2023-10-06T10:52:16.871 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-06T10:52:16.872 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412383 --name yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/scrub} --verbose --owner scheduled_yuriw@teuthology -- /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412383/orig.config.yaml 2023-10-06T10:52:16.916 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T10:52:17.003 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412383 branch: wip-yuri3-testing-2023-10-05-0943-quincy description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/scrub} email: yweinste@redhat.com first_in_suite: false job_id: '7412383' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: wip-yuri3-testing-2023-10-05-0943-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug ms: 1 mds cache max size: 1000 mds debug frag: true mds debug scatterstat: true mds log max segments: 1 mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - Replacing daemon mds - Scrub error on inode - Behind on trimming - Metadata damage detected - bad backtrace on inode - overall HEALTH_ - \(MDS_TRIM\) sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri3-testing-2023-10-05-0943-quincy sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 4002 sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri3-testing-2023-10-05-0943-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 targets: smithi146.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCxrCmBNDWnrQG363rGgvq+eUam0H+vsbvn8+swaGzRgm2B7vXHGTALrWWsghB8gHDgx270VrwKGtLH1Y6/RNS0= smithi151.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBETlmNbWzgqxqzZvjSqdDrYV2WKRkiFB3wtWmCw7Fa/hcUExw1PNaOi+l3Gbf6W1+rC0QmPLaTkzmyHFjATlIWA= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_scrub_checks - tasks.cephfs.test_scrub teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-05_23:54:57 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-06T10:52:17.003 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/qa; will attempt to use it 2023-10-06T10:52:17.004 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/qa/tasks 2023-10-06T10:52:17.004 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-06T10:52:17.006 INFO:teuthology.task.internal:Checking packages... 2023-10-06T10:52:17.032 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564' 2023-10-06T10:52:17.033 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-06T10:52:17.033 INFO:teuthology.packaging:ref: None 2023-10-06T10:52:17.033 INFO:teuthology.packaging:tag: None 2023-10-06T10:52:17.033 INFO:teuthology.packaging:branch: wip-yuri3-testing-2023-10-05-0943-quincy 2023-10-06T10:52:17.033 INFO:teuthology.packaging:sha1: 68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T10:52:17.033 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri3-testing-2023-10-05-0943-quincy 2023-10-06T10:52:17.249 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1274.g68e53a4a 2023-10-06T10:52:17.249 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-06T10:52:17.256 INFO:teuthology.task.internal:no buildpackages task found 2023-10-06T10:52:17.256 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-06T10:52:17.274 INFO:teuthology.task.internal:Saving configuration 2023-10-06T10:52:17.291 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-06T10:52:17.296 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T10:52:17.323 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi146.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412383', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 10:46:51.470704', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCxrCmBNDWnrQG363rGgvq+eUam0H+vsbvn8+swaGzRgm2B7vXHGTALrWWsghB8gHDgx270VrwKGtLH1Y6/RNS0='} 2023-10-06T10:52:17.347 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412383', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 10:46:51.469335', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBETlmNbWzgqxqzZvjSqdDrYV2WKRkiFB3wtWmCw7Fa/hcUExw1PNaOi+l3Gbf6W1+rC0QmPLaTkzmyHFjATlIWA='} 2023-10-06T10:52:17.347 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-06T10:52:17.353 INFO:teuthology.task.internal:roles: ubuntu@smithi146.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-06T10:52:17.353 INFO:teuthology.task.internal:roles: ubuntu@smithi151.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-06T10:52:17.353 INFO:teuthology.run_tasks:Running task console_log... 2023-10-06T10:52:17.426 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff7dcf1eb80>, signals=[15]) 2023-10-06T10:52:17.427 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-06T10:52:17.432 INFO:teuthology.task.internal:Opening connections... 2023-10-06T10:52:17.433 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi146.front.sepia.ceph.com 2023-10-06T10:52:17.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T10:52:17.504 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi151.front.sepia.ceph.com 2023-10-06T10:52:17.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T10:52:17.573 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-06T10:52:17.580 DEBUG:teuthology.orchestra.run.smithi146:> uname -m 2023-10-06T10:52:17.597 INFO:teuthology.orchestra.run.smithi146.stdout:x86_64 2023-10-06T10:52:17.598 DEBUG:teuthology.orchestra.run.smithi146:> cat /etc/os-release 2023-10-06T10:52:17.653 INFO:teuthology.orchestra.run.smithi146.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T10:52:17.654 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T10:52:17.654 INFO:teuthology.orchestra.run.smithi146.stdout:ID="rhel" 2023-10-06T10:52:17.654 INFO:teuthology.orchestra.run.smithi146.stdout:ID_LIKE="fedora" 2023-10-06T10:52:17.654 INFO:teuthology.orchestra.run.smithi146.stdout:VERSION_ID="8.4" 2023-10-06T10:52:17.654 INFO:teuthology.orchestra.run.smithi146.stdout:PLATFORM_ID="platform:el8" 2023-10-06T10:52:17.654 INFO:teuthology.orchestra.run.smithi146.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T10:52:17.654 INFO:teuthology.orchestra.run.smithi146.stdout:ANSI_COLOR="0;31" 2023-10-06T10:52:17.654 INFO:teuthology.orchestra.run.smithi146.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T10:52:17.654 INFO:teuthology.orchestra.run.smithi146.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T10:52:17.654 INFO:teuthology.orchestra.run.smithi146.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T10:52:17.654 INFO:teuthology.orchestra.run.smithi146.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T10:52:17.655 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T10:52:17.655 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T10:52:17.655 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T10:52:17.655 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T10:52:17.655 INFO:teuthology.orchestra.run.smithi146.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T10:52:17.656 INFO:teuthology.lock.ops:Updating smithi146.front.sepia.ceph.com on lock server 2023-10-06T10:52:17.677 DEBUG:teuthology.orchestra.run.smithi151:> uname -m 2023-10-06T10:52:17.694 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64 2023-10-06T10:52:17.695 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2023-10-06T10:52:17.751 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T10:52:17.751 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T10:52:17.751 INFO:teuthology.orchestra.run.smithi151.stdout:ID="rhel" 2023-10-06T10:52:17.751 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE="fedora" 2023-10-06T10:52:17.751 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="8.4" 2023-10-06T10:52:17.752 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM_ID="platform:el8" 2023-10-06T10:52:17.752 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T10:52:17.752 INFO:teuthology.orchestra.run.smithi151.stdout:ANSI_COLOR="0;31" 2023-10-06T10:52:17.752 INFO:teuthology.orchestra.run.smithi151.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T10:52:17.752 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T10:52:17.752 INFO:teuthology.orchestra.run.smithi151.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T10:52:17.752 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T10:52:17.753 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T10:52:17.753 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T10:52:17.753 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T10:52:17.753 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T10:52:17.753 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T10:52:17.754 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2023-10-06T10:52:17.777 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-06T10:52:17.786 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-06T10:52:17.812 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-06T10:52:17.813 DEBUG:teuthology.orchestra.run.smithi146:> test '!' -e /home/ubuntu/cephtest 2023-10-06T10:52:17.815 DEBUG:teuthology.orchestra.run.smithi151:> test '!' -e /home/ubuntu/cephtest 2023-10-06T10:52:17.831 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-06T10:52:17.837 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-06T10:52:17.837 DEBUG:teuthology.orchestra.run.smithi146:> test -z $(ls -A /var/lib/ceph) 2023-10-06T10:52:17.872 DEBUG:teuthology.orchestra.run.smithi151:> test -z $(ls -A /var/lib/ceph) 2023-10-06T10:52:17.887 INFO:teuthology.orchestra.run.smithi146.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-06T10:52:17.888 INFO:teuthology.orchestra.run.smithi151.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-06T10:52:17.889 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-06T10:52:17.942 INFO:teuthology.run_tasks:Running task kernel... 2023-10-06T10:52:17.958 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-10-06T10:52:17.958 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-10-06T10:52:17.959 DEBUG:teuthology.orchestra.run.smithi146:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T10:52:17.960 DEBUG:teuthology.orchestra.run.smithi151:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T10:52:17.975 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T10:52:17.976 DEBUG:teuthology.orchestra.run.smithi146:> uname -r 2023-10-06T10:52:17.977 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T10:52:17.977 DEBUG:teuthology.orchestra.run.smithi151:> uname -r 2023-10-06T10:52:18.032 INFO:teuthology.orchestra.run.smithi146.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-06T10:52:18.033 INFO:teuthology.task.kernel:Running kernel on smithi146: 4.18.0-305.25.1.el8_4.x86_64 2023-10-06T10:52:18.033 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum install -y kernel 2023-10-06T10:52:18.034 INFO:teuthology.orchestra.run.smithi151.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-06T10:52:18.034 INFO:teuthology.task.kernel:Running kernel on smithi151: 4.18.0-305.25.1.el8_4.x86_64 2023-10-06T10:52:18.034 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum install -y kernel 2023-10-06T10:52:19.466 INFO:teuthology.orchestra.run.smithi151.stdout:Updating Subscription Management repositories. 2023-10-06T10:52:19.467 INFO:teuthology.orchestra.run.smithi151.stdout:Unable to read consumer identity 2023-10-06T10:52:19.506 INFO:teuthology.orchestra.run.smithi146.stdout:Updating Subscription Management repositories. 2023-10-06T10:52:19.507 INFO:teuthology.orchestra.run.smithi146.stdout:Unable to read consumer identity 2023-10-06T10:52:20.886 INFO:teuthology.orchestra.run.smithi146.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2023-10-06T10:52:20.944 INFO:teuthology.orchestra.run.smithi151.stdout:Copr repo for python3-asyncssh owned by ceph 39 kB/s | 3.5 kB 00:00 2023-10-06T10:52:21.402 INFO:teuthology.orchestra.run.smithi146.stdout:Extra Packages for Enterprise Linux 34 MB/s | 16 MB 00:00 2023-10-06T10:52:22.001 INFO:teuthology.orchestra.run.smithi151.stdout:Extra Packages for Enterprise Linux 16 MB/s | 16 MB 00:01 2023-10-06T10:52:24.723 INFO:teuthology.orchestra.run.smithi146.stdout:lab-extras 4.6 MB/s | 24 kB 00:00 2023-10-06T10:52:25.288 INFO:teuthology.orchestra.run.smithi151.stdout:lab-extras 4.2 MB/s | 24 kB 00:00 2023-10-06T10:52:25.470 INFO:teuthology.orchestra.run.smithi146.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-06T10:52:25.470 INFO:teuthology.orchestra.run.smithi146.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-06T10:52:25.470 INFO:teuthology.orchestra.run.smithi146.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-06T10:52:25.624 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2023-10-06T10:52:25.625 INFO:teuthology.orchestra.run.smithi146.stdout:Nothing to do. 2023-10-06T10:52:25.625 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2023-10-06T10:52:25.744 DEBUG:teuthology.orchestra.run.smithi146:> echo no | sudo yum reinstall kernel || true 2023-10-06T10:52:26.002 INFO:teuthology.orchestra.run.smithi151.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-06T10:52:26.002 INFO:teuthology.orchestra.run.smithi151.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-06T10:52:26.003 INFO:teuthology.orchestra.run.smithi151.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-06T10:52:26.087 INFO:teuthology.orchestra.run.smithi146.stdout:Updating Subscription Management repositories. 2023-10-06T10:52:26.087 INFO:teuthology.orchestra.run.smithi146.stdout:Unable to read consumer identity 2023-10-06T10:52:26.173 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-10-06T10:52:26.174 INFO:teuthology.orchestra.run.smithi151.stdout:Nothing to do. 2023-10-06T10:52:26.174 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-10-06T10:52:26.295 DEBUG:teuthology.orchestra.run.smithi151:> echo no | sudo yum reinstall kernel || true 2023-10-06T10:52:26.385 INFO:teuthology.orchestra.run.smithi146.stdout:Last metadata expiration check: 0:00:02 ago on Fri 06 Oct 2023 10:52:24 AM UTC. 2023-10-06T10:52:26.511 INFO:teuthology.orchestra.run.smithi146.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T10:52:26.511 INFO:teuthology.orchestra.run.smithi146.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T10:52:26.511 INFO:teuthology.orchestra.run.smithi146.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T10:52:26.543 INFO:teuthology.orchestra.run.smithi146.stderr:Error: No packages marked for reinstall. 2023-10-06T10:52:26.593 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum reinstall -y kernel || true 2023-10-06T10:52:26.640 INFO:teuthology.orchestra.run.smithi151.stdout:Updating Subscription Management repositories. 2023-10-06T10:52:26.640 INFO:teuthology.orchestra.run.smithi151.stdout:Unable to read consumer identity 2023-10-06T10:52:26.929 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:00:01 ago on Fri 06 Oct 2023 10:52:25 AM UTC. 2023-10-06T10:52:26.936 INFO:teuthology.orchestra.run.smithi146.stdout:Updating Subscription Management repositories. 2023-10-06T10:52:26.937 INFO:teuthology.orchestra.run.smithi146.stdout:Unable to read consumer identity 2023-10-06T10:52:27.066 INFO:teuthology.orchestra.run.smithi151.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T10:52:27.067 INFO:teuthology.orchestra.run.smithi151.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T10:52:27.067 INFO:teuthology.orchestra.run.smithi151.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T10:52:27.090 INFO:teuthology.orchestra.run.smithi151.stderr:Error: No packages marked for reinstall. 2023-10-06T10:52:27.140 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum reinstall -y kernel || true 2023-10-06T10:52:27.218 INFO:teuthology.orchestra.run.smithi146.stdout:Last metadata expiration check: 0:00:03 ago on Fri 06 Oct 2023 10:52:24 AM UTC. 2023-10-06T10:52:27.343 INFO:teuthology.orchestra.run.smithi146.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T10:52:27.344 INFO:teuthology.orchestra.run.smithi146.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T10:52:27.344 INFO:teuthology.orchestra.run.smithi146.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T10:52:27.357 INFO:teuthology.orchestra.run.smithi146.stderr:Error: No packages marked for reinstall. 2023-10-06T10:52:27.410 DEBUG:teuthology.orchestra.run.smithi146:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T10:52:27.483 INFO:teuthology.orchestra.run.smithi151.stdout:Updating Subscription Management repositories. 2023-10-06T10:52:27.484 INFO:teuthology.orchestra.run.smithi151.stdout:Unable to read consumer identity 2023-10-06T10:52:27.535 INFO:teuthology.orchestra.run.smithi146.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T10:52:27.535 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T10:52:27.535 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-06T10:52:27.535 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-06T10:52:27.535 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-06T10:52:27.535 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-10-06T10:52:27.535 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi146.front.sepia.ceph.com, path=None, version=distro) 2023-10-06T10:52:27.536 DEBUG:teuthology.orchestra.run.smithi146:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T10:52:27.663 INFO:teuthology.orchestra.run.smithi146.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T10:52:27.663 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T10:52:27.663 DEBUG:teuthology.orchestra.run.smithi146:> sudo rpm -qi grub2-tools 2023-10-06T10:52:27.689 INFO:teuthology.orchestra.run.smithi146.stdout:Name : grub2-tools 2023-10-06T10:52:27.690 INFO:teuthology.orchestra.run.smithi146.stdout:Epoch : 1 2023-10-06T10:52:27.690 INFO:teuthology.orchestra.run.smithi146.stdout:Version : 2.02 2023-10-06T10:52:27.690 INFO:teuthology.orchestra.run.smithi146.stdout:Release : 99.el8_4.1 2023-10-06T10:52:27.690 INFO:teuthology.orchestra.run.smithi146.stdout:Architecture: x86_64 2023-10-06T10:52:27.690 INFO:teuthology.orchestra.run.smithi146.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-06T10:52:27.690 INFO:teuthology.orchestra.run.smithi146.stdout:Group : System Environment/Base 2023-10-06T10:52:27.690 INFO:teuthology.orchestra.run.smithi146.stdout:Size : 9264631 2023-10-06T10:52:27.690 INFO:teuthology.orchestra.run.smithi146.stdout:License : GPLv3+ 2023-10-06T10:52:27.690 INFO:teuthology.orchestra.run.smithi146.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-06T10:52:27.690 INFO:teuthology.orchestra.run.smithi146.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-06T10:52:27.691 INFO:teuthology.orchestra.run.smithi146.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-06T10:52:27.691 INFO:teuthology.orchestra.run.smithi146.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-06T10:52:27.691 INFO:teuthology.orchestra.run.smithi146.stdout:Relocations : (not relocatable) 2023-10-06T10:52:27.691 INFO:teuthology.orchestra.run.smithi146.stdout:Packager : Red Hat, Inc. 2023-10-06T10:52:27.691 INFO:teuthology.orchestra.run.smithi146.stdout:Vendor : Red Hat, Inc. 2023-10-06T10:52:27.691 INFO:teuthology.orchestra.run.smithi146.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T10:52:27.691 INFO:teuthology.orchestra.run.smithi146.stdout:Summary : Support tools for GRUB. 2023-10-06T10:52:27.691 INFO:teuthology.orchestra.run.smithi146.stdout:Description : 2023-10-06T10:52:27.691 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T10:52:27.691 INFO:teuthology.orchestra.run.smithi146.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T10:52:27.691 INFO:teuthology.orchestra.run.smithi146.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T10:52:27.692 INFO:teuthology.orchestra.run.smithi146.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T10:52:27.692 INFO:teuthology.orchestra.run.smithi146.stdout:hardware devices. 2023-10-06T10:52:27.692 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T10:52:27.692 INFO:teuthology.orchestra.run.smithi146.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T10:52:27.693 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T10:52:27.693 INFO:teuthology.task.kernel:Updating grub on smithi146 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-06T10:52:27.693 DEBUG:teuthology.orchestra.run.smithi146:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T10:52:27.766 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:00:02 ago on Fri 06 Oct 2023 10:52:25 AM UTC. 2023-10-06T10:52:27.899 INFO:teuthology.orchestra.run.smithi151.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T10:52:27.899 INFO:teuthology.orchestra.run.smithi151.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T10:52:27.900 INFO:teuthology.orchestra.run.smithi151.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T10:52:27.915 INFO:teuthology.orchestra.run.smithi151.stderr:Error: No packages marked for reinstall. 2023-10-06T10:52:27.971 DEBUG:teuthology.orchestra.run.smithi151:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T10:52:28.095 INFO:teuthology.orchestra.run.smithi151.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T10:52:28.095 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T10:52:28.095 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-06T10:52:28.095 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-06T10:52:28.095 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-06T10:52:28.095 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-10-06T10:52:28.095 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi151.front.sepia.ceph.com, path=None, version=distro) 2023-10-06T10:52:28.096 DEBUG:teuthology.orchestra.run.smithi151:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T10:52:28.220 INFO:teuthology.orchestra.run.smithi151.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T10:52:28.220 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T10:52:28.220 DEBUG:teuthology.orchestra.run.smithi151:> sudo rpm -qi grub2-tools 2023-10-06T10:52:28.247 INFO:teuthology.orchestra.run.smithi151.stdout:Name : grub2-tools 2023-10-06T10:52:28.248 INFO:teuthology.orchestra.run.smithi151.stdout:Epoch : 1 2023-10-06T10:52:28.248 INFO:teuthology.orchestra.run.smithi151.stdout:Version : 2.02 2023-10-06T10:52:28.248 INFO:teuthology.orchestra.run.smithi151.stdout:Release : 99.el8_4.1 2023-10-06T10:52:28.248 INFO:teuthology.orchestra.run.smithi151.stdout:Architecture: x86_64 2023-10-06T10:52:28.248 INFO:teuthology.orchestra.run.smithi151.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-06T10:52:28.248 INFO:teuthology.orchestra.run.smithi151.stdout:Group : System Environment/Base 2023-10-06T10:52:28.248 INFO:teuthology.orchestra.run.smithi151.stdout:Size : 9264631 2023-10-06T10:52:28.248 INFO:teuthology.orchestra.run.smithi151.stdout:License : GPLv3+ 2023-10-06T10:52:28.248 INFO:teuthology.orchestra.run.smithi151.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-06T10:52:28.248 INFO:teuthology.orchestra.run.smithi151.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-06T10:52:28.248 INFO:teuthology.orchestra.run.smithi151.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-06T10:52:28.248 INFO:teuthology.orchestra.run.smithi151.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-06T10:52:28.249 INFO:teuthology.orchestra.run.smithi151.stdout:Relocations : (not relocatable) 2023-10-06T10:52:28.249 INFO:teuthology.orchestra.run.smithi151.stdout:Packager : Red Hat, Inc. 2023-10-06T10:52:28.249 INFO:teuthology.orchestra.run.smithi151.stdout:Vendor : Red Hat, Inc. 2023-10-06T10:52:28.249 INFO:teuthology.orchestra.run.smithi151.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T10:52:28.249 INFO:teuthology.orchestra.run.smithi151.stdout:Summary : Support tools for GRUB. 2023-10-06T10:52:28.249 INFO:teuthology.orchestra.run.smithi151.stdout:Description : 2023-10-06T10:52:28.249 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T10:52:28.249 INFO:teuthology.orchestra.run.smithi151.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T10:52:28.249 INFO:teuthology.orchestra.run.smithi151.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T10:52:28.249 INFO:teuthology.orchestra.run.smithi151.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T10:52:28.249 INFO:teuthology.orchestra.run.smithi151.stdout:hardware devices. 2023-10-06T10:52:28.249 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T10:52:28.250 INFO:teuthology.orchestra.run.smithi151.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T10:52:28.250 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T10:52:28.250 INFO:teuthology.task.kernel:Updating grub on smithi151 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-06T10:52:28.251 DEBUG:teuthology.orchestra.run.smithi151:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T10:52:29.123 INFO:teuthology.orchestra.run.smithi146.stderr:Generating grub configuration file ... 2023-10-06T10:52:29.540 INFO:teuthology.orchestra.run.smithi151.stderr:Generating grub configuration file ... 2023-10-06T10:52:31.152 INFO:teuthology.orchestra.run.smithi146.stderr:done 2023-10-06T10:52:31.154 DEBUG:teuthology.orchestra.run.smithi146:> mktemp 2023-10-06T10:52:31.168 INFO:teuthology.orchestra.run.smithi146.stdout:/tmp/tmp.Mjt99g7unq 2023-10-06T10:52:31.168 DEBUG:teuthology.orchestra.run.smithi146:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Mjt99g7unq 2023-10-06T10:52:31.257 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0666 /tmp/tmp.Mjt99g7unq 2023-10-06T10:52:31.366 DEBUG:teuthology.orchestra.remote:smithi146:/tmp/tmp.Mjt99g7unq is 6KB 2023-10-06T10:52:31.372 INFO:teuthology.orchestra.run.smithi151.stderr:done 2023-10-06T10:52:31.374 DEBUG:teuthology.orchestra.run.smithi151:> mktemp 2023-10-06T10:52:31.414 DEBUG:teuthology.orchestra.run.smithi146:> rm -fr /tmp/tmp.Mjt99g7unq 2023-10-06T10:52:31.428 DEBUG:teuthology.orchestra.run.smithi146:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T10:52:31.429 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/tmp.O6gVkEiJyB 2023-10-06T10:52:31.429 DEBUG:teuthology.orchestra.run.smithi151:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.O6gVkEiJyB 2023-10-06T10:52:31.501 INFO:teuthology.orchestra.run.smithi146.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-06T10:52:31.501 INFO:teuthology.orchestra.run.smithi146.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-06T10:52:31.501 INFO:teuthology.orchestra.run.smithi146.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-06T10:52:31.501 INFO:teuthology.orchestra.run.smithi146.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-06T10:52:31.502 DEBUG:teuthology.orchestra.run.smithi146:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-06T10:52:31.516 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0666 /tmp/tmp.O6gVkEiJyB 2023-10-06T10:52:31.642 DEBUG:teuthology.orchestra.remote:smithi151:/tmp/tmp.O6gVkEiJyB is 6KB 2023-10-06T10:52:31.656 DEBUG:teuthology.orchestra.run.smithi146:> sudo shutdown -r now 2023-10-06T10:52:31.690 DEBUG:teuthology.orchestra.run.smithi151:> rm -fr /tmp/tmp.O6gVkEiJyB 2023-10-06T10:52:31.703 DEBUG:teuthology.orchestra.run.smithi151:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T10:52:31.777 INFO:teuthology.orchestra.run.smithi151.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-06T10:52:31.778 INFO:teuthology.orchestra.run.smithi151.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-06T10:52:31.778 INFO:teuthology.orchestra.run.smithi151.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-06T10:52:31.778 INFO:teuthology.orchestra.run.smithi151.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-06T10:52:31.779 DEBUG:teuthology.orchestra.run.smithi151:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-06T10:52:31.959 DEBUG:teuthology.orchestra.run.smithi151:> sudo shutdown -r now 2023-10-06T10:53:01.686 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-10-06T10:53:01.687 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-10-06T10:53:01.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T10:53:01.961 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-10-06T10:53:01.962 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-10-06T10:53:01.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T10:53:36.251 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-10-06T10:53:36.506 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-10-06T10:53:45.260 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-10-06T10:53:45.261 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T10:53:45.508 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-10-06T10:53:45.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T10:54:03.642 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.146 2023-10-06T10:54:03.902 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-10-06T10:54:15.654 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-10-06T10:54:15.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T10:54:15.904 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-10-06T10:54:15.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T10:54:17.457 DEBUG:teuthology.orchestra.run.smithi146:> true 2023-10-06T10:54:17.730 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-10-06T10:54:17.730 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-06T10:54:17.730 DEBUG:teuthology.orchestra.run.smithi146:> uname -r 2023-10-06T10:54:17.745 INFO:teuthology.orchestra.run.smithi146.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-06T10:54:17.745 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-06T10:54:17.745 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T10:54:17.745 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-06T10:54:17.828 DEBUG:teuthology.orchestra.run.smithi151:> true 2023-10-06T10:54:18.112 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-10-06T10:54:18.112 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-06T10:54:18.112 DEBUG:teuthology.orchestra.run.smithi151:> uname -r 2023-10-06T10:54:18.134 INFO:teuthology.orchestra.run.smithi151.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-06T10:54:18.135 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-06T10:54:18.135 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T10:54:18.135 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-06T10:54:18.746 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-06T10:54:18.747 DEBUG:teuthology.orchestra.run.smithi146:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-06T10:54:18.821 INFO:teuthology.orchestra.run.smithi146.stdout:ttyS1 2023-10-06T10:54:18.850 DEBUG:teuthology.parallel:result is None 2023-10-06T10:54:19.136 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-10-06T10:54:19.136 DEBUG:teuthology.orchestra.run.smithi151:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-06T10:54:19.256 INFO:teuthology.orchestra.run.smithi151.stdout:ttyS1 2023-10-06T10:54:19.273 DEBUG:teuthology.parallel:result is None 2023-10-06T10:54:19.273 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-06T10:54:19.288 INFO:teuthology.task.internal:Creating test directory... 2023-10-06T10:54:19.288 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T10:54:19.291 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T10:54:19.306 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-06T10:54:19.312 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-06T10:54:19.322 INFO:teuthology.task.internal:Creating archive directory... 2023-10-06T10:54:19.322 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T10:54:19.346 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T10:54:19.377 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-06T10:54:19.384 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-06T10:54:19.384 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T10:54:19.417 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T10:54:19.456 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T10:54:19.467 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T10:54:19.470 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T10:54:19.481 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T10:54:19.483 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-06T10:54:19.490 INFO:teuthology.task.internal:Configuring sudo... 2023-10-06T10:54:19.490 DEBUG:teuthology.orchestra.run.smithi146:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T10:54:19.495 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T10:54:19.533 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-06T10:54:19.547 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-06T10:54:19.547 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T10:54:19.563 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T10:54:19.589 DEBUG:teuthology.orchestra.run.smithi146:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T10:54:19.663 DEBUG:teuthology.orchestra.run.smithi146:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T10:54:19.704 DEBUG:teuthology.orchestra.run.smithi146:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T10:54:19.787 DEBUG:teuthology.orchestra.run.smithi146:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T10:54:19.826 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-06T10:54:19.826 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T10:54:19.908 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T10:54:19.949 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T10:54:20.001 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T10:54:20.082 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T10:54:20.122 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-06T10:54:20.122 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T10:54:20.200 DEBUG:teuthology.orchestra.run.smithi146:> sudo service rsyslog restart 2023-10-06T10:54:20.203 DEBUG:teuthology.orchestra.run.smithi151:> sudo service rsyslog restart 2023-10-06T10:54:20.275 INFO:teuthology.orchestra.run.smithi146.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T10:54:20.324 INFO:teuthology.orchestra.run.smithi151.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T10:54:20.466 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-06T10:54:20.474 INFO:teuthology.task.internal:Starting timer... 2023-10-06T10:54:20.474 INFO:teuthology.run_tasks:Running task pcp... 2023-10-06T10:54:20.497 INFO:teuthology.run_tasks:Running task selinux... 2023-10-06T10:54:20.505 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-10-06T10:54:20.505 DEBUG:teuthology.orchestra.run.smithi146:> sudo service auditd rotate 2023-10-06T10:54:20.593 INFO:teuthology.orchestra.run.smithi146.stdout:Rotating logs: [ OK ] 2023-10-06T10:54:20.595 DEBUG:teuthology.orchestra.run.smithi151:> sudo service auditd rotate 2023-10-06T10:54:20.676 INFO:teuthology.orchestra.run.smithi151.stdout:Rotating logs: [ OK ] 2023-10-06T10:54:20.678 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-06T10:54:20.678 DEBUG:teuthology.orchestra.run.smithi146:> /usr/sbin/getenforce 2023-10-06T10:54:20.700 INFO:teuthology.orchestra.run.smithi146.stdout:Permissive 2023-10-06T10:54:20.701 DEBUG:teuthology.orchestra.run.smithi151:> /usr/sbin/getenforce 2023-10-06T10:54:20.720 INFO:teuthology.orchestra.run.smithi151.stdout:Permissive 2023-10-06T10:54:20.721 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi146.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi151.front.sepia.ceph.com': 'permissive'} 2023-10-06T10:54:20.721 DEBUG:teuthology.orchestra.run.smithi146:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T10:54:20.765 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T10:54:20.766 DEBUG:teuthology.orchestra.run.smithi151:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T10:54:20.789 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T10:54:20.790 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-06T10:54:20.790 DEBUG:teuthology.orchestra.run.smithi146:> sudo /usr/sbin/setenforce permissive 2023-10-06T10:54:20.846 DEBUG:teuthology.orchestra.run.smithi151:> sudo /usr/sbin/setenforce permissive 2023-10-06T10:54:20.894 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-06T10:54:20.903 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-06T10:54:20.903 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-06T10:54:20.919 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-06T10:54:20.921 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi146.front.sepia.ceph.com,smithi151.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-06T11:02:31.610 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi146.front.sepia.ceph.com'), Remote(name='ubuntu@smithi151.front.sepia.ceph.com')] 2023-10-06T11:02:31.611 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-10-06T11:02:31.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi146.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:02:31.683 DEBUG:teuthology.orchestra.run.smithi146:> true 2023-10-06T11:02:31.750 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi146.front.sepia.ceph.com' 2023-10-06T11:02:31.750 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-10-06T11:02:31.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T11:02:31.820 DEBUG:teuthology.orchestra.run.smithi151:> true 2023-10-06T11:02:31.885 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-10-06T11:02:31.886 INFO:teuthology.run_tasks:Running task clock... 2023-10-06T11:02:31.898 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-06T11:02:31.898 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T11:02:31.899 DEBUG:teuthology.orchestra.run.smithi146:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T11:02:31.901 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T11:02:31.901 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T11:02:31.929 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T11:02:31.944 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T11:02:31.955 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T11:02:31.970 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T11:02:31.979 INFO:teuthology.orchestra.run.smithi146.stderr:sudo: ntpd: command not found 2023-10-06T11:02:31.989 INFO:teuthology.orchestra.run.smithi146.stdout:506 Cannot talk to daemon 2023-10-06T11:02:32.002 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T11:02:32.011 INFO:teuthology.orchestra.run.smithi151.stderr:sudo: ntpd: command not found 2023-10-06T11:02:32.016 INFO:teuthology.orchestra.run.smithi146.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T11:02:32.022 INFO:teuthology.orchestra.run.smithi151.stdout:506 Cannot talk to daemon 2023-10-06T11:02:32.036 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T11:02:32.050 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T11:02:32.086 INFO:teuthology.orchestra.run.smithi146.stderr:bash: ntpq: command not found 2023-10-06T11:02:32.089 INFO:teuthology.orchestra.run.smithi146.stdout:210 Number of sources = 4 2023-10-06T11:02:32.089 INFO:teuthology.orchestra.run.smithi146.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T11:02:32.089 INFO:teuthology.orchestra.run.smithi146.stdout:=============================================================================== 2023-10-06T11:02:32.089 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T11:02:32.090 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T11:02:32.090 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T11:02:32.090 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T11:02:32.112 INFO:teuthology.orchestra.run.smithi151.stderr:bash: ntpq: command not found 2023-10-06T11:02:32.115 INFO:teuthology.orchestra.run.smithi151.stdout:210 Number of sources = 4 2023-10-06T11:02:32.115 INFO:teuthology.orchestra.run.smithi151.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T11:02:32.116 INFO:teuthology.orchestra.run.smithi151.stdout:=============================================================================== 2023-10-06T11:02:32.116 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T11:02:32.116 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T11:02:32.116 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T11:02:32.116 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T11:02:32.116 INFO:teuthology.run_tasks:Running task install... 2023-10-06T11:02:32.124 DEBUG:teuthology.task.install:project ceph 2023-10-06T11:02:32.124 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}} 2023-10-06T11:02:32.124 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'} 2023-10-06T11:02:32.124 INFO:teuthology.task.install:Using flavor: default 2023-10-06T11:02:32.130 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-06T11:02:32.130 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-06T11:02:32.130 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564', 'tag': None, 'wait_for_package': False} 2023-10-06T11:02:32.130 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T11:02:32.132 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564', 'tag': None, 'wait_for_package': False} 2023-10-06T11:02:32.132 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T11:02:32.270 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/ 2023-10-06T11:02:32.270 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1274.g68e53a4a 2023-10-06T11:02:32.277 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/ 2023-10-06T11:02:32.278 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1274.g68e53a4a 2023-10-06T11:02:32.479 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T11:02:32.480 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-06T11:02:32.480 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T11:02:32.505 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-06T11:02:32.505 DEBUG:teuthology.orchestra.run.smithi146:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T11:02:32.527 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-10-05-0943-quincy/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T11:02:32.528 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-06T11:02:32.528 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T11:02:32.552 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-06T11:02:32.552 DEBUG:teuthology.orchestra.run.smithi151:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T11:02:32.570 DEBUG:teuthology.orchestra.run.smithi146:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T11:02:32.616 DEBUG:teuthology.orchestra.run.smithi151:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T11:02:32.644 DEBUG:teuthology.orchestra.run.smithi146:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T11:02:32.691 DEBUG:teuthology.orchestra.run.smithi151:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T11:02:32.708 INFO:teuthology.orchestra.run.smithi146.stdout:check_obsoletes = 1 2023-10-06T11:02:32.710 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum clean all 2023-10-06T11:02:32.754 INFO:teuthology.orchestra.run.smithi151.stdout:check_obsoletes = 1 2023-10-06T11:02:32.756 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum clean all 2023-10-06T11:02:33.101 INFO:teuthology.orchestra.run.smithi146.stdout:Updating Subscription Management repositories. 2023-10-06T11:02:33.148 INFO:teuthology.orchestra.run.smithi151.stdout:Updating Subscription Management repositories. 2023-10-06T11:02:34.315 INFO:teuthology.orchestra.run.smithi151.stdout:44 files removed 2023-10-06T11:02:34.362 INFO:teuthology.orchestra.run.smithi146.stdout:44 files removed 2023-10-06T11:02:34.369 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-06T11:02:34.423 DEBUG:teuthology.orchestra.run.smithi146:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-06T11:02:34.720 INFO:teuthology.orchestra.run.smithi151.stdout:Updating Subscription Management repositories. 2023-10-06T11:02:34.778 INFO:teuthology.orchestra.run.smithi146.stdout:Updating Subscription Management repositories. 2023-10-06T11:02:35.672 INFO:teuthology.orchestra.run.smithi151.stdout:ceph packages for x86_64 276 kB/s | 78 kB 00:00 2023-10-06T11:02:35.673 INFO:teuthology.orchestra.run.smithi146.stdout:ceph packages for x86_64 345 kB/s | 78 kB 00:00 2023-10-06T11:02:35.898 INFO:teuthology.orchestra.run.smithi146.stdout:ceph noarch packages 50 kB/s | 9.2 kB 00:00 2023-10-06T11:02:36.021 INFO:teuthology.orchestra.run.smithi151.stdout:ceph noarch packages 30 kB/s | 9.2 kB 00:00 2023-10-06T11:02:36.231 INFO:teuthology.orchestra.run.smithi146.stdout:ceph source packages 4.8 kB/s | 1.4 kB 00:00 2023-10-06T11:02:36.346 INFO:teuthology.orchestra.run.smithi151.stdout:ceph source packages 4.9 kB/s | 1.4 kB 00:00 2023-10-06T11:02:36.371 INFO:teuthology.orchestra.run.smithi146.stdout:Copr repo for python3-asyncssh owned by ceph 31 kB/s | 3.5 kB 00:00 2023-10-06T11:02:36.456 INFO:teuthology.orchestra.run.smithi151.stdout:Copr repo for python3-asyncssh owned by ceph 43 kB/s | 3.5 kB 00:00 2023-10-06T11:02:36.966 INFO:teuthology.orchestra.run.smithi151.stdout:Extra Packages for Enterprise Linux 33 MB/s | 16 MB 00:00 2023-10-06T11:02:37.902 INFO:teuthology.orchestra.run.smithi146.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2023-10-06T11:02:40.309 INFO:teuthology.orchestra.run.smithi151.stdout:lab-extras 1.7 MB/s | 24 kB 00:00 2023-10-06T11:02:40.709 INFO:teuthology.orchestra.run.smithi151.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 121 MB/s | 38 MB 00:00 2023-10-06T11:02:41.263 INFO:teuthology.orchestra.run.smithi146.stdout:lab-extras 4.8 MB/s | 24 kB 00:00 2023-10-06T11:02:41.620 INFO:teuthology.orchestra.run.smithi146.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 119 MB/s | 33 MB 00:00 2023-10-06T11:02:46.274 INFO:teuthology.orchestra.run.smithi151.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 120 MB/s | 33 MB 00:00 2023-10-06T11:02:46.707 INFO:teuthology.orchestra.run.smithi146.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 128 MB/s | 38 MB 00:00 2023-10-06T11:02:54.173 INFO:teuthology.orchestra.run.smithi151.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T11:02:54.174 INFO:teuthology.orchestra.run.smithi151.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T11:02:54.184 INFO:teuthology.orchestra.run.smithi151.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-06T11:02:54.185 INFO:teuthology.orchestra.run.smithi151.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-06T11:02:54.186 INFO:teuthology.orchestra.run.smithi151.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-06T11:02:54.187 INFO:teuthology.orchestra.run.smithi151.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T11:02:54.189 INFO:teuthology.orchestra.run.smithi151.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T11:02:54.191 INFO:teuthology.orchestra.run.smithi151.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-06T11:02:54.192 INFO:teuthology.orchestra.run.smithi151.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-06T11:02:54.681 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-10-06T11:02:54.691 INFO:teuthology.orchestra.run.smithi151.stdout:====================================================================================================================== 2023-10-06T11:02:54.692 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2023-10-06T11:02:54.692 INFO:teuthology.orchestra.run.smithi151.stdout:====================================================================================================================== 2023-10-06T11:02:54.692 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2023-10-06T11:02:54.692 INFO:teuthology.orchestra.run.smithi151.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-06T11:02:54.692 INFO:teuthology.orchestra.run.smithi151.stdout: ceph x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 6.4 k 2023-10-06T11:02:54.692 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 5.2 M 2023-10-06T11:02:54.692 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-fuse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 877 k 2023-10-06T11:02:54.692 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 162 k 2023-10-06T11:02:54.692 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 1.6 M 2023-10-06T11:02:54.692 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 121 k 2023-10-06T11:02:54.692 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 1.7 M 2023-10-06T11:02:54.692 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 7.4 M 2023-10-06T11:02:54.693 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-rook noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 47 k 2023-10-06T11:02:54.693 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-radosgw x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 17 M 2023-10-06T11:02:54.693 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-test x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 52 M 2023-10-06T11:02:54.693 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-volume noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 267 k 2023-10-06T11:02:54.693 INFO:teuthology.orchestra.run.smithi151.stdout: cephadm noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 80 k 2023-10-06T11:02:54.693 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-mirror x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 255 k 2023-10-06T11:02:54.693 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-top noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 18 k 2023-10-06T11:02:54.693 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-06T11:02:54.693 INFO:teuthology.orchestra.run.smithi151.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-06T11:02:54.693 INFO:teuthology.orchestra.run.smithi151.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-06T11:02:54.693 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs-devel x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 25 k 2023-10-06T11:02:54.693 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 797 k 2023-10-06T11:02:54.694 INFO:teuthology.orchestra.run.smithi151.stdout: librados-devel x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 130 k 2023-10-06T11:02:54.694 INFO:teuthology.orchestra.run.smithi151.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-06T11:02:54.694 INFO:teuthology.orchestra.run.smithi151.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-06T11:02:54.694 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-06T11:02:54.694 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cephfs x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 190 k 2023-10-06T11:02:54.694 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rados x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 371 k 2023-10-06T11:02:54.694 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rbd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 358 k 2023-10-06T11:02:54.694 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rgw x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 107 k 2023-10-06T11:02:54.694 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-fuse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 91 k 2023-10-06T11:02:54.694 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-mirror x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.5 M 2023-10-06T11:02:54.694 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-nbd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 173 k 2023-10-06T11:02:54.695 INFO:teuthology.orchestra.run.smithi151.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-06T11:02:54.695 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrading: 2023-10-06T11:02:54.695 INFO:teuthology.orchestra.run.smithi151.stdout: librados2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.4 M 2023-10-06T11:02:54.695 INFO:teuthology.orchestra.run.smithi151.stdout: librbd1 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.5 M 2023-10-06T11:02:54.695 INFO:teuthology.orchestra.run.smithi151.stdout:Installing dependencies: 2023-10-06T11:02:54.695 INFO:teuthology.orchestra.run.smithi151.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-06T11:02:54.695 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-common x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 23 M 2023-10-06T11:02:54.695 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 23 k 2023-10-06T11:02:54.695 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mds x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 2.3 M 2023-10-06T11:02:54.695 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 238 k 2023-10-06T11:02:54.695 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mon x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.9 M 2023-10-06T11:02:54.695 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-osd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 17 M 2023-10-06T11:02:54.696 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 14 k 2023-10-06T11:02:54.696 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-selinux x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 24 k 2023-10-06T11:02:54.696 INFO:teuthology.orchestra.run.smithi151.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-06T11:02:54.696 INFO:teuthology.orchestra.run.smithi151.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T11:02:54.696 INFO:teuthology.orchestra.run.smithi151.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-06T11:02:54.696 INFO:teuthology.orchestra.run.smithi151.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-06T11:02:54.696 INFO:teuthology.orchestra.run.smithi151.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-06T11:02:54.696 INFO:teuthology.orchestra.run.smithi151.stdout: libcephsqlite x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 175 k 2023-10-06T11:02:54.696 INFO:teuthology.orchestra.run.smithi151.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-06T11:02:54.696 INFO:teuthology.orchestra.run.smithi151.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-06T11:02:54.696 INFO:teuthology.orchestra.run.smithi151.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T11:02:54.696 INFO:teuthology.orchestra.run.smithi151.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-06T11:02:54.697 INFO:teuthology.orchestra.run.smithi151.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-06T11:02:54.697 INFO:teuthology.orchestra.run.smithi151.stdout: libradosstriper1 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 506 k 2023-10-06T11:02:54.697 INFO:teuthology.orchestra.run.smithi151.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-06T11:02:54.697 INFO:teuthology.orchestra.run.smithi151.stdout: librgw2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 5.6 M 2023-10-06T11:02:54.697 INFO:teuthology.orchestra.run.smithi151.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-06T11:02:54.697 INFO:teuthology.orchestra.run.smithi151.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-06T11:02:54.697 INFO:teuthology.orchestra.run.smithi151.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T11:02:54.697 INFO:teuthology.orchestra.run.smithi151.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-06T11:02:54.697 INFO:teuthology.orchestra.run.smithi151.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-06T11:02:54.697 INFO:teuthology.orchestra.run.smithi151.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-06T11:02:54.697 INFO:teuthology.orchestra.run.smithi151.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-06T11:02:54.697 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-06T11:02:54.698 INFO:teuthology.orchestra.run.smithi151.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-06T11:02:54.698 INFO:teuthology.orchestra.run.smithi151.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-06T11:02:54.698 INFO:teuthology.orchestra.run.smithi151.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-06T11:02:54.698 INFO:teuthology.orchestra.run.smithi151.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T11:02:54.698 INFO:teuthology.orchestra.run.smithi151.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-06T11:02:54.698 INFO:teuthology.orchestra.run.smithi151.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T11:02:54.698 INFO:teuthology.orchestra.run.smithi151.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T11:02:54.698 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T11:02:54.698 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-argparse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 45 k 2023-10-06T11:02:54.698 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 115 k 2023-10-06T11:02:54.698 INFO:teuthology.orchestra.run.smithi151.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T11:02:54.698 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T11:02:54.699 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T11:02:54.699 INFO:teuthology.orchestra.run.smithi151.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T11:02:54.699 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T11:02:54.699 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T11:02:54.699 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-06T11:02:54.699 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-06T11:02:54.699 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-06T11:02:54.699 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T11:02:54.699 INFO:teuthology.orchestra.run.smithi151.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T11:02:54.699 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T11:02:54.699 INFO:teuthology.orchestra.run.smithi151.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-06T11:02:54.699 INFO:teuthology.orchestra.run.smithi151.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-06T11:02:54.700 INFO:teuthology.orchestra.run.smithi151.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T11:02:54.700 INFO:teuthology.orchestra.run.smithi151.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T11:02:54.700 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-06T11:02:54.700 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-06T11:02:54.700 INFO:teuthology.orchestra.run.smithi151.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-06T11:02:54.700 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T11:02:54.700 INFO:teuthology.orchestra.run.smithi151.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T11:02:54.700 INFO:teuthology.orchestra.run.smithi151.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-06T11:02:54.700 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-06T11:02:54.701 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-06T11:02:54.701 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-06T11:02:54.701 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T11:02:54.701 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T11:02:54.701 INFO:teuthology.orchestra.run.smithi151.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T11:02:54.701 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T11:02:54.701 INFO:teuthology.orchestra.run.smithi151.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-06T11:02:54.701 INFO:teuthology.orchestra.run.smithi151.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T11:02:54.701 INFO:teuthology.orchestra.run.smithi151.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T11:02:54.701 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T11:02:54.701 INFO:teuthology.orchestra.run.smithi151.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T11:02:54.701 INFO:teuthology.orchestra.run.smithi151.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T11:02:54.702 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T11:02:54.702 INFO:teuthology.orchestra.run.smithi151.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T11:02:54.702 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T11:02:54.702 INFO:teuthology.orchestra.run.smithi151.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-06T11:02:54.702 INFO:teuthology.orchestra.run.smithi151.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T11:02:54.702 INFO:teuthology.orchestra.run.smithi151.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-06T11:02:54.702 INFO:teuthology.orchestra.run.smithi151.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T11:02:54.702 INFO:teuthology.orchestra.run.smithi151.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-06T11:02:54.702 INFO:teuthology.orchestra.run.smithi151.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-06T11:02:54.702 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:02:54.702 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2023-10-06T11:02:54.703 INFO:teuthology.orchestra.run.smithi151.stdout:====================================================================================================================== 2023-10-06T11:02:54.703 INFO:teuthology.orchestra.run.smithi151.stdout:Install 118 Packages 2023-10-06T11:02:54.703 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrade 2 Packages 2023-10-06T11:02:54.703 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:02:54.703 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 201 M 2023-10-06T11:02:54.703 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2023-10-06T11:02:54.852 INFO:teuthology.orchestra.run.smithi151.stdout:(1/120): ceph-17.2.6-1274.g68e53a4a.el8.x86_64. 71 kB/s | 6.4 kB 00:00 2023-10-06T11:02:55.004 INFO:teuthology.orchestra.run.smithi146.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T11:02:55.004 INFO:teuthology.orchestra.run.smithi146.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T11:02:55.015 INFO:teuthology.orchestra.run.smithi146.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-06T11:02:55.016 INFO:teuthology.orchestra.run.smithi146.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-06T11:02:55.017 INFO:teuthology.orchestra.run.smithi146.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-06T11:02:55.018 INFO:teuthology.orchestra.run.smithi146.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T11:02:55.019 INFO:teuthology.orchestra.run.smithi146.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T11:02:55.022 INFO:teuthology.orchestra.run.smithi146.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-06T11:02:55.023 INFO:teuthology.orchestra.run.smithi146.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-06T11:02:55.032 INFO:teuthology.orchestra.run.smithi151.stdout:(2/120): ceph-fuse-17.2.6-1274.g68e53a4a.el8.x8 4.8 MB/s | 877 kB 00:00 2023-10-06T11:02:55.192 INFO:teuthology.orchestra.run.smithi151.stdout:(3/120): ceph-immutable-object-cache-17.2.6-127 1.0 MB/s | 162 kB 00:00 2023-10-06T11:02:55.432 INFO:teuthology.orchestra.run.smithi151.stdout:(4/120): ceph-mds-17.2.6-1274.g68e53a4a.el8.x86 9.6 MB/s | 2.3 MB 00:00 2023-10-06T11:02:55.520 INFO:teuthology.orchestra.run.smithi146.stdout:Dependencies resolved. 2023-10-06T11:02:55.531 INFO:teuthology.orchestra.run.smithi146.stdout:====================================================================================================================== 2023-10-06T11:02:55.531 INFO:teuthology.orchestra.run.smithi146.stdout: Package Arch Version Repository Size 2023-10-06T11:02:55.531 INFO:teuthology.orchestra.run.smithi146.stdout:====================================================================================================================== 2023-10-06T11:02:55.531 INFO:teuthology.orchestra.run.smithi146.stdout:Installing: 2023-10-06T11:02:55.531 INFO:teuthology.orchestra.run.smithi146.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-06T11:02:55.531 INFO:teuthology.orchestra.run.smithi146.stdout: ceph x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 6.4 k 2023-10-06T11:02:55.532 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-base x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 5.2 M 2023-10-06T11:02:55.532 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-fuse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 877 k 2023-10-06T11:02:55.532 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 162 k 2023-10-06T11:02:55.532 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 1.6 M 2023-10-06T11:02:55.532 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 121 k 2023-10-06T11:02:55.532 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 1.7 M 2023-10-06T11:02:55.532 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 7.4 M 2023-10-06T11:02:55.532 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-rook noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 47 k 2023-10-06T11:02:55.532 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-radosgw x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 17 M 2023-10-06T11:02:55.532 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-test x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 52 M 2023-10-06T11:02:55.532 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-volume noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 267 k 2023-10-06T11:02:55.532 INFO:teuthology.orchestra.run.smithi146.stdout: cephadm noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 80 k 2023-10-06T11:02:55.533 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-mirror x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 255 k 2023-10-06T11:02:55.533 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-top noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 18 k 2023-10-06T11:02:55.533 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-06T11:02:55.533 INFO:teuthology.orchestra.run.smithi146.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-06T11:02:55.533 INFO:teuthology.orchestra.run.smithi146.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-06T11:02:55.533 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs-devel x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 25 k 2023-10-06T11:02:55.533 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 797 k 2023-10-06T11:02:55.533 INFO:teuthology.orchestra.run.smithi146.stdout: librados-devel x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 130 k 2023-10-06T11:02:55.533 INFO:teuthology.orchestra.run.smithi146.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-06T11:02:55.533 INFO:teuthology.orchestra.run.smithi146.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-06T11:02:55.533 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-06T11:02:55.533 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cephfs x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 190 k 2023-10-06T11:02:55.533 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rados x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 371 k 2023-10-06T11:02:55.534 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rbd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 358 k 2023-10-06T11:02:55.534 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rgw x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 107 k 2023-10-06T11:02:55.534 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-fuse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 91 k 2023-10-06T11:02:55.534 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-mirror x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.5 M 2023-10-06T11:02:55.534 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-nbd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 173 k 2023-10-06T11:02:55.534 INFO:teuthology.orchestra.run.smithi146.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-06T11:02:55.534 INFO:teuthology.orchestra.run.smithi146.stdout:Upgrading: 2023-10-06T11:02:55.534 INFO:teuthology.orchestra.run.smithi146.stdout: librados2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.4 M 2023-10-06T11:02:55.534 INFO:teuthology.orchestra.run.smithi146.stdout: librbd1 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.5 M 2023-10-06T11:02:55.534 INFO:teuthology.orchestra.run.smithi146.stdout:Installing dependencies: 2023-10-06T11:02:55.534 INFO:teuthology.orchestra.run.smithi146.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-06T11:02:55.535 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-common x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 23 M 2023-10-06T11:02:55.535 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 23 k 2023-10-06T11:02:55.535 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mds x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 2.3 M 2023-10-06T11:02:55.535 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 238 k 2023-10-06T11:02:55.535 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mon x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 3.9 M 2023-10-06T11:02:55.535 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-osd x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 17 M 2023-10-06T11:02:55.535 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1274.g68e53a4a.el8 ceph-noarch 14 k 2023-10-06T11:02:55.535 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-selinux x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 24 k 2023-10-06T11:02:55.535 INFO:teuthology.orchestra.run.smithi146.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-06T11:02:55.535 INFO:teuthology.orchestra.run.smithi146.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T11:02:55.535 INFO:teuthology.orchestra.run.smithi146.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-06T11:02:55.535 INFO:teuthology.orchestra.run.smithi146.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-06T11:02:55.536 INFO:teuthology.orchestra.run.smithi146.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-06T11:02:55.536 INFO:teuthology.orchestra.run.smithi146.stdout: libcephsqlite x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 175 k 2023-10-06T11:02:55.536 INFO:teuthology.orchestra.run.smithi146.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-06T11:02:55.536 INFO:teuthology.orchestra.run.smithi146.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-06T11:02:55.536 INFO:teuthology.orchestra.run.smithi146.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T11:02:55.536 INFO:teuthology.orchestra.run.smithi146.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-06T11:02:55.536 INFO:teuthology.orchestra.run.smithi146.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-06T11:02:55.536 INFO:teuthology.orchestra.run.smithi146.stdout: libradosstriper1 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 506 k 2023-10-06T11:02:55.536 INFO:teuthology.orchestra.run.smithi146.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-06T11:02:55.536 INFO:teuthology.orchestra.run.smithi146.stdout: librgw2 x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 5.6 M 2023-10-06T11:02:55.536 INFO:teuthology.orchestra.run.smithi146.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-06T11:02:55.536 INFO:teuthology.orchestra.run.smithi146.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-06T11:02:55.537 INFO:teuthology.orchestra.run.smithi146.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T11:02:55.537 INFO:teuthology.orchestra.run.smithi146.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-06T11:02:55.537 INFO:teuthology.orchestra.run.smithi146.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-06T11:02:55.537 INFO:teuthology.orchestra.run.smithi146.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-06T11:02:55.537 INFO:teuthology.orchestra.run.smithi146.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-06T11:02:55.537 INFO:teuthology.orchestra.run.smithi146.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-06T11:02:55.537 INFO:teuthology.orchestra.run.smithi146.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-06T11:02:55.537 INFO:teuthology.orchestra.run.smithi146.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-06T11:02:55.537 INFO:teuthology.orchestra.run.smithi146.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-06T11:02:55.537 INFO:teuthology.orchestra.run.smithi146.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T11:02:55.537 INFO:teuthology.orchestra.run.smithi146.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-06T11:02:55.537 INFO:teuthology.orchestra.run.smithi146.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T11:02:55.538 INFO:teuthology.orchestra.run.smithi146.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T11:02:55.538 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T11:02:55.538 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-argparse x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 45 k 2023-10-06T11:02:55.538 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-common x86_64 2:17.2.6-1274.g68e53a4a.el8 ceph 115 k 2023-10-06T11:02:55.538 INFO:teuthology.orchestra.run.smithi146.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T11:02:55.538 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T11:02:55.538 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T11:02:55.538 INFO:teuthology.orchestra.run.smithi146.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T11:02:55.538 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T11:02:55.538 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T11:02:55.538 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-06T11:02:55.538 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-06T11:02:55.539 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-06T11:02:55.539 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T11:02:55.539 INFO:teuthology.orchestra.run.smithi146.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T11:02:55.539 INFO:teuthology.orchestra.run.smithi146.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T11:02:55.539 INFO:teuthology.orchestra.run.smithi146.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-06T11:02:55.539 INFO:teuthology.orchestra.run.smithi146.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-06T11:02:55.539 INFO:teuthology.orchestra.run.smithi146.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T11:02:55.539 INFO:teuthology.orchestra.run.smithi146.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T11:02:55.539 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-06T11:02:55.539 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-06T11:02:55.539 INFO:teuthology.orchestra.run.smithi146.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-06T11:02:55.539 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T11:02:55.540 INFO:teuthology.orchestra.run.smithi146.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T11:02:55.540 INFO:teuthology.orchestra.run.smithi146.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-06T11:02:55.540 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-06T11:02:55.540 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-06T11:02:55.540 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-06T11:02:55.540 INFO:teuthology.orchestra.run.smithi146.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T11:02:55.540 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T11:02:55.540 INFO:teuthology.orchestra.run.smithi146.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T11:02:55.540 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T11:02:55.540 INFO:teuthology.orchestra.run.smithi146.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-06T11:02:55.540 INFO:teuthology.orchestra.run.smithi146.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T11:02:55.540 INFO:teuthology.orchestra.run.smithi146.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T11:02:55.540 INFO:teuthology.orchestra.run.smithi146.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T11:02:55.541 INFO:teuthology.orchestra.run.smithi146.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T11:02:55.541 INFO:teuthology.orchestra.run.smithi146.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T11:02:55.541 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T11:02:55.541 INFO:teuthology.orchestra.run.smithi146.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T11:02:55.541 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T11:02:55.541 INFO:teuthology.orchestra.run.smithi146.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-06T11:02:55.541 INFO:teuthology.orchestra.run.smithi146.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T11:02:55.541 INFO:teuthology.orchestra.run.smithi146.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-06T11:02:55.541 INFO:teuthology.orchestra.run.smithi146.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T11:02:55.541 INFO:teuthology.orchestra.run.smithi146.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-06T11:02:55.541 INFO:teuthology.orchestra.run.smithi146.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-06T11:02:55.541 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:02:55.542 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction Summary 2023-10-06T11:02:55.542 INFO:teuthology.orchestra.run.smithi146.stdout:====================================================================================================================== 2023-10-06T11:02:55.542 INFO:teuthology.orchestra.run.smithi146.stdout:Install 118 Packages 2023-10-06T11:02:55.542 INFO:teuthology.orchestra.run.smithi146.stdout:Upgrade 2 Packages 2023-10-06T11:02:55.542 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:02:55.542 INFO:teuthology.orchestra.run.smithi146.stdout:Total download size: 201 M 2023-10-06T11:02:55.543 INFO:teuthology.orchestra.run.smithi146.stdout:Downloading Packages: 2023-10-06T11:02:55.596 INFO:teuthology.orchestra.run.smithi151.stdout:(5/120): ceph-mgr-17.2.6-1274.g68e53a4a.el8.x86 9.6 MB/s | 1.6 MB 00:00 2023-10-06T11:02:55.655 INFO:teuthology.orchestra.run.smithi151.stdout:(6/120): ceph-base-17.2.6-1274.g68e53a4a.el8.x8 5.8 MB/s | 5.2 MB 00:00 2023-10-06T11:02:56.037 INFO:teuthology.orchestra.run.smithi146.stdout:(1/120): ceph-17.2.6-1274.g68e53a4a.el8.x86_64. 46 kB/s | 6.4 kB 00:00 2023-10-06T11:02:56.117 INFO:teuthology.orchestra.run.smithi151.stdout:(7/120): ceph-mon-17.2.6-1274.g68e53a4a.el8.x86 7.6 MB/s | 3.9 MB 00:00 2023-10-06T11:02:56.756 INFO:teuthology.orchestra.run.smithi146.stdout:(2/120): ceph-fuse-17.2.6-1274.g68e53a4a.el8.x8 1.2 MB/s | 877 kB 00:00 2023-10-06T11:02:56.776 INFO:teuthology.orchestra.run.smithi151.stdout:(8/120): ceph-common-17.2.6-1274.g68e53a4a.el8. 12 MB/s | 23 MB 00:02 2023-10-06T11:02:56.816 INFO:teuthology.orchestra.run.smithi146.stdout:(3/120): ceph-immutable-object-cache-17.2.6-127 2.7 MB/s | 162 kB 00:00 2023-10-06T11:02:56.828 INFO:teuthology.orchestra.run.smithi151.stdout:(9/120): ceph-selinux-17.2.6-1274.g68e53a4a.el8 468 kB/s | 24 kB 00:00 2023-10-06T11:02:57.859 INFO:teuthology.orchestra.run.smithi151.stdout:(10/120): ceph-osd-17.2.6-1274.g68e53a4a.el8.x8 7.6 MB/s | 17 MB 00:02 2023-10-06T11:02:57.921 INFO:teuthology.orchestra.run.smithi151.stdout:(11/120): cephfs-mirror-17.2.6-1274.g68e53a4a.e 4.1 MB/s | 255 kB 00:00 2023-10-06T11:02:57.978 INFO:teuthology.orchestra.run.smithi151.stdout:(12/120): libcephfs-devel-17.2.6-1274.g68e53a4a 436 kB/s | 25 kB 00:00 2023-10-06T11:02:57.999 INFO:teuthology.orchestra.run.smithi146.stdout:(4/120): ceph-mds-17.2.6-1274.g68e53a4a.el8.x86 1.9 MB/s | 2.3 MB 00:01 2023-10-06T11:02:58.176 INFO:teuthology.orchestra.run.smithi151.stdout:(13/120): libcephfs2-17.2.6-1274.g68e53a4a.el8. 3.9 MB/s | 797 kB 00:00 2023-10-06T11:02:58.243 INFO:teuthology.orchestra.run.smithi151.stdout:(14/120): libcephsqlite-17.2.6-1274.g68e53a4a.e 2.6 MB/s | 175 kB 00:00 2023-10-06T11:02:58.306 INFO:teuthology.orchestra.run.smithi151.stdout:(15/120): librados-devel-17.2.6-1274.g68e53a4a. 2.0 MB/s | 130 kB 00:00 2023-10-06T11:02:58.446 INFO:teuthology.orchestra.run.smithi151.stdout:(16/120): libradosstriper1-17.2.6-1274.g68e53a4 3.6 MB/s | 506 kB 00:00 2023-10-06T11:02:58.838 INFO:teuthology.orchestra.run.smithi146.stdout:(5/120): ceph-mgr-17.2.6-1274.g68e53a4a.el8.x86 1.9 MB/s | 1.6 MB 00:00 2023-10-06T11:02:59.691 INFO:teuthology.orchestra.run.smithi151.stdout:(17/120): ceph-radosgw-17.2.6-1274.g68e53a4a.el 4.7 MB/s | 17 MB 00:03 2023-10-06T11:02:59.754 INFO:teuthology.orchestra.run.smithi151.stdout:(18/120): python3-ceph-argparse-17.2.6-1274.g68 714 kB/s | 45 kB 00:00 2023-10-06T11:02:59.828 INFO:teuthology.orchestra.run.smithi151.stdout:(19/120): python3-ceph-common-17.2.6-1274.g68e5 1.5 MB/s | 115 kB 00:00 2023-10-06T11:02:59.906 INFO:teuthology.orchestra.run.smithi151.stdout:(20/120): python3-cephfs-17.2.6-1274.g68e53a4a. 2.4 MB/s | 190 kB 00:00 2023-10-06T11:03:00.040 INFO:teuthology.orchestra.run.smithi151.stdout:(21/120): librgw2-17.2.6-1274.g68e53a4a.el8.x86 3.5 MB/s | 5.6 MB 00:01 2023-10-06T11:03:00.051 INFO:teuthology.orchestra.run.smithi151.stdout:(22/120): python3-rados-17.2.6-1274.g68e53a4a.e 2.5 MB/s | 371 kB 00:00 2023-10-06T11:03:00.120 INFO:teuthology.orchestra.run.smithi151.stdout:(23/120): python3-rgw-17.2.6-1274.g68e53a4a.el8 1.5 MB/s | 107 kB 00:00 2023-10-06T11:03:00.171 INFO:teuthology.orchestra.run.smithi151.stdout:(24/120): python3-rbd-17.2.6-1274.g68e53a4a.el8 2.7 MB/s | 358 kB 00:00 2023-10-06T11:03:00.181 INFO:teuthology.orchestra.run.smithi151.stdout:(25/120): rbd-fuse-17.2.6-1274.g68e53a4a.el8.x8 1.4 MB/s | 91 kB 00:00 2023-10-06T11:03:00.253 INFO:teuthology.orchestra.run.smithi151.stdout:(26/120): rbd-nbd-17.2.6-1274.g68e53a4a.el8.x86 2.4 MB/s | 173 kB 00:00 2023-10-06T11:03:00.319 INFO:teuthology.orchestra.run.smithi151.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1274.g 341 kB/s | 23 kB 00:00 2023-10-06T11:03:00.391 INFO:teuthology.orchestra.run.smithi151.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1274.g68e53a4 1.7 MB/s | 121 kB 00:00 2023-10-06T11:03:00.500 INFO:teuthology.orchestra.run.smithi146.stdout:(6/120): ceph-base-17.2.6-1274.g68e53a4a.el8.x8 1.1 MB/s | 5.2 MB 00:04 2023-10-06T11:03:00.648 INFO:teuthology.orchestra.run.smithi146.stdout:(7/120): ceph-mon-17.2.6-1274.g68e53a4a.el8.x86 2.2 MB/s | 3.9 MB 00:01 2023-10-06T11:03:00.851 INFO:teuthology.orchestra.run.smithi151.stdout:(29/120): ceph-mgr-dashboard-17.2.6-1274.g68e53 3.7 MB/s | 1.7 MB 00:00 2023-10-06T11:03:01.135 INFO:teuthology.orchestra.run.smithi151.stdout:(30/120): rbd-mirror-17.2.6-1274.g68e53a4a.el8. 3.6 MB/s | 3.5 MB 00:00 2023-10-06T11:03:01.204 INFO:teuthology.orchestra.run.smithi151.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1274.g68 3.3 MB/s | 238 kB 00:00 2023-10-06T11:03:01.269 INFO:teuthology.orchestra.run.smithi151.stdout:(32/120): ceph-mgr-rook-17.2.6-1274.g68e53a4a.e 732 kB/s | 47 kB 00:00 2023-10-06T11:03:01.331 INFO:teuthology.orchestra.run.smithi151.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1274.g6 232 kB/s | 14 kB 00:00 2023-10-06T11:03:01.402 INFO:teuthology.orchestra.run.smithi151.stdout:(34/120): ceph-volume-17.2.6-1274.g68e53a4a.el8 3.7 MB/s | 267 kB 00:00 2023-10-06T11:03:01.465 INFO:teuthology.orchestra.run.smithi151.stdout:(35/120): cephadm-17.2.6-1274.g68e53a4a.el8.noa 1.3 MB/s | 80 kB 00:00 2023-10-06T11:03:01.525 INFO:teuthology.orchestra.run.smithi151.stdout:(36/120): cephfs-top-17.2.6-1274.g68e53a4a.el8. 298 kB/s | 18 kB 00:00 2023-10-06T11:03:01.582 INFO:teuthology.orchestra.run.smithi151.stdout:(37/120): gperftools-libs-2.7-9.el8.x86_64.rpm 5.3 MB/s | 306 kB 00:00 2023-10-06T11:03:01.591 INFO:teuthology.orchestra.run.smithi151.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 6.5 MB/s | 59 kB 00:00 2023-10-06T11:03:01.600 INFO:teuthology.orchestra.run.smithi151.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 8.3 MB/s | 75 kB 00:00 2023-10-06T11:03:01.620 INFO:teuthology.orchestra.run.smithi151.stdout:(40/120): python3-asyncssh-2.7.0-2.el8.noarch.r 24 MB/s | 476 kB 00:00 2023-10-06T11:03:01.628 INFO:teuthology.orchestra.run.smithi151.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 5.1 MB/s | 44 kB 00:00 2023-10-06T11:03:01.638 INFO:teuthology.orchestra.run.smithi151.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 19 MB/s | 185 kB 00:00 2023-10-06T11:03:01.646 INFO:teuthology.orchestra.run.smithi151.stdout:(43/120): python3-cachetools-3.1.1-4.el8.noarch 3.9 MB/s | 33 kB 00:00 2023-10-06T11:03:01.655 INFO:teuthology.orchestra.run.smithi151.stdout:(44/120): python3-certifi-2018.10.15-7.el8.noar 1.9 MB/s | 16 kB 00:00 2023-10-06T11:03:01.664 INFO:teuthology.orchestra.run.smithi151.stdout:(45/120): python3-cheroot-8.5.2-1.el8.noarch.rp 18 MB/s | 173 kB 00:00 2023-10-06T11:03:01.676 INFO:teuthology.orchestra.run.smithi151.stdout:(46/120): python3-cherrypy-18.4.0-1.el8.noarch. 32 MB/s | 384 kB 00:00 2023-10-06T11:03:01.686 INFO:teuthology.orchestra.run.smithi151.stdout:(47/120): python3-google-auth-1.1.1-10.el8.noar 8.6 MB/s | 81 kB 00:00 2023-10-06T11:03:01.694 INFO:teuthology.orchestra.run.smithi151.stdout:(48/120): python3-jaraco-6.2-6.el8.noarch.rpm 1.3 MB/s | 11 kB 00:00 2023-10-06T11:03:01.703 INFO:teuthology.orchestra.run.smithi151.stdout:(49/120): python3-jaraco-functools-2.0-4.el8.no 1.9 MB/s | 18 kB 00:00 2023-10-06T11:03:01.722 INFO:teuthology.orchestra.run.smithi151.stdout:(50/120): python3-kubernetes-11.0.0-6.el8.noarc 64 MB/s | 1.2 MB 00:00 2023-10-06T11:03:01.731 INFO:teuthology.orchestra.run.smithi151.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 5.3 MB/s | 49 kB 00:00 2023-10-06T11:03:01.740 INFO:teuthology.orchestra.run.smithi151.stdout:(52/120): python3-more-itertools-7.2.0-3.el8.no 6.7 MB/s | 59 kB 00:00 2023-10-06T11:03:01.749 INFO:teuthology.orchestra.run.smithi151.stdout:(53/120): python3-natsort-7.1.1-2.el8.noarch.rp 6.8 MB/s | 60 kB 00:00 2023-10-06T11:03:01.759 INFO:teuthology.orchestra.run.smithi151.stdout:(54/120): python3-pecan-1.3.2-9.el8.noarch.rpm 28 MB/s | 283 kB 00:00 2023-10-06T11:03:01.767 INFO:teuthology.orchestra.run.smithi151.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 1.8 MB/s | 16 kB 00:00 2023-10-06T11:03:01.776 INFO:teuthology.orchestra.run.smithi151.stdout:(56/120): python3-repoze-lru-0.7-6.el8.noarch.r 3.8 MB/s | 34 kB 00:00 2023-10-06T11:03:01.786 INFO:teuthology.orchestra.run.smithi151.stdout:(57/120): python3-routes-2.4.1-12.el8.noarch.rp 19 MB/s | 196 kB 00:00 2023-10-06T11:03:01.795 INFO:teuthology.orchestra.run.smithi151.stdout:(58/120): python3-rsa-4.9-2.el8.noarch.rpm 7.5 MB/s | 64 kB 00:00 2023-10-06T11:03:01.803 INFO:teuthology.orchestra.run.smithi151.stdout:(59/120): python3-simplegeneric-0.8.1-17.el8.no 2.2 MB/s | 19 kB 00:00 2023-10-06T11:03:01.812 INFO:teuthology.orchestra.run.smithi151.stdout:(60/120): python3-singledispatch-3.4.0.3-18.el8 2.7 MB/s | 24 kB 00:00 2023-10-06T11:03:01.821 INFO:teuthology.orchestra.run.smithi151.stdout:(61/120): python3-tempora-1.14.1-5.el8.noarch.r 3.4 MB/s | 29 kB 00:00 2023-10-06T11:03:01.829 INFO:teuthology.orchestra.run.smithi151.stdout:(62/120): python3-trustme-0.6.0-4.el8.noarch.rp 3.2 MB/s | 27 kB 00:00 2023-10-06T11:03:01.839 INFO:teuthology.orchestra.run.smithi151.stdout:(63/120): python3-waitress-1.4.3-1.el8.noarch.r 26 MB/s | 255 kB 00:00 2023-10-06T11:03:01.849 INFO:teuthology.orchestra.run.smithi151.stdout:(64/120): python3-webob-1.8.5-1.el8.1.noarch.rp 26 MB/s | 251 kB 00:00 2023-10-06T11:03:01.858 INFO:teuthology.orchestra.run.smithi151.stdout:(65/120): python3-websocket-client-0.56.0-5.el8 7.1 MB/s | 61 kB 00:00 2023-10-06T11:03:01.867 INFO:teuthology.orchestra.run.smithi151.stdout:(66/120): python3-webtest-2.0.33-1.el8.noarch.r 9.7 MB/s | 85 kB 00:00 2023-10-06T11:03:01.875 INFO:teuthology.orchestra.run.smithi151.stdout:(67/120): python3-zc-lockfile-2.0-2.el8.noarch. 2.7 MB/s | 23 kB 00:00 2023-10-06T11:03:01.896 INFO:teuthology.orchestra.run.smithi151.stdout:(68/120): thrift-0.13.0-2.el8.x86_64.rpm 85 MB/s | 1.7 MB 00:00 2023-10-06T11:03:01.900 INFO:teuthology.orchestra.run.smithi151.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 20 MB/s | 70 kB 00:00 2023-10-06T11:03:01.930 INFO:teuthology.orchestra.run.smithi151.stdout:(70/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 625 kB/s | 19 kB 00:00 2023-10-06T11:03:01.944 INFO:teuthology.orchestra.run.smithi151.stdout:(71/120): python3-jwt-1.6.1-2.el8.noarch.rpm 2.9 MB/s | 43 kB 00:00 2023-10-06T11:03:01.959 INFO:teuthology.orchestra.run.smithi151.stdout:(72/120): python3-oauthlib-2.1.0-1.el8.noarch.r 10 MB/s | 155 kB 00:00 2023-10-06T11:03:01.976 INFO:teuthology.orchestra.run.smithi151.stdout:(73/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 13 MB/s | 220 kB 00:00 2023-10-06T11:03:01.990 INFO:teuthology.orchestra.run.smithi151.stdout:(74/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 3.5 MB/s | 48 kB 00:00 2023-10-06T11:03:02.005 INFO:teuthology.orchestra.run.smithi151.stdout:(75/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 15 MB/s | 229 kB 00:00 2023-10-06T11:03:02.017 INFO:teuthology.orchestra.run.smithi151.stdout:(76/120): python3-requests-oauthlib-1.0.0-1.el8 3.4 MB/s | 43 kB 00:00 2023-10-06T11:03:02.056 INFO:teuthology.orchestra.run.smithi151.stdout:(77/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 60 MB/s | 2.3 MB 00:00 2023-10-06T11:03:02.069 INFO:teuthology.orchestra.run.smithi151.stdout:(78/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 1.4 MB/s | 18 kB 00:00 2023-10-06T11:03:02.087 INFO:teuthology.orchestra.run.smithi151.stdout:(79/120): pcre2-devel-10.32-2.el8.x86_64.rpm 33 MB/s | 605 kB 00:00 2023-10-06T11:03:02.101 INFO:teuthology.orchestra.run.smithi151.stdout:(80/120): fuse-2.9.7-12.el8.x86_64.rpm 5.9 MB/s | 83 kB 00:00 2023-10-06T11:03:02.113 INFO:teuthology.orchestra.run.smithi151.stdout:(81/120): elfutils-libelf-devel-0.182-3.el8.x86 4.8 MB/s | 59 kB 00:00 2023-10-06T11:03:02.126 INFO:teuthology.orchestra.run.smithi151.stdout:(82/120): libquadmath-8.4.1-1.el8.x86_64.rpm 13 MB/s | 169 kB 00:00 2023-10-06T11:03:02.138 INFO:teuthology.orchestra.run.smithi151.stdout:(83/120): libcom_err-devel-1.45.6-1.el8.x86_64. 3.2 MB/s | 38 kB 00:00 2023-10-06T11:03:02.150 INFO:teuthology.orchestra.run.smithi151.stdout:(84/120): libsepol-devel-2.9-2.el8.x86_64.rpm 7.0 MB/s | 86 kB 00:00 2023-10-06T11:03:02.162 INFO:teuthology.orchestra.run.smithi151.stdout:(85/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 4.8 MB/s | 58 kB 00:00 2023-10-06T11:03:02.174 INFO:teuthology.orchestra.run.smithi151.stdout:(86/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 3.9 MB/s | 47 kB 00:00 2023-10-06T11:03:02.192 INFO:teuthology.orchestra.run.smithi151.stdout:(87/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 31 MB/s | 559 kB 00:00 2023-10-06T11:03:02.210 INFO:teuthology.orchestra.run.smithi151.stdout:(88/120): libgfortran-8.4.1-1.el8.x86_64.rpm 35 MB/s | 639 kB 00:00 2023-10-06T11:03:02.223 INFO:teuthology.orchestra.run.smithi151.stdout:(89/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 5.5 MB/s | 70 kB 00:00 2023-10-06T11:03:02.236 INFO:teuthology.orchestra.run.smithi151.stdout:(90/120): libselinux-devel-2.9-5.el8.x86_64.rpm 15 MB/s | 200 kB 00:00 2023-10-06T11:03:02.249 INFO:teuthology.orchestra.run.smithi151.stdout:(91/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 7.7 MB/s | 97 kB 00:00 2023-10-06T11:03:02.486 INFO:teuthology.orchestra.run.smithi151.stdout:(92/120): python3-scipy-1.0.0-20.module+el8.1.0 61 MB/s | 15 MB 00:00 2023-10-06T11:03:02.499 INFO:teuthology.orchestra.run.smithi151.stdout:(93/120): python3-prettytable-0.7.2-14.el8.noar 3.3 MB/s | 44 kB 00:00 2023-10-06T11:03:02.511 INFO:teuthology.orchestra.run.smithi151.stdout:(94/120): python3-jsonpatch-1.21-2.el8.noarch.r 2.2 MB/s | 27 kB 00:00 2023-10-06T11:03:02.524 INFO:teuthology.orchestra.run.smithi151.stdout:(95/120): jq-1.5-12.el8.x86_64.rpm 12 MB/s | 161 kB 00:00 2023-10-06T11:03:02.539 INFO:teuthology.orchestra.run.smithi151.stdout:(96/120): flex-2.6.1-9.el8.x86_64.rpm 21 MB/s | 320 kB 00:00 2023-10-06T11:03:02.556 INFO:teuthology.orchestra.run.smithi151.stdout:(97/120): python3-werkzeug-0.12.2-4.el8.noarch. 27 MB/s | 457 kB 00:00 2023-10-06T11:03:02.579 INFO:teuthology.orchestra.run.smithi151.stdout:(98/120): ceph-mgr-diskprediction-local-17.2.6- 4.3 MB/s | 7.4 MB 00:01 2023-10-06T11:03:02.606 INFO:teuthology.orchestra.run.smithi151.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 1.4 MB/s | 39 kB 00:00 2023-10-06T11:03:02.626 INFO:teuthology.orchestra.run.smithi151.stdout:(100/120): bison-3.0.4-10.el8.x86_64.rpm 34 MB/s | 688 kB 00:00 2023-10-06T11:03:02.644 INFO:teuthology.orchestra.run.smithi151.stdout:(101/120): python3-babel-2.5.1-5.el8.noarch.rpm 55 MB/s | 4.8 MB 00:00 2023-10-06T11:03:02.647 INFO:teuthology.orchestra.run.smithi151.stdout:(102/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 12 MB/s | 259 kB 00:00 2023-10-06T11:03:02.661 INFO:teuthology.orchestra.run.smithi151.stdout:(103/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 13 MB/s | 225 kB 00:00 2023-10-06T11:03:02.667 INFO:teuthology.orchestra.run.smithi151.stdout:(104/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 6.4 MB/s | 126 kB 00:00 2023-10-06T11:03:02.683 INFO:teuthology.orchestra.run.smithi151.stdout:(105/120): oniguruma-6.8.2-2.el8.x86_64.rpm 12 MB/s | 187 kB 00:00 2023-10-06T11:03:02.702 INFO:teuthology.orchestra.run.smithi151.stdout:(106/120): python3-jinja2-2.10.1-2.el8_0.noarch 28 MB/s | 538 kB 00:00 2023-10-06T11:03:02.720 INFO:teuthology.orchestra.run.smithi151.stdout:(107/120): python3-numpy-1.14.3-9.el8.x86_64.rp 63 MB/s | 3.7 MB 00:00 2023-10-06T11:03:02.723 INFO:teuthology.orchestra.run.smithi151.stdout:(108/120): socat-1.7.3.3-2.el8.x86_64.rpm 14 MB/s | 302 kB 00:00 2023-10-06T11:03:02.736 INFO:teuthology.orchestra.run.smithi151.stdout:(109/120): python3-mako-1.0.6-13.el8.noarch.rpm 9.8 MB/s | 157 kB 00:00 2023-10-06T11:03:02.743 INFO:teuthology.orchestra.run.smithi151.stdout:(110/120): python3-pyasn1-modules-0.3.7-6.el8.n 5.7 MB/s | 110 kB 00:00 2023-10-06T11:03:02.753 INFO:teuthology.orchestra.run.smithi151.stdout:(111/120): librdkafka-0.11.4-1.el8.x86_64.rpm 21 MB/s | 353 kB 00:00 2023-10-06T11:03:02.755 INFO:teuthology.orchestra.run.smithi151.stdout:(112/120): python3-jsonpointer-1.10-11.el8.noar 1.6 MB/s | 20 kB 00:00 2023-10-06T11:03:02.768 INFO:teuthology.orchestra.run.smithi151.stdout:(113/120): python3-pytz-2017.2-9.el8.noarch.rpm 4.0 MB/s | 54 kB 00:00 2023-10-06T11:03:02.773 INFO:teuthology.orchestra.run.smithi151.stdout:(114/120): libtool-2.4.6-25.el8.x86_64.rpm 34 MB/s | 709 kB 00:00 2023-10-06T11:03:02.845 INFO:teuthology.orchestra.run.smithi151.stdout:(115/120): openblas-threads-0.3.12-1.el8.x86_64 62 MB/s | 4.7 MB 00:00 2023-10-06T11:03:02.862 INFO:teuthology.orchestra.run.smithi151.stdout:(116/120): openblas-0.3.12-1.el8.x86_64.rpm 52 MB/s | 4.6 MB 00:00 2023-10-06T11:03:02.869 INFO:teuthology.orchestra.run.smithi151.stdout:(117/120): automake-1.16.1-7.el8.noarch.rpm 29 MB/s | 713 kB 00:00 2023-10-06T11:03:03.976 INFO:teuthology.orchestra.run.smithi151.stdout:(118/120): librados2-17.2.6-1274.g68e53a4a.el8. 3.1 MB/s | 3.4 MB 00:01 2023-10-06T11:03:04.144 INFO:teuthology.orchestra.run.smithi151.stdout:(119/120): librbd1-17.2.6-1274.g68e53a4a.el8.x8 2.8 MB/s | 3.5 MB 00:01 2023-10-06T11:03:05.148 INFO:teuthology.orchestra.run.smithi151.stdout:(120/120): ceph-test-17.2.6-1274.g68e53a4a.el8. 6.2 MB/s | 52 MB 00:08 2023-10-06T11:03:05.152 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2023-10-06T11:03:05.152 INFO:teuthology.orchestra.run.smithi151.stdout:Total 19 MB/s | 201 MB 00:10 2023-10-06T11:03:05.203 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2023-10-06T11:03:05.317 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2023-10-06T11:03:05.318 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2023-10-06T11:03:07.058 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2023-10-06T11:03:07.063 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2023-10-06T11:03:07.068 INFO:teuthology.orchestra.run.smithi146.stdout:(8/120): ceph-radosgw-17.2.6-1274.g68e53a4a.el8 2.6 MB/s | 17 MB 00:06 2023-10-06T11:03:07.124 INFO:teuthology.orchestra.run.smithi146.stdout:(9/120): ceph-selinux-17.2.6-1274.g68e53a4a.el8 436 kB/s | 24 kB 00:00 2023-10-06T11:03:08.781 INFO:teuthology.orchestra.run.smithi146.stdout:(10/120): ceph-common-17.2.6-1274.g68e53a4a.el8 1.8 MB/s | 23 MB 00:12 2023-10-06T11:03:09.128 INFO:teuthology.orchestra.run.smithi146.stdout:(11/120): cephfs-mirror-17.2.6-1274.g68e53a4a.e 736 kB/s | 255 kB 00:00 2023-10-06T11:03:09.204 INFO:teuthology.orchestra.run.smithi146.stdout:(12/120): libcephfs-devel-17.2.6-1274.g68e53a4a 327 kB/s | 25 kB 00:00 2023-10-06T11:03:09.691 INFO:teuthology.orchestra.run.smithi146.stdout:(13/120): libcephfs2-17.2.6-1274.g68e53a4a.el8. 1.6 MB/s | 797 kB 00:00 2023-10-06T11:03:09.863 INFO:teuthology.orchestra.run.smithi146.stdout:(14/120): ceph-osd-17.2.6-1274.g68e53a4a.el8.x8 1.8 MB/s | 17 MB 00:09 2023-10-06T11:03:09.864 INFO:teuthology.orchestra.run.smithi146.stdout:(15/120): libcephsqlite-17.2.6-1274.g68e53a4a.e 1.0 MB/s | 175 kB 00:00 2023-10-06T11:03:09.913 INFO:teuthology.orchestra.run.smithi146.stdout:(16/120): librados-devel-17.2.6-1274.g68e53a4a. 2.5 MB/s | 130 kB 00:00 2023-10-06T11:03:10.151 INFO:teuthology.orchestra.run.smithi146.stdout:(17/120): libradosstriper1-17.2.6-1274.g68e53a4 1.7 MB/s | 506 kB 00:00 2023-10-06T11:03:10.230 INFO:teuthology.orchestra.run.smithi146.stdout:(18/120): python3-ceph-argparse-17.2.6-1274.g68 560 kB/s | 45 kB 00:00 2023-10-06T11:03:10.324 INFO:teuthology.orchestra.run.smithi146.stdout:(19/120): python3-ceph-common-17.2.6-1274.g68e5 1.2 MB/s | 115 kB 00:00 2023-10-06T11:03:10.469 INFO:teuthology.orchestra.run.smithi146.stdout:(20/120): python3-cephfs-17.2.6-1274.g68e53a4a. 1.3 MB/s | 190 kB 00:00 2023-10-06T11:03:10.708 INFO:teuthology.orchestra.run.smithi146.stdout:(21/120): python3-rados-17.2.6-1274.g68e53a4a.e 1.5 MB/s | 371 kB 00:00 2023-10-06T11:03:11.046 INFO:teuthology.orchestra.run.smithi146.stdout:(22/120): python3-rbd-17.2.6-1274.g68e53a4a.el8 1.0 MB/s | 358 kB 00:00 2023-10-06T11:03:11.127 INFO:teuthology.orchestra.run.smithi146.stdout:(23/120): python3-rgw-17.2.6-1274.g68e53a4a.el8 1.3 MB/s | 107 kB 00:00 2023-10-06T11:03:11.206 INFO:teuthology.orchestra.run.smithi146.stdout:(24/120): rbd-fuse-17.2.6-1274.g68e53a4a.el8.x8 1.1 MB/s | 91 kB 00:00 2023-10-06T11:03:11.561 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2023-10-06T11:03:12.386 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-06T11:03:12.527 INFO:teuthology.orchestra.run.smithi146.stdout:(25/120): librgw2-17.2.6-1274.g68e53a4a.el8.x86 2.1 MB/s | 5.6 MB 00:02 2023-10-06T11:03:12.577 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-06T11:03:12.653 INFO:teuthology.orchestra.run.smithi146.stdout:(26/120): rbd-nbd-17.2.6-1274.g68e53a4a.el8.x86 1.3 MB/s | 173 kB 00:00 2023-10-06T11:03:12.713 INFO:teuthology.orchestra.run.smithi146.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1274.g 386 kB/s | 23 kB 00:00 2023-10-06T11:03:12.731 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-06T11:03:12.777 INFO:teuthology.orchestra.run.smithi146.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1274.g68e53a4 1.9 MB/s | 121 kB 00:00 2023-10-06T11:03:12.910 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-06T11:03:13.287 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-06T11:03:13.620 INFO:teuthology.orchestra.run.smithi146.stdout:(29/120): ceph-mgr-dashboard-17.2.6-1274.g68e53 2.1 MB/s | 1.7 MB 00:00 2023-10-06T11:03:13.620 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 4/122 2023-10-06T11:03:13.886 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 4/122 2023-10-06T11:03:13.961 INFO:teuthology.orchestra.run.smithi146.stdout:(30/120): rbd-mirror-17.2.6-1274.g68e53a4a.el8. 1.3 MB/s | 3.5 MB 00:02 2023-10-06T11:03:14.102 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 5/122 2023-10-06T11:03:14.218 INFO:teuthology.orchestra.run.smithi146.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1274.g68 929 kB/s | 238 kB 00:00 2023-10-06T11:03:14.233 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 5/122 2023-10-06T11:03:14.364 INFO:teuthology.orchestra.run.smithi146.stdout:(32/120): ceph-mgr-rook-17.2.6-1274.g68e53a4a.e 325 kB/s | 47 kB 00:00 2023-10-06T11:03:14.418 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 6/122 2023-10-06T11:03:14.455 INFO:teuthology.orchestra.run.smithi146.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1274.g6 160 kB/s | 14 kB 00:00 2023-10-06T11:03:14.511 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 6/122 2023-10-06T11:03:14.690 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 7/122 2023-10-06T11:03:14.714 INFO:teuthology.orchestra.run.smithi146.stdout:(34/120): ceph-volume-17.2.6-1274.g68e53a4a.el8 1.0 MB/s | 267 kB 00:00 2023-10-06T11:03:14.781 INFO:teuthology.orchestra.run.smithi146.stdout:(35/120): cephadm-17.2.6-1274.g68e53a4a.el8.noa 1.2 MB/s | 80 kB 00:00 2023-10-06T11:03:14.845 INFO:teuthology.orchestra.run.smithi146.stdout:(36/120): cephfs-top-17.2.6-1274.g68e53a4a.el8. 269 kB/s | 18 kB 00:00 2023-10-06T11:03:14.943 INFO:teuthology.orchestra.run.smithi146.stdout:(37/120): gperftools-libs-2.7-9.el8.x86_64.rpm 3.1 MB/s | 306 kB 00:00 2023-10-06T11:03:14.956 INFO:teuthology.orchestra.run.smithi146.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 4.5 MB/s | 59 kB 00:00 2023-10-06T11:03:14.969 INFO:teuthology.orchestra.run.smithi146.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 5.6 MB/s | 75 kB 00:00 2023-10-06T11:03:14.996 INFO:teuthology.orchestra.run.smithi146.stdout:(40/120): python3-asyncssh-2.7.0-2.el8.noarch.r 17 MB/s | 476 kB 00:00 2023-10-06T11:03:15.008 INFO:teuthology.orchestra.run.smithi146.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 3.5 MB/s | 44 kB 00:00 2023-10-06T11:03:15.015 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/122 2023-10-06T11:03:15.022 INFO:teuthology.orchestra.run.smithi146.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 13 MB/s | 185 kB 00:00 2023-10-06T11:03:15.035 INFO:teuthology.orchestra.run.smithi146.stdout:(43/120): python3-cachetools-3.1.1-4.el8.noarch 2.7 MB/s | 33 kB 00:00 2023-10-06T11:03:15.047 INFO:teuthology.orchestra.run.smithi146.stdout:(44/120): python3-certifi-2018.10.15-7.el8.noar 1.3 MB/s | 16 kB 00:00 2023-10-06T11:03:15.061 INFO:teuthology.orchestra.run.smithi146.stdout:(45/120): python3-cheroot-8.5.2-1.el8.noarch.rp 12 MB/s | 173 kB 00:00 2023-10-06T11:03:15.078 INFO:teuthology.orchestra.run.smithi146.stdout:(46/120): python3-cherrypy-18.4.0-1.el8.noarch. 23 MB/s | 384 kB 00:00 2023-10-06T11:03:15.091 INFO:teuthology.orchestra.run.smithi146.stdout:(47/120): python3-google-auth-1.1.1-10.el8.noar 6.2 MB/s | 81 kB 00:00 2023-10-06T11:03:15.102 INFO:teuthology.orchestra.run.smithi146.stdout:(48/120): python3-jaraco-6.2-6.el8.noarch.rpm 963 kB/s | 11 kB 00:00 2023-10-06T11:03:15.114 INFO:teuthology.orchestra.run.smithi146.stdout:(49/120): python3-jaraco-functools-2.0-4.el8.no 1.5 MB/s | 18 kB 00:00 2023-10-06T11:03:15.155 INFO:teuthology.orchestra.run.smithi146.stdout:(50/120): python3-kubernetes-11.0.0-6.el8.noarc 29 MB/s | 1.2 MB 00:00 2023-10-06T11:03:15.167 INFO:teuthology.orchestra.run.smithi146.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 4.0 MB/s | 49 kB 00:00 2023-10-06T11:03:15.179 INFO:teuthology.orchestra.run.smithi146.stdout:(52/120): python3-more-itertools-7.2.0-3.el8.no 4.8 MB/s | 59 kB 00:00 2023-10-06T11:03:15.191 INFO:teuthology.orchestra.run.smithi146.stdout:(53/120): python3-natsort-7.1.1-2.el8.noarch.rp 4.8 MB/s | 60 kB 00:00 2023-10-06T11:03:15.207 INFO:teuthology.orchestra.run.smithi146.stdout:(54/120): python3-pecan-1.3.2-9.el8.noarch.rpm 18 MB/s | 283 kB 00:00 2023-10-06T11:03:15.218 INFO:teuthology.orchestra.run.smithi146.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 1.3 MB/s | 16 kB 00:00 2023-10-06T11:03:15.231 INFO:teuthology.orchestra.run.smithi146.stdout:(56/120): python3-repoze-lru-0.7-6.el8.noarch.r 2.7 MB/s | 34 kB 00:00 2023-10-06T11:03:15.246 INFO:teuthology.orchestra.run.smithi146.stdout:(57/120): python3-routes-2.4.1-12.el8.noarch.rp 13 MB/s | 196 kB 00:00 2023-10-06T11:03:15.258 INFO:teuthology.orchestra.run.smithi146.stdout:(58/120): python3-rsa-4.9-2.el8.noarch.rpm 5.0 MB/s | 64 kB 00:00 2023-10-06T11:03:15.270 INFO:teuthology.orchestra.run.smithi146.stdout:(59/120): python3-simplegeneric-0.8.1-17.el8.no 1.6 MB/s | 19 kB 00:00 2023-10-06T11:03:15.282 INFO:teuthology.orchestra.run.smithi146.stdout:(60/120): python3-singledispatch-3.4.0.3-18.el8 2.0 MB/s | 24 kB 00:00 2023-10-06T11:03:15.295 INFO:teuthology.orchestra.run.smithi146.stdout:(61/120): python3-tempora-1.14.1-5.el8.noarch.r 2.4 MB/s | 29 kB 00:00 2023-10-06T11:03:15.306 INFO:teuthology.orchestra.run.smithi146.stdout:(62/120): python3-trustme-0.6.0-4.el8.noarch.rp 2.3 MB/s | 27 kB 00:00 2023-10-06T11:03:15.321 INFO:teuthology.orchestra.run.smithi146.stdout:(63/120): python3-waitress-1.4.3-1.el8.noarch.r 17 MB/s | 255 kB 00:00 2023-10-06T11:03:15.336 INFO:teuthology.orchestra.run.smithi146.stdout:(64/120): python3-webob-1.8.5-1.el8.1.noarch.rp 17 MB/s | 251 kB 00:00 2023-10-06T11:03:15.349 INFO:teuthology.orchestra.run.smithi146.stdout:(65/120): python3-websocket-client-0.56.0-5.el8 4.8 MB/s | 61 kB 00:00 2023-10-06T11:03:15.361 INFO:teuthology.orchestra.run.smithi146.stdout:(66/120): python3-webtest-2.0.33-1.el8.noarch.r 6.7 MB/s | 85 kB 00:00 2023-10-06T11:03:15.374 INFO:teuthology.orchestra.run.smithi146.stdout:(67/120): python3-zc-lockfile-2.0-2.el8.noarch. 1.9 MB/s | 23 kB 00:00 2023-10-06T11:03:15.425 INFO:teuthology.orchestra.run.smithi146.stdout:(68/120): thrift-0.13.0-2.el8.x86_64.rpm 34 MB/s | 1.7 MB 00:00 2023-10-06T11:03:15.429 INFO:teuthology.orchestra.run.smithi146.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 20 MB/s | 70 kB 00:00 2023-10-06T11:03:15.681 INFO:teuthology.orchestra.run.smithi146.stdout:(70/120): python3-scipy-1.0.0-20.module+el8.1.0 58 MB/s | 15 MB 00:00 2023-10-06T11:03:15.685 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-06T11:03:15.698 INFO:teuthology.orchestra.run.smithi146.stdout:(71/120): python3-prettytable-0.7.2-14.el8.noar 2.7 MB/s | 44 kB 00:00 2023-10-06T11:03:15.712 INFO:teuthology.orchestra.run.smithi146.stdout:(72/120): python3-jsonpatch-1.21-2.el8.noarch.r 1.9 MB/s | 27 kB 00:00 2023-10-06T11:03:15.727 INFO:teuthology.orchestra.run.smithi146.stdout:(73/120): jq-1.5-12.el8.x86_64.rpm 11 MB/s | 161 kB 00:00 2023-10-06T11:03:15.744 INFO:teuthology.orchestra.run.smithi146.stdout:(74/120): flex-2.6.1-9.el8.x86_64.rpm 18 MB/s | 320 kB 00:00 2023-10-06T11:03:15.763 INFO:teuthology.orchestra.run.smithi146.stdout:(75/120): python3-werkzeug-0.12.2-4.el8.noarch. 24 MB/s | 457 kB 00:00 2023-10-06T11:03:15.827 INFO:teuthology.orchestra.run.smithi146.stdout:(76/120): python3-babel-2.5.1-5.el8.noarch.rpm 75 MB/s | 4.8 MB 00:00 2023-10-06T11:03:15.840 INFO:teuthology.orchestra.run.smithi146.stdout:(77/120): python3-markupsafe-0.23-19.el8.x86_64 2.9 MB/s | 39 kB 00:00 2023-10-06T11:03:15.859 INFO:teuthology.orchestra.run.smithi146.stdout:(78/120): bison-3.0.4-10.el8.x86_64.rpm 35 MB/s | 688 kB 00:00 2023-10-06T11:03:15.874 INFO:teuthology.orchestra.run.smithi146.stdout:(79/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 18 MB/s | 259 kB 00:00 2023-10-06T11:03:15.877 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/122 2023-10-06T11:03:15.888 INFO:teuthology.orchestra.run.smithi146.stdout:(80/120): python3-numpy-f2py-1.14.3-9.el8.x86_6 15 MB/s | 225 kB 00:00 2023-10-06T11:03:15.901 INFO:teuthology.orchestra.run.smithi146.stdout:(81/120): python3-pyasn1-0.3.7-6.el8.noarch.rpm 9.7 MB/s | 126 kB 00:00 2023-10-06T11:03:15.953 INFO:teuthology.orchestra.run.smithi146.stdout:(82/120): python3-numpy-1.14.3-9.el8.x86_64.rpm 73 MB/s | 3.7 MB 00:00 2023-10-06T11:03:15.967 INFO:teuthology.orchestra.run.smithi146.stdout:(83/120): oniguruma-6.8.2-2.el8.x86_64.rpm 13 MB/s | 187 kB 00:00 2023-10-06T11:03:15.968 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/122 2023-10-06T11:03:15.983 INFO:teuthology.orchestra.run.smithi146.stdout:(84/120): python3-jinja2-2.10.1-2.el8_0.noarch. 32 MB/s | 538 kB 00:00 2023-10-06T11:03:15.997 INFO:teuthology.orchestra.run.smithi146.stdout:(85/120): socat-1.7.3.3-2.el8.x86_64.rpm 21 MB/s | 302 kB 00:00 2023-10-06T11:03:16.013 INFO:teuthology.orchestra.run.smithi146.stdout:(86/120): python3-mako-1.0.6-13.el8.noarch.rpm 11 MB/s | 157 kB 00:00 2023-10-06T11:03:16.026 INFO:teuthology.orchestra.run.smithi146.stdout:(87/120): python3-pyasn1-modules-0.3.7-6.el8.no 8.5 MB/s | 110 kB 00:00 2023-10-06T11:03:16.039 INFO:teuthology.orchestra.run.smithi146.stdout:(88/120): librdkafka-0.11.4-1.el8.x86_64.rpm 24 MB/s | 353 kB 00:00 2023-10-06T11:03:16.051 INFO:teuthology.orchestra.run.smithi146.stdout:(89/120): python3-jsonpointer-1.10-11.el8.noarc 1.7 MB/s | 20 kB 00:00 2023-10-06T11:03:16.069 INFO:teuthology.orchestra.run.smithi146.stdout:(90/120): libtool-2.4.6-25.el8.x86_64.rpm 38 MB/s | 709 kB 00:00 2023-10-06T11:03:16.082 INFO:teuthology.orchestra.run.smithi146.stdout:(91/120): python3-pytz-2017.2-9.el8.noarch.rpm 4.4 MB/s | 54 kB 00:00 2023-10-06T11:03:16.142 INFO:teuthology.orchestra.run.smithi146.stdout:(92/120): openblas-threads-0.3.12-1.el8.x86_64. 79 MB/s | 4.7 MB 00:00 2023-10-06T11:03:16.197 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-06T11:03:16.202 INFO:teuthology.orchestra.run.smithi146.stdout:(93/120): openblas-0.3.12-1.el8.x86_64.rpm 77 MB/s | 4.6 MB 00:00 2023-10-06T11:03:16.222 INFO:teuthology.orchestra.run.smithi146.stdout:(94/120): automake-1.16.1-7.el8.noarch.rpm 35 MB/s | 713 kB 00:00 2023-10-06T11:03:16.235 INFO:teuthology.orchestra.run.smithi146.stdout:(95/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 1.5 MB/s | 19 kB 00:00 2023-10-06T11:03:16.246 INFO:teuthology.orchestra.run.smithi146.stdout:(96/120): python3-jwt-1.6.1-2.el8.noarch.rpm 3.6 MB/s | 43 kB 00:00 2023-10-06T11:03:16.260 INFO:teuthology.orchestra.run.smithi146.stdout:(97/120): python3-oauthlib-2.1.0-1.el8.noarch.r 11 MB/s | 155 kB 00:00 2023-10-06T11:03:16.273 INFO:teuthology.orchestra.run.smithi146.stdout:(98/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 16 MB/s | 220 kB 00:00 2023-10-06T11:03:16.286 INFO:teuthology.orchestra.run.smithi146.stdout:(99/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 3.8 MB/s | 48 kB 00:00 2023-10-06T11:03:16.299 INFO:teuthology.orchestra.run.smithi146.stdout:(100/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 17 MB/s | 229 kB 00:00 2023-10-06T11:03:16.312 INFO:teuthology.orchestra.run.smithi146.stdout:(101/120): python3-requests-oauthlib-1.0.0-1.el 3.3 MB/s | 43 kB 00:00 2023-10-06T11:03:16.348 INFO:teuthology.orchestra.run.smithi146.stdout:(102/120): openssl-devel-1.1.1g-15.el8_3.x86_64 66 MB/s | 2.3 MB 00:00 2023-10-06T11:03:16.359 INFO:teuthology.orchestra.run.smithi146.stdout:(103/120): libverto-devel-0.3.0-5.el8.x86_64.rp 1.5 MB/s | 18 kB 00:00 2023-10-06T11:03:16.367 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-06T11:03:16.377 INFO:teuthology.orchestra.run.smithi146.stdout:(104/120): pcre2-devel-10.32-2.el8.x86_64.rpm 35 MB/s | 605 kB 00:00 2023-10-06T11:03:16.389 INFO:teuthology.orchestra.run.smithi146.stdout:(105/120): fuse-2.9.7-12.el8.x86_64.rpm 6.5 MB/s | 83 kB 00:00 2023-10-06T11:03:16.401 INFO:teuthology.orchestra.run.smithi146.stdout:(106/120): elfutils-libelf-devel-0.182-3.el8.x8 4.9 MB/s | 59 kB 00:00 2023-10-06T11:03:16.414 INFO:teuthology.orchestra.run.smithi146.stdout:(107/120): libquadmath-8.4.1-1.el8.x86_64.rpm 13 MB/s | 169 kB 00:00 2023-10-06T11:03:16.427 INFO:teuthology.orchestra.run.smithi146.stdout:(108/120): libcom_err-devel-1.45.6-1.el8.x86_64 3.0 MB/s | 38 kB 00:00 2023-10-06T11:03:16.438 INFO:teuthology.orchestra.run.smithi146.stdout:(109/120): libsepol-devel-2.9-2.el8.x86_64.rpm 7.3 MB/s | 86 kB 00:00 2023-10-06T11:03:16.451 INFO:teuthology.orchestra.run.smithi146.stdout:(110/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 4.5 MB/s | 58 kB 00:00 2023-10-06T11:03:16.463 INFO:teuthology.orchestra.run.smithi146.stdout:(111/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 4.1 MB/s | 47 kB 00:00 2023-10-06T11:03:16.480 INFO:teuthology.orchestra.run.smithi146.stdout:(112/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.r 31 MB/s | 559 kB 00:00 2023-10-06T11:03:16.499 INFO:teuthology.orchestra.run.smithi146.stdout:(113/120): libgfortran-8.4.1-1.el8.x86_64.rpm 34 MB/s | 639 kB 00:00 2023-10-06T11:03:16.511 INFO:teuthology.orchestra.run.smithi146.stdout:(114/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rp 5.7 MB/s | 70 kB 00:00 2023-10-06T11:03:16.524 INFO:teuthology.orchestra.run.smithi146.stdout:(115/120): libselinux-devel-2.9-5.el8.x86_64.rp 15 MB/s | 200 kB 00:00 2023-10-06T11:03:16.536 INFO:teuthology.orchestra.run.smithi146.stdout:(116/120): libuuid-devel-2.32.1-27.el8.x86_64.r 7.9 MB/s | 97 kB 00:00 2023-10-06T11:03:16.560 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/122 2023-10-06T11:03:16.587 INFO:teuthology.orchestra.run.smithi146.stdout:(117/120): ceph-mgr-diskprediction-local-17.2.6 2.5 MB/s | 7.4 MB 00:03 2023-10-06T11:03:16.653 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/122 2023-10-06T11:03:16.843 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 14/122 2023-10-06T11:03:16.922 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 14/122 2023-10-06T11:03:17.097 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-10-06T11:03:17.347 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-10-06T11:03:17.599 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-10-06T11:03:17.836 INFO:teuthology.orchestra.run.smithi146.stdout:(118/120): librbd1-17.2.6-1274.g68e53a4a.el8.x8 2.8 MB/s | 3.5 MB 00:01 2023-10-06T11:03:18.279 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-10-06T11:03:18.434 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-06T11:03:18.583 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-06T11:03:18.734 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-06T11:03:19.265 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-06T11:03:19.443 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-06T11:03:19.948 INFO:teuthology.orchestra.run.smithi146.stdout:(119/120): librados2-17.2.6-1274.g68e53a4a.el8. 1.0 MB/s | 3.4 MB 00:03 2023-10-06T11:03:19.976 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-06T11:03:20.217 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-10-06T11:03:20.937 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-10-06T11:03:21.220 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-10-06T11:03:21.468 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-10-06T11:03:21.703 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-06T11:03:21.891 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8. 26/122 2023-10-06T11:03:22.036 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el 27/122 2023-10-06T11:03:22.274 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_6 28/122 2023-10-06T11:03:22.481 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-10-06T11:03:22.732 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-10-06T11:03:22.959 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-06T11:03:24.170 INFO:teuthology.orchestra.run.smithi146.stdout:(120/120): ceph-test-17.2.6-1274.g68e53a4a.el8. 3.0 MB/s | 52 MB 00:17 2023-10-06T11:03:24.175 INFO:teuthology.orchestra.run.smithi146.stdout:-------------------------------------------------------------------------------- 2023-10-06T11:03:24.176 INFO:teuthology.orchestra.run.smithi146.stdout:Total 7.0 MB/s | 201 MB 00:28 2023-10-06T11:03:24.226 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction check 2023-10-06T11:03:24.339 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction check succeeded. 2023-10-06T11:03:24.340 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction test 2023-10-06T11:03:24.997 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-06T11:03:25.347 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-10-06T11:03:26.230 INFO:teuthology.orchestra.run.smithi146.stdout:Transaction test succeeded. 2023-10-06T11:03:26.234 INFO:teuthology.orchestra.run.smithi146.stdout:Running transaction 2023-10-06T11:03:26.355 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-10-06T11:03:26.671 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-10-06T11:03:26.919 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-10-06T11:03:27.146 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-06T11:03:27.361 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-06T11:03:27.576 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 38/122 2023-10-06T11:03:27.756 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 39/122 2023-10-06T11:03:28.029 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_6 40/122 2023-10-06T11:03:28.274 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-10-06T11:03:28.457 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-10-06T11:03:28.663 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-10-06T11:03:28.852 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-10-06T11:03:29.041 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-06T11:03:29.102 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-06T11:03:29.299 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-10-06T11:03:29.480 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-10-06T11:03:29.665 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-10-06T11:03:29.862 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-10-06T11:03:30.034 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-10-06T11:03:30.202 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-10-06T11:03:30.378 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-10-06T11:03:30.549 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-10-06T11:03:30.593 INFO:teuthology.orchestra.run.smithi146.stdout: Preparing : 1/1 2023-10-06T11:03:30.719 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-10-06T11:03:30.798 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-06T11:03:31.004 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 2/122 2023-10-06T11:03:31.006 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-10-06T11:03:31.196 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-06T11:03:31.270 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-10-06T11:03:31.309 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-06T11:03:31.496 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-06T11:03:31.546 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-10-06T11:03:31.821 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-10-06T11:03:31.886 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-06T11:03:31.982 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-06T11:03:32.096 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 5/122 2023-10-06T11:03:32.145 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-06T11:03:32.395 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-06T11:03:32.494 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 5/122 2023-10-06T11:03:32.607 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-06T11:03:32.704 INFO:teuthology.orchestra.run.smithi146.stdout: Upgrading : librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 6/122 2023-10-06T11:03:32.798 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-06T11:03:32.834 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 6/122 2023-10-06T11:03:32.945 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-06T11:03:33.037 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 7/122 2023-10-06T11:03:33.101 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-06T11:03:33.152 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 7/122 2023-10-06T11:03:33.292 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-06T11:03:33.501 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 8/122 2023-10-06T11:03:33.527 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-06T11:03:33.759 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-06T11:03:33.977 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-06T11:03:34.162 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-06T11:03:34.187 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-06T11:03:34.362 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/122 2023-10-06T11:03:34.402 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-06T11:03:34.460 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/122 2023-10-06T11:03:34.627 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-06T11:03:34.708 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-06T11:03:34.838 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-06T11:03:34.861 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-06T11:03:35.036 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/122 2023-10-06T11:03:35.094 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-06T11:03:35.150 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/122 2023-10-06T11:03:35.312 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 14/122 2023-10-06T11:03:35.339 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-06T11:03:35.388 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 14/122 2023-10-06T11:03:35.530 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 15/122 2023-10-06T11:03:35.555 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-06T11:03:35.678 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-06T11:03:35.804 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-06T11:03:35.804 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-06T11:03:35.978 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-06T11:03:36.539 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-06T11:03:36.720 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-06T11:03:36.931 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-06T11:03:37.230 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-06T11:03:37.243 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-06T11:03:37.445 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : openblas-0.3.12-1.el8.x86_64 19/122 2023-10-06T11:03:37.474 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-06T11:03:37.793 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-06T11:03:38.059 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-06T11:03:38.161 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 19/122 2023-10-06T11:03:38.371 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-06T11:03:38.423 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 20/122 2023-10-06T11:03:38.610 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 21/122 2023-10-06T11:03:38.628 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-06T11:03:38.791 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 22/122 2023-10-06T11:03:38.815 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-06T11:03:39.015 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-06T11:03:39.052 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/122 2023-10-06T11:03:39.338 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/122 2023-10-06T11:03:39.590 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-06T11:03:39.760 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8. 26/122 2023-10-06T11:03:39.893 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el 27/122 2023-10-06T11:03:40.153 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_6 28/122 2023-10-06T11:03:41.168 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/122 2023-10-06T11:03:41.469 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 30/122 2023-10-06T11:03:41.779 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 31/122 2023-10-06T11:03:42.026 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 32/122 2023-10-06T11:03:42.320 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 33/122 2023-10-06T11:03:42.569 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-06T11:03:43.996 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 87/122 2023-10-06T11:03:44.248 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 87/122 2023-10-06T11:03:44.679 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-06T11:03:44.864 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 87/122 2023-10-06T11:03:45.015 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 35/122 2023-10-06T11:03:45.120 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 88/122 2023-10-06T11:03:45.212 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 88/122 2023-10-06T11:03:45.234 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-06T11:03:45.347 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 89/122 2023-10-06T11:03:45.421 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-06T11:03:45.645 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 38/122 2023-10-06T11:03:45.825 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 39/122 2023-10-06T11:03:46.020 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_6 40/122 2023-10-06T11:03:46.185 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 41/122 2023-10-06T11:03:46.348 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 42/122 2023-10-06T11:03:46.546 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 43/122 2023-10-06T11:03:46.696 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : fuse-2.9.7-12.el8.x86_64 44/122 2023-10-06T11:03:46.831 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 45/122 2023-10-06T11:03:47.000 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 46/122 2023-10-06T11:03:47.162 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 47/122 2023-10-06T11:03:47.467 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 48/122 2023-10-06T11:03:47.728 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 49/122 2023-10-06T11:03:47.986 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 50/122 2023-10-06T11:03:48.313 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 51/122 2023-10-06T11:03:48.509 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : automake-1.16.1-7.el8.noarch 52/122 2023-10-06T11:03:48.709 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 53/122 2023-10-06T11:03:48.910 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 54/122 2023-10-06T11:03:49.113 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 55/122 2023-10-06T11:03:49.276 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-06T11:03:49.370 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-06T11:03:49.551 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : jq-1.5-12.el8.x86_64 57/122 2023-10-06T11:03:49.745 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 58/122 2023-10-06T11:03:49.926 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-06T11:03:50.106 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-06T11:03:50.365 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-06T11:03:50.577 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-06T11:03:50.783 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-06T11:03:50.947 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-06T11:03:51.087 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-06T11:03:51.269 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-06T11:03:51.480 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-06T11:03:51.687 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-06T11:03:51.887 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-06T11:03:52.084 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-06T11:03:52.348 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-06T11:03:52.580 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-06T11:03:52.790 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-06T11:03:53.082 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-06T11:03:53.300 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-06T11:03:53.491 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-06T11:03:53.751 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-06T11:03:54.920 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-06T11:03:55.224 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-06T11:03:55.478 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-06T11:03:55.815 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-06T11:03:56.056 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-06T11:03:56.401 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-06T11:03:56.602 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-06T11:03:56.819 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-06T11:03:57.017 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-06T11:04:02.078 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 87/122 2023-10-06T11:04:02.316 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 87/122 2023-10-06T11:04:02.922 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 87/122 2023-10-06T11:04:03.185 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 89/122 2023-10-06T11:04:03.185 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /sys 2023-10-06T11:04:03.186 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /proc 2023-10-06T11:04:03.186 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /dev 2023-10-06T11:04:03.186 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /run 2023-10-06T11:04:03.186 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /mnt 2023-10-06T11:04:03.186 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /var/tmp 2023-10-06T11:04:03.186 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /home 2023-10-06T11:04:03.186 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /tmp 2023-10-06T11:04:03.186 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /dev 2023-10-06T11:04:03.186 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:04:03.194 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 88/122 2023-10-06T11:04:03.270 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 88/122 2023-10-06T11:04:03.416 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 89/122 2023-10-06T11:04:03.561 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 90/122 2023-10-06T11:04:05.055 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 90/122 2023-10-06T11:04:05.234 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 91/122 2023-10-06T11:04:05.455 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 91/122 2023-10-06T11:04:05.602 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 92/122 2023-10-06T11:04:05.996 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 92/122 2023-10-06T11:04:06.144 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 93/122 2023-10-06T11:04:06.161 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 93/122 2023-10-06T11:04:08.999 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 94/122 2023-10-06T11:04:09.178 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 94/122 2023-10-06T11:04:09.350 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.e 95/122 2023-10-06T11:04:09.557 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a. 96/122 2023-10-06T11:04:09.735 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 97/122 2023-10-06T11:04:09.952 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 97/122 2023-10-06T11:04:10.150 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 98/122 2023-10-06T11:04:11.130 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 98/122 2023-10-06T11:04:11.310 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 99/122 2023-10-06T11:04:11.410 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 99/122 2023-10-06T11:04:11.798 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el 100/122 2023-10-06T11:04:11.950 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 101/122 2023-10-06T11:04:11.986 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 101/122 2023-10-06T11:04:12.151 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 102/122 2023-10-06T11:04:12.163 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 102/122 2023-10-06T11:04:13.750 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 103/122 2023-10-06T11:04:13.966 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 104/122 2023-10-06T11:04:14.061 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 104/122 2023-10-06T11:04:14.218 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1274.g68e53 105/122 2023-10-06T11:04:14.264 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1274.g68e53 105/122 2023-10-06T11:04:14.435 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 106/122 2023-10-06T11:04:14.782 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 106/122 2023-10-06T11:04:14.968 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 107/122 2023-10-06T11:04:19.911 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 107/122 2023-10-06T11:04:20.872 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 108/122 2023-10-06T11:04:21.230 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-10-06T11:04:21.422 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 110/122 2023-10-06T11:04:21.660 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-10-06T11:04:21.850 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-10-06T11:04:21.861 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-10-06T11:04:21.923 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 89/122 2023-10-06T11:04:21.923 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /sys 2023-10-06T11:04:21.923 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /proc 2023-10-06T11:04:21.923 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /dev 2023-10-06T11:04:21.924 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /run 2023-10-06T11:04:21.924 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /mnt 2023-10-06T11:04:21.924 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /var/tmp 2023-10-06T11:04:21.924 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /home 2023-10-06T11:04:21.924 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /tmp 2023-10-06T11:04:21.924 INFO:teuthology.orchestra.run.smithi146.stdout:skipping the directory /dev 2023-10-06T11:04:21.924 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:04:22.037 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_ 113/122 2023-10-06T11:04:22.188 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-06T11:04:22.288 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 90/122 2023-10-06T11:04:22.325 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 115/122 2023-10-06T11:04:22.533 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 116/122 2023-10-06T11:04:22.797 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 117/122 2023-10-06T11:04:22.999 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-10-06T11:04:23.052 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-10-06T11:04:23.216 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-10-06T11:04:23.225 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-10-06T11:04:23.352 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-10-06T11:04:23.352 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T11:04:23.544 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T11:04:23.544 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T11:04:23.774 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 90/122 2023-10-06T11:04:23.991 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 91/122 2023-10-06T11:04:24.212 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 91/122 2023-10-06T11:04:24.371 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 92/122 2023-10-06T11:04:24.410 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T11:04:24.411 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 1/122 2023-10-06T11:04:24.411 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 2/122 2023-10-06T11:04:24.411 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 3/122 2023-10-06T11:04:24.411 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 4/122 2023-10-06T11:04:24.411 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1274.g68e53 5/122 2023-10-06T11:04:24.411 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 6/122 2023-10-06T11:04:24.411 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 7/122 2023-10-06T11:04:24.411 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 8/122 2023-10-06T11:04:24.411 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 9/122 2023-10-06T11:04:24.411 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/122 2023-10-06T11:04:24.411 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 11/122 2023-10-06T11:04:24.412 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 12/122 2023-10-06T11:04:24.412 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/122 2023-10-06T11:04:24.412 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_ 14/122 2023-10-06T11:04:24.412 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 15/122 2023-10-06T11:04:24.412 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 16/122 2023-10-06T11:04:24.412 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_6 17/122 2023-10-06T11:04:24.412 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 18/122 2023-10-06T11:04:24.412 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 19/122 2023-10-06T11:04:24.412 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el 20/122 2023-10-06T11:04:24.412 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8. 21/122 2023-10-06T11:04:24.412 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_6 22/122 2023-10-06T11:04:24.412 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 23/122 2023-10-06T11:04:24.413 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 24/122 2023-10-06T11:04:24.413 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 25/122 2023-10-06T11:04:24.413 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 26/122 2023-10-06T11:04:24.413 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 27/122 2023-10-06T11:04:24.413 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 28/122 2023-10-06T11:04:24.413 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a. 29/122 2023-10-06T11:04:24.413 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 30/122 2023-10-06T11:04:24.421 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 31/122 2023-10-06T11:04:24.421 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 32/122 2023-10-06T11:04:24.421 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el 33/122 2023-10-06T11:04:24.421 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 34/122 2023-10-06T11:04:24.421 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.e 35/122 2023-10-06T11:04:24.421 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 36/122 2023-10-06T11:04:24.421 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 37/122 2023-10-06T11:04:24.421 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 38/122 2023-10-06T11:04:24.421 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-06T11:04:24.422 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-06T11:04:24.422 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-06T11:04:24.422 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-06T11:04:24.422 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-06T11:04:24.422 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-06T11:04:24.422 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-06T11:04:24.422 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-06T11:04:24.422 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-06T11:04:24.422 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-06T11:04:24.422 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-06T11:04:24.422 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-06T11:04:24.423 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-06T11:04:24.423 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-06T11:04:24.423 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-06T11:04:24.423 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-06T11:04:24.423 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-06T11:04:24.423 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-06T11:04:24.423 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-06T11:04:24.423 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-06T11:04:24.423 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-06T11:04:24.423 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-06T11:04:24.423 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-06T11:04:24.423 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-06T11:04:24.423 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-06T11:04:24.424 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-06T11:04:24.424 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-06T11:04:24.424 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-06T11:04:24.424 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-06T11:04:24.424 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-06T11:04:24.424 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-06T11:04:24.424 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-06T11:04:24.424 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-06T11:04:24.424 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-10-06T11:04:24.424 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-10-06T11:04:24.424 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-10-06T11:04:24.424 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-10-06T11:04:24.425 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-10-06T11:04:24.425 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-10-06T11:04:24.425 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-10-06T11:04:24.425 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-10-06T11:04:24.425 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-10-06T11:04:24.425 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-10-06T11:04:24.425 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-10-06T11:04:24.425 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-10-06T11:04:24.425 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-10-06T11:04:24.425 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-10-06T11:04:24.425 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-10-06T11:04:24.425 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-10-06T11:04:24.425 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-10-06T11:04:24.426 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-10-06T11:04:24.426 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-10-06T11:04:24.426 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-10-06T11:04:24.426 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-10-06T11:04:24.426 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-10-06T11:04:24.426 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-10-06T11:04:24.426 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-10-06T11:04:24.426 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-10-06T11:04:24.426 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-10-06T11:04:24.426 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-10-06T11:04:24.426 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-10-06T11:04:24.426 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-10-06T11:04:24.427 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-10-06T11:04:24.427 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-10-06T11:04:24.427 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-10-06T11:04:24.427 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-10-06T11:04:24.427 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-10-06T11:04:24.427 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-10-06T11:04:24.427 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-10-06T11:04:24.427 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-10-06T11:04:24.427 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-10-06T11:04:24.427 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-10-06T11:04:24.427 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-10-06T11:04:24.427 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-10-06T11:04:24.428 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-10-06T11:04:24.428 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-10-06T11:04:24.428 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-10-06T11:04:24.428 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-10-06T11:04:24.428 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-10-06T11:04:24.428 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-10-06T11:04:24.428 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 119/122 2023-10-06T11:04:24.428 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-06T11:04:24.428 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 121/122 2023-10-06T11:04:24.769 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 92/122 2023-10-06T11:04:24.929 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 93/122 2023-10-06T11:04:24.946 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 93/122 2023-10-06T11:04:26.514 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T11:04:26.514 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:01:40 ago on Fri 06 Oct 2023 11:02:46 AM UTC. 2023-10-06T11:04:27.780 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 94/122 2023-10-06T11:04:27.935 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 94/122 2023-10-06T11:04:28.110 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.e 95/122 2023-10-06T11:04:28.342 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a. 96/122 2023-10-06T11:04:28.528 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 97/122 2023-10-06T11:04:28.536 INFO:teuthology.orchestra.run.smithi151.stdout:Installed products updated. 2023-10-06T11:04:28.692 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:04:28.693 INFO:teuthology.orchestra.run.smithi151.stdout:Upgraded: 2023-10-06T11:04:28.693 INFO:teuthology.orchestra.run.smithi151.stdout: librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:28.693 INFO:teuthology.orchestra.run.smithi151.stdout: librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:28.693 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2023-10-06T11:04:28.693 INFO:teuthology.orchestra.run.smithi151.stdout: automake-1.16.1-7.el8.noarch 2023-10-06T11:04:28.693 INFO:teuthology.orchestra.run.smithi151.stdout: bison-3.0.4-10.el8.x86_64 2023-10-06T11:04:28.693 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:28.693 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:28.693 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:28.693 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:28.694 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T11:04:28.694 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-immutable-object-cache-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:28.694 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:28.694 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:28.694 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T11:04:28.694 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T11:04:28.694 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T11:04:28.694 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T11:04:28.694 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T11:04:28.694 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:28.694 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:28.695 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T11:04:28.695 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:28.695 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:28.695 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:28.695 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T11:04:28.695 INFO:teuthology.orchestra.run.smithi151.stdout: cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T11:04:28.695 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:28.695 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T11:04:28.695 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-06T11:04:28.695 INFO:teuthology.orchestra.run.smithi151.stdout: flex-2.6.1-9.el8.x86_64 2023-10-06T11:04:28.695 INFO:teuthology.orchestra.run.smithi151.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-06T11:04:28.695 INFO:teuthology.orchestra.run.smithi151.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-06T11:04:28.696 INFO:teuthology.orchestra.run.smithi151.stdout: jq-1.5-12.el8.x86_64 2023-10-06T11:04:28.696 INFO:teuthology.orchestra.run.smithi151.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-06T11:04:28.696 INFO:teuthology.orchestra.run.smithi151.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-06T11:04:28.696 INFO:teuthology.orchestra.run.smithi151.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-06T11:04:28.696 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:28.696 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:28.696 INFO:teuthology.orchestra.run.smithi151.stdout: libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:28.696 INFO:teuthology.orchestra.run.smithi151.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-06T11:04:28.696 INFO:teuthology.orchestra.run.smithi151.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-06T11:04:28.696 INFO:teuthology.orchestra.run.smithi151.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-06T11:04:28.696 INFO:teuthology.orchestra.run.smithi151.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-06T11:04:28.696 INFO:teuthology.orchestra.run.smithi151.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-06T11:04:28.696 INFO:teuthology.orchestra.run.smithi151.stdout: librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:28.697 INFO:teuthology.orchestra.run.smithi151.stdout: libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:28.697 INFO:teuthology.orchestra.run.smithi151.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-06T11:04:28.697 INFO:teuthology.orchestra.run.smithi151.stdout: librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:28.697 INFO:teuthology.orchestra.run.smithi151.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-06T11:04:28.697 INFO:teuthology.orchestra.run.smithi151.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-06T11:04:28.697 INFO:teuthology.orchestra.run.smithi151.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-06T11:04:28.697 INFO:teuthology.orchestra.run.smithi151.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-06T11:04:28.697 INFO:teuthology.orchestra.run.smithi151.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-06T11:04:28.697 INFO:teuthology.orchestra.run.smithi151.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-06T11:04:28.697 INFO:teuthology.orchestra.run.smithi151.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-06T11:04:28.697 INFO:teuthology.orchestra.run.smithi151.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-06T11:04:28.697 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-06T11:04:28.698 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-06T11:04:28.698 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-06T11:04:28.698 INFO:teuthology.orchestra.run.smithi151.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-06T11:04:28.698 INFO:teuthology.orchestra.run.smithi151.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-06T11:04:28.698 INFO:teuthology.orchestra.run.smithi151.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-06T11:04:28.698 INFO:teuthology.orchestra.run.smithi151.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-06T11:04:28.698 INFO:teuthology.orchestra.run.smithi151.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-06T11:04:28.698 INFO:teuthology.orchestra.run.smithi151.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-06T11:04:28.698 INFO:teuthology.orchestra.run.smithi151.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-06T11:04:28.698 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-06T11:04:28.698 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:28.698 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:28.699 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:28.699 INFO:teuthology.orchestra.run.smithi151.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-06T11:04:28.699 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-06T11:04:28.699 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-06T11:04:28.699 INFO:teuthology.orchestra.run.smithi151.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-06T11:04:28.699 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-06T11:04:28.699 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-06T11:04:28.699 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-06T11:04:28.699 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-06T11:04:28.699 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-06T11:04:28.699 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-06T11:04:28.699 INFO:teuthology.orchestra.run.smithi151.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-06T11:04:28.700 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-06T11:04:28.700 INFO:teuthology.orchestra.run.smithi151.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-06T11:04:28.700 INFO:teuthology.orchestra.run.smithi151.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-06T11:04:28.700 INFO:teuthology.orchestra.run.smithi151.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-06T11:04:28.700 INFO:teuthology.orchestra.run.smithi151.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-06T11:04:28.700 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-06T11:04:28.700 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-06T11:04:28.700 INFO:teuthology.orchestra.run.smithi151.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-06T11:04:28.700 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-06T11:04:28.700 INFO:teuthology.orchestra.run.smithi151.stdout: python3-portend-2.6-1.el8.noarch 2023-10-06T11:04:28.700 INFO:teuthology.orchestra.run.smithi151.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-06T11:04:28.700 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-06T11:04:28.701 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-06T11:04:28.701 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-06T11:04:28.701 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:28.701 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:28.701 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-06T11:04:28.701 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-06T11:04:28.701 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:28.701 INFO:teuthology.orchestra.run.smithi151.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-06T11:04:28.701 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-06T11:04:28.701 INFO:teuthology.orchestra.run.smithi151.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-06T11:04:28.701 INFO:teuthology.orchestra.run.smithi151.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-06T11:04:28.701 INFO:teuthology.orchestra.run.smithi151.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-06T11:04:28.702 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-06T11:04:28.702 INFO:teuthology.orchestra.run.smithi151.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-06T11:04:28.702 INFO:teuthology.orchestra.run.smithi151.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-06T11:04:28.702 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-06T11:04:28.702 INFO:teuthology.orchestra.run.smithi151.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-06T11:04:28.702 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-06T11:04:28.702 INFO:teuthology.orchestra.run.smithi151.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-06T11:04:28.702 INFO:teuthology.orchestra.run.smithi151.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-06T11:04:28.702 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:28.702 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:28.702 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:28.702 INFO:teuthology.orchestra.run.smithi151.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-06T11:04:28.703 INFO:teuthology.orchestra.run.smithi151.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-06T11:04:28.703 INFO:teuthology.orchestra.run.smithi151.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-06T11:04:28.703 INFO:teuthology.orchestra.run.smithi151.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-06T11:04:28.703 INFO:teuthology.orchestra.run.smithi151.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-06T11:04:28.703 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:04:28.703 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-10-06T11:04:28.745 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 97/122 2023-10-06T11:04:28.948 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 98/122 2023-10-06T11:04:28.977 DEBUG:teuthology.parallel:result is None 2023-10-06T11:04:29.923 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 98/122 2023-10-06T11:04:30.111 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 99/122 2023-10-06T11:04:30.212 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 99/122 2023-10-06T11:04:30.573 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el 100/122 2023-10-06T11:04:30.765 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 101/122 2023-10-06T11:04:30.803 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 101/122 2023-10-06T11:04:30.978 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 102/122 2023-10-06T11:04:30.990 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 102/122 2023-10-06T11:04:32.588 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 103/122 2023-10-06T11:04:32.840 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 104/122 2023-10-06T11:04:32.930 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 104/122 2023-10-06T11:04:33.078 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1274.g68e53 105/122 2023-10-06T11:04:33.122 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1274.g68e53 105/122 2023-10-06T11:04:33.278 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 106/122 2023-10-06T11:04:33.627 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 106/122 2023-10-06T11:04:33.794 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 107/122 2023-10-06T11:04:38.748 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 107/122 2023-10-06T11:04:39.062 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 108/122 2023-10-06T11:04:39.227 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libtool-2.4.6-25.el8.x86_64 109/122 2023-10-06T11:04:39.953 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 109/122 2023-10-06T11:04:40.324 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 110/122 2023-10-06T11:04:40.533 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 111/122 2023-10-06T11:04:40.713 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 112/122 2023-10-06T11:04:40.881 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_ 113/122 2023-10-06T11:04:41.031 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-06T11:04:41.193 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 115/122 2023-10-06T11:04:41.376 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 116/122 2023-10-06T11:04:41.552 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 117/122 2023-10-06T11:04:41.769 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 118/122 2023-10-06T11:04:41.976 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : bison-3.0.4-10.el8.x86_64 119/122 2023-10-06T11:04:42.027 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 119/122 2023-10-06T11:04:42.201 INFO:teuthology.orchestra.run.smithi146.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/122 2023-10-06T11:04:42.210 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/122 2023-10-06T11:04:42.211 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T11:04:42.429 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T11:04:42.429 INFO:teuthology.orchestra.run.smithi146.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T11:04:43.291 INFO:teuthology.orchestra.run.smithi146.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T11:04:43.291 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 1/122 2023-10-06T11:04:43.291 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 2/122 2023-10-06T11:04:43.291 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 3/122 2023-10-06T11:04:43.291 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 4/122 2023-10-06T11:04:43.291 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1274.g68e53 5/122 2023-10-06T11:04:43.291 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 6/122 2023-10-06T11:04:43.291 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 7/122 2023-10-06T11:04:43.292 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 8/122 2023-10-06T11:04:43.292 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 9/122 2023-10-06T11:04:43.292 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 10/122 2023-10-06T11:04:43.292 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 11/122 2023-10-06T11:04:43.292 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 12/122 2023-10-06T11:04:43.292 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 13/122 2023-10-06T11:04:43.292 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_ 14/122 2023-10-06T11:04:43.292 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 15/122 2023-10-06T11:04:43.293 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 16/122 2023-10-06T11:04:43.293 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_6 17/122 2023-10-06T11:04:43.293 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86 18/122 2023-10-06T11:04:43.293 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 19/122 2023-10-06T11:04:43.293 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el 20/122 2023-10-06T11:04:43.293 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8. 21/122 2023-10-06T11:04:43.293 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_6 22/122 2023-10-06T11:04:43.293 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 23/122 2023-10-06T11:04:43.294 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 24/122 2023-10-06T11:04:43.294 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 25/122 2023-10-06T11:04:43.294 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 26/122 2023-10-06T11:04:43.294 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 27/122 2023-10-06T11:04:43.294 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 28/122 2023-10-06T11:04:43.294 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a. 29/122 2023-10-06T11:04:43.294 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noa 30/122 2023-10-06T11:04:43.302 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.n 31/122 2023-10-06T11:04:43.303 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e 32/122 2023-10-06T11:04:43.303 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el 33/122 2023-10-06T11:04:43.303 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 34/122 2023-10-06T11:04:43.303 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.e 35/122 2023-10-06T11:04:43.303 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 36/122 2023-10-06T11:04:43.303 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 37/122 2023-10-06T11:04:43.303 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 38/122 2023-10-06T11:04:43.303 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-06T11:04:43.303 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-06T11:04:43.304 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-06T11:04:43.304 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-06T11:04:43.304 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-06T11:04:43.304 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-06T11:04:43.304 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-06T11:04:43.304 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-06T11:04:43.304 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-06T11:04:43.304 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-06T11:04:43.304 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-06T11:04:43.305 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-06T11:04:43.305 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-06T11:04:43.305 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-06T11:04:43.305 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-06T11:04:43.305 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-06T11:04:43.305 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-06T11:04:43.305 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-06T11:04:43.305 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-06T11:04:43.306 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-06T11:04:43.306 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-06T11:04:43.306 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-06T11:04:43.306 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-06T11:04:43.306 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-06T11:04:43.306 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-06T11:04:43.306 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-06T11:04:43.306 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-06T11:04:43.307 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-06T11:04:43.307 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-06T11:04:43.307 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-06T11:04:43.307 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-06T11:04:43.307 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-06T11:04:43.307 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-06T11:04:43.307 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 72/122 2023-10-06T11:04:43.307 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 73/122 2023-10-06T11:04:43.308 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 74/122 2023-10-06T11:04:43.308 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : jq-1.5-12.el8.x86_64 75/122 2023-10-06T11:04:43.308 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : flex-2.6.1-9.el8.x86_64 76/122 2023-10-06T11:04:43.308 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 77/122 2023-10-06T11:04:43.308 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 78/122 2023-10-06T11:04:43.308 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 79/122 2023-10-06T11:04:43.308 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : bison-3.0.4-10.el8.x86_64 80/122 2023-10-06T11:04:43.308 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 81/122 2023-10-06T11:04:43.309 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 82/122 2023-10-06T11:04:43.309 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 83/122 2023-10-06T11:04:43.309 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 84/122 2023-10-06T11:04:43.309 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 85/122 2023-10-06T11:04:43.309 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 86/122 2023-10-06T11:04:43.309 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 87/122 2023-10-06T11:04:43.309 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 88/122 2023-10-06T11:04:43.309 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 89/122 2023-10-06T11:04:43.309 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 90/122 2023-10-06T11:04:43.310 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 91/122 2023-10-06T11:04:43.310 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 92/122 2023-10-06T11:04:43.310 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 93/122 2023-10-06T11:04:43.310 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 94/122 2023-10-06T11:04:43.310 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 95/122 2023-10-06T11:04:43.310 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : automake-1.16.1-7.el8.noarch 96/122 2023-10-06T11:04:43.310 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 97/122 2023-10-06T11:04:43.310 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 98/122 2023-10-06T11:04:43.311 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 99/122 2023-10-06T11:04:43.311 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 100/122 2023-10-06T11:04:43.311 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 101/122 2023-10-06T11:04:43.311 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 102/122 2023-10-06T11:04:43.311 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 103/122 2023-10-06T11:04:43.311 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 104/122 2023-10-06T11:04:43.311 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 105/122 2023-10-06T11:04:43.311 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 106/122 2023-10-06T11:04:43.312 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 107/122 2023-10-06T11:04:43.312 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 108/122 2023-10-06T11:04:43.312 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 109/122 2023-10-06T11:04:43.312 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 110/122 2023-10-06T11:04:43.312 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 111/122 2023-10-06T11:04:43.312 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 112/122 2023-10-06T11:04:43.312 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 113/122 2023-10-06T11:04:43.312 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 114/122 2023-10-06T11:04:43.312 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 115/122 2023-10-06T11:04:43.313 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 116/122 2023-10-06T11:04:43.313 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 117/122 2023-10-06T11:04:43.313 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 118/122 2023-10-06T11:04:43.313 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 119/122 2023-10-06T11:04:43.313 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-06T11:04:43.313 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 121/122 2023-10-06T11:04:45.452 INFO:teuthology.orchestra.run.smithi146.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T11:04:45.452 INFO:teuthology.orchestra.run.smithi146.stdout:Last metadata expiration check: 0:01:59 ago on Fri 06 Oct 2023 11:02:46 AM UTC. 2023-10-06T11:04:47.506 INFO:teuthology.orchestra.run.smithi146.stdout:Installed products updated. 2023-10-06T11:04:47.646 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:04:47.646 INFO:teuthology.orchestra.run.smithi146.stdout:Upgraded: 2023-10-06T11:04:47.646 INFO:teuthology.orchestra.run.smithi146.stdout: librados2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:47.647 INFO:teuthology.orchestra.run.smithi146.stdout: librbd1-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:47.647 INFO:teuthology.orchestra.run.smithi146.stdout:Installed: 2023-10-06T11:04:47.647 INFO:teuthology.orchestra.run.smithi146.stdout: automake-1.16.1-7.el8.noarch 2023-10-06T11:04:47.647 INFO:teuthology.orchestra.run.smithi146.stdout: bison-3.0.4-10.el8.x86_64 2023-10-06T11:04:47.647 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:47.647 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-base-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:47.647 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:47.647 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:47.647 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-grafana-dashboards-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T11:04:47.647 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-immutable-object-cache-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:47.647 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mds-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:47.647 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:47.648 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T11:04:47.648 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-dashboard-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T11:04:47.648 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T11:04:47.648 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-modules-core-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T11:04:47.648 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mgr-rook-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T11:04:47.648 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-mon-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:47.648 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-osd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:47.648 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-prometheus-alerts-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T11:04:47.648 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-radosgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:47.648 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-selinux-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:47.648 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-test-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:47.648 INFO:teuthology.orchestra.run.smithi146.stdout: ceph-volume-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T11:04:47.648 INFO:teuthology.orchestra.run.smithi146.stdout: cephadm-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T11:04:47.649 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:47.649 INFO:teuthology.orchestra.run.smithi146.stdout: cephfs-top-2:17.2.6-1274.g68e53a4a.el8.noarch 2023-10-06T11:04:47.649 INFO:teuthology.orchestra.run.smithi146.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-06T11:04:47.649 INFO:teuthology.orchestra.run.smithi146.stdout: flex-2.6.1-9.el8.x86_64 2023-10-06T11:04:47.649 INFO:teuthology.orchestra.run.smithi146.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-06T11:04:47.649 INFO:teuthology.orchestra.run.smithi146.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-06T11:04:47.649 INFO:teuthology.orchestra.run.smithi146.stdout: jq-1.5-12.el8.x86_64 2023-10-06T11:04:47.649 INFO:teuthology.orchestra.run.smithi146.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-06T11:04:47.649 INFO:teuthology.orchestra.run.smithi146.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-06T11:04:47.649 INFO:teuthology.orchestra.run.smithi146.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-06T11:04:47.649 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs-devel-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:47.649 INFO:teuthology.orchestra.run.smithi146.stdout: libcephfs2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:47.649 INFO:teuthology.orchestra.run.smithi146.stdout: libcephsqlite-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:47.650 INFO:teuthology.orchestra.run.smithi146.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-06T11:04:47.650 INFO:teuthology.orchestra.run.smithi146.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-06T11:04:47.650 INFO:teuthology.orchestra.run.smithi146.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-06T11:04:47.650 INFO:teuthology.orchestra.run.smithi146.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-06T11:04:47.650 INFO:teuthology.orchestra.run.smithi146.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-06T11:04:47.650 INFO:teuthology.orchestra.run.smithi146.stdout: librados-devel-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:47.650 INFO:teuthology.orchestra.run.smithi146.stdout: libradosstriper1-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:47.650 INFO:teuthology.orchestra.run.smithi146.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-06T11:04:47.650 INFO:teuthology.orchestra.run.smithi146.stdout: librgw2-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:47.650 INFO:teuthology.orchestra.run.smithi146.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-06T11:04:47.650 INFO:teuthology.orchestra.run.smithi146.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-06T11:04:47.650 INFO:teuthology.orchestra.run.smithi146.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-06T11:04:47.651 INFO:teuthology.orchestra.run.smithi146.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-06T11:04:47.651 INFO:teuthology.orchestra.run.smithi146.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-06T11:04:47.651 INFO:teuthology.orchestra.run.smithi146.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-06T11:04:47.651 INFO:teuthology.orchestra.run.smithi146.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-06T11:04:47.651 INFO:teuthology.orchestra.run.smithi146.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-06T11:04:47.651 INFO:teuthology.orchestra.run.smithi146.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-06T11:04:47.651 INFO:teuthology.orchestra.run.smithi146.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-06T11:04:47.651 INFO:teuthology.orchestra.run.smithi146.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-06T11:04:47.651 INFO:teuthology.orchestra.run.smithi146.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-06T11:04:47.651 INFO:teuthology.orchestra.run.smithi146.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-06T11:04:47.651 INFO:teuthology.orchestra.run.smithi146.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-06T11:04:47.651 INFO:teuthology.orchestra.run.smithi146.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-06T11:04:47.651 INFO:teuthology.orchestra.run.smithi146.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-06T11:04:47.652 INFO:teuthology.orchestra.run.smithi146.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-06T11:04:47.652 INFO:teuthology.orchestra.run.smithi146.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-06T11:04:47.652 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-06T11:04:47.652 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-argparse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:47.652 INFO:teuthology.orchestra.run.smithi146.stdout: python3-ceph-common-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:47.652 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cephfs-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:47.652 INFO:teuthology.orchestra.run.smithi146.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-06T11:04:47.652 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-06T11:04:47.652 INFO:teuthology.orchestra.run.smithi146.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-06T11:04:47.652 INFO:teuthology.orchestra.run.smithi146.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-06T11:04:47.652 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-06T11:04:47.652 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-06T11:04:47.653 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-06T11:04:47.653 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-06T11:04:47.653 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-06T11:04:47.653 INFO:teuthology.orchestra.run.smithi146.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-06T11:04:47.653 INFO:teuthology.orchestra.run.smithi146.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-06T11:04:47.653 INFO:teuthology.orchestra.run.smithi146.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-06T11:04:47.653 INFO:teuthology.orchestra.run.smithi146.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-06T11:04:47.653 INFO:teuthology.orchestra.run.smithi146.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-06T11:04:47.653 INFO:teuthology.orchestra.run.smithi146.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-06T11:04:47.653 INFO:teuthology.orchestra.run.smithi146.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-06T11:04:47.653 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-06T11:04:47.653 INFO:teuthology.orchestra.run.smithi146.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-06T11:04:47.653 INFO:teuthology.orchestra.run.smithi146.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-06T11:04:47.654 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-06T11:04:47.654 INFO:teuthology.orchestra.run.smithi146.stdout: python3-portend-2.6-1.el8.noarch 2023-10-06T11:04:47.654 INFO:teuthology.orchestra.run.smithi146.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-06T11:04:47.654 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-06T11:04:47.654 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-06T11:04:47.654 INFO:teuthology.orchestra.run.smithi146.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-06T11:04:47.654 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rados-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:47.654 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:47.654 INFO:teuthology.orchestra.run.smithi146.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-06T11:04:47.654 INFO:teuthology.orchestra.run.smithi146.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-06T11:04:47.654 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rgw-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:47.654 INFO:teuthology.orchestra.run.smithi146.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-06T11:04:47.654 INFO:teuthology.orchestra.run.smithi146.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-06T11:04:47.655 INFO:teuthology.orchestra.run.smithi146.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-06T11:04:47.655 INFO:teuthology.orchestra.run.smithi146.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-06T11:04:47.655 INFO:teuthology.orchestra.run.smithi146.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-06T11:04:47.655 INFO:teuthology.orchestra.run.smithi146.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-06T11:04:47.655 INFO:teuthology.orchestra.run.smithi146.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-06T11:04:47.655 INFO:teuthology.orchestra.run.smithi146.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-06T11:04:47.655 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-06T11:04:47.655 INFO:teuthology.orchestra.run.smithi146.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-06T11:04:47.655 INFO:teuthology.orchestra.run.smithi146.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-06T11:04:47.655 INFO:teuthology.orchestra.run.smithi146.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-06T11:04:47.655 INFO:teuthology.orchestra.run.smithi146.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-06T11:04:47.655 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-fuse-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:47.656 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-mirror-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:47.656 INFO:teuthology.orchestra.run.smithi146.stdout: rbd-nbd-2:17.2.6-1274.g68e53a4a.el8.x86_64 2023-10-06T11:04:47.656 INFO:teuthology.orchestra.run.smithi146.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-06T11:04:47.656 INFO:teuthology.orchestra.run.smithi146.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-06T11:04:47.656 INFO:teuthology.orchestra.run.smithi146.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-06T11:04:47.656 INFO:teuthology.orchestra.run.smithi146.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-06T11:04:47.656 INFO:teuthology.orchestra.run.smithi146.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-06T11:04:47.656 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:04:47.656 INFO:teuthology.orchestra.run.smithi146.stdout:Complete! 2023-10-06T11:04:47.900 DEBUG:teuthology.parallel:result is None 2023-10-06T11:04:47.901 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T11:04:48.047 DEBUG:teuthology.orchestra.run.smithi146:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-06T11:04:48.068 INFO:teuthology.orchestra.run.smithi146.stdout:17.2.6-1274.g68e53a4a.el8 2023-10-06T11:04:48.068 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1274.g68e53a4a.el8 2023-10-06T11:04:48.068 INFO:teuthology.task.install:The correct ceph version 17.2.6-1274.g68e53a4a is installed. 2023-10-06T11:04:48.068 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564 2023-10-06T11:04:48.282 DEBUG:teuthology.orchestra.run.smithi151:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-06T11:04:48.306 INFO:teuthology.orchestra.run.smithi151.stdout:17.2.6-1274.g68e53a4a.el8 2023-10-06T11:04:48.306 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1274.g68e53a4a.el8 2023-10-06T11:04:48.307 INFO:teuthology.task.install:The correct ceph version 17.2.6-1274.g68e53a4a is installed. 2023-10-06T11:04:48.307 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-06T11:04:48.307 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-06T11:04:48.307 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T11:04:48.345 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-06T11:04:48.345 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T11:04:48.388 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-06T11:04:48.389 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-06T11:04:48.389 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T11:04:48.413 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T11:04:48.478 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-06T11:04:48.478 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T11:04:48.504 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T11:04:48.569 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-06T11:04:48.570 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-06T11:04:48.570 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T11:04:48.594 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T11:04:48.658 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-06T11:04:48.658 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T11:04:48.682 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T11:04:48.747 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-06T11:04:48.747 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-06T11:04:48.747 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T11:04:48.771 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T11:04:48.835 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-06T11:04:48.835 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T11:04:48.860 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T11:04:48.924 INFO:teuthology.run_tasks:Running task ceph... 2023-10-06T11:04:48.985 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-06T11:04:48.985 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 777 /var/log/ceph 2023-10-06T11:04:48.988 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 777 /var/log/ceph 2023-10-06T11:04:49.011 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-06T11:04:49.011 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T11:04:49.053 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T11:04:49.076 INFO:tasks.ceph:Creating extra log directories... 2023-10-06T11:04:49.077 DEBUG:teuthology.orchestra.run.smithi146:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T11:04:49.116 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T11:04:49.146 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-06T11:04:49.146 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-06T11:04:49.146 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-06T11:04:49.146 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-06T11:04:49.146 DEBUG:teuthology.orchestra.run.smithi146:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T11:04:49.193 DEBUG:teuthology.orchestra.run.smithi146:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T11:04:49.303 DEBUG:teuthology.orchestra.run.smithi146:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-06T11:04:49.327 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-06T11:04:49.327 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T11:04:49.341 DEBUG:teuthology.orchestra.run.smithi151:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T11:04:49.451 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-06T11:04:49.479 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-06T11:04:49.479 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-06T11:04:49.480 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412383', 'branch': 'wip-yuri3-testing-2023-10-05-0943-quincy', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/scrub}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7412383', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'wip-yuri3-testing-2023-10-05-0943-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'Replacing daemon mds', 'Scrub error on inode', 'Behind on trimming', 'Metadata damage detected', 'bad backtrace on inode', 'overall HEALTH_', '\\(MDS_TRIM\\)'], 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri3-testing-2023-10-05-0943-quincy', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 4002, 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri3-testing-2023-10-05-0943-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564', 'targets': {'smithi146.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCxrCmBNDWnrQG363rGgvq+eUam0H+vsbvn8+swaGzRgm2B7vXHGTALrWWsghB8gHDgx270VrwKGtLH1Y6/RNS0=', 'smithi151.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBETlmNbWzgqxqzZvjSqdDrYV2WKRkiFB3wtWmCw7Fa/hcUExw1PNaOi+l3Gbf6W1+rC0QmPLaTkzmyHFjATlIWA='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_scrub_checks', 'tasks.cephfs.test_scrub']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-05_23:54:57', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-06T11:04:49.480 DEBUG:teuthology.orchestra.run.smithi146:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T11:04:49.482 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T11:04:49.529 DEBUG:teuthology.orchestra.run.smithi146:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T11:04:49.536 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T11:04:49.593 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-06T11:04:49.593 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T11:04:49.613 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T11:04:49.613 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_1 2023-10-06T11:04:49.668 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T11:04:49.668 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T11:04:49.668 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 6h/6d Inode: 214978 Links: 1 2023-10-06T11:04:49.668 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T11:04:49.668 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T11:04:49.668 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2023-10-06 11:04:42.862042198 +0000 2023-10-06T11:04:49.668 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2023-10-06 11:02:03.583923815 +0000 2023-10-06T11:04:49.668 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2023-10-06 11:02:03.583923815 +0000 2023-10-06T11:04:49.669 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: - 2023-10-06T11:04:49.669 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T11:04:49.731 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:04:49.731 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:04:49.731 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.00025382 s, 2.0 MB/s 2023-10-06T11:04:49.732 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T11:04:49.788 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_2 2023-10-06T11:04:49.843 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T11:04:49.844 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T11:04:49.844 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 6h/6d Inode: 223275 Links: 1 2023-10-06T11:04:49.844 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T11:04:49.844 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T11:04:49.844 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2023-10-06 11:04:42.862042198 +0000 2023-10-06T11:04:49.844 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2023-10-06 11:02:04.091916333 +0000 2023-10-06T11:04:49.844 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2023-10-06 11:02:04.091916333 +0000 2023-10-06T11:04:49.845 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: - 2023-10-06T11:04:49.845 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T11:04:49.906 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:04:49.906 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:04:49.907 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.00023279 s, 2.2 MB/s 2023-10-06T11:04:49.907 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T11:04:49.963 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_3 2023-10-06T11:04:50.018 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T11:04:50.018 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T11:04:50.018 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 6h/6d Inode: 218533 Links: 1 2023-10-06T11:04:50.018 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T11:04:50.018 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T11:04:50.018 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2023-10-06 11:04:42.862042198 +0000 2023-10-06T11:04:50.019 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2023-10-06 11:02:04.583909087 +0000 2023-10-06T11:04:50.019 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2023-10-06 11:02:04.583909087 +0000 2023-10-06T11:04:50.019 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: - 2023-10-06T11:04:50.019 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T11:04:50.081 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:04:50.081 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:04:50.081 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.000243201 s, 2.1 MB/s 2023-10-06T11:04:50.082 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T11:04:50.138 DEBUG:teuthology.orchestra.run.smithi146:> stat /dev/vg_nvme/lv_4 2023-10-06T11:04:50.193 INFO:teuthology.orchestra.run.smithi146.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T11:04:50.193 INFO:teuthology.orchestra.run.smithi146.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T11:04:50.193 INFO:teuthology.orchestra.run.smithi146.stdout:Device: 6h/6d Inode: 222425 Links: 1 2023-10-06T11:04:50.194 INFO:teuthology.orchestra.run.smithi146.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T11:04:50.194 INFO:teuthology.orchestra.run.smithi146.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T11:04:50.194 INFO:teuthology.orchestra.run.smithi146.stdout:Access: 2023-10-06 11:04:42.862042198 +0000 2023-10-06T11:04:50.194 INFO:teuthology.orchestra.run.smithi146.stdout:Modify: 2023-10-06 11:02:05.069901930 +0000 2023-10-06T11:04:50.194 INFO:teuthology.orchestra.run.smithi146.stdout:Change: 2023-10-06 11:02:05.069901930 +0000 2023-10-06T11:04:50.194 INFO:teuthology.orchestra.run.smithi146.stdout: Birth: - 2023-10-06T11:04:50.194 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T11:04:50.256 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:04:50.256 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:04:50.256 INFO:teuthology.orchestra.run.smithi146.stderr:512 bytes copied, 0.00019884 s, 2.6 MB/s 2023-10-06T11:04:50.257 DEBUG:teuthology.orchestra.run.smithi146:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T11:04:50.312 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T11:04:50.312 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-06T11:04:50.312 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T11:04:50.328 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T11:04:50.328 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_1 2023-10-06T11:04:50.384 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T11:04:50.384 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T11:04:50.384 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 6h/6d Inode: 218602 Links: 1 2023-10-06T11:04:50.384 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T11:04:50.384 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T11:04:50.384 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2023-10-06 11:04:24.014802834 +0000 2023-10-06T11:04:50.384 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2023-10-06 11:02:01.685771888 +0000 2023-10-06T11:04:50.384 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2023-10-06 11:02:01.685771888 +0000 2023-10-06T11:04:50.384 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: - 2023-10-06T11:04:50.385 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T11:04:50.448 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2023-10-06T11:04:50.449 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2023-10-06T11:04:50.449 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000254538 s, 2.0 MB/s 2023-10-06T11:04:50.450 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T11:04:50.506 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_2 2023-10-06T11:04:50.560 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T11:04:50.561 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T11:04:50.561 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 6h/6d Inode: 218657 Links: 1 2023-10-06T11:04:50.561 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T11:04:50.561 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T11:04:50.561 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2023-10-06 11:04:24.014802834 +0000 2023-10-06T11:04:50.561 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2023-10-06 11:02:02.168766156 +0000 2023-10-06T11:04:50.561 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2023-10-06 11:02:02.168766156 +0000 2023-10-06T11:04:50.561 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: - 2023-10-06T11:04:50.562 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T11:04:50.624 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2023-10-06T11:04:50.624 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2023-10-06T11:04:50.624 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000240699 s, 2.1 MB/s 2023-10-06T11:04:50.625 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T11:04:50.681 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_3 2023-10-06T11:04:50.736 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T11:04:50.736 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T11:04:50.736 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 6h/6d Inode: 218720 Links: 1 2023-10-06T11:04:50.736 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T11:04:50.736 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T11:04:50.736 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2023-10-06 11:04:24.014802834 +0000 2023-10-06T11:04:50.737 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2023-10-06 11:02:02.645760496 +0000 2023-10-06T11:04:50.737 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2023-10-06 11:02:02.645760496 +0000 2023-10-06T11:04:50.737 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: - 2023-10-06T11:04:50.737 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T11:04:50.799 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2023-10-06T11:04:50.799 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2023-10-06T11:04:50.799 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000219155 s, 2.3 MB/s 2023-10-06T11:04:50.800 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T11:04:50.856 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_4 2023-10-06T11:04:50.911 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T11:04:50.912 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T11:04:50.912 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 6h/6d Inode: 216923 Links: 1 2023-10-06T11:04:50.912 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T11:04:50.912 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T11:04:50.912 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2023-10-06 11:04:24.015802823 +0000 2023-10-06T11:04:50.912 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2023-10-06 11:02:03.128754764 +0000 2023-10-06T11:04:50.912 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2023-10-06 11:02:03.128754764 +0000 2023-10-06T11:04:50.912 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: - 2023-10-06T11:04:50.913 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T11:04:50.974 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2023-10-06T11:04:50.974 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2023-10-06T11:04:50.974 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000193392 s, 2.6 MB/s 2023-10-06T11:04:50.975 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T11:04:51.031 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T11:04:51.031 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi146.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi151.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T11:04:51.031 INFO:tasks.ceph:Generating config... 2023-10-06T11:04:51.032 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-06T11:04:51.032 INFO:tasks.ceph:[client] debug client = 20 2023-10-06T11:04:51.032 INFO:tasks.ceph:[client] debug ms = 1 2023-10-06T11:04:51.033 INFO:tasks.ceph:[client] pid file = 2023-10-06T11:04:51.033 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-06T11:04:51.033 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-06T11:04:51.033 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-06T11:04:51.033 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-06T11:04:51.033 INFO:tasks.ceph:[mds] mds cache max size = 1000 2023-10-06T11:04:51.033 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-06T11:04:51.033 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-06T11:04:51.033 INFO:tasks.ceph:[mds] mds log max segments = 1 2023-10-06T11:04:51.033 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-06T11:04:51.033 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-06T11:04:51.033 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-06T11:04:51.034 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-06T11:04:51.034 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-06T11:04:51.034 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-06T11:04:51.034 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-06T11:04:51.034 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-06T11:04:51.034 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-06T11:04:51.034 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-06T11:04:51.034 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-06T11:04:51.034 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-06T11:04:51.034 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-06T11:04:51.034 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-06T11:04:51.034 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-06T11:04:51.035 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-06T11:04:51.035 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-06T11:04:51.035 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-06T11:04:51.035 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-06T11:04:51.035 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-06T11:04:51.035 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-06T11:04:51.035 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-06T11:04:51.035 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-06T11:04:51.035 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-06T11:04:51.035 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-06T11:04:51.035 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-06T11:04:51.035 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-06T11:04:51.036 INFO:tasks.ceph:Setting up mon.a... 2023-10-06T11:04:51.036 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-06T11:04:51.080 INFO:teuthology.orchestra.run.smithi146.stdout:creating /etc/ceph/ceph.keyring 2023-10-06T11:04:51.082 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-06T11:04:51.121 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T11:04:51.185 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.146'), ('mon.b', '172.21.15.151'), ('mon.c', '[v2:172.21.15.151:3301,v1:172.21.15.151:6790]')] 2023-10-06T11:04:51.186 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.146,172.21.15.151,[v2:172.21.15.151:3301,v1:172.21.15.151:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds cache max size': 1000, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds log max segments': 1, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-06T11:04:51.186 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-06T11:04:51.186 DEBUG:teuthology.orchestra.run.smithi146:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T11:04:51.240 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.146 --add b 172.21.15.151 --addv c '[v2:172.21.15.151:3301,v1:172.21.15.151:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-06T11:04:51.322 INFO:teuthology.orchestra.run.smithi146.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-06T11:04:51.323 INFO:teuthology.orchestra.run.smithi146.stdout:monmaptool: generated fsid c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1 2023-10-06T11:04:51.323 INFO:teuthology.orchestra.run.smithi146.stdout:setting min_mon_release = octopus 2023-10-06T11:04:51.323 INFO:teuthology.orchestra.run.smithi146.stdout:epoch 0 2023-10-06T11:04:51.323 INFO:teuthology.orchestra.run.smithi146.stdout:fsid c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1 2023-10-06T11:04:51.323 INFO:teuthology.orchestra.run.smithi146.stdout:last_changed 2023-10-06T11:04:51.322430+0000 2023-10-06T11:04:51.323 INFO:teuthology.orchestra.run.smithi146.stdout:created 2023-10-06T11:04:51.322430+0000 2023-10-06T11:04:51.323 INFO:teuthology.orchestra.run.smithi146.stdout:min_mon_release 15 (octopus) 2023-10-06T11:04:51.323 INFO:teuthology.orchestra.run.smithi146.stdout:election_strategy: 1 2023-10-06T11:04:51.323 INFO:teuthology.orchestra.run.smithi146.stdout:0: [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] mon.a 2023-10-06T11:04:51.323 INFO:teuthology.orchestra.run.smithi146.stdout:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2023-10-06T11:04:51.324 INFO:teuthology.orchestra.run.smithi146.stdout:2: [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] mon.c 2023-10-06T11:04:51.324 INFO:teuthology.orchestra.run.smithi146.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-06T11:04:51.325 DEBUG:teuthology.orchestra.run.smithi146:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T11:04:51.378 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1... 2023-10-06T11:04:51.379 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T11:04:51.420 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T11:04:51.461 INFO:teuthology.orchestra.run.smithi146.stdout:[global] 2023-10-06T11:04:51.461 INFO:teuthology.orchestra.run.smithi146.stdout: chdir = "" 2023-10-06T11:04:51.461 INFO:teuthology.orchestra.run.smithi146.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T11:04:51.461 INFO:teuthology.orchestra.run.smithi146.stdout: auth supported = cephx 2023-10-06T11:04:51.461 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:04:51.461 INFO:teuthology.orchestra.run.smithi146.stdout: filestore xattr use omap = true 2023-10-06T11:04:51.461 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:04:51.462 INFO:teuthology.orchestra.run.smithi146.stdout: mon clock drift allowed = 1.000 2023-10-06T11:04:51.462 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:04:51.462 INFO:teuthology.orchestra.run.smithi146.stdout: osd crush chooseleaf type = 0 2023-10-06T11:04:51.462 INFO:teuthology.orchestra.run.smithi146.stdout: auth debug = true 2023-10-06T11:04:51.462 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:04:51.462 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on old message = true 2023-10-06T11:04:51.462 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on bug = true 2023-10-06T11:04:51.462 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:04:51.462 INFO:teuthology.orchestra.run.smithi146.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T11:04:51.462 INFO:teuthology.orchestra.run.smithi146.stdout: mon pg warn max object skew = 0 2023-10-06T11:04:51.462 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:04:51.463 INFO:teuthology.orchestra.run.smithi146.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T11:04:51.463 INFO:teuthology.orchestra.run.smithi146.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T11:04:51.463 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:04:51.463 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default size = 2 2023-10-06T11:04:51.463 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:04:51.463 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow primary affinity = true 2023-10-06T11:04:51.463 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow pg remap = true 2023-10-06T11:04:51.463 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on legacy crush tunables = false 2023-10-06T11:04:51.463 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on crush straw calc version zero = false 2023-10-06T11:04:51.463 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on no sortbitwise = false 2023-10-06T11:04:51.463 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on osd down out interval zero = false 2023-10-06T11:04:51.463 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on too few osds = false 2023-10-06T11:04:51.464 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T11:04:51.464 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T11:04:51.464 INFO:teuthology.orchestra.run.smithi146.stdout: mon_allow_pool_size_one = true 2023-10-06T11:04:51.464 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:04:51.464 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T11:04:51.464 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:04:51.464 INFO:teuthology.orchestra.run.smithi146.stdout: osd default data pool replay window = 5 2023-10-06T11:04:51.464 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:04:51.464 INFO:teuthology.orchestra.run.smithi146.stdout: mon allow pool delete = true 2023-10-06T11:04:51.464 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:04:51.465 INFO:teuthology.orchestra.run.smithi146.stdout: mon cluster log file level = debug 2023-10-06T11:04:51.465 INFO:teuthology.orchestra.run.smithi146.stdout: debug asserts on shutdown = true 2023-10-06T11:04:51.465 INFO:teuthology.orchestra.run.smithi146.stdout: mon health detail to clog = false 2023-10-06T11:04:51.465 INFO:teuthology.orchestra.run.smithi146.stdout: mon host = "172.21.15.146,172.21.15.151,[v2:172.21.15.151:3301,v1:172.21.15.151:6790]" 2023-10-06T11:04:51.465 INFO:teuthology.orchestra.run.smithi146.stdout: fsid = c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1 2023-10-06T11:04:51.465 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:04:51.465 INFO:teuthology.orchestra.run.smithi146.stdout:[osd] 2023-10-06T11:04:51.465 INFO:teuthology.orchestra.run.smithi146.stdout: osd journal size = 100 2023-10-06T11:04:51.465 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:04:51.465 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub load threshold = 5.0 2023-10-06T11:04:51.465 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub max interval = 600 2023-10-06T11:04:51.465 INFO:teuthology.orchestra.run.smithi146.stdout: osd mclock profile = high_recovery_ops 2023-10-06T11:04:51.466 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:04:51.466 INFO:teuthology.orchestra.run.smithi146.stdout: osd recover clone overlap = true 2023-10-06T11:04:51.466 INFO:teuthology.orchestra.run.smithi146.stdout: osd recovery max chunk = 1048576 2023-10-06T11:04:51.466 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:04:51.466 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug shutdown = true 2023-10-06T11:04:51.466 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug op order = true 2023-10-06T11:04:51.466 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug verify stray on activate = true 2023-10-06T11:04:51.466 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:04:51.466 INFO:teuthology.orchestra.run.smithi146.stdout: osd open classes on start = true 2023-10-06T11:04:51.466 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug pg log writeout = true 2023-10-06T11:04:51.466 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:04:51.467 INFO:teuthology.orchestra.run.smithi146.stdout: osd deep scrub update digest min age = 30 2023-10-06T11:04:51.467 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:04:51.467 INFO:teuthology.orchestra.run.smithi146.stdout: osd map max advance = 10 2023-10-06T11:04:51.467 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:04:51.467 INFO:teuthology.orchestra.run.smithi146.stdout: journal zero on create = true 2023-10-06T11:04:51.467 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:04:51.467 INFO:teuthology.orchestra.run.smithi146.stdout: filestore ondisk finisher threads = 3 2023-10-06T11:04:51.467 INFO:teuthology.orchestra.run.smithi146.stdout: filestore apply finisher threads = 3 2023-10-06T11:04:51.467 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:04:51.467 INFO:teuthology.orchestra.run.smithi146.stdout: bdev debug aio = true 2023-10-06T11:04:51.467 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug misdirected ops = true 2023-10-06T11:04:51.467 INFO:teuthology.orchestra.run.smithi146.stdout: bdev async discard = True 2023-10-06T11:04:51.468 INFO:teuthology.orchestra.run.smithi146.stdout: bdev enable discard = True 2023-10-06T11:04:51.468 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore allocator = bitmap 2023-10-06T11:04:51.468 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore block size = 96636764160 2023-10-06T11:04:51.468 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore fsck on mount = True 2023-10-06T11:04:51.468 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluefs = 1/20 2023-10-06T11:04:51.468 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluestore = 1/20 2023-10-06T11:04:51.468 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-10-06T11:04:51.468 INFO:teuthology.orchestra.run.smithi146.stdout: debug osd = 20 2023-10-06T11:04:51.468 INFO:teuthology.orchestra.run.smithi146.stdout: debug rocksdb = 4/10 2023-10-06T11:04:51.468 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T11:04:51.468 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd full ratio = 0.9 2023-10-06T11:04:51.468 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd nearfull ratio = 0.8 2023-10-06T11:04:51.468 INFO:teuthology.orchestra.run.smithi146.stdout: osd failsafe full ratio = 0.95 2023-10-06T11:04:51.469 INFO:teuthology.orchestra.run.smithi146.stdout: osd objectstore = bluestore 2023-10-06T11:04:51.469 INFO:teuthology.orchestra.run.smithi146.stdout: osd op complaint time = 180 2023-10-06T11:04:51.469 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:04:51.469 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr] 2023-10-06T11:04:51.469 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-10-06T11:04:51.469 INFO:teuthology.orchestra.run.smithi146.stdout: debug mgr = 20 2023-10-06T11:04:51.469 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2023-10-06T11:04:51.469 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2023-10-06T11:04:51.469 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2023-10-06T11:04:51.469 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2023-10-06T11:04:51.469 INFO:teuthology.orchestra.run.smithi146.stdout: mgr/telemetry/nag = false 2023-10-06T11:04:51.469 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:04:51.470 INFO:teuthology.orchestra.run.smithi146.stdout:[mon] 2023-10-06T11:04:51.470 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-10-06T11:04:51.470 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2023-10-06T11:04:51.470 INFO:teuthology.orchestra.run.smithi146.stdout: debug paxos = 20 2023-10-06T11:04:51.470 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2023-10-06T11:04:51.470 INFO:teuthology.orchestra.run.smithi146.stdout: mon data avail warn = 5 2023-10-06T11:04:51.470 INFO:teuthology.orchestra.run.smithi146.stdout: mon mgr mkfs grace = 240 2023-10-06T11:04:51.470 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2023-10-06T11:04:51.470 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd reporter subtree level = osd 2023-10-06T11:04:51.470 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd prime pg temp = true 2023-10-06T11:04:51.470 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2023-10-06T11:04:51.470 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:04:51.470 INFO:teuthology.orchestra.run.smithi146.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T11:04:51.471 INFO:teuthology.orchestra.run.smithi146.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T11:04:51.471 INFO:teuthology.orchestra.run.smithi146.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T11:04:51.471 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:04:51.471 INFO:teuthology.orchestra.run.smithi146.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T11:04:51.471 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T11:04:51.471 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T11:04:51.471 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:04:51.471 INFO:teuthology.orchestra.run.smithi146.stdout: # 1m isn't quite enough 2023-10-06T11:04:51.471 INFO:teuthology.orchestra.run.smithi146.stdout: mon_down_mkfs_grace = 2m 2023-10-06T11:04:51.471 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:04:51.471 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_filestore_osds = false 2023-10-06T11:04:51.471 INFO:teuthology.orchestra.run.smithi146.stdout: mon op complaint time = 120 2023-10-06T11:04:51.472 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:04:51.472 INFO:teuthology.orchestra.run.smithi146.stdout:[client] 2023-10-06T11:04:51.472 INFO:teuthology.orchestra.run.smithi146.stdout: rgw cache enabled = true 2023-10-06T11:04:51.472 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable ops log = true 2023-10-06T11:04:51.472 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable usage log = true 2023-10-06T11:04:51.472 INFO:teuthology.orchestra.run.smithi146.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T11:04:51.472 INFO:teuthology.orchestra.run.smithi146.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T11:04:51.472 INFO:teuthology.orchestra.run.smithi146.stdout: client mount timeout = 600 2023-10-06T11:04:51.472 INFO:teuthology.orchestra.run.smithi146.stdout: debug client = 20 2023-10-06T11:04:51.472 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-10-06T11:04:51.473 INFO:teuthology.orchestra.run.smithi146.stdout: pid file = "" 2023-10-06T11:04:51.473 INFO:teuthology.orchestra.run.smithi146.stdout: rados mon op timeout = 900 2023-10-06T11:04:51.473 INFO:teuthology.orchestra.run.smithi146.stdout: rados osd op timeout = 900 2023-10-06T11:04:51.473 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.a] 2023-10-06T11:04:51.473 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.b] 2023-10-06T11:04:51.473 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.c] 2023-10-06T11:04:51.473 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.a] 2023-10-06T11:04:51.473 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.c] 2023-10-06T11:04:51.473 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.b] 2023-10-06T11:04:51.473 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.d] 2023-10-06T11:04:51.473 INFO:teuthology.orchestra.run.smithi146.stdout:[mds] 2023-10-06T11:04:51.474 INFO:teuthology.orchestra.run.smithi146.stdout: debug mds = 20 2023-10-06T11:04:51.474 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-10-06T11:04:51.474 INFO:teuthology.orchestra.run.smithi146.stdout: mds cache max size = 1000 2023-10-06T11:04:51.474 INFO:teuthology.orchestra.run.smithi146.stdout: mds debug frag = True 2023-10-06T11:04:51.474 INFO:teuthology.orchestra.run.smithi146.stdout: mds debug scatterstat = True 2023-10-06T11:04:51.474 INFO:teuthology.orchestra.run.smithi146.stdout: mds log max segments = 1 2023-10-06T11:04:51.474 INFO:teuthology.orchestra.run.smithi146.stdout: mds op complaint time = 180 2023-10-06T11:04:51.474 INFO:teuthology.orchestra.run.smithi146.stdout: mds verify scatter = True 2023-10-06T11:04:51.474 INFO:teuthology.orchestra.run.smithi146.stdout: osd op complaint time = 180 2023-10-06T11:04:51.474 INFO:teuthology.orchestra.run.smithi146.stdout: rados mon op timeout = 900 2023-10-06T11:04:51.474 INFO:teuthology.orchestra.run.smithi146.stdout: rados osd op timeout = 900 2023-10-06T11:04:51.475 INFO:teuthology.orchestra.run.smithi151.stdout:[global] 2023-10-06T11:04:51.475 INFO:teuthology.orchestra.run.smithi151.stdout: chdir = "" 2023-10-06T11:04:51.475 INFO:teuthology.orchestra.run.smithi151.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T11:04:51.475 INFO:teuthology.orchestra.run.smithi151.stdout: auth supported = cephx 2023-10-06T11:04:51.476 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:04:51.476 INFO:teuthology.orchestra.run.smithi151.stdout: filestore xattr use omap = true 2023-10-06T11:04:51.476 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:04:51.476 INFO:teuthology.orchestra.run.smithi151.stdout: mon clock drift allowed = 1.000 2023-10-06T11:04:51.476 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:04:51.476 INFO:teuthology.orchestra.run.smithi151.stdout: osd crush chooseleaf type = 0 2023-10-06T11:04:51.476 INFO:teuthology.orchestra.run.smithi151.stdout: auth debug = true 2023-10-06T11:04:51.476 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:04:51.476 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on old message = true 2023-10-06T11:04:51.476 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on bug = true 2023-10-06T11:04:51.476 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:04:51.476 INFO:teuthology.orchestra.run.smithi151.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T11:04:51.476 INFO:teuthology.orchestra.run.smithi151.stdout: mon pg warn max object skew = 0 2023-10-06T11:04:51.477 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:04:51.477 INFO:teuthology.orchestra.run.smithi151.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T11:04:51.477 INFO:teuthology.orchestra.run.smithi151.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T11:04:51.477 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:04:51.477 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default size = 2 2023-10-06T11:04:51.477 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:04:51.477 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow primary affinity = true 2023-10-06T11:04:51.477 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow pg remap = true 2023-10-06T11:04:51.477 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on legacy crush tunables = false 2023-10-06T11:04:51.477 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on crush straw calc version zero = false 2023-10-06T11:04:51.477 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on no sortbitwise = false 2023-10-06T11:04:51.478 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on osd down out interval zero = false 2023-10-06T11:04:51.478 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on too few osds = false 2023-10-06T11:04:51.478 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T11:04:51.478 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T11:04:51.478 INFO:teuthology.orchestra.run.smithi151.stdout: mon_allow_pool_size_one = true 2023-10-06T11:04:51.478 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:04:51.478 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T11:04:51.478 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:04:51.478 INFO:teuthology.orchestra.run.smithi151.stdout: osd default data pool replay window = 5 2023-10-06T11:04:51.479 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:04:51.479 INFO:teuthology.orchestra.run.smithi151.stdout: mon allow pool delete = true 2023-10-06T11:04:51.479 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:04:51.479 INFO:teuthology.orchestra.run.smithi151.stdout: mon cluster log file level = debug 2023-10-06T11:04:51.479 INFO:teuthology.orchestra.run.smithi151.stdout: debug asserts on shutdown = true 2023-10-06T11:04:51.479 INFO:teuthology.orchestra.run.smithi151.stdout: mon health detail to clog = false 2023-10-06T11:04:51.479 INFO:teuthology.orchestra.run.smithi151.stdout: mon host = "172.21.15.146,172.21.15.151,[v2:172.21.15.151:3301,v1:172.21.15.151:6790]" 2023-10-06T11:04:51.479 INFO:teuthology.orchestra.run.smithi151.stdout: fsid = c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1 2023-10-06T11:04:51.479 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:04:51.479 INFO:teuthology.orchestra.run.smithi151.stdout:[osd] 2023-10-06T11:04:51.479 INFO:teuthology.orchestra.run.smithi151.stdout: osd journal size = 100 2023-10-06T11:04:51.479 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:04:51.480 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub load threshold = 5.0 2023-10-06T11:04:51.480 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub max interval = 600 2023-10-06T11:04:51.480 INFO:teuthology.orchestra.run.smithi151.stdout: osd mclock profile = high_recovery_ops 2023-10-06T11:04:51.480 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:04:51.480 INFO:teuthology.orchestra.run.smithi151.stdout: osd recover clone overlap = true 2023-10-06T11:04:51.480 INFO:teuthology.orchestra.run.smithi151.stdout: osd recovery max chunk = 1048576 2023-10-06T11:04:51.480 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:04:51.480 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug shutdown = true 2023-10-06T11:04:51.480 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug op order = true 2023-10-06T11:04:51.480 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug verify stray on activate = true 2023-10-06T11:04:51.480 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:04:51.480 INFO:teuthology.orchestra.run.smithi151.stdout: osd open classes on start = true 2023-10-06T11:04:51.480 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug pg log writeout = true 2023-10-06T11:04:51.481 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:04:51.481 INFO:teuthology.orchestra.run.smithi151.stdout: osd deep scrub update digest min age = 30 2023-10-06T11:04:51.481 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:04:51.481 INFO:teuthology.orchestra.run.smithi151.stdout: osd map max advance = 10 2023-10-06T11:04:51.481 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:04:51.481 INFO:teuthology.orchestra.run.smithi151.stdout: journal zero on create = true 2023-10-06T11:04:51.481 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:04:51.481 INFO:teuthology.orchestra.run.smithi151.stdout: filestore ondisk finisher threads = 3 2023-10-06T11:04:51.481 INFO:teuthology.orchestra.run.smithi151.stdout: filestore apply finisher threads = 3 2023-10-06T11:04:51.481 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:04:51.481 INFO:teuthology.orchestra.run.smithi151.stdout: bdev debug aio = true 2023-10-06T11:04:51.481 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug misdirected ops = true 2023-10-06T11:04:51.481 INFO:teuthology.orchestra.run.smithi151.stdout: bdev async discard = True 2023-10-06T11:04:51.482 INFO:teuthology.orchestra.run.smithi151.stdout: bdev enable discard = True 2023-10-06T11:04:51.482 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore allocator = bitmap 2023-10-06T11:04:51.482 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore block size = 96636764160 2023-10-06T11:04:51.482 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore fsck on mount = True 2023-10-06T11:04:51.482 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluefs = 1/20 2023-10-06T11:04:51.482 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluestore = 1/20 2023-10-06T11:04:51.482 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-10-06T11:04:51.482 INFO:teuthology.orchestra.run.smithi151.stdout: debug osd = 20 2023-10-06T11:04:51.482 INFO:teuthology.orchestra.run.smithi151.stdout: debug rocksdb = 4/10 2023-10-06T11:04:51.482 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T11:04:51.482 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd full ratio = 0.9 2023-10-06T11:04:51.482 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd nearfull ratio = 0.8 2023-10-06T11:04:51.483 INFO:teuthology.orchestra.run.smithi151.stdout: osd failsafe full ratio = 0.95 2023-10-06T11:04:51.483 INFO:teuthology.orchestra.run.smithi151.stdout: osd objectstore = bluestore 2023-10-06T11:04:51.483 INFO:teuthology.orchestra.run.smithi151.stdout: osd op complaint time = 180 2023-10-06T11:04:51.483 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:04:51.483 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr] 2023-10-06T11:04:51.483 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-10-06T11:04:51.483 INFO:teuthology.orchestra.run.smithi151.stdout: debug mgr = 20 2023-10-06T11:04:51.483 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2023-10-06T11:04:51.483 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2023-10-06T11:04:51.483 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2023-10-06T11:04:51.483 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2023-10-06T11:04:51.483 INFO:teuthology.orchestra.run.smithi151.stdout: mgr/telemetry/nag = false 2023-10-06T11:04:51.484 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:04:51.484 INFO:teuthology.orchestra.run.smithi151.stdout:[mon] 2023-10-06T11:04:51.484 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-10-06T11:04:51.484 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2023-10-06T11:04:51.484 INFO:teuthology.orchestra.run.smithi151.stdout: debug paxos = 20 2023-10-06T11:04:51.484 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2023-10-06T11:04:51.484 INFO:teuthology.orchestra.run.smithi151.stdout: mon data avail warn = 5 2023-10-06T11:04:51.484 INFO:teuthology.orchestra.run.smithi151.stdout: mon mgr mkfs grace = 240 2023-10-06T11:04:51.484 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2023-10-06T11:04:51.484 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd reporter subtree level = osd 2023-10-06T11:04:51.484 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd prime pg temp = true 2023-10-06T11:04:51.484 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2023-10-06T11:04:51.484 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:04:51.485 INFO:teuthology.orchestra.run.smithi151.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T11:04:51.485 INFO:teuthology.orchestra.run.smithi151.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T11:04:51.485 INFO:teuthology.orchestra.run.smithi151.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T11:04:51.485 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:04:51.485 INFO:teuthology.orchestra.run.smithi151.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T11:04:51.485 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T11:04:51.485 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T11:04:51.485 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:04:51.485 INFO:teuthology.orchestra.run.smithi151.stdout: # 1m isn't quite enough 2023-10-06T11:04:51.485 INFO:teuthology.orchestra.run.smithi151.stdout: mon_down_mkfs_grace = 2m 2023-10-06T11:04:51.485 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:04:51.485 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_filestore_osds = false 2023-10-06T11:04:51.485 INFO:teuthology.orchestra.run.smithi151.stdout: mon op complaint time = 120 2023-10-06T11:04:51.486 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:04:51.486 INFO:teuthology.orchestra.run.smithi151.stdout:[client] 2023-10-06T11:04:51.486 INFO:teuthology.orchestra.run.smithi151.stdout: rgw cache enabled = true 2023-10-06T11:04:51.486 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable ops log = true 2023-10-06T11:04:51.486 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable usage log = true 2023-10-06T11:04:51.486 INFO:teuthology.orchestra.run.smithi151.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T11:04:51.486 INFO:teuthology.orchestra.run.smithi151.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T11:04:51.486 INFO:teuthology.orchestra.run.smithi151.stdout: client mount timeout = 600 2023-10-06T11:04:51.486 INFO:teuthology.orchestra.run.smithi151.stdout: debug client = 20 2023-10-06T11:04:51.486 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-10-06T11:04:51.486 INFO:teuthology.orchestra.run.smithi151.stdout: pid file = "" 2023-10-06T11:04:51.486 INFO:teuthology.orchestra.run.smithi151.stdout: rados mon op timeout = 900 2023-10-06T11:04:51.487 INFO:teuthology.orchestra.run.smithi151.stdout: rados osd op timeout = 900 2023-10-06T11:04:51.487 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.a] 2023-10-06T11:04:51.487 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.b] 2023-10-06T11:04:51.487 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.c] 2023-10-06T11:04:51.487 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.a] 2023-10-06T11:04:51.487 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.c] 2023-10-06T11:04:51.487 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.b] 2023-10-06T11:04:51.487 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.d] 2023-10-06T11:04:51.487 INFO:teuthology.orchestra.run.smithi151.stdout:[mds] 2023-10-06T11:04:51.487 INFO:teuthology.orchestra.run.smithi151.stdout: debug mds = 20 2023-10-06T11:04:51.487 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-10-06T11:04:51.487 INFO:teuthology.orchestra.run.smithi151.stdout: mds cache max size = 1000 2023-10-06T11:04:51.488 INFO:teuthology.orchestra.run.smithi151.stdout: mds debug frag = True 2023-10-06T11:04:51.488 INFO:teuthology.orchestra.run.smithi151.stdout: mds debug scatterstat = True 2023-10-06T11:04:51.488 INFO:teuthology.orchestra.run.smithi151.stdout: mds log max segments = 1 2023-10-06T11:04:51.488 INFO:teuthology.orchestra.run.smithi151.stdout: mds op complaint time = 180 2023-10-06T11:04:51.488 INFO:teuthology.orchestra.run.smithi151.stdout: mds verify scatter = True 2023-10-06T11:04:51.488 INFO:teuthology.orchestra.run.smithi151.stdout: osd op complaint time = 180 2023-10-06T11:04:51.488 INFO:teuthology.orchestra.run.smithi151.stdout: rados mon op timeout = 900 2023-10-06T11:04:51.488 INFO:teuthology.orchestra.run.smithi151.stdout: rados osd op timeout = 900 2023-10-06T11:04:51.489 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-06T11:04:51.490 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-06T11:04:51.580 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-06T11:04:51.580 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-06T11:04:51.580 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-06T11:04:51.595 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-06T11:04:51.595 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-06T11:04:51.649 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi146.front.sepia.ceph.com 2023-10-06T11:04:51.649 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-06T11:04:51.650 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T11:04:51.650 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T11:04:51.724 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-06T11:04:51.724 DEBUG:teuthology.orchestra.run.smithi146:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T11:04:51.779 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi151.front.sepia.ceph.com 2023-10-06T11:04:51.779 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-06T11:04:51.779 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T11:04:51.779 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T11:04:51.820 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-06T11:04:51.820 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T11:04:51.878 INFO:tasks.ceph:Setting up mon nodes... 2023-10-06T11:04:51.878 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-06T11:04:51.878 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T11:04:51.926 INFO:teuthology.orchestra.run.smithi146.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T11:04:51.928 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T11:04:52.158 INFO:teuthology.orchestra.run.smithi151.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T11:04:52.162 INFO:tasks.ceph:Setting up mds nodes... 2023-10-06T11:04:52.162 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T11:04:52.209 INFO:teuthology.orchestra.run.smithi146.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T11:04:52.212 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-06T11:04:52.235 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T11:04:52.323 INFO:teuthology.orchestra.run.smithi146.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T11:04:52.325 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-06T11:04:52.349 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T11:04:52.405 INFO:teuthology.orchestra.run.smithi151.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T11:04:52.407 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-06T11:04:52.433 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T11:04:52.522 INFO:teuthology.orchestra.run.smithi151.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T11:04:52.524 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-06T11:04:52.548 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-06T11:04:52.548 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-06T11:04:52.586 INFO:teuthology.orchestra.run.smithi146.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-06T11:04:52.598 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-06T11:04:52.676 INFO:teuthology.orchestra.run.smithi146.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-06T11:04:52.689 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-06T11:04:52.727 INFO:teuthology.orchestra.run.smithi151.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-06T11:04:52.739 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-06T11:04:52.817 INFO:teuthology.orchestra.run.smithi151.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-06T11:04:52.829 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-06T11:04:52.829 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi146.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi151.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T11:04:52.830 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-06T11:04:52.854 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T11:04:52.854 INFO:tasks.ceph:role: osd.0 2023-10-06T11:04:52.854 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi146.front.sepia.ceph.com 2023-10-06T11:04:52.854 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T11:04:52.925 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T11:04:52.926 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T11:04:52.926 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T11:04:52.926 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 2023-10-06T11:04:52.926 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T11:04:52.926 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2023-10-06T11:04:52.926 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T11:04:52.926 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T11:04:52.926 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T11:04:52.926 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T11:04:53.358 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2023-10-06T11:04:53.361 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2023-10-06T11:04:53.361 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-06T11:04:53.516 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-06T11:04:53.548 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-06T11:04:53.613 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T11:04:53.613 INFO:tasks.ceph:role: osd.1 2023-10-06T11:04:53.613 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi146.front.sepia.ceph.com 2023-10-06T11:04:53.613 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T11:04:53.685 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T11:04:53.685 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T11:04:53.686 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T11:04:53.686 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 2023-10-06T11:04:53.686 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T11:04:53.686 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2023-10-06T11:04:53.686 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T11:04:53.686 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T11:04:53.686 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T11:04:53.686 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T11:04:54.112 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2023-10-06T11:04:54.114 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2023-10-06T11:04:54.114 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-06T11:04:54.214 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-06T11:04:54.242 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-06T11:04:54.305 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T11:04:54.305 INFO:tasks.ceph:role: osd.2 2023-10-06T11:04:54.306 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi146.front.sepia.ceph.com 2023-10-06T11:04:54.306 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T11:04:54.376 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T11:04:54.376 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T11:04:54.376 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T11:04:54.376 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 2023-10-06T11:04:54.376 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T11:04:54.376 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2023-10-06T11:04:54.377 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T11:04:54.377 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T11:04:54.377 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T11:04:54.377 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T11:04:54.831 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2023-10-06T11:04:54.832 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2023-10-06T11:04:54.833 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-06T11:04:54.999 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-06T11:04:55.030 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-06T11:04:55.094 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T11:04:55.095 INFO:tasks.ceph:role: osd.3 2023-10-06T11:04:55.095 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi146.front.sepia.ceph.com 2023-10-06T11:04:55.095 DEBUG:teuthology.orchestra.run.smithi146:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T11:04:55.165 INFO:teuthology.orchestra.run.smithi146.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T11:04:55.166 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T11:04:55.166 INFO:teuthology.orchestra.run.smithi146.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T11:04:55.166 INFO:teuthology.orchestra.run.smithi146.stdout: = reflink=1 2023-10-06T11:04:55.166 INFO:teuthology.orchestra.run.smithi146.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T11:04:55.166 INFO:teuthology.orchestra.run.smithi146.stdout: = sunit=0 swidth=0 blks 2023-10-06T11:04:55.166 INFO:teuthology.orchestra.run.smithi146.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T11:04:55.166 INFO:teuthology.orchestra.run.smithi146.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T11:04:55.166 INFO:teuthology.orchestra.run.smithi146.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T11:04:55.166 INFO:teuthology.orchestra.run.smithi146.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T11:04:55.604 INFO:teuthology.orchestra.run.smithi146.stdout:Discarding blocks...Done. 2023-10-06T11:04:55.606 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi146.front.sepia.ceph.com -o noatime 2023-10-06T11:04:55.606 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-06T11:04:55.778 DEBUG:teuthology.orchestra.run.smithi146:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-06T11:04:55.809 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T11:04:55.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:04:55.908+0000 7f6424f1e540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-06T11:04:55.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:04:55.909+0000 7f6424f1e540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-06T11:04:55.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:04:55.909+0000 7f6424f1e540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T11:04:55.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:04:55.909+0000 7f6424f1e540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T11:04:55.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:04:55.909+0000 7f6424f1e540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T11:04:55.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:04:55.909+0000 7f6424f1e540 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-06T11:04:56.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:04:56.434+0000 7f6424f1e540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:04:57.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:04:57.206+0000 7f6424f1e540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:04:57.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:04:57.966+0000 7f6424f1e540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:04:58.773 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-06T11:04:58.800 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T11:04:58.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:04:58.881+0000 7fd6a082b540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-06T11:04:58.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:04:58.882+0000 7fd6a082b540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-06T11:04:58.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:04:58.882+0000 7fd6a082b540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T11:04:58.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:04:58.882+0000 7fd6a082b540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T11:04:58.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:04:58.882+0000 7fd6a082b540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T11:04:58.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:04:58.882+0000 7fd6a082b540 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-06T11:04:59.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:04:59.405+0000 7fd6a082b540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:05:00.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:00.167+0000 7fd6a082b540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:05:00.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:00.930+0000 7fd6a082b540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:05:01.722 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-06T11:05:01.787 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T11:05:01.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:01.866+0000 7f6e3cf15540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-06T11:05:01.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:01.866+0000 7f6e3cf15540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-06T11:05:01.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:01.866+0000 7f6e3cf15540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T11:05:01.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:01.866+0000 7f6e3cf15540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T11:05:01.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:01.866+0000 7f6e3cf15540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T11:05:01.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:01.866+0000 7f6e3cf15540 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-06T11:05:02.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:02.390+0000 7f6e3cf15540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:05:03.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:03.169+0000 7f6e3cf15540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:05:03.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:03.934+0000 7f6e3cf15540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:05:04.729 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-06T11:05:04.800 DEBUG:teuthology.orchestra.run.smithi146:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T11:05:04.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:04.885+0000 7fc18d8cf540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-06T11:05:04.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:04.885+0000 7fc18d8cf540 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-06T11:05:04.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:04.885+0000 7fc18d8cf540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T11:05:04.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:04.885+0000 7fc18d8cf540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T11:05:04.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:04.885+0000 7fc18d8cf540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T11:05:04.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:04.886+0000 7fc18d8cf540 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-06T11:05:05.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:05.411+0000 7fc18d8cf540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:05:06.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:06.173+0000 7fc18d8cf540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:05:06.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:06.939+0000 7fc18d8cf540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:05:07.731 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-06T11:05:07.756 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-06T11:05:07.783 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T11:05:07.783 INFO:tasks.ceph:role: osd.4 2023-10-06T11:05:07.783 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi151.front.sepia.ceph.com 2023-10-06T11:05:07.783 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T11:05:07.857 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T11:05:07.857 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T11:05:07.857 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T11:05:07.857 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 2023-10-06T11:05:07.857 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T11:05:07.857 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2023-10-06T11:05:07.857 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T11:05:07.857 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T11:05:07.858 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T11:05:07.858 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T11:05:08.287 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2023-10-06T11:05:08.289 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2023-10-06T11:05:08.289 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-06T11:05:08.471 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-06T11:05:08.503 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-06T11:05:08.569 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T11:05:08.569 INFO:tasks.ceph:role: osd.5 2023-10-06T11:05:08.569 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi151.front.sepia.ceph.com 2023-10-06T11:05:08.569 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T11:05:08.642 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T11:05:08.642 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T11:05:08.642 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T11:05:08.642 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 2023-10-06T11:05:08.642 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T11:05:08.642 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2023-10-06T11:05:08.642 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T11:05:08.642 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T11:05:08.643 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T11:05:08.643 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T11:05:09.059 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2023-10-06T11:05:09.060 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2023-10-06T11:05:09.061 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-06T11:05:09.160 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-06T11:05:09.189 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-06T11:05:09.254 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T11:05:09.254 INFO:tasks.ceph:role: osd.6 2023-10-06T11:05:09.254 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi151.front.sepia.ceph.com 2023-10-06T11:05:09.254 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T11:05:09.326 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T11:05:09.326 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T11:05:09.327 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T11:05:09.327 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 2023-10-06T11:05:09.327 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T11:05:09.327 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2023-10-06T11:05:09.327 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T11:05:09.327 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T11:05:09.327 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T11:05:09.327 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T11:05:09.776 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2023-10-06T11:05:09.777 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2023-10-06T11:05:09.778 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-06T11:05:09.941 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-06T11:05:09.971 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-06T11:05:10.037 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T11:05:10.037 INFO:tasks.ceph:role: osd.7 2023-10-06T11:05:10.037 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi151.front.sepia.ceph.com 2023-10-06T11:05:10.037 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T11:05:10.108 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T11:05:10.109 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T11:05:10.109 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T11:05:10.109 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 2023-10-06T11:05:10.109 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T11:05:10.109 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2023-10-06T11:05:10.109 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T11:05:10.109 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T11:05:10.109 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T11:05:10.109 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T11:05:10.548 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2023-10-06T11:05:10.550 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2023-10-06T11:05:10.550 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-06T11:05:10.728 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-06T11:05:10.759 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T11:05:10.851 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:10.849+0000 7f262ca6f540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-06T11:05:10.851 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:10.849+0000 7f262ca6f540 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-06T11:05:10.851 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:10.849+0000 7f262ca6f540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T11:05:10.851 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:10.849+0000 7f262ca6f540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T11:05:10.851 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:10.849+0000 7f262ca6f540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T11:05:10.851 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:10.849+0000 7f262ca6f540 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-06T11:05:11.379 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:11.377+0000 7f262ca6f540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:05:12.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:12.145+0000 7f262ca6f540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:05:12.909 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:12.908+0000 7f262ca6f540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:05:13.713 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-06T11:05:13.738 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T11:05:13.819 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:13.817+0000 7f4000043540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-06T11:05:13.819 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:13.817+0000 7f4000043540 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-06T11:05:13.820 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:13.817+0000 7f4000043540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T11:05:13.820 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:13.817+0000 7f4000043540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T11:05:13.820 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:13.817+0000 7f4000043540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T11:05:13.820 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:13.818+0000 7f4000043540 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-06T11:05:14.346 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:14.344+0000 7f4000043540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:05:15.108 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:15.106+0000 7f4000043540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:05:15.870 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:15.868+0000 7f4000043540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:05:16.667 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-06T11:05:16.733 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T11:05:16.815 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:16.813+0000 7f3602962540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-06T11:05:16.815 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:16.813+0000 7f3602962540 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-06T11:05:16.815 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:16.813+0000 7f3602962540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T11:05:16.815 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:16.813+0000 7f3602962540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T11:05:16.815 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:16.813+0000 7f3602962540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T11:05:16.815 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:16.813+0000 7f3602962540 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-06T11:05:17.340 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:17.339+0000 7f3602962540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:05:18.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:18.103+0000 7f3602962540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:05:18.866 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:18.865+0000 7f3602962540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:05:19.481 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:05:19.484 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:05:19.663 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-06T11:05:19.688 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T11:05:19.769 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:19.768+0000 7fa9a39d0540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-06T11:05:19.769 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:19.768+0000 7fa9a39d0540 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-06T11:05:19.769 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:19.768+0000 7fa9a39d0540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T11:05:19.769 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:19.768+0000 7fa9a39d0540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T11:05:19.769 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:19.768+0000 7fa9a39d0540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T11:05:19.769 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:19.769+0000 7fa9a39d0540 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-06T11:05:20.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:20.293+0000 7fa9a39d0540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:05:21.057 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:21.056+0000 7fa9a39d0540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:05:21.819 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:21.819+0000 7fa9a39d0540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T11:05:22.611 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-06T11:05:22.679 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-06T11:05:22.679 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-06T11:05:22.679 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-06T11:05:22.705 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-06T11:05:22.705 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-06T11:05:22.771 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-06T11:05:22.772 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-06T11:05:22.837 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-06T11:05:22.837 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-06T11:05:22.903 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-06T11:05:22.903 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-06T11:05:22.969 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-06T11:05:22.969 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-06T11:05:23.034 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-06T11:05:23.034 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-06T11:05:23.099 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-06T11:05:23.099 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-06T11:05:23.128 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-06T11:05:23.128 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-06T11:05:23.196 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-06T11:05:23.196 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-06T11:05:23.264 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-06T11:05:23.264 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-06T11:05:23.331 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-06T11:05:23.331 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-06T11:05:23.396 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-06T11:05:23.396 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-06T11:05:23.460 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-06T11:05:23.460 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-06T11:05:23.525 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-06T11:05:23.525 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-06T11:05:23.540 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-06T11:05:23.541 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-06T11:05:23.594 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-06T11:05:23.594 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-06T11:05:23.609 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-06T11:05:23.609 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-06T11:05:23.665 INFO:tasks.ceph:Adding keys to all mons... 2023-10-06T11:05:23.665 DEBUG:teuthology.orchestra.run.smithi146:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T11:05:23.667 DEBUG:teuthology.orchestra.run.smithi151:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T11:05:23.707 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr.y] 2023-10-06T11:05:23.708 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDT6R9l2uQxNxAAVSMhKVzbf2vC4opL7YCLdg== 2023-10-06T11:05:23.708 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.a] 2023-10-06T11:05:23.708 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDU6R9lG4F8DBAAp5A4Dtfzvv8n9ORgkmiP9g== 2023-10-06T11:05:23.708 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.c] 2023-10-06T11:05:23.708 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDU6R9lbYA7ExAAAopKjS7+WMUE5fuVQygILQ== 2023-10-06T11:05:23.708 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.0] 2023-10-06T11:05:23.708 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDX6R9lLGo9NhAAcWJuUeOdEUsdDw84W9nLPw== 2023-10-06T11:05:23.708 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.1] 2023-10-06T11:05:23.708 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDa6R9lk02gNBAA9YqWT2/Xds20lv0sGtBApg== 2023-10-06T11:05:23.708 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.2] 2023-10-06T11:05:23.709 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDd6R9lrA6xMxAAmH8r6m2p4Jpa82xfYNcq+g== 2023-10-06T11:05:23.709 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.3] 2023-10-06T11:05:23.709 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDg6R9ltlHXNBAAvhfI1yjlaWCIE9Xr/4F/PA== 2023-10-06T11:05:23.709 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr.x] 2023-10-06T11:05:23.709 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDU6R9llLpwCRAA4UH9Uqli2de9HIJR2fZ9xg== 2023-10-06T11:05:23.709 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.b] 2023-10-06T11:05:23.709 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDU6R9lDIceGBAA4cr0oGVaXiy5hrruKY5DGw== 2023-10-06T11:05:23.709 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.d] 2023-10-06T11:05:23.709 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDU6R9laygiHxAAasUUn7Wk9EwLa36ggsZtHw== 2023-10-06T11:05:23.709 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.4] 2023-10-06T11:05:23.709 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDm6R9lPUCvMhAAGbUNfpoFi9SvYdelpnL1jA== 2023-10-06T11:05:23.710 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.5] 2023-10-06T11:05:23.710 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDp6R9lMfrMMBAAUEtnXDNr7+L3dQm4QE9qDw== 2023-10-06T11:05:23.710 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.6] 2023-10-06T11:05:23.710 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDs6R9lAmSDMBAArPp+6dVt/NyH9is46tL49g== 2023-10-06T11:05:23.710 INFO:teuthology.orchestra.run.smithi146.stdout:[osd.7] 2023-10-06T11:05:23.710 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDv6R9lnunMLRAA3o5ZtAyYDUoXTzjX9H8FCw== 2023-10-06T11:05:23.710 INFO:teuthology.orchestra.run.smithi146.stdout:[client.0] 2023-10-06T11:05:23.710 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDU6R9lCrPrIhAARrzj2VxVFkzF5L/ifIAqmw== 2023-10-06T11:05:23.711 INFO:teuthology.orchestra.run.smithi146.stdout:[client.2] 2023-10-06T11:05:23.711 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDU6R9lpLpJKBAAF/vLDkBg9/VBqMK4pVVIkg== 2023-10-06T11:05:23.711 INFO:teuthology.orchestra.run.smithi146.stdout:[client.1] 2023-10-06T11:05:23.711 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDU6R9l10VSKxAA0HmXejgRRCQ7XpsMB7ljkQ== 2023-10-06T11:05:23.711 INFO:teuthology.orchestra.run.smithi146.stdout:[client.3] 2023-10-06T11:05:23.711 INFO:teuthology.orchestra.run.smithi146.stdout: key = AQDU6R9luMqwMBAA4Y4I9hWTk2IqAzYwVQ13Pw== 2023-10-06T11:05:23.727 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr.y] 2023-10-06T11:05:23.727 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQDT6R9l2uQxNxAAVSMhKVzbf2vC4opL7YCLdg== 2023-10-06T11:05:23.727 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.a] 2023-10-06T11:05:23.728 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQDU6R9lG4F8DBAAp5A4Dtfzvv8n9ORgkmiP9g== 2023-10-06T11:05:23.728 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.c] 2023-10-06T11:05:23.728 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQDU6R9lbYA7ExAAAopKjS7+WMUE5fuVQygILQ== 2023-10-06T11:05:23.728 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.0] 2023-10-06T11:05:23.728 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQDX6R9lLGo9NhAAcWJuUeOdEUsdDw84W9nLPw== 2023-10-06T11:05:23.728 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.1] 2023-10-06T11:05:23.728 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQDa6R9lk02gNBAA9YqWT2/Xds20lv0sGtBApg== 2023-10-06T11:05:23.728 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.2] 2023-10-06T11:05:23.728 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQDd6R9lrA6xMxAAmH8r6m2p4Jpa82xfYNcq+g== 2023-10-06T11:05:23.728 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.3] 2023-10-06T11:05:23.729 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQDg6R9ltlHXNBAAvhfI1yjlaWCIE9Xr/4F/PA== 2023-10-06T11:05:23.729 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr.x] 2023-10-06T11:05:23.729 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQDU6R9llLpwCRAA4UH9Uqli2de9HIJR2fZ9xg== 2023-10-06T11:05:23.729 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.b] 2023-10-06T11:05:23.729 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQDU6R9lDIceGBAA4cr0oGVaXiy5hrruKY5DGw== 2023-10-06T11:05:23.729 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.d] 2023-10-06T11:05:23.729 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQDU6R9laygiHxAAasUUn7Wk9EwLa36ggsZtHw== 2023-10-06T11:05:23.729 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.4] 2023-10-06T11:05:23.729 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQDm6R9lPUCvMhAAGbUNfpoFi9SvYdelpnL1jA== 2023-10-06T11:05:23.729 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.5] 2023-10-06T11:05:23.729 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQDp6R9lMfrMMBAAUEtnXDNr7+L3dQm4QE9qDw== 2023-10-06T11:05:23.729 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.6] 2023-10-06T11:05:23.729 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQDs6R9lAmSDMBAArPp+6dVt/NyH9is46tL49g== 2023-10-06T11:05:23.730 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.7] 2023-10-06T11:05:23.730 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQDv6R9lnunMLRAA3o5ZtAyYDUoXTzjX9H8FCw== 2023-10-06T11:05:23.730 INFO:teuthology.orchestra.run.smithi151.stdout:[client.0] 2023-10-06T11:05:23.730 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQDU6R9lCrPrIhAARrzj2VxVFkzF5L/ifIAqmw== 2023-10-06T11:05:23.730 INFO:teuthology.orchestra.run.smithi151.stdout:[client.2] 2023-10-06T11:05:23.730 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQDU6R9lpLpJKBAAF/vLDkBg9/VBqMK4pVVIkg== 2023-10-06T11:05:23.730 INFO:teuthology.orchestra.run.smithi151.stdout:[client.1] 2023-10-06T11:05:23.730 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQDU6R9l10VSKxAA0HmXejgRRCQ7XpsMB7ljkQ== 2023-10-06T11:05:23.730 INFO:teuthology.orchestra.run.smithi151.stdout:[client.3] 2023-10-06T11:05:23.730 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQDU6R9luMqwMBAA4Y4I9hWTk2IqAzYwVQ13Pw== 2023-10-06T11:05:23.731 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T11:05:23.755 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T11:05:23.818 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T11:05:23.821 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T11:05:23.871 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T11:05:23.873 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T11:05:23.923 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T11:05:23.926 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T11:05:23.973 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T11:05:23.975 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T11:05:24.022 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T11:05:24.024 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T11:05:24.071 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T11:05:24.073 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T11:05:24.121 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T11:05:24.123 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T11:05:24.170 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T11:05:24.173 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T11:05:24.223 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T11:05:24.225 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T11:05:24.274 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T11:05:24.277 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T11:05:24.324 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T11:05:24.326 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T11:05:24.374 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T11:05:24.376 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T11:05:24.423 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T11:05:24.426 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T11:05:24.472 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T11:05:24.475 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T11:05:24.525 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T11:05:24.527 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T11:05:24.578 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T11:05:24.580 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T11:05:24.630 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T11:05:24.632 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T11:05:24.682 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-06T11:05:24.683 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-06T11:05:24.707 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T11:05:24.798 DEBUG:teuthology.orchestra.run.smithi146:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-06T11:05:24.822 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-06T11:05:24.847 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T11:05:24.939 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-06T11:05:24.963 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-06T11:05:25.028 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T11:05:25.121 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-06T11:05:25.146 DEBUG:teuthology.orchestra.run.smithi146:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T11:05:25.148 DEBUG:teuthology.orchestra.run.smithi151:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T11:05:25.200 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-06T11:05:25.200 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-06T11:05:25.200 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-06T11:05:25.203 INFO:tasks.ceph.mon.a:Started 2023-10-06T11:05:25.203 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-06T11:05:25.203 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-06T11:05:25.242 INFO:tasks.ceph.mon.b:Started 2023-10-06T11:05:25.243 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-06T11:05:25.243 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-06T11:05:25.244 INFO:tasks.ceph.mon.c:Started 2023-10-06T11:05:25.245 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-06T11:05:25.245 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-06T11:05:25.245 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-06T11:05:25.247 INFO:tasks.ceph.mgr.y:Started 2023-10-06T11:05:25.247 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-06T11:05:25.247 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-06T11:05:25.249 INFO:tasks.ceph.mgr.x:Started 2023-10-06T11:05:25.249 INFO:tasks.ceph:Setting crush tunables to default 2023-10-06T11:05:25.249 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd crush tunables default 2023-10-06T11:05:25.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.366+0000 7f8450e2a700 1 Processor -- start 2023-10-06T11:05:25.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.366+0000 7f8450e2a700 1 -- start start 2023-10-06T11:05:25.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.366+0000 7f8450e2a700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f844c069f30 0x7f844c15bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:25.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.366+0000 7f8450e2a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f844c06f240 0x7f844c06f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:25.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.366+0000 7f8450e2a700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f844c06fbd0 con 0x7f844c157a00 2023-10-06T11:05:25.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.366+0000 7f8450e2a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f844c0ac1a0 con 0x7f844c06f240 2023-10-06T11:05:25.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.366+0000 7f8450e2a700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f844c158960 con 0x7f844c069f30 2023-10-06T11:05:25.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.367+0000 7f8443fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f844c06f240 0x7f844c06f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:25.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.367+0000 7f8443fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f844c06f240 0x7f844c06f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42500/0 (socket says 172.21.15.146:42500) 2023-10-06T11:05:25.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.367+0000 7f8443fff700 1 -- 172.21.15.146:0/1586599524 learned_addr learned my addr 172.21.15.146:0/1586599524 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:25.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.367+0000 7f8443fff700 1 -- 172.21.15.146:0/1586599524 >> v2:172.21.15.146:3300/0 conn(0x7f844c06f240 msgr2=0x7f844c06f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-06T11:05:25.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.367+0000 7f8443fff700 1 -- 172.21.15.146:0/1586599524 >> v2:172.21.15.146:3300/0 conn(0x7f844c06f240 msgr2=0x7f844c06f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T11:05:25.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.367+0000 7f8443fff700 1 --2- 172.21.15.146:0/1586599524 >> v2:172.21.15.146:3300/0 conn(0x7f844c06f240 0x7f844c06f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T11:05:25.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.367+0000 7f844a59c700 1 --2- 172.21.15.146:0/1586599524 >> v2:172.21.15.151:3300/0 conn(0x7f844c069f30 0x7f844c15bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:25.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.367+0000 7f8443fff700 1 --2- 172.21.15.146:0/1586599524 >> v2:172.21.15.146:3300/0 conn(0x7f844c06f240 0x7f844c06f690 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T11:05:25.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.367+0000 7f844a59c700 1 -- 172.21.15.146:0/1586599524 >> v2:172.21.15.151:3300/0 conn(0x7f844c069f30 msgr2=0x7f844c15bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T11:05:25.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.367+0000 7f844a59c700 1 -- 172.21.15.146:0/1586599524 >> v2:172.21.15.151:3300/0 conn(0x7f844c069f30 msgr2=0x7f844c15bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T11:05:25.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.367+0000 7f844a59c700 1 --2- 172.21.15.146:0/1586599524 >> v2:172.21.15.151:3300/0 conn(0x7f844c069f30 0x7f844c15bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T11:05:25.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.367+0000 7f844a59c700 1 --2- 172.21.15.146:0/1586599524 >> v2:172.21.15.151:3300/0 conn(0x7f844c069f30 0x7f844c15bb80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T11:05:25.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.567+0000 7f8449d9b700 1 -- 172.21.15.146:0/1586599524 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 321447341 0 0) 0x7f844c06fbd0 con 0x7f844c157a00 2023-10-06T11:05:25.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.567+0000 7f8449d9b700 1 -- 172.21.15.146:0/1586599524 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8438003570 con 0x7f844c157a00 2023-10-06T11:05:25.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.568+0000 7f8443fff700 1 --2- 172.21.15.146:0/1586599524 >> v2:172.21.15.146:3300/0 conn(0x7f844c06f240 0x7f844c06f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:25.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.568+0000 7f844a59c700 1 --2- 172.21.15.146:0/1586599524 >> v2:172.21.15.151:3300/0 conn(0x7f844c069f30 0x7f844c15bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:25.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.568+0000 7f8443fff700 1 -- 172.21.15.146:0/1586599524 >> v2:172.21.15.151:3300/0 conn(0x7f844c069f30 msgr2=0x7f844c15bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:25.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.568+0000 7f8443fff700 1 --2- 172.21.15.146:0/1586599524 >> v2:172.21.15.151:3300/0 conn(0x7f844c069f30 0x7f844c15bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:25.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.568+0000 7f8443fff700 1 -- 172.21.15.146:0/1586599524 >> v1:172.21.15.151:6789/0 conn(0x7f844c157a00 legacy=0x7f844c157e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:25.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.568+0000 7f8443fff700 1 -- 172.21.15.146:0/1586599524 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f844c158680 con 0x7f844c06f240 2023-10-06T11:05:25.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.568+0000 7f8443fff700 1 --2- 172.21.15.146:0/1586599524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f844c06f240 0x7f844c06f690 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f844c06d5f0 tx=0x7f8434008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18cc9d185f894dac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:25.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.568+0000 7f8449d9b700 1 -- 172.21.15.146:0/1586599524 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8434013410 con 0x7f844c06f240 2023-10-06T11:05:25.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.568+0000 7f8449d9b700 1 -- 172.21.15.146:0/1586599524 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8434013570 con 0x7f844c06f240 2023-10-06T11:05:25.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.568+0000 7f8449d9b700 1 -- 172.21.15.146:0/1586599524 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8434013970 con 0x7f844c06f240 2023-10-06T11:05:25.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.569+0000 7f8450e2a700 1 -- 172.21.15.146:0/1586599524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f844c06f240 msgr2=0x7f844c06f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:25.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.569+0000 7f8450e2a700 1 --2- 172.21.15.146:0/1586599524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f844c06f240 0x7f844c06f690 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f844c06d5f0 tx=0x7f8434008040 comp rx=0 tx=0).stop 2023-10-06T11:05:25.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.569+0000 7f8450e2a700 1 -- 172.21.15.146:0/1586599524 shutdown_connections 2023-10-06T11:05:25.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.569+0000 7f8450e2a700 1 --2- 172.21.15.146:0/1586599524 >> v2:172.21.15.151:3300/0 conn(0x7f844c069f30 0x7f844c15bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:25.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.569+0000 7f8450e2a700 1 --2- 172.21.15.146:0/1586599524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f844c06f240 0x7f844c06f690 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:25.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.569+0000 7f8450e2a700 1 -- 172.21.15.146:0/1586599524 >> 172.21.15.146:0/1586599524 conn(0x7f844c0cc5c0 msgr2=0x7f844c0cc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:25.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.569+0000 7f8450e2a700 1 -- 172.21.15.146:0/1586599524 shutdown_connections 2023-10-06T11:05:25.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.569+0000 7f8450e2a700 1 -- 172.21.15.146:0/1586599524 wait complete. 2023-10-06T11:05:25.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.570+0000 7f8450e2a700 1 Processor -- start 2023-10-06T11:05:25.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.570+0000 7f8450e2a700 1 -- start start 2023-10-06T11:05:25.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.571+0000 7f8450e2a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f844c069f30 0x7f844c155a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:25.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.571+0000 7f8450e2a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f844c06f240 0x7f844c151d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:25.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.571+0000 7f8450e2a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f844c157a00 0x7f844c1522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:25.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.571+0000 7f8450e2a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844c156d50 con 0x7f844c069f30 2023-10-06T11:05:25.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.571+0000 7f8450e2a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844c156140 con 0x7f844c157a00 2023-10-06T11:05:25.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.571+0000 7f8450e2a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f844c156420 con 0x7f844c06f240 2023-10-06T11:05:25.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.571+0000 7f844a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f844c069f30 0x7f844c155a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:25.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.571+0000 7f844a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f844c069f30 0x7f844c155a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42538/0 (socket says 172.21.15.146:42538) 2023-10-06T11:05:25.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.571+0000 7f844a59c700 1 -- 172.21.15.146:0/557680861 learned_addr learned my addr 172.21.15.146:0/557680861 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:25.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.571+0000 7f8443fff700 1 --2- 172.21.15.146:0/557680861 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f844c06f240 0x7f844c151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:25.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.571+0000 7f844ad9d700 1 --2- 172.21.15.146:0/557680861 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f844c157a00 0x7f844c1522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:25.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.571+0000 7f844a59c700 1 -- 172.21.15.146:0/557680861 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f844c06f240 msgr2=0x7f844c151d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:25.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.571+0000 7f844a59c700 1 --2- 172.21.15.146:0/557680861 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f844c06f240 0x7f844c151d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:25.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.571+0000 7f844a59c700 1 -- 172.21.15.146:0/557680861 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f844c157a00 msgr2=0x7f844c1522c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:25.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.571+0000 7f844a59c700 1 --2- 172.21.15.146:0/557680861 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f844c157a00 0x7f844c1522c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:25.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.571+0000 7f844a59c700 1 -- 172.21.15.146:0/557680861 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8434009570 con 0x7f844c069f30 2023-10-06T11:05:25.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.572+0000 7f844a59c700 1 --2- 172.21.15.146:0/557680861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f844c069f30 0x7f844c155a40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f843c010ad0 tx=0x7f843c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:25.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.572+0000 7f84427fc700 1 -- 172.21.15.146:0/557680861 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843c00e8d0 con 0x7f844c069f30 2023-10-06T11:05:25.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.572+0000 7f84427fc700 1 -- 172.21.15.146:0/557680861 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f843c00ea30 con 0x7f844c069f30 2023-10-06T11:05:25.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.572+0000 7f84427fc700 1 -- 172.21.15.146:0/557680861 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843c00edf0 con 0x7f844c069f30 2023-10-06T11:05:25.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.572+0000 7f8450e2a700 1 -- 172.21.15.146:0/557680861 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f844c156700 con 0x7f844c069f30 2023-10-06T11:05:25.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.572+0000 7f8450e2a700 1 -- 172.21.15.146:0/557680861 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f844c0afd60 con 0x7f844c069f30 2023-10-06T11:05:25.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.572+0000 7f84427fc700 1 -- 172.21.15.146:0/557680861 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f843c014640 con 0x7f844c069f30 2023-10-06T11:05:25.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.572+0000 7f84427fc700 1 -- 172.21.15.146:0/557680861 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f843c01d7a0 con 0x7f844c069f30 2023-10-06T11:05:25.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.573+0000 7f8450e2a700 1 -- 172.21.15.146:0/557680861 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f844c04c380 con 0x7f844c069f30 2023-10-06T11:05:25.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.575+0000 7f84427fc700 1 -- 172.21.15.146:0/557680861 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f843c022060 con 0x7f844c069f30 2023-10-06T11:05:25.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.650+0000 7f8450e2a700 1 -- 172.21.15.146:0/557680861 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f844c15b0a0 con 0x7f844c069f30 2023-10-06T11:05:25.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.657+0000 7f84427fc700 1 -- 172.21.15.146:0/557680861 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f843c02c090 con 0x7f844c069f30 2023-10-06T11:05:25.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.658+0000 7f8450e2a700 1 -- 172.21.15.146:0/557680861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f844c069f30 msgr2=0x7f844c155a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:25.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.658+0000 7f8450e2a700 1 --2- 172.21.15.146:0/557680861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f844c069f30 0x7f844c155a40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f843c010ad0 tx=0x7f843c008040 comp rx=0 tx=0).stop 2023-10-06T11:05:25.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.658+0000 7f8450e2a700 1 -- 172.21.15.146:0/557680861 shutdown_connections 2023-10-06T11:05:25.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.658+0000 7f8450e2a700 1 --2- 172.21.15.146:0/557680861 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f844c157a00 0x7f844c1522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:25.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.658+0000 7f8450e2a700 1 --2- 172.21.15.146:0/557680861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f844c069f30 0x7f844c155a40 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:25.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.658+0000 7f8450e2a700 1 --2- 172.21.15.146:0/557680861 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f844c06f240 0x7f844c151d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:25.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.658+0000 7f8450e2a700 1 -- 172.21.15.146:0/557680861 >> 172.21.15.146:0/557680861 conn(0x7f844c0cc5c0 msgr2=0x7f844c153200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:25.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.658+0000 7f8450e2a700 1 -- 172.21.15.146:0/557680861 shutdown_connections 2023-10-06T11:05:25.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:25.658+0000 7f8450e2a700 1 -- 172.21.15.146:0/557680861 wait complete. 2023-10-06T11:05:25.661 INFO:teuthology.orchestra.run.smithi146.stderr:adjusted tunables profile to default 2023-10-06T11:05:25.672 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-06T11:05:25.672 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-06T11:05:25.672 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-06T11:05:25.696 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-06T11:05:25.696 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-06T11:05:25.761 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-06T11:05:25.761 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-06T11:05:25.825 DEBUG:teuthology.orchestra.run.smithi146:> set -ex 2023-10-06T11:05:25.825 DEBUG:teuthology.orchestra.run.smithi146:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-06T11:05:25.890 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-06T11:05:25.890 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-06T11:05:25.917 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-06T11:05:25.917 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-06T11:05:25.980 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-06T11:05:25.980 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-06T11:05:26.045 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-10-06T11:05:26.045 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-06T11:05:26.110 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 838fc683-c326-415a-b906-83cf8f3a396c 0 2023-10-06T11:05:26.265 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.264+0000 7fcc2afcd700 1 Processor -- start 2023-10-06T11:05:26.265 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.264+0000 7fcc2afcd700 1 -- start start 2023-10-06T11:05:26.268 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.265+0000 7fcc2afcd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc24159550 0x7fcc2406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:26.268 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.265+0000 7fcc2afcd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcc24159920 0x7fcc240aaf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:26.268 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.265+0000 7fcc2afcd700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc240aaa90 con 0x7fcc240ab460 2023-10-06T11:05:26.268 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.265+0000 7fcc2afcd700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc2406f340 con 0x7fcc24159920 2023-10-06T11:05:26.268 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.265+0000 7fcc2afcd700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc240a9e80 con 0x7fcc24159550 2023-10-06T11:05:26.268 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.265+0000 7fcc28d69700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc24159550 0x7fcc2406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:26.269 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.265+0000 7fcc28d69700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc24159550 0x7fcc2406ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:49204/0 (socket says 172.21.15.151:49204) 2023-10-06T11:05:26.269 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.265+0000 7fcc28d69700 1 -- 172.21.15.151:0/3076171229 learned_addr learned my addr 172.21.15.151:0/3076171229 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-06T11:05:26.269 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.265+0000 7fcc23fff700 1 --2- 172.21.15.151:0/3076171229 >> v2:172.21.15.146:3300/0 conn(0x7fcc24159920 0x7fcc240aaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:26.269 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.265+0000 7fcc28d69700 1 -- 172.21.15.151:0/3076171229 >> v2:172.21.15.146:3300/0 conn(0x7fcc24159920 msgr2=0x7fcc240aaf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:26.269 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.265+0000 7fcc28d69700 1 --2- 172.21.15.151:0/3076171229 >> v2:172.21.15.146:3300/0 conn(0x7fcc24159920 0x7fcc240aaf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:26.269 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.265+0000 7fcc28d69700 1 -- 172.21.15.151:0/3076171229 >> v1:172.21.15.146:6789/0 conn(0x7fcc240ab460 legacy=0x7fcc24068480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:26.269 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.265+0000 7fcc28d69700 1 -- 172.21.15.151:0/3076171229 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc240aa160 con 0x7fcc24159550 2023-10-06T11:05:26.269 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.265+0000 7fcc28d69700 1 --2- 172.21.15.151:0/3076171229 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc24159550 0x7fcc2406ee00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcc180099b0 tx=0x7fcc18009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=164cc96b3d44941a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:26.269 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.265+0000 7fcc237fe700 1 -- 172.21.15.151:0/3076171229 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc18009ea0 con 0x7fcc24159550 2023-10-06T11:05:26.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.266+0000 7fcc237fe700 1 -- 172.21.15.151:0/3076171229 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1800b860 con 0x7fcc24159550 2023-10-06T11:05:26.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.266+0000 7fcc237fe700 1 -- 172.21.15.151:0/3076171229 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1800bc00 con 0x7fcc24159550 2023-10-06T11:05:26.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.266+0000 7fcc2afcd700 1 -- 172.21.15.151:0/3076171229 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc24159550 msgr2=0x7fcc2406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:26.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.266+0000 7fcc2afcd700 1 --2- 172.21.15.151:0/3076171229 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc24159550 0x7fcc2406ee00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcc180099b0 tx=0x7fcc18009250 comp rx=0 tx=0).stop 2023-10-06T11:05:26.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.266+0000 7fcc2afcd700 1 -- 172.21.15.151:0/3076171229 shutdown_connections 2023-10-06T11:05:26.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.266+0000 7fcc2afcd700 1 --2- 172.21.15.151:0/3076171229 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc24159550 0x7fcc2406ee00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:26.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.266+0000 7fcc2afcd700 1 --2- 172.21.15.151:0/3076171229 >> v2:172.21.15.146:3300/0 conn(0x7fcc24159920 0x7fcc240aaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:26.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.266+0000 7fcc2afcd700 1 -- 172.21.15.151:0/3076171229 >> 172.21.15.151:0/3076171229 conn(0x7fcc240c9fa0 msgr2=0x7fcc2406de70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:26.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.266+0000 7fcc2afcd700 1 -- 172.21.15.151:0/3076171229 shutdown_connections 2023-10-06T11:05:26.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.266+0000 7fcc2afcd700 1 -- 172.21.15.151:0/3076171229 wait complete. 2023-10-06T11:05:26.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.267+0000 7fcc2afcd700 1 Processor -- start 2023-10-06T11:05:26.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.268+0000 7fcc2afcd700 1 -- start start 2023-10-06T11:05:26.273 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.268+0000 7fcc2afcd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc240ab460 0x7fcc24143890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:26.273 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.268+0000 7fcc2afcd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc24159550 0x7fcc24156f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:26.273 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.268+0000 7fcc2afcd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc24159920 0x7fcc24157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:26.273 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.268+0000 7fcc2afcd700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2415d9f0 con 0x7fcc24159920 2023-10-06T11:05:26.273 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.268+0000 7fcc2afcd700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2415cde0 con 0x7fcc24159550 2023-10-06T11:05:26.273 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.268+0000 7fcc2afcd700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2415d0c0 con 0x7fcc240ab460 2023-10-06T11:05:26.273 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.268+0000 7fcc28d69700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc240ab460 0x7fcc24143890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:26.273 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.268+0000 7fcc23fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc24159550 0x7fcc24156f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:26.273 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.269+0000 7fcc28d69700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc240ab460 0x7fcc24143890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:49206/0 (socket says 172.21.15.151:49206) 2023-10-06T11:05:26.273 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.269+0000 7fcc28d69700 1 -- 172.21.15.151:0/2275437426 learned_addr learned my addr 172.21.15.151:0/2275437426 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-06T11:05:26.273 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.269+0000 7fcc2956a700 1 --2- 172.21.15.151:0/2275437426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc24159920 0x7fcc24157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:26.273 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.269+0000 7fcc28d69700 1 -- 172.21.15.151:0/2275437426 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc24159550 msgr2=0x7fcc24156f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:26.274 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.269+0000 7fcc28d69700 1 --2- 172.21.15.151:0/2275437426 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc24159550 0x7fcc24156f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:26.274 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.269+0000 7fcc28d69700 1 -- 172.21.15.151:0/2275437426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc24159920 msgr2=0x7fcc24157490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:26.274 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.269+0000 7fcc28d69700 1 --2- 172.21.15.151:0/2275437426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc24159920 0x7fcc24157490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:26.274 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.269+0000 7fcc28d69700 1 -- 172.21.15.151:0/2275437426 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc180094f0 con 0x7fcc240ab460 2023-10-06T11:05:26.274 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.269+0000 7fcc23fff700 1 --2- 172.21.15.151:0/2275437426 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc24159550 0x7fcc24156f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:05:26.274 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.269+0000 7fcc28d69700 1 --2- 172.21.15.151:0/2275437426 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc240ab460 0x7fcc24143890 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcc240cca30 tx=0x7fcc18017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:26.274 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.269+0000 7fcc20ff9700 1 -- 172.21.15.151:0/2275437426 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc18000d10 con 0x7fcc240ab460 2023-10-06T11:05:26.274 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.269+0000 7fcc20ff9700 1 -- 172.21.15.151:0/2275437426 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1800bbe0 con 0x7fcc240ab460 2023-10-06T11:05:26.274 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.269+0000 7fcc2afcd700 1 -- 172.21.15.151:0/2275437426 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc2415d3a0 con 0x7fcc240ab460 2023-10-06T11:05:26.274 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.269+0000 7fcc20ff9700 1 -- 172.21.15.151:0/2275437426 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc18011670 con 0x7fcc240ab460 2023-10-06T11:05:26.274 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.269+0000 7fcc2afcd700 1 -- 172.21.15.151:0/2275437426 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc24143dd0 con 0x7fcc240ab460 2023-10-06T11:05:26.274 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.269+0000 7fcc20ff9700 1 -- 172.21.15.151:0/2275437426 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fcc18011d20 con 0x7fcc240ab460 2023-10-06T11:05:26.275 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.269+0000 7fcc20ff9700 1 -- 172.21.15.151:0/2275437426 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7fcc1802ebd0 con 0x7fcc240ab460 2023-10-06T11:05:26.275 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.270+0000 7fcc2afcd700 1 -- 172.21.15.151:0/2275437426 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc2404c380 con 0x7fcc240ab460 2023-10-06T11:05:26.275 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.272+0000 7fcc20ff9700 1 -- 172.21.15.151:0/2275437426 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fcc18033060 con 0x7fcc240ab460 2023-10-06T11:05:26.356 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.355+0000 7fcc2afcd700 1 -- 172.21.15.151:0/2275437426 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd new", "uuid": "838fc683-c326-415a-b906-83cf8f3a396c", "id": 0} v 0) v1 -- 0x7fcc240aa440 con 0x7fcc240ab460 2023-10-06T11:05:26.361 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.360+0000 7fcc20ff9700 1 -- 172.21.15.151:0/2275437426 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "838fc683-c326-415a-b906-83cf8f3a396c", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcc18015020 con 0x7fcc240ab460 2023-10-06T11:05:26.361 INFO:teuthology.orchestra.run.smithi151.stdout:0 2023-10-06T11:05:26.362 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.361+0000 7fcc2afcd700 1 -- 172.21.15.151:0/2275437426 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc240ab460 msgr2=0x7fcc24143890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:26.362 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.361+0000 7fcc2afcd700 1 --2- 172.21.15.151:0/2275437426 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc240ab460 0x7fcc24143890 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcc240cca30 tx=0x7fcc18017000 comp rx=0 tx=0).stop 2023-10-06T11:05:26.363 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.361+0000 7fcc2afcd700 1 -- 172.21.15.151:0/2275437426 shutdown_connections 2023-10-06T11:05:26.363 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.361+0000 7fcc2afcd700 1 --2- 172.21.15.151:0/2275437426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc24159920 0x7fcc24157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:26.363 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.361+0000 7fcc2afcd700 1 --2- 172.21.15.151:0/2275437426 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc240ab460 0x7fcc24143890 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:26.363 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.361+0000 7fcc2afcd700 1 --2- 172.21.15.151:0/2275437426 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc24159550 0x7fcc24156f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:26.363 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.361+0000 7fcc2afcd700 1 -- 172.21.15.151:0/2275437426 >> 172.21.15.151:0/2275437426 conn(0x7fcc240c9fa0 msgr2=0x7fcc24156690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:26.363 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.362+0000 7fcc2afcd700 1 -- 172.21.15.151:0/2275437426 shutdown_connections 2023-10-06T11:05:26.363 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.362+0000 7fcc2afcd700 1 -- 172.21.15.151:0/2275437426 wait complete. 2023-10-06T11:05:26.374 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 94f730ed-f906-4eaf-bec5-b878c4054a44 1 2023-10-06T11:05:26.490 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.489+0000 7f0878cca700 1 Processor -- start 2023-10-06T11:05:26.490 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.489+0000 7f0878cca700 1 -- start start 2023-10-06T11:05:26.493 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.490+0000 7f0878cca700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f08740cb090 0x7f08740cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:26.493 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.490+0000 7f0878cca700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0874068780 0x7f0874068b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:26.493 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.490+0000 7f0878cca700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08740cc130 con 0x7f08740b5640 2023-10-06T11:05:26.493 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.490+0000 7f0878cca700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08740b2660 con 0x7f08740cb090 2023-10-06T11:05:26.493 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.490+0000 7f0878cca700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08740690d0 con 0x7f0874068780 2023-10-06T11:05:26.493 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.490+0000 7f086bfff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f08740cb090 0x7f08740cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:26.493 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.490+0000 7f0873fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0874068780 0x7f0874068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:26.493 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.490+0000 7f08737fe700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f08740b5640 0x7f087415a870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:41980/0 (socket says 172.21.15.151:41980) 2023-10-06T11:05:26.494 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.490+0000 7f086bfff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f08740cb090 0x7f08740cc5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:55578/0 (socket says 172.21.15.151:55578) 2023-10-06T11:05:26.494 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.490+0000 7f08737fe700 1 -- 172.21.15.151:0/2544447277 learned_addr learned my addr 172.21.15.151:0/2544447277 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-06T11:05:26.494 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.491+0000 7f086bfff700 1 -- 172.21.15.151:0/2544447277 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0874068780 msgr2=0x7f0874068b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:26.494 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.491+0000 7f086bfff700 1 --2- 172.21.15.151:0/2544447277 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0874068780 0x7f0874068b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:26.494 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.491+0000 7f086bfff700 1 -- 172.21.15.151:0/2544447277 >> v1:172.21.15.151:6789/0 conn(0x7f08740b5640 legacy=0x7f087415a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:26.494 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.491+0000 7f086bfff700 1 -- 172.21.15.151:0/2544447277 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08740cb520 con 0x7f08740cb090 2023-10-06T11:05:26.494 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.491+0000 7f0872ffd700 1 -- 172.21.15.151:0/2544447277 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2827181374 0 0) 0x7f08740cc130 con 0x7f08740b5640 2023-10-06T11:05:26.494 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.491+0000 7f0873fff700 1 --2- 172.21.15.151:0/2544447277 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0874068780 0x7f0874068b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:05:26.494 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.491+0000 7f086bfff700 1 --2- 172.21.15.151:0/2544447277 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08740cb090 0x7f08740cc5c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f085c0098e0 tx=0x7f085c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83d59c646ac8f56 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:26.494 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.491+0000 7f0872ffd700 1 -- 172.21.15.151:0/2544447277 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085c00b640 con 0x7f08740cb090 2023-10-06T11:05:26.494 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.491+0000 7f0872ffd700 1 -- 172.21.15.151:0/2544447277 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085c00b7a0 con 0x7f08740cb090 2023-10-06T11:05:26.494 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.491+0000 7f0872ffd700 1 -- 172.21.15.151:0/2544447277 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085c00bb40 con 0x7f08740cb090 2023-10-06T11:05:26.495 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.492+0000 7f0878cca700 1 -- 172.21.15.151:0/2544447277 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08740cb090 msgr2=0x7f08740cc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:26.495 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.492+0000 7f0878cca700 1 --2- 172.21.15.151:0/2544447277 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08740cb090 0x7f08740cc5c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f085c0098e0 tx=0x7f085c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:05:26.495 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.492+0000 7f0878cca700 1 -- 172.21.15.151:0/2544447277 shutdown_connections 2023-10-06T11:05:26.495 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.492+0000 7f0878cca700 1 --2- 172.21.15.151:0/2544447277 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0874068780 0x7f0874068b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:26.495 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.492+0000 7f0878cca700 1 --2- 172.21.15.151:0/2544447277 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08740cb090 0x7f08740cc5c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:26.495 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.492+0000 7f0878cca700 1 -- 172.21.15.151:0/2544447277 >> 172.21.15.151:0/2544447277 conn(0x7f08740703f0 msgr2=0x7f08740707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:26.495 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.492+0000 7f0878cca700 1 -- 172.21.15.151:0/2544447277 shutdown_connections 2023-10-06T11:05:26.495 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.492+0000 7f0878cca700 1 -- 172.21.15.151:0/2544447277 wait complete. 2023-10-06T11:05:26.498 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.493+0000 7f0878cca700 1 Processor -- start 2023-10-06T11:05:26.498 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.493+0000 7f0878cca700 1 -- start start 2023-10-06T11:05:26.498 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.494+0000 7f0878cca700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0874068780 0x7f0874153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:26.498 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.494+0000 7f0878cca700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08740b5640 0x7f08740c6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:26.498 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.494+0000 7f0878cca700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08740cb090 0x7f0874146970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:26.498 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.494+0000 7f0878cca700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08740c8d70 con 0x7f08740cb090 2023-10-06T11:05:26.498 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.494+0000 7f0878cca700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08740c7e80 con 0x7f08740b5640 2023-10-06T11:05:26.498 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.494+0000 7f0878cca700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08740c8160 con 0x7f0874068780 2023-10-06T11:05:26.498 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.494+0000 7f086bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08740b5640 0x7f08740c6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:26.498 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.494+0000 7f08737fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0874068780 0x7f0874153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:26.499 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.494+0000 7f086bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08740b5640 0x7f08740c6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:55582/0 (socket says 172.21.15.151:55582) 2023-10-06T11:05:26.499 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.494+0000 7f08737fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0874068780 0x7f0874153200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:49216/0 (socket says 172.21.15.151:49216) 2023-10-06T11:05:26.499 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.494+0000 7f086bfff700 1 -- 172.21.15.151:0/74408847 learned_addr learned my addr 172.21.15.151:0/74408847 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-06T11:05:26.499 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.494+0000 7f0873fff700 1 --2- 172.21.15.151:0/74408847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08740cb090 0x7f0874146970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:26.499 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.494+0000 7f086bfff700 1 -- 172.21.15.151:0/74408847 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0874068780 msgr2=0x7f0874153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:26.499 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.494+0000 7f086bfff700 1 --2- 172.21.15.151:0/74408847 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0874068780 0x7f0874153200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:26.499 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.494+0000 7f086bfff700 1 -- 172.21.15.151:0/74408847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08740cb090 msgr2=0x7f0874146970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:26.499 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.494+0000 7f086bfff700 1 --2- 172.21.15.151:0/74408847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08740cb090 0x7f0874146970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:26.499 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.494+0000 7f086bfff700 1 -- 172.21.15.151:0/74408847 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f086c009a20 con 0x7f08740b5640 2023-10-06T11:05:26.499 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.494+0000 7f08737fe700 1 --2- 172.21.15.151:0/74408847 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0874068780 0x7f0874153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:05:26.499 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.494+0000 7f0873fff700 1 --2- 172.21.15.151:0/74408847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08740cb090 0x7f0874146970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:05:26.499 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.494+0000 7f086bfff700 1 --2- 172.21.15.151:0/74408847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08740b5640 0x7f08740c6d90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f08740694f0 tx=0x7f085c017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:26.499 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.494+0000 7f086b7fe700 1 -- 172.21.15.151:0/74408847 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085c000d10 con 0x7f08740b5640 2023-10-06T11:05:26.500 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.494+0000 7f086b7fe700 1 -- 172.21.15.151:0/74408847 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085c00bb20 con 0x7f08740b5640 2023-10-06T11:05:26.500 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.494+0000 7f086b7fe700 1 -- 172.21.15.151:0/74408847 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085c011650 con 0x7f08740b5640 2023-10-06T11:05:26.500 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.494+0000 7f0878cca700 1 -- 172.21.15.151:0/74408847 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f085c009420 con 0x7f08740b5640 2023-10-06T11:05:26.500 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.494+0000 7f0878cca700 1 -- 172.21.15.151:0/74408847 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08740c8720 con 0x7f08740b5640 2023-10-06T11:05:26.500 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.495+0000 7f086b7fe700 1 -- 172.21.15.151:0/74408847 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f085c011c80 con 0x7f08740b5640 2023-10-06T11:05:26.500 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.495+0000 7f086b7fe700 1 -- 172.21.15.151:0/74408847 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f085c025db0 con 0x7f08740b5640 2023-10-06T11:05:26.500 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.495+0000 7f0878cca700 1 -- 172.21.15.151:0/74408847 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08740894b0 con 0x7f08740b5640 2023-10-06T11:05:26.500 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.497+0000 7f086b7fe700 1 -- 172.21.15.151:0/74408847 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f085c029070 con 0x7f08740b5640 2023-10-06T11:05:26.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.581+0000 7f0878cca700 1 -- 172.21.15.151:0/74408847 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd new", "uuid": "94f730ed-f906-4eaf-bec5-b878c4054a44", "id": 1} v 0) v1 -- 0x7f08740b5a10 con 0x7f08740b5640 2023-10-06T11:05:26.589 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.589+0000 7f086b7fe700 1 -- 172.21.15.151:0/74408847 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "94f730ed-f906-4eaf-bec5-b878c4054a44", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f085c015020 con 0x7f08740b5640 2023-10-06T11:05:26.590 INFO:teuthology.orchestra.run.smithi151.stdout:1 2023-10-06T11:05:26.591 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.590+0000 7f0878cca700 1 -- 172.21.15.151:0/74408847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08740b5640 msgr2=0x7f08740c6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:26.591 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.590+0000 7f0878cca700 1 --2- 172.21.15.151:0/74408847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08740b5640 0x7f08740c6d90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f08740694f0 tx=0x7f085c017000 comp rx=0 tx=0).stop 2023-10-06T11:05:26.591 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.590+0000 7f0878cca700 1 -- 172.21.15.151:0/74408847 shutdown_connections 2023-10-06T11:05:26.591 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.590+0000 7f0878cca700 1 --2- 172.21.15.151:0/74408847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08740cb090 0x7f0874146970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:26.591 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.590+0000 7f0878cca700 1 --2- 172.21.15.151:0/74408847 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0874068780 0x7f0874153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:26.591 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.590+0000 7f0878cca700 1 --2- 172.21.15.151:0/74408847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08740b5640 0x7f08740c6d90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:26.591 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.590+0000 7f0878cca700 1 -- 172.21.15.151:0/74408847 >> 172.21.15.151:0/74408847 conn(0x7f08740703f0 msgr2=0x7f08741538d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:26.591 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.590+0000 7f0878cca700 1 -- 172.21.15.151:0/74408847 shutdown_connections 2023-10-06T11:05:26.591 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.590+0000 7f0878cca700 1 -- 172.21.15.151:0/74408847 wait complete. 2023-10-06T11:05:26.602 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 3cd165bf-ccf7-44c3-96a9-c998febbefe0 2 2023-10-06T11:05:26.719 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.719+0000 7f924b55d700 1 Processor -- start 2023-10-06T11:05:26.720 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.719+0000 7f924b55d700 1 -- start start 2023-10-06T11:05:26.722 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.720+0000 7f924b55d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f924415cff0 0x7f924415d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:26.722 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.720+0000 7f924b55d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92440cf030 con 0x7f924415cc20 2023-10-06T11:05:26.722 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.720+0000 7f924b55d700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92440ced20 con 0x7f92440d0c50 2023-10-06T11:05:26.722 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.720+0000 7f924b55d700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f924415e390 con 0x7f924415cff0 2023-10-06T11:05:26.722 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.720+0000 7f9248af8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f924415cff0 0x7f924415d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:26.722 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.720+0000 7f9249afa700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f92440d0c50 0x7f924415a890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:41990/0 (socket says 172.21.15.151:41990) 2023-10-06T11:05:26.722 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.720+0000 7f9249afa700 1 -- 172.21.15.151:0/1490209513 learned_addr learned my addr 172.21.15.151:0/1490209513 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-06T11:05:26.723 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.720+0000 7f923bfff700 1 -- 172.21.15.151:0/1490209513 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2903507956 0 0) 0x7f92440ced20 con 0x7f92440d0c50 2023-10-06T11:05:26.723 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.720+0000 7f9248af8700 1 -- 172.21.15.151:0/1490209513 >> v1:172.21.15.151:6789/0 conn(0x7f92440d0c50 legacy=0x7f924415a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:26.723 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.720+0000 7f9248af8700 1 -- 172.21.15.151:0/1490209513 >> v1:172.21.15.146:6789/0 conn(0x7f924415cc20 legacy=0x7f92440d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:26.723 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.720+0000 7f9248af8700 1 -- 172.21.15.151:0/1490209513 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f924415daf0 con 0x7f924415cff0 2023-10-06T11:05:26.723 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.720+0000 7f9248af8700 1 --2- 172.21.15.151:0/1490209513 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f924415cff0 0x7f924415d460 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9240009910 tx=0x7f92400091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75ec9dfc2b3fa1b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:26.723 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.720+0000 7f923bfff700 1 -- 172.21.15.151:0/1490209513 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924000b860 con 0x7f924415cff0 2023-10-06T11:05:26.723 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.721+0000 7f923bfff700 1 -- 172.21.15.151:0/1490209513 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924000b9c0 con 0x7f924415cff0 2023-10-06T11:05:26.723 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.721+0000 7f923bfff700 1 -- 172.21.15.151:0/1490209513 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924000bd60 con 0x7f924415cff0 2023-10-06T11:05:26.723 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.721+0000 7f924b55d700 1 -- 172.21.15.151:0/1490209513 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f924415cff0 msgr2=0x7f924415d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:26.723 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.721+0000 7f924b55d700 1 --2- 172.21.15.151:0/1490209513 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f924415cff0 0x7f924415d460 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9240009910 tx=0x7f92400091a0 comp rx=0 tx=0).stop 2023-10-06T11:05:26.723 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.721+0000 7f924b55d700 1 -- 172.21.15.151:0/1490209513 shutdown_connections 2023-10-06T11:05:26.723 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.721+0000 7f924b55d700 1 --2- 172.21.15.151:0/1490209513 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f924415cff0 0x7f924415d460 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:26.723 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.721+0000 7f924b55d700 1 -- 172.21.15.151:0/1490209513 >> 172.21.15.151:0/1490209513 conn(0x7f924406eba0 msgr2=0x7f924406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:26.724 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.721+0000 7f924b55d700 1 -- 172.21.15.151:0/1490209513 shutdown_connections 2023-10-06T11:05:26.724 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.721+0000 7f924b55d700 1 -- 172.21.15.151:0/1490209513 wait complete. 2023-10-06T11:05:26.726 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.722+0000 7f924b55d700 1 Processor -- start 2023-10-06T11:05:26.726 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.722+0000 7f924b55d700 1 -- start start 2023-10-06T11:05:26.726 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.723+0000 7f924b55d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92440d0c50 0x7f92441572d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:26.726 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.723+0000 7f924b55d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f924415cc20 0x7f92440ae910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:26.726 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.723+0000 7f924b55d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f924415cff0 0x7f92440b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:26.727 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.723+0000 7f924b55d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924416b1e0 con 0x7f924415cff0 2023-10-06T11:05:26.727 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.723+0000 7f924b55d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924415a960 con 0x7f92440d0c50 2023-10-06T11:05:26.727 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.723+0000 7f924b55d700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f924416a5d0 con 0x7f924415cc20 2023-10-06T11:05:26.727 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.723+0000 7f92492f9700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92440d0c50 0x7f92441572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:26.727 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.723+0000 7f9248af8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f924415cc20 0x7f92440ae910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:26.727 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.723+0000 7f92492f9700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92440d0c50 0x7f92441572d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:55584/0 (socket says 172.21.15.151:55584) 2023-10-06T11:05:26.727 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.723+0000 7f92492f9700 1 -- 172.21.15.151:0/2022183549 learned_addr learned my addr 172.21.15.151:0/2022183549 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-06T11:05:26.727 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.723+0000 7f9249afa700 1 --2- 172.21.15.151:0/2022183549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f924415cff0 0x7f92440b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:26.727 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.724+0000 7f9248af8700 1 -- 172.21.15.151:0/2022183549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92440d0c50 msgr2=0x7f92441572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:26.727 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.724+0000 7f9248af8700 1 --2- 172.21.15.151:0/2022183549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92440d0c50 0x7f92441572d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:26.727 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.724+0000 7f9248af8700 1 -- 172.21.15.151:0/2022183549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f924415cff0 msgr2=0x7f92440b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:26.728 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.724+0000 7f9248af8700 1 --2- 172.21.15.151:0/2022183549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f924415cff0 0x7f92440b1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:26.728 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.724+0000 7f9248af8700 1 -- 172.21.15.151:0/2022183549 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9240009420 con 0x7f924415cc20 2023-10-06T11:05:26.728 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.724+0000 7f92492f9700 1 --2- 172.21.15.151:0/2022183549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92440d0c50 0x7f92441572d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:05:26.728 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.724+0000 7f9248af8700 1 --2- 172.21.15.151:0/2022183549 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f924415cc20 0x7f92440ae910 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9240016000 tx=0x7f9240017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:26.728 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.724+0000 7f92397fa700 1 -- 172.21.15.151:0/2022183549 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924001f070 con 0x7f924415cc20 2023-10-06T11:05:26.728 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.724+0000 7f92397fa700 1 -- 172.21.15.151:0/2022183549 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9240002f70 con 0x7f924415cc20 2023-10-06T11:05:26.728 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.724+0000 7f92397fa700 1 -- 172.21.15.151:0/2022183549 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9240025420 con 0x7f924415cc20 2023-10-06T11:05:26.728 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.724+0000 7f924b55d700 1 -- 172.21.15.151:0/2022183549 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f924416a8b0 con 0x7f924415cc20 2023-10-06T11:05:26.728 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.724+0000 7f924b55d700 1 -- 172.21.15.151:0/2022183549 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f924416ae70 con 0x7f924415cc20 2023-10-06T11:05:26.729 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.724+0000 7f92397fa700 1 -- 172.21.15.151:0/2022183549 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f9240023070 con 0x7f924415cc20 2023-10-06T11:05:26.729 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.724+0000 7f92397fa700 1 -- 172.21.15.151:0/2022183549 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f924001a850 con 0x7f924415cc20 2023-10-06T11:05:26.729 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.725+0000 7f924b55d700 1 -- 172.21.15.151:0/2022183549 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f924416b390 con 0x7f924415cc20 2023-10-06T11:05:26.729 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.729+0000 7f92397fa700 1 -- 172.21.15.151:0/2022183549 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f924416b390 con 0x7f924415cc20 2023-10-06T11:05:26.730 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-10-06T11:05:26.729+0000 7fe765121180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T11:05:26.763 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-06T11:05:26.762+0000 7fc655002180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T11:05:26.810 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.809+0000 7f924b55d700 1 -- 172.21.15.151:0/2022183549 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3cd165bf-ccf7-44c3-96a9-c998febbefe0", "id": 2} v 0) v1 -- 0x7f924404c380 con 0x7f924415cc20 2023-10-06T11:05:26.814 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.813+0000 7f92397fa700 1 -- 172.21.15.151:0/2022183549 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3cd165bf-ccf7-44c3-96a9-c998febbefe0", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f924003c0b0 con 0x7f924415cc20 2023-10-06T11:05:26.814 INFO:teuthology.orchestra.run.smithi151.stdout:2 2023-10-06T11:05:26.815 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.814+0000 7f924b55d700 1 -- 172.21.15.151:0/2022183549 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f924415cc20 msgr2=0x7f92440ae910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:26.815 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.814+0000 7f924b55d700 1 --2- 172.21.15.151:0/2022183549 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f924415cc20 0x7f92440ae910 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9240016000 tx=0x7f9240017000 comp rx=0 tx=0).stop 2023-10-06T11:05:26.815 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.814+0000 7f924b55d700 1 -- 172.21.15.151:0/2022183549 shutdown_connections 2023-10-06T11:05:26.815 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.814+0000 7f924b55d700 1 --2- 172.21.15.151:0/2022183549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f924415cff0 0x7f92440b1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:26.815 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.814+0000 7f924b55d700 1 --2- 172.21.15.151:0/2022183549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92440d0c50 0x7f92441572d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:26.815 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.814+0000 7f924b55d700 1 --2- 172.21.15.151:0/2022183549 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f924415cc20 0x7f92440ae910 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:26.815 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.814+0000 7f924b55d700 1 -- 172.21.15.151:0/2022183549 >> 172.21.15.151:0/2022183549 conn(0x7f924406eba0 msgr2=0x7f9244158120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:26.815 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.814+0000 7f924b55d700 1 -- 172.21.15.151:0/2022183549 shutdown_connections 2023-10-06T11:05:26.816 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.814+0000 7f924b55d700 1 -- 172.21.15.151:0/2022183549 wait complete. 2023-10-06T11:05:26.827 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 6132b6d7-a09c-4a1f-824b-16983afa74e9 3 2023-10-06T11:05:26.863 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-10-06T11:05:26.862+0000 7fe765121180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T11:05:26.902 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-06T11:05:26.902+0000 7fc655002180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T11:05:26.939 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-10-06T11:05:26.937+0000 7fe765121180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T11:05:26.944 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.944+0000 7ff7b8390700 1 Processor -- start 2023-10-06T11:05:26.945 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.944+0000 7ff7b8390700 1 -- start start 2023-10-06T11:05:26.947 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.945+0000 7ff7b8390700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7b015cc20 0x7ff7b015d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:26.947 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.945+0000 7ff7b8390700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff7b00d0c50 0x7ff7b015a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:26.947 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.945+0000 7ff7b8390700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7b00cf030 con 0x7ff7b015cff0 2023-10-06T11:05:26.948 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.945+0000 7ff7b8390700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7b015e390 con 0x7ff7b00d0c50 2023-10-06T11:05:26.948 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.945+0000 7ff7b8390700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b00ced20 con 0x7ff7b015cc20 2023-10-06T11:05:26.948 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.945+0000 7ff7b612c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7b015cc20 0x7ff7b015d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:26.948 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.945+0000 7ff7b612c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7b015cc20 0x7ff7b015d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:49252/0 (socket says 172.21.15.151:49252) 2023-10-06T11:05:26.948 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.945+0000 7ff7b612c700 1 -- 172.21.15.151:0/3101768954 learned_addr learned my addr 172.21.15.151:0/3101768954 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-06T11:05:26.948 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.945+0000 7ff7b692d700 1 --2- 172.21.15.151:0/3101768954 >> v2:172.21.15.146:3300/0 conn(0x7ff7b00d0c50 0x7ff7b015a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:26.948 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.945+0000 7ff7b512a700 1 -- 172.21.15.151:0/3101768954 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 145305753 0 0) 0x7ff7b00cf030 con 0x7ff7b015cff0 2023-10-06T11:05:26.948 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.945+0000 7ff7b612c700 1 -- 172.21.15.151:0/3101768954 >> v2:172.21.15.146:3300/0 conn(0x7ff7b00d0c50 msgr2=0x7ff7b015a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:26.948 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.945+0000 7ff7b612c700 1 --2- 172.21.15.151:0/3101768954 >> v2:172.21.15.146:3300/0 conn(0x7ff7b00d0c50 0x7ff7b015a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:26.948 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.945+0000 7ff7b612c700 1 -- 172.21.15.151:0/3101768954 >> v1:172.21.15.151:6789/0 conn(0x7ff7b015cff0 legacy=0x7ff7b00d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:26.948 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.945+0000 7ff7b612c700 1 -- 172.21.15.151:0/3101768954 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b015daf0 con 0x7ff7b015cc20 2023-10-06T11:05:26.948 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.945+0000 7ff7b612c700 1 --2- 172.21.15.151:0/3101768954 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7b015cc20 0x7ff7b015d460 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac009990 tx=0x7ff7ac009220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd6e7439876a78be server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:26.949 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.946+0000 7ff7b512a700 1 -- 172.21.15.151:0/3101768954 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac009e80 con 0x7ff7b015cc20 2023-10-06T11:05:26.949 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.946+0000 7ff7b512a700 1 -- 172.21.15.151:0/3101768954 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7ac005c10 con 0x7ff7b015cc20 2023-10-06T11:05:26.949 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.946+0000 7ff7b512a700 1 -- 172.21.15.151:0/3101768954 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac00b650 con 0x7ff7b015cc20 2023-10-06T11:05:26.949 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.946+0000 7ff7b8390700 1 -- 172.21.15.151:0/3101768954 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7b015cc20 msgr2=0x7ff7b015d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:26.949 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.946+0000 7ff7b8390700 1 --2- 172.21.15.151:0/3101768954 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7b015cc20 0x7ff7b015d460 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac009990 tx=0x7ff7ac009220 comp rx=0 tx=0).stop 2023-10-06T11:05:26.949 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.946+0000 7ff7b8390700 1 -- 172.21.15.151:0/3101768954 shutdown_connections 2023-10-06T11:05:26.949 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.946+0000 7ff7b8390700 1 --2- 172.21.15.151:0/3101768954 >> v2:172.21.15.146:3300/0 conn(0x7ff7b00d0c50 0x7ff7b015a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:26.949 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.946+0000 7ff7b8390700 1 --2- 172.21.15.151:0/3101768954 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7b015cc20 0x7ff7b015d460 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:26.949 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.946+0000 7ff7b8390700 1 -- 172.21.15.151:0/3101768954 >> 172.21.15.151:0/3101768954 conn(0x7ff7b006eba0 msgr2=0x7ff7b006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:26.949 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.946+0000 7ff7b8390700 1 -- 172.21.15.151:0/3101768954 shutdown_connections 2023-10-06T11:05:26.949 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.946+0000 7ff7b8390700 1 -- 172.21.15.151:0/3101768954 wait complete. 2023-10-06T11:05:26.951 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.947+0000 7ff7b8390700 1 Processor -- start 2023-10-06T11:05:26.952 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.947+0000 7ff7b8390700 1 -- start start 2023-10-06T11:05:26.952 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.948+0000 7ff7b8390700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7b00d0c50 0x7ff7b00b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:26.952 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.948+0000 7ff7b8390700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7b015cc20 0x7ff7b016a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:26.952 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.948+0000 7ff7b8390700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7b015cff0 0x7ff7b0154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:26.952 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.948+0000 7ff7b8390700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b00c7a00 con 0x7ff7b015cff0 2023-10-06T11:05:26.952 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.948+0000 7ff7b8390700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b00afd00 con 0x7ff7b015cc20 2023-10-06T11:05:26.952 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.948+0000 7ff7b8390700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b016db90 con 0x7ff7b00d0c50 2023-10-06T11:05:26.952 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.948+0000 7ff7b612c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7b00d0c50 0x7ff7b00b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:26.952 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.948+0000 7ff7b592b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7b015cc20 0x7ff7b016a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:26.952 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.948+0000 7ff7b612c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7b00d0c50 0x7ff7b00b1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:49266/0 (socket says 172.21.15.151:49266) 2023-10-06T11:05:26.952 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.948+0000 7ff7b612c700 1 -- 172.21.15.151:0/2803900633 learned_addr learned my addr 172.21.15.151:0/2803900633 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-06T11:05:26.953 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.948+0000 7ff7b692d700 1 --2- 172.21.15.151:0/2803900633 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7b015cff0 0x7ff7b0154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:26.953 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.949+0000 7ff7b612c700 1 -- 172.21.15.151:0/2803900633 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7b015cc20 msgr2=0x7ff7b016a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:26.953 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.949+0000 7ff7b612c700 1 --2- 172.21.15.151:0/2803900633 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7b015cc20 0x7ff7b016a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:26.953 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.949+0000 7ff7b612c700 1 -- 172.21.15.151:0/2803900633 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7b015cff0 msgr2=0x7ff7b0154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:26.953 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.949+0000 7ff7b612c700 1 --2- 172.21.15.151:0/2803900633 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7b015cff0 0x7ff7b0154ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:26.953 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.949+0000 7ff7b612c700 1 -- 172.21.15.151:0/2803900633 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7ac009480 con 0x7ff7b00d0c50 2023-10-06T11:05:26.953 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.949+0000 7ff7b592b700 1 --2- 172.21.15.151:0/2803900633 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7b015cc20 0x7ff7b016a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:05:26.953 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.949+0000 7ff7b612c700 1 --2- 172.21.15.151:0/2803900633 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7b00d0c50 0x7ff7b00b1a40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff7b00894c0 tx=0x7ff7ac016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:26.953 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.949+0000 7ff7a67fc700 1 -- 172.21.15.151:0/2803900633 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac01dc30 con 0x7ff7b00d0c50 2023-10-06T11:05:26.953 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.949+0000 7ff7a67fc700 1 -- 172.21.15.151:0/2803900633 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7ac01dd90 con 0x7ff7b00d0c50 2023-10-06T11:05:26.953 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.949+0000 7ff7a67fc700 1 -- 172.21.15.151:0/2803900633 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac026660 con 0x7ff7b00d0c50 2023-10-06T11:05:26.953 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.949+0000 7ff7b8390700 1 -- 172.21.15.151:0/2803900633 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7b016de70 con 0x7ff7b00d0c50 2023-10-06T11:05:26.953 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.949+0000 7ff7b8390700 1 -- 172.21.15.151:0/2803900633 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7b016e430 con 0x7ff7b00d0c50 2023-10-06T11:05:26.953 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.949+0000 7ff7a67fc700 1 -- 172.21.15.151:0/2803900633 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7ff7ac026c90 con 0x7ff7b00d0c50 2023-10-06T11:05:26.954 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.949+0000 7ff7a67fc700 1 -- 172.21.15.151:0/2803900633 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7ff7ac01aaf0 con 0x7ff7b00d0c50 2023-10-06T11:05:26.954 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.950+0000 7ff7b8390700 1 -- 172.21.15.151:0/2803900633 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7b004c380 con 0x7ff7b00d0c50 2023-10-06T11:05:26.954 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:26.952+0000 7ff7a67fc700 1 -- 172.21.15.151:0/2803900633 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7ff7ac0456d0 con 0x7ff7b00d0c50 2023-10-06T11:05:26.982 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-06T11:05:26.981+0000 7fc655002180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T11:05:27.036 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.035+0000 7ff7b8390700 1 -- 172.21.15.151:0/2803900633 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6132b6d7-a09c-4a1f-824b-16983afa74e9", "id": 3} v 0) v1 -- 0x7ff7b015d730 con 0x7ff7b00d0c50 2023-10-06T11:05:27.039 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.039+0000 7ff7a67fc700 1 -- 172.21.15.151:0/2803900633 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6132b6d7-a09c-4a1f-824b-16983afa74e9", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff7ac034030 con 0x7ff7b00d0c50 2023-10-06T11:05:27.040 INFO:teuthology.orchestra.run.smithi151.stdout:3 2023-10-06T11:05:27.041 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.040+0000 7ff7b8390700 1 -- 172.21.15.151:0/2803900633 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7b00d0c50 msgr2=0x7ff7b00b1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:27.041 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.040+0000 7ff7b8390700 1 --2- 172.21.15.151:0/2803900633 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7b00d0c50 0x7ff7b00b1a40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff7b00894c0 tx=0x7ff7ac016000 comp rx=0 tx=0).stop 2023-10-06T11:05:27.041 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.040+0000 7ff7b8390700 1 -- 172.21.15.151:0/2803900633 shutdown_connections 2023-10-06T11:05:27.041 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.040+0000 7ff7b8390700 1 --2- 172.21.15.151:0/2803900633 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7b015cff0 0x7ff7b0154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:27.041 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.040+0000 7ff7b8390700 1 --2- 172.21.15.151:0/2803900633 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7b00d0c50 0x7ff7b00b1a40 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:27.041 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.040+0000 7ff7b8390700 1 --2- 172.21.15.151:0/2803900633 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7b015cc20 0x7ff7b016a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:27.041 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.040+0000 7ff7b8390700 1 -- 172.21.15.151:0/2803900633 >> 172.21.15.151:0/2803900633 conn(0x7ff7b006eba0 msgr2=0x7ff7b0156a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:27.041 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.040+0000 7ff7b8390700 1 -- 172.21.15.151:0/2803900633 shutdown_connections 2023-10-06T11:05:27.042 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.040+0000 7ff7b8390700 1 -- 172.21.15.151:0/2803900633 wait complete. 2023-10-06T11:05:27.052 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 27155e9b-fa1e-4960-bbf4-4a0bcea50e60 4 2023-10-06T11:05:27.127 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-10-06T11:05:27.125+0000 7fe765121180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T11:05:27.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.168+0000 7fa8190ec700 1 Processor -- start 2023-10-06T11:05:27.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.168+0000 7fa8190ec700 1 -- start start 2023-10-06T11:05:27.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.169+0000 7fa8190ec700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa8140cb090 0x7fa8140cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:27.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.169+0000 7fa8190ec700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa814068780 0x7fa814068bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:27.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.169+0000 7fa8190ec700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8140cc130 con 0x7fa8140b5640 2023-10-06T11:05:27.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.169+0000 7fa8190ec700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa814069100 con 0x7fa8140cb090 2023-10-06T11:05:27.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.169+0000 7fa8190ec700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8140b2660 con 0x7fa814068780 2023-10-06T11:05:27.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.169+0000 7fa8188eb700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa814068780 0x7fa814068bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:27.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.169+0000 7fa813fff700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fa8140b5640 0x7fa81415a870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:42012/0 (socket says 172.21.15.151:42012) 2023-10-06T11:05:27.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.169+0000 7fa813fff700 1 -- 172.21.15.151:0/2114339181 learned_addr learned my addr 172.21.15.151:0/2114339181 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-06T11:05:27.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.169+0000 7fa8137fe700 1 --2- 172.21.15.151:0/2114339181 >> v2:172.21.15.146:3300/0 conn(0x7fa8140cb090 0x7fa8140cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:27.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.169+0000 7fa8188eb700 1 -- 172.21.15.151:0/2114339181 >> v2:172.21.15.146:3300/0 conn(0x7fa8140cb090 msgr2=0x7fa8140cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:27.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.169+0000 7fa8188eb700 1 --2- 172.21.15.151:0/2114339181 >> v2:172.21.15.146:3300/0 conn(0x7fa8140cb090 0x7fa8140cc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:27.172 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.169+0000 7fa8188eb700 1 -- 172.21.15.151:0/2114339181 >> v1:172.21.15.151:6789/0 conn(0x7fa8140b5640 legacy=0x7fa81415a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:27.172 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.169+0000 7fa8188eb700 1 -- 172.21.15.151:0/2114339181 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8140cb520 con 0x7fa814068780 2023-10-06T11:05:27.172 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.169+0000 7fa812ffd700 1 -- 172.21.15.151:0/2114339181 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3125191870 0 0) 0x7fa8140cc130 con 0x7fa8140b5640 2023-10-06T11:05:27.172 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.170+0000 7fa8188eb700 1 --2- 172.21.15.151:0/2114339181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa814068780 0x7fa814068bc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa814159e40 tx=0x7fa80c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2db89a242e3dac9a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:27.172 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.170+0000 7fa812ffd700 1 -- 172.21.15.151:0/2114339181 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c00e070 con 0x7fa814068780 2023-10-06T11:05:27.172 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.170+0000 7fa812ffd700 1 -- 172.21.15.151:0/2114339181 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80c00bb60 con 0x7fa814068780 2023-10-06T11:05:27.172 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.170+0000 7fa812ffd700 1 -- 172.21.15.151:0/2114339181 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80c012430 con 0x7fa814068780 2023-10-06T11:05:27.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.170+0000 7fa8190ec700 1 -- 172.21.15.151:0/2114339181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa814068780 msgr2=0x7fa814068bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:27.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.170+0000 7fa8190ec700 1 --2- 172.21.15.151:0/2114339181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa814068780 0x7fa814068bc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa814159e40 tx=0x7fa80c009780 comp rx=0 tx=0).stop 2023-10-06T11:05:27.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.171+0000 7fa8190ec700 1 -- 172.21.15.151:0/2114339181 shutdown_connections 2023-10-06T11:05:27.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.171+0000 7fa8190ec700 1 --2- 172.21.15.151:0/2114339181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa814068780 0x7fa814068bc0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:27.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.171+0000 7fa8190ec700 1 --2- 172.21.15.151:0/2114339181 >> v2:172.21.15.146:3300/0 conn(0x7fa8140cb090 0x7fa8140cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:27.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.171+0000 7fa8190ec700 1 -- 172.21.15.151:0/2114339181 >> 172.21.15.151:0/2114339181 conn(0x7fa8140703f0 msgr2=0x7fa8140707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:27.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.171+0000 7fa8190ec700 1 -- 172.21.15.151:0/2114339181 shutdown_connections 2023-10-06T11:05:27.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.171+0000 7fa8190ec700 1 -- 172.21.15.151:0/2114339181 wait complete. 2023-10-06T11:05:27.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.172+0000 7fa8190ec700 1 Processor -- start 2023-10-06T11:05:27.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.172+0000 7fa8190ec700 1 -- start start 2023-10-06T11:05:27.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.173+0000 7fa8190ec700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa814068780 0x7fa8140c9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:27.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.173+0000 7fa8190ec700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8140b5640 0x7fa814169d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:27.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.173+0000 7fa8190ec700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8140cb090 0x7fa8140c6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:27.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.173+0000 7fa8190ec700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8140c6800 con 0x7fa814068780 2023-10-06T11:05:27.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.173+0000 7fa8190ec700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8140c9f50 con 0x7fa8140b5640 2023-10-06T11:05:27.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.173+0000 7fa8190ec700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa81416a2d0 con 0x7fa8140cb090 2023-10-06T11:05:27.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.173+0000 7fa8137fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8140b5640 0x7fa814169d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:27.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.173+0000 7fa8188eb700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8140cb090 0x7fa8140c6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:27.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.173+0000 7fa8137fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8140b5640 0x7fa814169d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:55614/0 (socket says 172.21.15.151:55614) 2023-10-06T11:05:27.177 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.173+0000 7fa8137fe700 1 -- 172.21.15.151:0/3340315777 learned_addr learned my addr 172.21.15.151:0/3340315777 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-06T11:05:27.177 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.173+0000 7fa813fff700 1 --2- 172.21.15.151:0/3340315777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa814068780 0x7fa8140c9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:27.177 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.173+0000 7fa8137fe700 1 -- 172.21.15.151:0/3340315777 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8140cb090 msgr2=0x7fa8140c6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:27.177 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.173+0000 7fa8137fe700 1 --2- 172.21.15.151:0/3340315777 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8140cb090 0x7fa8140c6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:27.177 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.173+0000 7fa8137fe700 1 -- 172.21.15.151:0/3340315777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa814068780 msgr2=0x7fa8140c9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:27.177 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.173+0000 7fa8137fe700 1 --2- 172.21.15.151:0/3340315777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa814068780 0x7fa8140c9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:27.177 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.173+0000 7fa8137fe700 1 -- 172.21.15.151:0/3340315777 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa80c009a20 con 0x7fa8140b5640 2023-10-06T11:05:27.177 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.173+0000 7fa8137fe700 1 --2- 172.21.15.151:0/3340315777 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8140b5640 0x7fa814169d90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa80400ecb0 tx=0x7fa8040091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:27.177 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.173+0000 7fa7fbfff700 1 -- 172.21.15.151:0/3340315777 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80400c850 con 0x7fa8140b5640 2023-10-06T11:05:27.177 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.173+0000 7fa7fbfff700 1 -- 172.21.15.151:0/3340315777 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa80400c9b0 con 0x7fa8140b5640 2023-10-06T11:05:27.177 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.173+0000 7fa8190ec700 1 -- 172.21.15.151:0/3340315777 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8140c4ab0 con 0x7fa8140b5640 2023-10-06T11:05:27.177 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.173+0000 7fa7fbfff700 1 -- 172.21.15.151:0/3340315777 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa80400cd50 con 0x7fa8140b5640 2023-10-06T11:05:27.178 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.173+0000 7fa8190ec700 1 -- 172.21.15.151:0/3340315777 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8140c47d0 con 0x7fa8140b5640 2023-10-06T11:05:27.178 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.173+0000 7fa7fbfff700 1 -- 172.21.15.151:0/3340315777 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fa804013900 con 0x7fa8140b5640 2023-10-06T11:05:27.178 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.173+0000 7fa7fbfff700 1 -- 172.21.15.151:0/3340315777 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7fa80401ca50 con 0x7fa8140b5640 2023-10-06T11:05:27.178 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.174+0000 7fa8190ec700 1 -- 172.21.15.151:0/3340315777 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8140c69b0 con 0x7fa8140b5640 2023-10-06T11:05:27.178 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.176+0000 7fa7fbfff700 1 -- 172.21.15.151:0/3340315777 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fa8140c69b0 con 0x7fa8140b5640 2023-10-06T11:05:27.178 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-06T11:05:27.177+0000 7fc655002180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T11:05:27.260 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.260+0000 7fa8190ec700 1 -- 172.21.15.151:0/3340315777 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd new", "uuid": "27155e9b-fa1e-4960-bbf4-4a0bcea50e60", "id": 4} v 0) v1 -- 0x7fa81404bb40 con 0x7fa8140b5640 2023-10-06T11:05:27.264 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.264+0000 7fa7fbfff700 1 -- 172.21.15.151:0/3340315777 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "27155e9b-fa1e-4960-bbf4-4a0bcea50e60", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa804021060 con 0x7fa8140b5640 2023-10-06T11:05:27.264 INFO:teuthology.orchestra.run.smithi151.stdout:4 2023-10-06T11:05:27.265 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.265+0000 7fa8190ec700 1 -- 172.21.15.151:0/3340315777 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8140b5640 msgr2=0x7fa814169d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:27.266 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.265+0000 7fa8190ec700 1 --2- 172.21.15.151:0/3340315777 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8140b5640 0x7fa814169d90 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa80400ecb0 tx=0x7fa8040091a0 comp rx=0 tx=0).stop 2023-10-06T11:05:27.266 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.265+0000 7fa8190ec700 1 -- 172.21.15.151:0/3340315777 shutdown_connections 2023-10-06T11:05:27.266 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.265+0000 7fa8190ec700 1 --2- 172.21.15.151:0/3340315777 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8140cb090 0x7fa8140c6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:27.266 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.265+0000 7fa8190ec700 1 --2- 172.21.15.151:0/3340315777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa814068780 0x7fa8140c9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:27.266 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.265+0000 7fa8190ec700 1 --2- 172.21.15.151:0/3340315777 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8140b5640 0x7fa814169d90 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:27.266 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.265+0000 7fa8190ec700 1 -- 172.21.15.151:0/3340315777 >> 172.21.15.151:0/3340315777 conn(0x7fa8140703f0 msgr2=0x7fa81415c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:27.266 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.265+0000 7fa8190ec700 1 -- 172.21.15.151:0/3340315777 shutdown_connections 2023-10-06T11:05:27.266 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.265+0000 7fa8190ec700 1 -- 172.21.15.151:0/3340315777 wait complete. 2023-10-06T11:05:27.277 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new bafd6c93-ce73-47a5-b027-309ed5c9d9e0 5 2023-10-06T11:05:27.301 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-10-06T11:05:27.299+0000 7fe765121180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T11:05:27.360 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-06T11:05:27.359+0000 7fc655002180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T11:05:27.378 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-10-06T11:05:27.377+0000 7fe765121180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T11:05:27.393 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.392+0000 7fd6ba3b9700 1 Processor -- start 2023-10-06T11:05:27.393 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.393+0000 7fd6ba3b9700 1 -- start start 2023-10-06T11:05:27.396 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.393+0000 7fd6ba3b9700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6b40adbd0 0x7fd6b4156160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:27.396 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.393+0000 7fd6ba3b9700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd6b4158e90 0x7fd6b415f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:27.396 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.393+0000 7fd6ba3b9700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6b41579f0 con 0x7fd6b41566a0 2023-10-06T11:05:27.396 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.393+0000 7fd6ba3b9700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6b4156b10 con 0x7fd6b4158e90 2023-10-06T11:05:27.396 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.393+0000 7fd6ba3b9700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b4156de0 con 0x7fd6b40adbd0 2023-10-06T11:05:27.396 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.393+0000 7fd6b3fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6b40adbd0 0x7fd6b4156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:27.396 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.394+0000 7fd6b8956700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd6b4158e90 0x7fd6b415f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:27.396 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.394+0000 7fd6b3fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6b40adbd0 0x7fd6b4156160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:49272/0 (socket says 172.21.15.151:49272) 2023-10-06T11:05:27.396 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.394+0000 7fd6b3fff700 1 -- 172.21.15.151:0/3841827144 learned_addr learned my addr 172.21.15.151:0/3841827144 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-06T11:05:27.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.394+0000 7fd6b8956700 1 -- 172.21.15.151:0/3841827144 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6b40adbd0 msgr2=0x7fd6b4156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:27.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.394+0000 7fd6b8956700 1 --2- 172.21.15.151:0/3841827144 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6b40adbd0 0x7fd6b4156160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:27.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.394+0000 7fd6b8956700 1 -- 172.21.15.151:0/3841827144 >> v1:172.21.15.146:6789/0 conn(0x7fd6b41566a0 legacy=0x7fd6b40adfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:27.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.394+0000 7fd6b8956700 1 -- 172.21.15.151:0/3841827144 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b41570c0 con 0x7fd6b4158e90 2023-10-06T11:05:27.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.394+0000 7fd6b3fff700 1 --2- 172.21.15.151:0/3841827144 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6b40adbd0 0x7fd6b4156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:05:27.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.394+0000 7fd6b8956700 1 --2- 172.21.15.151:0/3841827144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6b4158e90 0x7fd6b415f8e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac009e60 tx=0x7fd6ac009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2bde1f23584da13 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:27.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.394+0000 7fd6b2ffd700 1 -- 172.21.15.151:0/3841827144 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac00e070 con 0x7fd6b4158e90 2023-10-06T11:05:27.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.394+0000 7fd6b2ffd700 1 -- 172.21.15.151:0/3841827144 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6ac00bb60 con 0x7fd6b4158e90 2023-10-06T11:05:27.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.394+0000 7fd6b2ffd700 1 -- 172.21.15.151:0/3841827144 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac012430 con 0x7fd6b4158e90 2023-10-06T11:05:27.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.395+0000 7fd6ba3b9700 1 -- 172.21.15.151:0/3841827144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6b4158e90 msgr2=0x7fd6b415f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:27.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.395+0000 7fd6ba3b9700 1 --2- 172.21.15.151:0/3841827144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6b4158e90 0x7fd6b415f8e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac009e60 tx=0x7fd6ac009780 comp rx=0 tx=0).stop 2023-10-06T11:05:27.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.395+0000 7fd6ba3b9700 1 -- 172.21.15.151:0/3841827144 shutdown_connections 2023-10-06T11:05:27.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.395+0000 7fd6ba3b9700 1 --2- 172.21.15.151:0/3841827144 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6b40adbd0 0x7fd6b4156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:27.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.395+0000 7fd6ba3b9700 1 --2- 172.21.15.151:0/3841827144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6b4158e90 0x7fd6b415f8e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:27.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.395+0000 7fd6ba3b9700 1 -- 172.21.15.151:0/3841827144 >> 172.21.15.151:0/3841827144 conn(0x7fd6b406a070 msgr2=0x7fd6b4067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:27.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.395+0000 7fd6ba3b9700 1 -- 172.21.15.151:0/3841827144 shutdown_connections 2023-10-06T11:05:27.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.395+0000 7fd6ba3b9700 1 -- 172.21.15.151:0/3841827144 wait complete. 2023-10-06T11:05:27.400 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.396+0000 7fd6ba3b9700 1 Processor -- start 2023-10-06T11:05:27.400 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.396+0000 7fd6ba3b9700 1 -- start start 2023-10-06T11:05:27.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.397+0000 7fd6ba3b9700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6b40adbd0 0x7fd6b4152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:27.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.397+0000 7fd6ba3b9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6b41566a0 0x7fd6b41472a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:27.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.397+0000 7fd6ba3b9700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6b4158e90 0x7fd6b41461a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:27.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.397+0000 7fd6ba3b9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b413cfe0 con 0x7fd6b41566a0 2023-10-06T11:05:27.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.397+0000 7fd6ba3b9700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b413d2c0 con 0x7fd6b40adbd0 2023-10-06T11:05:27.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.397+0000 7fd6ba3b9700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b41459a0 con 0x7fd6b4158e90 2023-10-06T11:05:27.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.397+0000 7fd6b3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6b40adbd0 0x7fd6b4152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:27.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.397+0000 7fd6b8956700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6b4158e90 0x7fd6b41461a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:27.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.397+0000 7fd6b3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6b40adbd0 0x7fd6b4152fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:55644/0 (socket says 172.21.15.151:55644) 2023-10-06T11:05:27.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.397+0000 7fd6b3fff700 1 -- 172.21.15.151:0/1569289102 learned_addr learned my addr 172.21.15.151:0/1569289102 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-06T11:05:27.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.397+0000 7fd6b37fe700 1 --2- 172.21.15.151:0/1569289102 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6b41566a0 0x7fd6b41472a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:27.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.397+0000 7fd6b8956700 1 -- 172.21.15.151:0/1569289102 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6b40adbd0 msgr2=0x7fd6b4152fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:27.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.397+0000 7fd6b8956700 1 --2- 172.21.15.151:0/1569289102 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6b40adbd0 0x7fd6b4152fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:27.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.397+0000 7fd6b8956700 1 -- 172.21.15.151:0/1569289102 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6b41566a0 msgr2=0x7fd6b41472a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:27.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.397+0000 7fd6b8956700 1 --2- 172.21.15.151:0/1569289102 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6b41566a0 0x7fd6b41472a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:27.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.397+0000 7fd6b8956700 1 -- 172.21.15.151:0/1569289102 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a80094f0 con 0x7fd6b4158e90 2023-10-06T11:05:27.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.397+0000 7fd6b3fff700 1 --2- 172.21.15.151:0/1569289102 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6b40adbd0 0x7fd6b4152fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:05:27.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.397+0000 7fd6b8956700 1 --2- 172.21.15.151:0/1569289102 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6b4158e90 0x7fd6b41461a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac016000 tx=0x7fd6ac019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:27.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.397+0000 7fd69bfff700 1 -- 172.21.15.151:0/1569289102 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac027470 con 0x7fd6b4158e90 2023-10-06T11:05:27.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.398+0000 7fd69bfff700 1 -- 172.21.15.151:0/1569289102 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6ac0275f0 con 0x7fd6b4158e90 2023-10-06T11:05:27.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.398+0000 7fd6ba3b9700 1 -- 172.21.15.151:0/1569289102 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6ac009a20 con 0x7fd6b4158e90 2023-10-06T11:05:27.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.398+0000 7fd69bfff700 1 -- 172.21.15.151:0/1569289102 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac0279b0 con 0x7fd6b4158e90 2023-10-06T11:05:27.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.398+0000 7fd6ba3b9700 1 -- 172.21.15.151:0/1569289102 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6b413d5a0 con 0x7fd6b4158e90 2023-10-06T11:05:27.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.398+0000 7fd69bfff700 1 -- 172.21.15.151:0/1569289102 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fd6ac024070 con 0x7fd6b4158e90 2023-10-06T11:05:27.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.398+0000 7fd69bfff700 1 -- 172.21.15.151:0/1569289102 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7fd6ac01ddb0 con 0x7fd6b4158e90 2023-10-06T11:05:27.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.398+0000 7fd6ba3b9700 1 -- 172.21.15.151:0/1569289102 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6b406bd80 con 0x7fd6b4158e90 2023-10-06T11:05:27.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.400+0000 7fd69bfff700 1 -- 172.21.15.151:0/1569289102 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fd6ac0466d0 con 0x7fd6b4158e90 2023-10-06T11:05:27.441 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-06T11:05:27.441+0000 7fc655002180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T11:05:27.483 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.483+0000 7fd6ba3b9700 1 -- 172.21.15.151:0/1569289102 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd new", "uuid": "bafd6c93-ce73-47a5-b027-309ed5c9d9e0", "id": 5} v 0) v1 -- 0x7fd6b4145ea0 con 0x7fd6b4158e90 2023-10-06T11:05:27.487 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.487+0000 7fd69bfff700 1 -- 172.21.15.151:0/1569289102 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bafd6c93-ce73-47a5-b027-309ed5c9d9e0", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd6ac035030 con 0x7fd6b4158e90 2023-10-06T11:05:27.487 INFO:teuthology.orchestra.run.smithi151.stdout:5 2023-10-06T11:05:27.489 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.488+0000 7fd6ba3b9700 1 -- 172.21.15.151:0/1569289102 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6b4158e90 msgr2=0x7fd6b41461a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:27.489 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.488+0000 7fd6ba3b9700 1 --2- 172.21.15.151:0/1569289102 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6b4158e90 0x7fd6b41461a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac016000 tx=0x7fd6ac019000 comp rx=0 tx=0).stop 2023-10-06T11:05:27.489 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.488+0000 7fd6ba3b9700 1 -- 172.21.15.151:0/1569289102 shutdown_connections 2023-10-06T11:05:27.489 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.488+0000 7fd6ba3b9700 1 --2- 172.21.15.151:0/1569289102 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6b4158e90 0x7fd6b41461a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:27.489 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.488+0000 7fd6ba3b9700 1 --2- 172.21.15.151:0/1569289102 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6b40adbd0 0x7fd6b4152fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:27.489 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.488+0000 7fd6ba3b9700 1 --2- 172.21.15.151:0/1569289102 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6b41566a0 0x7fd6b41472a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:27.489 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.488+0000 7fd6ba3b9700 1 -- 172.21.15.151:0/1569289102 >> 172.21.15.151:0/1569289102 conn(0x7fd6b406a070 msgr2=0x7fd6b406ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:27.489 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.488+0000 7fd6ba3b9700 1 -- 172.21.15.151:0/1569289102 shutdown_connections 2023-10-06T11:05:27.489 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.488+0000 7fd6ba3b9700 1 -- 172.21.15.151:0/1569289102 wait complete. 2023-10-06T11:05:27.501 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new ca086e64-8042-425c-80f1-cb31555b13fd 6 2023-10-06T11:05:27.514 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-10-06T11:05:27.513+0000 7fe765121180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T11:05:27.590 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-06T11:05:27.590+0000 7fc655002180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T11:05:27.610 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-10-06T11:05:27.608+0000 7fe765121180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T11:05:27.619 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.618+0000 7fddb3102700 1 Processor -- start 2023-10-06T11:05:27.619 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.618+0000 7fddb3102700 1 -- start start 2023-10-06T11:05:27.622 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.619+0000 7fddb3102700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fddac15cff0 0x7fddac15d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:27.622 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.619+0000 7fddb3102700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fddac0d0c50 0x7fddac15a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:27.622 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.619+0000 7fddb3102700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddac0cf030 con 0x7fddac15cc20 2023-10-06T11:05:27.622 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.619+0000 7fddb3102700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddac15e390 con 0x7fddac15cff0 2023-10-06T11:05:27.622 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.619+0000 7fddb3102700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddac0ced20 con 0x7fddac0d0c50 2023-10-06T11:05:27.622 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.619+0000 7fddb169f700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fddac0d0c50 0x7fddac15a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:27.622 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.619+0000 7fddb169f700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fddac0d0c50 0x7fddac15a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:55656/0 (socket says 172.21.15.151:55656) 2023-10-06T11:05:27.622 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.619+0000 7fddb169f700 1 -- 172.21.15.151:0/1582503630 learned_addr learned my addr 172.21.15.151:0/1582503630 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-06T11:05:27.622 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.619+0000 7fddabfff700 1 --2- 172.21.15.151:0/1582503630 >> v2:172.21.15.146:3300/0 conn(0x7fddac15cff0 0x7fddac15d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:27.622 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.620+0000 7fddb169f700 1 -- 172.21.15.151:0/1582503630 >> v2:172.21.15.146:3300/0 conn(0x7fddac15cff0 msgr2=0x7fddac15d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:27.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.620+0000 7fddb169f700 1 --2- 172.21.15.151:0/1582503630 >> v2:172.21.15.146:3300/0 conn(0x7fddac15cff0 0x7fddac15d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:27.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.620+0000 7fddb169f700 1 -- 172.21.15.151:0/1582503630 >> v1:172.21.15.146:6789/0 conn(0x7fddac15cc20 legacy=0x7fddac0d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:27.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.620+0000 7fddb169f700 1 -- 172.21.15.151:0/1582503630 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddac15daf0 con 0x7fddac0d0c50 2023-10-06T11:05:27.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.620+0000 7fddb169f700 1 --2- 172.21.15.151:0/1582503630 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fddac0d0c50 0x7fddac15a890 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fddac15e590 tx=0x7fdda4009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bb423ec5076a1f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:27.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.620+0000 7fddab7fe700 1 -- 172.21.15.151:0/1582503630 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda400e070 con 0x7fddac0d0c50 2023-10-06T11:05:27.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.620+0000 7fddab7fe700 1 -- 172.21.15.151:0/1582503630 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda400ba20 con 0x7fddac0d0c50 2023-10-06T11:05:27.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.620+0000 7fddab7fe700 1 -- 172.21.15.151:0/1582503630 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda40092e0 con 0x7fddac0d0c50 2023-10-06T11:05:27.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.621+0000 7fddb3102700 1 -- 172.21.15.151:0/1582503630 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fddac0d0c50 msgr2=0x7fddac15a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:27.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.621+0000 7fddb3102700 1 --2- 172.21.15.151:0/1582503630 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fddac0d0c50 0x7fddac15a890 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fddac15e590 tx=0x7fdda4009840 comp rx=0 tx=0).stop 2023-10-06T11:05:27.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.621+0000 7fddb3102700 1 -- 172.21.15.151:0/1582503630 shutdown_connections 2023-10-06T11:05:27.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.621+0000 7fddb3102700 1 --2- 172.21.15.151:0/1582503630 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fddac0d0c50 0x7fddac15a890 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:27.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.621+0000 7fddb3102700 1 --2- 172.21.15.151:0/1582503630 >> v2:172.21.15.146:3300/0 conn(0x7fddac15cff0 0x7fddac15d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:27.624 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.621+0000 7fddb3102700 1 -- 172.21.15.151:0/1582503630 >> 172.21.15.151:0/1582503630 conn(0x7fddac06eba0 msgr2=0x7fddac06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:27.624 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.621+0000 7fddb3102700 1 -- 172.21.15.151:0/1582503630 shutdown_connections 2023-10-06T11:05:27.624 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.621+0000 7fddb3102700 1 -- 172.21.15.151:0/1582503630 wait complete. 2023-10-06T11:05:27.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.622+0000 7fddb3102700 1 Processor -- start 2023-10-06T11:05:27.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.622+0000 7fddb3102700 1 -- start start 2023-10-06T11:05:27.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.623+0000 7fddb3102700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddac0d0c50 0x7fddac0b2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:27.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.623+0000 7fddb3102700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fddac15cc20 0x7fddac151a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:27.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.623+0000 7fddb3102700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fddac15cff0 0x7fddac1534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:27.627 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.623+0000 7fddb3102700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddac151fa0 con 0x7fddac0d0c50 2023-10-06T11:05:27.627 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.623+0000 7fddb3102700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddac1514c0 con 0x7fddac15cff0 2023-10-06T11:05:27.627 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.623+0000 7fddb3102700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddac154980 con 0x7fddac15cc20 2023-10-06T11:05:27.627 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.623+0000 7fddb169f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fddac15cff0 0x7fddac1534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:27.627 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.623+0000 7fddabfff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fddac15cc20 0x7fddac151a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:27.627 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.623+0000 7fddb169f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fddac15cff0 0x7fddac1534a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:55662/0 (socket says 172.21.15.151:55662) 2023-10-06T11:05:27.627 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.623+0000 7fddabfff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fddac15cc20 0x7fddac151a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:49294/0 (socket says 172.21.15.151:49294) 2023-10-06T11:05:27.627 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.623+0000 7fddb169f700 1 -- 172.21.15.151:0/3631584422 learned_addr learned my addr 172.21.15.151:0/3631584422 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-06T11:05:27.627 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.623+0000 7fddb0e9e700 1 --2- 172.21.15.151:0/3631584422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddac0d0c50 0x7fddac0b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:27.627 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.623+0000 7fddb169f700 1 -- 172.21.15.151:0/3631584422 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fddac15cc20 msgr2=0x7fddac151a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:27.627 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.623+0000 7fddb169f700 1 --2- 172.21.15.151:0/3631584422 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fddac15cc20 0x7fddac151a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:27.627 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.623+0000 7fddb169f700 1 -- 172.21.15.151:0/3631584422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddac0d0c50 msgr2=0x7fddac0b2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:27.628 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.623+0000 7fddb169f700 1 --2- 172.21.15.151:0/3631584422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddac0d0c50 0x7fddac0b2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:27.628 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.623+0000 7fddb169f700 1 -- 172.21.15.151:0/3631584422 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda4009ae0 con 0x7fddac15cff0 2023-10-06T11:05:27.628 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.623+0000 7fddb0e9e700 1 --2- 172.21.15.151:0/3631584422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddac0d0c50 0x7fddac0b2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:05:27.628 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.623+0000 7fddabfff700 1 --2- 172.21.15.151:0/3631584422 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fddac15cc20 0x7fddac151a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:05:27.628 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.623+0000 7fddb169f700 1 --2- 172.21.15.151:0/3631584422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fddac15cff0 0x7fddac1534a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdda40072f0 tx=0x7fdda4018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:27.628 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.623+0000 7fdda8ff9700 1 -- 172.21.15.151:0/3631584422 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda4008b00 con 0x7fddac15cff0 2023-10-06T11:05:27.628 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.624+0000 7fdda8ff9700 1 -- 172.21.15.151:0/3631584422 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda4008c80 con 0x7fddac15cff0 2023-10-06T11:05:27.628 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.624+0000 7fddb3102700 1 -- 172.21.15.151:0/3631584422 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddac154e10 con 0x7fddac15cff0 2023-10-06T11:05:27.628 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.624+0000 7fdda8ff9700 1 -- 172.21.15.151:0/3631584422 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda4025460 con 0x7fddac15cff0 2023-10-06T11:05:27.628 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.624+0000 7fddb3102700 1 -- 172.21.15.151:0/3631584422 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddac154330 con 0x7fddac15cff0 2023-10-06T11:05:27.628 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.624+0000 7fdda8ff9700 1 -- 172.21.15.151:0/3631584422 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fdda4003040 con 0x7fddac15cff0 2023-10-06T11:05:27.628 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.624+0000 7fdda8ff9700 1 -- 172.21.15.151:0/3631584422 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7fdda4025ce0 con 0x7fddac15cff0 2023-10-06T11:05:27.629 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.624+0000 7fddb3102700 1 -- 172.21.15.151:0/3631584422 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddac04c380 con 0x7fddac15cff0 2023-10-06T11:05:27.629 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.626+0000 7fdda8ff9700 1 -- 172.21.15.151:0/3631584422 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fdda4020070 con 0x7fddac15cff0 2023-10-06T11:05:27.690 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-06T11:05:27.690+0000 7fc655002180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T11:05:27.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.709+0000 7fddb3102700 1 -- 172.21.15.151:0/3631584422 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ca086e64-8042-425c-80f1-cb31555b13fd", "id": 6} v 0) v1 -- 0x7fddac0b3b50 con 0x7fddac15cff0 2023-10-06T11:05:27.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.715+0000 7fdda8ff9700 1 -- 172.21.15.151:0/3631584422 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ca086e64-8042-425c-80f1-cb31555b13fd", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdda4025830 con 0x7fddac15cff0 2023-10-06T11:05:27.716 INFO:teuthology.orchestra.run.smithi151.stdout:6 2023-10-06T11:05:27.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.716+0000 7fddb3102700 1 -- 172.21.15.151:0/3631584422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fddac15cff0 msgr2=0x7fddac1534a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:27.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.716+0000 7fddb3102700 1 --2- 172.21.15.151:0/3631584422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fddac15cff0 0x7fddac1534a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdda40072f0 tx=0x7fdda4018000 comp rx=0 tx=0).stop 2023-10-06T11:05:27.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.716+0000 7fddb3102700 1 -- 172.21.15.151:0/3631584422 shutdown_connections 2023-10-06T11:05:27.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.716+0000 7fddb3102700 1 --2- 172.21.15.151:0/3631584422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fddac15cff0 0x7fddac1534a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:27.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.716+0000 7fddb3102700 1 --2- 172.21.15.151:0/3631584422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fddac0d0c50 0x7fddac0b2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:27.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.716+0000 7fddb3102700 1 --2- 172.21.15.151:0/3631584422 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fddac15cc20 0x7fddac151a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:27.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.716+0000 7fddb3102700 1 -- 172.21.15.151:0/3631584422 >> 172.21.15.151:0/3631584422 conn(0x7fddac06eba0 msgr2=0x7fddac157440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:27.718 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.716+0000 7fddb3102700 1 -- 172.21.15.151:0/3631584422 shutdown_connections 2023-10-06T11:05:27.718 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.716+0000 7fddb3102700 1 -- 172.21.15.151:0/3631584422 wait complete. 2023-10-06T11:05:27.728 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 911f8a63-3282-4197-9713-b484cc5a706f 7 2023-10-06T11:05:27.843 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.842+0000 7fcfeb8f9700 1 Processor -- start 2023-10-06T11:05:27.843 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.842+0000 7fcfeb8f9700 1 -- start start 2023-10-06T11:05:27.844 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.843+0000 7fcfeb8f9700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcfe40b2620 0x7fcfe406e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:27.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.843+0000 7fcfeb8f9700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcfe41571d0 0x7fcfe4157650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:27.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.843+0000 7fcfeb8f9700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfe40cb3c0 con 0x7fcfe40b29f0 2023-10-06T11:05:27.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.843+0000 7fcfeb8f9700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfe406fa70 con 0x7fcfe40b2620 2023-10-06T11:05:27.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.843+0000 7fcfeb8f9700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe4157b90 con 0x7fcfe41571d0 2023-10-06T11:05:27.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.843+0000 7fcfe9695700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcfe40b2620 0x7fcfe406e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:27.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.843+0000 7fcfe9e96700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcfe41571d0 0x7fcfe4157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:27.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.843+0000 7fcfe8e94700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fcfe40b29f0 0x7fcfe415bd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:42020/0 (socket says 172.21.15.151:42020) 2023-10-06T11:05:27.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.843+0000 7fcfe8e94700 1 -- 172.21.15.151:0/4193975475 learned_addr learned my addr 172.21.15.151:0/4193975475 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-10-06T11:05:27.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.843+0000 7fcfe9695700 1 -- 172.21.15.151:0/4193975475 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcfe41571d0 msgr2=0x7fcfe4157650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:27.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.843+0000 7fcfe9695700 1 --2- 172.21.15.151:0/4193975475 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcfe41571d0 0x7fcfe4157650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:27.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.843+0000 7fcfe9695700 1 -- 172.21.15.151:0/4193975475 >> v1:172.21.15.151:6789/0 conn(0x7fcfe40b29f0 legacy=0x7fcfe415bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:27.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.843+0000 7fcfe9695700 1 -- 172.21.15.151:0/4193975475 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe406eef0 con 0x7fcfe40b2620 2023-10-06T11:05:27.846 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.843+0000 7fcfdbfff700 1 -- 172.21.15.151:0/4193975475 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4105082970 0 0) 0x7fcfe40cb3c0 con 0x7fcfe40b29f0 2023-10-06T11:05:27.846 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.843+0000 7fcfe9e96700 1 --2- 172.21.15.151:0/4193975475 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcfe41571d0 0x7fcfe4157650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:05:27.846 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.844+0000 7fcfe9695700 1 --2- 172.21.15.151:0/4193975475 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcfe40b2620 0x7fcfe406e8a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcfe00098e0 tx=0x7fcfe00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffacd53ed918b99b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:27.846 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.844+0000 7fcfdbfff700 1 -- 172.21.15.151:0/4193975475 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe000b640 con 0x7fcfe40b2620 2023-10-06T11:05:27.846 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.844+0000 7fcfdbfff700 1 -- 172.21.15.151:0/4193975475 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe000b7a0 con 0x7fcfe40b2620 2023-10-06T11:05:27.846 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.844+0000 7fcfdbfff700 1 -- 172.21.15.151:0/4193975475 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe000bb40 con 0x7fcfe40b2620 2023-10-06T11:05:27.849 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.844+0000 7fcfeb8f9700 1 -- 172.21.15.151:0/4193975475 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcfe40b2620 msgr2=0x7fcfe406e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:27.849 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.844+0000 7fcfeb8f9700 1 --2- 172.21.15.151:0/4193975475 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcfe40b2620 0x7fcfe406e8a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcfe00098e0 tx=0x7fcfe00091a0 comp rx=0 tx=0).stop 2023-10-06T11:05:27.849 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.844+0000 7fcfeb8f9700 1 -- 172.21.15.151:0/4193975475 shutdown_connections 2023-10-06T11:05:27.849 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.844+0000 7fcfeb8f9700 1 --2- 172.21.15.151:0/4193975475 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcfe41571d0 0x7fcfe4157650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:27.849 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.844+0000 7fcfeb8f9700 1 --2- 172.21.15.151:0/4193975475 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcfe40b2620 0x7fcfe406e8a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:27.849 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.844+0000 7fcfeb8f9700 1 -- 172.21.15.151:0/4193975475 >> 172.21.15.151:0/4193975475 conn(0x7fcfe4068580 msgr2=0x7fcfe4068980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:27.849 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.844+0000 7fcfeb8f9700 1 -- 172.21.15.151:0/4193975475 shutdown_connections 2023-10-06T11:05:27.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.844+0000 7fcfeb8f9700 1 -- 172.21.15.151:0/4193975475 wait complete. 2023-10-06T11:05:27.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.845+0000 7fcfeb8f9700 1 Processor -- start 2023-10-06T11:05:27.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.846+0000 7fcfeb8f9700 1 -- start start 2023-10-06T11:05:27.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.846+0000 7fcfeb8f9700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcfe40b2620 0x7fcfe414ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:27.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.846+0000 7fcfeb8f9700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcfe40b29f0 0x7fcfe40cd360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:27.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.846+0000 7fcfeb8f9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfe41571d0 0x7fcfe40cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:27.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.846+0000 7fcfeb8f9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe40cc5e0 con 0x7fcfe41571d0 2023-10-06T11:05:27.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.846+0000 7fcfeb8f9700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe414f320 con 0x7fcfe40b2620 2023-10-06T11:05:27.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.846+0000 7fcfeb8f9700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe40cb730 con 0x7fcfe40b29f0 2023-10-06T11:05:27.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.846+0000 7fcfe9695700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcfe40b2620 0x7fcfe414ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:27.851 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.846+0000 7fcfe8e94700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcfe40b29f0 0x7fcfe40cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:27.851 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.846+0000 7fcfe8e94700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcfe40b29f0 0x7fcfe40cd360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:49316/0 (socket says 172.21.15.151:49316) 2023-10-06T11:05:27.851 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.846+0000 7fcfe8e94700 1 -- 172.21.15.151:0/2191721693 learned_addr learned my addr 172.21.15.151:0/2191721693 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-10-06T11:05:27.851 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.847+0000 7fcfe9e96700 1 --2- 172.21.15.151:0/2191721693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfe41571d0 0x7fcfe40cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:27.851 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.847+0000 7fcfe9695700 1 -- 172.21.15.151:0/2191721693 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcfe40b29f0 msgr2=0x7fcfe40cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:27.851 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.847+0000 7fcfe9695700 1 --2- 172.21.15.151:0/2191721693 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcfe40b29f0 0x7fcfe40cd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:27.851 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.847+0000 7fcfe9695700 1 -- 172.21.15.151:0/2191721693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfe41571d0 msgr2=0x7fcfe40cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:27.851 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.847+0000 7fcfe9695700 1 --2- 172.21.15.151:0/2191721693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfe41571d0 0x7fcfe40cd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:27.851 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.847+0000 7fcfe9695700 1 -- 172.21.15.151:0/2191721693 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfdc009a20 con 0x7fcfe40b2620 2023-10-06T11:05:27.851 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.847+0000 7fcfe8e94700 1 --2- 172.21.15.151:0/2191721693 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcfe40b29f0 0x7fcfe40cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:05:27.851 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.847+0000 7fcfe9695700 1 --2- 172.21.15.151:0/2191721693 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcfe40b2620 0x7fcfe414ede0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0016000 tx=0x7fcfe0017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:27.851 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.847+0000 7fcfd97fa700 1 -- 172.21.15.151:0/2191721693 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe0000d10 con 0x7fcfe40b2620 2023-10-06T11:05:27.852 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.847+0000 7fcfd97fa700 1 -- 172.21.15.151:0/2191721693 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe000bb20 con 0x7fcfe40b2620 2023-10-06T11:05:27.852 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.847+0000 7fcfeb8f9700 1 -- 172.21.15.151:0/2191721693 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe0009420 con 0x7fcfe40b2620 2023-10-06T11:05:27.852 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.847+0000 7fcfd97fa700 1 -- 172.21.15.151:0/2191721693 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe0011650 con 0x7fcfe40b2620 2023-10-06T11:05:27.852 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.847+0000 7fcfeb8f9700 1 -- 172.21.15.151:0/2191721693 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe40cbd30 con 0x7fcfe40b2620 2023-10-06T11:05:27.852 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.847+0000 7fcfd97fa700 1 -- 172.21.15.151:0/2191721693 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fcfe0011c80 con 0x7fcfe40b2620 2023-10-06T11:05:27.852 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.847+0000 7fcfd97fa700 1 -- 172.21.15.151:0/2191721693 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7fcfe002d3f0 con 0x7fcfe40b2620 2023-10-06T11:05:27.852 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.848+0000 7fcfeb8f9700 1 -- 172.21.15.151:0/2191721693 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe404c380 con 0x7fcfe40b2620 2023-10-06T11:05:27.852 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.850+0000 7fcfd97fa700 1 -- 172.21.15.151:0/2191721693 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fcfe0029070 con 0x7fcfe40b2620 2023-10-06T11:05:27.931 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.931+0000 7fcfeb8f9700 1 -- 172.21.15.151:0/2191721693 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd new", "uuid": "911f8a63-3282-4197-9713-b484cc5a706f", "id": 7} v 0) v1 -- 0x7fcfe40c9d00 con 0x7fcfe40b2620 2023-10-06T11:05:27.939 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.939+0000 7fcfd97fa700 1 -- 172.21.15.151:0/2191721693 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "911f8a63-3282-4197-9713-b484cc5a706f", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcfe0015020 con 0x7fcfe40b2620 2023-10-06T11:05:27.940 INFO:teuthology.orchestra.run.smithi151.stdout:7 2023-10-06T11:05:27.941 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.940+0000 7fcfeb8f9700 1 -- 172.21.15.151:0/2191721693 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcfe40b2620 msgr2=0x7fcfe414ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:27.941 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.940+0000 7fcfeb8f9700 1 --2- 172.21.15.151:0/2191721693 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcfe40b2620 0x7fcfe414ede0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0016000 tx=0x7fcfe0017000 comp rx=0 tx=0).stop 2023-10-06T11:05:27.941 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.940+0000 7fcfeb8f9700 1 -- 172.21.15.151:0/2191721693 shutdown_connections 2023-10-06T11:05:27.941 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.940+0000 7fcfeb8f9700 1 --2- 172.21.15.151:0/2191721693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfe41571d0 0x7fcfe40cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:27.941 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.940+0000 7fcfeb8f9700 1 --2- 172.21.15.151:0/2191721693 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcfe40b2620 0x7fcfe414ede0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:27.941 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.940+0000 7fcfeb8f9700 1 --2- 172.21.15.151:0/2191721693 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcfe40b29f0 0x7fcfe40cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:27.941 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.940+0000 7fcfeb8f9700 1 -- 172.21.15.151:0/2191721693 >> 172.21.15.151:0/2191721693 conn(0x7fcfe4068580 msgr2=0x7fcfe4153530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:27.941 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.940+0000 7fcfeb8f9700 1 -- 172.21.15.151:0/2191721693 shutdown_connections 2023-10-06T11:05:27.941 INFO:teuthology.orchestra.run.smithi151.stderr:2023-10-06T11:05:27.940+0000 7fcfeb8f9700 1 -- 172.21.15.151:0/2191721693 wait complete. 2023-10-06T11:05:27.952 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-06T11:05:27.953 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-06T11:05:27.954 INFO:tasks.ceph.osd.0:Started 2023-10-06T11:05:27.955 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-06T11:05:27.955 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-06T11:05:27.956 INFO:tasks.ceph.osd.1:Started 2023-10-06T11:05:27.957 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-06T11:05:27.957 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-06T11:05:27.959 INFO:tasks.ceph.osd.2:Started 2023-10-06T11:05:27.959 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-06T11:05:27.959 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-06T11:05:27.961 INFO:tasks.ceph.osd.3:Started 2023-10-06T11:05:27.961 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-06T11:05:27.961 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-06T11:05:27.963 INFO:tasks.ceph.osd.4:Started 2023-10-06T11:05:27.963 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-06T11:05:27.963 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-06T11:05:27.965 INFO:tasks.ceph.osd.5:Started 2023-10-06T11:05:27.965 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-06T11:05:27.965 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-06T11:05:27.967 INFO:tasks.ceph.osd.6:Started 2023-10-06T11:05:27.967 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-06T11:05:27.967 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-06T11:05:27.969 INFO:tasks.ceph.osd.7:Started 2023-10-06T11:05:27.969 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:05:28.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.115+0000 7f413811d700 1 Processor -- start 2023-10-06T11:05:28.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.116+0000 7f413811d700 1 -- start start 2023-10-06T11:05:28.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.117+0000 7f413811d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4130068ba0 0x7f413015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:28.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.117+0000 7f413811d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4130153e80 0x7f41300b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:28.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.117+0000 7f413811d700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f413015ac30 con 0x7f4130153ab0 2023-10-06T11:05:28.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.117+0000 7f413811d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41300b4510 con 0x7f4130068ba0 2023-10-06T11:05:28.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.117+0000 7f413811d700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41300b6530 con 0x7f4130153e80 2023-10-06T11:05:28.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.117+0000 7f41356b8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4130068ba0 0x7f413015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:28.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.117+0000 7f41356b8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4130068ba0 0x7f413015a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42590/0 (socket says 172.21.15.146:42590) 2023-10-06T11:05:28.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.117+0000 7f41356b8700 1 -- 172.21.15.146:0/3216976953 learned_addr learned my addr 172.21.15.146:0/3216976953 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:28.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.117+0000 7f41366ba700 1 --2- 172.21.15.146:0/3216976953 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4130153e80 0x7f41300b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:28.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.117+0000 7f41356b8700 1 -- 172.21.15.146:0/3216976953 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4130153e80 msgr2=0x7f41300b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:28.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.117+0000 7f41356b8700 1 --2- 172.21.15.146:0/3216976953 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4130153e80 0x7f41300b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:28.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.117+0000 7f41356b8700 1 -- 172.21.15.146:0/3216976953 >> v1:172.21.15.151:6789/0 conn(0x7f4130153ab0 legacy=0x7f4130068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:28.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.117+0000 7f41356b8700 1 -- 172.21.15.146:0/3216976953 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41300b5c50 con 0x7f4130068ba0 2023-10-06T11:05:28.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.117+0000 7f4134eb7700 1 -- 172.21.15.146:0/3216976953 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2764313504 0 0) 0x7f4120001110 con 0x7f4130153ab0 2023-10-06T11:05:28.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.117+0000 7f41366ba700 1 --2- 172.21.15.146:0/3216976953 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4130153e80 0x7f41300b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:05:28.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.117+0000 7f41356b8700 1 --2- 172.21.15.146:0/3216976953 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4130068ba0 0x7f413015a6f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f412c0099b0 tx=0x7f412c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=304a4666f77fc39b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:28.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.117+0000 7f4134eb7700 1 -- 172.21.15.146:0/3216976953 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412c009ea0 con 0x7f4130068ba0 2023-10-06T11:05:28.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.117+0000 7f4134eb7700 1 -- 172.21.15.146:0/3216976953 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f412c00b860 con 0x7f4130068ba0 2023-10-06T11:05:28.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.117+0000 7f4134eb7700 1 -- 172.21.15.146:0/3216976953 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412c00bc00 con 0x7f4130068ba0 2023-10-06T11:05:28.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.118+0000 7f413811d700 1 -- 172.21.15.146:0/3216976953 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4130068ba0 msgr2=0x7f413015a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:28.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.118+0000 7f413811d700 1 --2- 172.21.15.146:0/3216976953 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4130068ba0 0x7f413015a6f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f412c0099b0 tx=0x7f412c009250 comp rx=0 tx=0).stop 2023-10-06T11:05:28.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.118+0000 7f413811d700 1 -- 172.21.15.146:0/3216976953 shutdown_connections 2023-10-06T11:05:28.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.118+0000 7f413811d700 1 --2- 172.21.15.146:0/3216976953 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4130153e80 0x7f41300b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:28.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.118+0000 7f413811d700 1 --2- 172.21.15.146:0/3216976953 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4130068ba0 0x7f413015a6f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:28.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.118+0000 7f413811d700 1 -- 172.21.15.146:0/3216976953 >> 172.21.15.146:0/3216976953 conn(0x7f413006eba0 msgr2=0x7f413006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:28.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.118+0000 7f413811d700 1 -- 172.21.15.146:0/3216976953 shutdown_connections 2023-10-06T11:05:28.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.118+0000 7f413811d700 1 -- 172.21.15.146:0/3216976953 wait complete. 2023-10-06T11:05:28.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.119+0000 7f413811d700 1 Processor -- start 2023-10-06T11:05:28.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.119+0000 7f413811d700 1 -- start start 2023-10-06T11:05:28.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.120+0000 7f413811d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4130068ba0 0x7f413014fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:28.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.120+0000 7f413811d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4130153ab0 0x7f41301699e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:28.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.120+0000 7f413811d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4130153e80 0x7f4130158d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:28.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.120+0000 7f413811d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4130159270 con 0x7f4130153ab0 2023-10-06T11:05:28.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.120+0000 7f413811d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4130154db0 con 0x7f4130153e80 2023-10-06T11:05:28.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.120+0000 7f413811d700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f413016a020 con 0x7f4130068ba0 2023-10-06T11:05:28.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.120+0000 7f41356b8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4130153ab0 0x7f41301699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:28.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.120+0000 7f41356b8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4130153ab0 0x7f41301699e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42592/0 (socket says 172.21.15.146:42592) 2023-10-06T11:05:28.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.120+0000 7f41356b8700 1 -- 172.21.15.146:0/1450025833 learned_addr learned my addr 172.21.15.146:0/1450025833 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:28.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.120+0000 7f4135eb9700 1 --2- 172.21.15.146:0/1450025833 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4130068ba0 0x7f413014fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:28.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.120+0000 7f41366ba700 1 --2- 172.21.15.146:0/1450025833 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4130153e80 0x7f4130158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:28.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.120+0000 7f41356b8700 1 -- 172.21.15.146:0/1450025833 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4130068ba0 msgr2=0x7f413014fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:28.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.120+0000 7f41356b8700 1 --2- 172.21.15.146:0/1450025833 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4130068ba0 0x7f413014fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:28.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.120+0000 7f41356b8700 1 -- 172.21.15.146:0/1450025833 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4130153e80 msgr2=0x7f4130158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:28.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.120+0000 7f41356b8700 1 --2- 172.21.15.146:0/1450025833 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4130153e80 0x7f4130158d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:28.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.120+0000 7f41356b8700 1 -- 172.21.15.146:0/1450025833 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4128009a20 con 0x7f4130153ab0 2023-10-06T11:05:28.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.120+0000 7f41356b8700 1 --2- 172.21.15.146:0/1450025833 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4130153ab0 0x7f41301699e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4130089010 tx=0x7f412c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:28.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.121+0000 7f4125ffb700 1 -- 172.21.15.146:0/1450025833 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412c00bbe0 con 0x7f4130153ab0 2023-10-06T11:05:28.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.121+0000 7f4125ffb700 1 -- 172.21.15.146:0/1450025833 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f412c011420 con 0x7f4130153ab0 2023-10-06T11:05:28.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.121+0000 7f413811d700 1 -- 172.21.15.146:0/1450025833 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f412c0094f0 con 0x7f4130153ab0 2023-10-06T11:05:28.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.121+0000 7f4125ffb700 1 -- 172.21.15.146:0/1450025833 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412c0117e0 con 0x7f4130153ab0 2023-10-06T11:05:28.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.121+0000 7f413811d700 1 -- 172.21.15.146:0/1450025833 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f413016a5e0 con 0x7f4130153ab0 2023-10-06T11:05:28.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.121+0000 7f4125ffb700 1 -- 172.21.15.146:0/1450025833 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f412c02e3f0 con 0x7f4130153ab0 2023-10-06T11:05:28.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.121+0000 7f4125ffb700 1 -- 172.21.15.146:0/1450025833 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f412c011e10 con 0x7f4130153ab0 2023-10-06T11:05:28.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.122+0000 7f413811d700 1 -- 172.21.15.146:0/1450025833 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4130154f20 con 0x7f4130153ab0 2023-10-06T11:05:28.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.124+0000 7f4125ffb700 1 -- 172.21.15.146:0/1450025833 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f4130154f20 con 0x7f4130153ab0 2023-10-06T11:05:28.159 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-10-06T11:05:28.158+0000 7fe765121180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T11:05:28.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.193+0000 7f413811d700 1 -- 172.21.15.146:0/1450025833 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f413004c380 con 0x7f4130153ab0 2023-10-06T11:05:28.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.193+0000 7f4125ffb700 1 -- 172.21.15.146:0/1450025833 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f412c033060 con 0x7f4130153ab0 2023-10-06T11:05:28.195 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:05:28.195 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":10,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:05:27.932211+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:05:28.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.195+0000 7f413811d700 1 -- 172.21.15.146:0/1450025833 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4130153ab0 msgr2=0x7f41301699e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:28.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.195+0000 7f413811d700 1 --2- 172.21.15.146:0/1450025833 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4130153ab0 0x7f41301699e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4130089010 tx=0x7f412c017000 comp rx=0 tx=0).stop 2023-10-06T11:05:28.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.195+0000 7f413811d700 1 -- 172.21.15.146:0/1450025833 shutdown_connections 2023-10-06T11:05:28.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.195+0000 7f413811d700 1 --2- 172.21.15.146:0/1450025833 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4130153e80 0x7f4130158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:28.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.195+0000 7f413811d700 1 --2- 172.21.15.146:0/1450025833 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4130068ba0 0x7f413014fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:28.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.195+0000 7f413811d700 1 --2- 172.21.15.146:0/1450025833 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4130153ab0 0x7f41301699e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:28.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.195+0000 7f413811d700 1 -- 172.21.15.146:0/1450025833 >> 172.21.15.146:0/1450025833 conn(0x7f413006eba0 msgr2=0x7f41300d0060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:28.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.195+0000 7f413811d700 1 -- 172.21.15.146:0/1450025833 shutdown_connections 2023-10-06T11:05:28.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:28.195+0000 7f413811d700 1 -- 172.21.15.146:0/1450025833 wait complete. 2023-10-06T11:05:28.213 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-06T11:05:28.213 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-06T11:05:28.232 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-06T11:05:28.232+0000 7fc655002180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T11:05:28.246 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-10-06T11:05:28.244+0000 7fe765121180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T11:05:28.310 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-06T11:05:28.309+0000 7fc655002180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T11:05:28.324 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-10-06T11:05:28.323+0000 7fe765121180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T11:05:28.330 INFO:tasks.ceph.osd.1.smithi146.stderr:2023-10-06T11:05:28.328+0000 7f7824a36540 -1 Falling back to public interface 2023-10-06T11:05:28.388 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-06T11:05:28.387+0000 7fc655002180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T11:05:28.556 INFO:tasks.ceph.osd.0.smithi146.stderr:2023-10-06T11:05:28.554+0000 7f6a3f4cc540 -1 Falling back to public interface 2023-10-06T11:05:28.567 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-10-06T11:05:28.566+0000 7fb9bf9f5540 -1 Falling back to public interface 2023-10-06T11:05:28.574 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-10-06T11:05:28.573+0000 7f5cebeb7540 -1 Falling back to public interface 2023-10-06T11:05:28.576 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-10-06T11:05:28.575+0000 7f1bfe2ad540 -1 Falling back to public interface 2023-10-06T11:05:28.576 INFO:tasks.ceph.osd.2.smithi146.stderr:2023-10-06T11:05:28.574+0000 7f70aa61e540 -1 Falling back to public interface 2023-10-06T11:05:28.584 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-10-06T11:05:28.583+0000 7f4296ebb540 -1 Falling back to public interface 2023-10-06T11:05:28.595 INFO:tasks.ceph.osd.3.smithi146.stderr:2023-10-06T11:05:28.593+0000 7f792ad6a540 -1 Falling back to public interface 2023-10-06T11:05:28.919 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-10-06T11:05:28.918+0000 7fe765121180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-06T11:05:28.956 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-06T11:05:28.956+0000 7fc655002180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-06T11:05:29.019 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T11:05:29.059 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-10-06T11:05:29.057+0000 7fe765121180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T11:05:29.093 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-06T11:05:29.093+0000 7fc655002180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T11:05:29.127 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.125+0000 7f59aedfb700 1 Processor -- start 2023-10-06T11:05:29.127 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.125+0000 7f59aedfb700 1 -- start start 2023-10-06T11:05:29.129 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.126+0000 7f59aedfb700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f59a80ccae0 0x7f59a80c4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:29.129 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.126+0000 7f59aedfb700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f59a80cd5f0 0x7f59a8159220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:29.129 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.126+0000 7f59aedfb700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59a80cafd0 con 0x7f59a80cd220 2023-10-06T11:05:29.130 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.126+0000 7f59aedfb700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59a80cbe30 con 0x7f59a80ccae0 2023-10-06T11:05:29.130 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.126+0000 7f59aedfb700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a80cb220 con 0x7f59a80cd5f0 2023-10-06T11:05:29.130 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.126+0000 7f59a7fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f59a80ccae0 0x7f59a80c4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:29.130 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.126+0000 7f59acb97700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f59a80cd220 0x7f59a80cc3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:43076/0 (socket says 172.21.15.146:43076) 2023-10-06T11:05:29.130 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.126+0000 7f59a7fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f59a80ccae0 0x7f59a80c4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42602/0 (socket says 172.21.15.146:42602) 2023-10-06T11:05:29.130 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.126+0000 7f59acb97700 1 -- 172.21.15.146:0/943062255 learned_addr learned my addr 172.21.15.146:0/943062255 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:05:29.130 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.126+0000 7f59ad398700 1 --2- 172.21.15.146:0/943062255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f59a80cd5f0 0x7f59a8159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:29.130 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.126+0000 7f59a7fff700 1 -- 172.21.15.146:0/943062255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f59a80cd5f0 msgr2=0x7f59a8159220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:29.130 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.126+0000 7f59a7fff700 1 --2- 172.21.15.146:0/943062255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f59a80cd5f0 0x7f59a8159220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:29.130 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.126+0000 7f59a7fff700 1 -- 172.21.15.146:0/943062255 >> v1:172.21.15.146:6789/0 conn(0x7f59a80cd220 legacy=0x7f59a80cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:29.130 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.126+0000 7f59a7fff700 1 -- 172.21.15.146:0/943062255 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a80cb500 con 0x7f59a80ccae0 2023-10-06T11:05:29.130 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.126+0000 7f59a77fe700 1 -- 172.21.15.146:0/943062255 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2396600017 0 0) 0x7f59a80cafd0 con 0x7f59a80cd220 2023-10-06T11:05:29.131 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.126+0000 7f59a7fff700 1 --2- 172.21.15.146:0/943062255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59a80ccae0 0x7f59a80c4050 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f59940098e0 tx=0x7f59940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb6989df2e120689 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:29.131 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.126+0000 7f59a77fe700 1 -- 172.21.15.146:0/943062255 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599400b640 con 0x7f59a80ccae0 2023-10-06T11:05:29.131 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.126+0000 7f59a77fe700 1 -- 172.21.15.146:0/943062255 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f599400b7a0 con 0x7f59a80ccae0 2023-10-06T11:05:29.131 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.126+0000 7f59a77fe700 1 -- 172.21.15.146:0/943062255 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599400bb40 con 0x7f59a80ccae0 2023-10-06T11:05:29.131 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.127+0000 7f59aedfb700 1 -- 172.21.15.146:0/943062255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59a80ccae0 msgr2=0x7f59a80c4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:29.131 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.127+0000 7f59aedfb700 1 --2- 172.21.15.146:0/943062255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59a80ccae0 0x7f59a80c4050 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f59940098e0 tx=0x7f59940091a0 comp rx=0 tx=0).stop 2023-10-06T11:05:29.131 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.127+0000 7f59aedfb700 1 -- 172.21.15.146:0/943062255 shutdown_connections 2023-10-06T11:05:29.131 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.127+0000 7f59aedfb700 1 --2- 172.21.15.146:0/943062255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f59a80cd5f0 0x7f59a8159220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:29.131 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.127+0000 7f59aedfb700 1 --2- 172.21.15.146:0/943062255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59a80ccae0 0x7f59a80c4050 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:29.131 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.127+0000 7f59aedfb700 1 -- 172.21.15.146:0/943062255 >> 172.21.15.146:0/943062255 conn(0x7f59a806ebf0 msgr2=0x7f59a806eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:29.131 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.127+0000 7f59aedfb700 1 -- 172.21.15.146:0/943062255 shutdown_connections 2023-10-06T11:05:29.131 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.127+0000 7f59aedfb700 1 -- 172.21.15.146:0/943062255 wait complete. 2023-10-06T11:05:29.131 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.128+0000 7f59aedfb700 1 Processor -- start 2023-10-06T11:05:29.134 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.128+0000 7f59aedfb700 1 -- start start 2023-10-06T11:05:29.134 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.129+0000 7f59aedfb700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f59a80ccae0 0x7f59a816caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:29.134 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.129+0000 7f59aedfb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59a80cd220 0x7f59a8155fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:29.134 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.129+0000 7f59aedfb700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59a80cd5f0 0x7f59a8157c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:29.134 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.129+0000 7f59aedfb700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a8152890 con 0x7f59a80cd220 2023-10-06T11:05:29.134 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.129+0000 7f59aedfb700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a816d030 con 0x7f59a80cd5f0 2023-10-06T11:05:29.134 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.129+0000 7f59aedfb700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a8159370 con 0x7f59a80ccae0 2023-10-06T11:05:29.134 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.129+0000 7f59a7fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59a80cd220 0x7f59a8155fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:29.134 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.129+0000 7f59a7fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59a80cd220 0x7f59a8155fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42612/0 (socket says 172.21.15.146:42612) 2023-10-06T11:05:29.134 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.129+0000 7f59a7fff700 1 -- 172.21.15.146:0/609121417 learned_addr learned my addr 172.21.15.146:0/609121417 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:29.135 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.129+0000 7f59acb97700 1 --2- 172.21.15.146:0/609121417 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f59a80ccae0 0x7f59a816caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:29.135 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.129+0000 7f59ad398700 1 --2- 172.21.15.146:0/609121417 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59a80cd5f0 0x7f59a8157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:29.135 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.129+0000 7f59a7fff700 1 -- 172.21.15.146:0/609121417 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f59a80ccae0 msgr2=0x7f59a816caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:29.135 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.129+0000 7f59a7fff700 1 --2- 172.21.15.146:0/609121417 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f59a80ccae0 0x7f59a816caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:29.135 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.129+0000 7f59a7fff700 1 -- 172.21.15.146:0/609121417 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59a80cd5f0 msgr2=0x7f59a8157c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:29.135 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.129+0000 7f59a7fff700 1 --2- 172.21.15.146:0/609121417 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59a80cd5f0 0x7f59a8157c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:29.135 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.129+0000 7f59a7fff700 1 -- 172.21.15.146:0/609121417 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5994009420 con 0x7f59a80cd220 2023-10-06T11:05:29.135 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.129+0000 7f59a7fff700 1 --2- 172.21.15.146:0/609121417 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59a80cd220 0x7f59a8155fd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f59a8070ec0 tx=0x7f5994017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:29.135 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.130+0000 7f59a4ff9700 1 -- 172.21.15.146:0/609121417 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599400bb20 con 0x7f59a80cd220 2023-10-06T11:05:29.135 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.130+0000 7f59a4ff9700 1 -- 172.21.15.146:0/609121417 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5994000c90 con 0x7f59a80cd220 2023-10-06T11:05:29.135 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.130+0000 7f59aedfb700 1 -- 172.21.15.146:0/609121417 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59a8158ad0 con 0x7f59a80cd220 2023-10-06T11:05:29.135 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.130+0000 7f59a4ff9700 1 -- 172.21.15.146:0/609121417 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5994011630 con 0x7f59a80cd220 2023-10-06T11:05:29.136 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.130+0000 7f59aedfb700 1 -- 172.21.15.146:0/609121417 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59a8159090 con 0x7f59a80cd220 2023-10-06T11:05:29.136 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.130+0000 7f59a4ff9700 1 -- 172.21.15.146:0/609121417 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f5994011c60 con 0x7f59a80cd220 2023-10-06T11:05:29.136 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.130+0000 7f59a4ff9700 1 -- 172.21.15.146:0/609121417 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f599402d3f0 con 0x7f59a80cd220 2023-10-06T11:05:29.136 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.131+0000 7f59aedfb700 1 -- 172.21.15.146:0/609121417 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59a8063280 con 0x7f59a80cd220 2023-10-06T11:05:29.136 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.133+0000 7f59a4ff9700 1 -- 172.21.15.146:0/609121417 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f59940436d0 con 0x7f59a80cd220 2023-10-06T11:05:29.161 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-10-06T11:05:29.159+0000 7fe765121180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T11:05:29.188 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-06T11:05:29.187+0000 7fc655002180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T11:05:29.219 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.217+0000 7f59aedfb700 1 -- 172.21.15.146:0/609121417 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59a8153a30 con 0x7f59a80cd220 2023-10-06T11:05:29.220 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.218+0000 7f59a4ff9700 1 -- 172.21.15.146:0/609121417 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f5994032070 con 0x7f59a80cd220 2023-10-06T11:05:29.221 INFO:teuthology.misc.health.smithi146.stdout: 2023-10-06T11:05:29.221 INFO:teuthology.misc.health.smithi146.stdout:{"epoch":10,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:05:27.932211+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:05:29.222 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.219+0000 7f59aedfb700 1 -- 172.21.15.146:0/609121417 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59a80cd220 msgr2=0x7f59a8155fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:29.222 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.219+0000 7f59aedfb700 1 --2- 172.21.15.146:0/609121417 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59a80cd220 0x7f59a8155fd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f59a8070ec0 tx=0x7f5994017000 comp rx=0 tx=0).stop 2023-10-06T11:05:29.222 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.219+0000 7f59aedfb700 1 -- 172.21.15.146:0/609121417 shutdown_connections 2023-10-06T11:05:29.222 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.219+0000 7f59aedfb700 1 --2- 172.21.15.146:0/609121417 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59a80cd5f0 0x7f59a8157c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:29.222 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.219+0000 7f59aedfb700 1 --2- 172.21.15.146:0/609121417 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f59a80ccae0 0x7f59a816caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:29.222 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.219+0000 7f59aedfb700 1 --2- 172.21.15.146:0/609121417 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59a80cd220 0x7f59a8155fd0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:29.222 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.219+0000 7f59aedfb700 1 -- 172.21.15.146:0/609121417 >> 172.21.15.146:0/609121417 conn(0x7f59a806ebf0 msgr2=0x7f59a80cfc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:29.222 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.219+0000 7f59aedfb700 1 -- 172.21.15.146:0/609121417 shutdown_connections 2023-10-06T11:05:29.223 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:29.219+0000 7f59aedfb700 1 -- 172.21.15.146:0/609121417 wait complete. 2023-10-06T11:05:29.232 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-06T11:05:29.425 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-10-06T11:05:29.423+0000 7fe765121180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-06T11:05:29.438 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-06T11:05:29.437+0000 7fc655002180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-06T11:05:29.503 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-10-06T11:05:29.502+0000 7fe765121180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T11:05:29.516 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-06T11:05:29.514+0000 7fc655002180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T11:05:30.345 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-10-06T11:05:30.343+0000 7fe765121180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-06T11:05:30.354 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-06T11:05:30.353+0000 7fc655002180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-06T11:05:30.418 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-10-06T11:05:30.417+0000 7fe765121180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T11:05:30.427 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-06T11:05:30.427+0000 7fc655002180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T11:05:30.494 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-10-06T11:05:30.492+0000 7fe765121180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T11:05:30.502 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-06T11:05:30.502+0000 7fc655002180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T11:05:30.629 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-10-06T11:05:30.627+0000 7fe765121180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T11:05:30.637 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-06T11:05:30.636+0000 7fc655002180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T11:05:30.714 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-10-06T11:05:30.713+0000 7fe765121180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T11:05:30.721 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-06T11:05:30.721+0000 7fc655002180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T11:05:30.870 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-10-06T11:05:30.869+0000 7fe765121180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T11:05:30.876 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-06T11:05:30.876+0000 7fc655002180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T11:05:30.947 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-10-06T11:05:30.945+0000 7fe765121180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T11:05:30.952 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-06T11:05:30.952+0000 7fc655002180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T11:05:31.023 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-10-06T11:05:31.021+0000 7fe765121180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T11:05:31.029 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-06T11:05:31.029+0000 7fc655002180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T11:05:31.108 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-10-06T11:05:31.106+0000 7fe765121180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T11:05:31.111 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-10-06T11:05:31.110+0000 7fc655002180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T11:05:31.821 INFO:tasks.ceph.osd.1.smithi146.stderr:2023-10-06T11:05:31.819+0000 7f7824a36540 -1 osd.1 0 log_to_monitors true 2023-10-06T11:05:32.068 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-10-06T11:05:32.067+0000 7fb9bf9f5540 -1 osd.5 0 log_to_monitors true 2023-10-06T11:05:32.069 INFO:tasks.ceph.osd.2.smithi146.stderr:2023-10-06T11:05:32.067+0000 7f70aa61e540 -1 osd.2 0 log_to_monitors true 2023-10-06T11:05:32.112 INFO:tasks.ceph.osd.0.smithi146.stderr:2023-10-06T11:05:32.110+0000 7f6a3f4cc540 -1 osd.0 0 log_to_monitors true 2023-10-06T11:05:32.115 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-10-06T11:05:32.113+0000 7f1bfe2ad540 -1 osd.4 0 log_to_monitors true 2023-10-06T11:05:32.122 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-10-06T11:05:32.121+0000 7f4296ebb540 -1 osd.6 0 log_to_monitors true 2023-10-06T11:05:32.133 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-10-06T11:05:32.132+0000 7fe71e524700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-06T11:05:32.133 INFO:tasks.ceph.mgr.y.smithi146.stderr:2023-10-06T11:05:32.132+0000 7fe71e524700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-06T11:05:32.135 INFO:tasks.ceph.osd.3.smithi146.stderr:2023-10-06T11:05:32.134+0000 7f792ad6a540 -1 osd.3 0 log_to_monitors true 2023-10-06T11:05:32.151 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-10-06T11:05:32.150+0000 7f5cebeb7540 -1 osd.7 0 log_to_monitors true 2023-10-06T11:05:35.301 INFO:tasks.ceph.osd.3.smithi146.stderr:2023-10-06T11:05:35.299+0000 7f792198c700 -1 osd.3 0 waiting for initial osdmap 2023-10-06T11:05:35.307 INFO:tasks.ceph.osd.3.smithi146.stderr:2023-10-06T11:05:35.306+0000 7f791a783700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T11:05:35.330 INFO:tasks.ceph.osd.0.smithi146.stderr:2023-10-06T11:05:35.328+0000 7f6a360ee700 -1 osd.0 0 waiting for initial osdmap 2023-10-06T11:05:35.334 INFO:tasks.ceph.osd.0.smithi146.stderr:2023-10-06T11:05:35.332+0000 7f6a2eee5700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T11:05:35.342 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-10-06T11:05:35.341+0000 7f1bf4ecf700 -1 osd.4 0 waiting for initial osdmap 2023-10-06T11:05:35.345 INFO:tasks.ceph.osd.1.smithi146.stderr:2023-10-06T11:05:35.343+0000 7f781b658700 -1 osd.1 0 waiting for initial osdmap 2023-10-06T11:05:35.350 INFO:tasks.ceph.osd.1.smithi146.stderr:2023-10-06T11:05:35.349+0000 7f781444f700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T11:05:35.353 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-10-06T11:05:35.348+0000 7f1bedcc6700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T11:05:35.365 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-10-06T11:05:35.363+0000 7f5ce2ad9700 -1 osd.7 0 waiting for initial osdmap 2023-10-06T11:05:35.369 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-10-06T11:05:35.368+0000 7f5cdb8d0700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T11:05:35.391 INFO:tasks.ceph.osd.2.smithi146.stderr:2023-10-06T11:05:35.389+0000 7f70a1240700 -1 osd.2 0 waiting for initial osdmap 2023-10-06T11:05:35.394 INFO:tasks.ceph.osd.2.smithi146.stderr:2023-10-06T11:05:35.393+0000 7f709a037700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T11:05:35.395 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-10-06T11:05:35.394+0000 7fb9b6617700 -1 osd.5 0 waiting for initial osdmap 2023-10-06T11:05:35.400 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-10-06T11:05:35.398+0000 7f428f2e0700 -1 osd.6 0 waiting for initial osdmap 2023-10-06T11:05:35.400 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-10-06T11:05:35.399+0000 7fb9af40e700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T11:05:35.406 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-10-06T11:05:35.405+0000 7f42868d4700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T11:05:36.039 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T11:05:36.144 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.142+0000 7fa103fff700 1 Processor -- start 2023-10-06T11:05:36.144 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.142+0000 7fa103fff700 1 -- start start 2023-10-06T11:05:36.146 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.143+0000 7fa103fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa104068be0 0x7fa104156a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:36.146 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.143+0000 7fa103fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa104156f90 0x7fa1040ad3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:36.147 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.143+0000 7fa103fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1040c9510 con 0x7fa104153d10 2023-10-06T11:05:36.147 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.143+0000 7fa103fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1041577a0 con 0x7fa104068be0 2023-10-06T11:05:36.147 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.143+0000 7fa103fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa10415aca0 con 0x7fa104156f90 2023-10-06T11:05:36.147 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.143+0000 7fa0fa7fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa104068be0 0x7fa104156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:36.147 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.143+0000 7fa102ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa104153d10 0x7fa1040684d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38262/0 (socket says 172.21.15.146:38262) 2023-10-06T11:05:36.147 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.143+0000 7fa102ffd700 1 -- 172.21.15.146:0/2012566772 learned_addr learned my addr 172.21.15.146:0/2012566772 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:05:36.147 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.143+0000 7fa1037fe700 1 --2- 172.21.15.146:0/2012566772 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa104156f90 0x7fa1040ad3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:36.147 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.143+0000 7fa0fa7fc700 1 -- 172.21.15.146:0/2012566772 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa104156f90 msgr2=0x7fa1040ad3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:36.147 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.143+0000 7fa0fa7fc700 1 --2- 172.21.15.146:0/2012566772 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa104156f90 0x7fa1040ad3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:36.147 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.143+0000 7fa0fa7fc700 1 -- 172.21.15.146:0/2012566772 >> v1:172.21.15.146:6789/0 conn(0x7fa104153d10 legacy=0x7fa1040684d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:36.148 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.143+0000 7fa0fa7fc700 1 -- 172.21.15.146:0/2012566772 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa10415a810 con 0x7fa104068be0 2023-10-06T11:05:36.148 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.144+0000 7fa0fa7fc700 1 --2- 172.21.15.146:0/2012566772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa104068be0 0x7fa104156a50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec009910 tx=0x7fa0ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a05ceee4e91ead3b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:36.148 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.144+0000 7fa1027fc700 1 -- 172.21.15.146:0/2012566772 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec00b820 con 0x7fa104068be0 2023-10-06T11:05:36.148 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.144+0000 7fa1027fc700 1 -- 172.21.15.146:0/2012566772 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0ec00b980 con 0x7fa104068be0 2023-10-06T11:05:36.148 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.144+0000 7fa1027fc700 1 -- 172.21.15.146:0/2012566772 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0ec00bd20 con 0x7fa104068be0 2023-10-06T11:05:36.148 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.144+0000 7fa103fff700 1 -- 172.21.15.146:0/2012566772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa104068be0 msgr2=0x7fa104156a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:36.148 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.144+0000 7fa103fff700 1 --2- 172.21.15.146:0/2012566772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa104068be0 0x7fa104156a50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec009910 tx=0x7fa0ec0091a0 comp rx=0 tx=0).stop 2023-10-06T11:05:36.148 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.144+0000 7fa103fff700 1 -- 172.21.15.146:0/2012566772 shutdown_connections 2023-10-06T11:05:36.148 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.144+0000 7fa103fff700 1 --2- 172.21.15.146:0/2012566772 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa104156f90 0x7fa1040ad3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:36.148 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.144+0000 7fa103fff700 1 --2- 172.21.15.146:0/2012566772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa104068be0 0x7fa104156a50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:36.149 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.144+0000 7fa103fff700 1 -- 172.21.15.146:0/2012566772 >> 172.21.15.146:0/2012566772 conn(0x7fa10406db00 msgr2=0x7fa10406ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:36.149 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.144+0000 7fa103fff700 1 -- 172.21.15.146:0/2012566772 shutdown_connections 2023-10-06T11:05:36.149 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.144+0000 7fa103fff700 1 -- 172.21.15.146:0/2012566772 wait complete. 2023-10-06T11:05:36.152 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.146+0000 7fa103fff700 1 Processor -- start 2023-10-06T11:05:36.152 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.146+0000 7fa103fff700 1 -- start start 2023-10-06T11:05:36.152 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.146+0000 7fa103fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa104068be0 0x7fa104155660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:36.152 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.146+0000 7fa103fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa104153d10 0x7fa104166fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:36.152 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.146+0000 7fa103fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa104156f90 0x7fa1040a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:36.152 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.146+0000 7fa103fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa104150b10 con 0x7fa104156f90 2023-10-06T11:05:36.152 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.146+0000 7fa103fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1041545c0 con 0x7fa104153d10 2023-10-06T11:05:36.152 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.146+0000 7fa103fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1041548a0 con 0x7fa104068be0 2023-10-06T11:05:36.152 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.146+0000 7fa1037fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa104156f90 0x7fa1040a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:36.153 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.146+0000 7fa1037fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa104156f90 0x7fa1040a5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50080/0 (socket says 172.21.15.146:50080) 2023-10-06T11:05:36.153 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.147+0000 7fa1037fe700 1 -- 172.21.15.146:0/3473777005 learned_addr learned my addr 172.21.15.146:0/3473777005 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:36.153 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.147+0000 7fa0fa7fc700 1 --2- 172.21.15.146:0/3473777005 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa104153d10 0x7fa104166fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:36.153 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.147+0000 7fa102ffd700 1 --2- 172.21.15.146:0/3473777005 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa104068be0 0x7fa104155660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:36.153 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.147+0000 7fa1037fe700 1 -- 172.21.15.146:0/3473777005 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa104068be0 msgr2=0x7fa104155660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:36.153 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.147+0000 7fa1037fe700 1 --2- 172.21.15.146:0/3473777005 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa104068be0 0x7fa104155660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:36.153 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.147+0000 7fa1037fe700 1 -- 172.21.15.146:0/3473777005 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa104153d10 msgr2=0x7fa104166fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:36.153 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.147+0000 7fa1037fe700 1 --2- 172.21.15.146:0/3473777005 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa104153d10 0x7fa104166fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:36.153 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.147+0000 7fa1037fe700 1 -- 172.21.15.146:0/3473777005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0ec009420 con 0x7fa104156f90 2023-10-06T11:05:36.153 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.147+0000 7fa0fa7fc700 1 --2- 172.21.15.146:0/3473777005 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa104153d10 0x7fa104166fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:05:36.154 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.147+0000 7fa1037fe700 1 --2- 172.21.15.146:0/3473777005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa104156f90 0x7fa1040a5700 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc00ceb0 tx=0x7fa0fc007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:36.154 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.147+0000 7fa0fb7fe700 1 -- 172.21.15.146:0/3473777005 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc00ae40 con 0x7fa104156f90 2023-10-06T11:05:36.154 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.147+0000 7fa0fb7fe700 1 -- 172.21.15.146:0/3473777005 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0fc016430 con 0x7fa104156f90 2023-10-06T11:05:36.154 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.147+0000 7fa103fff700 1 -- 172.21.15.146:0/3473777005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa104154b80 con 0x7fa104156f90 2023-10-06T11:05:36.154 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.147+0000 7fa0fb7fe700 1 -- 172.21.15.146:0/3473777005 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc0167d0 con 0x7fa104156f90 2023-10-06T11:05:36.154 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.147+0000 7fa103fff700 1 -- 172.21.15.146:0/3473777005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa104155140 con 0x7fa104156f90 2023-10-06T11:05:36.154 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.148+0000 7fa103fff700 1 -- 172.21.15.146:0/3473777005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa104155330 con 0x7fa104156f90 2023-10-06T11:05:36.154 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.148+0000 7fa0fb7fe700 1 -- 172.21.15.146:0/3473777005 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7fa0fc003020 con 0x7fa104156f90 2023-10-06T11:05:36.154 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.149+0000 7fa0fb7fe700 1 --2- 172.21.15.146:0/3473777005 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa0e4066ea0 0x7fa0e4069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:36.154 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.149+0000 7fa0fb7fe700 1 -- 172.21.15.146:0/3473777005 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2227+0+0 (secure 0 0 0) 0x7fa0fc012070 con 0x7fa104156f90 2023-10-06T11:05:36.155 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.149+0000 7fa102ffd700 1 --2- 172.21.15.146:0/3473777005 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa0e4066ea0 0x7fa0e4069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:36.155 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.149+0000 7fa102ffd700 1 --2- 172.21.15.146:0/3473777005 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa0e4066ea0 0x7fa0e4069350 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4001820 tx=0x7fa0f4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:36.155 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.153+0000 7fa0fb7fe700 1 -- 172.21.15.146:0/3473777005 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa0fc052690 con 0x7fa104156f90 2023-10-06T11:05:36.347 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.346+0000 7fa103fff700 1 -- 172.21.15.146:0/3473777005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa10404c380 con 0x7fa104156f90 2023-10-06T11:05:36.348 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.346+0000 7fa0fb7fe700 1 -- 172.21.15.146:0/3473777005 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10444 (secure 0 0 0) 0x7fa0fc055cb0 con 0x7fa104156f90 2023-10-06T11:05:36.348 INFO:teuthology.misc.health.smithi146.stdout: 2023-10-06T11:05:36.348 INFO:teuthology.misc.health.smithi146.stdout:{"epoch":13,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:05:36.302744+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:05:36.350 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.349+0000 7fa103fff700 1 -- 172.21.15.146:0/3473777005 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa0e4066ea0 msgr2=0x7fa0e4069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:36.351 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.349+0000 7fa103fff700 1 --2- 172.21.15.146:0/3473777005 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa0e4066ea0 0x7fa0e4069350 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa0f4001820 tx=0x7fa0f4009040 comp rx=0 tx=0).stop 2023-10-06T11:05:36.351 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.349+0000 7fa103fff700 1 -- 172.21.15.146:0/3473777005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa104156f90 msgr2=0x7fa1040a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:36.351 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.349+0000 7fa103fff700 1 --2- 172.21.15.146:0/3473777005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa104156f90 0x7fa1040a5700 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc00ceb0 tx=0x7fa0fc007870 comp rx=0 tx=0).stop 2023-10-06T11:05:36.351 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.349+0000 7fa103fff700 1 -- 172.21.15.146:0/3473777005 shutdown_connections 2023-10-06T11:05:36.351 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.349+0000 7fa103fff700 1 --2- 172.21.15.146:0/3473777005 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa0e4066ea0 0x7fa0e4069350 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:36.351 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.349+0000 7fa103fff700 1 --2- 172.21.15.146:0/3473777005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa104156f90 0x7fa1040a5700 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:36.351 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.349+0000 7fa103fff700 1 --2- 172.21.15.146:0/3473777005 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa104068be0 0x7fa104155660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:36.351 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.349+0000 7fa103fff700 1 --2- 172.21.15.146:0/3473777005 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa104153d10 0x7fa104166fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:36.351 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.349+0000 7fa103fff700 1 -- 172.21.15.146:0/3473777005 >> 172.21.15.146:0/3473777005 conn(0x7fa10406db00 msgr2=0x7fa104157cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:36.351 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.349+0000 7fa103fff700 1 -- 172.21.15.146:0/3473777005 shutdown_connections 2023-10-06T11:05:36.351 INFO:teuthology.misc.health.smithi146.stderr:2023-10-06T11:05:36.349+0000 7fa103fff700 1 -- 172.21.15.146:0/3473777005 wait complete. 2023-10-06T11:05:36.361 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-06T11:05:36.361 INFO:tasks.ceph:Creating RBD pool 2023-10-06T11:05:36.362 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-06T11:05:36.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.473+0000 7f8233fff700 1 Processor -- start 2023-10-06T11:05:36.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.473+0000 7f8233fff700 1 -- start start 2023-10-06T11:05:36.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.474+0000 7f8233fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f823406ec90 0x7f82341641a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:36.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.474+0000 7f8233fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82340c8b80 con 0x7f82341595d0 2023-10-06T11:05:36.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.474+0000 7f8233fff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82340c7fb0 con 0x7f8234068b90 2023-10-06T11:05:36.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.474+0000 7f8233fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82340ca7d0 con 0x7f823406ec90 2023-10-06T11:05:36.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.474+0000 7f82337fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f823406ec90 0x7f82341641a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:36.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.474+0000 7f8232ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f82341595d0 0x7f8234068480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38266/0 (socket says 172.21.15.146:38266) 2023-10-06T11:05:36.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.474+0000 7f8232ffd700 1 -- 172.21.15.146:0/1136342061 learned_addr learned my addr 172.21.15.146:0/1136342061 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:05:36.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.474+0000 7f82337fe700 1 -- 172.21.15.146:0/1136342061 >> v1:172.21.15.151:6789/0 conn(0x7f8234068b90 legacy=0x7f823406e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:36.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.474+0000 7f82337fe700 1 -- 172.21.15.146:0/1136342061 >> v1:172.21.15.146:6789/0 conn(0x7f82341595d0 legacy=0x7f8234068480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:36.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.474+0000 7f82337fe700 1 -- 172.21.15.146:0/1136342061 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82340c8250 con 0x7f823406ec90 2023-10-06T11:05:36.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.474+0000 7f82327fc700 1 -- 172.21.15.146:0/1136342061 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3813042429 0 0) 0x7f82340c8b80 con 0x7f82341595d0 2023-10-06T11:05:36.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.475+0000 7f82337fe700 1 --2- 172.21.15.146:0/1136342061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f823406ec90 0x7f82341641a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f822c009e60 tx=0x7f822c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36342a08dc977c80 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:36.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.475+0000 7f82327fc700 1 -- 172.21.15.146:0/1136342061 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822c00e070 con 0x7f823406ec90 2023-10-06T11:05:36.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.475+0000 7f82327fc700 1 -- 172.21.15.146:0/1136342061 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f822c00bbf0 con 0x7f823406ec90 2023-10-06T11:05:36.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.475+0000 7f82327fc700 1 -- 172.21.15.146:0/1136342061 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822c012430 con 0x7f823406ec90 2023-10-06T11:05:36.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.475+0000 7f8233fff700 1 -- 172.21.15.146:0/1136342061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f823406ec90 msgr2=0x7f82341641a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:36.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.475+0000 7f8233fff700 1 --2- 172.21.15.146:0/1136342061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f823406ec90 0x7f82341641a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f822c009e60 tx=0x7f822c009780 comp rx=0 tx=0).stop 2023-10-06T11:05:36.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.475+0000 7f8233fff700 1 -- 172.21.15.146:0/1136342061 shutdown_connections 2023-10-06T11:05:36.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.475+0000 7f8233fff700 1 --2- 172.21.15.146:0/1136342061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f823406ec90 0x7f82341641a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:36.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.475+0000 7f8233fff700 1 -- 172.21.15.146:0/1136342061 >> 172.21.15.146:0/1136342061 conn(0x7f82340c9dc0 msgr2=0x7f823406dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:36.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.475+0000 7f8233fff700 1 -- 172.21.15.146:0/1136342061 shutdown_connections 2023-10-06T11:05:36.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.475+0000 7f8233fff700 1 -- 172.21.15.146:0/1136342061 wait complete. 2023-10-06T11:05:36.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.476+0000 7f8233fff700 1 Processor -- start 2023-10-06T11:05:36.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.477+0000 7f8233fff700 1 -- start start 2023-10-06T11:05:36.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.477+0000 7f8233fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8234068b90 0x7f8234144ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:36.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.477+0000 7f8233fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f823406ec90 0x7f823415c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:36.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.477+0000 7f8233fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82341595d0 0x7f823416a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:36.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.477+0000 7f8233fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823415b670 con 0x7f8234068b90 2023-10-06T11:05:36.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.477+0000 7f8233fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823415b950 con 0x7f823406ec90 2023-10-06T11:05:36.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.477+0000 7f8233fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f823415bc30 con 0x7f82341595d0 2023-10-06T11:05:36.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.477+0000 7f8232ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8234068b90 0x7f8234144ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:36.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.477+0000 7f8232ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8234068b90 0x7f8234144ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50092/0 (socket says 172.21.15.146:50092) 2023-10-06T11:05:36.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.477+0000 7f8232ffd700 1 -- 172.21.15.146:0/1175100030 learned_addr learned my addr 172.21.15.146:0/1175100030 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:36.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.478+0000 7f82337fe700 1 --2- 172.21.15.146:0/1175100030 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82341595d0 0x7f823416a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:36.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.478+0000 7f822a7fc700 1 --2- 172.21.15.146:0/1175100030 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f823406ec90 0x7f823415c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:36.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.478+0000 7f8232ffd700 1 -- 172.21.15.146:0/1175100030 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82341595d0 msgr2=0x7f823416a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:36.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.478+0000 7f8232ffd700 1 --2- 172.21.15.146:0/1175100030 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82341595d0 0x7f823416a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:36.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.478+0000 7f8232ffd700 1 -- 172.21.15.146:0/1175100030 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f823406ec90 msgr2=0x7f823415c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:36.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.478+0000 7f8232ffd700 1 --2- 172.21.15.146:0/1175100030 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f823406ec90 0x7f823415c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:36.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.478+0000 7f8232ffd700 1 -- 172.21.15.146:0/1175100030 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f822c009a20 con 0x7f8234068b90 2023-10-06T11:05:36.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.478+0000 7f822a7fc700 1 --2- 172.21.15.146:0/1175100030 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f823406ec90 0x7f823415c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:05:36.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.478+0000 7f8232ffd700 1 --2- 172.21.15.146:0/1175100030 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8234068b90 0x7f8234144ce0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f822400c5b0 tx=0x7f8224001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:36.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.478+0000 7f822b7fe700 1 -- 172.21.15.146:0/1175100030 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8224005b30 con 0x7f8234068b90 2023-10-06T11:05:36.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.478+0000 7f822b7fe700 1 -- 172.21.15.146:0/1175100030 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8224005c90 con 0x7f8234068b90 2023-10-06T11:05:36.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.478+0000 7f8233fff700 1 -- 172.21.15.146:0/1175100030 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f823415bf10 con 0x7f8234068b90 2023-10-06T11:05:36.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.478+0000 7f822b7fe700 1 -- 172.21.15.146:0/1175100030 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8224007300 con 0x7f8234068b90 2023-10-06T11:05:36.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.478+0000 7f8233fff700 1 -- 172.21.15.146:0/1175100030 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f823416a6a0 con 0x7f8234068b90 2023-10-06T11:05:36.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.479+0000 7f8233fff700 1 -- 172.21.15.146:0/1175100030 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f823415c100 con 0x7f8234068b90 2023-10-06T11:05:36.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.479+0000 7f822b7fe700 1 -- 172.21.15.146:0/1175100030 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f822401b3b0 con 0x7f8234068b90 2023-10-06T11:05:36.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.479+0000 7f822b7fe700 1 --2- 172.21.15.146:0/1175100030 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8214066ed0 0x7f8214069380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:36.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.480+0000 7f822b7fe700 1 -- 172.21.15.146:0/1175100030 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f8224083450 con 0x7f8234068b90 2023-10-06T11:05:36.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.480+0000 7f822a7fc700 1 --2- 172.21.15.146:0/1175100030 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8214066ed0 0x7f8214069380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:36.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.480+0000 7f822a7fc700 1 --2- 172.21.15.146:0/1175100030 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8214066ed0 0x7f8214069380 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8234068f90 tx=0x7f821c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:36.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.484+0000 7f822b7fe700 1 -- 172.21.15.146:0/1175100030 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8224050c70 con 0x7f8234068b90 2023-10-06T11:05:36.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:36.669+0000 7f8233fff700 1 -- 172.21.15.146:0/1175100030 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f823415b7b0 con 0x7f8234068b90 2023-10-06T11:05:37.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.312+0000 7f822b7fe700 1 -- 172.21.15.146:0/1175100030 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) v1 ==== 109+0+0 (secure 0 0 0) 0x7f823415b7b0 con 0x7f8234068b90 2023-10-06T11:05:37.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.314+0000 7f8233fff700 1 -- 172.21.15.146:0/1175100030 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8214066ed0 msgr2=0x7f8214069380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:37.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.314+0000 7f8233fff700 1 --2- 172.21.15.146:0/1175100030 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8214066ed0 0x7f8214069380 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8234068f90 tx=0x7f821c009040 comp rx=0 tx=0).stop 2023-10-06T11:05:37.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.314+0000 7f8233fff700 1 -- 172.21.15.146:0/1175100030 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8234068b90 msgr2=0x7f8234144ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:37.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.314+0000 7f8233fff700 1 --2- 172.21.15.146:0/1175100030 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8234068b90 0x7f8234144ce0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f822400c5b0 tx=0x7f8224001070 comp rx=0 tx=0).stop 2023-10-06T11:05:37.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.315+0000 7f8233fff700 1 -- 172.21.15.146:0/1175100030 shutdown_connections 2023-10-06T11:05:37.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.315+0000 7f8233fff700 1 --2- 172.21.15.146:0/1175100030 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8214066ed0 0x7f8214069380 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:37.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.315+0000 7f8233fff700 1 --2- 172.21.15.146:0/1175100030 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82341595d0 0x7f823416a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:37.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.315+0000 7f8233fff700 1 --2- 172.21.15.146:0/1175100030 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8234068b90 0x7f8234144ce0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:37.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.315+0000 7f8233fff700 1 --2- 172.21.15.146:0/1175100030 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f823406ec90 0x7f823415c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:37.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.315+0000 7f8233fff700 1 -- 172.21.15.146:0/1175100030 >> 172.21.15.146:0/1175100030 conn(0x7f82340c9dc0 msgr2=0x7f823415d860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:37.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.315+0000 7f8233fff700 1 -- 172.21.15.146:0/1175100030 shutdown_connections 2023-10-06T11:05:37.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.315+0000 7f8233fff700 1 -- 172.21.15.146:0/1175100030 wait complete. 2023-10-06T11:05:37.318 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'rbd' created 2023-10-06T11:05:37.330 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-06T11:05:37.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.446+0000 7f7575d3a700 1 Processor -- start 2023-10-06T11:05:37.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.446+0000 7f7575d3a700 1 -- start start 2023-10-06T11:05:37.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.447+0000 7f7575d3a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f757015d710 0x7f75700ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:37.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.447+0000 7f7575d3a700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f757015dae0 0x7f75700b04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:37.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.447+0000 7f7575d3a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75700b0010 con 0x7f75700aef20 2023-10-06T11:05:37.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.447+0000 7f7575d3a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f757015e340 con 0x7f757015d710 2023-10-06T11:05:37.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.447+0000 7f7575d3a700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75700cf090 con 0x7f757015dae0 2023-10-06T11:05:37.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.447+0000 7f756f7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f757015d710 0x7f75700ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:37.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.447+0000 7f756effd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f75700aef20 0x7f7570068580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38274/0 (socket says 172.21.15.146:38274) 2023-10-06T11:05:37.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.447+0000 7f756effd700 1 -- 172.21.15.146:0/383000436 learned_addr learned my addr 172.21.15.146:0/383000436 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:05:37.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.448+0000 7f756ffff700 1 --2- 172.21.15.146:0/383000436 >> v2:172.21.15.151:3300/0 conn(0x7f757015dae0 0x7f75700b04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:37.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.448+0000 7f756f7fe700 1 -- 172.21.15.146:0/383000436 >> v2:172.21.15.151:3300/0 conn(0x7f757015dae0 msgr2=0x7f75700b04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:37.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.448+0000 7f756f7fe700 1 --2- 172.21.15.146:0/383000436 >> v2:172.21.15.151:3300/0 conn(0x7f757015dae0 0x7f75700b04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:37.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.448+0000 7f756f7fe700 1 -- 172.21.15.146:0/383000436 >> v1:172.21.15.146:6789/0 conn(0x7f75700aef20 legacy=0x7f7570068580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:37.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.448+0000 7f756e7fc700 1 -- 172.21.15.146:0/383000436 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2503873785 0 0) 0x7f75700b0010 con 0x7f75700aef20 2023-10-06T11:05:37.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.448+0000 7f756f7fe700 1 -- 172.21.15.146:0/383000436 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75700af400 con 0x7f757015d710 2023-10-06T11:05:37.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.448+0000 7f756f7fe700 1 --2- 172.21.15.146:0/383000436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f757015d710 0x7f75700ceb50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f757006e1e0 tx=0x7f75600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d9031aa3519af4c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:37.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.448+0000 7f756e7fc700 1 -- 172.21.15.146:0/383000436 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756000b6b0 con 0x7f757015d710 2023-10-06T11:05:37.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.448+0000 7f756e7fc700 1 -- 172.21.15.146:0/383000436 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f756000b810 con 0x7f757015d710 2023-10-06T11:05:37.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.448+0000 7f756e7fc700 1 -- 172.21.15.146:0/383000436 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756000bbb0 con 0x7f757015d710 2023-10-06T11:05:37.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.448+0000 7f7575d3a700 1 -- 172.21.15.146:0/383000436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f757015d710 msgr2=0x7f75700ceb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:37.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.448+0000 7f7575d3a700 1 --2- 172.21.15.146:0/383000436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f757015d710 0x7f75700ceb50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f757006e1e0 tx=0x7f75600091a0 comp rx=0 tx=0).stop 2023-10-06T11:05:37.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.448+0000 7f7575d3a700 1 -- 172.21.15.146:0/383000436 shutdown_connections 2023-10-06T11:05:37.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.448+0000 7f7575d3a700 1 --2- 172.21.15.146:0/383000436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f757015d710 0x7f75700ceb50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:37.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.448+0000 7f7575d3a700 1 --2- 172.21.15.146:0/383000436 >> v2:172.21.15.151:3300/0 conn(0x7f757015dae0 0x7f75700b04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:37.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.448+0000 7f7575d3a700 1 -- 172.21.15.146:0/383000436 >> 172.21.15.146:0/383000436 conn(0x7f7570067c50 msgr2=0x7f75700ce440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:37.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.448+0000 7f7575d3a700 1 -- 172.21.15.146:0/383000436 shutdown_connections 2023-10-06T11:05:37.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.449+0000 7f7575d3a700 1 -- 172.21.15.146:0/383000436 wait complete. 2023-10-06T11:05:37.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.450+0000 7f7575d3a700 1 Processor -- start 2023-10-06T11:05:37.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.450+0000 7f7575d3a700 1 -- start start 2023-10-06T11:05:37.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.450+0000 7f7575d3a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75700aef20 0x7f7570143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:37.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.450+0000 7f7575d3a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f757015d710 0x7f75700ad380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:37.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.450+0000 7f7575d3a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f757015dae0 0x7f75700ad8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:37.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.450+0000 7f7575d3a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7570157360 con 0x7f757015dae0 2023-10-06T11:05:37.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.450+0000 7f7575d3a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75701577f0 con 0x7f75700aef20 2023-10-06T11:05:37.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.450+0000 7f7575d3a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75701443f0 con 0x7f757015d710 2023-10-06T11:05:37.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.451+0000 7f756ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f757015dae0 0x7f75700ad8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:37.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.451+0000 7f756ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f757015dae0 0x7f75700ad8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50098/0 (socket says 172.21.15.146:50098) 2023-10-06T11:05:37.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.451+0000 7f756ffff700 1 -- 172.21.15.146:0/2242338653 learned_addr learned my addr 172.21.15.146:0/2242338653 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:37.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.451+0000 7f756f7fe700 1 --2- 172.21.15.146:0/2242338653 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75700aef20 0x7f7570143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:37.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.451+0000 7f756effd700 1 --2- 172.21.15.146:0/2242338653 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f757015d710 0x7f75700ad380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:37.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.451+0000 7f756ffff700 1 -- 172.21.15.146:0/2242338653 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f757015d710 msgr2=0x7f75700ad380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:37.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.451+0000 7f756ffff700 1 --2- 172.21.15.146:0/2242338653 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f757015d710 0x7f75700ad380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:37.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.451+0000 7f756ffff700 1 -- 172.21.15.146:0/2242338653 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75700aef20 msgr2=0x7f7570143eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:37.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.451+0000 7f756ffff700 1 --2- 172.21.15.146:0/2242338653 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75700aef20 0x7f7570143eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:37.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.451+0000 7f756ffff700 1 -- 172.21.15.146:0/2242338653 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7560009420 con 0x7f757015dae0 2023-10-06T11:05:37.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.451+0000 7f756ffff700 1 --2- 172.21.15.146:0/2242338653 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f757015dae0 0x7f75700ad8c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7568007f20 tx=0x7f7568009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:37.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.451+0000 7f75577fe700 1 -- 172.21.15.146:0/2242338653 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756800eca0 con 0x7f757015dae0 2023-10-06T11:05:37.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.451+0000 7f75577fe700 1 -- 172.21.15.146:0/2242338653 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f756800ee20 con 0x7f757015dae0 2023-10-06T11:05:37.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.451+0000 7f7575d3a700 1 -- 172.21.15.146:0/2242338653 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7570156750 con 0x7f757015dae0 2023-10-06T11:05:37.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.451+0000 7f75577fe700 1 -- 172.21.15.146:0/2242338653 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7568014670 con 0x7f757015dae0 2023-10-06T11:05:37.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.451+0000 7f7575d3a700 1 -- 172.21.15.146:0/2242338653 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7570156d10 con 0x7f757015dae0 2023-10-06T11:05:37.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.452+0000 7f7575d3a700 1 -- 172.21.15.146:0/2242338653 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7570157510 con 0x7f757015dae0 2023-10-06T11:05:37.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.452+0000 7f75577fe700 1 -- 172.21.15.146:0/2242338653 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f75680149e0 con 0x7f757015dae0 2023-10-06T11:05:37.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.453+0000 7f75577fe700 1 --2- 172.21.15.146:0/2242338653 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f755c066ea0 0x7f755c069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:37.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.453+0000 7f756f7fe700 1 --2- 172.21.15.146:0/2242338653 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f755c066ea0 0x7f755c069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:37.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.453+0000 7f75577fe700 1 -- 172.21.15.146:0/2242338653 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 5184+0+0 (secure 0 0 0) 0x7f7568084910 con 0x7f757015dae0 2023-10-06T11:05:37.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.453+0000 7f756f7fe700 1 --2- 172.21.15.146:0/2242338653 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f755c066ea0 0x7f755c069350 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f75600093f0 tx=0x7f7560017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:37.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.457+0000 7f75577fe700 1 -- 172.21.15.146:0/2242338653 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7570157510 con 0x7f757015dae0 2023-10-06T11:05:37.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:37.647+0000 7f7575d3a700 1 -- 172.21.15.146:0/2242338653 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f757004c380 con 0x7f757015dae0 2023-10-06T11:05:38.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.317+0000 7f75577fe700 1 -- 172.21.15.146:0/2242338653 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v15) v1 ==== 173+0+0 (secure 0 0 0) 0x7f7568051e70 con 0x7f757015dae0 2023-10-06T11:05:38.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.320+0000 7f7575d3a700 1 -- 172.21.15.146:0/2242338653 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f755c066ea0 msgr2=0x7f755c069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:38.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.320+0000 7f7575d3a700 1 --2- 172.21.15.146:0/2242338653 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f755c066ea0 0x7f755c069350 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f75600093f0 tx=0x7f7560017000 comp rx=0 tx=0).stop 2023-10-06T11:05:38.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.320+0000 7f7575d3a700 1 -- 172.21.15.146:0/2242338653 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f757015dae0 msgr2=0x7f75700ad8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:38.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.320+0000 7f7575d3a700 1 --2- 172.21.15.146:0/2242338653 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f757015dae0 0x7f75700ad8c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7568007f20 tx=0x7f7568009860 comp rx=0 tx=0).stop 2023-10-06T11:05:38.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.320+0000 7f7575d3a700 1 -- 172.21.15.146:0/2242338653 shutdown_connections 2023-10-06T11:05:38.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.320+0000 7f7575d3a700 1 --2- 172.21.15.146:0/2242338653 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f755c066ea0 0x7f755c069350 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:38.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.320+0000 7f7575d3a700 1 --2- 172.21.15.146:0/2242338653 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f757015dae0 0x7f75700ad8c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:38.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.320+0000 7f7575d3a700 1 --2- 172.21.15.146:0/2242338653 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75700aef20 0x7f7570143eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:38.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.320+0000 7f7575d3a700 1 --2- 172.21.15.146:0/2242338653 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f757015d710 0x7f75700ad380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:38.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.320+0000 7f7575d3a700 1 -- 172.21.15.146:0/2242338653 >> 172.21.15.146:0/2242338653 conn(0x7f7570067c50 msgr2=0x7f75701529f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:38.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.321+0000 7f7575d3a700 1 -- 172.21.15.146:0/2242338653 shutdown_connections 2023-10-06T11:05:38.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.321+0000 7f7575d3a700 1 -- 172.21.15.146:0/2242338653 wait complete. 2023-10-06T11:05:38.324 INFO:teuthology.orchestra.run.smithi146.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-06T11:05:38.338 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-06T11:05:38.338 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T11:05:38.338 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T11:05:38.340 INFO:tasks.ceph.mds.a:Started 2023-10-06T11:05:38.341 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T11:05:38.341 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T11:05:38.343 INFO:tasks.ceph.mds.c:Started 2023-10-06T11:05:38.343 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T11:05:38.343 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T11:05:38.345 INFO:tasks.ceph.mds.b:Started 2023-10-06T11:05:38.346 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T11:05:38.346 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T11:05:38.348 INFO:tasks.ceph.mds.d:Started 2023-10-06T11:05:38.348 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-06T11:05:38.348 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:05:38.424 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2023-10-06T11:05:38.425 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2023-10-06T11:05:38.429 INFO:tasks.ceph.mds.b.smithi151.stdout:starting mds.b at 2023-10-06T11:05:38.435 INFO:tasks.ceph.mds.d.smithi151.stdout:starting mds.d at 2023-10-06T11:05:38.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.483+0000 7f6b21a74700 1 Processor -- start 2023-10-06T11:05:38.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.483+0000 7f6b21a74700 1 -- start start 2023-10-06T11:05:38.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.484+0000 7f6b21a74700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6b1c0c8390 0x7f6b1c159df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:38.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.484+0000 7f6b21a74700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6b1c15a330 0x7f6b1c0caf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:38.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.484+0000 7f6b21a74700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b1c0c8a30 con 0x7f6b1c156230 2023-10-06T11:05:38.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.484+0000 7f6b21a74700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b1c0c8830 con 0x7f6b1c0c8390 2023-10-06T11:05:38.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.484+0000 7f6b21a74700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1c15a7b0 con 0x7f6b1c15a330 2023-10-06T11:05:38.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.484+0000 7f6b20a72700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f6b1c156230 0x7f6b1c06ae20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:58314/0 (socket says 172.21.15.146:58314) 2023-10-06T11:05:38.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.484+0000 7f6b20a72700 1 -- 172.21.15.146:0/746174776 learned_addr learned my addr 172.21.15.146:0/746174776 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:05:38.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.484+0000 7f6b21273700 1 --2- 172.21.15.146:0/746174776 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6b1c15a330 0x7f6b1c0caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:38.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.484+0000 7f6b1bfff700 1 --2- 172.21.15.146:0/746174776 >> v2:172.21.15.151:3300/0 conn(0x7f6b1c0c8390 0x7f6b1c159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:38.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.484+0000 7f6b1b7fe700 1 -- 172.21.15.146:0/746174776 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 449127117 0 0) 0x7f6b1c0c8a30 con 0x7f6b1c156230 2023-10-06T11:05:38.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.485+0000 7f6b1b7fe700 1 -- 172.21.15.146:0/746174776 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b0c003570 con 0x7f6b1c156230 2023-10-06T11:05:38.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.485+0000 7f6b1bfff700 1 -- 172.21.15.146:0/746174776 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6b1c15a330 msgr2=0x7f6b1c0caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:38.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.485+0000 7f6b1bfff700 1 --2- 172.21.15.146:0/746174776 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6b1c15a330 0x7f6b1c0caf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:38.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.485+0000 7f6b1bfff700 1 -- 172.21.15.146:0/746174776 >> v1:172.21.15.151:6789/0 conn(0x7f6b1c156230 legacy=0x7f6b1c06ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:38.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.485+0000 7f6b1bfff700 1 -- 172.21.15.146:0/746174776 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b1c0c8d10 con 0x7f6b1c0c8390 2023-10-06T11:05:38.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.485+0000 7f6b21273700 1 --2- 172.21.15.146:0/746174776 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6b1c15a330 0x7f6b1c0caf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:05:38.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.485+0000 7f6b1bfff700 1 --2- 172.21.15.146:0/746174776 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b1c0c8390 0x7f6b1c159df0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6b08009910 tx=0x7f6b080091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5103c921db05e387 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:38.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.485+0000 7f6b1b7fe700 1 -- 172.21.15.146:0/746174776 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b08011630 con 0x7f6b1c0c8390 2023-10-06T11:05:38.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.485+0000 7f6b1b7fe700 1 -- 172.21.15.146:0/746174776 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b08011790 con 0x7f6b1c0c8390 2023-10-06T11:05:38.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.485+0000 7f6b1b7fe700 1 -- 172.21.15.146:0/746174776 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b08011b30 con 0x7f6b1c0c8390 2023-10-06T11:05:38.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.485+0000 7f6b21a74700 1 -- 172.21.15.146:0/746174776 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b1c0c8390 msgr2=0x7f6b1c159df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:38.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.485+0000 7f6b21a74700 1 --2- 172.21.15.146:0/746174776 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b1c0c8390 0x7f6b1c159df0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6b08009910 tx=0x7f6b080091a0 comp rx=0 tx=0).stop 2023-10-06T11:05:38.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.485+0000 7f6b21a74700 1 -- 172.21.15.146:0/746174776 shutdown_connections 2023-10-06T11:05:38.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.485+0000 7f6b21a74700 1 --2- 172.21.15.146:0/746174776 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6b1c15a330 0x7f6b1c0caf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:38.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.485+0000 7f6b21a74700 1 --2- 172.21.15.146:0/746174776 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b1c0c8390 0x7f6b1c159df0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:38.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.485+0000 7f6b21a74700 1 -- 172.21.15.146:0/746174776 >> 172.21.15.146:0/746174776 conn(0x7f6b1c069010 msgr2=0x7f6b1c0cd120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:38.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.486+0000 7f6b21a74700 1 -- 172.21.15.146:0/746174776 shutdown_connections 2023-10-06T11:05:38.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.486+0000 7f6b21a74700 1 -- 172.21.15.146:0/746174776 wait complete. 2023-10-06T11:05:38.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.487+0000 7f6b21a74700 1 Processor -- start 2023-10-06T11:05:38.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.487+0000 7f6b21a74700 1 -- start start 2023-10-06T11:05:38.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.487+0000 7f6b21a74700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b1c0c8390 0x7f6b1c14dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:38.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.487+0000 7f6b21a74700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6b1c156230 0x7f6b1c0b23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:38.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.487+0000 7f6b21a74700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b1c15a330 0x7f6b1c0cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:38.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.487+0000 7f6b21a74700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1c1687b0 con 0x7f6b1c0c8390 2023-10-06T11:05:38.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.487+0000 7f6b21a74700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1c167c30 con 0x7f6b1c15a330 2023-10-06T11:05:38.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.488+0000 7f6b21a74700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1c167f10 con 0x7f6b1c156230 2023-10-06T11:05:38.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.488+0000 7f6b20a72700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b1c0c8390 0x7f6b1c14dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:38.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.488+0000 7f6b20a72700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b1c0c8390 0x7f6b1c14dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50134/0 (socket says 172.21.15.146:50134) 2023-10-06T11:05:38.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.488+0000 7f6b20a72700 1 -- 172.21.15.146:0/3697168421 learned_addr learned my addr 172.21.15.146:0/3697168421 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:38.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.488+0000 7f6b21273700 1 --2- 172.21.15.146:0/3697168421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b1c15a330 0x7f6b1c0cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:38.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.488+0000 7f6b1bfff700 1 --2- 172.21.15.146:0/3697168421 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6b1c156230 0x7f6b1c0b23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:38.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.488+0000 7f6b20a72700 1 -- 172.21.15.146:0/3697168421 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6b1c156230 msgr2=0x7f6b1c0b23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:38.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.488+0000 7f6b20a72700 1 --2- 172.21.15.146:0/3697168421 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6b1c156230 0x7f6b1c0b23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:38.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.488+0000 7f6b20a72700 1 -- 172.21.15.146:0/3697168421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b1c15a330 msgr2=0x7f6b1c0cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:38.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.488+0000 7f6b20a72700 1 --2- 172.21.15.146:0/3697168421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b1c15a330 0x7f6b1c0cbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:38.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.488+0000 7f6b20a72700 1 -- 172.21.15.146:0/3697168421 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b14009a20 con 0x7f6b1c0c8390 2023-10-06T11:05:38.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.488+0000 7f6b21273700 1 --2- 172.21.15.146:0/3697168421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b1c15a330 0x7f6b1c0cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:05:38.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.488+0000 7f6b20a72700 1 --2- 172.21.15.146:0/3697168421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b1c0c8390 0x7f6b1c14dba0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6b1000c7c0 tx=0x7f6b10007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:38.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.488+0000 7f6b18ff9700 1 -- 172.21.15.146:0/3697168421 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b10005b30 con 0x7f6b1c0c8390 2023-10-06T11:05:38.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.488+0000 7f6b18ff9700 1 -- 172.21.15.146:0/3697168421 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b10005cb0 con 0x7f6b1c0c8390 2023-10-06T11:05:38.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.488+0000 7f6b18ff9700 1 -- 172.21.15.146:0/3697168421 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b10007320 con 0x7f6b1c0c8390 2023-10-06T11:05:38.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.488+0000 7f6b21a74700 1 -- 172.21.15.146:0/3697168421 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b08009420 con 0x7f6b1c0c8390 2023-10-06T11:05:38.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.488+0000 7f6b21a74700 1 -- 172.21.15.146:0/3697168421 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b1c1684d0 con 0x7f6b1c0c8390 2023-10-06T11:05:38.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.489+0000 7f6b21a74700 1 -- 172.21.15.146:0/3697168421 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b1c04bb40 con 0x7f6b1c0c8390 2023-10-06T11:05:38.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.490+0000 7f6b18ff9700 1 -- 172.21.15.146:0/3697168421 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f6b1001b3b0 con 0x7f6b1c0c8390 2023-10-06T11:05:38.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.490+0000 7f6b18ff9700 1 --2- 172.21.15.146:0/3697168421 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6b00066ea0 0x7f6b00069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:38.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.490+0000 7f6b18ff9700 1 -- 172.21.15.146:0/3697168421 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f6b10083690 con 0x7f6b1c0c8390 2023-10-06T11:05:38.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.490+0000 7f6b1bfff700 1 --2- 172.21.15.146:0/3697168421 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6b00066ea0 0x7f6b00069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:38.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.490+0000 7f6b1bfff700 1 --2- 172.21.15.146:0/3697168421 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6b00066ea0 0x7f6b00069350 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6b080091e0 tx=0x7f6b08017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:38.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.494+0000 7f6b18ff9700 1 -- 172.21.15.146:0/3697168421 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6b10050c90 con 0x7f6b1c0c8390 2023-10-06T11:05:38.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.692+0000 7f6b21a74700 1 -- 172.21.15.146:0/3697168421 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6b1c0cca00 con 0x7f6b1c0c8390 2023-10-06T11:05:38.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.693+0000 7f6b18ff9700 1 -- 172.21.15.146:0/3697168421 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+13722 (secure 0 0 0) 0x7f6b10017090 con 0x7f6b1c0c8390 2023-10-06T11:05:38.695 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:05:38.695 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":15,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:05:38.311939+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:05:38.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.695+0000 7f6b21a74700 1 -- 172.21.15.146:0/3697168421 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6b00066ea0 msgr2=0x7f6b00069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:38.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.695+0000 7f6b21a74700 1 --2- 172.21.15.146:0/3697168421 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6b00066ea0 0x7f6b00069350 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6b080091e0 tx=0x7f6b08017000 comp rx=0 tx=0).stop 2023-10-06T11:05:38.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.695+0000 7f6b21a74700 1 -- 172.21.15.146:0/3697168421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b1c0c8390 msgr2=0x7f6b1c14dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:38.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.695+0000 7f6b21a74700 1 --2- 172.21.15.146:0/3697168421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b1c0c8390 0x7f6b1c14dba0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6b1000c7c0 tx=0x7f6b10007e00 comp rx=0 tx=0).stop 2023-10-06T11:05:38.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.695+0000 7f6b21a74700 1 -- 172.21.15.146:0/3697168421 shutdown_connections 2023-10-06T11:05:38.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.695+0000 7f6b21a74700 1 --2- 172.21.15.146:0/3697168421 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6b00066ea0 0x7f6b00069350 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:38.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.695+0000 7f6b21a74700 1 --2- 172.21.15.146:0/3697168421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b1c15a330 0x7f6b1c0cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:38.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.695+0000 7f6b21a74700 1 --2- 172.21.15.146:0/3697168421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6b1c0c8390 0x7f6b1c14dba0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:38.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.695+0000 7f6b21a74700 1 --2- 172.21.15.146:0/3697168421 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6b1c156230 0x7f6b1c0b23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:38.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.695+0000 7f6b21a74700 1 -- 172.21.15.146:0/3697168421 >> 172.21.15.146:0/3697168421 conn(0x7f6b1c069010 msgr2=0x7f6b1c154050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:38.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.695+0000 7f6b21a74700 1 -- 172.21.15.146:0/3697168421 shutdown_connections 2023-10-06T11:05:38.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.695+0000 7f6b21a74700 1 -- 172.21.15.146:0/3697168421 wait complete. 2023-10-06T11:05:38.709 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:05:36.687307+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:05:37.171199+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T11:05:38.709 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:05:38.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.829+0000 7fe8dada9700 1 Processor -- start 2023-10-06T11:05:38.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.830+0000 7fe8dada9700 1 -- start start 2023-10-06T11:05:38.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.830+0000 7fe8dada9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe8d4159a90 0x7fe8d40ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:38.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.830+0000 7fe8dada9700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8d40aecd0 0x7fe8d40af150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:38.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.830+0000 7fe8dada9700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d40cb870 con 0x7fe8d40cdde0 2023-10-06T11:05:38.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.830+0000 7fe8dada9700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8d40af690 con 0x7fe8d4159a90 2023-10-06T11:05:38.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.830+0000 7fe8dada9700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d40b07d0 con 0x7fe8d40aecd0 2023-10-06T11:05:38.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.830+0000 7fe8d8b45700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe8d4159a90 0x7fe8d40ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:38.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.831+0000 7fe8cbfff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe8d40cdde0 0x7fe8d40b00c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38304/0 (socket says 172.21.15.146:38304) 2023-10-06T11:05:38.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.831+0000 7fe8cbfff700 1 -- 172.21.15.146:0/2147734957 learned_addr learned my addr 172.21.15.146:0/2147734957 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:05:38.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.831+0000 7fe8d9346700 1 --2- 172.21.15.146:0/2147734957 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8d40aecd0 0x7fe8d40af150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:38.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.831+0000 7fe8d8b45700 1 -- 172.21.15.146:0/2147734957 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8d40aecd0 msgr2=0x7fe8d40af150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:38.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.831+0000 7fe8d8b45700 1 --2- 172.21.15.146:0/2147734957 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8d40aecd0 0x7fe8d40af150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:38.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.831+0000 7fe8d8b45700 1 -- 172.21.15.146:0/2147734957 >> v1:172.21.15.146:6789/0 conn(0x7fe8d40cdde0 legacy=0x7fe8d40b00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:38.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.831+0000 7fe8d8b45700 1 -- 172.21.15.146:0/2147734957 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d40cac60 con 0x7fe8d4159a90 2023-10-06T11:05:38.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.831+0000 7fe8cb7fe700 1 -- 172.21.15.146:0/2147734957 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3984501007 0 0) 0x7fe8d40cb870 con 0x7fe8d40cdde0 2023-10-06T11:05:38.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.831+0000 7fe8d8b45700 1 --2- 172.21.15.146:0/2147734957 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8d4159a90 0x7fe8d40ca330 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe8d00098e0 tx=0x7fe8d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93be53c319e36275 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:38.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.831+0000 7fe8cb7fe700 1 -- 172.21.15.146:0/2147734957 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d0009e80 con 0x7fe8d4159a90 2023-10-06T11:05:38.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.831+0000 7fe8cb7fe700 1 -- 172.21.15.146:0/2147734957 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d000b860 con 0x7fe8d4159a90 2023-10-06T11:05:38.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.831+0000 7fe8cb7fe700 1 -- 172.21.15.146:0/2147734957 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8d000bbe0 con 0x7fe8d4159a90 2023-10-06T11:05:38.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.832+0000 7fe8dada9700 1 -- 172.21.15.146:0/2147734957 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8d4159a90 msgr2=0x7fe8d40ca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:38.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.832+0000 7fe8dada9700 1 --2- 172.21.15.146:0/2147734957 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8d4159a90 0x7fe8d40ca330 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe8d00098e0 tx=0x7fe8d00091a0 comp rx=0 tx=0).stop 2023-10-06T11:05:38.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.832+0000 7fe8dada9700 1 -- 172.21.15.146:0/2147734957 shutdown_connections 2023-10-06T11:05:38.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.832+0000 7fe8dada9700 1 --2- 172.21.15.146:0/2147734957 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8d40aecd0 0x7fe8d40af150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:38.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.832+0000 7fe8dada9700 1 --2- 172.21.15.146:0/2147734957 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8d4159a90 0x7fe8d40ca330 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:38.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.832+0000 7fe8dada9700 1 -- 172.21.15.146:0/2147734957 >> 172.21.15.146:0/2147734957 conn(0x7fe8d4068580 msgr2=0x7fe8d4068980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:38.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.832+0000 7fe8dada9700 1 -- 172.21.15.146:0/2147734957 shutdown_connections 2023-10-06T11:05:38.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.832+0000 7fe8dada9700 1 -- 172.21.15.146:0/2147734957 wait complete. 2023-10-06T11:05:38.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.833+0000 7fe8dada9700 1 Processor -- start 2023-10-06T11:05:38.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.833+0000 7fe8dada9700 1 -- start start 2023-10-06T11:05:38.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.834+0000 7fe8dada9700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8d40aecd0 0x7fe8d414a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:38.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.834+0000 7fe8dada9700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8d40cdde0 0x7fe8d40c97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:38.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.834+0000 7fe8dada9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8d4159a90 0x7fe8d40ade90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:38.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.834+0000 7fe8dada9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d40c9cf0 con 0x7fe8d4159a90 2023-10-06T11:05:38.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.834+0000 7fe8dada9700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d414a2d0 con 0x7fe8d40cdde0 2023-10-06T11:05:38.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.834+0000 7fe8dada9700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d41496c0 con 0x7fe8d40aecd0 2023-10-06T11:05:38.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.834+0000 7fe8d9346700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8d4159a90 0x7fe8d40ade90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:38.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.834+0000 7fe8d9346700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8d4159a90 0x7fe8d40ade90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50152/0 (socket says 172.21.15.146:50152) 2023-10-06T11:05:38.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.834+0000 7fe8d9346700 1 -- 172.21.15.146:0/3020997710 learned_addr learned my addr 172.21.15.146:0/3020997710 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:38.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.834+0000 7fe8d8b45700 1 --2- 172.21.15.146:0/3020997710 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8d40aecd0 0x7fe8d414a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:38.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.834+0000 7fe8cbfff700 1 --2- 172.21.15.146:0/3020997710 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8d40cdde0 0x7fe8d40c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:38.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.834+0000 7fe8d9346700 1 -- 172.21.15.146:0/3020997710 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8d40aecd0 msgr2=0x7fe8d414a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:38.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.834+0000 7fe8d9346700 1 --2- 172.21.15.146:0/3020997710 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8d40aecd0 0x7fe8d414a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:38.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.834+0000 7fe8d9346700 1 -- 172.21.15.146:0/3020997710 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8d40cdde0 msgr2=0x7fe8d40c97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:38.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.834+0000 7fe8d9346700 1 --2- 172.21.15.146:0/3020997710 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8d40cdde0 0x7fe8d40c97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:38.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.834+0000 7fe8d9346700 1 -- 172.21.15.146:0/3020997710 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d0009420 con 0x7fe8d4159a90 2023-10-06T11:05:38.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.834+0000 7fe8d9346700 1 --2- 172.21.15.146:0/3020997710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8d4159a90 0x7fe8d40ade90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc009fa0 tx=0x7fe8cc009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:38.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.834+0000 7fe8c8ff9700 1 -- 172.21.15.146:0/3020997710 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc00ebc0 con 0x7fe8d4159a90 2023-10-06T11:05:38.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.834+0000 7fe8c8ff9700 1 -- 172.21.15.146:0/3020997710 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8cc00ed20 con 0x7fe8d4159a90 2023-10-06T11:05:38.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.834+0000 7fe8dada9700 1 -- 172.21.15.146:0/3020997710 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d41499a0 con 0x7fe8d4159a90 2023-10-06T11:05:38.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.834+0000 7fe8c8ff9700 1 -- 172.21.15.146:0/3020997710 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc014670 con 0x7fe8d4159a90 2023-10-06T11:05:38.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.834+0000 7fe8dada9700 1 -- 172.21.15.146:0/3020997710 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d4149f60 con 0x7fe8d4159a90 2023-10-06T11:05:38.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.835+0000 7fe8dada9700 1 -- 172.21.15.146:0/3020997710 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8d414a440 con 0x7fe8d4159a90 2023-10-06T11:05:38.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.835+0000 7fe8c8ff9700 1 -- 172.21.15.146:0/3020997710 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7fe8cc0149e0 con 0x7fe8d4159a90 2023-10-06T11:05:38.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.836+0000 7fe8c8ff9700 1 --2- 172.21.15.146:0/3020997710 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe8c0066ea0 0x7fe8c0069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:38.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.836+0000 7fe8c8ff9700 1 -- 172.21.15.146:0/3020997710 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fe8cc0848c0 con 0x7fe8d4159a90 2023-10-06T11:05:38.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.840+0000 7fe8c8ff9700 1 -- 172.21.15.146:0/3020997710 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe8cc051e00 con 0x7fe8d4159a90 2023-10-06T11:05:38.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.850+0000 7fe8d8b45700 1 --2- 172.21.15.146:0/3020997710 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe8c0066ea0 0x7fe8c0069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:38.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:38.850+0000 7fe8d8b45700 1 --2- 172.21.15.146:0/3020997710 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe8c0066ea0 0x7fe8c0069350 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe8d00091e0 tx=0x7fe8d0017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:39.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.027+0000 7fe8dada9700 1 -- 172.21.15.146:0/3020997710 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe8d404c380 con 0x7fe8d4159a90 2023-10-06T11:05:39.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.027+0000 7fe8c8ff9700 1 -- 172.21.15.146:0/3020997710 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v15) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe8cc055420 con 0x7fe8d4159a90 2023-10-06T11:05:39.029 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-10-06T11:05:39.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.029+0000 7fe8dada9700 1 -- 172.21.15.146:0/3020997710 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe8c0066ea0 msgr2=0x7fe8c0069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:39.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.029+0000 7fe8dada9700 1 --2- 172.21.15.146:0/3020997710 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe8c0066ea0 0x7fe8c0069350 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe8d00091e0 tx=0x7fe8d0017000 comp rx=0 tx=0).stop 2023-10-06T11:05:39.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.029+0000 7fe8dada9700 1 -- 172.21.15.146:0/3020997710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8d4159a90 msgr2=0x7fe8d40ade90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:39.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.029+0000 7fe8dada9700 1 --2- 172.21.15.146:0/3020997710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8d4159a90 0x7fe8d40ade90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc009fa0 tx=0x7fe8cc009900 comp rx=0 tx=0).stop 2023-10-06T11:05:39.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.029+0000 7fe8dada9700 1 -- 172.21.15.146:0/3020997710 shutdown_connections 2023-10-06T11:05:39.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.029+0000 7fe8dada9700 1 --2- 172.21.15.146:0/3020997710 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe8c0066ea0 0x7fe8c0069350 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:39.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.029+0000 7fe8dada9700 1 --2- 172.21.15.146:0/3020997710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8d4159a90 0x7fe8d40ade90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:39.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.029+0000 7fe8dada9700 1 --2- 172.21.15.146:0/3020997710 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8d40aecd0 0x7fe8d414a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:39.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.029+0000 7fe8dada9700 1 --2- 172.21.15.146:0/3020997710 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8d40cdde0 0x7fe8d40c97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:39.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.029+0000 7fe8dada9700 1 -- 172.21.15.146:0/3020997710 >> 172.21.15.146:0/3020997710 conn(0x7fe8d4068580 msgr2=0x7fe8d40b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:39.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.029+0000 7fe8dada9700 1 -- 172.21.15.146:0/3020997710 shutdown_connections 2023-10-06T11:05:39.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.029+0000 7fe8dada9700 1 -- 172.21.15.146:0/3020997710 wait complete. 2023-10-06T11:05:39.043 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:05:39.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.162+0000 7f5517fff700 1 Processor -- start 2023-10-06T11:05:39.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.162+0000 7f5517fff700 1 -- start start 2023-10-06T11:05:39.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.163+0000 7f5517fff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f551806ec90 0x7f55181641a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:39.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.163+0000 7f5517fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55180c8b80 con 0x7f55181595d0 2023-10-06T11:05:39.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.163+0000 7f5517fff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55180c7fb0 con 0x7f5518068b90 2023-10-06T11:05:39.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.163+0000 7f5517fff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55180ca7d0 con 0x7f551806ec90 2023-10-06T11:05:39.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.163+0000 7f5516ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f55181595d0 0x7f5518068480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38320/0 (socket says 172.21.15.146:38320) 2023-10-06T11:05:39.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.163+0000 7f5516ffd700 1 -- 172.21.15.146:0/3670406914 learned_addr learned my addr 172.21.15.146:0/3670406914 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:05:39.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.164+0000 7f55177fe700 1 --2- 172.21.15.146:0/3670406914 >> v2:172.21.15.151:3300/0 conn(0x7f551806ec90 0x7f55181641a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:39.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.164+0000 7f55167fc700 1 -- 172.21.15.146:0/3670406914 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1865805924 0 0) 0x7f55180c7fb0 con 0x7f5518068b90 2023-10-06T11:05:39.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.164+0000 7f55167fc700 1 -- 172.21.15.146:0/3670406914 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5504003570 con 0x7f5518068b90 2023-10-06T11:05:39.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.164+0000 7f55177fe700 1 -- 172.21.15.146:0/3670406914 >> v1:172.21.15.151:6789/0 conn(0x7f5518068b90 legacy=0x7f551806e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:39.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.164+0000 7f55177fe700 1 -- 172.21.15.146:0/3670406914 >> v1:172.21.15.146:6789/0 conn(0x7f55181595d0 legacy=0x7f5518068480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:39.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.164+0000 7f55177fe700 1 -- 172.21.15.146:0/3670406914 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55180c8250 con 0x7f551806ec90 2023-10-06T11:05:39.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.164+0000 7f55177fe700 1 --2- 172.21.15.146:0/3670406914 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f551806ec90 0x7f55181641a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5510009e60 tx=0x7f5510009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89c8f5d9a9e7b63f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:39.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.164+0000 7f55167fc700 1 -- 172.21.15.146:0/3670406914 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551000e070 con 0x7f551806ec90 2023-10-06T11:05:39.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.164+0000 7f55167fc700 1 -- 172.21.15.146:0/3670406914 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f551000bb60 con 0x7f551806ec90 2023-10-06T11:05:39.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.164+0000 7f55167fc700 1 -- 172.21.15.146:0/3670406914 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5510012430 con 0x7f551806ec90 2023-10-06T11:05:39.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.165+0000 7f5517fff700 1 -- 172.21.15.146:0/3670406914 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f551806ec90 msgr2=0x7f55181641a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:39.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.165+0000 7f5517fff700 1 --2- 172.21.15.146:0/3670406914 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f551806ec90 0x7f55181641a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5510009e60 tx=0x7f5510009780 comp rx=0 tx=0).stop 2023-10-06T11:05:39.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.165+0000 7f5517fff700 1 -- 172.21.15.146:0/3670406914 shutdown_connections 2023-10-06T11:05:39.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.165+0000 7f5517fff700 1 --2- 172.21.15.146:0/3670406914 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f551806ec90 0x7f55181641a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:39.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.165+0000 7f5517fff700 1 -- 172.21.15.146:0/3670406914 >> 172.21.15.146:0/3670406914 conn(0x7f55180c9dc0 msgr2=0x7f551806dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:39.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.165+0000 7f5517fff700 1 -- 172.21.15.146:0/3670406914 shutdown_connections 2023-10-06T11:05:39.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.165+0000 7f5517fff700 1 -- 172.21.15.146:0/3670406914 wait complete. 2023-10-06T11:05:39.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.166+0000 7f5517fff700 1 Processor -- start 2023-10-06T11:05:39.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.166+0000 7f5517fff700 1 -- start start 2023-10-06T11:05:39.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.167+0000 7f5517fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5518068b90 0x7f551814c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:39.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.167+0000 7f5517fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f551806ec90 0x7f55180c3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:39.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.167+0000 7f5517fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55181595d0 0x7f55180c1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:39.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.167+0000 7f5517fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55180c5020 con 0x7f5518068b90 2023-10-06T11:05:39.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.167+0000 7f5517fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55180c54b0 con 0x7f55181595d0 2023-10-06T11:05:39.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.167+0000 7f5517fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55180c4410 con 0x7f551806ec90 2023-10-06T11:05:39.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.167+0000 7f5516ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5518068b90 0x7f551814c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:39.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.167+0000 7f5516ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5518068b90 0x7f551814c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50176/0 (socket says 172.21.15.146:50176) 2023-10-06T11:05:39.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.167+0000 7f5516ffd700 1 -- 172.21.15.146:0/3233611700 learned_addr learned my addr 172.21.15.146:0/3233611700 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:39.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.167+0000 7f55177fe700 1 --2- 172.21.15.146:0/3233611700 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55181595d0 0x7f55180c1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:39.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.167+0000 7f550ffff700 1 --2- 172.21.15.146:0/3233611700 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f551806ec90 0x7f55180c3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:39.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.167+0000 7f5516ffd700 1 -- 172.21.15.146:0/3233611700 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f551806ec90 msgr2=0x7f55180c3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:39.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.167+0000 7f5516ffd700 1 --2- 172.21.15.146:0/3233611700 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f551806ec90 0x7f55180c3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:39.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.167+0000 7f5516ffd700 1 -- 172.21.15.146:0/3233611700 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55181595d0 msgr2=0x7f55180c1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:39.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.167+0000 7f5516ffd700 1 --2- 172.21.15.146:0/3233611700 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55181595d0 0x7f55180c1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:39.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.167+0000 7f5516ffd700 1 -- 172.21.15.146:0/3233611700 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5510009a20 con 0x7f5518068b90 2023-10-06T11:05:39.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.167+0000 7f5516ffd700 1 --2- 172.21.15.146:0/3233611700 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5518068b90 0x7f551814c450 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f550800c560 tx=0x7f5508001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:39.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.185+0000 7f550effd700 1 -- 172.21.15.146:0/3233611700 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5508005b30 con 0x7f5518068b90 2023-10-06T11:05:39.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.185+0000 7f5517fff700 1 -- 172.21.15.146:0/3233611700 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55180c46f0 con 0x7f5518068b90 2023-10-06T11:05:39.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.186+0000 7f5517fff700 1 -- 172.21.15.146:0/3233611700 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55180c4cb0 con 0x7f5518068b90 2023-10-06T11:05:39.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.186+0000 7f550effd700 1 -- 172.21.15.146:0/3233611700 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55080070d0 con 0x7f5518068b90 2023-10-06T11:05:39.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.186+0000 7f550effd700 1 -- 172.21.15.146:0/3233611700 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5508005ea0 con 0x7f5518068b90 2023-10-06T11:05:39.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.187+0000 7f5517fff700 1 -- 172.21.15.146:0/3233611700 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54fc0052b0 con 0x7f5518068b90 2023-10-06T11:05:39.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.187+0000 7f550effd700 1 -- 172.21.15.146:0/3233611700 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f55080074d0 con 0x7f5518068b90 2023-10-06T11:05:39.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.188+0000 7f550effd700 1 --2- 172.21.15.146:0/3233611700 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f54f8066ea0 0x7f54f8069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:39.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.188+0000 7f550ffff700 1 --2- 172.21.15.146:0/3233611700 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f54f8066ea0 0x7f54f8069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:39.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.188+0000 7f550effd700 1 -- 172.21.15.146:0/3233611700 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f5508083570 con 0x7f5518068b90 2023-10-06T11:05:39.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.188+0000 7f550ffff700 1 --2- 172.21.15.146:0/3233611700 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f54f8066ea0 0x7f54f8069350 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f55180aa930 tx=0x7f5500007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:39.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.192+0000 7f550effd700 1 -- 172.21.15.146:0/3233611700 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f550804b5a0 con 0x7f5518068b90 2023-10-06T11:05:39.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.381+0000 7f5517fff700 1 -- 172.21.15.146:0/3233611700 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f54fc005ae0 con 0x7f5518068b90 2023-10-06T11:05:39.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.382+0000 7f550effd700 1 -- 172.21.15.146:0/3233611700 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f55080170a0 con 0x7f5518068b90 2023-10-06T11:05:39.384 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-10-06T11:05:39.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.384+0000 7f5517fff700 1 -- 172.21.15.146:0/3233611700 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f54f8066ea0 msgr2=0x7f54f8069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:39.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.384+0000 7f5517fff700 1 --2- 172.21.15.146:0/3233611700 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f54f8066ea0 0x7f54f8069350 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f55180aa930 tx=0x7f5500007d50 comp rx=0 tx=0).stop 2023-10-06T11:05:39.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.384+0000 7f5517fff700 1 -- 172.21.15.146:0/3233611700 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5518068b90 msgr2=0x7f551814c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:39.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.384+0000 7f5517fff700 1 --2- 172.21.15.146:0/3233611700 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5518068b90 0x7f551814c450 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f550800c560 tx=0x7f5508001020 comp rx=0 tx=0).stop 2023-10-06T11:05:39.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.384+0000 7f5517fff700 1 -- 172.21.15.146:0/3233611700 shutdown_connections 2023-10-06T11:05:39.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.384+0000 7f5517fff700 1 --2- 172.21.15.146:0/3233611700 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f54f8066ea0 0x7f54f8069350 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:39.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.384+0000 7f5517fff700 1 --2- 172.21.15.146:0/3233611700 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55181595d0 0x7f55180c1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:39.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.384+0000 7f5517fff700 1 --2- 172.21.15.146:0/3233611700 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5518068b90 0x7f551814c450 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:39.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.384+0000 7f5517fff700 1 --2- 172.21.15.146:0/3233611700 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f551806ec90 0x7f55180c3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:39.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.384+0000 7f5517fff700 1 -- 172.21.15.146:0/3233611700 >> 172.21.15.146:0/3233611700 conn(0x7f55180c9dc0 msgr2=0x7f551815b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:39.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.384+0000 7f5517fff700 1 -- 172.21.15.146:0/3233611700 shutdown_connections 2023-10-06T11:05:39.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.384+0000 7f5517fff700 1 -- 172.21.15.146:0/3233611700 wait complete. 2023-10-06T11:05:39.398 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:05:39.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.512+0000 7fd564b44700 1 Processor -- start 2023-10-06T11:05:39.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.512+0000 7fd564b44700 1 -- start start 2023-10-06T11:05:39.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.513+0000 7fd564b44700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd5600ced80 0x7fd5600c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:39.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.513+0000 7fd564b44700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5600c3910 0x7fd5600cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:39.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.513+0000 7fd564b44700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5600cf210 con 0x7fd5600b0c00 2023-10-06T11:05:39.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.513+0000 7fd564b44700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5600682f0 con 0x7fd5600ced80 2023-10-06T11:05:39.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.513+0000 7fd564b44700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd560068580 con 0x7fd5600c3910 2023-10-06T11:05:39.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.513+0000 7fd55dd9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd5600ced80 0x7fd5600c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:39.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.513+0000 7fd55ed9d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5600c3910 0x7fd5600cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:39.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.513+0000 7fd55dd9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd5600ced80 0x7fd5600c8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50180/0 (socket says 172.21.15.146:50180) 2023-10-06T11:05:39.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.513+0000 7fd55dd9b700 1 -- 172.21.15.146:0/3798769447 learned_addr learned my addr 172.21.15.146:0/3798769447 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:39.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.513+0000 7fd55dd9b700 1 -- 172.21.15.146:0/3798769447 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5600c3910 msgr2=0x7fd5600cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:39.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.513+0000 7fd55dd9b700 1 --2- 172.21.15.146:0/3798769447 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5600c3910 0x7fd5600cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:39.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.513+0000 7fd55dd9b700 1 -- 172.21.15.146:0/3798769447 >> v1:172.21.15.151:6789/0 conn(0x7fd5600b0c00 legacy=0x7fd5600c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:39.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.513+0000 7fd55dd9b700 1 -- 172.21.15.146:0/3798769447 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd560068790 con 0x7fd5600ced80 2023-10-06T11:05:39.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.513+0000 7fd55d59a700 1 -- 172.21.15.146:0/3798769447 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1894745923 0 0) 0x7fd5600cf210 con 0x7fd5600b0c00 2023-10-06T11:05:39.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.513+0000 7fd55dd9b700 1 --2- 172.21.15.146:0/3798769447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5600ced80 0x7fd5600c8aa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd5480099b0 tx=0x7fd548009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8869277a3d9b2ebb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:39.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.513+0000 7fd55d59a700 1 -- 172.21.15.146:0/3798769447 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd548009ea0 con 0x7fd5600ced80 2023-10-06T11:05:39.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.514+0000 7fd55d59a700 1 -- 172.21.15.146:0/3798769447 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54800b8f0 con 0x7fd5600ced80 2023-10-06T11:05:39.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.514+0000 7fd55d59a700 1 -- 172.21.15.146:0/3798769447 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54800bc90 con 0x7fd5600ced80 2023-10-06T11:05:39.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.514+0000 7fd564b44700 1 -- 172.21.15.146:0/3798769447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5600ced80 msgr2=0x7fd5600c8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:39.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.514+0000 7fd564b44700 1 --2- 172.21.15.146:0/3798769447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5600ced80 0x7fd5600c8aa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd5480099b0 tx=0x7fd548009250 comp rx=0 tx=0).stop 2023-10-06T11:05:39.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.514+0000 7fd564b44700 1 -- 172.21.15.146:0/3798769447 shutdown_connections 2023-10-06T11:05:39.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.514+0000 7fd564b44700 1 --2- 172.21.15.146:0/3798769447 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5600c3910 0x7fd5600cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:39.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.514+0000 7fd564b44700 1 --2- 172.21.15.146:0/3798769447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5600ced80 0x7fd5600c8aa0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:39.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.514+0000 7fd564b44700 1 -- 172.21.15.146:0/3798769447 >> 172.21.15.146:0/3798769447 conn(0x7fd560067c50 msgr2=0x7fd5600ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:39.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.514+0000 7fd564b44700 1 -- 172.21.15.146:0/3798769447 shutdown_connections 2023-10-06T11:05:39.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.514+0000 7fd564b44700 1 -- 172.21.15.146:0/3798769447 wait complete. 2023-10-06T11:05:39.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.515+0000 7fd564b44700 1 Processor -- start 2023-10-06T11:05:39.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.515+0000 7fd564b44700 1 -- start start 2023-10-06T11:05:39.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.516+0000 7fd564b44700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5600b0c00 0x7fd5600c6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:39.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.516+0000 7fd564b44700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5600c3910 0x7fd560156be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:39.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.516+0000 7fd564b44700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5600ced80 0x7fd5600c5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:39.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.516+0000 7fd564b44700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd560157830 con 0x7fd5600b0c00 2023-10-06T11:05:39.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.516+0000 7fd564b44700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56009ade0 con 0x7fd5600ced80 2023-10-06T11:05:39.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.516+0000 7fd564b44700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5600c60f0 con 0x7fd5600c3910 2023-10-06T11:05:39.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.516+0000 7fd55e59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5600b0c00 0x7fd5600c6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:39.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.516+0000 7fd55e59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5600b0c00 0x7fd5600c6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50184/0 (socket says 172.21.15.146:50184) 2023-10-06T11:05:39.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.516+0000 7fd55e59c700 1 -- 172.21.15.146:0/1360269101 learned_addr learned my addr 172.21.15.146:0/1360269101 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:39.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.516+0000 7fd55e59c700 1 -- 172.21.15.146:0/1360269101 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5600c3910 msgr2=0x7fd560156be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:39.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.516+0000 7fd55dd9b700 1 --2- 172.21.15.146:0/1360269101 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5600c3910 0x7fd560156be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:39.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.516+0000 7fd55ed9d700 1 --2- 172.21.15.146:0/1360269101 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5600ced80 0x7fd5600c5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:39.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.516+0000 7fd55e59c700 1 --2- 172.21.15.146:0/1360269101 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5600c3910 0x7fd560156be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:39.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.516+0000 7fd55e59c700 1 -- 172.21.15.146:0/1360269101 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5600ced80 msgr2=0x7fd5600c5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:39.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.516+0000 7fd55e59c700 1 --2- 172.21.15.146:0/1360269101 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5600ced80 0x7fd5600c5510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:39.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.516+0000 7fd55e59c700 1 -- 172.21.15.146:0/1360269101 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5480094f0 con 0x7fd5600b0c00 2023-10-06T11:05:39.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.517+0000 7fd55e59c700 1 --2- 172.21.15.146:0/1360269101 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5600b0c00 0x7fd5600c6860 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd55800c910 tx=0x7fd558001700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:39.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.517+0000 7fd5567fc700 1 -- 172.21.15.146:0/1360269101 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55800a7e0 con 0x7fd5600b0c00 2023-10-06T11:05:39.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.517+0000 7fd5567fc700 1 -- 172.21.15.146:0/1360269101 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd55800a960 con 0x7fd5600b0c00 2023-10-06T11:05:39.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.517+0000 7fd564b44700 1 -- 172.21.15.146:0/1360269101 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5600c63d0 con 0x7fd5600b0c00 2023-10-06T11:05:39.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.517+0000 7fd5567fc700 1 -- 172.21.15.146:0/1360269101 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55800ad20 con 0x7fd5600b0c00 2023-10-06T11:05:39.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.517+0000 7fd564b44700 1 -- 172.21.15.146:0/1360269101 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd56009aa70 con 0x7fd5600b0c00 2023-10-06T11:05:39.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.518+0000 7fd564b44700 1 -- 172.21.15.146:0/1360269101 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd560064010 con 0x7fd5600b0c00 2023-10-06T11:05:39.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.518+0000 7fd5567fc700 1 -- 172.21.15.146:0/1360269101 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7fd558003030 con 0x7fd5600b0c00 2023-10-06T11:05:39.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.518+0000 7fd5567fc700 1 --2- 172.21.15.146:0/1360269101 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd540066ea0 0x7fd540069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:39.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.519+0000 7fd5567fc700 1 -- 172.21.15.146:0/1360269101 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fd558084340 con 0x7fd5600b0c00 2023-10-06T11:05:39.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.519+0000 7fd55dd9b700 1 --2- 172.21.15.146:0/1360269101 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd540066ea0 0x7fd540069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:39.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.519+0000 7fd55dd9b700 1 --2- 172.21.15.146:0/1360269101 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd540066ea0 0x7fd540069350 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd5480099b0 tx=0x7fd548017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:39.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.523+0000 7fd5567fc700 1 -- 172.21.15.146:0/1360269101 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd558051880 con 0x7fd5600b0c00 2023-10-06T11:05:39.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.749+0000 7fd564b44700 1 -- 172.21.15.146:0/1360269101 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd56004c380 con 0x7fd5600b0c00 2023-10-06T11:05:39.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.750+0000 7fd5567fc700 1 -- 172.21.15.146:0/1360269101 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3530 (secure 0 0 0) 0x7fd558054ea0 con 0x7fd5600b0c00 2023-10-06T11:05:39.759 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:05:39.759 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2812328960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2812328960},{"type":"v1","addr":"172.21.15.151:6835","nonce":2812328960}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/178026783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":178026783},{"type":"v1","addr":"172.21.15.146:6836","nonce":178026783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/716185126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":716185126},{"type":"v1","addr":"172.21.15.146:6837","nonce":716185126}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/1317728156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1317728156},{"type":"v1","addr":"172.21.15.151:6833","nonce":1317728156}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-10-06T11:05:39.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.752+0000 7fd564b44700 1 -- 172.21.15.146:0/1360269101 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd540066ea0 msgr2=0x7fd540069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:39.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.752+0000 7fd564b44700 1 --2- 172.21.15.146:0/1360269101 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd540066ea0 0x7fd540069350 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd5480099b0 tx=0x7fd548017000 comp rx=0 tx=0).stop 2023-10-06T11:05:39.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.752+0000 7fd564b44700 1 -- 172.21.15.146:0/1360269101 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5600b0c00 msgr2=0x7fd5600c6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:39.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.752+0000 7fd564b44700 1 --2- 172.21.15.146:0/1360269101 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5600b0c00 0x7fd5600c6860 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd55800c910 tx=0x7fd558001700 comp rx=0 tx=0).stop 2023-10-06T11:05:39.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.752+0000 7fd564b44700 1 -- 172.21.15.146:0/1360269101 shutdown_connections 2023-10-06T11:05:39.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.752+0000 7fd564b44700 1 --2- 172.21.15.146:0/1360269101 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd540066ea0 0x7fd540069350 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:39.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.752+0000 7fd564b44700 1 --2- 172.21.15.146:0/1360269101 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5600ced80 0x7fd5600c5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:39.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.752+0000 7fd564b44700 1 --2- 172.21.15.146:0/1360269101 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5600b0c00 0x7fd5600c6860 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:39.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.752+0000 7fd564b44700 1 --2- 172.21.15.146:0/1360269101 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5600c3910 0x7fd560156be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:39.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.752+0000 7fd564b44700 1 -- 172.21.15.146:0/1360269101 >> 172.21.15.146:0/1360269101 conn(0x7fd560067c50 msgr2=0x7fd560159210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:39.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.752+0000 7fd564b44700 1 -- 172.21.15.146:0/1360269101 shutdown_connections 2023-10-06T11:05:39.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.752+0000 7fd564b44700 1 -- 172.21.15.146:0/1360269101 wait complete. 2023-10-06T11:05:39.761 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 3 2023-10-06T11:05:39.766 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:05:39.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.879+0000 7fce886f4700 1 Processor -- start 2023-10-06T11:05:39.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.879+0000 7fce886f4700 1 -- start start 2023-10-06T11:05:39.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.880+0000 7fce886f4700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce80153ab0 0x7fce8015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:39.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.880+0000 7fce886f4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fce80153e80 0x7fce80068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:39.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.880+0000 7fce886f4700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce8015ac30 con 0x7fce800689d0 2023-10-06T11:05:39.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.880+0000 7fce886f4700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce80068e50 con 0x7fce80153e80 2023-10-06T11:05:39.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.880+0000 7fce886f4700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce800b4510 con 0x7fce80153ab0 2023-10-06T11:05:39.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.880+0000 7fce85c8f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fce80153e80 0x7fce80068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:39.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.880+0000 7fce86c91700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fce800689d0 0x7fce8015d270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38322/0 (socket says 172.21.15.146:38322) 2023-10-06T11:05:39.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.880+0000 7fce86c91700 1 -- 172.21.15.146:0/2523809407 learned_addr learned my addr 172.21.15.146:0/2523809407 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:05:39.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.880+0000 7fce86490700 1 --2- 172.21.15.146:0/2523809407 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce80153ab0 0x7fce8015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:39.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.880+0000 7fce8548e700 1 -- 172.21.15.146:0/2523809407 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1509656180 0 0) 0x7fce78001490 con 0x7fce800689d0 2023-10-06T11:05:39.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.880+0000 7fce8548e700 1 -- 172.21.15.146:0/2523809407 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce6c003570 con 0x7fce800689d0 2023-10-06T11:05:39.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.880+0000 7fce85c8f700 1 -- 172.21.15.146:0/2523809407 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce80153ab0 msgr2=0x7fce8015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:39.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.880+0000 7fce85c8f700 1 --2- 172.21.15.146:0/2523809407 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce80153ab0 0x7fce8015a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:39.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.880+0000 7fce85c8f700 1 -- 172.21.15.146:0/2523809407 >> v1:172.21.15.146:6789/0 conn(0x7fce800689d0 legacy=0x7fce8015d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:39.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.880+0000 7fce85c8f700 1 -- 172.21.15.146:0/2523809407 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce800b6530 con 0x7fce80153e80 2023-10-06T11:05:39.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.880+0000 7fce86490700 1 --2- 172.21.15.146:0/2523809407 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce80153ab0 0x7fce8015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:05:39.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.881+0000 7fce85c8f700 1 --2- 172.21.15.146:0/2523809407 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce80153e80 0x7fce80068490 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fce700098e0 tx=0x7fce700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82780ea226337233 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:39.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.881+0000 7fce8548e700 1 -- 172.21.15.146:0/2523809407 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce70011630 con 0x7fce80153e80 2023-10-06T11:05:39.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.881+0000 7fce8548e700 1 -- 172.21.15.146:0/2523809407 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce70011790 con 0x7fce80153e80 2023-10-06T11:05:39.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.881+0000 7fce8548e700 1 -- 172.21.15.146:0/2523809407 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce70011b30 con 0x7fce80153e80 2023-10-06T11:05:39.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.881+0000 7fce886f4700 1 -- 172.21.15.146:0/2523809407 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce80153e80 msgr2=0x7fce80068490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:39.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.881+0000 7fce886f4700 1 --2- 172.21.15.146:0/2523809407 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce80153e80 0x7fce80068490 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fce700098e0 tx=0x7fce700091a0 comp rx=0 tx=0).stop 2023-10-06T11:05:39.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.881+0000 7fce886f4700 1 -- 172.21.15.146:0/2523809407 shutdown_connections 2023-10-06T11:05:39.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.881+0000 7fce886f4700 1 --2- 172.21.15.146:0/2523809407 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce80153ab0 0x7fce8015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:39.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.881+0000 7fce886f4700 1 --2- 172.21.15.146:0/2523809407 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce80153e80 0x7fce80068490 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:39.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.881+0000 7fce886f4700 1 -- 172.21.15.146:0/2523809407 >> 172.21.15.146:0/2523809407 conn(0x7fce8006eba0 msgr2=0x7fce8006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:39.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.881+0000 7fce886f4700 1 -- 172.21.15.146:0/2523809407 shutdown_connections 2023-10-06T11:05:39.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.881+0000 7fce886f4700 1 -- 172.21.15.146:0/2523809407 wait complete. 2023-10-06T11:05:39.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.882+0000 7fce886f4700 1 Processor -- start 2023-10-06T11:05:39.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.882+0000 7fce886f4700 1 -- start start 2023-10-06T11:05:39.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.883+0000 7fce886f4700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce800689d0 0x7fce8013fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:39.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.883+0000 7fce886f4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce80153ab0 0x7fce80143be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:39.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.883+0000 7fce886f4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce80153e80 0x7fce80144120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:39.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.883+0000 7fce886f4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce80152a50 con 0x7fce80153e80 2023-10-06T11:05:39.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.883+0000 7fce886f4700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce80143380 con 0x7fce80153ab0 2023-10-06T11:05:39.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.883+0000 7fce886f4700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce80142770 con 0x7fce800689d0 2023-10-06T11:05:39.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.883+0000 7fce86c91700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce80153e80 0x7fce80144120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:39.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.883+0000 7fce86c91700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce80153e80 0x7fce80144120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50202/0 (socket says 172.21.15.146:50202) 2023-10-06T11:05:39.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.883+0000 7fce86c91700 1 -- 172.21.15.146:0/2389439473 learned_addr learned my addr 172.21.15.146:0/2389439473 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:39.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.883+0000 7fce86c91700 1 -- 172.21.15.146:0/2389439473 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce800689d0 msgr2=0x7fce8013fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:39.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.883+0000 7fce86490700 1 --2- 172.21.15.146:0/2389439473 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce800689d0 0x7fce8013fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:39.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.883+0000 7fce86c91700 1 --2- 172.21.15.146:0/2389439473 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce800689d0 0x7fce8013fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:39.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.883+0000 7fce85c8f700 1 --2- 172.21.15.146:0/2389439473 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce80153ab0 0x7fce80143be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:39.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.883+0000 7fce86c91700 1 -- 172.21.15.146:0/2389439473 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce80153ab0 msgr2=0x7fce80143be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:39.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.883+0000 7fce86c91700 1 --2- 172.21.15.146:0/2389439473 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce80153ab0 0x7fce80143be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:39.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.884+0000 7fce86c91700 1 -- 172.21.15.146:0/2389439473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce7c009420 con 0x7fce80153e80 2023-10-06T11:05:39.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.884+0000 7fce85c8f700 1 --2- 172.21.15.146:0/2389439473 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce80153ab0 0x7fce80143be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:05:39.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.884+0000 7fce86c91700 1 --2- 172.21.15.146:0/2389439473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce80153e80 0x7fce80144120 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fce7800cc40 tx=0x7fce78001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:39.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.884+0000 7fce767fc700 1 -- 172.21.15.146:0/2389439473 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7800a960 con 0x7fce80153e80 2023-10-06T11:05:39.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.884+0000 7fce767fc700 1 -- 172.21.15.146:0/2389439473 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce7800aac0 con 0x7fce80153e80 2023-10-06T11:05:39.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.884+0000 7fce886f4700 1 -- 172.21.15.146:0/2389439473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce70009420 con 0x7fce80153e80 2023-10-06T11:05:39.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.884+0000 7fce767fc700 1 -- 172.21.15.146:0/2389439473 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce7800ae40 con 0x7fce80153e80 2023-10-06T11:05:39.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.884+0000 7fce886f4700 1 -- 172.21.15.146:0/2389439473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce80142db0 con 0x7fce80153e80 2023-10-06T11:05:39.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.885+0000 7fce886f4700 1 -- 172.21.15.146:0/2389439473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce801434f0 con 0x7fce80153e80 2023-10-06T11:05:39.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.885+0000 7fce767fc700 1 -- 172.21.15.146:0/2389439473 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7fce78007300 con 0x7fce80153e80 2023-10-06T11:05:39.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.885+0000 7fce767fc700 1 --2- 172.21.15.146:0/2389439473 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fce64066ea0 0x7fce64069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:39.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.885+0000 7fce767fc700 1 -- 172.21.15.146:0/2389439473 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fce78084540 con 0x7fce80153e80 2023-10-06T11:05:39.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.885+0000 7fce86490700 1 --2- 172.21.15.146:0/2389439473 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fce64066ea0 0x7fce64069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:39.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.886+0000 7fce86490700 1 --2- 172.21.15.146:0/2389439473 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fce64066ea0 0x7fce64069350 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fce7c006f00 tx=0x7fce7c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:39.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.890+0000 7fce767fc700 1 -- 172.21.15.146:0/2389439473 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fce78051a70 con 0x7fce80153e80 2023-10-06T11:05:39.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:39.909+0000 7fce767fc700 1 -- 172.21.15.146:0/2389439473 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fce78051e40 con 0x7fce80153e80 2023-10-06T11:05:40.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.076+0000 7fce886f4700 1 -- 172.21.15.146:0/2389439473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce8015ac30 con 0x7fce80153e80 2023-10-06T11:05:40.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.077+0000 7fce767fc700 1 -- 172.21.15.146:0/2389439473 <== mon.0 v2:172.21.15.146:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+13696 (secure 0 0 0) 0x7fce8015ac30 con 0x7fce80153e80 2023-10-06T11:05:40.079 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:05:40.079 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":16,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:05:39.316956+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:05:40.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.079+0000 7fce886f4700 1 -- 172.21.15.146:0/2389439473 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fce64066ea0 msgr2=0x7fce64069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:40.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.079+0000 7fce886f4700 1 --2- 172.21.15.146:0/2389439473 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fce64066ea0 0x7fce64069350 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fce7c006f00 tx=0x7fce7c008040 comp rx=0 tx=0).stop 2023-10-06T11:05:40.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.079+0000 7fce886f4700 1 -- 172.21.15.146:0/2389439473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce80153e80 msgr2=0x7fce80144120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:40.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.079+0000 7fce886f4700 1 --2- 172.21.15.146:0/2389439473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce80153e80 0x7fce80144120 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fce7800cc40 tx=0x7fce78001a30 comp rx=0 tx=0).stop 2023-10-06T11:05:40.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.079+0000 7fce886f4700 1 -- 172.21.15.146:0/2389439473 shutdown_connections 2023-10-06T11:05:40.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.079+0000 7fce886f4700 1 --2- 172.21.15.146:0/2389439473 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fce64066ea0 0x7fce64069350 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:40.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.079+0000 7fce886f4700 1 --2- 172.21.15.146:0/2389439473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce80153e80 0x7fce80144120 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:40.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.079+0000 7fce886f4700 1 --2- 172.21.15.146:0/2389439473 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce800689d0 0x7fce8013fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:40.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.079+0000 7fce886f4700 1 --2- 172.21.15.146:0/2389439473 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce80153ab0 0x7fce80143be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:40.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.079+0000 7fce886f4700 1 -- 172.21.15.146:0/2389439473 >> 172.21.15.146:0/2389439473 conn(0x7fce8006eba0 msgr2=0x7fce800d0220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:40.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.079+0000 7fce886f4700 1 -- 172.21.15.146:0/2389439473 shutdown_connections 2023-10-06T11:05:40.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.079+0000 7fce886f4700 1 -- 172.21.15.146:0/2389439473 wait complete. 2023-10-06T11:05:40.093 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:05:36.687307+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:05:37.171199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T11:05:40.093 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:05:40.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.209+0000 7f1fcd3a1700 1 Processor -- start 2023-10-06T11:05:40.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.209+0000 7f1fcd3a1700 1 -- start start 2023-10-06T11:05:40.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.210+0000 7f1fcd3a1700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1fc80676c0 0x7f1fc80b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:40.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.210+0000 7f1fcd3a1700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1fc8067a90 0x7f1fc815ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:40.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.210+0000 7f1fcd3a1700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fc815a840 con 0x7f1fc806e690 2023-10-06T11:05:40.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.210+0000 7f1fcd3a1700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fc815ab20 con 0x7f1fc8067a90 2023-10-06T11:05:40.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.210+0000 7f1fcd3a1700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc815ae00 con 0x7f1fc80676c0 2023-10-06T11:05:40.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.210+0000 7f1fc77fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f1fc806e690 0x7f1fc806eae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38336/0 (socket says 172.21.15.146:38336) 2023-10-06T11:05:40.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.210+0000 7f1fc77fe700 1 -- 172.21.15.146:0/3604023271 learned_addr learned my addr 172.21.15.146:0/3604023271 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:05:40.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.210+0000 7f1fc6ffd700 1 --2- 172.21.15.146:0/3604023271 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1fc80676c0 0x7f1fc80b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:40.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.210+0000 7f1fbe7fc700 1 --2- 172.21.15.146:0/3604023271 >> v2:172.21.15.151:3300/0 conn(0x7f1fc8067a90 0x7f1fc815ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:40.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.211+0000 7f1fc67fc700 1 -- 172.21.15.146:0/3604023271 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1752879691 0 0) 0x7f1fc815a840 con 0x7f1fc806e690 2023-10-06T11:05:40.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.211+0000 7f1fc67fc700 1 -- 172.21.15.146:0/3604023271 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fb4003570 con 0x7f1fc806e690 2023-10-06T11:05:40.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.211+0000 7f1fc6ffd700 1 -- 172.21.15.146:0/3604023271 >> v2:172.21.15.151:3300/0 conn(0x7f1fc8067a90 msgr2=0x7f1fc815ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:40.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.211+0000 7f1fc6ffd700 1 --2- 172.21.15.146:0/3604023271 >> v2:172.21.15.151:3300/0 conn(0x7f1fc8067a90 0x7f1fc815ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:40.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.211+0000 7f1fc6ffd700 1 -- 172.21.15.146:0/3604023271 >> v1:172.21.15.146:6789/0 conn(0x7f1fc806e690 legacy=0x7f1fc806eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:40.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.211+0000 7f1fc6ffd700 1 -- 172.21.15.146:0/3604023271 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc815d5b0 con 0x7f1fc80676c0 2023-10-06T11:05:40.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.211+0000 7f1fbe7fc700 1 --2- 172.21.15.146:0/3604023271 >> v2:172.21.15.151:3300/0 conn(0x7f1fc8067a90 0x7f1fc815ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:05:40.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.211+0000 7f1fc6ffd700 1 --2- 172.21.15.146:0/3604023271 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1fc80676c0 0x7f1fc80b0fa0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1fb80098e0 tx=0x7f1fb80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42a9d9a6af7a689b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:40.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.211+0000 7f1fc67fc700 1 -- 172.21.15.146:0/3604023271 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb8011630 con 0x7f1fc80676c0 2023-10-06T11:05:40.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.211+0000 7f1fc67fc700 1 -- 172.21.15.146:0/3604023271 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb8011790 con 0x7f1fc80676c0 2023-10-06T11:05:40.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.211+0000 7f1fc67fc700 1 -- 172.21.15.146:0/3604023271 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb8011b30 con 0x7f1fc80676c0 2023-10-06T11:05:40.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.211+0000 7f1fcd3a1700 1 -- 172.21.15.146:0/3604023271 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1fc80676c0 msgr2=0x7f1fc80b0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:40.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.211+0000 7f1fcd3a1700 1 --2- 172.21.15.146:0/3604023271 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1fc80676c0 0x7f1fc80b0fa0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1fb80098e0 tx=0x7f1fb80091a0 comp rx=0 tx=0).stop 2023-10-06T11:05:40.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.212+0000 7f1fcd3a1700 1 -- 172.21.15.146:0/3604023271 shutdown_connections 2023-10-06T11:05:40.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.212+0000 7f1fcd3a1700 1 --2- 172.21.15.146:0/3604023271 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1fc80676c0 0x7f1fc80b0fa0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:40.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.212+0000 7f1fcd3a1700 1 --2- 172.21.15.146:0/3604023271 >> v2:172.21.15.151:3300/0 conn(0x7f1fc8067a90 0x7f1fc815ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:40.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.212+0000 7f1fcd3a1700 1 -- 172.21.15.146:0/3604023271 >> 172.21.15.146:0/3604023271 conn(0x7f1fc8068580 msgr2=0x7f1fc8068980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:40.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.212+0000 7f1fcd3a1700 1 -- 172.21.15.146:0/3604023271 shutdown_connections 2023-10-06T11:05:40.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.212+0000 7f1fcd3a1700 1 -- 172.21.15.146:0/3604023271 wait complete. 2023-10-06T11:05:40.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.213+0000 7f1fcd3a1700 1 Processor -- start 2023-10-06T11:05:40.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.213+0000 7f1fcd3a1700 1 -- start start 2023-10-06T11:05:40.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.213+0000 7f1fcd3a1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fc80676c0 0x7f1fc80c20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:40.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.213+0000 7f1fcd3a1700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1fc8067a90 0x7f1fc816d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:40.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.214+0000 7f1fcd3a1700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1fc806e690 0x7f1fc8141490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:40.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.214+0000 7f1fcd3a1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc816cdf0 con 0x7f1fc80676c0 2023-10-06T11:05:40.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.214+0000 7f1fcd3a1700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc80af390 con 0x7f1fc8067a90 2023-10-06T11:05:40.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.214+0000 7f1fcd3a1700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc80c25e0 con 0x7f1fc806e690 2023-10-06T11:05:40.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.214+0000 7f1fc6ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fc80676c0 0x7f1fc80c20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:40.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.214+0000 7f1fc6ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fc80676c0 0x7f1fc80c20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50212/0 (socket says 172.21.15.146:50212) 2023-10-06T11:05:40.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.214+0000 7f1fc6ffd700 1 -- 172.21.15.146:0/3849723929 learned_addr learned my addr 172.21.15.146:0/3849723929 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:40.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.214+0000 7f1fc77fe700 1 --2- 172.21.15.146:0/3849723929 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1fc806e690 0x7f1fc8141490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:40.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.214+0000 7f1fbe7fc700 1 --2- 172.21.15.146:0/3849723929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1fc8067a90 0x7f1fc816d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:40.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.214+0000 7f1fc6ffd700 1 -- 172.21.15.146:0/3849723929 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1fc806e690 msgr2=0x7f1fc8141490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:40.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.214+0000 7f1fc6ffd700 1 --2- 172.21.15.146:0/3849723929 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1fc806e690 0x7f1fc8141490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:40.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.214+0000 7f1fc6ffd700 1 -- 172.21.15.146:0/3849723929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1fc8067a90 msgr2=0x7f1fc816d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:40.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.214+0000 7f1fc6ffd700 1 --2- 172.21.15.146:0/3849723929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1fc8067a90 0x7f1fc816d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:40.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.214+0000 7f1fc6ffd700 1 -- 172.21.15.146:0/3849723929 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb0009420 con 0x7f1fc80676c0 2023-10-06T11:05:40.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.214+0000 7f1fc6ffd700 1 --2- 172.21.15.146:0/3849723929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fc80676c0 0x7f1fc80c20a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1fc815af40 tx=0x7f1fb8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:40.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.214+0000 7f1fbf7fe700 1 -- 172.21.15.146:0/3849723929 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb8000d10 con 0x7f1fc80676c0 2023-10-06T11:05:40.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.214+0000 7f1fbf7fe700 1 -- 172.21.15.146:0/3849723929 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb8011b10 con 0x7f1fc80676c0 2023-10-06T11:05:40.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.214+0000 7f1fcd3a1700 1 -- 172.21.15.146:0/3849723929 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb8009420 con 0x7f1fc80676c0 2023-10-06T11:05:40.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.214+0000 7f1fbf7fe700 1 -- 172.21.15.146:0/3849723929 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb8025660 con 0x7f1fc80676c0 2023-10-06T11:05:40.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.214+0000 7f1fcd3a1700 1 -- 172.21.15.146:0/3849723929 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fc80aea60 con 0x7f1fc80676c0 2023-10-06T11:05:40.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.215+0000 7f1fcd3a1700 1 -- 172.21.15.146:0/3849723929 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fc804c380 con 0x7f1fc80676c0 2023-10-06T11:05:40.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.215+0000 7f1fbf7fe700 1 -- 172.21.15.146:0/3849723929 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1fb8025a50 con 0x7f1fc80676c0 2023-10-06T11:05:40.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.216+0000 7f1fbf7fe700 1 --2- 172.21.15.146:0/3849723929 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1fa8066f30 0x7f1fa80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:40.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.216+0000 7f1fbf7fe700 1 -- 172.21.15.146:0/3849723929 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f1fb8085b00 con 0x7f1fc80676c0 2023-10-06T11:05:40.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.216+0000 7f1fbe7fc700 1 --2- 172.21.15.146:0/3849723929 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1fa8066f30 0x7f1fa80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:40.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.216+0000 7f1fbe7fc700 1 --2- 172.21.15.146:0/3849723929 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1fa8066f30 0x7f1fa80693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8154450 tx=0x7f1fb00091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:40.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.220+0000 7f1fbf7fe700 1 -- 172.21.15.146:0/3849723929 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1fb8052f60 con 0x7f1fc80676c0 2023-10-06T11:05:40.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.405+0000 7f1fcd3a1700 1 -- 172.21.15.146:0/3849723929 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1fc80b1b30 con 0x7f1fc80676c0 2023-10-06T11:05:40.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.405+0000 7f1fbf7fe700 1 -- 172.21.15.146:0/3849723929 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1fb80150a0 con 0x7f1fc80676c0 2023-10-06T11:05:40.407 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-10-06T11:05:40.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.408+0000 7f1fcd3a1700 1 -- 172.21.15.146:0/3849723929 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1fa8066f30 msgr2=0x7f1fa80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.408+0000 7f1fcd3a1700 1 --2- 172.21.15.146:0/3849723929 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1fa8066f30 0x7f1fa80693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1fc8154450 tx=0x7f1fb00091a0 comp rx=0 tx=0).stop 2023-10-06T11:05:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.408+0000 7f1fcd3a1700 1 -- 172.21.15.146:0/3849723929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fc80676c0 msgr2=0x7f1fc80c20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.408+0000 7f1fcd3a1700 1 --2- 172.21.15.146:0/3849723929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fc80676c0 0x7f1fc80c20a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1fc815af40 tx=0x7f1fb8017000 comp rx=0 tx=0).stop 2023-10-06T11:05:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.408+0000 7f1fcd3a1700 1 -- 172.21.15.146:0/3849723929 shutdown_connections 2023-10-06T11:05:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.408+0000 7f1fcd3a1700 1 --2- 172.21.15.146:0/3849723929 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1fa8066f30 0x7f1fa80693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.408+0000 7f1fcd3a1700 1 --2- 172.21.15.146:0/3849723929 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1fc806e690 0x7f1fc8141490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.408+0000 7f1fcd3a1700 1 --2- 172.21.15.146:0/3849723929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fc80676c0 0x7f1fc80c20a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.408+0000 7f1fcd3a1700 1 --2- 172.21.15.146:0/3849723929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1fc8067a90 0x7f1fc816d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.408+0000 7f1fcd3a1700 1 -- 172.21.15.146:0/3849723929 >> 172.21.15.146:0/3849723929 conn(0x7f1fc8068580 msgr2=0x7f1fc81549a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:40.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.408+0000 7f1fcd3a1700 1 -- 172.21.15.146:0/3849723929 shutdown_connections 2023-10-06T11:05:40.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.408+0000 7f1fcd3a1700 1 -- 172.21.15.146:0/3849723929 wait complete. 2023-10-06T11:05:40.421 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:05:40.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.537+0000 7fa006e96700 1 Processor -- start 2023-10-06T11:05:40.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.537+0000 7fa006e96700 1 -- start start 2023-10-06T11:05:40.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.538+0000 7fa006e96700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa00015cc20 0x7fa00015d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:40.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.538+0000 7fa006e96700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa00015cff0 0x7fa0000d0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:40.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.538+0000 7fa006e96700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0000cf030 con 0x7fa0000d0a80 2023-10-06T11:05:40.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.538+0000 7fa006e96700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa00015e390 con 0x7fa00015cc20 2023-10-06T11:05:40.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.538+0000 7fa006e96700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0000d0ec0 con 0x7fa00015cff0 2023-10-06T11:05:40.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.538+0000 7fa004c32700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa00015cc20 0x7fa00015d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:40.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.538+0000 7fa004c32700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa00015cc20 0x7fa00015d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50228/0 (socket says 172.21.15.146:50228) 2023-10-06T11:05:40.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.538+0000 7fa004c32700 1 -- 172.21.15.146:0/2952697071 learned_addr learned my addr 172.21.15.146:0/2952697071 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:40.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.538+0000 7f9ffffff700 1 --2- 172.21.15.146:0/2952697071 >> v2:172.21.15.151:3300/0 conn(0x7fa00015cff0 0x7fa0000d0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:40.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.538+0000 7fa004c32700 1 -- 172.21.15.146:0/2952697071 >> v2:172.21.15.151:3300/0 conn(0x7fa00015cff0 msgr2=0x7fa0000d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:40.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.538+0000 7fa004c32700 1 --2- 172.21.15.146:0/2952697071 >> v2:172.21.15.151:3300/0 conn(0x7fa00015cff0 0x7fa0000d0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:40.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.538+0000 7fa004c32700 1 -- 172.21.15.146:0/2952697071 >> v1:172.21.15.151:6789/0 conn(0x7fa0000d0a80 legacy=0x7fa00015a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:40.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.538+0000 7fa004c32700 1 -- 172.21.15.146:0/2952697071 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0000ced20 con 0x7fa00015cc20 2023-10-06T11:05:40.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.538+0000 7f9ffffff700 1 --2- 172.21.15.146:0/2952697071 >> v2:172.21.15.151:3300/0 conn(0x7fa00015cff0 0x7fa0000d0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:05:40.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.539+0000 7fa004c32700 1 --2- 172.21.15.146:0/2952697071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa00015cc20 0x7fa00015d460 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa000067e50 tx=0x7f9ff4009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae1d216dbc8971f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:40.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.539+0000 7f9fff7fe700 1 -- 172.21.15.146:0/2952697071 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4005c10 con 0x7fa00015cc20 2023-10-06T11:05:40.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.539+0000 7f9fff7fe700 1 -- 172.21.15.146:0/2952697071 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff4005d70 con 0x7fa00015cc20 2023-10-06T11:05:40.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.539+0000 7f9fff7fe700 1 -- 172.21.15.146:0/2952697071 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff400b880 con 0x7fa00015cc20 2023-10-06T11:05:40.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.539+0000 7fa006e96700 1 -- 172.21.15.146:0/2952697071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa00015cc20 msgr2=0x7fa00015d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:40.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.539+0000 7fa006e96700 1 --2- 172.21.15.146:0/2952697071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa00015cc20 0x7fa00015d460 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa000067e50 tx=0x7f9ff4009220 comp rx=0 tx=0).stop 2023-10-06T11:05:40.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.539+0000 7fa006e96700 1 -- 172.21.15.146:0/2952697071 shutdown_connections 2023-10-06T11:05:40.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.539+0000 7fa006e96700 1 --2- 172.21.15.146:0/2952697071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa00015cc20 0x7fa00015d460 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:40.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.539+0000 7fa006e96700 1 --2- 172.21.15.146:0/2952697071 >> v2:172.21.15.151:3300/0 conn(0x7fa00015cff0 0x7fa0000d0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:40.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.539+0000 7fa006e96700 1 -- 172.21.15.146:0/2952697071 >> 172.21.15.146:0/2952697071 conn(0x7fa00006eba0 msgr2=0x7fa00006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:40.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.539+0000 7fa006e96700 1 -- 172.21.15.146:0/2952697071 shutdown_connections 2023-10-06T11:05:40.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.539+0000 7fa006e96700 1 -- 172.21.15.146:0/2952697071 wait complete. 2023-10-06T11:05:40.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.540+0000 7fa006e96700 1 Processor -- start 2023-10-06T11:05:40.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.541+0000 7fa006e96700 1 -- start start 2023-10-06T11:05:40.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.541+0000 7fa006e96700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0000d0a80 0x7fa000169dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:40.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.541+0000 7fa006e96700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa00015cc20 0x7fa0000c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:40.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.541+0000 7fa006e96700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa00015cff0 0x7fa0000cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:40.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.541+0000 7fa006e96700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0000cc4e0 con 0x7fa00015cff0 2023-10-06T11:05:40.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.541+0000 7fa006e96700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00016ad60 con 0x7fa00015cc20 2023-10-06T11:05:40.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.541+0000 7fa006e96700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa00016a4c0 con 0x7fa0000d0a80 2023-10-06T11:05:40.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.541+0000 7fa005433700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa00015cff0 0x7fa0000cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:40.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.541+0000 7fa005433700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa00015cff0 0x7fa0000cbfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50238/0 (socket says 172.21.15.146:50238) 2023-10-06T11:05:40.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.541+0000 7fa005433700 1 -- 172.21.15.146:0/945247398 learned_addr learned my addr 172.21.15.146:0/945247398 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:40.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.542+0000 7f9ffffff700 1 --2- 172.21.15.146:0/945247398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa00015cc20 0x7fa0000c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:40.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.542+0000 7fa004c32700 1 --2- 172.21.15.146:0/945247398 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0000d0a80 0x7fa000169dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:40.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.542+0000 7fa005433700 1 -- 172.21.15.146:0/945247398 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0000d0a80 msgr2=0x7fa000169dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:40.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.542+0000 7fa005433700 1 --2- 172.21.15.146:0/945247398 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0000d0a80 0x7fa000169dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:40.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.542+0000 7fa005433700 1 -- 172.21.15.146:0/945247398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa00015cc20 msgr2=0x7fa0000c9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:40.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.542+0000 7fa005433700 1 --2- 172.21.15.146:0/945247398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa00015cc20 0x7fa0000c9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:40.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.542+0000 7fa005433700 1 -- 172.21.15.146:0/945247398 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff4009480 con 0x7fa00015cff0 2023-10-06T11:05:40.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.542+0000 7f9ffffff700 1 --2- 172.21.15.146:0/945247398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa00015cc20 0x7fa0000c9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:05:40.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.542+0000 7fa005433700 1 --2- 172.21.15.146:0/945247398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa00015cff0 0x7fa0000cbfa0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9ff800c840 tx=0x7f9ff8001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:40.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.542+0000 7f9ffcff9700 1 -- 172.21.15.146:0/945247398 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8012630 con 0x7fa00015cff0 2023-10-06T11:05:40.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.542+0000 7f9ffcff9700 1 -- 172.21.15.146:0/945247398 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff80127b0 con 0x7fa00015cff0 2023-10-06T11:05:40.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.542+0000 7fa006e96700 1 -- 172.21.15.146:0/945247398 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa00016a7a0 con 0x7fa00015cff0 2023-10-06T11:05:40.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.542+0000 7f9ffcff9700 1 -- 172.21.15.146:0/945247398 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8012b70 con 0x7fa00015cff0 2023-10-06T11:05:40.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.542+0000 7fa006e96700 1 -- 172.21.15.146:0/945247398 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa00016b0c0 con 0x7fa00015cff0 2023-10-06T11:05:40.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.543+0000 7fa006e96700 1 -- 172.21.15.146:0/945247398 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa00004c380 con 0x7fa00015cff0 2023-10-06T11:05:40.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.543+0000 7f9ffcff9700 1 -- 172.21.15.146:0/945247398 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9ff8003030 con 0x7fa00015cff0 2023-10-06T11:05:40.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.544+0000 7f9ffcff9700 1 --2- 172.21.15.146:0/945247398 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9fe4066f30 0x7f9fe40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:40.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.544+0000 7f9ffcff9700 1 -- 172.21.15.146:0/945247398 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f9ff80842c0 con 0x7fa00015cff0 2023-10-06T11:05:40.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.544+0000 7fa004c32700 1 --2- 172.21.15.146:0/945247398 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9fe4066f30 0x7f9fe40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:40.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.544+0000 7fa004c32700 1 --2- 172.21.15.146:0/945247398 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9fe4066f30 0x7f9fe40693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa00015af90 tx=0x7f9ff4016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:40.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.548+0000 7f9ffcff9700 1 -- 172.21.15.146:0/945247398 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ff8051720 con 0x7fa00015cff0 2023-10-06T11:05:40.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.730+0000 7fa006e96700 1 -- 172.21.15.146:0/945247398 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa0000b3b50 con 0x7fa00015cff0 2023-10-06T11:05:40.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.731+0000 7f9ffcff9700 1 -- 172.21.15.146:0/945247398 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9ff8054d40 con 0x7fa00015cff0 2023-10-06T11:05:40.732 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-10-06T11:05:40.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.733+0000 7fa006e96700 1 -- 172.21.15.146:0/945247398 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9fe4066f30 msgr2=0x7f9fe40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:40.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.733+0000 7fa006e96700 1 --2- 172.21.15.146:0/945247398 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9fe4066f30 0x7f9fe40693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa00015af90 tx=0x7f9ff4016000 comp rx=0 tx=0).stop 2023-10-06T11:05:40.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.733+0000 7fa006e96700 1 -- 172.21.15.146:0/945247398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa00015cff0 msgr2=0x7fa0000cbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:40.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.733+0000 7fa006e96700 1 --2- 172.21.15.146:0/945247398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa00015cff0 0x7fa0000cbfa0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9ff800c840 tx=0x7f9ff8001670 comp rx=0 tx=0).stop 2023-10-06T11:05:40.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.733+0000 7fa006e96700 1 -- 172.21.15.146:0/945247398 shutdown_connections 2023-10-06T11:05:40.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.733+0000 7fa006e96700 1 --2- 172.21.15.146:0/945247398 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9fe4066f30 0x7f9fe40693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:40.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.733+0000 7fa006e96700 1 --2- 172.21.15.146:0/945247398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa00015cff0 0x7fa0000cbfa0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:40.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.733+0000 7fa006e96700 1 --2- 172.21.15.146:0/945247398 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0000d0a80 0x7fa000169dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:40.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.733+0000 7fa006e96700 1 --2- 172.21.15.146:0/945247398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa00015cc20 0x7fa0000c9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:40.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.733+0000 7fa006e96700 1 -- 172.21.15.146:0/945247398 >> 172.21.15.146:0/945247398 conn(0x7fa00006eba0 msgr2=0x7fa000156be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:40.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.733+0000 7fa006e96700 1 -- 172.21.15.146:0/945247398 shutdown_connections 2023-10-06T11:05:40.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.733+0000 7fa006e96700 1 -- 172.21.15.146:0/945247398 wait complete. 2023-10-06T11:05:40.747 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T11:05:40.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.860+0000 7f9d9dec6700 1 Processor -- start 2023-10-06T11:05:40.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.860+0000 7f9d9dec6700 1 -- start start 2023-10-06T11:05:40.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.860+0000 7f9d9dec6700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9d98153ab0 0x7f9d9815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:40.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.861+0000 7f9d9dec6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d98068ba0 0x7f9d980b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:40.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.861+0000 7f9d9dec6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d9815ac30 con 0x7f9d98153e80 2023-10-06T11:05:40.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.861+0000 7f9d9dec6700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d980b4510 con 0x7f9d98153ab0 2023-10-06T11:05:40.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.861+0000 7f9d9dec6700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d980b6530 con 0x7f9d98068ba0 2023-10-06T11:05:40.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.861+0000 7f9d8effd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f9d98153e80 0x7f9d98068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38346/0 (socket says 172.21.15.146:38346) 2023-10-06T11:05:40.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.861+0000 7f9d8effd700 1 -- 172.21.15.146:0/814049760 learned_addr learned my addr 172.21.15.146:0/814049760 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:05:40.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.861+0000 7f9d977fe700 1 --2- 172.21.15.146:0/814049760 >> v2:172.21.15.151:3300/0 conn(0x7f9d98153ab0 0x7f9d9815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:40.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.861+0000 7f9d97fff700 1 --2- 172.21.15.146:0/814049760 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d98068ba0 0x7f9d980b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:40.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.861+0000 7f9d96ffd700 1 -- 172.21.15.146:0/814049760 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1969252631 0 0) 0x7f9d80001110 con 0x7f9d98153e80 2023-10-06T11:05:40.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.861+0000 7f9d96ffd700 1 -- 172.21.15.146:0/814049760 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d84003570 con 0x7f9d98153e80 2023-10-06T11:05:40.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.861+0000 7f9d97fff700 1 -- 172.21.15.146:0/814049760 >> v2:172.21.15.151:3300/0 conn(0x7f9d98153ab0 msgr2=0x7f9d9815a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:40.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.861+0000 7f9d97fff700 1 --2- 172.21.15.146:0/814049760 >> v2:172.21.15.151:3300/0 conn(0x7f9d98153ab0 0x7f9d9815a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:40.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.861+0000 7f9d97fff700 1 -- 172.21.15.146:0/814049760 >> v1:172.21.15.146:6789/0 conn(0x7f9d98153e80 legacy=0x7f9d98068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:40.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.861+0000 7f9d97fff700 1 -- 172.21.15.146:0/814049760 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d980b5c50 con 0x7f9d98068ba0 2023-10-06T11:05:40.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.861+0000 7f9d977fe700 1 --2- 172.21.15.146:0/814049760 >> v2:172.21.15.151:3300/0 conn(0x7f9d98153ab0 0x7f9d9815a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:05:40.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.861+0000 7f9d97fff700 1 --2- 172.21.15.146:0/814049760 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d98068ba0 0x7f9d980b49a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9d90009e60 tx=0x7f9d90009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8482a343277dae5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:40.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.861+0000 7f9d96ffd700 1 -- 172.21.15.146:0/814049760 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9000e070 con 0x7f9d98068ba0 2023-10-06T11:05:40.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.861+0000 7f9d96ffd700 1 -- 172.21.15.146:0/814049760 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d9000bab0 con 0x7f9d98068ba0 2023-10-06T11:05:40.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.861+0000 7f9d96ffd700 1 -- 172.21.15.146:0/814049760 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9000be70 con 0x7f9d98068ba0 2023-10-06T11:05:40.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.862+0000 7f9d9dec6700 1 -- 172.21.15.146:0/814049760 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d98068ba0 msgr2=0x7f9d980b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:40.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.862+0000 7f9d9dec6700 1 --2- 172.21.15.146:0/814049760 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d98068ba0 0x7f9d980b49a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9d90009e60 tx=0x7f9d90009780 comp rx=0 tx=0).stop 2023-10-06T11:05:40.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.862+0000 7f9d9dec6700 1 -- 172.21.15.146:0/814049760 shutdown_connections 2023-10-06T11:05:40.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.862+0000 7f9d9dec6700 1 --2- 172.21.15.146:0/814049760 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d98068ba0 0x7f9d980b49a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:40.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.862+0000 7f9d9dec6700 1 --2- 172.21.15.146:0/814049760 >> v2:172.21.15.151:3300/0 conn(0x7f9d98153ab0 0x7f9d9815a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:40.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.862+0000 7f9d9dec6700 1 -- 172.21.15.146:0/814049760 >> 172.21.15.146:0/814049760 conn(0x7f9d9806eba0 msgr2=0x7f9d9806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:40.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.862+0000 7f9d9dec6700 1 -- 172.21.15.146:0/814049760 shutdown_connections 2023-10-06T11:05:40.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.862+0000 7f9d9dec6700 1 -- 172.21.15.146:0/814049760 wait complete. 2023-10-06T11:05:40.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.863+0000 7f9d9dec6700 1 Processor -- start 2023-10-06T11:05:40.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.863+0000 7f9d9dec6700 1 -- start start 2023-10-06T11:05:40.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.864+0000 7f9d9dec6700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d98068ba0 0x7f9d9815a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:40.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.864+0000 7f9d9dec6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d98153ab0 0x7f9d98140120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:40.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.864+0000 7f9d9dec6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d98153e80 0x7f9d98158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:40.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.864+0000 7f9d9dec6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9815a880 con 0x7f9d98153e80 2023-10-06T11:05:40.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.864+0000 7f9d9dec6700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d981592a0 con 0x7f9d98068ba0 2023-10-06T11:05:40.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.864+0000 7f9d9dec6700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d98159580 con 0x7f9d98153ab0 2023-10-06T11:05:40.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.864+0000 7f9d97fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d98153e80 0x7f9d98158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:40.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.864+0000 7f9d97fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d98153e80 0x7f9d98158950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50244/0 (socket says 172.21.15.146:50244) 2023-10-06T11:05:40.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.864+0000 7f9d97fff700 1 -- 172.21.15.146:0/1308064432 learned_addr learned my addr 172.21.15.146:0/1308064432 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:40.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.864+0000 7f9d977fe700 1 --2- 172.21.15.146:0/1308064432 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d98068ba0 0x7f9d9815a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:40.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.864+0000 7f9d8effd700 1 --2- 172.21.15.146:0/1308064432 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d98153ab0 0x7f9d98140120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:40.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.864+0000 7f9d97fff700 1 -- 172.21.15.146:0/1308064432 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d98153ab0 msgr2=0x7f9d98140120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:40.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.864+0000 7f9d97fff700 1 --2- 172.21.15.146:0/1308064432 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d98153ab0 0x7f9d98140120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:40.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.864+0000 7f9d97fff700 1 -- 172.21.15.146:0/1308064432 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d98068ba0 msgr2=0x7f9d9815a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:40.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.864+0000 7f9d97fff700 1 --2- 172.21.15.146:0/1308064432 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d98068ba0 0x7f9d9815a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:40.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.864+0000 7f9d97fff700 1 -- 172.21.15.146:0/1308064432 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d88009420 con 0x7f9d98153e80 2023-10-06T11:05:40.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.865+0000 7f9d97fff700 1 --2- 172.21.15.146:0/1308064432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d98153e80 0x7f9d98158950 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9d90013000 tx=0x7f9d90019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:40.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.865+0000 7f9d8ffff700 1 -- 172.21.15.146:0/1308064432 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d90012e10 con 0x7f9d98153e80 2023-10-06T11:05:40.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.865+0000 7f9d8ffff700 1 -- 172.21.15.146:0/1308064432 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d90027470 con 0x7f9d98153e80 2023-10-06T11:05:40.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.865+0000 7f9d9dec6700 1 -- 172.21.15.146:0/1308064432 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d90009a20 con 0x7f9d98153e80 2023-10-06T11:05:40.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.865+0000 7f9d8ffff700 1 -- 172.21.15.146:0/1308064432 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d90027830 con 0x7f9d98153e80 2023-10-06T11:05:40.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.865+0000 7f9d9dec6700 1 -- 172.21.15.146:0/1308064432 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d98159b40 con 0x7f9d98153e80 2023-10-06T11:05:40.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.866+0000 7f9d9dec6700 1 -- 172.21.15.146:0/1308064432 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d9804c380 con 0x7f9d98153e80 2023-10-06T11:05:40.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.866+0000 7f9d8ffff700 1 -- 172.21.15.146:0/1308064432 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9d90024070 con 0x7f9d98153e80 2023-10-06T11:05:40.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.866+0000 7f9d8ffff700 1 --2- 172.21.15.146:0/1308064432 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9d78066f30 0x7f9d780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:40.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.866+0000 7f9d8ffff700 1 -- 172.21.15.146:0/1308064432 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f9d90086d40 con 0x7f9d98153e80 2023-10-06T11:05:40.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.866+0000 7f9d977fe700 1 --2- 172.21.15.146:0/1308064432 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9d78066f30 0x7f9d780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:40.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.867+0000 7f9d977fe700 1 --2- 172.21.15.146:0/1308064432 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9d78066f30 0x7f9d780693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9d88009f40 tx=0x7f9d880091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:40.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:40.871+0000 7f9d8ffff700 1 -- 172.21.15.146:0/1308064432 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9d900541a0 con 0x7f9d98153e80 2023-10-06T11:05:41.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.057+0000 7f9d9dec6700 1 -- 172.21.15.146:0/1308064432 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9d980b6250 con 0x7f9d98153e80 2023-10-06T11:05:41.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.058+0000 7f9d8ffff700 1 -- 172.21.15.146:0/1308064432 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+126 (secure 0 0 0) 0x7f9d900577c0 con 0x7f9d98153e80 2023-10-06T11:05:41.060 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:05:41.060 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2023-10-06T11:05:41.060 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:05:41.060 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 1, 2023-10-06T11:05:41.060 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": "rbd" 2023-10-06T11:05:41.060 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:05:41.060 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:05:41.060 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 2, 2023-10-06T11:05:41.060 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": ".mgr" 2023-10-06T11:05:41.061 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:05:41.061 INFO:teuthology.orchestra.run.smithi146.stdout:] 2023-10-06T11:05:41.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.060+0000 7f9d9dec6700 1 -- 172.21.15.146:0/1308064432 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9d78066f30 msgr2=0x7f9d780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:41.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.060+0000 7f9d9dec6700 1 --2- 172.21.15.146:0/1308064432 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9d78066f30 0x7f9d780693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9d88009f40 tx=0x7f9d880091a0 comp rx=0 tx=0).stop 2023-10-06T11:05:41.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.060+0000 7f9d9dec6700 1 -- 172.21.15.146:0/1308064432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d98153e80 msgr2=0x7f9d98158950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:41.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.060+0000 7f9d9dec6700 1 --2- 172.21.15.146:0/1308064432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d98153e80 0x7f9d98158950 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9d90013000 tx=0x7f9d90019000 comp rx=0 tx=0).stop 2023-10-06T11:05:41.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.060+0000 7f9d9dec6700 1 -- 172.21.15.146:0/1308064432 shutdown_connections 2023-10-06T11:05:41.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.060+0000 7f9d9dec6700 1 --2- 172.21.15.146:0/1308064432 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9d78066f30 0x7f9d780693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:41.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.060+0000 7f9d9dec6700 1 --2- 172.21.15.146:0/1308064432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d98153e80 0x7f9d98158950 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:41.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.060+0000 7f9d9dec6700 1 --2- 172.21.15.146:0/1308064432 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d98068ba0 0x7f9d9815a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:41.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.060+0000 7f9d9dec6700 1 --2- 172.21.15.146:0/1308064432 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d98153ab0 0x7f9d98140120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:41.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.060+0000 7f9d9dec6700 1 -- 172.21.15.146:0/1308064432 >> 172.21.15.146:0/1308064432 conn(0x7f9d9806eba0 msgr2=0x7f9d98151b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:41.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.060+0000 7f9d9dec6700 1 -- 172.21.15.146:0/1308064432 shutdown_connections 2023-10-06T11:05:41.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.060+0000 7f9d9dec6700 1 -- 172.21.15.146:0/1308064432 wait complete. 2023-10-06T11:05:41.074 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T11:05:41.074 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T11:05:41.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.192+0000 7f7143daa700 1 Processor -- start 2023-10-06T11:05:41.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.192+0000 7f7143daa700 1 -- start start 2023-10-06T11:05:41.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.193+0000 7f7143daa700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f713c15a160 0x7f713c0c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:41.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.193+0000 7f7143daa700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f713c0ae730 0x7f713c0aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:41.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.193+0000 7f7143daa700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f713c0ce3d0 0x7f713c0ce830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:41.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.193+0000 7f7143daa700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f713c0ae2a0 con 0x7f713c15a160 2023-10-06T11:05:41.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.193+0000 7f7143daa700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f713c15a530 con 0x7f713c0ce3d0 2023-10-06T11:05:41.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.193+0000 7f7143daa700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f713c0ad690 con 0x7f713c0ae730 2023-10-06T11:05:41.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.193+0000 7f7141b46700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f713c15a160 0x7f713c0c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:41.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.193+0000 7f7141b46700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f713c15a160 0x7f713c0c55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50252/0 (socket says 172.21.15.146:50252) 2023-10-06T11:05:41.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.193+0000 7f7141b46700 1 -- 172.21.15.146:0/844055784 learned_addr learned my addr 172.21.15.146:0/844055784 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:41.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.193+0000 7f7141345700 1 --2- 172.21.15.146:0/844055784 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f713c0ae730 0x7f713c0aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:41.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.193+0000 7f7142347700 1 --2- 172.21.15.146:0/844055784 >> v2:172.21.15.151:3300/0 conn(0x7f713c0ce3d0 0x7f713c0ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:41.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.193+0000 7f7141b46700 1 -- 172.21.15.146:0/844055784 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f713c0ae730 msgr2=0x7f713c0aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:41.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.193+0000 7f7141b46700 1 --2- 172.21.15.146:0/844055784 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f713c0ae730 0x7f713c0aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:41.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.193+0000 7f7141b46700 1 -- 172.21.15.146:0/844055784 >> v2:172.21.15.151:3300/0 conn(0x7f713c0ce3d0 msgr2=0x7f713c0ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:41.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.193+0000 7f7141b46700 1 --2- 172.21.15.146:0/844055784 >> v2:172.21.15.151:3300/0 conn(0x7f713c0ce3d0 0x7f713c0ce830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:41.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.194+0000 7f7141b46700 1 -- 172.21.15.146:0/844055784 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f713c0ad970 con 0x7f713c15a160 2023-10-06T11:05:41.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.194+0000 7f7141b46700 1 --2- 172.21.15.146:0/844055784 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f713c15a160 0x7f713c0c55a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f713c089c40 tx=0x7f7138009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd9d0dea2d87d4f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:41.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.194+0000 7f7140b44700 1 -- 172.21.15.146:0/844055784 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7138005c10 con 0x7f713c15a160 2023-10-06T11:05:41.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.194+0000 7f7140b44700 1 -- 172.21.15.146:0/844055784 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7138005d70 con 0x7f713c15a160 2023-10-06T11:05:41.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.194+0000 7f7140b44700 1 -- 172.21.15.146:0/844055784 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7138006260 con 0x7f713c15a160 2023-10-06T11:05:41.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.194+0000 7f7143daa700 1 -- 172.21.15.146:0/844055784 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f713c15a160 msgr2=0x7f713c0c55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:41.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.194+0000 7f7143daa700 1 --2- 172.21.15.146:0/844055784 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f713c15a160 0x7f713c0c55a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f713c089c40 tx=0x7f7138009220 comp rx=0 tx=0).stop 2023-10-06T11:05:41.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.194+0000 7f7143daa700 1 -- 172.21.15.146:0/844055784 shutdown_connections 2023-10-06T11:05:41.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.194+0000 7f7143daa700 1 --2- 172.21.15.146:0/844055784 >> v2:172.21.15.151:3300/0 conn(0x7f713c0ce3d0 0x7f713c0ce830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:41.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.194+0000 7f7143daa700 1 --2- 172.21.15.146:0/844055784 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f713c15a160 0x7f713c0c55a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:41.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.194+0000 7f7143daa700 1 --2- 172.21.15.146:0/844055784 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f713c0ae730 0x7f713c0aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:41.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.194+0000 7f7143daa700 1 -- 172.21.15.146:0/844055784 >> 172.21.15.146:0/844055784 conn(0x7f713c06f380 msgr2=0x7f713c0d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:41.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.194+0000 7f7143daa700 1 -- 172.21.15.146:0/844055784 shutdown_connections 2023-10-06T11:05:41.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.194+0000 7f7143daa700 1 -- 172.21.15.146:0/844055784 wait complete. 2023-10-06T11:05:41.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.196+0000 7f7143daa700 1 Processor -- start 2023-10-06T11:05:41.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.196+0000 7f7143daa700 1 -- start start 2023-10-06T11:05:41.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.196+0000 7f7143daa700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f713c0ae730 0x7f713c157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:41.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.196+0000 7f7143daa700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f713c0ce3d0 0x7f713c14b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:41.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.196+0000 7f7143daa700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f713c15a160 0x7f713c15dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:41.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.196+0000 7f7143daa700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713c0ca110 con 0x7f713c15a160 2023-10-06T11:05:41.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.196+0000 7f7143daa700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713c0b35a0 con 0x7f713c0ae730 2023-10-06T11:05:41.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.196+0000 7f7143daa700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f713c0b3b60 con 0x7f713c0ce3d0 2023-10-06T11:05:41.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.196+0000 7f7142347700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f713c15a160 0x7f713c15dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:41.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.196+0000 7f7142347700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f713c15a160 0x7f713c15dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50266/0 (socket says 172.21.15.146:50266) 2023-10-06T11:05:41.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.196+0000 7f7142347700 1 -- 172.21.15.146:0/2857579436 learned_addr learned my addr 172.21.15.146:0/2857579436 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:41.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.196+0000 7f7141345700 1 --2- 172.21.15.146:0/2857579436 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f713c0ce3d0 0x7f713c14b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:41.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.196+0000 7f7141b46700 1 --2- 172.21.15.146:0/2857579436 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f713c0ae730 0x7f713c157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:41.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.197+0000 7f7142347700 1 -- 172.21.15.146:0/2857579436 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f713c0ce3d0 msgr2=0x7f713c14b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:41.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.197+0000 7f7142347700 1 --2- 172.21.15.146:0/2857579436 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f713c0ce3d0 0x7f713c14b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:41.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.197+0000 7f7142347700 1 -- 172.21.15.146:0/2857579436 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f713c0ae730 msgr2=0x7f713c157320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:41.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.197+0000 7f7142347700 1 --2- 172.21.15.146:0/2857579436 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f713c0ae730 0x7f713c157320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:41.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.197+0000 7f7142347700 1 -- 172.21.15.146:0/2857579436 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7138009480 con 0x7f713c15a160 2023-10-06T11:05:41.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.197+0000 7f7142347700 1 --2- 172.21.15.146:0/2857579436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f713c15a160 0x7f713c15dfc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7134009ec0 tx=0x7f713400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:41.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.197+0000 7f7131ffb700 1 -- 172.21.15.146:0/2857579436 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713400cb70 con 0x7f713c15a160 2023-10-06T11:05:41.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.197+0000 7f7131ffb700 1 -- 172.21.15.146:0/2857579436 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f713400f040 con 0x7f713c15a160 2023-10-06T11:05:41.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.197+0000 7f7131ffb700 1 -- 172.21.15.146:0/2857579436 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7134014480 con 0x7f713c15a160 2023-10-06T11:05:41.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.197+0000 7f7143daa700 1 -- 172.21.15.146:0/2857579436 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f713c0ca360 con 0x7f713c15a160 2023-10-06T11:05:41.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.197+0000 7f7143daa700 1 -- 172.21.15.146:0/2857579436 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f713c0b37f0 con 0x7f713c15a160 2023-10-06T11:05:41.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.198+0000 7f7143daa700 1 -- 172.21.15.146:0/2857579436 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f713c04c380 con 0x7f713c15a160 2023-10-06T11:05:41.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.198+0000 7f7131ffb700 1 -- 172.21.15.146:0/2857579436 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7134014830 con 0x7f713c15a160 2023-10-06T11:05:41.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.199+0000 7f7131ffb700 1 --2- 172.21.15.146:0/2857579436 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7120066f30 0x7f71200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:41.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.199+0000 7f7141b46700 1 --2- 172.21.15.146:0/2857579436 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7120066f30 0x7f71200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:41.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.199+0000 7f7131ffb700 1 -- 172.21.15.146:0/2857579436 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f7134084f00 con 0x7f713c15a160 2023-10-06T11:05:41.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.199+0000 7f7141b46700 1 --2- 172.21.15.146:0/2857579436 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7120066f30 0x7f71200693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7138009260 tx=0x7f7138016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:41.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.203+0000 7f7131ffb700 1 -- 172.21.15.146:0/2857579436 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7134052360 con 0x7f713c15a160 2023-10-06T11:05:41.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:41.386+0000 7f7143daa700 1 -- 172.21.15.146:0/2857579436 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f713c0adc50 con 0x7f713c15a160 2023-10-06T11:05:42.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.345+0000 7f7131ffb700 1 -- 172.21.15.146:0/2857579436 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7134055980 con 0x7f713c15a160 2023-10-06T11:05:42.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.350+0000 7f7143daa700 1 -- 172.21.15.146:0/2857579436 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7120066f30 msgr2=0x7f71200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:42.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.350+0000 7f7143daa700 1 --2- 172.21.15.146:0/2857579436 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7120066f30 0x7f71200693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7138009260 tx=0x7f7138016000 comp rx=0 tx=0).stop 2023-10-06T11:05:42.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.350+0000 7f7143daa700 1 -- 172.21.15.146:0/2857579436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f713c15a160 msgr2=0x7f713c15dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:42.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.350+0000 7f7143daa700 1 --2- 172.21.15.146:0/2857579436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f713c15a160 0x7f713c15dfc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7134009ec0 tx=0x7f713400b040 comp rx=0 tx=0).stop 2023-10-06T11:05:42.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.351+0000 7f7143daa700 1 -- 172.21.15.146:0/2857579436 shutdown_connections 2023-10-06T11:05:42.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.351+0000 7f7143daa700 1 --2- 172.21.15.146:0/2857579436 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7120066f30 0x7f71200693e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:42.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.351+0000 7f7143daa700 1 --2- 172.21.15.146:0/2857579436 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f713c15a160 0x7f713c15dfc0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:42.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.351+0000 7f7143daa700 1 --2- 172.21.15.146:0/2857579436 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f713c0ae730 0x7f713c157320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:42.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.351+0000 7f7143daa700 1 --2- 172.21.15.146:0/2857579436 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f713c0ce3d0 0x7f713c14b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:42.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.351+0000 7f7143daa700 1 -- 172.21.15.146:0/2857579436 >> 172.21.15.146:0/2857579436 conn(0x7f713c06f380 msgr2=0x7f713c1592e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:42.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.351+0000 7f7143daa700 1 -- 172.21.15.146:0/2857579436 shutdown_connections 2023-10-06T11:05:42.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.351+0000 7f7143daa700 1 -- 172.21.15.146:0/2857579436 wait complete. 2023-10-06T11:05:42.353 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' created 2023-10-06T11:05:42.366 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T11:05:42.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.487+0000 7f7adffff700 1 Processor -- start 2023-10-06T11:05:42.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.487+0000 7f7adffff700 1 -- start start 2023-10-06T11:05:42.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.488+0000 7f7adffff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7ae00cb090 0x7f7ae00cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:42.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.488+0000 7f7adffff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ae0068780 0x7f7ae0068b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:42.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.488+0000 7f7adffff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ae00cc130 con 0x7f7ae00b5640 2023-10-06T11:05:42.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.488+0000 7f7adffff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ae00b2660 con 0x7f7ae00cb090 2023-10-06T11:05:42.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.488+0000 7f7adffff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae00690d0 con 0x7f7ae0068780 2023-10-06T11:05:42.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.488+0000 7f7ad67fc700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7ae00cb090 0x7f7ae00cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:42.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.488+0000 7f7adf7fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ae0068780 0x7f7ae0068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:42.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.488+0000 7f7adeffd700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f7ae00b5640 0x7f7ae015a870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:53124/0 (socket says 172.21.15.146:53124) 2023-10-06T11:05:42.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.488+0000 7f7adeffd700 1 -- 172.21.15.146:0/2151662172 learned_addr learned my addr 172.21.15.146:0/2151662172 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:05:42.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.488+0000 7f7ad67fc700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7ae00cb090 0x7f7ae00cc5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:55958/0 (socket says 172.21.15.146:55958) 2023-10-06T11:05:42.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.488+0000 7f7adf7fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ae0068780 0x7f7ae0068b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:53278/0 (socket says 172.21.15.146:53278) 2023-10-06T11:05:42.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.488+0000 7f7adf7fe700 1 -- 172.21.15.146:0/2151662172 >> v2:172.21.15.151:3300/0 conn(0x7f7ae00cb090 msgr2=0x7f7ae00cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:42.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.488+0000 7f7adf7fe700 1 --2- 172.21.15.146:0/2151662172 >> v2:172.21.15.151:3300/0 conn(0x7f7ae00cb090 0x7f7ae00cc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:42.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.488+0000 7f7adf7fe700 1 -- 172.21.15.146:0/2151662172 >> v1:172.21.15.151:6789/0 conn(0x7f7ae00b5640 legacy=0x7f7ae015a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:42.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.488+0000 7f7adf7fe700 1 -- 172.21.15.146:0/2151662172 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae00cb520 con 0x7f7ae0068780 2023-10-06T11:05:42.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.488+0000 7f7ad67fc700 1 --2- 172.21.15.146:0/2151662172 >> v2:172.21.15.151:3300/0 conn(0x7f7ae00cb090 0x7f7ae00cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:05:42.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.488+0000 7f7adf7fe700 1 --2- 172.21.15.146:0/2151662172 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ae0068780 0x7f7ae0068b90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8009e60 tx=0x7f7ad8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38f0613177392a83 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:42.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.489+0000 7f7ade7fc700 1 -- 172.21.15.146:0/2151662172 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad800e070 con 0x7f7ae0068780 2023-10-06T11:05:42.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.489+0000 7f7ade7fc700 1 -- 172.21.15.146:0/2151662172 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad800bb60 con 0x7f7ae0068780 2023-10-06T11:05:42.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.489+0000 7f7ade7fc700 1 -- 172.21.15.146:0/2151662172 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad8012430 con 0x7f7ae0068780 2023-10-06T11:05:42.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.489+0000 7f7adffff700 1 -- 172.21.15.146:0/2151662172 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ae0068780 msgr2=0x7f7ae0068b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:42.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.489+0000 7f7adffff700 1 --2- 172.21.15.146:0/2151662172 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ae0068780 0x7f7ae0068b90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8009e60 tx=0x7f7ad8009780 comp rx=0 tx=0).stop 2023-10-06T11:05:42.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.489+0000 7f7adffff700 1 -- 172.21.15.146:0/2151662172 shutdown_connections 2023-10-06T11:05:42.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.489+0000 7f7adffff700 1 --2- 172.21.15.146:0/2151662172 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ae0068780 0x7f7ae0068b90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:42.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.489+0000 7f7adffff700 1 --2- 172.21.15.146:0/2151662172 >> v2:172.21.15.151:3300/0 conn(0x7f7ae00cb090 0x7f7ae00cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:42.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.489+0000 7f7adffff700 1 -- 172.21.15.146:0/2151662172 >> 172.21.15.146:0/2151662172 conn(0x7f7ae00703f0 msgr2=0x7f7ae00707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:42.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.489+0000 7f7adffff700 1 -- 172.21.15.146:0/2151662172 shutdown_connections 2023-10-06T11:05:42.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.489+0000 7f7adffff700 1 -- 172.21.15.146:0/2151662172 wait complete. 2023-10-06T11:05:42.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.490+0000 7f7adffff700 1 Processor -- start 2023-10-06T11:05:42.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.490+0000 7f7adffff700 1 -- start start 2023-10-06T11:05:42.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.491+0000 7f7adffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ae0068780 0x7f7ae015d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:42.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.491+0000 7f7adffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ae00b5640 0x7f7ae0158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:42.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.491+0000 7f7adffff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ae00cb090 0x7f7ae0153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:42.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.491+0000 7f7adffff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae016a570 con 0x7f7ae0068780 2023-10-06T11:05:42.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.491+0000 7f7adffff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae016dbb0 con 0x7f7ae00b5640 2023-10-06T11:05:42.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.491+0000 7f7adffff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae0169960 con 0x7f7ae00cb090 2023-10-06T11:05:42.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.491+0000 7f7adeffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ae0068780 0x7f7ae015d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:42.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.491+0000 7f7adeffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ae0068780 0x7f7ae015d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42030/0 (socket says 172.21.15.146:42030) 2023-10-06T11:05:42.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.491+0000 7f7adeffd700 1 -- 172.21.15.146:0/2995407201 learned_addr learned my addr 172.21.15.146:0/2995407201 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:42.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.491+0000 7f7adf7fe700 1 --2- 172.21.15.146:0/2995407201 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ae00cb090 0x7f7ae0153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:42.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.491+0000 7f7ad67fc700 1 --2- 172.21.15.146:0/2995407201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ae00b5640 0x7f7ae0158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:42.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.492+0000 7f7adeffd700 1 -- 172.21.15.146:0/2995407201 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ae00cb090 msgr2=0x7f7ae0153490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:42.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.492+0000 7f7adeffd700 1 --2- 172.21.15.146:0/2995407201 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ae00cb090 0x7f7ae0153490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:42.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.492+0000 7f7adeffd700 1 -- 172.21.15.146:0/2995407201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ae00b5640 msgr2=0x7f7ae0158e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:42.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.492+0000 7f7adeffd700 1 --2- 172.21.15.146:0/2995407201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ae00b5640 0x7f7ae0158e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:42.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.492+0000 7f7adeffd700 1 -- 172.21.15.146:0/2995407201 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac8009420 con 0x7f7ae0068780 2023-10-06T11:05:42.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.492+0000 7f7adeffd700 1 --2- 172.21.15.146:0/2995407201 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ae0068780 0x7f7ae015d620 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7ad000c7c0 tx=0x7f7ad0007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:42.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.492+0000 7f7ad77fe700 1 -- 172.21.15.146:0/2995407201 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0005b30 con 0x7f7ae0068780 2023-10-06T11:05:42.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.492+0000 7f7ad77fe700 1 -- 172.21.15.146:0/2995407201 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad0005c90 con 0x7f7ae0068780 2023-10-06T11:05:42.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.492+0000 7f7adffff700 1 -- 172.21.15.146:0/2995407201 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ad8009a20 con 0x7f7ae0068780 2023-10-06T11:05:42.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.492+0000 7f7ad77fe700 1 -- 172.21.15.146:0/2995407201 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0004a80 con 0x7f7ae0068780 2023-10-06T11:05:42.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.492+0000 7f7adffff700 1 -- 172.21.15.146:0/2995407201 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae0169fa0 con 0x7f7ae0068780 2023-10-06T11:05:42.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.493+0000 7f7adffff700 1 -- 172.21.15.146:0/2995407201 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ae00894b0 con 0x7f7ae0068780 2023-10-06T11:05:42.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.493+0000 7f7ad77fe700 1 -- 172.21.15.146:0/2995407201 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7ad00070d0 con 0x7f7ae0068780 2023-10-06T11:05:42.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.494+0000 7f7ad77fe700 1 --2- 172.21.15.146:0/2995407201 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7ac0066f30 0x7f7ac00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:42.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.494+0000 7f7ad77fe700 1 -- 172.21.15.146:0/2995407201 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f7ad0083810 con 0x7f7ae0068780 2023-10-06T11:05:42.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.494+0000 7f7ad67fc700 1 --2- 172.21.15.146:0/2995407201 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7ac0066f30 0x7f7ac00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:42.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.494+0000 7f7ad67fc700 1 --2- 172.21.15.146:0/2995407201 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7ac0066f30 0x7f7ac00693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7ae015bc60 tx=0x7f7ac80091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:42.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.498+0000 7f7ad77fe700 1 -- 172.21.15.146:0/2995407201 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7ad004b5a0 con 0x7f7ae0068780 2023-10-06T11:05:42.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:42.680+0000 7f7adffff700 1 -- 172.21.15.146:0/2995407201 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f7ae00b5a10 con 0x7f7ae0068780 2023-10-06T11:05:43.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.351+0000 7f7ad77fe700 1 -- 172.21.15.146:0/2995407201 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f7ad0050b00 con 0x7f7ae0068780 2023-10-06T11:05:43.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.361+0000 7f7adffff700 1 -- 172.21.15.146:0/2995407201 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7ac0066f30 msgr2=0x7f7ac00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:43.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.361+0000 7f7adffff700 1 --2- 172.21.15.146:0/2995407201 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7ac0066f30 0x7f7ac00693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7ae015bc60 tx=0x7f7ac80091a0 comp rx=0 tx=0).stop 2023-10-06T11:05:43.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.361+0000 7f7adffff700 1 -- 172.21.15.146:0/2995407201 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ae0068780 msgr2=0x7f7ae015d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:43.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.361+0000 7f7adffff700 1 --2- 172.21.15.146:0/2995407201 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ae0068780 0x7f7ae015d620 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7ad000c7c0 tx=0x7f7ad0007f70 comp rx=0 tx=0).stop 2023-10-06T11:05:43.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.361+0000 7f7adffff700 1 -- 172.21.15.146:0/2995407201 shutdown_connections 2023-10-06T11:05:43.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.361+0000 7f7adffff700 1 --2- 172.21.15.146:0/2995407201 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7ac0066f30 0x7f7ac00693e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:43.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.361+0000 7f7adffff700 1 --2- 172.21.15.146:0/2995407201 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ae00cb090 0x7f7ae0153490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:43.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.361+0000 7f7adffff700 1 --2- 172.21.15.146:0/2995407201 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ae0068780 0x7f7ae015d620 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:43.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.361+0000 7f7adffff700 1 --2- 172.21.15.146:0/2995407201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ae00b5640 0x7f7ae0158e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:43.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.361+0000 7f7adffff700 1 -- 172.21.15.146:0/2995407201 >> 172.21.15.146:0/2995407201 conn(0x7f7ae00703f0 msgr2=0x7f7ae015a310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:43.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.363+0000 7f7adffff700 1 -- 172.21.15.146:0/2995407201 shutdown_connections 2023-10-06T11:05:43.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.364+0000 7f7adffff700 1 -- 172.21.15.146:0/2995407201 wait complete. 2023-10-06T11:05:43.369 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' created 2023-10-06T11:05:43.380 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T11:05:43.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.496+0000 7fe607f62700 1 Processor -- start 2023-10-06T11:05:43.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.497+0000 7fe607f62700 1 -- start start 2023-10-06T11:05:43.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.497+0000 7fe607f62700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6000cdde0 0x7fe6000b00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:43.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.497+0000 7fe607f62700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe6000aecd0 0x7fe6000af150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:43.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.497+0000 7fe607f62700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6000cb870 con 0x7fe600159a90 2023-10-06T11:05:43.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.497+0000 7fe607f62700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6000caa40 con 0x7fe6000aecd0 2023-10-06T11:05:43.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.497+0000 7fe607f62700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6000af690 con 0x7fe6000cdde0 2023-10-06T11:05:43.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.497+0000 7fe605cfe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe600159a90 0x7fe6000ca330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33840/0 (socket says 172.21.15.146:33840) 2023-10-06T11:05:43.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.497+0000 7fe605cfe700 1 -- 172.21.15.146:0/1393764245 learned_addr learned my addr 172.21.15.146:0/1393764245 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:05:43.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.498+0000 7fe604cfc700 1 -- 172.21.15.146:0/1393764245 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3394205313 0 0) 0x7fe6000cb870 con 0x7fe600159a90 2023-10-06T11:05:43.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.498+0000 7fe6064ff700 1 --2- 172.21.15.146:0/1393764245 >> v2:172.21.15.151:3300/0 conn(0x7fe6000aecd0 0x7fe6000af150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:43.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.498+0000 7fe6054fd700 1 --2- 172.21.15.146:0/1393764245 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6000cdde0 0x7fe6000b00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:43.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.498+0000 7fe604cfc700 1 -- 172.21.15.146:0/1393764245 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5ec003570 con 0x7fe600159a90 2023-10-06T11:05:43.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.498+0000 7fe604cfc700 1 -- 172.21.15.146:0/1393764245 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2013510436 0 0) 0x7fe5ec003570 con 0x7fe600159a90 2023-10-06T11:05:43.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.498+0000 7fe604cfc700 1 -- 172.21.15.146:0/1393764245 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6000cdde0 msgr2=0x7fe6000b00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:43.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.498+0000 7fe604cfc700 1 --2- 172.21.15.146:0/1393764245 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6000cdde0 0x7fe6000b00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:43.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.498+0000 7fe604cfc700 1 -- 172.21.15.146:0/1393764245 >> v2:172.21.15.151:3300/0 conn(0x7fe6000aecd0 msgr2=0x7fe6000af150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:43.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.498+0000 7fe604cfc700 1 --2- 172.21.15.146:0/1393764245 >> v2:172.21.15.151:3300/0 conn(0x7fe6000aecd0 0x7fe6000af150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:43.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.498+0000 7fe604cfc700 1 -- 172.21.15.146:0/1393764245 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6000cac60 con 0x7fe600159a90 2023-10-06T11:05:43.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.498+0000 7fe604cfc700 1 -- 172.21.15.146:0/1393764245 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fe5fc001470 con 0x7fe600159a90 2023-10-06T11:05:43.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.498+0000 7fe604cfc700 1 -- 172.21.15.146:0/1393764245 >> v1:172.21.15.146:6789/0 conn(0x7fe600159a90 legacy=0x7fe6000ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:43.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.498+0000 7fe604cfc700 1 --2- 172.21.15.146:0/1393764245 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5ec003a60 0x7fe5ec003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:43.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.498+0000 7fe604cfc700 1 --2- 172.21.15.146:0/1393764245 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6000cdde0 0x7fe5ec004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:43.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.498+0000 7fe604cfc700 1 --2- 172.21.15.146:0/1393764245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5ec004d50 0x7fe5ec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:43.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.498+0000 7fe604cfc700 1 -- 172.21.15.146:0/1393764245 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6000caa40 con 0x7fe5ec004d50 2023-10-06T11:05:43.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.498+0000 7fe604cfc700 1 -- 172.21.15.146:0/1393764245 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6000af690 con 0x7fe5ec003a60 2023-10-06T11:05:43.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.498+0000 7fe604cfc700 1 -- 172.21.15.146:0/1393764245 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec00ba60 con 0x7fe6000cdde0 2023-10-06T11:05:43.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.498+0000 7fe605cfe700 1 --2- 172.21.15.146:0/1393764245 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5ec003a60 0x7fe5ec003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:43.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.498+0000 7fe6064ff700 1 --2- 172.21.15.146:0/1393764245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5ec004d50 0x7fe5ec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:43.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.498+0000 7fe6054fd700 1 --2- 172.21.15.146:0/1393764245 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6000cdde0 0x7fe5ec004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:43.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.498+0000 7fe6064ff700 1 -- 172.21.15.146:0/1393764245 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6000cdde0 msgr2=0x7fe5ec004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:43.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.498+0000 7fe6064ff700 1 --2- 172.21.15.146:0/1393764245 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6000cdde0 0x7fe5ec004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:43.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.498+0000 7fe6064ff700 1 -- 172.21.15.146:0/1393764245 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5ec003a60 msgr2=0x7fe5ec003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:43.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.498+0000 7fe6064ff700 1 --2- 172.21.15.146:0/1393764245 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5ec003a60 0x7fe5ec003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:43.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.499+0000 7fe6064ff700 1 -- 172.21.15.146:0/1393764245 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ec003570 con 0x7fe5ec004d50 2023-10-06T11:05:43.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.499+0000 7fe6054fd700 1 --2- 172.21.15.146:0/1393764245 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6000cdde0 0x7fe5ec004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:05:43.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.499+0000 7fe6064ff700 1 --2- 172.21.15.146:0/1393764245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5ec004d50 0x7fe5ec0051c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe5f800e210 tx=0x7fe5f800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19c525cd555571fd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:43.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.499+0000 7fe604cfc700 1 -- 172.21.15.146:0/1393764245 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f800ea60 con 0x7fe5ec004d50 2023-10-06T11:05:43.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.499+0000 7fe604cfc700 1 -- 172.21.15.146:0/1393764245 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f800f040 con 0x7fe5ec004d50 2023-10-06T11:05:43.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.499+0000 7fe604cfc700 1 -- 172.21.15.146:0/1393764245 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f800ee10 con 0x7fe5ec004d50 2023-10-06T11:05:43.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.499+0000 7fe607f62700 1 -- 172.21.15.146:0/1393764245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5ec004d50 msgr2=0x7fe5ec0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:43.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.499+0000 7fe607f62700 1 --2- 172.21.15.146:0/1393764245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5ec004d50 0x7fe5ec0051c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe5f800e210 tx=0x7fe5f800b040 comp rx=0 tx=0).stop 2023-10-06T11:05:43.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.499+0000 7fe6064ff700 1 -- 172.21.15.146:0/1393764245 reap_dead start 2023-10-06T11:05:43.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.499+0000 7fe607f62700 1 -- 172.21.15.146:0/1393764245 shutdown_connections 2023-10-06T11:05:43.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.499+0000 7fe607f62700 1 -- 172.21.15.146:0/1393764245 >> 172.21.15.146:0/1393764245 conn(0x7fe600068580 msgr2=0x7fe600068980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:43.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.499+0000 7fe607f62700 1 -- 172.21.15.146:0/1393764245 shutdown_connections 2023-10-06T11:05:43.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.499+0000 7fe607f62700 1 -- 172.21.15.146:0/1393764245 wait complete. 2023-10-06T11:05:43.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.500+0000 7fe607f62700 1 Processor -- start 2023-10-06T11:05:43.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.500+0000 7fe607f62700 1 -- start start 2023-10-06T11:05:43.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.501+0000 7fe607f62700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe60016c8c0 0x7fe60016ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:43.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.501+0000 7fe607f62700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe60016cc90 0x7fe60016a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:43.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.501+0000 7fe607f62700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe600067470 0x7fe6000678c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:43.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.501+0000 7fe607f62700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe600067e00 con 0x7fe600067470 2023-10-06T11:05:43.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.501+0000 7fe607f62700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6000c7a90 con 0x7fe60016c8c0 2023-10-06T11:05:43.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.501+0000 7fe607f62700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6000c7d70 con 0x7fe60016cc90 2023-10-06T11:05:43.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.501+0000 7fe6064ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe600067470 0x7fe6000678c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:43.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.501+0000 7fe6064ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe600067470 0x7fe6000678c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42048/0 (socket says 172.21.15.146:42048) 2023-10-06T11:05:43.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.501+0000 7fe6064ff700 1 -- 172.21.15.146:0/3927034023 learned_addr learned my addr 172.21.15.146:0/3927034023 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:43.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.501+0000 7fe6054fd700 1 --2- 172.21.15.146:0/3927034023 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe60016cc90 0x7fe60016a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:43.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.501+0000 7fe605cfe700 1 --2- 172.21.15.146:0/3927034023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe60016c8c0 0x7fe60016ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:43.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.502+0000 7fe6064ff700 1 -- 172.21.15.146:0/3927034023 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe60016cc90 msgr2=0x7fe60016a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:43.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.502+0000 7fe6064ff700 1 --2- 172.21.15.146:0/3927034023 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe60016cc90 0x7fe60016a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:43.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.502+0000 7fe6064ff700 1 -- 172.21.15.146:0/3927034023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe60016c8c0 msgr2=0x7fe60016ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:43.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.502+0000 7fe6064ff700 1 --2- 172.21.15.146:0/3927034023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe60016c8c0 0x7fe60016ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:43.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.502+0000 7fe6064ff700 1 -- 172.21.15.146:0/3927034023 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6000c8050 con 0x7fe600067470 2023-10-06T11:05:43.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.502+0000 7fe6064ff700 1 --2- 172.21.15.146:0/3927034023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe600067470 0x7fe6000678c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe5f800afd0 tx=0x7fe5f801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:43.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.502+0000 7fe5f5ffb700 1 -- 172.21.15.146:0/3927034023 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f800eee0 con 0x7fe600067470 2023-10-06T11:05:43.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.502+0000 7fe5f5ffb700 1 -- 172.21.15.146:0/3927034023 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f8014e10 con 0x7fe600067470 2023-10-06T11:05:43.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.502+0000 7fe607f62700 1 -- 172.21.15.146:0/3927034023 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6000c8330 con 0x7fe600067470 2023-10-06T11:05:43.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.502+0000 7fe5f5ffb700 1 -- 172.21.15.146:0/3927034023 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f801d880 con 0x7fe600067470 2023-10-06T11:05:43.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.502+0000 7fe607f62700 1 -- 172.21.15.146:0/3927034023 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe60016aad0 con 0x7fe600067470 2023-10-06T11:05:43.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.503+0000 7fe607f62700 1 -- 172.21.15.146:0/3927034023 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe60004c380 con 0x7fe600067470 2023-10-06T11:05:43.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.503+0000 7fe5f5ffb700 1 -- 172.21.15.146:0/3927034023 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe5f8003040 con 0x7fe600067470 2023-10-06T11:05:43.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.504+0000 7fe5f5ffb700 1 --2- 172.21.15.146:0/3927034023 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe5e4066f30 0x7fe5e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:43.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.504+0000 7fe5f5ffb700 1 -- 172.21.15.146:0/3927034023 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5958+0+0 (secure 0 0 0) 0x7fe5f8085300 con 0x7fe600067470 2023-10-06T11:05:43.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.504+0000 7fe605cfe700 1 --2- 172.21.15.146:0/3927034023 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe5e4066f30 0x7fe5e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:43.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.504+0000 7fe605cfe700 1 --2- 172.21.15.146:0/3927034023 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe5e4066f30 0x7fe5e40693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc0079e0 tx=0x7fe5fc001e90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:43.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.508+0000 7fe5f5ffb700 1 -- 172.21.15.146:0/3927034023 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe5f8052470 con 0x7fe600067470 2023-10-06T11:05:43.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:43.738+0000 7fe607f62700 1 -- 172.21.15.146:0/3927034023 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe6000cda90 con 0x7fe600067470 2023-10-06T11:05:44.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.353+0000 7fe5f5ffb700 1 -- 172.21.15.146:0/3927034023 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fe5f8055a90 con 0x7fe600067470 2023-10-06T11:05:44.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.361+0000 7fe607f62700 1 -- 172.21.15.146:0/3927034023 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe5e4066f30 msgr2=0x7fe5e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:44.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.361+0000 7fe607f62700 1 --2- 172.21.15.146:0/3927034023 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe5e4066f30 0x7fe5e40693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc0079e0 tx=0x7fe5fc001e90 comp rx=0 tx=0).stop 2023-10-06T11:05:44.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.361+0000 7fe607f62700 1 -- 172.21.15.146:0/3927034023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe600067470 msgr2=0x7fe6000678c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:44.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.361+0000 7fe607f62700 1 --2- 172.21.15.146:0/3927034023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe600067470 0x7fe6000678c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe5f800afd0 tx=0x7fe5f801a000 comp rx=0 tx=0).stop 2023-10-06T11:05:44.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.364+0000 7fe607f62700 1 -- 172.21.15.146:0/3927034023 shutdown_connections 2023-10-06T11:05:44.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.364+0000 7fe607f62700 1 --2- 172.21.15.146:0/3927034023 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe5e4066f30 0x7fe5e40693e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:44.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.364+0000 7fe607f62700 1 --2- 172.21.15.146:0/3927034023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe600067470 0x7fe6000678c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:44.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.364+0000 7fe607f62700 1 --2- 172.21.15.146:0/3927034023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe60016c8c0 0x7fe60016ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:44.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.364+0000 7fe607f62700 1 --2- 172.21.15.146:0/3927034023 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe60016cc90 0x7fe60016a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:44.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.364+0000 7fe607f62700 1 -- 172.21.15.146:0/3927034023 >> 172.21.15.146:0/3927034023 conn(0x7fe600068580 msgr2=0x7fe6000b0990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:44.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.366+0000 7fe607f62700 1 -- 172.21.15.146:0/3927034023 shutdown_connections 2023-10-06T11:05:44.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.366+0000 7fe607f62700 1 -- 172.21.15.146:0/3927034023 wait complete. 2023-10-06T11:05:44.373 INFO:teuthology.orchestra.run.smithi146.stderr:new fs with metadata pool 3 and data pool 4 2023-10-06T11:05:44.388 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:05:44.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.501+0000 7f4809180700 1 Processor -- start 2023-10-06T11:05:44.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.501+0000 7f4809180700 1 -- start start 2023-10-06T11:05:44.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.502+0000 7f4809180700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4804157430 0x7f4804157800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:44.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.502+0000 7f4809180700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f48040ca070 0x7f48040cc240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:44.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.502+0000 7f4809180700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48040ccf20 con 0x7f48040ab010 2023-10-06T11:05:44.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.502+0000 7f4809180700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48040ca4f0 con 0x7f4804157430 2023-10-06T11:05:44.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.502+0000 7f4809180700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48040c3dd0 con 0x7f48040ca070 2023-10-06T11:05:44.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.502+0000 7f4802d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4804157430 0x7f4804157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:44.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.502+0000 7f47fa59c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f48040ab010 0x7f48040ceb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33850/0 (socket says 172.21.15.146:33850) 2023-10-06T11:05:44.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.502+0000 7f47fa59c700 1 -- 172.21.15.146:0/342191900 learned_addr learned my addr 172.21.15.146:0/342191900 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:05:44.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.502+0000 7f480359e700 1 --2- 172.21.15.146:0/342191900 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f48040ca070 0x7f48040cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:44.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.502+0000 7f4802d9d700 1 -- 172.21.15.146:0/342191900 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f48040ca070 msgr2=0x7f48040cc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:44.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.502+0000 7f4802d9d700 1 --2- 172.21.15.146:0/342191900 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f48040ca070 0x7f48040cc240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:44.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.503+0000 7f4802d9d700 1 -- 172.21.15.146:0/342191900 >> v1:172.21.15.146:6789/0 conn(0x7f48040ab010 legacy=0x7f48040ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:44.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.503+0000 7f480259c700 1 -- 172.21.15.146:0/342191900 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1282746468 0 0) 0x7f48040ccf20 con 0x7f48040ab010 2023-10-06T11:05:44.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.503+0000 7f4802d9d700 1 -- 172.21.15.146:0/342191900 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48040cd200 con 0x7f4804157430 2023-10-06T11:05:44.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.503+0000 7f4802d9d700 1 --2- 172.21.15.146:0/342191900 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4804157430 0x7f4804157800 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f47f40098e0 tx=0x7f47f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2ec00647c6e4f45 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:44.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.503+0000 7f480259c700 1 -- 172.21.15.146:0/342191900 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f400b640 con 0x7f4804157430 2023-10-06T11:05:44.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.503+0000 7f480259c700 1 -- 172.21.15.146:0/342191900 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f400b7a0 con 0x7f4804157430 2023-10-06T11:05:44.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.503+0000 7f480259c700 1 -- 172.21.15.146:0/342191900 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f400bb40 con 0x7f4804157430 2023-10-06T11:05:44.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.503+0000 7f4809180700 1 -- 172.21.15.146:0/342191900 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4804157430 msgr2=0x7f4804157800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:44.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.503+0000 7f4809180700 1 --2- 172.21.15.146:0/342191900 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4804157430 0x7f4804157800 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f47f40098e0 tx=0x7f47f40091a0 comp rx=0 tx=0).stop 2023-10-06T11:05:44.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.503+0000 7f4809180700 1 -- 172.21.15.146:0/342191900 shutdown_connections 2023-10-06T11:05:44.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.503+0000 7f4809180700 1 --2- 172.21.15.146:0/342191900 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f48040ca070 0x7f48040cc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:44.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.503+0000 7f4809180700 1 --2- 172.21.15.146:0/342191900 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4804157430 0x7f4804157800 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:44.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.503+0000 7f4809180700 1 -- 172.21.15.146:0/342191900 >> 172.21.15.146:0/342191900 conn(0x7f4804067c50 msgr2=0x7f48040ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:44.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.503+0000 7f4809180700 1 -- 172.21.15.146:0/342191900 shutdown_connections 2023-10-06T11:05:44.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.503+0000 7f4809180700 1 -- 172.21.15.146:0/342191900 wait complete. 2023-10-06T11:05:44.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.505+0000 7f4809180700 1 Processor -- start 2023-10-06T11:05:44.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.505+0000 7f4809180700 1 -- start start 2023-10-06T11:05:44.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.505+0000 7f4809180700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48040ab010 0x7f48040ce500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:44.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.505+0000 7f4809180700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48040ca070 0x7f48040b1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:44.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.505+0000 7f4809180700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4804157430 0x7f48041526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:44.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.505+0000 7f4809180700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48040b1fc0 con 0x7f48040ab010 2023-10-06T11:05:44.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.505+0000 7f4809180700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48040b1ce0 con 0x7f48040ca070 2023-10-06T11:05:44.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.505+0000 7f4809180700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f480416b0e0 con 0x7f4804157430 2023-10-06T11:05:44.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.505+0000 7f4802d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48040ab010 0x7f48040ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:44.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.505+0000 7f4802d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48040ab010 0x7f48040ce500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42068/0 (socket says 172.21.15.146:42068) 2023-10-06T11:05:44.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.505+0000 7f4802d9d700 1 -- 172.21.15.146:0/2210107295 learned_addr learned my addr 172.21.15.146:0/2210107295 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:44.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.506+0000 7f47fa59c700 1 --2- 172.21.15.146:0/2210107295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48040ca070 0x7f48040b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:44.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.506+0000 7f480359e700 1 --2- 172.21.15.146:0/2210107295 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4804157430 0x7f48041526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:44.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.506+0000 7f4802d9d700 1 -- 172.21.15.146:0/2210107295 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4804157430 msgr2=0x7f48041526e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:44.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.506+0000 7f4802d9d700 1 --2- 172.21.15.146:0/2210107295 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4804157430 0x7f48041526e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:44.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.506+0000 7f4802d9d700 1 -- 172.21.15.146:0/2210107295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48040ca070 msgr2=0x7f48040b1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:44.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.506+0000 7f4802d9d700 1 --2- 172.21.15.146:0/2210107295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48040ca070 0x7f48040b1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:44.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.506+0000 7f4802d9d700 1 -- 172.21.15.146:0/2210107295 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f4009420 con 0x7f48040ab010 2023-10-06T11:05:44.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.506+0000 7f4802d9d700 1 --2- 172.21.15.146:0/2210107295 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48040ab010 0x7f48040ce500 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f47f4009f80 tx=0x7f47f4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:44.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.506+0000 7f47fb7fe700 1 -- 172.21.15.146:0/2210107295 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f400bb20 con 0x7f48040ab010 2023-10-06T11:05:44.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.506+0000 7f47fb7fe700 1 -- 172.21.15.146:0/2210107295 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f4011420 con 0x7f48040ab010 2023-10-06T11:05:44.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.506+0000 7f4809180700 1 -- 172.21.15.146:0/2210107295 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f480416b3c0 con 0x7f48040ab010 2023-10-06T11:05:44.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.506+0000 7f47fb7fe700 1 -- 172.21.15.146:0/2210107295 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f4011820 con 0x7f48040ab010 2023-10-06T11:05:44.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.506+0000 7f4809180700 1 -- 172.21.15.146:0/2210107295 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4804153740 con 0x7f48040ab010 2023-10-06T11:05:44.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.507+0000 7f4809180700 1 -- 172.21.15.146:0/2210107295 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f480416af40 con 0x7f48040ab010 2023-10-06T11:05:44.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.507+0000 7f47fb7fe700 1 -- 172.21.15.146:0/2210107295 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f47f4011c50 con 0x7f48040ab010 2023-10-06T11:05:44.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.508+0000 7f47fb7fe700 1 --2- 172.21.15.146:0/2210107295 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f47e4066f30 0x7f47e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:44.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.508+0000 7f47fb7fe700 1 -- 172.21.15.146:0/2210107295 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f47f40860c0 con 0x7f48040ab010 2023-10-06T11:05:44.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.508+0000 7f47fa59c700 1 --2- 172.21.15.146:0/2210107295 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f47e4066f30 0x7f47e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:44.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.508+0000 7f47fa59c700 1 --2- 172.21.15.146:0/2210107295 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f47e4066f30 0x7f47e40693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f47ec007fd0 tx=0x7f47ec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:44.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.512+0000 7f47fb7fe700 1 -- 172.21.15.146:0/2210107295 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f480416af40 con 0x7f48040ab010 2023-10-06T11:05:44.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.697+0000 7f4809180700 1 -- 172.21.15.146:0/2210107295 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f480416af40 con 0x7f48040ab010 2023-10-06T11:05:44.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.698+0000 7f47fb7fe700 1 -- 172.21.15.146:0/2210107295 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16927 (secure 0 0 0) 0x7f480416af40 con 0x7f48040ab010 2023-10-06T11:05:44.700 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:05:44.700 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":19,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:05:43.740167+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:05:41.403954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T11:05:42.698754+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:05:44.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.700+0000 7f4809180700 1 -- 172.21.15.146:0/2210107295 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f47e4066f30 msgr2=0x7f47e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:44.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.700+0000 7f4809180700 1 --2- 172.21.15.146:0/2210107295 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f47e4066f30 0x7f47e40693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f47ec007fd0 tx=0x7f47ec009040 comp rx=0 tx=0).stop 2023-10-06T11:05:44.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.700+0000 7f4809180700 1 -- 172.21.15.146:0/2210107295 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48040ab010 msgr2=0x7f48040ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:44.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.700+0000 7f4809180700 1 --2- 172.21.15.146:0/2210107295 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48040ab010 0x7f48040ce500 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f47f4009f80 tx=0x7f47f4017000 comp rx=0 tx=0).stop 2023-10-06T11:05:44.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.700+0000 7f4809180700 1 -- 172.21.15.146:0/2210107295 shutdown_connections 2023-10-06T11:05:44.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.700+0000 7f4809180700 1 --2- 172.21.15.146:0/2210107295 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f47e4066f30 0x7f47e40693e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:44.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.700+0000 7f4809180700 1 --2- 172.21.15.146:0/2210107295 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4804157430 0x7f48041526e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:44.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.700+0000 7f4809180700 1 --2- 172.21.15.146:0/2210107295 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48040ab010 0x7f48040ce500 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:44.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.700+0000 7f4809180700 1 --2- 172.21.15.146:0/2210107295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48040ca070 0x7f48040b1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:44.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.700+0000 7f4809180700 1 -- 172.21.15.146:0/2210107295 >> 172.21.15.146:0/2210107295 conn(0x7f4804067c50 msgr2=0x7f48040cb7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:44.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.700+0000 7f4809180700 1 -- 172.21.15.146:0/2210107295 shutdown_connections 2023-10-06T11:05:44.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.700+0000 7f4809180700 1 -- 172.21.15.146:0/2210107295 wait complete. 2023-10-06T11:05:44.714 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:05:44.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.826+0000 7fd6a4968700 1 Processor -- start 2023-10-06T11:05:44.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.826+0000 7fd6a4968700 1 -- start start 2023-10-06T11:05:44.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.827+0000 7fd6a4968700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6a0153ab0 0x7fd6a015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:44.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.827+0000 7fd6a4968700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd6a0068ba0 0x7fd6a00b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:44.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.827+0000 7fd6a4968700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6a015ac30 con 0x7fd6a0153e80 2023-10-06T11:05:44.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.827+0000 7fd6a4968700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6a00b4510 con 0x7fd6a0068ba0 2023-10-06T11:05:44.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.827+0000 7fd6a4968700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a00b6530 con 0x7fd6a0153ab0 2023-10-06T11:05:44.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.827+0000 7fd69ed9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd6a0068ba0 0x7fd6a00b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:44.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.827+0000 7fd695d9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd6a0153e80 0x7fd6a0068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33856/0 (socket says 172.21.15.146:33856) 2023-10-06T11:05:44.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.827+0000 7fd695d9b700 1 -- 172.21.15.146:0/508215341 learned_addr learned my addr 172.21.15.146:0/508215341 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:05:44.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.828+0000 7fd69e59c700 1 --2- 172.21.15.146:0/508215341 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6a0153ab0 0x7fd6a015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:44.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.828+0000 7fd69ed9d700 1 -- 172.21.15.146:0/508215341 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6a0153ab0 msgr2=0x7fd6a015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:44.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.828+0000 7fd69ed9d700 1 --2- 172.21.15.146:0/508215341 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6a0153ab0 0x7fd6a015a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:44.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.828+0000 7fd69ed9d700 1 -- 172.21.15.146:0/508215341 >> v1:172.21.15.146:6789/0 conn(0x7fd6a0153e80 legacy=0x7fd6a0068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:44.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.828+0000 7fd69ed9d700 1 -- 172.21.15.146:0/508215341 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a00b5c50 con 0x7fd6a0068ba0 2023-10-06T11:05:44.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.828+0000 7fd69dd9b700 1 -- 172.21.15.146:0/508215341 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 650806678 0 0) 0x7fd688001110 con 0x7fd6a0153e80 2023-10-06T11:05:44.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.828+0000 7fd69ed9d700 1 --2- 172.21.15.146:0/508215341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6a0068ba0 0x7fd6a00b49a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd698009e60 tx=0x7fd698009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59ff4bdc279f2627 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:44.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.828+0000 7fd69dd9b700 1 -- 172.21.15.146:0/508215341 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69800e070 con 0x7fd6a0068ba0 2023-10-06T11:05:44.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.828+0000 7fd69dd9b700 1 -- 172.21.15.146:0/508215341 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd69800bc30 con 0x7fd6a0068ba0 2023-10-06T11:05:44.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.828+0000 7fd69dd9b700 1 -- 172.21.15.146:0/508215341 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd698012430 con 0x7fd6a0068ba0 2023-10-06T11:05:44.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.828+0000 7fd6a4968700 1 -- 172.21.15.146:0/508215341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6a0068ba0 msgr2=0x7fd6a00b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:44.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.828+0000 7fd6a4968700 1 --2- 172.21.15.146:0/508215341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6a0068ba0 0x7fd6a00b49a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd698009e60 tx=0x7fd698009780 comp rx=0 tx=0).stop 2023-10-06T11:05:44.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.828+0000 7fd6a4968700 1 -- 172.21.15.146:0/508215341 shutdown_connections 2023-10-06T11:05:44.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.828+0000 7fd6a4968700 1 --2- 172.21.15.146:0/508215341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6a0068ba0 0x7fd6a00b49a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:44.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.828+0000 7fd6a4968700 1 --2- 172.21.15.146:0/508215341 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6a0153ab0 0x7fd6a015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:44.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.828+0000 7fd6a4968700 1 -- 172.21.15.146:0/508215341 >> 172.21.15.146:0/508215341 conn(0x7fd6a006eba0 msgr2=0x7fd6a006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:44.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.828+0000 7fd6a4968700 1 -- 172.21.15.146:0/508215341 shutdown_connections 2023-10-06T11:05:44.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.828+0000 7fd6a4968700 1 -- 172.21.15.146:0/508215341 wait complete. 2023-10-06T11:05:44.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.830+0000 7fd6a4968700 1 Processor -- start 2023-10-06T11:05:44.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.830+0000 7fd6a4968700 1 -- start start 2023-10-06T11:05:44.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.830+0000 7fd6a4968700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6a0068ba0 0x7fd6a014b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:44.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.830+0000 7fd6a4968700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6a0153ab0 0x7fd6a00b2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:44.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.830+0000 7fd6a4968700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6a0153e80 0x7fd6a014aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:44.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.830+0000 7fd6a4968700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a00b1de0 con 0x7fd6a0068ba0 2023-10-06T11:05:44.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.830+0000 7fd6a4968700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a014b430 con 0x7fd6a0153e80 2023-10-06T11:05:44.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.830+0000 7fd6a4968700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a00b1060 con 0x7fd6a0153ab0 2023-10-06T11:05:44.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.830+0000 7fd69e59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6a0068ba0 0x7fd6a014b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:44.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.830+0000 7fd69e59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6a0068ba0 0x7fd6a014b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42086/0 (socket says 172.21.15.146:42086) 2023-10-06T11:05:44.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.831+0000 7fd69e59c700 1 -- 172.21.15.146:0/1509116374 learned_addr learned my addr 172.21.15.146:0/1509116374 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:44.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.831+0000 7fd695d9b700 1 --2- 172.21.15.146:0/1509116374 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6a0153ab0 0x7fd6a00b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:44.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.831+0000 7fd69ed9d700 1 --2- 172.21.15.146:0/1509116374 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6a0153e80 0x7fd6a014aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:44.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.831+0000 7fd69e59c700 1 -- 172.21.15.146:0/1509116374 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6a0153ab0 msgr2=0x7fd6a00b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:44.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.831+0000 7fd69e59c700 1 --2- 172.21.15.146:0/1509116374 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6a0153ab0 0x7fd6a00b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:44.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.831+0000 7fd69e59c700 1 -- 172.21.15.146:0/1509116374 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6a0153e80 msgr2=0x7fd6a014aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:44.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.831+0000 7fd69e59c700 1 --2- 172.21.15.146:0/1509116374 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6a0153e80 0x7fd6a014aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:44.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.831+0000 7fd69e59c700 1 -- 172.21.15.146:0/1509116374 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd698009a20 con 0x7fd6a0068ba0 2023-10-06T11:05:44.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.831+0000 7fd69ed9d700 1 --2- 172.21.15.146:0/1509116374 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6a0153e80 0x7fd6a014aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:05:44.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.831+0000 7fd695d9b700 1 --2- 172.21.15.146:0/1509116374 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6a0153ab0 0x7fd6a00b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:05:44.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.831+0000 7fd69e59c700 1 --2- 172.21.15.146:0/1509116374 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6a0068ba0 0x7fd6a014b790 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd69000d890 tx=0x7fd690008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:44.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.831+0000 7fd696ffd700 1 -- 172.21.15.146:0/1509116374 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69000b600 con 0x7fd6a0068ba0 2023-10-06T11:05:44.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.831+0000 7fd696ffd700 1 -- 172.21.15.146:0/1509116374 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd69000b760 con 0x7fd6a0068ba0 2023-10-06T11:05:44.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.831+0000 7fd696ffd700 1 -- 172.21.15.146:0/1509116374 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69000bae0 con 0x7fd6a0068ba0 2023-10-06T11:05:44.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.831+0000 7fd6a4968700 1 -- 172.21.15.146:0/1509116374 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6a00b0aa0 con 0x7fd6a0068ba0 2023-10-06T11:05:44.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.831+0000 7fd6a4968700 1 -- 172.21.15.146:0/1509116374 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6a014bd70 con 0x7fd6a0068ba0 2023-10-06T11:05:44.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.832+0000 7fd6a4968700 1 -- 172.21.15.146:0/1509116374 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6a004c380 con 0x7fd6a0068ba0 2023-10-06T11:05:44.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.832+0000 7fd696ffd700 1 -- 172.21.15.146:0/1509116374 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd69001e460 con 0x7fd6a0068ba0 2023-10-06T11:05:44.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.833+0000 7fd696ffd700 1 --2- 172.21.15.146:0/1509116374 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd680066f30 0x7fd6800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:44.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.833+0000 7fd696ffd700 1 -- 172.21.15.146:0/1509116374 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd690084d40 con 0x7fd6a0068ba0 2023-10-06T11:05:44.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.833+0000 7fd695d9b700 1 --2- 172.21.15.146:0/1509116374 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd680066f30 0x7fd6800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:44.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.833+0000 7fd695d9b700 1 --2- 172.21.15.146:0/1509116374 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd680066f30 0x7fd6800693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd6a01542f0 tx=0x7fd688009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:44.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:44.837+0000 7fd696ffd700 1 -- 172.21.15.146:0/1509116374 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd690051e50 con 0x7fd6a0068ba0 2023-10-06T11:05:45.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.022+0000 7fd6a4968700 1 -- 172.21.15.146:0/1509116374 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6a00b20c0 con 0x7fd6a0068ba0 2023-10-06T11:05:45.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.023+0000 7fd696ffd700 1 -- 172.21.15.146:0/1509116374 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16927 (secure 0 0 0) 0x7fd690055470 con 0x7fd6a0068ba0 2023-10-06T11:05:45.024 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:05:45.025 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":19,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:05:43.740167+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:05:41.403954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T11:05:42.698754+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:05:45.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.025+0000 7fd6a4968700 1 -- 172.21.15.146:0/1509116374 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd680066f30 msgr2=0x7fd6800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:45.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.025+0000 7fd6a4968700 1 --2- 172.21.15.146:0/1509116374 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd680066f30 0x7fd6800693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd6a01542f0 tx=0x7fd688009040 comp rx=0 tx=0).stop 2023-10-06T11:05:45.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.025+0000 7fd6a4968700 1 -- 172.21.15.146:0/1509116374 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6a0068ba0 msgr2=0x7fd6a014b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:45.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.025+0000 7fd6a4968700 1 --2- 172.21.15.146:0/1509116374 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6a0068ba0 0x7fd6a014b790 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fd69000d890 tx=0x7fd690008040 comp rx=0 tx=0).stop 2023-10-06T11:05:45.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.025+0000 7fd6a4968700 1 -- 172.21.15.146:0/1509116374 shutdown_connections 2023-10-06T11:05:45.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.025+0000 7fd6a4968700 1 --2- 172.21.15.146:0/1509116374 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd680066f30 0x7fd6800693e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:45.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.025+0000 7fd6a4968700 1 --2- 172.21.15.146:0/1509116374 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6a0153e80 0x7fd6a014aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:45.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.025+0000 7fd6a4968700 1 --2- 172.21.15.146:0/1509116374 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6a0068ba0 0x7fd6a014b790 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:45.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.025+0000 7fd6a4968700 1 --2- 172.21.15.146:0/1509116374 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6a0153ab0 0x7fd6a00b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:45.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.025+0000 7fd6a4968700 1 -- 172.21.15.146:0/1509116374 >> 172.21.15.146:0/1509116374 conn(0x7fd6a006eba0 msgr2=0x7fd6a0151f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:45.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.025+0000 7fd6a4968700 1 -- 172.21.15.146:0/1509116374 shutdown_connections 2023-10-06T11:05:45.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.025+0000 7fd6a4968700 1 -- 172.21.15.146:0/1509116374 wait complete. 2023-10-06T11:05:45.039 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T11:05:45.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.154+0000 7fc5d4906700 1 Processor -- start 2023-10-06T11:05:45.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.154+0000 7fc5d4906700 1 -- start start 2023-10-06T11:05:45.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.155+0000 7fc5d4906700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5d015cc20 0x7fc5d015d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:45.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.155+0000 7fc5d4906700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc5d015cff0 0x7fc5d00d0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:45.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.155+0000 7fc5d4906700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5d00cf030 con 0x7fc5d00d0a80 2023-10-06T11:05:45.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.155+0000 7fc5d4906700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5d015e390 con 0x7fc5d015cff0 2023-10-06T11:05:45.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.155+0000 7fc5d4906700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d00ced20 con 0x7fc5d015cc20 2023-10-06T11:05:45.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.155+0000 7fc5c5d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc5d015cff0 0x7fc5d00d0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:45.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.155+0000 7fc5ced9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc5d00d0a80 0x7fc5d015a890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33866/0 (socket says 172.21.15.146:33866) 2023-10-06T11:05:45.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.155+0000 7fc5ced9d700 1 -- 172.21.15.146:0/1656889865 learned_addr learned my addr 172.21.15.146:0/1656889865 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:05:45.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.155+0000 7fc5ce59c700 1 --2- 172.21.15.146:0/1656889865 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5d015cc20 0x7fc5d015d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:45.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.156+0000 7fc5c5d9b700 1 -- 172.21.15.146:0/1656889865 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5d015cc20 msgr2=0x7fc5d015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:45.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.156+0000 7fc5c5d9b700 1 --2- 172.21.15.146:0/1656889865 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5d015cc20 0x7fc5d015d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:45.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.156+0000 7fc5c5d9b700 1 -- 172.21.15.146:0/1656889865 >> v1:172.21.15.146:6789/0 conn(0x7fc5d00d0a80 legacy=0x7fc5d015a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:45.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.156+0000 7fc5c5d9b700 1 -- 172.21.15.146:0/1656889865 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d00d0ea0 con 0x7fc5d015cff0 2023-10-06T11:05:45.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.156+0000 7fc5cdd9b700 1 -- 172.21.15.146:0/1656889865 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3591453571 0 0) 0x7fc5d00cf030 con 0x7fc5d00d0a80 2023-10-06T11:05:45.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.156+0000 7fc5c5d9b700 1 --2- 172.21.15.146:0/1656889865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5d015cff0 0x7fc5d00d0540 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc5b80098e0 tx=0x7fc5b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5142a58f97fda3ee server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:45.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.156+0000 7fc5cdd9b700 1 -- 172.21.15.146:0/1656889865 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b800b640 con 0x7fc5d015cff0 2023-10-06T11:05:45.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.156+0000 7fc5cdd9b700 1 -- 172.21.15.146:0/1656889865 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5b800b7a0 con 0x7fc5d015cff0 2023-10-06T11:05:45.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.156+0000 7fc5cdd9b700 1 -- 172.21.15.146:0/1656889865 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b800bb40 con 0x7fc5d015cff0 2023-10-06T11:05:45.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.156+0000 7fc5d4906700 1 -- 172.21.15.146:0/1656889865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5d015cff0 msgr2=0x7fc5d00d0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:45.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.156+0000 7fc5d4906700 1 --2- 172.21.15.146:0/1656889865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5d015cff0 0x7fc5d00d0540 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc5b80098e0 tx=0x7fc5b80091a0 comp rx=0 tx=0).stop 2023-10-06T11:05:45.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.156+0000 7fc5d4906700 1 -- 172.21.15.146:0/1656889865 shutdown_connections 2023-10-06T11:05:45.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.156+0000 7fc5d4906700 1 --2- 172.21.15.146:0/1656889865 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5d015cc20 0x7fc5d015d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:45.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.156+0000 7fc5d4906700 1 --2- 172.21.15.146:0/1656889865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5d015cff0 0x7fc5d00d0540 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:45.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.157+0000 7fc5d4906700 1 -- 172.21.15.146:0/1656889865 >> 172.21.15.146:0/1656889865 conn(0x7fc5d006eba0 msgr2=0x7fc5d006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:45.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.157+0000 7fc5d4906700 1 -- 172.21.15.146:0/1656889865 shutdown_connections 2023-10-06T11:05:45.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.157+0000 7fc5d4906700 1 -- 172.21.15.146:0/1656889865 wait complete. 2023-10-06T11:05:45.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.158+0000 7fc5d4906700 1 Processor -- start 2023-10-06T11:05:45.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.158+0000 7fc5d4906700 1 -- start start 2023-10-06T11:05:45.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.159+0000 7fc5d4906700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5d00d0a80 0x7fc5d016a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:45.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.159+0000 7fc5d4906700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5d015cc20 0x7fc5d01560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:45.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.159+0000 7fc5d4906700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5d015cff0 0x7fc5d00ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:45.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.159+0000 7fc5d4906700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d00c7f10 con 0x7fc5d015cc20 2023-10-06T11:05:45.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.159+0000 7fc5d4906700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d00caaf0 con 0x7fc5d015cff0 2023-10-06T11:05:45.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.159+0000 7fc5d4906700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d00c5b80 con 0x7fc5d00d0a80 2023-10-06T11:05:45.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.159+0000 7fc5c5d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5d015cc20 0x7fc5d01560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:45.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.159+0000 7fc5c5d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5d015cc20 0x7fc5d01560e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42092/0 (socket says 172.21.15.146:42092) 2023-10-06T11:05:45.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.159+0000 7fc5c5d9b700 1 -- 172.21.15.146:0/1517273650 learned_addr learned my addr 172.21.15.146:0/1517273650 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:45.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.159+0000 7fc5ce59c700 1 --2- 172.21.15.146:0/1517273650 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5d00d0a80 0x7fc5d016a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:45.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.159+0000 7fc5ced9d700 1 --2- 172.21.15.146:0/1517273650 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5d015cff0 0x7fc5d00ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:45.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.159+0000 7fc5c5d9b700 1 -- 172.21.15.146:0/1517273650 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5d00d0a80 msgr2=0x7fc5d016a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:45.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.159+0000 7fc5c5d9b700 1 --2- 172.21.15.146:0/1517273650 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5d00d0a80 0x7fc5d016a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:45.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.159+0000 7fc5c5d9b700 1 -- 172.21.15.146:0/1517273650 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5d015cff0 msgr2=0x7fc5d00ca5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:45.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.159+0000 7fc5c5d9b700 1 --2- 172.21.15.146:0/1517273650 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5d015cff0 0x7fc5d00ca5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:45.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.159+0000 7fc5c5d9b700 1 -- 172.21.15.146:0/1517273650 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b8009420 con 0x7fc5d015cc20 2023-10-06T11:05:45.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.159+0000 7fc5c5d9b700 1 --2- 172.21.15.146:0/1517273650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5d015cc20 0x7fc5d01560e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8013000 tx=0x7fc5b8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:45.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.159+0000 7fc5c6ffd700 1 -- 172.21.15.146:0/1517273650 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b800bb20 con 0x7fc5d015cc20 2023-10-06T11:05:45.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.159+0000 7fc5c6ffd700 1 -- 172.21.15.146:0/1517273650 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5b8011420 con 0x7fc5d015cc20 2023-10-06T11:05:45.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.159+0000 7fc5c6ffd700 1 -- 172.21.15.146:0/1517273650 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b80117a0 con 0x7fc5d015cc20 2023-10-06T11:05:45.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.159+0000 7fc5d4906700 1 -- 172.21.15.146:0/1517273650 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5d00c5e60 con 0x7fc5d015cc20 2023-10-06T11:05:45.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.159+0000 7fc5d4906700 1 -- 172.21.15.146:0/1517273650 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5d00c6420 con 0x7fc5d015cc20 2023-10-06T11:05:45.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.160+0000 7fc5d4906700 1 -- 172.21.15.146:0/1517273650 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5d00c8080 con 0x7fc5d015cc20 2023-10-06T11:05:45.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.160+0000 7fc5c6ffd700 1 -- 172.21.15.146:0/1517273650 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc5b8011b50 con 0x7fc5d015cc20 2023-10-06T11:05:45.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.161+0000 7fc5c6ffd700 1 --2- 172.21.15.146:0/1517273650 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc5b0066f30 0x7fc5b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:45.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.161+0000 7fc5c6ffd700 1 -- 172.21.15.146:0/1517273650 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc5b8085dc0 con 0x7fc5d015cc20 2023-10-06T11:05:45.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.161+0000 7fc5ce59c700 1 --2- 172.21.15.146:0/1517273650 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc5b0066f30 0x7fc5b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:45.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.161+0000 7fc5ce59c700 1 --2- 172.21.15.146:0/1517273650 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc5b0066f30 0x7fc5b00693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0009d30 tx=0x7fc5c0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:45.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.165+0000 7fc5c6ffd700 1 -- 172.21.15.146:0/1517273650 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc5d00c8080 con 0x7fc5d015cc20 2023-10-06T11:05:45.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:45.393+0000 7fc5d4906700 1 -- 172.21.15.146:0/1517273650 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc5d00c8050 con 0x7fc5d015cc20 2023-10-06T11:05:46.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.373+0000 7fc5c6ffd700 1 -- 172.21.15.146:0/1517273650 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc5b8052ed0 con 0x7fc5d015cc20 2023-10-06T11:05:46.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.375+0000 7fc5d4906700 1 -- 172.21.15.146:0/1517273650 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc5b0066f30 msgr2=0x7fc5b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:46.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.375+0000 7fc5d4906700 1 --2- 172.21.15.146:0/1517273650 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc5b0066f30 0x7fc5b00693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0009d30 tx=0x7fc5c0008040 comp rx=0 tx=0).stop 2023-10-06T11:05:46.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.375+0000 7fc5d4906700 1 -- 172.21.15.146:0/1517273650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5d015cc20 msgr2=0x7fc5d01560e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:46.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.375+0000 7fc5d4906700 1 --2- 172.21.15.146:0/1517273650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5d015cc20 0x7fc5d01560e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc5b8013000 tx=0x7fc5b8017000 comp rx=0 tx=0).stop 2023-10-06T11:05:46.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.375+0000 7fc5d4906700 1 -- 172.21.15.146:0/1517273650 shutdown_connections 2023-10-06T11:05:46.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.375+0000 7fc5d4906700 1 --2- 172.21.15.146:0/1517273650 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc5b0066f30 0x7fc5b00693e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:46.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.375+0000 7fc5d4906700 1 --2- 172.21.15.146:0/1517273650 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5d015cff0 0x7fc5d00ca5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:46.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.375+0000 7fc5d4906700 1 --2- 172.21.15.146:0/1517273650 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc5d00d0a80 0x7fc5d016a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:46.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.375+0000 7fc5d4906700 1 --2- 172.21.15.146:0/1517273650 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5d015cc20 0x7fc5d01560e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:46.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.375+0000 7fc5d4906700 1 -- 172.21.15.146:0/1517273650 >> 172.21.15.146:0/1517273650 conn(0x7fc5d006eba0 msgr2=0x7fc5d00b4310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:46.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.375+0000 7fc5d4906700 1 -- 172.21.15.146:0/1517273650 shutdown_connections 2023-10-06T11:05:46.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.375+0000 7fc5d4906700 1 -- 172.21.15.146:0/1517273650 wait complete. 2023-10-06T11:05:46.390 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T11:05:46.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.508+0000 7f4b594f7700 1 Processor -- start 2023-10-06T11:05:46.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.508+0000 7f4b594f7700 1 -- start start 2023-10-06T11:05:46.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.509+0000 7f4b594f7700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4b54068b90 0x7f4b540c7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:46.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.509+0000 7f4b594f7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4b540c7650 0x7f4b54155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:46.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.509+0000 7f4b594f7700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b5415a130 con 0x7f4b54155b00 2023-10-06T11:05:46.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.509+0000 7f4b594f7700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b5406ad80 con 0x7f4b540c7650 2023-10-06T11:05:46.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.509+0000 7f4b594f7700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b540c7e80 con 0x7f4b54068b90 2023-10-06T11:05:46.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.509+0000 7f4b537fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4b540c7650 0x7f4b54155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:46.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.509+0000 7f4b537fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4b540c7650 0x7f4b54155ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42104/0 (socket says 172.21.15.146:42104) 2023-10-06T11:05:46.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.509+0000 7f4b537fe700 1 -- 172.21.15.146:0/586524520 learned_addr learned my addr 172.21.15.146:0/586524520 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:46.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.510+0000 7f4b4a7fc700 1 --2- 172.21.15.146:0/586524520 >> v2:172.21.15.151:3300/0 conn(0x7f4b54068b90 0x7f4b540c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:46.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.510+0000 7f4b537fe700 1 -- 172.21.15.146:0/586524520 >> v2:172.21.15.151:3300/0 conn(0x7f4b54068b90 msgr2=0x7f4b540c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:46.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.510+0000 7f4b537fe700 1 --2- 172.21.15.146:0/586524520 >> v2:172.21.15.151:3300/0 conn(0x7f4b54068b90 0x7f4b540c7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:46.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.510+0000 7f4b537fe700 1 -- 172.21.15.146:0/586524520 >> v1:172.21.15.151:6789/0 conn(0x7f4b54155b00 legacy=0x7f4b54068480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:46.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.510+0000 7f4b537fe700 1 -- 172.21.15.146:0/586524520 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b54159800 con 0x7f4b540c7650 2023-10-06T11:05:46.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.510+0000 7f4b537fe700 1 --2- 172.21.15.146:0/586524520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b540c7650 0x7f4b54155ed0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4b540c9430 tx=0x7f4b4c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd38d557079ca38e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:46.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.510+0000 7f4b527fc700 1 -- 172.21.15.146:0/586524520 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c00e070 con 0x7f4b540c7650 2023-10-06T11:05:46.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.510+0000 7f4b527fc700 1 -- 172.21.15.146:0/586524520 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b4c00ba50 con 0x7f4b540c7650 2023-10-06T11:05:46.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.510+0000 7f4b527fc700 1 -- 172.21.15.146:0/586524520 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c0092e0 con 0x7f4b540c7650 2023-10-06T11:05:46.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.510+0000 7f4b594f7700 1 -- 172.21.15.146:0/586524520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b540c7650 msgr2=0x7f4b54155ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:46.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.510+0000 7f4b594f7700 1 --2- 172.21.15.146:0/586524520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b540c7650 0x7f4b54155ed0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4b540c9430 tx=0x7f4b4c009840 comp rx=0 tx=0).stop 2023-10-06T11:05:46.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.510+0000 7f4b594f7700 1 -- 172.21.15.146:0/586524520 shutdown_connections 2023-10-06T11:05:46.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.510+0000 7f4b594f7700 1 --2- 172.21.15.146:0/586524520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b540c7650 0x7f4b54155ed0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:46.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.510+0000 7f4b594f7700 1 --2- 172.21.15.146:0/586524520 >> v2:172.21.15.151:3300/0 conn(0x7f4b54068b90 0x7f4b540c7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:46.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.510+0000 7f4b594f7700 1 -- 172.21.15.146:0/586524520 >> 172.21.15.146:0/586524520 conn(0x7f4b540c9fa0 msgr2=0x7f4b5406de70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:46.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.510+0000 7f4b594f7700 1 -- 172.21.15.146:0/586524520 shutdown_connections 2023-10-06T11:05:46.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.510+0000 7f4b594f7700 1 -- 172.21.15.146:0/586524520 wait complete. 2023-10-06T11:05:46.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.512+0000 7f4b594f7700 1 Processor -- start 2023-10-06T11:05:46.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.512+0000 7f4b594f7700 1 -- start start 2023-10-06T11:05:46.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.512+0000 7f4b594f7700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b54068b90 0x7f4b54145dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:46.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.512+0000 7f4b594f7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b540c7650 0x7f4b54160e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:46.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.512+0000 7f4b594f7700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b54155b00 0x7f4b541580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:46.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.512+0000 7f4b594f7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b54146310 con 0x7f4b540c7650 2023-10-06T11:05:46.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.512+0000 7f4b594f7700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b541465b0 con 0x7f4b54155b00 2023-10-06T11:05:46.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.512+0000 7f4b594f7700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b54146890 con 0x7f4b54068b90 2023-10-06T11:05:46.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.512+0000 7f4b4a7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b540c7650 0x7f4b54160e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:46.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.512+0000 7f4b4a7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b540c7650 0x7f4b54160e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42120/0 (socket says 172.21.15.146:42120) 2023-10-06T11:05:46.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.512+0000 7f4b4a7fc700 1 -- 172.21.15.146:0/1284686290 learned_addr learned my addr 172.21.15.146:0/1284686290 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:46.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.513+0000 7f4b537fe700 1 --2- 172.21.15.146:0/1284686290 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b54155b00 0x7f4b541580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:46.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.513+0000 7f4b52ffd700 1 --2- 172.21.15.146:0/1284686290 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b54068b90 0x7f4b54145dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:46.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.513+0000 7f4b4a7fc700 1 -- 172.21.15.146:0/1284686290 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b54068b90 msgr2=0x7f4b54145dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:46.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.513+0000 7f4b4a7fc700 1 --2- 172.21.15.146:0/1284686290 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b54068b90 0x7f4b54145dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:46.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.513+0000 7f4b4a7fc700 1 -- 172.21.15.146:0/1284686290 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b54155b00 msgr2=0x7f4b541580e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:46.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.513+0000 7f4b4a7fc700 1 --2- 172.21.15.146:0/1284686290 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b54155b00 0x7f4b541580e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:46.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.513+0000 7f4b4a7fc700 1 -- 172.21.15.146:0/1284686290 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b4c009ae0 con 0x7f4b540c7650 2023-10-06T11:05:46.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.513+0000 7f4b4a7fc700 1 --2- 172.21.15.146:0/1284686290 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b540c7650 0x7f4b54160e80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c00d860 tx=0x7f4b3c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:46.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.513+0000 7f4b4b7fe700 1 -- 172.21.15.146:0/1284686290 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c0125f0 con 0x7f4b540c7650 2023-10-06T11:05:46.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.513+0000 7f4b4b7fe700 1 -- 172.21.15.146:0/1284686290 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b3c012750 con 0x7f4b540c7650 2023-10-06T11:05:46.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.513+0000 7f4b594f7700 1 -- 172.21.15.146:0/1284686290 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b54146b70 con 0x7f4b540c7650 2023-10-06T11:05:46.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.513+0000 7f4b4b7fe700 1 -- 172.21.15.146:0/1284686290 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c012b10 con 0x7f4b540c7650 2023-10-06T11:05:46.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.513+0000 7f4b594f7700 1 -- 172.21.15.146:0/1284686290 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b54147130 con 0x7f4b540c7650 2023-10-06T11:05:46.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.514+0000 7f4b594f7700 1 -- 172.21.15.146:0/1284686290 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b54147320 con 0x7f4b540c7650 2023-10-06T11:05:46.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.515+0000 7f4b4b7fe700 1 -- 172.21.15.146:0/1284686290 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4b3c01e460 con 0x7f4b540c7650 2023-10-06T11:05:46.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.515+0000 7f4b4b7fe700 1 --2- 172.21.15.146:0/1284686290 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4b34066f30 0x7f4b340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:46.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.515+0000 7f4b4b7fe700 1 -- 172.21.15.146:0/1284686290 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4b3c084bc0 con 0x7f4b540c7650 2023-10-06T11:05:46.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.515+0000 7f4b52ffd700 1 --2- 172.21.15.146:0/1284686290 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4b34066f30 0x7f4b340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:46.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.515+0000 7f4b52ffd700 1 --2- 172.21.15.146:0/1284686290 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4b34066f30 0x7f4b340693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4b5416b360 tx=0x7f4b44009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:46.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.519+0000 7f4b4b7fe700 1 -- 172.21.15.146:0/1284686290 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b3c051cd0 con 0x7f4b540c7650 2023-10-06T11:05:46.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:46.747+0000 7f4b594f7700 1 -- 172.21.15.146:0/1284686290 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4b5404c380 con 0x7f4b540c7650 2023-10-06T11:05:47.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.380+0000 7f4b4b7fe700 1 -- 172.21.15.146:0/1284686290 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4b3c0552f0 con 0x7f4b540c7650 2023-10-06T11:05:47.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.382+0000 7f4b594f7700 1 -- 172.21.15.146:0/1284686290 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4b34066f30 msgr2=0x7f4b340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:47.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.382+0000 7f4b594f7700 1 --2- 172.21.15.146:0/1284686290 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4b34066f30 0x7f4b340693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4b5416b360 tx=0x7f4b44009040 comp rx=0 tx=0).stop 2023-10-06T11:05:47.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.382+0000 7f4b594f7700 1 -- 172.21.15.146:0/1284686290 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b540c7650 msgr2=0x7f4b54160e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:47.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.382+0000 7f4b594f7700 1 --2- 172.21.15.146:0/1284686290 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b540c7650 0x7f4b54160e80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c00d860 tx=0x7f4b3c008040 comp rx=0 tx=0).stop 2023-10-06T11:05:47.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.382+0000 7f4b594f7700 1 -- 172.21.15.146:0/1284686290 shutdown_connections 2023-10-06T11:05:47.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.383+0000 7f4b594f7700 1 --2- 172.21.15.146:0/1284686290 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4b34066f30 0x7f4b340693e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:47.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.383+0000 7f4b594f7700 1 --2- 172.21.15.146:0/1284686290 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b54155b00 0x7f4b541580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:47.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.383+0000 7f4b594f7700 1 --2- 172.21.15.146:0/1284686290 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b54068b90 0x7f4b54145dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:47.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.383+0000 7f4b594f7700 1 --2- 172.21.15.146:0/1284686290 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b540c7650 0x7f4b54160e80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:47.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.383+0000 7f4b594f7700 1 -- 172.21.15.146:0/1284686290 >> 172.21.15.146:0/1284686290 conn(0x7f4b540c9fa0 msgr2=0x7f4b5406c2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:47.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.383+0000 7f4b594f7700 1 -- 172.21.15.146:0/1284686290 shutdown_connections 2023-10-06T11:05:47.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.383+0000 7f4b594f7700 1 -- 172.21.15.146:0/1284686290 wait complete. 2023-10-06T11:05:47.397 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:05:47.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.511+0000 7f79d7fff700 1 Processor -- start 2023-10-06T11:05:47.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.511+0000 7f79d7fff700 1 -- start start 2023-10-06T11:05:47.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.512+0000 7f79d7fff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f79d815a7f0 0x7f79d815cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:47.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.512+0000 7f79d7fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f79d80b2530 0x7f79d815acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:47.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.512+0000 7f79d7fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79d815c630 con 0x7f79d815a420 2023-10-06T11:05:47.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.512+0000 7f79d7fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79d80ce040 con 0x7f79d80b2530 2023-10-06T11:05:47.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.512+0000 7f79d7fff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79d815ba20 con 0x7f79d815a7f0 2023-10-06T11:05:47.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.512+0000 7f79d77fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f79d80b2530 0x7f79d815acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:47.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.512+0000 7f79d6ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f79d815a420 0x7f79d80b1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33870/0 (socket says 172.21.15.146:33870) 2023-10-06T11:05:47.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.512+0000 7f79d6ffd700 1 -- 172.21.15.146:0/3883649297 learned_addr learned my addr 172.21.15.146:0/3883649297 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:05:47.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.512+0000 7f79d67fc700 1 --2- 172.21.15.146:0/3883649297 >> v2:172.21.15.151:3300/0 conn(0x7f79d815a7f0 0x7f79d815cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:47.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.512+0000 7f79d77fe700 1 -- 172.21.15.146:0/3883649297 >> v2:172.21.15.151:3300/0 conn(0x7f79d815a7f0 msgr2=0x7f79d815cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:47.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.512+0000 7f79d77fe700 1 --2- 172.21.15.146:0/3883649297 >> v2:172.21.15.151:3300/0 conn(0x7f79d815a7f0 0x7f79d815cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:47.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.512+0000 7f79d77fe700 1 -- 172.21.15.146:0/3883649297 >> v1:172.21.15.146:6789/0 conn(0x7f79d815a420 legacy=0x7f79d80b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:47.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.512+0000 7f79d5ffb700 1 -- 172.21.15.146:0/3883649297 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3646028879 0 0) 0x7f79d815c630 con 0x7f79d815a420 2023-10-06T11:05:47.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.512+0000 7f79d77fe700 1 -- 172.21.15.146:0/3883649297 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d815bd00 con 0x7f79d80b2530 2023-10-06T11:05:47.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.513+0000 7f79d77fe700 1 --2- 172.21.15.146:0/3883649297 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79d80b2530 0x7f79d815acd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f79d80b33c0 tx=0x7f79d0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=656b9f48639f9316 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:47.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.513+0000 7f79d5ffb700 1 -- 172.21.15.146:0/3883649297 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d000e070 con 0x7f79d80b2530 2023-10-06T11:05:47.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.513+0000 7f79d5ffb700 1 -- 172.21.15.146:0/3883649297 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d000bb60 con 0x7f79d80b2530 2023-10-06T11:05:47.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.513+0000 7f79d5ffb700 1 -- 172.21.15.146:0/3883649297 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d0012430 con 0x7f79d80b2530 2023-10-06T11:05:47.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.513+0000 7f79d7fff700 1 -- 172.21.15.146:0/3883649297 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79d80b2530 msgr2=0x7f79d815acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:47.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.513+0000 7f79d7fff700 1 --2- 172.21.15.146:0/3883649297 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79d80b2530 0x7f79d815acd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f79d80b33c0 tx=0x7f79d0009780 comp rx=0 tx=0).stop 2023-10-06T11:05:47.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.513+0000 7f79d7fff700 1 -- 172.21.15.146:0/3883649297 shutdown_connections 2023-10-06T11:05:47.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.513+0000 7f79d7fff700 1 --2- 172.21.15.146:0/3883649297 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79d80b2530 0x7f79d815acd0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:47.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.513+0000 7f79d7fff700 1 --2- 172.21.15.146:0/3883649297 >> v2:172.21.15.151:3300/0 conn(0x7f79d815a7f0 0x7f79d815cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:47.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.513+0000 7f79d7fff700 1 -- 172.21.15.146:0/3883649297 >> 172.21.15.146:0/3883649297 conn(0x7f79d806eba0 msgr2=0x7f79d806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:47.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.513+0000 7f79d7fff700 1 -- 172.21.15.146:0/3883649297 shutdown_connections 2023-10-06T11:05:47.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.513+0000 7f79d7fff700 1 -- 172.21.15.146:0/3883649297 wait complete. 2023-10-06T11:05:47.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.514+0000 7f79d7fff700 1 Processor -- start 2023-10-06T11:05:47.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.515+0000 7f79d7fff700 1 -- start start 2023-10-06T11:05:47.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.515+0000 7f79d7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79d80b2530 0x7f79d8152660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:47.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.515+0000 7f79d7fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79d815a420 0x7f79d8151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:47.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.515+0000 7f79d7fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79d815a7f0 0x7f79d80cff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:47.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.515+0000 7f79d7fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d8151a90 con 0x7f79d815a420 2023-10-06T11:05:47.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.515+0000 7f79d7fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d8156f00 con 0x7f79d80b2530 2023-10-06T11:05:47.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.515+0000 7f79d7fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79d8152cb0 con 0x7f79d815a7f0 2023-10-06T11:05:47.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.515+0000 7f79d67fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79d815a420 0x7f79d8151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:47.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.515+0000 7f79d67fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79d815a420 0x7f79d8151550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42134/0 (socket says 172.21.15.146:42134) 2023-10-06T11:05:47.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.515+0000 7f79d67fc700 1 -- 172.21.15.146:0/38911242 learned_addr learned my addr 172.21.15.146:0/38911242 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:47.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.515+0000 7f79d6ffd700 1 --2- 172.21.15.146:0/38911242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79d80b2530 0x7f79d8152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:47.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.515+0000 7f79d77fe700 1 --2- 172.21.15.146:0/38911242 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79d815a7f0 0x7f79d80cff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:47.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.516+0000 7f79d67fc700 1 -- 172.21.15.146:0/38911242 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79d815a7f0 msgr2=0x7f79d80cff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:47.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.516+0000 7f79d67fc700 1 --2- 172.21.15.146:0/38911242 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79d815a7f0 0x7f79d80cff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:47.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.516+0000 7f79d67fc700 1 -- 172.21.15.146:0/38911242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79d80b2530 msgr2=0x7f79d8152660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:47.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.516+0000 7f79d67fc700 1 --2- 172.21.15.146:0/38911242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79d80b2530 0x7f79d8152660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:47.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.516+0000 7f79d67fc700 1 -- 172.21.15.146:0/38911242 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d0009a20 con 0x7f79d815a420 2023-10-06T11:05:47.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.516+0000 7f79d77fe700 1 --2- 172.21.15.146:0/38911242 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79d815a7f0 0x7f79d80cff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:05:47.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.516+0000 7f79d67fc700 1 --2- 172.21.15.146:0/38911242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79d815a420 0x7f79d8151550 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f79cc00e930 tx=0x7f79cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:47.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.516+0000 7f79beffd700 1 -- 172.21.15.146:0/38911242 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79cc013680 con 0x7f79d815a420 2023-10-06T11:05:47.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.516+0000 7f79beffd700 1 -- 172.21.15.146:0/38911242 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79cc0137e0 con 0x7f79d815a420 2023-10-06T11:05:47.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.516+0000 7f79d7fff700 1 -- 172.21.15.146:0/38911242 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79d8152f90 con 0x7f79d815a420 2023-10-06T11:05:47.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.516+0000 7f79beffd700 1 -- 172.21.15.146:0/38911242 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79cc013b80 con 0x7f79d815a420 2023-10-06T11:05:47.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.516+0000 7f79d7fff700 1 -- 172.21.15.146:0/38911242 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d8153550 con 0x7f79d815a420 2023-10-06T11:05:47.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.517+0000 7f79d7fff700 1 -- 172.21.15.146:0/38911242 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79d8153770 con 0x7f79d815a420 2023-10-06T11:05:47.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.517+0000 7f79beffd700 1 -- 172.21.15.146:0/38911242 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f79cc00c460 con 0x7f79d815a420 2023-10-06T11:05:47.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.518+0000 7f79beffd700 1 --2- 172.21.15.146:0/38911242 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f79c4066f30 0x7f79c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:47.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.518+0000 7f79beffd700 1 -- 172.21.15.146:0/38911242 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f79cc084800 con 0x7f79d815a420 2023-10-06T11:05:47.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.518+0000 7f79d6ffd700 1 --2- 172.21.15.146:0/38911242 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f79c4066f30 0x7f79c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:47.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.518+0000 7f79d6ffd700 1 --2- 172.21.15.146:0/38911242 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f79c4066f30 0x7f79c40693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f79c8007fd0 tx=0x7f79c8007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:47.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.522+0000 7f79beffd700 1 -- 172.21.15.146:0/38911242 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f79cc051910 con 0x7f79d815a420 2023-10-06T11:05:47.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.747+0000 7f79d7fff700 1 -- 172.21.15.146:0/38911242 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f79d80afae0 con 0x7f79d815a420 2023-10-06T11:05:47.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.747+0000 7f79beffd700 1 -- 172.21.15.146:0/38911242 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f79cc054f30 con 0x7f79d815a420 2023-10-06T11:05:47.749 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:05:47.749 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2812328960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2812328960},{"type":"v1","addr":"172.21.15.151:6835","nonce":2812328960}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/178026783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":178026783},{"type":"v1","addr":"172.21.15.146:6836","nonce":178026783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/716185126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":716185126},{"type":"v1","addr":"172.21.15.146:6837","nonce":716185126}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:05:43.740490+0000","modified":"2023-10-06T11:05:47.375805+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6833/1317728156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1317728156},{"type":"v1","addr":"172.21.15.151:6833","nonce":1317728156}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T11:05:47.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.749+0000 7f79d7fff700 1 -- 172.21.15.146:0/38911242 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f79c4066f30 msgr2=0x7f79c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:47.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.749+0000 7f79d7fff700 1 --2- 172.21.15.146:0/38911242 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f79c4066f30 0x7f79c40693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f79c8007fd0 tx=0x7f79c8007d30 comp rx=0 tx=0).stop 2023-10-06T11:05:47.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.749+0000 7f79d7fff700 1 -- 172.21.15.146:0/38911242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79d815a420 msgr2=0x7f79d8151550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:47.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.749+0000 7f79d7fff700 1 --2- 172.21.15.146:0/38911242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79d815a420 0x7f79d8151550 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f79cc00e930 tx=0x7f79cc0091a0 comp rx=0 tx=0).stop 2023-10-06T11:05:47.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.749+0000 7f79d7fff700 1 -- 172.21.15.146:0/38911242 shutdown_connections 2023-10-06T11:05:47.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.749+0000 7f79d7fff700 1 --2- 172.21.15.146:0/38911242 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f79c4066f30 0x7f79c40693e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:47.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.749+0000 7f79d7fff700 1 --2- 172.21.15.146:0/38911242 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79d815a7f0 0x7f79d80cff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:47.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.749+0000 7f79d7fff700 1 --2- 172.21.15.146:0/38911242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79d80b2530 0x7f79d8152660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:47.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.749+0000 7f79d7fff700 1 --2- 172.21.15.146:0/38911242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79d815a420 0x7f79d8151550 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:47.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.749+0000 7f79d7fff700 1 -- 172.21.15.146:0/38911242 >> 172.21.15.146:0/38911242 conn(0x7f79d806eba0 msgr2=0x7f79d814d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:47.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.749+0000 7f79d7fff700 1 -- 172.21.15.146:0/38911242 shutdown_connections 2023-10-06T11:05:47.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.749+0000 7f79d7fff700 1 -- 172.21.15.146:0/38911242 wait complete. 2023-10-06T11:05:47.752 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 7 2023-10-06T11:05:47.763 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:05:47.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.875+0000 7f881b59e700 1 Processor -- start 2023-10-06T11:05:47.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.875+0000 7f881b59e700 1 -- start start 2023-10-06T11:05:47.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.876+0000 7f881b59e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f881c15a420 0x7f881c15cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:47.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.876+0000 7f881b59e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f881c15a7f0 0x7f881c0b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:47.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.876+0000 7f881b59e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f881c15c630 con 0x7f881c0b2360 2023-10-06T11:05:47.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.876+0000 7f881b59e700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f881c0ce040 con 0x7f881c15a7f0 2023-10-06T11:05:47.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.876+0000 7f881b59e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f881c0b27e0 con 0x7f881c15a420 2023-10-06T11:05:47.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.876+0000 7f881a59c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f881c15a420 0x7f881c15cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:47.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.876+0000 7f8819d9b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f881c15a7f0 0x7f881c0b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:47.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.876+0000 7f8819d9b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f881c15a7f0 0x7f881c0b1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:56064/0 (socket says 172.21.15.146:56064) 2023-10-06T11:05:47.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.876+0000 7f881a59c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f881c15a420 0x7f881c15cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:53380/0 (socket says 172.21.15.146:53380) 2023-10-06T11:05:47.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.876+0000 7f8819d9b700 1 -- 172.21.15.146:0/284713979 learned_addr learned my addr 172.21.15.146:0/284713979 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:47.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.876+0000 7f8819d9b700 1 -- 172.21.15.146:0/284713979 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f881c15a420 msgr2=0x7f881c15cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:47.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.876+0000 7f8819d9b700 1 --2- 172.21.15.146:0/284713979 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f881c15a420 0x7f881c15cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:47.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.876+0000 7f8819d9b700 1 -- 172.21.15.146:0/284713979 >> v1:172.21.15.151:6789/0 conn(0x7f881c0b2360 legacy=0x7f881c15acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:47.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.876+0000 7f8819d9b700 1 -- 172.21.15.146:0/284713979 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f881c15ba20 con 0x7f881c15a7f0 2023-10-06T11:05:47.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.877+0000 7f8819d9b700 1 --2- 172.21.15.146:0/284713979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f881c15a7f0 0x7f881c0b1e20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f88100099e0 tx=0x7f8810009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcbef91cc8b0a82e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:47.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.877+0000 7f881959a700 1 -- 172.21.15.146:0/284713979 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881000b820 con 0x7f881c15a7f0 2023-10-06T11:05:47.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.877+0000 7f881959a700 1 -- 172.21.15.146:0/284713979 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881000b980 con 0x7f881c15a7f0 2023-10-06T11:05:47.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.877+0000 7f881959a700 1 -- 172.21.15.146:0/284713979 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881000bd20 con 0x7f881c15a7f0 2023-10-06T11:05:47.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.877+0000 7f881b59e700 1 -- 172.21.15.146:0/284713979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f881c15a7f0 msgr2=0x7f881c0b1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:47.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.877+0000 7f881b59e700 1 --2- 172.21.15.146:0/284713979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f881c15a7f0 0x7f881c0b1e20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f88100099e0 tx=0x7f8810009250 comp rx=0 tx=0).stop 2023-10-06T11:05:47.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.877+0000 7f881b59e700 1 -- 172.21.15.146:0/284713979 shutdown_connections 2023-10-06T11:05:47.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.877+0000 7f881b59e700 1 --2- 172.21.15.146:0/284713979 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f881c15a420 0x7f881c15cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:47.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.877+0000 7f881b59e700 1 --2- 172.21.15.146:0/284713979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f881c15a7f0 0x7f881c0b1e20 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:47.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.877+0000 7f881b59e700 1 -- 172.21.15.146:0/284713979 >> 172.21.15.146:0/284713979 conn(0x7f881c06eba0 msgr2=0x7f881c06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:47.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.878+0000 7f881b59e700 1 -- 172.21.15.146:0/284713979 shutdown_connections 2023-10-06T11:05:47.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.878+0000 7f881b59e700 1 -- 172.21.15.146:0/284713979 wait complete. 2023-10-06T11:05:47.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.879+0000 7f881b59e700 1 Processor -- start 2023-10-06T11:05:47.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.879+0000 7f881b59e700 1 -- start start 2023-10-06T11:05:47.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.879+0000 7f881b59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f881c0b2360 0x7f881c155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:47.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.879+0000 7f881b59e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f881c15a420 0x7f881c15c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:47.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.879+0000 7f881b59e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f881c15a7f0 0x7f881c15cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:47.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.879+0000 7f881b59e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881c169b00 con 0x7f881c0b2360 2023-10-06T11:05:47.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.879+0000 7f881b59e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881c15e190 con 0x7f881c15a7f0 2023-10-06T11:05:47.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.879+0000 7f881b59e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f881c15d580 con 0x7f881c15a420 2023-10-06T11:05:47.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.879+0000 7f881a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f881c0b2360 0x7f881c155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:47.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.879+0000 7f881a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f881c0b2360 0x7f881c155100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42146/0 (socket says 172.21.15.146:42146) 2023-10-06T11:05:47.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.879+0000 7f881a59c700 1 -- 172.21.15.146:0/648739772 learned_addr learned my addr 172.21.15.146:0/648739772 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:47.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.880+0000 7f8819d9b700 1 --2- 172.21.15.146:0/648739772 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f881c15a420 0x7f881c15c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:47.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.880+0000 7f881ad9d700 1 --2- 172.21.15.146:0/648739772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f881c15a7f0 0x7f881c15cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:47.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.880+0000 7f881a59c700 1 -- 172.21.15.146:0/648739772 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f881c15a420 msgr2=0x7f881c15c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:47.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.880+0000 7f881a59c700 1 --2- 172.21.15.146:0/648739772 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f881c15a420 0x7f881c15c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:47.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.880+0000 7f881a59c700 1 -- 172.21.15.146:0/648739772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f881c15a7f0 msgr2=0x7f881c15cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:47.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.880+0000 7f881a59c700 1 --2- 172.21.15.146:0/648739772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f881c15a7f0 0x7f881c15cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:47.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.880+0000 7f881a59c700 1 -- 172.21.15.146:0/648739772 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88100094f0 con 0x7f881c0b2360 2023-10-06T11:05:47.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.880+0000 7f881ad9d700 1 --2- 172.21.15.146:0/648739772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f881c15a7f0 0x7f881c15cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:05:47.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.880+0000 7f881a59c700 1 --2- 172.21.15.146:0/648739772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f881c0b2360 0x7f881c155100 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f880c00ec80 tx=0x7f880c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:47.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.880+0000 7f880a7fc700 1 -- 172.21.15.146:0/648739772 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c00c9d0 con 0x7f881c0b2360 2023-10-06T11:05:47.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.880+0000 7f880a7fc700 1 -- 172.21.15.146:0/648739772 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880c00cb30 con 0x7f881c0b2360 2023-10-06T11:05:47.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.880+0000 7f881b59e700 1 -- 172.21.15.146:0/648739772 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f881c15d860 con 0x7f881c0b2360 2023-10-06T11:05:47.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.880+0000 7f880a7fc700 1 -- 172.21.15.146:0/648739772 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c013470 con 0x7f881c0b2360 2023-10-06T11:05:47.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.880+0000 7f881b59e700 1 -- 172.21.15.146:0/648739772 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f881c15de20 con 0x7f881c0b2360 2023-10-06T11:05:47.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.881+0000 7f881b59e700 1 -- 172.21.15.146:0/648739772 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f881c0afae0 con 0x7f881c0b2360 2023-10-06T11:05:47.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.881+0000 7f880a7fc700 1 -- 172.21.15.146:0/648739772 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f880c013820 con 0x7f881c0b2360 2023-10-06T11:05:47.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.882+0000 7f880a7fc700 1 --2- 172.21.15.146:0/648739772 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f87fc066f30 0x7f87fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:47.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.882+0000 7f8819d9b700 1 --2- 172.21.15.146:0/648739772 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f87fc066f30 0x7f87fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:47.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.882+0000 7f880a7fc700 1 -- 172.21.15.146:0/648739772 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f880c084a20 con 0x7f881c0b2360 2023-10-06T11:05:47.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.882+0000 7f8819d9b700 1 --2- 172.21.15.146:0/648739772 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f87fc066f30 0x7f87fc0693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f88100099e0 tx=0x7f8810017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:47.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:47.886+0000 7f880a7fc700 1 -- 172.21.15.146:0/648739772 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f880c051b30 con 0x7f881c0b2360 2023-10-06T11:05:48.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.070+0000 7f881b59e700 1 -- 172.21.15.146:0/648739772 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f881c15bd00 con 0x7f881c0b2360 2023-10-06T11:05:48.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.071+0000 7f880a7fc700 1 -- 172.21.15.146:0/648739772 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16914 (secure 0 0 0) 0x7f880c055150 con 0x7f881c0b2360 2023-10-06T11:05:48.074 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:05:48.074 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":20,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:05:45.362089+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:05:41.403954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T11:05:42.698754+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:05:48.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.073+0000 7f881b59e700 1 -- 172.21.15.146:0/648739772 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f87fc066f30 msgr2=0x7f87fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:48.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.073+0000 7f881b59e700 1 --2- 172.21.15.146:0/648739772 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f87fc066f30 0x7f87fc0693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f88100099e0 tx=0x7f8810017000 comp rx=0 tx=0).stop 2023-10-06T11:05:48.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.073+0000 7f881b59e700 1 -- 172.21.15.146:0/648739772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f881c0b2360 msgr2=0x7f881c155100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:48.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.073+0000 7f881b59e700 1 --2- 172.21.15.146:0/648739772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f881c0b2360 0x7f881c155100 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f880c00ec80 tx=0x7f880c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:05:48.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.073+0000 7f881b59e700 1 -- 172.21.15.146:0/648739772 shutdown_connections 2023-10-06T11:05:48.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.073+0000 7f881b59e700 1 --2- 172.21.15.146:0/648739772 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f87fc066f30 0x7f87fc0693e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:48.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.073+0000 7f881b59e700 1 --2- 172.21.15.146:0/648739772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f881c15a7f0 0x7f881c15cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:48.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.073+0000 7f881b59e700 1 --2- 172.21.15.146:0/648739772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f881c0b2360 0x7f881c155100 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:48.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.073+0000 7f881b59e700 1 --2- 172.21.15.146:0/648739772 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f881c15a420 0x7f881c15c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:48.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.073+0000 7f881b59e700 1 -- 172.21.15.146:0/648739772 >> 172.21.15.146:0/648739772 conn(0x7f881c06eba0 msgr2=0x7f881c0b5590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:48.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.073+0000 7f881b59e700 1 -- 172.21.15.146:0/648739772 shutdown_connections 2023-10-06T11:05:48.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.073+0000 7f881b59e700 1 -- 172.21.15.146:0/648739772 wait complete. 2023-10-06T11:05:48.087 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T11:05:48.087 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:05:48.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.200+0000 7fbbb597f700 1 Processor -- start 2023-10-06T11:05:48.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.200+0000 7fbbb597f700 1 -- start start 2023-10-06T11:05:48.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.201+0000 7fbbb597f700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbbb0153ab0 0x7fbbb015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:48.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.201+0000 7fbbb597f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbbb0153e80 0x7fbbb0068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:48.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.201+0000 7fbbb597f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbbb00689d0 0x7fbbb015d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:48.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.201+0000 7fbbb597f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb0068e50 con 0x7fbbb00689d0 2023-10-06T11:05:48.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.201+0000 7fbbb597f700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb015ac30 con 0x7fbbb0153ab0 2023-10-06T11:05:48.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.201+0000 7fbbb597f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb00b4510 con 0x7fbbb0153e80 2023-10-06T11:05:48.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.201+0000 7fbbaf7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbbb00689d0 0x7fbbb015d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:48.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.201+0000 7fbbaeffd700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbbb0153ab0 0x7fbbb015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:48.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.201+0000 7fbbaf7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbbb00689d0 0x7fbbb015d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42148/0 (socket says 172.21.15.146:42148) 2023-10-06T11:05:48.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.201+0000 7fbbaf7fe700 1 -- 172.21.15.146:0/1907316670 learned_addr learned my addr 172.21.15.146:0/1907316670 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:48.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.201+0000 7fbbae7fc700 1 --2- 172.21.15.146:0/1907316670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbbb0153e80 0x7fbbb0068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:48.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.201+0000 7fbbaf7fe700 1 -- 172.21.15.146:0/1907316670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbbb0153e80 msgr2=0x7fbbb0068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:48.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.201+0000 7fbbaf7fe700 1 --2- 172.21.15.146:0/1907316670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbbb0153e80 0x7fbbb0068490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:48.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.201+0000 7fbbaf7fe700 1 -- 172.21.15.146:0/1907316670 >> v2:172.21.15.151:3300/0 conn(0x7fbbb0153ab0 msgr2=0x7fbbb015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:48.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.201+0000 7fbbaf7fe700 1 --2- 172.21.15.146:0/1907316670 >> v2:172.21.15.151:3300/0 conn(0x7fbbb0153ab0 0x7fbbb015a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:48.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.201+0000 7fbbaf7fe700 1 -- 172.21.15.146:0/1907316670 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb00b6530 con 0x7fbbb00689d0 2023-10-06T11:05:48.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.201+0000 7fbbaf7fe700 1 --2- 172.21.15.146:0/1907316670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbb00689d0 0x7fbbb015d270 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbbb00b5eb0 tx=0x7fbba0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=105ae1803baa016d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:48.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.201+0000 7fbbadffb700 1 -- 172.21.15.146:0/1907316670 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba000e070 con 0x7fbbb00689d0 2023-10-06T11:05:48.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.201+0000 7fbbadffb700 1 -- 172.21.15.146:0/1907316670 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba000b970 con 0x7fbbb00689d0 2023-10-06T11:05:48.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.201+0000 7fbbadffb700 1 -- 172.21.15.146:0/1907316670 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba00092e0 con 0x7fbbb00689d0 2023-10-06T11:05:48.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.202+0000 7fbbb597f700 1 -- 172.21.15.146:0/1907316670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbb00689d0 msgr2=0x7fbbb015d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:48.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.202+0000 7fbbb597f700 1 --2- 172.21.15.146:0/1907316670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbb00689d0 0x7fbbb015d270 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbbb00b5eb0 tx=0x7fbba0009840 comp rx=0 tx=0).stop 2023-10-06T11:05:48.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.202+0000 7fbbb597f700 1 -- 172.21.15.146:0/1907316670 shutdown_connections 2023-10-06T11:05:48.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.202+0000 7fbbb597f700 1 --2- 172.21.15.146:0/1907316670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbb00689d0 0x7fbbb015d270 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:48.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.202+0000 7fbbb597f700 1 --2- 172.21.15.146:0/1907316670 >> v2:172.21.15.151:3300/0 conn(0x7fbbb0153ab0 0x7fbbb015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:48.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.202+0000 7fbbb597f700 1 --2- 172.21.15.146:0/1907316670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbbb0153e80 0x7fbbb0068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:48.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.202+0000 7fbbb597f700 1 -- 172.21.15.146:0/1907316670 >> 172.21.15.146:0/1907316670 conn(0x7fbbb006eba0 msgr2=0x7fbbb006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:48.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.202+0000 7fbbb597f700 1 -- 172.21.15.146:0/1907316670 shutdown_connections 2023-10-06T11:05:48.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.202+0000 7fbbb597f700 1 -- 172.21.15.146:0/1907316670 wait complete. 2023-10-06T11:05:48.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.203+0000 7fbbb597f700 1 Processor -- start 2023-10-06T11:05:48.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.203+0000 7fbbb597f700 1 -- start start 2023-10-06T11:05:48.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.204+0000 7fbbb597f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbbb00689d0 0x7fbbb00b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:48.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.204+0000 7fbbb597f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbb0153ab0 0x7fbbb014a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:48.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.204+0000 7fbbb597f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbb0153e80 0x7fbbb014b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:48.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.204+0000 7fbbb597f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb015aa30 con 0x7fbbb0153e80 2023-10-06T11:05:48.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.204+0000 7fbbb597f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb014e7d0 con 0x7fbbb0153ab0 2023-10-06T11:05:48.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.204+0000 7fbbb597f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb00b1510 con 0x7fbbb00689d0 2023-10-06T11:05:48.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.204+0000 7fbbaf7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbb0153e80 0x7fbbb014b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:48.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.204+0000 7fbbaf7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbb0153e80 0x7fbbb014b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42150/0 (socket says 172.21.15.146:42150) 2023-10-06T11:05:48.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.204+0000 7fbbaf7fe700 1 -- 172.21.15.146:0/3498740564 learned_addr learned my addr 172.21.15.146:0/3498740564 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:48.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.204+0000 7fbbae7fc700 1 --2- 172.21.15.146:0/3498740564 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbb0153ab0 0x7fbbb014a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:48.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.204+0000 7fbbaeffd700 1 --2- 172.21.15.146:0/3498740564 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbbb00689d0 0x7fbbb00b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:48.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.204+0000 7fbbaf7fe700 1 -- 172.21.15.146:0/3498740564 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbbb00689d0 msgr2=0x7fbbb00b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:48.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.204+0000 7fbbaf7fe700 1 --2- 172.21.15.146:0/3498740564 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbbb00689d0 0x7fbbb00b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:48.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.204+0000 7fbbaf7fe700 1 -- 172.21.15.146:0/3498740564 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbb0153ab0 msgr2=0x7fbbb014a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:48.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.204+0000 7fbbaf7fe700 1 --2- 172.21.15.146:0/3498740564 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbb0153ab0 0x7fbbb014a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:48.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.204+0000 7fbbaf7fe700 1 -- 172.21.15.146:0/3498740564 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba0009ae0 con 0x7fbbb0153e80 2023-10-06T11:05:48.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.204+0000 7fbbaeffd700 1 --2- 172.21.15.146:0/3498740564 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbbb00689d0 0x7fbbb00b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:05:48.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.205+0000 7fbbaf7fe700 1 --2- 172.21.15.146:0/3498740564 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbb0153e80 0x7fbbb014b2c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0089010 tx=0x7fbba0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:48.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.205+0000 7fbba6ffd700 1 -- 172.21.15.146:0/3498740564 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba00032f0 con 0x7fbbb0153e80 2023-10-06T11:05:48.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.205+0000 7fbba6ffd700 1 -- 172.21.15.146:0/3498740564 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba0008ad0 con 0x7fbbb0153e80 2023-10-06T11:05:48.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.205+0000 7fbbb597f700 1 -- 172.21.15.146:0/3498740564 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbb0159eb0 con 0x7fbbb0153e80 2023-10-06T11:05:48.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.205+0000 7fbba6ffd700 1 -- 172.21.15.146:0/3498740564 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba0008e70 con 0x7fbbb0153e80 2023-10-06T11:05:48.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.205+0000 7fbbb597f700 1 -- 172.21.15.146:0/3498740564 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbb015a470 con 0x7fbbb0153e80 2023-10-06T11:05:48.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.206+0000 7fbbb597f700 1 -- 172.21.15.146:0/3498740564 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbb014e960 con 0x7fbbb0153e80 2023-10-06T11:05:48.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.206+0000 7fbba6ffd700 1 -- 172.21.15.146:0/3498740564 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbba0003040 con 0x7fbbb0153e80 2023-10-06T11:05:48.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.206+0000 7fbba6ffd700 1 --2- 172.21.15.146:0/3498740564 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbb90066f30 0x7fbb900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:48.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.206+0000 7fbba6ffd700 1 -- 172.21.15.146:0/3498740564 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbba0086140 con 0x7fbbb0153e80 2023-10-06T11:05:48.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.206+0000 7fbbaeffd700 1 --2- 172.21.15.146:0/3498740564 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbb90066f30 0x7fbb900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:48.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.207+0000 7fbbaeffd700 1 --2- 172.21.15.146:0/3498740564 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbb90066f30 0x7fbb900693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbba8009d80 tx=0x7fbba8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:48.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.211+0000 7fbba6ffd700 1 -- 172.21.15.146:0/3498740564 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbba0053250 con 0x7fbbb0153e80 2023-10-06T11:05:48.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.390+0000 7fbbb597f700 1 -- 172.21.15.146:0/3498740564 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbbb004c380 con 0x7fbb90066f30 2023-10-06T11:05:48.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.398+0000 7fbba6ffd700 1 -- 172.21.15.146:0/3498740564 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281094 (secure 0 0 0) 0x7fbbb004c380 con 0x7fbb90066f30 2023-10-06T11:05:48.403 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:05:48.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.401+0000 7fbbb597f700 1 -- 172.21.15.146:0/3498740564 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbb90066f30 msgr2=0x7fbb900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:48.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.401+0000 7fbbb597f700 1 --2- 172.21.15.146:0/3498740564 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbb90066f30 0x7fbb900693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbba8009d80 tx=0x7fbba8008040 comp rx=0 tx=0).stop 2023-10-06T11:05:48.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.401+0000 7fbbb597f700 1 -- 172.21.15.146:0/3498740564 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbb0153e80 msgr2=0x7fbbb014b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:48.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.401+0000 7fbbb597f700 1 --2- 172.21.15.146:0/3498740564 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbb0153e80 0x7fbbb014b2c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0089010 tx=0x7fbba0018000 comp rx=0 tx=0).stop 2023-10-06T11:05:48.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.402+0000 7fbbb597f700 1 -- 172.21.15.146:0/3498740564 shutdown_connections 2023-10-06T11:05:48.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.402+0000 7fbbb597f700 1 --2- 172.21.15.146:0/3498740564 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbb90066f30 0x7fbb900693e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:48.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.402+0000 7fbbb597f700 1 --2- 172.21.15.146:0/3498740564 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbb0153e80 0x7fbbb014b2c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:48.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.402+0000 7fbbb597f700 1 --2- 172.21.15.146:0/3498740564 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbbb00689d0 0x7fbbb00b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:48.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.402+0000 7fbbb597f700 1 --2- 172.21.15.146:0/3498740564 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbb0153ab0 0x7fbbb014a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:48.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.402+0000 7fbbb597f700 1 -- 172.21.15.146:0/3498740564 >> 172.21.15.146:0/3498740564 conn(0x7fbbb006eba0 msgr2=0x7fbbb015c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:48.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.402+0000 7fbbb597f700 1 -- 172.21.15.146:0/3498740564 shutdown_connections 2023-10-06T11:05:48.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.402+0000 7fbbb597f700 1 -- 172.21.15.146:0/3498740564 wait complete. 2023-10-06T11:05:48.407 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:05:48.415 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-10-06T11:05:47.128743+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591138,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":185,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":134,"acting":134,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":41,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381076,"kb_used_data":2644,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593644,"statfs":{"total":773094113280,"available":770655891456,"internally_reserved":0,"allocated":2707456,"data_stored":1692247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":770,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.784559"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.376223+0000","last_change":"2023-10-06T11:05:44.374095+0000","last_active":"2023-10-06T11:05:44.376223+0000","last_peered":"2023-10-06T11:05:44.376223+0000","last_clean":"2023-10-06T11:05:44.376223+0000","last_became_active":"2023-10-06T11:05:44.373839+0000","last_became_peered":"2023-10-06T11:05:44.373839+0000","last_unstale":"2023-10-06T11:05:44.376223+0000","last_undegraded":"2023-10-06T11:05:44.376223+0000","last_fullsized":"2023-10-06T11:05:44.376223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:25.910038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380398+0000","last_change":"2023-10-06T11:05:44.372580+0000","last_active":"2023-10-06T11:05:44.380398+0000","last_peered":"2023-10-06T11:05:44.380398+0000","last_clean":"2023-10-06T11:05:44.380398+0000","last_became_active":"2023-10-06T11:05:44.372338+0000","last_became_peered":"2023-10-06T11:05:44.372338+0000","last_unstale":"2023-10-06T11:05:44.380398+0000","last_undegraded":"2023-10-06T11:05:44.380398+0000","last_fullsized":"2023-10-06T11:05:44.380398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:49:53.929590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.370764+0000","last_change":"2023-10-06T11:05:44.368424+0000","last_active":"2023-10-06T11:05:44.370764+0000","last_peered":"2023-10-06T11:05:44.370764+0000","last_clean":"2023-10-06T11:05:44.370764+0000","last_became_active":"2023-10-06T11:05:44.368174+0000","last_became_peered":"2023-10-06T11:05:44.368174+0000","last_unstale":"2023-10-06T11:05:44.370764+0000","last_undegraded":"2023-10-06T11:05:44.370764+0000","last_fullsized":"2023-10-06T11:05:44.370764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:48.500150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.381050+0000","last_change":"2023-10-06T11:05:44.376045+0000","last_active":"2023-10-06T11:05:44.381050+0000","last_peered":"2023-10-06T11:05:44.381050+0000","last_clean":"2023-10-06T11:05:44.381050+0000","last_became_active":"2023-10-06T11:05:44.374697+0000","last_became_peered":"2023-10-06T11:05:44.374697+0000","last_unstale":"2023-10-06T11:05:44.381050+0000","last_undegraded":"2023-10-06T11:05:44.381050+0000","last_fullsized":"2023-10-06T11:05:44.381050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:30:10.233024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377816+0000","last_change":"2023-10-06T11:05:44.370424+0000","last_active":"2023-10-06T11:05:44.377816+0000","last_peered":"2023-10-06T11:05:44.377816+0000","last_clean":"2023-10-06T11:05:44.377816+0000","last_became_active":"2023-10-06T11:05:44.370141+0000","last_became_peered":"2023-10-06T11:05:44.370141+0000","last_unstale":"2023-10-06T11:05:44.377816+0000","last_undegraded":"2023-10-06T11:05:44.377816+0000","last_fullsized":"2023-10-06T11:05:44.377816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:32:17.346227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.374345+0000","last_change":"2023-10-06T11:05:44.370535+0000","last_active":"2023-10-06T11:05:44.374345+0000","last_peered":"2023-10-06T11:05:44.374345+0000","last_clean":"2023-10-06T11:05:44.374345+0000","last_became_active":"2023-10-06T11:05:44.370264+0000","last_became_peered":"2023-10-06T11:05:44.370264+0000","last_unstale":"2023-10-06T11:05:44.374345+0000","last_undegraded":"2023-10-06T11:05:44.374345+0000","last_fullsized":"2023-10-06T11:05:44.374345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:18:11.738273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377689+0000","last_change":"2023-10-06T11:05:44.363111+0000","last_active":"2023-10-06T11:05:44.377689+0000","last_peered":"2023-10-06T11:05:44.377689+0000","last_clean":"2023-10-06T11:05:44.377689+0000","last_became_active":"2023-10-06T11:05:44.362803+0000","last_became_peered":"2023-10-06T11:05:44.362803+0000","last_unstale":"2023-10-06T11:05:44.377689+0000","last_undegraded":"2023-10-06T11:05:44.377689+0000","last_fullsized":"2023-10-06T11:05:44.377689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:49:41.512642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.365243+0000","last_change":"2023-10-06T11:05:44.362523+0000","last_active":"2023-10-06T11:05:44.365243+0000","last_peered":"2023-10-06T11:05:44.365243+0000","last_clean":"2023-10-06T11:05:44.365243+0000","last_became_active":"2023-10-06T11:05:44.362248+0000","last_became_peered":"2023-10-06T11:05:44.362248+0000","last_unstale":"2023-10-06T11:05:44.365243+0000","last_undegraded":"2023-10-06T11:05:44.365243+0000","last_fullsized":"2023-10-06T11:05:44.365243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:33.869834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.376261+0000","last_change":"2023-10-06T11:05:44.373706+0000","last_active":"2023-10-06T11:05:44.376261+0000","last_peered":"2023-10-06T11:05:44.376261+0000","last_clean":"2023-10-06T11:05:44.376261+0000","last_became_active":"2023-10-06T11:05:44.373408+0000","last_became_peered":"2023-10-06T11:05:44.373408+0000","last_unstale":"2023-10-06T11:05:44.376261+0000","last_undegraded":"2023-10-06T11:05:44.376261+0000","last_fullsized":"2023-10-06T11:05:44.376261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:28.010695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377714+0000","last_change":"2023-10-06T11:05:44.364121+0000","last_active":"2023-10-06T11:05:44.377714+0000","last_peered":"2023-10-06T11:05:44.377714+0000","last_clean":"2023-10-06T11:05:44.377714+0000","last_became_active":"2023-10-06T11:05:44.363863+0000","last_became_peered":"2023-10-06T11:05:44.363863+0000","last_unstale":"2023-10-06T11:05:44.377714+0000","last_undegraded":"2023-10-06T11:05:44.377714+0000","last_fullsized":"2023-10-06T11:05:44.377714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:51.490766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.381068+0000","last_change":"2023-10-06T11:05:44.376146+0000","last_active":"2023-10-06T11:05:44.381068+0000","last_peered":"2023-10-06T11:05:44.381068+0000","last_clean":"2023-10-06T11:05:44.381068+0000","last_became_active":"2023-10-06T11:05:44.375877+0000","last_became_peered":"2023-10-06T11:05:44.375877+0000","last_unstale":"2023-10-06T11:05:44.381068+0000","last_undegraded":"2023-10-06T11:05:44.381068+0000","last_fullsized":"2023-10-06T11:05:44.381068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:25:37.173612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377465+0000","last_change":"2023-10-06T11:05:44.374262+0000","last_active":"2023-10-06T11:05:44.377465+0000","last_peered":"2023-10-06T11:05:44.377465+0000","last_clean":"2023-10-06T11:05:44.377465+0000","last_became_active":"2023-10-06T11:05:44.373997+0000","last_became_peered":"2023-10-06T11:05:44.373997+0000","last_unstale":"2023-10-06T11:05:44.377465+0000","last_undegraded":"2023-10-06T11:05:44.377465+0000","last_fullsized":"2023-10-06T11:05:44.377465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:30:10.233024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377738+0000","last_change":"2023-10-06T11:05:44.376536+0000","last_active":"2023-10-06T11:05:44.377738+0000","last_peered":"2023-10-06T11:05:44.377738+0000","last_clean":"2023-10-06T11:05:44.377738+0000","last_became_active":"2023-10-06T11:05:44.376291+0000","last_became_peered":"2023-10-06T11:05:44.376291+0000","last_unstale":"2023-10-06T11:05:44.377738+0000","last_undegraded":"2023-10-06T11:05:44.377738+0000","last_fullsized":"2023-10-06T11:05:44.377738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:19.308513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380978+0000","last_change":"2023-10-06T11:05:44.373773+0000","last_active":"2023-10-06T11:05:44.380978+0000","last_peered":"2023-10-06T11:05:44.380978+0000","last_clean":"2023-10-06T11:05:44.380978+0000","last_became_active":"2023-10-06T11:05:44.373445+0000","last_became_peered":"2023-10-06T11:05:44.373445+0000","last_unstale":"2023-10-06T11:05:44.380978+0000","last_undegraded":"2023-10-06T11:05:44.380978+0000","last_fullsized":"2023-10-06T11:05:44.380978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:48.500150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.370569+0000","last_change":"2023-10-06T11:05:44.365767+0000","last_active":"2023-10-06T11:05:44.370569+0000","last_peered":"2023-10-06T11:05:44.370569+0000","last_clean":"2023-10-06T11:05:44.370569+0000","last_became_active":"2023-10-06T11:05:44.365489+0000","last_became_peered":"2023-10-06T11:05:44.365489+0000","last_unstale":"2023-10-06T11:05:44.370569+0000","last_undegraded":"2023-10-06T11:05:44.370569+0000","last_fullsized":"2023-10-06T11:05:44.370569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:36:18.739157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379611+0000","last_change":"2023-10-06T11:05:44.373554+0000","last_active":"2023-10-06T11:05:44.379611+0000","last_peered":"2023-10-06T11:05:44.379611+0000","last_clean":"2023-10-06T11:05:44.379611+0000","last_became_active":"2023-10-06T11:05:44.373293+0000","last_became_peered":"2023-10-06T11:05:44.373293+0000","last_unstale":"2023-10-06T11:05:44.379611+0000","last_undegraded":"2023-10-06T11:05:44.379611+0000","last_fullsized":"2023-10-06T11:05:44.379611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:32:31.703547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380998+0000","last_change":"2023-10-06T11:05:44.373832+0000","last_active":"2023-10-06T11:05:44.380998+0000","last_peered":"2023-10-06T11:05:44.380998+0000","last_clean":"2023-10-06T11:05:44.380998+0000","last_became_active":"2023-10-06T11:05:44.373527+0000","last_became_peered":"2023-10-06T11:05:44.373527+0000","last_unstale":"2023-10-06T11:05:44.380998+0000","last_undegraded":"2023-10-06T11:05:44.380998+0000","last_fullsized":"2023-10-06T11:05:44.380998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:49:53.929590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380422+0000","last_change":"2023-10-06T11:05:44.372985+0000","last_active":"2023-10-06T11:05:44.380422+0000","last_peered":"2023-10-06T11:05:44.380422+0000","last_clean":"2023-10-06T11:05:44.380422+0000","last_became_active":"2023-10-06T11:05:44.372531+0000","last_became_peered":"2023-10-06T11:05:44.372531+0000","last_unstale":"2023-10-06T11:05:44.380422+0000","last_undegraded":"2023-10-06T11:05:44.380422+0000","last_fullsized":"2023-10-06T11:05:44.380422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:36:26.414372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:42.336346+0000","last_change":"2023-10-06T11:05:42.336346+0000","last_active":"2023-10-06T11:05:42.336346+0000","last_peered":"2023-10-06T11:05:42.336346+0000","last_clean":"2023-10-06T11:05:42.336346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:42.336346+0000","last_undegraded":"2023-10-06T11:05:42.336346+0000","last_fullsized":"2023-10-06T11:05:42.336346+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.370597+0000","last_change":"2023-10-06T11:05:44.367477+0000","last_active":"2023-10-06T11:05:44.370597+0000","last_peered":"2023-10-06T11:05:44.370597+0000","last_clean":"2023-10-06T11:05:44.370597+0000","last_became_active":"2023-10-06T11:05:44.367216+0000","last_became_peered":"2023-10-06T11:05:44.367216+0000","last_unstale":"2023-10-06T11:05:44.370597+0000","last_undegraded":"2023-10-06T11:05:44.370597+0000","last_fullsized":"2023-10-06T11:05:44.370597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:48.500150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:42.336346+0000","last_change":"2023-10-06T11:05:42.336346+0000","last_active":"2023-10-06T11:05:42.336346+0000","last_peered":"2023-10-06T11:05:42.336346+0000","last_clean":"2023-10-06T11:05:42.336346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:42.336346+0000","last_undegraded":"2023-10-06T11:05:42.336346+0000","last_fullsized":"2023-10-06T11:05:42.336346+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.370930+0000","last_change":"2023-10-06T11:05:44.367950+0000","last_active":"2023-10-06T11:05:44.370930+0000","last_peered":"2023-10-06T11:05:44.370930+0000","last_clean":"2023-10-06T11:05:44.370930+0000","last_became_active":"2023-10-06T11:05:44.367682+0000","last_became_peered":"2023-10-06T11:05:44.367682+0000","last_unstale":"2023-10-06T11:05:44.370930+0000","last_undegraded":"2023-10-06T11:05:44.370930+0000","last_fullsized":"2023-10-06T11:05:44.370930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:53:21.828799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.356971+0000","last_change":"2023-10-06T11:05:43.366406+0000","last_active":"2023-10-06T11:05:44.356971+0000","last_peered":"2023-10-06T11:05:44.356971+0000","last_clean":"2023-10-06T11:05:44.356971+0000","last_became_active":"2023-10-06T11:05:43.366004+0000","last_became_peered":"2023-10-06T11:05:43.366004+0000","last_unstale":"2023-10-06T11:05:44.356971+0000","last_undegraded":"2023-10-06T11:05:44.356971+0000","last_fullsized":"2023-10-06T11:05:44.356971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:00.477669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.353362+0000","last_change":"2023-10-06T11:05:43.362935+0000","last_active":"2023-10-06T11:05:44.353362+0000","last_peered":"2023-10-06T11:05:44.353362+0000","last_clean":"2023-10-06T11:05:44.353362+0000","last_became_active":"2023-10-06T11:05:43.362642+0000","last_became_peered":"2023-10-06T11:05:43.362642+0000","last_unstale":"2023-10-06T11:05:44.353362+0000","last_undegraded":"2023-10-06T11:05:44.353362+0000","last_fullsized":"2023-10-06T11:05:44.353362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:36.907530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.371257+0000","last_change":"2023-10-06T11:05:44.366360+0000","last_active":"2023-10-06T11:05:44.371257+0000","last_peered":"2023-10-06T11:05:44.371257+0000","last_clean":"2023-10-06T11:05:44.371257+0000","last_became_active":"2023-10-06T11:05:44.366097+0000","last_became_peered":"2023-10-06T11:05:44.366097+0000","last_unstale":"2023-10-06T11:05:44.371257+0000","last_undegraded":"2023-10-06T11:05:44.371257+0000","last_fullsized":"2023-10-06T11:05:44.371257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:18:11.738273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.357158+0000","last_change":"2023-10-06T11:05:43.365582+0000","last_active":"2023-10-06T11:05:44.357158+0000","last_peered":"2023-10-06T11:05:44.357158+0000","last_clean":"2023-10-06T11:05:44.357158+0000","last_became_active":"2023-10-06T11:05:43.365197+0000","last_became_peered":"2023-10-06T11:05:43.365197+0000","last_unstale":"2023-10-06T11:05:44.357158+0000","last_undegraded":"2023-10-06T11:05:44.357158+0000","last_fullsized":"2023-10-06T11:05:44.357158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:59:28.141215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.373455+0000","last_change":"2023-10-06T11:05:44.369545+0000","last_active":"2023-10-06T11:05:44.373455+0000","last_peered":"2023-10-06T11:05:44.373455+0000","last_clean":"2023-10-06T11:05:44.373455+0000","last_became_active":"2023-10-06T11:05:44.369228+0000","last_became_peered":"2023-10-06T11:05:44.369228+0000","last_unstale":"2023-10-06T11:05:44.373455+0000","last_undegraded":"2023-10-06T11:05:44.373455+0000","last_fullsized":"2023-10-06T11:05:44.373455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:36:18.739157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.378674+0000","last_change":"2023-10-06T11:05:43.370700+0000","last_active":"2023-10-06T11:05:44.378674+0000","last_peered":"2023-10-06T11:05:44.378674+0000","last_clean":"2023-10-06T11:05:44.378674+0000","last_became_active":"2023-10-06T11:05:43.370418+0000","last_became_peered":"2023-10-06T11:05:43.370418+0000","last_unstale":"2023-10-06T11:05:44.378674+0000","last_undegraded":"2023-10-06T11:05:44.378674+0000","last_fullsized":"2023-10-06T11:05:44.378674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:03.585687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:42.336346+0000","last_change":"2023-10-06T11:05:42.336346+0000","last_active":"2023-10-06T11:05:42.336346+0000","last_peered":"2023-10-06T11:05:42.336346+0000","last_clean":"2023-10-06T11:05:42.336346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:42.336346+0000","last_undegraded":"2023-10-06T11:05:42.336346+0000","last_fullsized":"2023-10-06T11:05:42.336346+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.378534+0000","last_change":"2023-10-06T11:05:43.369646+0000","last_active":"2023-10-06T11:05:44.378534+0000","last_peered":"2023-10-06T11:05:44.378534+0000","last_clean":"2023-10-06T11:05:44.378534+0000","last_became_active":"2023-10-06T11:05:43.369353+0000","last_became_peered":"2023-10-06T11:05:43.369353+0000","last_unstale":"2023-10-06T11:05:44.378534+0000","last_undegraded":"2023-10-06T11:05:44.378534+0000","last_fullsized":"2023-10-06T11:05:44.378534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:50.484027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379530+0000","last_change":"2023-10-06T11:05:44.372738+0000","last_active":"2023-10-06T11:05:44.379530+0000","last_peered":"2023-10-06T11:05:44.379530+0000","last_clean":"2023-10-06T11:05:44.379530+0000","last_became_active":"2023-10-06T11:05:44.372299+0000","last_became_peered":"2023-10-06T11:05:44.372299+0000","last_unstale":"2023-10-06T11:05:44.379530+0000","last_undegraded":"2023-10-06T11:05:44.379530+0000","last_fullsized":"2023-10-06T11:05:44.379530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:53:21.828799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.352712+0000","last_change":"2023-10-06T11:05:43.364085+0000","last_active":"2023-10-06T11:05:44.352712+0000","last_peered":"2023-10-06T11:05:44.352712+0000","last_clean":"2023-10-06T11:05:44.352712+0000","last_became_active":"2023-10-06T11:05:43.363844+0000","last_became_peered":"2023-10-06T11:05:43.363844+0000","last_unstale":"2023-10-06T11:05:44.352712+0000","last_undegraded":"2023-10-06T11:05:44.352712+0000","last_fullsized":"2023-10-06T11:05:44.352712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:51.324615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380405+0000","last_change":"2023-10-06T11:05:44.372815+0000","last_active":"2023-10-06T11:05:44.380405+0000","last_peered":"2023-10-06T11:05:44.380405+0000","last_clean":"2023-10-06T11:05:44.380405+0000","last_became_active":"2023-10-06T11:05:44.372237+0000","last_became_peered":"2023-10-06T11:05:44.372237+0000","last_unstale":"2023-10-06T11:05:44.380405+0000","last_undegraded":"2023-10-06T11:05:44.380405+0000","last_fullsized":"2023-10-06T11:05:44.380405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:42.381985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.363864+0000","last_change":"2023-10-06T11:05:43.369142+0000","last_active":"2023-10-06T11:05:44.363864+0000","last_peered":"2023-10-06T11:05:44.363864+0000","last_clean":"2023-10-06T11:05:44.363864+0000","last_became_active":"2023-10-06T11:05:43.368847+0000","last_became_peered":"2023-10-06T11:05:43.368847+0000","last_unstale":"2023-10-06T11:05:44.363864+0000","last_undegraded":"2023-10-06T11:05:44.363864+0000","last_fullsized":"2023-10-06T11:05:44.363864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:48:23.698446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.373918+0000","last_change":"2023-10-06T11:05:44.370314+0000","last_active":"2023-10-06T11:05:44.373918+0000","last_peered":"2023-10-06T11:05:44.373918+0000","last_clean":"2023-10-06T11:05:44.373918+0000","last_became_active":"2023-10-06T11:05:44.370065+0000","last_became_peered":"2023-10-06T11:05:44.370065+0000","last_unstale":"2023-10-06T11:05:44.373918+0000","last_undegraded":"2023-10-06T11:05:44.373918+0000","last_fullsized":"2023-10-06T11:05:44.373918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:32:31.703547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:42.336346+0000","last_change":"2023-10-06T11:05:42.336346+0000","last_active":"2023-10-06T11:05:42.336346+0000","last_peered":"2023-10-06T11:05:42.336346+0000","last_clean":"2023-10-06T11:05:42.336346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:42.336346+0000","last_undegraded":"2023-10-06T11:05:42.336346+0000","last_fullsized":"2023-10-06T11:05:42.336346+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379857+0000","last_change":"2023-10-06T11:05:44.372870+0000","last_active":"2023-10-06T11:05:44.379857+0000","last_peered":"2023-10-06T11:05:44.379857+0000","last_clean":"2023-10-06T11:05:44.379857+0000","last_became_active":"2023-10-06T11:05:44.372480+0000","last_became_peered":"2023-10-06T11:05:44.372480+0000","last_unstale":"2023-10-06T11:05:44.379857+0000","last_undegraded":"2023-10-06T11:05:44.379857+0000","last_fullsized":"2023-10-06T11:05:44.379857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:25:37.173612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.378371+0000","last_change":"2023-10-06T11:05:43.369672+0000","last_active":"2023-10-06T11:05:44.378371+0000","last_peered":"2023-10-06T11:05:44.378371+0000","last_clean":"2023-10-06T11:05:44.378371+0000","last_became_active":"2023-10-06T11:05:43.369415+0000","last_became_peered":"2023-10-06T11:05:43.369415+0000","last_unstale":"2023-10-06T11:05:44.378371+0000","last_undegraded":"2023-10-06T11:05:44.378371+0000","last_fullsized":"2023-10-06T11:05:44.378371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:21:07.005347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.385017+0000","last_change":"2023-10-06T11:05:44.380100+0000","last_active":"2023-10-06T11:05:44.385017+0000","last_peered":"2023-10-06T11:05:44.385017+0000","last_clean":"2023-10-06T11:05:44.385017+0000","last_became_active":"2023-10-06T11:05:44.379686+0000","last_became_peered":"2023-10-06T11:05:44.379686+0000","last_unstale":"2023-10-06T11:05:44.385017+0000","last_undegraded":"2023-10-06T11:05:44.385017+0000","last_fullsized":"2023-10-06T11:05:44.385017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:32:31.703547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.378652+0000","last_change":"2023-10-06T11:05:43.369280+0000","last_active":"2023-10-06T11:05:44.378652+0000","last_peered":"2023-10-06T11:05:44.378652+0000","last_clean":"2023-10-06T11:05:44.378652+0000","last_became_active":"2023-10-06T11:05:43.369002+0000","last_became_peered":"2023-10-06T11:05:43.369002+0000","last_unstale":"2023-10-06T11:05:44.378652+0000","last_undegraded":"2023-10-06T11:05:44.378652+0000","last_fullsized":"2023-10-06T11:05:44.378652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:53:55.024707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.378605+0000","last_change":"2023-10-06T11:05:43.368847+0000","last_active":"2023-10-06T11:05:44.378605+0000","last_peered":"2023-10-06T11:05:44.378605+0000","last_clean":"2023-10-06T11:05:44.378605+0000","last_became_active":"2023-10-06T11:05:43.368394+0000","last_became_peered":"2023-10-06T11:05:43.368394+0000","last_unstale":"2023-10-06T11:05:44.378605+0000","last_undegraded":"2023-10-06T11:05:44.378605+0000","last_fullsized":"2023-10-06T11:05:44.378605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:26.238071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.354872+0000","last_change":"2023-10-06T11:05:43.368442+0000","last_active":"2023-10-06T11:05:44.354872+0000","last_peered":"2023-10-06T11:05:44.354872+0000","last_clean":"2023-10-06T11:05:44.354872+0000","last_became_active":"2023-10-06T11:05:43.368152+0000","last_became_peered":"2023-10-06T11:05:43.368152+0000","last_unstale":"2023-10-06T11:05:44.354872+0000","last_undegraded":"2023-10-06T11:05:44.354872+0000","last_fullsized":"2023-10-06T11:05:44.354872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:27.003956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.371685+0000","last_change":"2023-10-06T11:05:44.368980+0000","last_active":"2023-10-06T11:05:44.371685+0000","last_peered":"2023-10-06T11:05:44.371685+0000","last_clean":"2023-10-06T11:05:44.371685+0000","last_became_active":"2023-10-06T11:05:44.368693+0000","last_became_peered":"2023-10-06T11:05:44.368693+0000","last_unstale":"2023-10-06T11:05:44.371685+0000","last_undegraded":"2023-10-06T11:05:44.371685+0000","last_fullsized":"2023-10-06T11:05:44.371685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:25:37.173612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.376448+0000","last_change":"2023-10-06T11:05:43.366389+0000","last_active":"2023-10-06T11:05:44.376448+0000","last_peered":"2023-10-06T11:05:44.376448+0000","last_clean":"2023-10-06T11:05:44.376448+0000","last_became_active":"2023-10-06T11:05:43.366041+0000","last_became_peered":"2023-10-06T11:05:43.366041+0000","last_unstale":"2023-10-06T11:05:44.376448+0000","last_undegraded":"2023-10-06T11:05:44.376448+0000","last_fullsized":"2023-10-06T11:05:44.376448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:18.301774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:42.336346+0000","last_change":"2023-10-06T11:05:42.336346+0000","last_active":"2023-10-06T11:05:42.336346+0000","last_peered":"2023-10-06T11:05:42.336346+0000","last_clean":"2023-10-06T11:05:42.336346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:42.336346+0000","last_undegraded":"2023-10-06T11:05:42.336346+0000","last_fullsized":"2023-10-06T11:05:42.336346+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:42.336346+0000","last_change":"2023-10-06T11:05:42.336346+0000","last_active":"2023-10-06T11:05:42.336346+0000","last_peered":"2023-10-06T11:05:42.336346+0000","last_clean":"2023-10-06T11:05:42.336346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:42.336346+0000","last_undegraded":"2023-10-06T11:05:42.336346+0000","last_fullsized":"2023-10-06T11:05:42.336346+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.357364+0000","last_change":"2023-10-06T11:05:43.367123+0000","last_active":"2023-10-06T11:05:44.357364+0000","last_peered":"2023-10-06T11:05:44.357364+0000","last_clean":"2023-10-06T11:05:44.357364+0000","last_became_active":"2023-10-06T11:05:43.366861+0000","last_became_peered":"2023-10-06T11:05:43.366861+0000","last_unstale":"2023-10-06T11:05:44.357364+0000","last_undegraded":"2023-10-06T11:05:44.357364+0000","last_fullsized":"2023-10-06T11:05:44.357364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:32.863094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379794+0000","last_change":"2023-10-06T11:05:43.367084+0000","last_active":"2023-10-06T11:05:44.379794+0000","last_peered":"2023-10-06T11:05:44.379794+0000","last_clean":"2023-10-06T11:05:44.379794+0000","last_became_active":"2023-10-06T11:05:43.366813+0000","last_became_peered":"2023-10-06T11:05:43.366813+0000","last_unstale":"2023-10-06T11:05:44.379794+0000","last_undegraded":"2023-10-06T11:05:44.379794+0000","last_fullsized":"2023-10-06T11:05:44.379794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:27.003956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-06T11:05:38.457157+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:05:38.457157+0000","last_peered":"2023-10-06T11:05:38.457157+0000","last_clean":"2023-10-06T11:05:38.457157+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:05:38.457157+0000","last_undegraded":"2023-10-06T11:05:38.457157+0000","last_fullsized":"2023-10-06T11:05:38.457157+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380176+0000","last_change":"2023-10-06T11:05:44.371162+0000","last_active":"2023-10-06T11:05:44.380176+0000","last_peered":"2023-10-06T11:05:44.380176+0000","last_clean":"2023-10-06T11:05:44.380176+0000","last_became_active":"2023-10-06T11:05:44.370923+0000","last_became_peered":"2023-10-06T11:05:44.370923+0000","last_unstale":"2023-10-06T11:05:44.380176+0000","last_undegraded":"2023-10-06T11:05:44.380176+0000","last_fullsized":"2023-10-06T11:05:44.380176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:20.240548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.356434+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:05:44.356434+0000","last_peered":"2023-10-06T11:05:44.356434+0000","last_clean":"2023-10-06T11:05:44.356434+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:05:44.356434+0000","last_undegraded":"2023-10-06T11:05:44.356434+0000","last_fullsized":"2023-10-06T11:05:44.356434+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.353543+0000","last_change":"2023-10-06T11:05:43.365664+0000","last_active":"2023-10-06T11:05:44.353543+0000","last_peered":"2023-10-06T11:05:44.353543+0000","last_clean":"2023-10-06T11:05:44.353543+0000","last_became_active":"2023-10-06T11:05:43.365413+0000","last_became_peered":"2023-10-06T11:05:43.365413+0000","last_unstale":"2023-10-06T11:05:44.353543+0000","last_undegraded":"2023-10-06T11:05:44.353543+0000","last_fullsized":"2023-10-06T11:05:44.353543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:32.863094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-06T11:05:38.324621+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:05:38.324621+0000","last_peered":"2023-10-06T11:05:38.324621+0000","last_clean":"2023-10-06T11:05:38.324621+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:05:38.324621+0000","last_undegraded":"2023-10-06T11:05:38.324621+0000","last_fullsized":"2023-10-06T11:05:38.324621+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.366104+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:05:44.366104+0000","last_peered":"2023-10-06T11:05:44.366104+0000","last_clean":"2023-10-06T11:05:44.366104+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:05:44.366104+0000","last_undegraded":"2023-10-06T11:05:44.366104+0000","last_fullsized":"2023-10-06T11:05:44.366104+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.352615+0000","last_change":"2023-10-06T11:05:43.368370+0000","last_active":"2023-10-06T11:05:44.352615+0000","last_peered":"2023-10-06T11:05:44.352615+0000","last_clean":"2023-10-06T11:05:44.352615+0000","last_became_active":"2023-10-06T11:05:43.368103+0000","last_became_peered":"2023-10-06T11:05:43.368103+0000","last_unstale":"2023-10-06T11:05:44.352615+0000","last_undegraded":"2023-10-06T11:05:44.352615+0000","last_fullsized":"2023-10-06T11:05:44.352615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:24.903299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.372002+0000","last_change":"2023-10-06T11:05:44.369604+0000","last_active":"2023-10-06T11:05:44.372002+0000","last_peered":"2023-10-06T11:05:44.372002+0000","last_clean":"2023-10-06T11:05:44.372002+0000","last_became_active":"2023-10-06T11:05:44.368781+0000","last_became_peered":"2023-10-06T11:05:44.368781+0000","last_unstale":"2023-10-06T11:05:44.372002+0000","last_undegraded":"2023-10-06T11:05:44.372002+0000","last_fullsized":"2023-10-06T11:05:44.372002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:20.240548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.361406+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:05:44.361406+0000","last_peered":"2023-10-06T11:05:44.361406+0000","last_clean":"2023-10-06T11:05:44.361406+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:05:44.361406+0000","last_undegraded":"2023-10-06T11:05:44.361406+0000","last_fullsized":"2023-10-06T11:05:44.361406+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:42.336346+0000","last_change":"2023-10-06T11:05:42.336346+0000","last_active":"2023-10-06T11:05:42.336346+0000","last_peered":"2023-10-06T11:05:42.336346+0000","last_clean":"2023-10-06T11:05:42.336346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:42.336346+0000","last_undegraded":"2023-10-06T11:05:42.336346+0000","last_fullsized":"2023-10-06T11:05:42.336346+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.365682+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:05:44.365682+0000","last_peered":"2023-10-06T11:05:44.365682+0000","last_clean":"2023-10-06T11:05:44.365682+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:05:44.365682+0000","last_undegraded":"2023-10-06T11:05:44.365682+0000","last_fullsized":"2023-10-06T11:05:44.365682+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.355393+0000","last_change":"2023-10-06T11:05:43.364706+0000","last_active":"2023-10-06T11:05:44.355393+0000","last_peered":"2023-10-06T11:05:44.355393+0000","last_clean":"2023-10-06T11:05:44.355393+0000","last_became_active":"2023-10-06T11:05:43.364448+0000","last_became_peered":"2023-10-06T11:05:43.364448+0000","last_unstale":"2023-10-06T11:05:44.355393+0000","last_undegraded":"2023-10-06T11:05:44.355393+0000","last_fullsized":"2023-10-06T11:05:44.355393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:24.903299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.354685+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:05:44.354685+0000","last_peered":"2023-10-06T11:05:44.354685+0000","last_clean":"2023-10-06T11:05:44.354685+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:05:44.354685+0000","last_undegraded":"2023-10-06T11:05:44.354685+0000","last_fullsized":"2023-10-06T11:05:44.354685+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:42.336346+0000","last_change":"2023-10-06T11:05:42.336346+0000","last_active":"2023-10-06T11:05:42.336346+0000","last_peered":"2023-10-06T11:05:42.336346+0000","last_clean":"2023-10-06T11:05:42.336346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:42.336346+0000","last_undegraded":"2023-10-06T11:05:42.336346+0000","last_fullsized":"2023-10-06T11:05:42.336346+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-06T11:05:38.420867+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:05:38.420867+0000","last_peered":"2023-10-06T11:05:38.420867+0000","last_clean":"2023-10-06T11:05:38.420867+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:05:38.420867+0000","last_undegraded":"2023-10-06T11:05:38.420867+0000","last_fullsized":"2023-10-06T11:05:38.420867+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:42.336346+0000","last_change":"2023-10-06T11:05:42.336346+0000","last_active":"2023-10-06T11:05:42.336346+0000","last_peered":"2023-10-06T11:05:42.336346+0000","last_clean":"2023-10-06T11:05:42.336346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:42.336346+0000","last_undegraded":"2023-10-06T11:05:42.336346+0000","last_fullsized":"2023-10-06T11:05:42.336346+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377441+0000","last_change":"2023-10-06T11:05:44.374324+0000","last_active":"2023-10-06T11:05:44.377441+0000","last_peered":"2023-10-06T11:05:44.377441+0000","last_clean":"2023-10-06T11:05:44.377441+0000","last_became_active":"2023-10-06T11:05:44.374070+0000","last_became_peered":"2023-10-06T11:05:44.374070+0000","last_unstale":"2023-10-06T11:05:44.377441+0000","last_undegraded":"2023-10-06T11:05:44.377441+0000","last_fullsized":"2023-10-06T11:05:44.377441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:49:53.929590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-06T11:05:38.323501+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:05:38.323501+0000","last_peered":"2023-10-06T11:05:38.323501+0000","last_clean":"2023-10-06T11:05:38.323501+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:05:38.323501+0000","last_undegraded":"2023-10-06T11:05:38.323501+0000","last_fullsized":"2023-10-06T11:05:38.323501+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.356747+0000","last_change":"2023-10-06T11:05:43.364980+0000","last_active":"2023-10-06T11:05:44.356747+0000","last_peered":"2023-10-06T11:05:44.356747+0000","last_clean":"2023-10-06T11:05:44.356747+0000","last_became_active":"2023-10-06T11:05:43.364661+0000","last_became_peered":"2023-10-06T11:05:43.364661+0000","last_unstale":"2023-10-06T11:05:44.356747+0000","last_undegraded":"2023-10-06T11:05:44.356747+0000","last_fullsized":"2023-10-06T11:05:44.356747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:32.863094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377355+0000","last_change":"2023-10-06T11:05:43.368448+0000","last_active":"2023-10-06T11:05:44.377355+0000","last_peered":"2023-10-06T11:05:44.377355+0000","last_clean":"2023-10-06T11:05:44.377355+0000","last_became_active":"2023-10-06T11:05:43.367859+0000","last_became_peered":"2023-10-06T11:05:43.367859+0000","last_unstale":"2023-10-06T11:05:44.377355+0000","last_undegraded":"2023-10-06T11:05:44.377355+0000","last_fullsized":"2023-10-06T11:05:44.377355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:18.301774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375383+0000","last_change":"2023-10-06T11:05:44.369211+0000","last_active":"2023-10-06T11:05:44.375383+0000","last_peered":"2023-10-06T11:05:44.375383+0000","last_clean":"2023-10-06T11:05:44.375383+0000","last_became_active":"2023-10-06T11:05:44.368950+0000","last_became_peered":"2023-10-06T11:05:44.368950+0000","last_unstale":"2023-10-06T11:05:44.375383+0000","last_undegraded":"2023-10-06T11:05:44.375383+0000","last_fullsized":"2023-10-06T11:05:44.375383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:01.484408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377607+0000","last_change":"2023-10-06T11:05:43.365792+0000","last_active":"2023-10-06T11:05:44.377607+0000","last_peered":"2023-10-06T11:05:44.377607+0000","last_clean":"2023-10-06T11:05:44.377607+0000","last_became_active":"2023-10-06T11:05:43.365137+0000","last_became_peered":"2023-10-06T11:05:43.365137+0000","last_unstale":"2023-10-06T11:05:44.377607+0000","last_undegraded":"2023-10-06T11:05:44.377607+0000","last_fullsized":"2023-10-06T11:05:44.377607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:24.903299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377828+0000","last_change":"2023-10-06T11:05:43.367620+0000","last_active":"2023-10-06T11:05:44.377828+0000","last_peered":"2023-10-06T11:05:44.377828+0000","last_clean":"2023-10-06T11:05:44.377828+0000","last_became_active":"2023-10-06T11:05:43.367335+0000","last_became_peered":"2023-10-06T11:05:43.367335+0000","last_unstale":"2023-10-06T11:05:44.377828+0000","last_undegraded":"2023-10-06T11:05:44.377828+0000","last_fullsized":"2023-10-06T11:05:44.377828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:18.301774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375170+0000","last_change":"2023-10-06T11:05:43.362124+0000","last_active":"2023-10-06T11:05:44.375170+0000","last_peered":"2023-10-06T11:05:44.375170+0000","last_clean":"2023-10-06T11:05:44.375170+0000","last_became_active":"2023-10-06T11:05:43.361847+0000","last_became_peered":"2023-10-06T11:05:43.361847+0000","last_unstale":"2023-10-06T11:05:44.375170+0000","last_undegraded":"2023-10-06T11:05:44.375170+0000","last_fullsized":"2023-10-06T11:05:44.375170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:36.907530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.373157+0000","last_change":"2023-10-06T11:05:44.367010+0000","last_active":"2023-10-06T11:05:44.373157+0000","last_peered":"2023-10-06T11:05:44.373157+0000","last_clean":"2023-10-06T11:05:44.373157+0000","last_became_active":"2023-10-06T11:05:44.366748+0000","last_became_peered":"2023-10-06T11:05:44.366748+0000","last_unstale":"2023-10-06T11:05:44.373157+0000","last_undegraded":"2023-10-06T11:05:44.373157+0000","last_fullsized":"2023-10-06T11:05:44.373157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:32:17.346227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380717+0000","last_change":"2023-10-06T11:05:43.367936+0000","last_active":"2023-10-06T11:05:44.380717+0000","last_peered":"2023-10-06T11:05:44.380717+0000","last_clean":"2023-10-06T11:05:44.380717+0000","last_became_active":"2023-10-06T11:05:43.367668+0000","last_became_peered":"2023-10-06T11:05:43.367668+0000","last_unstale":"2023-10-06T11:05:44.380717+0000","last_undegraded":"2023-10-06T11:05:44.380717+0000","last_fullsized":"2023-10-06T11:05:44.380717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:20:04.789716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379549+0000","last_change":"2023-10-06T11:05:44.373040+0000","last_active":"2023-10-06T11:05:44.379549+0000","last_peered":"2023-10-06T11:05:44.379549+0000","last_clean":"2023-10-06T11:05:44.379549+0000","last_became_active":"2023-10-06T11:05:44.370543+0000","last_became_peered":"2023-10-06T11:05:44.370543+0000","last_unstale":"2023-10-06T11:05:44.379549+0000","last_undegraded":"2023-10-06T11:05:44.379549+0000","last_fullsized":"2023-10-06T11:05:44.379549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:30:10.233024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379174+0000","last_change":"2023-10-06T11:05:44.372135+0000","last_active":"2023-10-06T11:05:44.379174+0000","last_peered":"2023-10-06T11:05:44.379174+0000","last_clean":"2023-10-06T11:05:44.379174+0000","last_became_active":"2023-10-06T11:05:44.371609+0000","last_became_peered":"2023-10-06T11:05:44.371609+0000","last_unstale":"2023-10-06T11:05:44.379174+0000","last_undegraded":"2023-10-06T11:05:44.379174+0000","last_fullsized":"2023-10-06T11:05:44.379174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:48:35.935962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":70,"acting":70,"num_store_stats":5},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":770,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23,"ondisk_log_size":23,"up":46,"acting":46,"num_store_stats":5},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298096,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073744,"statfs":{"total":96636764160,"available":96331513856,"internally_reserved":0,"allocated":827392,"data_stored":666304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297436,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074404,"statfs":{"total":96636764160,"available":96332189696,"internally_reserved":0,"allocated":151552,"data_stored":46308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298148,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073692,"statfs":{"total":96636764160,"available":96331460608,"internally_reserved":0,"allocated":749568,"data_stored":638029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":73385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297484,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074356,"statfs":{"total":96636764160,"available":96332140544,"internally_reserved":0,"allocated":200704,"data_stored":72831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":72921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297440,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074400,"statfs":{"total":96636764160,"available":96332185600,"internally_reserved":0,"allocated":155648,"data_stored":47661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":74808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:05:48.422 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:05:48.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.569+0000 7f021c8e8700 1 Processor -- start 2023-10-06T11:05:48.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.569+0000 7f021c8e8700 1 -- start start 2023-10-06T11:05:48.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.570+0000 7f021c8e8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0218068ba0 0x7f021815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:48.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.570+0000 7f021c8e8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0218153e80 0x7f02180b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:48.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.570+0000 7f021c8e8700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f021815ac30 con 0x7f0218153ab0 2023-10-06T11:05:48.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.570+0000 7f021c8e8700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02180b4510 con 0x7f0218068ba0 2023-10-06T11:05:48.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.570+0000 7f021c8e8700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02180b6530 con 0x7f0218153e80 2023-10-06T11:05:48.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.570+0000 7f0215d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0218068ba0 0x7f021815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:48.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.570+0000 7f0215d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0218068ba0 0x7f021815a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42156/0 (socket says 172.21.15.146:42156) 2023-10-06T11:05:48.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.570+0000 7f0215d9b700 1 -- 172.21.15.146:0/1085059215 learned_addr learned my addr 172.21.15.146:0/1085059215 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:48.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.570+0000 7f0216d9d700 1 --2- 172.21.15.146:0/1085059215 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0218153e80 0x7f02180b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:48.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.570+0000 7f0215d9b700 1 -- 172.21.15.146:0/1085059215 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0218153e80 msgr2=0x7f02180b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:48.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.570+0000 7f0215d9b700 1 --2- 172.21.15.146:0/1085059215 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0218153e80 0x7f02180b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:48.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.570+0000 7f0215d9b700 1 -- 172.21.15.146:0/1085059215 >> v1:172.21.15.151:6789/0 conn(0x7f0218153ab0 legacy=0x7f0218068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:48.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.570+0000 7f0215d9b700 1 -- 172.21.15.146:0/1085059215 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02180b5c50 con 0x7f0218068ba0 2023-10-06T11:05:48.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.570+0000 7f0215d9b700 1 --2- 172.21.15.146:0/1085059215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0218068ba0 0x7f021815a6f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f020c0099b0 tx=0x7f020c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e2a70b10ff0df69 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:48.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.570+0000 7f021559a700 1 -- 172.21.15.146:0/1085059215 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020c00b820 con 0x7f0218068ba0 2023-10-06T11:05:48.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.570+0000 7f021559a700 1 -- 172.21.15.146:0/1085059215 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020c00b980 con 0x7f0218068ba0 2023-10-06T11:05:48.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.570+0000 7f021559a700 1 -- 172.21.15.146:0/1085059215 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020c00bd20 con 0x7f0218068ba0 2023-10-06T11:05:48.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.571+0000 7f021c8e8700 1 -- 172.21.15.146:0/1085059215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0218068ba0 msgr2=0x7f021815a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:48.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.571+0000 7f021c8e8700 1 --2- 172.21.15.146:0/1085059215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0218068ba0 0x7f021815a6f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f020c0099b0 tx=0x7f020c009250 comp rx=0 tx=0).stop 2023-10-06T11:05:48.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.571+0000 7f021c8e8700 1 -- 172.21.15.146:0/1085059215 shutdown_connections 2023-10-06T11:05:48.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.571+0000 7f021c8e8700 1 --2- 172.21.15.146:0/1085059215 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0218153e80 0x7f02180b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:48.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.571+0000 7f021c8e8700 1 --2- 172.21.15.146:0/1085059215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0218068ba0 0x7f021815a6f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:48.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.571+0000 7f021c8e8700 1 -- 172.21.15.146:0/1085059215 >> 172.21.15.146:0/1085059215 conn(0x7f021806eba0 msgr2=0x7f021806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:48.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.571+0000 7f021c8e8700 1 -- 172.21.15.146:0/1085059215 shutdown_connections 2023-10-06T11:05:48.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.571+0000 7f021c8e8700 1 -- 172.21.15.146:0/1085059215 wait complete. 2023-10-06T11:05:48.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.572+0000 7f021c8e8700 1 Processor -- start 2023-10-06T11:05:48.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.572+0000 7f021c8e8700 1 -- start start 2023-10-06T11:05:48.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.573+0000 7f021c8e8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0218068ba0 0x7f02180cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:48.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.573+0000 7f021c8e8700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0218153ab0 0x7f0218156e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:48.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.573+0000 7f021c8e8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0218153e80 0x7f02180cfd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:48.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.573+0000 7f021c8e8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02180c56d0 con 0x7f0218068ba0 2023-10-06T11:05:48.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.573+0000 7f021c8e8700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02181583f0 con 0x7f0218153ab0 2023-10-06T11:05:48.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.573+0000 7f021c8e8700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02181586d0 con 0x7f0218153e80 2023-10-06T11:05:48.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.573+0000 7f021659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0218068ba0 0x7f02180cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:48.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.573+0000 7f021659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0218068ba0 0x7f02180cbcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42168/0 (socket says 172.21.15.146:42168) 2023-10-06T11:05:48.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.573+0000 7f021659c700 1 -- 172.21.15.146:0/4188273730 learned_addr learned my addr 172.21.15.146:0/4188273730 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:48.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.573+0000 7f0215d9b700 1 --2- 172.21.15.146:0/4188273730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0218153ab0 0x7f0218156e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:48.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.573+0000 7f0216d9d700 1 --2- 172.21.15.146:0/4188273730 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0218153e80 0x7f02180cfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:48.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.573+0000 7f021659c700 1 -- 172.21.15.146:0/4188273730 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0218153e80 msgr2=0x7f02180cfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:48.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.573+0000 7f021659c700 1 --2- 172.21.15.146:0/4188273730 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0218153e80 0x7f02180cfd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:48.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.573+0000 7f021659c700 1 -- 172.21.15.146:0/4188273730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0218153ab0 msgr2=0x7f0218156e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:48.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.573+0000 7f021659c700 1 --2- 172.21.15.146:0/4188273730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0218153ab0 0x7f0218156e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:48.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.573+0000 7f021659c700 1 -- 172.21.15.146:0/4188273730 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020c0094f0 con 0x7f0218068ba0 2023-10-06T11:05:48.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.573+0000 7f0215d9b700 1 --2- 172.21.15.146:0/4188273730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0218153ab0 0x7f0218156e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:05:48.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.573+0000 7f0216d9d700 1 --2- 172.21.15.146:0/4188273730 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0218153e80 0x7f02180cfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:05:48.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.573+0000 7f021659c700 1 --2- 172.21.15.146:0/4188273730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0218068ba0 0x7f02180cbcc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f020800c5d0 tx=0x7f0208007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:48.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.574+0000 7f02067fc700 1 -- 172.21.15.146:0/4188273730 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0208011590 con 0x7f0218068ba0 2023-10-06T11:05:48.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.574+0000 7f02067fc700 1 -- 172.21.15.146:0/4188273730 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0208011710 con 0x7f0218068ba0 2023-10-06T11:05:48.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.574+0000 7f021c8e8700 1 -- 172.21.15.146:0/4188273730 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02181589b0 con 0x7f0218068ba0 2023-10-06T11:05:48.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.574+0000 7f02067fc700 1 -- 172.21.15.146:0/4188273730 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0208011ad0 con 0x7f0218068ba0 2023-10-06T11:05:48.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.574+0000 7f021c8e8700 1 -- 172.21.15.146:0/4188273730 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0218158f70 con 0x7f0218068ba0 2023-10-06T11:05:48.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.574+0000 7f021c8e8700 1 -- 172.21.15.146:0/4188273730 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f021804c380 con 0x7f0218068ba0 2023-10-06T11:05:48.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.575+0000 7f02067fc700 1 -- 172.21.15.146:0/4188273730 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f020801c460 con 0x7f0218068ba0 2023-10-06T11:05:48.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.575+0000 7f02067fc700 1 --2- 172.21.15.146:0/4188273730 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f01f8066f30 0x7f01f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:48.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.575+0000 7f02067fc700 1 -- 172.21.15.146:0/4188273730 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f02080843f0 con 0x7f0218068ba0 2023-10-06T11:05:48.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.575+0000 7f0215d9b700 1 --2- 172.21.15.146:0/4188273730 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f01f8066f30 0x7f01f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:48.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.576+0000 7f0215d9b700 1 --2- 172.21.15.146:0/4188273730 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f01f8066f30 0x7f01f80693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f020c0099b0 tx=0x7f020c016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:48.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.579+0000 7f02067fc700 1 -- 172.21.15.146:0/4188273730 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0208051500 con 0x7f0218068ba0 2023-10-06T11:05:48.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.758+0000 7f021c8e8700 1 -- 172.21.15.146:0/4188273730 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f02180b6250 con 0x7f01f8066f30 2023-10-06T11:05:48.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.765+0000 7f02067fc700 1 -- 172.21.15.146:0/4188273730 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281094 (secure 0 0 0) 0x7f02180b6250 con 0x7f01f8066f30 2023-10-06T11:05:48.770 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:05:48.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.768+0000 7f021c8e8700 1 -- 172.21.15.146:0/4188273730 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f01f8066f30 msgr2=0x7f01f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:48.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.768+0000 7f021c8e8700 1 --2- 172.21.15.146:0/4188273730 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f01f8066f30 0x7f01f80693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f020c0099b0 tx=0x7f020c016000 comp rx=0 tx=0).stop 2023-10-06T11:05:48.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.768+0000 7f021c8e8700 1 -- 172.21.15.146:0/4188273730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0218068ba0 msgr2=0x7f02180cbcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:48.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.768+0000 7f021c8e8700 1 --2- 172.21.15.146:0/4188273730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0218068ba0 0x7f02180cbcc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f020800c5d0 tx=0x7f0208007f60 comp rx=0 tx=0).stop 2023-10-06T11:05:48.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.768+0000 7f021c8e8700 1 -- 172.21.15.146:0/4188273730 shutdown_connections 2023-10-06T11:05:48.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.768+0000 7f021c8e8700 1 --2- 172.21.15.146:0/4188273730 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f01f8066f30 0x7f01f80693e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:48.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.768+0000 7f021c8e8700 1 --2- 172.21.15.146:0/4188273730 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0218153e80 0x7f02180cfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:48.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.768+0000 7f021c8e8700 1 --2- 172.21.15.146:0/4188273730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0218068ba0 0x7f02180cbcc0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:48.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.768+0000 7f021c8e8700 1 --2- 172.21.15.146:0/4188273730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0218153ab0 0x7f0218156e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:48.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.768+0000 7f021c8e8700 1 -- 172.21.15.146:0/4188273730 >> 172.21.15.146:0/4188273730 conn(0x7f021806eba0 msgr2=0x7f02180ce950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:48.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.768+0000 7f021c8e8700 1 -- 172.21.15.146:0/4188273730 shutdown_connections 2023-10-06T11:05:48.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.768+0000 7f021c8e8700 1 -- 172.21.15.146:0/4188273730 wait complete. 2023-10-06T11:05:48.773 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:05:48.782 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-10-06T11:05:47.128743+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591138,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":185,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":134,"acting":134,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":41,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381076,"kb_used_data":2644,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593644,"statfs":{"total":773094113280,"available":770655891456,"internally_reserved":0,"allocated":2707456,"data_stored":1692247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":770,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.784559"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.376223+0000","last_change":"2023-10-06T11:05:44.374095+0000","last_active":"2023-10-06T11:05:44.376223+0000","last_peered":"2023-10-06T11:05:44.376223+0000","last_clean":"2023-10-06T11:05:44.376223+0000","last_became_active":"2023-10-06T11:05:44.373839+0000","last_became_peered":"2023-10-06T11:05:44.373839+0000","last_unstale":"2023-10-06T11:05:44.376223+0000","last_undegraded":"2023-10-06T11:05:44.376223+0000","last_fullsized":"2023-10-06T11:05:44.376223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:25.910038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380398+0000","last_change":"2023-10-06T11:05:44.372580+0000","last_active":"2023-10-06T11:05:44.380398+0000","last_peered":"2023-10-06T11:05:44.380398+0000","last_clean":"2023-10-06T11:05:44.380398+0000","last_became_active":"2023-10-06T11:05:44.372338+0000","last_became_peered":"2023-10-06T11:05:44.372338+0000","last_unstale":"2023-10-06T11:05:44.380398+0000","last_undegraded":"2023-10-06T11:05:44.380398+0000","last_fullsized":"2023-10-06T11:05:44.380398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:49:53.929590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.370764+0000","last_change":"2023-10-06T11:05:44.368424+0000","last_active":"2023-10-06T11:05:44.370764+0000","last_peered":"2023-10-06T11:05:44.370764+0000","last_clean":"2023-10-06T11:05:44.370764+0000","last_became_active":"2023-10-06T11:05:44.368174+0000","last_became_peered":"2023-10-06T11:05:44.368174+0000","last_unstale":"2023-10-06T11:05:44.370764+0000","last_undegraded":"2023-10-06T11:05:44.370764+0000","last_fullsized":"2023-10-06T11:05:44.370764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:48.500150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.381050+0000","last_change":"2023-10-06T11:05:44.376045+0000","last_active":"2023-10-06T11:05:44.381050+0000","last_peered":"2023-10-06T11:05:44.381050+0000","last_clean":"2023-10-06T11:05:44.381050+0000","last_became_active":"2023-10-06T11:05:44.374697+0000","last_became_peered":"2023-10-06T11:05:44.374697+0000","last_unstale":"2023-10-06T11:05:44.381050+0000","last_undegraded":"2023-10-06T11:05:44.381050+0000","last_fullsized":"2023-10-06T11:05:44.381050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:30:10.233024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377816+0000","last_change":"2023-10-06T11:05:44.370424+0000","last_active":"2023-10-06T11:05:44.377816+0000","last_peered":"2023-10-06T11:05:44.377816+0000","last_clean":"2023-10-06T11:05:44.377816+0000","last_became_active":"2023-10-06T11:05:44.370141+0000","last_became_peered":"2023-10-06T11:05:44.370141+0000","last_unstale":"2023-10-06T11:05:44.377816+0000","last_undegraded":"2023-10-06T11:05:44.377816+0000","last_fullsized":"2023-10-06T11:05:44.377816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:32:17.346227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.374345+0000","last_change":"2023-10-06T11:05:44.370535+0000","last_active":"2023-10-06T11:05:44.374345+0000","last_peered":"2023-10-06T11:05:44.374345+0000","last_clean":"2023-10-06T11:05:44.374345+0000","last_became_active":"2023-10-06T11:05:44.370264+0000","last_became_peered":"2023-10-06T11:05:44.370264+0000","last_unstale":"2023-10-06T11:05:44.374345+0000","last_undegraded":"2023-10-06T11:05:44.374345+0000","last_fullsized":"2023-10-06T11:05:44.374345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:18:11.738273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377689+0000","last_change":"2023-10-06T11:05:44.363111+0000","last_active":"2023-10-06T11:05:44.377689+0000","last_peered":"2023-10-06T11:05:44.377689+0000","last_clean":"2023-10-06T11:05:44.377689+0000","last_became_active":"2023-10-06T11:05:44.362803+0000","last_became_peered":"2023-10-06T11:05:44.362803+0000","last_unstale":"2023-10-06T11:05:44.377689+0000","last_undegraded":"2023-10-06T11:05:44.377689+0000","last_fullsized":"2023-10-06T11:05:44.377689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:49:41.512642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.365243+0000","last_change":"2023-10-06T11:05:44.362523+0000","last_active":"2023-10-06T11:05:44.365243+0000","last_peered":"2023-10-06T11:05:44.365243+0000","last_clean":"2023-10-06T11:05:44.365243+0000","last_became_active":"2023-10-06T11:05:44.362248+0000","last_became_peered":"2023-10-06T11:05:44.362248+0000","last_unstale":"2023-10-06T11:05:44.365243+0000","last_undegraded":"2023-10-06T11:05:44.365243+0000","last_fullsized":"2023-10-06T11:05:44.365243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:33.869834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.376261+0000","last_change":"2023-10-06T11:05:44.373706+0000","last_active":"2023-10-06T11:05:44.376261+0000","last_peered":"2023-10-06T11:05:44.376261+0000","last_clean":"2023-10-06T11:05:44.376261+0000","last_became_active":"2023-10-06T11:05:44.373408+0000","last_became_peered":"2023-10-06T11:05:44.373408+0000","last_unstale":"2023-10-06T11:05:44.376261+0000","last_undegraded":"2023-10-06T11:05:44.376261+0000","last_fullsized":"2023-10-06T11:05:44.376261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:28.010695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377714+0000","last_change":"2023-10-06T11:05:44.364121+0000","last_active":"2023-10-06T11:05:44.377714+0000","last_peered":"2023-10-06T11:05:44.377714+0000","last_clean":"2023-10-06T11:05:44.377714+0000","last_became_active":"2023-10-06T11:05:44.363863+0000","last_became_peered":"2023-10-06T11:05:44.363863+0000","last_unstale":"2023-10-06T11:05:44.377714+0000","last_undegraded":"2023-10-06T11:05:44.377714+0000","last_fullsized":"2023-10-06T11:05:44.377714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:51.490766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.381068+0000","last_change":"2023-10-06T11:05:44.376146+0000","last_active":"2023-10-06T11:05:44.381068+0000","last_peered":"2023-10-06T11:05:44.381068+0000","last_clean":"2023-10-06T11:05:44.381068+0000","last_became_active":"2023-10-06T11:05:44.375877+0000","last_became_peered":"2023-10-06T11:05:44.375877+0000","last_unstale":"2023-10-06T11:05:44.381068+0000","last_undegraded":"2023-10-06T11:05:44.381068+0000","last_fullsized":"2023-10-06T11:05:44.381068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:25:37.173612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377465+0000","last_change":"2023-10-06T11:05:44.374262+0000","last_active":"2023-10-06T11:05:44.377465+0000","last_peered":"2023-10-06T11:05:44.377465+0000","last_clean":"2023-10-06T11:05:44.377465+0000","last_became_active":"2023-10-06T11:05:44.373997+0000","last_became_peered":"2023-10-06T11:05:44.373997+0000","last_unstale":"2023-10-06T11:05:44.377465+0000","last_undegraded":"2023-10-06T11:05:44.377465+0000","last_fullsized":"2023-10-06T11:05:44.377465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:30:10.233024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377738+0000","last_change":"2023-10-06T11:05:44.376536+0000","last_active":"2023-10-06T11:05:44.377738+0000","last_peered":"2023-10-06T11:05:44.377738+0000","last_clean":"2023-10-06T11:05:44.377738+0000","last_became_active":"2023-10-06T11:05:44.376291+0000","last_became_peered":"2023-10-06T11:05:44.376291+0000","last_unstale":"2023-10-06T11:05:44.377738+0000","last_undegraded":"2023-10-06T11:05:44.377738+0000","last_fullsized":"2023-10-06T11:05:44.377738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:19.308513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380978+0000","last_change":"2023-10-06T11:05:44.373773+0000","last_active":"2023-10-06T11:05:44.380978+0000","last_peered":"2023-10-06T11:05:44.380978+0000","last_clean":"2023-10-06T11:05:44.380978+0000","last_became_active":"2023-10-06T11:05:44.373445+0000","last_became_peered":"2023-10-06T11:05:44.373445+0000","last_unstale":"2023-10-06T11:05:44.380978+0000","last_undegraded":"2023-10-06T11:05:44.380978+0000","last_fullsized":"2023-10-06T11:05:44.380978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:48.500150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.370569+0000","last_change":"2023-10-06T11:05:44.365767+0000","last_active":"2023-10-06T11:05:44.370569+0000","last_peered":"2023-10-06T11:05:44.370569+0000","last_clean":"2023-10-06T11:05:44.370569+0000","last_became_active":"2023-10-06T11:05:44.365489+0000","last_became_peered":"2023-10-06T11:05:44.365489+0000","last_unstale":"2023-10-06T11:05:44.370569+0000","last_undegraded":"2023-10-06T11:05:44.370569+0000","last_fullsized":"2023-10-06T11:05:44.370569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:36:18.739157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379611+0000","last_change":"2023-10-06T11:05:44.373554+0000","last_active":"2023-10-06T11:05:44.379611+0000","last_peered":"2023-10-06T11:05:44.379611+0000","last_clean":"2023-10-06T11:05:44.379611+0000","last_became_active":"2023-10-06T11:05:44.373293+0000","last_became_peered":"2023-10-06T11:05:44.373293+0000","last_unstale":"2023-10-06T11:05:44.379611+0000","last_undegraded":"2023-10-06T11:05:44.379611+0000","last_fullsized":"2023-10-06T11:05:44.379611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:32:31.703547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380998+0000","last_change":"2023-10-06T11:05:44.373832+0000","last_active":"2023-10-06T11:05:44.380998+0000","last_peered":"2023-10-06T11:05:44.380998+0000","last_clean":"2023-10-06T11:05:44.380998+0000","last_became_active":"2023-10-06T11:05:44.373527+0000","last_became_peered":"2023-10-06T11:05:44.373527+0000","last_unstale":"2023-10-06T11:05:44.380998+0000","last_undegraded":"2023-10-06T11:05:44.380998+0000","last_fullsized":"2023-10-06T11:05:44.380998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:49:53.929590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380422+0000","last_change":"2023-10-06T11:05:44.372985+0000","last_active":"2023-10-06T11:05:44.380422+0000","last_peered":"2023-10-06T11:05:44.380422+0000","last_clean":"2023-10-06T11:05:44.380422+0000","last_became_active":"2023-10-06T11:05:44.372531+0000","last_became_peered":"2023-10-06T11:05:44.372531+0000","last_unstale":"2023-10-06T11:05:44.380422+0000","last_undegraded":"2023-10-06T11:05:44.380422+0000","last_fullsized":"2023-10-06T11:05:44.380422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:36:26.414372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:42.336346+0000","last_change":"2023-10-06T11:05:42.336346+0000","last_active":"2023-10-06T11:05:42.336346+0000","last_peered":"2023-10-06T11:05:42.336346+0000","last_clean":"2023-10-06T11:05:42.336346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:42.336346+0000","last_undegraded":"2023-10-06T11:05:42.336346+0000","last_fullsized":"2023-10-06T11:05:42.336346+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.370597+0000","last_change":"2023-10-06T11:05:44.367477+0000","last_active":"2023-10-06T11:05:44.370597+0000","last_peered":"2023-10-06T11:05:44.370597+0000","last_clean":"2023-10-06T11:05:44.370597+0000","last_became_active":"2023-10-06T11:05:44.367216+0000","last_became_peered":"2023-10-06T11:05:44.367216+0000","last_unstale":"2023-10-06T11:05:44.370597+0000","last_undegraded":"2023-10-06T11:05:44.370597+0000","last_fullsized":"2023-10-06T11:05:44.370597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:48.500150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:42.336346+0000","last_change":"2023-10-06T11:05:42.336346+0000","last_active":"2023-10-06T11:05:42.336346+0000","last_peered":"2023-10-06T11:05:42.336346+0000","last_clean":"2023-10-06T11:05:42.336346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:42.336346+0000","last_undegraded":"2023-10-06T11:05:42.336346+0000","last_fullsized":"2023-10-06T11:05:42.336346+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.370930+0000","last_change":"2023-10-06T11:05:44.367950+0000","last_active":"2023-10-06T11:05:44.370930+0000","last_peered":"2023-10-06T11:05:44.370930+0000","last_clean":"2023-10-06T11:05:44.370930+0000","last_became_active":"2023-10-06T11:05:44.367682+0000","last_became_peered":"2023-10-06T11:05:44.367682+0000","last_unstale":"2023-10-06T11:05:44.370930+0000","last_undegraded":"2023-10-06T11:05:44.370930+0000","last_fullsized":"2023-10-06T11:05:44.370930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:53:21.828799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.356971+0000","last_change":"2023-10-06T11:05:43.366406+0000","last_active":"2023-10-06T11:05:44.356971+0000","last_peered":"2023-10-06T11:05:44.356971+0000","last_clean":"2023-10-06T11:05:44.356971+0000","last_became_active":"2023-10-06T11:05:43.366004+0000","last_became_peered":"2023-10-06T11:05:43.366004+0000","last_unstale":"2023-10-06T11:05:44.356971+0000","last_undegraded":"2023-10-06T11:05:44.356971+0000","last_fullsized":"2023-10-06T11:05:44.356971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:00.477669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.353362+0000","last_change":"2023-10-06T11:05:43.362935+0000","last_active":"2023-10-06T11:05:44.353362+0000","last_peered":"2023-10-06T11:05:44.353362+0000","last_clean":"2023-10-06T11:05:44.353362+0000","last_became_active":"2023-10-06T11:05:43.362642+0000","last_became_peered":"2023-10-06T11:05:43.362642+0000","last_unstale":"2023-10-06T11:05:44.353362+0000","last_undegraded":"2023-10-06T11:05:44.353362+0000","last_fullsized":"2023-10-06T11:05:44.353362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:36.907530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.371257+0000","last_change":"2023-10-06T11:05:44.366360+0000","last_active":"2023-10-06T11:05:44.371257+0000","last_peered":"2023-10-06T11:05:44.371257+0000","last_clean":"2023-10-06T11:05:44.371257+0000","last_became_active":"2023-10-06T11:05:44.366097+0000","last_became_peered":"2023-10-06T11:05:44.366097+0000","last_unstale":"2023-10-06T11:05:44.371257+0000","last_undegraded":"2023-10-06T11:05:44.371257+0000","last_fullsized":"2023-10-06T11:05:44.371257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:18:11.738273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.357158+0000","last_change":"2023-10-06T11:05:43.365582+0000","last_active":"2023-10-06T11:05:44.357158+0000","last_peered":"2023-10-06T11:05:44.357158+0000","last_clean":"2023-10-06T11:05:44.357158+0000","last_became_active":"2023-10-06T11:05:43.365197+0000","last_became_peered":"2023-10-06T11:05:43.365197+0000","last_unstale":"2023-10-06T11:05:44.357158+0000","last_undegraded":"2023-10-06T11:05:44.357158+0000","last_fullsized":"2023-10-06T11:05:44.357158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:59:28.141215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.373455+0000","last_change":"2023-10-06T11:05:44.369545+0000","last_active":"2023-10-06T11:05:44.373455+0000","last_peered":"2023-10-06T11:05:44.373455+0000","last_clean":"2023-10-06T11:05:44.373455+0000","last_became_active":"2023-10-06T11:05:44.369228+0000","last_became_peered":"2023-10-06T11:05:44.369228+0000","last_unstale":"2023-10-06T11:05:44.373455+0000","last_undegraded":"2023-10-06T11:05:44.373455+0000","last_fullsized":"2023-10-06T11:05:44.373455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:36:18.739157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.378674+0000","last_change":"2023-10-06T11:05:43.370700+0000","last_active":"2023-10-06T11:05:44.378674+0000","last_peered":"2023-10-06T11:05:44.378674+0000","last_clean":"2023-10-06T11:05:44.378674+0000","last_became_active":"2023-10-06T11:05:43.370418+0000","last_became_peered":"2023-10-06T11:05:43.370418+0000","last_unstale":"2023-10-06T11:05:44.378674+0000","last_undegraded":"2023-10-06T11:05:44.378674+0000","last_fullsized":"2023-10-06T11:05:44.378674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:03.585687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:42.336346+0000","last_change":"2023-10-06T11:05:42.336346+0000","last_active":"2023-10-06T11:05:42.336346+0000","last_peered":"2023-10-06T11:05:42.336346+0000","last_clean":"2023-10-06T11:05:42.336346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:42.336346+0000","last_undegraded":"2023-10-06T11:05:42.336346+0000","last_fullsized":"2023-10-06T11:05:42.336346+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.378534+0000","last_change":"2023-10-06T11:05:43.369646+0000","last_active":"2023-10-06T11:05:44.378534+0000","last_peered":"2023-10-06T11:05:44.378534+0000","last_clean":"2023-10-06T11:05:44.378534+0000","last_became_active":"2023-10-06T11:05:43.369353+0000","last_became_peered":"2023-10-06T11:05:43.369353+0000","last_unstale":"2023-10-06T11:05:44.378534+0000","last_undegraded":"2023-10-06T11:05:44.378534+0000","last_fullsized":"2023-10-06T11:05:44.378534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:50.484027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379530+0000","last_change":"2023-10-06T11:05:44.372738+0000","last_active":"2023-10-06T11:05:44.379530+0000","last_peered":"2023-10-06T11:05:44.379530+0000","last_clean":"2023-10-06T11:05:44.379530+0000","last_became_active":"2023-10-06T11:05:44.372299+0000","last_became_peered":"2023-10-06T11:05:44.372299+0000","last_unstale":"2023-10-06T11:05:44.379530+0000","last_undegraded":"2023-10-06T11:05:44.379530+0000","last_fullsized":"2023-10-06T11:05:44.379530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:53:21.828799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.352712+0000","last_change":"2023-10-06T11:05:43.364085+0000","last_active":"2023-10-06T11:05:44.352712+0000","last_peered":"2023-10-06T11:05:44.352712+0000","last_clean":"2023-10-06T11:05:44.352712+0000","last_became_active":"2023-10-06T11:05:43.363844+0000","last_became_peered":"2023-10-06T11:05:43.363844+0000","last_unstale":"2023-10-06T11:05:44.352712+0000","last_undegraded":"2023-10-06T11:05:44.352712+0000","last_fullsized":"2023-10-06T11:05:44.352712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:51.324615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380405+0000","last_change":"2023-10-06T11:05:44.372815+0000","last_active":"2023-10-06T11:05:44.380405+0000","last_peered":"2023-10-06T11:05:44.380405+0000","last_clean":"2023-10-06T11:05:44.380405+0000","last_became_active":"2023-10-06T11:05:44.372237+0000","last_became_peered":"2023-10-06T11:05:44.372237+0000","last_unstale":"2023-10-06T11:05:44.380405+0000","last_undegraded":"2023-10-06T11:05:44.380405+0000","last_fullsized":"2023-10-06T11:05:44.380405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:42.381985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.363864+0000","last_change":"2023-10-06T11:05:43.369142+0000","last_active":"2023-10-06T11:05:44.363864+0000","last_peered":"2023-10-06T11:05:44.363864+0000","last_clean":"2023-10-06T11:05:44.363864+0000","last_became_active":"2023-10-06T11:05:43.368847+0000","last_became_peered":"2023-10-06T11:05:43.368847+0000","last_unstale":"2023-10-06T11:05:44.363864+0000","last_undegraded":"2023-10-06T11:05:44.363864+0000","last_fullsized":"2023-10-06T11:05:44.363864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:48:23.698446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.373918+0000","last_change":"2023-10-06T11:05:44.370314+0000","last_active":"2023-10-06T11:05:44.373918+0000","last_peered":"2023-10-06T11:05:44.373918+0000","last_clean":"2023-10-06T11:05:44.373918+0000","last_became_active":"2023-10-06T11:05:44.370065+0000","last_became_peered":"2023-10-06T11:05:44.370065+0000","last_unstale":"2023-10-06T11:05:44.373918+0000","last_undegraded":"2023-10-06T11:05:44.373918+0000","last_fullsized":"2023-10-06T11:05:44.373918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:32:31.703547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:42.336346+0000","last_change":"2023-10-06T11:05:42.336346+0000","last_active":"2023-10-06T11:05:42.336346+0000","last_peered":"2023-10-06T11:05:42.336346+0000","last_clean":"2023-10-06T11:05:42.336346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:42.336346+0000","last_undegraded":"2023-10-06T11:05:42.336346+0000","last_fullsized":"2023-10-06T11:05:42.336346+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379857+0000","last_change":"2023-10-06T11:05:44.372870+0000","last_active":"2023-10-06T11:05:44.379857+0000","last_peered":"2023-10-06T11:05:44.379857+0000","last_clean":"2023-10-06T11:05:44.379857+0000","last_became_active":"2023-10-06T11:05:44.372480+0000","last_became_peered":"2023-10-06T11:05:44.372480+0000","last_unstale":"2023-10-06T11:05:44.379857+0000","last_undegraded":"2023-10-06T11:05:44.379857+0000","last_fullsized":"2023-10-06T11:05:44.379857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:25:37.173612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.378371+0000","last_change":"2023-10-06T11:05:43.369672+0000","last_active":"2023-10-06T11:05:44.378371+0000","last_peered":"2023-10-06T11:05:44.378371+0000","last_clean":"2023-10-06T11:05:44.378371+0000","last_became_active":"2023-10-06T11:05:43.369415+0000","last_became_peered":"2023-10-06T11:05:43.369415+0000","last_unstale":"2023-10-06T11:05:44.378371+0000","last_undegraded":"2023-10-06T11:05:44.378371+0000","last_fullsized":"2023-10-06T11:05:44.378371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:21:07.005347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.385017+0000","last_change":"2023-10-06T11:05:44.380100+0000","last_active":"2023-10-06T11:05:44.385017+0000","last_peered":"2023-10-06T11:05:44.385017+0000","last_clean":"2023-10-06T11:05:44.385017+0000","last_became_active":"2023-10-06T11:05:44.379686+0000","last_became_peered":"2023-10-06T11:05:44.379686+0000","last_unstale":"2023-10-06T11:05:44.385017+0000","last_undegraded":"2023-10-06T11:05:44.385017+0000","last_fullsized":"2023-10-06T11:05:44.385017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:32:31.703547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.378652+0000","last_change":"2023-10-06T11:05:43.369280+0000","last_active":"2023-10-06T11:05:44.378652+0000","last_peered":"2023-10-06T11:05:44.378652+0000","last_clean":"2023-10-06T11:05:44.378652+0000","last_became_active":"2023-10-06T11:05:43.369002+0000","last_became_peered":"2023-10-06T11:05:43.369002+0000","last_unstale":"2023-10-06T11:05:44.378652+0000","last_undegraded":"2023-10-06T11:05:44.378652+0000","last_fullsized":"2023-10-06T11:05:44.378652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:53:55.024707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.378605+0000","last_change":"2023-10-06T11:05:43.368847+0000","last_active":"2023-10-06T11:05:44.378605+0000","last_peered":"2023-10-06T11:05:44.378605+0000","last_clean":"2023-10-06T11:05:44.378605+0000","last_became_active":"2023-10-06T11:05:43.368394+0000","last_became_peered":"2023-10-06T11:05:43.368394+0000","last_unstale":"2023-10-06T11:05:44.378605+0000","last_undegraded":"2023-10-06T11:05:44.378605+0000","last_fullsized":"2023-10-06T11:05:44.378605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:26.238071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.354872+0000","last_change":"2023-10-06T11:05:43.368442+0000","last_active":"2023-10-06T11:05:44.354872+0000","last_peered":"2023-10-06T11:05:44.354872+0000","last_clean":"2023-10-06T11:05:44.354872+0000","last_became_active":"2023-10-06T11:05:43.368152+0000","last_became_peered":"2023-10-06T11:05:43.368152+0000","last_unstale":"2023-10-06T11:05:44.354872+0000","last_undegraded":"2023-10-06T11:05:44.354872+0000","last_fullsized":"2023-10-06T11:05:44.354872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:27.003956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.371685+0000","last_change":"2023-10-06T11:05:44.368980+0000","last_active":"2023-10-06T11:05:44.371685+0000","last_peered":"2023-10-06T11:05:44.371685+0000","last_clean":"2023-10-06T11:05:44.371685+0000","last_became_active":"2023-10-06T11:05:44.368693+0000","last_became_peered":"2023-10-06T11:05:44.368693+0000","last_unstale":"2023-10-06T11:05:44.371685+0000","last_undegraded":"2023-10-06T11:05:44.371685+0000","last_fullsized":"2023-10-06T11:05:44.371685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:25:37.173612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.376448+0000","last_change":"2023-10-06T11:05:43.366389+0000","last_active":"2023-10-06T11:05:44.376448+0000","last_peered":"2023-10-06T11:05:44.376448+0000","last_clean":"2023-10-06T11:05:44.376448+0000","last_became_active":"2023-10-06T11:05:43.366041+0000","last_became_peered":"2023-10-06T11:05:43.366041+0000","last_unstale":"2023-10-06T11:05:44.376448+0000","last_undegraded":"2023-10-06T11:05:44.376448+0000","last_fullsized":"2023-10-06T11:05:44.376448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:18.301774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:42.336346+0000","last_change":"2023-10-06T11:05:42.336346+0000","last_active":"2023-10-06T11:05:42.336346+0000","last_peered":"2023-10-06T11:05:42.336346+0000","last_clean":"2023-10-06T11:05:42.336346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:42.336346+0000","last_undegraded":"2023-10-06T11:05:42.336346+0000","last_fullsized":"2023-10-06T11:05:42.336346+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:42.336346+0000","last_change":"2023-10-06T11:05:42.336346+0000","last_active":"2023-10-06T11:05:42.336346+0000","last_peered":"2023-10-06T11:05:42.336346+0000","last_clean":"2023-10-06T11:05:42.336346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:42.336346+0000","last_undegraded":"2023-10-06T11:05:42.336346+0000","last_fullsized":"2023-10-06T11:05:42.336346+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.357364+0000","last_change":"2023-10-06T11:05:43.367123+0000","last_active":"2023-10-06T11:05:44.357364+0000","last_peered":"2023-10-06T11:05:44.357364+0000","last_clean":"2023-10-06T11:05:44.357364+0000","last_became_active":"2023-10-06T11:05:43.366861+0000","last_became_peered":"2023-10-06T11:05:43.366861+0000","last_unstale":"2023-10-06T11:05:44.357364+0000","last_undegraded":"2023-10-06T11:05:44.357364+0000","last_fullsized":"2023-10-06T11:05:44.357364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:32.863094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379794+0000","last_change":"2023-10-06T11:05:43.367084+0000","last_active":"2023-10-06T11:05:44.379794+0000","last_peered":"2023-10-06T11:05:44.379794+0000","last_clean":"2023-10-06T11:05:44.379794+0000","last_became_active":"2023-10-06T11:05:43.366813+0000","last_became_peered":"2023-10-06T11:05:43.366813+0000","last_unstale":"2023-10-06T11:05:44.379794+0000","last_undegraded":"2023-10-06T11:05:44.379794+0000","last_fullsized":"2023-10-06T11:05:44.379794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:27.003956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-06T11:05:38.457157+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:05:38.457157+0000","last_peered":"2023-10-06T11:05:38.457157+0000","last_clean":"2023-10-06T11:05:38.457157+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:05:38.457157+0000","last_undegraded":"2023-10-06T11:05:38.457157+0000","last_fullsized":"2023-10-06T11:05:38.457157+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380176+0000","last_change":"2023-10-06T11:05:44.371162+0000","last_active":"2023-10-06T11:05:44.380176+0000","last_peered":"2023-10-06T11:05:44.380176+0000","last_clean":"2023-10-06T11:05:44.380176+0000","last_became_active":"2023-10-06T11:05:44.370923+0000","last_became_peered":"2023-10-06T11:05:44.370923+0000","last_unstale":"2023-10-06T11:05:44.380176+0000","last_undegraded":"2023-10-06T11:05:44.380176+0000","last_fullsized":"2023-10-06T11:05:44.380176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:20.240548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.356434+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:05:44.356434+0000","last_peered":"2023-10-06T11:05:44.356434+0000","last_clean":"2023-10-06T11:05:44.356434+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:05:44.356434+0000","last_undegraded":"2023-10-06T11:05:44.356434+0000","last_fullsized":"2023-10-06T11:05:44.356434+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.353543+0000","last_change":"2023-10-06T11:05:43.365664+0000","last_active":"2023-10-06T11:05:44.353543+0000","last_peered":"2023-10-06T11:05:44.353543+0000","last_clean":"2023-10-06T11:05:44.353543+0000","last_became_active":"2023-10-06T11:05:43.365413+0000","last_became_peered":"2023-10-06T11:05:43.365413+0000","last_unstale":"2023-10-06T11:05:44.353543+0000","last_undegraded":"2023-10-06T11:05:44.353543+0000","last_fullsized":"2023-10-06T11:05:44.353543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:32.863094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-06T11:05:38.324621+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:05:38.324621+0000","last_peered":"2023-10-06T11:05:38.324621+0000","last_clean":"2023-10-06T11:05:38.324621+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:05:38.324621+0000","last_undegraded":"2023-10-06T11:05:38.324621+0000","last_fullsized":"2023-10-06T11:05:38.324621+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.366104+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:05:44.366104+0000","last_peered":"2023-10-06T11:05:44.366104+0000","last_clean":"2023-10-06T11:05:44.366104+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:05:44.366104+0000","last_undegraded":"2023-10-06T11:05:44.366104+0000","last_fullsized":"2023-10-06T11:05:44.366104+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.352615+0000","last_change":"2023-10-06T11:05:43.368370+0000","last_active":"2023-10-06T11:05:44.352615+0000","last_peered":"2023-10-06T11:05:44.352615+0000","last_clean":"2023-10-06T11:05:44.352615+0000","last_became_active":"2023-10-06T11:05:43.368103+0000","last_became_peered":"2023-10-06T11:05:43.368103+0000","last_unstale":"2023-10-06T11:05:44.352615+0000","last_undegraded":"2023-10-06T11:05:44.352615+0000","last_fullsized":"2023-10-06T11:05:44.352615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:24.903299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.372002+0000","last_change":"2023-10-06T11:05:44.369604+0000","last_active":"2023-10-06T11:05:44.372002+0000","last_peered":"2023-10-06T11:05:44.372002+0000","last_clean":"2023-10-06T11:05:44.372002+0000","last_became_active":"2023-10-06T11:05:44.368781+0000","last_became_peered":"2023-10-06T11:05:44.368781+0000","last_unstale":"2023-10-06T11:05:44.372002+0000","last_undegraded":"2023-10-06T11:05:44.372002+0000","last_fullsized":"2023-10-06T11:05:44.372002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:20.240548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.361406+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:05:44.361406+0000","last_peered":"2023-10-06T11:05:44.361406+0000","last_clean":"2023-10-06T11:05:44.361406+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:05:44.361406+0000","last_undegraded":"2023-10-06T11:05:44.361406+0000","last_fullsized":"2023-10-06T11:05:44.361406+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:42.336346+0000","last_change":"2023-10-06T11:05:42.336346+0000","last_active":"2023-10-06T11:05:42.336346+0000","last_peered":"2023-10-06T11:05:42.336346+0000","last_clean":"2023-10-06T11:05:42.336346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:42.336346+0000","last_undegraded":"2023-10-06T11:05:42.336346+0000","last_fullsized":"2023-10-06T11:05:42.336346+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.365682+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:05:44.365682+0000","last_peered":"2023-10-06T11:05:44.365682+0000","last_clean":"2023-10-06T11:05:44.365682+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:05:44.365682+0000","last_undegraded":"2023-10-06T11:05:44.365682+0000","last_fullsized":"2023-10-06T11:05:44.365682+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.355393+0000","last_change":"2023-10-06T11:05:43.364706+0000","last_active":"2023-10-06T11:05:44.355393+0000","last_peered":"2023-10-06T11:05:44.355393+0000","last_clean":"2023-10-06T11:05:44.355393+0000","last_became_active":"2023-10-06T11:05:43.364448+0000","last_became_peered":"2023-10-06T11:05:43.364448+0000","last_unstale":"2023-10-06T11:05:44.355393+0000","last_undegraded":"2023-10-06T11:05:44.355393+0000","last_fullsized":"2023-10-06T11:05:44.355393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:24.903299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.354685+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:05:44.354685+0000","last_peered":"2023-10-06T11:05:44.354685+0000","last_clean":"2023-10-06T11:05:44.354685+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:05:44.354685+0000","last_undegraded":"2023-10-06T11:05:44.354685+0000","last_fullsized":"2023-10-06T11:05:44.354685+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:42.336346+0000","last_change":"2023-10-06T11:05:42.336346+0000","last_active":"2023-10-06T11:05:42.336346+0000","last_peered":"2023-10-06T11:05:42.336346+0000","last_clean":"2023-10-06T11:05:42.336346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:42.336346+0000","last_undegraded":"2023-10-06T11:05:42.336346+0000","last_fullsized":"2023-10-06T11:05:42.336346+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-06T11:05:38.420867+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:05:38.420867+0000","last_peered":"2023-10-06T11:05:38.420867+0000","last_clean":"2023-10-06T11:05:38.420867+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:05:38.420867+0000","last_undegraded":"2023-10-06T11:05:38.420867+0000","last_fullsized":"2023-10-06T11:05:38.420867+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:42.336346+0000","last_change":"2023-10-06T11:05:42.336346+0000","last_active":"2023-10-06T11:05:42.336346+0000","last_peered":"2023-10-06T11:05:42.336346+0000","last_clean":"2023-10-06T11:05:42.336346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:42.336346+0000","last_undegraded":"2023-10-06T11:05:42.336346+0000","last_fullsized":"2023-10-06T11:05:42.336346+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377441+0000","last_change":"2023-10-06T11:05:44.374324+0000","last_active":"2023-10-06T11:05:44.377441+0000","last_peered":"2023-10-06T11:05:44.377441+0000","last_clean":"2023-10-06T11:05:44.377441+0000","last_became_active":"2023-10-06T11:05:44.374070+0000","last_became_peered":"2023-10-06T11:05:44.374070+0000","last_unstale":"2023-10-06T11:05:44.377441+0000","last_undegraded":"2023-10-06T11:05:44.377441+0000","last_fullsized":"2023-10-06T11:05:44.377441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:49:53.929590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-06T11:05:38.323501+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:05:38.323501+0000","last_peered":"2023-10-06T11:05:38.323501+0000","last_clean":"2023-10-06T11:05:38.323501+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:05:38.323501+0000","last_undegraded":"2023-10-06T11:05:38.323501+0000","last_fullsized":"2023-10-06T11:05:38.323501+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.356747+0000","last_change":"2023-10-06T11:05:43.364980+0000","last_active":"2023-10-06T11:05:44.356747+0000","last_peered":"2023-10-06T11:05:44.356747+0000","last_clean":"2023-10-06T11:05:44.356747+0000","last_became_active":"2023-10-06T11:05:43.364661+0000","last_became_peered":"2023-10-06T11:05:43.364661+0000","last_unstale":"2023-10-06T11:05:44.356747+0000","last_undegraded":"2023-10-06T11:05:44.356747+0000","last_fullsized":"2023-10-06T11:05:44.356747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:32.863094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377355+0000","last_change":"2023-10-06T11:05:43.368448+0000","last_active":"2023-10-06T11:05:44.377355+0000","last_peered":"2023-10-06T11:05:44.377355+0000","last_clean":"2023-10-06T11:05:44.377355+0000","last_became_active":"2023-10-06T11:05:43.367859+0000","last_became_peered":"2023-10-06T11:05:43.367859+0000","last_unstale":"2023-10-06T11:05:44.377355+0000","last_undegraded":"2023-10-06T11:05:44.377355+0000","last_fullsized":"2023-10-06T11:05:44.377355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:18.301774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375383+0000","last_change":"2023-10-06T11:05:44.369211+0000","last_active":"2023-10-06T11:05:44.375383+0000","last_peered":"2023-10-06T11:05:44.375383+0000","last_clean":"2023-10-06T11:05:44.375383+0000","last_became_active":"2023-10-06T11:05:44.368950+0000","last_became_peered":"2023-10-06T11:05:44.368950+0000","last_unstale":"2023-10-06T11:05:44.375383+0000","last_undegraded":"2023-10-06T11:05:44.375383+0000","last_fullsized":"2023-10-06T11:05:44.375383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:01.484408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377607+0000","last_change":"2023-10-06T11:05:43.365792+0000","last_active":"2023-10-06T11:05:44.377607+0000","last_peered":"2023-10-06T11:05:44.377607+0000","last_clean":"2023-10-06T11:05:44.377607+0000","last_became_active":"2023-10-06T11:05:43.365137+0000","last_became_peered":"2023-10-06T11:05:43.365137+0000","last_unstale":"2023-10-06T11:05:44.377607+0000","last_undegraded":"2023-10-06T11:05:44.377607+0000","last_fullsized":"2023-10-06T11:05:44.377607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:24.903299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377828+0000","last_change":"2023-10-06T11:05:43.367620+0000","last_active":"2023-10-06T11:05:44.377828+0000","last_peered":"2023-10-06T11:05:44.377828+0000","last_clean":"2023-10-06T11:05:44.377828+0000","last_became_active":"2023-10-06T11:05:43.367335+0000","last_became_peered":"2023-10-06T11:05:43.367335+0000","last_unstale":"2023-10-06T11:05:44.377828+0000","last_undegraded":"2023-10-06T11:05:44.377828+0000","last_fullsized":"2023-10-06T11:05:44.377828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:18.301774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375170+0000","last_change":"2023-10-06T11:05:43.362124+0000","last_active":"2023-10-06T11:05:44.375170+0000","last_peered":"2023-10-06T11:05:44.375170+0000","last_clean":"2023-10-06T11:05:44.375170+0000","last_became_active":"2023-10-06T11:05:43.361847+0000","last_became_peered":"2023-10-06T11:05:43.361847+0000","last_unstale":"2023-10-06T11:05:44.375170+0000","last_undegraded":"2023-10-06T11:05:44.375170+0000","last_fullsized":"2023-10-06T11:05:44.375170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:36.907530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.373157+0000","last_change":"2023-10-06T11:05:44.367010+0000","last_active":"2023-10-06T11:05:44.373157+0000","last_peered":"2023-10-06T11:05:44.373157+0000","last_clean":"2023-10-06T11:05:44.373157+0000","last_became_active":"2023-10-06T11:05:44.366748+0000","last_became_peered":"2023-10-06T11:05:44.366748+0000","last_unstale":"2023-10-06T11:05:44.373157+0000","last_undegraded":"2023-10-06T11:05:44.373157+0000","last_fullsized":"2023-10-06T11:05:44.373157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:32:17.346227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380717+0000","last_change":"2023-10-06T11:05:43.367936+0000","last_active":"2023-10-06T11:05:44.380717+0000","last_peered":"2023-10-06T11:05:44.380717+0000","last_clean":"2023-10-06T11:05:44.380717+0000","last_became_active":"2023-10-06T11:05:43.367668+0000","last_became_peered":"2023-10-06T11:05:43.367668+0000","last_unstale":"2023-10-06T11:05:44.380717+0000","last_undegraded":"2023-10-06T11:05:44.380717+0000","last_fullsized":"2023-10-06T11:05:44.380717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:20:04.789716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379549+0000","last_change":"2023-10-06T11:05:44.373040+0000","last_active":"2023-10-06T11:05:44.379549+0000","last_peered":"2023-10-06T11:05:44.379549+0000","last_clean":"2023-10-06T11:05:44.379549+0000","last_became_active":"2023-10-06T11:05:44.370543+0000","last_became_peered":"2023-10-06T11:05:44.370543+0000","last_unstale":"2023-10-06T11:05:44.379549+0000","last_undegraded":"2023-10-06T11:05:44.379549+0000","last_fullsized":"2023-10-06T11:05:44.379549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:30:10.233024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379174+0000","last_change":"2023-10-06T11:05:44.372135+0000","last_active":"2023-10-06T11:05:44.379174+0000","last_peered":"2023-10-06T11:05:44.379174+0000","last_clean":"2023-10-06T11:05:44.379174+0000","last_became_active":"2023-10-06T11:05:44.371609+0000","last_became_peered":"2023-10-06T11:05:44.371609+0000","last_unstale":"2023-10-06T11:05:44.379174+0000","last_undegraded":"2023-10-06T11:05:44.379174+0000","last_fullsized":"2023-10-06T11:05:44.379174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:48:35.935962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":70,"acting":70,"num_store_stats":5},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":770,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23,"ondisk_log_size":23,"up":46,"acting":46,"num_store_stats":5},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298096,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073744,"statfs":{"total":96636764160,"available":96331513856,"internally_reserved":0,"allocated":827392,"data_stored":666304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297436,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074404,"statfs":{"total":96636764160,"available":96332189696,"internally_reserved":0,"allocated":151552,"data_stored":46308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298148,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073692,"statfs":{"total":96636764160,"available":96331460608,"internally_reserved":0,"allocated":749568,"data_stored":638029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":73385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297484,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074356,"statfs":{"total":96636764160,"available":96332140544,"internally_reserved":0,"allocated":200704,"data_stored":72831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":72921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297440,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074400,"statfs":{"total":96636764160,"available":96332185600,"internally_reserved":0,"allocated":155648,"data_stored":47661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":74808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:05:48.789 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:05:48.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.935+0000 7fca2fa0c700 1 Processor -- start 2023-10-06T11:05:48.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.935+0000 7fca2fa0c700 1 -- start start 2023-10-06T11:05:48.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.935+0000 7fca2fa0c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fca28153e80 0x7fca2815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:48.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.935+0000 7fca2fa0c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca2815ac30 con 0x7fca28068ba0 2023-10-06T11:05:48.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.935+0000 7fca2fa0c700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca280b4510 con 0x7fca28153ab0 2023-10-06T11:05:48.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.935+0000 7fca2fa0c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca280b6530 con 0x7fca28153e80 2023-10-06T11:05:48.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.936+0000 7fca2cfa7700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fca28068ba0 0x7fca280b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33872/0 (socket says 172.21.15.146:33872) 2023-10-06T11:05:48.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.936+0000 7fca2cfa7700 1 -- 172.21.15.146:0/4191957210 learned_addr learned my addr 172.21.15.146:0/4191957210 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:05:48.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.936+0000 7fca2dfa9700 1 --2- 172.21.15.146:0/4191957210 >> v2:172.21.15.146:3300/0 conn(0x7fca28153e80 0x7fca2815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:48.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.936+0000 7fca1ffff700 1 -- 172.21.15.146:0/4191957210 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2631846418 0 0) 0x7fca18001110 con 0x7fca28068ba0 2023-10-06T11:05:48.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.936+0000 7fca1ffff700 1 -- 172.21.15.146:0/4191957210 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca14003570 con 0x7fca28068ba0 2023-10-06T11:05:48.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.936+0000 7fca2dfa9700 1 -- 172.21.15.146:0/4191957210 >> v1:172.21.15.151:6789/0 conn(0x7fca28153ab0 legacy=0x7fca28068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:48.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.936+0000 7fca1ffff700 1 -- 172.21.15.146:0/4191957210 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3989565663 0 0) 0x7fca280b4510 con 0x7fca28153ab0 2023-10-06T11:05:48.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.936+0000 7fca2dfa9700 1 -- 172.21.15.146:0/4191957210 >> v1:172.21.15.146:6789/0 conn(0x7fca28068ba0 legacy=0x7fca280b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:48.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.936+0000 7fca2dfa9700 1 -- 172.21.15.146:0/4191957210 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca280b5c50 con 0x7fca28153e80 2023-10-06T11:05:48.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.936+0000 7fca2dfa9700 1 --2- 172.21.15.146:0/4191957210 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca28153e80 0x7fca2815a6f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fca20009e60 tx=0x7fca20009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f13233cc69086828 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:48.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.936+0000 7fca1ffff700 1 -- 172.21.15.146:0/4191957210 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2000e070 con 0x7fca28153e80 2023-10-06T11:05:48.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.936+0000 7fca1ffff700 1 -- 172.21.15.146:0/4191957210 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2000bb60 con 0x7fca28153e80 2023-10-06T11:05:48.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.936+0000 7fca1ffff700 1 -- 172.21.15.146:0/4191957210 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca20012430 con 0x7fca28153e80 2023-10-06T11:05:48.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.937+0000 7fca2fa0c700 1 -- 172.21.15.146:0/4191957210 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca28153e80 msgr2=0x7fca2815a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:48.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.937+0000 7fca2fa0c700 1 --2- 172.21.15.146:0/4191957210 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca28153e80 0x7fca2815a6f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fca20009e60 tx=0x7fca20009780 comp rx=0 tx=0).stop 2023-10-06T11:05:48.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.937+0000 7fca2fa0c700 1 -- 172.21.15.146:0/4191957210 shutdown_connections 2023-10-06T11:05:48.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.937+0000 7fca2fa0c700 1 --2- 172.21.15.146:0/4191957210 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca28153e80 0x7fca2815a6f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:48.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.937+0000 7fca2fa0c700 1 -- 172.21.15.146:0/4191957210 >> 172.21.15.146:0/4191957210 conn(0x7fca2806eba0 msgr2=0x7fca2806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:48.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.937+0000 7fca2fa0c700 1 -- 172.21.15.146:0/4191957210 shutdown_connections 2023-10-06T11:05:48.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.937+0000 7fca2fa0c700 1 -- 172.21.15.146:0/4191957210 wait complete. 2023-10-06T11:05:48.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.938+0000 7fca2fa0c700 1 Processor -- start 2023-10-06T11:05:48.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.938+0000 7fca2fa0c700 1 -- start start 2023-10-06T11:05:48.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.939+0000 7fca2fa0c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca28068ba0 0x7fca2814a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:48.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.939+0000 7fca2fa0c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca28153ab0 0x7fca2816a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:48.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.939+0000 7fca2fa0c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca28153e80 0x7fca2814c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:48.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.939+0000 7fca2fa0c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca280b0570 con 0x7fca28068ba0 2023-10-06T11:05:48.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.939+0000 7fca2fa0c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2816acc0 con 0x7fca28153ab0 2023-10-06T11:05:48.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.939+0000 7fca2fa0c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca280aff60 con 0x7fca28153e80 2023-10-06T11:05:48.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.939+0000 7fca2d7a8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca28068ba0 0x7fca2814a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:48.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.939+0000 7fca2d7a8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca28068ba0 0x7fca2814a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42188/0 (socket says 172.21.15.146:42188) 2023-10-06T11:05:48.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.939+0000 7fca2d7a8700 1 -- 172.21.15.146:0/2625467764 learned_addr learned my addr 172.21.15.146:0/2625467764 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:48.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.939+0000 7fca2cfa7700 1 --2- 172.21.15.146:0/2625467764 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca28153ab0 0x7fca2816a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:48.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.939+0000 7fca2dfa9700 1 --2- 172.21.15.146:0/2625467764 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca28153e80 0x7fca2814c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:48.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.939+0000 7fca2d7a8700 1 -- 172.21.15.146:0/2625467764 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca28153e80 msgr2=0x7fca2814c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:48.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.939+0000 7fca2d7a8700 1 --2- 172.21.15.146:0/2625467764 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca28153e80 0x7fca2814c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:48.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.939+0000 7fca2d7a8700 1 -- 172.21.15.146:0/2625467764 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca28153ab0 msgr2=0x7fca2816a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:48.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.939+0000 7fca2d7a8700 1 --2- 172.21.15.146:0/2625467764 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca28153ab0 0x7fca2816a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:48.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.939+0000 7fca2d7a8700 1 -- 172.21.15.146:0/2625467764 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca20009a20 con 0x7fca28068ba0 2023-10-06T11:05:48.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.939+0000 7fca2dfa9700 1 --2- 172.21.15.146:0/2625467764 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca28153e80 0x7fca2814c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:05:48.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.939+0000 7fca2d7a8700 1 --2- 172.21.15.146:0/2625467764 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca28068ba0 0x7fca2814a690 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fca2400c7c0 tx=0x7fca24007da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:48.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.940+0000 7fca1d7fa700 1 -- 172.21.15.146:0/2625467764 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca24011590 con 0x7fca28068ba0 2023-10-06T11:05:48.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.940+0000 7fca1d7fa700 1 -- 172.21.15.146:0/2625467764 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca24011710 con 0x7fca28068ba0 2023-10-06T11:05:48.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.940+0000 7fca2fa0c700 1 -- 172.21.15.146:0/2625467764 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca280b29b0 con 0x7fca28068ba0 2023-10-06T11:05:48.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.940+0000 7fca1d7fa700 1 -- 172.21.15.146:0/2625467764 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca24011ad0 con 0x7fca28068ba0 2023-10-06T11:05:48.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.940+0000 7fca2fa0c700 1 -- 172.21.15.146:0/2625467764 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca280b20a0 con 0x7fca28068ba0 2023-10-06T11:05:48.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.940+0000 7fca2fa0c700 1 -- 172.21.15.146:0/2625467764 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca2804c380 con 0x7fca28068ba0 2023-10-06T11:05:48.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.941+0000 7fca1d7fa700 1 -- 172.21.15.146:0/2625467764 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fca2401b3b0 con 0x7fca28068ba0 2023-10-06T11:05:48.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.941+0000 7fca1d7fa700 1 --2- 172.21.15.146:0/2625467764 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fca0c066f30 0x7fca0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:48.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.941+0000 7fca1d7fa700 1 -- 172.21.15.146:0/2625467764 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fca24083b90 con 0x7fca28068ba0 2023-10-06T11:05:48.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.941+0000 7fca2cfa7700 1 --2- 172.21.15.146:0/2625467764 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fca0c066f30 0x7fca0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:48.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.942+0000 7fca2cfa7700 1 --2- 172.21.15.146:0/2625467764 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fca0c066f30 0x7fca0c0693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fca18007fd0 tx=0x7fca18000bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:48.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:48.946+0000 7fca1d7fa700 1 -- 172.21.15.146:0/2625467764 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca24050ca0 con 0x7fca28068ba0 2023-10-06T11:05:49.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.124+0000 7fca2fa0c700 1 -- 172.21.15.146:0/2625467764 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fca280b06b0 con 0x7fca0c066f30 2023-10-06T11:05:49.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.131+0000 7fca1d7fa700 1 -- 172.21.15.146:0/2625467764 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281094 (secure 0 0 0) 0x7fca180059c0 con 0x7fca0c066f30 2023-10-06T11:05:49.136 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:05:49.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.135+0000 7fca2fa0c700 1 -- 172.21.15.146:0/2625467764 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fca0c066f30 msgr2=0x7fca0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:49.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.135+0000 7fca2fa0c700 1 --2- 172.21.15.146:0/2625467764 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fca0c066f30 0x7fca0c0693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fca18007fd0 tx=0x7fca18000bc0 comp rx=0 tx=0).stop 2023-10-06T11:05:49.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.135+0000 7fca2fa0c700 1 -- 172.21.15.146:0/2625467764 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca28068ba0 msgr2=0x7fca2814a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:49.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.135+0000 7fca2fa0c700 1 --2- 172.21.15.146:0/2625467764 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca28068ba0 0x7fca2814a690 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fca2400c7c0 tx=0x7fca24007da0 comp rx=0 tx=0).stop 2023-10-06T11:05:49.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.135+0000 7fca2fa0c700 1 -- 172.21.15.146:0/2625467764 shutdown_connections 2023-10-06T11:05:49.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.135+0000 7fca2fa0c700 1 --2- 172.21.15.146:0/2625467764 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fca0c066f30 0x7fca0c0693e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:49.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.135+0000 7fca2fa0c700 1 --2- 172.21.15.146:0/2625467764 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca28153e80 0x7fca2814c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:49.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.135+0000 7fca2fa0c700 1 --2- 172.21.15.146:0/2625467764 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca28068ba0 0x7fca2814a690 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:49.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.135+0000 7fca2fa0c700 1 --2- 172.21.15.146:0/2625467764 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca28153ab0 0x7fca2816a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:49.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.135+0000 7fca2fa0c700 1 -- 172.21.15.146:0/2625467764 >> 172.21.15.146:0/2625467764 conn(0x7fca2806eba0 msgr2=0x7fca28151d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:49.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.135+0000 7fca2fa0c700 1 -- 172.21.15.146:0/2625467764 shutdown_connections 2023-10-06T11:05:49.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.135+0000 7fca2fa0c700 1 -- 172.21.15.146:0/2625467764 wait complete. 2023-10-06T11:05:49.140 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:05:49.151 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-10-06T11:05:47.128743+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591138,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":185,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":134,"acting":134,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":41,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381076,"kb_used_data":2644,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593644,"statfs":{"total":773094113280,"available":770655891456,"internally_reserved":0,"allocated":2707456,"data_stored":1692247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":770,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.784559"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.376223+0000","last_change":"2023-10-06T11:05:44.374095+0000","last_active":"2023-10-06T11:05:44.376223+0000","last_peered":"2023-10-06T11:05:44.376223+0000","last_clean":"2023-10-06T11:05:44.376223+0000","last_became_active":"2023-10-06T11:05:44.373839+0000","last_became_peered":"2023-10-06T11:05:44.373839+0000","last_unstale":"2023-10-06T11:05:44.376223+0000","last_undegraded":"2023-10-06T11:05:44.376223+0000","last_fullsized":"2023-10-06T11:05:44.376223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:25.910038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380398+0000","last_change":"2023-10-06T11:05:44.372580+0000","last_active":"2023-10-06T11:05:44.380398+0000","last_peered":"2023-10-06T11:05:44.380398+0000","last_clean":"2023-10-06T11:05:44.380398+0000","last_became_active":"2023-10-06T11:05:44.372338+0000","last_became_peered":"2023-10-06T11:05:44.372338+0000","last_unstale":"2023-10-06T11:05:44.380398+0000","last_undegraded":"2023-10-06T11:05:44.380398+0000","last_fullsized":"2023-10-06T11:05:44.380398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:49:53.929590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.370764+0000","last_change":"2023-10-06T11:05:44.368424+0000","last_active":"2023-10-06T11:05:44.370764+0000","last_peered":"2023-10-06T11:05:44.370764+0000","last_clean":"2023-10-06T11:05:44.370764+0000","last_became_active":"2023-10-06T11:05:44.368174+0000","last_became_peered":"2023-10-06T11:05:44.368174+0000","last_unstale":"2023-10-06T11:05:44.370764+0000","last_undegraded":"2023-10-06T11:05:44.370764+0000","last_fullsized":"2023-10-06T11:05:44.370764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:48.500150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.381050+0000","last_change":"2023-10-06T11:05:44.376045+0000","last_active":"2023-10-06T11:05:44.381050+0000","last_peered":"2023-10-06T11:05:44.381050+0000","last_clean":"2023-10-06T11:05:44.381050+0000","last_became_active":"2023-10-06T11:05:44.374697+0000","last_became_peered":"2023-10-06T11:05:44.374697+0000","last_unstale":"2023-10-06T11:05:44.381050+0000","last_undegraded":"2023-10-06T11:05:44.381050+0000","last_fullsized":"2023-10-06T11:05:44.381050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:30:10.233024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377816+0000","last_change":"2023-10-06T11:05:44.370424+0000","last_active":"2023-10-06T11:05:44.377816+0000","last_peered":"2023-10-06T11:05:44.377816+0000","last_clean":"2023-10-06T11:05:44.377816+0000","last_became_active":"2023-10-06T11:05:44.370141+0000","last_became_peered":"2023-10-06T11:05:44.370141+0000","last_unstale":"2023-10-06T11:05:44.377816+0000","last_undegraded":"2023-10-06T11:05:44.377816+0000","last_fullsized":"2023-10-06T11:05:44.377816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:32:17.346227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.374345+0000","last_change":"2023-10-06T11:05:44.370535+0000","last_active":"2023-10-06T11:05:44.374345+0000","last_peered":"2023-10-06T11:05:44.374345+0000","last_clean":"2023-10-06T11:05:44.374345+0000","last_became_active":"2023-10-06T11:05:44.370264+0000","last_became_peered":"2023-10-06T11:05:44.370264+0000","last_unstale":"2023-10-06T11:05:44.374345+0000","last_undegraded":"2023-10-06T11:05:44.374345+0000","last_fullsized":"2023-10-06T11:05:44.374345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:18:11.738273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377689+0000","last_change":"2023-10-06T11:05:44.363111+0000","last_active":"2023-10-06T11:05:44.377689+0000","last_peered":"2023-10-06T11:05:44.377689+0000","last_clean":"2023-10-06T11:05:44.377689+0000","last_became_active":"2023-10-06T11:05:44.362803+0000","last_became_peered":"2023-10-06T11:05:44.362803+0000","last_unstale":"2023-10-06T11:05:44.377689+0000","last_undegraded":"2023-10-06T11:05:44.377689+0000","last_fullsized":"2023-10-06T11:05:44.377689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:49:41.512642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.365243+0000","last_change":"2023-10-06T11:05:44.362523+0000","last_active":"2023-10-06T11:05:44.365243+0000","last_peered":"2023-10-06T11:05:44.365243+0000","last_clean":"2023-10-06T11:05:44.365243+0000","last_became_active":"2023-10-06T11:05:44.362248+0000","last_became_peered":"2023-10-06T11:05:44.362248+0000","last_unstale":"2023-10-06T11:05:44.365243+0000","last_undegraded":"2023-10-06T11:05:44.365243+0000","last_fullsized":"2023-10-06T11:05:44.365243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:33.869834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.376261+0000","last_change":"2023-10-06T11:05:44.373706+0000","last_active":"2023-10-06T11:05:44.376261+0000","last_peered":"2023-10-06T11:05:44.376261+0000","last_clean":"2023-10-06T11:05:44.376261+0000","last_became_active":"2023-10-06T11:05:44.373408+0000","last_became_peered":"2023-10-06T11:05:44.373408+0000","last_unstale":"2023-10-06T11:05:44.376261+0000","last_undegraded":"2023-10-06T11:05:44.376261+0000","last_fullsized":"2023-10-06T11:05:44.376261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:28.010695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377714+0000","last_change":"2023-10-06T11:05:44.364121+0000","last_active":"2023-10-06T11:05:44.377714+0000","last_peered":"2023-10-06T11:05:44.377714+0000","last_clean":"2023-10-06T11:05:44.377714+0000","last_became_active":"2023-10-06T11:05:44.363863+0000","last_became_peered":"2023-10-06T11:05:44.363863+0000","last_unstale":"2023-10-06T11:05:44.377714+0000","last_undegraded":"2023-10-06T11:05:44.377714+0000","last_fullsized":"2023-10-06T11:05:44.377714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:51.490766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.381068+0000","last_change":"2023-10-06T11:05:44.376146+0000","last_active":"2023-10-06T11:05:44.381068+0000","last_peered":"2023-10-06T11:05:44.381068+0000","last_clean":"2023-10-06T11:05:44.381068+0000","last_became_active":"2023-10-06T11:05:44.375877+0000","last_became_peered":"2023-10-06T11:05:44.375877+0000","last_unstale":"2023-10-06T11:05:44.381068+0000","last_undegraded":"2023-10-06T11:05:44.381068+0000","last_fullsized":"2023-10-06T11:05:44.381068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:25:37.173612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377465+0000","last_change":"2023-10-06T11:05:44.374262+0000","last_active":"2023-10-06T11:05:44.377465+0000","last_peered":"2023-10-06T11:05:44.377465+0000","last_clean":"2023-10-06T11:05:44.377465+0000","last_became_active":"2023-10-06T11:05:44.373997+0000","last_became_peered":"2023-10-06T11:05:44.373997+0000","last_unstale":"2023-10-06T11:05:44.377465+0000","last_undegraded":"2023-10-06T11:05:44.377465+0000","last_fullsized":"2023-10-06T11:05:44.377465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:30:10.233024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377738+0000","last_change":"2023-10-06T11:05:44.376536+0000","last_active":"2023-10-06T11:05:44.377738+0000","last_peered":"2023-10-06T11:05:44.377738+0000","last_clean":"2023-10-06T11:05:44.377738+0000","last_became_active":"2023-10-06T11:05:44.376291+0000","last_became_peered":"2023-10-06T11:05:44.376291+0000","last_unstale":"2023-10-06T11:05:44.377738+0000","last_undegraded":"2023-10-06T11:05:44.377738+0000","last_fullsized":"2023-10-06T11:05:44.377738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:19.308513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380978+0000","last_change":"2023-10-06T11:05:44.373773+0000","last_active":"2023-10-06T11:05:44.380978+0000","last_peered":"2023-10-06T11:05:44.380978+0000","last_clean":"2023-10-06T11:05:44.380978+0000","last_became_active":"2023-10-06T11:05:44.373445+0000","last_became_peered":"2023-10-06T11:05:44.373445+0000","last_unstale":"2023-10-06T11:05:44.380978+0000","last_undegraded":"2023-10-06T11:05:44.380978+0000","last_fullsized":"2023-10-06T11:05:44.380978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:48.500150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.370569+0000","last_change":"2023-10-06T11:05:44.365767+0000","last_active":"2023-10-06T11:05:44.370569+0000","last_peered":"2023-10-06T11:05:44.370569+0000","last_clean":"2023-10-06T11:05:44.370569+0000","last_became_active":"2023-10-06T11:05:44.365489+0000","last_became_peered":"2023-10-06T11:05:44.365489+0000","last_unstale":"2023-10-06T11:05:44.370569+0000","last_undegraded":"2023-10-06T11:05:44.370569+0000","last_fullsized":"2023-10-06T11:05:44.370569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:36:18.739157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379611+0000","last_change":"2023-10-06T11:05:44.373554+0000","last_active":"2023-10-06T11:05:44.379611+0000","last_peered":"2023-10-06T11:05:44.379611+0000","last_clean":"2023-10-06T11:05:44.379611+0000","last_became_active":"2023-10-06T11:05:44.373293+0000","last_became_peered":"2023-10-06T11:05:44.373293+0000","last_unstale":"2023-10-06T11:05:44.379611+0000","last_undegraded":"2023-10-06T11:05:44.379611+0000","last_fullsized":"2023-10-06T11:05:44.379611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:32:31.703547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380998+0000","last_change":"2023-10-06T11:05:44.373832+0000","last_active":"2023-10-06T11:05:44.380998+0000","last_peered":"2023-10-06T11:05:44.380998+0000","last_clean":"2023-10-06T11:05:44.380998+0000","last_became_active":"2023-10-06T11:05:44.373527+0000","last_became_peered":"2023-10-06T11:05:44.373527+0000","last_unstale":"2023-10-06T11:05:44.380998+0000","last_undegraded":"2023-10-06T11:05:44.380998+0000","last_fullsized":"2023-10-06T11:05:44.380998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:49:53.929590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380422+0000","last_change":"2023-10-06T11:05:44.372985+0000","last_active":"2023-10-06T11:05:44.380422+0000","last_peered":"2023-10-06T11:05:44.380422+0000","last_clean":"2023-10-06T11:05:44.380422+0000","last_became_active":"2023-10-06T11:05:44.372531+0000","last_became_peered":"2023-10-06T11:05:44.372531+0000","last_unstale":"2023-10-06T11:05:44.380422+0000","last_undegraded":"2023-10-06T11:05:44.380422+0000","last_fullsized":"2023-10-06T11:05:44.380422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:36:26.414372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:42.336346+0000","last_change":"2023-10-06T11:05:42.336346+0000","last_active":"2023-10-06T11:05:42.336346+0000","last_peered":"2023-10-06T11:05:42.336346+0000","last_clean":"2023-10-06T11:05:42.336346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:42.336346+0000","last_undegraded":"2023-10-06T11:05:42.336346+0000","last_fullsized":"2023-10-06T11:05:42.336346+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.370597+0000","last_change":"2023-10-06T11:05:44.367477+0000","last_active":"2023-10-06T11:05:44.370597+0000","last_peered":"2023-10-06T11:05:44.370597+0000","last_clean":"2023-10-06T11:05:44.370597+0000","last_became_active":"2023-10-06T11:05:44.367216+0000","last_became_peered":"2023-10-06T11:05:44.367216+0000","last_unstale":"2023-10-06T11:05:44.370597+0000","last_undegraded":"2023-10-06T11:05:44.370597+0000","last_fullsized":"2023-10-06T11:05:44.370597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:48.500150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:42.336346+0000","last_change":"2023-10-06T11:05:42.336346+0000","last_active":"2023-10-06T11:05:42.336346+0000","last_peered":"2023-10-06T11:05:42.336346+0000","last_clean":"2023-10-06T11:05:42.336346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:42.336346+0000","last_undegraded":"2023-10-06T11:05:42.336346+0000","last_fullsized":"2023-10-06T11:05:42.336346+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.370930+0000","last_change":"2023-10-06T11:05:44.367950+0000","last_active":"2023-10-06T11:05:44.370930+0000","last_peered":"2023-10-06T11:05:44.370930+0000","last_clean":"2023-10-06T11:05:44.370930+0000","last_became_active":"2023-10-06T11:05:44.367682+0000","last_became_peered":"2023-10-06T11:05:44.367682+0000","last_unstale":"2023-10-06T11:05:44.370930+0000","last_undegraded":"2023-10-06T11:05:44.370930+0000","last_fullsized":"2023-10-06T11:05:44.370930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:53:21.828799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.356971+0000","last_change":"2023-10-06T11:05:43.366406+0000","last_active":"2023-10-06T11:05:44.356971+0000","last_peered":"2023-10-06T11:05:44.356971+0000","last_clean":"2023-10-06T11:05:44.356971+0000","last_became_active":"2023-10-06T11:05:43.366004+0000","last_became_peered":"2023-10-06T11:05:43.366004+0000","last_unstale":"2023-10-06T11:05:44.356971+0000","last_undegraded":"2023-10-06T11:05:44.356971+0000","last_fullsized":"2023-10-06T11:05:44.356971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:00.477669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.353362+0000","last_change":"2023-10-06T11:05:43.362935+0000","last_active":"2023-10-06T11:05:44.353362+0000","last_peered":"2023-10-06T11:05:44.353362+0000","last_clean":"2023-10-06T11:05:44.353362+0000","last_became_active":"2023-10-06T11:05:43.362642+0000","last_became_peered":"2023-10-06T11:05:43.362642+0000","last_unstale":"2023-10-06T11:05:44.353362+0000","last_undegraded":"2023-10-06T11:05:44.353362+0000","last_fullsized":"2023-10-06T11:05:44.353362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:36.907530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.371257+0000","last_change":"2023-10-06T11:05:44.366360+0000","last_active":"2023-10-06T11:05:44.371257+0000","last_peered":"2023-10-06T11:05:44.371257+0000","last_clean":"2023-10-06T11:05:44.371257+0000","last_became_active":"2023-10-06T11:05:44.366097+0000","last_became_peered":"2023-10-06T11:05:44.366097+0000","last_unstale":"2023-10-06T11:05:44.371257+0000","last_undegraded":"2023-10-06T11:05:44.371257+0000","last_fullsized":"2023-10-06T11:05:44.371257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:18:11.738273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.357158+0000","last_change":"2023-10-06T11:05:43.365582+0000","last_active":"2023-10-06T11:05:44.357158+0000","last_peered":"2023-10-06T11:05:44.357158+0000","last_clean":"2023-10-06T11:05:44.357158+0000","last_became_active":"2023-10-06T11:05:43.365197+0000","last_became_peered":"2023-10-06T11:05:43.365197+0000","last_unstale":"2023-10-06T11:05:44.357158+0000","last_undegraded":"2023-10-06T11:05:44.357158+0000","last_fullsized":"2023-10-06T11:05:44.357158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:59:28.141215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.373455+0000","last_change":"2023-10-06T11:05:44.369545+0000","last_active":"2023-10-06T11:05:44.373455+0000","last_peered":"2023-10-06T11:05:44.373455+0000","last_clean":"2023-10-06T11:05:44.373455+0000","last_became_active":"2023-10-06T11:05:44.369228+0000","last_became_peered":"2023-10-06T11:05:44.369228+0000","last_unstale":"2023-10-06T11:05:44.373455+0000","last_undegraded":"2023-10-06T11:05:44.373455+0000","last_fullsized":"2023-10-06T11:05:44.373455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:36:18.739157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.378674+0000","last_change":"2023-10-06T11:05:43.370700+0000","last_active":"2023-10-06T11:05:44.378674+0000","last_peered":"2023-10-06T11:05:44.378674+0000","last_clean":"2023-10-06T11:05:44.378674+0000","last_became_active":"2023-10-06T11:05:43.370418+0000","last_became_peered":"2023-10-06T11:05:43.370418+0000","last_unstale":"2023-10-06T11:05:44.378674+0000","last_undegraded":"2023-10-06T11:05:44.378674+0000","last_fullsized":"2023-10-06T11:05:44.378674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:03.585687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:42.336346+0000","last_change":"2023-10-06T11:05:42.336346+0000","last_active":"2023-10-06T11:05:42.336346+0000","last_peered":"2023-10-06T11:05:42.336346+0000","last_clean":"2023-10-06T11:05:42.336346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:42.336346+0000","last_undegraded":"2023-10-06T11:05:42.336346+0000","last_fullsized":"2023-10-06T11:05:42.336346+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.378534+0000","last_change":"2023-10-06T11:05:43.369646+0000","last_active":"2023-10-06T11:05:44.378534+0000","last_peered":"2023-10-06T11:05:44.378534+0000","last_clean":"2023-10-06T11:05:44.378534+0000","last_became_active":"2023-10-06T11:05:43.369353+0000","last_became_peered":"2023-10-06T11:05:43.369353+0000","last_unstale":"2023-10-06T11:05:44.378534+0000","last_undegraded":"2023-10-06T11:05:44.378534+0000","last_fullsized":"2023-10-06T11:05:44.378534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:50.484027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379530+0000","last_change":"2023-10-06T11:05:44.372738+0000","last_active":"2023-10-06T11:05:44.379530+0000","last_peered":"2023-10-06T11:05:44.379530+0000","last_clean":"2023-10-06T11:05:44.379530+0000","last_became_active":"2023-10-06T11:05:44.372299+0000","last_became_peered":"2023-10-06T11:05:44.372299+0000","last_unstale":"2023-10-06T11:05:44.379530+0000","last_undegraded":"2023-10-06T11:05:44.379530+0000","last_fullsized":"2023-10-06T11:05:44.379530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:53:21.828799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.352712+0000","last_change":"2023-10-06T11:05:43.364085+0000","last_active":"2023-10-06T11:05:44.352712+0000","last_peered":"2023-10-06T11:05:44.352712+0000","last_clean":"2023-10-06T11:05:44.352712+0000","last_became_active":"2023-10-06T11:05:43.363844+0000","last_became_peered":"2023-10-06T11:05:43.363844+0000","last_unstale":"2023-10-06T11:05:44.352712+0000","last_undegraded":"2023-10-06T11:05:44.352712+0000","last_fullsized":"2023-10-06T11:05:44.352712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:51.324615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380405+0000","last_change":"2023-10-06T11:05:44.372815+0000","last_active":"2023-10-06T11:05:44.380405+0000","last_peered":"2023-10-06T11:05:44.380405+0000","last_clean":"2023-10-06T11:05:44.380405+0000","last_became_active":"2023-10-06T11:05:44.372237+0000","last_became_peered":"2023-10-06T11:05:44.372237+0000","last_unstale":"2023-10-06T11:05:44.380405+0000","last_undegraded":"2023-10-06T11:05:44.380405+0000","last_fullsized":"2023-10-06T11:05:44.380405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:42.381985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.363864+0000","last_change":"2023-10-06T11:05:43.369142+0000","last_active":"2023-10-06T11:05:44.363864+0000","last_peered":"2023-10-06T11:05:44.363864+0000","last_clean":"2023-10-06T11:05:44.363864+0000","last_became_active":"2023-10-06T11:05:43.368847+0000","last_became_peered":"2023-10-06T11:05:43.368847+0000","last_unstale":"2023-10-06T11:05:44.363864+0000","last_undegraded":"2023-10-06T11:05:44.363864+0000","last_fullsized":"2023-10-06T11:05:44.363864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:48:23.698446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.373918+0000","last_change":"2023-10-06T11:05:44.370314+0000","last_active":"2023-10-06T11:05:44.373918+0000","last_peered":"2023-10-06T11:05:44.373918+0000","last_clean":"2023-10-06T11:05:44.373918+0000","last_became_active":"2023-10-06T11:05:44.370065+0000","last_became_peered":"2023-10-06T11:05:44.370065+0000","last_unstale":"2023-10-06T11:05:44.373918+0000","last_undegraded":"2023-10-06T11:05:44.373918+0000","last_fullsized":"2023-10-06T11:05:44.373918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:32:31.703547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:42.336346+0000","last_change":"2023-10-06T11:05:42.336346+0000","last_active":"2023-10-06T11:05:42.336346+0000","last_peered":"2023-10-06T11:05:42.336346+0000","last_clean":"2023-10-06T11:05:42.336346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:42.336346+0000","last_undegraded":"2023-10-06T11:05:42.336346+0000","last_fullsized":"2023-10-06T11:05:42.336346+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379857+0000","last_change":"2023-10-06T11:05:44.372870+0000","last_active":"2023-10-06T11:05:44.379857+0000","last_peered":"2023-10-06T11:05:44.379857+0000","last_clean":"2023-10-06T11:05:44.379857+0000","last_became_active":"2023-10-06T11:05:44.372480+0000","last_became_peered":"2023-10-06T11:05:44.372480+0000","last_unstale":"2023-10-06T11:05:44.379857+0000","last_undegraded":"2023-10-06T11:05:44.379857+0000","last_fullsized":"2023-10-06T11:05:44.379857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:25:37.173612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.378371+0000","last_change":"2023-10-06T11:05:43.369672+0000","last_active":"2023-10-06T11:05:44.378371+0000","last_peered":"2023-10-06T11:05:44.378371+0000","last_clean":"2023-10-06T11:05:44.378371+0000","last_became_active":"2023-10-06T11:05:43.369415+0000","last_became_peered":"2023-10-06T11:05:43.369415+0000","last_unstale":"2023-10-06T11:05:44.378371+0000","last_undegraded":"2023-10-06T11:05:44.378371+0000","last_fullsized":"2023-10-06T11:05:44.378371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:21:07.005347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.385017+0000","last_change":"2023-10-06T11:05:44.380100+0000","last_active":"2023-10-06T11:05:44.385017+0000","last_peered":"2023-10-06T11:05:44.385017+0000","last_clean":"2023-10-06T11:05:44.385017+0000","last_became_active":"2023-10-06T11:05:44.379686+0000","last_became_peered":"2023-10-06T11:05:44.379686+0000","last_unstale":"2023-10-06T11:05:44.385017+0000","last_undegraded":"2023-10-06T11:05:44.385017+0000","last_fullsized":"2023-10-06T11:05:44.385017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:32:31.703547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.378652+0000","last_change":"2023-10-06T11:05:43.369280+0000","last_active":"2023-10-06T11:05:44.378652+0000","last_peered":"2023-10-06T11:05:44.378652+0000","last_clean":"2023-10-06T11:05:44.378652+0000","last_became_active":"2023-10-06T11:05:43.369002+0000","last_became_peered":"2023-10-06T11:05:43.369002+0000","last_unstale":"2023-10-06T11:05:44.378652+0000","last_undegraded":"2023-10-06T11:05:44.378652+0000","last_fullsized":"2023-10-06T11:05:44.378652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:53:55.024707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.378605+0000","last_change":"2023-10-06T11:05:43.368847+0000","last_active":"2023-10-06T11:05:44.378605+0000","last_peered":"2023-10-06T11:05:44.378605+0000","last_clean":"2023-10-06T11:05:44.378605+0000","last_became_active":"2023-10-06T11:05:43.368394+0000","last_became_peered":"2023-10-06T11:05:43.368394+0000","last_unstale":"2023-10-06T11:05:44.378605+0000","last_undegraded":"2023-10-06T11:05:44.378605+0000","last_fullsized":"2023-10-06T11:05:44.378605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:26.238071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.354872+0000","last_change":"2023-10-06T11:05:43.368442+0000","last_active":"2023-10-06T11:05:44.354872+0000","last_peered":"2023-10-06T11:05:44.354872+0000","last_clean":"2023-10-06T11:05:44.354872+0000","last_became_active":"2023-10-06T11:05:43.368152+0000","last_became_peered":"2023-10-06T11:05:43.368152+0000","last_unstale":"2023-10-06T11:05:44.354872+0000","last_undegraded":"2023-10-06T11:05:44.354872+0000","last_fullsized":"2023-10-06T11:05:44.354872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:27.003956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.371685+0000","last_change":"2023-10-06T11:05:44.368980+0000","last_active":"2023-10-06T11:05:44.371685+0000","last_peered":"2023-10-06T11:05:44.371685+0000","last_clean":"2023-10-06T11:05:44.371685+0000","last_became_active":"2023-10-06T11:05:44.368693+0000","last_became_peered":"2023-10-06T11:05:44.368693+0000","last_unstale":"2023-10-06T11:05:44.371685+0000","last_undegraded":"2023-10-06T11:05:44.371685+0000","last_fullsized":"2023-10-06T11:05:44.371685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:25:37.173612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.376448+0000","last_change":"2023-10-06T11:05:43.366389+0000","last_active":"2023-10-06T11:05:44.376448+0000","last_peered":"2023-10-06T11:05:44.376448+0000","last_clean":"2023-10-06T11:05:44.376448+0000","last_became_active":"2023-10-06T11:05:43.366041+0000","last_became_peered":"2023-10-06T11:05:43.366041+0000","last_unstale":"2023-10-06T11:05:44.376448+0000","last_undegraded":"2023-10-06T11:05:44.376448+0000","last_fullsized":"2023-10-06T11:05:44.376448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:18.301774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:42.336346+0000","last_change":"2023-10-06T11:05:42.336346+0000","last_active":"2023-10-06T11:05:42.336346+0000","last_peered":"2023-10-06T11:05:42.336346+0000","last_clean":"2023-10-06T11:05:42.336346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:42.336346+0000","last_undegraded":"2023-10-06T11:05:42.336346+0000","last_fullsized":"2023-10-06T11:05:42.336346+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:42.336346+0000","last_change":"2023-10-06T11:05:42.336346+0000","last_active":"2023-10-06T11:05:42.336346+0000","last_peered":"2023-10-06T11:05:42.336346+0000","last_clean":"2023-10-06T11:05:42.336346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:42.336346+0000","last_undegraded":"2023-10-06T11:05:42.336346+0000","last_fullsized":"2023-10-06T11:05:42.336346+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.357364+0000","last_change":"2023-10-06T11:05:43.367123+0000","last_active":"2023-10-06T11:05:44.357364+0000","last_peered":"2023-10-06T11:05:44.357364+0000","last_clean":"2023-10-06T11:05:44.357364+0000","last_became_active":"2023-10-06T11:05:43.366861+0000","last_became_peered":"2023-10-06T11:05:43.366861+0000","last_unstale":"2023-10-06T11:05:44.357364+0000","last_undegraded":"2023-10-06T11:05:44.357364+0000","last_fullsized":"2023-10-06T11:05:44.357364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:32.863094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379794+0000","last_change":"2023-10-06T11:05:43.367084+0000","last_active":"2023-10-06T11:05:44.379794+0000","last_peered":"2023-10-06T11:05:44.379794+0000","last_clean":"2023-10-06T11:05:44.379794+0000","last_became_active":"2023-10-06T11:05:43.366813+0000","last_became_peered":"2023-10-06T11:05:43.366813+0000","last_unstale":"2023-10-06T11:05:44.379794+0000","last_undegraded":"2023-10-06T11:05:44.379794+0000","last_fullsized":"2023-10-06T11:05:44.379794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:27.003956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-06T11:05:38.457157+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:05:38.457157+0000","last_peered":"2023-10-06T11:05:38.457157+0000","last_clean":"2023-10-06T11:05:38.457157+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:05:38.457157+0000","last_undegraded":"2023-10-06T11:05:38.457157+0000","last_fullsized":"2023-10-06T11:05:38.457157+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380176+0000","last_change":"2023-10-06T11:05:44.371162+0000","last_active":"2023-10-06T11:05:44.380176+0000","last_peered":"2023-10-06T11:05:44.380176+0000","last_clean":"2023-10-06T11:05:44.380176+0000","last_became_active":"2023-10-06T11:05:44.370923+0000","last_became_peered":"2023-10-06T11:05:44.370923+0000","last_unstale":"2023-10-06T11:05:44.380176+0000","last_undegraded":"2023-10-06T11:05:44.380176+0000","last_fullsized":"2023-10-06T11:05:44.380176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:20.240548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.356434+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:05:44.356434+0000","last_peered":"2023-10-06T11:05:44.356434+0000","last_clean":"2023-10-06T11:05:44.356434+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:05:44.356434+0000","last_undegraded":"2023-10-06T11:05:44.356434+0000","last_fullsized":"2023-10-06T11:05:44.356434+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.353543+0000","last_change":"2023-10-06T11:05:43.365664+0000","last_active":"2023-10-06T11:05:44.353543+0000","last_peered":"2023-10-06T11:05:44.353543+0000","last_clean":"2023-10-06T11:05:44.353543+0000","last_became_active":"2023-10-06T11:05:43.365413+0000","last_became_peered":"2023-10-06T11:05:43.365413+0000","last_unstale":"2023-10-06T11:05:44.353543+0000","last_undegraded":"2023-10-06T11:05:44.353543+0000","last_fullsized":"2023-10-06T11:05:44.353543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:32.863094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-06T11:05:38.324621+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:05:38.324621+0000","last_peered":"2023-10-06T11:05:38.324621+0000","last_clean":"2023-10-06T11:05:38.324621+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:05:38.324621+0000","last_undegraded":"2023-10-06T11:05:38.324621+0000","last_fullsized":"2023-10-06T11:05:38.324621+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.366104+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:05:44.366104+0000","last_peered":"2023-10-06T11:05:44.366104+0000","last_clean":"2023-10-06T11:05:44.366104+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:05:44.366104+0000","last_undegraded":"2023-10-06T11:05:44.366104+0000","last_fullsized":"2023-10-06T11:05:44.366104+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.352615+0000","last_change":"2023-10-06T11:05:43.368370+0000","last_active":"2023-10-06T11:05:44.352615+0000","last_peered":"2023-10-06T11:05:44.352615+0000","last_clean":"2023-10-06T11:05:44.352615+0000","last_became_active":"2023-10-06T11:05:43.368103+0000","last_became_peered":"2023-10-06T11:05:43.368103+0000","last_unstale":"2023-10-06T11:05:44.352615+0000","last_undegraded":"2023-10-06T11:05:44.352615+0000","last_fullsized":"2023-10-06T11:05:44.352615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:24.903299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.372002+0000","last_change":"2023-10-06T11:05:44.369604+0000","last_active":"2023-10-06T11:05:44.372002+0000","last_peered":"2023-10-06T11:05:44.372002+0000","last_clean":"2023-10-06T11:05:44.372002+0000","last_became_active":"2023-10-06T11:05:44.368781+0000","last_became_peered":"2023-10-06T11:05:44.368781+0000","last_unstale":"2023-10-06T11:05:44.372002+0000","last_undegraded":"2023-10-06T11:05:44.372002+0000","last_fullsized":"2023-10-06T11:05:44.372002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:20.240548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.361406+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:05:44.361406+0000","last_peered":"2023-10-06T11:05:44.361406+0000","last_clean":"2023-10-06T11:05:44.361406+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:05:44.361406+0000","last_undegraded":"2023-10-06T11:05:44.361406+0000","last_fullsized":"2023-10-06T11:05:44.361406+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:42.336346+0000","last_change":"2023-10-06T11:05:42.336346+0000","last_active":"2023-10-06T11:05:42.336346+0000","last_peered":"2023-10-06T11:05:42.336346+0000","last_clean":"2023-10-06T11:05:42.336346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:42.336346+0000","last_undegraded":"2023-10-06T11:05:42.336346+0000","last_fullsized":"2023-10-06T11:05:42.336346+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.365682+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:05:44.365682+0000","last_peered":"2023-10-06T11:05:44.365682+0000","last_clean":"2023-10-06T11:05:44.365682+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:05:44.365682+0000","last_undegraded":"2023-10-06T11:05:44.365682+0000","last_fullsized":"2023-10-06T11:05:44.365682+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.355393+0000","last_change":"2023-10-06T11:05:43.364706+0000","last_active":"2023-10-06T11:05:44.355393+0000","last_peered":"2023-10-06T11:05:44.355393+0000","last_clean":"2023-10-06T11:05:44.355393+0000","last_became_active":"2023-10-06T11:05:43.364448+0000","last_became_peered":"2023-10-06T11:05:43.364448+0000","last_unstale":"2023-10-06T11:05:44.355393+0000","last_undegraded":"2023-10-06T11:05:44.355393+0000","last_fullsized":"2023-10-06T11:05:44.355393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:24.903299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.354685+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:05:44.354685+0000","last_peered":"2023-10-06T11:05:44.354685+0000","last_clean":"2023-10-06T11:05:44.354685+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:05:44.354685+0000","last_undegraded":"2023-10-06T11:05:44.354685+0000","last_fullsized":"2023-10-06T11:05:44.354685+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:42.336346+0000","last_change":"2023-10-06T11:05:42.336346+0000","last_active":"2023-10-06T11:05:42.336346+0000","last_peered":"2023-10-06T11:05:42.336346+0000","last_clean":"2023-10-06T11:05:42.336346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:42.336346+0000","last_undegraded":"2023-10-06T11:05:42.336346+0000","last_fullsized":"2023-10-06T11:05:42.336346+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-06T11:05:38.420867+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:05:38.420867+0000","last_peered":"2023-10-06T11:05:38.420867+0000","last_clean":"2023-10-06T11:05:38.420867+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:05:38.420867+0000","last_undegraded":"2023-10-06T11:05:38.420867+0000","last_fullsized":"2023-10-06T11:05:38.420867+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:42.336346+0000","last_change":"2023-10-06T11:05:42.336346+0000","last_active":"2023-10-06T11:05:42.336346+0000","last_peered":"2023-10-06T11:05:42.336346+0000","last_clean":"2023-10-06T11:05:42.336346+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:42.336346+0000","last_undegraded":"2023-10-06T11:05:42.336346+0000","last_fullsized":"2023-10-06T11:05:42.336346+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377441+0000","last_change":"2023-10-06T11:05:44.374324+0000","last_active":"2023-10-06T11:05:44.377441+0000","last_peered":"2023-10-06T11:05:44.377441+0000","last_clean":"2023-10-06T11:05:44.377441+0000","last_became_active":"2023-10-06T11:05:44.374070+0000","last_became_peered":"2023-10-06T11:05:44.374070+0000","last_unstale":"2023-10-06T11:05:44.377441+0000","last_undegraded":"2023-10-06T11:05:44.377441+0000","last_fullsized":"2023-10-06T11:05:44.377441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:49:53.929590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":9,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-10-06T11:05:38.323501+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:05:38.323501+0000","last_peered":"2023-10-06T11:05:38.323501+0000","last_clean":"2023-10-06T11:05:38.323501+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:05:38.323501+0000","last_undegraded":"2023-10-06T11:05:38.323501+0000","last_fullsized":"2023-10-06T11:05:38.323501+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.356747+0000","last_change":"2023-10-06T11:05:43.364980+0000","last_active":"2023-10-06T11:05:44.356747+0000","last_peered":"2023-10-06T11:05:44.356747+0000","last_clean":"2023-10-06T11:05:44.356747+0000","last_became_active":"2023-10-06T11:05:43.364661+0000","last_became_peered":"2023-10-06T11:05:43.364661+0000","last_unstale":"2023-10-06T11:05:44.356747+0000","last_undegraded":"2023-10-06T11:05:44.356747+0000","last_fullsized":"2023-10-06T11:05:44.356747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:32.863094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377355+0000","last_change":"2023-10-06T11:05:43.368448+0000","last_active":"2023-10-06T11:05:44.377355+0000","last_peered":"2023-10-06T11:05:44.377355+0000","last_clean":"2023-10-06T11:05:44.377355+0000","last_became_active":"2023-10-06T11:05:43.367859+0000","last_became_peered":"2023-10-06T11:05:43.367859+0000","last_unstale":"2023-10-06T11:05:44.377355+0000","last_undegraded":"2023-10-06T11:05:44.377355+0000","last_fullsized":"2023-10-06T11:05:44.377355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:18.301774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375383+0000","last_change":"2023-10-06T11:05:44.369211+0000","last_active":"2023-10-06T11:05:44.375383+0000","last_peered":"2023-10-06T11:05:44.375383+0000","last_clean":"2023-10-06T11:05:44.375383+0000","last_became_active":"2023-10-06T11:05:44.368950+0000","last_became_peered":"2023-10-06T11:05:44.368950+0000","last_unstale":"2023-10-06T11:05:44.375383+0000","last_undegraded":"2023-10-06T11:05:44.375383+0000","last_fullsized":"2023-10-06T11:05:44.375383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:01.484408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377607+0000","last_change":"2023-10-06T11:05:43.365792+0000","last_active":"2023-10-06T11:05:44.377607+0000","last_peered":"2023-10-06T11:05:44.377607+0000","last_clean":"2023-10-06T11:05:44.377607+0000","last_became_active":"2023-10-06T11:05:43.365137+0000","last_became_peered":"2023-10-06T11:05:43.365137+0000","last_unstale":"2023-10-06T11:05:44.377607+0000","last_undegraded":"2023-10-06T11:05:44.377607+0000","last_fullsized":"2023-10-06T11:05:44.377607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:24.903299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377828+0000","last_change":"2023-10-06T11:05:43.367620+0000","last_active":"2023-10-06T11:05:44.377828+0000","last_peered":"2023-10-06T11:05:44.377828+0000","last_clean":"2023-10-06T11:05:44.377828+0000","last_became_active":"2023-10-06T11:05:43.367335+0000","last_became_peered":"2023-10-06T11:05:43.367335+0000","last_unstale":"2023-10-06T11:05:44.377828+0000","last_undegraded":"2023-10-06T11:05:44.377828+0000","last_fullsized":"2023-10-06T11:05:44.377828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:18.301774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375170+0000","last_change":"2023-10-06T11:05:43.362124+0000","last_active":"2023-10-06T11:05:44.375170+0000","last_peered":"2023-10-06T11:05:44.375170+0000","last_clean":"2023-10-06T11:05:44.375170+0000","last_became_active":"2023-10-06T11:05:43.361847+0000","last_became_peered":"2023-10-06T11:05:43.361847+0000","last_unstale":"2023-10-06T11:05:44.375170+0000","last_undegraded":"2023-10-06T11:05:44.375170+0000","last_fullsized":"2023-10-06T11:05:44.375170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:36.907530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.373157+0000","last_change":"2023-10-06T11:05:44.367010+0000","last_active":"2023-10-06T11:05:44.373157+0000","last_peered":"2023-10-06T11:05:44.373157+0000","last_clean":"2023-10-06T11:05:44.373157+0000","last_became_active":"2023-10-06T11:05:44.366748+0000","last_became_peered":"2023-10-06T11:05:44.366748+0000","last_unstale":"2023-10-06T11:05:44.373157+0000","last_undegraded":"2023-10-06T11:05:44.373157+0000","last_fullsized":"2023-10-06T11:05:44.373157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:32:17.346227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380717+0000","last_change":"2023-10-06T11:05:43.367936+0000","last_active":"2023-10-06T11:05:44.380717+0000","last_peered":"2023-10-06T11:05:44.380717+0000","last_clean":"2023-10-06T11:05:44.380717+0000","last_became_active":"2023-10-06T11:05:43.367668+0000","last_became_peered":"2023-10-06T11:05:43.367668+0000","last_unstale":"2023-10-06T11:05:44.380717+0000","last_undegraded":"2023-10-06T11:05:44.380717+0000","last_fullsized":"2023-10-06T11:05:44.380717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:20:04.789716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379549+0000","last_change":"2023-10-06T11:05:44.373040+0000","last_active":"2023-10-06T11:05:44.379549+0000","last_peered":"2023-10-06T11:05:44.379549+0000","last_clean":"2023-10-06T11:05:44.379549+0000","last_became_active":"2023-10-06T11:05:44.370543+0000","last_became_peered":"2023-10-06T11:05:44.370543+0000","last_unstale":"2023-10-06T11:05:44.379549+0000","last_undegraded":"2023-10-06T11:05:44.379549+0000","last_fullsized":"2023-10-06T11:05:44.379549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:30:10.233024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379174+0000","last_change":"2023-10-06T11:05:44.372135+0000","last_active":"2023-10-06T11:05:44.379174+0000","last_peered":"2023-10-06T11:05:44.379174+0000","last_clean":"2023-10-06T11:05:44.379174+0000","last_became_active":"2023-10-06T11:05:44.371609+0000","last_became_peered":"2023-10-06T11:05:44.371609+0000","last_unstale":"2023-10-06T11:05:44.379174+0000","last_undegraded":"2023-10-06T11:05:44.379174+0000","last_fullsized":"2023-10-06T11:05:44.379174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:48:35.935962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:05:43.343085+0000","last_change":"2023-10-06T11:05:43.343085+0000","last_active":"2023-10-06T11:05:43.343085+0000","last_peered":"2023-10-06T11:05:43.343085+0000","last_clean":"2023-10-06T11:05:43.343085+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:05:43.343085+0000","last_undegraded":"2023-10-06T11:05:43.343085+0000","last_fullsized":"2023-10-06T11:05:43.343085+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":70,"acting":70,"num_store_stats":5},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":770,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":23,"ondisk_log_size":23,"up":46,"acting":46,"num_store_stats":5},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298096,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073744,"statfs":{"total":96636764160,"available":96331513856,"internally_reserved":0,"allocated":827392,"data_stored":666304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297436,"kb_used_data":148,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074404,"statfs":{"total":96636764160,"available":96332189696,"internally_reserved":0,"allocated":151552,"data_stored":46308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298148,"kb_used_data":732,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073692,"statfs":{"total":96636764160,"available":96331460608,"internally_reserved":0,"allocated":749568,"data_stored":638029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":73385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297484,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074356,"statfs":{"total":96636764160,"available":96332140544,"internally_reserved":0,"allocated":200704,"data_stored":72831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":72921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297440,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074400,"statfs":{"total":96636764160,"available":96332185600,"internally_reserved":0,"allocated":155648,"data_stored":47661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":74808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:05:49.157 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3d is not active+clean 2023-10-06T11:05:49.157 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:05:43.343085+0000', 'last_change': '2023-10-06T11:05:43.343085+0000', 'last_active': '2023-10-06T11:05:43.343085+0000', 'last_peered': '2023-10-06T11:05:43.343085+0000', 'last_clean': '2023-10-06T11:05:43.343085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:05:43.343085+0000', 'last_undegraded': '2023-10-06T11:05:43.343085+0000', 'last_fullsized': '2023-10-06T11:05:43.343085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_clean_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:05:49.157 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3c is not active+clean 2023-10-06T11:05:49.157 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:05:43.343085+0000', 'last_change': '2023-10-06T11:05:43.343085+0000', 'last_active': '2023-10-06T11:05:43.343085+0000', 'last_peered': '2023-10-06T11:05:43.343085+0000', 'last_clean': '2023-10-06T11:05:43.343085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:05:43.343085+0000', 'last_undegraded': '2023-10-06T11:05:43.343085+0000', 'last_fullsized': '2023-10-06T11:05:43.343085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_clean_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:05:49.157 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3a is not active+clean 2023-10-06T11:05:49.157 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:05:43.343085+0000', 'last_change': '2023-10-06T11:05:43.343085+0000', 'last_active': '2023-10-06T11:05:43.343085+0000', 'last_peered': '2023-10-06T11:05:43.343085+0000', 'last_clean': '2023-10-06T11:05:43.343085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:05:43.343085+0000', 'last_undegraded': '2023-10-06T11:05:43.343085+0000', 'last_fullsized': '2023-10-06T11:05:43.343085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_clean_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:05:49.157 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.35 is not active+clean 2023-10-06T11:05:49.157 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:05:43.343085+0000', 'last_change': '2023-10-06T11:05:43.343085+0000', 'last_active': '2023-10-06T11:05:43.343085+0000', 'last_peered': '2023-10-06T11:05:43.343085+0000', 'last_clean': '2023-10-06T11:05:43.343085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:05:43.343085+0000', 'last_undegraded': '2023-10-06T11:05:43.343085+0000', 'last_fullsized': '2023-10-06T11:05:43.343085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_clean_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:05:49.157 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.30 is not active+clean 2023-10-06T11:05:49.158 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:05:43.343085+0000', 'last_change': '2023-10-06T11:05:43.343085+0000', 'last_active': '2023-10-06T11:05:43.343085+0000', 'last_peered': '2023-10-06T11:05:43.343085+0000', 'last_clean': '2023-10-06T11:05:43.343085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:05:43.343085+0000', 'last_undegraded': '2023-10-06T11:05:43.343085+0000', 'last_fullsized': '2023-10-06T11:05:43.343085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_clean_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:05:49.158 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2e is not active+clean 2023-10-06T11:05:49.158 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:05:43.343085+0000', 'last_change': '2023-10-06T11:05:43.343085+0000', 'last_active': '2023-10-06T11:05:43.343085+0000', 'last_peered': '2023-10-06T11:05:43.343085+0000', 'last_clean': '2023-10-06T11:05:43.343085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:05:43.343085+0000', 'last_undegraded': '2023-10-06T11:05:43.343085+0000', 'last_fullsized': '2023-10-06T11:05:43.343085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_clean_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:05:49.158 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2c is not active+clean 2023-10-06T11:05:49.158 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:05:43.343085+0000', 'last_change': '2023-10-06T11:05:43.343085+0000', 'last_active': '2023-10-06T11:05:43.343085+0000', 'last_peered': '2023-10-06T11:05:43.343085+0000', 'last_clean': '2023-10-06T11:05:43.343085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:05:43.343085+0000', 'last_undegraded': '2023-10-06T11:05:43.343085+0000', 'last_fullsized': '2023-10-06T11:05:43.343085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_clean_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:05:49.158 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.27 is not active+clean 2023-10-06T11:05:49.158 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:05:43.343085+0000', 'last_change': '2023-10-06T11:05:43.343085+0000', 'last_active': '2023-10-06T11:05:43.343085+0000', 'last_peered': '2023-10-06T11:05:43.343085+0000', 'last_clean': '2023-10-06T11:05:43.343085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:05:43.343085+0000', 'last_undegraded': '2023-10-06T11:05:43.343085+0000', 'last_fullsized': '2023-10-06T11:05:43.343085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_clean_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:05:49.158 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.26 is not active+clean 2023-10-06T11:05:49.158 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:05:43.343085+0000', 'last_change': '2023-10-06T11:05:43.343085+0000', 'last_active': '2023-10-06T11:05:43.343085+0000', 'last_peered': '2023-10-06T11:05:43.343085+0000', 'last_clean': '2023-10-06T11:05:43.343085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:05:43.343085+0000', 'last_undegraded': '2023-10-06T11:05:43.343085+0000', 'last_fullsized': '2023-10-06T11:05:43.343085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_clean_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:05:49.159 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2023-10-06T11:05:49.159 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:05:42.336346+0000', 'last_change': '2023-10-06T11:05:42.336346+0000', 'last_active': '2023-10-06T11:05:42.336346+0000', 'last_peered': '2023-10-06T11:05:42.336346+0000', 'last_clean': '2023-10-06T11:05:42.336346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:05:42.336346+0000', 'last_undegraded': '2023-10-06T11:05:42.336346+0000', 'last_fullsized': '2023-10-06T11:05:42.336346+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:05:42.336346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:05:42.336346+0000', 'last_clean_scrub_stamp': '2023-10-06T11:05:42.336346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:05:49.159 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2023-10-06T11:05:49.159 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:05:42.336346+0000', 'last_change': '2023-10-06T11:05:42.336346+0000', 'last_active': '2023-10-06T11:05:42.336346+0000', 'last_peered': '2023-10-06T11:05:42.336346+0000', 'last_clean': '2023-10-06T11:05:42.336346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:05:42.336346+0000', 'last_undegraded': '2023-10-06T11:05:42.336346+0000', 'last_fullsized': '2023-10-06T11:05:42.336346+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:05:42.336346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:05:42.336346+0000', 'last_clean_scrub_stamp': '2023-10-06T11:05:42.336346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:05:49.159 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2023-10-06T11:05:49.159 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:05:43.343085+0000', 'last_change': '2023-10-06T11:05:43.343085+0000', 'last_active': '2023-10-06T11:05:43.343085+0000', 'last_peered': '2023-10-06T11:05:43.343085+0000', 'last_clean': '2023-10-06T11:05:43.343085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:05:43.343085+0000', 'last_undegraded': '2023-10-06T11:05:43.343085+0000', 'last_fullsized': '2023-10-06T11:05:43.343085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_clean_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:05:49.159 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2023-10-06T11:05:49.159 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:05:43.343085+0000', 'last_change': '2023-10-06T11:05:43.343085+0000', 'last_active': '2023-10-06T11:05:43.343085+0000', 'last_peered': '2023-10-06T11:05:43.343085+0000', 'last_clean': '2023-10-06T11:05:43.343085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:05:43.343085+0000', 'last_undegraded': '2023-10-06T11:05:43.343085+0000', 'last_fullsized': '2023-10-06T11:05:43.343085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_clean_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:05:49.159 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2023-10-06T11:05:49.159 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:05:42.336346+0000', 'last_change': '2023-10-06T11:05:42.336346+0000', 'last_active': '2023-10-06T11:05:42.336346+0000', 'last_peered': '2023-10-06T11:05:42.336346+0000', 'last_clean': '2023-10-06T11:05:42.336346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:05:42.336346+0000', 'last_undegraded': '2023-10-06T11:05:42.336346+0000', 'last_fullsized': '2023-10-06T11:05:42.336346+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:05:42.336346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:05:42.336346+0000', 'last_clean_scrub_stamp': '2023-10-06T11:05:42.336346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:05:49.160 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2023-10-06T11:05:49.160 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:05:43.343085+0000', 'last_change': '2023-10-06T11:05:43.343085+0000', 'last_active': '2023-10-06T11:05:43.343085+0000', 'last_peered': '2023-10-06T11:05:43.343085+0000', 'last_clean': '2023-10-06T11:05:43.343085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:05:43.343085+0000', 'last_undegraded': '2023-10-06T11:05:43.343085+0000', 'last_fullsized': '2023-10-06T11:05:43.343085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_clean_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:05:49.160 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2023-10-06T11:05:49.160 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:05:42.336346+0000', 'last_change': '2023-10-06T11:05:42.336346+0000', 'last_active': '2023-10-06T11:05:42.336346+0000', 'last_peered': '2023-10-06T11:05:42.336346+0000', 'last_clean': '2023-10-06T11:05:42.336346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:05:42.336346+0000', 'last_undegraded': '2023-10-06T11:05:42.336346+0000', 'last_fullsized': '2023-10-06T11:05:42.336346+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:05:42.336346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:05:42.336346+0000', 'last_clean_scrub_stamp': '2023-10-06T11:05:42.336346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:05:49.160 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2023-10-06T11:05:49.160 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:05:43.343085+0000', 'last_change': '2023-10-06T11:05:43.343085+0000', 'last_active': '2023-10-06T11:05:43.343085+0000', 'last_peered': '2023-10-06T11:05:43.343085+0000', 'last_clean': '2023-10-06T11:05:43.343085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:05:43.343085+0000', 'last_undegraded': '2023-10-06T11:05:43.343085+0000', 'last_fullsized': '2023-10-06T11:05:43.343085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_clean_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:05:49.160 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2023-10-06T11:05:49.160 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:05:43.343085+0000', 'last_change': '2023-10-06T11:05:43.343085+0000', 'last_active': '2023-10-06T11:05:43.343085+0000', 'last_peered': '2023-10-06T11:05:43.343085+0000', 'last_clean': '2023-10-06T11:05:43.343085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:05:43.343085+0000', 'last_undegraded': '2023-10-06T11:05:43.343085+0000', 'last_fullsized': '2023-10-06T11:05:43.343085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_clean_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:05:49.160 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2023-10-06T11:05:49.160 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:05:43.343085+0000', 'last_change': '2023-10-06T11:05:43.343085+0000', 'last_active': '2023-10-06T11:05:43.343085+0000', 'last_peered': '2023-10-06T11:05:43.343085+0000', 'last_clean': '2023-10-06T11:05:43.343085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:05:43.343085+0000', 'last_undegraded': '2023-10-06T11:05:43.343085+0000', 'last_fullsized': '2023-10-06T11:05:43.343085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_clean_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:05:49.161 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2023-10-06T11:05:49.161 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:05:42.336346+0000', 'last_change': '2023-10-06T11:05:42.336346+0000', 'last_active': '2023-10-06T11:05:42.336346+0000', 'last_peered': '2023-10-06T11:05:42.336346+0000', 'last_clean': '2023-10-06T11:05:42.336346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:05:42.336346+0000', 'last_undegraded': '2023-10-06T11:05:42.336346+0000', 'last_fullsized': '2023-10-06T11:05:42.336346+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:05:42.336346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:05:42.336346+0000', 'last_clean_scrub_stamp': '2023-10-06T11:05:42.336346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:05:49.161 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2023-10-06T11:05:49.161 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:05:43.343085+0000', 'last_change': '2023-10-06T11:05:43.343085+0000', 'last_active': '2023-10-06T11:05:43.343085+0000', 'last_peered': '2023-10-06T11:05:43.343085+0000', 'last_clean': '2023-10-06T11:05:43.343085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:05:43.343085+0000', 'last_undegraded': '2023-10-06T11:05:43.343085+0000', 'last_fullsized': '2023-10-06T11:05:43.343085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_clean_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:05:49.161 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2023-10-06T11:05:49.161 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:05:42.336346+0000', 'last_change': '2023-10-06T11:05:42.336346+0000', 'last_active': '2023-10-06T11:05:42.336346+0000', 'last_peered': '2023-10-06T11:05:42.336346+0000', 'last_clean': '2023-10-06T11:05:42.336346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:05:42.336346+0000', 'last_undegraded': '2023-10-06T11:05:42.336346+0000', 'last_fullsized': '2023-10-06T11:05:42.336346+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:05:42.336346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:05:42.336346+0000', 'last_clean_scrub_stamp': '2023-10-06T11:05:42.336346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:05:49.161 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2023-10-06T11:05:49.161 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:05:43.343085+0000', 'last_change': '2023-10-06T11:05:43.343085+0000', 'last_active': '2023-10-06T11:05:43.343085+0000', 'last_peered': '2023-10-06T11:05:43.343085+0000', 'last_clean': '2023-10-06T11:05:43.343085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:05:43.343085+0000', 'last_undegraded': '2023-10-06T11:05:43.343085+0000', 'last_fullsized': '2023-10-06T11:05:43.343085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_clean_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:05:49.161 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2023-10-06T11:05:49.161 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:05:43.343085+0000', 'last_change': '2023-10-06T11:05:43.343085+0000', 'last_active': '2023-10-06T11:05:43.343085+0000', 'last_peered': '2023-10-06T11:05:43.343085+0000', 'last_clean': '2023-10-06T11:05:43.343085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:05:43.343085+0000', 'last_undegraded': '2023-10-06T11:05:43.343085+0000', 'last_fullsized': '2023-10-06T11:05:43.343085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_clean_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:05:49.162 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2023-10-06T11:05:49.162 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:05:43.343085+0000', 'last_change': '2023-10-06T11:05:43.343085+0000', 'last_active': '2023-10-06T11:05:43.343085+0000', 'last_peered': '2023-10-06T11:05:43.343085+0000', 'last_clean': '2023-10-06T11:05:43.343085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:05:43.343085+0000', 'last_undegraded': '2023-10-06T11:05:43.343085+0000', 'last_fullsized': '2023-10-06T11:05:43.343085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_clean_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:05:49.162 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2023-10-06T11:05:49.162 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:05:42.336346+0000', 'last_change': '2023-10-06T11:05:42.336346+0000', 'last_active': '2023-10-06T11:05:42.336346+0000', 'last_peered': '2023-10-06T11:05:42.336346+0000', 'last_clean': '2023-10-06T11:05:42.336346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:05:42.336346+0000', 'last_undegraded': '2023-10-06T11:05:42.336346+0000', 'last_fullsized': '2023-10-06T11:05:42.336346+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:05:42.336346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:05:42.336346+0000', 'last_clean_scrub_stamp': '2023-10-06T11:05:42.336346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:05:49.162 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2023-10-06T11:05:49.162 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:05:43.343085+0000', 'last_change': '2023-10-06T11:05:43.343085+0000', 'last_active': '2023-10-06T11:05:43.343085+0000', 'last_peered': '2023-10-06T11:05:43.343085+0000', 'last_clean': '2023-10-06T11:05:43.343085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:05:43.343085+0000', 'last_undegraded': '2023-10-06T11:05:43.343085+0000', 'last_fullsized': '2023-10-06T11:05:43.343085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_clean_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:05:49.162 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2023-10-06T11:05:49.162 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:05:43.343085+0000', 'last_change': '2023-10-06T11:05:43.343085+0000', 'last_active': '2023-10-06T11:05:43.343085+0000', 'last_peered': '2023-10-06T11:05:43.343085+0000', 'last_clean': '2023-10-06T11:05:43.343085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:05:43.343085+0000', 'last_undegraded': '2023-10-06T11:05:43.343085+0000', 'last_fullsized': '2023-10-06T11:05:43.343085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_clean_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:05:49.162 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2023-10-06T11:05:49.162 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:05:42.336346+0000', 'last_change': '2023-10-06T11:05:42.336346+0000', 'last_active': '2023-10-06T11:05:42.336346+0000', 'last_peered': '2023-10-06T11:05:42.336346+0000', 'last_clean': '2023-10-06T11:05:42.336346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:05:42.336346+0000', 'last_undegraded': '2023-10-06T11:05:42.336346+0000', 'last_fullsized': '2023-10-06T11:05:42.336346+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:05:42.336346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:05:42.336346+0000', 'last_clean_scrub_stamp': '2023-10-06T11:05:42.336346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:05:49.163 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2023-10-06T11:05:49.163 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:05:43.343085+0000', 'last_change': '2023-10-06T11:05:43.343085+0000', 'last_active': '2023-10-06T11:05:43.343085+0000', 'last_peered': '2023-10-06T11:05:43.343085+0000', 'last_clean': '2023-10-06T11:05:43.343085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:05:43.343085+0000', 'last_undegraded': '2023-10-06T11:05:43.343085+0000', 'last_fullsized': '2023-10-06T11:05:43.343085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_clean_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:05:49.163 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2023-10-06T11:05:49.163 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:05:42.336346+0000', 'last_change': '2023-10-06T11:05:42.336346+0000', 'last_active': '2023-10-06T11:05:42.336346+0000', 'last_peered': '2023-10-06T11:05:42.336346+0000', 'last_clean': '2023-10-06T11:05:42.336346+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:05:42.336346+0000', 'last_undegraded': '2023-10-06T11:05:42.336346+0000', 'last_fullsized': '2023-10-06T11:05:42.336346+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:05:42.336346+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:05:42.336346+0000', 'last_clean_scrub_stamp': '2023-10-06T11:05:42.336346+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:05:49.163 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2023-10-06T11:05:49.163 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:05:43.343085+0000', 'last_change': '2023-10-06T11:05:43.343085+0000', 'last_active': '2023-10-06T11:05:43.343085+0000', 'last_peered': '2023-10-06T11:05:43.343085+0000', 'last_clean': '2023-10-06T11:05:43.343085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:05:43.343085+0000', 'last_undegraded': '2023-10-06T11:05:43.343085+0000', 'last_fullsized': '2023-10-06T11:05:43.343085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_clean_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:05:49.163 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2023-10-06T11:05:49.163 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:05:43.343085+0000', 'last_change': '2023-10-06T11:05:43.343085+0000', 'last_active': '2023-10-06T11:05:43.343085+0000', 'last_peered': '2023-10-06T11:05:43.343085+0000', 'last_clean': '2023-10-06T11:05:43.343085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:05:43.343085+0000', 'last_undegraded': '2023-10-06T11:05:43.343085+0000', 'last_fullsized': '2023-10-06T11:05:43.343085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_clean_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:05:49.163 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2023-10-06T11:05:49.163 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:05:43.343085+0000', 'last_change': '2023-10-06T11:05:43.343085+0000', 'last_active': '2023-10-06T11:05:43.343085+0000', 'last_peered': '2023-10-06T11:05:43.343085+0000', 'last_clean': '2023-10-06T11:05:43.343085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:05:43.343085+0000', 'last_undegraded': '2023-10-06T11:05:43.343085+0000', 'last_fullsized': '2023-10-06T11:05:43.343085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_clean_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:05:49.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2023-10-06T11:05:49.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:05:43.343085+0000', 'last_change': '2023-10-06T11:05:43.343085+0000', 'last_active': '2023-10-06T11:05:43.343085+0000', 'last_peered': '2023-10-06T11:05:43.343085+0000', 'last_clean': '2023-10-06T11:05:43.343085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:05:43.343085+0000', 'last_undegraded': '2023-10-06T11:05:43.343085+0000', 'last_fullsized': '2023-10-06T11:05:43.343085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_clean_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:05:49.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.20 is not active+clean 2023-10-06T11:05:49.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:05:43.343085+0000', 'last_change': '2023-10-06T11:05:43.343085+0000', 'last_active': '2023-10-06T11:05:43.343085+0000', 'last_peered': '2023-10-06T11:05:43.343085+0000', 'last_clean': '2023-10-06T11:05:43.343085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:05:43.343085+0000', 'last_undegraded': '2023-10-06T11:05:43.343085+0000', 'last_fullsized': '2023-10-06T11:05:43.343085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_clean_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:05:49.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.22 is not active+clean 2023-10-06T11:05:49.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:05:43.343085+0000', 'last_change': '2023-10-06T11:05:43.343085+0000', 'last_active': '2023-10-06T11:05:43.343085+0000', 'last_peered': '2023-10-06T11:05:43.343085+0000', 'last_clean': '2023-10-06T11:05:43.343085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:05:43.343085+0000', 'last_undegraded': '2023-10-06T11:05:43.343085+0000', 'last_fullsized': '2023-10-06T11:05:43.343085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_clean_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:05:49.164 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.24 is not active+clean 2023-10-06T11:05:49.164 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:05:43.343085+0000', 'last_change': '2023-10-06T11:05:43.343085+0000', 'last_active': '2023-10-06T11:05:43.343085+0000', 'last_peered': '2023-10-06T11:05:43.343085+0000', 'last_clean': '2023-10-06T11:05:43.343085+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:05:43.343085+0000', 'last_undegraded': '2023-10-06T11:05:43.343085+0000', 'last_fullsized': '2023-10-06T11:05:43.343085+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'last_clean_scrub_stamp': '2023-10-06T11:05:43.343085+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:05:49.165 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T11:05:49.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.304+0000 7fb9ce763700 1 Processor -- start 2023-10-06T11:05:49.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.304+0000 7fb9ce763700 1 -- start start 2023-10-06T11:05:49.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.305+0000 7fb9ce763700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb9c80ca7d0 0x7fb9c80b0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:49.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.305+0000 7fb9ce763700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9c80b00c0 con 0x7fb9c80c97c0 2023-10-06T11:05:49.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.305+0000 7fb9ce763700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9c80afc30 con 0x7fb9c80ca330 2023-10-06T11:05:49.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.305+0000 7fb9ce763700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9c81569b0 con 0x7fb9c80ca7d0 2023-10-06T11:05:49.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.305+0000 7fb9c7fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb9c80c97c0 0x7fb9c815aae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33878/0 (socket says 172.21.15.146:33878) 2023-10-06T11:05:49.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.305+0000 7fb9c7fff700 1 -- 172.21.15.146:0/689775000 learned_addr learned my addr 172.21.15.146:0/689775000 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:05:49.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.306+0000 7fb9ccd00700 1 --2- 172.21.15.146:0/689775000 >> v2:172.21.15.151:3300/0 conn(0x7fb9c80ca7d0 0x7fb9c80b0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:49.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.306+0000 7fb9c6ffd700 1 -- 172.21.15.146:0/689775000 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1968954051 0 0) 0x7fb9c80b00c0 con 0x7fb9c80c97c0 2023-10-06T11:05:49.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.306+0000 7fb9c6ffd700 1 -- 172.21.15.146:0/689775000 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9b0003570 con 0x7fb9c80c97c0 2023-10-06T11:05:49.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.306+0000 7fb9c6ffd700 1 -- 172.21.15.146:0/689775000 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 394073228 0 0) 0x7fb9b0003570 con 0x7fb9c80c97c0 2023-10-06T11:05:49.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.306+0000 7fb9c6ffd700 1 -- 172.21.15.146:0/689775000 >> v2:172.21.15.151:3300/0 conn(0x7fb9c80ca7d0 msgr2=0x7fb9c80b0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:49.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.306+0000 7fb9c6ffd700 1 --2- 172.21.15.146:0/689775000 >> v2:172.21.15.151:3300/0 conn(0x7fb9c80ca7d0 0x7fb9c80b0830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:49.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.306+0000 7fb9c6ffd700 1 -- 172.21.15.146:0/689775000 >> v1:172.21.15.151:6789/0 conn(0x7fb9c80ca330 legacy=0x7fb9c806e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:49.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.306+0000 7fb9c6ffd700 1 -- 172.21.15.146:0/689775000 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c80b1c60 con 0x7fb9c80c97c0 2023-10-06T11:05:49.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.306+0000 7fb9c6ffd700 1 -- 172.21.15.146:0/689775000 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fb9b8001470 con 0x7fb9c80c97c0 2023-10-06T11:05:49.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.306+0000 7fb9c6ffd700 1 -- 172.21.15.146:0/689775000 >> v1:172.21.15.146:6789/0 conn(0x7fb9c80c97c0 legacy=0x7fb9c815aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:49.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.306+0000 7fb9c6ffd700 1 --2- 172.21.15.146:0/689775000 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9b0003a60 0x7fb9b0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:49.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.306+0000 7fb9c6ffd700 1 --2- 172.21.15.146:0/689775000 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9b0004810 0x7fb9b0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:49.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.306+0000 7fb9c6ffd700 1 --2- 172.21.15.146:0/689775000 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9b00052e0 0x7fb9b000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:49.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.306+0000 7fb9c6ffd700 1 -- 172.21.15.146:0/689775000 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c81569b0 con 0x7fb9b0004810 2023-10-06T11:05:49.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.306+0000 7fb9c6ffd700 1 -- 172.21.15.146:0/689775000 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b000c2a0 con 0x7fb9b00052e0 2023-10-06T11:05:49.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.306+0000 7fb9c6ffd700 1 -- 172.21.15.146:0/689775000 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b000c460 con 0x7fb9b0003a60 2023-10-06T11:05:49.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.306+0000 7fb9c77fe700 1 --2- 172.21.15.146:0/689775000 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9b0004810 0x7fb9b0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:49.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.306+0000 7fb9ccd00700 1 --2- 172.21.15.146:0/689775000 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9b00052e0 0x7fb9b000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:49.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.306+0000 7fb9c7fff700 1 --2- 172.21.15.146:0/689775000 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9b0003a60 0x7fb9b0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:49.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.306+0000 7fb9c77fe700 1 -- 172.21.15.146:0/689775000 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9b0003a60 msgr2=0x7fb9b0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:49.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.306+0000 7fb9c77fe700 1 --2- 172.21.15.146:0/689775000 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9b0003a60 0x7fb9b0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:49.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.306+0000 7fb9c77fe700 1 -- 172.21.15.146:0/689775000 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9b00052e0 msgr2=0x7fb9b000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:49.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.306+0000 7fb9c77fe700 1 --2- 172.21.15.146:0/689775000 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9b00052e0 0x7fb9b000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:49.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.306+0000 7fb9ccd00700 1 -- 172.21.15.146:0/689775000 reap_dead start 2023-10-06T11:05:49.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.306+0000 7fb9c77fe700 1 -- 172.21.15.146:0/689775000 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b0003570 con 0x7fb9b0004810 2023-10-06T11:05:49.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.306+0000 7fb9c77fe700 1 --2- 172.21.15.146:0/689775000 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9b0004810 0x7fb9b0004c80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc0018d0 tx=0x7fb9bc007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11f88989e039b3fa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:49.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.307+0000 7fb9c6ffd700 1 -- 172.21.15.146:0/689775000 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc001290 con 0x7fb9b0004810 2023-10-06T11:05:49.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.307+0000 7fb9c6ffd700 1 -- 172.21.15.146:0/689775000 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9bc012420 con 0x7fb9b0004810 2023-10-06T11:05:49.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.307+0000 7fb9c6ffd700 1 -- 172.21.15.146:0/689775000 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9bc0127e0 con 0x7fb9b0004810 2023-10-06T11:05:49.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.307+0000 7fb9ce763700 1 -- 172.21.15.146:0/689775000 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9b0004810 msgr2=0x7fb9b0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:49.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.307+0000 7fb9ce763700 1 --2- 172.21.15.146:0/689775000 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9b0004810 0x7fb9b0004c80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc0018d0 tx=0x7fb9bc007d80 comp rx=0 tx=0).stop 2023-10-06T11:05:49.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.307+0000 7fb9ce763700 1 -- 172.21.15.146:0/689775000 shutdown_connections 2023-10-06T11:05:49.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.307+0000 7fb9ce763700 1 --2- 172.21.15.146:0/689775000 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9b0004810 0x7fb9b0004c80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:49.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.307+0000 7fb9ce763700 1 -- 172.21.15.146:0/689775000 >> 172.21.15.146:0/689775000 conn(0x7fb9c806b060 msgr2=0x7fb9c80aecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:49.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.307+0000 7fb9ce763700 1 -- 172.21.15.146:0/689775000 shutdown_connections 2023-10-06T11:05:49.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.307+0000 7fb9ce763700 1 -- 172.21.15.146:0/689775000 wait complete. 2023-10-06T11:05:49.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.308+0000 7fb9ce763700 1 Processor -- start 2023-10-06T11:05:49.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.308+0000 7fb9ce763700 1 -- start start 2023-10-06T11:05:49.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.309+0000 7fb9ce763700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9b0004810 0x7fb9c8152d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:49.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.309+0000 7fb9ce763700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9c80c82d0 0x7fb9c8067470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:49.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.309+0000 7fb9ce763700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9c80c8740 0x7fb9c80679b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:49.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.309+0000 7fb9ce763700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c8158f10 con 0x7fb9c80c8740 2023-10-06T11:05:49.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.309+0000 7fb9ce763700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c8158300 con 0x7fb9c80c82d0 2023-10-06T11:05:49.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.309+0000 7fb9ce763700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c81585e0 con 0x7fb9b0004810 2023-10-06T11:05:49.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.309+0000 7fb9ccd00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9c80c8740 0x7fb9c80679b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:49.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.309+0000 7fb9ccd00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9c80c8740 0x7fb9c80679b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42206/0 (socket says 172.21.15.146:42206) 2023-10-06T11:05:49.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.309+0000 7fb9ccd00700 1 -- 172.21.15.146:0/1681478013 learned_addr learned my addr 172.21.15.146:0/1681478013 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:49.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.309+0000 7fb9c77fe700 1 --2- 172.21.15.146:0/1681478013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9c80c82d0 0x7fb9c8067470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:49.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.309+0000 7fb9c7fff700 1 --2- 172.21.15.146:0/1681478013 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9b0004810 0x7fb9c8152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:49.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.309+0000 7fb9ccd00700 1 -- 172.21.15.146:0/1681478013 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9b0004810 msgr2=0x7fb9c8152d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:49.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.309+0000 7fb9ccd00700 1 --2- 172.21.15.146:0/1681478013 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9b0004810 0x7fb9c8152d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:49.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.309+0000 7fb9ccd00700 1 -- 172.21.15.146:0/1681478013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9c80c82d0 msgr2=0x7fb9c8067470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:49.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.309+0000 7fb9ccd00700 1 --2- 172.21.15.146:0/1681478013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9c80c82d0 0x7fb9c8067470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:49.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.310+0000 7fb9ccd00700 1 -- 172.21.15.146:0/1681478013 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c81588c0 con 0x7fb9c80c8740 2023-10-06T11:05:49.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.310+0000 7fb9c7fff700 1 --2- 172.21.15.146:0/1681478013 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9b0004810 0x7fb9c8152d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:05:49.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.310+0000 7fb9ccd00700 1 --2- 172.21.15.146:0/1681478013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9c80c8740 0x7fb9c80679b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb9c00094d0 tx=0x7fb9c000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:49.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.310+0000 7fb9affff700 1 -- 172.21.15.146:0/1681478013 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c000e040 con 0x7fb9c80c8740 2023-10-06T11:05:49.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.310+0000 7fb9affff700 1 -- 172.21.15.146:0/1681478013 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c000f040 con 0x7fb9c80c8740 2023-10-06T11:05:49.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.310+0000 7fb9ce763700 1 -- 172.21.15.146:0/1681478013 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9c8158ba0 con 0x7fb9c80c8740 2023-10-06T11:05:49.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.310+0000 7fb9affff700 1 -- 172.21.15.146:0/1681478013 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c000fe20 con 0x7fb9c80c8740 2023-10-06T11:05:49.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.310+0000 7fb9ce763700 1 -- 172.21.15.146:0/1681478013 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c80ac1c0 con 0x7fb9c80c8740 2023-10-06T11:05:49.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.311+0000 7fb9ce763700 1 -- 172.21.15.146:0/1681478013 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9c804c380 con 0x7fb9c80c8740 2023-10-06T11:05:49.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.311+0000 7fb9affff700 1 -- 172.21.15.146:0/1681478013 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb9c0015640 con 0x7fb9c80c8740 2023-10-06T11:05:49.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.311+0000 7fb9affff700 1 --2- 172.21.15.146:0/1681478013 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb9b4066f30 0x7fb9b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:49.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.311+0000 7fb9affff700 1 -- 172.21.15.146:0/1681478013 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb9c0085000 con 0x7fb9c80c8740 2023-10-06T11:05:49.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.311+0000 7fb9c7fff700 1 --2- 172.21.15.146:0/1681478013 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb9b4066f30 0x7fb9b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:49.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.312+0000 7fb9c7fff700 1 --2- 172.21.15.146:0/1681478013 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb9b4066f30 0x7fb9b40693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb9b8000e10 tx=0x7fb9b8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:49.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.316+0000 7fb9affff700 1 -- 172.21.15.146:0/1681478013 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb9c0052110 con 0x7fb9c80c8740 2023-10-06T11:05:49.449 INFO:tasks.ceph.mds.b.smithi151.stderr:2023-10-06T11:05:49.447+0000 7f4ff0cf0700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T11:05:49.565 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:05:49.567 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:05:49.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.578+0000 7fb9ce763700 1 -- 172.21.15.146:0/1681478013 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fb9c80b1f40 con 0x7fb9c80c8740 2023-10-06T11:05:49.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.579+0000 7fb9affff700 1 -- 172.21.15.146:0/1681478013 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1015 (secure 0 0 0) 0x7fb9c0055730 con 0x7fb9c80c8740 2023-10-06T11:05:49.581 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:05:49.581 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":24,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":20,"num_osds":8,"num_up_osds":8,"osd_up_since":1696590336,"num_in_osds":8,"osd_in_since":1696590327,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":23,"data_bytes":592674,"bytes_used":2438258688,"bytes_avail":770655854592,"bytes_total":773094113280,"write_bytes_sec":2216,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":7,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4282}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-10-06T11:05:25.540734+0000","services":{}},"progress_events":{}} 2023-10-06T11:05:49.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.581+0000 7fb9ce763700 1 -- 172.21.15.146:0/1681478013 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb9b4066f30 msgr2=0x7fb9b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:49.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.581+0000 7fb9ce763700 1 --2- 172.21.15.146:0/1681478013 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb9b4066f30 0x7fb9b40693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb9b8000e10 tx=0x7fb9b8009040 comp rx=0 tx=0).stop 2023-10-06T11:05:49.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.581+0000 7fb9ce763700 1 -- 172.21.15.146:0/1681478013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9c80c8740 msgr2=0x7fb9c80679b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:49.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.581+0000 7fb9ce763700 1 --2- 172.21.15.146:0/1681478013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9c80c8740 0x7fb9c80679b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb9c00094d0 tx=0x7fb9c000b040 comp rx=0 tx=0).stop 2023-10-06T11:05:49.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.581+0000 7fb9ce763700 1 -- 172.21.15.146:0/1681478013 shutdown_connections 2023-10-06T11:05:49.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.581+0000 7fb9ce763700 1 --2- 172.21.15.146:0/1681478013 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb9b4066f30 0x7fb9b40693e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:49.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.581+0000 7fb9ce763700 1 --2- 172.21.15.146:0/1681478013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9c80c8740 0x7fb9c80679b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:49.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.581+0000 7fb9ce763700 1 --2- 172.21.15.146:0/1681478013 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9b0004810 0x7fb9c8152d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:49.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.581+0000 7fb9ce763700 1 --2- 172.21.15.146:0/1681478013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9c80c82d0 0x7fb9c8067470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:49.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.581+0000 7fb9ce763700 1 -- 172.21.15.146:0/1681478013 >> 172.21.15.146:0/1681478013 conn(0x7fb9c806b060 msgr2=0x7fb9c80cb730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:49.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.581+0000 7fb9ce763700 1 -- 172.21.15.146:0/1681478013 shutdown_connections 2023-10-06T11:05:49.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.581+0000 7fb9ce763700 1 -- 172.21.15.146:0/1681478013 wait complete. 2023-10-06T11:05:49.595 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-06T11:05:49.596 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:05:49.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.778+0000 7f7cfd6af700 1 Processor -- start 2023-10-06T11:05:49.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.778+0000 7f7cfd6af700 1 -- start start 2023-10-06T11:05:49.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.779+0000 7f7cfd6af700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7cf80ca7d0 0x7f7cf80b0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:49.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.779+0000 7f7cfd6af700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cf80b00c0 con 0x7f7cf80ca330 2023-10-06T11:05:49.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.779+0000 7f7cfd6af700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cf80afc30 con 0x7f7cf80c97c0 2023-10-06T11:05:49.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.779+0000 7f7cfd6af700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cf81569b0 con 0x7f7cf80ca7d0 2023-10-06T11:05:49.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.779+0000 7f7cf77fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7cf80ca7d0 0x7f7cf80b0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:49.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.779+0000 7f7cee7fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7cf80ca330 0x7f7cf806e590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33894/0 (socket says 172.21.15.146:33894) 2023-10-06T11:05:49.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.779+0000 7f7cee7fc700 1 -- 172.21.15.146:0/3735720527 learned_addr learned my addr 172.21.15.146:0/3735720527 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:05:49.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.780+0000 7f7cf77fe700 1 -- 172.21.15.146:0/3735720527 >> v1:172.21.15.151:6789/0 conn(0x7f7cf80c97c0 legacy=0x7f7cf815aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:49.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.780+0000 7f7cf77fe700 1 -- 172.21.15.146:0/3735720527 >> v1:172.21.15.146:6789/0 conn(0x7f7cf80ca330 legacy=0x7f7cf806e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:49.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.780+0000 7f7cf77fe700 1 -- 172.21.15.146:0/3735720527 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf80b1c60 con 0x7f7cf80ca7d0 2023-10-06T11:05:49.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.780+0000 7f7cf77fe700 1 --2- 172.21.15.146:0/3735720527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cf80ca7d0 0x7f7cf80b0830 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0009e60 tx=0x7f7cf0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fdb2753da79bc9c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:49.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.780+0000 7f7cf67fc700 1 -- 172.21.15.146:0/3735720527 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf000e070 con 0x7f7cf80ca7d0 2023-10-06T11:05:49.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.780+0000 7f7cf67fc700 1 -- 172.21.15.146:0/3735720527 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf000bc30 con 0x7f7cf80ca7d0 2023-10-06T11:05:49.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.780+0000 7f7cf67fc700 1 -- 172.21.15.146:0/3735720527 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf0012430 con 0x7f7cf80ca7d0 2023-10-06T11:05:49.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.780+0000 7f7cfd6af700 1 -- 172.21.15.146:0/3735720527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cf80ca7d0 msgr2=0x7f7cf80b0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:49.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.780+0000 7f7cfd6af700 1 --2- 172.21.15.146:0/3735720527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cf80ca7d0 0x7f7cf80b0830 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0009e60 tx=0x7f7cf0009780 comp rx=0 tx=0).stop 2023-10-06T11:05:49.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.780+0000 7f7cfd6af700 1 -- 172.21.15.146:0/3735720527 shutdown_connections 2023-10-06T11:05:49.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.780+0000 7f7cfd6af700 1 --2- 172.21.15.146:0/3735720527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cf80ca7d0 0x7f7cf80b0830 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:49.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.780+0000 7f7cfd6af700 1 -- 172.21.15.146:0/3735720527 >> 172.21.15.146:0/3735720527 conn(0x7f7cf806b060 msgr2=0x7f7cf80aecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:49.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.781+0000 7f7cfd6af700 1 -- 172.21.15.146:0/3735720527 shutdown_connections 2023-10-06T11:05:49.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.781+0000 7f7cfd6af700 1 -- 172.21.15.146:0/3735720527 wait complete. 2023-10-06T11:05:49.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.782+0000 7f7cfd6af700 1 Processor -- start 2023-10-06T11:05:49.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.782+0000 7f7cfd6af700 1 -- start start 2023-10-06T11:05:49.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.782+0000 7f7cfd6af700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cf80c97c0 0x7f7cf8148cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:49.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.784+0000 7f7cfd6af700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7cf80ca330 0x7f7cf80c20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:49.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.784+0000 7f7cfd6af700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cf80c25e0 0x7f7cf8067470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:49.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.784+0000 7f7cfd6af700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf8158a00 con 0x7f7cf80c25e0 2023-10-06T11:05:49.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.784+0000 7f7cfd6af700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf8157df0 con 0x7f7cf80c97c0 2023-10-06T11:05:49.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.784+0000 7f7cfd6af700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf81580d0 con 0x7f7cf80ca330 2023-10-06T11:05:49.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.784+0000 7f7cf77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cf80c25e0 0x7f7cf8067470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:49.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.784+0000 7f7cf77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cf80c25e0 0x7f7cf8067470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:42226/0 (socket says 172.21.15.146:42226) 2023-10-06T11:05:49.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.784+0000 7f7cf77fe700 1 -- 172.21.15.146:0/836641919 learned_addr learned my addr 172.21.15.146:0/836641919 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:49.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.784+0000 7f7cf6ffd700 1 --2- 172.21.15.146:0/836641919 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cf80c97c0 0x7f7cf8148cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:49.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.784+0000 7f7cee7fc700 1 --2- 172.21.15.146:0/836641919 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7cf80ca330 0x7f7cf80c20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:49.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.784+0000 7f7cf77fe700 1 -- 172.21.15.146:0/836641919 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7cf80ca330 msgr2=0x7f7cf80c20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:49.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.784+0000 7f7cf77fe700 1 --2- 172.21.15.146:0/836641919 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7cf80ca330 0x7f7cf80c20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:49.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.784+0000 7f7cf77fe700 1 -- 172.21.15.146:0/836641919 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cf80c97c0 msgr2=0x7f7cf8148cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:49.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.784+0000 7f7cf77fe700 1 --2- 172.21.15.146:0/836641919 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cf80c97c0 0x7f7cf8148cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:49.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.784+0000 7f7cf77fe700 1 -- 172.21.15.146:0/836641919 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf0009a20 con 0x7f7cf80c25e0 2023-10-06T11:05:49.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.784+0000 7f7cf6ffd700 1 --2- 172.21.15.146:0/836641919 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cf80c97c0 0x7f7cf8148cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:05:49.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.784+0000 7f7cf77fe700 1 --2- 172.21.15.146:0/836641919 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cf80c25e0 0x7f7cf8067470 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0013000 tx=0x7f7cf0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:49.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.784+0000 7f7cef7fe700 1 -- 172.21.15.146:0/836641919 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf0012e80 con 0x7f7cf80c25e0 2023-10-06T11:05:49.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.784+0000 7f7cef7fe700 1 -- 172.21.15.146:0/836641919 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf001b600 con 0x7f7cf80c25e0 2023-10-06T11:05:49.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.784+0000 7f7cfd6af700 1 -- 172.21.15.146:0/836641919 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cf81583b0 con 0x7f7cf80c25e0 2023-10-06T11:05:49.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.784+0000 7f7cef7fe700 1 -- 172.21.15.146:0/836641919 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf001b9c0 con 0x7f7cf80c25e0 2023-10-06T11:05:49.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.784+0000 7f7cfd6af700 1 -- 172.21.15.146:0/836641919 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cf81491f0 con 0x7f7cf80c25e0 2023-10-06T11:05:49.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.784+0000 7f7cfd6af700 1 -- 172.21.15.146:0/836641919 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cf8158b70 con 0x7f7cf80c25e0 2023-10-06T11:05:49.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.784+0000 7f7cef7fe700 1 -- 172.21.15.146:0/836641919 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7cf00263f0 con 0x7f7cf80c25e0 2023-10-06T11:05:49.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.785+0000 7f7cef7fe700 1 --2- 172.21.15.146:0/836641919 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7cd8066f60 0x7f7cd8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:49.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.785+0000 7f7cf6ffd700 1 --2- 172.21.15.146:0/836641919 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7cd8066f60 0x7f7cd8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:49.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.785+0000 7f7cef7fe700 1 -- 172.21.15.146:0/836641919 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7cf0086850 con 0x7f7cf80c25e0 2023-10-06T11:05:49.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.785+0000 7f7cf6ffd700 1 --2- 172.21.15.146:0/836641919 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7cd8066f60 0x7f7cd8069410 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8007fd0 tx=0x7f7ce8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:49.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.790+0000 7f7cef7fe700 1 -- 172.21.15.146:0/836641919 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7cf0053960 con 0x7f7cf80c25e0 2023-10-06T11:05:49.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.968+0000 7f7cfd6af700 1 -- 172.21.15.146:0/836641919 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7cf804c380 con 0x7f7cd8066f60 2023-10-06T11:05:49.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.976+0000 7f7cef7fe700 1 -- 172.21.15.146:0/836641919 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286868 (secure 0 0 0) 0x7f7cf804c380 con 0x7f7cd8066f60 2023-10-06T11:05:49.981 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:05:49.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.979+0000 7f7cfd6af700 1 -- 172.21.15.146:0/836641919 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7cd8066f60 msgr2=0x7f7cd8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:49.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.979+0000 7f7cfd6af700 1 --2- 172.21.15.146:0/836641919 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7cd8066f60 0x7f7cd8069410 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8007fd0 tx=0x7f7ce8009040 comp rx=0 tx=0).stop 2023-10-06T11:05:49.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.979+0000 7f7cfd6af700 1 -- 172.21.15.146:0/836641919 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cf80c25e0 msgr2=0x7f7cf8067470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:49.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.979+0000 7f7cfd6af700 1 --2- 172.21.15.146:0/836641919 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cf80c25e0 0x7f7cf8067470 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0013000 tx=0x7f7cf0019000 comp rx=0 tx=0).stop 2023-10-06T11:05:49.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.979+0000 7f7cfd6af700 1 -- 172.21.15.146:0/836641919 shutdown_connections 2023-10-06T11:05:49.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.979+0000 7f7cfd6af700 1 --2- 172.21.15.146:0/836641919 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7cd8066f60 0x7f7cd8069410 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:49.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.979+0000 7f7cfd6af700 1 --2- 172.21.15.146:0/836641919 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cf80c25e0 0x7f7cf8067470 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:49.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.979+0000 7f7cfd6af700 1 --2- 172.21.15.146:0/836641919 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cf80c97c0 0x7f7cf8148cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:49.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.979+0000 7f7cfd6af700 1 --2- 172.21.15.146:0/836641919 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7cf80ca330 0x7f7cf80c20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:49.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.979+0000 7f7cfd6af700 1 -- 172.21.15.146:0/836641919 >> 172.21.15.146:0/836641919 conn(0x7f7cf806b060 msgr2=0x7f7cf815a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:49.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.979+0000 7f7cfd6af700 1 -- 172.21.15.146:0/836641919 shutdown_connections 2023-10-06T11:05:49.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:49.979+0000 7f7cfd6af700 1 -- 172.21.15.146:0/836641919 wait complete. 2023-10-06T11:05:49.984 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:05:49.993 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-10-06T11:05:49.132637+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":109,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381112,"kb_used_data":2808,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593608,"statfs":{"total":773094113280,"available":770655854592,"internally_reserved":0,"allocated":2875392,"data_stored":1773408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.004687"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.376223+0000","last_change":"2023-10-06T11:05:44.374095+0000","last_active":"2023-10-06T11:05:44.376223+0000","last_peered":"2023-10-06T11:05:44.376223+0000","last_clean":"2023-10-06T11:05:44.376223+0000","last_became_active":"2023-10-06T11:05:44.373839+0000","last_became_peered":"2023-10-06T11:05:44.373839+0000","last_unstale":"2023-10-06T11:05:44.376223+0000","last_undegraded":"2023-10-06T11:05:44.376223+0000","last_fullsized":"2023-10-06T11:05:44.376223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:25.910038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380398+0000","last_change":"2023-10-06T11:05:44.372580+0000","last_active":"2023-10-06T11:05:44.380398+0000","last_peered":"2023-10-06T11:05:44.380398+0000","last_clean":"2023-10-06T11:05:44.380398+0000","last_became_active":"2023-10-06T11:05:44.372338+0000","last_became_peered":"2023-10-06T11:05:44.372338+0000","last_unstale":"2023-10-06T11:05:44.380398+0000","last_undegraded":"2023-10-06T11:05:44.380398+0000","last_fullsized":"2023-10-06T11:05:44.380398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:49:53.929590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375679+0000","last_change":"2023-10-06T11:05:44.370665+0000","last_active":"2023-10-06T11:05:44.375679+0000","last_peered":"2023-10-06T11:05:44.375679+0000","last_clean":"2023-10-06T11:05:44.375679+0000","last_became_active":"2023-10-06T11:05:44.370393+0000","last_became_peered":"2023-10-06T11:05:44.370393+0000","last_unstale":"2023-10-06T11:05:44.375679+0000","last_undegraded":"2023-10-06T11:05:44.375679+0000","last_fullsized":"2023-10-06T11:05:44.375679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:11:45.592433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377408+0000","last_change":"2023-10-06T11:05:44.371604+0000","last_active":"2023-10-06T11:05:44.377408+0000","last_peered":"2023-10-06T11:05:44.377408+0000","last_clean":"2023-10-06T11:05:44.377408+0000","last_became_active":"2023-10-06T11:05:44.371305+0000","last_became_peered":"2023-10-06T11:05:44.371305+0000","last_unstale":"2023-10-06T11:05:44.377408+0000","last_undegraded":"2023-10-06T11:05:44.377408+0000","last_fullsized":"2023-10-06T11:05:44.377408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:37.914270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.370764+0000","last_change":"2023-10-06T11:05:44.368424+0000","last_active":"2023-10-06T11:05:44.370764+0000","last_peered":"2023-10-06T11:05:44.370764+0000","last_clean":"2023-10-06T11:05:44.370764+0000","last_became_active":"2023-10-06T11:05:44.368174+0000","last_became_peered":"2023-10-06T11:05:44.368174+0000","last_unstale":"2023-10-06T11:05:44.370764+0000","last_undegraded":"2023-10-06T11:05:44.370764+0000","last_fullsized":"2023-10-06T11:05:44.370764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:48.500150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375623+0000","last_change":"2023-10-06T11:05:44.369384+0000","last_active":"2023-10-06T11:05:44.375623+0000","last_peered":"2023-10-06T11:05:44.375623+0000","last_clean":"2023-10-06T11:05:44.375623+0000","last_became_active":"2023-10-06T11:05:44.369114+0000","last_became_peered":"2023-10-06T11:05:44.369114+0000","last_unstale":"2023-10-06T11:05:44.375623+0000","last_undegraded":"2023-10-06T11:05:44.375623+0000","last_fullsized":"2023-10-06T11:05:44.375623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:11:02.117432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.381050+0000","last_change":"2023-10-06T11:05:44.376045+0000","last_active":"2023-10-06T11:05:44.381050+0000","last_peered":"2023-10-06T11:05:44.381050+0000","last_clean":"2023-10-06T11:05:44.381050+0000","last_became_active":"2023-10-06T11:05:44.374697+0000","last_became_peered":"2023-10-06T11:05:44.374697+0000","last_unstale":"2023-10-06T11:05:44.381050+0000","last_undegraded":"2023-10-06T11:05:44.381050+0000","last_fullsized":"2023-10-06T11:05:44.381050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:30:10.233024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377816+0000","last_change":"2023-10-06T11:05:44.370424+0000","last_active":"2023-10-06T11:05:44.377816+0000","last_peered":"2023-10-06T11:05:44.377816+0000","last_clean":"2023-10-06T11:05:44.377816+0000","last_became_active":"2023-10-06T11:05:44.370141+0000","last_became_peered":"2023-10-06T11:05:44.370141+0000","last_unstale":"2023-10-06T11:05:44.377816+0000","last_undegraded":"2023-10-06T11:05:44.377816+0000","last_fullsized":"2023-10-06T11:05:44.377816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:32:17.346227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.374345+0000","last_change":"2023-10-06T11:05:44.370535+0000","last_active":"2023-10-06T11:05:44.374345+0000","last_peered":"2023-10-06T11:05:44.374345+0000","last_clean":"2023-10-06T11:05:44.374345+0000","last_became_active":"2023-10-06T11:05:44.370264+0000","last_became_peered":"2023-10-06T11:05:44.370264+0000","last_unstale":"2023-10-06T11:05:44.374345+0000","last_undegraded":"2023-10-06T11:05:44.374345+0000","last_fullsized":"2023-10-06T11:05:44.374345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:18:11.738273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377689+0000","last_change":"2023-10-06T11:05:44.363111+0000","last_active":"2023-10-06T11:05:44.377689+0000","last_peered":"2023-10-06T11:05:44.377689+0000","last_clean":"2023-10-06T11:05:44.377689+0000","last_became_active":"2023-10-06T11:05:44.362803+0000","last_became_peered":"2023-10-06T11:05:44.362803+0000","last_unstale":"2023-10-06T11:05:44.377689+0000","last_undegraded":"2023-10-06T11:05:44.377689+0000","last_fullsized":"2023-10-06T11:05:44.377689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:49:41.512642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375661+0000","last_change":"2023-10-06T11:05:44.370641+0000","last_active":"2023-10-06T11:05:44.375661+0000","last_peered":"2023-10-06T11:05:44.375661+0000","last_clean":"2023-10-06T11:05:44.375661+0000","last_became_active":"2023-10-06T11:05:44.370078+0000","last_became_peered":"2023-10-06T11:05:44.370078+0000","last_unstale":"2023-10-06T11:05:44.375661+0000","last_undegraded":"2023-10-06T11:05:44.375661+0000","last_fullsized":"2023-10-06T11:05:44.375661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:34:03.025480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.365243+0000","last_change":"2023-10-06T11:05:44.362523+0000","last_active":"2023-10-06T11:05:44.365243+0000","last_peered":"2023-10-06T11:05:44.365243+0000","last_clean":"2023-10-06T11:05:44.365243+0000","last_became_active":"2023-10-06T11:05:44.362248+0000","last_became_peered":"2023-10-06T11:05:44.362248+0000","last_unstale":"2023-10-06T11:05:44.365243+0000","last_undegraded":"2023-10-06T11:05:44.365243+0000","last_fullsized":"2023-10-06T11:05:44.365243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:33.869834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.376261+0000","last_change":"2023-10-06T11:05:44.373706+0000","last_active":"2023-10-06T11:05:44.376261+0000","last_peered":"2023-10-06T11:05:44.376261+0000","last_clean":"2023-10-06T11:05:44.376261+0000","last_became_active":"2023-10-06T11:05:44.373408+0000","last_became_peered":"2023-10-06T11:05:44.373408+0000","last_unstale":"2023-10-06T11:05:44.376261+0000","last_undegraded":"2023-10-06T11:05:44.376261+0000","last_fullsized":"2023-10-06T11:05:44.376261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:28.010695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377714+0000","last_change":"2023-10-06T11:05:44.364121+0000","last_active":"2023-10-06T11:05:44.377714+0000","last_peered":"2023-10-06T11:05:44.377714+0000","last_clean":"2023-10-06T11:05:44.377714+0000","last_became_active":"2023-10-06T11:05:44.363863+0000","last_became_peered":"2023-10-06T11:05:44.363863+0000","last_unstale":"2023-10-06T11:05:44.377714+0000","last_undegraded":"2023-10-06T11:05:44.377714+0000","last_fullsized":"2023-10-06T11:05:44.377714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:51.490766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.381068+0000","last_change":"2023-10-06T11:05:44.376146+0000","last_active":"2023-10-06T11:05:44.381068+0000","last_peered":"2023-10-06T11:05:44.381068+0000","last_clean":"2023-10-06T11:05:44.381068+0000","last_became_active":"2023-10-06T11:05:44.375877+0000","last_became_peered":"2023-10-06T11:05:44.375877+0000","last_unstale":"2023-10-06T11:05:44.381068+0000","last_undegraded":"2023-10-06T11:05:44.381068+0000","last_fullsized":"2023-10-06T11:05:44.381068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:25:37.173612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375588+0000","last_change":"2023-10-06T11:05:44.371531+0000","last_active":"2023-10-06T11:05:44.375588+0000","last_peered":"2023-10-06T11:05:44.375588+0000","last_clean":"2023-10-06T11:05:44.375588+0000","last_became_active":"2023-10-06T11:05:44.371082+0000","last_became_peered":"2023-10-06T11:05:44.371082+0000","last_unstale":"2023-10-06T11:05:44.375588+0000","last_undegraded":"2023-10-06T11:05:44.375588+0000","last_fullsized":"2023-10-06T11:05:44.375588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:16:26.923074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377465+0000","last_change":"2023-10-06T11:05:44.374262+0000","last_active":"2023-10-06T11:05:44.377465+0000","last_peered":"2023-10-06T11:05:44.377465+0000","last_clean":"2023-10-06T11:05:44.377465+0000","last_became_active":"2023-10-06T11:05:44.373997+0000","last_became_peered":"2023-10-06T11:05:44.373997+0000","last_unstale":"2023-10-06T11:05:44.377465+0000","last_undegraded":"2023-10-06T11:05:44.377465+0000","last_fullsized":"2023-10-06T11:05:44.377465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:30:10.233024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375434+0000","last_change":"2023-10-06T11:05:44.369716+0000","last_active":"2023-10-06T11:05:44.375434+0000","last_peered":"2023-10-06T11:05:44.375434+0000","last_clean":"2023-10-06T11:05:44.375434+0000","last_became_active":"2023-10-06T11:05:44.369434+0000","last_became_peered":"2023-10-06T11:05:44.369434+0000","last_unstale":"2023-10-06T11:05:44.375434+0000","last_undegraded":"2023-10-06T11:05:44.375434+0000","last_fullsized":"2023-10-06T11:05:44.375434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:53:21.828799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377738+0000","last_change":"2023-10-06T11:05:44.376536+0000","last_active":"2023-10-06T11:05:44.377738+0000","last_peered":"2023-10-06T11:05:44.377738+0000","last_clean":"2023-10-06T11:05:44.377738+0000","last_became_active":"2023-10-06T11:05:44.376291+0000","last_became_peered":"2023-10-06T11:05:44.376291+0000","last_unstale":"2023-10-06T11:05:44.377738+0000","last_undegraded":"2023-10-06T11:05:44.377738+0000","last_fullsized":"2023-10-06T11:05:44.377738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:19.308513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380092+0000","last_change":"2023-10-06T11:05:44.374492+0000","last_active":"2023-10-06T11:05:44.380092+0000","last_peered":"2023-10-06T11:05:44.380092+0000","last_clean":"2023-10-06T11:05:44.380092+0000","last_became_active":"2023-10-06T11:05:44.374108+0000","last_became_peered":"2023-10-06T11:05:44.374108+0000","last_unstale":"2023-10-06T11:05:44.380092+0000","last_undegraded":"2023-10-06T11:05:44.380092+0000","last_fullsized":"2023-10-06T11:05:44.380092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:36:18.739157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380978+0000","last_change":"2023-10-06T11:05:44.373773+0000","last_active":"2023-10-06T11:05:44.380978+0000","last_peered":"2023-10-06T11:05:44.380978+0000","last_clean":"2023-10-06T11:05:44.380978+0000","last_became_active":"2023-10-06T11:05:44.373445+0000","last_became_peered":"2023-10-06T11:05:44.373445+0000","last_unstale":"2023-10-06T11:05:44.380978+0000","last_undegraded":"2023-10-06T11:05:44.380978+0000","last_fullsized":"2023-10-06T11:05:44.380978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:48.500150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.370569+0000","last_change":"2023-10-06T11:05:44.365767+0000","last_active":"2023-10-06T11:05:44.370569+0000","last_peered":"2023-10-06T11:05:44.370569+0000","last_clean":"2023-10-06T11:05:44.370569+0000","last_became_active":"2023-10-06T11:05:44.365489+0000","last_became_peered":"2023-10-06T11:05:44.365489+0000","last_unstale":"2023-10-06T11:05:44.370569+0000","last_undegraded":"2023-10-06T11:05:44.370569+0000","last_fullsized":"2023-10-06T11:05:44.370569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:36:18.739157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379611+0000","last_change":"2023-10-06T11:05:44.373554+0000","last_active":"2023-10-06T11:05:44.379611+0000","last_peered":"2023-10-06T11:05:44.379611+0000","last_clean":"2023-10-06T11:05:44.379611+0000","last_became_active":"2023-10-06T11:05:44.373293+0000","last_became_peered":"2023-10-06T11:05:44.373293+0000","last_unstale":"2023-10-06T11:05:44.379611+0000","last_undegraded":"2023-10-06T11:05:44.379611+0000","last_fullsized":"2023-10-06T11:05:44.379611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:32:31.703547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380998+0000","last_change":"2023-10-06T11:05:44.373832+0000","last_active":"2023-10-06T11:05:44.380998+0000","last_peered":"2023-10-06T11:05:44.380998+0000","last_clean":"2023-10-06T11:05:44.380998+0000","last_became_active":"2023-10-06T11:05:44.373527+0000","last_became_peered":"2023-10-06T11:05:44.373527+0000","last_unstale":"2023-10-06T11:05:44.380998+0000","last_undegraded":"2023-10-06T11:05:44.380998+0000","last_fullsized":"2023-10-06T11:05:44.380998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:49:53.929590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377989+0000","last_change":"2023-10-06T11:05:44.375109+0000","last_active":"2023-10-06T11:05:44.377989+0000","last_peered":"2023-10-06T11:05:44.377989+0000","last_clean":"2023-10-06T11:05:44.377989+0000","last_became_active":"2023-10-06T11:05:44.374861+0000","last_became_peered":"2023-10-06T11:05:44.374861+0000","last_unstale":"2023-10-06T11:05:44.377989+0000","last_undegraded":"2023-10-06T11:05:44.377989+0000","last_fullsized":"2023-10-06T11:05:44.377989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:36:26.414372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377747+0000","last_change":"2023-10-06T11:05:44.372987+0000","last_active":"2023-10-06T11:05:44.377747+0000","last_peered":"2023-10-06T11:05:44.377747+0000","last_clean":"2023-10-06T11:05:44.377747+0000","last_became_active":"2023-10-06T11:05:44.369828+0000","last_became_peered":"2023-10-06T11:05:44.369828+0000","last_unstale":"2023-10-06T11:05:44.377747+0000","last_undegraded":"2023-10-06T11:05:44.377747+0000","last_fullsized":"2023-10-06T11:05:44.377747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:42.381985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380422+0000","last_change":"2023-10-06T11:05:44.372985+0000","last_active":"2023-10-06T11:05:44.380422+0000","last_peered":"2023-10-06T11:05:44.380422+0000","last_clean":"2023-10-06T11:05:44.380422+0000","last_became_active":"2023-10-06T11:05:44.372531+0000","last_became_peered":"2023-10-06T11:05:44.372531+0000","last_unstale":"2023-10-06T11:05:44.380422+0000","last_undegraded":"2023-10-06T11:05:44.380422+0000","last_fullsized":"2023-10-06T11:05:44.380422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:36:26.414372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.382453+0000","last_change":"2023-10-06T11:05:43.369136+0000","last_active":"2023-10-06T11:05:44.382453+0000","last_peered":"2023-10-06T11:05:44.382453+0000","last_clean":"2023-10-06T11:05:44.382453+0000","last_became_active":"2023-10-06T11:05:43.368830+0000","last_became_peered":"2023-10-06T11:05:43.368830+0000","last_unstale":"2023-10-06T11:05:44.382453+0000","last_undegraded":"2023-10-06T11:05:44.382453+0000","last_fullsized":"2023-10-06T11:05:44.382453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:27.003956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.370597+0000","last_change":"2023-10-06T11:05:44.367477+0000","last_active":"2023-10-06T11:05:44.370597+0000","last_peered":"2023-10-06T11:05:44.370597+0000","last_clean":"2023-10-06T11:05:44.370597+0000","last_became_active":"2023-10-06T11:05:44.367216+0000","last_became_peered":"2023-10-06T11:05:44.367216+0000","last_unstale":"2023-10-06T11:05:44.370597+0000","last_undegraded":"2023-10-06T11:05:44.370597+0000","last_fullsized":"2023-10-06T11:05:44.370597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:48.500150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.364950+0000","last_change":"2023-10-06T11:05:43.369127+0000","last_active":"2023-10-06T11:05:44.364950+0000","last_peered":"2023-10-06T11:05:44.364950+0000","last_clean":"2023-10-06T11:05:44.364950+0000","last_became_active":"2023-10-06T11:05:43.368806+0000","last_became_peered":"2023-10-06T11:05:43.368806+0000","last_unstale":"2023-10-06T11:05:44.364950+0000","last_undegraded":"2023-10-06T11:05:44.364950+0000","last_fullsized":"2023-10-06T11:05:44.364950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:51.324615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.370930+0000","last_change":"2023-10-06T11:05:44.367950+0000","last_active":"2023-10-06T11:05:44.370930+0000","last_peered":"2023-10-06T11:05:44.370930+0000","last_clean":"2023-10-06T11:05:44.370930+0000","last_became_active":"2023-10-06T11:05:44.367682+0000","last_became_peered":"2023-10-06T11:05:44.367682+0000","last_unstale":"2023-10-06T11:05:44.370930+0000","last_undegraded":"2023-10-06T11:05:44.370930+0000","last_fullsized":"2023-10-06T11:05:44.370930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:53:21.828799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.356971+0000","last_change":"2023-10-06T11:05:43.366406+0000","last_active":"2023-10-06T11:05:44.356971+0000","last_peered":"2023-10-06T11:05:44.356971+0000","last_clean":"2023-10-06T11:05:44.356971+0000","last_became_active":"2023-10-06T11:05:43.366004+0000","last_became_peered":"2023-10-06T11:05:43.366004+0000","last_unstale":"2023-10-06T11:05:44.356971+0000","last_undegraded":"2023-10-06T11:05:44.356971+0000","last_fullsized":"2023-10-06T11:05:44.356971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:00.477669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.382373+0000","last_change":"2023-10-06T11:05:44.378728+0000","last_active":"2023-10-06T11:05:44.382373+0000","last_peered":"2023-10-06T11:05:44.382373+0000","last_clean":"2023-10-06T11:05:44.382373+0000","last_became_active":"2023-10-06T11:05:44.378467+0000","last_became_peered":"2023-10-06T11:05:44.378467+0000","last_unstale":"2023-10-06T11:05:44.382373+0000","last_undegraded":"2023-10-06T11:05:44.382373+0000","last_fullsized":"2023-10-06T11:05:44.382373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:20:05.796456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.353362+0000","last_change":"2023-10-06T11:05:43.362935+0000","last_active":"2023-10-06T11:05:44.353362+0000","last_peered":"2023-10-06T11:05:44.353362+0000","last_clean":"2023-10-06T11:05:44.353362+0000","last_became_active":"2023-10-06T11:05:43.362642+0000","last_became_peered":"2023-10-06T11:05:43.362642+0000","last_unstale":"2023-10-06T11:05:44.353362+0000","last_undegraded":"2023-10-06T11:05:44.353362+0000","last_fullsized":"2023-10-06T11:05:44.353362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:36.907530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.371257+0000","last_change":"2023-10-06T11:05:44.366360+0000","last_active":"2023-10-06T11:05:44.371257+0000","last_peered":"2023-10-06T11:05:44.371257+0000","last_clean":"2023-10-06T11:05:44.371257+0000","last_became_active":"2023-10-06T11:05:44.366097+0000","last_became_peered":"2023-10-06T11:05:44.366097+0000","last_unstale":"2023-10-06T11:05:44.371257+0000","last_undegraded":"2023-10-06T11:05:44.371257+0000","last_fullsized":"2023-10-06T11:05:44.371257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:18:11.738273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.357158+0000","last_change":"2023-10-06T11:05:43.365582+0000","last_active":"2023-10-06T11:05:44.357158+0000","last_peered":"2023-10-06T11:05:44.357158+0000","last_clean":"2023-10-06T11:05:44.357158+0000","last_became_active":"2023-10-06T11:05:43.365197+0000","last_became_peered":"2023-10-06T11:05:43.365197+0000","last_unstale":"2023-10-06T11:05:44.357158+0000","last_undegraded":"2023-10-06T11:05:44.357158+0000","last_fullsized":"2023-10-06T11:05:44.357158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:59:28.141215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.373455+0000","last_change":"2023-10-06T11:05:44.369545+0000","last_active":"2023-10-06T11:05:44.373455+0000","last_peered":"2023-10-06T11:05:44.373455+0000","last_clean":"2023-10-06T11:05:44.373455+0000","last_became_active":"2023-10-06T11:05:44.369228+0000","last_became_peered":"2023-10-06T11:05:44.369228+0000","last_unstale":"2023-10-06T11:05:44.373455+0000","last_undegraded":"2023-10-06T11:05:44.373455+0000","last_fullsized":"2023-10-06T11:05:44.373455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:36:18.739157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.378674+0000","last_change":"2023-10-06T11:05:43.370700+0000","last_active":"2023-10-06T11:05:44.378674+0000","last_peered":"2023-10-06T11:05:44.378674+0000","last_clean":"2023-10-06T11:05:44.378674+0000","last_became_active":"2023-10-06T11:05:43.370418+0000","last_became_peered":"2023-10-06T11:05:43.370418+0000","last_unstale":"2023-10-06T11:05:44.378674+0000","last_undegraded":"2023-10-06T11:05:44.378674+0000","last_fullsized":"2023-10-06T11:05:44.378674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:03.585687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377957+0000","last_change":"2023-10-06T11:05:44.375285+0000","last_active":"2023-10-06T11:05:44.377957+0000","last_peered":"2023-10-06T11:05:44.377957+0000","last_clean":"2023-10-06T11:05:44.377957+0000","last_became_active":"2023-10-06T11:05:44.374774+0000","last_became_peered":"2023-10-06T11:05:44.374774+0000","last_unstale":"2023-10-06T11:05:44.377957+0000","last_undegraded":"2023-10-06T11:05:44.377957+0000","last_fullsized":"2023-10-06T11:05:44.377957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:32:17.346227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.385298+0000","last_change":"2023-10-06T11:05:43.363844+0000","last_active":"2023-10-06T11:05:44.385298+0000","last_peered":"2023-10-06T11:05:44.385298+0000","last_clean":"2023-10-06T11:05:44.385298+0000","last_became_active":"2023-10-06T11:05:43.363568+0000","last_became_peered":"2023-10-06T11:05:43.363568+0000","last_unstale":"2023-10-06T11:05:44.385298+0000","last_undegraded":"2023-10-06T11:05:44.385298+0000","last_fullsized":"2023-10-06T11:05:44.385298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:51.324615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.382342+0000","last_change":"2023-10-06T11:05:44.375145+0000","last_active":"2023-10-06T11:05:44.382342+0000","last_peered":"2023-10-06T11:05:44.382342+0000","last_clean":"2023-10-06T11:05:44.382342+0000","last_became_active":"2023-10-06T11:05:44.374868+0000","last_became_peered":"2023-10-06T11:05:44.374868+0000","last_unstale":"2023-10-06T11:05:44.382342+0000","last_undegraded":"2023-10-06T11:05:44.382342+0000","last_fullsized":"2023-10-06T11:05:44.382342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:48.500150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.378534+0000","last_change":"2023-10-06T11:05:43.369646+0000","last_active":"2023-10-06T11:05:44.378534+0000","last_peered":"2023-10-06T11:05:44.378534+0000","last_clean":"2023-10-06T11:05:44.378534+0000","last_became_active":"2023-10-06T11:05:43.369353+0000","last_became_peered":"2023-10-06T11:05:43.369353+0000","last_unstale":"2023-10-06T11:05:44.378534+0000","last_undegraded":"2023-10-06T11:05:44.378534+0000","last_fullsized":"2023-10-06T11:05:44.378534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:50.484027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379530+0000","last_change":"2023-10-06T11:05:44.372738+0000","last_active":"2023-10-06T11:05:44.379530+0000","last_peered":"2023-10-06T11:05:44.379530+0000","last_clean":"2023-10-06T11:05:44.379530+0000","last_became_active":"2023-10-06T11:05:44.372299+0000","last_became_peered":"2023-10-06T11:05:44.372299+0000","last_unstale":"2023-10-06T11:05:44.379530+0000","last_undegraded":"2023-10-06T11:05:44.379530+0000","last_fullsized":"2023-10-06T11:05:44.379530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:53:21.828799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.352712+0000","last_change":"2023-10-06T11:05:43.364085+0000","last_active":"2023-10-06T11:05:44.352712+0000","last_peered":"2023-10-06T11:05:44.352712+0000","last_clean":"2023-10-06T11:05:44.352712+0000","last_became_active":"2023-10-06T11:05:43.363844+0000","last_became_peered":"2023-10-06T11:05:43.363844+0000","last_unstale":"2023-10-06T11:05:44.352712+0000","last_undegraded":"2023-10-06T11:05:44.352712+0000","last_fullsized":"2023-10-06T11:05:44.352712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:51.324615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380405+0000","last_change":"2023-10-06T11:05:44.372815+0000","last_active":"2023-10-06T11:05:44.380405+0000","last_peered":"2023-10-06T11:05:44.380405+0000","last_clean":"2023-10-06T11:05:44.380405+0000","last_became_active":"2023-10-06T11:05:44.372237+0000","last_became_peered":"2023-10-06T11:05:44.372237+0000","last_unstale":"2023-10-06T11:05:44.380405+0000","last_undegraded":"2023-10-06T11:05:44.380405+0000","last_fullsized":"2023-10-06T11:05:44.380405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:42.381985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.363864+0000","last_change":"2023-10-06T11:05:43.369142+0000","last_active":"2023-10-06T11:05:44.363864+0000","last_peered":"2023-10-06T11:05:44.363864+0000","last_clean":"2023-10-06T11:05:44.363864+0000","last_became_active":"2023-10-06T11:05:43.368847+0000","last_became_peered":"2023-10-06T11:05:43.368847+0000","last_unstale":"2023-10-06T11:05:44.363864+0000","last_undegraded":"2023-10-06T11:05:44.363864+0000","last_fullsized":"2023-10-06T11:05:44.363864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:48:23.698446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.373918+0000","last_change":"2023-10-06T11:05:44.370314+0000","last_active":"2023-10-06T11:05:44.373918+0000","last_peered":"2023-10-06T11:05:44.373918+0000","last_clean":"2023-10-06T11:05:44.373918+0000","last_became_active":"2023-10-06T11:05:44.370065+0000","last_became_peered":"2023-10-06T11:05:44.370065+0000","last_unstale":"2023-10-06T11:05:44.373918+0000","last_undegraded":"2023-10-06T11:05:44.373918+0000","last_fullsized":"2023-10-06T11:05:44.373918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:32:31.703547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377619+0000","last_change":"2023-10-06T11:05:43.366052+0000","last_active":"2023-10-06T11:05:44.377619+0000","last_peered":"2023-10-06T11:05:44.377619+0000","last_clean":"2023-10-06T11:05:44.377619+0000","last_became_active":"2023-10-06T11:05:43.365790+0000","last_became_peered":"2023-10-06T11:05:43.365790+0000","last_unstale":"2023-10-06T11:05:44.377619+0000","last_undegraded":"2023-10-06T11:05:44.377619+0000","last_fullsized":"2023-10-06T11:05:44.377619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:59:28.141215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379857+0000","last_change":"2023-10-06T11:05:44.372870+0000","last_active":"2023-10-06T11:05:44.379857+0000","last_peered":"2023-10-06T11:05:44.379857+0000","last_clean":"2023-10-06T11:05:44.379857+0000","last_became_active":"2023-10-06T11:05:44.372480+0000","last_became_peered":"2023-10-06T11:05:44.372480+0000","last_unstale":"2023-10-06T11:05:44.379857+0000","last_undegraded":"2023-10-06T11:05:44.379857+0000","last_fullsized":"2023-10-06T11:05:44.379857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:25:37.173612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.378371+0000","last_change":"2023-10-06T11:05:43.369672+0000","last_active":"2023-10-06T11:05:44.378371+0000","last_peered":"2023-10-06T11:05:44.378371+0000","last_clean":"2023-10-06T11:05:44.378371+0000","last_became_active":"2023-10-06T11:05:43.369415+0000","last_became_peered":"2023-10-06T11:05:43.369415+0000","last_unstale":"2023-10-06T11:05:44.378371+0000","last_undegraded":"2023-10-06T11:05:44.378371+0000","last_fullsized":"2023-10-06T11:05:44.378371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:21:07.005347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.385017+0000","last_change":"2023-10-06T11:05:44.380100+0000","last_active":"2023-10-06T11:05:44.385017+0000","last_peered":"2023-10-06T11:05:44.385017+0000","last_clean":"2023-10-06T11:05:44.385017+0000","last_became_active":"2023-10-06T11:05:44.379686+0000","last_became_peered":"2023-10-06T11:05:44.379686+0000","last_unstale":"2023-10-06T11:05:44.385017+0000","last_undegraded":"2023-10-06T11:05:44.385017+0000","last_fullsized":"2023-10-06T11:05:44.385017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:32:31.703547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.378652+0000","last_change":"2023-10-06T11:05:43.369280+0000","last_active":"2023-10-06T11:05:44.378652+0000","last_peered":"2023-10-06T11:05:44.378652+0000","last_clean":"2023-10-06T11:05:44.378652+0000","last_became_active":"2023-10-06T11:05:43.369002+0000","last_became_peered":"2023-10-06T11:05:43.369002+0000","last_unstale":"2023-10-06T11:05:44.378652+0000","last_undegraded":"2023-10-06T11:05:44.378652+0000","last_fullsized":"2023-10-06T11:05:44.378652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:53:55.024707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.365517+0000","last_change":"2023-10-06T11:05:44.363074+0000","last_active":"2023-10-06T11:05:44.365517+0000","last_peered":"2023-10-06T11:05:44.365517+0000","last_clean":"2023-10-06T11:05:44.365517+0000","last_became_active":"2023-10-06T11:05:44.362798+0000","last_became_peered":"2023-10-06T11:05:44.362798+0000","last_unstale":"2023-10-06T11:05:44.365517+0000","last_undegraded":"2023-10-06T11:05:44.365517+0000","last_fullsized":"2023-10-06T11:05:44.365517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:48:11.590704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.378605+0000","last_change":"2023-10-06T11:05:43.368847+0000","last_active":"2023-10-06T11:05:44.378605+0000","last_peered":"2023-10-06T11:05:44.378605+0000","last_clean":"2023-10-06T11:05:44.378605+0000","last_became_active":"2023-10-06T11:05:43.368394+0000","last_became_peered":"2023-10-06T11:05:43.368394+0000","last_unstale":"2023-10-06T11:05:44.378605+0000","last_undegraded":"2023-10-06T11:05:44.378605+0000","last_fullsized":"2023-10-06T11:05:44.378605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:26.238071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380176+0000","last_change":"2023-10-06T11:05:44.374404+0000","last_active":"2023-10-06T11:05:44.380176+0000","last_peered":"2023-10-06T11:05:44.380176+0000","last_clean":"2023-10-06T11:05:44.380176+0000","last_became_active":"2023-10-06T11:05:44.374017+0000","last_became_peered":"2023-10-06T11:05:44.374017+0000","last_unstale":"2023-10-06T11:05:44.380176+0000","last_undegraded":"2023-10-06T11:05:44.380176+0000","last_fullsized":"2023-10-06T11:05:44.380176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:51.490766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.354872+0000","last_change":"2023-10-06T11:05:43.368442+0000","last_active":"2023-10-06T11:05:44.354872+0000","last_peered":"2023-10-06T11:05:44.354872+0000","last_clean":"2023-10-06T11:05:44.354872+0000","last_became_active":"2023-10-06T11:05:43.368152+0000","last_became_peered":"2023-10-06T11:05:43.368152+0000","last_unstale":"2023-10-06T11:05:44.354872+0000","last_undegraded":"2023-10-06T11:05:44.354872+0000","last_fullsized":"2023-10-06T11:05:44.354872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:27.003956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.371685+0000","last_change":"2023-10-06T11:05:44.368980+0000","last_active":"2023-10-06T11:05:44.371685+0000","last_peered":"2023-10-06T11:05:44.371685+0000","last_clean":"2023-10-06T11:05:44.371685+0000","last_became_active":"2023-10-06T11:05:44.368693+0000","last_became_peered":"2023-10-06T11:05:44.368693+0000","last_unstale":"2023-10-06T11:05:44.371685+0000","last_undegraded":"2023-10-06T11:05:44.371685+0000","last_fullsized":"2023-10-06T11:05:44.371685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:25:37.173612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.376448+0000","last_change":"2023-10-06T11:05:43.366389+0000","last_active":"2023-10-06T11:05:44.376448+0000","last_peered":"2023-10-06T11:05:44.376448+0000","last_clean":"2023-10-06T11:05:44.376448+0000","last_became_active":"2023-10-06T11:05:43.366041+0000","last_became_peered":"2023-10-06T11:05:43.366041+0000","last_unstale":"2023-10-06T11:05:44.376448+0000","last_undegraded":"2023-10-06T11:05:44.376448+0000","last_fullsized":"2023-10-06T11:05:44.376448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:18.301774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375589+0000","last_change":"2023-10-06T11:05:44.371594+0000","last_active":"2023-10-06T11:05:44.375589+0000","last_peered":"2023-10-06T11:05:44.375589+0000","last_clean":"2023-10-06T11:05:44.375589+0000","last_became_active":"2023-10-06T11:05:44.371316+0000","last_became_peered":"2023-10-06T11:05:44.371316+0000","last_unstale":"2023-10-06T11:05:44.375589+0000","last_undegraded":"2023-10-06T11:05:44.375589+0000","last_fullsized":"2023-10-06T11:05:44.375589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:23:15.847562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.365041+0000","last_change":"2023-10-06T11:05:43.362138+0000","last_active":"2023-10-06T11:05:44.365041+0000","last_peered":"2023-10-06T11:05:44.365041+0000","last_clean":"2023-10-06T11:05:44.365041+0000","last_became_active":"2023-10-06T11:05:43.361796+0000","last_became_peered":"2023-10-06T11:05:43.361796+0000","last_unstale":"2023-10-06T11:05:44.365041+0000","last_undegraded":"2023-10-06T11:05:44.365041+0000","last_fullsized":"2023-10-06T11:05:44.365041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:51.324615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375623+0000","last_change":"2023-10-06T11:05:44.368661+0000","last_active":"2023-10-06T11:05:44.375623+0000","last_peered":"2023-10-06T11:05:44.375623+0000","last_clean":"2023-10-06T11:05:44.375623+0000","last_became_active":"2023-10-06T11:05:44.368296+0000","last_became_peered":"2023-10-06T11:05:44.368296+0000","last_unstale":"2023-10-06T11:05:44.375623+0000","last_undegraded":"2023-10-06T11:05:44.375623+0000","last_fullsized":"2023-10-06T11:05:44.375623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:42:21.740811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.354312+0000","last_change":"2023-10-06T11:05:43.357853+0000","last_active":"2023-10-06T11:05:44.354312+0000","last_peered":"2023-10-06T11:05:44.354312+0000","last_clean":"2023-10-06T11:05:44.354312+0000","last_became_active":"2023-10-06T11:05:43.357572+0000","last_became_peered":"2023-10-06T11:05:43.357572+0000","last_unstale":"2023-10-06T11:05:44.354312+0000","last_undegraded":"2023-10-06T11:05:44.354312+0000","last_fullsized":"2023-10-06T11:05:44.354312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:18.301774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380069+0000","last_change":"2023-10-06T11:05:44.374211+0000","last_active":"2023-10-06T11:05:44.380069+0000","last_peered":"2023-10-06T11:05:44.380069+0000","last_clean":"2023-10-06T11:05:44.380069+0000","last_became_active":"2023-10-06T11:05:44.373924+0000","last_became_peered":"2023-10-06T11:05:44.373924+0000","last_unstale":"2023-10-06T11:05:44.380069+0000","last_undegraded":"2023-10-06T11:05:44.380069+0000","last_fullsized":"2023-10-06T11:05:44.380069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:18:11.738273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.357364+0000","last_change":"2023-10-06T11:05:43.367123+0000","last_active":"2023-10-06T11:05:44.357364+0000","last_peered":"2023-10-06T11:05:44.357364+0000","last_clean":"2023-10-06T11:05:44.357364+0000","last_became_active":"2023-10-06T11:05:43.366861+0000","last_became_peered":"2023-10-06T11:05:43.366861+0000","last_unstale":"2023-10-06T11:05:44.357364+0000","last_undegraded":"2023-10-06T11:05:44.357364+0000","last_fullsized":"2023-10-06T11:05:44.357364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:32.863094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377938+0000","last_change":"2023-10-06T11:05:44.374963+0000","last_active":"2023-10-06T11:05:44.377938+0000","last_peered":"2023-10-06T11:05:44.377938+0000","last_clean":"2023-10-06T11:05:44.377938+0000","last_became_active":"2023-10-06T11:05:44.374524+0000","last_became_peered":"2023-10-06T11:05:44.374524+0000","last_unstale":"2023-10-06T11:05:44.377938+0000","last_undegraded":"2023-10-06T11:05:44.377938+0000","last_fullsized":"2023-10-06T11:05:44.377938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:27.244810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379794+0000","last_change":"2023-10-06T11:05:43.367084+0000","last_active":"2023-10-06T11:05:44.379794+0000","last_peered":"2023-10-06T11:05:44.379794+0000","last_clean":"2023-10-06T11:05:44.379794+0000","last_became_active":"2023-10-06T11:05:43.366813+0000","last_became_peered":"2023-10-06T11:05:43.366813+0000","last_unstale":"2023-10-06T11:05:44.379794+0000","last_undegraded":"2023-10-06T11:05:44.379794+0000","last_fullsized":"2023-10-06T11:05:44.379794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:27.003956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.357296+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:05:44.357296+0000","last_peered":"2023-10-06T11:05:44.357296+0000","last_clean":"2023-10-06T11:05:44.357296+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:05:44.357296+0000","last_undegraded":"2023-10-06T11:05:44.357296+0000","last_fullsized":"2023-10-06T11:05:44.357296+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380176+0000","last_change":"2023-10-06T11:05:44.371162+0000","last_active":"2023-10-06T11:05:44.380176+0000","last_peered":"2023-10-06T11:05:44.380176+0000","last_clean":"2023-10-06T11:05:44.380176+0000","last_became_active":"2023-10-06T11:05:44.370923+0000","last_became_peered":"2023-10-06T11:05:44.370923+0000","last_unstale":"2023-10-06T11:05:44.380176+0000","last_undegraded":"2023-10-06T11:05:44.380176+0000","last_fullsized":"2023-10-06T11:05:44.380176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:20.240548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.356434+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:05:44.356434+0000","last_peered":"2023-10-06T11:05:44.356434+0000","last_clean":"2023-10-06T11:05:44.356434+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:05:44.356434+0000","last_undegraded":"2023-10-06T11:05:44.356434+0000","last_fullsized":"2023-10-06T11:05:44.356434+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.353543+0000","last_change":"2023-10-06T11:05:43.365664+0000","last_active":"2023-10-06T11:05:44.353543+0000","last_peered":"2023-10-06T11:05:44.353543+0000","last_clean":"2023-10-06T11:05:44.353543+0000","last_became_active":"2023-10-06T11:05:43.365413+0000","last_became_peered":"2023-10-06T11:05:43.365413+0000","last_unstale":"2023-10-06T11:05:44.353543+0000","last_undegraded":"2023-10-06T11:05:44.353543+0000","last_fullsized":"2023-10-06T11:05:44.353543+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:32.863094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.382458+0000","last_change":"2023-10-06T11:05:44.376907+0000","last_active":"2023-10-06T11:05:44.382458+0000","last_peered":"2023-10-06T11:05:44.382458+0000","last_clean":"2023-10-06T11:05:44.382458+0000","last_became_active":"2023-10-06T11:05:44.376549+0000","last_became_peered":"2023-10-06T11:05:44.376549+0000","last_unstale":"2023-10-06T11:05:44.382458+0000","last_undegraded":"2023-10-06T11:05:44.382458+0000","last_fullsized":"2023-10-06T11:05:44.382458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:48:35.935962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.364783+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:05:44.364783+0000","last_peered":"2023-10-06T11:05:44.364783+0000","last_clean":"2023-10-06T11:05:44.364783+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:05:44.364783+0000","last_undegraded":"2023-10-06T11:05:44.364783+0000","last_fullsized":"2023-10-06T11:05:44.364783+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.366104+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:05:44.366104+0000","last_peered":"2023-10-06T11:05:44.366104+0000","last_clean":"2023-10-06T11:05:44.366104+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:05:44.366104+0000","last_undegraded":"2023-10-06T11:05:44.366104+0000","last_fullsized":"2023-10-06T11:05:44.366104+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.352615+0000","last_change":"2023-10-06T11:05:43.368370+0000","last_active":"2023-10-06T11:05:44.352615+0000","last_peered":"2023-10-06T11:05:44.352615+0000","last_clean":"2023-10-06T11:05:44.352615+0000","last_became_active":"2023-10-06T11:05:43.368103+0000","last_became_peered":"2023-10-06T11:05:43.368103+0000","last_unstale":"2023-10-06T11:05:44.352615+0000","last_undegraded":"2023-10-06T11:05:44.352615+0000","last_fullsized":"2023-10-06T11:05:44.352615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:24.903299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.372002+0000","last_change":"2023-10-06T11:05:44.369604+0000","last_active":"2023-10-06T11:05:44.372002+0000","last_peered":"2023-10-06T11:05:44.372002+0000","last_clean":"2023-10-06T11:05:44.372002+0000","last_became_active":"2023-10-06T11:05:44.368781+0000","last_became_peered":"2023-10-06T11:05:44.368781+0000","last_unstale":"2023-10-06T11:05:44.372002+0000","last_undegraded":"2023-10-06T11:05:44.372002+0000","last_fullsized":"2023-10-06T11:05:44.372002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:20.240548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.361406+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:05:44.361406+0000","last_peered":"2023-10-06T11:05:44.361406+0000","last_clean":"2023-10-06T11:05:44.361406+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:05:44.361406+0000","last_undegraded":"2023-10-06T11:05:44.361406+0000","last_fullsized":"2023-10-06T11:05:44.361406+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.364677+0000","last_change":"2023-10-06T11:05:43.367969+0000","last_active":"2023-10-06T11:05:44.364677+0000","last_peered":"2023-10-06T11:05:44.364677+0000","last_clean":"2023-10-06T11:05:44.364677+0000","last_became_active":"2023-10-06T11:05:43.367720+0000","last_became_peered":"2023-10-06T11:05:43.367720+0000","last_unstale":"2023-10-06T11:05:44.364677+0000","last_undegraded":"2023-10-06T11:05:44.364677+0000","last_fullsized":"2023-10-06T11:05:44.364677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:18.301774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379201+0000","last_change":"2023-10-06T11:05:44.378622+0000","last_active":"2023-10-06T11:05:44.379201+0000","last_peered":"2023-10-06T11:05:44.379201+0000","last_clean":"2023-10-06T11:05:44.379201+0000","last_became_active":"2023-10-06T11:05:44.378399+0000","last_became_peered":"2023-10-06T11:05:44.378399+0000","last_unstale":"2023-10-06T11:05:44.379201+0000","last_undegraded":"2023-10-06T11:05:44.379201+0000","last_fullsized":"2023-10-06T11:05:44.379201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:49:53.929590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.365682+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:05:44.365682+0000","last_peered":"2023-10-06T11:05:44.365682+0000","last_clean":"2023-10-06T11:05:44.365682+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:05:44.365682+0000","last_undegraded":"2023-10-06T11:05:44.365682+0000","last_fullsized":"2023-10-06T11:05:44.365682+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.355393+0000","last_change":"2023-10-06T11:05:43.364706+0000","last_active":"2023-10-06T11:05:44.355393+0000","last_peered":"2023-10-06T11:05:44.355393+0000","last_clean":"2023-10-06T11:05:44.355393+0000","last_became_active":"2023-10-06T11:05:43.364448+0000","last_became_peered":"2023-10-06T11:05:43.364448+0000","last_unstale":"2023-10-06T11:05:44.355393+0000","last_undegraded":"2023-10-06T11:05:44.355393+0000","last_fullsized":"2023-10-06T11:05:44.355393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:24.903299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.373780+0000","last_change":"2023-10-06T11:05:44.369625+0000","last_active":"2023-10-06T11:05:44.373780+0000","last_peered":"2023-10-06T11:05:44.373780+0000","last_clean":"2023-10-06T11:05:44.373780+0000","last_became_active":"2023-10-06T11:05:44.369370+0000","last_became_peered":"2023-10-06T11:05:44.369370+0000","last_unstale":"2023-10-06T11:05:44.373780+0000","last_undegraded":"2023-10-06T11:05:44.373780+0000","last_fullsized":"2023-10-06T11:05:44.373780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:53:56.031447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.354685+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:05:44.354685+0000","last_peered":"2023-10-06T11:05:44.354685+0000","last_clean":"2023-10-06T11:05:44.354685+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:05:44.354685+0000","last_undegraded":"2023-10-06T11:05:44.354685+0000","last_fullsized":"2023-10-06T11:05:44.354685+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.354439+0000","last_change":"2023-10-06T11:05:43.366958+0000","last_active":"2023-10-06T11:05:44.354439+0000","last_peered":"2023-10-06T11:05:44.354439+0000","last_clean":"2023-10-06T11:05:44.354439+0000","last_became_active":"2023-10-06T11:05:43.366523+0000","last_became_peered":"2023-10-06T11:05:43.366523+0000","last_unstale":"2023-10-06T11:05:44.354439+0000","last_undegraded":"2023-10-06T11:05:44.354439+0000","last_fullsized":"2023-10-06T11:05:44.354439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:24.903299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.376185+0000","last_change":"2023-10-06T11:05:44.372075+0000","last_active":"2023-10-06T11:05:44.376185+0000","last_peered":"2023-10-06T11:05:44.376185+0000","last_clean":"2023-10-06T11:05:44.376185+0000","last_became_active":"2023-10-06T11:05:44.371769+0000","last_became_peered":"2023-10-06T11:05:44.371769+0000","last_unstale":"2023-10-06T11:05:44.376185+0000","last_undegraded":"2023-10-06T11:05:44.376185+0000","last_fullsized":"2023-10-06T11:05:44.376185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:49:41.512642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.362233+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:05:44.362233+0000","last_peered":"2023-10-06T11:05:44.362233+0000","last_clean":"2023-10-06T11:05:44.362233+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:05:44.362233+0000","last_undegraded":"2023-10-06T11:05:44.362233+0000","last_fullsized":"2023-10-06T11:05:44.362233+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.364558+0000","last_change":"2023-10-06T11:05:43.368631+0000","last_active":"2023-10-06T11:05:44.364558+0000","last_peered":"2023-10-06T11:05:44.364558+0000","last_clean":"2023-10-06T11:05:44.364558+0000","last_became_active":"2023-10-06T11:05:43.368367+0000","last_became_peered":"2023-10-06T11:05:43.368367+0000","last_unstale":"2023-10-06T11:05:44.364558+0000","last_undegraded":"2023-10-06T11:05:44.364558+0000","last_fullsized":"2023-10-06T11:05:44.364558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:27.003956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377441+0000","last_change":"2023-10-06T11:05:44.374324+0000","last_active":"2023-10-06T11:05:44.377441+0000","last_peered":"2023-10-06T11:05:44.377441+0000","last_clean":"2023-10-06T11:05:44.377441+0000","last_became_active":"2023-10-06T11:05:44.374070+0000","last_became_peered":"2023-10-06T11:05:44.374070+0000","last_unstale":"2023-10-06T11:05:44.377441+0000","last_undegraded":"2023-10-06T11:05:44.377441+0000","last_fullsized":"2023-10-06T11:05:44.377441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:49:53.929590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.360913+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:05:44.360913+0000","last_peered":"2023-10-06T11:05:44.360913+0000","last_clean":"2023-10-06T11:05:44.360913+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:05:44.360913+0000","last_undegraded":"2023-10-06T11:05:44.360913+0000","last_fullsized":"2023-10-06T11:05:44.360913+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.356747+0000","last_change":"2023-10-06T11:05:43.364980+0000","last_active":"2023-10-06T11:05:44.356747+0000","last_peered":"2023-10-06T11:05:44.356747+0000","last_clean":"2023-10-06T11:05:44.356747+0000","last_became_active":"2023-10-06T11:05:43.364661+0000","last_became_peered":"2023-10-06T11:05:43.364661+0000","last_unstale":"2023-10-06T11:05:44.356747+0000","last_undegraded":"2023-10-06T11:05:44.356747+0000","last_fullsized":"2023-10-06T11:05:44.356747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:32.863094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379211+0000","last_change":"2023-10-06T11:05:44.378547+0000","last_active":"2023-10-06T11:05:44.379211+0000","last_peered":"2023-10-06T11:05:44.379211+0000","last_clean":"2023-10-06T11:05:44.379211+0000","last_became_active":"2023-10-06T11:05:44.378211+0000","last_became_peered":"2023-10-06T11:05:44.378211+0000","last_unstale":"2023-10-06T11:05:44.379211+0000","last_undegraded":"2023-10-06T11:05:44.379211+0000","last_fullsized":"2023-10-06T11:05:44.379211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:32:31.703547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377355+0000","last_change":"2023-10-06T11:05:43.368448+0000","last_active":"2023-10-06T11:05:44.377355+0000","last_peered":"2023-10-06T11:05:44.377355+0000","last_clean":"2023-10-06T11:05:44.377355+0000","last_became_active":"2023-10-06T11:05:43.367859+0000","last_became_peered":"2023-10-06T11:05:43.367859+0000","last_unstale":"2023-10-06T11:05:44.377355+0000","last_undegraded":"2023-10-06T11:05:44.377355+0000","last_fullsized":"2023-10-06T11:05:44.377355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:18.301774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375383+0000","last_change":"2023-10-06T11:05:44.369211+0000","last_active":"2023-10-06T11:05:44.375383+0000","last_peered":"2023-10-06T11:05:44.375383+0000","last_clean":"2023-10-06T11:05:44.375383+0000","last_became_active":"2023-10-06T11:05:44.368950+0000","last_became_peered":"2023-10-06T11:05:44.368950+0000","last_unstale":"2023-10-06T11:05:44.375383+0000","last_undegraded":"2023-10-06T11:05:44.375383+0000","last_fullsized":"2023-10-06T11:05:44.375383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:01.484408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377607+0000","last_change":"2023-10-06T11:05:43.365792+0000","last_active":"2023-10-06T11:05:44.377607+0000","last_peered":"2023-10-06T11:05:44.377607+0000","last_clean":"2023-10-06T11:05:44.377607+0000","last_became_active":"2023-10-06T11:05:43.365137+0000","last_became_peered":"2023-10-06T11:05:43.365137+0000","last_unstale":"2023-10-06T11:05:44.377607+0000","last_undegraded":"2023-10-06T11:05:44.377607+0000","last_fullsized":"2023-10-06T11:05:44.377607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:24.903299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379988+0000","last_change":"2023-10-06T11:05:44.373079+0000","last_active":"2023-10-06T11:05:44.379988+0000","last_peered":"2023-10-06T11:05:44.379988+0000","last_clean":"2023-10-06T11:05:44.379988+0000","last_became_active":"2023-10-06T11:05:44.372797+0000","last_became_peered":"2023-10-06T11:05:44.372797+0000","last_unstale":"2023-10-06T11:05:44.379988+0000","last_undegraded":"2023-10-06T11:05:44.379988+0000","last_fullsized":"2023-10-06T11:05:44.379988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:20.240548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377828+0000","last_change":"2023-10-06T11:05:43.367620+0000","last_active":"2023-10-06T11:05:44.377828+0000","last_peered":"2023-10-06T11:05:44.377828+0000","last_clean":"2023-10-06T11:05:44.377828+0000","last_became_active":"2023-10-06T11:05:43.367335+0000","last_became_peered":"2023-10-06T11:05:43.367335+0000","last_unstale":"2023-10-06T11:05:44.377828+0000","last_undegraded":"2023-10-06T11:05:44.377828+0000","last_fullsized":"2023-10-06T11:05:44.377828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:18.301774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375668+0000","last_change":"2023-10-06T11:05:44.371343+0000","last_active":"2023-10-06T11:05:44.375668+0000","last_peered":"2023-10-06T11:05:44.375668+0000","last_clean":"2023-10-06T11:05:44.375668+0000","last_became_active":"2023-10-06T11:05:44.371051+0000","last_became_peered":"2023-10-06T11:05:44.371051+0000","last_unstale":"2023-10-06T11:05:44.375668+0000","last_undegraded":"2023-10-06T11:05:44.375668+0000","last_fullsized":"2023-10-06T11:05:44.375668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:30:10.233024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375170+0000","last_change":"2023-10-06T11:05:43.362124+0000","last_active":"2023-10-06T11:05:44.375170+0000","last_peered":"2023-10-06T11:05:44.375170+0000","last_clean":"2023-10-06T11:05:44.375170+0000","last_became_active":"2023-10-06T11:05:43.361847+0000","last_became_peered":"2023-10-06T11:05:43.361847+0000","last_unstale":"2023-10-06T11:05:44.375170+0000","last_undegraded":"2023-10-06T11:05:44.375170+0000","last_fullsized":"2023-10-06T11:05:44.375170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:36.907530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.373157+0000","last_change":"2023-10-06T11:05:44.367010+0000","last_active":"2023-10-06T11:05:44.373157+0000","last_peered":"2023-10-06T11:05:44.373157+0000","last_clean":"2023-10-06T11:05:44.373157+0000","last_became_active":"2023-10-06T11:05:44.366748+0000","last_became_peered":"2023-10-06T11:05:44.366748+0000","last_unstale":"2023-10-06T11:05:44.373157+0000","last_undegraded":"2023-10-06T11:05:44.373157+0000","last_fullsized":"2023-10-06T11:05:44.373157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:32:17.346227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380717+0000","last_change":"2023-10-06T11:05:43.367936+0000","last_active":"2023-10-06T11:05:44.380717+0000","last_peered":"2023-10-06T11:05:44.380717+0000","last_clean":"2023-10-06T11:05:44.380717+0000","last_became_active":"2023-10-06T11:05:43.367668+0000","last_became_peered":"2023-10-06T11:05:43.367668+0000","last_unstale":"2023-10-06T11:05:44.380717+0000","last_undegraded":"2023-10-06T11:05:44.380717+0000","last_fullsized":"2023-10-06T11:05:44.380717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:20:04.789716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.382377+0000","last_change":"2023-10-06T11:05:44.375719+0000","last_active":"2023-10-06T11:05:44.382377+0000","last_peered":"2023-10-06T11:05:44.382377+0000","last_clean":"2023-10-06T11:05:44.382377+0000","last_became_active":"2023-10-06T11:05:44.375387+0000","last_became_peered":"2023-10-06T11:05:44.375387+0000","last_unstale":"2023-10-06T11:05:44.382377+0000","last_undegraded":"2023-10-06T11:05:44.382377+0000","last_fullsized":"2023-10-06T11:05:44.382377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:39:54.037210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375187+0000","last_change":"2023-10-06T11:05:44.370923+0000","last_active":"2023-10-06T11:05:44.375187+0000","last_peered":"2023-10-06T11:05:44.375187+0000","last_clean":"2023-10-06T11:05:44.375187+0000","last_became_active":"2023-10-06T11:05:44.370655+0000","last_became_peered":"2023-10-06T11:05:44.370655+0000","last_unstale":"2023-10-06T11:05:44.375187+0000","last_undegraded":"2023-10-06T11:05:44.375187+0000","last_fullsized":"2023-10-06T11:05:44.375187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:21:08.012086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379549+0000","last_change":"2023-10-06T11:05:44.373040+0000","last_active":"2023-10-06T11:05:44.379549+0000","last_peered":"2023-10-06T11:05:44.379549+0000","last_clean":"2023-10-06T11:05:44.379549+0000","last_became_active":"2023-10-06T11:05:44.370543+0000","last_became_peered":"2023-10-06T11:05:44.370543+0000","last_unstale":"2023-10-06T11:05:44.379549+0000","last_undegraded":"2023-10-06T11:05:44.379549+0000","last_fullsized":"2023-10-06T11:05:44.379549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:30:10.233024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380138+0000","last_change":"2023-10-06T11:05:44.374987+0000","last_active":"2023-10-06T11:05:44.380138+0000","last_peered":"2023-10-06T11:05:44.380138+0000","last_clean":"2023-10-06T11:05:44.380138+0000","last_became_active":"2023-10-06T11:05:44.374710+0000","last_became_peered":"2023-10-06T11:05:44.374710+0000","last_unstale":"2023-10-06T11:05:44.380138+0000","last_undegraded":"2023-10-06T11:05:44.380138+0000","last_fullsized":"2023-10-06T11:05:44.380138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:46:57.706239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379174+0000","last_change":"2023-10-06T11:05:44.372135+0000","last_active":"2023-10-06T11:05:44.379174+0000","last_peered":"2023-10-06T11:05:44.379174+0000","last_clean":"2023-10-06T11:05:44.379174+0000","last_became_active":"2023-10-06T11:05:44.371609+0000","last_became_peered":"2023-10-06T11:05:44.371609+0000","last_unstale":"2023-10-06T11:05:44.379174+0000","last_undegraded":"2023-10-06T11:05:44.379174+0000","last_fullsized":"2023-10-06T11:05:44.379174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:48:35.935962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.376168+0000","last_change":"2023-10-06T11:05:44.371940+0000","last_active":"2023-10-06T11:05:44.376168+0000","last_peered":"2023-10-06T11:05:44.376168+0000","last_clean":"2023-10-06T11:05:44.376168+0000","last_became_active":"2023-10-06T11:05:44.371617+0000","last_became_peered":"2023-10-06T11:05:44.371617+0000","last_unstale":"2023-10-06T11:05:44.376168+0000","last_undegraded":"2023-10-06T11:05:44.376168+0000","last_fullsized":"2023-10-06T11:05:44.376168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:48.500150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298096,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073744,"statfs":{"total":96636764160,"available":96331513856,"internally_reserved":0,"allocated":827392,"data_stored":666304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297484,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074356,"statfs":{"total":96636764160,"available":96332140544,"internally_reserved":0,"allocated":200704,"data_stored":72831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.314}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298068,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073772,"statfs":{"total":96636764160,"available":96331542528,"internally_reserved":0,"allocated":798720,"data_stored":664552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":73385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297484,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074356,"statfs":{"total":96636764160,"available":96332140544,"internally_reserved":0,"allocated":200704,"data_stored":72831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":72921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":74808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.316}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:05:52.999 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:05:53.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.124+0000 7f412f59e700 1 Processor -- start 2023-10-06T11:05:53.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.124+0000 7f412f59e700 1 -- start start 2023-10-06T11:05:53.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.124+0000 7f412f59e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4130154d20 0x7f41300c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:53.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.124+0000 7f412f59e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f41300ccf40 0x7f413015b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:53.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.124+0000 7f412f59e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f413006c5a0 con 0x7f413015aeb0 2023-10-06T11:05:53.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.124+0000 7f412f59e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f413015b870 con 0x7f4130154d20 2023-10-06T11:05:53.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.124+0000 7f412f59e700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41300c8f70 con 0x7f41300ccf40 2023-10-06T11:05:53.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.125+0000 7f412e59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4130154d20 0x7f41300c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:53.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.125+0000 7f412e59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4130154d20 0x7f41300c8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39762/0 (socket says 172.21.15.146:39762) 2023-10-06T11:05:53.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.125+0000 7f412e59c700 1 -- 172.21.15.146:0/2208115962 learned_addr learned my addr 172.21.15.146:0/2208115962 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:53.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.125+0000 7f412ed9d700 1 --2- 172.21.15.146:0/2208115962 >> v2:172.21.15.151:3300/0 conn(0x7f41300ccf40 0x7f413015b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:53.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.125+0000 7f412e59c700 1 -- 172.21.15.146:0/2208115962 >> v2:172.21.15.151:3300/0 conn(0x7f41300ccf40 msgr2=0x7f413015b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:53.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.125+0000 7f412e59c700 1 --2- 172.21.15.146:0/2208115962 >> v2:172.21.15.151:3300/0 conn(0x7f41300ccf40 0x7f413015b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:53.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.125+0000 7f412e59c700 1 -- 172.21.15.146:0/2208115962 >> v1:172.21.15.151:6789/0 conn(0x7f413015aeb0 legacy=0x7f41301578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:53.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.125+0000 7f412e59c700 1 -- 172.21.15.146:0/2208115962 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f413006b6b0 con 0x7f4130154d20 2023-10-06T11:05:53.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.125+0000 7f412e59c700 1 --2- 172.21.15.146:0/2208115962 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4130154d20 0x7f41300c8a30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f413006f540 tx=0x7f4120009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae56bf4348f59408 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:53.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.125+0000 7f412dd9b700 1 -- 172.21.15.146:0/2208115962 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4120005c10 con 0x7f4130154d20 2023-10-06T11:05:53.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.125+0000 7f412dd9b700 1 -- 172.21.15.146:0/2208115962 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4120005d70 con 0x7f4130154d20 2023-10-06T11:05:53.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.125+0000 7f412dd9b700 1 -- 172.21.15.146:0/2208115962 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4120006260 con 0x7f4130154d20 2023-10-06T11:05:53.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.126+0000 7f412f59e700 1 -- 172.21.15.146:0/2208115962 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4130154d20 msgr2=0x7f41300c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:53.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.126+0000 7f412f59e700 1 --2- 172.21.15.146:0/2208115962 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4130154d20 0x7f41300c8a30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f413006f540 tx=0x7f4120009220 comp rx=0 tx=0).stop 2023-10-06T11:05:53.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.126+0000 7f412f59e700 1 -- 172.21.15.146:0/2208115962 shutdown_connections 2023-10-06T11:05:53.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.126+0000 7f412f59e700 1 --2- 172.21.15.146:0/2208115962 >> v2:172.21.15.151:3300/0 conn(0x7f41300ccf40 0x7f413015b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:53.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.126+0000 7f412f59e700 1 --2- 172.21.15.146:0/2208115962 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4130154d20 0x7f41300c8a30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:53.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.126+0000 7f412f59e700 1 -- 172.21.15.146:0/2208115962 >> 172.21.15.146:0/2208115962 conn(0x7f41300ce260 msgr2=0x7f41300ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:53.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.126+0000 7f412f59e700 1 -- 172.21.15.146:0/2208115962 shutdown_connections 2023-10-06T11:05:53.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.126+0000 7f412f59e700 1 -- 172.21.15.146:0/2208115962 wait complete. 2023-10-06T11:05:53.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.127+0000 7f412f59e700 1 Processor -- start 2023-10-06T11:05:53.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.127+0000 7f412f59e700 1 -- start start 2023-10-06T11:05:53.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.128+0000 7f412f59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41300ccf40 0x7f41300c7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:53.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.128+0000 7f412f59e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4130154d20 0x7f41300b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:53.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.128+0000 7f412f59e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f413015aeb0 0x7f41300b3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:53.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.128+0000 7f412f59e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41300a54b0 con 0x7f41300ccf40 2023-10-06T11:05:53.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.128+0000 7f412f59e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41300b1000 con 0x7f4130154d20 2023-10-06T11:05:53.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.128+0000 7f412f59e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41300b1e60 con 0x7f413015aeb0 2023-10-06T11:05:53.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.128+0000 7f412e59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41300ccf40 0x7f41300c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:53.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.128+0000 7f412e59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41300ccf40 0x7f41300c7590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39768/0 (socket says 172.21.15.146:39768) 2023-10-06T11:05:53.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.128+0000 7f412e59c700 1 -- 172.21.15.146:0/714105403 learned_addr learned my addr 172.21.15.146:0/714105403 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:53.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.128+0000 7f4127fff700 1 --2- 172.21.15.146:0/714105403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4130154d20 0x7f41300b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:53.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.128+0000 7f412ed9d700 1 --2- 172.21.15.146:0/714105403 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f413015aeb0 0x7f41300b3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:53.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.128+0000 7f412e59c700 1 -- 172.21.15.146:0/714105403 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f413015aeb0 msgr2=0x7f41300b3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:53.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.128+0000 7f412e59c700 1 --2- 172.21.15.146:0/714105403 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f413015aeb0 0x7f41300b3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:53.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.128+0000 7f412e59c700 1 -- 172.21.15.146:0/714105403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4130154d20 msgr2=0x7f41300b22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:53.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.128+0000 7f412e59c700 1 --2- 172.21.15.146:0/714105403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4130154d20 0x7f41300b22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:53.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.128+0000 7f412e59c700 1 -- 172.21.15.146:0/714105403 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4120009480 con 0x7f41300ccf40 2023-10-06T11:05:53.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.128+0000 7f4127fff700 1 --2- 172.21.15.146:0/714105403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4130154d20 0x7f41300b22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:05:53.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.128+0000 7f412e59c700 1 --2- 172.21.15.146:0/714105403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41300ccf40 0x7f41300c7590 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f412000b0e0 tx=0x7f4120016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:53.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.128+0000 7f41267fc700 1 -- 172.21.15.146:0/714105403 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412000b850 con 0x7f41300ccf40 2023-10-06T11:05:53.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.128+0000 7f41267fc700 1 -- 172.21.15.146:0/714105403 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4120020070 con 0x7f41300ccf40 2023-10-06T11:05:53.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.128+0000 7f41267fc700 1 -- 172.21.15.146:0/714105403 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412000bbe0 con 0x7f41300ccf40 2023-10-06T11:05:53.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.128+0000 7f412f59e700 1 -- 172.21.15.146:0/714105403 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41300b1250 con 0x7f41300ccf40 2023-10-06T11:05:53.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.128+0000 7f412f59e700 1 -- 172.21.15.146:0/714105403 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41300b15e0 con 0x7f41300ccf40 2023-10-06T11:05:53.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.129+0000 7f412f59e700 1 -- 172.21.15.146:0/714105403 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41300b2140 con 0x7f41300ccf40 2023-10-06T11:05:53.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.130+0000 7f41267fc700 1 -- 172.21.15.146:0/714105403 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4120022030 con 0x7f41300ccf40 2023-10-06T11:05:53.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.130+0000 7f41267fc700 1 --2- 172.21.15.146:0/714105403 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4110066f60 0x7f4110069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:53.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.130+0000 7f41267fc700 1 -- 172.21.15.146:0/714105403 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4120086200 con 0x7f41300ccf40 2023-10-06T11:05:53.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.130+0000 7f4127fff700 1 --2- 172.21.15.146:0/714105403 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4110066f60 0x7f4110069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:53.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.130+0000 7f4127fff700 1 --2- 172.21.15.146:0/714105403 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4110066f60 0x7f4110069410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4118007fd0 tx=0x7f4118009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:53.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.134+0000 7f41267fc700 1 -- 172.21.15.146:0/714105403 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4120053310 con 0x7f41300ccf40 2023-10-06T11:05:53.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.314+0000 7f412f59e700 1 -- 172.21.15.146:0/714105403 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f413006e5e0 con 0x7f4110066f60 2023-10-06T11:05:53.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.322+0000 7f41267fc700 1 -- 172.21.15.146:0/714105403 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286860 (secure 0 0 0) 0x7f413006e5e0 con 0x7f4110066f60 2023-10-06T11:05:53.328 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:05:53.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.325+0000 7f412f59e700 1 -- 172.21.15.146:0/714105403 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4110066f60 msgr2=0x7f4110069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:53.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.325+0000 7f412f59e700 1 --2- 172.21.15.146:0/714105403 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4110066f60 0x7f4110069410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4118007fd0 tx=0x7f4118009040 comp rx=0 tx=0).stop 2023-10-06T11:05:53.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.325+0000 7f412f59e700 1 -- 172.21.15.146:0/714105403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41300ccf40 msgr2=0x7f41300c7590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:53.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.325+0000 7f412f59e700 1 --2- 172.21.15.146:0/714105403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41300ccf40 0x7f41300c7590 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f412000b0e0 tx=0x7f4120016000 comp rx=0 tx=0).stop 2023-10-06T11:05:53.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.325+0000 7f412f59e700 1 -- 172.21.15.146:0/714105403 shutdown_connections 2023-10-06T11:05:53.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.325+0000 7f412f59e700 1 --2- 172.21.15.146:0/714105403 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4110066f60 0x7f4110069410 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:53.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.325+0000 7f412f59e700 1 --2- 172.21.15.146:0/714105403 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f413015aeb0 0x7f41300b3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:53.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.325+0000 7f412f59e700 1 --2- 172.21.15.146:0/714105403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41300ccf40 0x7f41300c7590 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:53.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.325+0000 7f412f59e700 1 --2- 172.21.15.146:0/714105403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4130154d20 0x7f41300b22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:53.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.325+0000 7f412f59e700 1 -- 172.21.15.146:0/714105403 >> 172.21.15.146:0/714105403 conn(0x7f41300ce260 msgr2=0x7f41300cb7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:53.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.325+0000 7f412f59e700 1 -- 172.21.15.146:0/714105403 shutdown_connections 2023-10-06T11:05:53.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.325+0000 7f412f59e700 1 -- 172.21.15.146:0/714105403 wait complete. 2023-10-06T11:05:53.334 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:05:53.338 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-10-06T11:05:53.133440+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381112,"kb_used_data":2808,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593608,"statfs":{"total":773094113280,"available":770655854592,"internally_reserved":0,"allocated":2875392,"data_stored":1773408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.781713"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.376223+0000","last_change":"2023-10-06T11:05:44.374095+0000","last_active":"2023-10-06T11:05:44.376223+0000","last_peered":"2023-10-06T11:05:44.376223+0000","last_clean":"2023-10-06T11:05:44.376223+0000","last_became_active":"2023-10-06T11:05:44.373839+0000","last_became_peered":"2023-10-06T11:05:44.373839+0000","last_unstale":"2023-10-06T11:05:44.376223+0000","last_undegraded":"2023-10-06T11:05:44.376223+0000","last_fullsized":"2023-10-06T11:05:44.376223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:25.910038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380398+0000","last_change":"2023-10-06T11:05:44.372580+0000","last_active":"2023-10-06T11:05:44.380398+0000","last_peered":"2023-10-06T11:05:44.380398+0000","last_clean":"2023-10-06T11:05:44.380398+0000","last_became_active":"2023-10-06T11:05:44.372338+0000","last_became_peered":"2023-10-06T11:05:44.372338+0000","last_unstale":"2023-10-06T11:05:44.380398+0000","last_undegraded":"2023-10-06T11:05:44.380398+0000","last_fullsized":"2023-10-06T11:05:44.380398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:49:53.929590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375679+0000","last_change":"2023-10-06T11:05:44.370665+0000","last_active":"2023-10-06T11:05:44.375679+0000","last_peered":"2023-10-06T11:05:44.375679+0000","last_clean":"2023-10-06T11:05:44.375679+0000","last_became_active":"2023-10-06T11:05:44.370393+0000","last_became_peered":"2023-10-06T11:05:44.370393+0000","last_unstale":"2023-10-06T11:05:44.375679+0000","last_undegraded":"2023-10-06T11:05:44.375679+0000","last_fullsized":"2023-10-06T11:05:44.375679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:11:45.592433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377408+0000","last_change":"2023-10-06T11:05:44.371604+0000","last_active":"2023-10-06T11:05:44.377408+0000","last_peered":"2023-10-06T11:05:44.377408+0000","last_clean":"2023-10-06T11:05:44.377408+0000","last_became_active":"2023-10-06T11:05:44.371305+0000","last_became_peered":"2023-10-06T11:05:44.371305+0000","last_unstale":"2023-10-06T11:05:44.377408+0000","last_undegraded":"2023-10-06T11:05:44.377408+0000","last_fullsized":"2023-10-06T11:05:44.377408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:37.914270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.370764+0000","last_change":"2023-10-06T11:05:44.368424+0000","last_active":"2023-10-06T11:05:44.370764+0000","last_peered":"2023-10-06T11:05:44.370764+0000","last_clean":"2023-10-06T11:05:44.370764+0000","last_became_active":"2023-10-06T11:05:44.368174+0000","last_became_peered":"2023-10-06T11:05:44.368174+0000","last_unstale":"2023-10-06T11:05:44.370764+0000","last_undegraded":"2023-10-06T11:05:44.370764+0000","last_fullsized":"2023-10-06T11:05:44.370764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:48.500150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375623+0000","last_change":"2023-10-06T11:05:44.369384+0000","last_active":"2023-10-06T11:05:44.375623+0000","last_peered":"2023-10-06T11:05:44.375623+0000","last_clean":"2023-10-06T11:05:44.375623+0000","last_became_active":"2023-10-06T11:05:44.369114+0000","last_became_peered":"2023-10-06T11:05:44.369114+0000","last_unstale":"2023-10-06T11:05:44.375623+0000","last_undegraded":"2023-10-06T11:05:44.375623+0000","last_fullsized":"2023-10-06T11:05:44.375623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:11:02.117432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.381050+0000","last_change":"2023-10-06T11:05:44.376045+0000","last_active":"2023-10-06T11:05:44.381050+0000","last_peered":"2023-10-06T11:05:44.381050+0000","last_clean":"2023-10-06T11:05:44.381050+0000","last_became_active":"2023-10-06T11:05:44.374697+0000","last_became_peered":"2023-10-06T11:05:44.374697+0000","last_unstale":"2023-10-06T11:05:44.381050+0000","last_undegraded":"2023-10-06T11:05:44.381050+0000","last_fullsized":"2023-10-06T11:05:44.381050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:30:10.233024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377816+0000","last_change":"2023-10-06T11:05:44.370424+0000","last_active":"2023-10-06T11:05:44.377816+0000","last_peered":"2023-10-06T11:05:44.377816+0000","last_clean":"2023-10-06T11:05:44.377816+0000","last_became_active":"2023-10-06T11:05:44.370141+0000","last_became_peered":"2023-10-06T11:05:44.370141+0000","last_unstale":"2023-10-06T11:05:44.377816+0000","last_undegraded":"2023-10-06T11:05:44.377816+0000","last_fullsized":"2023-10-06T11:05:44.377816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:32:17.346227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.374345+0000","last_change":"2023-10-06T11:05:44.370535+0000","last_active":"2023-10-06T11:05:44.374345+0000","last_peered":"2023-10-06T11:05:44.374345+0000","last_clean":"2023-10-06T11:05:44.374345+0000","last_became_active":"2023-10-06T11:05:44.370264+0000","last_became_peered":"2023-10-06T11:05:44.370264+0000","last_unstale":"2023-10-06T11:05:44.374345+0000","last_undegraded":"2023-10-06T11:05:44.374345+0000","last_fullsized":"2023-10-06T11:05:44.374345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:18:11.738273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377689+0000","last_change":"2023-10-06T11:05:44.363111+0000","last_active":"2023-10-06T11:05:44.377689+0000","last_peered":"2023-10-06T11:05:44.377689+0000","last_clean":"2023-10-06T11:05:44.377689+0000","last_became_active":"2023-10-06T11:05:44.362803+0000","last_became_peered":"2023-10-06T11:05:44.362803+0000","last_unstale":"2023-10-06T11:05:44.377689+0000","last_undegraded":"2023-10-06T11:05:44.377689+0000","last_fullsized":"2023-10-06T11:05:44.377689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:49:41.512642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375661+0000","last_change":"2023-10-06T11:05:44.370641+0000","last_active":"2023-10-06T11:05:44.375661+0000","last_peered":"2023-10-06T11:05:44.375661+0000","last_clean":"2023-10-06T11:05:44.375661+0000","last_became_active":"2023-10-06T11:05:44.370078+0000","last_became_peered":"2023-10-06T11:05:44.370078+0000","last_unstale":"2023-10-06T11:05:44.375661+0000","last_undegraded":"2023-10-06T11:05:44.375661+0000","last_fullsized":"2023-10-06T11:05:44.375661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:34:03.025480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.365243+0000","last_change":"2023-10-06T11:05:44.362523+0000","last_active":"2023-10-06T11:05:44.365243+0000","last_peered":"2023-10-06T11:05:44.365243+0000","last_clean":"2023-10-06T11:05:44.365243+0000","last_became_active":"2023-10-06T11:05:44.362248+0000","last_became_peered":"2023-10-06T11:05:44.362248+0000","last_unstale":"2023-10-06T11:05:44.365243+0000","last_undegraded":"2023-10-06T11:05:44.365243+0000","last_fullsized":"2023-10-06T11:05:44.365243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:33.869834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.376261+0000","last_change":"2023-10-06T11:05:44.373706+0000","last_active":"2023-10-06T11:05:44.376261+0000","last_peered":"2023-10-06T11:05:44.376261+0000","last_clean":"2023-10-06T11:05:44.376261+0000","last_became_active":"2023-10-06T11:05:44.373408+0000","last_became_peered":"2023-10-06T11:05:44.373408+0000","last_unstale":"2023-10-06T11:05:44.376261+0000","last_undegraded":"2023-10-06T11:05:44.376261+0000","last_fullsized":"2023-10-06T11:05:44.376261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:28.010695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377714+0000","last_change":"2023-10-06T11:05:44.364121+0000","last_active":"2023-10-06T11:05:44.377714+0000","last_peered":"2023-10-06T11:05:44.377714+0000","last_clean":"2023-10-06T11:05:44.377714+0000","last_became_active":"2023-10-06T11:05:44.363863+0000","last_became_peered":"2023-10-06T11:05:44.363863+0000","last_unstale":"2023-10-06T11:05:44.377714+0000","last_undegraded":"2023-10-06T11:05:44.377714+0000","last_fullsized":"2023-10-06T11:05:44.377714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:51.490766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.381068+0000","last_change":"2023-10-06T11:05:44.376146+0000","last_active":"2023-10-06T11:05:44.381068+0000","last_peered":"2023-10-06T11:05:44.381068+0000","last_clean":"2023-10-06T11:05:44.381068+0000","last_became_active":"2023-10-06T11:05:44.375877+0000","last_became_peered":"2023-10-06T11:05:44.375877+0000","last_unstale":"2023-10-06T11:05:44.381068+0000","last_undegraded":"2023-10-06T11:05:44.381068+0000","last_fullsized":"2023-10-06T11:05:44.381068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:25:37.173612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375588+0000","last_change":"2023-10-06T11:05:44.371531+0000","last_active":"2023-10-06T11:05:44.375588+0000","last_peered":"2023-10-06T11:05:44.375588+0000","last_clean":"2023-10-06T11:05:44.375588+0000","last_became_active":"2023-10-06T11:05:44.371082+0000","last_became_peered":"2023-10-06T11:05:44.371082+0000","last_unstale":"2023-10-06T11:05:44.375588+0000","last_undegraded":"2023-10-06T11:05:44.375588+0000","last_fullsized":"2023-10-06T11:05:44.375588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:16:26.923074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377465+0000","last_change":"2023-10-06T11:05:44.374262+0000","last_active":"2023-10-06T11:05:44.377465+0000","last_peered":"2023-10-06T11:05:44.377465+0000","last_clean":"2023-10-06T11:05:44.377465+0000","last_became_active":"2023-10-06T11:05:44.373997+0000","last_became_peered":"2023-10-06T11:05:44.373997+0000","last_unstale":"2023-10-06T11:05:44.377465+0000","last_undegraded":"2023-10-06T11:05:44.377465+0000","last_fullsized":"2023-10-06T11:05:44.377465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:30:10.233024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375434+0000","last_change":"2023-10-06T11:05:44.369716+0000","last_active":"2023-10-06T11:05:44.375434+0000","last_peered":"2023-10-06T11:05:44.375434+0000","last_clean":"2023-10-06T11:05:44.375434+0000","last_became_active":"2023-10-06T11:05:44.369434+0000","last_became_peered":"2023-10-06T11:05:44.369434+0000","last_unstale":"2023-10-06T11:05:44.375434+0000","last_undegraded":"2023-10-06T11:05:44.375434+0000","last_fullsized":"2023-10-06T11:05:44.375434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:53:21.828799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377738+0000","last_change":"2023-10-06T11:05:44.376536+0000","last_active":"2023-10-06T11:05:44.377738+0000","last_peered":"2023-10-06T11:05:44.377738+0000","last_clean":"2023-10-06T11:05:44.377738+0000","last_became_active":"2023-10-06T11:05:44.376291+0000","last_became_peered":"2023-10-06T11:05:44.376291+0000","last_unstale":"2023-10-06T11:05:44.377738+0000","last_undegraded":"2023-10-06T11:05:44.377738+0000","last_fullsized":"2023-10-06T11:05:44.377738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:19.308513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380092+0000","last_change":"2023-10-06T11:05:44.374492+0000","last_active":"2023-10-06T11:05:44.380092+0000","last_peered":"2023-10-06T11:05:44.380092+0000","last_clean":"2023-10-06T11:05:44.380092+0000","last_became_active":"2023-10-06T11:05:44.374108+0000","last_became_peered":"2023-10-06T11:05:44.374108+0000","last_unstale":"2023-10-06T11:05:44.380092+0000","last_undegraded":"2023-10-06T11:05:44.380092+0000","last_fullsized":"2023-10-06T11:05:44.380092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:36:18.739157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380978+0000","last_change":"2023-10-06T11:05:44.373773+0000","last_active":"2023-10-06T11:05:44.380978+0000","last_peered":"2023-10-06T11:05:44.380978+0000","last_clean":"2023-10-06T11:05:44.380978+0000","last_became_active":"2023-10-06T11:05:44.373445+0000","last_became_peered":"2023-10-06T11:05:44.373445+0000","last_unstale":"2023-10-06T11:05:44.380978+0000","last_undegraded":"2023-10-06T11:05:44.380978+0000","last_fullsized":"2023-10-06T11:05:44.380978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:48.500150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.370569+0000","last_change":"2023-10-06T11:05:44.365767+0000","last_active":"2023-10-06T11:05:44.370569+0000","last_peered":"2023-10-06T11:05:44.370569+0000","last_clean":"2023-10-06T11:05:44.370569+0000","last_became_active":"2023-10-06T11:05:44.365489+0000","last_became_peered":"2023-10-06T11:05:44.365489+0000","last_unstale":"2023-10-06T11:05:44.370569+0000","last_undegraded":"2023-10-06T11:05:44.370569+0000","last_fullsized":"2023-10-06T11:05:44.370569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:36:18.739157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379611+0000","last_change":"2023-10-06T11:05:44.373554+0000","last_active":"2023-10-06T11:05:44.379611+0000","last_peered":"2023-10-06T11:05:44.379611+0000","last_clean":"2023-10-06T11:05:44.379611+0000","last_became_active":"2023-10-06T11:05:44.373293+0000","last_became_peered":"2023-10-06T11:05:44.373293+0000","last_unstale":"2023-10-06T11:05:44.379611+0000","last_undegraded":"2023-10-06T11:05:44.379611+0000","last_fullsized":"2023-10-06T11:05:44.379611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:32:31.703547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380998+0000","last_change":"2023-10-06T11:05:44.373832+0000","last_active":"2023-10-06T11:05:44.380998+0000","last_peered":"2023-10-06T11:05:44.380998+0000","last_clean":"2023-10-06T11:05:44.380998+0000","last_became_active":"2023-10-06T11:05:44.373527+0000","last_became_peered":"2023-10-06T11:05:44.373527+0000","last_unstale":"2023-10-06T11:05:44.380998+0000","last_undegraded":"2023-10-06T11:05:44.380998+0000","last_fullsized":"2023-10-06T11:05:44.380998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:49:53.929590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377989+0000","last_change":"2023-10-06T11:05:44.375109+0000","last_active":"2023-10-06T11:05:44.377989+0000","last_peered":"2023-10-06T11:05:44.377989+0000","last_clean":"2023-10-06T11:05:44.377989+0000","last_became_active":"2023-10-06T11:05:44.374861+0000","last_became_peered":"2023-10-06T11:05:44.374861+0000","last_unstale":"2023-10-06T11:05:44.377989+0000","last_undegraded":"2023-10-06T11:05:44.377989+0000","last_fullsized":"2023-10-06T11:05:44.377989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:36:26.414372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377747+0000","last_change":"2023-10-06T11:05:44.372987+0000","last_active":"2023-10-06T11:05:44.377747+0000","last_peered":"2023-10-06T11:05:44.377747+0000","last_clean":"2023-10-06T11:05:44.377747+0000","last_became_active":"2023-10-06T11:05:44.369828+0000","last_became_peered":"2023-10-06T11:05:44.369828+0000","last_unstale":"2023-10-06T11:05:44.377747+0000","last_undegraded":"2023-10-06T11:05:44.377747+0000","last_fullsized":"2023-10-06T11:05:44.377747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:42.381985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380422+0000","last_change":"2023-10-06T11:05:44.372985+0000","last_active":"2023-10-06T11:05:44.380422+0000","last_peered":"2023-10-06T11:05:44.380422+0000","last_clean":"2023-10-06T11:05:44.380422+0000","last_became_active":"2023-10-06T11:05:44.372531+0000","last_became_peered":"2023-10-06T11:05:44.372531+0000","last_unstale":"2023-10-06T11:05:44.380422+0000","last_undegraded":"2023-10-06T11:05:44.380422+0000","last_fullsized":"2023-10-06T11:05:44.380422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:36:26.414372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.382453+0000","last_change":"2023-10-06T11:05:43.369136+0000","last_active":"2023-10-06T11:05:44.382453+0000","last_peered":"2023-10-06T11:05:44.382453+0000","last_clean":"2023-10-06T11:05:44.382453+0000","last_became_active":"2023-10-06T11:05:43.368830+0000","last_became_peered":"2023-10-06T11:05:43.368830+0000","last_unstale":"2023-10-06T11:05:44.382453+0000","last_undegraded":"2023-10-06T11:05:44.382453+0000","last_fullsized":"2023-10-06T11:05:44.382453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:27.003956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.370597+0000","last_change":"2023-10-06T11:05:44.367477+0000","last_active":"2023-10-06T11:05:44.370597+0000","last_peered":"2023-10-06T11:05:44.370597+0000","last_clean":"2023-10-06T11:05:44.370597+0000","last_became_active":"2023-10-06T11:05:44.367216+0000","last_became_peered":"2023-10-06T11:05:44.367216+0000","last_unstale":"2023-10-06T11:05:44.370597+0000","last_undegraded":"2023-10-06T11:05:44.370597+0000","last_fullsized":"2023-10-06T11:05:44.370597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:48.500150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.364950+0000","last_change":"2023-10-06T11:05:43.369127+0000","last_active":"2023-10-06T11:05:44.364950+0000","last_peered":"2023-10-06T11:05:44.364950+0000","last_clean":"2023-10-06T11:05:44.364950+0000","last_became_active":"2023-10-06T11:05:43.368806+0000","last_became_peered":"2023-10-06T11:05:43.368806+0000","last_unstale":"2023-10-06T11:05:44.364950+0000","last_undegraded":"2023-10-06T11:05:44.364950+0000","last_fullsized":"2023-10-06T11:05:44.364950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:51.324615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.370930+0000","last_change":"2023-10-06T11:05:44.367950+0000","last_active":"2023-10-06T11:05:44.370930+0000","last_peered":"2023-10-06T11:05:44.370930+0000","last_clean":"2023-10-06T11:05:44.370930+0000","last_became_active":"2023-10-06T11:05:44.367682+0000","last_became_peered":"2023-10-06T11:05:44.367682+0000","last_unstale":"2023-10-06T11:05:44.370930+0000","last_undegraded":"2023-10-06T11:05:44.370930+0000","last_fullsized":"2023-10-06T11:05:44.370930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:53:21.828799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.356971+0000","last_change":"2023-10-06T11:05:43.366406+0000","last_active":"2023-10-06T11:05:44.356971+0000","last_peered":"2023-10-06T11:05:44.356971+0000","last_clean":"2023-10-06T11:05:44.356971+0000","last_became_active":"2023-10-06T11:05:43.366004+0000","last_became_peered":"2023-10-06T11:05:43.366004+0000","last_unstale":"2023-10-06T11:05:44.356971+0000","last_undegraded":"2023-10-06T11:05:44.356971+0000","last_fullsized":"2023-10-06T11:05:44.356971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:00.477669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.382373+0000","last_change":"2023-10-06T11:05:44.378728+0000","last_active":"2023-10-06T11:05:44.382373+0000","last_peered":"2023-10-06T11:05:44.382373+0000","last_clean":"2023-10-06T11:05:44.382373+0000","last_became_active":"2023-10-06T11:05:44.378467+0000","last_became_peered":"2023-10-06T11:05:44.378467+0000","last_unstale":"2023-10-06T11:05:44.382373+0000","last_undegraded":"2023-10-06T11:05:44.382373+0000","last_fullsized":"2023-10-06T11:05:44.382373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:20:05.796456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.353362+0000","last_change":"2023-10-06T11:05:43.362935+0000","last_active":"2023-10-06T11:05:44.353362+0000","last_peered":"2023-10-06T11:05:44.353362+0000","last_clean":"2023-10-06T11:05:44.353362+0000","last_became_active":"2023-10-06T11:05:43.362642+0000","last_became_peered":"2023-10-06T11:05:43.362642+0000","last_unstale":"2023-10-06T11:05:44.353362+0000","last_undegraded":"2023-10-06T11:05:44.353362+0000","last_fullsized":"2023-10-06T11:05:44.353362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:36.907530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.371257+0000","last_change":"2023-10-06T11:05:44.366360+0000","last_active":"2023-10-06T11:05:44.371257+0000","last_peered":"2023-10-06T11:05:44.371257+0000","last_clean":"2023-10-06T11:05:44.371257+0000","last_became_active":"2023-10-06T11:05:44.366097+0000","last_became_peered":"2023-10-06T11:05:44.366097+0000","last_unstale":"2023-10-06T11:05:44.371257+0000","last_undegraded":"2023-10-06T11:05:44.371257+0000","last_fullsized":"2023-10-06T11:05:44.371257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:18:11.738273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.357158+0000","last_change":"2023-10-06T11:05:43.365582+0000","last_active":"2023-10-06T11:05:44.357158+0000","last_peered":"2023-10-06T11:05:44.357158+0000","last_clean":"2023-10-06T11:05:44.357158+0000","last_became_active":"2023-10-06T11:05:43.365197+0000","last_became_peered":"2023-10-06T11:05:43.365197+0000","last_unstale":"2023-10-06T11:05:44.357158+0000","last_undegraded":"2023-10-06T11:05:44.357158+0000","last_fullsized":"2023-10-06T11:05:44.357158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:59:28.141215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.373455+0000","last_change":"2023-10-06T11:05:44.369545+0000","last_active":"2023-10-06T11:05:44.373455+0000","last_peered":"2023-10-06T11:05:44.373455+0000","last_clean":"2023-10-06T11:05:44.373455+0000","last_became_active":"2023-10-06T11:05:44.369228+0000","last_became_peered":"2023-10-06T11:05:44.369228+0000","last_unstale":"2023-10-06T11:05:44.373455+0000","last_undegraded":"2023-10-06T11:05:44.373455+0000","last_fullsized":"2023-10-06T11:05:44.373455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:36:18.739157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.378674+0000","last_change":"2023-10-06T11:05:43.370700+0000","last_active":"2023-10-06T11:05:44.378674+0000","last_peered":"2023-10-06T11:05:44.378674+0000","last_clean":"2023-10-06T11:05:44.378674+0000","last_became_active":"2023-10-06T11:05:43.370418+0000","last_became_peered":"2023-10-06T11:05:43.370418+0000","last_unstale":"2023-10-06T11:05:44.378674+0000","last_undegraded":"2023-10-06T11:05:44.378674+0000","last_fullsized":"2023-10-06T11:05:44.378674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:03.585687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377957+0000","last_change":"2023-10-06T11:05:44.375285+0000","last_active":"2023-10-06T11:05:44.377957+0000","last_peered":"2023-10-06T11:05:44.377957+0000","last_clean":"2023-10-06T11:05:44.377957+0000","last_became_active":"2023-10-06T11:05:44.374774+0000","last_became_peered":"2023-10-06T11:05:44.374774+0000","last_unstale":"2023-10-06T11:05:44.377957+0000","last_undegraded":"2023-10-06T11:05:44.377957+0000","last_fullsized":"2023-10-06T11:05:44.377957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:32:17.346227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.385298+0000","last_change":"2023-10-06T11:05:43.363844+0000","last_active":"2023-10-06T11:05:44.385298+0000","last_peered":"2023-10-06T11:05:44.385298+0000","last_clean":"2023-10-06T11:05:44.385298+0000","last_became_active":"2023-10-06T11:05:43.363568+0000","last_became_peered":"2023-10-06T11:05:43.363568+0000","last_unstale":"2023-10-06T11:05:44.385298+0000","last_undegraded":"2023-10-06T11:05:44.385298+0000","last_fullsized":"2023-10-06T11:05:44.385298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:51.324615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.382342+0000","last_change":"2023-10-06T11:05:44.375145+0000","last_active":"2023-10-06T11:05:44.382342+0000","last_peered":"2023-10-06T11:05:44.382342+0000","last_clean":"2023-10-06T11:05:44.382342+0000","last_became_active":"2023-10-06T11:05:44.374868+0000","last_became_peered":"2023-10-06T11:05:44.374868+0000","last_unstale":"2023-10-06T11:05:44.382342+0000","last_undegraded":"2023-10-06T11:05:44.382342+0000","last_fullsized":"2023-10-06T11:05:44.382342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:48.500150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.378534+0000","last_change":"2023-10-06T11:05:43.369646+0000","last_active":"2023-10-06T11:05:44.378534+0000","last_peered":"2023-10-06T11:05:44.378534+0000","last_clean":"2023-10-06T11:05:44.378534+0000","last_became_active":"2023-10-06T11:05:43.369353+0000","last_became_peered":"2023-10-06T11:05:43.369353+0000","last_unstale":"2023-10-06T11:05:44.378534+0000","last_undegraded":"2023-10-06T11:05:44.378534+0000","last_fullsized":"2023-10-06T11:05:44.378534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:50.484027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379530+0000","last_change":"2023-10-06T11:05:44.372738+0000","last_active":"2023-10-06T11:05:44.379530+0000","last_peered":"2023-10-06T11:05:44.379530+0000","last_clean":"2023-10-06T11:05:44.379530+0000","last_became_active":"2023-10-06T11:05:44.372299+0000","last_became_peered":"2023-10-06T11:05:44.372299+0000","last_unstale":"2023-10-06T11:05:44.379530+0000","last_undegraded":"2023-10-06T11:05:44.379530+0000","last_fullsized":"2023-10-06T11:05:44.379530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:53:21.828799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.352712+0000","last_change":"2023-10-06T11:05:43.364085+0000","last_active":"2023-10-06T11:05:44.352712+0000","last_peered":"2023-10-06T11:05:44.352712+0000","last_clean":"2023-10-06T11:05:44.352712+0000","last_became_active":"2023-10-06T11:05:43.363844+0000","last_became_peered":"2023-10-06T11:05:43.363844+0000","last_unstale":"2023-10-06T11:05:44.352712+0000","last_undegraded":"2023-10-06T11:05:44.352712+0000","last_fullsized":"2023-10-06T11:05:44.352712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:51.324615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380405+0000","last_change":"2023-10-06T11:05:44.372815+0000","last_active":"2023-10-06T11:05:44.380405+0000","last_peered":"2023-10-06T11:05:44.380405+0000","last_clean":"2023-10-06T11:05:44.380405+0000","last_became_active":"2023-10-06T11:05:44.372237+0000","last_became_peered":"2023-10-06T11:05:44.372237+0000","last_unstale":"2023-10-06T11:05:44.380405+0000","last_undegraded":"2023-10-06T11:05:44.380405+0000","last_fullsized":"2023-10-06T11:05:44.380405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:42.381985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.363864+0000","last_change":"2023-10-06T11:05:43.369142+0000","last_active":"2023-10-06T11:05:44.363864+0000","last_peered":"2023-10-06T11:05:44.363864+0000","last_clean":"2023-10-06T11:05:44.363864+0000","last_became_active":"2023-10-06T11:05:43.368847+0000","last_became_peered":"2023-10-06T11:05:43.368847+0000","last_unstale":"2023-10-06T11:05:44.363864+0000","last_undegraded":"2023-10-06T11:05:44.363864+0000","last_fullsized":"2023-10-06T11:05:44.363864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:48:23.698446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.373918+0000","last_change":"2023-10-06T11:05:44.370314+0000","last_active":"2023-10-06T11:05:44.373918+0000","last_peered":"2023-10-06T11:05:44.373918+0000","last_clean":"2023-10-06T11:05:44.373918+0000","last_became_active":"2023-10-06T11:05:44.370065+0000","last_became_peered":"2023-10-06T11:05:44.370065+0000","last_unstale":"2023-10-06T11:05:44.373918+0000","last_undegraded":"2023-10-06T11:05:44.373918+0000","last_fullsized":"2023-10-06T11:05:44.373918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:32:31.703547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377619+0000","last_change":"2023-10-06T11:05:43.366052+0000","last_active":"2023-10-06T11:05:44.377619+0000","last_peered":"2023-10-06T11:05:44.377619+0000","last_clean":"2023-10-06T11:05:44.377619+0000","last_became_active":"2023-10-06T11:05:43.365790+0000","last_became_peered":"2023-10-06T11:05:43.365790+0000","last_unstale":"2023-10-06T11:05:44.377619+0000","last_undegraded":"2023-10-06T11:05:44.377619+0000","last_fullsized":"2023-10-06T11:05:44.377619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:59:28.141215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379857+0000","last_change":"2023-10-06T11:05:44.372870+0000","last_active":"2023-10-06T11:05:44.379857+0000","last_peered":"2023-10-06T11:05:44.379857+0000","last_clean":"2023-10-06T11:05:44.379857+0000","last_became_active":"2023-10-06T11:05:44.372480+0000","last_became_peered":"2023-10-06T11:05:44.372480+0000","last_unstale":"2023-10-06T11:05:44.379857+0000","last_undegraded":"2023-10-06T11:05:44.379857+0000","last_fullsized":"2023-10-06T11:05:44.379857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:25:37.173612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.378371+0000","last_change":"2023-10-06T11:05:43.369672+0000","last_active":"2023-10-06T11:05:44.378371+0000","last_peered":"2023-10-06T11:05:44.378371+0000","last_clean":"2023-10-06T11:05:44.378371+0000","last_became_active":"2023-10-06T11:05:43.369415+0000","last_became_peered":"2023-10-06T11:05:43.369415+0000","last_unstale":"2023-10-06T11:05:44.378371+0000","last_undegraded":"2023-10-06T11:05:44.378371+0000","last_fullsized":"2023-10-06T11:05:44.378371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:21:07.005347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.385017+0000","last_change":"2023-10-06T11:05:44.380100+0000","last_active":"2023-10-06T11:05:44.385017+0000","last_peered":"2023-10-06T11:05:44.385017+0000","last_clean":"2023-10-06T11:05:44.385017+0000","last_became_active":"2023-10-06T11:05:44.379686+0000","last_became_peered":"2023-10-06T11:05:44.379686+0000","last_unstale":"2023-10-06T11:05:44.385017+0000","last_undegraded":"2023-10-06T11:05:44.385017+0000","last_fullsized":"2023-10-06T11:05:44.385017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:32:31.703547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.378652+0000","last_change":"2023-10-06T11:05:43.369280+0000","last_active":"2023-10-06T11:05:44.378652+0000","last_peered":"2023-10-06T11:05:44.378652+0000","last_clean":"2023-10-06T11:05:44.378652+0000","last_became_active":"2023-10-06T11:05:43.369002+0000","last_became_peered":"2023-10-06T11:05:43.369002+0000","last_unstale":"2023-10-06T11:05:44.378652+0000","last_undegraded":"2023-10-06T11:05:44.378652+0000","last_fullsized":"2023-10-06T11:05:44.378652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:53:55.024707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.365517+0000","last_change":"2023-10-06T11:05:44.363074+0000","last_active":"2023-10-06T11:05:44.365517+0000","last_peered":"2023-10-06T11:05:44.365517+0000","last_clean":"2023-10-06T11:05:44.365517+0000","last_became_active":"2023-10-06T11:05:44.362798+0000","last_became_peered":"2023-10-06T11:05:44.362798+0000","last_unstale":"2023-10-06T11:05:44.365517+0000","last_undegraded":"2023-10-06T11:05:44.365517+0000","last_fullsized":"2023-10-06T11:05:44.365517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:48:11.590704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.378605+0000","last_change":"2023-10-06T11:05:43.368847+0000","last_active":"2023-10-06T11:05:44.378605+0000","last_peered":"2023-10-06T11:05:44.378605+0000","last_clean":"2023-10-06T11:05:44.378605+0000","last_became_active":"2023-10-06T11:05:43.368394+0000","last_became_peered":"2023-10-06T11:05:43.368394+0000","last_unstale":"2023-10-06T11:05:44.378605+0000","last_undegraded":"2023-10-06T11:05:44.378605+0000","last_fullsized":"2023-10-06T11:05:44.378605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:26.238071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380176+0000","last_change":"2023-10-06T11:05:44.374404+0000","last_active":"2023-10-06T11:05:44.380176+0000","last_peered":"2023-10-06T11:05:44.380176+0000","last_clean":"2023-10-06T11:05:44.380176+0000","last_became_active":"2023-10-06T11:05:44.374017+0000","last_became_peered":"2023-10-06T11:05:44.374017+0000","last_unstale":"2023-10-06T11:05:44.380176+0000","last_undegraded":"2023-10-06T11:05:44.380176+0000","last_fullsized":"2023-10-06T11:05:44.380176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:51.490766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.354872+0000","last_change":"2023-10-06T11:05:43.368442+0000","last_active":"2023-10-06T11:05:44.354872+0000","last_peered":"2023-10-06T11:05:44.354872+0000","last_clean":"2023-10-06T11:05:44.354872+0000","last_became_active":"2023-10-06T11:05:43.368152+0000","last_became_peered":"2023-10-06T11:05:43.368152+0000","last_unstale":"2023-10-06T11:05:44.354872+0000","last_undegraded":"2023-10-06T11:05:44.354872+0000","last_fullsized":"2023-10-06T11:05:44.354872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:27.003956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.371685+0000","last_change":"2023-10-06T11:05:44.368980+0000","last_active":"2023-10-06T11:05:44.371685+0000","last_peered":"2023-10-06T11:05:44.371685+0000","last_clean":"2023-10-06T11:05:44.371685+0000","last_became_active":"2023-10-06T11:05:44.368693+0000","last_became_peered":"2023-10-06T11:05:44.368693+0000","last_unstale":"2023-10-06T11:05:44.371685+0000","last_undegraded":"2023-10-06T11:05:44.371685+0000","last_fullsized":"2023-10-06T11:05:44.371685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:25:37.173612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.376448+0000","last_change":"2023-10-06T11:05:43.366389+0000","last_active":"2023-10-06T11:05:44.376448+0000","last_peered":"2023-10-06T11:05:44.376448+0000","last_clean":"2023-10-06T11:05:44.376448+0000","last_became_active":"2023-10-06T11:05:43.366041+0000","last_became_peered":"2023-10-06T11:05:43.366041+0000","last_unstale":"2023-10-06T11:05:44.376448+0000","last_undegraded":"2023-10-06T11:05:44.376448+0000","last_fullsized":"2023-10-06T11:05:44.376448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:18.301774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375589+0000","last_change":"2023-10-06T11:05:44.371594+0000","last_active":"2023-10-06T11:05:44.375589+0000","last_peered":"2023-10-06T11:05:44.375589+0000","last_clean":"2023-10-06T11:05:44.375589+0000","last_became_active":"2023-10-06T11:05:44.371316+0000","last_became_peered":"2023-10-06T11:05:44.371316+0000","last_unstale":"2023-10-06T11:05:44.375589+0000","last_undegraded":"2023-10-06T11:05:44.375589+0000","last_fullsized":"2023-10-06T11:05:44.375589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:23:15.847562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.365041+0000","last_change":"2023-10-06T11:05:43.362138+0000","last_active":"2023-10-06T11:05:44.365041+0000","last_peered":"2023-10-06T11:05:44.365041+0000","last_clean":"2023-10-06T11:05:44.365041+0000","last_became_active":"2023-10-06T11:05:43.361796+0000","last_became_peered":"2023-10-06T11:05:43.361796+0000","last_unstale":"2023-10-06T11:05:44.365041+0000","last_undegraded":"2023-10-06T11:05:44.365041+0000","last_fullsized":"2023-10-06T11:05:44.365041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:51.324615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375623+0000","last_change":"2023-10-06T11:05:44.368661+0000","last_active":"2023-10-06T11:05:44.375623+0000","last_peered":"2023-10-06T11:05:44.375623+0000","last_clean":"2023-10-06T11:05:44.375623+0000","last_became_active":"2023-10-06T11:05:44.368296+0000","last_became_peered":"2023-10-06T11:05:44.368296+0000","last_unstale":"2023-10-06T11:05:44.375623+0000","last_undegraded":"2023-10-06T11:05:44.375623+0000","last_fullsized":"2023-10-06T11:05:44.375623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:42:21.740811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.354312+0000","last_change":"2023-10-06T11:05:43.357853+0000","last_active":"2023-10-06T11:05:44.354312+0000","last_peered":"2023-10-06T11:05:44.354312+0000","last_clean":"2023-10-06T11:05:44.354312+0000","last_became_active":"2023-10-06T11:05:43.357572+0000","last_became_peered":"2023-10-06T11:05:43.357572+0000","last_unstale":"2023-10-06T11:05:44.354312+0000","last_undegraded":"2023-10-06T11:05:44.354312+0000","last_fullsized":"2023-10-06T11:05:44.354312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:18.301774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380069+0000","last_change":"2023-10-06T11:05:44.374211+0000","last_active":"2023-10-06T11:05:44.380069+0000","last_peered":"2023-10-06T11:05:44.380069+0000","last_clean":"2023-10-06T11:05:44.380069+0000","last_became_active":"2023-10-06T11:05:44.373924+0000","last_became_peered":"2023-10-06T11:05:44.373924+0000","last_unstale":"2023-10-06T11:05:44.380069+0000","last_undegraded":"2023-10-06T11:05:44.380069+0000","last_fullsized":"2023-10-06T11:05:44.380069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:18:11.738273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.357364+0000","last_change":"2023-10-06T11:05:43.367123+0000","last_active":"2023-10-06T11:05:44.357364+0000","last_peered":"2023-10-06T11:05:44.357364+0000","last_clean":"2023-10-06T11:05:44.357364+0000","last_became_active":"2023-10-06T11:05:43.366861+0000","last_became_peered":"2023-10-06T11:05:43.366861+0000","last_unstale":"2023-10-06T11:05:44.357364+0000","last_undegraded":"2023-10-06T11:05:44.357364+0000","last_fullsized":"2023-10-06T11:05:44.357364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:32.863094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377938+0000","last_change":"2023-10-06T11:05:44.374963+0000","last_active":"2023-10-06T11:05:44.377938+0000","last_peered":"2023-10-06T11:05:44.377938+0000","last_clean":"2023-10-06T11:05:44.377938+0000","last_became_active":"2023-10-06T11:05:44.374524+0000","last_became_peered":"2023-10-06T11:05:44.374524+0000","last_unstale":"2023-10-06T11:05:44.377938+0000","last_undegraded":"2023-10-06T11:05:44.377938+0000","last_fullsized":"2023-10-06T11:05:44.377938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:27.244810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379794+0000","last_change":"2023-10-06T11:05:43.367084+0000","last_active":"2023-10-06T11:05:44.379794+0000","last_peered":"2023-10-06T11:05:44.379794+0000","last_clean":"2023-10-06T11:05:44.379794+0000","last_became_active":"2023-10-06T11:05:43.366813+0000","last_became_peered":"2023-10-06T11:05:43.366813+0000","last_unstale":"2023-10-06T11:05:44.379794+0000","last_undegraded":"2023-10-06T11:05:44.379794+0000","last_fullsized":"2023-10-06T11:05:44.379794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:27.003956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.357296+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:05:44.357296+0000","last_peered":"2023-10-06T11:05:44.357296+0000","last_clean":"2023-10-06T11:05:44.357296+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:05:44.357296+0000","last_undegraded":"2023-10-06T11:05:44.357296+0000","last_fullsized":"2023-10-06T11:05:44.357296+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380176+0000","last_change":"2023-10-06T11:05:44.371162+0000","last_active":"2023-10-06T11:05:44.380176+0000","last_peered":"2023-10-06T11:05:44.380176+0000","last_clean":"2023-10-06T11:05:44.380176+0000","last_became_active":"2023-10-06T11:05:44.370923+0000","last_became_peered":"2023-10-06T11:05:44.370923+0000","last_unstale":"2023-10-06T11:05:44.380176+0000","last_undegraded":"2023-10-06T11:05:44.380176+0000","last_fullsized":"2023-10-06T11:05:44.380176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:20.240548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.356434+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:05:44.356434+0000","last_peered":"2023-10-06T11:05:44.356434+0000","last_clean":"2023-10-06T11:05:44.356434+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:05:44.356434+0000","last_undegraded":"2023-10-06T11:05:44.356434+0000","last_fullsized":"2023-10-06T11:05:44.356434+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T11:05:45.427947+0000","last_change":"2023-10-06T11:05:43.365664+0000","last_active":"2023-10-06T11:05:45.427947+0000","last_peered":"2023-10-06T11:05:45.427947+0000","last_clean":"2023-10-06T11:05:45.427947+0000","last_became_active":"2023-10-06T11:05:43.365413+0000","last_became_peered":"2023-10-06T11:05:43.365413+0000","last_unstale":"2023-10-06T11:05:45.427947+0000","last_undegraded":"2023-10-06T11:05:45.427947+0000","last_fullsized":"2023-10-06T11:05:45.427947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:32.863094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.382458+0000","last_change":"2023-10-06T11:05:44.376907+0000","last_active":"2023-10-06T11:05:44.382458+0000","last_peered":"2023-10-06T11:05:44.382458+0000","last_clean":"2023-10-06T11:05:44.382458+0000","last_became_active":"2023-10-06T11:05:44.376549+0000","last_became_peered":"2023-10-06T11:05:44.376549+0000","last_unstale":"2023-10-06T11:05:44.382458+0000","last_undegraded":"2023-10-06T11:05:44.382458+0000","last_fullsized":"2023-10-06T11:05:44.382458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:48:35.935962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.364783+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:05:44.364783+0000","last_peered":"2023-10-06T11:05:44.364783+0000","last_clean":"2023-10-06T11:05:44.364783+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:05:44.364783+0000","last_undegraded":"2023-10-06T11:05:44.364783+0000","last_fullsized":"2023-10-06T11:05:44.364783+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.366104+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:05:44.366104+0000","last_peered":"2023-10-06T11:05:44.366104+0000","last_clean":"2023-10-06T11:05:44.366104+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:05:44.366104+0000","last_undegraded":"2023-10-06T11:05:44.366104+0000","last_fullsized":"2023-10-06T11:05:44.366104+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.352615+0000","last_change":"2023-10-06T11:05:43.368370+0000","last_active":"2023-10-06T11:05:44.352615+0000","last_peered":"2023-10-06T11:05:44.352615+0000","last_clean":"2023-10-06T11:05:44.352615+0000","last_became_active":"2023-10-06T11:05:43.368103+0000","last_became_peered":"2023-10-06T11:05:43.368103+0000","last_unstale":"2023-10-06T11:05:44.352615+0000","last_undegraded":"2023-10-06T11:05:44.352615+0000","last_fullsized":"2023-10-06T11:05:44.352615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:24.903299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.372002+0000","last_change":"2023-10-06T11:05:44.369604+0000","last_active":"2023-10-06T11:05:44.372002+0000","last_peered":"2023-10-06T11:05:44.372002+0000","last_clean":"2023-10-06T11:05:44.372002+0000","last_became_active":"2023-10-06T11:05:44.368781+0000","last_became_peered":"2023-10-06T11:05:44.368781+0000","last_unstale":"2023-10-06T11:05:44.372002+0000","last_undegraded":"2023-10-06T11:05:44.372002+0000","last_fullsized":"2023-10-06T11:05:44.372002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:20.240548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.361406+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:05:44.361406+0000","last_peered":"2023-10-06T11:05:44.361406+0000","last_clean":"2023-10-06T11:05:44.361406+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:05:44.361406+0000","last_undegraded":"2023-10-06T11:05:44.361406+0000","last_fullsized":"2023-10-06T11:05:44.361406+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.364677+0000","last_change":"2023-10-06T11:05:43.367969+0000","last_active":"2023-10-06T11:05:44.364677+0000","last_peered":"2023-10-06T11:05:44.364677+0000","last_clean":"2023-10-06T11:05:44.364677+0000","last_became_active":"2023-10-06T11:05:43.367720+0000","last_became_peered":"2023-10-06T11:05:43.367720+0000","last_unstale":"2023-10-06T11:05:44.364677+0000","last_undegraded":"2023-10-06T11:05:44.364677+0000","last_fullsized":"2023-10-06T11:05:44.364677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:18.301774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379201+0000","last_change":"2023-10-06T11:05:44.378622+0000","last_active":"2023-10-06T11:05:44.379201+0000","last_peered":"2023-10-06T11:05:44.379201+0000","last_clean":"2023-10-06T11:05:44.379201+0000","last_became_active":"2023-10-06T11:05:44.378399+0000","last_became_peered":"2023-10-06T11:05:44.378399+0000","last_unstale":"2023-10-06T11:05:44.379201+0000","last_undegraded":"2023-10-06T11:05:44.379201+0000","last_fullsized":"2023-10-06T11:05:44.379201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:49:53.929590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.365682+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:05:44.365682+0000","last_peered":"2023-10-06T11:05:44.365682+0000","last_clean":"2023-10-06T11:05:44.365682+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:05:44.365682+0000","last_undegraded":"2023-10-06T11:05:44.365682+0000","last_fullsized":"2023-10-06T11:05:44.365682+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.355393+0000","last_change":"2023-10-06T11:05:43.364706+0000","last_active":"2023-10-06T11:05:44.355393+0000","last_peered":"2023-10-06T11:05:44.355393+0000","last_clean":"2023-10-06T11:05:44.355393+0000","last_became_active":"2023-10-06T11:05:43.364448+0000","last_became_peered":"2023-10-06T11:05:43.364448+0000","last_unstale":"2023-10-06T11:05:44.355393+0000","last_undegraded":"2023-10-06T11:05:44.355393+0000","last_fullsized":"2023-10-06T11:05:44.355393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:24.903299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.373780+0000","last_change":"2023-10-06T11:05:44.369625+0000","last_active":"2023-10-06T11:05:44.373780+0000","last_peered":"2023-10-06T11:05:44.373780+0000","last_clean":"2023-10-06T11:05:44.373780+0000","last_became_active":"2023-10-06T11:05:44.369370+0000","last_became_peered":"2023-10-06T11:05:44.369370+0000","last_unstale":"2023-10-06T11:05:44.373780+0000","last_undegraded":"2023-10-06T11:05:44.373780+0000","last_fullsized":"2023-10-06T11:05:44.373780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:53:56.031447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.354685+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:05:44.354685+0000","last_peered":"2023-10-06T11:05:44.354685+0000","last_clean":"2023-10-06T11:05:44.354685+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:05:44.354685+0000","last_undegraded":"2023-10-06T11:05:44.354685+0000","last_fullsized":"2023-10-06T11:05:44.354685+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.354439+0000","last_change":"2023-10-06T11:05:43.366958+0000","last_active":"2023-10-06T11:05:44.354439+0000","last_peered":"2023-10-06T11:05:44.354439+0000","last_clean":"2023-10-06T11:05:44.354439+0000","last_became_active":"2023-10-06T11:05:43.366523+0000","last_became_peered":"2023-10-06T11:05:43.366523+0000","last_unstale":"2023-10-06T11:05:44.354439+0000","last_undegraded":"2023-10-06T11:05:44.354439+0000","last_fullsized":"2023-10-06T11:05:44.354439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:24.903299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.376185+0000","last_change":"2023-10-06T11:05:44.372075+0000","last_active":"2023-10-06T11:05:44.376185+0000","last_peered":"2023-10-06T11:05:44.376185+0000","last_clean":"2023-10-06T11:05:44.376185+0000","last_became_active":"2023-10-06T11:05:44.371769+0000","last_became_peered":"2023-10-06T11:05:44.371769+0000","last_unstale":"2023-10-06T11:05:44.376185+0000","last_undegraded":"2023-10-06T11:05:44.376185+0000","last_fullsized":"2023-10-06T11:05:44.376185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:49:41.512642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.362233+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:05:44.362233+0000","last_peered":"2023-10-06T11:05:44.362233+0000","last_clean":"2023-10-06T11:05:44.362233+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:05:44.362233+0000","last_undegraded":"2023-10-06T11:05:44.362233+0000","last_fullsized":"2023-10-06T11:05:44.362233+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.364558+0000","last_change":"2023-10-06T11:05:43.368631+0000","last_active":"2023-10-06T11:05:44.364558+0000","last_peered":"2023-10-06T11:05:44.364558+0000","last_clean":"2023-10-06T11:05:44.364558+0000","last_became_active":"2023-10-06T11:05:43.368367+0000","last_became_peered":"2023-10-06T11:05:43.368367+0000","last_unstale":"2023-10-06T11:05:44.364558+0000","last_undegraded":"2023-10-06T11:05:44.364558+0000","last_fullsized":"2023-10-06T11:05:44.364558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:27.003956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377441+0000","last_change":"2023-10-06T11:05:44.374324+0000","last_active":"2023-10-06T11:05:44.377441+0000","last_peered":"2023-10-06T11:05:44.377441+0000","last_clean":"2023-10-06T11:05:44.377441+0000","last_became_active":"2023-10-06T11:05:44.374070+0000","last_became_peered":"2023-10-06T11:05:44.374070+0000","last_unstale":"2023-10-06T11:05:44.377441+0000","last_undegraded":"2023-10-06T11:05:44.377441+0000","last_fullsized":"2023-10-06T11:05:44.377441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:49:53.929590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.360913+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:05:44.360913+0000","last_peered":"2023-10-06T11:05:44.360913+0000","last_clean":"2023-10-06T11:05:44.360913+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:05:44.360913+0000","last_undegraded":"2023-10-06T11:05:44.360913+0000","last_fullsized":"2023-10-06T11:05:44.360913+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.356747+0000","last_change":"2023-10-06T11:05:43.364980+0000","last_active":"2023-10-06T11:05:44.356747+0000","last_peered":"2023-10-06T11:05:44.356747+0000","last_clean":"2023-10-06T11:05:44.356747+0000","last_became_active":"2023-10-06T11:05:43.364661+0000","last_became_peered":"2023-10-06T11:05:43.364661+0000","last_unstale":"2023-10-06T11:05:44.356747+0000","last_undegraded":"2023-10-06T11:05:44.356747+0000","last_fullsized":"2023-10-06T11:05:44.356747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:32.863094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379211+0000","last_change":"2023-10-06T11:05:44.378547+0000","last_active":"2023-10-06T11:05:44.379211+0000","last_peered":"2023-10-06T11:05:44.379211+0000","last_clean":"2023-10-06T11:05:44.379211+0000","last_became_active":"2023-10-06T11:05:44.378211+0000","last_became_peered":"2023-10-06T11:05:44.378211+0000","last_unstale":"2023-10-06T11:05:44.379211+0000","last_undegraded":"2023-10-06T11:05:44.379211+0000","last_fullsized":"2023-10-06T11:05:44.379211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:32:31.703547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377355+0000","last_change":"2023-10-06T11:05:43.368448+0000","last_active":"2023-10-06T11:05:44.377355+0000","last_peered":"2023-10-06T11:05:44.377355+0000","last_clean":"2023-10-06T11:05:44.377355+0000","last_became_active":"2023-10-06T11:05:43.367859+0000","last_became_peered":"2023-10-06T11:05:43.367859+0000","last_unstale":"2023-10-06T11:05:44.377355+0000","last_undegraded":"2023-10-06T11:05:44.377355+0000","last_fullsized":"2023-10-06T11:05:44.377355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:18.301774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375383+0000","last_change":"2023-10-06T11:05:44.369211+0000","last_active":"2023-10-06T11:05:44.375383+0000","last_peered":"2023-10-06T11:05:44.375383+0000","last_clean":"2023-10-06T11:05:44.375383+0000","last_became_active":"2023-10-06T11:05:44.368950+0000","last_became_peered":"2023-10-06T11:05:44.368950+0000","last_unstale":"2023-10-06T11:05:44.375383+0000","last_undegraded":"2023-10-06T11:05:44.375383+0000","last_fullsized":"2023-10-06T11:05:44.375383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:01.484408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377607+0000","last_change":"2023-10-06T11:05:43.365792+0000","last_active":"2023-10-06T11:05:44.377607+0000","last_peered":"2023-10-06T11:05:44.377607+0000","last_clean":"2023-10-06T11:05:44.377607+0000","last_became_active":"2023-10-06T11:05:43.365137+0000","last_became_peered":"2023-10-06T11:05:43.365137+0000","last_unstale":"2023-10-06T11:05:44.377607+0000","last_undegraded":"2023-10-06T11:05:44.377607+0000","last_fullsized":"2023-10-06T11:05:44.377607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:24.903299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379988+0000","last_change":"2023-10-06T11:05:44.373079+0000","last_active":"2023-10-06T11:05:44.379988+0000","last_peered":"2023-10-06T11:05:44.379988+0000","last_clean":"2023-10-06T11:05:44.379988+0000","last_became_active":"2023-10-06T11:05:44.372797+0000","last_became_peered":"2023-10-06T11:05:44.372797+0000","last_unstale":"2023-10-06T11:05:44.379988+0000","last_undegraded":"2023-10-06T11:05:44.379988+0000","last_fullsized":"2023-10-06T11:05:44.379988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:20.240548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377828+0000","last_change":"2023-10-06T11:05:43.367620+0000","last_active":"2023-10-06T11:05:44.377828+0000","last_peered":"2023-10-06T11:05:44.377828+0000","last_clean":"2023-10-06T11:05:44.377828+0000","last_became_active":"2023-10-06T11:05:43.367335+0000","last_became_peered":"2023-10-06T11:05:43.367335+0000","last_unstale":"2023-10-06T11:05:44.377828+0000","last_undegraded":"2023-10-06T11:05:44.377828+0000","last_fullsized":"2023-10-06T11:05:44.377828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:18.301774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375668+0000","last_change":"2023-10-06T11:05:44.371343+0000","last_active":"2023-10-06T11:05:44.375668+0000","last_peered":"2023-10-06T11:05:44.375668+0000","last_clean":"2023-10-06T11:05:44.375668+0000","last_became_active":"2023-10-06T11:05:44.371051+0000","last_became_peered":"2023-10-06T11:05:44.371051+0000","last_unstale":"2023-10-06T11:05:44.375668+0000","last_undegraded":"2023-10-06T11:05:44.375668+0000","last_fullsized":"2023-10-06T11:05:44.375668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:30:10.233024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375170+0000","last_change":"2023-10-06T11:05:43.362124+0000","last_active":"2023-10-06T11:05:44.375170+0000","last_peered":"2023-10-06T11:05:44.375170+0000","last_clean":"2023-10-06T11:05:44.375170+0000","last_became_active":"2023-10-06T11:05:43.361847+0000","last_became_peered":"2023-10-06T11:05:43.361847+0000","last_unstale":"2023-10-06T11:05:44.375170+0000","last_undegraded":"2023-10-06T11:05:44.375170+0000","last_fullsized":"2023-10-06T11:05:44.375170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:36.907530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.373157+0000","last_change":"2023-10-06T11:05:44.367010+0000","last_active":"2023-10-06T11:05:44.373157+0000","last_peered":"2023-10-06T11:05:44.373157+0000","last_clean":"2023-10-06T11:05:44.373157+0000","last_became_active":"2023-10-06T11:05:44.366748+0000","last_became_peered":"2023-10-06T11:05:44.366748+0000","last_unstale":"2023-10-06T11:05:44.373157+0000","last_undegraded":"2023-10-06T11:05:44.373157+0000","last_fullsized":"2023-10-06T11:05:44.373157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:32:17.346227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380717+0000","last_change":"2023-10-06T11:05:43.367936+0000","last_active":"2023-10-06T11:05:44.380717+0000","last_peered":"2023-10-06T11:05:44.380717+0000","last_clean":"2023-10-06T11:05:44.380717+0000","last_became_active":"2023-10-06T11:05:43.367668+0000","last_became_peered":"2023-10-06T11:05:43.367668+0000","last_unstale":"2023-10-06T11:05:44.380717+0000","last_undegraded":"2023-10-06T11:05:44.380717+0000","last_fullsized":"2023-10-06T11:05:44.380717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:20:04.789716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.382377+0000","last_change":"2023-10-06T11:05:44.375719+0000","last_active":"2023-10-06T11:05:44.382377+0000","last_peered":"2023-10-06T11:05:44.382377+0000","last_clean":"2023-10-06T11:05:44.382377+0000","last_became_active":"2023-10-06T11:05:44.375387+0000","last_became_peered":"2023-10-06T11:05:44.375387+0000","last_unstale":"2023-10-06T11:05:44.382377+0000","last_undegraded":"2023-10-06T11:05:44.382377+0000","last_fullsized":"2023-10-06T11:05:44.382377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:39:54.037210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375187+0000","last_change":"2023-10-06T11:05:44.370923+0000","last_active":"2023-10-06T11:05:44.375187+0000","last_peered":"2023-10-06T11:05:44.375187+0000","last_clean":"2023-10-06T11:05:44.375187+0000","last_became_active":"2023-10-06T11:05:44.370655+0000","last_became_peered":"2023-10-06T11:05:44.370655+0000","last_unstale":"2023-10-06T11:05:44.375187+0000","last_undegraded":"2023-10-06T11:05:44.375187+0000","last_fullsized":"2023-10-06T11:05:44.375187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:21:08.012086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379549+0000","last_change":"2023-10-06T11:05:44.373040+0000","last_active":"2023-10-06T11:05:44.379549+0000","last_peered":"2023-10-06T11:05:44.379549+0000","last_clean":"2023-10-06T11:05:44.379549+0000","last_became_active":"2023-10-06T11:05:44.370543+0000","last_became_peered":"2023-10-06T11:05:44.370543+0000","last_unstale":"2023-10-06T11:05:44.379549+0000","last_undegraded":"2023-10-06T11:05:44.379549+0000","last_fullsized":"2023-10-06T11:05:44.379549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:30:10.233024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380138+0000","last_change":"2023-10-06T11:05:44.374987+0000","last_active":"2023-10-06T11:05:44.380138+0000","last_peered":"2023-10-06T11:05:44.380138+0000","last_clean":"2023-10-06T11:05:44.380138+0000","last_became_active":"2023-10-06T11:05:44.374710+0000","last_became_peered":"2023-10-06T11:05:44.374710+0000","last_unstale":"2023-10-06T11:05:44.380138+0000","last_undegraded":"2023-10-06T11:05:44.380138+0000","last_fullsized":"2023-10-06T11:05:44.380138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:46:57.706239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379174+0000","last_change":"2023-10-06T11:05:44.372135+0000","last_active":"2023-10-06T11:05:44.379174+0000","last_peered":"2023-10-06T11:05:44.379174+0000","last_clean":"2023-10-06T11:05:44.379174+0000","last_became_active":"2023-10-06T11:05:44.371609+0000","last_became_peered":"2023-10-06T11:05:44.371609+0000","last_unstale":"2023-10-06T11:05:44.379174+0000","last_undegraded":"2023-10-06T11:05:44.379174+0000","last_fullsized":"2023-10-06T11:05:44.379174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:48:35.935962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.376168+0000","last_change":"2023-10-06T11:05:44.371940+0000","last_active":"2023-10-06T11:05:44.376168+0000","last_peered":"2023-10-06T11:05:44.376168+0000","last_clean":"2023-10-06T11:05:44.376168+0000","last_became_active":"2023-10-06T11:05:44.371617+0000","last_became_peered":"2023-10-06T11:05:44.371617+0000","last_unstale":"2023-10-06T11:05:44.376168+0000","last_undegraded":"2023-10-06T11:05:44.376168+0000","last_fullsized":"2023-10-06T11:05:44.376168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:48.500150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298096,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073744,"statfs":{"total":96636764160,"available":96331513856,"internally_reserved":0,"allocated":827392,"data_stored":666304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297484,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074356,"statfs":{"total":96636764160,"available":96332140544,"internally_reserved":0,"allocated":200704,"data_stored":72831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298068,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073772,"statfs":{"total":96636764160,"available":96331542528,"internally_reserved":0,"allocated":798720,"data_stored":664552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":73385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297484,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074356,"statfs":{"total":96636764160,"available":96332140544,"internally_reserved":0,"allocated":200704,"data_stored":72831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":72921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":74808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:05:53.344 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T11:05:53.345 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-06T11:05:53.345 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-06T11:05:53.345 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-06T11:05:53.345 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-06T11:05:53.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.493+0000 7fcbb359e700 1 Processor -- start 2023-10-06T11:05:53.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.493+0000 7fcbb359e700 1 -- start start 2023-10-06T11:05:53.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.494+0000 7fcbb359e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbb4154d20 0x7fcbb40c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:53.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.494+0000 7fcbb359e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcbb415aeb0 0x7fcbb415b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:53.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.494+0000 7fcbb359e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcbb41578b0 0x7fcbb4157d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:53.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.494+0000 7fcbb359e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbb406c5a0 con 0x7fcbb415aeb0 2023-10-06T11:05:53.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.494+0000 7fcbb359e700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbb415b840 con 0x7fcbb41578b0 2023-10-06T11:05:53.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.494+0000 7fcbb359e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb40c8f70 con 0x7fcbb4154d20 2023-10-06T11:05:53.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.494+0000 7fcbb1d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcbb415aeb0 0x7fcbb415b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:53.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.494+0000 7fcbb1d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcbb415aeb0 0x7fcbb415b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39780/0 (socket says 172.21.15.146:39780) 2023-10-06T11:05:53.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.494+0000 7fcbb1d9b700 1 -- 172.21.15.146:0/20641107 learned_addr learned my addr 172.21.15.146:0/20641107 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:53.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.494+0000 7fcbb1d9b700 1 -- 172.21.15.146:0/20641107 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbb4154d20 msgr2=0x7fcbb40c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:53.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.494+0000 7fcbb1d9b700 1 --2- 172.21.15.146:0/20641107 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbb4154d20 0x7fcbb40c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:53.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.494+0000 7fcbb1d9b700 1 -- 172.21.15.146:0/20641107 >> v2:172.21.15.151:3300/0 conn(0x7fcbb41578b0 msgr2=0x7fcbb4157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:53.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.494+0000 7fcbb2d9d700 1 --2- 172.21.15.146:0/20641107 >> v2:172.21.15.151:3300/0 conn(0x7fcbb41578b0 0x7fcbb4157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:53.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.494+0000 7fcbb1d9b700 1 --2- 172.21.15.146:0/20641107 >> v2:172.21.15.151:3300/0 conn(0x7fcbb41578b0 0x7fcbb4157d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:53.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.494+0000 7fcbb1d9b700 1 -- 172.21.15.146:0/20641107 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb406b6b0 con 0x7fcbb415aeb0 2023-10-06T11:05:53.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.495+0000 7fcbb1d9b700 1 --2- 172.21.15.146:0/20641107 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbb415aeb0 0x7fcbb415b300 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcbb406edb0 tx=0x7fcb9c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=784dfa26ad8e07ec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:53.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.495+0000 7fcbb159a700 1 -- 172.21.15.146:0/20641107 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c00b860 con 0x7fcbb415aeb0 2023-10-06T11:05:53.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.495+0000 7fcbb159a700 1 -- 172.21.15.146:0/20641107 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb9c00b9c0 con 0x7fcbb415aeb0 2023-10-06T11:05:53.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.495+0000 7fcbb159a700 1 -- 172.21.15.146:0/20641107 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9c00bd60 con 0x7fcbb415aeb0 2023-10-06T11:05:53.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.495+0000 7fcbb359e700 1 -- 172.21.15.146:0/20641107 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbb415aeb0 msgr2=0x7fcbb415b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:53.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.495+0000 7fcbb359e700 1 --2- 172.21.15.146:0/20641107 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbb415aeb0 0x7fcbb415b300 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcbb406edb0 tx=0x7fcb9c009250 comp rx=0 tx=0).stop 2023-10-06T11:05:53.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.495+0000 7fcbb359e700 1 -- 172.21.15.146:0/20641107 shutdown_connections 2023-10-06T11:05:53.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.495+0000 7fcbb359e700 1 --2- 172.21.15.146:0/20641107 >> v2:172.21.15.151:3300/0 conn(0x7fcbb41578b0 0x7fcbb4157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:53.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.495+0000 7fcbb359e700 1 --2- 172.21.15.146:0/20641107 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbb4154d20 0x7fcbb40c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:53.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.495+0000 7fcbb359e700 1 --2- 172.21.15.146:0/20641107 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbb415aeb0 0x7fcbb415b300 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:53.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.495+0000 7fcbb359e700 1 -- 172.21.15.146:0/20641107 >> 172.21.15.146:0/20641107 conn(0x7fcbb40ce260 msgr2=0x7fcbb40ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:53.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.495+0000 7fcbb359e700 1 -- 172.21.15.146:0/20641107 shutdown_connections 2023-10-06T11:05:53.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.495+0000 7fcbb359e700 1 -- 172.21.15.146:0/20641107 wait complete. 2023-10-06T11:05:53.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.496+0000 7fcbb359e700 1 Processor -- start 2023-10-06T11:05:53.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.496+0000 7fcbb359e700 1 -- start start 2023-10-06T11:05:53.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.497+0000 7fcbb359e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbb4154d20 0x7fcbb40c6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:53.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.497+0000 7fcbb359e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbb41578b0 0x7fcbb41560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:53.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.497+0000 7fcbb359e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbb415aeb0 0x7fcbb4156600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:53.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.497+0000 7fcbb359e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb40c80f0 con 0x7fcbb4154d20 2023-10-06T11:05:53.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.497+0000 7fcbb359e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb414c880 con 0x7fcbb41578b0 2023-10-06T11:05:53.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.497+0000 7fcbb359e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb40c74e0 con 0x7fcbb415aeb0 2023-10-06T11:05:53.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.497+0000 7fcbb259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbb4154d20 0x7fcbb40c6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:53.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.497+0000 7fcbb259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbb4154d20 0x7fcbb40c6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39786/0 (socket says 172.21.15.146:39786) 2023-10-06T11:05:53.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.497+0000 7fcbb259c700 1 -- 172.21.15.146:0/3804407360 learned_addr learned my addr 172.21.15.146:0/3804407360 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:53.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.497+0000 7fcbb1d9b700 1 --2- 172.21.15.146:0/3804407360 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbb41578b0 0x7fcbb41560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:53.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.497+0000 7fcbb259c700 1 -- 172.21.15.146:0/3804407360 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbb415aeb0 msgr2=0x7fcbb4156600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:53.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.497+0000 7fcbb259c700 1 --2- 172.21.15.146:0/3804407360 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbb415aeb0 0x7fcbb4156600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:53.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.497+0000 7fcbb259c700 1 -- 172.21.15.146:0/3804407360 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbb41578b0 msgr2=0x7fcbb41560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:53.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.497+0000 7fcbb259c700 1 --2- 172.21.15.146:0/3804407360 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbb41578b0 0x7fcbb41560c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:53.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.497+0000 7fcbb259c700 1 -- 172.21.15.146:0/3804407360 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb9c0094f0 con 0x7fcbb4154d20 2023-10-06T11:05:53.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.498+0000 7fcbb259c700 1 --2- 172.21.15.146:0/3804407360 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbb4154d20 0x7fcbb40c6e70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcbac00bc30 tx=0x7fcbac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:53.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.498+0000 7fcbaa7fc700 1 -- 172.21.15.146:0/3804407360 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac0092e0 con 0x7fcbb4154d20 2023-10-06T11:05:53.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.498+0000 7fcbaa7fc700 1 -- 172.21.15.146:0/3804407360 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbac00c7a0 con 0x7fcbb4154d20 2023-10-06T11:05:53.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.498+0000 7fcbb359e700 1 -- 172.21.15.146:0/3804407360 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbb40c77c0 con 0x7fcbb4154d20 2023-10-06T11:05:53.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.498+0000 7fcbaa7fc700 1 -- 172.21.15.146:0/3804407360 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac00cb80 con 0x7fcbb4154d20 2023-10-06T11:05:53.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.498+0000 7fcbb359e700 1 -- 172.21.15.146:0/3804407360 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbb40c7d80 con 0x7fcbb4154d20 2023-10-06T11:05:53.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.499+0000 7fcbb359e700 1 -- 172.21.15.146:0/3804407360 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbb406e510 con 0x7fcbb4154d20 2023-10-06T11:05:53.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.499+0000 7fcbaa7fc700 1 -- 172.21.15.146:0/3804407360 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcbac012070 con 0x7fcbb4154d20 2023-10-06T11:05:53.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.499+0000 7fcbaa7fc700 1 --2- 172.21.15.146:0/3804407360 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcb94066f30 0x7fcb940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:53.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.499+0000 7fcbaa7fc700 1 -- 172.21.15.146:0/3804407360 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcbac084330 con 0x7fcbb4154d20 2023-10-06T11:05:53.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.499+0000 7fcbb1d9b700 1 --2- 172.21.15.146:0/3804407360 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcb94066f30 0x7fcb940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:53.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.500+0000 7fcbb1d9b700 1 --2- 172.21.15.146:0/3804407360 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcb94066f30 0x7fcb940693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcbb406edb0 tx=0x7fcb9c017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:53.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.504+0000 7fcbaa7fc700 1 -- 172.21.15.146:0/3804407360 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcbac051440 con 0x7fcbb4154d20 2023-10-06T11:05:53.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.739+0000 7fcbb359e700 1 -- 172.21.15.146:0/3804407360 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fcbb406b990 con 0x7fcbb4154d20 2023-10-06T11:05:53.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.741+0000 7fcbaa7fc700 1 -- 172.21.15.146:0/3804407360 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+163704 (secure 0 0 0) 0x7fcbac054a60 con 0x7fcbb4154d20 2023-10-06T11:05:53.744 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:05:53.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.744+0000 7fcbb359e700 1 -- 172.21.15.146:0/3804407360 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcb94066f30 msgr2=0x7fcb940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:53.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.744+0000 7fcbb359e700 1 --2- 172.21.15.146:0/3804407360 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcb94066f30 0x7fcb940693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fcbb406edb0 tx=0x7fcb9c017000 comp rx=0 tx=0).stop 2023-10-06T11:05:53.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.744+0000 7fcbb359e700 1 -- 172.21.15.146:0/3804407360 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbb4154d20 msgr2=0x7fcbb40c6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:53.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.744+0000 7fcbb359e700 1 --2- 172.21.15.146:0/3804407360 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbb4154d20 0x7fcbb40c6e70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcbac00bc30 tx=0x7fcbac009840 comp rx=0 tx=0).stop 2023-10-06T11:05:53.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.744+0000 7fcbb359e700 1 -- 172.21.15.146:0/3804407360 shutdown_connections 2023-10-06T11:05:53.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.744+0000 7fcbb359e700 1 --2- 172.21.15.146:0/3804407360 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcb94066f30 0x7fcb940693e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:53.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.744+0000 7fcbb359e700 1 --2- 172.21.15.146:0/3804407360 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbb415aeb0 0x7fcbb4156600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:53.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.744+0000 7fcbb359e700 1 --2- 172.21.15.146:0/3804407360 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbb4154d20 0x7fcbb40c6e70 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:53.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.744+0000 7fcbb359e700 1 --2- 172.21.15.146:0/3804407360 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbb41578b0 0x7fcbb41560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:53.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.744+0000 7fcbb359e700 1 -- 172.21.15.146:0/3804407360 >> 172.21.15.146:0/3804407360 conn(0x7fcbb40ce260 msgr2=0x7fcbb4152a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:53.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.744+0000 7fcbb359e700 1 -- 172.21.15.146:0/3804407360 shutdown_connections 2023-10-06T11:05:53.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.744+0000 7fcbb359e700 1 -- 172.21.15.146:0/3804407360 wait complete. 2023-10-06T11:05:53.756 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":5,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6832","nonce":90434},{"type":"v1","addr":"172.21.15.146:6833","nonce":90434}]},"active_addr":"172.21.15.146:6833/90434","active_change":"2023-10-06T11:05:31.121188+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.146:0","nonce":112154067}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.146:0","nonce":3824826060}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.146:0","nonce":679819117}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.146:0","nonce":3528685530}]}]} 2023-10-06T11:05:53.763 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-06T11:05:53.763 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-06T11:05:53.763 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:05:53.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.875+0000 7fea0d1a7700 1 Processor -- start 2023-10-06T11:05:53.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.875+0000 7fea0d1a7700 1 -- start start 2023-10-06T11:05:53.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.876+0000 7fea0d1a7700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea08068ba0 0x7fea0815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:53.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.876+0000 7fea0d1a7700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea0815ac30 con 0x7fea08153ab0 2023-10-06T11:05:53.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.876+0000 7fea0d1a7700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea080b4510 con 0x7fea08153e80 2023-10-06T11:05:53.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.876+0000 7fea0d1a7700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea080b6530 con 0x7fea08068ba0 2023-10-06T11:05:53.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.876+0000 7fea06d9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fea08153ab0 0x7fea08068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38758/0 (socket says 172.21.15.146:38758) 2023-10-06T11:05:53.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.876+0000 7fea06d9d700 1 -- 172.21.15.146:0/3866523038 learned_addr learned my addr 172.21.15.146:0/3866523038 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:05:53.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.877+0000 7fe9fffff700 1 --2- 172.21.15.146:0/3866523038 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea08068ba0 0x7fea0815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:53.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.877+0000 7fea0659c700 1 -- 172.21.15.146:0/3866523038 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2997837679 0 0) 0x7fe9f8001110 con 0x7fea08153ab0 2023-10-06T11:05:53.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.877+0000 7fea0659c700 1 -- 172.21.15.146:0/3866523038 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9f4003570 con 0x7fea08153ab0 2023-10-06T11:05:53.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.877+0000 7fea0659c700 1 -- 172.21.15.146:0/3866523038 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3192473311 0 0) 0x7fe9f4003570 con 0x7fea08153ab0 2023-10-06T11:05:53.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.877+0000 7fea0659c700 1 -- 172.21.15.146:0/3866523038 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea08068ba0 msgr2=0x7fea0815a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:53.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.877+0000 7fea0659c700 1 --2- 172.21.15.146:0/3866523038 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea08068ba0 0x7fea0815a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:53.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.877+0000 7fea0659c700 1 -- 172.21.15.146:0/3866523038 >> v1:172.21.15.151:6789/0 conn(0x7fea08153e80 legacy=0x7fea080b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:53.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.877+0000 7fea0659c700 1 -- 172.21.15.146:0/3866523038 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea080b5c50 con 0x7fea08153ab0 2023-10-06T11:05:53.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.877+0000 7fea0659c700 1 -- 172.21.15.146:0/3866523038 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fe9f8001600 con 0x7fea08153ab0 2023-10-06T11:05:53.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.877+0000 7fea0659c700 1 -- 172.21.15.146:0/3866523038 >> v1:172.21.15.146:6789/0 conn(0x7fea08153ab0 legacy=0x7fea08068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:53.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.877+0000 7fea0659c700 1 --2- 172.21.15.146:0/3866523038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9f4003a90 0x7fe9f4003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:53.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.877+0000 7fea0659c700 1 --2- 172.21.15.146:0/3866523038 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea08068ba0 0x7fe9f4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:53.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.877+0000 7fea0659c700 1 --2- 172.21.15.146:0/3866523038 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9f4004d50 0x7fe9f40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:53.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.877+0000 7fea0659c700 1 -- 172.21.15.146:0/3866523038 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea080b6530 con 0x7fe9f4003a90 2023-10-06T11:05:53.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.877+0000 7fea0659c700 1 -- 172.21.15.146:0/3866523038 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f400bb10 con 0x7fe9f4004d50 2023-10-06T11:05:53.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.877+0000 7fea0659c700 1 -- 172.21.15.146:0/3866523038 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f400bcd0 con 0x7fea08068ba0 2023-10-06T11:05:53.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.877+0000 7fea06d9d700 1 --2- 172.21.15.146:0/3866523038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9f4003a90 0x7fe9f4003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:53.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.877+0000 7fe9fffff700 1 --2- 172.21.15.146:0/3866523038 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea08068ba0 0x7fe9f4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:53.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.877+0000 7fea0759e700 1 --2- 172.21.15.146:0/3866523038 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9f4004d50 0x7fe9f40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:53.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.877+0000 7fea06d9d700 1 -- 172.21.15.146:0/3866523038 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea08068ba0 msgr2=0x7fe9f4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:53.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.877+0000 7fea06d9d700 1 --2- 172.21.15.146:0/3866523038 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea08068ba0 0x7fe9f4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:53.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.877+0000 7fea06d9d700 1 -- 172.21.15.146:0/3866523038 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9f4004d50 msgr2=0x7fe9f40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:53.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.877+0000 7fea06d9d700 1 --2- 172.21.15.146:0/3866523038 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9f4004d50 0x7fe9f40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:53.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.877+0000 7fea06d9d700 1 -- 172.21.15.146:0/3866523038 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f4003570 con 0x7fe9f4003a90 2023-10-06T11:05:53.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.877+0000 7fea06d9d700 1 --2- 172.21.15.146:0/3866523038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9f4003a90 0x7fe9f4003e60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe9f800c5f0 tx=0x7fea080b3db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32e9e4f767c78d91 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:53.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.878+0000 7fea0659c700 1 -- 172.21.15.146:0/3866523038 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f800cdf0 con 0x7fe9f4003a90 2023-10-06T11:05:53.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.878+0000 7fea0659c700 1 -- 172.21.15.146:0/3866523038 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f8005920 con 0x7fe9f4003a90 2023-10-06T11:05:53.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.878+0000 7fea0659c700 1 -- 172.21.15.146:0/3866523038 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f8005ce0 con 0x7fe9f4003a90 2023-10-06T11:05:53.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.878+0000 7fea0d1a7700 1 -- 172.21.15.146:0/3866523038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9f4003a90 msgr2=0x7fe9f4003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:53.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.878+0000 7fea0d1a7700 1 --2- 172.21.15.146:0/3866523038 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9f4003a90 0x7fe9f4003e60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe9f800c5f0 tx=0x7fea080b3db0 comp rx=0 tx=0).stop 2023-10-06T11:05:53.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.878+0000 7fea0759e700 1 -- 172.21.15.146:0/3866523038 reap_dead start 2023-10-06T11:05:53.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.878+0000 7fea0d1a7700 1 -- 172.21.15.146:0/3866523038 shutdown_connections 2023-10-06T11:05:53.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.878+0000 7fea0d1a7700 1 -- 172.21.15.146:0/3866523038 >> 172.21.15.146:0/3866523038 conn(0x7fea0806eba0 msgr2=0x7fea0806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:53.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.878+0000 7fea0d1a7700 1 -- 172.21.15.146:0/3866523038 shutdown_connections 2023-10-06T11:05:53.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.878+0000 7fea0d1a7700 1 -- 172.21.15.146:0/3866523038 wait complete. 2023-10-06T11:05:53.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.879+0000 7fea0d1a7700 1 Processor -- start 2023-10-06T11:05:53.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.879+0000 7fea0d1a7700 1 -- start start 2023-10-06T11:05:53.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.880+0000 7fea0d1a7700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9f4003a90 0x7fea0813e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:53.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.880+0000 7fea0d1a7700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea08159320 0x7fea0815d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:53.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.880+0000 7fea0d1a7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea08159790 0x7fea0815dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:53.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.880+0000 7fea0d1a7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea08155750 con 0x7fea08159790 2023-10-06T11:05:53.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.880+0000 7fea0d1a7700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea08154b40 con 0x7fea08159320 2023-10-06T11:05:53.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.880+0000 7fea0d1a7700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea08154e20 con 0x7fe9f4003a90 2023-10-06T11:05:53.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.880+0000 7fea0759e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea08159790 0x7fea0815dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:53.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.880+0000 7fea0759e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea08159790 0x7fea0815dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39806/0 (socket says 172.21.15.146:39806) 2023-10-06T11:05:53.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.880+0000 7fea0759e700 1 -- 172.21.15.146:0/3512623408 learned_addr learned my addr 172.21.15.146:0/3512623408 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:53.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.880+0000 7fea06d9d700 1 --2- 172.21.15.146:0/3512623408 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9f4003a90 0x7fea0813e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:53.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.880+0000 7fe9fffff700 1 --2- 172.21.15.146:0/3512623408 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea08159320 0x7fea0815d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:53.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.880+0000 7fea0759e700 1 -- 172.21.15.146:0/3512623408 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9f4003a90 msgr2=0x7fea0813e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:53.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.880+0000 7fea0759e700 1 --2- 172.21.15.146:0/3512623408 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9f4003a90 0x7fea0813e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:53.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.880+0000 7fea0759e700 1 -- 172.21.15.146:0/3512623408 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea08159320 msgr2=0x7fea0815d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:53.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.880+0000 7fea0759e700 1 --2- 172.21.15.146:0/3512623408 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea08159320 0x7fea0815d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:53.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.880+0000 7fea0759e700 1 -- 172.21.15.146:0/3512623408 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea08155100 con 0x7fea08159790 2023-10-06T11:05:53.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.880+0000 7fea0759e700 1 --2- 172.21.15.146:0/3512623408 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea08159790 0x7fea0815dd50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fea08154250 tx=0x7fea00009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:53.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.881+0000 7fe9feffd700 1 -- 172.21.15.146:0/3512623408 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea000032e0 con 0x7fea08159790 2023-10-06T11:05:53.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.881+0000 7fe9feffd700 1 -- 172.21.15.146:0/3512623408 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea00003440 con 0x7fea08159790 2023-10-06T11:05:53.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.881+0000 7fea0d1a7700 1 -- 172.21.15.146:0/3512623408 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea081553e0 con 0x7fea08159790 2023-10-06T11:05:53.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.881+0000 7fe9feffd700 1 -- 172.21.15.146:0/3512623408 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea00001890 con 0x7fea08159790 2023-10-06T11:05:53.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.881+0000 7fea0d1a7700 1 -- 172.21.15.146:0/3512623408 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea081547a0 con 0x7fea08159790 2023-10-06T11:05:53.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.881+0000 7fea0d1a7700 1 -- 172.21.15.146:0/3512623408 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea08155900 con 0x7fea08159790 2023-10-06T11:05:53.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.882+0000 7fe9feffd700 1 -- 172.21.15.146:0/3512623408 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fea00001c80 con 0x7fea08159790 2023-10-06T11:05:53.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.882+0000 7fe9feffd700 1 --2- 172.21.15.146:0/3512623408 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe9e8066f60 0x7fe9e8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:53.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.882+0000 7fe9feffd700 1 -- 172.21.15.146:0/3512623408 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fea000847b0 con 0x7fea08159790 2023-10-06T11:05:53.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.882+0000 7fea06d9d700 1 --2- 172.21.15.146:0/3512623408 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe9e8066f60 0x7fe9e8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:53.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.883+0000 7fea06d9d700 1 --2- 172.21.15.146:0/3512623408 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe9e8066f60 0x7fe9e8069410 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe9f8007e30 tx=0x7fe9f8015000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:53.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:53.887+0000 7fe9feffd700 1 -- 172.21.15.146:0/3512623408 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fea08155900 con 0x7fea08159790 2023-10-06T11:05:54.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.073+0000 7fea0d1a7700 1 -- 172.21.15.146:0/3512623408 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fea0804c380 con 0x7fea08159790 2023-10-06T11:05:54.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.074+0000 7fe9feffd700 1 -- 172.21.15.146:0/3512623408 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16914 (secure 0 0 0) 0x7fea00051820 con 0x7fea08159790 2023-10-06T11:05:54.075 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:05:54.076 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":20,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:05:45.362089+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:05:41.403954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T11:05:42.698754+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:05:54.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.076+0000 7fea0d1a7700 1 -- 172.21.15.146:0/3512623408 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe9e8066f60 msgr2=0x7fe9e8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.076+0000 7fea0d1a7700 1 --2- 172.21.15.146:0/3512623408 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe9e8066f60 0x7fe9e8069410 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe9f8007e30 tx=0x7fe9f8015000 comp rx=0 tx=0).stop 2023-10-06T11:05:54.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.076+0000 7fea0d1a7700 1 -- 172.21.15.146:0/3512623408 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea08159790 msgr2=0x7fea0815dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.076+0000 7fea0d1a7700 1 --2- 172.21.15.146:0/3512623408 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea08159790 0x7fea0815dd50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fea08154250 tx=0x7fea00009040 comp rx=0 tx=0).stop 2023-10-06T11:05:54.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.076+0000 7fea0d1a7700 1 -- 172.21.15.146:0/3512623408 shutdown_connections 2023-10-06T11:05:54.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.076+0000 7fea0d1a7700 1 --2- 172.21.15.146:0/3512623408 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe9e8066f60 0x7fe9e8069410 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.076+0000 7fea0d1a7700 1 --2- 172.21.15.146:0/3512623408 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea08159790 0x7fea0815dd50 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.076+0000 7fea0d1a7700 1 --2- 172.21.15.146:0/3512623408 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9f4003a90 0x7fea0813e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.076+0000 7fea0d1a7700 1 --2- 172.21.15.146:0/3512623408 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea08159320 0x7fea0815d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.076+0000 7fea0d1a7700 1 -- 172.21.15.146:0/3512623408 >> 172.21.15.146:0/3512623408 conn(0x7fea0806eba0 msgr2=0x7fea081531a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:54.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.076+0000 7fea0d1a7700 1 -- 172.21.15.146:0/3512623408 shutdown_connections 2023-10-06T11:05:54.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.076+0000 7fea0d1a7700 1 -- 172.21.15.146:0/3512623408 wait complete. 2023-10-06T11:05:54.090 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-06T11:05:54.090 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:05:54.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.203+0000 7fdb9ffff700 1 Processor -- start 2023-10-06T11:05:54.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.203+0000 7fdb9ffff700 1 -- start start 2023-10-06T11:05:54.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.204+0000 7fdb9ffff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdba015a7f0 0x7fdba015cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.204+0000 7fdb9ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdba00b2530 0x7fdba015acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.204+0000 7fdb9ffff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdba015c630 con 0x7fdba015a420 2023-10-06T11:05:54.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.204+0000 7fdb9ffff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdba00ce040 con 0x7fdba00b2530 2023-10-06T11:05:54.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.204+0000 7fdb9ffff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba015ba20 con 0x7fdba015a7f0 2023-10-06T11:05:54.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.204+0000 7fdb9f7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdba00b2530 0x7fdba015acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.204+0000 7fdb9f7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdba00b2530 0x7fdba015acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39812/0 (socket says 172.21.15.146:39812) 2023-10-06T11:05:54.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.204+0000 7fdb9f7fe700 1 -- 172.21.15.146:0/3623508952 learned_addr learned my addr 172.21.15.146:0/3623508952 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:54.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.204+0000 7fdb9effd700 1 --1- 172.21.15.146:0/3623508952 >> v1:172.21.15.151:6789/0 conn(0x7fdba015a420 0x7fdba00b1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:38420/0 (socket says 172.21.15.146:38420) 2023-10-06T11:05:54.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.204+0000 7fdb967fc700 1 --2- 172.21.15.146:0/3623508952 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdba015a7f0 0x7fdba015cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.204+0000 7fdb9f7fe700 1 -- 172.21.15.146:0/3623508952 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdba015a7f0 msgr2=0x7fdba015cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:54.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.204+0000 7fdb9f7fe700 1 --2- 172.21.15.146:0/3623508952 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdba015a7f0 0x7fdba015cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.204+0000 7fdb9f7fe700 1 -- 172.21.15.146:0/3623508952 >> v1:172.21.15.151:6789/0 conn(0x7fdba015a420 legacy=0x7fdba00b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.204+0000 7fdb9f7fe700 1 -- 172.21.15.146:0/3623508952 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba015bd00 con 0x7fdba00b2530 2023-10-06T11:05:54.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.204+0000 7fdb9f7fe700 1 --2- 172.21.15.146:0/3623508952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdba00b2530 0x7fdba015acd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdb98009f20 tx=0x7fdb98009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=541ab3a5f9a73cda server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:54.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.205+0000 7fdb9e7fc700 1 -- 172.21.15.146:0/3623508952 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9800e070 con 0x7fdba00b2530 2023-10-06T11:05:54.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.205+0000 7fdb9e7fc700 1 -- 172.21.15.146:0/3623508952 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9800b9d0 con 0x7fdba00b2530 2023-10-06T11:05:54.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.205+0000 7fdb9e7fc700 1 -- 172.21.15.146:0/3623508952 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb980092e0 con 0x7fdba00b2530 2023-10-06T11:05:54.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.205+0000 7fdb9ffff700 1 -- 172.21.15.146:0/3623508952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdba00b2530 msgr2=0x7fdba015acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.205+0000 7fdb9ffff700 1 --2- 172.21.15.146:0/3623508952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdba00b2530 0x7fdba015acd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdb98009f20 tx=0x7fdb98009840 comp rx=0 tx=0).stop 2023-10-06T11:05:54.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.205+0000 7fdb9ffff700 1 -- 172.21.15.146:0/3623508952 shutdown_connections 2023-10-06T11:05:54.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.205+0000 7fdb9ffff700 1 --2- 172.21.15.146:0/3623508952 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdba00b2530 0x7fdba015acd0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.205+0000 7fdb9ffff700 1 --2- 172.21.15.146:0/3623508952 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdba015a7f0 0x7fdba015cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.205+0000 7fdb9ffff700 1 -- 172.21.15.146:0/3623508952 >> 172.21.15.146:0/3623508952 conn(0x7fdba006eba0 msgr2=0x7fdba006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:54.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.205+0000 7fdb9ffff700 1 -- 172.21.15.146:0/3623508952 shutdown_connections 2023-10-06T11:05:54.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.205+0000 7fdb9ffff700 1 -- 172.21.15.146:0/3623508952 wait complete. 2023-10-06T11:05:54.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.206+0000 7fdb9ffff700 1 Processor -- start 2023-10-06T11:05:54.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.206+0000 7fdb9ffff700 1 -- start start 2023-10-06T11:05:54.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.207+0000 7fdb9ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdba00b2530 0x7fdba014f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.207+0000 7fdb9ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdba015a420 0x7fdba015d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.207+0000 7fdb9ffff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdba015a7f0 0x7fdba0154e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.207+0000 7fdb9ffff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba01574b0 con 0x7fdba015a420 2023-10-06T11:05:54.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.207+0000 7fdb9ffff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba0157180 con 0x7fdba00b2530 2023-10-06T11:05:54.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.207+0000 7fdb9ffff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba015de20 con 0x7fdba015a7f0 2023-10-06T11:05:54.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.207+0000 7fdb967fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdba015a420 0x7fdba015d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.207+0000 7fdb967fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdba015a420 0x7fdba015d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39828/0 (socket says 172.21.15.146:39828) 2023-10-06T11:05:54.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.207+0000 7fdb967fc700 1 -- 172.21.15.146:0/1853943971 learned_addr learned my addr 172.21.15.146:0/1853943971 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:54.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.207+0000 7fdb9f7fe700 1 --2- 172.21.15.146:0/1853943971 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdba015a7f0 0x7fdba0154e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.207+0000 7fdb9effd700 1 --2- 172.21.15.146:0/1853943971 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdba00b2530 0x7fdba014f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.207+0000 7fdb967fc700 1 -- 172.21.15.146:0/1853943971 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdba015a7f0 msgr2=0x7fdba0154e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.207+0000 7fdb967fc700 1 --2- 172.21.15.146:0/1853943971 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdba015a7f0 0x7fdba0154e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.207+0000 7fdb967fc700 1 -- 172.21.15.146:0/1853943971 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdba00b2530 msgr2=0x7fdba014f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.207+0000 7fdb967fc700 1 --2- 172.21.15.146:0/1853943971 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdba00b2530 0x7fdba014f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.207+0000 7fdb967fc700 1 -- 172.21.15.146:0/1853943971 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb98009ae0 con 0x7fdba015a420 2023-10-06T11:05:54.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.207+0000 7fdb9f7fe700 1 --2- 172.21.15.146:0/1853943971 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdba015a7f0 0x7fdba0154e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:05:54.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.207+0000 7fdb9effd700 1 --2- 172.21.15.146:0/1853943971 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdba00b2530 0x7fdba014f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:05:54.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.208+0000 7fdb967fc700 1 --2- 172.21.15.146:0/1853943971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdba015a420 0x7fdba015d380 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdb8800e900 tx=0x7fdb880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:54.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.208+0000 7fdb977fe700 1 -- 172.21.15.146:0/1853943971 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb88009510 con 0x7fdba015a420 2023-10-06T11:05:54.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.208+0000 7fdb977fe700 1 -- 172.21.15.146:0/1853943971 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb8800c850 con 0x7fdba015a420 2023-10-06T11:05:54.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.208+0000 7fdb9ffff700 1 -- 172.21.15.146:0/1853943971 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdba015e100 con 0x7fdba015a420 2023-10-06T11:05:54.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.208+0000 7fdb977fe700 1 -- 172.21.15.146:0/1853943971 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8800cbf0 con 0x7fdba015a420 2023-10-06T11:05:54.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.208+0000 7fdb9ffff700 1 -- 172.21.15.146:0/1853943971 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba014f7e0 con 0x7fdba015a420 2023-10-06T11:05:54.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.209+0000 7fdb9ffff700 1 -- 172.21.15.146:0/1853943971 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdba0156fe0 con 0x7fdba015a420 2023-10-06T11:05:54.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.209+0000 7fdb977fe700 1 -- 172.21.15.146:0/1853943971 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdb8800cd50 con 0x7fdba015a420 2023-10-06T11:05:54.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.209+0000 7fdb977fe700 1 --2- 172.21.15.146:0/1853943971 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdb80066f30 0x7fdb800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.210+0000 7fdb977fe700 1 -- 172.21.15.146:0/1853943971 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdb880847f0 con 0x7fdba015a420 2023-10-06T11:05:54.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.210+0000 7fdb9effd700 1 --2- 172.21.15.146:0/1853943971 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdb80066f30 0x7fdb800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.210+0000 7fdb9effd700 1 --2- 172.21.15.146:0/1853943971 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdb80066f30 0x7fdb800693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdb90001820 tx=0x7fdb90009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:54.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.214+0000 7fdb977fe700 1 -- 172.21.15.146:0/1853943971 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdba0156fe0 con 0x7fdba015a420 2023-10-06T11:05:54.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.398+0000 7fdb9ffff700 1 -- 172.21.15.146:0/1853943971 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdba0156fe0 con 0x7fdba015a420 2023-10-06T11:05:54.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.398+0000 7fdb977fe700 1 -- 172.21.15.146:0/1853943971 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16914 (secure 0 0 0) 0x7fdba0156fe0 con 0x7fdba015a420 2023-10-06T11:05:54.400 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:05:54.401 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":20,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:05:45.362089+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:05:41.403954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T11:05:42.698754+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:05:54.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.401+0000 7fdb9ffff700 1 -- 172.21.15.146:0/1853943971 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdb80066f30 msgr2=0x7fdb800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.401+0000 7fdb9ffff700 1 --2- 172.21.15.146:0/1853943971 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdb80066f30 0x7fdb800693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdb90001820 tx=0x7fdb90009040 comp rx=0 tx=0).stop 2023-10-06T11:05:54.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.401+0000 7fdb9ffff700 1 -- 172.21.15.146:0/1853943971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdba015a420 msgr2=0x7fdba015d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.401+0000 7fdb9ffff700 1 --2- 172.21.15.146:0/1853943971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdba015a420 0x7fdba015d380 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fdb8800e900 tx=0x7fdb880091a0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.401+0000 7fdb9ffff700 1 -- 172.21.15.146:0/1853943971 shutdown_connections 2023-10-06T11:05:54.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.401+0000 7fdb9ffff700 1 --2- 172.21.15.146:0/1853943971 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdb80066f30 0x7fdb800693e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.401+0000 7fdb9ffff700 1 --2- 172.21.15.146:0/1853943971 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdba015a7f0 0x7fdba0154e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.401+0000 7fdb9ffff700 1 --2- 172.21.15.146:0/1853943971 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdba00b2530 0x7fdba014f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.401+0000 7fdb9ffff700 1 --2- 172.21.15.146:0/1853943971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdba015a420 0x7fdba015d380 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.401+0000 7fdb9ffff700 1 -- 172.21.15.146:0/1853943971 >> 172.21.15.146:0/1853943971 conn(0x7fdba006eba0 msgr2=0x7fdba00b1380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:54.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.401+0000 7fdb9ffff700 1 -- 172.21.15.146:0/1853943971 shutdown_connections 2023-10-06T11:05:54.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.401+0000 7fdb9ffff700 1 -- 172.21.15.146:0/1853943971 wait complete. 2023-10-06T11:05:54.417 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-06T11:05:54.418 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-06T11:05:54.418 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-06T11:05:54.418 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-06T11:05:54.419 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-06T11:05:54.419 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-06T11:05:54.420 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-06T11:05:54.420 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-06T11:05:54.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.598+0000 7f094aee3700 1 Processor -- start 2023-10-06T11:05:54.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.598+0000 7f094aee3700 1 -- start start 2023-10-06T11:05:54.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.599+0000 7f094aee3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0944155720 0x7f0944155af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.599+0000 7f094aee3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09440ac500 0x7f09440c8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.599+0000 7f094aee3700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09440ac9e0 con 0x7f09440afbd0 2023-10-06T11:05:54.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.599+0000 7f094aee3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09440accc0 con 0x7f0944155720 2023-10-06T11:05:54.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.599+0000 7f094aee3700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09440acfa0 con 0x7f09440ac500 2023-10-06T11:05:54.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.600+0000 7f0948c7f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0944155720 0x7f0944155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.600+0000 7f0948c7f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0944155720 0x7f0944155af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39834/0 (socket says 172.21.15.146:39834) 2023-10-06T11:05:54.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.600+0000 7f0948c7f700 1 -- 172.21.15.146:0/2211398749 learned_addr learned my addr 172.21.15.146:0/2211398749 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:54.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.600+0000 7f0943fff700 1 --2- 172.21.15.146:0/2211398749 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09440ac500 0x7f09440c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.600+0000 7f0948c7f700 1 -- 172.21.15.146:0/2211398749 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09440ac500 msgr2=0x7f09440c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:54.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.600+0000 7f0948c7f700 1 --2- 172.21.15.146:0/2211398749 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09440ac500 0x7f09440c8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.600+0000 7f0948c7f700 1 -- 172.21.15.146:0/2211398749 >> v1:172.21.15.151:6789/0 conn(0x7f09440afbd0 legacy=0x7f0944159480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:54.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.600+0000 7f0948c7f700 1 -- 172.21.15.146:0/2211398749 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09440ad280 con 0x7f0944155720 2023-10-06T11:05:54.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.600+0000 7f0948c7f700 1 --2- 172.21.15.146:0/2211398749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0944155720 0x7f0944155af0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0938009320 tx=0x7f0938009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4006b71871a37d35 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:54.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.601+0000 7f09437fe700 1 -- 172.21.15.146:0/2211398749 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093800c970 con 0x7f0944155720 2023-10-06T11:05:54.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.601+0000 7f09437fe700 1 -- 172.21.15.146:0/2211398749 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f093800cad0 con 0x7f0944155720 2023-10-06T11:05:54.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.601+0000 7f09437fe700 1 -- 172.21.15.146:0/2211398749 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093800ce50 con 0x7f0944155720 2023-10-06T11:05:54.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.602+0000 7f094aee3700 1 -- 172.21.15.146:0/2211398749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0944155720 msgr2=0x7f0944155af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.602+0000 7f094aee3700 1 --2- 172.21.15.146:0/2211398749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0944155720 0x7f0944155af0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0938009320 tx=0x7f0938009ae0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.602+0000 7f094aee3700 1 -- 172.21.15.146:0/2211398749 shutdown_connections 2023-10-06T11:05:54.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.602+0000 7f094aee3700 1 --2- 172.21.15.146:0/2211398749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0944155720 0x7f0944155af0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.602+0000 7f094aee3700 1 --2- 172.21.15.146:0/2211398749 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09440ac500 0x7f09440c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.602+0000 7f094aee3700 1 -- 172.21.15.146:0/2211398749 >> 172.21.15.146:0/2211398749 conn(0x7f0944067f40 msgr2=0x7f09440cc1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:54.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.602+0000 7f094aee3700 1 -- 172.21.15.146:0/2211398749 shutdown_connections 2023-10-06T11:05:54.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.602+0000 7f094aee3700 1 -- 172.21.15.146:0/2211398749 wait complete. 2023-10-06T11:05:54.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.604+0000 7f094aee3700 1 Processor -- start 2023-10-06T11:05:54.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.604+0000 7f094aee3700 1 -- start start 2023-10-06T11:05:54.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.605+0000 7f094aee3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09440ac500 0x7f09440aaac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.605+0000 7f094aee3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09440afbd0 0x7f09440a5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.605+0000 7f094aee3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0944155720 0x7f09440cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.605+0000 7f094aee3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09440cadb0 con 0x7f09440ac500 2023-10-06T11:05:54.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.605+0000 7f094aee3700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09440cb090 con 0x7f0944155720 2023-10-06T11:05:54.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.605+0000 7f094aee3700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09440cb370 con 0x7f09440afbd0 2023-10-06T11:05:54.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.606+0000 7f0948c7f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09440ac500 0x7f09440aaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.606+0000 7f0948c7f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09440ac500 0x7f09440aaac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39842/0 (socket says 172.21.15.146:39842) 2023-10-06T11:05:54.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.606+0000 7f0948c7f700 1 -- 172.21.15.146:0/2089549797 learned_addr learned my addr 172.21.15.146:0/2089549797 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:54.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.606+0000 7f0948c7f700 1 -- 172.21.15.146:0/2089549797 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09440afbd0 msgr2=0x7f09440a5860 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T11:05:54.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.606+0000 7f0948c7f700 1 --2- 172.21.15.146:0/2089549797 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09440afbd0 0x7f09440a5860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.606+0000 7f0948c7f700 1 -- 172.21.15.146:0/2089549797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0944155720 msgr2=0x7f09440cbe50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T11:05:54.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.606+0000 7f0948c7f700 1 --2- 172.21.15.146:0/2089549797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0944155720 0x7f09440cbe50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.606+0000 7f0948c7f700 1 -- 172.21.15.146:0/2089549797 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0938009d80 con 0x7f09440ac500 2023-10-06T11:05:54.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.606+0000 7f0948c7f700 1 --2- 172.21.15.146:0/2089549797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09440ac500 0x7f09440aaac0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0938009b20 tx=0x7f0938018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:54.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.610+0000 7f0940ff9700 1 -- 172.21.15.146:0/2089549797 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f093801c040 con 0x7f09440ac500 2023-10-06T11:05:54.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.610+0000 7f0940ff9700 1 -- 172.21.15.146:0/2089549797 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09380223f0 con 0x7f09440ac500 2023-10-06T11:05:54.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.610+0000 7f0940ff9700 1 -- 172.21.15.146:0/2089549797 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0938022770 con 0x7f09440ac500 2023-10-06T11:05:54.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.610+0000 7f094aee3700 1 -- 172.21.15.146:0/2089549797 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09440cb650 con 0x7f09440ac500 2023-10-06T11:05:54.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.610+0000 7f094aee3700 1 -- 172.21.15.146:0/2089549797 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09440ca9d0 con 0x7f09440ac500 2023-10-06T11:05:54.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.613+0000 7f0940ff9700 1 -- 172.21.15.146:0/2089549797 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f09380103f0 con 0x7f09440ac500 2023-10-06T11:05:54.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.613+0000 7f0940ff9700 1 --2- 172.21.15.146:0/2089549797 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f092c0671e0 0x7f092c069690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.614+0000 7f0940ff9700 1 -- 172.21.15.146:0/2089549797 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f09380861a0 con 0x7f09440ac500 2023-10-06T11:05:54.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.614+0000 7f094aee3700 1 --2- 172.21.15.146:0/2089549797 >> [v2:172.21.15.146:6816/90680,v1:172.21.15.146:6817/90680] conn(0x7f09240015f0 0x7f0924003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.614+0000 7f094aee3700 1 -- 172.21.15.146:0/2089549797 --> [v2:172.21.15.146:6816/90680,v1:172.21.15.146:6817/90680] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0924006b90 con 0x7f09240015f0 2023-10-06T11:05:54.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.614+0000 7f0949480700 1 --2- 172.21.15.146:0/2089549797 >> [v2:172.21.15.146:6816/90680,v1:172.21.15.146:6817/90680] conn(0x7f09240015f0 0x7f0924003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.615+0000 7f0949480700 1 --2- 172.21.15.146:0/2089549797 >> [v2:172.21.15.146:6816/90680,v1:172.21.15.146:6817/90680] conn(0x7f09240015f0 0x7f0924003aa0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:54.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.615+0000 7f0943fff700 1 --2- 172.21.15.146:0/2089549797 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f092c0671e0 0x7f092c069690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.616+0000 7f0943fff700 1 --2- 172.21.15.146:0/2089549797 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f092c0671e0 0x7f092c069690 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f094418b200 tx=0x7f093c007440 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:54.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.617+0000 7f03afabe700 1 Processor -- start 2023-10-06T11:05:54.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.617+0000 7f0940ff9700 1 -- 172.21.15.146:0/2089549797 <== osd.2 v2:172.21.15.146:6816/90680 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f0924006b90 con 0x7f09240015f0 2023-10-06T11:05:54.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.618+0000 7f03afabe700 1 -- start start 2023-10-06T11:05:54.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.619+0000 7f7008126700 1 Processor -- start 2023-10-06T11:05:54.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.619+0000 7f03afabe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03a8155690 0x7f03a80c8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.619+0000 7f03afabe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f03a80b02e0 0x7f03a8155a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.619+0000 7f03afabe700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03a80ac9e0 con 0x7f03a80ac500 2023-10-06T11:05:54.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.619+0000 7f03afabe700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03a80accc0 con 0x7f03a80b02e0 2023-10-06T11:05:54.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.619+0000 7f03afabe700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a80acfa0 con 0x7f03a8155690 2023-10-06T11:05:54.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.619+0000 7f03ae05b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f03a80b02e0 0x7f03a8155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.619+0000 7f03ae05b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f03a80b02e0 0x7f03a8155a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39846/0 (socket says 172.21.15.146:39846) 2023-10-06T11:05:54.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.619+0000 7f03ae05b700 1 -- 172.21.15.146:0/2306451859 learned_addr learned my addr 172.21.15.146:0/2306451859 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:54.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.620+0000 7f03ae05b700 1 -- 172.21.15.146:0/2306451859 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03a8155690 msgr2=0x7f03a80c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:54.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.620+0000 7f03ae05b700 1 --2- 172.21.15.146:0/2306451859 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03a8155690 0x7f03a80c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.620+0000 7f03ae05b700 1 -- 172.21.15.146:0/2306451859 >> v1:172.21.15.151:6789/0 conn(0x7f03a80ac500 legacy=0x7f03a80afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:54.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.620+0000 7f03ae05b700 1 -- 172.21.15.146:0/2306451859 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a80ad280 con 0x7f03a80b02e0 2023-10-06T11:05:54.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.620+0000 7f03ae05b700 1 --2- 172.21.15.146:0/2306451859 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03a80b02e0 0x7f03a8155a60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f03980099b0 tx=0x7f0398009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=984f7214ae59df4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:54.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.619+0000 7f7008126700 1 -- start start 2023-10-06T11:05:54.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.621+0000 7f27d5776700 1 Processor -- start 2023-10-06T11:05:54.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.621+0000 7f7008126700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7000068480 0x7f7000068900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.621+0000 7f7008126700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70000c8270 con 0x7f70000c70a0 2023-10-06T11:05:54.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.621+0000 7f7008126700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70000c7660 con 0x7f700015da60 2023-10-06T11:05:54.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.621+0000 7f7008126700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7000068e40 con 0x7f7000068480 2023-10-06T11:05:54.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.621+0000 7f03ac858700 1 -- 172.21.15.146:0/2306451859 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039800b8b0 con 0x7f03a80b02e0 2023-10-06T11:05:54.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.621+0000 7f03ac858700 1 -- 172.21.15.146:0/2306451859 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f039800ba10 con 0x7f03a80b02e0 2023-10-06T11:05:54.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.621+0000 7f03ac858700 1 -- 172.21.15.146:0/2306451859 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039800bd90 con 0x7f03a80b02e0 2023-10-06T11:05:54.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.621+0000 7f7005ec2700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f700015da60 0x7f700006ee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:38438/0 (socket says 172.21.15.146:38438) 2023-10-06T11:05:54.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.621+0000 7f7005ec2700 1 -- 172.21.15.146:0/4234829119 learned_addr learned my addr 172.21.15.146:0/4234829119 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:05:54.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.621+0000 7f70066c3700 1 --2- 172.21.15.146:0/4234829119 >> v2:172.21.15.146:3300/0 conn(0x7f7000068480 0x7f7000068900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.621+0000 7f70066c3700 1 -- 172.21.15.146:0/4234829119 >> v1:172.21.15.151:6789/0 conn(0x7f700015da60 legacy=0x7f700006ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.621+0000 7f70066c3700 1 -- 172.21.15.146:0/4234829119 >> v1:172.21.15.146:6789/0 conn(0x7f70000c70a0 legacy=0x7f70000c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.621+0000 7f70066c3700 1 -- 172.21.15.146:0/4234829119 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70000c7940 con 0x7f7000068480 2023-10-06T11:05:54.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.621+0000 7fd11ccae700 1 Processor -- start 2023-10-06T11:05:54.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.621+0000 7fd11ccae700 1 -- start start 2023-10-06T11:05:54.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.621+0000 7f27d5776700 1 -- start start 2023-10-06T11:05:54.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.622+0000 7f27d5776700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f27d0155720 0x7f27d0155af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.622+0000 7f27d5776700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f27d00b02e0 0x7f27d00c8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.622+0000 7f27d5776700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d00ac9e0 con 0x7f27d00ac500 2023-10-06T11:05:54.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.622+0000 7f27d5776700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d00accc0 con 0x7f27d00b02e0 2023-10-06T11:05:54.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.622+0000 7f27d5776700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d00acfa0 con 0x7f27d0155720 2023-10-06T11:05:54.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.622+0000 7f70066c3700 1 --2- 172.21.15.146:0/4234829119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7000068480 0x7f7000068900 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8009e60 tx=0x7f6ff8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=637c70e86fc1095a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:54.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.622+0000 7fd11ccae700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd11815ff60 0x7fd1181648c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.622+0000 7fd11ccae700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd118164e00 0x7fd1181671e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.622+0000 7fd11ccae700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1180a64c0 con 0x7fd11815db80 2023-10-06T11:05:54.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.622+0000 7fd11ccae700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd118160560 con 0x7fd118164e00 2023-10-06T11:05:54.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.622+0000 7fd11ccae700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd118160840 con 0x7fd11815ff60 2023-10-06T11:05:54.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.622+0000 7f27ceffd700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f27d0155720 0x7f27d0155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.622+0000 7f27ceffd700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f27d0155720 0x7f27d0155af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:45076/0 (socket says 172.21.15.146:45076) 2023-10-06T11:05:54.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.622+0000 7f27ceffd700 1 -- 172.21.15.146:0/1171068221 learned_addr learned my addr 172.21.15.146:0/1171068221 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:54.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.622+0000 7f27cf7fe700 1 --2- 172.21.15.146:0/1171068221 >> v2:172.21.15.146:3300/0 conn(0x7f27d00b02e0 0x7f27d00c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.623+0000 7fd116d9d700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd118164e00 0x7fd1181671e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.623+0000 7fd115d9b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd11815ff60 0x7fd1181648c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.623+0000 7fd116d9d700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd118164e00 0x7fd1181671e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:45086/0 (socket says 172.21.15.146:45086) 2023-10-06T11:05:54.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.623+0000 7fd116d9d700 1 -- 172.21.15.146:0/3486845141 learned_addr learned my addr 172.21.15.146:0/3486845141 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:54.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.623+0000 7f27cf7fe700 1 -- 172.21.15.146:0/1171068221 >> v2:172.21.15.151:3300/0 conn(0x7f27d0155720 msgr2=0x7f27d0155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:54.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.623+0000 7f27cf7fe700 1 --2- 172.21.15.146:0/1171068221 >> v2:172.21.15.151:3300/0 conn(0x7f27d0155720 0x7f27d0155af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.623+0000 7f27cf7fe700 1 -- 172.21.15.146:0/1171068221 >> v1:172.21.15.151:6789/0 conn(0x7f27d00ac500 legacy=0x7f27d00afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:54.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.623+0000 7f27cf7fe700 1 -- 172.21.15.146:0/1171068221 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d00ad280 con 0x7f27d00b02e0 2023-10-06T11:05:54.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.623+0000 7f27ceffd700 1 --2- 172.21.15.146:0/1171068221 >> v2:172.21.15.151:3300/0 conn(0x7f27d0155720 0x7f27d0155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:05:54.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.623+0000 7fd116d9d700 1 -- 172.21.15.146:0/3486845141 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd11815ff60 msgr2=0x7fd1181648c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:54.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.623+0000 7fd116d9d700 1 --2- 172.21.15.146:0/3486845141 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd11815ff60 0x7fd1181648c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.623+0000 7fd116d9d700 1 -- 172.21.15.146:0/3486845141 >> v1:172.21.15.146:6789/0 conn(0x7fd11815db80 legacy=0x7fd1180b1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:54.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.623+0000 7f7004ec0700 1 -- 172.21.15.146:0/4234829119 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff800e070 con 0x7f7000068480 2023-10-06T11:05:54.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.623+0000 7f7004ec0700 1 -- 172.21.15.146:0/4234829119 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff800bb30 con 0x7f7000068480 2023-10-06T11:05:54.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.623+0000 7f7004ec0700 1 -- 172.21.15.146:0/4234829119 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff800bed0 con 0x7f7000068480 2023-10-06T11:05:54.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.623+0000 7fd116d9d700 1 -- 172.21.15.146:0/3486845141 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd118160b20 con 0x7fd118164e00 2023-10-06T11:05:54.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.623+0000 7fd115d9b700 1 --2- 172.21.15.146:0/3486845141 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd11815ff60 0x7fd1181648c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:05:54.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.623+0000 7fd116d9d700 1 --2- 172.21.15.146:0/3486845141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd118164e00 0x7fd1181671e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd1080099b0 tx=0x7fd108009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d240424fa89d9e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:54.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.623+0000 7f27cf7fe700 1 --2- 172.21.15.146:0/1171068221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27d00b02e0 0x7f27d00c8200 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f27d0071790 tx=0x7f27c000d630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb85eafe1bf9ab25 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:54.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.623+0000 7fd11559a700 1 -- 172.21.15.146:0/3486845141 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd108009ea0 con 0x7fd118164e00 2023-10-06T11:05:54.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.623+0000 7fd11559a700 1 -- 172.21.15.146:0/3486845141 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd10800b8b0 con 0x7fd118164e00 2023-10-06T11:05:54.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.624+0000 7fd11559a700 1 -- 172.21.15.146:0/3486845141 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10800bc50 con 0x7fd118164e00 2023-10-06T11:05:54.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.624+0000 7f27cdffb700 1 -- 172.21.15.146:0/1171068221 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c0012070 con 0x7f27d00b02e0 2023-10-06T11:05:54.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.624+0000 7f27cdffb700 1 -- 172.21.15.146:0/1171068221 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c000d2e0 con 0x7f27d00b02e0 2023-10-06T11:05:54.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.624+0000 7f27cdffb700 1 -- 172.21.15.146:0/1171068221 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c000f970 con 0x7f27d00b02e0 2023-10-06T11:05:54.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.624+0000 7f7008126700 1 -- 172.21.15.146:0/4234829119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7000068480 msgr2=0x7f7000068900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.624+0000 7f7008126700 1 --2- 172.21.15.146:0/4234829119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7000068480 0x7f7000068900 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8009e60 tx=0x7f6ff8009780 comp rx=0 tx=0).stop 2023-10-06T11:05:54.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.623+0000 7f03afabe700 1 -- 172.21.15.146:0/2306451859 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03a80b02e0 msgr2=0x7f03a8155a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.623+0000 7f03afabe700 1 --2- 172.21.15.146:0/2306451859 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03a80b02e0 0x7f03a8155a60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f03980099b0 tx=0x7f0398009250 comp rx=0 tx=0).stop 2023-10-06T11:05:54.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.624+0000 7f7008126700 1 -- 172.21.15.146:0/4234829119 shutdown_connections 2023-10-06T11:05:54.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.624+0000 7f7008126700 1 --2- 172.21.15.146:0/4234829119 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7000068480 0x7f7000068900 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.624+0000 7f7008126700 1 -- 172.21.15.146:0/4234829119 >> 172.21.15.146:0/4234829119 conn(0x7f70000c9fa0 msgr2=0x7f700006de70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:54.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.624+0000 7f03afabe700 1 -- 172.21.15.146:0/2306451859 shutdown_connections 2023-10-06T11:05:54.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.624+0000 7f03afabe700 1 --2- 172.21.15.146:0/2306451859 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03a80b02e0 0x7f03a8155a60 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.624+0000 7f03afabe700 1 --2- 172.21.15.146:0/2306451859 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03a8155690 0x7f03a80c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.624+0000 7f03afabe700 1 -- 172.21.15.146:0/2306451859 >> 172.21.15.146:0/2306451859 conn(0x7f03a8067f40 msgr2=0x7f03a80cc1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:54.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.624+0000 7f7008126700 1 -- 172.21.15.146:0/4234829119 shutdown_connections 2023-10-06T11:05:54.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.625+0000 7f7008126700 1 -- 172.21.15.146:0/4234829119 wait complete. 2023-10-06T11:05:54.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.625+0000 7f03afabe700 1 -- 172.21.15.146:0/2306451859 shutdown_connections 2023-10-06T11:05:54.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.625+0000 7fd11ccae700 1 -- 172.21.15.146:0/3486845141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd118164e00 msgr2=0x7fd1181671e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.625+0000 7fd11ccae700 1 --2- 172.21.15.146:0/3486845141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd118164e00 0x7fd1181671e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd1080099b0 tx=0x7fd108009250 comp rx=0 tx=0).stop 2023-10-06T11:05:54.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.625+0000 7f27d5776700 1 -- 172.21.15.146:0/1171068221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27d00b02e0 msgr2=0x7f27d00c8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.625+0000 7f27d5776700 1 --2- 172.21.15.146:0/1171068221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27d00b02e0 0x7f27d00c8200 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f27d0071790 tx=0x7f27c000d630 comp rx=0 tx=0).stop 2023-10-06T11:05:54.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.625+0000 7fd11ccae700 1 -- 172.21.15.146:0/3486845141 shutdown_connections 2023-10-06T11:05:54.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.625+0000 7fd11ccae700 1 --2- 172.21.15.146:0/3486845141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd118164e00 0x7fd1181671e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.625+0000 7fd11ccae700 1 --2- 172.21.15.146:0/3486845141 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd11815ff60 0x7fd1181648c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.625+0000 7fd11ccae700 1 -- 172.21.15.146:0/3486845141 >> 172.21.15.146:0/3486845141 conn(0x7fd118067f40 msgr2=0x7fd1180cc1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:54.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.626+0000 7f7008126700 1 Processor -- start 2023-10-06T11:05:54.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.626+0000 7f7008126700 1 -- start start 2023-10-06T11:05:54.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.627+0000 7f7008126700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7000068480 0x7f70000ad0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.627+0000 7f7008126700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70000c70a0 0x7f70000af020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.627+0000 7f7008126700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f700015da60 0x7f700016e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.627+0000 7f7008126700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70000af560 con 0x7f70000c70a0 2023-10-06T11:05:54.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.627+0000 7f7008126700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7000153640 con 0x7f700015da60 2023-10-06T11:05:54.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.627+0000 7f7008126700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70000aeb90 con 0x7f7000068480 2023-10-06T11:05:54.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.625+0000 7f03afabe700 1 -- 172.21.15.146:0/2306451859 wait complete. 2023-10-06T11:05:54.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.626+0000 7f03afabe700 1 Processor -- start 2023-10-06T11:05:54.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.625+0000 7fd11ccae700 1 -- 172.21.15.146:0/3486845141 shutdown_connections 2023-10-06T11:05:54.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.625+0000 7fd11ccae700 1 -- 172.21.15.146:0/3486845141 wait complete. 2023-10-06T11:05:54.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.627+0000 7fd11ccae700 1 Processor -- start 2023-10-06T11:05:54.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.627+0000 7f7005ec2700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7000068480 0x7f70000ad0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.627+0000 7f70066c3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f700015da60 0x7f700016e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.627+0000 7f7005ec2700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7000068480 0x7f70000ad0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:40598/0 (socket says 172.21.15.146:40598) 2023-10-06T11:05:54.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.627+0000 7f70066c3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f700015da60 0x7f700016e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:45096/0 (socket says 172.21.15.146:45096) 2023-10-06T11:05:54.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.627+0000 7f7005ec2700 1 -- 172.21.15.146:0/1365988023 learned_addr learned my addr 172.21.15.146:0/1365988023 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:54.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.627+0000 7fd11ccae700 1 -- start start 2023-10-06T11:05:54.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.627+0000 7f7005ec2700 1 -- 172.21.15.146:0/1365988023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f700015da60 msgr2=0x7f700016e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.627+0000 7f7005ec2700 1 --2- 172.21.15.146:0/1365988023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f700015da60 0x7f700016e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.627+0000 7f7005ec2700 1 -- 172.21.15.146:0/1365988023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70000c70a0 msgr2=0x7f70000af020 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T11:05:54.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.627+0000 7f7005ec2700 1 --2- 172.21.15.146:0/1365988023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70000c70a0 0x7f70000af020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.627+0000 7f7005ec2700 1 -- 172.21.15.146:0/1365988023 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff8009a20 con 0x7f7000068480 2023-10-06T11:05:54.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.627+0000 7f7005ec2700 1 --2- 172.21.15.146:0/1365988023 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7000068480 0x7f70000ad0e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc00c7f0 tx=0x7f6ffc007f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:54.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.628+0000 7f6ff5ffb700 1 -- 172.21.15.146:0/1365988023 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc005b30 con 0x7f7000068480 2023-10-06T11:05:54.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.628+0000 7f6ff5ffb700 1 -- 172.21.15.146:0/1365988023 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ffc005cb0 con 0x7f7000068480 2023-10-06T11:05:54.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.628+0000 7f6ff5ffb700 1 -- 172.21.15.146:0/1365988023 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc004a80 con 0x7f7000068480 2023-10-06T11:05:54.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.628+0000 7f7008126700 1 -- 172.21.15.146:0/1365988023 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70000adf80 con 0x7f7000068480 2023-10-06T11:05:54.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.628+0000 7fd11ccae700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd11815db80 0x7fd1181762e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.628+0000 7fd11ccae700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd11815ff60 0x7fd118179f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.628+0000 7fd11ccae700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd118164e00 0x7fd11817a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.628+0000 7fd11ccae700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd118162280 con 0x7fd11815ff60 2023-10-06T11:05:54.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.628+0000 7fd11ccae700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd118176820 con 0x7fd11815db80 2023-10-06T11:05:54.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.628+0000 7fd11ccae700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd118154b20 con 0x7fd118164e00 2023-10-06T11:05:54.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.628+0000 7f7008126700 1 -- 172.21.15.146:0/1365988023 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70000ae540 con 0x7f7000068480 2023-10-06T11:05:54.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.626+0000 7f03afabe700 1 -- start start 2023-10-06T11:05:54.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.628+0000 7f03afabe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03a80ac500 0x7f03a80c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.628+0000 7f03afabe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03a80b02e0 0x7f03a8158840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.628+0000 7f03afabe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03a8155690 0x7f03a814ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.628+0000 7f03afabe700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a8176fd0 con 0x7f03a80b02e0 2023-10-06T11:05:54.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.628+0000 7f03afabe700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a80c9b10 con 0x7f03a8155690 2023-10-06T11:05:54.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.628+0000 7f03afabe700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a80c9270 con 0x7f03a80ac500 2023-10-06T11:05:54.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.628+0000 7f03ad059700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03a80b02e0 0x7f03a8158840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.628+0000 7f03ad059700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03a80b02e0 0x7f03a8158840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39876/0 (socket says 172.21.15.146:39876) 2023-10-06T11:05:54.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.628+0000 7f03ad059700 1 -- 172.21.15.146:0/3153695359 learned_addr learned my addr 172.21.15.146:0/3153695359 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:54.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.628+0000 7f03ad85a700 1 --2- 172.21.15.146:0/3153695359 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03a80ac500 0x7f03a80c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.628+0000 7fd116d9d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd118164e00 0x7fd11817a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.628+0000 7f03ae05b700 1 --2- 172.21.15.146:0/3153695359 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03a8155690 0x7f03a814ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.628+0000 7fd116d9d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd118164e00 0x7fd11817a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:40622/0 (socket says 172.21.15.146:40622) 2023-10-06T11:05:54.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.628+0000 7fd116d9d700 1 -- 172.21.15.146:0/4075564300 learned_addr learned my addr 172.21.15.146:0/4075564300 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:54.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.628+0000 7fd115d9b700 1 --2- 172.21.15.146:0/4075564300 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd11815ff60 0x7fd118179f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.628+0000 7fd11659c700 1 --2- 172.21.15.146:0/4075564300 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd11815db80 0x7fd1181762e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.625+0000 7fbb01a99700 1 Processor -- start 2023-10-06T11:05:54.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.625+0000 7fbb01a99700 1 -- start start 2023-10-06T11:05:54.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.629+0000 7f03ad85a700 1 -- 172.21.15.146:0/3153695359 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03a8155690 msgr2=0x7f03a814ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.629+0000 7f03ad85a700 1 --2- 172.21.15.146:0/3153695359 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03a8155690 0x7f03a814ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.629+0000 7f03ad85a700 1 -- 172.21.15.146:0/3153695359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03a80b02e0 msgr2=0x7f03a8158840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.629+0000 7f03ad85a700 1 --2- 172.21.15.146:0/3153695359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03a80b02e0 0x7f03a8158840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.629+0000 7f03ad85a700 1 -- 172.21.15.146:0/3153695359 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03980094f0 con 0x7f03a80ac500 2023-10-06T11:05:54.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.626+0000 7fbb01a99700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbafc16a5c0 0x7fbafc169a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.626+0000 7fbb01a99700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbafc0b1e70 0x7fbafc16ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.626+0000 7fbb01a99700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbafc1695d0 con 0x7fbafc16a990 2023-10-06T11:05:54.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.626+0000 7fbb01a99700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbafc168a00 con 0x7fbafc0b1e70 2023-10-06T11:05:54.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.626+0000 7fbb01a99700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbafc0aeb60 con 0x7fbafc16a5c0 2023-10-06T11:05:54.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.627+0000 7fbafb7fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbafc16a5c0 0x7fbafc169a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.627+0000 7fbafb7fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbafc16a5c0 0x7fbafc169a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:40582/0 (socket says 172.21.15.146:40582) 2023-10-06T11:05:54.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.627+0000 7fbafb7fe700 1 -- 172.21.15.146:0/491503926 learned_addr learned my addr 172.21.15.146:0/491503926 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:54.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.628+0000 7fbafa7fc700 1 -- 172.21.15.146:0/491503926 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1789515225 0 0) 0x7fbafc1695d0 con 0x7fbafc16a990 2023-10-06T11:05:54.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.629+0000 7fbafa7fc700 1 -- 172.21.15.146:0/491503926 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbae4003550 con 0x7fbafc16a990 2023-10-06T11:05:54.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.629+0000 7fd116d9d700 1 -- 172.21.15.146:0/4075564300 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd11815db80 msgr2=0x7fd1181762e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.629+0000 7fd116d9d700 1 --2- 172.21.15.146:0/4075564300 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd11815db80 0x7fd1181762e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.629+0000 7f03ad85a700 1 --2- 172.21.15.146:0/3153695359 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03a80ac500 0x7f03a80c8c90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f03a400b610 tx=0x7f03a40090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:54.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.629+0000 7fd116d9d700 1 -- 172.21.15.146:0/4075564300 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd11815ff60 msgr2=0x7fd118179f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.629+0000 7fd116d9d700 1 --2- 172.21.15.146:0/4075564300 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd11815ff60 0x7fd118179f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.629+0000 7fd116d9d700 1 -- 172.21.15.146:0/4075564300 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd10c009420 con 0x7fd118164e00 2023-10-06T11:05:54.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.627+0000 7fbafbfff700 1 --2- 172.21.15.146:0/491503926 >> v2:172.21.15.146:3300/0 conn(0x7fbafc0b1e70 0x7fbafc16ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.629+0000 7f27d5776700 1 -- 172.21.15.146:0/1171068221 shutdown_connections 2023-10-06T11:05:54.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.629+0000 7f27d5776700 1 --2- 172.21.15.146:0/1171068221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27d00b02e0 0x7f27d00c8200 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.629+0000 7f27d5776700 1 --2- 172.21.15.146:0/1171068221 >> v2:172.21.15.151:3300/0 conn(0x7f27d0155720 0x7f27d0155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.629+0000 7f27d5776700 1 -- 172.21.15.146:0/1171068221 >> 172.21.15.146:0/1171068221 conn(0x7f27d0067f40 msgr2=0x7f27d00cc1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:54.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.629+0000 7fbafb7fe700 1 -- 172.21.15.146:0/491503926 >> v2:172.21.15.146:3300/0 conn(0x7fbafc0b1e70 msgr2=0x7fbafc16ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:54.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.629+0000 7fbafb7fe700 1 --2- 172.21.15.146:0/491503926 >> v2:172.21.15.146:3300/0 conn(0x7fbafc0b1e70 0x7fbafc16ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.629+0000 7f039dffb700 1 -- 172.21.15.146:0/3153695359 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a400f510 con 0x7f03a80ac500 2023-10-06T11:05:54.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.629+0000 7f039dffb700 1 -- 172.21.15.146:0/3153695359 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a400f670 con 0x7f03a80ac500 2023-10-06T11:05:54.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.629+0000 7f039dffb700 1 -- 172.21.15.146:0/3153695359 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a400fa30 con 0x7f03a80ac500 2023-10-06T11:05:54.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.629+0000 7fd116d9d700 1 --2- 172.21.15.146:0/4075564300 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd118164e00 0x7fd11817a490 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd1080030c0 tx=0x7fd108016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:54.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.629+0000 7f03afabe700 1 -- 172.21.15.146:0/3153695359 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03a80c9550 con 0x7f03a80ac500 2023-10-06T11:05:54.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.629+0000 7f27d5776700 1 -- 172.21.15.146:0/1171068221 shutdown_connections 2023-10-06T11:05:54.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.629+0000 7fbafa7fc700 1 -- 172.21.15.146:0/491503926 <== mon.1 v1:172.21.15.151:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2939960586 0 0) 0x7fbae4003550 con 0x7fbafc16a990 2023-10-06T11:05:54.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.629+0000 7fbafb7fe700 1 -- 172.21.15.146:0/491503926 >> v1:172.21.15.151:6789/0 conn(0x7fbafc16a990 legacy=0x7fbafc0b1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.629+0000 7fbafb7fe700 1 -- 172.21.15.146:0/491503926 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbafc168ca0 con 0x7fbafc16a5c0 2023-10-06T11:05:54.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.629+0000 7fbafb7fe700 1 --2- 172.21.15.146:0/491503926 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbafc16a5c0 0x7fbafc169a60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4009f20 tx=0x7fbaf4009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=431cf0a33582438e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:54.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.630+0000 7f7008126700 1 -- 172.21.15.146:0/1365988023 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f700004c380 con 0x7f7000068480 2023-10-06T11:05:54.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.630+0000 7f03afabe700 1 -- 172.21.15.146:0/3153695359 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a8158d80 con 0x7f03a80ac500 2023-10-06T11:05:54.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.630+0000 7fbafa7fc700 1 -- 172.21.15.146:0/491503926 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaec001470 con 0x7fbafc16a5c0 2023-10-06T11:05:54.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.630+0000 7fbafa7fc700 1 -- 172.21.15.146:0/491503926 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf40090d0 con 0x7fbafc16a5c0 2023-10-06T11:05:54.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.630+0000 7fbafa7fc700 1 -- 172.21.15.146:0/491503926 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf400bae0 con 0x7fbafc16a5c0 2023-10-06T11:05:54.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.630+0000 7f03afabe700 1 -- 172.21.15.146:0/3153695359 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f03a8176d70 con 0x7f03a80ac500 2023-10-06T11:05:54.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.631+0000 7fd1067fc700 1 -- 172.21.15.146:0/4075564300 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd108011d20 con 0x7fd118164e00 2023-10-06T11:05:54.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.631+0000 7fd1067fc700 1 -- 172.21.15.146:0/4075564300 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd108020070 con 0x7fd118164e00 2023-10-06T11:05:54.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.631+0000 7fd1067fc700 1 -- 172.21.15.146:0/4075564300 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10801b6a0 con 0x7fd118164e00 2023-10-06T11:05:54.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.631+0000 7f6ff5ffb700 1 -- 172.21.15.146:0/1365988023 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6ffc0070d0 con 0x7f7000068480 2023-10-06T11:05:54.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.631+0000 7fbb01a99700 1 -- 172.21.15.146:0/491503926 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbafc16a5c0 msgr2=0x7fbafc169a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.631+0000 7fbb01a99700 1 --2- 172.21.15.146:0/491503926 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbafc16a5c0 0x7fbafc169a60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4009f20 tx=0x7fbaf4009840 comp rx=0 tx=0).stop 2023-10-06T11:05:54.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.631+0000 7fd11ccae700 1 -- 172.21.15.146:0/4075564300 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1080094f0 con 0x7fd118164e00 2023-10-06T11:05:54.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.631+0000 7fd11ccae700 1 -- 172.21.15.146:0/4075564300 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd118161ec0 con 0x7fd118164e00 2023-10-06T11:05:54.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.631+0000 7f6ff5ffb700 1 --2- 172.21.15.146:0/1365988023 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6fe4066f30 0x7f6fe40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.630+0000 7f27d5776700 1 -- 172.21.15.146:0/1171068221 wait complete. 2023-10-06T11:05:54.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.631+0000 7f6ff5ffb700 1 -- 172.21.15.146:0/1365988023 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6ffc0839e0 con 0x7f7000068480 2023-10-06T11:05:54.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.631+0000 7fbb01a99700 1 -- 172.21.15.146:0/491503926 shutdown_connections 2023-10-06T11:05:54.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.631+0000 7fbb01a99700 1 --2- 172.21.15.146:0/491503926 >> v2:172.21.15.146:3300/0 conn(0x7fbafc0b1e70 0x7fbafc16ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.631+0000 7fbb01a99700 1 --2- 172.21.15.146:0/491503926 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbafc16a5c0 0x7fbafc169a60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.631+0000 7fbb01a99700 1 -- 172.21.15.146:0/491503926 >> 172.21.15.146:0/491503926 conn(0x7fbafc067f40 msgr2=0x7fbafc0cc1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:54.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.631+0000 7f6ff5ffb700 1 --2- 172.21.15.146:0/1365988023 >> [v2:172.21.15.146:6800/90681,v1:172.21.15.146:6801/90681] conn(0x7f6fe406f7e0 0x7f6fe4071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.631+0000 7f6ff5ffb700 1 -- 172.21.15.146:0/1365988023 --> [v2:172.21.15.146:6800/90681,v1:172.21.15.146:6801/90681] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6fe40722a0 con 0x7f6fe406f7e0 2023-10-06T11:05:54.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.631+0000 7f6ff5ffb700 1 -- 172.21.15.146:0/1365988023 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ffc088240 con 0x7f7000068480 2023-10-06T11:05:54.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.632+0000 7f27d5776700 1 Processor -- start 2023-10-06T11:05:54.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.632+0000 7f70066c3700 1 --2- 172.21.15.146:0/1365988023 >> [v2:172.21.15.146:6800/90681,v1:172.21.15.146:6801/90681] conn(0x7f6fe406f7e0 0x7f6fe4071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.632+0000 7f70056c1700 1 --2- 172.21.15.146:0/1365988023 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6fe4066f30 0x7f6fe40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.633+0000 7f70066c3700 1 --2- 172.21.15.146:0/1365988023 >> [v2:172.21.15.146:6800/90681,v1:172.21.15.146:6801/90681] conn(0x7f6fe406f7e0 0x7f6fe4071bf0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:54.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.633+0000 7f70056c1700 1 --2- 172.21.15.146:0/1365988023 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6fe4066f30 0x7f6fe40693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0001670 tx=0x7f6ff0007a20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:54.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.632+0000 7fbb01a99700 1 -- 172.21.15.146:0/491503926 shutdown_connections 2023-10-06T11:05:54.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.632+0000 7f039dffb700 1 -- 172.21.15.146:0/3153695359 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f03a401a400 con 0x7f03a80ac500 2023-10-06T11:05:54.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.633+0000 7f039dffb700 1 --2- 172.21.15.146:0/3153695359 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f038c066fb0 0x7f038c069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.633+0000 7f039dffb700 1 -- 172.21.15.146:0/3153695359 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f03a4084060 con 0x7f03a80ac500 2023-10-06T11:05:54.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.633+0000 7f039dffb700 1 --2- 172.21.15.146:0/3153695359 >> [v2:172.21.15.151:6816/90899,v1:172.21.15.151:6817/90899] conn(0x7f038c06f7e0 0x7f038c071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.633+0000 7f039dffb700 1 -- 172.21.15.146:0/3153695359 --> [v2:172.21.15.151:6816/90899,v1:172.21.15.151:6817/90899] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f038c0722a0 con 0x7f038c06f7e0 2023-10-06T11:05:54.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.632+0000 7fd11ccae700 1 -- 172.21.15.146:0/4075564300 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd11804c380 con 0x7fd118164e00 2023-10-06T11:05:54.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.633+0000 7fd1067fc700 1 -- 172.21.15.146:0/4075564300 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd108022030 con 0x7fd118164e00 2023-10-06T11:05:54.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.632+0000 7fbb01a99700 1 -- 172.21.15.146:0/491503926 wait complete. 2023-10-06T11:05:54.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.633+0000 7f03ae05b700 1 --2- 172.21.15.146:0/3153695359 >> [v2:172.21.15.151:6816/90899,v1:172.21.15.151:6817/90899] conn(0x7f038c06f7e0 0x7f038c071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.632+0000 7f27d5776700 1 -- start start 2023-10-06T11:05:54.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.633+0000 7f27d5776700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27d00ac500 0x7f27d016dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.633+0000 7f27d5776700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27d00b02e0 0x7f27d014dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.633+0000 7f27d5776700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27d0155720 0x7f27d00ad980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.633+0000 7f27d5776700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d00ca4c0 con 0x7f27d0155720 2023-10-06T11:05:54.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.633+0000 7f27d5776700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d00c98b0 con 0x7f27d00b02e0 2023-10-06T11:05:54.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.633+0000 7f27d5776700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d00c9b90 con 0x7f27d00ac500 2023-10-06T11:05:54.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.634+0000 7f27ceffd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27d00ac500 0x7f27d016dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.634+0000 7f27ceffd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27d00ac500 0x7f27d016dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:40624/0 (socket says 172.21.15.146:40624) 2023-10-06T11:05:54.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.634+0000 7f27ceffd700 1 -- 172.21.15.146:0/3523207807 learned_addr learned my addr 172.21.15.146:0/3523207807 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:54.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.634+0000 7fbb01a99700 1 Processor -- start 2023-10-06T11:05:54.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.634+0000 7f03ad059700 1 --2- 172.21.15.146:0/3153695359 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f038c066fb0 0x7f038c069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.633+0000 7fd1067fc700 1 --2- 172.21.15.146:0/4075564300 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd0f8067000 0x7fd0f80694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.634+0000 7fd1067fc700 1 -- 172.21.15.146:0/4075564300 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd108086520 con 0x7fd118164e00 2023-10-06T11:05:54.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.634+0000 7fd1067fc700 1 --2- 172.21.15.146:0/4075564300 >> [v2:172.21.15.151:6808/90890,v1:172.21.15.151:6809/90890] conn(0x7fd0f806f8b0 0x7fd0f8071cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.634+0000 7fd1067fc700 1 -- 172.21.15.146:0/4075564300 --> [v2:172.21.15.151:6808/90890,v1:172.21.15.151:6809/90890] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd0f8072370 con 0x7fd0f806f8b0 2023-10-06T11:05:54.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.634+0000 7fd1067fc700 1 -- 172.21.15.146:0/4075564300 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd108088a80 con 0x7fd118164e00 2023-10-06T11:05:54.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.634+0000 7fd11659c700 1 --2- 172.21.15.146:0/4075564300 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd0f8067000 0x7fd0f80694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.634+0000 7fbb01a99700 1 -- start start 2023-10-06T11:05:54.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.634+0000 7f03ae05b700 1 --2- 172.21.15.146:0/3153695359 >> [v2:172.21.15.151:6816/90899,v1:172.21.15.151:6817/90899] conn(0x7f038c06f7e0 0x7f038c071bf0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:54.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.634+0000 7f039dffb700 1 -- 172.21.15.146:0/3153695359 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f03a4009210 con 0x7f03a80ac500 2023-10-06T11:05:54.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.634+0000 7f27ce7fc700 1 --2- 172.21.15.146:0/3523207807 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27d00b02e0 0x7f27d014dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.634+0000 7f27cf7fe700 1 --2- 172.21.15.146:0/3523207807 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27d0155720 0x7f27d00ad980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.634+0000 7f27ceffd700 1 -- 172.21.15.146:0/3523207807 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27d00b02e0 msgr2=0x7f27d014dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.634+0000 7f27ceffd700 1 --2- 172.21.15.146:0/3523207807 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27d00b02e0 0x7f27d014dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.634+0000 7f27ceffd700 1 -- 172.21.15.146:0/3523207807 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27d0155720 msgr2=0x7f27d00ad980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.634+0000 7f27ceffd700 1 --2- 172.21.15.146:0/3523207807 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27d0155720 0x7f27d00ad980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.634+0000 7f27ceffd700 1 -- 172.21.15.146:0/3523207807 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c400a590 con 0x7f27d00ac500 2023-10-06T11:05:54.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.634+0000 7f0ff6b31700 1 Processor -- start 2023-10-06T11:05:54.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.634+0000 7f6ff5ffb700 1 -- 172.21.15.146:0/1365988023 <== osd.1 v2:172.21.15.146:6800/90681 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f6fe40722a0 con 0x7f6fe406f7e0 2023-10-06T11:05:54.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.634+0000 7fd115d9b700 1 --2- 172.21.15.146:0/4075564300 >> [v2:172.21.15.151:6808/90890,v1:172.21.15.151:6809/90890] conn(0x7fd0f806f8b0 0x7fd0f8071cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.634+0000 7f27ceffd700 1 --2- 172.21.15.146:0/3523207807 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27d00ac500 0x7f27d016dca0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f27c400baf0 tx=0x7f27c400d040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:54.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.635+0000 7f27beffd700 1 -- 172.21.15.146:0/3523207807 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c400ebb0 con 0x7f27d00ac500 2023-10-06T11:05:54.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.635+0000 7fd115d9b700 1 --2- 172.21.15.146:0/4075564300 >> [v2:172.21.15.151:6808/90890,v1:172.21.15.151:6809/90890] conn(0x7fd0f806f8b0 0x7fd0f8071cc0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:54.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.635+0000 7f27beffd700 1 -- 172.21.15.146:0/3523207807 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c400ed10 con 0x7f27d00ac500 2023-10-06T11:05:54.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.635+0000 7f27d5776700 1 -- 172.21.15.146:0/3523207807 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27c000d8d0 con 0x7f27d00ac500 2023-10-06T11:05:54.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.635+0000 7f27d5776700 1 -- 172.21.15.146:0/3523207807 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d00ca150 con 0x7f27d00ac500 2023-10-06T11:05:54.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.635+0000 7f27beffd700 1 -- 172.21.15.146:0/3523207807 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c4016680 con 0x7f27d00ac500 2023-10-06T11:05:54.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.635+0000 7fbb01a99700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbafc0b1e70 0x7fbafc0cc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.635+0000 7fbb01a99700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbafc16a5c0 0x7fbafc166410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.635+0000 7fbb01a99700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbafc16a990 0x7fbafc166950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.635+0000 7fbb01a99700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbafc15cec0 con 0x7fbafc16a990 2023-10-06T11:05:54.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.635+0000 7fbb01a99700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbafc167c30 con 0x7fbafc16a5c0 2023-10-06T11:05:54.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.635+0000 7fbb01a99700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbafc167020 con 0x7fbafc0b1e70 2023-10-06T11:05:54.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.635+0000 7fbafb7fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbafc0b1e70 0x7fbafc0cc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.635+0000 7fbafb7fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbafc0b1e70 0x7fbafc0cc3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:40638/0 (socket says 172.21.15.146:40638) 2023-10-06T11:05:54.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.635+0000 7fbafb7fe700 1 -- 172.21.15.146:0/1834258406 learned_addr learned my addr 172.21.15.146:0/1834258406 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:54.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.636+0000 7fbafaffd700 1 --2- 172.21.15.146:0/1834258406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbafc16a5c0 0x7fbafc166410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.634+0000 7f0ff6b31700 1 -- start start 2023-10-06T11:05:54.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.636+0000 7f0ff6b31700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0ff00b02e0 0x7f0ff0155af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.636+0000 7f0ff6b31700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0ff00ac500 0x7f0ff00c8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.636+0000 7f0ff6b31700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ff00ac9e0 con 0x7f0ff0155720 2023-10-06T11:05:54.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.636+0000 7f0ff6b31700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff00accc0 con 0x7f0ff00ac500 2023-10-06T11:05:54.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.636+0000 7f0ff6b31700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff00acfa0 con 0x7f0ff00b02e0 2023-10-06T11:05:54.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.636+0000 7f27d5776700 1 -- 172.21.15.146:0/3523207807 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f27ac000fd0 con 0x7f27d00ac500 2023-10-06T11:05:54.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.636+0000 7f0feffff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0ff00b02e0 0x7f0ff0155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.636+0000 7f0feffff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0ff00b02e0 0x7f0ff0155af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:45148/0 (socket says 172.21.15.146:45148) 2023-10-06T11:05:54.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.636+0000 7f0feffff700 1 -- 172.21.15.146:0/1663828863 learned_addr learned my addr 172.21.15.146:0/1663828863 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:54.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.636+0000 7f0ff50ce700 1 --2- 172.21.15.146:0/1663828863 >> v2:172.21.15.146:3300/0 conn(0x7f0ff00ac500 0x7f0ff00c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.637+0000 7f0feffff700 1 -- 172.21.15.146:0/1663828863 >> v2:172.21.15.146:3300/0 conn(0x7f0ff00ac500 msgr2=0x7f0ff00c8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:54.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.637+0000 7f0feffff700 1 --2- 172.21.15.146:0/1663828863 >> v2:172.21.15.146:3300/0 conn(0x7f0ff00ac500 0x7f0ff00c8200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.637+0000 7f0feffff700 1 -- 172.21.15.146:0/1663828863 >> v1:172.21.15.151:6789/0 conn(0x7f0ff0155720 legacy=0x7f0ff00afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.637+0000 7f0feffff700 1 -- 172.21.15.146:0/1663828863 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff00ad280 con 0x7f0ff00b02e0 2023-10-06T11:05:54.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.637+0000 7f27beffd700 1 -- 172.21.15.146:0/3523207807 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f27c4016a30 con 0x7f27d00ac500 2023-10-06T11:05:54.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.636+0000 7fbafbfff700 1 --2- 172.21.15.146:0/1834258406 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbafc16a990 0x7fbafc166950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.637+0000 7fbafb7fe700 1 -- 172.21.15.146:0/1834258406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbafc16a5c0 msgr2=0x7fbafc166410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.637+0000 7fbafb7fe700 1 --2- 172.21.15.146:0/1834258406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbafc16a5c0 0x7fbafc166410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.637+0000 7fbafb7fe700 1 -- 172.21.15.146:0/1834258406 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbafc16a990 msgr2=0x7fbafc166950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.637+0000 7fbafb7fe700 1 --2- 172.21.15.146:0/1834258406 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbafc16a990 0x7fbafc166950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.637+0000 7fbafb7fe700 1 -- 172.21.15.146:0/1834258406 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf4009ae0 con 0x7fbafc0b1e70 2023-10-06T11:05:54.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.637+0000 7fbafaffd700 1 --2- 172.21.15.146:0/1834258406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbafc16a5c0 0x7fbafc166410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:05:54.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.637+0000 7fbafbfff700 1 --2- 172.21.15.146:0/1834258406 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbafc16a990 0x7fbafc166950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:05:54.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.637+0000 7f0feffff700 1 --2- 172.21.15.146:0/1663828863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ff00b02e0 0x7f0ff0155af0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0ff006cc60 tx=0x7f0fe40082d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab1c04a04c79f2f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:54.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.637+0000 7fbafb7fe700 1 --2- 172.21.15.146:0/1834258406 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbafc0b1e70 0x7fbafc0cc3a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4003000 tx=0x7fbaf4019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:54.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.637+0000 7fbae37fe700 1 -- 172.21.15.146:0/1834258406 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf401e070 con 0x7fbafc0b1e70 2023-10-06T11:05:54.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.637+0000 7fbae37fe700 1 -- 172.21.15.146:0/1834258406 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf400b8d0 con 0x7fbafc0b1e70 2023-10-06T11:05:54.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.637+0000 7fbae37fe700 1 -- 172.21.15.146:0/1834258406 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf4022680 con 0x7fbafc0b1e70 2023-10-06T11:05:54.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.637+0000 7fbb01a99700 1 -- 172.21.15.146:0/1834258406 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbafc167300 con 0x7fbafc0b1e70 2023-10-06T11:05:54.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.637+0000 7fbb01a99700 1 -- 172.21.15.146:0/1834258406 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbafc1678c0 con 0x7fbafc0b1e70 2023-10-06T11:05:54.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.637+0000 7f27beffd700 1 --2- 172.21.15.146:0/3523207807 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f27b4066f00 0x7f27b40693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.637+0000 7f27beffd700 1 -- 172.21.15.146:0/3523207807 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f27c4010040 con 0x7f27d00ac500 2023-10-06T11:05:54.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.638+0000 7f27beffd700 1 --2- 172.21.15.146:0/3523207807 >> [v2:172.21.15.146:6808/90665,v1:172.21.15.146:6809/90665] conn(0x7f27b406f730 0x7f27b4071b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.638+0000 7f27beffd700 1 -- 172.21.15.146:0/3523207807 --> [v2:172.21.15.146:6808/90665,v1:172.21.15.146:6809/90665] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f27b40721f0 con 0x7f27b406f730 2023-10-06T11:05:54.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.638+0000 7f27beffd700 1 -- 172.21.15.146:0/3523207807 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27c4087610 con 0x7f27d00ac500 2023-10-06T11:05:54.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.638+0000 7f27cf7fe700 1 --2- 172.21.15.146:0/3523207807 >> [v2:172.21.15.146:6808/90665,v1:172.21.15.146:6809/90665] conn(0x7f27b406f730 0x7f27b4071b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.638+0000 7fbae17fa700 1 -- 172.21.15.146:0/1834258406 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbad4000fd0 con 0x7fbafc0b1e70 2023-10-06T11:05:54.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.638+0000 7f27cf7fe700 1 --2- 172.21.15.146:0/3523207807 >> [v2:172.21.15.146:6808/90665,v1:172.21.15.146:6809/90665] conn(0x7f27b406f730 0x7f27b4071b40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:54.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.639+0000 7f27beffd700 1 -- 172.21.15.146:0/3523207807 <== osd.0 v2:172.21.15.146:6808/90665 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f27b40721f0 con 0x7f27b406f730 2023-10-06T11:05:54.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.640+0000 7f27ce7fc700 1 --2- 172.21.15.146:0/3523207807 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f27b4066f00 0x7f27b40693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.640+0000 7f27ce7fc700 1 --2- 172.21.15.146:0/3523207807 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f27b4066f00 0x7f27b40693b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f27d006f9e0 tx=0x7f27c8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:54.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.640+0000 7fbae37fe700 1 -- 172.21.15.146:0/1834258406 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbaf40193f0 con 0x7fbafc0b1e70 2023-10-06T11:05:54.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.641+0000 7fbae37fe700 1 --2- 172.21.15.146:0/1834258406 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbae8066f30 0x7fbae80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.641+0000 7fbae37fe700 1 -- 172.21.15.146:0/1834258406 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbaf40867b0 con 0x7fbafc0b1e70 2023-10-06T11:05:54.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.641+0000 7fbae37fe700 1 --2- 172.21.15.146:0/1834258406 >> [v2:172.21.15.146:6824/90682,v1:172.21.15.146:6825/90682] conn(0x7fbae806f7e0 0x7fbae8071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.641+0000 7fbae37fe700 1 -- 172.21.15.146:0/1834258406 --> [v2:172.21.15.146:6824/90682,v1:172.21.15.146:6825/90682] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbae80722a0 con 0x7fbae806f7e0 2023-10-06T11:05:54.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.641+0000 7fbae37fe700 1 -- 172.21.15.146:0/1834258406 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbaf4086aa0 con 0x7fbafc0b1e70 2023-10-06T11:05:54.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.641+0000 7fbafbfff700 1 --2- 172.21.15.146:0/1834258406 >> [v2:172.21.15.146:6824/90682,v1:172.21.15.146:6825/90682] conn(0x7fbae806f7e0 0x7fbae8071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.641+0000 7fbafbfff700 1 --2- 172.21.15.146:0/1834258406 >> [v2:172.21.15.146:6824/90682,v1:172.21.15.146:6825/90682] conn(0x7fbae806f7e0 0x7fbae8071bf0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:54.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.643+0000 7fbae37fe700 1 -- 172.21.15.146:0/1834258406 <== osd.3 v2:172.21.15.146:6824/90682 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fbae80722a0 con 0x7fbae806f7e0 2023-10-06T11:05:54.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.645+0000 7fd11659c700 1 --2- 172.21.15.146:0/4075564300 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd0f8067000 0x7fd0f80694b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd110007560 tx=0x7fd110009760 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:54.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.635+0000 7f039dffb700 1 -- 172.21.15.146:0/3153695359 <== osd.4 v2:172.21.15.151:6816/90899 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f038c0722a0 con 0x7f038c06f7e0 2023-10-06T11:05:54.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.645+0000 7f03ad059700 1 --2- 172.21.15.146:0/3153695359 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f038c066fb0 0x7f038c069460 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f03a80c8710 tx=0x7f03a0009810 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:54.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.645+0000 7fbafaffd700 1 --2- 172.21.15.146:0/1834258406 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbae8066f30 0x7fbae80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.645+0000 7fbafaffd700 1 --2- 172.21.15.146:0/1834258406 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbae8066f30 0x7fbae80693e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbafc163bb0 tx=0x7fbaec001500 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:54.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.648+0000 7f094aee3700 1 -- 172.21.15.146:0/2089549797 --> [v2:172.21.15.146:6816/90680,v1:172.21.15.146:6817/90680] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0924005c80 con 0x7f09240015f0 2023-10-06T11:05:54.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.649+0000 7f0940ff9700 1 -- 172.21.15.146:0/2089549797 <== osd.2 v2:172.21.15.146:6816/90680 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0924005c80 con 0x7f09240015f0 2023-10-06T11:05:54.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.649+0000 7f094aee3700 1 -- 172.21.15.146:0/2089549797 >> [v2:172.21.15.146:6816/90680,v1:172.21.15.146:6817/90680] conn(0x7f09240015f0 msgr2=0x7f0924003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.649+0000 7f094aee3700 1 --2- 172.21.15.146:0/2089549797 >> [v2:172.21.15.146:6816/90680,v1:172.21.15.146:6817/90680] conn(0x7f09240015f0 0x7f0924003aa0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.649+0000 7f094aee3700 1 -- 172.21.15.146:0/2089549797 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f092c0671e0 msgr2=0x7f092c069690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.649+0000 7f094aee3700 1 --2- 172.21.15.146:0/2089549797 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f092c0671e0 0x7f092c069690 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f094418b200 tx=0x7f093c007440 comp rx=0 tx=0).stop 2023-10-06T11:05:54.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.649+0000 7f094aee3700 1 -- 172.21.15.146:0/2089549797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09440ac500 msgr2=0x7f09440aaac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.649+0000 7f094aee3700 1 --2- 172.21.15.146:0/2089549797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09440ac500 0x7f09440aaac0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0938009b20 tx=0x7f0938018000 comp rx=0 tx=0).stop 2023-10-06T11:05:54.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.649+0000 7f0949480700 1 -- 172.21.15.146:0/2089549797 reap_dead start 2023-10-06T11:05:54.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.649+0000 7f094aee3700 1 -- 172.21.15.146:0/2089549797 shutdown_connections 2023-10-06T11:05:54.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.649+0000 7f094aee3700 1 -- 172.21.15.146:0/2089549797 >> 172.21.15.146:0/2089549797 conn(0x7f0944067f40 msgr2=0x7f0944157b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:54.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.650+0000 7fb8c9e26700 1 Processor -- start 2023-10-06T11:05:54.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.650+0000 7fb8c9e26700 1 -- start start 2023-10-06T11:05:54.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.651+0000 7fd1067fc700 1 -- 172.21.15.146:0/4075564300 <== osd.7 v2:172.21.15.151:6808/90890 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fd0f8072370 con 0x7fd0f806f8b0 2023-10-06T11:05:54.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.651+0000 7f0fef7fe700 1 -- 172.21.15.146:0/1663828863 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe4010070 con 0x7f0ff00b02e0 2023-10-06T11:05:54.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.651+0000 7fb8c9e26700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8c415cc20 0x7fb8c415d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.652+0000 7fb8c9e26700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8c40cf030 con 0x7fb8c40d0c50 2023-10-06T11:05:54.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.652+0000 7fb8c9e26700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8c40ced20 con 0x7fb8c415cff0 2023-10-06T11:05:54.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.652+0000 7fb8c9e26700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c415e390 con 0x7fb8c415cc20 2023-10-06T11:05:54.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.651+0000 7f0fef7fe700 1 -- 172.21.15.146:0/1663828863 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe400da00 con 0x7f0ff00b02e0 2023-10-06T11:05:54.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.651+0000 7f0fef7fe700 1 -- 172.21.15.146:0/1663828863 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe400dd80 con 0x7f0ff00b02e0 2023-10-06T11:05:54.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.652+0000 7f0ff6b31700 1 -- 172.21.15.146:0/1663828863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ff00b02e0 msgr2=0x7f0ff0155af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.652+0000 7f0ff6b31700 1 --2- 172.21.15.146:0/1663828863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ff00b02e0 0x7f0ff0155af0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0ff006cc60 tx=0x7f0fe40082d0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.652+0000 7f0ff6b31700 1 -- 172.21.15.146:0/1663828863 shutdown_connections 2023-10-06T11:05:54.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.652+0000 7f0ff6b31700 1 --2- 172.21.15.146:0/1663828863 >> v2:172.21.15.146:3300/0 conn(0x7f0ff00ac500 0x7f0ff00c8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.652+0000 7f0ff6b31700 1 --2- 172.21.15.146:0/1663828863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ff00b02e0 0x7f0ff0155af0 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0ff006cc60 tx=0x7f0fe40082d0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.652+0000 7f0ff6b31700 1 -- 172.21.15.146:0/1663828863 >> 172.21.15.146:0/1663828863 conn(0x7f0ff0067f40 msgr2=0x7f0ff00cc1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:54.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.652+0000 7fb8c2ffd700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fb8c415cff0 0x7fb8c40d0540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:38464/0 (socket says 172.21.15.146:38464) 2023-10-06T11:05:54.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.652+0000 7fb8c2ffd700 1 -- 172.21.15.146:0/1355201521 learned_addr learned my addr 172.21.15.146:0/1355201521 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:05:54.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.652+0000 7fb8c27fc700 1 -- 172.21.15.146:0/1355201521 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2594664634 0 0) 0x7fb8c40ced20 con 0x7fb8c415cff0 2023-10-06T11:05:54.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.652+0000 7fb8c27fc700 1 -- 172.21.15.146:0/1355201521 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8b0003570 con 0x7fb8c415cff0 2023-10-06T11:05:54.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.652+0000 7fb8c27fc700 1 -- 172.21.15.146:0/1355201521 <== mon.1 v1:172.21.15.151:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3146744444 0 0) 0x7fb8b0003570 con 0x7fb8c415cff0 2023-10-06T11:05:54.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.652+0000 7fb8c27fc700 1 -- 172.21.15.146:0/1355201521 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8c415cc20 msgr2=0x7fb8c415d460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T11:05:54.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.652+0000 7fb8c27fc700 1 --2- 172.21.15.146:0/1355201521 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8c415cc20 0x7fb8c415d460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.652+0000 7fb8c27fc700 1 -- 172.21.15.146:0/1355201521 >> v1:172.21.15.146:6789/0 conn(0x7fb8c40d0c50 legacy=0x7fb8c415a890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T11:05:54.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.652+0000 7fb8c27fc700 1 -- 172.21.15.146:0/1355201521 --> v1:172.21.15.151:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c415daf0 con 0x7fb8c415cff0 2023-10-06T11:05:54.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.653+0000 7fb8c27fc700 1 -- 172.21.15.146:0/1355201521 <== mon.1 v1:172.21.15.151:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fb8ac0014b0 con 0x7fb8c415cff0 2023-10-06T11:05:54.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.653+0000 7fb8c27fc700 1 -- 172.21.15.146:0/1355201521 >> v1:172.21.15.151:6789/0 conn(0x7fb8c415cff0 legacy=0x7fb8c40d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.653+0000 7fb8c27fc700 1 --2- 172.21.15.146:0/1355201521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8b0003a60 0x7fb8b0003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.653+0000 7fb8c27fc700 1 --2- 172.21.15.146:0/1355201521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb8b0004810 0x7fb8b0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.653+0000 7fb8c27fc700 1 --2- 172.21.15.146:0/1355201521 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8b00052e0 0x7fb8b000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.653+0000 7fb8c27fc700 1 -- 172.21.15.146:0/1355201521 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c415e390 con 0x7fb8b0003a60 2023-10-06T11:05:54.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.653+0000 7fb8c27fc700 1 -- 172.21.15.146:0/1355201521 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b000c130 con 0x7fb8b0004810 2023-10-06T11:05:54.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.653+0000 7fb8c27fc700 1 -- 172.21.15.146:0/1355201521 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b000c2f0 con 0x7fb8b00052e0 2023-10-06T11:05:54.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.653+0000 7fb8c2ffd700 1 --2- 172.21.15.146:0/1355201521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb8b0004810 0x7fb8b0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.653+0000 7fb8c2ffd700 1 -- 172.21.15.146:0/1355201521 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8b00052e0 msgr2=0x7fb8b000ba60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T11:05:54.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.653+0000 7fb8c2ffd700 1 --2- 172.21.15.146:0/1355201521 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8b00052e0 0x7fb8b000ba60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.653+0000 7fb8c2ffd700 1 -- 172.21.15.146:0/1355201521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8b0003a60 msgr2=0x7fb8b0003e50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T11:05:54.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.653+0000 7fb8c2ffd700 1 --2- 172.21.15.146:0/1355201521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8b0003a60 0x7fb8b0003e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.653+0000 7fb8c2ffd700 1 -- 172.21.15.146:0/1355201521 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c415daf0 con 0x7fb8b0004810 2023-10-06T11:05:54.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.653+0000 7fb8c2ffd700 1 --2- 172.21.15.146:0/1355201521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb8b0004810 0x7fb8b0004c80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb8c415d3c0 tx=0x7fb8ac0079d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7df02d244e88837a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:54.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.654+0000 7f094aee3700 1 -- 172.21.15.146:0/2089549797 shutdown_connections 2023-10-06T11:05:54.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.654+0000 7f094aee3700 1 -- 172.21.15.146:0/2089549797 wait complete. 2023-10-06T11:05:54.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.654+0000 7fb8c27fc700 1 -- 172.21.15.146:0/1355201521 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac00cd60 con 0x7fb8b0004810 2023-10-06T11:05:54.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.654+0000 7fb8c27fc700 1 -- 172.21.15.146:0/1355201521 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8ac005920 con 0x7fb8b0004810 2023-10-06T11:05:54.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.654+0000 7fb8c27fc700 1 -- 172.21.15.146:0/1355201521 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac005ca0 con 0x7fb8b0004810 2023-10-06T11:05:54.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.654+0000 7f0ff6b31700 1 -- 172.21.15.146:0/1663828863 shutdown_connections 2023-10-06T11:05:54.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.655+0000 7fb8c9e26700 1 -- 172.21.15.146:0/1355201521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb8b0004810 msgr2=0x7fb8b0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.655+0000 7fb8c9e26700 1 --2- 172.21.15.146:0/1355201521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb8b0004810 0x7fb8b0004c80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb8c415d3c0 tx=0x7fb8ac0079d0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.655+0000 7f0ff6b31700 1 -- 172.21.15.146:0/1663828863 wait complete. 2023-10-06T11:05:54.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.656+0000 7fb8c3fff700 1 -- 172.21.15.146:0/1355201521 reap_dead start 2023-10-06T11:05:54.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.656+0000 7f0ff6b31700 1 Processor -- start 2023-10-06T11:05:54.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.657+0000 7f0ff6b31700 1 -- start start 2023-10-06T11:05:54.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.658+0000 7f0ff6b31700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ff00ac500 0x7f0ff014e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.658+0000 7f0ff6b31700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ff0155720 0x7f0ff00c95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.658+0000 7f0ff6b31700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ff00c9af0 0x7f0ff0153640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.658+0000 7f0ff6b31700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff014e590 con 0x7f0ff00ac500 2023-10-06T11:05:54.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.658+0000 7f0ff6b31700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff0159140 con 0x7f0ff00c9af0 2023-10-06T11:05:54.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.658+0000 7f0ff6b31700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff0171960 con 0x7f0ff0155720 2023-10-06T11:05:54.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.658+0000 7f0feffff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ff0155720 0x7f0ff00c95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.658+0000 7f0feffff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ff0155720 0x7f0ff00c95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:40652/0 (socket says 172.21.15.146:40652) 2023-10-06T11:05:54.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.658+0000 7f0feffff700 1 -- 172.21.15.146:0/1129654329 learned_addr learned my addr 172.21.15.146:0/1129654329 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:54.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.658+0000 7f0ff48cd700 1 --2- 172.21.15.146:0/1129654329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ff00ac500 0x7f0ff014e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.658+0000 7f0ff50ce700 1 --2- 172.21.15.146:0/1129654329 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ff00c9af0 0x7f0ff0153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.659+0000 7f0feffff700 1 -- 172.21.15.146:0/1129654329 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ff00c9af0 msgr2=0x7f0ff0153640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.659+0000 7f0feffff700 1 --2- 172.21.15.146:0/1129654329 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ff00c9af0 0x7f0ff0153640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.659+0000 7f0feffff700 1 -- 172.21.15.146:0/1129654329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ff00ac500 msgr2=0x7f0ff014e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.659+0000 7f0feffff700 1 --2- 172.21.15.146:0/1129654329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ff00ac500 0x7f0ff014e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.659+0000 7f0feffff700 1 -- 172.21.15.146:0/1129654329 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe4008570 con 0x7f0ff0155720 2023-10-06T11:05:54.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.659+0000 7f7008126700 1 -- 172.21.15.146:0/1365988023 --> [v2:172.21.15.146:6800/90681,v1:172.21.15.146:6801/90681] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7000070c60 con 0x7f6fe406f7e0 2023-10-06T11:05:54.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.659+0000 7fb8c9e26700 1 -- 172.21.15.146:0/1355201521 shutdown_connections 2023-10-06T11:05:54.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.659+0000 7fb8c9e26700 1 -- 172.21.15.146:0/1355201521 >> 172.21.15.146:0/1355201521 conn(0x7fb8c406eba0 msgr2=0x7fb8c406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:54.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.659+0000 7fb8c9e26700 1 -- 172.21.15.146:0/1355201521 shutdown_connections 2023-10-06T11:05:54.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.659+0000 7f27d5776700 1 -- 172.21.15.146:0/3523207807 --> [v2:172.21.15.146:6808/90665,v1:172.21.15.146:6809/90665] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f27ac002d30 con 0x7f27b406f730 2023-10-06T11:05:54.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.660+0000 7fb8c9e26700 1 -- 172.21.15.146:0/1355201521 wait complete. 2023-10-06T11:05:54.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.660+0000 7f27beffd700 1 -- 172.21.15.146:0/3523207807 <== osd.0 v2:172.21.15.146:6808/90665 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f27ac002d30 con 0x7f27b406f730 2023-10-06T11:05:54.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.660+0000 7f6ff5ffb700 1 -- 172.21.15.146:0/1365988023 <== osd.1 v2:172.21.15.146:6800/90681 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7000070c60 con 0x7f6fe406f7e0 2023-10-06T11:05:54.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.660+0000 7f7008126700 1 -- 172.21.15.146:0/1365988023 >> [v2:172.21.15.146:6800/90681,v1:172.21.15.146:6801/90681] conn(0x7f6fe406f7e0 msgr2=0x7f6fe4071bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.660+0000 7f7008126700 1 --2- 172.21.15.146:0/1365988023 >> [v2:172.21.15.146:6800/90681,v1:172.21.15.146:6801/90681] conn(0x7f6fe406f7e0 0x7f6fe4071bf0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.661+0000 7f7008126700 1 -- 172.21.15.146:0/1365988023 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6fe4066f30 msgr2=0x7f6fe40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.661+0000 7f7008126700 1 --2- 172.21.15.146:0/1365988023 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6fe4066f30 0x7f6fe40693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6ff0001670 tx=0x7f6ff0007a20 comp rx=0 tx=0).stop 2023-10-06T11:05:54.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.661+0000 7f7008126700 1 -- 172.21.15.146:0/1365988023 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7000068480 msgr2=0x7f70000ad0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.661+0000 7f7008126700 1 --2- 172.21.15.146:0/1365988023 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7000068480 0x7f70000ad0e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc00c7f0 tx=0x7f6ffc007f70 comp rx=0 tx=0).stop 2023-10-06T11:05:54.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.661+0000 7f70066c3700 1 -- 172.21.15.146:0/1365988023 reap_dead start 2023-10-06T11:05:54.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.661+0000 7f7008126700 1 -- 172.21.15.146:0/1365988023 shutdown_connections 2023-10-06T11:05:54.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.661+0000 7f7008126700 1 -- 172.21.15.146:0/1365988023 >> 172.21.15.146:0/1365988023 conn(0x7f70000c9fa0 msgr2=0x7f70000c5b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:54.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.661+0000 7f7008126700 1 -- 172.21.15.146:0/1365988023 shutdown_connections 2023-10-06T11:05:54.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.661+0000 7f7008126700 1 -- 172.21.15.146:0/1365988023 wait complete. 2023-10-06T11:05:54.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.661+0000 7fb8c9e26700 1 Processor -- start 2023-10-06T11:05:54.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.661+0000 7fb8c9e26700 1 -- start start 2023-10-06T11:05:54.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.663+0000 7fb8c9e26700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8b0004810 0x7fb8c4148070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.663+0000 7fb8c9e26700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8c406efa0 0x7fb8c406f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.663+0000 7fb8c9e26700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb8c40cb240 0x7fb8c40cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.663+0000 7f27d5776700 1 -- 172.21.15.146:0/3523207807 >> [v2:172.21.15.146:6808/90665,v1:172.21.15.146:6809/90665] conn(0x7f27b406f730 msgr2=0x7f27b4071b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.663+0000 7f27d5776700 1 --2- 172.21.15.146:0/3523207807 >> [v2:172.21.15.146:6808/90665,v1:172.21.15.146:6809/90665] conn(0x7f27b406f730 0x7f27b4071b40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.663+0000 7f27d5776700 1 -- 172.21.15.146:0/3523207807 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f27b4066f00 msgr2=0x7f27b40693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.663+0000 7f27d5776700 1 --2- 172.21.15.146:0/3523207807 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f27b4066f00 0x7f27b40693b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f27d006f9e0 tx=0x7f27c8009040 comp rx=0 tx=0).stop 2023-10-06T11:05:54.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.663+0000 7f27d5776700 1 -- 172.21.15.146:0/3523207807 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27d00ac500 msgr2=0x7f27d016dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.663+0000 7f27d5776700 1 --2- 172.21.15.146:0/3523207807 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27d00ac500 0x7f27d016dca0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f27c400baf0 tx=0x7f27c400d040 comp rx=0 tx=0).stop 2023-10-06T11:05:54.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.663+0000 7fb8c9e26700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c406f950 con 0x7fb8c406efa0 2023-10-06T11:05:54.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.663+0000 7fb8c9e26700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c41485b0 con 0x7fb8c40cb240 2023-10-06T11:05:54.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.663+0000 7fb8c9e26700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c40cbfb0 con 0x7fb8b0004810 2023-10-06T11:05:54.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.663+0000 7fb8c2ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8c406efa0 0x7fb8c406f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.663+0000 7fb8c2ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8c406efa0 0x7fb8c406f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39916/0 (socket says 172.21.15.146:39916) 2023-10-06T11:05:54.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.663+0000 7fb8c2ffd700 1 -- 172.21.15.146:0/45523452 learned_addr learned my addr 172.21.15.146:0/45523452 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:54.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.663+0000 7fb8c3fff700 1 --2- 172.21.15.146:0/45523452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb8c40cb240 0x7fb8c40cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.663+0000 7fb8c37fe700 1 --2- 172.21.15.146:0/45523452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8b0004810 0x7fb8c4148070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.663+0000 7f27cf7fe700 1 -- 172.21.15.146:0/3523207807 reap_dead start 2023-10-06T11:05:54.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.663+0000 7f27d5776700 1 -- 172.21.15.146:0/3523207807 shutdown_connections 2023-10-06T11:05:54.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.663+0000 7f27d5776700 1 -- 172.21.15.146:0/3523207807 >> 172.21.15.146:0/3523207807 conn(0x7f27d0067f40 msgr2=0x7f27d014ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:54.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.663+0000 7fb8c2ffd700 1 -- 172.21.15.146:0/45523452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8b0004810 msgr2=0x7fb8c4148070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.663+0000 7fb8c2ffd700 1 --2- 172.21.15.146:0/45523452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8b0004810 0x7fb8c4148070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.663+0000 7fb8c2ffd700 1 -- 172.21.15.146:0/45523452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb8c40cb240 msgr2=0x7fb8c40cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.663+0000 7fb8c2ffd700 1 --2- 172.21.15.146:0/45523452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb8c40cb240 0x7fb8c40cb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.663+0000 7fb8c2ffd700 1 -- 172.21.15.146:0/45523452 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c40c6690 con 0x7fb8c406efa0 2023-10-06T11:05:54.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.663+0000 7fb8c3fff700 1 --2- 172.21.15.146:0/45523452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb8c40cb240 0x7fb8c40cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:05:54.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.663+0000 7fb8c37fe700 1 --2- 172.21.15.146:0/45523452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8b0004810 0x7fb8c4148070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:05:54.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.664+0000 7fb8c2ffd700 1 --2- 172.21.15.146:0/45523452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8c406efa0 0x7fb8c406f410 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac007a10 tx=0x7fb8ac015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:54.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.664+0000 7fb8bb7fe700 1 -- 172.21.15.146:0/45523452 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac0072e0 con 0x7fb8c406efa0 2023-10-06T11:05:54.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.664+0000 7fb8bb7fe700 1 -- 172.21.15.146:0/45523452 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8ac007460 con 0x7fb8c406efa0 2023-10-06T11:05:54.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.664+0000 7fb8bb7fe700 1 -- 172.21.15.146:0/45523452 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac012400 con 0x7fb8c406efa0 2023-10-06T11:05:54.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.665+0000 7fb8c9e26700 1 -- 172.21.15.146:0/45523452 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c40c6970 con 0x7fb8c406efa0 2023-10-06T11:05:54.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.665+0000 7fb8c9e26700 1 -- 172.21.15.146:0/45523452 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8c40cbc20 con 0x7fb8c406efa0 2023-10-06T11:05:54.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.667+0000 7f27d5776700 1 -- 172.21.15.146:0/3523207807 shutdown_connections 2023-10-06T11:05:54.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.667+0000 7fb8bb7fe700 1 -- 172.21.15.146:0/45523452 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb8ac019070 con 0x7fb8c406efa0 2023-10-06T11:05:54.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.667+0000 7fb8bb7fe700 1 --2- 172.21.15.146:0/45523452 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb8a4066f30 0x7fb8a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.668+0000 7fb8bb7fe700 1 -- 172.21.15.146:0/45523452 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb8ac007e40 con 0x7fb8c406efa0 2023-10-06T11:05:54.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.663+0000 7f0feffff700 1 --2- 172.21.15.146:0/1129654329 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ff0155720 0x7f0ff00c95b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0ff00ad0e0 tx=0x7f0fe401b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:54.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.663+0000 7f0fecff9700 1 -- 172.21.15.146:0/1129654329 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe4016860 con 0x7f0ff0155720 2023-10-06T11:05:54.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.663+0000 7f0fecff9700 1 -- 172.21.15.146:0/1129654329 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe40169e0 con 0x7f0ff0155720 2023-10-06T11:05:54.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.664+0000 7f0ff6b31700 1 -- 172.21.15.146:0/1129654329 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff0171c40 con 0x7f0ff0155720 2023-10-06T11:05:54.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.664+0000 7f0ff6b31700 1 -- 172.21.15.146:0/1129654329 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff0172200 con 0x7f0ff0155720 2023-10-06T11:05:54.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.664+0000 7f0fecff9700 1 -- 172.21.15.146:0/1129654329 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe4016de0 con 0x7f0ff0155720 2023-10-06T11:05:54.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.665+0000 7f0ff6b31700 1 -- 172.21.15.146:0/1129654329 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0fd0000fd0 con 0x7f0ff0155720 2023-10-06T11:05:54.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.665+0000 7f0fecff9700 1 -- 172.21.15.146:0/1129654329 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0fe401d040 con 0x7f0ff0155720 2023-10-06T11:05:54.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.666+0000 7f0fecff9700 1 --2- 172.21.15.146:0/1129654329 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0fdc067000 0x7f0fdc0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.666+0000 7f0fecff9700 1 -- 172.21.15.146:0/1129654329 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0fe4084e90 con 0x7f0ff0155720 2023-10-06T11:05:54.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.666+0000 7f0ff48cd700 1 --2- 172.21.15.146:0/1129654329 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0fdc067000 0x7f0fdc0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.666+0000 7f0fecff9700 1 --2- 172.21.15.146:0/1129654329 >> [v2:172.21.15.151:6800/90889,v1:172.21.15.151:6801/90889] conn(0x7f0fdc06f8b0 0x7f0fdc071cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.666+0000 7f0fecff9700 1 -- 172.21.15.146:0/1129654329 --> [v2:172.21.15.151:6800/90889,v1:172.21.15.151:6801/90889] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0fdc072370 con 0x7f0fdc06f8b0 2023-10-06T11:05:54.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.666+0000 7f0fecff9700 1 -- 172.21.15.146:0/1129654329 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0fe40874d0 con 0x7f0ff0155720 2023-10-06T11:05:54.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.667+0000 7f0ff48cd700 1 --2- 172.21.15.146:0/1129654329 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0fdc067000 0x7f0fdc0694b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0000f60 tx=0x7f0fe0007ea0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:54.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.667+0000 7f0ff50ce700 1 --2- 172.21.15.146:0/1129654329 >> [v2:172.21.15.151:6800/90889,v1:172.21.15.151:6801/90889] conn(0x7f0fdc06f8b0 0x7f0fdc071cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.667+0000 7f0ff50ce700 1 --2- 172.21.15.146:0/1129654329 >> [v2:172.21.15.151:6800/90889,v1:172.21.15.151:6801/90889] conn(0x7f0fdc06f8b0 0x7f0fdc071cc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:54.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.668+0000 7f03afabe700 1 -- 172.21.15.146:0/3153695359 --> [v2:172.21.15.151:6816/90899,v1:172.21.15.151:6817/90899] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f03a804c380 con 0x7f038c06f7e0 2023-10-06T11:05:54.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.668+0000 7fb8c37fe700 1 --2- 172.21.15.146:0/45523452 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb8a4066f30 0x7fb8a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.668+0000 7fb8c9e26700 1 --2- 172.21.15.146:0/45523452 >> [v2:172.21.15.151:6824/90920,v1:172.21.15.151:6825/90920] conn(0x7fb8a80015f0 0x7fb8a8003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:54.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.668+0000 7fb8c9e26700 1 -- 172.21.15.146:0/45523452 --> [v2:172.21.15.151:6824/90920,v1:172.21.15.151:6825/90920] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb8a8006b90 con 0x7fb8a80015f0 2023-10-06T11:05:54.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.668+0000 7fb8c3fff700 1 --2- 172.21.15.146:0/45523452 >> [v2:172.21.15.151:6824/90920,v1:172.21.15.151:6825/90920] conn(0x7fb8a80015f0 0x7fb8a8003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:54.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.668+0000 7f039dffb700 1 -- 172.21.15.146:0/3153695359 <== osd.4 v2:172.21.15.151:6816/90899 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f03a804c380 con 0x7f038c06f7e0 2023-10-06T11:05:54.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.668+0000 7fb8c37fe700 1 --2- 172.21.15.146:0/45523452 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb8a4066f30 0x7fb8a40693e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb8c40b4410 tx=0x7fb8b4000f90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:54.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.668+0000 7f0fecff9700 1 -- 172.21.15.146:0/1129654329 <== osd.5 v2:172.21.15.151:6800/90889 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f0fdc072370 con 0x7f0fdc06f8b0 2023-10-06T11:05:54.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.668+0000 7fb8c3fff700 1 --2- 172.21.15.146:0/45523452 >> [v2:172.21.15.151:6824/90920,v1:172.21.15.151:6825/90920] conn(0x7fb8a80015f0 0x7fb8a8003aa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:54.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.669+0000 7f03afabe700 1 -- 172.21.15.146:0/3153695359 >> [v2:172.21.15.151:6816/90899,v1:172.21.15.151:6817/90899] conn(0x7f038c06f7e0 msgr2=0x7f038c071bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.669+0000 7f03afabe700 1 --2- 172.21.15.146:0/3153695359 >> [v2:172.21.15.151:6816/90899,v1:172.21.15.151:6817/90899] conn(0x7f038c06f7e0 0x7f038c071bf0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.669+0000 7fb8bb7fe700 1 -- 172.21.15.146:0/45523452 <== osd.6 v2:172.21.15.151:6824/90920 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fb8a8006b90 con 0x7fb8a80015f0 2023-10-06T11:05:54.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.671+0000 7fbae17fa700 1 -- 172.21.15.146:0/1834258406 --> [v2:172.21.15.146:6824/90682,v1:172.21.15.146:6825/90682] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbad4002d30 con 0x7fbae806f7e0 2023-10-06T11:05:54.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.672+0000 7f27d5776700 1 -- 172.21.15.146:0/3523207807 wait complete. 2023-10-06T11:05:54.780 INFO:teuthology.orchestra.run.smithi146.stdout:55834574855 2023-10-06T11:05:54.780 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T11:05:54.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.675+0000 7f03afabe700 1 -- 172.21.15.146:0/3153695359 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f038c066fb0 msgr2=0x7f038c069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.675+0000 7f03afabe700 1 --2- 172.21.15.146:0/3153695359 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f038c066fb0 0x7f038c069460 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f03a80c8710 tx=0x7f03a0009810 comp rx=0 tx=0).stop 2023-10-06T11:05:54.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.675+0000 7f03afabe700 1 -- 172.21.15.146:0/3153695359 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03a80ac500 msgr2=0x7f03a80c8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.675+0000 7f03afabe700 1 --2- 172.21.15.146:0/3153695359 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03a80ac500 0x7f03a80c8c90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f03a400b610 tx=0x7f03a40090f0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.675+0000 7f03ae05b700 1 -- 172.21.15.146:0/3153695359 reap_dead start 2023-10-06T11:05:54.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.675+0000 7f03afabe700 1 -- 172.21.15.146:0/3153695359 shutdown_connections 2023-10-06T11:05:54.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.675+0000 7f03afabe700 1 -- 172.21.15.146:0/3153695359 >> 172.21.15.146:0/3153695359 conn(0x7f03a8067f40 msgr2=0x7f03a8151b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:54.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.675+0000 7f03afabe700 1 -- 172.21.15.146:0/3153695359 shutdown_connections 2023-10-06T11:05:54.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.675+0000 7f03afabe700 1 -- 172.21.15.146:0/3153695359 wait complete. 2023-10-06T11:05:54.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.677+0000 7fd11ccae700 1 -- 172.21.15.146:0/4075564300 --> [v2:172.21.15.151:6808/90890,v1:172.21.15.151:6809/90890] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd118160e00 con 0x7fd0f806f8b0 2023-10-06T11:05:54.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.677+0000 7fbae37fe700 1 -- 172.21.15.146:0/1834258406 <== osd.3 v2:172.21.15.146:6824/90682 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbad4002d30 con 0x7fbae806f7e0 2023-10-06T11:05:54.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.678+0000 7fd1067fc700 1 -- 172.21.15.146:0/4075564300 <== osd.7 v2:172.21.15.151:6808/90890 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd118160e00 con 0x7fd0f806f8b0 2023-10-06T11:05:54.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.678+0000 7fbae17fa700 1 -- 172.21.15.146:0/1834258406 >> [v2:172.21.15.146:6824/90682,v1:172.21.15.146:6825/90682] conn(0x7fbae806f7e0 msgr2=0x7fbae8071bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.678+0000 7fbae17fa700 1 --2- 172.21.15.146:0/1834258406 >> [v2:172.21.15.146:6824/90682,v1:172.21.15.146:6825/90682] conn(0x7fbae806f7e0 0x7fbae8071bf0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.678+0000 7fbae17fa700 1 -- 172.21.15.146:0/1834258406 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbae8066f30 msgr2=0x7fbae80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.678+0000 7fbae17fa700 1 --2- 172.21.15.146:0/1834258406 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbae8066f30 0x7fbae80693e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbafc163bb0 tx=0x7fbaec001500 comp rx=0 tx=0).stop 2023-10-06T11:05:54.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.678+0000 7fbae17fa700 1 -- 172.21.15.146:0/1834258406 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbafc0b1e70 msgr2=0x7fbafc0cc3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.678+0000 7fbae17fa700 1 --2- 172.21.15.146:0/1834258406 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbafc0b1e70 0x7fbafc0cc3a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4003000 tx=0x7fbaf4019000 comp rx=0 tx=0).stop 2023-10-06T11:05:54.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.678+0000 7fbafbfff700 1 -- 172.21.15.146:0/1834258406 reap_dead start 2023-10-06T11:05:54.786 INFO:teuthology.orchestra.run.smithi146.stdout:55834574855 2023-10-06T11:05:54.786 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T11:05:54.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.682+0000 7fbae17fa700 1 -- 172.21.15.146:0/1834258406 shutdown_connections 2023-10-06T11:05:54.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.682+0000 7fbae17fa700 1 -- 172.21.15.146:0/1834258406 >> 172.21.15.146:0/1834258406 conn(0x7fbafc067f40 msgr2=0x7fbafc160ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:54.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.685+0000 7fd11ccae700 1 -- 172.21.15.146:0/4075564300 >> [v2:172.21.15.151:6808/90890,v1:172.21.15.151:6809/90890] conn(0x7fd0f806f8b0 msgr2=0x7fd0f8071cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.685+0000 7fd11ccae700 1 --2- 172.21.15.146:0/4075564300 >> [v2:172.21.15.151:6808/90890,v1:172.21.15.151:6809/90890] conn(0x7fd0f806f8b0 0x7fd0f8071cc0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.685+0000 7fbae17fa700 1 -- 172.21.15.146:0/1834258406 shutdown_connections 2023-10-06T11:05:54.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.685+0000 7fbae17fa700 1 -- 172.21.15.146:0/1834258406 wait complete. 2023-10-06T11:05:54.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.685+0000 7fd11ccae700 1 -- 172.21.15.146:0/4075564300 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd0f8067000 msgr2=0x7fd0f80694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.685+0000 7fd11ccae700 1 --2- 172.21.15.146:0/4075564300 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd0f8067000 0x7fd0f80694b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd110007560 tx=0x7fd110009760 comp rx=0 tx=0).stop 2023-10-06T11:05:54.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.685+0000 7fd11ccae700 1 -- 172.21.15.146:0/4075564300 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd118164e00 msgr2=0x7fd11817a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.685+0000 7fd11ccae700 1 --2- 172.21.15.146:0/4075564300 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd118164e00 0x7fd11817a490 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd1080030c0 tx=0x7fd108016000 comp rx=0 tx=0).stop 2023-10-06T11:05:54.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.685+0000 7fd116d9d700 1 -- 172.21.15.146:0/4075564300 reap_dead start 2023-10-06T11:05:54.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.685+0000 7fd11ccae700 1 -- 172.21.15.146:0/4075564300 shutdown_connections 2023-10-06T11:05:54.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.685+0000 7fd11ccae700 1 -- 172.21.15.146:0/4075564300 >> 172.21.15.146:0/4075564300 conn(0x7fd118067f40 msgr2=0x7fd1181507b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:54.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.685+0000 7fd11ccae700 1 -- 172.21.15.146:0/4075564300 shutdown_connections 2023-10-06T11:05:54.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.685+0000 7fd11ccae700 1 -- 172.21.15.146:0/4075564300 wait complete. 2023-10-06T11:05:54.790 INFO:teuthology.orchestra.run.smithi146.stdout:55834574854 2023-10-06T11:05:54.790 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T11:05:54.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.693+0000 7fb8c9e26700 1 -- 172.21.15.146:0/45523452 --> [v2:172.21.15.151:6824/90920,v1:172.21.15.151:6825/90920] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb8a8005c20 con 0x7fb8a80015f0 2023-10-06T11:05:54.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.693+0000 7fb8bb7fe700 1 -- 172.21.15.146:0/45523452 <== osd.6 v2:172.21.15.151:6824/90920 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb8a8005c20 con 0x7fb8a80015f0 2023-10-06T11:05:54.791 INFO:teuthology.orchestra.run.smithi146.stdout:55834574854 2023-10-06T11:05:54.792 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T11:05:54.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.697+0000 7fb8c9e26700 1 -- 172.21.15.146:0/45523452 >> [v2:172.21.15.151:6824/90920,v1:172.21.15.151:6825/90920] conn(0x7fb8a80015f0 msgr2=0x7fb8a8003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.697+0000 7fb8c9e26700 1 --2- 172.21.15.146:0/45523452 >> [v2:172.21.15.151:6824/90920,v1:172.21.15.151:6825/90920] conn(0x7fb8a80015f0 0x7fb8a8003aa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.697+0000 7f0ff6b31700 1 -- 172.21.15.146:0/1129654329 --> [v2:172.21.15.151:6800/90889,v1:172.21.15.151:6801/90889] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0fd0002d30 con 0x7f0fdc06f8b0 2023-10-06T11:05:54.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.697+0000 7fb8c9e26700 1 -- 172.21.15.146:0/45523452 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb8a4066f30 msgr2=0x7fb8a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.697+0000 7fb8c9e26700 1 --2- 172.21.15.146:0/45523452 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb8a4066f30 0x7fb8a40693e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb8c40b4410 tx=0x7fb8b4000f90 comp rx=0 tx=0).stop 2023-10-06T11:05:54.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.697+0000 7fb8c9e26700 1 -- 172.21.15.146:0/45523452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8c406efa0 msgr2=0x7fb8c406f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.697+0000 7fb8c9e26700 1 --2- 172.21.15.146:0/45523452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8c406efa0 0x7fb8c406f410 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac007a10 tx=0x7fb8ac015000 comp rx=0 tx=0).stop 2023-10-06T11:05:54.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.697+0000 7fb8c3fff700 1 -- 172.21.15.146:0/45523452 reap_dead start 2023-10-06T11:05:54.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.698+0000 7fb8c9e26700 1 -- 172.21.15.146:0/45523452 shutdown_connections 2023-10-06T11:05:54.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.698+0000 7fb8c9e26700 1 -- 172.21.15.146:0/45523452 >> 172.21.15.146:0/45523452 conn(0x7fb8c406eba0 msgr2=0x7fb8c40b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:54.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.698+0000 7fb8c9e26700 1 -- 172.21.15.146:0/45523452 shutdown_connections 2023-10-06T11:05:54.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.698+0000 7fb8c9e26700 1 -- 172.21.15.146:0/45523452 wait complete. 2023-10-06T11:05:54.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.698+0000 7f0fecff9700 1 -- 172.21.15.146:0/1129654329 <== osd.5 v2:172.21.15.151:6800/90889 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0fd0002d30 con 0x7f0fdc06f8b0 2023-10-06T11:05:54.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.698+0000 7f0ff6b31700 1 -- 172.21.15.146:0/1129654329 >> [v2:172.21.15.151:6800/90889,v1:172.21.15.151:6801/90889] conn(0x7f0fdc06f8b0 msgr2=0x7f0fdc071cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.698+0000 7f0ff6b31700 1 --2- 172.21.15.146:0/1129654329 >> [v2:172.21.15.151:6800/90889,v1:172.21.15.151:6801/90889] conn(0x7f0fdc06f8b0 0x7f0fdc071cc0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.698+0000 7f0ff6b31700 1 -- 172.21.15.146:0/1129654329 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0fdc067000 msgr2=0x7f0fdc0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.698+0000 7f0ff6b31700 1 --2- 172.21.15.146:0/1129654329 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0fdc067000 0x7f0fdc0694b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0fe0000f60 tx=0x7f0fe0007ea0 comp rx=0 tx=0).stop 2023-10-06T11:05:54.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.698+0000 7f0ff6b31700 1 -- 172.21.15.146:0/1129654329 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ff0155720 msgr2=0x7f0ff00c95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:54.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.698+0000 7f0ff6b31700 1 --2- 172.21.15.146:0/1129654329 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ff0155720 0x7f0ff00c95b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0ff00ad0e0 tx=0x7f0fe401b000 comp rx=0 tx=0).stop 2023-10-06T11:05:54.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.698+0000 7f0ff50ce700 1 -- 172.21.15.146:0/1129654329 reap_dead start 2023-10-06T11:05:54.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.698+0000 7f0ff6b31700 1 -- 172.21.15.146:0/1129654329 shutdown_connections 2023-10-06T11:05:54.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.698+0000 7f0ff6b31700 1 -- 172.21.15.146:0/1129654329 >> 172.21.15.146:0/1129654329 conn(0x7f0ff0067f40 msgr2=0x7f0ff014fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:54.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.699+0000 7f0ff6b31700 1 -- 172.21.15.146:0/1129654329 shutdown_connections 2023-10-06T11:05:54.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:54.699+0000 7f0ff6b31700 1 -- 172.21.15.146:0/1129654329 wait complete. 2023-10-06T11:05:54.797 INFO:teuthology.orchestra.run.smithi146.stdout:55834574854 2023-10-06T11:05:54.798 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T11:05:54.799 INFO:teuthology.orchestra.run.smithi146.stdout:55834574855 2023-10-06T11:05:54.799 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T11:05:54.800 INFO:teuthology.orchestra.run.smithi146.stdout:55834574856 2023-10-06T11:05:54.800 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T11:05:54.801 INFO:teuthology.orchestra.run.smithi146.stdout:55834574856 2023-10-06T11:05:54.801 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T11:05:55.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.011+0000 7f140cc88700 1 Processor -- start 2023-10-06T11:05:55.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.011+0000 7f140cc88700 1 -- start start 2023-10-06T11:05:55.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.012+0000 7f140cc88700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1408159a90 0x7f14080ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.012+0000 7f140cc88700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14080aecd0 0x7f14080af150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.012+0000 7f140cc88700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14080cb870 con 0x7f14080cdde0 2023-10-06T11:05:55.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.012+0000 7f140cc88700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14080af690 con 0x7f1408159a90 2023-10-06T11:05:55.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.012+0000 7f140cc88700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14080b07d0 con 0x7f14080aecd0 2023-10-06T11:05:55.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.013+0000 7f13fdd9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f14080cdde0 0x7f14080b00c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38788/0 (socket says 172.21.15.146:38788) 2023-10-06T11:05:55.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.013+0000 7f13fdd9b700 1 -- 172.21.15.146:0/1689850107 learned_addr learned my addr 172.21.15.146:0/1689850107 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:05:55.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.013+0000 7f1406d9d700 1 --2- 172.21.15.146:0/1689850107 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14080aecd0 0x7f14080af150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:55.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.013+0000 7f140659c700 1 --2- 172.21.15.146:0/1689850107 >> v2:172.21.15.151:3300/0 conn(0x7f1408159a90 0x7f14080ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:55.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.013+0000 7f1405d9b700 1 -- 172.21.15.146:0/1689850107 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1003563618 0 0) 0x7f14080cb870 con 0x7f14080cdde0 2023-10-06T11:05:55.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.013+0000 7f1405d9b700 1 -- 172.21.15.146:0/1689850107 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13f4003570 con 0x7f14080cdde0 2023-10-06T11:05:55.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.013+0000 7f1406d9d700 1 -- 172.21.15.146:0/1689850107 >> v2:172.21.15.151:3300/0 conn(0x7f1408159a90 msgr2=0x7f14080ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:55.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.013+0000 7f1406d9d700 1 --2- 172.21.15.146:0/1689850107 >> v2:172.21.15.151:3300/0 conn(0x7f1408159a90 0x7f14080ca330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.013+0000 7f1406d9d700 1 -- 172.21.15.146:0/1689850107 >> v1:172.21.15.146:6789/0 conn(0x7f14080cdde0 legacy=0x7f14080b00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:55.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.013+0000 7f1406d9d700 1 -- 172.21.15.146:0/1689850107 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14080cac60 con 0x7f14080aecd0 2023-10-06T11:05:55.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.013+0000 7f140659c700 1 --2- 172.21.15.146:0/1689850107 >> v2:172.21.15.151:3300/0 conn(0x7f1408159a90 0x7f14080ca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:05:55.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.014+0000 7f1406d9d700 1 --2- 172.21.15.146:0/1689850107 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14080aecd0 0x7f14080af150 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1400009e60 tx=0x7f1400009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28b44718847ec3a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:55.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.014+0000 7f1405d9b700 1 -- 172.21.15.146:0/1689850107 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140000e070 con 0x7f14080aecd0 2023-10-06T11:05:55.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.014+0000 7f1405d9b700 1 -- 172.21.15.146:0/1689850107 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f140000bb60 con 0x7f14080aecd0 2023-10-06T11:05:55.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.014+0000 7f1405d9b700 1 -- 172.21.15.146:0/1689850107 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1400012430 con 0x7f14080aecd0 2023-10-06T11:05:55.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.015+0000 7f140cc88700 1 -- 172.21.15.146:0/1689850107 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14080aecd0 msgr2=0x7f14080af150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:55.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.015+0000 7f140cc88700 1 --2- 172.21.15.146:0/1689850107 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14080aecd0 0x7f14080af150 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1400009e60 tx=0x7f1400009780 comp rx=0 tx=0).stop 2023-10-06T11:05:55.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.018+0000 7f140cc88700 1 -- 172.21.15.146:0/1689850107 shutdown_connections 2023-10-06T11:05:55.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.018+0000 7f140cc88700 1 --2- 172.21.15.146:0/1689850107 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14080aecd0 0x7f14080af150 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.018+0000 7f140cc88700 1 --2- 172.21.15.146:0/1689850107 >> v2:172.21.15.151:3300/0 conn(0x7f1408159a90 0x7f14080ca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.018+0000 7f140cc88700 1 -- 172.21.15.146:0/1689850107 >> 172.21.15.146:0/1689850107 conn(0x7f1408068580 msgr2=0x7f1408068980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:55.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.021+0000 7fca83a7c700 1 Processor -- start 2023-10-06T11:05:55.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.021+0000 7fca83a7c700 1 -- start start 2023-10-06T11:05:55.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.022+0000 7fca83a7c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fca7c0686d0 0x7fca7c06ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.022+0000 7fca83a7c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca7c068aa0 0x7fca7c06a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.022+0000 7fca83a7c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca7c06f380 con 0x7fca7c0ca630 2023-10-06T11:05:55.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.022+0000 7fca83a7c700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca7c15b410 con 0x7fca7c0686d0 2023-10-06T11:05:55.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.022+0000 7fca83a7c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c15b6f0 con 0x7fca7c068aa0 2023-10-06T11:05:55.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.022+0000 7f140cc88700 1 -- 172.21.15.146:0/1689850107 shutdown_connections 2023-10-06T11:05:55.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.022+0000 7fca82019700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fca7c0ca630 0x7fca7c0caa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38790/0 (socket says 172.21.15.146:38790) 2023-10-06T11:05:55.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.022+0000 7fca82019700 1 -- 172.21.15.146:0/2257907467 learned_addr learned my addr 172.21.15.146:0/2257907467 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:05:55.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.022+0000 7fca81818700 1 --2- 172.21.15.146:0/2257907467 >> v2:172.21.15.151:3300/0 conn(0x7fca7c0686d0 0x7fca7c06ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:55.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.022+0000 7fca81017700 1 --2- 172.21.15.146:0/2257907467 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca7c068aa0 0x7fca7c06a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:55.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.023+0000 7fca81818700 1 -- 172.21.15.146:0/2257907467 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca7c068aa0 msgr2=0x7fca7c06a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:55.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.023+0000 7fca81818700 1 --2- 172.21.15.146:0/2257907467 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca7c068aa0 0x7fca7c06a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.023+0000 7fca81818700 1 -- 172.21.15.146:0/2257907467 >> v1:172.21.15.146:6789/0 conn(0x7fca7c0ca630 legacy=0x7fca7c0caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:55.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.023+0000 7fca81818700 1 -- 172.21.15.146:0/2257907467 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca7c15b9d0 con 0x7fca7c0686d0 2023-10-06T11:05:55.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.023+0000 7fca81818700 1 --2- 172.21.15.146:0/2257907467 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca7c0686d0 0x7fca7c06ec80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fca6c0098e0 tx=0x7fca6c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67e771f3f8387f5b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:55.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.023+0000 7fca80816700 1 -- 172.21.15.146:0/2257907467 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c009e80 con 0x7fca7c0686d0 2023-10-06T11:05:55.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.023+0000 7fca80816700 1 -- 172.21.15.146:0/2257907467 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6c00b860 con 0x7fca7c0686d0 2023-10-06T11:05:55.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.023+0000 7fca80816700 1 -- 172.21.15.146:0/2257907467 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c00bc20 con 0x7fca7c0686d0 2023-10-06T11:05:55.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.024+0000 7fa6a4302700 1 Processor -- start 2023-10-06T11:05:55.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.024+0000 7fa6a4302700 1 -- start start 2023-10-06T11:05:55.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.024+0000 7f140cc88700 1 -- 172.21.15.146:0/1689850107 wait complete. 2023-10-06T11:05:55.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.024+0000 7f323257b700 1 Processor -- start 2023-10-06T11:05:55.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.024+0000 7f323257b700 1 -- start start 2023-10-06T11:05:55.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.024+0000 7fadba979700 1 Processor -- start 2023-10-06T11:05:55.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.024+0000 7fadba979700 1 -- start start 2023-10-06T11:05:55.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.024+0000 7fbf2da8e700 1 Processor -- start 2023-10-06T11:05:55.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.024+0000 7fbf2da8e700 1 -- start start 2023-10-06T11:05:55.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.025+0000 7fa6a4302700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa69c15b680 0x7fa69c15ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.025+0000 7fa6a4302700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa69c161250 0x7fa69c0af850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.025+0000 7fa6a4302700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa69c0b20b0 con 0x7fa69c15ba50 2023-10-06T11:05:55.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.025+0000 7fa6a4302700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa69c15f240 con 0x7fa69c161250 2023-10-06T11:05:55.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.025+0000 7fa6a4302700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa69c15fdb0 con 0x7fa69c15b680 2023-10-06T11:05:55.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.026+0000 7f140cc88700 1 Processor -- start 2023-10-06T11:05:55.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.026+0000 7fbf2da8e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbf2815d9e0 0x7fbf28162010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.024+0000 7fca83a7c700 1 -- 172.21.15.146:0/2257907467 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca7c0686d0 msgr2=0x7fca7c06ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:55.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.024+0000 7fca83a7c700 1 --2- 172.21.15.146:0/2257907467 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca7c0686d0 0x7fca7c06ec80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fca6c0098e0 tx=0x7fca6c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.026+0000 7fbf2da8e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbf28162550 0x7fbf2806e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.026+0000 7fbf2da8e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf281618a0 con 0x7fbf280cda10 2023-10-06T11:05:55.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.026+0000 7fbf2da8e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf28161b80 con 0x7fbf2815d9e0 2023-10-06T11:05:55.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.026+0000 7fbf2da8e700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf2815eb10 con 0x7fbf28162550 2023-10-06T11:05:55.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.026+0000 7fa6a289f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa69c161250 0x7fa69c0af850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:55.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.026+0000 7f140cc88700 1 -- start start 2023-10-06T11:05:55.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.026+0000 7fbf277fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbf2815d9e0 0x7fbf28162010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:55.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.026+0000 7fbf277fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbf2815d9e0 0x7fbf28162010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39938/0 (socket says 172.21.15.146:39938) 2023-10-06T11:05:55.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.026+0000 7fbf277fe700 1 -- 172.21.15.146:0/590976887 learned_addr learned my addr 172.21.15.146:0/590976887 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:55.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.026+0000 7fbf1ffff700 1 --2- 172.21.15.146:0/590976887 >> v2:172.21.15.151:3300/0 conn(0x7fbf28162550 0x7fbf2806e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:55.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.025+0000 7f323257b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f322c15db80 0x7f322c15ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.025+0000 7f323257b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f322c0b1b00 0x7f322c0a54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.026+0000 7f323257b700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f322c0a6540 con 0x7f322c0a59f0 2023-10-06T11:05:55.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.026+0000 7f323257b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f322c160560 con 0x7f322c15db80 2023-10-06T11:05:55.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.026+0000 7f323257b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f322c160840 con 0x7f322c0b1b00 2023-10-06T11:05:55.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.026+0000 7f322bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f322c15db80 0x7f322c15ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:55.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.026+0000 7f3230b18700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f322c0a59f0 0x7f322c0a5e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:38478/0 (socket says 172.21.15.146:38478) 2023-10-06T11:05:55.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.026+0000 7f3230b18700 1 -- 172.21.15.146:0/4157439415 learned_addr learned my addr 172.21.15.146:0/4157439415 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:05:55.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.026+0000 7f322b7fe700 1 --2- 172.21.15.146:0/4157439415 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f322c0b1b00 0x7f322c0a54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:55.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.026+0000 7fa6a289f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa69c161250 0x7fa69c0af850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39918/0 (socket says 172.21.15.146:39918) 2023-10-06T11:05:55.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.026+0000 7fa6a289f700 1 -- 172.21.15.146:0/2475846419 learned_addr learned my addr 172.21.15.146:0/2475846419 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:55.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.026+0000 7fa6a209e700 1 --2- 172.21.15.146:0/2475846419 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa69c15b680 0x7fa69c15ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:55.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.026+0000 7fa6a209e700 1 -- 172.21.15.146:0/2475846419 >> v2:172.21.15.146:3300/0 conn(0x7fa69c161250 msgr2=0x7fa69c0af850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:55.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.026+0000 7fa6a209e700 1 --2- 172.21.15.146:0/2475846419 >> v2:172.21.15.146:3300/0 conn(0x7fa69c161250 0x7fa69c0af850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.026+0000 7fa6a209e700 1 -- 172.21.15.146:0/2475846419 >> v1:172.21.15.146:6789/0 conn(0x7fa69c15ba50 legacy=0x7fa69c0b18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:55.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.026+0000 7fadba979700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fadb40686d0 0x7fadb406ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.026+0000 7fadba979700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fadb4068aa0 0x7fadb406a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.026+0000 7fadba979700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadb406f380 con 0x7fadb40ca630 2023-10-06T11:05:55.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.026+0000 7fadba979700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadb415b410 con 0x7fadb4068aa0 2023-10-06T11:05:55.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.026+0000 7fadba979700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadb415b6f0 con 0x7fadb40686d0 2023-10-06T11:05:55.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.026+0000 7fadb3fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fadb40686d0 0x7fadb406ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:55.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.026+0000 7fadb3fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fadb40686d0 0x7fadb406ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:40694/0 (socket says 172.21.15.146:40694) 2023-10-06T11:05:55.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.026+0000 7fadb3fff700 1 -- 172.21.15.146:0/2956677639 learned_addr learned my addr 172.21.15.146:0/2956677639 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:55.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.026+0000 7fca83a7c700 1 -- 172.21.15.146:0/2257907467 shutdown_connections 2023-10-06T11:05:55.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.026+0000 7fca83a7c700 1 --2- 172.21.15.146:0/2257907467 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca7c0686d0 0x7fca7c06ec80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.026+0000 7fca83a7c700 1 --2- 172.21.15.146:0/2257907467 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca7c068aa0 0x7fca7c06a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.026+0000 7fca83a7c700 1 -- 172.21.15.146:0/2257907467 >> 172.21.15.146:0/2257907467 conn(0x7fca7c0c9fa0 msgr2=0x7fca7c06de70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:55.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.026+0000 7fa6a209e700 1 -- 172.21.15.146:0/2475846419 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa69c15f480 con 0x7fa69c15b680 2023-10-06T11:05:55.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.027+0000 7fadb3fff700 1 -- 172.21.15.146:0/2956677639 >> v2:172.21.15.151:3300/0 conn(0x7fadb4068aa0 msgr2=0x7fadb406a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:55.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.027+0000 7fadb3fff700 1 --2- 172.21.15.146:0/2956677639 >> v2:172.21.15.151:3300/0 conn(0x7fadb4068aa0 0x7fadb406a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.027+0000 7fadb3fff700 1 -- 172.21.15.146:0/2956677639 >> v1:172.21.15.146:6789/0 conn(0x7fadb40ca630 legacy=0x7fadb40caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:55.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.027+0000 7fadb3fff700 1 -- 172.21.15.146:0/2956677639 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb415b9d0 con 0x7fadb40686d0 2023-10-06T11:05:55.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.027+0000 7fbf1ffff700 1 -- 172.21.15.146:0/590976887 >> v2:172.21.15.146:3300/0 conn(0x7fbf2815d9e0 msgr2=0x7fbf28162010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:55.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.027+0000 7fbf1ffff700 1 --2- 172.21.15.146:0/590976887 >> v2:172.21.15.146:3300/0 conn(0x7fbf2815d9e0 0x7fbf28162010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.027+0000 7fbf1ffff700 1 -- 172.21.15.146:0/590976887 >> v1:172.21.15.151:6789/0 conn(0x7fbf280cda10 legacy=0x7fbf28067470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:55.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.027+0000 7fbf1ffff700 1 -- 172.21.15.146:0/590976887 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf2815edf0 con 0x7fbf28162550 2023-10-06T11:05:55.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.026+0000 7f322bfff700 1 -- 172.21.15.146:0/4157439415 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f322c0b1b00 msgr2=0x7f322c0a54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:55.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.026+0000 7f322bfff700 1 --2- 172.21.15.146:0/4157439415 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f322c0b1b00 0x7f322c0a54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.026+0000 7f322bfff700 1 -- 172.21.15.146:0/4157439415 >> v1:172.21.15.151:6789/0 conn(0x7f322c0a59f0 legacy=0x7f322c0a5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:55.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.026+0000 7f322bfff700 1 -- 172.21.15.146:0/4157439415 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f322c160b20 con 0x7f322c15db80 2023-10-06T11:05:55.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.027+0000 7f322bfff700 1 --2- 172.21.15.146:0/4157439415 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f322c15db80 0x7f322c15ff60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3224009e60 tx=0x7f3224009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2b7c25fb19a218 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:55.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.027+0000 7fa6a209e700 1 --2- 172.21.15.146:0/2475846419 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa69c15b680 0x7fa69c15ed00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa6980098e0 tx=0x7fa6980091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7d16e87ae1c02ff server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:55.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.027+0000 7fa6a109c700 1 -- 172.21.15.146:0/2475846419 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa698009e80 con 0x7fa69c15b680 2023-10-06T11:05:55.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.027+0000 7fa6a109c700 1 -- 172.21.15.146:0/2475846419 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa69800b820 con 0x7fa69c15b680 2023-10-06T11:05:55.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.027+0000 7fa6a109c700 1 -- 172.21.15.146:0/2475846419 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69800bba0 con 0x7fa69c15b680 2023-10-06T11:05:55.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.027+0000 7fbf1ffff700 1 --2- 172.21.15.146:0/590976887 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf28162550 0x7fbf2806e6b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbf180098e0 tx=0x7fbf180091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2352e509a12ab8c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:55.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.027+0000 7fadb3fff700 1 --2- 172.21.15.146:0/2956677639 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fadb40686d0 0x7fadb406ec80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fadac009f20 tx=0x7fadac009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b81b83ad4c58a2b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:55.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.027+0000 7fadb2ffd700 1 -- 172.21.15.146:0/2956677639 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadac00e070 con 0x7fadb40686d0 2023-10-06T11:05:55.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.027+0000 7fadb2ffd700 1 -- 172.21.15.146:0/2956677639 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadac00ba40 con 0x7fadb40686d0 2023-10-06T11:05:55.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.027+0000 7fadb2ffd700 1 -- 172.21.15.146:0/2956677639 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadac0092e0 con 0x7fadb40686d0 2023-10-06T11:05:55.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.027+0000 7f140cc88700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14080aecd0 0x7f1408150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.027+0000 7f140cc88700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14080cdde0 0x7f140816ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.027+0000 7f140cc88700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1408159a90 0x7f14080a54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.027+0000 7f140cc88700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1408152f00 con 0x7f14080aecd0 2023-10-06T11:05:55.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.027+0000 7f140cc88700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14080a6570 con 0x7f1408159a90 2023-10-06T11:05:55.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.027+0000 7f140cc88700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1408154b80 con 0x7f14080cdde0 2023-10-06T11:05:55.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.027+0000 7fbf26ffd700 1 -- 172.21.15.146:0/590976887 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf18011630 con 0x7fbf28162550 2023-10-06T11:05:55.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.027+0000 7fbf26ffd700 1 -- 172.21.15.146:0/590976887 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf18011790 con 0x7fbf28162550 2023-10-06T11:05:55.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.027+0000 7fbf26ffd700 1 -- 172.21.15.146:0/590976887 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf18011b30 con 0x7fbf28162550 2023-10-06T11:05:55.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.027+0000 7fca83a7c700 1 -- 172.21.15.146:0/2257907467 shutdown_connections 2023-10-06T11:05:55.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.027+0000 7fca83a7c700 1 -- 172.21.15.146:0/2257907467 wait complete. 2023-10-06T11:05:55.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.028+0000 7f140659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14080aecd0 0x7f1408150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:55.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.028+0000 7f140659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14080aecd0 0x7f1408150e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39946/0 (socket says 172.21.15.146:39946) 2023-10-06T11:05:55.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.028+0000 7f140659c700 1 -- 172.21.15.146:0/2254505063 learned_addr learned my addr 172.21.15.146:0/2254505063 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:55.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.028+0000 7f1406d9d700 1 --2- 172.21.15.146:0/2254505063 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1408159a90 0x7f14080a54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:55.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.028+0000 7f140659c700 1 -- 172.21.15.146:0/2254505063 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14080cdde0 msgr2=0x7f140816ed10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T11:05:55.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.028+0000 7f140659c700 1 --2- 172.21.15.146:0/2254505063 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14080cdde0 0x7f140816ed10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.028+0000 7f140659c700 1 -- 172.21.15.146:0/2254505063 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1408159a90 msgr2=0x7f14080a54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:55.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.028+0000 7f140659c700 1 --2- 172.21.15.146:0/2254505063 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1408159a90 0x7f14080a54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.028+0000 7f140659c700 1 -- 172.21.15.146:0/2254505063 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1400009a20 con 0x7f14080aecd0 2023-10-06T11:05:55.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.027+0000 7f322affd700 1 -- 172.21.15.146:0/4157439415 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322400e070 con 0x7f322c15db80 2023-10-06T11:05:55.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.027+0000 7f322affd700 1 -- 172.21.15.146:0/4157439415 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322400ba60 con 0x7f322c15db80 2023-10-06T11:05:55.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.027+0000 7f322affd700 1 -- 172.21.15.146:0/4157439415 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322400be20 con 0x7f322c15db80 2023-10-06T11:05:55.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.028+0000 7f323257b700 1 -- 172.21.15.146:0/4157439415 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f322c15db80 msgr2=0x7f322c15ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:55.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.028+0000 7f323257b700 1 --2- 172.21.15.146:0/4157439415 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f322c15db80 0x7f322c15ff60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3224009e60 tx=0x7f3224009780 comp rx=0 tx=0).stop 2023-10-06T11:05:55.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.028+0000 7f323257b700 1 -- 172.21.15.146:0/4157439415 shutdown_connections 2023-10-06T11:05:55.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.028+0000 7f323257b700 1 --2- 172.21.15.146:0/4157439415 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f322c15db80 0x7f322c15ff60 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.028+0000 7f323257b700 1 --2- 172.21.15.146:0/4157439415 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f322c0b1b00 0x7f322c0a54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.028+0000 7f323257b700 1 -- 172.21.15.146:0/4157439415 >> 172.21.15.146:0/4157439415 conn(0x7f322c067f40 msgr2=0x7f322c0cc1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:55.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.028+0000 7f140659c700 1 --2- 172.21.15.146:0/2254505063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14080aecd0 0x7f1408150e00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f13f000d860 tx=0x7f13f0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:55.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.028+0000 7fbf2da8e700 1 -- 172.21.15.146:0/590976887 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf28162550 msgr2=0x7fbf2806e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:55.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.028+0000 7fbf2da8e700 1 --2- 172.21.15.146:0/590976887 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf28162550 0x7fbf2806e6b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbf180098e0 tx=0x7fbf180091a0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.028+0000 7fadba979700 1 -- 172.21.15.146:0/2956677639 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fadb40686d0 msgr2=0x7fadb406ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:55.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.028+0000 7fadba979700 1 --2- 172.21.15.146:0/2956677639 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fadb40686d0 0x7fadb406ec80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fadac009f20 tx=0x7fadac009840 comp rx=0 tx=0).stop 2023-10-06T11:05:55.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.028+0000 7fadba979700 1 -- 172.21.15.146:0/2956677639 shutdown_connections 2023-10-06T11:05:55.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.028+0000 7fadba979700 1 --2- 172.21.15.146:0/2956677639 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fadb40686d0 0x7fadb406ec80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.028+0000 7fadba979700 1 --2- 172.21.15.146:0/2956677639 >> v2:172.21.15.151:3300/0 conn(0x7fadb4068aa0 0x7fadb406a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.028+0000 7fadba979700 1 -- 172.21.15.146:0/2956677639 >> 172.21.15.146:0/2956677639 conn(0x7fadb40c9fa0 msgr2=0x7fadb406de70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:55.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.028+0000 7fadba979700 1 -- 172.21.15.146:0/2956677639 shutdown_connections 2023-10-06T11:05:55.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.028+0000 7fadba979700 1 -- 172.21.15.146:0/2956677639 wait complete. 2023-10-06T11:05:55.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.029+0000 7f13feffd700 1 -- 172.21.15.146:0/2254505063 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f00125f0 con 0x7f14080aecd0 2023-10-06T11:05:55.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.029+0000 7f13feffd700 1 -- 172.21.15.146:0/2254505063 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f0012750 con 0x7f14080aecd0 2023-10-06T11:05:55.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.029+0000 7f140cc88700 1 -- 172.21.15.146:0/2254505063 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14080a5fb0 con 0x7f14080aecd0 2023-10-06T11:05:55.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.029+0000 7fca83a7c700 1 Processor -- start 2023-10-06T11:05:55.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.029+0000 7f140cc88700 1 -- 172.21.15.146:0/2254505063 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1408152b90 con 0x7f14080aecd0 2023-10-06T11:05:55.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.029+0000 7f13feffd700 1 -- 172.21.15.146:0/2254505063 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f0012ad0 con 0x7f14080aecd0 2023-10-06T11:05:55.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.029+0000 7fa6a4302700 1 -- 172.21.15.146:0/2475846419 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa69c15b680 msgr2=0x7fa69c15ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:55.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.029+0000 7fa6a4302700 1 --2- 172.21.15.146:0/2475846419 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa69c15b680 0x7fa69c15ed00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa6980098e0 tx=0x7fa6980091a0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.029+0000 7fca83a7c700 1 -- start start 2023-10-06T11:05:55.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.029+0000 7fbf2da8e700 1 -- 172.21.15.146:0/590976887 shutdown_connections 2023-10-06T11:05:55.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.029+0000 7fbf2da8e700 1 --2- 172.21.15.146:0/590976887 >> v2:172.21.15.146:3300/0 conn(0x7fbf2815d9e0 0x7fbf28162010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.029+0000 7fbf2da8e700 1 --2- 172.21.15.146:0/590976887 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf28162550 0x7fbf2806e6b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.029+0000 7fbf2da8e700 1 -- 172.21.15.146:0/590976887 >> 172.21.15.146:0/590976887 conn(0x7fbf28069050 msgr2=0x7fbf280cd300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:55.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.030+0000 7fa6a4302700 1 -- 172.21.15.146:0/2475846419 shutdown_connections 2023-10-06T11:05:55.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.030+0000 7fa6a4302700 1 --2- 172.21.15.146:0/2475846419 >> v2:172.21.15.146:3300/0 conn(0x7fa69c161250 0x7fa69c0af850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.030+0000 7fa6a4302700 1 --2- 172.21.15.146:0/2475846419 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa69c15b680 0x7fa69c15ed00 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.030+0000 7fa6a4302700 1 -- 172.21.15.146:0/2475846419 >> 172.21.15.146:0/2475846419 conn(0x7fa69c06a070 msgr2=0x7fa69c067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:55.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.030+0000 7f11aef38700 1 Processor -- start 2023-10-06T11:05:55.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.030+0000 7f323257b700 1 -- 172.21.15.146:0/4157439415 shutdown_connections 2023-10-06T11:05:55.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.030+0000 7fca83a7c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca7c0686d0 0x7fca7c14d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.030+0000 7fca83a7c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca7c068aa0 0x7fca7c0c2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.030+0000 7f140cc88700 1 -- 172.21.15.146:0/2254505063 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13ec0052b0 con 0x7f14080aecd0 2023-10-06T11:05:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.030+0000 7fca83a7c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca7c0ca630 0x7fca7c0c2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.030+0000 7fca83a7c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c14dd70 con 0x7fca7c0ca630 2023-10-06T11:05:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.030+0000 7fca83a7c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c0c3bb0 con 0x7fca7c0686d0 2023-10-06T11:05:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.030+0000 7fca83a7c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca7c0c3e90 con 0x7fca7c068aa0 2023-10-06T11:05:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.030+0000 7f11aef38700 1 -- start start 2023-10-06T11:05:55.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.030+0000 7fca82019700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca7c0ca630 0x7fca7c0c2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:55.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.030+0000 7fca82019700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca7c0ca630 0x7fca7c0c2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39960/0 (socket says 172.21.15.146:39960) 2023-10-06T11:05:55.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.030+0000 7fca81818700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca7c0686d0 0x7fca7c14d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:55.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.030+0000 7fca82019700 1 -- 172.21.15.146:0/3865189459 learned_addr learned my addr 172.21.15.146:0/3865189459 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:55.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.030+0000 7fbf2da8e700 1 -- 172.21.15.146:0/590976887 shutdown_connections 2023-10-06T11:05:55.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.030+0000 7fadba979700 1 Processor -- start 2023-10-06T11:05:55.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.030+0000 7f323257b700 1 -- 172.21.15.146:0/4157439415 wait complete. 2023-10-06T11:05:55.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.030+0000 7fca81017700 1 --2- 172.21.15.146:0/3865189459 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca7c068aa0 0x7fca7c0c2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:55.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.030+0000 7fca81818700 1 -- 172.21.15.146:0/3865189459 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca7c068aa0 msgr2=0x7fca7c0c2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:55.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.031+0000 7fca81818700 1 --2- 172.21.15.146:0/3865189459 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca7c068aa0 0x7fca7c0c2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.031+0000 7fca81818700 1 -- 172.21.15.146:0/3865189459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca7c0ca630 msgr2=0x7fca7c0c2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:55.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.031+0000 7fca81818700 1 --2- 172.21.15.146:0/3865189459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca7c0ca630 0x7fca7c0c2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.031+0000 7fca81818700 1 -- 172.21.15.146:0/3865189459 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca6c009420 con 0x7fca7c0686d0 2023-10-06T11:05:55.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.031+0000 7fca82019700 1 --2- 172.21.15.146:0/3865189459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca7c0ca630 0x7fca7c0c2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:05:55.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.031+0000 7fa6a4302700 1 -- 172.21.15.146:0/2475846419 shutdown_connections 2023-10-06T11:05:55.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.031+0000 7fca81818700 1 --2- 172.21.15.146:0/3865189459 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca7c0686d0 0x7fca7c14d830 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fca6c016000 tx=0x7fca6c017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:55.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.031+0000 7fca71ffb700 1 -- 172.21.15.146:0/3865189459 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c01f070 con 0x7fca7c0686d0 2023-10-06T11:05:55.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.031+0000 7fca71ffb700 1 -- 172.21.15.146:0/3865189459 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6c00bbe0 con 0x7fca7c0686d0 2023-10-06T11:05:55.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.031+0000 7fca71ffb700 1 -- 172.21.15.146:0/3865189459 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c011670 con 0x7fca7c0686d0 2023-10-06T11:05:55.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.031+0000 7fca83a7c700 1 -- 172.21.15.146:0/3865189459 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca7c0c4170 con 0x7fca7c0686d0 2023-10-06T11:05:55.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.031+0000 7fca83a7c700 1 -- 172.21.15.146:0/3865189459 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca7c0c4730 con 0x7fca7c0686d0 2023-10-06T11:05:55.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.032+0000 7f323257b700 1 Processor -- start 2023-10-06T11:05:55.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.032+0000 7fa6a4302700 1 -- 172.21.15.146:0/2475846419 wait complete. 2023-10-06T11:05:55.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.031+0000 7f13feffd700 1 -- 172.21.15.146:0/2254505063 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f13f0014430 con 0x7f14080aecd0 2023-10-06T11:05:55.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.032+0000 7f13feffd700 1 --2- 172.21.15.146:0/2254505063 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f13e8066fb0 0x7f13e8069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.032+0000 7f13feffd700 1 -- 172.21.15.146:0/2254505063 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f13f0084ad0 con 0x7f14080aecd0 2023-10-06T11:05:55.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.033+0000 7f13fdd9b700 1 --2- 172.21.15.146:0/2254505063 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f13e8066fb0 0x7f13e8069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:55.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.034+0000 7f13fdd9b700 1 --2- 172.21.15.146:0/2254505063 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f13e8066fb0 0x7f13e8069460 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f13f80058d0 tx=0x7f13f80010a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:55.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.032+0000 7fbf2da8e700 1 -- 172.21.15.146:0/590976887 wait complete. 2023-10-06T11:05:55.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.033+0000 7fbf2da8e700 1 Processor -- start 2023-10-06T11:05:55.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.034+0000 7fbf2da8e700 1 -- start start 2023-10-06T11:05:55.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.032+0000 7f323257b700 1 -- start start 2023-10-06T11:05:55.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.033+0000 7f323257b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f322c0a59f0 0x7f322c0ae000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.033+0000 7f323257b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f322c0b1b00 0x7f322c158e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.033+0000 7f323257b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f322c15db80 0x7f322c142e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.033+0000 7f323257b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322c1589b0 con 0x7f322c0b1b00 2023-10-06T11:05:55.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.033+0000 7f323257b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322c157da0 con 0x7f322c15db80 2023-10-06T11:05:55.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.033+0000 7f323257b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f322c158080 con 0x7f322c0a59f0 2023-10-06T11:05:55.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.033+0000 7f322bfff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f322c0a59f0 0x7f322c0ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:55.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.033+0000 7f322bfff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f322c0a59f0 0x7f322c0ae000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:40716/0 (socket says 172.21.15.146:40716) 2023-10-06T11:05:55.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.033+0000 7f3230b18700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f322c15db80 0x7f322c142e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:55.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.034+0000 7f322bfff700 1 -- 172.21.15.146:0/2981068512 learned_addr learned my addr 172.21.15.146:0/2981068512 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:55.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.034+0000 7f322bfff700 1 -- 172.21.15.146:0/2981068512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f322c15db80 msgr2=0x7f322c142e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:55.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.034+0000 7f322bfff700 1 --2- 172.21.15.146:0/2981068512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f322c15db80 0x7f322c142e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.034+0000 7f322bfff700 1 -- 172.21.15.146:0/2981068512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f322c0b1b00 msgr2=0x7f322c158e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:55.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.034+0000 7f322bfff700 1 --2- 172.21.15.146:0/2981068512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f322c0b1b00 0x7f322c158e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.034+0000 7f322bfff700 1 -- 172.21.15.146:0/2981068512 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3224009a20 con 0x7f322c0a59f0 2023-10-06T11:05:55.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.033+0000 7fa6a4302700 1 Processor -- start 2023-10-06T11:05:55.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.034+0000 7fa6a4302700 1 -- start start 2023-10-06T11:05:55.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.031+0000 7fadba979700 1 -- start start 2023-10-06T11:05:55.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.032+0000 7fadba979700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fadb40686d0 0x7fadb41708d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.032+0000 7fadba979700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fadb4068aa0 0x7fadb4177c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.032+0000 7fadba979700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fadb40ca630 0x7fadb4176a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.032+0000 7fadba979700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb40c6740 con 0x7fadb4068aa0 2023-10-06T11:05:55.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.032+0000 7fadba979700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb4177a10 con 0x7fadb40686d0 2023-10-06T11:05:55.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.032+0000 7fadba979700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadb4177450 con 0x7fadb40ca630 2023-10-06T11:05:55.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.033+0000 7fadb3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fadb40686d0 0x7fadb41708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:55.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.033+0000 7fadb3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fadb40686d0 0x7fadb41708d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:45258/0 (socket says 172.21.15.146:45258) 2023-10-06T11:05:55.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.033+0000 7fadb3fff700 1 -- 172.21.15.146:0/3767132753 learned_addr learned my addr 172.21.15.146:0/3767132753 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:55.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.034+0000 7fadb3fff700 1 -- 172.21.15.146:0/3767132753 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fadb40ca630 msgr2=0x7fadb4176a70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T11:05:55.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.034+0000 7fadb3fff700 1 --2- 172.21.15.146:0/3767132753 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fadb40ca630 0x7fadb4176a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.034+0000 7fadb3fff700 1 -- 172.21.15.146:0/3767132753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fadb4068aa0 msgr2=0x7fadb4177c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:55.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.034+0000 7fadb3fff700 1 --2- 172.21.15.146:0/3767132753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fadb4068aa0 0x7fadb4177c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.034+0000 7fadb3fff700 1 -- 172.21.15.146:0/3767132753 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadac009ae0 con 0x7fadb40686d0 2023-10-06T11:05:55.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.033+0000 7fca83a7c700 1 -- 172.21.15.146:0/3865189459 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca7c04c380 con 0x7fca7c0686d0 2023-10-06T11:05:55.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.033+0000 7fca71ffb700 1 -- 172.21.15.146:0/3865189459 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fca6c011a60 con 0x7fca7c0686d0 2023-10-06T11:05:55.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.034+0000 7fca71ffb700 1 --2- 172.21.15.146:0/3865189459 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fca60066fb0 0x7fca60069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.034+0000 7fca71ffb700 1 -- 172.21.15.146:0/3865189459 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fca6c085840 con 0x7fca7c0686d0 2023-10-06T11:05:55.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.031+0000 7f11aef38700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f11a80ad3a0 0x7f11a80b1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.031+0000 7f11aef38700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f11a806a4f0 0x7f11a815db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.031+0000 7f11aef38700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11a815a6f0 con 0x7f11a80b1700 2023-10-06T11:05:55.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.031+0000 7f11aef38700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11a80cbe10 con 0x7f11a80ad3a0 2023-10-06T11:05:55.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.031+0000 7f11aef38700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11a8159b00 con 0x7f11a806a4f0 2023-10-06T11:05:55.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.032+0000 7f11ad735700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f11a80ad3a0 0x7f11a80b1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:55.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.032+0000 7f11ad735700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f11a80ad3a0 0x7f11a80b1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39974/0 (socket says 172.21.15.146:39974) 2023-10-06T11:05:55.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.032+0000 7f11adf36700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f11a80b1700 0x7f11a80acc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:38496/0 (socket says 172.21.15.146:38496) 2023-10-06T11:05:55.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.032+0000 7f11ad735700 1 -- 172.21.15.146:0/2187791701 learned_addr learned my addr 172.21.15.146:0/2187791701 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:55.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.033+0000 7f11ae737700 1 --2- 172.21.15.146:0/2187791701 >> v2:172.21.15.151:3300/0 conn(0x7f11a806a4f0 0x7f11a815db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:55.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.034+0000 7f11ae737700 1 -- 172.21.15.146:0/2187791701 >> v2:172.21.15.146:3300/0 conn(0x7f11a80ad3a0 msgr2=0x7f11a80b1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:55.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.034+0000 7f11ae737700 1 --2- 172.21.15.146:0/2187791701 >> v2:172.21.15.146:3300/0 conn(0x7f11a80ad3a0 0x7f11a80b1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.034+0000 7f11ae737700 1 -- 172.21.15.146:0/2187791701 >> v1:172.21.15.151:6789/0 conn(0x7f11a80b1700 legacy=0x7f11a80acc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:55.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.034+0000 7f11ae737700 1 -- 172.21.15.146:0/2187791701 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a8159dc0 con 0x7f11a806a4f0 2023-10-06T11:05:55.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.034+0000 7f322bfff700 1 --2- 172.21.15.146:0/2981068512 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f322c0a59f0 0x7f322c0ae000 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f322c069370 tx=0x7f3224018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:55.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.034+0000 7fadb3fff700 1 --2- 172.21.15.146:0/3767132753 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fadb40686d0 0x7fadb41708d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fadac00b6c0 tx=0x7fadac017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:55.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.034+0000 7fca81017700 1 --2- 172.21.15.146:0/3865189459 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fca60066fb0 0x7fca60069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:55.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.034+0000 7f3213fff700 1 -- 172.21.15.146:0/2981068512 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3224012db0 con 0x7f322c0a59f0 2023-10-06T11:05:55.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.035+0000 7f3213fff700 1 -- 172.21.15.146:0/2981068512 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322401e430 con 0x7f322c0a59f0 2023-10-06T11:05:55.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.035+0000 7f3213fff700 1 -- 172.21.15.146:0/2981068512 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322401e7f0 con 0x7f322c0a59f0 2023-10-06T11:05:55.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.035+0000 7f323257b700 1 -- 172.21.15.146:0/2981068512 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f322c158360 con 0x7f322c0a59f0 2023-10-06T11:05:55.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.035+0000 7f323257b700 1 -- 172.21.15.146:0/2981068512 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f322c0ae540 con 0x7f322c0a59f0 2023-10-06T11:05:55.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.035+0000 7fca81017700 1 --2- 172.21.15.146:0/3865189459 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fca60066fb0 0x7fca60069460 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fca7c0c4f20 tx=0x7fca78008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:55.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.035+0000 7fbf2da8e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf280cda10 0x7fbf28177610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.035+0000 7fbf2da8e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf2815d9e0 0x7fbf280aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.035+0000 7fbf2da8e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf28162550 0x7fbf2815c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.035+0000 7fbf2da8e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf280b1f80 con 0x7fbf28162550 2023-10-06T11:05:55.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.035+0000 7fbf2da8e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf280b23a0 con 0x7fbf2815d9e0 2023-10-06T11:05:55.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.035+0000 7fbf2da8e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf280b1300 con 0x7fbf280cda10 2023-10-06T11:05:55.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.035+0000 7fbf277fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf280cda10 0x7fbf28177610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:55.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.035+0000 7fbf1ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf2815d9e0 0x7fbf280aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:55.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.035+0000 7fbf277fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf280cda10 0x7fbf28177610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:40728/0 (socket says 172.21.15.146:40728) 2023-10-06T11:05:55.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.035+0000 7fbf1ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf2815d9e0 0x7fbf280aebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:45270/0 (socket says 172.21.15.146:45270) 2023-10-06T11:05:55.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.035+0000 7fbf277fe700 1 -- 172.21.15.146:0/1289010099 learned_addr learned my addr 172.21.15.146:0/1289010099 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:55.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.035+0000 7fbf27fff700 1 --2- 172.21.15.146:0/1289010099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf28162550 0x7fbf2815c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:55.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.035+0000 7fbf1ffff700 1 -- 172.21.15.146:0/1289010099 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf280cda10 msgr2=0x7fbf28177610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:55.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.035+0000 7fbf1ffff700 1 --2- 172.21.15.146:0/1289010099 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf280cda10 0x7fbf28177610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.036+0000 7fbf1ffff700 1 -- 172.21.15.146:0/1289010099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf28162550 msgr2=0x7fbf2815c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:55.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.036+0000 7fbf1ffff700 1 --2- 172.21.15.146:0/1289010099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf28162550 0x7fbf2815c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.036+0000 7fbf1ffff700 1 -- 172.21.15.146:0/1289010099 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf18009420 con 0x7fbf2815d9e0 2023-10-06T11:05:55.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.036+0000 7fbf27fff700 1 --2- 172.21.15.146:0/1289010099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf28162550 0x7fbf2815c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:05:55.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.035+0000 7fa6a4302700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa69c15b680 0x7fa69c0cb250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.035+0000 7fa6a4302700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa69c161250 0x7fa69c154860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.035+0000 7fa6a4302700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa69c0cb790 0x7fa69c154da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.035+0000 7fa6a4302700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa69c1552e0 con 0x7fa69c161250 2023-10-06T11:05:55.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.035+0000 7fa6a4302700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa69c15ccf0 con 0x7fa69c0cb790 2023-10-06T11:05:55.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.035+0000 7fa6a4302700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa69c15cfd0 con 0x7fa69c15b680 2023-10-06T11:05:55.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.035+0000 7fa6a289f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa69c0cb790 0x7fa69c154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:55.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.035+0000 7fa6a289f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa69c0cb790 0x7fa69c154da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:45284/0 (socket says 172.21.15.146:45284) 2023-10-06T11:05:55.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.035+0000 7fa6a289f700 1 -- 172.21.15.146:0/3388430729 learned_addr learned my addr 172.21.15.146:0/3388430729 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:55.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.035+0000 7fa6a189d700 1 --2- 172.21.15.146:0/3388430729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa69c161250 0x7fa69c154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:55.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.036+0000 7fa6a289f700 1 -- 172.21.15.146:0/3388430729 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa69c15b680 msgr2=0x7fa69c0cb250 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T11:05:55.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.036+0000 7fa6a289f700 1 --2- 172.21.15.146:0/3388430729 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa69c15b680 0x7fa69c0cb250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.036+0000 7fa6a289f700 1 -- 172.21.15.146:0/3388430729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa69c161250 msgr2=0x7fa69c154860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:55.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.036+0000 7fa6a289f700 1 --2- 172.21.15.146:0/3388430729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa69c161250 0x7fa69c154860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.036+0000 7fa6a289f700 1 -- 172.21.15.146:0/3388430729 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa698009420 con 0x7fa69c0cb790 2023-10-06T11:05:55.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.036+0000 7fbf1ffff700 1 --2- 172.21.15.146:0/1289010099 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf2815d9e0 0x7fbf280aebf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbf18015000 tx=0x7fbf18016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:55.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.036+0000 7f11ae737700 1 --2- 172.21.15.146:0/2187791701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11a806a4f0 0x7f11a815db10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f11a806d2c0 tx=0x7f11a0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbf1e4de5c0d75ea server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:55.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.036+0000 7fa6a289f700 1 --2- 172.21.15.146:0/3388430729 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa69c0cb790 0x7fa69c154da0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa694007c70 tx=0x7fa694009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:55.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.036+0000 7f323257b700 1 -- 172.21.15.146:0/2981068512 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f322c158c90 con 0x7f322c0a59f0 2023-10-06T11:05:55.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.037+0000 7f3213fff700 1 -- 172.21.15.146:0/2981068512 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f322401eba0 con 0x7f322c0a59f0 2023-10-06T11:05:55.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.037+0000 7f3213fff700 1 --2- 172.21.15.146:0/2981068512 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3218066f30 0x7f32180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.037+0000 7f322b7fe700 1 --2- 172.21.15.146:0/2981068512 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3218066f30 0x7f32180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:55.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.037+0000 7f3213fff700 1 -- 172.21.15.146:0/2981068512 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3224086910 con 0x7f322c0a59f0 2023-10-06T11:05:55.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.038+0000 7f322b7fe700 1 --2- 172.21.15.146:0/2981068512 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3218066f30 0x7f32180693e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3220009bb0 tx=0x7f32200091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:55.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.038+0000 7f13feffd700 1 -- 172.21.15.146:0/2254505063 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f13f0051b40 con 0x7f14080aecd0 2023-10-06T11:05:55.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.039+0000 7fa6927fc700 1 -- 172.21.15.146:0/3388430729 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69400d930 con 0x7fa69c0cb790 2023-10-06T11:05:55.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.039+0000 7f11acf34700 1 -- 172.21.15.146:0/2187791701 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a000e070 con 0x7f11a806a4f0 2023-10-06T11:05:55.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.039+0000 7fbf1f7fe700 1 -- 172.21.15.146:0/1289010099 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1801bce0 con 0x7fbf2815d9e0 2023-10-06T11:05:55.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.039+0000 7fbf2da8e700 1 -- 172.21.15.146:0/1289010099 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf280b15e0 con 0x7fbf2815d9e0 2023-10-06T11:05:55.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.039+0000 7fa6a4302700 1 -- 172.21.15.146:0/3388430729 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa69c15d2b0 con 0x7fa69c0cb790 2023-10-06T11:05:55.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.039+0000 7fa6927fc700 1 -- 172.21.15.146:0/3388430729 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa69400f040 con 0x7fa69c0cb790 2023-10-06T11:05:55.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.039+0000 7fa6927fc700 1 -- 172.21.15.146:0/3388430729 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa69400dd00 con 0x7fa69c0cb790 2023-10-06T11:05:55.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.039+0000 7fbf2da8e700 1 -- 172.21.15.146:0/1289010099 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf280b1ba0 con 0x7fbf2815d9e0 2023-10-06T11:05:55.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.039+0000 7fa6a4302700 1 -- 172.21.15.146:0/3388430729 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa69c15bf50 con 0x7fa69c0cb790 2023-10-06T11:05:55.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.039+0000 7fca71ffb700 1 -- 172.21.15.146:0/3865189459 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca6c0528b0 con 0x7fca7c0686d0 2023-10-06T11:05:55.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.039+0000 7fad9bfff700 1 -- 172.21.15.146:0/3767132753 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadac0129d0 con 0x7fadb40686d0 2023-10-06T11:05:55.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.040+0000 7fad9bfff700 1 -- 172.21.15.146:0/3767132753 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadac012b30 con 0x7fadb40686d0 2023-10-06T11:05:55.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.040+0000 7fad9bfff700 1 -- 172.21.15.146:0/3767132753 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadac01e430 con 0x7fadb40686d0 2023-10-06T11:05:55.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.040+0000 7fadba979700 1 -- 172.21.15.146:0/3767132753 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadb4177730 con 0x7fadb40686d0 2023-10-06T11:05:55.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.040+0000 7fadba979700 1 -- 172.21.15.146:0/3767132753 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadb40c6c50 con 0x7fadb40686d0 2023-10-06T11:05:55.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.040+0000 7fbf1f7fe700 1 -- 172.21.15.146:0/1289010099 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf1801be40 con 0x7fbf2815d9e0 2023-10-06T11:05:55.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.040+0000 7fbf1f7fe700 1 -- 172.21.15.146:0/1289010099 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1801c6a0 con 0x7fbf2815d9e0 2023-10-06T11:05:55.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.041+0000 7fa6a4302700 1 -- 172.21.15.146:0/3388430729 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa69c04c380 con 0x7fa69c0cb790 2023-10-06T11:05:55.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.041+0000 7fbf1f7fe700 1 -- 172.21.15.146:0/1289010099 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbf1801ca90 con 0x7fbf2815d9e0 2023-10-06T11:05:55.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.042+0000 7f11acf34700 1 -- 172.21.15.146:0/2187791701 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a000bb20 con 0x7f11a806a4f0 2023-10-06T11:05:55.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.042+0000 7f11acf34700 1 -- 172.21.15.146:0/2187791701 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a0012430 con 0x7f11a806a4f0 2023-10-06T11:05:55.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.042+0000 7fbf1f7fe700 1 --2- 172.21.15.146:0/1289010099 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbf140670a0 0x7fbf14069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.042+0000 7fbf1f7fe700 1 -- 172.21.15.146:0/1289010099 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbf18085650 con 0x7fbf2815d9e0 2023-10-06T11:05:55.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.042+0000 7fbf2da8e700 1 -- 172.21.15.146:0/1289010099 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf0c0052b0 con 0x7fbf2815d9e0 2023-10-06T11:05:55.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.042+0000 7fbf277fe700 1 --2- 172.21.15.146:0/1289010099 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbf140670a0 0x7fbf14069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:55.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.042+0000 7fa6927fc700 1 -- 172.21.15.146:0/3388430729 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa694013600 con 0x7fa69c0cb790 2023-10-06T11:05:55.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.042+0000 7fa6927fc700 1 --2- 172.21.15.146:0/3388430729 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa680066f30 0x7fa6800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.042+0000 7fa6927fc700 1 -- 172.21.15.146:0/3388430729 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa694084920 con 0x7fa69c0cb790 2023-10-06T11:05:55.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.043+0000 7fa6a209e700 1 --2- 172.21.15.146:0/3388430729 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa680066f30 0x7fa6800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:55.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.042+0000 7fadba979700 1 -- 172.21.15.146:0/3767132753 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad940052b0 con 0x7fadb40686d0 2023-10-06T11:05:55.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.042+0000 7fad9bfff700 1 -- 172.21.15.146:0/3767132753 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fadac01e820 con 0x7fadb40686d0 2023-10-06T11:05:55.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.043+0000 7fad9bfff700 1 --2- 172.21.15.146:0/3767132753 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fada0067000 0x7fada00694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.043+0000 7f11aef38700 1 -- 172.21.15.146:0/2187791701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11a806a4f0 msgr2=0x7f11a815db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:55.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.043+0000 7f11aef38700 1 --2- 172.21.15.146:0/2187791701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11a806a4f0 0x7f11a815db10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f11a806d2c0 tx=0x7f11a0009780 comp rx=0 tx=0).stop 2023-10-06T11:05:55.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.043+0000 7f11aef38700 1 -- 172.21.15.146:0/2187791701 shutdown_connections 2023-10-06T11:05:55.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.043+0000 7f11aef38700 1 --2- 172.21.15.146:0/2187791701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11a806a4f0 0x7f11a815db10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.043+0000 7f11aef38700 1 --2- 172.21.15.146:0/2187791701 >> v2:172.21.15.146:3300/0 conn(0x7f11a80ad3a0 0x7f11a80b1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.043+0000 7f11aef38700 1 -- 172.21.15.146:0/2187791701 >> 172.21.15.146:0/2187791701 conn(0x7f11a8067f00 msgr2=0x7f11a80cc010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:55.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.043+0000 7fbf277fe700 1 --2- 172.21.15.146:0/1289010099 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbf140670a0 0x7fbf14069550 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbf10009e80 tx=0x7fbf10009250 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:55.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.043+0000 7f3213fff700 1 -- 172.21.15.146:0/2981068512 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3224053a20 con 0x7f322c0a59f0 2023-10-06T11:05:55.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.043+0000 7fad9bfff700 1 -- 172.21.15.146:0/3767132753 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fadac085f90 con 0x7fadb40686d0 2023-10-06T11:05:55.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.043+0000 7fadb37fe700 1 --2- 172.21.15.146:0/3767132753 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fada0067000 0x7fada00694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:55.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.043+0000 7f11aef38700 1 -- 172.21.15.146:0/2187791701 shutdown_connections 2023-10-06T11:05:55.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.043+0000 7f11aef38700 1 -- 172.21.15.146:0/2187791701 wait complete. 2023-10-06T11:05:55.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.044+0000 7f11aef38700 1 Processor -- start 2023-10-06T11:05:55.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.043+0000 7fa6a209e700 1 --2- 172.21.15.146:0/3388430729 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa680066f30 0x7fa6800693e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa69800c010 tx=0x7fa698016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:55.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.044+0000 7f11aef38700 1 -- start start 2023-10-06T11:05:55.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.045+0000 7f11aef38700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11a806a4f0 0x7f11a815c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.045+0000 7f11aef38700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11a80ad3a0 0x7f11a8149c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.045+0000 7f11aef38700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11a80b1700 0x7f11a8153040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.045+0000 7f11aef38700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a814f920 con 0x7f11a806a4f0 2023-10-06T11:05:55.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.045+0000 7f11aef38700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a8152bb0 con 0x7f11a80ad3a0 2023-10-06T11:05:55.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.045+0000 7f11aef38700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11a8152280 con 0x7f11a80b1700 2023-10-06T11:05:55.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.045+0000 7f11adf36700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11a806a4f0 0x7f11a815c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:55.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.045+0000 7f11adf36700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11a806a4f0 0x7f11a815c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40030/0 (socket says 172.21.15.146:40030) 2023-10-06T11:05:55.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.045+0000 7f11adf36700 1 -- 172.21.15.146:0/3475732692 learned_addr learned my addr 172.21.15.146:0/3475732692 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:55.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.045+0000 7f11ad735700 1 --2- 172.21.15.146:0/3475732692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11a80ad3a0 0x7f11a8149c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:55.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.046+0000 7f11adf36700 1 -- 172.21.15.146:0/3475732692 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11a80b1700 msgr2=0x7f11a8153040 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T11:05:55.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.046+0000 7f11adf36700 1 --2- 172.21.15.146:0/3475732692 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11a80b1700 0x7f11a8153040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.046+0000 7f11adf36700 1 -- 172.21.15.146:0/3475732692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11a80ad3a0 msgr2=0x7f11a8149c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:55.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.046+0000 7f11adf36700 1 --2- 172.21.15.146:0/3475732692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11a80ad3a0 0x7f11a8149c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.046+0000 7f11adf36700 1 -- 172.21.15.146:0/3475732692 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a0009a20 con 0x7f11a806a4f0 2023-10-06T11:05:55.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.046+0000 7f11adf36700 1 --2- 172.21.15.146:0/3475732692 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11a806a4f0 0x7f11a815c1c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f119800c5e0 tx=0x7f11980049e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:55.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.046+0000 7f119dffb700 1 -- 172.21.15.146:0/3475732692 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1198005ac0 con 0x7f11a806a4f0 2023-10-06T11:05:55.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.046+0000 7f119dffb700 1 -- 172.21.15.146:0/3475732692 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1198005c40 con 0x7f11a806a4f0 2023-10-06T11:05:55.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.046+0000 7f11aef38700 1 -- 172.21.15.146:0/3475732692 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11a8152560 con 0x7f11a806a4f0 2023-10-06T11:05:55.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.046+0000 7f119dffb700 1 -- 172.21.15.146:0/3475732692 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11980070d0 con 0x7f11a806a4f0 2023-10-06T11:05:55.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.046+0000 7f11aef38700 1 -- 172.21.15.146:0/3475732692 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11a814a5d0 con 0x7f11a806a4f0 2023-10-06T11:05:55.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.047+0000 7fa6927fc700 1 -- 172.21.15.146:0/3388430729 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa694051990 con 0x7fa69c0cb790 2023-10-06T11:05:55.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.049+0000 7f119dffb700 1 -- 172.21.15.146:0/3475732692 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1198007480 con 0x7f11a806a4f0 2023-10-06T11:05:55.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.049+0000 7f11aef38700 1 -- 172.21.15.146:0/3475732692 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11a806c290 con 0x7f11a806a4f0 2023-10-06T11:05:55.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.049+0000 7f119dffb700 1 --2- 172.21.15.146:0/3475732692 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f118c066f30 0x7f118c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.049+0000 7f119dffb700 1 -- 172.21.15.146:0/3475732692 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1198083a80 con 0x7f11a806a4f0 2023-10-06T11:05:55.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.049+0000 7f11ad735700 1 --2- 172.21.15.146:0/3475732692 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f118c066f30 0x7f118c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:55.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.050+0000 7f11ad735700 1 --2- 172.21.15.146:0/3475732692 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f118c066f30 0x7f118c0693e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f11a81507d0 tx=0x7f11a4013040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:55.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.044+0000 7fadb37fe700 1 --2- 172.21.15.146:0/3767132753 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fada0067000 0x7fada00694b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fada8006fd0 tx=0x7fada8006db0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:55.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.051+0000 7fbf1f7fe700 1 -- 172.21.15.146:0/1289010099 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbf18021080 con 0x7fbf2815d9e0 2023-10-06T11:05:55.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.055+0000 7fad9bfff700 1 -- 172.21.15.146:0/3767132753 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fadac0b75a0 con 0x7fadb40686d0 2023-10-06T11:05:55.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.061+0000 7f119dffb700 1 -- 172.21.15.146:0/3475732692 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f119804b5a0 con 0x7f11a806a4f0 2023-10-06T11:05:55.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.062+0000 7f8346efe700 1 Processor -- start 2023-10-06T11:05:55.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.064+0000 7f8346efe700 1 -- start start 2023-10-06T11:05:55.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.065+0000 7f8346efe700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f83401578e0 0x7f834006e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.065+0000 7f8346efe700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83400cb3c0 con 0x7f83400b2620 2023-10-06T11:05:55.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.065+0000 7f8346efe700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f834006fa70 con 0x7f83400b29f0 2023-10-06T11:05:55.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.065+0000 7f8346efe700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83400b21e0 con 0x7f83401578e0 2023-10-06T11:05:55.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.065+0000 7f834549b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f83401578e0 0x7f834006e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:55.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.066+0000 7f834549b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f83401578e0 0x7f834006e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:45310/0 (socket says 172.21.15.146:45310) 2023-10-06T11:05:55.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.066+0000 7f834549b700 1 -- 172.21.15.146:0/2457700449 learned_addr learned my addr 172.21.15.146:0/2457700449 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:55.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.066+0000 7f834549b700 1 -- 172.21.15.146:0/2457700449 >> v1:172.21.15.151:6789/0 conn(0x7f83400b29f0 legacy=0x7f83401571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:55.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.066+0000 7f834549b700 1 -- 172.21.15.146:0/2457700449 >> v1:172.21.15.146:6789/0 conn(0x7f83400b2620 legacy=0x7f834015bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:55.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.066+0000 7f834549b700 1 -- 172.21.15.146:0/2457700449 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f834006eef0 con 0x7f83401578e0 2023-10-06T11:05:55.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.071+0000 7f834549b700 1 --2- 172.21.15.146:0/2457700449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83401578e0 0x7f834006e8a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8338009f20 tx=0x7f8338009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e601d6946d59c27e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:55.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.071+0000 7f833f7fe700 1 -- 172.21.15.146:0/2457700449 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833800e070 con 0x7f83401578e0 2023-10-06T11:05:55.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.071+0000 7f833f7fe700 1 -- 172.21.15.146:0/2457700449 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f833800ba40 con 0x7f83401578e0 2023-10-06T11:05:55.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.071+0000 7f833f7fe700 1 -- 172.21.15.146:0/2457700449 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83380092e0 con 0x7f83401578e0 2023-10-06T11:05:55.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.075+0000 7f8346efe700 1 -- 172.21.15.146:0/2457700449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83401578e0 msgr2=0x7f834006e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:55.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.075+0000 7f8346efe700 1 --2- 172.21.15.146:0/2457700449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83401578e0 0x7f834006e8a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8338009f20 tx=0x7f8338009840 comp rx=0 tx=0).stop 2023-10-06T11:05:55.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.076+0000 7f8346efe700 1 -- 172.21.15.146:0/2457700449 shutdown_connections 2023-10-06T11:05:55.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.076+0000 7f8346efe700 1 --2- 172.21.15.146:0/2457700449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83401578e0 0x7f834006e8a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.076+0000 7f8346efe700 1 -- 172.21.15.146:0/2457700449 >> 172.21.15.146:0/2457700449 conn(0x7f8340068580 msgr2=0x7f8340068980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:55.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.079+0000 7f8346efe700 1 -- 172.21.15.146:0/2457700449 shutdown_connections 2023-10-06T11:05:55.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.079+0000 7f8346efe700 1 -- 172.21.15.146:0/2457700449 wait complete. 2023-10-06T11:05:55.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.081+0000 7f8346efe700 1 Processor -- start 2023-10-06T11:05:55.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.081+0000 7f8346efe700 1 -- start start 2023-10-06T11:05:55.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.082+0000 7f8346efe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f83400b2620 0x7f83400b0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.082+0000 7f8346efe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83400b29f0 0x7f83401603f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.082+0000 7f8346efe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83401578e0 0x7f8340177140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.082+0000 7f8346efe700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f834015ff60 con 0x7f83400b29f0 2023-10-06T11:05:55.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.082+0000 7f8346efe700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8340161ab0 con 0x7f83401578e0 2023-10-06T11:05:55.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.082+0000 7f8346efe700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83401617d0 con 0x7f83400b2620 2023-10-06T11:05:55.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.083+0000 7f833ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83400b29f0 0x7f83401603f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:55.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.083+0000 7f833ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83400b29f0 0x7f83401603f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40038/0 (socket says 172.21.15.146:40038) 2023-10-06T11:05:55.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.083+0000 7f833ffff700 1 -- 172.21.15.146:0/2869651427 learned_addr learned my addr 172.21.15.146:0/2869651427 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:55.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.083+0000 7f833ffff700 1 -- 172.21.15.146:0/2869651427 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f83400b2620 msgr2=0x7f83400b0870 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T11:05:55.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.083+0000 7f833ffff700 1 --2- 172.21.15.146:0/2869651427 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f83400b2620 0x7f83400b0870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.083+0000 7f833ffff700 1 -- 172.21.15.146:0/2869651427 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83401578e0 msgr2=0x7f8340177140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T11:05:55.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.083+0000 7f833ffff700 1 --2- 172.21.15.146:0/2869651427 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83401578e0 0x7f8340177140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.083+0000 7f833ffff700 1 -- 172.21.15.146:0/2869651427 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8338009ae0 con 0x7f83400b29f0 2023-10-06T11:05:55.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.084+0000 7f833ffff700 1 --2- 172.21.15.146:0/2869651427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83400b29f0 0x7f83401603f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f833400c590 tx=0x7f833400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:55.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.084+0000 7f833cff9700 1 -- 172.21.15.146:0/2869651427 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8334011590 con 0x7f83400b29f0 2023-10-06T11:05:55.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.084+0000 7f833cff9700 1 -- 172.21.15.146:0/2869651427 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83340116f0 con 0x7f83400b29f0 2023-10-06T11:05:55.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.084+0000 7f833cff9700 1 -- 172.21.15.146:0/2869651427 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8334011a90 con 0x7f83400b29f0 2023-10-06T11:05:55.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.084+0000 7f8346efe700 1 -- 172.21.15.146:0/2869651427 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f834015f910 con 0x7f83400b29f0 2023-10-06T11:05:55.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.084+0000 7f8346efe700 1 -- 172.21.15.146:0/2869651427 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83400b0db0 con 0x7f83400b29f0 2023-10-06T11:05:55.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.087+0000 7f833cff9700 1 -- 172.21.15.146:0/2869651427 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8334012420 con 0x7f83400b29f0 2023-10-06T11:05:55.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.087+0000 7f833cff9700 1 --2- 172.21.15.146:0/2869651427 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f83280671a0 0x7f8328069650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:55.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.087+0000 7f833cff9700 1 -- 172.21.15.146:0/2869651427 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8334083af0 con 0x7f83400b29f0 2023-10-06T11:05:55.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.088+0000 7f8344c9a700 1 --2- 172.21.15.146:0/2869651427 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f83280671a0 0x7f8328069650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:55.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.089+0000 7f8344c9a700 1 --2- 172.21.15.146:0/2869651427 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f83280671a0 0x7f8328069650 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f83300096a0 tx=0x7f8330006bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:55.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.089+0000 7f8346efe700 1 -- 172.21.15.146:0/2869651427 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8340160110 con 0x7f83400b29f0 2023-10-06T11:05:55.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.098+0000 7f833cff9700 1 -- 172.21.15.146:0/2869651427 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f833404b5a0 con 0x7f83400b29f0 2023-10-06T11:05:55.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.400+0000 7f140cc88700 1 -- 172.21.15.146:0/2254505063 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f13ec005560 con 0x7f14080aecd0 2023-10-06T11:05:55.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.401+0000 7f13feffd700 1 -- 172.21.15.146:0/2254505063 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f13f0055160 con 0x7f14080aecd0 2023-10-06T11:05:55.405 INFO:teuthology.orchestra.run.smithi146.stdout:55834574854 2023-10-06T11:05:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.404+0000 7f140cc88700 1 -- 172.21.15.146:0/2254505063 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f13e8066fb0 msgr2=0x7f13e8069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.404+0000 7f140cc88700 1 --2- 172.21.15.146:0/2254505063 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f13e8066fb0 0x7f13e8069460 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f13f80058d0 tx=0x7f13f80010a0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.404+0000 7f140cc88700 1 -- 172.21.15.146:0/2254505063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14080aecd0 msgr2=0x7f1408150e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:55.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.404+0000 7f140cc88700 1 --2- 172.21.15.146:0/2254505063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14080aecd0 0x7f1408150e00 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f13f000d860 tx=0x7f13f0008040 comp rx=0 tx=0).stop 2023-10-06T11:05:55.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.408+0000 7f140cc88700 1 -- 172.21.15.146:0/2254505063 shutdown_connections 2023-10-06T11:05:55.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.408+0000 7f140cc88700 1 --2- 172.21.15.146:0/2254505063 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f13e8066fb0 0x7f13e8069460 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.408+0000 7f140cc88700 1 --2- 172.21.15.146:0/2254505063 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1408159a90 0x7f14080a54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.408+0000 7f140cc88700 1 --2- 172.21.15.146:0/2254505063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14080aecd0 0x7f1408150e00 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.408+0000 7f140cc88700 1 --2- 172.21.15.146:0/2254505063 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14080cdde0 0x7f140816ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.408+0000 7f140cc88700 1 -- 172.21.15.146:0/2254505063 >> 172.21.15.146:0/2254505063 conn(0x7f1408068580 msgr2=0x7f14080b1660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:55.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.409+0000 7f140cc88700 1 -- 172.21.15.146:0/2254505063 shutdown_connections 2023-10-06T11:05:55.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.409+0000 7f140cc88700 1 -- 172.21.15.146:0/2254505063 wait complete. 2023-10-06T11:05:55.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.420+0000 7fa6a4302700 1 -- 172.21.15.146:0/3388430729 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa69c155700 con 0x7fa69c0cb790 2023-10-06T11:05:55.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.425+0000 7fa6927fc700 1 -- 172.21.15.146:0/3388430729 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa69400de60 con 0x7fa69c0cb790 2023-10-06T11:05:55.429 INFO:teuthology.orchestra.run.smithi146.stdout:55834574854 2023-10-06T11:05:55.430 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.1 2023-10-06T11:05:55.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.427+0000 7fca83a7c700 1 -- 172.21.15.146:0/3865189459 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fca7c0add50 con 0x7fca7c0686d0 2023-10-06T11:05:55.430 INFO:teuthology.orchestra.run.smithi146.stdout:55834574855 2023-10-06T11:05:55.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.428+0000 7fca71ffb700 1 -- 172.21.15.146:0/3865189459 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fca6c015020 con 0x7fca7c0686d0 2023-10-06T11:05:55.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.431+0000 7fa6a4302700 1 -- 172.21.15.146:0/3388430729 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa680066f30 msgr2=0x7fa6800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:55.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.431+0000 7fa6a4302700 1 --2- 172.21.15.146:0/3388430729 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa680066f30 0x7fa6800693e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa69800c010 tx=0x7fa698016000 comp rx=0 tx=0).stop 2023-10-06T11:05:55.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.431+0000 7fa6a4302700 1 -- 172.21.15.146:0/3388430729 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa69c0cb790 msgr2=0x7fa69c154da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:55.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.431+0000 7fa6a4302700 1 --2- 172.21.15.146:0/3388430729 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa69c0cb790 0x7fa69c154da0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa694007c70 tx=0x7fa694009310 comp rx=0 tx=0).stop 2023-10-06T11:05:55.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.431+0000 7fca83a7c700 1 -- 172.21.15.146:0/3865189459 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fca60066fb0 msgr2=0x7fca60069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:55.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.431+0000 7fca83a7c700 1 --2- 172.21.15.146:0/3865189459 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fca60066fb0 0x7fca60069460 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fca7c0c4f20 tx=0x7fca78008040 comp rx=0 tx=0).stop 2023-10-06T11:05:55.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.431+0000 7fca83a7c700 1 -- 172.21.15.146:0/3865189459 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca7c0686d0 msgr2=0x7fca7c14d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:55.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.431+0000 7fca83a7c700 1 --2- 172.21.15.146:0/3865189459 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca7c0686d0 0x7fca7c14d830 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fca6c016000 tx=0x7fca6c017000 comp rx=0 tx=0).stop 2023-10-06T11:05:55.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.431+0000 7fca83a7c700 1 -- 172.21.15.146:0/3865189459 shutdown_connections 2023-10-06T11:05:55.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.431+0000 7fca83a7c700 1 --2- 172.21.15.146:0/3865189459 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fca60066fb0 0x7fca60069460 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.431+0000 7fca83a7c700 1 --2- 172.21.15.146:0/3865189459 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca7c0ca630 0x7fca7c0c2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.431+0000 7fca83a7c700 1 --2- 172.21.15.146:0/3865189459 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca7c0686d0 0x7fca7c14d830 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.431+0000 7fca83a7c700 1 --2- 172.21.15.146:0/3865189459 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca7c068aa0 0x7fca7c0c2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.431+0000 7fca83a7c700 1 -- 172.21.15.146:0/3865189459 >> 172.21.15.146:0/3865189459 conn(0x7fca7c0c9fa0 msgr2=0x7fca7c0cba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:55.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.431+0000 7fca83a7c700 1 -- 172.21.15.146:0/3865189459 shutdown_connections 2023-10-06T11:05:55.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.431+0000 7fca83a7c700 1 -- 172.21.15.146:0/3865189459 wait complete. 2023-10-06T11:05:55.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.432+0000 7fa6a4302700 1 -- 172.21.15.146:0/3388430729 shutdown_connections 2023-10-06T11:05:55.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.432+0000 7fa6a4302700 1 --2- 172.21.15.146:0/3388430729 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa680066f30 0x7fa6800693e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.432+0000 7fa6a4302700 1 --2- 172.21.15.146:0/3388430729 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa69c0cb790 0x7fa69c154da0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.432+0000 7fa6a4302700 1 --2- 172.21.15.146:0/3388430729 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa69c15b680 0x7fa69c0cb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.432+0000 7fa6a4302700 1 --2- 172.21.15.146:0/3388430729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa69c161250 0x7fa69c154860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.432+0000 7fa6a4302700 1 -- 172.21.15.146:0/3388430729 >> 172.21.15.146:0/3388430729 conn(0x7fa69c06a070 msgr2=0x7fa69c06da50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:55.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.436+0000 7fa6a4302700 1 -- 172.21.15.146:0/3388430729 shutdown_connections 2023-10-06T11:05:55.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.436+0000 7fa6a4302700 1 -- 172.21.15.146:0/3388430729 wait complete. 2023-10-06T11:05:55.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.440+0000 7f323257b700 1 -- 172.21.15.146:0/2981068512 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f322c04c380 con 0x7f322c0a59f0 2023-10-06T11:05:55.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.441+0000 7f3213fff700 1 -- 172.21.15.146:0/2981068512 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f32240283c0 con 0x7f322c0a59f0 2023-10-06T11:05:55.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.441+0000 7fbf2da8e700 1 -- 172.21.15.146:0/1289010099 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbf0c005830 con 0x7fbf2815d9e0 2023-10-06T11:05:55.443 INFO:teuthology.orchestra.run.smithi146.stdout:55834574854 2023-10-06T11:05:55.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.442+0000 7fbf1f7fe700 1 -- 172.21.15.146:0/1289010099 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbf18052760 con 0x7fbf2815d9e0 2023-10-06T11:05:55.445 INFO:teuthology.orchestra.run.smithi146.stdout:55834574855 2023-10-06T11:05:55.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.445+0000 7f323257b700 1 -- 172.21.15.146:0/2981068512 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3218066f30 msgr2=0x7f32180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:55.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.445+0000 7f323257b700 1 --2- 172.21.15.146:0/2981068512 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3218066f30 0x7f32180693e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3220009bb0 tx=0x7f32200091a0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.445+0000 7f323257b700 1 -- 172.21.15.146:0/2981068512 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f322c0a59f0 msgr2=0x7f322c0ae000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:55.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.445+0000 7f323257b700 1 --2- 172.21.15.146:0/2981068512 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f322c0a59f0 0x7f322c0ae000 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f322c069370 tx=0x7f3224018000 comp rx=0 tx=0).stop 2023-10-06T11:05:55.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.446+0000 7fbf2da8e700 1 -- 172.21.15.146:0/1289010099 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbf140670a0 msgr2=0x7fbf14069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:55.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.446+0000 7fbf2da8e700 1 --2- 172.21.15.146:0/1289010099 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbf140670a0 0x7fbf14069550 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbf10009e80 tx=0x7fbf10009250 comp rx=0 tx=0).stop 2023-10-06T11:05:55.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.446+0000 7fbf2da8e700 1 -- 172.21.15.146:0/1289010099 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf2815d9e0 msgr2=0x7fbf280aebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:55.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.446+0000 7fbf2da8e700 1 --2- 172.21.15.146:0/1289010099 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf2815d9e0 0x7fbf280aebf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbf18015000 tx=0x7fbf18016000 comp rx=0 tx=0).stop 2023-10-06T11:05:55.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.447+0000 7f323257b700 1 -- 172.21.15.146:0/2981068512 shutdown_connections 2023-10-06T11:05:55.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.447+0000 7f323257b700 1 --2- 172.21.15.146:0/2981068512 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3218066f30 0x7f32180693e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.447+0000 7f323257b700 1 --2- 172.21.15.146:0/2981068512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f322c15db80 0x7f322c142e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.447+0000 7f323257b700 1 --2- 172.21.15.146:0/2981068512 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f322c0a59f0 0x7f322c0ae000 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.447+0000 7f323257b700 1 --2- 172.21.15.146:0/2981068512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f322c0b1b00 0x7f322c158e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.447+0000 7f323257b700 1 -- 172.21.15.146:0/2981068512 >> 172.21.15.146:0/2981068512 conn(0x7f322c067f40 msgr2=0x7f322c0a5e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:55.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.447+0000 7fbf2da8e700 1 -- 172.21.15.146:0/1289010099 shutdown_connections 2023-10-06T11:05:55.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.447+0000 7fbf2da8e700 1 --2- 172.21.15.146:0/1289010099 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbf140670a0 0x7fbf14069550 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.447+0000 7fbf2da8e700 1 --2- 172.21.15.146:0/1289010099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbf28162550 0x7fbf2815c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.447+0000 7fbf2da8e700 1 --2- 172.21.15.146:0/1289010099 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf280cda10 0x7fbf28177610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.447+0000 7fbf2da8e700 1 --2- 172.21.15.146:0/1289010099 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf2815d9e0 0x7fbf280aebf0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.447+0000 7fbf2da8e700 1 -- 172.21.15.146:0/1289010099 >> 172.21.15.146:0/1289010099 conn(0x7fbf28069050 msgr2=0x7fbf2815ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:55.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.447+0000 7f323257b700 1 -- 172.21.15.146:0/2981068512 shutdown_connections 2023-10-06T11:05:55.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.447+0000 7fbf2da8e700 1 -- 172.21.15.146:0/1289010099 shutdown_connections 2023-10-06T11:05:55.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.447+0000 7fbf2da8e700 1 -- 172.21.15.146:0/1289010099 wait complete. 2023-10-06T11:05:55.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.447+0000 7f323257b700 1 -- 172.21.15.146:0/2981068512 wait complete. 2023-10-06T11:05:55.451 INFO:teuthology.orchestra.run.smithi146.stdout:55834574854 2023-10-06T11:05:55.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.447+0000 7fadba979700 1 -- 172.21.15.146:0/3767132753 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fad94005830 con 0x7fadb40686d0 2023-10-06T11:05:55.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.447+0000 7fad9bfff700 1 -- 172.21.15.146:0/3767132753 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fadac053120 con 0x7fadb40686d0 2023-10-06T11:05:55.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.450+0000 7f11aef38700 1 -- 172.21.15.146:0/3475732692 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f11a8152e90 con 0x7f11a806a4f0 2023-10-06T11:05:55.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.451+0000 7fadba979700 1 -- 172.21.15.146:0/3767132753 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fada0067000 msgr2=0x7fada00694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:55.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.451+0000 7fadba979700 1 --2- 172.21.15.146:0/3767132753 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fada0067000 0x7fada00694b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fada8006fd0 tx=0x7fada8006db0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.451+0000 7fadba979700 1 -- 172.21.15.146:0/3767132753 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fadb40686d0 msgr2=0x7fadb41708d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:55.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.451+0000 7fadba979700 1 --2- 172.21.15.146:0/3767132753 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fadb40686d0 0x7fadb41708d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fadac00b6c0 tx=0x7fadac017000 comp rx=0 tx=0).stop 2023-10-06T11:05:55.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.451+0000 7fadba979700 1 -- 172.21.15.146:0/3767132753 shutdown_connections 2023-10-06T11:05:55.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.451+0000 7fadba979700 1 --2- 172.21.15.146:0/3767132753 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fada0067000 0x7fada00694b0 secure :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fada8006fd0 tx=0x7fada8006db0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.451+0000 7fadba979700 1 --2- 172.21.15.146:0/3767132753 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fadb40ca630 0x7fadb4176a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.451+0000 7fadba979700 1 --2- 172.21.15.146:0/3767132753 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fadb40686d0 0x7fadb41708d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.451+0000 7fadba979700 1 --2- 172.21.15.146:0/3767132753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fadb4068aa0 0x7fadb4177c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.451+0000 7fadba979700 1 -- 172.21.15.146:0/3767132753 >> 172.21.15.146:0/3767132753 conn(0x7fadb40c9fa0 msgr2=0x7fadb4159880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:55.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.452+0000 7f119dffb700 1 -- 172.21.15.146:0/3475732692 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1198017020 con 0x7f11a806a4f0 2023-10-06T11:05:55.455 INFO:teuthology.orchestra.run.smithi146.stdout:55834574856 2023-10-06T11:05:55.458 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2023-10-06T11:05:55.458 DEBUG:teuthology.parallel:result is None 2023-10-06T11:05:55.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.458+0000 7fadba979700 1 -- 172.21.15.146:0/3767132753 shutdown_connections 2023-10-06T11:05:55.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.458+0000 7f11aef38700 1 -- 172.21.15.146:0/3475732692 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f118c066f30 msgr2=0x7f118c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:55.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.458+0000 7f11aef38700 1 --2- 172.21.15.146:0/3475732692 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f118c066f30 0x7f118c0693e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f11a81507d0 tx=0x7f11a4013040 comp rx=0 tx=0).stop 2023-10-06T11:05:55.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.458+0000 7f11aef38700 1 -- 172.21.15.146:0/3475732692 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11a806a4f0 msgr2=0x7f11a815c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:55.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.458+0000 7f11aef38700 1 --2- 172.21.15.146:0/3475732692 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11a806a4f0 0x7f11a815c1c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f119800c5e0 tx=0x7f11980049e0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.458+0000 7fadba979700 1 -- 172.21.15.146:0/3767132753 wait complete. 2023-10-06T11:05:55.461 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2023-10-06T11:05:55.461 DEBUG:teuthology.parallel:result is None 2023-10-06T11:05:55.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.461+0000 7f11aef38700 1 -- 172.21.15.146:0/3475732692 shutdown_connections 2023-10-06T11:05:55.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.461+0000 7f11aef38700 1 --2- 172.21.15.146:0/3475732692 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f118c066f30 0x7f118c0693e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.461+0000 7f11aef38700 1 --2- 172.21.15.146:0/3475732692 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11a80b1700 0x7f11a8153040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.461+0000 7f11aef38700 1 --2- 172.21.15.146:0/3475732692 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11a806a4f0 0x7f11a815c1c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.461+0000 7f11aef38700 1 --2- 172.21.15.146:0/3475732692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11a80ad3a0 0x7f11a8149c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.461+0000 7f11aef38700 1 -- 172.21.15.146:0/3475732692 >> 172.21.15.146:0/3475732692 conn(0x7f11a8067f00 msgr2=0x7f11a815d060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:55.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.461+0000 7f11aef38700 1 -- 172.21.15.146:0/3475732692 shutdown_connections 2023-10-06T11:05:55.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.461+0000 7f11aef38700 1 -- 172.21.15.146:0/3475732692 wait complete. 2023-10-06T11:05:55.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.465+0000 7f8346efe700 1 -- 172.21.15.146:0/2869651427 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f834004c380 con 0x7f83400b29f0 2023-10-06T11:05:55.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.466+0000 7f833cff9700 1 -- 172.21.15.146:0/2869651427 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8340160110 con 0x7f83400b29f0 2023-10-06T11:05:55.468 INFO:teuthology.orchestra.run.smithi146.stdout:55834574856 2023-10-06T11:05:55.468 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2023-10-06T11:05:55.469 DEBUG:teuthology.parallel:result is None 2023-10-06T11:05:55.471 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2023-10-06T11:05:55.472 DEBUG:teuthology.parallel:result is None 2023-10-06T11:05:55.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.470+0000 7f8346efe700 1 -- 172.21.15.146:0/2869651427 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f83280671a0 msgr2=0x7f8328069650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:55.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.470+0000 7f8346efe700 1 --2- 172.21.15.146:0/2869651427 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f83280671a0 0x7f8328069650 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f83300096a0 tx=0x7f8330006bc0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.470+0000 7f8346efe700 1 -- 172.21.15.146:0/2869651427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83400b29f0 msgr2=0x7f83401603f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:55.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.470+0000 7f8346efe700 1 --2- 172.21.15.146:0/2869651427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83400b29f0 0x7f83401603f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f833400c590 tx=0x7f833400c950 comp rx=0 tx=0).stop 2023-10-06T11:05:55.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.471+0000 7f8346efe700 1 -- 172.21.15.146:0/2869651427 shutdown_connections 2023-10-06T11:05:55.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.471+0000 7f8346efe700 1 --2- 172.21.15.146:0/2869651427 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f83280671a0 0x7f8328069650 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.471+0000 7f8346efe700 1 --2- 172.21.15.146:0/2869651427 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83401578e0 0x7f8340177140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.471+0000 7f8346efe700 1 --2- 172.21.15.146:0/2869651427 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f83400b2620 0x7f83400b0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.471+0000 7f8346efe700 1 --2- 172.21.15.146:0/2869651427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83400b29f0 0x7f83401603f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:55.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.471+0000 7f8346efe700 1 -- 172.21.15.146:0/2869651427 >> 172.21.15.146:0/2869651427 conn(0x7f8340068580 msgr2=0x7f83401560d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:55.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.471+0000 7f8346efe700 1 -- 172.21.15.146:0/2869651427 shutdown_connections 2023-10-06T11:05:55.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:55.471+0000 7f8346efe700 1 -- 172.21.15.146:0/2869651427 wait complete. 2023-10-06T11:05:55.480 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.5 2023-10-06T11:05:55.481 DEBUG:teuthology.parallel:result is None 2023-10-06T11:05:55.481 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2023-10-06T11:05:55.481 DEBUG:teuthology.parallel:result is None 2023-10-06T11:05:55.487 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.6 2023-10-06T11:05:55.487 DEBUG:teuthology.parallel:result is None 2023-10-06T11:05:56.430 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T11:05:56.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.545+0000 7f8d6272b700 1 Processor -- start 2023-10-06T11:05:56.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.545+0000 7f8d6272b700 1 -- start start 2023-10-06T11:05:56.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.546+0000 7f8d6272b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d5c0b3cf0 0x7f8d5c0ce860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:56.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.546+0000 7f8d6272b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8d5c0b2430 0x7f8d5c0b5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:56.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.546+0000 7f8d6272b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d5c0b4ec0 con 0x7f8d5c0b2060 2023-10-06T11:05:56.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.546+0000 7f8d6272b700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d5c0cd470 con 0x7f8d5c0b2430 2023-10-06T11:05:56.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.546+0000 7f8d6272b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5c0b42b0 con 0x7f8d5c0b3cf0 2023-10-06T11:05:56.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.546+0000 7f8d61729700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8d5c0b2060 0x7f8d5c0ccd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38802/0 (socket says 172.21.15.146:38802) 2023-10-06T11:05:56.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.546+0000 7f8d61729700 1 -- 172.21.15.146:0/548630130 learned_addr learned my addr 172.21.15.146:0/548630130 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:05:56.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.546+0000 7f8d53fff700 1 -- 172.21.15.146:0/548630130 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3876543444 0 0) 0x7f8d5c0b4ec0 con 0x7f8d5c0b2060 2023-10-06T11:05:56.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.546+0000 7f8d53fff700 1 -- 172.21.15.146:0/548630130 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d48003570 con 0x7f8d5c0b2060 2023-10-06T11:05:56.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.546+0000 7f8d61f2a700 1 --2- 172.21.15.146:0/548630130 >> v2:172.21.15.151:3300/0 conn(0x7f8d5c0b2430 0x7f8d5c0b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:56.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.546+0000 7f8d60f28700 1 --2- 172.21.15.146:0/548630130 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d5c0b3cf0 0x7f8d5c0ce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:56.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.547+0000 7f8d53fff700 1 -- 172.21.15.146:0/548630130 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1537063895 0 0) 0x7f8d48003570 con 0x7f8d5c0b2060 2023-10-06T11:05:56.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.547+0000 7f8d53fff700 1 -- 172.21.15.146:0/548630130 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d5c0b3cf0 msgr2=0x7f8d5c0ce860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:56.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.547+0000 7f8d53fff700 1 --2- 172.21.15.146:0/548630130 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d5c0b3cf0 0x7f8d5c0ce860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:56.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.547+0000 7f8d53fff700 1 -- 172.21.15.146:0/548630130 >> v2:172.21.15.151:3300/0 conn(0x7f8d5c0b2430 msgr2=0x7f8d5c0b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:56.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.547+0000 7f8d53fff700 1 --2- 172.21.15.146:0/548630130 >> v2:172.21.15.151:3300/0 conn(0x7f8d5c0b2430 0x7f8d5c0b5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:56.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.547+0000 7f8d53fff700 1 -- 172.21.15.146:0/548630130 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d5c0b4590 con 0x7f8d5c0b2060 2023-10-06T11:05:56.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.547+0000 7f8d53fff700 1 -- 172.21.15.146:0/548630130 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f8d580017f0 con 0x7f8d5c0b2060 2023-10-06T11:05:56.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.547+0000 7f8d53fff700 1 -- 172.21.15.146:0/548630130 >> v1:172.21.15.146:6789/0 conn(0x7f8d5c0b2060 legacy=0x7f8d5c0ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:56.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.547+0000 7f8d53fff700 1 --2- 172.21.15.146:0/548630130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d48003ae0 0x7f8d48003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:56.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.547+0000 7f8d53fff700 1 --2- 172.21.15.146:0/548630130 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d48004810 0x7f8d48004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:56.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.547+0000 7f8d53fff700 1 --2- 172.21.15.146:0/548630130 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d5c0b3cf0 0x7f8d480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:56.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.547+0000 7f8d53fff700 1 -- 172.21.15.146:0/548630130 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5c0cd470 con 0x7f8d48003ae0 2023-10-06T11:05:56.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.547+0000 7f8d53fff700 1 -- 172.21.15.146:0/548630130 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5c0b42b0 con 0x7f8d48004810 2023-10-06T11:05:56.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.547+0000 7f8d53fff700 1 -- 172.21.15.146:0/548630130 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4800bb10 con 0x7f8d5c0b3cf0 2023-10-06T11:05:56.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.547+0000 7f8d61729700 1 --2- 172.21.15.146:0/548630130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d48003ae0 0x7f8d48003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:56.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.547+0000 7f8d60f28700 1 --2- 172.21.15.146:0/548630130 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d48004810 0x7f8d48004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:56.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.547+0000 7f8d61f2a700 1 --2- 172.21.15.146:0/548630130 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d5c0b3cf0 0x7f8d480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:56.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.547+0000 7f8d61729700 1 -- 172.21.15.146:0/548630130 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d5c0b3cf0 msgr2=0x7f8d480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:56.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.547+0000 7f8d61729700 1 --2- 172.21.15.146:0/548630130 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d5c0b3cf0 0x7f8d480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:56.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.547+0000 7f8d61729700 1 -- 172.21.15.146:0/548630130 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d48004810 msgr2=0x7f8d48004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:56.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.547+0000 7f8d61729700 1 --2- 172.21.15.146:0/548630130 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d48004810 0x7f8d48004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:56.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.547+0000 7f8d61729700 1 -- 172.21.15.146:0/548630130 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d48003570 con 0x7f8d48003ae0 2023-10-06T11:05:56.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.547+0000 7f8d61729700 1 --2- 172.21.15.146:0/548630130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d48003ae0 0x7f8d48003ef0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8d5800a8a0 tx=0x7f8d58002140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc663eddc7bd9b35 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:56.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.547+0000 7f8d53fff700 1 -- 172.21.15.146:0/548630130 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d580070f0 con 0x7f8d48003ae0 2023-10-06T11:05:56.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.547+0000 7f8d53fff700 1 -- 172.21.15.146:0/548630130 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d58007270 con 0x7f8d48003ae0 2023-10-06T11:05:56.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.547+0000 7f8d53fff700 1 -- 172.21.15.146:0/548630130 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d58007630 con 0x7f8d48003ae0 2023-10-06T11:05:56.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.548+0000 7f8d6272b700 1 -- 172.21.15.146:0/548630130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d48003ae0 msgr2=0x7f8d48003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:56.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.548+0000 7f8d6272b700 1 --2- 172.21.15.146:0/548630130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d48003ae0 0x7f8d48003ef0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8d5800a8a0 tx=0x7f8d58002140 comp rx=0 tx=0).stop 2023-10-06T11:05:56.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.548+0000 7f8d61f2a700 1 -- 172.21.15.146:0/548630130 reap_dead start 2023-10-06T11:05:56.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.548+0000 7f8d6272b700 1 -- 172.21.15.146:0/548630130 shutdown_connections 2023-10-06T11:05:56.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.548+0000 7f8d6272b700 1 -- 172.21.15.146:0/548630130 >> 172.21.15.146:0/548630130 conn(0x7f8d5c06eba0 msgr2=0x7f8d5c06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:56.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.548+0000 7f8d6272b700 1 -- 172.21.15.146:0/548630130 shutdown_connections 2023-10-06T11:05:56.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.548+0000 7f8d6272b700 1 -- 172.21.15.146:0/548630130 wait complete. 2023-10-06T11:05:56.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.549+0000 7f8d6272b700 1 Processor -- start 2023-10-06T11:05:56.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.549+0000 7f8d6272b700 1 -- start start 2023-10-06T11:05:56.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.550+0000 7f8d6272b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d5c16cca0 0x7f8d5c15dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:56.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.550+0000 7f8d6272b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d5c16d070 0x7f8d5c15e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:56.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.550+0000 7f8d6272b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d5c15a7a0 0x7f8d5c15ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:56.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.550+0000 7f8d6272b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5c0c5590 con 0x7f8d5c16d070 2023-10-06T11:05:56.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.550+0000 7f8d6272b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5c15b180 con 0x7f8d5c15a7a0 2023-10-06T11:05:56.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.550+0000 7f8d6272b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5c15b3b0 con 0x7f8d5c16cca0 2023-10-06T11:05:56.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.550+0000 7f8d60f28700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d5c16d070 0x7f8d5c15e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:56.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.550+0000 7f8d60f28700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d5c16d070 0x7f8d5c15e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40044/0 (socket says 172.21.15.146:40044) 2023-10-06T11:05:56.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.550+0000 7f8d60f28700 1 -- 172.21.15.146:0/1360092279 learned_addr learned my addr 172.21.15.146:0/1360092279 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:56.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.550+0000 7f8d61f2a700 1 --2- 172.21.15.146:0/1360092279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d5c15a7a0 0x7f8d5c15ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:56.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.550+0000 7f8d61729700 1 --2- 172.21.15.146:0/1360092279 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d5c16cca0 0x7f8d5c15dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:56.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.550+0000 7f8d60f28700 1 -- 172.21.15.146:0/1360092279 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d5c16cca0 msgr2=0x7f8d5c15dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:56.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.550+0000 7f8d60f28700 1 --2- 172.21.15.146:0/1360092279 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d5c16cca0 0x7f8d5c15dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:56.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.550+0000 7f8d60f28700 1 -- 172.21.15.146:0/1360092279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d5c15a7a0 msgr2=0x7f8d5c15ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:56.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.550+0000 7f8d60f28700 1 --2- 172.21.15.146:0/1360092279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d5c15a7a0 0x7f8d5c15ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:56.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.550+0000 7f8d60f28700 1 -- 172.21.15.146:0/1360092279 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d5c15b690 con 0x7f8d5c16d070 2023-10-06T11:05:56.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.550+0000 7f8d61f2a700 1 --2- 172.21.15.146:0/1360092279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d5c15a7a0 0x7f8d5c15ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:05:56.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.550+0000 7f8d60f28700 1 --2- 172.21.15.146:0/1360092279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d5c16d070 0x7f8d5c15e3e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c011d40 tx=0x7f8d4c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:56.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.550+0000 7f8d517fa700 1 -- 172.21.15.146:0/1360092279 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c00fac0 con 0x7f8d5c16d070 2023-10-06T11:05:56.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.551+0000 7f8d517fa700 1 -- 172.21.15.146:0/1360092279 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4c00fc20 con 0x7f8d5c16d070 2023-10-06T11:05:56.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.551+0000 7f8d6272b700 1 -- 172.21.15.146:0/1360092279 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d5c15b970 con 0x7f8d5c16d070 2023-10-06T11:05:56.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.551+0000 7f8d517fa700 1 -- 172.21.15.146:0/1360092279 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c014440 con 0x7f8d5c16d070 2023-10-06T11:05:56.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.551+0000 7f8d6272b700 1 -- 172.21.15.146:0/1360092279 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d5c15bf30 con 0x7f8d5c16d070 2023-10-06T11:05:56.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.551+0000 7f8d6272b700 1 -- 172.21.15.146:0/1360092279 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d5c04c380 con 0x7f8d5c16d070 2023-10-06T11:05:56.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.552+0000 7f8d517fa700 1 -- 172.21.15.146:0/1360092279 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8d4c014870 con 0x7f8d5c16d070 2023-10-06T11:05:56.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.552+0000 7f8d517fa700 1 --2- 172.21.15.146:0/1360092279 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8d40066f30 0x7f8d400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:56.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.552+0000 7f8d517fa700 1 -- 172.21.15.146:0/1360092279 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8d4c018030 con 0x7f8d5c16d070 2023-10-06T11:05:56.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.552+0000 7f8d61729700 1 --2- 172.21.15.146:0/1360092279 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8d40066f30 0x7f8d400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:56.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.553+0000 7f8d61729700 1 --2- 172.21.15.146:0/1360092279 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8d40066f30 0x7f8d400693e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c0d13f0 tx=0x7f8d58016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:56.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.557+0000 7f8d517fa700 1 -- 172.21.15.146:0/1360092279 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8d4c052350 con 0x7f8d5c16d070 2023-10-06T11:05:56.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.740+0000 7f8d6272b700 1 -- 172.21.15.146:0/1360092279 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8d5c0b4870 con 0x7f8d5c16d070 2023-10-06T11:05:56.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.741+0000 7f8d517fa700 1 -- 172.21.15.146:0/1360092279 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8d4c055970 con 0x7f8d5c16d070 2023-10-06T11:05:56.743 INFO:teuthology.orchestra.run.smithi146.stdout:55834574855 2023-10-06T11:05:56.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.743+0000 7f8d6272b700 1 -- 172.21.15.146:0/1360092279 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8d40066f30 msgr2=0x7f8d400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:56.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.743+0000 7f8d6272b700 1 --2- 172.21.15.146:0/1360092279 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8d40066f30 0x7f8d400693e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c0d13f0 tx=0x7f8d58016000 comp rx=0 tx=0).stop 2023-10-06T11:05:56.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.743+0000 7f8d6272b700 1 -- 172.21.15.146:0/1360092279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d5c16d070 msgr2=0x7f8d5c15e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:56.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.743+0000 7f8d6272b700 1 --2- 172.21.15.146:0/1360092279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d5c16d070 0x7f8d5c15e3e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c011d40 tx=0x7f8d4c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:05:56.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.743+0000 7f8d6272b700 1 -- 172.21.15.146:0/1360092279 shutdown_connections 2023-10-06T11:05:56.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.743+0000 7f8d6272b700 1 --2- 172.21.15.146:0/1360092279 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8d40066f30 0x7f8d400693e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:56.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.743+0000 7f8d6272b700 1 --2- 172.21.15.146:0/1360092279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d5c15a7a0 0x7f8d5c15ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:56.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.743+0000 7f8d6272b700 1 --2- 172.21.15.146:0/1360092279 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d5c16cca0 0x7f8d5c15dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:56.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.743+0000 7f8d6272b700 1 --2- 172.21.15.146:0/1360092279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d5c16d070 0x7f8d5c15e3e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:56.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.743+0000 7f8d6272b700 1 -- 172.21.15.146:0/1360092279 >> 172.21.15.146:0/1360092279 conn(0x7f8d5c06eba0 msgr2=0x7f8d5c0cf0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:56.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.743+0000 7f8d6272b700 1 -- 172.21.15.146:0/1360092279 shutdown_connections 2023-10-06T11:05:56.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.743+0000 7f8d6272b700 1 -- 172.21.15.146:0/1360092279 wait complete. 2023-10-06T11:05:56.756 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2023-10-06T11:05:56.757 DEBUG:teuthology.parallel:result is None 2023-10-06T11:05:56.757 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T11:05:56.757 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:05:56.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.869+0000 7fbdcea91700 1 Processor -- start 2023-10-06T11:05:56.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.869+0000 7fbdcea91700 1 -- start start 2023-10-06T11:05:56.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.870+0000 7fbdcea91700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbdc8068ba0 0x7fbdc815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:56.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.870+0000 7fbdcea91700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdc815ac30 con 0x7fbdc8153e80 2023-10-06T11:05:56.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.870+0000 7fbdcea91700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdc80b4510 con 0x7fbdc8153ab0 2023-10-06T11:05:56.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.870+0000 7fbdcea91700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdc80b6530 con 0x7fbdc8068ba0 2023-10-06T11:05:56.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.870+0000 7fbdcd02e700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fbdc8153e80 0x7fbdc80b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38812/0 (socket says 172.21.15.146:38812) 2023-10-06T11:05:56.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.870+0000 7fbdcd02e700 1 -- 172.21.15.146:0/2477551448 learned_addr learned my addr 172.21.15.146:0/2477551448 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:05:56.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.870+0000 7fbdbffff700 1 --2- 172.21.15.146:0/2477551448 >> v2:172.21.15.151:3300/0 conn(0x7fbdc8068ba0 0x7fbdc815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:56.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.871+0000 7fbdbf7fe700 1 -- 172.21.15.146:0/2477551448 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1843904228 0 0) 0x7fbdc0001490 con 0x7fbdc8153e80 2023-10-06T11:05:56.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.871+0000 7fbdbf7fe700 1 -- 172.21.15.146:0/2477551448 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbdb0003570 con 0x7fbdc8153e80 2023-10-06T11:05:56.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.871+0000 7fbdbffff700 1 -- 172.21.15.146:0/2477551448 >> v1:172.21.15.151:6789/0 conn(0x7fbdc8153ab0 legacy=0x7fbdc8068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:56.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.871+0000 7fbdbffff700 1 -- 172.21.15.146:0/2477551448 >> v1:172.21.15.146:6789/0 conn(0x7fbdc8153e80 legacy=0x7fbdc80b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:56.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.871+0000 7fbdbffff700 1 -- 172.21.15.146:0/2477551448 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc80b5c50 con 0x7fbdc8068ba0 2023-10-06T11:05:56.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.871+0000 7fbdbffff700 1 --2- 172.21.15.146:0/2477551448 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbdc8068ba0 0x7fbdc815a6f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbdb80098e0 tx=0x7fbdb80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a97a747727014a6e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:56.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.871+0000 7fbdbf7fe700 1 -- 172.21.15.146:0/2477551448 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb800b640 con 0x7fbdc8068ba0 2023-10-06T11:05:56.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.871+0000 7fbdbf7fe700 1 -- 172.21.15.146:0/2477551448 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb800b7a0 con 0x7fbdc8068ba0 2023-10-06T11:05:56.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.871+0000 7fbdbf7fe700 1 -- 172.21.15.146:0/2477551448 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb800bb40 con 0x7fbdc8068ba0 2023-10-06T11:05:56.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.872+0000 7fbdcea91700 1 -- 172.21.15.146:0/2477551448 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbdc8068ba0 msgr2=0x7fbdc815a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:56.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.872+0000 7fbdcea91700 1 --2- 172.21.15.146:0/2477551448 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbdc8068ba0 0x7fbdc815a6f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbdb80098e0 tx=0x7fbdb80091a0 comp rx=0 tx=0).stop 2023-10-06T11:05:56.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.872+0000 7fbdcea91700 1 -- 172.21.15.146:0/2477551448 shutdown_connections 2023-10-06T11:05:56.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.872+0000 7fbdcea91700 1 --2- 172.21.15.146:0/2477551448 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbdc8068ba0 0x7fbdc815a6f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:56.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.872+0000 7fbdcea91700 1 -- 172.21.15.146:0/2477551448 >> 172.21.15.146:0/2477551448 conn(0x7fbdc806eba0 msgr2=0x7fbdc806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:56.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.872+0000 7fbdcea91700 1 -- 172.21.15.146:0/2477551448 shutdown_connections 2023-10-06T11:05:56.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.872+0000 7fbdcea91700 1 -- 172.21.15.146:0/2477551448 wait complete. 2023-10-06T11:05:56.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.873+0000 7fbdcea91700 1 Processor -- start 2023-10-06T11:05:56.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.873+0000 7fbdcea91700 1 -- start start 2023-10-06T11:05:56.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.874+0000 7fbdcea91700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbdc8068ba0 0x7fbdc8157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:56.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.874+0000 7fbdcea91700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbdc8153ab0 0x7fbdc8154530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:56.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.874+0000 7fbdcea91700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbdc8153e80 0x7fbdc8151790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:56.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.874+0000 7fbdcea91700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc806ae80 con 0x7fbdc8153e80 2023-10-06T11:05:56.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.874+0000 7fbdcea91700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc8154a70 con 0x7fbdc8153ab0 2023-10-06T11:05:56.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.874+0000 7fbdcea91700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc8157f70 con 0x7fbdc8068ba0 2023-10-06T11:05:56.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.874+0000 7fbdcd02e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbdc8153e80 0x7fbdc8151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:56.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.874+0000 7fbdcd02e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbdc8153e80 0x7fbdc8151790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40058/0 (socket says 172.21.15.146:40058) 2023-10-06T11:05:56.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.874+0000 7fbdcd02e700 1 -- 172.21.15.146:0/1260957682 learned_addr learned my addr 172.21.15.146:0/1260957682 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:56.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.874+0000 7fbdbffff700 1 --2- 172.21.15.146:0/1260957682 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbdc8153ab0 0x7fbdc8154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:56.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.874+0000 7fbdcc82d700 1 --2- 172.21.15.146:0/1260957682 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbdc8068ba0 0x7fbdc8157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:56.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.874+0000 7fbdcd02e700 1 -- 172.21.15.146:0/1260957682 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbdc8068ba0 msgr2=0x7fbdc8157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:56.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.874+0000 7fbdcd02e700 1 --2- 172.21.15.146:0/1260957682 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbdc8068ba0 0x7fbdc8157980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:56.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.874+0000 7fbdcd02e700 1 -- 172.21.15.146:0/1260957682 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbdc8153ab0 msgr2=0x7fbdc8154530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:56.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.874+0000 7fbdcd02e700 1 --2- 172.21.15.146:0/1260957682 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbdc8153ab0 0x7fbdc8154530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:56.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.874+0000 7fbdcd02e700 1 -- 172.21.15.146:0/1260957682 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb8009420 con 0x7fbdc8153e80 2023-10-06T11:05:56.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.874+0000 7fbdcd02e700 1 --2- 172.21.15.146:0/1260957682 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbdc8153e80 0x7fbdc8151790 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbdc000cd00 tx=0x7fbdc0001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:56.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.874+0000 7fbdbcff9700 1 -- 172.21.15.146:0/1260957682 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc000ab70 con 0x7fbdc8153e80 2023-10-06T11:05:56.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.874+0000 7fbdbcff9700 1 -- 172.21.15.146:0/1260957682 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdc000acd0 con 0x7fbdc8153e80 2023-10-06T11:05:56.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.874+0000 7fbdcea91700 1 -- 172.21.15.146:0/1260957682 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdc8158250 con 0x7fbdc8153e80 2023-10-06T11:05:56.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.874+0000 7fbdbcff9700 1 -- 172.21.15.146:0/1260957682 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdc0007300 con 0x7fbdc8153e80 2023-10-06T11:05:56.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.874+0000 7fbdcea91700 1 -- 172.21.15.146:0/1260957682 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdc806ab10 con 0x7fbdc8153e80 2023-10-06T11:05:56.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.875+0000 7fbdcea91700 1 -- 172.21.15.146:0/1260957682 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdc806aff0 con 0x7fbdc8153e80 2023-10-06T11:05:56.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.876+0000 7fbdbcff9700 1 -- 172.21.15.146:0/1260957682 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbdc00076f0 con 0x7fbdc8153e80 2023-10-06T11:05:56.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.876+0000 7fbdbcff9700 1 --2- 172.21.15.146:0/1260957682 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbdb4066f30 0x7fbdb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:56.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.876+0000 7fbdcc82d700 1 --2- 172.21.15.146:0/1260957682 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbdb4066f30 0x7fbdb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:56.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.876+0000 7fbdbcff9700 1 -- 172.21.15.146:0/1260957682 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbdc0084a40 con 0x7fbdc8153e80 2023-10-06T11:05:56.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.876+0000 7fbdcc82d700 1 --2- 172.21.15.146:0/1260957682 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbdb4066f30 0x7fbdb40693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbdc40038a0 tx=0x7fbdc4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:56.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:56.880+0000 7fbdbcff9700 1 -- 172.21.15.146:0/1260957682 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbdc0086e60 con 0x7fbdc8153e80 2023-10-06T11:05:57.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.061+0000 7fbdcea91700 1 -- 172.21.15.146:0/1260957682 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbdc815ac30 con 0x7fbdb4066f30 2023-10-06T11:05:57.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.068+0000 7fbdbcff9700 1 -- 172.21.15.146:0/1260957682 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286730 (secure 0 0 0) 0x7fbdc815ac30 con 0x7fbdb4066f30 2023-10-06T11:05:57.073 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:05:57.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.072+0000 7fbdcea91700 1 -- 172.21.15.146:0/1260957682 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbdb4066f30 msgr2=0x7fbdb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:57.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.072+0000 7fbdcea91700 1 --2- 172.21.15.146:0/1260957682 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbdb4066f30 0x7fbdb40693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbdc40038a0 tx=0x7fbdc4009040 comp rx=0 tx=0).stop 2023-10-06T11:05:57.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.072+0000 7fbdcea91700 1 -- 172.21.15.146:0/1260957682 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbdc8153e80 msgr2=0x7fbdc8151790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:57.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.072+0000 7fbdcea91700 1 --2- 172.21.15.146:0/1260957682 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbdc8153e80 0x7fbdc8151790 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbdc000cd00 tx=0x7fbdc0001ad0 comp rx=0 tx=0).stop 2023-10-06T11:05:57.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.072+0000 7fbdcea91700 1 -- 172.21.15.146:0/1260957682 shutdown_connections 2023-10-06T11:05:57.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.072+0000 7fbdcea91700 1 --2- 172.21.15.146:0/1260957682 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbdb4066f30 0x7fbdb40693e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:57.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.072+0000 7fbdcea91700 1 --2- 172.21.15.146:0/1260957682 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbdc8153e80 0x7fbdc8151790 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:57.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.072+0000 7fbdcea91700 1 --2- 172.21.15.146:0/1260957682 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbdc8068ba0 0x7fbdc8157980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:57.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.072+0000 7fbdcea91700 1 --2- 172.21.15.146:0/1260957682 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbdc8153ab0 0x7fbdc8154530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:57.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.072+0000 7fbdcea91700 1 -- 172.21.15.146:0/1260957682 >> 172.21.15.146:0/1260957682 conn(0x7fbdc806eba0 msgr2=0x7fbdc80b49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:57.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.072+0000 7fbdcea91700 1 -- 172.21.15.146:0/1260957682 shutdown_connections 2023-10-06T11:05:57.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.072+0000 7fbdcea91700 1 -- 172.21.15.146:0/1260957682 wait complete. 2023-10-06T11:05:57.079 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:05:57.085 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-06T11:05:55.144108+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381112,"kb_used_data":2808,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593608,"statfs":{"total":773094113280,"available":770655854592,"internally_reserved":0,"allocated":2875392,"data_stored":1773408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.015724"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.376223+0000","last_change":"2023-10-06T11:05:44.374095+0000","last_active":"2023-10-06T11:05:44.376223+0000","last_peered":"2023-10-06T11:05:44.376223+0000","last_clean":"2023-10-06T11:05:44.376223+0000","last_became_active":"2023-10-06T11:05:44.373839+0000","last_became_peered":"2023-10-06T11:05:44.373839+0000","last_unstale":"2023-10-06T11:05:44.376223+0000","last_undegraded":"2023-10-06T11:05:44.376223+0000","last_fullsized":"2023-10-06T11:05:44.376223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:25.910038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380398+0000","last_change":"2023-10-06T11:05:44.372580+0000","last_active":"2023-10-06T11:05:44.380398+0000","last_peered":"2023-10-06T11:05:44.380398+0000","last_clean":"2023-10-06T11:05:44.380398+0000","last_became_active":"2023-10-06T11:05:44.372338+0000","last_became_peered":"2023-10-06T11:05:44.372338+0000","last_unstale":"2023-10-06T11:05:44.380398+0000","last_undegraded":"2023-10-06T11:05:44.380398+0000","last_fullsized":"2023-10-06T11:05:44.380398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:49:53.929590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375679+0000","last_change":"2023-10-06T11:05:44.370665+0000","last_active":"2023-10-06T11:05:44.375679+0000","last_peered":"2023-10-06T11:05:44.375679+0000","last_clean":"2023-10-06T11:05:44.375679+0000","last_became_active":"2023-10-06T11:05:44.370393+0000","last_became_peered":"2023-10-06T11:05:44.370393+0000","last_unstale":"2023-10-06T11:05:44.375679+0000","last_undegraded":"2023-10-06T11:05:44.375679+0000","last_fullsized":"2023-10-06T11:05:44.375679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:11:45.592433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377408+0000","last_change":"2023-10-06T11:05:44.371604+0000","last_active":"2023-10-06T11:05:44.377408+0000","last_peered":"2023-10-06T11:05:44.377408+0000","last_clean":"2023-10-06T11:05:44.377408+0000","last_became_active":"2023-10-06T11:05:44.371305+0000","last_became_peered":"2023-10-06T11:05:44.371305+0000","last_unstale":"2023-10-06T11:05:44.377408+0000","last_undegraded":"2023-10-06T11:05:44.377408+0000","last_fullsized":"2023-10-06T11:05:44.377408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:37.914270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.370764+0000","last_change":"2023-10-06T11:05:44.368424+0000","last_active":"2023-10-06T11:05:44.370764+0000","last_peered":"2023-10-06T11:05:44.370764+0000","last_clean":"2023-10-06T11:05:44.370764+0000","last_became_active":"2023-10-06T11:05:44.368174+0000","last_became_peered":"2023-10-06T11:05:44.368174+0000","last_unstale":"2023-10-06T11:05:44.370764+0000","last_undegraded":"2023-10-06T11:05:44.370764+0000","last_fullsized":"2023-10-06T11:05:44.370764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:48.500150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375623+0000","last_change":"2023-10-06T11:05:44.369384+0000","last_active":"2023-10-06T11:05:44.375623+0000","last_peered":"2023-10-06T11:05:44.375623+0000","last_clean":"2023-10-06T11:05:44.375623+0000","last_became_active":"2023-10-06T11:05:44.369114+0000","last_became_peered":"2023-10-06T11:05:44.369114+0000","last_unstale":"2023-10-06T11:05:44.375623+0000","last_undegraded":"2023-10-06T11:05:44.375623+0000","last_fullsized":"2023-10-06T11:05:44.375623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:11:02.117432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.381050+0000","last_change":"2023-10-06T11:05:44.376045+0000","last_active":"2023-10-06T11:05:44.381050+0000","last_peered":"2023-10-06T11:05:44.381050+0000","last_clean":"2023-10-06T11:05:44.381050+0000","last_became_active":"2023-10-06T11:05:44.374697+0000","last_became_peered":"2023-10-06T11:05:44.374697+0000","last_unstale":"2023-10-06T11:05:44.381050+0000","last_undegraded":"2023-10-06T11:05:44.381050+0000","last_fullsized":"2023-10-06T11:05:44.381050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:30:10.233024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377816+0000","last_change":"2023-10-06T11:05:44.370424+0000","last_active":"2023-10-06T11:05:44.377816+0000","last_peered":"2023-10-06T11:05:44.377816+0000","last_clean":"2023-10-06T11:05:44.377816+0000","last_became_active":"2023-10-06T11:05:44.370141+0000","last_became_peered":"2023-10-06T11:05:44.370141+0000","last_unstale":"2023-10-06T11:05:44.377816+0000","last_undegraded":"2023-10-06T11:05:44.377816+0000","last_fullsized":"2023-10-06T11:05:44.377816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:32:17.346227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.374345+0000","last_change":"2023-10-06T11:05:44.370535+0000","last_active":"2023-10-06T11:05:44.374345+0000","last_peered":"2023-10-06T11:05:44.374345+0000","last_clean":"2023-10-06T11:05:44.374345+0000","last_became_active":"2023-10-06T11:05:44.370264+0000","last_became_peered":"2023-10-06T11:05:44.370264+0000","last_unstale":"2023-10-06T11:05:44.374345+0000","last_undegraded":"2023-10-06T11:05:44.374345+0000","last_fullsized":"2023-10-06T11:05:44.374345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:18:11.738273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377689+0000","last_change":"2023-10-06T11:05:44.363111+0000","last_active":"2023-10-06T11:05:44.377689+0000","last_peered":"2023-10-06T11:05:44.377689+0000","last_clean":"2023-10-06T11:05:44.377689+0000","last_became_active":"2023-10-06T11:05:44.362803+0000","last_became_peered":"2023-10-06T11:05:44.362803+0000","last_unstale":"2023-10-06T11:05:44.377689+0000","last_undegraded":"2023-10-06T11:05:44.377689+0000","last_fullsized":"2023-10-06T11:05:44.377689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:49:41.512642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375661+0000","last_change":"2023-10-06T11:05:44.370641+0000","last_active":"2023-10-06T11:05:44.375661+0000","last_peered":"2023-10-06T11:05:44.375661+0000","last_clean":"2023-10-06T11:05:44.375661+0000","last_became_active":"2023-10-06T11:05:44.370078+0000","last_became_peered":"2023-10-06T11:05:44.370078+0000","last_unstale":"2023-10-06T11:05:44.375661+0000","last_undegraded":"2023-10-06T11:05:44.375661+0000","last_fullsized":"2023-10-06T11:05:44.375661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:34:03.025480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.365243+0000","last_change":"2023-10-06T11:05:44.362523+0000","last_active":"2023-10-06T11:05:44.365243+0000","last_peered":"2023-10-06T11:05:44.365243+0000","last_clean":"2023-10-06T11:05:44.365243+0000","last_became_active":"2023-10-06T11:05:44.362248+0000","last_became_peered":"2023-10-06T11:05:44.362248+0000","last_unstale":"2023-10-06T11:05:44.365243+0000","last_undegraded":"2023-10-06T11:05:44.365243+0000","last_fullsized":"2023-10-06T11:05:44.365243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:33.869834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.376261+0000","last_change":"2023-10-06T11:05:44.373706+0000","last_active":"2023-10-06T11:05:44.376261+0000","last_peered":"2023-10-06T11:05:44.376261+0000","last_clean":"2023-10-06T11:05:44.376261+0000","last_became_active":"2023-10-06T11:05:44.373408+0000","last_became_peered":"2023-10-06T11:05:44.373408+0000","last_unstale":"2023-10-06T11:05:44.376261+0000","last_undegraded":"2023-10-06T11:05:44.376261+0000","last_fullsized":"2023-10-06T11:05:44.376261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:28.010695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377714+0000","last_change":"2023-10-06T11:05:44.364121+0000","last_active":"2023-10-06T11:05:44.377714+0000","last_peered":"2023-10-06T11:05:44.377714+0000","last_clean":"2023-10-06T11:05:44.377714+0000","last_became_active":"2023-10-06T11:05:44.363863+0000","last_became_peered":"2023-10-06T11:05:44.363863+0000","last_unstale":"2023-10-06T11:05:44.377714+0000","last_undegraded":"2023-10-06T11:05:44.377714+0000","last_fullsized":"2023-10-06T11:05:44.377714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:51.490766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.381068+0000","last_change":"2023-10-06T11:05:44.376146+0000","last_active":"2023-10-06T11:05:44.381068+0000","last_peered":"2023-10-06T11:05:44.381068+0000","last_clean":"2023-10-06T11:05:44.381068+0000","last_became_active":"2023-10-06T11:05:44.375877+0000","last_became_peered":"2023-10-06T11:05:44.375877+0000","last_unstale":"2023-10-06T11:05:44.381068+0000","last_undegraded":"2023-10-06T11:05:44.381068+0000","last_fullsized":"2023-10-06T11:05:44.381068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:25:37.173612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375588+0000","last_change":"2023-10-06T11:05:44.371531+0000","last_active":"2023-10-06T11:05:44.375588+0000","last_peered":"2023-10-06T11:05:44.375588+0000","last_clean":"2023-10-06T11:05:44.375588+0000","last_became_active":"2023-10-06T11:05:44.371082+0000","last_became_peered":"2023-10-06T11:05:44.371082+0000","last_unstale":"2023-10-06T11:05:44.375588+0000","last_undegraded":"2023-10-06T11:05:44.375588+0000","last_fullsized":"2023-10-06T11:05:44.375588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:16:26.923074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377465+0000","last_change":"2023-10-06T11:05:44.374262+0000","last_active":"2023-10-06T11:05:44.377465+0000","last_peered":"2023-10-06T11:05:44.377465+0000","last_clean":"2023-10-06T11:05:44.377465+0000","last_became_active":"2023-10-06T11:05:44.373997+0000","last_became_peered":"2023-10-06T11:05:44.373997+0000","last_unstale":"2023-10-06T11:05:44.377465+0000","last_undegraded":"2023-10-06T11:05:44.377465+0000","last_fullsized":"2023-10-06T11:05:44.377465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:30:10.233024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375434+0000","last_change":"2023-10-06T11:05:44.369716+0000","last_active":"2023-10-06T11:05:44.375434+0000","last_peered":"2023-10-06T11:05:44.375434+0000","last_clean":"2023-10-06T11:05:44.375434+0000","last_became_active":"2023-10-06T11:05:44.369434+0000","last_became_peered":"2023-10-06T11:05:44.369434+0000","last_unstale":"2023-10-06T11:05:44.375434+0000","last_undegraded":"2023-10-06T11:05:44.375434+0000","last_fullsized":"2023-10-06T11:05:44.375434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:53:21.828799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377738+0000","last_change":"2023-10-06T11:05:44.376536+0000","last_active":"2023-10-06T11:05:44.377738+0000","last_peered":"2023-10-06T11:05:44.377738+0000","last_clean":"2023-10-06T11:05:44.377738+0000","last_became_active":"2023-10-06T11:05:44.376291+0000","last_became_peered":"2023-10-06T11:05:44.376291+0000","last_unstale":"2023-10-06T11:05:44.377738+0000","last_undegraded":"2023-10-06T11:05:44.377738+0000","last_fullsized":"2023-10-06T11:05:44.377738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:19.308513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380092+0000","last_change":"2023-10-06T11:05:44.374492+0000","last_active":"2023-10-06T11:05:44.380092+0000","last_peered":"2023-10-06T11:05:44.380092+0000","last_clean":"2023-10-06T11:05:44.380092+0000","last_became_active":"2023-10-06T11:05:44.374108+0000","last_became_peered":"2023-10-06T11:05:44.374108+0000","last_unstale":"2023-10-06T11:05:44.380092+0000","last_undegraded":"2023-10-06T11:05:44.380092+0000","last_fullsized":"2023-10-06T11:05:44.380092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:36:18.739157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380978+0000","last_change":"2023-10-06T11:05:44.373773+0000","last_active":"2023-10-06T11:05:44.380978+0000","last_peered":"2023-10-06T11:05:44.380978+0000","last_clean":"2023-10-06T11:05:44.380978+0000","last_became_active":"2023-10-06T11:05:44.373445+0000","last_became_peered":"2023-10-06T11:05:44.373445+0000","last_unstale":"2023-10-06T11:05:44.380978+0000","last_undegraded":"2023-10-06T11:05:44.380978+0000","last_fullsized":"2023-10-06T11:05:44.380978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:48.500150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.370569+0000","last_change":"2023-10-06T11:05:44.365767+0000","last_active":"2023-10-06T11:05:44.370569+0000","last_peered":"2023-10-06T11:05:44.370569+0000","last_clean":"2023-10-06T11:05:44.370569+0000","last_became_active":"2023-10-06T11:05:44.365489+0000","last_became_peered":"2023-10-06T11:05:44.365489+0000","last_unstale":"2023-10-06T11:05:44.370569+0000","last_undegraded":"2023-10-06T11:05:44.370569+0000","last_fullsized":"2023-10-06T11:05:44.370569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:36:18.739157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379611+0000","last_change":"2023-10-06T11:05:44.373554+0000","last_active":"2023-10-06T11:05:44.379611+0000","last_peered":"2023-10-06T11:05:44.379611+0000","last_clean":"2023-10-06T11:05:44.379611+0000","last_became_active":"2023-10-06T11:05:44.373293+0000","last_became_peered":"2023-10-06T11:05:44.373293+0000","last_unstale":"2023-10-06T11:05:44.379611+0000","last_undegraded":"2023-10-06T11:05:44.379611+0000","last_fullsized":"2023-10-06T11:05:44.379611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:32:31.703547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380998+0000","last_change":"2023-10-06T11:05:44.373832+0000","last_active":"2023-10-06T11:05:44.380998+0000","last_peered":"2023-10-06T11:05:44.380998+0000","last_clean":"2023-10-06T11:05:44.380998+0000","last_became_active":"2023-10-06T11:05:44.373527+0000","last_became_peered":"2023-10-06T11:05:44.373527+0000","last_unstale":"2023-10-06T11:05:44.380998+0000","last_undegraded":"2023-10-06T11:05:44.380998+0000","last_fullsized":"2023-10-06T11:05:44.380998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:49:53.929590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377989+0000","last_change":"2023-10-06T11:05:44.375109+0000","last_active":"2023-10-06T11:05:44.377989+0000","last_peered":"2023-10-06T11:05:44.377989+0000","last_clean":"2023-10-06T11:05:44.377989+0000","last_became_active":"2023-10-06T11:05:44.374861+0000","last_became_peered":"2023-10-06T11:05:44.374861+0000","last_unstale":"2023-10-06T11:05:44.377989+0000","last_undegraded":"2023-10-06T11:05:44.377989+0000","last_fullsized":"2023-10-06T11:05:44.377989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:36:26.414372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377747+0000","last_change":"2023-10-06T11:05:44.372987+0000","last_active":"2023-10-06T11:05:44.377747+0000","last_peered":"2023-10-06T11:05:44.377747+0000","last_clean":"2023-10-06T11:05:44.377747+0000","last_became_active":"2023-10-06T11:05:44.369828+0000","last_became_peered":"2023-10-06T11:05:44.369828+0000","last_unstale":"2023-10-06T11:05:44.377747+0000","last_undegraded":"2023-10-06T11:05:44.377747+0000","last_fullsized":"2023-10-06T11:05:44.377747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:42.381985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380422+0000","last_change":"2023-10-06T11:05:44.372985+0000","last_active":"2023-10-06T11:05:44.380422+0000","last_peered":"2023-10-06T11:05:44.380422+0000","last_clean":"2023-10-06T11:05:44.380422+0000","last_became_active":"2023-10-06T11:05:44.372531+0000","last_became_peered":"2023-10-06T11:05:44.372531+0000","last_unstale":"2023-10-06T11:05:44.380422+0000","last_undegraded":"2023-10-06T11:05:44.380422+0000","last_fullsized":"2023-10-06T11:05:44.380422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:36:26.414372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.382453+0000","last_change":"2023-10-06T11:05:43.369136+0000","last_active":"2023-10-06T11:05:44.382453+0000","last_peered":"2023-10-06T11:05:44.382453+0000","last_clean":"2023-10-06T11:05:44.382453+0000","last_became_active":"2023-10-06T11:05:43.368830+0000","last_became_peered":"2023-10-06T11:05:43.368830+0000","last_unstale":"2023-10-06T11:05:44.382453+0000","last_undegraded":"2023-10-06T11:05:44.382453+0000","last_fullsized":"2023-10-06T11:05:44.382453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:27.003956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.370597+0000","last_change":"2023-10-06T11:05:44.367477+0000","last_active":"2023-10-06T11:05:44.370597+0000","last_peered":"2023-10-06T11:05:44.370597+0000","last_clean":"2023-10-06T11:05:44.370597+0000","last_became_active":"2023-10-06T11:05:44.367216+0000","last_became_peered":"2023-10-06T11:05:44.367216+0000","last_unstale":"2023-10-06T11:05:44.370597+0000","last_undegraded":"2023-10-06T11:05:44.370597+0000","last_fullsized":"2023-10-06T11:05:44.370597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:48.500150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.364950+0000","last_change":"2023-10-06T11:05:43.369127+0000","last_active":"2023-10-06T11:05:44.364950+0000","last_peered":"2023-10-06T11:05:44.364950+0000","last_clean":"2023-10-06T11:05:44.364950+0000","last_became_active":"2023-10-06T11:05:43.368806+0000","last_became_peered":"2023-10-06T11:05:43.368806+0000","last_unstale":"2023-10-06T11:05:44.364950+0000","last_undegraded":"2023-10-06T11:05:44.364950+0000","last_fullsized":"2023-10-06T11:05:44.364950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:51.324615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.370930+0000","last_change":"2023-10-06T11:05:44.367950+0000","last_active":"2023-10-06T11:05:44.370930+0000","last_peered":"2023-10-06T11:05:44.370930+0000","last_clean":"2023-10-06T11:05:44.370930+0000","last_became_active":"2023-10-06T11:05:44.367682+0000","last_became_peered":"2023-10-06T11:05:44.367682+0000","last_unstale":"2023-10-06T11:05:44.370930+0000","last_undegraded":"2023-10-06T11:05:44.370930+0000","last_fullsized":"2023-10-06T11:05:44.370930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:53:21.828799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.356971+0000","last_change":"2023-10-06T11:05:43.366406+0000","last_active":"2023-10-06T11:05:44.356971+0000","last_peered":"2023-10-06T11:05:44.356971+0000","last_clean":"2023-10-06T11:05:44.356971+0000","last_became_active":"2023-10-06T11:05:43.366004+0000","last_became_peered":"2023-10-06T11:05:43.366004+0000","last_unstale":"2023-10-06T11:05:44.356971+0000","last_undegraded":"2023-10-06T11:05:44.356971+0000","last_fullsized":"2023-10-06T11:05:44.356971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:00.477669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.382373+0000","last_change":"2023-10-06T11:05:44.378728+0000","last_active":"2023-10-06T11:05:44.382373+0000","last_peered":"2023-10-06T11:05:44.382373+0000","last_clean":"2023-10-06T11:05:44.382373+0000","last_became_active":"2023-10-06T11:05:44.378467+0000","last_became_peered":"2023-10-06T11:05:44.378467+0000","last_unstale":"2023-10-06T11:05:44.382373+0000","last_undegraded":"2023-10-06T11:05:44.382373+0000","last_fullsized":"2023-10-06T11:05:44.382373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:20:05.796456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.353362+0000","last_change":"2023-10-06T11:05:43.362935+0000","last_active":"2023-10-06T11:05:44.353362+0000","last_peered":"2023-10-06T11:05:44.353362+0000","last_clean":"2023-10-06T11:05:44.353362+0000","last_became_active":"2023-10-06T11:05:43.362642+0000","last_became_peered":"2023-10-06T11:05:43.362642+0000","last_unstale":"2023-10-06T11:05:44.353362+0000","last_undegraded":"2023-10-06T11:05:44.353362+0000","last_fullsized":"2023-10-06T11:05:44.353362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:36.907530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.371257+0000","last_change":"2023-10-06T11:05:44.366360+0000","last_active":"2023-10-06T11:05:44.371257+0000","last_peered":"2023-10-06T11:05:44.371257+0000","last_clean":"2023-10-06T11:05:44.371257+0000","last_became_active":"2023-10-06T11:05:44.366097+0000","last_became_peered":"2023-10-06T11:05:44.366097+0000","last_unstale":"2023-10-06T11:05:44.371257+0000","last_undegraded":"2023-10-06T11:05:44.371257+0000","last_fullsized":"2023-10-06T11:05:44.371257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:18:11.738273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.357158+0000","last_change":"2023-10-06T11:05:43.365582+0000","last_active":"2023-10-06T11:05:44.357158+0000","last_peered":"2023-10-06T11:05:44.357158+0000","last_clean":"2023-10-06T11:05:44.357158+0000","last_became_active":"2023-10-06T11:05:43.365197+0000","last_became_peered":"2023-10-06T11:05:43.365197+0000","last_unstale":"2023-10-06T11:05:44.357158+0000","last_undegraded":"2023-10-06T11:05:44.357158+0000","last_fullsized":"2023-10-06T11:05:44.357158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:59:28.141215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.373455+0000","last_change":"2023-10-06T11:05:44.369545+0000","last_active":"2023-10-06T11:05:44.373455+0000","last_peered":"2023-10-06T11:05:44.373455+0000","last_clean":"2023-10-06T11:05:44.373455+0000","last_became_active":"2023-10-06T11:05:44.369228+0000","last_became_peered":"2023-10-06T11:05:44.369228+0000","last_unstale":"2023-10-06T11:05:44.373455+0000","last_undegraded":"2023-10-06T11:05:44.373455+0000","last_fullsized":"2023-10-06T11:05:44.373455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:36:18.739157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.378674+0000","last_change":"2023-10-06T11:05:43.370700+0000","last_active":"2023-10-06T11:05:44.378674+0000","last_peered":"2023-10-06T11:05:44.378674+0000","last_clean":"2023-10-06T11:05:44.378674+0000","last_became_active":"2023-10-06T11:05:43.370418+0000","last_became_peered":"2023-10-06T11:05:43.370418+0000","last_unstale":"2023-10-06T11:05:44.378674+0000","last_undegraded":"2023-10-06T11:05:44.378674+0000","last_fullsized":"2023-10-06T11:05:44.378674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:03.585687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377957+0000","last_change":"2023-10-06T11:05:44.375285+0000","last_active":"2023-10-06T11:05:44.377957+0000","last_peered":"2023-10-06T11:05:44.377957+0000","last_clean":"2023-10-06T11:05:44.377957+0000","last_became_active":"2023-10-06T11:05:44.374774+0000","last_became_peered":"2023-10-06T11:05:44.374774+0000","last_unstale":"2023-10-06T11:05:44.377957+0000","last_undegraded":"2023-10-06T11:05:44.377957+0000","last_fullsized":"2023-10-06T11:05:44.377957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:32:17.346227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.385298+0000","last_change":"2023-10-06T11:05:43.363844+0000","last_active":"2023-10-06T11:05:44.385298+0000","last_peered":"2023-10-06T11:05:44.385298+0000","last_clean":"2023-10-06T11:05:44.385298+0000","last_became_active":"2023-10-06T11:05:43.363568+0000","last_became_peered":"2023-10-06T11:05:43.363568+0000","last_unstale":"2023-10-06T11:05:44.385298+0000","last_undegraded":"2023-10-06T11:05:44.385298+0000","last_fullsized":"2023-10-06T11:05:44.385298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:51.324615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.382342+0000","last_change":"2023-10-06T11:05:44.375145+0000","last_active":"2023-10-06T11:05:44.382342+0000","last_peered":"2023-10-06T11:05:44.382342+0000","last_clean":"2023-10-06T11:05:44.382342+0000","last_became_active":"2023-10-06T11:05:44.374868+0000","last_became_peered":"2023-10-06T11:05:44.374868+0000","last_unstale":"2023-10-06T11:05:44.382342+0000","last_undegraded":"2023-10-06T11:05:44.382342+0000","last_fullsized":"2023-10-06T11:05:44.382342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:48.500150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.378534+0000","last_change":"2023-10-06T11:05:43.369646+0000","last_active":"2023-10-06T11:05:44.378534+0000","last_peered":"2023-10-06T11:05:44.378534+0000","last_clean":"2023-10-06T11:05:44.378534+0000","last_became_active":"2023-10-06T11:05:43.369353+0000","last_became_peered":"2023-10-06T11:05:43.369353+0000","last_unstale":"2023-10-06T11:05:44.378534+0000","last_undegraded":"2023-10-06T11:05:44.378534+0000","last_fullsized":"2023-10-06T11:05:44.378534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:50.484027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379530+0000","last_change":"2023-10-06T11:05:44.372738+0000","last_active":"2023-10-06T11:05:44.379530+0000","last_peered":"2023-10-06T11:05:44.379530+0000","last_clean":"2023-10-06T11:05:44.379530+0000","last_became_active":"2023-10-06T11:05:44.372299+0000","last_became_peered":"2023-10-06T11:05:44.372299+0000","last_unstale":"2023-10-06T11:05:44.379530+0000","last_undegraded":"2023-10-06T11:05:44.379530+0000","last_fullsized":"2023-10-06T11:05:44.379530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:53:21.828799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.352712+0000","last_change":"2023-10-06T11:05:43.364085+0000","last_active":"2023-10-06T11:05:44.352712+0000","last_peered":"2023-10-06T11:05:44.352712+0000","last_clean":"2023-10-06T11:05:44.352712+0000","last_became_active":"2023-10-06T11:05:43.363844+0000","last_became_peered":"2023-10-06T11:05:43.363844+0000","last_unstale":"2023-10-06T11:05:44.352712+0000","last_undegraded":"2023-10-06T11:05:44.352712+0000","last_fullsized":"2023-10-06T11:05:44.352712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:51.324615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380405+0000","last_change":"2023-10-06T11:05:44.372815+0000","last_active":"2023-10-06T11:05:44.380405+0000","last_peered":"2023-10-06T11:05:44.380405+0000","last_clean":"2023-10-06T11:05:44.380405+0000","last_became_active":"2023-10-06T11:05:44.372237+0000","last_became_peered":"2023-10-06T11:05:44.372237+0000","last_unstale":"2023-10-06T11:05:44.380405+0000","last_undegraded":"2023-10-06T11:05:44.380405+0000","last_fullsized":"2023-10-06T11:05:44.380405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:42.381985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.363864+0000","last_change":"2023-10-06T11:05:43.369142+0000","last_active":"2023-10-06T11:05:44.363864+0000","last_peered":"2023-10-06T11:05:44.363864+0000","last_clean":"2023-10-06T11:05:44.363864+0000","last_became_active":"2023-10-06T11:05:43.368847+0000","last_became_peered":"2023-10-06T11:05:43.368847+0000","last_unstale":"2023-10-06T11:05:44.363864+0000","last_undegraded":"2023-10-06T11:05:44.363864+0000","last_fullsized":"2023-10-06T11:05:44.363864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:48:23.698446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.373918+0000","last_change":"2023-10-06T11:05:44.370314+0000","last_active":"2023-10-06T11:05:44.373918+0000","last_peered":"2023-10-06T11:05:44.373918+0000","last_clean":"2023-10-06T11:05:44.373918+0000","last_became_active":"2023-10-06T11:05:44.370065+0000","last_became_peered":"2023-10-06T11:05:44.370065+0000","last_unstale":"2023-10-06T11:05:44.373918+0000","last_undegraded":"2023-10-06T11:05:44.373918+0000","last_fullsized":"2023-10-06T11:05:44.373918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:32:31.703547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377619+0000","last_change":"2023-10-06T11:05:43.366052+0000","last_active":"2023-10-06T11:05:44.377619+0000","last_peered":"2023-10-06T11:05:44.377619+0000","last_clean":"2023-10-06T11:05:44.377619+0000","last_became_active":"2023-10-06T11:05:43.365790+0000","last_became_peered":"2023-10-06T11:05:43.365790+0000","last_unstale":"2023-10-06T11:05:44.377619+0000","last_undegraded":"2023-10-06T11:05:44.377619+0000","last_fullsized":"2023-10-06T11:05:44.377619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:59:28.141215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379857+0000","last_change":"2023-10-06T11:05:44.372870+0000","last_active":"2023-10-06T11:05:44.379857+0000","last_peered":"2023-10-06T11:05:44.379857+0000","last_clean":"2023-10-06T11:05:44.379857+0000","last_became_active":"2023-10-06T11:05:44.372480+0000","last_became_peered":"2023-10-06T11:05:44.372480+0000","last_unstale":"2023-10-06T11:05:44.379857+0000","last_undegraded":"2023-10-06T11:05:44.379857+0000","last_fullsized":"2023-10-06T11:05:44.379857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:25:37.173612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.378371+0000","last_change":"2023-10-06T11:05:43.369672+0000","last_active":"2023-10-06T11:05:44.378371+0000","last_peered":"2023-10-06T11:05:44.378371+0000","last_clean":"2023-10-06T11:05:44.378371+0000","last_became_active":"2023-10-06T11:05:43.369415+0000","last_became_peered":"2023-10-06T11:05:43.369415+0000","last_unstale":"2023-10-06T11:05:44.378371+0000","last_undegraded":"2023-10-06T11:05:44.378371+0000","last_fullsized":"2023-10-06T11:05:44.378371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:21:07.005347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.385017+0000","last_change":"2023-10-06T11:05:44.380100+0000","last_active":"2023-10-06T11:05:44.385017+0000","last_peered":"2023-10-06T11:05:44.385017+0000","last_clean":"2023-10-06T11:05:44.385017+0000","last_became_active":"2023-10-06T11:05:44.379686+0000","last_became_peered":"2023-10-06T11:05:44.379686+0000","last_unstale":"2023-10-06T11:05:44.385017+0000","last_undegraded":"2023-10-06T11:05:44.385017+0000","last_fullsized":"2023-10-06T11:05:44.385017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:32:31.703547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.378652+0000","last_change":"2023-10-06T11:05:43.369280+0000","last_active":"2023-10-06T11:05:44.378652+0000","last_peered":"2023-10-06T11:05:44.378652+0000","last_clean":"2023-10-06T11:05:44.378652+0000","last_became_active":"2023-10-06T11:05:43.369002+0000","last_became_peered":"2023-10-06T11:05:43.369002+0000","last_unstale":"2023-10-06T11:05:44.378652+0000","last_undegraded":"2023-10-06T11:05:44.378652+0000","last_fullsized":"2023-10-06T11:05:44.378652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:53:55.024707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.365517+0000","last_change":"2023-10-06T11:05:44.363074+0000","last_active":"2023-10-06T11:05:44.365517+0000","last_peered":"2023-10-06T11:05:44.365517+0000","last_clean":"2023-10-06T11:05:44.365517+0000","last_became_active":"2023-10-06T11:05:44.362798+0000","last_became_peered":"2023-10-06T11:05:44.362798+0000","last_unstale":"2023-10-06T11:05:44.365517+0000","last_undegraded":"2023-10-06T11:05:44.365517+0000","last_fullsized":"2023-10-06T11:05:44.365517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:48:11.590704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.378605+0000","last_change":"2023-10-06T11:05:43.368847+0000","last_active":"2023-10-06T11:05:44.378605+0000","last_peered":"2023-10-06T11:05:44.378605+0000","last_clean":"2023-10-06T11:05:44.378605+0000","last_became_active":"2023-10-06T11:05:43.368394+0000","last_became_peered":"2023-10-06T11:05:43.368394+0000","last_unstale":"2023-10-06T11:05:44.378605+0000","last_undegraded":"2023-10-06T11:05:44.378605+0000","last_fullsized":"2023-10-06T11:05:44.378605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:26.238071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380176+0000","last_change":"2023-10-06T11:05:44.374404+0000","last_active":"2023-10-06T11:05:44.380176+0000","last_peered":"2023-10-06T11:05:44.380176+0000","last_clean":"2023-10-06T11:05:44.380176+0000","last_became_active":"2023-10-06T11:05:44.374017+0000","last_became_peered":"2023-10-06T11:05:44.374017+0000","last_unstale":"2023-10-06T11:05:44.380176+0000","last_undegraded":"2023-10-06T11:05:44.380176+0000","last_fullsized":"2023-10-06T11:05:44.380176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:51.490766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.354872+0000","last_change":"2023-10-06T11:05:43.368442+0000","last_active":"2023-10-06T11:05:44.354872+0000","last_peered":"2023-10-06T11:05:44.354872+0000","last_clean":"2023-10-06T11:05:44.354872+0000","last_became_active":"2023-10-06T11:05:43.368152+0000","last_became_peered":"2023-10-06T11:05:43.368152+0000","last_unstale":"2023-10-06T11:05:44.354872+0000","last_undegraded":"2023-10-06T11:05:44.354872+0000","last_fullsized":"2023-10-06T11:05:44.354872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:27.003956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.371685+0000","last_change":"2023-10-06T11:05:44.368980+0000","last_active":"2023-10-06T11:05:44.371685+0000","last_peered":"2023-10-06T11:05:44.371685+0000","last_clean":"2023-10-06T11:05:44.371685+0000","last_became_active":"2023-10-06T11:05:44.368693+0000","last_became_peered":"2023-10-06T11:05:44.368693+0000","last_unstale":"2023-10-06T11:05:44.371685+0000","last_undegraded":"2023-10-06T11:05:44.371685+0000","last_fullsized":"2023-10-06T11:05:44.371685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:25:37.173612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.376448+0000","last_change":"2023-10-06T11:05:43.366389+0000","last_active":"2023-10-06T11:05:44.376448+0000","last_peered":"2023-10-06T11:05:44.376448+0000","last_clean":"2023-10-06T11:05:44.376448+0000","last_became_active":"2023-10-06T11:05:43.366041+0000","last_became_peered":"2023-10-06T11:05:43.366041+0000","last_unstale":"2023-10-06T11:05:44.376448+0000","last_undegraded":"2023-10-06T11:05:44.376448+0000","last_fullsized":"2023-10-06T11:05:44.376448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:18.301774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375589+0000","last_change":"2023-10-06T11:05:44.371594+0000","last_active":"2023-10-06T11:05:44.375589+0000","last_peered":"2023-10-06T11:05:44.375589+0000","last_clean":"2023-10-06T11:05:44.375589+0000","last_became_active":"2023-10-06T11:05:44.371316+0000","last_became_peered":"2023-10-06T11:05:44.371316+0000","last_unstale":"2023-10-06T11:05:44.375589+0000","last_undegraded":"2023-10-06T11:05:44.375589+0000","last_fullsized":"2023-10-06T11:05:44.375589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:23:15.847562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.365041+0000","last_change":"2023-10-06T11:05:43.362138+0000","last_active":"2023-10-06T11:05:44.365041+0000","last_peered":"2023-10-06T11:05:44.365041+0000","last_clean":"2023-10-06T11:05:44.365041+0000","last_became_active":"2023-10-06T11:05:43.361796+0000","last_became_peered":"2023-10-06T11:05:43.361796+0000","last_unstale":"2023-10-06T11:05:44.365041+0000","last_undegraded":"2023-10-06T11:05:44.365041+0000","last_fullsized":"2023-10-06T11:05:44.365041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:51.324615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375623+0000","last_change":"2023-10-06T11:05:44.368661+0000","last_active":"2023-10-06T11:05:44.375623+0000","last_peered":"2023-10-06T11:05:44.375623+0000","last_clean":"2023-10-06T11:05:44.375623+0000","last_became_active":"2023-10-06T11:05:44.368296+0000","last_became_peered":"2023-10-06T11:05:44.368296+0000","last_unstale":"2023-10-06T11:05:44.375623+0000","last_undegraded":"2023-10-06T11:05:44.375623+0000","last_fullsized":"2023-10-06T11:05:44.375623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:42:21.740811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.354312+0000","last_change":"2023-10-06T11:05:43.357853+0000","last_active":"2023-10-06T11:05:44.354312+0000","last_peered":"2023-10-06T11:05:44.354312+0000","last_clean":"2023-10-06T11:05:44.354312+0000","last_became_active":"2023-10-06T11:05:43.357572+0000","last_became_peered":"2023-10-06T11:05:43.357572+0000","last_unstale":"2023-10-06T11:05:44.354312+0000","last_undegraded":"2023-10-06T11:05:44.354312+0000","last_fullsized":"2023-10-06T11:05:44.354312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:18.301774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380069+0000","last_change":"2023-10-06T11:05:44.374211+0000","last_active":"2023-10-06T11:05:44.380069+0000","last_peered":"2023-10-06T11:05:44.380069+0000","last_clean":"2023-10-06T11:05:44.380069+0000","last_became_active":"2023-10-06T11:05:44.373924+0000","last_became_peered":"2023-10-06T11:05:44.373924+0000","last_unstale":"2023-10-06T11:05:44.380069+0000","last_undegraded":"2023-10-06T11:05:44.380069+0000","last_fullsized":"2023-10-06T11:05:44.380069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:18:11.738273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.357364+0000","last_change":"2023-10-06T11:05:43.367123+0000","last_active":"2023-10-06T11:05:44.357364+0000","last_peered":"2023-10-06T11:05:44.357364+0000","last_clean":"2023-10-06T11:05:44.357364+0000","last_became_active":"2023-10-06T11:05:43.366861+0000","last_became_peered":"2023-10-06T11:05:43.366861+0000","last_unstale":"2023-10-06T11:05:44.357364+0000","last_undegraded":"2023-10-06T11:05:44.357364+0000","last_fullsized":"2023-10-06T11:05:44.357364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:32.863094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377938+0000","last_change":"2023-10-06T11:05:44.374963+0000","last_active":"2023-10-06T11:05:44.377938+0000","last_peered":"2023-10-06T11:05:44.377938+0000","last_clean":"2023-10-06T11:05:44.377938+0000","last_became_active":"2023-10-06T11:05:44.374524+0000","last_became_peered":"2023-10-06T11:05:44.374524+0000","last_unstale":"2023-10-06T11:05:44.377938+0000","last_undegraded":"2023-10-06T11:05:44.377938+0000","last_fullsized":"2023-10-06T11:05:44.377938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:27.244810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379794+0000","last_change":"2023-10-06T11:05:43.367084+0000","last_active":"2023-10-06T11:05:44.379794+0000","last_peered":"2023-10-06T11:05:44.379794+0000","last_clean":"2023-10-06T11:05:44.379794+0000","last_became_active":"2023-10-06T11:05:43.366813+0000","last_became_peered":"2023-10-06T11:05:43.366813+0000","last_unstale":"2023-10-06T11:05:44.379794+0000","last_undegraded":"2023-10-06T11:05:44.379794+0000","last_fullsized":"2023-10-06T11:05:44.379794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:27.003956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.357296+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:05:44.357296+0000","last_peered":"2023-10-06T11:05:44.357296+0000","last_clean":"2023-10-06T11:05:44.357296+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:05:44.357296+0000","last_undegraded":"2023-10-06T11:05:44.357296+0000","last_fullsized":"2023-10-06T11:05:44.357296+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380176+0000","last_change":"2023-10-06T11:05:44.371162+0000","last_active":"2023-10-06T11:05:44.380176+0000","last_peered":"2023-10-06T11:05:44.380176+0000","last_clean":"2023-10-06T11:05:44.380176+0000","last_became_active":"2023-10-06T11:05:44.370923+0000","last_became_peered":"2023-10-06T11:05:44.370923+0000","last_unstale":"2023-10-06T11:05:44.380176+0000","last_undegraded":"2023-10-06T11:05:44.380176+0000","last_fullsized":"2023-10-06T11:05:44.380176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:20.240548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.356434+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:05:44.356434+0000","last_peered":"2023-10-06T11:05:44.356434+0000","last_clean":"2023-10-06T11:05:44.356434+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:05:44.356434+0000","last_undegraded":"2023-10-06T11:05:44.356434+0000","last_fullsized":"2023-10-06T11:05:44.356434+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T11:05:45.427947+0000","last_change":"2023-10-06T11:05:43.365664+0000","last_active":"2023-10-06T11:05:45.427947+0000","last_peered":"2023-10-06T11:05:45.427947+0000","last_clean":"2023-10-06T11:05:45.427947+0000","last_became_active":"2023-10-06T11:05:43.365413+0000","last_became_peered":"2023-10-06T11:05:43.365413+0000","last_unstale":"2023-10-06T11:05:45.427947+0000","last_undegraded":"2023-10-06T11:05:45.427947+0000","last_fullsized":"2023-10-06T11:05:45.427947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:32.863094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.382458+0000","last_change":"2023-10-06T11:05:44.376907+0000","last_active":"2023-10-06T11:05:44.382458+0000","last_peered":"2023-10-06T11:05:44.382458+0000","last_clean":"2023-10-06T11:05:44.382458+0000","last_became_active":"2023-10-06T11:05:44.376549+0000","last_became_peered":"2023-10-06T11:05:44.376549+0000","last_unstale":"2023-10-06T11:05:44.382458+0000","last_undegraded":"2023-10-06T11:05:44.382458+0000","last_fullsized":"2023-10-06T11:05:44.382458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:48:35.935962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.364783+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:05:44.364783+0000","last_peered":"2023-10-06T11:05:44.364783+0000","last_clean":"2023-10-06T11:05:44.364783+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:05:44.364783+0000","last_undegraded":"2023-10-06T11:05:44.364783+0000","last_fullsized":"2023-10-06T11:05:44.364783+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.366104+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:05:44.366104+0000","last_peered":"2023-10-06T11:05:44.366104+0000","last_clean":"2023-10-06T11:05:44.366104+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:05:44.366104+0000","last_undegraded":"2023-10-06T11:05:44.366104+0000","last_fullsized":"2023-10-06T11:05:44.366104+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.352615+0000","last_change":"2023-10-06T11:05:43.368370+0000","last_active":"2023-10-06T11:05:44.352615+0000","last_peered":"2023-10-06T11:05:44.352615+0000","last_clean":"2023-10-06T11:05:44.352615+0000","last_became_active":"2023-10-06T11:05:43.368103+0000","last_became_peered":"2023-10-06T11:05:43.368103+0000","last_unstale":"2023-10-06T11:05:44.352615+0000","last_undegraded":"2023-10-06T11:05:44.352615+0000","last_fullsized":"2023-10-06T11:05:44.352615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:24.903299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.372002+0000","last_change":"2023-10-06T11:05:44.369604+0000","last_active":"2023-10-06T11:05:44.372002+0000","last_peered":"2023-10-06T11:05:44.372002+0000","last_clean":"2023-10-06T11:05:44.372002+0000","last_became_active":"2023-10-06T11:05:44.368781+0000","last_became_peered":"2023-10-06T11:05:44.368781+0000","last_unstale":"2023-10-06T11:05:44.372002+0000","last_undegraded":"2023-10-06T11:05:44.372002+0000","last_fullsized":"2023-10-06T11:05:44.372002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:20.240548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.361406+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:05:44.361406+0000","last_peered":"2023-10-06T11:05:44.361406+0000","last_clean":"2023-10-06T11:05:44.361406+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:05:44.361406+0000","last_undegraded":"2023-10-06T11:05:44.361406+0000","last_fullsized":"2023-10-06T11:05:44.361406+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.364677+0000","last_change":"2023-10-06T11:05:43.367969+0000","last_active":"2023-10-06T11:05:44.364677+0000","last_peered":"2023-10-06T11:05:44.364677+0000","last_clean":"2023-10-06T11:05:44.364677+0000","last_became_active":"2023-10-06T11:05:43.367720+0000","last_became_peered":"2023-10-06T11:05:43.367720+0000","last_unstale":"2023-10-06T11:05:44.364677+0000","last_undegraded":"2023-10-06T11:05:44.364677+0000","last_fullsized":"2023-10-06T11:05:44.364677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:18.301774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379201+0000","last_change":"2023-10-06T11:05:44.378622+0000","last_active":"2023-10-06T11:05:44.379201+0000","last_peered":"2023-10-06T11:05:44.379201+0000","last_clean":"2023-10-06T11:05:44.379201+0000","last_became_active":"2023-10-06T11:05:44.378399+0000","last_became_peered":"2023-10-06T11:05:44.378399+0000","last_unstale":"2023-10-06T11:05:44.379201+0000","last_undegraded":"2023-10-06T11:05:44.379201+0000","last_fullsized":"2023-10-06T11:05:44.379201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:49:53.929590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.365682+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:05:44.365682+0000","last_peered":"2023-10-06T11:05:44.365682+0000","last_clean":"2023-10-06T11:05:44.365682+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:05:44.365682+0000","last_undegraded":"2023-10-06T11:05:44.365682+0000","last_fullsized":"2023-10-06T11:05:44.365682+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.355393+0000","last_change":"2023-10-06T11:05:43.364706+0000","last_active":"2023-10-06T11:05:44.355393+0000","last_peered":"2023-10-06T11:05:44.355393+0000","last_clean":"2023-10-06T11:05:44.355393+0000","last_became_active":"2023-10-06T11:05:43.364448+0000","last_became_peered":"2023-10-06T11:05:43.364448+0000","last_unstale":"2023-10-06T11:05:44.355393+0000","last_undegraded":"2023-10-06T11:05:44.355393+0000","last_fullsized":"2023-10-06T11:05:44.355393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:24.903299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.373780+0000","last_change":"2023-10-06T11:05:44.369625+0000","last_active":"2023-10-06T11:05:44.373780+0000","last_peered":"2023-10-06T11:05:44.373780+0000","last_clean":"2023-10-06T11:05:44.373780+0000","last_became_active":"2023-10-06T11:05:44.369370+0000","last_became_peered":"2023-10-06T11:05:44.369370+0000","last_unstale":"2023-10-06T11:05:44.373780+0000","last_undegraded":"2023-10-06T11:05:44.373780+0000","last_fullsized":"2023-10-06T11:05:44.373780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:53:56.031447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.354685+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:05:44.354685+0000","last_peered":"2023-10-06T11:05:44.354685+0000","last_clean":"2023-10-06T11:05:44.354685+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:05:44.354685+0000","last_undegraded":"2023-10-06T11:05:44.354685+0000","last_fullsized":"2023-10-06T11:05:44.354685+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.354439+0000","last_change":"2023-10-06T11:05:43.366958+0000","last_active":"2023-10-06T11:05:44.354439+0000","last_peered":"2023-10-06T11:05:44.354439+0000","last_clean":"2023-10-06T11:05:44.354439+0000","last_became_active":"2023-10-06T11:05:43.366523+0000","last_became_peered":"2023-10-06T11:05:43.366523+0000","last_unstale":"2023-10-06T11:05:44.354439+0000","last_undegraded":"2023-10-06T11:05:44.354439+0000","last_fullsized":"2023-10-06T11:05:44.354439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:24.903299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.376185+0000","last_change":"2023-10-06T11:05:44.372075+0000","last_active":"2023-10-06T11:05:44.376185+0000","last_peered":"2023-10-06T11:05:44.376185+0000","last_clean":"2023-10-06T11:05:44.376185+0000","last_became_active":"2023-10-06T11:05:44.371769+0000","last_became_peered":"2023-10-06T11:05:44.371769+0000","last_unstale":"2023-10-06T11:05:44.376185+0000","last_undegraded":"2023-10-06T11:05:44.376185+0000","last_fullsized":"2023-10-06T11:05:44.376185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:49:41.512642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.362233+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:05:44.362233+0000","last_peered":"2023-10-06T11:05:44.362233+0000","last_clean":"2023-10-06T11:05:44.362233+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:05:44.362233+0000","last_undegraded":"2023-10-06T11:05:44.362233+0000","last_fullsized":"2023-10-06T11:05:44.362233+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.364558+0000","last_change":"2023-10-06T11:05:43.368631+0000","last_active":"2023-10-06T11:05:44.364558+0000","last_peered":"2023-10-06T11:05:44.364558+0000","last_clean":"2023-10-06T11:05:44.364558+0000","last_became_active":"2023-10-06T11:05:43.368367+0000","last_became_peered":"2023-10-06T11:05:43.368367+0000","last_unstale":"2023-10-06T11:05:44.364558+0000","last_undegraded":"2023-10-06T11:05:44.364558+0000","last_fullsized":"2023-10-06T11:05:44.364558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:27.003956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377441+0000","last_change":"2023-10-06T11:05:44.374324+0000","last_active":"2023-10-06T11:05:44.377441+0000","last_peered":"2023-10-06T11:05:44.377441+0000","last_clean":"2023-10-06T11:05:44.377441+0000","last_became_active":"2023-10-06T11:05:44.374070+0000","last_became_peered":"2023-10-06T11:05:44.374070+0000","last_unstale":"2023-10-06T11:05:44.377441+0000","last_undegraded":"2023-10-06T11:05:44.377441+0000","last_fullsized":"2023-10-06T11:05:44.377441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:49:53.929590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.360913+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:05:44.360913+0000","last_peered":"2023-10-06T11:05:44.360913+0000","last_clean":"2023-10-06T11:05:44.360913+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:05:44.360913+0000","last_undegraded":"2023-10-06T11:05:44.360913+0000","last_fullsized":"2023-10-06T11:05:44.360913+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.356747+0000","last_change":"2023-10-06T11:05:43.364980+0000","last_active":"2023-10-06T11:05:44.356747+0000","last_peered":"2023-10-06T11:05:44.356747+0000","last_clean":"2023-10-06T11:05:44.356747+0000","last_became_active":"2023-10-06T11:05:43.364661+0000","last_became_peered":"2023-10-06T11:05:43.364661+0000","last_unstale":"2023-10-06T11:05:44.356747+0000","last_undegraded":"2023-10-06T11:05:44.356747+0000","last_fullsized":"2023-10-06T11:05:44.356747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:32.863094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379211+0000","last_change":"2023-10-06T11:05:44.378547+0000","last_active":"2023-10-06T11:05:44.379211+0000","last_peered":"2023-10-06T11:05:44.379211+0000","last_clean":"2023-10-06T11:05:44.379211+0000","last_became_active":"2023-10-06T11:05:44.378211+0000","last_became_peered":"2023-10-06T11:05:44.378211+0000","last_unstale":"2023-10-06T11:05:44.379211+0000","last_undegraded":"2023-10-06T11:05:44.379211+0000","last_fullsized":"2023-10-06T11:05:44.379211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:32:31.703547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377355+0000","last_change":"2023-10-06T11:05:43.368448+0000","last_active":"2023-10-06T11:05:44.377355+0000","last_peered":"2023-10-06T11:05:44.377355+0000","last_clean":"2023-10-06T11:05:44.377355+0000","last_became_active":"2023-10-06T11:05:43.367859+0000","last_became_peered":"2023-10-06T11:05:43.367859+0000","last_unstale":"2023-10-06T11:05:44.377355+0000","last_undegraded":"2023-10-06T11:05:44.377355+0000","last_fullsized":"2023-10-06T11:05:44.377355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:18.301774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375383+0000","last_change":"2023-10-06T11:05:44.369211+0000","last_active":"2023-10-06T11:05:44.375383+0000","last_peered":"2023-10-06T11:05:44.375383+0000","last_clean":"2023-10-06T11:05:44.375383+0000","last_became_active":"2023-10-06T11:05:44.368950+0000","last_became_peered":"2023-10-06T11:05:44.368950+0000","last_unstale":"2023-10-06T11:05:44.375383+0000","last_undegraded":"2023-10-06T11:05:44.375383+0000","last_fullsized":"2023-10-06T11:05:44.375383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:01.484408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377607+0000","last_change":"2023-10-06T11:05:43.365792+0000","last_active":"2023-10-06T11:05:44.377607+0000","last_peered":"2023-10-06T11:05:44.377607+0000","last_clean":"2023-10-06T11:05:44.377607+0000","last_became_active":"2023-10-06T11:05:43.365137+0000","last_became_peered":"2023-10-06T11:05:43.365137+0000","last_unstale":"2023-10-06T11:05:44.377607+0000","last_undegraded":"2023-10-06T11:05:44.377607+0000","last_fullsized":"2023-10-06T11:05:44.377607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:24.903299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379988+0000","last_change":"2023-10-06T11:05:44.373079+0000","last_active":"2023-10-06T11:05:44.379988+0000","last_peered":"2023-10-06T11:05:44.379988+0000","last_clean":"2023-10-06T11:05:44.379988+0000","last_became_active":"2023-10-06T11:05:44.372797+0000","last_became_peered":"2023-10-06T11:05:44.372797+0000","last_unstale":"2023-10-06T11:05:44.379988+0000","last_undegraded":"2023-10-06T11:05:44.379988+0000","last_fullsized":"2023-10-06T11:05:44.379988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:20.240548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377828+0000","last_change":"2023-10-06T11:05:43.367620+0000","last_active":"2023-10-06T11:05:44.377828+0000","last_peered":"2023-10-06T11:05:44.377828+0000","last_clean":"2023-10-06T11:05:44.377828+0000","last_became_active":"2023-10-06T11:05:43.367335+0000","last_became_peered":"2023-10-06T11:05:43.367335+0000","last_unstale":"2023-10-06T11:05:44.377828+0000","last_undegraded":"2023-10-06T11:05:44.377828+0000","last_fullsized":"2023-10-06T11:05:44.377828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:18.301774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375668+0000","last_change":"2023-10-06T11:05:44.371343+0000","last_active":"2023-10-06T11:05:44.375668+0000","last_peered":"2023-10-06T11:05:44.375668+0000","last_clean":"2023-10-06T11:05:44.375668+0000","last_became_active":"2023-10-06T11:05:44.371051+0000","last_became_peered":"2023-10-06T11:05:44.371051+0000","last_unstale":"2023-10-06T11:05:44.375668+0000","last_undegraded":"2023-10-06T11:05:44.375668+0000","last_fullsized":"2023-10-06T11:05:44.375668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:30:10.233024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375170+0000","last_change":"2023-10-06T11:05:43.362124+0000","last_active":"2023-10-06T11:05:44.375170+0000","last_peered":"2023-10-06T11:05:44.375170+0000","last_clean":"2023-10-06T11:05:44.375170+0000","last_became_active":"2023-10-06T11:05:43.361847+0000","last_became_peered":"2023-10-06T11:05:43.361847+0000","last_unstale":"2023-10-06T11:05:44.375170+0000","last_undegraded":"2023-10-06T11:05:44.375170+0000","last_fullsized":"2023-10-06T11:05:44.375170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:36.907530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.373157+0000","last_change":"2023-10-06T11:05:44.367010+0000","last_active":"2023-10-06T11:05:44.373157+0000","last_peered":"2023-10-06T11:05:44.373157+0000","last_clean":"2023-10-06T11:05:44.373157+0000","last_became_active":"2023-10-06T11:05:44.366748+0000","last_became_peered":"2023-10-06T11:05:44.366748+0000","last_unstale":"2023-10-06T11:05:44.373157+0000","last_undegraded":"2023-10-06T11:05:44.373157+0000","last_fullsized":"2023-10-06T11:05:44.373157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:32:17.346227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380717+0000","last_change":"2023-10-06T11:05:43.367936+0000","last_active":"2023-10-06T11:05:44.380717+0000","last_peered":"2023-10-06T11:05:44.380717+0000","last_clean":"2023-10-06T11:05:44.380717+0000","last_became_active":"2023-10-06T11:05:43.367668+0000","last_became_peered":"2023-10-06T11:05:43.367668+0000","last_unstale":"2023-10-06T11:05:44.380717+0000","last_undegraded":"2023-10-06T11:05:44.380717+0000","last_fullsized":"2023-10-06T11:05:44.380717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:20:04.789716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.382377+0000","last_change":"2023-10-06T11:05:44.375719+0000","last_active":"2023-10-06T11:05:44.382377+0000","last_peered":"2023-10-06T11:05:44.382377+0000","last_clean":"2023-10-06T11:05:44.382377+0000","last_became_active":"2023-10-06T11:05:44.375387+0000","last_became_peered":"2023-10-06T11:05:44.375387+0000","last_unstale":"2023-10-06T11:05:44.382377+0000","last_undegraded":"2023-10-06T11:05:44.382377+0000","last_fullsized":"2023-10-06T11:05:44.382377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:39:54.037210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375187+0000","last_change":"2023-10-06T11:05:44.370923+0000","last_active":"2023-10-06T11:05:44.375187+0000","last_peered":"2023-10-06T11:05:44.375187+0000","last_clean":"2023-10-06T11:05:44.375187+0000","last_became_active":"2023-10-06T11:05:44.370655+0000","last_became_peered":"2023-10-06T11:05:44.370655+0000","last_unstale":"2023-10-06T11:05:44.375187+0000","last_undegraded":"2023-10-06T11:05:44.375187+0000","last_fullsized":"2023-10-06T11:05:44.375187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:21:08.012086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379549+0000","last_change":"2023-10-06T11:05:44.373040+0000","last_active":"2023-10-06T11:05:44.379549+0000","last_peered":"2023-10-06T11:05:44.379549+0000","last_clean":"2023-10-06T11:05:44.379549+0000","last_became_active":"2023-10-06T11:05:44.370543+0000","last_became_peered":"2023-10-06T11:05:44.370543+0000","last_unstale":"2023-10-06T11:05:44.379549+0000","last_undegraded":"2023-10-06T11:05:44.379549+0000","last_fullsized":"2023-10-06T11:05:44.379549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:30:10.233024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380138+0000","last_change":"2023-10-06T11:05:44.374987+0000","last_active":"2023-10-06T11:05:44.380138+0000","last_peered":"2023-10-06T11:05:44.380138+0000","last_clean":"2023-10-06T11:05:44.380138+0000","last_became_active":"2023-10-06T11:05:44.374710+0000","last_became_peered":"2023-10-06T11:05:44.374710+0000","last_unstale":"2023-10-06T11:05:44.380138+0000","last_undegraded":"2023-10-06T11:05:44.380138+0000","last_fullsized":"2023-10-06T11:05:44.380138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:46:57.706239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379174+0000","last_change":"2023-10-06T11:05:44.372135+0000","last_active":"2023-10-06T11:05:44.379174+0000","last_peered":"2023-10-06T11:05:44.379174+0000","last_clean":"2023-10-06T11:05:44.379174+0000","last_became_active":"2023-10-06T11:05:44.371609+0000","last_became_peered":"2023-10-06T11:05:44.371609+0000","last_unstale":"2023-10-06T11:05:44.379174+0000","last_undegraded":"2023-10-06T11:05:44.379174+0000","last_fullsized":"2023-10-06T11:05:44.379174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:48:35.935962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.376168+0000","last_change":"2023-10-06T11:05:44.371940+0000","last_active":"2023-10-06T11:05:44.376168+0000","last_peered":"2023-10-06T11:05:44.376168+0000","last_clean":"2023-10-06T11:05:44.376168+0000","last_became_active":"2023-10-06T11:05:44.371617+0000","last_became_peered":"2023-10-06T11:05:44.371617+0000","last_unstale":"2023-10-06T11:05:44.376168+0000","last_undegraded":"2023-10-06T11:05:44.376168+0000","last_fullsized":"2023-10-06T11:05:44.376168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:48.500150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298096,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073744,"statfs":{"total":96636764160,"available":96331513856,"internally_reserved":0,"allocated":827392,"data_stored":666304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297484,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074356,"statfs":{"total":96636764160,"available":96332140544,"internally_reserved":0,"allocated":200704,"data_stored":72831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298068,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073772,"statfs":{"total":96636764160,"available":96331542528,"internally_reserved":0,"allocated":798720,"data_stored":664552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":73385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297484,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074356,"statfs":{"total":96636764160,"available":96332140544,"internally_reserved":0,"allocated":200704,"data_stored":72831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":72921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.095}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7729999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.694}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.657}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":74808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:05:57.091 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:05:57.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.238+0000 7ff4cfaa9700 1 Processor -- start 2023-10-06T11:05:57.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.239+0000 7ff4cfaa9700 1 -- start start 2023-10-06T11:05:57.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.239+0000 7ff4cfaa9700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4c80b28e0 0x7ff4c80c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:57.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.239+0000 7ff4cfaa9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff4c80c53f0 0x7ff4c80cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:57.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.239+0000 7ff4cfaa9700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4c80ad2a0 con 0x7ff4c80b2cb0 2023-10-06T11:05:57.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.239+0000 7ff4cfaa9700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4c8099ec0 con 0x7ff4c80c53f0 2023-10-06T11:05:57.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.239+0000 7ff4cfaa9700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c80c7240 con 0x7ff4c80b28e0 2023-10-06T11:05:57.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.240+0000 7ff4cd044700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff4c80c53f0 0x7ff4c80cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:57.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.240+0000 7ff4ce046700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff4c80b2cb0 0x7ff4c815d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38824/0 (socket says 172.21.15.146:38824) 2023-10-06T11:05:57.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.240+0000 7ff4ce046700 1 -- 172.21.15.146:0/1750684479 learned_addr learned my addr 172.21.15.146:0/1750684479 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:05:57.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.240+0000 7ff4cd845700 1 --2- 172.21.15.146:0/1750684479 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4c80b28e0 0x7ff4c80c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:57.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.240+0000 7ff4cd044700 1 -- 172.21.15.146:0/1750684479 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4c80b28e0 msgr2=0x7ff4c80c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:57.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.240+0000 7ff4cd044700 1 --2- 172.21.15.146:0/1750684479 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4c80b28e0 0x7ff4c80c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:57.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.240+0000 7ff4cd044700 1 -- 172.21.15.146:0/1750684479 >> v1:172.21.15.146:6789/0 conn(0x7ff4c80b2cb0 legacy=0x7ff4c815d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:57.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.240+0000 7ff4cd044700 1 -- 172.21.15.146:0/1750684479 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c80c69a0 con 0x7ff4c80c53f0 2023-10-06T11:05:57.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.240+0000 7ff4cd845700 1 --2- 172.21.15.146:0/1750684479 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4c80b28e0 0x7ff4c80c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:05:57.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.240+0000 7ff4cc843700 1 -- 172.21.15.146:0/1750684479 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2660633419 0 0) 0x7ff4c80ad2a0 con 0x7ff4c80b2cb0 2023-10-06T11:05:57.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.240+0000 7ff4cd044700 1 --2- 172.21.15.146:0/1750684479 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4c80c53f0 0x7ff4c80cebc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff4b80098e0 tx=0x7ff4b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93c6b22a649da2e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:57.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.240+0000 7ff4cc843700 1 -- 172.21.15.146:0/1750684479 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b8009e80 con 0x7ff4c80c53f0 2023-10-06T11:05:57.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.240+0000 7ff4cc843700 1 -- 172.21.15.146:0/1750684479 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b800b860 con 0x7ff4c80c53f0 2023-10-06T11:05:57.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.240+0000 7ff4cc843700 1 -- 172.21.15.146:0/1750684479 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b800bbe0 con 0x7ff4c80c53f0 2023-10-06T11:05:57.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.241+0000 7ff4cfaa9700 1 -- 172.21.15.146:0/1750684479 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4c80c53f0 msgr2=0x7ff4c80cebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:57.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.241+0000 7ff4cfaa9700 1 --2- 172.21.15.146:0/1750684479 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4c80c53f0 0x7ff4c80cebc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff4b80098e0 tx=0x7ff4b80091a0 comp rx=0 tx=0).stop 2023-10-06T11:05:57.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.241+0000 7ff4cfaa9700 1 -- 172.21.15.146:0/1750684479 shutdown_connections 2023-10-06T11:05:57.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.241+0000 7ff4cfaa9700 1 --2- 172.21.15.146:0/1750684479 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4c80b28e0 0x7ff4c80c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:57.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.241+0000 7ff4cfaa9700 1 --2- 172.21.15.146:0/1750684479 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4c80c53f0 0x7ff4c80cebc0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:57.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.241+0000 7ff4cfaa9700 1 -- 172.21.15.146:0/1750684479 >> 172.21.15.146:0/1750684479 conn(0x7ff4c80999a0 msgr2=0x7ff4c806f380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:57.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.241+0000 7ff4cfaa9700 1 -- 172.21.15.146:0/1750684479 shutdown_connections 2023-10-06T11:05:57.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.241+0000 7ff4cfaa9700 1 -- 172.21.15.146:0/1750684479 wait complete. 2023-10-06T11:05:57.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.242+0000 7ff4cfaa9700 1 Processor -- start 2023-10-06T11:05:57.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.242+0000 7ff4cfaa9700 1 -- start start 2023-10-06T11:05:57.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.243+0000 7ff4cfaa9700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4c80b28e0 0x7ff4c80c9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:57.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.243+0000 7ff4cfaa9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4c80b2cb0 0x7ff4c816cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:57.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.243+0000 7ff4cfaa9700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4c80c53f0 0x7ff4c816a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:57.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.243+0000 7ff4cfaa9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c816c6f0 con 0x7ff4c80b2cb0 2023-10-06T11:05:57.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.243+0000 7ff4cfaa9700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c80cb6a0 con 0x7ff4c80b28e0 2023-10-06T11:05:57.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.243+0000 7ff4cfaa9700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c80cb8f0 con 0x7ff4c80c53f0 2023-10-06T11:05:57.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.243+0000 7ff4cd044700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4c80b2cb0 0x7ff4c816cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:57.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.243+0000 7ff4cd044700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4c80b2cb0 0x7ff4c816cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40078/0 (socket says 172.21.15.146:40078) 2023-10-06T11:05:57.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.243+0000 7ff4cd044700 1 -- 172.21.15.146:0/559603456 learned_addr learned my addr 172.21.15.146:0/559603456 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:57.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.243+0000 7ff4cd845700 1 --2- 172.21.15.146:0/559603456 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4c80b28e0 0x7ff4c80c9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:57.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.243+0000 7ff4ce046700 1 --2- 172.21.15.146:0/559603456 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4c80c53f0 0x7ff4c816a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:57.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.243+0000 7ff4cd044700 1 -- 172.21.15.146:0/559603456 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4c80c53f0 msgr2=0x7ff4c816a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:57.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.243+0000 7ff4cd044700 1 --2- 172.21.15.146:0/559603456 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4c80c53f0 0x7ff4c816a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:57.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.243+0000 7ff4cd044700 1 -- 172.21.15.146:0/559603456 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4c80b28e0 msgr2=0x7ff4c80c9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:57.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.243+0000 7ff4cd044700 1 --2- 172.21.15.146:0/559603456 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4c80b28e0 0x7ff4c80c9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:57.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.243+0000 7ff4cd044700 1 -- 172.21.15.146:0/559603456 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b8009420 con 0x7ff4c80b2cb0 2023-10-06T11:05:57.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.243+0000 7ff4ce046700 1 --2- 172.21.15.146:0/559603456 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4c80c53f0 0x7ff4c816a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:05:57.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.243+0000 7ff4cd044700 1 --2- 172.21.15.146:0/559603456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4c80b2cb0 0x7ff4c816cb20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8071340 tx=0x7ff4b8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:57.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.243+0000 7ff4bdffb700 1 -- 172.21.15.146:0/559603456 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b800b9d0 con 0x7ff4c80b2cb0 2023-10-06T11:05:57.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.243+0000 7ff4bdffb700 1 -- 172.21.15.146:0/559603456 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b800bb50 con 0x7ff4c80b2cb0 2023-10-06T11:05:57.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.243+0000 7ff4cfaa9700 1 -- 172.21.15.146:0/559603456 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c80cbbd0 con 0x7ff4c80b2cb0 2023-10-06T11:05:57.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.243+0000 7ff4bdffb700 1 -- 172.21.15.146:0/559603456 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b8025670 con 0x7ff4c80b2cb0 2023-10-06T11:05:57.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.244+0000 7ff4cfaa9700 1 -- 172.21.15.146:0/559603456 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c80cc190 con 0x7ff4c80b2cb0 2023-10-06T11:05:57.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.244+0000 7ff4cfaa9700 1 -- 172.21.15.146:0/559603456 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4c804c380 con 0x7ff4c80b2cb0 2023-10-06T11:05:57.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.245+0000 7ff4bdffb700 1 -- 172.21.15.146:0/559603456 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff4b8023070 con 0x7ff4c80b2cb0 2023-10-06T11:05:57.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.245+0000 7ff4bdffb700 1 --2- 172.21.15.146:0/559603456 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff4ac066f30 0x7ff4ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:57.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.245+0000 7ff4bdffb700 1 -- 172.21.15.146:0/559603456 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff4b8085d10 con 0x7ff4c80b2cb0 2023-10-06T11:05:57.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.245+0000 7ff4cd845700 1 --2- 172.21.15.146:0/559603456 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff4ac066f30 0x7ff4ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:57.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.246+0000 7ff4cd845700 1 --2- 172.21.15.146:0/559603456 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff4ac066f30 0x7ff4ac0693e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4007fd0 tx=0x7ff4c400e040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:57.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.250+0000 7ff4bdffb700 1 -- 172.21.15.146:0/559603456 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff4b8052e20 con 0x7ff4c80b2cb0 2023-10-06T11:05:57.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.430+0000 7ff4cfaa9700 1 -- 172.21.15.146:0/559603456 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff4c80c6c80 con 0x7ff4ac066f30 2023-10-06T11:05:57.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.438+0000 7ff4bdffb700 1 -- 172.21.15.146:0/559603456 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286728 (secure 0 0 0) 0x7ff4c80c6c80 con 0x7ff4ac066f30 2023-10-06T11:05:57.446 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:05:57.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.441+0000 7ff4cfaa9700 1 -- 172.21.15.146:0/559603456 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff4ac066f30 msgr2=0x7ff4ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:57.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.442+0000 7ff4cfaa9700 1 --2- 172.21.15.146:0/559603456 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff4ac066f30 0x7ff4ac0693e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff4c4007fd0 tx=0x7ff4c400e040 comp rx=0 tx=0).stop 2023-10-06T11:05:57.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.442+0000 7ff4cfaa9700 1 -- 172.21.15.146:0/559603456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4c80b2cb0 msgr2=0x7ff4c816cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:57.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.442+0000 7ff4cfaa9700 1 --2- 172.21.15.146:0/559603456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4c80b2cb0 0x7ff4c816cb20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff4c8071340 tx=0x7ff4b8017000 comp rx=0 tx=0).stop 2023-10-06T11:05:57.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.442+0000 7ff4cfaa9700 1 -- 172.21.15.146:0/559603456 shutdown_connections 2023-10-06T11:05:57.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.442+0000 7ff4cfaa9700 1 --2- 172.21.15.146:0/559603456 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff4ac066f30 0x7ff4ac0693e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:57.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.442+0000 7ff4cfaa9700 1 --2- 172.21.15.146:0/559603456 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4c80c53f0 0x7ff4c816a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:57.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.442+0000 7ff4cfaa9700 1 --2- 172.21.15.146:0/559603456 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4c80b28e0 0x7ff4c80c9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:57.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.442+0000 7ff4cfaa9700 1 --2- 172.21.15.146:0/559603456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4c80b2cb0 0x7ff4c816cb20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:57.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.442+0000 7ff4cfaa9700 1 -- 172.21.15.146:0/559603456 >> 172.21.15.146:0/559603456 conn(0x7ff4c80999a0 msgr2=0x7ff4c8068630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:57.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.442+0000 7ff4cfaa9700 1 -- 172.21.15.146:0/559603456 shutdown_connections 2023-10-06T11:05:57.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.442+0000 7ff4cfaa9700 1 -- 172.21.15.146:0/559603456 wait complete. 2023-10-06T11:05:57.451 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:05:57.456 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-06T11:05:57.144746+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381112,"kb_used_data":2808,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593608,"statfs":{"total":773094113280,"available":770655854592,"internally_reserved":0,"allocated":2875392,"data_stored":1773408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.770589"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.376223+0000","last_change":"2023-10-06T11:05:44.374095+0000","last_active":"2023-10-06T11:05:44.376223+0000","last_peered":"2023-10-06T11:05:44.376223+0000","last_clean":"2023-10-06T11:05:44.376223+0000","last_became_active":"2023-10-06T11:05:44.373839+0000","last_became_peered":"2023-10-06T11:05:44.373839+0000","last_unstale":"2023-10-06T11:05:44.376223+0000","last_undegraded":"2023-10-06T11:05:44.376223+0000","last_fullsized":"2023-10-06T11:05:44.376223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:25.910038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380398+0000","last_change":"2023-10-06T11:05:44.372580+0000","last_active":"2023-10-06T11:05:44.380398+0000","last_peered":"2023-10-06T11:05:44.380398+0000","last_clean":"2023-10-06T11:05:44.380398+0000","last_became_active":"2023-10-06T11:05:44.372338+0000","last_became_peered":"2023-10-06T11:05:44.372338+0000","last_unstale":"2023-10-06T11:05:44.380398+0000","last_undegraded":"2023-10-06T11:05:44.380398+0000","last_fullsized":"2023-10-06T11:05:44.380398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:49:53.929590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375679+0000","last_change":"2023-10-06T11:05:44.370665+0000","last_active":"2023-10-06T11:05:44.375679+0000","last_peered":"2023-10-06T11:05:44.375679+0000","last_clean":"2023-10-06T11:05:44.375679+0000","last_became_active":"2023-10-06T11:05:44.370393+0000","last_became_peered":"2023-10-06T11:05:44.370393+0000","last_unstale":"2023-10-06T11:05:44.375679+0000","last_undegraded":"2023-10-06T11:05:44.375679+0000","last_fullsized":"2023-10-06T11:05:44.375679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:11:45.592433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377408+0000","last_change":"2023-10-06T11:05:44.371604+0000","last_active":"2023-10-06T11:05:44.377408+0000","last_peered":"2023-10-06T11:05:44.377408+0000","last_clean":"2023-10-06T11:05:44.377408+0000","last_became_active":"2023-10-06T11:05:44.371305+0000","last_became_peered":"2023-10-06T11:05:44.371305+0000","last_unstale":"2023-10-06T11:05:44.377408+0000","last_undegraded":"2023-10-06T11:05:44.377408+0000","last_fullsized":"2023-10-06T11:05:44.377408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:37.914270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.370764+0000","last_change":"2023-10-06T11:05:44.368424+0000","last_active":"2023-10-06T11:05:44.370764+0000","last_peered":"2023-10-06T11:05:44.370764+0000","last_clean":"2023-10-06T11:05:44.370764+0000","last_became_active":"2023-10-06T11:05:44.368174+0000","last_became_peered":"2023-10-06T11:05:44.368174+0000","last_unstale":"2023-10-06T11:05:44.370764+0000","last_undegraded":"2023-10-06T11:05:44.370764+0000","last_fullsized":"2023-10-06T11:05:44.370764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:48.500150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375623+0000","last_change":"2023-10-06T11:05:44.369384+0000","last_active":"2023-10-06T11:05:44.375623+0000","last_peered":"2023-10-06T11:05:44.375623+0000","last_clean":"2023-10-06T11:05:44.375623+0000","last_became_active":"2023-10-06T11:05:44.369114+0000","last_became_peered":"2023-10-06T11:05:44.369114+0000","last_unstale":"2023-10-06T11:05:44.375623+0000","last_undegraded":"2023-10-06T11:05:44.375623+0000","last_fullsized":"2023-10-06T11:05:44.375623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:11:02.117432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.381050+0000","last_change":"2023-10-06T11:05:44.376045+0000","last_active":"2023-10-06T11:05:44.381050+0000","last_peered":"2023-10-06T11:05:44.381050+0000","last_clean":"2023-10-06T11:05:44.381050+0000","last_became_active":"2023-10-06T11:05:44.374697+0000","last_became_peered":"2023-10-06T11:05:44.374697+0000","last_unstale":"2023-10-06T11:05:44.381050+0000","last_undegraded":"2023-10-06T11:05:44.381050+0000","last_fullsized":"2023-10-06T11:05:44.381050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:30:10.233024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377816+0000","last_change":"2023-10-06T11:05:44.370424+0000","last_active":"2023-10-06T11:05:44.377816+0000","last_peered":"2023-10-06T11:05:44.377816+0000","last_clean":"2023-10-06T11:05:44.377816+0000","last_became_active":"2023-10-06T11:05:44.370141+0000","last_became_peered":"2023-10-06T11:05:44.370141+0000","last_unstale":"2023-10-06T11:05:44.377816+0000","last_undegraded":"2023-10-06T11:05:44.377816+0000","last_fullsized":"2023-10-06T11:05:44.377816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:32:17.346227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.374345+0000","last_change":"2023-10-06T11:05:44.370535+0000","last_active":"2023-10-06T11:05:44.374345+0000","last_peered":"2023-10-06T11:05:44.374345+0000","last_clean":"2023-10-06T11:05:44.374345+0000","last_became_active":"2023-10-06T11:05:44.370264+0000","last_became_peered":"2023-10-06T11:05:44.370264+0000","last_unstale":"2023-10-06T11:05:44.374345+0000","last_undegraded":"2023-10-06T11:05:44.374345+0000","last_fullsized":"2023-10-06T11:05:44.374345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:18:11.738273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377689+0000","last_change":"2023-10-06T11:05:44.363111+0000","last_active":"2023-10-06T11:05:44.377689+0000","last_peered":"2023-10-06T11:05:44.377689+0000","last_clean":"2023-10-06T11:05:44.377689+0000","last_became_active":"2023-10-06T11:05:44.362803+0000","last_became_peered":"2023-10-06T11:05:44.362803+0000","last_unstale":"2023-10-06T11:05:44.377689+0000","last_undegraded":"2023-10-06T11:05:44.377689+0000","last_fullsized":"2023-10-06T11:05:44.377689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:49:41.512642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375661+0000","last_change":"2023-10-06T11:05:44.370641+0000","last_active":"2023-10-06T11:05:44.375661+0000","last_peered":"2023-10-06T11:05:44.375661+0000","last_clean":"2023-10-06T11:05:44.375661+0000","last_became_active":"2023-10-06T11:05:44.370078+0000","last_became_peered":"2023-10-06T11:05:44.370078+0000","last_unstale":"2023-10-06T11:05:44.375661+0000","last_undegraded":"2023-10-06T11:05:44.375661+0000","last_fullsized":"2023-10-06T11:05:44.375661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:34:03.025480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.365243+0000","last_change":"2023-10-06T11:05:44.362523+0000","last_active":"2023-10-06T11:05:44.365243+0000","last_peered":"2023-10-06T11:05:44.365243+0000","last_clean":"2023-10-06T11:05:44.365243+0000","last_became_active":"2023-10-06T11:05:44.362248+0000","last_became_peered":"2023-10-06T11:05:44.362248+0000","last_unstale":"2023-10-06T11:05:44.365243+0000","last_undegraded":"2023-10-06T11:05:44.365243+0000","last_fullsized":"2023-10-06T11:05:44.365243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:33.869834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.376261+0000","last_change":"2023-10-06T11:05:44.373706+0000","last_active":"2023-10-06T11:05:44.376261+0000","last_peered":"2023-10-06T11:05:44.376261+0000","last_clean":"2023-10-06T11:05:44.376261+0000","last_became_active":"2023-10-06T11:05:44.373408+0000","last_became_peered":"2023-10-06T11:05:44.373408+0000","last_unstale":"2023-10-06T11:05:44.376261+0000","last_undegraded":"2023-10-06T11:05:44.376261+0000","last_fullsized":"2023-10-06T11:05:44.376261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:28.010695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377714+0000","last_change":"2023-10-06T11:05:44.364121+0000","last_active":"2023-10-06T11:05:44.377714+0000","last_peered":"2023-10-06T11:05:44.377714+0000","last_clean":"2023-10-06T11:05:44.377714+0000","last_became_active":"2023-10-06T11:05:44.363863+0000","last_became_peered":"2023-10-06T11:05:44.363863+0000","last_unstale":"2023-10-06T11:05:44.377714+0000","last_undegraded":"2023-10-06T11:05:44.377714+0000","last_fullsized":"2023-10-06T11:05:44.377714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:51.490766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.381068+0000","last_change":"2023-10-06T11:05:44.376146+0000","last_active":"2023-10-06T11:05:44.381068+0000","last_peered":"2023-10-06T11:05:44.381068+0000","last_clean":"2023-10-06T11:05:44.381068+0000","last_became_active":"2023-10-06T11:05:44.375877+0000","last_became_peered":"2023-10-06T11:05:44.375877+0000","last_unstale":"2023-10-06T11:05:44.381068+0000","last_undegraded":"2023-10-06T11:05:44.381068+0000","last_fullsized":"2023-10-06T11:05:44.381068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:25:37.173612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375588+0000","last_change":"2023-10-06T11:05:44.371531+0000","last_active":"2023-10-06T11:05:44.375588+0000","last_peered":"2023-10-06T11:05:44.375588+0000","last_clean":"2023-10-06T11:05:44.375588+0000","last_became_active":"2023-10-06T11:05:44.371082+0000","last_became_peered":"2023-10-06T11:05:44.371082+0000","last_unstale":"2023-10-06T11:05:44.375588+0000","last_undegraded":"2023-10-06T11:05:44.375588+0000","last_fullsized":"2023-10-06T11:05:44.375588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:16:26.923074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377465+0000","last_change":"2023-10-06T11:05:44.374262+0000","last_active":"2023-10-06T11:05:44.377465+0000","last_peered":"2023-10-06T11:05:44.377465+0000","last_clean":"2023-10-06T11:05:44.377465+0000","last_became_active":"2023-10-06T11:05:44.373997+0000","last_became_peered":"2023-10-06T11:05:44.373997+0000","last_unstale":"2023-10-06T11:05:44.377465+0000","last_undegraded":"2023-10-06T11:05:44.377465+0000","last_fullsized":"2023-10-06T11:05:44.377465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:30:10.233024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375434+0000","last_change":"2023-10-06T11:05:44.369716+0000","last_active":"2023-10-06T11:05:44.375434+0000","last_peered":"2023-10-06T11:05:44.375434+0000","last_clean":"2023-10-06T11:05:44.375434+0000","last_became_active":"2023-10-06T11:05:44.369434+0000","last_became_peered":"2023-10-06T11:05:44.369434+0000","last_unstale":"2023-10-06T11:05:44.375434+0000","last_undegraded":"2023-10-06T11:05:44.375434+0000","last_fullsized":"2023-10-06T11:05:44.375434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:53:21.828799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377738+0000","last_change":"2023-10-06T11:05:44.376536+0000","last_active":"2023-10-06T11:05:44.377738+0000","last_peered":"2023-10-06T11:05:44.377738+0000","last_clean":"2023-10-06T11:05:44.377738+0000","last_became_active":"2023-10-06T11:05:44.376291+0000","last_became_peered":"2023-10-06T11:05:44.376291+0000","last_unstale":"2023-10-06T11:05:44.377738+0000","last_undegraded":"2023-10-06T11:05:44.377738+0000","last_fullsized":"2023-10-06T11:05:44.377738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:19.308513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380092+0000","last_change":"2023-10-06T11:05:44.374492+0000","last_active":"2023-10-06T11:05:44.380092+0000","last_peered":"2023-10-06T11:05:44.380092+0000","last_clean":"2023-10-06T11:05:44.380092+0000","last_became_active":"2023-10-06T11:05:44.374108+0000","last_became_peered":"2023-10-06T11:05:44.374108+0000","last_unstale":"2023-10-06T11:05:44.380092+0000","last_undegraded":"2023-10-06T11:05:44.380092+0000","last_fullsized":"2023-10-06T11:05:44.380092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:36:18.739157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380978+0000","last_change":"2023-10-06T11:05:44.373773+0000","last_active":"2023-10-06T11:05:44.380978+0000","last_peered":"2023-10-06T11:05:44.380978+0000","last_clean":"2023-10-06T11:05:44.380978+0000","last_became_active":"2023-10-06T11:05:44.373445+0000","last_became_peered":"2023-10-06T11:05:44.373445+0000","last_unstale":"2023-10-06T11:05:44.380978+0000","last_undegraded":"2023-10-06T11:05:44.380978+0000","last_fullsized":"2023-10-06T11:05:44.380978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:48.500150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.370569+0000","last_change":"2023-10-06T11:05:44.365767+0000","last_active":"2023-10-06T11:05:44.370569+0000","last_peered":"2023-10-06T11:05:44.370569+0000","last_clean":"2023-10-06T11:05:44.370569+0000","last_became_active":"2023-10-06T11:05:44.365489+0000","last_became_peered":"2023-10-06T11:05:44.365489+0000","last_unstale":"2023-10-06T11:05:44.370569+0000","last_undegraded":"2023-10-06T11:05:44.370569+0000","last_fullsized":"2023-10-06T11:05:44.370569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:36:18.739157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379611+0000","last_change":"2023-10-06T11:05:44.373554+0000","last_active":"2023-10-06T11:05:44.379611+0000","last_peered":"2023-10-06T11:05:44.379611+0000","last_clean":"2023-10-06T11:05:44.379611+0000","last_became_active":"2023-10-06T11:05:44.373293+0000","last_became_peered":"2023-10-06T11:05:44.373293+0000","last_unstale":"2023-10-06T11:05:44.379611+0000","last_undegraded":"2023-10-06T11:05:44.379611+0000","last_fullsized":"2023-10-06T11:05:44.379611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:32:31.703547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380998+0000","last_change":"2023-10-06T11:05:44.373832+0000","last_active":"2023-10-06T11:05:44.380998+0000","last_peered":"2023-10-06T11:05:44.380998+0000","last_clean":"2023-10-06T11:05:44.380998+0000","last_became_active":"2023-10-06T11:05:44.373527+0000","last_became_peered":"2023-10-06T11:05:44.373527+0000","last_unstale":"2023-10-06T11:05:44.380998+0000","last_undegraded":"2023-10-06T11:05:44.380998+0000","last_fullsized":"2023-10-06T11:05:44.380998+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:49:53.929590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377989+0000","last_change":"2023-10-06T11:05:44.375109+0000","last_active":"2023-10-06T11:05:44.377989+0000","last_peered":"2023-10-06T11:05:44.377989+0000","last_clean":"2023-10-06T11:05:44.377989+0000","last_became_active":"2023-10-06T11:05:44.374861+0000","last_became_peered":"2023-10-06T11:05:44.374861+0000","last_unstale":"2023-10-06T11:05:44.377989+0000","last_undegraded":"2023-10-06T11:05:44.377989+0000","last_fullsized":"2023-10-06T11:05:44.377989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:36:26.414372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377747+0000","last_change":"2023-10-06T11:05:44.372987+0000","last_active":"2023-10-06T11:05:44.377747+0000","last_peered":"2023-10-06T11:05:44.377747+0000","last_clean":"2023-10-06T11:05:44.377747+0000","last_became_active":"2023-10-06T11:05:44.369828+0000","last_became_peered":"2023-10-06T11:05:44.369828+0000","last_unstale":"2023-10-06T11:05:44.377747+0000","last_undegraded":"2023-10-06T11:05:44.377747+0000","last_fullsized":"2023-10-06T11:05:44.377747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:42.381985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380422+0000","last_change":"2023-10-06T11:05:44.372985+0000","last_active":"2023-10-06T11:05:44.380422+0000","last_peered":"2023-10-06T11:05:44.380422+0000","last_clean":"2023-10-06T11:05:44.380422+0000","last_became_active":"2023-10-06T11:05:44.372531+0000","last_became_peered":"2023-10-06T11:05:44.372531+0000","last_unstale":"2023-10-06T11:05:44.380422+0000","last_undegraded":"2023-10-06T11:05:44.380422+0000","last_fullsized":"2023-10-06T11:05:44.380422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:36:26.414372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.382453+0000","last_change":"2023-10-06T11:05:43.369136+0000","last_active":"2023-10-06T11:05:44.382453+0000","last_peered":"2023-10-06T11:05:44.382453+0000","last_clean":"2023-10-06T11:05:44.382453+0000","last_became_active":"2023-10-06T11:05:43.368830+0000","last_became_peered":"2023-10-06T11:05:43.368830+0000","last_unstale":"2023-10-06T11:05:44.382453+0000","last_undegraded":"2023-10-06T11:05:44.382453+0000","last_fullsized":"2023-10-06T11:05:44.382453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:27.003956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.370597+0000","last_change":"2023-10-06T11:05:44.367477+0000","last_active":"2023-10-06T11:05:44.370597+0000","last_peered":"2023-10-06T11:05:44.370597+0000","last_clean":"2023-10-06T11:05:44.370597+0000","last_became_active":"2023-10-06T11:05:44.367216+0000","last_became_peered":"2023-10-06T11:05:44.367216+0000","last_unstale":"2023-10-06T11:05:44.370597+0000","last_undegraded":"2023-10-06T11:05:44.370597+0000","last_fullsized":"2023-10-06T11:05:44.370597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:48.500150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.364950+0000","last_change":"2023-10-06T11:05:43.369127+0000","last_active":"2023-10-06T11:05:44.364950+0000","last_peered":"2023-10-06T11:05:44.364950+0000","last_clean":"2023-10-06T11:05:44.364950+0000","last_became_active":"2023-10-06T11:05:43.368806+0000","last_became_peered":"2023-10-06T11:05:43.368806+0000","last_unstale":"2023-10-06T11:05:44.364950+0000","last_undegraded":"2023-10-06T11:05:44.364950+0000","last_fullsized":"2023-10-06T11:05:44.364950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:51.324615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.370930+0000","last_change":"2023-10-06T11:05:44.367950+0000","last_active":"2023-10-06T11:05:44.370930+0000","last_peered":"2023-10-06T11:05:44.370930+0000","last_clean":"2023-10-06T11:05:44.370930+0000","last_became_active":"2023-10-06T11:05:44.367682+0000","last_became_peered":"2023-10-06T11:05:44.367682+0000","last_unstale":"2023-10-06T11:05:44.370930+0000","last_undegraded":"2023-10-06T11:05:44.370930+0000","last_fullsized":"2023-10-06T11:05:44.370930+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:53:21.828799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.356971+0000","last_change":"2023-10-06T11:05:43.366406+0000","last_active":"2023-10-06T11:05:44.356971+0000","last_peered":"2023-10-06T11:05:44.356971+0000","last_clean":"2023-10-06T11:05:44.356971+0000","last_became_active":"2023-10-06T11:05:43.366004+0000","last_became_peered":"2023-10-06T11:05:43.366004+0000","last_unstale":"2023-10-06T11:05:44.356971+0000","last_undegraded":"2023-10-06T11:05:44.356971+0000","last_fullsized":"2023-10-06T11:05:44.356971+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:00.477669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.382373+0000","last_change":"2023-10-06T11:05:44.378728+0000","last_active":"2023-10-06T11:05:44.382373+0000","last_peered":"2023-10-06T11:05:44.382373+0000","last_clean":"2023-10-06T11:05:44.382373+0000","last_became_active":"2023-10-06T11:05:44.378467+0000","last_became_peered":"2023-10-06T11:05:44.378467+0000","last_unstale":"2023-10-06T11:05:44.382373+0000","last_undegraded":"2023-10-06T11:05:44.382373+0000","last_fullsized":"2023-10-06T11:05:44.382373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:20:05.796456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.353362+0000","last_change":"2023-10-06T11:05:43.362935+0000","last_active":"2023-10-06T11:05:44.353362+0000","last_peered":"2023-10-06T11:05:44.353362+0000","last_clean":"2023-10-06T11:05:44.353362+0000","last_became_active":"2023-10-06T11:05:43.362642+0000","last_became_peered":"2023-10-06T11:05:43.362642+0000","last_unstale":"2023-10-06T11:05:44.353362+0000","last_undegraded":"2023-10-06T11:05:44.353362+0000","last_fullsized":"2023-10-06T11:05:44.353362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:36.907530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.371257+0000","last_change":"2023-10-06T11:05:44.366360+0000","last_active":"2023-10-06T11:05:44.371257+0000","last_peered":"2023-10-06T11:05:44.371257+0000","last_clean":"2023-10-06T11:05:44.371257+0000","last_became_active":"2023-10-06T11:05:44.366097+0000","last_became_peered":"2023-10-06T11:05:44.366097+0000","last_unstale":"2023-10-06T11:05:44.371257+0000","last_undegraded":"2023-10-06T11:05:44.371257+0000","last_fullsized":"2023-10-06T11:05:44.371257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:18:11.738273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.357158+0000","last_change":"2023-10-06T11:05:43.365582+0000","last_active":"2023-10-06T11:05:44.357158+0000","last_peered":"2023-10-06T11:05:44.357158+0000","last_clean":"2023-10-06T11:05:44.357158+0000","last_became_active":"2023-10-06T11:05:43.365197+0000","last_became_peered":"2023-10-06T11:05:43.365197+0000","last_unstale":"2023-10-06T11:05:44.357158+0000","last_undegraded":"2023-10-06T11:05:44.357158+0000","last_fullsized":"2023-10-06T11:05:44.357158+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:59:28.141215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.373455+0000","last_change":"2023-10-06T11:05:44.369545+0000","last_active":"2023-10-06T11:05:44.373455+0000","last_peered":"2023-10-06T11:05:44.373455+0000","last_clean":"2023-10-06T11:05:44.373455+0000","last_became_active":"2023-10-06T11:05:44.369228+0000","last_became_peered":"2023-10-06T11:05:44.369228+0000","last_unstale":"2023-10-06T11:05:44.373455+0000","last_undegraded":"2023-10-06T11:05:44.373455+0000","last_fullsized":"2023-10-06T11:05:44.373455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:36:18.739157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.378674+0000","last_change":"2023-10-06T11:05:43.370700+0000","last_active":"2023-10-06T11:05:44.378674+0000","last_peered":"2023-10-06T11:05:44.378674+0000","last_clean":"2023-10-06T11:05:44.378674+0000","last_became_active":"2023-10-06T11:05:43.370418+0000","last_became_peered":"2023-10-06T11:05:43.370418+0000","last_unstale":"2023-10-06T11:05:44.378674+0000","last_undegraded":"2023-10-06T11:05:44.378674+0000","last_fullsized":"2023-10-06T11:05:44.378674+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:03.585687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377957+0000","last_change":"2023-10-06T11:05:44.375285+0000","last_active":"2023-10-06T11:05:44.377957+0000","last_peered":"2023-10-06T11:05:44.377957+0000","last_clean":"2023-10-06T11:05:44.377957+0000","last_became_active":"2023-10-06T11:05:44.374774+0000","last_became_peered":"2023-10-06T11:05:44.374774+0000","last_unstale":"2023-10-06T11:05:44.377957+0000","last_undegraded":"2023-10-06T11:05:44.377957+0000","last_fullsized":"2023-10-06T11:05:44.377957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:32:17.346227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.385298+0000","last_change":"2023-10-06T11:05:43.363844+0000","last_active":"2023-10-06T11:05:44.385298+0000","last_peered":"2023-10-06T11:05:44.385298+0000","last_clean":"2023-10-06T11:05:44.385298+0000","last_became_active":"2023-10-06T11:05:43.363568+0000","last_became_peered":"2023-10-06T11:05:43.363568+0000","last_unstale":"2023-10-06T11:05:44.385298+0000","last_undegraded":"2023-10-06T11:05:44.385298+0000","last_fullsized":"2023-10-06T11:05:44.385298+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:51.324615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.382342+0000","last_change":"2023-10-06T11:05:44.375145+0000","last_active":"2023-10-06T11:05:44.382342+0000","last_peered":"2023-10-06T11:05:44.382342+0000","last_clean":"2023-10-06T11:05:44.382342+0000","last_became_active":"2023-10-06T11:05:44.374868+0000","last_became_peered":"2023-10-06T11:05:44.374868+0000","last_unstale":"2023-10-06T11:05:44.382342+0000","last_undegraded":"2023-10-06T11:05:44.382342+0000","last_fullsized":"2023-10-06T11:05:44.382342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:48.500150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.378534+0000","last_change":"2023-10-06T11:05:43.369646+0000","last_active":"2023-10-06T11:05:44.378534+0000","last_peered":"2023-10-06T11:05:44.378534+0000","last_clean":"2023-10-06T11:05:44.378534+0000","last_became_active":"2023-10-06T11:05:43.369353+0000","last_became_peered":"2023-10-06T11:05:43.369353+0000","last_unstale":"2023-10-06T11:05:44.378534+0000","last_undegraded":"2023-10-06T11:05:44.378534+0000","last_fullsized":"2023-10-06T11:05:44.378534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:50.484027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379530+0000","last_change":"2023-10-06T11:05:44.372738+0000","last_active":"2023-10-06T11:05:44.379530+0000","last_peered":"2023-10-06T11:05:44.379530+0000","last_clean":"2023-10-06T11:05:44.379530+0000","last_became_active":"2023-10-06T11:05:44.372299+0000","last_became_peered":"2023-10-06T11:05:44.372299+0000","last_unstale":"2023-10-06T11:05:44.379530+0000","last_undegraded":"2023-10-06T11:05:44.379530+0000","last_fullsized":"2023-10-06T11:05:44.379530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:53:21.828799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.352712+0000","last_change":"2023-10-06T11:05:43.364085+0000","last_active":"2023-10-06T11:05:44.352712+0000","last_peered":"2023-10-06T11:05:44.352712+0000","last_clean":"2023-10-06T11:05:44.352712+0000","last_became_active":"2023-10-06T11:05:43.363844+0000","last_became_peered":"2023-10-06T11:05:43.363844+0000","last_unstale":"2023-10-06T11:05:44.352712+0000","last_undegraded":"2023-10-06T11:05:44.352712+0000","last_fullsized":"2023-10-06T11:05:44.352712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:51.324615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380405+0000","last_change":"2023-10-06T11:05:44.372815+0000","last_active":"2023-10-06T11:05:44.380405+0000","last_peered":"2023-10-06T11:05:44.380405+0000","last_clean":"2023-10-06T11:05:44.380405+0000","last_became_active":"2023-10-06T11:05:44.372237+0000","last_became_peered":"2023-10-06T11:05:44.372237+0000","last_unstale":"2023-10-06T11:05:44.380405+0000","last_undegraded":"2023-10-06T11:05:44.380405+0000","last_fullsized":"2023-10-06T11:05:44.380405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:20:42.381985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.363864+0000","last_change":"2023-10-06T11:05:43.369142+0000","last_active":"2023-10-06T11:05:44.363864+0000","last_peered":"2023-10-06T11:05:44.363864+0000","last_clean":"2023-10-06T11:05:44.363864+0000","last_became_active":"2023-10-06T11:05:43.368847+0000","last_became_peered":"2023-10-06T11:05:43.368847+0000","last_unstale":"2023-10-06T11:05:44.363864+0000","last_undegraded":"2023-10-06T11:05:44.363864+0000","last_fullsized":"2023-10-06T11:05:44.363864+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:48:23.698446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.373918+0000","last_change":"2023-10-06T11:05:44.370314+0000","last_active":"2023-10-06T11:05:44.373918+0000","last_peered":"2023-10-06T11:05:44.373918+0000","last_clean":"2023-10-06T11:05:44.373918+0000","last_became_active":"2023-10-06T11:05:44.370065+0000","last_became_peered":"2023-10-06T11:05:44.370065+0000","last_unstale":"2023-10-06T11:05:44.373918+0000","last_undegraded":"2023-10-06T11:05:44.373918+0000","last_fullsized":"2023-10-06T11:05:44.373918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:32:31.703547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377619+0000","last_change":"2023-10-06T11:05:43.366052+0000","last_active":"2023-10-06T11:05:44.377619+0000","last_peered":"2023-10-06T11:05:44.377619+0000","last_clean":"2023-10-06T11:05:44.377619+0000","last_became_active":"2023-10-06T11:05:43.365790+0000","last_became_peered":"2023-10-06T11:05:43.365790+0000","last_unstale":"2023-10-06T11:05:44.377619+0000","last_undegraded":"2023-10-06T11:05:44.377619+0000","last_fullsized":"2023-10-06T11:05:44.377619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:59:28.141215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379857+0000","last_change":"2023-10-06T11:05:44.372870+0000","last_active":"2023-10-06T11:05:44.379857+0000","last_peered":"2023-10-06T11:05:44.379857+0000","last_clean":"2023-10-06T11:05:44.379857+0000","last_became_active":"2023-10-06T11:05:44.372480+0000","last_became_peered":"2023-10-06T11:05:44.372480+0000","last_unstale":"2023-10-06T11:05:44.379857+0000","last_undegraded":"2023-10-06T11:05:44.379857+0000","last_fullsized":"2023-10-06T11:05:44.379857+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:25:37.173612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.378371+0000","last_change":"2023-10-06T11:05:43.369672+0000","last_active":"2023-10-06T11:05:44.378371+0000","last_peered":"2023-10-06T11:05:44.378371+0000","last_clean":"2023-10-06T11:05:44.378371+0000","last_became_active":"2023-10-06T11:05:43.369415+0000","last_became_peered":"2023-10-06T11:05:43.369415+0000","last_unstale":"2023-10-06T11:05:44.378371+0000","last_undegraded":"2023-10-06T11:05:44.378371+0000","last_fullsized":"2023-10-06T11:05:44.378371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:21:07.005347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.385017+0000","last_change":"2023-10-06T11:05:44.380100+0000","last_active":"2023-10-06T11:05:44.385017+0000","last_peered":"2023-10-06T11:05:44.385017+0000","last_clean":"2023-10-06T11:05:44.385017+0000","last_became_active":"2023-10-06T11:05:44.379686+0000","last_became_peered":"2023-10-06T11:05:44.379686+0000","last_unstale":"2023-10-06T11:05:44.385017+0000","last_undegraded":"2023-10-06T11:05:44.385017+0000","last_fullsized":"2023-10-06T11:05:44.385017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:32:31.703547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.378652+0000","last_change":"2023-10-06T11:05:43.369280+0000","last_active":"2023-10-06T11:05:44.378652+0000","last_peered":"2023-10-06T11:05:44.378652+0000","last_clean":"2023-10-06T11:05:44.378652+0000","last_became_active":"2023-10-06T11:05:43.369002+0000","last_became_peered":"2023-10-06T11:05:43.369002+0000","last_unstale":"2023-10-06T11:05:44.378652+0000","last_undegraded":"2023-10-06T11:05:44.378652+0000","last_fullsized":"2023-10-06T11:05:44.378652+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:53:55.024707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.365517+0000","last_change":"2023-10-06T11:05:44.363074+0000","last_active":"2023-10-06T11:05:44.365517+0000","last_peered":"2023-10-06T11:05:44.365517+0000","last_clean":"2023-10-06T11:05:44.365517+0000","last_became_active":"2023-10-06T11:05:44.362798+0000","last_became_peered":"2023-10-06T11:05:44.362798+0000","last_unstale":"2023-10-06T11:05:44.365517+0000","last_undegraded":"2023-10-06T11:05:44.365517+0000","last_fullsized":"2023-10-06T11:05:44.365517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:48:11.590704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.378605+0000","last_change":"2023-10-06T11:05:43.368847+0000","last_active":"2023-10-06T11:05:44.378605+0000","last_peered":"2023-10-06T11:05:44.378605+0000","last_clean":"2023-10-06T11:05:44.378605+0000","last_became_active":"2023-10-06T11:05:43.368394+0000","last_became_peered":"2023-10-06T11:05:43.368394+0000","last_unstale":"2023-10-06T11:05:44.378605+0000","last_undegraded":"2023-10-06T11:05:44.378605+0000","last_fullsized":"2023-10-06T11:05:44.378605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:26.238071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380176+0000","last_change":"2023-10-06T11:05:44.374404+0000","last_active":"2023-10-06T11:05:44.380176+0000","last_peered":"2023-10-06T11:05:44.380176+0000","last_clean":"2023-10-06T11:05:44.380176+0000","last_became_active":"2023-10-06T11:05:44.374017+0000","last_became_peered":"2023-10-06T11:05:44.374017+0000","last_unstale":"2023-10-06T11:05:44.380176+0000","last_undegraded":"2023-10-06T11:05:44.380176+0000","last_fullsized":"2023-10-06T11:05:44.380176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:21:51.490766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.354872+0000","last_change":"2023-10-06T11:05:43.368442+0000","last_active":"2023-10-06T11:05:44.354872+0000","last_peered":"2023-10-06T11:05:44.354872+0000","last_clean":"2023-10-06T11:05:44.354872+0000","last_became_active":"2023-10-06T11:05:43.368152+0000","last_became_peered":"2023-10-06T11:05:43.368152+0000","last_unstale":"2023-10-06T11:05:44.354872+0000","last_undegraded":"2023-10-06T11:05:44.354872+0000","last_fullsized":"2023-10-06T11:05:44.354872+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:27.003956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.371685+0000","last_change":"2023-10-06T11:05:44.368980+0000","last_active":"2023-10-06T11:05:44.371685+0000","last_peered":"2023-10-06T11:05:44.371685+0000","last_clean":"2023-10-06T11:05:44.371685+0000","last_became_active":"2023-10-06T11:05:44.368693+0000","last_became_peered":"2023-10-06T11:05:44.368693+0000","last_unstale":"2023-10-06T11:05:44.371685+0000","last_undegraded":"2023-10-06T11:05:44.371685+0000","last_fullsized":"2023-10-06T11:05:44.371685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:25:37.173612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.376448+0000","last_change":"2023-10-06T11:05:43.366389+0000","last_active":"2023-10-06T11:05:44.376448+0000","last_peered":"2023-10-06T11:05:44.376448+0000","last_clean":"2023-10-06T11:05:44.376448+0000","last_became_active":"2023-10-06T11:05:43.366041+0000","last_became_peered":"2023-10-06T11:05:43.366041+0000","last_unstale":"2023-10-06T11:05:44.376448+0000","last_undegraded":"2023-10-06T11:05:44.376448+0000","last_fullsized":"2023-10-06T11:05:44.376448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:18.301774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375589+0000","last_change":"2023-10-06T11:05:44.371594+0000","last_active":"2023-10-06T11:05:44.375589+0000","last_peered":"2023-10-06T11:05:44.375589+0000","last_clean":"2023-10-06T11:05:44.375589+0000","last_became_active":"2023-10-06T11:05:44.371316+0000","last_became_peered":"2023-10-06T11:05:44.371316+0000","last_unstale":"2023-10-06T11:05:44.375589+0000","last_undegraded":"2023-10-06T11:05:44.375589+0000","last_fullsized":"2023-10-06T11:05:44.375589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:23:15.847562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.365041+0000","last_change":"2023-10-06T11:05:43.362138+0000","last_active":"2023-10-06T11:05:44.365041+0000","last_peered":"2023-10-06T11:05:44.365041+0000","last_clean":"2023-10-06T11:05:44.365041+0000","last_became_active":"2023-10-06T11:05:43.361796+0000","last_became_peered":"2023-10-06T11:05:43.361796+0000","last_unstale":"2023-10-06T11:05:44.365041+0000","last_undegraded":"2023-10-06T11:05:44.365041+0000","last_fullsized":"2023-10-06T11:05:44.365041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:51.324615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375623+0000","last_change":"2023-10-06T11:05:44.368661+0000","last_active":"2023-10-06T11:05:44.375623+0000","last_peered":"2023-10-06T11:05:44.375623+0000","last_clean":"2023-10-06T11:05:44.375623+0000","last_became_active":"2023-10-06T11:05:44.368296+0000","last_became_peered":"2023-10-06T11:05:44.368296+0000","last_unstale":"2023-10-06T11:05:44.375623+0000","last_undegraded":"2023-10-06T11:05:44.375623+0000","last_fullsized":"2023-10-06T11:05:44.375623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:42:21.740811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.354312+0000","last_change":"2023-10-06T11:05:43.357853+0000","last_active":"2023-10-06T11:05:44.354312+0000","last_peered":"2023-10-06T11:05:44.354312+0000","last_clean":"2023-10-06T11:05:44.354312+0000","last_became_active":"2023-10-06T11:05:43.357572+0000","last_became_peered":"2023-10-06T11:05:43.357572+0000","last_unstale":"2023-10-06T11:05:44.354312+0000","last_undegraded":"2023-10-06T11:05:44.354312+0000","last_fullsized":"2023-10-06T11:05:44.354312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:18.301774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380069+0000","last_change":"2023-10-06T11:05:44.374211+0000","last_active":"2023-10-06T11:05:44.380069+0000","last_peered":"2023-10-06T11:05:44.380069+0000","last_clean":"2023-10-06T11:05:44.380069+0000","last_became_active":"2023-10-06T11:05:44.373924+0000","last_became_peered":"2023-10-06T11:05:44.373924+0000","last_unstale":"2023-10-06T11:05:44.380069+0000","last_undegraded":"2023-10-06T11:05:44.380069+0000","last_fullsized":"2023-10-06T11:05:44.380069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:18:11.738273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.357364+0000","last_change":"2023-10-06T11:05:43.367123+0000","last_active":"2023-10-06T11:05:44.357364+0000","last_peered":"2023-10-06T11:05:44.357364+0000","last_clean":"2023-10-06T11:05:44.357364+0000","last_became_active":"2023-10-06T11:05:43.366861+0000","last_became_peered":"2023-10-06T11:05:43.366861+0000","last_unstale":"2023-10-06T11:05:44.357364+0000","last_undegraded":"2023-10-06T11:05:44.357364+0000","last_fullsized":"2023-10-06T11:05:44.357364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:32.863094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377938+0000","last_change":"2023-10-06T11:05:44.374963+0000","last_active":"2023-10-06T11:05:44.377938+0000","last_peered":"2023-10-06T11:05:44.377938+0000","last_clean":"2023-10-06T11:05:44.377938+0000","last_became_active":"2023-10-06T11:05:44.374524+0000","last_became_peered":"2023-10-06T11:05:44.374524+0000","last_unstale":"2023-10-06T11:05:44.377938+0000","last_undegraded":"2023-10-06T11:05:44.377938+0000","last_fullsized":"2023-10-06T11:05:44.377938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:27.244810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379794+0000","last_change":"2023-10-06T11:05:43.367084+0000","last_active":"2023-10-06T11:05:44.379794+0000","last_peered":"2023-10-06T11:05:44.379794+0000","last_clean":"2023-10-06T11:05:44.379794+0000","last_became_active":"2023-10-06T11:05:43.366813+0000","last_became_peered":"2023-10-06T11:05:43.366813+0000","last_unstale":"2023-10-06T11:05:44.379794+0000","last_undegraded":"2023-10-06T11:05:44.379794+0000","last_fullsized":"2023-10-06T11:05:44.379794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:27.003956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.357296+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:05:44.357296+0000","last_peered":"2023-10-06T11:05:44.357296+0000","last_clean":"2023-10-06T11:05:44.357296+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:05:44.357296+0000","last_undegraded":"2023-10-06T11:05:44.357296+0000","last_fullsized":"2023-10-06T11:05:44.357296+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380176+0000","last_change":"2023-10-06T11:05:44.371162+0000","last_active":"2023-10-06T11:05:44.380176+0000","last_peered":"2023-10-06T11:05:44.380176+0000","last_clean":"2023-10-06T11:05:44.380176+0000","last_became_active":"2023-10-06T11:05:44.370923+0000","last_became_peered":"2023-10-06T11:05:44.370923+0000","last_unstale":"2023-10-06T11:05:44.380176+0000","last_undegraded":"2023-10-06T11:05:44.380176+0000","last_fullsized":"2023-10-06T11:05:44.380176+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:20.240548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.356434+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:05:44.356434+0000","last_peered":"2023-10-06T11:05:44.356434+0000","last_clean":"2023-10-06T11:05:44.356434+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:05:44.356434+0000","last_undegraded":"2023-10-06T11:05:44.356434+0000","last_fullsized":"2023-10-06T11:05:44.356434+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-06T11:05:45.427947+0000","last_change":"2023-10-06T11:05:43.365664+0000","last_active":"2023-10-06T11:05:45.427947+0000","last_peered":"2023-10-06T11:05:45.427947+0000","last_clean":"2023-10-06T11:05:45.427947+0000","last_became_active":"2023-10-06T11:05:43.365413+0000","last_became_peered":"2023-10-06T11:05:43.365413+0000","last_unstale":"2023-10-06T11:05:45.427947+0000","last_undegraded":"2023-10-06T11:05:45.427947+0000","last_fullsized":"2023-10-06T11:05:45.427947+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:32.863094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.382458+0000","last_change":"2023-10-06T11:05:44.376907+0000","last_active":"2023-10-06T11:05:44.382458+0000","last_peered":"2023-10-06T11:05:44.382458+0000","last_clean":"2023-10-06T11:05:44.382458+0000","last_became_active":"2023-10-06T11:05:44.376549+0000","last_became_peered":"2023-10-06T11:05:44.376549+0000","last_unstale":"2023-10-06T11:05:44.382458+0000","last_undegraded":"2023-10-06T11:05:44.382458+0000","last_fullsized":"2023-10-06T11:05:44.382458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:48:35.935962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.364783+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:05:44.364783+0000","last_peered":"2023-10-06T11:05:44.364783+0000","last_clean":"2023-10-06T11:05:44.364783+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:05:44.364783+0000","last_undegraded":"2023-10-06T11:05:44.364783+0000","last_fullsized":"2023-10-06T11:05:44.364783+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.366104+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:05:44.366104+0000","last_peered":"2023-10-06T11:05:44.366104+0000","last_clean":"2023-10-06T11:05:44.366104+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:05:44.366104+0000","last_undegraded":"2023-10-06T11:05:44.366104+0000","last_fullsized":"2023-10-06T11:05:44.366104+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.352615+0000","last_change":"2023-10-06T11:05:43.368370+0000","last_active":"2023-10-06T11:05:44.352615+0000","last_peered":"2023-10-06T11:05:44.352615+0000","last_clean":"2023-10-06T11:05:44.352615+0000","last_became_active":"2023-10-06T11:05:43.368103+0000","last_became_peered":"2023-10-06T11:05:43.368103+0000","last_unstale":"2023-10-06T11:05:44.352615+0000","last_undegraded":"2023-10-06T11:05:44.352615+0000","last_fullsized":"2023-10-06T11:05:44.352615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:24.903299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.372002+0000","last_change":"2023-10-06T11:05:44.369604+0000","last_active":"2023-10-06T11:05:44.372002+0000","last_peered":"2023-10-06T11:05:44.372002+0000","last_clean":"2023-10-06T11:05:44.372002+0000","last_became_active":"2023-10-06T11:05:44.368781+0000","last_became_peered":"2023-10-06T11:05:44.368781+0000","last_unstale":"2023-10-06T11:05:44.372002+0000","last_undegraded":"2023-10-06T11:05:44.372002+0000","last_fullsized":"2023-10-06T11:05:44.372002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:20.240548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.361406+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:05:44.361406+0000","last_peered":"2023-10-06T11:05:44.361406+0000","last_clean":"2023-10-06T11:05:44.361406+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:05:44.361406+0000","last_undegraded":"2023-10-06T11:05:44.361406+0000","last_fullsized":"2023-10-06T11:05:44.361406+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.364677+0000","last_change":"2023-10-06T11:05:43.367969+0000","last_active":"2023-10-06T11:05:44.364677+0000","last_peered":"2023-10-06T11:05:44.364677+0000","last_clean":"2023-10-06T11:05:44.364677+0000","last_became_active":"2023-10-06T11:05:43.367720+0000","last_became_peered":"2023-10-06T11:05:43.367720+0000","last_unstale":"2023-10-06T11:05:44.364677+0000","last_undegraded":"2023-10-06T11:05:44.364677+0000","last_fullsized":"2023-10-06T11:05:44.364677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:18.301774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379201+0000","last_change":"2023-10-06T11:05:44.378622+0000","last_active":"2023-10-06T11:05:44.379201+0000","last_peered":"2023-10-06T11:05:44.379201+0000","last_clean":"2023-10-06T11:05:44.379201+0000","last_became_active":"2023-10-06T11:05:44.378399+0000","last_became_peered":"2023-10-06T11:05:44.378399+0000","last_unstale":"2023-10-06T11:05:44.379201+0000","last_undegraded":"2023-10-06T11:05:44.379201+0000","last_fullsized":"2023-10-06T11:05:44.379201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:49:53.929590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.365682+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:05:44.365682+0000","last_peered":"2023-10-06T11:05:44.365682+0000","last_clean":"2023-10-06T11:05:44.365682+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:05:44.365682+0000","last_undegraded":"2023-10-06T11:05:44.365682+0000","last_fullsized":"2023-10-06T11:05:44.365682+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.355393+0000","last_change":"2023-10-06T11:05:43.364706+0000","last_active":"2023-10-06T11:05:44.355393+0000","last_peered":"2023-10-06T11:05:44.355393+0000","last_clean":"2023-10-06T11:05:44.355393+0000","last_became_active":"2023-10-06T11:05:43.364448+0000","last_became_peered":"2023-10-06T11:05:43.364448+0000","last_unstale":"2023-10-06T11:05:44.355393+0000","last_undegraded":"2023-10-06T11:05:44.355393+0000","last_fullsized":"2023-10-06T11:05:44.355393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:24.903299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.373780+0000","last_change":"2023-10-06T11:05:44.369625+0000","last_active":"2023-10-06T11:05:44.373780+0000","last_peered":"2023-10-06T11:05:44.373780+0000","last_clean":"2023-10-06T11:05:44.373780+0000","last_became_active":"2023-10-06T11:05:44.369370+0000","last_became_peered":"2023-10-06T11:05:44.369370+0000","last_unstale":"2023-10-06T11:05:44.373780+0000","last_undegraded":"2023-10-06T11:05:44.373780+0000","last_fullsized":"2023-10-06T11:05:44.373780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:53:56.031447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.354685+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:05:44.354685+0000","last_peered":"2023-10-06T11:05:44.354685+0000","last_clean":"2023-10-06T11:05:44.354685+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:05:44.354685+0000","last_undegraded":"2023-10-06T11:05:44.354685+0000","last_fullsized":"2023-10-06T11:05:44.354685+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.354439+0000","last_change":"2023-10-06T11:05:43.366958+0000","last_active":"2023-10-06T11:05:44.354439+0000","last_peered":"2023-10-06T11:05:44.354439+0000","last_clean":"2023-10-06T11:05:44.354439+0000","last_became_active":"2023-10-06T11:05:43.366523+0000","last_became_peered":"2023-10-06T11:05:43.366523+0000","last_unstale":"2023-10-06T11:05:44.354439+0000","last_undegraded":"2023-10-06T11:05:44.354439+0000","last_fullsized":"2023-10-06T11:05:44.354439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:24.903299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.376185+0000","last_change":"2023-10-06T11:05:44.372075+0000","last_active":"2023-10-06T11:05:44.376185+0000","last_peered":"2023-10-06T11:05:44.376185+0000","last_clean":"2023-10-06T11:05:44.376185+0000","last_became_active":"2023-10-06T11:05:44.371769+0000","last_became_peered":"2023-10-06T11:05:44.371769+0000","last_unstale":"2023-10-06T11:05:44.376185+0000","last_undegraded":"2023-10-06T11:05:44.376185+0000","last_fullsized":"2023-10-06T11:05:44.376185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:49:41.512642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.362233+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:05:44.362233+0000","last_peered":"2023-10-06T11:05:44.362233+0000","last_clean":"2023-10-06T11:05:44.362233+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:05:44.362233+0000","last_undegraded":"2023-10-06T11:05:44.362233+0000","last_fullsized":"2023-10-06T11:05:44.362233+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.364558+0000","last_change":"2023-10-06T11:05:43.368631+0000","last_active":"2023-10-06T11:05:44.364558+0000","last_peered":"2023-10-06T11:05:44.364558+0000","last_clean":"2023-10-06T11:05:44.364558+0000","last_became_active":"2023-10-06T11:05:43.368367+0000","last_became_peered":"2023-10-06T11:05:43.368367+0000","last_unstale":"2023-10-06T11:05:44.364558+0000","last_undegraded":"2023-10-06T11:05:44.364558+0000","last_fullsized":"2023-10-06T11:05:44.364558+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:27.003956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377441+0000","last_change":"2023-10-06T11:05:44.374324+0000","last_active":"2023-10-06T11:05:44.377441+0000","last_peered":"2023-10-06T11:05:44.377441+0000","last_clean":"2023-10-06T11:05:44.377441+0000","last_became_active":"2023-10-06T11:05:44.374070+0000","last_became_peered":"2023-10-06T11:05:44.374070+0000","last_unstale":"2023-10-06T11:05:44.377441+0000","last_undegraded":"2023-10-06T11:05:44.377441+0000","last_fullsized":"2023-10-06T11:05:44.377441+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:49:53.929590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.360913+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:05:44.360913+0000","last_peered":"2023-10-06T11:05:44.360913+0000","last_clean":"2023-10-06T11:05:44.360913+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:05:44.360913+0000","last_undegraded":"2023-10-06T11:05:44.360913+0000","last_fullsized":"2023-10-06T11:05:44.360913+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.356747+0000","last_change":"2023-10-06T11:05:43.364980+0000","last_active":"2023-10-06T11:05:44.356747+0000","last_peered":"2023-10-06T11:05:44.356747+0000","last_clean":"2023-10-06T11:05:44.356747+0000","last_became_active":"2023-10-06T11:05:43.364661+0000","last_became_peered":"2023-10-06T11:05:43.364661+0000","last_unstale":"2023-10-06T11:05:44.356747+0000","last_undegraded":"2023-10-06T11:05:44.356747+0000","last_fullsized":"2023-10-06T11:05:44.356747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:32.863094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379211+0000","last_change":"2023-10-06T11:05:44.378547+0000","last_active":"2023-10-06T11:05:44.379211+0000","last_peered":"2023-10-06T11:05:44.379211+0000","last_clean":"2023-10-06T11:05:44.379211+0000","last_became_active":"2023-10-06T11:05:44.378211+0000","last_became_peered":"2023-10-06T11:05:44.378211+0000","last_unstale":"2023-10-06T11:05:44.379211+0000","last_undegraded":"2023-10-06T11:05:44.379211+0000","last_fullsized":"2023-10-06T11:05:44.379211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:32:31.703547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377355+0000","last_change":"2023-10-06T11:05:43.368448+0000","last_active":"2023-10-06T11:05:44.377355+0000","last_peered":"2023-10-06T11:05:44.377355+0000","last_clean":"2023-10-06T11:05:44.377355+0000","last_became_active":"2023-10-06T11:05:43.367859+0000","last_became_peered":"2023-10-06T11:05:43.367859+0000","last_unstale":"2023-10-06T11:05:44.377355+0000","last_undegraded":"2023-10-06T11:05:44.377355+0000","last_fullsized":"2023-10-06T11:05:44.377355+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:18.301774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375383+0000","last_change":"2023-10-06T11:05:44.369211+0000","last_active":"2023-10-06T11:05:44.375383+0000","last_peered":"2023-10-06T11:05:44.375383+0000","last_clean":"2023-10-06T11:05:44.375383+0000","last_became_active":"2023-10-06T11:05:44.368950+0000","last_became_peered":"2023-10-06T11:05:44.368950+0000","last_unstale":"2023-10-06T11:05:44.375383+0000","last_undegraded":"2023-10-06T11:05:44.375383+0000","last_fullsized":"2023-10-06T11:05:44.375383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:01.484408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377607+0000","last_change":"2023-10-06T11:05:43.365792+0000","last_active":"2023-10-06T11:05:44.377607+0000","last_peered":"2023-10-06T11:05:44.377607+0000","last_clean":"2023-10-06T11:05:44.377607+0000","last_became_active":"2023-10-06T11:05:43.365137+0000","last_became_peered":"2023-10-06T11:05:43.365137+0000","last_unstale":"2023-10-06T11:05:44.377607+0000","last_undegraded":"2023-10-06T11:05:44.377607+0000","last_fullsized":"2023-10-06T11:05:44.377607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:24.903299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379988+0000","last_change":"2023-10-06T11:05:44.373079+0000","last_active":"2023-10-06T11:05:44.379988+0000","last_peered":"2023-10-06T11:05:44.379988+0000","last_clean":"2023-10-06T11:05:44.379988+0000","last_became_active":"2023-10-06T11:05:44.372797+0000","last_became_peered":"2023-10-06T11:05:44.372797+0000","last_unstale":"2023-10-06T11:05:44.379988+0000","last_undegraded":"2023-10-06T11:05:44.379988+0000","last_fullsized":"2023-10-06T11:05:44.379988+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:20.240548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.377828+0000","last_change":"2023-10-06T11:05:43.367620+0000","last_active":"2023-10-06T11:05:44.377828+0000","last_peered":"2023-10-06T11:05:44.377828+0000","last_clean":"2023-10-06T11:05:44.377828+0000","last_became_active":"2023-10-06T11:05:43.367335+0000","last_became_peered":"2023-10-06T11:05:43.367335+0000","last_unstale":"2023-10-06T11:05:44.377828+0000","last_undegraded":"2023-10-06T11:05:44.377828+0000","last_fullsized":"2023-10-06T11:05:44.377828+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:18.301774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375668+0000","last_change":"2023-10-06T11:05:44.371343+0000","last_active":"2023-10-06T11:05:44.375668+0000","last_peered":"2023-10-06T11:05:44.375668+0000","last_clean":"2023-10-06T11:05:44.375668+0000","last_became_active":"2023-10-06T11:05:44.371051+0000","last_became_peered":"2023-10-06T11:05:44.371051+0000","last_unstale":"2023-10-06T11:05:44.375668+0000","last_undegraded":"2023-10-06T11:05:44.375668+0000","last_fullsized":"2023-10-06T11:05:44.375668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:30:10.233024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375170+0000","last_change":"2023-10-06T11:05:43.362124+0000","last_active":"2023-10-06T11:05:44.375170+0000","last_peered":"2023-10-06T11:05:44.375170+0000","last_clean":"2023-10-06T11:05:44.375170+0000","last_became_active":"2023-10-06T11:05:43.361847+0000","last_became_peered":"2023-10-06T11:05:43.361847+0000","last_unstale":"2023-10-06T11:05:44.375170+0000","last_undegraded":"2023-10-06T11:05:44.375170+0000","last_fullsized":"2023-10-06T11:05:44.375170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:36.907530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.373157+0000","last_change":"2023-10-06T11:05:44.367010+0000","last_active":"2023-10-06T11:05:44.373157+0000","last_peered":"2023-10-06T11:05:44.373157+0000","last_clean":"2023-10-06T11:05:44.373157+0000","last_became_active":"2023-10-06T11:05:44.366748+0000","last_became_peered":"2023-10-06T11:05:44.366748+0000","last_unstale":"2023-10-06T11:05:44.373157+0000","last_undegraded":"2023-10-06T11:05:44.373157+0000","last_fullsized":"2023-10-06T11:05:44.373157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:32:17.346227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380717+0000","last_change":"2023-10-06T11:05:43.367936+0000","last_active":"2023-10-06T11:05:44.380717+0000","last_peered":"2023-10-06T11:05:44.380717+0000","last_clean":"2023-10-06T11:05:44.380717+0000","last_became_active":"2023-10-06T11:05:43.367668+0000","last_became_peered":"2023-10-06T11:05:43.367668+0000","last_unstale":"2023-10-06T11:05:44.380717+0000","last_undegraded":"2023-10-06T11:05:44.380717+0000","last_fullsized":"2023-10-06T11:05:44.380717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:42.336346+0000","last_clean_scrub_stamp":"2023-10-06T11:05:42.336346+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:20:04.789716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.382377+0000","last_change":"2023-10-06T11:05:44.375719+0000","last_active":"2023-10-06T11:05:44.382377+0000","last_peered":"2023-10-06T11:05:44.382377+0000","last_clean":"2023-10-06T11:05:44.382377+0000","last_became_active":"2023-10-06T11:05:44.375387+0000","last_became_peered":"2023-10-06T11:05:44.375387+0000","last_unstale":"2023-10-06T11:05:44.382377+0000","last_undegraded":"2023-10-06T11:05:44.382377+0000","last_fullsized":"2023-10-06T11:05:44.382377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:39:54.037210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.375187+0000","last_change":"2023-10-06T11:05:44.370923+0000","last_active":"2023-10-06T11:05:44.375187+0000","last_peered":"2023-10-06T11:05:44.375187+0000","last_clean":"2023-10-06T11:05:44.375187+0000","last_became_active":"2023-10-06T11:05:44.370655+0000","last_became_peered":"2023-10-06T11:05:44.370655+0000","last_unstale":"2023-10-06T11:05:44.375187+0000","last_undegraded":"2023-10-06T11:05:44.375187+0000","last_fullsized":"2023-10-06T11:05:44.375187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:21:08.012086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379549+0000","last_change":"2023-10-06T11:05:44.373040+0000","last_active":"2023-10-06T11:05:44.379549+0000","last_peered":"2023-10-06T11:05:44.379549+0000","last_clean":"2023-10-06T11:05:44.379549+0000","last_became_active":"2023-10-06T11:05:44.370543+0000","last_became_peered":"2023-10-06T11:05:44.370543+0000","last_unstale":"2023-10-06T11:05:44.379549+0000","last_undegraded":"2023-10-06T11:05:44.379549+0000","last_fullsized":"2023-10-06T11:05:44.379549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:30:10.233024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.380138+0000","last_change":"2023-10-06T11:05:44.374987+0000","last_active":"2023-10-06T11:05:44.380138+0000","last_peered":"2023-10-06T11:05:44.380138+0000","last_clean":"2023-10-06T11:05:44.380138+0000","last_became_active":"2023-10-06T11:05:44.374710+0000","last_became_peered":"2023-10-06T11:05:44.374710+0000","last_unstale":"2023-10-06T11:05:44.380138+0000","last_undegraded":"2023-10-06T11:05:44.380138+0000","last_fullsized":"2023-10-06T11:05:44.380138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:46:57.706239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.379174+0000","last_change":"2023-10-06T11:05:44.372135+0000","last_active":"2023-10-06T11:05:44.379174+0000","last_peered":"2023-10-06T11:05:44.379174+0000","last_clean":"2023-10-06T11:05:44.379174+0000","last_became_active":"2023-10-06T11:05:44.371609+0000","last_became_peered":"2023-10-06T11:05:44.371609+0000","last_unstale":"2023-10-06T11:05:44.379174+0000","last_undegraded":"2023-10-06T11:05:44.379174+0000","last_fullsized":"2023-10-06T11:05:44.379174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:48:35.935962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T11:05:44.376168+0000","last_change":"2023-10-06T11:05:44.371940+0000","last_active":"2023-10-06T11:05:44.376168+0000","last_peered":"2023-10-06T11:05:44.376168+0000","last_clean":"2023-10-06T11:05:44.376168+0000","last_became_active":"2023-10-06T11:05:44.371617+0000","last_became_peered":"2023-10-06T11:05:44.371617+0000","last_unstale":"2023-10-06T11:05:44.376168+0000","last_undegraded":"2023-10-06T11:05:44.376168+0000","last_fullsized":"2023-10-06T11:05:44.376168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:43.343085+0000","last_clean_scrub_stamp":"2023-10-06T11:05:43.343085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:48.500150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298096,"kb_used_data":808,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073744,"statfs":{"total":96636764160,"available":96331513856,"internally_reserved":0,"allocated":827392,"data_stored":666304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297484,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074356,"statfs":{"total":96636764160,"available":96332140544,"internally_reserved":0,"allocated":200704,"data_stored":72831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298068,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073772,"statfs":{"total":96636764160,"available":96331542528,"internally_reserved":0,"allocated":798720,"data_stored":664552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":73385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.376}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297484,"kb_used_data":196,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074356,"statfs":{"total":96636764160,"available":96332140544,"internally_reserved":0,"allocated":200704,"data_stored":72831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":72921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.095}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7729999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.694}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.657}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297508,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074332,"statfs":{"total":96636764160,"available":96332115968,"internally_reserved":0,"allocated":225280,"data_stored":75776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":74808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.0490000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.018}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.2169999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:05:57.462 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T11:05:57.462 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-06T11:05:57.462 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-06T11:05:57.462 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-06T11:05:57.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.608+0000 7fcfebc86700 1 Processor -- start 2023-10-06T11:05:57.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.608+0000 7fcfebc86700 1 -- start start 2023-10-06T11:05:57.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.609+0000 7fcfebc86700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcfe4153ab0 0x7fcfe415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:57.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.609+0000 7fcfebc86700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcfe4153e80 0x7fcfe4068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:57.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.609+0000 7fcfebc86700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfe415ac30 con 0x7fcfe40689d0 2023-10-06T11:05:57.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.609+0000 7fcfebc86700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfe4068e50 con 0x7fcfe4153ab0 2023-10-06T11:05:57.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.609+0000 7fcfebc86700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe40b4510 con 0x7fcfe4153e80 2023-10-06T11:05:57.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.609+0000 7fcfe9a22700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcfe4153ab0 0x7fcfe415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:57.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.609+0000 7fcfe9a22700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcfe4153ab0 0x7fcfe415a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40088/0 (socket says 172.21.15.146:40088) 2023-10-06T11:05:57.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.609+0000 7fcfe9a22700 1 -- 172.21.15.146:0/738445755 learned_addr learned my addr 172.21.15.146:0/738445755 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:57.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.609+0000 7fcfe9221700 1 --2- 172.21.15.146:0/738445755 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcfe4153e80 0x7fcfe4068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:57.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.609+0000 7fcfe9a22700 1 -- 172.21.15.146:0/738445755 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcfe4153e80 msgr2=0x7fcfe4068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:57.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.609+0000 7fcfe9a22700 1 --2- 172.21.15.146:0/738445755 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcfe4153e80 0x7fcfe4068490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:57.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.609+0000 7fcfe9a22700 1 -- 172.21.15.146:0/738445755 >> v1:172.21.15.151:6789/0 conn(0x7fcfe40689d0 legacy=0x7fcfe415d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:57.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.610+0000 7fcfe9a22700 1 -- 172.21.15.146:0/738445755 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe40b6530 con 0x7fcfe4153ab0 2023-10-06T11:05:57.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.610+0000 7fcfe9221700 1 --2- 172.21.15.146:0/738445755 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcfe4153e80 0x7fcfe4068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:05:57.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.610+0000 7fcfe9a22700 1 --2- 172.21.15.146:0/738445755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfe4153ab0 0x7fcfe415a6f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0009f20 tx=0x7fcfe0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b357bb79bc4f6c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:57.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.610+0000 7fcfe8a20700 1 -- 172.21.15.146:0/738445755 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe000e070 con 0x7fcfe4153ab0 2023-10-06T11:05:57.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.610+0000 7fcfe8a20700 1 -- 172.21.15.146:0/738445755 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe000ba80 con 0x7fcfe4153ab0 2023-10-06T11:05:57.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.610+0000 7fcfe8a20700 1 -- 172.21.15.146:0/738445755 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe00092e0 con 0x7fcfe4153ab0 2023-10-06T11:05:57.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.610+0000 7fcfebc86700 1 -- 172.21.15.146:0/738445755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfe4153ab0 msgr2=0x7fcfe415a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:57.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.610+0000 7fcfebc86700 1 --2- 172.21.15.146:0/738445755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfe4153ab0 0x7fcfe415a6f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0009f20 tx=0x7fcfe0009840 comp rx=0 tx=0).stop 2023-10-06T11:05:57.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.610+0000 7fcfebc86700 1 -- 172.21.15.146:0/738445755 shutdown_connections 2023-10-06T11:05:57.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.610+0000 7fcfebc86700 1 --2- 172.21.15.146:0/738445755 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfe4153ab0 0x7fcfe415a6f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:57.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.610+0000 7fcfebc86700 1 --2- 172.21.15.146:0/738445755 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcfe4153e80 0x7fcfe4068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:57.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.610+0000 7fcfebc86700 1 -- 172.21.15.146:0/738445755 >> 172.21.15.146:0/738445755 conn(0x7fcfe406eba0 msgr2=0x7fcfe406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:57.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.610+0000 7fcfebc86700 1 -- 172.21.15.146:0/738445755 shutdown_connections 2023-10-06T11:05:57.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.610+0000 7fcfebc86700 1 -- 172.21.15.146:0/738445755 wait complete. 2023-10-06T11:05:57.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.611+0000 7fcfebc86700 1 Processor -- start 2023-10-06T11:05:57.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.611+0000 7fcfebc86700 1 -- start start 2023-10-06T11:05:57.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.612+0000 7fcfebc86700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfe40689d0 0x7fcfe414c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:57.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.612+0000 7fcfebc86700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcfe4153ab0 0x7fcfe414d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:57.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.612+0000 7fcfebc86700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcfe4153e80 0x7fcfe4147fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:57.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.612+0000 7fcfebc86700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe414fda0 con 0x7fcfe40689d0 2023-10-06T11:05:57.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.612+0000 7fcfebc86700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe4150080 con 0x7fcfe4153ab0 2023-10-06T11:05:57.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.612+0000 7fcfebc86700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe415eb10 con 0x7fcfe4153e80 2023-10-06T11:05:57.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.612+0000 7fcfe9a22700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfe40689d0 0x7fcfe414c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:57.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.612+0000 7fcfe9a22700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfe40689d0 0x7fcfe414c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40096/0 (socket says 172.21.15.146:40096) 2023-10-06T11:05:57.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.612+0000 7fcfe9a22700 1 -- 172.21.15.146:0/583668529 learned_addr learned my addr 172.21.15.146:0/583668529 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:57.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.612+0000 7fcfe9a22700 1 -- 172.21.15.146:0/583668529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcfe4153e80 msgr2=0x7fcfe4147fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:57.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.612+0000 7fcfe9a22700 1 --2- 172.21.15.146:0/583668529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcfe4153e80 0x7fcfe4147fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:57.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.612+0000 7fcfe9a22700 1 -- 172.21.15.146:0/583668529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcfe4153ab0 msgr2=0x7fcfe414d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:57.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.612+0000 7fcfe9a22700 1 --2- 172.21.15.146:0/583668529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcfe4153ab0 0x7fcfe414d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:57.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.612+0000 7fcfe9a22700 1 -- 172.21.15.146:0/583668529 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe0009ae0 con 0x7fcfe40689d0 2023-10-06T11:05:57.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.613+0000 7fcfe9a22700 1 --2- 172.21.15.146:0/583668529 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfe40689d0 0x7fcfe414c580 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcfe000b6c0 tx=0x7fcfe0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:57.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.613+0000 7fcfd9ffb700 1 -- 172.21.15.146:0/583668529 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe0008bb0 con 0x7fcfe40689d0 2023-10-06T11:05:57.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.613+0000 7fcfd9ffb700 1 -- 172.21.15.146:0/583668529 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe0008d10 con 0x7fcfe40689d0 2023-10-06T11:05:57.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.613+0000 7fcfd9ffb700 1 -- 172.21.15.146:0/583668529 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe00266b0 con 0x7fcfe40689d0 2023-10-06T11:05:57.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.613+0000 7fcfebc86700 1 -- 172.21.15.146:0/583668529 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe415e7d0 con 0x7fcfe40689d0 2023-10-06T11:05:57.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.613+0000 7fcfebc86700 1 -- 172.21.15.146:0/583668529 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe414ded0 con 0x7fcfe40689d0 2023-10-06T11:05:57.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.614+0000 7fcfebc86700 1 -- 172.21.15.146:0/583668529 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe415ecd0 con 0x7fcfe40689d0 2023-10-06T11:05:57.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.614+0000 7fcfd9ffb700 1 -- 172.21.15.146:0/583668529 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcfe0003040 con 0x7fcfe40689d0 2023-10-06T11:05:57.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.615+0000 7fcfd9ffb700 1 --2- 172.21.15.146:0/583668529 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcfc8066f30 0x7fcfc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:57.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.615+0000 7fcfe9221700 1 --2- 172.21.15.146:0/583668529 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcfc8066f30 0x7fcfc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:57.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.615+0000 7fcfd9ffb700 1 -- 172.21.15.146:0/583668529 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcfe0086470 con 0x7fcfe40689d0 2023-10-06T11:05:57.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.615+0000 7fcfe9221700 1 --2- 172.21.15.146:0/583668529 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcfc8066f30 0x7fcfc80693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4006f00 tx=0x7fcfd4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:57.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.619+0000 7fcfd9ffb700 1 -- 172.21.15.146:0/583668529 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcfe0053580 con 0x7fcfe40689d0 2023-10-06T11:05:57.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.843+0000 7fcfebc86700 1 -- 172.21.15.146:0/583668529 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fcfe414fee0 con 0x7fcfe40689d0 2023-10-06T11:05:57.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.843+0000 7fcfd9ffb700 1 -- 172.21.15.146:0/583668529 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fcfe414fee0 con 0x7fcfe40689d0 2023-10-06T11:05:57.845 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:05:57.846 INFO:teuthology.orchestra.run.smithi146.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-06T11:05:57.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.846+0000 7fcfebc86700 1 -- 172.21.15.146:0/583668529 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcfc8066f30 msgr2=0x7fcfc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:57.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.846+0000 7fcfebc86700 1 --2- 172.21.15.146:0/583668529 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcfc8066f30 0x7fcfc80693e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4006f00 tx=0x7fcfd4008040 comp rx=0 tx=0).stop 2023-10-06T11:05:57.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.846+0000 7fcfebc86700 1 -- 172.21.15.146:0/583668529 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfe40689d0 msgr2=0x7fcfe414c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:57.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.846+0000 7fcfebc86700 1 --2- 172.21.15.146:0/583668529 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfe40689d0 0x7fcfe414c580 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fcfe000b6c0 tx=0x7fcfe0018000 comp rx=0 tx=0).stop 2023-10-06T11:05:57.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.846+0000 7fcfebc86700 1 -- 172.21.15.146:0/583668529 shutdown_connections 2023-10-06T11:05:57.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.846+0000 7fcfebc86700 1 --2- 172.21.15.146:0/583668529 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcfc8066f30 0x7fcfc80693e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:57.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.846+0000 7fcfebc86700 1 --2- 172.21.15.146:0/583668529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcfe4153e80 0x7fcfe4147fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:57.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.846+0000 7fcfebc86700 1 --2- 172.21.15.146:0/583668529 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcfe40689d0 0x7fcfe414c580 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:57.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.846+0000 7fcfebc86700 1 --2- 172.21.15.146:0/583668529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcfe4153ab0 0x7fcfe414d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:57.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.846+0000 7fcfebc86700 1 -- 172.21.15.146:0/583668529 >> 172.21.15.146:0/583668529 conn(0x7fcfe406eba0 msgr2=0x7fcfe415c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:57.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.846+0000 7fcfebc86700 1 -- 172.21.15.146:0/583668529 shutdown_connections 2023-10-06T11:05:57.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.846+0000 7fcfebc86700 1 -- 172.21.15.146:0/583668529 wait complete. 2023-10-06T11:05:57.859 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-06T11:05:57.860 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:05:57.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.972+0000 7f68d52fe700 1 Processor -- start 2023-10-06T11:05:57.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.972+0000 7f68d52fe700 1 -- start start 2023-10-06T11:05:57.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.973+0000 7f68d52fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68d0153ab0 0x7f68d015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:57.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.973+0000 7f68d52fe700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f68d0068ba0 0x7f68d00b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:57.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.973+0000 7f68d52fe700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68d015ac30 con 0x7f68d0153e80 2023-10-06T11:05:57.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.973+0000 7f68d52fe700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d00b4510 con 0x7f68d0068ba0 2023-10-06T11:05:57.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.973+0000 7f68d52fe700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d00b6530 con 0x7f68d0153ab0 2023-10-06T11:05:57.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.973+0000 7f68ce7fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f68d0153e80 0x7f68d0068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38828/0 (socket says 172.21.15.146:38828) 2023-10-06T11:05:57.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.973+0000 7f68ce7fc700 1 -- 172.21.15.146:0/1814206360 learned_addr learned my addr 172.21.15.146:0/1814206360 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:05:57.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.973+0000 7f68cf7fe700 1 --2- 172.21.15.146:0/1814206360 >> v2:172.21.15.151:3300/0 conn(0x7f68d0068ba0 0x7f68d00b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:57.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.973+0000 7f68ceffd700 1 --2- 172.21.15.146:0/1814206360 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68d0153ab0 0x7f68d015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:57.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.973+0000 7f68cdffb700 1 -- 172.21.15.146:0/1814206360 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1159995361 0 0) 0x7f68c4001110 con 0x7f68d0153e80 2023-10-06T11:05:57.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.973+0000 7f68cdffb700 1 -- 172.21.15.146:0/1814206360 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68b8003570 con 0x7f68d0153e80 2023-10-06T11:05:57.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.973+0000 7f68cf7fe700 1 -- 172.21.15.146:0/1814206360 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68d0153ab0 msgr2=0x7f68d015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:57.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.973+0000 7f68cf7fe700 1 --2- 172.21.15.146:0/1814206360 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68d0153ab0 0x7f68d015a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:57.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.973+0000 7f68cf7fe700 1 -- 172.21.15.146:0/1814206360 >> v1:172.21.15.146:6789/0 conn(0x7f68d0153e80 legacy=0x7f68d0068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:57.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.973+0000 7f68cdffb700 1 -- 172.21.15.146:0/1814206360 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3557520474 0 0) 0x7f68b8003570 con 0x7f68d0153e80 2023-10-06T11:05:57.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.973+0000 7f68cf7fe700 1 -- 172.21.15.146:0/1814206360 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d00b5c50 con 0x7f68d0068ba0 2023-10-06T11:05:57.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.973+0000 7f68ceffd700 1 --2- 172.21.15.146:0/1814206360 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68d0153ab0 0x7f68d015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:05:57.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.974+0000 7f68cf7fe700 1 --2- 172.21.15.146:0/1814206360 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68d0068ba0 0x7f68d00b49a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f68c00098e0 tx=0x7f68c00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7559b0e6d1a9aa6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:57.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.974+0000 7f68cdffb700 1 -- 172.21.15.146:0/1814206360 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c4001600 con 0x7f68d0068ba0 2023-10-06T11:05:57.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.974+0000 7f68cdffb700 1 -- 172.21.15.146:0/1814206360 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c0011420 con 0x7f68d0068ba0 2023-10-06T11:05:57.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.974+0000 7f68cdffb700 1 -- 172.21.15.146:0/1814206360 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c00117c0 con 0x7f68d0068ba0 2023-10-06T11:05:57.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.974+0000 7f68d52fe700 1 -- 172.21.15.146:0/1814206360 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68d0068ba0 msgr2=0x7f68d00b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:57.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.974+0000 7f68d52fe700 1 --2- 172.21.15.146:0/1814206360 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68d0068ba0 0x7f68d00b49a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f68c00098e0 tx=0x7f68c00091a0 comp rx=0 tx=0).stop 2023-10-06T11:05:57.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.974+0000 7f68d52fe700 1 -- 172.21.15.146:0/1814206360 shutdown_connections 2023-10-06T11:05:57.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.974+0000 7f68d52fe700 1 --2- 172.21.15.146:0/1814206360 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68d0153ab0 0x7f68d015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:57.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.974+0000 7f68d52fe700 1 --2- 172.21.15.146:0/1814206360 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68d0068ba0 0x7f68d00b49a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:57.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.974+0000 7f68d52fe700 1 -- 172.21.15.146:0/1814206360 >> 172.21.15.146:0/1814206360 conn(0x7f68d006eba0 msgr2=0x7f68d006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:57.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.974+0000 7f68d52fe700 1 -- 172.21.15.146:0/1814206360 shutdown_connections 2023-10-06T11:05:57.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.974+0000 7f68d52fe700 1 -- 172.21.15.146:0/1814206360 wait complete. 2023-10-06T11:05:57.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.975+0000 7f68d52fe700 1 Processor -- start 2023-10-06T11:05:57.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.976+0000 7f68d52fe700 1 -- start start 2023-10-06T11:05:57.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.976+0000 7f68d52fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68d0068ba0 0x7f68d0154320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:57.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.976+0000 7f68d52fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68d0153ab0 0x7f68d0156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:57.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.976+0000 7f68d52fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68d0153e80 0x7f68d0159340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:57.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.976+0000 7f68d52fe700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d0150530 con 0x7f68d0153e80 2023-10-06T11:05:57.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.976+0000 7f68d52fe700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d00b06b0 con 0x7f68d0153ab0 2023-10-06T11:05:57.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.976+0000 7f68d52fe700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d0159f70 con 0x7f68d0068ba0 2023-10-06T11:05:57.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.976+0000 7f68cf7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68d0153e80 0x7f68d0159340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:57.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.976+0000 7f68cf7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68d0153e80 0x7f68d0159340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40104/0 (socket says 172.21.15.146:40104) 2023-10-06T11:05:57.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.976+0000 7f68cf7fe700 1 -- 172.21.15.146:0/3955661892 learned_addr learned my addr 172.21.15.146:0/3955661892 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:57.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.976+0000 7f68ce7fc700 1 --2- 172.21.15.146:0/3955661892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68d0153ab0 0x7f68d0156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:57.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.976+0000 7f68ceffd700 1 --2- 172.21.15.146:0/3955661892 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68d0068ba0 0x7f68d0154320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:57.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.977+0000 7f68cf7fe700 1 -- 172.21.15.146:0/3955661892 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68d0068ba0 msgr2=0x7f68d0154320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:57.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.977+0000 7f68cf7fe700 1 --2- 172.21.15.146:0/3955661892 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68d0068ba0 0x7f68d0154320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:57.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.977+0000 7f68cf7fe700 1 -- 172.21.15.146:0/3955661892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68d0153ab0 msgr2=0x7f68d0156920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:57.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.977+0000 7f68cf7fe700 1 --2- 172.21.15.146:0/3955661892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68d0153ab0 0x7f68d0156920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:57.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.977+0000 7f68cf7fe700 1 -- 172.21.15.146:0/3955661892 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c8009a20 con 0x7f68d0153e80 2023-10-06T11:05:57.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.977+0000 7f68cf7fe700 1 --2- 172.21.15.146:0/3955661892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68d0153e80 0x7f68d0159340 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f68c00030c0 tx=0x7f68c0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:57.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.977+0000 7f68b6ffd700 1 -- 172.21.15.146:0/3955661892 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c001cd10 con 0x7f68d0153e80 2023-10-06T11:05:57.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.977+0000 7f68b6ffd700 1 -- 172.21.15.146:0/3955661892 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c001ce70 con 0x7f68d0153e80 2023-10-06T11:05:57.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.977+0000 7f68d52fe700 1 -- 172.21.15.146:0/3955661892 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c0009420 con 0x7f68d0153e80 2023-10-06T11:05:57.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.977+0000 7f68b6ffd700 1 -- 172.21.15.146:0/3955661892 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c001a680 con 0x7f68d0153e80 2023-10-06T11:05:57.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.977+0000 7f68d52fe700 1 -- 172.21.15.146:0/3955661892 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d00b0340 con 0x7f68d0153e80 2023-10-06T11:05:57.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.978+0000 7f68d52fe700 1 -- 172.21.15.146:0/3955661892 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68d00afec0 con 0x7f68d0153e80 2023-10-06T11:05:57.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.978+0000 7f68b6ffd700 1 -- 172.21.15.146:0/3955661892 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f68c001aa70 con 0x7f68d0153e80 2023-10-06T11:05:57.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.979+0000 7f68b6ffd700 1 --2- 172.21.15.146:0/3955661892 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f68bc066f30 0x7f68bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:57.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.979+0000 7f68b6ffd700 1 -- 172.21.15.146:0/3955661892 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f68c0085ec0 con 0x7f68d0153e80 2023-10-06T11:05:57.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.979+0000 7f68ceffd700 1 --2- 172.21.15.146:0/3955661892 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f68bc066f30 0x7f68bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:57.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.979+0000 7f68ceffd700 1 --2- 172.21.15.146:0/3955661892 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f68bc066f30 0x7f68bc0693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f68c8009fd0 tx=0x7f68c800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:57.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:57.983+0000 7f68b6ffd700 1 -- 172.21.15.146:0/3955661892 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f68d00afec0 con 0x7f68d0153e80 2023-10-06T11:05:58.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.168+0000 7f68d52fe700 1 -- 172.21.15.146:0/3955661892 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68d00afec0 con 0x7f68d0153e80 2023-10-06T11:05:58.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.168+0000 7f68b6ffd700 1 -- 172.21.15.146:0/3955661892 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16914 (secure 0 0 0) 0x7f68d00afec0 con 0x7f68d0153e80 2023-10-06T11:05:58.170 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:05:58.171 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":20,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:05:45.362089+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:05:41.403954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T11:05:42.698754+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:05:58.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.170+0000 7f68d52fe700 1 -- 172.21.15.146:0/3955661892 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f68bc066f30 msgr2=0x7f68bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:58.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.170+0000 7f68d52fe700 1 --2- 172.21.15.146:0/3955661892 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f68bc066f30 0x7f68bc0693e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f68c8009fd0 tx=0x7f68c800b040 comp rx=0 tx=0).stop 2023-10-06T11:05:58.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.170+0000 7f68d52fe700 1 -- 172.21.15.146:0/3955661892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68d0153e80 msgr2=0x7f68d0159340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:58.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.170+0000 7f68d52fe700 1 --2- 172.21.15.146:0/3955661892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68d0153e80 0x7f68d0159340 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f68c00030c0 tx=0x7f68c0016000 comp rx=0 tx=0).stop 2023-10-06T11:05:58.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.170+0000 7f68d52fe700 1 -- 172.21.15.146:0/3955661892 shutdown_connections 2023-10-06T11:05:58.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.170+0000 7f68d52fe700 1 --2- 172.21.15.146:0/3955661892 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f68bc066f30 0x7f68bc0693e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:58.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.170+0000 7f68d52fe700 1 --2- 172.21.15.146:0/3955661892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68d0153e80 0x7f68d0159340 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:58.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.170+0000 7f68d52fe700 1 --2- 172.21.15.146:0/3955661892 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68d0068ba0 0x7f68d0154320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:58.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.170+0000 7f68d52fe700 1 --2- 172.21.15.146:0/3955661892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68d0153ab0 0x7f68d0156920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:58.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.170+0000 7f68d52fe700 1 -- 172.21.15.146:0/3955661892 >> 172.21.15.146:0/3955661892 conn(0x7f68d006eba0 msgr2=0x7f68d00b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:58.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.171+0000 7f68d52fe700 1 -- 172.21.15.146:0/3955661892 shutdown_connections 2023-10-06T11:05:58.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.171+0000 7f68d52fe700 1 -- 172.21.15.146:0/3955661892 wait complete. 2023-10-06T11:05:58.184 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:05:36.687307+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:05:37.171199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T11:05:41.403954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T11:05:42.698754+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T11:05:58.185 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:05:58.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.300+0000 7f9686afe700 1 Processor -- start 2023-10-06T11:05:58.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.300+0000 7f9686afe700 1 -- start start 2023-10-06T11:05:58.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.301+0000 7f9686afe700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f96800abfe0 0x7f96800add00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:58.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.301+0000 7f9686afe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f96800ceb50 0x7f96800af5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:58.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.301+0000 7f9686afe700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96800ae550 con 0x7f96800ac3b0 2023-10-06T11:05:58.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.301+0000 7f9686afe700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96800ae830 con 0x7f96800abfe0 2023-10-06T11:05:58.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.301+0000 7f9686afe700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96800aeb10 con 0x7f96800ceb50 2023-10-06T11:05:58.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.301+0000 7f967ffff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f96800ceb50 0x7f96800af5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:58.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.301+0000 7f968489a700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f96800abfe0 0x7f96800add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:58.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.301+0000 7f968509b700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f96800ac3b0 0x7f96800ac800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:38540/0 (socket says 172.21.15.146:38540) 2023-10-06T11:05:58.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.301+0000 7f968509b700 1 -- 172.21.15.146:0/3115189650 learned_addr learned my addr 172.21.15.146:0/3115189650 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:05:58.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.302+0000 7f967f7fe700 1 -- 172.21.15.146:0/3115189650 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 910422647 0 0) 0x7f96800ae550 con 0x7f96800ac3b0 2023-10-06T11:05:58.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.302+0000 7f967f7fe700 1 -- 172.21.15.146:0/3115189650 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9668003570 con 0x7f96800ac3b0 2023-10-06T11:05:58.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.302+0000 7f967ffff700 1 -- 172.21.15.146:0/3115189650 >> v2:172.21.15.151:3300/0 conn(0x7f96800abfe0 msgr2=0x7f96800add00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:58.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.302+0000 7f967ffff700 1 --2- 172.21.15.146:0/3115189650 >> v2:172.21.15.151:3300/0 conn(0x7f96800abfe0 0x7f96800add00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:58.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.302+0000 7f967ffff700 1 -- 172.21.15.146:0/3115189650 >> v1:172.21.15.151:6789/0 conn(0x7f96800ac3b0 legacy=0x7f96800ac800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:58.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.302+0000 7f967ffff700 1 -- 172.21.15.146:0/3115189650 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96800aedf0 con 0x7f96800ceb50 2023-10-06T11:05:58.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.302+0000 7f968489a700 1 --2- 172.21.15.146:0/3115189650 >> v2:172.21.15.151:3300/0 conn(0x7f96800abfe0 0x7f96800add00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:05:58.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.302+0000 7f967ffff700 1 --2- 172.21.15.146:0/3115189650 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f96800ceb50 0x7f96800af5f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f96740098e0 tx=0x7f96740091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40dad4dfba31303a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:58.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.302+0000 7f967f7fe700 1 -- 172.21.15.146:0/3115189650 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9674011630 con 0x7f96800ceb50 2023-10-06T11:05:58.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.302+0000 7f967f7fe700 1 -- 172.21.15.146:0/3115189650 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9674011790 con 0x7f96800ceb50 2023-10-06T11:05:58.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.302+0000 7f967f7fe700 1 -- 172.21.15.146:0/3115189650 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9674011b10 con 0x7f96800ceb50 2023-10-06T11:05:58.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.303+0000 7f9686afe700 1 -- 172.21.15.146:0/3115189650 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f96800ceb50 msgr2=0x7f96800af5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:58.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.303+0000 7f9686afe700 1 --2- 172.21.15.146:0/3115189650 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f96800ceb50 0x7f96800af5f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f96740098e0 tx=0x7f96740091a0 comp rx=0 tx=0).stop 2023-10-06T11:05:58.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.303+0000 7f9686afe700 1 -- 172.21.15.146:0/3115189650 shutdown_connections 2023-10-06T11:05:58.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.303+0000 7f9686afe700 1 --2- 172.21.15.146:0/3115189650 >> v2:172.21.15.151:3300/0 conn(0x7f96800abfe0 0x7f96800add00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:58.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.303+0000 7f9686afe700 1 --2- 172.21.15.146:0/3115189650 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f96800ceb50 0x7f96800af5f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:58.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.303+0000 7f9686afe700 1 -- 172.21.15.146:0/3115189650 >> 172.21.15.146:0/3115189650 conn(0x7f9680067c50 msgr2=0x7f96800ce440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:58.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.303+0000 7f9686afe700 1 -- 172.21.15.146:0/3115189650 shutdown_connections 2023-10-06T11:05:58.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.303+0000 7f9686afe700 1 -- 172.21.15.146:0/3115189650 wait complete. 2023-10-06T11:05:58.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.304+0000 7f9686afe700 1 Processor -- start 2023-10-06T11:05:58.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.304+0000 7f9686afe700 1 -- start start 2023-10-06T11:05:58.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.305+0000 7f9686afe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96800abfe0 0x7f96801515e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:58.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.305+0000 7f9686afe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f96800ac3b0 0x7f96800cdb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:58.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.305+0000 7f9686afe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96800ceb50 0x7f968015aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:58.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.305+0000 7f9686afe700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9680068f40 con 0x7f96800ceb50 2023-10-06T11:05:58.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.305+0000 7f9686afe700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968015a4f0 con 0x7f96800abfe0 2023-10-06T11:05:58.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.305+0000 7f9686afe700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9680151b20 con 0x7f96800ac3b0 2023-10-06T11:05:58.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.305+0000 7f968509b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96800ceb50 0x7f968015aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:58.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.305+0000 7f968509b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96800ceb50 0x7f968015aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40108/0 (socket says 172.21.15.146:40108) 2023-10-06T11:05:58.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.305+0000 7f968509b700 1 -- 172.21.15.146:0/4123312113 learned_addr learned my addr 172.21.15.146:0/4123312113 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:58.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.305+0000 7f968489a700 1 --2- 172.21.15.146:0/4123312113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96800abfe0 0x7f96801515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:58.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.305+0000 7f967ffff700 1 --2- 172.21.15.146:0/4123312113 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f96800ac3b0 0x7f96800cdb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:58.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.305+0000 7f968509b700 1 -- 172.21.15.146:0/4123312113 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f96800ac3b0 msgr2=0x7f96800cdb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:58.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.305+0000 7f968509b700 1 --2- 172.21.15.146:0/4123312113 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f96800ac3b0 0x7f96800cdb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:58.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.305+0000 7f968509b700 1 -- 172.21.15.146:0/4123312113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96800abfe0 msgr2=0x7f96801515e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:58.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.305+0000 7f968509b700 1 --2- 172.21.15.146:0/4123312113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96800abfe0 0x7f96801515e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:58.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.305+0000 7f968509b700 1 -- 172.21.15.146:0/4123312113 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9670009a20 con 0x7f96800ceb50 2023-10-06T11:05:58.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.305+0000 7f967ffff700 1 --2- 172.21.15.146:0/4123312113 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f96800ac3b0 0x7f96800cdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:05:58.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.305+0000 7f968509b700 1 --2- 172.21.15.146:0/4123312113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96800ceb50 0x7f968015aaf0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f96780010e0 tx=0x7f9678007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:58.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.305+0000 7f967cff9700 1 -- 172.21.15.146:0/4123312113 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9678005c00 con 0x7f96800ceb50 2023-10-06T11:05:58.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.305+0000 7f967cff9700 1 -- 172.21.15.146:0/4123312113 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9678005d60 con 0x7f96800ceb50 2023-10-06T11:05:58.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.305+0000 7f967cff9700 1 -- 172.21.15.146:0/4123312113 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96780072e0 con 0x7f96800ceb50 2023-10-06T11:05:58.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.305+0000 7f9686afe700 1 -- 172.21.15.146:0/4123312113 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9674009420 con 0x7f96800ceb50 2023-10-06T11:05:58.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.306+0000 7f9686afe700 1 -- 172.21.15.146:0/4123312113 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9680069780 con 0x7f96800ceb50 2023-10-06T11:05:58.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.306+0000 7f9686afe700 1 -- 172.21.15.146:0/4123312113 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9680069910 con 0x7f96800ceb50 2023-10-06T11:05:58.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.307+0000 7f967cff9700 1 -- 172.21.15.146:0/4123312113 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9678007690 con 0x7f96800ceb50 2023-10-06T11:05:58.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.307+0000 7f967cff9700 1 --2- 172.21.15.146:0/4123312113 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f966c066f30 0x7f966c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:58.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.307+0000 7f968489a700 1 --2- 172.21.15.146:0/4123312113 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f966c066f30 0x7f966c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:58.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.307+0000 7f967cff9700 1 -- 172.21.15.146:0/4123312113 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9678083ae0 con 0x7f96800ceb50 2023-10-06T11:05:58.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.308+0000 7f968489a700 1 --2- 172.21.15.146:0/4123312113 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f966c066f30 0x7f966c0693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9670009fd0 tx=0x7f967000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:58.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.311+0000 7f967cff9700 1 -- 172.21.15.146:0/4123312113 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f967804b5a0 con 0x7f96800ceb50 2023-10-06T11:05:58.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.495+0000 7f9686afe700 1 -- 172.21.15.146:0/4123312113 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f96800af0d0 con 0x7f96800ceb50 2023-10-06T11:05:58.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.495+0000 7f967cff9700 1 -- 172.21.15.146:0/4123312113 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9678017020 con 0x7f96800ceb50 2023-10-06T11:05:58.497 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-10-06T11:05:58.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.497+0000 7f9686afe700 1 -- 172.21.15.146:0/4123312113 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f966c066f30 msgr2=0x7f966c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:58.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.497+0000 7f9686afe700 1 --2- 172.21.15.146:0/4123312113 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f966c066f30 0x7f966c0693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9670009fd0 tx=0x7f967000b040 comp rx=0 tx=0).stop 2023-10-06T11:05:58.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.497+0000 7f9686afe700 1 -- 172.21.15.146:0/4123312113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96800ceb50 msgr2=0x7f968015aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:58.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.497+0000 7f9686afe700 1 --2- 172.21.15.146:0/4123312113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96800ceb50 0x7f968015aaf0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f96780010e0 tx=0x7f9678007dd0 comp rx=0 tx=0).stop 2023-10-06T11:05:58.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.497+0000 7f9686afe700 1 -- 172.21.15.146:0/4123312113 shutdown_connections 2023-10-06T11:05:58.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.497+0000 7f9686afe700 1 --2- 172.21.15.146:0/4123312113 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f966c066f30 0x7f966c0693e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:58.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.497+0000 7f9686afe700 1 --2- 172.21.15.146:0/4123312113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f96800ceb50 0x7f968015aaf0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:58.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.497+0000 7f9686afe700 1 --2- 172.21.15.146:0/4123312113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96800abfe0 0x7f96801515e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:58.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.497+0000 7f9686afe700 1 --2- 172.21.15.146:0/4123312113 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f96800ac3b0 0x7f96800cdb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:58.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.497+0000 7f9686afe700 1 -- 172.21.15.146:0/4123312113 >> 172.21.15.146:0/4123312113 conn(0x7f9680067c50 msgr2=0x7f96801533b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:58.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.497+0000 7f9686afe700 1 -- 172.21.15.146:0/4123312113 shutdown_connections 2023-10-06T11:05:58.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.497+0000 7f9686afe700 1 -- 172.21.15.146:0/4123312113 wait complete. 2023-10-06T11:05:58.511 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:05:58.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.626+0000 7f939a0e4700 1 Processor -- start 2023-10-06T11:05:58.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.626+0000 7f939a0e4700 1 -- start start 2023-10-06T11:05:58.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.627+0000 7f939a0e4700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f939415a160 0x7f93940c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:58.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.627+0000 7f939a0e4700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f93940ae730 0x7f93940aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:58.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.627+0000 7f939a0e4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f93940ce3d0 0x7f93940ce830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:58.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.627+0000 7f939a0e4700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93940ae2a0 con 0x7f93940ce3d0 2023-10-06T11:05:58.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.627+0000 7f939a0e4700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f939415a530 con 0x7f93940ae730 2023-10-06T11:05:58.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.627+0000 7f939a0e4700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93940ad690 con 0x7f939415a160 2023-10-06T11:05:58.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.627+0000 7f9393fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f93940ce3d0 0x7f93940ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:58.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.627+0000 7f9393fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f93940ce3d0 0x7f93940ce830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40118/0 (socket says 172.21.15.146:40118) 2023-10-06T11:05:58.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.627+0000 7f9393fff700 1 -- 172.21.15.146:0/3058235254 learned_addr learned my addr 172.21.15.146:0/3058235254 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:58.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.627+0000 7f9392ffd700 1 --2- 172.21.15.146:0/3058235254 >> v2:172.21.15.151:3300/0 conn(0x7f93940ae730 0x7f93940aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:58.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.627+0000 7f93937fe700 1 --2- 172.21.15.146:0/3058235254 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f939415a160 0x7f93940c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:58.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.627+0000 7f9393fff700 1 -- 172.21.15.146:0/3058235254 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f939415a160 msgr2=0x7f93940c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:58.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.627+0000 7f9393fff700 1 --2- 172.21.15.146:0/3058235254 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f939415a160 0x7f93940c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:58.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.627+0000 7f9393fff700 1 -- 172.21.15.146:0/3058235254 >> v2:172.21.15.151:3300/0 conn(0x7f93940ae730 msgr2=0x7f93940aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:58.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.627+0000 7f9393fff700 1 --2- 172.21.15.146:0/3058235254 >> v2:172.21.15.151:3300/0 conn(0x7f93940ae730 0x7f93940aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:58.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.627+0000 7f9393fff700 1 -- 172.21.15.146:0/3058235254 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93940ad970 con 0x7f93940ce3d0 2023-10-06T11:05:58.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.627+0000 7f9392ffd700 1 --2- 172.21.15.146:0/3058235254 >> v2:172.21.15.151:3300/0 conn(0x7f93940ae730 0x7f93940aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:05:58.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.628+0000 7f9393fff700 1 --2- 172.21.15.146:0/3058235254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93940ce3d0 0x7f93940ce830 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9394088a00 tx=0x7f938c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38028737fbed7af0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:58.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.628+0000 7f93927fc700 1 -- 172.21.15.146:0/3058235254 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938c00b860 con 0x7f93940ce3d0 2023-10-06T11:05:58.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.628+0000 7f93927fc700 1 -- 172.21.15.146:0/3058235254 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f938c00b9c0 con 0x7f93940ce3d0 2023-10-06T11:05:58.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.628+0000 7f93927fc700 1 -- 172.21.15.146:0/3058235254 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938c00bd60 con 0x7f93940ce3d0 2023-10-06T11:05:58.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.628+0000 7f939a0e4700 1 -- 172.21.15.146:0/3058235254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93940ce3d0 msgr2=0x7f93940ce830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:58.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.628+0000 7f939a0e4700 1 --2- 172.21.15.146:0/3058235254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93940ce3d0 0x7f93940ce830 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9394088a00 tx=0x7f938c009250 comp rx=0 tx=0).stop 2023-10-06T11:05:58.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.628+0000 7f939a0e4700 1 -- 172.21.15.146:0/3058235254 shutdown_connections 2023-10-06T11:05:58.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.628+0000 7f939a0e4700 1 --2- 172.21.15.146:0/3058235254 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93940ce3d0 0x7f93940ce830 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:58.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.628+0000 7f939a0e4700 1 --2- 172.21.15.146:0/3058235254 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f939415a160 0x7f93940c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:58.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.628+0000 7f939a0e4700 1 --2- 172.21.15.146:0/3058235254 >> v2:172.21.15.151:3300/0 conn(0x7f93940ae730 0x7f93940aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:58.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.628+0000 7f939a0e4700 1 -- 172.21.15.146:0/3058235254 >> 172.21.15.146:0/3058235254 conn(0x7f939406f380 msgr2=0x7f93940d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:58.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.628+0000 7f939a0e4700 1 -- 172.21.15.146:0/3058235254 shutdown_connections 2023-10-06T11:05:58.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.628+0000 7f939a0e4700 1 -- 172.21.15.146:0/3058235254 wait complete. 2023-10-06T11:05:58.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.629+0000 7f939a0e4700 1 Processor -- start 2023-10-06T11:05:58.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.630+0000 7f939a0e4700 1 -- start start 2023-10-06T11:05:58.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.630+0000 7f939a0e4700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93940ae730 0x7f93940c9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:58.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.630+0000 7f939a0e4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93940ce3d0 0x7f93941571e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:58.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.630+0000 7f939a0e4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f939415a160 0x7f93940aff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:58.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.630+0000 7f939a0e4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93940afb00 con 0x7f93940ce3d0 2023-10-06T11:05:58.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.630+0000 7f939a0e4700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93940c9740 con 0x7f939415a160 2023-10-06T11:05:58.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.630+0000 7f939a0e4700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93940aeef0 con 0x7f93940ae730 2023-10-06T11:05:58.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.630+0000 7f9392ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93940ce3d0 0x7f93941571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:58.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.630+0000 7f9392ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93940ce3d0 0x7f93941571e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40132/0 (socket says 172.21.15.146:40132) 2023-10-06T11:05:58.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.630+0000 7f9392ffd700 1 -- 172.21.15.146:0/386683029 learned_addr learned my addr 172.21.15.146:0/386683029 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:58.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.630+0000 7f93937fe700 1 --2- 172.21.15.146:0/386683029 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93940ae730 0x7f93940c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:58.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.630+0000 7f9393fff700 1 --2- 172.21.15.146:0/386683029 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f939415a160 0x7f93940aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:58.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.631+0000 7f9392ffd700 1 -- 172.21.15.146:0/386683029 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93940ae730 msgr2=0x7f93940c9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:58.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.631+0000 7f9392ffd700 1 --2- 172.21.15.146:0/386683029 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93940ae730 0x7f93940c9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:58.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.631+0000 7f9392ffd700 1 -- 172.21.15.146:0/386683029 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f939415a160 msgr2=0x7f93940aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:58.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.631+0000 7f9392ffd700 1 --2- 172.21.15.146:0/386683029 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f939415a160 0x7f93940aff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:58.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.631+0000 7f9392ffd700 1 -- 172.21.15.146:0/386683029 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f938c0094f0 con 0x7f93940ce3d0 2023-10-06T11:05:58.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.631+0000 7f9393fff700 1 --2- 172.21.15.146:0/386683029 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f939415a160 0x7f93940aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:05:58.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.631+0000 7f93937fe700 1 --2- 172.21.15.146:0/386683029 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93940ae730 0x7f93940c9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:05:58.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.631+0000 7f9392ffd700 1 --2- 172.21.15.146:0/386683029 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93940ce3d0 0x7f93941571e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f938800d860 tx=0x7f9388008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:58.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.631+0000 7f937b7fe700 1 -- 172.21.15.146:0/386683029 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93880125f0 con 0x7f93940ce3d0 2023-10-06T11:05:58.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.631+0000 7f937b7fe700 1 -- 172.21.15.146:0/386683029 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9388012750 con 0x7f93940ce3d0 2023-10-06T11:05:58.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.631+0000 7f939a0e4700 1 -- 172.21.15.146:0/386683029 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93940af1d0 con 0x7f93940ce3d0 2023-10-06T11:05:58.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.631+0000 7f937b7fe700 1 -- 172.21.15.146:0/386683029 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9388012ad0 con 0x7f93940ce3d0 2023-10-06T11:05:58.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.631+0000 7f939a0e4700 1 -- 172.21.15.146:0/386683029 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93940af790 con 0x7f93940ce3d0 2023-10-06T11:05:58.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.632+0000 7f939a0e4700 1 -- 172.21.15.146:0/386683029 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9394068390 con 0x7f93940ce3d0 2023-10-06T11:05:58.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.632+0000 7f937b7fe700 1 -- 172.21.15.146:0/386683029 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9388014430 con 0x7f93940ce3d0 2023-10-06T11:05:58.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.633+0000 7f937b7fe700 1 --2- 172.21.15.146:0/386683029 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9380066f30 0x7f93800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:58.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.633+0000 7f93937fe700 1 --2- 172.21.15.146:0/386683029 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9380066f30 0x7f93800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:58.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.633+0000 7f937b7fe700 1 -- 172.21.15.146:0/386683029 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9388084b20 con 0x7f93940ce3d0 2023-10-06T11:05:58.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.633+0000 7f93937fe700 1 --2- 172.21.15.146:0/386683029 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9380066f30 0x7f93800693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9384007620 tx=0x7f9384009830 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:58.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.637+0000 7f937b7fe700 1 -- 172.21.15.146:0/386683029 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9388051c30 con 0x7f93940ce3d0 2023-10-06T11:05:58.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.821+0000 7f939a0e4700 1 -- 172.21.15.146:0/386683029 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f939404c380 con 0x7f93940ce3d0 2023-10-06T11:05:58.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.822+0000 7f937b7fe700 1 -- 172.21.15.146:0/386683029 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9388055250 con 0x7f93940ce3d0 2023-10-06T11:05:58.824 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-10-06T11:05:58.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.824+0000 7f939a0e4700 1 -- 172.21.15.146:0/386683029 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9380066f30 msgr2=0x7f93800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:58.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.824+0000 7f939a0e4700 1 --2- 172.21.15.146:0/386683029 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9380066f30 0x7f93800693e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9384007620 tx=0x7f9384009830 comp rx=0 tx=0).stop 2023-10-06T11:05:58.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.824+0000 7f939a0e4700 1 -- 172.21.15.146:0/386683029 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93940ce3d0 msgr2=0x7f93941571e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:58.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.824+0000 7f939a0e4700 1 --2- 172.21.15.146:0/386683029 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93940ce3d0 0x7f93941571e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f938800d860 tx=0x7f9388008040 comp rx=0 tx=0).stop 2023-10-06T11:05:58.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.824+0000 7f939a0e4700 1 -- 172.21.15.146:0/386683029 shutdown_connections 2023-10-06T11:05:58.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.824+0000 7f939a0e4700 1 --2- 172.21.15.146:0/386683029 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9380066f30 0x7f93800693e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:58.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.824+0000 7f939a0e4700 1 --2- 172.21.15.146:0/386683029 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f939415a160 0x7f93940aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:58.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.824+0000 7f939a0e4700 1 --2- 172.21.15.146:0/386683029 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93940ae730 0x7f93940c9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:58.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.824+0000 7f939a0e4700 1 --2- 172.21.15.146:0/386683029 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93940ce3d0 0x7f93941571e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:58.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.824+0000 7f939a0e4700 1 -- 172.21.15.146:0/386683029 >> 172.21.15.146:0/386683029 conn(0x7f939406f380 msgr2=0x7f93940c55a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:58.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.824+0000 7f939a0e4700 1 -- 172.21.15.146:0/386683029 shutdown_connections 2023-10-06T11:05:58.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.824+0000 7f939a0e4700 1 -- 172.21.15.146:0/386683029 wait complete. 2023-10-06T11:05:58.838 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T11:05:58.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.953+0000 7f896c241700 1 Processor -- start 2023-10-06T11:05:58.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.953+0000 7f896c241700 1 -- start start 2023-10-06T11:05:58.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.954+0000 7f896c241700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f896415a160 0x7f89640c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:58.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.954+0000 7f896c241700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f89640ae730 0x7f89640aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:58.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.954+0000 7f896c241700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89640ce3d0 0x7f89640ce810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:58.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.954+0000 7f896c241700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89640ae2a0 con 0x7f89640ae730 2023-10-06T11:05:58.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.954+0000 7f896c241700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f896415a530 con 0x7f896415a160 2023-10-06T11:05:58.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.954+0000 7f896c241700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89640af0f0 con 0x7f89640ce3d0 2023-10-06T11:05:58.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.954+0000 7f89697dc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f89640ae730 0x7f89640aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:58.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.954+0000 7f89697dc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f89640ae730 0x7f89640aebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40142/0 (socket says 172.21.15.146:40142) 2023-10-06T11:05:58.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.954+0000 7f89697dc700 1 -- 172.21.15.146:0/1041787276 learned_addr learned my addr 172.21.15.146:0/1041787276 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:58.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.954+0000 7f896a7de700 1 --2- 172.21.15.146:0/1041787276 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89640ce3d0 0x7f89640ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:58.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.954+0000 7f8969fdd700 1 --2- 172.21.15.146:0/1041787276 >> v2:172.21.15.151:3300/0 conn(0x7f896415a160 0x7f89640c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:58.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.955+0000 7f89697dc700 1 -- 172.21.15.146:0/1041787276 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89640ce3d0 msgr2=0x7f89640ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:58.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.955+0000 7f89697dc700 1 --2- 172.21.15.146:0/1041787276 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89640ce3d0 0x7f89640ce810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:58.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.955+0000 7f89697dc700 1 -- 172.21.15.146:0/1041787276 >> v2:172.21.15.151:3300/0 conn(0x7f896415a160 msgr2=0x7f89640c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:58.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.955+0000 7f89697dc700 1 --2- 172.21.15.146:0/1041787276 >> v2:172.21.15.151:3300/0 conn(0x7f896415a160 0x7f89640c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:58.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.955+0000 7f89697dc700 1 -- 172.21.15.146:0/1041787276 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89640ad690 con 0x7f89640ae730 2023-10-06T11:05:58.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.955+0000 7f89697dc700 1 --2- 172.21.15.146:0/1041787276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89640ae730 0x7f89640aebb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8964065100 tx=0x7f8954009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf212a30d830aa1e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:58.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.955+0000 7f8968fdb700 1 -- 172.21.15.146:0/1041787276 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895400b640 con 0x7f89640ae730 2023-10-06T11:05:58.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.955+0000 7f8968fdb700 1 -- 172.21.15.146:0/1041787276 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895400b7a0 con 0x7f89640ae730 2023-10-06T11:05:58.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.955+0000 7f8968fdb700 1 -- 172.21.15.146:0/1041787276 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895400bb60 con 0x7f89640ae730 2023-10-06T11:05:58.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.955+0000 7f896c241700 1 -- 172.21.15.146:0/1041787276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89640ae730 msgr2=0x7f89640aebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:58.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.955+0000 7f896c241700 1 --2- 172.21.15.146:0/1041787276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89640ae730 0x7f89640aebb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8964065100 tx=0x7f8954009250 comp rx=0 tx=0).stop 2023-10-06T11:05:58.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.955+0000 7f896c241700 1 -- 172.21.15.146:0/1041787276 shutdown_connections 2023-10-06T11:05:58.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.956+0000 7f896c241700 1 --2- 172.21.15.146:0/1041787276 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89640ce3d0 0x7f89640ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:58.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.956+0000 7f896c241700 1 --2- 172.21.15.146:0/1041787276 >> v2:172.21.15.151:3300/0 conn(0x7f896415a160 0x7f89640c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:58.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.956+0000 7f896c241700 1 --2- 172.21.15.146:0/1041787276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89640ae730 0x7f89640aebb0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:58.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.956+0000 7f896c241700 1 -- 172.21.15.146:0/1041787276 >> 172.21.15.146:0/1041787276 conn(0x7f896406f380 msgr2=0x7f89640d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:58.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.956+0000 7f896c241700 1 -- 172.21.15.146:0/1041787276 shutdown_connections 2023-10-06T11:05:58.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.956+0000 7f896c241700 1 -- 172.21.15.146:0/1041787276 wait complete. 2023-10-06T11:05:58.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.957+0000 7f896c241700 1 Processor -- start 2023-10-06T11:05:58.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.957+0000 7f896c241700 1 -- start start 2023-10-06T11:05:58.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.957+0000 7f896c241700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89640ae730 0x7f89640c9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:58.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.957+0000 7f896c241700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89640ce3d0 0x7f89640c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:58.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.957+0000 7f896c241700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f896415a160 0x7f8964151c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:58.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.957+0000 7f896c241700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89640c9900 con 0x7f896415a160 2023-10-06T11:05:58.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.957+0000 7f896c241700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89640c8cf0 con 0x7f89640ce3d0 2023-10-06T11:05:58.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.957+0000 7f896c241700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89640c8fd0 con 0x7f89640ae730 2023-10-06T11:05:58.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.957+0000 7f896a7de700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f896415a160 0x7f8964151c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:58.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.957+0000 7f896a7de700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f896415a160 0x7f8964151c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40154/0 (socket says 172.21.15.146:40154) 2023-10-06T11:05:58.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.957+0000 7f896a7de700 1 -- 172.21.15.146:0/14143714 learned_addr learned my addr 172.21.15.146:0/14143714 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:58.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.958+0000 7f8969fdd700 1 --2- 172.21.15.146:0/14143714 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89640ae730 0x7f89640c9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:58.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.958+0000 7f89697dc700 1 --2- 172.21.15.146:0/14143714 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89640ce3d0 0x7f89640c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:58.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.958+0000 7f896a7de700 1 -- 172.21.15.146:0/14143714 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89640ae730 msgr2=0x7f89640c9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:58.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.958+0000 7f896a7de700 1 --2- 172.21.15.146:0/14143714 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89640ae730 0x7f89640c9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:58.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.958+0000 7f896a7de700 1 -- 172.21.15.146:0/14143714 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89640ce3d0 msgr2=0x7f89640c84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:58.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.958+0000 7f896a7de700 1 --2- 172.21.15.146:0/14143714 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89640ce3d0 0x7f89640c84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:58.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.958+0000 7f896a7de700 1 -- 172.21.15.146:0/14143714 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89540094f0 con 0x7f896415a160 2023-10-06T11:05:58.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.958+0000 7f896a7de700 1 --2- 172.21.15.146:0/14143714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f896415a160 0x7f8964151c60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f895c00e8d0 tx=0x7f895c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:58.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.958+0000 7f8959ffb700 1 -- 172.21.15.146:0/14143714 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895c013680 con 0x7f896415a160 2023-10-06T11:05:58.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.958+0000 7f8959ffb700 1 -- 172.21.15.146:0/14143714 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895c0137e0 con 0x7f896415a160 2023-10-06T11:05:58.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.958+0000 7f896c241700 1 -- 172.21.15.146:0/14143714 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89640c92b0 con 0x7f896415a160 2023-10-06T11:05:58.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.958+0000 7f8959ffb700 1 -- 172.21.15.146:0/14143714 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895c013ba0 con 0x7f896415a160 2023-10-06T11:05:58.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.958+0000 7f896c241700 1 -- 172.21.15.146:0/14143714 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89641521a0 con 0x7f896415a160 2023-10-06T11:05:58.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.959+0000 7f896c241700 1 -- 172.21.15.146:0/14143714 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8964068390 con 0x7f896415a160 2023-10-06T11:05:58.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.960+0000 7f8959ffb700 1 -- 172.21.15.146:0/14143714 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f895c0123d0 con 0x7f896415a160 2023-10-06T11:05:58.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.960+0000 7f8959ffb700 1 --2- 172.21.15.146:0/14143714 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8948066f30 0x7f89480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:58.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.960+0000 7f8959ffb700 1 -- 172.21.15.146:0/14143714 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f895c084ae0 con 0x7f896415a160 2023-10-06T11:05:58.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.960+0000 7f8969fdd700 1 --2- 172.21.15.146:0/14143714 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8948066f30 0x7f89480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:58.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.960+0000 7f8969fdd700 1 --2- 172.21.15.146:0/14143714 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8948066f30 0x7f89480693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f896000f5b0 tx=0x7f896000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:58.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:58.964+0000 7f8959ffb700 1 -- 172.21.15.146:0/14143714 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f895c051bf0 con 0x7f896415a160 2023-10-06T11:05:59.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.147+0000 7f896c241700 1 -- 172.21.15.146:0/14143714 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f896404c380 con 0x7f896415a160 2023-10-06T11:05:59.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.147+0000 7f8959ffb700 1 -- 172.21.15.146:0/14143714 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f895c055210 con 0x7f896415a160 2023-10-06T11:05:59.149 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2023-10-06T11:05:59.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.149+0000 7f896c241700 1 -- 172.21.15.146:0/14143714 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8948066f30 msgr2=0x7f89480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:59.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.149+0000 7f896c241700 1 --2- 172.21.15.146:0/14143714 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8948066f30 0x7f89480693e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f896000f5b0 tx=0x7f896000b040 comp rx=0 tx=0).stop 2023-10-06T11:05:59.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.149+0000 7f896c241700 1 -- 172.21.15.146:0/14143714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f896415a160 msgr2=0x7f8964151c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:59.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.149+0000 7f896c241700 1 --2- 172.21.15.146:0/14143714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f896415a160 0x7f8964151c60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f895c00e8d0 tx=0x7f895c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:05:59.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.149+0000 7f896c241700 1 -- 172.21.15.146:0/14143714 shutdown_connections 2023-10-06T11:05:59.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.149+0000 7f896c241700 1 --2- 172.21.15.146:0/14143714 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8948066f30 0x7f89480693e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:59.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.149+0000 7f896c241700 1 --2- 172.21.15.146:0/14143714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f896415a160 0x7f8964151c60 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:59.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.150+0000 7f896c241700 1 --2- 172.21.15.146:0/14143714 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89640ae730 0x7f89640c9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:59.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.150+0000 7f896c241700 1 --2- 172.21.15.146:0/14143714 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89640ce3d0 0x7f89640c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:59.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.150+0000 7f896c241700 1 -- 172.21.15.146:0/14143714 >> 172.21.15.146:0/14143714 conn(0x7f896406f380 msgr2=0x7f8964152520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:59.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.150+0000 7f896c241700 1 -- 172.21.15.146:0/14143714 shutdown_connections 2023-10-06T11:05:59.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.150+0000 7f896c241700 1 -- 172.21.15.146:0/14143714 wait complete. 2023-10-06T11:05:59.163 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T11:05:59.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.278+0000 7f8f0eed5700 1 Processor -- start 2023-10-06T11:05:59.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.278+0000 7f8f0eed5700 1 -- start start 2023-10-06T11:05:59.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.279+0000 7f8f0eed5700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f080b5640 0x7f8f0815a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:59.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.279+0000 7f8f0eed5700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8f080cb090 0x7f8f080cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:59.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.279+0000 7f8f0eed5700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f080cc130 con 0x7f8f08068780 2023-10-06T11:05:59.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.279+0000 7f8f0eed5700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f080b2660 con 0x7f8f080cb090 2023-10-06T11:05:59.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.279+0000 7f8f0eed5700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0815adb0 con 0x7f8f080b5640 2023-10-06T11:05:59.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.279+0000 7f8f0e6d4700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8f08068780 0x7f8f0815b010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38836/0 (socket says 172.21.15.146:38836) 2023-10-06T11:05:59.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.279+0000 7f8f0e6d4700 1 -- 172.21.15.146:0/853415302 learned_addr learned my addr 172.21.15.146:0/853415302 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:05:59.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.279+0000 7f8f0d6d2700 1 --2- 172.21.15.146:0/853415302 >> v2:172.21.15.151:3300/0 conn(0x7f8f080cb090 0x7f8f080cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:59.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.279+0000 7f8f0ded3700 1 --2- 172.21.15.146:0/853415302 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f080b5640 0x7f8f0815a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:59.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.279+0000 7f8f0ced1700 1 -- 172.21.15.146:0/853415302 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3596631071 0 0) 0x7f8f080cc130 con 0x7f8f08068780 2023-10-06T11:05:59.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.279+0000 7f8f0ced1700 1 -- 172.21.15.146:0/853415302 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ef4003570 con 0x7f8f08068780 2023-10-06T11:05:59.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.279+0000 7f8f0ded3700 1 -- 172.21.15.146:0/853415302 >> v2:172.21.15.151:3300/0 conn(0x7f8f080cb090 msgr2=0x7f8f080cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:59.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.279+0000 7f8f0ded3700 1 --2- 172.21.15.146:0/853415302 >> v2:172.21.15.151:3300/0 conn(0x7f8f080cb090 0x7f8f080cc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:59.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.279+0000 7f8f0ded3700 1 -- 172.21.15.146:0/853415302 >> v1:172.21.15.146:6789/0 conn(0x7f8f08068780 legacy=0x7f8f0815b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:59.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.279+0000 7f8f0ded3700 1 -- 172.21.15.146:0/853415302 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f080cb520 con 0x7f8f080b5640 2023-10-06T11:05:59.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.279+0000 7f8f0d6d2700 1 --2- 172.21.15.146:0/853415302 >> v2:172.21.15.151:3300/0 conn(0x7f8f080cb090 0x7f8f080cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:05:59.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.280+0000 7f8f0ded3700 1 --2- 172.21.15.146:0/853415302 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f080b5640 0x7f8f0815a870 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8f040098e0 tx=0x7f8f040091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41252a1359472be9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:59.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.280+0000 7f8f0ced1700 1 -- 172.21.15.146:0/853415302 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f04011630 con 0x7f8f080b5640 2023-10-06T11:05:59.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.280+0000 7f8f0ced1700 1 -- 172.21.15.146:0/853415302 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f04011790 con 0x7f8f080b5640 2023-10-06T11:05:59.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.280+0000 7f8f0ced1700 1 -- 172.21.15.146:0/853415302 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f04011b30 con 0x7f8f080b5640 2023-10-06T11:05:59.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.280+0000 7f8f0eed5700 1 -- 172.21.15.146:0/853415302 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f080b5640 msgr2=0x7f8f0815a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:59.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.280+0000 7f8f0eed5700 1 --2- 172.21.15.146:0/853415302 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f080b5640 0x7f8f0815a870 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8f040098e0 tx=0x7f8f040091a0 comp rx=0 tx=0).stop 2023-10-06T11:05:59.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.280+0000 7f8f0eed5700 1 -- 172.21.15.146:0/853415302 shutdown_connections 2023-10-06T11:05:59.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.280+0000 7f8f0eed5700 1 --2- 172.21.15.146:0/853415302 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f080b5640 0x7f8f0815a870 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:59.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.280+0000 7f8f0eed5700 1 --2- 172.21.15.146:0/853415302 >> v2:172.21.15.151:3300/0 conn(0x7f8f080cb090 0x7f8f080cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:59.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.280+0000 7f8f0eed5700 1 -- 172.21.15.146:0/853415302 >> 172.21.15.146:0/853415302 conn(0x7f8f080703f0 msgr2=0x7f8f080707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:59.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.280+0000 7f8f0eed5700 1 -- 172.21.15.146:0/853415302 shutdown_connections 2023-10-06T11:05:59.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.280+0000 7f8f0eed5700 1 -- 172.21.15.146:0/853415302 wait complete. 2023-10-06T11:05:59.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.281+0000 7f8f0eed5700 1 Processor -- start 2023-10-06T11:05:59.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.282+0000 7f8f0eed5700 1 -- start start 2023-10-06T11:05:59.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.282+0000 7f8f0eed5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f08068780 0x7f8f081697c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:59.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.282+0000 7f8f0eed5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f080b5640 0x7f8f081525e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:59.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.282+0000 7f8f0eed5700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f080cb090 0x7f8f080c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:59.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.282+0000 7f8f0eed5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f080c9120 con 0x7f8f08068780 2023-10-06T11:05:59.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.282+0000 7f8f0eed5700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f080c5300 con 0x7f8f080b5640 2023-10-06T11:05:59.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.282+0000 7f8f0eed5700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f080c9390 con 0x7f8f080cb090 2023-10-06T11:05:59.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.282+0000 7f8f0ded3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f08068780 0x7f8f081697c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:59.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.282+0000 7f8f0ded3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f08068780 0x7f8f081697c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40158/0 (socket says 172.21.15.146:40158) 2023-10-06T11:05:59.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.282+0000 7f8f0ded3700 1 -- 172.21.15.146:0/3554959626 learned_addr learned my addr 172.21.15.146:0/3554959626 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:59.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.282+0000 7f8f0d6d2700 1 --2- 172.21.15.146:0/3554959626 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f080b5640 0x7f8f081525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:59.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.282+0000 7f8f0e6d4700 1 --2- 172.21.15.146:0/3554959626 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f080cb090 0x7f8f080c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:59.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.283+0000 7f8f0ded3700 1 -- 172.21.15.146:0/3554959626 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f080cb090 msgr2=0x7f8f080c87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:59.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.283+0000 7f8f0ded3700 1 --2- 172.21.15.146:0/3554959626 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f080cb090 0x7f8f080c87c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:59.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.283+0000 7f8f0ded3700 1 -- 172.21.15.146:0/3554959626 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f080b5640 msgr2=0x7f8f081525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:59.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.283+0000 7f8f0ded3700 1 --2- 172.21.15.146:0/3554959626 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f080b5640 0x7f8f081525e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:59.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.283+0000 7f8f0ded3700 1 -- 172.21.15.146:0/3554959626 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef8009420 con 0x7f8f08068780 2023-10-06T11:05:59.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.283+0000 7f8f0ded3700 1 --2- 172.21.15.146:0/3554959626 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f08068780 0x7f8f081697c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8f080b2090 tx=0x7f8f04017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:59.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.283+0000 7f8efdffb700 1 -- 172.21.15.146:0/3554959626 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f04011900 con 0x7f8f08068780 2023-10-06T11:05:59.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.283+0000 7f8efdffb700 1 -- 172.21.15.146:0/3554959626 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f04011a60 con 0x7f8f08068780 2023-10-06T11:05:59.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.283+0000 7f8efdffb700 1 -- 172.21.15.146:0/3554959626 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f04025640 con 0x7f8f08068780 2023-10-06T11:05:59.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.283+0000 7f8f0eed5700 1 -- 172.21.15.146:0/3554959626 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f04009420 con 0x7f8f08068780 2023-10-06T11:05:59.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.283+0000 7f8f0eed5700 1 -- 172.21.15.146:0/3554959626 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f080c4dc0 con 0x7f8f08068780 2023-10-06T11:05:59.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.284+0000 7f8f0eed5700 1 -- 172.21.15.146:0/3554959626 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f080894b0 con 0x7f8f08068780 2023-10-06T11:05:59.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.284+0000 7f8efdffb700 1 -- 172.21.15.146:0/3554959626 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8f04025a30 con 0x7f8f08068780 2023-10-06T11:05:59.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.285+0000 7f8efdffb700 1 --2- 172.21.15.146:0/3554959626 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8eec066f30 0x7f8eec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:59.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.285+0000 7f8f0d6d2700 1 --2- 172.21.15.146:0/3554959626 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8eec066f30 0x7f8eec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:59.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.285+0000 7f8efdffb700 1 -- 172.21.15.146:0/3554959626 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8f04085df0 con 0x7f8f08068780 2023-10-06T11:05:59.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.285+0000 7f8f0d6d2700 1 --2- 172.21.15.146:0/3554959626 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8eec066f30 0x7f8eec0693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8009f40 tx=0x7f8ef80091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:59.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.289+0000 7f8efdffb700 1 -- 172.21.15.146:0/3554959626 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8f04052f00 con 0x7f8f08068780 2023-10-06T11:05:59.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.476+0000 7f8f0eed5700 1 -- 172.21.15.146:0/3554959626 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8f0804bb40 con 0x7f8f08068780 2023-10-06T11:05:59.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.476+0000 7f8efdffb700 1 -- 172.21.15.146:0/3554959626 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8f04056520 con 0x7f8f08068780 2023-10-06T11:05:59.478 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2023-10-06T11:05:59.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.478+0000 7f8f0eed5700 1 -- 172.21.15.146:0/3554959626 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8eec066f30 msgr2=0x7f8eec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:59.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.478+0000 7f8f0eed5700 1 --2- 172.21.15.146:0/3554959626 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8eec066f30 0x7f8eec0693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8009f40 tx=0x7f8ef80091a0 comp rx=0 tx=0).stop 2023-10-06T11:05:59.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.478+0000 7f8f0eed5700 1 -- 172.21.15.146:0/3554959626 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f08068780 msgr2=0x7f8f081697c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:59.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.478+0000 7f8f0eed5700 1 --2- 172.21.15.146:0/3554959626 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f08068780 0x7f8f081697c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8f080b2090 tx=0x7f8f04017000 comp rx=0 tx=0).stop 2023-10-06T11:05:59.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.479+0000 7f8f0eed5700 1 -- 172.21.15.146:0/3554959626 shutdown_connections 2023-10-06T11:05:59.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.479+0000 7f8f0eed5700 1 --2- 172.21.15.146:0/3554959626 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8eec066f30 0x7f8eec0693e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:59.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.479+0000 7f8f0eed5700 1 --2- 172.21.15.146:0/3554959626 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f080cb090 0x7f8f080c87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:59.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.479+0000 7f8f0eed5700 1 --2- 172.21.15.146:0/3554959626 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f08068780 0x7f8f081697c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:59.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.479+0000 7f8f0eed5700 1 --2- 172.21.15.146:0/3554959626 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f080b5640 0x7f8f081525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:59.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.479+0000 7f8f0eed5700 1 -- 172.21.15.146:0/3554959626 >> 172.21.15.146:0/3554959626 conn(0x7f8f080703f0 msgr2=0x7f8f080cfb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:59.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.479+0000 7f8f0eed5700 1 -- 172.21.15.146:0/3554959626 shutdown_connections 2023-10-06T11:05:59.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.479+0000 7f8f0eed5700 1 -- 172.21.15.146:0/3554959626 wait complete. 2023-10-06T11:05:59.492 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:05:59.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.605+0000 7fa60f610700 1 Processor -- start 2023-10-06T11:05:59.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.605+0000 7fa60f610700 1 -- start start 2023-10-06T11:05:59.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.606+0000 7fa60f610700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6080ced80 0x7fa6080c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:59.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.606+0000 7fa60f610700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa6080c3910 0x7fa6080cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:59.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.606+0000 7fa60f610700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6080cf210 con 0x7fa6080b0c00 2023-10-06T11:05:59.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.606+0000 7fa60f610700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6080682f0 con 0x7fa6080c3910 2023-10-06T11:05:59.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.606+0000 7fa60f610700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa608068580 con 0x7fa6080ced80 2023-10-06T11:05:59.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.606+0000 7fa60dbad700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa6080c3910 0x7fa6080cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:59.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.606+0000 7fa60dbad700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa6080c3910 0x7fa6080cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40164/0 (socket says 172.21.15.146:40164) 2023-10-06T11:05:59.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.606+0000 7fa60dbad700 1 -- 172.21.15.146:0/4217501897 learned_addr learned my addr 172.21.15.146:0/4217501897 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:59.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.606+0000 7fa60cbab700 1 --2- 172.21.15.146:0/4217501897 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6080ced80 0x7fa6080c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:59.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.606+0000 7fa60dbad700 1 -- 172.21.15.146:0/4217501897 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6080ced80 msgr2=0x7fa6080c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:59.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.606+0000 7fa60dbad700 1 --2- 172.21.15.146:0/4217501897 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6080ced80 0x7fa6080c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:59.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.606+0000 7fa60dbad700 1 -- 172.21.15.146:0/4217501897 >> v1:172.21.15.151:6789/0 conn(0x7fa6080b0c00 legacy=0x7fa6080c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:59.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.606+0000 7fa60dbad700 1 -- 172.21.15.146:0/4217501897 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa608068790 con 0x7fa6080c3910 2023-10-06T11:05:59.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.606+0000 7fa60cbab700 1 --2- 172.21.15.146:0/4217501897 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6080ced80 0x7fa6080c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:05:59.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.607+0000 7fa60dbad700 1 --2- 172.21.15.146:0/4217501897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6080c3910 0x7fa6080cd8c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa600009f20 tx=0x7fa600009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=123bf2b8f28928d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:59.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.607+0000 7fa5fffff700 1 -- 172.21.15.146:0/4217501897 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60000e070 con 0x7fa6080c3910 2023-10-06T11:05:59.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.607+0000 7fa5fffff700 1 -- 172.21.15.146:0/4217501897 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60000bad0 con 0x7fa6080c3910 2023-10-06T11:05:59.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.607+0000 7fa5fffff700 1 -- 172.21.15.146:0/4217501897 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6000092e0 con 0x7fa6080c3910 2023-10-06T11:05:59.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.607+0000 7fa60f610700 1 -- 172.21.15.146:0/4217501897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6080c3910 msgr2=0x7fa6080cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:59.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.607+0000 7fa60f610700 1 --2- 172.21.15.146:0/4217501897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6080c3910 0x7fa6080cd8c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa600009f20 tx=0x7fa600009840 comp rx=0 tx=0).stop 2023-10-06T11:05:59.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.607+0000 7fa60f610700 1 -- 172.21.15.146:0/4217501897 shutdown_connections 2023-10-06T11:05:59.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.607+0000 7fa60f610700 1 --2- 172.21.15.146:0/4217501897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6080c3910 0x7fa6080cd8c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:59.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.607+0000 7fa60f610700 1 --2- 172.21.15.146:0/4217501897 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6080ced80 0x7fa6080c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:59.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.607+0000 7fa60f610700 1 -- 172.21.15.146:0/4217501897 >> 172.21.15.146:0/4217501897 conn(0x7fa608067c50 msgr2=0x7fa6080ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:59.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.607+0000 7fa60f610700 1 -- 172.21.15.146:0/4217501897 shutdown_connections 2023-10-06T11:05:59.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.607+0000 7fa60f610700 1 -- 172.21.15.146:0/4217501897 wait complete. 2023-10-06T11:05:59.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.608+0000 7fa60f610700 1 Processor -- start 2023-10-06T11:05:59.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.608+0000 7fa60f610700 1 -- start start 2023-10-06T11:05:59.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.609+0000 7fa60f610700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6080b0c00 0x7fa6080c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:59.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.609+0000 7fa60f610700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6080c3910 0x7fa608157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:59.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.609+0000 7fa60f610700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6080ced80 0x7fa60816cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:59.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.609+0000 7fa60f610700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6081591f0 con 0x7fa6080b0c00 2023-10-06T11:05:59.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.609+0000 7fa60f610700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa608158670 con 0x7fa6080c3910 2023-10-06T11:05:59.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.609+0000 7fa60f610700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa608158950 con 0x7fa6080ced80 2023-10-06T11:05:59.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.609+0000 7fa60d3ac700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6080b0c00 0x7fa6080c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:59.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.609+0000 7fa60d3ac700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6080b0c00 0x7fa6080c80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40170/0 (socket says 172.21.15.146:40170) 2023-10-06T11:05:59.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.609+0000 7fa60d3ac700 1 -- 172.21.15.146:0/3165461501 learned_addr learned my addr 172.21.15.146:0/3165461501 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:59.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.610+0000 7fa60cbab700 1 --2- 172.21.15.146:0/3165461501 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6080c3910 0x7fa608157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:59.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.610+0000 7fa60dbad700 1 --2- 172.21.15.146:0/3165461501 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6080ced80 0x7fa60816cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:59.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.610+0000 7fa60d3ac700 1 -- 172.21.15.146:0/3165461501 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6080ced80 msgr2=0x7fa60816cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:59.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.610+0000 7fa60d3ac700 1 --2- 172.21.15.146:0/3165461501 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6080ced80 0x7fa60816cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:59.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.610+0000 7fa60d3ac700 1 -- 172.21.15.146:0/3165461501 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6080c3910 msgr2=0x7fa608157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:59.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.610+0000 7fa60d3ac700 1 --2- 172.21.15.146:0/3165461501 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6080c3910 0x7fa608157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:59.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.610+0000 7fa60d3ac700 1 -- 172.21.15.146:0/3165461501 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa600009ae0 con 0x7fa6080b0c00 2023-10-06T11:05:59.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.610+0000 7fa60d3ac700 1 --2- 172.21.15.146:0/3165461501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6080b0c00 0x7fa6080c80d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa60400c5d0 tx=0x7fa604007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:59.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.610+0000 7fa5fd7fa700 1 -- 172.21.15.146:0/3165461501 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa604011590 con 0x7fa6080b0c00 2023-10-06T11:05:59.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.610+0000 7fa5fd7fa700 1 -- 172.21.15.146:0/3165461501 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa604011710 con 0x7fa6080b0c00 2023-10-06T11:05:59.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.610+0000 7fa60f610700 1 -- 172.21.15.146:0/3165461501 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa608158c30 con 0x7fa6080b0c00 2023-10-06T11:05:59.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.610+0000 7fa5fd7fa700 1 -- 172.21.15.146:0/3165461501 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa604011ad0 con 0x7fa6080b0c00 2023-10-06T11:05:59.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.610+0000 7fa60f610700 1 -- 172.21.15.146:0/3165461501 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6080c8610 con 0x7fa6080b0c00 2023-10-06T11:05:59.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.611+0000 7fa60f610700 1 -- 172.21.15.146:0/3165461501 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa60804c380 con 0x7fa6080b0c00 2023-10-06T11:05:59.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.611+0000 7fa5fd7fa700 1 -- 172.21.15.146:0/3165461501 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa60401c460 con 0x7fa6080b0c00 2023-10-06T11:05:59.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.612+0000 7fa5fd7fa700 1 --2- 172.21.15.146:0/3165461501 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa5ec066f30 0x7fa5ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:59.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.612+0000 7fa5fd7fa700 1 -- 172.21.15.146:0/3165461501 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa604084490 con 0x7fa6080b0c00 2023-10-06T11:05:59.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.612+0000 7fa60cbab700 1 --2- 172.21.15.146:0/3165461501 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa5ec066f30 0x7fa5ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:59.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.612+0000 7fa60cbab700 1 --2- 172.21.15.146:0/3165461501 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa5ec066f30 0x7fa5ec0693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8006fd0 tx=0x7fa5f8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:59.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.616+0000 7fa5fd7fa700 1 -- 172.21.15.146:0/3165461501 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa6040515a0 con 0x7fa6080b0c00 2023-10-06T11:05:59.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.841+0000 7fa60f610700 1 -- 172.21.15.146:0/3165461501 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6080c3380 con 0x7fa6080b0c00 2023-10-06T11:05:59.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.841+0000 7fa5fd7fa700 1 -- 172.21.15.146:0/3165461501 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4597 (secure 0 0 0) 0x7fa604054bc0 con 0x7fa6080b0c00 2023-10-06T11:05:59.843 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:05:59.843 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2812328960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2812328960},{"type":"v1","addr":"172.21.15.151:6835","nonce":2812328960}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/178026783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":178026783},{"type":"v1","addr":"172.21.15.146:6836","nonce":178026783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/716185126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":716185126},{"type":"v1","addr":"172.21.15.146:6837","nonce":716185126}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:05:43.740490+0000","modified":"2023-10-06T11:05:47.375805+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6833/1317728156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1317728156},{"type":"v1","addr":"172.21.15.151:6833","nonce":1317728156}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T11:05:59.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.843+0000 7fa60f610700 1 -- 172.21.15.146:0/3165461501 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa5ec066f30 msgr2=0x7fa5ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:59.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.843+0000 7fa60f610700 1 --2- 172.21.15.146:0/3165461501 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa5ec066f30 0x7fa5ec0693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8006fd0 tx=0x7fa5f8008040 comp rx=0 tx=0).stop 2023-10-06T11:05:59.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.843+0000 7fa60f610700 1 -- 172.21.15.146:0/3165461501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6080b0c00 msgr2=0x7fa6080c80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:59.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.843+0000 7fa60f610700 1 --2- 172.21.15.146:0/3165461501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6080b0c00 0x7fa6080c80d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa60400c5d0 tx=0x7fa604007f60 comp rx=0 tx=0).stop 2023-10-06T11:05:59.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.843+0000 7fa60f610700 1 -- 172.21.15.146:0/3165461501 shutdown_connections 2023-10-06T11:05:59.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.843+0000 7fa60f610700 1 --2- 172.21.15.146:0/3165461501 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa5ec066f30 0x7fa5ec0693e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:59.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.843+0000 7fa60f610700 1 --2- 172.21.15.146:0/3165461501 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6080ced80 0x7fa60816cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:59.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.843+0000 7fa60f610700 1 --2- 172.21.15.146:0/3165461501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa6080b0c00 0x7fa6080c80d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:59.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.843+0000 7fa60f610700 1 --2- 172.21.15.146:0/3165461501 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6080c3910 0x7fa608157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:59.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.843+0000 7fa60f610700 1 -- 172.21.15.146:0/3165461501 >> 172.21.15.146:0/3165461501 conn(0x7fa608067c50 msgr2=0x7fa608155490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:59.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.843+0000 7fa60f610700 1 -- 172.21.15.146:0/3165461501 shutdown_connections 2023-10-06T11:05:59.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.843+0000 7fa60f610700 1 -- 172.21.15.146:0/3165461501 wait complete. 2023-10-06T11:05:59.847 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 7 2023-10-06T11:05:59.858 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:05:59.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.970+0000 7f4ac0612700 1 Processor -- start 2023-10-06T11:05:59.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.970+0000 7f4ac0612700 1 -- start start 2023-10-06T11:05:59.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.971+0000 7f4ac0612700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4ab80ab010 0x7f4ab8157800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:59.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.971+0000 7f4ac0612700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ab80ccf20 con 0x7f4ab8157430 2023-10-06T11:05:59.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.971+0000 7f4ac0612700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ab80cd200 con 0x7f4ab80ca070 2023-10-06T11:05:59.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.971+0000 7f4ac0612700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ab80ca4f0 con 0x7f4ab80ab010 2023-10-06T11:05:59.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.971+0000 7f4abdbad700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4ab80ab010 0x7f4ab8157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:59.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.971+0000 7f4abe3ae700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4ab8157430 0x7f4ab80ceb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38840/0 (socket says 172.21.15.146:38840) 2023-10-06T11:05:59.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.972+0000 7f4abe3ae700 1 -- 172.21.15.146:0/3082431827 learned_addr learned my addr 172.21.15.146:0/3082431827 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:05:59.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.972+0000 7f4abdbad700 1 -- 172.21.15.146:0/3082431827 >> v1:172.21.15.151:6789/0 conn(0x7f4ab80ca070 legacy=0x7f4ab80cc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:05:59.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.972+0000 7f4abdbad700 1 -- 172.21.15.146:0/3082431827 >> v1:172.21.15.146:6789/0 conn(0x7f4ab8157430 legacy=0x7f4ab80ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:59.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.972+0000 7f4abdbad700 1 -- 172.21.15.146:0/3082431827 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab80cd4e0 con 0x7f4ab80ab010 2023-10-06T11:05:59.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.972+0000 7f4abd3ac700 1 -- 172.21.15.146:0/3082431827 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 986455231 0 0) 0x7f4ab80ccf20 con 0x7f4ab8157430 2023-10-06T11:05:59.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.972+0000 7f4abdbad700 1 --2- 172.21.15.146:0/3082431827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ab80ab010 0x7f4ab8157800 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4aac0098e0 tx=0x7f4aac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bae64ad1deffbd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:59.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.972+0000 7f4abd3ac700 1 -- 172.21.15.146:0/3082431827 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac009e80 con 0x7f4ab80ab010 2023-10-06T11:05:59.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.972+0000 7f4abd3ac700 1 -- 172.21.15.146:0/3082431827 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aac00b820 con 0x7f4ab80ab010 2023-10-06T11:05:59.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.972+0000 7f4abd3ac700 1 -- 172.21.15.146:0/3082431827 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac00bba0 con 0x7f4ab80ab010 2023-10-06T11:05:59.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.973+0000 7f4ac0612700 1 -- 172.21.15.146:0/3082431827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ab80ab010 msgr2=0x7f4ab8157800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:59.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.973+0000 7f4ac0612700 1 --2- 172.21.15.146:0/3082431827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ab80ab010 0x7f4ab8157800 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4aac0098e0 tx=0x7f4aac0091a0 comp rx=0 tx=0).stop 2023-10-06T11:05:59.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.973+0000 7f4ac0612700 1 -- 172.21.15.146:0/3082431827 shutdown_connections 2023-10-06T11:05:59.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.973+0000 7f4ac0612700 1 --2- 172.21.15.146:0/3082431827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ab80ab010 0x7f4ab8157800 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:59.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.973+0000 7f4ac0612700 1 -- 172.21.15.146:0/3082431827 >> 172.21.15.146:0/3082431827 conn(0x7f4ab8067c50 msgr2=0x7f4ab80ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:05:59.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.973+0000 7f4ac0612700 1 -- 172.21.15.146:0/3082431827 shutdown_connections 2023-10-06T11:05:59.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.973+0000 7f4ac0612700 1 -- 172.21.15.146:0/3082431827 wait complete. 2023-10-06T11:05:59.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.974+0000 7f4ac0612700 1 Processor -- start 2023-10-06T11:05:59.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.974+0000 7f4ac0612700 1 -- start start 2023-10-06T11:05:59.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.974+0000 7f4ac0612700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ab80ab010 0x7f4ab80aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:59.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.974+0000 7f4ac0612700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ab80ca070 0x7f4ab81533f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:59.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.974+0000 7f4ac0612700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ab8157430 0x7f4ab80b2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:59.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.974+0000 7f4ac0612700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab80b0030 con 0x7f4ab8157430 2023-10-06T11:05:59.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.974+0000 7f4ac0612700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab80b04c0 con 0x7f4ab80ca070 2023-10-06T11:05:59.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.974+0000 7f4ac0612700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ab80af420 con 0x7f4ab80ab010 2023-10-06T11:05:59.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.975+0000 7f4abebaf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ab8157430 0x7f4ab80b2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:59.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.975+0000 7f4abebaf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ab8157430 0x7f4ab80b2b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40192/0 (socket says 172.21.15.146:40192) 2023-10-06T11:05:59.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.975+0000 7f4abebaf700 1 -- 172.21.15.146:0/3114882276 learned_addr learned my addr 172.21.15.146:0/3114882276 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:05:59.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.975+0000 7f4abebaf700 1 -- 172.21.15.146:0/3114882276 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ab80ab010 msgr2=0x7f4ab80aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:59.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.975+0000 7f4abebaf700 1 --2- 172.21.15.146:0/3114882276 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ab80ab010 0x7f4ab80aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:59.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.975+0000 7f4abebaf700 1 -- 172.21.15.146:0/3114882276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ab80ca070 msgr2=0x7f4ab81533f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:05:59.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.975+0000 7f4abdbad700 1 --2- 172.21.15.146:0/3114882276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ab80ca070 0x7f4ab81533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:59.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.975+0000 7f4abebaf700 1 --2- 172.21.15.146:0/3114882276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ab80ca070 0x7f4ab81533f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:05:59.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.975+0000 7f4abebaf700 1 -- 172.21.15.146:0/3114882276 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aac009420 con 0x7f4ab8157430 2023-10-06T11:05:59.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.975+0000 7f4abebaf700 1 --2- 172.21.15.146:0/3114882276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ab8157430 0x7f4ab80b2b90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4ab000c5b0 tx=0x7f4ab0007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:59.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.975+0000 7f4ab67fc700 1 -- 172.21.15.146:0/3114882276 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab0011590 con 0x7f4ab8157430 2023-10-06T11:05:59.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.975+0000 7f4ab67fc700 1 -- 172.21.15.146:0/3114882276 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab0011710 con 0x7f4ab8157430 2023-10-06T11:05:59.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.975+0000 7f4ac0612700 1 -- 172.21.15.146:0/3114882276 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ab80af700 con 0x7f4ab8157430 2023-10-06T11:05:59.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.975+0000 7f4ab67fc700 1 -- 172.21.15.146:0/3114882276 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab0011ad0 con 0x7f4ab8157430 2023-10-06T11:05:59.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.975+0000 7f4ac0612700 1 -- 172.21.15.146:0/3114882276 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ab80afcc0 con 0x7f4ab8157430 2023-10-06T11:05:59.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.976+0000 7f4ac0612700 1 -- 172.21.15.146:0/3114882276 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ab804c380 con 0x7f4ab8157430 2023-10-06T11:05:59.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.976+0000 7f4ab67fc700 1 -- 172.21.15.146:0/3114882276 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4ab001c460 con 0x7f4ab8157430 2023-10-06T11:05:59.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.977+0000 7f4ab67fc700 1 --2- 172.21.15.146:0/3114882276 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4aa4066f30 0x7f4aa40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:05:59.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.977+0000 7f4ab67fc700 1 -- 172.21.15.146:0/3114882276 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4ab00843d0 con 0x7f4ab8157430 2023-10-06T11:05:59.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.977+0000 7f4abe3ae700 1 --2- 172.21.15.146:0/3114882276 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4aa4066f30 0x7f4aa40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:05:59.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.977+0000 7f4abe3ae700 1 --2- 172.21.15.146:0/3114882276 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4aa4066f30 0x7f4aa40693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8002090 tx=0x7f4aa80015f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:05:59.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:05:59.981+0000 7f4ab67fc700 1 -- 172.21.15.146:0/3114882276 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ab00514e0 con 0x7f4ab8157430 2023-10-06T11:06:00.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.165+0000 7f4ac0612700 1 -- 172.21.15.146:0/3114882276 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ab80b0170 con 0x7f4ab8157430 2023-10-06T11:06:00.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.166+0000 7f4ab67fc700 1 -- 172.21.15.146:0/3114882276 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16914 (secure 0 0 0) 0x7f4ab0054b00 con 0x7f4ab8157430 2023-10-06T11:06:00.167 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:06:00.167 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":20,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:05:45.362089+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:05:41.403954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T11:05:42.698754+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:06:00.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.168+0000 7f4ac0612700 1 -- 172.21.15.146:0/3114882276 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4aa4066f30 msgr2=0x7f4aa40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:00.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.168+0000 7f4ac0612700 1 --2- 172.21.15.146:0/3114882276 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4aa4066f30 0x7f4aa40693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4aa8002090 tx=0x7f4aa80015f0 comp rx=0 tx=0).stop 2023-10-06T11:06:00.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.168+0000 7f4ac0612700 1 -- 172.21.15.146:0/3114882276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ab8157430 msgr2=0x7f4ab80b2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:00.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.168+0000 7f4ac0612700 1 --2- 172.21.15.146:0/3114882276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ab8157430 0x7f4ab80b2b90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4ab000c5b0 tx=0x7f4ab0007f60 comp rx=0 tx=0).stop 2023-10-06T11:06:00.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.168+0000 7f4ac0612700 1 -- 172.21.15.146:0/3114882276 shutdown_connections 2023-10-06T11:06:00.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.168+0000 7f4ac0612700 1 --2- 172.21.15.146:0/3114882276 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4aa4066f30 0x7f4aa40693e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:00.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.168+0000 7f4ac0612700 1 --2- 172.21.15.146:0/3114882276 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ab8157430 0x7f4ab80b2b90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:00.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.168+0000 7f4ac0612700 1 --2- 172.21.15.146:0/3114882276 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ab80ab010 0x7f4ab80aedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:00.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.168+0000 7f4ac0612700 1 --2- 172.21.15.146:0/3114882276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ab80ca070 0x7f4ab81533f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:00.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.168+0000 7f4ac0612700 1 -- 172.21.15.146:0/3114882276 >> 172.21.15.146:0/3114882276 conn(0x7f4ab8067c50 msgr2=0x7f4ab80cb0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:00.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.168+0000 7f4ac0612700 1 -- 172.21.15.146:0/3114882276 shutdown_connections 2023-10-06T11:06:00.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.168+0000 7f4ac0612700 1 -- 172.21.15.146:0/3114882276 wait complete. 2023-10-06T11:06:00.182 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:05:36.687307+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:05:37.171199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T11:05:41.403954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T11:05:42.698754+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T11:06:00.182 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:06:00.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.298+0000 7f5ae91a2700 1 Processor -- start 2023-10-06T11:06:00.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.298+0000 7f5ae91a2700 1 -- start start 2023-10-06T11:06:00.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.299+0000 7f5ae91a2700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5ae40c89b0 0x7f5ae40c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:00.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.299+0000 7f5ae91a2700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ae40c20c0 con 0x7f5ae40c9340 2023-10-06T11:06:00.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.299+0000 7f5ae91a2700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ae40c9890 con 0x7f5ae41577a0 2023-10-06T11:06:00.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.299+0000 7f5ae91a2700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae40c9b70 con 0x7f5ae40c89b0 2023-10-06T11:06:00.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.299+0000 7f5ae359e700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f5ae40c9340 0x7f5ae40c2550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38854/0 (socket says 172.21.15.146:38854) 2023-10-06T11:06:00.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.299+0000 7f5ae359e700 1 -- 172.21.15.146:0/3559225483 learned_addr learned my addr 172.21.15.146:0/3559225483 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:00.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.299+0000 7f5ae1d9b700 1 -- 172.21.15.146:0/3559225483 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 529473790 0 0) 0x7f5ae40c20c0 con 0x7f5ae40c9340 2023-10-06T11:06:00.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.299+0000 7f5ae1d9b700 1 -- 172.21.15.146:0/3559225483 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5acc003570 con 0x7f5ae40c9340 2023-10-06T11:06:00.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.299+0000 7f5ae259c700 1 --2- 172.21.15.146:0/3559225483 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5ae40c89b0 0x7f5ae40c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:00.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.299+0000 7f5ae1d9b700 1 -- 172.21.15.146:0/3559225483 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2412567282 0 0) 0x7f5acc003570 con 0x7f5ae40c9340 2023-10-06T11:06:00.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.299+0000 7f5ae1d9b700 1 -- 172.21.15.146:0/3559225483 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5ae40c89b0 msgr2=0x7f5ae40c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:00.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.299+0000 7f5ae1d9b700 1 --2- 172.21.15.146:0/3559225483 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5ae40c89b0 0x7f5ae40c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:00.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.299+0000 7f5ae1d9b700 1 -- 172.21.15.146:0/3559225483 >> v1:172.21.15.151:6789/0 conn(0x7f5ae41577a0 legacy=0x7f5ae40ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:00.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.299+0000 7f5ae1d9b700 1 -- 172.21.15.146:0/3559225483 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae40c9e50 con 0x7f5ae40c9340 2023-10-06T11:06:00.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.299+0000 7f5ae1d9b700 1 -- 172.21.15.146:0/3559225483 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f5adc0017f0 con 0x7f5ae40c9340 2023-10-06T11:06:00.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.299+0000 7f5ae1d9b700 1 -- 172.21.15.146:0/3559225483 >> v1:172.21.15.146:6789/0 conn(0x7f5ae40c9340 legacy=0x7f5ae40c2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:00.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.299+0000 7f5ae1d9b700 1 --2- 172.21.15.146:0/3559225483 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5ae40c89b0 0x7f5acc003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:00.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.299+0000 7f5ae1d9b700 1 --2- 172.21.15.146:0/3559225483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5acc004010 0x7f5acc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:00.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.299+0000 7f5ae1d9b700 1 --2- 172.21.15.146:0/3559225483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5acc004d50 0x7f5acc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:00.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.299+0000 7f5ae1d9b700 1 -- 172.21.15.146:0/3559225483 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae40c9b70 con 0x7f5acc004d50 2023-10-06T11:06:00.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.299+0000 7f5ae1d9b700 1 -- 172.21.15.146:0/3559225483 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5acc00bbf0 con 0x7f5acc004010 2023-10-06T11:06:00.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.299+0000 7f5ae1d9b700 1 -- 172.21.15.146:0/3559225483 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5acc00bdb0 con 0x7f5ae40c89b0 2023-10-06T11:06:00.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.299+0000 7f5ae359e700 1 --2- 172.21.15.146:0/3559225483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5acc004d50 0x7f5acc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:00.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.299+0000 7f5ae259c700 1 --2- 172.21.15.146:0/3559225483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5acc004010 0x7f5acc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:00.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.299+0000 7f5ae2d9d700 1 --2- 172.21.15.146:0/3559225483 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5ae40c89b0 0x7f5acc003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:00.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.300+0000 7f5ae359e700 1 -- 172.21.15.146:0/3559225483 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5ae40c89b0 msgr2=0x7f5acc003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:00.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.300+0000 7f5ae359e700 1 --2- 172.21.15.146:0/3559225483 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5ae40c89b0 0x7f5acc003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:00.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.300+0000 7f5ae359e700 1 -- 172.21.15.146:0/3559225483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5acc004010 msgr2=0x7f5acc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:00.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.300+0000 7f5ae359e700 1 --2- 172.21.15.146:0/3559225483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5acc004010 0x7f5acc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:00.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.300+0000 7f5ae359e700 1 -- 172.21.15.146:0/3559225483 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5acc003570 con 0x7f5acc004d50 2023-10-06T11:06:00.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.300+0000 7f5ae359e700 1 --2- 172.21.15.146:0/3559225483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5acc004d50 0x7f5acc0051c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5ae40c97c0 tx=0x7f5adc0021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26128e74004333e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:00.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.300+0000 7f5ae1d9b700 1 -- 172.21.15.146:0/3559225483 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5adc0070d0 con 0x7f5acc004d50 2023-10-06T11:06:00.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.300+0000 7f5ae1d9b700 1 -- 172.21.15.146:0/3559225483 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5adc007230 con 0x7f5acc004d50 2023-10-06T11:06:00.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.300+0000 7f5ae1d9b700 1 -- 172.21.15.146:0/3559225483 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5adc0075f0 con 0x7f5acc004d50 2023-10-06T11:06:00.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.300+0000 7f5ae91a2700 1 -- 172.21.15.146:0/3559225483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5acc004d50 msgr2=0x7f5acc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:00.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.300+0000 7f5ae91a2700 1 --2- 172.21.15.146:0/3559225483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5acc004d50 0x7f5acc0051c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5ae40c97c0 tx=0x7f5adc0021d0 comp rx=0 tx=0).stop 2023-10-06T11:06:00.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.300+0000 7f5ae359e700 1 -- 172.21.15.146:0/3559225483 reap_dead start 2023-10-06T11:06:00.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.301+0000 7f5ae91a2700 1 -- 172.21.15.146:0/3559225483 shutdown_connections 2023-10-06T11:06:00.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.301+0000 7f5ae91a2700 1 -- 172.21.15.146:0/3559225483 >> 172.21.15.146:0/3559225483 conn(0x7f5ae4067c50 msgr2=0x7f5ae40ce410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:00.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.301+0000 7f5ae91a2700 1 -- 172.21.15.146:0/3559225483 shutdown_connections 2023-10-06T11:06:00.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.301+0000 7f5ae91a2700 1 -- 172.21.15.146:0/3559225483 wait complete. 2023-10-06T11:06:00.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.302+0000 7f5ae91a2700 1 Processor -- start 2023-10-06T11:06:00.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.302+0000 7f5ae91a2700 1 -- start start 2023-10-06T11:06:00.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.302+0000 7f5ae91a2700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5ae414fae0 0x7f5ae40c79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:00.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.302+0000 7f5ae91a2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ae41500a0 0x7f5ae406bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:00.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.302+0000 7f5ae91a2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ae406c1b0 0x7f5ae40c5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:00.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.302+0000 7f5ae91a2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae4151120 con 0x7f5ae406c1b0 2023-10-06T11:06:00.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.302+0000 7f5ae91a2700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae4153910 con 0x7f5ae41500a0 2023-10-06T11:06:00.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.302+0000 7f5ae91a2700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae406c620 con 0x7f5ae414fae0 2023-10-06T11:06:00.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.303+0000 7f5ae359e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ae406c1b0 0x7f5ae40c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:00.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.303+0000 7f5ae359e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ae406c1b0 0x7f5ae40c5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40208/0 (socket says 172.21.15.146:40208) 2023-10-06T11:06:00.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.303+0000 7f5ae359e700 1 -- 172.21.15.146:0/95485832 learned_addr learned my addr 172.21.15.146:0/95485832 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:00.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.303+0000 7f5ae259c700 1 --2- 172.21.15.146:0/95485832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ae41500a0 0x7f5ae406bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:00.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.303+0000 7f5ae2d9d700 1 --2- 172.21.15.146:0/95485832 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5ae414fae0 0x7f5ae40c79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:00.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.303+0000 7f5ae359e700 1 -- 172.21.15.146:0/95485832 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5ae414fae0 msgr2=0x7f5ae40c79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:00.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.303+0000 7f5ae359e700 1 --2- 172.21.15.146:0/95485832 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5ae414fae0 0x7f5ae40c79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:00.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.303+0000 7f5ae359e700 1 -- 172.21.15.146:0/95485832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ae41500a0 msgr2=0x7f5ae406bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:00.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.303+0000 7f5ae359e700 1 --2- 172.21.15.146:0/95485832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ae41500a0 0x7f5ae406bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:00.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.303+0000 7f5ae359e700 1 -- 172.21.15.146:0/95485832 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae4153bd0 con 0x7f5ae406c1b0 2023-10-06T11:06:00.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.303+0000 7f5ae359e700 1 --2- 172.21.15.146:0/95485832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ae406c1b0 0x7f5ae40c5420 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5adc012000 tx=0x7f5adc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:00.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.303+0000 7f5acaffd700 1 -- 172.21.15.146:0/95485832 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5adc0070d0 con 0x7f5ae406c1b0 2023-10-06T11:06:00.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.303+0000 7f5acaffd700 1 -- 172.21.15.146:0/95485832 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5adc0011c0 con 0x7f5ae406c1b0 2023-10-06T11:06:00.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.303+0000 7f5ae91a2700 1 -- 172.21.15.146:0/95485832 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ae414feb0 con 0x7f5ae406c1b0 2023-10-06T11:06:00.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.303+0000 7f5acaffd700 1 -- 172.21.15.146:0/95485832 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5adc007960 con 0x7f5ae406c1b0 2023-10-06T11:06:00.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.303+0000 7f5ae91a2700 1 -- 172.21.15.146:0/95485832 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ae4150b60 con 0x7f5ae406c1b0 2023-10-06T11:06:00.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.304+0000 7f5ae91a2700 1 -- 172.21.15.146:0/95485832 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ae4153d60 con 0x7f5ae406c1b0 2023-10-06T11:06:00.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.304+0000 7f5acaffd700 1 -- 172.21.15.146:0/95485832 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5adc029460 con 0x7f5ae406c1b0 2023-10-06T11:06:00.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.305+0000 7f5acaffd700 1 --2- 172.21.15.146:0/95485832 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5ad0066f30 0x7f5ad00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:00.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.305+0000 7f5acaffd700 1 -- 172.21.15.146:0/95485832 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5adc086b00 con 0x7f5ae406c1b0 2023-10-06T11:06:00.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.305+0000 7f5ae2d9d700 1 --2- 172.21.15.146:0/95485832 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5ad0066f30 0x7f5ad00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:00.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.305+0000 7f5ae2d9d700 1 --2- 172.21.15.146:0/95485832 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5ad0066f30 0x7f5ad00693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4000ef0 tx=0x7f5ad4007d80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:00.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.309+0000 7f5acaffd700 1 -- 172.21.15.146:0/95485832 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5adc053c10 con 0x7f5ae406c1b0 2023-10-06T11:06:00.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.497+0000 7f5ae91a2700 1 -- 172.21.15.146:0/95485832 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5ae404c380 con 0x7f5ae406c1b0 2023-10-06T11:06:00.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.497+0000 7f5acaffd700 1 -- 172.21.15.146:0/95485832 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5adc0075b0 con 0x7f5ae406c1b0 2023-10-06T11:06:00.499 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-10-06T11:06:00.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.499+0000 7f5ae91a2700 1 -- 172.21.15.146:0/95485832 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5ad0066f30 msgr2=0x7f5ad00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:00.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.499+0000 7f5ae91a2700 1 --2- 172.21.15.146:0/95485832 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5ad0066f30 0x7f5ad00693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4000ef0 tx=0x7f5ad4007d80 comp rx=0 tx=0).stop 2023-10-06T11:06:00.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.499+0000 7f5ae91a2700 1 -- 172.21.15.146:0/95485832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ae406c1b0 msgr2=0x7f5ae40c5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:00.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.499+0000 7f5ae91a2700 1 --2- 172.21.15.146:0/95485832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ae406c1b0 0x7f5ae40c5420 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5adc012000 tx=0x7f5adc016000 comp rx=0 tx=0).stop 2023-10-06T11:06:00.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.499+0000 7f5ae91a2700 1 -- 172.21.15.146:0/95485832 shutdown_connections 2023-10-06T11:06:00.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.499+0000 7f5ae91a2700 1 --2- 172.21.15.146:0/95485832 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5ad0066f30 0x7f5ad00693e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:00.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.499+0000 7f5ae91a2700 1 --2- 172.21.15.146:0/95485832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5ae406c1b0 0x7f5ae40c5420 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:00.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.499+0000 7f5ae91a2700 1 --2- 172.21.15.146:0/95485832 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5ae414fae0 0x7f5ae40c79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:00.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.499+0000 7f5ae91a2700 1 --2- 172.21.15.146:0/95485832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ae41500a0 0x7f5ae406bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:00.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.499+0000 7f5ae91a2700 1 -- 172.21.15.146:0/95485832 >> 172.21.15.146:0/95485832 conn(0x7f5ae4067c50 msgr2=0x7f5ae40c46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:00.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.499+0000 7f5ae91a2700 1 -- 172.21.15.146:0/95485832 shutdown_connections 2023-10-06T11:06:00.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.499+0000 7f5ae91a2700 1 -- 172.21.15.146:0/95485832 wait complete. 2023-10-06T11:06:00.513 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:06:00.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.628+0000 7f8a5f59e700 1 Processor -- start 2023-10-06T11:06:00.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.628+0000 7f8a5f59e700 1 -- start start 2023-10-06T11:06:00.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.629+0000 7f8a5f59e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8a600b5640 0x7f8a6015a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:00.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.629+0000 7f8a5f59e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8a600cb090 0x7f8a600cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:00.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.629+0000 7f8a5f59e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a600cc130 con 0x7f8a60068780 2023-10-06T11:06:00.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.629+0000 7f8a5f59e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a600b2660 con 0x7f8a600b5640 2023-10-06T11:06:00.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.629+0000 7f8a5f59e700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a6015adb0 con 0x7f8a600cb090 2023-10-06T11:06:00.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.629+0000 7f8a5e59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8a600b5640 0x7f8a6015a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:00.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.629+0000 7f8a5ed9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8a60068780 0x7f8a6015b010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38868/0 (socket says 172.21.15.146:38868) 2023-10-06T11:06:00.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.629+0000 7f8a5e59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8a600b5640 0x7f8a6015a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40210/0 (socket says 172.21.15.146:40210) 2023-10-06T11:06:00.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.629+0000 7f8a5ed9d700 1 -- 172.21.15.146:0/3394917124 learned_addr learned my addr 172.21.15.146:0/3394917124 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:00.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.629+0000 7f8a5dd9b700 1 --2- 172.21.15.146:0/3394917124 >> v2:172.21.15.151:3300/0 conn(0x7f8a600cb090 0x7f8a600cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:00.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.629+0000 7f8a5e59c700 1 -- 172.21.15.146:0/3394917124 >> v2:172.21.15.151:3300/0 conn(0x7f8a600cb090 msgr2=0x7f8a600cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:00.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.629+0000 7f8a5e59c700 1 --2- 172.21.15.146:0/3394917124 >> v2:172.21.15.151:3300/0 conn(0x7f8a600cb090 0x7f8a600cc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:00.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.629+0000 7f8a5e59c700 1 -- 172.21.15.146:0/3394917124 >> v1:172.21.15.146:6789/0 conn(0x7f8a60068780 legacy=0x7f8a6015b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:00.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.629+0000 7f8a5d59a700 1 -- 172.21.15.146:0/3394917124 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3744218637 0 0) 0x7f8a600cc130 con 0x7f8a60068780 2023-10-06T11:06:00.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.629+0000 7f8a5e59c700 1 -- 172.21.15.146:0/3394917124 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a600cb520 con 0x7f8a600b5640 2023-10-06T11:06:00.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.629+0000 7f8a5dd9b700 1 --2- 172.21.15.146:0/3394917124 >> v2:172.21.15.151:3300/0 conn(0x7f8a600cb090 0x7f8a600cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:06:00.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.629+0000 7f8a5e59c700 1 --2- 172.21.15.146:0/3394917124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a600b5640 0x7f8a6015a870 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8a60159e40 tx=0x7f8a500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c647b23e80f2dd71 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:00.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.629+0000 7f8a5d59a700 1 -- 172.21.15.146:0/3394917124 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5000b6b0 con 0x7f8a600b5640 2023-10-06T11:06:00.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.630+0000 7f8a5d59a700 1 -- 172.21.15.146:0/3394917124 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a5000b810 con 0x7f8a600b5640 2023-10-06T11:06:00.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.630+0000 7f8a5d59a700 1 -- 172.21.15.146:0/3394917124 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5000bbb0 con 0x7f8a600b5640 2023-10-06T11:06:00.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.630+0000 7f8a5f59e700 1 -- 172.21.15.146:0/3394917124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a600b5640 msgr2=0x7f8a6015a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:00.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.630+0000 7f8a5f59e700 1 --2- 172.21.15.146:0/3394917124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a600b5640 0x7f8a6015a870 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8a60159e40 tx=0x7f8a500091a0 comp rx=0 tx=0).stop 2023-10-06T11:06:00.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.630+0000 7f8a5f59e700 1 -- 172.21.15.146:0/3394917124 shutdown_connections 2023-10-06T11:06:00.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.630+0000 7f8a5f59e700 1 --2- 172.21.15.146:0/3394917124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a600b5640 0x7f8a6015a870 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:00.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.630+0000 7f8a5f59e700 1 --2- 172.21.15.146:0/3394917124 >> v2:172.21.15.151:3300/0 conn(0x7f8a600cb090 0x7f8a600cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:00.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.630+0000 7f8a5f59e700 1 -- 172.21.15.146:0/3394917124 >> 172.21.15.146:0/3394917124 conn(0x7f8a600703f0 msgr2=0x7f8a600707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:00.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.630+0000 7f8a5f59e700 1 -- 172.21.15.146:0/3394917124 shutdown_connections 2023-10-06T11:06:00.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.630+0000 7f8a5f59e700 1 -- 172.21.15.146:0/3394917124 wait complete. 2023-10-06T11:06:00.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.631+0000 7f8a5f59e700 1 Processor -- start 2023-10-06T11:06:00.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.631+0000 7f8a5f59e700 1 -- start start 2023-10-06T11:06:00.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.632+0000 7f8a5f59e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a60068780 0x7f8a600c57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:00.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.632+0000 7f8a5f59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a600b5640 0x7f8a600c7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:00.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.632+0000 7f8a5f59e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a600cb090 0x7f8a601699e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:00.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.632+0000 7f8a5f59e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a600c8890 con 0x7f8a600b5640 2023-10-06T11:06:00.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.632+0000 7f8a5f59e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a600c79b0 con 0x7f8a600cb090 2023-10-06T11:06:00.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.632+0000 7f8a5f59e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a600c7c80 con 0x7f8a60068780 2023-10-06T11:06:00.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.632+0000 7f8a5dd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a600b5640 0x7f8a600c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:00.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.632+0000 7f8a5dd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a600b5640 0x7f8a600c7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40212/0 (socket says 172.21.15.146:40212) 2023-10-06T11:06:00.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.632+0000 7f8a5dd9b700 1 -- 172.21.15.146:0/2658996439 learned_addr learned my addr 172.21.15.146:0/2658996439 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:00.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.632+0000 7f8a5ed9d700 1 --2- 172.21.15.146:0/2658996439 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a600cb090 0x7f8a601699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:00.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.632+0000 7f8a5e59c700 1 --2- 172.21.15.146:0/2658996439 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a60068780 0x7f8a600c57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:00.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.632+0000 7f8a5dd9b700 1 -- 172.21.15.146:0/2658996439 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a60068780 msgr2=0x7f8a600c57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:00.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.632+0000 7f8a5dd9b700 1 --2- 172.21.15.146:0/2658996439 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a60068780 0x7f8a600c57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:00.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.632+0000 7f8a5dd9b700 1 -- 172.21.15.146:0/2658996439 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a600cb090 msgr2=0x7f8a601699e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:00.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.632+0000 7f8a5dd9b700 1 --2- 172.21.15.146:0/2658996439 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a600cb090 0x7f8a601699e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:00.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.632+0000 7f8a5dd9b700 1 -- 172.21.15.146:0/2658996439 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a50009420 con 0x7f8a600b5640 2023-10-06T11:06:00.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.632+0000 7f8a5dd9b700 1 --2- 172.21.15.146:0/2658996439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a600b5640 0x7f8a600c7470 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8a5400e8f0 tx=0x7f8a54008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:00.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.633+0000 7f8a4e7fc700 1 -- 172.21.15.146:0/2658996439 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5400ee90 con 0x7f8a600b5640 2023-10-06T11:06:00.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.633+0000 7f8a4e7fc700 1 -- 172.21.15.146:0/2658996439 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a5400c5e0 con 0x7f8a600b5640 2023-10-06T11:06:00.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.633+0000 7f8a4e7fc700 1 -- 172.21.15.146:0/2658996439 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5400c9a0 con 0x7f8a600b5640 2023-10-06T11:06:00.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.633+0000 7f8a5f59e700 1 -- 172.21.15.146:0/2658996439 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a600c7f60 con 0x7f8a600b5640 2023-10-06T11:06:00.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.633+0000 7f8a5f59e700 1 -- 172.21.15.146:0/2658996439 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a600c8520 con 0x7f8a600b5640 2023-10-06T11:06:00.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.633+0000 7f8a5f59e700 1 -- 172.21.15.146:0/2658996439 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a600c8a40 con 0x7f8a600b5640 2023-10-06T11:06:00.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.634+0000 7f8a4e7fc700 1 -- 172.21.15.146:0/2658996439 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8a5400cd10 con 0x7f8a600b5640 2023-10-06T11:06:00.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.634+0000 7f8a4e7fc700 1 --2- 172.21.15.146:0/2658996439 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8a40066f30 0x7f8a400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:00.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.634+0000 7f8a4e7fc700 1 -- 172.21.15.146:0/2658996439 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8a540845e0 con 0x7f8a600b5640 2023-10-06T11:06:00.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.634+0000 7f8a5e59c700 1 --2- 172.21.15.146:0/2658996439 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8a40066f30 0x7f8a400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:00.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.635+0000 7f8a5e59c700 1 --2- 172.21.15.146:0/2658996439 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8a40066f30 0x7f8a400693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8a500093f0 tx=0x7f8a50017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:00.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.638+0000 7f8a4e7fc700 1 -- 172.21.15.146:0/2658996439 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8a600c8a40 con 0x7f8a600b5640 2023-10-06T11:06:00.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.818+0000 7f8a5f59e700 1 -- 172.21.15.146:0/2658996439 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8a600c89d0 con 0x7f8a600b5640 2023-10-06T11:06:00.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.819+0000 7f8a4e7fc700 1 -- 172.21.15.146:0/2658996439 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8a540550e0 con 0x7f8a600b5640 2023-10-06T11:06:00.820 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-10-06T11:06:00.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.820+0000 7f8a5f59e700 1 -- 172.21.15.146:0/2658996439 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8a40066f30 msgr2=0x7f8a400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:00.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.820+0000 7f8a5f59e700 1 --2- 172.21.15.146:0/2658996439 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8a40066f30 0x7f8a400693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8a500093f0 tx=0x7f8a50017000 comp rx=0 tx=0).stop 2023-10-06T11:06:00.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.820+0000 7f8a5f59e700 1 -- 172.21.15.146:0/2658996439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a600b5640 msgr2=0x7f8a600c7470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:00.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.820+0000 7f8a5f59e700 1 --2- 172.21.15.146:0/2658996439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a600b5640 0x7f8a600c7470 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8a5400e8f0 tx=0x7f8a54008040 comp rx=0 tx=0).stop 2023-10-06T11:06:00.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.820+0000 7f8a5f59e700 1 -- 172.21.15.146:0/2658996439 shutdown_connections 2023-10-06T11:06:00.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.820+0000 7f8a5f59e700 1 --2- 172.21.15.146:0/2658996439 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8a40066f30 0x7f8a400693e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:00.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.820+0000 7f8a5f59e700 1 --2- 172.21.15.146:0/2658996439 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a600cb090 0x7f8a601699e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:00.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.820+0000 7f8a5f59e700 1 --2- 172.21.15.146:0/2658996439 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a60068780 0x7f8a600c57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:00.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.820+0000 7f8a5f59e700 1 --2- 172.21.15.146:0/2658996439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a600b5640 0x7f8a600c7470 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:00.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.820+0000 7f8a5f59e700 1 -- 172.21.15.146:0/2658996439 >> 172.21.15.146:0/2658996439 conn(0x7f8a600703f0 msgr2=0x7f8a6015eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:00.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.821+0000 7f8a5f59e700 1 -- 172.21.15.146:0/2658996439 shutdown_connections 2023-10-06T11:06:00.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.821+0000 7f8a5f59e700 1 -- 172.21.15.146:0/2658996439 wait complete. 2023-10-06T11:06:00.834 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T11:06:00.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.950+0000 7f0d41fe6700 1 Processor -- start 2023-10-06T11:06:00.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.950+0000 7f0d41fe6700 1 -- start start 2023-10-06T11:06:00.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.951+0000 7f0d41fe6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d3c0cc960 0x7f0d3c164c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:00.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.951+0000 7f0d41fe6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d3c0ae2a0 con 0x7f0d3c0ae730 2023-10-06T11:06:00.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.951+0000 7f0d41fe6700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d3c15a530 con 0x7f0d3c15a160 2023-10-06T11:06:00.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.951+0000 7f0d41fe6700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3c0ccdc0 con 0x7f0d3c0cc960 2023-10-06T11:06:00.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.951+0000 7f0d3affd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0d3c0ae730 0x7f0d3c0aebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38876/0 (socket says 172.21.15.146:38876) 2023-10-06T11:06:00.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.951+0000 7f0d3affd700 1 -- 172.21.15.146:0/3758396714 learned_addr learned my addr 172.21.15.146:0/3758396714 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:00.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.951+0000 7f0d3bfff700 1 --2- 172.21.15.146:0/3758396714 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d3c0cc960 0x7f0d3c164c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:00.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.951+0000 7f0d3a7fc700 1 -- 172.21.15.146:0/3758396714 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4202898018 0 0) 0x7f0d3c0ae2a0 con 0x7f0d3c0ae730 2023-10-06T11:06:00.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.951+0000 7f0d3a7fc700 1 -- 172.21.15.146:0/3758396714 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d24003570 con 0x7f0d3c0ae730 2023-10-06T11:06:00.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.952+0000 7f0d3a7fc700 1 -- 172.21.15.146:0/3758396714 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 198282495 0 0) 0x7f0d24003570 con 0x7f0d3c0ae730 2023-10-06T11:06:00.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.952+0000 7f0d3a7fc700 1 -- 172.21.15.146:0/3758396714 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d3c0cc960 msgr2=0x7f0d3c164c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:00.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.952+0000 7f0d3a7fc700 1 --2- 172.21.15.146:0/3758396714 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d3c0cc960 0x7f0d3c164c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:00.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.952+0000 7f0d3a7fc700 1 -- 172.21.15.146:0/3758396714 >> v1:172.21.15.151:6789/0 conn(0x7f0d3c15a160 legacy=0x7f0d3c0c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:00.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.952+0000 7f0d3a7fc700 1 -- 172.21.15.146:0/3758396714 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d3c0c5cb0 con 0x7f0d3c0ae730 2023-10-06T11:06:00.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.952+0000 7f0d3a7fc700 1 -- 172.21.15.146:0/3758396714 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f0d30001470 con 0x7f0d3c0ae730 2023-10-06T11:06:00.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.952+0000 7f0d3a7fc700 1 -- 172.21.15.146:0/3758396714 >> v1:172.21.15.146:6789/0 conn(0x7f0d3c0ae730 legacy=0x7f0d3c0aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:00.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.952+0000 7f0d3a7fc700 1 --2- 172.21.15.146:0/3758396714 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d3c0cc960 0x7f0d24003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:00.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.952+0000 7f0d3a7fc700 1 --2- 172.21.15.146:0/3758396714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d24004010 0x7f0d24004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:00.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.952+0000 7f0d3a7fc700 1 --2- 172.21.15.146:0/3758396714 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d24004d50 0x7f0d240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:00.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.952+0000 7f0d3a7fc700 1 -- 172.21.15.146:0/3758396714 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3c0ccdc0 con 0x7f0d24004010 2023-10-06T11:06:00.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.952+0000 7f0d3a7fc700 1 -- 172.21.15.146:0/3758396714 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2400bbf0 con 0x7f0d24004d50 2023-10-06T11:06:00.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.952+0000 7f0d3a7fc700 1 -- 172.21.15.146:0/3758396714 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2400bdb0 con 0x7f0d3c0cc960 2023-10-06T11:06:00.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.952+0000 7f0d3affd700 1 --2- 172.21.15.146:0/3758396714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d24004010 0x7f0d24004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:00.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.952+0000 7f0d3b7fe700 1 --2- 172.21.15.146:0/3758396714 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d3c0cc960 0x7f0d24003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:00.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.952+0000 7f0d3bfff700 1 --2- 172.21.15.146:0/3758396714 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d24004d50 0x7f0d240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:00.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.952+0000 7f0d3affd700 1 -- 172.21.15.146:0/3758396714 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d3c0cc960 msgr2=0x7f0d24003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:00.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.952+0000 7f0d3affd700 1 --2- 172.21.15.146:0/3758396714 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d3c0cc960 0x7f0d24003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:00.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.952+0000 7f0d3affd700 1 -- 172.21.15.146:0/3758396714 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d24004d50 msgr2=0x7f0d240051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:00.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.952+0000 7f0d3affd700 1 --2- 172.21.15.146:0/3758396714 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d24004d50 0x7f0d240051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:00.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.952+0000 7f0d3affd700 1 -- 172.21.15.146:0/3758396714 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d24003570 con 0x7f0d24004010 2023-10-06T11:06:00.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.952+0000 7f0d3affd700 1 --2- 172.21.15.146:0/3758396714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d24004010 0x7f0d24004810 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0d3000c390 tx=0x7f0d30001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ccf415862598c49 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:00.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.952+0000 7f0d3a7fc700 1 -- 172.21.15.146:0/3758396714 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3000cc60 con 0x7f0d24004010 2023-10-06T11:06:00.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.952+0000 7f0d3a7fc700 1 -- 172.21.15.146:0/3758396714 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3000cde0 con 0x7f0d24004010 2023-10-06T11:06:00.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.952+0000 7f0d3a7fc700 1 -- 172.21.15.146:0/3758396714 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d30005b70 con 0x7f0d24004010 2023-10-06T11:06:00.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.953+0000 7f0d41fe6700 1 -- 172.21.15.146:0/3758396714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d24004010 msgr2=0x7f0d24004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:00.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.953+0000 7f0d41fe6700 1 --2- 172.21.15.146:0/3758396714 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d24004010 0x7f0d24004810 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0d3000c390 tx=0x7f0d30001e50 comp rx=0 tx=0).stop 2023-10-06T11:06:00.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.953+0000 7f0d3bfff700 1 -- 172.21.15.146:0/3758396714 reap_dead start 2023-10-06T11:06:00.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.953+0000 7f0d41fe6700 1 -- 172.21.15.146:0/3758396714 shutdown_connections 2023-10-06T11:06:00.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.953+0000 7f0d41fe6700 1 -- 172.21.15.146:0/3758396714 >> 172.21.15.146:0/3758396714 conn(0x7f0d3c06f380 msgr2=0x7f0d3c0d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:00.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.953+0000 7f0d41fe6700 1 -- 172.21.15.146:0/3758396714 shutdown_connections 2023-10-06T11:06:00.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.953+0000 7f0d41fe6700 1 -- 172.21.15.146:0/3758396714 wait complete. 2023-10-06T11:06:00.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.954+0000 7f0d41fe6700 1 Processor -- start 2023-10-06T11:06:00.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.954+0000 7f0d41fe6700 1 -- start start 2023-10-06T11:06:00.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.955+0000 7f0d41fe6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d24004010 0x7f0d3c157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:00.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.955+0000 7f0d41fe6700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d3c15d470 0x7f0d3c16b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:00.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.955+0000 7f0d41fe6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d3c15ee40 0x7f0d3c15f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:00.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.955+0000 7f0d41fe6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3c09dd50 con 0x7f0d3c15ee40 2023-10-06T11:06:00.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.955+0000 7f0d41fe6700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3c0b4570 con 0x7f0d3c15d470 2023-10-06T11:06:00.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.955+0000 7f0d41fe6700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d3c16bac0 con 0x7f0d24004010 2023-10-06T11:06:00.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.955+0000 7f0d3bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d3c15ee40 0x7f0d3c15f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:00.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.955+0000 7f0d3bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d3c15ee40 0x7f0d3c15f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40226/0 (socket says 172.21.15.146:40226) 2023-10-06T11:06:00.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.955+0000 7f0d3bfff700 1 -- 172.21.15.146:0/1470262484 learned_addr learned my addr 172.21.15.146:0/1470262484 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:00.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.955+0000 7f0d3b7fe700 1 --2- 172.21.15.146:0/1470262484 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d24004010 0x7f0d3c157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:00.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.955+0000 7f0d3affd700 1 --2- 172.21.15.146:0/1470262484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d3c15d470 0x7f0d3c16b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:00.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.955+0000 7f0d3bfff700 1 -- 172.21.15.146:0/1470262484 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d24004010 msgr2=0x7f0d3c157830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:00.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.955+0000 7f0d3bfff700 1 --2- 172.21.15.146:0/1470262484 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d24004010 0x7f0d3c157830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:00.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.955+0000 7f0d3bfff700 1 -- 172.21.15.146:0/1470262484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d3c15d470 msgr2=0x7f0d3c16b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:00.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.955+0000 7f0d3bfff700 1 --2- 172.21.15.146:0/1470262484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d3c15d470 0x7f0d3c16b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:00.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.955+0000 7f0d3bfff700 1 -- 172.21.15.146:0/1470262484 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d3c09df30 con 0x7f0d3c15ee40 2023-10-06T11:06:00.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.955+0000 7f0d3bfff700 1 --2- 172.21.15.146:0/1470262484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d3c15ee40 0x7f0d3c15f2e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c0b3360 tx=0x7f0d3400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:00.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.956+0000 7f0d237fe700 1 -- 172.21.15.146:0/1470262484 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3400e040 con 0x7f0d3c15ee40 2023-10-06T11:06:00.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.956+0000 7f0d237fe700 1 -- 172.21.15.146:0/1470262484 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3400f040 con 0x7f0d3c15ee40 2023-10-06T11:06:00.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.956+0000 7f0d41fe6700 1 -- 172.21.15.146:0/1470262484 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d3c09e210 con 0x7f0d3c15ee40 2023-10-06T11:06:00.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.956+0000 7f0d237fe700 1 -- 172.21.15.146:0/1470262484 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3400fe20 con 0x7f0d3c15ee40 2023-10-06T11:06:00.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.956+0000 7f0d41fe6700 1 -- 172.21.15.146:0/1470262484 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d3c0b4a60 con 0x7f0d3c15ee40 2023-10-06T11:06:00.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.957+0000 7f0d41fe6700 1 -- 172.21.15.146:0/1470262484 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d3c068390 con 0x7f0d3c15ee40 2023-10-06T11:06:00.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.957+0000 7f0d237fe700 1 -- 172.21.15.146:0/1470262484 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0d34015640 con 0x7f0d3c15ee40 2023-10-06T11:06:00.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.957+0000 7f0d237fe700 1 --2- 172.21.15.146:0/1470262484 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0d28066f60 0x7f0d28069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:00.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.957+0000 7f0d237fe700 1 -- 172.21.15.146:0/1470262484 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0d34084f90 con 0x7f0d3c15ee40 2023-10-06T11:06:00.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.957+0000 7f0d3b7fe700 1 --2- 172.21.15.146:0/1470262484 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0d28066f60 0x7f0d28069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:00.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.958+0000 7f0d3b7fe700 1 --2- 172.21.15.146:0/1470262484 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0d28066f60 0x7f0d28069410 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c007c10 tx=0x7f0d2c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:00.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:00.962+0000 7f0d237fe700 1 -- 172.21.15.146:0/1470262484 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0d340520a0 con 0x7f0d3c15ee40 2023-10-06T11:06:01.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.142+0000 7f0d41fe6700 1 -- 172.21.15.146:0/1470262484 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0d3c0b4c50 con 0x7f0d3c15ee40 2023-10-06T11:06:01.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.143+0000 7f0d237fe700 1 -- 172.21.15.146:0/1470262484 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0d340556c0 con 0x7f0d3c15ee40 2023-10-06T11:06:01.145 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2023-10-06T11:06:01.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.145+0000 7f0d41fe6700 1 -- 172.21.15.146:0/1470262484 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0d28066f60 msgr2=0x7f0d28069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:01.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.145+0000 7f0d41fe6700 1 --2- 172.21.15.146:0/1470262484 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0d28066f60 0x7f0d28069410 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0d2c007c10 tx=0x7f0d2c009040 comp rx=0 tx=0).stop 2023-10-06T11:06:01.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.145+0000 7f0d41fe6700 1 -- 172.21.15.146:0/1470262484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d3c15ee40 msgr2=0x7f0d3c15f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:01.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.145+0000 7f0d41fe6700 1 --2- 172.21.15.146:0/1470262484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d3c15ee40 0x7f0d3c15f2e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c0b3360 tx=0x7f0d3400b040 comp rx=0 tx=0).stop 2023-10-06T11:06:01.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.145+0000 7f0d41fe6700 1 -- 172.21.15.146:0/1470262484 shutdown_connections 2023-10-06T11:06:01.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.145+0000 7f0d41fe6700 1 --2- 172.21.15.146:0/1470262484 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0d28066f60 0x7f0d28069410 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:01.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.145+0000 7f0d41fe6700 1 --2- 172.21.15.146:0/1470262484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d3c15ee40 0x7f0d3c15f2e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:01.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.145+0000 7f0d41fe6700 1 --2- 172.21.15.146:0/1470262484 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d24004010 0x7f0d3c157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:01.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.145+0000 7f0d41fe6700 1 --2- 172.21.15.146:0/1470262484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d3c15d470 0x7f0d3c16b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:01.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.145+0000 7f0d41fe6700 1 -- 172.21.15.146:0/1470262484 >> 172.21.15.146:0/1470262484 conn(0x7f0d3c06f380 msgr2=0x7f0d3c0cf570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:01.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.145+0000 7f0d41fe6700 1 -- 172.21.15.146:0/1470262484 shutdown_connections 2023-10-06T11:06:01.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.145+0000 7f0d41fe6700 1 -- 172.21.15.146:0/1470262484 wait complete. 2023-10-06T11:06:01.159 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T11:06:01.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.273+0000 7f7e4c99d700 1 Processor -- start 2023-10-06T11:06:01.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.273+0000 7f7e4c99d700 1 -- start start 2023-10-06T11:06:01.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.274+0000 7f7e4c99d700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7e48159f40 0x7f7e4815d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:01.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.274+0000 7f7e4c99d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e4815e5f0 0x7f7e480cada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:01.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.274+0000 7f7e4c99d700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e480d1670 con 0x7f7e480c7810 2023-10-06T11:06:01.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.274+0000 7f7e4c99d700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e480cc4b0 con 0x7f7e48159f40 2023-10-06T11:06:01.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.274+0000 7f7e4c99d700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4815a310 con 0x7f7e4815e5f0 2023-10-06T11:06:01.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.275+0000 7f7e46d9d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e4815e5f0 0x7f7e480cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:01.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.275+0000 7f7e4659c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7e48159f40 0x7f7e4815d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:01.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.275+0000 7f7e46d9d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e4815e5f0 0x7f7e480cada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:41034/0 (socket says 172.21.15.146:41034) 2023-10-06T11:06:01.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.275+0000 7f7e4659c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7e48159f40 0x7f7e4815d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:45550/0 (socket says 172.21.15.146:45550) 2023-10-06T11:06:01.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.275+0000 7f7e45d9b700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f7e480c7810 0x7f7e4815dee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:38582/0 (socket says 172.21.15.146:38582) 2023-10-06T11:06:01.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.275+0000 7f7e46d9d700 1 -- 172.21.15.146:0/1051576574 learned_addr learned my addr 172.21.15.146:0/1051576574 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:01.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.275+0000 7f7e46d9d700 1 -- 172.21.15.146:0/1051576574 >> v2:172.21.15.151:3300/0 conn(0x7f7e48159f40 msgr2=0x7f7e4815d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:01.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.275+0000 7f7e46d9d700 1 --2- 172.21.15.146:0/1051576574 >> v2:172.21.15.151:3300/0 conn(0x7f7e48159f40 0x7f7e4815d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:01.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.275+0000 7f7e46d9d700 1 -- 172.21.15.146:0/1051576574 >> v1:172.21.15.151:6789/0 conn(0x7f7e480c7810 legacy=0x7f7e4815dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:01.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.275+0000 7f7e46d9d700 1 -- 172.21.15.146:0/1051576574 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e480cee70 con 0x7f7e4815e5f0 2023-10-06T11:06:01.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.275+0000 7f7e4559a700 1 -- 172.21.15.146:0/1051576574 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2961181027 0 0) 0x7f7e480d1670 con 0x7f7e480c7810 2023-10-06T11:06:01.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.275+0000 7f7e4659c700 1 --2- 172.21.15.146:0/1051576574 >> v2:172.21.15.151:3300/0 conn(0x7f7e48159f40 0x7f7e4815d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:06:01.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.275+0000 7f7e46d9d700 1 --2- 172.21.15.146:0/1051576574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e4815e5f0 0x7f7e480cada0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7e400099b0 tx=0x7f7e40009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=faab2ea10e5bb0cc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:01.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.275+0000 7f7e4559a700 1 -- 172.21.15.146:0/1051576574 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e40009ea0 con 0x7f7e4815e5f0 2023-10-06T11:06:01.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.275+0000 7f7e4559a700 1 -- 172.21.15.146:0/1051576574 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e4000b860 con 0x7f7e4815e5f0 2023-10-06T11:06:01.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.275+0000 7f7e4559a700 1 -- 172.21.15.146:0/1051576574 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4000bc00 con 0x7f7e4815e5f0 2023-10-06T11:06:01.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.276+0000 7f7e4c99d700 1 -- 172.21.15.146:0/1051576574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e4815e5f0 msgr2=0x7f7e480cada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:01.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.276+0000 7f7e4c99d700 1 --2- 172.21.15.146:0/1051576574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e4815e5f0 0x7f7e480cada0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7e400099b0 tx=0x7f7e40009250 comp rx=0 tx=0).stop 2023-10-06T11:06:01.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.276+0000 7f7e4c99d700 1 -- 172.21.15.146:0/1051576574 shutdown_connections 2023-10-06T11:06:01.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.276+0000 7f7e4c99d700 1 --2- 172.21.15.146:0/1051576574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e4815e5f0 0x7f7e480cada0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:01.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.276+0000 7f7e4c99d700 1 --2- 172.21.15.146:0/1051576574 >> v2:172.21.15.151:3300/0 conn(0x7f7e48159f40 0x7f7e4815d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:01.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.276+0000 7f7e4c99d700 1 -- 172.21.15.146:0/1051576574 >> 172.21.15.146:0/1051576574 conn(0x7f7e4806f380 msgr2=0x7f7e480d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:01.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.276+0000 7f7e4c99d700 1 -- 172.21.15.146:0/1051576574 shutdown_connections 2023-10-06T11:06:01.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.276+0000 7f7e4c99d700 1 -- 172.21.15.146:0/1051576574 wait complete. 2023-10-06T11:06:01.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.277+0000 7f7e4c99d700 1 Processor -- start 2023-10-06T11:06:01.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.277+0000 7f7e4c99d700 1 -- start start 2023-10-06T11:06:01.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.278+0000 7f7e4c99d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e480c7810 0x7f7e480c6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:01.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.278+0000 7f7e4c99d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e48159f40 0x7f7e481698a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:01.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.278+0000 7f7e4c99d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e4815e5f0 0x7f7e480b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:01.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.278+0000 7f7e4c99d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e48169de0 con 0x7f7e480c7810 2023-10-06T11:06:01.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.278+0000 7f7e4c99d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e480b4a60 con 0x7f7e48159f40 2023-10-06T11:06:01.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.278+0000 7f7e4c99d700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e480c4990 con 0x7f7e4815e5f0 2023-10-06T11:06:01.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.278+0000 7f7e4659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e480c7810 0x7f7e480c6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:01.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.278+0000 7f7e4659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e480c7810 0x7f7e480c6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40238/0 (socket says 172.21.15.146:40238) 2023-10-06T11:06:01.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.278+0000 7f7e4659c700 1 -- 172.21.15.146:0/3170517526 learned_addr learned my addr 172.21.15.146:0/3170517526 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:01.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.278+0000 7f7e46d9d700 1 --2- 172.21.15.146:0/3170517526 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e4815e5f0 0x7f7e480b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:01.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.278+0000 7f7e45d9b700 1 --2- 172.21.15.146:0/3170517526 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e48159f40 0x7f7e481698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:01.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.278+0000 7f7e4659c700 1 -- 172.21.15.146:0/3170517526 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e4815e5f0 msgr2=0x7f7e480b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:01.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.278+0000 7f7e4659c700 1 --2- 172.21.15.146:0/3170517526 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e4815e5f0 0x7f7e480b3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:01.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.278+0000 7f7e4659c700 1 -- 172.21.15.146:0/3170517526 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e48159f40 msgr2=0x7f7e481698a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:01.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.278+0000 7f7e4659c700 1 --2- 172.21.15.146:0/3170517526 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e48159f40 0x7f7e481698a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:01.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.278+0000 7f7e4659c700 1 -- 172.21.15.146:0/3170517526 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e38009a20 con 0x7f7e480c7810 2023-10-06T11:06:01.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.278+0000 7f7e46d9d700 1 --2- 172.21.15.146:0/3170517526 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e4815e5f0 0x7f7e480b3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:06:01.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.278+0000 7f7e45d9b700 1 --2- 172.21.15.146:0/3170517526 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e48159f40 0x7f7e481698a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:06:01.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.278+0000 7f7e4659c700 1 --2- 172.21.15.146:0/3170517526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e480c7810 0x7f7e480c6cb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7e3800c1f0 tx=0x7f7e3800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:01.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.279+0000 7f7e367fc700 1 -- 172.21.15.146:0/3170517526 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3800ce30 con 0x7f7e480c7810 2023-10-06T11:06:01.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.279+0000 7f7e367fc700 1 -- 172.21.15.146:0/3170517526 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3800f040 con 0x7f7e480c7810 2023-10-06T11:06:01.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.279+0000 7f7e367fc700 1 -- 172.21.15.146:0/3170517526 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e38014690 con 0x7f7e480c7810 2023-10-06T11:06:01.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.279+0000 7f7e4c99d700 1 -- 172.21.15.146:0/3170517526 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e400094f0 con 0x7f7e480c7810 2023-10-06T11:06:01.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.279+0000 7f7e4c99d700 1 -- 172.21.15.146:0/3170517526 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e480b4800 con 0x7f7e480c7810 2023-10-06T11:06:01.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.279+0000 7f7e4c99d700 1 -- 172.21.15.146:0/3170517526 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e4804c380 con 0x7f7e480c7810 2023-10-06T11:06:01.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.280+0000 7f7e367fc700 1 -- 172.21.15.146:0/3170517526 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7e38014a00 con 0x7f7e480c7810 2023-10-06T11:06:01.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.280+0000 7f7e367fc700 1 --2- 172.21.15.146:0/3170517526 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7e28066f30 0x7f7e280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:01.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.280+0000 7f7e367fc700 1 -- 172.21.15.146:0/3170517526 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7e38085710 con 0x7f7e480c7810 2023-10-06T11:06:01.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.280+0000 7f7e45d9b700 1 --2- 172.21.15.146:0/3170517526 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7e28066f30 0x7f7e280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:01.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.281+0000 7f7e45d9b700 1 --2- 172.21.15.146:0/3170517526 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7e28066f30 0x7f7e280693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7e480cdee0 tx=0x7f7e3c007cb0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:01.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.285+0000 7f7e367fc700 1 -- 172.21.15.146:0/3170517526 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7e380562b0 con 0x7f7e480c7810 2023-10-06T11:06:01.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.471+0000 7f7e4c99d700 1 -- 172.21.15.146:0/3170517526 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7e48089ec0 con 0x7f7e480c7810 2023-10-06T11:06:01.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.471+0000 7f7e367fc700 1 -- 172.21.15.146:0/3170517526 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7e38014cb0 con 0x7f7e480c7810 2023-10-06T11:06:01.473 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2023-10-06T11:06:01.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.473+0000 7f7e4c99d700 1 -- 172.21.15.146:0/3170517526 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7e28066f30 msgr2=0x7f7e280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:01.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.473+0000 7f7e4c99d700 1 --2- 172.21.15.146:0/3170517526 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7e28066f30 0x7f7e280693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7e480cdee0 tx=0x7f7e3c007cb0 comp rx=0 tx=0).stop 2023-10-06T11:06:01.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.473+0000 7f7e4c99d700 1 -- 172.21.15.146:0/3170517526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e480c7810 msgr2=0x7f7e480c6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:01.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.473+0000 7f7e4c99d700 1 --2- 172.21.15.146:0/3170517526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e480c7810 0x7f7e480c6cb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7e3800c1f0 tx=0x7f7e3800b040 comp rx=0 tx=0).stop 2023-10-06T11:06:01.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.473+0000 7f7e4c99d700 1 -- 172.21.15.146:0/3170517526 shutdown_connections 2023-10-06T11:06:01.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.473+0000 7f7e4c99d700 1 --2- 172.21.15.146:0/3170517526 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7e28066f30 0x7f7e280693e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:01.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.473+0000 7f7e4c99d700 1 --2- 172.21.15.146:0/3170517526 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e4815e5f0 0x7f7e480b3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:01.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.473+0000 7f7e4c99d700 1 --2- 172.21.15.146:0/3170517526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e480c7810 0x7f7e480c6cb0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:01.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.473+0000 7f7e4c99d700 1 --2- 172.21.15.146:0/3170517526 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e48159f40 0x7f7e481698a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:01.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.473+0000 7f7e4c99d700 1 -- 172.21.15.146:0/3170517526 >> 172.21.15.146:0/3170517526 conn(0x7f7e4806f380 msgr2=0x7f7e48068560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:01.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.473+0000 7f7e4c99d700 1 -- 172.21.15.146:0/3170517526 shutdown_connections 2023-10-06T11:06:01.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.473+0000 7f7e4c99d700 1 -- 172.21.15.146:0/3170517526 wait complete. 2023-10-06T11:06:01.487 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:06:01.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.600+0000 7f7be6faa700 1 Processor -- start 2023-10-06T11:06:01.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.600+0000 7f7be6faa700 1 -- start start 2023-10-06T11:06:01.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.601+0000 7f7be6faa700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7be0068ba0 0x7f7be015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:01.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.601+0000 7f7be6faa700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7be0153e80 0x7f7be00b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:01.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.601+0000 7f7be6faa700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7be015ac30 con 0x7f7be0153ab0 2023-10-06T11:06:01.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.601+0000 7f7be6faa700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7be00b4510 con 0x7f7be0068ba0 2023-10-06T11:06:01.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.601+0000 7f7be6faa700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7be00b6530 con 0x7f7be0153e80 2023-10-06T11:06:01.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.601+0000 7f7bd7fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7be0068ba0 0x7f7be015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:01.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.601+0000 7f7bd7fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7be0068ba0 0x7f7be015a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47136/0 (socket says 172.21.15.146:47136) 2023-10-06T11:06:01.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.601+0000 7f7bd7fff700 1 -- 172.21.15.146:0/982882458 learned_addr learned my addr 172.21.15.146:0/982882458 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:01.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.601+0000 7f7bd7fff700 1 -- 172.21.15.146:0/982882458 >> v2:172.21.15.151:3300/0 conn(0x7f7be0153e80 msgr2=0x7f7be00b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:01.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.601+0000 7f7bd7fff700 1 --2- 172.21.15.146:0/982882458 >> v2:172.21.15.151:3300/0 conn(0x7f7be0153e80 0x7f7be00b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:01.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.601+0000 7f7bd7fff700 1 -- 172.21.15.146:0/982882458 >> v1:172.21.15.151:6789/0 conn(0x7f7be0153ab0 legacy=0x7f7be0068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:01.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.601+0000 7f7bd7fff700 1 -- 172.21.15.146:0/982882458 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be00b5c50 con 0x7f7be0068ba0 2023-10-06T11:06:01.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.601+0000 7f7bd7fff700 1 --2- 172.21.15.146:0/982882458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7be0068ba0 0x7f7be015a6f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7be00d12a0 tx=0x7f7bd0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f1eb314b48ad13 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:01.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.601+0000 7f7bd77fe700 1 -- 172.21.15.146:0/982882458 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd000b820 con 0x7f7be0068ba0 2023-10-06T11:06:01.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.601+0000 7f7bd77fe700 1 -- 172.21.15.146:0/982882458 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd000b980 con 0x7f7be0068ba0 2023-10-06T11:06:01.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.601+0000 7f7bd77fe700 1 -- 172.21.15.146:0/982882458 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd000bd20 con 0x7f7be0068ba0 2023-10-06T11:06:01.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.602+0000 7f7be6faa700 1 -- 172.21.15.146:0/982882458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7be0068ba0 msgr2=0x7f7be015a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:01.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.602+0000 7f7be6faa700 1 --2- 172.21.15.146:0/982882458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7be0068ba0 0x7f7be015a6f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7be00d12a0 tx=0x7f7bd0009250 comp rx=0 tx=0).stop 2023-10-06T11:06:01.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.602+0000 7f7be6faa700 1 -- 172.21.15.146:0/982882458 shutdown_connections 2023-10-06T11:06:01.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.602+0000 7f7be6faa700 1 --2- 172.21.15.146:0/982882458 >> v2:172.21.15.151:3300/0 conn(0x7f7be0153e80 0x7f7be00b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:01.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.602+0000 7f7be6faa700 1 --2- 172.21.15.146:0/982882458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7be0068ba0 0x7f7be015a6f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:01.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.602+0000 7f7be6faa700 1 -- 172.21.15.146:0/982882458 >> 172.21.15.146:0/982882458 conn(0x7f7be006eba0 msgr2=0x7f7be006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:01.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.602+0000 7f7be6faa700 1 -- 172.21.15.146:0/982882458 shutdown_connections 2023-10-06T11:06:01.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.602+0000 7f7be6faa700 1 -- 172.21.15.146:0/982882458 wait complete. 2023-10-06T11:06:01.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.603+0000 7f7be6faa700 1 Processor -- start 2023-10-06T11:06:01.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.603+0000 7f7be6faa700 1 -- start start 2023-10-06T11:06:01.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.604+0000 7f7be6faa700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7be0153ab0 0x7f7be0144e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:01.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.604+0000 7f7be6faa700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7be0153e80 0x7f7be015c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:01.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.604+0000 7f7be6faa700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7be015c580 0x7f7be013efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:01.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.604+0000 7f7be6faa700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be015ca00 con 0x7f7be015c580 2023-10-06T11:06:01.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.604+0000 7f7be6faa700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be013eb90 con 0x7f7be0153ab0 2023-10-06T11:06:01.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.604+0000 7f7be6faa700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be0145340 con 0x7f7be0153e80 2023-10-06T11:06:01.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.604+0000 7f7be5547700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7be015c580 0x7f7be013efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:01.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.604+0000 7f7be5547700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7be015c580 0x7f7be013efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47150/0 (socket says 172.21.15.146:47150) 2023-10-06T11:06:01.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.604+0000 7f7be5547700 1 -- 172.21.15.146:0/1243198906 learned_addr learned my addr 172.21.15.146:0/1243198906 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:01.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.604+0000 7f7be4d46700 1 --2- 172.21.15.146:0/1243198906 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7be0153ab0 0x7f7be0144e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:01.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.604+0000 7f7bd7fff700 1 --2- 172.21.15.146:0/1243198906 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7be0153e80 0x7f7be015c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:01.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.604+0000 7f7be5547700 1 -- 172.21.15.146:0/1243198906 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7be0153e80 msgr2=0x7f7be015c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:01.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.604+0000 7f7be5547700 1 --2- 172.21.15.146:0/1243198906 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7be0153e80 0x7f7be015c040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:01.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.604+0000 7f7be5547700 1 -- 172.21.15.146:0/1243198906 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7be0153ab0 msgr2=0x7f7be0144e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:01.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.604+0000 7f7be5547700 1 --2- 172.21.15.146:0/1243198906 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7be0153ab0 0x7f7be0144e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:01.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.604+0000 7f7be5547700 1 -- 172.21.15.146:0/1243198906 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd00094f0 con 0x7f7be015c580 2023-10-06T11:06:01.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.604+0000 7f7be5547700 1 --2- 172.21.15.146:0/1243198906 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7be015c580 0x7f7be013efe0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800b840 tx=0x7f7bd80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:01.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.605+0000 7f7bd4ff9700 1 -- 172.21.15.146:0/1243198906 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd800f510 con 0x7f7be015c580 2023-10-06T11:06:01.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.605+0000 7f7bd4ff9700 1 -- 172.21.15.146:0/1243198906 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd800f670 con 0x7f7be015c580 2023-10-06T11:06:01.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.605+0000 7f7bd4ff9700 1 -- 172.21.15.146:0/1243198906 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd800fa30 con 0x7f7be015c580 2023-10-06T11:06:01.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.605+0000 7f7be6faa700 1 -- 172.21.15.146:0/1243198906 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7be0140940 con 0x7f7be015c580 2023-10-06T11:06:01.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.605+0000 7f7be6faa700 1 -- 172.21.15.146:0/1243198906 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7be0140010 con 0x7f7be015c580 2023-10-06T11:06:01.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.605+0000 7f7be6faa700 1 -- 172.21.15.146:0/1243198906 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7be0140ad0 con 0x7f7be015c580 2023-10-06T11:06:01.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.606+0000 7f7bd4ff9700 1 -- 172.21.15.146:0/1243198906 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7bd801a400 con 0x7f7be015c580 2023-10-06T11:06:01.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.606+0000 7f7bd4ff9700 1 --2- 172.21.15.146:0/1243198906 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7bcc066f30 0x7f7bcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:01.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.606+0000 7f7bd4ff9700 1 -- 172.21.15.146:0/1243198906 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7bd80840b0 con 0x7f7be015c580 2023-10-06T11:06:01.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.606+0000 7f7be4d46700 1 --2- 172.21.15.146:0/1243198906 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7bcc066f30 0x7f7bcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:01.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.607+0000 7f7be4d46700 1 --2- 172.21.15.146:0/1243198906 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7bcc066f30 0x7f7bcc0693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc0075c0 tx=0x7f7bdc009780 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:01.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.610+0000 7f7bd4ff9700 1 -- 172.21.15.146:0/1243198906 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7bd8051240 con 0x7f7be015c580 2023-10-06T11:06:01.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.835+0000 7f7be6faa700 1 -- 172.21.15.146:0/1243198906 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7be004c380 con 0x7f7be015c580 2023-10-06T11:06:01.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.835+0000 7f7bd4ff9700 1 -- 172.21.15.146:0/1243198906 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f7bd8054860 con 0x7f7be015c580 2023-10-06T11:06:01.837 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:06:01.837 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2812328960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2812328960},{"type":"v1","addr":"172.21.15.151:6835","nonce":2812328960}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/178026783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":178026783},{"type":"v1","addr":"172.21.15.146:6836","nonce":178026783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/716185126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":716185126},{"type":"v1","addr":"172.21.15.146:6837","nonce":716185126}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:05:43.740490+0000","modified":"2023-10-06T11:05:47.375805+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6833/1317728156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1317728156},{"type":"v1","addr":"172.21.15.151:6833","nonce":1317728156}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T11:06:01.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.837+0000 7f7be6faa700 1 -- 172.21.15.146:0/1243198906 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7bcc066f30 msgr2=0x7f7bcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:01.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.837+0000 7f7be6faa700 1 --2- 172.21.15.146:0/1243198906 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7bcc066f30 0x7f7bcc0693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc0075c0 tx=0x7f7bdc009780 comp rx=0 tx=0).stop 2023-10-06T11:06:01.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.837+0000 7f7be6faa700 1 -- 172.21.15.146:0/1243198906 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7be015c580 msgr2=0x7f7be013efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:01.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.837+0000 7f7be6faa700 1 --2- 172.21.15.146:0/1243198906 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7be015c580 0x7f7be013efe0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800b840 tx=0x7f7bd80091d0 comp rx=0 tx=0).stop 2023-10-06T11:06:01.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.837+0000 7f7be6faa700 1 -- 172.21.15.146:0/1243198906 shutdown_connections 2023-10-06T11:06:01.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.837+0000 7f7be6faa700 1 --2- 172.21.15.146:0/1243198906 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7bcc066f30 0x7f7bcc0693e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:01.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.837+0000 7f7be6faa700 1 --2- 172.21.15.146:0/1243198906 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7be015c580 0x7f7be013efe0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:01.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.837+0000 7f7be6faa700 1 --2- 172.21.15.146:0/1243198906 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7be0153ab0 0x7f7be0144e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:01.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.837+0000 7f7be6faa700 1 --2- 172.21.15.146:0/1243198906 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7be0153e80 0x7f7be015c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:01.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.837+0000 7f7be6faa700 1 -- 172.21.15.146:0/1243198906 >> 172.21.15.146:0/1243198906 conn(0x7f7be006eba0 msgr2=0x7f7be015add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:01.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.837+0000 7f7be6faa700 1 -- 172.21.15.146:0/1243198906 shutdown_connections 2023-10-06T11:06:01.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.837+0000 7f7be6faa700 1 -- 172.21.15.146:0/1243198906 wait complete. 2023-10-06T11:06:01.840 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 7 2023-10-06T11:06:01.851 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:06:01.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.963+0000 7f49fcd91700 1 Processor -- start 2023-10-06T11:06:01.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.963+0000 7f49fcd91700 1 -- start start 2023-10-06T11:06:01.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.964+0000 7f49fcd91700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f49f813c390 0x7f49f815da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:01.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.964+0000 7f49fcd91700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f49f80cbe30 0x7f49f80cc280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:01.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.964+0000 7f49fcd91700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49f806c5a0 con 0x7f49f806cc10 2023-10-06T11:06:01.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.964+0000 7f49fcd91700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49f815dfb0 con 0x7f49f813c390 2023-10-06T11:06:01.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.964+0000 7f49fcd91700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f806b6b0 con 0x7f49f80cbe30 2023-10-06T11:06:01.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.964+0000 7f49f77fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f49f813c390 0x7f49f815da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:01.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.964+0000 7f49f7fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f49f806cc10 0x7f49f806d050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60262/0 (socket says 172.21.15.146:60262) 2023-10-06T11:06:01.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.964+0000 7f49f7fff700 1 -- 172.21.15.146:0/61831169 learned_addr learned my addr 172.21.15.146:0/61831169 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:01.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.965+0000 7f49f6ffd700 1 --2- 172.21.15.146:0/61831169 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f49f80cbe30 0x7f49f80cc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:01.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.965+0000 7f49f77fe700 1 -- 172.21.15.146:0/61831169 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f49f80cbe30 msgr2=0x7f49f80cc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:01.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.965+0000 7f49f77fe700 1 --2- 172.21.15.146:0/61831169 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f49f80cbe30 0x7f49f80cc280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:01.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.965+0000 7f49f77fe700 1 -- 172.21.15.146:0/61831169 >> v1:172.21.15.146:6789/0 conn(0x7f49f806cc10 legacy=0x7f49f806d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:01.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.965+0000 7f49f77fe700 1 -- 172.21.15.146:0/61831169 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f806b990 con 0x7f49f813c390 2023-10-06T11:06:01.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.965+0000 7f49f67fc700 1 -- 172.21.15.146:0/61831169 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1407378482 0 0) 0x7f49f806c5a0 con 0x7f49f806cc10 2023-10-06T11:06:01.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.965+0000 7f49f77fe700 1 --2- 172.21.15.146:0/61831169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49f813c390 0x7f49f815da70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f49e80098d0 tx=0x7f49e8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3c8a3bde3ccf8a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:01.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.965+0000 7f49f67fc700 1 -- 172.21.15.146:0/61831169 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e8009e70 con 0x7f49f813c390 2023-10-06T11:06:01.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.965+0000 7f49f67fc700 1 -- 172.21.15.146:0/61831169 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e8005c10 con 0x7f49f813c390 2023-10-06T11:06:01.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.965+0000 7f49f67fc700 1 -- 172.21.15.146:0/61831169 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e800b650 con 0x7f49f813c390 2023-10-06T11:06:01.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.966+0000 7f49fcd91700 1 -- 172.21.15.146:0/61831169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49f813c390 msgr2=0x7f49f815da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:01.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.966+0000 7f49fcd91700 1 --2- 172.21.15.146:0/61831169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49f813c390 0x7f49f815da70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f49e80098d0 tx=0x7f49e8009120 comp rx=0 tx=0).stop 2023-10-06T11:06:01.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.966+0000 7f49fcd91700 1 -- 172.21.15.146:0/61831169 shutdown_connections 2023-10-06T11:06:01.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.966+0000 7f49fcd91700 1 --2- 172.21.15.146:0/61831169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49f813c390 0x7f49f815da70 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:01.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.966+0000 7f49fcd91700 1 --2- 172.21.15.146:0/61831169 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f49f80cbe30 0x7f49f80cc280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:01.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.966+0000 7f49fcd91700 1 -- 172.21.15.146:0/61831169 >> 172.21.15.146:0/61831169 conn(0x7f49f80ce260 msgr2=0x7f49f80ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:01.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.966+0000 7f49fcd91700 1 -- 172.21.15.146:0/61831169 shutdown_connections 2023-10-06T11:06:01.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.966+0000 7f49fcd91700 1 -- 172.21.15.146:0/61831169 wait complete. 2023-10-06T11:06:01.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.967+0000 7f49fcd91700 1 Processor -- start 2023-10-06T11:06:01.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.967+0000 7f49fcd91700 1 -- start start 2023-10-06T11:06:01.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.968+0000 7f49fcd91700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49f806cc10 0x7f49f8154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:01.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.968+0000 7f49fcd91700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f49f80cbe30 0x7f49f80b0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:01.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.968+0000 7f49fcd91700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49f813c390 0x7f49f8139040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:01.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.968+0000 7f49fcd91700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f8156f70 con 0x7f49f813c390 2023-10-06T11:06:01.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.968+0000 7f49fcd91700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f8154740 con 0x7f49f806cc10 2023-10-06T11:06:01.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.968+0000 7f49fcd91700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f80adb20 con 0x7f49f80cbe30 2023-10-06T11:06:01.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.968+0000 7f49f7fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49f813c390 0x7f49f8139040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:01.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.968+0000 7f49f7fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49f813c390 0x7f49f8139040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47172/0 (socket says 172.21.15.146:47172) 2023-10-06T11:06:01.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.968+0000 7f49f7fff700 1 -- 172.21.15.146:0/1279715442 learned_addr learned my addr 172.21.15.146:0/1279715442 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:01.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.968+0000 7f49f6ffd700 1 --2- 172.21.15.146:0/1279715442 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f49f80cbe30 0x7f49f80b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:01.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.968+0000 7f49f77fe700 1 --2- 172.21.15.146:0/1279715442 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49f806cc10 0x7f49f8154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:01.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.968+0000 7f49f7fff700 1 -- 172.21.15.146:0/1279715442 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f49f80cbe30 msgr2=0x7f49f80b0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:01.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.968+0000 7f49f7fff700 1 --2- 172.21.15.146:0/1279715442 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f49f80cbe30 0x7f49f80b0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:01.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.968+0000 7f49f7fff700 1 -- 172.21.15.146:0/1279715442 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49f806cc10 msgr2=0x7f49f8154160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:01.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.968+0000 7f49f7fff700 1 --2- 172.21.15.146:0/1279715442 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49f806cc10 0x7f49f8154160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:01.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.968+0000 7f49f7fff700 1 -- 172.21.15.146:0/1279715442 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e80093c0 con 0x7f49f813c390 2023-10-06T11:06:01.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.968+0000 7f49f6ffd700 1 --2- 172.21.15.146:0/1279715442 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f49f80cbe30 0x7f49f80b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:06:01.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.968+0000 7f49f7fff700 1 --2- 172.21.15.146:0/1279715442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49f813c390 0x7f49f8139040 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f49f000cbf0 tx=0x7f49f00019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:01.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.968+0000 7f49df7fe700 1 -- 172.21.15.146:0/1279715442 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f000a9c0 con 0x7f49f813c390 2023-10-06T11:06:01.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.968+0000 7f49df7fe700 1 -- 172.21.15.146:0/1279715442 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49f000ab20 con 0x7f49f813c390 2023-10-06T11:06:01.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.968+0000 7f49fcd91700 1 -- 172.21.15.146:0/1279715442 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49f80ae010 con 0x7f49f813c390 2023-10-06T11:06:01.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.968+0000 7f49df7fe700 1 -- 172.21.15.146:0/1279715442 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49f00070f0 con 0x7f49f813c390 2023-10-06T11:06:01.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.968+0000 7f49fcd91700 1 -- 172.21.15.146:0/1279715442 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49f80adde0 con 0x7f49f813c390 2023-10-06T11:06:01.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.969+0000 7f49fcd91700 1 -- 172.21.15.146:0/1279715442 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49f806e510 con 0x7f49f813c390 2023-10-06T11:06:01.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.970+0000 7f49df7fe700 1 -- 172.21.15.146:0/1279715442 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f49f0007520 con 0x7f49f813c390 2023-10-06T11:06:01.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.970+0000 7f49df7fe700 1 --2- 172.21.15.146:0/1279715442 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f49e4066f30 0x7f49e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:01.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.970+0000 7f49f77fe700 1 --2- 172.21.15.146:0/1279715442 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f49e4066f30 0x7f49e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:01.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.970+0000 7f49df7fe700 1 -- 172.21.15.146:0/1279715442 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f49f0084ae0 con 0x7f49f813c390 2023-10-06T11:06:01.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.970+0000 7f49f77fe700 1 --2- 172.21.15.146:0/1279715442 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f49e4066f30 0x7f49e40693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f49e8009160 tx=0x7f49e8016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:01.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:01.974+0000 7f49df7fe700 1 -- 172.21.15.146:0/1279715442 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f49f0051bf0 con 0x7f49f813c390 2023-10-06T11:06:02.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.158+0000 7f49fcd91700 1 -- 172.21.15.146:0/1279715442 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49f804bb40 con 0x7f49f813c390 2023-10-06T11:06:02.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.159+0000 7f49df7fe700 1 -- 172.21.15.146:0/1279715442 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16914 (secure 0 0 0) 0x7f49f0055210 con 0x7f49f813c390 2023-10-06T11:06:02.161 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:06:02.161 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":20,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:05:45.362089+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:05:41.403954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T11:05:42.698754+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:06:02.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.161+0000 7f49fcd91700 1 -- 172.21.15.146:0/1279715442 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f49e4066f30 msgr2=0x7f49e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:02.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.161+0000 7f49fcd91700 1 --2- 172.21.15.146:0/1279715442 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f49e4066f30 0x7f49e40693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f49e8009160 tx=0x7f49e8016000 comp rx=0 tx=0).stop 2023-10-06T11:06:02.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.161+0000 7f49fcd91700 1 -- 172.21.15.146:0/1279715442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49f813c390 msgr2=0x7f49f8139040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:02.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.161+0000 7f49fcd91700 1 --2- 172.21.15.146:0/1279715442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49f813c390 0x7f49f8139040 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f49f000cbf0 tx=0x7f49f00019b0 comp rx=0 tx=0).stop 2023-10-06T11:06:02.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.161+0000 7f49fcd91700 1 -- 172.21.15.146:0/1279715442 shutdown_connections 2023-10-06T11:06:02.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.161+0000 7f49fcd91700 1 --2- 172.21.15.146:0/1279715442 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f49e4066f30 0x7f49e40693e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:02.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.161+0000 7f49fcd91700 1 --2- 172.21.15.146:0/1279715442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49f813c390 0x7f49f8139040 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:02.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.161+0000 7f49fcd91700 1 --2- 172.21.15.146:0/1279715442 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49f806cc10 0x7f49f8154160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:02.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.161+0000 7f49fcd91700 1 --2- 172.21.15.146:0/1279715442 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f49f80cbe30 0x7f49f80b0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:02.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.161+0000 7f49fcd91700 1 -- 172.21.15.146:0/1279715442 >> 172.21.15.146:0/1279715442 conn(0x7f49f80ce260 msgr2=0x7f49f815af90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:02.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.161+0000 7f49fcd91700 1 -- 172.21.15.146:0/1279715442 shutdown_connections 2023-10-06T11:06:02.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.161+0000 7f49fcd91700 1 -- 172.21.15.146:0/1279715442 wait complete. 2023-10-06T11:06:02.175 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:06:02.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.288+0000 7f0cbeb35700 1 Processor -- start 2023-10-06T11:06:02.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.288+0000 7f0cbeb35700 1 -- start start 2023-10-06T11:06:02.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.289+0000 7f0cbeb35700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cb8153e80 0x7f0cb815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:02.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.289+0000 7f0cbeb35700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cb815ac30 con 0x7f0cb8153ab0 2023-10-06T11:06:02.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.289+0000 7f0cbeb35700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cb80b4510 con 0x7f0cb8068ba0 2023-10-06T11:06:02.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.289+0000 7f0cbeb35700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb80b6530 con 0x7f0cb8153e80 2023-10-06T11:06:02.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.289+0000 7f0cbc8d1700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0cb8153ab0 0x7f0cb8068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60274/0 (socket says 172.21.15.146:60274) 2023-10-06T11:06:02.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.289+0000 7f0cbc8d1700 1 -- 172.21.15.146:0/1677652830 learned_addr learned my addr 172.21.15.146:0/1677652830 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:02.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.289+0000 7f0cbd0d2700 1 --2- 172.21.15.146:0/1677652830 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cb8153e80 0x7f0cb815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:02.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.289+0000 7f0cb77fe700 1 -- 172.21.15.146:0/1677652830 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3349224174 0 0) 0x7f0cb0001110 con 0x7f0cb8153ab0 2023-10-06T11:06:02.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.289+0000 7f0cb77fe700 1 -- 172.21.15.146:0/1677652830 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ca4003570 con 0x7f0cb8153ab0 2023-10-06T11:06:02.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.289+0000 7f0cb77fe700 1 -- 172.21.15.146:0/1677652830 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 335956012 0 0) 0x7f0ca4003570 con 0x7f0cb8153ab0 2023-10-06T11:06:02.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.289+0000 7f0cb77fe700 1 -- 172.21.15.146:0/1677652830 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cb8153e80 msgr2=0x7f0cb815a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:02.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.289+0000 7f0cb77fe700 1 --2- 172.21.15.146:0/1677652830 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cb8153e80 0x7f0cb815a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:02.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.289+0000 7f0cb77fe700 1 -- 172.21.15.146:0/1677652830 >> v1:172.21.15.151:6789/0 conn(0x7f0cb8068ba0 legacy=0x7f0cb80b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:02.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.289+0000 7f0cb77fe700 1 -- 172.21.15.146:0/1677652830 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb80b5c50 con 0x7f0cb8153ab0 2023-10-06T11:06:02.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.289+0000 7f0cb77fe700 1 -- 172.21.15.146:0/1677652830 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f0cb0001600 con 0x7f0cb8153ab0 2023-10-06T11:06:02.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.289+0000 7f0cb77fe700 1 -- 172.21.15.146:0/1677652830 >> v1:172.21.15.146:6789/0 conn(0x7f0cb8153ab0 legacy=0x7f0cb8068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:02.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.289+0000 7f0cb77fe700 1 --2- 172.21.15.146:0/1677652830 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cb8153e80 0x7f0ca4003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:02.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.289+0000 7f0cb77fe700 1 --2- 172.21.15.146:0/1677652830 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ca4004010 0x7f0ca4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:02.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.289+0000 7f0cb77fe700 1 --2- 172.21.15.146:0/1677652830 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ca4004d50 0x7f0ca40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:02.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.289+0000 7f0cb77fe700 1 -- 172.21.15.146:0/1677652830 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb80b6530 con 0x7f0ca4004d50 2023-10-06T11:06:02.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.289+0000 7f0cb77fe700 1 -- 172.21.15.146:0/1677652830 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca400bbf0 con 0x7f0ca4004010 2023-10-06T11:06:02.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.289+0000 7f0cb77fe700 1 -- 172.21.15.146:0/1677652830 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca400bdb0 con 0x7f0cb8153e80 2023-10-06T11:06:02.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.289+0000 7f0cbd0d2700 1 --2- 172.21.15.146:0/1677652830 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ca4004d50 0x7f0ca40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:02.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.289+0000 7f0cbc8d1700 1 --2- 172.21.15.146:0/1677652830 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cb8153e80 0x7f0ca4003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:02.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.290+0000 7f0cb7fff700 1 --2- 172.21.15.146:0/1677652830 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ca4004010 0x7f0ca4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:02.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.290+0000 7f0cbd0d2700 1 -- 172.21.15.146:0/1677652830 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cb8153e80 msgr2=0x7f0ca4003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:02.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.290+0000 7f0cbd0d2700 1 --2- 172.21.15.146:0/1677652830 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cb8153e80 0x7f0ca4003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:02.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.290+0000 7f0cbd0d2700 1 -- 172.21.15.146:0/1677652830 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ca4004010 msgr2=0x7f0ca4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:02.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.290+0000 7f0cbd0d2700 1 --2- 172.21.15.146:0/1677652830 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ca4004010 0x7f0ca4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:02.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.290+0000 7f0cbd0d2700 1 -- 172.21.15.146:0/1677652830 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca4003570 con 0x7f0ca4004d50 2023-10-06T11:06:02.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.290+0000 7f0cbd0d2700 1 --2- 172.21.15.146:0/1677652830 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ca4004d50 0x7f0ca40051c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0006f00 tx=0x7f0ca00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d63ee7d220fa3e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:02.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.290+0000 7f0cb77fe700 1 -- 172.21.15.146:0/1677652830 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca000e710 con 0x7f0ca4004d50 2023-10-06T11:06:02.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.290+0000 7f0cb77fe700 1 -- 172.21.15.146:0/1677652830 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca000e870 con 0x7f0ca4004d50 2023-10-06T11:06:02.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.290+0000 7f0cb77fe700 1 -- 172.21.15.146:0/1677652830 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca000ec30 con 0x7f0ca4004d50 2023-10-06T11:06:02.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.290+0000 7f0cbeb35700 1 -- 172.21.15.146:0/1677652830 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ca4004d50 msgr2=0x7f0ca40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:02.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.290+0000 7f0cbeb35700 1 --2- 172.21.15.146:0/1677652830 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ca4004d50 0x7f0ca40051c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0006f00 tx=0x7f0ca00091a0 comp rx=0 tx=0).stop 2023-10-06T11:06:02.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.290+0000 7f0cbd0d2700 1 -- 172.21.15.146:0/1677652830 reap_dead start 2023-10-06T11:06:02.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.290+0000 7f0cbeb35700 1 -- 172.21.15.146:0/1677652830 shutdown_connections 2023-10-06T11:06:02.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.290+0000 7f0cbeb35700 1 -- 172.21.15.146:0/1677652830 >> 172.21.15.146:0/1677652830 conn(0x7f0cb806eba0 msgr2=0x7f0cb806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:02.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.290+0000 7f0cbeb35700 1 -- 172.21.15.146:0/1677652830 shutdown_connections 2023-10-06T11:06:02.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.290+0000 7f0cbeb35700 1 -- 172.21.15.146:0/1677652830 wait complete. 2023-10-06T11:06:02.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.291+0000 7f0cbeb35700 1 Processor -- start 2023-10-06T11:06:02.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.292+0000 7f0cbeb35700 1 -- start start 2023-10-06T11:06:02.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.292+0000 7f0cbeb35700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0cb813afb0 0x7f0cb814ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:02.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.292+0000 7f0cbeb35700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cb80b1240 0x7f0cb80b1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:02.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.292+0000 7f0cbeb35700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cb80b2120 0x7f0cb80afec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:02.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.292+0000 7f0cbeb35700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb80b25c0 con 0x7f0cb80b2120 2023-10-06T11:06:02.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.292+0000 7f0cbeb35700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb814f3e0 con 0x7f0cb813afb0 2023-10-06T11:06:02.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.292+0000 7f0cbeb35700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb814f6c0 con 0x7f0cb80b1240 2023-10-06T11:06:02.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.293+0000 7f0cbd0d2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cb80b2120 0x7f0cb80afec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:02.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.293+0000 7f0cbd0d2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cb80b2120 0x7f0cb80afec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47184/0 (socket says 172.21.15.146:47184) 2023-10-06T11:06:02.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.293+0000 7f0cbd0d2700 1 -- 172.21.15.146:0/1738343936 learned_addr learned my addr 172.21.15.146:0/1738343936 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:02.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.293+0000 7f0cbc8d1700 1 --2- 172.21.15.146:0/1738343936 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0cb813afb0 0x7f0cb814ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:02.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.293+0000 7f0cb7fff700 1 --2- 172.21.15.146:0/1738343936 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cb80b1240 0x7f0cb80b1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:02.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.293+0000 7f0cbd0d2700 1 -- 172.21.15.146:0/1738343936 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cb80b1240 msgr2=0x7f0cb80b1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:02.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.293+0000 7f0cbd0d2700 1 --2- 172.21.15.146:0/1738343936 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cb80b1240 0x7f0cb80b1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:02.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.293+0000 7f0cbd0d2700 1 -- 172.21.15.146:0/1738343936 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0cb813afb0 msgr2=0x7f0cb814ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:02.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.293+0000 7f0cbd0d2700 1 --2- 172.21.15.146:0/1738343936 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0cb813afb0 0x7f0cb814ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:02.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.293+0000 7f0cbd0d2700 1 -- 172.21.15.146:0/1738343936 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb814f9a0 con 0x7f0cb80b2120 2023-10-06T11:06:02.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.293+0000 7f0cbd0d2700 1 --2- 172.21.15.146:0/1738343936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cb80b2120 0x7f0cb80afec0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0ca40057d0 tx=0x7f0ca001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:02.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.293+0000 7f0cb4ff9700 1 -- 172.21.15.146:0/1738343936 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca0022070 con 0x7f0cb80b2120 2023-10-06T11:06:02.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.293+0000 7f0cb4ff9700 1 -- 172.21.15.146:0/1738343936 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca0013db0 con 0x7f0cb80b2120 2023-10-06T11:06:02.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.293+0000 7f0cbeb35700 1 -- 172.21.15.146:0/1738343936 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cb814fc80 con 0x7f0cb80b2120 2023-10-06T11:06:02.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.293+0000 7f0cb4ff9700 1 -- 172.21.15.146:0/1738343936 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca000e710 con 0x7f0cb80b2120 2023-10-06T11:06:02.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.293+0000 7f0cbeb35700 1 -- 172.21.15.146:0/1738343936 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cb80b16b0 con 0x7f0cb80b2120 2023-10-06T11:06:02.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.294+0000 7f0cbeb35700 1 -- 172.21.15.146:0/1738343936 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cb81501a0 con 0x7f0cb80b2120 2023-10-06T11:06:02.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.294+0000 7f0cb4ff9700 1 -- 172.21.15.146:0/1738343936 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0ca001c990 con 0x7f0cb80b2120 2023-10-06T11:06:02.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.295+0000 7f0cb4ff9700 1 --2- 172.21.15.146:0/1738343936 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0c98066fb0 0x7f0c98069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:02.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.295+0000 7f0cb4ff9700 1 -- 172.21.15.146:0/1738343936 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0ca0000e40 con 0x7f0cb80b2120 2023-10-06T11:06:02.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.295+0000 7f0cbc8d1700 1 --2- 172.21.15.146:0/1738343936 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0c98066fb0 0x7f0c98069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:02.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.295+0000 7f0cbc8d1700 1 --2- 172.21.15.146:0/1738343936 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0c98066fb0 0x7f0c98069460 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0001730 tx=0x7f0cb8159c70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:02.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.299+0000 7f0cb4ff9700 1 -- 172.21.15.146:0/1738343936 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0cb81501a0 con 0x7f0cb80b2120 2023-10-06T11:06:02.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.526+0000 7f0cbeb35700 1 -- 172.21.15.146:0/1738343936 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0cb81501a0 con 0x7f0cb80b2120 2023-10-06T11:06:02.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.527+0000 7f0cb4ff9700 1 -- 172.21.15.146:0/1738343936 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f0cb81501a0 con 0x7f0cb80b2120 2023-10-06T11:06:02.529 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:06:02.529 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2812328960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2812328960},{"type":"v1","addr":"172.21.15.151:6835","nonce":2812328960}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/178026783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":178026783},{"type":"v1","addr":"172.21.15.146:6836","nonce":178026783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/716185126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":716185126},{"type":"v1","addr":"172.21.15.146:6837","nonce":716185126}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:05:43.740490+0000","modified":"2023-10-06T11:05:47.375805+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6833/1317728156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1317728156},{"type":"v1","addr":"172.21.15.151:6833","nonce":1317728156}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T11:06:02.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.529+0000 7f0cbeb35700 1 -- 172.21.15.146:0/1738343936 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0c98066fb0 msgr2=0x7f0c98069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:02.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.529+0000 7f0cbeb35700 1 --2- 172.21.15.146:0/1738343936 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0c98066fb0 0x7f0c98069460 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0001730 tx=0x7f0cb8159c70 comp rx=0 tx=0).stop 2023-10-06T11:06:02.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.529+0000 7f0cbeb35700 1 -- 172.21.15.146:0/1738343936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cb80b2120 msgr2=0x7f0cb80afec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:02.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.529+0000 7f0cbeb35700 1 --2- 172.21.15.146:0/1738343936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cb80b2120 0x7f0cb80afec0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0ca40057d0 tx=0x7f0ca001a000 comp rx=0 tx=0).stop 2023-10-06T11:06:02.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.529+0000 7f0cbeb35700 1 -- 172.21.15.146:0/1738343936 shutdown_connections 2023-10-06T11:06:02.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.529+0000 7f0cbeb35700 1 --2- 172.21.15.146:0/1738343936 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0c98066fb0 0x7f0c98069460 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:02.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.529+0000 7f0cbeb35700 1 --2- 172.21.15.146:0/1738343936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cb80b2120 0x7f0cb80afec0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:02.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.529+0000 7f0cbeb35700 1 --2- 172.21.15.146:0/1738343936 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0cb813afb0 0x7f0cb814ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:02.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.529+0000 7f0cbeb35700 1 --2- 172.21.15.146:0/1738343936 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cb80b1240 0x7f0cb80b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:02.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.529+0000 7f0cbeb35700 1 -- 172.21.15.146:0/1738343936 >> 172.21.15.146:0/1738343936 conn(0x7f0cb806eba0 msgr2=0x7f0cb8151e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:02.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.529+0000 7f0cbeb35700 1 -- 172.21.15.146:0/1738343936 shutdown_connections 2023-10-06T11:06:02.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:02.529+0000 7f0cbeb35700 1 -- 172.21.15.146:0/1738343936 wait complete. 2023-10-06T11:06:02.533 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 7 2023-10-06T11:06:02.945 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T11:05:43.740490+0000', 'modified': '2023-10-06T11:05:47.375805+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4282}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4282': {'gid': 4282, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.151:6833/1317728156', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6832', 'nonce': 1317728156}, {'type': 'v1', 'addr': '172.21.15.151:6833', 'nonce': 1317728156}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T11:06:02.945 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T11:06:02.945 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-06T11:06:03.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.061+0000 7fce8ef32700 1 Processor -- start 2023-10-06T11:06:03.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.061+0000 7fce8ef32700 1 -- start start 2023-10-06T11:06:03.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.061+0000 7fce8ef32700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce8815a160 0x7fce880c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:03.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.061+0000 7fce8ef32700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fce880ae730 0x7fce880aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:03.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.061+0000 7fce8ef32700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fce880ce3d0 0x7fce880ce830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:03.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.062+0000 7fce8ef32700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce880ae2a0 con 0x7fce880ce3d0 2023-10-06T11:06:03.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.062+0000 7fce8ef32700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce8815a530 con 0x7fce880ae730 2023-10-06T11:06:03.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.062+0000 7fce8ef32700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce880ad690 con 0x7fce8815a160 2023-10-06T11:06:03.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.062+0000 7fce8d4cf700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fce880ce3d0 0x7fce880ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:03.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.062+0000 7fce8d4cf700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fce880ce3d0 0x7fce880ce830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47192/0 (socket says 172.21.15.146:47192) 2023-10-06T11:06:03.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.062+0000 7fce8d4cf700 1 -- 172.21.15.146:0/2318507010 learned_addr learned my addr 172.21.15.146:0/2318507010 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:03.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.062+0000 7fce87fff700 1 --2- 172.21.15.146:0/2318507010 >> v2:172.21.15.151:3300/0 conn(0x7fce880ae730 0x7fce880aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:03.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.062+0000 7fce8ccce700 1 --2- 172.21.15.146:0/2318507010 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce8815a160 0x7fce880c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:03.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.062+0000 7fce8d4cf700 1 -- 172.21.15.146:0/2318507010 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce8815a160 msgr2=0x7fce880c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:03.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.062+0000 7fce8d4cf700 1 --2- 172.21.15.146:0/2318507010 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce8815a160 0x7fce880c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:03.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.062+0000 7fce8d4cf700 1 -- 172.21.15.146:0/2318507010 >> v2:172.21.15.151:3300/0 conn(0x7fce880ae730 msgr2=0x7fce880aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:03.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.062+0000 7fce8d4cf700 1 --2- 172.21.15.146:0/2318507010 >> v2:172.21.15.151:3300/0 conn(0x7fce880ae730 0x7fce880aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:03.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.062+0000 7fce8d4cf700 1 -- 172.21.15.146:0/2318507010 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce880ad970 con 0x7fce880ce3d0 2023-10-06T11:06:03.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.062+0000 7fce8d4cf700 1 --2- 172.21.15.146:0/2318507010 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce880ce3d0 0x7fce880ce830 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fce88088a00 tx=0x7fce80009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7945762399c1798 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:03.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.062+0000 7fce877fe700 1 -- 172.21.15.146:0/2318507010 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8000b860 con 0x7fce880ce3d0 2023-10-06T11:06:03.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.062+0000 7fce877fe700 1 -- 172.21.15.146:0/2318507010 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce8000b9c0 con 0x7fce880ce3d0 2023-10-06T11:06:03.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.062+0000 7fce877fe700 1 -- 172.21.15.146:0/2318507010 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8000bd60 con 0x7fce880ce3d0 2023-10-06T11:06:03.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.063+0000 7fce8ef32700 1 -- 172.21.15.146:0/2318507010 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce880ce3d0 msgr2=0x7fce880ce830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:03.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.063+0000 7fce8ef32700 1 --2- 172.21.15.146:0/2318507010 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce880ce3d0 0x7fce880ce830 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fce88088a00 tx=0x7fce80009250 comp rx=0 tx=0).stop 2023-10-06T11:06:03.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.063+0000 7fce8ef32700 1 -- 172.21.15.146:0/2318507010 shutdown_connections 2023-10-06T11:06:03.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.063+0000 7fce8ef32700 1 --2- 172.21.15.146:0/2318507010 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce880ce3d0 0x7fce880ce830 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:03.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.063+0000 7fce8ef32700 1 --2- 172.21.15.146:0/2318507010 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce8815a160 0x7fce880c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:03.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.063+0000 7fce8ef32700 1 --2- 172.21.15.146:0/2318507010 >> v2:172.21.15.151:3300/0 conn(0x7fce880ae730 0x7fce880aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:03.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.063+0000 7fce8ef32700 1 -- 172.21.15.146:0/2318507010 >> 172.21.15.146:0/2318507010 conn(0x7fce8806f380 msgr2=0x7fce880d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:03.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.063+0000 7fce8ef32700 1 -- 172.21.15.146:0/2318507010 shutdown_connections 2023-10-06T11:06:03.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.063+0000 7fce8ef32700 1 -- 172.21.15.146:0/2318507010 wait complete. 2023-10-06T11:06:03.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.064+0000 7fce8ef32700 1 Processor -- start 2023-10-06T11:06:03.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.064+0000 7fce8ef32700 1 -- start start 2023-10-06T11:06:03.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.065+0000 7fce8ef32700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce880ae730 0x7fce881594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:03.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.065+0000 7fce8ef32700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce880ce3d0 0x7fce88155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:03.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.065+0000 7fce8ef32700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce8815a160 0x7fce8815fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:03.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.065+0000 7fce8ef32700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce88155890 con 0x7fce8815a160 2023-10-06T11:06:03.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.065+0000 7fce8ef32700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce881567c0 con 0x7fce880ae730 2023-10-06T11:06:03.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.065+0000 7fce8ef32700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce88154c80 con 0x7fce880ce3d0 2023-10-06T11:06:03.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.065+0000 7fce8d4cf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce8815a160 0x7fce8815fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:03.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.065+0000 7fce8d4cf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce8815a160 0x7fce8815fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47200/0 (socket says 172.21.15.146:47200) 2023-10-06T11:06:03.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.065+0000 7fce8d4cf700 1 -- 172.21.15.146:0/28466768 learned_addr learned my addr 172.21.15.146:0/28466768 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:03.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.065+0000 7fce87fff700 1 --2- 172.21.15.146:0/28466768 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce880ce3d0 0x7fce88155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:03.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.065+0000 7fce8ccce700 1 --2- 172.21.15.146:0/28466768 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce880ae730 0x7fce881594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:03.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.065+0000 7fce8d4cf700 1 -- 172.21.15.146:0/28466768 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce880ce3d0 msgr2=0x7fce88155d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:03.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.065+0000 7fce8d4cf700 1 --2- 172.21.15.146:0/28466768 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce880ce3d0 0x7fce88155d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:03.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.065+0000 7fce8d4cf700 1 -- 172.21.15.146:0/28466768 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce880ae730 msgr2=0x7fce881594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:03.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.065+0000 7fce8d4cf700 1 --2- 172.21.15.146:0/28466768 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce880ae730 0x7fce881594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:03.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.065+0000 7fce8d4cf700 1 -- 172.21.15.146:0/28466768 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce800094f0 con 0x7fce8815a160 2023-10-06T11:06:03.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.065+0000 7fce8ccce700 1 --2- 172.21.15.146:0/28466768 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce880ae730 0x7fce881594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:06:03.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.065+0000 7fce8d4cf700 1 --2- 172.21.15.146:0/28466768 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce8815a160 0x7fce8815fba0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fce88088c60 tx=0x7fce80017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:03.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.065+0000 7fce84ff9700 1 -- 172.21.15.146:0/28466768 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8001a630 con 0x7fce8815a160 2023-10-06T11:06:03.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.065+0000 7fce84ff9700 1 -- 172.21.15.146:0/28466768 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce8001a7b0 con 0x7fce8815a160 2023-10-06T11:06:03.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.066+0000 7fce8ef32700 1 -- 172.21.15.146:0/28466768 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce88154f60 con 0x7fce8815a160 2023-10-06T11:06:03.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.066+0000 7fce84ff9700 1 -- 172.21.15.146:0/28466768 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8001ab70 con 0x7fce8815a160 2023-10-06T11:06:03.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.066+0000 7fce8ef32700 1 -- 172.21.15.146:0/28466768 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce88155520 con 0x7fce8815a160 2023-10-06T11:06:03.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.067+0000 7fce84ff9700 1 -- 172.21.15.146:0/28466768 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fce8002d440 con 0x7fce8815a160 2023-10-06T11:06:03.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.067+0000 7fce84ff9700 1 --2- 172.21.15.146:0/28466768 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fce74066f30 0x7fce740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:03.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.067+0000 7fce84ff9700 1 -- 172.21.15.146:0/28466768 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fce80086390 con 0x7fce8815a160 2023-10-06T11:06:03.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.067+0000 7fce8ccce700 1 --2- 172.21.15.146:0/28466768 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fce74066f30 0x7fce740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:03.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.068+0000 7fce8ccce700 1 --2- 172.21.15.146:0/28466768 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fce74066f30 0x7fce740693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fce88152f40 tx=0x7fce78009850 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:03.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.069+0000 7fce9822ab80 1 Processor -- start 2023-10-06T11:06:03.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.069+0000 7fce9822ab80 1 -- start start 2023-10-06T11:06:03.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.070+0000 7fce9822ab80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c493a39a90 0x55c493a39e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:03.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.070+0000 7fce9822ab80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c4939f59a0 0x55c4939f2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:03.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.070+0000 7fce9822ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4939f3bd0 0x55c4939f2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:03.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.070+0000 7fce9822ab80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c493972c80 con 0x55c493a39a90 2023-10-06T11:06:03.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.070+0000 7fce9822ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c493949a70 con 0x55c4939f3bd0 2023-10-06T11:06:03.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.070+0000 7fce9822ab80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c493947270 con 0x55c4939f59a0 2023-10-06T11:06:03.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.070+0000 7fce8ccce700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c493a39a90 0x55c493a39e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:03.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.070+0000 7fce8ccce700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c493a39a90 0x55c493a39e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47204/0 (socket says 172.21.15.146:47204) 2023-10-06T11:06:03.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.070+0000 7fce8ccce700 1 -- 172.21.15.146:0/219216442 learned_addr learned my addr 172.21.15.146:0/219216442 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:03.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.070+0000 7fce87fff700 1 --2- 172.21.15.146:0/219216442 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c4939f59a0 0x55c4939f2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:03.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.070+0000 7fce8d4cf700 1 --2- 172.21.15.146:0/219216442 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4939f3bd0 0x55c4939f2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:03.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.070+0000 7fce8ccce700 1 -- 172.21.15.146:0/219216442 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c4939f59a0 msgr2=0x55c4939f2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:03.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.070+0000 7fce8ccce700 1 --2- 172.21.15.146:0/219216442 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c4939f59a0 0x55c4939f2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:03.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.070+0000 7fce8ccce700 1 -- 172.21.15.146:0/219216442 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4939f3bd0 msgr2=0x55c4939f2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:03.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.070+0000 7fce8ccce700 1 --2- 172.21.15.146:0/219216442 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4939f3bd0 0x55c4939f2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:03.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.070+0000 7fce8ccce700 1 -- 172.21.15.146:0/219216442 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4937dd270 con 0x55c493a39a90 2023-10-06T11:06:03.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.070+0000 7fce8ccce700 1 --2- 172.21.15.146:0/219216442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c493a39a90 0x55c493a39e60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fce780169a0 tx=0x7fce78016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3992422d7c252801 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:03.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.071+0000 7fce6dffb700 1 -- 172.21.15.146:0/219216442 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce78016450 con 0x55c493a39a90 2023-10-06T11:06:03.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.071+0000 7fce6dffb700 1 -- 172.21.15.146:0/219216442 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce78014830 con 0x55c493a39a90 2023-10-06T11:06:03.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.071+0000 7fce6dffb700 1 -- 172.21.15.146:0/219216442 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce78014bd0 con 0x55c493a39a90 2023-10-06T11:06:03.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.071+0000 7fce9822ab80 1 -- 172.21.15.146:0/219216442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c493a39a90 msgr2=0x55c493a39e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:03.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.071+0000 7fce9822ab80 1 --2- 172.21.15.146:0/219216442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c493a39a90 0x55c493a39e60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fce780169a0 tx=0x7fce78016000 comp rx=0 tx=0).stop 2023-10-06T11:06:03.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.071+0000 7fce9822ab80 1 -- 172.21.15.146:0/219216442 shutdown_connections 2023-10-06T11:06:03.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.071+0000 7fce9822ab80 1 --2- 172.21.15.146:0/219216442 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4939f3bd0 0x55c4939f2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:03.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.071+0000 7fce9822ab80 1 --2- 172.21.15.146:0/219216442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c493a39a90 0x55c493a39e60 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:03.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.071+0000 7fce9822ab80 1 --2- 172.21.15.146:0/219216442 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c4939f59a0 0x55c4939f2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:03.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.071+0000 7fce9822ab80 1 -- 172.21.15.146:0/219216442 >> 172.21.15.146:0/219216442 conn(0x55c4939f4070 msgr2=0x55c4939f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:03.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.071+0000 7fce9822ab80 1 -- 172.21.15.146:0/219216442 shutdown_connections 2023-10-06T11:06:03.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.071+0000 7fce9822ab80 1 -- 172.21.15.146:0/219216442 wait complete. 2023-10-06T11:06:03.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.072+0000 7fce9822ab80 1 -- start start 2023-10-06T11:06:03.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.072+0000 7fce9822ab80 1 Processor -- start 2023-10-06T11:06:03.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.073+0000 7fce9822ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4939f3bd0 0x55c493a1cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:03.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.073+0000 7fce9822ab80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c4939f59a0 0x55c493a1aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:03.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.073+0000 7fce9822ab80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c493a39a90 0x55c493a1b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:03.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.073+0000 7fce9822ab80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c493943060 con 0x55c493a39a90 2023-10-06T11:06:03.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.073+0000 7fce9822ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4938ee890 con 0x55c4939f3bd0 2023-10-06T11:06:03.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.073+0000 7fce9822ab80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c493909ea0 con 0x55c4939f59a0 2023-10-06T11:06:03.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.073+0000 7fce9822ab80 10 client.0 _ll_register_callbacks cb 0x55c4937dff30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:06:03.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.073+0000 7fce8d4cf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c493a39a90 0x55c493a1b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:03.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.073+0000 7fce8d4cf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c493a39a90 0x55c493a1b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47214/0 (socket says 172.21.15.146:47214) 2023-10-06T11:06:03.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.073+0000 7fce87fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c4939f59a0 0x55c493a1aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:03.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.073+0000 7fce8d4cf700 1 -- 172.21.15.146:0/1667839247 learned_addr learned my addr 172.21.15.146:0/1667839247 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:03.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.073+0000 7fce8ccce700 1 --2- 172.21.15.146:0/1667839247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4939f3bd0 0x55c493a1cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:03.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.073+0000 7fce8d4cf700 1 -- 172.21.15.146:0/1667839247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c4939f59a0 msgr2=0x55c493a1aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:03.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.073+0000 7fce8d4cf700 1 --2- 172.21.15.146:0/1667839247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c4939f59a0 0x55c493a1aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:03.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.073+0000 7fce8d4cf700 1 -- 172.21.15.146:0/1667839247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4939f3bd0 msgr2=0x55c493a1cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:03.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.073+0000 7fce8d4cf700 1 --2- 172.21.15.146:0/1667839247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4939f3bd0 0x55c493a1cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:03.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.073+0000 7fce8d4cf700 1 -- 172.21.15.146:0/1667839247 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce780165b0 con 0x55c493a39a90 2023-10-06T11:06:03.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.073+0000 7fce8d4cf700 1 --2- 172.21.15.146:0/1667839247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c493a39a90 0x55c493a1b0e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fce80053660 tx=0x7fce80008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f6b1af8c3c595a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:03.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.073+0000 7fce66ffd700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:06:03.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.073+0000 7fce66ffd700 1 -- 172.21.15.146:0/1667839247 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8005a3b0 con 0x55c493a39a90 2023-10-06T11:06:03.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.073+0000 7fce66ffd700 1 -- 172.21.15.146:0/1667839247 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fce8005e100 con 0x55c493a39a90 2023-10-06T11:06:03.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.073+0000 7fce9822ab80 1 -- 172.21.15.146:0/1667839247 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c4939e7690 con 0x55c493a39a90 2023-10-06T11:06:03.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.074+0000 7fce66ffd700 1 -- 172.21.15.146:0/1667839247 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce800860f0 con 0x55c493a39a90 2023-10-06T11:06:03.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.074+0000 7fce9822ab80 10 client.4668 fetch_fsmap learned FSMap version 7 2023-10-06T11:06:03.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.074+0000 7fce9822ab80 1 -- 172.21.15.146:0/1667839247 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55c49377ffe0 con 0x55c493a39a90 2023-10-06T11:06:03.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.074+0000 7fce66ffd700 1 -- 172.21.15.146:0/1667839247 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce8007ee90 con 0x55c493a39a90 2023-10-06T11:06:03.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.074+0000 7fce66ffd700 1 -- 172.21.15.146:0/1667839247 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 7) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fce800573c0 con 0x55c493a39a90 2023-10-06T11:06:03.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.074+0000 7fce9822ab80 10 client.4668 fetch_fsmap finished waiting for FSMap version 7 2023-10-06T11:06:03.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.074+0000 7fce9822ab80 10 client.4668 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T11:06:03.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.074+0000 7fce9822ab80 20 client.4668 populate_metadata read hostname 'smithi146' 2023-10-06T11:06:03.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.074+0000 7fce9822ab80 1 --2- 172.21.15.146:0/1667839247 >> [v2:172.21.15.151:6832/1317728156,v1:172.21.15.151:6833/1317728156] conn(0x55c493a34a80 0x55c493a34e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:03.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.074+0000 7fce9822ab80 4 client.4668 mds_command: new command op to 4282 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:06:03.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.074+0000 7fce9822ab80 1 -- 172.21.15.146:0/1667839247 --> [v2:172.21.15.151:6832/1317728156,v1:172.21.15.151:6833/1317728156] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c4939c45c0 con 0x55c493a34a80 2023-10-06T11:06:03.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.074+0000 7fce8ccce700 1 --2- 172.21.15.146:0/1667839247 >> [v2:172.21.15.151:6832/1317728156,v1:172.21.15.151:6833/1317728156] conn(0x55c493a34a80 0x55c493a34e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:03.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.074+0000 7fce66ffd700 10 client.4668 ms_handle_connect on v2:172.21.15.151:6832/1317728156 2023-10-06T11:06:03.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.074+0000 7fce8ccce700 1 --2- 172.21.15.146:0/1667839247 >> [v2:172.21.15.151:6832/1317728156,v1:172.21.15.151:6833/1317728156] conn(0x55c493a34a80 0x55c493a34e50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6516108d8317666 server_cookie=db10da7772adbe3d in_seq=0 out_seq=0 2023-10-06T11:06:03.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.075+0000 7fce66ffd700 1 -- 172.21.15.146:0/1667839247 <== mds.0 v2:172.21.15.151:6832/1317728156 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55c4939c45c0 con 0x55c493a34a80 2023-10-06T11:06:03.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.075+0000 7fce66ffd700 10 client.4668 handle_command_reply: tid=0 2023-10-06T11:06:03.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.075+0000 7fce9822ab80 1 client.4668 shutdown 2023-10-06T11:06:03.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.075+0000 7fce9822ab80 1 -- 172.21.15.146:0/1667839247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c493a39a90 msgr2=0x55c493a1b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:03.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.075+0000 7fce9822ab80 1 --2- 172.21.15.146:0/1667839247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c493a39a90 0x55c493a1b0e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fce80053660 tx=0x7fce80008040 comp rx=0 tx=0).stop 2023-10-06T11:06:03.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.075+0000 7fce9822ab80 1 -- 172.21.15.146:0/1667839247 shutdown_connections 2023-10-06T11:06:03.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.075+0000 7fce9822ab80 1 --2- 172.21.15.146:0/1667839247 >> [v2:172.21.15.151:6832/1317728156,v1:172.21.15.151:6833/1317728156] conn(0x55c493a34a80 0x55c493a34e50 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:03.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.075+0000 7fce9822ab80 1 --2- 172.21.15.146:0/1667839247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c493a39a90 0x55c493a1b0e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:03.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.075+0000 7fce66ffd700 0 client.4668 ms_handle_reset on v2:172.21.15.151:6832/1317728156 2023-10-06T11:06:03.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.075+0000 7fce9822ab80 1 --2- 172.21.15.146:0/1667839247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4939f3bd0 0x55c493a1cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:03.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.075+0000 7fce9822ab80 1 --2- 172.21.15.146:0/1667839247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c4939f59a0 0x55c493a1aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:03.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.075+0000 7fce9822ab80 1 -- 172.21.15.146:0/1667839247 >> 172.21.15.146:0/1667839247 conn(0x55c4939f4070 msgr2=0x55c493a38f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:03.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.075+0000 7fce9822ab80 1 -- 172.21.15.146:0/1667839247 shutdown_connections 2023-10-06T11:06:03.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.075+0000 7fce9822ab80 1 -- 172.21.15.146:0/1667839247 wait complete. 2023-10-06T11:06:03.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.075+0000 7fce9822ab80 20 client.4668 trim_cache size 0 max 16384 2023-10-06T11:06:03.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.092+0000 7fce9822ab80 1 Processor -- start 2023-10-06T11:06:03.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.092+0000 7fce9822ab80 1 -- start start 2023-10-06T11:06:03.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.093+0000 7fce9822ab80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4939f3bd0 0x55c4939f4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:03.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.093+0000 7fce9822ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4939f59a0 0x55c4939f4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:03.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.093+0000 7fce9822ab80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c493a39a90 0x55c493a1aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:03.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.093+0000 7fce9822ab80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4937c5e30 con 0x55c4939f3bd0 2023-10-06T11:06:03.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.093+0000 7fce9822ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4939ed910 con 0x55c4939f59a0 2023-10-06T11:06:03.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.093+0000 7fce9822ab80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c493a48b20 con 0x55c493a39a90 2023-10-06T11:06:03.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.093+0000 7fce8ccce700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4939f3bd0 0x55c4939f4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:03.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.093+0000 7fce8ccce700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4939f3bd0 0x55c4939f4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47230/0 (socket says 172.21.15.146:47230) 2023-10-06T11:06:03.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.093+0000 7fce8ccce700 1 -- 172.21.15.146:0/713266600 learned_addr learned my addr 172.21.15.146:0/713266600 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:03.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.093+0000 7fce8ccce700 1 -- 172.21.15.146:0/713266600 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c493a39a90 msgr2=0x55c493a1aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:03.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.093+0000 7fce8ccce700 1 --2- 172.21.15.146:0/713266600 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c493a39a90 0x55c493a1aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:03.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.093+0000 7fce8ccce700 1 -- 172.21.15.146:0/713266600 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4939f59a0 msgr2=0x55c4939f4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:03.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.093+0000 7fce8ccce700 1 --2- 172.21.15.146:0/713266600 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4939f59a0 0x55c4939f4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:03.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.093+0000 7fce8ccce700 1 -- 172.21.15.146:0/713266600 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c493911780 con 0x55c4939f3bd0 2023-10-06T11:06:03.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.093+0000 7fce8ccce700 1 --2- 172.21.15.146:0/713266600 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4939f3bd0 0x55c4939f4440 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fce78017fd0 tx=0x7fce7801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1957bceb39097a39 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:03.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.093+0000 7fce6e7fc700 1 -- 172.21.15.146:0/713266600 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce780149a0 con 0x55c4939f3bd0 2023-10-06T11:06:03.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.093+0000 7fce6e7fc700 1 -- 172.21.15.146:0/713266600 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce78014b00 con 0x55c4939f3bd0 2023-10-06T11:06:03.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.093+0000 7fce6e7fc700 1 -- 172.21.15.146:0/713266600 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce78030600 con 0x55c4939f3bd0 2023-10-06T11:06:03.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.094+0000 7fce9822ab80 1 -- 172.21.15.146:0/713266600 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4939f3bd0 msgr2=0x55c4939f4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:03.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.094+0000 7fce9822ab80 1 --2- 172.21.15.146:0/713266600 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4939f3bd0 0x55c4939f4440 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fce78017fd0 tx=0x7fce7801f000 comp rx=0 tx=0).stop 2023-10-06T11:06:03.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.094+0000 7fce9822ab80 1 -- 172.21.15.146:0/713266600 shutdown_connections 2023-10-06T11:06:03.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.094+0000 7fce9822ab80 1 --2- 172.21.15.146:0/713266600 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c493a39a90 0x55c493a1aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:03.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.094+0000 7fce9822ab80 1 --2- 172.21.15.146:0/713266600 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c4939f3bd0 0x55c4939f4440 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:03.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.094+0000 7fce9822ab80 1 --2- 172.21.15.146:0/713266600 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4939f59a0 0x55c4939f4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:03.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.094+0000 7fce9822ab80 1 -- 172.21.15.146:0/713266600 >> 172.21.15.146:0/713266600 conn(0x55c4939f4070 msgr2=0x55c493a1cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:03.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.094+0000 7fce9822ab80 1 -- 172.21.15.146:0/713266600 shutdown_connections 2023-10-06T11:06:03.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.094+0000 7fce9822ab80 1 -- 172.21.15.146:0/713266600 wait complete. 2023-10-06T11:06:03.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.094+0000 7fce9822ab80 1 -- start start 2023-10-06T11:06:03.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.094+0000 7fce9822ab80 1 Processor -- start 2023-10-06T11:06:03.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.095+0000 7fce9822ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4939f3bd0 0x55c493a35aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:03.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.095+0000 7fce9822ab80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c4939f59a0 0x55c493a35fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:03.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.095+0000 7fce9822ab80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c493a39a90 0x55c493a21a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:03.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.095+0000 7fce9822ab80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c493a9f940 con 0x55c493a39a90 2023-10-06T11:06:03.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.095+0000 7fce9822ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4939efdb0 con 0x55c4939f3bd0 2023-10-06T11:06:03.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.095+0000 7fce9822ab80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c493a304e0 con 0x55c4939f59a0 2023-10-06T11:06:03.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.095+0000 7fce9822ab80 10 client.0 _ll_register_callbacks cb 0x55c4937dff30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:06:03.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.095+0000 7fce8d4cf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c493a39a90 0x55c493a21a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:03.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.095+0000 7fce8d4cf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c493a39a90 0x55c493a21a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47232/0 (socket says 172.21.15.146:47232) 2023-10-06T11:06:03.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.095+0000 7fce8d4cf700 1 -- 172.21.15.146:0/2490933134 learned_addr learned my addr 172.21.15.146:0/2490933134 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:03.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.095+0000 7fce87fff700 1 --2- 172.21.15.146:0/2490933134 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c4939f59a0 0x55c493a35fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:03.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.095+0000 7fce8ccce700 1 --2- 172.21.15.146:0/2490933134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4939f3bd0 0x55c493a35aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:03.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.096+0000 7fce8d4cf700 1 -- 172.21.15.146:0/2490933134 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c4939f59a0 msgr2=0x55c493a35fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:03.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.096+0000 7fce8d4cf700 1 --2- 172.21.15.146:0/2490933134 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c4939f59a0 0x55c493a35fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:03.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.096+0000 7fce8d4cf700 1 -- 172.21.15.146:0/2490933134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4939f3bd0 msgr2=0x55c493a35aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:03.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.096+0000 7fce8d4cf700 1 --2- 172.21.15.146:0/2490933134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4939f3bd0 0x55c493a35aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:03.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.096+0000 7fce8d4cf700 1 -- 172.21.15.146:0/2490933134 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c4937dd270 con 0x55c493a39a90 2023-10-06T11:06:03.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.096+0000 7fce8ccce700 1 --2- 172.21.15.146:0/2490933134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4939f3bd0 0x55c493a35aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:06:03.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.096+0000 7fce8d4cf700 1 --2- 172.21.15.146:0/2490933134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c493a39a90 0x55c493a21a50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fce80086670 tx=0x7fce8006d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dffa364c48204dd9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:03.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.096+0000 7fce66ffd700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:06:03.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.096+0000 7fce66ffd700 1 -- 172.21.15.146:0/2490933134 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8005a3b0 con 0x55c493a39a90 2023-10-06T11:06:03.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.096+0000 7fce66ffd700 1 -- 172.21.15.146:0/2490933134 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fce8005e100 con 0x55c493a39a90 2023-10-06T11:06:03.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.096+0000 7fce9822ab80 1 -- 172.21.15.146:0/2490933134 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fce78014830 con 0x55c493a39a90 2023-10-06T11:06:03.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.096+0000 7fce66ffd700 1 -- 172.21.15.146:0/2490933134 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce80057160 con 0x55c493a39a90 2023-10-06T11:06:03.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.096+0000 7fce9822ab80 10 client.4674 fetch_fsmap learned FSMap version 7 2023-10-06T11:06:03.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.096+0000 7fce9822ab80 1 -- 172.21.15.146:0/2490933134 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55c4938f8470 con 0x55c493a39a90 2023-10-06T11:06:03.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.096+0000 7fce66ffd700 1 -- 172.21.15.146:0/2490933134 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce80065080 con 0x55c493a39a90 2023-10-06T11:06:03.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.096+0000 7fce66ffd700 1 -- 172.21.15.146:0/2490933134 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 7) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fce8005dc70 con 0x55c493a39a90 2023-10-06T11:06:03.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.096+0000 7fce9822ab80 10 client.4674 fetch_fsmap finished waiting for FSMap version 7 2023-10-06T11:06:03.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.096+0000 7fce9822ab80 10 client.4674 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T11:06:03.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.096+0000 7fce9822ab80 20 client.4674 populate_metadata read hostname 'smithi146' 2023-10-06T11:06:03.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.096+0000 7fce9822ab80 1 --2- 172.21.15.146:0/2490933134 >> [v2:172.21.15.151:6832/1317728156,v1:172.21.15.151:6833/1317728156] conn(0x55c493a21f90 0x55c493a22360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:03.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.096+0000 7fce9822ab80 4 client.4674 mds_command: new command op to 4282 tid=0[{"prefix": "status"}] 2023-10-06T11:06:03.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.096+0000 7fce9822ab80 1 -- 172.21.15.146:0/2490933134 --> [v2:172.21.15.151:6832/1317728156,v1:172.21.15.151:6833/1317728156] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c4938e5e00 con 0x55c493a21f90 2023-10-06T11:06:03.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.096+0000 7fce8ccce700 1 --2- 172.21.15.146:0/2490933134 >> [v2:172.21.15.151:6832/1317728156,v1:172.21.15.151:6833/1317728156] conn(0x55c493a21f90 0x55c493a22360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:03.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.097+0000 7fce66ffd700 10 client.4674 ms_handle_connect on v2:172.21.15.151:6832/1317728156 2023-10-06T11:06:03.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.097+0000 7fce8ccce700 1 --2- 172.21.15.146:0/2490933134 >> [v2:172.21.15.151:6832/1317728156,v1:172.21.15.151:6833/1317728156] conn(0x55c493a21f90 0x55c493a22360 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce27df5f7ed7d40f server_cookie=489b574efa95fae9 in_seq=0 out_seq=0 2023-10-06T11:06:03.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.097+0000 7fce66ffd700 1 -- 172.21.15.146:0/2490933134 <== mds.0 v2:172.21.15.151:6832/1317728156 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55c4938e5e00 con 0x55c493a21f90 2023-10-06T11:06:03.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.097+0000 7fce66ffd700 10 client.4674 handle_command_reply: tid=0 2023-10-06T11:06:03.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.097+0000 7fce9822ab80 1 client.4674 shutdown 2023-10-06T11:06:03.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.097+0000 7fce9822ab80 1 -- 172.21.15.146:0/2490933134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c493a39a90 msgr2=0x55c493a21a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:03.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.097+0000 7fce9822ab80 1 --2- 172.21.15.146:0/2490933134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c493a39a90 0x55c493a21a50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fce80086670 tx=0x7fce8006d000 comp rx=0 tx=0).stop 2023-10-06T11:06:03.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.097+0000 7fce9822ab80 1 -- 172.21.15.146:0/2490933134 shutdown_connections 2023-10-06T11:06:03.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.097+0000 7fce9822ab80 1 --2- 172.21.15.146:0/2490933134 >> [v2:172.21.15.151:6832/1317728156,v1:172.21.15.151:6833/1317728156] conn(0x55c493a21f90 0x55c493a22360 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:03.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.097+0000 7fce9822ab80 1 --2- 172.21.15.146:0/2490933134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55c493a39a90 0x55c493a21a50 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:03.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.097+0000 7fce9822ab80 1 --2- 172.21.15.146:0/2490933134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4939f3bd0 0x55c493a35aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:03.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.097+0000 7fce9822ab80 1 --2- 172.21.15.146:0/2490933134 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55c4939f59a0 0x55c493a35fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:03.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.097+0000 7fce66ffd700 0 client.4674 ms_handle_reset on v2:172.21.15.151:6832/1317728156 2023-10-06T11:06:03.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.097+0000 7fce9822ab80 1 -- 172.21.15.146:0/2490933134 >> 172.21.15.146:0/2490933134 conn(0x55c4939f4070 msgr2=0x55c493a38650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:03.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.097+0000 7fce9822ab80 1 -- 172.21.15.146:0/2490933134 shutdown_connections 2023-10-06T11:06:03.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.097+0000 7fce9822ab80 1 -- 172.21.15.146:0/2490933134 wait complete. 2023-10-06T11:06:03.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.097+0000 7fce9822ab80 20 client.4674 trim_cache size 0 max 16384 2023-10-06T11:06:03.110 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:06:03.110 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1", 2023-10-06T11:06:03.110 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2023-10-06T11:06:03.111 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 4282, 2023-10-06T11:06:03.111 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2023-10-06T11:06:03.111 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2023-10-06T11:06:03.111 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2023-10-06T11:06:03.111 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 18.748711651000001, 2023-10-06T11:06:03.111 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 7, 2023-10-06T11:06:03.111 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 20, 2023-10-06T11:06:03.112 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 20, 2023-10-06T11:06:03.112 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 24.667302801000002 2023-10-06T11:06:03.112 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:06:03.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.098+0000 7fce8ef32700 1 -- 172.21.15.146:0/28466768 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fce74066f30 msgr2=0x7fce740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:03.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.098+0000 7fce8ef32700 1 --2- 172.21.15.146:0/28466768 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fce74066f30 0x7fce740693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fce88152f40 tx=0x7fce78009850 comp rx=0 tx=0).stop 2023-10-06T11:06:03.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.098+0000 7fce8ef32700 1 -- 172.21.15.146:0/28466768 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce8815a160 msgr2=0x7fce8815fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:03.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.098+0000 7fce8ef32700 1 --2- 172.21.15.146:0/28466768 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce8815a160 0x7fce8815fba0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fce88088c60 tx=0x7fce80017000 comp rx=0 tx=0).stop 2023-10-06T11:06:03.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.098+0000 7fce8ef32700 1 -- 172.21.15.146:0/28466768 shutdown_connections 2023-10-06T11:06:03.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.098+0000 7fce8ef32700 1 --2- 172.21.15.146:0/28466768 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fce74066f30 0x7fce740693e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:03.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.098+0000 7fce8ef32700 1 --2- 172.21.15.146:0/28466768 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fce8815a160 0x7fce8815fba0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:03.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.098+0000 7fce8ef32700 1 --2- 172.21.15.146:0/28466768 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce880ae730 0x7fce881594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:03.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.098+0000 7fce8ef32700 1 --2- 172.21.15.146:0/28466768 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fce880ce3d0 0x7fce88155d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:03.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.098+0000 7fce8ef32700 1 -- 172.21.15.146:0/28466768 >> 172.21.15.146:0/28466768 conn(0x7fce8806f380 msgr2=0x7fce880ccdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:03.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.098+0000 7fce8ef32700 1 -- 172.21.15.146:0/28466768 shutdown_connections 2023-10-06T11:06:03.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.098+0000 7fce8ef32700 1 -- 172.21.15.146:0/28466768 wait complete. 2023-10-06T11:06:03.115 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-10-06T11:06:03.140 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-10-06T11:06:03.140 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-06T11:06:03.140 INFO:tasks.ceph_fuse:client.0 config is {} 2023-10-06T11:06:03.140 INFO:tasks.ceph_fuse:client.2 config is {} 2023-10-06T11:06:03.141 INFO:tasks.ceph_fuse:client.1 config is {} 2023-10-06T11:06:03.141 INFO:tasks.ceph_fuse:client.3 config is {} 2023-10-06T11:06:03.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:03.141 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-10-06T11:06:03.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:03.160 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link delete ceph-brx 2023-10-06T11:06:03.232 INFO:teuthology.orchestra.run.smithi151.stderr:Cannot find device "ceph-brx" 2023-10-06T11:06:03.233 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:06:03.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:03.234 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-10-06T11:06:03.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:03.249 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link delete ceph-brx 2023-10-06T11:06:03.316 INFO:teuthology.orchestra.run.smithi146.stderr:Cannot find device "ceph-brx" 2023-10-06T11:06:03.317 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:06:03.317 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-10-06T11:06:03.318 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T11:06:03.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.472+0000 7f80ac728700 1 Processor -- start 2023-10-06T11:06:03.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.472+0000 7f80ac728700 1 -- start start 2023-10-06T11:06:03.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.473+0000 7f80ac728700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f80a4153ab0 0x7f80a415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:03.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.473+0000 7f80ac728700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80a4068ba0 0x7f80a40b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:03.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.473+0000 7f80ac728700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80a415ac30 con 0x7f80a4153e80 2023-10-06T11:06:03.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.473+0000 7f80ac728700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80a40b4510 con 0x7f80a4153ab0 2023-10-06T11:06:03.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.473+0000 7f80ac728700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a40b6530 con 0x7f80a4068ba0 2023-10-06T11:06:03.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.473+0000 7f80aacc5700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80a4068ba0 0x7f80a40b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:03.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.473+0000 7f80aa4c4700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f80a4153ab0 0x7f80a415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:03.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.473+0000 7f80a9cc3700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f80a4153e80 0x7f80a4068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:41330/0 (socket says 172.21.15.146:41330) 2023-10-06T11:06:03.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.473+0000 7f80a9cc3700 1 -- 172.21.15.146:0/3069639459 learned_addr learned my addr 172.21.15.146:0/3069639459 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:03.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.474+0000 7f80a94c2700 1 -- 172.21.15.146:0/3069639459 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3101896884 0 0) 0x7f8094001110 con 0x7f80a4153e80 2023-10-06T11:06:03.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.474+0000 7f80a94c2700 1 -- 172.21.15.146:0/3069639459 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8090003570 con 0x7f80a4153e80 2023-10-06T11:06:03.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.474+0000 7f80aacc5700 1 -- 172.21.15.146:0/3069639459 >> v2:172.21.15.151:3300/0 conn(0x7f80a4153ab0 msgr2=0x7f80a415a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:03.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.474+0000 7f80aacc5700 1 --2- 172.21.15.146:0/3069639459 >> v2:172.21.15.151:3300/0 conn(0x7f80a4153ab0 0x7f80a415a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:03.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.474+0000 7f80aacc5700 1 -- 172.21.15.146:0/3069639459 >> v1:172.21.15.151:6789/0 conn(0x7f80a4153e80 legacy=0x7f80a4068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:03.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.474+0000 7f80aacc5700 1 -- 172.21.15.146:0/3069639459 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a40b5c50 con 0x7f80a4068ba0 2023-10-06T11:06:03.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.474+0000 7f80aacc5700 1 --2- 172.21.15.146:0/3069639459 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80a4068ba0 0x7f80a40b49a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f809c0098e0 tx=0x7f809c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9949788867ed19bc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:03.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.474+0000 7f80a94c2700 1 -- 172.21.15.146:0/3069639459 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c011630 con 0x7f80a4068ba0 2023-10-06T11:06:03.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.474+0000 7f80a94c2700 1 -- 172.21.15.146:0/3069639459 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809c011790 con 0x7f80a4068ba0 2023-10-06T11:06:03.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.474+0000 7f80a94c2700 1 -- 172.21.15.146:0/3069639459 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c011b10 con 0x7f80a4068ba0 2023-10-06T11:06:03.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.475+0000 7f80ac728700 1 -- 172.21.15.146:0/3069639459 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80a4068ba0 msgr2=0x7f80a40b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:03.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.475+0000 7f80ac728700 1 --2- 172.21.15.146:0/3069639459 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80a4068ba0 0x7f80a40b49a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f809c0098e0 tx=0x7f809c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:06:03.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.475+0000 7f80ac728700 1 -- 172.21.15.146:0/3069639459 shutdown_connections 2023-10-06T11:06:03.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.475+0000 7f80ac728700 1 --2- 172.21.15.146:0/3069639459 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80a4068ba0 0x7f80a40b49a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:03.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.475+0000 7f80ac728700 1 --2- 172.21.15.146:0/3069639459 >> v2:172.21.15.151:3300/0 conn(0x7f80a4153ab0 0x7f80a415a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:03.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.475+0000 7f80ac728700 1 -- 172.21.15.146:0/3069639459 >> 172.21.15.146:0/3069639459 conn(0x7f80a406eba0 msgr2=0x7f80a406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:03.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.475+0000 7f80ac728700 1 -- 172.21.15.146:0/3069639459 shutdown_connections 2023-10-06T11:06:03.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.475+0000 7f80ac728700 1 -- 172.21.15.146:0/3069639459 wait complete. 2023-10-06T11:06:03.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.476+0000 7f80ac728700 1 Processor -- start 2023-10-06T11:06:03.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.476+0000 7f80ac728700 1 -- start start 2023-10-06T11:06:03.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.477+0000 7f80ac728700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80a4068ba0 0x7f80a413e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:03.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.477+0000 7f80ac728700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80a4153ab0 0x7f80a415e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:03.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.477+0000 7f80ac728700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80a4153e80 0x7f80a415e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:03.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.477+0000 7f80ac728700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a4151620 con 0x7f80a4068ba0 2023-10-06T11:06:03.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.477+0000 7f80ac728700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a4155ed0 con 0x7f80a4153e80 2023-10-06T11:06:03.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.477+0000 7f80ac728700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a4156490 con 0x7f80a4153ab0 2023-10-06T11:06:03.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.477+0000 7f80aa4c4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80a4068ba0 0x7f80a413e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:03.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.477+0000 7f80aa4c4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80a4068ba0 0x7f80a413e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47242/0 (socket says 172.21.15.146:47242) 2023-10-06T11:06:03.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.477+0000 7f80aa4c4700 1 -- 172.21.15.146:0/204318713 learned_addr learned my addr 172.21.15.146:0/204318713 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:03.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.477+0000 7f80a9cc3700 1 --2- 172.21.15.146:0/204318713 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80a4153ab0 0x7f80a415e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:03.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.477+0000 7f80aacc5700 1 --2- 172.21.15.146:0/204318713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80a4153e80 0x7f80a415e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:03.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.477+0000 7f80aa4c4700 1 -- 172.21.15.146:0/204318713 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80a4153ab0 msgr2=0x7f80a415e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:03.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.477+0000 7f80aa4c4700 1 --2- 172.21.15.146:0/204318713 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80a4153ab0 0x7f80a415e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:03.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.477+0000 7f80aa4c4700 1 -- 172.21.15.146:0/204318713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80a4153e80 msgr2=0x7f80a415e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:03.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.477+0000 7f80aa4c4700 1 --2- 172.21.15.146:0/204318713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80a4153e80 0x7f80a415e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:03.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.477+0000 7f80aa4c4700 1 -- 172.21.15.146:0/204318713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f809c009420 con 0x7f80a4068ba0 2023-10-06T11:06:03.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.477+0000 7f80aa4c4700 1 --2- 172.21.15.146:0/204318713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80a4068ba0 0x7f80a413e730 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f80a0009f20 tx=0x7f80a000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:03.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.477+0000 7f809a7fc700 1 -- 172.21.15.146:0/204318713 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a000cb70 con 0x7f80a4068ba0 2023-10-06T11:06:03.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.477+0000 7f809a7fc700 1 -- 172.21.15.146:0/204318713 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a000f040 con 0x7f80a4068ba0 2023-10-06T11:06:03.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.477+0000 7f809a7fc700 1 -- 172.21.15.146:0/204318713 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a0014480 con 0x7f80a4068ba0 2023-10-06T11:06:03.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.477+0000 7f80ac728700 1 -- 172.21.15.146:0/204318713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80a4154ed0 con 0x7f80a4068ba0 2023-10-06T11:06:03.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.477+0000 7f80ac728700 1 -- 172.21.15.146:0/204318713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80a4156120 con 0x7f80a4068ba0 2023-10-06T11:06:03.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.478+0000 7f80ac728700 1 -- 172.21.15.146:0/204318713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80a404c380 con 0x7f80a4068ba0 2023-10-06T11:06:03.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.479+0000 7f809a7fc700 1 -- 172.21.15.146:0/204318713 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f80a00147f0 con 0x7f80a4068ba0 2023-10-06T11:06:03.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.479+0000 7f809a7fc700 1 --2- 172.21.15.146:0/204318713 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8088066f30 0x7f80880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:03.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.479+0000 7f809a7fc700 1 -- 172.21.15.146:0/204318713 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f80a0085040 con 0x7f80a4068ba0 2023-10-06T11:06:03.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.479+0000 7f80a9cc3700 1 --2- 172.21.15.146:0/204318713 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8088066f30 0x7f80880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:03.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.479+0000 7f80a9cc3700 1 --2- 172.21.15.146:0/204318713 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8088066f30 0x7f80880693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f80a41588c0 tx=0x7f8094007bf0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:03.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.483+0000 7f809a7fc700 1 -- 172.21.15.146:0/204318713 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f80a0052150 con 0x7f80a4068ba0 2023-10-06T11:06:03.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.709+0000 7f80ac728700 1 -- 172.21.15.146:0/204318713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f80a40b6250 con 0x7f80a4068ba0 2023-10-06T11:06:03.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.709+0000 7f809a7fc700 1 -- 172.21.15.146:0/204318713 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f80a0055770 con 0x7f80a4068ba0 2023-10-06T11:06:03.711 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T11:06:03.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.711+0000 7f80ac728700 1 -- 172.21.15.146:0/204318713 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8088066f30 msgr2=0x7f80880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:03.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.711+0000 7f80ac728700 1 --2- 172.21.15.146:0/204318713 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8088066f30 0x7f80880693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f80a41588c0 tx=0x7f8094007bf0 comp rx=0 tx=0).stop 2023-10-06T11:06:03.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.711+0000 7f80ac728700 1 -- 172.21.15.146:0/204318713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80a4068ba0 msgr2=0x7f80a413e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:03.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.711+0000 7f80ac728700 1 --2- 172.21.15.146:0/204318713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80a4068ba0 0x7f80a413e730 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f80a0009f20 tx=0x7f80a000b040 comp rx=0 tx=0).stop 2023-10-06T11:06:03.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.711+0000 7f80ac728700 1 -- 172.21.15.146:0/204318713 shutdown_connections 2023-10-06T11:06:03.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.711+0000 7f80ac728700 1 --2- 172.21.15.146:0/204318713 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8088066f30 0x7f80880693e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:03.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.711+0000 7f80ac728700 1 --2- 172.21.15.146:0/204318713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80a4153e80 0x7f80a415e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:03.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.711+0000 7f80ac728700 1 --2- 172.21.15.146:0/204318713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80a4068ba0 0x7f80a413e730 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:03.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.711+0000 7f80ac728700 1 --2- 172.21.15.146:0/204318713 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80a4153ab0 0x7f80a415e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:03.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.712+0000 7f80ac728700 1 -- 172.21.15.146:0/204318713 >> 172.21.15.146:0/204318713 conn(0x7f80a406eba0 msgr2=0x7f80a41532a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:03.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.712+0000 7f80ac728700 1 -- 172.21.15.146:0/204318713 shutdown_connections 2023-10-06T11:06:03.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:03.712+0000 7f80ac728700 1 -- 172.21.15.146:0/204318713 wait complete. 2023-10-06T11:06:03.725 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T11:06:03.725 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T11:06:03.725 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2023-10-06T11:06:03.725 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T11:06:03.725 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T11:06:03.725 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T11:06:03.726 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T11:06:03.726 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T11:06:03.726 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:06:03.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:03.726 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2023-10-06T11:06:03.741 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:06:03.741 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:06:03.741 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:06:03.741 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:06:03.741 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2023-10-06T11:06:03.741 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:06:03.741 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:06:03.741 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2023-10-06T11:06:03.741 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2023-10-06T11:06:03.742 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:06:03.742 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2023-10-06T11:06:03.742 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2023-10-06T11:06:03.742 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:06:03.742 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2023-10-06T11:06:03.742 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T11:06:03.742 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2023-10-06T11:06:03.742 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T11:06:03.742 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42493sec preferred_lft 42493sec 2023-10-06T11:06:03.742 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link noprefixroute 2023-10-06T11:06:03.742 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:06:03.743 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T11:06:03.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:03.744 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-10-06T11:06:03.744 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:06:03.744 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link add name ceph-brx type bridge 2023-10-06T11:06:03.744 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip addr flush dev ceph-brx 2023-10-06T11:06:03.744 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set ceph-brx up 2023-10-06T11:06:03.744 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T11:06:03.744 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:06:03.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:03.903 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T11:06:03.944 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-06T11:06:03.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:03.946 DEBUG:teuthology.orchestra.run.smithi146:> route 2023-10-06T11:06:04.016 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2023-10-06T11:06:04.016 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T11:06:04.017 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T11:06:04.017 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T11:06:04.017 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T11:06:04.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:04.017 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-10-06T11:06:04.017 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:06:04.017 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T11:06:04.018 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T11:06:04.018 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T11:06:04.018 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:06:04.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:04.277 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-10-06T11:06:04.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:04.292 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list-id 2023-10-06T11:06:04.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:04.346 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-10-06T11:06:04.346 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:06:04.347 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T11:06:04.347 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-06T11:06:04.347 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:06:04.435 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-06T11:06:04.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:04.436 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-10-06T11:06:04.436 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:06:04.436 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-06T11:06:04.436 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T11:06:04.436 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-06T11:06:04.436 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-06T11:06:04.436 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-06T11:06:04.437 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:06:04.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:04.624 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-10-06T11:06:04.624 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:06:04.624 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2023-10-06T11:06:04.624 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T11:06:04.624 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:06:04.716 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T11:06:04.717 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:06:04.717 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T11:06:04.732 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:06:04.733 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:06:04.733 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:06:04.787 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-06T11:06:04.852 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:06:04.852 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:06:04.916 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:06:04.917 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:06:04.917 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:06:04.917 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-06T11:06:04.973 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T11:06:04.973 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T11:06:05.017 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-06T11:06:05.042 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:06:05.042 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:06:05.110 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:06:05.111 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:06:05.111 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:06:05.111 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-06T11:06:05.119 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:2023-10-06T11:06:05.118+0000 7fdbe21a6540 -1 init, newargv = 0x561c4b609960 newargc=15 2023-10-06T11:06:05.119 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[99781]: starting ceph client 2023-10-06T11:06:05.125 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[99781]: starting fuse 2023-10-06T11:06:05.133 INFO:teuthology.orchestra.run.smithi146.stdout:46 2023-10-06T11:06:05.134 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-06T11:06:05.134 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T11:06:05.134 DEBUG:teuthology.orchestra.run.smithi146:> import glob 2023-10-06T11:06:05.134 DEBUG:teuthology.orchestra.run.smithi146:> import re 2023-10-06T11:06:05.134 DEBUG:teuthology.orchestra.run.smithi146:> import os 2023-10-06T11:06:05.134 DEBUG:teuthology.orchestra.run.smithi146:> import subprocess 2023-10-06T11:06:05.134 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:06:05.134 DEBUG:teuthology.orchestra.run.smithi146:> def _find_admin_socket(client_name): 2023-10-06T11:06:05.134 DEBUG:teuthology.orchestra.run.smithi146:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T11:06:05.135 DEBUG:teuthology.orchestra.run.smithi146:> files = glob.glob(asok_path) 2023-10-06T11:06:05.135 DEBUG:teuthology.orchestra.run.smithi146:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T11:06:05.135 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:06:05.135 DEBUG:teuthology.orchestra.run.smithi146:> # Given a non-glob path, it better be there 2023-10-06T11:06:05.135 DEBUG:teuthology.orchestra.run.smithi146:> if "*" not in asok_path: 2023-10-06T11:06:05.135 DEBUG:teuthology.orchestra.run.smithi146:> assert(len(files) == 1) 2023-10-06T11:06:05.135 DEBUG:teuthology.orchestra.run.smithi146:> return files[0] 2023-10-06T11:06:05.135 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:06:05.135 DEBUG:teuthology.orchestra.run.smithi146:> for f in files: 2023-10-06T11:06:05.135 DEBUG:teuthology.orchestra.run.smithi146:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T11:06:05.135 DEBUG:teuthology.orchestra.run.smithi146:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T11:06:05.135 DEBUG:teuthology.orchestra.run.smithi146:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T11:06:05.136 DEBUG:teuthology.orchestra.run.smithi146:> contents = proc_f.read() 2023-10-06T11:06:05.136 DEBUG:teuthology.orchestra.run.smithi146:> if mountpoint in contents: 2023-10-06T11:06:05.136 DEBUG:teuthology.orchestra.run.smithi146:> return f 2023-10-06T11:06:05.136 DEBUG:teuthology.orchestra.run.smithi146:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T11:06:05.136 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:06:05.136 DEBUG:teuthology.orchestra.run.smithi146:> print(_find_admin_socket("client.0")) 2023-10-06T11:06:05.136 DEBUG:teuthology.orchestra.run.smithi146:> ' 2023-10-06T11:06:05.254 INFO:teuthology.orchestra.run.smithi146.stdout:/var/run/ceph/ceph-client.0.99781.asok 2023-10-06T11:06:05.437 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.99781.asok 2023-10-06T11:06:05.437 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:06:05.437 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.99781.asok status 2023-10-06T11:06:05.589 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:06:05.589 INFO:teuthology.orchestra.run.smithi146.stdout: "metadata": { 2023-10-06T11:06:05.589 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T11:06:05.589 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T11:06:05.590 INFO:teuthology.orchestra.run.smithi146.stdout: "entity_id": "0", 2023-10-06T11:06:05.590 INFO:teuthology.orchestra.run.smithi146.stdout: "hostname": "smithi146", 2023-10-06T11:06:05.590 INFO:teuthology.orchestra.run.smithi146.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T11:06:05.590 INFO:teuthology.orchestra.run.smithi146.stdout: "pid": "99781", 2023-10-06T11:06:05.590 INFO:teuthology.orchestra.run.smithi146.stdout: "root": "/" 2023-10-06T11:06:05.590 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:06:05.591 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_count": 0, 2023-10-06T11:06:05.591 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_pinned_count": 0, 2023-10-06T11:06:05.591 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 4686, 2023-10-06T11:06:05.591 INFO:teuthology.orchestra.run.smithi146.stdout: "inst": { 2023-10-06T11:06:05.591 INFO:teuthology.orchestra.run.smithi146.stdout: "name": { 2023-10-06T11:06:05.591 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "client", 2023-10-06T11:06:05.591 INFO:teuthology.orchestra.run.smithi146.stdout: "num": 4686 2023-10-06T11:06:05.591 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:06:05.591 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-06T11:06:05.592 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-06T11:06:05.592 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:06:05.592 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 3670995301 2023-10-06T11:06:05.592 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:06:05.592 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:06:05.592 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-06T11:06:05.592 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-06T11:06:05.592 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:06:05.592 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 3670995301 2023-10-06T11:06:05.592 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:06:05.593 INFO:teuthology.orchestra.run.smithi146.stdout: "inst_str": "client.4686 192.168.0.1:0/3670995301", 2023-10-06T11:06:05.593 INFO:teuthology.orchestra.run.smithi146.stdout: "addr_str": "192.168.0.1:0/3670995301", 2023-10-06T11:06:05.593 INFO:teuthology.orchestra.run.smithi146.stdout: "inode_count": 1, 2023-10-06T11:06:05.593 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_epoch": 7, 2023-10-06T11:06:05.593 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch": 20, 2023-10-06T11:06:05.593 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch_barrier": 0, 2023-10-06T11:06:05.593 INFO:teuthology.orchestra.run.smithi146.stdout: "blocklisted": false, 2023-10-06T11:06:05.593 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs" 2023-10-06T11:06:05.593 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:06:05.599 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T11:06:05.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.712+0000 7f2af9c98700 1 Processor -- start 2023-10-06T11:06:05.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.712+0000 7f2af9c98700 1 -- start start 2023-10-06T11:06:05.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.713+0000 7f2af9c98700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2af4153e80 0x7f2af415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:05.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.713+0000 7f2af9c98700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2af415ac30 con 0x7f2af4068ba0 2023-10-06T11:06:05.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.713+0000 7f2af9c98700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2af40b4510 con 0x7f2af4153ab0 2023-10-06T11:06:05.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.713+0000 7f2af9c98700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2af40b6530 con 0x7f2af4153e80 2023-10-06T11:06:05.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.713+0000 7f2af3fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2af4153e80 0x7f2af415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:05.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.713+0000 7f2af2ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2af4068ba0 0x7f2af40b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60278/0 (socket says 172.21.15.146:60278) 2023-10-06T11:06:05.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.713+0000 7f2af3fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2af4153e80 0x7f2af415a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47258/0 (socket says 172.21.15.146:47258) 2023-10-06T11:06:05.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.713+0000 7f2af2ffd700 1 -- 172.21.15.146:0/92136465 learned_addr learned my addr 172.21.15.146:0/92136465 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:05.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.714+0000 7f2af3fff700 1 -- 172.21.15.146:0/92136465 >> v1:172.21.15.151:6789/0 conn(0x7f2af4153ab0 legacy=0x7f2af4068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:05.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.714+0000 7f2af3fff700 1 -- 172.21.15.146:0/92136465 >> v1:172.21.15.146:6789/0 conn(0x7f2af4068ba0 legacy=0x7f2af40b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:05.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.714+0000 7f2af3fff700 1 -- 172.21.15.146:0/92136465 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af40b5c50 con 0x7f2af4153e80 2023-10-06T11:06:05.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.714+0000 7f2af27fc700 1 -- 172.21.15.146:0/92136465 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 19974421 0 0) 0x7f2ae8001110 con 0x7f2af4068ba0 2023-10-06T11:06:05.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.714+0000 7f2af3fff700 1 --2- 172.21.15.146:0/92136465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2af4153e80 0x7f2af415a6f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2aec009e60 tx=0x7f2aec009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d46031191cf1668f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:05.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.714+0000 7f2af27fc700 1 -- 172.21.15.146:0/92136465 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec00e070 con 0x7f2af4153e80 2023-10-06T11:06:05.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.714+0000 7f2af27fc700 1 -- 172.21.15.146:0/92136465 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aec00bc30 con 0x7f2af4153e80 2023-10-06T11:06:05.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.714+0000 7f2af27fc700 1 -- 172.21.15.146:0/92136465 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec012430 con 0x7f2af4153e80 2023-10-06T11:06:05.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.714+0000 7f2af9c98700 1 -- 172.21.15.146:0/92136465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2af4153e80 msgr2=0x7f2af415a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:05.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.714+0000 7f2af9c98700 1 --2- 172.21.15.146:0/92136465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2af4153e80 0x7f2af415a6f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2aec009e60 tx=0x7f2aec009780 comp rx=0 tx=0).stop 2023-10-06T11:06:05.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.714+0000 7f2af9c98700 1 -- 172.21.15.146:0/92136465 shutdown_connections 2023-10-06T11:06:05.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.714+0000 7f2af9c98700 1 --2- 172.21.15.146:0/92136465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2af4153e80 0x7f2af415a6f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:05.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.714+0000 7f2af9c98700 1 -- 172.21.15.146:0/92136465 >> 172.21.15.146:0/92136465 conn(0x7f2af406eba0 msgr2=0x7f2af406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:05.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.715+0000 7f2af9c98700 1 -- 172.21.15.146:0/92136465 shutdown_connections 2023-10-06T11:06:05.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.715+0000 7f2af9c98700 1 -- 172.21.15.146:0/92136465 wait complete. 2023-10-06T11:06:05.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.716+0000 7f2af9c98700 1 Processor -- start 2023-10-06T11:06:05.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.716+0000 7f2af9c98700 1 -- start start 2023-10-06T11:06:05.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.716+0000 7f2af9c98700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2af4068ba0 0x7f2af413e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:05.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.716+0000 7f2af9c98700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2af4153ab0 0x7f2af4158ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:05.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.716+0000 7f2af9c98700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2af4153e80 0x7f2af40ce950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:05.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.716+0000 7f2af9c98700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af416b820 con 0x7f2af4153e80 2023-10-06T11:06:05.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.716+0000 7f2af9c98700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af413eb20 con 0x7f2af4153ab0 2023-10-06T11:06:05.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.716+0000 7f2af9c98700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af416ac10 con 0x7f2af4068ba0 2023-10-06T11:06:05.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.717+0000 7f2af3fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2af4153e80 0x7f2af40ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:05.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.717+0000 7f2af3fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2af4153e80 0x7f2af40ce950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47266/0 (socket says 172.21.15.146:47266) 2023-10-06T11:06:05.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.717+0000 7f2af3fff700 1 -- 172.21.15.146:0/1741664555 learned_addr learned my addr 172.21.15.146:0/1741664555 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:05.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.717+0000 7f2af2ffd700 1 --2- 172.21.15.146:0/1741664555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2af4153ab0 0x7f2af4158ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:05.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.717+0000 7f2af3fff700 1 -- 172.21.15.146:0/1741664555 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2af4068ba0 msgr2=0x7f2af413e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:05.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.717+0000 7f2af37fe700 1 --2- 172.21.15.146:0/1741664555 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2af4068ba0 0x7f2af413e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:05.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.717+0000 7f2af3fff700 1 --2- 172.21.15.146:0/1741664555 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2af4068ba0 0x7f2af413e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:05.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.717+0000 7f2af3fff700 1 -- 172.21.15.146:0/1741664555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2af4153ab0 msgr2=0x7f2af4158ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:05.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.717+0000 7f2af3fff700 1 --2- 172.21.15.146:0/1741664555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2af4153ab0 0x7f2af4158ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:05.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.717+0000 7f2af3fff700 1 -- 172.21.15.146:0/1741664555 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aec009a20 con 0x7f2af4153e80 2023-10-06T11:06:05.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.717+0000 7f2af2ffd700 1 --2- 172.21.15.146:0/1741664555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2af4153ab0 0x7f2af4158ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:06:05.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.717+0000 7f2af37fe700 1 --2- 172.21.15.146:0/1741664555 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2af4068ba0 0x7f2af413e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:06:05.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.717+0000 7f2af3fff700 1 --2- 172.21.15.146:0/1741664555 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2af4153e80 0x7f2af40ce950 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2aec003000 tx=0x7f2aec018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:05.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.717+0000 7f2adb7fe700 1 -- 172.21.15.146:0/1741664555 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec01e640 con 0x7f2af4153e80 2023-10-06T11:06:05.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.717+0000 7f2adb7fe700 1 -- 172.21.15.146:0/1741664555 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aec01e7c0 con 0x7f2af4153e80 2023-10-06T11:06:05.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.717+0000 7f2af9c98700 1 -- 172.21.15.146:0/1741664555 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2af416aef0 con 0x7f2af4153e80 2023-10-06T11:06:05.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.717+0000 7f2adb7fe700 1 -- 172.21.15.146:0/1741664555 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec01eb80 con 0x7f2af4153e80 2023-10-06T11:06:05.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.717+0000 7f2af9c98700 1 -- 172.21.15.146:0/1741664555 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2af416b4b0 con 0x7f2af4153e80 2023-10-06T11:06:05.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.718+0000 7f2af9c98700 1 -- 172.21.15.146:0/1741664555 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2af404c380 con 0x7f2af4153e80 2023-10-06T11:06:05.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.718+0000 7f2adb7fe700 1 -- 172.21.15.146:0/1741664555 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2aec024070 con 0x7f2af4153e80 2023-10-06T11:06:05.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.719+0000 7f2adb7fe700 1 --2- 172.21.15.146:0/1741664555 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2ae0066f30 0x7f2ae00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:05.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.719+0000 7f2adb7fe700 1 -- 172.21.15.146:0/1741664555 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2aec0872b0 con 0x7f2af4153e80 2023-10-06T11:06:05.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.719+0000 7f2af37fe700 1 --2- 172.21.15.146:0/1741664555 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2ae0066f30 0x7f2ae00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:05.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.719+0000 7f2af37fe700 1 --2- 172.21.15.146:0/1741664555 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2ae0066f30 0x7f2ae00693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2af40b2810 tx=0x7f2ae4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:05.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.723+0000 7f2adb7fe700 1 -- 172.21.15.146:0/1741664555 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2aec054470 con 0x7f2af4153e80 2023-10-06T11:06:05.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.951+0000 7f2af9c98700 1 -- 172.21.15.146:0/1741664555 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2af416b960 con 0x7f2af4153e80 2023-10-06T11:06:05.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.951+0000 7f2adb7fe700 1 -- 172.21.15.146:0/1741664555 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2aec057a90 con 0x7f2af4153e80 2023-10-06T11:06:05.954 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T11:06:05.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.953+0000 7f2af9c98700 1 -- 172.21.15.146:0/1741664555 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2ae0066f30 msgr2=0x7f2ae00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:05.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.953+0000 7f2af9c98700 1 --2- 172.21.15.146:0/1741664555 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2ae0066f30 0x7f2ae00693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2af40b2810 tx=0x7f2ae4009040 comp rx=0 tx=0).stop 2023-10-06T11:06:05.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.953+0000 7f2af9c98700 1 -- 172.21.15.146:0/1741664555 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2af4153e80 msgr2=0x7f2af40ce950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:05.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.953+0000 7f2af9c98700 1 --2- 172.21.15.146:0/1741664555 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2af4153e80 0x7f2af40ce950 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2aec003000 tx=0x7f2aec018000 comp rx=0 tx=0).stop 2023-10-06T11:06:05.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.954+0000 7f2af9c98700 1 -- 172.21.15.146:0/1741664555 shutdown_connections 2023-10-06T11:06:05.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.954+0000 7f2af9c98700 1 --2- 172.21.15.146:0/1741664555 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2ae0066f30 0x7f2ae00693e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:05.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.954+0000 7f2af9c98700 1 --2- 172.21.15.146:0/1741664555 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2af4153e80 0x7f2af40ce950 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:05.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.954+0000 7f2af9c98700 1 --2- 172.21.15.146:0/1741664555 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2af4068ba0 0x7f2af413e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:05.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.954+0000 7f2af9c98700 1 --2- 172.21.15.146:0/1741664555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2af4153ab0 0x7f2af4158ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:05.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.954+0000 7f2af9c98700 1 -- 172.21.15.146:0/1741664555 >> 172.21.15.146:0/1741664555 conn(0x7f2af406eba0 msgr2=0x7f2af415add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:05.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.954+0000 7f2af9c98700 1 -- 172.21.15.146:0/1741664555 shutdown_connections 2023-10-06T11:06:05.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:05.954+0000 7f2af9c98700 1 -- 172.21.15.146:0/1741664555 wait complete. 2023-10-06T11:06:05.967 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T11:06:05.967 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T11:06:05.967 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2023-10-06T11:06:05.967 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-06T11:06:05.967 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-06T11:06:05.968 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T11:06:05.968 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T11:06:05.968 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T11:06:05.968 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-06T11:06:05.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:05.968 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2023-10-06T11:06:05.983 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:06:05.983 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:06:05.983 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:06:05.983 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:06:05.983 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2023-10-06T11:06:05.983 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:06:05.984 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:06:05.984 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2023-10-06T11:06:05.984 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2023-10-06T11:06:05.984 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:06:05.984 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2023-10-06T11:06:05.984 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2023-10-06T11:06:05.984 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:06:05.984 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2023-10-06T11:06:05.984 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T11:06:05.984 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2023-10-06T11:06:05.984 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T11:06:05.984 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42491sec preferred_lft 42491sec 2023-10-06T11:06:05.984 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link noprefixroute 2023-10-06T11:06:05.985 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:06:05.985 INFO:teuthology.orchestra.run.smithi146.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T11:06:05.985 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0e:4f:33:80:c4:0e brd ff:ff:ff:ff:ff:ff 2023-10-06T11:06:05.985 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T11:06:05.985 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:06:05.985 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3884:6eff:fefc:ffc7/64 scope link 2023-10-06T11:06:05.985 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:06:05.985 INFO:teuthology.orchestra.run.smithi146.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:06:05.985 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0e:4f:33:80:c4:0e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T11:06:05.985 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::c4f:33ff:fe80:c40e/64 scope link tentative 2023-10-06T11:06:05.985 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:06:05.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:05.986 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T11:06:06.046 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-06T11:06:06.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:06.048 DEBUG:teuthology.orchestra.run.smithi146:> route 2023-10-06T11:06:06.105 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2023-10-06T11:06:06.105 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T11:06:06.105 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T11:06:06.105 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T11:06:06.105 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T11:06:06.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:06.106 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-10-06T11:06:06.106 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:06:06.106 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T11:06:06.106 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T11:06:06.106 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T11:06:06.106 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:06:06.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:06.205 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-10-06T11:06:06.220 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T11:06:06.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:06.220 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list-id 2023-10-06T11:06:06.274 INFO:teuthology.orchestra.run.smithi146.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-06T11:06:06.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:06.275 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-10-06T11:06:06.275 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:06:06.275 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T11:06:06.275 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-06T11:06:06.276 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:06:06.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:06.362 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T11:06:06.394 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:06:06.394 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:06:06.394 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:06:06.394 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:06:06.394 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2023-10-06T11:06:06.394 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:06:06.395 INFO:teuthology.orchestra.run.smithi146.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T11:06:06.395 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 46:c5:93:98:23:8b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T11:06:06.395 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T11:06:06.395 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:06:06.395 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::44c5:93ff:fe98:238b/64 scope link 2023-10-06T11:06:06.395 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:06:06.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:06.407 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T11:06:06.483 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:06:06.483 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:06:06.483 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:06:06.483 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:06:06.484 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2023-10-06T11:06:06.484 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:06:06.484 INFO:teuthology.orchestra.run.smithi146.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T11:06:06.484 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 46:c5:93:98:23:8b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T11:06:06.484 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T11:06:06.484 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:06:06.484 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::44c5:93ff:fe98:238b/64 scope link 2023-10-06T11:06:06.484 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:06:06.497 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-06T11:06:06.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:06.497 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-10-06T11:06:06.498 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:06:06.498 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-06T11:06:06.498 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T11:06:06.498 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-06T11:06:06.498 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-06T11:06:06.498 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-06T11:06:06.498 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:06:06.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:06.723 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-10-06T11:06:06.723 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:06:06.723 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.1 up 2023-10-06T11:06:06.723 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T11:06:06.724 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:06:06.815 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-10-06T11:06:06.815 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:06:06.815 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-06T11:06:06.829 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-06T11:06:06.829 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:06:06.829 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-06T11:06:06.884 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-06T11:06:06.949 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:06:06.949 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:06:07.012 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:06:07.013 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:06:07.014 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:06:07.014 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-06T11:06:07.069 INFO:teuthology.orchestra.run.smithi146.stdout:46 2023-10-06T11:06:07.069 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [46] 2023-10-06T11:06:07.069 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-10-06T11:06:07.111 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-06T11:06:07.137 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:06:07.137 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:06:07.193 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi146.stderr:2023-10-06T11:06:07.191+0000 7f0b45a04540 -1 init, newargv = 0x55853a25a0a0 newargc=15 2023-10-06T11:06:07.193 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi146.stderr:ceph-fuse[100312]: starting ceph client 2023-10-06T11:06:07.197 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi146.stderr:ceph-fuse[100312]: starting fuse 2023-10-06T11:06:07.202 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:06:07.203 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:06:07.204 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:06:07.204 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-06T11:06:07.259 INFO:teuthology.orchestra.run.smithi146.stdout:46 2023-10-06T11:06:07.260 INFO:teuthology.orchestra.run.smithi146.stdout:48 2023-10-06T11:06:07.260 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46, 48] 2023-10-06T11:06:07.260 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T11:06:07.260 DEBUG:teuthology.orchestra.run.smithi146:> import glob 2023-10-06T11:06:07.260 DEBUG:teuthology.orchestra.run.smithi146:> import re 2023-10-06T11:06:07.260 DEBUG:teuthology.orchestra.run.smithi146:> import os 2023-10-06T11:06:07.261 DEBUG:teuthology.orchestra.run.smithi146:> import subprocess 2023-10-06T11:06:07.261 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:06:07.261 DEBUG:teuthology.orchestra.run.smithi146:> def _find_admin_socket(client_name): 2023-10-06T11:06:07.261 DEBUG:teuthology.orchestra.run.smithi146:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-10-06T11:06:07.261 DEBUG:teuthology.orchestra.run.smithi146:> files = glob.glob(asok_path) 2023-10-06T11:06:07.261 DEBUG:teuthology.orchestra.run.smithi146:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-10-06T11:06:07.261 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:06:07.261 DEBUG:teuthology.orchestra.run.smithi146:> # Given a non-glob path, it better be there 2023-10-06T11:06:07.261 DEBUG:teuthology.orchestra.run.smithi146:> if "*" not in asok_path: 2023-10-06T11:06:07.261 DEBUG:teuthology.orchestra.run.smithi146:> assert(len(files) == 1) 2023-10-06T11:06:07.262 DEBUG:teuthology.orchestra.run.smithi146:> return files[0] 2023-10-06T11:06:07.262 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:06:07.262 DEBUG:teuthology.orchestra.run.smithi146:> for f in files: 2023-10-06T11:06:07.262 DEBUG:teuthology.orchestra.run.smithi146:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T11:06:07.262 DEBUG:teuthology.orchestra.run.smithi146:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T11:06:07.262 DEBUG:teuthology.orchestra.run.smithi146:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T11:06:07.262 DEBUG:teuthology.orchestra.run.smithi146:> contents = proc_f.read() 2023-10-06T11:06:07.262 DEBUG:teuthology.orchestra.run.smithi146:> if mountpoint in contents: 2023-10-06T11:06:07.262 DEBUG:teuthology.orchestra.run.smithi146:> return f 2023-10-06T11:06:07.262 DEBUG:teuthology.orchestra.run.smithi146:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T11:06:07.262 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:06:07.262 DEBUG:teuthology.orchestra.run.smithi146:> print(_find_admin_socket("client.2")) 2023-10-06T11:06:07.263 DEBUG:teuthology.orchestra.run.smithi146:> ' 2023-10-06T11:06:07.382 INFO:teuthology.orchestra.run.smithi146.stdout:/var/run/ceph/ceph-client.2.100312.asok 2023-10-06T11:06:07.563 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.100312.asok 2023-10-06T11:06:07.563 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:06:07.563 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.100312.asok status 2023-10-06T11:06:07.715 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:06:07.715 INFO:teuthology.orchestra.run.smithi146.stdout: "metadata": { 2023-10-06T11:06:07.715 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T11:06:07.716 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T11:06:07.716 INFO:teuthology.orchestra.run.smithi146.stdout: "entity_id": "2", 2023-10-06T11:06:07.716 INFO:teuthology.orchestra.run.smithi146.stdout: "hostname": "smithi146", 2023-10-06T11:06:07.716 INFO:teuthology.orchestra.run.smithi146.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-10-06T11:06:07.716 INFO:teuthology.orchestra.run.smithi146.stdout: "pid": "100312", 2023-10-06T11:06:07.716 INFO:teuthology.orchestra.run.smithi146.stdout: "root": "/" 2023-10-06T11:06:07.716 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:06:07.717 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_count": 0, 2023-10-06T11:06:07.717 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_pinned_count": 0, 2023-10-06T11:06:07.717 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 4704, 2023-10-06T11:06:07.717 INFO:teuthology.orchestra.run.smithi146.stdout: "inst": { 2023-10-06T11:06:07.717 INFO:teuthology.orchestra.run.smithi146.stdout: "name": { 2023-10-06T11:06:07.717 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "client", 2023-10-06T11:06:07.718 INFO:teuthology.orchestra.run.smithi146.stdout: "num": 4704 2023-10-06T11:06:07.718 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:06:07.718 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-06T11:06:07.718 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-06T11:06:07.718 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "192.168.0.2:0", 2023-10-06T11:06:07.718 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 4164651704 2023-10-06T11:06:07.718 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:06:07.719 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:06:07.719 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-06T11:06:07.719 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-06T11:06:07.719 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "192.168.0.2:0", 2023-10-06T11:06:07.719 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 4164651704 2023-10-06T11:06:07.719 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:06:07.719 INFO:teuthology.orchestra.run.smithi146.stdout: "inst_str": "client.4704 192.168.0.2:0/4164651704", 2023-10-06T11:06:07.720 INFO:teuthology.orchestra.run.smithi146.stdout: "addr_str": "192.168.0.2:0/4164651704", 2023-10-06T11:06:07.720 INFO:teuthology.orchestra.run.smithi146.stdout: "inode_count": 1, 2023-10-06T11:06:07.720 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_epoch": 7, 2023-10-06T11:06:07.720 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch": 20, 2023-10-06T11:06:07.720 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch_barrier": 0, 2023-10-06T11:06:07.720 INFO:teuthology.orchestra.run.smithi146.stdout: "blocklisted": false, 2023-10-06T11:06:07.720 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs" 2023-10-06T11:06:07.721 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:06:07.725 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T11:06:07.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.839+0000 7fb524c3c700 1 Processor -- start 2023-10-06T11:06:07.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.839+0000 7fb524c3c700 1 -- start start 2023-10-06T11:06:07.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.840+0000 7fb524c3c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb520153e80 0x7fb52015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:07.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.840+0000 7fb524c3c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb52015ac30 con 0x7fb520068ba0 2023-10-06T11:06:07.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.840+0000 7fb524c3c700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5200b4510 con 0x7fb520153ab0 2023-10-06T11:06:07.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.840+0000 7fb524c3c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5200b6530 con 0x7fb520153e80 2023-10-06T11:06:07.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.840+0000 7fb515d9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb520068ba0 0x7fb5200b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60286/0 (socket says 172.21.15.146:60286) 2023-10-06T11:06:07.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.840+0000 7fb515d9b700 1 -- 172.21.15.146:0/2776295686 learned_addr learned my addr 172.21.15.146:0/2776295686 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:07.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.840+0000 7fb51ed9d700 1 --2- 172.21.15.146:0/2776295686 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb520153e80 0x7fb52015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:07.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.840+0000 7fb51dd9b700 1 -- 172.21.15.146:0/2776295686 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 215870050 0 0) 0x7fb508001110 con 0x7fb520068ba0 2023-10-06T11:06:07.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.840+0000 7fb51dd9b700 1 -- 172.21.15.146:0/2776295686 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb50c003570 con 0x7fb520068ba0 2023-10-06T11:06:07.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.841+0000 7fb51dd9b700 1 -- 172.21.15.146:0/2776295686 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 841663250 0 0) 0x7fb50c003570 con 0x7fb520068ba0 2023-10-06T11:06:07.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.841+0000 7fb51dd9b700 1 -- 172.21.15.146:0/2776295686 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb520153e80 msgr2=0x7fb52015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:07.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.841+0000 7fb51dd9b700 1 --2- 172.21.15.146:0/2776295686 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb520153e80 0x7fb52015a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:07.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.841+0000 7fb51dd9b700 1 -- 172.21.15.146:0/2776295686 >> v1:172.21.15.151:6789/0 conn(0x7fb520153ab0 legacy=0x7fb520068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:07.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.841+0000 7fb51dd9b700 1 -- 172.21.15.146:0/2776295686 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5200b5c50 con 0x7fb520068ba0 2023-10-06T11:06:07.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.841+0000 7fb51dd9b700 1 -- 172.21.15.146:0/2776295686 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fb508001600 con 0x7fb520068ba0 2023-10-06T11:06:07.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.841+0000 7fb51dd9b700 1 -- 172.21.15.146:0/2776295686 >> v1:172.21.15.146:6789/0 conn(0x7fb520068ba0 legacy=0x7fb5200b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:07.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.841+0000 7fb51dd9b700 1 --2- 172.21.15.146:0/2776295686 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb520153e80 0x7fb50c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:07.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.841+0000 7fb51dd9b700 1 --2- 172.21.15.146:0/2776295686 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb50c003fd0 0x7fb50c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:07.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.841+0000 7fb51dd9b700 1 --2- 172.21.15.146:0/2776295686 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb50c004d50 0x7fb50c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:07.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.841+0000 7fb51dd9b700 1 -- 172.21.15.146:0/2776295686 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5200b6530 con 0x7fb50c003fd0 2023-10-06T11:06:07.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.841+0000 7fb51dd9b700 1 -- 172.21.15.146:0/2776295686 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50c00bba0 con 0x7fb50c004d50 2023-10-06T11:06:07.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.841+0000 7fb51dd9b700 1 -- 172.21.15.146:0/2776295686 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb50c00bd60 con 0x7fb520153e80 2023-10-06T11:06:07.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.841+0000 7fb515d9b700 1 --2- 172.21.15.146:0/2776295686 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb50c003fd0 0x7fb50c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:07.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.841+0000 7fb51e59c700 1 --2- 172.21.15.146:0/2776295686 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb520153e80 0x7fb50c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:07.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.841+0000 7fb51ed9d700 1 --2- 172.21.15.146:0/2776295686 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb50c004d50 0x7fb50c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:07.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.841+0000 7fb515d9b700 1 -- 172.21.15.146:0/2776295686 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb520153e80 msgr2=0x7fb50c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:07.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.841+0000 7fb515d9b700 1 --2- 172.21.15.146:0/2776295686 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb520153e80 0x7fb50c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:07.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.841+0000 7fb515d9b700 1 -- 172.21.15.146:0/2776295686 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb50c004d50 msgr2=0x7fb50c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:07.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.841+0000 7fb515d9b700 1 --2- 172.21.15.146:0/2776295686 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb50c004d50 0x7fb50c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:07.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.841+0000 7fb515d9b700 1 -- 172.21.15.146:0/2776295686 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb50c003570 con 0x7fb50c003fd0 2023-10-06T11:06:07.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.841+0000 7fb515d9b700 1 --2- 172.21.15.146:0/2776295686 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb50c003fd0 0x7fb50c004810 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb50800c390 tx=0x7fb520159c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8b64eb56efd0fbf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:07.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.841+0000 7fb51dd9b700 1 -- 172.21.15.146:0/2776295686 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50800ccc0 con 0x7fb50c003fd0 2023-10-06T11:06:07.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.842+0000 7fb51dd9b700 1 -- 172.21.15.146:0/2776295686 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb50800ce20 con 0x7fb50c003fd0 2023-10-06T11:06:07.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.842+0000 7fb51dd9b700 1 -- 172.21.15.146:0/2776295686 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb508005b70 con 0x7fb50c003fd0 2023-10-06T11:06:07.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.842+0000 7fb524c3c700 1 -- 172.21.15.146:0/2776295686 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb50c003fd0 msgr2=0x7fb50c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:07.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.842+0000 7fb524c3c700 1 --2- 172.21.15.146:0/2776295686 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb50c003fd0 0x7fb50c004810 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb50800c390 tx=0x7fb520159c70 comp rx=0 tx=0).stop 2023-10-06T11:06:07.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.842+0000 7fb51ed9d700 1 -- 172.21.15.146:0/2776295686 reap_dead start 2023-10-06T11:06:07.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.842+0000 7fb524c3c700 1 -- 172.21.15.146:0/2776295686 shutdown_connections 2023-10-06T11:06:07.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.842+0000 7fb524c3c700 1 -- 172.21.15.146:0/2776295686 >> 172.21.15.146:0/2776295686 conn(0x7fb52006eba0 msgr2=0x7fb52006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:07.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.842+0000 7fb524c3c700 1 -- 172.21.15.146:0/2776295686 shutdown_connections 2023-10-06T11:06:07.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.842+0000 7fb524c3c700 1 -- 172.21.15.146:0/2776295686 wait complete. 2023-10-06T11:06:07.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.843+0000 7fb524c3c700 1 Processor -- start 2023-10-06T11:06:07.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.843+0000 7fb524c3c700 1 -- start start 2023-10-06T11:06:07.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.844+0000 7fb524c3c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb50c003fd0 0x7fb52014dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:07.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.844+0000 7fb524c3c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb52014e380 0x7fb5201348e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:07.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.844+0000 7fb524c3c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb52014adf0 0x7fb52014b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:07.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.844+0000 7fb524c3c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb52014b7a0 con 0x7fb52014e380 2023-10-06T11:06:07.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.844+0000 7fb524c3c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb52014f730 con 0x7fb50c003fd0 2023-10-06T11:06:07.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.844+0000 7fb524c3c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb520134e20 con 0x7fb52014adf0 2023-10-06T11:06:07.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.844+0000 7fb515d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb52014e380 0x7fb5201348e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:07.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.844+0000 7fb515d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb52014e380 0x7fb5201348e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47294/0 (socket says 172.21.15.146:47294) 2023-10-06T11:06:07.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.844+0000 7fb515d9b700 1 -- 172.21.15.146:0/3282026554 learned_addr learned my addr 172.21.15.146:0/3282026554 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:07.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.844+0000 7fb51ed9d700 1 --2- 172.21.15.146:0/3282026554 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb52014adf0 0x7fb52014b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:07.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.844+0000 7fb51e59c700 1 --2- 172.21.15.146:0/3282026554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb50c003fd0 0x7fb52014dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:07.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.844+0000 7fb515d9b700 1 -- 172.21.15.146:0/3282026554 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb52014adf0 msgr2=0x7fb52014b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:07.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.844+0000 7fb515d9b700 1 --2- 172.21.15.146:0/3282026554 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb52014adf0 0x7fb52014b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:07.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.844+0000 7fb515d9b700 1 -- 172.21.15.146:0/3282026554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb50c003fd0 msgr2=0x7fb52014dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:07.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.844+0000 7fb515d9b700 1 --2- 172.21.15.146:0/3282026554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb50c003fd0 0x7fb52014dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:07.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.844+0000 7fb515d9b700 1 -- 172.21.15.146:0/3282026554 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb52014eb20 con 0x7fb52014e380 2023-10-06T11:06:07.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.844+0000 7fb51ed9d700 1 --2- 172.21.15.146:0/3282026554 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb52014adf0 0x7fb52014b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:06:07.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.844+0000 7fb51e59c700 1 --2- 172.21.15.146:0/3282026554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb50c003fd0 0x7fb52014dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:06:07.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.845+0000 7fb515d9b700 1 --2- 172.21.15.146:0/3282026554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb52014e380 0x7fb5201348e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb50800d010 tx=0x7fb508015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:07.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.845+0000 7fb516ffd700 1 -- 172.21.15.146:0/3282026554 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5080017e0 con 0x7fb52014e380 2023-10-06T11:06:07.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.845+0000 7fb516ffd700 1 -- 172.21.15.146:0/3282026554 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5080070d0 con 0x7fb52014e380 2023-10-06T11:06:07.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.845+0000 7fb516ffd700 1 -- 172.21.15.146:0/3282026554 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb508007490 con 0x7fb52014e380 2023-10-06T11:06:07.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.845+0000 7fb524c3c700 1 -- 172.21.15.146:0/3282026554 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb52014ee00 con 0x7fb52014e380 2023-10-06T11:06:07.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.845+0000 7fb524c3c700 1 -- 172.21.15.146:0/3282026554 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb52014f3c0 con 0x7fb52014e380 2023-10-06T11:06:07.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.846+0000 7fb524c3c700 1 -- 172.21.15.146:0/3282026554 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb52014f8e0 con 0x7fb52014e380 2023-10-06T11:06:07.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.846+0000 7fb516ffd700 1 -- 172.21.15.146:0/3282026554 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb508028450 con 0x7fb52014e380 2023-10-06T11:06:07.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.846+0000 7fb516ffd700 1 --2- 172.21.15.146:0/3282026554 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb500066f30 0x7fb5000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:07.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.847+0000 7fb516ffd700 1 -- 172.21.15.146:0/3282026554 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb508085e00 con 0x7fb52014e380 2023-10-06T11:06:07.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.847+0000 7fb51e59c700 1 --2- 172.21.15.146:0/3282026554 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb500066f30 0x7fb5000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:07.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.847+0000 7fb51e59c700 1 --2- 172.21.15.146:0/3282026554 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb500066f30 0x7fb5000693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb510000c00 tx=0x7fb510009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:07.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:07.851+0000 7fb516ffd700 1 -- 172.21.15.146:0/3282026554 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb52014f8e0 con 0x7fb52014e380 2023-10-06T11:06:08.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:08.078+0000 7fb524c3c700 1 -- 172.21.15.146:0/3282026554 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb52014b7a0 con 0x7fb52014e380 2023-10-06T11:06:08.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:08.078+0000 7fb516ffd700 1 -- 172.21.15.146:0/3282026554 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb508052f10 con 0x7fb52014e380 2023-10-06T11:06:08.080 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T11:06:08.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:08.080+0000 7fb524c3c700 1 -- 172.21.15.146:0/3282026554 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb500066f30 msgr2=0x7fb5000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:08.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:08.080+0000 7fb524c3c700 1 --2- 172.21.15.146:0/3282026554 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb500066f30 0x7fb5000693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb510000c00 tx=0x7fb510009040 comp rx=0 tx=0).stop 2023-10-06T11:06:08.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:08.080+0000 7fb524c3c700 1 -- 172.21.15.146:0/3282026554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb52014e380 msgr2=0x7fb5201348e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:08.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:08.080+0000 7fb524c3c700 1 --2- 172.21.15.146:0/3282026554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb52014e380 0x7fb5201348e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb50800d010 tx=0x7fb508015000 comp rx=0 tx=0).stop 2023-10-06T11:06:08.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:08.080+0000 7fb524c3c700 1 -- 172.21.15.146:0/3282026554 shutdown_connections 2023-10-06T11:06:08.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:08.080+0000 7fb524c3c700 1 --2- 172.21.15.146:0/3282026554 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb500066f30 0x7fb5000693e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:08.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:08.080+0000 7fb524c3c700 1 --2- 172.21.15.146:0/3282026554 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb52014adf0 0x7fb52014b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:08.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:08.080+0000 7fb524c3c700 1 --2- 172.21.15.146:0/3282026554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb50c003fd0 0x7fb52014dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:08.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:08.080+0000 7fb524c3c700 1 --2- 172.21.15.146:0/3282026554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb52014e380 0x7fb5201348e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:08.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:08.080+0000 7fb524c3c700 1 -- 172.21.15.146:0/3282026554 >> 172.21.15.146:0/3282026554 conn(0x7fb52006eba0 msgr2=0x7fb520151e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:08.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:08.080+0000 7fb524c3c700 1 -- 172.21.15.146:0/3282026554 shutdown_connections 2023-10-06T11:06:08.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:08.080+0000 7fb524c3c700 1 -- 172.21.15.146:0/3282026554 wait complete. 2023-10-06T11:06:08.094 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T11:06:08.094 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T11:06:08.094 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi151.front.sepia.ceph.com 2023-10-06T11:06:08.094 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T11:06:08.094 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T11:06:08.094 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T11:06:08.094 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T11:06:08.094 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T11:06:08.094 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T11:06:08.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:08.095 DEBUG:teuthology.orchestra.run.smithi151:> ip addr 2023-10-06T11:06:08.113 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:06:08.114 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:06:08.114 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:06:08.114 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:06:08.114 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2023-10-06T11:06:08.114 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:06:08.114 INFO:teuthology.orchestra.run.smithi151.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:06:08.115 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0c brd ff:ff:ff:ff:ff:ff 2023-10-06T11:06:08.115 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f0 2023-10-06T11:06:08.115 INFO:teuthology.orchestra.run.smithi151.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:06:08.115 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0d brd ff:ff:ff:ff:ff:ff 2023-10-06T11:06:08.115 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f1 2023-10-06T11:06:08.115 INFO:teuthology.orchestra.run.smithi151.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:06:08.115 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:62 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:06:08.115 INFO:teuthology.orchestra.run.smithi151.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T11:06:08.116 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:63 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:06:08.116 INFO:teuthology.orchestra.run.smithi151.stdout: inet 172.21.15.151/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T11:06:08.116 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft 42489sec preferred_lft 42489sec 2023-10-06T11:06:08.116 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::ec4:7aff:fe88:6f63/64 scope link 2023-10-06T11:06:08.116 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:06:08.116 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T11:06:08.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:08.117 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-10-06T11:06:08.117 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-10-06T11:06:08.117 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link add name ceph-brx type bridge 2023-10-06T11:06:08.117 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip addr flush dev ceph-brx 2023-10-06T11:06:08.117 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set ceph-brx up 2023-10-06T11:06:08.117 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T11:06:08.118 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-10-06T11:06:08.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:08.292 DEBUG:teuthology.orchestra.run.smithi151:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T11:06:08.335 INFO:teuthology.orchestra.run.smithi151.stdout:1 2023-10-06T11:06:08.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:08.337 DEBUG:teuthology.orchestra.run.smithi151:> route 2023-10-06T11:06:08.422 INFO:teuthology.orchestra.run.smithi151.stdout:Kernel IP routing table 2023-10-06T11:06:08.422 INFO:teuthology.orchestra.run.smithi151.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T11:06:08.422 INFO:teuthology.orchestra.run.smithi151.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T11:06:08.422 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T11:06:08.422 INFO:teuthology.orchestra.run.smithi151.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T11:06:08.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:08.423 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-10-06T11:06:08.423 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-10-06T11:06:08.423 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T11:06:08.423 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T11:06:08.423 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T11:06:08.423 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-10-06T11:06:08.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:08.634 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-10-06T11:06:08.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:08.649 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list-id 2023-10-06T11:06:08.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:08.704 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-10-06T11:06:08.704 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-10-06T11:06:08.704 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T11:06:08.704 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-06T11:06:08.704 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-10-06T11:06:08.793 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-06T11:06:08.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:08.794 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-10-06T11:06:08.794 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-10-06T11:06:08.794 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-06T11:06:08.794 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T11:06:08.794 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-06T11:06:08.794 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-06T11:06:08.794 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-06T11:06:08.794 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-10-06T11:06:08.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:08.997 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-10-06T11:06:08.998 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-10-06T11:06:08.998 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set brx.0 up 2023-10-06T11:06:08.998 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T11:06:08.998 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-10-06T11:06:09.089 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-10-06T11:06:09.090 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:06:09.090 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T11:06:09.104 INFO:teuthology.orchestra.run.smithi151.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T11:06:09.104 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:06:09.105 DEBUG:teuthology.orchestra.run.smithi151:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T11:06:09.159 DEBUG:teuthology.orchestra.run.smithi151:> sudo modprobe fuse 2023-10-06T11:06:09.224 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:06:09.224 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:06:09.289 INFO:teuthology.orchestra.run.smithi151.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:06:09.289 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:06:09.290 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:06:09.290 DEBUG:teuthology.orchestra.run.smithi151:> ls /sys/fs/fuse/connections 2023-10-06T11:06:09.345 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T11:06:09.346 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-10-06T11:06:09.389 DEBUG:teuthology.orchestra.run.smithi151:> sudo modprobe fuse 2023-10-06T11:06:09.413 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:06:09.413 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:06:09.477 INFO:teuthology.orchestra.run.smithi151.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:06:09.478 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:06:09.479 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:06:09.479 DEBUG:teuthology.orchestra.run.smithi151:> ls /sys/fs/fuse/connections 2023-10-06T11:06:09.488 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi151.stderr:2023-10-06T11:06:09.486+0000 7f356baff540 -1 init, newargv = 0x558e01e9d0a0 newargc=15 2023-10-06T11:06:09.488 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi151.stderr:ceph-fuse[97281]: starting ceph client 2023-10-06T11:06:09.492 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi151.stderr:ceph-fuse[97281]: starting fuse 2023-10-06T11:06:09.503 INFO:teuthology.orchestra.run.smithi151.stdout:46 2023-10-06T11:06:09.503 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-06T11:06:09.504 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T11:06:09.504 DEBUG:teuthology.orchestra.run.smithi151:> import glob 2023-10-06T11:06:09.504 DEBUG:teuthology.orchestra.run.smithi151:> import re 2023-10-06T11:06:09.504 DEBUG:teuthology.orchestra.run.smithi151:> import os 2023-10-06T11:06:09.504 DEBUG:teuthology.orchestra.run.smithi151:> import subprocess 2023-10-06T11:06:09.504 DEBUG:teuthology.orchestra.run.smithi151:> 2023-10-06T11:06:09.504 DEBUG:teuthology.orchestra.run.smithi151:> def _find_admin_socket(client_name): 2023-10-06T11:06:09.504 DEBUG:teuthology.orchestra.run.smithi151:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-10-06T11:06:09.504 DEBUG:teuthology.orchestra.run.smithi151:> files = glob.glob(asok_path) 2023-10-06T11:06:09.504 DEBUG:teuthology.orchestra.run.smithi151:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-10-06T11:06:09.504 DEBUG:teuthology.orchestra.run.smithi151:> 2023-10-06T11:06:09.504 DEBUG:teuthology.orchestra.run.smithi151:> # Given a non-glob path, it better be there 2023-10-06T11:06:09.504 DEBUG:teuthology.orchestra.run.smithi151:> if "*" not in asok_path: 2023-10-06T11:06:09.505 DEBUG:teuthology.orchestra.run.smithi151:> assert(len(files) == 1) 2023-10-06T11:06:09.505 DEBUG:teuthology.orchestra.run.smithi151:> return files[0] 2023-10-06T11:06:09.505 DEBUG:teuthology.orchestra.run.smithi151:> 2023-10-06T11:06:09.505 DEBUG:teuthology.orchestra.run.smithi151:> for f in files: 2023-10-06T11:06:09.505 DEBUG:teuthology.orchestra.run.smithi151:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T11:06:09.505 DEBUG:teuthology.orchestra.run.smithi151:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T11:06:09.505 DEBUG:teuthology.orchestra.run.smithi151:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T11:06:09.505 DEBUG:teuthology.orchestra.run.smithi151:> contents = proc_f.read() 2023-10-06T11:06:09.505 DEBUG:teuthology.orchestra.run.smithi151:> if mountpoint in contents: 2023-10-06T11:06:09.505 DEBUG:teuthology.orchestra.run.smithi151:> return f 2023-10-06T11:06:09.505 DEBUG:teuthology.orchestra.run.smithi151:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T11:06:09.505 DEBUG:teuthology.orchestra.run.smithi151:> 2023-10-06T11:06:09.506 DEBUG:teuthology.orchestra.run.smithi151:> print(_find_admin_socket("client.1")) 2023-10-06T11:06:09.506 DEBUG:teuthology.orchestra.run.smithi151:> ' 2023-10-06T11:06:09.625 INFO:teuthology.orchestra.run.smithi151.stdout:/var/run/ceph/ceph-client.1.97281.asok 2023-10-06T11:06:09.809 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.97281.asok 2023-10-06T11:06:09.809 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:06:09.809 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.97281.asok status 2023-10-06T11:06:09.958 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-10-06T11:06:09.959 INFO:teuthology.orchestra.run.smithi151.stdout: "metadata": { 2023-10-06T11:06:09.959 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T11:06:09.959 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T11:06:09.959 INFO:teuthology.orchestra.run.smithi151.stdout: "entity_id": "1", 2023-10-06T11:06:09.959 INFO:teuthology.orchestra.run.smithi151.stdout: "hostname": "smithi151", 2023-10-06T11:06:09.959 INFO:teuthology.orchestra.run.smithi151.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-10-06T11:06:09.959 INFO:teuthology.orchestra.run.smithi151.stdout: "pid": "97281", 2023-10-06T11:06:09.959 INFO:teuthology.orchestra.run.smithi151.stdout: "root": "/" 2023-10-06T11:06:09.959 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-10-06T11:06:09.959 INFO:teuthology.orchestra.run.smithi151.stdout: "dentry_count": 0, 2023-10-06T11:06:09.959 INFO:teuthology.orchestra.run.smithi151.stdout: "dentry_pinned_count": 0, 2023-10-06T11:06:09.959 INFO:teuthology.orchestra.run.smithi151.stdout: "id": 4639, 2023-10-06T11:06:09.960 INFO:teuthology.orchestra.run.smithi151.stdout: "inst": { 2023-10-06T11:06:09.960 INFO:teuthology.orchestra.run.smithi151.stdout: "name": { 2023-10-06T11:06:09.960 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "client", 2023-10-06T11:06:09.960 INFO:teuthology.orchestra.run.smithi151.stdout: "num": 4639 2023-10-06T11:06:09.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-10-06T11:06:09.960 INFO:teuthology.orchestra.run.smithi151.stdout: "addr": { 2023-10-06T11:06:09.960 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "v1", 2023-10-06T11:06:09.960 INFO:teuthology.orchestra.run.smithi151.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:06:09.960 INFO:teuthology.orchestra.run.smithi151.stdout: "nonce": 3702003179 2023-10-06T11:06:09.960 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-10-06T11:06:09.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-10-06T11:06:09.960 INFO:teuthology.orchestra.run.smithi151.stdout: "addr": { 2023-10-06T11:06:09.961 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "v1", 2023-10-06T11:06:09.961 INFO:teuthology.orchestra.run.smithi151.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:06:09.961 INFO:teuthology.orchestra.run.smithi151.stdout: "nonce": 3702003179 2023-10-06T11:06:09.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-10-06T11:06:09.961 INFO:teuthology.orchestra.run.smithi151.stdout: "inst_str": "client.4639 192.168.0.1:0/3702003179", 2023-10-06T11:06:09.961 INFO:teuthology.orchestra.run.smithi151.stdout: "addr_str": "192.168.0.1:0/3702003179", 2023-10-06T11:06:09.961 INFO:teuthology.orchestra.run.smithi151.stdout: "inode_count": 1, 2023-10-06T11:06:09.961 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_epoch": 7, 2023-10-06T11:06:09.961 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_epoch": 20, 2023-10-06T11:06:09.961 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_epoch_barrier": 0, 2023-10-06T11:06:09.961 INFO:teuthology.orchestra.run.smithi151.stdout: "blocklisted": false, 2023-10-06T11:06:09.962 INFO:teuthology.orchestra.run.smithi151.stdout: "fs_name": "cephfs" 2023-10-06T11:06:09.962 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-10-06T11:06:09.968 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T11:06:10.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.087+0000 7f6f514ac700 1 Processor -- start 2023-10-06T11:06:10.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.087+0000 7f6f514ac700 1 -- start start 2023-10-06T11:06:10.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.088+0000 7f6f514ac700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6f4c06f090 0x7f6f4c06f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:10.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.088+0000 7f6f514ac700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f4c0a66f0 0x7f6f4c0a6b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:10.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.088+0000 7f6f514ac700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f4c0b1e90 con 0x7f6f4c0b1a40 2023-10-06T11:06:10.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.088+0000 7f6f514ac700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f4c1562b0 con 0x7f6f4c06f090 2023-10-06T11:06:10.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.088+0000 7f6f514ac700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4c0ac720 con 0x7f6f4c0a66f0 2023-10-06T11:06:10.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.088+0000 7f6f4b7fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f4c0a66f0 0x7f6f4c0a6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:10.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.088+0000 7f6f4affd700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6f4c06f090 0x7f6f4c06f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:10.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.088+0000 7f6f4a7fc700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f6f4c0b1a40 0x7f6f4c0aff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:41354/0 (socket says 172.21.15.146:41354) 2023-10-06T11:06:10.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.088+0000 7f6f4a7fc700 1 -- 172.21.15.146:0/2227484802 learned_addr learned my addr 172.21.15.146:0/2227484802 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:10.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.088+0000 7f6f4affd700 1 -- 172.21.15.146:0/2227484802 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f4c0a66f0 msgr2=0x7f6f4c0a6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:10.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.088+0000 7f6f4affd700 1 --2- 172.21.15.146:0/2227484802 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f4c0a66f0 0x7f6f4c0a6b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:10.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.088+0000 7f6f4affd700 1 -- 172.21.15.146:0/2227484802 >> v1:172.21.15.151:6789/0 conn(0x7f6f4c0b1a40 legacy=0x7f6f4c0aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:10.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.088+0000 7f6f49ffb700 1 -- 172.21.15.146:0/2227484802 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 676780038 0 0) 0x7f6f4c0b1e90 con 0x7f6f4c0b1a40 2023-10-06T11:06:10.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.088+0000 7f6f4affd700 1 -- 172.21.15.146:0/2227484802 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f4c0b0610 con 0x7f6f4c06f090 2023-10-06T11:06:10.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.088+0000 7f6f4b7fe700 1 --2- 172.21.15.146:0/2227484802 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f4c0a66f0 0x7f6f4c0a6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:06:10.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.089+0000 7f6f4affd700 1 --2- 172.21.15.146:0/2227484802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f4c06f090 0x7f6f4c06f460 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6f44009e60 tx=0x7f6f44009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4063eb2dbe3bce0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:10.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.089+0000 7f6f49ffb700 1 -- 172.21.15.146:0/2227484802 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4400e070 con 0x7f6f4c06f090 2023-10-06T11:06:10.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.089+0000 7f6f49ffb700 1 -- 172.21.15.146:0/2227484802 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4400bb60 con 0x7f6f4c06f090 2023-10-06T11:06:10.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.089+0000 7f6f49ffb700 1 -- 172.21.15.146:0/2227484802 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f44012430 con 0x7f6f4c06f090 2023-10-06T11:06:10.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.089+0000 7f6f514ac700 1 -- 172.21.15.146:0/2227484802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f4c06f090 msgr2=0x7f6f4c06f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:10.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.089+0000 7f6f514ac700 1 --2- 172.21.15.146:0/2227484802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f4c06f090 0x7f6f4c06f460 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6f44009e60 tx=0x7f6f44009780 comp rx=0 tx=0).stop 2023-10-06T11:06:10.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.089+0000 7f6f514ac700 1 -- 172.21.15.146:0/2227484802 shutdown_connections 2023-10-06T11:06:10.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.089+0000 7f6f514ac700 1 --2- 172.21.15.146:0/2227484802 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f4c0a66f0 0x7f6f4c0a6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:10.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.089+0000 7f6f514ac700 1 --2- 172.21.15.146:0/2227484802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f4c06f090 0x7f6f4c06f460 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:10.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.089+0000 7f6f514ac700 1 -- 172.21.15.146:0/2227484802 >> 172.21.15.146:0/2227484802 conn(0x7f6f4c0cc260 msgr2=0x7f6f4c0cc660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:10.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.089+0000 7f6f514ac700 1 -- 172.21.15.146:0/2227484802 shutdown_connections 2023-10-06T11:06:10.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.089+0000 7f6f514ac700 1 -- 172.21.15.146:0/2227484802 wait complete. 2023-10-06T11:06:10.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.091+0000 7f6f514ac700 1 Processor -- start 2023-10-06T11:06:10.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.091+0000 7f6f514ac700 1 -- start start 2023-10-06T11:06:10.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.091+0000 7f6f514ac700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f4c06f090 0x7f6f4c1540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:10.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.091+0000 7f6f514ac700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f4c0a66f0 0x7f6f4c168810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:10.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.091+0000 7f6f514ac700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f4c0b1a40 0x7f6f4c098c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:10.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.091+0000 7f6f514ac700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4c1686a0 con 0x7f6f4c0a66f0 2023-10-06T11:06:10.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.091+0000 7f6f514ac700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4c0cb760 con 0x7f6f4c0b1a40 2023-10-06T11:06:10.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.091+0000 7f6f514ac700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4c1683c0 con 0x7f6f4c06f090 2023-10-06T11:06:10.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.091+0000 7f6f4a7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f4c0a66f0 0x7f6f4c168810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:10.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.092+0000 7f6f4a7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f4c0a66f0 0x7f6f4c168810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47302/0 (socket says 172.21.15.146:47302) 2023-10-06T11:06:10.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.092+0000 7f6f4a7fc700 1 -- 172.21.15.146:0/4222205956 learned_addr learned my addr 172.21.15.146:0/4222205956 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:10.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.092+0000 7f6f4affd700 1 --2- 172.21.15.146:0/4222205956 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f4c06f090 0x7f6f4c1540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:10.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.092+0000 7f6f4b7fe700 1 --2- 172.21.15.146:0/4222205956 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f4c0b1a40 0x7f6f4c098c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:10.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.092+0000 7f6f4a7fc700 1 -- 172.21.15.146:0/4222205956 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f4c06f090 msgr2=0x7f6f4c1540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:10.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.092+0000 7f6f4a7fc700 1 --2- 172.21.15.146:0/4222205956 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f4c06f090 0x7f6f4c1540f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:10.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.092+0000 7f6f4a7fc700 1 -- 172.21.15.146:0/4222205956 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f4c0b1a40 msgr2=0x7f6f4c098c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:10.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.092+0000 7f6f4a7fc700 1 --2- 172.21.15.146:0/4222205956 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f4c0b1a40 0x7f6f4c098c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:10.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.092+0000 7f6f4a7fc700 1 -- 172.21.15.146:0/4222205956 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f3c009420 con 0x7f6f4c0a66f0 2023-10-06T11:06:10.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.092+0000 7f6f4a7fc700 1 --2- 172.21.15.146:0/4222205956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f4c0a66f0 0x7f6f4c168810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6f4000c5b0 tx=0x7f6f40001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:10.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.092+0000 7f6f32ffd700 1 -- 172.21.15.146:0/4222205956 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f40005b30 con 0x7f6f4c0a66f0 2023-10-06T11:06:10.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.092+0000 7f6f32ffd700 1 -- 172.21.15.146:0/4222205956 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f40005c90 con 0x7f6f4c0a66f0 2023-10-06T11:06:10.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.092+0000 7f6f514ac700 1 -- 172.21.15.146:0/4222205956 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f44009a20 con 0x7f6f4c0a66f0 2023-10-06T11:06:10.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.092+0000 7f6f32ffd700 1 -- 172.21.15.146:0/4222205956 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f40007300 con 0x7f6f4c0a66f0 2023-10-06T11:06:10.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.092+0000 7f6f514ac700 1 -- 172.21.15.146:0/4222205956 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f4c0a7d90 con 0x7f6f4c0a66f0 2023-10-06T11:06:10.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.093+0000 7f6f514ac700 1 -- 172.21.15.146:0/4222205956 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f4c04c380 con 0x7f6f4c0a66f0 2023-10-06T11:06:10.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.094+0000 7f6f32ffd700 1 -- 172.21.15.146:0/4222205956 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6f4001b3b0 con 0x7f6f4c0a66f0 2023-10-06T11:06:10.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.094+0000 7f6f32ffd700 1 --2- 172.21.15.146:0/4222205956 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6f38066f30 0x7f6f380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:10.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.094+0000 7f6f32ffd700 1 -- 172.21.15.146:0/4222205956 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6f40083bc0 con 0x7f6f4c0a66f0 2023-10-06T11:06:10.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.094+0000 7f6f4affd700 1 --2- 172.21.15.146:0/4222205956 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6f38066f30 0x7f6f380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:10.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.094+0000 7f6f4affd700 1 --2- 172.21.15.146:0/4222205956 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6f38066f30 0x7f6f380693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6f440097c0 tx=0x7f6f44019000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:10.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.098+0000 7f6f32ffd700 1 -- 172.21.15.146:0/4222205956 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f40050cd0 con 0x7f6f4c0a66f0 2023-10-06T11:06:10.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.326+0000 7f6f514ac700 1 -- 172.21.15.146:0/4222205956 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6f4c0acde0 con 0x7f6f4c0a66f0 2023-10-06T11:06:10.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.327+0000 7f6f32ffd700 1 -- 172.21.15.146:0/4222205956 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6f40017070 con 0x7f6f4c0a66f0 2023-10-06T11:06:10.329 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T11:06:10.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.329+0000 7f6f514ac700 1 -- 172.21.15.146:0/4222205956 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6f38066f30 msgr2=0x7f6f380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:10.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.329+0000 7f6f514ac700 1 --2- 172.21.15.146:0/4222205956 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6f38066f30 0x7f6f380693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6f440097c0 tx=0x7f6f44019000 comp rx=0 tx=0).stop 2023-10-06T11:06:10.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.329+0000 7f6f514ac700 1 -- 172.21.15.146:0/4222205956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f4c0a66f0 msgr2=0x7f6f4c168810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:10.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.329+0000 7f6f514ac700 1 --2- 172.21.15.146:0/4222205956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f4c0a66f0 0x7f6f4c168810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6f4000c5b0 tx=0x7f6f40001070 comp rx=0 tx=0).stop 2023-10-06T11:06:10.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.329+0000 7f6f514ac700 1 -- 172.21.15.146:0/4222205956 shutdown_connections 2023-10-06T11:06:10.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.329+0000 7f6f514ac700 1 --2- 172.21.15.146:0/4222205956 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6f38066f30 0x7f6f380693e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:10.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.329+0000 7f6f514ac700 1 --2- 172.21.15.146:0/4222205956 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f4c0b1a40 0x7f6f4c098c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:10.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.329+0000 7f6f514ac700 1 --2- 172.21.15.146:0/4222205956 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f4c06f090 0x7f6f4c1540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:10.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.329+0000 7f6f514ac700 1 --2- 172.21.15.146:0/4222205956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f4c0a66f0 0x7f6f4c168810 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:10.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.329+0000 7f6f514ac700 1 -- 172.21.15.146:0/4222205956 >> 172.21.15.146:0/4222205956 conn(0x7f6f4c0cc260 msgr2=0x7f6f4c06e640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:10.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.329+0000 7f6f514ac700 1 -- 172.21.15.146:0/4222205956 shutdown_connections 2023-10-06T11:06:10.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:10.329+0000 7f6f514ac700 1 -- 172.21.15.146:0/4222205956 wait complete. 2023-10-06T11:06:10.342 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T11:06:10.342 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T11:06:10.342 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi151.front.sepia.ceph.com 2023-10-06T11:06:10.342 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-06T11:06:10.343 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-06T11:06:10.343 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T11:06:10.343 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T11:06:10.343 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T11:06:10.343 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-06T11:06:10.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:10.343 DEBUG:teuthology.orchestra.run.smithi151:> ip addr 2023-10-06T11:06:10.358 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:06:10.359 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:06:10.359 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:06:10.359 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:06:10.359 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2023-10-06T11:06:10.359 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:06:10.359 INFO:teuthology.orchestra.run.smithi151.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:06:10.359 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0c brd ff:ff:ff:ff:ff:ff 2023-10-06T11:06:10.359 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f0 2023-10-06T11:06:10.359 INFO:teuthology.orchestra.run.smithi151.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:06:10.359 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0d brd ff:ff:ff:ff:ff:ff 2023-10-06T11:06:10.359 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f1 2023-10-06T11:06:10.359 INFO:teuthology.orchestra.run.smithi151.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:06:10.360 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:62 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:06:10.360 INFO:teuthology.orchestra.run.smithi151.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T11:06:10.360 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:63 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:06:10.360 INFO:teuthology.orchestra.run.smithi151.stdout: inet 172.21.15.151/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T11:06:10.360 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft 42487sec preferred_lft 42487sec 2023-10-06T11:06:10.360 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::ec4:7aff:fe88:6f63/64 scope link 2023-10-06T11:06:10.360 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:06:10.360 INFO:teuthology.orchestra.run.smithi151.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T11:06:10.360 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 9a:5c:51:0c:89:11 brd ff:ff:ff:ff:ff:ff 2023-10-06T11:06:10.360 INFO:teuthology.orchestra.run.smithi151.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T11:06:10.360 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:06:10.360 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::7037:94ff:fee8:64c4/64 scope link 2023-10-06T11:06:10.360 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:06:10.361 INFO:teuthology.orchestra.run.smithi151.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:06:10.361 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 9a:5c:51:0c:89:11 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T11:06:10.361 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::985c:51ff:fe0c:8911/64 scope link 2023-10-06T11:06:10.361 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:06:10.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:10.361 DEBUG:teuthology.orchestra.run.smithi151:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T11:06:10.422 INFO:teuthology.orchestra.run.smithi151.stdout:1 2023-10-06T11:06:10.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:10.423 DEBUG:teuthology.orchestra.run.smithi151:> route 2023-10-06T11:06:10.480 INFO:teuthology.orchestra.run.smithi151.stdout:Kernel IP routing table 2023-10-06T11:06:10.498 INFO:teuthology.orchestra.run.smithi151.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T11:06:10.499 INFO:teuthology.orchestra.run.smithi151.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T11:06:10.499 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T11:06:10.499 INFO:teuthology.orchestra.run.smithi151.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T11:06:10.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:10.499 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-10-06T11:06:10.500 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-10-06T11:06:10.500 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T11:06:10.500 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T11:06:10.500 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T11:06:10.500 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-10-06T11:06:10.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:10.580 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-10-06T11:06:10.594 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T11:06:10.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:10.595 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list-id 2023-10-06T11:06:10.649 INFO:teuthology.orchestra.run.smithi151.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-06T11:06:10.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:10.649 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-10-06T11:06:10.649 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-10-06T11:06:10.649 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T11:06:10.650 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-06T11:06:10.650 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-10-06T11:06:10.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:10.738 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T11:06:10.779 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:06:10.779 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:06:10.779 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:06:10.780 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:06:10.780 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2023-10-06T11:06:10.780 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:06:10.780 INFO:teuthology.orchestra.run.smithi151.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T11:06:10.780 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 62:b0:28:9b:b2:d2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T11:06:10.780 INFO:teuthology.orchestra.run.smithi151.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T11:06:10.780 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:06:10.780 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::60b0:28ff:fe9b:b2d2/64 scope link 2023-10-06T11:06:10.780 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:06:10.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:10.792 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T11:06:10.873 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:06:10.873 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:06:10.873 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:06:10.874 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:06:10.874 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2023-10-06T11:06:10.874 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:06:10.874 INFO:teuthology.orchestra.run.smithi151.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T11:06:10.874 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 62:b0:28:9b:b2:d2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T11:06:10.874 INFO:teuthology.orchestra.run.smithi151.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T11:06:10.874 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:06:10.874 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::60b0:28ff:fe9b:b2d2/64 scope link 2023-10-06T11:06:10.874 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:06:10.886 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-06T11:06:10.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:10.886 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-10-06T11:06:10.886 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-10-06T11:06:10.886 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-06T11:06:10.886 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T11:06:10.886 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-06T11:06:10.886 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-06T11:06:10.887 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-06T11:06:10.887 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-10-06T11:06:11.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:11.109 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-10-06T11:06:11.109 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-10-06T11:06:11.109 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set brx.1 up 2023-10-06T11:06:11.110 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T11:06:11.110 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-10-06T11:06:11.202 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-10-06T11:06:11.202 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:06:11.202 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-06T11:06:11.217 INFO:teuthology.orchestra.run.smithi151.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-06T11:06:11.217 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:06:11.217 DEBUG:teuthology.orchestra.run.smithi151:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-06T11:06:11.272 DEBUG:teuthology.orchestra.run.smithi151:> sudo modprobe fuse 2023-10-06T11:06:11.337 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:06:11.337 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:06:11.401 INFO:teuthology.orchestra.run.smithi151.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:06:11.402 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:06:11.403 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:06:11.403 DEBUG:teuthology.orchestra.run.smithi151:> ls /sys/fs/fuse/connections 2023-10-06T11:06:11.458 INFO:teuthology.orchestra.run.smithi151.stdout:46 2023-10-06T11:06:11.459 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [46] 2023-10-06T11:06:11.459 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-10-06T11:06:11.501 DEBUG:teuthology.orchestra.run.smithi151:> sudo modprobe fuse 2023-10-06T11:06:11.524 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:06:11.524 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:06:11.581 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi151.stderr:2023-10-06T11:06:11.579+0000 7f285685f540 -1 init, newargv = 0x55a9f0a2cb20 newargc=15 2023-10-06T11:06:11.581 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi151.stderr:ceph-fuse[97778]: starting ceph client 2023-10-06T11:06:11.585 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi151.stderr:ceph-fuse[97778]: starting fuse 2023-10-06T11:06:11.590 INFO:teuthology.orchestra.run.smithi151.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:06:11.591 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:06:11.591 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:06:11.591 DEBUG:teuthology.orchestra.run.smithi151:> ls /sys/fs/fuse/connections 2023-10-06T11:06:11.646 INFO:teuthology.orchestra.run.smithi151.stdout:46 2023-10-06T11:06:11.646 INFO:teuthology.orchestra.run.smithi151.stdout:48 2023-10-06T11:06:11.647 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46, 48] 2023-10-06T11:06:11.647 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T11:06:11.647 DEBUG:teuthology.orchestra.run.smithi151:> import glob 2023-10-06T11:06:11.647 DEBUG:teuthology.orchestra.run.smithi151:> import re 2023-10-06T11:06:11.647 DEBUG:teuthology.orchestra.run.smithi151:> import os 2023-10-06T11:06:11.647 DEBUG:teuthology.orchestra.run.smithi151:> import subprocess 2023-10-06T11:06:11.647 DEBUG:teuthology.orchestra.run.smithi151:> 2023-10-06T11:06:11.647 DEBUG:teuthology.orchestra.run.smithi151:> def _find_admin_socket(client_name): 2023-10-06T11:06:11.647 DEBUG:teuthology.orchestra.run.smithi151:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-10-06T11:06:11.647 DEBUG:teuthology.orchestra.run.smithi151:> files = glob.glob(asok_path) 2023-10-06T11:06:11.647 DEBUG:teuthology.orchestra.run.smithi151:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-10-06T11:06:11.648 DEBUG:teuthology.orchestra.run.smithi151:> 2023-10-06T11:06:11.648 DEBUG:teuthology.orchestra.run.smithi151:> # Given a non-glob path, it better be there 2023-10-06T11:06:11.648 DEBUG:teuthology.orchestra.run.smithi151:> if "*" not in asok_path: 2023-10-06T11:06:11.648 DEBUG:teuthology.orchestra.run.smithi151:> assert(len(files) == 1) 2023-10-06T11:06:11.648 DEBUG:teuthology.orchestra.run.smithi151:> return files[0] 2023-10-06T11:06:11.648 DEBUG:teuthology.orchestra.run.smithi151:> 2023-10-06T11:06:11.648 DEBUG:teuthology.orchestra.run.smithi151:> for f in files: 2023-10-06T11:06:11.648 DEBUG:teuthology.orchestra.run.smithi151:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T11:06:11.648 DEBUG:teuthology.orchestra.run.smithi151:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T11:06:11.648 DEBUG:teuthology.orchestra.run.smithi151:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T11:06:11.648 DEBUG:teuthology.orchestra.run.smithi151:> contents = proc_f.read() 2023-10-06T11:06:11.648 DEBUG:teuthology.orchestra.run.smithi151:> if mountpoint in contents: 2023-10-06T11:06:11.648 DEBUG:teuthology.orchestra.run.smithi151:> return f 2023-10-06T11:06:11.649 DEBUG:teuthology.orchestra.run.smithi151:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T11:06:11.649 DEBUG:teuthology.orchestra.run.smithi151:> 2023-10-06T11:06:11.649 DEBUG:teuthology.orchestra.run.smithi151:> print(_find_admin_socket("client.3")) 2023-10-06T11:06:11.649 DEBUG:teuthology.orchestra.run.smithi151:> ' 2023-10-06T11:06:11.767 INFO:teuthology.orchestra.run.smithi151.stdout:/var/run/ceph/ceph-client.3.97778.asok 2023-10-06T11:06:11.949 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.97778.asok 2023-10-06T11:06:11.950 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:06:11.950 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.97778.asok status 2023-10-06T11:06:12.099 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-10-06T11:06:12.099 INFO:teuthology.orchestra.run.smithi151.stdout: "metadata": { 2023-10-06T11:06:12.100 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T11:06:12.100 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T11:06:12.100 INFO:teuthology.orchestra.run.smithi151.stdout: "entity_id": "3", 2023-10-06T11:06:12.100 INFO:teuthology.orchestra.run.smithi151.stdout: "hostname": "smithi151", 2023-10-06T11:06:12.100 INFO:teuthology.orchestra.run.smithi151.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-10-06T11:06:12.100 INFO:teuthology.orchestra.run.smithi151.stdout: "pid": "97778", 2023-10-06T11:06:12.100 INFO:teuthology.orchestra.run.smithi151.stdout: "root": "/" 2023-10-06T11:06:12.100 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-10-06T11:06:12.100 INFO:teuthology.orchestra.run.smithi151.stdout: "dentry_count": 0, 2023-10-06T11:06:12.100 INFO:teuthology.orchestra.run.smithi151.stdout: "dentry_pinned_count": 0, 2023-10-06T11:06:12.101 INFO:teuthology.orchestra.run.smithi151.stdout: "id": 4654, 2023-10-06T11:06:12.101 INFO:teuthology.orchestra.run.smithi151.stdout: "inst": { 2023-10-06T11:06:12.101 INFO:teuthology.orchestra.run.smithi151.stdout: "name": { 2023-10-06T11:06:12.101 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "client", 2023-10-06T11:06:12.101 INFO:teuthology.orchestra.run.smithi151.stdout: "num": 4654 2023-10-06T11:06:12.101 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-10-06T11:06:12.101 INFO:teuthology.orchestra.run.smithi151.stdout: "addr": { 2023-10-06T11:06:12.101 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "v1", 2023-10-06T11:06:12.101 INFO:teuthology.orchestra.run.smithi151.stdout: "addr": "192.168.0.2:0", 2023-10-06T11:06:12.101 INFO:teuthology.orchestra.run.smithi151.stdout: "nonce": 730541583 2023-10-06T11:06:12.102 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-10-06T11:06:12.102 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-10-06T11:06:12.102 INFO:teuthology.orchestra.run.smithi151.stdout: "addr": { 2023-10-06T11:06:12.102 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "v1", 2023-10-06T11:06:12.102 INFO:teuthology.orchestra.run.smithi151.stdout: "addr": "192.168.0.2:0", 2023-10-06T11:06:12.102 INFO:teuthology.orchestra.run.smithi151.stdout: "nonce": 730541583 2023-10-06T11:06:12.102 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-10-06T11:06:12.102 INFO:teuthology.orchestra.run.smithi151.stdout: "inst_str": "client.4654 192.168.0.2:0/730541583", 2023-10-06T11:06:12.102 INFO:teuthology.orchestra.run.smithi151.stdout: "addr_str": "192.168.0.2:0/730541583", 2023-10-06T11:06:12.102 INFO:teuthology.orchestra.run.smithi151.stdout: "inode_count": 1, 2023-10-06T11:06:12.103 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_epoch": 7, 2023-10-06T11:06:12.103 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_epoch": 20, 2023-10-06T11:06:12.103 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_epoch_barrier": 0, 2023-10-06T11:06:12.103 INFO:teuthology.orchestra.run.smithi151.stdout: "blocklisted": false, 2023-10-06T11:06:12.103 INFO:teuthology.orchestra.run.smithi151.stdout: "fs_name": "cephfs" 2023-10-06T11:06:12.103 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-10-06T11:06:12.109 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:06:12.109 DEBUG:teuthology.orchestra.run.smithi146:> stat --file-system '--printf=%T 2023-10-06T11:06:12.109 DEBUG:teuthology.orchestra.run.smithi146:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T11:06:12.128 INFO:teuthology.orchestra.run.smithi146.stdout:fuseblk 2023-10-06T11:06:12.128 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T11:06:12.128 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:06:12.128 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:06:12.200 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:06:12.200 DEBUG:teuthology.orchestra.run.smithi146:> stat --file-system '--printf=%T 2023-10-06T11:06:12.200 DEBUG:teuthology.orchestra.run.smithi146:> ' -- /home/ubuntu/cephtest/mnt.2 2023-10-06T11:06:12.256 INFO:teuthology.orchestra.run.smithi146.stdout:fuseblk 2023-10-06T11:06:12.256 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-10-06T11:06:12.256 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:06:12.256 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-06T11:06:12.326 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:06:12.326 DEBUG:teuthology.orchestra.run.smithi151:> stat --file-system '--printf=%T 2023-10-06T11:06:12.326 DEBUG:teuthology.orchestra.run.smithi151:> ' -- /home/ubuntu/cephtest/mnt.1 2023-10-06T11:06:12.341 INFO:teuthology.orchestra.run.smithi151.stdout:fuseblk 2023-10-06T11:06:12.341 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-10-06T11:06:12.341 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:06:12.342 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T11:06:12.406 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:06:12.406 DEBUG:teuthology.orchestra.run.smithi151:> stat --file-system '--printf=%T 2023-10-06T11:06:12.406 DEBUG:teuthology.orchestra.run.smithi151:> ' -- /home/ubuntu/cephtest/mnt.3 2023-10-06T11:06:12.460 INFO:teuthology.orchestra.run.smithi151.stdout:fuseblk 2023-10-06T11:06:12.461 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-10-06T11:06:12.461 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:06:12.461 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-06T11:06:12.525 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-06T11:06:12.543 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:06:12.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.663+0000 7f33d6aaa700 1 Processor -- start 2023-10-06T11:06:12.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.663+0000 7f33d6aaa700 1 -- start start 2023-10-06T11:06:12.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.663+0000 7f33d6aaa700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f33d0155c80 0x7f33d00aefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:12.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.663+0000 7f33d6aaa700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f33d0156050 0x7f33d006dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:12.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.663+0000 7f33d6aaa700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33d00af520 con 0x7f33d015a370 2023-10-06T11:06:12.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.663+0000 7f33d6aaa700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33d00ad370 con 0x7f33d0155c80 2023-10-06T11:06:12.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.663+0000 7f33d6aaa700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33d015a8a0 con 0x7f33d0156050 2023-10-06T11:06:12.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.663+0000 7f33d4846700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f33d0155c80 0x7f33d00aefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:12.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.664+0000 7f33d4846700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f33d0155c80 0x7f33d00aefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39302/0 (socket says 172.21.15.146:39302) 2023-10-06T11:06:12.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.664+0000 7f33d4846700 1 -- 172.21.15.146:0/3451685138 learned_addr learned my addr 172.21.15.146:0/3451685138 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:12.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.664+0000 7f33cffff700 1 --2- 172.21.15.146:0/3451685138 >> v2:172.21.15.151:3300/0 conn(0x7f33d0156050 0x7f33d006dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:12.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.664+0000 7f33d4846700 1 -- 172.21.15.146:0/3451685138 >> v2:172.21.15.151:3300/0 conn(0x7f33d0156050 msgr2=0x7f33d006dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:12.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.664+0000 7f33d4846700 1 --2- 172.21.15.146:0/3451685138 >> v2:172.21.15.151:3300/0 conn(0x7f33d0156050 0x7f33d006dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:12.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.664+0000 7f33d4846700 1 -- 172.21.15.146:0/3451685138 >> v1:172.21.15.151:6789/0 conn(0x7f33d015a370 legacy=0x7f33d0067470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:12.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.664+0000 7f33d4846700 1 -- 172.21.15.146:0/3451685138 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d00aca40 con 0x7f33d0155c80 2023-10-06T11:06:12.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.664+0000 7f33cffff700 1 --2- 172.21.15.146:0/3451685138 >> v2:172.21.15.151:3300/0 conn(0x7f33d0156050 0x7f33d006dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:06:12.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.664+0000 7f33d4846700 1 --2- 172.21.15.146:0/3451685138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33d0155c80 0x7f33d00aefe0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f33d006d720 tx=0x7f33c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aef35de91b6baaf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:12.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.664+0000 7f33cf7fe700 1 -- 172.21.15.146:0/3451685138 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c400b820 con 0x7f33d0155c80 2023-10-06T11:06:12.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.664+0000 7f33cf7fe700 1 -- 172.21.15.146:0/3451685138 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c400b980 con 0x7f33d0155c80 2023-10-06T11:06:12.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.664+0000 7f33cf7fe700 1 -- 172.21.15.146:0/3451685138 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c400bd20 con 0x7f33d0155c80 2023-10-06T11:06:12.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.665+0000 7f33d6aaa700 1 -- 172.21.15.146:0/3451685138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33d0155c80 msgr2=0x7f33d00aefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:12.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.665+0000 7f33d6aaa700 1 --2- 172.21.15.146:0/3451685138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33d0155c80 0x7f33d00aefe0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f33d006d720 tx=0x7f33c4009250 comp rx=0 tx=0).stop 2023-10-06T11:06:12.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.665+0000 7f33d6aaa700 1 -- 172.21.15.146:0/3451685138 shutdown_connections 2023-10-06T11:06:12.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.665+0000 7f33d6aaa700 1 --2- 172.21.15.146:0/3451685138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33d0155c80 0x7f33d00aefe0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:12.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.665+0000 7f33d6aaa700 1 --2- 172.21.15.146:0/3451685138 >> v2:172.21.15.151:3300/0 conn(0x7f33d0156050 0x7f33d006dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:12.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.665+0000 7f33d6aaa700 1 -- 172.21.15.146:0/3451685138 >> 172.21.15.146:0/3451685138 conn(0x7f33d00cd530 msgr2=0x7f33d0069f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:12.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.665+0000 7f33d6aaa700 1 -- 172.21.15.146:0/3451685138 shutdown_connections 2023-10-06T11:06:12.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.665+0000 7f33d6aaa700 1 -- 172.21.15.146:0/3451685138 wait complete. 2023-10-06T11:06:12.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.666+0000 7f33d6aaa700 1 Processor -- start 2023-10-06T11:06:12.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.666+0000 7f33d6aaa700 1 -- start start 2023-10-06T11:06:12.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.667+0000 7f33d6aaa700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f33d0155c80 0x7f33d01549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:12.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.667+0000 7f33d6aaa700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33d0156050 0x7f33d00abbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:12.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.667+0000 7f33d6aaa700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f33d015a370 0x7f33d00c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:12.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.667+0000 7f33d6aaa700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d016df00 con 0x7f33d0156050 2023-10-06T11:06:12.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.667+0000 7f33d6aaa700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d016e1e0 con 0x7f33d0155c80 2023-10-06T11:06:12.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.667+0000 7f33d6aaa700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d016e4c0 con 0x7f33d015a370 2023-10-06T11:06:12.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.667+0000 7f33cffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33d0156050 0x7f33d00abbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:12.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.667+0000 7f33cffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33d0156050 0x7f33d00abbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39314/0 (socket says 172.21.15.146:39314) 2023-10-06T11:06:12.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.667+0000 7f33cffff700 1 -- 172.21.15.146:0/3178743729 learned_addr learned my addr 172.21.15.146:0/3178743729 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:12.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.667+0000 7f33d4846700 1 --2- 172.21.15.146:0/3178743729 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f33d0155c80 0x7f33d01549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:12.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.667+0000 7f33d5047700 1 --2- 172.21.15.146:0/3178743729 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f33d015a370 0x7f33d00c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:12.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.667+0000 7f33cffff700 1 -- 172.21.15.146:0/3178743729 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f33d015a370 msgr2=0x7f33d00c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:12.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.667+0000 7f33cffff700 1 --2- 172.21.15.146:0/3178743729 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f33d015a370 0x7f33d00c94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:12.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.667+0000 7f33cffff700 1 -- 172.21.15.146:0/3178743729 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f33d0155c80 msgr2=0x7f33d01549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:12.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.667+0000 7f33cffff700 1 --2- 172.21.15.146:0/3178743729 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f33d0155c80 0x7f33d01549d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:12.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.667+0000 7f33cffff700 1 -- 172.21.15.146:0/3178743729 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c40094f0 con 0x7f33d0156050 2023-10-06T11:06:12.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.667+0000 7f33cffff700 1 --2- 172.21.15.146:0/3178743729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33d0156050 0x7f33d00abbf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f33bc00c830 tx=0x7f33bc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:12.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.667+0000 7f33ccff9700 1 -- 172.21.15.146:0/3178743729 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33bc011600 con 0x7f33d0156050 2023-10-06T11:06:12.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.667+0000 7f33ccff9700 1 -- 172.21.15.146:0/3178743729 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33bc011760 con 0x7f33d0156050 2023-10-06T11:06:12.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.667+0000 7f33ccff9700 1 -- 172.21.15.146:0/3178743729 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33bc011b20 con 0x7f33d0156050 2023-10-06T11:06:12.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.667+0000 7f33d6aaa700 1 -- 172.21.15.146:0/3178743729 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33d016e7a0 con 0x7f33d0156050 2023-10-06T11:06:12.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.667+0000 7f33d6aaa700 1 -- 172.21.15.146:0/3178743729 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33d00ac130 con 0x7f33d0156050 2023-10-06T11:06:12.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.668+0000 7f33d6aaa700 1 -- 172.21.15.146:0/3178743729 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33d00ac350 con 0x7f33d0156050 2023-10-06T11:06:12.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.669+0000 7f33ccff9700 1 -- 172.21.15.146:0/3178743729 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f33bc018360 con 0x7f33d0156050 2023-10-06T11:06:12.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.669+0000 7f33ccff9700 1 --2- 172.21.15.146:0/3178743729 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f33b4066f30 0x7f33b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:12.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.669+0000 7f33d4846700 1 --2- 172.21.15.146:0/3178743729 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f33b4066f30 0x7f33b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:12.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.669+0000 7f33ccff9700 1 -- 172.21.15.146:0/3178743729 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f33bc084620 con 0x7f33d0156050 2023-10-06T11:06:12.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.670+0000 7f33d4846700 1 --2- 172.21.15.146:0/3178743729 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f33b4066f30 0x7f33b40693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f33d006d720 tx=0x7f33c4016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:12.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.674+0000 7f33ccff9700 1 -- 172.21.15.146:0/3178743729 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f33bc051730 con 0x7f33d0156050 2023-10-06T11:06:12.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.862+0000 7f33d6aaa700 1 -- 172.21.15.146:0/3178743729 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33d004c380 con 0x7f33d0156050 2023-10-06T11:06:12.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.863+0000 7f33ccff9700 1 -- 172.21.15.146:0/3178743729 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16914 (secure 0 0 0) 0x7f33bc054d50 con 0x7f33d0156050 2023-10-06T11:06:12.865 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:06:12.865 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":20,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:05:45.362089+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:05:41.403954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T11:05:42.698754+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:06:12.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.865+0000 7f33d6aaa700 1 -- 172.21.15.146:0/3178743729 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f33b4066f30 msgr2=0x7f33b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:12.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.865+0000 7f33d6aaa700 1 --2- 172.21.15.146:0/3178743729 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f33b4066f30 0x7f33b40693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f33d006d720 tx=0x7f33c4016000 comp rx=0 tx=0).stop 2023-10-06T11:06:12.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.865+0000 7f33d6aaa700 1 -- 172.21.15.146:0/3178743729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33d0156050 msgr2=0x7f33d00abbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:12.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.865+0000 7f33d6aaa700 1 --2- 172.21.15.146:0/3178743729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33d0156050 0x7f33d00abbf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f33bc00c830 tx=0x7f33bc008040 comp rx=0 tx=0).stop 2023-10-06T11:06:12.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.865+0000 7f33d6aaa700 1 -- 172.21.15.146:0/3178743729 shutdown_connections 2023-10-06T11:06:12.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.865+0000 7f33d6aaa700 1 --2- 172.21.15.146:0/3178743729 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f33b4066f30 0x7f33b40693e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:12.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.865+0000 7f33d6aaa700 1 --2- 172.21.15.146:0/3178743729 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f33d015a370 0x7f33d00c94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:12.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.865+0000 7f33d6aaa700 1 --2- 172.21.15.146:0/3178743729 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f33d0155c80 0x7f33d01549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:12.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.865+0000 7f33d6aaa700 1 --2- 172.21.15.146:0/3178743729 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33d0156050 0x7f33d00abbf0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:12.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.865+0000 7f33d6aaa700 1 -- 172.21.15.146:0/3178743729 >> 172.21.15.146:0/3178743729 conn(0x7f33d00cd530 msgr2=0x7f33d00b0910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:12.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.865+0000 7f33d6aaa700 1 -- 172.21.15.146:0/3178743729 shutdown_connections 2023-10-06T11:06:12.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.865+0000 7f33d6aaa700 1 -- 172.21.15.146:0/3178743729 wait complete. 2023-10-06T11:06:12.879 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:05:36.687307+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:05:37.171199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T11:05:41.403954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T11:05:42.698754+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T11:06:12.879 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:06:12.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.995+0000 7fed29562700 1 Processor -- start 2023-10-06T11:06:12.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.995+0000 7fed29562700 1 -- start start 2023-10-06T11:06:12.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.996+0000 7fed29562700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fed2406b8a0 0x7fed240b0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:12.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.996+0000 7fed29562700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fed24140800 0x7fed24140c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:12.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.996+0000 7fed29562700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed240c90f0 con 0x7fed2406bc70 2023-10-06T11:06:12.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.996+0000 7fed29562700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed240c9d40 con 0x7fed24140800 2023-10-06T11:06:12.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.996+0000 7fed29562700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed240cbe00 con 0x7fed2406b8a0 2023-10-06T11:06:12.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.996+0000 7fed237fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fed2406bc70 0x7fed2415b870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49490/0 (socket says 172.21.15.146:49490) 2023-10-06T11:06:12.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.996+0000 7fed237fe700 1 -- 172.21.15.146:0/2950301386 learned_addr learned my addr 172.21.15.146:0/2950301386 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:13.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.996+0000 7fed28d61700 1 --2- 172.21.15.146:0/2950301386 >> v2:172.21.15.146:3300/0 conn(0x7fed24140800 0x7fed24140c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:13.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.996+0000 7fed23fff700 1 --2- 172.21.15.146:0/2950301386 >> v2:172.21.15.151:3300/0 conn(0x7fed2406b8a0 0x7fed240b0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:13.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.996+0000 7fed28d61700 1 -- 172.21.15.146:0/2950301386 >> v2:172.21.15.151:3300/0 conn(0x7fed2406b8a0 msgr2=0x7fed240b0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:13.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.996+0000 7fed28d61700 1 --2- 172.21.15.146:0/2950301386 >> v2:172.21.15.151:3300/0 conn(0x7fed2406b8a0 0x7fed240b0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:13.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.996+0000 7fed28d61700 1 -- 172.21.15.146:0/2950301386 >> v1:172.21.15.146:6789/0 conn(0x7fed2406bc70 legacy=0x7fed2415b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:13.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.996+0000 7fed28d61700 1 -- 172.21.15.146:0/2950301386 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed240cc350 con 0x7fed24140800 2023-10-06T11:06:13.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.996+0000 7fed22ffd700 1 -- 172.21.15.146:0/2950301386 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2474036920 0 0) 0x7fed18001110 con 0x7fed2406bc70 2023-10-06T11:06:13.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.996+0000 7fed28d61700 1 --2- 172.21.15.146:0/2950301386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed24140800 0x7fed24140c40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fed240717c0 tx=0x7fed1c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ef09a97f0aad61a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:13.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.997+0000 7fed22ffd700 1 -- 172.21.15.146:0/2950301386 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1c00e070 con 0x7fed24140800 2023-10-06T11:06:13.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.997+0000 7fed22ffd700 1 -- 172.21.15.146:0/2950301386 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed1c00bc30 con 0x7fed24140800 2023-10-06T11:06:13.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.997+0000 7fed22ffd700 1 -- 172.21.15.146:0/2950301386 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1c012430 con 0x7fed24140800 2023-10-06T11:06:13.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.997+0000 7fed29562700 1 -- 172.21.15.146:0/2950301386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed24140800 msgr2=0x7fed24140c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:13.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.997+0000 7fed29562700 1 --2- 172.21.15.146:0/2950301386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed24140800 0x7fed24140c40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fed240717c0 tx=0x7fed1c009780 comp rx=0 tx=0).stop 2023-10-06T11:06:13.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.997+0000 7fed29562700 1 -- 172.21.15.146:0/2950301386 shutdown_connections 2023-10-06T11:06:13.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.997+0000 7fed29562700 1 --2- 172.21.15.146:0/2950301386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed24140800 0x7fed24140c40 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:13.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.997+0000 7fed29562700 1 --2- 172.21.15.146:0/2950301386 >> v2:172.21.15.151:3300/0 conn(0x7fed2406b8a0 0x7fed240b0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:13.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.997+0000 7fed29562700 1 -- 172.21.15.146:0/2950301386 >> 172.21.15.146:0/2950301386 conn(0x7fed240ce230 msgr2=0x7fed240ce630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:13.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.997+0000 7fed29562700 1 -- 172.21.15.146:0/2950301386 shutdown_connections 2023-10-06T11:06:13.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.997+0000 7fed29562700 1 -- 172.21.15.146:0/2950301386 wait complete. 2023-10-06T11:06:13.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.998+0000 7fed29562700 1 Processor -- start 2023-10-06T11:06:13.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.998+0000 7fed29562700 1 -- start start 2023-10-06T11:06:13.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.999+0000 7fed29562700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fed2406b8a0 0x7fed240c64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:13.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.999+0000 7fed29562700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed2406bc70 0x7fed240c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:13.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.999+0000 7fed29562700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed24140800 0x7fed240aa140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:13.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.999+0000 7fed29562700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed24068bc0 con 0x7fed24140800 2023-10-06T11:06:13.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.999+0000 7fed29562700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed240c6f60 con 0x7fed2406bc70 2023-10-06T11:06:13.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.999+0000 7fed29562700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed240c7230 con 0x7fed2406b8a0 2023-10-06T11:06:13.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.999+0000 7fed28d61700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed24140800 0x7fed240aa140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:13.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.999+0000 7fed28d61700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed24140800 0x7fed240aa140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39332/0 (socket says 172.21.15.146:39332) 2023-10-06T11:06:13.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.999+0000 7fed28d61700 1 -- 172.21.15.146:0/3929406414 learned_addr learned my addr 172.21.15.146:0/3929406414 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:13.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.999+0000 7fed23fff700 1 --2- 172.21.15.146:0/3929406414 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fed2406b8a0 0x7fed240c64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:13.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.999+0000 7fed237fe700 1 --2- 172.21.15.146:0/3929406414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed2406bc70 0x7fed240c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:13.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.999+0000 7fed28d61700 1 -- 172.21.15.146:0/3929406414 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fed2406b8a0 msgr2=0x7fed240c64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:13.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:12.999+0000 7fed28d61700 1 --2- 172.21.15.146:0/3929406414 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fed2406b8a0 0x7fed240c64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:13.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.000+0000 7fed28d61700 1 -- 172.21.15.146:0/3929406414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed2406bc70 msgr2=0x7fed240c6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:13.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.000+0000 7fed28d61700 1 --2- 172.21.15.146:0/3929406414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed2406bc70 0x7fed240c6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:13.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.000+0000 7fed28d61700 1 -- 172.21.15.146:0/3929406414 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed1c009a20 con 0x7fed24140800 2023-10-06T11:06:13.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.000+0000 7fed28d61700 1 --2- 172.21.15.146:0/3929406414 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed24140800 0x7fed240aa140 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fed2406fdd0 tx=0x7fed1c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:13.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.000+0000 7fed0bfff700 1 -- 172.21.15.146:0/3929406414 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1c027470 con 0x7fed24140800 2023-10-06T11:06:13.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.000+0000 7fed0bfff700 1 -- 172.21.15.146:0/3929406414 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed1c0275d0 con 0x7fed24140800 2023-10-06T11:06:13.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.000+0000 7fed0bfff700 1 -- 172.21.15.146:0/3929406414 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed1c027990 con 0x7fed24140800 2023-10-06T11:06:13.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.000+0000 7fed29562700 1 -- 172.21.15.146:0/3929406414 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed240c7510 con 0x7fed24140800 2023-10-06T11:06:13.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.000+0000 7fed29562700 1 -- 172.21.15.146:0/3929406414 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed240c7ad0 con 0x7fed24140800 2023-10-06T11:06:13.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.001+0000 7fed29562700 1 -- 172.21.15.146:0/3929406414 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed2406eb80 con 0x7fed24140800 2023-10-06T11:06:13.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.001+0000 7fed0bfff700 1 -- 172.21.15.146:0/3929406414 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fed1c024070 con 0x7fed24140800 2023-10-06T11:06:13.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.001+0000 7fed0bfff700 1 --2- 172.21.15.146:0/3929406414 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fed10066f30 0x7fed100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:13.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.002+0000 7fed0bfff700 1 -- 172.21.15.146:0/3929406414 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fed1c086ea0 con 0x7fed24140800 2023-10-06T11:06:13.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.002+0000 7fed23fff700 1 --2- 172.21.15.146:0/3929406414 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fed10066f30 0x7fed100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:13.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.002+0000 7fed23fff700 1 --2- 172.21.15.146:0/3929406414 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fed10066f30 0x7fed100693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fed14006fd0 tx=0x7fed14008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:13.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.006+0000 7fed0bfff700 1 -- 172.21.15.146:0/3929406414 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fed1c053fc0 con 0x7fed24140800 2023-10-06T11:06:13.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.189+0000 7fed29562700 1 -- 172.21.15.146:0/3929406414 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fed2404bb40 con 0x7fed24140800 2023-10-06T11:06:13.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.189+0000 7fed0bfff700 1 -- 172.21.15.146:0/3929406414 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7fed1c02c020 con 0x7fed24140800 2023-10-06T11:06:13.191 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-10-06T11:06:13.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.191+0000 7fed29562700 1 -- 172.21.15.146:0/3929406414 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fed10066f30 msgr2=0x7fed100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:13.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.191+0000 7fed29562700 1 --2- 172.21.15.146:0/3929406414 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fed10066f30 0x7fed100693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fed14006fd0 tx=0x7fed14008040 comp rx=0 tx=0).stop 2023-10-06T11:06:13.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.191+0000 7fed29562700 1 -- 172.21.15.146:0/3929406414 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed24140800 msgr2=0x7fed240aa140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:13.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.191+0000 7fed29562700 1 --2- 172.21.15.146:0/3929406414 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed24140800 0x7fed240aa140 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fed2406fdd0 tx=0x7fed1c019000 comp rx=0 tx=0).stop 2023-10-06T11:06:13.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.191+0000 7fed29562700 1 -- 172.21.15.146:0/3929406414 shutdown_connections 2023-10-06T11:06:13.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.191+0000 7fed29562700 1 --2- 172.21.15.146:0/3929406414 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fed10066f30 0x7fed100693e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:13.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.191+0000 7fed29562700 1 --2- 172.21.15.146:0/3929406414 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed24140800 0x7fed240aa140 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:13.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.191+0000 7fed29562700 1 --2- 172.21.15.146:0/3929406414 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fed2406b8a0 0x7fed240c64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:13.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.191+0000 7fed29562700 1 --2- 172.21.15.146:0/3929406414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed2406bc70 0x7fed240c6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:13.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.191+0000 7fed29562700 1 -- 172.21.15.146:0/3929406414 >> 172.21.15.146:0/3929406414 conn(0x7fed240ce230 msgr2=0x7fed2413fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:13.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.191+0000 7fed29562700 1 -- 172.21.15.146:0/3929406414 shutdown_connections 2023-10-06T11:06:13.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.191+0000 7fed29562700 1 -- 172.21.15.146:0/3929406414 wait complete. 2023-10-06T11:06:13.205 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:06:13.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.320+0000 7f3ac3adc700 1 Processor -- start 2023-10-06T11:06:13.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.320+0000 7f3ac3adc700 1 -- start start 2023-10-06T11:06:13.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.321+0000 7f3ac3adc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3abc0c7810 0x7f3abc15e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:13.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.321+0000 7f3ac3adc700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3abc0d1670 con 0x7f3abc159f40 2023-10-06T11:06:13.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.321+0000 7f3ac3adc700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3abc0cee70 con 0x7f3abc15e5f0 2023-10-06T11:06:13.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.321+0000 7f3ac3adc700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3abc0cc4b0 con 0x7f3abc0c7810 2023-10-06T11:06:13.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.321+0000 7f3ac1077700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3abc0c7810 0x7f3abc15e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:13.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.321+0000 7f3ac1878700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3abc159f40 0x7f3abc15d9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49500/0 (socket says 172.21.15.146:49500) 2023-10-06T11:06:13.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.321+0000 7f3ac1878700 1 -- 172.21.15.146:0/3714998049 learned_addr learned my addr 172.21.15.146:0/3714998049 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:13.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.321+0000 7f3ac0876700 1 -- 172.21.15.146:0/3714998049 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3787081028 0 0) 0x7f3abc0d1670 con 0x7f3abc159f40 2023-10-06T11:06:13.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.322+0000 7f3ac0876700 1 -- 172.21.15.146:0/3714998049 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3aa8003570 con 0x7f3abc159f40 2023-10-06T11:06:13.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.322+0000 7f3ac1077700 1 -- 172.21.15.146:0/3714998049 >> v1:172.21.15.151:6789/0 conn(0x7f3abc15e5f0 legacy=0x7f3abc0cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:13.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.322+0000 7f3ac1077700 1 -- 172.21.15.146:0/3714998049 >> v1:172.21.15.146:6789/0 conn(0x7f3abc159f40 legacy=0x7f3abc15d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:13.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.322+0000 7f3ac1077700 1 -- 172.21.15.146:0/3714998049 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3abc06f990 con 0x7f3abc0c7810 2023-10-06T11:06:13.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.322+0000 7f3ac1077700 1 --2- 172.21.15.146:0/3714998049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3abc0c7810 0x7f3abc15e0b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3aac0098e0 tx=0x7f3aac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9b21c3b31f1154f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:13.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.322+0000 7f3ac0876700 1 -- 172.21.15.146:0/3714998049 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac011630 con 0x7f3abc0c7810 2023-10-06T11:06:13.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.322+0000 7f3ac0876700 1 -- 172.21.15.146:0/3714998049 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aac011790 con 0x7f3abc0c7810 2023-10-06T11:06:13.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.322+0000 7f3ac0876700 1 -- 172.21.15.146:0/3714998049 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac011b30 con 0x7f3abc0c7810 2023-10-06T11:06:13.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.322+0000 7f3ac3adc700 1 -- 172.21.15.146:0/3714998049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3abc0c7810 msgr2=0x7f3abc15e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:13.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.322+0000 7f3ac3adc700 1 --2- 172.21.15.146:0/3714998049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3abc0c7810 0x7f3abc15e0b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3aac0098e0 tx=0x7f3aac0091a0 comp rx=0 tx=0).stop 2023-10-06T11:06:13.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.322+0000 7f3ac3adc700 1 -- 172.21.15.146:0/3714998049 shutdown_connections 2023-10-06T11:06:13.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.322+0000 7f3ac3adc700 1 --2- 172.21.15.146:0/3714998049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3abc0c7810 0x7f3abc15e0b0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:13.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.322+0000 7f3ac3adc700 1 -- 172.21.15.146:0/3714998049 >> 172.21.15.146:0/3714998049 conn(0x7f3abc06f380 msgr2=0x7f3abc0d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:13.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.323+0000 7f3ac3adc700 1 -- 172.21.15.146:0/3714998049 shutdown_connections 2023-10-06T11:06:13.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.323+0000 7f3ac3adc700 1 -- 172.21.15.146:0/3714998049 wait complete. 2023-10-06T11:06:13.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.324+0000 7f3ac3adc700 1 Processor -- start 2023-10-06T11:06:13.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.324+0000 7f3ac3adc700 1 -- start start 2023-10-06T11:06:13.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.324+0000 7f3ac3adc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3abc0c7810 0x7f3abc16d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:13.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.324+0000 7f3ac3adc700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3abc159f40 0x7f3abc16a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:13.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.324+0000 7f3ac3adc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3abc15e5f0 0x7f3abc09a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:13.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.324+0000 7f3ac3adc700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc0c4920 con 0x7f3abc0c7810 2023-10-06T11:06:13.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.324+0000 7f3ac3adc700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc09ce40 con 0x7f3abc15e5f0 2023-10-06T11:06:13.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.324+0000 7f3ac3adc700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc0c42d0 con 0x7f3abc159f40 2023-10-06T11:06:13.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.324+0000 7f3ac1878700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3abc0c7810 0x7f3abc16d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:13.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.324+0000 7f3ac1878700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3abc0c7810 0x7f3abc16d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39350/0 (socket says 172.21.15.146:39350) 2023-10-06T11:06:13.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.324+0000 7f3ac1878700 1 -- 172.21.15.146:0/1077497499 learned_addr learned my addr 172.21.15.146:0/1077497499 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:13.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.325+0000 7f3ac1077700 1 --2- 172.21.15.146:0/1077497499 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3abc159f40 0x7f3abc16a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:13.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.325+0000 7f3ac2079700 1 --2- 172.21.15.146:0/1077497499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3abc15e5f0 0x7f3abc09a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:13.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.325+0000 7f3ac1878700 1 -- 172.21.15.146:0/1077497499 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3abc159f40 msgr2=0x7f3abc16a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:13.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.325+0000 7f3ac1878700 1 --2- 172.21.15.146:0/1077497499 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3abc159f40 0x7f3abc16a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:13.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.325+0000 7f3ac1878700 1 -- 172.21.15.146:0/1077497499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3abc15e5f0 msgr2=0x7f3abc09a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:13.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.325+0000 7f3ac1878700 1 --2- 172.21.15.146:0/1077497499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3abc15e5f0 0x7f3abc09a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:13.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.325+0000 7f3ac1878700 1 -- 172.21.15.146:0/1077497499 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aac009420 con 0x7f3abc0c7810 2023-10-06T11:06:13.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.325+0000 7f3ac2079700 1 --2- 172.21.15.146:0/1077497499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3abc15e5f0 0x7f3abc09a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:06:13.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.325+0000 7f3ac1878700 1 --2- 172.21.15.146:0/1077497499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3abc0c7810 0x7f3abc16d2c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3ab800cb10 tx=0x7f3ab80027e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:13.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.325+0000 7f3ab1ffb700 1 -- 172.21.15.146:0/1077497499 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab8003110 con 0x7f3abc0c7810 2023-10-06T11:06:13.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.325+0000 7f3ab1ffb700 1 -- 172.21.15.146:0/1077497499 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ab8005d80 con 0x7f3abc0c7810 2023-10-06T11:06:13.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.325+0000 7f3ab1ffb700 1 -- 172.21.15.146:0/1077497499 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab800a7e0 con 0x7f3abc0c7810 2023-10-06T11:06:13.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.325+0000 7f3ac3adc700 1 -- 172.21.15.146:0/1077497499 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3abc0c45b0 con 0x7f3abc0c7810 2023-10-06T11:06:13.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.325+0000 7f3ac3adc700 1 -- 172.21.15.146:0/1077497499 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3abc09d120 con 0x7f3abc0c7810 2023-10-06T11:06:13.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.326+0000 7f3ac3adc700 1 -- 172.21.15.146:0/1077497499 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3abc04c380 con 0x7f3abc0c7810 2023-10-06T11:06:13.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.326+0000 7f3ab1ffb700 1 -- 172.21.15.146:0/1077497499 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3ab800ac10 con 0x7f3abc0c7810 2023-10-06T11:06:13.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.327+0000 7f3ab1ffb700 1 --2- 172.21.15.146:0/1077497499 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3aa0066f30 0x7f3aa00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:13.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.327+0000 7f3ab1ffb700 1 -- 172.21.15.146:0/1077497499 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3ab8084450 con 0x7f3abc0c7810 2023-10-06T11:06:13.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.327+0000 7f3ac1077700 1 --2- 172.21.15.146:0/1077497499 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3aa0066f30 0x7f3aa00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:13.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.327+0000 7f3ac1077700 1 --2- 172.21.15.146:0/1077497499 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3aa0066f30 0x7f3aa00693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3aac0091e0 tx=0x7f3aac016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:13.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.331+0000 7f3ab1ffb700 1 -- 172.21.15.146:0/1077497499 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3ab80515e0 con 0x7f3abc0c7810 2023-10-06T11:06:13.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.518+0000 7f3ac3adc700 1 -- 172.21.15.146:0/1077497499 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3abc070890 con 0x7f3abc0c7810 2023-10-06T11:06:13.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.518+0000 7f3ab1ffb700 1 -- 172.21.15.146:0/1077497499 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3ab8054c00 con 0x7f3abc0c7810 2023-10-06T11:06:13.521 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-10-06T11:06:13.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.520+0000 7f3ac3adc700 1 -- 172.21.15.146:0/1077497499 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3aa0066f30 msgr2=0x7f3aa00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:13.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.520+0000 7f3ac3adc700 1 --2- 172.21.15.146:0/1077497499 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3aa0066f30 0x7f3aa00693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3aac0091e0 tx=0x7f3aac016000 comp rx=0 tx=0).stop 2023-10-06T11:06:13.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.520+0000 7f3ac3adc700 1 -- 172.21.15.146:0/1077497499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3abc0c7810 msgr2=0x7f3abc16d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:13.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.520+0000 7f3ac3adc700 1 --2- 172.21.15.146:0/1077497499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3abc0c7810 0x7f3abc16d2c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3ab800cb10 tx=0x7f3ab80027e0 comp rx=0 tx=0).stop 2023-10-06T11:06:13.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.520+0000 7f3ac3adc700 1 -- 172.21.15.146:0/1077497499 shutdown_connections 2023-10-06T11:06:13.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.520+0000 7f3ac3adc700 1 --2- 172.21.15.146:0/1077497499 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3aa0066f30 0x7f3aa00693e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:13.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.520+0000 7f3ac3adc700 1 --2- 172.21.15.146:0/1077497499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3abc15e5f0 0x7f3abc09a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:13.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.520+0000 7f3ac3adc700 1 --2- 172.21.15.146:0/1077497499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3abc0c7810 0x7f3abc16d2c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:13.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.521+0000 7f3ac3adc700 1 --2- 172.21.15.146:0/1077497499 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3abc159f40 0x7f3abc16a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:13.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.521+0000 7f3ac3adc700 1 -- 172.21.15.146:0/1077497499 >> 172.21.15.146:0/1077497499 conn(0x7f3abc06f380 msgr2=0x7f3abc159220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:13.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.521+0000 7f3ac3adc700 1 -- 172.21.15.146:0/1077497499 shutdown_connections 2023-10-06T11:06:13.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.521+0000 7f3ac3adc700 1 -- 172.21.15.146:0/1077497499 wait complete. 2023-10-06T11:06:13.534 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T11:06:13.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.649+0000 7f104b83a700 1 Processor -- start 2023-10-06T11:06:13.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.649+0000 7f104b83a700 1 -- start start 2023-10-06T11:06:13.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.650+0000 7f104b83a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f104415a160 0x7f10440c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:13.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.650+0000 7f104b83a700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f10440ae730 0x7f10440aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:13.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.650+0000 7f104b83a700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10440ae2a0 con 0x7f10440ce3d0 2023-10-06T11:06:13.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.650+0000 7f104b83a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f104415a530 con 0x7f104415a160 2023-10-06T11:06:13.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.650+0000 7f104b83a700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10440af0f0 con 0x7f10440ae730 2023-10-06T11:06:13.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.650+0000 7f10495d6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f104415a160 0x7f10440c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:13.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.650+0000 7f10495d6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f104415a160 0x7f10440c55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39356/0 (socket says 172.21.15.146:39356) 2023-10-06T11:06:13.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.650+0000 7f10495d6700 1 -- 172.21.15.146:0/3997233670 learned_addr learned my addr 172.21.15.146:0/3997233670 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:13.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.651+0000 7f1048dd5700 1 --2- 172.21.15.146:0/3997233670 >> v2:172.21.15.151:3300/0 conn(0x7f10440ae730 0x7f10440aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:13.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.651+0000 7f10495d6700 1 -- 172.21.15.146:0/3997233670 >> v2:172.21.15.151:3300/0 conn(0x7f10440ae730 msgr2=0x7f10440aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:13.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.651+0000 7f10495d6700 1 --2- 172.21.15.146:0/3997233670 >> v2:172.21.15.151:3300/0 conn(0x7f10440ae730 0x7f10440aebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:13.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.651+0000 7f10495d6700 1 -- 172.21.15.146:0/3997233670 >> v1:172.21.15.151:6789/0 conn(0x7f10440ce3d0 legacy=0x7f10440ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:13.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.651+0000 7f10495d6700 1 -- 172.21.15.146:0/3997233670 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10440ad690 con 0x7f104415a160 2023-10-06T11:06:13.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.651+0000 7f10495d6700 1 --2- 172.21.15.146:0/3997233670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f104415a160 0x7f10440c55a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f10440d16e0 tx=0x7f1034009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e247adad969bb6e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:13.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.651+0000 7f1043fff700 1 -- 172.21.15.146:0/3997233670 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103400e070 con 0x7f104415a160 2023-10-06T11:06:13.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.651+0000 7f1043fff700 1 -- 172.21.15.146:0/3997233670 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f103400bad0 con 0x7f104415a160 2023-10-06T11:06:13.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.651+0000 7f1043fff700 1 -- 172.21.15.146:0/3997233670 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10340092e0 con 0x7f104415a160 2023-10-06T11:06:13.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.651+0000 7f104b83a700 1 -- 172.21.15.146:0/3997233670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f104415a160 msgr2=0x7f10440c55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:13.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.651+0000 7f104b83a700 1 --2- 172.21.15.146:0/3997233670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f104415a160 0x7f10440c55a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f10440d16e0 tx=0x7f1034009840 comp rx=0 tx=0).stop 2023-10-06T11:06:13.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.651+0000 7f104b83a700 1 -- 172.21.15.146:0/3997233670 shutdown_connections 2023-10-06T11:06:13.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.651+0000 7f104b83a700 1 --2- 172.21.15.146:0/3997233670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f104415a160 0x7f10440c55a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:13.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.651+0000 7f104b83a700 1 --2- 172.21.15.146:0/3997233670 >> v2:172.21.15.151:3300/0 conn(0x7f10440ae730 0x7f10440aebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:13.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.652+0000 7f104b83a700 1 -- 172.21.15.146:0/3997233670 >> 172.21.15.146:0/3997233670 conn(0x7f104406f380 msgr2=0x7f10440d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:13.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.652+0000 7f104b83a700 1 -- 172.21.15.146:0/3997233670 shutdown_connections 2023-10-06T11:06:13.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.652+0000 7f104b83a700 1 -- 172.21.15.146:0/3997233670 wait complete. 2023-10-06T11:06:13.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.653+0000 7f104b83a700 1 Processor -- start 2023-10-06T11:06:13.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.653+0000 7f104b83a700 1 -- start start 2023-10-06T11:06:13.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.653+0000 7f104b83a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10440ae730 0x7f10441520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:13.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.653+0000 7f104b83a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10440ce3d0 0x7f104416b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:13.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.654+0000 7f104b83a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f104415a160 0x7f10440af260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:13.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.654+0000 7f104b83a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10440afb40 con 0x7f10440ce3d0 2023-10-06T11:06:13.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.654+0000 7f104b83a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10440af7a0 con 0x7f10440ae730 2023-10-06T11:06:13.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.654+0000 7f104b83a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10440afd90 con 0x7f104415a160 2023-10-06T11:06:13.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.654+0000 7f1048dd5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10440ce3d0 0x7f104416b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:13.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.654+0000 7f1048dd5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10440ce3d0 0x7f104416b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39372/0 (socket says 172.21.15.146:39372) 2023-10-06T11:06:13.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.654+0000 7f1048dd5700 1 -- 172.21.15.146:0/90025222 learned_addr learned my addr 172.21.15.146:0/90025222 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:13.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.654+0000 7f10495d6700 1 --2- 172.21.15.146:0/90025222 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10440ae730 0x7f10441520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:13.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.654+0000 7f1049dd7700 1 --2- 172.21.15.146:0/90025222 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f104415a160 0x7f10440af260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:13.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.654+0000 7f1048dd5700 1 -- 172.21.15.146:0/90025222 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f104415a160 msgr2=0x7f10440af260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:13.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.654+0000 7f1048dd5700 1 --2- 172.21.15.146:0/90025222 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f104415a160 0x7f10440af260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:13.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.654+0000 7f1048dd5700 1 -- 172.21.15.146:0/90025222 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10440ae730 msgr2=0x7f10441520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:13.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.654+0000 7f1048dd5700 1 --2- 172.21.15.146:0/90025222 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10440ae730 0x7f10441520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:13.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.654+0000 7f1048dd5700 1 -- 172.21.15.146:0/90025222 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1034009ae0 con 0x7f10440ce3d0 2023-10-06T11:06:13.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.654+0000 7f1048dd5700 1 --2- 172.21.15.146:0/90025222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10440ce3d0 0x7f104416b2c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f103800d860 tx=0x7f1038008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:13.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.654+0000 7f10417fa700 1 -- 172.21.15.146:0/90025222 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10380125f0 con 0x7f10440ce3d0 2023-10-06T11:06:13.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.654+0000 7f10417fa700 1 -- 172.21.15.146:0/90025222 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1038012750 con 0x7f10440ce3d0 2023-10-06T11:06:13.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.654+0000 7f104b83a700 1 -- 172.21.15.146:0/90025222 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10440b0070 con 0x7f10440ce3d0 2023-10-06T11:06:13.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.654+0000 7f10417fa700 1 -- 172.21.15.146:0/90025222 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1038012b10 con 0x7f10440ce3d0 2023-10-06T11:06:13.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.654+0000 7f104b83a700 1 -- 172.21.15.146:0/90025222 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10440b0630 con 0x7f10440ce3d0 2023-10-06T11:06:13.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.655+0000 7f104b83a700 1 -- 172.21.15.146:0/90025222 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1044068390 con 0x7f10440ce3d0 2023-10-06T11:06:13.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.656+0000 7f10417fa700 1 -- 172.21.15.146:0/90025222 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f103801e460 con 0x7f10440ce3d0 2023-10-06T11:06:13.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.656+0000 7f10417fa700 1 --2- 172.21.15.146:0/90025222 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1030066f30 0x7f10300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:13.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.656+0000 7f10495d6700 1 --2- 172.21.15.146:0/90025222 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1030066f30 0x7f10300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:13.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.656+0000 7f10417fa700 1 -- 172.21.15.146:0/90025222 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1038084b80 con 0x7f10440ce3d0 2023-10-06T11:06:13.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.657+0000 7f10495d6700 1 --2- 172.21.15.146:0/90025222 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1030066f30 0x7f10300693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1034009fd0 tx=0x7f1034018000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:13.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.660+0000 7f10417fa700 1 -- 172.21.15.146:0/90025222 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1038055720 con 0x7f10440ce3d0 2023-10-06T11:06:13.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.841+0000 7f104b83a700 1 -- 172.21.15.146:0/90025222 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f104404c380 con 0x7f10440ce3d0 2023-10-06T11:06:13.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.841+0000 7f10417fa700 1 -- 172.21.15.146:0/90025222 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f10380552b0 con 0x7f10440ce3d0 2023-10-06T11:06:13.843 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2023-10-06T11:06:13.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.843+0000 7f104b83a700 1 -- 172.21.15.146:0/90025222 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1030066f30 msgr2=0x7f10300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:13.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.843+0000 7f104b83a700 1 --2- 172.21.15.146:0/90025222 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1030066f30 0x7f10300693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1034009fd0 tx=0x7f1034018000 comp rx=0 tx=0).stop 2023-10-06T11:06:13.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.843+0000 7f104b83a700 1 -- 172.21.15.146:0/90025222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10440ce3d0 msgr2=0x7f104416b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:13.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.843+0000 7f104b83a700 1 --2- 172.21.15.146:0/90025222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10440ce3d0 0x7f104416b2c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f103800d860 tx=0x7f1038008040 comp rx=0 tx=0).stop 2023-10-06T11:06:13.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.843+0000 7f104b83a700 1 -- 172.21.15.146:0/90025222 shutdown_connections 2023-10-06T11:06:13.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.843+0000 7f104b83a700 1 --2- 172.21.15.146:0/90025222 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1030066f30 0x7f10300693e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:13.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.843+0000 7f104b83a700 1 --2- 172.21.15.146:0/90025222 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f104415a160 0x7f10440af260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:13.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.843+0000 7f104b83a700 1 --2- 172.21.15.146:0/90025222 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10440ae730 0x7f10441520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:13.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.843+0000 7f104b83a700 1 --2- 172.21.15.146:0/90025222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f10440ce3d0 0x7f104416b2c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:13.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.843+0000 7f104b83a700 1 -- 172.21.15.146:0/90025222 >> 172.21.15.146:0/90025222 conn(0x7f104406f380 msgr2=0x7f10440b2530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:13.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.843+0000 7f104b83a700 1 -- 172.21.15.146:0/90025222 shutdown_connections 2023-10-06T11:06:13.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.843+0000 7f104b83a700 1 -- 172.21.15.146:0/90025222 wait complete. 2023-10-06T11:06:13.857 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T11:06:13.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.972+0000 7f697f5c9700 1 Processor -- start 2023-10-06T11:06:13.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.973+0000 7f697f5c9700 1 -- start start 2023-10-06T11:06:13.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.973+0000 7f697f5c9700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f69780abfe0 0x7f69780add00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:13.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.973+0000 7f697f5c9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f69780ac3b0 0x7f69780ac800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:13.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.973+0000 7f697f5c9700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69780ae550 con 0x7f69780ceb50 2023-10-06T11:06:13.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.973+0000 7f697f5c9700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69780ae830 con 0x7f69780ac3b0 2023-10-06T11:06:13.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.973+0000 7f697f5c9700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69780aeb10 con 0x7f69780abfe0 2023-10-06T11:06:13.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.973+0000 7f697db66700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f69780ac3b0 0x7f69780ac800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:13.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.973+0000 7f697cb64700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f69780ceb50 0x7f69780af5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49502/0 (socket says 172.21.15.146:49502) 2023-10-06T11:06:13.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.973+0000 7f697cb64700 1 -- 172.21.15.146:0/1672195160 learned_addr learned my addr 172.21.15.146:0/1672195160 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:13.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.974+0000 7f697d365700 1 --2- 172.21.15.146:0/1672195160 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f69780abfe0 0x7f69780add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:13.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.974+0000 7f697db66700 1 -- 172.21.15.146:0/1672195160 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f69780abfe0 msgr2=0x7f69780add00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:13.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.974+0000 7f697db66700 1 --2- 172.21.15.146:0/1672195160 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f69780abfe0 0x7f69780add00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:13.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.974+0000 7f697db66700 1 -- 172.21.15.146:0/1672195160 >> v1:172.21.15.146:6789/0 conn(0x7f69780ceb50 legacy=0x7f69780af5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:13.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.974+0000 7f696ffff700 1 -- 172.21.15.146:0/1672195160 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4187482580 0 0) 0x7f69780ae550 con 0x7f69780ceb50 2023-10-06T11:06:13.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.974+0000 7f697db66700 1 -- 172.21.15.146:0/1672195160 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69780aedf0 con 0x7f69780ac3b0 2023-10-06T11:06:13.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.974+0000 7f697d365700 1 --2- 172.21.15.146:0/1672195160 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f69780abfe0 0x7f69780add00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:06:13.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.974+0000 7f697db66700 1 --2- 172.21.15.146:0/1672195160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69780ac3b0 0x7f69780ac800 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f69700098e0 tx=0x7f69700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39e868dcaad82595 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:13.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.974+0000 7f696ffff700 1 -- 172.21.15.146:0/1672195160 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6970009e80 con 0x7f69780ac3b0 2023-10-06T11:06:13.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.974+0000 7f696ffff700 1 -- 172.21.15.146:0/1672195160 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697000b860 con 0x7f69780ac3b0 2023-10-06T11:06:13.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.974+0000 7f696ffff700 1 -- 172.21.15.146:0/1672195160 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697000bbe0 con 0x7f69780ac3b0 2023-10-06T11:06:13.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.975+0000 7f697f5c9700 1 -- 172.21.15.146:0/1672195160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69780ac3b0 msgr2=0x7f69780ac800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:13.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.975+0000 7f697f5c9700 1 --2- 172.21.15.146:0/1672195160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69780ac3b0 0x7f69780ac800 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f69700098e0 tx=0x7f69700091a0 comp rx=0 tx=0).stop 2023-10-06T11:06:13.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.975+0000 7f697f5c9700 1 -- 172.21.15.146:0/1672195160 shutdown_connections 2023-10-06T11:06:13.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.975+0000 7f697f5c9700 1 --2- 172.21.15.146:0/1672195160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69780ac3b0 0x7f69780ac800 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:13.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.975+0000 7f697f5c9700 1 --2- 172.21.15.146:0/1672195160 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f69780abfe0 0x7f69780add00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:13.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.975+0000 7f697f5c9700 1 -- 172.21.15.146:0/1672195160 >> 172.21.15.146:0/1672195160 conn(0x7f6978067c50 msgr2=0x7f69780ce440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:13.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.975+0000 7f697f5c9700 1 -- 172.21.15.146:0/1672195160 shutdown_connections 2023-10-06T11:06:13.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.975+0000 7f697f5c9700 1 -- 172.21.15.146:0/1672195160 wait complete. 2023-10-06T11:06:13.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.976+0000 7f697f5c9700 1 Processor -- start 2023-10-06T11:06:13.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.976+0000 7f697f5c9700 1 -- start start 2023-10-06T11:06:13.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.977+0000 7f697f5c9700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69780abfe0 0x7f69781696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:13.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.977+0000 7f697f5c9700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f69780ac3b0 0x7f6978151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:13.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.977+0000 7f697f5c9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69780ceb50 0x7f69780cda00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:13.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.977+0000 7f697f5c9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6978169bf0 con 0x7f69780ceb50 2023-10-06T11:06:13.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.977+0000 7f697f5c9700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6978068890 con 0x7f69780abfe0 2023-10-06T11:06:13.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.977+0000 7f697f5c9700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6978069410 con 0x7f69780ac3b0 2023-10-06T11:06:13.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.977+0000 7f697db66700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69780ceb50 0x7f69780cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:13.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.977+0000 7f697db66700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69780ceb50 0x7f69780cda00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39394/0 (socket says 172.21.15.146:39394) 2023-10-06T11:06:13.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.977+0000 7f697db66700 1 -- 172.21.15.146:0/238678222 learned_addr learned my addr 172.21.15.146:0/238678222 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:13.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.977+0000 7f697cb64700 1 --2- 172.21.15.146:0/238678222 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f69780ac3b0 0x7f6978151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:13.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.977+0000 7f697d365700 1 --2- 172.21.15.146:0/238678222 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69780abfe0 0x7f69781696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:13.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.977+0000 7f697db66700 1 -- 172.21.15.146:0/238678222 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f69780ac3b0 msgr2=0x7f6978151550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:13.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.977+0000 7f697db66700 1 --2- 172.21.15.146:0/238678222 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f69780ac3b0 0x7f6978151550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:13.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.977+0000 7f697db66700 1 -- 172.21.15.146:0/238678222 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69780abfe0 msgr2=0x7f69781696b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:13.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.977+0000 7f697db66700 1 --2- 172.21.15.146:0/238678222 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69780abfe0 0x7f69781696b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:13.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.977+0000 7f697db66700 1 -- 172.21.15.146:0/238678222 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6970009420 con 0x7f69780ceb50 2023-10-06T11:06:13.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.977+0000 7f697d365700 1 --2- 172.21.15.146:0/238678222 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69780abfe0 0x7f69781696b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:06:13.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.977+0000 7f697db66700 1 --2- 172.21.15.146:0/238678222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69780ceb50 0x7f69780cda00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f697806e8e0 tx=0x7f6970017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:13.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.977+0000 7f696d7fa700 1 -- 172.21.15.146:0/238678222 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697001f070 con 0x7f69780ceb50 2023-10-06T11:06:13.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.978+0000 7f696d7fa700 1 -- 172.21.15.146:0/238678222 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6970011420 con 0x7f69780ceb50 2023-10-06T11:06:13.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.978+0000 7f697f5c9700 1 -- 172.21.15.146:0/238678222 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6978151a90 con 0x7f69780ceb50 2023-10-06T11:06:13.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.978+0000 7f696d7fa700 1 -- 172.21.15.146:0/238678222 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697000bbe0 con 0x7f69780ceb50 2023-10-06T11:06:13.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.978+0000 7f697f5c9700 1 -- 172.21.15.146:0/238678222 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6978068dc0 con 0x7f69780ceb50 2023-10-06T11:06:13.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.979+0000 7f697f5c9700 1 -- 172.21.15.146:0/238678222 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f697804c380 con 0x7f69780ceb50 2023-10-06T11:06:13.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.979+0000 7f696d7fa700 1 -- 172.21.15.146:0/238678222 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6970011a90 con 0x7f69780ceb50 2023-10-06T11:06:13.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.979+0000 7f696d7fa700 1 --2- 172.21.15.146:0/238678222 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f695c066f30 0x7f695c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:13.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.979+0000 7f696d7fa700 1 -- 172.21.15.146:0/238678222 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6970085d20 con 0x7f69780ceb50 2023-10-06T11:06:13.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.979+0000 7f697d365700 1 --2- 172.21.15.146:0/238678222 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f695c066f30 0x7f695c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:13.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.980+0000 7f697d365700 1 --2- 172.21.15.146:0/238678222 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f695c066f30 0x7f695c0693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f69740094d0 tx=0x7f697400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:13.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:13.984+0000 7f696d7fa700 1 -- 172.21.15.146:0/238678222 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6970052e30 con 0x7f69780ceb50 2023-10-06T11:06:14.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.165+0000 7f697f5c9700 1 -- 172.21.15.146:0/238678222 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f69780af100 con 0x7f69780ceb50 2023-10-06T11:06:14.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.166+0000 7f696d7fa700 1 -- 172.21.15.146:0/238678222 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f69700280a0 con 0x7f69780ceb50 2023-10-06T11:06:14.168 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2023-10-06T11:06:14.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.168+0000 7f697f5c9700 1 -- 172.21.15.146:0/238678222 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f695c066f30 msgr2=0x7f695c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:14.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.168+0000 7f697f5c9700 1 --2- 172.21.15.146:0/238678222 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f695c066f30 0x7f695c0693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f69740094d0 tx=0x7f697400b040 comp rx=0 tx=0).stop 2023-10-06T11:06:14.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.168+0000 7f697f5c9700 1 -- 172.21.15.146:0/238678222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69780ceb50 msgr2=0x7f69780cda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:14.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.168+0000 7f697f5c9700 1 --2- 172.21.15.146:0/238678222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69780ceb50 0x7f69780cda00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f697806e8e0 tx=0x7f6970017000 comp rx=0 tx=0).stop 2023-10-06T11:06:14.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.168+0000 7f697f5c9700 1 -- 172.21.15.146:0/238678222 shutdown_connections 2023-10-06T11:06:14.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.168+0000 7f697f5c9700 1 --2- 172.21.15.146:0/238678222 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f695c066f30 0x7f695c0693e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:14.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.168+0000 7f697f5c9700 1 --2- 172.21.15.146:0/238678222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69780ceb50 0x7f69780cda00 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:14.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.168+0000 7f697f5c9700 1 --2- 172.21.15.146:0/238678222 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69780abfe0 0x7f69781696b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:14.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.168+0000 7f697f5c9700 1 --2- 172.21.15.146:0/238678222 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f69780ac3b0 0x7f6978151550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:14.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.168+0000 7f697f5c9700 1 -- 172.21.15.146:0/238678222 >> 172.21.15.146:0/238678222 conn(0x7f6978067c50 msgr2=0x7f69780ac8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:14.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.168+0000 7f697f5c9700 1 -- 172.21.15.146:0/238678222 shutdown_connections 2023-10-06T11:06:14.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.168+0000 7f697f5c9700 1 -- 172.21.15.146:0/238678222 wait complete. 2023-10-06T11:06:14.182 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:06:14.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.294+0000 7f66fe771700 1 Processor -- start 2023-10-06T11:06:14.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.294+0000 7f66fe771700 1 -- start start 2023-10-06T11:06:14.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.295+0000 7f66fe771700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f66f80b0bd0 0x7f66f80b1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:14.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.295+0000 7f66fe771700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f66f8067470 0x7f66f8067890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:14.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.295+0000 7f66fe771700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66f8067dd0 con 0x7f66f8153e00 2023-10-06T11:06:14.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.295+0000 7f66fe771700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66f815a270 con 0x7f66f8067470 2023-10-06T11:06:14.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.295+0000 7f66fe771700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66f815a550 con 0x7f66f80b0bd0 2023-10-06T11:06:14.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.295+0000 7f66fcd0e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f66f8067470 0x7f66f8067890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:14.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.295+0000 7f66f7fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f66f8153e00 0x7f66f806b960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49516/0 (socket says 172.21.15.146:49516) 2023-10-06T11:06:14.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.295+0000 7f66f7fff700 1 -- 172.21.15.146:0/5029157 learned_addr learned my addr 172.21.15.146:0/5029157 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:14.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.296+0000 7f66f77fe700 1 --2- 172.21.15.146:0/5029157 >> v2:172.21.15.151:3300/0 conn(0x7f66f80b0bd0 0x7f66f80b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:14.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.296+0000 7f66fcd0e700 1 -- 172.21.15.146:0/5029157 >> v2:172.21.15.151:3300/0 conn(0x7f66f80b0bd0 msgr2=0x7f66f80b1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:14.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.296+0000 7f66fcd0e700 1 --2- 172.21.15.146:0/5029157 >> v2:172.21.15.151:3300/0 conn(0x7f66f80b0bd0 0x7f66f80b1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:14.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.296+0000 7f66fcd0e700 1 -- 172.21.15.146:0/5029157 >> v1:172.21.15.146:6789/0 conn(0x7f66f8153e00 legacy=0x7f66f806b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:14.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.296+0000 7f66f6ffd700 1 -- 172.21.15.146:0/5029157 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 425499279 0 0) 0x7f66f8067dd0 con 0x7f66f8153e00 2023-10-06T11:06:14.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.296+0000 7f66fcd0e700 1 -- 172.21.15.146:0/5029157 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f815a830 con 0x7f66f8067470 2023-10-06T11:06:14.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.296+0000 7f66f77fe700 1 --2- 172.21.15.146:0/5029157 >> v2:172.21.15.151:3300/0 conn(0x7f66f80b0bd0 0x7f66f80b1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:06:14.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.296+0000 7f66fcd0e700 1 --2- 172.21.15.146:0/5029157 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66f8067470 0x7f66f8067890 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f66f8068330 tx=0x7f66f0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa929d6af4f31517 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:14.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.296+0000 7f66f6ffd700 1 -- 172.21.15.146:0/5029157 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f000e070 con 0x7f66f8067470 2023-10-06T11:06:14.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.296+0000 7f66f6ffd700 1 -- 172.21.15.146:0/5029157 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f000bc30 con 0x7f66f8067470 2023-10-06T11:06:14.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.296+0000 7f66f6ffd700 1 -- 172.21.15.146:0/5029157 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f0012430 con 0x7f66f8067470 2023-10-06T11:06:14.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.296+0000 7f66fe771700 1 -- 172.21.15.146:0/5029157 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66f8067470 msgr2=0x7f66f8067890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:14.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.297+0000 7f66fe771700 1 --2- 172.21.15.146:0/5029157 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66f8067470 0x7f66f8067890 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f66f8068330 tx=0x7f66f0009780 comp rx=0 tx=0).stop 2023-10-06T11:06:14.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.297+0000 7f66fe771700 1 -- 172.21.15.146:0/5029157 shutdown_connections 2023-10-06T11:06:14.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.297+0000 7f66fe771700 1 --2- 172.21.15.146:0/5029157 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66f8067470 0x7f66f8067890 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:14.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.297+0000 7f66fe771700 1 --2- 172.21.15.146:0/5029157 >> v2:172.21.15.151:3300/0 conn(0x7f66f80b0bd0 0x7f66f80b1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:14.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.297+0000 7f66fe771700 1 -- 172.21.15.146:0/5029157 >> 172.21.15.146:0/5029157 conn(0x7f66f806b060 msgr2=0x7f66f80aecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:14.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.297+0000 7f66fe771700 1 -- 172.21.15.146:0/5029157 shutdown_connections 2023-10-06T11:06:14.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.297+0000 7f66fe771700 1 -- 172.21.15.146:0/5029157 wait complete. 2023-10-06T11:06:14.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.298+0000 7f66fe771700 1 Processor -- start 2023-10-06T11:06:14.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.298+0000 7f66fe771700 1 -- start start 2023-10-06T11:06:14.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.299+0000 7f66fe771700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66f8067470 0x7f66f8169330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:14.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.299+0000 7f66fe771700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f66f80b0bd0 0x7f66f814cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:14.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.299+0000 7f66fe771700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66f8153e00 0x7f66f816c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:14.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.299+0000 7f66fe771700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f80ca420 con 0x7f66f8067470 2023-10-06T11:06:14.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.299+0000 7f66fe771700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f816d3f0 con 0x7f66f80b0bd0 2023-10-06T11:06:14.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.299+0000 7f66fe771700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66f816d6d0 con 0x7f66f8153e00 2023-10-06T11:06:14.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.299+0000 7f66f7fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66f8067470 0x7f66f8169330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:14.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.299+0000 7f66f7fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66f8067470 0x7f66f8169330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39416/0 (socket says 172.21.15.146:39416) 2023-10-06T11:06:14.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.299+0000 7f66f7fff700 1 -- 172.21.15.146:0/4047574279 learned_addr learned my addr 172.21.15.146:0/4047574279 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:14.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.299+0000 7f66f77fe700 1 --2- 172.21.15.146:0/4047574279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f66f80b0bd0 0x7f66f814cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:14.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.299+0000 7f66fcd0e700 1 --2- 172.21.15.146:0/4047574279 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66f8153e00 0x7f66f816c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:14.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.299+0000 7f66f7fff700 1 -- 172.21.15.146:0/4047574279 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66f8153e00 msgr2=0x7f66f816c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:14.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.299+0000 7f66f7fff700 1 --2- 172.21.15.146:0/4047574279 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66f8153e00 0x7f66f816c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:14.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.299+0000 7f66f7fff700 1 -- 172.21.15.146:0/4047574279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f66f80b0bd0 msgr2=0x7f66f814cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:14.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.299+0000 7f66f7fff700 1 --2- 172.21.15.146:0/4047574279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f66f80b0bd0 0x7f66f814cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:14.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.299+0000 7f66f7fff700 1 -- 172.21.15.146:0/4047574279 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f0009a20 con 0x7f66f8067470 2023-10-06T11:06:14.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.299+0000 7f66f7fff700 1 --2- 172.21.15.146:0/4047574279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66f8067470 0x7f66f8169330 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f66e800c5b0 tx=0x7f66e8001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:14.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.299+0000 7f66dffff700 1 -- 172.21.15.146:0/4047574279 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e8005b30 con 0x7f66f8067470 2023-10-06T11:06:14.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.299+0000 7f66dffff700 1 -- 172.21.15.146:0/4047574279 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e8005c90 con 0x7f66f8067470 2023-10-06T11:06:14.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.299+0000 7f66dffff700 1 -- 172.21.15.146:0/4047574279 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e8007300 con 0x7f66f8067470 2023-10-06T11:06:14.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.299+0000 7f66fe771700 1 -- 172.21.15.146:0/4047574279 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f80ca0b0 con 0x7f66f8067470 2023-10-06T11:06:14.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.299+0000 7f66fe771700 1 -- 172.21.15.146:0/4047574279 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66f814d2d0 con 0x7f66f8067470 2023-10-06T11:06:14.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.300+0000 7f66fe771700 1 -- 172.21.15.146:0/4047574279 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66f80c9f10 con 0x7f66f8067470 2023-10-06T11:06:14.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.301+0000 7f66dffff700 1 -- 172.21.15.146:0/4047574279 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f66e801b3b0 con 0x7f66f8067470 2023-10-06T11:06:14.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.301+0000 7f66dffff700 1 --2- 172.21.15.146:0/4047574279 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f66e4066f30 0x7f66e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:14.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.301+0000 7f66dffff700 1 -- 172.21.15.146:0/4047574279 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f66e8083bc0 con 0x7f66f8067470 2023-10-06T11:06:14.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.301+0000 7f66f77fe700 1 --2- 172.21.15.146:0/4047574279 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f66e4066f30 0x7f66e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:14.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.301+0000 7f66f77fe700 1 --2- 172.21.15.146:0/4047574279 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f66e4066f30 0x7f66e40693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f66f8151fa0 tx=0x7f66ec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:14.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.305+0000 7f66dffff700 1 -- 172.21.15.146:0/4047574279 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f66f80c9f10 con 0x7f66f8067470 2023-10-06T11:06:14.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.490+0000 7f66fe771700 1 -- 172.21.15.146:0/4047574279 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f66f80c9f10 con 0x7f66f8067470 2023-10-06T11:06:14.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.491+0000 7f66dffff700 1 -- 172.21.15.146:0/4047574279 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16914 (secure 0 0 0) 0x7f66f80c9f10 con 0x7f66f8067470 2023-10-06T11:06:14.492 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:06:14.493 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":20,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:05:45.362089+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:05:41.403954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T11:05:42.698754+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:06:14.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.493+0000 7f66fe771700 1 -- 172.21.15.146:0/4047574279 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f66e4066f30 msgr2=0x7f66e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:14.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.493+0000 7f66fe771700 1 --2- 172.21.15.146:0/4047574279 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f66e4066f30 0x7f66e40693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f66f8151fa0 tx=0x7f66ec008040 comp rx=0 tx=0).stop 2023-10-06T11:06:14.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.493+0000 7f66fe771700 1 -- 172.21.15.146:0/4047574279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66f8067470 msgr2=0x7f66f8169330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:14.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.493+0000 7f66fe771700 1 --2- 172.21.15.146:0/4047574279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66f8067470 0x7f66f8169330 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f66e800c5b0 tx=0x7f66e8001070 comp rx=0 tx=0).stop 2023-10-06T11:06:14.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.493+0000 7f66fe771700 1 -- 172.21.15.146:0/4047574279 shutdown_connections 2023-10-06T11:06:14.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.493+0000 7f66fe771700 1 --2- 172.21.15.146:0/4047574279 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f66e4066f30 0x7f66e40693e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:14.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.493+0000 7f66fe771700 1 --2- 172.21.15.146:0/4047574279 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66f8153e00 0x7f66f816c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:14.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.493+0000 7f66fe771700 1 --2- 172.21.15.146:0/4047574279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66f8067470 0x7f66f8169330 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:14.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.493+0000 7f66fe771700 1 --2- 172.21.15.146:0/4047574279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f66f80b0bd0 0x7f66f814cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:14.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.493+0000 7f66fe771700 1 -- 172.21.15.146:0/4047574279 >> 172.21.15.146:0/4047574279 conn(0x7f66f806b060 msgr2=0x7f66f8152040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:14.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.493+0000 7f66fe771700 1 -- 172.21.15.146:0/4047574279 shutdown_connections 2023-10-06T11:06:14.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.493+0000 7f66fe771700 1 -- 172.21.15.146:0/4047574279 wait complete. 2023-10-06T11:06:14.507 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:05:36.687307+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:05:37.171199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T11:05:41.403954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T11:05:42.698754+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T11:06:14.507 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:06:14.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.622+0000 7fd52d786700 1 Processor -- start 2023-10-06T11:06:14.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.622+0000 7fd52d786700 1 -- start start 2023-10-06T11:06:14.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.623+0000 7fd52d786700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd5280ae730 0x7fd5280aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:14.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.623+0000 7fd52d786700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd5280cb950 0x7fd5280cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:14.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.623+0000 7fd52d786700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5280ae2a0 con 0x7fd52815a160 2023-10-06T11:06:14.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.623+0000 7fd52d786700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd52815a530 con 0x7fd5280cb950 2023-10-06T11:06:14.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.623+0000 7fd52d786700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5280c5cb0 con 0x7fd5280ae730 2023-10-06T11:06:14.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.623+0000 7fd5277fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd5280cb950 0x7fd5280cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:14.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.623+0000 7fd5277fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd5280cb950 0x7fd5280cbd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39422/0 (socket says 172.21.15.146:39422) 2023-10-06T11:06:14.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.623+0000 7fd5277fe700 1 -- 172.21.15.146:0/407736844 learned_addr learned my addr 172.21.15.146:0/407736844 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:14.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.623+0000 7fd5267fc700 1 --2- 172.21.15.146:0/407736844 >> v2:172.21.15.151:3300/0 conn(0x7fd5280ae730 0x7fd5280aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:14.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.623+0000 7fd5277fe700 1 -- 172.21.15.146:0/407736844 >> v2:172.21.15.151:3300/0 conn(0x7fd5280ae730 msgr2=0x7fd5280aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:14.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.623+0000 7fd5277fe700 1 --2- 172.21.15.146:0/407736844 >> v2:172.21.15.151:3300/0 conn(0x7fd5280ae730 0x7fd5280aebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:14.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.623+0000 7fd5277fe700 1 -- 172.21.15.146:0/407736844 >> v1:172.21.15.151:6789/0 conn(0x7fd52815a160 legacy=0x7fd5280c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:14.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.623+0000 7fd5277fe700 1 -- 172.21.15.146:0/407736844 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5280af0f0 con 0x7fd5280cb950 2023-10-06T11:06:14.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.624+0000 7fd5277fe700 1 --2- 172.21.15.146:0/407736844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5280cb950 0x7fd5280cbd40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd5280d16e0 tx=0x7fd520009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=458e829188038081 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:14.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.624+0000 7fd525ffb700 1 -- 172.21.15.146:0/407736844 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd520009e70 con 0x7fd5280cb950 2023-10-06T11:06:14.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.624+0000 7fd525ffb700 1 -- 172.21.15.146:0/407736844 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd52000b860 con 0x7fd5280cb950 2023-10-06T11:06:14.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.624+0000 7fd525ffb700 1 -- 172.21.15.146:0/407736844 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52000bc00 con 0x7fd5280cb950 2023-10-06T11:06:14.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.624+0000 7fd52d786700 1 -- 172.21.15.146:0/407736844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5280cb950 msgr2=0x7fd5280cbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:14.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.624+0000 7fd52d786700 1 --2- 172.21.15.146:0/407736844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5280cb950 0x7fd5280cbd40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd5280d16e0 tx=0x7fd520009250 comp rx=0 tx=0).stop 2023-10-06T11:06:14.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.624+0000 7fd52d786700 1 -- 172.21.15.146:0/407736844 shutdown_connections 2023-10-06T11:06:14.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.624+0000 7fd52d786700 1 --2- 172.21.15.146:0/407736844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5280cb950 0x7fd5280cbd40 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:14.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.624+0000 7fd52d786700 1 --2- 172.21.15.146:0/407736844 >> v2:172.21.15.151:3300/0 conn(0x7fd5280ae730 0x7fd5280aebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:14.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.624+0000 7fd52d786700 1 -- 172.21.15.146:0/407736844 >> 172.21.15.146:0/407736844 conn(0x7fd52806f380 msgr2=0x7fd5280d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:14.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.624+0000 7fd52d786700 1 -- 172.21.15.146:0/407736844 shutdown_connections 2023-10-06T11:06:14.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.624+0000 7fd52d786700 1 -- 172.21.15.146:0/407736844 wait complete. 2023-10-06T11:06:14.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.625+0000 7fd52d786700 1 Processor -- start 2023-10-06T11:06:14.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.626+0000 7fd52d786700 1 -- start start 2023-10-06T11:06:14.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.626+0000 7fd52d786700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5280ae730 0x7fd5280ca280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:14.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.626+0000 7fd52d786700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5280cb950 0x7fd528155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:14.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.626+0000 7fd52d786700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd52815a160 0x7fd5280cf340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:14.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.626+0000 7fd52d786700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd528156080 con 0x7fd5280ae730 2023-10-06T11:06:14.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.626+0000 7fd52d786700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52816af50 con 0x7fd5280cb950 2023-10-06T11:06:14.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.626+0000 7fd52d786700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd52816a340 con 0x7fd52815a160 2023-10-06T11:06:14.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.626+0000 7fd526ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5280ae730 0x7fd5280ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:14.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.626+0000 7fd526ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5280ae730 0x7fd5280ca280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39434/0 (socket says 172.21.15.146:39434) 2023-10-06T11:06:14.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.626+0000 7fd526ffd700 1 -- 172.21.15.146:0/1199448672 learned_addr learned my addr 172.21.15.146:0/1199448672 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:14.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.627+0000 7fd5277fe700 1 --2- 172.21.15.146:0/1199448672 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd52815a160 0x7fd5280cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:14.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.627+0000 7fd5267fc700 1 --2- 172.21.15.146:0/1199448672 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5280cb950 0x7fd528155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:14.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.627+0000 7fd526ffd700 1 -- 172.21.15.146:0/1199448672 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd52815a160 msgr2=0x7fd5280cf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:14.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.627+0000 7fd526ffd700 1 --2- 172.21.15.146:0/1199448672 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd52815a160 0x7fd5280cf340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:14.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.627+0000 7fd526ffd700 1 -- 172.21.15.146:0/1199448672 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5280cb950 msgr2=0x7fd528155b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:14.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.627+0000 7fd526ffd700 1 --2- 172.21.15.146:0/1199448672 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5280cb950 0x7fd528155b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:14.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.627+0000 7fd526ffd700 1 -- 172.21.15.146:0/1199448672 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5200094f0 con 0x7fd5280ae730 2023-10-06T11:06:14.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.627+0000 7fd5267fc700 1 --2- 172.21.15.146:0/1199448672 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5280cb950 0x7fd528155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:06:14.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.627+0000 7fd526ffd700 1 --2- 172.21.15.146:0/1199448672 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5280ae730 0x7fd5280ca280 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd51800cd30 tx=0x7fd518001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:14.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.627+0000 7fd50effd700 1 -- 172.21.15.146:0/1199448672 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51800ab70 con 0x7fd5280ae730 2023-10-06T11:06:14.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.627+0000 7fd50effd700 1 -- 172.21.15.146:0/1199448672 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51800acd0 con 0x7fd5280ae730 2023-10-06T11:06:14.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.627+0000 7fd50effd700 1 -- 172.21.15.146:0/1199448672 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd518012670 con 0x7fd5280ae730 2023-10-06T11:06:14.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.627+0000 7fd52d786700 1 -- 172.21.15.146:0/1199448672 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd52816a620 con 0x7fd5280ae730 2023-10-06T11:06:14.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.627+0000 7fd52d786700 1 -- 172.21.15.146:0/1199448672 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd52816abe0 con 0x7fd5280ae730 2023-10-06T11:06:14.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.628+0000 7fd52d786700 1 -- 172.21.15.146:0/1199448672 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd528068390 con 0x7fd5280ae730 2023-10-06T11:06:14.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.628+0000 7fd50effd700 1 -- 172.21.15.146:0/1199448672 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd518012a60 con 0x7fd5280ae730 2023-10-06T11:06:14.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.629+0000 7fd50effd700 1 --2- 172.21.15.146:0/1199448672 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd514066f30 0x7fd5140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:14.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.629+0000 7fd50effd700 1 -- 172.21.15.146:0/1199448672 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd518084e20 con 0x7fd5280ae730 2023-10-06T11:06:14.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.629+0000 7fd5267fc700 1 --2- 172.21.15.146:0/1199448672 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd514066f30 0x7fd5140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:14.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.629+0000 7fd5267fc700 1 --2- 172.21.15.146:0/1199448672 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd514066f30 0x7fd5140693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd51c006f00 tx=0x7fd51c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:14.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.633+0000 7fd50effd700 1 -- 172.21.15.146:0/1199448672 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd518051f30 con 0x7fd5280ae730 2023-10-06T11:06:14.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.815+0000 7fd52d786700 1 -- 172.21.15.146:0/1199448672 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd52804c380 con 0x7fd5280ae730 2023-10-06T11:06:14.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.816+0000 7fd50effd700 1 -- 172.21.15.146:0/1199448672 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd518055550 con 0x7fd5280ae730 2023-10-06T11:06:14.817 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-10-06T11:06:14.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.818+0000 7fd52d786700 1 -- 172.21.15.146:0/1199448672 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd514066f30 msgr2=0x7fd5140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:14.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.818+0000 7fd52d786700 1 --2- 172.21.15.146:0/1199448672 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd514066f30 0x7fd5140693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd51c006f00 tx=0x7fd51c008040 comp rx=0 tx=0).stop 2023-10-06T11:06:14.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.818+0000 7fd52d786700 1 -- 172.21.15.146:0/1199448672 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5280ae730 msgr2=0x7fd5280ca280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:14.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.818+0000 7fd52d786700 1 --2- 172.21.15.146:0/1199448672 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5280ae730 0x7fd5280ca280 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd51800cd30 tx=0x7fd518001b40 comp rx=0 tx=0).stop 2023-10-06T11:06:14.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.818+0000 7fd52d786700 1 -- 172.21.15.146:0/1199448672 shutdown_connections 2023-10-06T11:06:14.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.818+0000 7fd52d786700 1 --2- 172.21.15.146:0/1199448672 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd514066f30 0x7fd5140693e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:14.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.818+0000 7fd52d786700 1 --2- 172.21.15.146:0/1199448672 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd52815a160 0x7fd5280cf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:14.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.818+0000 7fd52d786700 1 --2- 172.21.15.146:0/1199448672 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5280ae730 0x7fd5280ca280 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:14.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.818+0000 7fd52d786700 1 --2- 172.21.15.146:0/1199448672 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5280cb950 0x7fd528155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:14.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.818+0000 7fd52d786700 1 -- 172.21.15.146:0/1199448672 >> 172.21.15.146:0/1199448672 conn(0x7fd52806f380 msgr2=0x7fd528069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:14.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.818+0000 7fd52d786700 1 -- 172.21.15.146:0/1199448672 shutdown_connections 2023-10-06T11:06:14.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.818+0000 7fd52d786700 1 -- 172.21.15.146:0/1199448672 wait complete. 2023-10-06T11:06:14.832 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:06:14.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.947+0000 7f6e919a3700 1 Processor -- start 2023-10-06T11:06:14.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.947+0000 7f6e919a3700 1 -- start start 2023-10-06T11:06:14.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.948+0000 7f6e919a3700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6e8c159f40 0x7f6e8c15d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:14.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.948+0000 7f6e919a3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c0d1670 con 0x7f6e8c15e5f0 2023-10-06T11:06:14.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.948+0000 7f6e919a3700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e8c0cee70 con 0x7f6e8c0c7810 2023-10-06T11:06:14.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.948+0000 7f6e919a3700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e8c0cc4b0 con 0x7f6e8c159f40 2023-10-06T11:06:14.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.948+0000 7f6e8b7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6e8c15e5f0 0x7f6e8c0cada0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49526/0 (socket says 172.21.15.146:49526) 2023-10-06T11:06:14.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.948+0000 7f6e8b7fe700 1 -- 172.21.15.146:0/440518872 learned_addr learned my addr 172.21.15.146:0/440518872 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:14.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.948+0000 7f6e8affd700 1 --2- 172.21.15.146:0/440518872 >> v2:172.21.15.151:3300/0 conn(0x7f6e8c159f40 0x7f6e8c15d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:14.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.948+0000 7f6e8a7fc700 1 -- 172.21.15.146:0/440518872 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1257071186 0 0) 0x7f6e8c0d1670 con 0x7f6e8c15e5f0 2023-10-06T11:06:14.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.948+0000 7f6e8a7fc700 1 -- 172.21.15.146:0/440518872 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e78003570 con 0x7f6e8c15e5f0 2023-10-06T11:06:14.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.949+0000 7f6e8a7fc700 1 -- 172.21.15.146:0/440518872 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1185133765 0 0) 0x7f6e78003570 con 0x7f6e8c15e5f0 2023-10-06T11:06:14.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.949+0000 7f6e8a7fc700 1 -- 172.21.15.146:0/440518872 >> v2:172.21.15.151:3300/0 conn(0x7f6e8c159f40 msgr2=0x7f6e8c15d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:14.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.949+0000 7f6e8a7fc700 1 --2- 172.21.15.146:0/440518872 >> v2:172.21.15.151:3300/0 conn(0x7f6e8c159f40 0x7f6e8c15d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:14.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.949+0000 7f6e8a7fc700 1 -- 172.21.15.146:0/440518872 >> v1:172.21.15.151:6789/0 conn(0x7f6e8c0c7810 legacy=0x7f6e8c15dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:14.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.949+0000 7f6e8a7fc700 1 -- 172.21.15.146:0/440518872 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e8c06f990 con 0x7f6e8c15e5f0 2023-10-06T11:06:14.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.949+0000 7f6e8a7fc700 1 -- 172.21.15.146:0/440518872 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f6e840017f0 con 0x7f6e8c15e5f0 2023-10-06T11:06:14.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.949+0000 7f6e8a7fc700 1 -- 172.21.15.146:0/440518872 >> v1:172.21.15.146:6789/0 conn(0x7f6e8c15e5f0 legacy=0x7f6e8c0cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:14.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.949+0000 7f6e8a7fc700 1 --2- 172.21.15.146:0/440518872 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e78003a60 0x7f6e78003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:14.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.949+0000 7f6e8a7fc700 1 --2- 172.21.15.146:0/440518872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e78004810 0x7f6e78004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:14.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.949+0000 7f6e8a7fc700 1 --2- 172.21.15.146:0/440518872 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e780051c0 0x7f6e7800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:14.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.949+0000 7f6e8a7fc700 1 -- 172.21.15.146:0/440518872 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c0cc4b0 con 0x7f6e78004810 2023-10-06T11:06:14.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.949+0000 7f6e8a7fc700 1 -- 172.21.15.146:0/440518872 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7800c0e0 con 0x7f6e78003a60 2023-10-06T11:06:14.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.949+0000 7f6e8a7fc700 1 -- 172.21.15.146:0/440518872 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7800c2a0 con 0x7f6e780051c0 2023-10-06T11:06:14.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.949+0000 7f6e827fc700 1 --2- 172.21.15.146:0/440518872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e78004810 0x7f6e78004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:14.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.949+0000 7f6e8affd700 1 --2- 172.21.15.146:0/440518872 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e78003a60 0x7f6e78003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:14.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.949+0000 7f6e8b7fe700 1 --2- 172.21.15.146:0/440518872 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e780051c0 0x7f6e7800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:14.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.949+0000 7f6e827fc700 1 -- 172.21.15.146:0/440518872 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e780051c0 msgr2=0x7f6e7800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:14.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.949+0000 7f6e827fc700 1 --2- 172.21.15.146:0/440518872 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e780051c0 0x7f6e7800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:14.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.949+0000 7f6e827fc700 1 -- 172.21.15.146:0/440518872 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e78003a60 msgr2=0x7f6e78003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:14.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.949+0000 7f6e827fc700 1 --2- 172.21.15.146:0/440518872 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e78003a60 0x7f6e78003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:14.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.949+0000 7f6e827fc700 1 -- 172.21.15.146:0/440518872 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e78003570 con 0x7f6e78004810 2023-10-06T11:06:14.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.949+0000 7f6e8b7fe700 1 --2- 172.21.15.146:0/440518872 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e780051c0 0x7f6e7800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:06:14.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.949+0000 7f6e8b7fe700 1 -- 172.21.15.146:0/440518872 reap_dead start 2023-10-06T11:06:14.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.949+0000 7f6e827fc700 1 --2- 172.21.15.146:0/440518872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e78004810 0x7f6e78004c80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6e740019a0 tx=0x7f6e74007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=742b5f86c66d716e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:14.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.949+0000 7f6e8a7fc700 1 -- 172.21.15.146:0/440518872 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7400c5d0 con 0x7f6e78004810 2023-10-06T11:06:14.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.949+0000 7f6e8a7fc700 1 -- 172.21.15.146:0/440518872 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7400c730 con 0x7f6e78004810 2023-10-06T11:06:14.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.949+0000 7f6e8a7fc700 1 -- 172.21.15.146:0/440518872 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7400cad0 con 0x7f6e78004810 2023-10-06T11:06:14.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.950+0000 7f6e919a3700 1 -- 172.21.15.146:0/440518872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e78004810 msgr2=0x7f6e78004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:14.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.950+0000 7f6e919a3700 1 --2- 172.21.15.146:0/440518872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e78004810 0x7f6e78004c80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6e740019a0 tx=0x7f6e74007d10 comp rx=0 tx=0).stop 2023-10-06T11:06:14.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.950+0000 7f6e919a3700 1 -- 172.21.15.146:0/440518872 shutdown_connections 2023-10-06T11:06:14.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.950+0000 7f6e919a3700 1 --2- 172.21.15.146:0/440518872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e78004810 0x7f6e78004c80 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:14.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.950+0000 7f6e919a3700 1 -- 172.21.15.146:0/440518872 >> 172.21.15.146:0/440518872 conn(0x7f6e8c06f380 msgr2=0x7f6e8c0d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:14.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.950+0000 7f6e919a3700 1 -- 172.21.15.146:0/440518872 shutdown_connections 2023-10-06T11:06:14.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.950+0000 7f6e919a3700 1 -- 172.21.15.146:0/440518872 wait complete. 2023-10-06T11:06:14.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.951+0000 7f6e919a3700 1 Processor -- start 2023-10-06T11:06:14.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.951+0000 7f6e919a3700 1 -- start start 2023-10-06T11:06:14.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.952+0000 7f6e919a3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e78004810 0x7f6e8c156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:14.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.952+0000 7f6e919a3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e8c15f560 0x7f6e8c152fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:14.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.952+0000 7f6e919a3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e8c0c4260 0x7f6e8c0cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:14.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.952+0000 7f6e919a3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c0b5500 con 0x7f6e8c15f560 2023-10-06T11:06:14.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.952+0000 7f6e919a3700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c156810 con 0x7f6e8c0c4260 2023-10-06T11:06:14.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.952+0000 7f6e919a3700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c156af0 con 0x7f6e78004810 2023-10-06T11:06:14.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.952+0000 7f6e827fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e8c15f560 0x7f6e8c152fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:14.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.952+0000 7f6e827fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e8c15f560 0x7f6e8c152fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39452/0 (socket says 172.21.15.146:39452) 2023-10-06T11:06:14.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.952+0000 7f6e8affd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e78004810 0x7f6e8c156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:14.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.952+0000 7f6e827fc700 1 -- 172.21.15.146:0/3649309075 learned_addr learned my addr 172.21.15.146:0/3649309075 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:14.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.952+0000 7f6e8b7fe700 1 --2- 172.21.15.146:0/3649309075 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e8c0c4260 0x7f6e8c0cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:14.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.952+0000 7f6e827fc700 1 -- 172.21.15.146:0/3649309075 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e78004810 msgr2=0x7f6e8c156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:14.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.952+0000 7f6e827fc700 1 --2- 172.21.15.146:0/3649309075 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e78004810 0x7f6e8c156180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:14.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.952+0000 7f6e827fc700 1 -- 172.21.15.146:0/3649309075 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e8c0c4260 msgr2=0x7f6e8c0cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:14.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.952+0000 7f6e827fc700 1 --2- 172.21.15.146:0/3649309075 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e8c0c4260 0x7f6e8c0cb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:14.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.952+0000 7f6e827fc700 1 -- 172.21.15.146:0/3649309075 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e8c0b5190 con 0x7f6e8c15f560 2023-10-06T11:06:14.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.953+0000 7f6e827fc700 1 --2- 172.21.15.146:0/3649309075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e8c15f560 0x7f6e8c152fd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6e7400c3c0 tx=0x7f6e74015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:14.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.953+0000 7f6e837fe700 1 -- 172.21.15.146:0/3649309075 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7400c5d0 con 0x7f6e8c15f560 2023-10-06T11:06:14.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.953+0000 7f6e837fe700 1 -- 172.21.15.146:0/3649309075 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7400ce40 con 0x7f6e8c15f560 2023-10-06T11:06:14.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.953+0000 7f6e837fe700 1 -- 172.21.15.146:0/3649309075 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e74007af0 con 0x7f6e8c15f560 2023-10-06T11:06:14.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.953+0000 7f6e919a3700 1 -- 172.21.15.146:0/3649309075 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e8c153510 con 0x7f6e8c15f560 2023-10-06T11:06:14.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.953+0000 7f6e919a3700 1 -- 172.21.15.146:0/3649309075 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e8c0b4db0 con 0x7f6e8c15f560 2023-10-06T11:06:14.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.954+0000 7f6e919a3700 1 -- 172.21.15.146:0/3649309075 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e8c0b4fd0 con 0x7f6e8c15f560 2023-10-06T11:06:14.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.954+0000 7f6e837fe700 1 -- 172.21.15.146:0/3649309075 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6e74019030 con 0x7f6e8c15f560 2023-10-06T11:06:14.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.954+0000 7f6e837fe700 1 --2- 172.21.15.146:0/3649309075 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6e6c066f30 0x7f6e6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:14.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.955+0000 7f6e837fe700 1 -- 172.21.15.146:0/3649309075 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6e74085c30 con 0x7f6e8c15f560 2023-10-06T11:06:14.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.955+0000 7f6e8affd700 1 --2- 172.21.15.146:0/3649309075 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6e6c066f30 0x7f6e6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:14.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.955+0000 7f6e8affd700 1 --2- 172.21.15.146:0/3649309075 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6e6c066f30 0x7f6e6c0693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c006ea0 tx=0x7f6e7c009120 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:14.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:14.959+0000 7f6e837fe700 1 -- 172.21.15.146:0/3649309075 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e74052e00 con 0x7f6e8c15f560 2023-10-06T11:06:15.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.140+0000 7f6e919a3700 1 -- 172.21.15.146:0/3649309075 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6e8c0b5320 con 0x7f6e8c15f560 2023-10-06T11:06:15.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.140+0000 7f6e837fe700 1 -- 172.21.15.146:0/3649309075 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6e74022020 con 0x7f6e8c15f560 2023-10-06T11:06:15.142 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-10-06T11:06:15.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.142+0000 7f6e919a3700 1 -- 172.21.15.146:0/3649309075 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6e6c066f30 msgr2=0x7f6e6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:15.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.142+0000 7f6e919a3700 1 --2- 172.21.15.146:0/3649309075 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6e6c066f30 0x7f6e6c0693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c006ea0 tx=0x7f6e7c009120 comp rx=0 tx=0).stop 2023-10-06T11:06:15.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.142+0000 7f6e919a3700 1 -- 172.21.15.146:0/3649309075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e8c15f560 msgr2=0x7f6e8c152fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:15.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.142+0000 7f6e919a3700 1 --2- 172.21.15.146:0/3649309075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e8c15f560 0x7f6e8c152fd0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6e7400c3c0 tx=0x7f6e74015000 comp rx=0 tx=0).stop 2023-10-06T11:06:15.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.142+0000 7f6e919a3700 1 -- 172.21.15.146:0/3649309075 shutdown_connections 2023-10-06T11:06:15.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.142+0000 7f6e919a3700 1 --2- 172.21.15.146:0/3649309075 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6e6c066f30 0x7f6e6c0693e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:15.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.142+0000 7f6e919a3700 1 --2- 172.21.15.146:0/3649309075 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e8c0c4260 0x7f6e8c0cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:15.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.142+0000 7f6e919a3700 1 --2- 172.21.15.146:0/3649309075 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e78004810 0x7f6e8c156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:15.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.142+0000 7f6e919a3700 1 --2- 172.21.15.146:0/3649309075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e8c15f560 0x7f6e8c152fd0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:15.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.142+0000 7f6e919a3700 1 -- 172.21.15.146:0/3649309075 >> 172.21.15.146:0/3649309075 conn(0x7f6e8c06f380 msgr2=0x7f6e8c15d930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:15.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.142+0000 7f6e919a3700 1 -- 172.21.15.146:0/3649309075 shutdown_connections 2023-10-06T11:06:15.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.142+0000 7f6e919a3700 1 -- 172.21.15.146:0/3649309075 wait complete. 2023-10-06T11:06:15.156 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T11:06:15.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.271+0000 7f3d65bbb700 1 Processor -- start 2023-10-06T11:06:15.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.271+0000 7f3d65bbb700 1 -- start start 2023-10-06T11:06:15.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.272+0000 7f3d65bbb700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3d600cc960 0x7f3d60164c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:15.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.272+0000 7f3d65bbb700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d600ccd80 con 0x7f3d600ae730 2023-10-06T11:06:15.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.272+0000 7f3d65bbb700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d600ae2a0 con 0x7f3d6015a160 2023-10-06T11:06:15.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.272+0000 7f3d65bbb700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d6015a530 con 0x7f3d600cc960 2023-10-06T11:06:15.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.272+0000 7f3d5effd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3d600ae730 0x7f3d600aebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49542/0 (socket says 172.21.15.146:49542) 2023-10-06T11:06:15.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.272+0000 7f3d5effd700 1 -- 172.21.15.146:0/1133332648 learned_addr learned my addr 172.21.15.146:0/1133332648 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:15.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.272+0000 7f3d5ffff700 1 --2- 172.21.15.146:0/1133332648 >> v2:172.21.15.151:3300/0 conn(0x7f3d600cc960 0x7f3d60164c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:15.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.272+0000 7f3d5e7fc700 1 -- 172.21.15.146:0/1133332648 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2618497801 0 0) 0x7f3d54001110 con 0x7f3d600ae730 2023-10-06T11:06:15.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.273+0000 7f3d5e7fc700 1 -- 172.21.15.146:0/1133332648 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d48003570 con 0x7f3d600ae730 2023-10-06T11:06:15.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.273+0000 7f3d5e7fc700 1 -- 172.21.15.146:0/1133332648 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 593505635 0 0) 0x7f3d600ae2a0 con 0x7f3d6015a160 2023-10-06T11:06:15.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.273+0000 7f3d5e7fc700 1 -- 172.21.15.146:0/1133332648 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d54001110 con 0x7f3d6015a160 2023-10-06T11:06:15.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.273+0000 7f3d5ffff700 1 -- 172.21.15.146:0/1133332648 >> v1:172.21.15.151:6789/0 conn(0x7f3d6015a160 legacy=0x7f3d600c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:15.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.273+0000 7f3d5ffff700 1 -- 172.21.15.146:0/1133332648 >> v1:172.21.15.146:6789/0 conn(0x7f3d600ae730 legacy=0x7f3d600aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:15.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.273+0000 7f3d5e7fc700 1 -- 172.21.15.146:0/1133332648 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1461861014 0 0) 0x7f3d48003570 con 0x7f3d600ae730 2023-10-06T11:06:15.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.273+0000 7f3d5ffff700 1 -- 172.21.15.146:0/1133332648 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d600c5cb0 con 0x7f3d600cc960 2023-10-06T11:06:15.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.273+0000 7f3d5ffff700 1 --2- 172.21.15.146:0/1133332648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d600cc960 0x7f3d60164c60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3d580098e0 tx=0x7f3d580091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=211b8dcb2b8682f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:15.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.273+0000 7f3d5e7fc700 1 -- 172.21.15.146:0/1133332648 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d54001600 con 0x7f3d600cc960 2023-10-06T11:06:15.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.273+0000 7f3d5e7fc700 1 -- 172.21.15.146:0/1133332648 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d58011420 con 0x7f3d600cc960 2023-10-06T11:06:15.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.273+0000 7f3d5e7fc700 1 -- 172.21.15.146:0/1133332648 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d580117c0 con 0x7f3d600cc960 2023-10-06T11:06:15.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.274+0000 7f3d65bbb700 1 -- 172.21.15.146:0/1133332648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d600cc960 msgr2=0x7f3d60164c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:15.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.274+0000 7f3d65bbb700 1 --2- 172.21.15.146:0/1133332648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d600cc960 0x7f3d60164c60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3d580098e0 tx=0x7f3d580091a0 comp rx=0 tx=0).stop 2023-10-06T11:06:15.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.274+0000 7f3d65bbb700 1 -- 172.21.15.146:0/1133332648 shutdown_connections 2023-10-06T11:06:15.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.274+0000 7f3d65bbb700 1 --2- 172.21.15.146:0/1133332648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d600cc960 0x7f3d60164c60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:15.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.274+0000 7f3d65bbb700 1 -- 172.21.15.146:0/1133332648 >> 172.21.15.146:0/1133332648 conn(0x7f3d6006f380 msgr2=0x7f3d600d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:15.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.274+0000 7f3d65bbb700 1 -- 172.21.15.146:0/1133332648 shutdown_connections 2023-10-06T11:06:15.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.274+0000 7f3d65bbb700 1 -- 172.21.15.146:0/1133332648 wait complete. 2023-10-06T11:06:15.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.275+0000 7f3d65bbb700 1 Processor -- start 2023-10-06T11:06:15.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.275+0000 7f3d65bbb700 1 -- start start 2023-10-06T11:06:15.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.276+0000 7f3d65bbb700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d600ae730 0x7f3d601506c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:15.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.276+0000 7f3d65bbb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d600cc960 0x7f3d60169c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:15.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.276+0000 7f3d65bbb700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d6015a160 0x7f3d600c9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:15.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.276+0000 7f3d65bbb700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d60150c00 con 0x7f3d600cc960 2023-10-06T11:06:15.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.276+0000 7f3d65bbb700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d60153c00 con 0x7f3d600ae730 2023-10-06T11:06:15.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.276+0000 7f3d65bbb700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d600cfbb0 con 0x7f3d6015a160 2023-10-06T11:06:15.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.276+0000 7f3d5effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d600cc960 0x7f3d60169c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:15.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.276+0000 7f3d5effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d600cc960 0x7f3d60169c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39464/0 (socket says 172.21.15.146:39464) 2023-10-06T11:06:15.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.276+0000 7f3d5effd700 1 -- 172.21.15.146:0/193567648 learned_addr learned my addr 172.21.15.146:0/193567648 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:15.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.276+0000 7f3d5f7fe700 1 --2- 172.21.15.146:0/193567648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d600ae730 0x7f3d601506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:15.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.276+0000 7f3d5ffff700 1 --2- 172.21.15.146:0/193567648 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d6015a160 0x7f3d600c9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:15.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.276+0000 7f3d5effd700 1 -- 172.21.15.146:0/193567648 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d6015a160 msgr2=0x7f3d600c9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:15.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.276+0000 7f3d5effd700 1 --2- 172.21.15.146:0/193567648 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d6015a160 0x7f3d600c9240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:15.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.276+0000 7f3d5effd700 1 -- 172.21.15.146:0/193567648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d600ae730 msgr2=0x7f3d601506c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:15.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.276+0000 7f3d5effd700 1 --2- 172.21.15.146:0/193567648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d600ae730 0x7f3d601506c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:15.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.276+0000 7f3d5effd700 1 -- 172.21.15.146:0/193567648 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d58009420 con 0x7f3d600cc960 2023-10-06T11:06:15.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.276+0000 7f3d5f7fe700 1 --2- 172.21.15.146:0/193567648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d600ae730 0x7f3d601506c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:06:15.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.276+0000 7f3d5effd700 1 --2- 172.21.15.146:0/193567648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d600cc960 0x7f3d60169c80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3d5400cb90 tx=0x7f3d54001ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:15.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.276+0000 7f3d477fe700 1 -- 172.21.15.146:0/193567648 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d54007430 con 0x7f3d600cc960 2023-10-06T11:06:15.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.276+0000 7f3d477fe700 1 -- 172.21.15.146:0/193567648 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d540075b0 con 0x7f3d600cc960 2023-10-06T11:06:15.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.276+0000 7f3d65bbb700 1 -- 172.21.15.146:0/193567648 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d60152d10 con 0x7f3d600cc960 2023-10-06T11:06:15.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.276+0000 7f3d477fe700 1 -- 172.21.15.146:0/193567648 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d54004a80 con 0x7f3d600cc960 2023-10-06T11:06:15.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.276+0000 7f3d65bbb700 1 -- 172.21.15.146:0/193567648 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d601532d0 con 0x7f3d600cc960 2023-10-06T11:06:15.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.277+0000 7f3d65bbb700 1 -- 172.21.15.146:0/193567648 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d60068390 con 0x7f3d600cc960 2023-10-06T11:06:15.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.278+0000 7f3d477fe700 1 -- 172.21.15.146:0/193567648 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3d5400a620 con 0x7f3d600cc960 2023-10-06T11:06:15.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.278+0000 7f3d477fe700 1 --2- 172.21.15.146:0/193567648 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3d4c066f30 0x7f3d4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:15.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.278+0000 7f3d5f7fe700 1 --2- 172.21.15.146:0/193567648 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3d4c066f30 0x7f3d4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:15.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.278+0000 7f3d477fe700 1 -- 172.21.15.146:0/193567648 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3d54083f70 con 0x7f3d600cc960 2023-10-06T11:06:15.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.279+0000 7f3d5f7fe700 1 --2- 172.21.15.146:0/193567648 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3d4c066f30 0x7f3d4c0693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3d5000d220 tx=0x7f3d50009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:15.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.283+0000 7f3d477fe700 1 -- 172.21.15.146:0/193567648 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d54051100 con 0x7f3d600cc960 2023-10-06T11:06:15.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.469+0000 7f3d65bbb700 1 -- 172.21.15.146:0/193567648 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3d600cdf00 con 0x7f3d600cc960 2023-10-06T11:06:15.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.469+0000 7f3d477fe700 1 -- 172.21.15.146:0/193567648 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3d54018020 con 0x7f3d600cc960 2023-10-06T11:06:15.471 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2023-10-06T11:06:15.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.471+0000 7f3d65bbb700 1 -- 172.21.15.146:0/193567648 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3d4c066f30 msgr2=0x7f3d4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:15.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.471+0000 7f3d65bbb700 1 --2- 172.21.15.146:0/193567648 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3d4c066f30 0x7f3d4c0693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3d5000d220 tx=0x7f3d50009040 comp rx=0 tx=0).stop 2023-10-06T11:06:15.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.471+0000 7f3d65bbb700 1 -- 172.21.15.146:0/193567648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d600cc960 msgr2=0x7f3d60169c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:15.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.471+0000 7f3d65bbb700 1 --2- 172.21.15.146:0/193567648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d600cc960 0x7f3d60169c80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3d5400cb90 tx=0x7f3d54001ce0 comp rx=0 tx=0).stop 2023-10-06T11:06:15.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.471+0000 7f3d65bbb700 1 -- 172.21.15.146:0/193567648 shutdown_connections 2023-10-06T11:06:15.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.471+0000 7f3d65bbb700 1 --2- 172.21.15.146:0/193567648 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3d4c066f30 0x7f3d4c0693e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:15.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.471+0000 7f3d65bbb700 1 --2- 172.21.15.146:0/193567648 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d6015a160 0x7f3d600c9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:15.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.471+0000 7f3d65bbb700 1 --2- 172.21.15.146:0/193567648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d600ae730 0x7f3d601506c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:15.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.471+0000 7f3d65bbb700 1 --2- 172.21.15.146:0/193567648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d600cc960 0x7f3d60169c80 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:15.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.471+0000 7f3d65bbb700 1 -- 172.21.15.146:0/193567648 >> 172.21.15.146:0/193567648 conn(0x7f3d6006f380 msgr2=0x7f3d601525b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:15.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.471+0000 7f3d65bbb700 1 -- 172.21.15.146:0/193567648 shutdown_connections 2023-10-06T11:06:15.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.471+0000 7f3d65bbb700 1 -- 172.21.15.146:0/193567648 wait complete. 2023-10-06T11:06:15.485 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T11:06:15.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.600+0000 7f32efef7700 1 Processor -- start 2023-10-06T11:06:15.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.600+0000 7f32efef7700 1 -- start start 2023-10-06T11:06:15.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.601+0000 7f32efef7700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f32e815a160 0x7f32e80c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:15.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.601+0000 7f32efef7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f32e80ae730 0x7f32e80aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:15.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.601+0000 7f32efef7700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32e80ce3d0 0x7f32e80ce810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:15.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.601+0000 7f32efef7700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32e80ae2a0 con 0x7f32e80ae730 2023-10-06T11:06:15.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.601+0000 7f32efef7700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32e815a530 con 0x7f32e815a160 2023-10-06T11:06:15.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.601+0000 7f32efef7700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e80af0f0 con 0x7f32e80ce3d0 2023-10-06T11:06:15.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.601+0000 7f32ed492700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f32e80ae730 0x7f32e80aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:15.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.601+0000 7f32ed492700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f32e80ae730 0x7f32e80aebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39472/0 (socket says 172.21.15.146:39472) 2023-10-06T11:06:15.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.601+0000 7f32ed492700 1 -- 172.21.15.146:0/2634037726 learned_addr learned my addr 172.21.15.146:0/2634037726 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:15.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.601+0000 7f32ee494700 1 --2- 172.21.15.146:0/2634037726 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32e80ce3d0 0x7f32e80ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:15.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.601+0000 7f32edc93700 1 --2- 172.21.15.146:0/2634037726 >> v2:172.21.15.151:3300/0 conn(0x7f32e815a160 0x7f32e80c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:15.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.601+0000 7f32ed492700 1 -- 172.21.15.146:0/2634037726 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32e80ce3d0 msgr2=0x7f32e80ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:15.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.601+0000 7f32ed492700 1 --2- 172.21.15.146:0/2634037726 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32e80ce3d0 0x7f32e80ce810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:15.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.601+0000 7f32ed492700 1 -- 172.21.15.146:0/2634037726 >> v2:172.21.15.151:3300/0 conn(0x7f32e815a160 msgr2=0x7f32e80c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:15.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.601+0000 7f32ed492700 1 --2- 172.21.15.146:0/2634037726 >> v2:172.21.15.151:3300/0 conn(0x7f32e815a160 0x7f32e80c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:15.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.601+0000 7f32ed492700 1 -- 172.21.15.146:0/2634037726 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e80ad690 con 0x7f32e80ae730 2023-10-06T11:06:15.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.602+0000 7f32ed492700 1 --2- 172.21.15.146:0/2634037726 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32e80ae730 0x7f32e80aebb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f32e8065100 tx=0x7f32d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a759649b1e551ea7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:15.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.602+0000 7f32ecc91700 1 -- 172.21.15.146:0/2634037726 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d800b860 con 0x7f32e80ae730 2023-10-06T11:06:15.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.602+0000 7f32ecc91700 1 -- 172.21.15.146:0/2634037726 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d800b9c0 con 0x7f32e80ae730 2023-10-06T11:06:15.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.602+0000 7f32ecc91700 1 -- 172.21.15.146:0/2634037726 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d800bd60 con 0x7f32e80ae730 2023-10-06T11:06:15.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.602+0000 7f32efef7700 1 -- 172.21.15.146:0/2634037726 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32e80ae730 msgr2=0x7f32e80aebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:15.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.602+0000 7f32efef7700 1 --2- 172.21.15.146:0/2634037726 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32e80ae730 0x7f32e80aebb0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f32e8065100 tx=0x7f32d8009250 comp rx=0 tx=0).stop 2023-10-06T11:06:15.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.602+0000 7f32efef7700 1 -- 172.21.15.146:0/2634037726 shutdown_connections 2023-10-06T11:06:15.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.602+0000 7f32efef7700 1 --2- 172.21.15.146:0/2634037726 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32e80ce3d0 0x7f32e80ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:15.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.602+0000 7f32efef7700 1 --2- 172.21.15.146:0/2634037726 >> v2:172.21.15.151:3300/0 conn(0x7f32e815a160 0x7f32e80c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:15.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.602+0000 7f32efef7700 1 --2- 172.21.15.146:0/2634037726 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32e80ae730 0x7f32e80aebb0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:15.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.602+0000 7f32efef7700 1 -- 172.21.15.146:0/2634037726 >> 172.21.15.146:0/2634037726 conn(0x7f32e806f380 msgr2=0x7f32e80d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:15.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.602+0000 7f32efef7700 1 -- 172.21.15.146:0/2634037726 shutdown_connections 2023-10-06T11:06:15.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.602+0000 7f32efef7700 1 -- 172.21.15.146:0/2634037726 wait complete. 2023-10-06T11:06:15.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.603+0000 7f32efef7700 1 Processor -- start 2023-10-06T11:06:15.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.603+0000 7f32efef7700 1 -- start start 2023-10-06T11:06:15.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.604+0000 7f32efef7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32e80ae730 0x7f32e8157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:15.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.604+0000 7f32efef7700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32e80ce3d0 0x7f32e80b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:15.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.604+0000 7f32efef7700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32e815a160 0x7f32e80b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:15.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.604+0000 7f32efef7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e80b1f80 con 0x7f32e80ae730 2023-10-06T11:06:15.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.604+0000 7f32efef7700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e816b0c0 con 0x7f32e80ce3d0 2023-10-06T11:06:15.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.604+0000 7f32efef7700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e816b550 con 0x7f32e815a160 2023-10-06T11:06:15.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.604+0000 7f32edc93700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32e80ae730 0x7f32e8157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:15.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.604+0000 7f32edc93700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32e80ae730 0x7f32e8157500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39478/0 (socket says 172.21.15.146:39478) 2023-10-06T11:06:15.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.604+0000 7f32edc93700 1 -- 172.21.15.146:0/3846318627 learned_addr learned my addr 172.21.15.146:0/3846318627 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:15.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.604+0000 7f32ee494700 1 --2- 172.21.15.146:0/3846318627 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32e815a160 0x7f32e80b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:15.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.604+0000 7f32ed492700 1 --2- 172.21.15.146:0/3846318627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32e80ce3d0 0x7f32e80b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:15.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.605+0000 7f32edc93700 1 -- 172.21.15.146:0/3846318627 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32e815a160 msgr2=0x7f32e80b18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:15.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.605+0000 7f32edc93700 1 --2- 172.21.15.146:0/3846318627 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32e815a160 0x7f32e80b18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:15.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.605+0000 7f32edc93700 1 -- 172.21.15.146:0/3846318627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32e80ce3d0 msgr2=0x7f32e80b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:15.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.605+0000 7f32edc93700 1 --2- 172.21.15.146:0/3846318627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32e80ce3d0 0x7f32e80b13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:15.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.605+0000 7f32edc93700 1 -- 172.21.15.146:0/3846318627 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d80094f0 con 0x7f32e80ae730 2023-10-06T11:06:15.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.605+0000 7f32edc93700 1 --2- 172.21.15.146:0/3846318627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32e80ae730 0x7f32e8157500 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f32e400e160 tx=0x7f32e4009970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:15.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.605+0000 7f32ddffb700 1 -- 172.21.15.146:0/3846318627 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e400eca0 con 0x7f32e80ae730 2023-10-06T11:06:15.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.605+0000 7f32ddffb700 1 -- 172.21.15.146:0/3846318627 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e400ee00 con 0x7f32e80ae730 2023-10-06T11:06:15.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.605+0000 7f32efef7700 1 -- 172.21.15.146:0/3846318627 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32e8157a40 con 0x7f32e80ae730 2023-10-06T11:06:15.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.605+0000 7f32ddffb700 1 -- 172.21.15.146:0/3846318627 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e4014670 con 0x7f32e80ae730 2023-10-06T11:06:15.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.605+0000 7f32efef7700 1 -- 172.21.15.146:0/3846318627 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32e816aa70 con 0x7f32e80ae730 2023-10-06T11:06:15.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.606+0000 7f32efef7700 1 -- 172.21.15.146:0/3846318627 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32e8069510 con 0x7f32e80ae730 2023-10-06T11:06:15.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.606+0000 7f32ddffb700 1 -- 172.21.15.146:0/3846318627 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f32e4014a20 con 0x7f32e80ae730 2023-10-06T11:06:15.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.607+0000 7f32ddffb700 1 --2- 172.21.15.146:0/3846318627 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f32cc066f30 0x7f32cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:15.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.607+0000 7f32ddffb700 1 -- 172.21.15.146:0/3846318627 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f32e4084d70 con 0x7f32e80ae730 2023-10-06T11:06:15.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.607+0000 7f32ed492700 1 --2- 172.21.15.146:0/3846318627 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f32cc066f30 0x7f32cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:15.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.607+0000 7f32ed492700 1 --2- 172.21.15.146:0/3846318627 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f32cc066f30 0x7f32cc0693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f32e8065100 tx=0x7f32d8017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:15.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.611+0000 7f32ddffb700 1 -- 172.21.15.146:0/3846318627 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f32e4051e80 con 0x7f32e80ae730 2023-10-06T11:06:15.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.792+0000 7f32efef7700 1 -- 172.21.15.146:0/3846318627 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f32e804c380 con 0x7f32e80ae730 2023-10-06T11:06:15.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.792+0000 7f32ddffb700 1 -- 172.21.15.146:0/3846318627 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f32e4009ab0 con 0x7f32e80ae730 2023-10-06T11:06:15.794 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2023-10-06T11:06:15.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.794+0000 7f32efef7700 1 -- 172.21.15.146:0/3846318627 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f32cc066f30 msgr2=0x7f32cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:15.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.794+0000 7f32efef7700 1 --2- 172.21.15.146:0/3846318627 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f32cc066f30 0x7f32cc0693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f32e8065100 tx=0x7f32d8017000 comp rx=0 tx=0).stop 2023-10-06T11:06:15.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.794+0000 7f32efef7700 1 -- 172.21.15.146:0/3846318627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32e80ae730 msgr2=0x7f32e8157500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:15.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.794+0000 7f32efef7700 1 --2- 172.21.15.146:0/3846318627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32e80ae730 0x7f32e8157500 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f32e400e160 tx=0x7f32e4009970 comp rx=0 tx=0).stop 2023-10-06T11:06:15.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.794+0000 7f32efef7700 1 -- 172.21.15.146:0/3846318627 shutdown_connections 2023-10-06T11:06:15.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.794+0000 7f32efef7700 1 --2- 172.21.15.146:0/3846318627 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f32cc066f30 0x7f32cc0693e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:15.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.794+0000 7f32efef7700 1 --2- 172.21.15.146:0/3846318627 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32e815a160 0x7f32e80b18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:15.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.794+0000 7f32efef7700 1 --2- 172.21.15.146:0/3846318627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32e80ae730 0x7f32e8157500 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:15.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.794+0000 7f32efef7700 1 --2- 172.21.15.146:0/3846318627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32e80ce3d0 0x7f32e80b13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:15.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.794+0000 7f32efef7700 1 -- 172.21.15.146:0/3846318627 >> 172.21.15.146:0/3846318627 conn(0x7f32e806f380 msgr2=0x7f32e80cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:15.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.794+0000 7f32efef7700 1 -- 172.21.15.146:0/3846318627 shutdown_connections 2023-10-06T11:06:15.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.795+0000 7f32efef7700 1 -- 172.21.15.146:0/3846318627 wait complete. 2023-10-06T11:06:15.808 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:06:15.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.920+0000 7f12971e9700 1 Processor -- start 2023-10-06T11:06:15.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.920+0000 7f12971e9700 1 -- start start 2023-10-06T11:06:15.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.921+0000 7f12971e9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f129015a7f0 0x7f129015cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:15.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.921+0000 7f12971e9700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f129015c630 con 0x7f12900b2530 2023-10-06T11:06:15.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.921+0000 7f12971e9700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f129015ba20 con 0x7f129015a420 2023-10-06T11:06:15.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.921+0000 7f12959e6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f129015a7f0 0x7f129015cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:15.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.921+0000 7f12971e9700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12900ce040 con 0x7f129015a7f0 2023-10-06T11:06:15.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.921+0000 7f12959e6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f129015a7f0 0x7f129015cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39486/0 (socket says 172.21.15.146:39486) 2023-10-06T11:06:15.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.921+0000 7f12959e6700 1 -- 172.21.15.146:0/4146461350 learned_addr learned my addr 172.21.15.146:0/4146461350 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:15.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.921+0000 7f12959e6700 1 -- 172.21.15.146:0/4146461350 >> v1:172.21.15.151:6789/0 conn(0x7f129015a420 legacy=0x7f12900b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:15.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.921+0000 7f12959e6700 1 -- 172.21.15.146:0/4146461350 >> v1:172.21.15.146:6789/0 conn(0x7f12900b2530 legacy=0x7f129015acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:15.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.922+0000 7f12959e6700 1 -- 172.21.15.146:0/4146461350 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f129015bd00 con 0x7f129015a7f0 2023-10-06T11:06:15.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.922+0000 7f12951e5700 1 -- 172.21.15.146:0/4146461350 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1902047274 0 0) 0x7f129015c630 con 0x7f12900b2530 2023-10-06T11:06:15.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.922+0000 7f12959e6700 1 --2- 172.21.15.146:0/4146461350 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f129015a7f0 0x7f129015cac0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f12800099b0 tx=0x7f1280009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a08d2e6da7942607 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:15.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.922+0000 7f12951e5700 1 -- 172.21.15.146:0/4146461350 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128000b860 con 0x7f129015a7f0 2023-10-06T11:06:15.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.922+0000 7f12951e5700 1 -- 172.21.15.146:0/4146461350 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128000b9c0 con 0x7f129015a7f0 2023-10-06T11:06:15.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.922+0000 7f12951e5700 1 -- 172.21.15.146:0/4146461350 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128000bd60 con 0x7f129015a7f0 2023-10-06T11:06:15.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.922+0000 7f12971e9700 1 -- 172.21.15.146:0/4146461350 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f129015a7f0 msgr2=0x7f129015cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:15.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.922+0000 7f12971e9700 1 --2- 172.21.15.146:0/4146461350 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f129015a7f0 0x7f129015cac0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f12800099b0 tx=0x7f1280009250 comp rx=0 tx=0).stop 2023-10-06T11:06:15.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.922+0000 7f12971e9700 1 -- 172.21.15.146:0/4146461350 shutdown_connections 2023-10-06T11:06:15.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.922+0000 7f12971e9700 1 --2- 172.21.15.146:0/4146461350 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f129015a7f0 0x7f129015cac0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:15.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.922+0000 7f12971e9700 1 -- 172.21.15.146:0/4146461350 >> 172.21.15.146:0/4146461350 conn(0x7f129006eba0 msgr2=0x7f129006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:15.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.922+0000 7f12971e9700 1 -- 172.21.15.146:0/4146461350 shutdown_connections 2023-10-06T11:06:15.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.922+0000 7f12971e9700 1 -- 172.21.15.146:0/4146461350 wait complete. 2023-10-06T11:06:15.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.923+0000 7f12971e9700 1 Processor -- start 2023-10-06T11:06:15.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.924+0000 7f12971e9700 1 -- start start 2023-10-06T11:06:15.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.924+0000 7f12971e9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12900b2530 0x7f1290147f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:15.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.924+0000 7f12971e9700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f129015a420 0x7f1290148950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:15.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.924+0000 7f12971e9700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f129015a7f0 0x7f129014adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:15.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.924+0000 7f12971e9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f129014a020 con 0x7f12900b2530 2023-10-06T11:06:15.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.924+0000 7f12971e9700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12901484c0 con 0x7f129015a7f0 2023-10-06T11:06:15.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.924+0000 7f12971e9700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1290149410 con 0x7f129015a420 2023-10-06T11:06:15.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.924+0000 7f12961e7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12900b2530 0x7f1290147f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:15.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.924+0000 7f12961e7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12900b2530 0x7f1290147f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39488/0 (socket says 172.21.15.146:39488) 2023-10-06T11:06:15.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.924+0000 7f12961e7700 1 -- 172.21.15.146:0/228140452 learned_addr learned my addr 172.21.15.146:0/228140452 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:15.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.924+0000 7f12969e8700 1 --2- 172.21.15.146:0/228140452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f129015a7f0 0x7f129014adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:15.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.924+0000 7f12959e6700 1 --2- 172.21.15.146:0/228140452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f129015a420 0x7f1290148950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:15.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.925+0000 7f12961e7700 1 -- 172.21.15.146:0/228140452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f129015a420 msgr2=0x7f1290148950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:15.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.925+0000 7f12961e7700 1 --2- 172.21.15.146:0/228140452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f129015a420 0x7f1290148950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:15.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.925+0000 7f12961e7700 1 -- 172.21.15.146:0/228140452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f129015a7f0 msgr2=0x7f129014adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:15.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.925+0000 7f12961e7700 1 --2- 172.21.15.146:0/228140452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f129015a7f0 0x7f129014adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:15.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.925+0000 7f12961e7700 1 -- 172.21.15.146:0/228140452 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12800094f0 con 0x7f12900b2530 2023-10-06T11:06:15.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.925+0000 7f12961e7700 1 --2- 172.21.15.146:0/228140452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12900b2530 0x7f1290147f80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f128c00c590 tx=0x7f128c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:15.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.925+0000 7f12867fc700 1 -- 172.21.15.146:0/228140452 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c011590 con 0x7f12900b2530 2023-10-06T11:06:15.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.925+0000 7f12867fc700 1 -- 172.21.15.146:0/228140452 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128c0116f0 con 0x7f12900b2530 2023-10-06T11:06:15.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.925+0000 7f12867fc700 1 -- 172.21.15.146:0/228140452 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c011ab0 con 0x7f12900b2530 2023-10-06T11:06:15.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.925+0000 7f12971e9700 1 -- 172.21.15.146:0/228140452 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12901496f0 con 0x7f12900b2530 2023-10-06T11:06:15.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.925+0000 7f12971e9700 1 -- 172.21.15.146:0/228140452 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1290149cb0 con 0x7f12900b2530 2023-10-06T11:06:15.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.926+0000 7f12971e9700 1 -- 172.21.15.146:0/228140452 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12900afae0 con 0x7f12900b2530 2023-10-06T11:06:15.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.926+0000 7f12867fc700 1 -- 172.21.15.146:0/228140452 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f128c01b3b0 con 0x7f12900b2530 2023-10-06T11:06:15.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.927+0000 7f12867fc700 1 --2- 172.21.15.146:0/228140452 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1274066f30 0x7f12740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:15.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.927+0000 7f12867fc700 1 -- 172.21.15.146:0/228140452 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f128c083bf0 con 0x7f12900b2530 2023-10-06T11:06:15.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.927+0000 7f12959e6700 1 --2- 172.21.15.146:0/228140452 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1274066f30 0x7f12740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:15.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.927+0000 7f12959e6700 1 --2- 172.21.15.146:0/228140452 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1274066f30 0x7f12740693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f12800099b0 tx=0x7f1280017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:15.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:15.931+0000 7f12867fc700 1 -- 172.21.15.146:0/228140452 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f128c050d00 con 0x7f12900b2530 2023-10-06T11:06:16.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.113+0000 7f12971e9700 1 -- 172.21.15.146:0/228140452 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f129015bfe0 con 0x7f12900b2530 2023-10-06T11:06:16.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.114+0000 7f12867fc700 1 -- 172.21.15.146:0/228140452 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16914 (secure 0 0 0) 0x7f128c017020 con 0x7f12900b2530 2023-10-06T11:06:16.116 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:06:16.116 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":20,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:05:45.362089+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:05:41.403954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T11:05:42.698754+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:06:16.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.116+0000 7f12971e9700 1 -- 172.21.15.146:0/228140452 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1274066f30 msgr2=0x7f12740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:16.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.116+0000 7f12971e9700 1 --2- 172.21.15.146:0/228140452 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1274066f30 0x7f12740693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f12800099b0 tx=0x7f1280017000 comp rx=0 tx=0).stop 2023-10-06T11:06:16.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.116+0000 7f12971e9700 1 -- 172.21.15.146:0/228140452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12900b2530 msgr2=0x7f1290147f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:16.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.116+0000 7f12971e9700 1 --2- 172.21.15.146:0/228140452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12900b2530 0x7f1290147f80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f128c00c590 tx=0x7f128c00c950 comp rx=0 tx=0).stop 2023-10-06T11:06:16.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.116+0000 7f12971e9700 1 -- 172.21.15.146:0/228140452 shutdown_connections 2023-10-06T11:06:16.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.116+0000 7f12971e9700 1 --2- 172.21.15.146:0/228140452 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1274066f30 0x7f12740693e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:16.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.116+0000 7f12971e9700 1 --2- 172.21.15.146:0/228140452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f129015a7f0 0x7f129014adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:16.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.116+0000 7f12971e9700 1 --2- 172.21.15.146:0/228140452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12900b2530 0x7f1290147f80 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:16.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.116+0000 7f12971e9700 1 --2- 172.21.15.146:0/228140452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f129015a420 0x7f1290148950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:16.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.116+0000 7f12971e9700 1 -- 172.21.15.146:0/228140452 >> 172.21.15.146:0/228140452 conn(0x7f129006eba0 msgr2=0x7f1290159610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:16.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.116+0000 7f12971e9700 1 -- 172.21.15.146:0/228140452 shutdown_connections 2023-10-06T11:06:16.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.116+0000 7f12971e9700 1 -- 172.21.15.146:0/228140452 wait complete. 2023-10-06T11:06:16.130 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:05:36.687307+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:05:37.171199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T11:05:41.403954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T11:05:42.698754+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T11:06:16.131 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:06:16.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.246+0000 7efd12bab700 1 Processor -- start 2023-10-06T11:06:16.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.246+0000 7efd12bab700 1 -- start start 2023-10-06T11:06:16.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.247+0000 7efd12bab700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd0c0cc960 0x7efd0c164c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:16.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.247+0000 7efd12bab700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd0c0ae2a0 con 0x7efd0c0ae730 2023-10-06T11:06:16.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.247+0000 7efd12bab700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd0c15a530 con 0x7efd0c15a160 2023-10-06T11:06:16.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.247+0000 7efd12bab700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c0ccdc0 con 0x7efd0c0cc960 2023-10-06T11:06:16.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.247+0000 7efd0bfff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7efd0c0ae730 0x7efd0c0aebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49558/0 (socket says 172.21.15.146:49558) 2023-10-06T11:06:16.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.247+0000 7efd0bfff700 1 -- 172.21.15.146:0/3031382165 learned_addr learned my addr 172.21.15.146:0/3031382165 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:16.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.247+0000 7efd0b7fe700 1 -- 172.21.15.146:0/3031382165 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1319765046 0 0) 0x7efd0c0ae2a0 con 0x7efd0c0ae730 2023-10-06T11:06:16.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.247+0000 7efd11148700 1 --2- 172.21.15.146:0/3031382165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd0c0cc960 0x7efd0c164c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:16.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.247+0000 7efd0b7fe700 1 -- 172.21.15.146:0/3031382165 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcf4003570 con 0x7efd0c0ae730 2023-10-06T11:06:16.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.248+0000 7efd0b7fe700 1 -- 172.21.15.146:0/3031382165 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 116688017 0 0) 0x7efcf4003570 con 0x7efd0c0ae730 2023-10-06T11:06:16.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.248+0000 7efd0b7fe700 1 -- 172.21.15.146:0/3031382165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd0c0cc960 msgr2=0x7efd0c164c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:16.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.248+0000 7efd0b7fe700 1 --2- 172.21.15.146:0/3031382165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd0c0cc960 0x7efd0c164c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:16.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.248+0000 7efd0b7fe700 1 -- 172.21.15.146:0/3031382165 >> v1:172.21.15.151:6789/0 conn(0x7efd0c15a160 legacy=0x7efd0c0c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:16.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.248+0000 7efd0b7fe700 1 -- 172.21.15.146:0/3031382165 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd0c0c5cb0 con 0x7efd0c0ae730 2023-10-06T11:06:16.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.248+0000 7efd0b7fe700 1 -- 172.21.15.146:0/3031382165 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7efd00001470 con 0x7efd0c0ae730 2023-10-06T11:06:16.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.248+0000 7efd0b7fe700 1 -- 172.21.15.146:0/3031382165 >> v1:172.21.15.146:6789/0 conn(0x7efd0c0ae730 legacy=0x7efd0c0aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:16.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.248+0000 7efd0b7fe700 1 --2- 172.21.15.146:0/3031382165 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcf4003a90 0x7efcf4003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:16.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.248+0000 7efd0b7fe700 1 --2- 172.21.15.146:0/3031382165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efcf4004810 0x7efcf4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:16.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.248+0000 7efd0b7fe700 1 --2- 172.21.15.146:0/3031382165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd0c0cc960 0x7efcf40051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:16.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.248+0000 7efd0b7fe700 1 -- 172.21.15.146:0/3031382165 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c0ccdc0 con 0x7efcf4003a90 2023-10-06T11:06:16.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.248+0000 7efd0b7fe700 1 -- 172.21.15.146:0/3031382165 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf400bb60 con 0x7efcf4004810 2023-10-06T11:06:16.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.248+0000 7efd0b7fe700 1 -- 172.21.15.146:0/3031382165 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf400bd20 con 0x7efd0c0cc960 2023-10-06T11:06:16.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.248+0000 7efd10947700 1 --2- 172.21.15.146:0/3031382165 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcf4003a90 0x7efcf4003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:16.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.248+0000 7efd0bfff700 1 --2- 172.21.15.146:0/3031382165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efcf4004810 0x7efcf4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:16.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.248+0000 7efd11148700 1 --2- 172.21.15.146:0/3031382165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd0c0cc960 0x7efcf40051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:16.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.248+0000 7efd10947700 1 -- 172.21.15.146:0/3031382165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd0c0cc960 msgr2=0x7efcf40051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:16.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.248+0000 7efd10947700 1 --2- 172.21.15.146:0/3031382165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd0c0cc960 0x7efcf40051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:16.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.248+0000 7efd10947700 1 -- 172.21.15.146:0/3031382165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efcf4004810 msgr2=0x7efcf4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:16.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.248+0000 7efd10947700 1 --2- 172.21.15.146:0/3031382165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efcf4004810 0x7efcf4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:16.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.248+0000 7efd10947700 1 -- 172.21.15.146:0/3031382165 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf4003570 con 0x7efcf4003a90 2023-10-06T11:06:16.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.248+0000 7efd11148700 1 --2- 172.21.15.146:0/3031382165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd0c0cc960 0x7efcf40051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:06:16.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.248+0000 7efd10947700 1 --2- 172.21.15.146:0/3031382165 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcf4003a90 0x7efcf4003ea0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7efcfc00c2d0 tx=0x7efcfc001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9216c628e1fea43f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:16.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.248+0000 7efd0b7fe700 1 -- 172.21.15.146:0/3031382165 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcfc001d80 con 0x7efcf4003a90 2023-10-06T11:06:16.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.248+0000 7efd0b7fe700 1 -- 172.21.15.146:0/3031382165 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcfc00cba0 con 0x7efcf4003a90 2023-10-06T11:06:16.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.248+0000 7efd0b7fe700 1 -- 172.21.15.146:0/3031382165 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcfc012400 con 0x7efcf4003a90 2023-10-06T11:06:16.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.249+0000 7efd12bab700 1 -- 172.21.15.146:0/3031382165 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcf4003a90 msgr2=0x7efcf4003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:16.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.249+0000 7efd12bab700 1 --2- 172.21.15.146:0/3031382165 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcf4003a90 0x7efcf4003ea0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7efcfc00c2d0 tx=0x7efcfc001a70 comp rx=0 tx=0).stop 2023-10-06T11:06:16.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.249+0000 7efd11148700 1 -- 172.21.15.146:0/3031382165 reap_dead start 2023-10-06T11:06:16.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.249+0000 7efd12bab700 1 -- 172.21.15.146:0/3031382165 shutdown_connections 2023-10-06T11:06:16.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.249+0000 7efd12bab700 1 -- 172.21.15.146:0/3031382165 >> 172.21.15.146:0/3031382165 conn(0x7efd0c06f380 msgr2=0x7efd0c0d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:16.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.249+0000 7efd12bab700 1 -- 172.21.15.146:0/3031382165 shutdown_connections 2023-10-06T11:06:16.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.249+0000 7efd12bab700 1 -- 172.21.15.146:0/3031382165 wait complete. 2023-10-06T11:06:16.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.250+0000 7efd12bab700 1 Processor -- start 2023-10-06T11:06:16.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.250+0000 7efd12bab700 1 -- start start 2023-10-06T11:06:16.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.251+0000 7efd12bab700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcf4003a90 0x7efd0c0c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:16.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.251+0000 7efd12bab700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd0c16b270 0x7efd0c16b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:16.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.251+0000 7efd12bab700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd0c15cff0 0x7efd0c15d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:16.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.251+0000 7efd12bab700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c15d9a0 con 0x7efcf4003a90 2023-10-06T11:06:16.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.251+0000 7efd12bab700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c0b5410 con 0x7efd0c16b270 2023-10-06T11:06:16.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.251+0000 7efd12bab700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c0b4b20 con 0x7efd0c15cff0 2023-10-06T11:06:16.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.251+0000 7efd10947700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcf4003a90 0x7efd0c0c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:16.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.251+0000 7efd10947700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcf4003a90 0x7efd0c0c8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39504/0 (socket says 172.21.15.146:39504) 2023-10-06T11:06:16.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.251+0000 7efd10947700 1 -- 172.21.15.146:0/3132493788 learned_addr learned my addr 172.21.15.146:0/3132493788 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:16.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.251+0000 7efd0bfff700 1 --2- 172.21.15.146:0/3132493788 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd0c16b270 0x7efd0c16b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:16.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.251+0000 7efd11148700 1 --2- 172.21.15.146:0/3132493788 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd0c15cff0 0x7efd0c15d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:16.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.251+0000 7efd10947700 1 -- 172.21.15.146:0/3132493788 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd0c15cff0 msgr2=0x7efd0c15d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:16.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.251+0000 7efd10947700 1 --2- 172.21.15.146:0/3132493788 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd0c15cff0 0x7efd0c15d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:16.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.251+0000 7efd10947700 1 -- 172.21.15.146:0/3132493788 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd0c16b270 msgr2=0x7efd0c16b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:16.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.251+0000 7efd10947700 1 --2- 172.21.15.146:0/3132493788 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd0c16b270 0x7efd0c16b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:16.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.251+0000 7efd10947700 1 -- 172.21.15.146:0/3132493788 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd0c0b4dc0 con 0x7efcf4003a90 2023-10-06T11:06:16.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.251+0000 7efd11148700 1 --2- 172.21.15.146:0/3132493788 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd0c15cff0 0x7efd0c15d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:06:16.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.252+0000 7efd10947700 1 --2- 172.21.15.146:0/3132493788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcf4003a90 0x7efd0c0c8a50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7efcfc00c8c0 tx=0x7efcfc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:16.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.252+0000 7efd08ff9700 1 -- 172.21.15.146:0/3132493788 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcfc027470 con 0x7efcf4003a90 2023-10-06T11:06:16.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.252+0000 7efd08ff9700 1 -- 172.21.15.146:0/3132493788 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcfc0275d0 con 0x7efcf4003a90 2023-10-06T11:06:16.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.252+0000 7efd08ff9700 1 -- 172.21.15.146:0/3132493788 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcfc027990 con 0x7efcf4003a90 2023-10-06T11:06:16.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.252+0000 7efd12bab700 1 -- 172.21.15.146:0/3132493788 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd0c0b50a0 con 0x7efcf4003a90 2023-10-06T11:06:16.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.252+0000 7efd12bab700 1 -- 172.21.15.146:0/3132493788 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd0c0c8f90 con 0x7efcf4003a90 2023-10-06T11:06:16.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.253+0000 7efd12bab700 1 -- 172.21.15.146:0/3132493788 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd0c0ad3f0 con 0x7efcf4003a90 2023-10-06T11:06:16.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.253+0000 7efd08ff9700 1 -- 172.21.15.146:0/3132493788 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efcfc024070 con 0x7efcf4003a90 2023-10-06T11:06:16.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.253+0000 7efd08ff9700 1 --2- 172.21.15.146:0/3132493788 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7efcf8066f30 0x7efcf80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:16.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.253+0000 7efd08ff9700 1 -- 172.21.15.146:0/3132493788 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7efcfc086d80 con 0x7efcf4003a90 2023-10-06T11:06:16.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.253+0000 7efd0bfff700 1 --2- 172.21.15.146:0/3132493788 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7efcf8066f30 0x7efcf80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:16.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.254+0000 7efd0bfff700 1 --2- 172.21.15.146:0/3132493788 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7efcf8066f30 0x7efcf80693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efd000010e0 tx=0x7efd00001e50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:16.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.258+0000 7efd08ff9700 1 -- 172.21.15.146:0/3132493788 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efcfc053e90 con 0x7efcf4003a90 2023-10-06T11:06:16.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.444+0000 7efd12bab700 1 -- 172.21.15.146:0/3132493788 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7efd0c0b56f0 con 0x7efcf4003a90 2023-10-06T11:06:16.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.444+0000 7efd08ff9700 1 -- 172.21.15.146:0/3132493788 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7efcfc02c070 con 0x7efcf4003a90 2023-10-06T11:06:16.446 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-10-06T11:06:16.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.446+0000 7efd12bab700 1 -- 172.21.15.146:0/3132493788 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7efcf8066f30 msgr2=0x7efcf80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:16.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.446+0000 7efd12bab700 1 --2- 172.21.15.146:0/3132493788 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7efcf8066f30 0x7efcf80693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efd000010e0 tx=0x7efd00001e50 comp rx=0 tx=0).stop 2023-10-06T11:06:16.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.446+0000 7efd12bab700 1 -- 172.21.15.146:0/3132493788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcf4003a90 msgr2=0x7efd0c0c8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:16.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.446+0000 7efd12bab700 1 --2- 172.21.15.146:0/3132493788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcf4003a90 0x7efd0c0c8a50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7efcfc00c8c0 tx=0x7efcfc016000 comp rx=0 tx=0).stop 2023-10-06T11:06:16.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.446+0000 7efd12bab700 1 -- 172.21.15.146:0/3132493788 shutdown_connections 2023-10-06T11:06:16.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.446+0000 7efd12bab700 1 --2- 172.21.15.146:0/3132493788 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7efcf8066f30 0x7efcf80693e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:16.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.446+0000 7efd12bab700 1 --2- 172.21.15.146:0/3132493788 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd0c15cff0 0x7efd0c15d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:16.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.446+0000 7efd12bab700 1 --2- 172.21.15.146:0/3132493788 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcf4003a90 0x7efd0c0c8a50 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:16.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.446+0000 7efd12bab700 1 --2- 172.21.15.146:0/3132493788 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd0c16b270 0x7efd0c16b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:16.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.446+0000 7efd12bab700 1 -- 172.21.15.146:0/3132493788 >> 172.21.15.146:0/3132493788 conn(0x7efd0c06f380 msgr2=0x7efd0c0cf3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:16.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.446+0000 7efd12bab700 1 -- 172.21.15.146:0/3132493788 shutdown_connections 2023-10-06T11:06:16.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.446+0000 7efd12bab700 1 -- 172.21.15.146:0/3132493788 wait complete. 2023-10-06T11:06:16.460 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:06:16.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.576+0000 7f3aff062700 1 Processor -- start 2023-10-06T11:06:16.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.576+0000 7f3aff062700 1 -- start start 2023-10-06T11:06:16.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.577+0000 7f3aff062700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3af806ef00 0x7f3af806f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:16.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.577+0000 7f3aff062700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3af806f8e0 con 0x7f3af8067470 2023-10-06T11:06:16.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.577+0000 7f3aff062700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3af80cae90 con 0x7f3af80c7d20 2023-10-06T11:06:16.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.577+0000 7f3aff062700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3af80cb170 con 0x7f3af806ef00 2023-10-06T11:06:16.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.577+0000 7f3afe060700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3af8067470 0x7f3af8067840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49566/0 (socket says 172.21.15.146:49566) 2023-10-06T11:06:16.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.577+0000 7f3afe060700 1 -- 172.21.15.146:0/3849823361 learned_addr learned my addr 172.21.15.146:0/3849823361 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:16.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.577+0000 7f3afd85f700 1 --2- 172.21.15.146:0/3849823361 >> v2:172.21.15.151:3300/0 conn(0x7f3af806ef00 0x7f3af806f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:16.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.577+0000 7f3afd05e700 1 -- 172.21.15.146:0/3849823361 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 777786186 0 0) 0x7f3af806f8e0 con 0x7f3af8067470 2023-10-06T11:06:16.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.577+0000 7f3afd05e700 1 -- 172.21.15.146:0/3849823361 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ae4003570 con 0x7f3af8067470 2023-10-06T11:06:16.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.578+0000 7f3afd05e700 1 -- 172.21.15.146:0/3849823361 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3441036587 0 0) 0x7f3ae4003570 con 0x7f3af8067470 2023-10-06T11:06:16.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.578+0000 7f3afd85f700 1 -- 172.21.15.146:0/3849823361 >> v1:172.21.15.151:6789/0 conn(0x7f3af80c7d20 legacy=0x7f3af80c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:16.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.578+0000 7f3afd85f700 1 -- 172.21.15.146:0/3849823361 >> v1:172.21.15.146:6789/0 conn(0x7f3af8067470 legacy=0x7f3af8067840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:16.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.578+0000 7f3afd85f700 1 -- 172.21.15.146:0/3849823361 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af80cb450 con 0x7f3af806ef00 2023-10-06T11:06:16.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.578+0000 7f3afd85f700 1 --2- 172.21.15.146:0/3849823361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3af806ef00 0x7f3af806f3a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3ae80098e0 tx=0x7f3ae80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab04e53ff0bcc11d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:16.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.578+0000 7f3afd05e700 1 -- 172.21.15.146:0/3849823361 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af4001470 con 0x7f3af806ef00 2023-10-06T11:06:16.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.578+0000 7f3afd05e700 1 -- 172.21.15.146:0/3849823361 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae8011420 con 0x7f3af806ef00 2023-10-06T11:06:16.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.578+0000 7f3afd05e700 1 -- 172.21.15.146:0/3849823361 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae80117c0 con 0x7f3af806ef00 2023-10-06T11:06:16.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.578+0000 7f3aff062700 1 -- 172.21.15.146:0/3849823361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3af806ef00 msgr2=0x7f3af806f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:16.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.578+0000 7f3aff062700 1 --2- 172.21.15.146:0/3849823361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3af806ef00 0x7f3af806f3a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3ae80098e0 tx=0x7f3ae80091a0 comp rx=0 tx=0).stop 2023-10-06T11:06:16.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.579+0000 7f3aff062700 1 -- 172.21.15.146:0/3849823361 shutdown_connections 2023-10-06T11:06:16.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.579+0000 7f3aff062700 1 --2- 172.21.15.146:0/3849823361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3af806ef00 0x7f3af806f3a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:16.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.579+0000 7f3aff062700 1 -- 172.21.15.146:0/3849823361 >> 172.21.15.146:0/3849823361 conn(0x7f3af8069010 msgr2=0x7f3af80cd120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:16.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.579+0000 7f3aff062700 1 -- 172.21.15.146:0/3849823361 shutdown_connections 2023-10-06T11:06:16.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.579+0000 7f3aff062700 1 -- 172.21.15.146:0/3849823361 wait complete. 2023-10-06T11:06:16.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.580+0000 7f3aff062700 1 Processor -- start 2023-10-06T11:06:16.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.580+0000 7f3aff062700 1 -- start start 2023-10-06T11:06:16.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.580+0000 7f3aff062700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3af8067470 0x7f3af80ac0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:16.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.580+0000 7f3aff062700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3af806ef00 0x7f3af80c3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:16.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.580+0000 7f3aff062700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3af80c7d20 0x7f3af80c3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:16.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.580+0000 7f3aff062700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af815bbc0 con 0x7f3af806ef00 2023-10-06T11:06:16.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.580+0000 7f3aff062700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af816d2e0 con 0x7f3af80c7d20 2023-10-06T11:06:16.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.580+0000 7f3aff062700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3af816d5c0 con 0x7f3af8067470 2023-10-06T11:06:16.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.581+0000 7f3afd85f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3af806ef00 0x7f3af80c3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:16.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.581+0000 7f3afd85f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3af806ef00 0x7f3af80c3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39512/0 (socket says 172.21.15.146:39512) 2023-10-06T11:06:16.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.581+0000 7f3afd85f700 1 -- 172.21.15.146:0/2797450397 learned_addr learned my addr 172.21.15.146:0/2797450397 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:16.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.581+0000 7f3afe861700 1 --2- 172.21.15.146:0/2797450397 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3af80c7d20 0x7f3af80c3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:16.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.581+0000 7f3afe060700 1 --2- 172.21.15.146:0/2797450397 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3af8067470 0x7f3af80ac0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:16.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.581+0000 7f3afd85f700 1 -- 172.21.15.146:0/2797450397 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3af8067470 msgr2=0x7f3af80ac0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:16.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.581+0000 7f3afd85f700 1 --2- 172.21.15.146:0/2797450397 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3af8067470 0x7f3af80ac0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:16.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.581+0000 7f3afd85f700 1 -- 172.21.15.146:0/2797450397 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3af80c7d20 msgr2=0x7f3af80c3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:16.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.581+0000 7f3afd85f700 1 --2- 172.21.15.146:0/2797450397 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3af80c7d20 0x7f3af80c3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:16.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.581+0000 7f3afd85f700 1 -- 172.21.15.146:0/2797450397 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae8009420 con 0x7f3af806ef00 2023-10-06T11:06:16.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.581+0000 7f3afd85f700 1 --2- 172.21.15.146:0/2797450397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3af806ef00 0x7f3af80c3040 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3ae80091e0 tx=0x7f3ae8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:16.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.581+0000 7f3aee7fc700 1 -- 172.21.15.146:0/2797450397 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae801cb30 con 0x7f3af806ef00 2023-10-06T11:06:16.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.581+0000 7f3aee7fc700 1 -- 172.21.15.146:0/2797450397 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae801ccb0 con 0x7f3af806ef00 2023-10-06T11:06:16.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.581+0000 7f3aff062700 1 -- 172.21.15.146:0/2797450397 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3af816d8a0 con 0x7f3af806ef00 2023-10-06T11:06:16.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.581+0000 7f3aee7fc700 1 -- 172.21.15.146:0/2797450397 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae801a6a0 con 0x7f3af806ef00 2023-10-06T11:06:16.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.581+0000 7f3aff062700 1 -- 172.21.15.146:0/2797450397 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3af816de60 con 0x7f3af806ef00 2023-10-06T11:06:16.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.582+0000 7f3aff062700 1 -- 172.21.15.146:0/2797450397 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3af816e050 con 0x7f3af806ef00 2023-10-06T11:06:16.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.582+0000 7f3aee7fc700 1 -- 172.21.15.146:0/2797450397 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3ae801aa50 con 0x7f3af806ef00 2023-10-06T11:06:16.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.583+0000 7f3aee7fc700 1 --2- 172.21.15.146:0/2797450397 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3adc066f30 0x7f3adc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:16.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.583+0000 7f3aee7fc700 1 -- 172.21.15.146:0/2797450397 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3ae8086280 con 0x7f3af806ef00 2023-10-06T11:06:16.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.583+0000 7f3afe060700 1 --2- 172.21.15.146:0/2797450397 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3adc066f30 0x7f3adc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:16.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.583+0000 7f3afe060700 1 --2- 172.21.15.146:0/2797450397 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3adc066f30 0x7f3adc0693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3af4001ed0 tx=0x7f3af4000bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:16.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.587+0000 7f3aee7fc700 1 -- 172.21.15.146:0/2797450397 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3ae8053390 con 0x7f3af806ef00 2023-10-06T11:06:16.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.768+0000 7f3aff062700 1 -- 172.21.15.146:0/2797450397 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3af80c7800 con 0x7f3af806ef00 2023-10-06T11:06:16.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.768+0000 7f3aee7fc700 1 -- 172.21.15.146:0/2797450397 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3ae80569b0 con 0x7f3af806ef00 2023-10-06T11:06:16.771 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-10-06T11:06:16.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.770+0000 7f3aff062700 1 -- 172.21.15.146:0/2797450397 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3adc066f30 msgr2=0x7f3adc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:16.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.770+0000 7f3aff062700 1 --2- 172.21.15.146:0/2797450397 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3adc066f30 0x7f3adc0693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3af4001ed0 tx=0x7f3af4000bc0 comp rx=0 tx=0).stop 2023-10-06T11:06:16.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.770+0000 7f3aff062700 1 -- 172.21.15.146:0/2797450397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3af806ef00 msgr2=0x7f3af80c3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:16.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.770+0000 7f3aff062700 1 --2- 172.21.15.146:0/2797450397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3af806ef00 0x7f3af80c3040 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3ae80091e0 tx=0x7f3ae8016000 comp rx=0 tx=0).stop 2023-10-06T11:06:16.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.771+0000 7f3aff062700 1 -- 172.21.15.146:0/2797450397 shutdown_connections 2023-10-06T11:06:16.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.771+0000 7f3aff062700 1 --2- 172.21.15.146:0/2797450397 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3adc066f30 0x7f3adc0693e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:16.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.771+0000 7f3aff062700 1 --2- 172.21.15.146:0/2797450397 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3af80c7d20 0x7f3af80c3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:16.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.771+0000 7f3aff062700 1 --2- 172.21.15.146:0/2797450397 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3af8067470 0x7f3af80ac0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:16.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.771+0000 7f3aff062700 1 --2- 172.21.15.146:0/2797450397 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3af806ef00 0x7f3af80c3040 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:16.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.771+0000 7f3aff062700 1 -- 172.21.15.146:0/2797450397 >> 172.21.15.146:0/2797450397 conn(0x7f3af8069010 msgr2=0x7f3af8067840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:16.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.771+0000 7f3aff062700 1 -- 172.21.15.146:0/2797450397 shutdown_connections 2023-10-06T11:06:16.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.771+0000 7f3aff062700 1 -- 172.21.15.146:0/2797450397 wait complete. 2023-10-06T11:06:16.784 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T11:06:16.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.899+0000 7ff710472700 1 Processor -- start 2023-10-06T11:06:16.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.899+0000 7ff710472700 1 -- start start 2023-10-06T11:06:16.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.900+0000 7ff710472700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff70815a160 0x7ff7080c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:16.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.900+0000 7ff710472700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff7080ae730 0x7ff7080aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:16.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.900+0000 7ff710472700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7080ce3d0 0x7ff7080ce810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:16.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.900+0000 7ff710472700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7080ae2a0 con 0x7ff7080ae730 2023-10-06T11:06:16.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.900+0000 7ff710472700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff70815a530 con 0x7ff70815a160 2023-10-06T11:06:16.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.900+0000 7ff710472700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7080af0f0 con 0x7ff7080ce3d0 2023-10-06T11:06:16.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.900+0000 7ff70da0d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff7080ae730 0x7ff7080aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:16.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.900+0000 7ff70da0d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff7080ae730 0x7ff7080aebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39524/0 (socket says 172.21.15.146:39524) 2023-10-06T11:06:16.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.900+0000 7ff70da0d700 1 -- 172.21.15.146:0/4105259140 learned_addr learned my addr 172.21.15.146:0/4105259140 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:16.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.901+0000 7ff70ea0f700 1 --2- 172.21.15.146:0/4105259140 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7080ce3d0 0x7ff7080ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:16.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.901+0000 7ff70e20e700 1 --2- 172.21.15.146:0/4105259140 >> v2:172.21.15.151:3300/0 conn(0x7ff70815a160 0x7ff7080c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:16.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.901+0000 7ff70da0d700 1 -- 172.21.15.146:0/4105259140 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7080ce3d0 msgr2=0x7ff7080ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:16.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.901+0000 7ff70da0d700 1 --2- 172.21.15.146:0/4105259140 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7080ce3d0 0x7ff7080ce810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:16.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.901+0000 7ff70da0d700 1 -- 172.21.15.146:0/4105259140 >> v2:172.21.15.151:3300/0 conn(0x7ff70815a160 msgr2=0x7ff7080c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:16.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.901+0000 7ff70da0d700 1 --2- 172.21.15.146:0/4105259140 >> v2:172.21.15.151:3300/0 conn(0x7ff70815a160 0x7ff7080c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:16.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.901+0000 7ff70da0d700 1 -- 172.21.15.146:0/4105259140 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7080ad690 con 0x7ff7080ae730 2023-10-06T11:06:16.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.901+0000 7ff70da0d700 1 --2- 172.21.15.146:0/4105259140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7080ae730 0x7ff7080aebb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff708065100 tx=0x7ff6fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b30025a65151da6e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:16.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.901+0000 7ff70d20c700 1 -- 172.21.15.146:0/4105259140 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc00b860 con 0x7ff7080ae730 2023-10-06T11:06:16.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.901+0000 7ff70d20c700 1 -- 172.21.15.146:0/4105259140 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6fc00b9c0 con 0x7ff7080ae730 2023-10-06T11:06:16.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.901+0000 7ff70d20c700 1 -- 172.21.15.146:0/4105259140 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc00bd60 con 0x7ff7080ae730 2023-10-06T11:06:16.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.901+0000 7ff710472700 1 -- 172.21.15.146:0/4105259140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7080ae730 msgr2=0x7ff7080aebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:16.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.901+0000 7ff710472700 1 --2- 172.21.15.146:0/4105259140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7080ae730 0x7ff7080aebb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff708065100 tx=0x7ff6fc009250 comp rx=0 tx=0).stop 2023-10-06T11:06:16.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.902+0000 7ff710472700 1 -- 172.21.15.146:0/4105259140 shutdown_connections 2023-10-06T11:06:16.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.902+0000 7ff710472700 1 --2- 172.21.15.146:0/4105259140 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7080ce3d0 0x7ff7080ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:16.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.902+0000 7ff710472700 1 --2- 172.21.15.146:0/4105259140 >> v2:172.21.15.151:3300/0 conn(0x7ff70815a160 0x7ff7080c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:16.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.902+0000 7ff710472700 1 --2- 172.21.15.146:0/4105259140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7080ae730 0x7ff7080aebb0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:16.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.902+0000 7ff710472700 1 -- 172.21.15.146:0/4105259140 >> 172.21.15.146:0/4105259140 conn(0x7ff70806f380 msgr2=0x7ff7080d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:16.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.902+0000 7ff710472700 1 -- 172.21.15.146:0/4105259140 shutdown_connections 2023-10-06T11:06:16.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.902+0000 7ff710472700 1 -- 172.21.15.146:0/4105259140 wait complete. 2023-10-06T11:06:16.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.903+0000 7ff710472700 1 Processor -- start 2023-10-06T11:06:16.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.903+0000 7ff710472700 1 -- start start 2023-10-06T11:06:16.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.903+0000 7ff710472700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7080ae730 0x7ff7081569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:16.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.903+0000 7ff710472700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7080ce3d0 0x7ff70815e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:16.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.903+0000 7ff710472700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff70815a160 0x7ff7080b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:16.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.903+0000 7ff710472700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff708157930 con 0x7ff7080ce3d0 2023-10-06T11:06:16.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.903+0000 7ff710472700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff70815eec0 con 0x7ff70815a160 2023-10-06T11:06:16.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.903+0000 7ff710472700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff70815f1a0 con 0x7ff7080ae730 2023-10-06T11:06:16.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.904+0000 7ff70da0d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7080ce3d0 0x7ff70815e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:16.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.904+0000 7ff70da0d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7080ce3d0 0x7ff70815e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39532/0 (socket says 172.21.15.146:39532) 2023-10-06T11:06:16.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.904+0000 7ff70da0d700 1 -- 172.21.15.146:0/1899594820 learned_addr learned my addr 172.21.15.146:0/1899594820 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:16.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.904+0000 7ff70e20e700 1 --2- 172.21.15.146:0/1899594820 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7080ae730 0x7ff7081569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:16.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.904+0000 7ff70ea0f700 1 --2- 172.21.15.146:0/1899594820 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff70815a160 0x7ff7080b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:16.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.904+0000 7ff70da0d700 1 -- 172.21.15.146:0/1899594820 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7080ae730 msgr2=0x7ff7081569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:16.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.904+0000 7ff70da0d700 1 --2- 172.21.15.146:0/1899594820 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7080ae730 0x7ff7081569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:16.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.904+0000 7ff70da0d700 1 -- 172.21.15.146:0/1899594820 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff70815a160 msgr2=0x7ff7080b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:16.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.904+0000 7ff70da0d700 1 --2- 172.21.15.146:0/1899594820 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff70815a160 0x7ff7080b3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:16.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.904+0000 7ff70da0d700 1 -- 172.21.15.146:0/1899594820 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6fc0094f0 con 0x7ff7080ce3d0 2023-10-06T11:06:16.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.904+0000 7ff70ea0f700 1 --2- 172.21.15.146:0/1899594820 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff70815a160 0x7ff7080b3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:06:16.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.904+0000 7ff70da0d700 1 --2- 172.21.15.146:0/1899594820 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7080ce3d0 0x7ff70815e570 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff708088c60 tx=0x7ff6fc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:16.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.904+0000 7ff7067fc700 1 -- 172.21.15.146:0/1899594820 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc011e70 con 0x7ff7080ce3d0 2023-10-06T11:06:16.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.904+0000 7ff7067fc700 1 -- 172.21.15.146:0/1899594820 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6fc024440 con 0x7ff7080ce3d0 2023-10-06T11:06:16.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.904+0000 7ff7067fc700 1 -- 172.21.15.146:0/1899594820 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6fc024800 con 0x7ff7080ce3d0 2023-10-06T11:06:16.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.904+0000 7ff710472700 1 -- 172.21.15.146:0/1899594820 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff70815f480 con 0x7ff7080ce3d0 2023-10-06T11:06:16.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.904+0000 7ff710472700 1 -- 172.21.15.146:0/1899594820 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff70815eab0 con 0x7ff7080ce3d0 2023-10-06T11:06:16.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.905+0000 7ff710472700 1 -- 172.21.15.146:0/1899594820 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7080ad3f0 con 0x7ff7080ce3d0 2023-10-06T11:06:16.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.905+0000 7ff7067fc700 1 -- 172.21.15.146:0/1899594820 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff6fc01a420 con 0x7ff7080ce3d0 2023-10-06T11:06:16.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.906+0000 7ff7067fc700 1 --2- 172.21.15.146:0/1899594820 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff6f4066f30 0x7ff6f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:16.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.906+0000 7ff7067fc700 1 -- 172.21.15.146:0/1899594820 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff6fc0864a0 con 0x7ff7080ce3d0 2023-10-06T11:06:16.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.906+0000 7ff70e20e700 1 --2- 172.21.15.146:0/1899594820 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff6f4066f30 0x7ff6f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:16.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.906+0000 7ff70e20e700 1 --2- 172.21.15.146:0/1899594820 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff6f4066f30 0x7ff6f40693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8006aa0 tx=0x7ff6f8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:16.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:16.910+0000 7ff7067fc700 1 -- 172.21.15.146:0/1899594820 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff6fc0535b0 con 0x7ff7080ce3d0 2023-10-06T11:06:17.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.091+0000 7ff710472700 1 -- 172.21.15.146:0/1899594820 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff708068390 con 0x7ff7080ce3d0 2023-10-06T11:06:17.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.091+0000 7ff7067fc700 1 -- 172.21.15.146:0/1899594820 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff6fc056bd0 con 0x7ff7080ce3d0 2023-10-06T11:06:17.093 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2023-10-06T11:06:17.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.093+0000 7ff710472700 1 -- 172.21.15.146:0/1899594820 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff6f4066f30 msgr2=0x7ff6f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:17.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.093+0000 7ff710472700 1 --2- 172.21.15.146:0/1899594820 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff6f4066f30 0x7ff6f40693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff6f8006aa0 tx=0x7ff6f8008040 comp rx=0 tx=0).stop 2023-10-06T11:06:17.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.093+0000 7ff710472700 1 -- 172.21.15.146:0/1899594820 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7080ce3d0 msgr2=0x7ff70815e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:17.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.093+0000 7ff710472700 1 --2- 172.21.15.146:0/1899594820 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7080ce3d0 0x7ff70815e570 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff708088c60 tx=0x7ff6fc017000 comp rx=0 tx=0).stop 2023-10-06T11:06:17.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.093+0000 7ff710472700 1 -- 172.21.15.146:0/1899594820 shutdown_connections 2023-10-06T11:06:17.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.093+0000 7ff710472700 1 --2- 172.21.15.146:0/1899594820 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff6f4066f30 0x7ff6f40693e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:17.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.093+0000 7ff710472700 1 --2- 172.21.15.146:0/1899594820 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff70815a160 0x7ff7080b3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:17.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.093+0000 7ff710472700 1 --2- 172.21.15.146:0/1899594820 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7080ae730 0x7ff7081569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:17.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.093+0000 7ff710472700 1 --2- 172.21.15.146:0/1899594820 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7080ce3d0 0x7ff70815e570 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:17.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.093+0000 7ff710472700 1 -- 172.21.15.146:0/1899594820 >> 172.21.15.146:0/1899594820 conn(0x7ff70806f380 msgr2=0x7ff708069e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:17.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.093+0000 7ff710472700 1 -- 172.21.15.146:0/1899594820 shutdown_connections 2023-10-06T11:06:17.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.093+0000 7ff710472700 1 -- 172.21.15.146:0/1899594820 wait complete. 2023-10-06T11:06:17.107 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T11:06:17.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.223+0000 7fde10896700 1 Processor -- start 2023-10-06T11:06:17.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.223+0000 7fde10896700 1 -- start start 2023-10-06T11:06:17.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.224+0000 7fde10896700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fde0c142b00 0x7fde0c0c8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:17.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.224+0000 7fde10896700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde0c142ed0 0x7fde0c06b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:17.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.224+0000 7fde10896700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fde0c06bb90 0x7fde0c06cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:17.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.224+0000 7fde10896700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde0c06c010 con 0x7fde0c142b00 2023-10-06T11:06:17.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.224+0000 7fde10896700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde0c0c8db0 con 0x7fde0c06bb90 2023-10-06T11:06:17.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.224+0000 7fde10896700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde0c06d8d0 con 0x7fde0c142ed0 2023-10-06T11:06:17.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.224+0000 7fde0b7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fde0c142b00 0x7fde0c0c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:17.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.224+0000 7fde0b7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fde0c142b00 0x7fde0c0c8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39538/0 (socket says 172.21.15.146:39538) 2023-10-06T11:06:17.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.224+0000 7fde0b7fe700 1 -- 172.21.15.146:0/3087054501 learned_addr learned my addr 172.21.15.146:0/3087054501 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:17.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.224+0000 7fde0bfff700 1 --2- 172.21.15.146:0/3087054501 >> v2:172.21.15.151:3300/0 conn(0x7fde0c06bb90 0x7fde0c06cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:17.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.224+0000 7fde0affd700 1 --2- 172.21.15.146:0/3087054501 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde0c142ed0 0x7fde0c06b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:17.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.225+0000 7fde0b7fe700 1 -- 172.21.15.146:0/3087054501 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde0c142ed0 msgr2=0x7fde0c06b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:17.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.225+0000 7fde0b7fe700 1 --2- 172.21.15.146:0/3087054501 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde0c142ed0 0x7fde0c06b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:17.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.225+0000 7fde0b7fe700 1 -- 172.21.15.146:0/3087054501 >> v2:172.21.15.151:3300/0 conn(0x7fde0c06bb90 msgr2=0x7fde0c06cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:17.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.225+0000 7fde0b7fe700 1 --2- 172.21.15.146:0/3087054501 >> v2:172.21.15.151:3300/0 conn(0x7fde0c06bb90 0x7fde0c06cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:17.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.225+0000 7fde0b7fe700 1 -- 172.21.15.146:0/3087054501 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde0c068720 con 0x7fde0c142b00 2023-10-06T11:06:17.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.225+0000 7fde0affd700 1 --2- 172.21.15.146:0/3087054501 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde0c142ed0 0x7fde0c06b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:06:17.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.225+0000 7fde0b7fe700 1 --2- 172.21.15.146:0/3087054501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde0c142b00 0x7fde0c0c8870 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fde0c06a730 tx=0x7fddfc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea579d9312f98801 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:17.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.225+0000 7fde0a7fc700 1 -- 172.21.15.146:0/3087054501 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddfc00e070 con 0x7fde0c142b00 2023-10-06T11:06:17.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.225+0000 7fde0a7fc700 1 -- 172.21.15.146:0/3087054501 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddfc00ba50 con 0x7fde0c142b00 2023-10-06T11:06:17.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.225+0000 7fde0a7fc700 1 -- 172.21.15.146:0/3087054501 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddfc0092e0 con 0x7fde0c142b00 2023-10-06T11:06:17.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.225+0000 7fde10896700 1 -- 172.21.15.146:0/3087054501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde0c142b00 msgr2=0x7fde0c0c8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:17.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.225+0000 7fde10896700 1 --2- 172.21.15.146:0/3087054501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde0c142b00 0x7fde0c0c8870 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fde0c06a730 tx=0x7fddfc009840 comp rx=0 tx=0).stop 2023-10-06T11:06:17.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.225+0000 7fde10896700 1 -- 172.21.15.146:0/3087054501 shutdown_connections 2023-10-06T11:06:17.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.225+0000 7fde10896700 1 --2- 172.21.15.146:0/3087054501 >> v2:172.21.15.151:3300/0 conn(0x7fde0c06bb90 0x7fde0c06cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:17.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.225+0000 7fde10896700 1 --2- 172.21.15.146:0/3087054501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde0c142b00 0x7fde0c0c8870 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:17.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.225+0000 7fde10896700 1 --2- 172.21.15.146:0/3087054501 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde0c142ed0 0x7fde0c06b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:17.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.225+0000 7fde10896700 1 -- 172.21.15.146:0/3087054501 >> 172.21.15.146:0/3087054501 conn(0x7fde0c0ce230 msgr2=0x7fde0c0ce630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:17.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.225+0000 7fde10896700 1 -- 172.21.15.146:0/3087054501 shutdown_connections 2023-10-06T11:06:17.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.225+0000 7fde10896700 1 -- 172.21.15.146:0/3087054501 wait complete. 2023-10-06T11:06:17.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.227+0000 7fde10896700 1 Processor -- start 2023-10-06T11:06:17.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.227+0000 7fde10896700 1 -- start start 2023-10-06T11:06:17.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.227+0000 7fde10896700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde0c06bb90 0x7fde0c158920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:17.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.227+0000 7fde10896700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde0c142b00 0x7fde0c141670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:17.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.227+0000 7fde10896700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde0c142ed0 0x7fde0c141bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:17.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.227+0000 7fde10896700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0c0c5630 con 0x7fde0c142b00 2023-10-06T11:06:17.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.227+0000 7fde10896700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0c0c52e0 con 0x7fde0c142ed0 2023-10-06T11:06:17.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.227+0000 7fde10896700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde0c15c750 con 0x7fde0c06bb90 2023-10-06T11:06:17.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.227+0000 7fde0affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde0c142b00 0x7fde0c141670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:17.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.228+0000 7fde0affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde0c142b00 0x7fde0c141670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39550/0 (socket says 172.21.15.146:39550) 2023-10-06T11:06:17.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.228+0000 7fde0affd700 1 -- 172.21.15.146:0/1277573583 learned_addr learned my addr 172.21.15.146:0/1277573583 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:17.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.228+0000 7fde0b7fe700 1 --2- 172.21.15.146:0/1277573583 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde0c06bb90 0x7fde0c158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:17.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.228+0000 7fde0bfff700 1 --2- 172.21.15.146:0/1277573583 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde0c142ed0 0x7fde0c141bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:17.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.228+0000 7fde0affd700 1 -- 172.21.15.146:0/1277573583 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde0c06bb90 msgr2=0x7fde0c158920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:17.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.228+0000 7fde0affd700 1 --2- 172.21.15.146:0/1277573583 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde0c06bb90 0x7fde0c158920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:17.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.228+0000 7fde0affd700 1 -- 172.21.15.146:0/1277573583 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde0c142ed0 msgr2=0x7fde0c141bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:17.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.228+0000 7fde0affd700 1 --2- 172.21.15.146:0/1277573583 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde0c142ed0 0x7fde0c141bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:17.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.228+0000 7fde0affd700 1 -- 172.21.15.146:0/1277573583 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddfc009ae0 con 0x7fde0c142b00 2023-10-06T11:06:17.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.228+0000 7fde0affd700 1 --2- 172.21.15.146:0/1277573583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde0c142b00 0x7fde0c141670 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fde0000c830 tx=0x7fde00008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:17.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.228+0000 7fddf37fe700 1 -- 172.21.15.146:0/1277573583 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde00011600 con 0x7fde0c142b00 2023-10-06T11:06:17.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.228+0000 7fddf37fe700 1 -- 172.21.15.146:0/1277573583 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde00011760 con 0x7fde0c142b00 2023-10-06T11:06:17.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.228+0000 7fde10896700 1 -- 172.21.15.146:0/1277573583 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde0c15ca30 con 0x7fde0c142b00 2023-10-06T11:06:17.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.228+0000 7fddf37fe700 1 -- 172.21.15.146:0/1277573583 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde00011b20 con 0x7fde0c142b00 2023-10-06T11:06:17.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.228+0000 7fde10896700 1 -- 172.21.15.146:0/1277573583 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde0c158e60 con 0x7fde0c142b00 2023-10-06T11:06:17.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.229+0000 7fde10896700 1 -- 172.21.15.146:0/1277573583 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde0c0c57a0 con 0x7fde0c142b00 2023-10-06T11:06:17.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.229+0000 7fddf37fe700 1 -- 172.21.15.146:0/1277573583 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fde00018360 con 0x7fde0c142b00 2023-10-06T11:06:17.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.230+0000 7fddf37fe700 1 --2- 172.21.15.146:0/1277573583 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fddf8066f30 0x7fddf80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:17.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.230+0000 7fddf37fe700 1 -- 172.21.15.146:0/1277573583 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fde000845d0 con 0x7fde0c142b00 2023-10-06T11:06:17.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.230+0000 7fde0b7fe700 1 --2- 172.21.15.146:0/1277573583 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fddf8066f30 0x7fddf80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:17.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.230+0000 7fde0b7fe700 1 --2- 172.21.15.146:0/1277573583 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fddf8066f30 0x7fddf80693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fddfc009880 tx=0x7fddfc018000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:17.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.234+0000 7fddf37fe700 1 -- 172.21.15.146:0/1277573583 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fde000516e0 con 0x7fde0c142b00 2023-10-06T11:06:17.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.417+0000 7fde10896700 1 -- 172.21.15.146:0/1277573583 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fde0c068a00 con 0x7fde0c142b00 2023-10-06T11:06:17.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.418+0000 7fddf37fe700 1 -- 172.21.15.146:0/1277573583 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fde00054d00 con 0x7fde0c142b00 2023-10-06T11:06:17.419 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2023-10-06T11:06:17.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.420+0000 7fde10896700 1 -- 172.21.15.146:0/1277573583 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fddf8066f30 msgr2=0x7fddf80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:17.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.420+0000 7fde10896700 1 --2- 172.21.15.146:0/1277573583 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fddf8066f30 0x7fddf80693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fddfc009880 tx=0x7fddfc018000 comp rx=0 tx=0).stop 2023-10-06T11:06:17.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.420+0000 7fde10896700 1 -- 172.21.15.146:0/1277573583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde0c142b00 msgr2=0x7fde0c141670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:17.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.420+0000 7fde10896700 1 --2- 172.21.15.146:0/1277573583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde0c142b00 0x7fde0c141670 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fde0000c830 tx=0x7fde00008040 comp rx=0 tx=0).stop 2023-10-06T11:06:17.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.420+0000 7fde10896700 1 -- 172.21.15.146:0/1277573583 shutdown_connections 2023-10-06T11:06:17.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.420+0000 7fde10896700 1 --2- 172.21.15.146:0/1277573583 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fddf8066f30 0x7fddf80693e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:17.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.420+0000 7fde10896700 1 --2- 172.21.15.146:0/1277573583 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde0c142ed0 0x7fde0c141bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:17.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.420+0000 7fde10896700 1 --2- 172.21.15.146:0/1277573583 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde0c06bb90 0x7fde0c158920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:17.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.420+0000 7fde10896700 1 --2- 172.21.15.146:0/1277573583 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde0c142b00 0x7fde0c141670 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:17.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.420+0000 7fde10896700 1 -- 172.21.15.146:0/1277573583 >> 172.21.15.146:0/1277573583 conn(0x7fde0c0ce230 msgr2=0x7fde0c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:17.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.420+0000 7fde10896700 1 -- 172.21.15.146:0/1277573583 shutdown_connections 2023-10-06T11:06:17.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.420+0000 7fde10896700 1 -- 172.21.15.146:0/1277573583 wait complete. 2023-10-06T11:06:17.433 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:06:17.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.547+0000 7f98a337c700 1 Processor -- start 2023-10-06T11:06:17.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.547+0000 7f98a337c700 1 -- start start 2023-10-06T11:06:17.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.548+0000 7f98a337c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f989c157430 0x7f989c157800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:17.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.548+0000 7f98a337c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f989c0ab010 0x7f989c0ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:17.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.548+0000 7f98a337c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f989c0cc240 0x7f989c0cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:17.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.548+0000 7f98a337c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f989c0c3dd0 con 0x7f989c157430 2023-10-06T11:06:17.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.548+0000 7f98a337c700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f989c0cf0b0 con 0x7f989c0cc240 2023-10-06T11:06:17.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.548+0000 7f98a337c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f989c0ccf20 con 0x7f989c0ab010 2023-10-06T11:06:17.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.548+0000 7f98a1118700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f989c157430 0x7f989c157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:17.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.548+0000 7f98a1118700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f989c157430 0x7f989c157800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39562/0 (socket says 172.21.15.146:39562) 2023-10-06T11:06:17.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.548+0000 7f98a1118700 1 -- 172.21.15.146:0/2303563163 learned_addr learned my addr 172.21.15.146:0/2303563163 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:17.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.549+0000 7f98a1919700 1 --2- 172.21.15.146:0/2303563163 >> v2:172.21.15.151:3300/0 conn(0x7f989c0cc240 0x7f989c0cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:17.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.549+0000 7f98a0917700 1 --2- 172.21.15.146:0/2303563163 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f989c0ab010 0x7f989c0ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:17.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.549+0000 7f98a1118700 1 -- 172.21.15.146:0/2303563163 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f989c0ab010 msgr2=0x7f989c0ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:17.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.549+0000 7f98a1118700 1 --2- 172.21.15.146:0/2303563163 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f989c0ab010 0x7f989c0ceb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:17.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.549+0000 7f98a1118700 1 -- 172.21.15.146:0/2303563163 >> v2:172.21.15.151:3300/0 conn(0x7f989c0cc240 msgr2=0x7f989c0cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:17.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.549+0000 7f98a1118700 1 --2- 172.21.15.146:0/2303563163 >> v2:172.21.15.151:3300/0 conn(0x7f989c0cc240 0x7f989c0cc6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:17.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.549+0000 7f98a1118700 1 -- 172.21.15.146:0/2303563163 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f989c0cd200 con 0x7f989c157430 2023-10-06T11:06:17.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.549+0000 7f98a1118700 1 --2- 172.21.15.146:0/2303563163 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f989c157430 0x7f989c157800 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f989c0ce3f0 tx=0x7f9898009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7c7baaad44546ba server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:17.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.549+0000 7f9893fff700 1 -- 172.21.15.146:0/2303563163 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989800e070 con 0x7f989c157430 2023-10-06T11:06:17.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.549+0000 7f9893fff700 1 -- 172.21.15.146:0/2303563163 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989800ba50 con 0x7f989c157430 2023-10-06T11:06:17.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.549+0000 7f9893fff700 1 -- 172.21.15.146:0/2303563163 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98980092e0 con 0x7f989c157430 2023-10-06T11:06:17.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.549+0000 7f98a337c700 1 -- 172.21.15.146:0/2303563163 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f989c157430 msgr2=0x7f989c157800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:17.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.549+0000 7f98a337c700 1 --2- 172.21.15.146:0/2303563163 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f989c157430 0x7f989c157800 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f989c0ce3f0 tx=0x7f9898009840 comp rx=0 tx=0).stop 2023-10-06T11:06:17.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.549+0000 7f98a337c700 1 -- 172.21.15.146:0/2303563163 shutdown_connections 2023-10-06T11:06:17.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.549+0000 7f98a337c700 1 --2- 172.21.15.146:0/2303563163 >> v2:172.21.15.151:3300/0 conn(0x7f989c0cc240 0x7f989c0cc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:17.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.549+0000 7f98a337c700 1 --2- 172.21.15.146:0/2303563163 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f989c157430 0x7f989c157800 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:17.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.549+0000 7f98a337c700 1 --2- 172.21.15.146:0/2303563163 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f989c0ab010 0x7f989c0ceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:17.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.549+0000 7f98a337c700 1 -- 172.21.15.146:0/2303563163 >> 172.21.15.146:0/2303563163 conn(0x7f989c067c50 msgr2=0x7f989c0ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:17.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.550+0000 7f98a337c700 1 -- 172.21.15.146:0/2303563163 shutdown_connections 2023-10-06T11:06:17.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.550+0000 7f98a337c700 1 -- 172.21.15.146:0/2303563163 wait complete. 2023-10-06T11:06:17.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.551+0000 7f98a337c700 1 Processor -- start 2023-10-06T11:06:17.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.551+0000 7f98a337c700 1 -- start start 2023-10-06T11:06:17.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.551+0000 7f98a337c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f989c0ab010 0x7f989c14d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:17.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.551+0000 7f98a337c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f989c0cc240 0x7f989c14d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:17.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.551+0000 7f98a337c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f989c157430 0x7f989c0afa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:17.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.551+0000 7f98a337c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989c150c60 con 0x7f989c157430 2023-10-06T11:06:17.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.551+0000 7f98a337c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989c14d640 con 0x7f989c0cc240 2023-10-06T11:06:17.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.551+0000 7f98a337c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f989c150050 con 0x7f989c0ab010 2023-10-06T11:06:17.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.552+0000 7f98a1919700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f989c157430 0x7f989c0afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:17.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.552+0000 7f98a1919700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f989c157430 0x7f989c0afa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39568/0 (socket says 172.21.15.146:39568) 2023-10-06T11:06:17.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.552+0000 7f98a1919700 1 -- 172.21.15.146:0/2919171246 learned_addr learned my addr 172.21.15.146:0/2919171246 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:17.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.552+0000 7f98a0917700 1 --2- 172.21.15.146:0/2919171246 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f989c0cc240 0x7f989c14d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:17.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.552+0000 7f98a1118700 1 --2- 172.21.15.146:0/2919171246 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f989c0ab010 0x7f989c14d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:17.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.552+0000 7f98a1919700 1 -- 172.21.15.146:0/2919171246 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f989c0ab010 msgr2=0x7f989c14d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:17.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.552+0000 7f98a1919700 1 --2- 172.21.15.146:0/2919171246 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f989c0ab010 0x7f989c14d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:17.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.552+0000 7f98a1919700 1 -- 172.21.15.146:0/2919171246 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f989c0cc240 msgr2=0x7f989c14d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:17.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.552+0000 7f98a1919700 1 --2- 172.21.15.146:0/2919171246 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f989c0cc240 0x7f989c14d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:17.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.552+0000 7f98a1919700 1 -- 172.21.15.146:0/2919171246 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9898009ae0 con 0x7f989c157430 2023-10-06T11:06:17.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.552+0000 7f98a1919700 1 --2- 172.21.15.146:0/2919171246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f989c157430 0x7f989c0afa90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f989400c8b0 tx=0x7f9894008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:17.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.552+0000 7f98917fa700 1 -- 172.21.15.146:0/2919171246 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9894011660 con 0x7f989c157430 2023-10-06T11:06:17.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.552+0000 7f98917fa700 1 -- 172.21.15.146:0/2919171246 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98940117c0 con 0x7f989c157430 2023-10-06T11:06:17.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.552+0000 7f98a337c700 1 -- 172.21.15.146:0/2919171246 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f989c150330 con 0x7f989c157430 2023-10-06T11:06:17.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.552+0000 7f98917fa700 1 -- 172.21.15.146:0/2919171246 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9894011b40 con 0x7f989c157430 2023-10-06T11:06:17.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.552+0000 7f98a337c700 1 -- 172.21.15.146:0/2919171246 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f989c1508f0 con 0x7f989c157430 2023-10-06T11:06:17.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.553+0000 7f98a337c700 1 -- 172.21.15.146:0/2919171246 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f989c0b2220 con 0x7f989c157430 2023-10-06T11:06:17.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.553+0000 7f98917fa700 1 -- 172.21.15.146:0/2919171246 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f98940193f0 con 0x7f989c157430 2023-10-06T11:06:17.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.554+0000 7f98917fa700 1 --2- 172.21.15.146:0/2919171246 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9880066f30 0x7f98800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:17.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.554+0000 7f98917fa700 1 -- 172.21.15.146:0/2919171246 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9894084980 con 0x7f989c157430 2023-10-06T11:06:17.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.554+0000 7f98a1118700 1 --2- 172.21.15.146:0/2919171246 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9880066f30 0x7f98800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:17.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.554+0000 7f98a1118700 1 --2- 172.21.15.146:0/2919171246 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9880066f30 0x7f98800693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9898009880 tx=0x7f9898018000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:17.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.558+0000 7f98917fa700 1 -- 172.21.15.146:0/2919171246 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9894055520 con 0x7f989c157430 2023-10-06T11:06:17.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.742+0000 7f98a337c700 1 -- 172.21.15.146:0/2919171246 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f989c04c380 con 0x7f989c157430 2023-10-06T11:06:17.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.743+0000 7f98917fa700 1 -- 172.21.15.146:0/2919171246 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16914 (secure 0 0 0) 0x7f98940550b0 con 0x7f989c157430 2023-10-06T11:06:17.744 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:06:17.745 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":20,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:05:45.362089+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:05:41.403954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T11:05:42.698754+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:06:17.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.745+0000 7f98a337c700 1 -- 172.21.15.146:0/2919171246 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9880066f30 msgr2=0x7f98800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:17.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.745+0000 7f98a337c700 1 --2- 172.21.15.146:0/2919171246 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9880066f30 0x7f98800693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9898009880 tx=0x7f9898018000 comp rx=0 tx=0).stop 2023-10-06T11:06:17.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.745+0000 7f98a337c700 1 -- 172.21.15.146:0/2919171246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f989c157430 msgr2=0x7f989c0afa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:17.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.745+0000 7f98a337c700 1 --2- 172.21.15.146:0/2919171246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f989c157430 0x7f989c0afa90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f989400c8b0 tx=0x7f9894008040 comp rx=0 tx=0).stop 2023-10-06T11:06:17.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.745+0000 7f98a337c700 1 -- 172.21.15.146:0/2919171246 shutdown_connections 2023-10-06T11:06:17.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.745+0000 7f98a337c700 1 --2- 172.21.15.146:0/2919171246 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9880066f30 0x7f98800693e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:17.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.745+0000 7f98a337c700 1 --2- 172.21.15.146:0/2919171246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f989c157430 0x7f989c0afa90 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:17.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.745+0000 7f98a337c700 1 --2- 172.21.15.146:0/2919171246 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f989c0ab010 0x7f989c14d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:17.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.745+0000 7f98a337c700 1 --2- 172.21.15.146:0/2919171246 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f989c0cc240 0x7f989c14d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:17.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.745+0000 7f98a337c700 1 -- 172.21.15.146:0/2919171246 >> 172.21.15.146:0/2919171246 conn(0x7f989c067c50 msgr2=0x7f989c0ce420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:17.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.745+0000 7f98a337c700 1 -- 172.21.15.146:0/2919171246 shutdown_connections 2023-10-06T11:06:17.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.745+0000 7f98a337c700 1 -- 172.21.15.146:0/2919171246 wait complete. 2023-10-06T11:06:17.759 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:05:36.687307+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:05:37.171199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T11:05:41.403954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T11:05:42.698754+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T11:06:17.759 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:06:17.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.875+0000 7f7e73575700 1 Processor -- start 2023-10-06T11:06:17.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.875+0000 7f7e73575700 1 -- start start 2023-10-06T11:06:17.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.876+0000 7f7e73575700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7e6c0b5640 0x7f7e6c15a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:17.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.876+0000 7f7e73575700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7e6c0cb090 0x7f7e6c0cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:17.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.876+0000 7f7e73575700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e6c0cc130 con 0x7f7e6c068780 2023-10-06T11:06:17.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.876+0000 7f7e73575700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e6c0b2660 con 0x7f7e6c0b5640 2023-10-06T11:06:17.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.876+0000 7f7e73575700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e6c15adb0 con 0x7f7e6c0cb090 2023-10-06T11:06:17.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.876+0000 7f7e72573700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7e6c0b5640 0x7f7e6c15a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:17.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.876+0000 7f7e72573700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7e6c0b5640 0x7f7e6c15a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39572/0 (socket says 172.21.15.146:39572) 2023-10-06T11:06:17.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.876+0000 7f7e72573700 1 -- 172.21.15.146:0/3144711100 learned_addr learned my addr 172.21.15.146:0/3144711100 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:17.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.876+0000 7f7e71d72700 1 --2- 172.21.15.146:0/3144711100 >> v2:172.21.15.151:3300/0 conn(0x7f7e6c0cb090 0x7f7e6c0cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:17.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.876+0000 7f7e72573700 1 -- 172.21.15.146:0/3144711100 >> v2:172.21.15.151:3300/0 conn(0x7f7e6c0cb090 msgr2=0x7f7e6c0cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:17.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.876+0000 7f7e72573700 1 --2- 172.21.15.146:0/3144711100 >> v2:172.21.15.151:3300/0 conn(0x7f7e6c0cb090 0x7f7e6c0cc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:17.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.876+0000 7f7e72573700 1 -- 172.21.15.146:0/3144711100 >> v1:172.21.15.151:6789/0 conn(0x7f7e6c068780 legacy=0x7f7e6c15b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:17.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.876+0000 7f7e72573700 1 -- 172.21.15.146:0/3144711100 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e6c0cb520 con 0x7f7e6c0b5640 2023-10-06T11:06:17.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.876+0000 7f7e72573700 1 --2- 172.21.15.146:0/3144711100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e6c0b5640 0x7f7e6c15a870 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c159e40 tx=0x7f7e68009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dc41c8d554f065d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:17.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.877+0000 7f7e71571700 1 -- 172.21.15.146:0/3144711100 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6800b820 con 0x7f7e6c0b5640 2023-10-06T11:06:17.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.877+0000 7f7e71571700 1 -- 172.21.15.146:0/3144711100 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6800b980 con 0x7f7e6c0b5640 2023-10-06T11:06:17.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.877+0000 7f7e71571700 1 -- 172.21.15.146:0/3144711100 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6800bd20 con 0x7f7e6c0b5640 2023-10-06T11:06:17.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.877+0000 7f7e73575700 1 -- 172.21.15.146:0/3144711100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e6c0b5640 msgr2=0x7f7e6c15a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:17.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.877+0000 7f7e73575700 1 --2- 172.21.15.146:0/3144711100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e6c0b5640 0x7f7e6c15a870 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c159e40 tx=0x7f7e68009250 comp rx=0 tx=0).stop 2023-10-06T11:06:17.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.877+0000 7f7e73575700 1 -- 172.21.15.146:0/3144711100 shutdown_connections 2023-10-06T11:06:17.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.877+0000 7f7e73575700 1 --2- 172.21.15.146:0/3144711100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e6c0b5640 0x7f7e6c15a870 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:17.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.877+0000 7f7e73575700 1 --2- 172.21.15.146:0/3144711100 >> v2:172.21.15.151:3300/0 conn(0x7f7e6c0cb090 0x7f7e6c0cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:17.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.877+0000 7f7e73575700 1 -- 172.21.15.146:0/3144711100 >> 172.21.15.146:0/3144711100 conn(0x7f7e6c0703f0 msgr2=0x7f7e6c0707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:17.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.877+0000 7f7e73575700 1 -- 172.21.15.146:0/3144711100 shutdown_connections 2023-10-06T11:06:17.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.877+0000 7f7e73575700 1 -- 172.21.15.146:0/3144711100 wait complete. 2023-10-06T11:06:17.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.878+0000 7f7e73575700 1 Processor -- start 2023-10-06T11:06:17.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.878+0000 7f7e73575700 1 -- start start 2023-10-06T11:06:17.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.879+0000 7f7e73575700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e6c068780 0x7f7e6c0cfa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:17.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.879+0000 7f7e73575700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e6c0b5640 0x7f7e6c0c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:17.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.879+0000 7f7e73575700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e6c0cb090 0x7f7e6c0c9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:17.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.879+0000 7f7e73575700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6c0d0e30 con 0x7f7e6c0cb090 2023-10-06T11:06:17.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.879+0000 7f7e73575700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6c0cff90 con 0x7f7e6c068780 2023-10-06T11:06:17.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.879+0000 7f7e73575700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6c0d0220 con 0x7f7e6c0b5640 2023-10-06T11:06:17.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.879+0000 7f7e72d74700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e6c0cb090 0x7f7e6c0c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:17.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.879+0000 7f7e72d74700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e6c0cb090 0x7f7e6c0c9070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39584/0 (socket says 172.21.15.146:39584) 2023-10-06T11:06:17.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.879+0000 7f7e72d74700 1 -- 172.21.15.146:0/2941503128 learned_addr learned my addr 172.21.15.146:0/2941503128 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:17.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.879+0000 7f7e72573700 1 --2- 172.21.15.146:0/2941503128 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e6c068780 0x7f7e6c0cfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:17.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.880+0000 7f7e72d74700 1 -- 172.21.15.146:0/2941503128 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e6c0b5640 msgr2=0x7f7e6c0c74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:17.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.880+0000 7f7e71d72700 1 --2- 172.21.15.146:0/2941503128 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e6c0b5640 0x7f7e6c0c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:17.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.880+0000 7f7e72d74700 1 --2- 172.21.15.146:0/2941503128 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e6c0b5640 0x7f7e6c0c74e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:17.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.880+0000 7f7e72d74700 1 -- 172.21.15.146:0/2941503128 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e6c068780 msgr2=0x7f7e6c0cfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:17.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.880+0000 7f7e72d74700 1 --2- 172.21.15.146:0/2941503128 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e6c068780 0x7f7e6c0cfa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:17.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.880+0000 7f7e72d74700 1 -- 172.21.15.146:0/2941503128 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e680094f0 con 0x7f7e6c0cb090 2023-10-06T11:06:17.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.880+0000 7f7e72573700 1 --2- 172.21.15.146:0/2941503128 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e6c068780 0x7f7e6c0cfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:06:17.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.880+0000 7f7e72d74700 1 --2- 172.21.15.146:0/2941503128 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e6c0cb090 0x7f7e6c0c9070 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7e6400bc30 tx=0x7f7e64009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:17.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.880+0000 7f7e627fc700 1 -- 172.21.15.146:0/2941503128 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6400c9b0 con 0x7f7e6c0cb090 2023-10-06T11:06:17.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.880+0000 7f7e627fc700 1 -- 172.21.15.146:0/2941503128 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e6400cb50 con 0x7f7e6c0cb090 2023-10-06T11:06:17.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.880+0000 7f7e73575700 1 -- 172.21.15.146:0/2941503128 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e6c0d0500 con 0x7f7e6c0cb090 2023-10-06T11:06:17.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.880+0000 7f7e627fc700 1 -- 172.21.15.146:0/2941503128 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e64014410 con 0x7f7e6c0cb090 2023-10-06T11:06:17.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.880+0000 7f7e73575700 1 -- 172.21.15.146:0/2941503128 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e6c0d0ac0 con 0x7f7e6c0cb090 2023-10-06T11:06:17.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.881+0000 7f7e73575700 1 -- 172.21.15.146:0/2941503128 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e6c0894b0 con 0x7f7e6c0cb090 2023-10-06T11:06:17.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.881+0000 7f7e627fc700 1 -- 172.21.15.146:0/2941503128 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7e64014800 con 0x7f7e6c0cb090 2023-10-06T11:06:17.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.882+0000 7f7e627fc700 1 --2- 172.21.15.146:0/2941503128 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7e50066f30 0x7f7e500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:17.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.882+0000 7f7e627fc700 1 -- 172.21.15.146:0/2941503128 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7e64084730 con 0x7f7e6c0cb090 2023-10-06T11:06:17.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.882+0000 7f7e72573700 1 --2- 172.21.15.146:0/2941503128 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7e50066f30 0x7f7e500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:17.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.882+0000 7f7e72573700 1 --2- 172.21.15.146:0/2941503128 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7e50066f30 0x7f7e500693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c159e40 tx=0x7f7e68016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:17.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:17.886+0000 7f7e627fc700 1 -- 172.21.15.146:0/2941503128 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7e6404c5a0 con 0x7f7e6c0cb090 2023-10-06T11:06:18.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.067+0000 7f7e73575700 1 -- 172.21.15.146:0/2941503128 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7e6c04bb40 con 0x7f7e6c0cb090 2023-10-06T11:06:18.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.067+0000 7f7e627fc700 1 -- 172.21.15.146:0/2941503128 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7e64051840 con 0x7f7e6c0cb090 2023-10-06T11:06:18.069 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-10-06T11:06:18.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.069+0000 7f7e73575700 1 -- 172.21.15.146:0/2941503128 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7e50066f30 msgr2=0x7f7e500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:18.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.069+0000 7f7e73575700 1 --2- 172.21.15.146:0/2941503128 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7e50066f30 0x7f7e500693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c159e40 tx=0x7f7e68016000 comp rx=0 tx=0).stop 2023-10-06T11:06:18.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.069+0000 7f7e73575700 1 -- 172.21.15.146:0/2941503128 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e6c0cb090 msgr2=0x7f7e6c0c9070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:18.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.069+0000 7f7e73575700 1 --2- 172.21.15.146:0/2941503128 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e6c0cb090 0x7f7e6c0c9070 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7e6400bc30 tx=0x7f7e64009820 comp rx=0 tx=0).stop 2023-10-06T11:06:18.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.069+0000 7f7e73575700 1 -- 172.21.15.146:0/2941503128 shutdown_connections 2023-10-06T11:06:18.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.069+0000 7f7e73575700 1 --2- 172.21.15.146:0/2941503128 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7e50066f30 0x7f7e500693e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:18.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.069+0000 7f7e73575700 1 --2- 172.21.15.146:0/2941503128 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e6c0cb090 0x7f7e6c0c9070 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:18.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.069+0000 7f7e73575700 1 --2- 172.21.15.146:0/2941503128 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e6c068780 0x7f7e6c0cfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:18.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.069+0000 7f7e73575700 1 --2- 172.21.15.146:0/2941503128 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e6c0b5640 0x7f7e6c0c74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:18.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.069+0000 7f7e73575700 1 -- 172.21.15.146:0/2941503128 >> 172.21.15.146:0/2941503128 conn(0x7f7e6c0703f0 msgr2=0x7f7e6c063790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:18.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.069+0000 7f7e73575700 1 -- 172.21.15.146:0/2941503128 shutdown_connections 2023-10-06T11:06:18.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.069+0000 7f7e73575700 1 -- 172.21.15.146:0/2941503128 wait complete. 2023-10-06T11:06:18.083 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:06:18.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.198+0000 7f1cc4dc0700 1 Processor -- start 2023-10-06T11:06:18.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.198+0000 7f1cc4dc0700 1 -- start start 2023-10-06T11:06:18.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.199+0000 7f1cc4dc0700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cc00cb090 0x7f1cc00cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:18.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.199+0000 7f1cc4dc0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1cc0068780 0x7f1cc0068be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:18.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.199+0000 7f1cc4dc0700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cc0069120 con 0x7f1cc00b5640 2023-10-06T11:06:18.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.199+0000 7f1cc4dc0700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cc00cc130 con 0x7f1cc0068780 2023-10-06T11:06:18.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.199+0000 7f1cc4dc0700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc00b2660 con 0x7f1cc00cb090 2023-10-06T11:06:18.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.199+0000 7f1cbffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1cc0068780 0x7f1cc0068be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:18.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.199+0000 7f1cbffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1cc0068780 0x7f1cc0068be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39586/0 (socket says 172.21.15.146:39586) 2023-10-06T11:06:18.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.199+0000 7f1cbffff700 1 -- 172.21.15.146:0/208153244 learned_addr learned my addr 172.21.15.146:0/208153244 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:18.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.200+0000 7f1cbeffd700 1 --2- 172.21.15.146:0/208153244 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cc00cb090 0x7f1cc00cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:18.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.200+0000 7f1cbffff700 1 -- 172.21.15.146:0/208153244 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cc00cb090 msgr2=0x7f1cc00cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:18.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.200+0000 7f1cbffff700 1 --2- 172.21.15.146:0/208153244 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cc00cb090 0x7f1cc00cc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:18.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.200+0000 7f1cbffff700 1 -- 172.21.15.146:0/208153244 >> v1:172.21.15.151:6789/0 conn(0x7f1cc00b5640 legacy=0x7f1cc015a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:18.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.200+0000 7f1cbffff700 1 -- 172.21.15.146:0/208153244 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc00cb520 con 0x7f1cc0068780 2023-10-06T11:06:18.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.200+0000 7f1cbffff700 1 --2- 172.21.15.146:0/208153244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1cc0068780 0x7f1cc0068be0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8009f20 tx=0x7f1cb8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d131e6a60177050e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:18.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.200+0000 7f1cbe7fc700 1 -- 172.21.15.146:0/208153244 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb800e070 con 0x7f1cc0068780 2023-10-06T11:06:18.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.200+0000 7f1cbe7fc700 1 -- 172.21.15.146:0/208153244 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb800b9d0 con 0x7f1cc0068780 2023-10-06T11:06:18.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.200+0000 7f1cbe7fc700 1 -- 172.21.15.146:0/208153244 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb80092e0 con 0x7f1cc0068780 2023-10-06T11:06:18.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.201+0000 7f1cc4dc0700 1 -- 172.21.15.146:0/208153244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1cc0068780 msgr2=0x7f1cc0068be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:18.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.201+0000 7f1cc4dc0700 1 --2- 172.21.15.146:0/208153244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1cc0068780 0x7f1cc0068be0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8009f20 tx=0x7f1cb8009840 comp rx=0 tx=0).stop 2023-10-06T11:06:18.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.201+0000 7f1cc4dc0700 1 -- 172.21.15.146:0/208153244 shutdown_connections 2023-10-06T11:06:18.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.201+0000 7f1cc4dc0700 1 --2- 172.21.15.146:0/208153244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1cc0068780 0x7f1cc0068be0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:18.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.201+0000 7f1cc4dc0700 1 --2- 172.21.15.146:0/208153244 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cc00cb090 0x7f1cc00cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:18.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.201+0000 7f1cc4dc0700 1 -- 172.21.15.146:0/208153244 >> 172.21.15.146:0/208153244 conn(0x7f1cc00703f0 msgr2=0x7f1cc00707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:18.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.201+0000 7f1cc4dc0700 1 -- 172.21.15.146:0/208153244 shutdown_connections 2023-10-06T11:06:18.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.201+0000 7f1cc4dc0700 1 -- 172.21.15.146:0/208153244 wait complete. 2023-10-06T11:06:18.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.202+0000 7f1cc4dc0700 1 Processor -- start 2023-10-06T11:06:18.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.202+0000 7f1cc4dc0700 1 -- start start 2023-10-06T11:06:18.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.203+0000 7f1cc4dc0700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cc0068780 0x7f1cc0152c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:18.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.203+0000 7f1cc4dc0700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1cc00b5640 0x7f1cc01531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:18.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.203+0000 7f1cc4dc0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1cc00cb090 0x7f1cc015d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:18.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.203+0000 7f1cc4dc0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc00c86b0 con 0x7f1cc00cb090 2023-10-06T11:06:18.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.203+0000 7f1cc4dc0700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc01603e0 con 0x7f1cc00b5640 2023-10-06T11:06:18.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.203+0000 7f1cc4dc0700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cc00c8c30 con 0x7f1cc0068780 2023-10-06T11:06:18.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.203+0000 7f1cbffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1cc00cb090 0x7f1cc015d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:18.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.203+0000 7f1cbffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1cc00cb090 0x7f1cc015d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39600/0 (socket says 172.21.15.146:39600) 2023-10-06T11:06:18.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.203+0000 7f1cbffff700 1 -- 172.21.15.146:0/2572929088 learned_addr learned my addr 172.21.15.146:0/2572929088 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:18.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.203+0000 7f1cbeffd700 1 --2- 172.21.15.146:0/2572929088 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1cc00b5640 0x7f1cc01531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:18.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.203+0000 7f1cbf7fe700 1 --2- 172.21.15.146:0/2572929088 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cc0068780 0x7f1cc0152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:18.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.203+0000 7f1cbffff700 1 -- 172.21.15.146:0/2572929088 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cc0068780 msgr2=0x7f1cc0152c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:18.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.203+0000 7f1cbffff700 1 --2- 172.21.15.146:0/2572929088 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cc0068780 0x7f1cc0152c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:18.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.203+0000 7f1cbffff700 1 -- 172.21.15.146:0/2572929088 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1cc00b5640 msgr2=0x7f1cc01531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:18.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.203+0000 7f1cbffff700 1 --2- 172.21.15.146:0/2572929088 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1cc00b5640 0x7f1cc01531b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:18.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.203+0000 7f1cbffff700 1 -- 172.21.15.146:0/2572929088 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb8009ae0 con 0x7f1cc00cb090 2023-10-06T11:06:18.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.203+0000 7f1cbffff700 1 --2- 172.21.15.146:0/2572929088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1cc00cb090 0x7f1cc015d810 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1cb800b610 tx=0x7f1cb8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:18.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.203+0000 7f1ca77fe700 1 -- 172.21.15.146:0/2572929088 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb8008ad0 con 0x7f1cc00cb090 2023-10-06T11:06:18.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.203+0000 7f1ca77fe700 1 -- 172.21.15.146:0/2572929088 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb8008c30 con 0x7f1cc00cb090 2023-10-06T11:06:18.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.203+0000 7f1cc4dc0700 1 -- 172.21.15.146:0/2572929088 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cc0153810 con 0x7f1cc00cb090 2023-10-06T11:06:18.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.203+0000 7f1ca77fe700 1 -- 172.21.15.146:0/2572929088 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb8026460 con 0x7f1cc00cb090 2023-10-06T11:06:18.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.203+0000 7f1cc4dc0700 1 -- 172.21.15.146:0/2572929088 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cc00c88c0 con 0x7f1cc00cb090 2023-10-06T11:06:18.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.204+0000 7f1cc4dc0700 1 -- 172.21.15.146:0/2572929088 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cc00894b0 con 0x7f1cc00cb090 2023-10-06T11:06:18.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.205+0000 7f1ca77fe700 1 -- 172.21.15.146:0/2572929088 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1cb8003040 con 0x7f1cc00cb090 2023-10-06T11:06:18.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.205+0000 7f1ca77fe700 1 --2- 172.21.15.146:0/2572929088 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1cac066f30 0x7f1cac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:18.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.205+0000 7f1ca77fe700 1 -- 172.21.15.146:0/2572929088 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1cb8086550 con 0x7f1cc00cb090 2023-10-06T11:06:18.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.205+0000 7f1cbf7fe700 1 --2- 172.21.15.146:0/2572929088 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1cac066f30 0x7f1cac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:18.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.206+0000 7f1cbf7fe700 1 --2- 172.21.15.146:0/2572929088 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1cac066f30 0x7f1cac0693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1cb00033b0 tx=0x7f1cb0016040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:18.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.209+0000 7f1ca77fe700 1 -- 172.21.15.146:0/2572929088 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1cb8053660 con 0x7f1cc00cb090 2023-10-06T11:06:18.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.394+0000 7f1cc4dc0700 1 -- 172.21.15.146:0/2572929088 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1cc0068d30 con 0x7f1cc00cb090 2023-10-06T11:06:18.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.395+0000 7f1ca77fe700 1 -- 172.21.15.146:0/2572929088 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1cb8056c80 con 0x7f1cc00cb090 2023-10-06T11:06:18.397 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-10-06T11:06:18.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.397+0000 7f1cc4dc0700 1 -- 172.21.15.146:0/2572929088 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1cac066f30 msgr2=0x7f1cac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:18.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.397+0000 7f1cc4dc0700 1 --2- 172.21.15.146:0/2572929088 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1cac066f30 0x7f1cac0693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1cb00033b0 tx=0x7f1cb0016040 comp rx=0 tx=0).stop 2023-10-06T11:06:18.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.397+0000 7f1cc4dc0700 1 -- 172.21.15.146:0/2572929088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1cc00cb090 msgr2=0x7f1cc015d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:18.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.397+0000 7f1cc4dc0700 1 --2- 172.21.15.146:0/2572929088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1cc00cb090 0x7f1cc015d810 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1cb800b610 tx=0x7f1cb8018000 comp rx=0 tx=0).stop 2023-10-06T11:06:18.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.397+0000 7f1cc4dc0700 1 -- 172.21.15.146:0/2572929088 shutdown_connections 2023-10-06T11:06:18.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.397+0000 7f1cc4dc0700 1 --2- 172.21.15.146:0/2572929088 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1cac066f30 0x7f1cac0693e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:18.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.397+0000 7f1cc4dc0700 1 --2- 172.21.15.146:0/2572929088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1cc00cb090 0x7f1cc015d810 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:18.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.397+0000 7f1cc4dc0700 1 --2- 172.21.15.146:0/2572929088 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cc0068780 0x7f1cc0152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:18.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.397+0000 7f1cc4dc0700 1 --2- 172.21.15.146:0/2572929088 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1cc00b5640 0x7f1cc01531b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:18.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.397+0000 7f1cc4dc0700 1 -- 172.21.15.146:0/2572929088 >> 172.21.15.146:0/2572929088 conn(0x7f1cc00703f0 msgr2=0x7f1cc0063790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:18.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.397+0000 7f1cc4dc0700 1 -- 172.21.15.146:0/2572929088 shutdown_connections 2023-10-06T11:06:18.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.397+0000 7f1cc4dc0700 1 -- 172.21.15.146:0/2572929088 wait complete. 2023-10-06T11:06:18.410 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T11:06:18.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.527+0000 7fb596f0a700 1 Processor -- start 2023-10-06T11:06:18.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.527+0000 7fb596f0a700 1 -- start start 2023-10-06T11:06:18.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.528+0000 7fb596f0a700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb59015a160 0x7fb5900c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:18.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.528+0000 7fb596f0a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5900cb950 0x7fb5900cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:18.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.528+0000 7fb596f0a700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5900ae2a0 con 0x7fb5900ae730 2023-10-06T11:06:18.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.528+0000 7fb596f0a700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb59015a530 con 0x7fb59015a160 2023-10-06T11:06:18.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.528+0000 7fb596f0a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5900ad690 con 0x7fb5900cb950 2023-10-06T11:06:18.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.529+0000 7fb594ca6700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb59015a160 0x7fb5900c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:18.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.529+0000 7fb5954a7700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5900cb950 0x7fb5900cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:18.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.529+0000 7fb587fff700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fb5900ae730 0x7fb5900aebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:49824/0 (socket says 172.21.15.146:49824) 2023-10-06T11:06:18.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.529+0000 7fb587fff700 1 -- 172.21.15.146:0/1523117839 learned_addr learned my addr 172.21.15.146:0/1523117839 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:18.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.529+0000 7fb594ca6700 1 -- 172.21.15.146:0/1523117839 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5900cb950 msgr2=0x7fb5900cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:18.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.529+0000 7fb594ca6700 1 --2- 172.21.15.146:0/1523117839 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5900cb950 0x7fb5900cbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:18.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.529+0000 7fb594ca6700 1 -- 172.21.15.146:0/1523117839 >> v1:172.21.15.151:6789/0 conn(0x7fb5900ae730 legacy=0x7fb5900aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:18.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.529+0000 7fb594ca6700 1 -- 172.21.15.146:0/1523117839 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5900ad970 con 0x7fb59015a160 2023-10-06T11:06:18.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.529+0000 7fb594ca6700 1 --2- 172.21.15.146:0/1523117839 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb59015a160 0x7fb5900c55a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb58c0098d0 tx=0x7fb58c009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcb2a48035d4c184 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:18.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.529+0000 7fb5877fe700 1 -- 172.21.15.146:0/1523117839 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c005c10 con 0x7fb59015a160 2023-10-06T11:06:18.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.529+0000 7fb5877fe700 1 -- 172.21.15.146:0/1523117839 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58c005d70 con 0x7fb59015a160 2023-10-06T11:06:18.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.529+0000 7fb5877fe700 1 -- 172.21.15.146:0/1523117839 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c006280 con 0x7fb59015a160 2023-10-06T11:06:18.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.530+0000 7fb596f0a700 1 -- 172.21.15.146:0/1523117839 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb59015a160 msgr2=0x7fb5900c55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:18.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.530+0000 7fb596f0a700 1 --2- 172.21.15.146:0/1523117839 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb59015a160 0x7fb5900c55a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb58c0098d0 tx=0x7fb58c009120 comp rx=0 tx=0).stop 2023-10-06T11:06:18.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.530+0000 7fb596f0a700 1 -- 172.21.15.146:0/1523117839 shutdown_connections 2023-10-06T11:06:18.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.530+0000 7fb596f0a700 1 --2- 172.21.15.146:0/1523117839 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5900cb950 0x7fb5900cbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:18.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.530+0000 7fb596f0a700 1 --2- 172.21.15.146:0/1523117839 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb59015a160 0x7fb5900c55a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:18.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.530+0000 7fb596f0a700 1 -- 172.21.15.146:0/1523117839 >> 172.21.15.146:0/1523117839 conn(0x7fb59006f380 msgr2=0x7fb5900d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:18.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.530+0000 7fb596f0a700 1 -- 172.21.15.146:0/1523117839 shutdown_connections 2023-10-06T11:06:18.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.530+0000 7fb596f0a700 1 -- 172.21.15.146:0/1523117839 wait complete. 2023-10-06T11:06:18.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.531+0000 7fb596f0a700 1 Processor -- start 2023-10-06T11:06:18.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.531+0000 7fb596f0a700 1 -- start start 2023-10-06T11:06:18.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.532+0000 7fb596f0a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5900ae730 0x7fb59014f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:18.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.532+0000 7fb596f0a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5900cb950 0x7fb5900c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:18.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.532+0000 7fb596f0a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb59015a160 0x7fb5900c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:18.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.532+0000 7fb596f0a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5900c9040 con 0x7fb5900ae730 2023-10-06T11:06:18.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.532+0000 7fb596f0a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5900b47f0 con 0x7fb5900cb950 2023-10-06T11:06:18.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.532+0000 7fb596f0a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5900b5090 con 0x7fb59015a160 2023-10-06T11:06:18.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.532+0000 7fb594ca6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5900ae730 0x7fb59014f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:18.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.532+0000 7fb594ca6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5900ae730 0x7fb59014f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39612/0 (socket says 172.21.15.146:39612) 2023-10-06T11:06:18.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.532+0000 7fb594ca6700 1 -- 172.21.15.146:0/2730930610 learned_addr learned my addr 172.21.15.146:0/2730930610 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:18.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.532+0000 7fb5954a7700 1 --2- 172.21.15.146:0/2730930610 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb59015a160 0x7fb5900c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:18.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.532+0000 7fb587fff700 1 --2- 172.21.15.146:0/2730930610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5900cb950 0x7fb5900c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:18.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.532+0000 7fb594ca6700 1 -- 172.21.15.146:0/2730930610 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb59015a160 msgr2=0x7fb5900c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:18.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.532+0000 7fb594ca6700 1 --2- 172.21.15.146:0/2730930610 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb59015a160 0x7fb5900c8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:18.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.532+0000 7fb594ca6700 1 -- 172.21.15.146:0/2730930610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5900cb950 msgr2=0x7fb5900c7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:18.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.532+0000 7fb594ca6700 1 --2- 172.21.15.146:0/2730930610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5900cb950 0x7fb5900c7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:18.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.532+0000 7fb594ca6700 1 -- 172.21.15.146:0/2730930610 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb58c0093c0 con 0x7fb5900ae730 2023-10-06T11:06:18.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.532+0000 7fb594ca6700 1 --2- 172.21.15.146:0/2730930610 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5900ae730 0x7fb59014f150 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb58c009f70 tx=0x7fb58c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:18.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.533+0000 7fb584ff9700 1 -- 172.21.15.146:0/2730930610 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c01a700 con 0x7fb5900ae730 2023-10-06T11:06:18.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.533+0000 7fb584ff9700 1 -- 172.21.15.146:0/2730930610 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb58c01a860 con 0x7fb5900ae730 2023-10-06T11:06:18.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.533+0000 7fb584ff9700 1 -- 172.21.15.146:0/2730930610 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb58c01ac00 con 0x7fb5900ae730 2023-10-06T11:06:18.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.533+0000 7fb596f0a700 1 -- 172.21.15.146:0/2730930610 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb590152150 con 0x7fb5900ae730 2023-10-06T11:06:18.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.533+0000 7fb596f0a700 1 -- 172.21.15.146:0/2730930610 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5900b4d20 con 0x7fb5900ae730 2023-10-06T11:06:18.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.534+0000 7fb596f0a700 1 -- 172.21.15.146:0/2730930610 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb590068390 con 0x7fb5900ae730 2023-10-06T11:06:18.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.534+0000 7fb584ff9700 1 -- 172.21.15.146:0/2730930610 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb58c011420 con 0x7fb5900ae730 2023-10-06T11:06:18.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.534+0000 7fb584ff9700 1 --2- 172.21.15.146:0/2730930610 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb57c066f30 0x7fb57c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:18.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.534+0000 7fb584ff9700 1 -- 172.21.15.146:0/2730930610 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb58c085b20 con 0x7fb5900ae730 2023-10-06T11:06:18.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.534+0000 7fb587fff700 1 --2- 172.21.15.146:0/2730930610 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb57c066f30 0x7fb57c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:18.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.535+0000 7fb587fff700 1 --2- 172.21.15.146:0/2730930610 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb57c066f30 0x7fb57c0693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb59006a490 tx=0x7fb580009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:18.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.539+0000 7fb584ff9700 1 -- 172.21.15.146:0/2730930610 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb58c052c30 con 0x7fb5900ae730 2023-10-06T11:06:18.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.722+0000 7fb596f0a700 1 -- 172.21.15.146:0/2730930610 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb59004c380 con 0x7fb5900ae730 2023-10-06T11:06:18.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.722+0000 7fb584ff9700 1 -- 172.21.15.146:0/2730930610 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb58c02b020 con 0x7fb5900ae730 2023-10-06T11:06:18.724 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2023-10-06T11:06:18.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.724+0000 7fb596f0a700 1 -- 172.21.15.146:0/2730930610 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb57c066f30 msgr2=0x7fb57c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:18.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.724+0000 7fb596f0a700 1 --2- 172.21.15.146:0/2730930610 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb57c066f30 0x7fb57c0693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb59006a490 tx=0x7fb580009040 comp rx=0 tx=0).stop 2023-10-06T11:06:18.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.724+0000 7fb596f0a700 1 -- 172.21.15.146:0/2730930610 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5900ae730 msgr2=0x7fb59014f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:18.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.724+0000 7fb596f0a700 1 --2- 172.21.15.146:0/2730930610 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5900ae730 0x7fb59014f150 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb58c009f70 tx=0x7fb58c016000 comp rx=0 tx=0).stop 2023-10-06T11:06:18.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.724+0000 7fb596f0a700 1 -- 172.21.15.146:0/2730930610 shutdown_connections 2023-10-06T11:06:18.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.724+0000 7fb596f0a700 1 --2- 172.21.15.146:0/2730930610 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb57c066f30 0x7fb57c0693e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:18.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.724+0000 7fb596f0a700 1 --2- 172.21.15.146:0/2730930610 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb59015a160 0x7fb5900c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:18.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.724+0000 7fb596f0a700 1 --2- 172.21.15.146:0/2730930610 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5900ae730 0x7fb59014f150 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:18.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.724+0000 7fb596f0a700 1 --2- 172.21.15.146:0/2730930610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5900cb950 0x7fb5900c7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:18.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.724+0000 7fb596f0a700 1 -- 172.21.15.146:0/2730930610 >> 172.21.15.146:0/2730930610 conn(0x7fb59006f380 msgr2=0x7fb5901526c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:18.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.724+0000 7fb596f0a700 1 -- 172.21.15.146:0/2730930610 shutdown_connections 2023-10-06T11:06:18.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.724+0000 7fb596f0a700 1 -- 172.21.15.146:0/2730930610 wait complete. 2023-10-06T11:06:18.737 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T11:06:18.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.852+0000 7f39fbdbe700 1 Processor -- start 2023-10-06T11:06:18.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.853+0000 7f39fbdbe700 1 -- start start 2023-10-06T11:06:18.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.853+0000 7f39fbdbe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f39f40ae730 0x7f39f40aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:18.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.853+0000 7f39fbdbe700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39f40ae2a0 con 0x7f39f40cb950 2023-10-06T11:06:18.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.854+0000 7f39fbdbe700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39f415a530 con 0x7f39f415a160 2023-10-06T11:06:18.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.854+0000 7f39fbdbe700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39f40c5cb0 con 0x7f39f40ae730 2023-10-06T11:06:18.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.854+0000 7f39f9359700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f39f40ae730 0x7f39f40aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:18.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.854+0000 7f39fa35b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f39f40cb950 0x7f39f40cbd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49580/0 (socket says 172.21.15.146:49580) 2023-10-06T11:06:18.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.854+0000 7f39fa35b700 1 -- 172.21.15.146:0/2643843827 learned_addr learned my addr 172.21.15.146:0/2643843827 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:18.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.854+0000 7f39f9359700 1 -- 172.21.15.146:0/2643843827 >> v1:172.21.15.151:6789/0 conn(0x7f39f415a160 legacy=0x7f39f40c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:18.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.854+0000 7f39f9359700 1 -- 172.21.15.146:0/2643843827 >> v1:172.21.15.146:6789/0 conn(0x7f39f40cb950 legacy=0x7f39f40cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:18.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.854+0000 7f39f9359700 1 -- 172.21.15.146:0/2643843827 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f40af0f0 con 0x7f39f40ae730 2023-10-06T11:06:18.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.854+0000 7f39f9359700 1 --2- 172.21.15.146:0/2643843827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39f40ae730 0x7f39f40aebb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f39e40098e0 tx=0x7f39e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bee3ef15d13e2f5b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:18.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.854+0000 7f39f8b58700 1 -- 172.21.15.146:0/2643843827 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e4009e80 con 0x7f39f40ae730 2023-10-06T11:06:18.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.854+0000 7f39f8b58700 1 -- 172.21.15.146:0/2643843827 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e400b760 con 0x7f39f40ae730 2023-10-06T11:06:18.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.854+0000 7f39f8b58700 1 -- 172.21.15.146:0/2643843827 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e400bae0 con 0x7f39f40ae730 2023-10-06T11:06:18.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.855+0000 7f39fbdbe700 1 -- 172.21.15.146:0/2643843827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39f40ae730 msgr2=0x7f39f40aebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:18.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.855+0000 7f39fbdbe700 1 --2- 172.21.15.146:0/2643843827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39f40ae730 0x7f39f40aebb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f39e40098e0 tx=0x7f39e40091a0 comp rx=0 tx=0).stop 2023-10-06T11:06:18.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.855+0000 7f39fbdbe700 1 -- 172.21.15.146:0/2643843827 shutdown_connections 2023-10-06T11:06:18.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.855+0000 7f39fbdbe700 1 --2- 172.21.15.146:0/2643843827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39f40ae730 0x7f39f40aebb0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:18.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.855+0000 7f39fbdbe700 1 -- 172.21.15.146:0/2643843827 >> 172.21.15.146:0/2643843827 conn(0x7f39f406f380 msgr2=0x7f39f40d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:18.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.855+0000 7f39fbdbe700 1 -- 172.21.15.146:0/2643843827 shutdown_connections 2023-10-06T11:06:18.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.855+0000 7f39fbdbe700 1 -- 172.21.15.146:0/2643843827 wait complete. 2023-10-06T11:06:18.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.856+0000 7f39fbdbe700 1 Processor -- start 2023-10-06T11:06:18.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.856+0000 7f39fbdbe700 1 -- start start 2023-10-06T11:06:18.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.857+0000 7f39fbdbe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39f40ae730 0x7f39f40b5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:18.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.857+0000 7f39fbdbe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39f40cb950 0x7f39f40b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:18.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.857+0000 7f39fbdbe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39f415a160 0x7f39f4171b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:18.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.857+0000 7f39fbdbe700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f40af580 con 0x7f39f40cb950 2023-10-06T11:06:18.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.857+0000 7f39fbdbe700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f40b5c30 con 0x7f39f415a160 2023-10-06T11:06:18.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.857+0000 7f39fbdbe700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39f40b5f10 con 0x7f39f40ae730 2023-10-06T11:06:18.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.857+0000 7f39f9359700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39f40cb950 0x7f39f40b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:18.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.857+0000 7f39f9359700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39f40cb950 0x7f39f40b55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39628/0 (socket says 172.21.15.146:39628) 2023-10-06T11:06:18.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.857+0000 7f39f9359700 1 -- 172.21.15.146:0/954443595 learned_addr learned my addr 172.21.15.146:0/954443595 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:18.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.857+0000 7f39f9b5a700 1 --2- 172.21.15.146:0/954443595 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39f40ae730 0x7f39f40b5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:18.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.857+0000 7f39fa35b700 1 --2- 172.21.15.146:0/954443595 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39f415a160 0x7f39f4171b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:18.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.857+0000 7f39f9359700 1 -- 172.21.15.146:0/954443595 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39f40ae730 msgr2=0x7f39f40b5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:18.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.857+0000 7f39f9359700 1 --2- 172.21.15.146:0/954443595 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39f40ae730 0x7f39f40b5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:18.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.857+0000 7f39f9359700 1 -- 172.21.15.146:0/954443595 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39f415a160 msgr2=0x7f39f4171b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:18.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.857+0000 7f39f9359700 1 --2- 172.21.15.146:0/954443595 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39f415a160 0x7f39f4171b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:18.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.857+0000 7f39f9359700 1 -- 172.21.15.146:0/954443595 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e4009420 con 0x7f39f40cb950 2023-10-06T11:06:18.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.857+0000 7f39f9359700 1 --2- 172.21.15.146:0/954443595 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39f40cb950 0x7f39f40b55d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f39e40093f0 tx=0x7f39e4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:18.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.857+0000 7f39e9ffb700 1 -- 172.21.15.146:0/954443595 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e400bae0 con 0x7f39f40cb950 2023-10-06T11:06:18.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.858+0000 7f39e9ffb700 1 -- 172.21.15.146:0/954443595 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e401c460 con 0x7f39f40cb950 2023-10-06T11:06:18.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.858+0000 7f39fbdbe700 1 -- 172.21.15.146:0/954443595 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39f40b61f0 con 0x7f39f40cb950 2023-10-06T11:06:18.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.858+0000 7f39e9ffb700 1 -- 172.21.15.146:0/954443595 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e401c820 con 0x7f39f40cb950 2023-10-06T11:06:18.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.858+0000 7f39fbdbe700 1 -- 172.21.15.146:0/954443595 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39f4158b10 con 0x7f39f40cb950 2023-10-06T11:06:18.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.859+0000 7f39fbdbe700 1 -- 172.21.15.146:0/954443595 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39f4069510 con 0x7f39f40cb950 2023-10-06T11:06:18.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.859+0000 7f39e9ffb700 1 -- 172.21.15.146:0/954443595 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f39e401cbd0 con 0x7f39f40cb950 2023-10-06T11:06:18.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.859+0000 7f39e9ffb700 1 --2- 172.21.15.146:0/954443595 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f39d8066f30 0x7f39d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:18.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.860+0000 7f39e9ffb700 1 -- 172.21.15.146:0/954443595 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f39e4086aa0 con 0x7f39f40cb950 2023-10-06T11:06:18.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.860+0000 7f39f9b5a700 1 --2- 172.21.15.146:0/954443595 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f39d8066f30 0x7f39d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:18.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.860+0000 7f39f9b5a700 1 --2- 172.21.15.146:0/954443595 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f39d8066f30 0x7f39d80693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f39f000c580 tx=0x7f39f0001a80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:18.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:18.864+0000 7f39e9ffb700 1 -- 172.21.15.146:0/954443595 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f39e4053bb0 con 0x7f39f40cb950 2023-10-06T11:06:19.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.045+0000 7f39fbdbe700 1 -- 172.21.15.146:0/954443595 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f39f4069510 con 0x7f39f40cb950 2023-10-06T11:06:19.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.045+0000 7f39e9ffb700 1 -- 172.21.15.146:0/954443595 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f39e40571d0 con 0x7f39f40cb950 2023-10-06T11:06:19.047 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2023-10-06T11:06:19.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.047+0000 7f39fbdbe700 1 -- 172.21.15.146:0/954443595 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f39d8066f30 msgr2=0x7f39d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:19.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.047+0000 7f39fbdbe700 1 --2- 172.21.15.146:0/954443595 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f39d8066f30 0x7f39d80693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f39f000c580 tx=0x7f39f0001a80 comp rx=0 tx=0).stop 2023-10-06T11:06:19.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.047+0000 7f39fbdbe700 1 -- 172.21.15.146:0/954443595 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39f40cb950 msgr2=0x7f39f40b55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:19.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.047+0000 7f39fbdbe700 1 --2- 172.21.15.146:0/954443595 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39f40cb950 0x7f39f40b55d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f39e40093f0 tx=0x7f39e4016000 comp rx=0 tx=0).stop 2023-10-06T11:06:19.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.047+0000 7f39fbdbe700 1 -- 172.21.15.146:0/954443595 shutdown_connections 2023-10-06T11:06:19.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.047+0000 7f39fbdbe700 1 --2- 172.21.15.146:0/954443595 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f39d8066f30 0x7f39d80693e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:19.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.047+0000 7f39fbdbe700 1 --2- 172.21.15.146:0/954443595 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39f415a160 0x7f39f4171b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:19.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.047+0000 7f39fbdbe700 1 --2- 172.21.15.146:0/954443595 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39f40ae730 0x7f39f40b5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:19.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.047+0000 7f39fbdbe700 1 --2- 172.21.15.146:0/954443595 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39f40cb950 0x7f39f40b55d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:19.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.047+0000 7f39fbdbe700 1 -- 172.21.15.146:0/954443595 >> 172.21.15.146:0/954443595 conn(0x7f39f406f380 msgr2=0x7f39f4159790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:19.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.048+0000 7f39fbdbe700 1 -- 172.21.15.146:0/954443595 shutdown_connections 2023-10-06T11:06:19.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.048+0000 7f39fbdbe700 1 -- 172.21.15.146:0/954443595 wait complete. 2023-10-06T11:06:19.148 INFO:tasks.cephfs_test_runner:Starting test: test_flag_scrub_mdsdir (tasks.cephfs.test_scrub_checks.TestScrubChecks) test flag scrub_mdsdir 2023-10-06T11:06:19.148 INFO:tasks.cephfs_test_runner:test_flag_scrub_mdsdir (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2023-10-06T11:06:19.149 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir' 2023-10-06T11:06:19.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.260+0000 7f7bc169b700 1 Processor -- start 2023-10-06T11:06:19.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.260+0000 7f7bc169b700 1 -- start start 2023-10-06T11:06:19.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.261+0000 7f7bc169b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7bbc13fb80 0x7f7bbc15d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:19.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.261+0000 7f7bc169b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7bbc13ff50 0x7f7bbc06c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:19.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.261+0000 7f7bc169b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7bbc15d810 0x7f7bbc0c7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:19.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.261+0000 7f7bc169b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bbc15dcb0 con 0x7f7bbc15d810 2023-10-06T11:06:19.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.261+0000 7f7bc169b700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bbc15df90 con 0x7f7bbc13fb80 2023-10-06T11:06:19.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.261+0000 7f7bc169b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bbc06b9d0 con 0x7f7bbc13ff50 2023-10-06T11:06:19.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.261+0000 7f7bbb7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7bbc15d810 0x7f7bbc0c7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:19.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.261+0000 7f7bbb7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7bbc15d810 0x7f7bbc0c7800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39640/0 (socket says 172.21.15.146:39640) 2023-10-06T11:06:19.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.261+0000 7f7bbb7fe700 1 -- 172.21.15.146:0/290896764 learned_addr learned my addr 172.21.15.146:0/290896764 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:19.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.262+0000 7f7bb27fc700 1 --2- 172.21.15.146:0/290896764 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7bbc13ff50 0x7f7bbc06c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:19.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.262+0000 7f7bbaffd700 1 --2- 172.21.15.146:0/290896764 >> v2:172.21.15.151:3300/0 conn(0x7f7bbc13fb80 0x7f7bbc15d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:19.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.262+0000 7f7bbb7fe700 1 -- 172.21.15.146:0/290896764 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7bbc13ff50 msgr2=0x7f7bbc06c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:19.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.262+0000 7f7bbb7fe700 1 --2- 172.21.15.146:0/290896764 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7bbc13ff50 0x7f7bbc06c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:19.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.262+0000 7f7bbb7fe700 1 -- 172.21.15.146:0/290896764 >> v2:172.21.15.151:3300/0 conn(0x7f7bbc13fb80 msgr2=0x7f7bbc15d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:19.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.262+0000 7f7bbb7fe700 1 --2- 172.21.15.146:0/290896764 >> v2:172.21.15.151:3300/0 conn(0x7f7bbc13fb80 0x7f7bbc15d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:19.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.262+0000 7f7bbb7fe700 1 -- 172.21.15.146:0/290896764 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bbc06bcb0 con 0x7f7bbc15d810 2023-10-06T11:06:19.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.262+0000 7f7bbb7fe700 1 --2- 172.21.15.146:0/290896764 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bbc15d810 0x7f7bbc0c7800 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc065790 tx=0x7f7bb4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6b025fed25eef3c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:19.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.262+0000 7f7bba7fc700 1 -- 172.21.15.146:0/290896764 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb400e070 con 0x7f7bbc15d810 2023-10-06T11:06:19.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.262+0000 7f7bba7fc700 1 -- 172.21.15.146:0/290896764 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb400b970 con 0x7f7bbc15d810 2023-10-06T11:06:19.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.262+0000 7f7bba7fc700 1 -- 172.21.15.146:0/290896764 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb40092e0 con 0x7f7bbc15d810 2023-10-06T11:06:19.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.263+0000 7f7bc169b700 1 -- 172.21.15.146:0/290896764 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bbc15d810 msgr2=0x7f7bbc0c7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:19.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.263+0000 7f7bc169b700 1 --2- 172.21.15.146:0/290896764 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bbc15d810 0x7f7bbc0c7800 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc065790 tx=0x7f7bb4009840 comp rx=0 tx=0).stop 2023-10-06T11:06:19.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.263+0000 7f7bc169b700 1 -- 172.21.15.146:0/290896764 shutdown_connections 2023-10-06T11:06:19.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.263+0000 7f7bc169b700 1 --2- 172.21.15.146:0/290896764 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bbc15d810 0x7f7bbc0c7800 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:19.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.263+0000 7f7bc169b700 1 --2- 172.21.15.146:0/290896764 >> v2:172.21.15.151:3300/0 conn(0x7f7bbc13fb80 0x7f7bbc15d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:19.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.263+0000 7f7bc169b700 1 --2- 172.21.15.146:0/290896764 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7bbc13ff50 0x7f7bbc06c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:19.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.263+0000 7f7bc169b700 1 -- 172.21.15.146:0/290896764 >> 172.21.15.146:0/290896764 conn(0x7f7bbc06b040 msgr2=0x7f7bbc0cd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:19.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.263+0000 7f7bc169b700 1 -- 172.21.15.146:0/290896764 shutdown_connections 2023-10-06T11:06:19.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.263+0000 7f7bc169b700 1 -- 172.21.15.146:0/290896764 wait complete. 2023-10-06T11:06:19.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.264+0000 7f7bc169b700 1 Processor -- start 2023-10-06T11:06:19.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.264+0000 7f7bc169b700 1 -- start start 2023-10-06T11:06:19.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.265+0000 7f7bc169b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bbc13fb80 0x7f7bbc1598c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:19.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.265+0000 7f7bc169b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7bbc13ff50 0x7f7bbc169d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:19.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.265+0000 7f7bc169b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7bbc15d810 0x7f7bbc0c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:19.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.265+0000 7f7bc169b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bbc16d130 con 0x7f7bbc13fb80 2023-10-06T11:06:19.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.265+0000 7f7bc169b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bbc0b0f10 con 0x7f7bbc13ff50 2023-10-06T11:06:19.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.265+0000 7f7bc169b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bbc16a260 con 0x7f7bbc15d810 2023-10-06T11:06:19.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.265+0000 7f7bbaffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bbc13fb80 0x7f7bbc1598c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:19.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.265+0000 7f7bbaffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bbc13fb80 0x7f7bbc1598c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39642/0 (socket says 172.21.15.146:39642) 2023-10-06T11:06:19.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.265+0000 7f7bbaffd700 1 -- 172.21.15.146:0/665045488 learned_addr learned my addr 172.21.15.146:0/665045488 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:19.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.265+0000 7f7bb27fc700 1 --2- 172.21.15.146:0/665045488 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7bbc13ff50 0x7f7bbc169d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:19.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.265+0000 7f7bbb7fe700 1 --2- 172.21.15.146:0/665045488 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7bbc15d810 0x7f7bbc0c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:19.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.265+0000 7f7bbaffd700 1 -- 172.21.15.146:0/665045488 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7bbc15d810 msgr2=0x7f7bbc0c6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:19.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.265+0000 7f7bbaffd700 1 --2- 172.21.15.146:0/665045488 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7bbc15d810 0x7f7bbc0c6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:19.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.265+0000 7f7bbaffd700 1 -- 172.21.15.146:0/665045488 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7bbc13ff50 msgr2=0x7f7bbc169d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:19.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.265+0000 7f7bbaffd700 1 --2- 172.21.15.146:0/665045488 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7bbc13ff50 0x7f7bbc169d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:19.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.265+0000 7f7bbaffd700 1 -- 172.21.15.146:0/665045488 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb4009ae0 con 0x7f7bbc13fb80 2023-10-06T11:06:19.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.265+0000 7f7bbaffd700 1 --2- 172.21.15.146:0/665045488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bbc13fb80 0x7f7bbc1598c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7bac00ec80 tx=0x7f7bac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:19.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.265+0000 7f7bb37fe700 1 -- 172.21.15.146:0/665045488 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bac009690 con 0x7f7bbc13fb80 2023-10-06T11:06:19.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.265+0000 7f7bb37fe700 1 -- 172.21.15.146:0/665045488 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bac00c7f0 con 0x7f7bbc13fb80 2023-10-06T11:06:19.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.265+0000 7f7bc169b700 1 -- 172.21.15.146:0/665045488 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bbc0b0c30 con 0x7f7bbc13fb80 2023-10-06T11:06:19.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.265+0000 7f7bb37fe700 1 -- 172.21.15.146:0/665045488 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bac00cbb0 con 0x7f7bbc13fb80 2023-10-06T11:06:19.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.265+0000 7f7bc169b700 1 -- 172.21.15.146:0/665045488 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bbc15b590 con 0x7f7bbc13fb80 2023-10-06T11:06:19.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.266+0000 7f7bc169b700 1 -- 172.21.15.146:0/665045488 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bbc15b110 con 0x7f7bbc13fb80 2023-10-06T11:06:19.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.267+0000 7f7bb37fe700 1 -- 172.21.15.146:0/665045488 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7bac013470 con 0x7f7bbc13fb80 2023-10-06T11:06:19.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.267+0000 7f7bb37fe700 1 --2- 172.21.15.146:0/665045488 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7b9c066f30 0x7f7b9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:19.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.267+0000 7f7bb37fe700 1 -- 172.21.15.146:0/665045488 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7bac084780 con 0x7f7bbc13fb80 2023-10-06T11:06:19.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.267+0000 7f7bb27fc700 1 --2- 172.21.15.146:0/665045488 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7b9c066f30 0x7f7b9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:19.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.267+0000 7f7bb27fc700 1 --2- 172.21.15.146:0/665045488 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7b9c066f30 0x7f7b9c0693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc15ce10 tx=0x7f7ba40091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:19.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.271+0000 7f7bb37fe700 1 -- 172.21.15.146:0/665045488 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7bbc15b110 con 0x7f7bbc13fb80 2023-10-06T11:06:19.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:19.532+0000 7f7bc169b700 1 -- 172.21.15.146:0/665045488 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]} v 0) v1 -- 0x7f7bbc15b110 con 0x7f7bbc13fb80 2023-10-06T11:06:19.626 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:06:19.629 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:06:20.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.478+0000 7f7bb37fe700 1 -- 172.21.15.146:0/665045488 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]}]=0 v50) v1 ==== 151+0+0 (secure 0 0 0) 0x7f7bbc15b110 con 0x7f7bbc13fb80 2023-10-06T11:06:20.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.480+0000 7f7bc169b700 1 -- 172.21.15.146:0/665045488 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7b9c066f30 msgr2=0x7f7b9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:20.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.480+0000 7f7bc169b700 1 --2- 172.21.15.146:0/665045488 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7b9c066f30 0x7f7b9c0693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7bbc15ce10 tx=0x7f7ba40091a0 comp rx=0 tx=0).stop 2023-10-06T11:06:20.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.480+0000 7f7bc169b700 1 -- 172.21.15.146:0/665045488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bbc13fb80 msgr2=0x7f7bbc1598c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:20.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.480+0000 7f7bc169b700 1 --2- 172.21.15.146:0/665045488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bbc13fb80 0x7f7bbc1598c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7bac00ec80 tx=0x7f7bac0091a0 comp rx=0 tx=0).stop 2023-10-06T11:06:20.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.481+0000 7f7bc169b700 1 -- 172.21.15.146:0/665045488 shutdown_connections 2023-10-06T11:06:20.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.481+0000 7f7bc169b700 1 --2- 172.21.15.146:0/665045488 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7b9c066f30 0x7f7b9c0693e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:20.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.481+0000 7f7bc169b700 1 --2- 172.21.15.146:0/665045488 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7bbc15d810 0x7f7bbc0c6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:20.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.481+0000 7f7bc169b700 1 --2- 172.21.15.146:0/665045488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bbc13fb80 0x7f7bbc1598c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:20.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.481+0000 7f7bc169b700 1 --2- 172.21.15.146:0/665045488 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7bbc13ff50 0x7f7bbc169d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:20.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.481+0000 7f7bc169b700 1 -- 172.21.15.146:0/665045488 >> 172.21.15.146:0/665045488 conn(0x7f7bbc06b040 msgr2=0x7f7bbc06e420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:20.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.481+0000 7f7bc169b700 1 -- 172.21.15.146:0/665045488 shutdown_connections 2023-10-06T11:06:20.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.481+0000 7f7bc169b700 1 -- 172.21.15.146:0/665045488 wait complete. 2023-10-06T11:06:20.496 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T11:06:20.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.617+0000 7fac630e3700 1 Processor -- start 2023-10-06T11:06:20.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.617+0000 7fac630e3700 1 -- start start 2023-10-06T11:06:20.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.617+0000 7fac630e3700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fac5c0ae730 0x7fac5c0aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:20.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.617+0000 7fac630e3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac5c0cb950 0x7fac5c0cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:20.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.617+0000 7fac630e3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac5c0ae2a0 con 0x7fac5c15a160 2023-10-06T11:06:20.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.618+0000 7fac630e3700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac5c15a530 con 0x7fac5c0ae730 2023-10-06T11:06:20.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.618+0000 7fac630e3700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c0c5cb0 con 0x7fac5c0cb950 2023-10-06T11:06:20.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.618+0000 7fac60e7f700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fac5c15a160 0x7fac5c0c55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49596/0 (socket says 172.21.15.146:49596) 2023-10-06T11:06:20.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.618+0000 7fac60e7f700 1 -- 172.21.15.146:0/2771810824 learned_addr learned my addr 172.21.15.146:0/2771810824 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:20.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.618+0000 7fac53fff700 1 --2- 172.21.15.146:0/2771810824 >> v2:172.21.15.151:3300/0 conn(0x7fac5c0ae730 0x7fac5c0aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:20.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.618+0000 7fac61680700 1 --2- 172.21.15.146:0/2771810824 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac5c0cb950 0x7fac5c0cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:20.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.618+0000 7fac537fe700 1 -- 172.21.15.146:0/2771810824 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1408929568 0 0) 0x7fac5c0ae2a0 con 0x7fac5c15a160 2023-10-06T11:06:20.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.618+0000 7fac537fe700 1 -- 172.21.15.146:0/2771810824 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac44003570 con 0x7fac5c15a160 2023-10-06T11:06:20.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.618+0000 7fac537fe700 1 -- 172.21.15.146:0/2771810824 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 476587959 0 0) 0x7fac44003570 con 0x7fac5c15a160 2023-10-06T11:06:20.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.618+0000 7fac537fe700 1 -- 172.21.15.146:0/2771810824 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac5c0cb950 msgr2=0x7fac5c0cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:20.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.618+0000 7fac537fe700 1 --2- 172.21.15.146:0/2771810824 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac5c0cb950 0x7fac5c0cbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:20.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.618+0000 7fac537fe700 1 -- 172.21.15.146:0/2771810824 >> v2:172.21.15.151:3300/0 conn(0x7fac5c0ae730 msgr2=0x7fac5c0aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:20.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.618+0000 7fac537fe700 1 --2- 172.21.15.146:0/2771810824 >> v2:172.21.15.151:3300/0 conn(0x7fac5c0ae730 0x7fac5c0aebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:20.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.618+0000 7fac537fe700 1 -- 172.21.15.146:0/2771810824 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac5c0af0f0 con 0x7fac5c15a160 2023-10-06T11:06:20.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.618+0000 7fac537fe700 1 -- 172.21.15.146:0/2771810824 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fac58001970 con 0x7fac5c15a160 2023-10-06T11:06:20.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.618+0000 7fac537fe700 1 -- 172.21.15.146:0/2771810824 >> v1:172.21.15.146:6789/0 conn(0x7fac5c15a160 legacy=0x7fac5c0c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:20.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.618+0000 7fac537fe700 1 --2- 172.21.15.146:0/2771810824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac44003a60 0x7fac44003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:20.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.618+0000 7fac537fe700 1 --2- 172.21.15.146:0/2771810824 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac5c0cb950 0x7fac44004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:20.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.618+0000 7fac537fe700 1 --2- 172.21.15.146:0/2771810824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac44004d50 0x7fac440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:20.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.618+0000 7fac537fe700 1 -- 172.21.15.146:0/2771810824 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c15a530 con 0x7fac44004d50 2023-10-06T11:06:20.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.618+0000 7fac537fe700 1 -- 172.21.15.146:0/2771810824 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c0c5cb0 con 0x7fac44003a60 2023-10-06T11:06:20.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.618+0000 7fac537fe700 1 -- 172.21.15.146:0/2771810824 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac4400ba60 con 0x7fac5c0cb950 2023-10-06T11:06:20.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.618+0000 7fac61680700 1 --2- 172.21.15.146:0/2771810824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac44004d50 0x7fac440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:20.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.618+0000 7fac60e7f700 1 --2- 172.21.15.146:0/2771810824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac44003a60 0x7fac44003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:20.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.618+0000 7fac53fff700 1 --2- 172.21.15.146:0/2771810824 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac5c0cb950 0x7fac44004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:20.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.619+0000 7fac61680700 1 -- 172.21.15.146:0/2771810824 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac5c0cb950 msgr2=0x7fac44004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:20.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.619+0000 7fac61680700 1 --2- 172.21.15.146:0/2771810824 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac5c0cb950 0x7fac44004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:20.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.619+0000 7fac61680700 1 -- 172.21.15.146:0/2771810824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac44003a60 msgr2=0x7fac44003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:20.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.619+0000 7fac61680700 1 --2- 172.21.15.146:0/2771810824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac44003a60 0x7fac44003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:20.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.619+0000 7fac61680700 1 -- 172.21.15.146:0/2771810824 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac44003570 con 0x7fac44004d50 2023-10-06T11:06:20.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.619+0000 7fac61680700 1 --2- 172.21.15.146:0/2771810824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac44004d50 0x7fac440051c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fac54009c00 tx=0x7fac540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aa8de409e8debfa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:20.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.619+0000 7fac537fe700 1 -- 172.21.15.146:0/2771810824 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5400e6b0 con 0x7fac44004d50 2023-10-06T11:06:20.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.619+0000 7fac537fe700 1 -- 172.21.15.146:0/2771810824 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac5400e810 con 0x7fac44004d50 2023-10-06T11:06:20.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.619+0000 7fac537fe700 1 -- 172.21.15.146:0/2771810824 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5400ebd0 con 0x7fac44004d50 2023-10-06T11:06:20.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.619+0000 7fac630e3700 1 -- 172.21.15.146:0/2771810824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac44004d50 msgr2=0x7fac440051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:20.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.619+0000 7fac630e3700 1 --2- 172.21.15.146:0/2771810824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac44004d50 0x7fac440051c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fac54009c00 tx=0x7fac540091a0 comp rx=0 tx=0).stop 2023-10-06T11:06:20.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.619+0000 7fac61680700 1 -- 172.21.15.146:0/2771810824 reap_dead start 2023-10-06T11:06:20.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.620+0000 7fac630e3700 1 -- 172.21.15.146:0/2771810824 shutdown_connections 2023-10-06T11:06:20.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.620+0000 7fac630e3700 1 -- 172.21.15.146:0/2771810824 >> 172.21.15.146:0/2771810824 conn(0x7fac5c06f380 msgr2=0x7fac5c0d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:20.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.620+0000 7fac630e3700 1 -- 172.21.15.146:0/2771810824 shutdown_connections 2023-10-06T11:06:20.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.620+0000 7fac630e3700 1 -- 172.21.15.146:0/2771810824 wait complete. 2023-10-06T11:06:20.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.621+0000 7fac630e3700 1 Processor -- start 2023-10-06T11:06:20.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.621+0000 7fac630e3700 1 -- start start 2023-10-06T11:06:20.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.622+0000 7fac630e3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac5c157930 0x7fac5c0c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:20.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.622+0000 7fac630e3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac5c0c9dc0 0x7fac5c0cf300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:20.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.622+0000 7fac630e3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac5c0cf840 0x7fac5c0b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:20.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.622+0000 7fac630e3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c0c8770 con 0x7fac5c157930 2023-10-06T11:06:20.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.622+0000 7fac630e3700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c0cfcb0 con 0x7fac5c0c9dc0 2023-10-06T11:06:20.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.622+0000 7fac630e3700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5c0b01b0 con 0x7fac5c0cf840 2023-10-06T11:06:20.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.622+0000 7fac60e7f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac5c157930 0x7fac5c0c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:20.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.622+0000 7fac60e7f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac5c157930 0x7fac5c0c78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39664/0 (socket says 172.21.15.146:39664) 2023-10-06T11:06:20.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.622+0000 7fac60e7f700 1 -- 172.21.15.146:0/3050590710 learned_addr learned my addr 172.21.15.146:0/3050590710 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:20.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.622+0000 7fac61680700 1 --2- 172.21.15.146:0/3050590710 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac5c0cf840 0x7fac5c0b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:20.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.622+0000 7fac53fff700 1 --2- 172.21.15.146:0/3050590710 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac5c0c9dc0 0x7fac5c0cf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:20.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.622+0000 7fac60e7f700 1 -- 172.21.15.146:0/3050590710 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac5c0cf840 msgr2=0x7fac5c0b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:20.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.622+0000 7fac60e7f700 1 --2- 172.21.15.146:0/3050590710 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac5c0cf840 0x7fac5c0b35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:20.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.622+0000 7fac60e7f700 1 -- 172.21.15.146:0/3050590710 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac5c0c9dc0 msgr2=0x7fac5c0cf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:20.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.622+0000 7fac60e7f700 1 --2- 172.21.15.146:0/3050590710 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac5c0c9dc0 0x7fac5c0cf300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:20.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.622+0000 7fac60e7f700 1 -- 172.21.15.146:0/3050590710 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac5c0afba0 con 0x7fac5c157930 2023-10-06T11:06:20.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.622+0000 7fac60e7f700 1 --2- 172.21.15.146:0/3050590710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac5c157930 0x7fac5c0c78b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fac58001930 tx=0x7fac58009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:20.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.622+0000 7fac50ff9700 1 -- 172.21.15.146:0/3050590710 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac58005d80 con 0x7fac5c157930 2023-10-06T11:06:20.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.622+0000 7fac50ff9700 1 -- 172.21.15.146:0/3050590710 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac5800d920 con 0x7fac5c157930 2023-10-06T11:06:20.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.622+0000 7fac630e3700 1 -- 172.21.15.146:0/3050590710 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac5c0c81b0 con 0x7fac5c157930 2023-10-06T11:06:20.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.622+0000 7fac50ff9700 1 -- 172.21.15.146:0/3050590710 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5800dce0 con 0x7fac5c157930 2023-10-06T11:06:20.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.622+0000 7fac630e3700 1 -- 172.21.15.146:0/3050590710 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac5c0afe40 con 0x7fac5c157930 2023-10-06T11:06:20.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.623+0000 7fac630e3700 1 -- 172.21.15.146:0/3050590710 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac5c068390 con 0x7fac5c157930 2023-10-06T11:06:20.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.624+0000 7fac50ff9700 1 -- 172.21.15.146:0/3050590710 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fac580072e0 con 0x7fac5c157930 2023-10-06T11:06:20.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.624+0000 7fac50ff9700 1 --2- 172.21.15.146:0/3050590710 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fac48066f30 0x7fac480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:20.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.624+0000 7fac53fff700 1 --2- 172.21.15.146:0/3050590710 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fac48066f30 0x7fac480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:20.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.624+0000 7fac50ff9700 1 -- 172.21.15.146:0/3050590710 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fac58084c30 con 0x7fac5c157930 2023-10-06T11:06:20.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.625+0000 7fac53fff700 1 --2- 172.21.15.146:0/3050590710 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fac48066f30 0x7fac480693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fac5c0b2c40 tx=0x7fac4c0091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:20.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.629+0000 7fac50ff9700 1 -- 172.21.15.146:0/3050590710 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fac58051d40 con 0x7fac5c157930 2023-10-06T11:06:20.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.809+0000 7fac630e3700 1 -- 172.21.15.146:0/3050590710 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fac5c04c380 con 0x7fac5c157930 2023-10-06T11:06:20.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.813+0000 7fac50ff9700 1 -- 172.21.15.146:0/3050590710 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fac58055360 con 0x7fac5c157930 2023-10-06T11:06:20.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.815+0000 7fac630e3700 1 -- 172.21.15.146:0/3050590710 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fac48066f30 msgr2=0x7fac480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:20.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.815+0000 7fac630e3700 1 --2- 172.21.15.146:0/3050590710 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fac48066f30 0x7fac480693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fac5c0b2c40 tx=0x7fac4c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:06:20.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.815+0000 7fac630e3700 1 -- 172.21.15.146:0/3050590710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac5c157930 msgr2=0x7fac5c0c78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:20.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.815+0000 7fac630e3700 1 --2- 172.21.15.146:0/3050590710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac5c157930 0x7fac5c0c78b0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fac58001930 tx=0x7fac58009040 comp rx=0 tx=0).stop 2023-10-06T11:06:20.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.815+0000 7fac630e3700 1 -- 172.21.15.146:0/3050590710 shutdown_connections 2023-10-06T11:06:20.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.815+0000 7fac630e3700 1 --2- 172.21.15.146:0/3050590710 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fac48066f30 0x7fac480693e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:20.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.815+0000 7fac630e3700 1 --2- 172.21.15.146:0/3050590710 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac5c0cf840 0x7fac5c0b35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:20.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.815+0000 7fac630e3700 1 --2- 172.21.15.146:0/3050590710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac5c157930 0x7fac5c0c78b0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:20.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.815+0000 7fac630e3700 1 --2- 172.21.15.146:0/3050590710 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac5c0c9dc0 0x7fac5c0cf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:20.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.815+0000 7fac630e3700 1 -- 172.21.15.146:0/3050590710 >> 172.21.15.146:0/3050590710 conn(0x7fac5c06f380 msgr2=0x7fac5c159400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:20.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.815+0000 7fac630e3700 1 -- 172.21.15.146:0/3050590710 shutdown_connections 2023-10-06T11:06:20.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:20.815+0000 7fac630e3700 1 -- 172.21.15.146:0/3050590710 wait complete. 2023-10-06T11:06:20.828 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T11:06:20.829 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:06:20.866 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:06:20.907 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T11:06:20.908 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi146.front.sepia.ceph.com... 2023-10-06T11:06:20.908 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T11:06:20.908 DEBUG:teuthology.orchestra.run.smithi146:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T11:06:20.942 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T11:06:20.942 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-10-06T11:06:20.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:20.942 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T11:06:20.998 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi151.front.sepia.ceph.com... 2023-10-06T11:06:20.998 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T11:06:20.998 DEBUG:teuthology.orchestra.run.smithi151:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-10-06T11:06:21.036 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T11:06:21.036 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-10-06T11:06:21.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:21.037 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T11:06:21.093 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi146.front.sepia.ceph.com... 2023-10-06T11:06:21.093 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T11:06:21.093 DEBUG:teuthology.orchestra.run.smithi146:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-10-06T11:06:21.128 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T11:06:21.128 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-10-06T11:06:21.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:21.128 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T11:06:21.183 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi151.front.sepia.ceph.com... 2023-10-06T11:06:21.183 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T11:06:21.184 DEBUG:teuthology.orchestra.run.smithi151:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-10-06T11:06:21.223 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T11:06:21.223 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-10-06T11:06:21.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:21.223 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T11:06:21.280 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T11:06:21.280 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:06:21.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.393+0000 7fde3359e700 1 Processor -- start 2023-10-06T11:06:21.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.393+0000 7fde3359e700 1 -- start start 2023-10-06T11:06:21.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.394+0000 7fde3359e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fde3415a420 0x7fde3415cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:21.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.394+0000 7fde3359e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fde3415a7f0 0x7fde340b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:21.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.394+0000 7fde3359e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde340b2360 0x7fde3415acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:21.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.394+0000 7fde3359e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde340ce040 con 0x7fde3415a7f0 2023-10-06T11:06:21.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.394+0000 7fde3359e700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde3415c630 con 0x7fde3415a420 2023-10-06T11:06:21.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.394+0000 7fde3359e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde340b27a0 con 0x7fde340b2360 2023-10-06T11:06:21.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.394+0000 7fde29d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fde3415a7f0 0x7fde340b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:21.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.394+0000 7fde29d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fde3415a7f0 0x7fde340b1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34580/0 (socket says 172.21.15.146:34580) 2023-10-06T11:06:21.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.394+0000 7fde29d9b700 1 -- 172.21.15.146:0/1557669590 learned_addr learned my addr 172.21.15.146:0/1557669590 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:21.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.394+0000 7fde3259c700 1 --2- 172.21.15.146:0/1557669590 >> v2:172.21.15.151:3300/0 conn(0x7fde3415a420 0x7fde3415cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:21.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.394+0000 7fde32d9d700 1 --2- 172.21.15.146:0/1557669590 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde340b2360 0x7fde3415acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:21.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.394+0000 7fde29d9b700 1 -- 172.21.15.146:0/1557669590 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde340b2360 msgr2=0x7fde3415acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:21.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.394+0000 7fde29d9b700 1 --2- 172.21.15.146:0/1557669590 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde340b2360 0x7fde3415acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:21.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.394+0000 7fde29d9b700 1 -- 172.21.15.146:0/1557669590 >> v2:172.21.15.151:3300/0 conn(0x7fde3415a420 msgr2=0x7fde3415cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:21.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.394+0000 7fde29d9b700 1 --2- 172.21.15.146:0/1557669590 >> v2:172.21.15.151:3300/0 conn(0x7fde3415a420 0x7fde3415cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:21.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.394+0000 7fde29d9b700 1 -- 172.21.15.146:0/1557669590 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde3415ba20 con 0x7fde3415a7f0 2023-10-06T11:06:21.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.394+0000 7fde3259c700 1 --2- 172.21.15.146:0/1557669590 >> v2:172.21.15.151:3300/0 conn(0x7fde3415a420 0x7fde3415cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:06:21.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.394+0000 7fde29d9b700 1 --2- 172.21.15.146:0/1557669590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde3415a7f0 0x7fde340b1e20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fde340d1460 tx=0x7fde1c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a78dae82ef4433ed server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:21.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.395+0000 7fde31d9b700 1 -- 172.21.15.146:0/1557669590 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1c00b860 con 0x7fde3415a7f0 2023-10-06T11:06:21.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.395+0000 7fde31d9b700 1 -- 172.21.15.146:0/1557669590 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde1c00b9c0 con 0x7fde3415a7f0 2023-10-06T11:06:21.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.395+0000 7fde31d9b700 1 -- 172.21.15.146:0/1557669590 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1c00bd60 con 0x7fde3415a7f0 2023-10-06T11:06:21.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.395+0000 7fde3359e700 1 -- 172.21.15.146:0/1557669590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde3415a7f0 msgr2=0x7fde340b1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:21.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.395+0000 7fde3359e700 1 --2- 172.21.15.146:0/1557669590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde3415a7f0 0x7fde340b1e20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fde340d1460 tx=0x7fde1c009250 comp rx=0 tx=0).stop 2023-10-06T11:06:21.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.395+0000 7fde3359e700 1 -- 172.21.15.146:0/1557669590 shutdown_connections 2023-10-06T11:06:21.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.395+0000 7fde3359e700 1 --2- 172.21.15.146:0/1557669590 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde340b2360 0x7fde3415acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:21.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.395+0000 7fde3359e700 1 --2- 172.21.15.146:0/1557669590 >> v2:172.21.15.151:3300/0 conn(0x7fde3415a420 0x7fde3415cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:21.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.395+0000 7fde3359e700 1 --2- 172.21.15.146:0/1557669590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde3415a7f0 0x7fde340b1e20 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:21.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.395+0000 7fde3359e700 1 -- 172.21.15.146:0/1557669590 >> 172.21.15.146:0/1557669590 conn(0x7fde3406eba0 msgr2=0x7fde3406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:21.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.395+0000 7fde3359e700 1 -- 172.21.15.146:0/1557669590 shutdown_connections 2023-10-06T11:06:21.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.395+0000 7fde3359e700 1 -- 172.21.15.146:0/1557669590 wait complete. 2023-10-06T11:06:21.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.396+0000 7fde3359e700 1 Processor -- start 2023-10-06T11:06:21.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.396+0000 7fde3359e700 1 -- start start 2023-10-06T11:06:21.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.397+0000 7fde3359e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde340b2360 0x7fde340ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:21.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.397+0000 7fde3359e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde3415a420 0x7fde34147ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:21.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.397+0000 7fde3359e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde3415a7f0 0x7fde340ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:21.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.397+0000 7fde3359e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde340cd100 con 0x7fde3415a7f0 2023-10-06T11:06:21.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.397+0000 7fde3359e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde34147840 con 0x7fde340b2360 2023-10-06T11:06:21.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.397+0000 7fde3359e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde3416a120 con 0x7fde3415a420 2023-10-06T11:06:21.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.397+0000 7fde32d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde3415a7f0 0x7fde340ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:21.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.397+0000 7fde32d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde3415a7f0 0x7fde340ceb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34586/0 (socket says 172.21.15.146:34586) 2023-10-06T11:06:21.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.397+0000 7fde32d9d700 1 -- 172.21.15.146:0/3966146312 learned_addr learned my addr 172.21.15.146:0/3966146312 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:21.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.397+0000 7fde29d9b700 1 --2- 172.21.15.146:0/3966146312 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde3415a420 0x7fde34147ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:21.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.397+0000 7fde3259c700 1 --2- 172.21.15.146:0/3966146312 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde340b2360 0x7fde340ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:21.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.398+0000 7fde32d9d700 1 -- 172.21.15.146:0/3966146312 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde3415a420 msgr2=0x7fde34147ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:21.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.398+0000 7fde32d9d700 1 --2- 172.21.15.146:0/3966146312 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde3415a420 0x7fde34147ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:21.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.398+0000 7fde32d9d700 1 -- 172.21.15.146:0/3966146312 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde340b2360 msgr2=0x7fde340ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:21.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.398+0000 7fde32d9d700 1 --2- 172.21.15.146:0/3966146312 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde340b2360 0x7fde340ccbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:21.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.398+0000 7fde32d9d700 1 -- 172.21.15.146:0/3966146312 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde1c0094f0 con 0x7fde3415a7f0 2023-10-06T11:06:21.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.398+0000 7fde32d9d700 1 --2- 172.21.15.146:0/3966146312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde3415a7f0 0x7fde340ceb70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fde2c009fd0 tx=0x7fde2c009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:21.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.398+0000 7fde2affd700 1 -- 172.21.15.146:0/3966146312 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2c00ebf0 con 0x7fde3415a7f0 2023-10-06T11:06:21.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.398+0000 7fde2affd700 1 -- 172.21.15.146:0/3966146312 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde2c00ed50 con 0x7fde3415a7f0 2023-10-06T11:06:21.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.398+0000 7fde3359e700 1 -- 172.21.15.146:0/3966146312 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde34148920 con 0x7fde3415a7f0 2023-10-06T11:06:21.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.398+0000 7fde2affd700 1 -- 172.21.15.146:0/3966146312 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2c014670 con 0x7fde3415a7f0 2023-10-06T11:06:21.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.398+0000 7fde3359e700 1 -- 172.21.15.146:0/3966146312 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde34148f60 con 0x7fde3415a7f0 2023-10-06T11:06:21.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.399+0000 7fde3359e700 1 -- 172.21.15.146:0/3966146312 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde340afae0 con 0x7fde3415a7f0 2023-10-06T11:06:21.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.399+0000 7fde2affd700 1 -- 172.21.15.146:0/3966146312 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fde2c0149e0 con 0x7fde3415a7f0 2023-10-06T11:06:21.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.400+0000 7fde2affd700 1 --2- 172.21.15.146:0/3966146312 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fde14066f30 0x7fde140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:21.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.400+0000 7fde3259c700 1 --2- 172.21.15.146:0/3966146312 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fde14066f30 0x7fde140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:21.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.400+0000 7fde2affd700 1 -- 172.21.15.146:0/3966146312 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fde2c084ce0 con 0x7fde3415a7f0 2023-10-06T11:06:21.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.400+0000 7fde3259c700 1 --2- 172.21.15.146:0/3966146312 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fde14066f30 0x7fde140693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fde24006f00 tx=0x7fde24008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:21.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.404+0000 7fde2affd700 1 -- 172.21.15.146:0/3966146312 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fde2c051df0 con 0x7fde3415a7f0 2023-10-06T11:06:21.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.631+0000 7fde3359e700 1 -- 172.21.15.146:0/3966146312 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde3415bd00 con 0x7fde3415a7f0 2023-10-06T11:06:21.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.631+0000 7fde2affd700 1 -- 172.21.15.146:0/3966146312 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4597 (secure 0 0 0) 0x7fde2c055410 con 0x7fde3415a7f0 2023-10-06T11:06:21.633 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:06:21.634 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2812328960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2812328960},{"type":"v1","addr":"172.21.15.151:6835","nonce":2812328960}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/178026783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":178026783},{"type":"v1","addr":"172.21.15.146:6836","nonce":178026783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/716185126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":716185126},{"type":"v1","addr":"172.21.15.146:6837","nonce":716185126}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:05:43.740490+0000","modified":"2023-10-06T11:05:47.375805+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6833/1317728156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1317728156},{"type":"v1","addr":"172.21.15.151:6833","nonce":1317728156}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T11:06:21.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.633+0000 7fde3359e700 1 -- 172.21.15.146:0/3966146312 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fde14066f30 msgr2=0x7fde140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:21.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.633+0000 7fde3359e700 1 --2- 172.21.15.146:0/3966146312 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fde14066f30 0x7fde140693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fde24006f00 tx=0x7fde24008040 comp rx=0 tx=0).stop 2023-10-06T11:06:21.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.633+0000 7fde3359e700 1 -- 172.21.15.146:0/3966146312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde3415a7f0 msgr2=0x7fde340ceb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:21.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.633+0000 7fde3359e700 1 --2- 172.21.15.146:0/3966146312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde3415a7f0 0x7fde340ceb70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fde2c009fd0 tx=0x7fde2c009900 comp rx=0 tx=0).stop 2023-10-06T11:06:21.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.633+0000 7fde3359e700 1 -- 172.21.15.146:0/3966146312 shutdown_connections 2023-10-06T11:06:21.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.633+0000 7fde3359e700 1 --2- 172.21.15.146:0/3966146312 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fde14066f30 0x7fde140693e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:21.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.633+0000 7fde3359e700 1 --2- 172.21.15.146:0/3966146312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde3415a7f0 0x7fde340ceb70 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:21.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.633+0000 7fde3359e700 1 --2- 172.21.15.146:0/3966146312 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde340b2360 0x7fde340ccbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:21.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.633+0000 7fde3359e700 1 --2- 172.21.15.146:0/3966146312 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde3415a420 0x7fde34147ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:21.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.633+0000 7fde3359e700 1 -- 172.21.15.146:0/3966146312 >> 172.21.15.146:0/3966146312 conn(0x7fde3406eba0 msgr2=0x7fde340b1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:21.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.634+0000 7fde3359e700 1 -- 172.21.15.146:0/3966146312 shutdown_connections 2023-10-06T11:06:21.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.634+0000 7fde3359e700 1 -- 172.21.15.146:0/3966146312 wait complete. 2023-10-06T11:06:21.637 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 7 2023-10-06T11:06:21.648 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:06:21.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.761+0000 7fa80b043700 1 Processor -- start 2023-10-06T11:06:21.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.761+0000 7fa80b043700 1 -- start start 2023-10-06T11:06:21.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.762+0000 7fa80b043700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa80415aeb0 0x7fa80415b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:21.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.762+0000 7fa80b043700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa80406c5a0 con 0x7fa804154d20 2023-10-06T11:06:21.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.762+0000 7fa80b043700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa80406b6b0 con 0x7fa8040cbf30 2023-10-06T11:06:21.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.762+0000 7fa80b043700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa80415b870 con 0x7fa80415aeb0 2023-10-06T11:06:21.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.762+0000 7fa80a041700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa804154d20 0x7fa8040c8a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40876/0 (socket says 172.21.15.146:40876) 2023-10-06T11:06:21.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.762+0000 7fa80a041700 1 -- 172.21.15.146:0/4139215907 learned_addr learned my addr 172.21.15.146:0/4139215907 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:21.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.762+0000 7fa80903f700 1 -- 172.21.15.146:0/4139215907 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3823719118 0 0) 0x7fa80406c5a0 con 0x7fa804154d20 2023-10-06T11:06:21.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.762+0000 7fa80903f700 1 -- 172.21.15.146:0/4139215907 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7f0003570 con 0x7fa804154d20 2023-10-06T11:06:21.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.762+0000 7fa809840700 1 --2- 172.21.15.146:0/4139215907 >> v2:172.21.15.151:3300/0 conn(0x7fa80415aeb0 0x7fa80415b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:21.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.762+0000 7fa80903f700 1 -- 172.21.15.146:0/4139215907 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1600140716 0 0) 0x7fa7f0003570 con 0x7fa804154d20 2023-10-06T11:06:21.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.762+0000 7fa80903f700 1 -- 172.21.15.146:0/4139215907 >> v2:172.21.15.151:3300/0 conn(0x7fa80415aeb0 msgr2=0x7fa80415b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:21.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.762+0000 7fa80903f700 1 --2- 172.21.15.146:0/4139215907 >> v2:172.21.15.151:3300/0 conn(0x7fa80415aeb0 0x7fa80415b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:21.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.762+0000 7fa80903f700 1 -- 172.21.15.146:0/4139215907 >> v1:172.21.15.151:6789/0 conn(0x7fa8040cbf30 legacy=0x7fa8040cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:21.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.762+0000 7fa80903f700 1 -- 172.21.15.146:0/4139215907 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa80406b990 con 0x7fa804154d20 2023-10-06T11:06:21.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.762+0000 7fa80903f700 1 -- 172.21.15.146:0/4139215907 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fa8000015f0 con 0x7fa804154d20 2023-10-06T11:06:21.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.763+0000 7fa80903f700 1 -- 172.21.15.146:0/4139215907 >> v1:172.21.15.146:6789/0 conn(0x7fa804154d20 legacy=0x7fa8040c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:21.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.763+0000 7fa80903f700 1 --2- 172.21.15.146:0/4139215907 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa7f0003a60 0x7fa7f0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:21.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.763+0000 7fa80903f700 1 --2- 172.21.15.146:0/4139215907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7f0004810 0x7fa7f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:21.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.763+0000 7fa80903f700 1 --2- 172.21.15.146:0/4139215907 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa7f00051c0 0x7fa7f000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:21.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.763+0000 7fa80903f700 1 -- 172.21.15.146:0/4139215907 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa80415b870 con 0x7fa7f0004810 2023-10-06T11:06:21.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.763+0000 7fa80903f700 1 -- 172.21.15.146:0/4139215907 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f000c0d0 con 0x7fa7f00051c0 2023-10-06T11:06:21.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.763+0000 7fa80903f700 1 -- 172.21.15.146:0/4139215907 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f000c290 con 0x7fa7f0003a60 2023-10-06T11:06:21.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.763+0000 7fa809840700 1 --2- 172.21.15.146:0/4139215907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7f0004810 0x7fa7f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:21.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.763+0000 7fa80a041700 1 --2- 172.21.15.146:0/4139215907 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa7f0003a60 0x7fa7f0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:21.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.763+0000 7fa80a842700 1 --2- 172.21.15.146:0/4139215907 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa7f00051c0 0x7fa7f000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:21.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.763+0000 7fa809840700 1 -- 172.21.15.146:0/4139215907 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa7f0003a60 msgr2=0x7fa7f0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:21.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.763+0000 7fa809840700 1 --2- 172.21.15.146:0/4139215907 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa7f0003a60 0x7fa7f0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:21.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.763+0000 7fa809840700 1 -- 172.21.15.146:0/4139215907 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa7f00051c0 msgr2=0x7fa7f000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:21.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.763+0000 7fa809840700 1 --2- 172.21.15.146:0/4139215907 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa7f00051c0 0x7fa7f000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:21.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.763+0000 7fa809840700 1 -- 172.21.15.146:0/4139215907 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f0003570 con 0x7fa7f0004810 2023-10-06T11:06:21.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.763+0000 7fa80a842700 1 -- 172.21.15.146:0/4139215907 reap_dead start 2023-10-06T11:06:21.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.763+0000 7fa809840700 1 --2- 172.21.15.146:0/4139215907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7f0004810 0x7fa7f0004c80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4009c00 tx=0x7fa7f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de73a4e9fad4de4f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:21.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.763+0000 7fa80903f700 1 -- 172.21.15.146:0/4139215907 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f400e710 con 0x7fa7f0004810 2023-10-06T11:06:21.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.763+0000 7fa80903f700 1 -- 172.21.15.146:0/4139215907 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f400e870 con 0x7fa7f0004810 2023-10-06T11:06:21.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.763+0000 7fa80903f700 1 -- 172.21.15.146:0/4139215907 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f400ec30 con 0x7fa7f0004810 2023-10-06T11:06:21.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.764+0000 7fa80b043700 1 -- 172.21.15.146:0/4139215907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7f0004810 msgr2=0x7fa7f0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:21.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.764+0000 7fa80b043700 1 --2- 172.21.15.146:0/4139215907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7f0004810 0x7fa7f0004c80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4009c00 tx=0x7fa7f40091a0 comp rx=0 tx=0).stop 2023-10-06T11:06:21.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.764+0000 7fa80b043700 1 -- 172.21.15.146:0/4139215907 shutdown_connections 2023-10-06T11:06:21.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.764+0000 7fa80b043700 1 --2- 172.21.15.146:0/4139215907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7f0004810 0x7fa7f0004c80 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:21.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.764+0000 7fa80b043700 1 -- 172.21.15.146:0/4139215907 >> 172.21.15.146:0/4139215907 conn(0x7fa8040ce260 msgr2=0x7fa8040ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:21.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.764+0000 7fa80b043700 1 -- 172.21.15.146:0/4139215907 shutdown_connections 2023-10-06T11:06:21.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.764+0000 7fa80b043700 1 -- 172.21.15.146:0/4139215907 wait complete. 2023-10-06T11:06:21.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.765+0000 7fa80b043700 1 Processor -- start 2023-10-06T11:06:21.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.765+0000 7fa80b043700 1 -- start start 2023-10-06T11:06:21.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.766+0000 7fa80b043700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa7f0004810 0x7fa8040c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:21.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.766+0000 7fa80b043700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8040b3850 0x7fa8040b1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:21.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.766+0000 7fa80b043700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8040c5e90 0x7fa8040c6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:21.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.766+0000 7fa80b043700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8040b2510 con 0x7fa8040b3850 2023-10-06T11:06:21.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.766+0000 7fa80b043700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8040b27b0 con 0x7fa8040c5e90 2023-10-06T11:06:21.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.766+0000 7fa80b043700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8040b2a90 con 0x7fa7f0004810 2023-10-06T11:06:21.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.766+0000 7fa809840700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8040b3850 0x7fa8040b1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:21.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.766+0000 7fa809840700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8040b3850 0x7fa8040b1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34602/0 (socket says 172.21.15.146:34602) 2023-10-06T11:06:21.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.766+0000 7fa809840700 1 -- 172.21.15.146:0/3767340101 learned_addr learned my addr 172.21.15.146:0/3767340101 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:21.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.766+0000 7fa80a041700 1 --2- 172.21.15.146:0/3767340101 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa7f0004810 0x7fa8040c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:21.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.766+0000 7fa80a842700 1 --2- 172.21.15.146:0/3767340101 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8040c5e90 0x7fa8040c6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:21.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.766+0000 7fa809840700 1 -- 172.21.15.146:0/3767340101 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa7f0004810 msgr2=0x7fa8040c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:21.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.766+0000 7fa809840700 1 --2- 172.21.15.146:0/3767340101 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa7f0004810 0x7fa8040c8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:21.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.766+0000 7fa809840700 1 -- 172.21.15.146:0/3767340101 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8040c5e90 msgr2=0x7fa8040c6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:21.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.766+0000 7fa809840700 1 --2- 172.21.15.146:0/3767340101 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8040c5e90 0x7fa8040c6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:21.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.766+0000 7fa809840700 1 -- 172.21.15.146:0/3767340101 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8040b2d70 con 0x7fa8040b3850 2023-10-06T11:06:21.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.766+0000 7fa809840700 1 --2- 172.21.15.146:0/3767340101 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8040b3850 0x7fa8040b1fd0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa7f000c0a0 tx=0x7fa7f401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:21.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.766+0000 7fa7fa7fc700 1 -- 172.21.15.146:0/3767340101 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f4022070 con 0x7fa8040b3850 2023-10-06T11:06:21.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.766+0000 7fa7fa7fc700 1 -- 172.21.15.146:0/3767340101 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f400e9e0 con 0x7fa8040b3850 2023-10-06T11:06:21.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.766+0000 7fa7fa7fc700 1 -- 172.21.15.146:0/3767340101 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f400e710 con 0x7fa8040b3850 2023-10-06T11:06:21.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.766+0000 7fa80b043700 1 -- 172.21.15.146:0/3767340101 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8040b3050 con 0x7fa8040b3850 2023-10-06T11:06:21.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.767+0000 7fa80b043700 1 -- 172.21.15.146:0/3767340101 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa80413d1d0 con 0x7fa8040b3850 2023-10-06T11:06:21.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.767+0000 7fa80b043700 1 -- 172.21.15.146:0/3767340101 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8040b34f0 con 0x7fa8040b3850 2023-10-06T11:06:21.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.768+0000 7fa7fa7fc700 1 -- 172.21.15.146:0/3767340101 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa7f401c660 con 0x7fa8040b3850 2023-10-06T11:06:21.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.768+0000 7fa7fa7fc700 1 --2- 172.21.15.146:0/3767340101 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa7e8066f30 0x7fa7e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:21.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.768+0000 7fa7fa7fc700 1 -- 172.21.15.146:0/3767340101 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa7f4085d50 con 0x7fa8040b3850 2023-10-06T11:06:21.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.768+0000 7fa80a041700 1 --2- 172.21.15.146:0/3767340101 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa7e8066f30 0x7fa7e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:21.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.769+0000 7fa80a041700 1 --2- 172.21.15.146:0/3767340101 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa7e8066f30 0x7fa7e80693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa8000011d0 tx=0x7fa800009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:21.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.772+0000 7fa7fa7fc700 1 -- 172.21.15.146:0/3767340101 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa7f40b75a0 con 0x7fa8040b3850 2023-10-06T11:06:21.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.956+0000 7fa80b043700 1 -- 172.21.15.146:0/3767340101 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8040b36a0 con 0x7fa8040b3850 2023-10-06T11:06:21.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.957+0000 7fa7fa7fc700 1 -- 172.21.15.146:0/3767340101 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16914 (secure 0 0 0) 0x7fa7f402b090 con 0x7fa8040b3850 2023-10-06T11:06:21.960 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:06:21.960 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":20,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:05:45.362089+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:05:41.403954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T11:05:42.698754+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:06:21.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.959+0000 7fa80b043700 1 -- 172.21.15.146:0/3767340101 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa7e8066f30 msgr2=0x7fa7e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:21.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.959+0000 7fa80b043700 1 --2- 172.21.15.146:0/3767340101 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa7e8066f30 0x7fa7e80693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa8000011d0 tx=0x7fa800009040 comp rx=0 tx=0).stop 2023-10-06T11:06:21.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.959+0000 7fa80b043700 1 -- 172.21.15.146:0/3767340101 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8040b3850 msgr2=0x7fa8040b1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:21.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.959+0000 7fa80b043700 1 --2- 172.21.15.146:0/3767340101 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8040b3850 0x7fa8040b1fd0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa7f000c0a0 tx=0x7fa7f401a000 comp rx=0 tx=0).stop 2023-10-06T11:06:21.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.959+0000 7fa80b043700 1 -- 172.21.15.146:0/3767340101 shutdown_connections 2023-10-06T11:06:21.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.959+0000 7fa80b043700 1 --2- 172.21.15.146:0/3767340101 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa7e8066f30 0x7fa7e80693e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:21.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.959+0000 7fa80b043700 1 --2- 172.21.15.146:0/3767340101 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8040c5e90 0x7fa8040c6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:21.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.959+0000 7fa80b043700 1 --2- 172.21.15.146:0/3767340101 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa7f0004810 0x7fa8040c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:21.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.959+0000 7fa80b043700 1 --2- 172.21.15.146:0/3767340101 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8040b3850 0x7fa8040b1fd0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:21.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.959+0000 7fa80b043700 1 -- 172.21.15.146:0/3767340101 >> 172.21.15.146:0/3767340101 conn(0x7fa8040ce260 msgr2=0x7fa8040cacd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:21.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.959+0000 7fa80b043700 1 -- 172.21.15.146:0/3767340101 shutdown_connections 2023-10-06T11:06:21.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:21.959+0000 7fa80b043700 1 -- 172.21.15.146:0/3767340101 wait complete. 2023-10-06T11:06:21.974 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:05:36.687307+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:05:37.171199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T11:05:41.403954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T11:05:42.698754+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T11:06:21.974 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:06:22.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.091+0000 7f2623ae9700 1 Processor -- start 2023-10-06T11:06:22.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.091+0000 7f2623ae9700 1 -- start start 2023-10-06T11:06:22.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.092+0000 7f2623ae9700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f261c0ae730 0x7f261c0aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:22.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.092+0000 7f2623ae9700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f261c0cb950 0x7f261c0cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:22.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.092+0000 7f2623ae9700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f261c0ae2a0 con 0x7f261c15a160 2023-10-06T11:06:22.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.092+0000 7f2623ae9700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f261c15a530 con 0x7f261c0ae730 2023-10-06T11:06:22.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.092+0000 7f2623ae9700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261c0c5cb0 con 0x7f261c0cb950 2023-10-06T11:06:22.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.092+0000 7f2621885700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f261c15a160 0x7f261c0c55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40880/0 (socket says 172.21.15.146:40880) 2023-10-06T11:06:22.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.092+0000 7f2621885700 1 -- 172.21.15.146:0/4244536246 learned_addr learned my addr 172.21.15.146:0/4244536246 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:22.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.092+0000 7f2622086700 1 --2- 172.21.15.146:0/4244536246 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f261c0cb950 0x7f261c0cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:22.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.092+0000 7f2620883700 1 -- 172.21.15.146:0/4244536246 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 413246587 0 0) 0x7f261c0ae2a0 con 0x7f261c15a160 2023-10-06T11:06:22.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.092+0000 7f2621084700 1 --2- 172.21.15.146:0/4244536246 >> v2:172.21.15.151:3300/0 conn(0x7f261c0ae730 0x7f261c0aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:22.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.092+0000 7f2620883700 1 -- 172.21.15.146:0/4244536246 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2604003570 con 0x7f261c15a160 2023-10-06T11:06:22.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.092+0000 7f2620883700 1 -- 172.21.15.146:0/4244536246 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2499336317 0 0) 0x7f2604003570 con 0x7f261c15a160 2023-10-06T11:06:22.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.092+0000 7f2620883700 1 -- 172.21.15.146:0/4244536246 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f261c0cb950 msgr2=0x7f261c0cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:22.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.092+0000 7f2620883700 1 --2- 172.21.15.146:0/4244536246 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f261c0cb950 0x7f261c0cbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:22.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.092+0000 7f2620883700 1 -- 172.21.15.146:0/4244536246 >> v2:172.21.15.151:3300/0 conn(0x7f261c0ae730 msgr2=0x7f261c0aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:22.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.092+0000 7f2620883700 1 --2- 172.21.15.146:0/4244536246 >> v2:172.21.15.151:3300/0 conn(0x7f261c0ae730 0x7f261c0aebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:22.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.092+0000 7f2620883700 1 -- 172.21.15.146:0/4244536246 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261c0af0f0 con 0x7f261c15a160 2023-10-06T11:06:22.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.092+0000 7f2620883700 1 -- 172.21.15.146:0/4244536246 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f2614001970 con 0x7f261c15a160 2023-10-06T11:06:22.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.092+0000 7f2621084700 1 --2- 172.21.15.146:0/4244536246 >> v2:172.21.15.151:3300/0 conn(0x7f261c0ae730 0x7f261c0aebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:06:22.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.092+0000 7f2620883700 1 -- 172.21.15.146:0/4244536246 >> v1:172.21.15.146:6789/0 conn(0x7f261c15a160 legacy=0x7f261c0c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:22.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.092+0000 7f2620883700 1 --2- 172.21.15.146:0/4244536246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2604003a60 0x7f2604003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:22.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.092+0000 7f2620883700 1 --2- 172.21.15.146:0/4244536246 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2604004810 0x7f2604004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:22.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.092+0000 7f2620883700 1 --2- 172.21.15.146:0/4244536246 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f261c0cb950 0x7f26040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:22.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.092+0000 7f2620883700 1 -- 172.21.15.146:0/4244536246 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261c15a530 con 0x7f2604003a60 2023-10-06T11:06:22.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.092+0000 7f2620883700 1 -- 172.21.15.146:0/4244536246 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261c0c5cb0 con 0x7f2604004810 2023-10-06T11:06:22.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.092+0000 7f2620883700 1 -- 172.21.15.146:0/4244536246 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f260400bae0 con 0x7f261c0cb950 2023-10-06T11:06:22.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.093+0000 7f2621885700 1 --2- 172.21.15.146:0/4244536246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2604003a60 0x7f2604003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:22.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.093+0000 7f2621084700 1 --2- 172.21.15.146:0/4244536246 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2604004810 0x7f2604004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:22.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.093+0000 7f2622086700 1 --2- 172.21.15.146:0/4244536246 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f261c0cb950 0x7f26040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:22.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.093+0000 7f2621885700 1 -- 172.21.15.146:0/4244536246 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f261c0cb950 msgr2=0x7f26040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:22.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.093+0000 7f2621885700 1 --2- 172.21.15.146:0/4244536246 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f261c0cb950 0x7f26040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:22.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.093+0000 7f2621885700 1 -- 172.21.15.146:0/4244536246 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2604004810 msgr2=0x7f2604004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:22.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.093+0000 7f2621885700 1 --2- 172.21.15.146:0/4244536246 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2604004810 0x7f2604004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:22.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.093+0000 7f2621885700 1 -- 172.21.15.146:0/4244536246 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2604003570 con 0x7f2604003a60 2023-10-06T11:06:22.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.093+0000 7f2621885700 1 --2- 172.21.15.146:0/4244536246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2604003a60 0x7f2604003e70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f261400c6b0 tx=0x7f2614007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beb478e7fa0c7bde server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:22.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.093+0000 7f2620883700 1 -- 172.21.15.146:0/4244536246 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2614005b70 con 0x7f2604003a60 2023-10-06T11:06:22.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.093+0000 7f2620883700 1 -- 172.21.15.146:0/4244536246 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2614005d10 con 0x7f2604003a60 2023-10-06T11:06:22.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.093+0000 7f2620883700 1 -- 172.21.15.146:0/4244536246 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2614007360 con 0x7f2604003a60 2023-10-06T11:06:22.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.094+0000 7f2623ae9700 1 -- 172.21.15.146:0/4244536246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2604003a60 msgr2=0x7f2604003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:22.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.094+0000 7f2623ae9700 1 --2- 172.21.15.146:0/4244536246 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2604003a60 0x7f2604003e70 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f261400c6b0 tx=0x7f2614007ca0 comp rx=0 tx=0).stop 2023-10-06T11:06:22.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.094+0000 7f2622086700 1 -- 172.21.15.146:0/4244536246 reap_dead start 2023-10-06T11:06:22.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.094+0000 7f2623ae9700 1 -- 172.21.15.146:0/4244536246 shutdown_connections 2023-10-06T11:06:22.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.094+0000 7f2623ae9700 1 -- 172.21.15.146:0/4244536246 >> 172.21.15.146:0/4244536246 conn(0x7f261c06f380 msgr2=0x7f261c0d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:22.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.094+0000 7f2623ae9700 1 -- 172.21.15.146:0/4244536246 shutdown_connections 2023-10-06T11:06:22.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.094+0000 7f2623ae9700 1 -- 172.21.15.146:0/4244536246 wait complete. 2023-10-06T11:06:22.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.095+0000 7f2623ae9700 1 Processor -- start 2023-10-06T11:06:22.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.095+0000 7f2623ae9700 1 -- start start 2023-10-06T11:06:22.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.095+0000 7f2623ae9700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2604003a60 0x7f261c0afce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.096+0000 7f2623ae9700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f261c0b5410 0x7f261c157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.096+0000 7f2623ae9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f261c0b11b0 0x7f261c0b1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.096+0000 7f2623ae9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261c0b1b60 con 0x7f261c0b11b0 2023-10-06T11:06:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.096+0000 7f2623ae9700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261c0c8310 con 0x7f2604003a60 2023-10-06T11:06:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.096+0000 7f2623ae9700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261c0b0360 con 0x7f261c0b5410 2023-10-06T11:06:22.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.096+0000 7f2622086700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f261c0b11b0 0x7f261c0b1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:22.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.096+0000 7f2622086700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f261c0b11b0 0x7f261c0b1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34632/0 (socket says 172.21.15.146:34632) 2023-10-06T11:06:22.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.096+0000 7f2622086700 1 -- 172.21.15.146:0/2991975116 learned_addr learned my addr 172.21.15.146:0/2991975116 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:22.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.096+0000 7f2621084700 1 --2- 172.21.15.146:0/2991975116 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f261c0b5410 0x7f261c157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:22.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.096+0000 7f2621885700 1 --2- 172.21.15.146:0/2991975116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2604003a60 0x7f261c0afce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:22.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.096+0000 7f2622086700 1 -- 172.21.15.146:0/2991975116 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f261c0b5410 msgr2=0x7f261c157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:22.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.096+0000 7f2622086700 1 --2- 172.21.15.146:0/2991975116 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f261c0b5410 0x7f261c157600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:22.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.096+0000 7f2622086700 1 -- 172.21.15.146:0/2991975116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2604003a60 msgr2=0x7f261c0afce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:22.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.096+0000 7f2622086700 1 --2- 172.21.15.146:0/2991975116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2604003a60 0x7f261c0afce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:22.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.096+0000 7f2622086700 1 -- 172.21.15.146:0/2991975116 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261c0b0640 con 0x7f261c0b11b0 2023-10-06T11:06:22.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.096+0000 7f2622086700 1 --2- 172.21.15.146:0/2991975116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f261c0b11b0 0x7f261c0b1620 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f261c089c40 tx=0x7f260c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:22.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.096+0000 7f2619ffb700 1 -- 172.21.15.146:0/2991975116 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c013750 con 0x7f261c0b11b0 2023-10-06T11:06:22.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.096+0000 7f2619ffb700 1 -- 172.21.15.146:0/2991975116 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260c0138b0 con 0x7f261c0b11b0 2023-10-06T11:06:22.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.096+0000 7f2619ffb700 1 -- 172.21.15.146:0/2991975116 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c013c50 con 0x7f261c0b11b0 2023-10-06T11:06:22.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.096+0000 7f2623ae9700 1 -- 172.21.15.146:0/2991975116 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f261c0b0920 con 0x7f261c0b11b0 2023-10-06T11:06:22.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.097+0000 7f2623ae9700 1 -- 172.21.15.146:0/2991975116 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f261c157b40 con 0x7f261c0b11b0 2023-10-06T11:06:22.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.097+0000 7f2623ae9700 1 -- 172.21.15.146:0/2991975116 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f261c068b60 con 0x7f261c0b11b0 2023-10-06T11:06:22.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.098+0000 7f2619ffb700 1 -- 172.21.15.146:0/2991975116 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f260c014440 con 0x7f261c0b11b0 2023-10-06T11:06:22.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.098+0000 7f2619ffb700 1 --2- 172.21.15.146:0/2991975116 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2608066f30 0x7f26080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:22.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.098+0000 7f2619ffb700 1 -- 172.21.15.146:0/2991975116 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f260c084b20 con 0x7f261c0b11b0 2023-10-06T11:06:22.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.098+0000 7f2621885700 1 --2- 172.21.15.146:0/2991975116 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2608066f30 0x7f26080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:22.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.099+0000 7f2621885700 1 --2- 172.21.15.146:0/2991975116 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2608066f30 0x7f26080693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f261400c6b0 tx=0x7f2614015000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:22.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.102+0000 7f2619ffb700 1 -- 172.21.15.146:0/2991975116 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f260c051cb0 con 0x7f261c0b11b0 2023-10-06T11:06:22.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.284+0000 7f2623ae9700 1 -- 172.21.15.146:0/2991975116 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f261c04c380 con 0x7f261c0b11b0 2023-10-06T11:06:22.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.285+0000 7f2619ffb700 1 -- 172.21.15.146:0/2991975116 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f260c0220a0 con 0x7f261c0b11b0 2023-10-06T11:06:22.287 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-10-06T11:06:22.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.287+0000 7f2623ae9700 1 -- 172.21.15.146:0/2991975116 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2608066f30 msgr2=0x7f26080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:22.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.287+0000 7f2623ae9700 1 --2- 172.21.15.146:0/2991975116 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2608066f30 0x7f26080693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f261400c6b0 tx=0x7f2614015000 comp rx=0 tx=0).stop 2023-10-06T11:06:22.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.287+0000 7f2623ae9700 1 -- 172.21.15.146:0/2991975116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f261c0b11b0 msgr2=0x7f261c0b1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:22.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.287+0000 7f2623ae9700 1 --2- 172.21.15.146:0/2991975116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f261c0b11b0 0x7f261c0b1620 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f261c089c40 tx=0x7f260c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:06:22.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.287+0000 7f2623ae9700 1 -- 172.21.15.146:0/2991975116 shutdown_connections 2023-10-06T11:06:22.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.287+0000 7f2623ae9700 1 --2- 172.21.15.146:0/2991975116 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2608066f30 0x7f26080693e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:22.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.287+0000 7f2623ae9700 1 --2- 172.21.15.146:0/2991975116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f261c0b11b0 0x7f261c0b1620 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:22.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.287+0000 7f2623ae9700 1 --2- 172.21.15.146:0/2991975116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2604003a60 0x7f261c0afce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:22.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.287+0000 7f2623ae9700 1 --2- 172.21.15.146:0/2991975116 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f261c0b5410 0x7f261c157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:22.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.287+0000 7f2623ae9700 1 -- 172.21.15.146:0/2991975116 >> 172.21.15.146:0/2991975116 conn(0x7f261c06f380 msgr2=0x7f261c159500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:22.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.287+0000 7f2623ae9700 1 -- 172.21.15.146:0/2991975116 shutdown_connections 2023-10-06T11:06:22.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.287+0000 7f2623ae9700 1 -- 172.21.15.146:0/2991975116 wait complete. 2023-10-06T11:06:22.301 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:06:22.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.416+0000 7f73ffe98700 1 Processor -- start 2023-10-06T11:06:22.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.416+0000 7f73ffe98700 1 -- start start 2023-10-06T11:06:22.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.417+0000 7f73ffe98700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f73f815a160 0x7f73f80c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:22.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.417+0000 7f73ffe98700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73f80ae2a0 con 0x7f73f80ae730 2023-10-06T11:06:22.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.417+0000 7f73ffe98700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73f815a530 con 0x7f73f80cb950 2023-10-06T11:06:22.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.417+0000 7f73ffe98700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73f80ad690 con 0x7f73f815a160 2023-10-06T11:06:22.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.417+0000 7f73fd433700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f73f80ae730 0x7f73f80aebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40882/0 (socket says 172.21.15.146:40882) 2023-10-06T11:06:22.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.417+0000 7f73fd433700 1 -- 172.21.15.146:0/2648855490 learned_addr learned my addr 172.21.15.146:0/2648855490 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:22.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.418+0000 7f73fdc34700 1 --2- 172.21.15.146:0/2648855490 >> v2:172.21.15.151:3300/0 conn(0x7f73f815a160 0x7f73f80c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:22.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.418+0000 7f73fcc32700 1 -- 172.21.15.146:0/2648855490 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2281364937 0 0) 0x7f73f80ae2a0 con 0x7f73f80ae730 2023-10-06T11:06:22.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.418+0000 7f73fcc32700 1 -- 172.21.15.146:0/2648855490 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73e4003570 con 0x7f73f80ae730 2023-10-06T11:06:22.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.418+0000 7f73fcc32700 1 -- 172.21.15.146:0/2648855490 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2908888918 0 0) 0x7f73e4003570 con 0x7f73f80ae730 2023-10-06T11:06:22.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.418+0000 7f73fcc32700 1 -- 172.21.15.146:0/2648855490 >> v2:172.21.15.151:3300/0 conn(0x7f73f815a160 msgr2=0x7f73f80c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:22.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.418+0000 7f73fcc32700 1 --2- 172.21.15.146:0/2648855490 >> v2:172.21.15.151:3300/0 conn(0x7f73f815a160 0x7f73f80c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:22.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.418+0000 7f73fcc32700 1 -- 172.21.15.146:0/2648855490 >> v1:172.21.15.151:6789/0 conn(0x7f73f80cb950 legacy=0x7f73f80cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:22.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.418+0000 7f73fcc32700 1 -- 172.21.15.146:0/2648855490 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f80ad970 con 0x7f73f80ae730 2023-10-06T11:06:22.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.418+0000 7f73fcc32700 1 -- 172.21.15.146:0/2648855490 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f73e8001470 con 0x7f73f80ae730 2023-10-06T11:06:22.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.418+0000 7f73fcc32700 1 -- 172.21.15.146:0/2648855490 >> v1:172.21.15.146:6789/0 conn(0x7f73f80ae730 legacy=0x7f73f80aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:22.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.418+0000 7f73fcc32700 1 --2- 172.21.15.146:0/2648855490 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f73e4003a60 0x7f73e4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:22.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.418+0000 7f73fcc32700 1 --2- 172.21.15.146:0/2648855490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f73e4004810 0x7f73e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:22.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.418+0000 7f73fcc32700 1 --2- 172.21.15.146:0/2648855490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73e40051c0 0x7f73e400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:22.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.418+0000 7f73fcc32700 1 -- 172.21.15.146:0/2648855490 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f80ad690 con 0x7f73e40051c0 2023-10-06T11:06:22.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.418+0000 7f73fcc32700 1 -- 172.21.15.146:0/2648855490 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e400c050 con 0x7f73e4004810 2023-10-06T11:06:22.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.418+0000 7f73fcc32700 1 -- 172.21.15.146:0/2648855490 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e400c210 con 0x7f73e4003a60 2023-10-06T11:06:22.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.418+0000 7f73fdc34700 1 --2- 172.21.15.146:0/2648855490 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f73e4003a60 0x7f73e4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:22.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.418+0000 7f73fe435700 1 --2- 172.21.15.146:0/2648855490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73e40051c0 0x7f73e400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:22.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.418+0000 7f73fd433700 1 --2- 172.21.15.146:0/2648855490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f73e4004810 0x7f73e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:22.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.418+0000 7f73fe435700 1 -- 172.21.15.146:0/2648855490 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f73e4003a60 msgr2=0x7f73e4003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:22.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.418+0000 7f73fe435700 1 --2- 172.21.15.146:0/2648855490 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f73e4003a60 0x7f73e4003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:22.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.418+0000 7f73fe435700 1 -- 172.21.15.146:0/2648855490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f73e4004810 msgr2=0x7f73e4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:22.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.418+0000 7f73fe435700 1 --2- 172.21.15.146:0/2648855490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f73e4004810 0x7f73e4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:22.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.418+0000 7f73fe435700 1 -- 172.21.15.146:0/2648855490 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e4003570 con 0x7f73e40051c0 2023-10-06T11:06:22.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.418+0000 7f73fdc34700 1 --2- 172.21.15.146:0/2648855490 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f73e4003a60 0x7f73e4003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:06:22.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.419+0000 7f73fe435700 1 -- 172.21.15.146:0/2648855490 reap_dead start 2023-10-06T11:06:22.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.419+0000 7f73fe435700 1 --2- 172.21.15.146:0/2648855490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73e40051c0 0x7f73e400ba60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f73f0002170 tx=0x7f73f00017d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e6000bc88215edb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:22.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.419+0000 7f73fcc32700 1 -- 172.21.15.146:0/2648855490 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f0001ae0 con 0x7f73e40051c0 2023-10-06T11:06:22.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.419+0000 7f73fcc32700 1 -- 172.21.15.146:0/2648855490 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f000c940 con 0x7f73e40051c0 2023-10-06T11:06:22.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.419+0000 7f73fcc32700 1 -- 172.21.15.146:0/2648855490 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f000cd20 con 0x7f73e40051c0 2023-10-06T11:06:22.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.419+0000 7f73ffe98700 1 -- 172.21.15.146:0/2648855490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73e40051c0 msgr2=0x7f73e400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:22.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.419+0000 7f73ffe98700 1 --2- 172.21.15.146:0/2648855490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73e40051c0 0x7f73e400ba60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f73f0002170 tx=0x7f73f00017d0 comp rx=0 tx=0).stop 2023-10-06T11:06:22.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.419+0000 7f73ffe98700 1 -- 172.21.15.146:0/2648855490 shutdown_connections 2023-10-06T11:06:22.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.419+0000 7f73ffe98700 1 --2- 172.21.15.146:0/2648855490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73e40051c0 0x7f73e400ba60 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:22.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.419+0000 7f73ffe98700 1 -- 172.21.15.146:0/2648855490 >> 172.21.15.146:0/2648855490 conn(0x7f73f806f380 msgr2=0x7f73f80d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:22.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.419+0000 7f73ffe98700 1 -- 172.21.15.146:0/2648855490 shutdown_connections 2023-10-06T11:06:22.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.419+0000 7f73ffe98700 1 -- 172.21.15.146:0/2648855490 wait complete. 2023-10-06T11:06:22.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.420+0000 7f73ffe98700 1 Processor -- start 2023-10-06T11:06:22.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.420+0000 7f73ffe98700 1 -- start start 2023-10-06T11:06:22.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.421+0000 7f73ffe98700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f73e40051c0 0x7f73f81518d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:22.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.421+0000 7f73ffe98700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f73f8153470 0x7f73f80b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:22.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.421+0000 7f73ffe98700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73f81538e0 0x7f73f80b1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:22.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.421+0000 7f73ffe98700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f80b0a00 con 0x7f73f81538e0 2023-10-06T11:06:22.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.421+0000 7f73ffe98700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f80c8310 con 0x7f73e40051c0 2023-10-06T11:06:22.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.421+0000 7f73ffe98700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f8151e10 con 0x7f73f8153470 2023-10-06T11:06:22.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.421+0000 7f73fe435700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73f81538e0 0x7f73f80b1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:22.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.421+0000 7f73fe435700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73f81538e0 0x7f73f80b1ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34652/0 (socket says 172.21.15.146:34652) 2023-10-06T11:06:22.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.421+0000 7f73fe435700 1 -- 172.21.15.146:0/4036941686 learned_addr learned my addr 172.21.15.146:0/4036941686 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:22.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.421+0000 7f73fdc34700 1 --2- 172.21.15.146:0/4036941686 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f73e40051c0 0x7f73f81518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:22.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.421+0000 7f73fd433700 1 --2- 172.21.15.146:0/4036941686 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f73f8153470 0x7f73f80b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:22.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.422+0000 7f73fe435700 1 -- 172.21.15.146:0/4036941686 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f73f8153470 msgr2=0x7f73f80b1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:22.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.422+0000 7f73fe435700 1 --2- 172.21.15.146:0/4036941686 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f73f8153470 0x7f73f80b1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:22.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.422+0000 7f73fe435700 1 -- 172.21.15.146:0/4036941686 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f73e40051c0 msgr2=0x7f73f81518d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:22.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.422+0000 7f73fe435700 1 --2- 172.21.15.146:0/4036941686 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f73e40051c0 0x7f73f81518d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:22.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.422+0000 7f73fe435700 1 -- 172.21.15.146:0/4036941686 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f80c79e0 con 0x7f73f81538e0 2023-10-06T11:06:22.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.422+0000 7f73fd433700 1 --2- 172.21.15.146:0/4036941686 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f73f8153470 0x7f73f80b1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:06:22.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.422+0000 7f73fe435700 1 --2- 172.21.15.146:0/4036941686 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73f81538e0 0x7f73f80b1ff0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f73f000c6a0 tx=0x7f73f0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:22.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.422+0000 7f73edffb700 1 -- 172.21.15.146:0/4036941686 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f0012ae0 con 0x7f73f81538e0 2023-10-06T11:06:22.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.422+0000 7f73edffb700 1 -- 172.21.15.146:0/4036941686 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f0012c60 con 0x7f73f81538e0 2023-10-06T11:06:22.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.422+0000 7f73ffe98700 1 -- 172.21.15.146:0/4036941686 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73f80c7cc0 con 0x7f73f81538e0 2023-10-06T11:06:22.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.422+0000 7f73edffb700 1 -- 172.21.15.146:0/4036941686 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f001d420 con 0x7f73f81538e0 2023-10-06T11:06:22.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.422+0000 7f73ffe98700 1 -- 172.21.15.146:0/4036941686 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f80c87a0 con 0x7f73f81538e0 2023-10-06T11:06:22.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.423+0000 7f73ffe98700 1 -- 172.21.15.146:0/4036941686 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73f8068390 con 0x7f73f81538e0 2023-10-06T11:06:22.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.423+0000 7f73edffb700 1 -- 172.21.15.146:0/4036941686 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f73f001d7d0 con 0x7f73f81538e0 2023-10-06T11:06:22.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.424+0000 7f73edffb700 1 --2- 172.21.15.146:0/4036941686 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f73dc066f30 0x7f73dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:22.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.424+0000 7f73edffb700 1 -- 172.21.15.146:0/4036941686 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f73f0086420 con 0x7f73f81538e0 2023-10-06T11:06:22.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.424+0000 7f73fdc34700 1 --2- 172.21.15.146:0/4036941686 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f73dc066f30 0x7f73dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:22.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.424+0000 7f73fdc34700 1 --2- 172.21.15.146:0/4036941686 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f73dc066f30 0x7f73dc0693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f73f4006e50 tx=0x7f73f4009120 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:22.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.428+0000 7f73edffb700 1 -- 172.21.15.146:0/4036941686 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f73f0053550 con 0x7f73f81538e0 2023-10-06T11:06:22.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.611+0000 7f73ffe98700 1 -- 172.21.15.146:0/4036941686 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f73f80c84a0 con 0x7f73f81538e0 2023-10-06T11:06:22.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.612+0000 7f73edffb700 1 -- 172.21.15.146:0/4036941686 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f73f0056b70 con 0x7f73f81538e0 2023-10-06T11:06:22.614 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-10-06T11:06:22.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.614+0000 7f73ffe98700 1 -- 172.21.15.146:0/4036941686 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f73dc066f30 msgr2=0x7f73dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:22.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.614+0000 7f73ffe98700 1 --2- 172.21.15.146:0/4036941686 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f73dc066f30 0x7f73dc0693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f73f4006e50 tx=0x7f73f4009120 comp rx=0 tx=0).stop 2023-10-06T11:06:22.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.614+0000 7f73ffe98700 1 -- 172.21.15.146:0/4036941686 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73f81538e0 msgr2=0x7f73f80b1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:22.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.614+0000 7f73ffe98700 1 --2- 172.21.15.146:0/4036941686 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73f81538e0 0x7f73f80b1ff0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f73f000c6a0 tx=0x7f73f0016000 comp rx=0 tx=0).stop 2023-10-06T11:06:22.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.614+0000 7f73ffe98700 1 -- 172.21.15.146:0/4036941686 shutdown_connections 2023-10-06T11:06:22.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.614+0000 7f73ffe98700 1 --2- 172.21.15.146:0/4036941686 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f73dc066f30 0x7f73dc0693e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:22.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.614+0000 7f73ffe98700 1 --2- 172.21.15.146:0/4036941686 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73f81538e0 0x7f73f80b1ff0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:22.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.614+0000 7f73ffe98700 1 --2- 172.21.15.146:0/4036941686 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f73e40051c0 0x7f73f81518d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:22.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.614+0000 7f73ffe98700 1 --2- 172.21.15.146:0/4036941686 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f73f8153470 0x7f73f80b1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:22.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.614+0000 7f73ffe98700 1 -- 172.21.15.146:0/4036941686 >> 172.21.15.146:0/4036941686 conn(0x7f73f806f380 msgr2=0x7f73f8068550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:22.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.614+0000 7f73ffe98700 1 -- 172.21.15.146:0/4036941686 shutdown_connections 2023-10-06T11:06:22.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.614+0000 7f73ffe98700 1 -- 172.21.15.146:0/4036941686 wait complete. 2023-10-06T11:06:22.628 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T11:06:22.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.743+0000 7fc4843d7700 1 Processor -- start 2023-10-06T11:06:22.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.743+0000 7fc4843d7700 1 -- start start 2023-10-06T11:06:22.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.744+0000 7fc4843d7700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc47c15a160 0x7fc47c0c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:22.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.744+0000 7fc4843d7700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc47c0ae730 0x7fc47c0aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:22.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.744+0000 7fc4843d7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc47c0ce3d0 0x7fc47c0ce830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:22.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.744+0000 7fc4843d7700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc47c0ae2a0 con 0x7fc47c0ce3d0 2023-10-06T11:06:22.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.744+0000 7fc4843d7700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc47c15a530 con 0x7fc47c15a160 2023-10-06T11:06:22.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.744+0000 7fc4843d7700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c0ad690 con 0x7fc47c0ae730 2023-10-06T11:06:22.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.744+0000 7fc482974700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc47c0ce3d0 0x7fc47c0ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:22.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.744+0000 7fc482974700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc47c0ce3d0 0x7fc47c0ce830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34660/0 (socket says 172.21.15.146:34660) 2023-10-06T11:06:22.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.744+0000 7fc482974700 1 -- 172.21.15.146:0/3424085059 learned_addr learned my addr 172.21.15.146:0/3424085059 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:22.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.745+0000 7fc482173700 1 --2- 172.21.15.146:0/3424085059 >> v2:172.21.15.151:3300/0 conn(0x7fc47c15a160 0x7fc47c0c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:22.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.745+0000 7fc481972700 1 --2- 172.21.15.146:0/3424085059 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc47c0ae730 0x7fc47c0aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:22.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.745+0000 7fc482974700 1 -- 172.21.15.146:0/3424085059 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc47c0ae730 msgr2=0x7fc47c0aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:22.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.745+0000 7fc482974700 1 --2- 172.21.15.146:0/3424085059 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc47c0ae730 0x7fc47c0aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:22.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.745+0000 7fc482974700 1 -- 172.21.15.146:0/3424085059 >> v2:172.21.15.151:3300/0 conn(0x7fc47c15a160 msgr2=0x7fc47c0c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:22.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.745+0000 7fc482974700 1 --2- 172.21.15.146:0/3424085059 >> v2:172.21.15.151:3300/0 conn(0x7fc47c15a160 0x7fc47c0c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:22.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.745+0000 7fc482974700 1 -- 172.21.15.146:0/3424085059 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc47c0ad970 con 0x7fc47c0ce3d0 2023-10-06T11:06:22.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.745+0000 7fc481972700 1 --2- 172.21.15.146:0/3424085059 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc47c0ae730 0x7fc47c0aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:06:22.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.745+0000 7fc482974700 1 --2- 172.21.15.146:0/3424085059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc47c0ce3d0 0x7fc47c0ce830 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc47c065100 tx=0x7fc474009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=147d8a552a13d23d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:22.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.745+0000 7fc481171700 1 -- 172.21.15.146:0/3424085059 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc474009e70 con 0x7fc47c0ce3d0 2023-10-06T11:06:22.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.745+0000 7fc481171700 1 -- 172.21.15.146:0/3424085059 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47400b860 con 0x7fc47c0ce3d0 2023-10-06T11:06:22.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.745+0000 7fc481171700 1 -- 172.21.15.146:0/3424085059 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47400bc00 con 0x7fc47c0ce3d0 2023-10-06T11:06:22.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.746+0000 7fc4843d7700 1 -- 172.21.15.146:0/3424085059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc47c0ce3d0 msgr2=0x7fc47c0ce830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:22.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.746+0000 7fc4843d7700 1 --2- 172.21.15.146:0/3424085059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc47c0ce3d0 0x7fc47c0ce830 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc47c065100 tx=0x7fc474009250 comp rx=0 tx=0).stop 2023-10-06T11:06:22.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.746+0000 7fc4843d7700 1 -- 172.21.15.146:0/3424085059 shutdown_connections 2023-10-06T11:06:22.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.746+0000 7fc4843d7700 1 --2- 172.21.15.146:0/3424085059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc47c0ce3d0 0x7fc47c0ce830 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:22.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.746+0000 7fc4843d7700 1 --2- 172.21.15.146:0/3424085059 >> v2:172.21.15.151:3300/0 conn(0x7fc47c15a160 0x7fc47c0c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:22.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.746+0000 7fc4843d7700 1 --2- 172.21.15.146:0/3424085059 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc47c0ae730 0x7fc47c0aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:22.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.746+0000 7fc4843d7700 1 -- 172.21.15.146:0/3424085059 >> 172.21.15.146:0/3424085059 conn(0x7fc47c06f380 msgr2=0x7fc47c0d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:22.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.746+0000 7fc4843d7700 1 -- 172.21.15.146:0/3424085059 shutdown_connections 2023-10-06T11:06:22.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.746+0000 7fc4843d7700 1 -- 172.21.15.146:0/3424085059 wait complete. 2023-10-06T11:06:22.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.747+0000 7fc4843d7700 1 Processor -- start 2023-10-06T11:06:22.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.747+0000 7fc4843d7700 1 -- start start 2023-10-06T11:06:22.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.747+0000 7fc4843d7700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc47c0ae730 0x7fc47c0afa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:22.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.747+0000 7fc4843d7700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc47c0ce3d0 0x7fc47c14b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:22.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.747+0000 7fc4843d7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc47c15a160 0x7fc47c0b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:22.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.748+0000 7fc4843d7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c0af5e0 con 0x7fc47c15a160 2023-10-06T11:06:22.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.748+0000 7fc4843d7700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c14ba10 con 0x7fc47c0ae730 2023-10-06T11:06:22.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.748+0000 7fc4843d7700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc47c0b25a0 con 0x7fc47c0ce3d0 2023-10-06T11:06:22.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.748+0000 7fc482974700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc47c15a160 0x7fc47c0b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:22.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.748+0000 7fc482974700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc47c15a160 0x7fc47c0b01a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34662/0 (socket says 172.21.15.146:34662) 2023-10-06T11:06:22.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.748+0000 7fc482974700 1 -- 172.21.15.146:0/443397545 learned_addr learned my addr 172.21.15.146:0/443397545 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:22.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.748+0000 7fc481972700 1 --2- 172.21.15.146:0/443397545 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc47c0ce3d0 0x7fc47c14b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:22.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.748+0000 7fc482173700 1 --2- 172.21.15.146:0/443397545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc47c0ae730 0x7fc47c0afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:22.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.748+0000 7fc482974700 1 -- 172.21.15.146:0/443397545 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc47c0ce3d0 msgr2=0x7fc47c14b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:22.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.748+0000 7fc482974700 1 --2- 172.21.15.146:0/443397545 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc47c0ce3d0 0x7fc47c14b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:22.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.748+0000 7fc482974700 1 -- 172.21.15.146:0/443397545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc47c0ae730 msgr2=0x7fc47c0afa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:22.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.748+0000 7fc482974700 1 --2- 172.21.15.146:0/443397545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc47c0ae730 0x7fc47c0afa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:22.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.748+0000 7fc482974700 1 -- 172.21.15.146:0/443397545 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4740094f0 con 0x7fc47c15a160 2023-10-06T11:06:22.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.748+0000 7fc482974700 1 --2- 172.21.15.146:0/443397545 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc47c15a160 0x7fc47c0b01a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc4740090b0 tx=0x7fc474017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:22.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.748+0000 7fc4727fc700 1 -- 172.21.15.146:0/443397545 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47400bbe0 con 0x7fc47c15a160 2023-10-06T11:06:22.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.748+0000 7fc4727fc700 1 -- 172.21.15.146:0/443397545 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47401f070 con 0x7fc47c15a160 2023-10-06T11:06:22.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.748+0000 7fc4727fc700 1 -- 172.21.15.146:0/443397545 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4740266b0 con 0x7fc47c15a160 2023-10-06T11:06:22.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.748+0000 7fc4843d7700 1 -- 172.21.15.146:0/443397545 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc47c0aecb0 con 0x7fc47c15a160 2023-10-06T11:06:22.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.748+0000 7fc4843d7700 1 -- 172.21.15.146:0/443397545 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc47c0af270 con 0x7fc47c15a160 2023-10-06T11:06:22.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.749+0000 7fc4843d7700 1 -- 172.21.15.146:0/443397545 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc47c068390 con 0x7fc47c15a160 2023-10-06T11:06:22.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.750+0000 7fc4727fc700 1 -- 172.21.15.146:0/443397545 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc474026a20 con 0x7fc47c15a160 2023-10-06T11:06:22.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.750+0000 7fc4727fc700 1 --2- 172.21.15.146:0/443397545 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc460066f30 0x7fc4600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:22.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.750+0000 7fc4727fc700 1 -- 172.21.15.146:0/443397545 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc474021070 con 0x7fc47c15a160 2023-10-06T11:06:22.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.750+0000 7fc482173700 1 --2- 172.21.15.146:0/443397545 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc460066f30 0x7fc4600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:22.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.750+0000 7fc482173700 1 --2- 172.21.15.146:0/443397545 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc460066f30 0x7fc4600693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc47800f5b0 tx=0x7fc47800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:22.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.754+0000 7fc4727fc700 1 -- 172.21.15.146:0/443397545 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc474053560 con 0x7fc47c15a160 2023-10-06T11:06:22.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.937+0000 7fc4843d7700 1 -- 172.21.15.146:0/443397545 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc47c04c380 con 0x7fc47c15a160 2023-10-06T11:06:22.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.937+0000 7fc4727fc700 1 -- 172.21.15.146:0/443397545 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc474056b80 con 0x7fc47c15a160 2023-10-06T11:06:22.939 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2023-10-06T11:06:22.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.939+0000 7fc4843d7700 1 -- 172.21.15.146:0/443397545 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc460066f30 msgr2=0x7fc4600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:22.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.939+0000 7fc4843d7700 1 --2- 172.21.15.146:0/443397545 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc460066f30 0x7fc4600693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc47800f5b0 tx=0x7fc47800b040 comp rx=0 tx=0).stop 2023-10-06T11:06:22.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.939+0000 7fc4843d7700 1 -- 172.21.15.146:0/443397545 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc47c15a160 msgr2=0x7fc47c0b01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:22.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.939+0000 7fc4843d7700 1 --2- 172.21.15.146:0/443397545 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc47c15a160 0x7fc47c0b01a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fc4740090b0 tx=0x7fc474017000 comp rx=0 tx=0).stop 2023-10-06T11:06:22.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.939+0000 7fc4843d7700 1 -- 172.21.15.146:0/443397545 shutdown_connections 2023-10-06T11:06:22.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.939+0000 7fc4843d7700 1 --2- 172.21.15.146:0/443397545 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc460066f30 0x7fc4600693e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:22.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.939+0000 7fc4843d7700 1 --2- 172.21.15.146:0/443397545 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc47c15a160 0x7fc47c0b01a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:22.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.939+0000 7fc4843d7700 1 --2- 172.21.15.146:0/443397545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc47c0ae730 0x7fc47c0afa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:22.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.939+0000 7fc4843d7700 1 --2- 172.21.15.146:0/443397545 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc47c0ce3d0 0x7fc47c14b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:22.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.939+0000 7fc4843d7700 1 -- 172.21.15.146:0/443397545 >> 172.21.15.146:0/443397545 conn(0x7fc47c06f380 msgr2=0x7fc47c0cbe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:22.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.939+0000 7fc4843d7700 1 -- 172.21.15.146:0/443397545 shutdown_connections 2023-10-06T11:06:22.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:22.939+0000 7fc4843d7700 1 -- 172.21.15.146:0/443397545 wait complete. 2023-10-06T11:06:22.953 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T11:06:23.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.068+0000 7f6f27c81700 1 Processor -- start 2023-10-06T11:06:23.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.069+0000 7f6f27c81700 1 -- start start 2023-10-06T11:06:23.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.069+0000 7f6f27c81700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6f2015a160 0x7f6f200c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:23.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.069+0000 7f6f27c81700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6f200ae730 0x7f6f200aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:23.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.069+0000 7f6f27c81700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f200ae2a0 con 0x7f6f200ce3d0 2023-10-06T11:06:23.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.069+0000 7f6f27c81700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f2015a530 con 0x7f6f2015a160 2023-10-06T11:06:23.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.069+0000 7f6f27c81700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f200af0f0 con 0x7f6f200ae730 2023-10-06T11:06:23.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.070+0000 7f6f25a1d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6f2015a160 0x7f6f200c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:23.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.070+0000 7f6f2621e700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6f200ce3d0 0x7f6f200ce7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40894/0 (socket says 172.21.15.146:40894) 2023-10-06T11:06:23.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.070+0000 7f6f2621e700 1 -- 172.21.15.146:0/664001364 learned_addr learned my addr 172.21.15.146:0/664001364 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:23.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.070+0000 7f6f2521c700 1 --2- 172.21.15.146:0/664001364 >> v2:172.21.15.151:3300/0 conn(0x7f6f200ae730 0x7f6f200aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:23.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.070+0000 7f6f25a1d700 1 -- 172.21.15.146:0/664001364 >> v2:172.21.15.151:3300/0 conn(0x7f6f200ae730 msgr2=0x7f6f200aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:23.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.070+0000 7f6f25a1d700 1 --2- 172.21.15.146:0/664001364 >> v2:172.21.15.151:3300/0 conn(0x7f6f200ae730 0x7f6f200aebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:23.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.070+0000 7f6f25a1d700 1 -- 172.21.15.146:0/664001364 >> v1:172.21.15.146:6789/0 conn(0x7f6f200ce3d0 legacy=0x7f6f200ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:23.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.070+0000 7f6f25a1d700 1 -- 172.21.15.146:0/664001364 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f200ad690 con 0x7f6f2015a160 2023-10-06T11:06:23.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.070+0000 7f6f24a1b700 1 -- 172.21.15.146:0/664001364 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 515040818 0 0) 0x7f6f200ae2a0 con 0x7f6f200ce3d0 2023-10-06T11:06:23.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.070+0000 7f6f25a1d700 1 --2- 172.21.15.146:0/664001364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f2015a160 0x7f6f200c55a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6f200d16e0 tx=0x7f6f1c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea7ebc04a2dc6978 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:23.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.070+0000 7f6f24a1b700 1 -- 172.21.15.146:0/664001364 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c00e070 con 0x7f6f2015a160 2023-10-06T11:06:23.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.070+0000 7f6f24a1b700 1 -- 172.21.15.146:0/664001364 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f1c00bc30 con 0x7f6f2015a160 2023-10-06T11:06:23.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.070+0000 7f6f24a1b700 1 -- 172.21.15.146:0/664001364 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c012430 con 0x7f6f2015a160 2023-10-06T11:06:23.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.071+0000 7f6f27c81700 1 -- 172.21.15.146:0/664001364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f2015a160 msgr2=0x7f6f200c55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:23.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.071+0000 7f6f27c81700 1 --2- 172.21.15.146:0/664001364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f2015a160 0x7f6f200c55a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6f200d16e0 tx=0x7f6f1c009780 comp rx=0 tx=0).stop 2023-10-06T11:06:23.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.071+0000 7f6f27c81700 1 -- 172.21.15.146:0/664001364 shutdown_connections 2023-10-06T11:06:23.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.071+0000 7f6f27c81700 1 --2- 172.21.15.146:0/664001364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f2015a160 0x7f6f200c55a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:23.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.071+0000 7f6f27c81700 1 --2- 172.21.15.146:0/664001364 >> v2:172.21.15.151:3300/0 conn(0x7f6f200ae730 0x7f6f200aebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:23.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.071+0000 7f6f27c81700 1 -- 172.21.15.146:0/664001364 >> 172.21.15.146:0/664001364 conn(0x7f6f2006f380 msgr2=0x7f6f200d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:23.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.071+0000 7f6f27c81700 1 -- 172.21.15.146:0/664001364 shutdown_connections 2023-10-06T11:06:23.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.071+0000 7f6f27c81700 1 -- 172.21.15.146:0/664001364 wait complete. 2023-10-06T11:06:23.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.072+0000 7f6f27c81700 1 Processor -- start 2023-10-06T11:06:23.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.072+0000 7f6f27c81700 1 -- start start 2023-10-06T11:06:23.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.073+0000 7f6f27c81700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f200ae730 0x7f6f2015d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:23.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.073+0000 7f6f27c81700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f200ce3d0 0x7f6f20158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:23.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.073+0000 7f6f27c81700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f2015a160 0x7f6f2015eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:23.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.073+0000 7f6f27c81700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f20158c40 con 0x7f6f200ce3d0 2023-10-06T11:06:23.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.073+0000 7f6f27c81700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f200b40a0 con 0x7f6f2015a160 2023-10-06T11:06:23.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.073+0000 7f6f27c81700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f200c9940 con 0x7f6f200ae730 2023-10-06T11:06:23.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.073+0000 7f6f2521c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f200ce3d0 0x7f6f20158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:23.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.073+0000 7f6f2521c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f200ce3d0 0x7f6f20158140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34674/0 (socket says 172.21.15.146:34674) 2023-10-06T11:06:23.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.073+0000 7f6f2521c700 1 -- 172.21.15.146:0/2157548966 learned_addr learned my addr 172.21.15.146:0/2157548966 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:23.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.073+0000 7f6f2621e700 1 --2- 172.21.15.146:0/2157548966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f2015a160 0x7f6f2015eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:23.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.073+0000 7f6f25a1d700 1 --2- 172.21.15.146:0/2157548966 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f200ae730 0x7f6f2015d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:23.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.073+0000 7f6f2521c700 1 -- 172.21.15.146:0/2157548966 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f200ae730 msgr2=0x7f6f2015d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:23.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.073+0000 7f6f2521c700 1 --2- 172.21.15.146:0/2157548966 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f200ae730 0x7f6f2015d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:23.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.073+0000 7f6f2521c700 1 -- 172.21.15.146:0/2157548966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f2015a160 msgr2=0x7f6f2015eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:23.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.073+0000 7f6f2521c700 1 --2- 172.21.15.146:0/2157548966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f2015a160 0x7f6f2015eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:23.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.073+0000 7f6f2521c700 1 -- 172.21.15.146:0/2157548966 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f1c009a20 con 0x7f6f200ce3d0 2023-10-06T11:06:23.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.073+0000 7f6f2521c700 1 --2- 172.21.15.146:0/2157548966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f200ce3d0 0x7f6f20158140 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6f1000d860 tx=0x7f6f10008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:23.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.073+0000 7f6f15ffb700 1 -- 172.21.15.146:0/2157548966 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f100125f0 con 0x7f6f200ce3d0 2023-10-06T11:06:23.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.073+0000 7f6f15ffb700 1 -- 172.21.15.146:0/2157548966 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f10012750 con 0x7f6f200ce3d0 2023-10-06T11:06:23.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.073+0000 7f6f27c81700 1 -- 172.21.15.146:0/2157548966 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f200c9c20 con 0x7f6f200ce3d0 2023-10-06T11:06:23.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.073+0000 7f6f15ffb700 1 -- 172.21.15.146:0/2157548966 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f10012b10 con 0x7f6f200ce3d0 2023-10-06T11:06:23.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.074+0000 7f6f27c81700 1 -- 172.21.15.146:0/2157548966 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f200ca1e0 con 0x7f6f200ce3d0 2023-10-06T11:06:23.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.075+0000 7f6f27c81700 1 -- 172.21.15.146:0/2157548966 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f20068390 con 0x7f6f200ce3d0 2023-10-06T11:06:23.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.075+0000 7f6f15ffb700 1 -- 172.21.15.146:0/2157548966 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6f1001e460 con 0x7f6f200ce3d0 2023-10-06T11:06:23.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.075+0000 7f6f15ffb700 1 --2- 172.21.15.146:0/2157548966 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6f04066f30 0x7f6f040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:23.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.075+0000 7f6f15ffb700 1 -- 172.21.15.146:0/2157548966 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6f10084bc0 con 0x7f6f200ce3d0 2023-10-06T11:06:23.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.075+0000 7f6f25a1d700 1 --2- 172.21.15.146:0/2157548966 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6f04066f30 0x7f6f040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:23.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.076+0000 7f6f25a1d700 1 --2- 172.21.15.146:0/2157548966 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6f04066f30 0x7f6f040693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6f200d16e0 tx=0x7f6f1c019000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:23.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.080+0000 7f6f15ffb700 1 -- 172.21.15.146:0/2157548966 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f10051cd0 con 0x7f6f200ce3d0 2023-10-06T11:06:23.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.262+0000 7f6f27c81700 1 -- 172.21.15.146:0/2157548966 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6f200b4210 con 0x7f6f200ce3d0 2023-10-06T11:06:23.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.262+0000 7f6f15ffb700 1 -- 172.21.15.146:0/2157548966 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6f100552f0 con 0x7f6f200ce3d0 2023-10-06T11:06:23.264 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2023-10-06T11:06:23.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.264+0000 7f6f27c81700 1 -- 172.21.15.146:0/2157548966 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6f04066f30 msgr2=0x7f6f040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:23.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.264+0000 7f6f27c81700 1 --2- 172.21.15.146:0/2157548966 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6f04066f30 0x7f6f040693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6f200d16e0 tx=0x7f6f1c019000 comp rx=0 tx=0).stop 2023-10-06T11:06:23.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.264+0000 7f6f27c81700 1 -- 172.21.15.146:0/2157548966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f200ce3d0 msgr2=0x7f6f20158140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:23.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.264+0000 7f6f27c81700 1 --2- 172.21.15.146:0/2157548966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f200ce3d0 0x7f6f20158140 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6f1000d860 tx=0x7f6f10008040 comp rx=0 tx=0).stop 2023-10-06T11:06:23.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.264+0000 7f6f27c81700 1 -- 172.21.15.146:0/2157548966 shutdown_connections 2023-10-06T11:06:23.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.264+0000 7f6f27c81700 1 --2- 172.21.15.146:0/2157548966 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6f04066f30 0x7f6f040693e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:23.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.264+0000 7f6f27c81700 1 --2- 172.21.15.146:0/2157548966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f2015a160 0x7f6f2015eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:23.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.264+0000 7f6f27c81700 1 --2- 172.21.15.146:0/2157548966 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f200ae730 0x7f6f2015d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:23.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.264+0000 7f6f27c81700 1 --2- 172.21.15.146:0/2157548966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f200ce3d0 0x7f6f20158140 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:23.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.264+0000 7f6f27c81700 1 -- 172.21.15.146:0/2157548966 >> 172.21.15.146:0/2157548966 conn(0x7f6f2006f380 msgr2=0x7f6f200c55a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:23.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.264+0000 7f6f27c81700 1 -- 172.21.15.146:0/2157548966 shutdown_connections 2023-10-06T11:06:23.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.264+0000 7f6f27c81700 1 -- 172.21.15.146:0/2157548966 wait complete. 2023-10-06T11:06:23.278 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:06:23.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.392+0000 7fec3d405700 1 Processor -- start 2023-10-06T11:06:23.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.392+0000 7fec3d405700 1 -- start start 2023-10-06T11:06:23.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.393+0000 7fec3d405700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fec3815a420 0x7fec3815cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:23.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.393+0000 7fec3d405700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fec3815a7f0 0x7fec380b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:23.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.393+0000 7fec3d405700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec3815c630 con 0x7fec380b2360 2023-10-06T11:06:23.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.393+0000 7fec3d405700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec380ce040 con 0x7fec3815a7f0 2023-10-06T11:06:23.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.393+0000 7fec3d405700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec380b2780 con 0x7fec3815a420 2023-10-06T11:06:23.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.393+0000 7fec377fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fec3815a7f0 0x7fec380b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:23.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.393+0000 7fec377fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fec3815a7f0 0x7fec380b1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34680/0 (socket says 172.21.15.146:34680) 2023-10-06T11:06:23.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.393+0000 7fec377fe700 1 -- 172.21.15.146:0/3785720627 learned_addr learned my addr 172.21.15.146:0/3785720627 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:23.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.393+0000 7fec37fff700 1 --2- 172.21.15.146:0/3785720627 >> v2:172.21.15.151:3300/0 conn(0x7fec3815a420 0x7fec3815cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:23.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.393+0000 7fec377fe700 1 -- 172.21.15.146:0/3785720627 >> v2:172.21.15.151:3300/0 conn(0x7fec3815a420 msgr2=0x7fec3815cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:23.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.393+0000 7fec377fe700 1 --2- 172.21.15.146:0/3785720627 >> v2:172.21.15.151:3300/0 conn(0x7fec3815a420 0x7fec3815cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:23.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.393+0000 7fec377fe700 1 -- 172.21.15.146:0/3785720627 >> v1:172.21.15.146:6789/0 conn(0x7fec380b2360 legacy=0x7fec3815acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:23.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.393+0000 7fec377fe700 1 -- 172.21.15.146:0/3785720627 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec3815ba20 con 0x7fec3815a7f0 2023-10-06T11:06:23.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.393+0000 7fec36ffd700 1 -- 172.21.15.146:0/3785720627 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3937605823 0 0) 0x7fec3815c630 con 0x7fec380b2360 2023-10-06T11:06:23.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.394+0000 7fec377fe700 1 --2- 172.21.15.146:0/3785720627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec3815a7f0 0x7fec380b1e20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fec380d1460 tx=0x7fec2c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=119bd8f4d7126989 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:23.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.394+0000 7fec36ffd700 1 -- 172.21.15.146:0/3785720627 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2c009e70 con 0x7fec3815a7f0 2023-10-06T11:06:23.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.394+0000 7fec36ffd700 1 -- 172.21.15.146:0/3785720627 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec2c00b860 con 0x7fec3815a7f0 2023-10-06T11:06:23.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.394+0000 7fec36ffd700 1 -- 172.21.15.146:0/3785720627 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2c00bc00 con 0x7fec3815a7f0 2023-10-06T11:06:23.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.394+0000 7fec3d405700 1 -- 172.21.15.146:0/3785720627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec3815a7f0 msgr2=0x7fec380b1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:23.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.394+0000 7fec3d405700 1 --2- 172.21.15.146:0/3785720627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec3815a7f0 0x7fec380b1e20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fec380d1460 tx=0x7fec2c009250 comp rx=0 tx=0).stop 2023-10-06T11:06:23.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.394+0000 7fec3d405700 1 -- 172.21.15.146:0/3785720627 shutdown_connections 2023-10-06T11:06:23.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.394+0000 7fec3d405700 1 --2- 172.21.15.146:0/3785720627 >> v2:172.21.15.151:3300/0 conn(0x7fec3815a420 0x7fec3815cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:23.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.394+0000 7fec3d405700 1 --2- 172.21.15.146:0/3785720627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec3815a7f0 0x7fec380b1e20 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:23.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.394+0000 7fec3d405700 1 -- 172.21.15.146:0/3785720627 >> 172.21.15.146:0/3785720627 conn(0x7fec3806eba0 msgr2=0x7fec3806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:23.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.394+0000 7fec3d405700 1 -- 172.21.15.146:0/3785720627 shutdown_connections 2023-10-06T11:06:23.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.394+0000 7fec3d405700 1 -- 172.21.15.146:0/3785720627 wait complete. 2023-10-06T11:06:23.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.395+0000 7fec3d405700 1 Processor -- start 2023-10-06T11:06:23.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.396+0000 7fec3d405700 1 -- start start 2023-10-06T11:06:23.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.396+0000 7fec3d405700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec380b2360 0x7fec38152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:23.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.396+0000 7fec3d405700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec3815a420 0x7fec3814f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:23.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.396+0000 7fec3d405700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec3815a7f0 0x7fec3814fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:23.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.396+0000 7fec3d405700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec3816aac0 con 0x7fec3815a7f0 2023-10-06T11:06:23.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.396+0000 7fec3d405700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec3816d0f0 con 0x7fec3815a420 2023-10-06T11:06:23.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.396+0000 7fec3d405700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec3816dc70 con 0x7fec380b2360 2023-10-06T11:06:23.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.396+0000 7fec3cc04700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec3815a7f0 0x7fec3814fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:23.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.396+0000 7fec3cc04700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec3815a7f0 0x7fec3814fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34696/0 (socket says 172.21.15.146:34696) 2023-10-06T11:06:23.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.396+0000 7fec3cc04700 1 -- 172.21.15.146:0/1751232015 learned_addr learned my addr 172.21.15.146:0/1751232015 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:23.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.397+0000 7fec377fe700 1 --2- 172.21.15.146:0/1751232015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec3815a420 0x7fec3814f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:23.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.397+0000 7fec37fff700 1 --2- 172.21.15.146:0/1751232015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec380b2360 0x7fec38152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:23.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.397+0000 7fec3cc04700 1 -- 172.21.15.146:0/1751232015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec380b2360 msgr2=0x7fec38152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:23.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.397+0000 7fec3cc04700 1 --2- 172.21.15.146:0/1751232015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec380b2360 0x7fec38152d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:23.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.397+0000 7fec3cc04700 1 -- 172.21.15.146:0/1751232015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec3815a420 msgr2=0x7fec3814f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:23.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.397+0000 7fec3cc04700 1 --2- 172.21.15.146:0/1751232015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec3815a420 0x7fec3814f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:23.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.397+0000 7fec3cc04700 1 -- 172.21.15.146:0/1751232015 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec2c0094f0 con 0x7fec3815a7f0 2023-10-06T11:06:23.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.397+0000 7fec37fff700 1 --2- 172.21.15.146:0/1751232015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec380b2360 0x7fec38152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:06:23.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.397+0000 7fec3cc04700 1 --2- 172.21.15.146:0/1751232015 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec3815a7f0 0x7fec3814fea0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fec3000c8c0 tx=0x7fec30001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:23.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.397+0000 7fec1ffff700 1 -- 172.21.15.146:0/1751232015 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec30012630 con 0x7fec3815a7f0 2023-10-06T11:06:23.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.397+0000 7fec1ffff700 1 -- 172.21.15.146:0/1751232015 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec300127d0 con 0x7fec3815a7f0 2023-10-06T11:06:23.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.397+0000 7fec3d405700 1 -- 172.21.15.146:0/1751232015 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec3816d340 con 0x7fec3815a7f0 2023-10-06T11:06:23.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.397+0000 7fec1ffff700 1 -- 172.21.15.146:0/1751232015 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec30012b90 con 0x7fec3815a7f0 2023-10-06T11:06:23.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.397+0000 7fec3d405700 1 -- 172.21.15.146:0/1751232015 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec3816d900 con 0x7fec3815a7f0 2023-10-06T11:06:23.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.398+0000 7fec3d405700 1 -- 172.21.15.146:0/1751232015 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec380afae0 con 0x7fec3815a7f0 2023-10-06T11:06:23.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.398+0000 7fec1ffff700 1 -- 172.21.15.146:0/1751232015 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fec3001a3a0 con 0x7fec3815a7f0 2023-10-06T11:06:23.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.399+0000 7fec1ffff700 1 --2- 172.21.15.146:0/1751232015 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fec24066f30 0x7fec240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:23.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.399+0000 7fec1ffff700 1 -- 172.21.15.146:0/1751232015 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fec30084910 con 0x7fec3815a7f0 2023-10-06T11:06:23.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.399+0000 7fec37fff700 1 --2- 172.21.15.146:0/1751232015 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fec24066f30 0x7fec240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:23.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.399+0000 7fec37fff700 1 --2- 172.21.15.146:0/1751232015 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fec24066f30 0x7fec240693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fec28009d80 tx=0x7fec28008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:23.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.403+0000 7fec1ffff700 1 -- 172.21.15.146:0/1751232015 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fec30051a20 con 0x7fec3815a7f0 2023-10-06T11:06:23.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.630+0000 7fec3d405700 1 -- 172.21.15.146:0/1751232015 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec3816ddb0 con 0x7fec3815a7f0 2023-10-06T11:06:23.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.631+0000 7fec1ffff700 1 -- 172.21.15.146:0/1751232015 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4597 (secure 0 0 0) 0x7fec30055040 con 0x7fec3815a7f0 2023-10-06T11:06:23.633 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:06:23.633 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2812328960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2812328960},{"type":"v1","addr":"172.21.15.151:6835","nonce":2812328960}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/178026783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":178026783},{"type":"v1","addr":"172.21.15.146:6836","nonce":178026783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/716185126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":716185126},{"type":"v1","addr":"172.21.15.146:6837","nonce":716185126}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:05:43.740490+0000","modified":"2023-10-06T11:05:47.375805+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6833/1317728156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1317728156},{"type":"v1","addr":"172.21.15.151:6833","nonce":1317728156}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T11:06:23.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.633+0000 7fec3d405700 1 -- 172.21.15.146:0/1751232015 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fec24066f30 msgr2=0x7fec240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:23.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.633+0000 7fec3d405700 1 --2- 172.21.15.146:0/1751232015 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fec24066f30 0x7fec240693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fec28009d80 tx=0x7fec28008040 comp rx=0 tx=0).stop 2023-10-06T11:06:23.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.633+0000 7fec3d405700 1 -- 172.21.15.146:0/1751232015 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec3815a7f0 msgr2=0x7fec3814fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:23.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.633+0000 7fec3d405700 1 --2- 172.21.15.146:0/1751232015 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec3815a7f0 0x7fec3814fea0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fec3000c8c0 tx=0x7fec30001670 comp rx=0 tx=0).stop 2023-10-06T11:06:23.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.633+0000 7fec3d405700 1 -- 172.21.15.146:0/1751232015 shutdown_connections 2023-10-06T11:06:23.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.633+0000 7fec3d405700 1 --2- 172.21.15.146:0/1751232015 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fec24066f30 0x7fec240693e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:23.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.633+0000 7fec3d405700 1 --2- 172.21.15.146:0/1751232015 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec3815a7f0 0x7fec3814fea0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:23.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.633+0000 7fec3d405700 1 --2- 172.21.15.146:0/1751232015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec380b2360 0x7fec38152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:23.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.633+0000 7fec3d405700 1 --2- 172.21.15.146:0/1751232015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec3815a420 0x7fec3814f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:23.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.633+0000 7fec3d405700 1 -- 172.21.15.146:0/1751232015 >> 172.21.15.146:0/1751232015 conn(0x7fec3806eba0 msgr2=0x7fec380b5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:23.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.633+0000 7fec3d405700 1 -- 172.21.15.146:0/1751232015 shutdown_connections 2023-10-06T11:06:23.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.633+0000 7fec3d405700 1 -- 172.21.15.146:0/1751232015 wait complete. 2023-10-06T11:06:23.636 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 7 2023-10-06T11:06:23.647 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:06:23.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.760+0000 7f5d69ff5700 1 Processor -- start 2023-10-06T11:06:23.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.760+0000 7f5d69ff5700 1 -- start start 2023-10-06T11:06:23.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.761+0000 7f5d69ff5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5d64153ab0 0x7f5d6415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:23.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.761+0000 7f5d69ff5700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d6415ac30 con 0x7f5d64153e80 2023-10-06T11:06:23.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.761+0000 7f5d69ff5700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d640b4510 con 0x7f5d64068ba0 2023-10-06T11:06:23.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.761+0000 7f5d69ff5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d640b6530 con 0x7f5d64153ab0 2023-10-06T11:06:23.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.761+0000 7f5d637fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5d64153ab0 0x7f5d6415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:23.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.761+0000 7f5d62ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f5d64153e80 0x7f5d64068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40916/0 (socket says 172.21.15.146:40916) 2023-10-06T11:06:23.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.761+0000 7f5d62ffd700 1 -- 172.21.15.146:0/1227085563 learned_addr learned my addr 172.21.15.146:0/1227085563 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:23.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.761+0000 7f5d637fe700 1 -- 172.21.15.146:0/1227085563 >> v1:172.21.15.151:6789/0 conn(0x7f5d64068ba0 legacy=0x7f5d640b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:23.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.761+0000 7f5d637fe700 1 -- 172.21.15.146:0/1227085563 >> v1:172.21.15.146:6789/0 conn(0x7f5d64153e80 legacy=0x7f5d64068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:23.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.761+0000 7f5d627fc700 1 -- 172.21.15.146:0/1227085563 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 354674802 0 0) 0x7f5d58001110 con 0x7f5d64153e80 2023-10-06T11:06:23.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.761+0000 7f5d637fe700 1 -- 172.21.15.146:0/1227085563 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d640b5c50 con 0x7f5d64153ab0 2023-10-06T11:06:23.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.762+0000 7f5d637fe700 1 --2- 172.21.15.146:0/1227085563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d64153ab0 0x7f5d6415a6f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5d54009e60 tx=0x7f5d54009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83987a6d90bbbeae server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:23.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.762+0000 7f5d627fc700 1 -- 172.21.15.146:0/1227085563 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d5400e070 con 0x7f5d64153ab0 2023-10-06T11:06:23.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.762+0000 7f5d627fc700 1 -- 172.21.15.146:0/1227085563 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d5400bbf0 con 0x7f5d64153ab0 2023-10-06T11:06:23.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.762+0000 7f5d627fc700 1 -- 172.21.15.146:0/1227085563 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d54012430 con 0x7f5d64153ab0 2023-10-06T11:06:23.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.762+0000 7f5d69ff5700 1 -- 172.21.15.146:0/1227085563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d64153ab0 msgr2=0x7f5d6415a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:23.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.762+0000 7f5d69ff5700 1 --2- 172.21.15.146:0/1227085563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d64153ab0 0x7f5d6415a6f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5d54009e60 tx=0x7f5d54009780 comp rx=0 tx=0).stop 2023-10-06T11:06:23.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.762+0000 7f5d69ff5700 1 -- 172.21.15.146:0/1227085563 shutdown_connections 2023-10-06T11:06:23.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.762+0000 7f5d69ff5700 1 --2- 172.21.15.146:0/1227085563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d64153ab0 0x7f5d6415a6f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:23.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.762+0000 7f5d69ff5700 1 -- 172.21.15.146:0/1227085563 >> 172.21.15.146:0/1227085563 conn(0x7f5d6406eba0 msgr2=0x7f5d6406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:23.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.762+0000 7f5d69ff5700 1 -- 172.21.15.146:0/1227085563 shutdown_connections 2023-10-06T11:06:23.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.762+0000 7f5d69ff5700 1 -- 172.21.15.146:0/1227085563 wait complete. 2023-10-06T11:06:23.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.763+0000 7f5d69ff5700 1 Processor -- start 2023-10-06T11:06:23.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.764+0000 7f5d69ff5700 1 -- start start 2023-10-06T11:06:23.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.764+0000 7f5d69ff5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d64068ba0 0x7f5d640b13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:23.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.764+0000 7f5d69ff5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d64153ab0 0x7f5d640b0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:23.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.764+0000 7f5d69ff5700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d64153e80 0x7f5d641473c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:23.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.764+0000 7f5d69ff5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d640b0590 con 0x7f5d64068ba0 2023-10-06T11:06:23.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.764+0000 7f5d69ff5700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6414bfb0 con 0x7f5d64153ab0 2023-10-06T11:06:23.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.764+0000 7f5d69ff5700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d6414b3e0 con 0x7f5d64153e80 2023-10-06T11:06:23.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.764+0000 7f5d637fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d64068ba0 0x7f5d640b13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:23.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.764+0000 7f5d637fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d64068ba0 0x7f5d640b13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34726/0 (socket says 172.21.15.146:34726) 2023-10-06T11:06:23.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.764+0000 7f5d637fe700 1 -- 172.21.15.146:0/3988755268 learned_addr learned my addr 172.21.15.146:0/3988755268 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:23.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.765+0000 7f5d637fe700 1 -- 172.21.15.146:0/3988755268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d64153e80 msgr2=0x7f5d641473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:23.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.765+0000 7f5d637fe700 1 --2- 172.21.15.146:0/3988755268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d64153e80 0x7f5d641473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:23.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.765+0000 7f5d637fe700 1 -- 172.21.15.146:0/3988755268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d64153ab0 msgr2=0x7f5d640b0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:23.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.765+0000 7f5d62ffd700 1 --2- 172.21.15.146:0/3988755268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d64153ab0 0x7f5d640b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:23.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.765+0000 7f5d637fe700 1 --2- 172.21.15.146:0/3988755268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d64153ab0 0x7f5d640b0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:23.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.765+0000 7f5d637fe700 1 -- 172.21.15.146:0/3988755268 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d54009a20 con 0x7f5d64068ba0 2023-10-06T11:06:23.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.765+0000 7f5d637fe700 1 --2- 172.21.15.146:0/3988755268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d64068ba0 0x7f5d640b13e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5d64089010 tx=0x7f5d54018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:23.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.765+0000 7f5d4b7fe700 1 -- 172.21.15.146:0/3988755268 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d54027470 con 0x7f5d64068ba0 2023-10-06T11:06:23.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.765+0000 7f5d4b7fe700 1 -- 172.21.15.146:0/3988755268 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d540275d0 con 0x7f5d64068ba0 2023-10-06T11:06:23.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.765+0000 7f5d69ff5700 1 -- 172.21.15.146:0/3988755268 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d6414b680 con 0x7f5d64068ba0 2023-10-06T11:06:23.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.765+0000 7f5d4b7fe700 1 -- 172.21.15.146:0/3988755268 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d54027970 con 0x7f5d64068ba0 2023-10-06T11:06:23.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.765+0000 7f5d69ff5700 1 -- 172.21.15.146:0/3988755268 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d6414bc40 con 0x7f5d64068ba0 2023-10-06T11:06:23.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.766+0000 7f5d69ff5700 1 -- 172.21.15.146:0/3988755268 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d64068fd0 con 0x7f5d64068ba0 2023-10-06T11:06:23.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.766+0000 7f5d4b7fe700 1 -- 172.21.15.146:0/3988755268 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5d54024070 con 0x7f5d64068ba0 2023-10-06T11:06:23.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.767+0000 7f5d4b7fe700 1 --2- 172.21.15.146:0/3988755268 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5d50066f30 0x7f5d500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:23.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.767+0000 7f5d4b7fe700 1 -- 172.21.15.146:0/3988755268 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5d54087290 con 0x7f5d64068ba0 2023-10-06T11:06:23.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.767+0000 7f5d62ffd700 1 --2- 172.21.15.146:0/3988755268 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5d50066f30 0x7f5d500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:23.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.767+0000 7f5d62ffd700 1 --2- 172.21.15.146:0/3988755268 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5d50066f30 0x7f5d500693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5d6416d470 tx=0x7f5d58009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:23.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.771+0000 7f5d4b7fe700 1 -- 172.21.15.146:0/3988755268 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5d540543a0 con 0x7f5d64068ba0 2023-10-06T11:06:23.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.955+0000 7f5d69ff5700 1 -- 172.21.15.146:0/3988755268 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d6414cb10 con 0x7f5d64068ba0 2023-10-06T11:06:23.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.956+0000 7f5d4b7fe700 1 -- 172.21.15.146:0/3988755268 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16914 (secure 0 0 0) 0x7f5d540579c0 con 0x7f5d64068ba0 2023-10-06T11:06:23.958 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:06:23.958 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":20,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:05:45.362089+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:05:41.403954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T11:05:42.698754+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:06:23.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.958+0000 7f5d69ff5700 1 -- 172.21.15.146:0/3988755268 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5d50066f30 msgr2=0x7f5d500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:23.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.958+0000 7f5d69ff5700 1 --2- 172.21.15.146:0/3988755268 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5d50066f30 0x7f5d500693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5d6416d470 tx=0x7f5d58009040 comp rx=0 tx=0).stop 2023-10-06T11:06:23.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.958+0000 7f5d69ff5700 1 -- 172.21.15.146:0/3988755268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d64068ba0 msgr2=0x7f5d640b13e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:23.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.958+0000 7f5d69ff5700 1 --2- 172.21.15.146:0/3988755268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d64068ba0 0x7f5d640b13e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5d64089010 tx=0x7f5d54018000 comp rx=0 tx=0).stop 2023-10-06T11:06:23.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.958+0000 7f5d69ff5700 1 -- 172.21.15.146:0/3988755268 shutdown_connections 2023-10-06T11:06:23.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.958+0000 7f5d69ff5700 1 --2- 172.21.15.146:0/3988755268 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5d50066f30 0x7f5d500693e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:23.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.958+0000 7f5d69ff5700 1 --2- 172.21.15.146:0/3988755268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d64153e80 0x7f5d641473c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:23.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.958+0000 7f5d69ff5700 1 --2- 172.21.15.146:0/3988755268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d64068ba0 0x7f5d640b13e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:23.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.958+0000 7f5d69ff5700 1 --2- 172.21.15.146:0/3988755268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d64153ab0 0x7f5d640b0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:23.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.958+0000 7f5d69ff5700 1 -- 172.21.15.146:0/3988755268 >> 172.21.15.146:0/3988755268 conn(0x7f5d6406eba0 msgr2=0x7f5d641492b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:23.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.958+0000 7f5d69ff5700 1 -- 172.21.15.146:0/3988755268 shutdown_connections 2023-10-06T11:06:23.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:23.958+0000 7f5d69ff5700 1 -- 172.21.15.146:0/3988755268 wait complete. 2023-10-06T11:06:23.972 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T11:06:23.973 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:06:24.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.086+0000 7fea66a20700 1 Processor -- start 2023-10-06T11:06:24.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.086+0000 7fea66a20700 1 -- start start 2023-10-06T11:06:24.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.087+0000 7fea66a20700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fea60153e80 0x7fea6015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:24.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.087+0000 7fea66a20700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea6015ac30 con 0x7fea60068ba0 2023-10-06T11:06:24.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.087+0000 7fea66a20700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea600b4510 con 0x7fea60153ab0 2023-10-06T11:06:24.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.087+0000 7fea66a20700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea600b6530 con 0x7fea60153e80 2023-10-06T11:06:24.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.087+0000 7fea64fbd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fea60153e80 0x7fea6015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:24.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.087+0000 7fea5f7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fea60068ba0 0x7fea600b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40926/0 (socket says 172.21.15.146:40926) 2023-10-06T11:06:24.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.087+0000 7fea5f7fe700 1 -- 172.21.15.146:0/1430289512 learned_addr learned my addr 172.21.15.146:0/1430289512 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:24.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.087+0000 7fea64fbd700 1 -- 172.21.15.146:0/1430289512 >> v1:172.21.15.151:6789/0 conn(0x7fea60153ab0 legacy=0x7fea60068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:24.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.087+0000 7fea64fbd700 1 -- 172.21.15.146:0/1430289512 >> v1:172.21.15.146:6789/0 conn(0x7fea60068ba0 legacy=0x7fea600b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:24.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.087+0000 7fea64fbd700 1 -- 172.21.15.146:0/1430289512 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea600b5c50 con 0x7fea60153e80 2023-10-06T11:06:24.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.087+0000 7fea5effd700 1 -- 172.21.15.146:0/1430289512 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3794122059 0 0) 0x7fea54001110 con 0x7fea60068ba0 2023-10-06T11:06:24.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.087+0000 7fea64fbd700 1 --2- 172.21.15.146:0/1430289512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea60153e80 0x7fea6015a6f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fea58009e60 tx=0x7fea58009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e171e7be7499a8b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:24.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.087+0000 7fea5effd700 1 -- 172.21.15.146:0/1430289512 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5800e070 con 0x7fea60153e80 2023-10-06T11:06:24.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.088+0000 7fea5effd700 1 -- 172.21.15.146:0/1430289512 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5800bc30 con 0x7fea60153e80 2023-10-06T11:06:24.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.088+0000 7fea5effd700 1 -- 172.21.15.146:0/1430289512 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea58012430 con 0x7fea60153e80 2023-10-06T11:06:24.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.088+0000 7fea66a20700 1 -- 172.21.15.146:0/1430289512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea60153e80 msgr2=0x7fea6015a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:24.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.088+0000 7fea66a20700 1 --2- 172.21.15.146:0/1430289512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea60153e80 0x7fea6015a6f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fea58009e60 tx=0x7fea58009780 comp rx=0 tx=0).stop 2023-10-06T11:06:24.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.088+0000 7fea66a20700 1 -- 172.21.15.146:0/1430289512 shutdown_connections 2023-10-06T11:06:24.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.088+0000 7fea66a20700 1 --2- 172.21.15.146:0/1430289512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea60153e80 0x7fea6015a6f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:24.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.088+0000 7fea66a20700 1 -- 172.21.15.146:0/1430289512 >> 172.21.15.146:0/1430289512 conn(0x7fea6006eba0 msgr2=0x7fea6006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:24.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.088+0000 7fea66a20700 1 -- 172.21.15.146:0/1430289512 shutdown_connections 2023-10-06T11:06:24.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.088+0000 7fea66a20700 1 -- 172.21.15.146:0/1430289512 wait complete. 2023-10-06T11:06:24.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.089+0000 7fea66a20700 1 Processor -- start 2023-10-06T11:06:24.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.089+0000 7fea66a20700 1 -- start start 2023-10-06T11:06:24.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.090+0000 7fea66a20700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea60068ba0 0x7fea60150f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:24.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.090+0000 7fea66a20700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea60153ab0 0x7fea601497a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:24.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.090+0000 7fea66a20700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea60153e80 0x7fea60152610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:24.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.090+0000 7fea66a20700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea60149ce0 con 0x7fea60153e80 2023-10-06T11:06:24.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.090+0000 7fea66a20700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea600b0ad0 con 0x7fea60153ab0 2023-10-06T11:06:24.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.090+0000 7fea66a20700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea600afec0 con 0x7fea60068ba0 2023-10-06T11:06:24.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.090+0000 7fea64fbd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea60153e80 0x7fea60152610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:24.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.090+0000 7fea64fbd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea60153e80 0x7fea60152610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34756/0 (socket says 172.21.15.146:34756) 2023-10-06T11:06:24.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.090+0000 7fea64fbd700 1 -- 172.21.15.146:0/1603072810 learned_addr learned my addr 172.21.15.146:0/1603072810 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:24.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.090+0000 7fea5ffff700 1 --2- 172.21.15.146:0/1603072810 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea60068ba0 0x7fea60150f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:24.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.090+0000 7fea5f7fe700 1 --2- 172.21.15.146:0/1603072810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea60153ab0 0x7fea601497a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:24.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.091+0000 7fea64fbd700 1 -- 172.21.15.146:0/1603072810 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea60068ba0 msgr2=0x7fea60150f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:24.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.091+0000 7fea64fbd700 1 --2- 172.21.15.146:0/1603072810 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea60068ba0 0x7fea60150f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:24.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.091+0000 7fea64fbd700 1 -- 172.21.15.146:0/1603072810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea60153ab0 msgr2=0x7fea601497a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:24.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.091+0000 7fea64fbd700 1 --2- 172.21.15.146:0/1603072810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea60153ab0 0x7fea601497a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:24.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.091+0000 7fea64fbd700 1 -- 172.21.15.146:0/1603072810 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea58009a20 con 0x7fea60153e80 2023-10-06T11:06:24.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.091+0000 7fea5f7fe700 1 --2- 172.21.15.146:0/1603072810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea60153ab0 0x7fea601497a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:06:24.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.091+0000 7fea64fbd700 1 --2- 172.21.15.146:0/1603072810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea60153e80 0x7fea60152610 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fea58003000 tx=0x7fea58018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:24.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.091+0000 7fea47fff700 1 -- 172.21.15.146:0/1603072810 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5801e640 con 0x7fea60153e80 2023-10-06T11:06:24.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.091+0000 7fea47fff700 1 -- 172.21.15.146:0/1603072810 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5801e7c0 con 0x7fea60153e80 2023-10-06T11:06:24.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.091+0000 7fea66a20700 1 -- 172.21.15.146:0/1603072810 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea600b01a0 con 0x7fea60153e80 2023-10-06T11:06:24.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.091+0000 7fea47fff700 1 -- 172.21.15.146:0/1603072810 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5801eb80 con 0x7fea60153e80 2023-10-06T11:06:24.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.091+0000 7fea66a20700 1 -- 172.21.15.146:0/1603072810 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea600b0760 con 0x7fea60153e80 2023-10-06T11:06:24.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.092+0000 7fea66a20700 1 -- 172.21.15.146:0/1603072810 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea60151490 con 0x7fea60153e80 2023-10-06T11:06:24.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.092+0000 7fea47fff700 1 -- 172.21.15.146:0/1603072810 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fea58024070 con 0x7fea60153e80 2023-10-06T11:06:24.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.093+0000 7fea47fff700 1 --2- 172.21.15.146:0/1603072810 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fea4c066f30 0x7fea4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:24.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.093+0000 7fea47fff700 1 -- 172.21.15.146:0/1603072810 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fea58087200 con 0x7fea60153e80 2023-10-06T11:06:24.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.093+0000 7fea5ffff700 1 --2- 172.21.15.146:0/1603072810 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fea4c066f30 0x7fea4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:24.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.093+0000 7fea5ffff700 1 --2- 172.21.15.146:0/1603072810 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fea4c066f30 0x7fea4c0693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fea50003870 tx=0x7fea50009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:24.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.097+0000 7fea47fff700 1 -- 172.21.15.146:0/1603072810 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fea58054310 con 0x7fea60153e80 2023-10-06T11:06:24.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.323+0000 7fea66a20700 1 -- 172.21.15.146:0/1603072810 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fea6004c380 con 0x7fea60153e80 2023-10-06T11:06:24.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.324+0000 7fea47fff700 1 -- 172.21.15.146:0/1603072810 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4597 (secure 0 0 0) 0x7fea58057930 con 0x7fea60153e80 2023-10-06T11:06:24.326 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:06:24.326 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2812328960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2812328960},{"type":"v1","addr":"172.21.15.151:6835","nonce":2812328960}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/178026783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":178026783},{"type":"v1","addr":"172.21.15.146:6836","nonce":178026783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/716185126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":716185126},{"type":"v1","addr":"172.21.15.146:6837","nonce":716185126}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:05:43.740490+0000","modified":"2023-10-06T11:05:47.375805+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6833/1317728156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1317728156},{"type":"v1","addr":"172.21.15.151:6833","nonce":1317728156}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T11:06:24.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.326+0000 7fea66a20700 1 -- 172.21.15.146:0/1603072810 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fea4c066f30 msgr2=0x7fea4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:24.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.326+0000 7fea66a20700 1 --2- 172.21.15.146:0/1603072810 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fea4c066f30 0x7fea4c0693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fea50003870 tx=0x7fea50009040 comp rx=0 tx=0).stop 2023-10-06T11:06:24.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.326+0000 7fea66a20700 1 -- 172.21.15.146:0/1603072810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea60153e80 msgr2=0x7fea60152610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:24.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.326+0000 7fea66a20700 1 --2- 172.21.15.146:0/1603072810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea60153e80 0x7fea60152610 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fea58003000 tx=0x7fea58018000 comp rx=0 tx=0).stop 2023-10-06T11:06:24.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.326+0000 7fea66a20700 1 -- 172.21.15.146:0/1603072810 shutdown_connections 2023-10-06T11:06:24.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.326+0000 7fea66a20700 1 --2- 172.21.15.146:0/1603072810 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fea4c066f30 0x7fea4c0693e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:24.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.326+0000 7fea66a20700 1 --2- 172.21.15.146:0/1603072810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fea60153e80 0x7fea60152610 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:24.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.326+0000 7fea66a20700 1 --2- 172.21.15.146:0/1603072810 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fea60068ba0 0x7fea60150f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:24.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.326+0000 7fea66a20700 1 --2- 172.21.15.146:0/1603072810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea60153ab0 0x7fea601497a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:24.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.326+0000 7fea66a20700 1 -- 172.21.15.146:0/1603072810 >> 172.21.15.146:0/1603072810 conn(0x7fea6006eba0 msgr2=0x7fea6015afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:24.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.326+0000 7fea66a20700 1 -- 172.21.15.146:0/1603072810 shutdown_connections 2023-10-06T11:06:24.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.326+0000 7fea66a20700 1 -- 172.21.15.146:0/1603072810 wait complete. 2023-10-06T11:06:24.329 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 7 2023-10-06T11:06:24.340 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:06:24.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.456+0000 7f07f5a53700 1 Processor -- start 2023-10-06T11:06:24.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.456+0000 7f07f5a53700 1 -- start start 2023-10-06T11:06:24.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.457+0000 7f07f5a53700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07f006ebd0 0x7f07f00af020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:24.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.457+0000 7f07f5a53700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f07f00ad7f0 0x7f07f00cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:24.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.457+0000 7f07f5a53700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07f00af6b0 con 0x7f07f006e800 2023-10-06T11:06:24.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.457+0000 7f07f5a53700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07f006f040 con 0x7f07f00ad7f0 2023-10-06T11:06:24.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.457+0000 7f07f5a53700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f00af990 con 0x7f07f006ebd0 2023-10-06T11:06:24.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.457+0000 7f07ef7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f07f00ad7f0 0x7f07f00cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:24.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.457+0000 7f07ef7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f07f00ad7f0 0x7f07f00cb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34772/0 (socket says 172.21.15.146:34772) 2023-10-06T11:06:24.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.457+0000 7f07ef7fe700 1 -- 172.21.15.146:0/828930333 learned_addr learned my addr 172.21.15.146:0/828930333 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:24.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.457+0000 7f07ee7fc700 1 --2- 172.21.15.146:0/828930333 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07f006ebd0 0x7f07f00af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:24.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.457+0000 7f07ef7fe700 1 -- 172.21.15.146:0/828930333 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07f006ebd0 msgr2=0x7f07f00af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:24.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.457+0000 7f07ef7fe700 1 --2- 172.21.15.146:0/828930333 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07f006ebd0 0x7f07f00af020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:24.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.457+0000 7f07ef7fe700 1 -- 172.21.15.146:0/828930333 >> v1:172.21.15.151:6789/0 conn(0x7f07f006e800 legacy=0x7f07f00b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:24.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.457+0000 7f07ef7fe700 1 -- 172.21.15.146:0/828930333 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f00afc70 con 0x7f07f00ad7f0 2023-10-06T11:06:24.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.457+0000 7f07ef7fe700 1 --2- 172.21.15.146:0/828930333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07f00ad7f0 0x7f07f00cb350 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f07e00099b0 tx=0x7f07e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=582427167a753103 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:24.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.457+0000 7f07edffb700 1 -- 172.21.15.146:0/828930333 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e000b820 con 0x7f07f00ad7f0 2023-10-06T11:06:24.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.457+0000 7f07edffb700 1 -- 172.21.15.146:0/828930333 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e000b980 con 0x7f07f00ad7f0 2023-10-06T11:06:24.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.457+0000 7f07edffb700 1 -- 172.21.15.146:0/828930333 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e000bd20 con 0x7f07f00ad7f0 2023-10-06T11:06:24.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.458+0000 7f07f5a53700 1 -- 172.21.15.146:0/828930333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07f00ad7f0 msgr2=0x7f07f00cb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:24.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.458+0000 7f07f5a53700 1 --2- 172.21.15.146:0/828930333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07f00ad7f0 0x7f07f00cb350 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f07e00099b0 tx=0x7f07e0009250 comp rx=0 tx=0).stop 2023-10-06T11:06:24.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.458+0000 7f07f5a53700 1 -- 172.21.15.146:0/828930333 shutdown_connections 2023-10-06T11:06:24.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.458+0000 7f07f5a53700 1 --2- 172.21.15.146:0/828930333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07f00ad7f0 0x7f07f00cb350 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:24.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.458+0000 7f07f5a53700 1 --2- 172.21.15.146:0/828930333 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07f006ebd0 0x7f07f00af020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:24.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.458+0000 7f07f5a53700 1 -- 172.21.15.146:0/828930333 >> 172.21.15.146:0/828930333 conn(0x7f07f00cc260 msgr2=0x7f07f00cc660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:24.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.458+0000 7f07f5a53700 1 -- 172.21.15.146:0/828930333 shutdown_connections 2023-10-06T11:06:24.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.458+0000 7f07f5a53700 1 -- 172.21.15.146:0/828930333 wait complete. 2023-10-06T11:06:24.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.459+0000 7f07f5a53700 1 Processor -- start 2023-10-06T11:06:24.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.459+0000 7f07f5a53700 1 -- start start 2023-10-06T11:06:24.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.460+0000 7f07f5a53700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07f006e800 0x7f07f0167d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:24.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.460+0000 7f07f5a53700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f07f006ebd0 0x7f07f0166bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:24.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.460+0000 7f07f5a53700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07f00ad7f0 0x7f07f01684e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:24.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.460+0000 7f07f5a53700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f01682d0 con 0x7f07f00ad7f0 2023-10-06T11:06:24.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.460+0000 7f07f5a53700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07f00c1f80 con 0x7f07f006ebd0 2023-10-06T11:06:24.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.460+0000 7f07f5a53700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07f00c1370 con 0x7f07f006e800 2023-10-06T11:06:24.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.460+0000 7f07ef7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07f00ad7f0 0x7f07f01684e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:24.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.460+0000 7f07ef7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07f00ad7f0 0x7f07f01684e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34776/0 (socket says 172.21.15.146:34776) 2023-10-06T11:06:24.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.460+0000 7f07ef7fe700 1 -- 172.21.15.146:0/1691461120 learned_addr learned my addr 172.21.15.146:0/1691461120 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:24.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.460+0000 7f07ef7fe700 1 -- 172.21.15.146:0/1691461120 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07f006e800 msgr2=0x7f07f0167d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:24.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.460+0000 7f07ef7fe700 1 --2- 172.21.15.146:0/1691461120 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07f006e800 0x7f07f0167d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:24.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.460+0000 7f07ef7fe700 1 -- 172.21.15.146:0/1691461120 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f07f006ebd0 msgr2=0x7f07f0166bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:24.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.460+0000 7f07ee7fc700 1 --2- 172.21.15.146:0/1691461120 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f07f006ebd0 0x7f07f0166bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:24.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.460+0000 7f07ef7fe700 1 --2- 172.21.15.146:0/1691461120 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f07f006ebd0 0x7f07f0166bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:24.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.460+0000 7f07ef7fe700 1 -- 172.21.15.146:0/1691461120 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e00094f0 con 0x7f07f00ad7f0 2023-10-06T11:06:24.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.461+0000 7f07ef7fe700 1 --2- 172.21.15.146:0/1691461120 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07f00ad7f0 0x7f07f01684e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f07e00030c0 tx=0x7f07e0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:24.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.461+0000 7f07e6ffd700 1 -- 172.21.15.146:0/1691461120 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e001b450 con 0x7f07f00ad7f0 2023-10-06T11:06:24.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.461+0000 7f07e6ffd700 1 -- 172.21.15.146:0/1691461120 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07e0020070 con 0x7f07f00ad7f0 2023-10-06T11:06:24.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.461+0000 7f07f5a53700 1 -- 172.21.15.146:0/1691461120 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07f00c1650 con 0x7f07f00ad7f0 2023-10-06T11:06:24.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.461+0000 7f07e6ffd700 1 -- 172.21.15.146:0/1691461120 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07e001b800 con 0x7f07f00ad7f0 2023-10-06T11:06:24.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.461+0000 7f07f5a53700 1 -- 172.21.15.146:0/1691461120 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07f00c1c10 con 0x7f07f00ad7f0 2023-10-06T11:06:24.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.462+0000 7f07f5a53700 1 -- 172.21.15.146:0/1691461120 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07f004c380 con 0x7f07f00ad7f0 2023-10-06T11:06:24.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.462+0000 7f07e6ffd700 1 -- 172.21.15.146:0/1691461120 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f07e0022030 con 0x7f07f00ad7f0 2023-10-06T11:06:24.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.462+0000 7f07e6ffd700 1 --2- 172.21.15.146:0/1691461120 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f07d0066f30 0x7f07d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:24.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.463+0000 7f07e6ffd700 1 -- 172.21.15.146:0/1691461120 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f07e0086720 con 0x7f07f00ad7f0 2023-10-06T11:06:24.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.463+0000 7f07eeffd700 1 --2- 172.21.15.146:0/1691461120 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f07d0066f30 0x7f07d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:24.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.463+0000 7f07eeffd700 1 --2- 172.21.15.146:0/1691461120 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f07d0066f30 0x7f07d00693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f07f015d110 tx=0x7f07e8007ea0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:24.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.467+0000 7f07e6ffd700 1 -- 172.21.15.146:0/1691461120 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f07e0053830 con 0x7f07f00ad7f0 2023-10-06T11:06:24.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.692+0000 7f07f5a53700 1 -- 172.21.15.146:0/1691461120 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07f004c380 con 0x7f07f00ad7f0 2023-10-06T11:06:24.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.692+0000 7f07e6ffd700 1 -- 172.21.15.146:0/1691461120 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4597 (secure 0 0 0) 0x7f07e0056e50 con 0x7f07f00ad7f0 2023-10-06T11:06:24.695 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:06:24.695 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2812328960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2812328960},{"type":"v1","addr":"172.21.15.151:6835","nonce":2812328960}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4275,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/178026783","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":178026783},{"type":"v1","addr":"172.21.15.146:6836","nonce":178026783}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/716185126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":716185126},{"type":"v1","addr":"172.21.15.146:6837","nonce":716185126}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:05:43.740490+0000","modified":"2023-10-06T11:05:47.375805+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6833/1317728156","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1317728156},{"type":"v1","addr":"172.21.15.151:6833","nonce":1317728156}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T11:06:24.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.695+0000 7f07f5a53700 1 -- 172.21.15.146:0/1691461120 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f07d0066f30 msgr2=0x7f07d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:24.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.695+0000 7f07f5a53700 1 --2- 172.21.15.146:0/1691461120 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f07d0066f30 0x7f07d00693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f07f015d110 tx=0x7f07e8007ea0 comp rx=0 tx=0).stop 2023-10-06T11:06:24.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.695+0000 7f07f5a53700 1 -- 172.21.15.146:0/1691461120 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07f00ad7f0 msgr2=0x7f07f01684e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:24.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.695+0000 7f07f5a53700 1 --2- 172.21.15.146:0/1691461120 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07f00ad7f0 0x7f07f01684e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f07e00030c0 tx=0x7f07e0016000 comp rx=0 tx=0).stop 2023-10-06T11:06:24.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.695+0000 7f07f5a53700 1 -- 172.21.15.146:0/1691461120 shutdown_connections 2023-10-06T11:06:24.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.695+0000 7f07f5a53700 1 --2- 172.21.15.146:0/1691461120 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f07d0066f30 0x7f07d00693e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:24.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.695+0000 7f07f5a53700 1 --2- 172.21.15.146:0/1691461120 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07f00ad7f0 0x7f07f01684e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:24.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.695+0000 7f07f5a53700 1 --2- 172.21.15.146:0/1691461120 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07f006e800 0x7f07f0167d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:24.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.695+0000 7f07f5a53700 1 --2- 172.21.15.146:0/1691461120 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f07f006ebd0 0x7f07f0166bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:24.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.695+0000 7f07f5a53700 1 -- 172.21.15.146:0/1691461120 >> 172.21.15.146:0/1691461120 conn(0x7f07f00cc260 msgr2=0x7f07f0097c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:24.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.695+0000 7f07f5a53700 1 -- 172.21.15.146:0/1691461120 shutdown_connections 2023-10-06T11:06:24.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.695+0000 7f07f5a53700 1 -- 172.21.15.146:0/1691461120 wait complete. 2023-10-06T11:06:24.699 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 7 2023-10-06T11:06:24.709 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:06:24.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.822+0000 7fb0a0ef6700 1 Processor -- start 2023-10-06T11:06:24.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.822+0000 7fb0a0ef6700 1 -- start start 2023-10-06T11:06:24.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.823+0000 7fb0a0ef6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb09c15a420 0x7fb09c15cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:24.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.823+0000 7fb0a0ef6700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb09c15a7f0 0x7fb09c0b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:24.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.823+0000 7fb0a0ef6700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb09c15c630 con 0x7fb09c0b2360 2023-10-06T11:06:24.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.823+0000 7fb0a0ef6700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb09c0ce040 con 0x7fb09c15a420 2023-10-06T11:06:24.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.823+0000 7fb0a0ef6700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb09c0b2780 con 0x7fb09c15a7f0 2023-10-06T11:06:24.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.823+0000 7fb09b7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb09c15a420 0x7fb09c15cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:24.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.823+0000 7fb09b7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb09c15a420 0x7fb09c15cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34792/0 (socket says 172.21.15.146:34792) 2023-10-06T11:06:24.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.823+0000 7fb09b7fe700 1 -- 172.21.15.146:0/3814371514 learned_addr learned my addr 172.21.15.146:0/3814371514 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:24.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.823+0000 7fb09affd700 1 --2- 172.21.15.146:0/3814371514 >> v2:172.21.15.151:3300/0 conn(0x7fb09c15a7f0 0x7fb09c0b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:24.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.824+0000 7fb09b7fe700 1 -- 172.21.15.146:0/3814371514 >> v2:172.21.15.151:3300/0 conn(0x7fb09c15a7f0 msgr2=0x7fb09c0b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:24.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.824+0000 7fb09b7fe700 1 --2- 172.21.15.146:0/3814371514 >> v2:172.21.15.151:3300/0 conn(0x7fb09c15a7f0 0x7fb09c0b1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:24.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.824+0000 7fb09b7fe700 1 -- 172.21.15.146:0/3814371514 >> v1:172.21.15.151:6789/0 conn(0x7fb09c0b2360 legacy=0x7fb09c15acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:24.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.824+0000 7fb09b7fe700 1 -- 172.21.15.146:0/3814371514 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb09c15ba20 con 0x7fb09c15a420 2023-10-06T11:06:24.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.824+0000 7fb09b7fe700 1 --2- 172.21.15.146:0/3814371514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb09c15a420 0x7fb09c15cac0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb09c0b33c0 tx=0x7fb08c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=152860bdc72d8847 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:24.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.824+0000 7fb09a7fc700 1 -- 172.21.15.146:0/3814371514 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08c009e70 con 0x7fb09c15a420 2023-10-06T11:06:24.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.824+0000 7fb09a7fc700 1 -- 172.21.15.146:0/3814371514 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb08c00b860 con 0x7fb09c15a420 2023-10-06T11:06:24.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.824+0000 7fb09a7fc700 1 -- 172.21.15.146:0/3814371514 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08c00bc00 con 0x7fb09c15a420 2023-10-06T11:06:24.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.824+0000 7fb0a0ef6700 1 -- 172.21.15.146:0/3814371514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb09c15a420 msgr2=0x7fb09c15cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:24.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.824+0000 7fb0a0ef6700 1 --2- 172.21.15.146:0/3814371514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb09c15a420 0x7fb09c15cac0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb09c0b33c0 tx=0x7fb08c009250 comp rx=0 tx=0).stop 2023-10-06T11:06:24.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.824+0000 7fb0a0ef6700 1 -- 172.21.15.146:0/3814371514 shutdown_connections 2023-10-06T11:06:24.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.825+0000 7fb0a0ef6700 1 --2- 172.21.15.146:0/3814371514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb09c15a420 0x7fb09c15cac0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:24.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.825+0000 7fb0a0ef6700 1 --2- 172.21.15.146:0/3814371514 >> v2:172.21.15.151:3300/0 conn(0x7fb09c15a7f0 0x7fb09c0b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:24.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.825+0000 7fb0a0ef6700 1 -- 172.21.15.146:0/3814371514 >> 172.21.15.146:0/3814371514 conn(0x7fb09c06eba0 msgr2=0x7fb09c06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:24.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.825+0000 7fb0a0ef6700 1 -- 172.21.15.146:0/3814371514 shutdown_connections 2023-10-06T11:06:24.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.825+0000 7fb0a0ef6700 1 -- 172.21.15.146:0/3814371514 wait complete. 2023-10-06T11:06:24.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.826+0000 7fb0a0ef6700 1 Processor -- start 2023-10-06T11:06:24.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.826+0000 7fb0a0ef6700 1 -- start start 2023-10-06T11:06:24.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.827+0000 7fb0a0ef6700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb09c0b2360 0x7fb09c13ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:24.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.827+0000 7fb0a0ef6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb09c15a420 0x7fb09c152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:24.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.827+0000 7fb0a0ef6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb09c15a7f0 0x7fb09c155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:24.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.827+0000 7fb0a0ef6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb09c150b00 con 0x7fb09c15a420 2023-10-06T11:06:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.827+0000 7fb0a0ef6700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb09c1510c0 con 0x7fb09c0b2360 2023-10-06T11:06:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.827+0000 7fb0a0ef6700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb09c154ea0 con 0x7fb09c15a7f0 2023-10-06T11:06:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.827+0000 7fb09affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb09c15a420 0x7fb09c152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.827+0000 7fb09affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb09c15a420 0x7fb09c152f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34806/0 (socket says 172.21.15.146:34806) 2023-10-06T11:06:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.827+0000 7fb09affd700 1 -- 172.21.15.146:0/588184530 learned_addr learned my addr 172.21.15.146:0/588184530 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.827+0000 7fb09b7fe700 1 --2- 172.21.15.146:0/588184530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb09c0b2360 0x7fb09c13ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.827+0000 7fb09bfff700 1 --2- 172.21.15.146:0/588184530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb09c15a7f0 0x7fb09c155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.827+0000 7fb09affd700 1 -- 172.21.15.146:0/588184530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb09c15a7f0 msgr2=0x7fb09c155870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.827+0000 7fb09affd700 1 --2- 172.21.15.146:0/588184530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb09c15a7f0 0x7fb09c155870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.827+0000 7fb09affd700 1 -- 172.21.15.146:0/588184530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb09c0b2360 msgr2=0x7fb09c13ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.827+0000 7fb09affd700 1 --2- 172.21.15.146:0/588184530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb09c0b2360 0x7fb09c13ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.827+0000 7fb09affd700 1 -- 172.21.15.146:0/588184530 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb08c0094f0 con 0x7fb09c15a420 2023-10-06T11:06:24.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.827+0000 7fb09affd700 1 --2- 172.21.15.146:0/588184530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb09c15a420 0x7fb09c152f90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb09000ec80 tx=0x7fb0900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:24.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.827+0000 7fb0837fe700 1 -- 172.21.15.146:0/588184530 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09000c9d0 con 0x7fb09c15a420 2023-10-06T11:06:24.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.827+0000 7fb0837fe700 1 -- 172.21.15.146:0/588184530 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09000cb30 con 0x7fb09c15a420 2023-10-06T11:06:24.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.827+0000 7fb0a0ef6700 1 -- 172.21.15.146:0/588184530 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb09c155180 con 0x7fb09c15a420 2023-10-06T11:06:24.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.827+0000 7fb0837fe700 1 -- 172.21.15.146:0/588184530 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb090013470 con 0x7fb09c15a420 2023-10-06T11:06:24.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.827+0000 7fb0a0ef6700 1 -- 172.21.15.146:0/588184530 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb09c13f2a0 con 0x7fb09c15a420 2023-10-06T11:06:24.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.828+0000 7fb0a0ef6700 1 -- 172.21.15.146:0/588184530 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb09c151230 con 0x7fb09c15a420 2023-10-06T11:06:24.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.829+0000 7fb0837fe700 1 -- 172.21.15.146:0/588184530 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb090013820 con 0x7fb09c15a420 2023-10-06T11:06:24.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.829+0000 7fb0837fe700 1 --2- 172.21.15.146:0/588184530 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb088066f30 0x7fb0880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:24.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.829+0000 7fb0837fe700 1 -- 172.21.15.146:0/588184530 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb090084a00 con 0x7fb09c15a420 2023-10-06T11:06:24.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.829+0000 7fb09b7fe700 1 --2- 172.21.15.146:0/588184530 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb088066f30 0x7fb0880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:24.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.830+0000 7fb09b7fe700 1 --2- 172.21.15.146:0/588184530 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb088066f30 0x7fb0880693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb09c0b33c0 tx=0x7fb08c017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:24.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:24.833+0000 7fb0837fe700 1 -- 172.21.15.146:0/588184530 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb090051b10 con 0x7fb09c15a420 2023-10-06T11:06:25.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.017+0000 7fb0a0ef6700 1 -- 172.21.15.146:0/588184530 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb09c15bd00 con 0x7fb09c15a420 2023-10-06T11:06:25.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.018+0000 7fb0837fe700 1 -- 172.21.15.146:0/588184530 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16914 (secure 0 0 0) 0x7fb090055130 con 0x7fb09c15a420 2023-10-06T11:06:25.020 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:06:25.020 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":20,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:05:45.362089+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:05:41.403954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T11:05:42.698754+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:06:25.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.021+0000 7fb0a0ef6700 1 -- 172.21.15.146:0/588184530 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb088066f30 msgr2=0x7fb0880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:25.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.021+0000 7fb0a0ef6700 1 --2- 172.21.15.146:0/588184530 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb088066f30 0x7fb0880693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb09c0b33c0 tx=0x7fb08c017000 comp rx=0 tx=0).stop 2023-10-06T11:06:25.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.021+0000 7fb0a0ef6700 1 -- 172.21.15.146:0/588184530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb09c15a420 msgr2=0x7fb09c152f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:25.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.021+0000 7fb0a0ef6700 1 --2- 172.21.15.146:0/588184530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb09c15a420 0x7fb09c152f90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb09000ec80 tx=0x7fb0900091a0 comp rx=0 tx=0).stop 2023-10-06T11:06:25.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.021+0000 7fb0a0ef6700 1 -- 172.21.15.146:0/588184530 shutdown_connections 2023-10-06T11:06:25.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.021+0000 7fb0a0ef6700 1 --2- 172.21.15.146:0/588184530 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb088066f30 0x7fb0880693e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:25.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.021+0000 7fb0a0ef6700 1 --2- 172.21.15.146:0/588184530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb09c15a7f0 0x7fb09c155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:25.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.021+0000 7fb0a0ef6700 1 --2- 172.21.15.146:0/588184530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb09c0b2360 0x7fb09c13ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:25.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.021+0000 7fb0a0ef6700 1 --2- 172.21.15.146:0/588184530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb09c15a420 0x7fb09c152f90 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:25.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.021+0000 7fb0a0ef6700 1 -- 172.21.15.146:0/588184530 >> 172.21.15.146:0/588184530 conn(0x7fb09c06eba0 msgr2=0x7fb09c14fb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:25.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.021+0000 7fb0a0ef6700 1 -- 172.21.15.146:0/588184530 shutdown_connections 2023-10-06T11:06:25.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.021+0000 7fb0a0ef6700 1 -- 172.21.15.146:0/588184530 wait complete. 2023-10-06T11:06:25.035 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T11:06:25.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.149+0000 7ff31b59e700 1 Processor -- start 2023-10-06T11:06:25.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.149+0000 7ff31b59e700 1 -- start start 2023-10-06T11:06:25.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.150+0000 7ff31b59e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff31c0cc040 0x7ff31c0cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:25.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.150+0000 7ff31b59e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff31c06b6f0 0x7ff31c06bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:25.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.150+0000 7ff31b59e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff31c15db50 con 0x7ff31c159d20 2023-10-06T11:06:25.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.150+0000 7ff31b59e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff31c15aa50 con 0x7ff31c0cc040 2023-10-06T11:06:25.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.150+0000 7ff31b59e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff31c06c0b0 con 0x7ff31c06b6f0 2023-10-06T11:06:25.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.150+0000 7ff31a59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff31c0cc040 0x7ff31c0cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:25.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.150+0000 7ff31ad9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff31c159d20 0x7ff31c15a180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40930/0 (socket says 172.21.15.146:40930) 2023-10-06T11:06:25.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.150+0000 7ff31ad9d700 1 -- 172.21.15.146:0/3305860585 learned_addr learned my addr 172.21.15.146:0/3305860585 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:25.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.150+0000 7ff31a59c700 1 -- 172.21.15.146:0/3305860585 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff31c06b6f0 msgr2=0x7ff31c06bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:25.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.150+0000 7ff319d9b700 1 --2- 172.21.15.146:0/3305860585 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff31c06b6f0 0x7ff31c06bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:25.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.150+0000 7ff31959a700 1 -- 172.21.15.146:0/3305860585 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2641432034 0 0) 0x7ff31c15db50 con 0x7ff31c159d20 2023-10-06T11:06:25.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.150+0000 7ff31a59c700 1 --2- 172.21.15.146:0/3305860585 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff31c06b6f0 0x7ff31c06bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:25.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.150+0000 7ff31a59c700 1 -- 172.21.15.146:0/3305860585 >> v1:172.21.15.146:6789/0 conn(0x7ff31c159d20 legacy=0x7ff31c15a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:25.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.150+0000 7ff31a59c700 1 -- 172.21.15.146:0/3305860585 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff31c15d220 con 0x7ff31c0cc040 2023-10-06T11:06:25.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.150+0000 7ff319d9b700 1 --2- 172.21.15.146:0/3305860585 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff31c06b6f0 0x7ff31c06bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:06:25.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.151+0000 7ff31a59c700 1 --2- 172.21.15.146:0/3305860585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff31c0cc040 0x7ff31c0cc410 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff30c009910 tx=0x7ff30c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98d2113cab8d9aef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:25.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.151+0000 7ff31959a700 1 -- 172.21.15.146:0/3305860585 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30c00b820 con 0x7ff31c0cc040 2023-10-06T11:06:25.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.151+0000 7ff31959a700 1 -- 172.21.15.146:0/3305860585 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff30c00b980 con 0x7ff31c0cc040 2023-10-06T11:06:25.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.151+0000 7ff31959a700 1 -- 172.21.15.146:0/3305860585 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30c00bd20 con 0x7ff31c0cc040 2023-10-06T11:06:25.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.151+0000 7ff31b59e700 1 -- 172.21.15.146:0/3305860585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff31c0cc040 msgr2=0x7ff31c0cc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:25.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.151+0000 7ff31b59e700 1 --2- 172.21.15.146:0/3305860585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff31c0cc040 0x7ff31c0cc410 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff30c009910 tx=0x7ff30c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:06:25.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.151+0000 7ff31b59e700 1 -- 172.21.15.146:0/3305860585 shutdown_connections 2023-10-06T11:06:25.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.151+0000 7ff31b59e700 1 --2- 172.21.15.146:0/3305860585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff31c0cc040 0x7ff31c0cc410 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:25.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.151+0000 7ff31b59e700 1 --2- 172.21.15.146:0/3305860585 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff31c06b6f0 0x7ff31c06bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:25.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.151+0000 7ff31b59e700 1 -- 172.21.15.146:0/3305860585 >> 172.21.15.146:0/3305860585 conn(0x7ff31c0ce240 msgr2=0x7ff31c0ce640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:25.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.151+0000 7ff31b59e700 1 -- 172.21.15.146:0/3305860585 shutdown_connections 2023-10-06T11:06:25.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.151+0000 7ff31b59e700 1 -- 172.21.15.146:0/3305860585 wait complete. 2023-10-06T11:06:25.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.152+0000 7ff31b59e700 1 Processor -- start 2023-10-06T11:06:25.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.152+0000 7ff31b59e700 1 -- start start 2023-10-06T11:06:25.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.153+0000 7ff31b59e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff31c06b6f0 0x7ff31c13abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:25.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.153+0000 7ff31b59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff31c0cc040 0x7ff31c0c52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:25.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.153+0000 7ff31b59e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff31c159d20 0x7ff31c15c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:25.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.153+0000 7ff31b59e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31c13ec70 con 0x7ff31c0cc040 2023-10-06T11:06:25.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.153+0000 7ff31b59e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31c0c9780 con 0x7ff31c06b6f0 2023-10-06T11:06:25.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.153+0000 7ff31b59e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff31c0c9a60 con 0x7ff31c159d20 2023-10-06T11:06:25.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.153+0000 7ff319d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff31c0cc040 0x7ff31c0c52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:25.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.153+0000 7ff319d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff31c0cc040 0x7ff31c0c52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34822/0 (socket says 172.21.15.146:34822) 2023-10-06T11:06:25.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.153+0000 7ff319d9b700 1 -- 172.21.15.146:0/368398190 learned_addr learned my addr 172.21.15.146:0/368398190 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:25.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.153+0000 7ff31a59c700 1 --2- 172.21.15.146:0/368398190 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff31c06b6f0 0x7ff31c13abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:25.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.153+0000 7ff31ad9d700 1 --2- 172.21.15.146:0/368398190 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff31c159d20 0x7ff31c15c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:25.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.154+0000 7ff319d9b700 1 -- 172.21.15.146:0/368398190 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff31c159d20 msgr2=0x7ff31c15c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:25.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.154+0000 7ff319d9b700 1 --2- 172.21.15.146:0/368398190 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff31c159d20 0x7ff31c15c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:25.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.154+0000 7ff319d9b700 1 -- 172.21.15.146:0/368398190 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff31c06b6f0 msgr2=0x7ff31c13abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:25.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.154+0000 7ff319d9b700 1 --2- 172.21.15.146:0/368398190 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff31c06b6f0 0x7ff31c13abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:25.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.154+0000 7ff319d9b700 1 -- 172.21.15.146:0/368398190 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff30c009420 con 0x7ff31c0cc040 2023-10-06T11:06:25.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.154+0000 7ff31a59c700 1 --2- 172.21.15.146:0/368398190 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff31c06b6f0 0x7ff31c13abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:06:25.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.154+0000 7ff319d9b700 1 --2- 172.21.15.146:0/368398190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff31c0cc040 0x7ff31c0c52f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff30400c830 tx=0x7ff304008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:25.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.154+0000 7ff3127fc700 1 -- 172.21.15.146:0/368398190 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff304011600 con 0x7ff31c0cc040 2023-10-06T11:06:25.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.154+0000 7ff3127fc700 1 -- 172.21.15.146:0/368398190 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff304011760 con 0x7ff31c0cc040 2023-10-06T11:06:25.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.154+0000 7ff3127fc700 1 -- 172.21.15.146:0/368398190 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff304011b20 con 0x7ff31c0cc040 2023-10-06T11:06:25.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.154+0000 7ff31b59e700 1 -- 172.21.15.146:0/368398190 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff31c13e620 con 0x7ff31c0cc040 2023-10-06T11:06:25.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.154+0000 7ff31b59e700 1 -- 172.21.15.146:0/368398190 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff31c13b0f0 con 0x7ff31c0cc040 2023-10-06T11:06:25.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.155+0000 7ff31b59e700 1 -- 172.21.15.146:0/368398190 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff31c13eac0 con 0x7ff31c0cc040 2023-10-06T11:06:25.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.155+0000 7ff3127fc700 1 -- 172.21.15.146:0/368398190 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff30400a3e0 con 0x7ff31c0cc040 2023-10-06T11:06:25.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.156+0000 7ff3127fc700 1 --2- 172.21.15.146:0/368398190 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff2fc066f30 0x7ff2fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:25.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.156+0000 7ff3127fc700 1 -- 172.21.15.146:0/368398190 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff3040847d0 con 0x7ff31c0cc040 2023-10-06T11:06:25.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.156+0000 7ff31a59c700 1 --2- 172.21.15.146:0/368398190 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff2fc066f30 0x7ff2fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:25.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.156+0000 7ff31a59c700 1 --2- 172.21.15.146:0/368398190 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff2fc066f30 0x7ff2fc0693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff30c009860 tx=0x7ff30c017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:25.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.160+0000 7ff3127fc700 1 -- 172.21.15.146:0/368398190 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff304051840 con 0x7ff31c0cc040 2023-10-06T11:06:25.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.384+0000 7ff31b59e700 1 -- 172.21.15.146:0/368398190 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff31c13edb0 con 0x7ff31c0cc040 2023-10-06T11:06:25.386 INFO:tasks.ceph.mon.a.smithi146.stderr:2023-10-06T11:06:25.385+0000 7f011baa1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T11:06:25.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.388+0000 7ff3127fc700 1 -- 172.21.15.146:0/368398190 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff304054e60 con 0x7ff31c0cc040 2023-10-06T11:06:25.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.390+0000 7ff31b59e700 1 -- 172.21.15.146:0/368398190 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff2fc066f30 msgr2=0x7ff2fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:25.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.390+0000 7ff31b59e700 1 --2- 172.21.15.146:0/368398190 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff2fc066f30 0x7ff2fc0693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff30c009860 tx=0x7ff30c017000 comp rx=0 tx=0).stop 2023-10-06T11:06:25.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.391+0000 7ff31b59e700 1 -- 172.21.15.146:0/368398190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff31c0cc040 msgr2=0x7ff31c0c52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:25.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.391+0000 7ff31b59e700 1 --2- 172.21.15.146:0/368398190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff31c0cc040 0x7ff31c0c52f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff30400c830 tx=0x7ff304008040 comp rx=0 tx=0).stop 2023-10-06T11:06:25.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.391+0000 7ff31b59e700 1 -- 172.21.15.146:0/368398190 shutdown_connections 2023-10-06T11:06:25.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.391+0000 7ff31b59e700 1 --2- 172.21.15.146:0/368398190 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff2fc066f30 0x7ff2fc0693e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:25.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.391+0000 7ff31b59e700 1 --2- 172.21.15.146:0/368398190 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff31c159d20 0x7ff31c15c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:25.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.391+0000 7ff31b59e700 1 --2- 172.21.15.146:0/368398190 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff31c06b6f0 0x7ff31c13abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:25.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.391+0000 7ff31b59e700 1 --2- 172.21.15.146:0/368398190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff31c0cc040 0x7ff31c0c52f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:25.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.391+0000 7ff31b59e700 1 -- 172.21.15.146:0/368398190 >> 172.21.15.146:0/368398190 conn(0x7ff31c0ce240 msgr2=0x7ff31c13ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:25.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.391+0000 7ff31b59e700 1 -- 172.21.15.146:0/368398190 shutdown_connections 2023-10-06T11:06:25.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.391+0000 7ff31b59e700 1 -- 172.21.15.146:0/368398190 wait complete. 2023-10-06T11:06:25.394 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T11:06:25.394 INFO:tasks.ceph.mds.b.smithi151.stderr: -2251> 2023-10-06T11:05:49.447+0000 7f4ff0cf0700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T11:06:25.404 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T11:06:25.418 INFO:tasks.ceph.mds.b.smithi151.stdout:starting mds.b at 2023-10-06T11:06:25.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.521+0000 7fd4a54c2700 1 Processor -- start 2023-10-06T11:06:25.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.521+0000 7fd4a54c2700 1 -- start start 2023-10-06T11:06:25.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.522+0000 7fd4a54c2700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd4a0067470 0x7fd4a00678c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:25.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.522+0000 7fd4a54c2700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4a00a9e90 0x7fd4a00aa2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:25.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.522+0000 7fd4a54c2700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4a00cce10 con 0x7fd4a01573f0 2023-10-06T11:06:25.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.522+0000 7fd4a54c2700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a0067e00 con 0x7fd4a0067470 2023-10-06T11:06:25.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.522+0000 7fd4a54c2700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a00c7fc0 con 0x7fd4a00a9e90 2023-10-06T11:06:25.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.522+0000 7fd49effd700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fd4a01573f0 0x7fd4a00c78b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:57018/0 (socket says 172.21.15.146:57018) 2023-10-06T11:06:25.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.522+0000 7fd49effd700 1 -- 172.21.15.146:0/2099797442 learned_addr learned my addr 172.21.15.146:0/2099797442 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:25.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.522+0000 7fd49f7fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4a00a9e90 0x7fd4a00aa2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:25.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.522+0000 7fd4967fc700 1 --2- 172.21.15.146:0/2099797442 >> v2:172.21.15.151:3300/0 conn(0x7fd4a0067470 0x7fd4a00678c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:25.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.522+0000 7fd49e7fc700 1 -- 172.21.15.146:0/2099797442 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3790017001 0 0) 0x7fd4a00cce10 con 0x7fd4a01573f0 2023-10-06T11:06:25.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.522+0000 7fd49e7fc700 1 -- 172.21.15.146:0/2099797442 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd48c003570 con 0x7fd4a01573f0 2023-10-06T11:06:25.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.523+0000 7fd49f7fe700 1 -- 172.21.15.146:0/2099797442 >> v2:172.21.15.151:3300/0 conn(0x7fd4a0067470 msgr2=0x7fd4a00678c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:25.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.523+0000 7fd49f7fe700 1 --2- 172.21.15.146:0/2099797442 >> v2:172.21.15.151:3300/0 conn(0x7fd4a0067470 0x7fd4a00678c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:25.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.523+0000 7fd49f7fe700 1 -- 172.21.15.146:0/2099797442 >> v1:172.21.15.151:6789/0 conn(0x7fd4a01573f0 legacy=0x7fd4a00c78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:25.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.523+0000 7fd49f7fe700 1 -- 172.21.15.146:0/2099797442 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a00cc200 con 0x7fd4a00a9e90 2023-10-06T11:06:25.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.523+0000 7fd4967fc700 1 --2- 172.21.15.146:0/2099797442 >> v2:172.21.15.151:3300/0 conn(0x7fd4a0067470 0x7fd4a00678c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:06:25.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.523+0000 7fd49f7fe700 1 --2- 172.21.15.146:0/2099797442 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4a00a9e90 0x7fd4a00aa2f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd498009e60 tx=0x7fd498009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37ca61bb3083ef3a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:25.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.523+0000 7fd49e7fc700 1 -- 172.21.15.146:0/2099797442 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49800e070 con 0x7fd4a00a9e90 2023-10-06T11:06:25.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.523+0000 7fd49e7fc700 1 -- 172.21.15.146:0/2099797442 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd49800bab0 con 0x7fd4a00a9e90 2023-10-06T11:06:25.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.523+0000 7fd49e7fc700 1 -- 172.21.15.146:0/2099797442 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49800be70 con 0x7fd4a00a9e90 2023-10-06T11:06:25.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.523+0000 7fd4a54c2700 1 -- 172.21.15.146:0/2099797442 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4a00a9e90 msgr2=0x7fd4a00aa2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:25.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.523+0000 7fd4a54c2700 1 --2- 172.21.15.146:0/2099797442 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4a00a9e90 0x7fd4a00aa2f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd498009e60 tx=0x7fd498009780 comp rx=0 tx=0).stop 2023-10-06T11:06:25.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.524+0000 7fd4a54c2700 1 -- 172.21.15.146:0/2099797442 shutdown_connections 2023-10-06T11:06:25.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.524+0000 7fd4a54c2700 1 --2- 172.21.15.146:0/2099797442 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4a00a9e90 0x7fd4a00aa2f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:25.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.524+0000 7fd4a54c2700 1 --2- 172.21.15.146:0/2099797442 >> v2:172.21.15.151:3300/0 conn(0x7fd4a0067470 0x7fd4a00678c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:25.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.524+0000 7fd4a54c2700 1 -- 172.21.15.146:0/2099797442 >> 172.21.15.146:0/2099797442 conn(0x7fd4a00cd270 msgr2=0x7fd4a00cd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:25.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.524+0000 7fd4a54c2700 1 -- 172.21.15.146:0/2099797442 shutdown_connections 2023-10-06T11:06:25.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.524+0000 7fd4a54c2700 1 -- 172.21.15.146:0/2099797442 wait complete. 2023-10-06T11:06:25.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.525+0000 7fd4a54c2700 1 Processor -- start 2023-10-06T11:06:25.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.525+0000 7fd4a54c2700 1 -- start start 2023-10-06T11:06:25.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.526+0000 7fd4a54c2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4a0067470 0x7fd4a00b27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:25.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.526+0000 7fd4a54c2700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4a00a9e90 0x7fd4a00b0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:25.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.526+0000 7fd4a54c2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4a01573f0 0x7fd4a00b0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:25.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.526+0000 7fd4a54c2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a00c3980 con 0x7fd4a0067470 2023-10-06T11:06:25.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.526+0000 7fd4a54c2700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a00c2bc0 con 0x7fd4a01573f0 2023-10-06T11:06:25.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.526+0000 7fd4a54c2700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a00c2ea0 con 0x7fd4a00a9e90 2023-10-06T11:06:25.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.526+0000 7fd49effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4a0067470 0x7fd4a00b27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:25.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.526+0000 7fd49effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4a0067470 0x7fd4a00b27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34834/0 (socket says 172.21.15.146:34834) 2023-10-06T11:06:25.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.526+0000 7fd49effd700 1 -- 172.21.15.146:0/848380707 learned_addr learned my addr 172.21.15.146:0/848380707 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:25.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.526+0000 7fd4967fc700 1 --2- 172.21.15.146:0/848380707 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4a00a9e90 0x7fd4a00b0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:25.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.526+0000 7fd49f7fe700 1 --2- 172.21.15.146:0/848380707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4a01573f0 0x7fd4a00b0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:25.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.526+0000 7fd49effd700 1 -- 172.21.15.146:0/848380707 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4a00a9e90 msgr2=0x7fd4a00b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:25.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.526+0000 7fd49effd700 1 --2- 172.21.15.146:0/848380707 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4a00a9e90 0x7fd4a00b0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:25.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.526+0000 7fd49effd700 1 -- 172.21.15.146:0/848380707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4a01573f0 msgr2=0x7fd4a00b0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:25.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.526+0000 7fd49effd700 1 --2- 172.21.15.146:0/848380707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4a01573f0 0x7fd4a00b0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:25.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.526+0000 7fd49effd700 1 -- 172.21.15.146:0/848380707 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd488009420 con 0x7fd4a0067470 2023-10-06T11:06:25.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.526+0000 7fd49effd700 1 --2- 172.21.15.146:0/848380707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4a0067470 0x7fd4a00b27c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd49000c590 tx=0x7fd490007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:25.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.526+0000 7fd4977fe700 1 -- 172.21.15.146:0/848380707 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd490005b30 con 0x7fd4a0067470 2023-10-06T11:06:25.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.526+0000 7fd4977fe700 1 -- 172.21.15.146:0/848380707 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd490005cb0 con 0x7fd4a0067470 2023-10-06T11:06:25.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.526+0000 7fd4a54c2700 1 -- 172.21.15.146:0/848380707 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd498009a20 con 0x7fd4a0067470 2023-10-06T11:06:25.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.526+0000 7fd4977fe700 1 -- 172.21.15.146:0/848380707 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd490007320 con 0x7fd4a0067470 2023-10-06T11:06:25.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.526+0000 7fd4a54c2700 1 -- 172.21.15.146:0/848380707 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4a00c3460 con 0x7fd4a0067470 2023-10-06T11:06:25.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.527+0000 7fd4a54c2700 1 -- 172.21.15.146:0/848380707 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4a006d290 con 0x7fd4a0067470 2023-10-06T11:06:25.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.528+0000 7fd4977fe700 1 -- 172.21.15.146:0/848380707 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd49001b3b0 con 0x7fd4a0067470 2023-10-06T11:06:25.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.528+0000 7fd4977fe700 1 --2- 172.21.15.146:0/848380707 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd480066f30 0x7fd4800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:25.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.528+0000 7fd4977fe700 1 -- 172.21.15.146:0/848380707 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fd490083b70 con 0x7fd4a0067470 2023-10-06T11:06:25.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.528+0000 7fd4967fc700 1 --2- 172.21.15.146:0/848380707 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd480066f30 0x7fd4800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:25.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.529+0000 7fd4967fc700 1 --2- 172.21.15.146:0/848380707 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd480066f30 0x7fd4800693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd4a009af70 tx=0x7fd4880091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:25.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.532+0000 7fd4977fe700 1 -- 172.21.15.146:0/848380707 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd490050bb0 con 0x7fd4a0067470 2023-10-06T11:06:25.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:25.759+0000 7fd4a54c2700 1 -- 172.21.15.146:0/848380707 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd4a004bb40 con 0x7fd4a0067470 2023-10-06T11:06:26.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.390+0000 7fd4977fe700 1 -- 172.21.15.146:0/848380707 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd4900170a0 con 0x7fd4a0067470 2023-10-06T11:06:26.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.392+0000 7fd4a54c2700 1 -- 172.21.15.146:0/848380707 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd480066f30 msgr2=0x7fd4800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:26.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.392+0000 7fd4a54c2700 1 --2- 172.21.15.146:0/848380707 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd480066f30 0x7fd4800693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd4a009af70 tx=0x7fd4880091a0 comp rx=0 tx=0).stop 2023-10-06T11:06:26.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.392+0000 7fd4a54c2700 1 -- 172.21.15.146:0/848380707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4a0067470 msgr2=0x7fd4a00b27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:26.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.392+0000 7fd4a54c2700 1 --2- 172.21.15.146:0/848380707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4a0067470 0x7fd4a00b27c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd49000c590 tx=0x7fd490007e00 comp rx=0 tx=0).stop 2023-10-06T11:06:26.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.392+0000 7fd4a54c2700 1 -- 172.21.15.146:0/848380707 shutdown_connections 2023-10-06T11:06:26.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.392+0000 7fd4a54c2700 1 --2- 172.21.15.146:0/848380707 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd480066f30 0x7fd4800693e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:26.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.392+0000 7fd4a54c2700 1 --2- 172.21.15.146:0/848380707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4a01573f0 0x7fd4a00b0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:26.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.392+0000 7fd4a54c2700 1 --2- 172.21.15.146:0/848380707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd4a0067470 0x7fd4a00b27c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:26.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.392+0000 7fd4a54c2700 1 --2- 172.21.15.146:0/848380707 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4a00a9e90 0x7fd4a00b0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:26.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.392+0000 7fd4a54c2700 1 -- 172.21.15.146:0/848380707 >> 172.21.15.146:0/848380707 conn(0x7fd4a00cd270 msgr2=0x7fd4a00aa260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:26.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.392+0000 7fd4a54c2700 1 -- 172.21.15.146:0/848380707 shutdown_connections 2023-10-06T11:06:26.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.392+0000 7fd4a54c2700 1 -- 172.21.15.146:0/848380707 wait complete. 2023-10-06T11:06:26.406 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T11:06:26.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.525+0000 7f89e9486700 1 Processor -- start 2023-10-06T11:06:26.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.525+0000 7f89e9486700 1 -- start start 2023-10-06T11:06:26.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.525+0000 7f89e9486700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89e415a160 0x7f89e40c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:26.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.525+0000 7f89e9486700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f89e40ae730 0x7f89e40aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:26.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.526+0000 7f89e9486700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89e40ae2a0 con 0x7f89e40ce3d0 2023-10-06T11:06:26.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.526+0000 7f89e9486700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89e415a530 con 0x7f89e40ae730 2023-10-06T11:06:26.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.526+0000 7f89e9486700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e40ad690 con 0x7f89e415a160 2023-10-06T11:06:26.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.526+0000 7f89e2ffd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89e415a160 0x7f89e40c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:26.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.526+0000 7f89e27fc700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f89e40ae730 0x7f89e40aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:26.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.526+0000 7f89e2ffd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89e415a160 0x7f89e40c55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:59760/0 (socket says 172.21.15.146:59760) 2023-10-06T11:06:26.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.526+0000 7f89e2ffd700 1 -- 172.21.15.146:0/501838789 learned_addr learned my addr 172.21.15.146:0/501838789 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:26.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.526+0000 7f89e37fe700 1 --1- 172.21.15.146:0/501838789 >> v1:172.21.15.151:6789/0 conn(0x7f89e40ce3d0 0x7f89e40ce830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:57026/0 (socket says 172.21.15.146:57026) 2023-10-06T11:06:26.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.526+0000 7f89e2ffd700 1 -- 172.21.15.146:0/501838789 >> v2:172.21.15.151:3300/0 conn(0x7f89e40ae730 msgr2=0x7f89e40aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:26.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.526+0000 7f89e2ffd700 1 --2- 172.21.15.146:0/501838789 >> v2:172.21.15.151:3300/0 conn(0x7f89e40ae730 0x7f89e40aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:26.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.526+0000 7f89e2ffd700 1 -- 172.21.15.146:0/501838789 >> v1:172.21.15.151:6789/0 conn(0x7f89e40ce3d0 legacy=0x7f89e40ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:26.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.526+0000 7f89e2ffd700 1 -- 172.21.15.146:0/501838789 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e40ad970 con 0x7f89e415a160 2023-10-06T11:06:26.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.526+0000 7f89e27fc700 1 --2- 172.21.15.146:0/501838789 >> v2:172.21.15.151:3300/0 conn(0x7f89e40ae730 0x7f89e40aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:06:26.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.526+0000 7f89e2ffd700 1 --2- 172.21.15.146:0/501838789 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89e415a160 0x7f89e40c55a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f89d4009990 tx=0x7f89d4009220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6199ef9efc1f4d52 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:26.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.526+0000 7f89e1ffb700 1 -- 172.21.15.146:0/501838789 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d4009e80 con 0x7f89e415a160 2023-10-06T11:06:26.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.527+0000 7f89e1ffb700 1 -- 172.21.15.146:0/501838789 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d4005c10 con 0x7f89e415a160 2023-10-06T11:06:26.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.527+0000 7f89e1ffb700 1 -- 172.21.15.146:0/501838789 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d400b650 con 0x7f89e415a160 2023-10-06T11:06:26.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.527+0000 7f89e9486700 1 -- 172.21.15.146:0/501838789 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89e415a160 msgr2=0x7f89e40c55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:26.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.527+0000 7f89e9486700 1 --2- 172.21.15.146:0/501838789 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89e415a160 0x7f89e40c55a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f89d4009990 tx=0x7f89d4009220 comp rx=0 tx=0).stop 2023-10-06T11:06:26.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.527+0000 7f89e9486700 1 -- 172.21.15.146:0/501838789 shutdown_connections 2023-10-06T11:06:26.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.527+0000 7f89e9486700 1 --2- 172.21.15.146:0/501838789 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89e415a160 0x7f89e40c55a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:26.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.527+0000 7f89e9486700 1 --2- 172.21.15.146:0/501838789 >> v2:172.21.15.151:3300/0 conn(0x7f89e40ae730 0x7f89e40aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:26.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.527+0000 7f89e9486700 1 -- 172.21.15.146:0/501838789 >> 172.21.15.146:0/501838789 conn(0x7f89e406f380 msgr2=0x7f89e40d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:26.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.527+0000 7f89e9486700 1 -- 172.21.15.146:0/501838789 shutdown_connections 2023-10-06T11:06:26.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.527+0000 7f89e9486700 1 -- 172.21.15.146:0/501838789 wait complete. 2023-10-06T11:06:26.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.528+0000 7f89e9486700 1 Processor -- start 2023-10-06T11:06:26.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.528+0000 7f89e9486700 1 -- start start 2023-10-06T11:06:26.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.529+0000 7f89e9486700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89e40ae730 0x7f89e40b5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:26.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.529+0000 7f89e9486700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89e40ce3d0 0x7f89e40b4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:26.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.529+0000 7f89e9486700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89e415a160 0x7f89e415eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:26.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.529+0000 7f89e9486700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e416e3b0 con 0x7f89e415a160 2023-10-06T11:06:26.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.529+0000 7f89e9486700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e40b46b0 con 0x7f89e40ce3d0 2023-10-06T11:06:26.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.529+0000 7f89e9486700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e40b6290 con 0x7f89e40ae730 2023-10-06T11:06:26.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.529+0000 7f89e37fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89e415a160 0x7f89e415eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:26.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.529+0000 7f89e37fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89e415a160 0x7f89e415eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34848/0 (socket says 172.21.15.146:34848) 2023-10-06T11:06:26.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.529+0000 7f89e37fe700 1 -- 172.21.15.146:0/159523003 learned_addr learned my addr 172.21.15.146:0/159523003 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:26.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.529+0000 7f89e2ffd700 1 --2- 172.21.15.146:0/159523003 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89e40ae730 0x7f89e40b5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:26.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.529+0000 7f89e27fc700 1 --2- 172.21.15.146:0/159523003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89e40ce3d0 0x7f89e40b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:26.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.530+0000 7f89e37fe700 1 -- 172.21.15.146:0/159523003 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89e40ae730 msgr2=0x7f89e40b5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:26.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.530+0000 7f89e37fe700 1 --2- 172.21.15.146:0/159523003 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89e40ae730 0x7f89e40b5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:26.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.530+0000 7f89e37fe700 1 -- 172.21.15.146:0/159523003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89e40ce3d0 msgr2=0x7f89e40b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:26.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.530+0000 7f89e37fe700 1 --2- 172.21.15.146:0/159523003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89e40ce3d0 0x7f89e40b4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:26.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.530+0000 7f89e37fe700 1 -- 172.21.15.146:0/159523003 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d8009420 con 0x7f89e415a160 2023-10-06T11:06:26.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.530+0000 7f89e37fe700 1 --2- 172.21.15.146:0/159523003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89e415a160 0x7f89e415eca0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f89dc00cd30 tx=0x7f89dc001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:26.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.530+0000 7f89caffd700 1 -- 172.21.15.146:0/159523003 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89dc00ce90 con 0x7f89e415a160 2023-10-06T11:06:26.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.530+0000 7f89caffd700 1 -- 172.21.15.146:0/159523003 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89dc005df0 con 0x7f89e415a160 2023-10-06T11:06:26.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.530+0000 7f89e9486700 1 -- 172.21.15.146:0/159523003 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89d4009480 con 0x7f89e415a160 2023-10-06T11:06:26.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.530+0000 7f89caffd700 1 -- 172.21.15.146:0/159523003 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89dc00aac0 con 0x7f89e415a160 2023-10-06T11:06:26.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.530+0000 7f89e9486700 1 -- 172.21.15.146:0/159523003 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89e416e040 con 0x7f89e415a160 2023-10-06T11:06:26.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.531+0000 7f89e9486700 1 -- 172.21.15.146:0/159523003 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89e416dbc0 con 0x7f89e415a160 2023-10-06T11:06:26.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.531+0000 7f89caffd700 1 -- 172.21.15.146:0/159523003 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f89dc0070f0 con 0x7f89e415a160 2023-10-06T11:06:26.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.532+0000 7f89caffd700 1 --2- 172.21.15.146:0/159523003 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f89d0066f30 0x7f89d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:26.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.532+0000 7f89caffd700 1 -- 172.21.15.146:0/159523003 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f89dc084790 con 0x7f89e415a160 2023-10-06T11:06:26.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.532+0000 7f89e2ffd700 1 --2- 172.21.15.146:0/159523003 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f89d0066f30 0x7f89d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:26.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.532+0000 7f89e2ffd700 1 --2- 172.21.15.146:0/159523003 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f89d0066f30 0x7f89d00693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f89d4009260 tx=0x7f89d4016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:26.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.536+0000 7f89caffd700 1 -- 172.21.15.146:0/159523003 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f89e416dbc0 con 0x7f89e415a160 2023-10-06T11:06:26.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:26.720+0000 7f89e9486700 1 -- 172.21.15.146:0/159523003 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f89e416dbc0 con 0x7f89e415a160 2023-10-06T11:06:27.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.503+0000 7f89caffd700 1 -- 172.21.15.146:0/159523003 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) v1 ==== 181+0+0 (secure 0 0 0) 0x7f89e416dbc0 con 0x7f89e415a160 2023-10-06T11:06:27.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.506+0000 7f89e9486700 1 -- 172.21.15.146:0/159523003 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f89d0066f30 msgr2=0x7f89d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:27.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.506+0000 7f89e9486700 1 --2- 172.21.15.146:0/159523003 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f89d0066f30 0x7f89d00693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f89d4009260 tx=0x7f89d4016000 comp rx=0 tx=0).stop 2023-10-06T11:06:27.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.506+0000 7f89e9486700 1 -- 172.21.15.146:0/159523003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89e415a160 msgr2=0x7f89e415eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:27.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.506+0000 7f89e9486700 1 --2- 172.21.15.146:0/159523003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89e415a160 0x7f89e415eca0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f89dc00cd30 tx=0x7f89dc001b10 comp rx=0 tx=0).stop 2023-10-06T11:06:27.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.506+0000 7f89e9486700 1 -- 172.21.15.146:0/159523003 shutdown_connections 2023-10-06T11:06:27.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.506+0000 7f89e9486700 1 --2- 172.21.15.146:0/159523003 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f89d0066f30 0x7f89d00693e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:27.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.506+0000 7f89e9486700 1 --2- 172.21.15.146:0/159523003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89e415a160 0x7f89e415eca0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:27.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.506+0000 7f89e9486700 1 --2- 172.21.15.146:0/159523003 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89e40ae730 0x7f89e40b5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:27.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.506+0000 7f89e9486700 1 --2- 172.21.15.146:0/159523003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89e40ce3d0 0x7f89e40b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:27.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.506+0000 7f89e9486700 1 -- 172.21.15.146:0/159523003 >> 172.21.15.146:0/159523003 conn(0x7f89e406f380 msgr2=0x7f89e40c6a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:27.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.506+0000 7f89e9486700 1 -- 172.21.15.146:0/159523003 shutdown_connections 2023-10-06T11:06:27.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.506+0000 7f89e9486700 1 -- 172.21.15.146:0/159523003 wait complete. 2023-10-06T11:06:27.509 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' removed 2023-10-06T11:06:27.520 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T11:06:27.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.636+0000 7fd476f3f700 1 Processor -- start 2023-10-06T11:06:27.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.636+0000 7fd476f3f700 1 -- start start 2023-10-06T11:06:27.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.637+0000 7fd476f3f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd47015a160 0x7fd4700c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:27.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.637+0000 7fd476f3f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4700cb950 0x7fd4700cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:27.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.637+0000 7fd476f3f700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4700ae2a0 con 0x7fd4700ae730 2023-10-06T11:06:27.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.637+0000 7fd476f3f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd47015a530 con 0x7fd47015a160 2023-10-06T11:06:27.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.637+0000 7fd476f3f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4700ad690 con 0x7fd4700cb950 2023-10-06T11:06:27.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.637+0000 7fd474cdb700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd47015a160 0x7fd4700c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:27.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.637+0000 7fd474cdb700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd47015a160 0x7fd4700c55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34860/0 (socket says 172.21.15.146:34860) 2023-10-06T11:06:27.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.637+0000 7fd474cdb700 1 -- 172.21.15.146:0/1363772987 learned_addr learned my addr 172.21.15.146:0/1363772987 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:27.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.637+0000 7fd4754dc700 1 --2- 172.21.15.146:0/1363772987 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4700cb950 0x7fd4700cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:27.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.638+0000 7fd474cdb700 1 -- 172.21.15.146:0/1363772987 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4700cb950 msgr2=0x7fd4700cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:27.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.638+0000 7fd474cdb700 1 --2- 172.21.15.146:0/1363772987 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4700cb950 0x7fd4700cbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:27.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.638+0000 7fd474cdb700 1 -- 172.21.15.146:0/1363772987 >> v1:172.21.15.151:6789/0 conn(0x7fd4700ae730 legacy=0x7fd4700aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:27.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.638+0000 7fd474cdb700 1 -- 172.21.15.146:0/1363772987 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4700ad970 con 0x7fd47015a160 2023-10-06T11:06:27.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.638+0000 7fd474cdb700 1 --2- 172.21.15.146:0/1363772987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd47015a160 0x7fd4700c55a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd46c009990 tx=0x7fd46c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f54a6c39fcf44eb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:27.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.638+0000 7fd4677fe700 1 -- 172.21.15.146:0/1363772987 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46c005c10 con 0x7fd47015a160 2023-10-06T11:06:27.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.638+0000 7fd4677fe700 1 -- 172.21.15.146:0/1363772987 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46c005d70 con 0x7fd47015a160 2023-10-06T11:06:27.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.638+0000 7fd4677fe700 1 -- 172.21.15.146:0/1363772987 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46c00b880 con 0x7fd47015a160 2023-10-06T11:06:27.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.638+0000 7fd476f3f700 1 -- 172.21.15.146:0/1363772987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd47015a160 msgr2=0x7fd4700c55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:27.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.638+0000 7fd476f3f700 1 --2- 172.21.15.146:0/1363772987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd47015a160 0x7fd4700c55a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd46c009990 tx=0x7fd46c009220 comp rx=0 tx=0).stop 2023-10-06T11:06:27.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.638+0000 7fd476f3f700 1 -- 172.21.15.146:0/1363772987 shutdown_connections 2023-10-06T11:06:27.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.638+0000 7fd476f3f700 1 --2- 172.21.15.146:0/1363772987 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4700cb950 0x7fd4700cbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:27.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.638+0000 7fd476f3f700 1 --2- 172.21.15.146:0/1363772987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd47015a160 0x7fd4700c55a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:27.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.638+0000 7fd476f3f700 1 -- 172.21.15.146:0/1363772987 >> 172.21.15.146:0/1363772987 conn(0x7fd47006f380 msgr2=0x7fd4700d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:27.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.638+0000 7fd476f3f700 1 -- 172.21.15.146:0/1363772987 shutdown_connections 2023-10-06T11:06:27.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.638+0000 7fd476f3f700 1 -- 172.21.15.146:0/1363772987 wait complete. 2023-10-06T11:06:27.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.639+0000 7fd476f3f700 1 Processor -- start 2023-10-06T11:06:27.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.640+0000 7fd476f3f700 1 -- start start 2023-10-06T11:06:27.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.640+0000 7fd476f3f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4700ae730 0x7fd47014f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:27.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.640+0000 7fd476f3f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4700cb950 0x7fd4700c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:27.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.640+0000 7fd476f3f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd47015a160 0x7fd4700c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:27.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.640+0000 7fd476f3f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4700c9040 con 0x7fd47015a160 2023-10-06T11:06:27.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.640+0000 7fd476f3f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4700b47f0 con 0x7fd4700ae730 2023-10-06T11:06:27.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.640+0000 7fd476f3f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4700b5090 con 0x7fd4700cb950 2023-10-06T11:06:27.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.640+0000 7fd4754dc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd47015a160 0x7fd4700c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:27.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.640+0000 7fd4754dc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd47015a160 0x7fd4700c8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34870/0 (socket says 172.21.15.146:34870) 2023-10-06T11:06:27.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.640+0000 7fd4754dc700 1 -- 172.21.15.146:0/1951929553 learned_addr learned my addr 172.21.15.146:0/1951929553 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:27.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.641+0000 7fd474cdb700 1 --2- 172.21.15.146:0/1951929553 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4700ae730 0x7fd47014f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:27.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.641+0000 7fd467fff700 1 --2- 172.21.15.146:0/1951929553 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4700cb950 0x7fd4700c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:27.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.641+0000 7fd4754dc700 1 -- 172.21.15.146:0/1951929553 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4700cb950 msgr2=0x7fd4700c7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:27.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.641+0000 7fd4754dc700 1 --2- 172.21.15.146:0/1951929553 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4700cb950 0x7fd4700c7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:27.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.641+0000 7fd4754dc700 1 -- 172.21.15.146:0/1951929553 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4700ae730 msgr2=0x7fd47014f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:27.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.641+0000 7fd4754dc700 1 --2- 172.21.15.146:0/1951929553 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4700ae730 0x7fd47014f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:27.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.641+0000 7fd4754dc700 1 -- 172.21.15.146:0/1951929553 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd46c009480 con 0x7fd47015a160 2023-10-06T11:06:27.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.641+0000 7fd4754dc700 1 --2- 172.21.15.146:0/1951929553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd47015a160 0x7fd4700c8000 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd468009fa0 tx=0x7fd468009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:27.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.641+0000 7fd464ff9700 1 -- 172.21.15.146:0/1951929553 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46800eb60 con 0x7fd47015a160 2023-10-06T11:06:27.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.641+0000 7fd464ff9700 1 -- 172.21.15.146:0/1951929553 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46800ecc0 con 0x7fd47015a160 2023-10-06T11:06:27.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.641+0000 7fd476f3f700 1 -- 172.21.15.146:0/1951929553 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd470152150 con 0x7fd47015a160 2023-10-06T11:06:27.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.641+0000 7fd464ff9700 1 -- 172.21.15.146:0/1951929553 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd468014670 con 0x7fd47015a160 2023-10-06T11:06:27.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.641+0000 7fd476f3f700 1 -- 172.21.15.146:0/1951929553 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4700b4d20 con 0x7fd47015a160 2023-10-06T11:06:27.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.642+0000 7fd476f3f700 1 -- 172.21.15.146:0/1951929553 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd470068390 con 0x7fd47015a160 2023-10-06T11:06:27.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.642+0000 7fd464ff9700 1 -- 172.21.15.146:0/1951929553 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd468014a20 con 0x7fd47015a160 2023-10-06T11:06:27.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.643+0000 7fd464ff9700 1 --2- 172.21.15.146:0/1951929553 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd45c066f30 0x7fd45c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:27.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.643+0000 7fd464ff9700 1 -- 172.21.15.146:0/1951929553 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fd468084a90 con 0x7fd47015a160 2023-10-06T11:06:27.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.643+0000 7fd474cdb700 1 --2- 172.21.15.146:0/1951929553 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd45c066f30 0x7fd45c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:27.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.643+0000 7fd474cdb700 1 --2- 172.21.15.146:0/1951929553 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd45c066f30 0x7fd45c0693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd46c009260 tx=0x7fd46c016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:27.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.647+0000 7fd464ff9700 1 -- 172.21.15.146:0/1951929553 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd468055790 con 0x7fd47015a160 2023-10-06T11:06:27.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:27.827+0000 7fd476f3f700 1 -- 172.21.15.146:0/1951929553 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd47004c380 con 0x7fd47015a160 2023-10-06T11:06:28.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.508+0000 7fd464ff9700 1 -- 172.21.15.146:0/1951929553 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd468055320 con 0x7fd47015a160 2023-10-06T11:06:28.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.512+0000 7fd476f3f700 1 -- 172.21.15.146:0/1951929553 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd45c066f30 msgr2=0x7fd45c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:28.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.512+0000 7fd476f3f700 1 --2- 172.21.15.146:0/1951929553 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd45c066f30 0x7fd45c0693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd46c009260 tx=0x7fd46c016000 comp rx=0 tx=0).stop 2023-10-06T11:06:28.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.512+0000 7fd476f3f700 1 -- 172.21.15.146:0/1951929553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd47015a160 msgr2=0x7fd4700c8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:28.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.512+0000 7fd476f3f700 1 --2- 172.21.15.146:0/1951929553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd47015a160 0x7fd4700c8000 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd468009fa0 tx=0x7fd468009900 comp rx=0 tx=0).stop 2023-10-06T11:06:28.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.512+0000 7fd476f3f700 1 -- 172.21.15.146:0/1951929553 shutdown_connections 2023-10-06T11:06:28.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.512+0000 7fd476f3f700 1 --2- 172.21.15.146:0/1951929553 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd45c066f30 0x7fd45c0693e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:28.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.512+0000 7fd476f3f700 1 --2- 172.21.15.146:0/1951929553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd47015a160 0x7fd4700c8000 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:28.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.512+0000 7fd476f3f700 1 --2- 172.21.15.146:0/1951929553 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4700ae730 0x7fd47014f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:28.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.512+0000 7fd476f3f700 1 --2- 172.21.15.146:0/1951929553 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd4700cb950 0x7fd4700c7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:28.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.512+0000 7fd476f3f700 1 -- 172.21.15.146:0/1951929553 >> 172.21.15.146:0/1951929553 conn(0x7fd47006f380 msgr2=0x7fd4701526c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:28.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.512+0000 7fd476f3f700 1 -- 172.21.15.146:0/1951929553 shutdown_connections 2023-10-06T11:06:28.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.512+0000 7fd476f3f700 1 -- 172.21.15.146:0/1951929553 wait complete. 2023-10-06T11:06:28.515 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' removed 2023-10-06T11:06:28.528 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T11:06:28.528 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T11:06:28.528 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T11:06:28.528 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:06:28.529 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T11:06:28.529 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T11:06:28.529 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T11:06:28.529 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:06:28.529 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T11:06:28.529 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T11:06:28.530 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T11:06:28.530 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:06:28.530 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T11:06:28.530 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T11:06:28.530 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T11:06:28.531 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:06:28.537 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T11:06:28.538 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T11:06:28.539 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T11:06:28.539 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T11:06:28.540 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T11:06:28.540 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T11:06:28.541 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T11:06:28.541 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T11:06:28.580 INFO:tasks.ceph.mds.a:Started 2023-10-06T11:06:28.581 DEBUG:teuthology.parallel:result is None 2023-10-06T11:06:28.582 INFO:tasks.ceph.mds.c:Started 2023-10-06T11:06:28.582 DEBUG:teuthology.parallel:result is None 2023-10-06T11:06:28.583 INFO:tasks.ceph.mds.b:Started 2023-10-06T11:06:28.583 DEBUG:teuthology.parallel:result is None 2023-10-06T11:06:28.584 INFO:tasks.ceph.mds.d:Started 2023-10-06T11:06:28.584 DEBUG:teuthology.parallel:result is None 2023-10-06T11:06:28.584 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T11:06:28.654 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2023-10-06T11:06:28.655 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2023-10-06T11:06:28.655 INFO:tasks.ceph.mds.c.smithi146.stderr:2023-10-06T11:06:28.653+0000 7f59036d1700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-10-06T11:06:28.662 INFO:tasks.ceph.mds.b.smithi151.stdout:starting mds.b at 2023-10-06T11:06:28.662 INFO:tasks.ceph.mds.d.smithi151.stdout:starting mds.d at 2023-10-06T11:06:28.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.703+0000 7f4867fff700 1 Processor -- start 2023-10-06T11:06:28.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.703+0000 7f4867fff700 1 -- start start 2023-10-06T11:06:28.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.704+0000 7f4867fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f48680d05c0 0x7f48680d0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:28.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.704+0000 7f4867fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f486815b0d0 0x7f486815b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:28.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.704+0000 7f4867fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48680ceb90 con 0x7f48681572f0 2023-10-06T11:06:28.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.704+0000 7f4867fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48680ce3c0 con 0x7f48680d05c0 2023-10-06T11:06:28.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.704+0000 7f4867fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48680d0f80 con 0x7f486815b0d0 2023-10-06T11:06:28.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.704+0000 7f485e7fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f48680d05c0 0x7f48680d0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:28.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.704+0000 7f4866ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f48681572f0 0x7f48680cfb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40954/0 (socket says 172.21.15.146:40954) 2023-10-06T11:06:28.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.704+0000 7f4866ffd700 1 -- 172.21.15.146:0/3590104990 learned_addr learned my addr 172.21.15.146:0/3590104990 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:28.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.704+0000 7f48677fe700 1 --2- 172.21.15.146:0/3590104990 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f486815b0d0 0x7f486815b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:28.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.704+0000 7f485e7fc700 1 -- 172.21.15.146:0/3590104990 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f486815b0d0 msgr2=0x7f486815b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:28.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.704+0000 7f485e7fc700 1 --2- 172.21.15.146:0/3590104990 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f486815b0d0 0x7f486815b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:28.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.704+0000 7f485e7fc700 1 -- 172.21.15.146:0/3590104990 >> v1:172.21.15.146:6789/0 conn(0x7f48681572f0 legacy=0x7f48680cfb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:28.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.704+0000 7f485e7fc700 1 -- 172.21.15.146:0/3590104990 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f486815e250 con 0x7f48680d05c0 2023-10-06T11:06:28.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.704+0000 7f48667fc700 1 -- 172.21.15.146:0/3590104990 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 932108995 0 0) 0x7f48680ceb90 con 0x7f48681572f0 2023-10-06T11:06:28.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.705+0000 7f485e7fc700 1 --2- 172.21.15.146:0/3590104990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48680d05c0 0x7f48680d0a40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4850009910 tx=0x7f48500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e579375f5d2e34 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:28.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.705+0000 7f48667fc700 1 -- 172.21.15.146:0/3590104990 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485000b820 con 0x7f48680d05c0 2023-10-06T11:06:28.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.705+0000 7f48667fc700 1 -- 172.21.15.146:0/3590104990 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485000b980 con 0x7f48680d05c0 2023-10-06T11:06:28.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.705+0000 7f48667fc700 1 -- 172.21.15.146:0/3590104990 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485000bd20 con 0x7f48680d05c0 2023-10-06T11:06:28.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.705+0000 7f4867fff700 1 -- 172.21.15.146:0/3590104990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48680d05c0 msgr2=0x7f48680d0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:28.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.705+0000 7f4867fff700 1 --2- 172.21.15.146:0/3590104990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48680d05c0 0x7f48680d0a40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4850009910 tx=0x7f48500091a0 comp rx=0 tx=0).stop 2023-10-06T11:06:28.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.705+0000 7f4867fff700 1 -- 172.21.15.146:0/3590104990 shutdown_connections 2023-10-06T11:06:28.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.705+0000 7f4867fff700 1 --2- 172.21.15.146:0/3590104990 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f486815b0d0 0x7f486815b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:28.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.705+0000 7f4867fff700 1 --2- 172.21.15.146:0/3590104990 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48680d05c0 0x7f48680d0a40 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:28.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.705+0000 7f4867fff700 1 -- 172.21.15.146:0/3590104990 >> 172.21.15.146:0/3590104990 conn(0x7f486806eba0 msgr2=0x7f486806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:28.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.705+0000 7f4867fff700 1 -- 172.21.15.146:0/3590104990 shutdown_connections 2023-10-06T11:06:28.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.705+0000 7f4867fff700 1 -- 172.21.15.146:0/3590104990 wait complete. 2023-10-06T11:06:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.707+0000 7f4867fff700 1 Processor -- start 2023-10-06T11:06:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.707+0000 7f4867fff700 1 -- start start 2023-10-06T11:06:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.707+0000 7f4867fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f48680d05c0 0x7f4868153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.707+0000 7f4867fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48681572f0 0x7f48680b1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.707+0000 7f4867fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f486815b0d0 0x7f4868158ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.707+0000 7f4867fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48680c63a0 con 0x7f48681572f0 2023-10-06T11:06:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.707+0000 7f4867fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4868153840 con 0x7f486815b0d0 2023-10-06T11:06:28.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.707+0000 7f4867fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48680b2210 con 0x7f48680d05c0 2023-10-06T11:06:28.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.707+0000 7f485e7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48681572f0 0x7f48680b1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:28.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.707+0000 7f485e7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48681572f0 0x7f48680b1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34904/0 (socket says 172.21.15.146:34904) 2023-10-06T11:06:28.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.707+0000 7f485e7fc700 1 -- 172.21.15.146:0/845484265 learned_addr learned my addr 172.21.15.146:0/845484265 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:28.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.708+0000 7f48677fe700 1 --2- 172.21.15.146:0/845484265 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f486815b0d0 0x7f4868158ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:28.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.708+0000 7f4866ffd700 1 --2- 172.21.15.146:0/845484265 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f48680d05c0 0x7f4868153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:28.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.708+0000 7f485e7fc700 1 -- 172.21.15.146:0/845484265 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f48680d05c0 msgr2=0x7f4868153300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:28.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.708+0000 7f485e7fc700 1 --2- 172.21.15.146:0/845484265 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f48680d05c0 0x7f4868153300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:28.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.708+0000 7f485e7fc700 1 -- 172.21.15.146:0/845484265 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f486815b0d0 msgr2=0x7f4868158ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:28.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.708+0000 7f485e7fc700 1 --2- 172.21.15.146:0/845484265 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f486815b0d0 0x7f4868158ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:28.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.708+0000 7f485e7fc700 1 -- 172.21.15.146:0/845484265 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4850009420 con 0x7f48681572f0 2023-10-06T11:06:28.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.708+0000 7f48677fe700 1 --2- 172.21.15.146:0/845484265 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f486815b0d0 0x7f4868158ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:06:28.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.708+0000 7f485e7fc700 1 --2- 172.21.15.146:0/845484265 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48681572f0 0x7f48680b1cd0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f485000b3c0 tx=0x7f4850017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:28.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.708+0000 7f485f7fe700 1 -- 172.21.15.146:0/845484265 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4850024440 con 0x7f48681572f0 2023-10-06T11:06:28.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.708+0000 7f485f7fe700 1 -- 172.21.15.146:0/845484265 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48500245c0 con 0x7f48681572f0 2023-10-06T11:06:28.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.708+0000 7f4867fff700 1 -- 172.21.15.146:0/845484265 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48680c6e50 con 0x7f48681572f0 2023-10-06T11:06:28.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.708+0000 7f485f7fe700 1 -- 172.21.15.146:0/845484265 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4850024980 con 0x7f48681572f0 2023-10-06T11:06:28.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.708+0000 7f4867fff700 1 -- 172.21.15.146:0/845484265 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48680c5a70 con 0x7f48681572f0 2023-10-06T11:06:28.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.709+0000 7f4867fff700 1 -- 172.21.15.146:0/845484265 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4868088d50 con 0x7f48681572f0 2023-10-06T11:06:28.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.709+0000 7f485f7fe700 1 -- 172.21.15.146:0/845484265 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f485001a420 con 0x7f48681572f0 2023-10-06T11:06:28.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.710+0000 7f485f7fe700 1 --2- 172.21.15.146:0/845484265 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4848066f30 0x7f48480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:28.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.710+0000 7f485f7fe700 1 -- 172.21.15.146:0/845484265 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f4850086250 con 0x7f48681572f0 2023-10-06T11:06:28.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.710+0000 7f4866ffd700 1 --2- 172.21.15.146:0/845484265 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4848066f30 0x7f48480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:28.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.710+0000 7f4866ffd700 1 --2- 172.21.15.146:0/845484265 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4848066f30 0x7f48480693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4858001360 tx=0x7f4858009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:28.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.714+0000 7f485f7fe700 1 -- 172.21.15.146:0/845484265 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f48500536e0 con 0x7f48681572f0 2023-10-06T11:06:28.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:28.923+0000 7f4867fff700 1 -- 172.21.15.146:0/845484265 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f48680c64e0 con 0x7f48681572f0 2023-10-06T11:06:29.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.523+0000 7f485f7fe700 1 -- 172.21.15.146:0/845484265 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v25) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4850056d00 con 0x7f48681572f0 2023-10-06T11:06:29.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.526+0000 7f4867fff700 1 -- 172.21.15.146:0/845484265 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4848066f30 msgr2=0x7f48480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:29.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.526+0000 7f4867fff700 1 --2- 172.21.15.146:0/845484265 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4848066f30 0x7f48480693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4858001360 tx=0x7f4858009040 comp rx=0 tx=0).stop 2023-10-06T11:06:29.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.526+0000 7f4867fff700 1 -- 172.21.15.146:0/845484265 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48681572f0 msgr2=0x7f48680b1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:29.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.526+0000 7f4867fff700 1 --2- 172.21.15.146:0/845484265 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48681572f0 0x7f48680b1cd0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f485000b3c0 tx=0x7f4850017000 comp rx=0 tx=0).stop 2023-10-06T11:06:29.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.526+0000 7f4867fff700 1 -- 172.21.15.146:0/845484265 shutdown_connections 2023-10-06T11:06:29.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.526+0000 7f4867fff700 1 --2- 172.21.15.146:0/845484265 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4848066f30 0x7f48480693e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:29.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.526+0000 7f4867fff700 1 --2- 172.21.15.146:0/845484265 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f486815b0d0 0x7f4868158ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:29.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.526+0000 7f4867fff700 1 --2- 172.21.15.146:0/845484265 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f48680d05c0 0x7f4868153300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:29.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.526+0000 7f4867fff700 1 --2- 172.21.15.146:0/845484265 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48681572f0 0x7f48680b1cd0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:29.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.526+0000 7f4867fff700 1 -- 172.21.15.146:0/845484265 >> 172.21.15.146:0/845484265 conn(0x7f486806eba0 msgr2=0x7f4868154270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:29.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.526+0000 7f4867fff700 1 -- 172.21.15.146:0/845484265 shutdown_connections 2023-10-06T11:06:29.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.526+0000 7f4867fff700 1 -- 172.21.15.146:0/845484265 wait complete. 2023-10-06T11:06:29.529 INFO:teuthology.orchestra.run.smithi146.stderr: removed all blocklist entries 2023-10-06T11:06:29.541 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T11:06:29.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.655+0000 7fbb03fff700 1 Processor -- start 2023-10-06T11:06:29.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.655+0000 7fbb03fff700 1 -- start start 2023-10-06T11:06:29.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.656+0000 7fbb03fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb0413c390 0x7fbb0415da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:29.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.656+0000 7fbb03fff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbb04159c20 0x7fbb0415a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:29.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.656+0000 7fbb03fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb0406c5a0 con 0x7fbb040cbe30 2023-10-06T11:06:29.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.656+0000 7fbb03fff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb0415dfb0 con 0x7fbb04159c20 2023-10-06T11:06:29.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.656+0000 7fbb03fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0406b6b0 con 0x7fbb0413c390 2023-10-06T11:06:29.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.656+0000 7fbafa7fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fbb040cbe30 0x7fbb040cc2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40956/0 (socket says 172.21.15.146:40956) 2023-10-06T11:06:29.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.656+0000 7fbafa7fc700 1 -- 172.21.15.146:0/3019047099 learned_addr learned my addr 172.21.15.146:0/3019047099 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:29.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.656+0000 7fbb037fe700 1 --2- 172.21.15.146:0/3019047099 >> v2:172.21.15.151:3300/0 conn(0x7fbb04159c20 0x7fbb0415a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:29.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.656+0000 7fbb027fc700 1 -- 172.21.15.146:0/3019047099 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1725984522 0 0) 0x7fbb0406c5a0 con 0x7fbb040cbe30 2023-10-06T11:06:29.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.656+0000 7fbb027fc700 1 -- 172.21.15.146:0/3019047099 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbaf0003570 con 0x7fbb040cbe30 2023-10-06T11:06:29.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.656+0000 7fbb02ffd700 1 --2- 172.21.15.146:0/3019047099 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb0413c390 0x7fbb0415da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:29.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.657+0000 7fbb027fc700 1 -- 172.21.15.146:0/3019047099 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 498182439 0 0) 0x7fbaf0003570 con 0x7fbb040cbe30 2023-10-06T11:06:29.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.657+0000 7fbb027fc700 1 -- 172.21.15.146:0/3019047099 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb0413c390 msgr2=0x7fbb0415da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:29.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.657+0000 7fbb027fc700 1 --2- 172.21.15.146:0/3019047099 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb0413c390 0x7fbb0415da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:29.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.657+0000 7fbb027fc700 1 -- 172.21.15.146:0/3019047099 >> v2:172.21.15.151:3300/0 conn(0x7fbb04159c20 msgr2=0x7fbb0415a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:29.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.657+0000 7fbb027fc700 1 --2- 172.21.15.146:0/3019047099 >> v2:172.21.15.151:3300/0 conn(0x7fbb04159c20 0x7fbb0415a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:29.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.657+0000 7fbb027fc700 1 -- 172.21.15.146:0/3019047099 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0406b990 con 0x7fbb040cbe30 2023-10-06T11:06:29.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.657+0000 7fbb027fc700 1 -- 172.21.15.146:0/3019047099 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fbaec001470 con 0x7fbb040cbe30 2023-10-06T11:06:29.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.657+0000 7fbb027fc700 1 -- 172.21.15.146:0/3019047099 >> v1:172.21.15.146:6789/0 conn(0x7fbb040cbe30 legacy=0x7fbb040cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:29.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.657+0000 7fbb027fc700 1 --2- 172.21.15.146:0/3019047099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbaf0003a60 0x7fbaf0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:29.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.657+0000 7fbb027fc700 1 --2- 172.21.15.146:0/3019047099 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbaf0004810 0x7fbaf0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:29.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.657+0000 7fbb027fc700 1 --2- 172.21.15.146:0/3019047099 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb0413c390 0x7fbaf00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:29.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.657+0000 7fbb027fc700 1 -- 172.21.15.146:0/3019047099 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0415dfb0 con 0x7fbaf0003a60 2023-10-06T11:06:29.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.657+0000 7fbb027fc700 1 -- 172.21.15.146:0/3019047099 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0406b6b0 con 0x7fbaf0004810 2023-10-06T11:06:29.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.657+0000 7fbb027fc700 1 -- 172.21.15.146:0/3019047099 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaf000ba60 con 0x7fbb0413c390 2023-10-06T11:06:29.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.657+0000 7fbb02ffd700 1 --2- 172.21.15.146:0/3019047099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbaf0003a60 0x7fbaf0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:29.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.657+0000 7fbafa7fc700 1 --2- 172.21.15.146:0/3019047099 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbaf0004810 0x7fbaf0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:29.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.657+0000 7fbb037fe700 1 --2- 172.21.15.146:0/3019047099 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb0413c390 0x7fbaf00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:29.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.657+0000 7fbb02ffd700 1 -- 172.21.15.146:0/3019047099 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb0413c390 msgr2=0x7fbaf00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:29.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.657+0000 7fbb02ffd700 1 --2- 172.21.15.146:0/3019047099 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb0413c390 0x7fbaf00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:29.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.657+0000 7fbb02ffd700 1 -- 172.21.15.146:0/3019047099 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbaf0004810 msgr2=0x7fbaf0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:29.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.657+0000 7fbb02ffd700 1 --2- 172.21.15.146:0/3019047099 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbaf0004810 0x7fbaf0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:29.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.657+0000 7fbb02ffd700 1 -- 172.21.15.146:0/3019047099 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf0003570 con 0x7fbaf0003a60 2023-10-06T11:06:29.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.657+0000 7fbafa7fc700 1 --2- 172.21.15.146:0/3019047099 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbaf0004810 0x7fbaf0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:06:29.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.657+0000 7fbb037fe700 1 --2- 172.21.15.146:0/3019047099 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb0413c390 0x7fbaf00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:06:29.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.657+0000 7fbb02ffd700 1 --2- 172.21.15.146:0/3019047099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbaf0003a60 0x7fbaf0003e70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4009c20 tx=0x7fbaf4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4230e7a628d52d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:29.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.657+0000 7fbb027fc700 1 -- 172.21.15.146:0/3019047099 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf4005a00 con 0x7fbaf0003a60 2023-10-06T11:06:29.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.657+0000 7fbb027fc700 1 -- 172.21.15.146:0/3019047099 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf4005b60 con 0x7fbaf0003a60 2023-10-06T11:06:29.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.657+0000 7fbb027fc700 1 -- 172.21.15.146:0/3019047099 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf400e710 con 0x7fbaf0003a60 2023-10-06T11:06:29.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.658+0000 7fbb03fff700 1 -- 172.21.15.146:0/3019047099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbaf0003a60 msgr2=0x7fbaf0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:29.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.658+0000 7fbb03fff700 1 --2- 172.21.15.146:0/3019047099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbaf0003a60 0x7fbaf0003e70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4009c20 tx=0x7fbaf4009120 comp rx=0 tx=0).stop 2023-10-06T11:06:29.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.658+0000 7fbb037fe700 1 -- 172.21.15.146:0/3019047099 reap_dead start 2023-10-06T11:06:29.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.658+0000 7fbb03fff700 1 -- 172.21.15.146:0/3019047099 shutdown_connections 2023-10-06T11:06:29.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.658+0000 7fbb03fff700 1 -- 172.21.15.146:0/3019047099 >> 172.21.15.146:0/3019047099 conn(0x7fbb040ce260 msgr2=0x7fbb040ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:29.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.658+0000 7fbb03fff700 1 -- 172.21.15.146:0/3019047099 shutdown_connections 2023-10-06T11:06:29.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.658+0000 7fbb03fff700 1 -- 172.21.15.146:0/3019047099 wait complete. 2023-10-06T11:06:29.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.659+0000 7fbb03fff700 1 Processor -- start 2023-10-06T11:06:29.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.659+0000 7fbb03fff700 1 -- start start 2023-10-06T11:06:29.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.660+0000 7fbb03fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbaf0003a60 0x7fbb040b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:29.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.660+0000 7fbb03fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb040aeea0 0x7fbb04153400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:29.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.660+0000 7fbb03fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb040af310 0x7fbb0416d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:29.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.660+0000 7fbb03fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0416e270 con 0x7fbb040aeea0 2023-10-06T11:06:29.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.660+0000 7fbb03fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb040aea10 con 0x7fbaf0003a60 2023-10-06T11:06:29.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.660+0000 7fbb03fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb040adb20 con 0x7fbb040af310 2023-10-06T11:06:29.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.660+0000 7fbafa7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb040aeea0 0x7fbb04153400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:29.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.660+0000 7fbafa7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb040aeea0 0x7fbb04153400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34910/0 (socket says 172.21.15.146:34910) 2023-10-06T11:06:29.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.660+0000 7fbafa7fc700 1 -- 172.21.15.146:0/3115278801 learned_addr learned my addr 172.21.15.146:0/3115278801 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:29.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.660+0000 7fbb037fe700 1 --2- 172.21.15.146:0/3115278801 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb040af310 0x7fbb0416d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:29.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.660+0000 7fbb02ffd700 1 --2- 172.21.15.146:0/3115278801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbaf0003a60 0x7fbb040b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:29.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.661+0000 7fbafa7fc700 1 -- 172.21.15.146:0/3115278801 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb040af310 msgr2=0x7fbb0416d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:29.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.661+0000 7fbafa7fc700 1 --2- 172.21.15.146:0/3115278801 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb040af310 0x7fbb0416d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:29.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.661+0000 7fbafa7fc700 1 -- 172.21.15.146:0/3115278801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbaf0003a60 msgr2=0x7fbb040b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:29.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.661+0000 7fbafa7fc700 1 --2- 172.21.15.146:0/3115278801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbaf0003a60 0x7fbb040b34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:29.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.661+0000 7fbafa7fc700 1 -- 172.21.15.146:0/3115278801 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb040ade00 con 0x7fbb040aeea0 2023-10-06T11:06:29.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.661+0000 7fbafa7fc700 1 --2- 172.21.15.146:0/3115278801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb040aeea0 0x7fbb04153400 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fbaec001ed0 tx=0x7fbaec001570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:29.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.661+0000 7fbafb7fe700 1 -- 172.21.15.146:0/3115278801 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaec00ee70 con 0x7fbb040aeea0 2023-10-06T11:06:29.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.661+0000 7fbb03fff700 1 -- 172.21.15.146:0/3115278801 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb040ae0e0 con 0x7fbb040aeea0 2023-10-06T11:06:29.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.661+0000 7fbb03fff700 1 -- 172.21.15.146:0/3115278801 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb040ae6a0 con 0x7fbb040aeea0 2023-10-06T11:06:29.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.661+0000 7fbafb7fe700 1 -- 172.21.15.146:0/3115278801 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaec00c6d0 con 0x7fbb040aeea0 2023-10-06T11:06:29.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.661+0000 7fbafb7fe700 1 -- 172.21.15.146:0/3115278801 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaec00ca50 con 0x7fbb040aeea0 2023-10-06T11:06:29.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.662+0000 7fbb03fff700 1 -- 172.21.15.146:0/3115278801 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbae80052b0 con 0x7fbb040aeea0 2023-10-06T11:06:29.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.663+0000 7fbafb7fe700 1 -- 172.21.15.146:0/3115278801 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbaec01d460 con 0x7fbb040aeea0 2023-10-06T11:06:29.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.663+0000 7fbafb7fe700 1 --2- 172.21.15.146:0/3115278801 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbae4066f30 0x7fbae40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:29.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.664+0000 7fbb02ffd700 1 --2- 172.21.15.146:0/3115278801 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbae4066f30 0x7fbae40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:29.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.664+0000 7fbafb7fe700 1 -- 172.21.15.146:0/3115278801 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fbaec084310 con 0x7fbb040aeea0 2023-10-06T11:06:29.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.664+0000 7fbb02ffd700 1 --2- 172.21.15.146:0/3115278801 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbae4066f30 0x7fbae40693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4009160 tx=0x7fbaf4019000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:29.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.668+0000 7fbafb7fe700 1 -- 172.21.15.146:0/3115278801 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbaec0516d0 con 0x7fbb040aeea0 2023-10-06T11:06:29.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.926+0000 7fbb03fff700 1 -- 172.21.15.146:0/3115278801 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fbae8005560 con 0x7fbb040aeea0 2023-10-06T11:06:29.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.927+0000 7fbafb7fe700 1 -- 172.21.15.146:0/3115278801 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fbaec054cf0 con 0x7fbb040aeea0 2023-10-06T11:06:29.929 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:06:29.929 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:06:29.929 INFO:teuthology.orchestra.run.smithi146.stdout: "auth_dump": [ 2023-10-06T11:06:29.929 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:06:29.929 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.a", 2023-10-06T11:06:29.929 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lG4F8DBAAp5A4Dtfzvv8n9ORgkmiP9g==", 2023-10-06T11:06:29.929 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:06:29.929 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:06:29.929 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:06:29.929 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:06:29.930 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:06:29.930 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:06:29.930 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:06:29.930 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:06:29.930 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.b", 2023-10-06T11:06:29.930 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lDIceGBAA4cr0oGVaXiy5hrruKY5DGw==", 2023-10-06T11:06:29.930 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:06:29.930 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:06:29.930 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:06:29.930 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:06:29.930 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:06:29.931 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:06:29.931 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:06:29.931 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:06:29.931 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.c", 2023-10-06T11:06:29.931 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lbYA7ExAAAopKjS7+WMUE5fuVQygILQ==", 2023-10-06T11:06:29.931 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:06:29.931 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:06:29.931 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:06:29.931 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:06:29.931 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:06:29.931 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:06:29.931 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:06:29.932 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:06:29.932 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.d", 2023-10-06T11:06:29.932 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9laygiHxAAasUUn7Wk9EwLa36ggsZtHw==", 2023-10-06T11:06:29.932 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:06:29.932 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:06:29.932 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:06:29.932 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:06:29.932 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:06:29.932 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:06:29.932 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:06:29.932 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:06:29.932 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.0", 2023-10-06T11:06:29.933 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDX6R9lLGo9NhAAcWJuUeOdEUsdDw84W9nLPw==", 2023-10-06T11:06:29.933 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:06:29.933 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:06:29.933 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:06:29.933 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:06:29.933 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:06:29.933 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:06:29.933 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:06:29.933 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.1", 2023-10-06T11:06:29.933 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDa6R9lk02gNBAA9YqWT2/Xds20lv0sGtBApg==", 2023-10-06T11:06:29.933 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:06:29.933 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:06:29.934 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:06:29.934 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:06:29.934 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:06:29.934 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:06:29.934 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:06:29.934 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.2", 2023-10-06T11:06:29.934 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDd6R9lrA6xMxAAmH8r6m2p4Jpa82xfYNcq+g==", 2023-10-06T11:06:29.934 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:06:29.934 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:06:29.934 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:06:29.934 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:06:29.934 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:06:29.935 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:06:29.935 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:06:29.935 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.3", 2023-10-06T11:06:29.935 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDg6R9ltlHXNBAAvhfI1yjlaWCIE9Xr/4F/PA==", 2023-10-06T11:06:29.935 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:06:29.935 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:06:29.935 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:06:29.935 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:06:29.935 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:06:29.936 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:06:29.936 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:06:29.936 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.4", 2023-10-06T11:06:29.936 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDm6R9lPUCvMhAAGbUNfpoFi9SvYdelpnL1jA==", 2023-10-06T11:06:29.936 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:06:29.936 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:06:29.936 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:06:29.936 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:06:29.936 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:06:29.936 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:06:29.937 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:06:29.937 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.5", 2023-10-06T11:06:29.937 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDp6R9lMfrMMBAAUEtnXDNr7+L3dQm4QE9qDw==", 2023-10-06T11:06:29.937 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:06:29.937 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:06:29.937 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:06:29.937 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:06:29.937 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:06:29.937 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:06:29.938 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:06:29.938 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.6", 2023-10-06T11:06:29.938 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDs6R9lAmSDMBAArPp+6dVt/NyH9is46tL49g==", 2023-10-06T11:06:29.938 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:06:29.938 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:06:29.938 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:06:29.938 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:06:29.938 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:06:29.938 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:06:29.938 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:06:29.938 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.7", 2023-10-06T11:06:29.939 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDv6R9lnunMLRAA3o5ZtAyYDUoXTzjX9H8FCw==", 2023-10-06T11:06:29.939 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:06:29.939 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:06:29.939 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:06:29.939 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:06:29.939 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:06:29.939 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:06:29.939 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:06:29.939 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.0", 2023-10-06T11:06:29.939 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lCrPrIhAARrzj2VxVFkzF5L/ifIAqmw==", 2023-10-06T11:06:29.940 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:06:29.940 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:06:29.940 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2023-10-06T11:06:29.940 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2023-10-06T11:06:29.940 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2023-10-06T11:06:29.940 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:06:29.940 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:06:29.941 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:06:29.941 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.1", 2023-10-06T11:06:29.941 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9l10VSKxAA0HmXejgRRCQ7XpsMB7ljkQ==", 2023-10-06T11:06:29.941 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:06:29.941 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:06:29.941 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2023-10-06T11:06:29.942 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2023-10-06T11:06:29.942 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2023-10-06T11:06:29.942 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:06:29.942 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:06:29.942 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:06:29.942 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.2", 2023-10-06T11:06:29.943 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lpLpJKBAAF/vLDkBg9/VBqMK4pVVIkg==", 2023-10-06T11:06:29.943 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:06:29.943 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:06:29.943 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2023-10-06T11:06:29.943 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2023-10-06T11:06:29.944 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2023-10-06T11:06:29.944 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:06:29.944 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:06:29.944 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:06:29.944 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.3", 2023-10-06T11:06:29.944 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9luMqwMBAA4Y4I9hWTk2IqAzYwVQ13Pw==", 2023-10-06T11:06:29.945 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:06:29.945 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:06:29.945 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2023-10-06T11:06:29.945 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2023-10-06T11:06:29.945 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2023-10-06T11:06:29.946 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:06:29.946 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:06:29.946 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:06:29.946 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.admin", 2023-10-06T11:06:29.946 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDT6R9lSr9qIhAAiNEN9xFWUwFGsB+oUE1cXw==", 2023-10-06T11:06:29.946 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:06:29.947 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2023-10-06T11:06:29.947 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:06:29.947 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:06:29.947 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:06:29.947 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:06:29.948 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:06:29.948 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:06:29.948 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.bootstrap-mds", 2023-10-06T11:06:29.948 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQD16R9loUgxIBAAB3X1MIG7wDRFDHEm43z/gA==", 2023-10-06T11:06:29.948 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:06:29.948 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile bootstrap-mds" 2023-10-06T11:06:29.949 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:06:29.949 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:06:29.949 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:06:29.949 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.bootstrap-mgr", 2023-10-06T11:06:29.949 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQD16R9l1lIxIBAAeyHOx53Q5CPTgVkVMu3AAQ==", 2023-10-06T11:06:29.950 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:06:29.950 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-06T11:06:29.950 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:06:29.950 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:06:29.950 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:06:29.950 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.bootstrap-osd", 2023-10-06T11:06:29.950 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQD16R9ltVoxIBAA+BUPpe47ZrTxb63w49+hig==", 2023-10-06T11:06:29.950 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:06:29.950 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile bootstrap-osd" 2023-10-06T11:06:29.951 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:06:29.951 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:06:29.951 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:06:29.951 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.bootstrap-rbd", 2023-10-06T11:06:29.951 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQD16R9lo2ExIBAAT4IvlaoW/kSHffUXWbP8Dg==", 2023-10-06T11:06:29.951 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:06:29.951 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-06T11:06:29.951 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:06:29.951 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:06:29.951 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:06:29.952 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-06T11:06:29.952 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQD16R9lv2gxIBAAJoZw5EHufpJ8WAczbmntYQ==", 2023-10-06T11:06:29.952 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:06:29.952 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-06T11:06:29.952 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:06:29.952 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:06:29.952 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:06:29.952 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.bootstrap-rgw", 2023-10-06T11:06:29.952 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQD16R9lPHAxIBAAiwLM82HTLXNAJkF+oQxvlw==", 2023-10-06T11:06:29.952 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:06:29.952 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-06T11:06:29.953 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:06:29.953 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:06:29.953 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:06:29.953 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.x", 2023-10-06T11:06:29.953 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9llLpwCRAA4UH9Uqli2de9HIJR2fZ9xg==", 2023-10-06T11:06:29.953 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:06:29.953 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2023-10-06T11:06:29.953 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2023-10-06T11:06:29.953 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:06:29.953 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:06:29.953 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:06:29.953 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:06:29.954 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.y", 2023-10-06T11:06:29.954 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDT6R9l2uQxNxAAVSMhKVzbf2vC4opL7YCLdg==", 2023-10-06T11:06:29.954 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:06:29.954 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2023-10-06T11:06:29.954 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2023-10-06T11:06:29.954 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:06:29.954 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:06:29.954 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:06:29.954 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2023-10-06T11:06:29.954 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:06:29.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.929+0000 7fbb03fff700 1 -- 172.21.15.146:0/3115278801 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbae4066f30 msgr2=0x7fbae40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:29.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.929+0000 7fbb03fff700 1 --2- 172.21.15.146:0/3115278801 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbae4066f30 0x7fbae40693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fbaf4009160 tx=0x7fbaf4019000 comp rx=0 tx=0).stop 2023-10-06T11:06:29.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.929+0000 7fbb03fff700 1 -- 172.21.15.146:0/3115278801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb040aeea0 msgr2=0x7fbb04153400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:29.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.929+0000 7fbb03fff700 1 --2- 172.21.15.146:0/3115278801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb040aeea0 0x7fbb04153400 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fbaec001ed0 tx=0x7fbaec001570 comp rx=0 tx=0).stop 2023-10-06T11:06:29.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.929+0000 7fbb03fff700 1 -- 172.21.15.146:0/3115278801 shutdown_connections 2023-10-06T11:06:29.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.929+0000 7fbb03fff700 1 --2- 172.21.15.146:0/3115278801 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbae4066f30 0x7fbae40693e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:29.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.929+0000 7fbb03fff700 1 --2- 172.21.15.146:0/3115278801 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb040af310 0x7fbb0416d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:29.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.929+0000 7fbb03fff700 1 --2- 172.21.15.146:0/3115278801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbaf0003a60 0x7fbb040b34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:29.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.929+0000 7fbb03fff700 1 --2- 172.21.15.146:0/3115278801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb040aeea0 0x7fbb04153400 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:29.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.929+0000 7fbb03fff700 1 -- 172.21.15.146:0/3115278801 >> 172.21.15.146:0/3115278801 conn(0x7fbb040ce260 msgr2=0x7fbb040c45d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:29.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.929+0000 7fbb03fff700 1 -- 172.21.15.146:0/3115278801 shutdown_connections 2023-10-06T11:06:29.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:29.929+0000 7fbb03fff700 1 -- 172.21.15.146:0/3115278801 wait complete. 2023-10-06T11:06:29.959 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-06T11:06:30.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.073+0000 7f43da9d9700 1 Processor -- start 2023-10-06T11:06:30.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.073+0000 7f43da9d9700 1 -- start start 2023-10-06T11:06:30.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.074+0000 7f43da9d9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f43d415a160 0x7f43d40c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:30.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.074+0000 7f43da9d9700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f43d40cb950 0x7f43d40cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:30.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.074+0000 7f43da9d9700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d40ae2a0 con 0x7f43d40ae730 2023-10-06T11:06:30.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.074+0000 7f43da9d9700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43d415a530 con 0x7f43d415a160 2023-10-06T11:06:30.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.074+0000 7f43da9d9700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43d40ad690 con 0x7f43d40cb950 2023-10-06T11:06:30.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.074+0000 7f43d3fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f43d415a160 0x7f43d40c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:30.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.074+0000 7f43d37fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f43d40ae730 0x7f43d40aebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40972/0 (socket says 172.21.15.146:40972) 2023-10-06T11:06:30.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.074+0000 7f43d37fe700 1 -- 172.21.15.146:0/3314685982 learned_addr learned my addr 172.21.15.146:0/3314685982 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:30.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.074+0000 7f43d8f76700 1 --2- 172.21.15.146:0/3314685982 >> v2:172.21.15.151:3300/0 conn(0x7f43d40cb950 0x7f43d40cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:30.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.074+0000 7f43d3fff700 1 -- 172.21.15.146:0/3314685982 >> v2:172.21.15.151:3300/0 conn(0x7f43d40cb950 msgr2=0x7f43d40cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:30.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.074+0000 7f43d3fff700 1 --2- 172.21.15.146:0/3314685982 >> v2:172.21.15.151:3300/0 conn(0x7f43d40cb950 0x7f43d40cbd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:30.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.074+0000 7f43d3fff700 1 -- 172.21.15.146:0/3314685982 >> v1:172.21.15.146:6789/0 conn(0x7f43d40ae730 legacy=0x7f43d40aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:30.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.074+0000 7f43d3fff700 1 -- 172.21.15.146:0/3314685982 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d40ad970 con 0x7f43d415a160 2023-10-06T11:06:30.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.074+0000 7f43d2ffd700 1 -- 172.21.15.146:0/3314685982 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2719668551 0 0) 0x7f43d40ae2a0 con 0x7f43d40ae730 2023-10-06T11:06:30.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.074+0000 7f43d3fff700 1 --2- 172.21.15.146:0/3314685982 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43d415a160 0x7f43d40c55a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f43d40890e0 tx=0x7f43c4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77c0e67c53b61892 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:30.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.075+0000 7f43d2ffd700 1 -- 172.21.15.146:0/3314685982 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c4005c10 con 0x7f43d415a160 2023-10-06T11:06:30.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.075+0000 7f43d2ffd700 1 -- 172.21.15.146:0/3314685982 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c4005d70 con 0x7f43d415a160 2023-10-06T11:06:30.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.075+0000 7f43d2ffd700 1 -- 172.21.15.146:0/3314685982 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c4006260 con 0x7f43d415a160 2023-10-06T11:06:30.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.075+0000 7f43da9d9700 1 -- 172.21.15.146:0/3314685982 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43d415a160 msgr2=0x7f43d40c55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:30.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.075+0000 7f43da9d9700 1 --2- 172.21.15.146:0/3314685982 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43d415a160 0x7f43d40c55a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f43d40890e0 tx=0x7f43c4009120 comp rx=0 tx=0).stop 2023-10-06T11:06:30.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.075+0000 7f43da9d9700 1 -- 172.21.15.146:0/3314685982 shutdown_connections 2023-10-06T11:06:30.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.075+0000 7f43da9d9700 1 --2- 172.21.15.146:0/3314685982 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43d415a160 0x7f43d40c55a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:30.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.075+0000 7f43da9d9700 1 --2- 172.21.15.146:0/3314685982 >> v2:172.21.15.151:3300/0 conn(0x7f43d40cb950 0x7f43d40cbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:30.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.075+0000 7f43da9d9700 1 -- 172.21.15.146:0/3314685982 >> 172.21.15.146:0/3314685982 conn(0x7f43d406f380 msgr2=0x7f43d40d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:30.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.075+0000 7f43da9d9700 1 -- 172.21.15.146:0/3314685982 shutdown_connections 2023-10-06T11:06:30.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.075+0000 7f43da9d9700 1 -- 172.21.15.146:0/3314685982 wait complete. 2023-10-06T11:06:30.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.076+0000 7f43da9d9700 1 Processor -- start 2023-10-06T11:06:30.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.076+0000 7f43da9d9700 1 -- start start 2023-10-06T11:06:30.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.077+0000 7f43da9d9700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43d40ae730 0x7f43d416b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:30.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.077+0000 7f43da9d9700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43d40cb950 0x7f43d4155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:30.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.077+0000 7f43da9d9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43d415a160 0x7f43d40b58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:30.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.077+0000 7f43da9d9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d416b580 con 0x7f43d415a160 2023-10-06T11:06:30.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.077+0000 7f43da9d9700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d41557a0 con 0x7f43d40cb950 2023-10-06T11:06:30.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.077+0000 7f43da9d9700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d414fb20 con 0x7f43d40ae730 2023-10-06T11:06:30.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.077+0000 7f43d8f76700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43d415a160 0x7f43d40b58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:30.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.077+0000 7f43d8f76700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43d415a160 0x7f43d40b58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34928/0 (socket says 172.21.15.146:34928) 2023-10-06T11:06:30.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.077+0000 7f43d8f76700 1 -- 172.21.15.146:0/247460672 learned_addr learned my addr 172.21.15.146:0/247460672 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:30.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.077+0000 7f43d3fff700 1 --2- 172.21.15.146:0/247460672 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43d40ae730 0x7f43d416b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:30.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.077+0000 7f43d37fe700 1 --2- 172.21.15.146:0/247460672 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43d40cb950 0x7f43d4155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:30.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.078+0000 7f43d8f76700 1 -- 172.21.15.146:0/247460672 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43d40ae730 msgr2=0x7f43d416b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:30.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.078+0000 7f43d8f76700 1 --2- 172.21.15.146:0/247460672 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43d40ae730 0x7f43d416b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:30.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.078+0000 7f43d8f76700 1 -- 172.21.15.146:0/247460672 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43d40cb950 msgr2=0x7f43d4155c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:30.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.078+0000 7f43d8f76700 1 --2- 172.21.15.146:0/247460672 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43d40cb950 0x7f43d4155c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:30.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.078+0000 7f43d8f76700 1 -- 172.21.15.146:0/247460672 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c40093c0 con 0x7f43d415a160 2023-10-06T11:06:30.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.078+0000 7f43d8f76700 1 --2- 172.21.15.146:0/247460672 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43d415a160 0x7f43d40b58e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f43cc009ec0 tx=0x7f43cc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:30.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.078+0000 7f43bbfff700 1 -- 172.21.15.146:0/247460672 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc00cb70 con 0x7f43d415a160 2023-10-06T11:06:30.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.078+0000 7f43bbfff700 1 -- 172.21.15.146:0/247460672 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43cc00f040 con 0x7f43d415a160 2023-10-06T11:06:30.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.078+0000 7f43da9d9700 1 -- 172.21.15.146:0/247460672 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43d4154b90 con 0x7f43d415a160 2023-10-06T11:06:30.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.078+0000 7f43bbfff700 1 -- 172.21.15.146:0/247460672 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc014480 con 0x7f43d415a160 2023-10-06T11:06:30.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.078+0000 7f43da9d9700 1 -- 172.21.15.146:0/247460672 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d4155150 con 0x7f43d415a160 2023-10-06T11:06:30.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.079+0000 7f43da9d9700 1 -- 172.21.15.146:0/247460672 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43d4068390 con 0x7f43d415a160 2023-10-06T11:06:30.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.079+0000 7f43bbfff700 1 -- 172.21.15.146:0/247460672 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f43cc014830 con 0x7f43d415a160 2023-10-06T11:06:30.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.080+0000 7f43bbfff700 1 --2- 172.21.15.146:0/247460672 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f43c0066f30 0x7f43c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:30.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.080+0000 7f43bbfff700 1 -- 172.21.15.146:0/247460672 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f43cc084f00 con 0x7f43d415a160 2023-10-06T11:06:30.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.080+0000 7f43d3fff700 1 --2- 172.21.15.146:0/247460672 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f43c0066f30 0x7f43c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:30.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.080+0000 7f43d3fff700 1 --2- 172.21.15.146:0/247460672 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f43c0066f30 0x7f43c00693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f43c4009160 tx=0x7f43c4016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:30.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.084+0000 7f43bbfff700 1 -- 172.21.15.146:0/247460672 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f43cc052360 con 0x7f43d415a160 2023-10-06T11:06:30.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.345+0000 7f43da9d9700 1 -- 172.21.15.146:0/247460672 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f43d4155930 con 0x7f43d415a160 2023-10-06T11:06:30.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.350+0000 7f43bbfff700 1 -- 172.21.15.146:0/247460672 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f43cc055980 con 0x7f43d415a160 2023-10-06T11:06:30.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.352+0000 7f43da9d9700 1 -- 172.21.15.146:0/247460672 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f43c0066f30 msgr2=0x7f43c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:30.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.352+0000 7f43da9d9700 1 --2- 172.21.15.146:0/247460672 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f43c0066f30 0x7f43c00693e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f43c4009160 tx=0x7f43c4016000 comp rx=0 tx=0).stop 2023-10-06T11:06:30.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.352+0000 7f43da9d9700 1 -- 172.21.15.146:0/247460672 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43d415a160 msgr2=0x7f43d40b58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:30.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.352+0000 7f43da9d9700 1 --2- 172.21.15.146:0/247460672 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43d415a160 0x7f43d40b58e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f43cc009ec0 tx=0x7f43cc00b040 comp rx=0 tx=0).stop 2023-10-06T11:06:30.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.352+0000 7f43da9d9700 1 -- 172.21.15.146:0/247460672 shutdown_connections 2023-10-06T11:06:30.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.352+0000 7f43da9d9700 1 --2- 172.21.15.146:0/247460672 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f43c0066f30 0x7f43c00693e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:30.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.352+0000 7f43da9d9700 1 --2- 172.21.15.146:0/247460672 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43d415a160 0x7f43d40b58e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:30.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.352+0000 7f43da9d9700 1 --2- 172.21.15.146:0/247460672 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43d40ae730 0x7f43d416b040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:30.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.352+0000 7f43da9d9700 1 --2- 172.21.15.146:0/247460672 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43d40cb950 0x7f43d4155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:30.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.352+0000 7f43da9d9700 1 -- 172.21.15.146:0/247460672 >> 172.21.15.146:0/247460672 conn(0x7f43d406f380 msgr2=0x7f43d40cbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:30.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.352+0000 7f43da9d9700 1 -- 172.21.15.146:0/247460672 shutdown_connections 2023-10-06T11:06:30.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.352+0000 7f43da9d9700 1 -- 172.21.15.146:0/247460672 wait complete. 2023-10-06T11:06:30.365 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-06T11:06:30.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.479+0000 7f2da6e9a700 1 Processor -- start 2023-10-06T11:06:30.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.480+0000 7f2da6e9a700 1 -- start start 2023-10-06T11:06:30.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.480+0000 7f2da6e9a700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2da00ae730 0x7f2da00aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:30.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.480+0000 7f2da6e9a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2da00cb950 0x7f2da00cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:30.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.480+0000 7f2da6e9a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2da00ae2a0 con 0x7f2da015a160 2023-10-06T11:06:30.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.480+0000 7f2da6e9a700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2da015a530 con 0x7f2da00ae730 2023-10-06T11:06:30.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.480+0000 7f2da6e9a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da00c5cb0 con 0x7f2da00cb950 2023-10-06T11:06:30.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.480+0000 7f2da4c36700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2da015a160 0x7f2da00c55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40974/0 (socket says 172.21.15.146:40974) 2023-10-06T11:06:30.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.480+0000 7f2da4c36700 1 -- 172.21.15.146:0/392954775 learned_addr learned my addr 172.21.15.146:0/392954775 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:30.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.481+0000 7f2d977fe700 1 -- 172.21.15.146:0/392954775 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 420880988 0 0) 0x7f2da00ae2a0 con 0x7f2da015a160 2023-10-06T11:06:30.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.481+0000 7f2d977fe700 1 -- 172.21.15.146:0/392954775 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d88003570 con 0x7f2da015a160 2023-10-06T11:06:30.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.481+0000 7f2da5437700 1 --2- 172.21.15.146:0/392954775 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2da00cb950 0x7f2da00cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:30.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.481+0000 7f2d97fff700 1 --2- 172.21.15.146:0/392954775 >> v2:172.21.15.151:3300/0 conn(0x7f2da00ae730 0x7f2da00aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:30.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.481+0000 7f2d977fe700 1 -- 172.21.15.146:0/392954775 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2599594110 0 0) 0x7f2d88003570 con 0x7f2da015a160 2023-10-06T11:06:30.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.481+0000 7f2d977fe700 1 -- 172.21.15.146:0/392954775 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2da00cb950 msgr2=0x7f2da00cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:30.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.481+0000 7f2d977fe700 1 --2- 172.21.15.146:0/392954775 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2da00cb950 0x7f2da00cbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:30.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.481+0000 7f2d977fe700 1 -- 172.21.15.146:0/392954775 >> v2:172.21.15.151:3300/0 conn(0x7f2da00ae730 msgr2=0x7f2da00aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:30.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.481+0000 7f2d977fe700 1 --2- 172.21.15.146:0/392954775 >> v2:172.21.15.151:3300/0 conn(0x7f2da00ae730 0x7f2da00aebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:30.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.481+0000 7f2d977fe700 1 -- 172.21.15.146:0/392954775 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da00af0f0 con 0x7f2da015a160 2023-10-06T11:06:30.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.481+0000 7f2d977fe700 1 -- 172.21.15.146:0/392954775 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f2d9c001970 con 0x7f2da015a160 2023-10-06T11:06:30.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.481+0000 7f2d977fe700 1 -- 172.21.15.146:0/392954775 >> v1:172.21.15.146:6789/0 conn(0x7f2da015a160 legacy=0x7f2da00c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:30.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.481+0000 7f2d977fe700 1 --2- 172.21.15.146:0/392954775 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2da00cb950 0x7f2d88003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:30.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.481+0000 7f2d977fe700 1 --2- 172.21.15.146:0/392954775 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d88003fe0 0x7f2d88004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:30.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.481+0000 7f2d977fe700 1 --2- 172.21.15.146:0/392954775 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d88004d50 0x7f2d880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:30.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.481+0000 7f2d977fe700 1 -- 172.21.15.146:0/392954775 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da015a530 con 0x7f2d88004d50 2023-10-06T11:06:30.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.481+0000 7f2d977fe700 1 -- 172.21.15.146:0/392954775 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da00c5cb0 con 0x7f2d88003fe0 2023-10-06T11:06:30.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.481+0000 7f2d977fe700 1 -- 172.21.15.146:0/392954775 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d8800ba90 con 0x7f2da00cb950 2023-10-06T11:06:30.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.481+0000 7f2da5437700 1 --2- 172.21.15.146:0/392954775 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d88004d50 0x7f2d880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:30.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.481+0000 7f2da4c36700 1 --2- 172.21.15.146:0/392954775 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2da00cb950 0x7f2d88003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:30.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.481+0000 7f2d97fff700 1 --2- 172.21.15.146:0/392954775 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d88003fe0 0x7f2d88004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:30.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.482+0000 7f2da5437700 1 -- 172.21.15.146:0/392954775 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2da00cb950 msgr2=0x7f2d88003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:30.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.482+0000 7f2da5437700 1 --2- 172.21.15.146:0/392954775 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2da00cb950 0x7f2d88003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:30.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.482+0000 7f2da5437700 1 -- 172.21.15.146:0/392954775 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d88003fe0 msgr2=0x7f2d88004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:30.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.482+0000 7f2da5437700 1 --2- 172.21.15.146:0/392954775 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d88003fe0 0x7f2d88004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:30.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.482+0000 7f2da5437700 1 -- 172.21.15.146:0/392954775 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d88003570 con 0x7f2d88004d50 2023-10-06T11:06:30.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.482+0000 7f2da5437700 1 --2- 172.21.15.146:0/392954775 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d88004d50 0x7f2d880051c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2d98009c00 tx=0x7f2d980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f537a8b8dd713e25 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:30.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.482+0000 7f2d977fe700 1 -- 172.21.15.146:0/392954775 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9800e6b0 con 0x7f2d88004d50 2023-10-06T11:06:30.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.482+0000 7f2d977fe700 1 -- 172.21.15.146:0/392954775 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9800e810 con 0x7f2d88004d50 2023-10-06T11:06:30.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.482+0000 7f2d977fe700 1 -- 172.21.15.146:0/392954775 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9800ebd0 con 0x7f2d88004d50 2023-10-06T11:06:30.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.482+0000 7f2da6e9a700 1 -- 172.21.15.146:0/392954775 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d88004d50 msgr2=0x7f2d880051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:30.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.482+0000 7f2da6e9a700 1 --2- 172.21.15.146:0/392954775 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d88004d50 0x7f2d880051c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f2d98009c00 tx=0x7f2d980091a0 comp rx=0 tx=0).stop 2023-10-06T11:06:30.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.482+0000 7f2da5437700 1 -- 172.21.15.146:0/392954775 reap_dead start 2023-10-06T11:06:30.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.482+0000 7f2da6e9a700 1 -- 172.21.15.146:0/392954775 shutdown_connections 2023-10-06T11:06:30.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.482+0000 7f2da6e9a700 1 -- 172.21.15.146:0/392954775 >> 172.21.15.146:0/392954775 conn(0x7f2da006f380 msgr2=0x7f2da00d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:30.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.482+0000 7f2da6e9a700 1 -- 172.21.15.146:0/392954775 shutdown_connections 2023-10-06T11:06:30.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.482+0000 7f2da6e9a700 1 -- 172.21.15.146:0/392954775 wait complete. 2023-10-06T11:06:30.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.483+0000 7f2da6e9a700 1 Processor -- start 2023-10-06T11:06:30.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.484+0000 7f2da6e9a700 1 -- start start 2023-10-06T11:06:30.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.484+0000 7f2da6e9a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2da014e730 0x7f2da00b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:30.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.484+0000 7f2da6e9a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2da014eb00 0x7f2da00b5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:30.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.484+0000 7f2da6e9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2da00cd640 0x7f2da00cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:30.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.484+0000 7f2da6e9a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da00b6460 con 0x7f2da014e730 2023-10-06T11:06:30.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.484+0000 7f2da6e9a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2da00cdff0 con 0x7f2da00cd640 2023-10-06T11:06:30.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.484+0000 7f2da6e9a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2da00b55d0 con 0x7f2da014eb00 2023-10-06T11:06:30.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.484+0000 7f2da4c36700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2da014e730 0x7f2da00b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:30.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.484+0000 7f2da4c36700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2da014e730 0x7f2da00b36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34944/0 (socket says 172.21.15.146:34944) 2023-10-06T11:06:30.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.484+0000 7f2da4c36700 1 -- 172.21.15.146:0/1800278181 learned_addr learned my addr 172.21.15.146:0/1800278181 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:30.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.485+0000 7f2da5437700 1 --2- 172.21.15.146:0/1800278181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2da00cd640 0x7f2da00cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:30.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.485+0000 7f2d97fff700 1 --2- 172.21.15.146:0/1800278181 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2da014eb00 0x7f2da00b5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:30.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.485+0000 7f2da4c36700 1 -- 172.21.15.146:0/1800278181 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2da014eb00 msgr2=0x7f2da00b5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:30.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.485+0000 7f2da4c36700 1 --2- 172.21.15.146:0/1800278181 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2da014eb00 0x7f2da00b5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:30.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.485+0000 7f2da4c36700 1 -- 172.21.15.146:0/1800278181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2da00cd640 msgr2=0x7f2da00cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:30.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.485+0000 7f2da4c36700 1 --2- 172.21.15.146:0/1800278181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2da00cd640 0x7f2da00cdab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:30.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.485+0000 7f2da4c36700 1 -- 172.21.15.146:0/1800278181 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da00b5850 con 0x7f2da014e730 2023-10-06T11:06:30.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.485+0000 7f2da4c36700 1 --2- 172.21.15.146:0/1800278181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2da014e730 0x7f2da00b36f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c007db0 tx=0x7f2d9c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:30.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.485+0000 7f2d94ff9700 1 -- 172.21.15.146:0/1800278181 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c005e50 con 0x7f2da014e730 2023-10-06T11:06:30.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.485+0000 7f2d94ff9700 1 -- 172.21.15.146:0/1800278181 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9c00d920 con 0x7f2da014e730 2023-10-06T11:06:30.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.485+0000 7f2da6e9a700 1 -- 172.21.15.146:0/1800278181 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2da00b5b30 con 0x7f2da014e730 2023-10-06T11:06:30.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.485+0000 7f2d94ff9700 1 -- 172.21.15.146:0/1800278181 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c00dce0 con 0x7f2da014e730 2023-10-06T11:06:30.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.485+0000 7f2da6e9a700 1 -- 172.21.15.146:0/1800278181 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2da00b60f0 con 0x7f2da014e730 2023-10-06T11:06:30.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.486+0000 7f2da6e9a700 1 -- 172.21.15.146:0/1800278181 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2da0068390 con 0x7f2da014e730 2023-10-06T11:06:30.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.487+0000 7f2d94ff9700 1 -- 172.21.15.146:0/1800278181 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2d9c0072e0 con 0x7f2da014e730 2023-10-06T11:06:30.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.487+0000 7f2d94ff9700 1 --2- 172.21.15.146:0/1800278181 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2d8c066f60 0x7f2d8c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:30.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.487+0000 7f2d94ff9700 1 -- 172.21.15.146:0/1800278181 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f2d9c0848d0 con 0x7f2da014e730 2023-10-06T11:06:30.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.487+0000 7f2d97fff700 1 --2- 172.21.15.146:0/1800278181 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2d8c066f60 0x7f2d8c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:30.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.487+0000 7f2d97fff700 1 --2- 172.21.15.146:0/1800278181 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2d8c066f60 0x7f2d8c069410 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2da00ce210 tx=0x7f2d900091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:30.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.491+0000 7f2d94ff9700 1 -- 172.21.15.146:0/1800278181 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d9c051d30 con 0x7f2da014e730 2023-10-06T11:06:30.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.754+0000 7f2da6e9a700 1 -- 172.21.15.146:0/1800278181 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f2da004c380 con 0x7f2da014e730 2023-10-06T11:06:30.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.760+0000 7f2d94ff9700 1 -- 172.21.15.146:0/1800278181 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2d9c055350 con 0x7f2da014e730 2023-10-06T11:06:30.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.762+0000 7f2da6e9a700 1 -- 172.21.15.146:0/1800278181 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2d8c066f60 msgr2=0x7f2d8c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:30.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.762+0000 7f2da6e9a700 1 --2- 172.21.15.146:0/1800278181 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2d8c066f60 0x7f2d8c069410 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2da00ce210 tx=0x7f2d900091a0 comp rx=0 tx=0).stop 2023-10-06T11:06:30.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.762+0000 7f2da6e9a700 1 -- 172.21.15.146:0/1800278181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2da014e730 msgr2=0x7f2da00b36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:30.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.762+0000 7f2da6e9a700 1 --2- 172.21.15.146:0/1800278181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2da014e730 0x7f2da00b36f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c007db0 tx=0x7f2d9c009040 comp rx=0 tx=0).stop 2023-10-06T11:06:30.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.762+0000 7f2da6e9a700 1 -- 172.21.15.146:0/1800278181 shutdown_connections 2023-10-06T11:06:30.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.762+0000 7f2da6e9a700 1 --2- 172.21.15.146:0/1800278181 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2d8c066f60 0x7f2d8c069410 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:30.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.762+0000 7f2da6e9a700 1 --2- 172.21.15.146:0/1800278181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2da00cd640 0x7f2da00cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:30.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.762+0000 7f2da6e9a700 1 --2- 172.21.15.146:0/1800278181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2da014e730 0x7f2da00b36f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:30.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.762+0000 7f2da6e9a700 1 --2- 172.21.15.146:0/1800278181 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2da014eb00 0x7f2da00b5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:30.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.762+0000 7f2da6e9a700 1 -- 172.21.15.146:0/1800278181 >> 172.21.15.146:0/1800278181 conn(0x7f2da006f380 msgr2=0x7f2da0068550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:30.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.762+0000 7f2da6e9a700 1 -- 172.21.15.146:0/1800278181 shutdown_connections 2023-10-06T11:06:30.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.762+0000 7f2da6e9a700 1 -- 172.21.15.146:0/1800278181 wait complete. 2023-10-06T11:06:30.776 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-06T11:06:30.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.890+0000 7fe35869a700 1 Processor -- start 2023-10-06T11:06:30.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.890+0000 7fe35869a700 1 -- start start 2023-10-06T11:06:30.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.891+0000 7fe35869a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe35015a160 0x7fe3500c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:30.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.891+0000 7fe35869a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3500ae2a0 con 0x7fe3500cb950 2023-10-06T11:06:30.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.891+0000 7fe35869a700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe35015a530 con 0x7fe3500ae730 2023-10-06T11:06:30.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.891+0000 7fe35869a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3500ad690 con 0x7fe35015a160 2023-10-06T11:06:30.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.891+0000 7fe356c37700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe3500cb950 0x7fe3500cbdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40982/0 (socket says 172.21.15.146:40982) 2023-10-06T11:06:30.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.891+0000 7fe356c37700 1 -- 172.21.15.146:0/3881754520 learned_addr learned my addr 172.21.15.146:0/3881754520 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:30.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.891+0000 7fe356436700 1 --2- 172.21.15.146:0/3881754520 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe35015a160 0x7fe3500c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:30.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.891+0000 7fe355434700 1 -- 172.21.15.146:0/3881754520 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1490803074 0 0) 0x7fe3500ae2a0 con 0x7fe3500cb950 2023-10-06T11:06:30.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.891+0000 7fe355434700 1 -- 172.21.15.146:0/3881754520 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe338003570 con 0x7fe3500cb950 2023-10-06T11:06:30.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.891+0000 7fe355434700 1 -- 172.21.15.146:0/3881754520 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3831830912 0 0) 0x7fe35015a530 con 0x7fe3500ae730 2023-10-06T11:06:30.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.891+0000 7fe355434700 1 -- 172.21.15.146:0/3881754520 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3500ae2a0 con 0x7fe3500ae730 2023-10-06T11:06:30.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.891+0000 7fe356436700 1 -- 172.21.15.146:0/3881754520 >> v1:172.21.15.151:6789/0 conn(0x7fe3500ae730 legacy=0x7fe3500aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:30.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.891+0000 7fe355434700 1 -- 172.21.15.146:0/3881754520 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3375329338 0 0) 0x7fe338003570 con 0x7fe3500cb950 2023-10-06T11:06:30.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.891+0000 7fe356436700 1 -- 172.21.15.146:0/3881754520 >> v1:172.21.15.146:6789/0 conn(0x7fe3500cb950 legacy=0x7fe3500cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:30.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.891+0000 7fe356436700 1 -- 172.21.15.146:0/3881754520 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3500ad970 con 0x7fe35015a160 2023-10-06T11:06:30.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.892+0000 7fe356436700 1 --2- 172.21.15.146:0/3881754520 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe35015a160 0x7fe3500c55a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe348009ee0 tx=0x7fe348009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f46b220c796809f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:30.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.892+0000 7fe355434700 1 -- 172.21.15.146:0/3881754520 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34800e070 con 0x7fe35015a160 2023-10-06T11:06:30.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.892+0000 7fe355434700 1 -- 172.21.15.146:0/3881754520 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34800bb80 con 0x7fe35015a160 2023-10-06T11:06:30.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.892+0000 7fe355434700 1 -- 172.21.15.146:0/3881754520 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe348012430 con 0x7fe35015a160 2023-10-06T11:06:30.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.892+0000 7fe35869a700 1 -- 172.21.15.146:0/3881754520 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe35015a160 msgr2=0x7fe3500c55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:30.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.892+0000 7fe35869a700 1 --2- 172.21.15.146:0/3881754520 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe35015a160 0x7fe3500c55a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe348009ee0 tx=0x7fe348009780 comp rx=0 tx=0).stop 2023-10-06T11:06:30.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.892+0000 7fe35869a700 1 -- 172.21.15.146:0/3881754520 shutdown_connections 2023-10-06T11:06:30.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.892+0000 7fe35869a700 1 --2- 172.21.15.146:0/3881754520 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe35015a160 0x7fe3500c55a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:30.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.892+0000 7fe35869a700 1 -- 172.21.15.146:0/3881754520 >> 172.21.15.146:0/3881754520 conn(0x7fe35006f380 msgr2=0x7fe3500d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:30.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.892+0000 7fe35869a700 1 -- 172.21.15.146:0/3881754520 shutdown_connections 2023-10-06T11:06:30.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.892+0000 7fe35869a700 1 -- 172.21.15.146:0/3881754520 wait complete. 2023-10-06T11:06:30.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.893+0000 7fe35869a700 1 Processor -- start 2023-10-06T11:06:30.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.893+0000 7fe35869a700 1 -- start start 2023-10-06T11:06:30.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.894+0000 7fe35869a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3500ae730 0x7fe3500c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:30.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.894+0000 7fe35869a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3500cb950 0x7fe3500b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:30.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.894+0000 7fe35869a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe35015a160 0x7fe3500b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:30.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.894+0000 7fe35869a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3500ca720 con 0x7fe3500cb950 2023-10-06T11:06:30.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.894+0000 7fe35869a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3500c9410 con 0x7fe3500ae730 2023-10-06T11:06:30.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.894+0000 7fe35869a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3500c8a40 con 0x7fe35015a160 2023-10-06T11:06:30.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.894+0000 7fe355c35700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3500cb950 0x7fe3500b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:30.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.894+0000 7fe355c35700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3500cb950 0x7fe3500b35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34956/0 (socket says 172.21.15.146:34956) 2023-10-06T11:06:30.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.894+0000 7fe355c35700 1 -- 172.21.15.146:0/4238321369 learned_addr learned my addr 172.21.15.146:0/4238321369 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:30.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.894+0000 7fe356c37700 1 --2- 172.21.15.146:0/4238321369 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe35015a160 0x7fe3500b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:30.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.894+0000 7fe356436700 1 --2- 172.21.15.146:0/4238321369 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3500ae730 0x7fe3500c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:30.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.895+0000 7fe355c35700 1 -- 172.21.15.146:0/4238321369 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe35015a160 msgr2=0x7fe3500b3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:30.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.895+0000 7fe355c35700 1 --2- 172.21.15.146:0/4238321369 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe35015a160 0x7fe3500b3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:30.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.895+0000 7fe355c35700 1 -- 172.21.15.146:0/4238321369 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3500ae730 msgr2=0x7fe3500c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:30.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.895+0000 7fe355c35700 1 --2- 172.21.15.146:0/4238321369 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3500ae730 0x7fe3500c8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:30.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.895+0000 7fe355c35700 1 -- 172.21.15.146:0/4238321369 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe348009a20 con 0x7fe3500cb950 2023-10-06T11:06:30.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.895+0000 7fe356c37700 1 --2- 172.21.15.146:0/4238321369 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe35015a160 0x7fe3500b3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:06:30.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.895+0000 7fe356436700 1 --2- 172.21.15.146:0/4238321369 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3500ae730 0x7fe3500c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:06:30.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.895+0000 7fe355c35700 1 --2- 172.21.15.146:0/4238321369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3500cb950 0x7fe3500b35a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe34400c5b0 tx=0x7fe344007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:30.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.895+0000 7fe34e7fc700 1 -- 172.21.15.146:0/4238321369 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe344010510 con 0x7fe3500cb950 2023-10-06T11:06:30.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.895+0000 7fe34e7fc700 1 -- 172.21.15.146:0/4238321369 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe344010670 con 0x7fe3500cb950 2023-10-06T11:06:30.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.895+0000 7fe35869a700 1 -- 172.21.15.146:0/4238321369 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe350157490 con 0x7fe3500cb950 2023-10-06T11:06:30.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.895+0000 7fe34e7fc700 1 -- 172.21.15.146:0/4238321369 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe344010a30 con 0x7fe3500cb950 2023-10-06T11:06:30.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.895+0000 7fe35869a700 1 -- 172.21.15.146:0/4238321369 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3500c83f0 con 0x7fe3500cb950 2023-10-06T11:06:30.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.896+0000 7fe35869a700 1 -- 172.21.15.146:0/4238321369 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe350068b60 con 0x7fe3500cb950 2023-10-06T11:06:30.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.896+0000 7fe34e7fc700 1 -- 172.21.15.146:0/4238321369 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe34401b400 con 0x7fe3500cb950 2023-10-06T11:06:30.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.897+0000 7fe34e7fc700 1 --2- 172.21.15.146:0/4238321369 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe33c066f30 0x7fe33c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:30.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.897+0000 7fe356436700 1 --2- 172.21.15.146:0/4238321369 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe33c066f30 0x7fe33c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:30.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.897+0000 7fe34e7fc700 1 -- 172.21.15.146:0/4238321369 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fe344083fd0 con 0x7fe3500cb950 2023-10-06T11:06:30.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.897+0000 7fe356436700 1 --2- 172.21.15.146:0/4238321369 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe33c066f30 0x7fe33c0693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe348009e30 tx=0x7fe348019000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:30.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:30.901+0000 7fe34e7fc700 1 -- 172.21.15.146:0/4238321369 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe344051430 con 0x7fe3500cb950 2023-10-06T11:06:31.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.160+0000 7fe35869a700 1 -- 172.21.15.146:0/4238321369 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fe35004c380 con 0x7fe3500cb950 2023-10-06T11:06:31.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.165+0000 7fe34e7fc700 1 -- 172.21.15.146:0/4238321369 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe344054a50 con 0x7fe3500cb950 2023-10-06T11:06:31.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.167+0000 7fe35869a700 1 -- 172.21.15.146:0/4238321369 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe33c066f30 msgr2=0x7fe33c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:31.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.167+0000 7fe35869a700 1 --2- 172.21.15.146:0/4238321369 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe33c066f30 0x7fe33c0693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe348009e30 tx=0x7fe348019000 comp rx=0 tx=0).stop 2023-10-06T11:06:31.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.167+0000 7fe35869a700 1 -- 172.21.15.146:0/4238321369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3500cb950 msgr2=0x7fe3500b35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:31.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.167+0000 7fe35869a700 1 --2- 172.21.15.146:0/4238321369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3500cb950 0x7fe3500b35a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe34400c5b0 tx=0x7fe344007e10 comp rx=0 tx=0).stop 2023-10-06T11:06:31.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.167+0000 7fe35869a700 1 -- 172.21.15.146:0/4238321369 shutdown_connections 2023-10-06T11:06:31.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.167+0000 7fe35869a700 1 --2- 172.21.15.146:0/4238321369 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe33c066f30 0x7fe33c0693e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:31.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.167+0000 7fe35869a700 1 --2- 172.21.15.146:0/4238321369 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe35015a160 0x7fe3500b3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:31.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.167+0000 7fe35869a700 1 --2- 172.21.15.146:0/4238321369 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3500ae730 0x7fe3500c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:31.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.168+0000 7fe35869a700 1 --2- 172.21.15.146:0/4238321369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3500cb950 0x7fe3500b35a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:31.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.168+0000 7fe35869a700 1 -- 172.21.15.146:0/4238321369 >> 172.21.15.146:0/4238321369 conn(0x7fe35006f380 msgr2=0x7fe350159620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:31.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.168+0000 7fe35869a700 1 -- 172.21.15.146:0/4238321369 shutdown_connections 2023-10-06T11:06:31.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.168+0000 7fe35869a700 1 -- 172.21.15.146:0/4238321369 wait complete. 2023-10-06T11:06:31.181 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-06T11:06:31.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.295+0000 7fc798851700 1 Processor -- start 2023-10-06T11:06:31.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.295+0000 7fc798851700 1 -- start start 2023-10-06T11:06:31.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.296+0000 7fc798851700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc79406eda0 0x7fc7940b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:31.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.296+0000 7fc798851700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc79415e4c0 con 0x7fc794067a90 2023-10-06T11:06:31.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.296+0000 7fc798851700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc79415a840 con 0x7fc7940676c0 2023-10-06T11:06:31.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.296+0000 7fc798851700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc79415ab20 con 0x7fc79406eda0 2023-10-06T11:06:31.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.296+0000 7fc791d9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc794067a90 0x7fc79406e690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40990/0 (socket says 172.21.15.146:40990) 2023-10-06T11:06:31.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.296+0000 7fc791d9b700 1 -- 172.21.15.146:0/1466566438 learned_addr learned my addr 172.21.15.146:0/1466566438 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:31.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.297+0000 7fc79159a700 1 -- 172.21.15.146:0/1466566438 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2356489521 0 0) 0x7fc79415e4c0 con 0x7fc794067a90 2023-10-06T11:06:31.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.297+0000 7fc792d9d700 1 --2- 172.21.15.146:0/1466566438 >> v2:172.21.15.151:3300/0 conn(0x7fc79406eda0 0x7fc7940b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:31.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.297+0000 7fc79159a700 1 -- 172.21.15.146:0/1466566438 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc77c003570 con 0x7fc794067a90 2023-10-06T11:06:31.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.297+0000 7fc79159a700 1 -- 172.21.15.146:0/1466566438 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4024320486 0 0) 0x7fc77c003570 con 0x7fc794067a90 2023-10-06T11:06:31.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.297+0000 7fc79159a700 1 -- 172.21.15.146:0/1466566438 >> v2:172.21.15.151:3300/0 conn(0x7fc79406eda0 msgr2=0x7fc7940b0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:31.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.297+0000 7fc79159a700 1 --2- 172.21.15.146:0/1466566438 >> v2:172.21.15.151:3300/0 conn(0x7fc79406eda0 0x7fc7940b0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:31.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.297+0000 7fc79159a700 1 -- 172.21.15.146:0/1466566438 >> v1:172.21.15.151:6789/0 conn(0x7fc7940676c0 legacy=0x7fc79415ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:31.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.297+0000 7fc79159a700 1 -- 172.21.15.146:0/1466566438 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc79415ae00 con 0x7fc794067a90 2023-10-06T11:06:31.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.297+0000 7fc79159a700 1 -- 172.21.15.146:0/1466566438 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fc788001470 con 0x7fc794067a90 2023-10-06T11:06:31.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.297+0000 7fc792d9d700 1 --2- 172.21.15.146:0/1466566438 >> v2:172.21.15.151:3300/0 conn(0x7fc79406eda0 0x7fc7940b0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:06:31.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.297+0000 7fc79159a700 1 -- 172.21.15.146:0/1466566438 >> v1:172.21.15.146:6789/0 conn(0x7fc794067a90 legacy=0x7fc79406e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:31.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.297+0000 7fc79159a700 1 --2- 172.21.15.146:0/1466566438 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc77c003a60 0x7fc77c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:31.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.297+0000 7fc79159a700 1 --2- 172.21.15.146:0/1466566438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc77c004810 0x7fc77c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:31.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.297+0000 7fc79159a700 1 --2- 172.21.15.146:0/1466566438 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc77c0052e0 0x7fc77c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:31.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.297+0000 7fc79159a700 1 -- 172.21.15.146:0/1466566438 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79415ab20 con 0x7fc77c004810 2023-10-06T11:06:31.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.297+0000 7fc79159a700 1 -- 172.21.15.146:0/1466566438 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c00c190 con 0x7fc77c0052e0 2023-10-06T11:06:31.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.297+0000 7fc79159a700 1 -- 172.21.15.146:0/1466566438 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c00c350 con 0x7fc77c003a60 2023-10-06T11:06:31.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.297+0000 7fc791d9b700 1 --2- 172.21.15.146:0/1466566438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc77c004810 0x7fc77c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:31.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.297+0000 7fc792d9d700 1 --2- 172.21.15.146:0/1466566438 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc77c0052e0 0x7fc77c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:31.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.297+0000 7fc79259c700 1 --2- 172.21.15.146:0/1466566438 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc77c003a60 0x7fc77c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:31.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.297+0000 7fc791d9b700 1 -- 172.21.15.146:0/1466566438 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc77c003a60 msgr2=0x7fc77c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:31.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.297+0000 7fc791d9b700 1 --2- 172.21.15.146:0/1466566438 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc77c003a60 0x7fc77c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:31.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.297+0000 7fc791d9b700 1 -- 172.21.15.146:0/1466566438 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc77c0052e0 msgr2=0x7fc77c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:31.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.297+0000 7fc791d9b700 1 --2- 172.21.15.146:0/1466566438 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc77c0052e0 0x7fc77c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:31.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.297+0000 7fc792d9d700 1 -- 172.21.15.146:0/1466566438 reap_dead start 2023-10-06T11:06:31.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.298+0000 7fc791d9b700 1 -- 172.21.15.146:0/1466566438 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc77c003570 con 0x7fc77c004810 2023-10-06T11:06:31.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.298+0000 7fc791d9b700 1 --2- 172.21.15.146:0/1466566438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc77c004810 0x7fc77c004c80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc78800c3c0 tx=0x7fc788001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71aa3be577dd7dad server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:31.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.298+0000 7fc79159a700 1 -- 172.21.15.146:0/1466566438 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78800cc50 con 0x7fc77c004810 2023-10-06T11:06:31.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.298+0000 7fc79159a700 1 -- 172.21.15.146:0/1466566438 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc78800cdb0 con 0x7fc77c004810 2023-10-06T11:06:31.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.298+0000 7fc79159a700 1 -- 172.21.15.146:0/1466566438 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc788005b70 con 0x7fc77c004810 2023-10-06T11:06:31.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.298+0000 7fc798851700 1 -- 172.21.15.146:0/1466566438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc77c004810 msgr2=0x7fc77c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:31.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.298+0000 7fc798851700 1 --2- 172.21.15.146:0/1466566438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc77c004810 0x7fc77c004c80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc78800c3c0 tx=0x7fc788001e50 comp rx=0 tx=0).stop 2023-10-06T11:06:31.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.298+0000 7fc798851700 1 -- 172.21.15.146:0/1466566438 shutdown_connections 2023-10-06T11:06:31.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.298+0000 7fc798851700 1 --2- 172.21.15.146:0/1466566438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc77c004810 0x7fc77c004c80 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:31.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.298+0000 7fc798851700 1 -- 172.21.15.146:0/1466566438 >> 172.21.15.146:0/1466566438 conn(0x7fc794068580 msgr2=0x7fc794068980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:31.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.298+0000 7fc798851700 1 -- 172.21.15.146:0/1466566438 shutdown_connections 2023-10-06T11:06:31.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.298+0000 7fc798851700 1 -- 172.21.15.146:0/1466566438 wait complete. 2023-10-06T11:06:31.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.299+0000 7fc798851700 1 Processor -- start 2023-10-06T11:06:31.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.299+0000 7fc798851700 1 -- start start 2023-10-06T11:06:31.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.300+0000 7fc798851700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc77c004810 0x7fc7940ab360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:31.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.300+0000 7fc798851700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc794151f00 0x7fc794152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:31.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.300+0000 7fc798851700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc79416b3f0 0x7fc79416b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:31.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.300+0000 7fc798851700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79416d1f0 con 0x7fc79416b3f0 2023-10-06T11:06:31.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.300+0000 7fc798851700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7941528b0 con 0x7fc794151f00 2023-10-06T11:06:31.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.300+0000 7fc798851700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc79416cd60 con 0x7fc77c004810 2023-10-06T11:06:31.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.300+0000 7fc792d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc79416b3f0 0x7fc79416b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:31.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.300+0000 7fc792d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc79416b3f0 0x7fc79416b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34964/0 (socket says 172.21.15.146:34964) 2023-10-06T11:06:31.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.300+0000 7fc792d9d700 1 -- 172.21.15.146:0/2994025090 learned_addr learned my addr 172.21.15.146:0/2994025090 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:31.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.300+0000 7fc791d9b700 1 --2- 172.21.15.146:0/2994025090 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc794151f00 0x7fc794152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:31.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.300+0000 7fc79259c700 1 --2- 172.21.15.146:0/2994025090 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc77c004810 0x7fc7940ab360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:31.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.301+0000 7fc792d9d700 1 -- 172.21.15.146:0/2994025090 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc77c004810 msgr2=0x7fc7940ab360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:31.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.301+0000 7fc792d9d700 1 --2- 172.21.15.146:0/2994025090 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc77c004810 0x7fc7940ab360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:31.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.301+0000 7fc792d9d700 1 -- 172.21.15.146:0/2994025090 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc794151f00 msgr2=0x7fc794152370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:31.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.301+0000 7fc792d9d700 1 --2- 172.21.15.146:0/2994025090 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc794151f00 0x7fc794152370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:31.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.301+0000 7fc792d9d700 1 -- 172.21.15.146:0/2994025090 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7940ab8a0 con 0x7fc79416b3f0 2023-10-06T11:06:31.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.301+0000 7fc79259c700 1 --2- 172.21.15.146:0/2994025090 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc77c004810 0x7fc7940ab360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:06:31.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.301+0000 7fc792d9d700 1 --2- 172.21.15.146:0/2994025090 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc79416b3f0 0x7fc79416b860 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc79406f200 tx=0x7fc78c0097f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:31.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.301+0000 7fc7827fc700 1 -- 172.21.15.146:0/2994025090 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78c010b70 con 0x7fc79416b3f0 2023-10-06T11:06:31.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.301+0000 7fc7827fc700 1 -- 172.21.15.146:0/2994025090 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc78c010cf0 con 0x7fc79416b3f0 2023-10-06T11:06:31.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.301+0000 7fc798851700 1 -- 172.21.15.146:0/2994025090 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc79416c150 con 0x7fc79416b3f0 2023-10-06T11:06:31.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.301+0000 7fc7827fc700 1 -- 172.21.15.146:0/2994025090 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78c017680 con 0x7fc79416b3f0 2023-10-06T11:06:31.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.301+0000 7fc798851700 1 -- 172.21.15.146:0/2994025090 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc79416c710 con 0x7fc79416b3f0 2023-10-06T11:06:31.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.302+0000 7fc798851700 1 -- 172.21.15.146:0/2994025090 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc79416cef0 con 0x7fc79416b3f0 2023-10-06T11:06:31.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.302+0000 7fc7827fc700 1 -- 172.21.15.146:0/2994025090 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc78c017a70 con 0x7fc79416b3f0 2023-10-06T11:06:31.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.303+0000 7fc7827fc700 1 --2- 172.21.15.146:0/2994025090 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc774066f30 0x7fc7740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:31.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.303+0000 7fc7827fc700 1 -- 172.21.15.146:0/2994025090 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fc78c0851a0 con 0x7fc79416b3f0 2023-10-06T11:06:31.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.303+0000 7fc79259c700 1 --2- 172.21.15.146:0/2994025090 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc774066f30 0x7fc7740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:31.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.303+0000 7fc79259c700 1 --2- 172.21.15.146:0/2994025090 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc774066f30 0x7fc7740693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc7940af800 tx=0x7fc784009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:31.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.307+0000 7fc7827fc700 1 -- 172.21.15.146:0/2994025090 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc78c056090 con 0x7fc79416b3f0 2023-10-06T11:06:31.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.568+0000 7fc798851700 1 -- 172.21.15.146:0/2994025090 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fc79404c380 con 0x7fc79416b3f0 2023-10-06T11:06:31.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.572+0000 7fc7827fc700 1 -- 172.21.15.146:0/2994025090 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc78c055c20 con 0x7fc79416b3f0 2023-10-06T11:06:31.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.575+0000 7fc798851700 1 -- 172.21.15.146:0/2994025090 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc774066f30 msgr2=0x7fc7740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:31.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.575+0000 7fc798851700 1 --2- 172.21.15.146:0/2994025090 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc774066f30 0x7fc7740693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc7940af800 tx=0x7fc784009040 comp rx=0 tx=0).stop 2023-10-06T11:06:31.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.575+0000 7fc798851700 1 -- 172.21.15.146:0/2994025090 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc79416b3f0 msgr2=0x7fc79416b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:31.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.575+0000 7fc798851700 1 --2- 172.21.15.146:0/2994025090 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc79416b3f0 0x7fc79416b860 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc79406f200 tx=0x7fc78c0097f0 comp rx=0 tx=0).stop 2023-10-06T11:06:31.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.575+0000 7fc798851700 1 -- 172.21.15.146:0/2994025090 shutdown_connections 2023-10-06T11:06:31.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.575+0000 7fc798851700 1 --2- 172.21.15.146:0/2994025090 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc774066f30 0x7fc7740693e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:31.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.575+0000 7fc798851700 1 --2- 172.21.15.146:0/2994025090 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc79416b3f0 0x7fc79416b860 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:31.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.575+0000 7fc798851700 1 --2- 172.21.15.146:0/2994025090 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc77c004810 0x7fc7940ab360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:31.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.575+0000 7fc798851700 1 --2- 172.21.15.146:0/2994025090 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc794151f00 0x7fc794152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:31.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.575+0000 7fc798851700 1 -- 172.21.15.146:0/2994025090 >> 172.21.15.146:0/2994025090 conn(0x7fc794068580 msgr2=0x7fc7941550a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:31.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.575+0000 7fc798851700 1 -- 172.21.15.146:0/2994025090 shutdown_connections 2023-10-06T11:06:31.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.575+0000 7fc798851700 1 -- 172.21.15.146:0/2994025090 wait complete. 2023-10-06T11:06:31.588 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-06T11:06:31.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.703+0000 7f367bfff700 1 Processor -- start 2023-10-06T11:06:31.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.703+0000 7f367bfff700 1 -- start start 2023-10-06T11:06:31.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.704+0000 7f367bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f367c13fbc0 0x7f367c0c94f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:31.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.704+0000 7f367bfff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f367c0cbc30 con 0x7f367c0c8710 2023-10-06T11:06:31.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.704+0000 7f367bfff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f367c0cb020 con 0x7f367c0afec0 2023-10-06T11:06:31.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.704+0000 7f367bfff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f367c0c9a30 con 0x7f367c13fbc0 2023-10-06T11:06:31.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.704+0000 7f367affd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f367c13fbc0 0x7f367c0c94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:31.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.704+0000 7f36727fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f367c0c8710 0x7f367c0cc0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52300/0 (socket says 172.21.15.146:52300) 2023-10-06T11:06:31.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.704+0000 7f36727fc700 1 -- 172.21.15.146:0/3425954257 learned_addr learned my addr 172.21.15.146:0/3425954257 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:31.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.704+0000 7f367affd700 1 -- 172.21.15.146:0/3425954257 >> v1:172.21.15.151:6789/0 conn(0x7f367c0afec0 legacy=0x7f367c06a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:31.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.704+0000 7f367affd700 1 -- 172.21.15.146:0/3425954257 >> v1:172.21.15.146:6789/0 conn(0x7f367c0c8710 legacy=0x7f367c0cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:31.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.704+0000 7f367affd700 1 -- 172.21.15.146:0/3425954257 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f367c0cb300 con 0x7f367c13fbc0 2023-10-06T11:06:31.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.704+0000 7f367a7fc700 1 -- 172.21.15.146:0/3425954257 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1534147624 0 0) 0x7f367c0cbc30 con 0x7f367c0c8710 2023-10-06T11:06:31.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.705+0000 7f367affd700 1 --2- 172.21.15.146:0/3425954257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f367c13fbc0 0x7f367c0c94f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f366c0098e0 tx=0x7f366c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78a081ca80d1e803 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:31.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.705+0000 7f367a7fc700 1 -- 172.21.15.146:0/3425954257 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366c009e80 con 0x7f367c13fbc0 2023-10-06T11:06:31.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.705+0000 7f367a7fc700 1 -- 172.21.15.146:0/3425954257 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f366c00b820 con 0x7f367c13fbc0 2023-10-06T11:06:31.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.705+0000 7f367a7fc700 1 -- 172.21.15.146:0/3425954257 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366c00bba0 con 0x7f367c13fbc0 2023-10-06T11:06:31.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.705+0000 7f367bfff700 1 -- 172.21.15.146:0/3425954257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f367c13fbc0 msgr2=0x7f367c0c94f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:31.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.705+0000 7f367bfff700 1 --2- 172.21.15.146:0/3425954257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f367c13fbc0 0x7f367c0c94f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f366c0098e0 tx=0x7f366c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:06:31.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.705+0000 7f367bfff700 1 -- 172.21.15.146:0/3425954257 shutdown_connections 2023-10-06T11:06:31.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.705+0000 7f367bfff700 1 --2- 172.21.15.146:0/3425954257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f367c13fbc0 0x7f367c0c94f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:31.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.705+0000 7f367bfff700 1 -- 172.21.15.146:0/3425954257 >> 172.21.15.146:0/3425954257 conn(0x7f367c069010 msgr2=0x7f367c0cd100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:31.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.705+0000 7f367bfff700 1 -- 172.21.15.146:0/3425954257 shutdown_connections 2023-10-06T11:06:31.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.705+0000 7f367bfff700 1 -- 172.21.15.146:0/3425954257 wait complete. 2023-10-06T11:06:31.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.706+0000 7f367bfff700 1 Processor -- start 2023-10-06T11:06:31.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.706+0000 7f367bfff700 1 -- start start 2023-10-06T11:06:31.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.707+0000 7f367bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f367c0afec0 0x7f367c155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:31.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.707+0000 7f367bfff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f367c0c8710 0x7f367c0c5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:31.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.707+0000 7f367bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f367c13fbc0 0x7f367c0aeb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:31.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.707+0000 7f367bfff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f367c0c5180 con 0x7f367c13fbc0 2023-10-06T11:06:31.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.707+0000 7f367bfff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f367c0c4570 con 0x7f367c0afec0 2023-10-06T11:06:31.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.707+0000 7f367bfff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f367c0c4850 con 0x7f367c0c8710 2023-10-06T11:06:31.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.707+0000 7f367b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f367c13fbc0 0x7f367c0aeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:31.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.707+0000 7f367b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f367c13fbc0 0x7f367c0aeb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41706/0 (socket says 172.21.15.146:41706) 2023-10-06T11:06:31.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.707+0000 7f367b7fe700 1 -- 172.21.15.146:0/1352651528 learned_addr learned my addr 172.21.15.146:0/1352651528 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:31.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.707+0000 7f36727fc700 1 --2- 172.21.15.146:0/1352651528 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f367c0c8710 0x7f367c0c5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:31.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.707+0000 7f367affd700 1 --2- 172.21.15.146:0/1352651528 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f367c0afec0 0x7f367c155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:31.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.708+0000 7f367b7fe700 1 -- 172.21.15.146:0/1352651528 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f367c0c8710 msgr2=0x7f367c0c5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:31.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.708+0000 7f367b7fe700 1 --2- 172.21.15.146:0/1352651528 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f367c0c8710 0x7f367c0c5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:31.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.708+0000 7f367b7fe700 1 -- 172.21.15.146:0/1352651528 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f367c0afec0 msgr2=0x7f367c155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:31.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.708+0000 7f367b7fe700 1 --2- 172.21.15.146:0/1352651528 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f367c0afec0 0x7f367c155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:31.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.708+0000 7f367b7fe700 1 -- 172.21.15.146:0/1352651528 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f366c009420 con 0x7f367c13fbc0 2023-10-06T11:06:31.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.708+0000 7f367affd700 1 --2- 172.21.15.146:0/1352651528 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f367c0afec0 0x7f367c155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:06:31.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.708+0000 7f367b7fe700 1 --2- 172.21.15.146:0/1352651528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f367c13fbc0 0x7f367c0aeb90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f367400bbb0 tx=0x7f3674009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:31.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.708+0000 7f36737fe700 1 -- 172.21.15.146:0/1352651528 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36740092e0 con 0x7f367c13fbc0 2023-10-06T11:06:31.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.708+0000 7f36737fe700 1 -- 172.21.15.146:0/1352651528 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f367400c6f0 con 0x7f367c13fbc0 2023-10-06T11:06:31.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.708+0000 7f36737fe700 1 -- 172.21.15.146:0/1352651528 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f367400ca90 con 0x7f367c13fbc0 2023-10-06T11:06:31.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.708+0000 7f367bfff700 1 -- 172.21.15.146:0/1352651528 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f367c0c4b30 con 0x7f367c13fbc0 2023-10-06T11:06:31.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.708+0000 7f367bfff700 1 -- 172.21.15.146:0/1352651528 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f367c0c41b0 con 0x7f367c13fbc0 2023-10-06T11:06:31.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.709+0000 7f367bfff700 1 -- 172.21.15.146:0/1352651528 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f367c0c5330 con 0x7f367c13fbc0 2023-10-06T11:06:31.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.709+0000 7f36737fe700 1 -- 172.21.15.146:0/1352651528 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3674012070 con 0x7f367c13fbc0 2023-10-06T11:06:31.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.710+0000 7f36737fe700 1 --2- 172.21.15.146:0/1352651528 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f365c066f30 0x7f365c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:31.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.710+0000 7f36737fe700 1 -- 172.21.15.146:0/1352651528 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f3674083fa0 con 0x7f367c13fbc0 2023-10-06T11:06:31.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.710+0000 7f367affd700 1 --2- 172.21.15.146:0/1352651528 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f365c066f30 0x7f365c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:31.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.710+0000 7f367affd700 1 --2- 172.21.15.146:0/1352651528 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f365c066f30 0x7f365c0693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f366c0030c0 tx=0x7f366c016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:31.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.714+0000 7f36737fe700 1 -- 172.21.15.146:0/1352651528 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f367c0c5330 con 0x7f367c13fbc0 2023-10-06T11:06:31.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.972+0000 7f367bfff700 1 -- 172.21.15.146:0/1352651528 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f367c0c5330 con 0x7f367c13fbc0 2023-10-06T11:06:31.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.978+0000 7f36737fe700 1 -- 172.21.15.146:0/1352651528 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f367c0c5330 con 0x7f367c13fbc0 2023-10-06T11:06:31.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.980+0000 7f367bfff700 1 -- 172.21.15.146:0/1352651528 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f365c066f30 msgr2=0x7f365c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:31.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.980+0000 7f367bfff700 1 --2- 172.21.15.146:0/1352651528 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f365c066f30 0x7f365c0693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f366c0030c0 tx=0x7f366c016000 comp rx=0 tx=0).stop 2023-10-06T11:06:31.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.980+0000 7f367bfff700 1 -- 172.21.15.146:0/1352651528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f367c13fbc0 msgr2=0x7f367c0aeb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:31.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.980+0000 7f367bfff700 1 --2- 172.21.15.146:0/1352651528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f367c13fbc0 0x7f367c0aeb90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f367400bbb0 tx=0x7f3674009840 comp rx=0 tx=0).stop 2023-10-06T11:06:31.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.980+0000 7f367bfff700 1 -- 172.21.15.146:0/1352651528 shutdown_connections 2023-10-06T11:06:31.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.980+0000 7f367bfff700 1 --2- 172.21.15.146:0/1352651528 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f365c066f30 0x7f365c0693e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:31.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.980+0000 7f367bfff700 1 --2- 172.21.15.146:0/1352651528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f367c13fbc0 0x7f367c0aeb90 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:31.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.980+0000 7f367bfff700 1 --2- 172.21.15.146:0/1352651528 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f367c0afec0 0x7f367c155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:31.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.980+0000 7f367bfff700 1 --2- 172.21.15.146:0/1352651528 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f367c0c8710 0x7f367c0c5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:31.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.980+0000 7f367bfff700 1 -- 172.21.15.146:0/1352651528 >> 172.21.15.146:0/1352651528 conn(0x7f367c069010 msgr2=0x7f367c0cc0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:31.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.980+0000 7f367bfff700 1 -- 172.21.15.146:0/1352651528 shutdown_connections 2023-10-06T11:06:31.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:31.980+0000 7f367bfff700 1 -- 172.21.15.146:0/1352651528 wait complete. 2023-10-06T11:06:31.994 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-06T11:06:32.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.107+0000 7f72826e6700 1 Processor -- start 2023-10-06T11:06:32.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.107+0000 7f72826e6700 1 -- start start 2023-10-06T11:06:32.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.108+0000 7f72826e6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f727c0b2060 0x7f727c0ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:32.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.108+0000 7f72826e6700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f727c0b2430 0x7f727c0b5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:32.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.108+0000 7f72826e6700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f727c0b4ec0 con 0x7f727c0b3cf0 2023-10-06T11:06:32.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.108+0000 7f72826e6700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f727c0b42b0 con 0x7f727c0b2060 2023-10-06T11:06:32.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.108+0000 7f72826e6700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f727c0b4590 con 0x7f727c0b2430 2023-10-06T11:06:32.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.108+0000 7f72816e4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f727c0b2060 0x7f727c0ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:32.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.108+0000 7f72816e4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f727c0b2060 0x7f727c0ccd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41708/0 (socket says 172.21.15.146:41708) 2023-10-06T11:06:32.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.108+0000 7f72816e4700 1 -- 172.21.15.146:0/1189259763 learned_addr learned my addr 172.21.15.146:0/1189259763 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:32.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.108+0000 7f7281ee5700 1 --2- 172.21.15.146:0/1189259763 >> v2:172.21.15.151:3300/0 conn(0x7f727c0b2430 0x7f727c0b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:32.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.108+0000 7f72816e4700 1 -- 172.21.15.146:0/1189259763 >> v2:172.21.15.151:3300/0 conn(0x7f727c0b2430 msgr2=0x7f727c0b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:32.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.108+0000 7f72816e4700 1 --2- 172.21.15.146:0/1189259763 >> v2:172.21.15.151:3300/0 conn(0x7f727c0b2430 0x7f727c0b5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:32.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.108+0000 7f72816e4700 1 -- 172.21.15.146:0/1189259763 >> v1:172.21.15.151:6789/0 conn(0x7f727c0b3cf0 legacy=0x7f727c0ce860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:32.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.108+0000 7f72816e4700 1 -- 172.21.15.146:0/1189259763 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f727c0b4870 con 0x7f727c0b2060 2023-10-06T11:06:32.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.108+0000 7f72816e4700 1 --2- 172.21.15.146:0/1189259763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f727c0b2060 0x7f727c0ccd60 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f727c0cdb30 tx=0x7f726c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ea23628dc9b03ed server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:32.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.109+0000 7f7273fff700 1 -- 172.21.15.146:0/1189259763 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c00b860 con 0x7f727c0b2060 2023-10-06T11:06:32.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.109+0000 7f7273fff700 1 -- 172.21.15.146:0/1189259763 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726c00b9c0 con 0x7f727c0b2060 2023-10-06T11:06:32.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.109+0000 7f7273fff700 1 -- 172.21.15.146:0/1189259763 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c00bd60 con 0x7f727c0b2060 2023-10-06T11:06:32.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.109+0000 7f72826e6700 1 -- 172.21.15.146:0/1189259763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f727c0b2060 msgr2=0x7f727c0ccd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:32.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.109+0000 7f72826e6700 1 --2- 172.21.15.146:0/1189259763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f727c0b2060 0x7f727c0ccd60 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f727c0cdb30 tx=0x7f726c009250 comp rx=0 tx=0).stop 2023-10-06T11:06:32.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.109+0000 7f72826e6700 1 -- 172.21.15.146:0/1189259763 shutdown_connections 2023-10-06T11:06:32.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.109+0000 7f72826e6700 1 --2- 172.21.15.146:0/1189259763 >> v2:172.21.15.151:3300/0 conn(0x7f727c0b2430 0x7f727c0b5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:32.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.109+0000 7f72826e6700 1 --2- 172.21.15.146:0/1189259763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f727c0b2060 0x7f727c0ccd60 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:32.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.109+0000 7f72826e6700 1 -- 172.21.15.146:0/1189259763 >> 172.21.15.146:0/1189259763 conn(0x7f727c06eba0 msgr2=0x7f727c06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:32.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.109+0000 7f72826e6700 1 -- 172.21.15.146:0/1189259763 shutdown_connections 2023-10-06T11:06:32.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.109+0000 7f72826e6700 1 -- 172.21.15.146:0/1189259763 wait complete. 2023-10-06T11:06:32.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.110+0000 7f72826e6700 1 Processor -- start 2023-10-06T11:06:32.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.110+0000 7f72826e6700 1 -- start start 2023-10-06T11:06:32.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.111+0000 7f72826e6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f727c0b2060 0x7f727c0a70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:32.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.111+0000 7f72826e6700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f727c0b2430 0x7f727c0a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:32.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.111+0000 7f72826e6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f727c0b3cf0 0x7f727c153380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:32.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.111+0000 7f72826e6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727c0a7960 con 0x7f727c0b2060 2023-10-06T11:06:32.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.111+0000 7f72826e6700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727c0a7c40 con 0x7f727c0b2430 2023-10-06T11:06:32.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.111+0000 7f72826e6700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f727c0a7f20 con 0x7f727c0b3cf0 2023-10-06T11:06:32.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.111+0000 7f72816e4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f727c0b2060 0x7f727c0a70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:32.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.111+0000 7f72816e4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f727c0b2060 0x7f727c0a70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41710/0 (socket says 172.21.15.146:41710) 2023-10-06T11:06:32.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.111+0000 7f72816e4700 1 -- 172.21.15.146:0/131262840 learned_addr learned my addr 172.21.15.146:0/131262840 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:32.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.111+0000 7f7281ee5700 1 --2- 172.21.15.146:0/131262840 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f727c0b3cf0 0x7f727c153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:32.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.111+0000 7f72816e4700 1 -- 172.21.15.146:0/131262840 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f727c0b3cf0 msgr2=0x7f727c153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:32.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.111+0000 7f72816e4700 1 --2- 172.21.15.146:0/131262840 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f727c0b3cf0 0x7f727c153380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:32.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.111+0000 7f7280ee3700 1 --2- 172.21.15.146:0/131262840 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f727c0b2430 0x7f727c0a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:32.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.111+0000 7f72816e4700 1 -- 172.21.15.146:0/131262840 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f727c0b2430 msgr2=0x7f727c0a9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:32.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.111+0000 7f72816e4700 1 --2- 172.21.15.146:0/131262840 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f727c0b2430 0x7f727c0a9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:32.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.111+0000 7f72816e4700 1 -- 172.21.15.146:0/131262840 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726c0094f0 con 0x7f727c0b2060 2023-10-06T11:06:32.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.112+0000 7f7281ee5700 1 --2- 172.21.15.146:0/131262840 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f727c0b3cf0 0x7f727c153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:06:32.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.112+0000 7f7280ee3700 1 --2- 172.21.15.146:0/131262840 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f727c0b2430 0x7f727c0a9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:06:32.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.112+0000 7f72816e4700 1 --2- 172.21.15.146:0/131262840 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f727c0b2060 0x7f727c0a70e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f727c088db0 tx=0x7f726c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:32.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.112+0000 7f72717fa700 1 -- 172.21.15.146:0/131262840 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c011e60 con 0x7f727c0b2060 2023-10-06T11:06:32.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.112+0000 7f72717fa700 1 -- 172.21.15.146:0/131262840 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726c01a630 con 0x7f727c0b2060 2023-10-06T11:06:32.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.112+0000 7f72717fa700 1 -- 172.21.15.146:0/131262840 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c01a9f0 con 0x7f727c0b2060 2023-10-06T11:06:32.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.112+0000 7f72826e6700 1 -- 172.21.15.146:0/131262840 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f727c0a8200 con 0x7f727c0b2060 2023-10-06T11:06:32.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.112+0000 7f72826e6700 1 -- 172.21.15.146:0/131262840 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f727c0a7620 con 0x7f727c0b2060 2023-10-06T11:06:32.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.113+0000 7f72826e6700 1 -- 172.21.15.146:0/131262840 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f727c04c380 con 0x7f727c0b2060 2023-10-06T11:06:32.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.113+0000 7f72717fa700 1 -- 172.21.15.146:0/131262840 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f726c02d440 con 0x7f727c0b2060 2023-10-06T11:06:32.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.113+0000 7f72717fa700 1 --2- 172.21.15.146:0/131262840 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7260066f30 0x7f72600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:32.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.114+0000 7f72717fa700 1 -- 172.21.15.146:0/131262840 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f726c086060 con 0x7f727c0b2060 2023-10-06T11:06:32.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.114+0000 7f7280ee3700 1 --2- 172.21.15.146:0/131262840 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7260066f30 0x7f72600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:32.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.114+0000 7f7280ee3700 1 --2- 172.21.15.146:0/131262840 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7260066f30 0x7f72600693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f727c0ab590 tx=0x7f7278009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:32.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.118+0000 7f72717fa700 1 -- 172.21.15.146:0/131262840 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f726c053420 con 0x7f727c0b2060 2023-10-06T11:06:32.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.378+0000 7f72826e6700 1 -- 172.21.15.146:0/131262840 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f727c0b4b50 con 0x7f727c0b2060 2023-10-06T11:06:32.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.383+0000 7f72717fa700 1 -- 172.21.15.146:0/131262840 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f726c0150a0 con 0x7f727c0b2060 2023-10-06T11:06:32.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.385+0000 7f72826e6700 1 -- 172.21.15.146:0/131262840 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7260066f30 msgr2=0x7f72600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:32.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.385+0000 7f72826e6700 1 --2- 172.21.15.146:0/131262840 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7260066f30 0x7f72600693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f727c0ab590 tx=0x7f7278009040 comp rx=0 tx=0).stop 2023-10-06T11:06:32.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.385+0000 7f72826e6700 1 -- 172.21.15.146:0/131262840 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f727c0b2060 msgr2=0x7f727c0a70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:32.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.385+0000 7f72826e6700 1 --2- 172.21.15.146:0/131262840 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f727c0b2060 0x7f727c0a70e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f727c088db0 tx=0x7f726c017000 comp rx=0 tx=0).stop 2023-10-06T11:06:32.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.385+0000 7f72826e6700 1 -- 172.21.15.146:0/131262840 shutdown_connections 2023-10-06T11:06:32.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.385+0000 7f72826e6700 1 --2- 172.21.15.146:0/131262840 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7260066f30 0x7f72600693e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:32.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.385+0000 7f72826e6700 1 --2- 172.21.15.146:0/131262840 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f727c0b3cf0 0x7f727c153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:32.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.385+0000 7f72826e6700 1 --2- 172.21.15.146:0/131262840 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f727c0b2060 0x7f727c0a70e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:32.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.385+0000 7f72826e6700 1 --2- 172.21.15.146:0/131262840 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f727c0b2430 0x7f727c0a9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:32.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.385+0000 7f72826e6700 1 -- 172.21.15.146:0/131262840 >> 172.21.15.146:0/131262840 conn(0x7f727c06eba0 msgr2=0x7f727c1555c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:32.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.386+0000 7f72826e6700 1 -- 172.21.15.146:0/131262840 shutdown_connections 2023-10-06T11:06:32.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.386+0000 7f72826e6700 1 -- 172.21.15.146:0/131262840 wait complete. 2023-10-06T11:06:32.399 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:06:32.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.512+0000 7f09a87df700 1 Processor -- start 2023-10-06T11:06:32.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.512+0000 7f09a87df700 1 -- start start 2023-10-06T11:06:32.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.513+0000 7f09a87df700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09a0153ab0 0x7f09a015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:32.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.513+0000 7f09a87df700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f09a0153e80 0x7f09a0068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:32.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.513+0000 7f09a87df700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09a015ac30 con 0x7f09a00689d0 2023-10-06T11:06:32.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.513+0000 7f09a87df700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09a0068e50 con 0x7f09a0153e80 2023-10-06T11:06:32.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.513+0000 7f09a87df700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a00b4510 con 0x7f09a0153ab0 2023-10-06T11:06:32.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.513+0000 7f09a5d7a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f09a0153e80 0x7f09a0068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:32.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.513+0000 7f09a6d7c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f09a00689d0 0x7f09a015d270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52308/0 (socket says 172.21.15.146:52308) 2023-10-06T11:06:32.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.513+0000 7f09a6d7c700 1 -- 172.21.15.146:0/2105553512 learned_addr learned my addr 172.21.15.146:0/2105553512 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:32.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.513+0000 7f09a657b700 1 --2- 172.21.15.146:0/2105553512 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09a0153ab0 0x7f09a015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:32.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.513+0000 7f09a5d7a700 1 -- 172.21.15.146:0/2105553512 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09a0153ab0 msgr2=0x7f09a015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:32.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.513+0000 7f09a5d7a700 1 --2- 172.21.15.146:0/2105553512 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09a0153ab0 0x7f09a015a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:32.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.513+0000 7f09a5d7a700 1 -- 172.21.15.146:0/2105553512 >> v1:172.21.15.146:6789/0 conn(0x7f09a00689d0 legacy=0x7f09a015d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:32.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.513+0000 7f09a5579700 1 -- 172.21.15.146:0/2105553512 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3452256615 0 0) 0x7f0998001490 con 0x7f09a00689d0 2023-10-06T11:06:32.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.513+0000 7f09a5d7a700 1 -- 172.21.15.146:0/2105553512 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a00b6530 con 0x7f09a0153e80 2023-10-06T11:06:32.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.513+0000 7f09a657b700 1 --2- 172.21.15.146:0/2105553512 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09a0153ab0 0x7f09a015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:06:32.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.513+0000 7f09a5d7a700 1 --2- 172.21.15.146:0/2105553512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09a0153e80 0x7f09a0068490 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f09900098e0 tx=0x7f09900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d681b2af5ff0e1c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:32.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.513+0000 7f09a5579700 1 -- 172.21.15.146:0/2105553512 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0990009e80 con 0x7f09a0153e80 2023-10-06T11:06:32.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.513+0000 7f09a5579700 1 -- 172.21.15.146:0/2105553512 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f099000b860 con 0x7f09a0153e80 2023-10-06T11:06:32.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.513+0000 7f09a5579700 1 -- 172.21.15.146:0/2105553512 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099000bbe0 con 0x7f09a0153e80 2023-10-06T11:06:32.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.514+0000 7f09a87df700 1 -- 172.21.15.146:0/2105553512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09a0153e80 msgr2=0x7f09a0068490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:32.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.514+0000 7f09a87df700 1 --2- 172.21.15.146:0/2105553512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09a0153e80 0x7f09a0068490 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f09900098e0 tx=0x7f09900091a0 comp rx=0 tx=0).stop 2023-10-06T11:06:32.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.514+0000 7f09a87df700 1 -- 172.21.15.146:0/2105553512 shutdown_connections 2023-10-06T11:06:32.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.514+0000 7f09a87df700 1 --2- 172.21.15.146:0/2105553512 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09a0153ab0 0x7f09a015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:32.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.514+0000 7f09a87df700 1 --2- 172.21.15.146:0/2105553512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09a0153e80 0x7f09a0068490 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:32.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.514+0000 7f09a87df700 1 -- 172.21.15.146:0/2105553512 >> 172.21.15.146:0/2105553512 conn(0x7f09a006eba0 msgr2=0x7f09a006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:32.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.514+0000 7f09a87df700 1 -- 172.21.15.146:0/2105553512 shutdown_connections 2023-10-06T11:06:32.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.514+0000 7f09a87df700 1 -- 172.21.15.146:0/2105553512 wait complete. 2023-10-06T11:06:32.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.515+0000 7f09a87df700 1 Processor -- start 2023-10-06T11:06:32.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.515+0000 7f09a87df700 1 -- start start 2023-10-06T11:06:32.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.516+0000 7f09a87df700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09a00689d0 0x7f09a01550b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:32.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.516+0000 7f09a87df700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09a0153ab0 0x7f09a016a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:32.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.516+0000 7f09a87df700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09a0153e80 0x7f09a00cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:32.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.516+0000 7f09a87df700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a016c010 con 0x7f09a0153ab0 2023-10-06T11:06:32.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.516+0000 7f09a87df700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a016b0d0 con 0x7f09a00689d0 2023-10-06T11:06:32.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.516+0000 7f09a87df700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a016b6e0 con 0x7f09a0153e80 2023-10-06T11:06:32.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.516+0000 7f09a5d7a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09a0153ab0 0x7f09a016a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:32.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.516+0000 7f09a5d7a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09a0153ab0 0x7f09a016a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41722/0 (socket says 172.21.15.146:41722) 2023-10-06T11:06:32.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.516+0000 7f09a5d7a700 1 -- 172.21.15.146:0/2791754150 learned_addr learned my addr 172.21.15.146:0/2791754150 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:32.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.516+0000 7f09a6d7c700 1 --2- 172.21.15.146:0/2791754150 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09a0153e80 0x7f09a00cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:32.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.516+0000 7f09a5d7a700 1 -- 172.21.15.146:0/2791754150 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09a0153e80 msgr2=0x7f09a00cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:32.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.516+0000 7f09a5d7a700 1 --2- 172.21.15.146:0/2791754150 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09a0153e80 0x7f09a00cbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:32.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.516+0000 7f09a5d7a700 1 -- 172.21.15.146:0/2791754150 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09a00689d0 msgr2=0x7f09a01550b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:32.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.516+0000 7f09a5d7a700 1 --2- 172.21.15.146:0/2791754150 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09a00689d0 0x7f09a01550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:32.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.516+0000 7f09a5d7a700 1 -- 172.21.15.146:0/2791754150 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0990009420 con 0x7f09a0153ab0 2023-10-06T11:06:32.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.516+0000 7f09a5d7a700 1 --2- 172.21.15.146:0/2791754150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09a0153ab0 0x7f09a016a8b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0990013000 tx=0x7f0990017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:32.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.517+0000 7f09967fc700 1 -- 172.21.15.146:0/2791754150 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099000b9d0 con 0x7f09a0153ab0 2023-10-06T11:06:32.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.517+0000 7f09967fc700 1 -- 172.21.15.146:0/2791754150 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f099000bb30 con 0x7f09a0153ab0 2023-10-06T11:06:32.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.517+0000 7f09a87df700 1 -- 172.21.15.146:0/2791754150 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09a016b9c0 con 0x7f09a0153ab0 2023-10-06T11:06:32.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.517+0000 7f09967fc700 1 -- 172.21.15.146:0/2791754150 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0990025650 con 0x7f09a0153ab0 2023-10-06T11:06:32.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.517+0000 7f09a87df700 1 -- 172.21.15.146:0/2791754150 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09a016adf0 con 0x7f09a0153ab0 2023-10-06T11:06:32.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.517+0000 7f09a87df700 1 -- 172.21.15.146:0/2791754150 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09a004c380 con 0x7f09a0153ab0 2023-10-06T11:06:32.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.518+0000 7f09967fc700 1 -- 172.21.15.146:0/2791754150 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0990023070 con 0x7f09a0153ab0 2023-10-06T11:06:32.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.518+0000 7f09967fc700 1 --2- 172.21.15.146:0/2791754150 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0984066f30 0x7f09840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:32.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.518+0000 7f09967fc700 1 -- 172.21.15.146:0/2791754150 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f0990085870 con 0x7f09a0153ab0 2023-10-06T11:06:32.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.518+0000 7f09a657b700 1 --2- 172.21.15.146:0/2791754150 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0984066f30 0x7f09840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:32.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.519+0000 7f09a657b700 1 --2- 172.21.15.146:0/2791754150 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0984066f30 0x7f09840693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f099c006fd0 tx=0x7f099c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:32.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.523+0000 7f09967fc700 1 -- 172.21.15.146:0/2791754150 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0990052cd0 con 0x7f09a0153ab0 2023-10-06T11:06:32.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.708+0000 7f09a87df700 1 -- 172.21.15.146:0/2791754150 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f09a016c150 con 0x7f09a0153ab0 2023-10-06T11:06:32.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.709+0000 7f09967fc700 1 -- 172.21.15.146:0/2791754150 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+13698 (secure 0 0 0) 0x7f09900562f0 con 0x7f09a0153ab0 2023-10-06T11:06:32.711 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:06:32.711 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":27,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:06:29.531955+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:06:32.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.711+0000 7f09a87df700 1 -- 172.21.15.146:0/2791754150 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0984066f30 msgr2=0x7f09840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:32.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.711+0000 7f09a87df700 1 --2- 172.21.15.146:0/2791754150 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0984066f30 0x7f09840693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f099c006fd0 tx=0x7f099c008040 comp rx=0 tx=0).stop 2023-10-06T11:06:32.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.711+0000 7f09a87df700 1 -- 172.21.15.146:0/2791754150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09a0153ab0 msgr2=0x7f09a016a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:32.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.711+0000 7f09a87df700 1 --2- 172.21.15.146:0/2791754150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09a0153ab0 0x7f09a016a8b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0990013000 tx=0x7f0990017000 comp rx=0 tx=0).stop 2023-10-06T11:06:32.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.711+0000 7f09a87df700 1 -- 172.21.15.146:0/2791754150 shutdown_connections 2023-10-06T11:06:32.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.711+0000 7f09a87df700 1 --2- 172.21.15.146:0/2791754150 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0984066f30 0x7f09840693e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:32.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.711+0000 7f09a87df700 1 --2- 172.21.15.146:0/2791754150 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09a0153e80 0x7f09a00cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:32.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.711+0000 7f09a87df700 1 --2- 172.21.15.146:0/2791754150 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09a00689d0 0x7f09a01550b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:32.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.711+0000 7f09a87df700 1 --2- 172.21.15.146:0/2791754150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09a0153ab0 0x7f09a016a8b0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:32.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.711+0000 7f09a87df700 1 -- 172.21.15.146:0/2791754150 >> 172.21.15.146:0/2791754150 conn(0x7f09a006eba0 msgr2=0x7f09a0153270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:32.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.711+0000 7f09a87df700 1 -- 172.21.15.146:0/2791754150 shutdown_connections 2023-10-06T11:06:32.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.711+0000 7f09a87df700 1 -- 172.21.15.146:0/2791754150 wait complete. 2023-10-06T11:06:32.725 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:05:36.687307+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:05:37.171199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T11:06:32.726 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:06:32.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.841+0000 7fbee14f6700 1 Processor -- start 2023-10-06T11:06:32.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.841+0000 7fbee14f6700 1 -- start start 2023-10-06T11:06:32.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.842+0000 7fbee14f6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbedc15a160 0x7fbedc0c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:32.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.842+0000 7fbee14f6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbedc0ae730 0x7fbedc0aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:32.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.842+0000 7fbee14f6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbedc0ae2a0 con 0x7fbedc0ce3d0 2023-10-06T11:06:32.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.842+0000 7fbee14f6700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbedc15a530 con 0x7fbedc15a160 2023-10-06T11:06:32.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.842+0000 7fbee14f6700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc0ad690 con 0x7fbedc0ae730 2023-10-06T11:06:32.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.842+0000 7fbedaffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbedc15a160 0x7fbedc0c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:32.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.842+0000 7fbedb7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fbedc0ce3d0 0x7fbedc0ce830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52320/0 (socket says 172.21.15.146:52320) 2023-10-06T11:06:32.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.842+0000 7fbedb7fe700 1 -- 172.21.15.146:0/1544557707 learned_addr learned my addr 172.21.15.146:0/1544557707 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:32.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.842+0000 7fbeda7fc700 1 --2- 172.21.15.146:0/1544557707 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbedc0ae730 0x7fbedc0aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:32.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.842+0000 7fbedaffd700 1 -- 172.21.15.146:0/1544557707 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbedc0ae730 msgr2=0x7fbedc0aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:32.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.842+0000 7fbedaffd700 1 --2- 172.21.15.146:0/1544557707 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbedc0ae730 0x7fbedc0aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:32.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.842+0000 7fbedaffd700 1 -- 172.21.15.146:0/1544557707 >> v1:172.21.15.146:6789/0 conn(0x7fbedc0ce3d0 legacy=0x7fbedc0ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:32.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.842+0000 7fbed9ffb700 1 -- 172.21.15.146:0/1544557707 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 452274803 0 0) 0x7fbedc0ae2a0 con 0x7fbedc0ce3d0 2023-10-06T11:06:32.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.842+0000 7fbedaffd700 1 -- 172.21.15.146:0/1544557707 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbedc0ad970 con 0x7fbedc15a160 2023-10-06T11:06:32.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.842+0000 7fbedaffd700 1 --2- 172.21.15.146:0/1544557707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbedc15a160 0x7fbedc0c55a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fbecc009eb0 tx=0x7fbecc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48d36da13e3864d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:32.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.843+0000 7fbed9ffb700 1 -- 172.21.15.146:0/1544557707 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc00e070 con 0x7fbedc15a160 2023-10-06T11:06:32.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.843+0000 7fbed9ffb700 1 -- 172.21.15.146:0/1544557707 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbecc00bc30 con 0x7fbedc15a160 2023-10-06T11:06:32.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.843+0000 7fbed9ffb700 1 -- 172.21.15.146:0/1544557707 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbecc012430 con 0x7fbedc15a160 2023-10-06T11:06:32.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.843+0000 7fbee14f6700 1 -- 172.21.15.146:0/1544557707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbedc15a160 msgr2=0x7fbedc0c55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:32.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.843+0000 7fbee14f6700 1 --2- 172.21.15.146:0/1544557707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbedc15a160 0x7fbedc0c55a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fbecc009eb0 tx=0x7fbecc009780 comp rx=0 tx=0).stop 2023-10-06T11:06:32.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.843+0000 7fbee14f6700 1 -- 172.21.15.146:0/1544557707 shutdown_connections 2023-10-06T11:06:32.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.843+0000 7fbee14f6700 1 --2- 172.21.15.146:0/1544557707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbedc15a160 0x7fbedc0c55a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:32.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.843+0000 7fbee14f6700 1 --2- 172.21.15.146:0/1544557707 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbedc0ae730 0x7fbedc0aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:32.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.843+0000 7fbee14f6700 1 -- 172.21.15.146:0/1544557707 >> 172.21.15.146:0/1544557707 conn(0x7fbedc06f380 msgr2=0x7fbedc0d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:32.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.843+0000 7fbee14f6700 1 -- 172.21.15.146:0/1544557707 shutdown_connections 2023-10-06T11:06:32.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.843+0000 7fbee14f6700 1 -- 172.21.15.146:0/1544557707 wait complete. 2023-10-06T11:06:32.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.844+0000 7fbee14f6700 1 Processor -- start 2023-10-06T11:06:32.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.844+0000 7fbee14f6700 1 -- start start 2023-10-06T11:06:32.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.845+0000 7fbee14f6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbedc0ae730 0x7fbedc0b4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:32.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.845+0000 7fbee14f6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbedc0ce3d0 0x7fbedc14ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:32.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.845+0000 7fbee14f6700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbedc15a160 0x7fbedc15fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:32.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.845+0000 7fbee14f6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc154030 con 0x7fbedc0ce3d0 2023-10-06T11:06:32.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.845+0000 7fbee14f6700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc14ef80 con 0x7fbedc15a160 2023-10-06T11:06:32.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.845+0000 7fbee14f6700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc0b4b50 con 0x7fbedc0ae730 2023-10-06T11:06:32.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.845+0000 7fbeda7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbedc0ce3d0 0x7fbedc14ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:32.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.845+0000 7fbeda7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbedc0ce3d0 0x7fbedc14ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41746/0 (socket says 172.21.15.146:41746) 2023-10-06T11:06:32.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.845+0000 7fbeda7fc700 1 -- 172.21.15.146:0/720150232 learned_addr learned my addr 172.21.15.146:0/720150232 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:32.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.845+0000 7fbedb7fe700 1 --2- 172.21.15.146:0/720150232 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbedc15a160 0x7fbedc15fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:32.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.845+0000 7fbedaffd700 1 --2- 172.21.15.146:0/720150232 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbedc0ae730 0x7fbedc0b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:32.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.846+0000 7fbeda7fc700 1 -- 172.21.15.146:0/720150232 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbedc0ae730 msgr2=0x7fbedc0b4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:32.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.846+0000 7fbeda7fc700 1 --2- 172.21.15.146:0/720150232 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbedc0ae730 0x7fbedc0b4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:32.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.846+0000 7fbeda7fc700 1 -- 172.21.15.146:0/720150232 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbedc15a160 msgr2=0x7fbedc15fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:32.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.846+0000 7fbeda7fc700 1 --2- 172.21.15.146:0/720150232 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbedc15a160 0x7fbedc15fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:32.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.846+0000 7fbeda7fc700 1 -- 172.21.15.146:0/720150232 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbecc009a20 con 0x7fbedc0ce3d0 2023-10-06T11:06:32.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.846+0000 7fbeda7fc700 1 --2- 172.21.15.146:0/720150232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbedc0ce3d0 0x7fbedc14ea40 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fbed000d860 tx=0x7fbed0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:32.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.846+0000 7fbec2ffd700 1 -- 172.21.15.146:0/720150232 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed00125f0 con 0x7fbedc0ce3d0 2023-10-06T11:06:32.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.846+0000 7fbec2ffd700 1 -- 172.21.15.146:0/720150232 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed0012750 con 0x7fbedc0ce3d0 2023-10-06T11:06:32.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.846+0000 7fbec2ffd700 1 -- 172.21.15.146:0/720150232 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed0012b10 con 0x7fbedc0ce3d0 2023-10-06T11:06:32.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.846+0000 7fbee14f6700 1 -- 172.21.15.146:0/720150232 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbedc0b4e30 con 0x7fbedc0ce3d0 2023-10-06T11:06:32.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.846+0000 7fbee14f6700 1 -- 172.21.15.146:0/720150232 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbedc0b53f0 con 0x7fbedc0ce3d0 2023-10-06T11:06:32.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.847+0000 7fbee14f6700 1 -- 172.21.15.146:0/720150232 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbedc1541a0 con 0x7fbedc0ce3d0 2023-10-06T11:06:32.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.847+0000 7fbec2ffd700 1 -- 172.21.15.146:0/720150232 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbed001e460 con 0x7fbedc0ce3d0 2023-10-06T11:06:32.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.848+0000 7fbec2ffd700 1 --2- 172.21.15.146:0/720150232 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbec8066f60 0x7fbec8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:32.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.848+0000 7fbec2ffd700 1 -- 172.21.15.146:0/720150232 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fbed0084980 con 0x7fbedc0ce3d0 2023-10-06T11:06:32.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.848+0000 7fbedaffd700 1 --2- 172.21.15.146:0/720150232 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbec8066f60 0x7fbec8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:32.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.848+0000 7fbedaffd700 1 --2- 172.21.15.146:0/720150232 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbec8066f60 0x7fbec8069410 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbecc009eb0 tx=0x7fbecc017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:32.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:32.852+0000 7fbec2ffd700 1 -- 172.21.15.146:0/720150232 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbedc1541a0 con 0x7fbedc0ce3d0 2023-10-06T11:06:33.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.033+0000 7fbee14f6700 1 -- 172.21.15.146:0/720150232 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbedc068390 con 0x7fbedc0ce3d0 2023-10-06T11:06:33.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.034+0000 7fbec2ffd700 1 -- 172.21.15.146:0/720150232 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbed0055870 con 0x7fbedc0ce3d0 2023-10-06T11:06:33.036 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-10-06T11:06:33.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.036+0000 7fbee14f6700 1 -- 172.21.15.146:0/720150232 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbec8066f60 msgr2=0x7fbec8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:33.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.036+0000 7fbee14f6700 1 --2- 172.21.15.146:0/720150232 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbec8066f60 0x7fbec8069410 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbecc009eb0 tx=0x7fbecc017000 comp rx=0 tx=0).stop 2023-10-06T11:06:33.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.036+0000 7fbee14f6700 1 -- 172.21.15.146:0/720150232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbedc0ce3d0 msgr2=0x7fbedc14ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:33.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.036+0000 7fbee14f6700 1 --2- 172.21.15.146:0/720150232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbedc0ce3d0 0x7fbedc14ea40 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fbed000d860 tx=0x7fbed0008040 comp rx=0 tx=0).stop 2023-10-06T11:06:33.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.036+0000 7fbee14f6700 1 -- 172.21.15.146:0/720150232 shutdown_connections 2023-10-06T11:06:33.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.036+0000 7fbee14f6700 1 --2- 172.21.15.146:0/720150232 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbec8066f60 0x7fbec8069410 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:33.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.036+0000 7fbee14f6700 1 --2- 172.21.15.146:0/720150232 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbedc15a160 0x7fbedc15fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:33.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.036+0000 7fbee14f6700 1 --2- 172.21.15.146:0/720150232 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbedc0ae730 0x7fbedc0b4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:33.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.036+0000 7fbee14f6700 1 --2- 172.21.15.146:0/720150232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbedc0ce3d0 0x7fbedc14ea40 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:33.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.036+0000 7fbee14f6700 1 -- 172.21.15.146:0/720150232 >> 172.21.15.146:0/720150232 conn(0x7fbedc06f380 msgr2=0x7fbedc1523f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:33.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.036+0000 7fbee14f6700 1 -- 172.21.15.146:0/720150232 shutdown_connections 2023-10-06T11:06:33.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.036+0000 7fbee14f6700 1 -- 172.21.15.146:0/720150232 wait complete. 2023-10-06T11:06:33.049 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:06:33.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.165+0000 7f3aefcd8700 1 Processor -- start 2023-10-06T11:06:33.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.165+0000 7f3aefcd8700 1 -- start start 2023-10-06T11:06:33.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.166+0000 7f3aefcd8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3ae80ae730 0x7f3ae80aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:33.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.166+0000 7f3aefcd8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ae80cb950 0x7f3ae80cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:33.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.166+0000 7f3aefcd8700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ae80ae2a0 con 0x7f3ae815a160 2023-10-06T11:06:33.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.166+0000 7f3aefcd8700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ae815a530 con 0x7f3ae80ae730 2023-10-06T11:06:33.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.166+0000 7f3aefcd8700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae80c5cb0 con 0x7f3ae80cb950 2023-10-06T11:06:33.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.166+0000 7f3aed273700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3ae80ae730 0x7f3ae80aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:33.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.166+0000 7f3aeda74700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3ae815a160 0x7f3ae80c55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52324/0 (socket says 172.21.15.146:52324) 2023-10-06T11:06:33.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.166+0000 7f3aeda74700 1 -- 172.21.15.146:0/3924281206 learned_addr learned my addr 172.21.15.146:0/3924281206 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:33.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.166+0000 7f3aee275700 1 --2- 172.21.15.146:0/3924281206 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ae80cb950 0x7f3ae80cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:33.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.166+0000 7f3aed273700 1 -- 172.21.15.146:0/3924281206 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ae80cb950 msgr2=0x7f3ae80cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:33.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.166+0000 7f3aed273700 1 --2- 172.21.15.146:0/3924281206 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ae80cb950 0x7f3ae80cbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:33.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.166+0000 7f3aed273700 1 -- 172.21.15.146:0/3924281206 >> v1:172.21.15.146:6789/0 conn(0x7f3ae815a160 legacy=0x7f3ae80c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:33.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.166+0000 7f3aed273700 1 -- 172.21.15.146:0/3924281206 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae80af0f0 con 0x7f3ae80ae730 2023-10-06T11:06:33.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.167+0000 7f3aed273700 1 --2- 172.21.15.146:0/3924281206 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ae80ae730 0x7f3ae80aebb0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3ad80098e0 tx=0x7f3ad80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5905a7afa072eaca server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:33.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.167+0000 7f3aeca72700 1 -- 172.21.15.146:0/3924281206 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad8009e80 con 0x7f3ae80ae730 2023-10-06T11:06:33.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.167+0000 7f3aeca72700 1 -- 172.21.15.146:0/3924281206 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad800b860 con 0x7f3ae80ae730 2023-10-06T11:06:33.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.167+0000 7f3aeca72700 1 -- 172.21.15.146:0/3924281206 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad800bbe0 con 0x7f3ae80ae730 2023-10-06T11:06:33.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.167+0000 7f3aefcd8700 1 -- 172.21.15.146:0/3924281206 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ae80ae730 msgr2=0x7f3ae80aebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:33.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.167+0000 7f3aefcd8700 1 --2- 172.21.15.146:0/3924281206 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ae80ae730 0x7f3ae80aebb0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3ad80098e0 tx=0x7f3ad80091a0 comp rx=0 tx=0).stop 2023-10-06T11:06:33.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.167+0000 7f3aefcd8700 1 -- 172.21.15.146:0/3924281206 shutdown_connections 2023-10-06T11:06:33.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.167+0000 7f3aefcd8700 1 --2- 172.21.15.146:0/3924281206 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ae80cb950 0x7f3ae80cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:33.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.167+0000 7f3aefcd8700 1 --2- 172.21.15.146:0/3924281206 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ae80ae730 0x7f3ae80aebb0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:33.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.167+0000 7f3aefcd8700 1 -- 172.21.15.146:0/3924281206 >> 172.21.15.146:0/3924281206 conn(0x7f3ae806f380 msgr2=0x7f3ae80d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:33.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.167+0000 7f3aefcd8700 1 -- 172.21.15.146:0/3924281206 shutdown_connections 2023-10-06T11:06:33.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.167+0000 7f3aefcd8700 1 -- 172.21.15.146:0/3924281206 wait complete. 2023-10-06T11:06:33.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.168+0000 7f3aefcd8700 1 Processor -- start 2023-10-06T11:06:33.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.168+0000 7f3aefcd8700 1 -- start start 2023-10-06T11:06:33.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.169+0000 7f3aefcd8700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ae80ae730 0x7f3ae814b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:33.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.169+0000 7f3aefcd8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ae80cb950 0x7f3ae816a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:33.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.169+0000 7f3aefcd8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ae815a160 0x7f3ae815ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:33.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.169+0000 7f3aefcd8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae815a670 con 0x7f3ae80cb950 2023-10-06T11:06:33.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.169+0000 7f3aefcd8700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae815a950 con 0x7f3ae80ae730 2023-10-06T11:06:33.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.169+0000 7f3aefcd8700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae814ba10 con 0x7f3ae815a160 2023-10-06T11:06:33.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.169+0000 7f3aed273700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ae80cb950 0x7f3ae816a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:33.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.169+0000 7f3aed273700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ae80cb950 0x7f3ae816a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41756/0 (socket says 172.21.15.146:41756) 2023-10-06T11:06:33.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.169+0000 7f3aed273700 1 -- 172.21.15.146:0/4203929429 learned_addr learned my addr 172.21.15.146:0/4203929429 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:33.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.169+0000 7f3aee275700 1 --2- 172.21.15.146:0/4203929429 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ae815a160 0x7f3ae815ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:33.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.169+0000 7f3aeda74700 1 --2- 172.21.15.146:0/4203929429 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ae80ae730 0x7f3ae814b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:33.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.169+0000 7f3aed273700 1 -- 172.21.15.146:0/4203929429 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ae815a160 msgr2=0x7f3ae815ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:33.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.169+0000 7f3aed273700 1 --2- 172.21.15.146:0/4203929429 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ae815a160 0x7f3ae815ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:33.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.169+0000 7f3aed273700 1 -- 172.21.15.146:0/4203929429 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ae80ae730 msgr2=0x7f3ae814b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:33.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.169+0000 7f3aed273700 1 --2- 172.21.15.146:0/4203929429 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ae80ae730 0x7f3ae814b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:33.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.169+0000 7f3aed273700 1 -- 172.21.15.146:0/4203929429 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad8009420 con 0x7f3ae80cb950 2023-10-06T11:06:33.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.170+0000 7f3aed273700 1 --2- 172.21.15.146:0/4203929429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ae80cb950 0x7f3ae816a390 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3ad800b3c0 tx=0x7f3ad8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:33.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.170+0000 7f3addffb700 1 -- 172.21.15.146:0/4203929429 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad800bbe0 con 0x7f3ae80cb950 2023-10-06T11:06:33.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.170+0000 7f3addffb700 1 -- 172.21.15.146:0/4203929429 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad8011420 con 0x7f3ae80cb950 2023-10-06T11:06:33.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.170+0000 7f3addffb700 1 -- 172.21.15.146:0/4203929429 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad80117e0 con 0x7f3ae80cb950 2023-10-06T11:06:33.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.170+0000 7f3aefcd8700 1 -- 172.21.15.146:0/4203929429 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ae816a8d0 con 0x7f3ae80cb950 2023-10-06T11:06:33.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.170+0000 7f3aefcd8700 1 -- 172.21.15.146:0/4203929429 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ae816ae50 con 0x7f3ae80cb950 2023-10-06T11:06:33.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.171+0000 7f3aefcd8700 1 -- 172.21.15.146:0/4203929429 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ae804c380 con 0x7f3ae80cb950 2023-10-06T11:06:33.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.171+0000 7f3addffb700 1 -- 172.21.15.146:0/4203929429 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3ad8011bd0 con 0x7f3ae80cb950 2023-10-06T11:06:33.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.172+0000 7f3addffb700 1 --2- 172.21.15.146:0/4203929429 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3acc066f30 0x7f3acc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:33.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.172+0000 7f3addffb700 1 -- 172.21.15.146:0/4203929429 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f3ad8085d20 con 0x7f3ae80cb950 2023-10-06T11:06:33.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.172+0000 7f3aeda74700 1 --2- 172.21.15.146:0/4203929429 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3acc066f30 0x7f3acc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:33.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.172+0000 7f3aeda74700 1 --2- 172.21.15.146:0/4203929429 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3acc066f30 0x7f3acc0693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4001460 tx=0x7f3ae4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:33.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.176+0000 7f3addffb700 1 -- 172.21.15.146:0/4203929429 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3ad8053180 con 0x7f3ae80cb950 2023-10-06T11:06:33.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.359+0000 7f3aefcd8700 1 -- 172.21.15.146:0/4203929429 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3ae815aa90 con 0x7f3ae80cb950 2023-10-06T11:06:33.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.360+0000 7f3addffb700 1 -- 172.21.15.146:0/4203929429 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3ad8015020 con 0x7f3ae80cb950 2023-10-06T11:06:33.362 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-10-06T11:06:33.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.362+0000 7f3aefcd8700 1 -- 172.21.15.146:0/4203929429 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3acc066f30 msgr2=0x7f3acc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:33.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.362+0000 7f3aefcd8700 1 --2- 172.21.15.146:0/4203929429 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3acc066f30 0x7f3acc0693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4001460 tx=0x7f3ae4009040 comp rx=0 tx=0).stop 2023-10-06T11:06:33.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.362+0000 7f3aefcd8700 1 -- 172.21.15.146:0/4203929429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ae80cb950 msgr2=0x7f3ae816a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:33.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.362+0000 7f3aefcd8700 1 --2- 172.21.15.146:0/4203929429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ae80cb950 0x7f3ae816a390 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3ad800b3c0 tx=0x7f3ad8017000 comp rx=0 tx=0).stop 2023-10-06T11:06:33.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.362+0000 7f3aefcd8700 1 -- 172.21.15.146:0/4203929429 shutdown_connections 2023-10-06T11:06:33.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.362+0000 7f3aefcd8700 1 --2- 172.21.15.146:0/4203929429 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3acc066f30 0x7f3acc0693e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:33.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.362+0000 7f3aefcd8700 1 --2- 172.21.15.146:0/4203929429 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ae815a160 0x7f3ae815ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:33.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.362+0000 7f3aefcd8700 1 --2- 172.21.15.146:0/4203929429 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ae80ae730 0x7f3ae814b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:33.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.362+0000 7f3aefcd8700 1 --2- 172.21.15.146:0/4203929429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ae80cb950 0x7f3ae816a390 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:33.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.362+0000 7f3aefcd8700 1 -- 172.21.15.146:0/4203929429 >> 172.21.15.146:0/4203929429 conn(0x7f3ae806f380 msgr2=0x7f3ae8159560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:33.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.362+0000 7f3aefcd8700 1 -- 172.21.15.146:0/4203929429 shutdown_connections 2023-10-06T11:06:33.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.362+0000 7f3aefcd8700 1 -- 172.21.15.146:0/4203929429 wait complete. 2023-10-06T11:06:33.378 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T11:06:33.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.491+0000 7f5f7ddd9700 1 Processor -- start 2023-10-06T11:06:33.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.491+0000 7f5f7ddd9700 1 -- start start 2023-10-06T11:06:33.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.492+0000 7f5f7ddd9700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5f7815a7f0 0x7f5f7815cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:33.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.492+0000 7f5f7ddd9700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f780b2530 0x7f5f7815acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:33.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.492+0000 7f5f7ddd9700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f7815c630 con 0x7f5f7815a420 2023-10-06T11:06:33.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.492+0000 7f5f7ddd9700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f780ce040 con 0x7f5f7815a7f0 2023-10-06T11:06:33.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.492+0000 7f5f7ddd9700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7815ba20 con 0x7f5f780b2530 2023-10-06T11:06:33.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.492+0000 7f5f7cdd7700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f5f7815a420 0x7f5f780b1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52334/0 (socket says 172.21.15.146:52334) 2023-10-06T11:06:33.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.492+0000 7f5f7cdd7700 1 -- 172.21.15.146:0/962475926 learned_addr learned my addr 172.21.15.146:0/962475926 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:33.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.492+0000 7f5f7d5d8700 1 --2- 172.21.15.146:0/962475926 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f780b2530 0x7f5f7815acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:33.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.492+0000 7f5f77fff700 1 --2- 172.21.15.146:0/962475926 >> v2:172.21.15.151:3300/0 conn(0x7f5f7815a7f0 0x7f5f7815cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:33.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.492+0000 7f5f777fe700 1 -- 172.21.15.146:0/962475926 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 932800677 0 0) 0x7f5f7815c630 con 0x7f5f7815a420 2023-10-06T11:06:33.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.492+0000 7f5f777fe700 1 -- 172.21.15.146:0/962475926 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f64003570 con 0x7f5f7815a420 2023-10-06T11:06:33.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.493+0000 7f5f777fe700 1 -- 172.21.15.146:0/962475926 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2585165327 0 0) 0x7f5f64003570 con 0x7f5f7815a420 2023-10-06T11:06:33.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.493+0000 7f5f777fe700 1 -- 172.21.15.146:0/962475926 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f780b2530 msgr2=0x7f5f7815acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:33.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.493+0000 7f5f777fe700 1 --2- 172.21.15.146:0/962475926 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f780b2530 0x7f5f7815acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:33.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.493+0000 7f5f777fe700 1 -- 172.21.15.146:0/962475926 >> v2:172.21.15.151:3300/0 conn(0x7f5f7815a7f0 msgr2=0x7f5f7815cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:33.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.493+0000 7f5f777fe700 1 --2- 172.21.15.146:0/962475926 >> v2:172.21.15.151:3300/0 conn(0x7f5f7815a7f0 0x7f5f7815cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:33.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.493+0000 7f5f777fe700 1 -- 172.21.15.146:0/962475926 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f7815bd00 con 0x7f5f7815a420 2023-10-06T11:06:33.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.493+0000 7f5f777fe700 1 -- 172.21.15.146:0/962475926 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f5f60001470 con 0x7f5f7815a420 2023-10-06T11:06:33.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.493+0000 7f5f777fe700 1 -- 172.21.15.146:0/962475926 >> v1:172.21.15.146:6789/0 conn(0x7f5f7815a420 legacy=0x7f5f780b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:33.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.493+0000 7f5f777fe700 1 --2- 172.21.15.146:0/962475926 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f780b2530 0x7f5f64003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:33.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.493+0000 7f5f777fe700 1 --2- 172.21.15.146:0/962475926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f64003fe0 0x7f5f64004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:33.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.493+0000 7f5f777fe700 1 --2- 172.21.15.146:0/962475926 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f64004d50 0x7f5f640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:33.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.493+0000 7f5f777fe700 1 -- 172.21.15.146:0/962475926 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7815ba20 con 0x7f5f64004d50 2023-10-06T11:06:33.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.493+0000 7f5f777fe700 1 -- 172.21.15.146:0/962475926 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6400ba60 con 0x7f5f64003fe0 2023-10-06T11:06:33.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.493+0000 7f5f777fe700 1 -- 172.21.15.146:0/962475926 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6400bbd0 con 0x7f5f780b2530 2023-10-06T11:06:33.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.493+0000 7f5f7d5d8700 1 --2- 172.21.15.146:0/962475926 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f64004d50 0x7f5f640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:33.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.493+0000 7f5f77fff700 1 --2- 172.21.15.146:0/962475926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f64003fe0 0x7f5f64004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:33.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.493+0000 7f5f7cdd7700 1 --2- 172.21.15.146:0/962475926 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f780b2530 0x7f5f64003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:33.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.493+0000 7f5f7d5d8700 1 -- 172.21.15.146:0/962475926 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f780b2530 msgr2=0x7f5f64003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:33.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.493+0000 7f5f7d5d8700 1 --2- 172.21.15.146:0/962475926 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f780b2530 0x7f5f64003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:33.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.493+0000 7f5f7d5d8700 1 -- 172.21.15.146:0/962475926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f64003fe0 msgr2=0x7f5f64004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:33.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.493+0000 7f5f7d5d8700 1 --2- 172.21.15.146:0/962475926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f64003fe0 0x7f5f64004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:33.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.493+0000 7f5f7d5d8700 1 -- 172.21.15.146:0/962475926 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f64003570 con 0x7f5f64004d50 2023-10-06T11:06:33.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.493+0000 7f5f7d5d8700 1 --2- 172.21.15.146:0/962475926 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f64004d50 0x7f5f640051c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5f780b2930 tx=0x7f5f700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d351c1b0ebc2f96a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:33.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.493+0000 7f5f777fe700 1 -- 172.21.15.146:0/962475926 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7000e680 con 0x7f5f64004d50 2023-10-06T11:06:33.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.493+0000 7f5f777fe700 1 -- 172.21.15.146:0/962475926 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f7000e7e0 con 0x7f5f64004d50 2023-10-06T11:06:33.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.493+0000 7f5f777fe700 1 -- 172.21.15.146:0/962475926 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7000eba0 con 0x7f5f64004d50 2023-10-06T11:06:33.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.494+0000 7f5f7ddd9700 1 -- 172.21.15.146:0/962475926 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f64004d50 msgr2=0x7f5f640051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:33.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.494+0000 7f5f7ddd9700 1 --2- 172.21.15.146:0/962475926 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f64004d50 0x7f5f640051c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5f780b2930 tx=0x7f5f700091a0 comp rx=0 tx=0).stop 2023-10-06T11:06:33.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.494+0000 7f5f7d5d8700 1 -- 172.21.15.146:0/962475926 reap_dead start 2023-10-06T11:06:33.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.494+0000 7f5f7ddd9700 1 -- 172.21.15.146:0/962475926 shutdown_connections 2023-10-06T11:06:33.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.494+0000 7f5f7ddd9700 1 -- 172.21.15.146:0/962475926 >> 172.21.15.146:0/962475926 conn(0x7f5f7806eba0 msgr2=0x7f5f7806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:33.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.494+0000 7f5f7ddd9700 1 -- 172.21.15.146:0/962475926 shutdown_connections 2023-10-06T11:06:33.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.494+0000 7f5f7ddd9700 1 -- 172.21.15.146:0/962475926 wait complete. 2023-10-06T11:06:33.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.495+0000 7f5f7ddd9700 1 Processor -- start 2023-10-06T11:06:33.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.495+0000 7f5f7ddd9700 1 -- start start 2023-10-06T11:06:33.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.496+0000 7f5f7ddd9700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f7814e8b0 0x7f5f7814ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:33.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.496+0000 7f5f7ddd9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f78156c60 0x7f5f78153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:33.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.496+0000 7f5f7ddd9700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f781570d0 0x7f5f78153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:33.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.496+0000 7f5f7ddd9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7814f1c0 con 0x7f5f78156c60 2023-10-06T11:06:33.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.496+0000 7f5f7ddd9700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f78155c80 con 0x7f5f7814e8b0 2023-10-06T11:06:33.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.496+0000 7f5f7ddd9700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7816db30 con 0x7f5f781570d0 2023-10-06T11:06:33.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.496+0000 7f5f77fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f78156c60 0x7f5f78153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:33.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.496+0000 7f5f77fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f78156c60 0x7f5f78153130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41768/0 (socket says 172.21.15.146:41768) 2023-10-06T11:06:33.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.496+0000 7f5f77fff700 1 -- 172.21.15.146:0/794021472 learned_addr learned my addr 172.21.15.146:0/794021472 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:33.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.496+0000 7f5f7d5d8700 1 --2- 172.21.15.146:0/794021472 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f781570d0 0x7f5f78153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:33.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.496+0000 7f5f77fff700 1 -- 172.21.15.146:0/794021472 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f781570d0 msgr2=0x7f5f78153670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:33.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.496+0000 7f5f7cdd7700 1 --2- 172.21.15.146:0/794021472 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f7814e8b0 0x7f5f7814ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:33.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.496+0000 7f5f77fff700 1 --2- 172.21.15.146:0/794021472 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f781570d0 0x7f5f78153670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:33.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.496+0000 7f5f77fff700 1 -- 172.21.15.146:0/794021472 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f7814e8b0 msgr2=0x7f5f7814ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:33.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.496+0000 7f5f77fff700 1 --2- 172.21.15.146:0/794021472 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f7814e8b0 0x7f5f7814ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:33.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.496+0000 7f5f77fff700 1 -- 172.21.15.146:0/794021472 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f7816d850 con 0x7f5f78156c60 2023-10-06T11:06:33.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.496+0000 7f5f7d5d8700 1 --2- 172.21.15.146:0/794021472 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f781570d0 0x7f5f78153670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:06:33.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.497+0000 7f5f77fff700 1 --2- 172.21.15.146:0/794021472 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f78156c60 0x7f5f78153130 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5f68009fd0 tx=0x7f5f6800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:33.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.497+0000 7f5f74ff9700 1 -- 172.21.15.146:0/794021472 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6800e040 con 0x7f5f78156c60 2023-10-06T11:06:33.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.497+0000 7f5f74ff9700 1 -- 172.21.15.146:0/794021472 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f6800f040 con 0x7f5f78156c60 2023-10-06T11:06:33.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.497+0000 7f5f74ff9700 1 -- 172.21.15.146:0/794021472 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f68015430 con 0x7f5f78156c60 2023-10-06T11:06:33.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.497+0000 7f5f7ddd9700 1 -- 172.21.15.146:0/794021472 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f78156180 con 0x7f5f78156c60 2023-10-06T11:06:33.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.497+0000 7f5f7ddd9700 1 -- 172.21.15.146:0/794021472 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f78156740 con 0x7f5f78156c60 2023-10-06T11:06:33.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.498+0000 7f5f7ddd9700 1 -- 172.21.15.146:0/794021472 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f78156960 con 0x7f5f78156c60 2023-10-06T11:06:33.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.498+0000 7f5f74ff9700 1 -- 172.21.15.146:0/794021472 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5f68015860 con 0x7f5f78156c60 2023-10-06T11:06:33.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.498+0000 7f5f74ff9700 1 --2- 172.21.15.146:0/794021472 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5f58066f30 0x7f5f580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:33.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.498+0000 7f5f74ff9700 1 -- 172.21.15.146:0/794021472 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f5f680850c0 con 0x7f5f78156c60 2023-10-06T11:06:33.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.498+0000 7f5f7cdd7700 1 --2- 172.21.15.146:0/794021472 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5f58066f30 0x7f5f580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:33.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.499+0000 7f5f7cdd7700 1 --2- 172.21.15.146:0/794021472 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5f58066f30 0x7f5f580693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5f60000e10 tx=0x7f5f60001430 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:33.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.503+0000 7f5f74ff9700 1 -- 172.21.15.146:0/794021472 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5f68052480 con 0x7f5f78156c60 2023-10-06T11:06:33.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.691+0000 7f5f7ddd9700 1 -- 172.21.15.146:0/794021472 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5f780afae0 con 0x7f5f78156c60 2023-10-06T11:06:33.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.691+0000 7f5f74ff9700 1 -- 172.21.15.146:0/794021472 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v27) v1 ==== 84+0+126 (secure 0 0 0) 0x7f5f68055aa0 con 0x7f5f78156c60 2023-10-06T11:06:33.693 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:06:33.693 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2023-10-06T11:06:33.694 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:06:33.694 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 1, 2023-10-06T11:06:33.694 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": "rbd" 2023-10-06T11:06:33.694 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:06:33.694 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:06:33.694 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 2, 2023-10-06T11:06:33.694 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": ".mgr" 2023-10-06T11:06:33.694 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:06:33.694 INFO:teuthology.orchestra.run.smithi146.stdout:] 2023-10-06T11:06:33.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.693+0000 7f5f7ddd9700 1 -- 172.21.15.146:0/794021472 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5f58066f30 msgr2=0x7f5f580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:33.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.693+0000 7f5f7ddd9700 1 --2- 172.21.15.146:0/794021472 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5f58066f30 0x7f5f580693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5f60000e10 tx=0x7f5f60001430 comp rx=0 tx=0).stop 2023-10-06T11:06:33.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.693+0000 7f5f7ddd9700 1 -- 172.21.15.146:0/794021472 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f78156c60 msgr2=0x7f5f78153130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:33.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.693+0000 7f5f7ddd9700 1 --2- 172.21.15.146:0/794021472 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f78156c60 0x7f5f78153130 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f5f68009fd0 tx=0x7f5f6800b040 comp rx=0 tx=0).stop 2023-10-06T11:06:33.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.693+0000 7f5f7ddd9700 1 -- 172.21.15.146:0/794021472 shutdown_connections 2023-10-06T11:06:33.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.693+0000 7f5f7ddd9700 1 --2- 172.21.15.146:0/794021472 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5f58066f30 0x7f5f580693e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:33.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.693+0000 7f5f7ddd9700 1 --2- 172.21.15.146:0/794021472 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f781570d0 0x7f5f78153670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:33.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.693+0000 7f5f7ddd9700 1 --2- 172.21.15.146:0/794021472 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f7814e8b0 0x7f5f7814ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:33.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.693+0000 7f5f7ddd9700 1 --2- 172.21.15.146:0/794021472 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f78156c60 0x7f5f78153130 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:33.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.693+0000 7f5f7ddd9700 1 -- 172.21.15.146:0/794021472 >> 172.21.15.146:0/794021472 conn(0x7f5f7806eba0 msgr2=0x7f5f780b1510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:33.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.693+0000 7f5f7ddd9700 1 -- 172.21.15.146:0/794021472 shutdown_connections 2023-10-06T11:06:33.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.693+0000 7f5f7ddd9700 1 -- 172.21.15.146:0/794021472 wait complete. 2023-10-06T11:06:33.707 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T11:06:33.707 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T11:06:33.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.825+0000 7fd6a5cf9700 1 Processor -- start 2023-10-06T11:06:33.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.825+0000 7fd6a5cf9700 1 -- start start 2023-10-06T11:06:33.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.825+0000 7fd6a5cf9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd6a00cc960 0x7fd6a0164c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:33.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.826+0000 7fd6a5cf9700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6a00ccd80 con 0x7fd6a015a160 2023-10-06T11:06:33.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.826+0000 7fd6a5cf9700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6a00ae2a0 con 0x7fd6a00ae730 2023-10-06T11:06:33.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.826+0000 7fd6a5cf9700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6a015a530 con 0x7fd6a00cc960 2023-10-06T11:06:33.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.826+0000 7fd69f7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd6a015a160 0x7fd6a00c55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52340/0 (socket says 172.21.15.146:52340) 2023-10-06T11:06:33.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.826+0000 7fd69f7fe700 1 -- 172.21.15.146:0/1300263588 learned_addr learned my addr 172.21.15.146:0/1300263588 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:33.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.826+0000 7fd69ffff700 1 --2- 172.21.15.146:0/1300263588 >> v2:172.21.15.146:3300/0 conn(0x7fd6a00cc960 0x7fd6a0164c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:33.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.826+0000 7fd69e7fc700 1 -- 172.21.15.146:0/1300263588 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 183782227 0 0) 0x7fd694001290 con 0x7fd6a015a160 2023-10-06T11:06:33.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.826+0000 7fd69e7fc700 1 -- 172.21.15.146:0/1300263588 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd688003570 con 0x7fd6a015a160 2023-10-06T11:06:33.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.826+0000 7fd69ffff700 1 -- 172.21.15.146:0/1300263588 >> v1:172.21.15.151:6789/0 conn(0x7fd6a00ae730 legacy=0x7fd6a00aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:33.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.826+0000 7fd69ffff700 1 -- 172.21.15.146:0/1300263588 >> v1:172.21.15.146:6789/0 conn(0x7fd6a015a160 legacy=0x7fd6a00c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:33.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.826+0000 7fd69ffff700 1 -- 172.21.15.146:0/1300263588 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a00c5cb0 con 0x7fd6a00cc960 2023-10-06T11:06:33.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.826+0000 7fd69ffff700 1 --2- 172.21.15.146:0/1300263588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6a00cc960 0x7fd6a0164c60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd698009e60 tx=0x7fd698009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38746ed0665d76fa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:33.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.826+0000 7fd69e7fc700 1 -- 172.21.15.146:0/1300263588 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69800e070 con 0x7fd6a00cc960 2023-10-06T11:06:33.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.826+0000 7fd69e7fc700 1 -- 172.21.15.146:0/1300263588 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd69800bb60 con 0x7fd6a00cc960 2023-10-06T11:06:33.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.826+0000 7fd69e7fc700 1 -- 172.21.15.146:0/1300263588 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd698012430 con 0x7fd6a00cc960 2023-10-06T11:06:33.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.827+0000 7fd6a5cf9700 1 -- 172.21.15.146:0/1300263588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6a00cc960 msgr2=0x7fd6a0164c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:33.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.827+0000 7fd6a5cf9700 1 --2- 172.21.15.146:0/1300263588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6a00cc960 0x7fd6a0164c60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd698009e60 tx=0x7fd698009780 comp rx=0 tx=0).stop 2023-10-06T11:06:33.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.827+0000 7fd6a5cf9700 1 -- 172.21.15.146:0/1300263588 shutdown_connections 2023-10-06T11:06:33.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.827+0000 7fd6a5cf9700 1 --2- 172.21.15.146:0/1300263588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6a00cc960 0x7fd6a0164c60 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:33.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.827+0000 7fd6a5cf9700 1 -- 172.21.15.146:0/1300263588 >> 172.21.15.146:0/1300263588 conn(0x7fd6a006f380 msgr2=0x7fd6a00d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:33.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.827+0000 7fd6a5cf9700 1 -- 172.21.15.146:0/1300263588 shutdown_connections 2023-10-06T11:06:33.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.827+0000 7fd6a5cf9700 1 -- 172.21.15.146:0/1300263588 wait complete. 2023-10-06T11:06:33.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.828+0000 7fd6a5cf9700 1 Processor -- start 2023-10-06T11:06:33.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.828+0000 7fd6a5cf9700 1 -- start start 2023-10-06T11:06:33.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.829+0000 7fd6a5cf9700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6a00ae730 0x7fd6a00c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:33.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.829+0000 7fd6a5cf9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6a00cc960 0x7fd6a015dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:33.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.829+0000 7fd6a5cf9700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6a015a160 0x7fd6a015e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:33.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.829+0000 7fd6a5cf9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a00c7df0 con 0x7fd6a00cc960 2023-10-06T11:06:33.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.829+0000 7fd6a5cf9700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a00c8c30 con 0x7fd6a015a160 2023-10-06T11:06:33.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.829+0000 7fd6a5cf9700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a0157c10 con 0x7fd6a00ae730 2023-10-06T11:06:33.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.829+0000 7fd69effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6a00cc960 0x7fd6a015dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:33.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.829+0000 7fd69effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6a00cc960 0x7fd6a015dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41790/0 (socket says 172.21.15.146:41790) 2023-10-06T11:06:33.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.829+0000 7fd69effd700 1 -- 172.21.15.146:0/1751440442 learned_addr learned my addr 172.21.15.146:0/1751440442 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:33.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.829+0000 7fd69ffff700 1 --2- 172.21.15.146:0/1751440442 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6a015a160 0x7fd6a015e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:33.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.829+0000 7fd69f7fe700 1 --2- 172.21.15.146:0/1751440442 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6a00ae730 0x7fd6a00c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:33.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.829+0000 7fd69effd700 1 -- 172.21.15.146:0/1751440442 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6a00ae730 msgr2=0x7fd6a00c78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:33.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.829+0000 7fd69effd700 1 --2- 172.21.15.146:0/1751440442 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6a00ae730 0x7fd6a00c78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:33.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.829+0000 7fd69effd700 1 -- 172.21.15.146:0/1751440442 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6a015a160 msgr2=0x7fd6a015e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:33.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.829+0000 7fd69effd700 1 --2- 172.21.15.146:0/1751440442 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6a015a160 0x7fd6a015e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:33.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.829+0000 7fd69effd700 1 -- 172.21.15.146:0/1751440442 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd698009a20 con 0x7fd6a00cc960 2023-10-06T11:06:33.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.829+0000 7fd69effd700 1 --2- 172.21.15.146:0/1751440442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6a00cc960 0x7fd6a015dfc0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd69000c590 tx=0x7fd69000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:33.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.829+0000 7fd6877fe700 1 -- 172.21.15.146:0/1751440442 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd690011590 con 0x7fd6a00cc960 2023-10-06T11:06:33.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.830+0000 7fd6877fe700 1 -- 172.21.15.146:0/1751440442 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd690011710 con 0x7fd6a00cc960 2023-10-06T11:06:33.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.830+0000 7fd6a5cf9700 1 -- 172.21.15.146:0/1751440442 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6a00c8020 con 0x7fd6a00cc960 2023-10-06T11:06:33.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.830+0000 7fd6877fe700 1 -- 172.21.15.146:0/1751440442 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd690011ad0 con 0x7fd6a00cc960 2023-10-06T11:06:33.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.830+0000 7fd6a5cf9700 1 -- 172.21.15.146:0/1751440442 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6a00c85e0 con 0x7fd6a00cc960 2023-10-06T11:06:33.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.831+0000 7fd6a5cf9700 1 -- 172.21.15.146:0/1751440442 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6a0068390 con 0x7fd6a00cc960 2023-10-06T11:06:33.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.831+0000 7fd6877fe700 1 -- 172.21.15.146:0/1751440442 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd69001b3b0 con 0x7fd6a00cc960 2023-10-06T11:06:33.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.831+0000 7fd6877fe700 1 --2- 172.21.15.146:0/1751440442 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd68c066f30 0x7fd68c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:33.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.831+0000 7fd6877fe700 1 -- 172.21.15.146:0/1751440442 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fd690083850 con 0x7fd6a00cc960 2023-10-06T11:06:33.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.831+0000 7fd69f7fe700 1 --2- 172.21.15.146:0/1751440442 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd68c066f30 0x7fd68c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:33.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.832+0000 7fd69f7fe700 1 --2- 172.21.15.146:0/1751440442 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd68c066f30 0x7fd68c0693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd6940013f0 tx=0x7fd694009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:33.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:33.835+0000 7fd6877fe700 1 -- 172.21.15.146:0/1751440442 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd690050cb0 con 0x7fd6a00cc960 2023-10-06T11:06:34.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.018+0000 7fd6a5cf9700 1 -- 172.21.15.146:0/1751440442 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd6a00ad690 con 0x7fd6a00cc960 2023-10-06T11:06:34.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.546+0000 7fd6877fe700 1 -- 172.21.15.146:0/1751440442 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v28) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd690017070 con 0x7fd6a00cc960 2023-10-06T11:06:34.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.549+0000 7fd6a5cf9700 1 -- 172.21.15.146:0/1751440442 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd68c066f30 msgr2=0x7fd68c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:34.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.549+0000 7fd6a5cf9700 1 --2- 172.21.15.146:0/1751440442 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd68c066f30 0x7fd68c0693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd6940013f0 tx=0x7fd694009040 comp rx=0 tx=0).stop 2023-10-06T11:06:34.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.549+0000 7fd6a5cf9700 1 -- 172.21.15.146:0/1751440442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6a00cc960 msgr2=0x7fd6a015dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:34.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.549+0000 7fd6a5cf9700 1 --2- 172.21.15.146:0/1751440442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6a00cc960 0x7fd6a015dfc0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd69000c590 tx=0x7fd69000c8a0 comp rx=0 tx=0).stop 2023-10-06T11:06:34.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.550+0000 7fd6a5cf9700 1 -- 172.21.15.146:0/1751440442 shutdown_connections 2023-10-06T11:06:34.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.550+0000 7fd6a5cf9700 1 --2- 172.21.15.146:0/1751440442 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd68c066f30 0x7fd68c0693e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:34.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.550+0000 7fd6a5cf9700 1 --2- 172.21.15.146:0/1751440442 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6a015a160 0x7fd6a015e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:34.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.550+0000 7fd6a5cf9700 1 --2- 172.21.15.146:0/1751440442 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6a00ae730 0x7fd6a00c78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:34.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.550+0000 7fd6a5cf9700 1 --2- 172.21.15.146:0/1751440442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6a00cc960 0x7fd6a015dfc0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:34.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.550+0000 7fd6a5cf9700 1 -- 172.21.15.146:0/1751440442 >> 172.21.15.146:0/1751440442 conn(0x7fd6a006f380 msgr2=0x7fd6a00c5ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:34.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.550+0000 7fd6a5cf9700 1 -- 172.21.15.146:0/1751440442 shutdown_connections 2023-10-06T11:06:34.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.550+0000 7fd6a5cf9700 1 -- 172.21.15.146:0/1751440442 wait complete. 2023-10-06T11:06:34.554 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' created 2023-10-06T11:06:34.567 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T11:06:34.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.690+0000 7f687ddd4700 1 Processor -- start 2023-10-06T11:06:34.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.690+0000 7f687ddd4700 1 -- start start 2023-10-06T11:06:34.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.691+0000 7f687ddd4700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6878159f60 0x7f68780c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:34.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.691+0000 7f687ddd4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f68780cc760 0x7f68780c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:34.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.691+0000 7f687ddd4700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68780c5c20 con 0x7f68780c7200 2023-10-06T11:06:34.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.691+0000 7f687ddd4700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68780b3260 con 0x7f68780cc760 2023-10-06T11:06:34.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.691+0000 7f687ddd4700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68780c5f00 con 0x7f6878159f60 2023-10-06T11:06:34.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.691+0000 7f6876ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f68780cc760 0x7f68780c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:34.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.691+0000 7f6877fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f68780c7200 0x7f68780b35f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52356/0 (socket says 172.21.15.146:52356) 2023-10-06T11:06:34.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.691+0000 7f6877fff700 1 -- 172.21.15.146:0/1159974282 learned_addr learned my addr 172.21.15.146:0/1159974282 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:34.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.691+0000 7f68777fe700 1 --2- 172.21.15.146:0/1159974282 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6878159f60 0x7f68780c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:34.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.691+0000 7f6876ffd700 1 -- 172.21.15.146:0/1159974282 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6878159f60 msgr2=0x7f68780c55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:34.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.691+0000 7f6876ffd700 1 --2- 172.21.15.146:0/1159974282 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6878159f60 0x7f68780c55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:34.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.691+0000 7f6876ffd700 1 -- 172.21.15.146:0/1159974282 >> v1:172.21.15.146:6789/0 conn(0x7f68780c7200 legacy=0x7f68780b35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:34.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.691+0000 7f68767fc700 1 -- 172.21.15.146:0/1159974282 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3534448070 0 0) 0x7f68780c5c20 con 0x7f68780c7200 2023-10-06T11:06:34.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.691+0000 7f6876ffd700 1 -- 172.21.15.146:0/1159974282 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68780c61e0 con 0x7f68780cc760 2023-10-06T11:06:34.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.691+0000 7f68777fe700 1 --2- 172.21.15.146:0/1159974282 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6878159f60 0x7f68780c55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:06:34.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.691+0000 7f6876ffd700 1 --2- 172.21.15.146:0/1159974282 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68780cc760 0x7f68780c6cc0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f686c0098e0 tx=0x7f686c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a898b95262fd837a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:34.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.692+0000 7f68767fc700 1 -- 172.21.15.146:0/1159974282 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686c009e80 con 0x7f68780cc760 2023-10-06T11:06:34.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.692+0000 7f68767fc700 1 -- 172.21.15.146:0/1159974282 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686c00b860 con 0x7f68780cc760 2023-10-06T11:06:34.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.692+0000 7f68767fc700 1 -- 172.21.15.146:0/1159974282 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686c00bbe0 con 0x7f68780cc760 2023-10-06T11:06:34.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.692+0000 7f687ddd4700 1 -- 172.21.15.146:0/1159974282 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68780cc760 msgr2=0x7f68780c6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:34.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.692+0000 7f687ddd4700 1 --2- 172.21.15.146:0/1159974282 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68780cc760 0x7f68780c6cc0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f686c0098e0 tx=0x7f686c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:06:34.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.692+0000 7f687ddd4700 1 -- 172.21.15.146:0/1159974282 shutdown_connections 2023-10-06T11:06:34.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.692+0000 7f687ddd4700 1 --2- 172.21.15.146:0/1159974282 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6878159f60 0x7f68780c55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:34.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.692+0000 7f687ddd4700 1 --2- 172.21.15.146:0/1159974282 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68780cc760 0x7f68780c6cc0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:34.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.692+0000 7f687ddd4700 1 -- 172.21.15.146:0/1159974282 >> 172.21.15.146:0/1159974282 conn(0x7f687806f380 msgr2=0x7f68780d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:34.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.692+0000 7f687ddd4700 1 -- 172.21.15.146:0/1159974282 shutdown_connections 2023-10-06T11:06:34.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.692+0000 7f687ddd4700 1 -- 172.21.15.146:0/1159974282 wait complete. 2023-10-06T11:06:34.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.693+0000 7f687ddd4700 1 Processor -- start 2023-10-06T11:06:34.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.693+0000 7f687ddd4700 1 -- start start 2023-10-06T11:06:34.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.694+0000 7f687ddd4700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68780c7200 0x7f6878169a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:34.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.694+0000 7f687ddd4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68780cc760 0x7f687815d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:34.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.694+0000 7f687ddd4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6878159f60 0x7f687814b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:34.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.694+0000 7f687ddd4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687814ba40 con 0x7f68780cc760 2023-10-06T11:06:34.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.694+0000 7f687ddd4700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687816a020 con 0x7f6878159f60 2023-10-06T11:06:34.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.694+0000 7f687ddd4700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f687816a300 con 0x7f68780c7200 2023-10-06T11:06:34.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.694+0000 7f6876ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68780cc760 0x7f687815d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:34.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.694+0000 7f6876ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68780cc760 0x7f687815d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41800/0 (socket says 172.21.15.146:41800) 2023-10-06T11:06:34.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.694+0000 7f6876ffd700 1 -- 172.21.15.146:0/715019739 learned_addr learned my addr 172.21.15.146:0/715019739 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:34.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.695+0000 7f6876ffd700 1 -- 172.21.15.146:0/715019739 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68780c7200 msgr2=0x7f6878169a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:34.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.695+0000 7f68777fe700 1 --2- 172.21.15.146:0/715019739 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68780c7200 0x7f6878169a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:34.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.695+0000 7f6877fff700 1 --2- 172.21.15.146:0/715019739 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6878159f60 0x7f687814b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:34.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.695+0000 7f6876ffd700 1 --2- 172.21.15.146:0/715019739 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68780c7200 0x7f6878169a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:34.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.695+0000 7f6876ffd700 1 -- 172.21.15.146:0/715019739 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6878159f60 msgr2=0x7f687814b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:34.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.695+0000 7f6876ffd700 1 --2- 172.21.15.146:0/715019739 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6878159f60 0x7f687814b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:34.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.695+0000 7f6876ffd700 1 -- 172.21.15.146:0/715019739 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f686c009420 con 0x7f68780cc760 2023-10-06T11:06:34.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.695+0000 7f68777fe700 1 --2- 172.21.15.146:0/715019739 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68780c7200 0x7f6878169a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:06:34.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.695+0000 7f6877fff700 1 --2- 172.21.15.146:0/715019739 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6878159f60 0x7f687814b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:06:34.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.695+0000 7f6876ffd700 1 --2- 172.21.15.146:0/715019739 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68780cc760 0x7f687815d390 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6878088c10 tx=0x7f686c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:34.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.695+0000 7f685f7fe700 1 -- 172.21.15.146:0/715019739 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686c011420 con 0x7f68780cc760 2023-10-06T11:06:34.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.695+0000 7f685f7fe700 1 -- 172.21.15.146:0/715019739 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686c0115a0 con 0x7f68780cc760 2023-10-06T11:06:34.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.695+0000 7f687ddd4700 1 -- 172.21.15.146:0/715019739 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f687816a5e0 con 0x7f68780cc760 2023-10-06T11:06:34.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.695+0000 7f685f7fe700 1 -- 172.21.15.146:0/715019739 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f686c011960 con 0x7f68780cc760 2023-10-06T11:06:34.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.695+0000 7f687ddd4700 1 -- 172.21.15.146:0/715019739 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f687816d0e0 con 0x7f68780cc760 2023-10-06T11:06:34.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.696+0000 7f687ddd4700 1 -- 172.21.15.146:0/715019739 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6878068b60 con 0x7f68780cc760 2023-10-06T11:06:34.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.696+0000 7f685f7fe700 1 -- 172.21.15.146:0/715019739 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f686c0253f0 con 0x7f68780cc760 2023-10-06T11:06:34.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.697+0000 7f685f7fe700 1 --2- 172.21.15.146:0/715019739 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6864066f30 0x7f68640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:34.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.697+0000 7f685f7fe700 1 -- 172.21.15.146:0/715019739 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f686c0860f0 con 0x7f68780cc760 2023-10-06T11:06:34.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.697+0000 7f68777fe700 1 --2- 172.21.15.146:0/715019739 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6864066f30 0x7f68640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:34.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.697+0000 7f68777fe700 1 --2- 172.21.15.146:0/715019739 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6864066f30 0x7f68640693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f686800d510 tx=0x7f6868007620 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:34.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.702+0000 7f685f7fe700 1 -- 172.21.15.146:0/715019739 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f686c053340 con 0x7f68780cc760 2023-10-06T11:06:34.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:34.884+0000 7f687ddd4700 1 -- 172.21.15.146:0/715019739 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f687804c380 con 0x7f68780cc760 2023-10-06T11:06:35.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.551+0000 7f685f7fe700 1 -- 172.21.15.146:0/715019739 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v29) v1 ==== 170+0+0 (secure 0 0 0) 0x7f686c056960 con 0x7f68780cc760 2023-10-06T11:06:35.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.555+0000 7f687ddd4700 1 -- 172.21.15.146:0/715019739 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6864066f30 msgr2=0x7f68640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:35.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.555+0000 7f687ddd4700 1 --2- 172.21.15.146:0/715019739 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6864066f30 0x7f68640693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f686800d510 tx=0x7f6868007620 comp rx=0 tx=0).stop 2023-10-06T11:06:35.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.555+0000 7f687ddd4700 1 -- 172.21.15.146:0/715019739 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68780cc760 msgr2=0x7f687815d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:35.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.555+0000 7f687ddd4700 1 --2- 172.21.15.146:0/715019739 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68780cc760 0x7f687815d390 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6878088c10 tx=0x7f686c017000 comp rx=0 tx=0).stop 2023-10-06T11:06:35.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.556+0000 7f687ddd4700 1 -- 172.21.15.146:0/715019739 shutdown_connections 2023-10-06T11:06:35.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.556+0000 7f687ddd4700 1 --2- 172.21.15.146:0/715019739 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6864066f30 0x7f68640693e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:35.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.556+0000 7f687ddd4700 1 --2- 172.21.15.146:0/715019739 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6878159f60 0x7f687814b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:35.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.556+0000 7f687ddd4700 1 --2- 172.21.15.146:0/715019739 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68780c7200 0x7f6878169a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:35.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.556+0000 7f687ddd4700 1 --2- 172.21.15.146:0/715019739 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68780cc760 0x7f687815d390 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:35.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.556+0000 7f687ddd4700 1 -- 172.21.15.146:0/715019739 >> 172.21.15.146:0/715019739 conn(0x7f687806f380 msgr2=0x7f6878069e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:35.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.556+0000 7f687ddd4700 1 -- 172.21.15.146:0/715019739 shutdown_connections 2023-10-06T11:06:35.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.556+0000 7f687ddd4700 1 -- 172.21.15.146:0/715019739 wait complete. 2023-10-06T11:06:35.563 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' created 2023-10-06T11:06:35.577 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T11:06:35.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.693+0000 7f2972c47700 1 Processor -- start 2023-10-06T11:06:35.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.693+0000 7f2972c47700 1 -- start start 2023-10-06T11:06:35.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.693+0000 7f2972c47700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f296c159b80 0x7f296c0abfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:35.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.693+0000 7f2972c47700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f296c15a9c0 0x7f296c069850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:35.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.693+0000 7f2972c47700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f296c15ae10 0x7f296c069d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:35.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.693+0000 7f2972c47700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f296c0cee40 con 0x7f296c15ae10 2023-10-06T11:06:35.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.693+0000 7f2972c47700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f296c0aff10 con 0x7f296c159b80 2023-10-06T11:06:35.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.693+0000 7f2972c47700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f296c0af090 con 0x7f296c15a9c0 2023-10-06T11:06:35.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.694+0000 7f29711e4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f296c15ae10 0x7f296c069d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:35.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.694+0000 7f29711e4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f296c15ae10 0x7f296c069d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41806/0 (socket says 172.21.15.146:41806) 2023-10-06T11:06:35.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.694+0000 7f29711e4700 1 -- 172.21.15.146:0/1619109316 learned_addr learned my addr 172.21.15.146:0/1619109316 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:35.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.694+0000 7f29709e3700 1 --2- 172.21.15.146:0/1619109316 >> v2:172.21.15.151:3300/0 conn(0x7f296c159b80 0x7f296c0abfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:35.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.694+0000 7f2963fff700 1 --2- 172.21.15.146:0/1619109316 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f296c15a9c0 0x7f296c069850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:35.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.694+0000 7f29711e4700 1 -- 172.21.15.146:0/1619109316 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f296c15a9c0 msgr2=0x7f296c069850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:35.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.694+0000 7f29711e4700 1 --2- 172.21.15.146:0/1619109316 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f296c15a9c0 0x7f296c069850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:35.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.694+0000 7f29711e4700 1 -- 172.21.15.146:0/1619109316 >> v2:172.21.15.151:3300/0 conn(0x7f296c159b80 msgr2=0x7f296c0abfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:35.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.694+0000 7f29711e4700 1 --2- 172.21.15.146:0/1619109316 >> v2:172.21.15.151:3300/0 conn(0x7f296c159b80 0x7f296c0abfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:35.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.694+0000 7f29711e4700 1 -- 172.21.15.146:0/1619109316 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f296c0af300 con 0x7f296c15ae10 2023-10-06T11:06:35.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.694+0000 7f2963fff700 1 --2- 172.21.15.146:0/1619109316 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f296c15a9c0 0x7f296c069850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:06:35.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.694+0000 7f29711e4700 1 --2- 172.21.15.146:0/1619109316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f296c15ae10 0x7f296c069d90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f296c0cacc0 tx=0x7f2964009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=956bc1c9d552c734 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:35.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.694+0000 7f29637fe700 1 -- 172.21.15.146:0/1619109316 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2964009e70 con 0x7f296c15ae10 2023-10-06T11:06:35.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.694+0000 7f29637fe700 1 -- 172.21.15.146:0/1619109316 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f296400b8f0 con 0x7f296c15ae10 2023-10-06T11:06:35.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.694+0000 7f29637fe700 1 -- 172.21.15.146:0/1619109316 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296400bc90 con 0x7f296c15ae10 2023-10-06T11:06:35.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.695+0000 7f2972c47700 1 -- 172.21.15.146:0/1619109316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f296c15ae10 msgr2=0x7f296c069d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:35.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.695+0000 7f2972c47700 1 --2- 172.21.15.146:0/1619109316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f296c15ae10 0x7f296c069d90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f296c0cacc0 tx=0x7f2964009250 comp rx=0 tx=0).stop 2023-10-06T11:06:35.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.695+0000 7f2972c47700 1 -- 172.21.15.146:0/1619109316 shutdown_connections 2023-10-06T11:06:35.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.695+0000 7f2972c47700 1 --2- 172.21.15.146:0/1619109316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f296c15ae10 0x7f296c069d90 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:35.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.695+0000 7f2972c47700 1 --2- 172.21.15.146:0/1619109316 >> v2:172.21.15.151:3300/0 conn(0x7f296c159b80 0x7f296c0abfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:35.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.695+0000 7f2972c47700 1 --2- 172.21.15.146:0/1619109316 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f296c15a9c0 0x7f296c069850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:35.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.695+0000 7f2972c47700 1 -- 172.21.15.146:0/1619109316 >> 172.21.15.146:0/1619109316 conn(0x7f296c067c50 msgr2=0x7f296c0ce400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:35.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.695+0000 7f2972c47700 1 -- 172.21.15.146:0/1619109316 shutdown_connections 2023-10-06T11:06:35.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.695+0000 7f2972c47700 1 -- 172.21.15.146:0/1619109316 wait complete. 2023-10-06T11:06:35.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.696+0000 7f2972c47700 1 Processor -- start 2023-10-06T11:06:35.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.696+0000 7f2972c47700 1 -- start start 2023-10-06T11:06:35.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.697+0000 7f2972c47700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f296c159b80 0x7f296c165d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:35.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.697+0000 7f2972c47700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f296c15a9c0 0x7f296c0cd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:35.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.697+0000 7f2972c47700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f296c15ae10 0x7f296c168680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:35.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.697+0000 7f2972c47700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296c0ac670 con 0x7f296c15a9c0 2023-10-06T11:06:35.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.697+0000 7f2972c47700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296c0acc30 con 0x7f296c15ae10 2023-10-06T11:06:35.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.697+0000 7f2972c47700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f296c098330 con 0x7f296c159b80 2023-10-06T11:06:35.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.697+0000 7f2963fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f296c15a9c0 0x7f296c0cd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:35.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.697+0000 7f2963fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f296c15a9c0 0x7f296c0cd1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41822/0 (socket says 172.21.15.146:41822) 2023-10-06T11:06:35.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.697+0000 7f2963fff700 1 -- 172.21.15.146:0/2257177192 learned_addr learned my addr 172.21.15.146:0/2257177192 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:35.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.697+0000 7f29711e4700 1 --2- 172.21.15.146:0/2257177192 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f296c15ae10 0x7f296c168680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:35.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.697+0000 7f29709e3700 1 --2- 172.21.15.146:0/2257177192 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f296c159b80 0x7f296c165d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:35.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.697+0000 7f2963fff700 1 -- 172.21.15.146:0/2257177192 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f296c159b80 msgr2=0x7f296c165d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:35.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.697+0000 7f2963fff700 1 --2- 172.21.15.146:0/2257177192 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f296c159b80 0x7f296c165d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:35.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.697+0000 7f2963fff700 1 -- 172.21.15.146:0/2257177192 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f296c15ae10 msgr2=0x7f296c168680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:35.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.697+0000 7f2963fff700 1 --2- 172.21.15.146:0/2257177192 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f296c15ae10 0x7f296c168680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:35.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.697+0000 7f2963fff700 1 -- 172.21.15.146:0/2257177192 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29640094f0 con 0x7f296c15a9c0 2023-10-06T11:06:35.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.697+0000 7f2963fff700 1 --2- 172.21.15.146:0/2257177192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f296c15a9c0 0x7f296c0cd1a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f295c015450 tx=0x7f295c011d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:35.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.697+0000 7f2960ff9700 1 -- 172.21.15.146:0/2257177192 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c015e60 con 0x7f296c15a9c0 2023-10-06T11:06:35.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.698+0000 7f2960ff9700 1 -- 172.21.15.146:0/2257177192 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f295c017040 con 0x7f296c15a9c0 2023-10-06T11:06:35.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.698+0000 7f2972c47700 1 -- 172.21.15.146:0/2257177192 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f296c09bc80 con 0x7f296c15a9c0 2023-10-06T11:06:35.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.698+0000 7f2960ff9700 1 -- 172.21.15.146:0/2257177192 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c01d650 con 0x7f296c15a9c0 2023-10-06T11:06:35.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.698+0000 7f2972c47700 1 -- 172.21.15.146:0/2257177192 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f296c0cd6e0 con 0x7f296c15a9c0 2023-10-06T11:06:35.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.699+0000 7f2972c47700 1 -- 172.21.15.146:0/2257177192 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f296c0cd930 con 0x7f296c15a9c0 2023-10-06T11:06:35.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.699+0000 7f2960ff9700 1 -- 172.21.15.146:0/2257177192 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f295c01d9c0 con 0x7f296c15a9c0 2023-10-06T11:06:35.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.699+0000 7f2960ff9700 1 --2- 172.21.15.146:0/2257177192 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2958066f30 0x7f29580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:35.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.700+0000 7f2960ff9700 1 -- 172.21.15.146:0/2257177192 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f295c08ce00 con 0x7f296c15a9c0 2023-10-06T11:06:35.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.700+0000 7f29709e3700 1 --2- 172.21.15.146:0/2257177192 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2958066f30 0x7f29580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:35.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.700+0000 7f29709e3700 1 --2- 172.21.15.146:0/2257177192 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2958066f30 0x7f29580693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f296800f570 tx=0x7f296800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:35.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.704+0000 7f2960ff9700 1 -- 172.21.15.146:0/2257177192 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f295c059ed0 con 0x7f296c15a9c0 2023-10-06T11:06:35.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:35.933+0000 7f2972c47700 1 -- 172.21.15.146:0/2257177192 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f296c0acda0 con 0x7f296c15a9c0 2023-10-06T11:06:36.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.554+0000 7f2960ff9700 1 -- 172.21.15.146:0/2257177192 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f295c05d4f0 con 0x7f296c15a9c0 2023-10-06T11:06:36.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.559+0000 7f2972c47700 1 -- 172.21.15.146:0/2257177192 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2958066f30 msgr2=0x7f29580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:36.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.559+0000 7f2972c47700 1 --2- 172.21.15.146:0/2257177192 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2958066f30 0x7f29580693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f296800f570 tx=0x7f296800b040 comp rx=0 tx=0).stop 2023-10-06T11:06:36.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.559+0000 7f2972c47700 1 -- 172.21.15.146:0/2257177192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f296c15a9c0 msgr2=0x7f296c0cd1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:36.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.559+0000 7f2972c47700 1 --2- 172.21.15.146:0/2257177192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f296c15a9c0 0x7f296c0cd1a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f295c015450 tx=0x7f295c011d10 comp rx=0 tx=0).stop 2023-10-06T11:06:36.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.559+0000 7f2972c47700 1 -- 172.21.15.146:0/2257177192 shutdown_connections 2023-10-06T11:06:36.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.559+0000 7f2972c47700 1 --2- 172.21.15.146:0/2257177192 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2958066f30 0x7f29580693e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:36.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.559+0000 7f2972c47700 1 --2- 172.21.15.146:0/2257177192 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f296c15ae10 0x7f296c168680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:36.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.559+0000 7f2972c47700 1 --2- 172.21.15.146:0/2257177192 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f296c159b80 0x7f296c165d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:36.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.559+0000 7f2972c47700 1 --2- 172.21.15.146:0/2257177192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f296c15a9c0 0x7f296c0cd1a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:36.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.559+0000 7f2972c47700 1 -- 172.21.15.146:0/2257177192 >> 172.21.15.146:0/2257177192 conn(0x7f296c067c50 msgr2=0x7f296c0ce390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:36.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.559+0000 7f2972c47700 1 -- 172.21.15.146:0/2257177192 shutdown_connections 2023-10-06T11:06:36.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.561+0000 7f2972c47700 1 -- 172.21.15.146:0/2257177192 wait complete. 2023-10-06T11:06:36.566 INFO:teuthology.orchestra.run.smithi146.stderr:new fs with metadata pool 5 and data pool 6 2023-10-06T11:06:36.589 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:06:36.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.702+0000 7fcc53fff700 1 Processor -- start 2023-10-06T11:06:36.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.702+0000 7fcc53fff700 1 -- start start 2023-10-06T11:06:36.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.703+0000 7fcc53fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcc54140af0 0x7fcc5406eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:36.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.703+0000 7fcc53fff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcc54067b80 0x7fcc540affc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:36.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.703+0000 7fcc53fff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc54140ec0 con 0x7fcc540c95d0 2023-10-06T11:06:36.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.703+0000 7fcc53fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc5406f880 con 0x7fcc54140af0 2023-10-06T11:06:36.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.703+0000 7fcc53fff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc540c7fc0 con 0x7fcc54067b80 2023-10-06T11:06:36.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.703+0000 7fcc52ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcc54140af0 0x7fcc5406eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:36.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.703+0000 7fcc52ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcc54140af0 0x7fcc5406eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41828/0 (socket says 172.21.15.146:41828) 2023-10-06T11:06:36.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.703+0000 7fcc52ffd700 1 -- 172.21.15.146:0/1989389844 learned_addr learned my addr 172.21.15.146:0/1989389844 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:36.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.704+0000 7fcc537fe700 1 --2- 172.21.15.146:0/1989389844 >> v2:172.21.15.151:3300/0 conn(0x7fcc54067b80 0x7fcc540affc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:36.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.704+0000 7fcc52ffd700 1 -- 172.21.15.146:0/1989389844 >> v2:172.21.15.151:3300/0 conn(0x7fcc54067b80 msgr2=0x7fcc540affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:36.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.704+0000 7fcc52ffd700 1 --2- 172.21.15.146:0/1989389844 >> v2:172.21.15.151:3300/0 conn(0x7fcc54067b80 0x7fcc540affc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:36.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.704+0000 7fcc52ffd700 1 -- 172.21.15.146:0/1989389844 >> v1:172.21.15.151:6789/0 conn(0x7fcc540c95d0 legacy=0x7fcc54067470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:36.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.704+0000 7fcc52ffd700 1 -- 172.21.15.146:0/1989389844 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc5406f5a0 con 0x7fcc54140af0 2023-10-06T11:06:36.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.704+0000 7fcc52ffd700 1 --2- 172.21.15.146:0/1989389844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc54140af0 0x7fcc5406eec0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcc54071690 tx=0x7fcc44009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3de99c8270ebf9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:36.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.704+0000 7fcc527fc700 1 -- 172.21.15.146:0/1989389844 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4400b820 con 0x7fcc54140af0 2023-10-06T11:06:36.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.704+0000 7fcc527fc700 1 -- 172.21.15.146:0/1989389844 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc4400b980 con 0x7fcc54140af0 2023-10-06T11:06:36.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.704+0000 7fcc527fc700 1 -- 172.21.15.146:0/1989389844 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4400bd20 con 0x7fcc54140af0 2023-10-06T11:06:36.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.704+0000 7fcc53fff700 1 -- 172.21.15.146:0/1989389844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc54140af0 msgr2=0x7fcc5406eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:36.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.704+0000 7fcc53fff700 1 --2- 172.21.15.146:0/1989389844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc54140af0 0x7fcc5406eec0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcc54071690 tx=0x7fcc44009250 comp rx=0 tx=0).stop 2023-10-06T11:06:36.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.704+0000 7fcc53fff700 1 -- 172.21.15.146:0/1989389844 shutdown_connections 2023-10-06T11:06:36.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.704+0000 7fcc53fff700 1 --2- 172.21.15.146:0/1989389844 >> v2:172.21.15.151:3300/0 conn(0x7fcc54067b80 0x7fcc540affc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:36.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.704+0000 7fcc53fff700 1 --2- 172.21.15.146:0/1989389844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc54140af0 0x7fcc5406eec0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:36.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.704+0000 7fcc53fff700 1 -- 172.21.15.146:0/1989389844 >> 172.21.15.146:0/1989389844 conn(0x7fcc54069010 msgr2=0x7fcc540cd120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:36.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.705+0000 7fcc53fff700 1 -- 172.21.15.146:0/1989389844 shutdown_connections 2023-10-06T11:06:36.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.705+0000 7fcc53fff700 1 -- 172.21.15.146:0/1989389844 wait complete. 2023-10-06T11:06:36.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.706+0000 7fcc53fff700 1 Processor -- start 2023-10-06T11:06:36.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.706+0000 7fcc53fff700 1 -- start start 2023-10-06T11:06:36.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.706+0000 7fcc53fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc54067b80 0x7fcc5413d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:36.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.706+0000 7fcc53fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc540c95d0 0x7fcc5416b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:36.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.706+0000 7fcc53fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc54140af0 0x7fcc5416bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:36.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.706+0000 7fcc53fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc540c4e10 con 0x7fcc54140af0 2023-10-06T11:06:36.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.706+0000 7fcc53fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc540c4270 con 0x7fcc540c95d0 2023-10-06T11:06:36.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.706+0000 7fcc53fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc540c44e0 con 0x7fcc54067b80 2023-10-06T11:06:36.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.707+0000 7fcc537fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc54140af0 0x7fcc5416bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:36.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.707+0000 7fcc537fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc54140af0 0x7fcc5416bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41840/0 (socket says 172.21.15.146:41840) 2023-10-06T11:06:36.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.707+0000 7fcc537fe700 1 -- 172.21.15.146:0/529782059 learned_addr learned my addr 172.21.15.146:0/529782059 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:36.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.707+0000 7fcc52ffd700 1 --2- 172.21.15.146:0/529782059 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc54067b80 0x7fcc5413d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:36.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.707+0000 7fcc537fe700 1 -- 172.21.15.146:0/529782059 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc54067b80 msgr2=0x7fcc5413d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:36.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.707+0000 7fcc537fe700 1 --2- 172.21.15.146:0/529782059 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc54067b80 0x7fcc5413d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:36.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.707+0000 7fcc537fe700 1 -- 172.21.15.146:0/529782059 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc540c95d0 msgr2=0x7fcc5416b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:36.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.707+0000 7fcc537fe700 1 --2- 172.21.15.146:0/529782059 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc540c95d0 0x7fcc5416b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:36.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.707+0000 7fcc537fe700 1 -- 172.21.15.146:0/529782059 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc440094f0 con 0x7fcc54140af0 2023-10-06T11:06:36.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.707+0000 7fcc537fe700 1 --2- 172.21.15.146:0/529782059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc54140af0 0x7fcc5416bb80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c00ce50 tx=0x7fcc4c007810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:36.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.707+0000 7fcc4b7fe700 1 -- 172.21.15.146:0/529782059 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4c00ae40 con 0x7fcc54140af0 2023-10-06T11:06:36.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.707+0000 7fcc4b7fe700 1 -- 172.21.15.146:0/529782059 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc4c016430 con 0x7fcc54140af0 2023-10-06T11:06:36.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.707+0000 7fcc53fff700 1 -- 172.21.15.146:0/529782059 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc540c47c0 con 0x7fcc54140af0 2023-10-06T11:06:36.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.707+0000 7fcc4b7fe700 1 -- 172.21.15.146:0/529782059 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4c0167d0 con 0x7fcc54140af0 2023-10-06T11:06:36.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.707+0000 7fcc53fff700 1 -- 172.21.15.146:0/529782059 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc5416c3b0 con 0x7fcc54140af0 2023-10-06T11:06:36.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.708+0000 7fcc53fff700 1 -- 172.21.15.146:0/529782059 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc540c4f50 con 0x7fcc54140af0 2023-10-06T11:06:36.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.708+0000 7fcc4b7fe700 1 -- 172.21.15.146:0/529782059 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcc4c003020 con 0x7fcc54140af0 2023-10-06T11:06:36.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.709+0000 7fcc4b7fe700 1 --2- 172.21.15.146:0/529782059 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcc34066f30 0x7fcc340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:36.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.709+0000 7fcc4b7fe700 1 -- 172.21.15.146:0/529782059 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcc4c012070 con 0x7fcc54140af0 2023-10-06T11:06:36.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.709+0000 7fcc52ffd700 1 --2- 172.21.15.146:0/529782059 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcc34066f30 0x7fcc340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:36.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.709+0000 7fcc52ffd700 1 --2- 172.21.15.146:0/529782059 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcc34066f30 0x7fcc340693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcc54071690 tx=0x7fcc44016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:36.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.713+0000 7fcc4b7fe700 1 -- 172.21.15.146:0/529782059 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcc4c052770 con 0x7fcc54140af0 2023-10-06T11:06:36.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.897+0000 7fcc53fff700 1 -- 172.21.15.146:0/529782059 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc540c7900 con 0x7fcc54140af0 2023-10-06T11:06:36.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.898+0000 7fcc4b7fe700 1 -- 172.21.15.146:0/529782059 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16927 (secure 0 0 0) 0x7fcc4c055d90 con 0x7fcc54140af0 2023-10-06T11:06:36.899 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:06:36.900 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":30,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:06:35.934931+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:06:34.036525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T11:06:34.902843+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:06:36.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.900+0000 7fcc53fff700 1 -- 172.21.15.146:0/529782059 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcc34066f30 msgr2=0x7fcc340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:36.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.900+0000 7fcc53fff700 1 --2- 172.21.15.146:0/529782059 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcc34066f30 0x7fcc340693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcc54071690 tx=0x7fcc44016000 comp rx=0 tx=0).stop 2023-10-06T11:06:36.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.900+0000 7fcc53fff700 1 -- 172.21.15.146:0/529782059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc54140af0 msgr2=0x7fcc5416bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:36.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.900+0000 7fcc53fff700 1 --2- 172.21.15.146:0/529782059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc54140af0 0x7fcc5416bb80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fcc4c00ce50 tx=0x7fcc4c007810 comp rx=0 tx=0).stop 2023-10-06T11:06:36.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.900+0000 7fcc53fff700 1 -- 172.21.15.146:0/529782059 shutdown_connections 2023-10-06T11:06:36.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.900+0000 7fcc53fff700 1 --2- 172.21.15.146:0/529782059 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcc34066f30 0x7fcc340693e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:36.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.900+0000 7fcc53fff700 1 --2- 172.21.15.146:0/529782059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc54140af0 0x7fcc5416bb80 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:36.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.900+0000 7fcc53fff700 1 --2- 172.21.15.146:0/529782059 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc54067b80 0x7fcc5413d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:36.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.900+0000 7fcc53fff700 1 --2- 172.21.15.146:0/529782059 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc540c95d0 0x7fcc5416b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:36.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.900+0000 7fcc53fff700 1 -- 172.21.15.146:0/529782059 >> 172.21.15.146:0/529782059 conn(0x7fcc54069010 msgr2=0x7fcc540b03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:36.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.900+0000 7fcc53fff700 1 -- 172.21.15.146:0/529782059 shutdown_connections 2023-10-06T11:06:36.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:36.900+0000 7fcc53fff700 1 -- 172.21.15.146:0/529782059 wait complete. 2023-10-06T11:06:36.914 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:06:37.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.027+0000 7f82f6341700 1 Processor -- start 2023-10-06T11:06:37.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.027+0000 7f82f6341700 1 -- start start 2023-10-06T11:06:37.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.028+0000 7f82f6341700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f82f015a420 0x7f82f015cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:37.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.028+0000 7f82f6341700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f82f015a7f0 0x7f82f00b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:37.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.028+0000 7f82f6341700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82f015c630 con 0x7f82f00b2360 2023-10-06T11:06:37.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.028+0000 7f82f6341700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82f00ce040 con 0x7f82f015a420 2023-10-06T11:06:37.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.028+0000 7f82f6341700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82f00b2780 con 0x7f82f015a7f0 2023-10-06T11:06:37.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.028+0000 7f82f533f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f82f015a420 0x7f82f015cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:37.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.028+0000 7f82f5b40700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f82f00b2360 0x7f82f015acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52362/0 (socket says 172.21.15.146:52362) 2023-10-06T11:06:37.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.028+0000 7f82f5b40700 1 -- 172.21.15.146:0/1943957640 learned_addr learned my addr 172.21.15.146:0/1943957640 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:37.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.028+0000 7f82f4b3e700 1 --2- 172.21.15.146:0/1943957640 >> v2:172.21.15.151:3300/0 conn(0x7f82f015a7f0 0x7f82f00b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:37.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.028+0000 7f82f533f700 1 -- 172.21.15.146:0/1943957640 >> v2:172.21.15.151:3300/0 conn(0x7f82f015a7f0 msgr2=0x7f82f00b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:37.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.028+0000 7f82f533f700 1 --2- 172.21.15.146:0/1943957640 >> v2:172.21.15.151:3300/0 conn(0x7f82f015a7f0 0x7f82f00b1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:37.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.028+0000 7f82f533f700 1 -- 172.21.15.146:0/1943957640 >> v1:172.21.15.146:6789/0 conn(0x7f82f00b2360 legacy=0x7f82f015acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:37.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.028+0000 7f82f533f700 1 -- 172.21.15.146:0/1943957640 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f015ba20 con 0x7f82f015a420 2023-10-06T11:06:37.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.028+0000 7f82e7fff700 1 -- 172.21.15.146:0/1943957640 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3140109358 0 0) 0x7f82f015c630 con 0x7f82f00b2360 2023-10-06T11:06:37.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.028+0000 7f82f533f700 1 --2- 172.21.15.146:0/1943957640 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82f015a420 0x7f82f015cac0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f82f00b33c0 tx=0x7f82ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6eed5a85862692a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:37.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.029+0000 7f82e7fff700 1 -- 172.21.15.146:0/1943957640 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ec00b6b0 con 0x7f82f015a420 2023-10-06T11:06:37.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.029+0000 7f82e7fff700 1 -- 172.21.15.146:0/1943957640 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82ec00b810 con 0x7f82f015a420 2023-10-06T11:06:37.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.029+0000 7f82e7fff700 1 -- 172.21.15.146:0/1943957640 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ec00bbb0 con 0x7f82f015a420 2023-10-06T11:06:37.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.029+0000 7f82f6341700 1 -- 172.21.15.146:0/1943957640 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82f015a420 msgr2=0x7f82f015cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:37.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.029+0000 7f82f6341700 1 --2- 172.21.15.146:0/1943957640 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82f015a420 0x7f82f015cac0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f82f00b33c0 tx=0x7f82ec0091a0 comp rx=0 tx=0).stop 2023-10-06T11:06:37.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.029+0000 7f82f6341700 1 -- 172.21.15.146:0/1943957640 shutdown_connections 2023-10-06T11:06:37.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.029+0000 7f82f6341700 1 --2- 172.21.15.146:0/1943957640 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82f015a420 0x7f82f015cac0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:37.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.029+0000 7f82f6341700 1 --2- 172.21.15.146:0/1943957640 >> v2:172.21.15.151:3300/0 conn(0x7f82f015a7f0 0x7f82f00b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:37.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.029+0000 7f82f6341700 1 -- 172.21.15.146:0/1943957640 >> 172.21.15.146:0/1943957640 conn(0x7f82f006eba0 msgr2=0x7f82f006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:37.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.029+0000 7f82f6341700 1 -- 172.21.15.146:0/1943957640 shutdown_connections 2023-10-06T11:06:37.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.029+0000 7f82f6341700 1 -- 172.21.15.146:0/1943957640 wait complete. 2023-10-06T11:06:37.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.030+0000 7f82f6341700 1 Processor -- start 2023-10-06T11:06:37.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.030+0000 7f82f6341700 1 -- start start 2023-10-06T11:06:37.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.031+0000 7f82f6341700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82f00b2360 0x7f82f016af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:37.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.031+0000 7f82f6341700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82f015a420 0x7f82f013ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:37.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.031+0000 7f82f6341700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82f015a7f0 0x7f82f01559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:37.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.031+0000 7f82f6341700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f01552c0 con 0x7f82f015a7f0 2023-10-06T11:06:37.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.031+0000 7f82f6341700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f0151280 con 0x7f82f015a420 2023-10-06T11:06:37.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.031+0000 7f82f6341700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82f0154fe0 con 0x7f82f00b2360 2023-10-06T11:06:37.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.031+0000 7f82f5b40700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82f015a7f0 0x7f82f01559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:37.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.031+0000 7f82f5b40700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82f015a7f0 0x7f82f01559b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41866/0 (socket says 172.21.15.146:41866) 2023-10-06T11:06:37.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.031+0000 7f82f5b40700 1 -- 172.21.15.146:0/2994635394 learned_addr learned my addr 172.21.15.146:0/2994635394 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:37.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.031+0000 7f82f533f700 1 --2- 172.21.15.146:0/2994635394 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82f00b2360 0x7f82f016af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:37.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.031+0000 7f82f4b3e700 1 --2- 172.21.15.146:0/2994635394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82f015a420 0x7f82f013ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:37.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.032+0000 7f82f5b40700 1 -- 172.21.15.146:0/2994635394 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82f00b2360 msgr2=0x7f82f016af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:37.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.032+0000 7f82f5b40700 1 --2- 172.21.15.146:0/2994635394 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82f00b2360 0x7f82f016af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:37.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.032+0000 7f82f5b40700 1 -- 172.21.15.146:0/2994635394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82f015a420 msgr2=0x7f82f013ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:37.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.032+0000 7f82f5b40700 1 --2- 172.21.15.146:0/2994635394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82f015a420 0x7f82f013ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:37.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.032+0000 7f82f5b40700 1 -- 172.21.15.146:0/2994635394 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82ec009420 con 0x7f82f015a7f0 2023-10-06T11:06:37.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.032+0000 7f82f4b3e700 1 --2- 172.21.15.146:0/2994635394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82f015a420 0x7f82f013ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:06:37.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.032+0000 7f82f5b40700 1 --2- 172.21.15.146:0/2994635394 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82f015a7f0 0x7f82f01559b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f82e800cbf0 tx=0x7f82e80019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:37.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.032+0000 7f82e57fa700 1 -- 172.21.15.146:0/2994635394 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e800a910 con 0x7f82f015a7f0 2023-10-06T11:06:37.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.032+0000 7f82e57fa700 1 -- 172.21.15.146:0/2994635394 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82e800aa70 con 0x7f82f015a7f0 2023-10-06T11:06:37.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.032+0000 7f82e57fa700 1 -- 172.21.15.146:0/2994635394 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e800ae30 con 0x7f82f015a7f0 2023-10-06T11:06:37.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.032+0000 7f82f6341700 1 -- 172.21.15.146:0/2994635394 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82f0150c30 con 0x7f82f015a7f0 2023-10-06T11:06:37.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.032+0000 7f82f6341700 1 -- 172.21.15.146:0/2994635394 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82f013f270 con 0x7f82f015a7f0 2023-10-06T11:06:37.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.033+0000 7f82f6341700 1 -- 172.21.15.146:0/2994635394 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82f01513f0 con 0x7f82f015a7f0 2023-10-06T11:06:37.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.033+0000 7f82e57fa700 1 -- 172.21.15.146:0/2994635394 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f82e8007300 con 0x7f82f015a7f0 2023-10-06T11:06:37.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.034+0000 7f82e57fa700 1 --2- 172.21.15.146:0/2994635394 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f82d4066f30 0x7f82d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:37.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.034+0000 7f82e57fa700 1 -- 172.21.15.146:0/2994635394 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f82e80849c0 con 0x7f82f015a7f0 2023-10-06T11:06:37.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.034+0000 7f82f533f700 1 --2- 172.21.15.146:0/2994635394 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f82d4066f30 0x7f82d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:37.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.034+0000 7f82f533f700 1 --2- 172.21.15.146:0/2994635394 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f82d4066f30 0x7f82d40693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f82ec0093f0 tx=0x7f82ec017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:37.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.038+0000 7f82e57fa700 1 -- 172.21.15.146:0/2994635394 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f82e8051b50 con 0x7f82f015a7f0 2023-10-06T11:06:37.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.221+0000 7f82f6341700 1 -- 172.21.15.146:0/2994635394 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f82f00afae0 con 0x7f82f015a7f0 2023-10-06T11:06:37.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.222+0000 7f82e57fa700 1 -- 172.21.15.146:0/2994635394 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+16927 (secure 0 0 0) 0x7f82e8055170 con 0x7f82f015a7f0 2023-10-06T11:06:37.224 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:06:37.224 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":30,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:06:35.934931+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:06:34.036525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T11:06:34.902843+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:06:37.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.224+0000 7f82f6341700 1 -- 172.21.15.146:0/2994635394 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f82d4066f30 msgr2=0x7f82d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:37.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.224+0000 7f82f6341700 1 --2- 172.21.15.146:0/2994635394 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f82d4066f30 0x7f82d40693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f82ec0093f0 tx=0x7f82ec017000 comp rx=0 tx=0).stop 2023-10-06T11:06:37.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.224+0000 7f82f6341700 1 -- 172.21.15.146:0/2994635394 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82f015a7f0 msgr2=0x7f82f01559b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:37.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.224+0000 7f82f6341700 1 --2- 172.21.15.146:0/2994635394 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82f015a7f0 0x7f82f01559b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f82e800cbf0 tx=0x7f82e80019b0 comp rx=0 tx=0).stop 2023-10-06T11:06:37.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.224+0000 7f82f6341700 1 -- 172.21.15.146:0/2994635394 shutdown_connections 2023-10-06T11:06:37.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.224+0000 7f82f6341700 1 --2- 172.21.15.146:0/2994635394 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f82d4066f30 0x7f82d40693e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:37.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.224+0000 7f82f6341700 1 --2- 172.21.15.146:0/2994635394 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82f015a7f0 0x7f82f01559b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:37.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.224+0000 7f82f6341700 1 --2- 172.21.15.146:0/2994635394 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82f00b2360 0x7f82f016af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:37.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.224+0000 7f82f6341700 1 --2- 172.21.15.146:0/2994635394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82f015a420 0x7f82f013ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:37.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.224+0000 7f82f6341700 1 -- 172.21.15.146:0/2994635394 >> 172.21.15.146:0/2994635394 conn(0x7f82f006eba0 msgr2=0x7f82f00ce950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:37.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.224+0000 7f82f6341700 1 -- 172.21.15.146:0/2994635394 shutdown_connections 2023-10-06T11:06:37.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.224+0000 7f82f6341700 1 -- 172.21.15.146:0/2994635394 wait complete. 2023-10-06T11:06:37.238 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T11:06:37.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.354+0000 7f2fc44c3700 1 Processor -- start 2023-10-06T11:06:37.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.354+0000 7f2fc44c3700 1 -- start start 2023-10-06T11:06:37.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.355+0000 7f2fc44c3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2fbc0ae730 0x7f2fbc0aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:37.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.355+0000 7f2fc44c3700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2fbc0cb950 0x7f2fbc0cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:37.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.355+0000 7f2fc44c3700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fbc0ae2a0 con 0x7f2fbc15a160 2023-10-06T11:06:37.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.355+0000 7f2fc44c3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fbc15a530 con 0x7f2fbc0ae730 2023-10-06T11:06:37.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.355+0000 7f2fc44c3700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fbc0c5cb0 con 0x7f2fbc0cb950 2023-10-06T11:06:37.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.355+0000 7f2fc1a5e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2fbc0ae730 0x7f2fbc0aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:37.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.355+0000 7f2fc1a5e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2fbc0ae730 0x7f2fbc0aebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41872/0 (socket says 172.21.15.146:41872) 2023-10-06T11:06:37.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.355+0000 7f2fc1a5e700 1 -- 172.21.15.146:0/2007445374 learned_addr learned my addr 172.21.15.146:0/2007445374 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:37.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.355+0000 7f2fc2a60700 1 --2- 172.21.15.146:0/2007445374 >> v2:172.21.15.151:3300/0 conn(0x7f2fbc0cb950 0x7f2fbc0cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:37.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.355+0000 7f2fc1a5e700 1 -- 172.21.15.146:0/2007445374 >> v2:172.21.15.151:3300/0 conn(0x7f2fbc0cb950 msgr2=0x7f2fbc0cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:37.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.355+0000 7f2fc1a5e700 1 --2- 172.21.15.146:0/2007445374 >> v2:172.21.15.151:3300/0 conn(0x7f2fbc0cb950 0x7f2fbc0cbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:37.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.356+0000 7f2fc1a5e700 1 -- 172.21.15.146:0/2007445374 >> v1:172.21.15.151:6789/0 conn(0x7f2fbc15a160 legacy=0x7f2fbc0c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:37.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.356+0000 7f2fc1a5e700 1 -- 172.21.15.146:0/2007445374 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fbc0af0f0 con 0x7f2fbc0ae730 2023-10-06T11:06:37.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.356+0000 7f2fc1a5e700 1 --2- 172.21.15.146:0/2007445374 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fbc0ae730 0x7f2fbc0aebb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc08b000 tx=0x7f2fac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff42a009612af737 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:37.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.356+0000 7f2fc125d700 1 -- 172.21.15.146:0/2007445374 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac00b860 con 0x7f2fbc0ae730 2023-10-06T11:06:37.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.356+0000 7f2fc125d700 1 -- 172.21.15.146:0/2007445374 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fac00b9c0 con 0x7f2fbc0ae730 2023-10-06T11:06:37.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.356+0000 7f2fc125d700 1 -- 172.21.15.146:0/2007445374 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac00bd60 con 0x7f2fbc0ae730 2023-10-06T11:06:37.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.356+0000 7f2fc44c3700 1 -- 172.21.15.146:0/2007445374 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fbc0ae730 msgr2=0x7f2fbc0aebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:37.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.356+0000 7f2fc44c3700 1 --2- 172.21.15.146:0/2007445374 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fbc0ae730 0x7f2fbc0aebb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc08b000 tx=0x7f2fac009250 comp rx=0 tx=0).stop 2023-10-06T11:06:37.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.356+0000 7f2fc44c3700 1 -- 172.21.15.146:0/2007445374 shutdown_connections 2023-10-06T11:06:37.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.356+0000 7f2fc44c3700 1 --2- 172.21.15.146:0/2007445374 >> v2:172.21.15.151:3300/0 conn(0x7f2fbc0cb950 0x7f2fbc0cbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:37.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.356+0000 7f2fc44c3700 1 --2- 172.21.15.146:0/2007445374 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fbc0ae730 0x7f2fbc0aebb0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:37.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.356+0000 7f2fc44c3700 1 -- 172.21.15.146:0/2007445374 >> 172.21.15.146:0/2007445374 conn(0x7f2fbc06f380 msgr2=0x7f2fbc0d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:37.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.356+0000 7f2fc44c3700 1 -- 172.21.15.146:0/2007445374 shutdown_connections 2023-10-06T11:06:37.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.356+0000 7f2fc44c3700 1 -- 172.21.15.146:0/2007445374 wait complete. 2023-10-06T11:06:37.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.357+0000 7f2fc44c3700 1 Processor -- start 2023-10-06T11:06:37.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.357+0000 7f2fc44c3700 1 -- start start 2023-10-06T11:06:37.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.358+0000 7f2fc44c3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fbc0ae730 0x7f2fbc0af680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:37.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.358+0000 7f2fc44c3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2fbc0cb950 0x7f2fbc0b5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:37.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.358+0000 7f2fc44c3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2fbc15a160 0x7f2fbc0cd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:37.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.358+0000 7f2fc44c3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc0b35a0 con 0x7f2fbc0ae730 2023-10-06T11:06:37.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.358+0000 7f2fc44c3700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc0aff80 con 0x7f2fbc0cb950 2023-10-06T11:06:37.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.358+0000 7f2fc44c3700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc0b0260 con 0x7f2fbc15a160 2023-10-06T11:06:37.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.358+0000 7f2fc225f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fbc0ae730 0x7f2fbc0af680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:37.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.358+0000 7f2fc225f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fbc0ae730 0x7f2fbc0af680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41874/0 (socket says 172.21.15.146:41874) 2023-10-06T11:06:37.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.358+0000 7f2fc225f700 1 -- 172.21.15.146:0/2740445011 learned_addr learned my addr 172.21.15.146:0/2740445011 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:37.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.359+0000 7f2fc225f700 1 -- 172.21.15.146:0/2740445011 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2fbc15a160 msgr2=0x7f2fbc0cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:37.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.359+0000 7f2fc225f700 1 --2- 172.21.15.146:0/2740445011 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2fbc15a160 0x7f2fbc0cd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:37.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.359+0000 7f2fc225f700 1 -- 172.21.15.146:0/2740445011 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2fbc0cb950 msgr2=0x7f2fbc0b5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:37.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.359+0000 7f2fc225f700 1 --2- 172.21.15.146:0/2740445011 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2fbc0cb950 0x7f2fbc0b5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:37.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.359+0000 7f2fc225f700 1 -- 172.21.15.146:0/2740445011 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fac0094f0 con 0x7f2fbc0ae730 2023-10-06T11:06:37.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.359+0000 7f2fc225f700 1 --2- 172.21.15.146:0/2740445011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fbc0ae730 0x7f2fbc0af680 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2fb800c540 tx=0x7f2fb8001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:37.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.359+0000 7f2fb27fc700 1 -- 172.21.15.146:0/2740445011 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb8011590 con 0x7f2fbc0ae730 2023-10-06T11:06:37.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.359+0000 7f2fb27fc700 1 -- 172.21.15.146:0/2740445011 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb80116f0 con 0x7f2fbc0ae730 2023-10-06T11:06:37.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.359+0000 7f2fc44c3700 1 -- 172.21.15.146:0/2740445011 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fbc0b0540 con 0x7f2fbc0ae730 2023-10-06T11:06:37.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.359+0000 7f2fb27fc700 1 -- 172.21.15.146:0/2740445011 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb8011ab0 con 0x7f2fbc0ae730 2023-10-06T11:06:37.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.359+0000 7f2fc44c3700 1 -- 172.21.15.146:0/2740445011 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fbc154c40 con 0x7f2fbc0ae730 2023-10-06T11:06:37.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.360+0000 7f2fc44c3700 1 -- 172.21.15.146:0/2740445011 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fbc068390 con 0x7f2fbc0ae730 2023-10-06T11:06:37.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.360+0000 7f2fb27fc700 1 -- 172.21.15.146:0/2740445011 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2fb801b3b0 con 0x7f2fbc0ae730 2023-10-06T11:06:37.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.361+0000 7f2fb27fc700 1 --2- 172.21.15.146:0/2740445011 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2fa0066f30 0x7f2fa00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:37.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.361+0000 7f2fb27fc700 1 -- 172.21.15.146:0/2740445011 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2fb8083ae0 con 0x7f2fbc0ae730 2023-10-06T11:06:37.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.361+0000 7f2fc1a5e700 1 --2- 172.21.15.146:0/2740445011 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2fa0066f30 0x7f2fa00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:37.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.361+0000 7f2fc1a5e700 1 --2- 172.21.15.146:0/2740445011 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2fa0066f30 0x7f2fa00693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc08b000 tx=0x7f2fac017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:37.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.365+0000 7f2fb27fc700 1 -- 172.21.15.146:0/2740445011 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2fb8050ca0 con 0x7f2fbc0ae730 2023-10-06T11:06:37.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:37.594+0000 7f2fc44c3700 1 -- 172.21.15.146:0/2740445011 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2fbc154e60 con 0x7f2fbc0ae730 2023-10-06T11:06:38.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.571+0000 7f2fb27fc700 1 -- 172.21.15.146:0/2740445011 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2fb8017070 con 0x7f2fbc0ae730 2023-10-06T11:06:38.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.573+0000 7f2fc44c3700 1 -- 172.21.15.146:0/2740445011 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2fa0066f30 msgr2=0x7f2fa00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:38.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.573+0000 7f2fc44c3700 1 --2- 172.21.15.146:0/2740445011 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2fa0066f30 0x7f2fa00693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc08b000 tx=0x7f2fac017000 comp rx=0 tx=0).stop 2023-10-06T11:06:38.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.573+0000 7f2fc44c3700 1 -- 172.21.15.146:0/2740445011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fbc0ae730 msgr2=0x7f2fbc0af680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:38.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.573+0000 7f2fc44c3700 1 --2- 172.21.15.146:0/2740445011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fbc0ae730 0x7f2fbc0af680 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2fb800c540 tx=0x7f2fb8001070 comp rx=0 tx=0).stop 2023-10-06T11:06:38.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.574+0000 7f2fc44c3700 1 -- 172.21.15.146:0/2740445011 shutdown_connections 2023-10-06T11:06:38.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.574+0000 7f2fc44c3700 1 --2- 172.21.15.146:0/2740445011 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2fa0066f30 0x7f2fa00693e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:38.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.574+0000 7f2fc44c3700 1 --2- 172.21.15.146:0/2740445011 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2fbc15a160 0x7f2fbc0cd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:38.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.574+0000 7f2fc44c3700 1 --2- 172.21.15.146:0/2740445011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2fbc0ae730 0x7f2fbc0af680 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:38.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.574+0000 7f2fc44c3700 1 --2- 172.21.15.146:0/2740445011 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2fbc0cb950 0x7f2fbc0b5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:38.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.574+0000 7f2fc44c3700 1 -- 172.21.15.146:0/2740445011 >> 172.21.15.146:0/2740445011 conn(0x7f2fbc06f380 msgr2=0x7f2fbc0c55a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:38.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.574+0000 7f2fc44c3700 1 -- 172.21.15.146:0/2740445011 shutdown_connections 2023-10-06T11:06:38.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.574+0000 7f2fc44c3700 1 -- 172.21.15.146:0/2740445011 wait complete. 2023-10-06T11:06:38.590 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T11:06:38.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.711+0000 7f63874d7700 1 Processor -- start 2023-10-06T11:06:38.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.711+0000 7f63874d7700 1 -- start start 2023-10-06T11:06:38.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.712+0000 7f63874d7700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f638015a160 0x7f63800c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:38.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.712+0000 7f63874d7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f63800ae730 0x7f63800aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:38.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.712+0000 7f63874d7700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f63800ce3d0 0x7f63800ce830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:38.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.712+0000 7f63874d7700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63800ae2a0 con 0x7f63800ae730 2023-10-06T11:06:38.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.712+0000 7f63874d7700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f638015a530 con 0x7f63800ce3d0 2023-10-06T11:06:38.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.712+0000 7f63874d7700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63800ad690 con 0x7f638015a160 2023-10-06T11:06:38.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.712+0000 7f6384a72700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f63800ae730 0x7f63800aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:38.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.712+0000 7f6384a72700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f63800ae730 0x7f63800aeb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41884/0 (socket says 172.21.15.146:41884) 2023-10-06T11:06:38.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.712+0000 7f6384a72700 1 -- 172.21.15.146:0/539874015 learned_addr learned my addr 172.21.15.146:0/539874015 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:38.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.713+0000 7f6385a74700 1 --2- 172.21.15.146:0/539874015 >> v2:172.21.15.151:3300/0 conn(0x7f63800ce3d0 0x7f63800ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:38.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.713+0000 7f6385273700 1 --2- 172.21.15.146:0/539874015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f638015a160 0x7f63800c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:38.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.713+0000 7f6384a72700 1 -- 172.21.15.146:0/539874015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f638015a160 msgr2=0x7f63800c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:38.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.713+0000 7f6384a72700 1 --2- 172.21.15.146:0/539874015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f638015a160 0x7f63800c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:38.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.713+0000 7f6384a72700 1 -- 172.21.15.146:0/539874015 >> v2:172.21.15.151:3300/0 conn(0x7f63800ce3d0 msgr2=0x7f63800ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:38.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.713+0000 7f6384a72700 1 --2- 172.21.15.146:0/539874015 >> v2:172.21.15.151:3300/0 conn(0x7f63800ce3d0 0x7f63800ce830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:38.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.713+0000 7f6384a72700 1 -- 172.21.15.146:0/539874015 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63800ad970 con 0x7f63800ae730 2023-10-06T11:06:38.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.713+0000 7f6385273700 1 --2- 172.21.15.146:0/539874015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f638015a160 0x7f63800c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:06:38.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.713+0000 7f6384a72700 1 --2- 172.21.15.146:0/539874015 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63800ae730 0x7f63800aeb80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6380089c40 tx=0x7f6370009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3582f544fb5def22 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:38.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.713+0000 7f6377fff700 1 -- 172.21.15.146:0/539874015 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6370009e70 con 0x7f63800ae730 2023-10-06T11:06:38.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.713+0000 7f6377fff700 1 -- 172.21.15.146:0/539874015 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f637000b860 con 0x7f63800ae730 2023-10-06T11:06:38.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.713+0000 7f6377fff700 1 -- 172.21.15.146:0/539874015 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637000bc00 con 0x7f63800ae730 2023-10-06T11:06:38.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.713+0000 7f63874d7700 1 -- 172.21.15.146:0/539874015 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63800ae730 msgr2=0x7f63800aeb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:38.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.714+0000 7f63874d7700 1 --2- 172.21.15.146:0/539874015 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63800ae730 0x7f63800aeb80 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f6380089c40 tx=0x7f6370009250 comp rx=0 tx=0).stop 2023-10-06T11:06:38.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.714+0000 7f63874d7700 1 -- 172.21.15.146:0/539874015 shutdown_connections 2023-10-06T11:06:38.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.714+0000 7f63874d7700 1 --2- 172.21.15.146:0/539874015 >> v2:172.21.15.151:3300/0 conn(0x7f63800ce3d0 0x7f63800ce830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:38.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.714+0000 7f63874d7700 1 --2- 172.21.15.146:0/539874015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f638015a160 0x7f63800c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:38.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.714+0000 7f63874d7700 1 --2- 172.21.15.146:0/539874015 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63800ae730 0x7f63800aeb80 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:38.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.714+0000 7f63874d7700 1 -- 172.21.15.146:0/539874015 >> 172.21.15.146:0/539874015 conn(0x7f638006f380 msgr2=0x7f63800d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:38.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.714+0000 7f63874d7700 1 -- 172.21.15.146:0/539874015 shutdown_connections 2023-10-06T11:06:38.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.714+0000 7f63874d7700 1 -- 172.21.15.146:0/539874015 wait complete. 2023-10-06T11:06:38.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.715+0000 7f63874d7700 1 Processor -- start 2023-10-06T11:06:38.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.715+0000 7f63874d7700 1 -- start start 2023-10-06T11:06:38.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.716+0000 7f63874d7700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63800ae730 0x7f63800c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:38.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.716+0000 7f63874d7700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63800ce3d0 0x7f638015c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:38.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.716+0000 7f63874d7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f638015a160 0x7f638015ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:38.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.716+0000 7f63874d7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63800c8dc0 con 0x7f638015a160 2023-10-06T11:06:38.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.716+0000 7f63874d7700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63800c9bc0 con 0x7f63800ae730 2023-10-06T11:06:38.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.716+0000 7f63874d7700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63800c8fb0 con 0x7f63800ce3d0 2023-10-06T11:06:38.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.716+0000 7f6385a74700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f638015a160 0x7f638015ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:38.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.716+0000 7f6385a74700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f638015a160 0x7f638015ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41900/0 (socket says 172.21.15.146:41900) 2023-10-06T11:06:38.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.716+0000 7f6385a74700 1 -- 172.21.15.146:0/3427796062 learned_addr learned my addr 172.21.15.146:0/3427796062 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:38.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.716+0000 7f6385273700 1 --2- 172.21.15.146:0/3427796062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63800ae730 0x7f63800c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:38.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.716+0000 7f6384a72700 1 --2- 172.21.15.146:0/3427796062 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63800ce3d0 0x7f638015c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:38.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.716+0000 7f6385a74700 1 -- 172.21.15.146:0/3427796062 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63800ce3d0 msgr2=0x7f638015c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:38.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.716+0000 7f6385a74700 1 --2- 172.21.15.146:0/3427796062 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63800ce3d0 0x7f638015c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:38.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.716+0000 7f6385a74700 1 -- 172.21.15.146:0/3427796062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63800ae730 msgr2=0x7f63800c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:38.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.716+0000 7f6385a74700 1 --2- 172.21.15.146:0/3427796062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63800ae730 0x7f63800c8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:38.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.716+0000 7f6385a74700 1 -- 172.21.15.146:0/3427796062 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63700094f0 con 0x7f638015a160 2023-10-06T11:06:38.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.716+0000 7f6385a74700 1 --2- 172.21.15.146:0/3427796062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f638015a160 0x7f638015ccb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6378009ec0 tx=0x7f637800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:38.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.716+0000 7f63757fa700 1 -- 172.21.15.146:0/3427796062 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637800cb70 con 0x7f638015a160 2023-10-06T11:06:38.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.716+0000 7f63757fa700 1 -- 172.21.15.146:0/3427796062 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f637800f040 con 0x7f638015a160 2023-10-06T11:06:38.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.716+0000 7f63874d7700 1 -- 172.21.15.146:0/3427796062 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63800c9290 con 0x7f638015a160 2023-10-06T11:06:38.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.716+0000 7f63757fa700 1 -- 172.21.15.146:0/3427796062 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6378014480 con 0x7f638015a160 2023-10-06T11:06:38.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.716+0000 7f63874d7700 1 -- 172.21.15.146:0/3427796062 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63800c9850 con 0x7f638015a160 2023-10-06T11:06:38.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.717+0000 7f63874d7700 1 -- 172.21.15.146:0/3427796062 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6380068390 con 0x7f638015a160 2023-10-06T11:06:38.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.718+0000 7f63757fa700 1 -- 172.21.15.146:0/3427796062 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6378014830 con 0x7f638015a160 2023-10-06T11:06:38.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.718+0000 7f63757fa700 1 --2- 172.21.15.146:0/3427796062 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6364066f30 0x7f63640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:38.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.718+0000 7f63757fa700 1 -- 172.21.15.146:0/3427796062 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6378084f30 con 0x7f638015a160 2023-10-06T11:06:38.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.718+0000 7f6385273700 1 --2- 172.21.15.146:0/3427796062 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6364066f30 0x7f63640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:38.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.719+0000 7f6385273700 1 --2- 172.21.15.146:0/3427796062 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6364066f30 0x7f63640693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f637c006ea0 tx=0x7f637c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:38.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.722+0000 7f63757fa700 1 -- 172.21.15.146:0/3427796062 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6378052040 con 0x7f638015a160 2023-10-06T11:06:38.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:38.947+0000 7f63874d7700 1 -- 172.21.15.146:0/3427796062 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f63800c9d50 con 0x7f638015a160 2023-10-06T11:06:39.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.576+0000 7f63757fa700 1 -- 172.21.15.146:0/3427796062 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6378055660 con 0x7f638015a160 2023-10-06T11:06:39.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.579+0000 7f63874d7700 1 -- 172.21.15.146:0/3427796062 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6364066f30 msgr2=0x7f63640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:39.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.579+0000 7f63874d7700 1 --2- 172.21.15.146:0/3427796062 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6364066f30 0x7f63640693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f637c006ea0 tx=0x7f637c008040 comp rx=0 tx=0).stop 2023-10-06T11:06:39.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.579+0000 7f63874d7700 1 -- 172.21.15.146:0/3427796062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f638015a160 msgr2=0x7f638015ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:39.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.579+0000 7f63874d7700 1 --2- 172.21.15.146:0/3427796062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f638015a160 0x7f638015ccb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6378009ec0 tx=0x7f637800b040 comp rx=0 tx=0).stop 2023-10-06T11:06:39.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.579+0000 7f63874d7700 1 -- 172.21.15.146:0/3427796062 shutdown_connections 2023-10-06T11:06:39.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.579+0000 7f63874d7700 1 --2- 172.21.15.146:0/3427796062 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6364066f30 0x7f63640693e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:39.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.579+0000 7f63874d7700 1 --2- 172.21.15.146:0/3427796062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f638015a160 0x7f638015ccb0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:39.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.579+0000 7f63874d7700 1 --2- 172.21.15.146:0/3427796062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63800ae730 0x7f63800c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:39.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.579+0000 7f63874d7700 1 --2- 172.21.15.146:0/3427796062 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63800ce3d0 0x7f638015c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:39.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.579+0000 7f63874d7700 1 -- 172.21.15.146:0/3427796062 >> 172.21.15.146:0/3427796062 conn(0x7f638006f380 msgr2=0x7f63800c6950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:39.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.579+0000 7f63874d7700 1 -- 172.21.15.146:0/3427796062 shutdown_connections 2023-10-06T11:06:39.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.579+0000 7f63874d7700 1 -- 172.21.15.146:0/3427796062 wait complete. 2023-10-06T11:06:39.593 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:06:39.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.706+0000 7f7611af8700 1 Processor -- start 2023-10-06T11:06:39.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.706+0000 7f7611af8700 1 -- start start 2023-10-06T11:06:39.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.707+0000 7f7611af8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f760c153e80 0x7f760c15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:39.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.707+0000 7f7611af8700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f760c15ac30 con 0x7f760c153ab0 2023-10-06T11:06:39.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.707+0000 7f7611af8700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f760c0b4510 con 0x7f760c068ba0 2023-10-06T11:06:39.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.707+0000 7f7611af8700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f760c0b6530 con 0x7f760c153e80 2023-10-06T11:06:39.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.707+0000 7f760bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f760c153e80 0x7f760c15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:39.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.707+0000 7f760b7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f760c153ab0 0x7f760c068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52368/0 (socket says 172.21.15.146:52368) 2023-10-06T11:06:39.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.707+0000 7f760b7fe700 1 -- 172.21.15.146:0/4002269408 learned_addr learned my addr 172.21.15.146:0/4002269408 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:39.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.707+0000 7f760bfff700 1 -- 172.21.15.146:0/4002269408 >> v1:172.21.15.151:6789/0 conn(0x7f760c068ba0 legacy=0x7f760c0b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:39.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.707+0000 7f760bfff700 1 -- 172.21.15.146:0/4002269408 >> v1:172.21.15.146:6789/0 conn(0x7f760c153ab0 legacy=0x7f760c068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:39.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.707+0000 7f760bfff700 1 -- 172.21.15.146:0/4002269408 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c0b5c50 con 0x7f760c153e80 2023-10-06T11:06:39.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.707+0000 7f760a7fc700 1 -- 172.21.15.146:0/4002269408 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2957347249 0 0) 0x7f75fc001490 con 0x7f760c153ab0 2023-10-06T11:06:39.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.708+0000 7f760bfff700 1 --2- 172.21.15.146:0/4002269408 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f760c153e80 0x7f760c15a6f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f76040098e0 tx=0x7f76040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d051a349fe32227 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:39.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.708+0000 7f760a7fc700 1 -- 172.21.15.146:0/4002269408 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7604009e80 con 0x7f760c153e80 2023-10-06T11:06:39.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.708+0000 7f760a7fc700 1 -- 172.21.15.146:0/4002269408 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760400b860 con 0x7f760c153e80 2023-10-06T11:06:39.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.708+0000 7f760a7fc700 1 -- 172.21.15.146:0/4002269408 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760400bbe0 con 0x7f760c153e80 2023-10-06T11:06:39.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.708+0000 7f7611af8700 1 -- 172.21.15.146:0/4002269408 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f760c153e80 msgr2=0x7f760c15a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:39.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.708+0000 7f7611af8700 1 --2- 172.21.15.146:0/4002269408 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f760c153e80 0x7f760c15a6f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f76040098e0 tx=0x7f76040091a0 comp rx=0 tx=0).stop 2023-10-06T11:06:39.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.708+0000 7f7611af8700 1 -- 172.21.15.146:0/4002269408 shutdown_connections 2023-10-06T11:06:39.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.708+0000 7f7611af8700 1 --2- 172.21.15.146:0/4002269408 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f760c153e80 0x7f760c15a6f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:39.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.708+0000 7f7611af8700 1 -- 172.21.15.146:0/4002269408 >> 172.21.15.146:0/4002269408 conn(0x7f760c06eba0 msgr2=0x7f760c06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:39.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.708+0000 7f7611af8700 1 -- 172.21.15.146:0/4002269408 shutdown_connections 2023-10-06T11:06:39.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.708+0000 7f7611af8700 1 -- 172.21.15.146:0/4002269408 wait complete. 2023-10-06T11:06:39.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.709+0000 7f7611af8700 1 Processor -- start 2023-10-06T11:06:39.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.709+0000 7f7611af8700 1 -- start start 2023-10-06T11:06:39.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.710+0000 7f7611af8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f760c068ba0 0x7f760c0b1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:39.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.710+0000 7f7611af8700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f760c153ab0 0x7f760c158020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:39.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.710+0000 7f7611af8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f760c153e80 0x7f760c14fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:39.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.710+0000 7f7611af8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c154430 con 0x7f760c153e80 2023-10-06T11:06:39.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.710+0000 7f7611af8700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c158560 con 0x7f760c153ab0 2023-10-06T11:06:39.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.710+0000 7f7611af8700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f760c158810 con 0x7f760c068ba0 2023-10-06T11:06:39.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.710+0000 7f760bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f760c153e80 0x7f760c14fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:39.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.710+0000 7f760bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f760c153e80 0x7f760c14fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41918/0 (socket says 172.21.15.146:41918) 2023-10-06T11:06:39.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.710+0000 7f760bfff700 1 -- 172.21.15.146:0/3169473338 learned_addr learned my addr 172.21.15.146:0/3169473338 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:39.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.710+0000 7f760affd700 1 --2- 172.21.15.146:0/3169473338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f760c153ab0 0x7f760c158020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:39.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.710+0000 7f760b7fe700 1 --2- 172.21.15.146:0/3169473338 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f760c068ba0 0x7f760c0b1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:39.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.711+0000 7f760bfff700 1 -- 172.21.15.146:0/3169473338 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f760c068ba0 msgr2=0x7f760c0b1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:39.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.711+0000 7f760bfff700 1 --2- 172.21.15.146:0/3169473338 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f760c068ba0 0x7f760c0b1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:39.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.711+0000 7f760bfff700 1 -- 172.21.15.146:0/3169473338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f760c153ab0 msgr2=0x7f760c158020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:39.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.711+0000 7f760bfff700 1 --2- 172.21.15.146:0/3169473338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f760c153ab0 0x7f760c158020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:39.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.711+0000 7f760bfff700 1 -- 172.21.15.146:0/3169473338 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7604009420 con 0x7f760c153e80 2023-10-06T11:06:39.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.711+0000 7f760bfff700 1 --2- 172.21.15.146:0/3169473338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f760c153e80 0x7f760c14fe70 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f760c089010 tx=0x7f7604017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:39.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.711+0000 7f75f37fe700 1 -- 172.21.15.146:0/3169473338 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760401f070 con 0x7f760c153e80 2023-10-06T11:06:39.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.711+0000 7f75f37fe700 1 -- 172.21.15.146:0/3169473338 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7604011420 con 0x7f760c153e80 2023-10-06T11:06:39.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.711+0000 7f7611af8700 1 -- 172.21.15.146:0/3169473338 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f760c158af0 con 0x7f760c153e80 2023-10-06T11:06:39.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.711+0000 7f75f37fe700 1 -- 172.21.15.146:0/3169473338 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76040117e0 con 0x7f760c153e80 2023-10-06T11:06:39.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.711+0000 7f7611af8700 1 -- 172.21.15.146:0/3169473338 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f760c1590b0 con 0x7f760c153e80 2023-10-06T11:06:39.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.712+0000 7f7611af8700 1 -- 172.21.15.146:0/3169473338 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f760c1545e0 con 0x7f760c153e80 2023-10-06T11:06:39.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.712+0000 7f75f37fe700 1 -- 172.21.15.146:0/3169473338 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7604011b50 con 0x7f760c153e80 2023-10-06T11:06:39.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.713+0000 7f75f37fe700 1 --2- 172.21.15.146:0/3169473338 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f75f8066f30 0x7f75f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:39.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.713+0000 7f75f37fe700 1 -- 172.21.15.146:0/3169473338 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7604085e90 con 0x7f760c153e80 2023-10-06T11:06:39.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.713+0000 7f760b7fe700 1 --2- 172.21.15.146:0/3169473338 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f75f8066f30 0x7f75f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:39.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.713+0000 7f760b7fe700 1 --2- 172.21.15.146:0/3169473338 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f75f8066f30 0x7f75f80693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f75fc000f80 tx=0x7f75fc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:39.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.717+0000 7f75f37fe700 1 -- 172.21.15.146:0/3169473338 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f760c1545e0 con 0x7f760c153e80 2023-10-06T11:06:39.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.943+0000 7f7611af8700 1 -- 172.21.15.146:0/3169473338 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f760c04c380 con 0x7f760c153e80 2023-10-06T11:06:39.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.944+0000 7f75f37fe700 1 -- 172.21.15.146:0/3169473338 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4609 (secure 0 0 0) 0x7f7604053020 con 0x7f760c153e80 2023-10-06T11:06:39.946 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:06:39.946 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4673,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/1243531288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1243531288},{"type":"v1","addr":"172.21.15.151:6834","nonce":1243531288}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4676,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/4009288357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":4009288357},{"type":"v1","addr":"172.21.15.151:6835","nonce":4009288357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4983,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2777930290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2777930290},{"type":"v1","addr":"172.21.15.146:6836","nonce":2777930290}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:06:35.935256+0000","modified":"2023-10-06T11:06:39.571293+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4986},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4986":{"gid":4986,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/4187213529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":4187213529},{"type":"v1","addr":"172.21.15.146:6837","nonce":4187213529}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T11:06:39.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.946+0000 7f7611af8700 1 -- 172.21.15.146:0/3169473338 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f75f8066f30 msgr2=0x7f75f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:39.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.946+0000 7f7611af8700 1 --2- 172.21.15.146:0/3169473338 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f75f8066f30 0x7f75f80693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f75fc000f80 tx=0x7f75fc009040 comp rx=0 tx=0).stop 2023-10-06T11:06:39.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.946+0000 7f7611af8700 1 -- 172.21.15.146:0/3169473338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f760c153e80 msgr2=0x7f760c14fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:39.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.946+0000 7f7611af8700 1 --2- 172.21.15.146:0/3169473338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f760c153e80 0x7f760c14fe70 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f760c089010 tx=0x7f7604017000 comp rx=0 tx=0).stop 2023-10-06T11:06:39.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.946+0000 7f7611af8700 1 -- 172.21.15.146:0/3169473338 shutdown_connections 2023-10-06T11:06:39.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.946+0000 7f7611af8700 1 --2- 172.21.15.146:0/3169473338 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f75f8066f30 0x7f75f80693e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:39.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.946+0000 7f7611af8700 1 --2- 172.21.15.146:0/3169473338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f760c153e80 0x7f760c14fe70 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:39.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.946+0000 7f7611af8700 1 --2- 172.21.15.146:0/3169473338 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f760c068ba0 0x7f760c0b1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:39.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.946+0000 7f7611af8700 1 --2- 172.21.15.146:0/3169473338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f760c153ab0 0x7f760c158020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:39.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.946+0000 7f7611af8700 1 -- 172.21.15.146:0/3169473338 >> 172.21.15.146:0/3169473338 conn(0x7f760c06eba0 msgr2=0x7f760c0cedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:39.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.946+0000 7f7611af8700 1 -- 172.21.15.146:0/3169473338 shutdown_connections 2023-10-06T11:06:39.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:39.946+0000 7f7611af8700 1 -- 172.21.15.146:0/3169473338 wait complete. 2023-10-06T11:06:39.949 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 16 2023-10-06T11:06:39.960 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:06:40.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.072+0000 7f634e915700 1 Processor -- start 2023-10-06T11:06:40.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.072+0000 7f634e915700 1 -- start start 2023-10-06T11:06:40.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.073+0000 7f634e915700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f634815a7f0 0x7f634815cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:40.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.073+0000 7f634e915700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63480b2530 0x7f634815acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:40.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.073+0000 7f634e915700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f634815c630 con 0x7f634815a420 2023-10-06T11:06:40.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.073+0000 7f634e915700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63480ce040 con 0x7f634815a7f0 2023-10-06T11:06:40.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.073+0000 7f634e915700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f634815ba20 con 0x7f63480b2530 2023-10-06T11:06:40.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.073+0000 7f634d112700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f634815a7f0 0x7f634815cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:40.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.073+0000 7f634d913700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f634815a420 0x7f63480b1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:44508/0 (socket says 172.21.15.146:44508) 2023-10-06T11:06:40.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.073+0000 7f634e114700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63480b2530 0x7f634815acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:40.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.073+0000 7f634d913700 1 -- 172.21.15.146:0/3194762551 learned_addr learned my addr 172.21.15.146:0/3194762551 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:40.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.074+0000 7f634e114700 1 -- 172.21.15.146:0/3194762551 >> v2:172.21.15.151:3300/0 conn(0x7f634815a7f0 msgr2=0x7f634815cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:40.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.074+0000 7f634e114700 1 --2- 172.21.15.146:0/3194762551 >> v2:172.21.15.151:3300/0 conn(0x7f634815a7f0 0x7f634815cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:40.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.074+0000 7f634e114700 1 -- 172.21.15.146:0/3194762551 >> v1:172.21.15.151:6789/0 conn(0x7f634815a420 legacy=0x7f63480b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:40.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.074+0000 7f634e114700 1 -- 172.21.15.146:0/3194762551 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f634815bd00 con 0x7f63480b2530 2023-10-06T11:06:40.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.074+0000 7f634c911700 1 -- 172.21.15.146:0/3194762551 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1979985237 0 0) 0x7f634815c630 con 0x7f634815a420 2023-10-06T11:06:40.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.074+0000 7f634d112700 1 --2- 172.21.15.146:0/3194762551 >> v2:172.21.15.151:3300/0 conn(0x7f634815a7f0 0x7f634815cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:06:40.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.074+0000 7f634e114700 1 --2- 172.21.15.146:0/3194762551 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63480b2530 0x7f634815acd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6340009e60 tx=0x7f6340009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d2e4d9781184a0f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:40.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.074+0000 7f634c911700 1 -- 172.21.15.146:0/3194762551 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634000e070 con 0x7f63480b2530 2023-10-06T11:06:40.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.074+0000 7f634c911700 1 -- 172.21.15.146:0/3194762551 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f634000bb60 con 0x7f63480b2530 2023-10-06T11:06:40.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.074+0000 7f634c911700 1 -- 172.21.15.146:0/3194762551 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6340012430 con 0x7f63480b2530 2023-10-06T11:06:40.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.074+0000 7f634e915700 1 -- 172.21.15.146:0/3194762551 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63480b2530 msgr2=0x7f634815acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:40.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.074+0000 7f634e915700 1 --2- 172.21.15.146:0/3194762551 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63480b2530 0x7f634815acd0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6340009e60 tx=0x7f6340009780 comp rx=0 tx=0).stop 2023-10-06T11:06:40.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.074+0000 7f634e915700 1 -- 172.21.15.146:0/3194762551 shutdown_connections 2023-10-06T11:06:40.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.074+0000 7f634e915700 1 --2- 172.21.15.146:0/3194762551 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63480b2530 0x7f634815acd0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:40.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.075+0000 7f634e915700 1 --2- 172.21.15.146:0/3194762551 >> v2:172.21.15.151:3300/0 conn(0x7f634815a7f0 0x7f634815cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:40.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.075+0000 7f634e915700 1 -- 172.21.15.146:0/3194762551 >> 172.21.15.146:0/3194762551 conn(0x7f634806eba0 msgr2=0x7f634806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:40.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.075+0000 7f634e915700 1 -- 172.21.15.146:0/3194762551 shutdown_connections 2023-10-06T11:06:40.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.075+0000 7f634e915700 1 -- 172.21.15.146:0/3194762551 wait complete. 2023-10-06T11:06:40.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.076+0000 7f634e915700 1 Processor -- start 2023-10-06T11:06:40.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.076+0000 7f634e915700 1 -- start start 2023-10-06T11:06:40.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.076+0000 7f634e915700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63480b2530 0x7f63481486c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:40.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.076+0000 7f634e915700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f634815a420 0x7f634814cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:40.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.076+0000 7f634e915700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f634815a7f0 0x7f634813ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:40.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.076+0000 7f634e915700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63480ceb30 con 0x7f634815a7f0 2023-10-06T11:06:40.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.076+0000 7f634e915700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6348149030 con 0x7f634815a420 2023-10-06T11:06:40.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.076+0000 7f634e915700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6348149310 con 0x7f63480b2530 2023-10-06T11:06:40.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.077+0000 7f634e114700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f634815a7f0 0x7f634813ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:40.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.077+0000 7f634e114700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f634815a7f0 0x7f634813ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41930/0 (socket says 172.21.15.146:41930) 2023-10-06T11:06:40.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.077+0000 7f634e114700 1 -- 172.21.15.146:0/2061259129 learned_addr learned my addr 172.21.15.146:0/2061259129 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:40.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.077+0000 7f634d112700 1 --2- 172.21.15.146:0/2061259129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f634815a420 0x7f634814cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:40.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.077+0000 7f634d913700 1 --2- 172.21.15.146:0/2061259129 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63480b2530 0x7f63481486c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:40.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.077+0000 7f634e114700 1 -- 172.21.15.146:0/2061259129 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63480b2530 msgr2=0x7f63481486c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:40.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.077+0000 7f634e114700 1 --2- 172.21.15.146:0/2061259129 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63480b2530 0x7f63481486c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:40.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.077+0000 7f634e114700 1 -- 172.21.15.146:0/2061259129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f634815a420 msgr2=0x7f634814cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:40.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.077+0000 7f634e114700 1 --2- 172.21.15.146:0/2061259129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f634815a420 0x7f634814cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:40.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.077+0000 7f634e114700 1 -- 172.21.15.146:0/2061259129 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6338009420 con 0x7f634815a7f0 2023-10-06T11:06:40.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.077+0000 7f634e114700 1 --2- 172.21.15.146:0/2061259129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f634815a7f0 0x7f634813ba20 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6340013000 tx=0x7f6340019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:40.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.077+0000 7f633dffb700 1 -- 172.21.15.146:0/2061259129 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6340012ea0 con 0x7f634815a7f0 2023-10-06T11:06:40.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.077+0000 7f634e915700 1 -- 172.21.15.146:0/2061259129 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6340009a20 con 0x7f634815a7f0 2023-10-06T11:06:40.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.077+0000 7f633dffb700 1 -- 172.21.15.146:0/2061259129 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6340027470 con 0x7f634815a7f0 2023-10-06T11:06:40.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.077+0000 7f633dffb700 1 -- 172.21.15.146:0/2061259129 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6340027830 con 0x7f634815a7f0 2023-10-06T11:06:40.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.077+0000 7f634e915700 1 -- 172.21.15.146:0/2061259129 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6348148c00 con 0x7f634815a7f0 2023-10-06T11:06:40.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.078+0000 7f634e915700 1 -- 172.21.15.146:0/2061259129 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6348149830 con 0x7f634815a7f0 2023-10-06T11:06:40.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.079+0000 7f633dffb700 1 -- 172.21.15.146:0/2061259129 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6340024070 con 0x7f634815a7f0 2023-10-06T11:06:40.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.079+0000 7f633dffb700 1 --2- 172.21.15.146:0/2061259129 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f632c066f30 0x7f632c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:40.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.079+0000 7f633dffb700 1 -- 172.21.15.146:0/2061259129 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6340086d50 con 0x7f634815a7f0 2023-10-06T11:06:40.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.079+0000 7f634d913700 1 --2- 172.21.15.146:0/2061259129 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f632c066f30 0x7f632c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:40.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.079+0000 7f634d913700 1 --2- 172.21.15.146:0/2061259129 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f632c066f30 0x7f632c0693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6344007fd0 tx=0x7f6344007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:40.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.083+0000 7f633dffb700 1 -- 172.21.15.146:0/2061259129 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6348149830 con 0x7f634815a7f0 2023-10-06T11:06:40.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.270+0000 7f634e915700 1 -- 172.21.15.146:0/2061259129 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63480ce900 con 0x7f634815a7f0 2023-10-06T11:06:40.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.270+0000 7f633dffb700 1 -- 172.21.15.146:0/2061259129 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16914 (secure 0 0 0) 0x7f63480ce900 con 0x7f634815a7f0 2023-10-06T11:06:40.272 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:06:40.273 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":31,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:06:37.560729+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:06:34.036525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T11:06:34.902843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:06:40.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.273+0000 7f634e915700 1 -- 172.21.15.146:0/2061259129 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f632c066f30 msgr2=0x7f632c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:40.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.273+0000 7f634e915700 1 --2- 172.21.15.146:0/2061259129 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f632c066f30 0x7f632c0693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6344007fd0 tx=0x7f6344007d30 comp rx=0 tx=0).stop 2023-10-06T11:06:40.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.273+0000 7f634e915700 1 -- 172.21.15.146:0/2061259129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f634815a7f0 msgr2=0x7f634813ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:40.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.273+0000 7f634e915700 1 --2- 172.21.15.146:0/2061259129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f634815a7f0 0x7f634813ba20 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6340013000 tx=0x7f6340019000 comp rx=0 tx=0).stop 2023-10-06T11:06:40.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.273+0000 7f634e915700 1 -- 172.21.15.146:0/2061259129 shutdown_connections 2023-10-06T11:06:40.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.273+0000 7f634e915700 1 --2- 172.21.15.146:0/2061259129 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f632c066f30 0x7f632c0693e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:40.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.273+0000 7f634e915700 1 --2- 172.21.15.146:0/2061259129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f634815a7f0 0x7f634813ba20 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:40.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.273+0000 7f634e915700 1 --2- 172.21.15.146:0/2061259129 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63480b2530 0x7f63481486c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:40.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.273+0000 7f634e915700 1 --2- 172.21.15.146:0/2061259129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f634815a420 0x7f634814cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:40.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.273+0000 7f634e915700 1 -- 172.21.15.146:0/2061259129 >> 172.21.15.146:0/2061259129 conn(0x7f634806eba0 msgr2=0x7f6348147f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:40.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.273+0000 7f634e915700 1 -- 172.21.15.146:0/2061259129 shutdown_connections 2023-10-06T11:06:40.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.273+0000 7f634e915700 1 -- 172.21.15.146:0/2061259129 wait complete. 2023-10-06T11:06:40.287 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T11:06:40.287 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:06:40.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.400+0000 7fd068ed1700 1 Processor -- start 2023-10-06T11:06:40.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.400+0000 7fd068ed1700 1 -- start start 2023-10-06T11:06:40.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.401+0000 7fd068ed1700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd064153ab0 0x7fd06415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:40.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.401+0000 7fd068ed1700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd064068ba0 0x7fd0640b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:40.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.401+0000 7fd068ed1700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd06415ac30 con 0x7fd064153e80 2023-10-06T11:06:40.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.401+0000 7fd068ed1700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0640b4510 con 0x7fd064153ab0 2023-10-06T11:06:40.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.401+0000 7fd068ed1700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0640b6530 con 0x7fd064068ba0 2023-10-06T11:06:40.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.401+0000 7fd06259c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd064153ab0 0x7fd06415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:40.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.401+0000 7fd059d9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd064153e80 0x7fd064068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52384/0 (socket says 172.21.15.146:52384) 2023-10-06T11:06:40.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.401+0000 7fd059d9b700 1 -- 172.21.15.146:0/836933110 learned_addr learned my addr 172.21.15.146:0/836933110 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:40.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.401+0000 7fd062d9d700 1 --2- 172.21.15.146:0/836933110 >> v2:172.21.15.151:3300/0 conn(0x7fd064068ba0 0x7fd0640b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:40.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.401+0000 7fd06259c700 1 -- 172.21.15.146:0/836933110 >> v2:172.21.15.151:3300/0 conn(0x7fd064068ba0 msgr2=0x7fd0640b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:40.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.401+0000 7fd06259c700 1 --2- 172.21.15.146:0/836933110 >> v2:172.21.15.151:3300/0 conn(0x7fd064068ba0 0x7fd0640b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:40.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.401+0000 7fd06259c700 1 -- 172.21.15.146:0/836933110 >> v1:172.21.15.146:6789/0 conn(0x7fd064153e80 legacy=0x7fd064068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:40.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.401+0000 7fd061d9b700 1 -- 172.21.15.146:0/836933110 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2090545451 0 0) 0x7fd04c001110 con 0x7fd064153e80 2023-10-06T11:06:40.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.401+0000 7fd06259c700 1 -- 172.21.15.146:0/836933110 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0640b5c50 con 0x7fd064153ab0 2023-10-06T11:06:40.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.401+0000 7fd062d9d700 1 --2- 172.21.15.146:0/836933110 >> v2:172.21.15.151:3300/0 conn(0x7fd064068ba0 0x7fd0640b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:06:40.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.401+0000 7fd06259c700 1 --2- 172.21.15.146:0/836933110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd064153ab0 0x7fd06415a6f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd0640b36d0 tx=0x7fd0540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6201b18bb2596199 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:40.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.401+0000 7fd061d9b700 1 -- 172.21.15.146:0/836933110 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05400b6b0 con 0x7fd064153ab0 2023-10-06T11:06:40.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.401+0000 7fd061d9b700 1 -- 172.21.15.146:0/836933110 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05400b810 con 0x7fd064153ab0 2023-10-06T11:06:40.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.401+0000 7fd061d9b700 1 -- 172.21.15.146:0/836933110 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05400bbb0 con 0x7fd064153ab0 2023-10-06T11:06:40.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.402+0000 7fd068ed1700 1 -- 172.21.15.146:0/836933110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd064153ab0 msgr2=0x7fd06415a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:40.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.402+0000 7fd068ed1700 1 --2- 172.21.15.146:0/836933110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd064153ab0 0x7fd06415a6f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd0640b36d0 tx=0x7fd0540091a0 comp rx=0 tx=0).stop 2023-10-06T11:06:40.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.402+0000 7fd068ed1700 1 -- 172.21.15.146:0/836933110 shutdown_connections 2023-10-06T11:06:40.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.402+0000 7fd068ed1700 1 --2- 172.21.15.146:0/836933110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd064153ab0 0x7fd06415a6f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:40.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.402+0000 7fd068ed1700 1 --2- 172.21.15.146:0/836933110 >> v2:172.21.15.151:3300/0 conn(0x7fd064068ba0 0x7fd0640b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:40.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.402+0000 7fd068ed1700 1 -- 172.21.15.146:0/836933110 >> 172.21.15.146:0/836933110 conn(0x7fd06406eba0 msgr2=0x7fd06406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:40.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.402+0000 7fd068ed1700 1 -- 172.21.15.146:0/836933110 shutdown_connections 2023-10-06T11:06:40.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.402+0000 7fd068ed1700 1 -- 172.21.15.146:0/836933110 wait complete. 2023-10-06T11:06:40.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.403+0000 7fd068ed1700 1 Processor -- start 2023-10-06T11:06:40.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.403+0000 7fd068ed1700 1 -- start start 2023-10-06T11:06:40.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.404+0000 7fd068ed1700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd064068ba0 0x7fd0640c55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:40.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.404+0000 7fd068ed1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd064153ab0 0x7fd064140ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:40.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.404+0000 7fd068ed1700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd064153e80 0x7fd064141400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.404+0000 7fd068ed1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06416b090 con 0x7fd064153ab0 2023-10-06T11:06:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.404+0000 7fd068ed1700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0641562a0 con 0x7fd064068ba0 2023-10-06T11:06:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.404+0000 7fd068ed1700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd064156580 con 0x7fd064153e80 2023-10-06T11:06:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.404+0000 7fd059d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd064153ab0 0x7fd064140ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.404+0000 7fd059d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd064153ab0 0x7fd064140ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41950/0 (socket says 172.21.15.146:41950) 2023-10-06T11:06:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.404+0000 7fd059d9b700 1 -- 172.21.15.146:0/4135157248 learned_addr learned my addr 172.21.15.146:0/4135157248 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.404+0000 7fd062d9d700 1 --2- 172.21.15.146:0/4135157248 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd064153e80 0x7fd064141400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.404+0000 7fd06259c700 1 --2- 172.21.15.146:0/4135157248 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd064068ba0 0x7fd0640c55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.404+0000 7fd059d9b700 1 -- 172.21.15.146:0/4135157248 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd064153e80 msgr2=0x7fd064141400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.404+0000 7fd059d9b700 1 --2- 172.21.15.146:0/4135157248 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd064153e80 0x7fd064141400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.404+0000 7fd059d9b700 1 -- 172.21.15.146:0/4135157248 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd064068ba0 msgr2=0x7fd0640c55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.404+0000 7fd059d9b700 1 --2- 172.21.15.146:0/4135157248 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd064068ba0 0x7fd0640c55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:40.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.404+0000 7fd059d9b700 1 -- 172.21.15.146:0/4135157248 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd054009420 con 0x7fd064153ab0 2023-10-06T11:06:40.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.404+0000 7fd062d9d700 1 --2- 172.21.15.146:0/4135157248 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd064153e80 0x7fd064141400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:06:40.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.404+0000 7fd06259c700 1 --2- 172.21.15.146:0/4135157248 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd064068ba0 0x7fd0640c55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:06:40.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.404+0000 7fd059d9b700 1 --2- 172.21.15.146:0/4135157248 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd064153ab0 0x7fd064140ec0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd04c00c810 tx=0x7fd04c007c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:40.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.405+0000 7fd05affd700 1 -- 172.21.15.146:0/4135157248 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04c005b30 con 0x7fd064153ab0 2023-10-06T11:06:40.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.405+0000 7fd05affd700 1 -- 172.21.15.146:0/4135157248 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd04c005c90 con 0x7fd064153ab0 2023-10-06T11:06:40.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.405+0000 7fd068ed1700 1 -- 172.21.15.146:0/4135157248 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd064156860 con 0x7fd064153ab0 2023-10-06T11:06:40.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.405+0000 7fd05affd700 1 -- 172.21.15.146:0/4135157248 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04c007340 con 0x7fd064153ab0 2023-10-06T11:06:40.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.405+0000 7fd068ed1700 1 -- 172.21.15.146:0/4135157248 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0640c5b30 con 0x7fd064153ab0 2023-10-06T11:06:40.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.406+0000 7fd068ed1700 1 -- 172.21.15.146:0/4135157248 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd06416b240 con 0x7fd064153ab0 2023-10-06T11:06:40.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.406+0000 7fd05affd700 1 -- 172.21.15.146:0/4135157248 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd04c01b400 con 0x7fd064153ab0 2023-10-06T11:06:40.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.406+0000 7fd05affd700 1 --2- 172.21.15.146:0/4135157248 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd044066f30 0x7fd0440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:40.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.406+0000 7fd05affd700 1 -- 172.21.15.146:0/4135157248 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd04c083fc0 con 0x7fd064153ab0 2023-10-06T11:06:40.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.406+0000 7fd06259c700 1 --2- 172.21.15.146:0/4135157248 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd044066f30 0x7fd0440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:40.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.407+0000 7fd06259c700 1 --2- 172.21.15.146:0/4135157248 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd044066f30 0x7fd0440693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd0540093f0 tx=0x7fd054017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:40.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.411+0000 7fd05affd700 1 -- 172.21.15.146:0/4135157248 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd06416b240 con 0x7fd064153ab0 2023-10-06T11:06:40.532 INFO:tasks.ceph.mds.c.smithi146.stderr:2023-10-06T11:06:40.531+0000 7f58fd6c5700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T11:06:40.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.591+0000 7fd068ed1700 1 -- 172.21.15.146:0/4135157248 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd06415ac30 con 0x7fd044066f30 2023-10-06T11:06:40.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.599+0000 7fd05affd700 1 -- 172.21.15.146:0/4135157248 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284891 (secure 0 0 0) 0x7fd06415ac30 con 0x7fd044066f30 2023-10-06T11:06:40.605 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:06:40.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.602+0000 7fd068ed1700 1 -- 172.21.15.146:0/4135157248 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd044066f30 msgr2=0x7fd0440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:40.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.602+0000 7fd068ed1700 1 --2- 172.21.15.146:0/4135157248 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd044066f30 0x7fd0440693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd0540093f0 tx=0x7fd054017000 comp rx=0 tx=0).stop 2023-10-06T11:06:40.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.602+0000 7fd068ed1700 1 -- 172.21.15.146:0/4135157248 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd064153ab0 msgr2=0x7fd064140ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:40.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.602+0000 7fd068ed1700 1 --2- 172.21.15.146:0/4135157248 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd064153ab0 0x7fd064140ec0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd04c00c810 tx=0x7fd04c007c50 comp rx=0 tx=0).stop 2023-10-06T11:06:40.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.602+0000 7fd068ed1700 1 -- 172.21.15.146:0/4135157248 shutdown_connections 2023-10-06T11:06:40.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.602+0000 7fd068ed1700 1 --2- 172.21.15.146:0/4135157248 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd044066f30 0x7fd0440693e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:40.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.602+0000 7fd068ed1700 1 --2- 172.21.15.146:0/4135157248 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd064153e80 0x7fd064141400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:40.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.602+0000 7fd068ed1700 1 --2- 172.21.15.146:0/4135157248 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd064068ba0 0x7fd0640c55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:40.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.602+0000 7fd068ed1700 1 --2- 172.21.15.146:0/4135157248 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd064153ab0 0x7fd064140ec0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:40.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.602+0000 7fd068ed1700 1 -- 172.21.15.146:0/4135157248 >> 172.21.15.146:0/4135157248 conn(0x7fd06406eba0 msgr2=0x7fd0640b1f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:40.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.602+0000 7fd068ed1700 1 -- 172.21.15.146:0/4135157248 shutdown_connections 2023-10-06T11:06:40.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.602+0000 7fd068ed1700 1 -- 172.21.15.146:0/4135157248 wait complete. 2023-10-06T11:06:40.609 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:06:40.615 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2023-10-06T11:06:39.152719+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590922,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":172,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":74,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381988,"kb_used_data":3684,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592732,"statfs":{"total":773094113280,"available":770654957568,"internally_reserved":0,"allocated":3772416,"data_stored":2196014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":554,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.606359"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.555937+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:10:47.800013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.555568+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:53.550011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.561454+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:12:02.043126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.558319+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:55:04.265993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.556959+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:57:12.272427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.577548+0000","last_change":"2023-10-06T11:06:36.577548+0000","last_active":"2023-10-06T11:06:36.577548+0000","last_peered":"2023-10-06T11:06:36.577548+0000","last_clean":"2023-10-06T11:06:36.577548+0000","last_became_active":"2023-10-06T11:06:36.577311+0000","last_became_peered":"2023-10-06T11:06:36.577311+0000","last_unstale":"2023-10-06T11:06:36.577548+0000","last_undegraded":"2023-10-06T11:06:36.577548+0000","last_fullsized":"2023-10-06T11:06:36.577548+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:42:19.402886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.554712+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:54:47.482196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.555530+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:02.184653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.559560+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:27.615158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.558009+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:59:13.791303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.557630+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:35:12.331105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.558756+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:54.497548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.557611+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:27.615158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.566565+0000","last_change":"2023-10-06T11:06:36.566565+0000","last_active":"2023-10-06T11:06:36.566565+0000","last_peered":"2023-10-06T11:06:36.566565+0000","last_clean":"2023-10-06T11:06:36.566565+0000","last_became_active":"2023-10-06T11:06:36.566292+0000","last_became_peered":"2023-10-06T11:06:36.566292+0000","last_unstale":"2023-10-06T11:06:36.566565+0000","last_undegraded":"2023-10-06T11:06:36.566565+0000","last_fullsized":"2023-10-06T11:06:36.566565+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:40:32.681590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.556104+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:04:06.576517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.566902+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:02.184653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.566595+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:59:13.791303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.572882+0000","last_change":"2023-10-06T11:06:36.572882+0000","last_active":"2023-10-06T11:06:36.572882+0000","last_peered":"2023-10-06T11:06:36.572882+0000","last_clean":"2023-10-06T11:06:36.572882+0000","last_became_active":"2023-10-06T11:06:36.572597+0000","last_became_peered":"2023-10-06T11:06:36.572597+0000","last_unstale":"2023-10-06T11:06:36.572882+0000","last_undegraded":"2023-10-06T11:06:36.572882+0000","last_fullsized":"2023-10-06T11:06:36.572882+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:37:27.797737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.556450+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:21:21.228875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.578432+0000","last_change":"2023-10-06T11:06:36.578432+0000","last_active":"2023-10-06T11:06:36.578432+0000","last_peered":"2023-10-06T11:06:36.578432+0000","last_clean":"2023-10-06T11:06:36.578432+0000","last_became_active":"2023-10-06T11:06:36.578156+0000","last_became_peered":"2023-10-06T11:06:36.578156+0000","last_unstale":"2023-10-06T11:06:36.578432+0000","last_undegraded":"2023-10-06T11:06:36.578432+0000","last_fullsized":"2023-10-06T11:06:36.578432+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:53.558991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.556166+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:46:45.723235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.565509+0000","last_change":"2023-10-06T11:06:36.565509+0000","last_active":"2023-10-06T11:06:36.565509+0000","last_peered":"2023-10-06T11:06:36.565509+0000","last_clean":"2023-10-06T11:06:36.565509+0000","last_became_active":"2023-10-06T11:06:36.565187+0000","last_became_peered":"2023-10-06T11:06:36.565187+0000","last_unstale":"2023-10-06T11:06:36.565509+0000","last_undegraded":"2023-10-06T11:06:36.565509+0000","last_fullsized":"2023-10-06T11:06:36.565509+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:15:22.214670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.562630+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:04:06.576517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.556572+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:22:13.035423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.568754+0000","last_change":"2023-10-06T11:06:36.568754+0000","last_active":"2023-10-06T11:06:36.568754+0000","last_peered":"2023-10-06T11:06:36.568754+0000","last_clean":"2023-10-06T11:06:36.568754+0000","last_became_active":"2023-10-06T11:06:36.567464+0000","last_became_peered":"2023-10-06T11:06:36.567464+0000","last_unstale":"2023-10-06T11:06:36.568754+0000","last_undegraded":"2023-10-06T11:06:36.568754+0000","last_fullsized":"2023-10-06T11:06:36.568754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:54:47.482196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.568939+0000","last_change":"2023-10-06T11:06:36.568939+0000","last_active":"2023-10-06T11:06:36.568939+0000","last_peered":"2023-10-06T11:06:36.568939+0000","last_clean":"2023-10-06T11:06:36.568939+0000","last_became_active":"2023-10-06T11:06:36.567759+0000","last_became_peered":"2023-10-06T11:06:36.567759+0000","last_unstale":"2023-10-06T11:06:36.568939+0000","last_undegraded":"2023-10-06T11:06:36.568939+0000","last_fullsized":"2023-10-06T11:06:36.568939+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:59:13.791303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.566548+0000","last_change":"2023-10-06T11:06:36.566548+0000","last_active":"2023-10-06T11:06:36.566548+0000","last_peered":"2023-10-06T11:06:36.566548+0000","last_clean":"2023-10-06T11:06:36.566548+0000","last_became_active":"2023-10-06T11:06:36.566290+0000","last_became_peered":"2023-10-06T11:06:36.566290+0000","last_unstale":"2023-10-06T11:06:36.566548+0000","last_undegraded":"2023-10-06T11:06:36.566548+0000","last_fullsized":"2023-10-06T11:06:36.566548+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:27.799403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.554784+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:48:39.453895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.568346+0000","last_change":"2023-10-06T11:06:36.568346+0000","last_active":"2023-10-06T11:06:36.568346+0000","last_peered":"2023-10-06T11:06:36.568346+0000","last_clean":"2023-10-06T11:06:36.568346+0000","last_became_active":"2023-10-06T11:06:36.568044+0000","last_became_peered":"2023-10-06T11:06:36.568044+0000","last_unstale":"2023-10-06T11:06:36.568346+0000","last_undegraded":"2023-10-06T11:06:36.568346+0000","last_fullsized":"2023-10-06T11:06:36.568346+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:02:06.190668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.578800+0000","last_change":"2023-10-06T11:06:36.578800+0000","last_active":"2023-10-06T11:06:36.578800+0000","last_peered":"2023-10-06T11:06:36.578800+0000","last_clean":"2023-10-06T11:06:36.578800+0000","last_became_active":"2023-10-06T11:06:36.577352+0000","last_became_peered":"2023-10-06T11:06:36.577352+0000","last_unstale":"2023-10-06T11:06:36.578800+0000","last_undegraded":"2023-10-06T11:06:36.578800+0000","last_fullsized":"2023-10-06T11:06:36.578800+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:18:51.654155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.566095+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:12:02.043126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.561959+0000","last_change":"2023-10-06T11:06:36.561959+0000","last_active":"2023-10-06T11:06:36.561959+0000","last_peered":"2023-10-06T11:06:36.561959+0000","last_clean":"2023-10-06T11:06:36.561959+0000","last_became_active":"2023-10-06T11:06:36.561663+0000","last_became_peered":"2023-10-06T11:06:36.561663+0000","last_unstale":"2023-10-06T11:06:36.561959+0000","last_undegraded":"2023-10-06T11:06:36.561959+0000","last_fullsized":"2023-10-06T11:06:36.561959+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:27.615158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.563727+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:46:45.723235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"30'4","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.579947+0000","last_change":"2023-10-06T11:06:35.569189+0000","last_active":"2023-10-06T11:06:36.579947+0000","last_peered":"2023-10-06T11:06:36.579947+0000","last_clean":"2023-10-06T11:06:36.579947+0000","last_became_active":"2023-10-06T11:06:35.568921+0000","last_became_peered":"2023-10-06T11:06:35.568921+0000","last_unstale":"2023-10-06T11:06:36.579947+0000","last_undegraded":"2023-10-06T11:06:36.579947+0000","last_fullsized":"2023-10-06T11:06:36.579947+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:24:57.695098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.576765+0000","last_change":"2023-10-06T11:06:36.576765+0000","last_active":"2023-10-06T11:06:36.576765+0000","last_peered":"2023-10-06T11:06:36.576765+0000","last_clean":"2023-10-06T11:06:36.576765+0000","last_became_active":"2023-10-06T11:06:36.576511+0000","last_became_peered":"2023-10-06T11:06:36.576511+0000","last_unstale":"2023-10-06T11:06:36.576765+0000","last_undegraded":"2023-10-06T11:06:36.576765+0000","last_fullsized":"2023-10-06T11:06:36.576765+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:12:02.043126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.569717+0000","last_change":"2023-10-06T11:06:35.569717+0000","last_active":"2023-10-06T11:06:35.569717+0000","last_peered":"2023-10-06T11:06:35.569717+0000","last_clean":"2023-10-06T11:06:35.569717+0000","last_became_active":"2023-10-06T11:06:35.569537+0000","last_became_peered":"2023-10-06T11:06:35.569537+0000","last_unstale":"2023-10-06T11:06:35.569717+0000","last_undegraded":"2023-10-06T11:06:35.569717+0000","last_fullsized":"2023-10-06T11:06:35.569717+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:48:38.446657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.566688+0000","last_change":"2023-10-06T11:06:36.566688+0000","last_active":"2023-10-06T11:06:36.566688+0000","last_peered":"2023-10-06T11:06:36.566688+0000","last_clean":"2023-10-06T11:06:36.566688+0000","last_became_active":"2023-10-06T11:06:36.566407+0000","last_became_peered":"2023-10-06T11:06:36.566407+0000","last_unstale":"2023-10-06T11:06:36.566688+0000","last_undegraded":"2023-10-06T11:06:36.566688+0000","last_fullsized":"2023-10-06T11:06:36.566688+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:11:13.106985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"30'2","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.577901+0000","last_change":"2023-10-06T11:06:35.568732+0000","last_active":"2023-10-06T11:06:36.577901+0000","last_peered":"2023-10-06T11:06:36.577901+0000","last_clean":"2023-10-06T11:06:36.577901+0000","last_became_active":"2023-10-06T11:06:35.568493+0000","last_became_peered":"2023-10-06T11:06:35.568493+0000","last_unstale":"2023-10-06T11:06:36.577901+0000","last_undegraded":"2023-10-06T11:06:36.577901+0000","last_fullsized":"2023-10-06T11:06:36.577901+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:26.792165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.555527+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:03:01.050221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"30'2","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.579816+0000","last_change":"2023-10-06T11:06:35.567485+0000","last_active":"2023-10-06T11:06:36.579816+0000","last_peered":"2023-10-06T11:06:36.579816+0000","last_clean":"2023-10-06T11:06:36.579816+0000","last_became_active":"2023-10-06T11:06:35.567162+0000","last_became_peered":"2023-10-06T11:06:35.567162+0000","last_unstale":"2023-10-06T11:06:36.579816+0000","last_undegraded":"2023-10-06T11:06:36.579816+0000","last_fullsized":"2023-10-06T11:06:36.579816+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:12:01.035888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.560206+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:24:26.471584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.572139+0000","last_change":"2023-10-06T11:06:35.572139+0000","last_active":"2023-10-06T11:06:35.572139+0000","last_peered":"2023-10-06T11:06:35.572139+0000","last_clean":"2023-10-06T11:06:35.572139+0000","last_became_active":"2023-10-06T11:06:35.566406+0000","last_became_peered":"2023-10-06T11:06:35.566406+0000","last_unstale":"2023-10-06T11:06:35.572139+0000","last_undegraded":"2023-10-06T11:06:35.572139+0000","last_fullsized":"2023-10-06T11:06:35.572139+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:55:03.258755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.555302+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:50:39.669447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.573473+0000","last_change":"2023-10-06T11:06:35.573473+0000","last_active":"2023-10-06T11:06:35.573473+0000","last_peered":"2023-10-06T11:06:35.573473+0000","last_clean":"2023-10-06T11:06:35.573473+0000","last_became_active":"2023-10-06T11:06:35.573204+0000","last_became_peered":"2023-10-06T11:06:35.573204+0000","last_unstale":"2023-10-06T11:06:35.573473+0000","last_undegraded":"2023-10-06T11:06:35.573473+0000","last_fullsized":"2023-10-06T11:06:35.573473+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:52.551753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.564722+0000","last_change":"2023-10-06T11:06:36.564722+0000","last_active":"2023-10-06T11:06:36.564722+0000","last_peered":"2023-10-06T11:06:36.564722+0000","last_clean":"2023-10-06T11:06:36.564722+0000","last_became_active":"2023-10-06T11:06:36.564429+0000","last_became_peered":"2023-10-06T11:06:36.564429+0000","last_unstale":"2023-10-06T11:06:36.564722+0000","last_undegraded":"2023-10-06T11:06:36.564722+0000","last_fullsized":"2023-10-06T11:06:36.564722+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:30:40.428266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.570363+0000","last_change":"2023-10-06T11:06:35.563757+0000","last_active":"2023-10-06T11:06:35.570363+0000","last_peered":"2023-10-06T11:06:35.570363+0000","last_clean":"2023-10-06T11:06:35.570363+0000","last_became_active":"2023-10-06T11:06:35.563499+0000","last_became_peered":"2023-10-06T11:06:35.563499+0000","last_unstale":"2023-10-06T11:06:35.570363+0000","last_undegraded":"2023-10-06T11:06:35.570363+0000","last_fullsized":"2023-10-06T11:06:35.570363+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:52.551753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.555463+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:12:02.043126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.568186+0000","last_change":"2023-10-06T11:06:35.566496+0000","last_active":"2023-10-06T11:06:35.568186+0000","last_peered":"2023-10-06T11:06:35.568186+0000","last_clean":"2023-10-06T11:06:35.568186+0000","last_became_active":"2023-10-06T11:06:35.566211+0000","last_became_peered":"2023-10-06T11:06:35.566211+0000","last_unstale":"2023-10-06T11:06:35.568186+0000","last_undegraded":"2023-10-06T11:06:35.568186+0000","last_fullsized":"2023-10-06T11:06:35.568186+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:42:18.395648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.556385+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:47:35.465132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.570888+0000","last_change":"2023-10-06T11:06:35.570888+0000","last_active":"2023-10-06T11:06:35.570888+0000","last_peered":"2023-10-06T11:06:35.570888+0000","last_clean":"2023-10-06T11:06:35.570888+0000","last_became_active":"2023-10-06T11:06:35.570608+0000","last_became_peered":"2023-10-06T11:06:35.570608+0000","last_unstale":"2023-10-06T11:06:35.570888+0000","last_undegraded":"2023-10-06T11:06:35.570888+0000","last_fullsized":"2023-10-06T11:06:35.570888+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:35:11.323866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.566534+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:03:01.050221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.570188+0000","last_change":"2023-10-06T11:06:35.570188+0000","last_active":"2023-10-06T11:06:35.570188+0000","last_peered":"2023-10-06T11:06:35.570188+0000","last_clean":"2023-10-06T11:06:35.570188+0000","last_became_active":"2023-10-06T11:06:35.565593+0000","last_became_peered":"2023-10-06T11:06:35.565593+0000","last_unstale":"2023-10-06T11:06:35.570188+0000","last_undegraded":"2023-10-06T11:06:35.570188+0000","last_fullsized":"2023-10-06T11:06:35.570188+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:37:26.790499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.559557+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:59:13.791303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.572003+0000","last_change":"2023-10-06T11:06:35.572003+0000","last_active":"2023-10-06T11:06:35.572003+0000","last_peered":"2023-10-06T11:06:35.572003+0000","last_clean":"2023-10-06T11:06:35.572003+0000","last_became_active":"2023-10-06T11:06:35.571696+0000","last_became_peered":"2023-10-06T11:06:35.571696+0000","last_unstale":"2023-10-06T11:06:35.572003+0000","last_undegraded":"2023-10-06T11:06:35.572003+0000","last_fullsized":"2023-10-06T11:06:35.572003+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:26.792165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.561650+0000","last_change":"2023-10-06T11:06:36.561650+0000","last_active":"2023-10-06T11:06:36.561650+0000","last_peered":"2023-10-06T11:06:36.561650+0000","last_clean":"2023-10-06T11:06:36.561650+0000","last_became_active":"2023-10-06T11:06:36.561402+0000","last_became_peered":"2023-10-06T11:06:36.561402+0000","last_unstale":"2023-10-06T11:06:36.561650+0000","last_undegraded":"2023-10-06T11:06:36.561650+0000","last_fullsized":"2023-10-06T11:06:36.561650+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:27:30.195353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.567043+0000","last_change":"2023-10-06T11:06:35.567043+0000","last_active":"2023-10-06T11:06:35.567043+0000","last_peered":"2023-10-06T11:06:35.567043+0000","last_clean":"2023-10-06T11:06:35.567043+0000","last_became_active":"2023-10-06T11:06:35.566798+0000","last_became_peered":"2023-10-06T11:06:35.566798+0000","last_unstale":"2023-10-06T11:06:35.567043+0000","last_undegraded":"2023-10-06T11:06:35.567043+0000","last_fullsized":"2023-10-06T11:06:35.567043+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:50:38.662209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.558529+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:04:06.576517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.566555+0000","last_change":"2023-10-06T11:06:35.566555+0000","last_active":"2023-10-06T11:06:35.566555+0000","last_peered":"2023-10-06T11:06:35.566555+0000","last_clean":"2023-10-06T11:06:35.566555+0000","last_became_active":"2023-10-06T11:06:35.566300+0000","last_became_peered":"2023-10-06T11:06:35.566300+0000","last_unstale":"2023-10-06T11:06:35.566555+0000","last_undegraded":"2023-10-06T11:06:35.566555+0000","last_fullsized":"2023-10-06T11:06:35.566555+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:48:38.446657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.554511+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:59:13.791303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.570171+0000","last_change":"2023-10-06T11:06:35.563788+0000","last_active":"2023-10-06T11:06:35.570171+0000","last_peered":"2023-10-06T11:06:35.570171+0000","last_clean":"2023-10-06T11:06:35.570171+0000","last_became_active":"2023-10-06T11:06:35.563536+0000","last_became_peered":"2023-10-06T11:06:35.563536+0000","last_unstale":"2023-10-06T11:06:35.570171+0000","last_undegraded":"2023-10-06T11:06:35.570171+0000","last_fullsized":"2023-10-06T11:06:35.570171+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:37:26.790499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.562604+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:35:12.331105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.569968+0000","last_change":"2023-10-06T11:06:35.568542+0000","last_active":"2023-10-06T11:06:35.569968+0000","last_peered":"2023-10-06T11:06:35.569968+0000","last_clean":"2023-10-06T11:06:35.569968+0000","last_became_active":"2023-10-06T11:06:35.568247+0000","last_became_peered":"2023-10-06T11:06:35.568247+0000","last_unstale":"2023-10-06T11:06:35.569968+0000","last_undegraded":"2023-10-06T11:06:35.569968+0000","last_fullsized":"2023-10-06T11:06:35.569968+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:47:34.457893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.555063+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:24:26.471584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.573522+0000","last_change":"2023-10-06T11:06:35.573522+0000","last_active":"2023-10-06T11:06:35.573522+0000","last_peered":"2023-10-06T11:06:35.573522+0000","last_clean":"2023-10-06T11:06:35.573522+0000","last_became_active":"2023-10-06T11:06:35.573233+0000","last_became_peered":"2023-10-06T11:06:35.573233+0000","last_unstale":"2023-10-06T11:06:35.573522+0000","last_undegraded":"2023-10-06T11:06:35.573522+0000","last_fullsized":"2023-10-06T11:06:35.573522+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:37:26.790499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.554705+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:27.615158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.562619+0000","last_change":"2023-10-06T11:06:35.562619+0000","last_active":"2023-10-06T11:06:35.562619+0000","last_peered":"2023-10-06T11:06:35.562619+0000","last_clean":"2023-10-06T11:06:35.562619+0000","last_became_active":"2023-10-06T11:06:35.562355+0000","last_became_peered":"2023-10-06T11:06:35.562355+0000","last_unstale":"2023-10-06T11:06:35.562619+0000","last_undegraded":"2023-10-06T11:06:35.562619+0000","last_fullsized":"2023-10-06T11:06:35.562619+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:02:05.183430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.560355+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:24:26.471584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"30'2","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.580615+0000","last_change":"2023-10-06T11:06:35.566348+0000","last_active":"2023-10-06T11:06:36.580615+0000","last_peered":"2023-10-06T11:06:36.580615+0000","last_clean":"2023-10-06T11:06:36.580615+0000","last_became_active":"2023-10-06T11:06:35.565126+0000","last_became_peered":"2023-10-06T11:06:35.565126+0000","last_unstale":"2023-10-06T11:06:36.580615+0000","last_undegraded":"2023-10-06T11:06:36.580615+0000","last_fullsized":"2023-10-06T11:06:36.580615+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:59:12.784065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.564115+0000","last_change":"2023-10-06T11:06:36.564115+0000","last_active":"2023-10-06T11:06:36.564115+0000","last_peered":"2023-10-06T11:06:36.564115+0000","last_clean":"2023-10-06T11:06:36.564115+0000","last_became_active":"2023-10-06T11:06:36.563844+0000","last_became_peered":"2023-10-06T11:06:36.563844+0000","last_unstale":"2023-10-06T11:06:36.564115+0000","last_undegraded":"2023-10-06T11:06:36.564115+0000","last_fullsized":"2023-10-06T11:06:36.564115+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:02.194639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.570646+0000","last_change":"2023-10-06T11:06:35.570646+0000","last_active":"2023-10-06T11:06:35.570646+0000","last_peered":"2023-10-06T11:06:35.570646+0000","last_clean":"2023-10-06T11:06:35.570646+0000","last_became_active":"2023-10-06T11:06:35.570386+0000","last_became_peered":"2023-10-06T11:06:35.570386+0000","last_unstale":"2023-10-06T11:06:35.570646+0000","last_undegraded":"2023-10-06T11:06:35.570646+0000","last_fullsized":"2023-10-06T11:06:35.570646+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:10.251950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.555475+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:24:58.702337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.571568+0000","last_change":"2023-10-06T11:06:35.568732+0000","last_active":"2023-10-06T11:06:35.571568+0000","last_peered":"2023-10-06T11:06:35.571568+0000","last_clean":"2023-10-06T11:06:35.571568+0000","last_became_active":"2023-10-06T11:06:35.568460+0000","last_became_peered":"2023-10-06T11:06:35.568460+0000","last_unstale":"2023-10-06T11:06:35.571568+0000","last_undegraded":"2023-10-06T11:06:35.571568+0000","last_fullsized":"2023-10-06T11:06:35.571568+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:25.431156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.562560+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:50:39.669447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.565612+0000","last_change":"2023-10-06T11:06:35.565612+0000","last_active":"2023-10-06T11:06:35.565612+0000","last_peered":"2023-10-06T11:06:35.565612+0000","last_clean":"2023-10-06T11:06:35.565612+0000","last_became_active":"2023-10-06T11:06:35.565373+0000","last_became_peered":"2023-10-06T11:06:35.565373+0000","last_unstale":"2023-10-06T11:06:35.565612+0000","last_undegraded":"2023-10-06T11:06:35.565612+0000","last_fullsized":"2023-10-06T11:06:35.565612+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:22.790704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.558753+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:46:45.723235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.563587+0000","last_change":"2023-10-06T11:06:35.563587+0000","last_active":"2023-10-06T11:06:35.563587+0000","last_peered":"2023-10-06T11:06:35.563587+0000","last_clean":"2023-10-06T11:06:35.563587+0000","last_became_active":"2023-10-06T11:06:35.562933+0000","last_became_peered":"2023-10-06T11:06:35.562933+0000","last_unstale":"2023-10-06T11:06:35.563587+0000","last_undegraded":"2023-10-06T11:06:35.563587+0000","last_fullsized":"2023-10-06T11:06:35.563587+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:27:16.186215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.555165+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:18:51.654155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.573385+0000","last_change":"2023-10-06T11:06:35.573385+0000","last_active":"2023-10-06T11:06:35.573385+0000","last_peered":"2023-10-06T11:06:35.573385+0000","last_clean":"2023-10-06T11:06:35.573385+0000","last_became_active":"2023-10-06T11:06:35.573110+0000","last_became_peered":"2023-10-06T11:06:35.573110+0000","last_unstale":"2023-10-06T11:06:35.573385+0000","last_undegraded":"2023-10-06T11:06:35.573385+0000","last_fullsized":"2023-10-06T11:06:35.573385+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:54:46.474958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.554379+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:54.497548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.565314+0000","last_change":"2023-10-06T11:06:35.565314+0000","last_active":"2023-10-06T11:06:35.565314+0000","last_peered":"2023-10-06T11:06:35.565314+0000","last_clean":"2023-10-06T11:06:35.565314+0000","last_became_active":"2023-10-06T11:06:35.565003+0000","last_became_peered":"2023-10-06T11:06:35.565003+0000","last_unstale":"2023-10-06T11:06:35.565314+0000","last_undegraded":"2023-10-06T11:06:35.565314+0000","last_fullsized":"2023-10-06T11:06:35.565314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:06:59.444199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.578091+0000","last_change":"2023-10-06T11:06:36.578091+0000","last_active":"2023-10-06T11:06:36.578091+0000","last_peered":"2023-10-06T11:06:36.578091+0000","last_clean":"2023-10-06T11:06:36.578091+0000","last_became_active":"2023-10-06T11:06:36.577829+0000","last_became_peered":"2023-10-06T11:06:36.577829+0000","last_unstale":"2023-10-06T11:06:36.578091+0000","last_undegraded":"2023-10-06T11:06:36.578091+0000","last_fullsized":"2023-10-06T11:06:36.578091+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:32:31.550090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.569823+0000","last_change":"2023-10-06T11:06:35.568012+0000","last_active":"2023-10-06T11:06:35.569823+0000","last_peered":"2023-10-06T11:06:35.569823+0000","last_clean":"2023-10-06T11:06:35.569823+0000","last_became_active":"2023-10-06T11:06:35.567630+0000","last_became_peered":"2023-10-06T11:06:35.567630+0000","last_unstale":"2023-10-06T11:06:35.569823+0000","last_undegraded":"2023-10-06T11:06:35.569823+0000","last_fullsized":"2023-10-06T11:06:35.569823+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:24:25.464345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.557148+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:06:35.557148+0000","last_peered":"2023-10-06T11:06:35.557148+0000","last_clean":"2023-10-06T11:06:35.557148+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:06:35.557148+0000","last_undegraded":"2023-10-06T11:06:35.557148+0000","last_fullsized":"2023-10-06T11:06:35.557148+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.564430+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:54.497548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.565611+0000","last_change":"2023-10-06T11:06:35.565611+0000","last_active":"2023-10-06T11:06:35.565611+0000","last_peered":"2023-10-06T11:06:35.565611+0000","last_clean":"2023-10-06T11:06:35.565611+0000","last_became_active":"2023-10-06T11:06:35.565425+0000","last_became_peered":"2023-10-06T11:06:35.565425+0000","last_unstale":"2023-10-06T11:06:35.565611+0000","last_undegraded":"2023-10-06T11:06:35.565611+0000","last_fullsized":"2023-10-06T11:06:35.565611+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:04:05.569279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T11:06:34.554099+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:06:34.554099+0000","last_peered":"2023-10-06T11:06:34.554099+0000","last_clean":"2023-10-06T11:06:34.554099+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:06:34.554099+0000","last_undegraded":"2023-10-06T11:06:34.554099+0000","last_fullsized":"2023-10-06T11:06:34.554099+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.568057+0000","last_change":"2023-10-06T11:06:36.568057+0000","last_active":"2023-10-06T11:06:36.568057+0000","last_peered":"2023-10-06T11:06:36.568057+0000","last_clean":"2023-10-06T11:06:36.568057+0000","last_became_active":"2023-10-06T11:06:36.567776+0000","last_became_peered":"2023-10-06T11:06:36.567776+0000","last_unstale":"2023-10-06T11:06:36.568057+0000","last_undegraded":"2023-10-06T11:06:36.568057+0000","last_fullsized":"2023-10-06T11:06:36.568057+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:54.497548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.571084+0000","last_change":"2023-10-06T11:06:35.571084+0000","last_active":"2023-10-06T11:06:35.571084+0000","last_peered":"2023-10-06T11:06:35.571084+0000","last_clean":"2023-10-06T11:06:35.571084+0000","last_became_active":"2023-10-06T11:06:35.570790+0000","last_became_peered":"2023-10-06T11:06:35.570790+0000","last_unstale":"2023-10-06T11:06:35.571084+0000","last_undegraded":"2023-10-06T11:06:35.571084+0000","last_fullsized":"2023-10-06T11:06:35.571084+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:25.431156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.563251+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:06:35.563251+0000","last_peered":"2023-10-06T11:06:35.563251+0000","last_clean":"2023-10-06T11:06:35.563251+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:06:35.563251+0000","last_undegraded":"2023-10-06T11:06:35.563251+0000","last_fullsized":"2023-10-06T11:06:35.563251+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":169,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T11:06:34.552651+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:06:34.552651+0000","last_peered":"2023-10-06T11:06:34.552651+0000","last_clean":"2023-10-06T11:06:34.552651+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:06:34.552651+0000","last_undegraded":"2023-10-06T11:06:34.552651+0000","last_fullsized":"2023-10-06T11:06:34.552651+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.566037+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:27.615158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.562232+0000","last_change":"2023-10-06T11:06:35.562232+0000","last_active":"2023-10-06T11:06:35.562232+0000","last_peered":"2023-10-06T11:06:35.562232+0000","last_clean":"2023-10-06T11:06:35.562232+0000","last_became_active":"2023-10-06T11:06:35.561976+0000","last_became_peered":"2023-10-06T11:06:35.561976+0000","last_unstale":"2023-10-06T11:06:35.562232+0000","last_undegraded":"2023-10-06T11:06:35.562232+0000","last_fullsized":"2023-10-06T11:06:35.562232+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:50:26.045766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T11:06:34.552999+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:06:34.552999+0000","last_peered":"2023-10-06T11:06:34.552999+0000","last_clean":"2023-10-06T11:06:34.552999+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:06:34.552999+0000","last_undegraded":"2023-10-06T11:06:34.552999+0000","last_fullsized":"2023-10-06T11:06:34.552999+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.556811+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:54.497548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.575854+0000","last_change":"2023-10-06T11:06:35.575854+0000","last_active":"2023-10-06T11:06:35.575854+0000","last_peered":"2023-10-06T11:06:35.575854+0000","last_clean":"2023-10-06T11:06:35.575854+0000","last_became_active":"2023-10-06T11:06:35.575563+0000","last_became_peered":"2023-10-06T11:06:35.575563+0000","last_unstale":"2023-10-06T11:06:35.575854+0000","last_undegraded":"2023-10-06T11:06:35.575854+0000","last_fullsized":"2023-10-06T11:06:35.575854+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:18:50.646916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T11:06:34.552645+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:06:34.552645+0000","last_peered":"2023-10-06T11:06:34.552645+0000","last_clean":"2023-10-06T11:06:34.552645+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:06:34.552645+0000","last_undegraded":"2023-10-06T11:06:34.552645+0000","last_fullsized":"2023-10-06T11:06:34.552645+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.554674+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:42:19.402886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.571025+0000","last_change":"2023-10-06T11:06:35.571025+0000","last_active":"2023-10-06T11:06:35.571025+0000","last_peered":"2023-10-06T11:06:35.571025+0000","last_clean":"2023-10-06T11:06:35.571025+0000","last_became_active":"2023-10-06T11:06:35.570772+0000","last_became_peered":"2023-10-06T11:06:35.570772+0000","last_unstale":"2023-10-06T11:06:35.571025+0000","last_undegraded":"2023-10-06T11:06:35.571025+0000","last_fullsized":"2023-10-06T11:06:35.571025+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:54:46.474958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T11:06:34.549969+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:06:34.549969+0000","last_peered":"2023-10-06T11:06:34.549969+0000","last_clean":"2023-10-06T11:06:34.549969+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:06:34.549969+0000","last_undegraded":"2023-10-06T11:06:34.549969+0000","last_fullsized":"2023-10-06T11:06:34.549969+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.569370+0000","last_change":"2023-10-06T11:06:36.569370+0000","last_active":"2023-10-06T11:06:36.569370+0000","last_peered":"2023-10-06T11:06:36.569370+0000","last_clean":"2023-10-06T11:06:36.569370+0000","last_became_active":"2023-10-06T11:06:36.569170+0000","last_became_peered":"2023-10-06T11:06:36.569170+0000","last_unstale":"2023-10-06T11:06:36.569370+0000","last_undegraded":"2023-10-06T11:06:36.569370+0000","last_fullsized":"2023-10-06T11:06:36.569370+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:24:26.471584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.567471+0000","last_change":"2023-10-06T11:06:35.565421+0000","last_active":"2023-10-06T11:06:35.567471+0000","last_peered":"2023-10-06T11:06:35.567471+0000","last_clean":"2023-10-06T11:06:35.567471+0000","last_became_active":"2023-10-06T11:06:35.565160+0000","last_became_peered":"2023-10-06T11:06:35.565160+0000","last_unstale":"2023-10-06T11:06:35.567471+0000","last_undegraded":"2023-10-06T11:06:35.567471+0000","last_fullsized":"2023-10-06T11:06:35.567471+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:21:20.221637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.563206+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:06:35.563206+0000","last_peered":"2023-10-06T11:06:35.563206+0000","last_clean":"2023-10-06T11:06:35.563206+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:06:35.563206+0000","last_undegraded":"2023-10-06T11:06:35.563206+0000","last_fullsized":"2023-10-06T11:06:35.563206+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.559729+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:42:19.402886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.567604+0000","last_change":"2023-10-06T11:06:35.567604+0000","last_active":"2023-10-06T11:06:35.567604+0000","last_peered":"2023-10-06T11:06:35.567604+0000","last_clean":"2023-10-06T11:06:35.567604+0000","last_became_active":"2023-10-06T11:06:35.567290+0000","last_became_peered":"2023-10-06T11:06:35.567290+0000","last_unstale":"2023-10-06T11:06:35.567604+0000","last_undegraded":"2023-10-06T11:06:35.567604+0000","last_fullsized":"2023-10-06T11:06:35.567604+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:18:50.646916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.563054+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:06:35.563054+0000","last_peered":"2023-10-06T11:06:35.563054+0000","last_clean":"2023-10-06T11:06:35.563054+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:06:35.563054+0000","last_undegraded":"2023-10-06T11:06:35.563054+0000","last_fullsized":"2023-10-06T11:06:35.563054+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":554,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298172,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073668,"statfs":{"total":96636764160,"available":96331436032,"internally_reserved":0,"allocated":905216,"data_stored":711130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297600,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074240,"statfs":{"total":96636764160,"available":96332021760,"internally_reserved":0,"allocated":319488,"data_stored":126025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298200,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073640,"statfs":{"total":96636764160,"available":96331407360,"internally_reserved":0,"allocated":933888,"data_stored":724952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297600,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074240,"statfs":{"total":96636764160,"available":96332021760,"internally_reserved":0,"allocated":319488,"data_stored":126025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297600,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074240,"statfs":{"total":96636764160,"available":96332021760,"internally_reserved":0,"allocated":319488,"data_stored":126025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297600,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074240,"statfs":{"total":96636764160,"available":96332021760,"internally_reserved":0,"allocated":319488,"data_stored":126025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297624,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074216,"statfs":{"total":96636764160,"available":96331997184,"internally_reserved":0,"allocated":344064,"data_stored":135070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":311296,"data_stored":120762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:06:40.625 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:06:40.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.768+0000 7f2842324700 1 Processor -- start 2023-10-06T11:06:40.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.768+0000 7f2842324700 1 -- start start 2023-10-06T11:06:40.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.769+0000 7f2842324700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f283c15a7f0 0x7f283c15cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:40.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.769+0000 7f2842324700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f283c0b2530 0x7f283c15acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:40.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.769+0000 7f2842324700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f283c15c630 con 0x7f283c15a420 2023-10-06T11:06:40.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.769+0000 7f2842324700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f283c0ce040 con 0x7f283c15a7f0 2023-10-06T11:06:40.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.769+0000 7f2842324700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f283c15ba20 con 0x7f283c0b2530 2023-10-06T11:06:40.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.769+0000 7f2840b21700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f283c15a7f0 0x7f283c15cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:40.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.769+0000 7f2841322700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f283c15a420 0x7f283c0b1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52388/0 (socket says 172.21.15.146:52388) 2023-10-06T11:06:40.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.769+0000 7f2841322700 1 -- 172.21.15.146:0/627864007 learned_addr learned my addr 172.21.15.146:0/627864007 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:40.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.769+0000 7f2840b21700 1 -- 172.21.15.146:0/627864007 >> v2:172.21.15.151:3300/0 conn(0x7f283c0b2530 msgr2=0x7f283c15acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:40.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.769+0000 7f2841b23700 1 --2- 172.21.15.146:0/627864007 >> v2:172.21.15.151:3300/0 conn(0x7f283c0b2530 0x7f283c15acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:40.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.769+0000 7f2840b21700 1 --2- 172.21.15.146:0/627864007 >> v2:172.21.15.151:3300/0 conn(0x7f283c0b2530 0x7f283c15acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:40.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.769+0000 7f2840b21700 1 -- 172.21.15.146:0/627864007 >> v1:172.21.15.146:6789/0 conn(0x7f283c15a420 legacy=0x7f283c0b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:40.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.769+0000 7f2840b21700 1 -- 172.21.15.146:0/627864007 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f283c15bd00 con 0x7f283c15a7f0 2023-10-06T11:06:40.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.769+0000 7f2833fff700 1 -- 172.21.15.146:0/627864007 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1739312663 0 0) 0x7f283c15c630 con 0x7f283c15a420 2023-10-06T11:06:40.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.769+0000 7f2840b21700 1 --2- 172.21.15.146:0/627864007 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f283c15a7f0 0x7f283c15cac0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f283c15c5a0 tx=0x7f282c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84fb70e89b77f0a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:40.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.770+0000 7f2833fff700 1 -- 172.21.15.146:0/627864007 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282c00b6b0 con 0x7f283c15a7f0 2023-10-06T11:06:40.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.770+0000 7f2833fff700 1 -- 172.21.15.146:0/627864007 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f282c00b810 con 0x7f283c15a7f0 2023-10-06T11:06:40.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.770+0000 7f2833fff700 1 -- 172.21.15.146:0/627864007 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282c00bbb0 con 0x7f283c15a7f0 2023-10-06T11:06:40.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.770+0000 7f2842324700 1 -- 172.21.15.146:0/627864007 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f283c15a7f0 msgr2=0x7f283c15cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:40.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.770+0000 7f2842324700 1 --2- 172.21.15.146:0/627864007 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f283c15a7f0 0x7f283c15cac0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f283c15c5a0 tx=0x7f282c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:06:40.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.770+0000 7f2842324700 1 -- 172.21.15.146:0/627864007 shutdown_connections 2023-10-06T11:06:40.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.770+0000 7f2842324700 1 --2- 172.21.15.146:0/627864007 >> v2:172.21.15.151:3300/0 conn(0x7f283c0b2530 0x7f283c15acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:40.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.770+0000 7f2842324700 1 --2- 172.21.15.146:0/627864007 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f283c15a7f0 0x7f283c15cac0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:40.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.770+0000 7f2842324700 1 -- 172.21.15.146:0/627864007 >> 172.21.15.146:0/627864007 conn(0x7f283c06eba0 msgr2=0x7f283c06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:40.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.770+0000 7f2842324700 1 -- 172.21.15.146:0/627864007 shutdown_connections 2023-10-06T11:06:40.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.770+0000 7f2842324700 1 -- 172.21.15.146:0/627864007 wait complete. 2023-10-06T11:06:40.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.771+0000 7f2842324700 1 Processor -- start 2023-10-06T11:06:40.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.771+0000 7f2842324700 1 -- start start 2023-10-06T11:06:40.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.772+0000 7f2842324700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f283c0b2530 0x7f283c154d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:40.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.772+0000 7f2842324700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f283c15a420 0x7f283c16d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:40.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.772+0000 7f2842324700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f283c15a7f0 0x7f283c141bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:40.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.772+0000 7f2842324700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283c16da20 con 0x7f283c0b2530 2023-10-06T11:06:40.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.772+0000 7f2842324700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283c16dd00 con 0x7f283c15a420 2023-10-06T11:06:40.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.772+0000 7f2842324700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f283c152370 con 0x7f283c15a7f0 2023-10-06T11:06:40.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.772+0000 7f2841322700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f283c0b2530 0x7f283c154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:40.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.772+0000 7f2841322700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f283c0b2530 0x7f283c154d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41958/0 (socket says 172.21.15.146:41958) 2023-10-06T11:06:40.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.772+0000 7f2841322700 1 -- 172.21.15.146:0/1605987867 learned_addr learned my addr 172.21.15.146:0/1605987867 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:40.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.772+0000 7f2840b21700 1 --2- 172.21.15.146:0/1605987867 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f283c15a420 0x7f283c16d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:40.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.772+0000 7f2841b23700 1 --2- 172.21.15.146:0/1605987867 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f283c15a7f0 0x7f283c141bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:40.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.772+0000 7f2841322700 1 -- 172.21.15.146:0/1605987867 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f283c15a7f0 msgr2=0x7f283c141bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:40.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.772+0000 7f2841322700 1 --2- 172.21.15.146:0/1605987867 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f283c15a7f0 0x7f283c141bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:40.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.772+0000 7f2841322700 1 -- 172.21.15.146:0/1605987867 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f283c15a420 msgr2=0x7f283c16d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:40.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.772+0000 7f2841322700 1 --2- 172.21.15.146:0/1605987867 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f283c15a420 0x7f283c16d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:40.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.772+0000 7f2841322700 1 -- 172.21.15.146:0/1605987867 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f282c009420 con 0x7f283c0b2530 2023-10-06T11:06:40.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.773+0000 7f2841b23700 1 --2- 172.21.15.146:0/1605987867 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f283c15a7f0 0x7f283c141bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:06:40.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.773+0000 7f2841322700 1 --2- 172.21.15.146:0/1605987867 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f283c0b2530 0x7f283c154d00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f283800c7e0 tx=0x7f2838007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:40.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.773+0000 7f28317fa700 1 -- 172.21.15.146:0/1605987867 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2838005b30 con 0x7f283c0b2530 2023-10-06T11:06:40.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.773+0000 7f28317fa700 1 -- 172.21.15.146:0/1605987867 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2838005c90 con 0x7f283c0b2530 2023-10-06T11:06:40.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.773+0000 7f2842324700 1 -- 172.21.15.146:0/1605987867 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f283c152650 con 0x7f283c0b2530 2023-10-06T11:06:40.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.773+0000 7f28317fa700 1 -- 172.21.15.146:0/1605987867 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2838007300 con 0x7f283c0b2530 2023-10-06T11:06:40.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.773+0000 7f2842324700 1 -- 172.21.15.146:0/1605987867 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f283c14d2d0 con 0x7f283c0b2530 2023-10-06T11:06:40.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.774+0000 7f2842324700 1 -- 172.21.15.146:0/1605987867 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f283c0afae0 con 0x7f283c0b2530 2023-10-06T11:06:40.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.774+0000 7f28317fa700 1 -- 172.21.15.146:0/1605987867 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f283801b400 con 0x7f283c0b2530 2023-10-06T11:06:40.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.775+0000 7f28317fa700 1 --2- 172.21.15.146:0/1605987867 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2820066f30 0x7f28200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:40.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.775+0000 7f28317fa700 1 -- 172.21.15.146:0/1605987867 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f28380841e0 con 0x7f283c0b2530 2023-10-06T11:06:40.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.775+0000 7f2840b21700 1 --2- 172.21.15.146:0/1605987867 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2820066f30 0x7f28200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:40.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.775+0000 7f2840b21700 1 --2- 172.21.15.146:0/1605987867 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2820066f30 0x7f28200693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f282c0093f0 tx=0x7f282c017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:40.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.779+0000 7f28317fa700 1 -- 172.21.15.146:0/1605987867 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2838051370 con 0x7f283c0b2530 2023-10-06T11:06:40.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.959+0000 7f2842324700 1 -- 172.21.15.146:0/1605987867 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f283c155480 con 0x7f2820066f30 2023-10-06T11:06:40.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.966+0000 7f28317fa700 1 -- 172.21.15.146:0/1605987867 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284891 (secure 0 0 0) 0x7f283c155480 con 0x7f2820066f30 2023-10-06T11:06:40.971 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:06:40.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.969+0000 7f2842324700 1 -- 172.21.15.146:0/1605987867 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2820066f30 msgr2=0x7f28200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:40.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.969+0000 7f2842324700 1 --2- 172.21.15.146:0/1605987867 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2820066f30 0x7f28200693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f282c0093f0 tx=0x7f282c017000 comp rx=0 tx=0).stop 2023-10-06T11:06:40.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.969+0000 7f2842324700 1 -- 172.21.15.146:0/1605987867 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f283c0b2530 msgr2=0x7f283c154d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:40.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.969+0000 7f2842324700 1 --2- 172.21.15.146:0/1605987867 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f283c0b2530 0x7f283c154d00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f283800c7e0 tx=0x7f2838007df0 comp rx=0 tx=0).stop 2023-10-06T11:06:40.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.970+0000 7f2842324700 1 -- 172.21.15.146:0/1605987867 shutdown_connections 2023-10-06T11:06:40.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.970+0000 7f2842324700 1 --2- 172.21.15.146:0/1605987867 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2820066f30 0x7f28200693e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:40.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.970+0000 7f2842324700 1 --2- 172.21.15.146:0/1605987867 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f283c15a7f0 0x7f283c141bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:40.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.970+0000 7f2842324700 1 --2- 172.21.15.146:0/1605987867 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f283c0b2530 0x7f283c154d00 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:40.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.970+0000 7f2842324700 1 --2- 172.21.15.146:0/1605987867 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f283c15a420 0x7f283c16d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:40.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.970+0000 7f2842324700 1 -- 172.21.15.146:0/1605987867 >> 172.21.15.146:0/1605987867 conn(0x7f283c06eba0 msgr2=0x7f283c15d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:40.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.970+0000 7f2842324700 1 -- 172.21.15.146:0/1605987867 shutdown_connections 2023-10-06T11:06:40.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:40.970+0000 7f2842324700 1 -- 172.21.15.146:0/1605987867 wait complete. 2023-10-06T11:06:40.974 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:06:40.983 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2023-10-06T11:06:39.152719+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590922,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":172,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":74,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381988,"kb_used_data":3684,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592732,"statfs":{"total":773094113280,"available":770654957568,"internally_reserved":0,"allocated":3772416,"data_stored":2196014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":554,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.606359"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.555937+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:10:47.800013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.555568+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:53.550011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.561454+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:12:02.043126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.558319+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:55:04.265993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.556959+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:57:12.272427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.577548+0000","last_change":"2023-10-06T11:06:36.577548+0000","last_active":"2023-10-06T11:06:36.577548+0000","last_peered":"2023-10-06T11:06:36.577548+0000","last_clean":"2023-10-06T11:06:36.577548+0000","last_became_active":"2023-10-06T11:06:36.577311+0000","last_became_peered":"2023-10-06T11:06:36.577311+0000","last_unstale":"2023-10-06T11:06:36.577548+0000","last_undegraded":"2023-10-06T11:06:36.577548+0000","last_fullsized":"2023-10-06T11:06:36.577548+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:42:19.402886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.554712+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:54:47.482196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.555530+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:02.184653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.559560+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:27.615158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.558009+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:59:13.791303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.557630+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:35:12.331105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.558756+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:54.497548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.557611+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:27.615158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.566565+0000","last_change":"2023-10-06T11:06:36.566565+0000","last_active":"2023-10-06T11:06:36.566565+0000","last_peered":"2023-10-06T11:06:36.566565+0000","last_clean":"2023-10-06T11:06:36.566565+0000","last_became_active":"2023-10-06T11:06:36.566292+0000","last_became_peered":"2023-10-06T11:06:36.566292+0000","last_unstale":"2023-10-06T11:06:36.566565+0000","last_undegraded":"2023-10-06T11:06:36.566565+0000","last_fullsized":"2023-10-06T11:06:36.566565+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:40:32.681590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.556104+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:04:06.576517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.566902+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:02.184653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.566595+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:59:13.791303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.572882+0000","last_change":"2023-10-06T11:06:36.572882+0000","last_active":"2023-10-06T11:06:36.572882+0000","last_peered":"2023-10-06T11:06:36.572882+0000","last_clean":"2023-10-06T11:06:36.572882+0000","last_became_active":"2023-10-06T11:06:36.572597+0000","last_became_peered":"2023-10-06T11:06:36.572597+0000","last_unstale":"2023-10-06T11:06:36.572882+0000","last_undegraded":"2023-10-06T11:06:36.572882+0000","last_fullsized":"2023-10-06T11:06:36.572882+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:37:27.797737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.556450+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:21:21.228875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.578432+0000","last_change":"2023-10-06T11:06:36.578432+0000","last_active":"2023-10-06T11:06:36.578432+0000","last_peered":"2023-10-06T11:06:36.578432+0000","last_clean":"2023-10-06T11:06:36.578432+0000","last_became_active":"2023-10-06T11:06:36.578156+0000","last_became_peered":"2023-10-06T11:06:36.578156+0000","last_unstale":"2023-10-06T11:06:36.578432+0000","last_undegraded":"2023-10-06T11:06:36.578432+0000","last_fullsized":"2023-10-06T11:06:36.578432+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:53.558991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.556166+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:46:45.723235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.565509+0000","last_change":"2023-10-06T11:06:36.565509+0000","last_active":"2023-10-06T11:06:36.565509+0000","last_peered":"2023-10-06T11:06:36.565509+0000","last_clean":"2023-10-06T11:06:36.565509+0000","last_became_active":"2023-10-06T11:06:36.565187+0000","last_became_peered":"2023-10-06T11:06:36.565187+0000","last_unstale":"2023-10-06T11:06:36.565509+0000","last_undegraded":"2023-10-06T11:06:36.565509+0000","last_fullsized":"2023-10-06T11:06:36.565509+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:15:22.214670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.562630+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:04:06.576517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.556572+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:22:13.035423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.568754+0000","last_change":"2023-10-06T11:06:36.568754+0000","last_active":"2023-10-06T11:06:36.568754+0000","last_peered":"2023-10-06T11:06:36.568754+0000","last_clean":"2023-10-06T11:06:36.568754+0000","last_became_active":"2023-10-06T11:06:36.567464+0000","last_became_peered":"2023-10-06T11:06:36.567464+0000","last_unstale":"2023-10-06T11:06:36.568754+0000","last_undegraded":"2023-10-06T11:06:36.568754+0000","last_fullsized":"2023-10-06T11:06:36.568754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:54:47.482196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.568939+0000","last_change":"2023-10-06T11:06:36.568939+0000","last_active":"2023-10-06T11:06:36.568939+0000","last_peered":"2023-10-06T11:06:36.568939+0000","last_clean":"2023-10-06T11:06:36.568939+0000","last_became_active":"2023-10-06T11:06:36.567759+0000","last_became_peered":"2023-10-06T11:06:36.567759+0000","last_unstale":"2023-10-06T11:06:36.568939+0000","last_undegraded":"2023-10-06T11:06:36.568939+0000","last_fullsized":"2023-10-06T11:06:36.568939+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:59:13.791303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.566548+0000","last_change":"2023-10-06T11:06:36.566548+0000","last_active":"2023-10-06T11:06:36.566548+0000","last_peered":"2023-10-06T11:06:36.566548+0000","last_clean":"2023-10-06T11:06:36.566548+0000","last_became_active":"2023-10-06T11:06:36.566290+0000","last_became_peered":"2023-10-06T11:06:36.566290+0000","last_unstale":"2023-10-06T11:06:36.566548+0000","last_undegraded":"2023-10-06T11:06:36.566548+0000","last_fullsized":"2023-10-06T11:06:36.566548+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:27.799403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.554784+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:48:39.453895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.568346+0000","last_change":"2023-10-06T11:06:36.568346+0000","last_active":"2023-10-06T11:06:36.568346+0000","last_peered":"2023-10-06T11:06:36.568346+0000","last_clean":"2023-10-06T11:06:36.568346+0000","last_became_active":"2023-10-06T11:06:36.568044+0000","last_became_peered":"2023-10-06T11:06:36.568044+0000","last_unstale":"2023-10-06T11:06:36.568346+0000","last_undegraded":"2023-10-06T11:06:36.568346+0000","last_fullsized":"2023-10-06T11:06:36.568346+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:02:06.190668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.578800+0000","last_change":"2023-10-06T11:06:36.578800+0000","last_active":"2023-10-06T11:06:36.578800+0000","last_peered":"2023-10-06T11:06:36.578800+0000","last_clean":"2023-10-06T11:06:36.578800+0000","last_became_active":"2023-10-06T11:06:36.577352+0000","last_became_peered":"2023-10-06T11:06:36.577352+0000","last_unstale":"2023-10-06T11:06:36.578800+0000","last_undegraded":"2023-10-06T11:06:36.578800+0000","last_fullsized":"2023-10-06T11:06:36.578800+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:18:51.654155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.566095+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:12:02.043126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.561959+0000","last_change":"2023-10-06T11:06:36.561959+0000","last_active":"2023-10-06T11:06:36.561959+0000","last_peered":"2023-10-06T11:06:36.561959+0000","last_clean":"2023-10-06T11:06:36.561959+0000","last_became_active":"2023-10-06T11:06:36.561663+0000","last_became_peered":"2023-10-06T11:06:36.561663+0000","last_unstale":"2023-10-06T11:06:36.561959+0000","last_undegraded":"2023-10-06T11:06:36.561959+0000","last_fullsized":"2023-10-06T11:06:36.561959+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:27.615158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.563727+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:46:45.723235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"30'4","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.579947+0000","last_change":"2023-10-06T11:06:35.569189+0000","last_active":"2023-10-06T11:06:36.579947+0000","last_peered":"2023-10-06T11:06:36.579947+0000","last_clean":"2023-10-06T11:06:36.579947+0000","last_became_active":"2023-10-06T11:06:35.568921+0000","last_became_peered":"2023-10-06T11:06:35.568921+0000","last_unstale":"2023-10-06T11:06:36.579947+0000","last_undegraded":"2023-10-06T11:06:36.579947+0000","last_fullsized":"2023-10-06T11:06:36.579947+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:24:57.695098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.576765+0000","last_change":"2023-10-06T11:06:36.576765+0000","last_active":"2023-10-06T11:06:36.576765+0000","last_peered":"2023-10-06T11:06:36.576765+0000","last_clean":"2023-10-06T11:06:36.576765+0000","last_became_active":"2023-10-06T11:06:36.576511+0000","last_became_peered":"2023-10-06T11:06:36.576511+0000","last_unstale":"2023-10-06T11:06:36.576765+0000","last_undegraded":"2023-10-06T11:06:36.576765+0000","last_fullsized":"2023-10-06T11:06:36.576765+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:12:02.043126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.569717+0000","last_change":"2023-10-06T11:06:35.569717+0000","last_active":"2023-10-06T11:06:35.569717+0000","last_peered":"2023-10-06T11:06:35.569717+0000","last_clean":"2023-10-06T11:06:35.569717+0000","last_became_active":"2023-10-06T11:06:35.569537+0000","last_became_peered":"2023-10-06T11:06:35.569537+0000","last_unstale":"2023-10-06T11:06:35.569717+0000","last_undegraded":"2023-10-06T11:06:35.569717+0000","last_fullsized":"2023-10-06T11:06:35.569717+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:48:38.446657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.566688+0000","last_change":"2023-10-06T11:06:36.566688+0000","last_active":"2023-10-06T11:06:36.566688+0000","last_peered":"2023-10-06T11:06:36.566688+0000","last_clean":"2023-10-06T11:06:36.566688+0000","last_became_active":"2023-10-06T11:06:36.566407+0000","last_became_peered":"2023-10-06T11:06:36.566407+0000","last_unstale":"2023-10-06T11:06:36.566688+0000","last_undegraded":"2023-10-06T11:06:36.566688+0000","last_fullsized":"2023-10-06T11:06:36.566688+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:11:13.106985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"30'2","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.577901+0000","last_change":"2023-10-06T11:06:35.568732+0000","last_active":"2023-10-06T11:06:36.577901+0000","last_peered":"2023-10-06T11:06:36.577901+0000","last_clean":"2023-10-06T11:06:36.577901+0000","last_became_active":"2023-10-06T11:06:35.568493+0000","last_became_peered":"2023-10-06T11:06:35.568493+0000","last_unstale":"2023-10-06T11:06:36.577901+0000","last_undegraded":"2023-10-06T11:06:36.577901+0000","last_fullsized":"2023-10-06T11:06:36.577901+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:26.792165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.555527+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:03:01.050221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"30'2","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.579816+0000","last_change":"2023-10-06T11:06:35.567485+0000","last_active":"2023-10-06T11:06:36.579816+0000","last_peered":"2023-10-06T11:06:36.579816+0000","last_clean":"2023-10-06T11:06:36.579816+0000","last_became_active":"2023-10-06T11:06:35.567162+0000","last_became_peered":"2023-10-06T11:06:35.567162+0000","last_unstale":"2023-10-06T11:06:36.579816+0000","last_undegraded":"2023-10-06T11:06:36.579816+0000","last_fullsized":"2023-10-06T11:06:36.579816+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:12:01.035888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.560206+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:24:26.471584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.572139+0000","last_change":"2023-10-06T11:06:35.572139+0000","last_active":"2023-10-06T11:06:35.572139+0000","last_peered":"2023-10-06T11:06:35.572139+0000","last_clean":"2023-10-06T11:06:35.572139+0000","last_became_active":"2023-10-06T11:06:35.566406+0000","last_became_peered":"2023-10-06T11:06:35.566406+0000","last_unstale":"2023-10-06T11:06:35.572139+0000","last_undegraded":"2023-10-06T11:06:35.572139+0000","last_fullsized":"2023-10-06T11:06:35.572139+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:55:03.258755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.555302+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:50:39.669447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.573473+0000","last_change":"2023-10-06T11:06:35.573473+0000","last_active":"2023-10-06T11:06:35.573473+0000","last_peered":"2023-10-06T11:06:35.573473+0000","last_clean":"2023-10-06T11:06:35.573473+0000","last_became_active":"2023-10-06T11:06:35.573204+0000","last_became_peered":"2023-10-06T11:06:35.573204+0000","last_unstale":"2023-10-06T11:06:35.573473+0000","last_undegraded":"2023-10-06T11:06:35.573473+0000","last_fullsized":"2023-10-06T11:06:35.573473+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:52.551753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.564722+0000","last_change":"2023-10-06T11:06:36.564722+0000","last_active":"2023-10-06T11:06:36.564722+0000","last_peered":"2023-10-06T11:06:36.564722+0000","last_clean":"2023-10-06T11:06:36.564722+0000","last_became_active":"2023-10-06T11:06:36.564429+0000","last_became_peered":"2023-10-06T11:06:36.564429+0000","last_unstale":"2023-10-06T11:06:36.564722+0000","last_undegraded":"2023-10-06T11:06:36.564722+0000","last_fullsized":"2023-10-06T11:06:36.564722+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:30:40.428266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.570363+0000","last_change":"2023-10-06T11:06:35.563757+0000","last_active":"2023-10-06T11:06:35.570363+0000","last_peered":"2023-10-06T11:06:35.570363+0000","last_clean":"2023-10-06T11:06:35.570363+0000","last_became_active":"2023-10-06T11:06:35.563499+0000","last_became_peered":"2023-10-06T11:06:35.563499+0000","last_unstale":"2023-10-06T11:06:35.570363+0000","last_undegraded":"2023-10-06T11:06:35.570363+0000","last_fullsized":"2023-10-06T11:06:35.570363+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:52.551753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.555463+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:12:02.043126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.568186+0000","last_change":"2023-10-06T11:06:35.566496+0000","last_active":"2023-10-06T11:06:35.568186+0000","last_peered":"2023-10-06T11:06:35.568186+0000","last_clean":"2023-10-06T11:06:35.568186+0000","last_became_active":"2023-10-06T11:06:35.566211+0000","last_became_peered":"2023-10-06T11:06:35.566211+0000","last_unstale":"2023-10-06T11:06:35.568186+0000","last_undegraded":"2023-10-06T11:06:35.568186+0000","last_fullsized":"2023-10-06T11:06:35.568186+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:42:18.395648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.556385+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:47:35.465132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.570888+0000","last_change":"2023-10-06T11:06:35.570888+0000","last_active":"2023-10-06T11:06:35.570888+0000","last_peered":"2023-10-06T11:06:35.570888+0000","last_clean":"2023-10-06T11:06:35.570888+0000","last_became_active":"2023-10-06T11:06:35.570608+0000","last_became_peered":"2023-10-06T11:06:35.570608+0000","last_unstale":"2023-10-06T11:06:35.570888+0000","last_undegraded":"2023-10-06T11:06:35.570888+0000","last_fullsized":"2023-10-06T11:06:35.570888+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:35:11.323866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.566534+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:03:01.050221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.570188+0000","last_change":"2023-10-06T11:06:35.570188+0000","last_active":"2023-10-06T11:06:35.570188+0000","last_peered":"2023-10-06T11:06:35.570188+0000","last_clean":"2023-10-06T11:06:35.570188+0000","last_became_active":"2023-10-06T11:06:35.565593+0000","last_became_peered":"2023-10-06T11:06:35.565593+0000","last_unstale":"2023-10-06T11:06:35.570188+0000","last_undegraded":"2023-10-06T11:06:35.570188+0000","last_fullsized":"2023-10-06T11:06:35.570188+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:37:26.790499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.559557+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:59:13.791303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.572003+0000","last_change":"2023-10-06T11:06:35.572003+0000","last_active":"2023-10-06T11:06:35.572003+0000","last_peered":"2023-10-06T11:06:35.572003+0000","last_clean":"2023-10-06T11:06:35.572003+0000","last_became_active":"2023-10-06T11:06:35.571696+0000","last_became_peered":"2023-10-06T11:06:35.571696+0000","last_unstale":"2023-10-06T11:06:35.572003+0000","last_undegraded":"2023-10-06T11:06:35.572003+0000","last_fullsized":"2023-10-06T11:06:35.572003+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:26.792165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.561650+0000","last_change":"2023-10-06T11:06:36.561650+0000","last_active":"2023-10-06T11:06:36.561650+0000","last_peered":"2023-10-06T11:06:36.561650+0000","last_clean":"2023-10-06T11:06:36.561650+0000","last_became_active":"2023-10-06T11:06:36.561402+0000","last_became_peered":"2023-10-06T11:06:36.561402+0000","last_unstale":"2023-10-06T11:06:36.561650+0000","last_undegraded":"2023-10-06T11:06:36.561650+0000","last_fullsized":"2023-10-06T11:06:36.561650+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:27:30.195353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.567043+0000","last_change":"2023-10-06T11:06:35.567043+0000","last_active":"2023-10-06T11:06:35.567043+0000","last_peered":"2023-10-06T11:06:35.567043+0000","last_clean":"2023-10-06T11:06:35.567043+0000","last_became_active":"2023-10-06T11:06:35.566798+0000","last_became_peered":"2023-10-06T11:06:35.566798+0000","last_unstale":"2023-10-06T11:06:35.567043+0000","last_undegraded":"2023-10-06T11:06:35.567043+0000","last_fullsized":"2023-10-06T11:06:35.567043+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:50:38.662209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.558529+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:04:06.576517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.566555+0000","last_change":"2023-10-06T11:06:35.566555+0000","last_active":"2023-10-06T11:06:35.566555+0000","last_peered":"2023-10-06T11:06:35.566555+0000","last_clean":"2023-10-06T11:06:35.566555+0000","last_became_active":"2023-10-06T11:06:35.566300+0000","last_became_peered":"2023-10-06T11:06:35.566300+0000","last_unstale":"2023-10-06T11:06:35.566555+0000","last_undegraded":"2023-10-06T11:06:35.566555+0000","last_fullsized":"2023-10-06T11:06:35.566555+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:48:38.446657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.554511+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:59:13.791303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.570171+0000","last_change":"2023-10-06T11:06:35.563788+0000","last_active":"2023-10-06T11:06:35.570171+0000","last_peered":"2023-10-06T11:06:35.570171+0000","last_clean":"2023-10-06T11:06:35.570171+0000","last_became_active":"2023-10-06T11:06:35.563536+0000","last_became_peered":"2023-10-06T11:06:35.563536+0000","last_unstale":"2023-10-06T11:06:35.570171+0000","last_undegraded":"2023-10-06T11:06:35.570171+0000","last_fullsized":"2023-10-06T11:06:35.570171+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:37:26.790499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.562604+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:35:12.331105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.569968+0000","last_change":"2023-10-06T11:06:35.568542+0000","last_active":"2023-10-06T11:06:35.569968+0000","last_peered":"2023-10-06T11:06:35.569968+0000","last_clean":"2023-10-06T11:06:35.569968+0000","last_became_active":"2023-10-06T11:06:35.568247+0000","last_became_peered":"2023-10-06T11:06:35.568247+0000","last_unstale":"2023-10-06T11:06:35.569968+0000","last_undegraded":"2023-10-06T11:06:35.569968+0000","last_fullsized":"2023-10-06T11:06:35.569968+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:47:34.457893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.555063+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:24:26.471584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.573522+0000","last_change":"2023-10-06T11:06:35.573522+0000","last_active":"2023-10-06T11:06:35.573522+0000","last_peered":"2023-10-06T11:06:35.573522+0000","last_clean":"2023-10-06T11:06:35.573522+0000","last_became_active":"2023-10-06T11:06:35.573233+0000","last_became_peered":"2023-10-06T11:06:35.573233+0000","last_unstale":"2023-10-06T11:06:35.573522+0000","last_undegraded":"2023-10-06T11:06:35.573522+0000","last_fullsized":"2023-10-06T11:06:35.573522+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:37:26.790499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.554705+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:27.615158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.562619+0000","last_change":"2023-10-06T11:06:35.562619+0000","last_active":"2023-10-06T11:06:35.562619+0000","last_peered":"2023-10-06T11:06:35.562619+0000","last_clean":"2023-10-06T11:06:35.562619+0000","last_became_active":"2023-10-06T11:06:35.562355+0000","last_became_peered":"2023-10-06T11:06:35.562355+0000","last_unstale":"2023-10-06T11:06:35.562619+0000","last_undegraded":"2023-10-06T11:06:35.562619+0000","last_fullsized":"2023-10-06T11:06:35.562619+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:02:05.183430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.560355+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:24:26.471584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"30'2","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.580615+0000","last_change":"2023-10-06T11:06:35.566348+0000","last_active":"2023-10-06T11:06:36.580615+0000","last_peered":"2023-10-06T11:06:36.580615+0000","last_clean":"2023-10-06T11:06:36.580615+0000","last_became_active":"2023-10-06T11:06:35.565126+0000","last_became_peered":"2023-10-06T11:06:35.565126+0000","last_unstale":"2023-10-06T11:06:36.580615+0000","last_undegraded":"2023-10-06T11:06:36.580615+0000","last_fullsized":"2023-10-06T11:06:36.580615+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:59:12.784065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.564115+0000","last_change":"2023-10-06T11:06:36.564115+0000","last_active":"2023-10-06T11:06:36.564115+0000","last_peered":"2023-10-06T11:06:36.564115+0000","last_clean":"2023-10-06T11:06:36.564115+0000","last_became_active":"2023-10-06T11:06:36.563844+0000","last_became_peered":"2023-10-06T11:06:36.563844+0000","last_unstale":"2023-10-06T11:06:36.564115+0000","last_undegraded":"2023-10-06T11:06:36.564115+0000","last_fullsized":"2023-10-06T11:06:36.564115+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:02.194639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.570646+0000","last_change":"2023-10-06T11:06:35.570646+0000","last_active":"2023-10-06T11:06:35.570646+0000","last_peered":"2023-10-06T11:06:35.570646+0000","last_clean":"2023-10-06T11:06:35.570646+0000","last_became_active":"2023-10-06T11:06:35.570386+0000","last_became_peered":"2023-10-06T11:06:35.570386+0000","last_unstale":"2023-10-06T11:06:35.570646+0000","last_undegraded":"2023-10-06T11:06:35.570646+0000","last_fullsized":"2023-10-06T11:06:35.570646+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:10.251950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.555475+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:24:58.702337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.571568+0000","last_change":"2023-10-06T11:06:35.568732+0000","last_active":"2023-10-06T11:06:35.571568+0000","last_peered":"2023-10-06T11:06:35.571568+0000","last_clean":"2023-10-06T11:06:35.571568+0000","last_became_active":"2023-10-06T11:06:35.568460+0000","last_became_peered":"2023-10-06T11:06:35.568460+0000","last_unstale":"2023-10-06T11:06:35.571568+0000","last_undegraded":"2023-10-06T11:06:35.571568+0000","last_fullsized":"2023-10-06T11:06:35.571568+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:25.431156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.562560+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:50:39.669447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.565612+0000","last_change":"2023-10-06T11:06:35.565612+0000","last_active":"2023-10-06T11:06:35.565612+0000","last_peered":"2023-10-06T11:06:35.565612+0000","last_clean":"2023-10-06T11:06:35.565612+0000","last_became_active":"2023-10-06T11:06:35.565373+0000","last_became_peered":"2023-10-06T11:06:35.565373+0000","last_unstale":"2023-10-06T11:06:35.565612+0000","last_undegraded":"2023-10-06T11:06:35.565612+0000","last_fullsized":"2023-10-06T11:06:35.565612+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:22.790704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.558753+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:46:45.723235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.563587+0000","last_change":"2023-10-06T11:06:35.563587+0000","last_active":"2023-10-06T11:06:35.563587+0000","last_peered":"2023-10-06T11:06:35.563587+0000","last_clean":"2023-10-06T11:06:35.563587+0000","last_became_active":"2023-10-06T11:06:35.562933+0000","last_became_peered":"2023-10-06T11:06:35.562933+0000","last_unstale":"2023-10-06T11:06:35.563587+0000","last_undegraded":"2023-10-06T11:06:35.563587+0000","last_fullsized":"2023-10-06T11:06:35.563587+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:27:16.186215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.555165+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:18:51.654155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.573385+0000","last_change":"2023-10-06T11:06:35.573385+0000","last_active":"2023-10-06T11:06:35.573385+0000","last_peered":"2023-10-06T11:06:35.573385+0000","last_clean":"2023-10-06T11:06:35.573385+0000","last_became_active":"2023-10-06T11:06:35.573110+0000","last_became_peered":"2023-10-06T11:06:35.573110+0000","last_unstale":"2023-10-06T11:06:35.573385+0000","last_undegraded":"2023-10-06T11:06:35.573385+0000","last_fullsized":"2023-10-06T11:06:35.573385+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:54:46.474958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.554379+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:54.497548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.565314+0000","last_change":"2023-10-06T11:06:35.565314+0000","last_active":"2023-10-06T11:06:35.565314+0000","last_peered":"2023-10-06T11:06:35.565314+0000","last_clean":"2023-10-06T11:06:35.565314+0000","last_became_active":"2023-10-06T11:06:35.565003+0000","last_became_peered":"2023-10-06T11:06:35.565003+0000","last_unstale":"2023-10-06T11:06:35.565314+0000","last_undegraded":"2023-10-06T11:06:35.565314+0000","last_fullsized":"2023-10-06T11:06:35.565314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:06:59.444199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.578091+0000","last_change":"2023-10-06T11:06:36.578091+0000","last_active":"2023-10-06T11:06:36.578091+0000","last_peered":"2023-10-06T11:06:36.578091+0000","last_clean":"2023-10-06T11:06:36.578091+0000","last_became_active":"2023-10-06T11:06:36.577829+0000","last_became_peered":"2023-10-06T11:06:36.577829+0000","last_unstale":"2023-10-06T11:06:36.578091+0000","last_undegraded":"2023-10-06T11:06:36.578091+0000","last_fullsized":"2023-10-06T11:06:36.578091+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:32:31.550090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.569823+0000","last_change":"2023-10-06T11:06:35.568012+0000","last_active":"2023-10-06T11:06:35.569823+0000","last_peered":"2023-10-06T11:06:35.569823+0000","last_clean":"2023-10-06T11:06:35.569823+0000","last_became_active":"2023-10-06T11:06:35.567630+0000","last_became_peered":"2023-10-06T11:06:35.567630+0000","last_unstale":"2023-10-06T11:06:35.569823+0000","last_undegraded":"2023-10-06T11:06:35.569823+0000","last_fullsized":"2023-10-06T11:06:35.569823+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:24:25.464345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.557148+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:06:35.557148+0000","last_peered":"2023-10-06T11:06:35.557148+0000","last_clean":"2023-10-06T11:06:35.557148+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:06:35.557148+0000","last_undegraded":"2023-10-06T11:06:35.557148+0000","last_fullsized":"2023-10-06T11:06:35.557148+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.564430+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:54.497548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.565611+0000","last_change":"2023-10-06T11:06:35.565611+0000","last_active":"2023-10-06T11:06:35.565611+0000","last_peered":"2023-10-06T11:06:35.565611+0000","last_clean":"2023-10-06T11:06:35.565611+0000","last_became_active":"2023-10-06T11:06:35.565425+0000","last_became_peered":"2023-10-06T11:06:35.565425+0000","last_unstale":"2023-10-06T11:06:35.565611+0000","last_undegraded":"2023-10-06T11:06:35.565611+0000","last_fullsized":"2023-10-06T11:06:35.565611+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:04:05.569279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T11:06:34.554099+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:06:34.554099+0000","last_peered":"2023-10-06T11:06:34.554099+0000","last_clean":"2023-10-06T11:06:34.554099+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:06:34.554099+0000","last_undegraded":"2023-10-06T11:06:34.554099+0000","last_fullsized":"2023-10-06T11:06:34.554099+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.568057+0000","last_change":"2023-10-06T11:06:36.568057+0000","last_active":"2023-10-06T11:06:36.568057+0000","last_peered":"2023-10-06T11:06:36.568057+0000","last_clean":"2023-10-06T11:06:36.568057+0000","last_became_active":"2023-10-06T11:06:36.567776+0000","last_became_peered":"2023-10-06T11:06:36.567776+0000","last_unstale":"2023-10-06T11:06:36.568057+0000","last_undegraded":"2023-10-06T11:06:36.568057+0000","last_fullsized":"2023-10-06T11:06:36.568057+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:54.497548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.571084+0000","last_change":"2023-10-06T11:06:35.571084+0000","last_active":"2023-10-06T11:06:35.571084+0000","last_peered":"2023-10-06T11:06:35.571084+0000","last_clean":"2023-10-06T11:06:35.571084+0000","last_became_active":"2023-10-06T11:06:35.570790+0000","last_became_peered":"2023-10-06T11:06:35.570790+0000","last_unstale":"2023-10-06T11:06:35.571084+0000","last_undegraded":"2023-10-06T11:06:35.571084+0000","last_fullsized":"2023-10-06T11:06:35.571084+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:25.431156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.563251+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:06:35.563251+0000","last_peered":"2023-10-06T11:06:35.563251+0000","last_clean":"2023-10-06T11:06:35.563251+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:06:35.563251+0000","last_undegraded":"2023-10-06T11:06:35.563251+0000","last_fullsized":"2023-10-06T11:06:35.563251+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":169,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T11:06:34.552651+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:06:34.552651+0000","last_peered":"2023-10-06T11:06:34.552651+0000","last_clean":"2023-10-06T11:06:34.552651+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:06:34.552651+0000","last_undegraded":"2023-10-06T11:06:34.552651+0000","last_fullsized":"2023-10-06T11:06:34.552651+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.566037+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:27.615158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.562232+0000","last_change":"2023-10-06T11:06:35.562232+0000","last_active":"2023-10-06T11:06:35.562232+0000","last_peered":"2023-10-06T11:06:35.562232+0000","last_clean":"2023-10-06T11:06:35.562232+0000","last_became_active":"2023-10-06T11:06:35.561976+0000","last_became_peered":"2023-10-06T11:06:35.561976+0000","last_unstale":"2023-10-06T11:06:35.562232+0000","last_undegraded":"2023-10-06T11:06:35.562232+0000","last_fullsized":"2023-10-06T11:06:35.562232+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:50:26.045766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T11:06:34.552999+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:06:34.552999+0000","last_peered":"2023-10-06T11:06:34.552999+0000","last_clean":"2023-10-06T11:06:34.552999+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:06:34.552999+0000","last_undegraded":"2023-10-06T11:06:34.552999+0000","last_fullsized":"2023-10-06T11:06:34.552999+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.556811+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:54.497548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.575854+0000","last_change":"2023-10-06T11:06:35.575854+0000","last_active":"2023-10-06T11:06:35.575854+0000","last_peered":"2023-10-06T11:06:35.575854+0000","last_clean":"2023-10-06T11:06:35.575854+0000","last_became_active":"2023-10-06T11:06:35.575563+0000","last_became_peered":"2023-10-06T11:06:35.575563+0000","last_unstale":"2023-10-06T11:06:35.575854+0000","last_undegraded":"2023-10-06T11:06:35.575854+0000","last_fullsized":"2023-10-06T11:06:35.575854+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:18:50.646916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T11:06:34.552645+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:06:34.552645+0000","last_peered":"2023-10-06T11:06:34.552645+0000","last_clean":"2023-10-06T11:06:34.552645+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:06:34.552645+0000","last_undegraded":"2023-10-06T11:06:34.552645+0000","last_fullsized":"2023-10-06T11:06:34.552645+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.554674+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:42:19.402886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.571025+0000","last_change":"2023-10-06T11:06:35.571025+0000","last_active":"2023-10-06T11:06:35.571025+0000","last_peered":"2023-10-06T11:06:35.571025+0000","last_clean":"2023-10-06T11:06:35.571025+0000","last_became_active":"2023-10-06T11:06:35.570772+0000","last_became_peered":"2023-10-06T11:06:35.570772+0000","last_unstale":"2023-10-06T11:06:35.571025+0000","last_undegraded":"2023-10-06T11:06:35.571025+0000","last_fullsized":"2023-10-06T11:06:35.571025+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:54:46.474958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T11:06:34.549969+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:06:34.549969+0000","last_peered":"2023-10-06T11:06:34.549969+0000","last_clean":"2023-10-06T11:06:34.549969+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:06:34.549969+0000","last_undegraded":"2023-10-06T11:06:34.549969+0000","last_fullsized":"2023-10-06T11:06:34.549969+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.569370+0000","last_change":"2023-10-06T11:06:36.569370+0000","last_active":"2023-10-06T11:06:36.569370+0000","last_peered":"2023-10-06T11:06:36.569370+0000","last_clean":"2023-10-06T11:06:36.569370+0000","last_became_active":"2023-10-06T11:06:36.569170+0000","last_became_peered":"2023-10-06T11:06:36.569170+0000","last_unstale":"2023-10-06T11:06:36.569370+0000","last_undegraded":"2023-10-06T11:06:36.569370+0000","last_fullsized":"2023-10-06T11:06:36.569370+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:24:26.471584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.567471+0000","last_change":"2023-10-06T11:06:35.565421+0000","last_active":"2023-10-06T11:06:35.567471+0000","last_peered":"2023-10-06T11:06:35.567471+0000","last_clean":"2023-10-06T11:06:35.567471+0000","last_became_active":"2023-10-06T11:06:35.565160+0000","last_became_peered":"2023-10-06T11:06:35.565160+0000","last_unstale":"2023-10-06T11:06:35.567471+0000","last_undegraded":"2023-10-06T11:06:35.567471+0000","last_fullsized":"2023-10-06T11:06:35.567471+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:21:20.221637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.563206+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:06:35.563206+0000","last_peered":"2023-10-06T11:06:35.563206+0000","last_clean":"2023-10-06T11:06:35.563206+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:06:35.563206+0000","last_undegraded":"2023-10-06T11:06:35.563206+0000","last_fullsized":"2023-10-06T11:06:35.563206+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.559729+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:42:19.402886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.567604+0000","last_change":"2023-10-06T11:06:35.567604+0000","last_active":"2023-10-06T11:06:35.567604+0000","last_peered":"2023-10-06T11:06:35.567604+0000","last_clean":"2023-10-06T11:06:35.567604+0000","last_became_active":"2023-10-06T11:06:35.567290+0000","last_became_peered":"2023-10-06T11:06:35.567290+0000","last_unstale":"2023-10-06T11:06:35.567604+0000","last_undegraded":"2023-10-06T11:06:35.567604+0000","last_fullsized":"2023-10-06T11:06:35.567604+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:18:50.646916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.563054+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:06:35.563054+0000","last_peered":"2023-10-06T11:06:35.563054+0000","last_clean":"2023-10-06T11:06:35.563054+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:06:35.563054+0000","last_undegraded":"2023-10-06T11:06:35.563054+0000","last_fullsized":"2023-10-06T11:06:35.563054+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":554,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298172,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073668,"statfs":{"total":96636764160,"available":96331436032,"internally_reserved":0,"allocated":905216,"data_stored":711130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297600,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074240,"statfs":{"total":96636764160,"available":96332021760,"internally_reserved":0,"allocated":319488,"data_stored":126025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298200,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073640,"statfs":{"total":96636764160,"available":96331407360,"internally_reserved":0,"allocated":933888,"data_stored":724952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297600,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074240,"statfs":{"total":96636764160,"available":96332021760,"internally_reserved":0,"allocated":319488,"data_stored":126025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297600,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074240,"statfs":{"total":96636764160,"available":96332021760,"internally_reserved":0,"allocated":319488,"data_stored":126025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297600,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074240,"statfs":{"total":96636764160,"available":96332021760,"internally_reserved":0,"allocated":319488,"data_stored":126025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297624,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074216,"statfs":{"total":96636764160,"available":96331997184,"internally_reserved":0,"allocated":344064,"data_stored":135070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":311296,"data_stored":120762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:06:40.989 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:06:41.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.136+0000 7f0c67474700 1 Processor -- start 2023-10-06T11:06:41.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.136+0000 7f0c67474700 1 -- start start 2023-10-06T11:06:41.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.137+0000 7f0c67474700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0c60153ab0 0x7f0c6015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:41.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.137+0000 7f0c67474700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c60153e80 0x7f0c60068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:41.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.137+0000 7f0c67474700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c6015ac30 con 0x7f0c600689d0 2023-10-06T11:06:41.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.137+0000 7f0c67474700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c60068e50 con 0x7f0c60153ab0 2023-10-06T11:06:41.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.137+0000 7f0c67474700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c600b4510 con 0x7f0c60153e80 2023-10-06T11:06:41.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.137+0000 7f0c65210700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0c60153ab0 0x7f0c6015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:41.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.137+0000 7f0c65210700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0c60153ab0 0x7f0c6015a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41966/0 (socket says 172.21.15.146:41966) 2023-10-06T11:06:41.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.137+0000 7f0c65210700 1 -- 172.21.15.146:0/3274465975 learned_addr learned my addr 172.21.15.146:0/3274465975 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:41.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.138+0000 7f0c64a0f700 1 --2- 172.21.15.146:0/3274465975 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c60153e80 0x7f0c60068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:41.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.138+0000 7f0c65210700 1 -- 172.21.15.146:0/3274465975 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c60153e80 msgr2=0x7f0c60068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:41.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.138+0000 7f0c65210700 1 --2- 172.21.15.146:0/3274465975 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c60153e80 0x7f0c60068490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:41.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.138+0000 7f0c65210700 1 -- 172.21.15.146:0/3274465975 >> v1:172.21.15.151:6789/0 conn(0x7f0c600689d0 legacy=0x7f0c6015d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:41.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.138+0000 7f0c65210700 1 -- 172.21.15.146:0/3274465975 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c600b6530 con 0x7f0c60153ab0 2023-10-06T11:06:41.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.138+0000 7f0c64a0f700 1 --2- 172.21.15.146:0/3274465975 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c60153e80 0x7f0c60068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:06:41.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.138+0000 7f0c65210700 1 --2- 172.21.15.146:0/3274465975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c60153ab0 0x7f0c6015a6f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c0099b0 tx=0x7f0c5c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ecae9007be465f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:41.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.138+0000 7f0c57fff700 1 -- 172.21.15.146:0/3274465975 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c00b860 con 0x7f0c60153ab0 2023-10-06T11:06:41.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.138+0000 7f0c57fff700 1 -- 172.21.15.146:0/3274465975 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c5c00b9c0 con 0x7f0c60153ab0 2023-10-06T11:06:41.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.138+0000 7f0c57fff700 1 -- 172.21.15.146:0/3274465975 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c00bd60 con 0x7f0c60153ab0 2023-10-06T11:06:41.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.138+0000 7f0c67474700 1 -- 172.21.15.146:0/3274465975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c60153ab0 msgr2=0x7f0c6015a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:41.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.138+0000 7f0c67474700 1 --2- 172.21.15.146:0/3274465975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c60153ab0 0x7f0c6015a6f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c0099b0 tx=0x7f0c5c009250 comp rx=0 tx=0).stop 2023-10-06T11:06:41.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.139+0000 7f0c67474700 1 -- 172.21.15.146:0/3274465975 shutdown_connections 2023-10-06T11:06:41.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.139+0000 7f0c67474700 1 --2- 172.21.15.146:0/3274465975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c60153ab0 0x7f0c6015a6f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:41.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.139+0000 7f0c67474700 1 --2- 172.21.15.146:0/3274465975 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c60153e80 0x7f0c60068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:41.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.139+0000 7f0c67474700 1 -- 172.21.15.146:0/3274465975 >> 172.21.15.146:0/3274465975 conn(0x7f0c6006eba0 msgr2=0x7f0c6006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:41.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.139+0000 7f0c67474700 1 -- 172.21.15.146:0/3274465975 shutdown_connections 2023-10-06T11:06:41.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.139+0000 7f0c67474700 1 -- 172.21.15.146:0/3274465975 wait complete. 2023-10-06T11:06:41.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.140+0000 7f0c67474700 1 Processor -- start 2023-10-06T11:06:41.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.140+0000 7f0c67474700 1 -- start start 2023-10-06T11:06:41.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.141+0000 7f0c67474700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c600689d0 0x7f0c6014c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:41.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.141+0000 7f0c67474700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c60153ab0 0x7f0c6014d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:41.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.141+0000 7f0c67474700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c60153e80 0x7f0c60147fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:41.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.141+0000 7f0c67474700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6014fda0 con 0x7f0c600689d0 2023-10-06T11:06:41.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.141+0000 7f0c67474700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c60150080 con 0x7f0c60153ab0 2023-10-06T11:06:41.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.141+0000 7f0c67474700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6015eb10 con 0x7f0c60153e80 2023-10-06T11:06:41.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.141+0000 7f0c65210700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c600689d0 0x7f0c6014c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:41.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.141+0000 7f0c65210700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c600689d0 0x7f0c6014c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41982/0 (socket says 172.21.15.146:41982) 2023-10-06T11:06:41.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.141+0000 7f0c65210700 1 -- 172.21.15.146:0/3082413615 learned_addr learned my addr 172.21.15.146:0/3082413615 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:41.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.141+0000 7f0c64a0f700 1 --2- 172.21.15.146:0/3082413615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c60153ab0 0x7f0c6014d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:41.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.141+0000 7f0c65a11700 1 --2- 172.21.15.146:0/3082413615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c60153e80 0x7f0c60147fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:41.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.141+0000 7f0c65210700 1 -- 172.21.15.146:0/3082413615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c60153e80 msgr2=0x7f0c60147fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:41.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.141+0000 7f0c65210700 1 --2- 172.21.15.146:0/3082413615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c60153e80 0x7f0c60147fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:41.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.141+0000 7f0c65210700 1 -- 172.21.15.146:0/3082413615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c60153ab0 msgr2=0x7f0c6014d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:41.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.141+0000 7f0c65210700 1 --2- 172.21.15.146:0/3082413615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c60153ab0 0x7f0c6014d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:41.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.141+0000 7f0c65210700 1 -- 172.21.15.146:0/3082413615 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c5c0094f0 con 0x7f0c600689d0 2023-10-06T11:06:41.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.141+0000 7f0c65210700 1 --2- 172.21.15.146:0/3082413615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c600689d0 0x7f0c6014c580 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c009290 tx=0x7f0c5c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:41.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.141+0000 7f0c557fa700 1 -- 172.21.15.146:0/3082413615 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c026480 con 0x7f0c600689d0 2023-10-06T11:06:41.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.141+0000 7f0c557fa700 1 -- 172.21.15.146:0/3082413615 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c5c01f070 con 0x7f0c600689d0 2023-10-06T11:06:41.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.141+0000 7f0c67474700 1 -- 172.21.15.146:0/3082413615 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c6015e7d0 con 0x7f0c600689d0 2023-10-06T11:06:41.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.141+0000 7f0c557fa700 1 -- 172.21.15.146:0/3082413615 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c026830 con 0x7f0c600689d0 2023-10-06T11:06:41.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.141+0000 7f0c67474700 1 -- 172.21.15.146:0/3082413615 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c6014cc80 con 0x7f0c600689d0 2023-10-06T11:06:41.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.142+0000 7f0c67474700 1 -- 172.21.15.146:0/3082413615 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c6004c380 con 0x7f0c600689d0 2023-10-06T11:06:41.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.143+0000 7f0c557fa700 1 -- 172.21.15.146:0/3082413615 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0c5c026ba0 con 0x7f0c600689d0 2023-10-06T11:06:41.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.143+0000 7f0c557fa700 1 --2- 172.21.15.146:0/3082413615 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0c44066f30 0x7f0c440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:41.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.143+0000 7f0c557fa700 1 -- 172.21.15.146:0/3082413615 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0c5c021070 con 0x7f0c600689d0 2023-10-06T11:06:41.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.143+0000 7f0c64a0f700 1 --2- 172.21.15.146:0/3082413615 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0c44066f30 0x7f0c440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:41.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.143+0000 7f0c64a0f700 1 --2- 172.21.15.146:0/3082413615 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0c44066f30 0x7f0c440693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0c50006fd0 tx=0x7f0c50008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:41.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.147+0000 7f0c557fa700 1 -- 172.21.15.146:0/3082413615 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0c5c053580 con 0x7f0c600689d0 2023-10-06T11:06:41.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.326+0000 7f0c67474700 1 -- 172.21.15.146:0/3082413615 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0c6014fee0 con 0x7f0c44066f30 2023-10-06T11:06:41.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.334+0000 7f0c557fa700 1 -- 172.21.15.146:0/3082413615 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284891 (secure 0 0 0) 0x7f0c6014fee0 con 0x7f0c44066f30 2023-10-06T11:06:41.339 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:06:41.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.337+0000 7f0c67474700 1 -- 172.21.15.146:0/3082413615 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0c44066f30 msgr2=0x7f0c440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:41.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.337+0000 7f0c67474700 1 --2- 172.21.15.146:0/3082413615 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0c44066f30 0x7f0c440693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0c50006fd0 tx=0x7f0c50008040 comp rx=0 tx=0).stop 2023-10-06T11:06:41.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.338+0000 7f0c67474700 1 -- 172.21.15.146:0/3082413615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c600689d0 msgr2=0x7f0c6014c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:41.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.338+0000 7f0c67474700 1 --2- 172.21.15.146:0/3082413615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c600689d0 0x7f0c6014c580 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c009290 tx=0x7f0c5c017000 comp rx=0 tx=0).stop 2023-10-06T11:06:41.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.338+0000 7f0c67474700 1 -- 172.21.15.146:0/3082413615 shutdown_connections 2023-10-06T11:06:41.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.338+0000 7f0c67474700 1 --2- 172.21.15.146:0/3082413615 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0c44066f30 0x7f0c440693e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:41.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.338+0000 7f0c67474700 1 --2- 172.21.15.146:0/3082413615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c60153e80 0x7f0c60147fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:41.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.338+0000 7f0c67474700 1 --2- 172.21.15.146:0/3082413615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c600689d0 0x7f0c6014c580 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:41.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.338+0000 7f0c67474700 1 --2- 172.21.15.146:0/3082413615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c60153ab0 0x7f0c6014d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:41.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.338+0000 7f0c67474700 1 -- 172.21.15.146:0/3082413615 >> 172.21.15.146:0/3082413615 conn(0x7f0c6006eba0 msgr2=0x7f0c6015c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:41.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.338+0000 7f0c67474700 1 -- 172.21.15.146:0/3082413615 shutdown_connections 2023-10-06T11:06:41.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.338+0000 7f0c67474700 1 -- 172.21.15.146:0/3082413615 wait complete. 2023-10-06T11:06:41.343 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:06:41.351 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2023-10-06T11:06:41.153094+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590922,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":172,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":74,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381988,"kb_used_data":3684,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592732,"statfs":{"total":773094113280,"available":770654957568,"internally_reserved":0,"allocated":3772416,"data_stored":2196014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":554,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001088"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.555937+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:10:47.800013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.555568+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:53.550011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.561454+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:12:02.043126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.558319+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:55:04.265993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.556959+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:57:12.272427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.577548+0000","last_change":"2023-10-06T11:06:36.577548+0000","last_active":"2023-10-06T11:06:36.577548+0000","last_peered":"2023-10-06T11:06:36.577548+0000","last_clean":"2023-10-06T11:06:36.577548+0000","last_became_active":"2023-10-06T11:06:36.577311+0000","last_became_peered":"2023-10-06T11:06:36.577311+0000","last_unstale":"2023-10-06T11:06:36.577548+0000","last_undegraded":"2023-10-06T11:06:36.577548+0000","last_fullsized":"2023-10-06T11:06:36.577548+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:42:19.402886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.554712+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:54:47.482196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.555530+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:02.184653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.559560+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:27.615158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.558009+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:59:13.791303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.557630+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:35:12.331105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.558756+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:54.497548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.557611+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:27.615158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.566565+0000","last_change":"2023-10-06T11:06:36.566565+0000","last_active":"2023-10-06T11:06:36.566565+0000","last_peered":"2023-10-06T11:06:36.566565+0000","last_clean":"2023-10-06T11:06:36.566565+0000","last_became_active":"2023-10-06T11:06:36.566292+0000","last_became_peered":"2023-10-06T11:06:36.566292+0000","last_unstale":"2023-10-06T11:06:36.566565+0000","last_undegraded":"2023-10-06T11:06:36.566565+0000","last_fullsized":"2023-10-06T11:06:36.566565+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:40:32.681590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.556104+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:04:06.576517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.566902+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:02.184653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.566595+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:59:13.791303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.572882+0000","last_change":"2023-10-06T11:06:36.572882+0000","last_active":"2023-10-06T11:06:36.572882+0000","last_peered":"2023-10-06T11:06:36.572882+0000","last_clean":"2023-10-06T11:06:36.572882+0000","last_became_active":"2023-10-06T11:06:36.572597+0000","last_became_peered":"2023-10-06T11:06:36.572597+0000","last_unstale":"2023-10-06T11:06:36.572882+0000","last_undegraded":"2023-10-06T11:06:36.572882+0000","last_fullsized":"2023-10-06T11:06:36.572882+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:37:27.797737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.556450+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:21:21.228875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.578432+0000","last_change":"2023-10-06T11:06:36.578432+0000","last_active":"2023-10-06T11:06:36.578432+0000","last_peered":"2023-10-06T11:06:36.578432+0000","last_clean":"2023-10-06T11:06:36.578432+0000","last_became_active":"2023-10-06T11:06:36.578156+0000","last_became_peered":"2023-10-06T11:06:36.578156+0000","last_unstale":"2023-10-06T11:06:36.578432+0000","last_undegraded":"2023-10-06T11:06:36.578432+0000","last_fullsized":"2023-10-06T11:06:36.578432+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:53.558991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.556166+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:46:45.723235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.565509+0000","last_change":"2023-10-06T11:06:36.565509+0000","last_active":"2023-10-06T11:06:36.565509+0000","last_peered":"2023-10-06T11:06:36.565509+0000","last_clean":"2023-10-06T11:06:36.565509+0000","last_became_active":"2023-10-06T11:06:36.565187+0000","last_became_peered":"2023-10-06T11:06:36.565187+0000","last_unstale":"2023-10-06T11:06:36.565509+0000","last_undegraded":"2023-10-06T11:06:36.565509+0000","last_fullsized":"2023-10-06T11:06:36.565509+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:15:22.214670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.562630+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:04:06.576517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.556572+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:22:13.035423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.568754+0000","last_change":"2023-10-06T11:06:36.568754+0000","last_active":"2023-10-06T11:06:36.568754+0000","last_peered":"2023-10-06T11:06:36.568754+0000","last_clean":"2023-10-06T11:06:36.568754+0000","last_became_active":"2023-10-06T11:06:36.567464+0000","last_became_peered":"2023-10-06T11:06:36.567464+0000","last_unstale":"2023-10-06T11:06:36.568754+0000","last_undegraded":"2023-10-06T11:06:36.568754+0000","last_fullsized":"2023-10-06T11:06:36.568754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:54:47.482196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.568939+0000","last_change":"2023-10-06T11:06:36.568939+0000","last_active":"2023-10-06T11:06:36.568939+0000","last_peered":"2023-10-06T11:06:36.568939+0000","last_clean":"2023-10-06T11:06:36.568939+0000","last_became_active":"2023-10-06T11:06:36.567759+0000","last_became_peered":"2023-10-06T11:06:36.567759+0000","last_unstale":"2023-10-06T11:06:36.568939+0000","last_undegraded":"2023-10-06T11:06:36.568939+0000","last_fullsized":"2023-10-06T11:06:36.568939+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:59:13.791303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.566548+0000","last_change":"2023-10-06T11:06:36.566548+0000","last_active":"2023-10-06T11:06:36.566548+0000","last_peered":"2023-10-06T11:06:36.566548+0000","last_clean":"2023-10-06T11:06:36.566548+0000","last_became_active":"2023-10-06T11:06:36.566290+0000","last_became_peered":"2023-10-06T11:06:36.566290+0000","last_unstale":"2023-10-06T11:06:36.566548+0000","last_undegraded":"2023-10-06T11:06:36.566548+0000","last_fullsized":"2023-10-06T11:06:36.566548+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:27.799403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.554784+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:48:39.453895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.568346+0000","last_change":"2023-10-06T11:06:36.568346+0000","last_active":"2023-10-06T11:06:36.568346+0000","last_peered":"2023-10-06T11:06:36.568346+0000","last_clean":"2023-10-06T11:06:36.568346+0000","last_became_active":"2023-10-06T11:06:36.568044+0000","last_became_peered":"2023-10-06T11:06:36.568044+0000","last_unstale":"2023-10-06T11:06:36.568346+0000","last_undegraded":"2023-10-06T11:06:36.568346+0000","last_fullsized":"2023-10-06T11:06:36.568346+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:02:06.190668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.578800+0000","last_change":"2023-10-06T11:06:36.578800+0000","last_active":"2023-10-06T11:06:36.578800+0000","last_peered":"2023-10-06T11:06:36.578800+0000","last_clean":"2023-10-06T11:06:36.578800+0000","last_became_active":"2023-10-06T11:06:36.577352+0000","last_became_peered":"2023-10-06T11:06:36.577352+0000","last_unstale":"2023-10-06T11:06:36.578800+0000","last_undegraded":"2023-10-06T11:06:36.578800+0000","last_fullsized":"2023-10-06T11:06:36.578800+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:18:51.654155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.566095+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:12:02.043126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.561959+0000","last_change":"2023-10-06T11:06:36.561959+0000","last_active":"2023-10-06T11:06:36.561959+0000","last_peered":"2023-10-06T11:06:36.561959+0000","last_clean":"2023-10-06T11:06:36.561959+0000","last_became_active":"2023-10-06T11:06:36.561663+0000","last_became_peered":"2023-10-06T11:06:36.561663+0000","last_unstale":"2023-10-06T11:06:36.561959+0000","last_undegraded":"2023-10-06T11:06:36.561959+0000","last_fullsized":"2023-10-06T11:06:36.561959+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:27.615158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.563727+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:46:45.723235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"30'4","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.579947+0000","last_change":"2023-10-06T11:06:35.569189+0000","last_active":"2023-10-06T11:06:36.579947+0000","last_peered":"2023-10-06T11:06:36.579947+0000","last_clean":"2023-10-06T11:06:36.579947+0000","last_became_active":"2023-10-06T11:06:35.568921+0000","last_became_peered":"2023-10-06T11:06:35.568921+0000","last_unstale":"2023-10-06T11:06:36.579947+0000","last_undegraded":"2023-10-06T11:06:36.579947+0000","last_fullsized":"2023-10-06T11:06:36.579947+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:24:57.695098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.576765+0000","last_change":"2023-10-06T11:06:36.576765+0000","last_active":"2023-10-06T11:06:36.576765+0000","last_peered":"2023-10-06T11:06:36.576765+0000","last_clean":"2023-10-06T11:06:36.576765+0000","last_became_active":"2023-10-06T11:06:36.576511+0000","last_became_peered":"2023-10-06T11:06:36.576511+0000","last_unstale":"2023-10-06T11:06:36.576765+0000","last_undegraded":"2023-10-06T11:06:36.576765+0000","last_fullsized":"2023-10-06T11:06:36.576765+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:12:02.043126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.569717+0000","last_change":"2023-10-06T11:06:35.569717+0000","last_active":"2023-10-06T11:06:35.569717+0000","last_peered":"2023-10-06T11:06:35.569717+0000","last_clean":"2023-10-06T11:06:35.569717+0000","last_became_active":"2023-10-06T11:06:35.569537+0000","last_became_peered":"2023-10-06T11:06:35.569537+0000","last_unstale":"2023-10-06T11:06:35.569717+0000","last_undegraded":"2023-10-06T11:06:35.569717+0000","last_fullsized":"2023-10-06T11:06:35.569717+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:48:38.446657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.566688+0000","last_change":"2023-10-06T11:06:36.566688+0000","last_active":"2023-10-06T11:06:36.566688+0000","last_peered":"2023-10-06T11:06:36.566688+0000","last_clean":"2023-10-06T11:06:36.566688+0000","last_became_active":"2023-10-06T11:06:36.566407+0000","last_became_peered":"2023-10-06T11:06:36.566407+0000","last_unstale":"2023-10-06T11:06:36.566688+0000","last_undegraded":"2023-10-06T11:06:36.566688+0000","last_fullsized":"2023-10-06T11:06:36.566688+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:11:13.106985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"30'2","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.577901+0000","last_change":"2023-10-06T11:06:35.568732+0000","last_active":"2023-10-06T11:06:36.577901+0000","last_peered":"2023-10-06T11:06:36.577901+0000","last_clean":"2023-10-06T11:06:36.577901+0000","last_became_active":"2023-10-06T11:06:35.568493+0000","last_became_peered":"2023-10-06T11:06:35.568493+0000","last_unstale":"2023-10-06T11:06:36.577901+0000","last_undegraded":"2023-10-06T11:06:36.577901+0000","last_fullsized":"2023-10-06T11:06:36.577901+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:26.792165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.555527+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:03:01.050221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"30'2","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.579816+0000","last_change":"2023-10-06T11:06:35.567485+0000","last_active":"2023-10-06T11:06:36.579816+0000","last_peered":"2023-10-06T11:06:36.579816+0000","last_clean":"2023-10-06T11:06:36.579816+0000","last_became_active":"2023-10-06T11:06:35.567162+0000","last_became_peered":"2023-10-06T11:06:35.567162+0000","last_unstale":"2023-10-06T11:06:36.579816+0000","last_undegraded":"2023-10-06T11:06:36.579816+0000","last_fullsized":"2023-10-06T11:06:36.579816+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:12:01.035888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.560206+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:24:26.471584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.572139+0000","last_change":"2023-10-06T11:06:35.572139+0000","last_active":"2023-10-06T11:06:35.572139+0000","last_peered":"2023-10-06T11:06:35.572139+0000","last_clean":"2023-10-06T11:06:35.572139+0000","last_became_active":"2023-10-06T11:06:35.566406+0000","last_became_peered":"2023-10-06T11:06:35.566406+0000","last_unstale":"2023-10-06T11:06:35.572139+0000","last_undegraded":"2023-10-06T11:06:35.572139+0000","last_fullsized":"2023-10-06T11:06:35.572139+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:55:03.258755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.555302+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:50:39.669447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.573473+0000","last_change":"2023-10-06T11:06:35.573473+0000","last_active":"2023-10-06T11:06:35.573473+0000","last_peered":"2023-10-06T11:06:35.573473+0000","last_clean":"2023-10-06T11:06:35.573473+0000","last_became_active":"2023-10-06T11:06:35.573204+0000","last_became_peered":"2023-10-06T11:06:35.573204+0000","last_unstale":"2023-10-06T11:06:35.573473+0000","last_undegraded":"2023-10-06T11:06:35.573473+0000","last_fullsized":"2023-10-06T11:06:35.573473+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:52.551753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.564722+0000","last_change":"2023-10-06T11:06:36.564722+0000","last_active":"2023-10-06T11:06:36.564722+0000","last_peered":"2023-10-06T11:06:36.564722+0000","last_clean":"2023-10-06T11:06:36.564722+0000","last_became_active":"2023-10-06T11:06:36.564429+0000","last_became_peered":"2023-10-06T11:06:36.564429+0000","last_unstale":"2023-10-06T11:06:36.564722+0000","last_undegraded":"2023-10-06T11:06:36.564722+0000","last_fullsized":"2023-10-06T11:06:36.564722+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:30:40.428266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.570363+0000","last_change":"2023-10-06T11:06:35.563757+0000","last_active":"2023-10-06T11:06:35.570363+0000","last_peered":"2023-10-06T11:06:35.570363+0000","last_clean":"2023-10-06T11:06:35.570363+0000","last_became_active":"2023-10-06T11:06:35.563499+0000","last_became_peered":"2023-10-06T11:06:35.563499+0000","last_unstale":"2023-10-06T11:06:35.570363+0000","last_undegraded":"2023-10-06T11:06:35.570363+0000","last_fullsized":"2023-10-06T11:06:35.570363+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:52.551753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.555463+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:12:02.043126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.568186+0000","last_change":"2023-10-06T11:06:35.566496+0000","last_active":"2023-10-06T11:06:35.568186+0000","last_peered":"2023-10-06T11:06:35.568186+0000","last_clean":"2023-10-06T11:06:35.568186+0000","last_became_active":"2023-10-06T11:06:35.566211+0000","last_became_peered":"2023-10-06T11:06:35.566211+0000","last_unstale":"2023-10-06T11:06:35.568186+0000","last_undegraded":"2023-10-06T11:06:35.568186+0000","last_fullsized":"2023-10-06T11:06:35.568186+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:42:18.395648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.556385+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:47:35.465132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.570888+0000","last_change":"2023-10-06T11:06:35.570888+0000","last_active":"2023-10-06T11:06:35.570888+0000","last_peered":"2023-10-06T11:06:35.570888+0000","last_clean":"2023-10-06T11:06:35.570888+0000","last_became_active":"2023-10-06T11:06:35.570608+0000","last_became_peered":"2023-10-06T11:06:35.570608+0000","last_unstale":"2023-10-06T11:06:35.570888+0000","last_undegraded":"2023-10-06T11:06:35.570888+0000","last_fullsized":"2023-10-06T11:06:35.570888+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:35:11.323866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.566534+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:03:01.050221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.570188+0000","last_change":"2023-10-06T11:06:35.570188+0000","last_active":"2023-10-06T11:06:35.570188+0000","last_peered":"2023-10-06T11:06:35.570188+0000","last_clean":"2023-10-06T11:06:35.570188+0000","last_became_active":"2023-10-06T11:06:35.565593+0000","last_became_peered":"2023-10-06T11:06:35.565593+0000","last_unstale":"2023-10-06T11:06:35.570188+0000","last_undegraded":"2023-10-06T11:06:35.570188+0000","last_fullsized":"2023-10-06T11:06:35.570188+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:37:26.790499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.559557+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:59:13.791303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.572003+0000","last_change":"2023-10-06T11:06:35.572003+0000","last_active":"2023-10-06T11:06:35.572003+0000","last_peered":"2023-10-06T11:06:35.572003+0000","last_clean":"2023-10-06T11:06:35.572003+0000","last_became_active":"2023-10-06T11:06:35.571696+0000","last_became_peered":"2023-10-06T11:06:35.571696+0000","last_unstale":"2023-10-06T11:06:35.572003+0000","last_undegraded":"2023-10-06T11:06:35.572003+0000","last_fullsized":"2023-10-06T11:06:35.572003+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:26.792165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.561650+0000","last_change":"2023-10-06T11:06:36.561650+0000","last_active":"2023-10-06T11:06:36.561650+0000","last_peered":"2023-10-06T11:06:36.561650+0000","last_clean":"2023-10-06T11:06:36.561650+0000","last_became_active":"2023-10-06T11:06:36.561402+0000","last_became_peered":"2023-10-06T11:06:36.561402+0000","last_unstale":"2023-10-06T11:06:36.561650+0000","last_undegraded":"2023-10-06T11:06:36.561650+0000","last_fullsized":"2023-10-06T11:06:36.561650+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:27:30.195353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.567043+0000","last_change":"2023-10-06T11:06:35.567043+0000","last_active":"2023-10-06T11:06:35.567043+0000","last_peered":"2023-10-06T11:06:35.567043+0000","last_clean":"2023-10-06T11:06:35.567043+0000","last_became_active":"2023-10-06T11:06:35.566798+0000","last_became_peered":"2023-10-06T11:06:35.566798+0000","last_unstale":"2023-10-06T11:06:35.567043+0000","last_undegraded":"2023-10-06T11:06:35.567043+0000","last_fullsized":"2023-10-06T11:06:35.567043+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:50:38.662209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.558529+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:04:06.576517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.566555+0000","last_change":"2023-10-06T11:06:35.566555+0000","last_active":"2023-10-06T11:06:35.566555+0000","last_peered":"2023-10-06T11:06:35.566555+0000","last_clean":"2023-10-06T11:06:35.566555+0000","last_became_active":"2023-10-06T11:06:35.566300+0000","last_became_peered":"2023-10-06T11:06:35.566300+0000","last_unstale":"2023-10-06T11:06:35.566555+0000","last_undegraded":"2023-10-06T11:06:35.566555+0000","last_fullsized":"2023-10-06T11:06:35.566555+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:48:38.446657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.554511+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:59:13.791303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.570171+0000","last_change":"2023-10-06T11:06:35.563788+0000","last_active":"2023-10-06T11:06:35.570171+0000","last_peered":"2023-10-06T11:06:35.570171+0000","last_clean":"2023-10-06T11:06:35.570171+0000","last_became_active":"2023-10-06T11:06:35.563536+0000","last_became_peered":"2023-10-06T11:06:35.563536+0000","last_unstale":"2023-10-06T11:06:35.570171+0000","last_undegraded":"2023-10-06T11:06:35.570171+0000","last_fullsized":"2023-10-06T11:06:35.570171+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:37:26.790499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.562604+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:35:12.331105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.569968+0000","last_change":"2023-10-06T11:06:35.568542+0000","last_active":"2023-10-06T11:06:35.569968+0000","last_peered":"2023-10-06T11:06:35.569968+0000","last_clean":"2023-10-06T11:06:35.569968+0000","last_became_active":"2023-10-06T11:06:35.568247+0000","last_became_peered":"2023-10-06T11:06:35.568247+0000","last_unstale":"2023-10-06T11:06:35.569968+0000","last_undegraded":"2023-10-06T11:06:35.569968+0000","last_fullsized":"2023-10-06T11:06:35.569968+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:47:34.457893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.555063+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:24:26.471584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.573522+0000","last_change":"2023-10-06T11:06:35.573522+0000","last_active":"2023-10-06T11:06:35.573522+0000","last_peered":"2023-10-06T11:06:35.573522+0000","last_clean":"2023-10-06T11:06:35.573522+0000","last_became_active":"2023-10-06T11:06:35.573233+0000","last_became_peered":"2023-10-06T11:06:35.573233+0000","last_unstale":"2023-10-06T11:06:35.573522+0000","last_undegraded":"2023-10-06T11:06:35.573522+0000","last_fullsized":"2023-10-06T11:06:35.573522+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:37:26.790499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.554705+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:27.615158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.562619+0000","last_change":"2023-10-06T11:06:35.562619+0000","last_active":"2023-10-06T11:06:35.562619+0000","last_peered":"2023-10-06T11:06:35.562619+0000","last_clean":"2023-10-06T11:06:35.562619+0000","last_became_active":"2023-10-06T11:06:35.562355+0000","last_became_peered":"2023-10-06T11:06:35.562355+0000","last_unstale":"2023-10-06T11:06:35.562619+0000","last_undegraded":"2023-10-06T11:06:35.562619+0000","last_fullsized":"2023-10-06T11:06:35.562619+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:02:05.183430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.560355+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:24:26.471584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"30'2","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.580615+0000","last_change":"2023-10-06T11:06:35.566348+0000","last_active":"2023-10-06T11:06:36.580615+0000","last_peered":"2023-10-06T11:06:36.580615+0000","last_clean":"2023-10-06T11:06:36.580615+0000","last_became_active":"2023-10-06T11:06:35.565126+0000","last_became_peered":"2023-10-06T11:06:35.565126+0000","last_unstale":"2023-10-06T11:06:36.580615+0000","last_undegraded":"2023-10-06T11:06:36.580615+0000","last_fullsized":"2023-10-06T11:06:36.580615+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:59:12.784065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.564115+0000","last_change":"2023-10-06T11:06:36.564115+0000","last_active":"2023-10-06T11:06:36.564115+0000","last_peered":"2023-10-06T11:06:36.564115+0000","last_clean":"2023-10-06T11:06:36.564115+0000","last_became_active":"2023-10-06T11:06:36.563844+0000","last_became_peered":"2023-10-06T11:06:36.563844+0000","last_unstale":"2023-10-06T11:06:36.564115+0000","last_undegraded":"2023-10-06T11:06:36.564115+0000","last_fullsized":"2023-10-06T11:06:36.564115+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:02.194639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.570646+0000","last_change":"2023-10-06T11:06:35.570646+0000","last_active":"2023-10-06T11:06:35.570646+0000","last_peered":"2023-10-06T11:06:35.570646+0000","last_clean":"2023-10-06T11:06:35.570646+0000","last_became_active":"2023-10-06T11:06:35.570386+0000","last_became_peered":"2023-10-06T11:06:35.570386+0000","last_unstale":"2023-10-06T11:06:35.570646+0000","last_undegraded":"2023-10-06T11:06:35.570646+0000","last_fullsized":"2023-10-06T11:06:35.570646+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:10.251950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.555475+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:24:58.702337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.571568+0000","last_change":"2023-10-06T11:06:35.568732+0000","last_active":"2023-10-06T11:06:35.571568+0000","last_peered":"2023-10-06T11:06:35.571568+0000","last_clean":"2023-10-06T11:06:35.571568+0000","last_became_active":"2023-10-06T11:06:35.568460+0000","last_became_peered":"2023-10-06T11:06:35.568460+0000","last_unstale":"2023-10-06T11:06:35.571568+0000","last_undegraded":"2023-10-06T11:06:35.571568+0000","last_fullsized":"2023-10-06T11:06:35.571568+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:25.431156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.562560+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:50:39.669447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.565612+0000","last_change":"2023-10-06T11:06:35.565612+0000","last_active":"2023-10-06T11:06:35.565612+0000","last_peered":"2023-10-06T11:06:35.565612+0000","last_clean":"2023-10-06T11:06:35.565612+0000","last_became_active":"2023-10-06T11:06:35.565373+0000","last_became_peered":"2023-10-06T11:06:35.565373+0000","last_unstale":"2023-10-06T11:06:35.565612+0000","last_undegraded":"2023-10-06T11:06:35.565612+0000","last_fullsized":"2023-10-06T11:06:35.565612+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:22.790704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.558753+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:46:45.723235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.563587+0000","last_change":"2023-10-06T11:06:35.563587+0000","last_active":"2023-10-06T11:06:35.563587+0000","last_peered":"2023-10-06T11:06:35.563587+0000","last_clean":"2023-10-06T11:06:35.563587+0000","last_became_active":"2023-10-06T11:06:35.562933+0000","last_became_peered":"2023-10-06T11:06:35.562933+0000","last_unstale":"2023-10-06T11:06:35.563587+0000","last_undegraded":"2023-10-06T11:06:35.563587+0000","last_fullsized":"2023-10-06T11:06:35.563587+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:27:16.186215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.555165+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:18:51.654155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.573385+0000","last_change":"2023-10-06T11:06:35.573385+0000","last_active":"2023-10-06T11:06:35.573385+0000","last_peered":"2023-10-06T11:06:35.573385+0000","last_clean":"2023-10-06T11:06:35.573385+0000","last_became_active":"2023-10-06T11:06:35.573110+0000","last_became_peered":"2023-10-06T11:06:35.573110+0000","last_unstale":"2023-10-06T11:06:35.573385+0000","last_undegraded":"2023-10-06T11:06:35.573385+0000","last_fullsized":"2023-10-06T11:06:35.573385+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:54:46.474958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.554379+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:54.497548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.565314+0000","last_change":"2023-10-06T11:06:35.565314+0000","last_active":"2023-10-06T11:06:35.565314+0000","last_peered":"2023-10-06T11:06:35.565314+0000","last_clean":"2023-10-06T11:06:35.565314+0000","last_became_active":"2023-10-06T11:06:35.565003+0000","last_became_peered":"2023-10-06T11:06:35.565003+0000","last_unstale":"2023-10-06T11:06:35.565314+0000","last_undegraded":"2023-10-06T11:06:35.565314+0000","last_fullsized":"2023-10-06T11:06:35.565314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:06:59.444199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.578091+0000","last_change":"2023-10-06T11:06:36.578091+0000","last_active":"2023-10-06T11:06:36.578091+0000","last_peered":"2023-10-06T11:06:36.578091+0000","last_clean":"2023-10-06T11:06:36.578091+0000","last_became_active":"2023-10-06T11:06:36.577829+0000","last_became_peered":"2023-10-06T11:06:36.577829+0000","last_unstale":"2023-10-06T11:06:36.578091+0000","last_undegraded":"2023-10-06T11:06:36.578091+0000","last_fullsized":"2023-10-06T11:06:36.578091+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:32:31.550090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.569823+0000","last_change":"2023-10-06T11:06:35.568012+0000","last_active":"2023-10-06T11:06:35.569823+0000","last_peered":"2023-10-06T11:06:35.569823+0000","last_clean":"2023-10-06T11:06:35.569823+0000","last_became_active":"2023-10-06T11:06:35.567630+0000","last_became_peered":"2023-10-06T11:06:35.567630+0000","last_unstale":"2023-10-06T11:06:35.569823+0000","last_undegraded":"2023-10-06T11:06:35.569823+0000","last_fullsized":"2023-10-06T11:06:35.569823+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:24:25.464345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.557148+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:06:35.557148+0000","last_peered":"2023-10-06T11:06:35.557148+0000","last_clean":"2023-10-06T11:06:35.557148+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:06:35.557148+0000","last_undegraded":"2023-10-06T11:06:35.557148+0000","last_fullsized":"2023-10-06T11:06:35.557148+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.564430+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:54.497548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.565611+0000","last_change":"2023-10-06T11:06:35.565611+0000","last_active":"2023-10-06T11:06:35.565611+0000","last_peered":"2023-10-06T11:06:35.565611+0000","last_clean":"2023-10-06T11:06:35.565611+0000","last_became_active":"2023-10-06T11:06:35.565425+0000","last_became_peered":"2023-10-06T11:06:35.565425+0000","last_unstale":"2023-10-06T11:06:35.565611+0000","last_undegraded":"2023-10-06T11:06:35.565611+0000","last_fullsized":"2023-10-06T11:06:35.565611+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:04:05.569279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T11:06:34.554099+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:06:34.554099+0000","last_peered":"2023-10-06T11:06:34.554099+0000","last_clean":"2023-10-06T11:06:34.554099+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:06:34.554099+0000","last_undegraded":"2023-10-06T11:06:34.554099+0000","last_fullsized":"2023-10-06T11:06:34.554099+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.568057+0000","last_change":"2023-10-06T11:06:36.568057+0000","last_active":"2023-10-06T11:06:36.568057+0000","last_peered":"2023-10-06T11:06:36.568057+0000","last_clean":"2023-10-06T11:06:36.568057+0000","last_became_active":"2023-10-06T11:06:36.567776+0000","last_became_peered":"2023-10-06T11:06:36.567776+0000","last_unstale":"2023-10-06T11:06:36.568057+0000","last_undegraded":"2023-10-06T11:06:36.568057+0000","last_fullsized":"2023-10-06T11:06:36.568057+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:54.497548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.571084+0000","last_change":"2023-10-06T11:06:35.571084+0000","last_active":"2023-10-06T11:06:35.571084+0000","last_peered":"2023-10-06T11:06:35.571084+0000","last_clean":"2023-10-06T11:06:35.571084+0000","last_became_active":"2023-10-06T11:06:35.570790+0000","last_became_peered":"2023-10-06T11:06:35.570790+0000","last_unstale":"2023-10-06T11:06:35.571084+0000","last_undegraded":"2023-10-06T11:06:35.571084+0000","last_fullsized":"2023-10-06T11:06:35.571084+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:25.431156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.563251+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:06:35.563251+0000","last_peered":"2023-10-06T11:06:35.563251+0000","last_clean":"2023-10-06T11:06:35.563251+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:06:35.563251+0000","last_undegraded":"2023-10-06T11:06:35.563251+0000","last_fullsized":"2023-10-06T11:06:35.563251+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":169,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T11:06:34.552651+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:06:34.552651+0000","last_peered":"2023-10-06T11:06:34.552651+0000","last_clean":"2023-10-06T11:06:34.552651+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:06:34.552651+0000","last_undegraded":"2023-10-06T11:06:34.552651+0000","last_fullsized":"2023-10-06T11:06:34.552651+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.566037+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:27.615158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.562232+0000","last_change":"2023-10-06T11:06:35.562232+0000","last_active":"2023-10-06T11:06:35.562232+0000","last_peered":"2023-10-06T11:06:35.562232+0000","last_clean":"2023-10-06T11:06:35.562232+0000","last_became_active":"2023-10-06T11:06:35.561976+0000","last_became_peered":"2023-10-06T11:06:35.561976+0000","last_unstale":"2023-10-06T11:06:35.562232+0000","last_undegraded":"2023-10-06T11:06:35.562232+0000","last_fullsized":"2023-10-06T11:06:35.562232+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:50:26.045766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T11:06:34.552999+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:06:34.552999+0000","last_peered":"2023-10-06T11:06:34.552999+0000","last_clean":"2023-10-06T11:06:34.552999+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:06:34.552999+0000","last_undegraded":"2023-10-06T11:06:34.552999+0000","last_fullsized":"2023-10-06T11:06:34.552999+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.556811+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:54.497548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.575854+0000","last_change":"2023-10-06T11:06:35.575854+0000","last_active":"2023-10-06T11:06:35.575854+0000","last_peered":"2023-10-06T11:06:35.575854+0000","last_clean":"2023-10-06T11:06:35.575854+0000","last_became_active":"2023-10-06T11:06:35.575563+0000","last_became_peered":"2023-10-06T11:06:35.575563+0000","last_unstale":"2023-10-06T11:06:35.575854+0000","last_undegraded":"2023-10-06T11:06:35.575854+0000","last_fullsized":"2023-10-06T11:06:35.575854+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:18:50.646916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T11:06:34.552645+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:06:34.552645+0000","last_peered":"2023-10-06T11:06:34.552645+0000","last_clean":"2023-10-06T11:06:34.552645+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:06:34.552645+0000","last_undegraded":"2023-10-06T11:06:34.552645+0000","last_fullsized":"2023-10-06T11:06:34.552645+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.554674+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:42:19.402886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.571025+0000","last_change":"2023-10-06T11:06:35.571025+0000","last_active":"2023-10-06T11:06:35.571025+0000","last_peered":"2023-10-06T11:06:35.571025+0000","last_clean":"2023-10-06T11:06:35.571025+0000","last_became_active":"2023-10-06T11:06:35.570772+0000","last_became_peered":"2023-10-06T11:06:35.570772+0000","last_unstale":"2023-10-06T11:06:35.571025+0000","last_undegraded":"2023-10-06T11:06:35.571025+0000","last_fullsized":"2023-10-06T11:06:35.571025+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:54:46.474958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T11:06:34.549969+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:06:34.549969+0000","last_peered":"2023-10-06T11:06:34.549969+0000","last_clean":"2023-10-06T11:06:34.549969+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:06:34.549969+0000","last_undegraded":"2023-10-06T11:06:34.549969+0000","last_fullsized":"2023-10-06T11:06:34.549969+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.569370+0000","last_change":"2023-10-06T11:06:36.569370+0000","last_active":"2023-10-06T11:06:36.569370+0000","last_peered":"2023-10-06T11:06:36.569370+0000","last_clean":"2023-10-06T11:06:36.569370+0000","last_became_active":"2023-10-06T11:06:36.569170+0000","last_became_peered":"2023-10-06T11:06:36.569170+0000","last_unstale":"2023-10-06T11:06:36.569370+0000","last_undegraded":"2023-10-06T11:06:36.569370+0000","last_fullsized":"2023-10-06T11:06:36.569370+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:24:26.471584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.567471+0000","last_change":"2023-10-06T11:06:35.565421+0000","last_active":"2023-10-06T11:06:35.567471+0000","last_peered":"2023-10-06T11:06:35.567471+0000","last_clean":"2023-10-06T11:06:35.567471+0000","last_became_active":"2023-10-06T11:06:35.565160+0000","last_became_peered":"2023-10-06T11:06:35.565160+0000","last_unstale":"2023-10-06T11:06:35.567471+0000","last_undegraded":"2023-10-06T11:06:35.567471+0000","last_fullsized":"2023-10-06T11:06:35.567471+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:21:20.221637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.563206+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:06:35.563206+0000","last_peered":"2023-10-06T11:06:35.563206+0000","last_clean":"2023-10-06T11:06:35.563206+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:06:35.563206+0000","last_undegraded":"2023-10-06T11:06:35.563206+0000","last_fullsized":"2023-10-06T11:06:35.563206+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.559729+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:42:19.402886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.567604+0000","last_change":"2023-10-06T11:06:35.567604+0000","last_active":"2023-10-06T11:06:35.567604+0000","last_peered":"2023-10-06T11:06:35.567604+0000","last_clean":"2023-10-06T11:06:35.567604+0000","last_became_active":"2023-10-06T11:06:35.567290+0000","last_became_peered":"2023-10-06T11:06:35.567290+0000","last_unstale":"2023-10-06T11:06:35.567604+0000","last_undegraded":"2023-10-06T11:06:35.567604+0000","last_fullsized":"2023-10-06T11:06:35.567604+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:18:50.646916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.563054+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:06:35.563054+0000","last_peered":"2023-10-06T11:06:35.563054+0000","last_clean":"2023-10-06T11:06:35.563054+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:06:35.563054+0000","last_undegraded":"2023-10-06T11:06:35.563054+0000","last_fullsized":"2023-10-06T11:06:35.563054+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":554,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298172,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073668,"statfs":{"total":96636764160,"available":96331436032,"internally_reserved":0,"allocated":905216,"data_stored":711130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297600,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074240,"statfs":{"total":96636764160,"available":96332021760,"internally_reserved":0,"allocated":319488,"data_stored":126025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298200,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073640,"statfs":{"total":96636764160,"available":96331407360,"internally_reserved":0,"allocated":933888,"data_stored":724952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297600,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074240,"statfs":{"total":96636764160,"available":96332021760,"internally_reserved":0,"allocated":319488,"data_stored":126025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297600,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074240,"statfs":{"total":96636764160,"available":96332021760,"internally_reserved":0,"allocated":319488,"data_stored":126025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297600,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074240,"statfs":{"total":96636764160,"available":96332021760,"internally_reserved":0,"allocated":319488,"data_stored":126025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297624,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074216,"statfs":{"total":96636764160,"available":96331997184,"internally_reserved":0,"allocated":344064,"data_stored":135070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":311296,"data_stored":120762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:06:41.359 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3f is not active+clean 2023-10-06T11:06:41.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:06:35.546099+0000', 'last_change': '2023-10-06T11:06:35.555937+0000', 'last_active': '2023-10-06T11:06:35.546099+0000', 'last_peered': '2023-10-06T11:06:35.546099+0000', 'last_clean': '2023-10-06T11:06:35.546099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:06:35.546099+0000', 'last_undegraded': '2023-10-06T11:06:35.546099+0000', 'last_fullsized': '2023-10-06T11:06:35.546099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_clean_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:10:47.800013+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T11:06:41.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3e is not active+clean 2023-10-06T11:06:41.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:06:35.546099+0000', 'last_change': '2023-10-06T11:06:35.555568+0000', 'last_active': '2023-10-06T11:06:35.546099+0000', 'last_peered': '2023-10-06T11:06:35.546099+0000', 'last_clean': '2023-10-06T11:06:35.546099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:06:35.546099+0000', 'last_undegraded': '2023-10-06T11:06:35.546099+0000', 'last_fullsized': '2023-10-06T11:06:35.546099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_clean_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:55:53.550011+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T11:06:41.360 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3d is not active+clean 2023-10-06T11:06:41.360 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:06:35.546099+0000', 'last_change': '2023-10-06T11:06:35.561454+0000', 'last_active': '2023-10-06T11:06:35.546099+0000', 'last_peered': '2023-10-06T11:06:35.546099+0000', 'last_clean': '2023-10-06T11:06:35.546099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:06:35.546099+0000', 'last_undegraded': '2023-10-06T11:06:35.546099+0000', 'last_fullsized': '2023-10-06T11:06:35.546099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_clean_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:12:02.043126+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:06:41.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3c is not active+clean 2023-10-06T11:06:41.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:06:35.546099+0000', 'last_change': '2023-10-06T11:06:35.558319+0000', 'last_active': '2023-10-06T11:06:35.546099+0000', 'last_peered': '2023-10-06T11:06:35.546099+0000', 'last_clean': '2023-10-06T11:06:35.546099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:06:35.546099+0000', 'last_undegraded': '2023-10-06T11:06:35.546099+0000', 'last_fullsized': '2023-10-06T11:06:35.546099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_clean_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T21:55:04.265993+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T11:06:41.361 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3b is not active+clean 2023-10-06T11:06:41.361 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:06:35.546099+0000', 'last_change': '2023-10-06T11:06:35.556959+0000', 'last_active': '2023-10-06T11:06:35.546099+0000', 'last_peered': '2023-10-06T11:06:35.546099+0000', 'last_clean': '2023-10-06T11:06:35.546099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:06:35.546099+0000', 'last_undegraded': '2023-10-06T11:06:35.546099+0000', 'last_fullsized': '2023-10-06T11:06:35.546099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_clean_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T17:57:12.272427+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T11:06:41.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.39 is not active+clean 2023-10-06T11:06:41.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:06:35.546099+0000', 'last_change': '2023-10-06T11:06:35.554712+0000', 'last_active': '2023-10-06T11:06:35.546099+0000', 'last_peered': '2023-10-06T11:06:35.546099+0000', 'last_clean': '2023-10-06T11:06:35.546099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:06:35.546099+0000', 'last_undegraded': '2023-10-06T11:06:35.546099+0000', 'last_fullsized': '2023-10-06T11:06:35.546099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_clean_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:54:47.482196+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T11:06:41.362 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.38 is not active+clean 2023-10-06T11:06:41.362 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:06:35.546099+0000', 'last_change': '2023-10-06T11:06:35.555530+0000', 'last_active': '2023-10-06T11:06:35.546099+0000', 'last_peered': '2023-10-06T11:06:35.546099+0000', 'last_clean': '2023-10-06T11:06:35.546099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:06:35.546099+0000', 'last_undegraded': '2023-10-06T11:06:35.546099+0000', 'last_fullsized': '2023-10-06T11:06:35.546099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_clean_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:10:02.184653+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T11:06:41.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.37 is not active+clean 2023-10-06T11:06:41.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:06:35.546099+0000', 'last_change': '2023-10-06T11:06:35.559560+0000', 'last_active': '2023-10-06T11:06:35.546099+0000', 'last_peered': '2023-10-06T11:06:35.546099+0000', 'last_clean': '2023-10-06T11:06:35.546099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:06:35.546099+0000', 'last_undegraded': '2023-10-06T11:06:35.546099+0000', 'last_fullsized': '2023-10-06T11:06:35.546099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_clean_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T17:27:27.615158+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:06:41.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.36 is not active+clean 2023-10-06T11:06:41.363 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:06:35.546099+0000', 'last_change': '2023-10-06T11:06:35.558009+0000', 'last_active': '2023-10-06T11:06:35.546099+0000', 'last_peered': '2023-10-06T11:06:35.546099+0000', 'last_clean': '2023-10-06T11:06:35.546099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:06:35.546099+0000', 'last_undegraded': '2023-10-06T11:06:35.546099+0000', 'last_fullsized': '2023-10-06T11:06:35.546099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_clean_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T22:59:13.791303+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T11:06:41.363 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.35 is not active+clean 2023-10-06T11:06:41.364 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:06:35.546099+0000', 'last_change': '2023-10-06T11:06:35.557630+0000', 'last_active': '2023-10-06T11:06:35.546099+0000', 'last_peered': '2023-10-06T11:06:35.546099+0000', 'last_clean': '2023-10-06T11:06:35.546099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:06:35.546099+0000', 'last_undegraded': '2023-10-06T11:06:35.546099+0000', 'last_fullsized': '2023-10-06T11:06:35.546099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_clean_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T17:35:12.331105+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T11:06:41.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.34 is not active+clean 2023-10-06T11:06:41.364 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:06:35.546099+0000', 'last_change': '2023-10-06T11:06:35.558756+0000', 'last_active': '2023-10-06T11:06:35.546099+0000', 'last_peered': '2023-10-06T11:06:35.546099+0000', 'last_clean': '2023-10-06T11:06:35.546099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:06:35.546099+0000', 'last_undegraded': '2023-10-06T11:06:35.546099+0000', 'last_fullsized': '2023-10-06T11:06:35.546099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_clean_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:41:54.497548+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:06:41.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.33 is not active+clean 2023-10-06T11:06:41.364 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:06:35.546099+0000', 'last_change': '2023-10-06T11:06:35.557611+0000', 'last_active': '2023-10-06T11:06:35.546099+0000', 'last_peered': '2023-10-06T11:06:35.546099+0000', 'last_clean': '2023-10-06T11:06:35.546099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:06:35.546099+0000', 'last_undegraded': '2023-10-06T11:06:35.546099+0000', 'last_fullsized': '2023-10-06T11:06:35.546099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_clean_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T17:27:27.615158+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T11:06:41.364 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.31 is not active+clean 2023-10-06T11:06:41.364 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:06:35.546099+0000', 'last_change': '2023-10-06T11:06:35.556104+0000', 'last_active': '2023-10-06T11:06:35.546099+0000', 'last_peered': '2023-10-06T11:06:35.546099+0000', 'last_clean': '2023-10-06T11:06:35.546099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:06:35.546099+0000', 'last_undegraded': '2023-10-06T11:06:35.546099+0000', 'last_fullsized': '2023-10-06T11:06:35.546099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_clean_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T18:04:06.576517+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T11:06:41.365 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.30 is not active+clean 2023-10-06T11:06:41.365 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:06:35.546099+0000', 'last_change': '2023-10-06T11:06:35.566902+0000', 'last_active': '2023-10-06T11:06:35.546099+0000', 'last_peered': '2023-10-06T11:06:35.546099+0000', 'last_clean': '2023-10-06T11:06:35.546099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:06:35.546099+0000', 'last_undegraded': '2023-10-06T11:06:35.546099+0000', 'last_fullsized': '2023-10-06T11:06:35.546099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_clean_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:10:02.184653+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T11:06:41.365 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2f is not active+clean 2023-10-06T11:06:41.365 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:06:35.546099+0000', 'last_change': '2023-10-06T11:06:35.566595+0000', 'last_active': '2023-10-06T11:06:35.546099+0000', 'last_peered': '2023-10-06T11:06:35.546099+0000', 'last_clean': '2023-10-06T11:06:35.546099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:06:35.546099+0000', 'last_undegraded': '2023-10-06T11:06:35.546099+0000', 'last_fullsized': '2023-10-06T11:06:35.546099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_clean_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T22:59:13.791303+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T11:06:41.365 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2d is not active+clean 2023-10-06T11:06:41.365 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:06:35.546099+0000', 'last_change': '2023-10-06T11:06:35.556450+0000', 'last_active': '2023-10-06T11:06:35.546099+0000', 'last_peered': '2023-10-06T11:06:35.546099+0000', 'last_clean': '2023-10-06T11:06:35.546099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:06:35.546099+0000', 'last_undegraded': '2023-10-06T11:06:35.546099+0000', 'last_fullsized': '2023-10-06T11:06:35.546099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_clean_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T22:21:21.228875+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T11:06:41.365 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2b is not active+clean 2023-10-06T11:06:41.365 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:06:35.546099+0000', 'last_change': '2023-10-06T11:06:35.556166+0000', 'last_active': '2023-10-06T11:06:35.546099+0000', 'last_peered': '2023-10-06T11:06:35.546099+0000', 'last_clean': '2023-10-06T11:06:35.546099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:06:35.546099+0000', 'last_undegraded': '2023-10-06T11:06:35.546099+0000', 'last_fullsized': '2023-10-06T11:06:35.546099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_clean_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:46:45.723235+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T11:06:41.365 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.29 is not active+clean 2023-10-06T11:06:41.365 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:06:35.546099+0000', 'last_change': '2023-10-06T11:06:35.562630+0000', 'last_active': '2023-10-06T11:06:35.546099+0000', 'last_peered': '2023-10-06T11:06:35.546099+0000', 'last_clean': '2023-10-06T11:06:35.546099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:06:35.546099+0000', 'last_undegraded': '2023-10-06T11:06:35.546099+0000', 'last_fullsized': '2023-10-06T11:06:35.546099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_clean_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T18:04:06.576517+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T11:06:41.366 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.28 is not active+clean 2023-10-06T11:06:41.366 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:06:35.546099+0000', 'last_change': '2023-10-06T11:06:35.556572+0000', 'last_active': '2023-10-06T11:06:35.546099+0000', 'last_peered': '2023-10-06T11:06:35.546099+0000', 'last_clean': '2023-10-06T11:06:35.546099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:06:35.546099+0000', 'last_undegraded': '2023-10-06T11:06:35.546099+0000', 'last_fullsized': '2023-10-06T11:06:35.546099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_clean_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:22:13.035423+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T11:06:41.366 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.24 is not active+clean 2023-10-06T11:06:41.366 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:06:35.546099+0000', 'last_change': '2023-10-06T11:06:35.554784+0000', 'last_active': '2023-10-06T11:06:35.546099+0000', 'last_peered': '2023-10-06T11:06:35.546099+0000', 'last_clean': '2023-10-06T11:06:35.546099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:06:35.546099+0000', 'last_undegraded': '2023-10-06T11:06:35.546099+0000', 'last_fullsized': '2023-10-06T11:06:35.546099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_clean_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:48:39.453895+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T11:06:41.366 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.21 is not active+clean 2023-10-06T11:06:41.366 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:06:35.546099+0000', 'last_change': '2023-10-06T11:06:35.566095+0000', 'last_active': '2023-10-06T11:06:35.546099+0000', 'last_peered': '2023-10-06T11:06:35.546099+0000', 'last_clean': '2023-10-06T11:06:35.546099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:06:35.546099+0000', 'last_undegraded': '2023-10-06T11:06:35.546099+0000', 'last_fullsized': '2023-10-06T11:06:35.546099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_clean_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:12:02.043126+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T11:06:41.366 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2023-10-06T11:06:41.366 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:06:35.546099+0000', 'last_change': '2023-10-06T11:06:35.563727+0000', 'last_active': '2023-10-06T11:06:35.546099+0000', 'last_peered': '2023-10-06T11:06:35.546099+0000', 'last_clean': '2023-10-06T11:06:35.546099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:06:35.546099+0000', 'last_undegraded': '2023-10-06T11:06:35.546099+0000', 'last_fullsized': '2023-10-06T11:06:35.546099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_clean_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:46:45.723235+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T11:06:41.367 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2023-10-06T11:06:41.367 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:06:35.546099+0000', 'last_change': '2023-10-06T11:06:35.555527+0000', 'last_active': '2023-10-06T11:06:35.546099+0000', 'last_peered': '2023-10-06T11:06:35.546099+0000', 'last_clean': '2023-10-06T11:06:35.546099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:06:35.546099+0000', 'last_undegraded': '2023-10-06T11:06:35.546099+0000', 'last_fullsized': '2023-10-06T11:06:35.546099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_clean_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:03:01.050221+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T11:06:41.367 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2023-10-06T11:06:41.367 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:06:35.546099+0000', 'last_change': '2023-10-06T11:06:35.560206+0000', 'last_active': '2023-10-06T11:06:35.546099+0000', 'last_peered': '2023-10-06T11:06:35.546099+0000', 'last_clean': '2023-10-06T11:06:35.546099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:06:35.546099+0000', 'last_undegraded': '2023-10-06T11:06:35.546099+0000', 'last_fullsized': '2023-10-06T11:06:35.546099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_clean_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T22:24:26.471584+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:06:41.367 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2023-10-06T11:06:41.367 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:06:35.546099+0000', 'last_change': '2023-10-06T11:06:35.555302+0000', 'last_active': '2023-10-06T11:06:35.546099+0000', 'last_peered': '2023-10-06T11:06:35.546099+0000', 'last_clean': '2023-10-06T11:06:35.546099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:06:35.546099+0000', 'last_undegraded': '2023-10-06T11:06:35.546099+0000', 'last_fullsized': '2023-10-06T11:06:35.546099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_clean_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T17:50:39.669447+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T11:06:41.367 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2023-10-06T11:06:41.367 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:06:35.546099+0000', 'last_change': '2023-10-06T11:06:35.555463+0000', 'last_active': '2023-10-06T11:06:35.546099+0000', 'last_peered': '2023-10-06T11:06:35.546099+0000', 'last_clean': '2023-10-06T11:06:35.546099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:06:35.546099+0000', 'last_undegraded': '2023-10-06T11:06:35.546099+0000', 'last_fullsized': '2023-10-06T11:06:35.546099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_clean_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:12:02.043126+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T11:06:41.368 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2023-10-06T11:06:41.368 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:06:35.546099+0000', 'last_change': '2023-10-06T11:06:35.556385+0000', 'last_active': '2023-10-06T11:06:35.546099+0000', 'last_peered': '2023-10-06T11:06:35.546099+0000', 'last_clean': '2023-10-06T11:06:35.546099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:06:35.546099+0000', 'last_undegraded': '2023-10-06T11:06:35.546099+0000', 'last_fullsized': '2023-10-06T11:06:35.546099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_clean_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T19:47:35.465132+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T11:06:41.368 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2023-10-06T11:06:41.368 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:06:35.546099+0000', 'last_change': '2023-10-06T11:06:35.566534+0000', 'last_active': '2023-10-06T11:06:35.546099+0000', 'last_peered': '2023-10-06T11:06:35.546099+0000', 'last_clean': '2023-10-06T11:06:35.546099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:06:35.546099+0000', 'last_undegraded': '2023-10-06T11:06:35.546099+0000', 'last_fullsized': '2023-10-06T11:06:35.546099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_clean_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:03:01.050221+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T11:06:41.368 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2023-10-06T11:06:41.368 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:06:35.546099+0000', 'last_change': '2023-10-06T11:06:35.559557+0000', 'last_active': '2023-10-06T11:06:35.546099+0000', 'last_peered': '2023-10-06T11:06:35.546099+0000', 'last_clean': '2023-10-06T11:06:35.546099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:06:35.546099+0000', 'last_undegraded': '2023-10-06T11:06:35.546099+0000', 'last_fullsized': '2023-10-06T11:06:35.546099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_clean_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T22:59:13.791303+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:06:41.368 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2023-10-06T11:06:41.368 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:06:35.546099+0000', 'last_change': '2023-10-06T11:06:35.558529+0000', 'last_active': '2023-10-06T11:06:35.546099+0000', 'last_peered': '2023-10-06T11:06:35.546099+0000', 'last_clean': '2023-10-06T11:06:35.546099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:06:35.546099+0000', 'last_undegraded': '2023-10-06T11:06:35.546099+0000', 'last_fullsized': '2023-10-06T11:06:35.546099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_clean_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T18:04:06.576517+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:06:41.368 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2023-10-06T11:06:41.368 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:06:35.546099+0000', 'last_change': '2023-10-06T11:06:35.554511+0000', 'last_active': '2023-10-06T11:06:35.546099+0000', 'last_peered': '2023-10-06T11:06:35.546099+0000', 'last_clean': '2023-10-06T11:06:35.546099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:06:35.546099+0000', 'last_undegraded': '2023-10-06T11:06:35.546099+0000', 'last_fullsized': '2023-10-06T11:06:35.546099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_clean_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T22:59:13.791303+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T11:06:41.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2023-10-06T11:06:41.369 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:06:35.546099+0000', 'last_change': '2023-10-06T11:06:35.562604+0000', 'last_active': '2023-10-06T11:06:35.546099+0000', 'last_peered': '2023-10-06T11:06:35.546099+0000', 'last_clean': '2023-10-06T11:06:35.546099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:06:35.546099+0000', 'last_undegraded': '2023-10-06T11:06:35.546099+0000', 'last_fullsized': '2023-10-06T11:06:35.546099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_clean_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T17:35:12.331105+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T11:06:41.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2023-10-06T11:06:41.369 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:06:35.546099+0000', 'last_change': '2023-10-06T11:06:35.555063+0000', 'last_active': '2023-10-06T11:06:35.546099+0000', 'last_peered': '2023-10-06T11:06:35.546099+0000', 'last_clean': '2023-10-06T11:06:35.546099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:06:35.546099+0000', 'last_undegraded': '2023-10-06T11:06:35.546099+0000', 'last_fullsized': '2023-10-06T11:06:35.546099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_clean_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T22:24:26.471584+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T11:06:41.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2023-10-06T11:06:41.369 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:06:35.546099+0000', 'last_change': '2023-10-06T11:06:35.554705+0000', 'last_active': '2023-10-06T11:06:35.546099+0000', 'last_peered': '2023-10-06T11:06:35.546099+0000', 'last_clean': '2023-10-06T11:06:35.546099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:06:35.546099+0000', 'last_undegraded': '2023-10-06T11:06:35.546099+0000', 'last_fullsized': '2023-10-06T11:06:35.546099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_clean_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T17:27:27.615158+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T11:06:41.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2023-10-06T11:06:41.369 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:06:35.546099+0000', 'last_change': '2023-10-06T11:06:35.560355+0000', 'last_active': '2023-10-06T11:06:35.546099+0000', 'last_peered': '2023-10-06T11:06:35.546099+0000', 'last_clean': '2023-10-06T11:06:35.546099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:06:35.546099+0000', 'last_undegraded': '2023-10-06T11:06:35.546099+0000', 'last_fullsized': '2023-10-06T11:06:35.546099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_clean_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T22:24:26.471584+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T11:06:41.370 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2023-10-06T11:06:41.370 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:06:35.546099+0000', 'last_change': '2023-10-06T11:06:35.555475+0000', 'last_active': '2023-10-06T11:06:35.546099+0000', 'last_peered': '2023-10-06T11:06:35.546099+0000', 'last_clean': '2023-10-06T11:06:35.546099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:06:35.546099+0000', 'last_undegraded': '2023-10-06T11:06:35.546099+0000', 'last_fullsized': '2023-10-06T11:06:35.546099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_clean_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:24:58.702337+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T11:06:41.370 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2023-10-06T11:06:41.370 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:06:35.546099+0000', 'last_change': '2023-10-06T11:06:35.562560+0000', 'last_active': '2023-10-06T11:06:35.546099+0000', 'last_peered': '2023-10-06T11:06:35.546099+0000', 'last_clean': '2023-10-06T11:06:35.546099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:06:35.546099+0000', 'last_undegraded': '2023-10-06T11:06:35.546099+0000', 'last_fullsized': '2023-10-06T11:06:35.546099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_clean_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T17:50:39.669447+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T11:06:41.370 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2023-10-06T11:06:41.370 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:06:35.546099+0000', 'last_change': '2023-10-06T11:06:35.558753+0000', 'last_active': '2023-10-06T11:06:35.546099+0000', 'last_peered': '2023-10-06T11:06:35.546099+0000', 'last_clean': '2023-10-06T11:06:35.546099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:06:35.546099+0000', 'last_undegraded': '2023-10-06T11:06:35.546099+0000', 'last_fullsized': '2023-10-06T11:06:35.546099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_clean_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:46:45.723235+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:06:41.370 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2023-10-06T11:06:41.370 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:06:35.546099+0000', 'last_change': '2023-10-06T11:06:35.555165+0000', 'last_active': '2023-10-06T11:06:35.546099+0000', 'last_peered': '2023-10-06T11:06:35.546099+0000', 'last_clean': '2023-10-06T11:06:35.546099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:06:35.546099+0000', 'last_undegraded': '2023-10-06T11:06:35.546099+0000', 'last_fullsized': '2023-10-06T11:06:35.546099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_clean_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T18:18:51.654155+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T11:06:41.370 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2023-10-06T11:06:41.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:06:35.546099+0000', 'last_change': '2023-10-06T11:06:35.554379+0000', 'last_active': '2023-10-06T11:06:35.546099+0000', 'last_peered': '2023-10-06T11:06:35.546099+0000', 'last_clean': '2023-10-06T11:06:35.546099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:06:35.546099+0000', 'last_undegraded': '2023-10-06T11:06:35.546099+0000', 'last_fullsized': '2023-10-06T11:06:35.546099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_clean_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:41:54.497548+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T11:06:41.371 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2023-10-06T11:06:41.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:06:35.546099+0000', 'last_change': '2023-10-06T11:06:35.564430+0000', 'last_active': '2023-10-06T11:06:35.546099+0000', 'last_peered': '2023-10-06T11:06:35.546099+0000', 'last_clean': '2023-10-06T11:06:35.546099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:06:35.546099+0000', 'last_undegraded': '2023-10-06T11:06:35.546099+0000', 'last_fullsized': '2023-10-06T11:06:35.546099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_clean_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:41:54.497548+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T11:06:41.371 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2023-10-06T11:06:41.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:06:35.546099+0000', 'last_change': '2023-10-06T11:06:35.566037+0000', 'last_active': '2023-10-06T11:06:35.546099+0000', 'last_peered': '2023-10-06T11:06:35.546099+0000', 'last_clean': '2023-10-06T11:06:35.546099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:06:35.546099+0000', 'last_undegraded': '2023-10-06T11:06:35.546099+0000', 'last_fullsized': '2023-10-06T11:06:35.546099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_clean_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T17:27:27.615158+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T11:06:41.371 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2023-10-06T11:06:41.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:06:35.546099+0000', 'last_change': '2023-10-06T11:06:35.556811+0000', 'last_active': '2023-10-06T11:06:35.546099+0000', 'last_peered': '2023-10-06T11:06:35.546099+0000', 'last_clean': '2023-10-06T11:06:35.546099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:06:35.546099+0000', 'last_undegraded': '2023-10-06T11:06:35.546099+0000', 'last_fullsized': '2023-10-06T11:06:35.546099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_clean_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:41:54.497548+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T11:06:41.371 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2023-10-06T11:06:41.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:06:35.546099+0000', 'last_change': '2023-10-06T11:06:35.554674+0000', 'last_active': '2023-10-06T11:06:35.546099+0000', 'last_peered': '2023-10-06T11:06:35.546099+0000', 'last_clean': '2023-10-06T11:06:35.546099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:06:35.546099+0000', 'last_undegraded': '2023-10-06T11:06:35.546099+0000', 'last_fullsized': '2023-10-06T11:06:35.546099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_clean_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T18:42:19.402886+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T11:06:41.371 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2023-10-06T11:06:41.372 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:06:35.546099+0000', 'last_change': '2023-10-06T11:06:35.559729+0000', 'last_active': '2023-10-06T11:06:35.546099+0000', 'last_peered': '2023-10-06T11:06:35.546099+0000', 'last_clean': '2023-10-06T11:06:35.546099+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:06:35.546099+0000', 'last_undegraded': '2023-10-06T11:06:35.546099+0000', 'last_fullsized': '2023-10-06T11:06:35.546099+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'last_clean_scrub_stamp': '2023-10-06T11:06:35.546099+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T18:42:19.402886+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:06:41.372 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T11:06:41.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.503+0000 7f8078983700 1 Processor -- start 2023-10-06T11:06:41.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.503+0000 7f8078983700 1 -- start start 2023-10-06T11:06:41.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.504+0000 7f8078983700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8074153ab0 0x7f807415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:41.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.504+0000 7f8078983700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8074068ba0 0x7f80740b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:41.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.504+0000 7f8078983700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f807415ac30 con 0x7f8074153e80 2023-10-06T11:06:41.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.504+0000 7f8078983700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80740b4510 con 0x7f8074068ba0 2023-10-06T11:06:41.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.504+0000 7f8078983700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80740b6530 con 0x7f8074153ab0 2023-10-06T11:06:41.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.504+0000 7f8072d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8074068ba0 0x7f80740b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:41.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.504+0000 7f8072d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8074068ba0 0x7f80740b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39848/0 (socket says 172.21.15.146:39848) 2023-10-06T11:06:41.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.504+0000 7f8072d9d700 1 -- 172.21.15.146:0/1572548049 learned_addr learned my addr 172.21.15.146:0/1572548049 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:41.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.504+0000 7f807259c700 1 --2- 172.21.15.146:0/1572548049 >> v2:172.21.15.151:3300/0 conn(0x7f8074153ab0 0x7f807415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:41.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.504+0000 7f8072d9d700 1 -- 172.21.15.146:0/1572548049 >> v2:172.21.15.151:3300/0 conn(0x7f8074153ab0 msgr2=0x7f807415a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:41.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.504+0000 7f8072d9d700 1 --2- 172.21.15.146:0/1572548049 >> v2:172.21.15.151:3300/0 conn(0x7f8074153ab0 0x7f807415a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:41.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.504+0000 7f8072d9d700 1 -- 172.21.15.146:0/1572548049 >> v1:172.21.15.151:6789/0 conn(0x7f8074153e80 legacy=0x7f8074068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:41.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.504+0000 7f8072d9d700 1 -- 172.21.15.146:0/1572548049 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80740b5c50 con 0x7f8074068ba0 2023-10-06T11:06:41.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.504+0000 7f8072d9d700 1 --2- 172.21.15.146:0/1572548049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8074068ba0 0x7f80740b49a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f80740b5eb0 tx=0x7f806c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2098c8da1af241c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:41.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.504+0000 7f807159a700 1 -- 172.21.15.146:0/1572548049 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806c00e070 con 0x7f8074068ba0 2023-10-06T11:06:41.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.504+0000 7f807159a700 1 -- 172.21.15.146:0/1572548049 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806c00ba20 con 0x7f8074068ba0 2023-10-06T11:06:41.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.504+0000 7f807159a700 1 -- 172.21.15.146:0/1572548049 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806c0092e0 con 0x7f8074068ba0 2023-10-06T11:06:41.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.505+0000 7f8078983700 1 -- 172.21.15.146:0/1572548049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8074068ba0 msgr2=0x7f80740b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:41.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.505+0000 7f8078983700 1 --2- 172.21.15.146:0/1572548049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8074068ba0 0x7f80740b49a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f80740b5eb0 tx=0x7f806c009840 comp rx=0 tx=0).stop 2023-10-06T11:06:41.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.505+0000 7f8078983700 1 -- 172.21.15.146:0/1572548049 shutdown_connections 2023-10-06T11:06:41.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.505+0000 7f8078983700 1 --2- 172.21.15.146:0/1572548049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8074068ba0 0x7f80740b49a0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:41.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.505+0000 7f8078983700 1 --2- 172.21.15.146:0/1572548049 >> v2:172.21.15.151:3300/0 conn(0x7f8074153ab0 0x7f807415a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:41.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.505+0000 7f8078983700 1 -- 172.21.15.146:0/1572548049 >> 172.21.15.146:0/1572548049 conn(0x7f807406eba0 msgr2=0x7f807406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:41.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.505+0000 7f8078983700 1 -- 172.21.15.146:0/1572548049 shutdown_connections 2023-10-06T11:06:41.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.505+0000 7f8078983700 1 -- 172.21.15.146:0/1572548049 wait complete. 2023-10-06T11:06:41.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.506+0000 7f8078983700 1 Processor -- start 2023-10-06T11:06:41.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.506+0000 7f8078983700 1 -- start start 2023-10-06T11:06:41.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.507+0000 7f8078983700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8074068ba0 0x7f80740c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:41.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.507+0000 7f8078983700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8074153ab0 0x7f80740c58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:41.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.507+0000 7f8078983700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8074153e80 0x7f8074159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:41.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.507+0000 7f8078983700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8074159490 con 0x7f8074068ba0 2023-10-06T11:06:41.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.507+0000 7f8078983700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8074158880 con 0x7f8074153ab0 2023-10-06T11:06:41.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.507+0000 7f8078983700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8074158b60 con 0x7f8074153e80 2023-10-06T11:06:41.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.507+0000 7f807259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8074068ba0 0x7f80740c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:41.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.507+0000 7f807259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8074068ba0 0x7f80740c53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39862/0 (socket says 172.21.15.146:39862) 2023-10-06T11:06:41.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.507+0000 7f807259c700 1 -- 172.21.15.146:0/4123506533 learned_addr learned my addr 172.21.15.146:0/4123506533 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:41.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.507+0000 7f8072d9d700 1 --2- 172.21.15.146:0/4123506533 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8074153e80 0x7f8074159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:41.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.507+0000 7f8071d9b700 1 --2- 172.21.15.146:0/4123506533 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8074153ab0 0x7f80740c58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:41.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.507+0000 7f807259c700 1 -- 172.21.15.146:0/4123506533 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8074153e80 msgr2=0x7f8074159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:41.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.507+0000 7f807259c700 1 --2- 172.21.15.146:0/4123506533 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8074153e80 0x7f8074159920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:41.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.507+0000 7f807259c700 1 -- 172.21.15.146:0/4123506533 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8074153ab0 msgr2=0x7f80740c58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:41.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.507+0000 7f807259c700 1 --2- 172.21.15.146:0/4123506533 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8074153ab0 0x7f80740c58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:41.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.507+0000 7f807259c700 1 -- 172.21.15.146:0/4123506533 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f806c009ae0 con 0x7f8074068ba0 2023-10-06T11:06:41.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.507+0000 7f8072d9d700 1 --2- 172.21.15.146:0/4123506533 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8074153e80 0x7f8074159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:06:41.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.507+0000 7f807259c700 1 --2- 172.21.15.146:0/4123506533 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8074068ba0 0x7f80740c53a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f806400ec80 tx=0x7f80640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:41.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.508+0000 7f80627fc700 1 -- 172.21.15.146:0/4123506533 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806400c9d0 con 0x7f8074068ba0 2023-10-06T11:06:41.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.508+0000 7f80627fc700 1 -- 172.21.15.146:0/4123506533 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806400cb30 con 0x7f8074068ba0 2023-10-06T11:06:41.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.508+0000 7f8078983700 1 -- 172.21.15.146:0/4123506533 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8074158e40 con 0x7f8074068ba0 2023-10-06T11:06:41.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.508+0000 7f80627fc700 1 -- 172.21.15.146:0/4123506533 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8064013470 con 0x7f8074068ba0 2023-10-06T11:06:41.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.508+0000 7f8078983700 1 -- 172.21.15.146:0/4123506533 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8074141860 con 0x7f8074068ba0 2023-10-06T11:06:41.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.508+0000 7f8078983700 1 -- 172.21.15.146:0/4123506533 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f807404c380 con 0x7f8074068ba0 2023-10-06T11:06:41.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.509+0000 7f80627fc700 1 -- 172.21.15.146:0/4123506533 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8064013820 con 0x7f8074068ba0 2023-10-06T11:06:41.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.509+0000 7f80627fc700 1 --2- 172.21.15.146:0/4123506533 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8054066f30 0x7f80540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:41.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.509+0000 7f80627fc700 1 -- 172.21.15.146:0/4123506533 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8064084a80 con 0x7f8074068ba0 2023-10-06T11:06:41.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.509+0000 7f8071d9b700 1 --2- 172.21.15.146:0/4123506533 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8054066f30 0x7f80540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:41.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.510+0000 7f8071d9b700 1 --2- 172.21.15.146:0/4123506533 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8054066f30 0x7f80540693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8074158040 tx=0x7f8068009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:41.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.513+0000 7f80627fc700 1 -- 172.21.15.146:0/4123506533 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8064051b90 con 0x7f8074068ba0 2023-10-06T11:06:41.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.773+0000 7f8078983700 1 -- 172.21.15.146:0/4123506533 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f8074159770 con 0x7f8074068ba0 2023-10-06T11:06:41.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.774+0000 7f80627fc700 1 -- 172.21.15.146:0/4123506533 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1646 (secure 0 0 0) 0x7f80640551b0 con 0x7f8074068ba0 2023-10-06T11:06:41.775 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:06:41.777 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":76,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":31,"num_osds":8,"num_up_osds":8,"osd_up_since":1696590336,"num_in_osds":8,"osd_in_since":1696590327,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":60},{"state_name":"creating+peering","count":45}],"num_pgs":105,"num_pools":4,"num_objects":7,"data_bytes":590922,"bytes_used":2439155712,"bytes_avail":770654957568,"bytes_total":773094113280,"inactive_pgs_ratio":0.4285714328289032,"write_bytes_sec":170,"read_op_per_sec":0,"write_op_per_sec":2},"fsmap":{"epoch":16,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":4986}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2023-10-06T11:06:39.152799+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T11:06:41.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.775+0000 7f8078983700 1 -- 172.21.15.146:0/4123506533 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8054066f30 msgr2=0x7f80540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:41.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.775+0000 7f8078983700 1 --2- 172.21.15.146:0/4123506533 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8054066f30 0x7f80540693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8074158040 tx=0x7f8068009040 comp rx=0 tx=0).stop 2023-10-06T11:06:41.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.775+0000 7f8078983700 1 -- 172.21.15.146:0/4123506533 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8074068ba0 msgr2=0x7f80740c53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:41.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.775+0000 7f8078983700 1 --2- 172.21.15.146:0/4123506533 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8074068ba0 0x7f80740c53a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f806400ec80 tx=0x7f80640091a0 comp rx=0 tx=0).stop 2023-10-06T11:06:41.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.775+0000 7f8078983700 1 -- 172.21.15.146:0/4123506533 shutdown_connections 2023-10-06T11:06:41.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.775+0000 7f8078983700 1 --2- 172.21.15.146:0/4123506533 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8054066f30 0x7f80540693e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:41.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.775+0000 7f8078983700 1 --2- 172.21.15.146:0/4123506533 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8074153e80 0x7f8074159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:41.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.775+0000 7f8078983700 1 --2- 172.21.15.146:0/4123506533 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8074068ba0 0x7f80740c53a0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:41.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.775+0000 7f8078983700 1 --2- 172.21.15.146:0/4123506533 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8074153ab0 0x7f80740c58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:41.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.775+0000 7f8078983700 1 -- 172.21.15.146:0/4123506533 >> 172.21.15.146:0/4123506533 conn(0x7f807406eba0 msgr2=0x7f80740d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:41.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.776+0000 7f8078983700 1 -- 172.21.15.146:0/4123506533 shutdown_connections 2023-10-06T11:06:41.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.776+0000 7f8078983700 1 -- 172.21.15.146:0/4123506533 wait complete. 2023-10-06T11:06:41.789 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-06T11:06:41.789 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:06:41.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.903+0000 7fd29e352700 1 Processor -- start 2023-10-06T11:06:41.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.903+0000 7fd29e352700 1 -- start start 2023-10-06T11:06:41.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.903+0000 7fd29e352700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd2980cc950 0x7fd298157800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:41.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.903+0000 7fd29e352700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2980ccf20 con 0x7fd298157430 2023-10-06T11:06:41.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.903+0000 7fd29e352700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2980cd200 con 0x7fd2980ab010 2023-10-06T11:06:41.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.903+0000 7fd29e352700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2980c3dd0 con 0x7fd2980cc950 2023-10-06T11:06:41.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.904+0000 7fd29c8ef700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd2980cc950 0x7fd298157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:41.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.904+0000 7fd297fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd298157430 0x7fd2980ceb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38672/0 (socket says 172.21.15.146:38672) 2023-10-06T11:06:41.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.904+0000 7fd297fff700 1 -- 172.21.15.146:0/1214140874 learned_addr learned my addr 172.21.15.146:0/1214140874 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:41.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.904+0000 7fd29c8ef700 1 -- 172.21.15.146:0/1214140874 >> v1:172.21.15.151:6789/0 conn(0x7fd2980ab010 legacy=0x7fd2980cc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:41.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.904+0000 7fd29c8ef700 1 -- 172.21.15.146:0/1214140874 >> v1:172.21.15.146:6789/0 conn(0x7fd298157430 legacy=0x7fd2980ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:41.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.904+0000 7fd296ffd700 1 -- 172.21.15.146:0/1214140874 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2060571683 0 0) 0x7fd2980ccf20 con 0x7fd298157430 2023-10-06T11:06:41.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.904+0000 7fd29c8ef700 1 -- 172.21.15.146:0/1214140874 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2980cd4e0 con 0x7fd2980cc950 2023-10-06T11:06:41.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.904+0000 7fd29c8ef700 1 --2- 172.21.15.146:0/1214140874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2980cc950 0x7fd298157800 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd290009e60 tx=0x7fd290009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38cef34a52547f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:41.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.904+0000 7fd296ffd700 1 -- 172.21.15.146:0/1214140874 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29000e070 con 0x7fd2980cc950 2023-10-06T11:06:41.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.904+0000 7fd296ffd700 1 -- 172.21.15.146:0/1214140874 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd29000bc30 con 0x7fd2980cc950 2023-10-06T11:06:41.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.904+0000 7fd296ffd700 1 -- 172.21.15.146:0/1214140874 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd290012430 con 0x7fd2980cc950 2023-10-06T11:06:41.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.905+0000 7fd29e352700 1 -- 172.21.15.146:0/1214140874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2980cc950 msgr2=0x7fd298157800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:41.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.905+0000 7fd29e352700 1 --2- 172.21.15.146:0/1214140874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2980cc950 0x7fd298157800 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd290009e60 tx=0x7fd290009780 comp rx=0 tx=0).stop 2023-10-06T11:06:41.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.905+0000 7fd29e352700 1 -- 172.21.15.146:0/1214140874 shutdown_connections 2023-10-06T11:06:41.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.905+0000 7fd29e352700 1 --2- 172.21.15.146:0/1214140874 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2980cc950 0x7fd298157800 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:41.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.905+0000 7fd29e352700 1 -- 172.21.15.146:0/1214140874 >> 172.21.15.146:0/1214140874 conn(0x7fd298067c50 msgr2=0x7fd2980ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:41.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.905+0000 7fd29e352700 1 -- 172.21.15.146:0/1214140874 shutdown_connections 2023-10-06T11:06:41.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.905+0000 7fd29e352700 1 -- 172.21.15.146:0/1214140874 wait complete. 2023-10-06T11:06:41.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.906+0000 7fd29e352700 1 Processor -- start 2023-10-06T11:06:41.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.906+0000 7fd29e352700 1 -- start start 2023-10-06T11:06:41.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.907+0000 7fd29e352700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2980ab010 0x7fd2981674b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:41.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.907+0000 7fd29e352700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2980cc950 0x7fd298145dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:41.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.907+0000 7fd29e352700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd298157430 0x7fd2980aee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:41.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.907+0000 7fd29e352700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2980adb70 con 0x7fd2980ab010 2023-10-06T11:06:41.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.907+0000 7fd29e352700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd298167b30 con 0x7fd2980cc950 2023-10-06T11:06:41.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.907+0000 7fd29e352700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd298167e10 con 0x7fd298157430 2023-10-06T11:06:41.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.907+0000 7fd297fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2980ab010 0x7fd2981674b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:41.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.907+0000 7fd297fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2980ab010 0x7fd2981674b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39880/0 (socket says 172.21.15.146:39880) 2023-10-06T11:06:41.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.907+0000 7fd297fff700 1 -- 172.21.15.146:0/254129873 learned_addr learned my addr 172.21.15.146:0/254129873 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:41.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.907+0000 7fd2977fe700 1 --2- 172.21.15.146:0/254129873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2980cc950 0x7fd298145dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:41.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.907+0000 7fd29c8ef700 1 --2- 172.21.15.146:0/254129873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd298157430 0x7fd2980aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:41.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.907+0000 7fd297fff700 1 -- 172.21.15.146:0/254129873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd298157430 msgr2=0x7fd2980aee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:41.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.907+0000 7fd297fff700 1 --2- 172.21.15.146:0/254129873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd298157430 0x7fd2980aee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:41.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.907+0000 7fd297fff700 1 -- 172.21.15.146:0/254129873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2980cc950 msgr2=0x7fd298145dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:41.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.907+0000 7fd297fff700 1 --2- 172.21.15.146:0/254129873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2980cc950 0x7fd298145dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:41.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.907+0000 7fd297fff700 1 -- 172.21.15.146:0/254129873 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd290009a20 con 0x7fd2980ab010 2023-10-06T11:06:41.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.907+0000 7fd297fff700 1 --2- 172.21.15.146:0/254129873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2980ab010 0x7fd2981674b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd28800c5b0 tx=0x7fd288001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:41.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.907+0000 7fd27ffff700 1 -- 172.21.15.146:0/254129873 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd288005b30 con 0x7fd2980ab010 2023-10-06T11:06:41.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.907+0000 7fd27ffff700 1 -- 172.21.15.146:0/254129873 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd288005c90 con 0x7fd2980ab010 2023-10-06T11:06:41.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.907+0000 7fd27ffff700 1 -- 172.21.15.146:0/254129873 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd288007300 con 0x7fd2980ab010 2023-10-06T11:06:41.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.907+0000 7fd29e352700 1 -- 172.21.15.146:0/254129873 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2981680f0 con 0x7fd2980ab010 2023-10-06T11:06:41.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.907+0000 7fd29e352700 1 -- 172.21.15.146:0/254129873 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd298152600 con 0x7fd2980ab010 2023-10-06T11:06:41.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.908+0000 7fd29e352700 1 -- 172.21.15.146:0/254129873 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2980ad930 con 0x7fd2980ab010 2023-10-06T11:06:41.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.909+0000 7fd27ffff700 1 -- 172.21.15.146:0/254129873 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd28801b3b0 con 0x7fd2980ab010 2023-10-06T11:06:41.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.909+0000 7fd27ffff700 1 --2- 172.21.15.146:0/254129873 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd284066f30 0x7fd2840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:41.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.909+0000 7fd27ffff700 1 -- 172.21.15.146:0/254129873 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd288083a90 con 0x7fd2980ab010 2023-10-06T11:06:41.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.909+0000 7fd2977fe700 1 --2- 172.21.15.146:0/254129873 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd284066f30 0x7fd2840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:41.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.909+0000 7fd2977fe700 1 --2- 172.21.15.146:0/254129873 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd284066f30 0x7fd2840693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd298068180 tx=0x7fd28c007ec0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:41.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:41.913+0000 7fd27ffff700 1 -- 172.21.15.146:0/254129873 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd288050ba0 con 0x7fd2980ab010 2023-10-06T11:06:42.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:42.093+0000 7fd29e352700 1 -- 172.21.15.146:0/254129873 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd2980adcb0 con 0x7fd284066f30 2023-10-06T11:06:42.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:42.101+0000 7fd27ffff700 1 -- 172.21.15.146:0/254129873 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284891 (secure 0 0 0) 0x7fd28c014450 con 0x7fd284066f30 2023-10-06T11:06:42.105 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:06:42.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:42.104+0000 7fd29e352700 1 -- 172.21.15.146:0/254129873 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd284066f30 msgr2=0x7fd2840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:42.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:42.104+0000 7fd29e352700 1 --2- 172.21.15.146:0/254129873 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd284066f30 0x7fd2840693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd298068180 tx=0x7fd28c007ec0 comp rx=0 tx=0).stop 2023-10-06T11:06:42.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:42.104+0000 7fd29e352700 1 -- 172.21.15.146:0/254129873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2980ab010 msgr2=0x7fd2981674b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:42.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:42.104+0000 7fd29e352700 1 --2- 172.21.15.146:0/254129873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2980ab010 0x7fd2981674b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd28800c5b0 tx=0x7fd288001070 comp rx=0 tx=0).stop 2023-10-06T11:06:42.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:42.104+0000 7fd29e352700 1 -- 172.21.15.146:0/254129873 shutdown_connections 2023-10-06T11:06:42.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:42.104+0000 7fd29e352700 1 --2- 172.21.15.146:0/254129873 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd284066f30 0x7fd2840693e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:42.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:42.104+0000 7fd29e352700 1 --2- 172.21.15.146:0/254129873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd298157430 0x7fd2980aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:42.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:42.104+0000 7fd29e352700 1 --2- 172.21.15.146:0/254129873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2980ab010 0x7fd2981674b0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:42.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:42.104+0000 7fd29e352700 1 --2- 172.21.15.146:0/254129873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2980cc950 0x7fd298145dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:42.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:42.104+0000 7fd29e352700 1 -- 172.21.15.146:0/254129873 >> 172.21.15.146:0/254129873 conn(0x7fd298067c50 msgr2=0x7fd298153f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:42.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:42.104+0000 7fd29e352700 1 -- 172.21.15.146:0/254129873 shutdown_connections 2023-10-06T11:06:42.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:42.104+0000 7fd29e352700 1 -- 172.21.15.146:0/254129873 wait complete. 2023-10-06T11:06:42.109 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:06:42.117 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2023-10-06T11:06:41.153094+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590922,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":172,"num_write_kb":2417,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":127,"ondisk_log_size":127,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":74,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381988,"kb_used_data":3684,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592732,"statfs":{"total":773094113280,"available":770654957568,"internally_reserved":0,"allocated":3772416,"data_stored":2196014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":554,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001088"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.555937+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:10:47.800013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.555568+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:53.550011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.561454+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:12:02.043126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.558319+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:55:04.265993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.556959+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:57:12.272427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.577548+0000","last_change":"2023-10-06T11:06:36.577548+0000","last_active":"2023-10-06T11:06:36.577548+0000","last_peered":"2023-10-06T11:06:36.577548+0000","last_clean":"2023-10-06T11:06:36.577548+0000","last_became_active":"2023-10-06T11:06:36.577311+0000","last_became_peered":"2023-10-06T11:06:36.577311+0000","last_unstale":"2023-10-06T11:06:36.577548+0000","last_undegraded":"2023-10-06T11:06:36.577548+0000","last_fullsized":"2023-10-06T11:06:36.577548+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:42:19.402886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.554712+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:54:47.482196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.555530+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:02.184653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.559560+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:27.615158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.558009+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:59:13.791303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.557630+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:35:12.331105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.558756+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:54.497548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.557611+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:27.615158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.566565+0000","last_change":"2023-10-06T11:06:36.566565+0000","last_active":"2023-10-06T11:06:36.566565+0000","last_peered":"2023-10-06T11:06:36.566565+0000","last_clean":"2023-10-06T11:06:36.566565+0000","last_became_active":"2023-10-06T11:06:36.566292+0000","last_became_peered":"2023-10-06T11:06:36.566292+0000","last_unstale":"2023-10-06T11:06:36.566565+0000","last_undegraded":"2023-10-06T11:06:36.566565+0000","last_fullsized":"2023-10-06T11:06:36.566565+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:40:32.681590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.556104+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:04:06.576517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.566902+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:02.184653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.566595+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:59:13.791303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.572882+0000","last_change":"2023-10-06T11:06:36.572882+0000","last_active":"2023-10-06T11:06:36.572882+0000","last_peered":"2023-10-06T11:06:36.572882+0000","last_clean":"2023-10-06T11:06:36.572882+0000","last_became_active":"2023-10-06T11:06:36.572597+0000","last_became_peered":"2023-10-06T11:06:36.572597+0000","last_unstale":"2023-10-06T11:06:36.572882+0000","last_undegraded":"2023-10-06T11:06:36.572882+0000","last_fullsized":"2023-10-06T11:06:36.572882+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:37:27.797737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.556450+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:21:21.228875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.578432+0000","last_change":"2023-10-06T11:06:36.578432+0000","last_active":"2023-10-06T11:06:36.578432+0000","last_peered":"2023-10-06T11:06:36.578432+0000","last_clean":"2023-10-06T11:06:36.578432+0000","last_became_active":"2023-10-06T11:06:36.578156+0000","last_became_peered":"2023-10-06T11:06:36.578156+0000","last_unstale":"2023-10-06T11:06:36.578432+0000","last_undegraded":"2023-10-06T11:06:36.578432+0000","last_fullsized":"2023-10-06T11:06:36.578432+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:53.558991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.556166+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:46:45.723235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.565509+0000","last_change":"2023-10-06T11:06:36.565509+0000","last_active":"2023-10-06T11:06:36.565509+0000","last_peered":"2023-10-06T11:06:36.565509+0000","last_clean":"2023-10-06T11:06:36.565509+0000","last_became_active":"2023-10-06T11:06:36.565187+0000","last_became_peered":"2023-10-06T11:06:36.565187+0000","last_unstale":"2023-10-06T11:06:36.565509+0000","last_undegraded":"2023-10-06T11:06:36.565509+0000","last_fullsized":"2023-10-06T11:06:36.565509+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:15:22.214670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.562630+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:04:06.576517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.556572+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:22:13.035423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.568754+0000","last_change":"2023-10-06T11:06:36.568754+0000","last_active":"2023-10-06T11:06:36.568754+0000","last_peered":"2023-10-06T11:06:36.568754+0000","last_clean":"2023-10-06T11:06:36.568754+0000","last_became_active":"2023-10-06T11:06:36.567464+0000","last_became_peered":"2023-10-06T11:06:36.567464+0000","last_unstale":"2023-10-06T11:06:36.568754+0000","last_undegraded":"2023-10-06T11:06:36.568754+0000","last_fullsized":"2023-10-06T11:06:36.568754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:54:47.482196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.568939+0000","last_change":"2023-10-06T11:06:36.568939+0000","last_active":"2023-10-06T11:06:36.568939+0000","last_peered":"2023-10-06T11:06:36.568939+0000","last_clean":"2023-10-06T11:06:36.568939+0000","last_became_active":"2023-10-06T11:06:36.567759+0000","last_became_peered":"2023-10-06T11:06:36.567759+0000","last_unstale":"2023-10-06T11:06:36.568939+0000","last_undegraded":"2023-10-06T11:06:36.568939+0000","last_fullsized":"2023-10-06T11:06:36.568939+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:59:13.791303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.566548+0000","last_change":"2023-10-06T11:06:36.566548+0000","last_active":"2023-10-06T11:06:36.566548+0000","last_peered":"2023-10-06T11:06:36.566548+0000","last_clean":"2023-10-06T11:06:36.566548+0000","last_became_active":"2023-10-06T11:06:36.566290+0000","last_became_peered":"2023-10-06T11:06:36.566290+0000","last_unstale":"2023-10-06T11:06:36.566548+0000","last_undegraded":"2023-10-06T11:06:36.566548+0000","last_fullsized":"2023-10-06T11:06:36.566548+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:27.799403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.554784+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:48:39.453895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.568346+0000","last_change":"2023-10-06T11:06:36.568346+0000","last_active":"2023-10-06T11:06:36.568346+0000","last_peered":"2023-10-06T11:06:36.568346+0000","last_clean":"2023-10-06T11:06:36.568346+0000","last_became_active":"2023-10-06T11:06:36.568044+0000","last_became_peered":"2023-10-06T11:06:36.568044+0000","last_unstale":"2023-10-06T11:06:36.568346+0000","last_undegraded":"2023-10-06T11:06:36.568346+0000","last_fullsized":"2023-10-06T11:06:36.568346+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:02:06.190668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.578800+0000","last_change":"2023-10-06T11:06:36.578800+0000","last_active":"2023-10-06T11:06:36.578800+0000","last_peered":"2023-10-06T11:06:36.578800+0000","last_clean":"2023-10-06T11:06:36.578800+0000","last_became_active":"2023-10-06T11:06:36.577352+0000","last_became_peered":"2023-10-06T11:06:36.577352+0000","last_unstale":"2023-10-06T11:06:36.578800+0000","last_undegraded":"2023-10-06T11:06:36.578800+0000","last_fullsized":"2023-10-06T11:06:36.578800+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:18:51.654155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.566095+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:12:02.043126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.561959+0000","last_change":"2023-10-06T11:06:36.561959+0000","last_active":"2023-10-06T11:06:36.561959+0000","last_peered":"2023-10-06T11:06:36.561959+0000","last_clean":"2023-10-06T11:06:36.561959+0000","last_became_active":"2023-10-06T11:06:36.561663+0000","last_became_peered":"2023-10-06T11:06:36.561663+0000","last_unstale":"2023-10-06T11:06:36.561959+0000","last_undegraded":"2023-10-06T11:06:36.561959+0000","last_fullsized":"2023-10-06T11:06:36.561959+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:27.615158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.563727+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:46:45.723235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"30'4","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.579947+0000","last_change":"2023-10-06T11:06:35.569189+0000","last_active":"2023-10-06T11:06:36.579947+0000","last_peered":"2023-10-06T11:06:36.579947+0000","last_clean":"2023-10-06T11:06:36.579947+0000","last_became_active":"2023-10-06T11:06:35.568921+0000","last_became_peered":"2023-10-06T11:06:35.568921+0000","last_unstale":"2023-10-06T11:06:36.579947+0000","last_undegraded":"2023-10-06T11:06:36.579947+0000","last_fullsized":"2023-10-06T11:06:36.579947+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:24:57.695098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.576765+0000","last_change":"2023-10-06T11:06:36.576765+0000","last_active":"2023-10-06T11:06:36.576765+0000","last_peered":"2023-10-06T11:06:36.576765+0000","last_clean":"2023-10-06T11:06:36.576765+0000","last_became_active":"2023-10-06T11:06:36.576511+0000","last_became_peered":"2023-10-06T11:06:36.576511+0000","last_unstale":"2023-10-06T11:06:36.576765+0000","last_undegraded":"2023-10-06T11:06:36.576765+0000","last_fullsized":"2023-10-06T11:06:36.576765+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:12:02.043126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.569717+0000","last_change":"2023-10-06T11:06:35.569717+0000","last_active":"2023-10-06T11:06:35.569717+0000","last_peered":"2023-10-06T11:06:35.569717+0000","last_clean":"2023-10-06T11:06:35.569717+0000","last_became_active":"2023-10-06T11:06:35.569537+0000","last_became_peered":"2023-10-06T11:06:35.569537+0000","last_unstale":"2023-10-06T11:06:35.569717+0000","last_undegraded":"2023-10-06T11:06:35.569717+0000","last_fullsized":"2023-10-06T11:06:35.569717+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:48:38.446657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.566688+0000","last_change":"2023-10-06T11:06:36.566688+0000","last_active":"2023-10-06T11:06:36.566688+0000","last_peered":"2023-10-06T11:06:36.566688+0000","last_clean":"2023-10-06T11:06:36.566688+0000","last_became_active":"2023-10-06T11:06:36.566407+0000","last_became_peered":"2023-10-06T11:06:36.566407+0000","last_unstale":"2023-10-06T11:06:36.566688+0000","last_undegraded":"2023-10-06T11:06:36.566688+0000","last_fullsized":"2023-10-06T11:06:36.566688+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:11:13.106985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"30'2","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.577901+0000","last_change":"2023-10-06T11:06:35.568732+0000","last_active":"2023-10-06T11:06:36.577901+0000","last_peered":"2023-10-06T11:06:36.577901+0000","last_clean":"2023-10-06T11:06:36.577901+0000","last_became_active":"2023-10-06T11:06:35.568493+0000","last_became_peered":"2023-10-06T11:06:35.568493+0000","last_unstale":"2023-10-06T11:06:36.577901+0000","last_undegraded":"2023-10-06T11:06:36.577901+0000","last_fullsized":"2023-10-06T11:06:36.577901+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:26.792165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.555527+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:03:01.050221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"30'2","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.579816+0000","last_change":"2023-10-06T11:06:35.567485+0000","last_active":"2023-10-06T11:06:36.579816+0000","last_peered":"2023-10-06T11:06:36.579816+0000","last_clean":"2023-10-06T11:06:36.579816+0000","last_became_active":"2023-10-06T11:06:35.567162+0000","last_became_peered":"2023-10-06T11:06:35.567162+0000","last_unstale":"2023-10-06T11:06:36.579816+0000","last_undegraded":"2023-10-06T11:06:36.579816+0000","last_fullsized":"2023-10-06T11:06:36.579816+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:12:01.035888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.560206+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:24:26.471584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.572139+0000","last_change":"2023-10-06T11:06:35.572139+0000","last_active":"2023-10-06T11:06:35.572139+0000","last_peered":"2023-10-06T11:06:35.572139+0000","last_clean":"2023-10-06T11:06:35.572139+0000","last_became_active":"2023-10-06T11:06:35.566406+0000","last_became_peered":"2023-10-06T11:06:35.566406+0000","last_unstale":"2023-10-06T11:06:35.572139+0000","last_undegraded":"2023-10-06T11:06:35.572139+0000","last_fullsized":"2023-10-06T11:06:35.572139+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:55:03.258755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.555302+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:50:39.669447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.573473+0000","last_change":"2023-10-06T11:06:35.573473+0000","last_active":"2023-10-06T11:06:35.573473+0000","last_peered":"2023-10-06T11:06:35.573473+0000","last_clean":"2023-10-06T11:06:35.573473+0000","last_became_active":"2023-10-06T11:06:35.573204+0000","last_became_peered":"2023-10-06T11:06:35.573204+0000","last_unstale":"2023-10-06T11:06:35.573473+0000","last_undegraded":"2023-10-06T11:06:35.573473+0000","last_fullsized":"2023-10-06T11:06:35.573473+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:52.551753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.564722+0000","last_change":"2023-10-06T11:06:36.564722+0000","last_active":"2023-10-06T11:06:36.564722+0000","last_peered":"2023-10-06T11:06:36.564722+0000","last_clean":"2023-10-06T11:06:36.564722+0000","last_became_active":"2023-10-06T11:06:36.564429+0000","last_became_peered":"2023-10-06T11:06:36.564429+0000","last_unstale":"2023-10-06T11:06:36.564722+0000","last_undegraded":"2023-10-06T11:06:36.564722+0000","last_fullsized":"2023-10-06T11:06:36.564722+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:30:40.428266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.570363+0000","last_change":"2023-10-06T11:06:35.563757+0000","last_active":"2023-10-06T11:06:35.570363+0000","last_peered":"2023-10-06T11:06:35.570363+0000","last_clean":"2023-10-06T11:06:35.570363+0000","last_became_active":"2023-10-06T11:06:35.563499+0000","last_became_peered":"2023-10-06T11:06:35.563499+0000","last_unstale":"2023-10-06T11:06:35.570363+0000","last_undegraded":"2023-10-06T11:06:35.570363+0000","last_fullsized":"2023-10-06T11:06:35.570363+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:52.551753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.555463+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:12:02.043126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.568186+0000","last_change":"2023-10-06T11:06:35.566496+0000","last_active":"2023-10-06T11:06:35.568186+0000","last_peered":"2023-10-06T11:06:35.568186+0000","last_clean":"2023-10-06T11:06:35.568186+0000","last_became_active":"2023-10-06T11:06:35.566211+0000","last_became_peered":"2023-10-06T11:06:35.566211+0000","last_unstale":"2023-10-06T11:06:35.568186+0000","last_undegraded":"2023-10-06T11:06:35.568186+0000","last_fullsized":"2023-10-06T11:06:35.568186+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:42:18.395648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.556385+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:47:35.465132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.570888+0000","last_change":"2023-10-06T11:06:35.570888+0000","last_active":"2023-10-06T11:06:35.570888+0000","last_peered":"2023-10-06T11:06:35.570888+0000","last_clean":"2023-10-06T11:06:35.570888+0000","last_became_active":"2023-10-06T11:06:35.570608+0000","last_became_peered":"2023-10-06T11:06:35.570608+0000","last_unstale":"2023-10-06T11:06:35.570888+0000","last_undegraded":"2023-10-06T11:06:35.570888+0000","last_fullsized":"2023-10-06T11:06:35.570888+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:35:11.323866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.566534+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:03:01.050221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.570188+0000","last_change":"2023-10-06T11:06:35.570188+0000","last_active":"2023-10-06T11:06:35.570188+0000","last_peered":"2023-10-06T11:06:35.570188+0000","last_clean":"2023-10-06T11:06:35.570188+0000","last_became_active":"2023-10-06T11:06:35.565593+0000","last_became_peered":"2023-10-06T11:06:35.565593+0000","last_unstale":"2023-10-06T11:06:35.570188+0000","last_undegraded":"2023-10-06T11:06:35.570188+0000","last_fullsized":"2023-10-06T11:06:35.570188+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:37:26.790499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.559557+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:59:13.791303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.572003+0000","last_change":"2023-10-06T11:06:35.572003+0000","last_active":"2023-10-06T11:06:35.572003+0000","last_peered":"2023-10-06T11:06:35.572003+0000","last_clean":"2023-10-06T11:06:35.572003+0000","last_became_active":"2023-10-06T11:06:35.571696+0000","last_became_peered":"2023-10-06T11:06:35.571696+0000","last_unstale":"2023-10-06T11:06:35.572003+0000","last_undegraded":"2023-10-06T11:06:35.572003+0000","last_fullsized":"2023-10-06T11:06:35.572003+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:26.792165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.561650+0000","last_change":"2023-10-06T11:06:36.561650+0000","last_active":"2023-10-06T11:06:36.561650+0000","last_peered":"2023-10-06T11:06:36.561650+0000","last_clean":"2023-10-06T11:06:36.561650+0000","last_became_active":"2023-10-06T11:06:36.561402+0000","last_became_peered":"2023-10-06T11:06:36.561402+0000","last_unstale":"2023-10-06T11:06:36.561650+0000","last_undegraded":"2023-10-06T11:06:36.561650+0000","last_fullsized":"2023-10-06T11:06:36.561650+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:27:30.195353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.567043+0000","last_change":"2023-10-06T11:06:35.567043+0000","last_active":"2023-10-06T11:06:35.567043+0000","last_peered":"2023-10-06T11:06:35.567043+0000","last_clean":"2023-10-06T11:06:35.567043+0000","last_became_active":"2023-10-06T11:06:35.566798+0000","last_became_peered":"2023-10-06T11:06:35.566798+0000","last_unstale":"2023-10-06T11:06:35.567043+0000","last_undegraded":"2023-10-06T11:06:35.567043+0000","last_fullsized":"2023-10-06T11:06:35.567043+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:50:38.662209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.558529+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:04:06.576517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.566555+0000","last_change":"2023-10-06T11:06:35.566555+0000","last_active":"2023-10-06T11:06:35.566555+0000","last_peered":"2023-10-06T11:06:35.566555+0000","last_clean":"2023-10-06T11:06:35.566555+0000","last_became_active":"2023-10-06T11:06:35.566300+0000","last_became_peered":"2023-10-06T11:06:35.566300+0000","last_unstale":"2023-10-06T11:06:35.566555+0000","last_undegraded":"2023-10-06T11:06:35.566555+0000","last_fullsized":"2023-10-06T11:06:35.566555+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:48:38.446657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.554511+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:59:13.791303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.570171+0000","last_change":"2023-10-06T11:06:35.563788+0000","last_active":"2023-10-06T11:06:35.570171+0000","last_peered":"2023-10-06T11:06:35.570171+0000","last_clean":"2023-10-06T11:06:35.570171+0000","last_became_active":"2023-10-06T11:06:35.563536+0000","last_became_peered":"2023-10-06T11:06:35.563536+0000","last_unstale":"2023-10-06T11:06:35.570171+0000","last_undegraded":"2023-10-06T11:06:35.570171+0000","last_fullsized":"2023-10-06T11:06:35.570171+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:37:26.790499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.562604+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:35:12.331105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.569968+0000","last_change":"2023-10-06T11:06:35.568542+0000","last_active":"2023-10-06T11:06:35.569968+0000","last_peered":"2023-10-06T11:06:35.569968+0000","last_clean":"2023-10-06T11:06:35.569968+0000","last_became_active":"2023-10-06T11:06:35.568247+0000","last_became_peered":"2023-10-06T11:06:35.568247+0000","last_unstale":"2023-10-06T11:06:35.569968+0000","last_undegraded":"2023-10-06T11:06:35.569968+0000","last_fullsized":"2023-10-06T11:06:35.569968+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:47:34.457893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.555063+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:24:26.471584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.573522+0000","last_change":"2023-10-06T11:06:35.573522+0000","last_active":"2023-10-06T11:06:35.573522+0000","last_peered":"2023-10-06T11:06:35.573522+0000","last_clean":"2023-10-06T11:06:35.573522+0000","last_became_active":"2023-10-06T11:06:35.573233+0000","last_became_peered":"2023-10-06T11:06:35.573233+0000","last_unstale":"2023-10-06T11:06:35.573522+0000","last_undegraded":"2023-10-06T11:06:35.573522+0000","last_fullsized":"2023-10-06T11:06:35.573522+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:37:26.790499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.554705+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:27.615158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.562619+0000","last_change":"2023-10-06T11:06:35.562619+0000","last_active":"2023-10-06T11:06:35.562619+0000","last_peered":"2023-10-06T11:06:35.562619+0000","last_clean":"2023-10-06T11:06:35.562619+0000","last_became_active":"2023-10-06T11:06:35.562355+0000","last_became_peered":"2023-10-06T11:06:35.562355+0000","last_unstale":"2023-10-06T11:06:35.562619+0000","last_undegraded":"2023-10-06T11:06:35.562619+0000","last_fullsized":"2023-10-06T11:06:35.562619+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:02:05.183430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.560355+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:24:26.471584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"30'2","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.580615+0000","last_change":"2023-10-06T11:06:35.566348+0000","last_active":"2023-10-06T11:06:36.580615+0000","last_peered":"2023-10-06T11:06:36.580615+0000","last_clean":"2023-10-06T11:06:36.580615+0000","last_became_active":"2023-10-06T11:06:35.565126+0000","last_became_peered":"2023-10-06T11:06:35.565126+0000","last_unstale":"2023-10-06T11:06:36.580615+0000","last_undegraded":"2023-10-06T11:06:36.580615+0000","last_fullsized":"2023-10-06T11:06:36.580615+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:59:12.784065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.564115+0000","last_change":"2023-10-06T11:06:36.564115+0000","last_active":"2023-10-06T11:06:36.564115+0000","last_peered":"2023-10-06T11:06:36.564115+0000","last_clean":"2023-10-06T11:06:36.564115+0000","last_became_active":"2023-10-06T11:06:36.563844+0000","last_became_peered":"2023-10-06T11:06:36.563844+0000","last_unstale":"2023-10-06T11:06:36.564115+0000","last_undegraded":"2023-10-06T11:06:36.564115+0000","last_fullsized":"2023-10-06T11:06:36.564115+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:02.194639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.570646+0000","last_change":"2023-10-06T11:06:35.570646+0000","last_active":"2023-10-06T11:06:35.570646+0000","last_peered":"2023-10-06T11:06:35.570646+0000","last_clean":"2023-10-06T11:06:35.570646+0000","last_became_active":"2023-10-06T11:06:35.570386+0000","last_became_peered":"2023-10-06T11:06:35.570386+0000","last_unstale":"2023-10-06T11:06:35.570646+0000","last_undegraded":"2023-10-06T11:06:35.570646+0000","last_fullsized":"2023-10-06T11:06:35.570646+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:10.251950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.555475+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:24:58.702337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.571568+0000","last_change":"2023-10-06T11:06:35.568732+0000","last_active":"2023-10-06T11:06:35.571568+0000","last_peered":"2023-10-06T11:06:35.571568+0000","last_clean":"2023-10-06T11:06:35.571568+0000","last_became_active":"2023-10-06T11:06:35.568460+0000","last_became_peered":"2023-10-06T11:06:35.568460+0000","last_unstale":"2023-10-06T11:06:35.571568+0000","last_undegraded":"2023-10-06T11:06:35.571568+0000","last_fullsized":"2023-10-06T11:06:35.571568+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:25.431156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.562560+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:50:39.669447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.565612+0000","last_change":"2023-10-06T11:06:35.565612+0000","last_active":"2023-10-06T11:06:35.565612+0000","last_peered":"2023-10-06T11:06:35.565612+0000","last_clean":"2023-10-06T11:06:35.565612+0000","last_became_active":"2023-10-06T11:06:35.565373+0000","last_became_peered":"2023-10-06T11:06:35.565373+0000","last_unstale":"2023-10-06T11:06:35.565612+0000","last_undegraded":"2023-10-06T11:06:35.565612+0000","last_fullsized":"2023-10-06T11:06:35.565612+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:22.790704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.558753+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:46:45.723235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.563587+0000","last_change":"2023-10-06T11:06:35.563587+0000","last_active":"2023-10-06T11:06:35.563587+0000","last_peered":"2023-10-06T11:06:35.563587+0000","last_clean":"2023-10-06T11:06:35.563587+0000","last_became_active":"2023-10-06T11:06:35.562933+0000","last_became_peered":"2023-10-06T11:06:35.562933+0000","last_unstale":"2023-10-06T11:06:35.563587+0000","last_undegraded":"2023-10-06T11:06:35.563587+0000","last_fullsized":"2023-10-06T11:06:35.563587+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:27:16.186215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.555165+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:18:51.654155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.573385+0000","last_change":"2023-10-06T11:06:35.573385+0000","last_active":"2023-10-06T11:06:35.573385+0000","last_peered":"2023-10-06T11:06:35.573385+0000","last_clean":"2023-10-06T11:06:35.573385+0000","last_became_active":"2023-10-06T11:06:35.573110+0000","last_became_peered":"2023-10-06T11:06:35.573110+0000","last_unstale":"2023-10-06T11:06:35.573385+0000","last_undegraded":"2023-10-06T11:06:35.573385+0000","last_fullsized":"2023-10-06T11:06:35.573385+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:54:46.474958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.554379+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:54.497548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.565314+0000","last_change":"2023-10-06T11:06:35.565314+0000","last_active":"2023-10-06T11:06:35.565314+0000","last_peered":"2023-10-06T11:06:35.565314+0000","last_clean":"2023-10-06T11:06:35.565314+0000","last_became_active":"2023-10-06T11:06:35.565003+0000","last_became_peered":"2023-10-06T11:06:35.565003+0000","last_unstale":"2023-10-06T11:06:35.565314+0000","last_undegraded":"2023-10-06T11:06:35.565314+0000","last_fullsized":"2023-10-06T11:06:35.565314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:06:59.444199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.578091+0000","last_change":"2023-10-06T11:06:36.578091+0000","last_active":"2023-10-06T11:06:36.578091+0000","last_peered":"2023-10-06T11:06:36.578091+0000","last_clean":"2023-10-06T11:06:36.578091+0000","last_became_active":"2023-10-06T11:06:36.577829+0000","last_became_peered":"2023-10-06T11:06:36.577829+0000","last_unstale":"2023-10-06T11:06:36.578091+0000","last_undegraded":"2023-10-06T11:06:36.578091+0000","last_fullsized":"2023-10-06T11:06:36.578091+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:32:31.550090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.569823+0000","last_change":"2023-10-06T11:06:35.568012+0000","last_active":"2023-10-06T11:06:35.569823+0000","last_peered":"2023-10-06T11:06:35.569823+0000","last_clean":"2023-10-06T11:06:35.569823+0000","last_became_active":"2023-10-06T11:06:35.567630+0000","last_became_peered":"2023-10-06T11:06:35.567630+0000","last_unstale":"2023-10-06T11:06:35.569823+0000","last_undegraded":"2023-10-06T11:06:35.569823+0000","last_fullsized":"2023-10-06T11:06:35.569823+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:24:25.464345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.557148+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:06:35.557148+0000","last_peered":"2023-10-06T11:06:35.557148+0000","last_clean":"2023-10-06T11:06:35.557148+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:06:35.557148+0000","last_undegraded":"2023-10-06T11:06:35.557148+0000","last_fullsized":"2023-10-06T11:06:35.557148+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.564430+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:54.497548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.565611+0000","last_change":"2023-10-06T11:06:35.565611+0000","last_active":"2023-10-06T11:06:35.565611+0000","last_peered":"2023-10-06T11:06:35.565611+0000","last_clean":"2023-10-06T11:06:35.565611+0000","last_became_active":"2023-10-06T11:06:35.565425+0000","last_became_peered":"2023-10-06T11:06:35.565425+0000","last_unstale":"2023-10-06T11:06:35.565611+0000","last_undegraded":"2023-10-06T11:06:35.565611+0000","last_fullsized":"2023-10-06T11:06:35.565611+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:04:05.569279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T11:06:34.554099+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:06:34.554099+0000","last_peered":"2023-10-06T11:06:34.554099+0000","last_clean":"2023-10-06T11:06:34.554099+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:06:34.554099+0000","last_undegraded":"2023-10-06T11:06:34.554099+0000","last_fullsized":"2023-10-06T11:06:34.554099+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.568057+0000","last_change":"2023-10-06T11:06:36.568057+0000","last_active":"2023-10-06T11:06:36.568057+0000","last_peered":"2023-10-06T11:06:36.568057+0000","last_clean":"2023-10-06T11:06:36.568057+0000","last_became_active":"2023-10-06T11:06:36.567776+0000","last_became_peered":"2023-10-06T11:06:36.567776+0000","last_unstale":"2023-10-06T11:06:36.568057+0000","last_undegraded":"2023-10-06T11:06:36.568057+0000","last_fullsized":"2023-10-06T11:06:36.568057+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:54.497548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.571084+0000","last_change":"2023-10-06T11:06:35.571084+0000","last_active":"2023-10-06T11:06:35.571084+0000","last_peered":"2023-10-06T11:06:35.571084+0000","last_clean":"2023-10-06T11:06:35.571084+0000","last_became_active":"2023-10-06T11:06:35.570790+0000","last_became_peered":"2023-10-06T11:06:35.570790+0000","last_unstale":"2023-10-06T11:06:35.571084+0000","last_undegraded":"2023-10-06T11:06:35.571084+0000","last_fullsized":"2023-10-06T11:06:35.571084+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:25.431156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.563251+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:06:35.563251+0000","last_peered":"2023-10-06T11:06:35.563251+0000","last_clean":"2023-10-06T11:06:35.563251+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:06:35.563251+0000","last_undegraded":"2023-10-06T11:06:35.563251+0000","last_fullsized":"2023-10-06T11:06:35.563251+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":169,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T11:06:34.552651+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:06:34.552651+0000","last_peered":"2023-10-06T11:06:34.552651+0000","last_clean":"2023-10-06T11:06:34.552651+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:06:34.552651+0000","last_undegraded":"2023-10-06T11:06:34.552651+0000","last_fullsized":"2023-10-06T11:06:34.552651+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.566037+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:27.615158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.562232+0000","last_change":"2023-10-06T11:06:35.562232+0000","last_active":"2023-10-06T11:06:35.562232+0000","last_peered":"2023-10-06T11:06:35.562232+0000","last_clean":"2023-10-06T11:06:35.562232+0000","last_became_active":"2023-10-06T11:06:35.561976+0000","last_became_peered":"2023-10-06T11:06:35.561976+0000","last_unstale":"2023-10-06T11:06:35.562232+0000","last_undegraded":"2023-10-06T11:06:35.562232+0000","last_fullsized":"2023-10-06T11:06:35.562232+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:50:26.045766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T11:06:34.552999+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:06:34.552999+0000","last_peered":"2023-10-06T11:06:34.552999+0000","last_clean":"2023-10-06T11:06:34.552999+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:06:34.552999+0000","last_undegraded":"2023-10-06T11:06:34.552999+0000","last_fullsized":"2023-10-06T11:06:34.552999+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.556811+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:54.497548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.575854+0000","last_change":"2023-10-06T11:06:35.575854+0000","last_active":"2023-10-06T11:06:35.575854+0000","last_peered":"2023-10-06T11:06:35.575854+0000","last_clean":"2023-10-06T11:06:35.575854+0000","last_became_active":"2023-10-06T11:06:35.575563+0000","last_became_peered":"2023-10-06T11:06:35.575563+0000","last_unstale":"2023-10-06T11:06:35.575854+0000","last_undegraded":"2023-10-06T11:06:35.575854+0000","last_fullsized":"2023-10-06T11:06:35.575854+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:18:50.646916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T11:06:34.552645+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:06:34.552645+0000","last_peered":"2023-10-06T11:06:34.552645+0000","last_clean":"2023-10-06T11:06:34.552645+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:06:34.552645+0000","last_undegraded":"2023-10-06T11:06:34.552645+0000","last_fullsized":"2023-10-06T11:06:34.552645+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.554674+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:42:19.402886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.571025+0000","last_change":"2023-10-06T11:06:35.571025+0000","last_active":"2023-10-06T11:06:35.571025+0000","last_peered":"2023-10-06T11:06:35.571025+0000","last_clean":"2023-10-06T11:06:35.571025+0000","last_became_active":"2023-10-06T11:06:35.570772+0000","last_became_peered":"2023-10-06T11:06:35.570772+0000","last_unstale":"2023-10-06T11:06:35.571025+0000","last_undegraded":"2023-10-06T11:06:35.571025+0000","last_fullsized":"2023-10-06T11:06:35.571025+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:54:46.474958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-06T11:06:34.549969+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:06:34.549969+0000","last_peered":"2023-10-06T11:06:34.549969+0000","last_clean":"2023-10-06T11:06:34.549969+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:06:34.549969+0000","last_undegraded":"2023-10-06T11:06:34.549969+0000","last_fullsized":"2023-10-06T11:06:34.549969+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":8,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.569370+0000","last_change":"2023-10-06T11:06:36.569370+0000","last_active":"2023-10-06T11:06:36.569370+0000","last_peered":"2023-10-06T11:06:36.569370+0000","last_clean":"2023-10-06T11:06:36.569370+0000","last_became_active":"2023-10-06T11:06:36.569170+0000","last_became_peered":"2023-10-06T11:06:36.569170+0000","last_unstale":"2023-10-06T11:06:36.569370+0000","last_undegraded":"2023-10-06T11:06:36.569370+0000","last_fullsized":"2023-10-06T11:06:36.569370+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:24:26.471584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.567471+0000","last_change":"2023-10-06T11:06:35.565421+0000","last_active":"2023-10-06T11:06:35.567471+0000","last_peered":"2023-10-06T11:06:35.567471+0000","last_clean":"2023-10-06T11:06:35.567471+0000","last_became_active":"2023-10-06T11:06:35.565160+0000","last_became_peered":"2023-10-06T11:06:35.565160+0000","last_unstale":"2023-10-06T11:06:35.567471+0000","last_undegraded":"2023-10-06T11:06:35.567471+0000","last_fullsized":"2023-10-06T11:06:35.567471+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:21:20.221637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.563206+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:06:35.563206+0000","last_peered":"2023-10-06T11:06:35.563206+0000","last_clean":"2023-10-06T11:06:35.563206+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:06:35.563206+0000","last_undegraded":"2023-10-06T11:06:35.563206+0000","last_fullsized":"2023-10-06T11:06:35.563206+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:06:35.546099+0000","last_change":"2023-10-06T11:06:35.559729+0000","last_active":"2023-10-06T11:06:35.546099+0000","last_peered":"2023-10-06T11:06:35.546099+0000","last_clean":"2023-10-06T11:06:35.546099+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:06:35.546099+0000","last_undegraded":"2023-10-06T11:06:35.546099+0000","last_fullsized":"2023-10-06T11:06:35.546099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:42:19.402886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":8,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.567604+0000","last_change":"2023-10-06T11:06:35.567604+0000","last_active":"2023-10-06T11:06:35.567604+0000","last_peered":"2023-10-06T11:06:35.567604+0000","last_clean":"2023-10-06T11:06:35.567604+0000","last_became_active":"2023-10-06T11:06:35.567290+0000","last_became_peered":"2023-10-06T11:06:35.567290+0000","last_unstale":"2023-10-06T11:06:35.567604+0000","last_undegraded":"2023-10-06T11:06:35.567604+0000","last_fullsized":"2023-10-06T11:06:35.567604+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:18:50.646916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-10-06T11:06:35.563054+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:06:35.563054+0000","last_peered":"2023-10-06T11:06:35.563054+0000","last_clean":"2023-10-06T11:06:35.563054+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:06:35.563054+0000","last_undegraded":"2023-10-06T11:06:35.563054+0000","last_fullsized":"2023-10-06T11:06:35.563054+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":554,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298172,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073668,"statfs":{"total":96636764160,"available":96331436032,"internally_reserved":0,"allocated":905216,"data_stored":711130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297600,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074240,"statfs":{"total":96636764160,"available":96332021760,"internally_reserved":0,"allocated":319488,"data_stored":126025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298200,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073640,"statfs":{"total":96636764160,"available":96331407360,"internally_reserved":0,"allocated":933888,"data_stored":724952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297600,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074240,"statfs":{"total":96636764160,"available":96332021760,"internally_reserved":0,"allocated":319488,"data_stored":126025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297600,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074240,"statfs":{"total":96636764160,"available":96332021760,"internally_reserved":0,"allocated":319488,"data_stored":126025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297600,"kb_used_data":312,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074240,"statfs":{"total":96636764160,"available":96332021760,"internally_reserved":0,"allocated":319488,"data_stored":126025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297624,"kb_used_data":336,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074216,"statfs":{"total":96636764160,"available":96331997184,"internally_reserved":0,"allocated":344064,"data_stored":135070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":311296,"data_stored":120762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:06:45.125 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:06:45.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.249+0000 7f49ed21d700 1 Processor -- start 2023-10-06T11:06:45.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.249+0000 7f49ed21d700 1 -- start start 2023-10-06T11:06:45.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.250+0000 7f49ed21d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f49e8068ba0 0x7f49e815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:45.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.250+0000 7f49ed21d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f49e8153e80 0x7f49e80b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:45.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.250+0000 7f49ed21d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e815ac30 con 0x7f49e8153ab0 2023-10-06T11:06:45.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.250+0000 7f49ed21d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e80b4510 con 0x7f49e8153e80 2023-10-06T11:06:45.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.250+0000 7f49ed21d700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e80b6530 con 0x7f49e8068ba0 2023-10-06T11:06:45.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.250+0000 7f49e6d9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f49e8153ab0 0x7f49e8068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38676/0 (socket says 172.21.15.146:38676) 2023-10-06T11:06:45.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.250+0000 7f49e6d9d700 1 -- 172.21.15.146:0/2918221164 learned_addr learned my addr 172.21.15.146:0/2918221164 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:45.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.250+0000 7f49e759e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f49e8153e80 0x7f49e80b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:45.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.250+0000 7f49e659c700 1 -- 172.21.15.146:0/2918221164 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2345207388 0 0) 0x7f49d8001110 con 0x7f49e8153ab0 2023-10-06T11:06:45.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.250+0000 7f49e659c700 1 -- 172.21.15.146:0/2918221164 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49d4003570 con 0x7f49e8153ab0 2023-10-06T11:06:45.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.250+0000 7f49dffff700 1 --2- 172.21.15.146:0/2918221164 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f49e8068ba0 0x7f49e815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:45.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.250+0000 7f49e759e700 1 -- 172.21.15.146:0/2918221164 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f49e8068ba0 msgr2=0x7f49e815a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:45.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.250+0000 7f49e759e700 1 --2- 172.21.15.146:0/2918221164 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f49e8068ba0 0x7f49e815a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:45.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.250+0000 7f49e759e700 1 -- 172.21.15.146:0/2918221164 >> v1:172.21.15.146:6789/0 conn(0x7f49e8153ab0 legacy=0x7f49e8068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:45.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.250+0000 7f49e759e700 1 -- 172.21.15.146:0/2918221164 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e80b5c50 con 0x7f49e8153e80 2023-10-06T11:06:45.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.250+0000 7f49dffff700 1 --2- 172.21.15.146:0/2918221164 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f49e8068ba0 0x7f49e815a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:06:45.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.250+0000 7f49e759e700 1 --2- 172.21.15.146:0/2918221164 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49e8153e80 0x7f49e80b49a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f49e0009e60 tx=0x7f49e0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62412983bf15f78a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:45.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.250+0000 7f49e659c700 1 -- 172.21.15.146:0/2918221164 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e000e070 con 0x7f49e8153e80 2023-10-06T11:06:45.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.251+0000 7f49e659c700 1 -- 172.21.15.146:0/2918221164 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e000bb60 con 0x7f49e8153e80 2023-10-06T11:06:45.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.251+0000 7f49e659c700 1 -- 172.21.15.146:0/2918221164 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e0012430 con 0x7f49e8153e80 2023-10-06T11:06:45.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.251+0000 7f49ed21d700 1 -- 172.21.15.146:0/2918221164 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49e8153e80 msgr2=0x7f49e80b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:45.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.251+0000 7f49ed21d700 1 --2- 172.21.15.146:0/2918221164 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49e8153e80 0x7f49e80b49a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f49e0009e60 tx=0x7f49e0009780 comp rx=0 tx=0).stop 2023-10-06T11:06:45.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.251+0000 7f49ed21d700 1 -- 172.21.15.146:0/2918221164 shutdown_connections 2023-10-06T11:06:45.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.251+0000 7f49ed21d700 1 --2- 172.21.15.146:0/2918221164 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49e8153e80 0x7f49e80b49a0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:45.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.251+0000 7f49ed21d700 1 --2- 172.21.15.146:0/2918221164 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f49e8068ba0 0x7f49e815a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:45.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.251+0000 7f49ed21d700 1 -- 172.21.15.146:0/2918221164 >> 172.21.15.146:0/2918221164 conn(0x7f49e806eba0 msgr2=0x7f49e806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:45.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.251+0000 7f49ed21d700 1 -- 172.21.15.146:0/2918221164 shutdown_connections 2023-10-06T11:06:45.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.251+0000 7f49ed21d700 1 -- 172.21.15.146:0/2918221164 wait complete. 2023-10-06T11:06:45.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.252+0000 7f49ed21d700 1 Processor -- start 2023-10-06T11:06:45.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.252+0000 7f49ed21d700 1 -- start start 2023-10-06T11:06:45.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.253+0000 7f49ed21d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49e8068ba0 0x7f49e80b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:45.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.253+0000 7f49ed21d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49e8153ab0 0x7f49e80ce950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:45.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.253+0000 7f49ed21d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f49e8153e80 0x7f49e80cee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:45.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.253+0000 7f49ed21d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e8148d60 con 0x7f49e8153ab0 2023-10-06T11:06:45.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.253+0000 7f49ed21d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e814d930 con 0x7f49e8068ba0 2023-10-06T11:06:45.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.253+0000 7f49ed21d700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e814f310 con 0x7f49e8153e80 2023-10-06T11:06:45.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.253+0000 7f49dffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49e8153ab0 0x7f49e80ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:45.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.253+0000 7f49dffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49e8153ab0 0x7f49e80ce950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39896/0 (socket says 172.21.15.146:39896) 2023-10-06T11:06:45.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.253+0000 7f49dffff700 1 -- 172.21.15.146:0/3374443375 learned_addr learned my addr 172.21.15.146:0/3374443375 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:45.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.253+0000 7f49e6d9d700 1 --2- 172.21.15.146:0/3374443375 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49e8068ba0 0x7f49e80b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:45.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.253+0000 7f49dffff700 1 -- 172.21.15.146:0/3374443375 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f49e8153e80 msgr2=0x7f49e80cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:45.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.253+0000 7f49e759e700 1 --2- 172.21.15.146:0/3374443375 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f49e8153e80 0x7f49e80cee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:45.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.253+0000 7f49dffff700 1 --2- 172.21.15.146:0/3374443375 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f49e8153e80 0x7f49e80cee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:45.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.253+0000 7f49dffff700 1 -- 172.21.15.146:0/3374443375 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49e8068ba0 msgr2=0x7f49e80b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:45.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.253+0000 7f49dffff700 1 --2- 172.21.15.146:0/3374443375 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49e8068ba0 0x7f49e80b1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:45.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.254+0000 7f49dffff700 1 -- 172.21.15.146:0/3374443375 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e0009a20 con 0x7f49e8153ab0 2023-10-06T11:06:45.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.254+0000 7f49e6d9d700 1 --2- 172.21.15.146:0/3374443375 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49e8068ba0 0x7f49e80b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:06:45.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.254+0000 7f49dffff700 1 --2- 172.21.15.146:0/3374443375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49e8153ab0 0x7f49e80ce950 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f49d000c850 tx=0x7f49d0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:45.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.254+0000 7f49deffd700 1 -- 172.21.15.146:0/3374443375 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d0011600 con 0x7f49e8153ab0 2023-10-06T11:06:45.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.254+0000 7f49deffd700 1 -- 172.21.15.146:0/3374443375 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d0011760 con 0x7f49e8153ab0 2023-10-06T11:06:45.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.254+0000 7f49ed21d700 1 -- 172.21.15.146:0/3374443375 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e814f5f0 con 0x7f49e8153ab0 2023-10-06T11:06:45.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.254+0000 7f49deffd700 1 -- 172.21.15.146:0/3374443375 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d0011b00 con 0x7f49e8153ab0 2023-10-06T11:06:45.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.254+0000 7f49ed21d700 1 -- 172.21.15.146:0/3374443375 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e814fdf0 con 0x7f49e8153ab0 2023-10-06T11:06:45.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.255+0000 7f49ed21d700 1 -- 172.21.15.146:0/3374443375 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49e804c380 con 0x7f49e8153ab0 2023-10-06T11:06:45.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.255+0000 7f49deffd700 1 -- 172.21.15.146:0/3374443375 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f49d00073b0 con 0x7f49e8153ab0 2023-10-06T11:06:45.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.256+0000 7f49deffd700 1 --2- 172.21.15.146:0/3374443375 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f49c8066f30 0x7f49c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:45.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.256+0000 7f49deffd700 1 -- 172.21.15.146:0/3374443375 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f49d0084690 con 0x7f49e8153ab0 2023-10-06T11:06:45.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.256+0000 7f49e6d9d700 1 --2- 172.21.15.146:0/3374443375 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f49c8066f30 0x7f49c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:45.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.256+0000 7f49e6d9d700 1 --2- 172.21.15.146:0/3374443375 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f49c8066f30 0x7f49c80693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f49d8001270 tx=0x7f49d8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:45.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.260+0000 7f49deffd700 1 -- 172.21.15.146:0/3374443375 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f49d0055230 con 0x7f49e8153ab0 2023-10-06T11:06:45.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.437+0000 7f49ed21d700 1 -- 172.21.15.146:0/3374443375 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f49e80b6250 con 0x7f49c8066f30 2023-10-06T11:06:45.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.446+0000 7f49deffd700 1 -- 172.21.15.146:0/3374443375 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+312011 (secure 0 0 0) 0x7f49e80b6250 con 0x7f49c8066f30 2023-10-06T11:06:45.451 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:06:45.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.449+0000 7f49ed21d700 1 -- 172.21.15.146:0/3374443375 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f49c8066f30 msgr2=0x7f49c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:45.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.449+0000 7f49ed21d700 1 --2- 172.21.15.146:0/3374443375 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f49c8066f30 0x7f49c80693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f49d8001270 tx=0x7f49d8009040 comp rx=0 tx=0).stop 2023-10-06T11:06:45.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.449+0000 7f49ed21d700 1 -- 172.21.15.146:0/3374443375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49e8153ab0 msgr2=0x7f49e80ce950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:45.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.449+0000 7f49ed21d700 1 --2- 172.21.15.146:0/3374443375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49e8153ab0 0x7f49e80ce950 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f49d000c850 tx=0x7f49d0008040 comp rx=0 tx=0).stop 2023-10-06T11:06:45.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.449+0000 7f49ed21d700 1 -- 172.21.15.146:0/3374443375 shutdown_connections 2023-10-06T11:06:45.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.449+0000 7f49ed21d700 1 --2- 172.21.15.146:0/3374443375 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f49c8066f30 0x7f49c80693e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:45.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.449+0000 7f49ed21d700 1 --2- 172.21.15.146:0/3374443375 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f49e8153e80 0x7f49e80cee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:45.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.449+0000 7f49ed21d700 1 --2- 172.21.15.146:0/3374443375 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49e8068ba0 0x7f49e80b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:45.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.449+0000 7f49ed21d700 1 --2- 172.21.15.146:0/3374443375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f49e8153ab0 0x7f49e80ce950 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:45.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.449+0000 7f49ed21d700 1 -- 172.21.15.146:0/3374443375 >> 172.21.15.146:0/3374443375 conn(0x7f49e806eba0 msgr2=0x7f49e80cfa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:45.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.449+0000 7f49ed21d700 1 -- 172.21.15.146:0/3374443375 shutdown_connections 2023-10-06T11:06:45.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.449+0000 7f49ed21d700 1 -- 172.21.15.146:0/3374443375 wait complete. 2023-10-06T11:06:45.456 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:06:45.463 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2023-10-06T11:06:45.153921+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382232,"kb_used_data":3928,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592488,"statfs":{"total":773094113280,"available":770654707712,"internally_reserved":0,"allocated":4022272,"data_stored":2309016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.598875"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.581114+0000","last_change":"2023-10-06T11:06:36.577112+0000","last_active":"2023-10-06T11:06:36.581114+0000","last_peered":"2023-10-06T11:06:36.581114+0000","last_clean":"2023-10-06T11:06:36.581114+0000","last_became_active":"2023-10-06T11:06:36.576729+0000","last_became_peered":"2023-10-06T11:06:36.576729+0000","last_unstale":"2023-10-06T11:06:36.581114+0000","last_undegraded":"2023-10-06T11:06:36.581114+0000","last_fullsized":"2023-10-06T11:06:36.581114+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:27:30.195353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.578451+0000","last_change":"2023-10-06T11:06:36.571388+0000","last_active":"2023-10-06T11:06:36.578451+0000","last_peered":"2023-10-06T11:06:36.578451+0000","last_clean":"2023-10-06T11:06:36.578451+0000","last_became_active":"2023-10-06T11:06:36.571124+0000","last_became_peered":"2023-10-06T11:06:36.571124+0000","last_unstale":"2023-10-06T11:06:36.578451+0000","last_undegraded":"2023-10-06T11:06:36.578451+0000","last_fullsized":"2023-10-06T11:06:36.578451+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:36:53.469044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.571954+0000","last_change":"2023-10-06T11:06:36.569465+0000","last_active":"2023-10-06T11:06:36.571954+0000","last_peered":"2023-10-06T11:06:36.571954+0000","last_clean":"2023-10-06T11:06:36.571954+0000","last_became_active":"2023-10-06T11:06:36.569241+0000","last_became_peered":"2023-10-06T11:06:36.569241+0000","last_unstale":"2023-10-06T11:06:36.571954+0000","last_undegraded":"2023-10-06T11:06:36.571954+0000","last_fullsized":"2023-10-06T11:06:36.571954+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:36:53.469044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.566476+0000","last_change":"2023-10-06T11:06:36.564851+0000","last_active":"2023-10-06T11:06:36.566476+0000","last_peered":"2023-10-06T11:06:36.566476+0000","last_clean":"2023-10-06T11:06:36.566476+0000","last_became_active":"2023-10-06T11:06:36.564220+0000","last_became_peered":"2023-10-06T11:06:36.564220+0000","last_unstale":"2023-10-06T11:06:36.566476+0000","last_undegraded":"2023-10-06T11:06:36.566476+0000","last_fullsized":"2023-10-06T11:06:36.566476+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:26.438394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.575315+0000","last_change":"2023-10-06T11:06:36.573967+0000","last_active":"2023-10-06T11:06:36.575315+0000","last_peered":"2023-10-06T11:06:36.575315+0000","last_clean":"2023-10-06T11:06:36.575315+0000","last_became_active":"2023-10-06T11:06:36.573702+0000","last_became_peered":"2023-10-06T11:06:36.573702+0000","last_unstale":"2023-10-06T11:06:36.575315+0000","last_undegraded":"2023-10-06T11:06:36.575315+0000","last_fullsized":"2023-10-06T11:06:36.575315+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:55.557911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.579791+0000","last_change":"2023-10-06T11:06:36.577548+0000","last_active":"2023-10-06T11:06:36.579791+0000","last_peered":"2023-10-06T11:06:36.579791+0000","last_clean":"2023-10-06T11:06:36.579791+0000","last_became_active":"2023-10-06T11:06:36.577311+0000","last_became_peered":"2023-10-06T11:06:36.577311+0000","last_unstale":"2023-10-06T11:06:36.579791+0000","last_undegraded":"2023-10-06T11:06:36.579791+0000","last_fullsized":"2023-10-06T11:06:36.579791+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:42:19.402886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.580366+0000","last_change":"2023-10-06T11:06:36.576014+0000","last_active":"2023-10-06T11:06:36.580366+0000","last_peered":"2023-10-06T11:06:36.580366+0000","last_clean":"2023-10-06T11:06:36.580366+0000","last_became_active":"2023-10-06T11:06:36.575723+0000","last_became_peered":"2023-10-06T11:06:36.575723+0000","last_unstale":"2023-10-06T11:06:36.580366+0000","last_undegraded":"2023-10-06T11:06:36.580366+0000","last_fullsized":"2023-10-06T11:06:36.580366+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:12:02.043126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.586357+0000","last_change":"2023-10-06T11:06:36.580972+0000","last_active":"2023-10-06T11:06:36.586357+0000","last_peered":"2023-10-06T11:06:36.586357+0000","last_clean":"2023-10-06T11:06:36.586357+0000","last_became_active":"2023-10-06T11:06:36.580703+0000","last_became_peered":"2023-10-06T11:06:36.580703+0000","last_unstale":"2023-10-06T11:06:36.586357+0000","last_undegraded":"2023-10-06T11:06:36.586357+0000","last_fullsized":"2023-10-06T11:06:36.586357+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:33.482789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.570324+0000","last_change":"2023-10-06T11:06:36.568395+0000","last_active":"2023-10-06T11:06:36.570324+0000","last_peered":"2023-10-06T11:06:36.570324+0000","last_clean":"2023-10-06T11:06:36.570324+0000","last_became_active":"2023-10-06T11:06:36.568143+0000","last_became_peered":"2023-10-06T11:06:36.568143+0000","last_unstale":"2023-10-06T11:06:36.570324+0000","last_undegraded":"2023-10-06T11:06:36.570324+0000","last_fullsized":"2023-10-06T11:06:36.570324+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:25.340891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.579934+0000","last_change":"2023-10-06T11:06:36.568582+0000","last_active":"2023-10-06T11:06:36.579934+0000","last_peered":"2023-10-06T11:06:36.579934+0000","last_clean":"2023-10-06T11:06:36.579934+0000","last_became_active":"2023-10-06T11:06:36.568315+0000","last_became_peered":"2023-10-06T11:06:36.568315+0000","last_unstale":"2023-10-06T11:06:36.579934+0000","last_undegraded":"2023-10-06T11:06:36.579934+0000","last_fullsized":"2023-10-06T11:06:36.579934+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:27:30.195353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.580248+0000","last_change":"2023-10-06T11:06:36.569013+0000","last_active":"2023-10-06T11:06:36.580248+0000","last_peered":"2023-10-06T11:06:36.580248+0000","last_clean":"2023-10-06T11:06:36.580248+0000","last_became_active":"2023-10-06T11:06:36.565168+0000","last_became_peered":"2023-10-06T11:06:36.565168+0000","last_unstale":"2023-10-06T11:06:36.580248+0000","last_undegraded":"2023-10-06T11:06:36.580248+0000","last_fullsized":"2023-10-06T11:06:36.580248+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:10:47.800013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.566189+0000","last_change":"2023-10-06T11:06:36.562613+0000","last_active":"2023-10-06T11:06:36.566189+0000","last_peered":"2023-10-06T11:06:36.566189+0000","last_clean":"2023-10-06T11:06:36.566189+0000","last_became_active":"2023-10-06T11:06:36.561642+0000","last_became_peered":"2023-10-06T11:06:36.561642+0000","last_unstale":"2023-10-06T11:06:36.566189+0000","last_undegraded":"2023-10-06T11:06:36.566189+0000","last_fullsized":"2023-10-06T11:06:36.566189+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:03:01.050221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.579892+0000","last_change":"2023-10-06T11:06:36.569638+0000","last_active":"2023-10-06T11:06:36.579892+0000","last_peered":"2023-10-06T11:06:36.579892+0000","last_clean":"2023-10-06T11:06:36.579892+0000","last_became_active":"2023-10-06T11:06:36.569330+0000","last_became_peered":"2023-10-06T11:06:36.569330+0000","last_unstale":"2023-10-06T11:06:36.579892+0000","last_undegraded":"2023-10-06T11:06:36.579892+0000","last_fullsized":"2023-10-06T11:06:36.579892+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:44:02.830216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.570807+0000","last_change":"2023-10-06T11:06:36.566565+0000","last_active":"2023-10-06T11:06:36.570807+0000","last_peered":"2023-10-06T11:06:36.570807+0000","last_clean":"2023-10-06T11:06:36.570807+0000","last_became_active":"2023-10-06T11:06:36.566292+0000","last_became_peered":"2023-10-06T11:06:36.566292+0000","last_unstale":"2023-10-06T11:06:36.570807+0000","last_undegraded":"2023-10-06T11:06:36.570807+0000","last_fullsized":"2023-10-06T11:06:36.570807+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:40:32.681590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.566687+0000","last_change":"2023-10-06T11:06:36.561645+0000","last_active":"2023-10-06T11:06:36.566687+0000","last_peered":"2023-10-06T11:06:36.566687+0000","last_clean":"2023-10-06T11:06:36.566687+0000","last_became_active":"2023-10-06T11:06:36.561369+0000","last_became_peered":"2023-10-06T11:06:36.561369+0000","last_unstale":"2023-10-06T11:06:36.566687+0000","last_undegraded":"2023-10-06T11:06:36.566687+0000","last_fullsized":"2023-10-06T11:06:36.566687+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:42:19.402886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.586194+0000","last_change":"2023-10-06T11:06:36.582633+0000","last_active":"2023-10-06T11:06:36.586194+0000","last_peered":"2023-10-06T11:06:36.586194+0000","last_clean":"2023-10-06T11:06:36.586194+0000","last_became_active":"2023-10-06T11:06:36.581890+0000","last_became_peered":"2023-10-06T11:06:36.581890+0000","last_unstale":"2023-10-06T11:06:36.586194+0000","last_undegraded":"2023-10-06T11:06:36.586194+0000","last_fullsized":"2023-10-06T11:06:36.586194+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:53.494581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.585222+0000","last_change":"2023-10-06T11:06:36.582207+0000","last_active":"2023-10-06T11:06:36.585222+0000","last_peered":"2023-10-06T11:06:36.585222+0000","last_clean":"2023-10-06T11:06:36.585222+0000","last_became_active":"2023-10-06T11:06:36.581935+0000","last_became_peered":"2023-10-06T11:06:36.581935+0000","last_unstale":"2023-10-06T11:06:36.585222+0000","last_undegraded":"2023-10-06T11:06:36.585222+0000","last_fullsized":"2023-10-06T11:06:36.585222+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:27:30.195353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.576927+0000","last_change":"2023-10-06T11:06:36.572882+0000","last_active":"2023-10-06T11:06:36.576927+0000","last_peered":"2023-10-06T11:06:36.576927+0000","last_clean":"2023-10-06T11:06:36.576927+0000","last_became_active":"2023-10-06T11:06:36.572597+0000","last_became_peered":"2023-10-06T11:06:36.572597+0000","last_unstale":"2023-10-06T11:06:36.576927+0000","last_undegraded":"2023-10-06T11:06:36.576927+0000","last_fullsized":"2023-10-06T11:06:36.576927+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:37:27.797737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.571864+0000","last_change":"2023-10-06T11:06:36.566117+0000","last_active":"2023-10-06T11:06:36.571864+0000","last_peered":"2023-10-06T11:06:36.571864+0000","last_clean":"2023-10-06T11:06:36.571864+0000","last_became_active":"2023-10-06T11:06:36.565858+0000","last_became_peered":"2023-10-06T11:06:36.565858+0000","last_unstale":"2023-10-06T11:06:36.571864+0000","last_undegraded":"2023-10-06T11:06:36.571864+0000","last_fullsized":"2023-10-06T11:06:36.571864+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:02:06.190668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.583108+0000","last_change":"2023-10-06T11:06:36.578432+0000","last_active":"2023-10-06T11:06:36.583108+0000","last_peered":"2023-10-06T11:06:36.583108+0000","last_clean":"2023-10-06T11:06:36.583108+0000","last_became_active":"2023-10-06T11:06:36.578156+0000","last_became_peered":"2023-10-06T11:06:36.578156+0000","last_unstale":"2023-10-06T11:06:36.583108+0000","last_undegraded":"2023-10-06T11:06:36.583108+0000","last_fullsized":"2023-10-06T11:06:36.583108+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:53.558991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.569489+0000","last_change":"2023-10-06T11:06:36.563282+0000","last_active":"2023-10-06T11:06:36.569489+0000","last_peered":"2023-10-06T11:06:36.569489+0000","last_clean":"2023-10-06T11:06:36.569489+0000","last_became_active":"2023-10-06T11:06:36.562979+0000","last_became_peered":"2023-10-06T11:06:36.562979+0000","last_unstale":"2023-10-06T11:06:36.569489+0000","last_undegraded":"2023-10-06T11:06:36.569489+0000","last_fullsized":"2023-10-06T11:06:36.569489+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:02.184653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.570786+0000","last_change":"2023-10-06T11:06:36.565509+0000","last_active":"2023-10-06T11:06:36.570786+0000","last_peered":"2023-10-06T11:06:36.570786+0000","last_clean":"2023-10-06T11:06:36.570786+0000","last_became_active":"2023-10-06T11:06:36.565187+0000","last_became_peered":"2023-10-06T11:06:36.565187+0000","last_unstale":"2023-10-06T11:06:36.570786+0000","last_undegraded":"2023-10-06T11:06:36.570786+0000","last_fullsized":"2023-10-06T11:06:36.570786+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:15:22.214670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.581371+0000","last_change":"2023-10-06T11:06:36.572163+0000","last_active":"2023-10-06T11:06:36.581371+0000","last_peered":"2023-10-06T11:06:36.581371+0000","last_clean":"2023-10-06T11:06:36.581371+0000","last_became_active":"2023-10-06T11:06:36.571726+0000","last_became_peered":"2023-10-06T11:06:36.571726+0000","last_unstale":"2023-10-06T11:06:36.581371+0000","last_undegraded":"2023-10-06T11:06:36.581371+0000","last_fullsized":"2023-10-06T11:06:36.581371+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:53.550011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.574535+0000","last_change":"2023-10-06T11:06:36.568683+0000","last_active":"2023-10-06T11:06:36.574535+0000","last_peered":"2023-10-06T11:06:36.574535+0000","last_clean":"2023-10-06T11:06:36.574535+0000","last_became_active":"2023-10-06T11:06:36.568446+0000","last_became_peered":"2023-10-06T11:06:36.568446+0000","last_unstale":"2023-10-06T11:06:36.574535+0000","last_undegraded":"2023-10-06T11:06:36.574535+0000","last_fullsized":"2023-10-06T11:06:36.574535+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:27.799403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.575954+0000","last_change":"2023-10-06T11:06:36.568754+0000","last_active":"2023-10-06T11:06:36.575954+0000","last_peered":"2023-10-06T11:06:36.575954+0000","last_clean":"2023-10-06T11:06:36.575954+0000","last_became_active":"2023-10-06T11:06:36.567464+0000","last_became_peered":"2023-10-06T11:06:36.567464+0000","last_unstale":"2023-10-06T11:06:36.575954+0000","last_undegraded":"2023-10-06T11:06:36.575954+0000","last_fullsized":"2023-10-06T11:06:36.575954+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:54:47.482196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.572906+0000","last_change":"2023-10-06T11:06:36.568939+0000","last_active":"2023-10-06T11:06:36.572906+0000","last_peered":"2023-10-06T11:06:36.572906+0000","last_clean":"2023-10-06T11:06:36.572906+0000","last_became_active":"2023-10-06T11:06:36.567759+0000","last_became_peered":"2023-10-06T11:06:36.567759+0000","last_unstale":"2023-10-06T11:06:36.572906+0000","last_undegraded":"2023-10-06T11:06:36.572906+0000","last_fullsized":"2023-10-06T11:06:36.572906+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:59:13.791303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.573070+0000","last_change":"2023-10-06T11:06:36.566548+0000","last_active":"2023-10-06T11:06:36.573070+0000","last_peered":"2023-10-06T11:06:36.573070+0000","last_clean":"2023-10-06T11:06:36.573070+0000","last_became_active":"2023-10-06T11:06:36.566290+0000","last_became_peered":"2023-10-06T11:06:36.566290+0000","last_unstale":"2023-10-06T11:06:36.573070+0000","last_undegraded":"2023-10-06T11:06:36.573070+0000","last_fullsized":"2023-10-06T11:06:36.573070+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:27.799403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.585125+0000","last_change":"2023-10-06T11:06:36.578282+0000","last_active":"2023-10-06T11:06:36.585125+0000","last_peered":"2023-10-06T11:06:36.585125+0000","last_clean":"2023-10-06T11:06:36.585125+0000","last_became_active":"2023-10-06T11:06:36.577478+0000","last_became_peered":"2023-10-06T11:06:36.577478+0000","last_unstale":"2023-10-06T11:06:36.585125+0000","last_undegraded":"2023-10-06T11:06:36.585125+0000","last_fullsized":"2023-10-06T11:06:36.585125+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:03:01.050221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.575078+0000","last_change":"2023-10-06T11:06:36.568346+0000","last_active":"2023-10-06T11:06:36.575078+0000","last_peered":"2023-10-06T11:06:36.575078+0000","last_clean":"2023-10-06T11:06:36.575078+0000","last_became_active":"2023-10-06T11:06:36.568044+0000","last_became_peered":"2023-10-06T11:06:36.568044+0000","last_unstale":"2023-10-06T11:06:36.575078+0000","last_undegraded":"2023-10-06T11:06:36.575078+0000","last_fullsized":"2023-10-06T11:06:36.575078+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:02:06.190668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.583187+0000","last_change":"2023-10-06T11:06:36.578800+0000","last_active":"2023-10-06T11:06:36.583187+0000","last_peered":"2023-10-06T11:06:36.583187+0000","last_clean":"2023-10-06T11:06:36.583187+0000","last_became_active":"2023-10-06T11:06:36.577352+0000","last_became_peered":"2023-10-06T11:06:36.577352+0000","last_unstale":"2023-10-06T11:06:36.583187+0000","last_undegraded":"2023-10-06T11:06:36.583187+0000","last_fullsized":"2023-10-06T11:06:36.583187+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:18:51.654155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.581349+0000","last_change":"2023-10-06T11:06:36.571998+0000","last_active":"2023-10-06T11:06:36.581349+0000","last_peered":"2023-10-06T11:06:36.581349+0000","last_clean":"2023-10-06T11:06:36.581349+0000","last_became_active":"2023-10-06T11:06:36.571440+0000","last_became_peered":"2023-10-06T11:06:36.571440+0000","last_unstale":"2023-10-06T11:06:36.581349+0000","last_undegraded":"2023-10-06T11:06:36.581349+0000","last_fullsized":"2023-10-06T11:06:36.581349+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:44:02.830216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.565515+0000","last_change":"2023-10-06T11:06:36.561959+0000","last_active":"2023-10-06T11:06:36.565515+0000","last_peered":"2023-10-06T11:06:36.565515+0000","last_clean":"2023-10-06T11:06:36.565515+0000","last_became_active":"2023-10-06T11:06:36.561663+0000","last_became_peered":"2023-10-06T11:06:36.561663+0000","last_unstale":"2023-10-06T11:06:36.565515+0000","last_undegraded":"2023-10-06T11:06:36.565515+0000","last_fullsized":"2023-10-06T11:06:36.565515+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:27.615158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.585202+0000","last_change":"2023-10-06T11:06:36.582114+0000","last_active":"2023-10-06T11:06:36.585202+0000","last_peered":"2023-10-06T11:06:36.585202+0000","last_clean":"2023-10-06T11:06:36.585202+0000","last_became_active":"2023-10-06T11:06:36.581814+0000","last_became_peered":"2023-10-06T11:06:36.581814+0000","last_unstale":"2023-10-06T11:06:36.585202+0000","last_undegraded":"2023-10-06T11:06:36.585202+0000","last_fullsized":"2023-10-06T11:06:36.585202+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:24:26.471584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"30'4","reported_seq":14,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.580040+0000","last_change":"2023-10-06T11:06:35.569189+0000","last_active":"2023-10-06T11:06:36.580040+0000","last_peered":"2023-10-06T11:06:36.580040+0000","last_clean":"2023-10-06T11:06:36.580040+0000","last_became_active":"2023-10-06T11:06:35.568921+0000","last_became_peered":"2023-10-06T11:06:35.568921+0000","last_unstale":"2023-10-06T11:06:36.580040+0000","last_undegraded":"2023-10-06T11:06:36.580040+0000","last_fullsized":"2023-10-06T11:06:36.580040+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:24:57.695098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.579759+0000","last_change":"2023-10-06T11:06:36.576765+0000","last_active":"2023-10-06T11:06:36.579759+0000","last_peered":"2023-10-06T11:06:36.579759+0000","last_clean":"2023-10-06T11:06:36.579759+0000","last_became_active":"2023-10-06T11:06:36.576511+0000","last_became_peered":"2023-10-06T11:06:36.576511+0000","last_unstale":"2023-10-06T11:06:36.579759+0000","last_undegraded":"2023-10-06T11:06:36.579759+0000","last_fullsized":"2023-10-06T11:06:36.579759+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:12:02.043126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.581753+0000","last_change":"2023-10-06T11:06:35.569717+0000","last_active":"2023-10-06T11:06:36.581753+0000","last_peered":"2023-10-06T11:06:36.581753+0000","last_clean":"2023-10-06T11:06:36.581753+0000","last_became_active":"2023-10-06T11:06:35.569537+0000","last_became_peered":"2023-10-06T11:06:35.569537+0000","last_unstale":"2023-10-06T11:06:36.581753+0000","last_undegraded":"2023-10-06T11:06:36.581753+0000","last_fullsized":"2023-10-06T11:06:36.581753+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:48:38.446657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.570589+0000","last_change":"2023-10-06T11:06:36.566688+0000","last_active":"2023-10-06T11:06:36.570589+0000","last_peered":"2023-10-06T11:06:36.570589+0000","last_clean":"2023-10-06T11:06:36.570589+0000","last_became_active":"2023-10-06T11:06:36.566407+0000","last_became_peered":"2023-10-06T11:06:36.566407+0000","last_unstale":"2023-10-06T11:06:36.570589+0000","last_undegraded":"2023-10-06T11:06:36.570589+0000","last_fullsized":"2023-10-06T11:06:36.570589+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:11:13.106985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.578012+0000","last_change":"2023-10-06T11:06:35.568732+0000","last_active":"2023-10-06T11:06:36.578012+0000","last_peered":"2023-10-06T11:06:36.578012+0000","last_clean":"2023-10-06T11:06:36.578012+0000","last_became_active":"2023-10-06T11:06:35.568493+0000","last_became_peered":"2023-10-06T11:06:35.568493+0000","last_unstale":"2023-10-06T11:06:36.578012+0000","last_undegraded":"2023-10-06T11:06:36.578012+0000","last_fullsized":"2023-10-06T11:06:36.578012+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:26.792165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.581176+0000","last_change":"2023-10-06T11:06:36.577662+0000","last_active":"2023-10-06T11:06:36.581176+0000","last_peered":"2023-10-06T11:06:36.581176+0000","last_clean":"2023-10-06T11:06:36.581176+0000","last_became_active":"2023-10-06T11:06:36.577069+0000","last_became_peered":"2023-10-06T11:06:36.577069+0000","last_unstale":"2023-10-06T11:06:36.581176+0000","last_undegraded":"2023-10-06T11:06:36.581176+0000","last_fullsized":"2023-10-06T11:06:36.581176+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:32:31.550090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.584025+0000","last_change":"2023-10-06T11:06:35.567485+0000","last_active":"2023-10-06T11:06:36.584025+0000","last_peered":"2023-10-06T11:06:36.584025+0000","last_clean":"2023-10-06T11:06:36.584025+0000","last_became_active":"2023-10-06T11:06:35.567162+0000","last_became_peered":"2023-10-06T11:06:35.567162+0000","last_unstale":"2023-10-06T11:06:36.584025+0000","last_undegraded":"2023-10-06T11:06:36.584025+0000","last_fullsized":"2023-10-06T11:06:36.584025+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:12:01.035888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.566219+0000","last_change":"2023-10-06T11:06:36.562977+0000","last_active":"2023-10-06T11:06:36.566219+0000","last_peered":"2023-10-06T11:06:36.566219+0000","last_clean":"2023-10-06T11:06:36.566219+0000","last_became_active":"2023-10-06T11:06:36.562747+0000","last_became_peered":"2023-10-06T11:06:36.562747+0000","last_unstale":"2023-10-06T11:06:36.566219+0000","last_undegraded":"2023-10-06T11:06:36.566219+0000","last_fullsized":"2023-10-06T11:06:36.566219+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:53.550011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.580230+0000","last_change":"2023-10-06T11:06:35.572139+0000","last_active":"2023-10-06T11:06:36.580230+0000","last_peered":"2023-10-06T11:06:36.580230+0000","last_clean":"2023-10-06T11:06:36.580230+0000","last_became_active":"2023-10-06T11:06:35.566406+0000","last_became_peered":"2023-10-06T11:06:35.566406+0000","last_unstale":"2023-10-06T11:06:36.580230+0000","last_undegraded":"2023-10-06T11:06:36.580230+0000","last_fullsized":"2023-10-06T11:06:36.580230+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:55:03.258755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.580117+0000","last_change":"2023-10-06T11:06:36.570434+0000","last_active":"2023-10-06T11:06:36.580117+0000","last_peered":"2023-10-06T11:06:36.580117+0000","last_clean":"2023-10-06T11:06:36.580117+0000","last_became_active":"2023-10-06T11:06:36.570155+0000","last_became_peered":"2023-10-06T11:06:36.570155+0000","last_unstale":"2023-10-06T11:06:36.580117+0000","last_undegraded":"2023-10-06T11:06:36.580117+0000","last_fullsized":"2023-10-06T11:06:36.580117+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:25.340891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.585626+0000","last_change":"2023-10-06T11:06:35.573473+0000","last_active":"2023-10-06T11:06:36.585626+0000","last_peered":"2023-10-06T11:06:36.585626+0000","last_clean":"2023-10-06T11:06:36.585626+0000","last_became_active":"2023-10-06T11:06:35.573204+0000","last_became_peered":"2023-10-06T11:06:35.573204+0000","last_unstale":"2023-10-06T11:06:36.585626+0000","last_undegraded":"2023-10-06T11:06:36.585626+0000","last_fullsized":"2023-10-06T11:06:36.585626+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:52.551753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.570765+0000","last_change":"2023-10-06T11:06:36.564722+0000","last_active":"2023-10-06T11:06:36.570765+0000","last_peered":"2023-10-06T11:06:36.570765+0000","last_clean":"2023-10-06T11:06:36.570765+0000","last_became_active":"2023-10-06T11:06:36.564429+0000","last_became_peered":"2023-10-06T11:06:36.564429+0000","last_unstale":"2023-10-06T11:06:36.570765+0000","last_undegraded":"2023-10-06T11:06:36.570765+0000","last_fullsized":"2023-10-06T11:06:36.570765+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:30:40.428266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.562336+0000","last_change":"2023-10-06T11:06:35.563757+0000","last_active":"2023-10-06T11:06:36.562336+0000","last_peered":"2023-10-06T11:06:36.562336+0000","last_clean":"2023-10-06T11:06:36.562336+0000","last_became_active":"2023-10-06T11:06:35.563499+0000","last_became_peered":"2023-10-06T11:06:35.563499+0000","last_unstale":"2023-10-06T11:06:36.562336+0000","last_undegraded":"2023-10-06T11:06:36.562336+0000","last_fullsized":"2023-10-06T11:06:36.562336+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:52.551753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.581070+0000","last_change":"2023-10-06T11:06:36.576859+0000","last_active":"2023-10-06T11:06:36.581070+0000","last_peered":"2023-10-06T11:06:36.581070+0000","last_clean":"2023-10-06T11:06:36.581070+0000","last_became_active":"2023-10-06T11:06:36.576353+0000","last_became_peered":"2023-10-06T11:06:36.576353+0000","last_unstale":"2023-10-06T11:06:36.581070+0000","last_undegraded":"2023-10-06T11:06:36.581070+0000","last_fullsized":"2023-10-06T11:06:36.581070+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:02.194639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.556022+0000","last_change":"2023-10-06T11:06:35.566496+0000","last_active":"2023-10-06T11:06:36.556022+0000","last_peered":"2023-10-06T11:06:36.556022+0000","last_clean":"2023-10-06T11:06:36.556022+0000","last_became_active":"2023-10-06T11:06:35.566211+0000","last_became_peered":"2023-10-06T11:06:35.566211+0000","last_unstale":"2023-10-06T11:06:36.556022+0000","last_undegraded":"2023-10-06T11:06:36.556022+0000","last_fullsized":"2023-10-06T11:06:36.556022+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:42:18.395648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.565090+0000","last_change":"2023-10-06T11:06:36.564119+0000","last_active":"2023-10-06T11:06:36.565090+0000","last_peered":"2023-10-06T11:06:36.565090+0000","last_clean":"2023-10-06T11:06:36.565090+0000","last_became_active":"2023-10-06T11:06:36.563842+0000","last_became_peered":"2023-10-06T11:06:36.563842+0000","last_unstale":"2023-10-06T11:06:36.565090+0000","last_undegraded":"2023-10-06T11:06:36.565090+0000","last_fullsized":"2023-10-06T11:06:36.565090+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:22.479784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.565555+0000","last_change":"2023-10-06T11:06:35.570888+0000","last_active":"2023-10-06T11:06:36.565555+0000","last_peered":"2023-10-06T11:06:36.565555+0000","last_clean":"2023-10-06T11:06:36.565555+0000","last_became_active":"2023-10-06T11:06:35.570608+0000","last_became_peered":"2023-10-06T11:06:35.570608+0000","last_unstale":"2023-10-06T11:06:36.565555+0000","last_undegraded":"2023-10-06T11:06:36.565555+0000","last_fullsized":"2023-10-06T11:06:36.565555+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:35:11.323866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.582939+0000","last_change":"2023-10-06T11:06:36.580237+0000","last_active":"2023-10-06T11:06:36.582939+0000","last_peered":"2023-10-06T11:06:36.582939+0000","last_clean":"2023-10-06T11:06:36.582939+0000","last_became_active":"2023-10-06T11:06:36.577317+0000","last_became_peered":"2023-10-06T11:06:36.577317+0000","last_unstale":"2023-10-06T11:06:36.582939+0000","last_undegraded":"2023-10-06T11:06:36.582939+0000","last_fullsized":"2023-10-06T11:06:36.582939+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:36:53.469044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.560525+0000","last_change":"2023-10-06T11:06:35.570188+0000","last_active":"2023-10-06T11:06:36.560525+0000","last_peered":"2023-10-06T11:06:36.560525+0000","last_clean":"2023-10-06T11:06:36.560525+0000","last_became_active":"2023-10-06T11:06:35.565593+0000","last_became_peered":"2023-10-06T11:06:35.565593+0000","last_unstale":"2023-10-06T11:06:36.560525+0000","last_undegraded":"2023-10-06T11:06:36.560525+0000","last_fullsized":"2023-10-06T11:06:36.560525+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:37:26.790499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.575845+0000","last_change":"2023-10-06T11:06:36.573614+0000","last_active":"2023-10-06T11:06:36.575845+0000","last_peered":"2023-10-06T11:06:36.575845+0000","last_clean":"2023-10-06T11:06:36.575845+0000","last_became_active":"2023-10-06T11:06:36.573340+0000","last_became_peered":"2023-10-06T11:06:36.573340+0000","last_unstale":"2023-10-06T11:06:36.575845+0000","last_undegraded":"2023-10-06T11:06:36.575845+0000","last_fullsized":"2023-10-06T11:06:36.575845+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:33.482789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"30'3","reported_seq":13,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.585066+0000","last_change":"2023-10-06T11:06:35.572003+0000","last_active":"2023-10-06T11:06:36.585066+0000","last_peered":"2023-10-06T11:06:36.585066+0000","last_clean":"2023-10-06T11:06:36.585066+0000","last_became_active":"2023-10-06T11:06:35.571696+0000","last_became_peered":"2023-10-06T11:06:35.571696+0000","last_unstale":"2023-10-06T11:06:36.585066+0000","last_undegraded":"2023-10-06T11:06:36.585066+0000","last_fullsized":"2023-10-06T11:06:36.585066+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:26.792165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.567562+0000","last_change":"2023-10-06T11:06:36.561650+0000","last_active":"2023-10-06T11:06:36.567562+0000","last_peered":"2023-10-06T11:06:36.567562+0000","last_clean":"2023-10-06T11:06:36.567562+0000","last_became_active":"2023-10-06T11:06:36.561402+0000","last_became_peered":"2023-10-06T11:06:36.561402+0000","last_unstale":"2023-10-06T11:06:36.567562+0000","last_undegraded":"2023-10-06T11:06:36.567562+0000","last_fullsized":"2023-10-06T11:06:36.567562+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:27:30.195353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"30'6","reported_seq":16,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.588989+0000","last_change":"2023-10-06T11:06:35.567043+0000","last_active":"2023-10-06T11:06:36.588989+0000","last_peered":"2023-10-06T11:06:36.588989+0000","last_clean":"2023-10-06T11:06:36.588989+0000","last_became_active":"2023-10-06T11:06:35.566798+0000","last_became_peered":"2023-10-06T11:06:35.566798+0000","last_unstale":"2023-10-06T11:06:36.588989+0000","last_undegraded":"2023-10-06T11:06:36.588989+0000","last_fullsized":"2023-10-06T11:06:36.588989+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:50:38.662209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.566236+0000","last_change":"2023-10-06T11:06:36.563757+0000","last_active":"2023-10-06T11:06:36.566236+0000","last_peered":"2023-10-06T11:06:36.566236+0000","last_clean":"2023-10-06T11:06:36.566236+0000","last_became_active":"2023-10-06T11:06:36.563496+0000","last_became_peered":"2023-10-06T11:06:36.563496+0000","last_unstale":"2023-10-06T11:06:36.566236+0000","last_undegraded":"2023-10-06T11:06:36.566236+0000","last_fullsized":"2023-10-06T11:06:36.566236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:02.184653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.578940+0000","last_change":"2023-10-06T11:06:35.566555+0000","last_active":"2023-10-06T11:06:36.578940+0000","last_peered":"2023-10-06T11:06:36.578940+0000","last_clean":"2023-10-06T11:06:36.578940+0000","last_became_active":"2023-10-06T11:06:35.566300+0000","last_became_peered":"2023-10-06T11:06:35.566300+0000","last_unstale":"2023-10-06T11:06:36.578940+0000","last_undegraded":"2023-10-06T11:06:36.578940+0000","last_fullsized":"2023-10-06T11:06:36.578940+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:48:38.446657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.578828+0000","last_change":"2023-10-06T11:06:36.573431+0000","last_active":"2023-10-06T11:06:36.578828+0000","last_peered":"2023-10-06T11:06:36.578828+0000","last_clean":"2023-10-06T11:06:36.578828+0000","last_became_active":"2023-10-06T11:06:36.573151+0000","last_became_peered":"2023-10-06T11:06:36.573151+0000","last_unstale":"2023-10-06T11:06:36.578828+0000","last_undegraded":"2023-10-06T11:06:36.578828+0000","last_fullsized":"2023-10-06T11:06:36.578828+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:15:22.214670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.558693+0000","last_change":"2023-10-06T11:06:35.563788+0000","last_active":"2023-10-06T11:06:36.558693+0000","last_peered":"2023-10-06T11:06:36.558693+0000","last_clean":"2023-10-06T11:06:36.558693+0000","last_became_active":"2023-10-06T11:06:35.563536+0000","last_became_peered":"2023-10-06T11:06:35.563536+0000","last_unstale":"2023-10-06T11:06:36.558693+0000","last_undegraded":"2023-10-06T11:06:36.558693+0000","last_fullsized":"2023-10-06T11:06:36.558693+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:37:26.790499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.581189+0000","last_change":"2023-10-06T11:06:36.570409+0000","last_active":"2023-10-06T11:06:36.581189+0000","last_peered":"2023-10-06T11:06:36.581189+0000","last_clean":"2023-10-06T11:06:36.581189+0000","last_became_active":"2023-10-06T11:06:36.570154+0000","last_became_peered":"2023-10-06T11:06:36.570154+0000","last_unstale":"2023-10-06T11:06:36.581189+0000","last_undegraded":"2023-10-06T11:06:36.581189+0000","last_fullsized":"2023-10-06T11:06:36.581189+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:10:47.800013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.562992+0000","last_change":"2023-10-06T11:06:35.568542+0000","last_active":"2023-10-06T11:06:36.562992+0000","last_peered":"2023-10-06T11:06:36.562992+0000","last_clean":"2023-10-06T11:06:36.562992+0000","last_became_active":"2023-10-06T11:06:35.568247+0000","last_became_peered":"2023-10-06T11:06:35.568247+0000","last_unstale":"2023-10-06T11:06:36.562992+0000","last_undegraded":"2023-10-06T11:06:36.562992+0000","last_fullsized":"2023-10-06T11:06:36.562992+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:47:34.457893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.581151+0000","last_change":"2023-10-06T11:06:36.577406+0000","last_active":"2023-10-06T11:06:36.581151+0000","last_peered":"2023-10-06T11:06:36.581151+0000","last_clean":"2023-10-06T11:06:36.581151+0000","last_became_active":"2023-10-06T11:06:36.577127+0000","last_became_peered":"2023-10-06T11:06:36.577127+0000","last_unstale":"2023-10-06T11:06:36.581151+0000","last_undegraded":"2023-10-06T11:06:36.581151+0000","last_fullsized":"2023-10-06T11:06:36.581151+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:44:02.830216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"30'8","reported_seq":18,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.586477+0000","last_change":"2023-10-06T11:06:35.573522+0000","last_active":"2023-10-06T11:06:36.586477+0000","last_peered":"2023-10-06T11:06:36.586477+0000","last_clean":"2023-10-06T11:06:36.586477+0000","last_became_active":"2023-10-06T11:06:35.573233+0000","last_became_peered":"2023-10-06T11:06:35.573233+0000","last_unstale":"2023-10-06T11:06:36.586477+0000","last_undegraded":"2023-10-06T11:06:36.586477+0000","last_fullsized":"2023-10-06T11:06:36.586477+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:37:26.790499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.581089+0000","last_change":"2023-10-06T11:06:36.576928+0000","last_active":"2023-10-06T11:06:36.581089+0000","last_peered":"2023-10-06T11:06:36.581089+0000","last_clean":"2023-10-06T11:06:36.581089+0000","last_became_active":"2023-10-06T11:06:36.576701+0000","last_became_peered":"2023-10-06T11:06:36.576701+0000","last_unstale":"2023-10-06T11:06:36.581089+0000","last_undegraded":"2023-10-06T11:06:36.581089+0000","last_fullsized":"2023-10-06T11:06:36.581089+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:53.494581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.585551+0000","last_change":"2023-10-06T11:06:35.562619+0000","last_active":"2023-10-06T11:06:36.585551+0000","last_peered":"2023-10-06T11:06:36.585551+0000","last_clean":"2023-10-06T11:06:36.585551+0000","last_became_active":"2023-10-06T11:06:35.562355+0000","last_became_peered":"2023-10-06T11:06:35.562355+0000","last_unstale":"2023-10-06T11:06:36.585551+0000","last_undegraded":"2023-10-06T11:06:36.585551+0000","last_fullsized":"2023-10-06T11:06:36.585551+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:02:05.183430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.580271+0000","last_change":"2023-10-06T11:06:36.572292+0000","last_active":"2023-10-06T11:06:36.580271+0000","last_peered":"2023-10-06T11:06:36.580271+0000","last_clean":"2023-10-06T11:06:36.580271+0000","last_became_active":"2023-10-06T11:06:36.571989+0000","last_became_peered":"2023-10-06T11:06:36.571989+0000","last_unstale":"2023-10-06T11:06:36.580271+0000","last_undegraded":"2023-10-06T11:06:36.580271+0000","last_fullsized":"2023-10-06T11:06:36.580271+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:36:53.469044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.580708+0000","last_change":"2023-10-06T11:06:35.566348+0000","last_active":"2023-10-06T11:06:36.580708+0000","last_peered":"2023-10-06T11:06:36.580708+0000","last_clean":"2023-10-06T11:06:36.580708+0000","last_became_active":"2023-10-06T11:06:35.565126+0000","last_became_peered":"2023-10-06T11:06:35.565126+0000","last_unstale":"2023-10-06T11:06:36.580708+0000","last_undegraded":"2023-10-06T11:06:36.580708+0000","last_fullsized":"2023-10-06T11:06:36.580708+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:59:12.784065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.570570+0000","last_change":"2023-10-06T11:06:36.564115+0000","last_active":"2023-10-06T11:06:36.570570+0000","last_peered":"2023-10-06T11:06:36.570570+0000","last_clean":"2023-10-06T11:06:36.570570+0000","last_became_active":"2023-10-06T11:06:36.563844+0000","last_became_peered":"2023-10-06T11:06:36.563844+0000","last_unstale":"2023-10-06T11:06:36.570570+0000","last_undegraded":"2023-10-06T11:06:36.570570+0000","last_fullsized":"2023-10-06T11:06:36.570570+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:02.194639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"30'1","reported_seq":11,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.581547+0000","last_change":"2023-10-06T11:06:35.570646+0000","last_active":"2023-10-06T11:06:36.581547+0000","last_peered":"2023-10-06T11:06:36.581547+0000","last_clean":"2023-10-06T11:06:36.581547+0000","last_became_active":"2023-10-06T11:06:35.570386+0000","last_became_peered":"2023-10-06T11:06:35.570386+0000","last_unstale":"2023-10-06T11:06:36.581547+0000","last_undegraded":"2023-10-06T11:06:36.581547+0000","last_fullsized":"2023-10-06T11:06:36.581547+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:10.251950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.581070+0000","last_change":"2023-10-06T11:06:36.578481+0000","last_active":"2023-10-06T11:06:36.581070+0000","last_peered":"2023-10-06T11:06:36.581070+0000","last_clean":"2023-10-06T11:06:36.581070+0000","last_became_active":"2023-10-06T11:06:36.578219+0000","last_became_peered":"2023-10-06T11:06:36.578219+0000","last_unstale":"2023-10-06T11:06:36.581070+0000","last_undegraded":"2023-10-06T11:06:36.581070+0000","last_fullsized":"2023-10-06T11:06:36.581070+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:54:27.565436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.558819+0000","last_change":"2023-10-06T11:06:35.568732+0000","last_active":"2023-10-06T11:06:36.558819+0000","last_peered":"2023-10-06T11:06:36.558819+0000","last_clean":"2023-10-06T11:06:36.558819+0000","last_became_active":"2023-10-06T11:06:35.568460+0000","last_became_peered":"2023-10-06T11:06:35.568460+0000","last_unstale":"2023-10-06T11:06:36.558819+0000","last_undegraded":"2023-10-06T11:06:36.558819+0000","last_fullsized":"2023-10-06T11:06:36.558819+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:25.431156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.586204+0000","last_change":"2023-10-06T11:06:36.582752+0000","last_active":"2023-10-06T11:06:36.586204+0000","last_peered":"2023-10-06T11:06:36.586204+0000","last_clean":"2023-10-06T11:06:36.586204+0000","last_became_active":"2023-10-06T11:06:36.581919+0000","last_became_peered":"2023-10-06T11:06:36.581919+0000","last_unstale":"2023-10-06T11:06:36.586204+0000","last_undegraded":"2023-10-06T11:06:36.586204+0000","last_fullsized":"2023-10-06T11:06:36.586204+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:33.482789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.575543+0000","last_change":"2023-10-06T11:06:35.565612+0000","last_active":"2023-10-06T11:06:36.575543+0000","last_peered":"2023-10-06T11:06:36.575543+0000","last_clean":"2023-10-06T11:06:36.575543+0000","last_became_active":"2023-10-06T11:06:35.565373+0000","last_became_peered":"2023-10-06T11:06:35.565373+0000","last_unstale":"2023-10-06T11:06:36.575543+0000","last_undegraded":"2023-10-06T11:06:36.575543+0000","last_fullsized":"2023-10-06T11:06:36.575543+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:22.790704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.575283+0000","last_change":"2023-10-06T11:06:36.570130+0000","last_active":"2023-10-06T11:06:36.575283+0000","last_peered":"2023-10-06T11:06:36.575283+0000","last_clean":"2023-10-06T11:06:36.575283+0000","last_became_active":"2023-10-06T11:06:36.569896+0000","last_became_peered":"2023-10-06T11:06:36.569896+0000","last_unstale":"2023-10-06T11:06:36.575283+0000","last_undegraded":"2023-10-06T11:06:36.575283+0000","last_fullsized":"2023-10-06T11:06:36.575283+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:44:02.830216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.559853+0000","last_change":"2023-10-06T11:06:35.563587+0000","last_active":"2023-10-06T11:06:36.559853+0000","last_peered":"2023-10-06T11:06:36.559853+0000","last_clean":"2023-10-06T11:06:36.559853+0000","last_became_active":"2023-10-06T11:06:35.562933+0000","last_became_peered":"2023-10-06T11:06:35.562933+0000","last_unstale":"2023-10-06T11:06:36.559853+0000","last_undegraded":"2023-10-06T11:06:36.559853+0000","last_fullsized":"2023-10-06T11:06:36.559853+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:27:16.186215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.580169+0000","last_change":"2023-10-06T11:06:36.571501+0000","last_active":"2023-10-06T11:06:36.580169+0000","last_peered":"2023-10-06T11:06:36.580169+0000","last_clean":"2023-10-06T11:06:36.580169+0000","last_became_active":"2023-10-06T11:06:36.571201+0000","last_became_peered":"2023-10-06T11:06:36.571201+0000","last_unstale":"2023-10-06T11:06:36.580169+0000","last_undegraded":"2023-10-06T11:06:36.580169+0000","last_fullsized":"2023-10-06T11:06:36.580169+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:33.482789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.564605+0000","last_change":"2023-10-06T11:06:35.573385+0000","last_active":"2023-10-06T11:06:36.564605+0000","last_peered":"2023-10-06T11:06:36.564605+0000","last_clean":"2023-10-06T11:06:36.564605+0000","last_became_active":"2023-10-06T11:06:35.573110+0000","last_became_peered":"2023-10-06T11:06:35.573110+0000","last_unstale":"2023-10-06T11:06:36.564605+0000","last_undegraded":"2023-10-06T11:06:36.564605+0000","last_fullsized":"2023-10-06T11:06:36.564605+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:54:46.474958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.581171+0000","last_change":"2023-10-06T11:06:36.577454+0000","last_active":"2023-10-06T11:06:36.581171+0000","last_peered":"2023-10-06T11:06:36.581171+0000","last_clean":"2023-10-06T11:06:36.581171+0000","last_became_active":"2023-10-06T11:06:36.576673+0000","last_became_peered":"2023-10-06T11:06:36.576673+0000","last_unstale":"2023-10-06T11:06:36.581171+0000","last_undegraded":"2023-10-06T11:06:36.581171+0000","last_fullsized":"2023-10-06T11:06:36.581171+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:30:40.428266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.558953+0000","last_change":"2023-10-06T11:06:35.565314+0000","last_active":"2023-10-06T11:06:36.558953+0000","last_peered":"2023-10-06T11:06:36.558953+0000","last_clean":"2023-10-06T11:06:36.558953+0000","last_became_active":"2023-10-06T11:06:35.565003+0000","last_became_peered":"2023-10-06T11:06:35.565003+0000","last_unstale":"2023-10-06T11:06:36.558953+0000","last_undegraded":"2023-10-06T11:06:36.558953+0000","last_fullsized":"2023-10-06T11:06:36.558953+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:06:59.444199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.585434+0000","last_change":"2023-10-06T11:06:36.578091+0000","last_active":"2023-10-06T11:06:36.585434+0000","last_peered":"2023-10-06T11:06:36.585434+0000","last_clean":"2023-10-06T11:06:36.585434+0000","last_became_active":"2023-10-06T11:06:36.577829+0000","last_became_peered":"2023-10-06T11:06:36.577829+0000","last_unstale":"2023-10-06T11:06:36.585434+0000","last_undegraded":"2023-10-06T11:06:36.585434+0000","last_fullsized":"2023-10-06T11:06:36.585434+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:32:31.550090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.555614+0000","last_change":"2023-10-06T11:06:35.568012+0000","last_active":"2023-10-06T11:06:36.555614+0000","last_peered":"2023-10-06T11:06:36.555614+0000","last_clean":"2023-10-06T11:06:36.555614+0000","last_became_active":"2023-10-06T11:06:35.567630+0000","last_became_peered":"2023-10-06T11:06:35.567630+0000","last_unstale":"2023-10-06T11:06:36.555614+0000","last_undegraded":"2023-10-06T11:06:36.555614+0000","last_fullsized":"2023-10-06T11:06:36.555614+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:24:25.464345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":22,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.555662+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:06:36.555662+0000","last_peered":"2023-10-06T11:06:36.555662+0000","last_clean":"2023-10-06T11:06:36.555662+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:06:36.555662+0000","last_undegraded":"2023-10-06T11:06:36.555662+0000","last_fullsized":"2023-10-06T11:06:36.555662+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.585234+0000","last_change":"2023-10-06T11:06:36.581413+0000","last_active":"2023-10-06T11:06:36.585234+0000","last_peered":"2023-10-06T11:06:36.585234+0000","last_clean":"2023-10-06T11:06:36.585234+0000","last_became_active":"2023-10-06T11:06:36.580955+0000","last_became_peered":"2023-10-06T11:06:36.580955+0000","last_unstale":"2023-10-06T11:06:36.585234+0000","last_undegraded":"2023-10-06T11:06:36.585234+0000","last_fullsized":"2023-10-06T11:06:36.585234+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:42:19.402886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.563866+0000","last_change":"2023-10-06T11:06:35.565611+0000","last_active":"2023-10-06T11:06:36.563866+0000","last_peered":"2023-10-06T11:06:36.563866+0000","last_clean":"2023-10-06T11:06:36.563866+0000","last_became_active":"2023-10-06T11:06:35.565425+0000","last_became_peered":"2023-10-06T11:06:35.565425+0000","last_unstale":"2023-10-06T11:06:36.563866+0000","last_undegraded":"2023-10-06T11:06:36.563866+0000","last_fullsized":"2023-10-06T11:06:36.563866+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:04:05.569279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.566580+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:06:36.566580+0000","last_peered":"2023-10-06T11:06:36.566580+0000","last_clean":"2023-10-06T11:06:36.566580+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:06:36.566580+0000","last_undegraded":"2023-10-06T11:06:36.566580+0000","last_fullsized":"2023-10-06T11:06:36.566580+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.571772+0000","last_change":"2023-10-06T11:06:36.568057+0000","last_active":"2023-10-06T11:06:36.571772+0000","last_peered":"2023-10-06T11:06:36.571772+0000","last_clean":"2023-10-06T11:06:36.571772+0000","last_became_active":"2023-10-06T11:06:36.567776+0000","last_became_peered":"2023-10-06T11:06:36.567776+0000","last_unstale":"2023-10-06T11:06:36.571772+0000","last_undegraded":"2023-10-06T11:06:36.571772+0000","last_fullsized":"2023-10-06T11:06:36.571772+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:54.497548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"30'2","reported_seq":12,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.580716+0000","last_change":"2023-10-06T11:06:35.571084+0000","last_active":"2023-10-06T11:06:36.580716+0000","last_peered":"2023-10-06T11:06:36.580716+0000","last_clean":"2023-10-06T11:06:36.580716+0000","last_became_active":"2023-10-06T11:06:35.570790+0000","last_became_peered":"2023-10-06T11:06:35.570790+0000","last_unstale":"2023-10-06T11:06:36.580716+0000","last_undegraded":"2023-10-06T11:06:36.580716+0000","last_fullsized":"2023-10-06T11:06:36.580716+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:02:25.431156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.558581+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:06:36.558581+0000","last_peered":"2023-10-06T11:06:36.558581+0000","last_clean":"2023-10-06T11:06:36.558581+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:06:36.558581+0000","last_undegraded":"2023-10-06T11:06:36.558581+0000","last_fullsized":"2023-10-06T11:06:36.558581+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":171,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.566462+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:06:36.566462+0000","last_peered":"2023-10-06T11:06:36.566462+0000","last_clean":"2023-10-06T11:06:36.566462+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:06:36.566462+0000","last_undegraded":"2023-10-06T11:06:36.566462+0000","last_fullsized":"2023-10-06T11:06:36.566462+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.582958+0000","last_change":"2023-10-06T11:06:36.580788+0000","last_active":"2023-10-06T11:06:36.582958+0000","last_peered":"2023-10-06T11:06:36.582958+0000","last_clean":"2023-10-06T11:06:36.582958+0000","last_became_active":"2023-10-06T11:06:36.580536+0000","last_became_peered":"2023-10-06T11:06:36.580536+0000","last_unstale":"2023-10-06T11:06:36.582958+0000","last_undegraded":"2023-10-06T11:06:36.582958+0000","last_fullsized":"2023-10-06T11:06:36.582958+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:25.340891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-06T11:06:38.126770+0000","last_change":"2023-10-06T11:06:35.562232+0000","last_active":"2023-10-06T11:06:38.126770+0000","last_peered":"2023-10-06T11:06:38.126770+0000","last_clean":"2023-10-06T11:06:38.126770+0000","last_became_active":"2023-10-06T11:06:35.561976+0000","last_became_peered":"2023-10-06T11:06:35.561976+0000","last_unstale":"2023-10-06T11:06:38.126770+0000","last_undegraded":"2023-10-06T11:06:38.126770+0000","last_fullsized":"2023-10-06T11:06:38.126770+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:50:26.045766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.563550+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:06:36.563550+0000","last_peered":"2023-10-06T11:06:36.563550+0000","last_clean":"2023-10-06T11:06:36.563550+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:06:36.563550+0000","last_undegraded":"2023-10-06T11:06:36.563550+0000","last_fullsized":"2023-10-06T11:06:36.563550+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.585003+0000","last_change":"2023-10-06T11:06:36.577799+0000","last_active":"2023-10-06T11:06:36.585003+0000","last_peered":"2023-10-06T11:06:36.585003+0000","last_clean":"2023-10-06T11:06:36.585003+0000","last_became_active":"2023-10-06T11:06:36.577544+0000","last_became_peered":"2023-10-06T11:06:36.577544+0000","last_unstale":"2023-10-06T11:06:36.585003+0000","last_undegraded":"2023-10-06T11:06:36.585003+0000","last_fullsized":"2023-10-06T11:06:36.585003+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:53.550011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.564290+0000","last_change":"2023-10-06T11:06:35.575854+0000","last_active":"2023-10-06T11:06:36.564290+0000","last_peered":"2023-10-06T11:06:36.564290+0000","last_clean":"2023-10-06T11:06:36.564290+0000","last_became_active":"2023-10-06T11:06:35.575563+0000","last_became_peered":"2023-10-06T11:06:35.575563+0000","last_unstale":"2023-10-06T11:06:36.564290+0000","last_undegraded":"2023-10-06T11:06:36.564290+0000","last_fullsized":"2023-10-06T11:06:36.564290+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:18:50.646916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":21,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.566374+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:06:36.566374+0000","last_peered":"2023-10-06T11:06:36.566374+0000","last_clean":"2023-10-06T11:06:36.566374+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:06:36.566374+0000","last_undegraded":"2023-10-06T11:06:36.566374+0000","last_fullsized":"2023-10-06T11:06:36.566374+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.583898+0000","last_change":"2023-10-06T11:06:36.580177+0000","last_active":"2023-10-06T11:06:36.583898+0000","last_peered":"2023-10-06T11:06:36.583898+0000","last_clean":"2023-10-06T11:06:36.583898+0000","last_became_active":"2023-10-06T11:06:36.579881+0000","last_became_peered":"2023-10-06T11:06:36.579881+0000","last_unstale":"2023-10-06T11:06:36.583898+0000","last_undegraded":"2023-10-06T11:06:36.583898+0000","last_fullsized":"2023-10-06T11:06:36.583898+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:25.340891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.554763+0000","last_change":"2023-10-06T11:06:35.571025+0000","last_active":"2023-10-06T11:06:36.554763+0000","last_peered":"2023-10-06T11:06:36.554763+0000","last_clean":"2023-10-06T11:06:36.554763+0000","last_became_active":"2023-10-06T11:06:35.570772+0000","last_became_peered":"2023-10-06T11:06:35.570772+0000","last_unstale":"2023-10-06T11:06:36.554763+0000","last_undegraded":"2023-10-06T11:06:36.554763+0000","last_fullsized":"2023-10-06T11:06:36.554763+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:54:46.474958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":24,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.559475+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:06:36.559475+0000","last_peered":"2023-10-06T11:06:36.559475+0000","last_clean":"2023-10-06T11:06:36.559475+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:06:36.559475+0000","last_undegraded":"2023-10-06T11:06:36.559475+0000","last_fullsized":"2023-10-06T11:06:36.559475+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.574139+0000","last_change":"2023-10-06T11:06:36.569370+0000","last_active":"2023-10-06T11:06:36.574139+0000","last_peered":"2023-10-06T11:06:36.574139+0000","last_clean":"2023-10-06T11:06:36.574139+0000","last_became_active":"2023-10-06T11:06:36.569170+0000","last_became_peered":"2023-10-06T11:06:36.569170+0000","last_unstale":"2023-10-06T11:06:36.574139+0000","last_undegraded":"2023-10-06T11:06:36.574139+0000","last_fullsized":"2023-10-06T11:06:36.574139+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:24:26.471584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.561301+0000","last_change":"2023-10-06T11:06:35.565421+0000","last_active":"2023-10-06T11:06:36.561301+0000","last_peered":"2023-10-06T11:06:36.561301+0000","last_clean":"2023-10-06T11:06:36.561301+0000","last_became_active":"2023-10-06T11:06:35.565160+0000","last_became_peered":"2023-10-06T11:06:35.565160+0000","last_unstale":"2023-10-06T11:06:36.561301+0000","last_undegraded":"2023-10-06T11:06:36.561301+0000","last_fullsized":"2023-10-06T11:06:36.561301+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:21:20.221637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.561540+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:06:36.561540+0000","last_peered":"2023-10-06T11:06:36.561540+0000","last_clean":"2023-10-06T11:06:36.561540+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:06:36.561540+0000","last_undegraded":"2023-10-06T11:06:36.561540+0000","last_fullsized":"2023-10-06T11:06:36.561540+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.580158+0000","last_change":"2023-10-06T11:06:36.577975+0000","last_active":"2023-10-06T11:06:36.580158+0000","last_peered":"2023-10-06T11:06:36.580158+0000","last_clean":"2023-10-06T11:06:36.580158+0000","last_became_active":"2023-10-06T11:06:36.577290+0000","last_became_peered":"2023-10-06T11:06:36.577290+0000","last_unstale":"2023-10-06T11:06:36.580158+0000","last_undegraded":"2023-10-06T11:06:36.580158+0000","last_fullsized":"2023-10-06T11:06:36.580158+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:35.546099+0000","last_clean_scrub_stamp":"2023-10-06T11:06:35.546099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:10:47.800013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.554803+0000","last_change":"2023-10-06T11:06:35.567604+0000","last_active":"2023-10-06T11:06:36.554803+0000","last_peered":"2023-10-06T11:06:36.554803+0000","last_clean":"2023-10-06T11:06:36.554803+0000","last_became_active":"2023-10-06T11:06:35.567290+0000","last_became_peered":"2023-10-06T11:06:35.567290+0000","last_unstale":"2023-10-06T11:06:36.554803+0000","last_undegraded":"2023-10-06T11:06:36.554803+0000","last_fullsized":"2023-10-06T11:06:36.554803+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:06:34.538861+0000","last_clean_scrub_stamp":"2023-10-06T11:06:34.538861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:18:50.646916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":23,"reported_epoch":30,"state":"active+clean","last_fresh":"2023-10-06T11:06:36.561757+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:06:36.561757+0000","last_peered":"2023-10-06T11:06:36.561757+0000","last_clean":"2023-10-06T11:06:36.561757+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:06:36.561757+0000","last_undegraded":"2023-10-06T11:06:36.561757+0000","last_fullsized":"2023-10-06T11:06:36.561757+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073616,"statfs":{"total":96636764160,"available":96331382784,"internally_reserved":0,"allocated":958464,"data_stored":733109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.39300000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.47499999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.496}]},{"osd":3,"last update":"Fri Oct 6 11:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.438}]},{"osd":4,"last update":"Fri Oct 6 11:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.372},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.40699999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.53100000000000003}]},{"osd":6,"last update":"Fri Oct 6 11:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.56000000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297628,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074212,"statfs":{"total":96636764160,"available":96331993088,"internally_reserved":0,"allocated":348160,"data_stored":140336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.55600000000000005}]},{"osd":1,"last update":"Fri Oct 6 11:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.45700000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.52400000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.626},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.64500000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.68300000000000005}]},{"osd":5,"last update":"Fri Oct 6 11:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.71299999999999997}]},{"osd":7,"last update":"Fri Oct 6 11:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.73099999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298212,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073628,"statfs":{"total":96636764160,"available":96331395072,"internally_reserved":0,"allocated":946176,"data_stored":731593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.29299999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.505,"5min":0.505,"15min":0.505},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.375}]},{"osd":3,"last update":"Fri Oct 6 11:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.35399999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.622},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.67300000000000004}]},{"osd":5,"last update":"Fri Oct 6 11:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.51200000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.54300000000000004}]},{"osd":7,"last update":"Fri Oct 6 11:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.61299999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297628,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074212,"statfs":{"total":96636764160,"available":96331993088,"internally_reserved":0,"allocated":348160,"data_stored":139816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:06:40 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"last":0.246}]},{"osd":2,"last update":"Fri Oct 6 11:06:40 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.28299999999999997}]},{"osd":3,"last update":"Fri Oct 6 11:06:40 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.35599999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:06:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.54700000000000004}]},{"osd":5,"last update":"Fri Oct 6 11:06:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.44900000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:06:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.61199999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:06:40 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.498}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297628,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074212,"statfs":{"total":96636764160,"available":96331993088,"internally_reserved":0,"allocated":348160,"data_stored":139852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.309,"5min":0.309,"15min":0.309},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.36399999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.27500000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"last":0.311},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.34999999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.497},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.66100000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.57699999999999996}]},{"osd":6,"last update":"Fri Oct 6 11:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.67600000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:06:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.64900000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297640,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074200,"statfs":{"total":96636764160,"available":96331980800,"internally_reserved":0,"allocated":360448,"data_stored":141352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:06:36 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.34999999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:06:36 2023","interfaces":[{"interface":"back","average":{"1min":0.307,"5min":0.307,"15min":0.307},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.33200000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:06:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.36899999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:06:36 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.694,"5min":1.694,"15min":1.694},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.58499999999999996}]},{"osd":5,"last update":"Fri Oct 6 11:06:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.55600000000000005}]},{"osd":6,"last update":"Fri Oct 6 11:06:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.7470000000000001,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.57499999999999996}]},{"osd":7,"last update":"Fri Oct 6 11:06:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.54100000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297636,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074204,"statfs":{"total":96636764160,"available":96331984896,"internally_reserved":0,"allocated":356352,"data_stored":141711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":2.6619999999999999,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.71999999999999997}]},{"osd":1,"last update":"Fri Oct 6 11:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":2.8650000000000002,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":2.7610000000000001,"5min":2.7610000000000001,"15min":2.7610000000000001},"last":0.69899999999999995}]},{"osd":2,"last update":"Fri Oct 6 11:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.718,"5min":1.718,"15min":1.718},"last":0.80200000000000005}]},{"osd":3,"last update":"Fri Oct 6 11:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":2.677,"5min":2.677,"15min":2.677},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.57099999999999995}]},{"osd":5,"last update":"Fri Oct 6 11:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.49399999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.54500000000000004}]},{"osd":7,"last update":"Fri Oct 6 11:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.74299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297636,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074204,"statfs":{"total":96636764160,"available":96331984896,"internally_reserved":0,"allocated":356352,"data_stored":141247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":5.0490000000000004,"5min":5.0490000000000004,"15min":5.0490000000000004},"last":0.624},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":5.1449999999999996,"5min":5.1449999999999996,"15min":5.1449999999999996},"last":0.45600000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.53800000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.71699999999999997}]},{"osd":3,"last update":"Fri Oct 6 11:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":5.2169999999999996,"5min":5.2169999999999996,"15min":5.2169999999999996},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.51300000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.436},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.56100000000000005}]},{"osd":6,"last update":"Fri Oct 6 11:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.68300000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:06:38 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.75}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:06:45.471 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T11:06:45.471 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T11:06:45.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.625+0000 7f733513e700 1 Processor -- start 2023-10-06T11:06:45.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.625+0000 7f733513e700 1 -- start start 2023-10-06T11:06:45.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.626+0000 7f733513e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7330159f60 0x7f73300c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:45.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.626+0000 7f733513e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f73300b35f0 0x7f73300b3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:45.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.626+0000 7f733513e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73300b3f90 con 0x7f73300cc760 2023-10-06T11:06:45.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.626+0000 7f733513e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73300b3260 con 0x7f73300b35f0 2023-10-06T11:06:45.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.626+0000 7f733513e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73300c5c20 con 0x7f7330159f60 2023-10-06T11:06:45.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.626+0000 7f732f59e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f73300b35f0 0x7f73300b3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:45.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.626+0000 7f732f59e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f73300b35f0 0x7f73300b3a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39904/0 (socket says 172.21.15.146:39904) 2023-10-06T11:06:45.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.626+0000 7f732f59e700 1 -- 172.21.15.146:0/1542330530 learned_addr learned my addr 172.21.15.146:0/1542330530 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:45.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.626+0000 7f732ed9d700 1 --2- 172.21.15.146:0/1542330530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7330159f60 0x7f73300c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:45.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.626+0000 7f732f59e700 1 -- 172.21.15.146:0/1542330530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7330159f60 msgr2=0x7f73300c55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:45.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.626+0000 7f732f59e700 1 --2- 172.21.15.146:0/1542330530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7330159f60 0x7f73300c55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:45.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.626+0000 7f732f59e700 1 -- 172.21.15.146:0/1542330530 >> v1:172.21.15.151:6789/0 conn(0x7f73300cc760 legacy=0x7f73300c6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:45.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.627+0000 7f732f59e700 1 -- 172.21.15.146:0/1542330530 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73300c5f00 con 0x7f73300b35f0 2023-10-06T11:06:45.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.627+0000 7f732f59e700 1 --2- 172.21.15.146:0/1542330530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73300b35f0 0x7f73300b3a50 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7328009f20 tx=0x7f7328009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3336cd6558f307ac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:45.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.627+0000 7f732e59c700 1 -- 172.21.15.146:0/1542330530 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732800e070 con 0x7f73300b35f0 2023-10-06T11:06:45.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.627+0000 7f732e59c700 1 -- 172.21.15.146:0/1542330530 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f732800ba40 con 0x7f73300b35f0 2023-10-06T11:06:45.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.627+0000 7f732e59c700 1 -- 172.21.15.146:0/1542330530 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73280092e0 con 0x7f73300b35f0 2023-10-06T11:06:45.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.627+0000 7f733513e700 1 -- 172.21.15.146:0/1542330530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73300b35f0 msgr2=0x7f73300b3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:45.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.627+0000 7f733513e700 1 --2- 172.21.15.146:0/1542330530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73300b35f0 0x7f73300b3a50 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7328009f20 tx=0x7f7328009840 comp rx=0 tx=0).stop 2023-10-06T11:06:45.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.627+0000 7f733513e700 1 -- 172.21.15.146:0/1542330530 shutdown_connections 2023-10-06T11:06:45.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.627+0000 7f733513e700 1 --2- 172.21.15.146:0/1542330530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f73300b35f0 0x7f73300b3a50 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:45.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.627+0000 7f733513e700 1 --2- 172.21.15.146:0/1542330530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7330159f60 0x7f73300c55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:45.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.627+0000 7f733513e700 1 -- 172.21.15.146:0/1542330530 >> 172.21.15.146:0/1542330530 conn(0x7f733006f380 msgr2=0x7f73300d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:45.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.627+0000 7f733513e700 1 -- 172.21.15.146:0/1542330530 shutdown_connections 2023-10-06T11:06:45.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.627+0000 7f733513e700 1 -- 172.21.15.146:0/1542330530 wait complete. 2023-10-06T11:06:45.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.629+0000 7f733513e700 1 Processor -- start 2023-10-06T11:06:45.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.629+0000 7f733513e700 1 -- start start 2023-10-06T11:06:45.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.629+0000 7f733513e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f73300b35f0 0x7f73300c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:45.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.629+0000 7f733513e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f73300cc760 0x7f7330154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:45.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.629+0000 7f733513e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7330159f60 0x7f733015cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:45.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.629+0000 7f733513e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73300c7e20 con 0x7f7330159f60 2023-10-06T11:06:45.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.629+0000 7f733513e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733015c650 con 0x7f73300b35f0 2023-10-06T11:06:45.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.629+0000 7f733513e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7330155500 con 0x7f73300cc760 2023-10-06T11:06:45.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.629+0000 7f732f59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7330159f60 0x7f733015cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:45.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.629+0000 7f732f59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7330159f60 0x7f733015cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39920/0 (socket says 172.21.15.146:39920) 2023-10-06T11:06:45.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.629+0000 7f732f59e700 1 -- 172.21.15.146:0/4112809415 learned_addr learned my addr 172.21.15.146:0/4112809415 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:45.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.630+0000 7f732ed9d700 1 --2- 172.21.15.146:0/4112809415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f73300b35f0 0x7f73300c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:45.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.630+0000 7f732659c700 1 --2- 172.21.15.146:0/4112809415 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f73300cc760 0x7f7330154fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:45.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.630+0000 7f732f59e700 1 -- 172.21.15.146:0/4112809415 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f73300cc760 msgr2=0x7f7330154fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:45.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.630+0000 7f732f59e700 1 --2- 172.21.15.146:0/4112809415 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f73300cc760 0x7f7330154fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:45.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.630+0000 7f732f59e700 1 -- 172.21.15.146:0/4112809415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f73300b35f0 msgr2=0x7f73300c78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:45.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.630+0000 7f732f59e700 1 --2- 172.21.15.146:0/4112809415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f73300b35f0 0x7f73300c78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:45.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.630+0000 7f732f59e700 1 -- 172.21.15.146:0/4112809415 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7328009ae0 con 0x7f7330159f60 2023-10-06T11:06:45.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.630+0000 7f732659c700 1 --2- 172.21.15.146:0/4112809415 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f73300cc760 0x7f7330154fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:06:45.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.630+0000 7f732f59e700 1 --2- 172.21.15.146:0/4112809415 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7330159f60 0x7f733015cae0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7330068160 tx=0x7f7328017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:45.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.630+0000 7f73277fe700 1 -- 172.21.15.146:0/4112809415 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73280032f0 con 0x7f7330159f60 2023-10-06T11:06:45.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.630+0000 7f73277fe700 1 -- 172.21.15.146:0/4112809415 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7328012db0 con 0x7f7330159f60 2023-10-06T11:06:45.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.630+0000 7f733513e700 1 -- 172.21.15.146:0/4112809415 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f733015ba40 con 0x7f7330159f60 2023-10-06T11:06:45.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.630+0000 7f73277fe700 1 -- 172.21.15.146:0/4112809415 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732801d670 con 0x7f7330159f60 2023-10-06T11:06:45.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.630+0000 7f733513e700 1 -- 172.21.15.146:0/4112809415 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f733015c000 con 0x7f7330159f60 2023-10-06T11:06:45.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.631+0000 7f733513e700 1 -- 172.21.15.146:0/4112809415 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7330068390 con 0x7f7330159f60 2023-10-06T11:06:45.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.631+0000 7f73277fe700 1 -- 172.21.15.146:0/4112809415 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f732801da60 con 0x7f7330159f60 2023-10-06T11:06:45.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.632+0000 7f73277fe700 1 --2- 172.21.15.146:0/4112809415 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7310066f30 0x7f73100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:45.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.632+0000 7f73277fe700 1 -- 172.21.15.146:0/4112809415 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7328085f60 con 0x7f7330159f60 2023-10-06T11:06:45.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.632+0000 7f732ed9d700 1 --2- 172.21.15.146:0/4112809415 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7310066f30 0x7f73100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:45.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.632+0000 7f732ed9d700 1 --2- 172.21.15.146:0/4112809415 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7310066f30 0x7f73100693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f732000ac00 tx=0x7f7320008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:45.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.636+0000 7f73277fe700 1 -- 172.21.15.146:0/4112809415 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7328053070 con 0x7f7330159f60 2023-10-06T11:06:45.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.894+0000 7f733513e700 1 -- 172.21.15.146:0/4112809415 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f733004c380 con 0x7f7330159f60 2023-10-06T11:06:45.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.898+0000 7f73277fe700 1 -- 172.21.15.146:0/4112809415 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7f7328009420 con 0x7f7330159f60 2023-10-06T11:06:45.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.900+0000 7f733513e700 1 -- 172.21.15.146:0/4112809415 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7310066f30 msgr2=0x7f73100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:45.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.900+0000 7f733513e700 1 --2- 172.21.15.146:0/4112809415 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7310066f30 0x7f73100693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f732000ac00 tx=0x7f7320008040 comp rx=0 tx=0).stop 2023-10-06T11:06:45.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.900+0000 7f733513e700 1 -- 172.21.15.146:0/4112809415 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7330159f60 msgr2=0x7f733015cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:45.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.900+0000 7f733513e700 1 --2- 172.21.15.146:0/4112809415 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7330159f60 0x7f733015cae0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7330068160 tx=0x7f7328017000 comp rx=0 tx=0).stop 2023-10-06T11:06:45.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.900+0000 7f733513e700 1 -- 172.21.15.146:0/4112809415 shutdown_connections 2023-10-06T11:06:45.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.900+0000 7f733513e700 1 --2- 172.21.15.146:0/4112809415 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7310066f30 0x7f73100693e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:45.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.900+0000 7f733513e700 1 --2- 172.21.15.146:0/4112809415 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7330159f60 0x7f733015cae0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:45.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.900+0000 7f733513e700 1 --2- 172.21.15.146:0/4112809415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f73300b35f0 0x7f73300c78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:45.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.900+0000 7f733513e700 1 --2- 172.21.15.146:0/4112809415 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f73300cc760 0x7f7330154fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:45.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.900+0000 7f733513e700 1 -- 172.21.15.146:0/4112809415 >> 172.21.15.146:0/4112809415 conn(0x7f733006f380 msgr2=0x7f7330068550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:45.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.901+0000 7f733513e700 1 -- 172.21.15.146:0/4112809415 shutdown_connections 2023-10-06T11:06:45.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:45.901+0000 7f733513e700 1 -- 172.21.15.146:0/4112809415 wait complete. 2023-10-06T11:06:45.904 INFO:teuthology.orchestra.run.smithi146.stderr:updated caps for client.0 2023-10-06T11:06:45.914 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:06:46.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.027+0000 7f6aa343c700 1 Processor -- start 2023-10-06T11:06:46.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.027+0000 7f6aa343c700 1 -- start start 2023-10-06T11:06:46.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.028+0000 7f6aa343c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6a9c1664c0 0x7f6a9c06b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:46.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.028+0000 7f6aa343c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a9c06b460 con 0x7f6a9c0af5b0 2023-10-06T11:06:46.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.028+0000 7f6aa343c700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a9c06a850 con 0x7f6a9c0af1e0 2023-10-06T11:06:46.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.028+0000 7f6aa343c700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a9c06be30 con 0x7f6a9c1664c0 2023-10-06T11:06:46.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.028+0000 7f6aa09d7700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6a9c0af5b0 0x7f6a9c165db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38680/0 (socket says 172.21.15.146:38680) 2023-10-06T11:06:46.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.028+0000 7f6aa09d7700 1 -- 172.21.15.146:0/1713793551 learned_addr learned my addr 172.21.15.146:0/1713793551 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:06:46.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.028+0000 7f6aa19d9700 1 --2- 172.21.15.146:0/1713793551 >> v2:172.21.15.151:3300/0 conn(0x7f6a9c1664c0 0x7f6a9c06b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:46.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.028+0000 7f6a93fff700 1 -- 172.21.15.146:0/1713793551 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2116277693 0 0) 0x7f6a9c06b460 con 0x7f6a9c0af5b0 2023-10-06T11:06:46.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.048+0000 7f6a93fff700 1 -- 172.21.15.146:0/1713793551 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a88003570 con 0x7f6a9c0af5b0 2023-10-06T11:06:46.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.048+0000 7f6a93fff700 1 -- 172.21.15.146:0/1713793551 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1323523308 0 0) 0x7f6a9c06a850 con 0x7f6a9c0af1e0 2023-10-06T11:06:46.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.048+0000 7f6a93fff700 1 -- 172.21.15.146:0/1713793551 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a9c06b460 con 0x7f6a9c0af1e0 2023-10-06T11:06:46.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.048+0000 7f6a93fff700 1 -- 172.21.15.146:0/1713793551 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3251457579 0 0) 0x7f6a88003570 con 0x7f6a9c0af5b0 2023-10-06T11:06:46.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.048+0000 7f6a93fff700 1 -- 172.21.15.146:0/1713793551 >> v2:172.21.15.151:3300/0 conn(0x7f6a9c1664c0 msgr2=0x7f6a9c06b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:46.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.048+0000 7f6a93fff700 1 --2- 172.21.15.146:0/1713793551 >> v2:172.21.15.151:3300/0 conn(0x7f6a9c1664c0 0x7f6a9c06b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:46.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.048+0000 7f6a93fff700 1 -- 172.21.15.146:0/1713793551 >> v1:172.21.15.151:6789/0 conn(0x7f6a9c0af1e0 legacy=0x7f6a9c0b1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:46.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.048+0000 7f6a93fff700 1 -- 172.21.15.146:0/1713793551 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a9c06ab30 con 0x7f6a9c0af5b0 2023-10-06T11:06:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.048+0000 7f6a93fff700 1 -- 172.21.15.146:0/1713793551 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f6a8c001470 con 0x7f6a9c0af5b0 2023-10-06T11:06:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.048+0000 7f6a93fff700 1 -- 172.21.15.146:0/1713793551 >> v1:172.21.15.146:6789/0 conn(0x7f6a9c0af5b0 legacy=0x7f6a9c165db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.048+0000 7f6a93fff700 1 --2- 172.21.15.146:0/1713793551 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a88008260 0x7f6a8800a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.048+0000 7f6a93fff700 1 --2- 172.21.15.146:0/1713793551 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a8800acd0 0x7f6a8800d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.048+0000 7f6a93fff700 1 --2- 172.21.15.146:0/1713793551 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a8800d7c0 0x7f6a8800fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.048+0000 7f6a93fff700 1 -- 172.21.15.146:0/1713793551 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c06be30 con 0x7f6a8800d7c0 2023-10-06T11:06:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.048+0000 7f6a93fff700 1 -- 172.21.15.146:0/1713793551 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a880104b0 con 0x7f6a88008260 2023-10-06T11:06:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.048+0000 7f6a93fff700 1 -- 172.21.15.146:0/1713793551 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a88010670 con 0x7f6a8800acd0 2023-10-06T11:06:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.048+0000 7f6aa19d9700 1 --2- 172.21.15.146:0/1713793551 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a8800d7c0 0x7f6a8800fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.048+0000 7f6aa09d7700 1 --2- 172.21.15.146:0/1713793551 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a8800acd0 0x7f6a8800d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.048+0000 7f6aa11d8700 1 --2- 172.21.15.146:0/1713793551 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a88008260 0x7f6a8800a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.048+0000 7f6aa19d9700 1 -- 172.21.15.146:0/1713793551 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a8800acd0 msgr2=0x7f6a8800d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.048+0000 7f6aa19d9700 1 --2- 172.21.15.146:0/1713793551 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a8800acd0 0x7f6a8800d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.048+0000 7f6aa19d9700 1 -- 172.21.15.146:0/1713793551 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a88008260 msgr2=0x7f6a8800a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.048+0000 7f6aa19d9700 1 --2- 172.21.15.146:0/1713793551 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a88008260 0x7f6a8800a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.048+0000 7f6aa19d9700 1 -- 172.21.15.146:0/1713793551 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a88003570 con 0x7f6a8800d7c0 2023-10-06T11:06:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.048+0000 7f6aa09d7700 1 --2- 172.21.15.146:0/1713793551 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a8800acd0 0x7f6a8800d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:06:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.048+0000 7f6aa11d8700 1 --2- 172.21.15.146:0/1713793551 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a88008260 0x7f6a8800a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:06:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.048+0000 7f6aa19d9700 1 -- 172.21.15.146:0/1713793551 reap_dead start 2023-10-06T11:06:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.048+0000 7f6aa19d9700 1 --2- 172.21.15.146:0/1713793551 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a8800d7c0 0x7f6a8800fc70 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6a94009c00 tx=0x7f6a94008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53493dcc0dcc9cff server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.048+0000 7f6a93fff700 1 -- 172.21.15.146:0/1713793551 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9400f8b0 con 0x7f6a8800d7c0 2023-10-06T11:06:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.048+0000 7f6a93fff700 1 -- 172.21.15.146:0/1713793551 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a9400fa10 con 0x7f6a8800d7c0 2023-10-06T11:06:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.048+0000 7f6a93fff700 1 -- 172.21.15.146:0/1713793551 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9400fdd0 con 0x7f6a8800d7c0 2023-10-06T11:06:46.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.049+0000 7f6aa343c700 1 -- 172.21.15.146:0/1713793551 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a8800d7c0 msgr2=0x7f6a8800fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:46.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.049+0000 7f6aa343c700 1 --2- 172.21.15.146:0/1713793551 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a8800d7c0 0x7f6a8800fc70 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6a94009c00 tx=0x7f6a94008040 comp rx=0 tx=0).stop 2023-10-06T11:06:46.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.049+0000 7f6aa343c700 1 -- 172.21.15.146:0/1713793551 shutdown_connections 2023-10-06T11:06:46.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.049+0000 7f6aa343c700 1 --2- 172.21.15.146:0/1713793551 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a8800d7c0 0x7f6a8800fc70 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:46.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.049+0000 7f6aa343c700 1 -- 172.21.15.146:0/1713793551 >> 172.21.15.146:0/1713793551 conn(0x7f6a9c0cc260 msgr2=0x7f6a9c0cc660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:46.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.049+0000 7f6aa343c700 1 -- 172.21.15.146:0/1713793551 shutdown_connections 2023-10-06T11:06:46.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.049+0000 7f6aa343c700 1 -- 172.21.15.146:0/1713793551 wait complete. 2023-10-06T11:06:46.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.050+0000 7f6aa343c700 1 Processor -- start 2023-10-06T11:06:46.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.050+0000 7f6aa343c700 1 -- start start 2023-10-06T11:06:46.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.051+0000 7f6aa343c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a8800d7c0 0x7f6a9c06e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:46.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.051+0000 7f6aa343c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a9c06ec70 0x7f6a9c1768e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:46.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.051+0000 7f6aa343c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a9c176e20 0x7f6a9c0aaca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:46.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.051+0000 7f6aa343c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c177270 con 0x7f6a9c176e20 2023-10-06T11:06:46.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.051+0000 7f6aa343c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c06e2a0 con 0x7f6a8800d7c0 2023-10-06T11:06:46.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.051+0000 7f6aa343c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c16b990 con 0x7f6a9c06ec70 2023-10-06T11:06:46.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.051+0000 7f6aa19d9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a9c176e20 0x7f6a9c0aaca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:46.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.051+0000 7f6aa19d9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a9c176e20 0x7f6a9c0aaca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39928/0 (socket says 172.21.15.146:39928) 2023-10-06T11:06:46.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.051+0000 7f6aa19d9700 1 -- 172.21.15.146:0/2537621083 learned_addr learned my addr 172.21.15.146:0/2537621083 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:46.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.051+0000 7f6aa11d8700 1 --2- 172.21.15.146:0/2537621083 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a8800d7c0 0x7f6a9c06e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:46.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.051+0000 7f6aa09d7700 1 --2- 172.21.15.146:0/2537621083 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a9c06ec70 0x7f6a9c1768e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:46.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.051+0000 7f6aa19d9700 1 -- 172.21.15.146:0/2537621083 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a9c06ec70 msgr2=0x7f6a9c1768e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:46.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.051+0000 7f6aa19d9700 1 --2- 172.21.15.146:0/2537621083 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a9c06ec70 0x7f6a9c1768e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:46.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.051+0000 7f6aa19d9700 1 -- 172.21.15.146:0/2537621083 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a8800d7c0 msgr2=0x7f6a9c06e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:46.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.051+0000 7f6aa19d9700 1 --2- 172.21.15.146:0/2537621083 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a8800d7c0 0x7f6a9c06e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:46.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.051+0000 7f6aa19d9700 1 -- 172.21.15.146:0/2537621083 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a9c06d6d0 con 0x7f6a9c176e20 2023-10-06T11:06:46.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.051+0000 7f6aa19d9700 1 --2- 172.21.15.146:0/2537621083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a9c176e20 0x7f6a9c0aaca0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c0a7250 tx=0x7f6a94019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:46.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.051+0000 7f6a917fa700 1 -- 172.21.15.146:0/2537621083 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a94020070 con 0x7f6a9c176e20 2023-10-06T11:06:46.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.051+0000 7f6a917fa700 1 -- 172.21.15.146:0/2537621083 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a94011e50 con 0x7f6a9c176e20 2023-10-06T11:06:46.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.051+0000 7f6aa343c700 1 -- 172.21.15.146:0/2537621083 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a9c06d970 con 0x7f6a9c176e20 2023-10-06T11:06:46.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.051+0000 7f6a917fa700 1 -- 172.21.15.146:0/2537621083 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9400f8b0 con 0x7f6a9c176e20 2023-10-06T11:06:46.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.051+0000 7f6aa343c700 1 -- 172.21.15.146:0/2537621083 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a9c06df30 con 0x7f6a9c176e20 2023-10-06T11:06:46.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.052+0000 7f6aa343c700 1 -- 172.21.15.146:0/2537621083 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a9c04c380 con 0x7f6a9c176e20 2023-10-06T11:06:46.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.053+0000 7f6a917fa700 1 -- 172.21.15.146:0/2537621083 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6a94024070 con 0x7f6a9c176e20 2023-10-06T11:06:46.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.053+0000 7f6a917fa700 1 --2- 172.21.15.146:0/2537621083 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6a80066f60 0x7f6a80069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:46.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.053+0000 7f6a917fa700 1 -- 172.21.15.146:0/2537621083 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6a94015030 con 0x7f6a9c176e20 2023-10-06T11:06:46.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.053+0000 7f6aa11d8700 1 --2- 172.21.15.146:0/2537621083 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6a80066f60 0x7f6a80069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:46.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.054+0000 7f6aa11d8700 1 --2- 172.21.15.146:0/2537621083 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6a80066f60 0x7f6a80069410 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6a98007fd0 tx=0x7f6a9800c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:46.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.057+0000 7f6a917fa700 1 -- 172.21.15.146:0/2537621083 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a94052c40 con 0x7f6a9c176e20 2023-10-06T11:06:46.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.282+0000 7f6aa343c700 1 -- 172.21.15.146:0/2537621083 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a9c0b03a0 con 0x7f6a9c176e20 2023-10-06T11:06:46.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.283+0000 7f6a917fa700 1 -- 172.21.15.146:0/2537621083 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4609 (secure 0 0 0) 0x7f6a9400c090 con 0x7f6a9c176e20 2023-10-06T11:06:46.336 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:06:46.336 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4673,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/1243531288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1243531288},{"type":"v1","addr":"172.21.15.151:6834","nonce":1243531288}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4676,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/4009288357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":4009288357},{"type":"v1","addr":"172.21.15.151:6835","nonce":4009288357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4983,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2777930290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2777930290},{"type":"v1","addr":"172.21.15.146:6836","nonce":2777930290}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:06:35.935256+0000","modified":"2023-10-06T11:06:39.571293+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4986},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4986":{"gid":4986,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/4187213529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":4187213529},{"type":"v1","addr":"172.21.15.146:6837","nonce":4187213529}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T11:06:46.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.285+0000 7f6aa343c700 1 -- 172.21.15.146:0/2537621083 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6a80066f60 msgr2=0x7f6a80069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:46.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.285+0000 7f6aa343c700 1 --2- 172.21.15.146:0/2537621083 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6a80066f60 0x7f6a80069410 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6a98007fd0 tx=0x7f6a9800c040 comp rx=0 tx=0).stop 2023-10-06T11:06:46.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.285+0000 7f6aa343c700 1 -- 172.21.15.146:0/2537621083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a9c176e20 msgr2=0x7f6a9c0aaca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:46.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.285+0000 7f6aa343c700 1 --2- 172.21.15.146:0/2537621083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a9c176e20 0x7f6a9c0aaca0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c0a7250 tx=0x7f6a94019000 comp rx=0 tx=0).stop 2023-10-06T11:06:46.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.285+0000 7f6aa343c700 1 -- 172.21.15.146:0/2537621083 shutdown_connections 2023-10-06T11:06:46.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.285+0000 7f6aa343c700 1 --2- 172.21.15.146:0/2537621083 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6a80066f60 0x7f6a80069410 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:46.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.285+0000 7f6aa343c700 1 --2- 172.21.15.146:0/2537621083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6a9c176e20 0x7f6a9c0aaca0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:46.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.285+0000 7f6aa343c700 1 --2- 172.21.15.146:0/2537621083 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a8800d7c0 0x7f6a9c06e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:46.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.285+0000 7f6aa343c700 1 --2- 172.21.15.146:0/2537621083 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6a9c06ec70 0x7f6a9c1768e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:46.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.285+0000 7f6aa343c700 1 -- 172.21.15.146:0/2537621083 >> 172.21.15.146:0/2537621083 conn(0x7f6a9c0cc260 msgr2=0x7f6a9c098db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:46.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.285+0000 7f6aa343c700 1 -- 172.21.15.146:0/2537621083 shutdown_connections 2023-10-06T11:06:46.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.285+0000 7f6aa343c700 1 -- 172.21.15.146:0/2537621083 wait complete. 2023-10-06T11:06:46.339 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 16 2023-10-06T11:06:46.743 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T11:06:35.935256+0000', 'modified': '2023-10-06T11:06:39.571293+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4986}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4986': {'gid': 4986, 'name': 'c', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.146:6837/4187213529', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6835', 'nonce': 4187213529}, {'type': 'v1', 'addr': '172.21.15.146:6837', 'nonce': 4187213529}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T11:06:46.743 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T11:06:46.743 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T11:06:46.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.858+0000 7f7f11e2b700 1 Processor -- start 2023-10-06T11:06:46.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.858+0000 7f7f11e2b700 1 -- start start 2023-10-06T11:06:46.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.859+0000 7f7f11e2b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7f0c0b3cf0 0x7f7f0c0ce860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:46.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.859+0000 7f7f11e2b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f0c0b2430 0x7f7f0c0b5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:46.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.859+0000 7f7f11e2b700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f0c0b4ec0 con 0x7f7f0c0b2060 2023-10-06T11:06:46.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.859+0000 7f7f11e2b700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f0c0cd470 con 0x7f7f0c0b3cf0 2023-10-06T11:06:46.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.859+0000 7f7f11e2b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c0b42b0 con 0x7f7f0c0b2430 2023-10-06T11:06:46.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.859+0000 7f7f0bfff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7f0c0b3cf0 0x7f7f0c0ce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:46.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.859+0000 7f7f1162a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f0c0b2430 0x7f7f0c0b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:46.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.859+0000 7f7f0bfff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7f0c0b3cf0 0x7f7f0c0ce860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:33674/0 (socket says 172.21.15.146:33674) 2023-10-06T11:06:46.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.859+0000 7f7f1162a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f0c0b2430 0x7f7f0c0b5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:42182/0 (socket says 172.21.15.146:42182) 2023-10-06T11:06:46.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.859+0000 7f7f0bfff700 1 -- 172.21.15.146:0/601258250 learned_addr learned my addr 172.21.15.146:0/601258250 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:46.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.859+0000 7f7f10e29700 1 --1- 172.21.15.146:0/601258250 >> v1:172.21.15.151:6789/0 conn(0x7f7f0c0b2060 0x7f7f0c0ccd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:58554/0 (socket says 172.21.15.146:58554) 2023-10-06T11:06:46.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.859+0000 7f7f1162a700 1 -- 172.21.15.146:0/601258250 >> v2:172.21.15.151:3300/0 conn(0x7f7f0c0b3cf0 msgr2=0x7f7f0c0ce860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:46.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.859+0000 7f7f1162a700 1 --2- 172.21.15.146:0/601258250 >> v2:172.21.15.151:3300/0 conn(0x7f7f0c0b3cf0 0x7f7f0c0ce860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:46.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.859+0000 7f7f1162a700 1 -- 172.21.15.146:0/601258250 >> v1:172.21.15.151:6789/0 conn(0x7f7f0c0b2060 legacy=0x7f7f0c0ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:46.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.859+0000 7f7f1162a700 1 -- 172.21.15.146:0/601258250 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f0c0b4590 con 0x7f7f0c0b2430 2023-10-06T11:06:46.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.859+0000 7f7f0bfff700 1 --2- 172.21.15.146:0/601258250 >> v2:172.21.15.151:3300/0 conn(0x7f7f0c0b3cf0 0x7f7f0c0ce860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:06:46.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.860+0000 7f7f1162a700 1 --2- 172.21.15.146:0/601258250 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f0c0b2430 0x7f7f0c0b5350 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7ef40098e0 tx=0x7f7ef40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec4810842d4c16a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:46.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.860+0000 7f7f0b7fe700 1 -- 172.21.15.146:0/601258250 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef400b640 con 0x7f7f0c0b2430 2023-10-06T11:06:46.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.860+0000 7f7f0b7fe700 1 -- 172.21.15.146:0/601258250 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef400b7a0 con 0x7f7f0c0b2430 2023-10-06T11:06:46.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.860+0000 7f7f0b7fe700 1 -- 172.21.15.146:0/601258250 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef400bb40 con 0x7f7f0c0b2430 2023-10-06T11:06:46.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.860+0000 7f7f11e2b700 1 -- 172.21.15.146:0/601258250 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f0c0b2430 msgr2=0x7f7f0c0b5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:46.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.860+0000 7f7f11e2b700 1 --2- 172.21.15.146:0/601258250 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f0c0b2430 0x7f7f0c0b5350 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7ef40098e0 tx=0x7f7ef40091a0 comp rx=0 tx=0).stop 2023-10-06T11:06:46.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.860+0000 7f7f11e2b700 1 -- 172.21.15.146:0/601258250 shutdown_connections 2023-10-06T11:06:46.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.860+0000 7f7f11e2b700 1 --2- 172.21.15.146:0/601258250 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f0c0b2430 0x7f7f0c0b5350 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:46.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.860+0000 7f7f11e2b700 1 --2- 172.21.15.146:0/601258250 >> v2:172.21.15.151:3300/0 conn(0x7f7f0c0b3cf0 0x7f7f0c0ce860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:46.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.860+0000 7f7f11e2b700 1 -- 172.21.15.146:0/601258250 >> 172.21.15.146:0/601258250 conn(0x7f7f0c06eba0 msgr2=0x7f7f0c06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:46.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.860+0000 7f7f11e2b700 1 -- 172.21.15.146:0/601258250 shutdown_connections 2023-10-06T11:06:46.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.860+0000 7f7f11e2b700 1 -- 172.21.15.146:0/601258250 wait complete. 2023-10-06T11:06:46.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.861+0000 7f7f11e2b700 1 Processor -- start 2023-10-06T11:06:46.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.862+0000 7f7f11e2b700 1 -- start start 2023-10-06T11:06:46.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.862+0000 7f7f11e2b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f0c0b2060 0x7f7f0c06d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:46.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.862+0000 7f7f11e2b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f0c0b2430 0x7f7f0c157660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:46.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.862+0000 7f7f11e2b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f0c0b3cf0 0x7f7f0c14b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:46.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.862+0000 7f7f11e2b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c1726a0 con 0x7f7f0c0b2060 2023-10-06T11:06:46.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.862+0000 7f7f11e2b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c1723c0 con 0x7f7f0c0b2430 2023-10-06T11:06:46.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.862+0000 7f7f11e2b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c15a640 con 0x7f7f0c0b3cf0 2023-10-06T11:06:46.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.863+0000 7f7f10e29700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f0c0b2060 0x7f7f0c06d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:46.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.863+0000 7f7f10e29700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f0c0b2060 0x7f7f0c06d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39938/0 (socket says 172.21.15.146:39938) 2023-10-06T11:06:46.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.863+0000 7f7f10e29700 1 -- 172.21.15.146:0/290334062 learned_addr learned my addr 172.21.15.146:0/290334062 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:46.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.863+0000 7f7f0bfff700 1 --2- 172.21.15.146:0/290334062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f0c0b2430 0x7f7f0c157660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:46.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.863+0000 7f7f1162a700 1 --2- 172.21.15.146:0/290334062 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f0c0b3cf0 0x7f7f0c14b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:46.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.863+0000 7f7f10e29700 1 -- 172.21.15.146:0/290334062 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f0c0b3cf0 msgr2=0x7f7f0c14b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:46.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.863+0000 7f7f10e29700 1 --2- 172.21.15.146:0/290334062 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f0c0b3cf0 0x7f7f0c14b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:46.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.863+0000 7f7f10e29700 1 -- 172.21.15.146:0/290334062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f0c0b2430 msgr2=0x7f7f0c157660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:46.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.863+0000 7f7f10e29700 1 --2- 172.21.15.146:0/290334062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f0c0b2430 0x7f7f0c157660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:46.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.863+0000 7f7f10e29700 1 -- 172.21.15.146:0/290334062 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7efc0094f0 con 0x7f7f0c0b2060 2023-10-06T11:06:46.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.863+0000 7f7f10e29700 1 --2- 172.21.15.146:0/290334062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f0c0b2060 0x7f7f0c06d0b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7f0400cd80 tx=0x7f7f04001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:46.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.863+0000 7f7f08ff9700 1 -- 172.21.15.146:0/290334062 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f04005df0 con 0x7f7f0c0b2060 2023-10-06T11:06:46.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.863+0000 7f7f08ff9700 1 -- 172.21.15.146:0/290334062 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0400a960 con 0x7f7f0c0b2060 2023-10-06T11:06:46.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.863+0000 7f7f11e2b700 1 -- 172.21.15.146:0/290334062 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef4009420 con 0x7f7f0c0b2060 2023-10-06T11:06:46.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.863+0000 7f7f08ff9700 1 -- 172.21.15.146:0/290334062 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0400ad20 con 0x7f7f0c0b2060 2023-10-06T11:06:46.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.863+0000 7f7f11e2b700 1 -- 172.21.15.146:0/290334062 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f0c15ac00 con 0x7f7f0c0b2060 2023-10-06T11:06:46.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.865+0000 7f7f08ff9700 1 -- 172.21.15.146:0/290334062 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7f04007300 con 0x7f7f0c0b2060 2023-10-06T11:06:46.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.865+0000 7f7f08ff9700 1 --2- 172.21.15.146:0/290334062 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7eec066f30 0x7f7eec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:46.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.865+0000 7f7f08ff9700 1 -- 172.21.15.146:0/290334062 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7f040848e0 con 0x7f7f0c0b2060 2023-10-06T11:06:46.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.865+0000 7f7f0bfff700 1 --2- 172.21.15.146:0/290334062 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7eec066f30 0x7f7eec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:46.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.865+0000 7f7f0bfff700 1 --2- 172.21.15.146:0/290334062 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7eec066f30 0x7f7eec0693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c0cdc00 tx=0x7f7efc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:46.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.867+0000 7f7f1c385b80 1 Processor -- start 2023-10-06T11:06:46.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.867+0000 7f7f1c385b80 1 -- start start 2023-10-06T11:06:46.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.867+0000 7f7f1c385b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560afb06f950 0x560afb06fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:46.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.867+0000 7f7f1c385b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560afb0b9bc0 0x560afb098920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:46.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.867+0000 7f7f1c385b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560afb098e60 0x560afb06b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:46.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.867+0000 7f7f1c385b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x560afafefc80 con 0x560afb0b9bc0 2023-10-06T11:06:46.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.867+0000 7f7f1c385b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x560afafc6a70 con 0x560afb098e60 2023-10-06T11:06:46.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.867+0000 7f7f1c385b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x560afafc4270 con 0x560afb06f950 2023-10-06T11:06:46.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.868+0000 7f7f0bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560afb0b9bc0 0x560afb098920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:46.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.868+0000 7f7f0bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560afb0b9bc0 0x560afb098920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39940/0 (socket says 172.21.15.146:39940) 2023-10-06T11:06:46.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.868+0000 7f7f0bfff700 1 -- 172.21.15.146:0/3363959023 learned_addr learned my addr 172.21.15.146:0/3363959023 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:46.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.868+0000 7f7f1162a700 1 --2- 172.21.15.146:0/3363959023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560afb098e60 0x560afb06b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:46.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.868+0000 7f7f0bfff700 1 -- 172.21.15.146:0/3363959023 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560afb06f950 msgr2=0x560afb06fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:46.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.868+0000 7f7f10e29700 1 --2- 172.21.15.146:0/3363959023 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560afb06f950 0x560afb06fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:46.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.868+0000 7f7f0bfff700 1 --2- 172.21.15.146:0/3363959023 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560afb06f950 0x560afb06fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:46.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.868+0000 7f7f0bfff700 1 -- 172.21.15.146:0/3363959023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560afb098e60 msgr2=0x560afb06b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:46.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.868+0000 7f7f0bfff700 1 --2- 172.21.15.146:0/3363959023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560afb098e60 0x560afb06b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:46.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.868+0000 7f7f0bfff700 1 -- 172.21.15.146:0/3363959023 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560afae5a270 con 0x560afb0b9bc0 2023-10-06T11:06:46.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.868+0000 7f7f0bfff700 1 --2- 172.21.15.146:0/3363959023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560afb0b9bc0 0x560afb098920 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7efc011ec0 tx=0x7f7efc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12d998ae4c07c2ee server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:46.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.868+0000 7f7f01ffb700 1 -- 172.21.15.146:0/3363959023 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc015c60 con 0x560afb0b9bc0 2023-10-06T11:06:46.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.868+0000 7f7f01ffb700 1 -- 172.21.15.146:0/3363959023 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7efc015dc0 con 0x560afb0b9bc0 2023-10-06T11:06:46.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.868+0000 7f7f01ffb700 1 -- 172.21.15.146:0/3363959023 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc021440 con 0x560afb0b9bc0 2023-10-06T11:06:46.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.869+0000 7f7f1c385b80 1 -- 172.21.15.146:0/3363959023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560afb0b9bc0 msgr2=0x560afb098920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:46.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.869+0000 7f7f1c385b80 1 --2- 172.21.15.146:0/3363959023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560afb0b9bc0 0x560afb098920 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7efc011ec0 tx=0x7f7efc018000 comp rx=0 tx=0).stop 2023-10-06T11:06:46.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.869+0000 7f7f1c385b80 1 -- 172.21.15.146:0/3363959023 shutdown_connections 2023-10-06T11:06:46.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.869+0000 7f7f1c385b80 1 --2- 172.21.15.146:0/3363959023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560afb098e60 0x560afb06b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:46.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.869+0000 7f7f1c385b80 1 --2- 172.21.15.146:0/3363959023 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560afb06f950 0x560afb06fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:46.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.869+0000 7f7f1c385b80 1 --2- 172.21.15.146:0/3363959023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560afb0b9bc0 0x560afb098920 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:46.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.869+0000 7f7f1c385b80 1 -- 172.21.15.146:0/3363959023 >> 172.21.15.146:0/3363959023 conn(0x560afb071270 msgr2=0x560afb071640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:46.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.869+0000 7f7f1c385b80 1 -- 172.21.15.146:0/3363959023 shutdown_connections 2023-10-06T11:06:46.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.869+0000 7f7f1c385b80 1 -- 172.21.15.146:0/3363959023 wait complete. 2023-10-06T11:06:46.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.869+0000 7f7f1c385b80 1 -- start start 2023-10-06T11:06:46.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.870+0000 7f7f1c385b80 1 Processor -- start 2023-10-06T11:06:46.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.870+0000 7f7f1c385b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560afb06f950 0x560afb0b0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:46.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.870+0000 7f7f1c385b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560afb098e60 0x560afb095340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:46.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.870+0000 7f7f1c385b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560afb0b9bc0 0x560afb0960c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:46.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.870+0000 7f7f1c385b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x560afafc0060 con 0x560afb098e60 2023-10-06T11:06:46.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.870+0000 7f7f1c385b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x560afaf6b890 con 0x560afb0b9bc0 2023-10-06T11:06:46.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.870+0000 7f7f1c385b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x560afaf86ea0 con 0x560afb06f950 2023-10-06T11:06:46.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.870+0000 7f7f1c385b80 10 client.0 _ll_register_callbacks cb 0x560afae5cf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:06:46.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.870+0000 7f7f0bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560afb098e60 0x560afb095340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:46.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.870+0000 7f7f0bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560afb098e60 0x560afb095340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39952/0 (socket says 172.21.15.146:39952) 2023-10-06T11:06:46.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.870+0000 7f7f0bfff700 1 -- 172.21.15.146:0/1913777862 learned_addr learned my addr 172.21.15.146:0/1913777862 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:46.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.871+0000 7f7f10e29700 1 --2- 172.21.15.146:0/1913777862 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560afb06f950 0x560afb0b0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:46.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.871+0000 7f7f1162a700 1 --2- 172.21.15.146:0/1913777862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560afb0b9bc0 0x560afb0960c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:46.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.871+0000 7f7f0bfff700 1 -- 172.21.15.146:0/1913777862 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560afb06f950 msgr2=0x560afb0b0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:46.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.871+0000 7f7f0bfff700 1 --2- 172.21.15.146:0/1913777862 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560afb06f950 0x560afb0b0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:46.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.871+0000 7f7f0bfff700 1 -- 172.21.15.146:0/1913777862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560afb0b9bc0 msgr2=0x560afb0960c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:46.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.871+0000 7f7f0bfff700 1 --2- 172.21.15.146:0/1913777862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560afb0b9bc0 0x560afb0960c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:46.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.871+0000 7f7f0bfff700 1 -- 172.21.15.146:0/1913777862 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7efc011b20 con 0x560afb098e60 2023-10-06T11:06:46.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.871+0000 7f7f10e29700 1 --2- 172.21.15.146:0/1913777862 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560afb06f950 0x560afb0b0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:06:46.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.871+0000 7f7f1162a700 1 --2- 172.21.15.146:0/1913777862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560afb0b9bc0 0x560afb0960c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:06:46.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.871+0000 7f7f0bfff700 1 --2- 172.21.15.146:0/1913777862 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560afb098e60 0x560afb095340 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7efc023040 tx=0x7f7efc01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=823eea8558342a96 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:46.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.871+0000 7f7eeaffd700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:06:46.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.871+0000 7f7eeaffd700 1 -- 172.21.15.146:0/1913777862 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc015be0 con 0x560afb098e60 2023-10-06T11:06:46.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.871+0000 7f7eeaffd700 1 -- 172.21.15.146:0/1913777862 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7efc031070 con 0x560afb098e60 2023-10-06T11:06:46.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.871+0000 7f7f1c385b80 1 -- 172.21.15.146:0/1913777862 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560afb064690 con 0x560afb098e60 2023-10-06T11:06:46.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.871+0000 7f7eeaffd700 1 -- 172.21.15.146:0/1913777862 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7efc02a820 con 0x560afb098e60 2023-10-06T11:06:46.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.871+0000 7f7f1c385b80 10 client.5223 fetch_fsmap learned FSMap version 16 2023-10-06T11:06:46.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.871+0000 7f7f1c385b80 1 -- 172.21.15.146:0/1913777862 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x560afadfcfe0 con 0x560afb098e60 2023-10-06T11:06:46.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.871+0000 7f7eeaffd700 1 -- 172.21.15.146:0/1913777862 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560afb064690 con 0x560afb098e60 2023-10-06T11:06:46.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.871+0000 7f7eeaffd700 1 -- 172.21.15.146:0/1913777862 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 16) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f7efc02a980 con 0x560afb098e60 2023-10-06T11:06:46.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.871+0000 7f7f1c385b80 10 client.5223 fetch_fsmap finished waiting for FSMap version 16 2023-10-06T11:06:46.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.871+0000 7f7f1c385b80 10 client.5223 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T11:06:46.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.871+0000 7f7f1c385b80 20 client.5223 populate_metadata read hostname 'smithi146' 2023-10-06T11:06:46.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.871+0000 7f7f1c385b80 1 --2- 172.21.15.146:0/1913777862 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x560afb0adae0 0x560afb0adeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:46.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.871+0000 7f7f1c385b80 4 client.5223 mds_command: new command op to 4986 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:06:46.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.871+0000 7f7f1c385b80 1 -- 172.21.15.146:0/1913777862 --> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560afb0415c0 con 0x560afb0adae0 2023-10-06T11:06:46.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.872+0000 7f7f10e29700 1 --2- 172.21.15.146:0/1913777862 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x560afb0adae0 0x560afb0adeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:46.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.872+0000 7f7eeaffd700 10 client.5223 ms_handle_connect on v2:172.21.15.146:6835/4187213529 2023-10-06T11:06:46.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.872+0000 7f7f10e29700 1 --2- 172.21.15.146:0/1913777862 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x560afb0adae0 0x560afb0adeb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4d09348dfab62b4 server_cookie=df8ead5121f243dd in_seq=0 out_seq=0 2023-10-06T11:06:46.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.872+0000 7f7eeaffd700 1 -- 172.21.15.146:0/1913777862 <== mds.0 v2:172.21.15.146:6835/4187213529 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x560afb0415c0 con 0x560afb0adae0 2023-10-06T11:06:46.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.872+0000 7f7eeaffd700 10 client.5223 handle_command_reply: tid=0 2023-10-06T11:06:46.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.872+0000 7f7f1c385b80 1 client.5223 shutdown 2023-10-06T11:06:46.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.873+0000 7f7f1c385b80 1 -- 172.21.15.146:0/1913777862 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560afb098e60 msgr2=0x560afb095340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:46.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.873+0000 7f7f1c385b80 1 --2- 172.21.15.146:0/1913777862 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560afb098e60 0x560afb095340 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f7efc023040 tx=0x7f7efc01b000 comp rx=0 tx=0).stop 2023-10-06T11:06:46.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.873+0000 7f7f1c385b80 1 -- 172.21.15.146:0/1913777862 shutdown_connections 2023-10-06T11:06:46.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.873+0000 7f7f1c385b80 1 --2- 172.21.15.146:0/1913777862 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x560afb0adae0 0x560afb0adeb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:46.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.873+0000 7f7f1c385b80 1 --2- 172.21.15.146:0/1913777862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560afb0b9bc0 0x560afb0960c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:46.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.873+0000 7f7f1c385b80 1 --2- 172.21.15.146:0/1913777862 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560afb06f950 0x560afb0b0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:46.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.873+0000 7f7eeaffd700 0 client.5223 ms_handle_reset on v2:172.21.15.146:6835/4187213529 2023-10-06T11:06:46.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.873+0000 7f7f1c385b80 1 --2- 172.21.15.146:0/1913777862 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560afb098e60 0x560afb095340 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:46.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.873+0000 7f7f1c385b80 1 -- 172.21.15.146:0/1913777862 >> 172.21.15.146:0/1913777862 conn(0x560afb071270 msgr2=0x560afb070210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:46.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.873+0000 7f7f1c385b80 1 -- 172.21.15.146:0/1913777862 shutdown_connections 2023-10-06T11:06:46.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.873+0000 7f7f1c385b80 1 -- 172.21.15.146:0/1913777862 wait complete. 2023-10-06T11:06:46.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.873+0000 7f7f1c385b80 20 client.5223 trim_cache size 0 max 16384 2023-10-06T11:06:46.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.889+0000 7f7f1c385b80 1 Processor -- start 2023-10-06T11:06:46.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.890+0000 7f7f1c385b80 1 -- start start 2023-10-06T11:06:46.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.890+0000 7f7f1c385b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560afb06f950 0x560afb0661a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:46.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.890+0000 7f7f1c385b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560afb098e60 0x560afb095c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:46.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.890+0000 7f7f1c385b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560afb0b9bc0 0x560afb0afb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:46.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.890+0000 7f7f1c385b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x560afae42e30 con 0x560afb06f950 2023-10-06T11:06:46.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.890+0000 7f7f1c385b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x560afb0702b0 con 0x560afb098e60 2023-10-06T11:06:46.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.890+0000 7f7f1c385b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x560afb06fd20 con 0x560afb0b9bc0 2023-10-06T11:06:46.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.890+0000 7f7f10e29700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560afb06f950 0x560afb0661a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:46.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.890+0000 7f7f10e29700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560afb06f950 0x560afb0661a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39954/0 (socket says 172.21.15.146:39954) 2023-10-06T11:06:46.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.890+0000 7f7f10e29700 1 -- 172.21.15.146:0/2584201623 learned_addr learned my addr 172.21.15.146:0/2584201623 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:46.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.891+0000 7f7f10e29700 1 -- 172.21.15.146:0/2584201623 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560afb0b9bc0 msgr2=0x560afb0afb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:46.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.891+0000 7f7f10e29700 1 --2- 172.21.15.146:0/2584201623 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560afb0b9bc0 0x560afb0afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:46.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.891+0000 7f7f10e29700 1 -- 172.21.15.146:0/2584201623 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560afb098e60 msgr2=0x560afb095c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:46.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.891+0000 7f7f10e29700 1 --2- 172.21.15.146:0/2584201623 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560afb098e60 0x560afb095c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:46.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.891+0000 7f7f10e29700 1 -- 172.21.15.146:0/2584201623 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560afaf8e780 con 0x560afb06f950 2023-10-06T11:06:46.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.891+0000 7f7f10e29700 1 --2- 172.21.15.146:0/2584201623 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560afb06f950 0x560afb0661a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7f04005fd0 tx=0x7f7f04058040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d643ac7210d19b39 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:46.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.891+0000 7f7f027fc700 1 -- 172.21.15.146:0/2584201623 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f04058900 con 0x560afb06f950 2023-10-06T11:06:46.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.891+0000 7f7f027fc700 1 -- 172.21.15.146:0/2584201623 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0405c650 con 0x560afb06f950 2023-10-06T11:06:46.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.891+0000 7f7f027fc700 1 -- 172.21.15.146:0/2584201623 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f040712c0 con 0x560afb06f950 2023-10-06T11:06:46.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.891+0000 7f7f1c385b80 1 -- 172.21.15.146:0/2584201623 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560afb06f950 msgr2=0x560afb0661a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:46.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.891+0000 7f7f1c385b80 1 --2- 172.21.15.146:0/2584201623 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560afb06f950 0x560afb0661a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7f04005fd0 tx=0x7f7f04058040 comp rx=0 tx=0).stop 2023-10-06T11:06:46.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.891+0000 7f7f1c385b80 1 -- 172.21.15.146:0/2584201623 shutdown_connections 2023-10-06T11:06:46.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.891+0000 7f7f1c385b80 1 --2- 172.21.15.146:0/2584201623 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560afb0b9bc0 0x560afb0afb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:46.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.891+0000 7f7f1c385b80 1 --2- 172.21.15.146:0/2584201623 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560afb06f950 0x560afb0661a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:46.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.891+0000 7f7f1c385b80 1 --2- 172.21.15.146:0/2584201623 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560afb098e60 0x560afb095c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:46.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.891+0000 7f7f1c385b80 1 -- 172.21.15.146:0/2584201623 >> 172.21.15.146:0/2584201623 conn(0x560afb071270 msgr2=0x560afb0b33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:46.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.891+0000 7f7f1c385b80 1 -- 172.21.15.146:0/2584201623 shutdown_connections 2023-10-06T11:06:46.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.891+0000 7f7f1c385b80 1 -- 172.21.15.146:0/2584201623 wait complete. 2023-10-06T11:06:46.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.892+0000 7f7f1c385b80 1 -- start start 2023-10-06T11:06:46.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.892+0000 7f7f1c385b80 1 Processor -- start 2023-10-06T11:06:46.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.893+0000 7f7f1c385b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560afb06f950 0x560afb0afb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:46.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.893+0000 7f7f1c385b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560afb098e60 0x560afb0b00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:46.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.893+0000 7f7f1c385b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560afb0b9bc0 0x560afb0d3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:46.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.893+0000 7f7f1c385b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x560afb0ad8c0 con 0x560afb098e60 2023-10-06T11:06:46.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.893+0000 7f7f1c385b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x560afb11d1e0 con 0x560afb06f950 2023-10-06T11:06:46.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.893+0000 7f7f1c385b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x560afb0ad430 con 0x560afb0b9bc0 2023-10-06T11:06:46.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.893+0000 7f7f1c385b80 10 client.0 _ll_register_callbacks cb 0x560afae5cf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:06:46.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.893+0000 7f7f0bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560afb098e60 0x560afb0b00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:46.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.893+0000 7f7f0bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560afb098e60 0x560afb0b00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39968/0 (socket says 172.21.15.146:39968) 2023-10-06T11:06:46.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.893+0000 7f7f0bfff700 1 -- 172.21.15.146:0/1352405654 learned_addr learned my addr 172.21.15.146:0/1352405654 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:46.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.893+0000 7f7f10e29700 1 --2- 172.21.15.146:0/1352405654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560afb06f950 0x560afb0afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:46.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.893+0000 7f7f1162a700 1 --2- 172.21.15.146:0/1352405654 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560afb0b9bc0 0x560afb0d3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:46.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.893+0000 7f7f0bfff700 1 -- 172.21.15.146:0/1352405654 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560afb0b9bc0 msgr2=0x560afb0d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:46.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.893+0000 7f7f0bfff700 1 --2- 172.21.15.146:0/1352405654 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560afb0b9bc0 0x560afb0d3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:46.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.893+0000 7f7f0bfff700 1 -- 172.21.15.146:0/1352405654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560afb06f950 msgr2=0x560afb0afb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:46.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.893+0000 7f7f0bfff700 1 --2- 172.21.15.146:0/1352405654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560afb06f950 0x560afb0afb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:46.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.893+0000 7f7f0bfff700 1 -- 172.21.15.146:0/1352405654 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f0c15ac00 con 0x560afb098e60 2023-10-06T11:06:46.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.893+0000 7f7f0bfff700 1 --2- 172.21.15.146:0/1352405654 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560afb098e60 0x560afb0b00c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7efc015ab0 tx=0x7f7efc02d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e973482b79497e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:46.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.893+0000 7f7eeaffd700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:06:46.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.894+0000 7f7eeaffd700 1 -- 172.21.15.146:0/1352405654 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7efc046070 con 0x560afb098e60 2023-10-06T11:06:46.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.894+0000 7f7eeaffd700 1 -- 172.21.15.146:0/1352405654 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7efc031050 con 0x560afb098e60 2023-10-06T11:06:46.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.894+0000 7f7f1c385b80 1 -- 172.21.15.146:0/1352405654 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7efc015dc0 con 0x560afb098e60 2023-10-06T11:06:46.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.894+0000 7f7eeaffd700 1 -- 172.21.15.146:0/1352405654 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7efc009770 con 0x560afb098e60 2023-10-06T11:06:46.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.894+0000 7f7f1c385b80 10 client.5229 fetch_fsmap learned FSMap version 16 2023-10-06T11:06:46.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.894+0000 7f7f1c385b80 1 -- 172.21.15.146:0/1352405654 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x560afaf75470 con 0x560afb098e60 2023-10-06T11:06:46.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.894+0000 7f7eeaffd700 1 -- 172.21.15.146:0/1352405654 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7efc015dc0 con 0x560afb098e60 2023-10-06T11:06:46.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.894+0000 7f7eeaffd700 1 -- 172.21.15.146:0/1352405654 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 16) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f7efc037a50 con 0x560afb098e60 2023-10-06T11:06:46.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.894+0000 7f7f1c385b80 10 client.5229 fetch_fsmap finished waiting for FSMap version 16 2023-10-06T11:06:46.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.894+0000 7f7f1c385b80 10 client.5229 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T11:06:46.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.894+0000 7f7f1c385b80 20 client.5229 populate_metadata read hostname 'smithi146' 2023-10-06T11:06:46.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.894+0000 7f7f1c385b80 1 --2- 172.21.15.146:0/1352405654 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x560afb0b4e70 0x560afb0d3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:46.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.894+0000 7f7f1c385b80 4 client.5229 mds_command: new command op to 4986 tid=0[{"prefix": "status"}] 2023-10-06T11:06:46.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.894+0000 7f7f1c385b80 1 -- 172.21.15.146:0/1352405654 --> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560afaf62e00 con 0x560afb0b4e70 2023-10-06T11:06:46.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.894+0000 7f7f10e29700 1 --2- 172.21.15.146:0/1352405654 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x560afb0b4e70 0x560afb0d3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:46.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.894+0000 7f7eeaffd700 10 client.5229 ms_handle_connect on v2:172.21.15.146:6835/4187213529 2023-10-06T11:06:46.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.894+0000 7f7f10e29700 1 --2- 172.21.15.146:0/1352405654 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x560afb0b4e70 0x560afb0d3550 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1d2abed94e643d server_cookie=e305fc9c30029419 in_seq=0 out_seq=0 2023-10-06T11:06:46.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.895+0000 7f7eeaffd700 1 -- 172.21.15.146:0/1352405654 <== mds.0 v2:172.21.15.146:6835/4187213529 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x560afaf62e00 con 0x560afb0b4e70 2023-10-06T11:06:46.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.895+0000 7f7eeaffd700 10 client.5229 handle_command_reply: tid=0 2023-10-06T11:06:46.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.895+0000 7f7f1c385b80 1 client.5229 shutdown 2023-10-06T11:06:46.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.895+0000 7f7f1c385b80 1 -- 172.21.15.146:0/1352405654 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560afb098e60 msgr2=0x560afb0b00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:46.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.895+0000 7f7f1c385b80 1 --2- 172.21.15.146:0/1352405654 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560afb098e60 0x560afb0b00c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7efc015ab0 tx=0x7f7efc02d070 comp rx=0 tx=0).stop 2023-10-06T11:06:46.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.895+0000 7f7f1c385b80 1 -- 172.21.15.146:0/1352405654 shutdown_connections 2023-10-06T11:06:46.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.895+0000 7f7f1c385b80 1 --2- 172.21.15.146:0/1352405654 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x560afb0b4e70 0x560afb0d3550 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:46.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.895+0000 7f7f1c385b80 1 --2- 172.21.15.146:0/1352405654 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560afb0b9bc0 0x560afb0d3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:46.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.895+0000 7f7eeaffd700 0 client.5229 ms_handle_reset on v2:172.21.15.146:6835/4187213529 2023-10-06T11:06:46.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.895+0000 7f7f1c385b80 1 --2- 172.21.15.146:0/1352405654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560afb06f950 0x560afb0afb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:46.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.895+0000 7f7f1c385b80 1 --2- 172.21.15.146:0/1352405654 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560afb098e60 0x560afb0b00c0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:46.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.895+0000 7f7f1c385b80 1 -- 172.21.15.146:0/1352405654 >> 172.21.15.146:0/1352405654 conn(0x560afb071270 msgr2=0x560afb095c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:46.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.895+0000 7f7f1c385b80 1 -- 172.21.15.146:0/1352405654 shutdown_connections 2023-10-06T11:06:46.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.895+0000 7f7f1c385b80 1 -- 172.21.15.146:0/1352405654 wait complete. 2023-10-06T11:06:46.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.895+0000 7f7f1c385b80 20 client.5229 trim_cache size 0 max 16384 2023-10-06T11:06:46.908 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:06:46.908 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1", 2023-10-06T11:06:46.908 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2023-10-06T11:06:46.908 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 4986, 2023-10-06T11:06:46.908 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2023-10-06T11:06:46.908 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2023-10-06T11:06:46.908 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2023-10-06T11:06:46.908 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 10.34393257, 2023-10-06T11:06:46.908 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 16, 2023-10-06T11:06:46.909 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 31, 2023-10-06T11:06:46.909 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 31, 2023-10-06T11:06:46.909 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 18.240144211 2023-10-06T11:06:46.909 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:06:46.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.895+0000 7f7f11e2b700 1 -- 172.21.15.146:0/290334062 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7eec066f30 msgr2=0x7f7eec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:46.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.895+0000 7f7f11e2b700 1 --2- 172.21.15.146:0/290334062 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7eec066f30 0x7f7eec0693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c0cdc00 tx=0x7f7efc008040 comp rx=0 tx=0).stop 2023-10-06T11:06:46.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.895+0000 7f7f11e2b700 1 -- 172.21.15.146:0/290334062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f0c0b2060 msgr2=0x7f7f0c06d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:46.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.895+0000 7f7f11e2b700 1 --2- 172.21.15.146:0/290334062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f0c0b2060 0x7f7f0c06d0b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7f0400cd80 tx=0x7f7f04001b90 comp rx=0 tx=0).stop 2023-10-06T11:06:46.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.895+0000 7f7f11e2b700 1 -- 172.21.15.146:0/290334062 shutdown_connections 2023-10-06T11:06:46.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.895+0000 7f7f11e2b700 1 --2- 172.21.15.146:0/290334062 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7eec066f30 0x7f7eec0693e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:46.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.895+0000 7f7f11e2b700 1 --2- 172.21.15.146:0/290334062 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f0c0b3cf0 0x7f7f0c14b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:46.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.895+0000 7f7f11e2b700 1 --2- 172.21.15.146:0/290334062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f0c0b2060 0x7f7f0c06d0b0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:46.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.895+0000 7f7f11e2b700 1 --2- 172.21.15.146:0/290334062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f0c0b2430 0x7f7f0c157660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:46.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.895+0000 7f7f11e2b700 1 -- 172.21.15.146:0/290334062 >> 172.21.15.146:0/290334062 conn(0x7f7f0c06eba0 msgr2=0x7f7f0c15c510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:46.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.896+0000 7f7f11e2b700 1 -- 172.21.15.146:0/290334062 shutdown_connections 2023-10-06T11:06:46.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:46.896+0000 7f7f11e2b700 1 -- 172.21.15.146:0/290334062 wait complete. 2023-10-06T11:06:46.912 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T11:06:47.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.025+0000 7fd08e43a700 1 Processor -- start 2023-10-06T11:06:47.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.025+0000 7fd08e43a700 1 -- start start 2023-10-06T11:06:47.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.026+0000 7fd08e43a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd0880b0710 0x7fd0880b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:47.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.026+0000 7fd08e43a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0880cf170 0x7fd0880b1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:47.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.026+0000 7fd08e43a700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd088157e30 con 0x7fd0880c9290 2023-10-06T11:06:47.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.026+0000 7fd08e43a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0880c3f70 con 0x7fd0880b0710 2023-10-06T11:06:47.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.026+0000 7fd08e43a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0880c3360 con 0x7fd0880cf170 2023-10-06T11:06:47.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.026+0000 7fd087fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd0880b0710 0x7fd0880b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:47.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.026+0000 7fd087fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd0880b0710 0x7fd0880b0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39970/0 (socket says 172.21.15.146:39970) 2023-10-06T11:06:47.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.026+0000 7fd087fff700 1 -- 172.21.15.146:0/3571817802 learned_addr learned my addr 172.21.15.146:0/3571817802 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:47.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.026+0000 7fd0877fe700 1 --2- 172.21.15.146:0/3571817802 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0880cf170 0x7fd0880b1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:47.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.026+0000 7fd087fff700 1 -- 172.21.15.146:0/3571817802 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0880cf170 msgr2=0x7fd0880b1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:47.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.026+0000 7fd087fff700 1 --2- 172.21.15.146:0/3571817802 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0880cf170 0x7fd0880b1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:47.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.026+0000 7fd087fff700 1 -- 172.21.15.146:0/3571817802 >> v1:172.21.15.151:6789/0 conn(0x7fd0880c9290 legacy=0x7fd0880c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:47.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.026+0000 7fd087fff700 1 -- 172.21.15.146:0/3571817802 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0880c3640 con 0x7fd0880b0710 2023-10-06T11:06:47.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.026+0000 7fd0877fe700 1 --2- 172.21.15.146:0/3571817802 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0880cf170 0x7fd0880b1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:06:47.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.026+0000 7fd087fff700 1 --2- 172.21.15.146:0/3571817802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0880b0710 0x7fd0880b0ae0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd0780099e0 tx=0x7fd078009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8d013a0c633883e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:47.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.027+0000 7fd086ffd700 1 -- 172.21.15.146:0/3571817802 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07800b820 con 0x7fd0880b0710 2023-10-06T11:06:47.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.027+0000 7fd086ffd700 1 -- 172.21.15.146:0/3571817802 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07800b980 con 0x7fd0880b0710 2023-10-06T11:06:47.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.027+0000 7fd086ffd700 1 -- 172.21.15.146:0/3571817802 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07800bd20 con 0x7fd0880b0710 2023-10-06T11:06:47.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.027+0000 7fd08e43a700 1 -- 172.21.15.146:0/3571817802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0880b0710 msgr2=0x7fd0880b0ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:47.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.027+0000 7fd08e43a700 1 --2- 172.21.15.146:0/3571817802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0880b0710 0x7fd0880b0ae0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fd0780099e0 tx=0x7fd078009250 comp rx=0 tx=0).stop 2023-10-06T11:06:47.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.027+0000 7fd08e43a700 1 -- 172.21.15.146:0/3571817802 shutdown_connections 2023-10-06T11:06:47.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.027+0000 7fd08e43a700 1 --2- 172.21.15.146:0/3571817802 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0880b0710 0x7fd0880b0ae0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:47.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.027+0000 7fd08e43a700 1 --2- 172.21.15.146:0/3571817802 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0880cf170 0x7fd0880b1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:47.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.027+0000 7fd08e43a700 1 -- 172.21.15.146:0/3571817802 >> 172.21.15.146:0/3571817802 conn(0x7fd088067c50 msgr2=0x7fd0880ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:47.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.027+0000 7fd08e43a700 1 -- 172.21.15.146:0/3571817802 shutdown_connections 2023-10-06T11:06:47.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.027+0000 7fd08e43a700 1 -- 172.21.15.146:0/3571817802 wait complete. 2023-10-06T11:06:47.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.028+0000 7fd08e43a700 1 Processor -- start 2023-10-06T11:06:47.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.028+0000 7fd08e43a700 1 -- start start 2023-10-06T11:06:47.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.029+0000 7fd08e43a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0880b0710 0x7fd0880b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:47.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.029+0000 7fd08e43a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0880c9290 0x7fd0880b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:47.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.029+0000 7fd08e43a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0880cf170 0x7fd0880c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:47.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.029+0000 7fd08e43a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0880b28c0 con 0x7fd0880b0710 2023-10-06T11:06:47.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.029+0000 7fd08e43a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0880b1cb0 con 0x7fd0880c9290 2023-10-06T11:06:47.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.029+0000 7fd08e43a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0880b1f90 con 0x7fd0880cf170 2023-10-06T11:06:47.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.029+0000 7fd087fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0880b0710 0x7fd0880b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:47.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.029+0000 7fd087fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0880b0710 0x7fd0880b2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39978/0 (socket says 172.21.15.146:39978) 2023-10-06T11:06:47.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.029+0000 7fd087fff700 1 -- 172.21.15.146:0/671828928 learned_addr learned my addr 172.21.15.146:0/671828928 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:47.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.029+0000 7fd08c9d7700 1 --2- 172.21.15.146:0/671828928 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0880cf170 0x7fd0880c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:47.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.029+0000 7fd0877fe700 1 --2- 172.21.15.146:0/671828928 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0880c9290 0x7fd0880b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:47.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.030+0000 7fd087fff700 1 -- 172.21.15.146:0/671828928 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0880cf170 msgr2=0x7fd0880c7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:47.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.030+0000 7fd087fff700 1 --2- 172.21.15.146:0/671828928 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0880cf170 0x7fd0880c7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:47.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.030+0000 7fd087fff700 1 -- 172.21.15.146:0/671828928 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0880c9290 msgr2=0x7fd0880b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:47.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.030+0000 7fd087fff700 1 --2- 172.21.15.146:0/671828928 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0880c9290 0x7fd0880b3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:47.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.030+0000 7fd087fff700 1 -- 172.21.15.146:0/671828928 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0780094f0 con 0x7fd0880b0710 2023-10-06T11:06:47.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.030+0000 7fd08c9d7700 1 --2- 172.21.15.146:0/671828928 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0880cf170 0x7fd0880c7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:06:47.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.030+0000 7fd087fff700 1 --2- 172.21.15.146:0/671828928 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0880b0710 0x7fd0880b2d50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd078009290 tx=0x7fd078017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:47.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.030+0000 7fd06ffff700 1 -- 172.21.15.146:0/671828928 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd078026480 con 0x7fd0880b0710 2023-10-06T11:06:47.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.030+0000 7fd06ffff700 1 -- 172.21.15.146:0/671828928 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd07801f070 con 0x7fd0880b0710 2023-10-06T11:06:47.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.030+0000 7fd08e43a700 1 -- 172.21.15.146:0/671828928 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0880b2270 con 0x7fd0880b0710 2023-10-06T11:06:47.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.030+0000 7fd06ffff700 1 -- 172.21.15.146:0/671828928 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd078026830 con 0x7fd0880b0710 2023-10-06T11:06:47.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.030+0000 7fd08e43a700 1 -- 172.21.15.146:0/671828928 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0880b41a0 con 0x7fd0880b0710 2023-10-06T11:06:47.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.031+0000 7fd08e43a700 1 -- 172.21.15.146:0/671828928 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd08804c380 con 0x7fd0880b0710 2023-10-06T11:06:47.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.031+0000 7fd06ffff700 1 -- 172.21.15.146:0/671828928 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd078026ba0 con 0x7fd0880b0710 2023-10-06T11:06:47.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.032+0000 7fd06ffff700 1 --2- 172.21.15.146:0/671828928 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd074066f30 0x7fd0740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:47.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.032+0000 7fd06ffff700 1 -- 172.21.15.146:0/671828928 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd078021070 con 0x7fd0880b0710 2023-10-06T11:06:47.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.032+0000 7fd0877fe700 1 --2- 172.21.15.146:0/671828928 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd074066f30 0x7fd0740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:47.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.032+0000 7fd0877fe700 1 --2- 172.21.15.146:0/671828928 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd074066f30 0x7fd0740693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd07c006f00 tx=0x7fd07c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:47.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.036+0000 7fd06ffff700 1 -- 172.21.15.146:0/671828928 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd0780536a0 con 0x7fd0880b0710 2023-10-06T11:06:47.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.265+0000 7fd08e43a700 1 -- 172.21.15.146:0/671828928 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd0880c3920 con 0x7fd0880b0710 2023-10-06T11:06:47.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.265+0000 7fd06ffff700 1 -- 172.21.15.146:0/671828928 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd078056cc0 con 0x7fd0880b0710 2023-10-06T11:06:47.267 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T11:06:47.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.268+0000 7fd08e43a700 1 -- 172.21.15.146:0/671828928 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd074066f30 msgr2=0x7fd0740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:47.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.268+0000 7fd08e43a700 1 --2- 172.21.15.146:0/671828928 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd074066f30 0x7fd0740693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fd07c006f00 tx=0x7fd07c008040 comp rx=0 tx=0).stop 2023-10-06T11:06:47.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.268+0000 7fd08e43a700 1 -- 172.21.15.146:0/671828928 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0880b0710 msgr2=0x7fd0880b2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:47.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.268+0000 7fd08e43a700 1 --2- 172.21.15.146:0/671828928 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0880b0710 0x7fd0880b2d50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd078009290 tx=0x7fd078017000 comp rx=0 tx=0).stop 2023-10-06T11:06:47.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.268+0000 7fd08e43a700 1 -- 172.21.15.146:0/671828928 shutdown_connections 2023-10-06T11:06:47.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.268+0000 7fd08e43a700 1 --2- 172.21.15.146:0/671828928 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd074066f30 0x7fd0740693e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:47.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.268+0000 7fd08e43a700 1 --2- 172.21.15.146:0/671828928 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0880cf170 0x7fd0880c7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:47.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.268+0000 7fd08e43a700 1 --2- 172.21.15.146:0/671828928 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0880b0710 0x7fd0880b2d50 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:47.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.268+0000 7fd08e43a700 1 --2- 172.21.15.146:0/671828928 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0880c9290 0x7fd0880b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:47.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.268+0000 7fd08e43a700 1 -- 172.21.15.146:0/671828928 >> 172.21.15.146:0/671828928 conn(0x7fd088067c50 msgr2=0x7fd088156ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:47.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.268+0000 7fd08e43a700 1 -- 172.21.15.146:0/671828928 shutdown_connections 2023-10-06T11:06:47.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:47.268+0000 7fd08e43a700 1 -- 172.21.15.146:0/671828928 wait complete. 2023-10-06T11:06:47.281 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T11:06:47.282 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T11:06:47.282 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2023-10-06T11:06:47.282 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T11:06:47.282 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T11:06:47.282 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T11:06:47.282 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T11:06:47.282 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T11:06:47.282 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:06:47.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:47.283 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2023-10-06T11:06:47.297 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:06:47.298 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:06:47.298 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:06:47.298 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:06:47.298 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2023-10-06T11:06:47.298 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:06:47.298 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:06:47.298 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2023-10-06T11:06:47.298 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2023-10-06T11:06:47.298 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:06:47.298 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2023-10-06T11:06:47.298 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2023-10-06T11:06:47.299 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:06:47.299 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2023-10-06T11:06:47.299 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T11:06:47.299 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2023-10-06T11:06:47.299 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T11:06:47.299 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42450sec preferred_lft 42450sec 2023-10-06T11:06:47.299 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link noprefixroute 2023-10-06T11:06:47.299 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:06:47.299 INFO:teuthology.orchestra.run.smithi146.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T11:06:47.299 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0e:4f:33:80:c4:0e brd ff:ff:ff:ff:ff:ff 2023-10-06T11:06:47.299 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T11:06:47.299 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:06:47.300 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3884:6eff:fefc:ffc7/64 scope link 2023-10-06T11:06:47.300 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:06:47.300 INFO:teuthology.orchestra.run.smithi146.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:06:47.300 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0e:4f:33:80:c4:0e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T11:06:47.300 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::c4f:33ff:fe80:c40e/64 scope link 2023-10-06T11:06:47.300 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:06:47.300 INFO:teuthology.orchestra.run.smithi146.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:06:47.300 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 36:96:28:73:57:c4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T11:06:47.300 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3496:28ff:fe73:57c4/64 scope link 2023-10-06T11:06:47.300 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:06:47.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:47.301 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T11:06:47.361 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-06T11:06:47.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:47.363 DEBUG:teuthology.orchestra.run.smithi146:> route 2023-10-06T11:06:47.418 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2023-10-06T11:06:47.419 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T11:06:47.419 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T11:06:47.419 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T11:06:47.419 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T11:06:47.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:47.419 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-10-06T11:06:47.419 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:06:47.419 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T11:06:47.419 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T11:06:47.420 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T11:06:47.420 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:06:47.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:47.519 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-10-06T11:06:47.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T11:06:47.533 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T11:06:47.534 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:06:47.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:06:47.534 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2023-10-06T11:06:47.598 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T11:06:47.599 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:06:47.599 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T11:06:47.653 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:06:47.653 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:06:47.653 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:06:47.707 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-06T11:06:47.772 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:06:47.772 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:06:47.836 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:06:47.837 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:06:47.837 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:06:47.838 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-06T11:06:47.892 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T11:06:47.892 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T11:06:47.934 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-06T11:06:47.958 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:06:47.958 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:06:48.015 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:2023-10-06T11:06:48.013+0000 7fc58cc88540 -1 init, newargv = 0x5621ea1b5ed0 newargc=15 2023-10-06T11:06:48.015 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[103883]: starting ceph client 2023-10-06T11:06:48.020 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[103883]: starting fuse 2023-10-06T11:06:48.024 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:06:48.025 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:06:48.026 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:06:48.026 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-06T11:06:48.081 INFO:teuthology.orchestra.run.smithi146.stdout:46 2023-10-06T11:06:48.081 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-06T11:06:48.081 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T11:06:48.082 DEBUG:teuthology.orchestra.run.smithi146:> import glob 2023-10-06T11:06:48.082 DEBUG:teuthology.orchestra.run.smithi146:> import re 2023-10-06T11:06:48.082 DEBUG:teuthology.orchestra.run.smithi146:> import os 2023-10-06T11:06:48.082 DEBUG:teuthology.orchestra.run.smithi146:> import subprocess 2023-10-06T11:06:48.082 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:06:48.082 DEBUG:teuthology.orchestra.run.smithi146:> def _find_admin_socket(client_name): 2023-10-06T11:06:48.082 DEBUG:teuthology.orchestra.run.smithi146:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T11:06:48.082 DEBUG:teuthology.orchestra.run.smithi146:> files = glob.glob(asok_path) 2023-10-06T11:06:48.082 DEBUG:teuthology.orchestra.run.smithi146:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T11:06:48.082 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:06:48.082 DEBUG:teuthology.orchestra.run.smithi146:> # Given a non-glob path, it better be there 2023-10-06T11:06:48.082 DEBUG:teuthology.orchestra.run.smithi146:> if "*" not in asok_path: 2023-10-06T11:06:48.083 DEBUG:teuthology.orchestra.run.smithi146:> assert(len(files) == 1) 2023-10-06T11:06:48.083 DEBUG:teuthology.orchestra.run.smithi146:> return files[0] 2023-10-06T11:06:48.083 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:06:48.083 DEBUG:teuthology.orchestra.run.smithi146:> for f in files: 2023-10-06T11:06:48.083 DEBUG:teuthology.orchestra.run.smithi146:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T11:06:48.083 DEBUG:teuthology.orchestra.run.smithi146:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T11:06:48.083 DEBUG:teuthology.orchestra.run.smithi146:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T11:06:48.083 DEBUG:teuthology.orchestra.run.smithi146:> contents = proc_f.read() 2023-10-06T11:06:48.083 DEBUG:teuthology.orchestra.run.smithi146:> if mountpoint in contents: 2023-10-06T11:06:48.083 DEBUG:teuthology.orchestra.run.smithi146:> return f 2023-10-06T11:06:48.083 DEBUG:teuthology.orchestra.run.smithi146:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T11:06:48.083 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:06:48.083 DEBUG:teuthology.orchestra.run.smithi146:> print(_find_admin_socket("client.0")) 2023-10-06T11:06:48.084 DEBUG:teuthology.orchestra.run.smithi146:> ' 2023-10-06T11:06:48.202 INFO:teuthology.orchestra.run.smithi146.stdout:/var/run/ceph/ceph-client.0.103883.asok 2023-10-06T11:06:48.385 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.103883.asok 2023-10-06T11:06:48.385 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:06:48.385 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.103883.asok status 2023-10-06T11:06:48.534 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:06:48.535 INFO:teuthology.orchestra.run.smithi146.stdout: "metadata": { 2023-10-06T11:06:48.535 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T11:06:48.535 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T11:06:48.535 INFO:teuthology.orchestra.run.smithi146.stdout: "entity_id": "0", 2023-10-06T11:06:48.535 INFO:teuthology.orchestra.run.smithi146.stdout: "hostname": "smithi146", 2023-10-06T11:06:48.535 INFO:teuthology.orchestra.run.smithi146.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T11:06:48.535 INFO:teuthology.orchestra.run.smithi146.stdout: "pid": "103883", 2023-10-06T11:06:48.535 INFO:teuthology.orchestra.run.smithi146.stdout: "root": "/" 2023-10-06T11:06:48.535 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:06:48.535 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_count": 0, 2023-10-06T11:06:48.536 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_pinned_count": 0, 2023-10-06T11:06:48.536 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 5238, 2023-10-06T11:06:48.536 INFO:teuthology.orchestra.run.smithi146.stdout: "inst": { 2023-10-06T11:06:48.536 INFO:teuthology.orchestra.run.smithi146.stdout: "name": { 2023-10-06T11:06:48.536 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "client", 2023-10-06T11:06:48.536 INFO:teuthology.orchestra.run.smithi146.stdout: "num": 5238 2023-10-06T11:06:48.536 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:06:48.536 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-06T11:06:48.536 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-06T11:06:48.536 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:06:48.536 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 1415278858 2023-10-06T11:06:48.536 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:06:48.537 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:06:48.537 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-06T11:06:48.537 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-06T11:06:48.537 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:06:48.537 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 1415278858 2023-10-06T11:06:48.537 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:06:48.537 INFO:teuthology.orchestra.run.smithi146.stdout: "inst_str": "client.5238 192.168.0.1:0/1415278858", 2023-10-06T11:06:48.537 INFO:teuthology.orchestra.run.smithi146.stdout: "addr_str": "192.168.0.1:0/1415278858", 2023-10-06T11:06:48.537 INFO:teuthology.orchestra.run.smithi146.stdout: "inode_count": 1, 2023-10-06T11:06:48.537 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_epoch": 16, 2023-10-06T11:06:48.537 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch": 31, 2023-10-06T11:06:48.537 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch_barrier": 0, 2023-10-06T11:06:48.538 INFO:teuthology.orchestra.run.smithi146.stdout: "blocklisted": false, 2023-10-06T11:06:48.538 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs" 2023-10-06T11:06:48.538 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:06:48.544 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:06:48.544 DEBUG:teuthology.orchestra.run.smithi146:> stat --file-system '--printf=%T 2023-10-06T11:06:48.544 DEBUG:teuthology.orchestra.run.smithi146:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T11:06:48.559 INFO:teuthology.orchestra.run.smithi146.stdout:fuseblk 2023-10-06T11:06:48.560 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T11:06:48.560 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:06:48.560 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:06:48.624 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2023-10-06T11:06:48.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.780+0000 7ff797553700 1 Processor -- start 2023-10-06T11:06:48.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.780+0000 7ff797553700 1 -- start start 2023-10-06T11:06:48.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.781+0000 7ff797553700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff79015a160 0x7ff7900c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:48.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.781+0000 7ff797553700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff7900ae730 0x7ff7900aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:48.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.781+0000 7ff797553700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7900ae2a0 con 0x7ff7900ce3d0 2023-10-06T11:06:48.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.781+0000 7ff797553700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff79015a530 con 0x7ff79015a160 2023-10-06T11:06:48.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.781+0000 7ff797553700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7900af0f0 con 0x7ff7900ae730 2023-10-06T11:06:48.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.781+0000 7ff7952ef700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff79015a160 0x7ff7900c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:48.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.781+0000 7ff7952ef700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff79015a160 0x7ff7900c55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39984/0 (socket says 172.21.15.146:39984) 2023-10-06T11:06:48.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.781+0000 7ff7952ef700 1 -- 172.21.15.146:0/1339882074 learned_addr learned my addr 172.21.15.146:0/1339882074 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:48.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.781+0000 7ff794aee700 1 --2- 172.21.15.146:0/1339882074 >> v2:172.21.15.151:3300/0 conn(0x7ff7900ae730 0x7ff7900aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:48.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.782+0000 7ff7952ef700 1 -- 172.21.15.146:0/1339882074 >> v2:172.21.15.151:3300/0 conn(0x7ff7900ae730 msgr2=0x7ff7900aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:06:48.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.782+0000 7ff7952ef700 1 --2- 172.21.15.146:0/1339882074 >> v2:172.21.15.151:3300/0 conn(0x7ff7900ae730 0x7ff7900aebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:48.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.782+0000 7ff7952ef700 1 -- 172.21.15.146:0/1339882074 >> v1:172.21.15.151:6789/0 conn(0x7ff7900ce3d0 legacy=0x7ff7900ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:48.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.782+0000 7ff7952ef700 1 -- 172.21.15.146:0/1339882074 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7900ad690 con 0x7ff79015a160 2023-10-06T11:06:48.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.782+0000 7ff787fff700 1 -- 172.21.15.146:0/1339882074 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1686217758 0 0) 0x7ff7900ae2a0 con 0x7ff7900ce3d0 2023-10-06T11:06:48.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.782+0000 7ff7952ef700 1 --2- 172.21.15.146:0/1339882074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff79015a160 0x7ff7900c55a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff7900d16e0 tx=0x7ff78c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feb7dbdeb6ac82e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:48.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.782+0000 7ff787fff700 1 -- 172.21.15.146:0/1339882074 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78c00e070 con 0x7ff79015a160 2023-10-06T11:06:48.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.782+0000 7ff787fff700 1 -- 172.21.15.146:0/1339882074 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff78c00ba20 con 0x7ff79015a160 2023-10-06T11:06:48.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.782+0000 7ff787fff700 1 -- 172.21.15.146:0/1339882074 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78c0092e0 con 0x7ff79015a160 2023-10-06T11:06:48.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.782+0000 7ff797553700 1 -- 172.21.15.146:0/1339882074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff79015a160 msgr2=0x7ff7900c55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:48.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.782+0000 7ff797553700 1 --2- 172.21.15.146:0/1339882074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff79015a160 0x7ff7900c55a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff7900d16e0 tx=0x7ff78c009840 comp rx=0 tx=0).stop 2023-10-06T11:06:48.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.782+0000 7ff797553700 1 -- 172.21.15.146:0/1339882074 shutdown_connections 2023-10-06T11:06:48.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.782+0000 7ff797553700 1 --2- 172.21.15.146:0/1339882074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff79015a160 0x7ff7900c55a0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:48.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.782+0000 7ff797553700 1 --2- 172.21.15.146:0/1339882074 >> v2:172.21.15.151:3300/0 conn(0x7ff7900ae730 0x7ff7900aebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:48.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.782+0000 7ff797553700 1 -- 172.21.15.146:0/1339882074 >> 172.21.15.146:0/1339882074 conn(0x7ff79006f380 msgr2=0x7ff7900d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:48.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.783+0000 7ff797553700 1 -- 172.21.15.146:0/1339882074 shutdown_connections 2023-10-06T11:06:48.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.783+0000 7ff797553700 1 -- 172.21.15.146:0/1339882074 wait complete. 2023-10-06T11:06:48.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.784+0000 7ff797553700 1 Processor -- start 2023-10-06T11:06:48.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.784+0000 7ff797553700 1 -- start start 2023-10-06T11:06:48.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.784+0000 7ff797553700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7900ae730 0x7ff79015d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:48.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.784+0000 7ff797553700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7900ce3d0 0x7ff79014c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:48.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.785+0000 7ff797553700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff79015a160 0x7ff7900ca060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:48.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.785+0000 7ff797553700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7900c8fc0 con 0x7ff7900ce3d0 2023-10-06T11:06:48.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.785+0000 7ff797553700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7900c92a0 con 0x7ff79015a160 2023-10-06T11:06:48.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.785+0000 7ff797553700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7900c9580 con 0x7ff7900ae730 2023-10-06T11:06:48.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.785+0000 7ff794aee700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7900ce3d0 0x7ff79014c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:48.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.785+0000 7ff794aee700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7900ce3d0 0x7ff79014c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39996/0 (socket says 172.21.15.146:39996) 2023-10-06T11:06:48.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.785+0000 7ff794aee700 1 -- 172.21.15.146:0/3640833718 learned_addr learned my addr 172.21.15.146:0/3640833718 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:06:48.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.785+0000 7ff7952ef700 1 --2- 172.21.15.146:0/3640833718 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7900ae730 0x7ff79015d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:48.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.785+0000 7ff795af0700 1 --2- 172.21.15.146:0/3640833718 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff79015a160 0x7ff7900ca060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:48.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.785+0000 7ff794aee700 1 -- 172.21.15.146:0/3640833718 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7900ae730 msgr2=0x7ff79015d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:48.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.785+0000 7ff794aee700 1 --2- 172.21.15.146:0/3640833718 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7900ae730 0x7ff79015d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:48.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.785+0000 7ff794aee700 1 -- 172.21.15.146:0/3640833718 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff79015a160 msgr2=0x7ff7900ca060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:48.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.785+0000 7ff794aee700 1 --2- 172.21.15.146:0/3640833718 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff79015a160 0x7ff7900ca060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:48.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.785+0000 7ff794aee700 1 -- 172.21.15.146:0/3640833718 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff78c009ae0 con 0x7ff7900ce3d0 2023-10-06T11:06:48.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.785+0000 7ff794aee700 1 --2- 172.21.15.146:0/3640833718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7900ce3d0 0x7ff79014c4e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff78000e930 tx=0x7ff7800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:48.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.785+0000 7ff7857fa700 1 -- 172.21.15.146:0/3640833718 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff780013680 con 0x7ff7900ce3d0 2023-10-06T11:06:48.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.785+0000 7ff7857fa700 1 -- 172.21.15.146:0/3640833718 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7800137e0 con 0x7ff7900ce3d0 2023-10-06T11:06:48.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.785+0000 7ff797553700 1 -- 172.21.15.146:0/3640833718 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7900c9860 con 0x7ff7900ce3d0 2023-10-06T11:06:48.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.785+0000 7ff7857fa700 1 -- 172.21.15.146:0/3640833718 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff780013b80 con 0x7ff7900ce3d0 2023-10-06T11:06:48.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.785+0000 7ff797553700 1 -- 172.21.15.146:0/3640833718 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff79014ca20 con 0x7ff7900ce3d0 2023-10-06T11:06:48.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.786+0000 7ff797553700 1 -- 172.21.15.146:0/3640833718 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff790068390 con 0x7ff7900ce3d0 2023-10-06T11:06:48.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.787+0000 7ff7857fa700 1 -- 172.21.15.146:0/3640833718 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff78000c3e0 con 0x7ff7900ce3d0 2023-10-06T11:06:48.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.787+0000 7ff7857fa700 1 --2- 172.21.15.146:0/3640833718 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff774066f30 0x7ff7740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:06:48.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.787+0000 7ff7952ef700 1 --2- 172.21.15.146:0/3640833718 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff774066f30 0x7ff7740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:06:48.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.787+0000 7ff7857fa700 1 -- 172.21.15.146:0/3640833718 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff780084710 con 0x7ff7900ce3d0 2023-10-06T11:06:48.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.788+0000 7ff7952ef700 1 --2- 172.21.15.146:0/3640833718 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff774066f30 0x7ff7740693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff78c009fd0 tx=0x7ff78c018000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:06:48.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:48.791+0000 7ff7857fa700 1 -- 172.21.15.146:0/3640833718 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff780051820 con 0x7ff7900ce3d0 2023-10-06T11:06:49.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:49.017+0000 7ff797553700 1 -- 172.21.15.146:0/3640833718 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff79004c380 con 0x7ff7900ce3d0 2023-10-06T11:06:49.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:49.316+0000 7ff7857fa700 1 -- 172.21.15.146:0/3640833718 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v17) v1 ==== 167+0+0 (secure 0 0 0) 0x7ff780054e40 con 0x7ff7900ce3d0 2023-10-06T11:06:49.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:49.318+0000 7ff797553700 1 -- 172.21.15.146:0/3640833718 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff774066f30 msgr2=0x7ff7740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:49.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:49.318+0000 7ff797553700 1 --2- 172.21.15.146:0/3640833718 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff774066f30 0x7ff7740693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff78c009fd0 tx=0x7ff78c018000 comp rx=0 tx=0).stop 2023-10-06T11:06:49.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:49.318+0000 7ff797553700 1 -- 172.21.15.146:0/3640833718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7900ce3d0 msgr2=0x7ff79014c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:06:49.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:49.318+0000 7ff797553700 1 --2- 172.21.15.146:0/3640833718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7900ce3d0 0x7ff79014c4e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff78000e930 tx=0x7ff7800091a0 comp rx=0 tx=0).stop 2023-10-06T11:06:49.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:49.318+0000 7ff797553700 1 -- 172.21.15.146:0/3640833718 shutdown_connections 2023-10-06T11:06:49.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:49.318+0000 7ff797553700 1 --2- 172.21.15.146:0/3640833718 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff774066f30 0x7ff7740693e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:49.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:49.318+0000 7ff797553700 1 --2- 172.21.15.146:0/3640833718 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff79015a160 0x7ff7900ca060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:49.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:49.318+0000 7ff797553700 1 --2- 172.21.15.146:0/3640833718 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7900ae730 0x7ff79015d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:49.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:49.318+0000 7ff797553700 1 --2- 172.21.15.146:0/3640833718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff7900ce3d0 0x7ff79014c4e0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:06:49.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:49.318+0000 7ff797553700 1 -- 172.21.15.146:0/3640833718 >> 172.21.15.146:0/3640833718 conn(0x7ff79006f380 msgr2=0x7ff790069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:06:49.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:49.318+0000 7ff797553700 1 -- 172.21.15.146:0/3640833718 shutdown_connections 2023-10-06T11:06:49.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:06:49.318+0000 7ff797553700 1 -- 172.21.15.146:0/3640833718 wait complete. 2023-10-06T11:06:49.321 INFO:teuthology.orchestra.run.smithi146.stderr:enabled new snapshots 2023-10-06T11:06:49.332 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:06:49.332 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir stray_eval_dir) 2023-10-06T11:06:49.353 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T11:06:49.353 DEBUG:teuthology.orchestra.run.smithi146:> import os 2023-10-06T11:06:49.353 DEBUG:teuthology.orchestra.run.smithi146:> import uuid 2023-10-06T11:06:49.353 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:06:49.353 DEBUG:teuthology.orchestra.run.smithi146:> n = 2000 2023-10-06T11:06:49.354 DEBUG:teuthology.orchestra.run.smithi146:> create_hard_links = False 2023-10-06T11:06:49.354 DEBUG:teuthology.orchestra.run.smithi146:> if 3 > 0: 2023-10-06T11:06:49.354 DEBUG:teuthology.orchestra.run.smithi146:> create_hard_links = True 2023-10-06T11:06:49.354 DEBUG:teuthology.orchestra.run.smithi146:> path = "/home/ubuntu/cephtest/mnt.0/stray_eval_dir/file" 2023-10-06T11:06:49.354 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:06:49.354 DEBUG:teuthology.orchestra.run.smithi146:> dpath = os.path.dirname(path) 2023-10-06T11:06:49.354 DEBUG:teuthology.orchestra.run.smithi146:> fnameprefix = os.path.basename(path) 2023-10-06T11:06:49.354 DEBUG:teuthology.orchestra.run.smithi146:> os.makedirs(dpath, exist_ok=True) 2023-10-06T11:06:49.354 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:06:49.354 DEBUG:teuthology.orchestra.run.smithi146:> try: 2023-10-06T11:06:49.354 DEBUG:teuthology.orchestra.run.smithi146:> dirfd = os.open(dpath, os.O_DIRECTORY) 2023-10-06T11:06:49.355 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:06:49.355 DEBUG:teuthology.orchestra.run.smithi146:> for i in range(n): 2023-10-06T11:06:49.355 DEBUG:teuthology.orchestra.run.smithi146:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2023-10-06T11:06:49.355 DEBUG:teuthology.orchestra.run.smithi146:> with open(fpath, '"'"'w'"'"') as f: 2023-10-06T11:06:49.355 DEBUG:teuthology.orchestra.run.smithi146:> f.write(f"{i}") 2023-10-06T11:06:49.355 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2023-10-06T11:06:49.355 DEBUG:teuthology.orchestra.run.smithi146:> f.flush() 2023-10-06T11:06:49.355 DEBUG:teuthology.orchestra.run.smithi146:> os.fsync(f.fileno()) 2023-10-06T11:06:49.355 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2023-10-06T11:06:49.355 DEBUG:teuthology.orchestra.run.smithi146:> os.unlink(fpath) 2023-10-06T11:06:49.355 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2023-10-06T11:06:49.355 DEBUG:teuthology.orchestra.run.smithi146:> os.fsync(dirfd) 2023-10-06T11:06:49.356 DEBUG:teuthology.orchestra.run.smithi146:> if create_hard_links: 2023-10-06T11:06:49.356 DEBUG:teuthology.orchestra.run.smithi146:> for j in range(3): 2023-10-06T11:06:49.356 DEBUG:teuthology.orchestra.run.smithi146:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2023-10-06T11:06:49.356 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2023-10-06T11:06:49.356 DEBUG:teuthology.orchestra.run.smithi146:> os.fsync(dirfd) 2023-10-06T11:06:49.356 DEBUG:teuthology.orchestra.run.smithi146:> finally: 2023-10-06T11:06:49.356 DEBUG:teuthology.orchestra.run.smithi146:> os.close(dirfd) 2023-10-06T11:06:49.356 DEBUG:teuthology.orchestra.run.smithi146:> ' 2023-10-06T11:06:49.692 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:06:49.694 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:07:19.756 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:07:19.758 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:07:22.078 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:07:22.078 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2023-10-06T11:07:22.134 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:07:22.135 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec find /home/ubuntu/cephtest/mnt.0/stray_eval_dir/ -type f -delete) 2023-10-06T11:07:49.811 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:07:49.813 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:07:55.605 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:07:55.606 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2023-10-06T11:07:55.668 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 perf dump 2023-10-06T11:07:55.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.783+0000 7ff1439d3700 1 Processor -- start 2023-10-06T11:07:55.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.783+0000 7ff1439d3700 1 -- start start 2023-10-06T11:07:55.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.784+0000 7ff1439d3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff13c15d710 0x7ff13c0ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:55.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.784+0000 7ff1439d3700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff13c0aef20 0x7ff13c068580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:55.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.784+0000 7ff1439d3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff13c068ac0 0x7ff13c0b04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:55.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.784+0000 7ff1439d3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff13c15e340 con 0x7ff13c15d710 2023-10-06T11:07:55.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.784+0000 7ff1439d3700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff13c0b0010 con 0x7ff13c0aef20 2023-10-06T11:07:55.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.784+0000 7ff1439d3700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c0cf090 con 0x7ff13c068ac0 2023-10-06T11:07:55.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.785+0000 7ff14176f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff13c15d710 0x7ff13c0ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:55.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.785+0000 7ff14176f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff13c15d710 0x7ff13c0ceb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60866/0 (socket says 172.21.15.146:60866) 2023-10-06T11:07:55.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.785+0000 7ff14176f700 1 -- 172.21.15.146:0/1426823368 learned_addr learned my addr 172.21.15.146:0/1426823368 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:07:55.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.785+0000 7ff140f6e700 1 --2- 172.21.15.146:0/1426823368 >> v2:172.21.15.151:3300/0 conn(0x7ff13c0aef20 0x7ff13c068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:55.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.785+0000 7ff141f70700 1 --2- 172.21.15.146:0/1426823368 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff13c068ac0 0x7ff13c0b04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:55.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.785+0000 7ff14176f700 1 -- 172.21.15.146:0/1426823368 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff13c068ac0 msgr2=0x7ff13c0b04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:07:55.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.785+0000 7ff14176f700 1 --2- 172.21.15.146:0/1426823368 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff13c068ac0 0x7ff13c0b04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:55.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.785+0000 7ff14176f700 1 -- 172.21.15.146:0/1426823368 >> v2:172.21.15.151:3300/0 conn(0x7ff13c0aef20 msgr2=0x7ff13c068580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:07:55.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.785+0000 7ff14176f700 1 --2- 172.21.15.146:0/1426823368 >> v2:172.21.15.151:3300/0 conn(0x7ff13c0aef20 0x7ff13c068580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:55.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.785+0000 7ff14176f700 1 -- 172.21.15.146:0/1426823368 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff13c0af400 con 0x7ff13c15d710 2023-10-06T11:07:55.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.785+0000 7ff141f70700 1 --2- 172.21.15.146:0/1426823368 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff13c068ac0 0x7ff13c0b04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:07:55.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.785+0000 7ff14176f700 1 --2- 172.21.15.146:0/1426823368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff13c15d710 0x7ff13c0ceb50 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff13c0ce410 tx=0x7ff138009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36c163d849ff618c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:07:55.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.785+0000 7ff133fff700 1 -- 172.21.15.146:0/1426823368 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13800e070 con 0x7ff13c15d710 2023-10-06T11:07:55.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.785+0000 7ff133fff700 1 -- 172.21.15.146:0/1426823368 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13800ba50 con 0x7ff13c15d710 2023-10-06T11:07:55.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.785+0000 7ff133fff700 1 -- 172.21.15.146:0/1426823368 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1380092e0 con 0x7ff13c15d710 2023-10-06T11:07:55.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.786+0000 7ff1439d3700 1 -- 172.21.15.146:0/1426823368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff13c15d710 msgr2=0x7ff13c0ceb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:07:55.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.786+0000 7ff1439d3700 1 --2- 172.21.15.146:0/1426823368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff13c15d710 0x7ff13c0ceb50 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff13c0ce410 tx=0x7ff138009840 comp rx=0 tx=0).stop 2023-10-06T11:07:55.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.786+0000 7ff1439d3700 1 -- 172.21.15.146:0/1426823368 shutdown_connections 2023-10-06T11:07:55.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.786+0000 7ff1439d3700 1 --2- 172.21.15.146:0/1426823368 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff13c068ac0 0x7ff13c0b04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:55.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.786+0000 7ff1439d3700 1 --2- 172.21.15.146:0/1426823368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff13c15d710 0x7ff13c0ceb50 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:55.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.786+0000 7ff1439d3700 1 --2- 172.21.15.146:0/1426823368 >> v2:172.21.15.151:3300/0 conn(0x7ff13c0aef20 0x7ff13c068580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:55.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.786+0000 7ff1439d3700 1 -- 172.21.15.146:0/1426823368 >> 172.21.15.146:0/1426823368 conn(0x7ff13c067c50 msgr2=0x7ff13c0ce440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:07:55.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.786+0000 7ff1439d3700 1 -- 172.21.15.146:0/1426823368 shutdown_connections 2023-10-06T11:07:55.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.786+0000 7ff1439d3700 1 -- 172.21.15.146:0/1426823368 wait complete. 2023-10-06T11:07:55.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.787+0000 7ff1439d3700 1 Processor -- start 2023-10-06T11:07:55.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.787+0000 7ff1439d3700 1 -- start start 2023-10-06T11:07:55.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.788+0000 7ff1439d3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff13c068ac0 0x7ff13c155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:55.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.788+0000 7ff1439d3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff13c0aef20 0x7ff13c153120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:55.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.788+0000 7ff1439d3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff13c15d710 0x7ff13c157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:55.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.788+0000 7ff1439d3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c1584d0 con 0x7ff13c0aef20 2023-10-06T11:07:55.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.788+0000 7ff1439d3700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c16ae60 con 0x7ff13c15d710 2023-10-06T11:07:55.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.788+0000 7ff1439d3700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff13c157c30 con 0x7ff13c068ac0 2023-10-06T11:07:55.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.788+0000 7ff140f6e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff13c0aef20 0x7ff13c153120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:55.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.788+0000 7ff140f6e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff13c0aef20 0x7ff13c153120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60868/0 (socket says 172.21.15.146:60868) 2023-10-06T11:07:55.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.788+0000 7ff140f6e700 1 -- 172.21.15.146:0/113770099 learned_addr learned my addr 172.21.15.146:0/113770099 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:07:55.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.788+0000 7ff141f70700 1 --2- 172.21.15.146:0/113770099 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff13c15d710 0x7ff13c157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:55.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.788+0000 7ff14176f700 1 --2- 172.21.15.146:0/113770099 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff13c068ac0 0x7ff13c155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:55.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.788+0000 7ff140f6e700 1 -- 172.21.15.146:0/113770099 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff13c068ac0 msgr2=0x7ff13c155020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:07:55.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.788+0000 7ff140f6e700 1 --2- 172.21.15.146:0/113770099 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff13c068ac0 0x7ff13c155020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:55.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.788+0000 7ff140f6e700 1 -- 172.21.15.146:0/113770099 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff13c15d710 msgr2=0x7ff13c157390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:07:55.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.788+0000 7ff140f6e700 1 --2- 172.21.15.146:0/113770099 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff13c15d710 0x7ff13c157390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:55.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.788+0000 7ff140f6e700 1 -- 172.21.15.146:0/113770099 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff138009ae0 con 0x7ff13c0aef20 2023-10-06T11:07:55.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.788+0000 7ff140f6e700 1 --2- 172.21.15.146:0/113770099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff13c0aef20 0x7ff13c153120 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff12c00d860 tx=0x7ff12c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:07:55.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.788+0000 7ff1317fa700 1 -- 172.21.15.146:0/113770099 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12c017070 con 0x7ff13c0aef20 2023-10-06T11:07:55.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.789+0000 7ff1317fa700 1 -- 172.21.15.146:0/113770099 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff12c0125f0 con 0x7ff13c0aef20 2023-10-06T11:07:55.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.789+0000 7ff1439d3700 1 -- 172.21.15.146:0/113770099 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff13c157f10 con 0x7ff13c0aef20 2023-10-06T11:07:55.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.789+0000 7ff1317fa700 1 -- 172.21.15.146:0/113770099 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12c012990 con 0x7ff13c0aef20 2023-10-06T11:07:55.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.789+0000 7ff1439d3700 1 -- 172.21.15.146:0/113770099 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff13c1578d0 con 0x7ff13c0aef20 2023-10-06T11:07:55.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.790+0000 7ff1317fa700 1 -- 172.21.15.146:0/113770099 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff12c012d40 con 0x7ff13c0aef20 2023-10-06T11:07:55.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.790+0000 7ff1317fa700 1 --2- 172.21.15.146:0/113770099 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff120066f30 0x7ff1200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:55.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.790+0000 7ff1317fa700 1 -- 172.21.15.146:0/113770099 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6087+0+0 (secure 0 0 0) 0x7ff12c084660 con 0x7ff13c0aef20 2023-10-06T11:07:55.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.790+0000 7ff14176f700 1 --2- 172.21.15.146:0/113770099 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff120066f30 0x7ff1200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:55.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.791+0000 7ff14176f700 1 --2- 172.21.15.146:0/113770099 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff120066f30 0x7ff1200693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff13c16d030 tx=0x7ff138018000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:07:55.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.792+0000 7ff14cccbb80 1 Processor -- start 2023-10-06T11:07:55.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.792+0000 7ff14cccbb80 1 -- start start 2023-10-06T11:07:55.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.793+0000 7ff14cccbb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f629d27ad0 0x55f629d27ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:55.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.793+0000 7ff14cccbb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f629ce39e0 0x55f629ce05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:55.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.793+0000 7ff14cccbb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f629ce1c10 0x55f629ce0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:55.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.793+0000 7ff14cccbb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f629c60cc0 con 0x55f629ce1c10 2023-10-06T11:07:55.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.793+0000 7ff14cccbb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f629c37ab0 con 0x55f629ce39e0 2023-10-06T11:07:55.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.793+0000 7ff14cccbb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f629c352b0 con 0x55f629d27ad0 2023-10-06T11:07:55.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.793+0000 7ff141f70700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f629ce1c10 0x55f629ce0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:55.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.793+0000 7ff141f70700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f629ce1c10 0x55f629ce0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60880/0 (socket says 172.21.15.146:60880) 2023-10-06T11:07:55.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.793+0000 7ff141f70700 1 -- 172.21.15.146:0/722354816 learned_addr learned my addr 172.21.15.146:0/722354816 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:07:55.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.793+0000 7ff14176f700 1 --2- 172.21.15.146:0/722354816 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f629d27ad0 0x55f629d27ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:55.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.793+0000 7ff141f70700 1 -- 172.21.15.146:0/722354816 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f629d27ad0 msgr2=0x55f629d27ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:07:55.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.793+0000 7ff140f6e700 1 --2- 172.21.15.146:0/722354816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f629ce39e0 0x55f629ce05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:55.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.793+0000 7ff141f70700 1 --2- 172.21.15.146:0/722354816 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f629d27ad0 0x55f629d27ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:55.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.793+0000 7ff141f70700 1 -- 172.21.15.146:0/722354816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f629ce39e0 msgr2=0x55f629ce05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:07:55.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.793+0000 7ff141f70700 1 --2- 172.21.15.146:0/722354816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f629ce39e0 0x55f629ce05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:55.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.793+0000 7ff141f70700 1 -- 172.21.15.146:0/722354816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f629acb2b0 con 0x55f629ce1c10 2023-10-06T11:07:55.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.794+0000 7ff141f70700 1 --2- 172.21.15.146:0/722354816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f629ce1c10 0x55f629ce0b00 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff13400acb0 tx=0x7ff134008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eddc90301f8e03ff server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:07:55.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.794+0000 7ff1267fc700 1 -- 172.21.15.146:0/722354816 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13400a770 con 0x55f629ce1c10 2023-10-06T11:07:55.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.794+0000 7ff1267fc700 1 -- 172.21.15.146:0/722354816 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13400c040 con 0x55f629ce1c10 2023-10-06T11:07:55.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.794+0000 7ff1267fc700 1 -- 172.21.15.146:0/722354816 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13400fee0 con 0x55f629ce1c10 2023-10-06T11:07:55.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.794+0000 7ff14cccbb80 1 -- 172.21.15.146:0/722354816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f629ce1c10 msgr2=0x55f629ce0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:07:55.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.794+0000 7ff14cccbb80 1 --2- 172.21.15.146:0/722354816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f629ce1c10 0x55f629ce0b00 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff13400acb0 tx=0x7ff134008040 comp rx=0 tx=0).stop 2023-10-06T11:07:55.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.794+0000 7ff14cccbb80 1 -- 172.21.15.146:0/722354816 shutdown_connections 2023-10-06T11:07:55.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.794+0000 7ff14cccbb80 1 --2- 172.21.15.146:0/722354816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f629ce1c10 0x55f629ce0b00 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:55.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.794+0000 7ff14cccbb80 1 --2- 172.21.15.146:0/722354816 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f629d27ad0 0x55f629d27ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:55.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.794+0000 7ff14cccbb80 1 --2- 172.21.15.146:0/722354816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f629ce39e0 0x55f629ce05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:55.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.794+0000 7ff14cccbb80 1 -- 172.21.15.146:0/722354816 >> 172.21.15.146:0/722354816 conn(0x55f629ce20b0 msgr2=0x55f629ce2480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:07:55.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.794+0000 7ff14cccbb80 1 -- 172.21.15.146:0/722354816 shutdown_connections 2023-10-06T11:07:55.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.794+0000 7ff14cccbb80 1 -- 172.21.15.146:0/722354816 wait complete. 2023-10-06T11:07:55.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.795+0000 7ff14cccbb80 1 -- start start 2023-10-06T11:07:55.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.795+0000 7ff14cccbb80 1 Processor -- start 2023-10-06T11:07:55.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.796+0000 7ff14cccbb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f629ce1c10 0x55f629d07fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:55.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.796+0000 7ff14cccbb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f629ce39e0 0x55f629d3a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:55.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.796+0000 7ff14cccbb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f629d27ad0 0x55f629d3a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:55.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.796+0000 7ff14cccbb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f629c310a0 con 0x55f629d27ad0 2023-10-06T11:07:55.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.796+0000 7ff14cccbb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f629bdc8d0 con 0x55f629ce39e0 2023-10-06T11:07:55.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.796+0000 7ff14cccbb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f629bf7ee0 con 0x55f629ce1c10 2023-10-06T11:07:55.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.796+0000 7ff14cccbb80 10 client.0 _ll_register_callbacks cb 0x55f629acdf70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:07:55.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.796+0000 7ff141f70700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f629d27ad0 0x55f629d3a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:55.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.796+0000 7ff141f70700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f629d27ad0 0x55f629d3a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60882/0 (socket says 172.21.15.146:60882) 2023-10-06T11:07:55.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.796+0000 7ff141f70700 1 -- 172.21.15.146:0/1913958134 learned_addr learned my addr 172.21.15.146:0/1913958134 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:07:55.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.796+0000 7ff140f6e700 1 --2- 172.21.15.146:0/1913958134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f629ce39e0 0x55f629d3a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:55.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.796+0000 7ff14176f700 1 --2- 172.21.15.146:0/1913958134 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f629ce1c10 0x55f629d07fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:55.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.796+0000 7ff141f70700 1 -- 172.21.15.146:0/1913958134 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f629ce1c10 msgr2=0x55f629d07fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:07:55.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.796+0000 7ff141f70700 1 --2- 172.21.15.146:0/1913958134 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f629ce1c10 0x55f629d07fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:55.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.796+0000 7ff141f70700 1 -- 172.21.15.146:0/1913958134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f629ce39e0 msgr2=0x55f629d3a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:07:55.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.796+0000 7ff141f70700 1 --2- 172.21.15.146:0/1913958134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f629ce39e0 0x55f629d3a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:55.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.796+0000 7ff141f70700 1 -- 172.21.15.146:0/1913958134 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff13400a960 con 0x55f629d27ad0 2023-10-06T11:07:55.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.796+0000 7ff140f6e700 1 --2- 172.21.15.146:0/1913958134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f629ce39e0 0x55f629d3a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:07:55.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.796+0000 7ff141f70700 1 --2- 172.21.15.146:0/1913958134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f629d27ad0 0x55f629d3a6b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff13400f8b0 tx=0x7ff13401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1674353d74d634f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:07:55.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.796+0000 7ff11b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:07:55.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.797+0000 7ff11b7fe700 1 -- 172.21.15.146:0/1913958134 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff134013ea0 con 0x55f629d27ad0 2023-10-06T11:07:55.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.797+0000 7ff11b7fe700 1 -- 172.21.15.146:0/1913958134 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 6087+0+0 (secure 0 0 0) 0x7ff134024450 con 0x55f629d27ad0 2023-10-06T11:07:55.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.797+0000 7ff14cccbb80 1 -- 172.21.15.146:0/1913958134 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f629cd56d0 con 0x55f629d27ad0 2023-10-06T11:07:55.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.797+0000 7ff11b7fe700 1 -- 172.21.15.146:0/1913958134 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff134024820 con 0x55f629d27ad0 2023-10-06T11:07:55.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.797+0000 7ff14cccbb80 10 client.5256 fetch_fsmap learned FSMap version 23 2023-10-06T11:07:55.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.797+0000 7ff14cccbb80 1 -- 172.21.15.146:0/1913958134 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x55f629a6e020 con 0x55f629d27ad0 2023-10-06T11:07:55.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.797+0000 7ff11b7fe700 1 -- 172.21.15.146:0/1913958134 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f629cd56d0 con 0x55f629d27ad0 2023-10-06T11:07:55.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.797+0000 7ff11b7fe700 1 -- 172.21.15.146:0/1913958134 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 23) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff134011040 con 0x55f629d27ad0 2023-10-06T11:07:55.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.797+0000 7ff14cccbb80 10 client.5256 fetch_fsmap finished waiting for FSMap version 23 2023-10-06T11:07:55.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.797+0000 7ff14cccbb80 10 client.5256 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2023-10-06T11:07:55.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.797+0000 7ff14cccbb80 20 client.5256 populate_metadata read hostname 'smithi146' 2023-10-06T11:07:55.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.797+0000 7ff14cccbb80 1 --2- 172.21.15.146:0/1913958134 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x55f629d0d1d0 0x55f629d21ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:55.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.797+0000 7ff14cccbb80 4 client.5256 mds_command: new command op to 4986 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:07:55.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.797+0000 7ff14cccbb80 1 -- 172.21.15.146:0/1913958134 --> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f629cb2600 con 0x55f629d0d1d0 2023-10-06T11:07:55.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.797+0000 7ff14176f700 1 --2- 172.21.15.146:0/1913958134 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x55f629d0d1d0 0x55f629d21ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:55.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.798+0000 7ff11b7fe700 10 client.5256 ms_handle_connect on v2:172.21.15.146:6835/4187213529 2023-10-06T11:07:55.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.798+0000 7ff14176f700 1 --2- 172.21.15.146:0/1913958134 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x55f629d0d1d0 0x55f629d21ef0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=281f20a506b48b26 server_cookie=8bb6fc3485f61f88 in_seq=0 out_seq=0 2023-10-06T11:07:55.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.798+0000 7ff11b7fe700 1 -- 172.21.15.146:0/1913958134 <== mds.0 v2:172.21.15.146:6835/4187213529 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55f629cb2600 con 0x55f629d0d1d0 2023-10-06T11:07:55.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.798+0000 7ff11b7fe700 10 client.5256 handle_command_reply: tid=0 2023-10-06T11:07:55.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.798+0000 7ff14cccbb80 1 client.5256 shutdown 2023-10-06T11:07:55.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.798+0000 7ff14cccbb80 1 -- 172.21.15.146:0/1913958134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f629d27ad0 msgr2=0x55f629d3a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:07:55.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.798+0000 7ff14cccbb80 1 --2- 172.21.15.146:0/1913958134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f629d27ad0 0x55f629d3a6b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff13400f8b0 tx=0x7ff13401c000 comp rx=0 tx=0).stop 2023-10-06T11:07:55.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.798+0000 7ff14cccbb80 1 -- 172.21.15.146:0/1913958134 shutdown_connections 2023-10-06T11:07:55.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.798+0000 7ff14cccbb80 1 --2- 172.21.15.146:0/1913958134 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x55f629d0d1d0 0x55f629d21ef0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:55.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.798+0000 7ff14cccbb80 1 --2- 172.21.15.146:0/1913958134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f629d27ad0 0x55f629d3a6b0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:55.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.798+0000 7ff11b7fe700 0 client.5256 ms_handle_reset on v2:172.21.15.146:6835/4187213529 2023-10-06T11:07:55.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.798+0000 7ff14cccbb80 1 --2- 172.21.15.146:0/1913958134 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f629ce1c10 0x55f629d07fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:55.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.798+0000 7ff14cccbb80 1 --2- 172.21.15.146:0/1913958134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f629ce39e0 0x55f629d3a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:55.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.798+0000 7ff14cccbb80 1 -- 172.21.15.146:0/1913958134 >> 172.21.15.146:0/1913958134 conn(0x55f629ce20b0 msgr2=0x55f629d25330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:07:55.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.799+0000 7ff14cccbb80 1 -- 172.21.15.146:0/1913958134 shutdown_connections 2023-10-06T11:07:55.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.799+0000 7ff14cccbb80 1 -- 172.21.15.146:0/1913958134 wait complete. 2023-10-06T11:07:55.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.799+0000 7ff14cccbb80 20 client.5256 trim_cache size 0 max 16384 2023-10-06T11:07:55.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.814+0000 7ff14cccbb80 1 Processor -- start 2023-10-06T11:07:55.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.814+0000 7ff14cccbb80 1 -- start start 2023-10-06T11:07:55.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.814+0000 7ff14cccbb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f629ce1c10 0x55f629d3a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:55.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.814+0000 7ff14cccbb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f629ce39e0 0x55f629d269f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:55.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.814+0000 7ff14cccbb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f629d27ad0 0x55f629ce05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:55.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.814+0000 7ff14cccbb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f629ab3e70 con 0x55f629d27ad0 2023-10-06T11:07:55.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.814+0000 7ff14cccbb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f629d0d900 con 0x55f629ce1c10 2023-10-06T11:07:55.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.814+0000 7ff14cccbb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f629cde770 con 0x55f629ce39e0 2023-10-06T11:07:55.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.815+0000 7ff141f70700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f629d27ad0 0x55f629ce05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:55.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.815+0000 7ff141f70700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f629d27ad0 0x55f629ce05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60894/0 (socket says 172.21.15.146:60894) 2023-10-06T11:07:55.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.815+0000 7ff141f70700 1 -- 172.21.15.146:0/375368862 learned_addr learned my addr 172.21.15.146:0/375368862 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:07:55.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.815+0000 7ff140f6e700 1 --2- 172.21.15.146:0/375368862 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f629ce39e0 0x55f629d269f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:55.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.815+0000 7ff14176f700 1 --2- 172.21.15.146:0/375368862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f629ce1c10 0x55f629d3a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:55.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.815+0000 7ff141f70700 1 -- 172.21.15.146:0/375368862 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f629ce39e0 msgr2=0x55f629d269f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:07:55.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.815+0000 7ff141f70700 1 --2- 172.21.15.146:0/375368862 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f629ce39e0 0x55f629d269f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:55.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.815+0000 7ff141f70700 1 -- 172.21.15.146:0/375368862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f629ce1c10 msgr2=0x55f629d3a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:07:55.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.815+0000 7ff141f70700 1 --2- 172.21.15.146:0/375368862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f629ce1c10 0x55f629d3a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:55.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.815+0000 7ff141f70700 1 -- 172.21.15.146:0/375368862 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f629bff7c0 con 0x55f629d27ad0 2023-10-06T11:07:55.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.815+0000 7ff14176f700 1 --2- 172.21.15.146:0/375368862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f629ce1c10 0x55f629d3a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:07:55.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.815+0000 7ff141f70700 1 --2- 172.21.15.146:0/375368862 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f629d27ad0 0x55f629ce05c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff13400a7f0 tx=0x7ff134021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc7f03e29bb76939 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:07:55.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.815+0000 7ff126ffd700 1 -- 172.21.15.146:0/375368862 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff134013ae0 con 0x55f629d27ad0 2023-10-06T11:07:55.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.815+0000 7ff126ffd700 1 -- 172.21.15.146:0/375368862 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff134024450 con 0x55f629d27ad0 2023-10-06T11:07:55.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.815+0000 7ff126ffd700 1 -- 172.21.15.146:0/375368862 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff134024820 con 0x55f629d27ad0 2023-10-06T11:07:55.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.816+0000 7ff14cccbb80 1 -- 172.21.15.146:0/375368862 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f629d27ad0 msgr2=0x55f629ce05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:07:55.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.816+0000 7ff14cccbb80 1 --2- 172.21.15.146:0/375368862 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f629d27ad0 0x55f629ce05c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff13400a7f0 tx=0x7ff134021000 comp rx=0 tx=0).stop 2023-10-06T11:07:55.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.816+0000 7ff14cccbb80 1 -- 172.21.15.146:0/375368862 shutdown_connections 2023-10-06T11:07:55.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.816+0000 7ff14cccbb80 1 --2- 172.21.15.146:0/375368862 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f629d27ad0 0x55f629ce05c0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:55.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.816+0000 7ff14cccbb80 1 --2- 172.21.15.146:0/375368862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f629ce1c10 0x55f629d3a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:55.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.816+0000 7ff14cccbb80 1 --2- 172.21.15.146:0/375368862 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f629ce39e0 0x55f629d269f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:55.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.816+0000 7ff14cccbb80 1 -- 172.21.15.146:0/375368862 >> 172.21.15.146:0/375368862 conn(0x55f629ce20b0 msgr2=0x55f629d0be50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:07:55.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.816+0000 7ff14cccbb80 1 -- 172.21.15.146:0/375368862 shutdown_connections 2023-10-06T11:07:55.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.816+0000 7ff14cccbb80 1 -- 172.21.15.146:0/375368862 wait complete. 2023-10-06T11:07:55.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.816+0000 7ff14cccbb80 1 -- start start 2023-10-06T11:07:55.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.817+0000 7ff14cccbb80 1 Processor -- start 2023-10-06T11:07:55.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.817+0000 7ff14cccbb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f629ce1c10 0x55f629d20e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:55.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.817+0000 7ff14cccbb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f629ce39e0 0x55f629d8b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:55.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.817+0000 7ff14cccbb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f629d27ad0 0x55f629d8b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:55.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.817+0000 7ff14cccbb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f629d21900 con 0x55f629d27ad0 2023-10-06T11:07:55.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.817+0000 7ff14cccbb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f629d8be60 con 0x55f629ce1c10 2023-10-06T11:07:55.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.817+0000 7ff14cccbb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f629d38dd0 con 0x55f629ce39e0 2023-10-06T11:07:55.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.817+0000 7ff14cccbb80 10 client.0 _ll_register_callbacks cb 0x55f629d1e8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:07:55.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.817+0000 7ff141f70700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f629d27ad0 0x55f629d8b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:55.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.817+0000 7ff141f70700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f629d27ad0 0x55f629d8b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60906/0 (socket says 172.21.15.146:60906) 2023-10-06T11:07:55.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.817+0000 7ff141f70700 1 -- 172.21.15.146:0/3011378354 learned_addr learned my addr 172.21.15.146:0/3011378354 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:07:55.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.818+0000 7ff14176f700 1 --2- 172.21.15.146:0/3011378354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f629ce1c10 0x55f629d20e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:55.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.818+0000 7ff140f6e700 1 --2- 172.21.15.146:0/3011378354 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f629ce39e0 0x55f629d8b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:55.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.818+0000 7ff141f70700 1 -- 172.21.15.146:0/3011378354 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f629ce39e0 msgr2=0x55f629d8b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:07:55.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.818+0000 7ff141f70700 1 --2- 172.21.15.146:0/3011378354 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f629ce39e0 0x55f629d8b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:55.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.818+0000 7ff141f70700 1 -- 172.21.15.146:0/3011378354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f629ce1c10 msgr2=0x55f629d20e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:07:55.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.818+0000 7ff141f70700 1 --2- 172.21.15.146:0/3011378354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f629ce1c10 0x55f629d20e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:55.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.818+0000 7ff141f70700 1 -- 172.21.15.146:0/3011378354 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f629a6e020 con 0x55f629d27ad0 2023-10-06T11:07:55.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.818+0000 7ff141f70700 1 --2- 172.21.15.146:0/3011378354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f629d27ad0 0x55f629d8b920 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff134024f20 tx=0x7ff134008070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42c1ec3087ec6298 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:07:55.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.818+0000 7ff11b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:07:55.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.818+0000 7ff11b7fe700 1 -- 172.21.15.146:0/3011378354 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff134024d20 con 0x55f629d27ad0 2023-10-06T11:07:55.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.818+0000 7ff11b7fe700 1 -- 172.21.15.146:0/3011378354 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 6087+0+0 (secure 0 0 0) 0x7ff134000e40 con 0x55f629d27ad0 2023-10-06T11:07:55.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.818+0000 7ff14cccbb80 1 -- 172.21.15.146:0/3011378354 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff13400c040 con 0x55f629d27ad0 2023-10-06T11:07:55.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.818+0000 7ff11b7fe700 1 -- 172.21.15.146:0/3011378354 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff134013cf0 con 0x55f629d27ad0 2023-10-06T11:07:55.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.818+0000 7ff14cccbb80 10 client.5262 fetch_fsmap learned FSMap version 23 2023-10-06T11:07:55.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.818+0000 7ff14cccbb80 1 -- 172.21.15.146:0/3011378354 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x55f629be64b0 con 0x55f629d27ad0 2023-10-06T11:07:55.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.818+0000 7ff11b7fe700 1 -- 172.21.15.146:0/3011378354 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13400c040 con 0x55f629d27ad0 2023-10-06T11:07:55.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.818+0000 7ff11b7fe700 1 -- 172.21.15.146:0/3011378354 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 23) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff13400f5d0 con 0x55f629d27ad0 2023-10-06T11:07:55.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.818+0000 7ff14cccbb80 10 client.5262 fetch_fsmap finished waiting for FSMap version 23 2023-10-06T11:07:55.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.818+0000 7ff14cccbb80 10 client.5262 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2023-10-06T11:07:55.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.818+0000 7ff14cccbb80 20 client.5262 populate_metadata read hostname 'smithi146' 2023-10-06T11:07:55.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.818+0000 7ff14cccbb80 1 --2- 172.21.15.146:0/3011378354 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x55f629d25ac0 0x55f629d0fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:55.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.818+0000 7ff14cccbb80 4 client.5262 mds_command: new command op to 4986 tid=0[{"prefix": "perf dump"}] 2023-10-06T11:07:55.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.818+0000 7ff14cccbb80 1 -- 172.21.15.146:0/3011378354 --> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] -- command(tid 0: {"prefix": "perf dump"}) v1 -- 0x55f629bd3e40 con 0x55f629d25ac0 2023-10-06T11:07:55.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.819+0000 7ff14176f700 1 --2- 172.21.15.146:0/3011378354 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x55f629d25ac0 0x55f629d0fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:55.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.819+0000 7ff11b7fe700 10 client.5262 ms_handle_connect on v2:172.21.15.146:6835/4187213529 2023-10-06T11:07:55.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.819+0000 7ff14176f700 1 --2- 172.21.15.146:0/3011378354 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x55f629d25ac0 0x55f629d0fa90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=214d1fe0179b7c35 server_cookie=952b24e5325c7f65 in_seq=0 out_seq=0 2023-10-06T11:07:55.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.819+0000 7ff11b7fe700 1 -- 172.21.15.146:0/3011378354 <== mds.0 v2:172.21.15.146:6835/4187213529 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17056 (crc 0 0 0) 0x55f629bd3e40 con 0x55f629d25ac0 2023-10-06T11:07:55.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.819+0000 7ff11b7fe700 10 client.5262 handle_command_reply: tid=0 2023-10-06T11:07:55.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.819+0000 7ff14cccbb80 1 client.5262 shutdown 2023-10-06T11:07:55.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.819+0000 7ff14cccbb80 1 -- 172.21.15.146:0/3011378354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f629d27ad0 msgr2=0x55f629d8b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:07:55.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.819+0000 7ff14cccbb80 1 --2- 172.21.15.146:0/3011378354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f629d27ad0 0x55f629d8b920 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff134024f20 tx=0x7ff134008070 comp rx=0 tx=0).stop 2023-10-06T11:07:55.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.820+0000 7ff14cccbb80 1 -- 172.21.15.146:0/3011378354 shutdown_connections 2023-10-06T11:07:55.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.820+0000 7ff14cccbb80 1 --2- 172.21.15.146:0/3011378354 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x55f629d25ac0 0x55f629d0fa90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:55.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.820+0000 7ff14cccbb80 1 --2- 172.21.15.146:0/3011378354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f629d27ad0 0x55f629d8b920 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:55.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.820+0000 7ff11b7fe700 0 client.5262 ms_handle_reset on v2:172.21.15.146:6835/4187213529 2023-10-06T11:07:55.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.820+0000 7ff14cccbb80 1 --2- 172.21.15.146:0/3011378354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f629ce1c10 0x55f629d20e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:55.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.820+0000 7ff14cccbb80 1 --2- 172.21.15.146:0/3011378354 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f629ce39e0 0x55f629d8b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:55.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.820+0000 7ff14cccbb80 1 -- 172.21.15.146:0/3011378354 >> 172.21.15.146:0/3011378354 conn(0x55f629ce20b0 msgr2=0x55f629ce05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:07:55.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.820+0000 7ff14cccbb80 1 -- 172.21.15.146:0/3011378354 shutdown_connections 2023-10-06T11:07:55.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.820+0000 7ff14cccbb80 1 -- 172.21.15.146:0/3011378354 wait complete. 2023-10-06T11:07:55.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.820+0000 7ff14cccbb80 20 client.5262 trim_cache size 0 max 16384 2023-10-06T11:07:55.830 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:07:55.830 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-0": { 2023-10-06T11:07:55.830 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 6125, 2023-10-06T11:07:55.830 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 6126, 2023-10-06T11:07:55.830 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 1680474, 2023-10-06T11:07:55.830 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 48601406, 2023-10-06T11:07:55.830 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 9, 2023-10-06T11:07:55.831 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 3, 2023-10-06T11:07:55.831 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 0.435257673, 2023-10-06T11:07:55.831 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 0.185548989, 2023-10-06T11:07:55.831 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 0.085218148, 2023-10-06T11:07:55.831 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.143028232, 2023-10-06T11:07:55.831 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T11:07:55.831 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 6125, 2023-10-06T11:07:55.831 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 4.215681150, 2023-10-06T11:07:55.831 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000688274 2023-10-06T11:07:55.831 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.831 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2023-10-06T11:07:55.831 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 2, 2023-10-06T11:07:55.831 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000258, 2023-10-06T11:07:55.832 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000129 2023-10-06T11:07:55.832 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:07:55.832 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.832 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-1": { 2023-10-06T11:07:55.832 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 4073, 2023-10-06T11:07:55.832 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 4091, 2023-10-06T11:07:55.832 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 1177934, 2023-10-06T11:07:55.832 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 18882929, 2023-10-06T11:07:55.832 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 6, 2023-10-06T11:07:55.832 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 4, 2023-10-06T11:07:55.832 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 0.238134908, 2023-10-06T11:07:55.832 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 0.083628506, 2023-10-06T11:07:55.833 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 0.059327926, 2023-10-06T11:07:55.833 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.083038444, 2023-10-06T11:07:55.833 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T11:07:55.833 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 4090, 2023-10-06T11:07:55.833 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 2.115361387, 2023-10-06T11:07:55.833 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000517203 2023-10-06T11:07:55.833 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.833 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2023-10-06T11:07:55.833 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:07:55.833 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:07:55.833 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:07:55.834 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:07:55.834 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.834 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-2": { 2023-10-06T11:07:55.834 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 34963, 2023-10-06T11:07:55.834 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 60867, 2023-10-06T11:07:55.834 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 12158266, 2023-10-06T11:07:55.834 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 50635231, 2023-10-06T11:07:55.834 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 7, 2023-10-06T11:07:55.834 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 4, 2023-10-06T11:07:55.834 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 2.733268935, 2023-10-06T11:07:55.834 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 1.369626765, 2023-10-06T11:07:55.835 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 1.582230514, 2023-10-06T11:07:55.835 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.063073492, 2023-10-06T11:07:55.835 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T11:07:55.835 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 60866, 2023-10-06T11:07:55.835 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 4.305826554, 2023-10-06T11:07:55.835 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000070742 2023-10-06T11:07:55.835 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.835 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2023-10-06T11:07:55.835 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 88333, 2023-10-06T11:07:55.835 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.012176604, 2023-10-06T11:07:55.835 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000137 2023-10-06T11:07:55.835 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:07:55.836 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.836 INFO:teuthology.orchestra.run.smithi146.stdout: "cct": { 2023-10-06T11:07:55.836 INFO:teuthology.orchestra.run.smithi146.stdout: "total_workers": 1, 2023-10-06T11:07:55.836 INFO:teuthology.orchestra.run.smithi146.stdout: "unhealthy_workers": 0 2023-10-06T11:07:55.836 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.836 INFO:teuthology.orchestra.run.smithi146.stdout: "finisher-MDSRank": { 2023-10-06T11:07:55.836 INFO:teuthology.orchestra.run.smithi146.stdout: "queue_len": 0, 2023-10-06T11:07:55.836 INFO:teuthology.orchestra.run.smithi146.stdout: "complete_latency": { 2023-10-06T11:07:55.836 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 8935, 2023-10-06T11:07:55.836 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 16.166867977, 2023-10-06T11:07:55.836 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.001809386 2023-10-06T11:07:55.837 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:07:55.837 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.837 INFO:teuthology.orchestra.run.smithi146.stdout: "finisher-PurgeQueue": { 2023-10-06T11:07:55.837 INFO:teuthology.orchestra.run.smithi146.stdout: "queue_len": 0, 2023-10-06T11:07:55.837 INFO:teuthology.orchestra.run.smithi146.stdout: "complete_latency": { 2023-10-06T11:07:55.837 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1600, 2023-10-06T11:07:55.837 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.835532154, 2023-10-06T11:07:55.837 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000522207 2023-10-06T11:07:55.837 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:07:55.837 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.837 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": { 2023-10-06T11:07:55.837 INFO:teuthology.orchestra.run.smithi146.stdout: "request": 30501, 2023-10-06T11:07:55.838 INFO:teuthology.orchestra.run.smithi146.stdout: "reply": 30501, 2023-10-06T11:07:55.838 INFO:teuthology.orchestra.run.smithi146.stdout: "reply_latency": { 2023-10-06T11:07:55.838 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 30501, 2023-10-06T11:07:55.838 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 597.723987154, 2023-10-06T11:07:55.838 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.019596865 2023-10-06T11:07:55.838 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.838 INFO:teuthology.orchestra.run.smithi146.stdout: "slow_reply": 0, 2023-10-06T11:07:55.838 INFO:teuthology.orchestra.run.smithi146.stdout: "forward": 0, 2023-10-06T11:07:55.838 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_fetch": 0, 2023-10-06T11:07:55.838 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_commit": 45, 2023-10-06T11:07:55.838 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_split": 0, 2023-10-06T11:07:55.839 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_merge": 0, 2023-10-06T11:07:55.839 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes": 10011, 2023-10-06T11:07:55.839 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_top": 6117, 2023-10-06T11:07:55.839 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_bottom": 3894, 2023-10-06T11:07:55.839 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_pin_tail": 0, 2023-10-06T11:07:55.839 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_pinned": 1272, 2023-10-06T11:07:55.839 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_expired": 7418, 2023-10-06T11:07:55.839 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_with_caps": 403, 2023-10-06T11:07:55.839 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": 403, 2023-10-06T11:07:55.839 INFO:teuthology.orchestra.run.smithi146.stdout: "subtrees": 2, 2023-10-06T11:07:55.839 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse": 57644, 2023-10-06T11:07:55.840 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_hit": 55583, 2023-10-06T11:07:55.840 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_forward": 0, 2023-10-06T11:07:55.840 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_discover": 0, 2023-10-06T11:07:55.840 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_dir_fetch": 0, 2023-10-06T11:07:55.840 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_remote_ino": 0, 2023-10-06T11:07:55.840 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_lock": 1938, 2023-10-06T11:07:55.840 INFO:teuthology.orchestra.run.smithi146.stdout: "load_cent": 622658, 2023-10-06T11:07:55.840 INFO:teuthology.orchestra.run.smithi146.stdout: "q": 0, 2023-10-06T11:07:55.840 INFO:teuthology.orchestra.run.smithi146.stdout: "exported": 0, 2023-10-06T11:07:55.840 INFO:teuthology.orchestra.run.smithi146.stdout: "exported_inodes": 0, 2023-10-06T11:07:55.840 INFO:teuthology.orchestra.run.smithi146.stdout: "imported": 0, 2023-10-06T11:07:55.840 INFO:teuthology.orchestra.run.smithi146.stdout: "imported_inodes": 0, 2023-10-06T11:07:55.840 INFO:teuthology.orchestra.run.smithi146.stdout: "openino_dir_fetch": 0, 2023-10-06T11:07:55.841 INFO:teuthology.orchestra.run.smithi146.stdout: "openino_backtrace_fetch": 0, 2023-10-06T11:07:55.841 INFO:teuthology.orchestra.run.smithi146.stdout: "openino_peer_discover": 0, 2023-10-06T11:07:55.841 INFO:teuthology.orchestra.run.smithi146.stdout: "root_rfiles": 0, 2023-10-06T11:07:55.841 INFO:teuthology.orchestra.run.smithi146.stdout: "root_rbytes": 0, 2023-10-06T11:07:55.841 INFO:teuthology.orchestra.run.smithi146.stdout: "root_rsnaps": 0, 2023-10-06T11:07:55.841 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_backtrace_fetch": 0, 2023-10-06T11:07:55.841 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_set_tag": 0, 2023-10-06T11:07:55.841 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_backtrace_repaired": 0, 2023-10-06T11:07:55.841 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_inotable_repaired": 0, 2023-10-06T11:07:55.841 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_dir_inodes": 0, 2023-10-06T11:07:55.841 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_dir_base_inodes": 0, 2023-10-06T11:07:55.841 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_dirfrag_rstats": 0, 2023-10-06T11:07:55.842 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_file_inodes": 0, 2023-10-06T11:07:55.842 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_inode_file_caps": 0, 2023-10-06T11:07:55.842 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_revoke": 6149, 2023-10-06T11:07:55.842 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_grant": 6004, 2023-10-06T11:07:55.842 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_trunc": 0, 2023-10-06T11:07:55.842 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-06T11:07:55.842 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-06T11:07:55.842 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_caps": 6149, 2023-10-06T11:07:55.842 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_caps_dirty": 2000, 2023-10-06T11:07:55.842 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_cap_release": 26, 2023-10-06T11:07:55.842 INFO:teuthology.orchestra.run.smithi146.stdout: "process_request_cap_release": 17812 2023-10-06T11:07:55.842 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.843 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_cache": { 2023-10-06T11:07:55.843 INFO:teuthology.orchestra.run.smithi146.stdout: "num_strays": 2000, 2023-10-06T11:07:55.843 INFO:teuthology.orchestra.run.smithi146.stdout: "num_strays_delayed": 280, 2023-10-06T11:07:55.843 INFO:teuthology.orchestra.run.smithi146.stdout: "num_strays_enqueuing": 0, 2023-10-06T11:07:55.843 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_created": 4226, 2023-10-06T11:07:55.843 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_enqueued": 1319, 2023-10-06T11:07:55.843 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_reintegrated": 4514, 2023-10-06T11:07:55.843 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_migrated": 0, 2023-10-06T11:07:55.843 INFO:teuthology.orchestra.run.smithi146.stdout: "num_recovering_processing": 0, 2023-10-06T11:07:55.843 INFO:teuthology.orchestra.run.smithi146.stdout: "num_recovering_enqueued": 0, 2023-10-06T11:07:55.843 INFO:teuthology.orchestra.run.smithi146.stdout: "num_recovering_prioritized": 0, 2023-10-06T11:07:55.843 INFO:teuthology.orchestra.run.smithi146.stdout: "recovery_started": 0, 2023-10-06T11:07:55.844 INFO:teuthology.orchestra.run.smithi146.stdout: "recovery_completed": 0, 2023-10-06T11:07:55.844 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_enqueue_scrub": 0, 2023-10-06T11:07:55.844 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_exportdir": 0, 2023-10-06T11:07:55.844 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_flush": 0, 2023-10-06T11:07:55.844 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_fragmentdir": 0, 2023-10-06T11:07:55.844 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_fragstats": 0, 2023-10-06T11:07:55.844 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_inodestats": 0 2023-10-06T11:07:55.844 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.844 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_log": { 2023-10-06T11:07:55.844 INFO:teuthology.orchestra.run.smithi146.stdout: "evadd": 21610, 2023-10-06T11:07:55.844 INFO:teuthology.orchestra.run.smithi146.stdout: "evex": 19629, 2023-10-06T11:07:55.844 INFO:teuthology.orchestra.run.smithi146.stdout: "evtrm": 17596, 2023-10-06T11:07:55.845 INFO:teuthology.orchestra.run.smithi146.stdout: "ev": 4014, 2023-10-06T11:07:55.845 INFO:teuthology.orchestra.run.smithi146.stdout: "evexg": 0, 2023-10-06T11:07:55.845 INFO:teuthology.orchestra.run.smithi146.stdout: "evexd": 2033, 2023-10-06T11:07:55.845 INFO:teuthology.orchestra.run.smithi146.stdout: "segadd": 26, 2023-10-06T11:07:55.845 INFO:teuthology.orchestra.run.smithi146.stdout: "segex": 22, 2023-10-06T11:07:55.845 INFO:teuthology.orchestra.run.smithi146.stdout: "segtrm": 20, 2023-10-06T11:07:55.845 INFO:teuthology.orchestra.run.smithi146.stdout: "seg": 6, 2023-10-06T11:07:55.845 INFO:teuthology.orchestra.run.smithi146.stdout: "segexg": 0, 2023-10-06T11:07:55.845 INFO:teuthology.orchestra.run.smithi146.stdout: "segexd": 2, 2023-10-06T11:07:55.845 INFO:teuthology.orchestra.run.smithi146.stdout: "expos": 62923737, 2023-10-06T11:07:55.845 INFO:teuthology.orchestra.run.smithi146.stdout: "wrpos": 78070748, 2023-10-06T11:07:55.846 INFO:teuthology.orchestra.run.smithi146.stdout: "rdpos": 0, 2023-10-06T11:07:55.846 INFO:teuthology.orchestra.run.smithi146.stdout: "jlat": { 2023-10-06T11:07:55.846 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 6667, 2023-10-06T11:07:55.846 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 110.568708974, 2023-10-06T11:07:55.846 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.016584477 2023-10-06T11:07:55.846 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.846 INFO:teuthology.orchestra.run.smithi146.stdout: "replayed": 0 2023-10-06T11:07:55.846 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.846 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_mem": { 2023-10-06T11:07:55.846 INFO:teuthology.orchestra.run.smithi146.stdout: "ino": 2014, 2023-10-06T11:07:55.846 INFO:teuthology.orchestra.run.smithi146.stdout: "ino+": 2014, 2023-10-06T11:07:55.847 INFO:teuthology.orchestra.run.smithi146.stdout: "ino-": 0, 2023-10-06T11:07:55.847 INFO:teuthology.orchestra.run.smithi146.stdout: "dir": 13, 2023-10-06T11:07:55.847 INFO:teuthology.orchestra.run.smithi146.stdout: "dir+": 13, 2023-10-06T11:07:55.847 INFO:teuthology.orchestra.run.smithi146.stdout: "dir-": 0, 2023-10-06T11:07:55.847 INFO:teuthology.orchestra.run.smithi146.stdout: "dn": 10654, 2023-10-06T11:07:55.847 INFO:teuthology.orchestra.run.smithi146.stdout: "dn+": 20000, 2023-10-06T11:07:55.847 INFO:teuthology.orchestra.run.smithi146.stdout: "dn-": 9346, 2023-10-06T11:07:55.847 INFO:teuthology.orchestra.run.smithi146.stdout: "cap": 403, 2023-10-06T11:07:55.847 INFO:teuthology.orchestra.run.smithi146.stdout: "cap+": 2002, 2023-10-06T11:07:55.847 INFO:teuthology.orchestra.run.smithi146.stdout: "cap-": 1599, 2023-10-06T11:07:55.847 INFO:teuthology.orchestra.run.smithi146.stdout: "rss": 106216, 2023-10-06T11:07:55.848 INFO:teuthology.orchestra.run.smithi146.stdout: "heap": 207104 2023-10-06T11:07:55.848 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.848 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_server": { 2023-10-06T11:07:55.848 INFO:teuthology.orchestra.run.smithi146.stdout: "dispatch_client_request": 43512, 2023-10-06T11:07:55.848 INFO:teuthology.orchestra.run.smithi146.stdout: "dispatch_server_request": 0, 2023-10-06T11:07:55.848 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_request": 30501, 2023-10-06T11:07:55.848 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_session": 6, 2023-10-06T11:07:55.848 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_peer_request": 0, 2023-10-06T11:07:55.848 INFO:teuthology.orchestra.run.smithi146.stdout: "req_create_latency": { 2023-10-06T11:07:55.848 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 2000, 2023-10-06T11:07:55.848 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 1.451177270, 2023-10-06T11:07:55.848 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000725588 2023-10-06T11:07:55.849 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.849 INFO:teuthology.orchestra.run.smithi146.stdout: "req_getattr_latency": { 2023-10-06T11:07:55.849 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1971, 2023-10-06T11:07:55.849 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.678170708, 2023-10-06T11:07:55.849 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000344074 2023-10-06T11:07:55.849 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.849 INFO:teuthology.orchestra.run.smithi146.stdout: "req_getfilelock_latency": { 2023-10-06T11:07:55.849 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:07:55.849 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:07:55.849 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:07:55.849 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.849 INFO:teuthology.orchestra.run.smithi146.stdout: "req_link_latency": { 2023-10-06T11:07:55.850 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 6000, 2023-10-06T11:07:55.850 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 10.221761573, 2023-10-06T11:07:55.850 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.001703626 2023-10-06T11:07:55.850 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.850 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookup_latency": { 2023-10-06T11:07:55.850 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 8003, 2023-10-06T11:07:55.850 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 3.574431503, 2023-10-06T11:07:55.850 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000446636 2023-10-06T11:07:55.850 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.850 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookuphash_latency": { 2023-10-06T11:07:55.850 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:07:55.850 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:07:55.851 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:07:55.851 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.851 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupino_latency": { 2023-10-06T11:07:55.851 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:07:55.851 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:07:55.851 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:07:55.851 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.851 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupname_latency": { 2023-10-06T11:07:55.851 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:07:55.851 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:07:55.851 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:07:55.851 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.851 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupparent_latency": { 2023-10-06T11:07:55.852 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:07:55.852 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:07:55.852 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:07:55.852 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.852 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupsnap_latency": { 2023-10-06T11:07:55.852 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 3, 2023-10-06T11:07:55.852 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.032226986, 2023-10-06T11:07:55.852 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.010742328 2023-10-06T11:07:55.852 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.852 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lssnap_latency": { 2023-10-06T11:07:55.852 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:07:55.852 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:07:55.852 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:07:55.853 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.853 INFO:teuthology.orchestra.run.smithi146.stdout: "req_mkdir_latency": { 2023-10-06T11:07:55.853 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1, 2023-10-06T11:07:55.853 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.002559689, 2023-10-06T11:07:55.853 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.002559689 2023-10-06T11:07:55.853 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.853 INFO:teuthology.orchestra.run.smithi146.stdout: "req_mknod_latency": { 2023-10-06T11:07:55.853 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:07:55.853 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:07:55.853 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:07:55.853 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.853 INFO:teuthology.orchestra.run.smithi146.stdout: "req_mksnap_latency": { 2023-10-06T11:07:55.854 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1, 2023-10-06T11:07:55.854 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.007832496, 2023-10-06T11:07:55.854 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.007832496 2023-10-06T11:07:55.854 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.854 INFO:teuthology.orchestra.run.smithi146.stdout: "req_open_latency": { 2023-10-06T11:07:55.854 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:07:55.854 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:07:55.854 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:07:55.854 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.854 INFO:teuthology.orchestra.run.smithi146.stdout: "req_readdir_latency": { 2023-10-06T11:07:55.854 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 6, 2023-10-06T11:07:55.854 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.098080705, 2023-10-06T11:07:55.855 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.016346784 2023-10-06T11:07:55.855 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.855 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rename_latency": { 2023-10-06T11:07:55.855 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 4514, 2023-10-06T11:07:55.855 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 559.265484035, 2023-10-06T11:07:55.855 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.123895765 2023-10-06T11:07:55.855 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.855 INFO:teuthology.orchestra.run.smithi146.stdout: "req_renamesnap_latency": { 2023-10-06T11:07:55.855 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:07:55.855 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:07:55.855 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:07:55.855 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.856 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rmdir_latency": { 2023-10-06T11:07:55.856 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:07:55.856 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:07:55.856 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:07:55.856 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.856 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rmsnap_latency": { 2023-10-06T11:07:55.856 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1, 2023-10-06T11:07:55.856 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.004579579, 2023-10-06T11:07:55.856 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.004579579 2023-10-06T11:07:55.856 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.856 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rmxattr_latency": { 2023-10-06T11:07:55.856 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:07:55.857 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:07:55.857 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:07:55.857 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.857 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setattr_latency": { 2023-10-06T11:07:55.857 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1, 2023-10-06T11:07:55.857 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000243953, 2023-10-06T11:07:55.857 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000243953 2023-10-06T11:07:55.857 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.857 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setdirlayout_latency": { 2023-10-06T11:07:55.857 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:07:55.857 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:07:55.857 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:07:55.857 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.858 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setfilelock_latency": { 2023-10-06T11:07:55.858 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:07:55.858 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:07:55.858 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:07:55.858 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.858 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setlayout_latency": { 2023-10-06T11:07:55.858 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:07:55.858 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:07:55.858 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:07:55.858 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.858 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setxattr_latency": { 2023-10-06T11:07:55.858 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:07:55.858 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:07:55.859 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:07:55.859 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.859 INFO:teuthology.orchestra.run.smithi146.stdout: "req_symlink_latency": { 2023-10-06T11:07:55.859 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:07:55.859 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:07:55.859 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:07:55.859 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.859 INFO:teuthology.orchestra.run.smithi146.stdout: "req_unlink_latency": { 2023-10-06T11:07:55.859 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 8000, 2023-10-06T11:07:55.859 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 22.387438657, 2023-10-06T11:07:55.859 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.002798429 2023-10-06T11:07:55.859 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.860 INFO:teuthology.orchestra.run.smithi146.stdout: "cap_revoke_eviction": 0, 2023-10-06T11:07:55.860 INFO:teuthology.orchestra.run.smithi146.stdout: "cap_acquisition_throttle": 0, 2023-10-06T11:07:55.860 INFO:teuthology.orchestra.run.smithi146.stdout: "req_getvxattr_latency": { 2023-10-06T11:07:55.860 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:07:55.860 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:07:55.860 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:07:55.860 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:07:55.860 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.860 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_sessions": { 2023-10-06T11:07:55.860 INFO:teuthology.orchestra.run.smithi146.stdout: "session_count": 1, 2023-10-06T11:07:55.860 INFO:teuthology.orchestra.run.smithi146.stdout: "session_add": 1, 2023-10-06T11:07:55.860 INFO:teuthology.orchestra.run.smithi146.stdout: "session_remove": 0, 2023-10-06T11:07:55.861 INFO:teuthology.orchestra.run.smithi146.stdout: "sessions_open": 1, 2023-10-06T11:07:55.861 INFO:teuthology.orchestra.run.smithi146.stdout: "sessions_stale": 0, 2023-10-06T11:07:55.861 INFO:teuthology.orchestra.run.smithi146.stdout: "total_load": 18938, 2023-10-06T11:07:55.861 INFO:teuthology.orchestra.run.smithi146.stdout: "average_load": 18938, 2023-10-06T11:07:55.861 INFO:teuthology.orchestra.run.smithi146.stdout: "avg_session_uptime": 65 2023-10-06T11:07:55.861 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.861 INFO:teuthology.orchestra.run.smithi146.stdout: "mempool": { 2023-10-06T11:07:55.861 INFO:teuthology.orchestra.run.smithi146.stdout: "bloom_filter_bytes": 19265, 2023-10-06T11:07:55.861 INFO:teuthology.orchestra.run.smithi146.stdout: "bloom_filter_items": 19265, 2023-10-06T11:07:55.861 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_alloc_bytes": 0, 2023-10-06T11:07:55.861 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_alloc_items": 0, 2023-10-06T11:07:55.861 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_data_bytes": 0, 2023-10-06T11:07:55.862 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_data_items": 0, 2023-10-06T11:07:55.862 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-06T11:07:55.862 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_onode_items": 0, 2023-10-06T11:07:55.862 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-06T11:07:55.862 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_meta_items": 0, 2023-10-06T11:07:55.862 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_other_bytes": 0, 2023-10-06T11:07:55.862 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_other_items": 0, 2023-10-06T11:07:55.862 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_Buffer_bytes": 0, 2023-10-06T11:07:55.862 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_Buffer_items": 0, 2023-10-06T11:07:55.862 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_Extent_bytes": 0, 2023-10-06T11:07:55.862 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_Extent_items": 0, 2023-10-06T11:07:55.862 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_Blob_bytes": 0, 2023-10-06T11:07:55.863 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_Blob_items": 0, 2023-10-06T11:07:55.863 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_SharedBlob_bytes": 0, 2023-10-06T11:07:55.863 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_SharedBlob_items": 0, 2023-10-06T11:07:55.863 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-06T11:07:55.863 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_inline_bl_items": 0, 2023-10-06T11:07:55.863 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_fsck_bytes": 0, 2023-10-06T11:07:55.863 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_fsck_items": 0, 2023-10-06T11:07:55.863 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_txc_bytes": 0, 2023-10-06T11:07:55.863 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_txc_items": 0, 2023-10-06T11:07:55.863 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-06T11:07:55.863 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_deferred_items": 0, 2023-10-06T11:07:55.863 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_bytes": 0, 2023-10-06T11:07:55.864 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_items": 0, 2023-10-06T11:07:55.864 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_bytes": 0, 2023-10-06T11:07:55.864 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_items": 0, 2023-10-06T11:07:55.864 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_reader_bytes": 0, 2023-10-06T11:07:55.864 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_reader_items": 0, 2023-10-06T11:07:55.864 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_writer_bytes": 0, 2023-10-06T11:07:55.864 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_writer_items": 0, 2023-10-06T11:07:55.864 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_anon_bytes": 8603505, 2023-10-06T11:07:55.864 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_anon_items": 2194, 2023-10-06T11:07:55.864 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_meta_bytes": 0, 2023-10-06T11:07:55.864 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_meta_items": 0, 2023-10-06T11:07:55.864 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_bytes": 0, 2023-10-06T11:07:55.864 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_items": 0, 2023-10-06T11:07:55.865 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_mapbl_bytes": 0, 2023-10-06T11:07:55.865 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_mapbl_items": 0, 2023-10-06T11:07:55.865 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_pglog_bytes": 0, 2023-10-06T11:07:55.865 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_pglog_items": 0, 2023-10-06T11:07:55.865 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_bytes": 6200, 2023-10-06T11:07:55.865 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_items": 80, 2023-10-06T11:07:55.865 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_mapping_bytes": 0, 2023-10-06T11:07:55.865 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_mapping_items": 0, 2023-10-06T11:07:55.865 INFO:teuthology.orchestra.run.smithi146.stdout: "pgmap_bytes": 0, 2023-10-06T11:07:55.865 INFO:teuthology.orchestra.run.smithi146.stdout: "pgmap_items": 0, 2023-10-06T11:07:55.865 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_co_bytes": 14674402, 2023-10-06T11:07:55.865 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_co_items": 547222, 2023-10-06T11:07:55.866 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_1_bytes": 0, 2023-10-06T11:07:55.866 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_1_items": 0, 2023-10-06T11:07:55.866 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_2_bytes": 0, 2023-10-06T11:07:55.866 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_2_items": 0 2023-10-06T11:07:55.866 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.866 INFO:teuthology.orchestra.run.smithi146.stdout: "objecter": { 2023-10-06T11:07:55.866 INFO:teuthology.orchestra.run.smithi146.stdout: "op_active": 0, 2023-10-06T11:07:55.866 INFO:teuthology.orchestra.run.smithi146.stdout: "op_laggy": 0, 2023-10-06T11:07:55.866 INFO:teuthology.orchestra.run.smithi146.stdout: "op_send": 12835, 2023-10-06T11:07:55.866 INFO:teuthology.orchestra.run.smithi146.stdout: "op_send_bytes": 83672816, 2023-10-06T11:07:55.866 INFO:teuthology.orchestra.run.smithi146.stdout: "op_resend": 37, 2023-10-06T11:07:55.866 INFO:teuthology.orchestra.run.smithi146.stdout: "op_reply": 12835, 2023-10-06T11:07:55.867 INFO:teuthology.orchestra.run.smithi146.stdout: "oplen_avg": { 2023-10-06T11:07:55.867 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 12835, 2023-10-06T11:07:55.867 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 22085 2023-10-06T11:07:55.867 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.867 INFO:teuthology.orchestra.run.smithi146.stdout: "op": 12835, 2023-10-06T11:07:55.867 INFO:teuthology.orchestra.run.smithi146.stdout: "op_r": 55, 2023-10-06T11:07:55.867 INFO:teuthology.orchestra.run.smithi146.stdout: "op_w": 12780, 2023-10-06T11:07:55.867 INFO:teuthology.orchestra.run.smithi146.stdout: "op_rmw": 0, 2023-10-06T11:07:55.867 INFO:teuthology.orchestra.run.smithi146.stdout: "op_pg": 0, 2023-10-06T11:07:55.867 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_stat": 32, 2023-10-06T11:07:55.867 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_create": 4571, 2023-10-06T11:07:55.867 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_read": 55, 2023-10-06T11:07:55.867 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_write": 6722, 2023-10-06T11:07:55.868 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_writefull": 52, 2023-10-06T11:07:55.868 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_writesame": 0, 2023-10-06T11:07:55.868 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_append": 0, 2023-10-06T11:07:55.868 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_zero": 1319, 2023-10-06T11:07:55.868 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_truncate": 0, 2023-10-06T11:07:55.868 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_delete": 43, 2023-10-06T11:07:55.868 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_mapext": 0, 2023-10-06T11:07:55.868 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_sparse_read": 0, 2023-10-06T11:07:55.868 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_clonerange": 0, 2023-10-06T11:07:55.868 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_getxattr": 0, 2023-10-06T11:07:55.868 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_setxattr": 9142, 2023-10-06T11:07:55.868 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_cmpxattr": 0, 2023-10-06T11:07:55.868 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_rmxattr": 0, 2023-10-06T11:07:55.869 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_resetxattrs": 0, 2023-10-06T11:07:55.869 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_call": 0, 2023-10-06T11:07:55.869 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_watch": 0, 2023-10-06T11:07:55.869 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_notify": 0, 2023-10-06T11:07:55.869 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_src_cmpxattr": 0, 2023-10-06T11:07:55.869 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_pgls": 0, 2023-10-06T11:07:55.869 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_pgls_filter": 0, 2023-10-06T11:07:55.869 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_other": 0, 2023-10-06T11:07:55.869 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_active": 0, 2023-10-06T11:07:55.869 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_send": 0, 2023-10-06T11:07:55.869 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_resend": 0, 2023-10-06T11:07:55.869 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_ping": 0, 2023-10-06T11:07:55.870 INFO:teuthology.orchestra.run.smithi146.stdout: "poolop_active": 0, 2023-10-06T11:07:55.870 INFO:teuthology.orchestra.run.smithi146.stdout: "poolop_send": 0, 2023-10-06T11:07:55.870 INFO:teuthology.orchestra.run.smithi146.stdout: "poolop_resend": 0, 2023-10-06T11:07:55.870 INFO:teuthology.orchestra.run.smithi146.stdout: "poolstat_active": 0, 2023-10-06T11:07:55.870 INFO:teuthology.orchestra.run.smithi146.stdout: "poolstat_send": 0, 2023-10-06T11:07:55.870 INFO:teuthology.orchestra.run.smithi146.stdout: "poolstat_resend": 0, 2023-10-06T11:07:55.870 INFO:teuthology.orchestra.run.smithi146.stdout: "statfs_active": 0, 2023-10-06T11:07:55.870 INFO:teuthology.orchestra.run.smithi146.stdout: "statfs_send": 0, 2023-10-06T11:07:55.870 INFO:teuthology.orchestra.run.smithi146.stdout: "statfs_resend": 0, 2023-10-06T11:07:55.870 INFO:teuthology.orchestra.run.smithi146.stdout: "command_active": 0, 2023-10-06T11:07:55.870 INFO:teuthology.orchestra.run.smithi146.stdout: "command_send": 0, 2023-10-06T11:07:55.870 INFO:teuthology.orchestra.run.smithi146.stdout: "command_resend": 0, 2023-10-06T11:07:55.871 INFO:teuthology.orchestra.run.smithi146.stdout: "map_epoch": 33, 2023-10-06T11:07:55.871 INFO:teuthology.orchestra.run.smithi146.stdout: "map_full": 0, 2023-10-06T11:07:55.871 INFO:teuthology.orchestra.run.smithi146.stdout: "map_inc": 3, 2023-10-06T11:07:55.871 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_sessions": 8, 2023-10-06T11:07:55.871 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_session_open": 8, 2023-10-06T11:07:55.871 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_session_close": 0, 2023-10-06T11:07:55.871 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_laggy": 0, 2023-10-06T11:07:55.871 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_wr": 123, 2023-10-06T11:07:55.871 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_rd": 0, 2023-10-06T11:07:55.871 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_del": 26 2023-10-06T11:07:55.871 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.871 INFO:teuthology.orchestra.run.smithi146.stdout: "oft": { 2023-10-06T11:07:55.872 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_objs": 1, 2023-10-06T11:07:55.872 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_kv_pairs": 0, 2023-10-06T11:07:55.872 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_updates": 0, 2023-10-06T11:07:55.872 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_removes": 0 2023-10-06T11:07:55.872 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.872 INFO:teuthology.orchestra.run.smithi146.stdout: "purge_queue": { 2023-10-06T11:07:55.872 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing_ops": 0, 2023-10-06T11:07:55.872 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing_ops_high_water": 32, 2023-10-06T11:07:55.872 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing": 0, 2023-10-06T11:07:55.872 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing_high_water": 32, 2023-10-06T11:07:55.872 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executed": 1319, 2023-10-06T11:07:55.872 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_item_in_journal": 0 2023-10-06T11:07:55.873 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.873 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-06T11:07:55.873 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2023-10-06T11:07:55.873 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 104857600, 2023-10-06T11:07:55.873 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2023-10-06T11:07:55.873 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 45157, 2023-10-06T11:07:55.873 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 10947103, 2023-10-06T11:07:55.873 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2023-10-06T11:07:55.873 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 45157, 2023-10-06T11:07:55.873 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2023-10-06T11:07:55.873 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2023-10-06T11:07:55.873 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 45157, 2023-10-06T11:07:55.873 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 10947103, 2023-10-06T11:07:55.874 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2023-10-06T11:07:55.874 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:07:55.874 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:07:55.874 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:07:55.874 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:07:55.874 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.874 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-objecter_bytes": { 2023-10-06T11:07:55.874 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2023-10-06T11:07:55.874 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 104857600, 2023-10-06T11:07:55.874 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2023-10-06T11:07:55.874 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 0, 2023-10-06T11:07:55.875 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 0, 2023-10-06T11:07:55.875 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2023-10-06T11:07:55.875 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 0, 2023-10-06T11:07:55.875 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 12835, 2023-10-06T11:07:55.875 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 83816587, 2023-10-06T11:07:55.875 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 12835, 2023-10-06T11:07:55.875 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 83816587, 2023-10-06T11:07:55.875 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2023-10-06T11:07:55.875 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:07:55.875 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:07:55.875 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:07:55.876 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:07:55.876 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.876 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-objecter_ops": { 2023-10-06T11:07:55.876 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2023-10-06T11:07:55.876 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 1024, 2023-10-06T11:07:55.876 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2023-10-06T11:07:55.876 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 0, 2023-10-06T11:07:55.876 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 0, 2023-10-06T11:07:55.876 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2023-10-06T11:07:55.876 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 0, 2023-10-06T11:07:55.876 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 12835, 2023-10-06T11:07:55.876 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 12835, 2023-10-06T11:07:55.877 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 12835, 2023-10-06T11:07:55.877 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 12835, 2023-10-06T11:07:55.877 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2023-10-06T11:07:55.877 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:07:55.877 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:07:55.877 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:07:55.877 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:07:55.877 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.877 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-write_buf_throttle": { 2023-10-06T11:07:55.877 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2023-10-06T11:07:55.877 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 3758096384, 2023-10-06T11:07:55.877 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2023-10-06T11:07:55.878 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 1319, 2023-10-06T11:07:55.878 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 143771, 2023-10-06T11:07:55.878 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2023-10-06T11:07:55.878 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 1319, 2023-10-06T11:07:55.878 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2023-10-06T11:07:55.878 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2023-10-06T11:07:55.878 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 55, 2023-10-06T11:07:55.878 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 143771, 2023-10-06T11:07:55.878 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2023-10-06T11:07:55.878 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:07:55.878 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:07:55.879 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:07:55.879 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:07:55.879 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:07:55.879 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-write_buf_throttle-0x55b61bcb1e00": { 2023-10-06T11:07:55.879 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 84, 2023-10-06T11:07:55.879 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 3758096384, 2023-10-06T11:07:55.879 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2023-10-06T11:07:55.879 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 21610, 2023-10-06T11:07:55.879 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 73876444, 2023-10-06T11:07:55.879 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2023-10-06T11:07:55.879 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 21610, 2023-10-06T11:07:55.879 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2023-10-06T11:07:55.880 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2023-10-06T11:07:55.880 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 6667, 2023-10-06T11:07:55.880 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 73876360, 2023-10-06T11:07:55.880 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2023-10-06T11:07:55.880 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:07:55.880 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:07:55.880 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:07:55.880 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:07:55.880 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:07:55.880 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:07:55.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.820+0000 7ff1439d3700 1 -- 172.21.15.146:0/113770099 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff120066f30 msgr2=0x7ff1200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:07:55.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.820+0000 7ff1439d3700 1 --2- 172.21.15.146:0/113770099 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff120066f30 0x7ff1200693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff13c16d030 tx=0x7ff138018000 comp rx=0 tx=0).stop 2023-10-06T11:07:55.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.820+0000 7ff1439d3700 1 -- 172.21.15.146:0/113770099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff13c0aef20 msgr2=0x7ff13c153120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:07:55.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.820+0000 7ff1439d3700 1 --2- 172.21.15.146:0/113770099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff13c0aef20 0x7ff13c153120 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff12c00d860 tx=0x7ff12c008040 comp rx=0 tx=0).stop 2023-10-06T11:07:55.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.820+0000 7ff1439d3700 1 -- 172.21.15.146:0/113770099 shutdown_connections 2023-10-06T11:07:55.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.820+0000 7ff1439d3700 1 --2- 172.21.15.146:0/113770099 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff120066f30 0x7ff1200693e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:55.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.820+0000 7ff1439d3700 1 --2- 172.21.15.146:0/113770099 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff13c15d710 0x7ff13c157390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:55.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.820+0000 7ff1439d3700 1 --2- 172.21.15.146:0/113770099 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff13c068ac0 0x7ff13c155020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:55.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.820+0000 7ff1439d3700 1 --2- 172.21.15.146:0/113770099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff13c0aef20 0x7ff13c153120 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:55.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.820+0000 7ff1439d3700 1 -- 172.21.15.146:0/113770099 >> 172.21.15.146:0/113770099 conn(0x7ff13c067c50 msgr2=0x7ff13c1541b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:07:55.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.820+0000 7ff1439d3700 1 -- 172.21.15.146:0/113770099 shutdown_connections 2023-10-06T11:07:55.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:55.820+0000 7ff1439d3700 1 -- 172.21.15.146:0/113770099 wait complete. 2023-10-06T11:07:55.883 INFO:tasks.cephfs.test_scrub_checks:num of strays: 2000 2023-10-06T11:07:55.884 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 scrub start / recursive,scrub_mdsdir 2023-10-06T11:07:56.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.001+0000 7ff9a21d6700 1 Processor -- start 2023-10-06T11:07:56.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.001+0000 7ff9a21d6700 1 -- start start 2023-10-06T11:07:56.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.002+0000 7ff9a21d6700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff99c0ae730 0x7ff99c0aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:56.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.002+0000 7ff9a21d6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff99c0cb950 0x7ff99c0cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:56.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.002+0000 7ff9a21d6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff99c0ae2a0 con 0x7ff99c15a160 2023-10-06T11:07:56.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.002+0000 7ff9a21d6700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff99c15a530 con 0x7ff99c0ae730 2023-10-06T11:07:56.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.002+0000 7ff9a21d6700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff99c0c5cb0 con 0x7ff99c0cb950 2023-10-06T11:07:56.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.002+0000 7ff99b7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff99c15a160 0x7ff99c0c55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44272/0 (socket says 172.21.15.146:44272) 2023-10-06T11:07:56.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.002+0000 7ff99b7fe700 1 -- 172.21.15.146:0/3235593937 learned_addr learned my addr 172.21.15.146:0/3235593937 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:07:56.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.002+0000 7ff99affd700 1 --2- 172.21.15.146:0/3235593937 >> v2:172.21.15.151:3300/0 conn(0x7ff99c0ae730 0x7ff99c0aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:56.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.002+0000 7ff99bfff700 1 --2- 172.21.15.146:0/3235593937 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff99c0cb950 0x7ff99c0cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:56.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.002+0000 7ff99a7fc700 1 -- 172.21.15.146:0/3235593937 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 565831985 0 0) 0x7ff99c0ae2a0 con 0x7ff99c15a160 2023-10-06T11:07:56.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.002+0000 7ff99a7fc700 1 -- 172.21.15.146:0/3235593937 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff988003570 con 0x7ff99c15a160 2023-10-06T11:07:56.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.002+0000 7ff99affd700 1 -- 172.21.15.146:0/3235593937 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff99c0cb950 msgr2=0x7ff99c0cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:07:56.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.002+0000 7ff99affd700 1 --2- 172.21.15.146:0/3235593937 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff99c0cb950 0x7ff99c0cbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.002+0000 7ff99affd700 1 -- 172.21.15.146:0/3235593937 >> v1:172.21.15.146:6789/0 conn(0x7ff99c15a160 legacy=0x7ff99c0c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:07:56.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.002+0000 7ff99affd700 1 -- 172.21.15.146:0/3235593937 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff99c0af0f0 con 0x7ff99c0ae730 2023-10-06T11:07:56.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.002+0000 7ff99bfff700 1 --2- 172.21.15.146:0/3235593937 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff99c0cb950 0x7ff99c0cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:07:56.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.003+0000 7ff99affd700 1 --2- 172.21.15.146:0/3235593937 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff99c0ae730 0x7ff99c0aebb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff9840098e0 tx=0x7ff9840091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb16ab222e22ec92 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:07:56.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.003+0000 7ff99a7fc700 1 -- 172.21.15.146:0/3235593937 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff984011630 con 0x7ff99c0ae730 2023-10-06T11:07:56.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.003+0000 7ff99a7fc700 1 -- 172.21.15.146:0/3235593937 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff984011790 con 0x7ff99c0ae730 2023-10-06T11:07:56.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.003+0000 7ff99a7fc700 1 -- 172.21.15.146:0/3235593937 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff984011b10 con 0x7ff99c0ae730 2023-10-06T11:07:56.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.003+0000 7ff9a21d6700 1 -- 172.21.15.146:0/3235593937 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff99c0ae730 msgr2=0x7ff99c0aebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:07:56.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.003+0000 7ff9a21d6700 1 --2- 172.21.15.146:0/3235593937 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff99c0ae730 0x7ff99c0aebb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff9840098e0 tx=0x7ff9840091a0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.003+0000 7ff9a21d6700 1 -- 172.21.15.146:0/3235593937 shutdown_connections 2023-10-06T11:07:56.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.003+0000 7ff9a21d6700 1 --2- 172.21.15.146:0/3235593937 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff99c0cb950 0x7ff99c0cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.003+0000 7ff9a21d6700 1 --2- 172.21.15.146:0/3235593937 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff99c0ae730 0x7ff99c0aebb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.003+0000 7ff9a21d6700 1 -- 172.21.15.146:0/3235593937 >> 172.21.15.146:0/3235593937 conn(0x7ff99c06f380 msgr2=0x7ff99c0d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:07:56.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.003+0000 7ff9a21d6700 1 -- 172.21.15.146:0/3235593937 shutdown_connections 2023-10-06T11:07:56.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.003+0000 7ff9a21d6700 1 -- 172.21.15.146:0/3235593937 wait complete. 2023-10-06T11:07:56.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.004+0000 7ff9a21d6700 1 Processor -- start 2023-10-06T11:07:56.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.005+0000 7ff9a21d6700 1 -- start start 2023-10-06T11:07:56.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.005+0000 7ff9a21d6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff99c0ae730 0x7ff99c0b54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:56.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.005+0000 7ff9a21d6700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff99c0cb950 0x7ff99c09df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:56.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.005+0000 7ff9a21d6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff99c15a160 0x7ff99c157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:56.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.005+0000 7ff9a21d6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99c0af2e0 con 0x7ff99c0ae730 2023-10-06T11:07:56.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.005+0000 7ff9a21d6700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99c16dff0 con 0x7ff99c0cb950 2023-10-06T11:07:56.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.005+0000 7ff9a21d6700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff99c09e480 con 0x7ff99c15a160 2023-10-06T11:07:56.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.005+0000 7ff99b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff99c0ae730 0x7ff99c0b54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:56.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.005+0000 7ff99b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff99c0ae730 0x7ff99c0b54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60916/0 (socket says 172.21.15.146:60916) 2023-10-06T11:07:56.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.005+0000 7ff99b7fe700 1 -- 172.21.15.146:0/1017227878 learned_addr learned my addr 172.21.15.146:0/1017227878 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:07:56.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.006+0000 7ff99bfff700 1 --2- 172.21.15.146:0/1017227878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff99c15a160 0x7ff99c157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:56.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.005+0000 7ff99affd700 1 --2- 172.21.15.146:0/1017227878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff99c0cb950 0x7ff99c09df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:56.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.006+0000 7ff99b7fe700 1 -- 172.21.15.146:0/1017227878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff99c15a160 msgr2=0x7ff99c157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:07:56.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.006+0000 7ff99b7fe700 1 --2- 172.21.15.146:0/1017227878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff99c15a160 0x7ff99c157620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.006+0000 7ff99b7fe700 1 -- 172.21.15.146:0/1017227878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff99c0cb950 msgr2=0x7ff99c09df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:07:56.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.006+0000 7ff99b7fe700 1 --2- 172.21.15.146:0/1017227878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff99c0cb950 0x7ff99c09df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.006+0000 7ff99b7fe700 1 -- 172.21.15.146:0/1017227878 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff994009420 con 0x7ff99c0ae730 2023-10-06T11:07:56.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.006+0000 7ff99b7fe700 1 --2- 172.21.15.146:0/1017227878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff99c0ae730 0x7ff99c0b54b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff98c00cb10 tx=0x7ff98c0027e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:07:56.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.006+0000 7ff9937fe700 1 -- 172.21.15.146:0/1017227878 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98c0030d0 con 0x7ff99c0ae730 2023-10-06T11:07:56.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.006+0000 7ff9937fe700 1 -- 172.21.15.146:0/1017227878 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff98c005d80 con 0x7ff99c0ae730 2023-10-06T11:07:56.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.006+0000 7ff9937fe700 1 -- 172.21.15.146:0/1017227878 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98c00a820 con 0x7ff99c0ae730 2023-10-06T11:07:56.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.006+0000 7ff9a21d6700 1 -- 172.21.15.146:0/1017227878 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff984009420 con 0x7ff99c0ae730 2023-10-06T11:07:56.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.006+0000 7ff9a21d6700 1 -- 172.21.15.146:0/1017227878 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff99c16e570 con 0x7ff99c0ae730 2023-10-06T11:07:56.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.007+0000 7ff9937fe700 1 -- 172.21.15.146:0/1017227878 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff98c00abd0 con 0x7ff99c0ae730 2023-10-06T11:07:56.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.008+0000 7ff9937fe700 1 --2- 172.21.15.146:0/1017227878 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff97c066f30 0x7ff97c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:56.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.008+0000 7ff9937fe700 1 -- 172.21.15.146:0/1017227878 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6087+0+0 (secure 0 0 0) 0x7ff98c0843d0 con 0x7ff99c0ae730 2023-10-06T11:07:56.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.008+0000 7ff99affd700 1 --2- 172.21.15.146:0/1017227878 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff97c066f30 0x7ff97c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:56.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.008+0000 7ff99affd700 1 --2- 172.21.15.146:0/1017227878 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff97c066f30 0x7ff97c0693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff9840091e0 tx=0x7ff984017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:07:56.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.010+0000 7ff9ab4ceb80 1 Processor -- start 2023-10-06T11:07:56.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.010+0000 7ff9ab4ceb80 1 -- start start 2023-10-06T11:07:56.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.011+0000 7ff9ab4ceb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5614c689fb80 0x5614c6895e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:56.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.011+0000 7ff9ab4ceb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614c6859cc0 0x5614c689f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:56.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.011+0000 7ff9ab4ceb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614c689ff50 0x5614c68548c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:56.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.011+0000 7ff9ab4ceb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614c67d8d70 con 0x5614c689ff50 2023-10-06T11:07:56.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.011+0000 7ff9ab4ceb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614c67afb60 con 0x5614c6859cc0 2023-10-06T11:07:56.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.011+0000 7ff9ab4ceb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5614c67ad360 con 0x5614c689fb80 2023-10-06T11:07:56.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.011+0000 7ff99bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614c689ff50 0x5614c68548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:56.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.011+0000 7ff99bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614c689ff50 0x5614c68548c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60928/0 (socket says 172.21.15.146:60928) 2023-10-06T11:07:56.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.011+0000 7ff99bfff700 1 -- 172.21.15.146:0/1094070342 learned_addr learned my addr 172.21.15.146:0/1094070342 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:07:56.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.011+0000 7ff99b7fe700 1 --2- 172.21.15.146:0/1094070342 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5614c689fb80 0x5614c6895e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:56.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.011+0000 7ff99affd700 1 --2- 172.21.15.146:0/1094070342 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614c6859cc0 0x5614c689f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:56.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.011+0000 7ff99bfff700 1 -- 172.21.15.146:0/1094070342 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5614c689fb80 msgr2=0x5614c6895e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:07:56.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.011+0000 7ff99bfff700 1 --2- 172.21.15.146:0/1094070342 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5614c689fb80 0x5614c6895e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.011+0000 7ff99bfff700 1 -- 172.21.15.146:0/1094070342 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614c6859cc0 msgr2=0x5614c689f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:07:56.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.011+0000 7ff99bfff700 1 --2- 172.21.15.146:0/1094070342 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614c6859cc0 0x5614c689f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.011+0000 7ff99bfff700 1 -- 172.21.15.146:0/1094070342 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5614c6643360 con 0x5614c689ff50 2023-10-06T11:07:56.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.011+0000 7ff99affd700 1 --2- 172.21.15.146:0/1094070342 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614c6859cc0 0x5614c689f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:07:56.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.011+0000 7ff99bfff700 1 --2- 172.21.15.146:0/1094070342 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614c689ff50 0x5614c68548c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff994009e50 tx=0x7ff9940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c3fd9daf6f1c196 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:07:56.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.011+0000 7ff990ff9700 1 -- 172.21.15.146:0/1094070342 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff994011e20 con 0x5614c689ff50 2023-10-06T11:07:56.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.011+0000 7ff990ff9700 1 -- 172.21.15.146:0/1094070342 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff994014440 con 0x5614c689ff50 2023-10-06T11:07:56.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.011+0000 7ff990ff9700 1 -- 172.21.15.146:0/1094070342 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9940147e0 con 0x5614c689ff50 2023-10-06T11:07:56.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.012+0000 7ff9ab4ceb80 1 -- 172.21.15.146:0/1094070342 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614c689ff50 msgr2=0x5614c68548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:07:56.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.012+0000 7ff9ab4ceb80 1 --2- 172.21.15.146:0/1094070342 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614c689ff50 0x5614c68548c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff994009e50 tx=0x7ff9940091a0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.012+0000 7ff9ab4ceb80 1 -- 172.21.15.146:0/1094070342 shutdown_connections 2023-10-06T11:07:56.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.012+0000 7ff9ab4ceb80 1 --2- 172.21.15.146:0/1094070342 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614c689ff50 0x5614c68548c0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.012+0000 7ff9ab4ceb80 1 --2- 172.21.15.146:0/1094070342 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5614c689fb80 0x5614c6895e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.012+0000 7ff9ab4ceb80 1 --2- 172.21.15.146:0/1094070342 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614c6859cc0 0x5614c689f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.012+0000 7ff9ab4ceb80 1 -- 172.21.15.146:0/1094070342 >> 172.21.15.146:0/1094070342 conn(0x5614c685a160 msgr2=0x5614c685a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:07:56.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.012+0000 7ff9ab4ceb80 1 -- 172.21.15.146:0/1094070342 shutdown_connections 2023-10-06T11:07:56.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.012+0000 7ff9ab4ceb80 1 -- 172.21.15.146:0/1094070342 wait complete. 2023-10-06T11:07:56.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.013+0000 7ff9ab4ceb80 1 -- start start 2023-10-06T11:07:56.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.013+0000 7ff9ab4ceb80 1 Processor -- start 2023-10-06T11:07:56.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.013+0000 7ff9ab4ceb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5614c6859cc0 0x5614c6882d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:56.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.013+0000 7ff9ab4ceb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614c689fb80 0x5614c68bb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:56.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.013+0000 7ff9ab4ceb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614c689ff50 0x5614c68547d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:56.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.013+0000 7ff9ab4ceb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614c67a9150 con 0x5614c689ff50 2023-10-06T11:07:56.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.013+0000 7ff9ab4ceb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614c6754980 con 0x5614c689fb80 2023-10-06T11:07:56.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.013+0000 7ff9ab4ceb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5614c676ff90 con 0x5614c6859cc0 2023-10-06T11:07:56.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.013+0000 7ff9ab4ceb80 10 client.0 _ll_register_callbacks cb 0x5614c6646020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:07:56.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.013+0000 7ff99bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614c689ff50 0x5614c68547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:56.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.014+0000 7ff99bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614c689ff50 0x5614c68547d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60934/0 (socket says 172.21.15.146:60934) 2023-10-06T11:07:56.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.014+0000 7ff99bfff700 1 -- 172.21.15.146:0/3206007515 learned_addr learned my addr 172.21.15.146:0/3206007515 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:07:56.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.014+0000 7ff99affd700 1 --2- 172.21.15.146:0/3206007515 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614c689fb80 0x5614c68bb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:56.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.014+0000 7ff99b7fe700 1 --2- 172.21.15.146:0/3206007515 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5614c6859cc0 0x5614c6882d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:56.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.014+0000 7ff99bfff700 1 -- 172.21.15.146:0/3206007515 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5614c6859cc0 msgr2=0x5614c6882d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:07:56.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.014+0000 7ff99bfff700 1 --2- 172.21.15.146:0/3206007515 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5614c6859cc0 0x5614c6882d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.014+0000 7ff99bfff700 1 -- 172.21.15.146:0/3206007515 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614c689fb80 msgr2=0x5614c68bb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:07:56.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.014+0000 7ff99bfff700 1 --2- 172.21.15.146:0/3206007515 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614c689fb80 0x5614c68bb7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.014+0000 7ff99bfff700 1 -- 172.21.15.146:0/3206007515 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff994009b80 con 0x5614c689ff50 2023-10-06T11:07:56.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.014+0000 7ff99affd700 1 --2- 172.21.15.146:0/3206007515 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614c689fb80 0x5614c68bb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:07:56.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.014+0000 7ff99bfff700 1 --2- 172.21.15.146:0/3206007515 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614c689ff50 0x5614c68547d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff994019000 tx=0x7ff99401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e4d97b3f71163f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:07:56.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.014+0000 7ff979ffb700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:07:56.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.014+0000 7ff979ffb700 1 -- 172.21.15.146:0/3206007515 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff994014de0 con 0x5614c689ff50 2023-10-06T11:07:56.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.014+0000 7ff979ffb700 1 -- 172.21.15.146:0/3206007515 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 6087+0+0 (secure 0 0 0) 0x7ff994018070 con 0x5614c689ff50 2023-10-06T11:07:56.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.014+0000 7ff9ab4ceb80 1 -- 172.21.15.146:0/3206007515 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5614c684d780 con 0x5614c689ff50 2023-10-06T11:07:56.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.014+0000 7ff979ffb700 1 -- 172.21.15.146:0/3206007515 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff99401c640 con 0x5614c689ff50 2023-10-06T11:07:56.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.014+0000 7ff9ab4ceb80 10 client.5274 fetch_fsmap learned FSMap version 23 2023-10-06T11:07:56.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.014+0000 7ff9ab4ceb80 1 -- 172.21.15.146:0/3206007515 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x5614c65e60d0 con 0x5614c689ff50 2023-10-06T11:07:56.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.014+0000 7ff979ffb700 1 -- 172.21.15.146:0/3206007515 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5614c684d780 con 0x5614c689ff50 2023-10-06T11:07:56.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.015+0000 7ff979ffb700 1 -- 172.21.15.146:0/3206007515 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 23) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff99401c7a0 con 0x5614c689ff50 2023-10-06T11:07:56.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.015+0000 7ff9ab4ceb80 10 client.5274 fetch_fsmap finished waiting for FSMap version 23 2023-10-06T11:07:56.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.015+0000 7ff9ab4ceb80 10 client.5274 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2023-10-06T11:07:56.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.015+0000 7ff9ab4ceb80 20 client.5274 populate_metadata read hostname 'smithi146' 2023-10-06T11:07:56.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.015+0000 7ff9ab4ceb80 1 --2- 172.21.15.146:0/3206007515 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x5614c6887690 0x5614c6887a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:56.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.015+0000 7ff9ab4ceb80 4 client.5274 mds_command: new command op to 4986 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:07:56.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.015+0000 7ff9ab4ceb80 1 -- 172.21.15.146:0/3206007515 --> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5614c682a6b0 con 0x5614c6887690 2023-10-06T11:07:56.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.015+0000 7ff99b7fe700 1 --2- 172.21.15.146:0/3206007515 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x5614c6887690 0x5614c6887a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:56.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.015+0000 7ff979ffb700 10 client.5274 ms_handle_connect on v2:172.21.15.146:6835/4187213529 2023-10-06T11:07:56.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.015+0000 7ff99b7fe700 1 --2- 172.21.15.146:0/3206007515 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x5614c6887690 0x5614c6887a90 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54d4c1b164a17e5 server_cookie=e1a43e47455c0f1c in_seq=0 out_seq=0 2023-10-06T11:07:56.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.025+0000 7ff979ffb700 1 -- 172.21.15.146:0/3206007515 <== mds.0 v2:172.21.15.146:6835/4187213529 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5614c682a6b0 con 0x5614c6887690 2023-10-06T11:07:56.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.025+0000 7ff979ffb700 10 client.5274 handle_command_reply: tid=0 2023-10-06T11:07:56.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.025+0000 7ff9ab4ceb80 1 client.5274 shutdown 2023-10-06T11:07:56.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.026+0000 7ff9ab4ceb80 1 -- 172.21.15.146:0/3206007515 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614c689ff50 msgr2=0x5614c68547d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:07:56.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.026+0000 7ff9ab4ceb80 1 --2- 172.21.15.146:0/3206007515 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614c689ff50 0x5614c68547d0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff994019000 tx=0x7ff99401c000 comp rx=0 tx=0).stop 2023-10-06T11:07:56.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.026+0000 7ff9ab4ceb80 1 -- 172.21.15.146:0/3206007515 shutdown_connections 2023-10-06T11:07:56.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.026+0000 7ff9ab4ceb80 1 --2- 172.21.15.146:0/3206007515 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x5614c6887690 0x5614c6887a90 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.026+0000 7ff9ab4ceb80 1 --2- 172.21.15.146:0/3206007515 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614c689ff50 0x5614c68547d0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.026+0000 7ff9ab4ceb80 1 --2- 172.21.15.146:0/3206007515 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5614c6859cc0 0x5614c6882d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.026+0000 7ff9ab4ceb80 1 --2- 172.21.15.146:0/3206007515 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614c689fb80 0x5614c68bb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.026+0000 7ff9ab4ceb80 1 -- 172.21.15.146:0/3206007515 >> 172.21.15.146:0/3206007515 conn(0x5614c685a160 msgr2=0x5614c6853830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:07:56.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.026+0000 7ff979ffb700 0 client.5274 ms_handle_reset on v2:172.21.15.146:6835/4187213529 2023-10-06T11:07:56.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.026+0000 7ff9ab4ceb80 1 -- 172.21.15.146:0/3206007515 shutdown_connections 2023-10-06T11:07:56.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.026+0000 7ff9ab4ceb80 1 -- 172.21.15.146:0/3206007515 wait complete. 2023-10-06T11:07:56.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.027+0000 7ff9ab4ceb80 20 client.5274 trim_cache size 0 max 16384 2023-10-06T11:07:56.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.054+0000 7ff9ab4ceb80 1 Processor -- start 2023-10-06T11:07:56.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.054+0000 7ff9ab4ceb80 1 -- start start 2023-10-06T11:07:56.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.056+0000 7ff9ab4ceb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614c6859cc0 0x5614c68510c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:56.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.056+0000 7ff9ab4ceb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614c689fb80 0x5614c6895b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:56.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.056+0000 7ff9ab4ceb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5614c689ff50 0x5614c6896060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:56.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.056+0000 7ff9ab4ceb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614c662bf20 con 0x5614c689fb80 2023-10-06T11:07:56.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.056+0000 7ff9ab4ceb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614c68381c0 con 0x5614c6859cc0 2023-10-06T11:07:56.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.056+0000 7ff9ab4ceb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5614c6856010 con 0x5614c689ff50 2023-10-06T11:07:56.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.056+0000 7ff99affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614c689fb80 0x5614c6895b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:56.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.056+0000 7ff99b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614c6859cc0 0x5614c68510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:56.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.056+0000 7ff99affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614c689fb80 0x5614c6895b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60940/0 (socket says 172.21.15.146:60940) 2023-10-06T11:07:56.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.056+0000 7ff99affd700 1 -- 172.21.15.146:0/3812255068 learned_addr learned my addr 172.21.15.146:0/3812255068 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:07:56.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.056+0000 7ff99b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614c6859cc0 0x5614c68510c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:36586/0 (socket says 172.21.15.146:36586) 2023-10-06T11:07:56.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.056+0000 7ff99bfff700 1 --2- 172.21.15.146:0/3812255068 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5614c689ff50 0x5614c6896060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:56.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.056+0000 7ff99affd700 1 -- 172.21.15.146:0/3812255068 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5614c689ff50 msgr2=0x5614c6896060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:07:56.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.056+0000 7ff99affd700 1 --2- 172.21.15.146:0/3812255068 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5614c689ff50 0x5614c6896060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.056+0000 7ff99affd700 1 -- 172.21.15.146:0/3812255068 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614c6859cc0 msgr2=0x5614c68510c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:07:56.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.056+0000 7ff99affd700 1 --2- 172.21.15.146:0/3812255068 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614c6859cc0 0x5614c68510c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.056+0000 7ff99affd700 1 -- 172.21.15.146:0/3812255068 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5614c6777870 con 0x5614c689fb80 2023-10-06T11:07:56.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.057+0000 7ff99affd700 1 --2- 172.21.15.146:0/3812255068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614c689fb80 0x5614c6895b20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff984013000 tx=0x7ff984021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a322d9547d4bc474 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:07:56.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.057+0000 7ff9917fa700 1 -- 172.21.15.146:0/3812255068 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98402e050 con 0x5614c689fb80 2023-10-06T11:07:56.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.057+0000 7ff9917fa700 1 -- 172.21.15.146:0/3812255068 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff98402f040 con 0x5614c689fb80 2023-10-06T11:07:56.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.057+0000 7ff9917fa700 1 -- 172.21.15.146:0/3812255068 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff984021070 con 0x5614c689fb80 2023-10-06T11:07:56.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.058+0000 7ff9ab4ceb80 1 -- 172.21.15.146:0/3812255068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614c689fb80 msgr2=0x5614c6895b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:07:56.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.058+0000 7ff9ab4ceb80 1 --2- 172.21.15.146:0/3812255068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614c689fb80 0x5614c6895b20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff984013000 tx=0x7ff984021000 comp rx=0 tx=0).stop 2023-10-06T11:07:56.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.059+0000 7ff9ab4ceb80 1 -- 172.21.15.146:0/3812255068 shutdown_connections 2023-10-06T11:07:56.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.059+0000 7ff9ab4ceb80 1 --2- 172.21.15.146:0/3812255068 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5614c689ff50 0x5614c6896060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.059+0000 7ff9ab4ceb80 1 --2- 172.21.15.146:0/3812255068 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614c6859cc0 0x5614c68510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.059+0000 7ff9ab4ceb80 1 --2- 172.21.15.146:0/3812255068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614c689fb80 0x5614c6895b20 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.059+0000 7ff9ab4ceb80 1 -- 172.21.15.146:0/3812255068 >> 172.21.15.146:0/3812255068 conn(0x5614c685a160 msgr2=0x5614c685a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:07:56.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.060+0000 7ff9ab4ceb80 1 -- 172.21.15.146:0/3812255068 shutdown_connections 2023-10-06T11:07:56.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.060+0000 7ff9ab4ceb80 1 -- 172.21.15.146:0/3812255068 wait complete. 2023-10-06T11:07:56.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.060+0000 7ff9ab4ceb80 1 -- start start 2023-10-06T11:07:56.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.061+0000 7ff9ab4ceb80 1 Processor -- start 2023-10-06T11:07:56.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.062+0000 7ff9ab4ceb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614c6859cc0 0x5614c6895f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:56.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.062+0000 7ff9ab4ceb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5614c689fb80 0x5614c6907f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:56.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.062+0000 7ff9ab4ceb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614c689ff50 0x5614c6908470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:56.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.062+0000 7ff9ab4ceb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614c68853f0 con 0x5614c689ff50 2023-10-06T11:07:56.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.062+0000 7ff9ab4ceb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614c68801e0 con 0x5614c6859cc0 2023-10-06T11:07:56.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.062+0000 7ff9ab4ceb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5614c6880420 con 0x5614c689fb80 2023-10-06T11:07:56.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.062+0000 7ff9ab4ceb80 10 client.0 _ll_register_callbacks cb 0x5614c6646020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:07:56.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.062+0000 7ff99bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614c689ff50 0x5614c6908470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:56.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.062+0000 7ff99bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614c689ff50 0x5614c6908470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60948/0 (socket says 172.21.15.146:60948) 2023-10-06T11:07:56.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.062+0000 7ff99bfff700 1 -- 172.21.15.146:0/3557416305 learned_addr learned my addr 172.21.15.146:0/3557416305 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:07:56.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.062+0000 7ff99b7fe700 1 --2- 172.21.15.146:0/3557416305 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614c6859cc0 0x5614c6895f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:56.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.062+0000 7ff99affd700 1 --2- 172.21.15.146:0/3557416305 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5614c689fb80 0x5614c6907f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:56.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.062+0000 7ff99bfff700 1 -- 172.21.15.146:0/3557416305 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5614c689fb80 msgr2=0x5614c6907f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:07:56.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.062+0000 7ff99bfff700 1 --2- 172.21.15.146:0/3557416305 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5614c689fb80 0x5614c6907f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.062+0000 7ff99bfff700 1 -- 172.21.15.146:0/3557416305 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614c6859cc0 msgr2=0x5614c6895f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:07:56.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.062+0000 7ff99bfff700 1 --2- 172.21.15.146:0/3557416305 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614c6859cc0 0x5614c6895f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.062+0000 7ff99bfff700 1 -- 172.21.15.146:0/3557416305 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff99c0af0f0 con 0x5614c689ff50 2023-10-06T11:07:56.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.064+0000 7ff99bfff700 1 --2- 172.21.15.146:0/3557416305 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614c689ff50 0x5614c6908470 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x5614c6858e40 tx=0x7ff994023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a34ebc49ff1f0018 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:07:56.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.064+0000 7ff979ffb700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:07:56.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.065+0000 7ff979ffb700 1 -- 172.21.15.146:0/3557416305 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99401cc10 con 0x5614c689ff50 2023-10-06T11:07:56.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.065+0000 7ff979ffb700 1 -- 172.21.15.146:0/3557416305 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 6087+0+0 (secure 0 0 0) 0x7ff99401c850 con 0x5614c689ff50 2023-10-06T11:07:56.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.065+0000 7ff9ab4ceb80 1 -- 172.21.15.146:0/3557416305 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff994014440 con 0x5614c689ff50 2023-10-06T11:07:56.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.066+0000 7ff979ffb700 1 -- 172.21.15.146:0/3557416305 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff994026620 con 0x5614c689ff50 2023-10-06T11:07:56.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.067+0000 7ff9ab4ceb80 10 client.5280 fetch_fsmap learned FSMap version 23 2023-10-06T11:07:56.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.067+0000 7ff9ab4ceb80 1 -- 172.21.15.146:0/3557416305 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x5614c675e560 con 0x5614c689ff50 2023-10-06T11:07:56.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.067+0000 7ff979ffb700 1 -- 172.21.15.146:0/3557416305 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff994014440 con 0x5614c689ff50 2023-10-06T11:07:56.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.068+0000 7ff979ffb700 1 -- 172.21.15.146:0/3557416305 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 23) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff994026780 con 0x5614c689ff50 2023-10-06T11:07:56.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.068+0000 7ff9ab4ceb80 10 client.5280 fetch_fsmap finished waiting for FSMap version 23 2023-10-06T11:07:56.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.068+0000 7ff9ab4ceb80 10 client.5280 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2023-10-06T11:07:56.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.068+0000 7ff9ab4ceb80 20 client.5280 populate_metadata read hostname 'smithi146' 2023-10-06T11:07:56.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.068+0000 7ff9ab4ceb80 1 --2- 172.21.15.146:0/3557416305 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x5614c6899740 0x5614c69089b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:56.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.068+0000 7ff9ab4ceb80 4 client.5280 mds_command: new command op to 4986 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "scrub_mdsdir"]}] 2023-10-06T11:07:56.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.068+0000 7ff9ab4ceb80 1 -- 172.21.15.146:0/3557416305 --> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "scrub_mdsdir"]}) v1 -- 0x5614c674bef0 con 0x5614c6899740 2023-10-06T11:07:56.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.069+0000 7ff99b7fe700 1 --2- 172.21.15.146:0/3557416305 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x5614c6899740 0x5614c69089b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:56.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.070+0000 7ff979ffb700 10 client.5280 ms_handle_connect on v2:172.21.15.146:6835/4187213529 2023-10-06T11:07:56.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.070+0000 7ff99b7fe700 1 --2- 172.21.15.146:0/3557416305 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x5614c6899740 0x5614c69089b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52e87985ed640e60 server_cookie=8142ad12fbd910a0 in_seq=0 out_seq=0 2023-10-06T11:07:56.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.079+0000 7ff979ffb700 1 -- 172.21.15.146:0/3557416305 <== mds.0 v2:172.21.15.146:6835/4187213529 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5614c674bef0 con 0x5614c6899740 2023-10-06T11:07:56.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.079+0000 7ff979ffb700 10 client.5280 handle_command_reply: tid=0 2023-10-06T11:07:56.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.079+0000 7ff9ab4ceb80 1 client.5280 shutdown 2023-10-06T11:07:56.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.079+0000 7ff9ab4ceb80 1 -- 172.21.15.146:0/3557416305 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614c689ff50 msgr2=0x5614c6908470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:07:56.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.079+0000 7ff9ab4ceb80 1 --2- 172.21.15.146:0/3557416305 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614c689ff50 0x5614c6908470 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x5614c6858e40 tx=0x7ff994023000 comp rx=0 tx=0).stop 2023-10-06T11:07:56.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.079+0000 7ff9ab4ceb80 1 -- 172.21.15.146:0/3557416305 shutdown_connections 2023-10-06T11:07:56.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.079+0000 7ff9ab4ceb80 1 --2- 172.21.15.146:0/3557416305 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x5614c6899740 0x5614c69089b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.079+0000 7ff9ab4ceb80 1 --2- 172.21.15.146:0/3557416305 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5614c689ff50 0x5614c6908470 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.079+0000 7ff9ab4ceb80 1 --2- 172.21.15.146:0/3557416305 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614c6859cc0 0x5614c6895f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.079+0000 7ff9ab4ceb80 1 --2- 172.21.15.146:0/3557416305 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5614c689fb80 0x5614c6907f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.079+0000 7ff9ab4ceb80 1 -- 172.21.15.146:0/3557416305 >> 172.21.15.146:0/3557416305 conn(0x5614c685a160 msgr2=0x5614c68552c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:07:56.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.079+0000 7ff979ffb700 0 client.5280 ms_handle_reset on v2:172.21.15.146:6835/4187213529 2023-10-06T11:07:56.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.079+0000 7ff9ab4ceb80 1 -- 172.21.15.146:0/3557416305 shutdown_connections 2023-10-06T11:07:56.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.079+0000 7ff9ab4ceb80 1 -- 172.21.15.146:0/3557416305 wait complete. 2023-10-06T11:07:56.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.079+0000 7ff9ab4ceb80 20 client.5280 trim_cache size 0 max 16384 2023-10-06T11:07:56.082 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:07:56.083 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0, 2023-10-06T11:07:56.083 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_tag": "c465b52f-3fd7-40ae-9328-5e41e137774d", 2023-10-06T11:07:56.083 INFO:teuthology.orchestra.run.smithi146.stdout: "mode": "asynchronous" 2023-10-06T11:07:56.083 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:07:56.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.080+0000 7ff9a21d6700 1 -- 172.21.15.146:0/1017227878 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff97c066f30 msgr2=0x7ff97c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:07:56.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.080+0000 7ff9a21d6700 1 --2- 172.21.15.146:0/1017227878 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff97c066f30 0x7ff97c0693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff9840091e0 tx=0x7ff984017000 comp rx=0 tx=0).stop 2023-10-06T11:07:56.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.080+0000 7ff9a21d6700 1 -- 172.21.15.146:0/1017227878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff99c0ae730 msgr2=0x7ff99c0b54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:07:56.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.080+0000 7ff9a21d6700 1 --2- 172.21.15.146:0/1017227878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff99c0ae730 0x7ff99c0b54b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff98c00cb10 tx=0x7ff98c0027e0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.080+0000 7ff9a21d6700 1 -- 172.21.15.146:0/1017227878 shutdown_connections 2023-10-06T11:07:56.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.080+0000 7ff9a21d6700 1 --2- 172.21.15.146:0/1017227878 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff97c066f30 0x7ff97c0693e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.080+0000 7ff9a21d6700 1 --2- 172.21.15.146:0/1017227878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff99c15a160 0x7ff99c157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.080+0000 7ff9a21d6700 1 --2- 172.21.15.146:0/1017227878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff99c0ae730 0x7ff99c0b54b0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.080+0000 7ff9a21d6700 1 --2- 172.21.15.146:0/1017227878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff99c0cb950 0x7ff99c09df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.080+0000 7ff9a21d6700 1 -- 172.21.15.146:0/1017227878 >> 172.21.15.146:0/1017227878 conn(0x7ff99c06f380 msgr2=0x7ff99c159560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:07:56.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.080+0000 7ff9a21d6700 1 -- 172.21.15.146:0/1017227878 shutdown_connections 2023-10-06T11:07:56.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.080+0000 7ff9a21d6700 1 -- 172.21.15.146:0/1017227878 wait complete. 2023-10-06T11:07:56.094 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 scrub status 2023-10-06T11:07:56.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.243+0000 7fc67d935700 1 Processor -- start 2023-10-06T11:07:56.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.243+0000 7fc67d935700 1 -- start start 2023-10-06T11:07:56.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.244+0000 7fc67d935700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc67815da60 0x7fc67806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:56.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.244+0000 7fc67d935700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc6780c70a0 0x7fc6780c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:56.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.244+0000 7fc67d935700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc6780c8c40 0x7fc678068480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:56.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.244+0000 7fc67d935700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6780c8270 con 0x7fc6780c70a0 2023-10-06T11:07:56.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.244+0000 7fc67d935700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc67806f340 con 0x7fc6780c8c40 2023-10-06T11:07:56.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.244+0000 7fc67d935700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6780c7660 con 0x7fc67815da60 2023-10-06T11:07:56.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.244+0000 7fc6767fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc6780c70a0 0x7fc6780c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:56.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.244+0000 7fc6777fe700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc6780c8c40 0x7fc678068480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:56.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.244+0000 7fc6767fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc6780c70a0 0x7fc6780c8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60952/0 (socket says 172.21.15.146:60952) 2023-10-06T11:07:56.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.244+0000 7fc6767fc700 1 -- 172.21.15.146:0/3371759296 learned_addr learned my addr 172.21.15.146:0/3371759296 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:07:56.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.244+0000 7fc676ffd700 1 --2- 172.21.15.146:0/3371759296 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc67815da60 0x7fc67806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:56.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.245+0000 7fc6777fe700 1 -- 172.21.15.146:0/3371759296 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc67815da60 msgr2=0x7fc67806ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:07:56.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.245+0000 7fc6777fe700 1 --2- 172.21.15.146:0/3371759296 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc67815da60 0x7fc67806ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.245+0000 7fc6777fe700 1 -- 172.21.15.146:0/3371759296 >> v2:172.21.15.146:3300/0 conn(0x7fc6780c70a0 msgr2=0x7fc6780c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:07:56.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.245+0000 7fc6777fe700 1 --2- 172.21.15.146:0/3371759296 >> v2:172.21.15.146:3300/0 conn(0x7fc6780c70a0 0x7fc6780c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.245+0000 7fc6777fe700 1 -- 172.21.15.146:0/3371759296 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6780c7940 con 0x7fc6780c8c40 2023-10-06T11:07:56.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.245+0000 7fc6767fc700 1 --2- 172.21.15.146:0/3371759296 >> v2:172.21.15.146:3300/0 conn(0x7fc6780c70a0 0x7fc6780c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:07:56.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.245+0000 7fc6777fe700 1 --2- 172.21.15.146:0/3371759296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6780c8c40 0x7fc678068480 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc67806de00 tx=0x7fc670009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfa0cb40ec8079aa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:07:56.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.245+0000 7fc675ffb700 1 -- 172.21.15.146:0/3371759296 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67000e070 con 0x7fc6780c8c40 2023-10-06T11:07:56.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.245+0000 7fc675ffb700 1 -- 172.21.15.146:0/3371759296 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67000bab0 con 0x7fc6780c8c40 2023-10-06T11:07:56.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.245+0000 7fc675ffb700 1 -- 172.21.15.146:0/3371759296 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc67000be70 con 0x7fc6780c8c40 2023-10-06T11:07:56.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.246+0000 7fc67d935700 1 -- 172.21.15.146:0/3371759296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6780c8c40 msgr2=0x7fc678068480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:07:56.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.246+0000 7fc67d935700 1 --2- 172.21.15.146:0/3371759296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6780c8c40 0x7fc678068480 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc67806de00 tx=0x7fc670009780 comp rx=0 tx=0).stop 2023-10-06T11:07:56.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.246+0000 7fc67d935700 1 -- 172.21.15.146:0/3371759296 shutdown_connections 2023-10-06T11:07:56.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.246+0000 7fc67d935700 1 --2- 172.21.15.146:0/3371759296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6780c8c40 0x7fc678068480 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.246+0000 7fc67d935700 1 --2- 172.21.15.146:0/3371759296 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc67815da60 0x7fc67806ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.246+0000 7fc67d935700 1 --2- 172.21.15.146:0/3371759296 >> v2:172.21.15.146:3300/0 conn(0x7fc6780c70a0 0x7fc6780c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.246+0000 7fc67d935700 1 -- 172.21.15.146:0/3371759296 >> 172.21.15.146:0/3371759296 conn(0x7fc6780c9fa0 msgr2=0x7fc67806de70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:07:56.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.246+0000 7fc67d935700 1 -- 172.21.15.146:0/3371759296 shutdown_connections 2023-10-06T11:07:56.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.246+0000 7fc67d935700 1 -- 172.21.15.146:0/3371759296 wait complete. 2023-10-06T11:07:56.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.248+0000 7fc67d935700 1 Processor -- start 2023-10-06T11:07:56.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.248+0000 7fc67d935700 1 -- start start 2023-10-06T11:07:56.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.249+0000 7fc67d935700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6780c70a0 0x7fc67814ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:56.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.249+0000 7fc67d935700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6780c8c40 0x7fc67815f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:56.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.249+0000 7fc67d935700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc67815da60 0x7fc67815fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:56.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.249+0000 7fc67d935700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc67814ec70 con 0x7fc67815da60 2023-10-06T11:07:56.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.249+0000 7fc67d935700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc67814e340 con 0x7fc6780c8c40 2023-10-06T11:07:56.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.249+0000 7fc67d935700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc67814e620 con 0x7fc6780c70a0 2023-10-06T11:07:56.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.249+0000 7fc6777fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc67815da60 0x7fc67815fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:56.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.249+0000 7fc676ffd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6780c70a0 0x7fc67814ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:56.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.249+0000 7fc6777fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc67815da60 0x7fc67815fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60960/0 (socket says 172.21.15.146:60960) 2023-10-06T11:07:56.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.249+0000 7fc6767fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6780c8c40 0x7fc67815f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:56.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.249+0000 7fc6777fe700 1 -- 172.21.15.146:0/2914590572 learned_addr learned my addr 172.21.15.146:0/2914590572 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:07:56.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.250+0000 7fc6767fc700 1 -- 172.21.15.146:0/2914590572 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6780c70a0 msgr2=0x7fc67814ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:07:56.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.250+0000 7fc6767fc700 1 --2- 172.21.15.146:0/2914590572 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6780c70a0 0x7fc67814ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.250+0000 7fc6767fc700 1 -- 172.21.15.146:0/2914590572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc67815da60 msgr2=0x7fc67815fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:07:56.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.250+0000 7fc6767fc700 1 --2- 172.21.15.146:0/2914590572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc67815da60 0x7fc67815fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.250+0000 7fc6767fc700 1 -- 172.21.15.146:0/2914590572 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc66c0094f0 con 0x7fc6780c8c40 2023-10-06T11:07:56.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.250+0000 7fc6777fe700 1 --2- 172.21.15.146:0/2914590572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc67815da60 0x7fc67815fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:07:56.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.250+0000 7fc6767fc700 1 --2- 172.21.15.146:0/2914590572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6780c8c40 0x7fc67815f680 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc66c006fd0 tx=0x7fc66c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:07:56.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.250+0000 7fc65effd700 1 -- 172.21.15.146:0/2914590572 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66c00c730 con 0x7fc6780c8c40 2023-10-06T11:07:56.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.250+0000 7fc65effd700 1 -- 172.21.15.146:0/2914590572 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc66c00c890 con 0x7fc6780c8c40 2023-10-06T11:07:56.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.250+0000 7fc67d935700 1 -- 172.21.15.146:0/2914590572 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc670009a20 con 0x7fc6780c8c40 2023-10-06T11:07:56.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.250+0000 7fc65effd700 1 -- 172.21.15.146:0/2914590572 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66c00cc10 con 0x7fc6780c8c40 2023-10-06T11:07:56.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.250+0000 7fc67d935700 1 -- 172.21.15.146:0/2914590572 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc67814e010 con 0x7fc6780c8c40 2023-10-06T11:07:56.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.252+0000 7fc65effd700 1 -- 172.21.15.146:0/2914590572 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc66c013470 con 0x7fc6780c8c40 2023-10-06T11:07:56.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.253+0000 7fc65effd700 1 --2- 172.21.15.146:0/2914590572 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc664066f30 0x7fc6640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:56.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.253+0000 7fc65effd700 1 -- 172.21.15.146:0/2914590572 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fc66c0847d0 con 0x7fc6780c8c40 2023-10-06T11:07:56.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.253+0000 7fc676ffd700 1 --2- 172.21.15.146:0/2914590572 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc664066f30 0x7fc6640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:56.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.254+0000 7fc676ffd700 1 --2- 172.21.15.146:0/2914590572 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc664066f30 0x7fc6640693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc668009db0 tx=0x7fc6680091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:07:56.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.255+0000 7fc686c2db80 1 Processor -- start 2023-10-06T11:07:56.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.255+0000 7fc686c2db80 1 -- start start 2023-10-06T11:07:56.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.256+0000 7fc686c2db80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55876080aae0 0x55876080aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:56.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.256+0000 7fc686c2db80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587607c69f0 0x5587607c35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:56.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.256+0000 7fc686c2db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5587607c4c20 0x5587607c3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:56.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.256+0000 7fc686c2db80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x558760743cd0 con 0x5587607c69f0 2023-10-06T11:07:56.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.256+0000 7fc686c2db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55876071aac0 con 0x5587607c4c20 2023-10-06T11:07:56.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.256+0000 7fc686c2db80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5587607182c0 con 0x55876080aae0 2023-10-06T11:07:56.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.256+0000 7fc676ffd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55876080aae0 0x55876080aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:56.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.256+0000 7fc6767fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587607c69f0 0x5587607c35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:56.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.257+0000 7fc676ffd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55876080aae0 0x55876080aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:41984/0 (socket says 172.21.15.146:41984) 2023-10-06T11:07:56.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.257+0000 7fc676ffd700 1 -- 172.21.15.146:0/1915469589 learned_addr learned my addr 172.21.15.146:0/1915469589 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:07:56.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.257+0000 7fc6777fe700 1 --2- 172.21.15.146:0/1915469589 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5587607c4c20 0x5587607c3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:56.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.257+0000 7fc676ffd700 1 -- 172.21.15.146:0/1915469589 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5587607c4c20 msgr2=0x5587607c3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:07:56.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.257+0000 7fc676ffd700 1 --2- 172.21.15.146:0/1915469589 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5587607c4c20 0x5587607c3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.257+0000 7fc676ffd700 1 -- 172.21.15.146:0/1915469589 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587607c69f0 msgr2=0x5587607c35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:07:56.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.257+0000 7fc676ffd700 1 --2- 172.21.15.146:0/1915469589 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587607c69f0 0x5587607c35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.257+0000 7fc676ffd700 1 -- 172.21.15.146:0/1915469589 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5587605ae2c0 con 0x55876080aae0 2023-10-06T11:07:56.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.257+0000 7fc676ffd700 1 --2- 172.21.15.146:0/1915469589 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55876080aae0 0x55876080aeb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc668011f50 tx=0x7fc668019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b8da8d61458ffd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:07:56.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.257+0000 7fc657fff700 1 -- 172.21.15.146:0/1915469589 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc668014dc0 con 0x55876080aae0 2023-10-06T11:07:56.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.257+0000 7fc657fff700 1 -- 172.21.15.146:0/1915469589 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc668021450 con 0x55876080aae0 2023-10-06T11:07:56.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.257+0000 7fc657fff700 1 -- 172.21.15.146:0/1915469589 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6680217d0 con 0x55876080aae0 2023-10-06T11:07:56.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.258+0000 7fc686c2db80 1 -- 172.21.15.146:0/1915469589 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55876080aae0 msgr2=0x55876080aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:07:56.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.258+0000 7fc686c2db80 1 --2- 172.21.15.146:0/1915469589 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55876080aae0 0x55876080aeb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc668011f50 tx=0x7fc668019000 comp rx=0 tx=0).stop 2023-10-06T11:07:56.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.258+0000 7fc686c2db80 1 -- 172.21.15.146:0/1915469589 shutdown_connections 2023-10-06T11:07:56.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.258+0000 7fc686c2db80 1 --2- 172.21.15.146:0/1915469589 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5587607c4c20 0x5587607c3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.258+0000 7fc686c2db80 1 --2- 172.21.15.146:0/1915469589 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55876080aae0 0x55876080aeb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.258+0000 7fc686c2db80 1 --2- 172.21.15.146:0/1915469589 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587607c69f0 0x5587607c35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.258+0000 7fc686c2db80 1 -- 172.21.15.146:0/1915469589 >> 172.21.15.146:0/1915469589 conn(0x5587607c50c0 msgr2=0x5587607c5490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:07:56.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.258+0000 7fc686c2db80 1 -- 172.21.15.146:0/1915469589 shutdown_connections 2023-10-06T11:07:56.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.258+0000 7fc686c2db80 1 -- 172.21.15.146:0/1915469589 wait complete. 2023-10-06T11:07:56.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.259+0000 7fc686c2db80 1 -- start start 2023-10-06T11:07:56.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.259+0000 7fc686c2db80 1 Processor -- start 2023-10-06T11:07:56.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.260+0000 7fc686c2db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5587607c4c20 0x558760807830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:56.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.260+0000 7fc686c2db80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587607c69f0 0x5587607eae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:56.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.260+0000 7fc686c2db80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55876080aae0 0x5587607eb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:56.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.260+0000 7fc686c2db80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587607140b0 con 0x5587607c69f0 2023-10-06T11:07:56.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.260+0000 7fc686c2db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587606bf8e0 con 0x5587607c4c20 2023-10-06T11:07:56.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.260+0000 7fc686c2db80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5587606daef0 con 0x55876080aae0 2023-10-06T11:07:56.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.260+0000 7fc686c2db80 10 client.0 _ll_register_callbacks cb 0x5587605b0f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:07:56.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.260+0000 7fc6767fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587607c69f0 0x5587607eae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:56.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.260+0000 7fc6767fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587607c69f0 0x5587607eae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60978/0 (socket says 172.21.15.146:60978) 2023-10-06T11:07:56.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.260+0000 7fc6767fc700 1 -- 172.21.15.146:0/800277749 learned_addr learned my addr 172.21.15.146:0/800277749 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:07:56.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.260+0000 7fc6777fe700 1 --2- 172.21.15.146:0/800277749 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55876080aae0 0x5587607eb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:56.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.260+0000 7fc676ffd700 1 --2- 172.21.15.146:0/800277749 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5587607c4c20 0x558760807830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:56.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.261+0000 7fc6767fc700 1 -- 172.21.15.146:0/800277749 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55876080aae0 msgr2=0x5587607eb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:07:56.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.261+0000 7fc6767fc700 1 --2- 172.21.15.146:0/800277749 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55876080aae0 0x5587607eb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.261+0000 7fc6767fc700 1 -- 172.21.15.146:0/800277749 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5587607c4c20 msgr2=0x558760807830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:07:56.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.261+0000 7fc6767fc700 1 --2- 172.21.15.146:0/800277749 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5587607c4c20 0x558760807830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.261+0000 7fc6767fc700 1 -- 172.21.15.146:0/800277749 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc668011b90 con 0x5587607c69f0 2023-10-06T11:07:56.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.261+0000 7fc6767fc700 1 --2- 172.21.15.146:0/800277749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587607c69f0 0x5587607eae10 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc66c006d20 tx=0x7fc66c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3f41817cce5b2a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:07:56.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.261+0000 7fc6557fa700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:07:56.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.261+0000 7fc6557fa700 1 -- 172.21.15.146:0/800277749 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66c0539f0 con 0x5587607c69f0 2023-10-06T11:07:56.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.261+0000 7fc6557fa700 1 -- 172.21.15.146:0/800277749 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fc66c054c80 con 0x5587607c69f0 2023-10-06T11:07:56.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.261+0000 7fc686c2db80 1 -- 172.21.15.146:0/800277749 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5587607b86e0 con 0x5587607c69f0 2023-10-06T11:07:56.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.261+0000 7fc6557fa700 1 -- 172.21.15.146:0/800277749 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc66c05c2a0 con 0x5587607c69f0 2023-10-06T11:07:56.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.261+0000 7fc686c2db80 10 client.5292 fetch_fsmap learned FSMap version 23 2023-10-06T11:07:56.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.261+0000 7fc686c2db80 1 -- 172.21.15.146:0/800277749 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x558760551030 con 0x5587607c69f0 2023-10-06T11:07:56.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.262+0000 7fc6557fa700 1 -- 172.21.15.146:0/800277749 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5587607b86e0 con 0x5587607c69f0 2023-10-06T11:07:56.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.262+0000 7fc6557fa700 1 -- 172.21.15.146:0/800277749 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 23) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc66c07e070 con 0x5587607c69f0 2023-10-06T11:07:56.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.262+0000 7fc686c2db80 10 client.5292 fetch_fsmap finished waiting for FSMap version 23 2023-10-06T11:07:56.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.262+0000 7fc686c2db80 10 client.5292 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2023-10-06T11:07:56.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.262+0000 7fc686c2db80 20 client.5292 populate_metadata read hostname 'smithi146' 2023-10-06T11:07:56.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.262+0000 7fc686c2db80 1 --2- 172.21.15.146:0/800277749 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x5587607ebaf0 0x5587607ebef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:56.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.262+0000 7fc686c2db80 4 client.5292 mds_command: new command op to 4986 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:07:56.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.262+0000 7fc686c2db80 1 -- 172.21.15.146:0/800277749 --> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558760795610 con 0x5587607ebaf0 2023-10-06T11:07:56.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.262+0000 7fc676ffd700 1 --2- 172.21.15.146:0/800277749 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x5587607ebaf0 0x5587607ebef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:56.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.263+0000 7fc6557fa700 10 client.5292 ms_handle_connect on v2:172.21.15.146:6835/4187213529 2023-10-06T11:07:56.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.263+0000 7fc676ffd700 1 --2- 172.21.15.146:0/800277749 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x5587607ebaf0 0x5587607ebef0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab064ff72ac13f04 server_cookie=2dc31bb711955a23 in_seq=0 out_seq=0 2023-10-06T11:07:56.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.264+0000 7fc6557fa700 1 -- 172.21.15.146:0/800277749 <== mds.0 v2:172.21.15.146:6835/4187213529 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x558760795610 con 0x5587607ebaf0 2023-10-06T11:07:56.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.264+0000 7fc6557fa700 10 client.5292 handle_command_reply: tid=0 2023-10-06T11:07:56.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.264+0000 7fc686c2db80 1 client.5292 shutdown 2023-10-06T11:07:56.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.264+0000 7fc686c2db80 1 -- 172.21.15.146:0/800277749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587607c69f0 msgr2=0x5587607eae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:07:56.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.264+0000 7fc686c2db80 1 --2- 172.21.15.146:0/800277749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587607c69f0 0x5587607eae10 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc66c006d20 tx=0x7fc66c000bc0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.264+0000 7fc686c2db80 1 -- 172.21.15.146:0/800277749 shutdown_connections 2023-10-06T11:07:56.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.264+0000 7fc686c2db80 1 --2- 172.21.15.146:0/800277749 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x5587607ebaf0 0x5587607ebef0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.264+0000 7fc686c2db80 1 --2- 172.21.15.146:0/800277749 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55876080aae0 0x5587607eb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.264+0000 7fc686c2db80 1 --2- 172.21.15.146:0/800277749 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5587607c4c20 0x558760807830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.264+0000 7fc686c2db80 1 --2- 172.21.15.146:0/800277749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587607c69f0 0x5587607eae10 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.264+0000 7fc686c2db80 1 -- 172.21.15.146:0/800277749 >> 172.21.15.146:0/800277749 conn(0x5587607c50c0 msgr2=0x5587607c08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:07:56.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.264+0000 7fc6557fa700 0 client.5292 ms_handle_reset on v2:172.21.15.146:6835/4187213529 2023-10-06T11:07:56.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.264+0000 7fc686c2db80 1 -- 172.21.15.146:0/800277749 shutdown_connections 2023-10-06T11:07:56.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.264+0000 7fc686c2db80 1 -- 172.21.15.146:0/800277749 wait complete. 2023-10-06T11:07:56.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.264+0000 7fc686c2db80 20 client.5292 trim_cache size 0 max 16384 2023-10-06T11:07:56.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.292+0000 7fc686c2db80 1 Processor -- start 2023-10-06T11:07:56.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.292+0000 7fc686c2db80 1 -- start start 2023-10-06T11:07:56.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.293+0000 7fc686c2db80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587607c4c20 0x558760823ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:56.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.293+0000 7fc686c2db80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5587607c69f0 0x5587607ea9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:56.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.293+0000 7fc686c2db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55876080aae0 0x5587608050f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:56.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.293+0000 7fc686c2db80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x558760596e80 con 0x5587607c4c20 2023-10-06T11:07:56.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.293+0000 7fc686c2db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587608238a0 con 0x55876080aae0 2023-10-06T11:07:56.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.294+0000 7fc686c2db80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x558760805cb0 con 0x5587607c69f0 2023-10-06T11:07:56.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.294+0000 7fc676ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587607c4c20 0x558760823ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:56.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.294+0000 7fc676ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587607c4c20 0x558760823ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60994/0 (socket says 172.21.15.146:60994) 2023-10-06T11:07:56.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.294+0000 7fc6767fc700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5587607c69f0 0x5587607ea9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:56.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.294+0000 7fc676ffd700 1 -- 172.21.15.146:0/3389186689 learned_addr learned my addr 172.21.15.146:0/3389186689 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:07:56.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.294+0000 7fc6777fe700 1 --2- 172.21.15.146:0/3389186689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55876080aae0 0x5587608050f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:56.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.294+0000 7fc676ffd700 1 -- 172.21.15.146:0/3389186689 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5587607c69f0 msgr2=0x5587607ea9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:07:56.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.294+0000 7fc676ffd700 1 --2- 172.21.15.146:0/3389186689 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5587607c69f0 0x5587607ea9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.294+0000 7fc676ffd700 1 -- 172.21.15.146:0/3389186689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55876080aae0 msgr2=0x5587608050f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:07:56.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.294+0000 7fc676ffd700 1 --2- 172.21.15.146:0/3389186689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55876080aae0 0x5587608050f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.294+0000 7fc676ffd700 1 -- 172.21.15.146:0/3389186689 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5587607c1870 con 0x5587607c4c20 2023-10-06T11:07:56.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.294+0000 7fc6767fc700 1 --2- 172.21.15.146:0/3389186689 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5587607c69f0 0x5587607ea9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:07:56.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.294+0000 7fc6777fe700 1 --2- 172.21.15.146:0/3389186689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55876080aae0 0x5587608050f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:07:56.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.294+0000 7fc676ffd700 1 --2- 172.21.15.146:0/3389186689 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587607c4c20 0x558760823ad0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc668011930 tx=0x7fc66802d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f65ec42d35cbcc81 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:07:56.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.294+0000 7fc65cff9700 1 -- 172.21.15.146:0/3389186689 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc668031070 con 0x5587607c4c20 2023-10-06T11:07:56.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.295+0000 7fc65cff9700 1 -- 172.21.15.146:0/3389186689 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc668014dc0 con 0x5587607c4c20 2023-10-06T11:07:56.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.295+0000 7fc65cff9700 1 -- 172.21.15.146:0/3389186689 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc668035250 con 0x5587607c4c20 2023-10-06T11:07:56.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.295+0000 7fc686c2db80 1 -- 172.21.15.146:0/3389186689 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587607c4c20 msgr2=0x558760823ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:07:56.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.295+0000 7fc686c2db80 1 --2- 172.21.15.146:0/3389186689 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587607c4c20 0x558760823ad0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc668011930 tx=0x7fc66802d040 comp rx=0 tx=0).stop 2023-10-06T11:07:56.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.295+0000 7fc686c2db80 1 -- 172.21.15.146:0/3389186689 shutdown_connections 2023-10-06T11:07:56.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.295+0000 7fc686c2db80 1 --2- 172.21.15.146:0/3389186689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55876080aae0 0x5587608050f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.295+0000 7fc686c2db80 1 --2- 172.21.15.146:0/3389186689 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587607c4c20 0x558760823ad0 secure :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fc668011930 tx=0x7fc66802d040 comp rx=0 tx=0).stop 2023-10-06T11:07:56.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.295+0000 7fc686c2db80 1 --2- 172.21.15.146:0/3389186689 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5587607c69f0 0x5587607ea9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.295+0000 7fc686c2db80 1 -- 172.21.15.146:0/3389186689 >> 172.21.15.146:0/3389186689 conn(0x5587607c50c0 msgr2=0x5587608086e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:07:56.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.296+0000 7fc686c2db80 1 -- 172.21.15.146:0/3389186689 shutdown_connections 2023-10-06T11:07:56.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.296+0000 7fc686c2db80 1 -- 172.21.15.146:0/3389186689 wait complete. 2023-10-06T11:07:56.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.296+0000 7fc686c2db80 1 -- start start 2023-10-06T11:07:56.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.296+0000 7fc686c2db80 1 Processor -- start 2023-10-06T11:07:56.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.297+0000 7fc686c2db80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587607c69f0 0x5587607eb250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:56.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.297+0000 7fc686c2db80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55876080aae0 0x558760872bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:56.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.297+0000 7fc686c2db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5587607ec6d0 0x5587607bf080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:56.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.297+0000 7fc686c2db80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x558760803a30 con 0x5587607c69f0 2023-10-06T11:07:56.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.297+0000 7fc686c2db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587608737c0 con 0x5587607ec6d0 2023-10-06T11:07:56.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.297+0000 7fc686c2db80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x558760803ba0 con 0x55876080aae0 2023-10-06T11:07:56.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.297+0000 7fc686c2db80 10 client.0 _ll_register_callbacks cb 0x5587605b0f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:07:56.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.298+0000 7fc676ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587607c69f0 0x5587607eb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:56.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.298+0000 7fc676ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587607c69f0 0x5587607eb250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32770/0 (socket says 172.21.15.146:32770) 2023-10-06T11:07:56.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.298+0000 7fc676ffd700 1 -- 172.21.15.146:0/1689818481 learned_addr learned my addr 172.21.15.146:0/1689818481 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:07:56.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.298+0000 7fc6767fc700 1 --2- 172.21.15.146:0/1689818481 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55876080aae0 0x558760872bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:56.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.298+0000 7fc6777fe700 1 --2- 172.21.15.146:0/1689818481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5587607ec6d0 0x5587607bf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:56.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.298+0000 7fc6767fc700 1 -- 172.21.15.146:0/1689818481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5587607ec6d0 msgr2=0x5587607bf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:07:56.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.298+0000 7fc6767fc700 1 --2- 172.21.15.146:0/1689818481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5587607ec6d0 0x5587607bf080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.298+0000 7fc6767fc700 1 -- 172.21.15.146:0/1689818481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587607c69f0 msgr2=0x5587607eb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:07:56.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.298+0000 7fc6767fc700 1 --2- 172.21.15.146:0/1689818481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587607c69f0 0x5587607eb250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.298+0000 7fc6767fc700 1 -- 172.21.15.146:0/1689818481 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558760551030 con 0x55876080aae0 2023-10-06T11:07:56.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.298+0000 7fc676ffd700 1 --2- 172.21.15.146:0/1689818481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587607c69f0 0x5587607eb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:07:56.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.298+0000 7fc6767fc700 1 --2- 172.21.15.146:0/1689818481 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55876080aae0 0x558760872bf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc66c051fa0 tx=0x7fc66c057000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f48006c6307d55d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:07:56.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.298+0000 7fc6557fa700 10 client.0 ms_handle_connect on v2:172.21.15.151:3301/0 2023-10-06T11:07:56.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.298+0000 7fc6557fa700 1 -- 172.21.15.146:0/1689818481 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66c055c80 con 0x55876080aae0 2023-10-06T11:07:56.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.298+0000 7fc6557fa700 1 -- 172.21.15.146:0/1689818481 <== mon.2 v2:172.21.15.151:3301/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 6087+0+0 (secure 0 0 0) 0x7fc66c05c2a0 con 0x55876080aae0 2023-10-06T11:07:56.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.298+0000 7fc686c2db80 1 -- 172.21.15.146:0/1689818481 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc668021450 con 0x55876080aae0 2023-10-06T11:07:56.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.299+0000 7fc6557fa700 1 -- 172.21.15.146:0/1689818481 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc66c053920 con 0x55876080aae0 2023-10-06T11:07:56.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.299+0000 7fc686c2db80 10 client.4835 fetch_fsmap learned FSMap version 23 2023-10-06T11:07:56.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.299+0000 7fc686c2db80 1 -- 172.21.15.146:0/1689818481 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x7fc6780c7940 con 0x55876080aae0 2023-10-06T11:07:56.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.299+0000 7fc6557fa700 1 -- 172.21.15.146:0/1689818481 <== mon.2 v2:172.21.15.151:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc668021450 con 0x55876080aae0 2023-10-06T11:07:56.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.299+0000 7fc6557fa700 1 -- 172.21.15.146:0/1689818481 <== mon.2 v2:172.21.15.151:3301/0 5 ==== fsmap(e 23) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc66c011070 con 0x55876080aae0 2023-10-06T11:07:56.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.299+0000 7fc686c2db80 10 client.4835 fetch_fsmap finished waiting for FSMap version 23 2023-10-06T11:07:56.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.299+0000 7fc686c2db80 10 client.4835 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2023-10-06T11:07:56.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.299+0000 7fc686c2db80 20 client.4835 populate_metadata read hostname 'smithi146' 2023-10-06T11:07:56.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.299+0000 7fc686c2db80 1 --2- 172.21.15.146:0/1689818481 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x5587608661f0 0x5587607bf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:07:56.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.299+0000 7fc686c2db80 4 client.4835 mds_command: new command op to 4986 tid=0[{"prefix": "scrub status"}] 2023-10-06T11:07:56.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.299+0000 7fc686c2db80 1 -- 172.21.15.146:0/1689818481 --> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5587606b6e50 con 0x5587608661f0 2023-10-06T11:07:56.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.299+0000 7fc676ffd700 1 --2- 172.21.15.146:0/1689818481 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x5587608661f0 0x5587607bf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:07:56.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.300+0000 7fc6557fa700 10 client.4835 ms_handle_connect on v2:172.21.15.146:6835/4187213529 2023-10-06T11:07:56.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.300+0000 7fc676ffd700 1 --2- 172.21.15.146:0/1689818481 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x5587608661f0 0x5587607bf5c0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11cbfa3385ff014b server_cookie=3c7e08747ac2d086 in_seq=0 out_seq=0 2023-10-06T11:07:56.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.300+0000 7fc6557fa700 1 -- 172.21.15.146:0/1689818481 <== mds.0 v2:172.21.15.146:6835/4187213529 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+274 (crc 0 0 0) 0x5587606b6e50 con 0x5587608661f0 2023-10-06T11:07:56.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.300+0000 7fc6557fa700 10 client.4835 handle_command_reply: tid=0 2023-10-06T11:07:56.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.300+0000 7fc686c2db80 1 client.4835 shutdown 2023-10-06T11:07:56.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.300+0000 7fc686c2db80 1 -- 172.21.15.146:0/1689818481 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55876080aae0 msgr2=0x558760872bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:07:56.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.300+0000 7fc686c2db80 1 --2- 172.21.15.146:0/1689818481 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55876080aae0 0x558760872bf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc66c051fa0 tx=0x7fc66c057000 comp rx=0 tx=0).stop 2023-10-06T11:07:56.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.301+0000 7fc686c2db80 1 -- 172.21.15.146:0/1689818481 shutdown_connections 2023-10-06T11:07:56.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.301+0000 7fc686c2db80 1 --2- 172.21.15.146:0/1689818481 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x5587608661f0 0x5587607bf5c0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.301+0000 7fc686c2db80 1 --2- 172.21.15.146:0/1689818481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5587607ec6d0 0x5587607bf080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.301+0000 7fc686c2db80 1 --2- 172.21.15.146:0/1689818481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587607c69f0 0x5587607eb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.301+0000 7fc686c2db80 1 --2- 172.21.15.146:0/1689818481 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55876080aae0 0x558760872bf0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.301+0000 7fc686c2db80 1 -- 172.21.15.146:0/1689818481 >> 172.21.15.146:0/1689818481 conn(0x5587607c50c0 msgr2=0x5587608052b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:07:56.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.301+0000 7fc6557fa700 0 client.4835 ms_handle_reset on v2:172.21.15.146:6835/4187213529 2023-10-06T11:07:56.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.301+0000 7fc686c2db80 1 -- 172.21.15.146:0/1689818481 shutdown_connections 2023-10-06T11:07:56.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.301+0000 7fc686c2db80 1 -- 172.21.15.146:0/1689818481 wait complete. 2023-10-06T11:07:56.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.301+0000 7fc686c2db80 20 client.4835 trim_cache size 0 max 16384 2023-10-06T11:07:56.307 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:07:56.307 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "scrub active (198 inodes in the stack)", 2023-10-06T11:07:56.307 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": { 2023-10-06T11:07:56.307 INFO:teuthology.orchestra.run.smithi146.stdout: "c465b52f-3fd7-40ae-9328-5e41e137774d": { 2023-10-06T11:07:56.307 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/", 2023-10-06T11:07:56.308 INFO:teuthology.orchestra.run.smithi146.stdout: "tag": "c465b52f-3fd7-40ae-9328-5e41e137774d", 2023-10-06T11:07:56.308 INFO:teuthology.orchestra.run.smithi146.stdout: "options": "recursive,scrub_mdsdir" 2023-10-06T11:07:56.308 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:07:56.308 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:07:56.308 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:07:56.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.302+0000 7fc67d935700 1 -- 172.21.15.146:0/2914590572 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc664066f30 msgr2=0x7fc6640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:07:56.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.302+0000 7fc67d935700 1 --2- 172.21.15.146:0/2914590572 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc664066f30 0x7fc6640693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc668009db0 tx=0x7fc6680091a0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.302+0000 7fc67d935700 1 -- 172.21.15.146:0/2914590572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6780c8c40 msgr2=0x7fc67815f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:07:56.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.302+0000 7fc67d935700 1 --2- 172.21.15.146:0/2914590572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6780c8c40 0x7fc67815f680 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc66c006fd0 tx=0x7fc66c009250 comp rx=0 tx=0).stop 2023-10-06T11:07:56.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.302+0000 7fc67d935700 1 -- 172.21.15.146:0/2914590572 shutdown_connections 2023-10-06T11:07:56.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.302+0000 7fc67d935700 1 --2- 172.21.15.146:0/2914590572 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc664066f30 0x7fc6640693e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.302+0000 7fc67d935700 1 --2- 172.21.15.146:0/2914590572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc67815da60 0x7fc67815fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.302+0000 7fc67d935700 1 --2- 172.21.15.146:0/2914590572 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6780c70a0 0x7fc67814ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.302+0000 7fc67d935700 1 --2- 172.21.15.146:0/2914590572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6780c8c40 0x7fc67815f680 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:07:56.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.302+0000 7fc67d935700 1 -- 172.21.15.146:0/2914590572 >> 172.21.15.146:0/2914590572 conn(0x7fc6780c9fa0 msgr2=0x7fc67806a470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:07:56.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.302+0000 7fc67d935700 1 -- 172.21.15.146:0/2914590572 shutdown_connections 2023-10-06T11:07:56.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:07:56.302+0000 7fc67d935700 1 -- 172.21.15.146:0/2914590572 wait complete. 2023-10-06T11:07:56.318 INFO:tasks.cephfs.filesystem:scrub status for tag:c465b52f-3fd7-40ae-9328-5e41e137774d - {'path': '/', 'tag': 'c465b52f-3fd7-40ae-9328-5e41e137774d', 'options': 'recursive,scrub_mdsdir'} 2023-10-06T11:08:19.895 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:08:19.898 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:08:26.319 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 scrub status 2023-10-06T11:08:26.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.449+0000 7f0ac4b85700 1 Processor -- start 2023-10-06T11:08:26.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.449+0000 7f0ac4b85700 1 -- start start 2023-10-06T11:08:26.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.450+0000 7f0ac4b85700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0ac015a160 0x7f0ac00c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:26.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.450+0000 7f0ac4b85700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0ac00cb950 0x7f0ac00cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:26.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.450+0000 7f0ac4b85700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac00ae2a0 con 0x7f0ac00ae730 2023-10-06T11:08:26.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.450+0000 7f0ac4b85700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ac015a530 con 0x7f0ac00cb950 2023-10-06T11:08:26.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.450+0000 7f0ac4b85700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ac00ad690 con 0x7f0ac015a160 2023-10-06T11:08:26.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.450+0000 7f0abed9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0ac00cb950 0x7f0ac00cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:26.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.450+0000 7f0abed9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0ac00cb950 0x7f0ac00cbd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56266/0 (socket says 172.21.15.146:56266) 2023-10-06T11:08:26.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.450+0000 7f0abed9d700 1 -- 172.21.15.146:0/1221703505 learned_addr learned my addr 172.21.15.146:0/1221703505 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:26.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.450+0000 7f0abe59c700 1 --2- 172.21.15.146:0/1221703505 >> v2:172.21.15.151:3300/0 conn(0x7f0ac015a160 0x7f0ac00c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:26.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.450+0000 7f0abed9d700 1 -- 172.21.15.146:0/1221703505 >> v2:172.21.15.151:3300/0 conn(0x7f0ac015a160 msgr2=0x7f0ac00c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:26.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.450+0000 7f0abed9d700 1 --2- 172.21.15.146:0/1221703505 >> v2:172.21.15.151:3300/0 conn(0x7f0ac015a160 0x7f0ac00c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.450+0000 7f0abed9d700 1 -- 172.21.15.146:0/1221703505 >> v1:172.21.15.151:6789/0 conn(0x7f0ac00ae730 legacy=0x7f0ac00aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:26.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.450+0000 7f0abed9d700 1 -- 172.21.15.146:0/1221703505 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac00ad970 con 0x7f0ac00cb950 2023-10-06T11:08:26.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.450+0000 7f0abed9d700 1 --2- 172.21.15.146:0/1221703505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ac00cb950 0x7f0ac00cbd70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0065100 tx=0x7f0ab8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dca171f363fdfdb0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:26.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.450+0000 7f0abdd9b700 1 -- 172.21.15.146:0/1221703505 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab800e070 con 0x7f0ac00cb950 2023-10-06T11:08:26.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.450+0000 7f0abdd9b700 1 -- 172.21.15.146:0/1221703505 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab800ba10 con 0x7f0ac00cb950 2023-10-06T11:08:26.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.450+0000 7f0abdd9b700 1 -- 172.21.15.146:0/1221703505 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab80092e0 con 0x7f0ac00cb950 2023-10-06T11:08:26.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.451+0000 7f0ac4b85700 1 -- 172.21.15.146:0/1221703505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ac00cb950 msgr2=0x7f0ac00cbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:26.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.451+0000 7f0ac4b85700 1 --2- 172.21.15.146:0/1221703505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ac00cb950 0x7f0ac00cbd70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0ac0065100 tx=0x7f0ab8009840 comp rx=0 tx=0).stop 2023-10-06T11:08:26.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.451+0000 7f0ac4b85700 1 -- 172.21.15.146:0/1221703505 shutdown_connections 2023-10-06T11:08:26.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.451+0000 7f0ac4b85700 1 --2- 172.21.15.146:0/1221703505 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ac00cb950 0x7f0ac00cbd70 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.451+0000 7f0ac4b85700 1 --2- 172.21.15.146:0/1221703505 >> v2:172.21.15.151:3300/0 conn(0x7f0ac015a160 0x7f0ac00c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.451+0000 7f0ac4b85700 1 -- 172.21.15.146:0/1221703505 >> 172.21.15.146:0/1221703505 conn(0x7f0ac006f380 msgr2=0x7f0ac00d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:26.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.451+0000 7f0ac4b85700 1 -- 172.21.15.146:0/1221703505 shutdown_connections 2023-10-06T11:08:26.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.451+0000 7f0ac4b85700 1 -- 172.21.15.146:0/1221703505 wait complete. 2023-10-06T11:08:26.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.452+0000 7f0ac4b85700 1 Processor -- start 2023-10-06T11:08:26.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.452+0000 7f0ac4b85700 1 -- start start 2023-10-06T11:08:26.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.453+0000 7f0ac4b85700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ac00ae730 0x7f0ac0150750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:26.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.453+0000 7f0ac4b85700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ac00cb950 0x7f0ac00b5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:26.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.453+0000 7f0ac4b85700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ac015a160 0x7f0ac00b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:26.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.453+0000 7f0ac4b85700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac00b5070 con 0x7f0ac00cb950 2023-10-06T11:08:26.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.453+0000 7f0ac4b85700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac0150c90 con 0x7f0ac00ae730 2023-10-06T11:08:26.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.453+0000 7f0ac4b85700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac00b4460 con 0x7f0ac015a160 2023-10-06T11:08:26.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.453+0000 7f0ab5d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ac00cb950 0x7f0ac00b5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:26.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.453+0000 7f0ab5d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ac00cb950 0x7f0ac00b5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56268/0 (socket says 172.21.15.146:56268) 2023-10-06T11:08:26.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.453+0000 7f0ab5d9b700 1 -- 172.21.15.146:0/2171354529 learned_addr learned my addr 172.21.15.146:0/2171354529 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:26.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.453+0000 7f0abed9d700 1 --2- 172.21.15.146:0/2171354529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ac015a160 0x7f0ac00b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:26.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.453+0000 7f0abe59c700 1 --2- 172.21.15.146:0/2171354529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ac00ae730 0x7f0ac0150750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:26.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.453+0000 7f0ab5d9b700 1 -- 172.21.15.146:0/2171354529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ac015a160 msgr2=0x7f0ac00b5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:26.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.453+0000 7f0ab5d9b700 1 --2- 172.21.15.146:0/2171354529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ac015a160 0x7f0ac00b5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.453+0000 7f0ab5d9b700 1 -- 172.21.15.146:0/2171354529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ac00ae730 msgr2=0x7f0ac0150750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:26.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.453+0000 7f0ab5d9b700 1 --2- 172.21.15.146:0/2171354529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ac00ae730 0x7f0ac0150750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.453+0000 7f0ab5d9b700 1 -- 172.21.15.146:0/2171354529 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab8009ae0 con 0x7f0ac00cb950 2023-10-06T11:08:26.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.454+0000 7f0ab5d9b700 1 --2- 172.21.15.146:0/2171354529 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ac00cb950 0x7f0ac00b5710 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f0aa800c600 tx=0x7f0aa8007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:26.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.454+0000 7f0ab6ffd700 1 -- 172.21.15.146:0/2171354529 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa8011590 con 0x7f0ac00cb950 2023-10-06T11:08:26.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.454+0000 7f0ab6ffd700 1 -- 172.21.15.146:0/2171354529 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa80116f0 con 0x7f0ac00cb950 2023-10-06T11:08:26.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.454+0000 7f0ac4b85700 1 -- 172.21.15.146:0/2171354529 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ac00b4740 con 0x7f0ac00cb950 2023-10-06T11:08:26.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.454+0000 7f0ab6ffd700 1 -- 172.21.15.146:0/2171354529 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa8011ab0 con 0x7f0ac00cb950 2023-10-06T11:08:26.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.454+0000 7f0ac4b85700 1 -- 172.21.15.146:0/2171354529 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac00b4d00 con 0x7f0ac00cb950 2023-10-06T11:08:26.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.455+0000 7f0ab6ffd700 1 -- 172.21.15.146:0/2171354529 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0aa801c460 con 0x7f0ac00cb950 2023-10-06T11:08:26.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.456+0000 7f0ab6ffd700 1 --2- 172.21.15.146:0/2171354529 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0aa0066f30 0x7f0aa00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:26.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.456+0000 7f0ab6ffd700 1 -- 172.21.15.146:0/2171354529 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f0aa8084350 con 0x7f0ac00cb950 2023-10-06T11:08:26.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.456+0000 7f0abe59c700 1 --2- 172.21.15.146:0/2171354529 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0aa0066f30 0x7f0aa00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:26.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.456+0000 7f0abe59c700 1 --2- 172.21.15.146:0/2171354529 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0aa0066f30 0x7f0aa00693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0ab00061f0 tx=0x7f0ab0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:26.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.458+0000 7f0acde7db80 1 Processor -- start 2023-10-06T11:08:26.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.458+0000 7f0acde7db80 1 -- start start 2023-10-06T11:08:26.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.459+0000 7f0acde7db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591efa20ae0 0x5591efa20eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:26.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.459+0000 7f0acde7db80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5591ef9dc9f0 0x5591ef9d95d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:26.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.459+0000 7f0acde7db80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5591ef9dac20 0x5591ef9d9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:26.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.459+0000 7f0acde7db80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591ef959cd0 con 0x5591ef9dac20 2023-10-06T11:08:26.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.459+0000 7f0acde7db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591ef930ac0 con 0x5591efa20ae0 2023-10-06T11:08:26.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.459+0000 7f0acde7db80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5591ef92e2c0 con 0x5591ef9dc9f0 2023-10-06T11:08:26.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.459+0000 7f0abed9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5591ef9dac20 0x5591ef9d9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:26.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.459+0000 7f0abed9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5591ef9dac20 0x5591ef9d9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56270/0 (socket says 172.21.15.146:56270) 2023-10-06T11:08:26.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.459+0000 7f0abed9d700 1 -- 172.21.15.146:0/525426438 learned_addr learned my addr 172.21.15.146:0/525426438 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:26.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.459+0000 7f0abe59c700 1 --2- 172.21.15.146:0/525426438 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591efa20ae0 0x5591efa20eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:26.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.459+0000 7f0ab5d9b700 1 --2- 172.21.15.146:0/525426438 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5591ef9dc9f0 0x5591ef9d95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:26.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.459+0000 7f0abed9d700 1 -- 172.21.15.146:0/525426438 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5591ef9dc9f0 msgr2=0x5591ef9d95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:26.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.459+0000 7f0abed9d700 1 --2- 172.21.15.146:0/525426438 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5591ef9dc9f0 0x5591ef9d95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.459+0000 7f0abed9d700 1 -- 172.21.15.146:0/525426438 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591efa20ae0 msgr2=0x5591efa20eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:26.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.459+0000 7f0abed9d700 1 --2- 172.21.15.146:0/525426438 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591efa20ae0 0x5591efa20eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.459+0000 7f0abed9d700 1 -- 172.21.15.146:0/525426438 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5591ef7c42c0 con 0x5591ef9dac20 2023-10-06T11:08:26.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.459+0000 7f0ab5d9b700 1 --2- 172.21.15.146:0/525426438 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5591ef9dc9f0 0x5591ef9d95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:08:26.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.459+0000 7f0abed9d700 1 --2- 172.21.15.146:0/525426438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5591ef9dac20 0x5591ef9d9b10 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8009fd0 tx=0x7f0ab8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45ea6c8bab501123 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:26.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.459+0000 7f0a9f7fe700 1 -- 172.21.15.146:0/525426438 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab800bb80 con 0x5591ef9dac20 2023-10-06T11:08:26.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.459+0000 7f0a9f7fe700 1 -- 172.21.15.146:0/525426438 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab800bce0 con 0x5591ef9dac20 2023-10-06T11:08:26.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.459+0000 7f0a9f7fe700 1 -- 172.21.15.146:0/525426438 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab8012890 con 0x5591ef9dac20 2023-10-06T11:08:26.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.460+0000 7f0acde7db80 1 -- 172.21.15.146:0/525426438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5591ef9dac20 msgr2=0x5591ef9d9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:26.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.460+0000 7f0acde7db80 1 --2- 172.21.15.146:0/525426438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5591ef9dac20 0x5591ef9d9b10 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8009fd0 tx=0x7f0ab8017000 comp rx=0 tx=0).stop 2023-10-06T11:08:26.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.460+0000 7f0acde7db80 1 -- 172.21.15.146:0/525426438 shutdown_connections 2023-10-06T11:08:26.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.460+0000 7f0acde7db80 1 --2- 172.21.15.146:0/525426438 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5591ef9dac20 0x5591ef9d9b10 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.460+0000 7f0acde7db80 1 --2- 172.21.15.146:0/525426438 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591efa20ae0 0x5591efa20eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.460+0000 7f0acde7db80 1 --2- 172.21.15.146:0/525426438 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5591ef9dc9f0 0x5591ef9d95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.460+0000 7f0acde7db80 1 -- 172.21.15.146:0/525426438 >> 172.21.15.146:0/525426438 conn(0x5591ef9db0c0 msgr2=0x5591ef9db490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:26.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.460+0000 7f0acde7db80 1 -- 172.21.15.146:0/525426438 shutdown_connections 2023-10-06T11:08:26.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.460+0000 7f0acde7db80 1 -- 172.21.15.146:0/525426438 wait complete. 2023-10-06T11:08:26.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.461+0000 7f0acde7db80 1 -- start start 2023-10-06T11:08:26.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.461+0000 7f0acde7db80 1 Processor -- start 2023-10-06T11:08:26.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.462+0000 7f0acde7db80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5591ef9dac20 0x5591efa00410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:26.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.462+0000 7f0acde7db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591ef9dc9f0 0x5591efa1d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:26.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.462+0000 7f0acde7db80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5591efa20ae0 0x5591efa1bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:26.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.462+0000 7f0acde7db80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591ef92a0b0 con 0x5591ef9dac20 2023-10-06T11:08:26.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.462+0000 7f0acde7db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591ef8d58e0 con 0x5591ef9dc9f0 2023-10-06T11:08:26.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.462+0000 7f0acde7db80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5591ef8f0ef0 con 0x5591efa20ae0 2023-10-06T11:08:26.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.462+0000 7f0acde7db80 10 client.0 _ll_register_callbacks cb 0x5591ef7c6f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:08:26.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.462+0000 7f0abe59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5591ef9dac20 0x5591efa00410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:26.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.462+0000 7f0abe59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5591ef9dac20 0x5591efa00410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56282/0 (socket says 172.21.15.146:56282) 2023-10-06T11:08:26.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.462+0000 7f0abe59c700 1 -- 172.21.15.146:0/470671142 learned_addr learned my addr 172.21.15.146:0/470671142 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:26.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.462+0000 7f0abed9d700 1 --2- 172.21.15.146:0/470671142 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5591efa20ae0 0x5591efa1bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:26.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.462+0000 7f0ab5d9b700 1 --2- 172.21.15.146:0/470671142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591ef9dc9f0 0x5591efa1d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:26.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.462+0000 7f0abe59c700 1 -- 172.21.15.146:0/470671142 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5591efa20ae0 msgr2=0x5591efa1bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:26.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.462+0000 7f0abe59c700 1 --2- 172.21.15.146:0/470671142 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5591efa20ae0 0x5591efa1bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.462+0000 7f0abe59c700 1 -- 172.21.15.146:0/470671142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591ef9dc9f0 msgr2=0x5591efa1d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:26.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.462+0000 7f0abe59c700 1 --2- 172.21.15.146:0/470671142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591ef9dc9f0 0x5591efa1d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.462+0000 7f0abe59c700 1 -- 172.21.15.146:0/470671142 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac00ad970 con 0x5591ef9dac20 2023-10-06T11:08:26.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.462+0000 7f0ab5d9b700 1 --2- 172.21.15.146:0/470671142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591ef9dc9f0 0x5591efa1d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:08:26.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.462+0000 7f0abe59c700 1 --2- 172.21.15.146:0/470671142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5591ef9dac20 0x5591efa00410 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0016830 tx=0x7f0ab0019040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90e8ea8d135c53f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:26.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.463+0000 7f0a9cff9700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:08:26.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.463+0000 7f0a9cff9700 1 -- 172.21.15.146:0/470671142 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab0014640 con 0x5591ef9dac20 2023-10-06T11:08:26.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.463+0000 7f0a9cff9700 1 -- 172.21.15.146:0/470671142 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f0ab00147a0 con 0x5591ef9dac20 2023-10-06T11:08:26.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.463+0000 7f0acde7db80 1 -- 172.21.15.146:0/470671142 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5591ef9ce6e0 con 0x5591ef9dac20 2023-10-06T11:08:26.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.463+0000 7f0a9cff9700 1 -- 172.21.15.146:0/470671142 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ab0014b70 con 0x5591ef9dac20 2023-10-06T11:08:26.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.463+0000 7f0acde7db80 10 client.5310 fetch_fsmap learned FSMap version 27 2023-10-06T11:08:26.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.463+0000 7f0acde7db80 1 -- 172.21.15.146:0/470671142 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x5591ef767030 con 0x5591ef9dac20 2023-10-06T11:08:26.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.463+0000 7f0a9cff9700 1 -- 172.21.15.146:0/470671142 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5591ef9ce6e0 con 0x5591ef9dac20 2023-10-06T11:08:26.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.463+0000 7f0a9cff9700 1 -- 172.21.15.146:0/470671142 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 27) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0ab0014cd0 con 0x5591ef9dac20 2023-10-06T11:08:26.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.463+0000 7f0acde7db80 10 client.5310 fetch_fsmap finished waiting for FSMap version 27 2023-10-06T11:08:26.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.463+0000 7f0acde7db80 10 client.5310 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2023-10-06T11:08:26.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.463+0000 7f0acde7db80 20 client.5310 populate_metadata read hostname 'smithi146' 2023-10-06T11:08:26.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.463+0000 7f0acde7db80 1 --2- 172.21.15.146:0/470671142 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x5591efa02000 0x5591efa06a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:26.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.463+0000 7f0acde7db80 4 client.5310 mds_command: new command op to 4986 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:08:26.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.463+0000 7f0acde7db80 1 -- 172.21.15.146:0/470671142 --> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5591ef9ab610 con 0x5591efa02000 2023-10-06T11:08:26.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.463+0000 7f0ab5d9b700 1 --2- 172.21.15.146:0/470671142 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x5591efa02000 0x5591efa06a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:26.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.464+0000 7f0a9cff9700 10 client.5310 ms_handle_connect on v2:172.21.15.146:6835/4187213529 2023-10-06T11:08:26.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.464+0000 7f0ab5d9b700 1 --2- 172.21.15.146:0/470671142 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x5591efa02000 0x5591efa06a90 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e82f7593e6e67915 server_cookie=fe37f1ca1cea5af0 in_seq=0 out_seq=0 2023-10-06T11:08:26.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.464+0000 7f0a9cff9700 1 -- 172.21.15.146:0/470671142 <== mds.0 v2:172.21.15.146:6835/4187213529 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5591ef9ab610 con 0x5591efa02000 2023-10-06T11:08:26.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.464+0000 7f0a9cff9700 10 client.5310 handle_command_reply: tid=0 2023-10-06T11:08:26.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.464+0000 7f0acde7db80 1 client.5310 shutdown 2023-10-06T11:08:26.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.464+0000 7f0acde7db80 1 -- 172.21.15.146:0/470671142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5591ef9dac20 msgr2=0x5591efa00410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:26.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.464+0000 7f0acde7db80 1 --2- 172.21.15.146:0/470671142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5591ef9dac20 0x5591efa00410 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0016830 tx=0x7f0ab0019040 comp rx=0 tx=0).stop 2023-10-06T11:08:26.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.464+0000 7f0acde7db80 1 -- 172.21.15.146:0/470671142 shutdown_connections 2023-10-06T11:08:26.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.464+0000 7f0acde7db80 1 --2- 172.21.15.146:0/470671142 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x5591efa02000 0x5591efa06a90 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.464+0000 7f0acde7db80 1 --2- 172.21.15.146:0/470671142 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5591efa20ae0 0x5591efa1bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.464+0000 7f0a9cff9700 0 client.5310 ms_handle_reset on v2:172.21.15.146:6835/4187213529 2023-10-06T11:08:26.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.464+0000 7f0acde7db80 1 --2- 172.21.15.146:0/470671142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5591ef9dac20 0x5591efa00410 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.464+0000 7f0acde7db80 1 --2- 172.21.15.146:0/470671142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591ef9dc9f0 0x5591efa1d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.464+0000 7f0acde7db80 1 -- 172.21.15.146:0/470671142 >> 172.21.15.146:0/470671142 conn(0x5591ef9db0c0 msgr2=0x5591efa1e340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:26.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.464+0000 7f0acde7db80 1 -- 172.21.15.146:0/470671142 shutdown_connections 2023-10-06T11:08:26.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.464+0000 7f0acde7db80 1 -- 172.21.15.146:0/470671142 wait complete. 2023-10-06T11:08:26.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.465+0000 7f0acde7db80 20 client.5310 trim_cache size 0 max 16384 2023-10-06T11:08:26.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.480+0000 7f0acde7db80 1 Processor -- start 2023-10-06T11:08:26.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.480+0000 7f0acde7db80 1 -- start start 2023-10-06T11:08:26.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.481+0000 7f0acde7db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591ef9dac20 0x5591ef9ff460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:26.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.481+0000 7f0acde7db80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5591ef9dc9f0 0x5591ef9d6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:26.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.481+0000 7f0acde7db80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5591efa20ae0 0x5591ef9d6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:26.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.481+0000 7f0acde7db80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591ef7ace80 con 0x5591efa20ae0 2023-10-06T11:08:26.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.481+0000 7f0acde7db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591efa1d7b0 con 0x5591ef9dac20 2023-10-06T11:08:26.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.481+0000 7f0acde7db80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5591ef9dbd20 con 0x5591ef9dc9f0 2023-10-06T11:08:26.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.481+0000 7f0abed9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5591efa20ae0 0x5591ef9d6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:26.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.481+0000 7f0abed9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5591efa20ae0 0x5591ef9d6fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56292/0 (socket says 172.21.15.146:56292) 2023-10-06T11:08:26.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.481+0000 7f0abed9d700 1 -- 172.21.15.146:0/259389463 learned_addr learned my addr 172.21.15.146:0/259389463 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:26.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.481+0000 7f0abe59c700 1 --2- 172.21.15.146:0/259389463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591ef9dac20 0x5591ef9ff460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:26.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.481+0000 7f0abed9d700 1 -- 172.21.15.146:0/259389463 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5591ef9dc9f0 msgr2=0x5591ef9d6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:26.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.481+0000 7f0abed9d700 1 --2- 172.21.15.146:0/259389463 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5591ef9dc9f0 0x5591ef9d6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.481+0000 7f0abed9d700 1 -- 172.21.15.146:0/259389463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591ef9dac20 msgr2=0x5591ef9ff460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:26.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.481+0000 7f0abed9d700 1 --2- 172.21.15.146:0/259389463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591ef9dac20 0x5591ef9ff460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.481+0000 7f0abed9d700 1 -- 172.21.15.146:0/259389463 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5591ef8f87d0 con 0x5591efa20ae0 2023-10-06T11:08:26.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.481+0000 7f0abe59c700 1 --2- 172.21.15.146:0/259389463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591ef9dac20 0x5591ef9ff460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:08:26.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.482+0000 7f0abed9d700 1 --2- 172.21.15.146:0/259389463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5591efa20ae0 0x5591ef9d6fe0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8023000 tx=0x7f0ab8020070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d917394ba30be324 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:26.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.482+0000 7f0a9ffff700 1 -- 172.21.15.146:0/259389463 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab8009980 con 0x5591efa20ae0 2023-10-06T11:08:26.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.482+0000 7f0a9ffff700 1 -- 172.21.15.146:0/259389463 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab802d040 con 0x5591efa20ae0 2023-10-06T11:08:26.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.482+0000 7f0a9ffff700 1 -- 172.21.15.146:0/259389463 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab8012660 con 0x5591efa20ae0 2023-10-06T11:08:26.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.482+0000 7f0acde7db80 1 -- 172.21.15.146:0/259389463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5591efa20ae0 msgr2=0x5591ef9d6fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:26.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.482+0000 7f0acde7db80 1 --2- 172.21.15.146:0/259389463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5591efa20ae0 0x5591ef9d6fe0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8023000 tx=0x7f0ab8020070 comp rx=0 tx=0).stop 2023-10-06T11:08:26.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.482+0000 7f0acde7db80 1 -- 172.21.15.146:0/259389463 shutdown_connections 2023-10-06T11:08:26.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.482+0000 7f0acde7db80 1 --2- 172.21.15.146:0/259389463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5591efa20ae0 0x5591ef9d6fe0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.482+0000 7f0acde7db80 1 --2- 172.21.15.146:0/259389463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591ef9dac20 0x5591ef9ff460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.482+0000 7f0acde7db80 1 --2- 172.21.15.146:0/259389463 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5591ef9dc9f0 0x5591ef9d6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.482+0000 7f0acde7db80 1 -- 172.21.15.146:0/259389463 >> 172.21.15.146:0/259389463 conn(0x5591ef9db0c0 msgr2=0x5591efa1f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:26.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.482+0000 7f0acde7db80 1 -- 172.21.15.146:0/259389463 shutdown_connections 2023-10-06T11:08:26.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.482+0000 7f0acde7db80 1 -- 172.21.15.146:0/259389463 wait complete. 2023-10-06T11:08:26.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.483+0000 7f0acde7db80 1 -- start start 2023-10-06T11:08:26.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.483+0000 7f0acde7db80 1 Processor -- start 2023-10-06T11:08:26.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.484+0000 7f0acde7db80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5591ef9dac20 0x5591ef9d6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:26.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.484+0000 7f0acde7db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591ef9dc9f0 0x5591ef9d6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:26.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.484+0000 7f0acde7db80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5591efa20ae0 0x5591efa26170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:26.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.484+0000 7f0acde7db80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591efa27020 con 0x5591ef9dac20 2023-10-06T11:08:26.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.484+0000 7f0acde7db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591efa05770 con 0x5591ef9dc9f0 2023-10-06T11:08:26.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.484+0000 7f0acde7db80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5591efa03fb0 con 0x5591efa20ae0 2023-10-06T11:08:26.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.484+0000 7f0acde7db80 10 client.0 _ll_register_callbacks cb 0x5591ef7c6f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:08:26.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.484+0000 7f0abe59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5591ef9dac20 0x5591ef9d6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:26.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.484+0000 7f0abe59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5591ef9dac20 0x5591ef9d6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56306/0 (socket says 172.21.15.146:56306) 2023-10-06T11:08:26.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.484+0000 7f0abe59c700 1 -- 172.21.15.146:0/398652731 learned_addr learned my addr 172.21.15.146:0/398652731 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:26.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.484+0000 7f0ab5d9b700 1 --2- 172.21.15.146:0/398652731 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591ef9dc9f0 0x5591ef9d6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:26.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.484+0000 7f0abed9d700 1 --2- 172.21.15.146:0/398652731 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5591efa20ae0 0x5591efa26170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:26.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.484+0000 7f0abe59c700 1 -- 172.21.15.146:0/398652731 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5591efa20ae0 msgr2=0x5591efa26170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:26.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.484+0000 7f0abe59c700 1 --2- 172.21.15.146:0/398652731 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5591efa20ae0 0x5591efa26170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.484+0000 7f0abe59c700 1 -- 172.21.15.146:0/398652731 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591ef9dc9f0 msgr2=0x5591ef9d6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:26.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.484+0000 7f0abe59c700 1 --2- 172.21.15.146:0/398652731 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591ef9dc9f0 0x5591ef9d6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.484+0000 7f0abe59c700 1 -- 172.21.15.146:0/398652731 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5591ef7c42c0 con 0x5591ef9dac20 2023-10-06T11:08:26.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.484+0000 7f0abed9d700 1 --2- 172.21.15.146:0/398652731 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5591efa20ae0 0x5591efa26170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:08:26.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.484+0000 7f0abe59c700 1 --2- 172.21.15.146:0/398652731 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5591ef9dac20 0x5591ef9d6920 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0003000 tx=0x7f0ab001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad403c67f3b7e4d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:26.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.484+0000 7f0a9cff9700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:08:26.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.484+0000 7f0a9cff9700 1 -- 172.21.15.146:0/398652731 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab0039070 con 0x5591ef9dac20 2023-10-06T11:08:26.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.485+0000 7f0a9cff9700 1 -- 172.21.15.146:0/398652731 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f0ab0014640 con 0x5591ef9dac20 2023-10-06T11:08:26.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.485+0000 7f0acde7db80 1 -- 172.21.15.146:0/398652731 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0ab800bce0 con 0x5591ef9dac20 2023-10-06T11:08:26.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.485+0000 7f0a9cff9700 1 -- 172.21.15.146:0/398652731 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ab0014800 con 0x5591ef9dac20 2023-10-06T11:08:26.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.485+0000 7f0acde7db80 10 client.5316 fetch_fsmap learned FSMap version 27 2023-10-06T11:08:26.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.485+0000 7f0acde7db80 1 -- 172.21.15.146:0/398652731 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x5591ef8df4c0 con 0x5591ef9dac20 2023-10-06T11:08:26.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.485+0000 7f0a9cff9700 1 -- 172.21.15.146:0/398652731 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab800bce0 con 0x5591ef9dac20 2023-10-06T11:08:26.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.485+0000 7f0a9cff9700 1 -- 172.21.15.146:0/398652731 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 27) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0ab00228b0 con 0x5591ef9dac20 2023-10-06T11:08:26.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.485+0000 7f0acde7db80 10 client.5316 fetch_fsmap finished waiting for FSMap version 27 2023-10-06T11:08:26.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.485+0000 7f0acde7db80 10 client.5316 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2023-10-06T11:08:26.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.485+0000 7f0acde7db80 20 client.5316 populate_metadata read hostname 'smithi146' 2023-10-06T11:08:26.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.485+0000 7f0acde7db80 1 --2- 172.21.15.146:0/398652731 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x5591efa88e00 0x5591efa266b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:26.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.485+0000 7f0acde7db80 4 client.5316 mds_command: new command op to 4986 tid=0[{"prefix": "scrub status"}] 2023-10-06T11:08:26.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.485+0000 7f0acde7db80 1 -- 172.21.15.146:0/398652731 --> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5591ef8cce50 con 0x5591efa88e00 2023-10-06T11:08:26.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.485+0000 7f0ab5d9b700 1 --2- 172.21.15.146:0/398652731 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x5591efa88e00 0x5591efa266b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:26.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.485+0000 7f0a9cff9700 10 client.5316 ms_handle_connect on v2:172.21.15.146:6835/4187213529 2023-10-06T11:08:26.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.485+0000 7f0ab5d9b700 1 --2- 172.21.15.146:0/398652731 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x5591efa88e00 0x5591efa266b0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=836916b142ff7480 server_cookie=2faa79f203aeca25 in_seq=0 out_seq=0 2023-10-06T11:08:26.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.485+0000 7f0a9cff9700 1 -- 172.21.15.146:0/398652731 <== mds.0 v2:172.21.15.146:6835/4187213529 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5591ef8cce50 con 0x5591efa88e00 2023-10-06T11:08:26.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.485+0000 7f0a9cff9700 10 client.5316 handle_command_reply: tid=0 2023-10-06T11:08:26.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.485+0000 7f0acde7db80 1 client.5316 shutdown 2023-10-06T11:08:26.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.486+0000 7f0acde7db80 1 -- 172.21.15.146:0/398652731 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5591ef9dac20 msgr2=0x5591ef9d6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:26.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.486+0000 7f0acde7db80 1 --2- 172.21.15.146:0/398652731 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5591ef9dac20 0x5591ef9d6920 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0003000 tx=0x7f0ab001a000 comp rx=0 tx=0).stop 2023-10-06T11:08:26.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.486+0000 7f0acde7db80 1 -- 172.21.15.146:0/398652731 shutdown_connections 2023-10-06T11:08:26.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.486+0000 7f0acde7db80 1 --2- 172.21.15.146:0/398652731 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x5591efa88e00 0x5591efa266b0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.486+0000 7f0acde7db80 1 --2- 172.21.15.146:0/398652731 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5591efa20ae0 0x5591efa26170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.486+0000 7f0acde7db80 1 --2- 172.21.15.146:0/398652731 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5591ef9dac20 0x5591ef9d6920 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.486+0000 7f0a9cff9700 0 client.5316 ms_handle_reset on v2:172.21.15.146:6835/4187213529 2023-10-06T11:08:26.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.486+0000 7f0acde7db80 1 --2- 172.21.15.146:0/398652731 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591ef9dc9f0 0x5591ef9d6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.486+0000 7f0acde7db80 1 -- 172.21.15.146:0/398652731 >> 172.21.15.146:0/398652731 conn(0x5591ef9db0c0 msgr2=0x5591efa28ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:26.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.486+0000 7f0acde7db80 1 -- 172.21.15.146:0/398652731 shutdown_connections 2023-10-06T11:08:26.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.486+0000 7f0acde7db80 1 -- 172.21.15.146:0/398652731 wait complete. 2023-10-06T11:08:26.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.486+0000 7f0acde7db80 20 client.5316 trim_cache size 0 max 16384 2023-10-06T11:08:26.495 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:08:26.495 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "no active scrubs running", 2023-10-06T11:08:26.495 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": {} 2023-10-06T11:08:26.496 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:08:26.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.486+0000 7f0ac4b85700 1 -- 172.21.15.146:0/2171354529 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0aa0066f30 msgr2=0x7f0aa00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:26.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.486+0000 7f0ac4b85700 1 --2- 172.21.15.146:0/2171354529 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0aa0066f30 0x7f0aa00693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0ab00061f0 tx=0x7f0ab0008040 comp rx=0 tx=0).stop 2023-10-06T11:08:26.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.486+0000 7f0ac4b85700 1 -- 172.21.15.146:0/2171354529 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ac00cb950 msgr2=0x7f0ac00b5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:26.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.486+0000 7f0ac4b85700 1 --2- 172.21.15.146:0/2171354529 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ac00cb950 0x7f0ac00b5710 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f0aa800c600 tx=0x7f0aa8007f60 comp rx=0 tx=0).stop 2023-10-06T11:08:26.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.486+0000 7f0ac4b85700 1 -- 172.21.15.146:0/2171354529 shutdown_connections 2023-10-06T11:08:26.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.486+0000 7f0ac4b85700 1 --2- 172.21.15.146:0/2171354529 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0aa0066f30 0x7f0aa00693e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.486+0000 7f0ac4b85700 1 --2- 172.21.15.146:0/2171354529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ac015a160 0x7f0ac00b5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.486+0000 7f0ac4b85700 1 --2- 172.21.15.146:0/2171354529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ac00ae730 0x7f0ac0150750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.486+0000 7f0ac4b85700 1 --2- 172.21.15.146:0/2171354529 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ac00cb950 0x7f0ac00b5710 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.486+0000 7f0ac4b85700 1 -- 172.21.15.146:0/2171354529 >> 172.21.15.146:0/2171354529 conn(0x7f0ac006f380 msgr2=0x7f0ac00cbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:26.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.486+0000 7f0ac4b85700 1 -- 172.21.15.146:0/2171354529 shutdown_connections 2023-10-06T11:08:26.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.486+0000 7f0ac4b85700 1 -- 172.21.15.146:0/2171354529 wait complete. 2023-10-06T11:08:26.500 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-06T11:08:26.500 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 perf dump 2023-10-06T11:08:26.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.614+0000 7f893debf700 1 Processor -- start 2023-10-06T11:08:26.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.615+0000 7f893debf700 1 -- start start 2023-10-06T11:08:26.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.615+0000 7f893debf700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f893815a160 0x7f89380c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:26.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.615+0000 7f893debf700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f89380ae730 0x7f89380aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:26.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.615+0000 7f893debf700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89380ae2a0 con 0x7f89380ce3d0 2023-10-06T11:08:26.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.615+0000 7f893debf700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f893815a530 con 0x7f89380ae730 2023-10-06T11:08:26.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.615+0000 7f893debf700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89380ad690 con 0x7f893815a160 2023-10-06T11:08:26.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.615+0000 7f8937fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f89380ce3d0 0x7f89380ce830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35112/0 (socket says 172.21.15.146:35112) 2023-10-06T11:08:26.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.616+0000 7f8937fff700 1 -- 172.21.15.146:0/3823235102 learned_addr learned my addr 172.21.15.146:0/3823235102 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:08:26.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.616+0000 7f8936ffd700 1 --2- 172.21.15.146:0/3823235102 >> v2:172.21.15.151:3300/0 conn(0x7f89380ae730 0x7f89380aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:26.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.616+0000 7f89377fe700 1 --2- 172.21.15.146:0/3823235102 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f893815a160 0x7f89380c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:26.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.616+0000 7f89367fc700 1 -- 172.21.15.146:0/3823235102 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 336338401 0 0) 0x7f89380ae2a0 con 0x7f89380ce3d0 2023-10-06T11:08:26.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.616+0000 7f89367fc700 1 -- 172.21.15.146:0/3823235102 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8920003570 con 0x7f89380ce3d0 2023-10-06T11:08:26.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.616+0000 7f89377fe700 1 -- 172.21.15.146:0/3823235102 >> v2:172.21.15.151:3300/0 conn(0x7f89380ae730 msgr2=0x7f89380aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:26.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.616+0000 7f89377fe700 1 --2- 172.21.15.146:0/3823235102 >> v2:172.21.15.151:3300/0 conn(0x7f89380ae730 0x7f89380aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.616+0000 7f89367fc700 1 -- 172.21.15.146:0/3823235102 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3489462074 0 0) 0x7f8920003570 con 0x7f89380ce3d0 2023-10-06T11:08:26.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.616+0000 7f89377fe700 1 -- 172.21.15.146:0/3823235102 >> v1:172.21.15.146:6789/0 conn(0x7f89380ce3d0 legacy=0x7f89380ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:26.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.616+0000 7f89377fe700 1 -- 172.21.15.146:0/3823235102 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89380ad970 con 0x7f893815a160 2023-10-06T11:08:26.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.616+0000 7f89377fe700 1 --2- 172.21.15.146:0/3823235102 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f893815a160 0x7f89380c55a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8928009eb0 tx=0x7f8928009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=199586a0691d67ca server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:26.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.616+0000 7f89367fc700 1 -- 172.21.15.146:0/3823235102 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892800e070 con 0x7f893815a160 2023-10-06T11:08:26.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.616+0000 7f89367fc700 1 -- 172.21.15.146:0/3823235102 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892800b870 con 0x7f893815a160 2023-10-06T11:08:26.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.616+0000 7f89367fc700 1 -- 172.21.15.146:0/3823235102 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8930001470 con 0x7f893815a160 2023-10-06T11:08:26.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.617+0000 7f893debf700 1 -- 172.21.15.146:0/3823235102 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f893815a160 msgr2=0x7f89380c55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:26.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.617+0000 7f893debf700 1 --2- 172.21.15.146:0/3823235102 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f893815a160 0x7f89380c55a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8928009eb0 tx=0x7f8928009780 comp rx=0 tx=0).stop 2023-10-06T11:08:26.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.617+0000 7f893debf700 1 -- 172.21.15.146:0/3823235102 shutdown_connections 2023-10-06T11:08:26.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.617+0000 7f893debf700 1 --2- 172.21.15.146:0/3823235102 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f893815a160 0x7f89380c55a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.617+0000 7f893debf700 1 --2- 172.21.15.146:0/3823235102 >> v2:172.21.15.151:3300/0 conn(0x7f89380ae730 0x7f89380aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.617+0000 7f893debf700 1 -- 172.21.15.146:0/3823235102 >> 172.21.15.146:0/3823235102 conn(0x7f893806f380 msgr2=0x7f89380d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:26.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.617+0000 7f893debf700 1 -- 172.21.15.146:0/3823235102 shutdown_connections 2023-10-06T11:08:26.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.617+0000 7f893debf700 1 -- 172.21.15.146:0/3823235102 wait complete. 2023-10-06T11:08:26.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.618+0000 7f893debf700 1 Processor -- start 2023-10-06T11:08:26.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.618+0000 7f893debf700 1 -- start start 2023-10-06T11:08:26.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.619+0000 7f893debf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89380ae730 0x7f8938157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:26.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.619+0000 7f893debf700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89380ce3d0 0x7f89380afd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:26.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.619+0000 7f893debf700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89380b1df0 0x7f89380b4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:26.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.619+0000 7f893debf700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893815d8e0 con 0x7f89380ae730 2023-10-06T11:08:26.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.619+0000 7f893debf700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8938157b60 con 0x7f89380b1df0 2023-10-06T11:08:26.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.619+0000 7f893debf700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89380b06b0 con 0x7f89380ce3d0 2023-10-06T11:08:26.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.619+0000 7f89377fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89380ae730 0x7f8938157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:26.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.619+0000 7f89377fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89380ae730 0x7f8938157620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56318/0 (socket says 172.21.15.146:56318) 2023-10-06T11:08:26.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.619+0000 7f89377fe700 1 -- 172.21.15.146:0/2586082563 learned_addr learned my addr 172.21.15.146:0/2586082563 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:26.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.619+0000 7f8937fff700 1 --2- 172.21.15.146:0/2586082563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89380b1df0 0x7f89380b4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:26.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.619+0000 7f8936ffd700 1 --2- 172.21.15.146:0/2586082563 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89380ce3d0 0x7f89380afd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:26.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.619+0000 7f89377fe700 1 -- 172.21.15.146:0/2586082563 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89380ce3d0 msgr2=0x7f89380afd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:26.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.619+0000 7f89377fe700 1 --2- 172.21.15.146:0/2586082563 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89380ce3d0 0x7f89380afd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.619+0000 7f89377fe700 1 -- 172.21.15.146:0/2586082563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89380b1df0 msgr2=0x7f89380b4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:26.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.619+0000 7f89377fe700 1 --2- 172.21.15.146:0/2586082563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89380b1df0 0x7f89380b4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.619+0000 7f89377fe700 1 -- 172.21.15.146:0/2586082563 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8928009a20 con 0x7f89380ae730 2023-10-06T11:08:26.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.619+0000 7f8937fff700 1 --2- 172.21.15.146:0/2586082563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89380b1df0 0x7f89380b4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:08:26.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.620+0000 7f89377fe700 1 --2- 172.21.15.146:0/2586082563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89380ae730 0x7f8938157620 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8928003000 tx=0x7f8928018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:26.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.620+0000 7f891f7fe700 1 -- 172.21.15.146:0/2586082563 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8928012970 con 0x7f89380ae730 2023-10-06T11:08:26.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.620+0000 7f891f7fe700 1 -- 172.21.15.146:0/2586082563 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8928012ad0 con 0x7f89380ae730 2023-10-06T11:08:26.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.620+0000 7f893debf700 1 -- 172.21.15.146:0/2586082563 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89380b0990 con 0x7f89380ae730 2023-10-06T11:08:26.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.620+0000 7f891f7fe700 1 -- 172.21.15.146:0/2586082563 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8928012c80 con 0x7f89380ae730 2023-10-06T11:08:26.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.620+0000 7f893debf700 1 -- 172.21.15.146:0/2586082563 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f893815d470 con 0x7f89380ae730 2023-10-06T11:08:26.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.621+0000 7f891f7fe700 1 -- 172.21.15.146:0/2586082563 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8928024030 con 0x7f89380ae730 2023-10-06T11:08:26.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.621+0000 7f891f7fe700 1 --2- 172.21.15.146:0/2586082563 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8924066f30 0x7f89240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:26.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.621+0000 7f891f7fe700 1 -- 172.21.15.146:0/2586082563 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f8928086060 con 0x7f89380ae730 2023-10-06T11:08:26.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.621+0000 7f8936ffd700 1 --2- 172.21.15.146:0/2586082563 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8924066f30 0x7f89240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:26.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.622+0000 7f8936ffd700 1 --2- 172.21.15.146:0/2586082563 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8924066f30 0x7f89240693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8938069740 tx=0x7f892c0091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:26.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.623+0000 7f89471b7b80 1 Processor -- start 2023-10-06T11:08:26.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.624+0000 7f89471b7b80 1 -- start start 2023-10-06T11:08:26.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.624+0000 7f89471b7b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604bfd0cad0 0x5604bfd0cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:26.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.624+0000 7f89471b7b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604bfcc89e0 0x5604bfcc55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:26.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.624+0000 7f89471b7b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604bfcc6c10 0x5604bfcc5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:26.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.624+0000 7f89471b7b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604bfc45cc0 con 0x5604bfcc89e0 2023-10-06T11:08:26.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.624+0000 7f89471b7b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604bfc1cab0 con 0x5604bfd0cad0 2023-10-06T11:08:26.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.624+0000 7f89471b7b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5604bfc1a2b0 con 0x5604bfcc6c10 2023-10-06T11:08:26.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.624+0000 7f8936ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604bfcc89e0 0x5604bfcc55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:26.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.624+0000 7f8936ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604bfcc89e0 0x5604bfcc55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56322/0 (socket says 172.21.15.146:56322) 2023-10-06T11:08:26.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.624+0000 7f8936ffd700 1 -- 172.21.15.146:0/2683273324 learned_addr learned my addr 172.21.15.146:0/2683273324 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:26.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.625+0000 7f89377fe700 1 --2- 172.21.15.146:0/2683273324 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604bfd0cad0 0x5604bfd0cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:26.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.625+0000 7f8937fff700 1 --2- 172.21.15.146:0/2683273324 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604bfcc6c10 0x5604bfcc5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:26.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.625+0000 7f8936ffd700 1 -- 172.21.15.146:0/2683273324 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604bfcc6c10 msgr2=0x5604bfcc5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:26.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.625+0000 7f8936ffd700 1 --2- 172.21.15.146:0/2683273324 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604bfcc6c10 0x5604bfcc5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.625+0000 7f8936ffd700 1 -- 172.21.15.146:0/2683273324 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604bfd0cad0 msgr2=0x5604bfd0cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:26.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.625+0000 7f8936ffd700 1 --2- 172.21.15.146:0/2683273324 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604bfd0cad0 0x5604bfd0cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.625+0000 7f8936ffd700 1 -- 172.21.15.146:0/2683273324 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604bfab02b0 con 0x5604bfcc89e0 2023-10-06T11:08:26.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.625+0000 7f8937fff700 1 --2- 172.21.15.146:0/2683273324 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604bfcc6c10 0x5604bfcc5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:08:26.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.625+0000 7f8936ffd700 1 --2- 172.21.15.146:0/2683273324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604bfcc89e0 0x5604bfcc55c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f892c011ec0 tx=0x7f892c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9da5c72c66d9c59d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:26.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.625+0000 7f891cff9700 1 -- 172.21.15.146:0/2683273324 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c014e70 con 0x5604bfcc89e0 2023-10-06T11:08:26.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.625+0000 7f891cff9700 1 -- 172.21.15.146:0/2683273324 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892c021450 con 0x5604bfcc89e0 2023-10-06T11:08:26.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.625+0000 7f891cff9700 1 -- 172.21.15.146:0/2683273324 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c0217d0 con 0x5604bfcc89e0 2023-10-06T11:08:26.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.626+0000 7f89471b7b80 1 -- 172.21.15.146:0/2683273324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604bfcc89e0 msgr2=0x5604bfcc55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:26.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.626+0000 7f89471b7b80 1 --2- 172.21.15.146:0/2683273324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604bfcc89e0 0x5604bfcc55c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f892c011ec0 tx=0x7f892c019000 comp rx=0 tx=0).stop 2023-10-06T11:08:26.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.626+0000 7f89471b7b80 1 -- 172.21.15.146:0/2683273324 shutdown_connections 2023-10-06T11:08:26.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.626+0000 7f89471b7b80 1 --2- 172.21.15.146:0/2683273324 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604bfcc6c10 0x5604bfcc5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.626+0000 7f89471b7b80 1 --2- 172.21.15.146:0/2683273324 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604bfd0cad0 0x5604bfd0cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.626+0000 7f89471b7b80 1 --2- 172.21.15.146:0/2683273324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604bfcc89e0 0x5604bfcc55c0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.626+0000 7f89471b7b80 1 -- 172.21.15.146:0/2683273324 >> 172.21.15.146:0/2683273324 conn(0x5604bfcc70b0 msgr2=0x5604bfcc7480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:26.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.626+0000 7f89471b7b80 1 -- 172.21.15.146:0/2683273324 shutdown_connections 2023-10-06T11:08:26.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.626+0000 7f89471b7b80 1 -- 172.21.15.146:0/2683273324 wait complete. 2023-10-06T11:08:26.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.626+0000 7f89471b7b80 1 -- start start 2023-10-06T11:08:26.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.626+0000 7f89471b7b80 1 Processor -- start 2023-10-06T11:08:26.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.627+0000 7f89471b7b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604bfcc6c10 0x5604bfcec4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:26.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.627+0000 7f89471b7b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604bfcc89e0 0x5604bfd1fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:26.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.627+0000 7f89471b7b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604bfd0cad0 0x5604bfcc55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:26.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.627+0000 7f89471b7b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604bfc160a0 con 0x5604bfcc89e0 2023-10-06T11:08:26.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.627+0000 7f89471b7b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604bfbc18d0 con 0x5604bfd0cad0 2023-10-06T11:08:26.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.627+0000 7f89471b7b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5604bfbdcee0 con 0x5604bfcc6c10 2023-10-06T11:08:26.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.627+0000 7f89471b7b80 10 client.0 _ll_register_callbacks cb 0x5604bfab2f70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:08:26.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.627+0000 7f8936ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604bfcc89e0 0x5604bfd1fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:26.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.627+0000 7f8936ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604bfcc89e0 0x5604bfd1fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56336/0 (socket says 172.21.15.146:56336) 2023-10-06T11:08:26.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.627+0000 7f8936ffd700 1 -- 172.21.15.146:0/2639516237 learned_addr learned my addr 172.21.15.146:0/2639516237 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:26.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.627+0000 7f89377fe700 1 --2- 172.21.15.146:0/2639516237 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604bfcc6c10 0x5604bfcec4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:26.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.627+0000 7f8937fff700 1 --2- 172.21.15.146:0/2639516237 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604bfd0cad0 0x5604bfcc55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:26.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.628+0000 7f8936ffd700 1 -- 172.21.15.146:0/2639516237 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604bfcc6c10 msgr2=0x5604bfcec4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:26.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.628+0000 7f8936ffd700 1 --2- 172.21.15.146:0/2639516237 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604bfcc6c10 0x5604bfcec4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.628+0000 7f8936ffd700 1 -- 172.21.15.146:0/2639516237 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604bfd0cad0 msgr2=0x5604bfcc55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:26.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.628+0000 7f8936ffd700 1 --2- 172.21.15.146:0/2639516237 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604bfd0cad0 0x5604bfcc55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.628+0000 7f8936ffd700 1 -- 172.21.15.146:0/2639516237 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f892c011b00 con 0x5604bfcc89e0 2023-10-06T11:08:26.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.628+0000 7f8936ffd700 1 --2- 172.21.15.146:0/2639516237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604bfcc89e0 0x5604bfd1fb00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x5604bfcc8f30 tx=0x7f892c022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22c7324b7c51d34c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:26.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.628+0000 7f8915ffb700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:08:26.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.628+0000 7f8915ffb700 1 -- 172.21.15.146:0/2639516237 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c02a660 con 0x5604bfcc89e0 2023-10-06T11:08:26.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.628+0000 7f8915ffb700 1 -- 172.21.15.146:0/2639516237 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f892c01a030 con 0x5604bfcc89e0 2023-10-06T11:08:26.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.628+0000 7f89471b7b80 1 -- 172.21.15.146:0/2639516237 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5604bfcba6d0 con 0x5604bfcc89e0 2023-10-06T11:08:26.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.628+0000 7f8915ffb700 1 -- 172.21.15.146:0/2639516237 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f892c005a00 con 0x5604bfcc89e0 2023-10-06T11:08:26.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.628+0000 7f89471b7b80 10 client.5328 fetch_fsmap learned FSMap version 27 2023-10-06T11:08:26.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.628+0000 7f89471b7b80 1 -- 172.21.15.146:0/2639516237 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x5604bfa53020 con 0x5604bfcc89e0 2023-10-06T11:08:26.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.628+0000 7f8915ffb700 1 -- 172.21.15.146:0/2639516237 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5604bfcba6d0 con 0x5604bfcc89e0 2023-10-06T11:08:26.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.628+0000 7f8915ffb700 1 -- 172.21.15.146:0/2639516237 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 27) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f892c005b60 con 0x5604bfcc89e0 2023-10-06T11:08:26.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.628+0000 7f89471b7b80 10 client.5328 fetch_fsmap finished waiting for FSMap version 27 2023-10-06T11:08:26.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.628+0000 7f89471b7b80 10 client.5328 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2023-10-06T11:08:26.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.628+0000 7f89471b7b80 20 client.5328 populate_metadata read hostname 'smithi146' 2023-10-06T11:08:26.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.628+0000 7f89471b7b80 1 --2- 172.21.15.146:0/2639516237 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x5604bfd06f10 0x5604bfd07310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:26.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.628+0000 7f89471b7b80 4 client.5328 mds_command: new command op to 4986 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:08:26.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.628+0000 7f89471b7b80 1 -- 172.21.15.146:0/2639516237 --> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5604bfc97600 con 0x5604bfd06f10 2023-10-06T11:08:26.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.628+0000 7f89377fe700 1 --2- 172.21.15.146:0/2639516237 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x5604bfd06f10 0x5604bfd07310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:26.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.629+0000 7f8915ffb700 10 client.5328 ms_handle_connect on v2:172.21.15.146:6835/4187213529 2023-10-06T11:08:26.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.629+0000 7f89377fe700 1 --2- 172.21.15.146:0/2639516237 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x5604bfd06f10 0x5604bfd07310 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68fc5fdefe048765 server_cookie=e229e482d00e8f58 in_seq=0 out_seq=0 2023-10-06T11:08:26.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.629+0000 7f8915ffb700 1 -- 172.21.15.146:0/2639516237 <== mds.0 v2:172.21.15.146:6835/4187213529 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5604bfc97600 con 0x5604bfd06f10 2023-10-06T11:08:26.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.629+0000 7f8915ffb700 10 client.5328 handle_command_reply: tid=0 2023-10-06T11:08:26.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.629+0000 7f89471b7b80 1 client.5328 shutdown 2023-10-06T11:08:26.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.629+0000 7f89471b7b80 1 -- 172.21.15.146:0/2639516237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604bfcc89e0 msgr2=0x5604bfd1fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:26.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.629+0000 7f89471b7b80 1 --2- 172.21.15.146:0/2639516237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604bfcc89e0 0x5604bfd1fb00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x5604bfcc8f30 tx=0x7f892c022000 comp rx=0 tx=0).stop 2023-10-06T11:08:26.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.629+0000 7f89471b7b80 1 -- 172.21.15.146:0/2639516237 shutdown_connections 2023-10-06T11:08:26.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.629+0000 7f89471b7b80 1 --2- 172.21.15.146:0/2639516237 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x5604bfd06f10 0x5604bfd07310 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.629+0000 7f89471b7b80 1 --2- 172.21.15.146:0/2639516237 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604bfd0cad0 0x5604bfcc55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.629+0000 7f8915ffb700 0 client.5328 ms_handle_reset on v2:172.21.15.146:6835/4187213529 2023-10-06T11:08:26.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.629+0000 7f89471b7b80 1 --2- 172.21.15.146:0/2639516237 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604bfcc6c10 0x5604bfcec4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.629+0000 7f89471b7b80 1 --2- 172.21.15.146:0/2639516237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604bfcc89e0 0x5604bfd1fb00 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.629+0000 7f89471b7b80 1 -- 172.21.15.146:0/2639516237 >> 172.21.15.146:0/2639516237 conn(0x5604bfcc70b0 msgr2=0x5604bfd0a330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:26.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.629+0000 7f89471b7b80 1 -- 172.21.15.146:0/2639516237 shutdown_connections 2023-10-06T11:08:26.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.630+0000 7f89471b7b80 1 -- 172.21.15.146:0/2639516237 wait complete. 2023-10-06T11:08:26.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.630+0000 7f89471b7b80 20 client.5328 trim_cache size 0 max 16384 2023-10-06T11:08:26.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.644+0000 7f89471b7b80 1 Processor -- start 2023-10-06T11:08:26.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.645+0000 7f89471b7b80 1 -- start start 2023-10-06T11:08:26.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.645+0000 7f89471b7b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604bfcc6c10 0x5604bfd25bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:26.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.645+0000 7f89471b7b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604bfcc89e0 0x5604bfd072e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:26.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.645+0000 7f89471b7b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604bfd0cad0 0x5604bfd0bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:26.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.645+0000 7f89471b7b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604bfa98e70 con 0x5604bfd0cad0 2023-10-06T11:08:26.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.645+0000 7f89471b7b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604bfcc0100 con 0x5604bfcc89e0 2023-10-06T11:08:26.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.645+0000 7f89471b7b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5604bfcf5bd0 con 0x5604bfcc6c10 2023-10-06T11:08:26.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.645+0000 7f8937fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604bfd0cad0 0x5604bfd0bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:26.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.645+0000 7f8937fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604bfd0cad0 0x5604bfd0bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56352/0 (socket says 172.21.15.146:56352) 2023-10-06T11:08:26.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.645+0000 7f8937fff700 1 -- 172.21.15.146:0/2547336612 learned_addr learned my addr 172.21.15.146:0/2547336612 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:26.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.646+0000 7f8937fff700 1 -- 172.21.15.146:0/2547336612 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604bfcc6c10 msgr2=0x5604bfd25bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:26.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.646+0000 7f89377fe700 1 --2- 172.21.15.146:0/2547336612 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604bfcc6c10 0x5604bfd25bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:26.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.646+0000 7f8937fff700 1 --2- 172.21.15.146:0/2547336612 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604bfcc6c10 0x5604bfd25bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.646+0000 7f8936ffd700 1 --2- 172.21.15.146:0/2547336612 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604bfcc89e0 0x5604bfd072e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:26.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.646+0000 7f8937fff700 1 -- 172.21.15.146:0/2547336612 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604bfcc89e0 msgr2=0x5604bfd072e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:26.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.646+0000 7f8937fff700 1 --2- 172.21.15.146:0/2547336612 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604bfcc89e0 0x5604bfd072e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.646+0000 7f8937fff700 1 -- 172.21.15.146:0/2547336612 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604bfbe47c0 con 0x5604bfd0cad0 2023-10-06T11:08:26.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.646+0000 7f8937fff700 1 --2- 172.21.15.146:0/2547336612 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604bfd0cad0 0x5604bfd0bdd0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f8930001400 tx=0x7f8930007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=104deb5195f10c6f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:26.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.646+0000 7f891d7fa700 1 -- 172.21.15.146:0/2547336612 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893000d070 con 0x5604bfd0cad0 2023-10-06T11:08:26.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.646+0000 7f891d7fa700 1 -- 172.21.15.146:0/2547336612 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89300129d0 con 0x5604bfd0cad0 2023-10-06T11:08:26.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.646+0000 7f891d7fa700 1 -- 172.21.15.146:0/2547336612 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8930012d50 con 0x5604bfd0cad0 2023-10-06T11:08:26.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.646+0000 7f89471b7b80 1 -- 172.21.15.146:0/2547336612 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604bfd0cad0 msgr2=0x5604bfd0bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:26.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.646+0000 7f89471b7b80 1 --2- 172.21.15.146:0/2547336612 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604bfd0cad0 0x5604bfd0bdd0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f8930001400 tx=0x7f8930007040 comp rx=0 tx=0).stop 2023-10-06T11:08:26.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.646+0000 7f89471b7b80 1 -- 172.21.15.146:0/2547336612 shutdown_connections 2023-10-06T11:08:26.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.646+0000 7f89471b7b80 1 --2- 172.21.15.146:0/2547336612 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604bfd0cad0 0x5604bfd0bdd0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.646+0000 7f89471b7b80 1 --2- 172.21.15.146:0/2547336612 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604bfcc6c10 0x5604bfd25bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.646+0000 7f89471b7b80 1 --2- 172.21.15.146:0/2547336612 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604bfcc89e0 0x5604bfd072e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.646+0000 7f89471b7b80 1 -- 172.21.15.146:0/2547336612 >> 172.21.15.146:0/2547336612 conn(0x5604bfcc70b0 msgr2=0x5604bfcc0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:26.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.646+0000 7f89471b7b80 1 -- 172.21.15.146:0/2547336612 shutdown_connections 2023-10-06T11:08:26.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.647+0000 7f89471b7b80 1 -- 172.21.15.146:0/2547336612 wait complete. 2023-10-06T11:08:26.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.647+0000 7f89471b7b80 1 -- start start 2023-10-06T11:08:26.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.647+0000 7f89471b7b80 1 Processor -- start 2023-10-06T11:08:26.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.648+0000 7f89471b7b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604bfcc6c10 0x5604bfcf0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:26.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.648+0000 7f89471b7b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604bfcc89e0 0x5604bfceb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:26.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.648+0000 7f89471b7b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604bfd0cad0 0x5604bfceb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:26.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.648+0000 7f89471b7b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604bfd72850 con 0x5604bfd0cad0 2023-10-06T11:08:26.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.648+0000 7f89471b7b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604bfd2e4f0 con 0x5604bfcc6c10 2023-10-06T11:08:26.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.648+0000 7f89471b7b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5604bfcef750 con 0x5604bfcc89e0 2023-10-06T11:08:26.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.648+0000 7f89471b7b80 10 client.0 _ll_register_callbacks cb 0x5604bfab2f70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:08:26.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.648+0000 7f8937fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604bfd0cad0 0x5604bfceb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:26.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.648+0000 7f8937fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604bfd0cad0 0x5604bfceb9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56368/0 (socket says 172.21.15.146:56368) 2023-10-06T11:08:26.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.648+0000 7f8937fff700 1 -- 172.21.15.146:0/3312721665 learned_addr learned my addr 172.21.15.146:0/3312721665 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:26.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.648+0000 7f89377fe700 1 --2- 172.21.15.146:0/3312721665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604bfcc6c10 0x5604bfcf0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:26.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.648+0000 7f8936ffd700 1 --2- 172.21.15.146:0/3312721665 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604bfcc89e0 0x5604bfceb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:26.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.648+0000 7f8937fff700 1 -- 172.21.15.146:0/3312721665 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604bfcc89e0 msgr2=0x5604bfceb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:26.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.648+0000 7f8937fff700 1 --2- 172.21.15.146:0/3312721665 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604bfcc89e0 0x5604bfceb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.648+0000 7f8937fff700 1 -- 172.21.15.146:0/3312721665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604bfcc6c10 msgr2=0x5604bfcf0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:26.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.648+0000 7f8937fff700 1 --2- 172.21.15.146:0/3312721665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604bfcc6c10 0x5604bfcf0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.648+0000 7f8937fff700 1 -- 172.21.15.146:0/3312721665 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8930005b40 con 0x5604bfd0cad0 2023-10-06T11:08:26.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.648+0000 7f8937fff700 1 --2- 172.21.15.146:0/3312721665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604bfd0cad0 0x5604bfceb9c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8930001620 tx=0x7f8930018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56c1970ca4426eb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:26.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.648+0000 7f8915ffb700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:08:26.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.648+0000 7f8915ffb700 1 -- 172.21.15.146:0/3312721665 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8930016af0 con 0x5604bfd0cad0 2023-10-06T11:08:26.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.649+0000 7f8915ffb700 1 -- 172.21.15.146:0/3312721665 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f8930016c50 con 0x5604bfd0cad0 2023-10-06T11:08:26.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.649+0000 7f89471b7b80 1 -- 172.21.15.146:0/3312721665 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f892c021450 con 0x5604bfd0cad0 2023-10-06T11:08:26.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.649+0000 7f8915ffb700 1 -- 172.21.15.146:0/3312721665 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8930016e10 con 0x5604bfd0cad0 2023-10-06T11:08:26.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.649+0000 7f89471b7b80 10 client.5334 fetch_fsmap learned FSMap version 27 2023-10-06T11:08:26.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.649+0000 7f89471b7b80 1 -- 172.21.15.146:0/3312721665 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=2+}) v3 -- 0x5604bfbcb4b0 con 0x5604bfd0cad0 2023-10-06T11:08:26.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.649+0000 7f8915ffb700 1 -- 172.21.15.146:0/3312721665 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892c021450 con 0x5604bfd0cad0 2023-10-06T11:08:26.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.649+0000 7f8915ffb700 1 -- 172.21.15.146:0/3312721665 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 27) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8930021620 con 0x5604bfd0cad0 2023-10-06T11:08:26.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.649+0000 7f89471b7b80 10 client.5334 fetch_fsmap finished waiting for FSMap version 27 2023-10-06T11:08:26.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.649+0000 7f89471b7b80 10 client.5334 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.c 2023-10-06T11:08:26.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.649+0000 7f89471b7b80 20 client.5334 populate_metadata read hostname 'smithi146' 2023-10-06T11:08:26.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.649+0000 7f89471b7b80 1 --2- 172.21.15.146:0/3312721665 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x5604bfcc1810 0x5604bfd71720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:26.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.649+0000 7f89471b7b80 4 client.5334 mds_command: new command op to 4986 tid=0[{"prefix": "perf dump"}] 2023-10-06T11:08:26.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.649+0000 7f89471b7b80 1 -- 172.21.15.146:0/3312721665 --> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] -- command(tid 0: {"prefix": "perf dump"}) v1 -- 0x5604bfbb8e40 con 0x5604bfcc1810 2023-10-06T11:08:26.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.649+0000 7f89377fe700 1 --2- 172.21.15.146:0/3312721665 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x5604bfcc1810 0x5604bfd71720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:26.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.649+0000 7f8915ffb700 10 client.5334 ms_handle_connect on v2:172.21.15.146:6835/4187213529 2023-10-06T11:08:26.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.649+0000 7f89377fe700 1 --2- 172.21.15.146:0/3312721665 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x5604bfcc1810 0x5604bfd71720 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef16c364c294afee server_cookie=632a0bf8ae494d4b in_seq=0 out_seq=0 2023-10-06T11:08:26.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.650+0000 7f8915ffb700 1 -- 172.21.15.146:0/3312721665 <== mds.0 v2:172.21.15.146:6835/4187213529 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17056 (crc 0 0 0) 0x5604bfbb8e40 con 0x5604bfcc1810 2023-10-06T11:08:26.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.650+0000 7f8915ffb700 10 client.5334 handle_command_reply: tid=0 2023-10-06T11:08:26.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.650+0000 7f89471b7b80 1 client.5334 shutdown 2023-10-06T11:08:26.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.650+0000 7f89471b7b80 1 -- 172.21.15.146:0/3312721665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604bfd0cad0 msgr2=0x5604bfceb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:26.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.650+0000 7f89471b7b80 1 --2- 172.21.15.146:0/3312721665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604bfd0cad0 0x5604bfceb9c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8930001620 tx=0x7f8930018000 comp rx=0 tx=0).stop 2023-10-06T11:08:26.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.650+0000 7f89471b7b80 1 -- 172.21.15.146:0/3312721665 shutdown_connections 2023-10-06T11:08:26.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.650+0000 7f89471b7b80 1 --2- 172.21.15.146:0/3312721665 >> [v2:172.21.15.146:6835/4187213529,v1:172.21.15.146:6837/4187213529] conn(0x5604bfcc1810 0x5604bfd71720 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.650+0000 7f89471b7b80 1 --2- 172.21.15.146:0/3312721665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604bfd0cad0 0x5604bfceb9c0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.650+0000 7f89471b7b80 1 --2- 172.21.15.146:0/3312721665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604bfcc6c10 0x5604bfcf0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.650+0000 7f8915ffb700 0 client.5334 ms_handle_reset on v2:172.21.15.146:6835/4187213529 2023-10-06T11:08:26.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.650+0000 7f89471b7b80 1 --2- 172.21.15.146:0/3312721665 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604bfcc89e0 0x5604bfceb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.650+0000 7f89471b7b80 1 -- 172.21.15.146:0/3312721665 >> 172.21.15.146:0/3312721665 conn(0x5604bfcc70b0 msgr2=0x5604bfceeb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:26.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.650+0000 7f89471b7b80 1 -- 172.21.15.146:0/3312721665 shutdown_connections 2023-10-06T11:08:26.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.650+0000 7f89471b7b80 1 -- 172.21.15.146:0/3312721665 wait complete. 2023-10-06T11:08:26.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.650+0000 7f89471b7b80 20 client.5334 trim_cache size 0 max 16384 2023-10-06T11:08:26.660 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:08:26.660 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-0": { 2023-10-06T11:08:26.660 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 7649, 2023-10-06T11:08:26.660 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 7650, 2023-10-06T11:08:26.660 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 2144560, 2023-10-06T11:08:26.660 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 49323460, 2023-10-06T11:08:26.661 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 17, 2023-10-06T11:08:26.661 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 6, 2023-10-06T11:08:26.661 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 0.512007166, 2023-10-06T11:08:26.661 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 0.211022366, 2023-10-06T11:08:26.661 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 0.106427226, 2023-10-06T11:08:26.661 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.167515588, 2023-10-06T11:08:26.661 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T11:08:26.661 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 7649, 2023-10-06T11:08:26.661 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 4.342101089, 2023-10-06T11:08:26.661 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000567669 2023-10-06T11:08:26.661 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.662 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2023-10-06T11:08:26.662 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 10, 2023-10-06T11:08:26.662 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000001218, 2023-10-06T11:08:26.662 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000121 2023-10-06T11:08:26.662 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:08:26.662 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.662 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-1": { 2023-10-06T11:08:26.662 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 5578, 2023-10-06T11:08:26.662 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 5602, 2023-10-06T11:08:26.662 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 1637398, 2023-10-06T11:08:26.662 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 19540383, 2023-10-06T11:08:26.662 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 6, 2023-10-06T11:08:26.663 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 4, 2023-10-06T11:08:26.663 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 0.312198653, 2023-10-06T11:08:26.663 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 0.108934957, 2023-10-06T11:08:26.663 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 0.077988559, 2023-10-06T11:08:26.663 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.108049808, 2023-10-06T11:08:26.663 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T11:08:26.663 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 5601, 2023-10-06T11:08:26.663 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 2.244819471, 2023-10-06T11:08:26.663 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000400789 2023-10-06T11:08:26.663 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.663 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2023-10-06T11:08:26.663 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:08:26.664 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:08:26.664 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:08:26.664 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:08:26.664 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.664 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-2": { 2023-10-06T11:08:26.664 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 35784, 2023-10-06T11:08:26.664 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 61651, 2023-10-06T11:08:26.664 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 12625268, 2023-10-06T11:08:26.664 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 52309122, 2023-10-06T11:08:26.664 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 7, 2023-10-06T11:08:26.664 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 4, 2023-10-06T11:08:26.664 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 2.785026608, 2023-10-06T11:08:26.665 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 1.389343716, 2023-10-06T11:08:26.665 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 1.593954180, 2023-10-06T11:08:26.665 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.079901968, 2023-10-06T11:08:26.665 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T11:08:26.665 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 61650, 2023-10-06T11:08:26.665 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 4.364014869, 2023-10-06T11:08:26.665 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000070786 2023-10-06T11:08:26.665 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.665 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2023-10-06T11:08:26.665 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 88368, 2023-10-06T11:08:26.665 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.012182273, 2023-10-06T11:08:26.665 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000137 2023-10-06T11:08:26.666 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:08:26.666 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.666 INFO:teuthology.orchestra.run.smithi146.stdout: "cct": { 2023-10-06T11:08:26.666 INFO:teuthology.orchestra.run.smithi146.stdout: "total_workers": 1, 2023-10-06T11:08:26.666 INFO:teuthology.orchestra.run.smithi146.stdout: "unhealthy_workers": 0 2023-10-06T11:08:26.666 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.666 INFO:teuthology.orchestra.run.smithi146.stdout: "finisher-MDSRank": { 2023-10-06T11:08:26.666 INFO:teuthology.orchestra.run.smithi146.stdout: "queue_len": 0, 2023-10-06T11:08:26.666 INFO:teuthology.orchestra.run.smithi146.stdout: "complete_latency": { 2023-10-06T11:08:26.666 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 9965, 2023-10-06T11:08:26.666 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 16.540278346, 2023-10-06T11:08:26.667 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.001659837 2023-10-06T11:08:26.667 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:08:26.667 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.667 INFO:teuthology.orchestra.run.smithi146.stdout: "finisher-PurgeQueue": { 2023-10-06T11:08:26.667 INFO:teuthology.orchestra.run.smithi146.stdout: "queue_len": 0, 2023-10-06T11:08:26.667 INFO:teuthology.orchestra.run.smithi146.stdout: "complete_latency": { 2023-10-06T11:08:26.667 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 3554, 2023-10-06T11:08:26.667 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 1.040151164, 2023-10-06T11:08:26.667 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000292670 2023-10-06T11:08:26.667 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:08:26.667 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.667 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": { 2023-10-06T11:08:26.668 INFO:teuthology.orchestra.run.smithi146.stdout: "request": 30501, 2023-10-06T11:08:26.668 INFO:teuthology.orchestra.run.smithi146.stdout: "reply": 30501, 2023-10-06T11:08:26.668 INFO:teuthology.orchestra.run.smithi146.stdout: "reply_latency": { 2023-10-06T11:08:26.668 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 30501, 2023-10-06T11:08:26.668 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 597.723987154, 2023-10-06T11:08:26.668 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.019596865 2023-10-06T11:08:26.668 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.668 INFO:teuthology.orchestra.run.smithi146.stdout: "slow_reply": 0, 2023-10-06T11:08:26.668 INFO:teuthology.orchestra.run.smithi146.stdout: "forward": 0, 2023-10-06T11:08:26.668 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_fetch": 0, 2023-10-06T11:08:26.668 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_commit": 58, 2023-10-06T11:08:26.668 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_split": 0, 2023-10-06T11:08:26.669 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_merge": 0, 2023-10-06T11:08:26.669 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes": 7838, 2023-10-06T11:08:26.669 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_top": 5478, 2023-10-06T11:08:26.669 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_bottom": 2360, 2023-10-06T11:08:26.669 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_pin_tail": 0, 2023-10-06T11:08:26.669 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_pinned": 11, 2023-10-06T11:08:26.669 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_expired": 8000, 2023-10-06T11:08:26.669 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_with_caps": 2, 2023-10-06T11:08:26.669 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": 2, 2023-10-06T11:08:26.669 INFO:teuthology.orchestra.run.smithi146.stdout: "subtrees": 2, 2023-10-06T11:08:26.669 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse": 57645, 2023-10-06T11:08:26.670 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_hit": 55584, 2023-10-06T11:08:26.670 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_forward": 0, 2023-10-06T11:08:26.670 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_discover": 0, 2023-10-06T11:08:26.670 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_dir_fetch": 0, 2023-10-06T11:08:26.670 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_remote_ino": 0, 2023-10-06T11:08:26.670 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_lock": 1938, 2023-10-06T11:08:26.670 INFO:teuthology.orchestra.run.smithi146.stdout: "load_cent": 11797, 2023-10-06T11:08:26.670 INFO:teuthology.orchestra.run.smithi146.stdout: "q": 0, 2023-10-06T11:08:26.670 INFO:teuthology.orchestra.run.smithi146.stdout: "exported": 0, 2023-10-06T11:08:26.670 INFO:teuthology.orchestra.run.smithi146.stdout: "exported_inodes": 0, 2023-10-06T11:08:26.670 INFO:teuthology.orchestra.run.smithi146.stdout: "imported": 0, 2023-10-06T11:08:26.670 INFO:teuthology.orchestra.run.smithi146.stdout: "imported_inodes": 0, 2023-10-06T11:08:26.671 INFO:teuthology.orchestra.run.smithi146.stdout: "openino_dir_fetch": 0, 2023-10-06T11:08:26.671 INFO:teuthology.orchestra.run.smithi146.stdout: "openino_backtrace_fetch": 1733, 2023-10-06T11:08:26.671 INFO:teuthology.orchestra.run.smithi146.stdout: "openino_peer_discover": 0, 2023-10-06T11:08:26.671 INFO:teuthology.orchestra.run.smithi146.stdout: "root_rfiles": 0, 2023-10-06T11:08:26.671 INFO:teuthology.orchestra.run.smithi146.stdout: "root_rbytes": 0, 2023-10-06T11:08:26.671 INFO:teuthology.orchestra.run.smithi146.stdout: "root_rsnaps": 0, 2023-10-06T11:08:26.671 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_backtrace_fetch": 1733, 2023-10-06T11:08:26.671 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_set_tag": 0, 2023-10-06T11:08:26.671 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_backtrace_repaired": 0, 2023-10-06T11:08:26.671 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_inotable_repaired": 0, 2023-10-06T11:08:26.671 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_dir_inodes": 13, 2023-10-06T11:08:26.671 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_dir_base_inodes": 2, 2023-10-06T11:08:26.672 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_dirfrag_rstats": 11, 2023-10-06T11:08:26.672 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_file_inodes": 1720, 2023-10-06T11:08:26.672 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_inode_file_caps": 0, 2023-10-06T11:08:26.672 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_revoke": 6149, 2023-10-06T11:08:26.672 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_grant": 6004, 2023-10-06T11:08:26.672 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_trunc": 0, 2023-10-06T11:08:26.672 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-06T11:08:26.672 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-06T11:08:26.672 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_caps": 6149, 2023-10-06T11:08:26.672 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_caps_dirty": 2000, 2023-10-06T11:08:26.672 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_cap_release": 28, 2023-10-06T11:08:26.672 INFO:teuthology.orchestra.run.smithi146.stdout: "process_request_cap_release": 17812 2023-10-06T11:08:26.672 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.673 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_cache": { 2023-10-06T11:08:26.673 INFO:teuthology.orchestra.run.smithi146.stdout: "num_strays": 0, 2023-10-06T11:08:26.673 INFO:teuthology.orchestra.run.smithi146.stdout: "num_strays_delayed": 0, 2023-10-06T11:08:26.673 INFO:teuthology.orchestra.run.smithi146.stdout: "num_strays_enqueuing": 0, 2023-10-06T11:08:26.673 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_created": 4226, 2023-10-06T11:08:26.673 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_enqueued": 3319, 2023-10-06T11:08:26.673 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_reintegrated": 4514, 2023-10-06T11:08:26.673 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_migrated": 0, 2023-10-06T11:08:26.673 INFO:teuthology.orchestra.run.smithi146.stdout: "num_recovering_processing": 0, 2023-10-06T11:08:26.673 INFO:teuthology.orchestra.run.smithi146.stdout: "num_recovering_enqueued": 0, 2023-10-06T11:08:26.673 INFO:teuthology.orchestra.run.smithi146.stdout: "num_recovering_prioritized": 0, 2023-10-06T11:08:26.673 INFO:teuthology.orchestra.run.smithi146.stdout: "recovery_started": 0, 2023-10-06T11:08:26.674 INFO:teuthology.orchestra.run.smithi146.stdout: "recovery_completed": 0, 2023-10-06T11:08:26.674 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_enqueue_scrub": 1, 2023-10-06T11:08:26.674 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_exportdir": 0, 2023-10-06T11:08:26.674 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_flush": 0, 2023-10-06T11:08:26.674 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_fragmentdir": 0, 2023-10-06T11:08:26.674 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_fragstats": 0, 2023-10-06T11:08:26.674 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_inodestats": 0 2023-10-06T11:08:26.674 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.674 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_log": { 2023-10-06T11:08:26.674 INFO:teuthology.orchestra.run.smithi146.stdout: "evadd": 23617, 2023-10-06T11:08:26.674 INFO:teuthology.orchestra.run.smithi146.stdout: "evex": 22891, 2023-10-06T11:08:26.674 INFO:teuthology.orchestra.run.smithi146.stdout: "evtrm": 22891, 2023-10-06T11:08:26.675 INFO:teuthology.orchestra.run.smithi146.stdout: "ev": 1750, 2023-10-06T11:08:26.675 INFO:teuthology.orchestra.run.smithi146.stdout: "evexg": 0, 2023-10-06T11:08:26.675 INFO:teuthology.orchestra.run.smithi146.stdout: "evexd": 1024, 2023-10-06T11:08:26.675 INFO:teuthology.orchestra.run.smithi146.stdout: "segadd": 28, 2023-10-06T11:08:26.675 INFO:teuthology.orchestra.run.smithi146.stdout: "segex": 27, 2023-10-06T11:08:26.675 INFO:teuthology.orchestra.run.smithi146.stdout: "segtrm": 27, 2023-10-06T11:08:26.675 INFO:teuthology.orchestra.run.smithi146.stdout: "seg": 2, 2023-10-06T11:08:26.675 INFO:teuthology.orchestra.run.smithi146.stdout: "segexg": 0, 2023-10-06T11:08:26.675 INFO:teuthology.orchestra.run.smithi146.stdout: "segexd": 1, 2023-10-06T11:08:26.675 INFO:teuthology.orchestra.run.smithi146.stdout: "expos": 78847306, 2023-10-06T11:08:26.675 INFO:teuthology.orchestra.run.smithi146.stdout: "wrpos": 79285684, 2023-10-06T11:08:26.675 INFO:teuthology.orchestra.run.smithi146.stdout: "rdpos": 0, 2023-10-06T11:08:26.676 INFO:teuthology.orchestra.run.smithi146.stdout: "jlat": { 2023-10-06T11:08:26.676 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 6671, 2023-10-06T11:08:26.676 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 110.598675420, 2023-10-06T11:08:26.676 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.016579024 2023-10-06T11:08:26.676 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.676 INFO:teuthology.orchestra.run.smithi146.stdout: "replayed": 0 2023-10-06T11:08:26.676 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.676 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_mem": { 2023-10-06T11:08:26.676 INFO:teuthology.orchestra.run.smithi146.stdout: "ino": 14, 2023-10-06T11:08:26.676 INFO:teuthology.orchestra.run.smithi146.stdout: "ino+": 2016, 2023-10-06T11:08:26.676 INFO:teuthology.orchestra.run.smithi146.stdout: "ino-": 2002, 2023-10-06T11:08:26.676 INFO:teuthology.orchestra.run.smithi146.stdout: "dir": 13, 2023-10-06T11:08:26.677 INFO:teuthology.orchestra.run.smithi146.stdout: "dir+": 13, 2023-10-06T11:08:26.677 INFO:teuthology.orchestra.run.smithi146.stdout: "dir-": 0, 2023-10-06T11:08:26.677 INFO:teuthology.orchestra.run.smithi146.stdout: "dn": 8209, 2023-10-06T11:08:26.677 INFO:teuthology.orchestra.run.smithi146.stdout: "dn+": 20000, 2023-10-06T11:08:26.677 INFO:teuthology.orchestra.run.smithi146.stdout: "dn-": 11791, 2023-10-06T11:08:26.677 INFO:teuthology.orchestra.run.smithi146.stdout: "cap": 2, 2023-10-06T11:08:26.677 INFO:teuthology.orchestra.run.smithi146.stdout: "cap+": 2002, 2023-10-06T11:08:26.677 INFO:teuthology.orchestra.run.smithi146.stdout: "cap-": 2000, 2023-10-06T11:08:26.677 INFO:teuthology.orchestra.run.smithi146.stdout: "rss": 85132, 2023-10-06T11:08:26.677 INFO:teuthology.orchestra.run.smithi146.stdout: "heap": 207104 2023-10-06T11:08:26.677 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.677 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_server": { 2023-10-06T11:08:26.678 INFO:teuthology.orchestra.run.smithi146.stdout: "dispatch_client_request": 43512, 2023-10-06T11:08:26.678 INFO:teuthology.orchestra.run.smithi146.stdout: "dispatch_server_request": 0, 2023-10-06T11:08:26.678 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_request": 30501, 2023-10-06T11:08:26.678 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_session": 7, 2023-10-06T11:08:26.678 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_peer_request": 0, 2023-10-06T11:08:26.678 INFO:teuthology.orchestra.run.smithi146.stdout: "req_create_latency": { 2023-10-06T11:08:26.678 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 2000, 2023-10-06T11:08:26.678 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 1.451177270, 2023-10-06T11:08:26.678 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000725588 2023-10-06T11:08:26.678 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.678 INFO:teuthology.orchestra.run.smithi146.stdout: "req_getattr_latency": { 2023-10-06T11:08:26.679 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1971, 2023-10-06T11:08:26.679 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.678170708, 2023-10-06T11:08:26.679 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000344074 2023-10-06T11:08:26.679 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.679 INFO:teuthology.orchestra.run.smithi146.stdout: "req_getfilelock_latency": { 2023-10-06T11:08:26.679 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:08:26.679 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:08:26.679 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:08:26.679 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.679 INFO:teuthology.orchestra.run.smithi146.stdout: "req_link_latency": { 2023-10-06T11:08:26.679 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 6000, 2023-10-06T11:08:26.679 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 10.221761573, 2023-10-06T11:08:26.680 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.001703626 2023-10-06T11:08:26.680 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.680 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookup_latency": { 2023-10-06T11:08:26.680 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 8003, 2023-10-06T11:08:26.680 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 3.574431503, 2023-10-06T11:08:26.680 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000446636 2023-10-06T11:08:26.680 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.680 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookuphash_latency": { 2023-10-06T11:08:26.680 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:08:26.680 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:08:26.680 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:08:26.680 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.680 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupino_latency": { 2023-10-06T11:08:26.681 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:08:26.681 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:08:26.681 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:08:26.681 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.681 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupname_latency": { 2023-10-06T11:08:26.681 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:08:26.681 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:08:26.681 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:08:26.681 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.681 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupparent_latency": { 2023-10-06T11:08:26.681 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:08:26.681 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:08:26.682 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:08:26.682 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.682 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupsnap_latency": { 2023-10-06T11:08:26.682 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 3, 2023-10-06T11:08:26.682 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.032226986, 2023-10-06T11:08:26.682 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.010742328 2023-10-06T11:08:26.682 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.682 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lssnap_latency": { 2023-10-06T11:08:26.682 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:08:26.682 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:08:26.682 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:08:26.683 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.683 INFO:teuthology.orchestra.run.smithi146.stdout: "req_mkdir_latency": { 2023-10-06T11:08:26.683 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1, 2023-10-06T11:08:26.683 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.002559689, 2023-10-06T11:08:26.683 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.002559689 2023-10-06T11:08:26.683 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.683 INFO:teuthology.orchestra.run.smithi146.stdout: "req_mknod_latency": { 2023-10-06T11:08:26.683 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:08:26.683 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:08:26.683 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:08:26.683 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.683 INFO:teuthology.orchestra.run.smithi146.stdout: "req_mksnap_latency": { 2023-10-06T11:08:26.684 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1, 2023-10-06T11:08:26.684 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.007832496, 2023-10-06T11:08:26.684 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.007832496 2023-10-06T11:08:26.684 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.684 INFO:teuthology.orchestra.run.smithi146.stdout: "req_open_latency": { 2023-10-06T11:08:26.684 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:08:26.684 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:08:26.684 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:08:26.684 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.684 INFO:teuthology.orchestra.run.smithi146.stdout: "req_readdir_latency": { 2023-10-06T11:08:26.684 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 6, 2023-10-06T11:08:26.684 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.098080705, 2023-10-06T11:08:26.685 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.016346784 2023-10-06T11:08:26.685 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.685 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rename_latency": { 2023-10-06T11:08:26.685 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 4514, 2023-10-06T11:08:26.685 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 559.265484035, 2023-10-06T11:08:26.685 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.123895765 2023-10-06T11:08:26.685 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.685 INFO:teuthology.orchestra.run.smithi146.stdout: "req_renamesnap_latency": { 2023-10-06T11:08:26.685 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:08:26.685 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:08:26.685 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:08:26.686 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.686 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rmdir_latency": { 2023-10-06T11:08:26.686 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:08:26.686 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:08:26.686 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:08:26.686 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.686 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rmsnap_latency": { 2023-10-06T11:08:26.686 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1, 2023-10-06T11:08:26.686 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.004579579, 2023-10-06T11:08:26.686 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.004579579 2023-10-06T11:08:26.686 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.686 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rmxattr_latency": { 2023-10-06T11:08:26.687 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:08:26.687 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:08:26.687 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:08:26.687 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.687 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setattr_latency": { 2023-10-06T11:08:26.687 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1, 2023-10-06T11:08:26.687 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000243953, 2023-10-06T11:08:26.687 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000243953 2023-10-06T11:08:26.687 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.687 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setdirlayout_latency": { 2023-10-06T11:08:26.687 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:08:26.687 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:08:26.688 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:08:26.688 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.688 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setfilelock_latency": { 2023-10-06T11:08:26.688 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:08:26.688 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:08:26.688 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:08:26.688 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.688 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setlayout_latency": { 2023-10-06T11:08:26.688 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:08:26.688 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:08:26.688 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:08:26.688 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.689 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setxattr_latency": { 2023-10-06T11:08:26.689 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:08:26.689 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:08:26.689 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:08:26.689 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.689 INFO:teuthology.orchestra.run.smithi146.stdout: "req_symlink_latency": { 2023-10-06T11:08:26.689 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:08:26.689 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:08:26.689 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:08:26.689 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.689 INFO:teuthology.orchestra.run.smithi146.stdout: "req_unlink_latency": { 2023-10-06T11:08:26.689 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 8000, 2023-10-06T11:08:26.690 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 22.387438657, 2023-10-06T11:08:26.690 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.002798429 2023-10-06T11:08:26.690 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.690 INFO:teuthology.orchestra.run.smithi146.stdout: "cap_revoke_eviction": 0, 2023-10-06T11:08:26.690 INFO:teuthology.orchestra.run.smithi146.stdout: "cap_acquisition_throttle": 0, 2023-10-06T11:08:26.690 INFO:teuthology.orchestra.run.smithi146.stdout: "req_getvxattr_latency": { 2023-10-06T11:08:26.690 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:08:26.690 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:08:26.690 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:08:26.690 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:08:26.690 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.690 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_sessions": { 2023-10-06T11:08:26.691 INFO:teuthology.orchestra.run.smithi146.stdout: "session_count": 1, 2023-10-06T11:08:26.691 INFO:teuthology.orchestra.run.smithi146.stdout: "session_add": 1, 2023-10-06T11:08:26.691 INFO:teuthology.orchestra.run.smithi146.stdout: "session_remove": 0, 2023-10-06T11:08:26.691 INFO:teuthology.orchestra.run.smithi146.stdout: "sessions_open": 1, 2023-10-06T11:08:26.691 INFO:teuthology.orchestra.run.smithi146.stdout: "sessions_stale": 0, 2023-10-06T11:08:26.691 INFO:teuthology.orchestra.run.smithi146.stdout: "total_load": 18938, 2023-10-06T11:08:26.691 INFO:teuthology.orchestra.run.smithi146.stdout: "average_load": 18938, 2023-10-06T11:08:26.691 INFO:teuthology.orchestra.run.smithi146.stdout: "avg_session_uptime": 95 2023-10-06T11:08:26.691 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.691 INFO:teuthology.orchestra.run.smithi146.stdout: "mempool": { 2023-10-06T11:08:26.691 INFO:teuthology.orchestra.run.smithi146.stdout: "bloom_filter_bytes": 19265, 2023-10-06T11:08:26.691 INFO:teuthology.orchestra.run.smithi146.stdout: "bloom_filter_items": 19265, 2023-10-06T11:08:26.692 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_alloc_bytes": 0, 2023-10-06T11:08:26.692 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_alloc_items": 0, 2023-10-06T11:08:26.692 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_data_bytes": 0, 2023-10-06T11:08:26.692 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_data_items": 0, 2023-10-06T11:08:26.692 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-06T11:08:26.692 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_onode_items": 0, 2023-10-06T11:08:26.692 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-06T11:08:26.692 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_meta_items": 0, 2023-10-06T11:08:26.692 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_other_bytes": 0, 2023-10-06T11:08:26.692 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_other_items": 0, 2023-10-06T11:08:26.692 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_Buffer_bytes": 0, 2023-10-06T11:08:26.692 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_Buffer_items": 0, 2023-10-06T11:08:26.693 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_Extent_bytes": 0, 2023-10-06T11:08:26.693 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_Extent_items": 0, 2023-10-06T11:08:26.693 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_Blob_bytes": 0, 2023-10-06T11:08:26.693 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_Blob_items": 0, 2023-10-06T11:08:26.693 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_SharedBlob_bytes": 0, 2023-10-06T11:08:26.693 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_SharedBlob_items": 0, 2023-10-06T11:08:26.693 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-06T11:08:26.693 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_inline_bl_items": 0, 2023-10-06T11:08:26.693 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_fsck_bytes": 0, 2023-10-06T11:08:26.693 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_fsck_items": 0, 2023-10-06T11:08:26.693 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_txc_bytes": 0, 2023-10-06T11:08:26.693 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_txc_items": 0, 2023-10-06T11:08:26.693 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-06T11:08:26.694 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_deferred_items": 0, 2023-10-06T11:08:26.694 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_bytes": 0, 2023-10-06T11:08:26.694 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_items": 0, 2023-10-06T11:08:26.694 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_bytes": 0, 2023-10-06T11:08:26.694 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_items": 0, 2023-10-06T11:08:26.694 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_reader_bytes": 0, 2023-10-06T11:08:26.694 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_reader_items": 0, 2023-10-06T11:08:26.694 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_writer_bytes": 0, 2023-10-06T11:08:26.694 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_writer_items": 0, 2023-10-06T11:08:26.694 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_anon_bytes": 234791, 2023-10-06T11:08:26.694 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_anon_items": 82, 2023-10-06T11:08:26.694 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_meta_bytes": 0, 2023-10-06T11:08:26.695 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_meta_items": 0, 2023-10-06T11:08:26.695 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_bytes": 0, 2023-10-06T11:08:26.695 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_items": 0, 2023-10-06T11:08:26.695 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_mapbl_bytes": 0, 2023-10-06T11:08:26.695 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_mapbl_items": 0, 2023-10-06T11:08:26.695 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_pglog_bytes": 0, 2023-10-06T11:08:26.695 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_pglog_items": 0, 2023-10-06T11:08:26.695 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_bytes": 6304, 2023-10-06T11:08:26.695 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_items": 82, 2023-10-06T11:08:26.695 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_mapping_bytes": 0, 2023-10-06T11:08:26.695 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_mapping_items": 0, 2023-10-06T11:08:26.695 INFO:teuthology.orchestra.run.smithi146.stdout: "pgmap_bytes": 0, 2023-10-06T11:08:26.696 INFO:teuthology.orchestra.run.smithi146.stdout: "pgmap_items": 0, 2023-10-06T11:08:26.696 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_co_bytes": 6117809, 2023-10-06T11:08:26.696 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_co_items": 311011, 2023-10-06T11:08:26.696 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_1_bytes": 0, 2023-10-06T11:08:26.696 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_1_items": 0, 2023-10-06T11:08:26.696 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_2_bytes": 0, 2023-10-06T11:08:26.696 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_2_items": 0 2023-10-06T11:08:26.696 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.696 INFO:teuthology.orchestra.run.smithi146.stdout: "objecter": { 2023-10-06T11:08:26.696 INFO:teuthology.orchestra.run.smithi146.stdout: "op_active": 0, 2023-10-06T11:08:26.696 INFO:teuthology.orchestra.run.smithi146.stdout: "op_laggy": 0, 2023-10-06T11:08:26.696 INFO:teuthology.orchestra.run.smithi146.stdout: "op_send": 16625, 2023-10-06T11:08:26.697 INFO:teuthology.orchestra.run.smithi146.stdout: "op_send_bytes": 85413012, 2023-10-06T11:08:26.697 INFO:teuthology.orchestra.run.smithi146.stdout: "op_resend": 37, 2023-10-06T11:08:26.697 INFO:teuthology.orchestra.run.smithi146.stdout: "op_reply": 16625, 2023-10-06T11:08:26.697 INFO:teuthology.orchestra.run.smithi146.stdout: "oplen_avg": { 2023-10-06T11:08:26.697 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 16625, 2023-10-06T11:08:26.697 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 25906 2023-10-06T11:08:26.697 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.697 INFO:teuthology.orchestra.run.smithi146.stdout: "op": 16625, 2023-10-06T11:08:26.697 INFO:teuthology.orchestra.run.smithi146.stdout: "op_r": 1801, 2023-10-06T11:08:26.697 INFO:teuthology.orchestra.run.smithi146.stdout: "op_w": 14824, 2023-10-06T11:08:26.697 INFO:teuthology.orchestra.run.smithi146.stdout: "op_rmw": 0, 2023-10-06T11:08:26.697 INFO:teuthology.orchestra.run.smithi146.stdout: "op_pg": 0, 2023-10-06T11:08:26.698 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_stat": 45, 2023-10-06T11:08:26.698 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_create": 4571, 2023-10-06T11:08:26.698 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_read": 66, 2023-10-06T11:08:26.698 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_write": 6735, 2023-10-06T11:08:26.698 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_writefull": 64, 2023-10-06T11:08:26.698 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_writesame": 0, 2023-10-06T11:08:26.698 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_append": 0, 2023-10-06T11:08:26.698 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_zero": 1319, 2023-10-06T11:08:26.698 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_truncate": 0, 2023-10-06T11:08:26.698 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_delete": 2046, 2023-10-06T11:08:26.698 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_mapext": 0, 2023-10-06T11:08:26.698 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_sparse_read": 0, 2023-10-06T11:08:26.698 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_clonerange": 0, 2023-10-06T11:08:26.699 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_getxattr": 1735, 2023-10-06T11:08:26.699 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_setxattr": 9142, 2023-10-06T11:08:26.699 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_cmpxattr": 0, 2023-10-06T11:08:26.699 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_rmxattr": 0, 2023-10-06T11:08:26.699 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_resetxattrs": 0, 2023-10-06T11:08:26.699 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_call": 0, 2023-10-06T11:08:26.699 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_watch": 0, 2023-10-06T11:08:26.699 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_notify": 0, 2023-10-06T11:08:26.699 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_src_cmpxattr": 0, 2023-10-06T11:08:26.699 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_pgls": 0, 2023-10-06T11:08:26.699 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_pgls_filter": 0, 2023-10-06T11:08:26.699 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_other": 0, 2023-10-06T11:08:26.700 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_active": 0, 2023-10-06T11:08:26.700 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_send": 0, 2023-10-06T11:08:26.700 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_resend": 0, 2023-10-06T11:08:26.700 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_ping": 0, 2023-10-06T11:08:26.700 INFO:teuthology.orchestra.run.smithi146.stdout: "poolop_active": 0, 2023-10-06T11:08:26.700 INFO:teuthology.orchestra.run.smithi146.stdout: "poolop_send": 0, 2023-10-06T11:08:26.700 INFO:teuthology.orchestra.run.smithi146.stdout: "poolop_resend": 0, 2023-10-06T11:08:26.700 INFO:teuthology.orchestra.run.smithi146.stdout: "poolstat_active": 0, 2023-10-06T11:08:26.700 INFO:teuthology.orchestra.run.smithi146.stdout: "poolstat_send": 0, 2023-10-06T11:08:26.700 INFO:teuthology.orchestra.run.smithi146.stdout: "poolstat_resend": 0, 2023-10-06T11:08:26.700 INFO:teuthology.orchestra.run.smithi146.stdout: "statfs_active": 0, 2023-10-06T11:08:26.700 INFO:teuthology.orchestra.run.smithi146.stdout: "statfs_send": 0, 2023-10-06T11:08:26.701 INFO:teuthology.orchestra.run.smithi146.stdout: "statfs_resend": 0, 2023-10-06T11:08:26.701 INFO:teuthology.orchestra.run.smithi146.stdout: "command_active": 0, 2023-10-06T11:08:26.701 INFO:teuthology.orchestra.run.smithi146.stdout: "command_send": 0, 2023-10-06T11:08:26.701 INFO:teuthology.orchestra.run.smithi146.stdout: "command_resend": 0, 2023-10-06T11:08:26.701 INFO:teuthology.orchestra.run.smithi146.stdout: "map_epoch": 35, 2023-10-06T11:08:26.701 INFO:teuthology.orchestra.run.smithi146.stdout: "map_full": 0, 2023-10-06T11:08:26.701 INFO:teuthology.orchestra.run.smithi146.stdout: "map_inc": 5, 2023-10-06T11:08:26.701 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_sessions": 8, 2023-10-06T11:08:26.701 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_session_open": 8, 2023-10-06T11:08:26.701 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_session_close": 0, 2023-10-06T11:08:26.701 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_laggy": 0, 2023-10-06T11:08:26.701 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_wr": 145, 2023-10-06T11:08:26.702 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_rd": 0, 2023-10-06T11:08:26.702 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_del": 38 2023-10-06T11:08:26.702 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.702 INFO:teuthology.orchestra.run.smithi146.stdout: "oft": { 2023-10-06T11:08:26.702 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_objs": 1, 2023-10-06T11:08:26.702 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_kv_pairs": 0, 2023-10-06T11:08:26.702 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_updates": 0, 2023-10-06T11:08:26.702 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_removes": 0 2023-10-06T11:08:26.702 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.702 INFO:teuthology.orchestra.run.smithi146.stdout: "purge_queue": { 2023-10-06T11:08:26.702 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing_ops": 0, 2023-10-06T11:08:26.702 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing_ops_high_water": 32, 2023-10-06T11:08:26.703 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing": 0, 2023-10-06T11:08:26.703 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing_high_water": 32, 2023-10-06T11:08:26.703 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executed": 3319, 2023-10-06T11:08:26.703 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_item_in_journal": 0 2023-10-06T11:08:26.703 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.703 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-06T11:08:26.703 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2023-10-06T11:08:26.703 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 104857600, 2023-10-06T11:08:26.703 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2023-10-06T11:08:26.703 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 49007, 2023-10-06T11:08:26.703 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 11990322, 2023-10-06T11:08:26.703 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2023-10-06T11:08:26.704 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 49007, 2023-10-06T11:08:26.704 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2023-10-06T11:08:26.704 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2023-10-06T11:08:26.704 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 49007, 2023-10-06T11:08:26.704 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 11990322, 2023-10-06T11:08:26.704 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2023-10-06T11:08:26.704 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:08:26.704 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:08:26.704 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:08:26.704 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:08:26.704 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.704 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-objecter_bytes": { 2023-10-06T11:08:26.705 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2023-10-06T11:08:26.705 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 104857600, 2023-10-06T11:08:26.705 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2023-10-06T11:08:26.705 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 0, 2023-10-06T11:08:26.705 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 0, 2023-10-06T11:08:26.705 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2023-10-06T11:08:26.705 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 0, 2023-10-06T11:08:26.705 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 16625, 2023-10-06T11:08:26.705 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 85758783, 2023-10-06T11:08:26.705 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 16625, 2023-10-06T11:08:26.705 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 85758783, 2023-10-06T11:08:26.706 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2023-10-06T11:08:26.706 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:08:26.706 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:08:26.706 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:08:26.706 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:08:26.706 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.706 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-objecter_ops": { 2023-10-06T11:08:26.706 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2023-10-06T11:08:26.706 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 1024, 2023-10-06T11:08:26.706 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2023-10-06T11:08:26.706 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 0, 2023-10-06T11:08:26.706 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 0, 2023-10-06T11:08:26.707 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2023-10-06T11:08:26.707 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 0, 2023-10-06T11:08:26.707 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 16625, 2023-10-06T11:08:26.707 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 16625, 2023-10-06T11:08:26.707 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 16625, 2023-10-06T11:08:26.707 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 16625, 2023-10-06T11:08:26.707 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2023-10-06T11:08:26.707 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:08:26.707 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:08:26.707 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:08:26.707 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:08:26.707 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.707 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-write_buf_throttle": { 2023-10-06T11:08:26.708 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2023-10-06T11:08:26.708 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 3758096384, 2023-10-06T11:08:26.708 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2023-10-06T11:08:26.708 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 3319, 2023-10-06T11:08:26.708 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 345771, 2023-10-06T11:08:26.708 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2023-10-06T11:08:26.708 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 3319, 2023-10-06T11:08:26.708 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2023-10-06T11:08:26.708 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2023-10-06T11:08:26.708 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 64, 2023-10-06T11:08:26.708 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 345771, 2023-10-06T11:08:26.708 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2023-10-06T11:08:26.709 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:08:26.709 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:08:26.709 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:08:26.709 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:08:26.709 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:26.709 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-write_buf_throttle-0x55b61bcb1e00": { 2023-10-06T11:08:26.709 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2023-10-06T11:08:26.709 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 3758096384, 2023-10-06T11:08:26.709 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2023-10-06T11:08:26.709 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 23617, 2023-10-06T11:08:26.709 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 75091380, 2023-10-06T11:08:26.709 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2023-10-06T11:08:26.710 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 23617, 2023-10-06T11:08:26.710 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2023-10-06T11:08:26.710 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2023-10-06T11:08:26.710 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 6671, 2023-10-06T11:08:26.710 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 75091380, 2023-10-06T11:08:26.710 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2023-10-06T11:08:26.710 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:08:26.710 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:08:26.710 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:08:26.710 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:08:26.710 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:08:26.710 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:08:26.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.650+0000 7f893debf700 1 -- 172.21.15.146:0/2586082563 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8924066f30 msgr2=0x7f89240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:26.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.650+0000 7f893debf700 1 --2- 172.21.15.146:0/2586082563 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8924066f30 0x7f89240693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8938069740 tx=0x7f892c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.650+0000 7f893debf700 1 -- 172.21.15.146:0/2586082563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89380ae730 msgr2=0x7f8938157620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:26.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.650+0000 7f893debf700 1 --2- 172.21.15.146:0/2586082563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89380ae730 0x7f8938157620 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8928003000 tx=0x7f8928018000 comp rx=0 tx=0).stop 2023-10-06T11:08:26.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.651+0000 7f893debf700 1 -- 172.21.15.146:0/2586082563 shutdown_connections 2023-10-06T11:08:26.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.651+0000 7f893debf700 1 --2- 172.21.15.146:0/2586082563 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8924066f30 0x7f89240693e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.651+0000 7f893debf700 1 --2- 172.21.15.146:0/2586082563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89380b1df0 0x7f89380b4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.651+0000 7f893debf700 1 --2- 172.21.15.146:0/2586082563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89380ae730 0x7f8938157620 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.651+0000 7f893debf700 1 --2- 172.21.15.146:0/2586082563 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89380ce3d0 0x7f89380afd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:26.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.651+0000 7f893debf700 1 -- 172.21.15.146:0/2586082563 >> 172.21.15.146:0/2586082563 conn(0x7f893806f380 msgr2=0x7f89380cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:26.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.651+0000 7f893debf700 1 -- 172.21.15.146:0/2586082563 shutdown_connections 2023-10-06T11:08:26.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:26.651+0000 7f893debf700 1 -- 172.21.15.146:0/2586082563 wait complete. 2023-10-06T11:08:26.714 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T11:08:26.714 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:08:26.755 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:08:26.799 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T11:08:26.799 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi146.front.sepia.ceph.com... 2023-10-06T11:08:26.799 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T11:08:26.800 DEBUG:teuthology.orchestra.run.smithi146:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T11:08:26.834 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[103883]: fuse finished with error 0 and tester_r 0 2023-10-06T11:08:26.838 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-10-06T11:08:26.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:08:26.838 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T11:08:27.005 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-10-06T11:08:27.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:08:27.006 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T11:08:27.023 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:08:27.024 INFO:teuthology.orchestra.run.smithi151.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-06T11:08:27.024 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-10-06T11:08:27.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:08:27.024 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T11:08:27.060 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:08:27.060 INFO:teuthology.orchestra.run.smithi146.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-06T11:08:27.061 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-10-06T11:08:27.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:08:27.061 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T11:08:27.081 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:08:27.082 INFO:teuthology.orchestra.run.smithi151.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-06T11:08:27.082 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:08:27.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.214+0000 7f4f4a976700 1 Processor -- start 2023-10-06T11:08:27.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.214+0000 7f4f4a976700 1 -- start start 2023-10-06T11:08:27.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.215+0000 7f4f4a976700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f440ced80 0x7f4f440c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:27.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.215+0000 7f4f4a976700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4f440c3910 0x7f4f440cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:27.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.215+0000 7f4f4a976700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f440cf210 con 0x7f4f440b0c00 2023-10-06T11:08:27.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.215+0000 7f4f4a976700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f440682f0 con 0x7f4f440c3910 2023-10-06T11:08:27.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.215+0000 7f4f4a976700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f44068580 con 0x7f4f440ced80 2023-10-06T11:08:27.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.215+0000 7f4f43fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4f440b0c00 0x7f4f440c3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35128/0 (socket says 172.21.15.146:35128) 2023-10-06T11:08:27.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.215+0000 7f4f43fff700 1 -- 172.21.15.146:0/956208604 learned_addr learned my addr 172.21.15.146:0/956208604 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:08:27.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.215+0000 7f4f48f13700 1 --2- 172.21.15.146:0/956208604 >> v2:172.21.15.146:3300/0 conn(0x7f4f440c3910 0x7f4f440cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:27.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.215+0000 7f4f437fe700 1 --2- 172.21.15.146:0/956208604 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f440ced80 0x7f4f440c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:27.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.215+0000 7f4f42ffd700 1 -- 172.21.15.146:0/956208604 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 904390708 0 0) 0x7f4f440cf210 con 0x7f4f440b0c00 2023-10-06T11:08:27.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.216+0000 7f4f42ffd700 1 -- 172.21.15.146:0/956208604 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f2c003570 con 0x7f4f440b0c00 2023-10-06T11:08:27.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.216+0000 7f4f48f13700 1 -- 172.21.15.146:0/956208604 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f440ced80 msgr2=0x7f4f440c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:27.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.216+0000 7f4f48f13700 1 --2- 172.21.15.146:0/956208604 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f440ced80 0x7f4f440c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:27.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.216+0000 7f4f48f13700 1 -- 172.21.15.146:0/956208604 >> v1:172.21.15.146:6789/0 conn(0x7f4f440b0c00 legacy=0x7f4f440c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:27.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.216+0000 7f4f48f13700 1 -- 172.21.15.146:0/956208604 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f44068790 con 0x7f4f440c3910 2023-10-06T11:08:27.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.216+0000 7f4f48f13700 1 --2- 172.21.15.146:0/956208604 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f440c3910 0x7f4f440cd8c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c009e60 tx=0x7f4f3c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62ce521ca3a9ff55 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:27.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.216+0000 7f4f42ffd700 1 -- 172.21.15.146:0/956208604 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c00e070 con 0x7f4f440c3910 2023-10-06T11:08:27.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.216+0000 7f4f42ffd700 1 -- 172.21.15.146:0/956208604 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3c00bb40 con 0x7f4f440c3910 2023-10-06T11:08:27.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.216+0000 7f4f42ffd700 1 -- 172.21.15.146:0/956208604 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3c012430 con 0x7f4f440c3910 2023-10-06T11:08:27.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.216+0000 7f4f4a976700 1 -- 172.21.15.146:0/956208604 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f440c3910 msgr2=0x7f4f440cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:27.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.216+0000 7f4f4a976700 1 --2- 172.21.15.146:0/956208604 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f440c3910 0x7f4f440cd8c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c009e60 tx=0x7f4f3c009780 comp rx=0 tx=0).stop 2023-10-06T11:08:27.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.216+0000 7f4f4a976700 1 -- 172.21.15.146:0/956208604 shutdown_connections 2023-10-06T11:08:27.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.216+0000 7f4f4a976700 1 --2- 172.21.15.146:0/956208604 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f440c3910 0x7f4f440cd8c0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:27.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.216+0000 7f4f4a976700 1 --2- 172.21.15.146:0/956208604 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f440ced80 0x7f4f440c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:27.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.216+0000 7f4f4a976700 1 -- 172.21.15.146:0/956208604 >> 172.21.15.146:0/956208604 conn(0x7f4f44067c50 msgr2=0x7f4f440ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:27.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.216+0000 7f4f4a976700 1 -- 172.21.15.146:0/956208604 shutdown_connections 2023-10-06T11:08:27.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.216+0000 7f4f4a976700 1 -- 172.21.15.146:0/956208604 wait complete. 2023-10-06T11:08:27.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.218+0000 7f4f4a976700 1 Processor -- start 2023-10-06T11:08:27.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.218+0000 7f4f4a976700 1 -- start start 2023-10-06T11:08:27.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.218+0000 7f4f4a976700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f440b0c00 0x7f4f4406b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:27.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.218+0000 7f4f4a976700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f440c3910 0x7f4f44098080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:27.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.218+0000 7f4f4a976700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f440ced80 0x7f4f440985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:27.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.218+0000 7f4f4a976700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4406d1b0 con 0x7f4f440c3910 2023-10-06T11:08:27.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.218+0000 7f4f4a976700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4406c110 con 0x7f4f440ced80 2023-10-06T11:08:27.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.218+0000 7f4f4a976700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4406c3f0 con 0x7f4f440b0c00 2023-10-06T11:08:27.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.218+0000 7f4f437fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f440c3910 0x7f4f44098080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:27.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.219+0000 7f4f437fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f440c3910 0x7f4f44098080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56376/0 (socket says 172.21.15.146:56376) 2023-10-06T11:08:27.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.219+0000 7f4f437fe700 1 -- 172.21.15.146:0/4245581853 learned_addr learned my addr 172.21.15.146:0/4245581853 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:27.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.219+0000 7f4f437fe700 1 -- 172.21.15.146:0/4245581853 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f440b0c00 msgr2=0x7f4f4406b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:27.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.219+0000 7f4f437fe700 1 --2- 172.21.15.146:0/4245581853 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f440b0c00 0x7f4f4406b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:27.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.219+0000 7f4f437fe700 1 -- 172.21.15.146:0/4245581853 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f440ced80 msgr2=0x7f4f440985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:27.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.219+0000 7f4f437fe700 1 --2- 172.21.15.146:0/4245581853 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f440ced80 0x7f4f440985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:27.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.219+0000 7f4f437fe700 1 -- 172.21.15.146:0/4245581853 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3c009a20 con 0x7f4f440c3910 2023-10-06T11:08:27.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.219+0000 7f4f437fe700 1 --2- 172.21.15.146:0/4245581853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f440c3910 0x7f4f44098080 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f4f3800ec80 tx=0x7f4f380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:27.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.219+0000 7f4f2bfff700 1 -- 172.21.15.146:0/4245581853 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3800c9d0 con 0x7f4f440c3910 2023-10-06T11:08:27.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.219+0000 7f4f2bfff700 1 -- 172.21.15.146:0/4245581853 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3800cb30 con 0x7f4f440c3910 2023-10-06T11:08:27.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.219+0000 7f4f2bfff700 1 -- 172.21.15.146:0/4245581853 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f38013470 con 0x7f4f440c3910 2023-10-06T11:08:27.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.219+0000 7f4f4a976700 1 -- 172.21.15.146:0/4245581853 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f4406c6d0 con 0x7f4f440c3910 2023-10-06T11:08:27.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.219+0000 7f4f4a976700 1 -- 172.21.15.146:0/4245581853 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f4406cc90 con 0x7f4f440c3910 2023-10-06T11:08:27.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.220+0000 7f4f4a976700 1 -- 172.21.15.146:0/4245581853 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f4404c380 con 0x7f4f440c3910 2023-10-06T11:08:27.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.220+0000 7f4f2bfff700 1 -- 172.21.15.146:0/4245581853 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4f38013820 con 0x7f4f440c3910 2023-10-06T11:08:27.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.221+0000 7f4f2bfff700 1 --2- 172.21.15.146:0/4245581853 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4f30066f30 0x7f4f300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:27.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.221+0000 7f4f2bfff700 1 -- 172.21.15.146:0/4245581853 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f4f38084a40 con 0x7f4f440c3910 2023-10-06T11:08:27.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.221+0000 7f4f43fff700 1 --2- 172.21.15.146:0/4245581853 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4f30066f30 0x7f4f300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:27.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.221+0000 7f4f43fff700 1 --2- 172.21.15.146:0/4245581853 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4f30066f30 0x7f4f300693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4f340058d0 tx=0x7f4f340079d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:27.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.225+0000 7f4f2bfff700 1 -- 172.21.15.146:0/4245581853 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4f38086e60 con 0x7f4f440c3910 2023-10-06T11:08:27.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.451+0000 7f4f4a976700 1 -- 172.21.15.146:0/4245581853 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4f440cb710 con 0x7f4f440c3910 2023-10-06T11:08:27.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.452+0000 7f4f2bfff700 1 -- 172.21.15.146:0/4245581853 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4610 (secure 0 0 0) 0x7f4f38051b10 con 0x7f4f440c3910 2023-10-06T11:08:27.455 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:08:27.455 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":27,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4673,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/1243531288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1243531288},{"type":"v1","addr":"172.21.15.151:6834","nonce":1243531288}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4676,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/4009288357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":4009288357},{"type":"v1","addr":"172.21.15.151:6835","nonce":4009288357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4983,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2777930290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2777930290},{"type":"v1","addr":"172.21.15.146:6836","nonce":2777930290}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-10-06T11:06:35.935256+0000","modified":"2023-10-06T11:08:13.321298+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4986},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4986":{"gid":4986,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":27,"addr":"172.21.15.146:6837/4187213529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":4187213529},{"type":"v1","addr":"172.21.15.146:6837","nonce":4187213529}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T11:08:27.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.454+0000 7f4f4a976700 1 -- 172.21.15.146:0/4245581853 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4f30066f30 msgr2=0x7f4f300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:27.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.454+0000 7f4f4a976700 1 --2- 172.21.15.146:0/4245581853 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4f30066f30 0x7f4f300693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4f340058d0 tx=0x7f4f340079d0 comp rx=0 tx=0).stop 2023-10-06T11:08:27.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.454+0000 7f4f4a976700 1 -- 172.21.15.146:0/4245581853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f440c3910 msgr2=0x7f4f44098080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:27.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.454+0000 7f4f4a976700 1 --2- 172.21.15.146:0/4245581853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f440c3910 0x7f4f44098080 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f4f3800ec80 tx=0x7f4f380091a0 comp rx=0 tx=0).stop 2023-10-06T11:08:27.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.454+0000 7f4f4a976700 1 -- 172.21.15.146:0/4245581853 shutdown_connections 2023-10-06T11:08:27.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.454+0000 7f4f4a976700 1 --2- 172.21.15.146:0/4245581853 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4f30066f30 0x7f4f300693e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:27.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.454+0000 7f4f4a976700 1 --2- 172.21.15.146:0/4245581853 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f440ced80 0x7f4f440985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:27.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.454+0000 7f4f4a976700 1 --2- 172.21.15.146:0/4245581853 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f440b0c00 0x7f4f4406b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:27.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.454+0000 7f4f4a976700 1 --2- 172.21.15.146:0/4245581853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f440c3910 0x7f4f44098080 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:27.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.454+0000 7f4f4a976700 1 -- 172.21.15.146:0/4245581853 >> 172.21.15.146:0/4245581853 conn(0x7f4f44067c50 msgr2=0x7f4f440c3ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:27.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.454+0000 7f4f4a976700 1 -- 172.21.15.146:0/4245581853 shutdown_connections 2023-10-06T11:08:27.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.454+0000 7f4f4a976700 1 -- 172.21.15.146:0/4245581853 wait complete. 2023-10-06T11:08:27.458 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 27 2023-10-06T11:08:27.468 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:08:27.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.583+0000 7f2a59d94700 1 Processor -- start 2023-10-06T11:08:27.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.583+0000 7f2a59d94700 1 -- start start 2023-10-06T11:08:27.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.584+0000 7f2a59d94700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2a54067b80 0x7f2a5406eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:27.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.584+0000 7f2a59d94700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2a540c95d0 0x7f2a540affc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:27.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.584+0000 7f2a59d94700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a54140ec0 con 0x7f2a54140af0 2023-10-06T11:08:27.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.584+0000 7f2a59d94700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a5406f880 con 0x7f2a54067b80 2023-10-06T11:08:27.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.584+0000 7f2a59d94700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a540c7fc0 con 0x7f2a540c95d0 2023-10-06T11:08:27.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.584+0000 7f2a53fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2a54067b80 0x7f2a5406eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:27.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.584+0000 7f2a58d92700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2a54140af0 0x7f2a54067470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35136/0 (socket says 172.21.15.146:35136) 2023-10-06T11:08:27.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.584+0000 7f2a58d92700 1 -- 172.21.15.146:0/5267350 learned_addr learned my addr 172.21.15.146:0/5267350 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:08:27.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.584+0000 7f2a53fff700 1 --2- 172.21.15.146:0/5267350 >> v2:172.21.15.146:3300/0 conn(0x7f2a54067b80 0x7f2a5406eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56392/0 (socket says 172.21.15.146:56392) 2023-10-06T11:08:27.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.585+0000 7f2a59593700 1 --2- 172.21.15.146:0/5267350 >> v2:172.21.15.151:3300/0 conn(0x7f2a540c95d0 0x7f2a540affc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:27.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.585+0000 7f2a53fff700 1 -- 172.21.15.146:0/5267350 >> v2:172.21.15.151:3300/0 conn(0x7f2a540c95d0 msgr2=0x7f2a540affc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:27.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.585+0000 7f2a53fff700 1 --2- 172.21.15.146:0/5267350 >> v2:172.21.15.151:3300/0 conn(0x7f2a540c95d0 0x7f2a540affc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:27.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.585+0000 7f2a53fff700 1 -- 172.21.15.146:0/5267350 >> v1:172.21.15.146:6789/0 conn(0x7f2a54140af0 legacy=0x7f2a54067470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:27.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.585+0000 7f2a537fe700 1 -- 172.21.15.146:0/5267350 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 103428481 0 0) 0x7f2a54140ec0 con 0x7f2a54140af0 2023-10-06T11:08:27.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.585+0000 7f2a53fff700 1 -- 172.21.15.146:0/5267350 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a5406f5a0 con 0x7f2a54067b80 2023-10-06T11:08:27.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.585+0000 7f2a53fff700 1 --2- 172.21.15.146:0/5267350 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a54067b80 0x7f2a5406eec0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2a54141260 tx=0x7f2a400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=780f633b943be518 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:27.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.585+0000 7f2a537fe700 1 -- 172.21.15.146:0/5267350 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4000b6b0 con 0x7f2a54067b80 2023-10-06T11:08:27.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.585+0000 7f2a537fe700 1 -- 172.21.15.146:0/5267350 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4000b810 con 0x7f2a54067b80 2023-10-06T11:08:27.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.585+0000 7f2a537fe700 1 -- 172.21.15.146:0/5267350 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4000bbb0 con 0x7f2a54067b80 2023-10-06T11:08:27.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.586+0000 7f2a59d94700 1 -- 172.21.15.146:0/5267350 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a54067b80 msgr2=0x7f2a5406eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:27.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.586+0000 7f2a59d94700 1 --2- 172.21.15.146:0/5267350 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a54067b80 0x7f2a5406eec0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2a54141260 tx=0x7f2a400091a0 comp rx=0 tx=0).stop 2023-10-06T11:08:27.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.586+0000 7f2a59d94700 1 -- 172.21.15.146:0/5267350 shutdown_connections 2023-10-06T11:08:27.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.586+0000 7f2a59d94700 1 --2- 172.21.15.146:0/5267350 >> v2:172.21.15.151:3300/0 conn(0x7f2a540c95d0 0x7f2a540affc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:27.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.586+0000 7f2a59d94700 1 --2- 172.21.15.146:0/5267350 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a54067b80 0x7f2a5406eec0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:27.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.586+0000 7f2a59d94700 1 -- 172.21.15.146:0/5267350 >> 172.21.15.146:0/5267350 conn(0x7f2a54069010 msgr2=0x7f2a540cd120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:27.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.586+0000 7f2a59d94700 1 -- 172.21.15.146:0/5267350 shutdown_connections 2023-10-06T11:08:27.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.586+0000 7f2a59d94700 1 -- 172.21.15.146:0/5267350 wait complete. 2023-10-06T11:08:27.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.587+0000 7f2a59d94700 1 Processor -- start 2023-10-06T11:08:27.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.587+0000 7f2a59d94700 1 -- start start 2023-10-06T11:08:27.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.588+0000 7f2a59d94700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2a54067b80 0x7f2a54155f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:27.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.588+0000 7f2a59d94700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a540c95d0 0x7f2a540c5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:27.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.588+0000 7f2a59d94700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a54140af0 0x7f2a540afee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:27.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.588+0000 7f2a59d94700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a540c4660 con 0x7f2a54140af0 2023-10-06T11:08:27.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.588+0000 7f2a59d94700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a540c4940 con 0x7f2a540c95d0 2023-10-06T11:08:27.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.588+0000 7f2a59d94700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a540c4c20 con 0x7f2a54067b80 2023-10-06T11:08:27.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.588+0000 7f2a59593700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a54140af0 0x7f2a540afee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:27.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.588+0000 7f2a59593700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a54140af0 0x7f2a540afee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56396/0 (socket says 172.21.15.146:56396) 2023-10-06T11:08:27.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.588+0000 7f2a59593700 1 -- 172.21.15.146:0/4241743535 learned_addr learned my addr 172.21.15.146:0/4241743535 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:27.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.588+0000 7f2a53fff700 1 --2- 172.21.15.146:0/4241743535 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a540c95d0 0x7f2a540c5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:27.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.588+0000 7f2a58d92700 1 --2- 172.21.15.146:0/4241743535 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2a54067b80 0x7f2a54155f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:27.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.588+0000 7f2a59593700 1 -- 172.21.15.146:0/4241743535 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2a54067b80 msgr2=0x7f2a54155f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:27.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.588+0000 7f2a59593700 1 --2- 172.21.15.146:0/4241743535 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2a54067b80 0x7f2a54155f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:27.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.588+0000 7f2a59593700 1 -- 172.21.15.146:0/4241743535 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a540c95d0 msgr2=0x7f2a540c5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:27.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.588+0000 7f2a59593700 1 --2- 172.21.15.146:0/4241743535 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a540c95d0 0x7f2a540c5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:27.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.588+0000 7f2a59593700 1 -- 172.21.15.146:0/4241743535 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a40009420 con 0x7f2a54140af0 2023-10-06T11:08:27.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.588+0000 7f2a59593700 1 --2- 172.21.15.146:0/4241743535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a54140af0 0x7f2a540afee0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c009fa0 tx=0x7f2a4c009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:27.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.588+0000 7f2a50ff9700 1 -- 172.21.15.146:0/4241743535 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c00ec70 con 0x7f2a54140af0 2023-10-06T11:08:27.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.588+0000 7f2a50ff9700 1 -- 172.21.15.146:0/4241743535 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4c00edd0 con 0x7f2a54140af0 2023-10-06T11:08:27.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.588+0000 7f2a59d94700 1 -- 172.21.15.146:0/4241743535 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a540c4f00 con 0x7f2a54140af0 2023-10-06T11:08:27.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.588+0000 7f2a50ff9700 1 -- 172.21.15.146:0/4241743535 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4c014670 con 0x7f2a54140af0 2023-10-06T11:08:27.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.588+0000 7f2a59d94700 1 -- 172.21.15.146:0/4241743535 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a540c6260 con 0x7f2a54140af0 2023-10-06T11:08:27.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.589+0000 7f2a59d94700 1 -- 172.21.15.146:0/4241743535 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a540ac850 con 0x7f2a54140af0 2023-10-06T11:08:27.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.590+0000 7f2a50ff9700 1 -- 172.21.15.146:0/4241743535 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2a4c014a20 con 0x7f2a54140af0 2023-10-06T11:08:27.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.590+0000 7f2a50ff9700 1 --2- 172.21.15.146:0/4241743535 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2a38066f30 0x7f2a380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:27.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.590+0000 7f2a50ff9700 1 -- 172.21.15.146:0/4241743535 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f2a4c084d20 con 0x7f2a54140af0 2023-10-06T11:08:27.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.590+0000 7f2a58d92700 1 --2- 172.21.15.146:0/4241743535 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2a38066f30 0x7f2a380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:27.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.590+0000 7f2a58d92700 1 --2- 172.21.15.146:0/4241743535 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2a38066f30 0x7f2a380693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2a4800c8f0 tx=0x7f2a48009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:27.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.594+0000 7f2a50ff9700 1 -- 172.21.15.146:0/4241743535 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2a4c051df0 con 0x7f2a54140af0 2023-10-06T11:08:27.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.780+0000 7f2a59d94700 1 -- 172.21.15.146:0/4241743535 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a540c7900 con 0x7f2a54140af0 2023-10-06T11:08:27.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.781+0000 7f2a50ff9700 1 -- 172.21.15.146:0/4241743535 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+17028 (secure 0 0 0) 0x7f2a4c055410 con 0x7f2a54140af0 2023-10-06T11:08:27.783 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:08:27.783 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":35,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:08:05.310462+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:06:34.036525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T11:06:34.902843+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":34,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.10","mappings":[{"from":5,"to":1}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:08:27.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.783+0000 7f2a59d94700 1 -- 172.21.15.146:0/4241743535 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2a38066f30 msgr2=0x7f2a380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:27.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.783+0000 7f2a59d94700 1 --2- 172.21.15.146:0/4241743535 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2a38066f30 0x7f2a380693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2a4800c8f0 tx=0x7f2a48009040 comp rx=0 tx=0).stop 2023-10-06T11:08:27.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.783+0000 7f2a59d94700 1 -- 172.21.15.146:0/4241743535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a54140af0 msgr2=0x7f2a540afee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:27.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.783+0000 7f2a59d94700 1 --2- 172.21.15.146:0/4241743535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a54140af0 0x7f2a540afee0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f2a4c009fa0 tx=0x7f2a4c009900 comp rx=0 tx=0).stop 2023-10-06T11:08:27.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.783+0000 7f2a59d94700 1 -- 172.21.15.146:0/4241743535 shutdown_connections 2023-10-06T11:08:27.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.783+0000 7f2a59d94700 1 --2- 172.21.15.146:0/4241743535 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2a38066f30 0x7f2a380693e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:27.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.783+0000 7f2a59d94700 1 --2- 172.21.15.146:0/4241743535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a54140af0 0x7f2a540afee0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:27.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.783+0000 7f2a59d94700 1 --2- 172.21.15.146:0/4241743535 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2a54067b80 0x7f2a54155f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:27.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.783+0000 7f2a59d94700 1 --2- 172.21.15.146:0/4241743535 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a540c95d0 0x7f2a540c5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:27.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.783+0000 7f2a59d94700 1 -- 172.21.15.146:0/4241743535 >> 172.21.15.146:0/4241743535 conn(0x7f2a54069010 msgr2=0x7f2a540c9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:27.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.783+0000 7f2a59d94700 1 -- 172.21.15.146:0/4241743535 shutdown_connections 2023-10-06T11:08:27.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.783+0000 7f2a59d94700 1 -- 172.21.15.146:0/4241743535 wait complete. 2023-10-06T11:08:27.797 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:05:36.687307+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:05:37.171199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T11:06:34.036525+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T11:06:34.902843+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 34, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T11:08:27.798 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:08:27.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.914+0000 7f54c759e700 1 Processor -- start 2023-10-06T11:08:27.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.914+0000 7f54c759e700 1 -- start start 2023-10-06T11:08:27.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.915+0000 7f54c759e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54c80b5640 0x7f54c815a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:27.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.915+0000 7f54c759e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f54c8068780 0x7f54c8068b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:27.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.915+0000 7f54c759e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54c80cc130 con 0x7f54c80cb090 2023-10-06T11:08:27.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.915+0000 7f54c759e700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54c80cccd0 con 0x7f54c8068780 2023-10-06T11:08:27.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.915+0000 7f54c759e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c80b2660 con 0x7f54c80b5640 2023-10-06T11:08:27.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.915+0000 7f54c659c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54c80b5640 0x7f54c815a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:27.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.915+0000 7f54c6d9d700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f54c8068780 0x7f54c8068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:27.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.915+0000 7f54bdd9b700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f54c80cb090 0x7f54c80cc5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:39272/0 (socket says 172.21.15.146:39272) 2023-10-06T11:08:27.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.915+0000 7f54bdd9b700 1 -- 172.21.15.146:0/889224915 learned_addr learned my addr 172.21.15.146:0/889224915 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:08:27.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.916+0000 7f54c659c700 1 -- 172.21.15.146:0/889224915 >> v2:172.21.15.151:3300/0 conn(0x7f54c8068780 msgr2=0x7f54c8068b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:27.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.916+0000 7f54c659c700 1 --2- 172.21.15.146:0/889224915 >> v2:172.21.15.151:3300/0 conn(0x7f54c8068780 0x7f54c8068b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:27.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.916+0000 7f54c659c700 1 -- 172.21.15.146:0/889224915 >> v1:172.21.15.151:6789/0 conn(0x7f54c80cb090 legacy=0x7f54c80cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:27.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.916+0000 7f54c659c700 1 -- 172.21.15.146:0/889224915 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c815adb0 con 0x7f54c80b5640 2023-10-06T11:08:27.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.916+0000 7f54c5d9b700 1 -- 172.21.15.146:0/889224915 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1635836415 0 0) 0x7f54c80cc130 con 0x7f54c80cb090 2023-10-06T11:08:27.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.916+0000 7f54c6d9d700 1 --2- 172.21.15.146:0/889224915 >> v2:172.21.15.151:3300/0 conn(0x7f54c8068780 0x7f54c8068b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:08:27.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.916+0000 7f54c659c700 1 --2- 172.21.15.146:0/889224915 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54c80b5640 0x7f54c815a870 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f54b80098e0 tx=0x7f54b80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af02dafd0ce584d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:27.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.916+0000 7f54c5d9b700 1 -- 172.21.15.146:0/889224915 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b800b640 con 0x7f54c80b5640 2023-10-06T11:08:27.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.916+0000 7f54c5d9b700 1 -- 172.21.15.146:0/889224915 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b800b7a0 con 0x7f54c80b5640 2023-10-06T11:08:27.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.916+0000 7f54c5d9b700 1 -- 172.21.15.146:0/889224915 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b800bb40 con 0x7f54c80b5640 2023-10-06T11:08:27.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.916+0000 7f54c759e700 1 -- 172.21.15.146:0/889224915 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54c80b5640 msgr2=0x7f54c815a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:27.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.916+0000 7f54c759e700 1 --2- 172.21.15.146:0/889224915 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54c80b5640 0x7f54c815a870 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f54b80098e0 tx=0x7f54b80091a0 comp rx=0 tx=0).stop 2023-10-06T11:08:27.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.916+0000 7f54c759e700 1 -- 172.21.15.146:0/889224915 shutdown_connections 2023-10-06T11:08:27.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.916+0000 7f54c759e700 1 --2- 172.21.15.146:0/889224915 >> v2:172.21.15.151:3300/0 conn(0x7f54c8068780 0x7f54c8068b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:27.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.916+0000 7f54c759e700 1 --2- 172.21.15.146:0/889224915 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54c80b5640 0x7f54c815a870 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:27.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.916+0000 7f54c759e700 1 -- 172.21.15.146:0/889224915 >> 172.21.15.146:0/889224915 conn(0x7f54c80703f0 msgr2=0x7f54c80707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:27.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.916+0000 7f54c759e700 1 -- 172.21.15.146:0/889224915 shutdown_connections 2023-10-06T11:08:27.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.916+0000 7f54c759e700 1 -- 172.21.15.146:0/889224915 wait complete. 2023-10-06T11:08:27.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.918+0000 7f54c759e700 1 Processor -- start 2023-10-06T11:08:27.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.918+0000 7f54c759e700 1 -- start start 2023-10-06T11:08:27.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.918+0000 7f54c759e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54c8068780 0x7f54c80ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:27.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.918+0000 7f54c759e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54c80b5640 0x7f54c80c6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:27.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.918+0000 7f54c759e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54c80cb090 0x7f54c80c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:27.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.918+0000 7f54c759e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c80ca710 con 0x7f54c80cb090 2023-10-06T11:08:27.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.918+0000 7f54c759e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54c8169780 con 0x7f54c80b5640 2023-10-06T11:08:27.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.918+0000 7f54c759e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54c80c7290 con 0x7f54c8068780 2023-10-06T11:08:27.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.919+0000 7f54c6d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54c80cb090 0x7f54c80c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:27.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.919+0000 7f54c6d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54c80cb090 0x7f54c80c69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56400/0 (socket says 172.21.15.146:56400) 2023-10-06T11:08:27.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.919+0000 7f54c6d9d700 1 -- 172.21.15.146:0/194921703 learned_addr learned my addr 172.21.15.146:0/194921703 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:27.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.919+0000 7f54bdd9b700 1 --2- 172.21.15.146:0/194921703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54c80b5640 0x7f54c80c6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:27.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.919+0000 7f54c659c700 1 --2- 172.21.15.146:0/194921703 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54c8068780 0x7f54c80ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:27.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.919+0000 7f54c6d9d700 1 -- 172.21.15.146:0/194921703 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54c8068780 msgr2=0x7f54c80ca1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:27.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.919+0000 7f54c6d9d700 1 --2- 172.21.15.146:0/194921703 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54c8068780 0x7f54c80ca1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:27.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.919+0000 7f54c6d9d700 1 -- 172.21.15.146:0/194921703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54c80b5640 msgr2=0x7f54c80c6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:27.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.919+0000 7f54c6d9d700 1 --2- 172.21.15.146:0/194921703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54c80b5640 0x7f54c80c6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:27.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.919+0000 7f54c6d9d700 1 -- 172.21.15.146:0/194921703 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54c0009a20 con 0x7f54c80cb090 2023-10-06T11:08:27.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.919+0000 7f54c6d9d700 1 --2- 172.21.15.146:0/194921703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54c80cb090 0x7f54c80c69c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f54c000c0f0 tx=0x7f54c000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:27.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.919+0000 7f54beffd700 1 -- 172.21.15.146:0/194921703 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c000cb70 con 0x7f54c80cb090 2023-10-06T11:08:27.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.919+0000 7f54beffd700 1 -- 172.21.15.146:0/194921703 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c000f040 con 0x7f54c80cb090 2023-10-06T11:08:27.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.919+0000 7f54beffd700 1 -- 172.21.15.146:0/194921703 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54c0014480 con 0x7f54c80cb090 2023-10-06T11:08:27.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.919+0000 7f54c759e700 1 -- 172.21.15.146:0/194921703 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54b8009420 con 0x7f54c80cb090 2023-10-06T11:08:27.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.919+0000 7f54c759e700 1 -- 172.21.15.146:0/194921703 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54c816a010 con 0x7f54c80cb090 2023-10-06T11:08:27.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.920+0000 7f54c759e700 1 -- 172.21.15.146:0/194921703 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54c80894b0 con 0x7f54c80cb090 2023-10-06T11:08:27.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.921+0000 7f54beffd700 1 -- 172.21.15.146:0/194921703 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f54c0003020 con 0x7f54c80cb090 2023-10-06T11:08:27.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.921+0000 7f54beffd700 1 --2- 172.21.15.146:0/194921703 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f54a8066f30 0x7f54a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:27.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.921+0000 7f54beffd700 1 -- 172.21.15.146:0/194921703 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f54c0084f90 con 0x7f54c80cb090 2023-10-06T11:08:27.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.921+0000 7f54c659c700 1 --2- 172.21.15.146:0/194921703 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f54a8066f30 0x7f54a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:27.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.922+0000 7f54c659c700 1 --2- 172.21.15.146:0/194921703 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f54a8066f30 0x7f54a80693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f54c8158ad0 tx=0x7f54b8017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:27.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:27.925+0000 7f54beffd700 1 -- 172.21.15.146:0/194921703 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f54c00b65a0 con 0x7f54c80cb090 2023-10-06T11:08:28.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.107+0000 7f54c759e700 1 -- 172.21.15.146:0/194921703 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f54c8159f40 con 0x7f54c80cb090 2023-10-06T11:08:28.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.107+0000 7f54beffd700 1 -- 172.21.15.146:0/194921703 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v35) v1 ==== 92+0+10 (secure 0 0 0) 0x7f54c0018020 con 0x7f54c80cb090 2023-10-06T11:08:28.109 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-10-06T11:08:28.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.109+0000 7f54c759e700 1 -- 172.21.15.146:0/194921703 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f54a8066f30 msgr2=0x7f54a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:28.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.109+0000 7f54c759e700 1 --2- 172.21.15.146:0/194921703 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f54a8066f30 0x7f54a80693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f54c8158ad0 tx=0x7f54b8017000 comp rx=0 tx=0).stop 2023-10-06T11:08:28.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.109+0000 7f54c759e700 1 -- 172.21.15.146:0/194921703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54c80cb090 msgr2=0x7f54c80c69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:28.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.109+0000 7f54c759e700 1 --2- 172.21.15.146:0/194921703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54c80cb090 0x7f54c80c69c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f54c000c0f0 tx=0x7f54c000b040 comp rx=0 tx=0).stop 2023-10-06T11:08:28.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.109+0000 7f54c759e700 1 -- 172.21.15.146:0/194921703 shutdown_connections 2023-10-06T11:08:28.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.109+0000 7f54c759e700 1 --2- 172.21.15.146:0/194921703 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f54a8066f30 0x7f54a80693e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:28.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.109+0000 7f54c759e700 1 --2- 172.21.15.146:0/194921703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54c80cb090 0x7f54c80c69c0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:28.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.109+0000 7f54c759e700 1 --2- 172.21.15.146:0/194921703 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54c8068780 0x7f54c80ca1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:28.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.109+0000 7f54c759e700 1 --2- 172.21.15.146:0/194921703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54c80b5640 0x7f54c80c6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:28.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.109+0000 7f54c759e700 1 -- 172.21.15.146:0/194921703 >> 172.21.15.146:0/194921703 conn(0x7f54c80703f0 msgr2=0x7f54c80b38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:28.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.109+0000 7f54c759e700 1 -- 172.21.15.146:0/194921703 shutdown_connections 2023-10-06T11:08:28.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.109+0000 7f54c759e700 1 -- 172.21.15.146:0/194921703 wait complete. 2023-10-06T11:08:28.123 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:08:28.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.240+0000 7f7859223700 1 Processor -- start 2023-10-06T11:08:28.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.240+0000 7f7859223700 1 -- start start 2023-10-06T11:08:28.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.241+0000 7f7859223700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f785415a160 0x7f78540c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:28.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.241+0000 7f7859223700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78540ae730 0x7f78540aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:28.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.241+0000 7f7859223700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78540ae2a0 con 0x7f78540ce3d0 2023-10-06T11:08:28.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.241+0000 7f7859223700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f785415a530 con 0x7f785415a160 2023-10-06T11:08:28.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.241+0000 7f7859223700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78540ad690 con 0x7f78540ae730 2023-10-06T11:08:28.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.241+0000 7f7852d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f785415a160 0x7f78540c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:28.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.241+0000 7f7852d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f785415a160 0x7f78540c55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56408/0 (socket says 172.21.15.146:56408) 2023-10-06T11:08:28.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.241+0000 7f7852d9d700 1 -- 172.21.15.146:0/1648236738 learned_addr learned my addr 172.21.15.146:0/1648236738 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:28.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.241+0000 7f785259c700 1 --2- 172.21.15.146:0/1648236738 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78540ae730 0x7f78540aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:28.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.241+0000 7f7852d9d700 1 -- 172.21.15.146:0/1648236738 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78540ae730 msgr2=0x7f78540aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:28.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.241+0000 7f7852d9d700 1 --2- 172.21.15.146:0/1648236738 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78540ae730 0x7f78540aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:28.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.241+0000 7f7852d9d700 1 -- 172.21.15.146:0/1648236738 >> v1:172.21.15.151:6789/0 conn(0x7f78540ce3d0 legacy=0x7f78540ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:28.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.241+0000 7f7852d9d700 1 -- 172.21.15.146:0/1648236738 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78540ad970 con 0x7f785415a160 2023-10-06T11:08:28.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.241+0000 7f7852d9d700 1 --2- 172.21.15.146:0/1648236738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f785415a160 0x7f78540c55a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7844009990 tx=0x7f7844009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0f0661ba9c05922 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:28.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.241+0000 7f7851d9b700 1 -- 172.21.15.146:0/1648236738 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7844009e80 con 0x7f785415a160 2023-10-06T11:08:28.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.242+0000 7f7851d9b700 1 -- 172.21.15.146:0/1648236738 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7844005c10 con 0x7f785415a160 2023-10-06T11:08:28.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.242+0000 7f7851d9b700 1 -- 172.21.15.146:0/1648236738 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784400b650 con 0x7f785415a160 2023-10-06T11:08:28.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.242+0000 7f7859223700 1 -- 172.21.15.146:0/1648236738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f785415a160 msgr2=0x7f78540c55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:28.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.242+0000 7f7859223700 1 --2- 172.21.15.146:0/1648236738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f785415a160 0x7f78540c55a0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7844009990 tx=0x7f7844009220 comp rx=0 tx=0).stop 2023-10-06T11:08:28.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.242+0000 7f7859223700 1 -- 172.21.15.146:0/1648236738 shutdown_connections 2023-10-06T11:08:28.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.242+0000 7f7859223700 1 --2- 172.21.15.146:0/1648236738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f785415a160 0x7f78540c55a0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:28.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.242+0000 7f7859223700 1 --2- 172.21.15.146:0/1648236738 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78540ae730 0x7f78540aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:28.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.242+0000 7f7859223700 1 -- 172.21.15.146:0/1648236738 >> 172.21.15.146:0/1648236738 conn(0x7f785406f380 msgr2=0x7f78540d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:28.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.242+0000 7f7859223700 1 -- 172.21.15.146:0/1648236738 shutdown_connections 2023-10-06T11:08:28.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.242+0000 7f7859223700 1 -- 172.21.15.146:0/1648236738 wait complete. 2023-10-06T11:08:28.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.243+0000 7f7859223700 1 Processor -- start 2023-10-06T11:08:28.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.243+0000 7f7859223700 1 -- start start 2023-10-06T11:08:28.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.244+0000 7f7859223700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78540ae730 0x7f785415f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:28.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.244+0000 7f7859223700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78540ce3d0 0x7f785415b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:28.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.244+0000 7f7859223700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f785415a160 0x7f785415c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:28.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.244+0000 7f7859223700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f785416aaa0 con 0x7f785415a160 2023-10-06T11:08:28.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.244+0000 7f7859223700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f785415fba0 con 0x7f78540ce3d0 2023-10-06T11:08:28.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.244+0000 7f7859223700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f785416ad40 con 0x7f78540ae730 2023-10-06T11:08:28.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.244+0000 7f785359e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f785415a160 0x7f785415c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:28.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.244+0000 7f785359e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f785415a160 0x7f785415c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56422/0 (socket says 172.21.15.146:56422) 2023-10-06T11:08:28.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.244+0000 7f785359e700 1 -- 172.21.15.146:0/436722166 learned_addr learned my addr 172.21.15.146:0/436722166 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:28.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.244+0000 7f785259c700 1 --2- 172.21.15.146:0/436722166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78540ce3d0 0x7f785415b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:28.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.244+0000 7f7852d9d700 1 --2- 172.21.15.146:0/436722166 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78540ae730 0x7f785415f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:28.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.244+0000 7f785359e700 1 -- 172.21.15.146:0/436722166 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78540ae730 msgr2=0x7f785415f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:28.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.244+0000 7f785359e700 1 --2- 172.21.15.146:0/436722166 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78540ae730 0x7f785415f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:28.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.244+0000 7f785359e700 1 -- 172.21.15.146:0/436722166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78540ce3d0 msgr2=0x7f785415b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:28.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.244+0000 7f785359e700 1 --2- 172.21.15.146:0/436722166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78540ce3d0 0x7f785415b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:28.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.244+0000 7f785359e700 1 -- 172.21.15.146:0/436722166 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7844009480 con 0x7f785415a160 2023-10-06T11:08:28.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.244+0000 7f7852d9d700 1 --2- 172.21.15.146:0/436722166 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78540ae730 0x7f785415f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:08:28.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.245+0000 7f785359e700 1 --2- 172.21.15.146:0/436722166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f785415a160 0x7f785415c910 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f784c00c8e0 tx=0x7f784c001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:28.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.245+0000 7f783affd700 1 -- 172.21.15.146:0/436722166 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784c012630 con 0x7f785415a160 2023-10-06T11:08:28.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.245+0000 7f783affd700 1 -- 172.21.15.146:0/436722166 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f784c012790 con 0x7f785415a160 2023-10-06T11:08:28.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.245+0000 7f7859223700 1 -- 172.21.15.146:0/436722166 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f785416b020 con 0x7f785415a160 2023-10-06T11:08:28.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.245+0000 7f783affd700 1 -- 172.21.15.146:0/436722166 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784c012b50 con 0x7f785415a160 2023-10-06T11:08:28.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.245+0000 7f7859223700 1 -- 172.21.15.146:0/436722166 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f785416b5e0 con 0x7f785415a160 2023-10-06T11:08:28.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.246+0000 7f7859223700 1 -- 172.21.15.146:0/436722166 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7854068390 con 0x7f785415a160 2023-10-06T11:08:28.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.246+0000 7f783affd700 1 -- 172.21.15.146:0/436722166 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f784c00a3b0 con 0x7f785415a160 2023-10-06T11:08:28.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.246+0000 7f783affd700 1 --2- 172.21.15.146:0/436722166 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7840066f30 0x7f78400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:28.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.246+0000 7f783affd700 1 -- 172.21.15.146:0/436722166 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f784c084a30 con 0x7f785415a160 2023-10-06T11:08:28.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.246+0000 7f7852d9d700 1 --2- 172.21.15.146:0/436722166 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7840066f30 0x7f78400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:28.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.247+0000 7f7852d9d700 1 --2- 172.21.15.146:0/436722166 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7840066f30 0x7f78400693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7844009260 tx=0x7f7844016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:28.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.251+0000 7f783affd700 1 -- 172.21.15.146:0/436722166 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f784c055590 con 0x7f785415a160 2023-10-06T11:08:28.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.434+0000 7f7859223700 1 -- 172.21.15.146:0/436722166 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f785416b7d0 con 0x7f785415a160 2023-10-06T11:08:28.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.435+0000 7f783affd700 1 -- 172.21.15.146:0/436722166 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f784c055120 con 0x7f785415a160 2023-10-06T11:08:28.437 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-10-06T11:08:28.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.437+0000 7f7859223700 1 -- 172.21.15.146:0/436722166 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7840066f30 msgr2=0x7f78400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:28.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.437+0000 7f7859223700 1 --2- 172.21.15.146:0/436722166 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7840066f30 0x7f78400693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7844009260 tx=0x7f7844016000 comp rx=0 tx=0).stop 2023-10-06T11:08:28.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.437+0000 7f7859223700 1 -- 172.21.15.146:0/436722166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f785415a160 msgr2=0x7f785415c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:28.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.437+0000 7f7859223700 1 --2- 172.21.15.146:0/436722166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f785415a160 0x7f785415c910 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f784c00c8e0 tx=0x7f784c001710 comp rx=0 tx=0).stop 2023-10-06T11:08:28.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.437+0000 7f7859223700 1 -- 172.21.15.146:0/436722166 shutdown_connections 2023-10-06T11:08:28.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.437+0000 7f7859223700 1 --2- 172.21.15.146:0/436722166 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7840066f30 0x7f78400693e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:28.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.437+0000 7f7859223700 1 --2- 172.21.15.146:0/436722166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f785415a160 0x7f785415c910 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:28.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.437+0000 7f7859223700 1 --2- 172.21.15.146:0/436722166 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78540ae730 0x7f785415f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:28.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.437+0000 7f7859223700 1 --2- 172.21.15.146:0/436722166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78540ce3d0 0x7f785415b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:28.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.437+0000 7f7859223700 1 -- 172.21.15.146:0/436722166 >> 172.21.15.146:0/436722166 conn(0x7f785406f380 msgr2=0x7f78540cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:28.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.437+0000 7f7859223700 1 -- 172.21.15.146:0/436722166 shutdown_connections 2023-10-06T11:08:28.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.437+0000 7f7859223700 1 -- 172.21.15.146:0/436722166 wait complete. 2023-10-06T11:08:28.451 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T11:08:28.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.567+0000 7f0e22c2c700 1 Processor -- start 2023-10-06T11:08:28.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.567+0000 7f0e22c2c700 1 -- start start 2023-10-06T11:08:28.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.568+0000 7f0e22c2c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0e1c15d710 0x7f0e1c0ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:28.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.568+0000 7f0e22c2c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e1c0b0010 con 0x7f0e1c0aef20 2023-10-06T11:08:28.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.568+0000 7f0e22c2c700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e1c0cf090 con 0x7f0e1c15dae0 2023-10-06T11:08:28.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.568+0000 7f0e22c2c700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e1c15e340 con 0x7f0e1c15d710 2023-10-06T11:08:28.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.568+0000 7f0e1bfff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0e1c0aef20 0x7f0e1c068580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35142/0 (socket says 172.21.15.146:35142) 2023-10-06T11:08:28.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.568+0000 7f0e1bfff700 1 -- 172.21.15.146:0/3237979466 learned_addr learned my addr 172.21.15.146:0/3237979466 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:08:28.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.568+0000 7f0e209c8700 1 --2- 172.21.15.146:0/3237979466 >> v2:172.21.15.151:3300/0 conn(0x7f0e1c15d710 0x7f0e1c0ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:28.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.569+0000 7f0e1b7fe700 1 -- 172.21.15.146:0/3237979466 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1003450307 0 0) 0x7f0e1c0b0010 con 0x7f0e1c0aef20 2023-10-06T11:08:28.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.569+0000 7f0e1b7fe700 1 -- 172.21.15.146:0/3237979466 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e0c003570 con 0x7f0e1c0aef20 2023-10-06T11:08:28.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.569+0000 7f0e209c8700 1 -- 172.21.15.146:0/3237979466 >> v1:172.21.15.151:6789/0 conn(0x7f0e1c15dae0 legacy=0x7f0e1c0b04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:28.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.569+0000 7f0e209c8700 1 -- 172.21.15.146:0/3237979466 >> v1:172.21.15.146:6789/0 conn(0x7f0e1c0aef20 legacy=0x7f0e1c068580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:28.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.569+0000 7f0e1b7fe700 1 -- 172.21.15.146:0/3237979466 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3217354332 0 0) 0x7f0e0c003570 con 0x7f0e1c0aef20 2023-10-06T11:08:28.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.569+0000 7f0e209c8700 1 -- 172.21.15.146:0/3237979466 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e1c0af400 con 0x7f0e1c15d710 2023-10-06T11:08:28.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.569+0000 7f0e209c8700 1 --2- 172.21.15.146:0/3237979466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e1c15d710 0x7f0e1c0ceb50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0e100098e0 tx=0x7f0e100091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb429be3370a4e21 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:28.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.569+0000 7f0e1b7fe700 1 -- 172.21.15.146:0/3237979466 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e08001470 con 0x7f0e1c15d710 2023-10-06T11:08:28.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.569+0000 7f0e1b7fe700 1 -- 172.21.15.146:0/3237979466 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e10011420 con 0x7f0e1c15d710 2023-10-06T11:08:28.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.569+0000 7f0e1b7fe700 1 -- 172.21.15.146:0/3237979466 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e100117c0 con 0x7f0e1c15d710 2023-10-06T11:08:28.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.570+0000 7f0e22c2c700 1 -- 172.21.15.146:0/3237979466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e1c15d710 msgr2=0x7f0e1c0ceb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:28.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.570+0000 7f0e22c2c700 1 --2- 172.21.15.146:0/3237979466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e1c15d710 0x7f0e1c0ceb50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0e100098e0 tx=0x7f0e100091a0 comp rx=0 tx=0).stop 2023-10-06T11:08:28.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.570+0000 7f0e22c2c700 1 -- 172.21.15.146:0/3237979466 shutdown_connections 2023-10-06T11:08:28.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.570+0000 7f0e22c2c700 1 --2- 172.21.15.146:0/3237979466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e1c15d710 0x7f0e1c0ceb50 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:28.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.570+0000 7f0e22c2c700 1 -- 172.21.15.146:0/3237979466 >> 172.21.15.146:0/3237979466 conn(0x7f0e1c067c50 msgr2=0x7f0e1c0ce440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:28.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.570+0000 7f0e22c2c700 1 -- 172.21.15.146:0/3237979466 shutdown_connections 2023-10-06T11:08:28.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.570+0000 7f0e22c2c700 1 -- 172.21.15.146:0/3237979466 wait complete. 2023-10-06T11:08:28.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.571+0000 7f0e22c2c700 1 Processor -- start 2023-10-06T11:08:28.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.571+0000 7f0e22c2c700 1 -- start start 2023-10-06T11:08:28.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.572+0000 7f0e22c2c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e1c0aef20 0x7f0e1c151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:28.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.572+0000 7f0e22c2c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e1c15d710 0x7f0e1c150e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:28.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.572+0000 7f0e22c2c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e1c15dae0 0x7f0e1c151360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:28.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.572+0000 7f0e22c2c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1c0cd8c0 con 0x7f0e1c15dae0 2023-10-06T11:08:28.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.572+0000 7f0e22c2c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1c0b1900 con 0x7f0e1c15d710 2023-10-06T11:08:28.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.572+0000 7f0e22c2c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e1c0b1be0 con 0x7f0e1c0aef20 2023-10-06T11:08:28.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.572+0000 7f0e211c9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e1c15dae0 0x7f0e1c151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:28.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.572+0000 7f0e211c9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e1c15dae0 0x7f0e1c151360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56438/0 (socket says 172.21.15.146:56438) 2023-10-06T11:08:28.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.572+0000 7f0e1bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e1c15d710 0x7f0e1c150e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:28.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.572+0000 7f0e209c8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e1c0aef20 0x7f0e1c151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:28.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.572+0000 7f0e211c9700 1 -- 172.21.15.146:0/2960508893 learned_addr learned my addr 172.21.15.146:0/2960508893 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:28.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.572+0000 7f0e211c9700 1 -- 172.21.15.146:0/2960508893 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e1c0aef20 msgr2=0x7f0e1c151fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:28.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.572+0000 7f0e211c9700 1 --2- 172.21.15.146:0/2960508893 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e1c0aef20 0x7f0e1c151fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:28.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.572+0000 7f0e211c9700 1 -- 172.21.15.146:0/2960508893 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e1c15d710 msgr2=0x7f0e1c150e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:28.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.572+0000 7f0e211c9700 1 --2- 172.21.15.146:0/2960508893 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e1c15d710 0x7f0e1c150e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:28.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.572+0000 7f0e211c9700 1 -- 172.21.15.146:0/2960508893 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e10009420 con 0x7f0e1c15dae0 2023-10-06T11:08:28.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.573+0000 7f0e211c9700 1 --2- 172.21.15.146:0/2960508893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e1c15dae0 0x7f0e1c151360 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0e1400c840 tx=0x7f0e14001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:28.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.573+0000 7f0e18ff9700 1 -- 172.21.15.146:0/2960508893 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e14012630 con 0x7f0e1c15dae0 2023-10-06T11:08:28.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.573+0000 7f0e18ff9700 1 -- 172.21.15.146:0/2960508893 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e140127b0 con 0x7f0e1c15dae0 2023-10-06T11:08:28.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.573+0000 7f0e18ff9700 1 -- 172.21.15.146:0/2960508893 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e14012b70 con 0x7f0e1c15dae0 2023-10-06T11:08:28.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.573+0000 7f0e22c2c700 1 -- 172.21.15.146:0/2960508893 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e1c0b1ec0 con 0x7f0e1c15dae0 2023-10-06T11:08:28.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.573+0000 7f0e22c2c700 1 -- 172.21.15.146:0/2960508893 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e1c0b2480 con 0x7f0e1c15dae0 2023-10-06T11:08:28.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.574+0000 7f0e22c2c700 1 -- 172.21.15.146:0/2960508893 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e1c04c380 con 0x7f0e1c15dae0 2023-10-06T11:08:28.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.575+0000 7f0e18ff9700 1 -- 172.21.15.146:0/2960508893 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0e14024420 con 0x7f0e1c15dae0 2023-10-06T11:08:28.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.575+0000 7f0e18ff9700 1 --2- 172.21.15.146:0/2960508893 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0e00066f30 0x7f0e000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:28.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.575+0000 7f0e18ff9700 1 -- 172.21.15.146:0/2960508893 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f0e14084f80 con 0x7f0e1c15dae0 2023-10-06T11:08:28.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.575+0000 7f0e209c8700 1 --2- 172.21.15.146:0/2960508893 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0e00066f30 0x7f0e000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:28.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.575+0000 7f0e209c8700 1 --2- 172.21.15.146:0/2960508893 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0e00066f30 0x7f0e000693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0e100091e0 tx=0x7f0e10016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:28.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.579+0000 7f0e18ff9700 1 -- 172.21.15.146:0/2960508893 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e14052050 con 0x7f0e1c15dae0 2023-10-06T11:08:28.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.762+0000 7f0e22c2c700 1 -- 172.21.15.146:0/2960508893 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0e1c06f380 con 0x7f0e1c15dae0 2023-10-06T11:08:28.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.762+0000 7f0e18ff9700 1 -- 172.21.15.146:0/2960508893 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0e14055670 con 0x7f0e1c15dae0 2023-10-06T11:08:28.764 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2023-10-06T11:08:28.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.764+0000 7f0e22c2c700 1 -- 172.21.15.146:0/2960508893 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0e00066f30 msgr2=0x7f0e000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:28.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.764+0000 7f0e22c2c700 1 --2- 172.21.15.146:0/2960508893 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0e00066f30 0x7f0e000693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0e100091e0 tx=0x7f0e10016000 comp rx=0 tx=0).stop 2023-10-06T11:08:28.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.764+0000 7f0e22c2c700 1 -- 172.21.15.146:0/2960508893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e1c15dae0 msgr2=0x7f0e1c151360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:28.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.764+0000 7f0e22c2c700 1 --2- 172.21.15.146:0/2960508893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e1c15dae0 0x7f0e1c151360 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0e1400c840 tx=0x7f0e14001670 comp rx=0 tx=0).stop 2023-10-06T11:08:28.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.765+0000 7f0e22c2c700 1 -- 172.21.15.146:0/2960508893 shutdown_connections 2023-10-06T11:08:28.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.765+0000 7f0e22c2c700 1 --2- 172.21.15.146:0/2960508893 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0e00066f30 0x7f0e000693e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:28.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.765+0000 7f0e22c2c700 1 --2- 172.21.15.146:0/2960508893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e1c15dae0 0x7f0e1c151360 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:28.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.765+0000 7f0e22c2c700 1 --2- 172.21.15.146:0/2960508893 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e1c0aef20 0x7f0e1c151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:28.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.765+0000 7f0e22c2c700 1 --2- 172.21.15.146:0/2960508893 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e1c15d710 0x7f0e1c150e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:28.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.765+0000 7f0e22c2c700 1 -- 172.21.15.146:0/2960508893 >> 172.21.15.146:0/2960508893 conn(0x7f0e1c067c50 msgr2=0x7f0e1c0ac2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:28.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.765+0000 7f0e22c2c700 1 -- 172.21.15.146:0/2960508893 shutdown_connections 2023-10-06T11:08:28.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.765+0000 7f0e22c2c700 1 -- 172.21.15.146:0/2960508893 wait complete. 2023-10-06T11:08:28.779 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T11:08:28.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.895+0000 7f7c3a448700 1 Processor -- start 2023-10-06T11:08:28.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.895+0000 7f7c3a448700 1 -- start start 2023-10-06T11:08:28.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.896+0000 7f7c3a448700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7c340b5640 0x7f7c3415a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:28.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.896+0000 7f7c3a448700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c340cb090 0x7f7c340cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:28.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.896+0000 7f7c3a448700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7c34068780 0x7f7c34068bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:28.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.896+0000 7f7c3a448700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c340cc130 con 0x7f7c340b5640 2023-10-06T11:08:28.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.896+0000 7f7c3a448700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c340b2660 con 0x7f7c34068780 2023-10-06T11:08:28.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.896+0000 7f7c3a448700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c340690f0 con 0x7f7c340cb090 2023-10-06T11:08:28.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.896+0000 7f7c39446700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7c340b5640 0x7f7c3415a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:28.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.896+0000 7f7c39446700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7c340b5640 0x7f7c3415a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56440/0 (socket says 172.21.15.146:56440) 2023-10-06T11:08:28.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.896+0000 7f7c39446700 1 -- 172.21.15.146:0/1957580861 learned_addr learned my addr 172.21.15.146:0/1957580861 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:28.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.896+0000 7f7c39c47700 1 --2- 172.21.15.146:0/1957580861 >> v2:172.21.15.151:3300/0 conn(0x7f7c34068780 0x7f7c34068bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:28.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.896+0000 7f7c38c45700 1 --2- 172.21.15.146:0/1957580861 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c340cb090 0x7f7c340cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:28.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.896+0000 7f7c39446700 1 -- 172.21.15.146:0/1957580861 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c340cb090 msgr2=0x7f7c340cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:28.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.896+0000 7f7c39446700 1 --2- 172.21.15.146:0/1957580861 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c340cb090 0x7f7c340cc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:28.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.896+0000 7f7c39446700 1 -- 172.21.15.146:0/1957580861 >> v2:172.21.15.151:3300/0 conn(0x7f7c34068780 msgr2=0x7f7c34068bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:28.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.896+0000 7f7c39446700 1 --2- 172.21.15.146:0/1957580861 >> v2:172.21.15.151:3300/0 conn(0x7f7c34068780 0x7f7c34068bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:28.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.896+0000 7f7c39446700 1 -- 172.21.15.146:0/1957580861 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c3415adb0 con 0x7f7c340b5640 2023-10-06T11:08:28.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.896+0000 7f7c38c45700 1 --2- 172.21.15.146:0/1957580861 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c340cb090 0x7f7c340cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:08:28.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.896+0000 7f7c39c47700 1 --2- 172.21.15.146:0/1957580861 >> v2:172.21.15.151:3300/0 conn(0x7f7c34068780 0x7f7c34068bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:08:28.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.897+0000 7f7c39446700 1 --2- 172.21.15.146:0/1957580861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c340b5640 0x7f7c3415a870 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f7c34069350 tx=0x7f7c30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6aea5708d271c2f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:28.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.897+0000 7f7c2bfff700 1 -- 172.21.15.146:0/1957580861 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3000b860 con 0x7f7c340b5640 2023-10-06T11:08:28.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.897+0000 7f7c2bfff700 1 -- 172.21.15.146:0/1957580861 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3000b9c0 con 0x7f7c340b5640 2023-10-06T11:08:28.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.897+0000 7f7c2bfff700 1 -- 172.21.15.146:0/1957580861 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3000bd60 con 0x7f7c340b5640 2023-10-06T11:08:28.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.897+0000 7f7c3a448700 1 -- 172.21.15.146:0/1957580861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c340b5640 msgr2=0x7f7c3415a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:28.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.897+0000 7f7c3a448700 1 --2- 172.21.15.146:0/1957580861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c340b5640 0x7f7c3415a870 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f7c34069350 tx=0x7f7c30009250 comp rx=0 tx=0).stop 2023-10-06T11:08:28.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.897+0000 7f7c3a448700 1 -- 172.21.15.146:0/1957580861 shutdown_connections 2023-10-06T11:08:28.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.897+0000 7f7c3a448700 1 --2- 172.21.15.146:0/1957580861 >> v2:172.21.15.151:3300/0 conn(0x7f7c34068780 0x7f7c34068bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:28.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.897+0000 7f7c3a448700 1 --2- 172.21.15.146:0/1957580861 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c340b5640 0x7f7c3415a870 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:28.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.897+0000 7f7c3a448700 1 --2- 172.21.15.146:0/1957580861 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c340cb090 0x7f7c340cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:28.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.897+0000 7f7c3a448700 1 -- 172.21.15.146:0/1957580861 >> 172.21.15.146:0/1957580861 conn(0x7f7c340703f0 msgr2=0x7f7c340707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:28.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.897+0000 7f7c3a448700 1 -- 172.21.15.146:0/1957580861 shutdown_connections 2023-10-06T11:08:28.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.897+0000 7f7c3a448700 1 -- 172.21.15.146:0/1957580861 wait complete. 2023-10-06T11:08:28.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.898+0000 7f7c3a448700 1 Processor -- start 2023-10-06T11:08:28.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.899+0000 7f7c3a448700 1 -- start start 2023-10-06T11:08:28.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.899+0000 7f7c3a448700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c34068780 0x7f7c3415afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:28.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.899+0000 7f7c3a448700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c340b5640 0x7f7c34145ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:28.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.899+0000 7f7c3a448700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c340cb090 0x7f7c340c9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:28.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.899+0000 7f7c3a448700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3415c3e0 con 0x7f7c340cb090 2023-10-06T11:08:28.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.899+0000 7f7c3a448700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3415b7d0 con 0x7f7c34068780 2023-10-06T11:08:28.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.899+0000 7f7c3a448700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c3415bab0 con 0x7f7c340b5640 2023-10-06T11:08:28.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.899+0000 7f7c39c47700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c340cb090 0x7f7c340c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:28.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.900+0000 7f7c39c47700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c340cb090 0x7f7c340c9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56448/0 (socket says 172.21.15.146:56448) 2023-10-06T11:08:28.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.900+0000 7f7c39c47700 1 -- 172.21.15.146:0/3527633455 learned_addr learned my addr 172.21.15.146:0/3527633455 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:28.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.900+0000 7f7c38c45700 1 --2- 172.21.15.146:0/3527633455 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c340b5640 0x7f7c34145ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:28.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.900+0000 7f7c39446700 1 --2- 172.21.15.146:0/3527633455 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c34068780 0x7f7c3415afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:28.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.900+0000 7f7c39c47700 1 -- 172.21.15.146:0/3527633455 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c340b5640 msgr2=0x7f7c34145ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:28.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.900+0000 7f7c39c47700 1 --2- 172.21.15.146:0/3527633455 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c340b5640 0x7f7c34145ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:28.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.900+0000 7f7c39c47700 1 -- 172.21.15.146:0/3527633455 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c34068780 msgr2=0x7f7c3415afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:28.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.900+0000 7f7c39c47700 1 --2- 172.21.15.146:0/3527633455 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c34068780 0x7f7c3415afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:28.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.900+0000 7f7c39c47700 1 -- 172.21.15.146:0/3527633455 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c300094f0 con 0x7f7c340cb090 2023-10-06T11:08:28.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.900+0000 7f7c39c47700 1 --2- 172.21.15.146:0/3527633455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c340cb090 0x7f7c340c9990 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c00cf60 tx=0x7f7c2c007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:28.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.900+0000 7f7c297fa700 1 -- 172.21.15.146:0/3527633455 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c00ae40 con 0x7f7c340cb090 2023-10-06T11:08:28.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.900+0000 7f7c297fa700 1 -- 172.21.15.146:0/3527633455 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2c015440 con 0x7f7c340cb090 2023-10-06T11:08:28.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.900+0000 7f7c297fa700 1 -- 172.21.15.146:0/3527633455 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2c015800 con 0x7f7c340cb090 2023-10-06T11:08:28.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.900+0000 7f7c3a448700 1 -- 172.21.15.146:0/3527633455 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c3415bd90 con 0x7f7c340cb090 2023-10-06T11:08:28.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.900+0000 7f7c3a448700 1 -- 172.21.15.146:0/3527633455 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c3415b4e0 con 0x7f7c340cb090 2023-10-06T11:08:28.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.901+0000 7f7c3a448700 1 -- 172.21.15.146:0/3527633455 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c340894b0 con 0x7f7c340cb090 2023-10-06T11:08:28.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.902+0000 7f7c297fa700 1 -- 172.21.15.146:0/3527633455 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7c2c00d440 con 0x7f7c340cb090 2023-10-06T11:08:28.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.902+0000 7f7c297fa700 1 --2- 172.21.15.146:0/3527633455 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7c18066f30 0x7f7c180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:28.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.902+0000 7f7c297fa700 1 -- 172.21.15.146:0/3527633455 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f7c2c0852c0 con 0x7f7c340cb090 2023-10-06T11:08:28.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.902+0000 7f7c39446700 1 --2- 172.21.15.146:0/3527633455 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7c18066f30 0x7f7c180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:28.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.902+0000 7f7c39446700 1 --2- 172.21.15.146:0/3527633455 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7c18066f30 0x7f7c180693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7c34069350 tx=0x7f7c30017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:28.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:28.906+0000 7f7c297fa700 1 -- 172.21.15.146:0/3527633455 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7c2c052390 con 0x7f7c340cb090 2023-10-06T11:08:29.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.087+0000 7f7c3a448700 1 -- 172.21.15.146:0/3527633455 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7c3415c520 con 0x7f7c340cb090 2023-10-06T11:08:29.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.088+0000 7f7c297fa700 1 -- 172.21.15.146:0/3527633455 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7c2c0559b0 con 0x7f7c340cb090 2023-10-06T11:08:29.090 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2023-10-06T11:08:29.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.090+0000 7f7c3a448700 1 -- 172.21.15.146:0/3527633455 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7c18066f30 msgr2=0x7f7c180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:29.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.090+0000 7f7c3a448700 1 --2- 172.21.15.146:0/3527633455 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7c18066f30 0x7f7c180693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7c34069350 tx=0x7f7c30017000 comp rx=0 tx=0).stop 2023-10-06T11:08:29.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.090+0000 7f7c3a448700 1 -- 172.21.15.146:0/3527633455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c340cb090 msgr2=0x7f7c340c9990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:29.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.090+0000 7f7c3a448700 1 --2- 172.21.15.146:0/3527633455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c340cb090 0x7f7c340c9990 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7c2c00cf60 tx=0x7f7c2c007870 comp rx=0 tx=0).stop 2023-10-06T11:08:29.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.090+0000 7f7c3a448700 1 -- 172.21.15.146:0/3527633455 shutdown_connections 2023-10-06T11:08:29.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.090+0000 7f7c3a448700 1 --2- 172.21.15.146:0/3527633455 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7c18066f30 0x7f7c180693e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:29.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.090+0000 7f7c3a448700 1 --2- 172.21.15.146:0/3527633455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7c340cb090 0x7f7c340c9990 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:29.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.090+0000 7f7c3a448700 1 --2- 172.21.15.146:0/3527633455 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c34068780 0x7f7c3415afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:29.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.090+0000 7f7c3a448700 1 --2- 172.21.15.146:0/3527633455 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c340b5640 0x7f7c34145ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:29.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.090+0000 7f7c3a448700 1 -- 172.21.15.146:0/3527633455 >> 172.21.15.146:0/3527633455 conn(0x7f7c340703f0 msgr2=0x7f7c34153af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:29.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.090+0000 7f7c3a448700 1 -- 172.21.15.146:0/3527633455 shutdown_connections 2023-10-06T11:08:29.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.090+0000 7f7c3a448700 1 -- 172.21.15.146:0/3527633455 wait complete. 2023-10-06T11:08:29.104 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:08:29.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.218+0000 7f671d573700 1 Processor -- start 2023-10-06T11:08:29.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.218+0000 7f671d573700 1 -- start start 2023-10-06T11:08:29.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.219+0000 7f671d573700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f671815a7f0 0x7f671815cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:29.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.219+0000 7f671d573700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f671815c630 con 0x7f671815a420 2023-10-06T11:08:29.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.219+0000 7f671d573700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f671815ba20 con 0x7f67180b2530 2023-10-06T11:08:29.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.219+0000 7f671d573700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67180ce040 con 0x7f671815a7f0 2023-10-06T11:08:29.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.219+0000 7f6717fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f671815a420 0x7f67180b1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35146/0 (socket says 172.21.15.146:35146) 2023-10-06T11:08:29.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.219+0000 7f6717fff700 1 -- 172.21.15.146:0/3714623529 learned_addr learned my addr 172.21.15.146:0/3714623529 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:08:29.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.219+0000 7f67177fe700 1 --2- 172.21.15.146:0/3714623529 >> v2:172.21.15.146:3300/0 conn(0x7f671815a7f0 0x7f671815cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:29.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.219+0000 7f6716ffd700 1 -- 172.21.15.146:0/3714623529 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3084533349 0 0) 0x7f671815c630 con 0x7f671815a420 2023-10-06T11:08:29.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.219+0000 7f6716ffd700 1 -- 172.21.15.146:0/3714623529 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6700003570 con 0x7f671815a420 2023-10-06T11:08:29.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.219+0000 7f67177fe700 1 -- 172.21.15.146:0/3714623529 >> v1:172.21.15.151:6789/0 conn(0x7f67180b2530 legacy=0x7f671815acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:29.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.219+0000 7f67177fe700 1 -- 172.21.15.146:0/3714623529 >> v1:172.21.15.146:6789/0 conn(0x7f671815a420 legacy=0x7f67180b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:29.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.219+0000 7f67177fe700 1 -- 172.21.15.146:0/3714623529 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f671815bd00 con 0x7f671815a7f0 2023-10-06T11:08:29.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.220+0000 7f67177fe700 1 --2- 172.21.15.146:0/3714623529 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f671815a7f0 0x7f671815cac0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f670c0098e0 tx=0x7f670c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2fbd7299be93347 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:29.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.220+0000 7f6716ffd700 1 -- 172.21.15.146:0/3714623529 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c011630 con 0x7f671815a7f0 2023-10-06T11:08:29.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.220+0000 7f6716ffd700 1 -- 172.21.15.146:0/3714623529 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670c011790 con 0x7f671815a7f0 2023-10-06T11:08:29.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.220+0000 7f6716ffd700 1 -- 172.21.15.146:0/3714623529 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c011b30 con 0x7f671815a7f0 2023-10-06T11:08:29.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.220+0000 7f671d573700 1 -- 172.21.15.146:0/3714623529 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f671815a7f0 msgr2=0x7f671815cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:29.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.220+0000 7f671d573700 1 --2- 172.21.15.146:0/3714623529 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f671815a7f0 0x7f671815cac0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f670c0098e0 tx=0x7f670c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:08:29.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.220+0000 7f671d573700 1 -- 172.21.15.146:0/3714623529 shutdown_connections 2023-10-06T11:08:29.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.220+0000 7f671d573700 1 --2- 172.21.15.146:0/3714623529 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f671815a7f0 0x7f671815cac0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:29.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.220+0000 7f671d573700 1 -- 172.21.15.146:0/3714623529 >> 172.21.15.146:0/3714623529 conn(0x7f671806eba0 msgr2=0x7f671806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:29.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.220+0000 7f671d573700 1 -- 172.21.15.146:0/3714623529 shutdown_connections 2023-10-06T11:08:29.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.220+0000 7f671d573700 1 -- 172.21.15.146:0/3714623529 wait complete. 2023-10-06T11:08:29.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.221+0000 7f671d573700 1 Processor -- start 2023-10-06T11:08:29.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.222+0000 7f671d573700 1 -- start start 2023-10-06T11:08:29.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.222+0000 7f671d573700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67180b2530 0x7f671814ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:29.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.222+0000 7f671d573700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f671815a420 0x7f671816dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:29.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.222+0000 7f671d573700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f671815a7f0 0x7f67181597b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:29.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.222+0000 7f671d573700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67181531f0 con 0x7f67180b2530 2023-10-06T11:08:29.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.222+0000 7f671d573700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671816e0f0 con 0x7f671815a7f0 2023-10-06T11:08:29.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.222+0000 7f671d573700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6718152c30 con 0x7f671815a420 2023-10-06T11:08:29.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.222+0000 7f6717fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67180b2530 0x7f671814ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:29.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.222+0000 7f6717fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67180b2530 0x7f671814ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56474/0 (socket says 172.21.15.146:56474) 2023-10-06T11:08:29.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.222+0000 7f6717fff700 1 -- 172.21.15.146:0/421938421 learned_addr learned my addr 172.21.15.146:0/421938421 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:29.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.223+0000 7f6717fff700 1 -- 172.21.15.146:0/421938421 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f671815a420 msgr2=0x7f671816dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:29.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.223+0000 7f6717fff700 1 --2- 172.21.15.146:0/421938421 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f671815a420 0x7f671816dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:29.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.223+0000 7f6717fff700 1 -- 172.21.15.146:0/421938421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f671815a7f0 msgr2=0x7f67181597b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:29.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.223+0000 7f6717fff700 1 --2- 172.21.15.146:0/421938421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f671815a7f0 0x7f67181597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:29.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.223+0000 7f6717fff700 1 -- 172.21.15.146:0/421938421 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f670c009420 con 0x7f67180b2530 2023-10-06T11:08:29.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.223+0000 7f6717fff700 1 --2- 172.21.15.146:0/421938421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67180b2530 0x7f671814ceb0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f670800c7c0 tx=0x7f6708007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:29.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.223+0000 7f66fffff700 1 -- 172.21.15.146:0/421938421 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6708005b30 con 0x7f67180b2530 2023-10-06T11:08:29.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.223+0000 7f66fffff700 1 -- 172.21.15.146:0/421938421 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6708005c90 con 0x7f67180b2530 2023-10-06T11:08:29.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.223+0000 7f671d573700 1 -- 172.21.15.146:0/421938421 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6718152f10 con 0x7f67180b2530 2023-10-06T11:08:29.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.223+0000 7f66fffff700 1 -- 172.21.15.146:0/421938421 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6708007340 con 0x7f67180b2530 2023-10-06T11:08:29.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.223+0000 7f671d573700 1 -- 172.21.15.146:0/421938421 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f671816d690 con 0x7f67180b2530 2023-10-06T11:08:29.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.224+0000 7f671d573700 1 -- 172.21.15.146:0/421938421 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f671816d210 con 0x7f67180b2530 2023-10-06T11:08:29.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.224+0000 7f66fffff700 1 -- 172.21.15.146:0/421938421 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f670801b400 con 0x7f67180b2530 2023-10-06T11:08:29.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.225+0000 7f66fffff700 1 --2- 172.21.15.146:0/421938421 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6704066f30 0x7f67040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:29.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.225+0000 7f67177fe700 1 --2- 172.21.15.146:0/421938421 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6704066f30 0x7f67040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:29.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.225+0000 7f66fffff700 1 -- 172.21.15.146:0/421938421 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f6708084220 con 0x7f67180b2530 2023-10-06T11:08:29.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.225+0000 7f67177fe700 1 --2- 172.21.15.146:0/421938421 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6704066f30 0x7f67040693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6718155760 tx=0x7f670c016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:29.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.229+0000 7f66fffff700 1 -- 172.21.15.146:0/421938421 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f671816d210 con 0x7f67180b2530 2023-10-06T11:08:29.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.456+0000 7f671d573700 1 -- 172.21.15.146:0/421938421 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f671816d210 con 0x7f67180b2530 2023-10-06T11:08:29.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.456+0000 7f66fffff700 1 -- 172.21.15.146:0/421938421 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4610 (secure 0 0 0) 0x7f671816d210 con 0x7f67180b2530 2023-10-06T11:08:29.458 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:08:29.459 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":27,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4673,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/1243531288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1243531288},{"type":"v1","addr":"172.21.15.151:6834","nonce":1243531288}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4676,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/4009288357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":4009288357},{"type":"v1","addr":"172.21.15.151:6835","nonce":4009288357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4983,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2777930290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2777930290},{"type":"v1","addr":"172.21.15.146:6836","nonce":2777930290}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-10-06T11:06:35.935256+0000","modified":"2023-10-06T11:08:13.321298+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4986},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4986":{"gid":4986,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":27,"addr":"172.21.15.146:6837/4187213529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":4187213529},{"type":"v1","addr":"172.21.15.146:6837","nonce":4187213529}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T11:08:29.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.459+0000 7f671d573700 1 -- 172.21.15.146:0/421938421 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6704066f30 msgr2=0x7f67040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:29.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.459+0000 7f671d573700 1 --2- 172.21.15.146:0/421938421 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6704066f30 0x7f67040693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6718155760 tx=0x7f670c016000 comp rx=0 tx=0).stop 2023-10-06T11:08:29.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.459+0000 7f671d573700 1 -- 172.21.15.146:0/421938421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67180b2530 msgr2=0x7f671814ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:29.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.459+0000 7f671d573700 1 --2- 172.21.15.146:0/421938421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67180b2530 0x7f671814ceb0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f670800c7c0 tx=0x7f6708007e00 comp rx=0 tx=0).stop 2023-10-06T11:08:29.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.459+0000 7f671d573700 1 -- 172.21.15.146:0/421938421 shutdown_connections 2023-10-06T11:08:29.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.459+0000 7f671d573700 1 --2- 172.21.15.146:0/421938421 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6704066f30 0x7f67040693e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:29.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.459+0000 7f671d573700 1 --2- 172.21.15.146:0/421938421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f671815a7f0 0x7f67181597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:29.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.459+0000 7f671d573700 1 --2- 172.21.15.146:0/421938421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f67180b2530 0x7f671814ceb0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:29.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.459+0000 7f671d573700 1 --2- 172.21.15.146:0/421938421 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f671815a420 0x7f671816dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:29.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.459+0000 7f671d573700 1 -- 172.21.15.146:0/421938421 >> 172.21.15.146:0/421938421 conn(0x7f671806eba0 msgr2=0x7f671814f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:29.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.459+0000 7f671d573700 1 -- 172.21.15.146:0/421938421 shutdown_connections 2023-10-06T11:08:29.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.459+0000 7f671d573700 1 -- 172.21.15.146:0/421938421 wait complete. 2023-10-06T11:08:29.462 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 27 2023-10-06T11:08:29.473 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:08:29.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.586+0000 7f5ecc6af700 1 Processor -- start 2023-10-06T11:08:29.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.586+0000 7f5ecc6af700 1 -- start start 2023-10-06T11:08:29.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.587+0000 7f5ecc6af700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5ec415dde0 0x7f5ec415a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:29.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.587+0000 7f5ecc6af700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ec406f090 con 0x7f5ec40aa1e0 2023-10-06T11:08:29.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.587+0000 7f5ecc6af700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ec4067810 con 0x7f5ec41595c0 2023-10-06T11:08:29.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.587+0000 7f5ecc6af700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ec4068420 con 0x7f5ec415dde0 2023-10-06T11:08:29.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.588+0000 7f5ec9c4a700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f5ec40aa1e0 0x7f5ec4159990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35148/0 (socket says 172.21.15.146:35148) 2023-10-06T11:08:29.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.588+0000 7f5ec9c4a700 1 -- 172.21.15.146:0/2453753512 learned_addr learned my addr 172.21.15.146:0/2453753512 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:08:29.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.588+0000 7f5ecac4c700 1 --2- 172.21.15.146:0/2453753512 >> v2:172.21.15.151:3300/0 conn(0x7f5ec415dde0 0x7f5ec415a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:29.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.588+0000 7f5ec9449700 1 -- 172.21.15.146:0/2453753512 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1105090284 0 0) 0x7f5ec406f090 con 0x7f5ec40aa1e0 2023-10-06T11:08:29.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.588+0000 7f5ec9449700 1 -- 172.21.15.146:0/2453753512 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5eb0003570 con 0x7f5ec40aa1e0 2023-10-06T11:08:29.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.588+0000 7f5ec9449700 1 -- 172.21.15.146:0/2453753512 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2624473158 0 0) 0x7f5ec4067810 con 0x7f5ec41595c0 2023-10-06T11:08:29.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.588+0000 7f5ec9449700 1 -- 172.21.15.146:0/2453753512 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ec406f090 con 0x7f5ec41595c0 2023-10-06T11:08:29.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.588+0000 7f5ec9449700 1 -- 172.21.15.146:0/2453753512 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1218628459 0 0) 0x7f5eb0003570 con 0x7f5ec40aa1e0 2023-10-06T11:08:29.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.588+0000 7f5ec9449700 1 -- 172.21.15.146:0/2453753512 >> v2:172.21.15.151:3300/0 conn(0x7f5ec415dde0 msgr2=0x7f5ec415a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:29.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.588+0000 7f5ec9449700 1 --2- 172.21.15.146:0/2453753512 >> v2:172.21.15.151:3300/0 conn(0x7f5ec415dde0 0x7f5ec415a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:29.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.588+0000 7f5ec9449700 1 -- 172.21.15.146:0/2453753512 >> v1:172.21.15.151:6789/0 conn(0x7f5ec41595c0 legacy=0x7f5ec40a9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:29.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.588+0000 7f5ec9449700 1 -- 172.21.15.146:0/2453753512 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec4067af0 con 0x7f5ec40aa1e0 2023-10-06T11:08:29.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.588+0000 7f5ec9449700 1 -- 172.21.15.146:0/2453753512 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f5ec0001470 con 0x7f5ec40aa1e0 2023-10-06T11:08:29.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.588+0000 7f5ec9449700 1 -- 172.21.15.146:0/2453753512 >> v1:172.21.15.146:6789/0 conn(0x7f5ec40aa1e0 legacy=0x7f5ec4159990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:29.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.588+0000 7f5ec9449700 1 --2- 172.21.15.146:0/2453753512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5eb0003c40 0x7f5eb0004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:29.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.588+0000 7f5ec9449700 1 --2- 172.21.15.146:0/2453753512 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5eb0004810 0x7f5eb0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:29.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.588+0000 7f5ec9449700 1 --2- 172.21.15.146:0/2453753512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5eb0005210 0x7f5eb000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:29.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.588+0000 7f5ec9449700 1 -- 172.21.15.146:0/2453753512 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec4068420 con 0x7f5eb0005210 2023-10-06T11:08:29.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.588+0000 7f5ec9449700 1 -- 172.21.15.146:0/2453753512 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb000c1b0 con 0x7f5eb0003c40 2023-10-06T11:08:29.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.588+0000 7f5ec9449700 1 -- 172.21.15.146:0/2453753512 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb000c370 con 0x7f5eb0004810 2023-10-06T11:08:29.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.588+0000 7f5ecac4c700 1 --2- 172.21.15.146:0/2453753512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5eb0005210 0x7f5eb000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:29.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.588+0000 7f5eca44b700 1 --2- 172.21.15.146:0/2453753512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5eb0003c40 0x7f5eb0004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:29.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.588+0000 7f5ec9c4a700 1 --2- 172.21.15.146:0/2453753512 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5eb0004810 0x7f5eb0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:29.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.589+0000 7f5ecac4c700 1 -- 172.21.15.146:0/2453753512 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5eb0004810 msgr2=0x7f5eb0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:29.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.589+0000 7f5ecac4c700 1 --2- 172.21.15.146:0/2453753512 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5eb0004810 0x7f5eb0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:29.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.589+0000 7f5ecac4c700 1 -- 172.21.15.146:0/2453753512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5eb0003c40 msgr2=0x7f5eb0004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:29.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.589+0000 7f5ecac4c700 1 --2- 172.21.15.146:0/2453753512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5eb0003c40 0x7f5eb0004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:29.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.589+0000 7f5ecac4c700 1 -- 172.21.15.146:0/2453753512 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb0003570 con 0x7f5eb0005210 2023-10-06T11:08:29.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.589+0000 7f5eca44b700 1 --2- 172.21.15.146:0/2453753512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5eb0003c40 0x7f5eb0004030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:08:29.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.589+0000 7f5ecac4c700 1 -- 172.21.15.146:0/2453753512 reap_dead start 2023-10-06T11:08:29.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.589+0000 7f5ecac4c700 1 --2- 172.21.15.146:0/2453753512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5eb0005210 0x7f5eb000ba60 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc0094d0 tx=0x7f5ebc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=757a15696e40edbe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:29.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.589+0000 7f5ec9449700 1 -- 172.21.15.146:0/2453753512 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc00ea90 con 0x7f5eb0005210 2023-10-06T11:08:29.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.589+0000 7f5ec9449700 1 -- 172.21.15.146:0/2453753512 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ebc00f040 con 0x7f5eb0005210 2023-10-06T11:08:29.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.589+0000 7f5ec9449700 1 -- 172.21.15.146:0/2453753512 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ebc00ee20 con 0x7f5eb0005210 2023-10-06T11:08:29.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.589+0000 7f5ecc6af700 1 -- 172.21.15.146:0/2453753512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5eb0005210 msgr2=0x7f5eb000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:29.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.589+0000 7f5ecc6af700 1 --2- 172.21.15.146:0/2453753512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5eb0005210 0x7f5eb000ba60 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc0094d0 tx=0x7f5ebc00b040 comp rx=0 tx=0).stop 2023-10-06T11:08:29.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.589+0000 7f5ecc6af700 1 -- 172.21.15.146:0/2453753512 shutdown_connections 2023-10-06T11:08:29.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.589+0000 7f5ecc6af700 1 --2- 172.21.15.146:0/2453753512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5eb0005210 0x7f5eb000ba60 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:29.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.589+0000 7f5ecc6af700 1 -- 172.21.15.146:0/2453753512 >> 172.21.15.146:0/2453753512 conn(0x7f5ec40cd530 msgr2=0x7f5ec4069f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:29.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.589+0000 7f5ecc6af700 1 -- 172.21.15.146:0/2453753512 shutdown_connections 2023-10-06T11:08:29.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.589+0000 7f5ecc6af700 1 -- 172.21.15.146:0/2453753512 wait complete. 2023-10-06T11:08:29.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.590+0000 7f5ecc6af700 1 Processor -- start 2023-10-06T11:08:29.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.591+0000 7f5ecc6af700 1 -- start start 2023-10-06T11:08:29.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.591+0000 7f5ecc6af700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5eb0005210 0x7f5ec40abb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:29.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.591+0000 7f5ecc6af700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ec4169c40 0x7f5ec416a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:29.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.591+0000 7f5ecc6af700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5ec40addf0 0x7f5ec40ae260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:29.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.591+0000 7f5ecc6af700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec40ad110 con 0x7f5eb0005210 2023-10-06T11:08:29.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.591+0000 7f5ecc6af700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec40ac490 con 0x7f5ec4169c40 2023-10-06T11:08:29.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.591+0000 7f5ecc6af700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec40ac770 con 0x7f5ec40addf0 2023-10-06T11:08:29.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.591+0000 7f5eca44b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5eb0005210 0x7f5ec40abb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:29.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.591+0000 7f5eca44b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5eb0005210 0x7f5ec40abb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56494/0 (socket says 172.21.15.146:56494) 2023-10-06T11:08:29.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.591+0000 7f5eca44b700 1 -- 172.21.15.146:0/3624682888 learned_addr learned my addr 172.21.15.146:0/3624682888 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:29.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.591+0000 7f5ec9c4a700 1 --2- 172.21.15.146:0/3624682888 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ec4169c40 0x7f5ec416a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:29.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.591+0000 7f5ecac4c700 1 --2- 172.21.15.146:0/3624682888 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5ec40addf0 0x7f5ec40ae260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:29.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.592+0000 7f5eca44b700 1 -- 172.21.15.146:0/3624682888 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5ec40addf0 msgr2=0x7f5ec40ae260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:29.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.592+0000 7f5eca44b700 1 --2- 172.21.15.146:0/3624682888 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5ec40addf0 0x7f5ec40ae260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:29.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.592+0000 7f5eca44b700 1 -- 172.21.15.146:0/3624682888 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ec4169c40 msgr2=0x7f5ec416a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:29.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.592+0000 7f5eca44b700 1 --2- 172.21.15.146:0/3624682888 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ec4169c40 0x7f5ec416a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:29.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.592+0000 7f5eca44b700 1 -- 172.21.15.146:0/3624682888 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec40aca50 con 0x7f5eb0005210 2023-10-06T11:08:29.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.592+0000 7f5ecac4c700 1 --2- 172.21.15.146:0/3624682888 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5ec40addf0 0x7f5ec40ae260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:08:29.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.592+0000 7f5ec9c4a700 1 --2- 172.21.15.146:0/3624682888 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ec4169c40 0x7f5ec416a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:08:29.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.592+0000 7f5eca44b700 1 --2- 172.21.15.146:0/3624682888 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5eb0005210 0x7f5ec40abb20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f5eb800e7b0 tx=0x7f5eb8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:29.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.592+0000 7f5eb67fc700 1 -- 172.21.15.146:0/3624682888 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb80026a0 con 0x7f5eb0005210 2023-10-06T11:08:29.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.592+0000 7f5eb67fc700 1 -- 172.21.15.146:0/3624682888 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb8010040 con 0x7f5eb0005210 2023-10-06T11:08:29.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.592+0000 7f5ecc6af700 1 -- 172.21.15.146:0/3624682888 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ec40acd30 con 0x7f5eb0005210 2023-10-06T11:08:29.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.592+0000 7f5eb67fc700 1 -- 172.21.15.146:0/3624682888 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb8002a50 con 0x7f5eb0005210 2023-10-06T11:08:29.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.592+0000 7f5ecc6af700 1 -- 172.21.15.146:0/3624682888 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ec40ae7a0 con 0x7f5eb0005210 2023-10-06T11:08:29.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.593+0000 7f5ecc6af700 1 -- 172.21.15.146:0/3624682888 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ec40ad250 con 0x7f5eb0005210 2023-10-06T11:08:29.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.593+0000 7f5eb67fc700 1 -- 172.21.15.146:0/3624682888 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5eb80143f0 con 0x7f5eb0005210 2023-10-06T11:08:29.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.594+0000 7f5eb67fc700 1 --2- 172.21.15.146:0/3624682888 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5ea8066f30 0x7f5ea80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:29.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.594+0000 7f5eb67fc700 1 -- 172.21.15.146:0/3624682888 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f5eb8084130 con 0x7f5eb0005210 2023-10-06T11:08:29.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.594+0000 7f5ec9c4a700 1 --2- 172.21.15.146:0/3624682888 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5ea8066f30 0x7f5ea80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:29.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.594+0000 7f5ec9c4a700 1 --2- 172.21.15.146:0/3624682888 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5ea8066f30 0x7f5ea80693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0001ed0 tx=0x7f5ec0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:29.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.598+0000 7f5eb67fc700 1 -- 172.21.15.146:0/3624682888 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5eb804d5a0 con 0x7f5eb0005210 2023-10-06T11:08:29.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.785+0000 7f5ecc6af700 1 -- 172.21.15.146:0/3624682888 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ec404c380 con 0x7f5eb0005210 2023-10-06T11:08:29.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.786+0000 7f5eb67fc700 1 -- 172.21.15.146:0/3624682888 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+17028 (secure 0 0 0) 0x7f5ec40ad250 con 0x7f5eb0005210 2023-10-06T11:08:29.788 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:08:29.788 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":35,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:08:05.310462+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:06:34.036525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T11:06:34.902843+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":34,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.10","mappings":[{"from":5,"to":1}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:08:29.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.788+0000 7f5ecc6af700 1 -- 172.21.15.146:0/3624682888 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5ea8066f30 msgr2=0x7f5ea80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:29.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.788+0000 7f5ecc6af700 1 --2- 172.21.15.146:0/3624682888 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5ea8066f30 0x7f5ea80693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0001ed0 tx=0x7f5ec0009040 comp rx=0 tx=0).stop 2023-10-06T11:08:29.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.788+0000 7f5ecc6af700 1 -- 172.21.15.146:0/3624682888 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5eb0005210 msgr2=0x7f5ec40abb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:29.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.788+0000 7f5ecc6af700 1 --2- 172.21.15.146:0/3624682888 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5eb0005210 0x7f5ec40abb20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f5eb800e7b0 tx=0x7f5eb8009040 comp rx=0 tx=0).stop 2023-10-06T11:08:29.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.788+0000 7f5ecc6af700 1 -- 172.21.15.146:0/3624682888 shutdown_connections 2023-10-06T11:08:29.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.788+0000 7f5ecc6af700 1 --2- 172.21.15.146:0/3624682888 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5ea8066f30 0x7f5ea80693e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:29.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.788+0000 7f5ecc6af700 1 --2- 172.21.15.146:0/3624682888 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5ec40addf0 0x7f5ec40ae260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:29.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.788+0000 7f5ecc6af700 1 --2- 172.21.15.146:0/3624682888 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5eb0005210 0x7f5ec40abb20 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:29.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.788+0000 7f5ecc6af700 1 --2- 172.21.15.146:0/3624682888 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ec4169c40 0x7f5ec416a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:29.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.788+0000 7f5ecc6af700 1 -- 172.21.15.146:0/3624682888 >> 172.21.15.146:0/3624682888 conn(0x7f5ec40cd530 msgr2=0x7f5ec41585f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:29.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.788+0000 7f5ecc6af700 1 -- 172.21.15.146:0/3624682888 shutdown_connections 2023-10-06T11:08:29.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.788+0000 7f5ecc6af700 1 -- 172.21.15.146:0/3624682888 wait complete. 2023-10-06T11:08:29.802 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T11:08:29.802 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:08:29.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.915+0000 7fadb45a7700 1 Processor -- start 2023-10-06T11:08:29.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.915+0000 7fadb45a7700 1 -- start start 2023-10-06T11:08:29.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.916+0000 7fadb45a7700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fadac0c3960 0x7fadac0cc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:29.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.916+0000 7fadb45a7700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fadac0c4750 0x7fadac0cced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:29.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.916+0000 7fadb45a7700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadac068a90 con 0x7fadac0b08d0 2023-10-06T11:08:29.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.916+0000 7fadb45a7700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadac159fd0 con 0x7fadac0c3960 2023-10-06T11:08:29.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.916+0000 7fadb45a7700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadac0cdcf0 con 0x7fadac0c4750 2023-10-06T11:08:29.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.916+0000 7fadb2343700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fadac0b08d0 0x7fadac0c3250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35160/0 (socket says 172.21.15.146:35160) 2023-10-06T11:08:29.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.916+0000 7fadb2343700 1 -- 172.21.15.146:0/3292485371 learned_addr learned my addr 172.21.15.146:0/3292485371 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:08:29.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.916+0000 7fadb1b42700 1 --2- 172.21.15.146:0/3292485371 >> v2:172.21.15.151:3300/0 conn(0x7fadac0c3960 0x7fadac0cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:29.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.916+0000 7fadb2b44700 1 --2- 172.21.15.146:0/3292485371 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fadac0c4750 0x7fadac0cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:29.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.916+0000 7fadb1341700 1 -- 172.21.15.146:0/3292485371 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 831882788 0 0) 0x7fadac068a90 con 0x7fadac0b08d0 2023-10-06T11:08:29.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.916+0000 7fadb1341700 1 -- 172.21.15.146:0/3292485371 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad98003570 con 0x7fadac0b08d0 2023-10-06T11:08:29.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.916+0000 7fadb1b42700 1 -- 172.21.15.146:0/3292485371 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fadac0c4750 msgr2=0x7fadac0cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:29.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.916+0000 7fadb1b42700 1 --2- 172.21.15.146:0/3292485371 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fadac0c4750 0x7fadac0cced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:29.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.916+0000 7fadb1b42700 1 -- 172.21.15.146:0/3292485371 >> v1:172.21.15.146:6789/0 conn(0x7fadac0b08d0 legacy=0x7fadac0c3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:29.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.916+0000 7fadb1b42700 1 -- 172.21.15.146:0/3292485371 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadac0cdfd0 con 0x7fadac0c3960 2023-10-06T11:08:29.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.916+0000 7fadb1b42700 1 --2- 172.21.15.146:0/3292485371 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fadac0c3960 0x7fadac0cc990 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fad9c0098e0 tx=0x7fad9c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1bf6158d822a01bc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:29.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.917+0000 7fadb1341700 1 -- 172.21.15.146:0/3292485371 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9c011630 con 0x7fadac0c3960 2023-10-06T11:08:29.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.917+0000 7fadb1341700 1 -- 172.21.15.146:0/3292485371 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad9c011790 con 0x7fadac0c3960 2023-10-06T11:08:29.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.917+0000 7fadb1341700 1 -- 172.21.15.146:0/3292485371 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9c011b10 con 0x7fadac0c3960 2023-10-06T11:08:29.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.917+0000 7fadb45a7700 1 -- 172.21.15.146:0/3292485371 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fadac0c3960 msgr2=0x7fadac0cc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:29.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.917+0000 7fadb45a7700 1 --2- 172.21.15.146:0/3292485371 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fadac0c3960 0x7fadac0cc990 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fad9c0098e0 tx=0x7fad9c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:08:29.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.917+0000 7fadb45a7700 1 -- 172.21.15.146:0/3292485371 shutdown_connections 2023-10-06T11:08:29.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.917+0000 7fadb45a7700 1 --2- 172.21.15.146:0/3292485371 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fadac0c4750 0x7fadac0cced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:29.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.917+0000 7fadb45a7700 1 --2- 172.21.15.146:0/3292485371 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fadac0c3960 0x7fadac0cc990 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:29.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.917+0000 7fadb45a7700 1 -- 172.21.15.146:0/3292485371 >> 172.21.15.146:0/3292485371 conn(0x7fadac067c50 msgr2=0x7fadac0ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:29.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.917+0000 7fadb45a7700 1 -- 172.21.15.146:0/3292485371 shutdown_connections 2023-10-06T11:08:29.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.917+0000 7fadb45a7700 1 -- 172.21.15.146:0/3292485371 wait complete. 2023-10-06T11:08:29.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.918+0000 7fadb45a7700 1 Processor -- start 2023-10-06T11:08:29.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.918+0000 7fadb45a7700 1 -- start start 2023-10-06T11:08:29.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.919+0000 7fadb45a7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fadac0b08d0 0x7fadac15b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:29.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.919+0000 7fadb45a7700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fadac0c3960 0x7fadac0caf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:29.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.919+0000 7fadb45a7700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fadac0c4750 0x7fadac0cb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:29.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.919+0000 7fadb45a7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadac150f40 con 0x7fadac0b08d0 2023-10-06T11:08:29.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.919+0000 7fadb45a7700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadac0b1d80 con 0x7fadac0c3960 2023-10-06T11:08:29.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.919+0000 7fadb45a7700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadac15ba30 con 0x7fadac0c4750 2023-10-06T11:08:29.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.919+0000 7fadb2343700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fadac0b08d0 0x7fadac15b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:29.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.919+0000 7fadb2343700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fadac0b08d0 0x7fadac15b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56496/0 (socket says 172.21.15.146:56496) 2023-10-06T11:08:29.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.919+0000 7fadb2343700 1 -- 172.21.15.146:0/2192227100 learned_addr learned my addr 172.21.15.146:0/2192227100 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:29.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.919+0000 7fadb2343700 1 -- 172.21.15.146:0/2192227100 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fadac0c4750 msgr2=0x7fadac0cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:29.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.919+0000 7fadb2343700 1 --2- 172.21.15.146:0/2192227100 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fadac0c4750 0x7fadac0cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:29.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.919+0000 7fadb2343700 1 -- 172.21.15.146:0/2192227100 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fadac0c3960 msgr2=0x7fadac0caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:29.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.919+0000 7fadb1b42700 1 --2- 172.21.15.146:0/2192227100 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fadac0c3960 0x7fadac0caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:29.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.919+0000 7fadb2343700 1 --2- 172.21.15.146:0/2192227100 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fadac0c3960 0x7fadac0caf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:29.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.919+0000 7fadb2343700 1 -- 172.21.15.146:0/2192227100 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad9c009420 con 0x7fadac0b08d0 2023-10-06T11:08:29.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.920+0000 7fadb2343700 1 --2- 172.21.15.146:0/2192227100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fadac0b08d0 0x7fadac15b4f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fada80011e0 tx=0x7fada8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:29.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.920+0000 7fada27fc700 1 -- 172.21.15.146:0/2192227100 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada8005b30 con 0x7fadac0b08d0 2023-10-06T11:08:29.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.920+0000 7fada27fc700 1 -- 172.21.15.146:0/2192227100 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fada8005c90 con 0x7fadac0b08d0 2023-10-06T11:08:29.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.920+0000 7fadb45a7700 1 -- 172.21.15.146:0/2192227100 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadac15bcd0 con 0x7fadac0b08d0 2023-10-06T11:08:29.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.920+0000 7fada27fc700 1 -- 172.21.15.146:0/2192227100 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fada8007320 con 0x7fadac0b08d0 2023-10-06T11:08:29.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.920+0000 7fadb45a7700 1 -- 172.21.15.146:0/2192227100 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadac15c290 con 0x7fadac0b08d0 2023-10-06T11:08:29.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.921+0000 7fadb45a7700 1 -- 172.21.15.146:0/2192227100 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadac0b1b50 con 0x7fadac0b08d0 2023-10-06T11:08:29.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.921+0000 7fada27fc700 1 -- 172.21.15.146:0/2192227100 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fada8007690 con 0x7fadac0b08d0 2023-10-06T11:08:29.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.921+0000 7fada27fc700 1 --2- 172.21.15.146:0/2192227100 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fad90066f30 0x7fad900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:29.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.922+0000 7fadb1b42700 1 --2- 172.21.15.146:0/2192227100 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fad90066f30 0x7fad900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:29.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.922+0000 7fada27fc700 1 -- 172.21.15.146:0/2192227100 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6115+0+0 (secure 0 0 0) 0x7fada8083bd0 con 0x7fadac0b08d0 2023-10-06T11:08:29.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.922+0000 7fadb1b42700 1 --2- 172.21.15.146:0/2192227100 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fad90066f30 0x7fad900693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fadac0c3d60 tx=0x7fad9c017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:29.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:29.926+0000 7fada27fc700 1 -- 172.21.15.146:0/2192227100 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fada8050ca0 con 0x7fadac0b08d0 2023-10-06T11:08:30.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.154+0000 7fadb45a7700 1 -- 172.21.15.146:0/2192227100 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fadac04c380 con 0x7fadac0b08d0 2023-10-06T11:08:30.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.154+0000 7fada27fc700 1 -- 172.21.15.146:0/2192227100 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4610 (secure 0 0 0) 0x7fada8017020 con 0x7fadac0b08d0 2023-10-06T11:08:30.156 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:08:30.156 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":27,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4673,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/1243531288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1243531288},{"type":"v1","addr":"172.21.15.151:6834","nonce":1243531288}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4676,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/4009288357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":4009288357},{"type":"v1","addr":"172.21.15.151:6835","nonce":4009288357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4983,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2777930290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2777930290},{"type":"v1","addr":"172.21.15.146:6836","nonce":2777930290}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-10-06T11:06:35.935256+0000","modified":"2023-10-06T11:08:13.321298+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4986},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4986":{"gid":4986,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":27,"addr":"172.21.15.146:6837/4187213529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":4187213529},{"type":"v1","addr":"172.21.15.146:6837","nonce":4187213529}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T11:08:30.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.156+0000 7fadb45a7700 1 -- 172.21.15.146:0/2192227100 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fad90066f30 msgr2=0x7fad900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:30.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.156+0000 7fadb45a7700 1 --2- 172.21.15.146:0/2192227100 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fad90066f30 0x7fad900693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fadac0c3d60 tx=0x7fad9c017000 comp rx=0 tx=0).stop 2023-10-06T11:08:30.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.156+0000 7fadb45a7700 1 -- 172.21.15.146:0/2192227100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fadac0b08d0 msgr2=0x7fadac15b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:30.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.156+0000 7fadb45a7700 1 --2- 172.21.15.146:0/2192227100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fadac0b08d0 0x7fadac15b4f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fada80011e0 tx=0x7fada8007df0 comp rx=0 tx=0).stop 2023-10-06T11:08:30.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.156+0000 7fadb45a7700 1 -- 172.21.15.146:0/2192227100 shutdown_connections 2023-10-06T11:08:30.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.156+0000 7fadb45a7700 1 --2- 172.21.15.146:0/2192227100 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fad90066f30 0x7fad900693e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:30.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.156+0000 7fadb45a7700 1 --2- 172.21.15.146:0/2192227100 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fadac0c4750 0x7fadac0cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:30.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.156+0000 7fadb45a7700 1 --2- 172.21.15.146:0/2192227100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fadac0b08d0 0x7fadac15b4f0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:30.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.156+0000 7fadb45a7700 1 --2- 172.21.15.146:0/2192227100 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fadac0c3960 0x7fadac0caf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:30.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.156+0000 7fadb45a7700 1 -- 172.21.15.146:0/2192227100 >> 172.21.15.146:0/2192227100 conn(0x7fadac067c50 msgr2=0x7fadac0ca0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:30.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.156+0000 7fadb45a7700 1 -- 172.21.15.146:0/2192227100 shutdown_connections 2023-10-06T11:08:30.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.156+0000 7fadb45a7700 1 -- 172.21.15.146:0/2192227100 wait complete. 2023-10-06T11:08:30.159 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 27 2023-10-06T11:08:30.170 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:08:30.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.284+0000 7f9a77458700 1 Processor -- start 2023-10-06T11:08:30.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.284+0000 7f9a77458700 1 -- start start 2023-10-06T11:08:30.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.285+0000 7f9a77458700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9a7015a420 0x7f9a7015cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:30.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.285+0000 7f9a77458700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9a7015a7f0 0x7f9a700b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:30.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.285+0000 7f9a77458700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a7015c630 con 0x7f9a700b2360 2023-10-06T11:08:30.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.285+0000 7f9a77458700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a700ce040 con 0x7f9a7015a7f0 2023-10-06T11:08:30.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.285+0000 7f9a77458700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a700b2780 con 0x7f9a7015a420 2023-10-06T11:08:30.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.285+0000 7f9a75c55700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9a7015a7f0 0x7f9a700b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:30.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.285+0000 7f9a75c55700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9a7015a7f0 0x7f9a700b1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56508/0 (socket says 172.21.15.146:56508) 2023-10-06T11:08:30.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.285+0000 7f9a75c55700 1 -- 172.21.15.146:0/3243214387 learned_addr learned my addr 172.21.15.146:0/3243214387 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:30.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.285+0000 7f9a76456700 1 --2- 172.21.15.146:0/3243214387 >> v2:172.21.15.151:3300/0 conn(0x7f9a7015a420 0x7f9a7015cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:30.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.285+0000 7f9a75c55700 1 -- 172.21.15.146:0/3243214387 >> v2:172.21.15.151:3300/0 conn(0x7f9a7015a420 msgr2=0x7f9a7015cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:30.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.285+0000 7f9a75c55700 1 --2- 172.21.15.146:0/3243214387 >> v2:172.21.15.151:3300/0 conn(0x7f9a7015a420 0x7f9a7015cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:30.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.285+0000 7f9a75c55700 1 -- 172.21.15.146:0/3243214387 >> v1:172.21.15.151:6789/0 conn(0x7f9a700b2360 legacy=0x7f9a7015acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:30.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.286+0000 7f9a75c55700 1 -- 172.21.15.146:0/3243214387 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a7015ba20 con 0x7f9a7015a7f0 2023-10-06T11:08:30.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.286+0000 7f9a75c55700 1 --2- 172.21.15.146:0/3243214387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a7015a7f0 0x7f9a700b1e20 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9a700d1460 tx=0x7f9a60009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f1ad17776f27daa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:30.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.286+0000 7f9a75454700 1 -- 172.21.15.146:0/3243214387 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6000b820 con 0x7f9a7015a7f0 2023-10-06T11:08:30.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.286+0000 7f9a75454700 1 -- 172.21.15.146:0/3243214387 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a6000b980 con 0x7f9a7015a7f0 2023-10-06T11:08:30.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.286+0000 7f9a75454700 1 -- 172.21.15.146:0/3243214387 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6000bd20 con 0x7f9a7015a7f0 2023-10-06T11:08:30.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.286+0000 7f9a77458700 1 -- 172.21.15.146:0/3243214387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a7015a7f0 msgr2=0x7f9a700b1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:30.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.286+0000 7f9a77458700 1 --2- 172.21.15.146:0/3243214387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a7015a7f0 0x7f9a700b1e20 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9a700d1460 tx=0x7f9a60009250 comp rx=0 tx=0).stop 2023-10-06T11:08:30.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.286+0000 7f9a77458700 1 -- 172.21.15.146:0/3243214387 shutdown_connections 2023-10-06T11:08:30.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.286+0000 7f9a77458700 1 --2- 172.21.15.146:0/3243214387 >> v2:172.21.15.151:3300/0 conn(0x7f9a7015a420 0x7f9a7015cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:30.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.286+0000 7f9a77458700 1 --2- 172.21.15.146:0/3243214387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a7015a7f0 0x7f9a700b1e20 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:30.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.286+0000 7f9a77458700 1 -- 172.21.15.146:0/3243214387 >> 172.21.15.146:0/3243214387 conn(0x7f9a7006eba0 msgr2=0x7f9a7006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:30.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.286+0000 7f9a77458700 1 -- 172.21.15.146:0/3243214387 shutdown_connections 2023-10-06T11:08:30.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.286+0000 7f9a77458700 1 -- 172.21.15.146:0/3243214387 wait complete. 2023-10-06T11:08:30.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.287+0000 7f9a77458700 1 Processor -- start 2023-10-06T11:08:30.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.288+0000 7f9a77458700 1 -- start start 2023-10-06T11:08:30.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.288+0000 7f9a77458700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a700b2360 0x7f9a7014d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:30.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.288+0000 7f9a77458700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a7015a420 0x7f9a70157c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:30.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.288+0000 7f9a77458700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a7015a7f0 0x7f9a70152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:30.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.288+0000 7f9a77458700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7016b390 con 0x7f9a7015a420 2023-10-06T11:08:30.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.288+0000 7f9a77458700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a701515d0 con 0x7f9a700b2360 2023-10-06T11:08:30.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.288+0000 7f9a77458700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7014d6b0 con 0x7f9a7015a7f0 2023-10-06T11:08:30.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.288+0000 7f9a75c55700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a7015a420 0x7f9a70157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:30.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.288+0000 7f9a75c55700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a7015a420 0x7f9a70157c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56510/0 (socket says 172.21.15.146:56510) 2023-10-06T11:08:30.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.288+0000 7f9a75c55700 1 -- 172.21.15.146:0/1941722550 learned_addr learned my addr 172.21.15.146:0/1941722550 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:30.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.289+0000 7f9a76456700 1 --2- 172.21.15.146:0/1941722550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a700b2360 0x7f9a7014d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:30.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.289+0000 7f9a75c55700 1 -- 172.21.15.146:0/1941722550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a7015a7f0 msgr2=0x7f9a70152d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:30.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.289+0000 7f9a76c57700 1 --2- 172.21.15.146:0/1941722550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a7015a7f0 0x7f9a70152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:30.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.289+0000 7f9a75c55700 1 --2- 172.21.15.146:0/1941722550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a7015a7f0 0x7f9a70152d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:30.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.289+0000 7f9a75c55700 1 -- 172.21.15.146:0/1941722550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a700b2360 msgr2=0x7f9a7014d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:30.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.289+0000 7f9a75c55700 1 --2- 172.21.15.146:0/1941722550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a700b2360 0x7f9a7014d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:30.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.289+0000 7f9a75c55700 1 -- 172.21.15.146:0/1941722550 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a600094f0 con 0x7f9a7015a420 2023-10-06T11:08:30.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.289+0000 7f9a76456700 1 --2- 172.21.15.146:0/1941722550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a700b2360 0x7f9a7014d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:08:30.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.289+0000 7f9a76c57700 1 --2- 172.21.15.146:0/1941722550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a7015a7f0 0x7f9a70152d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:08:30.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.289+0000 7f9a75c55700 1 --2- 172.21.15.146:0/1941722550 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a7015a420 0x7f9a70157c90 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9a60009290 tx=0x7f9a60016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:30.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.289+0000 7f9a667fc700 1 -- 172.21.15.146:0/1941722550 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a60011e60 con 0x7f9a7015a420 2023-10-06T11:08:30.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.289+0000 7f9a667fc700 1 -- 172.21.15.146:0/1941722550 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a6001b680 con 0x7f9a7015a420 2023-10-06T11:08:30.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.289+0000 7f9a77458700 1 -- 172.21.15.146:0/1941722550 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a70150ca0 con 0x7f9a7015a420 2023-10-06T11:08:30.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.289+0000 7f9a667fc700 1 -- 172.21.15.146:0/1941722550 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6001ba40 con 0x7f9a7015a420 2023-10-06T11:08:30.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.289+0000 7f9a77458700 1 -- 172.21.15.146:0/1941722550 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a70151260 con 0x7f9a7015a420 2023-10-06T11:08:30.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.290+0000 7f9a77458700 1 -- 172.21.15.146:0/1941722550 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a701513f0 con 0x7f9a7015a420 2023-10-06T11:08:30.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.290+0000 7f9a667fc700 1 -- 172.21.15.146:0/1941722550 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9a6001c450 con 0x7f9a7015a420 2023-10-06T11:08:30.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.291+0000 7f9a667fc700 1 --2- 172.21.15.146:0/1941722550 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9a54066f30 0x7f9a540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:30.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.291+0000 7f9a76456700 1 --2- 172.21.15.146:0/1941722550 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9a54066f30 0x7f9a540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:30.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.291+0000 7f9a667fc700 1 -- 172.21.15.146:0/1941722550 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f9a60086530 con 0x7f9a7015a420 2023-10-06T11:08:30.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.291+0000 7f9a76456700 1 --2- 172.21.15.146:0/1941722550 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9a54066f30 0x7f9a540693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c00d460 tx=0x7f9a6c0075e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:30.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.295+0000 7f9a667fc700 1 -- 172.21.15.146:0/1941722550 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9a60053600 con 0x7f9a7015a420 2023-10-06T11:08:30.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.521+0000 7f9a77458700 1 -- 172.21.15.146:0/1941722550 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a70151740 con 0x7f9a7015a420 2023-10-06T11:08:30.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.522+0000 7f9a667fc700 1 -- 172.21.15.146:0/1941722550 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+4610 (secure 0 0 0) 0x7f9a60056c20 con 0x7f9a7015a420 2023-10-06T11:08:30.523 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:08:30.523 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":27,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4673,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/1243531288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1243531288},{"type":"v1","addr":"172.21.15.151:6834","nonce":1243531288}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4676,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/4009288357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":4009288357},{"type":"v1","addr":"172.21.15.151:6835","nonce":4009288357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4983,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2777930290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2777930290},{"type":"v1","addr":"172.21.15.146:6836","nonce":2777930290}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-10-06T11:06:35.935256+0000","modified":"2023-10-06T11:08:13.321298+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4986},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4986":{"gid":4986,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":27,"addr":"172.21.15.146:6837/4187213529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":4187213529},{"type":"v1","addr":"172.21.15.146:6837","nonce":4187213529}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T11:08:30.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.524+0000 7f9a77458700 1 -- 172.21.15.146:0/1941722550 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9a54066f30 msgr2=0x7f9a540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:30.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.524+0000 7f9a77458700 1 --2- 172.21.15.146:0/1941722550 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9a54066f30 0x7f9a540693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c00d460 tx=0x7f9a6c0075e0 comp rx=0 tx=0).stop 2023-10-06T11:08:30.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.524+0000 7f9a77458700 1 -- 172.21.15.146:0/1941722550 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a7015a420 msgr2=0x7f9a70157c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:30.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.524+0000 7f9a77458700 1 --2- 172.21.15.146:0/1941722550 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a7015a420 0x7f9a70157c90 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9a60009290 tx=0x7f9a60016000 comp rx=0 tx=0).stop 2023-10-06T11:08:30.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.524+0000 7f9a77458700 1 -- 172.21.15.146:0/1941722550 shutdown_connections 2023-10-06T11:08:30.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.524+0000 7f9a77458700 1 --2- 172.21.15.146:0/1941722550 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9a54066f30 0x7f9a540693e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:30.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.524+0000 7f9a77458700 1 --2- 172.21.15.146:0/1941722550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a7015a7f0 0x7f9a70152d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:30.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.524+0000 7f9a77458700 1 --2- 172.21.15.146:0/1941722550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a700b2360 0x7f9a7014d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:30.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.524+0000 7f9a77458700 1 --2- 172.21.15.146:0/1941722550 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a7015a420 0x7f9a70157c90 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:30.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.524+0000 7f9a77458700 1 -- 172.21.15.146:0/1941722550 >> 172.21.15.146:0/1941722550 conn(0x7f9a7006eba0 msgr2=0x7f9a7014fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:30.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.524+0000 7f9a77458700 1 -- 172.21.15.146:0/1941722550 shutdown_connections 2023-10-06T11:08:30.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.524+0000 7f9a77458700 1 -- 172.21.15.146:0/1941722550 wait complete. 2023-10-06T11:08:30.527 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 27 2023-10-06T11:08:30.538 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:08:30.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.650+0000 7f1a4359e700 1 Processor -- start 2023-10-06T11:08:30.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.650+0000 7f1a4359e700 1 -- start start 2023-10-06T11:08:30.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.651+0000 7f1a4359e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a4415a420 0x7f1a4415cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:30.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.651+0000 7f1a4359e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1a4415a7f0 0x7f1a440b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:30.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.651+0000 7f1a4359e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1a440b2360 0x7f1a4415acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:30.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.651+0000 7f1a4359e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a440ce040 con 0x7f1a4415a7f0 2023-10-06T11:08:30.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.651+0000 7f1a4359e700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a440b27e0 con 0x7f1a440b2360 2023-10-06T11:08:30.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.651+0000 7f1a4359e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4415c630 con 0x7f1a4415a420 2023-10-06T11:08:30.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.651+0000 7f1a41d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1a4415a7f0 0x7f1a440b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:30.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.651+0000 7f1a41d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1a4415a7f0 0x7f1a440b1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56522/0 (socket says 172.21.15.146:56522) 2023-10-06T11:08:30.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.651+0000 7f1a41d9b700 1 -- 172.21.15.146:0/1475636501 learned_addr learned my addr 172.21.15.146:0/1475636501 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:30.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.651+0000 7f1a4259c700 1 --2- 172.21.15.146:0/1475636501 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a4415a420 0x7f1a4415cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:30.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.651+0000 7f1a42d9d700 1 --2- 172.21.15.146:0/1475636501 >> v2:172.21.15.151:3300/0 conn(0x7f1a440b2360 0x7f1a4415acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:30.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.651+0000 7f1a41d9b700 1 -- 172.21.15.146:0/1475636501 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a4415a420 msgr2=0x7f1a4415cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:30.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.651+0000 7f1a41d9b700 1 --2- 172.21.15.146:0/1475636501 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a4415a420 0x7f1a4415cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:30.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.651+0000 7f1a41d9b700 1 -- 172.21.15.146:0/1475636501 >> v2:172.21.15.151:3300/0 conn(0x7f1a440b2360 msgr2=0x7f1a4415acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:30.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.651+0000 7f1a41d9b700 1 --2- 172.21.15.146:0/1475636501 >> v2:172.21.15.151:3300/0 conn(0x7f1a440b2360 0x7f1a4415acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:30.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.651+0000 7f1a41d9b700 1 -- 172.21.15.146:0/1475636501 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a4415ba20 con 0x7f1a4415a7f0 2023-10-06T11:08:30.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.651+0000 7f1a41d9b700 1 --2- 172.21.15.146:0/1475636501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a4415a7f0 0x7f1a440b1e20 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f1a44089860 tx=0x7f1a38009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=312cf2ec374db1f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:30.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.652+0000 7f1a4159a700 1 -- 172.21.15.146:0/1475636501 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3800b820 con 0x7f1a4415a7f0 2023-10-06T11:08:30.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.652+0000 7f1a4159a700 1 -- 172.21.15.146:0/1475636501 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3800b980 con 0x7f1a4415a7f0 2023-10-06T11:08:30.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.652+0000 7f1a4159a700 1 -- 172.21.15.146:0/1475636501 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3800bd20 con 0x7f1a4415a7f0 2023-10-06T11:08:30.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.652+0000 7f1a4359e700 1 -- 172.21.15.146:0/1475636501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a4415a7f0 msgr2=0x7f1a440b1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:30.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.652+0000 7f1a4359e700 1 --2- 172.21.15.146:0/1475636501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a4415a7f0 0x7f1a440b1e20 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f1a44089860 tx=0x7f1a38009250 comp rx=0 tx=0).stop 2023-10-06T11:08:30.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.652+0000 7f1a4359e700 1 -- 172.21.15.146:0/1475636501 shutdown_connections 2023-10-06T11:08:30.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.652+0000 7f1a4359e700 1 --2- 172.21.15.146:0/1475636501 >> v2:172.21.15.151:3300/0 conn(0x7f1a440b2360 0x7f1a4415acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:30.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.652+0000 7f1a4359e700 1 --2- 172.21.15.146:0/1475636501 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a4415a420 0x7f1a4415cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:30.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.652+0000 7f1a4359e700 1 --2- 172.21.15.146:0/1475636501 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a4415a7f0 0x7f1a440b1e20 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:30.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.652+0000 7f1a4359e700 1 -- 172.21.15.146:0/1475636501 >> 172.21.15.146:0/1475636501 conn(0x7f1a4406eba0 msgr2=0x7f1a4406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:30.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.652+0000 7f1a4359e700 1 -- 172.21.15.146:0/1475636501 shutdown_connections 2023-10-06T11:08:30.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.652+0000 7f1a4359e700 1 -- 172.21.15.146:0/1475636501 wait complete. 2023-10-06T11:08:30.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.653+0000 7f1a4359e700 1 Processor -- start 2023-10-06T11:08:30.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.653+0000 7f1a4359e700 1 -- start start 2023-10-06T11:08:30.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.654+0000 7f1a4359e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a440b2360 0x7f1a441698d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:30.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.654+0000 7f1a4359e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a4415a420 0x7f1a4414a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:30.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.654+0000 7f1a4359e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a4415a7f0 0x7f1a440ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:30.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.654+0000 7f1a4359e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4414bec0 con 0x7f1a4415a420 2023-10-06T11:08:30.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.654+0000 7f1a4359e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4414ad80 con 0x7f1a4415a7f0 2023-10-06T11:08:30.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.654+0000 7f1a4359e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4414b060 con 0x7f1a440b2360 2023-10-06T11:08:30.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.654+0000 7f1a41d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a4415a420 0x7f1a4414a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:30.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.654+0000 7f1a41d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a4415a420 0x7f1a4414a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56530/0 (socket says 172.21.15.146:56530) 2023-10-06T11:08:30.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.654+0000 7f1a41d9b700 1 -- 172.21.15.146:0/4204745685 learned_addr learned my addr 172.21.15.146:0/4204745685 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:30.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.654+0000 7f1a41d9b700 1 -- 172.21.15.146:0/4204745685 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a440b2360 msgr2=0x7f1a441698d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:30.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.654+0000 7f1a41d9b700 1 --2- 172.21.15.146:0/4204745685 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a440b2360 0x7f1a441698d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:30.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.654+0000 7f1a41d9b700 1 -- 172.21.15.146:0/4204745685 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a4415a7f0 msgr2=0x7f1a440ae4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:30.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.654+0000 7f1a41d9b700 1 --2- 172.21.15.146:0/4204745685 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a4415a7f0 0x7f1a440ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:30.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.654+0000 7f1a41d9b700 1 -- 172.21.15.146:0/4204745685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a380094f0 con 0x7f1a4415a420 2023-10-06T11:08:30.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.655+0000 7f1a41d9b700 1 --2- 172.21.15.146:0/4204745685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a4415a420 0x7f1a4414a510 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f1a380094c0 tx=0x7f1a38017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:30.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.655+0000 7f1a327fc700 1 -- 172.21.15.146:0/4204745685 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a38024440 con 0x7f1a4415a420 2023-10-06T11:08:30.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.655+0000 7f1a327fc700 1 -- 172.21.15.146:0/4204745685 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a380245e0 con 0x7f1a4415a420 2023-10-06T11:08:30.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.655+0000 7f1a4359e700 1 -- 172.21.15.146:0/4204745685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a4414b340 con 0x7f1a4415a420 2023-10-06T11:08:30.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.655+0000 7f1a327fc700 1 -- 172.21.15.146:0/4204745685 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a380249a0 con 0x7f1a4415a420 2023-10-06T11:08:30.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.655+0000 7f1a4359e700 1 -- 172.21.15.146:0/4204745685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a4414aa50 con 0x7f1a4415a420 2023-10-06T11:08:30.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.656+0000 7f1a4359e700 1 -- 172.21.15.146:0/4204745685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a4414c350 con 0x7f1a4415a420 2023-10-06T11:08:30.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.656+0000 7f1a327fc700 1 -- 172.21.15.146:0/4204745685 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1a3801a420 con 0x7f1a4415a420 2023-10-06T11:08:30.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.656+0000 7f1a327fc700 1 --2- 172.21.15.146:0/4204745685 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1a24066f30 0x7f1a240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:30.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.656+0000 7f1a327fc700 1 -- 172.21.15.146:0/4204745685 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f1a38086500 con 0x7f1a4415a420 2023-10-06T11:08:30.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.656+0000 7f1a4259c700 1 --2- 172.21.15.146:0/4204745685 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1a24066f30 0x7f1a240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:30.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.657+0000 7f1a4259c700 1 --2- 172.21.15.146:0/4204745685 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1a24066f30 0x7f1a240693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1a44148b40 tx=0x7f1a34008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:30.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.661+0000 7f1a327fc700 1 -- 172.21.15.146:0/4204745685 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1a4414c350 con 0x7f1a4415a420 2023-10-06T11:08:30.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.844+0000 7f1a4359e700 1 -- 172.21.15.146:0/4204745685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a4414c350 con 0x7f1a4415a420 2023-10-06T11:08:30.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.845+0000 7f1a327fc700 1 -- 172.21.15.146:0/4204745685 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+17028 (secure 0 0 0) 0x7f1a4414c350 con 0x7f1a4415a420 2023-10-06T11:08:30.847 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:08:30.847 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":35,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:08:05.310462+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:06:34.036525+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T11:06:34.902843+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":34,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.10","mappings":[{"from":5,"to":1}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:08:30.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.847+0000 7f1a4359e700 1 -- 172.21.15.146:0/4204745685 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1a24066f30 msgr2=0x7f1a240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:30.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.847+0000 7f1a4359e700 1 --2- 172.21.15.146:0/4204745685 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1a24066f30 0x7f1a240693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1a44148b40 tx=0x7f1a34008040 comp rx=0 tx=0).stop 2023-10-06T11:08:30.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.847+0000 7f1a4359e700 1 -- 172.21.15.146:0/4204745685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a4415a420 msgr2=0x7f1a4414a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:30.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.847+0000 7f1a4359e700 1 --2- 172.21.15.146:0/4204745685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a4415a420 0x7f1a4414a510 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f1a380094c0 tx=0x7f1a38017000 comp rx=0 tx=0).stop 2023-10-06T11:08:30.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.847+0000 7f1a4359e700 1 -- 172.21.15.146:0/4204745685 shutdown_connections 2023-10-06T11:08:30.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.847+0000 7f1a4359e700 1 --2- 172.21.15.146:0/4204745685 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1a24066f30 0x7f1a240693e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:30.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.847+0000 7f1a4359e700 1 --2- 172.21.15.146:0/4204745685 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a4415a7f0 0x7f1a440ae4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:30.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.847+0000 7f1a4359e700 1 --2- 172.21.15.146:0/4204745685 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a440b2360 0x7f1a441698d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:30.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.847+0000 7f1a4359e700 1 --2- 172.21.15.146:0/4204745685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a4415a420 0x7f1a4414a510 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:30.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.847+0000 7f1a4359e700 1 -- 172.21.15.146:0/4204745685 >> 172.21.15.146:0/4204745685 conn(0x7f1a4406eba0 msgr2=0x7f1a440cfec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:30.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.847+0000 7f1a4359e700 1 -- 172.21.15.146:0/4204745685 shutdown_connections 2023-10-06T11:08:30.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.847+0000 7f1a4359e700 1 -- 172.21.15.146:0/4204745685 wait complete. 2023-10-06T11:08:30.861 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T11:08:30.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.975+0000 7fafa89af700 1 Processor -- start 2023-10-06T11:08:30.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.975+0000 7fafa89af700 1 -- start start 2023-10-06T11:08:30.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.976+0000 7fafa89af700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fafa415a160 0x7fafa40c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:30.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.976+0000 7fafa89af700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafa40ae2a0 con 0x7fafa40cb950 2023-10-06T11:08:30.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.976+0000 7fafa89af700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafa415a530 con 0x7fafa40ae730 2023-10-06T11:08:30.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.976+0000 7fafa89af700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafa40ad690 con 0x7fafa415a160 2023-10-06T11:08:30.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.976+0000 7fafa2d9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fafa40cb950 0x7fafa40cbd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35176/0 (socket says 172.21.15.146:35176) 2023-10-06T11:08:30.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.976+0000 7fafa2d9d700 1 -- 172.21.15.146:0/2304290498 learned_addr learned my addr 172.21.15.146:0/2304290498 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:08:30.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.976+0000 7fafa259c700 1 --2- 172.21.15.146:0/2304290498 >> v2:172.21.15.151:3300/0 conn(0x7fafa415a160 0x7fafa40c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:30.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.977+0000 7fafa1d9b700 1 -- 172.21.15.146:0/2304290498 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4232919886 0 0) 0x7fafa40ae2a0 con 0x7fafa40cb950 2023-10-06T11:08:30.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.977+0000 7fafa1d9b700 1 -- 172.21.15.146:0/2304290498 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf90003570 con 0x7fafa40cb950 2023-10-06T11:08:30.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.977+0000 7fafa1d9b700 1 -- 172.21.15.146:0/2304290498 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3931143191 0 0) 0x7faf90003570 con 0x7fafa40cb950 2023-10-06T11:08:30.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.977+0000 7fafa1d9b700 1 -- 172.21.15.146:0/2304290498 >> v2:172.21.15.151:3300/0 conn(0x7fafa415a160 msgr2=0x7fafa40c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:30.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.977+0000 7fafa1d9b700 1 --2- 172.21.15.146:0/2304290498 >> v2:172.21.15.151:3300/0 conn(0x7fafa415a160 0x7fafa40c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:30.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.977+0000 7fafa1d9b700 1 -- 172.21.15.146:0/2304290498 >> v1:172.21.15.151:6789/0 conn(0x7fafa40ae730 legacy=0x7fafa40aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:30.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.977+0000 7fafa1d9b700 1 -- 172.21.15.146:0/2304290498 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa40ad970 con 0x7fafa40cb950 2023-10-06T11:08:30.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.977+0000 7fafa1d9b700 1 -- 172.21.15.146:0/2304290498 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7faf9c0017f0 con 0x7fafa40cb950 2023-10-06T11:08:30.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.977+0000 7fafa1d9b700 1 -- 172.21.15.146:0/2304290498 >> v1:172.21.15.146:6789/0 conn(0x7fafa40cb950 legacy=0x7fafa40cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:30.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.977+0000 7fafa1d9b700 1 --2- 172.21.15.146:0/2304290498 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf90003a60 0x7faf90003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:30.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.977+0000 7fafa1d9b700 1 --2- 172.21.15.146:0/2304290498 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf90004810 0x7faf90004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:30.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.977+0000 7fafa1d9b700 1 --2- 172.21.15.146:0/2304290498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf900051c0 0x7faf9000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:30.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.977+0000 7fafa1d9b700 1 -- 172.21.15.146:0/2304290498 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa40ad690 con 0x7faf900051c0 2023-10-06T11:08:30.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.977+0000 7fafa1d9b700 1 -- 172.21.15.146:0/2304290498 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9000c0d0 con 0x7faf90003a60 2023-10-06T11:08:30.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.977+0000 7fafa1d9b700 1 -- 172.21.15.146:0/2304290498 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf9000c290 con 0x7faf90004810 2023-10-06T11:08:30.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.977+0000 7fafa2d9d700 1 --2- 172.21.15.146:0/2304290498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf900051c0 0x7faf9000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:30.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.977+0000 7fafa259c700 1 --2- 172.21.15.146:0/2304290498 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf90003a60 0x7faf90003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:30.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.977+0000 7faf99d9b700 1 --2- 172.21.15.146:0/2304290498 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf90004810 0x7faf90004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:30.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.977+0000 7fafa2d9d700 1 -- 172.21.15.146:0/2304290498 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf90004810 msgr2=0x7faf90004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:30.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.977+0000 7fafa2d9d700 1 --2- 172.21.15.146:0/2304290498 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faf90004810 0x7faf90004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:30.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.977+0000 7fafa2d9d700 1 -- 172.21.15.146:0/2304290498 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf90003a60 msgr2=0x7faf90003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:30.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.977+0000 7fafa2d9d700 1 --2- 172.21.15.146:0/2304290498 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf90003a60 0x7faf90003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:30.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.977+0000 7fafa2d9d700 1 -- 172.21.15.146:0/2304290498 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf90003570 con 0x7faf900051c0 2023-10-06T11:08:30.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.977+0000 7fafa2d9d700 1 -- 172.21.15.146:0/2304290498 reap_dead start 2023-10-06T11:08:30.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.977+0000 7fafa2d9d700 1 --2- 172.21.15.146:0/2304290498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf900051c0 0x7faf9000ba60 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7faf9c00a930 tx=0x7faf9c0021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f93c0a4ec4a539a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:30.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.978+0000 7fafa1d9b700 1 -- 172.21.15.146:0/2304290498 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c0070d0 con 0x7faf900051c0 2023-10-06T11:08:30.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.978+0000 7fafa1d9b700 1 -- 172.21.15.146:0/2304290498 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9c007230 con 0x7faf900051c0 2023-10-06T11:08:30.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.978+0000 7fafa1d9b700 1 -- 172.21.15.146:0/2304290498 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c0075d0 con 0x7faf900051c0 2023-10-06T11:08:30.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.978+0000 7fafa89af700 1 -- 172.21.15.146:0/2304290498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf900051c0 msgr2=0x7faf9000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:30.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.978+0000 7fafa89af700 1 --2- 172.21.15.146:0/2304290498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf900051c0 0x7faf9000ba60 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7faf9c00a930 tx=0x7faf9c0021d0 comp rx=0 tx=0).stop 2023-10-06T11:08:30.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.978+0000 7fafa89af700 1 -- 172.21.15.146:0/2304290498 shutdown_connections 2023-10-06T11:08:30.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.978+0000 7fafa89af700 1 --2- 172.21.15.146:0/2304290498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf900051c0 0x7faf9000ba60 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:30.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.978+0000 7fafa89af700 1 -- 172.21.15.146:0/2304290498 >> 172.21.15.146:0/2304290498 conn(0x7fafa406f380 msgr2=0x7fafa40d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:30.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.978+0000 7fafa89af700 1 -- 172.21.15.146:0/2304290498 shutdown_connections 2023-10-06T11:08:30.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.978+0000 7fafa89af700 1 -- 172.21.15.146:0/2304290498 wait complete. 2023-10-06T11:08:30.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.979+0000 7fafa89af700 1 Processor -- start 2023-10-06T11:08:30.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.979+0000 7fafa89af700 1 -- start start 2023-10-06T11:08:30.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.980+0000 7fafa89af700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf900051c0 0x7fafa40b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:30.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.980+0000 7fafa89af700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fafa409de20 0x7fafa40af5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:30.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.980+0000 7fafa89af700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafa40b3f70 0x7fafa40b43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:30.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.980+0000 7fafa89af700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa40b4930 con 0x7faf900051c0 2023-10-06T11:08:30.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.980+0000 7fafa89af700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa4149700 con 0x7fafa409de20 2023-10-06T11:08:30.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.980+0000 7fafa89af700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa409e290 con 0x7fafa40b3f70 2023-10-06T11:08:30.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.980+0000 7fafa259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf900051c0 0x7fafa40b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:30.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.980+0000 7fafa259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf900051c0 0x7fafa40b22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56554/0 (socket says 172.21.15.146:56554) 2023-10-06T11:08:30.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.980+0000 7fafa259c700 1 -- 172.21.15.146:0/3422593004 learned_addr learned my addr 172.21.15.146:0/3422593004 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:30.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.980+0000 7fafa2d9d700 1 --2- 172.21.15.146:0/3422593004 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafa40b3f70 0x7fafa40b43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:30.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.980+0000 7faf99d9b700 1 --2- 172.21.15.146:0/3422593004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fafa409de20 0x7fafa40af5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:30.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.980+0000 7fafa259c700 1 -- 172.21.15.146:0/3422593004 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafa40b3f70 msgr2=0x7fafa40b43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:30.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.980+0000 7fafa259c700 1 --2- 172.21.15.146:0/3422593004 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafa40b3f70 0x7fafa40b43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:30.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.980+0000 7fafa259c700 1 -- 172.21.15.146:0/3422593004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fafa409de20 msgr2=0x7fafa40af5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:30.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.980+0000 7fafa259c700 1 --2- 172.21.15.146:0/3422593004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fafa409de20 0x7fafa40af5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:30.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.980+0000 7fafa259c700 1 -- 172.21.15.146:0/3422593004 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa40afdd0 con 0x7faf900051c0 2023-10-06T11:08:30.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.980+0000 7fafa2d9d700 1 --2- 172.21.15.146:0/3422593004 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafa40b3f70 0x7fafa40b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:08:30.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.980+0000 7faf99d9b700 1 --2- 172.21.15.146:0/3422593004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fafa409de20 0x7fafa40af5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:08:30.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.981+0000 7fafa259c700 1 --2- 172.21.15.146:0/3422593004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf900051c0 0x7fafa40b22f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7faf94011a40 tx=0x7faf94009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:30.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.981+0000 7faf9affd700 1 -- 172.21.15.146:0/3422593004 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf94005c10 con 0x7faf900051c0 2023-10-06T11:08:30.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.981+0000 7faf9affd700 1 -- 172.21.15.146:0/3422593004 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf94005d70 con 0x7faf900051c0 2023-10-06T11:08:30.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.981+0000 7faf9affd700 1 -- 172.21.15.146:0/3422593004 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9400f900 con 0x7faf900051c0 2023-10-06T11:08:30.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.981+0000 7fafa89af700 1 -- 172.21.15.146:0/3422593004 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafa40b00b0 con 0x7faf900051c0 2023-10-06T11:08:30.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.981+0000 7fafa89af700 1 -- 172.21.15.146:0/3422593004 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafa4149390 con 0x7faf900051c0 2023-10-06T11:08:30.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.982+0000 7fafa89af700 1 -- 172.21.15.146:0/3422593004 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafa4068b60 con 0x7faf900051c0 2023-10-06T11:08:30.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.982+0000 7faf9affd700 1 -- 172.21.15.146:0/3422593004 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faf9400fd30 con 0x7faf900051c0 2023-10-06T11:08:30.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.982+0000 7faf9affd700 1 --2- 172.21.15.146:0/3422593004 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faf84066f30 0x7faf840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:30.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.983+0000 7faf99d9b700 1 --2- 172.21.15.146:0/3422593004 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faf84066f30 0x7faf840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:30.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.983+0000 7faf9affd700 1 -- 172.21.15.146:0/3422593004 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6115+0+0 (secure 0 0 0) 0x7faf94085030 con 0x7faf900051c0 2023-10-06T11:08:30.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.983+0000 7faf99d9b700 1 --2- 172.21.15.146:0/3422593004 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faf84066f30 0x7faf840693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7faf8c003b40 tx=0x7faf8c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:30.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:30.987+0000 7faf9affd700 1 -- 172.21.15.146:0/3422593004 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faf94052100 con 0x7faf900051c0 2023-10-06T11:08:31.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.215+0000 7fafa89af700 1 -- 172.21.15.146:0/3422593004 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fafa404c380 con 0x7faf900051c0 2023-10-06T11:08:31.217 INFO:tasks.ceph.mon.a.smithi146.stderr:2023-10-06T11:08:31.215+0000 7f011baa1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T11:08:31.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.219+0000 7faf9affd700 1 -- 172.21.15.146:0/3422593004 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v28) v1 ==== 161+0+0 (secure 0 0 0) 0x7faf94055720 con 0x7faf900051c0 2023-10-06T11:08:31.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.222+0000 7fafa89af700 1 -- 172.21.15.146:0/3422593004 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faf84066f30 msgr2=0x7faf840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:31.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.222+0000 7fafa89af700 1 --2- 172.21.15.146:0/3422593004 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faf84066f30 0x7faf840693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7faf8c003b40 tx=0x7faf8c009040 comp rx=0 tx=0).stop 2023-10-06T11:08:31.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.222+0000 7fafa89af700 1 -- 172.21.15.146:0/3422593004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf900051c0 msgr2=0x7fafa40b22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:31.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.222+0000 7fafa89af700 1 --2- 172.21.15.146:0/3422593004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf900051c0 0x7fafa40b22f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7faf94011a40 tx=0x7faf94009120 comp rx=0 tx=0).stop 2023-10-06T11:08:31.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.222+0000 7fafa89af700 1 -- 172.21.15.146:0/3422593004 shutdown_connections 2023-10-06T11:08:31.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.222+0000 7fafa89af700 1 --2- 172.21.15.146:0/3422593004 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faf84066f30 0x7faf840693e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:31.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.222+0000 7fafa89af700 1 --2- 172.21.15.146:0/3422593004 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafa40b3f70 0x7fafa40b43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:31.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.222+0000 7fafa89af700 1 --2- 172.21.15.146:0/3422593004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faf900051c0 0x7fafa40b22f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:31.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.222+0000 7fafa89af700 1 --2- 172.21.15.146:0/3422593004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fafa409de20 0x7fafa40af5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:31.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.222+0000 7fafa89af700 1 -- 172.21.15.146:0/3422593004 >> 172.21.15.146:0/3422593004 conn(0x7fafa406f380 msgr2=0x7fafa4069690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:31.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.222+0000 7fafa89af700 1 -- 172.21.15.146:0/3422593004 shutdown_connections 2023-10-06T11:08:31.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.222+0000 7fafa89af700 1 -- 172.21.15.146:0/3422593004 wait complete. 2023-10-06T11:08:31.225 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T11:08:31.237 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T11:08:31.256 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2023-10-06T11:08:31.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.355+0000 7feeff76e700 1 Processor -- start 2023-10-06T11:08:31.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.356+0000 7feeff76e700 1 -- start start 2023-10-06T11:08:31.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.357+0000 7feeff76e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feef80b2620 0x7feef806e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:31.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.357+0000 7feeff76e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7feef81571d0 0x7feef8157650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:31.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.357+0000 7feeff76e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feef80cb3c0 con 0x7feef80b29f0 2023-10-06T11:08:31.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.357+0000 7feeff76e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feef806fa70 con 0x7feef81571d0 2023-10-06T11:08:31.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.357+0000 7feeff76e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feef8157b90 con 0x7feef80b2620 2023-10-06T11:08:31.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.357+0000 7feefdd0b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7feef81571d0 0x7feef8157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:31.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.357+0000 7feefdd0b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7feef81571d0 0x7feef8157650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60838/0 (socket says 172.21.15.146:60838) 2023-10-06T11:08:31.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.357+0000 7feefdd0b700 1 -- 172.21.15.146:0/1142280854 learned_addr learned my addr 172.21.15.146:0/1142280854 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:31.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.357+0000 7feefd50a700 1 --2- 172.21.15.146:0/1142280854 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feef80b2620 0x7feef806e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:31.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.357+0000 7feefdd0b700 1 -- 172.21.15.146:0/1142280854 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feef80b2620 msgr2=0x7feef806e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:31.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.357+0000 7feefdd0b700 1 --2- 172.21.15.146:0/1142280854 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feef80b2620 0x7feef806e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:31.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.357+0000 7feefdd0b700 1 -- 172.21.15.146:0/1142280854 >> v1:172.21.15.151:6789/0 conn(0x7feef80b29f0 legacy=0x7feef815bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:31.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.357+0000 7feefdd0b700 1 -- 172.21.15.146:0/1142280854 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef806eef0 con 0x7feef81571d0 2023-10-06T11:08:31.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.357+0000 7feefdd0b700 1 --2- 172.21.15.146:0/1142280854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feef81571d0 0x7feef8157650 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7feef0009f20 tx=0x7feef0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eab054481234d10 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:31.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.357+0000 7feeeffff700 1 -- 172.21.15.146:0/1142280854 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef000e070 con 0x7feef81571d0 2023-10-06T11:08:31.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.357+0000 7feeeffff700 1 -- 172.21.15.146:0/1142280854 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef000b9d0 con 0x7feef81571d0 2023-10-06T11:08:31.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.357+0000 7feeeffff700 1 -- 172.21.15.146:0/1142280854 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef00092e0 con 0x7feef81571d0 2023-10-06T11:08:31.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.358+0000 7feeff76e700 1 -- 172.21.15.146:0/1142280854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feef81571d0 msgr2=0x7feef8157650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:31.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.358+0000 7feeff76e700 1 --2- 172.21.15.146:0/1142280854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feef81571d0 0x7feef8157650 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7feef0009f20 tx=0x7feef0009840 comp rx=0 tx=0).stop 2023-10-06T11:08:31.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.358+0000 7feeff76e700 1 -- 172.21.15.146:0/1142280854 shutdown_connections 2023-10-06T11:08:31.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.358+0000 7feeff76e700 1 --2- 172.21.15.146:0/1142280854 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feef81571d0 0x7feef8157650 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:31.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.358+0000 7feeff76e700 1 --2- 172.21.15.146:0/1142280854 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feef80b2620 0x7feef806e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:31.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.358+0000 7feeff76e700 1 -- 172.21.15.146:0/1142280854 >> 172.21.15.146:0/1142280854 conn(0x7feef8068580 msgr2=0x7feef8068980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:31.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.358+0000 7feeff76e700 1 -- 172.21.15.146:0/1142280854 shutdown_connections 2023-10-06T11:08:31.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.358+0000 7feeff76e700 1 -- 172.21.15.146:0/1142280854 wait complete. 2023-10-06T11:08:31.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.359+0000 7feeff76e700 1 Processor -- start 2023-10-06T11:08:31.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.359+0000 7feeff76e700 1 -- start start 2023-10-06T11:08:31.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.360+0000 7feeff76e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feef80b2620 0x7feef815a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:31.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.360+0000 7feeff76e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feef80b29f0 0x7feef8143d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:31.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.360+0000 7feeff76e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feef81571d0 0x7feef80ada80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:31.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.360+0000 7feeff76e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef815ad70 con 0x7feef80b29f0 2023-10-06T11:08:31.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.360+0000 7feeff76e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef80c20a0 con 0x7feef81571d0 2023-10-06T11:08:31.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.360+0000 7feeff76e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feef80c3cc0 con 0x7feef80b2620 2023-10-06T11:08:31.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.360+0000 7feefcd09700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feef80b29f0 0x7feef8143d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:31.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.360+0000 7feefcd09700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feef80b29f0 0x7feef8143d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60846/0 (socket says 172.21.15.146:60846) 2023-10-06T11:08:31.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.360+0000 7feefcd09700 1 -- 172.21.15.146:0/2079370598 learned_addr learned my addr 172.21.15.146:0/2079370598 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:31.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.360+0000 7feefd50a700 1 --2- 172.21.15.146:0/2079370598 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feef80b2620 0x7feef815a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:31.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.360+0000 7feefdd0b700 1 --2- 172.21.15.146:0/2079370598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feef81571d0 0x7feef80ada80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:31.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.360+0000 7feefcd09700 1 -- 172.21.15.146:0/2079370598 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feef80b2620 msgr2=0x7feef815a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:31.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.360+0000 7feefcd09700 1 --2- 172.21.15.146:0/2079370598 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feef80b2620 0x7feef815a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:31.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.360+0000 7feefcd09700 1 -- 172.21.15.146:0/2079370598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feef81571d0 msgr2=0x7feef80ada80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:31.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.360+0000 7feefcd09700 1 --2- 172.21.15.146:0/2079370598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feef81571d0 0x7feef80ada80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:31.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.360+0000 7feefcd09700 1 -- 172.21.15.146:0/2079370598 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef0009ae0 con 0x7feef80b29f0 2023-10-06T11:08:31.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.360+0000 7feefdd0b700 1 --2- 172.21.15.146:0/2079370598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feef81571d0 0x7feef80ada80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:08:31.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.361+0000 7feefcd09700 1 --2- 172.21.15.146:0/2079370598 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feef80b29f0 0x7feef8143d20 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7feee800c590 tx=0x7feee800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:31.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.361+0000 7feeed7fa700 1 -- 172.21.15.146:0/2079370598 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee8011590 con 0x7feef80b29f0 2023-10-06T11:08:31.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.361+0000 7feeed7fa700 1 -- 172.21.15.146:0/2079370598 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee80116f0 con 0x7feef80b29f0 2023-10-06T11:08:31.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.361+0000 7feeff76e700 1 -- 172.21.15.146:0/2079370598 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feef8167d90 con 0x7feef80b29f0 2023-10-06T11:08:31.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.361+0000 7feeed7fa700 1 -- 172.21.15.146:0/2079370598 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee8011ab0 con 0x7feef80b29f0 2023-10-06T11:08:31.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.361+0000 7feeff76e700 1 -- 172.21.15.146:0/2079370598 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feef8168350 con 0x7feef80b29f0 2023-10-06T11:08:31.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.362+0000 7feeff76e700 1 -- 172.21.15.146:0/2079370598 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feef80c2210 con 0x7feef80b29f0 2023-10-06T11:08:31.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.362+0000 7feeed7fa700 1 -- 172.21.15.146:0/2079370598 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feee801b3b0 con 0x7feef80b29f0 2023-10-06T11:08:31.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.362+0000 7feeed7fa700 1 --2- 172.21.15.146:0/2079370598 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feedc066f30 0x7feedc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:31.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.363+0000 7feefd50a700 1 --2- 172.21.15.146:0/2079370598 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feedc066f30 0x7feedc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:31.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.363+0000 7feeed7fa700 1 -- 172.21.15.146:0/2079370598 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6173+0+0 (secure 0 0 0) 0x7feee8083d00 con 0x7feef80b29f0 2023-10-06T11:08:31.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.363+0000 7feefd50a700 1 --2- 172.21.15.146:0/2079370598 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feedc066f30 0x7feedc0693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7feef8154660 tx=0x7feef4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:31.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.367+0000 7feeed7fa700 1 -- 172.21.15.146:0/2079370598 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feee8050da0 con 0x7feef80b29f0 2023-10-06T11:08:31.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:31.592+0000 7feeff76e700 1 -- 172.21.15.146:0/2079370598 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7feef804c380 con 0x7feef80b29f0 2023-10-06T11:08:32.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.219+0000 7feeed7fa700 1 -- 172.21.15.146:0/2079370598 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v29) v1 ==== 104+0+0 (secure 0 0 0) 0x7feee8017020 con 0x7feef80b29f0 2023-10-06T11:08:32.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.222+0000 7feeff76e700 1 -- 172.21.15.146:0/2079370598 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feedc066f30 msgr2=0x7feedc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:32.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.222+0000 7feeff76e700 1 --2- 172.21.15.146:0/2079370598 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feedc066f30 0x7feedc0693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7feef8154660 tx=0x7feef4008040 comp rx=0 tx=0).stop 2023-10-06T11:08:32.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.222+0000 7feeff76e700 1 -- 172.21.15.146:0/2079370598 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feef80b29f0 msgr2=0x7feef8143d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:32.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.222+0000 7feeff76e700 1 --2- 172.21.15.146:0/2079370598 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feef80b29f0 0x7feef8143d20 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7feee800c590 tx=0x7feee800c950 comp rx=0 tx=0).stop 2023-10-06T11:08:32.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.222+0000 7feeff76e700 1 -- 172.21.15.146:0/2079370598 shutdown_connections 2023-10-06T11:08:32.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.222+0000 7feeff76e700 1 --2- 172.21.15.146:0/2079370598 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feedc066f30 0x7feedc0693e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:32.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.222+0000 7feeff76e700 1 --2- 172.21.15.146:0/2079370598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feef81571d0 0x7feef80ada80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:32.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.222+0000 7feeff76e700 1 --2- 172.21.15.146:0/2079370598 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feef80b2620 0x7feef815a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:32.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.222+0000 7feeff76e700 1 --2- 172.21.15.146:0/2079370598 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feef80b29f0 0x7feef8143d20 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:32.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.222+0000 7feeff76e700 1 -- 172.21.15.146:0/2079370598 >> 172.21.15.146:0/2079370598 conn(0x7feef8068580 msgr2=0x7feef80ae8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:32.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.222+0000 7feeff76e700 1 -- 172.21.15.146:0/2079370598 shutdown_connections 2023-10-06T11:08:32.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.222+0000 7feeff76e700 1 -- 172.21.15.146:0/2079370598 wait complete. 2023-10-06T11:08:32.237 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T11:08:32.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.397+0000 7ff2b3674700 1 Processor -- start 2023-10-06T11:08:32.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.397+0000 7ff2b3674700 1 -- start start 2023-10-06T11:08:32.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.398+0000 7ff2b3674700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2ac15a160 0x7ff2ac0c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:32.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.398+0000 7ff2b3674700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff2ac0cb950 0x7ff2ac0cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:32.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.398+0000 7ff2b3674700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2ac0ae2a0 con 0x7ff2ac0ae730 2023-10-06T11:08:32.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.398+0000 7ff2b3674700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2ac15a530 con 0x7ff2ac0cb950 2023-10-06T11:08:32.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.398+0000 7ff2b3674700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ac0ad690 con 0x7ff2ac15a160 2023-10-06T11:08:32.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.398+0000 7ff2b1c11700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff2ac0cb950 0x7ff2ac0cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:32.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.398+0000 7ff2b0c0f700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff2ac0ae730 0x7ff2ac0aeb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45952/0 (socket says 172.21.15.146:45952) 2023-10-06T11:08:32.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.398+0000 7ff2b0c0f700 1 -- 172.21.15.146:0/3438313439 learned_addr learned my addr 172.21.15.146:0/3438313439 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:08:32.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.398+0000 7ff2b1c11700 1 -- 172.21.15.146:0/3438313439 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2ac15a160 msgr2=0x7ff2ac0c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:32.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.398+0000 7ff2b1410700 1 --2- 172.21.15.146:0/3438313439 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2ac15a160 0x7ff2ac0c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:32.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.398+0000 7ff2b1c11700 1 --2- 172.21.15.146:0/3438313439 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2ac15a160 0x7ff2ac0c55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:32.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.398+0000 7ff2b1c11700 1 -- 172.21.15.146:0/3438313439 >> v1:172.21.15.146:6789/0 conn(0x7ff2ac0ae730 legacy=0x7ff2ac0aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:32.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.398+0000 7ff2b1c11700 1 -- 172.21.15.146:0/3438313439 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2ac0ad970 con 0x7ff2ac0cb950 2023-10-06T11:08:32.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.398+0000 7ff2a3fff700 1 -- 172.21.15.146:0/3438313439 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1906643589 0 0) 0x7ff2ac0ae2a0 con 0x7ff2ac0ae730 2023-10-06T11:08:32.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.398+0000 7ff2b1c11700 1 --2- 172.21.15.146:0/3438313439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2ac0cb950 0x7ff2ac0cbdb0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8009e60 tx=0x7ff2a8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa3f66b727e611b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:32.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.398+0000 7ff2a3fff700 1 -- 172.21.15.146:0/3438313439 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a800e070 con 0x7ff2ac0cb950 2023-10-06T11:08:32.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.398+0000 7ff2a3fff700 1 -- 172.21.15.146:0/3438313439 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2a800bc30 con 0x7ff2ac0cb950 2023-10-06T11:08:32.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.399+0000 7ff2a3fff700 1 -- 172.21.15.146:0/3438313439 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a8012430 con 0x7ff2ac0cb950 2023-10-06T11:08:32.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.399+0000 7ff2b3674700 1 -- 172.21.15.146:0/3438313439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2ac0cb950 msgr2=0x7ff2ac0cbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:32.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.399+0000 7ff2b3674700 1 --2- 172.21.15.146:0/3438313439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2ac0cb950 0x7ff2ac0cbdb0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8009e60 tx=0x7ff2a8009780 comp rx=0 tx=0).stop 2023-10-06T11:08:32.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.399+0000 7ff2b3674700 1 -- 172.21.15.146:0/3438313439 shutdown_connections 2023-10-06T11:08:32.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.399+0000 7ff2b3674700 1 --2- 172.21.15.146:0/3438313439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2ac0cb950 0x7ff2ac0cbdb0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:32.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.399+0000 7ff2b3674700 1 --2- 172.21.15.146:0/3438313439 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2ac15a160 0x7ff2ac0c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:32.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.399+0000 7ff2b3674700 1 -- 172.21.15.146:0/3438313439 >> 172.21.15.146:0/3438313439 conn(0x7ff2ac06f380 msgr2=0x7ff2ac0d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:32.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.399+0000 7ff2b3674700 1 -- 172.21.15.146:0/3438313439 shutdown_connections 2023-10-06T11:08:32.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.399+0000 7ff2b3674700 1 -- 172.21.15.146:0/3438313439 wait complete. 2023-10-06T11:08:32.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.400+0000 7ff2b3674700 1 Processor -- start 2023-10-06T11:08:32.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.400+0000 7ff2b3674700 1 -- start start 2023-10-06T11:08:32.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.401+0000 7ff2b3674700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2ac0ae730 0x7ff2ac0afc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:32.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.401+0000 7ff2b3674700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2ac0cb950 0x7ff2ac0ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:32.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.401+0000 7ff2b3674700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2ac15a160 0x7ff2ac169fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:32.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.401+0000 7ff2b3674700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ac157650 con 0x7ff2ac15a160 2023-10-06T11:08:32.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.401+0000 7ff2b3674700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ac16a4e0 con 0x7ff2ac0ae730 2023-10-06T11:08:32.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.401+0000 7ff2b3674700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2ac0c8760 con 0x7ff2ac0cb950 2023-10-06T11:08:32.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.401+0000 7ff2b1c11700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2ac15a160 0x7ff2ac169fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:32.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.401+0000 7ff2b1c11700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2ac15a160 0x7ff2ac169fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60864/0 (socket says 172.21.15.146:60864) 2023-10-06T11:08:32.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.401+0000 7ff2b1c11700 1 -- 172.21.15.146:0/3326512079 learned_addr learned my addr 172.21.15.146:0/3326512079 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:32.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.401+0000 7ff2b1c11700 1 -- 172.21.15.146:0/3326512079 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2ac0cb950 msgr2=0x7ff2ac0ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:32.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.401+0000 7ff2b1c11700 1 --2- 172.21.15.146:0/3326512079 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2ac0cb950 0x7ff2ac0ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:32.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.401+0000 7ff2b1c11700 1 -- 172.21.15.146:0/3326512079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2ac0ae730 msgr2=0x7ff2ac0afc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:32.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.401+0000 7ff2b1c11700 1 --2- 172.21.15.146:0/3326512079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2ac0ae730 0x7ff2ac0afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:32.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.401+0000 7ff2b1c11700 1 -- 172.21.15.146:0/3326512079 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a8009a20 con 0x7ff2ac15a160 2023-10-06T11:08:32.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.402+0000 7ff2b1c11700 1 --2- 172.21.15.146:0/3326512079 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2ac15a160 0x7ff2ac169fa0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac088c60 tx=0x7ff2a8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:32.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.402+0000 7ff2a17fa700 1 -- 172.21.15.146:0/3326512079 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a801d630 con 0x7ff2ac15a160 2023-10-06T11:08:32.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.402+0000 7ff2a17fa700 1 -- 172.21.15.146:0/3326512079 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2a801d7b0 con 0x7ff2ac15a160 2023-10-06T11:08:32.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.402+0000 7ff2b3674700 1 -- 172.21.15.146:0/3326512079 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2ac0c8a40 con 0x7ff2ac15a160 2023-10-06T11:08:32.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.402+0000 7ff2a17fa700 1 -- 172.21.15.146:0/3326512079 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a801db70 con 0x7ff2ac15a160 2023-10-06T11:08:32.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.402+0000 7ff2b3674700 1 -- 172.21.15.146:0/3326512079 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2ac0c9000 con 0x7ff2ac15a160 2023-10-06T11:08:32.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.403+0000 7ff2b3674700 1 -- 172.21.15.146:0/3326512079 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2ac0c91f0 con 0x7ff2ac15a160 2023-10-06T11:08:32.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.403+0000 7ff2a17fa700 1 -- 172.21.15.146:0/3326512079 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff2a8024070 con 0x7ff2ac15a160 2023-10-06T11:08:32.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.403+0000 7ff2a17fa700 1 --2- 172.21.15.146:0/3326512079 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff290066f30 0x7ff2900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:32.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.404+0000 7ff2a17fa700 1 -- 172.21.15.146:0/3326512079 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6173+0+0 (secure 0 0 0) 0x7ff2a8087170 con 0x7ff2ac15a160 2023-10-06T11:08:32.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.404+0000 7ff2b1410700 1 --2- 172.21.15.146:0/3326512079 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff290066f30 0x7ff2900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:32.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.404+0000 7ff2b1410700 1 --2- 172.21.15.146:0/3326512079 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff290066f30 0x7ff2900693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4006fd0 tx=0x7ff2a4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:32.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.408+0000 7ff2a17fa700 1 -- 172.21.15.146:0/3326512079 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff2a8054170 con 0x7ff2ac15a160 2023-10-06T11:08:32.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:32.592+0000 7ff2b3674700 1 -- 172.21.15.146:0/3326512079 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff2ac04c380 con 0x7ff2ac15a160 2023-10-06T11:08:33.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.359+0000 7ff2a17fa700 1 -- 172.21.15.146:0/3326512079 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v37) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff2a8057790 con 0x7ff2ac15a160 2023-10-06T11:08:33.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.362+0000 7ff2b3674700 1 -- 172.21.15.146:0/3326512079 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff290066f30 msgr2=0x7ff2900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:33.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.362+0000 7ff2b3674700 1 --2- 172.21.15.146:0/3326512079 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff290066f30 0x7ff2900693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff2a4006fd0 tx=0x7ff2a4008040 comp rx=0 tx=0).stop 2023-10-06T11:08:33.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.362+0000 7ff2b3674700 1 -- 172.21.15.146:0/3326512079 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2ac15a160 msgr2=0x7ff2ac169fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:33.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.362+0000 7ff2b3674700 1 --2- 172.21.15.146:0/3326512079 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2ac15a160 0x7ff2ac169fa0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac088c60 tx=0x7ff2a8019000 comp rx=0 tx=0).stop 2023-10-06T11:08:33.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.362+0000 7ff2b3674700 1 -- 172.21.15.146:0/3326512079 shutdown_connections 2023-10-06T11:08:33.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.362+0000 7ff2b3674700 1 --2- 172.21.15.146:0/3326512079 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff290066f30 0x7ff2900693e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:33.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.362+0000 7ff2b3674700 1 --2- 172.21.15.146:0/3326512079 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2ac15a160 0x7ff2ac169fa0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:33.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.362+0000 7ff2b3674700 1 --2- 172.21.15.146:0/3326512079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2ac0ae730 0x7ff2ac0afc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:33.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.362+0000 7ff2b3674700 1 --2- 172.21.15.146:0/3326512079 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2ac0cb950 0x7ff2ac0ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:33.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.362+0000 7ff2b3674700 1 -- 172.21.15.146:0/3326512079 >> 172.21.15.146:0/3326512079 conn(0x7ff2ac06f380 msgr2=0x7ff2ac159370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:33.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.363+0000 7ff2b3674700 1 -- 172.21.15.146:0/3326512079 shutdown_connections 2023-10-06T11:08:33.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.363+0000 7ff2b3674700 1 -- 172.21.15.146:0/3326512079 wait complete. 2023-10-06T11:08:33.366 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' removed 2023-10-06T11:08:33.378 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T11:08:33.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.495+0000 7f771212b700 1 Processor -- start 2023-10-06T11:08:33.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.495+0000 7f771212b700 1 -- start start 2023-10-06T11:08:33.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.496+0000 7f771212b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f770c0ae730 0x7f770c0aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:33.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.496+0000 7f771212b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f770c0cb950 0x7f770c0cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:33.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.496+0000 7f771212b700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f770c0ae2a0 con 0x7f770c15a160 2023-10-06T11:08:33.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.496+0000 7f771212b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f770c15a530 con 0x7f770c0cb950 2023-10-06T11:08:33.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.496+0000 7f771212b700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f770c0c5cb0 con 0x7f770c0ae730 2023-10-06T11:08:33.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.496+0000 7f770bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f770c0cb950 0x7f770c0cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:33.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.496+0000 7f770bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f770c0cb950 0x7f770c0cbd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60884/0 (socket says 172.21.15.146:60884) 2023-10-06T11:08:33.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.496+0000 7f770bfff700 1 -- 172.21.15.146:0/771458654 learned_addr learned my addr 172.21.15.146:0/771458654 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:33.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.496+0000 7f770affd700 1 --2- 172.21.15.146:0/771458654 >> v2:172.21.15.151:3300/0 conn(0x7f770c0ae730 0x7f770c0aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:33.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.497+0000 7f770bfff700 1 -- 172.21.15.146:0/771458654 >> v2:172.21.15.151:3300/0 conn(0x7f770c0ae730 msgr2=0x7f770c0aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:33.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.497+0000 7f770bfff700 1 --2- 172.21.15.146:0/771458654 >> v2:172.21.15.151:3300/0 conn(0x7f770c0ae730 0x7f770c0aebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:33.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.497+0000 7f770bfff700 1 -- 172.21.15.146:0/771458654 >> v1:172.21.15.151:6789/0 conn(0x7f770c15a160 legacy=0x7f770c0c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:33.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.497+0000 7f770bfff700 1 -- 172.21.15.146:0/771458654 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f770c0af0f0 con 0x7f770c0cb950 2023-10-06T11:08:33.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.497+0000 7f770bfff700 1 --2- 172.21.15.146:0/771458654 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f770c0cb950 0x7f770c0cbd40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f770c0d16e0 tx=0x7f7704009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c81914372c9b5aa3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:33.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.497+0000 7f770a7fc700 1 -- 172.21.15.146:0/771458654 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770400b860 con 0x7f770c0cb950 2023-10-06T11:08:33.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.497+0000 7f770a7fc700 1 -- 172.21.15.146:0/771458654 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770400b9c0 con 0x7f770c0cb950 2023-10-06T11:08:33.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.497+0000 7f770a7fc700 1 -- 172.21.15.146:0/771458654 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770400bd60 con 0x7f770c0cb950 2023-10-06T11:08:33.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.497+0000 7f771212b700 1 -- 172.21.15.146:0/771458654 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f770c0cb950 msgr2=0x7f770c0cbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:33.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.497+0000 7f771212b700 1 --2- 172.21.15.146:0/771458654 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f770c0cb950 0x7f770c0cbd40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f770c0d16e0 tx=0x7f7704009250 comp rx=0 tx=0).stop 2023-10-06T11:08:33.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.497+0000 7f771212b700 1 -- 172.21.15.146:0/771458654 shutdown_connections 2023-10-06T11:08:33.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.497+0000 7f771212b700 1 --2- 172.21.15.146:0/771458654 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f770c0cb950 0x7f770c0cbd40 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:33.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.497+0000 7f771212b700 1 --2- 172.21.15.146:0/771458654 >> v2:172.21.15.151:3300/0 conn(0x7f770c0ae730 0x7f770c0aebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:33.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.497+0000 7f771212b700 1 -- 172.21.15.146:0/771458654 >> 172.21.15.146:0/771458654 conn(0x7f770c06f380 msgr2=0x7f770c0d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:33.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.498+0000 7f771212b700 1 -- 172.21.15.146:0/771458654 shutdown_connections 2023-10-06T11:08:33.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.498+0000 7f771212b700 1 -- 172.21.15.146:0/771458654 wait complete. 2023-10-06T11:08:33.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.499+0000 7f771212b700 1 Processor -- start 2023-10-06T11:08:33.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.499+0000 7f771212b700 1 -- start start 2023-10-06T11:08:33.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.499+0000 7f771212b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f770c0ae730 0x7f770c0b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:33.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.499+0000 7f771212b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f770c0cb950 0x7f770c14b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:33.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.499+0000 7f771212b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f770c15a160 0x7f770c0b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:33.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.499+0000 7f771212b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770c0afc40 con 0x7f770c0ae730 2023-10-06T11:08:33.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.500+0000 7f771212b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770c0af380 con 0x7f770c15a160 2023-10-06T11:08:33.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.500+0000 7f771212b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f770c0af5f0 con 0x7f770c0cb950 2023-10-06T11:08:33.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.500+0000 7f770b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f770c0ae730 0x7f770c0b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:33.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.500+0000 7f770b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f770c0ae730 0x7f770c0b00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60890/0 (socket says 172.21.15.146:60890) 2023-10-06T11:08:33.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.500+0000 7f770b7fe700 1 -- 172.21.15.146:0/3802246404 learned_addr learned my addr 172.21.15.146:0/3802246404 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:33.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.500+0000 7f770affd700 1 --2- 172.21.15.146:0/3802246404 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f770c0cb950 0x7f770c14b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:33.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.500+0000 7f770bfff700 1 --2- 172.21.15.146:0/3802246404 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f770c15a160 0x7f770c0b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:33.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.500+0000 7f770b7fe700 1 -- 172.21.15.146:0/3802246404 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f770c0cb950 msgr2=0x7f770c14b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:33.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.500+0000 7f770b7fe700 1 --2- 172.21.15.146:0/3802246404 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f770c0cb950 0x7f770c14b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:33.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.500+0000 7f770b7fe700 1 -- 172.21.15.146:0/3802246404 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f770c15a160 msgr2=0x7f770c0b0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:33.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.500+0000 7f770b7fe700 1 --2- 172.21.15.146:0/3802246404 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f770c15a160 0x7f770c0b0a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:33.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.500+0000 7f770b7fe700 1 -- 172.21.15.146:0/3802246404 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77040094f0 con 0x7f770c0ae730 2023-10-06T11:08:33.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.500+0000 7f770b7fe700 1 --2- 172.21.15.146:0/3802246404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f770c0ae730 0x7f770c0b00d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f76fc00cca0 tx=0x7f76fc001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:33.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.500+0000 7f76f37fe700 1 -- 172.21.15.146:0/3802246404 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76fc00ab30 con 0x7f770c0ae730 2023-10-06T11:08:33.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.500+0000 7f76f37fe700 1 -- 172.21.15.146:0/3802246404 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76fc00acb0 con 0x7f770c0ae730 2023-10-06T11:08:33.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.500+0000 7f771212b700 1 -- 172.21.15.146:0/3802246404 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f770c0af8d0 con 0x7f770c0ae730 2023-10-06T11:08:33.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.500+0000 7f76f37fe700 1 -- 172.21.15.146:0/3802246404 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76fc012670 con 0x7f770c0ae730 2023-10-06T11:08:33.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.500+0000 7f771212b700 1 -- 172.21.15.146:0/3802246404 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f770c157cf0 con 0x7f770c0ae730 2023-10-06T11:08:33.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.501+0000 7f771212b700 1 -- 172.21.15.146:0/3802246404 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f770c0aff20 con 0x7f770c0ae730 2023-10-06T11:08:33.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.502+0000 7f76f37fe700 1 -- 172.21.15.146:0/3802246404 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f76fc0129e0 con 0x7f770c0ae730 2023-10-06T11:08:33.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.502+0000 7f76f37fe700 1 --2- 172.21.15.146:0/3802246404 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f76f8066f30 0x7f76f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:33.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.502+0000 7f76f37fe700 1 -- 172.21.15.146:0/3802246404 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5735+0+0 (secure 0 0 0) 0x7f76fc084be0 con 0x7f770c0ae730 2023-10-06T11:08:33.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.502+0000 7f770affd700 1 --2- 172.21.15.146:0/3802246404 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f76f8066f30 0x7f76f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:33.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.502+0000 7f770affd700 1 --2- 172.21.15.146:0/3802246404 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f76f8066f30 0x7f76f80693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f770c0ce2c0 tx=0x7f7700008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:33.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.506+0000 7f76f37fe700 1 -- 172.21.15.146:0/3802246404 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f76fc051e30 con 0x7f770c0ae730 2023-10-06T11:08:33.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:33.690+0000 7f771212b700 1 -- 172.21.15.146:0/3802246404 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f770c068390 con 0x7f770c0ae730 2023-10-06T11:08:34.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.364+0000 7f76f37fe700 1 -- 172.21.15.146:0/3802246404 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v38) v1 ==== 169+0+0 (secure 0 0 0) 0x7f76fc055450 con 0x7f770c0ae730 2023-10-06T11:08:34.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.368+0000 7f771212b700 1 -- 172.21.15.146:0/3802246404 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f76f8066f30 msgr2=0x7f76f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:34.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.368+0000 7f771212b700 1 --2- 172.21.15.146:0/3802246404 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f76f8066f30 0x7f76f80693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f770c0ce2c0 tx=0x7f7700008040 comp rx=0 tx=0).stop 2023-10-06T11:08:34.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.368+0000 7f771212b700 1 -- 172.21.15.146:0/3802246404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f770c0ae730 msgr2=0x7f770c0b00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:34.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.368+0000 7f771212b700 1 --2- 172.21.15.146:0/3802246404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f770c0ae730 0x7f770c0b00d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f76fc00cca0 tx=0x7f76fc001af0 comp rx=0 tx=0).stop 2023-10-06T11:08:34.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.368+0000 7f771212b700 1 -- 172.21.15.146:0/3802246404 shutdown_connections 2023-10-06T11:08:34.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.368+0000 7f771212b700 1 --2- 172.21.15.146:0/3802246404 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f76f8066f30 0x7f76f80693e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:34.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.368+0000 7f771212b700 1 --2- 172.21.15.146:0/3802246404 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f770c15a160 0x7f770c0b0a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:34.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.368+0000 7f771212b700 1 --2- 172.21.15.146:0/3802246404 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f770c0ae730 0x7f770c0b00d0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:34.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.368+0000 7f771212b700 1 --2- 172.21.15.146:0/3802246404 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f770c0cb950 0x7f770c14b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:34.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.368+0000 7f771212b700 1 -- 172.21.15.146:0/3802246404 >> 172.21.15.146:0/3802246404 conn(0x7f770c06f380 msgr2=0x7f770c159700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:34.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.369+0000 7f771212b700 1 -- 172.21.15.146:0/3802246404 shutdown_connections 2023-10-06T11:08:34.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.369+0000 7f771212b700 1 -- 172.21.15.146:0/3802246404 wait complete. 2023-10-06T11:08:34.371 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' removed 2023-10-06T11:08:34.384 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T11:08:34.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.501+0000 7f2886e0a700 1 Processor -- start 2023-10-06T11:08:34.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.501+0000 7f2886e0a700 1 -- start start 2023-10-06T11:08:34.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.501+0000 7f2886e0a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f288015cc20 0x7f288015d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:34.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.501+0000 7f2886e0a700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f288015cff0 0x7f28800d0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:34.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.501+0000 7f2886e0a700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28800cf030 con 0x7f28800d0a80 2023-10-06T11:08:34.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.501+0000 7f2886e0a700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f288015e390 con 0x7f288015cff0 2023-10-06T11:08:34.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.501+0000 7f2886e0a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28800ced20 con 0x7f288015cc20 2023-10-06T11:08:34.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.502+0000 7f2877fff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f288015cff0 0x7f28800d0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:34.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.502+0000 7f2884ba6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f288015cc20 0x7f288015d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:34.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.502+0000 7f28853a7700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f28800d0a80 0x7f288015a890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:41594/0 (socket says 172.21.15.146:41594) 2023-10-06T11:08:34.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.502+0000 7f28853a7700 1 -- 172.21.15.146:0/2160187054 learned_addr learned my addr 172.21.15.146:0/2160187054 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:08:34.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.502+0000 7f2884ba6700 1 -- 172.21.15.146:0/2160187054 >> v2:172.21.15.151:3300/0 conn(0x7f288015cff0 msgr2=0x7f28800d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:34.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.502+0000 7f2884ba6700 1 --2- 172.21.15.146:0/2160187054 >> v2:172.21.15.151:3300/0 conn(0x7f288015cff0 0x7f28800d0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:34.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.502+0000 7f2884ba6700 1 -- 172.21.15.146:0/2160187054 >> v1:172.21.15.151:6789/0 conn(0x7f28800d0a80 legacy=0x7f288015a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:34.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.502+0000 7f2884ba6700 1 -- 172.21.15.146:0/2160187054 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28800d0ea0 con 0x7f288015cc20 2023-10-06T11:08:34.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.502+0000 7f2877fff700 1 --2- 172.21.15.146:0/2160187054 >> v2:172.21.15.151:3300/0 conn(0x7f288015cff0 0x7f28800d0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:08:34.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.502+0000 7f2884ba6700 1 --2- 172.21.15.146:0/2160187054 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f288015cc20 0x7f288015d460 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f287c009eb0 tx=0x7f287c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a65269fa402d00b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:34.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.502+0000 7f28777fe700 1 -- 172.21.15.146:0/2160187054 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c00e070 con 0x7f288015cc20 2023-10-06T11:08:34.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.503+0000 7f28777fe700 1 -- 172.21.15.146:0/2160187054 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287c00bc30 con 0x7f288015cc20 2023-10-06T11:08:34.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.503+0000 7f28777fe700 1 -- 172.21.15.146:0/2160187054 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c012430 con 0x7f288015cc20 2023-10-06T11:08:34.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.503+0000 7f2886e0a700 1 -- 172.21.15.146:0/2160187054 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f288015cc20 msgr2=0x7f288015d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:34.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.503+0000 7f2886e0a700 1 --2- 172.21.15.146:0/2160187054 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f288015cc20 0x7f288015d460 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f287c009eb0 tx=0x7f287c009780 comp rx=0 tx=0).stop 2023-10-06T11:08:34.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.503+0000 7f2886e0a700 1 -- 172.21.15.146:0/2160187054 shutdown_connections 2023-10-06T11:08:34.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.503+0000 7f2886e0a700 1 --2- 172.21.15.146:0/2160187054 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f288015cc20 0x7f288015d460 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:34.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.503+0000 7f2886e0a700 1 --2- 172.21.15.146:0/2160187054 >> v2:172.21.15.151:3300/0 conn(0x7f288015cff0 0x7f28800d0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:34.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.503+0000 7f2886e0a700 1 -- 172.21.15.146:0/2160187054 >> 172.21.15.146:0/2160187054 conn(0x7f288006eba0 msgr2=0x7f288006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:34.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.503+0000 7f2886e0a700 1 -- 172.21.15.146:0/2160187054 shutdown_connections 2023-10-06T11:08:34.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.503+0000 7f2886e0a700 1 -- 172.21.15.146:0/2160187054 wait complete. 2023-10-06T11:08:34.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.504+0000 7f2886e0a700 1 Processor -- start 2023-10-06T11:08:34.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.504+0000 7f2886e0a700 1 -- start start 2023-10-06T11:08:34.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.505+0000 7f2886e0a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28800d0a80 0x7f28800cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:34.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.505+0000 7f2886e0a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f288015cc20 0x7f28800c5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:34.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.505+0000 7f2886e0a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f288015cff0 0x7f28801561f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:34.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.505+0000 7f2886e0a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28800c6340 con 0x7f288015cc20 2023-10-06T11:08:34.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.505+0000 7f2886e0a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28800c58b0 con 0x7f288015cff0 2023-10-06T11:08:34.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.505+0000 7f2886e0a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28800c7040 con 0x7f28800d0a80 2023-10-06T11:08:34.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.505+0000 7f2877fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f288015cc20 0x7f28800c5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:34.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.505+0000 7f2877fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f288015cc20 0x7f28800c5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60896/0 (socket says 172.21.15.146:60896) 2023-10-06T11:08:34.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.505+0000 7f2877fff700 1 -- 172.21.15.146:0/3705354280 learned_addr learned my addr 172.21.15.146:0/3705354280 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:34.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.505+0000 7f2884ba6700 1 --2- 172.21.15.146:0/3705354280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28800d0a80 0x7f28800cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:34.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.505+0000 7f28853a7700 1 --2- 172.21.15.146:0/3705354280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f288015cff0 0x7f28801561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:34.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.506+0000 7f2877fff700 1 -- 172.21.15.146:0/3705354280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28800d0a80 msgr2=0x7f28800cbf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:34.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.506+0000 7f2877fff700 1 --2- 172.21.15.146:0/3705354280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28800d0a80 0x7f28800cbf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:34.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.506+0000 7f2877fff700 1 -- 172.21.15.146:0/3705354280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f288015cff0 msgr2=0x7f28801561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:34.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.506+0000 7f2877fff700 1 --2- 172.21.15.146:0/3705354280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f288015cff0 0x7f28801561f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:34.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.506+0000 7f2877fff700 1 -- 172.21.15.146:0/3705354280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2870009420 con 0x7f288015cc20 2023-10-06T11:08:34.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.506+0000 7f2877fff700 1 --2- 172.21.15.146:0/3705354280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f288015cc20 0x7f28800c5370 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f287000ec80 tx=0x7f28700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:34.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.506+0000 7f2874ff9700 1 -- 172.21.15.146:0/3705354280 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287000c850 con 0x7f288015cc20 2023-10-06T11:08:34.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.506+0000 7f2874ff9700 1 -- 172.21.15.146:0/3705354280 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287000c9b0 con 0x7f288015cc20 2023-10-06T11:08:34.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.506+0000 7f2886e0a700 1 -- 172.21.15.146:0/3705354280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f287c009a20 con 0x7f288015cc20 2023-10-06T11:08:34.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.506+0000 7f2874ff9700 1 -- 172.21.15.146:0/3705354280 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287000cd50 con 0x7f288015cc20 2023-10-06T11:08:34.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.506+0000 7f2886e0a700 1 -- 172.21.15.146:0/3705354280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28800c5aa0 con 0x7f288015cc20 2023-10-06T11:08:34.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.507+0000 7f2886e0a700 1 -- 172.21.15.146:0/3705354280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28800b5030 con 0x7f288015cc20 2023-10-06T11:08:34.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.507+0000 7f2874ff9700 1 -- 172.21.15.146:0/3705354280 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2870013680 con 0x7f288015cc20 2023-10-06T11:08:34.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.508+0000 7f2874ff9700 1 --2- 172.21.15.146:0/3705354280 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f286c066f30 0x7f286c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:34.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.508+0000 7f2874ff9700 1 -- 172.21.15.146:0/3705354280 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f28700843c0 con 0x7f288015cc20 2023-10-06T11:08:34.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.508+0000 7f2884ba6700 1 --2- 172.21.15.146:0/3705354280 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f286c066f30 0x7f286c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:34.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.508+0000 7f2884ba6700 1 --2- 172.21.15.146:0/3705354280 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f286c066f30 0x7f286c0693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f287c009eb0 tx=0x7f287c019000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:34.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.512+0000 7f2874ff9700 1 -- 172.21.15.146:0/3705354280 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f28700517d0 con 0x7f288015cc20 2023-10-06T11:08:34.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.696+0000 7f2886e0a700 1 -- 172.21.15.146:0/3705354280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f288004c380 con 0x7f288015cc20 2023-10-06T11:08:34.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.700+0000 7f2874ff9700 1 -- 172.21.15.146:0/3705354280 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2870054df0 con 0x7f288015cc20 2023-10-06T11:08:34.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.703+0000 7f2886e0a700 1 -- 172.21.15.146:0/3705354280 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f286c066f30 msgr2=0x7f286c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:34.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.703+0000 7f2886e0a700 1 --2- 172.21.15.146:0/3705354280 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f286c066f30 0x7f286c0693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f287c009eb0 tx=0x7f287c019000 comp rx=0 tx=0).stop 2023-10-06T11:08:34.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.703+0000 7f2886e0a700 1 -- 172.21.15.146:0/3705354280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f288015cc20 msgr2=0x7f28800c5370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:34.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.703+0000 7f2886e0a700 1 --2- 172.21.15.146:0/3705354280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f288015cc20 0x7f28800c5370 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f287000ec80 tx=0x7f28700091a0 comp rx=0 tx=0).stop 2023-10-06T11:08:34.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.703+0000 7f2886e0a700 1 -- 172.21.15.146:0/3705354280 shutdown_connections 2023-10-06T11:08:34.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.703+0000 7f2886e0a700 1 --2- 172.21.15.146:0/3705354280 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f286c066f30 0x7f286c0693e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:34.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.703+0000 7f2886e0a700 1 --2- 172.21.15.146:0/3705354280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f288015cff0 0x7f28801561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:34.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.703+0000 7f2886e0a700 1 --2- 172.21.15.146:0/3705354280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28800d0a80 0x7f28800cbf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:34.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.703+0000 7f2886e0a700 1 --2- 172.21.15.146:0/3705354280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f288015cc20 0x7f28800c5370 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:34.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.703+0000 7f2886e0a700 1 -- 172.21.15.146:0/3705354280 >> 172.21.15.146:0/3705354280 conn(0x7f288006eba0 msgr2=0x7f2880157120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:34.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.704+0000 7f2886e0a700 1 -- 172.21.15.146:0/3705354280 shutdown_connections 2023-10-06T11:08:34.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.704+0000 7f2886e0a700 1 -- 172.21.15.146:0/3705354280 wait complete. 2023-10-06T11:08:34.720 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir' 2023-10-06T11:08:34.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.833+0000 7fe4d283f700 1 Processor -- start 2023-10-06T11:08:34.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.833+0000 7fe4d283f700 1 -- start start 2023-10-06T11:08:34.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.834+0000 7fe4d283f700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe4cc153ab0 0x7fe4cc15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:34.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.834+0000 7fe4d283f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe4cc153e80 0x7fe4cc068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:34.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.834+0000 7fe4d283f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4cc15ac30 con 0x7fe4cc0689d0 2023-10-06T11:08:34.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.834+0000 7fe4d283f700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4cc068e50 con 0x7fe4cc153ab0 2023-10-06T11:08:34.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.834+0000 7fe4d283f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc0b4510 con 0x7fe4cc153e80 2023-10-06T11:08:34.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.834+0000 7fe4d0ddc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe4cc0689d0 0x7fe4cc15d270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45962/0 (socket says 172.21.15.146:45962) 2023-10-06T11:08:34.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.834+0000 7fe4d0ddc700 1 -- 172.21.15.146:0/1145223058 learned_addr learned my addr 172.21.15.146:0/1145223058 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:08:34.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.834+0000 7fe4caffd700 1 -- 172.21.15.146:0/1145223058 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 363779049 0 0) 0x7fe4c4001490 con 0x7fe4cc0689d0 2023-10-06T11:08:34.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.834+0000 7fe4caffd700 1 -- 172.21.15.146:0/1145223058 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4b4003570 con 0x7fe4cc0689d0 2023-10-06T11:08:34.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.834+0000 7fe4cb7fe700 1 --2- 172.21.15.146:0/1145223058 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe4cc153e80 0x7fe4cc068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:34.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.834+0000 7fe4cbfff700 1 --2- 172.21.15.146:0/1145223058 >> v2:172.21.15.151:3300/0 conn(0x7fe4cc153ab0 0x7fe4cc15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:34.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.835+0000 7fe4caffd700 1 -- 172.21.15.146:0/1145223058 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3009264158 0 0) 0x7fe4b4003570 con 0x7fe4cc0689d0 2023-10-06T11:08:34.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.835+0000 7fe4caffd700 1 -- 172.21.15.146:0/1145223058 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe4cc153e80 msgr2=0x7fe4cc068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:34.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.835+0000 7fe4caffd700 1 --2- 172.21.15.146:0/1145223058 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe4cc153e80 0x7fe4cc068490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:34.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.835+0000 7fe4caffd700 1 -- 172.21.15.146:0/1145223058 >> v2:172.21.15.151:3300/0 conn(0x7fe4cc153ab0 msgr2=0x7fe4cc15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:34.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.835+0000 7fe4caffd700 1 --2- 172.21.15.146:0/1145223058 >> v2:172.21.15.151:3300/0 conn(0x7fe4cc153ab0 0x7fe4cc15a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:34.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.835+0000 7fe4caffd700 1 -- 172.21.15.146:0/1145223058 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4cc0b6530 con 0x7fe4cc0689d0 2023-10-06T11:08:34.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.835+0000 7fe4caffd700 1 -- 172.21.15.146:0/1145223058 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fe4c4001980 con 0x7fe4cc0689d0 2023-10-06T11:08:34.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.835+0000 7fe4caffd700 1 -- 172.21.15.146:0/1145223058 >> v1:172.21.15.146:6789/0 conn(0x7fe4cc0689d0 legacy=0x7fe4cc15d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:34.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.835+0000 7fe4caffd700 1 --2- 172.21.15.146:0/1145223058 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe4b4003a60 0x7fe4b4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:34.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.835+0000 7fe4caffd700 1 --2- 172.21.15.146:0/1145223058 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe4cc153e80 0x7fe4b4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:34.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.835+0000 7fe4caffd700 1 --2- 172.21.15.146:0/1145223058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4b4004d50 0x7fe4b40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:34.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.835+0000 7fe4caffd700 1 -- 172.21.15.146:0/1145223058 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc068e50 con 0x7fe4b4004d50 2023-10-06T11:08:34.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.835+0000 7fe4caffd700 1 -- 172.21.15.146:0/1145223058 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc0b4510 con 0x7fe4b4003a60 2023-10-06T11:08:34.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.835+0000 7fe4caffd700 1 -- 172.21.15.146:0/1145223058 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b400ba60 con 0x7fe4cc153e80 2023-10-06T11:08:34.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.835+0000 7fe4d0ddc700 1 --2- 172.21.15.146:0/1145223058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4b4004d50 0x7fe4b40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:34.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.835+0000 7fe4cbfff700 1 --2- 172.21.15.146:0/1145223058 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe4b4003a60 0x7fe4b4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:34.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.835+0000 7fe4cb7fe700 1 --2- 172.21.15.146:0/1145223058 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe4cc153e80 0x7fe4b4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:34.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.835+0000 7fe4d0ddc700 1 -- 172.21.15.146:0/1145223058 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe4cc153e80 msgr2=0x7fe4b4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:34.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.835+0000 7fe4d0ddc700 1 --2- 172.21.15.146:0/1145223058 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe4cc153e80 0x7fe4b4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:34.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.835+0000 7fe4d0ddc700 1 -- 172.21.15.146:0/1145223058 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe4b4003a60 msgr2=0x7fe4b4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:34.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.835+0000 7fe4d0ddc700 1 --2- 172.21.15.146:0/1145223058 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe4b4003a60 0x7fe4b4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:34.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.835+0000 7fe4d0ddc700 1 -- 172.21.15.146:0/1145223058 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b4003570 con 0x7fe4b4004d50 2023-10-06T11:08:34.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.835+0000 7fe4d0ddc700 1 --2- 172.21.15.146:0/1145223058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4b4004d50 0x7fe4b40051c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe4c400aaf0 tx=0x7fe4cc159c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71a24b96659999cf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:34.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.835+0000 7fe4caffd700 1 -- 172.21.15.146:0/1145223058 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c400a480 con 0x7fe4b4004d50 2023-10-06T11:08:34.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.836+0000 7fe4caffd700 1 -- 172.21.15.146:0/1145223058 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c400c570 con 0x7fe4b4004d50 2023-10-06T11:08:34.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.836+0000 7fe4caffd700 1 -- 172.21.15.146:0/1145223058 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c400c910 con 0x7fe4b4004d50 2023-10-06T11:08:34.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.836+0000 7fe4d283f700 1 -- 172.21.15.146:0/1145223058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4b4004d50 msgr2=0x7fe4b40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:34.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.836+0000 7fe4d283f700 1 --2- 172.21.15.146:0/1145223058 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4b4004d50 0x7fe4b40051c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fe4c400aaf0 tx=0x7fe4cc159c70 comp rx=0 tx=0).stop 2023-10-06T11:08:34.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.836+0000 7fe4d0ddc700 1 -- 172.21.15.146:0/1145223058 reap_dead start 2023-10-06T11:08:34.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.836+0000 7fe4d283f700 1 -- 172.21.15.146:0/1145223058 shutdown_connections 2023-10-06T11:08:34.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.836+0000 7fe4d283f700 1 -- 172.21.15.146:0/1145223058 >> 172.21.15.146:0/1145223058 conn(0x7fe4cc06eba0 msgr2=0x7fe4cc06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:34.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.836+0000 7fe4d283f700 1 -- 172.21.15.146:0/1145223058 shutdown_connections 2023-10-06T11:08:34.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.836+0000 7fe4d283f700 1 -- 172.21.15.146:0/1145223058 wait complete. 2023-10-06T11:08:34.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.837+0000 7fe4d283f700 1 Processor -- start 2023-10-06T11:08:34.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.837+0000 7fe4d283f700 1 -- start start 2023-10-06T11:08:34.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.838+0000 7fe4d283f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe4cc13d110 0x7fe4cc15a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:34.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.838+0000 7fe4d283f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4cc14fbf0 0x7fe4cc158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:34.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.838+0000 7fe4d283f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe4cc158f60 0x7fe4cc1569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:34.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.838+0000 7fe4d283f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc15a030 con 0x7fe4cc14fbf0 2023-10-06T11:08:34.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.838+0000 7fe4d283f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc15aa00 con 0x7fe4cc13d110 2023-10-06T11:08:34.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.838+0000 7fe4d283f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4cc159420 con 0x7fe4cc158f60 2023-10-06T11:08:34.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.838+0000 7fe4cb7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4cc14fbf0 0x7fe4cc158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:34.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.838+0000 7fe4cb7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4cc14fbf0 0x7fe4cc158a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60918/0 (socket says 172.21.15.146:60918) 2023-10-06T11:08:34.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.838+0000 7fe4cb7fe700 1 -- 172.21.15.146:0/4133526622 learned_addr learned my addr 172.21.15.146:0/4133526622 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:34.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.838+0000 7fe4d0ddc700 1 --2- 172.21.15.146:0/4133526622 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe4cc158f60 0x7fe4cc1569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:34.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.838+0000 7fe4cbfff700 1 --2- 172.21.15.146:0/4133526622 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe4cc13d110 0x7fe4cc15a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:34.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.838+0000 7fe4cb7fe700 1 -- 172.21.15.146:0/4133526622 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe4cc158f60 msgr2=0x7fe4cc1569d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:34.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.838+0000 7fe4cb7fe700 1 --2- 172.21.15.146:0/4133526622 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe4cc158f60 0x7fe4cc1569d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:34.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.838+0000 7fe4cb7fe700 1 -- 172.21.15.146:0/4133526622 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe4cc13d110 msgr2=0x7fe4cc15a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:34.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.838+0000 7fe4cb7fe700 1 --2- 172.21.15.146:0/4133526622 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe4cc13d110 0x7fe4cc15a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:34.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.838+0000 7fe4cb7fe700 1 -- 172.21.15.146:0/4133526622 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4cc159700 con 0x7fe4cc14fbf0 2023-10-06T11:08:34.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.838+0000 7fe4d0ddc700 1 --2- 172.21.15.146:0/4133526622 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe4cc158f60 0x7fe4cc1569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:08:34.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.838+0000 7fe4cbfff700 1 --2- 172.21.15.146:0/4133526622 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe4cc13d110 0x7fe4cc15a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:08:34.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.839+0000 7fe4cb7fe700 1 --2- 172.21.15.146:0/4133526622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4cc14fbf0 0x7fe4cc158a20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0011b40 tx=0x7fe4c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:34.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.839+0000 7fe4b3fff700 1 -- 172.21.15.146:0/4133526622 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c000fa10 con 0x7fe4cc14fbf0 2023-10-06T11:08:34.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.839+0000 7fe4b3fff700 1 -- 172.21.15.146:0/4133526622 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c000fb70 con 0x7fe4cc14fbf0 2023-10-06T11:08:34.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.839+0000 7fe4d283f700 1 -- 172.21.15.146:0/4133526622 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4cc1599e0 con 0x7fe4cc14fbf0 2023-10-06T11:08:34.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.839+0000 7fe4b3fff700 1 -- 172.21.15.146:0/4133526622 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c001d480 con 0x7fe4cc14fbf0 2023-10-06T11:08:34.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.839+0000 7fe4d283f700 1 -- 172.21.15.146:0/4133526622 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4cc13d4e0 con 0x7fe4cc14fbf0 2023-10-06T11:08:34.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.840+0000 7fe4d283f700 1 -- 172.21.15.146:0/4133526622 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4cc13d7c0 con 0x7fe4cc14fbf0 2023-10-06T11:08:34.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.840+0000 7fe4b3fff700 1 -- 172.21.15.146:0/4133526622 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe4c001d870 con 0x7fe4cc14fbf0 2023-10-06T11:08:34.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.841+0000 7fe4b3fff700 1 --2- 172.21.15.146:0/4133526622 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe4b8066f30 0x7fe4b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:34.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.841+0000 7fe4cbfff700 1 --2- 172.21.15.146:0/4133526622 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe4b8066f30 0x7fe4b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:34.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.841+0000 7fe4b3fff700 1 -- 172.21.15.146:0/4133526622 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fe4c0018070 con 0x7fe4cc14fbf0 2023-10-06T11:08:34.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.841+0000 7fe4cbfff700 1 --2- 172.21.15.146:0/4133526622 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe4b8066f30 0x7fe4b80693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc006f00 tx=0x7fe4bc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:34.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:34.845+0000 7fe4b3fff700 1 -- 172.21.15.146:0/4133526622 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe4c00b65a0 con 0x7fe4cc14fbf0 2023-10-06T11:08:35.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.102+0000 7fe4d283f700 1 -- 172.21.15.146:0/4133526622 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]} v 0) v1 -- 0x7fe4cc04c380 con 0x7fe4cc14fbf0 2023-10-06T11:08:35.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.365+0000 7fe4b3fff700 1 -- 172.21.15.146:0/4133526622 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_flag_scrub_mdsdir"]}]=0 v143) v1 ==== 148+0+0 (secure 0 0 0) 0x7fe4c00220d0 con 0x7fe4cc14fbf0 2023-10-06T11:08:35.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.367+0000 7fe4d283f700 1 -- 172.21.15.146:0/4133526622 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe4b8066f30 msgr2=0x7fe4b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:35.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.367+0000 7fe4d283f700 1 --2- 172.21.15.146:0/4133526622 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe4b8066f30 0x7fe4b80693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc006f00 tx=0x7fe4bc008040 comp rx=0 tx=0).stop 2023-10-06T11:08:35.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.367+0000 7fe4d283f700 1 -- 172.21.15.146:0/4133526622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4cc14fbf0 msgr2=0x7fe4cc158a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:35.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.367+0000 7fe4d283f700 1 --2- 172.21.15.146:0/4133526622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4cc14fbf0 0x7fe4cc158a20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0011b40 tx=0x7fe4c00091a0 comp rx=0 tx=0).stop 2023-10-06T11:08:35.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.367+0000 7fe4d283f700 1 -- 172.21.15.146:0/4133526622 shutdown_connections 2023-10-06T11:08:35.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.367+0000 7fe4d283f700 1 --2- 172.21.15.146:0/4133526622 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe4b8066f30 0x7fe4b80693e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:35.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.367+0000 7fe4d283f700 1 --2- 172.21.15.146:0/4133526622 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe4cc158f60 0x7fe4cc1569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:35.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.367+0000 7fe4d283f700 1 --2- 172.21.15.146:0/4133526622 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe4cc13d110 0x7fe4cc15a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:35.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.367+0000 7fe4d283f700 1 --2- 172.21.15.146:0/4133526622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4cc14fbf0 0x7fe4cc158a20 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:35.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.367+0000 7fe4d283f700 1 -- 172.21.15.146:0/4133526622 >> 172.21.15.146:0/4133526622 conn(0x7fe4cc06eba0 msgr2=0x7fe4cc151f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:35.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.367+0000 7fe4d283f700 1 -- 172.21.15.146:0/4133526622 shutdown_connections 2023-10-06T11:08:35.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.367+0000 7fe4d283f700 1 -- 172.21.15.146:0/4133526622 wait complete. 2023-10-06T11:08:35.382 INFO:tasks.cephfs_test_runner:test flag scrub_mdsdir ... ok 2023-10-06T11:08:35.382 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_checks (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2023-10-06T11:08:35.382 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks' 2023-10-06T11:08:35.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.494+0000 7fd75755f700 1 Processor -- start 2023-10-06T11:08:35.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.495+0000 7fd75755f700 1 -- start start 2023-10-06T11:08:35.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.495+0000 7fd75755f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd750153ab0 0x7fd75015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:35.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.495+0000 7fd75755f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd750068ba0 0x7fd7500b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:35.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.495+0000 7fd75755f700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd75015ac30 con 0x7fd750153e80 2023-10-06T11:08:35.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.495+0000 7fd75755f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7500b4510 con 0x7fd750068ba0 2023-10-06T11:08:35.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.495+0000 7fd75755f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7500b6530 con 0x7fd750153ab0 2023-10-06T11:08:35.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.496+0000 7fd755afc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd750068ba0 0x7fd7500b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:35.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.496+0000 7fd755afc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd750068ba0 0x7fd7500b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60924/0 (socket says 172.21.15.146:60924) 2023-10-06T11:08:35.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.496+0000 7fd755afc700 1 -- 172.21.15.146:0/2186493898 learned_addr learned my addr 172.21.15.146:0/2186493898 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:35.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.496+0000 7fd7552fb700 1 --2- 172.21.15.146:0/2186493898 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd750153ab0 0x7fd75015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:35.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.496+0000 7fd755afc700 1 -- 172.21.15.146:0/2186493898 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd750153ab0 msgr2=0x7fd75015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:35.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.496+0000 7fd755afc700 1 --2- 172.21.15.146:0/2186493898 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd750153ab0 0x7fd75015a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:35.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.496+0000 7fd755afc700 1 -- 172.21.15.146:0/2186493898 >> v1:172.21.15.151:6789/0 conn(0x7fd750153e80 legacy=0x7fd750068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:35.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.496+0000 7fd755afc700 1 -- 172.21.15.146:0/2186493898 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7500b5c50 con 0x7fd750068ba0 2023-10-06T11:08:35.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.496+0000 7fd755afc700 1 --2- 172.21.15.146:0/2186493898 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd750068ba0 0x7fd7500b49a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd7480099b0 tx=0x7fd748009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaa9b920aecfee6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:35.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.496+0000 7fd747fff700 1 -- 172.21.15.146:0/2186493898 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd748009ea0 con 0x7fd750068ba0 2023-10-06T11:08:35.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.496+0000 7fd747fff700 1 -- 172.21.15.146:0/2186493898 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd74800b860 con 0x7fd750068ba0 2023-10-06T11:08:35.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.496+0000 7fd747fff700 1 -- 172.21.15.146:0/2186493898 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74800bc00 con 0x7fd750068ba0 2023-10-06T11:08:35.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.497+0000 7fd75755f700 1 -- 172.21.15.146:0/2186493898 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd750068ba0 msgr2=0x7fd7500b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:35.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.497+0000 7fd75755f700 1 --2- 172.21.15.146:0/2186493898 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd750068ba0 0x7fd7500b49a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd7480099b0 tx=0x7fd748009250 comp rx=0 tx=0).stop 2023-10-06T11:08:35.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.497+0000 7fd75755f700 1 -- 172.21.15.146:0/2186493898 shutdown_connections 2023-10-06T11:08:35.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.497+0000 7fd75755f700 1 --2- 172.21.15.146:0/2186493898 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd750068ba0 0x7fd7500b49a0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:35.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.497+0000 7fd75755f700 1 --2- 172.21.15.146:0/2186493898 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd750153ab0 0x7fd75015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:35.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.497+0000 7fd75755f700 1 -- 172.21.15.146:0/2186493898 >> 172.21.15.146:0/2186493898 conn(0x7fd75006eba0 msgr2=0x7fd75006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:35.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.497+0000 7fd75755f700 1 -- 172.21.15.146:0/2186493898 shutdown_connections 2023-10-06T11:08:35.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.497+0000 7fd75755f700 1 -- 172.21.15.146:0/2186493898 wait complete. 2023-10-06T11:08:35.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.498+0000 7fd75755f700 1 Processor -- start 2023-10-06T11:08:35.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.498+0000 7fd75755f700 1 -- start start 2023-10-06T11:08:35.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.499+0000 7fd75755f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd750068ba0 0x7fd750147140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:35.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.499+0000 7fd75755f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd750153ab0 0x7fd75014b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:35.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.499+0000 7fd75755f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd750153e80 0x7fd7501526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:35.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.499+0000 7fd75755f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75014e0b0 con 0x7fd750153e80 2023-10-06T11:08:35.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.499+0000 7fd75755f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75014d4a0 con 0x7fd750068ba0 2023-10-06T11:08:35.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.499+0000 7fd75755f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd75014d780 con 0x7fd750153ab0 2023-10-06T11:08:35.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.499+0000 7fd755afc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd750153e80 0x7fd7501526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:35.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.499+0000 7fd755afc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd750153e80 0x7fd7501526e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60932/0 (socket says 172.21.15.146:60932) 2023-10-06T11:08:35.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.499+0000 7fd755afc700 1 -- 172.21.15.146:0/4169735256 learned_addr learned my addr 172.21.15.146:0/4169735256 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:35.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.499+0000 7fd754afa700 1 --2- 172.21.15.146:0/4169735256 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd750153ab0 0x7fd75014b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:35.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.499+0000 7fd7552fb700 1 --2- 172.21.15.146:0/4169735256 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd750068ba0 0x7fd750147140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:35.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.499+0000 7fd755afc700 1 -- 172.21.15.146:0/4169735256 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd750153ab0 msgr2=0x7fd75014b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:35.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.499+0000 7fd755afc700 1 --2- 172.21.15.146:0/4169735256 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd750153ab0 0x7fd75014b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:35.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.499+0000 7fd755afc700 1 -- 172.21.15.146:0/4169735256 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd750068ba0 msgr2=0x7fd750147140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:35.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.499+0000 7fd755afc700 1 --2- 172.21.15.146:0/4169735256 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd750068ba0 0x7fd750147140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:35.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.499+0000 7fd755afc700 1 -- 172.21.15.146:0/4169735256 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7480094f0 con 0x7fd750153e80 2023-10-06T11:08:35.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.499+0000 7fd7552fb700 1 --2- 172.21.15.146:0/4169735256 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd750068ba0 0x7fd750147140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:08:35.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.499+0000 7fd755afc700 1 --2- 172.21.15.146:0/4169735256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd750153e80 0x7fd7501526e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd7480099b0 tx=0x7fd748017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:35.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.500+0000 7fd7457fa700 1 -- 172.21.15.146:0/4169735256 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74800bb20 con 0x7fd750153e80 2023-10-06T11:08:35.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.500+0000 7fd7457fa700 1 -- 172.21.15.146:0/4169735256 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd748025420 con 0x7fd750153e80 2023-10-06T11:08:35.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.500+0000 7fd75755f700 1 -- 172.21.15.146:0/4169735256 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd75014da60 con 0x7fd750153e80 2023-10-06T11:08:35.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.500+0000 7fd7457fa700 1 -- 172.21.15.146:0/4169735256 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7480257c0 con 0x7fd750153e80 2023-10-06T11:08:35.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.500+0000 7fd75755f700 1 -- 172.21.15.146:0/4169735256 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd75014d150 con 0x7fd750153e80 2023-10-06T11:08:35.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.501+0000 7fd75755f700 1 -- 172.21.15.146:0/4169735256 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd75004c380 con 0x7fd750153e80 2023-10-06T11:08:35.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.501+0000 7fd7457fa700 1 -- 172.21.15.146:0/4169735256 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd748023070 con 0x7fd750153e80 2023-10-06T11:08:35.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.501+0000 7fd7457fa700 1 --2- 172.21.15.146:0/4169735256 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd734066f30 0x7fd7340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:35.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.501+0000 7fd7457fa700 1 -- 172.21.15.146:0/4169735256 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fd748085a80 con 0x7fd750153e80 2023-10-06T11:08:35.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.501+0000 7fd7552fb700 1 --2- 172.21.15.146:0/4169735256 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd734066f30 0x7fd7340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:35.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.502+0000 7fd7552fb700 1 --2- 172.21.15.146:0/4169735256 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd734066f30 0x7fd7340693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd750150610 tx=0x7fd74c00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:35.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.506+0000 7fd7457fa700 1 -- 172.21.15.146:0/4169735256 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd748052e90 con 0x7fd750153e80 2023-10-06T11:08:35.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:35.768+0000 7fd75755f700 1 -- 172.21.15.146:0/4169735256 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]} v 0) v1 -- 0x7fd75014e1f0 con 0x7fd750153e80 2023-10-06T11:08:36.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.367+0000 7fd7457fa700 1 -- 172.21.15.146:0/4169735256 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]}]=0 v144) v1 ==== 146+0+0 (secure 0 0 0) 0x7fd75014e1f0 con 0x7fd750153e80 2023-10-06T11:08:36.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.369+0000 7fd75755f700 1 -- 172.21.15.146:0/4169735256 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd734066f30 msgr2=0x7fd7340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:36.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.369+0000 7fd75755f700 1 --2- 172.21.15.146:0/4169735256 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd734066f30 0x7fd7340693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd750150610 tx=0x7fd74c00b040 comp rx=0 tx=0).stop 2023-10-06T11:08:36.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.369+0000 7fd75755f700 1 -- 172.21.15.146:0/4169735256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd750153e80 msgr2=0x7fd7501526e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:36.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.369+0000 7fd75755f700 1 --2- 172.21.15.146:0/4169735256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd750153e80 0x7fd7501526e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd7480099b0 tx=0x7fd748017000 comp rx=0 tx=0).stop 2023-10-06T11:08:36.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.370+0000 7fd75755f700 1 -- 172.21.15.146:0/4169735256 shutdown_connections 2023-10-06T11:08:36.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.370+0000 7fd75755f700 1 --2- 172.21.15.146:0/4169735256 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd734066f30 0x7fd7340693e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:36.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.370+0000 7fd75755f700 1 --2- 172.21.15.146:0/4169735256 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd750153e80 0x7fd7501526e0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:36.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.370+0000 7fd75755f700 1 --2- 172.21.15.146:0/4169735256 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd750068ba0 0x7fd750147140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:36.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.370+0000 7fd75755f700 1 --2- 172.21.15.146:0/4169735256 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd750153ab0 0x7fd75014b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:36.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.370+0000 7fd75755f700 1 -- 172.21.15.146:0/4169735256 >> 172.21.15.146:0/4169735256 conn(0x7fd75006eba0 msgr2=0x7fd750151f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:36.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.370+0000 7fd75755f700 1 -- 172.21.15.146:0/4169735256 shutdown_connections 2023-10-06T11:08:36.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.370+0000 7fd75755f700 1 -- 172.21.15.146:0/4169735256 wait complete. 2023-10-06T11:08:36.385 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T11:08:36.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.502+0000 7f315a161700 1 Processor -- start 2023-10-06T11:08:36.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.502+0000 7f315a161700 1 -- start start 2023-10-06T11:08:36.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.503+0000 7f315a161700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31541596e0 0x7f31540cb190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:36.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.503+0000 7f315a161700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f315406ef10 con 0x7f31540cb6d0 2023-10-06T11:08:36.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.503+0000 7f315a161700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31540cbb70 con 0x7f3154067b80 2023-10-06T11:08:36.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.503+0000 7f315a161700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31540cbe50 con 0x7f31541596e0 2023-10-06T11:08:36.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.503+0000 7f3152ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f31540cb6d0 0x7f3154067470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45964/0 (socket says 172.21.15.146:45964) 2023-10-06T11:08:36.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.503+0000 7f3152ffd700 1 -- 172.21.15.146:0/3744762116 learned_addr learned my addr 172.21.15.146:0/3744762116 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:08:36.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.503+0000 7f31527fc700 1 -- 172.21.15.146:0/3744762116 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1615583289 0 0) 0x7f315406ef10 con 0x7f31540cb6d0 2023-10-06T11:08:36.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.503+0000 7f31537fe700 1 --2- 172.21.15.146:0/3744762116 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31541596e0 0x7f31540cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:36.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.503+0000 7f31527fc700 1 -- 172.21.15.146:0/3744762116 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f313c003570 con 0x7f31540cb6d0 2023-10-06T11:08:36.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.503+0000 7f31527fc700 1 -- 172.21.15.146:0/3744762116 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1899187573 0 0) 0x7f313c003570 con 0x7f31540cb6d0 2023-10-06T11:08:36.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.503+0000 7f31527fc700 1 -- 172.21.15.146:0/3744762116 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31541596e0 msgr2=0x7f31540cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:36.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.503+0000 7f31527fc700 1 --2- 172.21.15.146:0/3744762116 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31541596e0 0x7f31540cb190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:36.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.503+0000 7f31527fc700 1 -- 172.21.15.146:0/3744762116 >> v1:172.21.15.151:6789/0 conn(0x7f3154067b80 legacy=0x7f315415d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:36.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.503+0000 7f31527fc700 1 -- 172.21.15.146:0/3744762116 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f315406e8c0 con 0x7f31540cb6d0 2023-10-06T11:08:36.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.503+0000 7f31527fc700 1 -- 172.21.15.146:0/3744762116 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f3148001470 con 0x7f31540cb6d0 2023-10-06T11:08:36.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.504+0000 7f31527fc700 1 -- 172.21.15.146:0/3744762116 >> v1:172.21.15.146:6789/0 conn(0x7f31540cb6d0 legacy=0x7f3154067470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:36.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.504+0000 7f31527fc700 1 --2- 172.21.15.146:0/3744762116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f313c003a90 0x7f313c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:36.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.504+0000 7f31527fc700 1 --2- 172.21.15.146:0/3744762116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f313c004810 0x7f313c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:36.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.504+0000 7f31527fc700 1 --2- 172.21.15.146:0/3744762116 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31541596e0 0x7f313c0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:36.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.504+0000 7f31527fc700 1 -- 172.21.15.146:0/3744762116 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31540cbe50 con 0x7f313c003a90 2023-10-06T11:08:36.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.504+0000 7f31527fc700 1 -- 172.21.15.146:0/3744762116 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f313c00bb60 con 0x7f313c004810 2023-10-06T11:08:36.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.504+0000 7f31527fc700 1 -- 172.21.15.146:0/3744762116 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f313c00bd20 con 0x7f31541596e0 2023-10-06T11:08:36.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.504+0000 7f31537fe700 1 --2- 172.21.15.146:0/3744762116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f313c003a90 0x7f313c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:36.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.504+0000 7f3152ffd700 1 --2- 172.21.15.146:0/3744762116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f313c004810 0x7f313c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:36.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.504+0000 7f3153fff700 1 --2- 172.21.15.146:0/3744762116 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31541596e0 0x7f313c0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:36.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.504+0000 7f31537fe700 1 -- 172.21.15.146:0/3744762116 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31541596e0 msgr2=0x7f313c0051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:36.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.504+0000 7f31537fe700 1 --2- 172.21.15.146:0/3744762116 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31541596e0 0x7f313c0051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:36.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.504+0000 7f31537fe700 1 -- 172.21.15.146:0/3744762116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f313c004810 msgr2=0x7f313c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:36.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.504+0000 7f31537fe700 1 --2- 172.21.15.146:0/3744762116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f313c004810 0x7f313c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:36.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.504+0000 7f31537fe700 1 -- 172.21.15.146:0/3744762116 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f313c003570 con 0x7f313c003a90 2023-10-06T11:08:36.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.504+0000 7f31537fe700 1 --2- 172.21.15.146:0/3744762116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f313c003a90 0x7f313c003ea0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3144009c00 tx=0x7f31440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc2837cbf8305329 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:36.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.504+0000 7f31527fc700 1 -- 172.21.15.146:0/3744762116 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314400e710 con 0x7f313c003a90 2023-10-06T11:08:36.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.504+0000 7f31527fc700 1 -- 172.21.15.146:0/3744762116 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f314400e870 con 0x7f313c003a90 2023-10-06T11:08:36.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.504+0000 7f31527fc700 1 -- 172.21.15.146:0/3744762116 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314400ec30 con 0x7f313c003a90 2023-10-06T11:08:36.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.505+0000 7f315a161700 1 -- 172.21.15.146:0/3744762116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f313c003a90 msgr2=0x7f313c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:36.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.505+0000 7f315a161700 1 --2- 172.21.15.146:0/3744762116 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f313c003a90 0x7f313c003ea0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3144009c00 tx=0x7f31440091a0 comp rx=0 tx=0).stop 2023-10-06T11:08:36.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.505+0000 7f3153fff700 1 -- 172.21.15.146:0/3744762116 reap_dead start 2023-10-06T11:08:36.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.505+0000 7f315a161700 1 -- 172.21.15.146:0/3744762116 shutdown_connections 2023-10-06T11:08:36.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.505+0000 7f315a161700 1 -- 172.21.15.146:0/3744762116 >> 172.21.15.146:0/3744762116 conn(0x7f3154069050 msgr2=0x7f31540cd300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:36.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.505+0000 7f315a161700 1 -- 172.21.15.146:0/3744762116 shutdown_connections 2023-10-06T11:08:36.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.505+0000 7f315a161700 1 -- 172.21.15.146:0/3744762116 wait complete. 2023-10-06T11:08:36.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.506+0000 7f315a161700 1 Processor -- start 2023-10-06T11:08:36.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.506+0000 7f315a161700 1 -- start start 2023-10-06T11:08:36.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.507+0000 7f315a161700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f313c003a90 0x7f315416a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:36.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.507+0000 7f315a161700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31540c5210 0x7f31541544f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:36.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.507+0000 7f315a161700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31540c69a0 0x7f31540c34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:36.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.507+0000 7f315a161700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31540c4d80 con 0x7f31540c5210 2023-10-06T11:08:36.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.507+0000 7f315a161700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31540c7240 con 0x7f31540c69a0 2023-10-06T11:08:36.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.507+0000 7f315a161700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31540c4450 con 0x7f313c003a90 2023-10-06T11:08:36.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.507+0000 7f3152ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31540c5210 0x7f31541544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:36.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.507+0000 7f3152ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31540c5210 0x7f31541544f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60938/0 (socket says 172.21.15.146:60938) 2023-10-06T11:08:36.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.507+0000 7f3152ffd700 1 -- 172.21.15.146:0/2537280072 learned_addr learned my addr 172.21.15.146:0/2537280072 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:36.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.507+0000 7f31537fe700 1 --2- 172.21.15.146:0/2537280072 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f313c003a90 0x7f315416a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:36.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.507+0000 7f3153fff700 1 --2- 172.21.15.146:0/2537280072 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31540c69a0 0x7f31540c34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:36.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.507+0000 7f3152ffd700 1 -- 172.21.15.146:0/2537280072 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f313c003a90 msgr2=0x7f315416a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:36.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.507+0000 7f3152ffd700 1 --2- 172.21.15.146:0/2537280072 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f313c003a90 0x7f315416a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:36.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.507+0000 7f3152ffd700 1 -- 172.21.15.146:0/2537280072 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31540c69a0 msgr2=0x7f31540c34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:36.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.507+0000 7f3152ffd700 1 --2- 172.21.15.146:0/2537280072 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31540c69a0 0x7f31540c34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:36.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.507+0000 7f3152ffd700 1 -- 172.21.15.146:0/2537280072 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31540c4730 con 0x7f31540c5210 2023-10-06T11:08:36.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.507+0000 7f3152ffd700 1 --2- 172.21.15.146:0/2537280072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31540c5210 0x7f31541544f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3148001c00 tx=0x7f315406ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:36.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.507+0000 7f313b7fe700 1 -- 172.21.15.146:0/2537280072 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314800f6c0 con 0x7f31540c5210 2023-10-06T11:08:36.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.508+0000 7f313b7fe700 1 -- 172.21.15.146:0/2537280072 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f314800f840 con 0x7f31540c5210 2023-10-06T11:08:36.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.508+0000 7f313b7fe700 1 -- 172.21.15.146:0/2537280072 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314800fc00 con 0x7f31540c5210 2023-10-06T11:08:36.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.508+0000 7f315a161700 1 -- 172.21.15.146:0/2537280072 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31540c4a10 con 0x7f31540c5210 2023-10-06T11:08:36.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.508+0000 7f315a161700 1 -- 172.21.15.146:0/2537280072 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31540c6e40 con 0x7f31540c5210 2023-10-06T11:08:36.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.509+0000 7f315a161700 1 -- 172.21.15.146:0/2537280072 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f315404c380 con 0x7f31540c5210 2023-10-06T11:08:36.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.509+0000 7f313b7fe700 1 -- 172.21.15.146:0/2537280072 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f314801d670 con 0x7f31540c5210 2023-10-06T11:08:36.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.509+0000 7f313b7fe700 1 --2- 172.21.15.146:0/2537280072 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3140066f30 0x7f31400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:36.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.509+0000 7f313b7fe700 1 -- 172.21.15.146:0/2537280072 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f3148084690 con 0x7f31540c5210 2023-10-06T11:08:36.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.510+0000 7f31537fe700 1 --2- 172.21.15.146:0/2537280072 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3140066f30 0x7f31400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:36.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.510+0000 7f31537fe700 1 --2- 172.21.15.146:0/2537280072 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3140066f30 0x7f31400693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f31440091e0 tx=0x7f314401a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:36.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.514+0000 7f313b7fe700 1 -- 172.21.15.146:0/2537280072 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3148051b60 con 0x7f31540c5210 2023-10-06T11:08:36.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.699+0000 7f315a161700 1 -- 172.21.15.146:0/2537280072 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f31540c4ec0 con 0x7f31540c5210 2023-10-06T11:08:36.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.702+0000 7f313b7fe700 1 -- 172.21.15.146:0/2537280072 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3148084030 con 0x7f31540c5210 2023-10-06T11:08:36.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.705+0000 7f315a161700 1 -- 172.21.15.146:0/2537280072 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3140066f30 msgr2=0x7f31400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:36.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.705+0000 7f315a161700 1 --2- 172.21.15.146:0/2537280072 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3140066f30 0x7f31400693e0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f31440091e0 tx=0x7f314401a000 comp rx=0 tx=0).stop 2023-10-06T11:08:36.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.705+0000 7f315a161700 1 -- 172.21.15.146:0/2537280072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31540c5210 msgr2=0x7f31541544f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:36.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.705+0000 7f315a161700 1 --2- 172.21.15.146:0/2537280072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31540c5210 0x7f31541544f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3148001c00 tx=0x7f315406ee80 comp rx=0 tx=0).stop 2023-10-06T11:08:36.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.705+0000 7f315a161700 1 -- 172.21.15.146:0/2537280072 shutdown_connections 2023-10-06T11:08:36.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.705+0000 7f315a161700 1 --2- 172.21.15.146:0/2537280072 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3140066f30 0x7f31400693e0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:36.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.705+0000 7f315a161700 1 --2- 172.21.15.146:0/2537280072 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31540c69a0 0x7f31540c34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:36.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.705+0000 7f315a161700 1 --2- 172.21.15.146:0/2537280072 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f313c003a90 0x7f315416a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:36.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.705+0000 7f315a161700 1 --2- 172.21.15.146:0/2537280072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31540c5210 0x7f31541544f0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:36.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.705+0000 7f315a161700 1 -- 172.21.15.146:0/2537280072 >> 172.21.15.146:0/2537280072 conn(0x7f3154069050 msgr2=0x7f31540c20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:36.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.705+0000 7f315a161700 1 -- 172.21.15.146:0/2537280072 shutdown_connections 2023-10-06T11:08:36.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.705+0000 7f315a161700 1 -- 172.21.15.146:0/2537280072 wait complete. 2023-10-06T11:08:36.719 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T11:08:36.719 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:08:36.758 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:08:36.801 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T11:08:36.801 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T11:08:36.802 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:08:36.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.914+0000 7fa300a8f700 1 Processor -- start 2023-10-06T11:08:36.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.914+0000 7fa300a8f700 1 -- start start 2023-10-06T11:08:36.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.915+0000 7fa300a8f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa2fc15a7f0 0x7fa2fc15cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:36.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.915+0000 7fa300a8f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2fc15c630 con 0x7fa2fc15a420 2023-10-06T11:08:36.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.915+0000 7fa300a8f700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2fc15ba20 con 0x7fa2fc0b2530 2023-10-06T11:08:36.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.915+0000 7fa300a8f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2fc0ce040 con 0x7fa2fc15a7f0 2023-10-06T11:08:36.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.915+0000 7fa2fb7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa2fc15a420 0x7fa2fc0b1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45968/0 (socket says 172.21.15.146:45968) 2023-10-06T11:08:36.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.915+0000 7fa2fb7fe700 1 -- 172.21.15.146:0/1678654049 learned_addr learned my addr 172.21.15.146:0/1678654049 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:08:36.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.915+0000 7fa2faffd700 1 --2- 172.21.15.146:0/1678654049 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa2fc15a7f0 0x7fa2fc15cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:36.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.915+0000 7fa2fa7fc700 1 -- 172.21.15.146:0/1678654049 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3826411525 0 0) 0x7fa2fc15ba20 con 0x7fa2fc0b2530 2023-10-06T11:08:36.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.915+0000 7fa2fa7fc700 1 -- 172.21.15.146:0/1678654049 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2e4003570 con 0x7fa2fc0b2530 2023-10-06T11:08:36.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.915+0000 7fa2faffd700 1 -- 172.21.15.146:0/1678654049 >> v1:172.21.15.151:6789/0 conn(0x7fa2fc0b2530 legacy=0x7fa2fc15acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:36.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.915+0000 7fa2faffd700 1 -- 172.21.15.146:0/1678654049 >> v1:172.21.15.146:6789/0 conn(0x7fa2fc15a420 legacy=0x7fa2fc0b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:36.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.915+0000 7fa2fa7fc700 1 -- 172.21.15.146:0/1678654049 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3262229663 0 0) 0x7fa2fc15c630 con 0x7fa2fc15a420 2023-10-06T11:08:36.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.916+0000 7fa2faffd700 1 -- 172.21.15.146:0/1678654049 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2fc15bd00 con 0x7fa2fc15a7f0 2023-10-06T11:08:36.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.916+0000 7fa2faffd700 1 --2- 172.21.15.146:0/1678654049 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa2fc15a7f0 0x7fa2fc15cac0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0009910 tx=0x7fa2f00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a28505a10c69aae server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:36.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.916+0000 7fa2fa7fc700 1 -- 172.21.15.146:0/1678654049 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f000b680 con 0x7fa2fc15a7f0 2023-10-06T11:08:36.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.916+0000 7fa2fa7fc700 1 -- 172.21.15.146:0/1678654049 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f000b7e0 con 0x7fa2fc15a7f0 2023-10-06T11:08:36.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.916+0000 7fa2fa7fc700 1 -- 172.21.15.146:0/1678654049 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f000bb60 con 0x7fa2fc15a7f0 2023-10-06T11:08:36.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.916+0000 7fa300a8f700 1 -- 172.21.15.146:0/1678654049 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa2fc15a7f0 msgr2=0x7fa2fc15cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:36.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.916+0000 7fa300a8f700 1 --2- 172.21.15.146:0/1678654049 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa2fc15a7f0 0x7fa2fc15cac0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0009910 tx=0x7fa2f00091a0 comp rx=0 tx=0).stop 2023-10-06T11:08:36.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.916+0000 7fa300a8f700 1 -- 172.21.15.146:0/1678654049 shutdown_connections 2023-10-06T11:08:36.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.916+0000 7fa300a8f700 1 --2- 172.21.15.146:0/1678654049 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa2fc15a7f0 0x7fa2fc15cac0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:36.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.916+0000 7fa300a8f700 1 -- 172.21.15.146:0/1678654049 >> 172.21.15.146:0/1678654049 conn(0x7fa2fc06eba0 msgr2=0x7fa2fc06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:36.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.916+0000 7fa300a8f700 1 -- 172.21.15.146:0/1678654049 shutdown_connections 2023-10-06T11:08:36.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.916+0000 7fa300a8f700 1 -- 172.21.15.146:0/1678654049 wait complete. 2023-10-06T11:08:36.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.918+0000 7fa300a8f700 1 Processor -- start 2023-10-06T11:08:36.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.918+0000 7fa300a8f700 1 -- start start 2023-10-06T11:08:36.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.918+0000 7fa300a8f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa2fc0b2530 0x7fa2fc1526a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:36.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.918+0000 7fa300a8f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2fc15a420 0x7fa2fc16a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:36.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.918+0000 7fa300a8f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2fc15a7f0 0x7fa2fc13eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:36.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.918+0000 7fa300a8f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2fc16abf0 con 0x7fa2fc15a7f0 2023-10-06T11:08:36.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.918+0000 7fa300a8f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2fc152da0 con 0x7fa2fc15a420 2023-10-06T11:08:36.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.918+0000 7fa300a8f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2fc13f410 con 0x7fa2fc0b2530 2023-10-06T11:08:36.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.919+0000 7fa2fbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2fc15a7f0 0x7fa2fc13eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:36.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.919+0000 7fa2fbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2fc15a7f0 0x7fa2fc13eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60942/0 (socket says 172.21.15.146:60942) 2023-10-06T11:08:36.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.919+0000 7fa2fbfff700 1 -- 172.21.15.146:0/2131568387 learned_addr learned my addr 172.21.15.146:0/2131568387 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:36.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.919+0000 7fa2fb7fe700 1 --2- 172.21.15.146:0/2131568387 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa2fc0b2530 0x7fa2fc1526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:36.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.919+0000 7fa2faffd700 1 --2- 172.21.15.146:0/2131568387 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2fc15a420 0x7fa2fc16a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:36.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.919+0000 7fa2fbfff700 1 -- 172.21.15.146:0/2131568387 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa2fc0b2530 msgr2=0x7fa2fc1526a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:36.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.919+0000 7fa2fbfff700 1 --2- 172.21.15.146:0/2131568387 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa2fc0b2530 0x7fa2fc1526a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:36.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.919+0000 7fa2fbfff700 1 -- 172.21.15.146:0/2131568387 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2fc15a420 msgr2=0x7fa2fc16a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:36.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.919+0000 7fa2fbfff700 1 --2- 172.21.15.146:0/2131568387 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2fc15a420 0x7fa2fc16a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:36.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.919+0000 7fa2fbfff700 1 -- 172.21.15.146:0/2131568387 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f0009420 con 0x7fa2fc15a7f0 2023-10-06T11:08:36.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.919+0000 7fa2fbfff700 1 --2- 172.21.15.146:0/2131568387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2fc15a7f0 0x7fa2fc13eed0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fa2f400c5f0 tx=0x7fa2f4007cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:36.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.919+0000 7fa2e37fe700 1 -- 172.21.15.146:0/2131568387 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f4011590 con 0x7fa2fc15a7f0 2023-10-06T11:08:36.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.919+0000 7fa2e37fe700 1 -- 172.21.15.146:0/2131568387 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f4011710 con 0x7fa2fc15a7f0 2023-10-06T11:08:36.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.919+0000 7fa300a8f700 1 -- 172.21.15.146:0/2131568387 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2fc151590 con 0x7fa2fc15a7f0 2023-10-06T11:08:36.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.919+0000 7fa2e37fe700 1 -- 172.21.15.146:0/2131568387 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f4011ad0 con 0x7fa2fc15a7f0 2023-10-06T11:08:36.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.919+0000 7fa300a8f700 1 -- 172.21.15.146:0/2131568387 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2fc150f40 con 0x7fa2fc15a7f0 2023-10-06T11:08:36.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.920+0000 7fa300a8f700 1 -- 172.21.15.146:0/2131568387 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2fc151720 con 0x7fa2fc15a7f0 2023-10-06T11:08:36.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.921+0000 7fa2e37fe700 1 -- 172.21.15.146:0/2131568387 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa2f4012420 con 0x7fa2fc15a7f0 2023-10-06T11:08:36.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.921+0000 7fa2e37fe700 1 --2- 172.21.15.146:0/2131568387 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa2e8066f30 0x7fa2e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:36.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.921+0000 7fa2e37fe700 1 -- 172.21.15.146:0/2131568387 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fa2f4083cf0 con 0x7fa2fc15a7f0 2023-10-06T11:08:36.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.921+0000 7fa2fb7fe700 1 --2- 172.21.15.146:0/2131568387 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa2e8066f30 0x7fa2e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:36.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.921+0000 7fa2fb7fe700 1 --2- 172.21.15.146:0/2131568387 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa2e8066f30 0x7fa2e80693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec002250 tx=0x7fa2ec001a20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:36.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:36.925+0000 7fa2e37fe700 1 -- 172.21.15.146:0/2131568387 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa2f4088070 con 0x7fa2fc15a7f0 2023-10-06T11:08:37.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.152+0000 7fa300a8f700 1 -- 172.21.15.146:0/2131568387 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2fc0b02b0 con 0x7fa2fc15a7f0 2023-10-06T11:08:37.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.152+0000 7fa2e37fe700 1 -- 172.21.15.146:0/2131568387 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+3541 (secure 0 0 0) 0x7fa2f4051100 con 0x7fa2fc15a7f0 2023-10-06T11:08:37.154 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:08:37.154 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":29,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4673,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/1243531288","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1243531288},{"type":"v1","addr":"172.21.15.151:6834","nonce":1243531288}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4676,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/4009288357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":4009288357},{"type":"v1","addr":"172.21.15.151:6835","nonce":4009288357}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4983,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2777930290","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2777930290},{"type":"v1","addr":"172.21.15.146:6836","nonce":2777930290}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5421,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3639970097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":3639970097},{"type":"v1","addr":"172.21.15.146:6837","nonce":3639970097}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[]} 2023-10-06T11:08:37.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.154+0000 7fa300a8f700 1 -- 172.21.15.146:0/2131568387 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa2e8066f30 msgr2=0x7fa2e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:37.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.154+0000 7fa300a8f700 1 --2- 172.21.15.146:0/2131568387 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa2e8066f30 0x7fa2e80693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec002250 tx=0x7fa2ec001a20 comp rx=0 tx=0).stop 2023-10-06T11:08:37.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.154+0000 7fa300a8f700 1 -- 172.21.15.146:0/2131568387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2fc15a7f0 msgr2=0x7fa2fc13eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:37.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.154+0000 7fa300a8f700 1 --2- 172.21.15.146:0/2131568387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2fc15a7f0 0x7fa2fc13eed0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fa2f400c5f0 tx=0x7fa2f4007cf0 comp rx=0 tx=0).stop 2023-10-06T11:08:37.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.154+0000 7fa300a8f700 1 -- 172.21.15.146:0/2131568387 shutdown_connections 2023-10-06T11:08:37.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.154+0000 7fa300a8f700 1 --2- 172.21.15.146:0/2131568387 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa2e8066f30 0x7fa2e80693e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:37.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.154+0000 7fa300a8f700 1 --2- 172.21.15.146:0/2131568387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2fc15a7f0 0x7fa2fc13eed0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:37.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.154+0000 7fa300a8f700 1 --2- 172.21.15.146:0/2131568387 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa2fc0b2530 0x7fa2fc1526a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:37.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.154+0000 7fa300a8f700 1 --2- 172.21.15.146:0/2131568387 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2fc15a420 0x7fa2fc16a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:37.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.154+0000 7fa300a8f700 1 -- 172.21.15.146:0/2131568387 >> 172.21.15.146:0/2131568387 conn(0x7fa2fc06eba0 msgr2=0x7fa2fc15d640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:37.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.154+0000 7fa300a8f700 1 -- 172.21.15.146:0/2131568387 shutdown_connections 2023-10-06T11:08:37.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.154+0000 7fa300a8f700 1 -- 172.21.15.146:0/2131568387 wait complete. 2023-10-06T11:08:37.157 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 29 2023-10-06T11:08:37.168 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T11:08:37.169 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T11:08:37.169 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T11:08:37.169 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:08:37.169 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T11:08:37.170 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T11:08:37.170 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T11:08:37.170 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:08:37.170 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T11:08:37.171 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T11:08:37.171 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T11:08:37.171 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:08:37.171 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T11:08:37.171 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T11:08:37.172 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T11:08:37.172 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:08:37.178 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T11:08:37.179 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T11:08:37.179 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T11:08:37.180 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T11:08:37.183 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T11:08:37.183 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T11:08:37.184 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T11:08:37.184 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T11:08:37.221 INFO:tasks.ceph.mds.a:Started 2023-10-06T11:08:37.221 DEBUG:teuthology.parallel:result is None 2023-10-06T11:08:37.221 INFO:tasks.ceph.mds.c:Started 2023-10-06T11:08:37.222 DEBUG:teuthology.parallel:result is None 2023-10-06T11:08:37.226 INFO:tasks.ceph.mds.d:Started 2023-10-06T11:08:37.226 DEBUG:teuthology.parallel:result is None 2023-10-06T11:08:37.227 INFO:tasks.ceph.mds.b:Started 2023-10-06T11:08:37.227 DEBUG:teuthology.parallel:result is None 2023-10-06T11:08:37.227 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T11:08:37.294 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2023-10-06T11:08:37.295 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2023-10-06T11:08:37.308 INFO:tasks.ceph.mds.d.smithi151.stdout:starting mds.d at 2023-10-06T11:08:37.309 INFO:tasks.ceph.mds.b.smithi151.stdout:starting mds.b at 2023-10-06T11:08:37.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.347+0000 7f135dbb0700 1 Processor -- start 2023-10-06T11:08:37.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.347+0000 7f135dbb0700 1 -- start start 2023-10-06T11:08:37.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.348+0000 7f135dbb0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f13580b2060 0x7f13580ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:37.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.348+0000 7f135dbb0700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f13580b2430 0x7f13580b5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:37.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.348+0000 7f135dbb0700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13580b4ec0 con 0x7f13580b3cf0 2023-10-06T11:08:37.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.348+0000 7f135dbb0700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13580b42b0 con 0x7f13580b2060 2023-10-06T11:08:37.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.348+0000 7f135dbb0700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13580b4590 con 0x7f13580b2430 2023-10-06T11:08:37.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.348+0000 7f135cbae700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f13580b2060 0x7f13580ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:37.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.348+0000 7f135cbae700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f13580b2060 0x7f13580ccd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60972/0 (socket says 172.21.15.146:60972) 2023-10-06T11:08:37.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.348+0000 7f135cbae700 1 -- 172.21.15.146:0/610285984 learned_addr learned my addr 172.21.15.146:0/610285984 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:37.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.348+0000 7f135d3af700 1 --2- 172.21.15.146:0/610285984 >> v2:172.21.15.151:3300/0 conn(0x7f13580b2430 0x7f13580b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:37.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.348+0000 7f135cbae700 1 -- 172.21.15.146:0/610285984 >> v2:172.21.15.151:3300/0 conn(0x7f13580b2430 msgr2=0x7f13580b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:37.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.348+0000 7f135cbae700 1 --2- 172.21.15.146:0/610285984 >> v2:172.21.15.151:3300/0 conn(0x7f13580b2430 0x7f13580b5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:37.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.348+0000 7f135cbae700 1 -- 172.21.15.146:0/610285984 >> v1:172.21.15.151:6789/0 conn(0x7f13580b3cf0 legacy=0x7f13580ce860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:37.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.348+0000 7f135cbae700 1 -- 172.21.15.146:0/610285984 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13580b4870 con 0x7f13580b2060 2023-10-06T11:08:37.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.348+0000 7f135d3af700 1 --2- 172.21.15.146:0/610285984 >> v2:172.21.15.151:3300/0 conn(0x7f13580b2430 0x7f13580b5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:08:37.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.349+0000 7f135cbae700 1 --2- 172.21.15.146:0/610285984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13580b2060 0x7f13580ccd60 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f13580cdb30 tx=0x7f1354009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5747246aa236320 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:37.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.349+0000 7f134f7fe700 1 -- 172.21.15.146:0/610285984 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135400b860 con 0x7f13580b2060 2023-10-06T11:08:37.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.349+0000 7f134f7fe700 1 -- 172.21.15.146:0/610285984 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135400b9c0 con 0x7f13580b2060 2023-10-06T11:08:37.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.349+0000 7f134f7fe700 1 -- 172.21.15.146:0/610285984 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135400bd60 con 0x7f13580b2060 2023-10-06T11:08:37.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.349+0000 7f135dbb0700 1 -- 172.21.15.146:0/610285984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13580b2060 msgr2=0x7f13580ccd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:37.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.349+0000 7f135dbb0700 1 --2- 172.21.15.146:0/610285984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13580b2060 0x7f13580ccd60 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f13580cdb30 tx=0x7f1354009250 comp rx=0 tx=0).stop 2023-10-06T11:08:37.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.349+0000 7f135dbb0700 1 -- 172.21.15.146:0/610285984 shutdown_connections 2023-10-06T11:08:37.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.349+0000 7f135dbb0700 1 --2- 172.21.15.146:0/610285984 >> v2:172.21.15.151:3300/0 conn(0x7f13580b2430 0x7f13580b5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:37.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.349+0000 7f135dbb0700 1 --2- 172.21.15.146:0/610285984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13580b2060 0x7f13580ccd60 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:37.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.349+0000 7f135dbb0700 1 -- 172.21.15.146:0/610285984 >> 172.21.15.146:0/610285984 conn(0x7f135806eba0 msgr2=0x7f135806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:37.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.349+0000 7f135dbb0700 1 -- 172.21.15.146:0/610285984 shutdown_connections 2023-10-06T11:08:37.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.349+0000 7f135dbb0700 1 -- 172.21.15.146:0/610285984 wait complete. 2023-10-06T11:08:37.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.350+0000 7f135dbb0700 1 Processor -- start 2023-10-06T11:08:37.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.351+0000 7f135dbb0700 1 -- start start 2023-10-06T11:08:37.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.351+0000 7f135dbb0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13580b2060 0x7f13580a7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:37.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.351+0000 7f135dbb0700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13580b2430 0x7f1358153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:37.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.351+0000 7f135dbb0700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f13580b3cf0 0x7f13580a7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:37.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.351+0000 7f135dbb0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13580a94d0 con 0x7f13580b2060 2023-10-06T11:08:37.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.351+0000 7f135dbb0700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13580aa330 con 0x7f13580b2430 2023-10-06T11:08:37.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.351+0000 7f135dbb0700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13580a7740 con 0x7f13580b3cf0 2023-10-06T11:08:37.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.351+0000 7f135cbae700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13580b2060 0x7f13580a7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:37.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.351+0000 7f135cbae700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13580b2060 0x7f13580a7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60988/0 (socket says 172.21.15.146:60988) 2023-10-06T11:08:37.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.351+0000 7f135cbae700 1 -- 172.21.15.146:0/2180511249 learned_addr learned my addr 172.21.15.146:0/2180511249 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:37.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.352+0000 7f135cbae700 1 -- 172.21.15.146:0/2180511249 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f13580b3cf0 msgr2=0x7f13580a7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:37.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.352+0000 7f135cbae700 1 --2- 172.21.15.146:0/2180511249 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f13580b3cf0 0x7f13580a7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:37.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.352+0000 7f135cbae700 1 -- 172.21.15.146:0/2180511249 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13580b2430 msgr2=0x7f1358153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:37.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.352+0000 7f135cbae700 1 --2- 172.21.15.146:0/2180511249 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13580b2430 0x7f1358153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:37.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.352+0000 7f135cbae700 1 -- 172.21.15.146:0/2180511249 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13540094f0 con 0x7f13580b2060 2023-10-06T11:08:37.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.352+0000 7f135cbae700 1 --2- 172.21.15.146:0/2180511249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13580b2060 0x7f13580a7200 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f13540090b0 tx=0x7f1354017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:37.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.352+0000 7f134cff9700 1 -- 172.21.15.146:0/2180511249 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1354011e20 con 0x7f13580b2060 2023-10-06T11:08:37.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.352+0000 7f134cff9700 1 -- 172.21.15.146:0/2180511249 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135401f070 con 0x7f13580b2060 2023-10-06T11:08:37.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.352+0000 7f135dbb0700 1 -- 172.21.15.146:0/2180511249 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1358153cc0 con 0x7f13580b2060 2023-10-06T11:08:37.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.352+0000 7f134cff9700 1 -- 172.21.15.146:0/2180511249 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135401a890 con 0x7f13580b2060 2023-10-06T11:08:37.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.352+0000 7f135dbb0700 1 -- 172.21.15.146:0/2180511249 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13580a9a00 con 0x7f13580b2060 2023-10-06T11:08:37.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.353+0000 7f135dbb0700 1 -- 172.21.15.146:0/2180511249 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13580cd660 con 0x7f13580b2060 2023-10-06T11:08:37.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.353+0000 7f134cff9700 1 -- 172.21.15.146:0/2180511249 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f135401ac00 con 0x7f13580b2060 2023-10-06T11:08:37.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.354+0000 7f134cff9700 1 --2- 172.21.15.146:0/2180511249 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1344066f30 0x7f13440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:37.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.354+0000 7f134cff9700 1 -- 172.21.15.146:0/2180511249 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f1354021070 con 0x7f13580b2060 2023-10-06T11:08:37.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.354+0000 7f134ffff700 1 --2- 172.21.15.146:0/2180511249 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1344066f30 0x7f13440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:37.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.354+0000 7f134ffff700 1 --2- 172.21.15.146:0/2180511249 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1344066f30 0x7f13440693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1358154d50 tx=0x7f1348007b40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:37.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.358+0000 7f134cff9700 1 -- 172.21.15.146:0/2180511249 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f13540537f0 con 0x7f13580b2060 2023-10-06T11:08:37.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:37.560+0000 7f135dbb0700 1 -- 172.21.15.146:0/2180511249 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f135804c380 con 0x7f13580b2060 2023-10-06T11:08:38.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.386+0000 7f134cff9700 1 -- 172.21.15.146:0/2180511249 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v43) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1354056e10 con 0x7f13580b2060 2023-10-06T11:08:38.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.389+0000 7f135dbb0700 1 -- 172.21.15.146:0/2180511249 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1344066f30 msgr2=0x7f13440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:38.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.389+0000 7f135dbb0700 1 --2- 172.21.15.146:0/2180511249 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1344066f30 0x7f13440693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1358154d50 tx=0x7f1348007b40 comp rx=0 tx=0).stop 2023-10-06T11:08:38.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.389+0000 7f135dbb0700 1 -- 172.21.15.146:0/2180511249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13580b2060 msgr2=0x7f13580a7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:38.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.389+0000 7f135dbb0700 1 --2- 172.21.15.146:0/2180511249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13580b2060 0x7f13580a7200 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f13540090b0 tx=0x7f1354017000 comp rx=0 tx=0).stop 2023-10-06T11:08:38.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.389+0000 7f135dbb0700 1 -- 172.21.15.146:0/2180511249 shutdown_connections 2023-10-06T11:08:38.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.389+0000 7f135dbb0700 1 --2- 172.21.15.146:0/2180511249 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1344066f30 0x7f13440693e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:38.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.389+0000 7f135dbb0700 1 --2- 172.21.15.146:0/2180511249 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f13580b3cf0 0x7f13580a7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:38.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.389+0000 7f135dbb0700 1 --2- 172.21.15.146:0/2180511249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13580b2060 0x7f13580a7200 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:38.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.389+0000 7f135dbb0700 1 --2- 172.21.15.146:0/2180511249 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13580b2430 0x7f1358153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:38.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.389+0000 7f135dbb0700 1 -- 172.21.15.146:0/2180511249 >> 172.21.15.146:0/2180511249 conn(0x7f135806eba0 msgr2=0x7f13581582c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:38.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.389+0000 7f135dbb0700 1 -- 172.21.15.146:0/2180511249 shutdown_connections 2023-10-06T11:08:38.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.389+0000 7f135dbb0700 1 -- 172.21.15.146:0/2180511249 wait complete. 2023-10-06T11:08:38.392 INFO:teuthology.orchestra.run.smithi146.stderr: removed all blocklist entries 2023-10-06T11:08:38.405 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T11:08:38.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.524+0000 7fe6ab3d1700 1 Processor -- start 2023-10-06T11:08:38.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.524+0000 7fe6ab3d1700 1 -- start start 2023-10-06T11:08:38.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.525+0000 7fe6ab3d1700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe6a4153ab0 0x7fe6a415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:38.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.525+0000 7fe6ab3d1700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6a4068ba0 0x7fe6a40b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:38.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.525+0000 7fe6ab3d1700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6a415ac30 con 0x7fe6a4153e80 2023-10-06T11:08:38.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.525+0000 7fe6ab3d1700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6a40b4510 con 0x7fe6a4153ab0 2023-10-06T11:08:38.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.525+0000 7fe6ab3d1700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a40b6530 con 0x7fe6a4068ba0 2023-10-06T11:08:38.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.525+0000 7fe6a916d700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe6a4153ab0 0x7fe6a415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:38.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.525+0000 7fe6a996e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6a4068ba0 0x7fe6a40b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:38.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.526+0000 7fe6a896c700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fe6a4153e80 0x7fe6a4068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:41666/0 (socket says 172.21.15.146:41666) 2023-10-06T11:08:38.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.526+0000 7fe6a896c700 1 -- 172.21.15.146:0/2132033561 learned_addr learned my addr 172.21.15.146:0/2132033561 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:08:38.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.526+0000 7fe6a916d700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe6a4153ab0 0x7fe6a415a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:38174/0 (socket says 172.21.15.146:38174) 2023-10-06T11:08:38.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.526+0000 7fe6a996e700 1 -- 172.21.15.146:0/2132033561 >> v2:172.21.15.151:3300/0 conn(0x7fe6a4153ab0 msgr2=0x7fe6a415a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:38.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.526+0000 7fe6a996e700 1 --2- 172.21.15.146:0/2132033561 >> v2:172.21.15.151:3300/0 conn(0x7fe6a4153ab0 0x7fe6a415a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:38.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.526+0000 7fe6a996e700 1 -- 172.21.15.146:0/2132033561 >> v1:172.21.15.151:6789/0 conn(0x7fe6a4153e80 legacy=0x7fe6a4068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:38.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.526+0000 7fe69bfff700 1 -- 172.21.15.146:0/2132033561 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3716716180 0 0) 0x7fe694001110 con 0x7fe6a4153e80 2023-10-06T11:08:38.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.526+0000 7fe6a996e700 1 -- 172.21.15.146:0/2132033561 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a40b5c50 con 0x7fe6a4068ba0 2023-10-06T11:08:38.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.526+0000 7fe6a916d700 1 --2- 172.21.15.146:0/2132033561 >> v2:172.21.15.151:3300/0 conn(0x7fe6a4153ab0 0x7fe6a415a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:08:38.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.526+0000 7fe6a996e700 1 --2- 172.21.15.146:0/2132033561 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6a4068ba0 0x7fe6a40b49a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe69c009e60 tx=0x7fe69c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da11e4d6b1499b53 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:38.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.526+0000 7fe69bfff700 1 -- 172.21.15.146:0/2132033561 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe69c00e070 con 0x7fe6a4068ba0 2023-10-06T11:08:38.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.526+0000 7fe69bfff700 1 -- 172.21.15.146:0/2132033561 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe69c00bb60 con 0x7fe6a4068ba0 2023-10-06T11:08:38.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.526+0000 7fe69bfff700 1 -- 172.21.15.146:0/2132033561 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe69c012430 con 0x7fe6a4068ba0 2023-10-06T11:08:38.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.527+0000 7fe6ab3d1700 1 -- 172.21.15.146:0/2132033561 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6a4068ba0 msgr2=0x7fe6a40b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:38.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.527+0000 7fe6ab3d1700 1 --2- 172.21.15.146:0/2132033561 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6a4068ba0 0x7fe6a40b49a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe69c009e60 tx=0x7fe69c009780 comp rx=0 tx=0).stop 2023-10-06T11:08:38.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.527+0000 7fe6ab3d1700 1 -- 172.21.15.146:0/2132033561 shutdown_connections 2023-10-06T11:08:38.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.527+0000 7fe6ab3d1700 1 --2- 172.21.15.146:0/2132033561 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6a4068ba0 0x7fe6a40b49a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:38.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.527+0000 7fe6ab3d1700 1 --2- 172.21.15.146:0/2132033561 >> v2:172.21.15.151:3300/0 conn(0x7fe6a4153ab0 0x7fe6a415a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:38.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.527+0000 7fe6ab3d1700 1 -- 172.21.15.146:0/2132033561 >> 172.21.15.146:0/2132033561 conn(0x7fe6a406eba0 msgr2=0x7fe6a406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:38.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.527+0000 7fe6ab3d1700 1 -- 172.21.15.146:0/2132033561 shutdown_connections 2023-10-06T11:08:38.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.527+0000 7fe6ab3d1700 1 -- 172.21.15.146:0/2132033561 wait complete. 2023-10-06T11:08:38.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.528+0000 7fe6ab3d1700 1 Processor -- start 2023-10-06T11:08:38.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.528+0000 7fe6ab3d1700 1 -- start start 2023-10-06T11:08:38.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.529+0000 7fe6ab3d1700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6a4068ba0 0x7fe6a41471b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:38.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.529+0000 7fe6ab3d1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6a4153ab0 0x7fe6a414fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:38.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.529+0000 7fe6ab3d1700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6a4153e80 0x7fe6a414b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:38.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.529+0000 7fe6ab3d1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a41476f0 con 0x7fe6a4153ab0 2023-10-06T11:08:38.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.529+0000 7fe6ab3d1700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a414f740 con 0x7fe6a4153e80 2023-10-06T11:08:38.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.529+0000 7fe6ab3d1700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6a414eb30 con 0x7fe6a4068ba0 2023-10-06T11:08:38.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.529+0000 7fe6a896c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6a4153ab0 0x7fe6a414fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:38.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.529+0000 7fe6a896c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6a4153ab0 0x7fe6a414fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60998/0 (socket says 172.21.15.146:60998) 2023-10-06T11:08:38.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.529+0000 7fe6a896c700 1 -- 172.21.15.146:0/454309875 learned_addr learned my addr 172.21.15.146:0/454309875 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:38.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.529+0000 7fe6a916d700 1 --2- 172.21.15.146:0/454309875 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6a4068ba0 0x7fe6a41471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:38.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.529+0000 7fe6a996e700 1 --2- 172.21.15.146:0/454309875 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6a4153e80 0x7fe6a414b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:38.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.529+0000 7fe6a896c700 1 -- 172.21.15.146:0/454309875 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6a4068ba0 msgr2=0x7fe6a41471b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:38.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.529+0000 7fe6a896c700 1 --2- 172.21.15.146:0/454309875 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6a4068ba0 0x7fe6a41471b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:38.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.529+0000 7fe6a896c700 1 -- 172.21.15.146:0/454309875 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6a4153e80 msgr2=0x7fe6a414b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:38.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.529+0000 7fe6a896c700 1 --2- 172.21.15.146:0/454309875 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6a4153e80 0x7fe6a414b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:38.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.529+0000 7fe6a896c700 1 -- 172.21.15.146:0/454309875 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6a0009420 con 0x7fe6a4153ab0 2023-10-06T11:08:38.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.529+0000 7fe6a896c700 1 --2- 172.21.15.146:0/454309875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6a4153ab0 0x7fe6a414fbd0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe69400c810 tx=0x7fe694007c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:38.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.530+0000 7fe6997fa700 1 -- 172.21.15.146:0/454309875 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe694005b30 con 0x7fe6a4153ab0 2023-10-06T11:08:38.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.530+0000 7fe6997fa700 1 -- 172.21.15.146:0/454309875 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe694005c90 con 0x7fe6a4153ab0 2023-10-06T11:08:38.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.530+0000 7fe6ab3d1700 1 -- 172.21.15.146:0/454309875 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe69c009a20 con 0x7fe6a4153ab0 2023-10-06T11:08:38.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.530+0000 7fe6997fa700 1 -- 172.21.15.146:0/454309875 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe694007300 con 0x7fe6a4153ab0 2023-10-06T11:08:38.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.530+0000 7fe6ab3d1700 1 -- 172.21.15.146:0/454309875 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6a414f170 con 0x7fe6a4153ab0 2023-10-06T11:08:38.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.531+0000 7fe6ab3d1700 1 -- 172.21.15.146:0/454309875 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6a414f8b0 con 0x7fe6a4153ab0 2023-10-06T11:08:38.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.531+0000 7fe6997fa700 1 -- 172.21.15.146:0/454309875 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe69401b3b0 con 0x7fe6a4153ab0 2023-10-06T11:08:38.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.531+0000 7fe6997fa700 1 --2- 172.21.15.146:0/454309875 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe688066f30 0x7fe6880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:38.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.531+0000 7fe6997fa700 1 -- 172.21.15.146:0/454309875 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fe6940836b0 con 0x7fe6a4153ab0 2023-10-06T11:08:38.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.531+0000 7fe6a916d700 1 --2- 172.21.15.146:0/454309875 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe688066f30 0x7fe6880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:38.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.532+0000 7fe6a916d700 1 --2- 172.21.15.146:0/454309875 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe688066f30 0x7fe6880693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0009f40 tx=0x7fe6a00091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:38.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.535+0000 7fe6997fa700 1 -- 172.21.15.146:0/454309875 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe694050b10 con 0x7fe6a4153ab0 2023-10-06T11:08:38.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.791+0000 7fe6ab3d1700 1 -- 172.21.15.146:0/454309875 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fe6a415bdb0 con 0x7fe6a4153ab0 2023-10-06T11:08:38.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.792+0000 7fe6997fa700 1 -- 172.21.15.146:0/454309875 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fe6a415bdb0 con 0x7fe6a4153ab0 2023-10-06T11:08:38.794 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:08:38.794 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:08:38.794 INFO:teuthology.orchestra.run.smithi146.stdout: "auth_dump": [ 2023-10-06T11:08:38.794 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:08:38.794 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.a", 2023-10-06T11:08:38.795 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lG4F8DBAAp5A4Dtfzvv8n9ORgkmiP9g==", 2023-10-06T11:08:38.795 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:08:38.795 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:08:38.795 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:08:38.795 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:08:38.795 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:08:38.796 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:08:38.796 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:38.796 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:08:38.796 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.b", 2023-10-06T11:08:38.796 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lDIceGBAA4cr0oGVaXiy5hrruKY5DGw==", 2023-10-06T11:08:38.796 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:08:38.796 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:08:38.796 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:08:38.796 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:08:38.796 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:08:38.797 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:08:38.797 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:38.797 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:08:38.797 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.c", 2023-10-06T11:08:38.797 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lbYA7ExAAAopKjS7+WMUE5fuVQygILQ==", 2023-10-06T11:08:38.797 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:08:38.797 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:08:38.797 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:08:38.797 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:08:38.797 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:08:38.797 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:08:38.797 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:38.798 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:08:38.798 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.d", 2023-10-06T11:08:38.798 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9laygiHxAAasUUn7Wk9EwLa36ggsZtHw==", 2023-10-06T11:08:38.798 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:08:38.798 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:08:38.798 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:08:38.798 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:08:38.798 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:08:38.798 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:08:38.798 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:38.798 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:08:38.798 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.0", 2023-10-06T11:08:38.799 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDX6R9lLGo9NhAAcWJuUeOdEUsdDw84W9nLPw==", 2023-10-06T11:08:38.799 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:08:38.799 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:08:38.799 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:08:38.799 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:08:38.799 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:08:38.799 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:38.799 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:08:38.799 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.1", 2023-10-06T11:08:38.799 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDa6R9lk02gNBAA9YqWT2/Xds20lv0sGtBApg==", 2023-10-06T11:08:38.799 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:08:38.799 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:08:38.799 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:08:38.800 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:08:38.800 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:08:38.800 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:38.800 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:08:38.800 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.2", 2023-10-06T11:08:38.800 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDd6R9lrA6xMxAAmH8r6m2p4Jpa82xfYNcq+g==", 2023-10-06T11:08:38.800 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:08:38.801 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:08:38.801 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:08:38.801 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:08:38.801 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:08:38.801 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:38.801 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:08:38.801 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.3", 2023-10-06T11:08:38.802 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDg6R9ltlHXNBAAvhfI1yjlaWCIE9Xr/4F/PA==", 2023-10-06T11:08:38.802 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:08:38.802 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:08:38.802 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:08:38.802 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:08:38.802 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:08:38.802 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:38.803 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:08:38.803 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.4", 2023-10-06T11:08:38.803 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDm6R9lPUCvMhAAGbUNfpoFi9SvYdelpnL1jA==", 2023-10-06T11:08:38.803 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:08:38.803 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:08:38.803 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:08:38.804 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:08:38.804 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:08:38.804 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:38.804 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:08:38.804 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.5", 2023-10-06T11:08:38.804 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDp6R9lMfrMMBAAUEtnXDNr7+L3dQm4QE9qDw==", 2023-10-06T11:08:38.805 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:08:38.805 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:08:38.805 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:08:38.805 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:08:38.805 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:08:38.805 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:38.806 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:08:38.806 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.6", 2023-10-06T11:08:38.806 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDs6R9lAmSDMBAArPp+6dVt/NyH9is46tL49g==", 2023-10-06T11:08:38.806 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:08:38.806 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:08:38.806 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:08:38.806 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:08:38.807 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:08:38.807 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:38.807 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:08:38.807 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.7", 2023-10-06T11:08:38.807 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDv6R9lnunMLRAA3o5ZtAyYDUoXTzjX9H8FCw==", 2023-10-06T11:08:38.807 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:08:38.807 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:08:38.807 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:08:38.808 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:08:38.808 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:08:38.808 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:38.808 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:08:38.808 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.0", 2023-10-06T11:08:38.808 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lCrPrIhAARrzj2VxVFkzF5L/ifIAqmw==", 2023-10-06T11:08:38.809 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:08:38.809 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:08:38.809 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow r", 2023-10-06T11:08:38.809 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T11:08:38.809 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:08:38.809 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:38.810 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:08:38.810 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.1", 2023-10-06T11:08:38.810 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9l10VSKxAA0HmXejgRRCQ7XpsMB7ljkQ==", 2023-10-06T11:08:38.810 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:08:38.810 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:08:38.810 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2023-10-06T11:08:38.810 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2023-10-06T11:08:38.811 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2023-10-06T11:08:38.811 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:08:38.811 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:38.811 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:08:38.811 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.2", 2023-10-06T11:08:38.811 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lpLpJKBAAF/vLDkBg9/VBqMK4pVVIkg==", 2023-10-06T11:08:38.811 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:08:38.811 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:08:38.811 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2023-10-06T11:08:38.811 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2023-10-06T11:08:38.811 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2023-10-06T11:08:38.812 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:08:38.812 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:38.812 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:08:38.812 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.3", 2023-10-06T11:08:38.812 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9luMqwMBAA4Y4I9hWTk2IqAzYwVQ13Pw==", 2023-10-06T11:08:38.812 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:08:38.812 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:08:38.812 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2023-10-06T11:08:38.812 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2023-10-06T11:08:38.812 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2023-10-06T11:08:38.812 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:08:38.812 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:38.812 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:08:38.813 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.admin", 2023-10-06T11:08:38.813 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDT6R9lSr9qIhAAiNEN9xFWUwFGsB+oUE1cXw==", 2023-10-06T11:08:38.813 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:08:38.813 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2023-10-06T11:08:38.813 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:08:38.813 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:08:38.813 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:08:38.813 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:08:38.813 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:38.813 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:08:38.813 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.x", 2023-10-06T11:08:38.813 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9llLpwCRAA4UH9Uqli2de9HIJR2fZ9xg==", 2023-10-06T11:08:38.814 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:08:38.814 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2023-10-06T11:08:38.814 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2023-10-06T11:08:38.814 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:08:38.814 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:08:38.814 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:38.814 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:08:38.814 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.y", 2023-10-06T11:08:38.814 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDT6R9l2uQxNxAAVSMhKVzbf2vC4opL7YCLdg==", 2023-10-06T11:08:38.814 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:08:38.814 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2023-10-06T11:08:38.814 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2023-10-06T11:08:38.814 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:08:38.815 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:08:38.815 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:08:38.815 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2023-10-06T11:08:38.815 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:08:38.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.794+0000 7fe6ab3d1700 1 -- 172.21.15.146:0/454309875 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe688066f30 msgr2=0x7fe6880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:38.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.794+0000 7fe6ab3d1700 1 --2- 172.21.15.146:0/454309875 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe688066f30 0x7fe6880693e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0009f40 tx=0x7fe6a00091a0 comp rx=0 tx=0).stop 2023-10-06T11:08:38.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.794+0000 7fe6ab3d1700 1 -- 172.21.15.146:0/454309875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6a4153ab0 msgr2=0x7fe6a414fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:38.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.794+0000 7fe6ab3d1700 1 --2- 172.21.15.146:0/454309875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6a4153ab0 0x7fe6a414fbd0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe69400c810 tx=0x7fe694007c50 comp rx=0 tx=0).stop 2023-10-06T11:08:38.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.794+0000 7fe6ab3d1700 1 -- 172.21.15.146:0/454309875 shutdown_connections 2023-10-06T11:08:38.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.794+0000 7fe6ab3d1700 1 --2- 172.21.15.146:0/454309875 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe688066f30 0x7fe6880693e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:38.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.794+0000 7fe6ab3d1700 1 --2- 172.21.15.146:0/454309875 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6a4153e80 0x7fe6a414b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:38.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.794+0000 7fe6ab3d1700 1 --2- 172.21.15.146:0/454309875 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6a4068ba0 0x7fe6a41471b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:38.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.794+0000 7fe6ab3d1700 1 --2- 172.21.15.146:0/454309875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6a4153ab0 0x7fe6a414fbd0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:38.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.794+0000 7fe6ab3d1700 1 -- 172.21.15.146:0/454309875 >> 172.21.15.146:0/454309875 conn(0x7fe6a406eba0 msgr2=0x7fe6a4151e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:38.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.794+0000 7fe6ab3d1700 1 -- 172.21.15.146:0/454309875 shutdown_connections 2023-10-06T11:08:38.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.794+0000 7fe6ab3d1700 1 -- 172.21.15.146:0/454309875 wait complete. 2023-10-06T11:08:38.818 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:08:38.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.931+0000 7fcb141a6700 1 Processor -- start 2023-10-06T11:08:38.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.931+0000 7fcb141a6700 1 -- start start 2023-10-06T11:08:38.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.932+0000 7fcb141a6700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcb0c068ba0 0x7fcb0c15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:38.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.932+0000 7fcb141a6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb0c15ac30 con 0x7fcb0c153e80 2023-10-06T11:08:38.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.932+0000 7fcb141a6700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb0c0b4510 con 0x7fcb0c153ab0 2023-10-06T11:08:38.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.932+0000 7fcb141a6700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb0c0b6530 con 0x7fcb0c068ba0 2023-10-06T11:08:38.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.932+0000 7fcb12743700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fcb0c153e80 0x7fcb0c0b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45974/0 (socket says 172.21.15.146:45974) 2023-10-06T11:08:38.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.932+0000 7fcb12743700 1 -- 172.21.15.146:0/536218692 learned_addr learned my addr 172.21.15.146:0/536218692 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:08:38.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.932+0000 7fcb11741700 1 --2- 172.21.15.146:0/536218692 >> v2:172.21.15.151:3300/0 conn(0x7fcb0c068ba0 0x7fcb0c15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:38.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.933+0000 7fcb10f40700 1 -- 172.21.15.146:0/536218692 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 633558551 0 0) 0x7fcb04001110 con 0x7fcb0c153e80 2023-10-06T11:08:38.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.933+0000 7fcb10f40700 1 -- 172.21.15.146:0/536218692 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcaf8003570 con 0x7fcb0c153e80 2023-10-06T11:08:38.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.933+0000 7fcb11741700 1 -- 172.21.15.146:0/536218692 >> v1:172.21.15.151:6789/0 conn(0x7fcb0c153ab0 legacy=0x7fcb0c068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:38.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.933+0000 7fcb10f40700 1 -- 172.21.15.146:0/536218692 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3416036390 0 0) 0x7fcb0c0b4510 con 0x7fcb0c153ab0 2023-10-06T11:08:38.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.933+0000 7fcb11741700 1 -- 172.21.15.146:0/536218692 >> v1:172.21.15.146:6789/0 conn(0x7fcb0c153e80 legacy=0x7fcb0c0b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:38.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.933+0000 7fcb11741700 1 -- 172.21.15.146:0/536218692 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb0c0b5c50 con 0x7fcb0c068ba0 2023-10-06T11:08:38.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.933+0000 7fcb11741700 1 --2- 172.21.15.146:0/536218692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb0c068ba0 0x7fcb0c15a6f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fcafc0098e0 tx=0x7fcafc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d451905a1c75324a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:38.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.933+0000 7fcb10f40700 1 -- 172.21.15.146:0/536218692 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcafc00b640 con 0x7fcb0c068ba0 2023-10-06T11:08:38.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.933+0000 7fcb10f40700 1 -- 172.21.15.146:0/536218692 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcafc00b7a0 con 0x7fcb0c068ba0 2023-10-06T11:08:38.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.933+0000 7fcb10f40700 1 -- 172.21.15.146:0/536218692 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcafc00bb40 con 0x7fcb0c068ba0 2023-10-06T11:08:38.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.934+0000 7fcb141a6700 1 -- 172.21.15.146:0/536218692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb0c068ba0 msgr2=0x7fcb0c15a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:38.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.934+0000 7fcb141a6700 1 --2- 172.21.15.146:0/536218692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb0c068ba0 0x7fcb0c15a6f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fcafc0098e0 tx=0x7fcafc0091a0 comp rx=0 tx=0).stop 2023-10-06T11:08:38.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.934+0000 7fcb141a6700 1 -- 172.21.15.146:0/536218692 shutdown_connections 2023-10-06T11:08:38.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.934+0000 7fcb141a6700 1 --2- 172.21.15.146:0/536218692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb0c068ba0 0x7fcb0c15a6f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:38.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.934+0000 7fcb141a6700 1 -- 172.21.15.146:0/536218692 >> 172.21.15.146:0/536218692 conn(0x7fcb0c06eba0 msgr2=0x7fcb0c06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:38.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.934+0000 7fcb141a6700 1 -- 172.21.15.146:0/536218692 shutdown_connections 2023-10-06T11:08:38.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.934+0000 7fcb141a6700 1 -- 172.21.15.146:0/536218692 wait complete. 2023-10-06T11:08:38.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.935+0000 7fcb141a6700 1 Processor -- start 2023-10-06T11:08:38.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.935+0000 7fcb141a6700 1 -- start start 2023-10-06T11:08:38.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.935+0000 7fcb141a6700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb0c068ba0 0x7fcb0c158ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:38.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.935+0000 7fcb141a6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb0c153ab0 0x7fcb0c0b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:38.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.935+0000 7fcb141a6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb0c153e80 0x7fcb0c150250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:38.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.935+0000 7fcb141a6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0c159220 con 0x7fcb0c153ab0 2023-10-06T11:08:38.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.935+0000 7fcb141a6700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0c158850 con 0x7fcb0c068ba0 2023-10-06T11:08:38.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.935+0000 7fcb141a6700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0c0b1c60 con 0x7fcb0c153e80 2023-10-06T11:08:38.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.936+0000 7fcb11741700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb0c153ab0 0x7fcb0c0b08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:38.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.936+0000 7fcb11741700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb0c153ab0 0x7fcb0c0b08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32778/0 (socket says 172.21.15.146:32778) 2023-10-06T11:08:38.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.936+0000 7fcb11741700 1 -- 172.21.15.146:0/3822636794 learned_addr learned my addr 172.21.15.146:0/3822636794 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:38.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.936+0000 7fcb11f42700 1 --2- 172.21.15.146:0/3822636794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb0c068ba0 0x7fcb0c158ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:38.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.936+0000 7fcb12743700 1 --2- 172.21.15.146:0/3822636794 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb0c153e80 0x7fcb0c150250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:38.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.936+0000 7fcb11741700 1 -- 172.21.15.146:0/3822636794 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb0c153e80 msgr2=0x7fcb0c150250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:38.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.936+0000 7fcb11741700 1 --2- 172.21.15.146:0/3822636794 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb0c153e80 0x7fcb0c150250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:38.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.936+0000 7fcb11741700 1 -- 172.21.15.146:0/3822636794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb0c068ba0 msgr2=0x7fcb0c158ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:38.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.936+0000 7fcb11741700 1 --2- 172.21.15.146:0/3822636794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb0c068ba0 0x7fcb0c158ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:38.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.936+0000 7fcb11741700 1 -- 172.21.15.146:0/3822636794 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcafc009420 con 0x7fcb0c153ab0 2023-10-06T11:08:38.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.936+0000 7fcb11741700 1 --2- 172.21.15.146:0/3822636794 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb0c153ab0 0x7fcb0c0b08d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c089010 tx=0x7fcafc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:38.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.936+0000 7fcb01ffb700 1 -- 172.21.15.146:0/3822636794 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcafc01f070 con 0x7fcb0c153ab0 2023-10-06T11:08:38.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.936+0000 7fcb01ffb700 1 -- 172.21.15.146:0/3822636794 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcafc002f70 con 0x7fcb0c153ab0 2023-10-06T11:08:38.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.936+0000 7fcb01ffb700 1 -- 172.21.15.146:0/3822636794 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcafc00b910 con 0x7fcb0c153ab0 2023-10-06T11:08:38.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.936+0000 7fcb141a6700 1 -- 172.21.15.146:0/3822636794 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb0c157c40 con 0x7fcb0c153ab0 2023-10-06T11:08:38.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.936+0000 7fcb141a6700 1 -- 172.21.15.146:0/3822636794 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb0c158200 con 0x7fcb0c153ab0 2023-10-06T11:08:38.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.937+0000 7fcb141a6700 1 -- 172.21.15.146:0/3822636794 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb0c04c380 con 0x7fcb0c153ab0 2023-10-06T11:08:38.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.938+0000 7fcb01ffb700 1 -- 172.21.15.146:0/3822636794 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcafc023070 con 0x7fcb0c153ab0 2023-10-06T11:08:38.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.938+0000 7fcb01ffb700 1 --2- 172.21.15.146:0/3822636794 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcaf0066f30 0x7fcaf00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:38.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.938+0000 7fcb01ffb700 1 -- 172.21.15.146:0/3822636794 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fcafc085520 con 0x7fcb0c153ab0 2023-10-06T11:08:38.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.938+0000 7fcb11f42700 1 --2- 172.21.15.146:0/3822636794 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcaf0066f30 0x7fcaf00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:38.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.939+0000 7fcb11f42700 1 --2- 172.21.15.146:0/3822636794 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcaf0066f30 0x7fcaf00693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fcb08007fd0 tx=0x7fcb08001700 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:38.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:38.942+0000 7fcb01ffb700 1 -- 172.21.15.146:0/3822636794 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcafc052980 con 0x7fcb0c153ab0 2023-10-06T11:08:39.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.127+0000 7fcb141a6700 1 -- 172.21.15.146:0/3822636794 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb0c158990 con 0x7fcb0c153ab0 2023-10-06T11:08:39.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.127+0000 7fcb01ffb700 1 -- 172.21.15.146:0/3822636794 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+13698 (secure 0 0 0) 0x7fcafc015090 con 0x7fcb0c153ab0 2023-10-06T11:08:39.129 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:08:39.129 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":43,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:08:38.384708+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:08:39.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.129+0000 7fcb141a6700 1 -- 172.21.15.146:0/3822636794 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcaf0066f30 msgr2=0x7fcaf00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:39.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.129+0000 7fcb141a6700 1 --2- 172.21.15.146:0/3822636794 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcaf0066f30 0x7fcaf00693e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fcb08007fd0 tx=0x7fcb08001700 comp rx=0 tx=0).stop 2023-10-06T11:08:39.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.129+0000 7fcb141a6700 1 -- 172.21.15.146:0/3822636794 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb0c153ab0 msgr2=0x7fcb0c0b08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:39.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.129+0000 7fcb141a6700 1 --2- 172.21.15.146:0/3822636794 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb0c153ab0 0x7fcb0c0b08d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c089010 tx=0x7fcafc017000 comp rx=0 tx=0).stop 2023-10-06T11:08:39.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.129+0000 7fcb141a6700 1 -- 172.21.15.146:0/3822636794 shutdown_connections 2023-10-06T11:08:39.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.129+0000 7fcb141a6700 1 --2- 172.21.15.146:0/3822636794 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcaf0066f30 0x7fcaf00693e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:39.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.129+0000 7fcb141a6700 1 --2- 172.21.15.146:0/3822636794 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb0c153e80 0x7fcb0c150250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:39.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.129+0000 7fcb141a6700 1 --2- 172.21.15.146:0/3822636794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb0c068ba0 0x7fcb0c158ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:39.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.129+0000 7fcb141a6700 1 --2- 172.21.15.146:0/3822636794 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb0c153ab0 0x7fcb0c0b08d0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:39.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.129+0000 7fcb141a6700 1 -- 172.21.15.146:0/3822636794 >> 172.21.15.146:0/3822636794 conn(0x7fcb0c06eba0 msgr2=0x7fcb0c152100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:39.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.130+0000 7fcb141a6700 1 -- 172.21.15.146:0/3822636794 shutdown_connections 2023-10-06T11:08:39.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.130+0000 7fcb141a6700 1 -- 172.21.15.146:0/3822636794 wait complete. 2023-10-06T11:08:39.144 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:05:36.687307+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:05:37.171199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T11:08:39.145 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:08:39.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.262+0000 7f8a37597700 1 Processor -- start 2023-10-06T11:08:39.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.262+0000 7f8a37597700 1 -- start start 2023-10-06T11:08:39.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.263+0000 7f8a37597700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8a300b5640 0x7f8a3015a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:39.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.263+0000 7f8a37597700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a30068780 0x7f8a30068c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:39.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.263+0000 7f8a37597700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a300cc130 con 0x7f8a300cb090 2023-10-06T11:08:39.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.263+0000 7f8a37597700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a30069140 con 0x7f8a300b5640 2023-10-06T11:08:39.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.263+0000 7f8a37597700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a300cccd0 con 0x7f8a30068780 2023-10-06T11:08:39.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.263+0000 7f8a36595700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8a300b5640 0x7f8a3015a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:39.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.263+0000 7f8a35d94700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8a300cb090 0x7f8a300cc5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45988/0 (socket says 172.21.15.146:45988) 2023-10-06T11:08:39.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.263+0000 7f8a35d94700 1 -- 172.21.15.146:0/2239009321 learned_addr learned my addr 172.21.15.146:0/2239009321 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:08:39.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.263+0000 7f8a36d96700 1 --2- 172.21.15.146:0/2239009321 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a30068780 0x7f8a30068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:39.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.263+0000 7f8a36595700 1 -- 172.21.15.146:0/2239009321 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a30068780 msgr2=0x7f8a30068c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:39.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.263+0000 7f8a36595700 1 --2- 172.21.15.146:0/2239009321 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a30068780 0x7f8a30068c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:39.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.263+0000 7f8a36595700 1 -- 172.21.15.146:0/2239009321 >> v1:172.21.15.146:6789/0 conn(0x7f8a300cb090 legacy=0x7f8a300cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:39.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.263+0000 7f8a36595700 1 -- 172.21.15.146:0/2239009321 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a300b2660 con 0x7f8a300b5640 2023-10-06T11:08:39.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.263+0000 7f8a35593700 1 -- 172.21.15.146:0/2239009321 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4011699450 0 0) 0x7f8a300cc130 con 0x7f8a300cb090 2023-10-06T11:08:39.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.263+0000 7f8a36595700 1 --2- 172.21.15.146:0/2239009321 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a300b5640 0x7f8a3015a870 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c009e60 tx=0x7f8a2c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=598133ab7ccb147b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:39.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.263+0000 7f8a35593700 1 -- 172.21.15.146:0/2239009321 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c00e070 con 0x7f8a300b5640 2023-10-06T11:08:39.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.264+0000 7f8a35593700 1 -- 172.21.15.146:0/2239009321 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a2c00bb60 con 0x7f8a300b5640 2023-10-06T11:08:39.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.264+0000 7f8a35593700 1 -- 172.21.15.146:0/2239009321 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c012430 con 0x7f8a300b5640 2023-10-06T11:08:39.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.264+0000 7f8a37597700 1 -- 172.21.15.146:0/2239009321 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a300b5640 msgr2=0x7f8a3015a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:39.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.264+0000 7f8a37597700 1 --2- 172.21.15.146:0/2239009321 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a300b5640 0x7f8a3015a870 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c009e60 tx=0x7f8a2c009780 comp rx=0 tx=0).stop 2023-10-06T11:08:39.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.264+0000 7f8a37597700 1 -- 172.21.15.146:0/2239009321 shutdown_connections 2023-10-06T11:08:39.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.264+0000 7f8a37597700 1 --2- 172.21.15.146:0/2239009321 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a30068780 0x7f8a30068c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:39.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.264+0000 7f8a37597700 1 --2- 172.21.15.146:0/2239009321 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a300b5640 0x7f8a3015a870 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:39.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.264+0000 7f8a37597700 1 -- 172.21.15.146:0/2239009321 >> 172.21.15.146:0/2239009321 conn(0x7f8a300703f0 msgr2=0x7f8a300707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:39.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.264+0000 7f8a37597700 1 -- 172.21.15.146:0/2239009321 shutdown_connections 2023-10-06T11:08:39.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.264+0000 7f8a37597700 1 -- 172.21.15.146:0/2239009321 wait complete. 2023-10-06T11:08:39.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.265+0000 7f8a37597700 1 Processor -- start 2023-10-06T11:08:39.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.265+0000 7f8a37597700 1 -- start start 2023-10-06T11:08:39.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.266+0000 7f8a37597700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a30068780 0x7f8a300c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:39.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.266+0000 7f8a37597700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a300b5640 0x7f8a30153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:39.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.266+0000 7f8a37597700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a300cb090 0x7f8a300c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:39.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.266+0000 7f8a37597700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a30154070 con 0x7f8a300b5640 2023-10-06T11:08:39.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.266+0000 7f8a37597700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a300c63a0 con 0x7f8a300cb090 2023-10-06T11:08:39.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.266+0000 7f8a37597700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a300c8e40 con 0x7f8a30068780 2023-10-06T11:08:39.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.266+0000 7f8a35d94700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a300b5640 0x7f8a30153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:39.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.266+0000 7f8a35d94700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a300b5640 0x7f8a30153b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32798/0 (socket says 172.21.15.146:32798) 2023-10-06T11:08:39.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.266+0000 7f8a35d94700 1 -- 172.21.15.146:0/3894274909 learned_addr learned my addr 172.21.15.146:0/3894274909 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:39.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.266+0000 7f8a36595700 1 --2- 172.21.15.146:0/3894274909 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a30068780 0x7f8a300c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:39.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.266+0000 7f8a36d96700 1 --2- 172.21.15.146:0/3894274909 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a300cb090 0x7f8a300c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:39.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.266+0000 7f8a35d94700 1 -- 172.21.15.146:0/3894274909 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a30068780 msgr2=0x7f8a300c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:39.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.266+0000 7f8a35d94700 1 --2- 172.21.15.146:0/3894274909 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a30068780 0x7f8a300c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:39.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.266+0000 7f8a35d94700 1 -- 172.21.15.146:0/3894274909 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a300cb090 msgr2=0x7f8a300c8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:39.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.266+0000 7f8a35d94700 1 --2- 172.21.15.146:0/3894274909 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a300cb090 0x7f8a300c8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:39.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.266+0000 7f8a35d94700 1 -- 172.21.15.146:0/3894274909 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a2c009a20 con 0x7f8a300b5640 2023-10-06T11:08:39.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.267+0000 7f8a35d94700 1 --2- 172.21.15.146:0/3894274909 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a300b5640 0x7f8a30153b30 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f8a2000c610 tx=0x7f8a20000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:39.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.267+0000 7f8a267fc700 1 -- 172.21.15.146:0/3894274909 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a20005b30 con 0x7f8a300b5640 2023-10-06T11:08:39.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.267+0000 7f8a267fc700 1 -- 172.21.15.146:0/3894274909 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a20005c90 con 0x7f8a300b5640 2023-10-06T11:08:39.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.267+0000 7f8a37597700 1 -- 172.21.15.146:0/3894274909 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a300c9070 con 0x7f8a300b5640 2023-10-06T11:08:39.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.267+0000 7f8a267fc700 1 -- 172.21.15.146:0/3894274909 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a20007300 con 0x7f8a300b5640 2023-10-06T11:08:39.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.267+0000 7f8a37597700 1 -- 172.21.15.146:0/3894274909 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a300c68b0 con 0x7f8a300b5640 2023-10-06T11:08:39.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.268+0000 7f8a37597700 1 -- 172.21.15.146:0/3894274909 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a300894b0 con 0x7f8a300b5640 2023-10-06T11:08:39.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.268+0000 7f8a267fc700 1 -- 172.21.15.146:0/3894274909 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8a2001b3b0 con 0x7f8a300b5640 2023-10-06T11:08:39.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.268+0000 7f8a267fc700 1 --2- 172.21.15.146:0/3894274909 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8a14066f30 0x7f8a140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:39.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.268+0000 7f8a267fc700 1 -- 172.21.15.146:0/3894274909 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f8a200838a0 con 0x7f8a300b5640 2023-10-06T11:08:39.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.268+0000 7f8a36595700 1 --2- 172.21.15.146:0/3894274909 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8a14066f30 0x7f8a140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:39.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.269+0000 7f8a36595700 1 --2- 172.21.15.146:0/3894274909 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8a14066f30 0x7f8a140693e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c0097c0 tx=0x7f8a2c019000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:39.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.273+0000 7f8a267fc700 1 -- 172.21.15.146:0/3894274909 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8a20050d00 con 0x7f8a300b5640 2023-10-06T11:08:39.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.454+0000 7f8a37597700 1 -- 172.21.15.146:0/3894274909 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8a3004bb40 con 0x7f8a300b5640 2023-10-06T11:08:39.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.454+0000 7f8a267fc700 1 -- 172.21.15.146:0/3894274909 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v43) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8a20017020 con 0x7f8a300b5640 2023-10-06T11:08:39.456 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-10-06T11:08:39.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.456+0000 7f8a37597700 1 -- 172.21.15.146:0/3894274909 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8a14066f30 msgr2=0x7f8a140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:39.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.456+0000 7f8a37597700 1 --2- 172.21.15.146:0/3894274909 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8a14066f30 0x7f8a140693e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c0097c0 tx=0x7f8a2c019000 comp rx=0 tx=0).stop 2023-10-06T11:08:39.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.456+0000 7f8a37597700 1 -- 172.21.15.146:0/3894274909 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a300b5640 msgr2=0x7f8a30153b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:39.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.456+0000 7f8a37597700 1 --2- 172.21.15.146:0/3894274909 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a300b5640 0x7f8a30153b30 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f8a2000c610 tx=0x7f8a20000fe0 comp rx=0 tx=0).stop 2023-10-06T11:08:39.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.457+0000 7f8a37597700 1 -- 172.21.15.146:0/3894274909 shutdown_connections 2023-10-06T11:08:39.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.457+0000 7f8a37597700 1 --2- 172.21.15.146:0/3894274909 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8a14066f30 0x7f8a140693e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:39.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.457+0000 7f8a37597700 1 --2- 172.21.15.146:0/3894274909 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a300cb090 0x7f8a300c8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:39.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.457+0000 7f8a37597700 1 --2- 172.21.15.146:0/3894274909 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a30068780 0x7f8a300c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:39.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.457+0000 7f8a37597700 1 --2- 172.21.15.146:0/3894274909 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a300b5640 0x7f8a30153b30 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:39.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.457+0000 7f8a37597700 1 -- 172.21.15.146:0/3894274909 >> 172.21.15.146:0/3894274909 conn(0x7f8a300703f0 msgr2=0x7f8a300b4ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:39.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.457+0000 7f8a37597700 1 -- 172.21.15.146:0/3894274909 shutdown_connections 2023-10-06T11:08:39.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.457+0000 7f8a37597700 1 -- 172.21.15.146:0/3894274909 wait complete. 2023-10-06T11:08:39.470 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:08:39.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.586+0000 7f3bcc815700 1 Processor -- start 2023-10-06T11:08:39.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.586+0000 7f3bcc815700 1 -- start start 2023-10-06T11:08:39.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.587+0000 7f3bcc815700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3bc80ae730 0x7f3bc80aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:39.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.587+0000 7f3bcc815700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bc80ae2a0 con 0x7f3bc815a160 2023-10-06T11:08:39.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.587+0000 7f3bcc815700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bc815a530 con 0x7f3bc80cb950 2023-10-06T11:08:39.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.587+0000 7f3bcc815700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc80c5cb0 con 0x7f3bc80ae730 2023-10-06T11:08:39.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.587+0000 7f3bc5d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3bc80ae730 0x7f3bc80aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:39.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.587+0000 7f3bc659c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3bc815a160 0x7f3bc80c55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:46004/0 (socket says 172.21.15.146:46004) 2023-10-06T11:08:39.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.587+0000 7f3bc659c700 1 -- 172.21.15.146:0/3270471697 learned_addr learned my addr 172.21.15.146:0/3270471697 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:08:39.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.587+0000 7f3bc5d9b700 1 -- 172.21.15.146:0/3270471697 >> v1:172.21.15.151:6789/0 conn(0x7f3bc80cb950 legacy=0x7f3bc80cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:39.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.587+0000 7f3bc5d9b700 1 -- 172.21.15.146:0/3270471697 >> v1:172.21.15.146:6789/0 conn(0x7f3bc815a160 legacy=0x7f3bc80c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:39.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.587+0000 7f3bc5d9b700 1 -- 172.21.15.146:0/3270471697 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc80af0f0 con 0x7f3bc80ae730 2023-10-06T11:08:39.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.587+0000 7f3bc559a700 1 -- 172.21.15.146:0/3270471697 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2024881128 0 0) 0x7f3bc80ae2a0 con 0x7f3bc815a160 2023-10-06T11:08:39.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.588+0000 7f3bc5d9b700 1 --2- 172.21.15.146:0/3270471697 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bc80ae730 0x7f3bc80aebb0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc0098e0 tx=0x7f3bbc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3076477d08c65624 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:39.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.588+0000 7f3bc559a700 1 -- 172.21.15.146:0/3270471697 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc009e80 con 0x7f3bc80ae730 2023-10-06T11:08:39.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.588+0000 7f3bc559a700 1 -- 172.21.15.146:0/3270471697 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bbc00b820 con 0x7f3bc80ae730 2023-10-06T11:08:39.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.588+0000 7f3bc559a700 1 -- 172.21.15.146:0/3270471697 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc00bba0 con 0x7f3bc80ae730 2023-10-06T11:08:39.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.588+0000 7f3bcc815700 1 -- 172.21.15.146:0/3270471697 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bc80ae730 msgr2=0x7f3bc80aebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:39.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.588+0000 7f3bcc815700 1 --2- 172.21.15.146:0/3270471697 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bc80ae730 0x7f3bc80aebb0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc0098e0 tx=0x7f3bbc0091a0 comp rx=0 tx=0).stop 2023-10-06T11:08:39.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.588+0000 7f3bcc815700 1 -- 172.21.15.146:0/3270471697 shutdown_connections 2023-10-06T11:08:39.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.588+0000 7f3bcc815700 1 --2- 172.21.15.146:0/3270471697 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bc80ae730 0x7f3bc80aebb0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:39.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.588+0000 7f3bcc815700 1 -- 172.21.15.146:0/3270471697 >> 172.21.15.146:0/3270471697 conn(0x7f3bc806f380 msgr2=0x7f3bc80d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:39.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.588+0000 7f3bcc815700 1 -- 172.21.15.146:0/3270471697 shutdown_connections 2023-10-06T11:08:39.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.588+0000 7f3bcc815700 1 -- 172.21.15.146:0/3270471697 wait complete. 2023-10-06T11:08:39.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.589+0000 7f3bcc815700 1 Processor -- start 2023-10-06T11:08:39.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.589+0000 7f3bcc815700 1 -- start start 2023-10-06T11:08:39.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.590+0000 7f3bcc815700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3bc80ae730 0x7f3bc80b2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:39.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.590+0000 7f3bcc815700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bc80cb950 0x7f3bc80b4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:39.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.590+0000 7f3bcc815700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3bc815a160 0x7f3bc8157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:39.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.590+0000 7f3bcc815700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc80b5f50 con 0x7f3bc80cb950 2023-10-06T11:08:39.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.590+0000 7f3bcc815700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc80b63e0 con 0x7f3bc80ae730 2023-10-06T11:08:39.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.590+0000 7f3bcc815700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc80b5340 con 0x7f3bc815a160 2023-10-06T11:08:39.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.590+0000 7f3bc5d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bc80cb950 0x7f3bc80b4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:39.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.590+0000 7f3bc5d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bc80cb950 0x7f3bc80b4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32828/0 (socket says 172.21.15.146:32828) 2023-10-06T11:08:39.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.590+0000 7f3bc5d9b700 1 -- 172.21.15.146:0/2415009674 learned_addr learned my addr 172.21.15.146:0/2415009674 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:39.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.591+0000 7f3bc5d9b700 1 -- 172.21.15.146:0/2415009674 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3bc815a160 msgr2=0x7f3bc8157610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:39.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.591+0000 7f3bc5d9b700 1 --2- 172.21.15.146:0/2415009674 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3bc815a160 0x7f3bc8157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:39.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.591+0000 7f3bc5d9b700 1 -- 172.21.15.146:0/2415009674 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3bc80ae730 msgr2=0x7f3bc80b2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:39.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.591+0000 7f3bc5d9b700 1 --2- 172.21.15.146:0/2415009674 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3bc80ae730 0x7f3bc80b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:39.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.591+0000 7f3bc5d9b700 1 -- 172.21.15.146:0/2415009674 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bbc009420 con 0x7f3bc80cb950 2023-10-06T11:08:39.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.591+0000 7f3bc5d9b700 1 --2- 172.21.15.146:0/2415009674 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bc80cb950 0x7f3bc80b4c40 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc0030c0 tx=0x7f3bbc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:39.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.591+0000 7f3bb67fc700 1 -- 172.21.15.146:0/2415009674 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc00ba10 con 0x7f3bc80cb950 2023-10-06T11:08:39.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.591+0000 7f3bb67fc700 1 -- 172.21.15.146:0/2415009674 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bbc020070 con 0x7f3bc80cb950 2023-10-06T11:08:39.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.591+0000 7f3bcc815700 1 -- 172.21.15.146:0/2415009674 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc80b5620 con 0x7f3bc80cb950 2023-10-06T11:08:39.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.591+0000 7f3bb67fc700 1 -- 172.21.15.146:0/2415009674 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bbc01b6a0 con 0x7f3bc80cb950 2023-10-06T11:08:39.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.591+0000 7f3bcc815700 1 -- 172.21.15.146:0/2415009674 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc80b5be0 con 0x7f3bc80cb950 2023-10-06T11:08:39.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.592+0000 7f3bcc815700 1 -- 172.21.15.146:0/2415009674 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bc8068390 con 0x7f3bc80cb950 2023-10-06T11:08:39.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.592+0000 7f3bb67fc700 1 -- 172.21.15.146:0/2415009674 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3bbc022030 con 0x7f3bc80cb950 2023-10-06T11:08:39.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.592+0000 7f3bb67fc700 1 --2- 172.21.15.146:0/2415009674 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3ba8066f30 0x7f3ba80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:39.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.593+0000 7f3bb67fc700 1 -- 172.21.15.146:0/2415009674 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f3bbc086310 con 0x7f3bc80cb950 2023-10-06T11:08:39.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.593+0000 7f3bc659c700 1 --2- 172.21.15.146:0/2415009674 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3ba8066f30 0x7f3ba80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:39.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.593+0000 7f3bc659c700 1 --2- 172.21.15.146:0/2415009674 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3ba8066f30 0x7f3ba80693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3bb8001640 tx=0x7f3bb8007a40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:39.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.597+0000 7f3bb67fc700 1 -- 172.21.15.146:0/2415009674 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3bbc053770 con 0x7f3bc80cb950 2023-10-06T11:08:39.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.780+0000 7f3bcc815700 1 -- 172.21.15.146:0/2415009674 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3bc8068390 con 0x7f3bc80cb950 2023-10-06T11:08:39.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.781+0000 7f3bb67fc700 1 -- 172.21.15.146:0/2415009674 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3bbc056d90 con 0x7f3bc80cb950 2023-10-06T11:08:39.783 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-10-06T11:08:39.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.783+0000 7f3bcc815700 1 -- 172.21.15.146:0/2415009674 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3ba8066f30 msgr2=0x7f3ba80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:39.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.783+0000 7f3bcc815700 1 --2- 172.21.15.146:0/2415009674 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3ba8066f30 0x7f3ba80693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3bb8001640 tx=0x7f3bb8007a40 comp rx=0 tx=0).stop 2023-10-06T11:08:39.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.783+0000 7f3bcc815700 1 -- 172.21.15.146:0/2415009674 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bc80cb950 msgr2=0x7f3bc80b4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:39.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.783+0000 7f3bcc815700 1 --2- 172.21.15.146:0/2415009674 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bc80cb950 0x7f3bc80b4c40 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f3bbc0030c0 tx=0x7f3bbc016000 comp rx=0 tx=0).stop 2023-10-06T11:08:39.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.783+0000 7f3bcc815700 1 -- 172.21.15.146:0/2415009674 shutdown_connections 2023-10-06T11:08:39.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.783+0000 7f3bcc815700 1 --2- 172.21.15.146:0/2415009674 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3ba8066f30 0x7f3ba80693e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:39.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.783+0000 7f3bcc815700 1 --2- 172.21.15.146:0/2415009674 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3bc815a160 0x7f3bc8157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:39.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.783+0000 7f3bcc815700 1 --2- 172.21.15.146:0/2415009674 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3bc80ae730 0x7f3bc80b2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:39.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.783+0000 7f3bcc815700 1 --2- 172.21.15.146:0/2415009674 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bc80cb950 0x7f3bc80b4c40 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:39.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.783+0000 7f3bcc815700 1 -- 172.21.15.146:0/2415009674 >> 172.21.15.146:0/2415009674 conn(0x7f3bc806f380 msgr2=0x7f3bc8159460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:39.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.783+0000 7f3bcc815700 1 -- 172.21.15.146:0/2415009674 shutdown_connections 2023-10-06T11:08:39.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.783+0000 7f3bcc815700 1 -- 172.21.15.146:0/2415009674 wait complete. 2023-10-06T11:08:39.797 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T11:08:39.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.910+0000 7f373f1a7700 1 Processor -- start 2023-10-06T11:08:39.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.910+0000 7f373f1a7700 1 -- start start 2023-10-06T11:08:39.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.911+0000 7f373f1a7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3738157430 0x7f3738157800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:39.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.911+0000 7f373f1a7700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f37380ab010 0x7f37380ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:39.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.911+0000 7f373f1a7700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37380cf0b0 con 0x7f37380cc240 2023-10-06T11:08:39.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.911+0000 7f373f1a7700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37380c3dd0 con 0x7f3738157430 2023-10-06T11:08:39.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.911+0000 7f373f1a7700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37380ccf20 con 0x7f37380ab010 2023-10-06T11:08:39.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.911+0000 7f373cf43700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3738157430 0x7f3738157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:39.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.911+0000 7f373cf43700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3738157430 0x7f3738157800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32836/0 (socket says 172.21.15.146:32836) 2023-10-06T11:08:39.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.911+0000 7f373cf43700 1 -- 172.21.15.146:0/3886548659 learned_addr learned my addr 172.21.15.146:0/3886548659 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:39.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.911+0000 7f372ffff700 1 --2- 172.21.15.146:0/3886548659 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f37380ab010 0x7f37380ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:39.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.911+0000 7f373cf43700 1 -- 172.21.15.146:0/3886548659 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f37380ab010 msgr2=0x7f37380ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:39.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.911+0000 7f373cf43700 1 --2- 172.21.15.146:0/3886548659 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f37380ab010 0x7f37380ceb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:39.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.911+0000 7f373cf43700 1 -- 172.21.15.146:0/3886548659 >> v1:172.21.15.151:6789/0 conn(0x7f37380cc240 legacy=0x7f37380cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:39.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.911+0000 7f373cf43700 1 -- 172.21.15.146:0/3886548659 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37380cd200 con 0x7f3738157430 2023-10-06T11:08:39.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.911+0000 7f372ffff700 1 --2- 172.21.15.146:0/3886548659 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f37380ab010 0x7f37380ceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:08:39.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.912+0000 7f373cf43700 1 --2- 172.21.15.146:0/3886548659 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3738157430 0x7f3738157800 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3734009f20 tx=0x7f3734009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=851c217f5f47ffca server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:39.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.912+0000 7f372f7fe700 1 -- 172.21.15.146:0/3886548659 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373400e070 con 0x7f3738157430 2023-10-06T11:08:39.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.912+0000 7f372f7fe700 1 -- 172.21.15.146:0/3886548659 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373400ba40 con 0x7f3738157430 2023-10-06T11:08:39.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.912+0000 7f372f7fe700 1 -- 172.21.15.146:0/3886548659 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37340092e0 con 0x7f3738157430 2023-10-06T11:08:39.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.912+0000 7f373f1a7700 1 -- 172.21.15.146:0/3886548659 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3738157430 msgr2=0x7f3738157800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:39.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.912+0000 7f373f1a7700 1 --2- 172.21.15.146:0/3886548659 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3738157430 0x7f3738157800 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3734009f20 tx=0x7f3734009840 comp rx=0 tx=0).stop 2023-10-06T11:08:39.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.912+0000 7f373f1a7700 1 -- 172.21.15.146:0/3886548659 shutdown_connections 2023-10-06T11:08:39.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.912+0000 7f373f1a7700 1 --2- 172.21.15.146:0/3886548659 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3738157430 0x7f3738157800 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:39.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.912+0000 7f373f1a7700 1 --2- 172.21.15.146:0/3886548659 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f37380ab010 0x7f37380ceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:39.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.912+0000 7f373f1a7700 1 -- 172.21.15.146:0/3886548659 >> 172.21.15.146:0/3886548659 conn(0x7f3738067c50 msgr2=0x7f37380ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:39.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.912+0000 7f373f1a7700 1 -- 172.21.15.146:0/3886548659 shutdown_connections 2023-10-06T11:08:39.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.912+0000 7f373f1a7700 1 -- 172.21.15.146:0/3886548659 wait complete. 2023-10-06T11:08:39.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.913+0000 7f373f1a7700 1 Processor -- start 2023-10-06T11:08:39.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.914+0000 7f373f1a7700 1 -- start start 2023-10-06T11:08:39.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.914+0000 7f373f1a7700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f37380ab010 0x7f37381524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:39.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.914+0000 7f373f1a7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37380cc240 0x7f373815c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:39.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.914+0000 7f373f1a7700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3738157430 0x7f373815c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:39.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.914+0000 7f373f1a7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37380b1200 con 0x7f37380cc240 2023-10-06T11:08:39.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.914+0000 7f373f1a7700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37380b1d40 con 0x7f37380ab010 2023-10-06T11:08:39.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.914+0000 7f373f1a7700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37380b1410 con 0x7f3738157430 2023-10-06T11:08:39.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.914+0000 7f372ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37380cc240 0x7f373815c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:39.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.914+0000 7f372ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37380cc240 0x7f373815c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32848/0 (socket says 172.21.15.146:32848) 2023-10-06T11:08:39.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.914+0000 7f372ffff700 1 -- 172.21.15.146:0/1429207817 learned_addr learned my addr 172.21.15.146:0/1429207817 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:39.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.914+0000 7f373d744700 1 --2- 172.21.15.146:0/1429207817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3738157430 0x7f373815c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:39.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.914+0000 7f373cf43700 1 --2- 172.21.15.146:0/1429207817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f37380ab010 0x7f37381524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:39.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.915+0000 7f372ffff700 1 -- 172.21.15.146:0/1429207817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3738157430 msgr2=0x7f373815c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:39.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.915+0000 7f372ffff700 1 --2- 172.21.15.146:0/1429207817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3738157430 0x7f373815c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:39.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.915+0000 7f372ffff700 1 -- 172.21.15.146:0/1429207817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f37380ab010 msgr2=0x7f37381524a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:39.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.915+0000 7f372ffff700 1 --2- 172.21.15.146:0/1429207817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f37380ab010 0x7f37381524a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:39.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.915+0000 7f372ffff700 1 -- 172.21.15.146:0/1429207817 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3734009ae0 con 0x7f37380cc240 2023-10-06T11:08:39.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.915+0000 7f373d744700 1 --2- 172.21.15.146:0/1429207817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3738157430 0x7f373815c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:08:39.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.915+0000 7f372ffff700 1 --2- 172.21.15.146:0/1429207817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37380cc240 0x7f373815c170 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f372800c830 tx=0x7f3728008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:39.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.915+0000 7f372cff9700 1 -- 172.21.15.146:0/1429207817 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3728011600 con 0x7f37380cc240 2023-10-06T11:08:39.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.915+0000 7f372cff9700 1 -- 172.21.15.146:0/1429207817 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3728011760 con 0x7f37380cc240 2023-10-06T11:08:39.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.915+0000 7f373f1a7700 1 -- 172.21.15.146:0/1429207817 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37380b16f0 con 0x7f37380cc240 2023-10-06T11:08:39.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.915+0000 7f372cff9700 1 -- 172.21.15.146:0/1429207817 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3728011b20 con 0x7f37380cc240 2023-10-06T11:08:39.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.915+0000 7f373f1a7700 1 -- 172.21.15.146:0/1429207817 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37381529e0 con 0x7f37380cc240 2023-10-06T11:08:39.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.916+0000 7f373f1a7700 1 -- 172.21.15.146:0/1429207817 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37380b20d0 con 0x7f37380cc240 2023-10-06T11:08:39.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.916+0000 7f372cff9700 1 -- 172.21.15.146:0/1429207817 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f372800a3e0 con 0x7f37380cc240 2023-10-06T11:08:39.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.917+0000 7f372cff9700 1 --2- 172.21.15.146:0/1429207817 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3724066f30 0x7f37240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:39.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.917+0000 7f372cff9700 1 -- 172.21.15.146:0/1429207817 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f3728084800 con 0x7f37380cc240 2023-10-06T11:08:39.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.917+0000 7f373cf43700 1 --2- 172.21.15.146:0/1429207817 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3724066f30 0x7f37240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:39.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.917+0000 7f373cf43700 1 --2- 172.21.15.146:0/1429207817 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3724066f30 0x7f37240693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3734009880 tx=0x7f3734017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:39.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:39.921+0000 7f372cff9700 1 -- 172.21.15.146:0/1429207817 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f37380b20d0 con 0x7f37380cc240 2023-10-06T11:08:40.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.107+0000 7f373f1a7700 1 -- 172.21.15.146:0/1429207817 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f37380b20d0 con 0x7f37380cc240 2023-10-06T11:08:40.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.107+0000 7f372cff9700 1 -- 172.21.15.146:0/1429207817 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v43) v1 ==== 84+0+126 (secure 0 0 0) 0x7f372801f090 con 0x7f37380cc240 2023-10-06T11:08:40.109 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:08:40.109 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2023-10-06T11:08:40.109 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:08:40.110 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 1, 2023-10-06T11:08:40.110 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": "rbd" 2023-10-06T11:08:40.110 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:40.110 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:08:40.110 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 2, 2023-10-06T11:08:40.110 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": ".mgr" 2023-10-06T11:08:40.110 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:08:40.110 INFO:teuthology.orchestra.run.smithi146.stdout:] 2023-10-06T11:08:40.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.109+0000 7f373f1a7700 1 -- 172.21.15.146:0/1429207817 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3724066f30 msgr2=0x7f37240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:40.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.109+0000 7f373f1a7700 1 --2- 172.21.15.146:0/1429207817 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3724066f30 0x7f37240693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3734009880 tx=0x7f3734017000 comp rx=0 tx=0).stop 2023-10-06T11:08:40.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.109+0000 7f373f1a7700 1 -- 172.21.15.146:0/1429207817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37380cc240 msgr2=0x7f373815c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:40.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.109+0000 7f373f1a7700 1 --2- 172.21.15.146:0/1429207817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37380cc240 0x7f373815c170 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f372800c830 tx=0x7f3728008040 comp rx=0 tx=0).stop 2023-10-06T11:08:40.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.109+0000 7f373f1a7700 1 -- 172.21.15.146:0/1429207817 shutdown_connections 2023-10-06T11:08:40.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.109+0000 7f373f1a7700 1 --2- 172.21.15.146:0/1429207817 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3724066f30 0x7f37240693e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:40.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.109+0000 7f373f1a7700 1 --2- 172.21.15.146:0/1429207817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3738157430 0x7f373815c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:40.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.109+0000 7f373f1a7700 1 --2- 172.21.15.146:0/1429207817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f37380ab010 0x7f37381524a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:40.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.109+0000 7f373f1a7700 1 --2- 172.21.15.146:0/1429207817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f37380cc240 0x7f373815c170 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:40.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.109+0000 7f373f1a7700 1 -- 172.21.15.146:0/1429207817 >> 172.21.15.146:0/1429207817 conn(0x7f3738067c50 msgr2=0x7f3738063840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:40.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.109+0000 7f373f1a7700 1 -- 172.21.15.146:0/1429207817 shutdown_connections 2023-10-06T11:08:40.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.109+0000 7f373f1a7700 1 -- 172.21.15.146:0/1429207817 wait complete. 2023-10-06T11:08:40.123 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T11:08:40.123 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T11:08:40.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.242+0000 7faae19d8700 1 Processor -- start 2023-10-06T11:08:40.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.242+0000 7faae19d8700 1 -- start start 2023-10-06T11:08:40.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.243+0000 7faae19d8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faadc1596e0 0x7faadc0cb190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:40.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.243+0000 7faae19d8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faadc067b80 0x7faadc15d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:40.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.243+0000 7faae19d8700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faadc06ef10 con 0x7faadc0cb6d0 2023-10-06T11:08:40.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.243+0000 7faae19d8700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faadc0cbe50 con 0x7faadc067b80 2023-10-06T11:08:40.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.243+0000 7faae19d8700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faadc06e6b0 con 0x7faadc1596e0 2023-10-06T11:08:40.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.243+0000 7faadb7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faadc067b80 0x7faadc15d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:40.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.243+0000 7faadb7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faadc067b80 0x7faadc15d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32864/0 (socket says 172.21.15.146:32864) 2023-10-06T11:08:40.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.243+0000 7faadb7fe700 1 -- 172.21.15.146:0/883596856 learned_addr learned my addr 172.21.15.146:0/883596856 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:40.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.244+0000 7faadaffd700 1 --2- 172.21.15.146:0/883596856 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faadc1596e0 0x7faadc0cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:40.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.244+0000 7faadb7fe700 1 -- 172.21.15.146:0/883596856 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faadc1596e0 msgr2=0x7faadc0cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:40.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.244+0000 7faadb7fe700 1 --2- 172.21.15.146:0/883596856 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faadc1596e0 0x7faadc0cb190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:40.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.244+0000 7faadb7fe700 1 -- 172.21.15.146:0/883596856 >> v1:172.21.15.151:6789/0 conn(0x7faadc0cb6d0 legacy=0x7faadc067470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:40.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.244+0000 7faadb7fe700 1 -- 172.21.15.146:0/883596856 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faadc0cbb70 con 0x7faadc067b80 2023-10-06T11:08:40.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.244+0000 7faadaffd700 1 --2- 172.21.15.146:0/883596856 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faadc1596e0 0x7faadc0cb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:08:40.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.244+0000 7faadb7fe700 1 --2- 172.21.15.146:0/883596856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faadc067b80 0x7faadc15d4a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7faad4009f20 tx=0x7faad4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b782f6630ff2ab0b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:40.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.244+0000 7faada7fc700 1 -- 172.21.15.146:0/883596856 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad400e070 con 0x7faadc067b80 2023-10-06T11:08:40.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.244+0000 7faada7fc700 1 -- 172.21.15.146:0/883596856 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad400ba40 con 0x7faadc067b80 2023-10-06T11:08:40.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.244+0000 7faada7fc700 1 -- 172.21.15.146:0/883596856 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad40092e0 con 0x7faadc067b80 2023-10-06T11:08:40.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.244+0000 7faae19d8700 1 -- 172.21.15.146:0/883596856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faadc067b80 msgr2=0x7faadc15d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:40.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.244+0000 7faae19d8700 1 --2- 172.21.15.146:0/883596856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faadc067b80 0x7faadc15d4a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7faad4009f20 tx=0x7faad4009840 comp rx=0 tx=0).stop 2023-10-06T11:08:40.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.244+0000 7faae19d8700 1 -- 172.21.15.146:0/883596856 shutdown_connections 2023-10-06T11:08:40.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.244+0000 7faae19d8700 1 --2- 172.21.15.146:0/883596856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faadc067b80 0x7faadc15d4a0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:40.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.244+0000 7faae19d8700 1 --2- 172.21.15.146:0/883596856 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faadc1596e0 0x7faadc0cb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:40.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.244+0000 7faae19d8700 1 -- 172.21.15.146:0/883596856 >> 172.21.15.146:0/883596856 conn(0x7faadc069050 msgr2=0x7faadc0cd300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:40.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.245+0000 7faae19d8700 1 -- 172.21.15.146:0/883596856 shutdown_connections 2023-10-06T11:08:40.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.245+0000 7faae19d8700 1 -- 172.21.15.146:0/883596856 wait complete. 2023-10-06T11:08:40.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.246+0000 7faae19d8700 1 Processor -- start 2023-10-06T11:08:40.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.246+0000 7faae19d8700 1 -- start start 2023-10-06T11:08:40.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.247+0000 7faae19d8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faadc067b80 0x7faadc0ae030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:40.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.247+0000 7faae19d8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faadc0cb6d0 0x7faadc157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:40.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.247+0000 7faae19d8700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faadc1596e0 0x7faadc157b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:40.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.247+0000 7faae19d8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faadc0aa1f0 con 0x7faadc0cb6d0 2023-10-06T11:08:40.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.247+0000 7faae19d8700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faadc16df00 con 0x7faadc1596e0 2023-10-06T11:08:40.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.247+0000 7faae19d8700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faadc0a98c0 con 0x7faadc067b80 2023-10-06T11:08:40.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.247+0000 7faad27fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faadc0cb6d0 0x7faadc157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:40.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.247+0000 7faad27fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faadc0cb6d0 0x7faadc157620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32870/0 (socket says 172.21.15.146:32870) 2023-10-06T11:08:40.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.247+0000 7faad27fc700 1 -- 172.21.15.146:0/3295885853 learned_addr learned my addr 172.21.15.146:0/3295885853 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:40.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.247+0000 7faadb7fe700 1 --2- 172.21.15.146:0/3295885853 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faadc1596e0 0x7faadc157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:40.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.247+0000 7faadaffd700 1 --2- 172.21.15.146:0/3295885853 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faadc067b80 0x7faadc0ae030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:40.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.247+0000 7faad27fc700 1 -- 172.21.15.146:0/3295885853 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faadc067b80 msgr2=0x7faadc0ae030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:40.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.247+0000 7faad27fc700 1 --2- 172.21.15.146:0/3295885853 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faadc067b80 0x7faadc0ae030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:40.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.247+0000 7faad27fc700 1 -- 172.21.15.146:0/3295885853 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faadc1596e0 msgr2=0x7faadc157b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:40.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.247+0000 7faad27fc700 1 --2- 172.21.15.146:0/3295885853 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faadc1596e0 0x7faadc157b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:40.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.247+0000 7faad27fc700 1 -- 172.21.15.146:0/3295885853 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad4009ae0 con 0x7faadc0cb6d0 2023-10-06T11:08:40.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.247+0000 7faad27fc700 1 --2- 172.21.15.146:0/3295885853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faadc0cb6d0 0x7faadc157620 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7faac400c590 tx=0x7faac4007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:40.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.247+0000 7faad37fe700 1 -- 172.21.15.146:0/3295885853 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac4011590 con 0x7faadc0cb6d0 2023-10-06T11:08:40.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.247+0000 7faad37fe700 1 -- 172.21.15.146:0/3295885853 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac40116f0 con 0x7faadc0cb6d0 2023-10-06T11:08:40.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.247+0000 7faae19d8700 1 -- 172.21.15.146:0/3295885853 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faadc0a9ba0 con 0x7faadc0cb6d0 2023-10-06T11:08:40.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.247+0000 7faad37fe700 1 -- 172.21.15.146:0/3295885853 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac4011ab0 con 0x7faadc0cb6d0 2023-10-06T11:08:40.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.247+0000 7faae19d8700 1 -- 172.21.15.146:0/3295885853 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faadc0aa680 con 0x7faadc0cb6d0 2023-10-06T11:08:40.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.248+0000 7faae19d8700 1 -- 172.21.15.146:0/3295885853 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faadc0aa3a0 con 0x7faadc0cb6d0 2023-10-06T11:08:40.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.249+0000 7faad37fe700 1 -- 172.21.15.146:0/3295885853 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faac401c460 con 0x7faadc0cb6d0 2023-10-06T11:08:40.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.249+0000 7faad37fe700 1 --2- 172.21.15.146:0/3295885853 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faabc066f60 0x7faabc069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:40.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.249+0000 7faad37fe700 1 -- 172.21.15.146:0/3295885853 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5206+0+0 (secure 0 0 0) 0x7faac4083fb0 con 0x7faadc0cb6d0 2023-10-06T11:08:40.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.249+0000 7faadaffd700 1 --2- 172.21.15.146:0/3295885853 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faabc066f60 0x7faabc069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:40.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.249+0000 7faadaffd700 1 --2- 172.21.15.146:0/3295885853 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faabc066f60 0x7faabc069410 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7faacc006fd0 tx=0x7faacc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:40.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.253+0000 7faad37fe700 1 -- 172.21.15.146:0/3295885853 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faac40b55a0 con 0x7faadc0cb6d0 2023-10-06T11:08:40.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:40.438+0000 7faae19d8700 1 -- 172.21.15.146:0/3295885853 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7faadc04c380 con 0x7faadc0cb6d0 2023-10-06T11:08:41.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.404+0000 7faad37fe700 1 -- 172.21.15.146:0/3295885853 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v44) v1 ==== 138+0+0 (secure 0 0 0) 0x7faadc0aa3a0 con 0x7faadc0cb6d0 2023-10-06T11:08:41.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.408+0000 7faae19d8700 1 -- 172.21.15.146:0/3295885853 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faabc066f60 msgr2=0x7faabc069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:41.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.408+0000 7faae19d8700 1 --2- 172.21.15.146:0/3295885853 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faabc066f60 0x7faabc069410 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7faacc006fd0 tx=0x7faacc008040 comp rx=0 tx=0).stop 2023-10-06T11:08:41.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.408+0000 7faae19d8700 1 -- 172.21.15.146:0/3295885853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faadc0cb6d0 msgr2=0x7faadc157620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:41.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.408+0000 7faae19d8700 1 --2- 172.21.15.146:0/3295885853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faadc0cb6d0 0x7faadc157620 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7faac400c590 tx=0x7faac4007f30 comp rx=0 tx=0).stop 2023-10-06T11:08:41.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.408+0000 7faae19d8700 1 -- 172.21.15.146:0/3295885853 shutdown_connections 2023-10-06T11:08:41.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.408+0000 7faae19d8700 1 --2- 172.21.15.146:0/3295885853 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faabc066f60 0x7faabc069410 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:41.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.408+0000 7faae19d8700 1 --2- 172.21.15.146:0/3295885853 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faadc1596e0 0x7faadc157b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:41.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.408+0000 7faae19d8700 1 --2- 172.21.15.146:0/3295885853 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faadc067b80 0x7faadc0ae030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:41.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.408+0000 7faae19d8700 1 --2- 172.21.15.146:0/3295885853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faadc0cb6d0 0x7faadc157620 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:41.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.408+0000 7faae19d8700 1 -- 172.21.15.146:0/3295885853 >> 172.21.15.146:0/3295885853 conn(0x7faadc069050 msgr2=0x7faadc158350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:41.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.409+0000 7faae19d8700 1 -- 172.21.15.146:0/3295885853 shutdown_connections 2023-10-06T11:08:41.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.410+0000 7faae19d8700 1 -- 172.21.15.146:0/3295885853 wait complete. 2023-10-06T11:08:41.413 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' created 2023-10-06T11:08:41.426 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T11:08:41.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.549+0000 7feb60fb5700 1 Processor -- start 2023-10-06T11:08:41.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.549+0000 7feb60fb5700 1 -- start start 2023-10-06T11:08:41.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.550+0000 7feb60fb5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7feb5c06b8a0 0x7feb5c0b0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:41.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.550+0000 7feb60fb5700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7feb5c06bc70 0x7feb5c15b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:41.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.550+0000 7feb60fb5700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb5c140800 0x7feb5c140c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:41.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.550+0000 7feb60fb5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb5c0c9d40 con 0x7feb5c06b8a0 2023-10-06T11:08:41.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.550+0000 7feb60fb5700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb5c0cbe00 con 0x7feb5c06bc70 2023-10-06T11:08:41.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.550+0000 7feb60fb5700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb5c0c90f0 con 0x7feb5c140800 2023-10-06T11:08:41.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.550+0000 7feb5b7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7feb5c06b8a0 0x7feb5c0b0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:41.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.550+0000 7feb5b7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7feb5c06b8a0 0x7feb5c0b0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60744/0 (socket says 172.21.15.146:60744) 2023-10-06T11:08:41.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.550+0000 7feb5b7fe700 1 -- 172.21.15.146:0/3194746849 learned_addr learned my addr 172.21.15.146:0/3194746849 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:41.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.551+0000 7feb5b7fe700 1 -- 172.21.15.146:0/3194746849 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb5c140800 msgr2=0x7feb5c140c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:41.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.551+0000 7feb5b7fe700 1 --2- 172.21.15.146:0/3194746849 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb5c140800 0x7feb5c140c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:41.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.551+0000 7feb5b7fe700 1 -- 172.21.15.146:0/3194746849 >> v2:172.21.15.151:3300/0 conn(0x7feb5c06bc70 msgr2=0x7feb5c15b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:41.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.551+0000 7feb5affd700 1 --2- 172.21.15.146:0/3194746849 >> v2:172.21.15.151:3300/0 conn(0x7feb5c06bc70 0x7feb5c15b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:41.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.551+0000 7feb5b7fe700 1 --2- 172.21.15.146:0/3194746849 >> v2:172.21.15.151:3300/0 conn(0x7feb5c06bc70 0x7feb5c15b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:41.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.551+0000 7feb5b7fe700 1 -- 172.21.15.146:0/3194746849 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb5c0cc350 con 0x7feb5c06b8a0 2023-10-06T11:08:41.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.551+0000 7feb5affd700 1 --2- 172.21.15.146:0/3194746849 >> v2:172.21.15.151:3300/0 conn(0x7feb5c06bc70 0x7feb5c15b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:08:41.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.551+0000 7feb5b7fe700 1 --2- 172.21.15.146:0/3194746849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb5c06b8a0 0x7feb5c0b0ff0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7feb5c0b41f0 tx=0x7feb4c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e2bac0811a97b27 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:41.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.551+0000 7feb5a7fc700 1 -- 172.21.15.146:0/3194746849 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4c00e070 con 0x7feb5c06b8a0 2023-10-06T11:08:41.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.551+0000 7feb5a7fc700 1 -- 172.21.15.146:0/3194746849 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb4c00ba50 con 0x7feb5c06b8a0 2023-10-06T11:08:41.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.551+0000 7feb5a7fc700 1 -- 172.21.15.146:0/3194746849 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4c0092e0 con 0x7feb5c06b8a0 2023-10-06T11:08:41.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.552+0000 7feb60fb5700 1 -- 172.21.15.146:0/3194746849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb5c06b8a0 msgr2=0x7feb5c0b0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:41.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.552+0000 7feb60fb5700 1 --2- 172.21.15.146:0/3194746849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb5c06b8a0 0x7feb5c0b0ff0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7feb5c0b41f0 tx=0x7feb4c009840 comp rx=0 tx=0).stop 2023-10-06T11:08:41.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.552+0000 7feb60fb5700 1 -- 172.21.15.146:0/3194746849 shutdown_connections 2023-10-06T11:08:41.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.552+0000 7feb60fb5700 1 --2- 172.21.15.146:0/3194746849 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb5c140800 0x7feb5c140c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:41.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.552+0000 7feb60fb5700 1 --2- 172.21.15.146:0/3194746849 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb5c06b8a0 0x7feb5c0b0ff0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:41.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.552+0000 7feb60fb5700 1 --2- 172.21.15.146:0/3194746849 >> v2:172.21.15.151:3300/0 conn(0x7feb5c06bc70 0x7feb5c15b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:41.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.552+0000 7feb60fb5700 1 -- 172.21.15.146:0/3194746849 >> 172.21.15.146:0/3194746849 conn(0x7feb5c0ce230 msgr2=0x7feb5c0ce630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:41.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.552+0000 7feb60fb5700 1 -- 172.21.15.146:0/3194746849 shutdown_connections 2023-10-06T11:08:41.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.552+0000 7feb60fb5700 1 -- 172.21.15.146:0/3194746849 wait complete. 2023-10-06T11:08:41.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.553+0000 7feb60fb5700 1 Processor -- start 2023-10-06T11:08:41.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.553+0000 7feb60fb5700 1 -- start start 2023-10-06T11:08:41.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.554+0000 7feb60fb5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb5c06b8a0 0x7feb5c1594e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:41.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.554+0000 7feb60fb5700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb5c06bc70 0x7feb5c0a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:41.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.554+0000 7feb60fb5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb5c140800 0x7feb5c0c72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:41.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.554+0000 7feb60fb5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5c169d00 con 0x7feb5c140800 2023-10-06T11:08:41.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.554+0000 7feb60fb5700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5c15c150 con 0x7feb5c06b8a0 2023-10-06T11:08:41.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.554+0000 7feb60fb5700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb5c15b8b0 con 0x7feb5c06bc70 2023-10-06T11:08:41.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.554+0000 7feb5bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb5c140800 0x7feb5c0c72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:41.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.554+0000 7feb5bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb5c140800 0x7feb5c0c72f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60750/0 (socket says 172.21.15.146:60750) 2023-10-06T11:08:41.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.554+0000 7feb5bfff700 1 -- 172.21.15.146:0/241641136 learned_addr learned my addr 172.21.15.146:0/241641136 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:41.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.554+0000 7feb5affd700 1 --2- 172.21.15.146:0/241641136 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb5c06bc70 0x7feb5c0a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:41.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.554+0000 7feb5b7fe700 1 --2- 172.21.15.146:0/241641136 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb5c06b8a0 0x7feb5c1594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:41.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.554+0000 7feb5bfff700 1 -- 172.21.15.146:0/241641136 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb5c06bc70 msgr2=0x7feb5c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:41.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.554+0000 7feb5bfff700 1 --2- 172.21.15.146:0/241641136 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb5c06bc70 0x7feb5c0a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:41.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.554+0000 7feb5bfff700 1 -- 172.21.15.146:0/241641136 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb5c06b8a0 msgr2=0x7feb5c1594e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:41.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.554+0000 7feb5bfff700 1 --2- 172.21.15.146:0/241641136 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb5c06b8a0 0x7feb5c1594e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:41.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.554+0000 7feb5bfff700 1 -- 172.21.15.146:0/241641136 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb4c009ae0 con 0x7feb5c140800 2023-10-06T11:08:41.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.554+0000 7feb5bfff700 1 --2- 172.21.15.146:0/241641136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb5c140800 0x7feb5c0c72f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7feb5400b5c0 tx=0x7feb54006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:41.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.554+0000 7feb437fe700 1 -- 172.21.15.146:0/241641136 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5400f510 con 0x7feb5c140800 2023-10-06T11:08:41.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.554+0000 7feb437fe700 1 -- 172.21.15.146:0/241641136 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb5400f690 con 0x7feb5c140800 2023-10-06T11:08:41.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.554+0000 7feb437fe700 1 -- 172.21.15.146:0/241641136 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5400fa50 con 0x7feb5c140800 2023-10-06T11:08:41.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.554+0000 7feb60fb5700 1 -- 172.21.15.146:0/241641136 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb5c15bb90 con 0x7feb5c140800 2023-10-06T11:08:41.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.555+0000 7feb60fb5700 1 -- 172.21.15.146:0/241641136 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb5c06a2a0 con 0x7feb5c140800 2023-10-06T11:08:41.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.556+0000 7feb60fb5700 1 -- 172.21.15.146:0/241641136 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb5c169eb0 con 0x7feb5c140800 2023-10-06T11:08:41.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.556+0000 7feb437fe700 1 -- 172.21.15.146:0/241641136 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feb5401a400 con 0x7feb5c140800 2023-10-06T11:08:41.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.556+0000 7feb437fe700 1 --2- 172.21.15.146:0/241641136 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feb48066f30 0x7feb480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:41.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.557+0000 7feb437fe700 1 -- 172.21.15.146:0/241641136 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5576+0+0 (secure 0 0 0) 0x7feb54083d70 con 0x7feb5c140800 2023-10-06T11:08:41.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.557+0000 7feb5b7fe700 1 --2- 172.21.15.146:0/241641136 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feb48066f30 0x7feb480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:41.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.557+0000 7feb5b7fe700 1 --2- 172.21.15.146:0/241641136 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feb48066f30 0x7feb480693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7feb4c009880 tx=0x7feb4c018000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:41.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.561+0000 7feb437fe700 1 -- 172.21.15.146:0/241641136 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feb540510e0 con 0x7feb5c140800 2023-10-06T11:08:41.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:41.746+0000 7feb60fb5700 1 -- 172.21.15.146:0/241641136 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7feb5c0c9290 con 0x7feb5c140800 2023-10-06T11:08:42.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.411+0000 7feb437fe700 1 -- 172.21.15.146:0/241641136 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v45) v1 ==== 170+0+0 (secure 0 0 0) 0x7feb54054700 con 0x7feb5c140800 2023-10-06T11:08:42.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.415+0000 7feb60fb5700 1 -- 172.21.15.146:0/241641136 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feb48066f30 msgr2=0x7feb480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:42.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.415+0000 7feb60fb5700 1 --2- 172.21.15.146:0/241641136 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feb48066f30 0x7feb480693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7feb4c009880 tx=0x7feb4c018000 comp rx=0 tx=0).stop 2023-10-06T11:08:42.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.415+0000 7feb60fb5700 1 -- 172.21.15.146:0/241641136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb5c140800 msgr2=0x7feb5c0c72f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:42.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.415+0000 7feb60fb5700 1 --2- 172.21.15.146:0/241641136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb5c140800 0x7feb5c0c72f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7feb5400b5c0 tx=0x7feb54006f90 comp rx=0 tx=0).stop 2023-10-06T11:08:42.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.415+0000 7feb60fb5700 1 -- 172.21.15.146:0/241641136 shutdown_connections 2023-10-06T11:08:42.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.415+0000 7feb60fb5700 1 --2- 172.21.15.146:0/241641136 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feb48066f30 0x7feb480693e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:42.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.415+0000 7feb60fb5700 1 --2- 172.21.15.146:0/241641136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb5c140800 0x7feb5c0c72f0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:42.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.415+0000 7feb60fb5700 1 --2- 172.21.15.146:0/241641136 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb5c06b8a0 0x7feb5c1594e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:42.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.415+0000 7feb60fb5700 1 --2- 172.21.15.146:0/241641136 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb5c06bc70 0x7feb5c0a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:42.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.415+0000 7feb60fb5700 1 -- 172.21.15.146:0/241641136 >> 172.21.15.146:0/241641136 conn(0x7feb5c0ce230 msgr2=0x7feb5c0c2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:42.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.418+0000 7feb60fb5700 1 -- 172.21.15.146:0/241641136 shutdown_connections 2023-10-06T11:08:42.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.418+0000 7feb60fb5700 1 -- 172.21.15.146:0/241641136 wait complete. 2023-10-06T11:08:42.425 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' created 2023-10-06T11:08:42.441 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T11:08:42.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.558+0000 7fc4ae16d700 1 Processor -- start 2023-10-06T11:08:42.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.558+0000 7fc4ae16d700 1 -- start start 2023-10-06T11:08:42.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.559+0000 7fc4ae16d700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc4a8159f40 0x7fc4a815d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:42.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.559+0000 7fc4ae16d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4a80c7810 0x7fc4a815dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:42.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.559+0000 7fc4ae16d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4a80d1670 con 0x7fc4a815e420 2023-10-06T11:08:42.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.559+0000 7fc4ae16d700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4a80cc4b0 con 0x7fc4a8159f40 2023-10-06T11:08:42.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.559+0000 7fc4ae16d700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a815a310 con 0x7fc4a80c7810 2023-10-06T11:08:42.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.559+0000 7fc4a7fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc4a815e420 0x7fc4a80cf300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40002/0 (socket says 172.21.15.146:40002) 2023-10-06T11:08:42.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.559+0000 7fc4a7fff700 1 -- 172.21.15.146:0/3187313906 learned_addr learned my addr 172.21.15.146:0/3187313906 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:08:42.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.559+0000 7fc4a77fe700 1 --2- 172.21.15.146:0/3187313906 >> v2:172.21.15.151:3300/0 conn(0x7fc4a8159f40 0x7fc4a815d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:42.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.559+0000 7fc4a6ffd700 1 --2- 172.21.15.146:0/3187313906 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4a80c7810 0x7fc4a815dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:42.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.559+0000 7fc4a67fc700 1 -- 172.21.15.146:0/3187313906 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2567797859 0 0) 0x7fc4a80d1670 con 0x7fc4a815e420 2023-10-06T11:08:42.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.559+0000 7fc4a67fc700 1 -- 172.21.15.146:0/3187313906 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc490003570 con 0x7fc4a815e420 2023-10-06T11:08:42.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.559+0000 7fc4a67fc700 1 -- 172.21.15.146:0/3187313906 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 59361257 0 0) 0x7fc490003570 con 0x7fc4a815e420 2023-10-06T11:08:42.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.559+0000 7fc4a67fc700 1 -- 172.21.15.146:0/3187313906 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4a80c7810 msgr2=0x7fc4a815dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:42.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.559+0000 7fc4a67fc700 1 --2- 172.21.15.146:0/3187313906 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4a80c7810 0x7fc4a815dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:42.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.559+0000 7fc4a67fc700 1 -- 172.21.15.146:0/3187313906 >> v2:172.21.15.151:3300/0 conn(0x7fc4a8159f40 msgr2=0x7fc4a815d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:42.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.559+0000 7fc4a67fc700 1 --2- 172.21.15.146:0/3187313906 >> v2:172.21.15.151:3300/0 conn(0x7fc4a8159f40 0x7fc4a815d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:42.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.559+0000 7fc4a67fc700 1 -- 172.21.15.146:0/3187313906 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a80cee70 con 0x7fc4a815e420 2023-10-06T11:08:42.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.559+0000 7fc4a67fc700 1 -- 172.21.15.146:0/3187313906 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fc4a00017f0 con 0x7fc4a815e420 2023-10-06T11:08:42.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.559+0000 7fc4a67fc700 1 -- 172.21.15.146:0/3187313906 >> v1:172.21.15.146:6789/0 conn(0x7fc4a815e420 legacy=0x7fc4a80cf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:42.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.559+0000 7fc4a67fc700 1 --2- 172.21.15.146:0/3187313906 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4a80c7810 0x7fc490003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:42.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.559+0000 7fc4a67fc700 1 --2- 172.21.15.146:0/3187313906 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc490004010 0x7fc490004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:42.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.559+0000 7fc4a67fc700 1 --2- 172.21.15.146:0/3187313906 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc490004d50 0x7fc4900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:42.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.559+0000 7fc4a67fc700 1 -- 172.21.15.146:0/3187313906 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a80cc4b0 con 0x7fc490004010 2023-10-06T11:08:42.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.559+0000 7fc4a67fc700 1 -- 172.21.15.146:0/3187313906 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a815a310 con 0x7fc490004d50 2023-10-06T11:08:42.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.559+0000 7fc4a67fc700 1 -- 172.21.15.146:0/3187313906 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc49000bab0 con 0x7fc4a80c7810 2023-10-06T11:08:42.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.560+0000 7fc4a6ffd700 1 --2- 172.21.15.146:0/3187313906 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc490004010 0x7fc490004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:42.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.560+0000 7fc4a77fe700 1 --2- 172.21.15.146:0/3187313906 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4a80c7810 0x7fc490003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:42.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.560+0000 7fc4a7fff700 1 --2- 172.21.15.146:0/3187313906 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc490004d50 0x7fc4900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:42.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.560+0000 7fc4a6ffd700 1 -- 172.21.15.146:0/3187313906 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4a80c7810 msgr2=0x7fc490003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:42.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.560+0000 7fc4a6ffd700 1 --2- 172.21.15.146:0/3187313906 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4a80c7810 0x7fc490003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:42.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.560+0000 7fc4a6ffd700 1 -- 172.21.15.146:0/3187313906 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc490004d50 msgr2=0x7fc4900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:42.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.560+0000 7fc4a6ffd700 1 --2- 172.21.15.146:0/3187313906 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc490004d50 0x7fc4900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:42.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.560+0000 7fc4a6ffd700 1 -- 172.21.15.146:0/3187313906 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc490003570 con 0x7fc490004010 2023-10-06T11:08:42.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.560+0000 7fc4a6ffd700 1 --2- 172.21.15.146:0/3187313906 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc490004010 0x7fc490004810 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fc498009c00 tx=0x7fc4980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eee0670be19cb4a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:42.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.560+0000 7fc4a67fc700 1 -- 172.21.15.146:0/3187313906 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49800e710 con 0x7fc490004010 2023-10-06T11:08:42.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.560+0000 7fc4a67fc700 1 -- 172.21.15.146:0/3187313906 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc49800e870 con 0x7fc490004010 2023-10-06T11:08:42.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.560+0000 7fc4a67fc700 1 -- 172.21.15.146:0/3187313906 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49800ec30 con 0x7fc490004010 2023-10-06T11:08:42.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.561+0000 7fc4ae16d700 1 -- 172.21.15.146:0/3187313906 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc490004010 msgr2=0x7fc490004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:42.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.561+0000 7fc4ae16d700 1 --2- 172.21.15.146:0/3187313906 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc490004010 0x7fc490004810 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fc498009c00 tx=0x7fc4980091a0 comp rx=0 tx=0).stop 2023-10-06T11:08:42.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.561+0000 7fc4a7fff700 1 -- 172.21.15.146:0/3187313906 reap_dead start 2023-10-06T11:08:42.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.561+0000 7fc4ae16d700 1 -- 172.21.15.146:0/3187313906 shutdown_connections 2023-10-06T11:08:42.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.561+0000 7fc4ae16d700 1 -- 172.21.15.146:0/3187313906 >> 172.21.15.146:0/3187313906 conn(0x7fc4a806f380 msgr2=0x7fc4a80d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:42.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.561+0000 7fc4ae16d700 1 -- 172.21.15.146:0/3187313906 shutdown_connections 2023-10-06T11:08:42.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.561+0000 7fc4ae16d700 1 -- 172.21.15.146:0/3187313906 wait complete. 2023-10-06T11:08:42.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.562+0000 7fc4ae16d700 1 Processor -- start 2023-10-06T11:08:42.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.562+0000 7fc4ae16d700 1 -- start start 2023-10-06T11:08:42.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.563+0000 7fc4ae16d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc490004010 0x7fc4a815c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:42.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.563+0000 7fc4ae16d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4a80ca5c0 0x7fc4a8158d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:42.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.563+0000 7fc4ae16d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4a815d520 0x7fc4a815d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:42.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.563+0000 7fc4ae16d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a815dee0 con 0x7fc490004010 2023-10-06T11:08:42.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.563+0000 7fc4ae16d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a80cb6a0 con 0x7fc4a815d520 2023-10-06T11:08:42.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.563+0000 7fc4ae16d700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a80caa90 con 0x7fc4a80ca5c0 2023-10-06T11:08:42.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.563+0000 7fc4a77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc490004010 0x7fc4a815c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:42.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.563+0000 7fc4a77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc490004010 0x7fc4a815c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60768/0 (socket says 172.21.15.146:60768) 2023-10-06T11:08:42.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.563+0000 7fc4a77fe700 1 -- 172.21.15.146:0/1172010712 learned_addr learned my addr 172.21.15.146:0/1172010712 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:42.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.563+0000 7fc4a6ffd700 1 --2- 172.21.15.146:0/1172010712 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4a80ca5c0 0x7fc4a8158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:42.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.563+0000 7fc4a7fff700 1 --2- 172.21.15.146:0/1172010712 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4a815d520 0x7fc4a815d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:42.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.563+0000 7fc4a77fe700 1 -- 172.21.15.146:0/1172010712 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4a80ca5c0 msgr2=0x7fc4a8158d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:42.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.563+0000 7fc4a77fe700 1 --2- 172.21.15.146:0/1172010712 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4a80ca5c0 0x7fc4a8158d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:42.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.563+0000 7fc4a77fe700 1 -- 172.21.15.146:0/1172010712 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4a815d520 msgr2=0x7fc4a815d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:42.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.563+0000 7fc4a77fe700 1 --2- 172.21.15.146:0/1172010712 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4a815d520 0x7fc4a815d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:42.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.563+0000 7fc4a77fe700 1 -- 172.21.15.146:0/1172010712 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a80cad70 con 0x7fc490004010 2023-10-06T11:08:42.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.563+0000 7fc4a77fe700 1 --2- 172.21.15.146:0/1172010712 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc490004010 0x7fc4a815c2d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fc49c011b60 tx=0x7fc49c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:42.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.563+0000 7fc48f7fe700 1 -- 172.21.15.146:0/1172010712 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49c005c10 con 0x7fc490004010 2023-10-06T11:08:42.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.563+0000 7fc48f7fe700 1 -- 172.21.15.146:0/1172010712 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc49c005d70 con 0x7fc490004010 2023-10-06T11:08:42.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.563+0000 7fc4ae16d700 1 -- 172.21.15.146:0/1172010712 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4a80cb050 con 0x7fc490004010 2023-10-06T11:08:42.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.563+0000 7fc48f7fe700 1 -- 172.21.15.146:0/1172010712 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49c00f980 con 0x7fc490004010 2023-10-06T11:08:42.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.563+0000 7fc4ae16d700 1 -- 172.21.15.146:0/1172010712 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4a815c810 con 0x7fc490004010 2023-10-06T11:08:42.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.565+0000 7fc4ae16d700 1 -- 172.21.15.146:0/1172010712 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4a804c380 con 0x7fc490004010 2023-10-06T11:08:42.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.565+0000 7fc48f7fe700 1 -- 172.21.15.146:0/1172010712 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc49c006050 con 0x7fc490004010 2023-10-06T11:08:42.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.565+0000 7fc48f7fe700 1 --2- 172.21.15.146:0/1172010712 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc494066fb0 0x7fc494069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:42.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.565+0000 7fc48f7fe700 1 -- 172.21.15.146:0/1172010712 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5958+0+0 (secure 0 0 0) 0x7fc49c084e70 con 0x7fc490004010 2023-10-06T11:08:42.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.565+0000 7fc4a6ffd700 1 --2- 172.21.15.146:0/1172010712 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc494066fb0 0x7fc494069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:42.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.566+0000 7fc4a6ffd700 1 --2- 172.21.15.146:0/1172010712 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc494066fb0 0x7fc494069460 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc4980091e0 tx=0x7fc49801a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:42.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.570+0000 7fc48f7fe700 1 -- 172.21.15.146:0/1172010712 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc49c051f40 con 0x7fc490004010 2023-10-06T11:08:42.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:42.795+0000 7fc4ae16d700 1 -- 172.21.15.146:0/1172010712 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc4a809bbd0 con 0x7fc490004010 2023-10-06T11:08:43.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.425+0000 7fc48f7fe700 1 -- 172.21.15.146:0/1172010712 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v31) v1 ==== 172+0+0 (secure 0 0 0) 0x7fc49c0210c0 con 0x7fc490004010 2023-10-06T11:08:43.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.434+0000 7fc4ae16d700 1 -- 172.21.15.146:0/1172010712 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc494066fb0 msgr2=0x7fc494069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:43.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.434+0000 7fc4ae16d700 1 --2- 172.21.15.146:0/1172010712 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc494066fb0 0x7fc494069460 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc4980091e0 tx=0x7fc49801a000 comp rx=0 tx=0).stop 2023-10-06T11:08:43.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.434+0000 7fc4ae16d700 1 -- 172.21.15.146:0/1172010712 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc490004010 msgr2=0x7fc4a815c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:43.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.434+0000 7fc4ae16d700 1 --2- 172.21.15.146:0/1172010712 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc490004010 0x7fc4a815c2d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fc49c011b60 tx=0x7fc49c009120 comp rx=0 tx=0).stop 2023-10-06T11:08:43.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.436+0000 7fc4ae16d700 1 -- 172.21.15.146:0/1172010712 shutdown_connections 2023-10-06T11:08:43.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.436+0000 7fc4ae16d700 1 --2- 172.21.15.146:0/1172010712 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc494066fb0 0x7fc494069460 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:43.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.436+0000 7fc4ae16d700 1 --2- 172.21.15.146:0/1172010712 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc4a815d520 0x7fc4a815d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:43.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.436+0000 7fc4ae16d700 1 --2- 172.21.15.146:0/1172010712 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc490004010 0x7fc4a815c2d0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:43.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.436+0000 7fc4ae16d700 1 --2- 172.21.15.146:0/1172010712 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4a80ca5c0 0x7fc4a8158d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:43.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.436+0000 7fc4ae16d700 1 -- 172.21.15.146:0/1172010712 >> 172.21.15.146:0/1172010712 conn(0x7fc4a806f380 msgr2=0x7fc4a8069af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:43.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.438+0000 7fc4ae16d700 1 -- 172.21.15.146:0/1172010712 shutdown_connections 2023-10-06T11:08:43.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.438+0000 7fc4ae16d700 1 -- 172.21.15.146:0/1172010712 wait complete. 2023-10-06T11:08:43.441 INFO:teuthology.orchestra.run.smithi146.stderr:new fs with metadata pool 7 and data pool 8 2023-10-06T11:08:43.453 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:08:43.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.567+0000 7fabacddb700 1 Processor -- start 2023-10-06T11:08:43.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.567+0000 7fabacddb700 1 -- start start 2023-10-06T11:08:43.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.568+0000 7fabacddb700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faba80ced80 0x7faba80c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:43.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.568+0000 7fabacddb700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faba80c3910 0x7faba80cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:43.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.568+0000 7fabacddb700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faba80cf210 con 0x7faba80b0c00 2023-10-06T11:08:43.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.568+0000 7fabacddb700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faba80682f0 con 0x7faba80c3910 2023-10-06T11:08:43.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.568+0000 7fabacddb700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba8068580 con 0x7faba80ced80 2023-10-06T11:08:43.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.568+0000 7faba6d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faba80c3910 0x7faba80cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:43.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.568+0000 7faba659c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7faba80b0c00 0x7faba80c3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40018/0 (socket says 172.21.15.146:40018) 2023-10-06T11:08:43.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.568+0000 7faba659c700 1 -- 172.21.15.146:0/3724642751 learned_addr learned my addr 172.21.15.146:0/3724642751 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:08:43.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.569+0000 7faba5d9b700 1 --2- 172.21.15.146:0/3724642751 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faba80ced80 0x7faba80c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:43.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.569+0000 7faba6d9d700 1 -- 172.21.15.146:0/3724642751 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faba80ced80 msgr2=0x7faba80c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:43.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.569+0000 7faba6d9d700 1 --2- 172.21.15.146:0/3724642751 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faba80ced80 0x7faba80c8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:43.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.569+0000 7faba6d9d700 1 -- 172.21.15.146:0/3724642751 >> v1:172.21.15.146:6789/0 conn(0x7faba80b0c00 legacy=0x7faba80c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:43.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.569+0000 7faba6d9d700 1 -- 172.21.15.146:0/3724642751 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba8068790 con 0x7faba80c3910 2023-10-06T11:08:43.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.569+0000 7faba559a700 1 -- 172.21.15.146:0/3724642751 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 735190268 0 0) 0x7faba80cf210 con 0x7faba80b0c00 2023-10-06T11:08:43.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.569+0000 7faba6d9d700 1 --2- 172.21.15.146:0/3724642751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faba80c3910 0x7faba80cd8c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7faba00098e0 tx=0x7faba00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8de78ff5039c58ec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:43.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.569+0000 7faba559a700 1 -- 172.21.15.146:0/3724642751 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba0009e80 con 0x7faba80c3910 2023-10-06T11:08:43.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.569+0000 7faba559a700 1 -- 172.21.15.146:0/3724642751 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faba000b8f0 con 0x7faba80c3910 2023-10-06T11:08:43.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.569+0000 7faba559a700 1 -- 172.21.15.146:0/3724642751 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba000bc70 con 0x7faba80c3910 2023-10-06T11:08:43.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.569+0000 7fabacddb700 1 -- 172.21.15.146:0/3724642751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faba80c3910 msgr2=0x7faba80cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:43.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.569+0000 7fabacddb700 1 --2- 172.21.15.146:0/3724642751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faba80c3910 0x7faba80cd8c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7faba00098e0 tx=0x7faba00091a0 comp rx=0 tx=0).stop 2023-10-06T11:08:43.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.570+0000 7fabacddb700 1 -- 172.21.15.146:0/3724642751 shutdown_connections 2023-10-06T11:08:43.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.570+0000 7fabacddb700 1 --2- 172.21.15.146:0/3724642751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faba80c3910 0x7faba80cd8c0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:43.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.570+0000 7fabacddb700 1 --2- 172.21.15.146:0/3724642751 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faba80ced80 0x7faba80c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:43.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.570+0000 7fabacddb700 1 -- 172.21.15.146:0/3724642751 >> 172.21.15.146:0/3724642751 conn(0x7faba8067c50 msgr2=0x7faba80ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:43.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.570+0000 7fabacddb700 1 -- 172.21.15.146:0/3724642751 shutdown_connections 2023-10-06T11:08:43.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.570+0000 7fabacddb700 1 -- 172.21.15.146:0/3724642751 wait complete. 2023-10-06T11:08:43.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.571+0000 7fabacddb700 1 Processor -- start 2023-10-06T11:08:43.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.571+0000 7fabacddb700 1 -- start start 2023-10-06T11:08:43.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.571+0000 7fabacddb700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faba80b0c00 0x7faba8147240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:43.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.571+0000 7fabacddb700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faba80c3910 0x7faba8155df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:43.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.571+0000 7fabacddb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faba80ced80 0x7faba8157a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:43.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.571+0000 7fabacddb700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba8158720 con 0x7faba80ced80 2023-10-06T11:08:43.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.571+0000 7fabacddb700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba8158a00 con 0x7faba80b0c00 2023-10-06T11:08:43.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.571+0000 7fabacddb700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba8158ce0 con 0x7faba80c3910 2023-10-06T11:08:43.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.571+0000 7faba6d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faba80ced80 0x7faba8157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:43.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.571+0000 7faba6d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faba80ced80 0x7faba8157a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60782/0 (socket says 172.21.15.146:60782) 2023-10-06T11:08:43.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.572+0000 7faba6d9d700 1 -- 172.21.15.146:0/2952138685 learned_addr learned my addr 172.21.15.146:0/2952138685 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:43.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.572+0000 7faba5d9b700 1 --2- 172.21.15.146:0/2952138685 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faba80c3910 0x7faba8155df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:43.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.572+0000 7faba659c700 1 --2- 172.21.15.146:0/2952138685 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faba80b0c00 0x7faba8147240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:43.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.572+0000 7faba6d9d700 1 -- 172.21.15.146:0/2952138685 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faba80c3910 msgr2=0x7faba8155df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:43.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.572+0000 7faba6d9d700 1 --2- 172.21.15.146:0/2952138685 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faba80c3910 0x7faba8155df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:43.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.572+0000 7faba6d9d700 1 -- 172.21.15.146:0/2952138685 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faba80b0c00 msgr2=0x7faba8147240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:43.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.572+0000 7faba6d9d700 1 --2- 172.21.15.146:0/2952138685 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faba80b0c00 0x7faba8147240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:43.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.572+0000 7faba6d9d700 1 -- 172.21.15.146:0/2952138685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba0009420 con 0x7faba80ced80 2023-10-06T11:08:43.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.572+0000 7faba6d9d700 1 --2- 172.21.15.146:0/2952138685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faba80ced80 0x7faba8157a60 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7faba806e410 tx=0x7faba0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:43.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.572+0000 7fab967fc700 1 -- 172.21.15.146:0/2952138685 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba000bc30 con 0x7faba80ced80 2023-10-06T11:08:43.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.572+0000 7fab967fc700 1 -- 172.21.15.146:0/2952138685 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faba0025420 con 0x7faba80ced80 2023-10-06T11:08:43.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.572+0000 7fabacddb700 1 -- 172.21.15.146:0/2952138685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba8158fc0 con 0x7faba80ced80 2023-10-06T11:08:43.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.572+0000 7fab967fc700 1 -- 172.21.15.146:0/2952138685 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba00257e0 con 0x7faba80ced80 2023-10-06T11:08:43.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.572+0000 7fabacddb700 1 -- 172.21.15.146:0/2952138685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba8147780 con 0x7faba80ced80 2023-10-06T11:08:43.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.573+0000 7fabacddb700 1 -- 172.21.15.146:0/2952138685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faba804c380 con 0x7faba80ced80 2023-10-06T11:08:43.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.573+0000 7fab967fc700 1 -- 172.21.15.146:0/2952138685 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faba0023070 con 0x7faba80ced80 2023-10-06T11:08:43.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.574+0000 7fab967fc700 1 --2- 172.21.15.146:0/2952138685 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fab88066f60 0x7fab88069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:43.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.574+0000 7fab967fc700 1 -- 172.21.15.146:0/2952138685 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6058+0+0 (secure 0 0 0) 0x7faba0085f10 con 0x7faba80ced80 2023-10-06T11:08:43.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.574+0000 7faba659c700 1 --2- 172.21.15.146:0/2952138685 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fab88066f60 0x7fab88069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:43.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.574+0000 7faba659c700 1 --2- 172.21.15.146:0/2952138685 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fab88066f60 0x7fab88069410 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fab98007240 tx=0x7fab98001970 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:43.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.578+0000 7fab967fc700 1 -- 172.21.15.146:0/2952138685 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faba0053020 con 0x7faba80ced80 2023-10-06T11:08:43.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.768+0000 7fabacddb700 1 -- 172.21.15.146:0/2952138685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faba80c5d10 con 0x7faba80ced80 2023-10-06T11:08:43.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.769+0000 7fab967fc700 1 -- 172.21.15.146:0/2952138685 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16927 (secure 0 0 0) 0x7faba0056640 con 0x7faba80ced80 2023-10-06T11:08:43.771 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:08:43.771 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":46,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:08:42.797242+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:08:40.456040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-06T11:08:41.764122+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:08:43.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.771+0000 7fabacddb700 1 -- 172.21.15.146:0/2952138685 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fab88066f60 msgr2=0x7fab88069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:43.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.771+0000 7fabacddb700 1 --2- 172.21.15.146:0/2952138685 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fab88066f60 0x7fab88069410 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fab98007240 tx=0x7fab98001970 comp rx=0 tx=0).stop 2023-10-06T11:08:43.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.771+0000 7fabacddb700 1 -- 172.21.15.146:0/2952138685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faba80ced80 msgr2=0x7faba8157a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:43.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.771+0000 7fabacddb700 1 --2- 172.21.15.146:0/2952138685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faba80ced80 0x7faba8157a60 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7faba806e410 tx=0x7faba0017000 comp rx=0 tx=0).stop 2023-10-06T11:08:43.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.771+0000 7fabacddb700 1 -- 172.21.15.146:0/2952138685 shutdown_connections 2023-10-06T11:08:43.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.771+0000 7fabacddb700 1 --2- 172.21.15.146:0/2952138685 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fab88066f60 0x7fab88069410 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:43.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.771+0000 7fabacddb700 1 --2- 172.21.15.146:0/2952138685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faba80ced80 0x7faba8157a60 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:43.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.771+0000 7fabacddb700 1 --2- 172.21.15.146:0/2952138685 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faba80b0c00 0x7faba8147240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:43.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.771+0000 7fabacddb700 1 --2- 172.21.15.146:0/2952138685 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faba80c3910 0x7faba8155df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:43.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.771+0000 7fabacddb700 1 -- 172.21.15.146:0/2952138685 >> 172.21.15.146:0/2952138685 conn(0x7faba8067c50 msgr2=0x7faba8155520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:43.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.771+0000 7fabacddb700 1 -- 172.21.15.146:0/2952138685 shutdown_connections 2023-10-06T11:08:43.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.771+0000 7fabacddb700 1 -- 172.21.15.146:0/2952138685 wait complete. 2023-10-06T11:08:43.786 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:08:43.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.899+0000 7f4911f4a700 1 Processor -- start 2023-10-06T11:08:43.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.899+0000 7f4911f4a700 1 -- start start 2023-10-06T11:08:43.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.900+0000 7f4911f4a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f490c153ab0 0x7f490c15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:43.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.900+0000 7f4911f4a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f490c153e80 0x7f490c068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:43.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.900+0000 7f4911f4a700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f490c15ac30 con 0x7f490c0689d0 2023-10-06T11:08:43.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.900+0000 7f4911f4a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f490c068e50 con 0x7f490c153e80 2023-10-06T11:08:43.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.900+0000 7f4911f4a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f490c0b4510 con 0x7f490c153ab0 2023-10-06T11:08:43.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.900+0000 7f490affd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f490c153e80 0x7f490c068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:43.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.900+0000 7f490affd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f490c153e80 0x7f490c068490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60790/0 (socket says 172.21.15.146:60790) 2023-10-06T11:08:43.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.900+0000 7f490affd700 1 -- 172.21.15.146:0/2854786020 learned_addr learned my addr 172.21.15.146:0/2854786020 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:43.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.900+0000 7f490b7fe700 1 --2- 172.21.15.146:0/2854786020 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f490c153ab0 0x7f490c15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:43.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.900+0000 7f490affd700 1 -- 172.21.15.146:0/2854786020 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f490c153ab0 msgr2=0x7f490c15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:43.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.900+0000 7f490affd700 1 --2- 172.21.15.146:0/2854786020 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f490c153ab0 0x7f490c15a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:43.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.900+0000 7f490affd700 1 -- 172.21.15.146:0/2854786020 >> v1:172.21.15.151:6789/0 conn(0x7f490c0689d0 legacy=0x7f490c15d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:43.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.900+0000 7f490affd700 1 -- 172.21.15.146:0/2854786020 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f490c0b6530 con 0x7f490c153e80 2023-10-06T11:08:43.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.900+0000 7f490affd700 1 --2- 172.21.15.146:0/2854786020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f490c153e80 0x7f490c068490 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f48fc0099b0 tx=0x7f48fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b62208a41045336b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:43.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.900+0000 7f490a7fc700 1 -- 172.21.15.146:0/2854786020 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48fc00b860 con 0x7f490c153e80 2023-10-06T11:08:43.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.900+0000 7f490a7fc700 1 -- 172.21.15.146:0/2854786020 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48fc00b9c0 con 0x7f490c153e80 2023-10-06T11:08:43.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.900+0000 7f490a7fc700 1 -- 172.21.15.146:0/2854786020 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48fc00bd60 con 0x7f490c153e80 2023-10-06T11:08:43.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.901+0000 7f4911f4a700 1 -- 172.21.15.146:0/2854786020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f490c153e80 msgr2=0x7f490c068490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:43.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.901+0000 7f4911f4a700 1 --2- 172.21.15.146:0/2854786020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f490c153e80 0x7f490c068490 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f48fc0099b0 tx=0x7f48fc009250 comp rx=0 tx=0).stop 2023-10-06T11:08:43.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.901+0000 7f4911f4a700 1 -- 172.21.15.146:0/2854786020 shutdown_connections 2023-10-06T11:08:43.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.901+0000 7f4911f4a700 1 --2- 172.21.15.146:0/2854786020 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f490c153ab0 0x7f490c15a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:43.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.901+0000 7f4911f4a700 1 --2- 172.21.15.146:0/2854786020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f490c153e80 0x7f490c068490 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:43.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.901+0000 7f4911f4a700 1 -- 172.21.15.146:0/2854786020 >> 172.21.15.146:0/2854786020 conn(0x7f490c06eba0 msgr2=0x7f490c06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:43.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.901+0000 7f4911f4a700 1 -- 172.21.15.146:0/2854786020 shutdown_connections 2023-10-06T11:08:43.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.901+0000 7f4911f4a700 1 -- 172.21.15.146:0/2854786020 wait complete. 2023-10-06T11:08:43.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.902+0000 7f4911f4a700 1 Processor -- start 2023-10-06T11:08:43.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.902+0000 7f4911f4a700 1 -- start start 2023-10-06T11:08:43.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.903+0000 7f4911f4a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f490c0689d0 0x7f490c13d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:43.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.903+0000 7f4911f4a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f490c153ab0 0x7f490c158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:43.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.903+0000 7f4911f4a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f490c153e80 0x7f490c1528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:43.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.903+0000 7f4911f4a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490c154320 con 0x7f490c0689d0 2023-10-06T11:08:43.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.903+0000 7f4911f4a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490c154600 con 0x7f490c153e80 2023-10-06T11:08:43.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.903+0000 7f4911f4a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f490c13d7d0 con 0x7f490c153ab0 2023-10-06T11:08:43.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.903+0000 7f490b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f490c0689d0 0x7f490c13d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:43.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.903+0000 7f490b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f490c0689d0 0x7f490c13d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60794/0 (socket says 172.21.15.146:60794) 2023-10-06T11:08:43.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.903+0000 7f490b7fe700 1 -- 172.21.15.146:0/2423044525 learned_addr learned my addr 172.21.15.146:0/2423044525 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:43.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.903+0000 7f490b7fe700 1 -- 172.21.15.146:0/2423044525 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f490c153ab0 msgr2=0x7f490c158fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:43.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.903+0000 7f490b7fe700 1 --2- 172.21.15.146:0/2423044525 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f490c153ab0 0x7f490c158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:43.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.903+0000 7f490b7fe700 1 -- 172.21.15.146:0/2423044525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f490c153e80 msgr2=0x7f490c1528e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:43.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.903+0000 7f490bfff700 1 --2- 172.21.15.146:0/2423044525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f490c153e80 0x7f490c1528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:43.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.903+0000 7f490b7fe700 1 --2- 172.21.15.146:0/2423044525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f490c153e80 0x7f490c1528e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:43.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.903+0000 7f490b7fe700 1 -- 172.21.15.146:0/2423044525 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48fc0094f0 con 0x7f490c0689d0 2023-10-06T11:08:43.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.903+0000 7f490b7fe700 1 --2- 172.21.15.146:0/2423044525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f490c0689d0 0x7f490c13d290 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f490000d8c0 tx=0x7f4900008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:43.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.904+0000 7f48f37fe700 1 -- 172.21.15.146:0/2423044525 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490000de60 con 0x7f490c0689d0 2023-10-06T11:08:43.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.904+0000 7f48f37fe700 1 -- 172.21.15.146:0/2423044525 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f490000b780 con 0x7f490c0689d0 2023-10-06T11:08:43.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.904+0000 7f4911f4a700 1 -- 172.21.15.146:0/2423044525 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f490c159a10 con 0x7f490c0689d0 2023-10-06T11:08:43.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.904+0000 7f48f37fe700 1 -- 172.21.15.146:0/2423044525 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490000bb20 con 0x7f490c0689d0 2023-10-06T11:08:43.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.904+0000 7f4911f4a700 1 -- 172.21.15.146:0/2423044525 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f490c159fd0 con 0x7f490c0689d0 2023-10-06T11:08:43.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.905+0000 7f4911f4a700 1 -- 172.21.15.146:0/2423044525 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f490c1548e0 con 0x7f490c0689d0 2023-10-06T11:08:43.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.905+0000 7f48f37fe700 1 -- 172.21.15.146:0/2423044525 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f490001e460 con 0x7f490c0689d0 2023-10-06T11:08:43.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.905+0000 7f48f37fe700 1 --2- 172.21.15.146:0/2423044525 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f48f8066f30 0x7f48f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:43.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.905+0000 7f490affd700 1 --2- 172.21.15.146:0/2423044525 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f48f8066f30 0x7f48f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:43.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.905+0000 7f48f37fe700 1 -- 172.21.15.146:0/2423044525 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4900084d30 con 0x7f490c0689d0 2023-10-06T11:08:43.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.906+0000 7f490affd700 1 --2- 172.21.15.146:0/2423044525 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f48f8066f30 0x7f48f80693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f490c1542f0 tx=0x7f48fc017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:43.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:43.910+0000 7f48f37fe700 1 -- 172.21.15.146:0/2423044525 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4900051e40 con 0x7f490c0689d0 2023-10-06T11:08:44.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.092+0000 7f4911f4a700 1 -- 172.21.15.146:0/2423044525 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f490c04c380 con 0x7f490c0689d0 2023-10-06T11:08:44.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.093+0000 7f48f37fe700 1 -- 172.21.15.146:0/2423044525 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16927 (secure 0 0 0) 0x7f4900055460 con 0x7f490c0689d0 2023-10-06T11:08:44.095 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:08:44.095 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":46,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:08:42.797242+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:08:40.456040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-06T11:08:41.764122+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:08:44.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.095+0000 7f4911f4a700 1 -- 172.21.15.146:0/2423044525 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f48f8066f30 msgr2=0x7f48f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:44.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.095+0000 7f4911f4a700 1 --2- 172.21.15.146:0/2423044525 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f48f8066f30 0x7f48f80693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f490c1542f0 tx=0x7f48fc017000 comp rx=0 tx=0).stop 2023-10-06T11:08:44.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.095+0000 7f4911f4a700 1 -- 172.21.15.146:0/2423044525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f490c0689d0 msgr2=0x7f490c13d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:44.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.095+0000 7f4911f4a700 1 --2- 172.21.15.146:0/2423044525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f490c0689d0 0x7f490c13d290 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f490000d8c0 tx=0x7f4900008040 comp rx=0 tx=0).stop 2023-10-06T11:08:44.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.095+0000 7f4911f4a700 1 -- 172.21.15.146:0/2423044525 shutdown_connections 2023-10-06T11:08:44.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.095+0000 7f4911f4a700 1 --2- 172.21.15.146:0/2423044525 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f48f8066f30 0x7f48f80693e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:44.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.095+0000 7f4911f4a700 1 --2- 172.21.15.146:0/2423044525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f490c153e80 0x7f490c1528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:44.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.095+0000 7f4911f4a700 1 --2- 172.21.15.146:0/2423044525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f490c0689d0 0x7f490c13d290 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:44.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.095+0000 7f4911f4a700 1 --2- 172.21.15.146:0/2423044525 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f490c153ab0 0x7f490c158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:44.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.095+0000 7f4911f4a700 1 -- 172.21.15.146:0/2423044525 >> 172.21.15.146:0/2423044525 conn(0x7f490c06eba0 msgr2=0x7f490c151f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:44.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.095+0000 7f4911f4a700 1 -- 172.21.15.146:0/2423044525 shutdown_connections 2023-10-06T11:08:44.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.095+0000 7f4911f4a700 1 -- 172.21.15.146:0/2423044525 wait complete. 2023-10-06T11:08:44.110 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T11:08:44.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.226+0000 7f098d430700 1 Processor -- start 2023-10-06T11:08:44.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.226+0000 7f098d430700 1 -- start start 2023-10-06T11:08:44.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.227+0000 7f098d430700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09880cb090 0x7f09880cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:44.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.227+0000 7f098d430700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0988068780 0x7f0988068be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:44.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.227+0000 7f098d430700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0988069120 con 0x7f09880b5640 2023-10-06T11:08:44.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.227+0000 7f098d430700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09880cc130 con 0x7f0988068780 2023-10-06T11:08:44.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.227+0000 7f098d430700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09880b2660 con 0x7f09880cb090 2023-10-06T11:08:44.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.227+0000 7f098cc2f700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0988068780 0x7f0988068be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:44.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.227+0000 7f09877fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09880cb090 0x7f09880cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:44.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.227+0000 7f09877fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09880cb090 0x7f09880cc5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:35024/0 (socket says 172.21.15.146:35024) 2023-10-06T11:08:44.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.227+0000 7f098cc2f700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0988068780 0x7f0988068be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:49168/0 (socket says 172.21.15.146:49168) 2023-10-06T11:08:44.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.227+0000 7f09877fe700 1 -- 172.21.15.146:0/3258503011 learned_addr learned my addr 172.21.15.146:0/3258503011 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:44.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.227+0000 7f0987fff700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f09880b5640 0x7f098815a870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:51422/0 (socket says 172.21.15.146:51422) 2023-10-06T11:08:44.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.228+0000 7f09877fe700 1 -- 172.21.15.146:0/3258503011 >> v2:172.21.15.151:3300/0 conn(0x7f0988068780 msgr2=0x7f0988068be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:44.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.228+0000 7f09877fe700 1 --2- 172.21.15.146:0/3258503011 >> v2:172.21.15.151:3300/0 conn(0x7f0988068780 0x7f0988068be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:44.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.228+0000 7f0986ffd700 1 -- 172.21.15.146:0/3258503011 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2020209135 0 0) 0x7f0978001110 con 0x7f09880b5640 2023-10-06T11:08:44.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.228+0000 7f09877fe700 1 -- 172.21.15.146:0/3258503011 >> v1:172.21.15.151:6789/0 conn(0x7f09880b5640 legacy=0x7f098815a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:44.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.228+0000 7f09877fe700 1 -- 172.21.15.146:0/3258503011 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09880cb520 con 0x7f09880cb090 2023-10-06T11:08:44.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.228+0000 7f09877fe700 1 --2- 172.21.15.146:0/3258503011 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09880cb090 0x7f09880cc5c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f097c0099b0 tx=0x7f097c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87aa9e690663dc0e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:44.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.228+0000 7f0986ffd700 1 -- 172.21.15.146:0/3258503011 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c009ea0 con 0x7f09880cb090 2023-10-06T11:08:44.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.228+0000 7f0986ffd700 1 -- 172.21.15.146:0/3258503011 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f097c00b860 con 0x7f09880cb090 2023-10-06T11:08:44.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.228+0000 7f0986ffd700 1 -- 172.21.15.146:0/3258503011 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097c00bc00 con 0x7f09880cb090 2023-10-06T11:08:44.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.229+0000 7f098d430700 1 -- 172.21.15.146:0/3258503011 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09880cb090 msgr2=0x7f09880cc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:44.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.229+0000 7f098d430700 1 --2- 172.21.15.146:0/3258503011 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09880cb090 0x7f09880cc5c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f097c0099b0 tx=0x7f097c009250 comp rx=0 tx=0).stop 2023-10-06T11:08:44.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.229+0000 7f098d430700 1 -- 172.21.15.146:0/3258503011 shutdown_connections 2023-10-06T11:08:44.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.229+0000 7f098d430700 1 --2- 172.21.15.146:0/3258503011 >> v2:172.21.15.151:3300/0 conn(0x7f0988068780 0x7f0988068be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:44.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.229+0000 7f098d430700 1 --2- 172.21.15.146:0/3258503011 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09880cb090 0x7f09880cc5c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:44.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.229+0000 7f098d430700 1 -- 172.21.15.146:0/3258503011 >> 172.21.15.146:0/3258503011 conn(0x7f09880703f0 msgr2=0x7f09880707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:44.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.229+0000 7f098d430700 1 -- 172.21.15.146:0/3258503011 shutdown_connections 2023-10-06T11:08:44.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.229+0000 7f098d430700 1 -- 172.21.15.146:0/3258503011 wait complete. 2023-10-06T11:08:44.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.230+0000 7f098d430700 1 Processor -- start 2023-10-06T11:08:44.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.230+0000 7f098d430700 1 -- start start 2023-10-06T11:08:44.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.231+0000 7f098d430700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0988068780 0x7f09880d0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:44.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.231+0000 7f098d430700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09880b5640 0x7f09880c7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:44.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.231+0000 7f098d430700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09880cb090 0x7f09880c6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:44.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.231+0000 7f098d430700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09880c3c00 con 0x7f09880b5640 2023-10-06T11:08:44.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.231+0000 7f098d430700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09880c3ee0 con 0x7f0988068780 2023-10-06T11:08:44.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.231+0000 7f098d430700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09880c41c0 con 0x7f09880cb090 2023-10-06T11:08:44.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.231+0000 7f09877fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09880b5640 0x7f09880c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:44.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.231+0000 7f09877fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09880b5640 0x7f09880c7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60796/0 (socket says 172.21.15.146:60796) 2023-10-06T11:08:44.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.231+0000 7f0987fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0988068780 0x7f09880d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:44.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.231+0000 7f09877fe700 1 -- 172.21.15.146:0/4271195211 learned_addr learned my addr 172.21.15.146:0/4271195211 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:44.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.231+0000 7f098cc2f700 1 --2- 172.21.15.146:0/4271195211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09880cb090 0x7f09880c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:44.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.231+0000 7f098cc2f700 1 -- 172.21.15.146:0/4271195211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0988068780 msgr2=0x7f09880d0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:44.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.231+0000 7f098cc2f700 1 --2- 172.21.15.146:0/4271195211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0988068780 0x7f09880d0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:44.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.231+0000 7f098cc2f700 1 -- 172.21.15.146:0/4271195211 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09880b5640 msgr2=0x7f09880c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:44.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.231+0000 7f098cc2f700 1 --2- 172.21.15.146:0/4271195211 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09880b5640 0x7f09880c7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:44.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.231+0000 7f098cc2f700 1 -- 172.21.15.146:0/4271195211 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097c0094f0 con 0x7f09880cb090 2023-10-06T11:08:44.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.231+0000 7f09877fe700 1 --2- 172.21.15.146:0/4271195211 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09880b5640 0x7f09880c7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:08:44.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.231+0000 7f098cc2f700 1 --2- 172.21.15.146:0/4271195211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09880cb090 0x7f09880c6050 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f098000ecc0 tx=0x7f098000b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:44.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.231+0000 7f096ffff700 1 -- 172.21.15.146:0/4271195211 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098000c8c0 con 0x7f09880cb090 2023-10-06T11:08:44.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.232+0000 7f096ffff700 1 -- 172.21.15.146:0/4271195211 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098000f040 con 0x7f09880cb090 2023-10-06T11:08:44.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.232+0000 7f096ffff700 1 -- 172.21.15.146:0/4271195211 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098000cc70 con 0x7f09880cb090 2023-10-06T11:08:44.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.232+0000 7f098d430700 1 -- 172.21.15.146:0/4271195211 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09880c44a0 con 0x7f09880cb090 2023-10-06T11:08:44.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.232+0000 7f098d430700 1 -- 172.21.15.146:0/4271195211 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0988169c90 con 0x7f09880cb090 2023-10-06T11:08:44.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.232+0000 7f098d430700 1 -- 172.21.15.146:0/4271195211 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09880c46c0 con 0x7f09880cb090 2023-10-06T11:08:44.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.233+0000 7f096ffff700 1 -- 172.21.15.146:0/4271195211 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0980014690 con 0x7f09880cb090 2023-10-06T11:08:44.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.233+0000 7f096ffff700 1 --2- 172.21.15.146:0/4271195211 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0974066f30 0x7f09740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:44.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.233+0000 7f096ffff700 1 -- 172.21.15.146:0/4271195211 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0980085230 con 0x7f09880cb090 2023-10-06T11:08:44.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.233+0000 7f0987fff700 1 --2- 172.21.15.146:0/4271195211 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0974066f30 0x7f09740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:44.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.234+0000 7f0987fff700 1 --2- 172.21.15.146:0/4271195211 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0974066f30 0x7f09740693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0978007fd0 tx=0x7f0978007b90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:44.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.238+0000 7f096ffff700 1 -- 172.21.15.146:0/4271195211 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f09800523c0 con 0x7f09880cb090 2023-10-06T11:08:44.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:44.465+0000 7f098d430700 1 -- 172.21.15.146:0/4271195211 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0988169c90 con 0x7f09880cb090 2023-10-06T11:08:45.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.436+0000 7f096ffff700 1 -- 172.21.15.146:0/4271195211 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v34) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0988169c90 con 0x7f09880cb090 2023-10-06T11:08:45.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.439+0000 7f098d430700 1 -- 172.21.15.146:0/4271195211 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0974066f30 msgr2=0x7f09740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:45.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.439+0000 7f098d430700 1 --2- 172.21.15.146:0/4271195211 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0974066f30 0x7f09740693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0978007fd0 tx=0x7f0978007b90 comp rx=0 tx=0).stop 2023-10-06T11:08:45.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.439+0000 7f098d430700 1 -- 172.21.15.146:0/4271195211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09880cb090 msgr2=0x7f09880c6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:45.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.439+0000 7f098d430700 1 --2- 172.21.15.146:0/4271195211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09880cb090 0x7f09880c6050 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f098000ecc0 tx=0x7f098000b040 comp rx=0 tx=0).stop 2023-10-06T11:08:45.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.439+0000 7f098d430700 1 -- 172.21.15.146:0/4271195211 shutdown_connections 2023-10-06T11:08:45.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.439+0000 7f098d430700 1 --2- 172.21.15.146:0/4271195211 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0974066f30 0x7f09740693e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:45.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.439+0000 7f098d430700 1 --2- 172.21.15.146:0/4271195211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09880cb090 0x7f09880c6050 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:45.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.439+0000 7f098d430700 1 --2- 172.21.15.146:0/4271195211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0988068780 0x7f09880d0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:45.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.439+0000 7f098d430700 1 --2- 172.21.15.146:0/4271195211 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09880b5640 0x7f09880c7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:45.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.439+0000 7f098d430700 1 -- 172.21.15.146:0/4271195211 >> 172.21.15.146:0/4271195211 conn(0x7f09880703f0 msgr2=0x7f09881537e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:45.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.439+0000 7f098d430700 1 -- 172.21.15.146:0/4271195211 shutdown_connections 2023-10-06T11:08:45.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.439+0000 7f098d430700 1 -- 172.21.15.146:0/4271195211 wait complete. 2023-10-06T11:08:45.454 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T11:08:45.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.573+0000 7f590b59e700 1 Processor -- start 2023-10-06T11:08:45.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.573+0000 7f590b59e700 1 -- start start 2023-10-06T11:08:45.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.574+0000 7f590b59e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f590c068780 0x7f590c068bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:45.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.574+0000 7f590b59e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f590c0cc130 con 0x7f590c0cb090 2023-10-06T11:08:45.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.574+0000 7f590b59e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f590c0cccd0 con 0x7f590c0b5640 2023-10-06T11:08:45.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.574+0000 7f590b59e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f590c069100 con 0x7f590c068780 2023-10-06T11:08:45.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.574+0000 7f590ad9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f590c068780 0x7f590c068bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:45.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.574+0000 7f5909d9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f590c0cb090 0x7f590c0cc5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40030/0 (socket says 172.21.15.146:40030) 2023-10-06T11:08:45.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.574+0000 7f5909d9b700 1 -- 172.21.15.146:0/1753648958 learned_addr learned my addr 172.21.15.146:0/1753648958 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:08:45.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.574+0000 7f590ad9d700 1 -- 172.21.15.146:0/1753648958 >> v1:172.21.15.151:6789/0 conn(0x7f590c0b5640 legacy=0x7f590c15a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:45.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.574+0000 7f590ad9d700 1 -- 172.21.15.146:0/1753648958 >> v1:172.21.15.146:6789/0 conn(0x7f590c0cb090 legacy=0x7f590c0cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:45.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.574+0000 7f590ad9d700 1 -- 172.21.15.146:0/1753648958 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f590c0b2660 con 0x7f590c068780 2023-10-06T11:08:45.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.574+0000 7f590959a700 1 -- 172.21.15.146:0/1753648958 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 45377782 0 0) 0x7f590c0cc130 con 0x7f590c0cb090 2023-10-06T11:08:45.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.575+0000 7f590ad9d700 1 --2- 172.21.15.146:0/1753648958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f590c068780 0x7f590c068bc0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5904009e60 tx=0x7f5904009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7cbe2bb75f8466b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:45.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.575+0000 7f590959a700 1 -- 172.21.15.146:0/1753648958 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590400e070 con 0x7f590c068780 2023-10-06T11:08:45.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.575+0000 7f590959a700 1 -- 172.21.15.146:0/1753648958 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f590400bbf0 con 0x7f590c068780 2023-10-06T11:08:45.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.575+0000 7f590959a700 1 -- 172.21.15.146:0/1753648958 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5904012430 con 0x7f590c068780 2023-10-06T11:08:45.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.575+0000 7f590b59e700 1 -- 172.21.15.146:0/1753648958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f590c068780 msgr2=0x7f590c068bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:45.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.575+0000 7f590b59e700 1 --2- 172.21.15.146:0/1753648958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f590c068780 0x7f590c068bc0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5904009e60 tx=0x7f5904009780 comp rx=0 tx=0).stop 2023-10-06T11:08:45.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.575+0000 7f590b59e700 1 -- 172.21.15.146:0/1753648958 shutdown_connections 2023-10-06T11:08:45.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.575+0000 7f590b59e700 1 --2- 172.21.15.146:0/1753648958 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f590c068780 0x7f590c068bc0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:45.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.575+0000 7f590b59e700 1 -- 172.21.15.146:0/1753648958 >> 172.21.15.146:0/1753648958 conn(0x7f590c0703f0 msgr2=0x7f590c0707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:45.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.575+0000 7f590b59e700 1 -- 172.21.15.146:0/1753648958 shutdown_connections 2023-10-06T11:08:45.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.575+0000 7f590b59e700 1 -- 172.21.15.146:0/1753648958 wait complete. 2023-10-06T11:08:45.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.576+0000 7f590b59e700 1 Processor -- start 2023-10-06T11:08:45.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.576+0000 7f590b59e700 1 -- start start 2023-10-06T11:08:45.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.577+0000 7f590b59e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f590c068780 0x7f590c153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:45.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.577+0000 7f590b59e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f590c0b5640 0x7f590c0c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:45.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.577+0000 7f590b59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f590c0cb090 0x7f590c16a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:45.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.577+0000 7f590b59e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590c154190 con 0x7f590c0cb090 2023-10-06T11:08:45.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.577+0000 7f590b59e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590c0c7250 con 0x7f590c0b5640 2023-10-06T11:08:45.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.577+0000 7f590b59e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f590c16a6d0 con 0x7f590c068780 2023-10-06T11:08:45.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.577+0000 7f590ad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f590c0cb090 0x7f590c16a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:45.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.577+0000 7f590ad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f590c0cb090 0x7f590c16a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60814/0 (socket says 172.21.15.146:60814) 2023-10-06T11:08:45.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.577+0000 7f590ad9d700 1 -- 172.21.15.146:0/1320521527 learned_addr learned my addr 172.21.15.146:0/1320521527 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:45.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.577+0000 7f5909d9b700 1 --2- 172.21.15.146:0/1320521527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f590c0b5640 0x7f590c0c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:45.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.577+0000 7f590a59c700 1 --2- 172.21.15.146:0/1320521527 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f590c068780 0x7f590c153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:45.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.577+0000 7f590ad9d700 1 -- 172.21.15.146:0/1320521527 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f590c068780 msgr2=0x7f590c153c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:45.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.577+0000 7f590ad9d700 1 --2- 172.21.15.146:0/1320521527 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f590c068780 0x7f590c153c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:45.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.577+0000 7f590ad9d700 1 -- 172.21.15.146:0/1320521527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f590c0b5640 msgr2=0x7f590c0c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:45.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.577+0000 7f590ad9d700 1 --2- 172.21.15.146:0/1320521527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f590c0b5640 0x7f590c0c6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:45.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.578+0000 7f590ad9d700 1 -- 172.21.15.146:0/1320521527 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5904009a20 con 0x7f590c0cb090 2023-10-06T11:08:45.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.578+0000 7f5909d9b700 1 --2- 172.21.15.146:0/1320521527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f590c0b5640 0x7f590c0c6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:08:45.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.578+0000 7f590ad9d700 1 --2- 172.21.15.146:0/1320521527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f590c0cb090 0x7f590c16a190 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f590400b6c0 tx=0x7f5904018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:45.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.578+0000 7f59027fc700 1 -- 172.21.15.146:0/1320521527 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590401e710 con 0x7f590c0cb090 2023-10-06T11:08:45.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.578+0000 7f59027fc700 1 -- 172.21.15.146:0/1320521527 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f590401e870 con 0x7f590c0cb090 2023-10-06T11:08:45.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.578+0000 7f590b59e700 1 -- 172.21.15.146:0/1320521527 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f590c0c4800 con 0x7f590c0cb090 2023-10-06T11:08:45.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.578+0000 7f59027fc700 1 -- 172.21.15.146:0/1320521527 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590401ec10 con 0x7f590c0cb090 2023-10-06T11:08:45.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.578+0000 7f590b59e700 1 -- 172.21.15.146:0/1320521527 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f590c0c6230 con 0x7f590c0cb090 2023-10-06T11:08:45.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.579+0000 7f590b59e700 1 -- 172.21.15.146:0/1320521527 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f590c0c6090 con 0x7f590c0cb090 2023-10-06T11:08:45.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.579+0000 7f59027fc700 1 -- 172.21.15.146:0/1320521527 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5904024070 con 0x7f590c0cb090 2023-10-06T11:08:45.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.580+0000 7f59027fc700 1 --2- 172.21.15.146:0/1320521527 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f58ec066f30 0x7f58ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:45.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.580+0000 7f59027fc700 1 -- 172.21.15.146:0/1320521527 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f59040871c0 con 0x7f590c0cb090 2023-10-06T11:08:45.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.580+0000 7f590a59c700 1 --2- 172.21.15.146:0/1320521527 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f58ec066f30 0x7f58ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:45.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.580+0000 7f590a59c700 1 --2- 172.21.15.146:0/1320521527 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f58ec066f30 0x7f58ec0693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f590c0b50e0 tx=0x7f58fc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:45.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.584+0000 7f59027fc700 1 -- 172.21.15.146:0/1320521527 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f590c0c6090 con 0x7f590c0cb090 2023-10-06T11:08:45.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:45.812+0000 7f590b59e700 1 -- 172.21.15.146:0/1320521527 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f590c0c6090 con 0x7f590c0cb090 2023-10-06T11:08:46.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.439+0000 7f59027fc700 1 -- 172.21.15.146:0/1320521527 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v35) v1 ==== 122+0+0 (secure 0 0 0) 0x7f590c0c6090 con 0x7f590c0cb090 2023-10-06T11:08:46.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.442+0000 7f590b59e700 1 -- 172.21.15.146:0/1320521527 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f58ec066f30 msgr2=0x7f58ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:46.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.442+0000 7f590b59e700 1 --2- 172.21.15.146:0/1320521527 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f58ec066f30 0x7f58ec0693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f590c0b50e0 tx=0x7f58fc009040 comp rx=0 tx=0).stop 2023-10-06T11:08:46.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.442+0000 7f590b59e700 1 -- 172.21.15.146:0/1320521527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f590c0cb090 msgr2=0x7f590c16a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:46.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.442+0000 7f590b59e700 1 --2- 172.21.15.146:0/1320521527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f590c0cb090 0x7f590c16a190 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f590400b6c0 tx=0x7f5904018000 comp rx=0 tx=0).stop 2023-10-06T11:08:46.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.442+0000 7f590b59e700 1 -- 172.21.15.146:0/1320521527 shutdown_connections 2023-10-06T11:08:46.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.442+0000 7f590b59e700 1 --2- 172.21.15.146:0/1320521527 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f58ec066f30 0x7f58ec0693e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:46.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.442+0000 7f590b59e700 1 --2- 172.21.15.146:0/1320521527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f590c0cb090 0x7f590c16a190 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:46.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.442+0000 7f590b59e700 1 --2- 172.21.15.146:0/1320521527 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f590c068780 0x7f590c153c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:46.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.442+0000 7f590b59e700 1 --2- 172.21.15.146:0/1320521527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f590c0b5640 0x7f590c0c6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:46.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.442+0000 7f590b59e700 1 -- 172.21.15.146:0/1320521527 >> 172.21.15.146:0/1320521527 conn(0x7f590c0703f0 msgr2=0x7f590c0d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:46.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.442+0000 7f590b59e700 1 -- 172.21.15.146:0/1320521527 shutdown_connections 2023-10-06T11:08:46.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.442+0000 7f590b59e700 1 -- 172.21.15.146:0/1320521527 wait complete. 2023-10-06T11:08:46.456 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:08:46.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.569+0000 7faffe177700 1 Processor -- start 2023-10-06T11:08:46.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.569+0000 7faffe177700 1 -- start start 2023-10-06T11:08:46.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.570+0000 7faffe177700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7faff8067b80 0x7faff80aea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:46.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.570+0000 7faffe177700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faff806eb10 con 0x7faff8159720 2023-10-06T11:08:46.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.570+0000 7faffe177700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faff806f6b0 con 0x7faff80a7f30 2023-10-06T11:08:46.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.570+0000 7faffe177700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faff806e7e0 con 0x7faff8067b80 2023-10-06T11:08:46.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.570+0000 7faff77fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7faff8159720 0x7faff806efa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40038/0 (socket says 172.21.15.146:40038) 2023-10-06T11:08:46.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.570+0000 7faff77fe700 1 -- 172.21.15.146:0/692862919 learned_addr learned my addr 172.21.15.146:0/692862919 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:08:46.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.571+0000 7faff67fc700 1 -- 172.21.15.146:0/692862919 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 747605766 0 0) 0x7faff806eb10 con 0x7faff8159720 2023-10-06T11:08:46.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.571+0000 7faff67fc700 1 -- 172.21.15.146:0/692862919 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafe0003570 con 0x7faff8159720 2023-10-06T11:08:46.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.571+0000 7faff7fff700 1 --2- 172.21.15.146:0/692862919 >> v2:172.21.15.151:3300/0 conn(0x7faff8067b80 0x7faff80aea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:46.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.571+0000 7faff67fc700 1 -- 172.21.15.146:0/692862919 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 812706093 0 0) 0x7fafe0003570 con 0x7faff8159720 2023-10-06T11:08:46.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.571+0000 7faff67fc700 1 -- 172.21.15.146:0/692862919 >> v2:172.21.15.151:3300/0 conn(0x7faff8067b80 msgr2=0x7faff80aea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:46.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.571+0000 7faff67fc700 1 --2- 172.21.15.146:0/692862919 >> v2:172.21.15.151:3300/0 conn(0x7faff8067b80 0x7faff80aea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:46.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.571+0000 7faff67fc700 1 -- 172.21.15.146:0/692862919 >> v1:172.21.15.151:6789/0 conn(0x7faff80a7f30 legacy=0x7faff8067470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:46.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.571+0000 7faff67fc700 1 -- 172.21.15.146:0/692862919 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff815a860 con 0x7faff8159720 2023-10-06T11:08:46.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.571+0000 7faff67fc700 1 -- 172.21.15.146:0/692862919 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fafe80017f0 con 0x7faff8159720 2023-10-06T11:08:46.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.571+0000 7faff67fc700 1 -- 172.21.15.146:0/692862919 >> v1:172.21.15.146:6789/0 conn(0x7faff8159720 legacy=0x7faff806efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:46.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.571+0000 7faff67fc700 1 --2- 172.21.15.146:0/692862919 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafe0003a60 0x7fafe0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:46.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.571+0000 7faff67fc700 1 --2- 172.21.15.146:0/692862919 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fafe0004810 0x7fafe0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:46.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.571+0000 7faff67fc700 1 --2- 172.21.15.146:0/692862919 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafe00051c0 0x7fafe000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:46.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.571+0000 7faff67fc700 1 -- 172.21.15.146:0/692862919 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff806e7e0 con 0x7fafe00051c0 2023-10-06T11:08:46.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.571+0000 7faff67fc700 1 -- 172.21.15.146:0/692862919 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe000c0d0 con 0x7fafe0004810 2023-10-06T11:08:46.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.571+0000 7faff67fc700 1 -- 172.21.15.146:0/692862919 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe000c290 con 0x7fafe0003a60 2023-10-06T11:08:46.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.571+0000 7faff7fff700 1 --2- 172.21.15.146:0/692862919 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafe00051c0 0x7fafe000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:46.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.571+0000 7faff77fe700 1 --2- 172.21.15.146:0/692862919 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafe0003a60 0x7fafe0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:46.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.571+0000 7faff6ffd700 1 --2- 172.21.15.146:0/692862919 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fafe0004810 0x7fafe0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:46.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.571+0000 7faff7fff700 1 -- 172.21.15.146:0/692862919 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafe0003a60 msgr2=0x7fafe0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:46.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.571+0000 7faff7fff700 1 --2- 172.21.15.146:0/692862919 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafe0003a60 0x7fafe0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:46.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.571+0000 7faff7fff700 1 -- 172.21.15.146:0/692862919 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fafe0004810 msgr2=0x7fafe0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:46.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.571+0000 7faff7fff700 1 --2- 172.21.15.146:0/692862919 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fafe0004810 0x7fafe0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:46.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.571+0000 7faff7fff700 1 -- 172.21.15.146:0/692862919 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe0003570 con 0x7fafe00051c0 2023-10-06T11:08:46.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.571+0000 7faff7fff700 1 -- 172.21.15.146:0/692862919 reap_dead start 2023-10-06T11:08:46.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.572+0000 7faff7fff700 1 --2- 172.21.15.146:0/692862919 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafe00051c0 0x7fafe000ba60 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7faff8067f80 tx=0x7faff00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c32e0375f715bace server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:46.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.572+0000 7faff67fc700 1 -- 172.21.15.146:0/692862919 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff000e710 con 0x7fafe00051c0 2023-10-06T11:08:46.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.572+0000 7faff67fc700 1 -- 172.21.15.146:0/692862919 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff000e870 con 0x7fafe00051c0 2023-10-06T11:08:46.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.572+0000 7faff67fc700 1 -- 172.21.15.146:0/692862919 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faff000ec30 con 0x7fafe00051c0 2023-10-06T11:08:46.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.572+0000 7faffe177700 1 -- 172.21.15.146:0/692862919 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafe00051c0 msgr2=0x7fafe000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:46.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.572+0000 7faffe177700 1 --2- 172.21.15.146:0/692862919 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafe00051c0 0x7fafe000ba60 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7faff8067f80 tx=0x7faff00091a0 comp rx=0 tx=0).stop 2023-10-06T11:08:46.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.572+0000 7faffe177700 1 -- 172.21.15.146:0/692862919 shutdown_connections 2023-10-06T11:08:46.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.572+0000 7faffe177700 1 --2- 172.21.15.146:0/692862919 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafe00051c0 0x7fafe000ba60 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:46.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.572+0000 7faffe177700 1 -- 172.21.15.146:0/692862919 >> 172.21.15.146:0/692862919 conn(0x7faff8068580 msgr2=0x7faff8068980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:46.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.572+0000 7faffe177700 1 -- 172.21.15.146:0/692862919 shutdown_connections 2023-10-06T11:08:46.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.572+0000 7faffe177700 1 -- 172.21.15.146:0/692862919 wait complete. 2023-10-06T11:08:46.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.574+0000 7faffe177700 1 Processor -- start 2023-10-06T11:08:46.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.574+0000 7faffe177700 1 -- start start 2023-10-06T11:08:46.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.574+0000 7faffe177700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafe00051c0 0x7faff8157d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:46.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.574+0000 7faffe177700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faff8097a60 0x7faff80cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:46.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.574+0000 7faffe177700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faff815a000 0x7faff814c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:46.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.574+0000 7faffe177700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff8096a50 con 0x7fafe00051c0 2023-10-06T11:08:46.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.574+0000 7faffe177700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff80975d0 con 0x7faff815a000 2023-10-06T11:08:46.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.574+0000 7faffe177700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff8158240 con 0x7faff8097a60 2023-10-06T11:08:46.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.574+0000 7faff77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafe00051c0 0x7faff8157d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:46.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.574+0000 7faff77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafe00051c0 0x7faff8157d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60832/0 (socket says 172.21.15.146:60832) 2023-10-06T11:08:46.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.574+0000 7faff77fe700 1 -- 172.21.15.146:0/3514948770 learned_addr learned my addr 172.21.15.146:0/3514948770 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:46.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.575+0000 7faff6ffd700 1 --2- 172.21.15.146:0/3514948770 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faff8097a60 0x7faff80cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:46.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.575+0000 7faff7fff700 1 --2- 172.21.15.146:0/3514948770 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faff815a000 0x7faff814c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:46.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.575+0000 7faff77fe700 1 -- 172.21.15.146:0/3514948770 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faff8097a60 msgr2=0x7faff80cbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:46.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.575+0000 7faff77fe700 1 --2- 172.21.15.146:0/3514948770 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faff8097a60 0x7faff80cbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:46.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.575+0000 7faff77fe700 1 -- 172.21.15.146:0/3514948770 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faff815a000 msgr2=0x7faff814c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:46.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.575+0000 7faff77fe700 1 --2- 172.21.15.146:0/3514948770 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faff815a000 0x7faff814c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:46.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.575+0000 7faff77fe700 1 -- 172.21.15.146:0/3514948770 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff8096ca0 con 0x7fafe00051c0 2023-10-06T11:08:46.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.575+0000 7faff6ffd700 1 --2- 172.21.15.146:0/3514948770 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faff8097a60 0x7faff80cbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:08:46.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.575+0000 7faff7fff700 1 --2- 172.21.15.146:0/3514948770 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faff815a000 0x7faff814c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:08:46.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.575+0000 7faff77fe700 1 --2- 172.21.15.146:0/3514948770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafe00051c0 0x7faff8157d00 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fafe8007aa0 tx=0x7fafe80021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:46.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.575+0000 7fafdf7fe700 1 -- 172.21.15.146:0/3514948770 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe800ae40 con 0x7fafe00051c0 2023-10-06T11:08:46.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.575+0000 7fafdf7fe700 1 -- 172.21.15.146:0/3514948770 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe80133f0 con 0x7fafe00051c0 2023-10-06T11:08:46.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.575+0000 7faffe177700 1 -- 172.21.15.146:0/3514948770 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faff8096f80 con 0x7fafe00051c0 2023-10-06T11:08:46.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.575+0000 7fafdf7fe700 1 -- 172.21.15.146:0/3514948770 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe80137b0 con 0x7fafe00051c0 2023-10-06T11:08:46.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.575+0000 7faffe177700 1 -- 172.21.15.146:0/3514948770 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faff80cc1e0 con 0x7fafe00051c0 2023-10-06T11:08:46.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.576+0000 7faffe177700 1 -- 172.21.15.146:0/3514948770 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faff80cc400 con 0x7fafe00051c0 2023-10-06T11:08:46.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.576+0000 7fafdf7fe700 1 -- 172.21.15.146:0/3514948770 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fafe8013b20 con 0x7fafe00051c0 2023-10-06T11:08:46.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.577+0000 7fafdf7fe700 1 --2- 172.21.15.146:0/3514948770 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fafe4066f30 0x7fafe40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:46.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.577+0000 7fafdf7fe700 1 -- 172.21.15.146:0/3514948770 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fafe80853a0 con 0x7fafe00051c0 2023-10-06T11:08:46.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.577+0000 7faff6ffd700 1 --2- 172.21.15.146:0/3514948770 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fafe4066f30 0x7fafe40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:46.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.577+0000 7faff6ffd700 1 --2- 172.21.15.146:0/3514948770 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fafe4066f30 0x7fafe40693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fafec007e40 tx=0x7fafec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:46.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.581+0000 7fafdf7fe700 1 -- 172.21.15.146:0/3514948770 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fafe8052410 con 0x7fafe00051c0 2023-10-06T11:08:46.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.804+0000 7faffe177700 1 -- 172.21.15.146:0/3514948770 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faff804c380 con 0x7fafe00051c0 2023-10-06T11:08:46.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.805+0000 7fafdf7fe700 1 -- 172.21.15.146:0/3514948770 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4609 (secure 0 0 0) 0x7fafe8055a30 con 0x7fafe00051c0 2023-10-06T11:08:46.807 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:08:46.807 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":35,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5248,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3360977916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3360977916},{"type":"v1","addr":"172.21.15.151:6834","nonce":3360977916}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5251,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2265934004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":2265934004},{"type":"v1","addr":"172.21.15.151:6835","nonce":2265934004}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2387575667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2387575667},{"type":"v1","addr":"172.21.15.146:6836","nonce":2387575667}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:08:42.797557+0000","modified":"2023-10-06T11:08:46.435072+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5481":{"gid":5481,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/2252184844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2252184844},{"type":"v1","addr":"172.21.15.146:6837","nonce":2252184844}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T11:08:46.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.807+0000 7faffe177700 1 -- 172.21.15.146:0/3514948770 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fafe4066f30 msgr2=0x7fafe40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:46.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.807+0000 7faffe177700 1 --2- 172.21.15.146:0/3514948770 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fafe4066f30 0x7fafe40693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fafec007e40 tx=0x7fafec009040 comp rx=0 tx=0).stop 2023-10-06T11:08:46.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.807+0000 7faffe177700 1 -- 172.21.15.146:0/3514948770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafe00051c0 msgr2=0x7faff8157d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:46.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.807+0000 7faffe177700 1 --2- 172.21.15.146:0/3514948770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafe00051c0 0x7faff8157d00 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fafe8007aa0 tx=0x7fafe80021d0 comp rx=0 tx=0).stop 2023-10-06T11:08:46.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.807+0000 7faffe177700 1 -- 172.21.15.146:0/3514948770 shutdown_connections 2023-10-06T11:08:46.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.807+0000 7faffe177700 1 --2- 172.21.15.146:0/3514948770 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fafe4066f30 0x7fafe40693e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:46.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.807+0000 7faffe177700 1 --2- 172.21.15.146:0/3514948770 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faff815a000 0x7faff814c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:46.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.807+0000 7faffe177700 1 --2- 172.21.15.146:0/3514948770 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fafe00051c0 0x7faff8157d00 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:46.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.807+0000 7faffe177700 1 --2- 172.21.15.146:0/3514948770 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faff8097a60 0x7faff80cbca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:46.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.807+0000 7faffe177700 1 -- 172.21.15.146:0/3514948770 >> 172.21.15.146:0/3514948770 conn(0x7faff8068580 msgr2=0x7faff80b0380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:46.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.807+0000 7faffe177700 1 -- 172.21.15.146:0/3514948770 shutdown_connections 2023-10-06T11:08:46.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.807+0000 7faffe177700 1 -- 172.21.15.146:0/3514948770 wait complete. 2023-10-06T11:08:46.811 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 35 2023-10-06T11:08:46.821 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:08:46.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.934+0000 7f0cac555700 1 Processor -- start 2023-10-06T11:08:46.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.934+0000 7f0cac555700 1 -- start start 2023-10-06T11:08:46.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.935+0000 7f0cac555700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ca4153ab0 0x7f0ca415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:46.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.935+0000 7f0cac555700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0ca4068ba0 0x7f0ca40b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:46.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.935+0000 7f0cac555700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca415ac30 con 0x7f0ca4153e80 2023-10-06T11:08:46.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.935+0000 7f0cac555700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca40b4510 con 0x7f0ca4068ba0 2023-10-06T11:08:46.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.935+0000 7f0cac555700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca40b6530 con 0x7f0ca4153ab0 2023-10-06T11:08:46.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.935+0000 7f0caaaf2700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0ca4068ba0 0x7f0ca40b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:46.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.935+0000 7f0caa2f1700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ca4153ab0 0x7f0ca415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:46.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.935+0000 7f0caa2f1700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ca4153ab0 0x7f0ca415a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:35056/0 (socket says 172.21.15.146:35056) 2023-10-06T11:08:46.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.935+0000 7f0caaaf2700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0ca4068ba0 0x7f0ca40b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:49218/0 (socket says 172.21.15.146:49218) 2023-10-06T11:08:46.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.935+0000 7f0caa2f1700 1 -- 172.21.15.146:0/2951016769 learned_addr learned my addr 172.21.15.146:0/2951016769 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:46.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.935+0000 7f0ca9af0700 1 --1- 172.21.15.146:0/2951016769 >> v1:172.21.15.151:6789/0 conn(0x7f0ca4153e80 0x7f0ca4068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:51446/0 (socket says 172.21.15.146:51446) 2023-10-06T11:08:46.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.935+0000 7f0caa2f1700 1 -- 172.21.15.146:0/2951016769 >> v2:172.21.15.151:3300/0 conn(0x7f0ca4068ba0 msgr2=0x7f0ca40b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:46.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.935+0000 7f0caa2f1700 1 --2- 172.21.15.146:0/2951016769 >> v2:172.21.15.151:3300/0 conn(0x7f0ca4068ba0 0x7f0ca40b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:46.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.935+0000 7f0caa2f1700 1 -- 172.21.15.146:0/2951016769 >> v1:172.21.15.151:6789/0 conn(0x7f0ca4153e80 legacy=0x7f0ca4068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:46.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.935+0000 7f0caa2f1700 1 -- 172.21.15.146:0/2951016769 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca40b5c50 con 0x7f0ca4153ab0 2023-10-06T11:08:46.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.936+0000 7f0caa2f1700 1 --2- 172.21.15.146:0/2951016769 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ca4153ab0 0x7f0ca415a6f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c0099b0 tx=0x7f0c9c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c413cee7509d5d63 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:46.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.936+0000 7f0ca92ef700 1 -- 172.21.15.146:0/2951016769 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c009ea0 con 0x7f0ca4153ab0 2023-10-06T11:08:46.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.936+0000 7f0ca92ef700 1 -- 172.21.15.146:0/2951016769 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9c00b860 con 0x7f0ca4153ab0 2023-10-06T11:08:46.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.936+0000 7f0ca92ef700 1 -- 172.21.15.146:0/2951016769 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c00bc00 con 0x7f0ca4153ab0 2023-10-06T11:08:46.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.936+0000 7f0cac555700 1 -- 172.21.15.146:0/2951016769 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ca4153ab0 msgr2=0x7f0ca415a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:46.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.936+0000 7f0cac555700 1 --2- 172.21.15.146:0/2951016769 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ca4153ab0 0x7f0ca415a6f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c0099b0 tx=0x7f0c9c009250 comp rx=0 tx=0).stop 2023-10-06T11:08:46.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.936+0000 7f0cac555700 1 -- 172.21.15.146:0/2951016769 shutdown_connections 2023-10-06T11:08:46.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.936+0000 7f0cac555700 1 --2- 172.21.15.146:0/2951016769 >> v2:172.21.15.151:3300/0 conn(0x7f0ca4068ba0 0x7f0ca40b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:46.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.936+0000 7f0cac555700 1 --2- 172.21.15.146:0/2951016769 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ca4153ab0 0x7f0ca415a6f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:46.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.936+0000 7f0cac555700 1 -- 172.21.15.146:0/2951016769 >> 172.21.15.146:0/2951016769 conn(0x7f0ca406eba0 msgr2=0x7f0ca406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:46.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.936+0000 7f0cac555700 1 -- 172.21.15.146:0/2951016769 shutdown_connections 2023-10-06T11:08:46.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.936+0000 7f0cac555700 1 -- 172.21.15.146:0/2951016769 wait complete. 2023-10-06T11:08:46.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.938+0000 7f0cac555700 1 Processor -- start 2023-10-06T11:08:46.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.938+0000 7f0cac555700 1 -- start start 2023-10-06T11:08:46.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.938+0000 7f0cac555700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ca4068ba0 0x7f0ca41553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:46.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.938+0000 7f0cac555700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ca4153ab0 0x7f0ca4155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:46.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.938+0000 7f0cac555700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ca4153e80 0x7f0ca4169a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:46.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.938+0000 7f0cac555700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca4155e50 con 0x7f0ca4068ba0 2023-10-06T11:08:46.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.938+0000 7f0cac555700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca4156120 con 0x7f0ca4153e80 2023-10-06T11:08:46.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.938+0000 7f0cac555700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca4156400 con 0x7f0ca4153ab0 2023-10-06T11:08:46.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.938+0000 7f0caa2f1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ca4068ba0 0x7f0ca41553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:46.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.938+0000 7f0caa2f1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ca4068ba0 0x7f0ca41553d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60842/0 (socket says 172.21.15.146:60842) 2023-10-06T11:08:46.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.938+0000 7f0caa2f1700 1 -- 172.21.15.146:0/2216160816 learned_addr learned my addr 172.21.15.146:0/2216160816 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:46.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.939+0000 7f0ca9af0700 1 --2- 172.21.15.146:0/2216160816 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ca4153ab0 0x7f0ca4155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:46.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.939+0000 7f0caa2f1700 1 -- 172.21.15.146:0/2216160816 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ca4153ab0 msgr2=0x7f0ca4155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:46.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.939+0000 7f0caaaf2700 1 --2- 172.21.15.146:0/2216160816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ca4153e80 0x7f0ca4169a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:46.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.939+0000 7f0caa2f1700 1 --2- 172.21.15.146:0/2216160816 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ca4153ab0 0x7f0ca4155910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:46.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.939+0000 7f0caa2f1700 1 -- 172.21.15.146:0/2216160816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ca4153e80 msgr2=0x7f0ca4169a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:46.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.939+0000 7f0caa2f1700 1 --2- 172.21.15.146:0/2216160816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ca4153e80 0x7f0ca4169a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:46.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.939+0000 7f0caa2f1700 1 -- 172.21.15.146:0/2216160816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c9c0094f0 con 0x7f0ca4068ba0 2023-10-06T11:08:46.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.939+0000 7f0ca9af0700 1 --2- 172.21.15.146:0/2216160816 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ca4153ab0 0x7f0ca4155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:08:46.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.939+0000 7f0caaaf2700 1 --2- 172.21.15.146:0/2216160816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ca4153e80 0x7f0ca4169a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:08:46.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.939+0000 7f0caa2f1700 1 --2- 172.21.15.146:0/2216160816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ca4068ba0 0x7f0ca41553d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f0ca40b6670 tx=0x7f0c9c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:46.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.939+0000 7f0ca27fc700 1 -- 172.21.15.146:0/2216160816 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c00bbe0 con 0x7f0ca4068ba0 2023-10-06T11:08:46.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.939+0000 7f0ca27fc700 1 -- 172.21.15.146:0/2216160816 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9c011420 con 0x7f0ca4068ba0 2023-10-06T11:08:46.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.939+0000 7f0cac555700 1 -- 172.21.15.146:0/2216160816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca41566e0 con 0x7f0ca4068ba0 2023-10-06T11:08:46.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.939+0000 7f0ca27fc700 1 -- 172.21.15.146:0/2216160816 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c0117c0 con 0x7f0ca4068ba0 2023-10-06T11:08:46.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.939+0000 7f0cac555700 1 -- 172.21.15.146:0/2216160816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca415a980 con 0x7f0ca4068ba0 2023-10-06T11:08:46.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.940+0000 7f0cac555700 1 -- 172.21.15.146:0/2216160816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca404c380 con 0x7f0ca4068ba0 2023-10-06T11:08:46.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.940+0000 7f0ca27fc700 1 -- 172.21.15.146:0/2216160816 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0c9c011b70 con 0x7f0ca4068ba0 2023-10-06T11:08:46.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.941+0000 7f0ca27fc700 1 --2- 172.21.15.146:0/2216160816 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0c90066f30 0x7f0c900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:46.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.941+0000 7f0ca9af0700 1 --2- 172.21.15.146:0/2216160816 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0c90066f30 0x7f0c900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:46.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.941+0000 7f0ca27fc700 1 -- 172.21.15.146:0/2216160816 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0c9c086050 con 0x7f0ca4068ba0 2023-10-06T11:08:46.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.941+0000 7f0ca9af0700 1 --2- 172.21.15.146:0/2216160816 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0c90066f30 0x7f0c900693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4147df0 tx=0x7f0c98009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:46.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:46.945+0000 7f0ca27fc700 1 -- 172.21.15.146:0/2216160816 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0c9c053160 con 0x7f0ca4068ba0 2023-10-06T11:08:47.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.130+0000 7f0cac555700 1 -- 172.21.15.146:0/2216160816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ca40b6250 con 0x7f0ca4068ba0 2023-10-06T11:08:47.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.131+0000 7f0ca27fc700 1 -- 172.21.15.146:0/2216160816 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16914 (secure 0 0 0) 0x7f0c9c056780 con 0x7f0ca4068ba0 2023-10-06T11:08:47.133 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:08:47.133 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":47,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:08:44.410124+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:08:40.456040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-06T11:08:41.764122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:08:47.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.133+0000 7f0cac555700 1 -- 172.21.15.146:0/2216160816 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0c90066f30 msgr2=0x7f0c900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:47.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.133+0000 7f0cac555700 1 --2- 172.21.15.146:0/2216160816 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0c90066f30 0x7f0c900693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4147df0 tx=0x7f0c98009040 comp rx=0 tx=0).stop 2023-10-06T11:08:47.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.133+0000 7f0cac555700 1 -- 172.21.15.146:0/2216160816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ca4068ba0 msgr2=0x7f0ca41553d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:47.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.133+0000 7f0cac555700 1 --2- 172.21.15.146:0/2216160816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ca4068ba0 0x7f0ca41553d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f0ca40b6670 tx=0x7f0c9c017000 comp rx=0 tx=0).stop 2023-10-06T11:08:47.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.133+0000 7f0cac555700 1 -- 172.21.15.146:0/2216160816 shutdown_connections 2023-10-06T11:08:47.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.133+0000 7f0cac555700 1 --2- 172.21.15.146:0/2216160816 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0c90066f30 0x7f0c900693e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:47.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.133+0000 7f0cac555700 1 --2- 172.21.15.146:0/2216160816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ca4153e80 0x7f0ca4169a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:47.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.133+0000 7f0cac555700 1 --2- 172.21.15.146:0/2216160816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ca4068ba0 0x7f0ca41553d0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:47.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.133+0000 7f0cac555700 1 --2- 172.21.15.146:0/2216160816 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ca4153ab0 0x7f0ca4155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:47.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.133+0000 7f0cac555700 1 -- 172.21.15.146:0/2216160816 >> 172.21.15.146:0/2216160816 conn(0x7f0ca406eba0 msgr2=0x7f0ca40b22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:47.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.133+0000 7f0cac555700 1 -- 172.21.15.146:0/2216160816 shutdown_connections 2023-10-06T11:08:47.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.133+0000 7f0cac555700 1 -- 172.21.15.146:0/2216160816 wait complete. 2023-10-06T11:08:47.147 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T11:08:47.148 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:08:47.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.261+0000 7feb3dc7b700 1 Processor -- start 2023-10-06T11:08:47.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.261+0000 7feb3dc7b700 1 -- start start 2023-10-06T11:08:47.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.262+0000 7feb3dc7b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7feb38154d20 0x7feb380c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:47.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.262+0000 7feb3dc7b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb380ccf40 0x7feb3815b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:47.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.262+0000 7feb3dc7b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb3806c5a0 con 0x7feb3815aeb0 2023-10-06T11:08:47.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.262+0000 7feb3dc7b700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb3815b870 con 0x7feb38154d20 2023-10-06T11:08:47.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.262+0000 7feb3dc7b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb380c8f70 con 0x7feb380ccf40 2023-10-06T11:08:47.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.262+0000 7feb2ffff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7feb3815aeb0 0x7feb381578b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40050/0 (socket says 172.21.15.146:40050) 2023-10-06T11:08:47.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.262+0000 7feb2ffff700 1 -- 172.21.15.146:0/2736003328 learned_addr learned my addr 172.21.15.146:0/2736003328 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:08:47.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.262+0000 7feb3d47a700 1 --2- 172.21.15.146:0/2736003328 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb380ccf40 0x7feb3815b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:47.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.262+0000 7feb3cc79700 1 --2- 172.21.15.146:0/2736003328 >> v2:172.21.15.151:3300/0 conn(0x7feb38154d20 0x7feb380c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:47.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.262+0000 7feb2f7fe700 1 -- 172.21.15.146:0/2736003328 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3205167402 0 0) 0x7feb3806c5a0 con 0x7feb3815aeb0 2023-10-06T11:08:47.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.262+0000 7feb2f7fe700 1 -- 172.21.15.146:0/2736003328 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb20003570 con 0x7feb3815aeb0 2023-10-06T11:08:47.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.263+0000 7feb3d47a700 1 -- 172.21.15.146:0/2736003328 >> v2:172.21.15.151:3300/0 conn(0x7feb38154d20 msgr2=0x7feb380c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:47.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.263+0000 7feb3d47a700 1 --2- 172.21.15.146:0/2736003328 >> v2:172.21.15.151:3300/0 conn(0x7feb38154d20 0x7feb380c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:47.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.263+0000 7feb2f7fe700 1 -- 172.21.15.146:0/2736003328 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 363669568 0 0) 0x7feb20003570 con 0x7feb3815aeb0 2023-10-06T11:08:47.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.263+0000 7feb3d47a700 1 -- 172.21.15.146:0/2736003328 >> v1:172.21.15.146:6789/0 conn(0x7feb3815aeb0 legacy=0x7feb381578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:47.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.263+0000 7feb3d47a700 1 -- 172.21.15.146:0/2736003328 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb3806b6b0 con 0x7feb380ccf40 2023-10-06T11:08:47.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.263+0000 7feb3d47a700 1 --2- 172.21.15.146:0/2736003328 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb380ccf40 0x7feb3815b330 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7feb30009e60 tx=0x7feb30009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3443fe91e726f9b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:47.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.263+0000 7feb2f7fe700 1 -- 172.21.15.146:0/2736003328 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3000e070 con 0x7feb380ccf40 2023-10-06T11:08:47.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.263+0000 7feb2f7fe700 1 -- 172.21.15.146:0/2736003328 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb3000b7a0 con 0x7feb380ccf40 2023-10-06T11:08:47.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.263+0000 7feb2f7fe700 1 -- 172.21.15.146:0/2736003328 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb28001470 con 0x7feb380ccf40 2023-10-06T11:08:47.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.263+0000 7feb3dc7b700 1 -- 172.21.15.146:0/2736003328 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb380ccf40 msgr2=0x7feb3815b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:47.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.263+0000 7feb3dc7b700 1 --2- 172.21.15.146:0/2736003328 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb380ccf40 0x7feb3815b330 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7feb30009e60 tx=0x7feb30009780 comp rx=0 tx=0).stop 2023-10-06T11:08:47.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.264+0000 7feb3dc7b700 1 -- 172.21.15.146:0/2736003328 shutdown_connections 2023-10-06T11:08:47.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.264+0000 7feb3dc7b700 1 --2- 172.21.15.146:0/2736003328 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb380ccf40 0x7feb3815b330 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:47.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.264+0000 7feb3dc7b700 1 --2- 172.21.15.146:0/2736003328 >> v2:172.21.15.151:3300/0 conn(0x7feb38154d20 0x7feb380c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:47.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.264+0000 7feb3dc7b700 1 -- 172.21.15.146:0/2736003328 >> 172.21.15.146:0/2736003328 conn(0x7feb380ce260 msgr2=0x7feb380ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:47.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.264+0000 7feb3dc7b700 1 -- 172.21.15.146:0/2736003328 shutdown_connections 2023-10-06T11:08:47.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.264+0000 7feb3dc7b700 1 -- 172.21.15.146:0/2736003328 wait complete. 2023-10-06T11:08:47.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.265+0000 7feb3dc7b700 1 Processor -- start 2023-10-06T11:08:47.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.265+0000 7feb3dc7b700 1 -- start start 2023-10-06T11:08:47.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.266+0000 7feb3dc7b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb380ccf40 0x7feb380b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:47.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.266+0000 7feb3dc7b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb38154d20 0x7feb380cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:47.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.266+0000 7feb3dc7b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb3815aeb0 0x7feb380cd920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:47.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.266+0000 7feb3dc7b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb380b3870 con 0x7feb3815aeb0 2023-10-06T11:08:47.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.266+0000 7feb3dc7b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb380b2c60 con 0x7feb380ccf40 2023-10-06T11:08:47.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.266+0000 7feb3dc7b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb380b2f40 con 0x7feb38154d20 2023-10-06T11:08:47.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.266+0000 7feb3d47a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb3815aeb0 0x7feb380cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:47.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.266+0000 7feb3d47a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb3815aeb0 0x7feb380cd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60848/0 (socket says 172.21.15.146:60848) 2023-10-06T11:08:47.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.266+0000 7feb3d47a700 1 -- 172.21.15.146:0/1865013598 learned_addr learned my addr 172.21.15.146:0/1865013598 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:47.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.266+0000 7feb2ffff700 1 --2- 172.21.15.146:0/1865013598 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb38154d20 0x7feb380cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:47.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.266+0000 7feb3cc79700 1 --2- 172.21.15.146:0/1865013598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb380ccf40 0x7feb380b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:47.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.266+0000 7feb3d47a700 1 -- 172.21.15.146:0/1865013598 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb38154d20 msgr2=0x7feb380cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:47.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.266+0000 7feb3d47a700 1 --2- 172.21.15.146:0/1865013598 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb38154d20 0x7feb380cd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:47.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.266+0000 7feb3d47a700 1 -- 172.21.15.146:0/1865013598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb380ccf40 msgr2=0x7feb380b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:47.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.266+0000 7feb3d47a700 1 --2- 172.21.15.146:0/1865013598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb380ccf40 0x7feb380b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:47.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.266+0000 7feb3d47a700 1 -- 172.21.15.146:0/1865013598 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb30009a20 con 0x7feb3815aeb0 2023-10-06T11:08:47.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.266+0000 7feb3cc79700 1 --2- 172.21.15.146:0/1865013598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb380ccf40 0x7feb380b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:08:47.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.266+0000 7feb3d47a700 1 --2- 172.21.15.146:0/1865013598 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb3815aeb0 0x7feb380cd920 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7feb300097c0 tx=0x7feb30018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:47.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.266+0000 7feb2cff9700 1 -- 172.21.15.146:0/1865013598 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb30012c70 con 0x7feb3815aeb0 2023-10-06T11:08:47.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.266+0000 7feb2cff9700 1 -- 172.21.15.146:0/1865013598 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb30012dd0 con 0x7feb3815aeb0 2023-10-06T11:08:47.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.266+0000 7feb3dc7b700 1 -- 172.21.15.146:0/1865013598 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb380b3220 con 0x7feb3815aeb0 2023-10-06T11:08:47.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.266+0000 7feb2cff9700 1 -- 172.21.15.146:0/1865013598 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3001d680 con 0x7feb3815aeb0 2023-10-06T11:08:47.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.266+0000 7feb3dc7b700 1 -- 172.21.15.146:0/1865013598 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb380b2230 con 0x7feb3815aeb0 2023-10-06T11:08:47.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.267+0000 7feb3dc7b700 1 -- 172.21.15.146:0/1865013598 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb380b3a20 con 0x7feb3815aeb0 2023-10-06T11:08:47.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.268+0000 7feb2cff9700 1 -- 172.21.15.146:0/1865013598 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feb30024070 con 0x7feb3815aeb0 2023-10-06T11:08:47.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.268+0000 7feb2cff9700 1 --2- 172.21.15.146:0/1865013598 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feb24066f30 0x7feb240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:47.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.268+0000 7feb2cff9700 1 -- 172.21.15.146:0/1865013598 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7feb30086950 con 0x7feb3815aeb0 2023-10-06T11:08:47.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.268+0000 7feb3cc79700 1 --2- 172.21.15.146:0/1865013598 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feb24066f30 0x7feb240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:47.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.268+0000 7feb3cc79700 1 --2- 172.21.15.146:0/1865013598 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feb24066f30 0x7feb240693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7feb34009d70 tx=0x7feb34008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:47.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.272+0000 7feb2cff9700 1 -- 172.21.15.146:0/1865013598 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feb380b3a20 con 0x7feb3815aeb0 2023-10-06T11:08:47.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.453+0000 7feb3dc7b700 1 -- 172.21.15.146:0/1865013598 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feb380b3c00 con 0x7feb24066f30 2023-10-06T11:08:47.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.462+0000 7feb2cff9700 1 -- 172.21.15.146:0/1865013598 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+307619 (secure 0 0 0) 0x7feb380b3c00 con 0x7feb24066f30 2023-10-06T11:08:47.468 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:08:47.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.465+0000 7feb3dc7b700 1 -- 172.21.15.146:0/1865013598 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feb24066f30 msgr2=0x7feb240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:47.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.465+0000 7feb3dc7b700 1 --2- 172.21.15.146:0/1865013598 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feb24066f30 0x7feb240693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7feb34009d70 tx=0x7feb34008040 comp rx=0 tx=0).stop 2023-10-06T11:08:47.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.465+0000 7feb3dc7b700 1 -- 172.21.15.146:0/1865013598 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb3815aeb0 msgr2=0x7feb380cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:47.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.465+0000 7feb3dc7b700 1 --2- 172.21.15.146:0/1865013598 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb3815aeb0 0x7feb380cd920 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7feb300097c0 tx=0x7feb30018000 comp rx=0 tx=0).stop 2023-10-06T11:08:47.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.465+0000 7feb3dc7b700 1 -- 172.21.15.146:0/1865013598 shutdown_connections 2023-10-06T11:08:47.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.465+0000 7feb3dc7b700 1 --2- 172.21.15.146:0/1865013598 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feb24066f30 0x7feb240693e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:47.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.465+0000 7feb3dc7b700 1 --2- 172.21.15.146:0/1865013598 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb3815aeb0 0x7feb380cd920 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:47.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.465+0000 7feb3dc7b700 1 --2- 172.21.15.146:0/1865013598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb380ccf40 0x7feb380b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:47.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.465+0000 7feb3dc7b700 1 --2- 172.21.15.146:0/1865013598 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb38154d20 0x7feb380cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:47.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.465+0000 7feb3dc7b700 1 -- 172.21.15.146:0/1865013598 >> 172.21.15.146:0/1865013598 conn(0x7feb380ce260 msgr2=0x7feb380c3000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:47.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.465+0000 7feb3dc7b700 1 -- 172.21.15.146:0/1865013598 shutdown_connections 2023-10-06T11:08:47.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.465+0000 7feb3dc7b700 1 -- 172.21.15.146:0/1865013598 wait complete. 2023-10-06T11:08:47.471 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:08:47.479 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":135,"stamp":"2023-10-06T11:08:47.179426+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592050,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":191,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":142,"ondisk_log_size":142,"up":168,"acting":168,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":104,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2453324,"kb_used_data":5388,"kb_used_omap":0,"kb_used_meta":2447872,"kb_avail":752521396,"statfs":{"total":773094113280,"available":770581909504,"internally_reserved":0,"allocated":5517312,"data_stored":3026846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2506620928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1682,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.776512"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.437128+0000","last_change":"2023-10-06T11:08:43.429477+0000","last_active":"2023-10-06T11:08:43.437128+0000","last_peered":"2023-10-06T11:08:43.437128+0000","last_clean":"2023-10-06T11:08:43.437128+0000","last_became_active":"2023-10-06T11:08:43.429245+0000","last_became_peered":"2023-10-06T11:08:43.429245+0000","last_unstale":"2023-10-06T11:08:43.437128+0000","last_undegraded":"2023-10-06T11:08:43.437128+0000","last_fullsized":"2023-10-06T11:08:43.437128+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:30.771237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.434216+0000","last_change":"2023-10-06T11:08:43.425499+0000","last_active":"2023-10-06T11:08:43.434216+0000","last_peered":"2023-10-06T11:08:43.434216+0000","last_clean":"2023-10-06T11:08:43.434216+0000","last_became_active":"2023-10-06T11:08:43.425262+0000","last_became_peered":"2023-10-06T11:08:43.425262+0000","last_unstale":"2023-10-06T11:08:43.434216+0000","last_undegraded":"2023-10-06T11:08:43.434216+0000","last_fullsized":"2023-10-06T11:08:43.434216+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:04:54.615565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.437292+0000","last_change":"2023-10-06T11:08:43.433555+0000","last_active":"2023-10-06T11:08:43.437292+0000","last_peered":"2023-10-06T11:08:43.437292+0000","last_clean":"2023-10-06T11:08:43.437292+0000","last_became_active":"2023-10-06T11:08:43.429961+0000","last_became_peered":"2023-10-06T11:08:43.429961+0000","last_unstale":"2023-10-06T11:08:43.437292+0000","last_undegraded":"2023-10-06T11:08:43.437292+0000","last_fullsized":"2023-10-06T11:08:43.437292+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:45:44.809943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435566+0000","last_change":"2023-10-06T11:08:43.424718+0000","last_active":"2023-10-06T11:08:43.435566+0000","last_peered":"2023-10-06T11:08:43.435566+0000","last_clean":"2023-10-06T11:08:43.435566+0000","last_became_active":"2023-10-06T11:08:43.424156+0000","last_became_peered":"2023-10-06T11:08:43.424156+0000","last_unstale":"2023-10-06T11:08:43.435566+0000","last_undegraded":"2023-10-06T11:08:43.435566+0000","last_fullsized":"2023-10-06T11:08:43.435566+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:52:09.529056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.429675+0000","last_change":"2023-10-06T11:08:43.428465+0000","last_active":"2023-10-06T11:08:43.429675+0000","last_peered":"2023-10-06T11:08:43.429675+0000","last_clean":"2023-10-06T11:08:43.429675+0000","last_became_active":"2023-10-06T11:08:43.427865+0000","last_became_peered":"2023-10-06T11:08:43.427865+0000","last_unstale":"2023-10-06T11:08:43.429675+0000","last_undegraded":"2023-10-06T11:08:43.429675+0000","last_fullsized":"2023-10-06T11:08:43.429675+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:23.831368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435190+0000","last_change":"2023-10-06T11:08:43.431433+0000","last_active":"2023-10-06T11:08:43.435190+0000","last_peered":"2023-10-06T11:08:43.435190+0000","last_clean":"2023-10-06T11:08:43.435190+0000","last_became_active":"2023-10-06T11:08:43.430675+0000","last_became_peered":"2023-10-06T11:08:43.430675+0000","last_unstale":"2023-10-06T11:08:43.435190+0000","last_undegraded":"2023-10-06T11:08:43.435190+0000","last_fullsized":"2023-10-06T11:08:43.435190+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:04:54.615565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.439131+0000","last_change":"2023-10-06T11:08:43.430750+0000","last_active":"2023-10-06T11:08:43.439131+0000","last_peered":"2023-10-06T11:08:43.439131+0000","last_clean":"2023-10-06T11:08:43.439131+0000","last_became_active":"2023-10-06T11:08:43.430457+0000","last_became_peered":"2023-10-06T11:08:43.430457+0000","last_unstale":"2023-10-06T11:08:43.439131+0000","last_undegraded":"2023-10-06T11:08:43.439131+0000","last_fullsized":"2023-10-06T11:08:43.439131+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:46.781626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.429682+0000","last_change":"2023-10-06T11:08:43.426994+0000","last_active":"2023-10-06T11:08:43.429682+0000","last_peered":"2023-10-06T11:08:43.429682+0000","last_clean":"2023-10-06T11:08:43.429682+0000","last_became_active":"2023-10-06T11:08:43.426729+0000","last_became_peered":"2023-10-06T11:08:43.426729+0000","last_unstale":"2023-10-06T11:08:43.429682+0000","last_undegraded":"2023-10-06T11:08:43.429682+0000","last_fullsized":"2023-10-06T11:08:43.429682+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:08:40.633452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435568+0000","last_change":"2023-10-06T11:08:43.428408+0000","last_active":"2023-10-06T11:08:43.435568+0000","last_peered":"2023-10-06T11:08:43.435568+0000","last_clean":"2023-10-06T11:08:43.435568+0000","last_became_active":"2023-10-06T11:08:43.428142+0000","last_became_peered":"2023-10-06T11:08:43.428142+0000","last_unstale":"2023-10-06T11:08:43.435568+0000","last_undegraded":"2023-10-06T11:08:43.435568+0000","last_fullsized":"2023-10-06T11:08:43.435568+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:23.831368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.437137+0000","last_change":"2023-10-06T11:08:43.429906+0000","last_active":"2023-10-06T11:08:43.437137+0000","last_peered":"2023-10-06T11:08:43.437137+0000","last_clean":"2023-10-06T11:08:43.437137+0000","last_became_active":"2023-10-06T11:08:43.429640+0000","last_became_peered":"2023-10-06T11:08:43.429640+0000","last_unstale":"2023-10-06T11:08:43.437137+0000","last_undegraded":"2023-10-06T11:08:43.437137+0000","last_fullsized":"2023-10-06T11:08:43.437137+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:33:49.431732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.433510+0000","last_change":"2023-10-06T11:08:43.422104+0000","last_active":"2023-10-06T11:08:43.433510+0000","last_peered":"2023-10-06T11:08:43.433510+0000","last_clean":"2023-10-06T11:08:43.433510+0000","last_became_active":"2023-10-06T11:08:43.421669+0000","last_became_peered":"2023-10-06T11:08:43.421669+0000","last_unstale":"2023-10-06T11:08:43.433510+0000","last_undegraded":"2023-10-06T11:08:43.433510+0000","last_fullsized":"2023-10-06T11:08:43.433510+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:28.243301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.437180+0000","last_change":"2023-10-06T11:08:43.433205+0000","last_active":"2023-10-06T11:08:43.437180+0000","last_peered":"2023-10-06T11:08:43.437180+0000","last_clean":"2023-10-06T11:08:43.437180+0000","last_became_active":"2023-10-06T11:08:43.429348+0000","last_became_peered":"2023-10-06T11:08:43.429348+0000","last_unstale":"2023-10-06T11:08:43.437180+0000","last_undegraded":"2023-10-06T11:08:43.437180+0000","last_fullsized":"2023-10-06T11:08:43.437180+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:31:49.189518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.434252+0000","last_change":"2023-10-06T11:08:43.427751+0000","last_active":"2023-10-06T11:08:43.434252+0000","last_peered":"2023-10-06T11:08:43.434252+0000","last_clean":"2023-10-06T11:08:43.434252+0000","last_became_active":"2023-10-06T11:08:43.427469+0000","last_became_peered":"2023-10-06T11:08:43.427469+0000","last_unstale":"2023-10-06T11:08:43.434252+0000","last_undegraded":"2023-10-06T11:08:43.434252+0000","last_fullsized":"2023-10-06T11:08:43.434252+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:26.368790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435606+0000","last_change":"2023-10-06T11:08:43.431889+0000","last_active":"2023-10-06T11:08:43.435606+0000","last_peered":"2023-10-06T11:08:43.435606+0000","last_clean":"2023-10-06T11:08:43.435606+0000","last_became_active":"2023-10-06T11:08:43.431636+0000","last_became_peered":"2023-10-06T11:08:43.431636+0000","last_unstale":"2023-10-06T11:08:43.435606+0000","last_undegraded":"2023-10-06T11:08:43.435606+0000","last_fullsized":"2023-10-06T11:08:43.435606+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:27:02.499415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.431264+0000","last_change":"2023-10-06T11:08:43.426550+0000","last_active":"2023-10-06T11:08:43.431264+0000","last_peered":"2023-10-06T11:08:43.431264+0000","last_clean":"2023-10-06T11:08:43.431264+0000","last_became_active":"2023-10-06T11:08:43.426263+0000","last_became_peered":"2023-10-06T11:08:43.426263+0000","last_unstale":"2023-10-06T11:08:43.431264+0000","last_undegraded":"2023-10-06T11:08:43.431264+0000","last_fullsized":"2023-10-06T11:08:43.431264+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:29:00.361399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.433487+0000","last_change":"2023-10-06T11:08:43.423917+0000","last_active":"2023-10-06T11:08:43.433487+0000","last_peered":"2023-10-06T11:08:43.433487+0000","last_clean":"2023-10-06T11:08:43.433487+0000","last_became_active":"2023-10-06T11:08:43.423665+0000","last_became_peered":"2023-10-06T11:08:43.423665+0000","last_unstale":"2023-10-06T11:08:43.433487+0000","last_undegraded":"2023-10-06T11:08:43.433487+0000","last_fullsized":"2023-10-06T11:08:43.433487+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:06:21.706780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435638+0000","last_change":"2023-10-06T11:08:43.430289+0000","last_active":"2023-10-06T11:08:43.435638+0000","last_peered":"2023-10-06T11:08:43.435638+0000","last_clean":"2023-10-06T11:08:43.435638+0000","last_became_active":"2023-10-06T11:08:43.430041+0000","last_became_peered":"2023-10-06T11:08:43.430041+0000","last_unstale":"2023-10-06T11:08:43.435638+0000","last_undegraded":"2023-10-06T11:08:43.435638+0000","last_fullsized":"2023-10-06T11:08:43.435638+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:01:46.808227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.429634+0000","last_change":"2023-10-06T11:08:43.426790+0000","last_active":"2023-10-06T11:08:43.429634+0000","last_peered":"2023-10-06T11:08:43.429634+0000","last_clean":"2023-10-06T11:08:43.429634+0000","last_became_active":"2023-10-06T11:08:43.426546+0000","last_became_peered":"2023-10-06T11:08:43.426546+0000","last_unstale":"2023-10-06T11:08:43.429634+0000","last_undegraded":"2023-10-06T11:08:43.429634+0000","last_fullsized":"2023-10-06T11:08:43.429634+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:39:00.400333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435640+0000","last_change":"2023-10-06T11:08:43.432649+0000","last_active":"2023-10-06T11:08:43.435640+0000","last_peered":"2023-10-06T11:08:43.435640+0000","last_clean":"2023-10-06T11:08:43.435640+0000","last_became_active":"2023-10-06T11:08:43.432398+0000","last_became_peered":"2023-10-06T11:08:43.432398+0000","last_unstale":"2023-10-06T11:08:43.435640+0000","last_undegraded":"2023-10-06T11:08:43.435640+0000","last_fullsized":"2023-10-06T11:08:43.435640+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:50:26.239260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.437343+0000","last_change":"2023-10-06T11:08:43.435236+0000","last_active":"2023-10-06T11:08:43.437343+0000","last_peered":"2023-10-06T11:08:43.437343+0000","last_clean":"2023-10-06T11:08:43.437343+0000","last_became_active":"2023-10-06T11:08:43.434990+0000","last_became_peered":"2023-10-06T11:08:43.434990+0000","last_unstale":"2023-10-06T11:08:43.437343+0000","last_undegraded":"2023-10-06T11:08:43.437343+0000","last_fullsized":"2023-10-06T11:08:43.437343+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:29.015502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435588+0000","last_change":"2023-10-06T11:08:43.424872+0000","last_active":"2023-10-06T11:08:43.435588+0000","last_peered":"2023-10-06T11:08:43.435588+0000","last_clean":"2023-10-06T11:08:43.435588+0000","last_became_active":"2023-10-06T11:08:43.424349+0000","last_became_peered":"2023-10-06T11:08:43.424349+0000","last_unstale":"2023-10-06T11:08:43.435588+0000","last_undegraded":"2023-10-06T11:08:43.435588+0000","last_fullsized":"2023-10-06T11:08:43.435588+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:03:16.583418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.434680+0000","last_change":"2023-10-06T11:08:43.431580+0000","last_active":"2023-10-06T11:08:43.434680+0000","last_peered":"2023-10-06T11:08:43.434680+0000","last_clean":"2023-10-06T11:08:43.434680+0000","last_became_active":"2023-10-06T11:08:43.430722+0000","last_became_peered":"2023-10-06T11:08:43.430722+0000","last_unstale":"2023-10-06T11:08:43.434680+0000","last_undegraded":"2023-10-06T11:08:43.434680+0000","last_fullsized":"2023-10-06T11:08:43.434680+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:54:07.391040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.428430+0000","last_change":"2023-10-06T11:08:43.427248+0000","last_active":"2023-10-06T11:08:43.428430+0000","last_peered":"2023-10-06T11:08:43.428430+0000","last_clean":"2023-10-06T11:08:43.428430+0000","last_became_active":"2023-10-06T11:08:43.426986+0000","last_became_peered":"2023-10-06T11:08:43.426986+0000","last_unstale":"2023-10-06T11:08:43.428430+0000","last_undegraded":"2023-10-06T11:08:43.428430+0000","last_fullsized":"2023-10-06T11:08:43.428430+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:33.013845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.407835+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:03.751012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.428786+0000","last_change":"2023-10-06T11:08:43.427311+0000","last_active":"2023-10-06T11:08:43.428786+0000","last_peered":"2023-10-06T11:08:43.428786+0000","last_clean":"2023-10-06T11:08:43.428786+0000","last_became_active":"2023-10-06T11:08:43.427059+0000","last_became_peered":"2023-10-06T11:08:43.427059+0000","last_unstale":"2023-10-06T11:08:43.428786+0000","last_undegraded":"2023-10-06T11:08:43.428786+0000","last_fullsized":"2023-10-06T11:08:43.428786+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:33:09.554346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.407802+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:13:18.791935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.407406+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:51:07.091891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.429699+0000","last_change":"2023-10-06T11:08:43.427507+0000","last_active":"2023-10-06T11:08:43.429699+0000","last_peered":"2023-10-06T11:08:43.429699+0000","last_clean":"2023-10-06T11:08:43.429699+0000","last_became_active":"2023-10-06T11:08:43.427268+0000","last_became_peered":"2023-10-06T11:08:43.427268+0000","last_unstale":"2023-10-06T11:08:43.429699+0000","last_undegraded":"2023-10-06T11:08:43.429699+0000","last_fullsized":"2023-10-06T11:08:43.429699+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:03:16.583418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"46'2","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.438968+0000","last_change":"2023-10-06T11:08:42.422232+0000","last_active":"2023-10-06T11:08:43.438968+0000","last_peered":"2023-10-06T11:08:43.438968+0000","last_clean":"2023-10-06T11:08:43.438968+0000","last_became_active":"2023-10-06T11:08:42.421943+0000","last_became_peered":"2023-10-06T11:08:42.421943+0000","last_unstale":"2023-10-06T11:08:43.438968+0000","last_undegraded":"2023-10-06T11:08:43.438968+0000","last_fullsized":"2023-10-06T11:08:43.438968+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:26:25.091803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"46'1","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.439458+0000","last_change":"2023-10-06T11:08:42.428856+0000","last_active":"2023-10-06T11:08:43.439458+0000","last_peered":"2023-10-06T11:08:43.439458+0000","last_clean":"2023-10-06T11:08:43.439458+0000","last_became_active":"2023-10-06T11:08:42.428382+0000","last_became_peered":"2023-10-06T11:08:42.428382+0000","last_unstale":"2023-10-06T11:08:43.439458+0000","last_undegraded":"2023-10-06T11:08:43.439458+0000","last_fullsized":"2023-10-06T11:08:43.439458+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:21.442104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.437333+0000","last_change":"2023-10-06T11:08:43.435060+0000","last_active":"2023-10-06T11:08:43.437333+0000","last_peered":"2023-10-06T11:08:43.437333+0000","last_clean":"2023-10-06T11:08:43.437333+0000","last_became_active":"2023-10-06T11:08:43.434067+0000","last_became_peered":"2023-10-06T11:08:43.434067+0000","last_unstale":"2023-10-06T11:08:43.437333+0000","last_undegraded":"2023-10-06T11:08:43.437333+0000","last_fullsized":"2023-10-06T11:08:43.437333+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:10.212258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.404858+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:25.209537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.429405+0000","last_change":"2023-10-06T11:08:43.426045+0000","last_active":"2023-10-06T11:08:43.429405+0000","last_peered":"2023-10-06T11:08:43.429405+0000","last_clean":"2023-10-06T11:08:43.429405+0000","last_became_active":"2023-10-06T11:08:43.425808+0000","last_became_peered":"2023-10-06T11:08:43.425808+0000","last_unstale":"2023-10-06T11:08:43.429405+0000","last_undegraded":"2023-10-06T11:08:43.429405+0000","last_fullsized":"2023-10-06T11:08:43.429405+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:26.368790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.407305+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:24:24.468404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.437296+0000","last_change":"2023-10-06T11:08:43.434561+0000","last_active":"2023-10-06T11:08:43.437296+0000","last_peered":"2023-10-06T11:08:43.437296+0000","last_clean":"2023-10-06T11:08:43.437296+0000","last_became_active":"2023-10-06T11:08:43.434261+0000","last_became_peered":"2023-10-06T11:08:43.434261+0000","last_unstale":"2023-10-06T11:08:43.437296+0000","last_undegraded":"2023-10-06T11:08:43.437296+0000","last_fullsized":"2023-10-06T11:08:43.437296+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:25:01.083898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.419445+0000","last_change":"2023-10-06T11:08:42.426277+0000","last_active":"2023-10-06T11:08:43.419445+0000","last_peered":"2023-10-06T11:08:43.419445+0000","last_clean":"2023-10-06T11:08:43.419445+0000","last_became_active":"2023-10-06T11:08:42.425809+0000","last_became_peered":"2023-10-06T11:08:42.425809+0000","last_unstale":"2023-10-06T11:08:43.419445+0000","last_undegraded":"2023-10-06T11:08:43.419445+0000","last_fullsized":"2023-10-06T11:08:43.419445+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:43.267112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.422360+0000","last_change":"2023-10-06T11:08:42.424509+0000","last_active":"2023-10-06T11:08:43.422360+0000","last_peered":"2023-10-06T11:08:43.422360+0000","last_clean":"2023-10-06T11:08:43.422360+0000","last_became_active":"2023-10-06T11:08:42.424227+0000","last_became_peered":"2023-10-06T11:08:42.424227+0000","last_unstale":"2023-10-06T11:08:43.422360+0000","last_undegraded":"2023-10-06T11:08:43.422360+0000","last_fullsized":"2023-10-06T11:08:43.422360+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:20:21.116613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.428755+0000","last_change":"2023-10-06T11:08:43.425933+0000","last_active":"2023-10-06T11:08:43.428755+0000","last_peered":"2023-10-06T11:08:43.428755+0000","last_clean":"2023-10-06T11:08:43.428755+0000","last_became_active":"2023-10-06T11:08:43.425682+0000","last_became_peered":"2023-10-06T11:08:43.425682+0000","last_unstale":"2023-10-06T11:08:43.428755+0000","last_undegraded":"2023-10-06T11:08:43.428755+0000","last_fullsized":"2023-10-06T11:08:43.428755+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:22.451552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.405987+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:06:38.366301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435589+0000","last_change":"2023-10-06T11:08:43.430989+0000","last_active":"2023-10-06T11:08:43.435589+0000","last_peered":"2023-10-06T11:08:43.435589+0000","last_clean":"2023-10-06T11:08:43.435589+0000","last_became_active":"2023-10-06T11:08:43.430743+0000","last_became_peered":"2023-10-06T11:08:43.430743+0000","last_unstale":"2023-10-06T11:08:43.435589+0000","last_undegraded":"2023-10-06T11:08:43.435589+0000","last_fullsized":"2023-10-06T11:08:43.435589+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:29:21.767861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"46'3","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.439412+0000","last_change":"2023-10-06T11:08:42.429474+0000","last_active":"2023-10-06T11:08:43.439412+0000","last_peered":"2023-10-06T11:08:43.439412+0000","last_clean":"2023-10-06T11:08:43.439412+0000","last_became_active":"2023-10-06T11:08:42.429213+0000","last_became_peered":"2023-10-06T11:08:42.429213+0000","last_unstale":"2023-10-06T11:08:43.439412+0000","last_undegraded":"2023-10-06T11:08:43.439412+0000","last_fullsized":"2023-10-06T11:08:43.439412+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:32:09.873020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"46'6","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.441588+0000","last_change":"2023-10-06T11:08:42.425248+0000","last_active":"2023-10-06T11:08:43.441588+0000","last_peered":"2023-10-06T11:08:43.441588+0000","last_clean":"2023-10-06T11:08:43.441588+0000","last_became_active":"2023-10-06T11:08:42.425015+0000","last_became_peered":"2023-10-06T11:08:42.425015+0000","last_unstale":"2023-10-06T11:08:43.441588+0000","last_undegraded":"2023-10-06T11:08:43.441588+0000","last_fullsized":"2023-10-06T11:08:43.441588+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:54:06.381591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.428699+0000","last_change":"2023-10-06T11:08:43.424775+0000","last_active":"2023-10-06T11:08:43.428699+0000","last_peered":"2023-10-06T11:08:43.428699+0000","last_clean":"2023-10-06T11:08:43.428699+0000","last_became_active":"2023-10-06T11:08:43.424530+0000","last_became_peered":"2023-10-06T11:08:43.424530+0000","last_unstale":"2023-10-06T11:08:43.428699+0000","last_undegraded":"2023-10-06T11:08:43.428699+0000","last_fullsized":"2023-10-06T11:08:43.428699+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:33:49.431732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"46'2","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.438255+0000","last_change":"2023-10-06T11:08:42.429006+0000","last_active":"2023-10-06T11:08:43.438255+0000","last_peered":"2023-10-06T11:08:43.438255+0000","last_clean":"2023-10-06T11:08:43.438255+0000","last_became_active":"2023-10-06T11:08:42.428634+0000","last_became_peered":"2023-10-06T11:08:42.428634+0000","last_unstale":"2023-10-06T11:08:43.438255+0000","last_undegraded":"2023-10-06T11:08:43.438255+0000","last_fullsized":"2023-10-06T11:08:43.438255+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:35.607875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.434236+0000","last_change":"2023-10-06T11:08:43.427213+0000","last_active":"2023-10-06T11:08:43.434236+0000","last_peered":"2023-10-06T11:08:43.434236+0000","last_clean":"2023-10-06T11:08:43.434236+0000","last_became_active":"2023-10-06T11:08:43.426968+0000","last_became_peered":"2023-10-06T11:08:43.426968+0000","last_unstale":"2023-10-06T11:08:43.434236+0000","last_undegraded":"2023-10-06T11:08:43.434236+0000","last_fullsized":"2023-10-06T11:08:43.434236+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:27:02.499415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.407354+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:51.790939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.429655+0000","last_change":"2023-10-06T11:08:43.427942+0000","last_active":"2023-10-06T11:08:43.429655+0000","last_peered":"2023-10-06T11:08:43.429655+0000","last_clean":"2023-10-06T11:08:43.429655+0000","last_became_active":"2023-10-06T11:08:43.427700+0000","last_became_peered":"2023-10-06T11:08:43.427700+0000","last_unstale":"2023-10-06T11:08:43.429655+0000","last_undegraded":"2023-10-06T11:08:43.429655+0000","last_fullsized":"2023-10-06T11:08:43.429655+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:01:46.808227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.421807+0000","last_change":"2023-10-06T11:08:42.423739+0000","last_active":"2023-10-06T11:08:43.421807+0000","last_peered":"2023-10-06T11:08:43.421807+0000","last_clean":"2023-10-06T11:08:43.421807+0000","last_became_active":"2023-10-06T11:08:42.423397+0000","last_became_peered":"2023-10-06T11:08:42.423397+0000","last_unstale":"2023-10-06T11:08:43.421807+0000","last_undegraded":"2023-10-06T11:08:43.421807+0000","last_fullsized":"2023-10-06T11:08:43.421807+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:06:22.465949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435617+0000","last_change":"2023-10-06T11:08:43.427656+0000","last_active":"2023-10-06T11:08:43.435617+0000","last_peered":"2023-10-06T11:08:43.435617+0000","last_clean":"2023-10-06T11:08:43.435617+0000","last_became_active":"2023-10-06T11:08:43.427354+0000","last_became_peered":"2023-10-06T11:08:43.427354+0000","last_unstale":"2023-10-06T11:08:43.435617+0000","last_undegraded":"2023-10-06T11:08:43.435617+0000","last_fullsized":"2023-10-06T11:08:43.435617+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:39:00.400333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"46'8","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.440505+0000","last_change":"2023-10-06T11:08:42.424889+0000","last_active":"2023-10-06T11:08:43.440505+0000","last_peered":"2023-10-06T11:08:43.440505+0000","last_clean":"2023-10-06T11:08:43.440505+0000","last_became_active":"2023-10-06T11:08:42.424633+0000","last_became_peered":"2023-10-06T11:08:42.424633+0000","last_unstale":"2023-10-06T11:08:43.440505+0000","last_undegraded":"2023-10-06T11:08:43.440505+0000","last_fullsized":"2023-10-06T11:08:43.440505+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:32.004396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.429696+0000","last_change":"2023-10-06T11:08:43.428620+0000","last_active":"2023-10-06T11:08:43.429696+0000","last_peered":"2023-10-06T11:08:43.429696+0000","last_clean":"2023-10-06T11:08:43.429696+0000","last_became_active":"2023-10-06T11:08:43.428142+0000","last_became_peered":"2023-10-06T11:08:43.428142+0000","last_unstale":"2023-10-06T11:08:43.429696+0000","last_undegraded":"2023-10-06T11:08:43.429696+0000","last_fullsized":"2023-10-06T11:08:43.429696+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:28.243301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"46'1","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.436390+0000","last_change":"2023-10-06T11:08:42.432219+0000","last_active":"2023-10-06T11:08:43.436390+0000","last_peered":"2023-10-06T11:08:43.436390+0000","last_clean":"2023-10-06T11:08:43.436390+0000","last_became_active":"2023-10-06T11:08:42.431764+0000","last_became_peered":"2023-10-06T11:08:42.431764+0000","last_unstale":"2023-10-06T11:08:43.436390+0000","last_undegraded":"2023-10-06T11:08:43.436390+0000","last_fullsized":"2023-10-06T11:08:43.436390+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:45:43.800494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"46'2","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.439915+0000","last_change":"2023-10-06T11:08:42.419848+0000","last_active":"2023-10-06T11:08:43.439915+0000","last_peered":"2023-10-06T11:08:43.439915+0000","last_clean":"2023-10-06T11:08:43.439915+0000","last_became_active":"2023-10-06T11:08:42.419544+0000","last_became_peered":"2023-10-06T11:08:42.419544+0000","last_unstale":"2023-10-06T11:08:43.439915+0000","last_undegraded":"2023-10-06T11:08:43.439915+0000","last_fullsized":"2023-10-06T11:08:43.439915+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:07:14.329644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.407701+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:35:14.166168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.407347+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:07:14.329644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.428782+0000","last_change":"2023-10-06T11:08:43.426219+0000","last_active":"2023-10-06T11:08:43.428782+0000","last_peered":"2023-10-06T11:08:43.428782+0000","last_clean":"2023-10-06T11:08:43.428782+0000","last_became_active":"2023-10-06T11:08:43.425974+0000","last_became_peered":"2023-10-06T11:08:43.425974+0000","last_unstale":"2023-10-06T11:08:43.428782+0000","last_undegraded":"2023-10-06T11:08:43.428782+0000","last_fullsized":"2023-10-06T11:08:43.428782+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:07:16.658185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.407311+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:39:11.705262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.416345+0000","last_change":"2023-10-06T11:08:42.424867+0000","last_active":"2023-10-06T11:08:43.416345+0000","last_peered":"2023-10-06T11:08:43.416345+0000","last_clean":"2023-10-06T11:08:43.416345+0000","last_became_active":"2023-10-06T11:08:42.424670+0000","last_became_peered":"2023-10-06T11:08:42.424670+0000","last_unstale":"2023-10-06T11:08:43.416345+0000","last_undegraded":"2023-10-06T11:08:43.416345+0000","last_fullsized":"2023-10-06T11:08:43.416345+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:28.006053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.434353+0000","last_change":"2023-10-06T11:08:43.426134+0000","last_active":"2023-10-06T11:08:43.434353+0000","last_peered":"2023-10-06T11:08:43.434353+0000","last_clean":"2023-10-06T11:08:43.434353+0000","last_became_active":"2023-10-06T11:08:43.425902+0000","last_became_peered":"2023-10-06T11:08:43.425902+0000","last_unstale":"2023-10-06T11:08:43.434353+0000","last_undegraded":"2023-10-06T11:08:43.434353+0000","last_fullsized":"2023-10-06T11:08:43.434353+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:51:36.859426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.419934+0000","last_change":"2023-10-06T11:08:42.430104+0000","last_active":"2023-10-06T11:08:43.419934+0000","last_peered":"2023-10-06T11:08:43.419934+0000","last_clean":"2023-10-06T11:08:43.419934+0000","last_became_active":"2023-10-06T11:08:42.429143+0000","last_became_peered":"2023-10-06T11:08:42.429143+0000","last_unstale":"2023-10-06T11:08:43.419934+0000","last_undegraded":"2023-10-06T11:08:43.419934+0000","last_fullsized":"2023-10-06T11:08:43.419934+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:33:48.422283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.414859+0000","last_change":"2023-10-06T11:08:42.422089+0000","last_active":"2023-10-06T11:08:43.414859+0000","last_peered":"2023-10-06T11:08:43.414859+0000","last_clean":"2023-10-06T11:08:43.414859+0000","last_became_active":"2023-10-06T11:08:42.421847+0000","last_became_peered":"2023-10-06T11:08:42.421847+0000","last_unstale":"2023-10-06T11:08:43.414859+0000","last_undegraded":"2023-10-06T11:08:43.414859+0000","last_fullsized":"2023-10-06T11:08:43.414859+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:24:24.468404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435505+0000","last_change":"2023-10-06T11:08:43.429380+0000","last_active":"2023-10-06T11:08:43.435505+0000","last_peered":"2023-10-06T11:08:43.435505+0000","last_clean":"2023-10-06T11:08:43.435505+0000","last_became_active":"2023-10-06T11:08:43.429113+0000","last_became_peered":"2023-10-06T11:08:43.429113+0000","last_unstale":"2023-10-06T11:08:43.435505+0000","last_undegraded":"2023-10-06T11:08:43.435505+0000","last_fullsized":"2023-10-06T11:08:43.435505+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:43.781886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.416288+0000","last_change":"2023-10-06T11:08:42.425700+0000","last_active":"2023-10-06T11:08:43.416288+0000","last_peered":"2023-10-06T11:08:43.416288+0000","last_clean":"2023-10-06T11:08:43.416288+0000","last_became_active":"2023-10-06T11:08:42.425460+0000","last_became_peered":"2023-10-06T11:08:42.425460+0000","last_unstale":"2023-10-06T11:08:43.416288+0000","last_undegraded":"2023-10-06T11:08:43.416288+0000","last_fullsized":"2023-10-06T11:08:43.416288+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:31:48.180069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":33,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T11:08:38.388420+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:08:38.388420+0000","last_peered":"2023-10-06T11:08:38.388420+0000","last_clean":"2023-10-06T11:08:38.388420+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:08:38.388420+0000","last_undegraded":"2023-10-06T11:08:38.388420+0000","last_fullsized":"2023-10-06T11:08:38.388420+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.428719+0000","last_change":"2023-10-06T11:08:43.425187+0000","last_active":"2023-10-06T11:08:43.428719+0000","last_peered":"2023-10-06T11:08:43.428719+0000","last_clean":"2023-10-06T11:08:43.428719+0000","last_became_active":"2023-10-06T11:08:43.424989+0000","last_became_peered":"2023-10-06T11:08:43.424989+0000","last_unstale":"2023-10-06T11:08:43.428719+0000","last_undegraded":"2023-10-06T11:08:43.428719+0000","last_fullsized":"2023-10-06T11:08:43.428719+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:45:44.809943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.416439+0000","last_change":"2023-10-06T11:08:42.428698+0000","last_active":"2023-10-06T11:08:43.416439+0000","last_peered":"2023-10-06T11:08:43.416439+0000","last_clean":"2023-10-06T11:08:43.416439+0000","last_became_active":"2023-10-06T11:08:42.428458+0000","last_became_peered":"2023-10-06T11:08:42.428458+0000","last_unstale":"2023-10-06T11:08:43.416439+0000","last_undegraded":"2023-10-06T11:08:43.416439+0000","last_fullsized":"2023-10-06T11:08:43.416439+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:29.761788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":39,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.416332+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:08:43.416332+0000","last_peered":"2023-10-06T11:08:43.416332+0000","last_clean":"2023-10-06T11:08:43.416332+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:08:43.416332+0000","last_undegraded":"2023-10-06T11:08:43.416332+0000","last_fullsized":"2023-10-06T11:08:43.416332+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.422039+0000","last_change":"2023-10-06T11:08:42.427034+0000","last_active":"2023-10-06T11:08:43.422039+0000","last_peered":"2023-10-06T11:08:43.422039+0000","last_clean":"2023-10-06T11:08:43.422039+0000","last_became_active":"2023-10-06T11:08:42.426733+0000","last_became_peered":"2023-10-06T11:08:42.426733+0000","last_unstale":"2023-10-06T11:08:43.422039+0000","last_undegraded":"2023-10-06T11:08:43.422039+0000","last_fullsized":"2023-10-06T11:08:43.422039+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:26:25.091803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":31,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T11:08:38.495257+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:08:38.495257+0000","last_peered":"2023-10-06T11:08:38.495257+0000","last_clean":"2023-10-06T11:08:38.495257+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:08:38.495257+0000","last_undegraded":"2023-10-06T11:08:38.495257+0000","last_fullsized":"2023-10-06T11:08:38.495257+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":184,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.421836+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:08:43.421836+0000","last_peered":"2023-10-06T11:08:43.421836+0000","last_clean":"2023-10-06T11:08:43.421836+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:08:43.421836+0000","last_undegraded":"2023-10-06T11:08:43.421836+0000","last_fullsized":"2023-10-06T11:08:43.421836+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.427071+0000","last_change":"2023-10-06T11:08:43.423061+0000","last_active":"2023-10-06T11:08:43.427071+0000","last_peered":"2023-10-06T11:08:43.427071+0000","last_clean":"2023-10-06T11:08:43.427071+0000","last_became_active":"2023-10-06T11:08:43.422802+0000","last_became_peered":"2023-10-06T11:08:43.422802+0000","last_unstale":"2023-10-06T11:08:43.427071+0000","last_undegraded":"2023-10-06T11:08:43.427071+0000","last_fullsized":"2023-10-06T11:08:43.427071+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:43.781886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.421298+0000","last_change":"2023-10-06T11:08:42.427910+0000","last_active":"2023-10-06T11:08:43.421298+0000","last_peered":"2023-10-06T11:08:43.421298+0000","last_clean":"2023-10-06T11:08:43.421298+0000","last_became_active":"2023-10-06T11:08:42.427478+0000","last_became_peered":"2023-10-06T11:08:42.427478+0000","last_unstale":"2023-10-06T11:08:43.421298+0000","last_undegraded":"2023-10-06T11:08:43.421298+0000","last_fullsized":"2023-10-06T11:08:43.421298+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:33:08.544897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.422507+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:08:43.422507+0000","last_peered":"2023-10-06T11:08:43.422507+0000","last_clean":"2023-10-06T11:08:43.422507+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:08:43.422507+0000","last_undegraded":"2023-10-06T11:08:43.422507+0000","last_fullsized":"2023-10-06T11:08:43.422507+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.421792+0000","last_change":"2023-10-06T11:08:42.428676+0000","last_active":"2023-10-06T11:08:43.421792+0000","last_peered":"2023-10-06T11:08:43.421792+0000","last_clean":"2023-10-06T11:08:43.421792+0000","last_became_active":"2023-10-06T11:08:42.428426+0000","last_became_peered":"2023-10-06T11:08:42.428426+0000","last_unstale":"2023-10-06T11:08:43.421792+0000","last_undegraded":"2023-10-06T11:08:43.421792+0000","last_fullsized":"2023-10-06T11:08:43.421792+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:07:15.648736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.421780+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:08:43.421780+0000","last_peered":"2023-10-06T11:08:43.421780+0000","last_clean":"2023-10-06T11:08:43.421780+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:08:43.421780+0000","last_undegraded":"2023-10-06T11:08:43.421780+0000","last_fullsized":"2023-10-06T11:08:43.421780+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.434698+0000","last_change":"2023-10-06T11:08:43.431756+0000","last_active":"2023-10-06T11:08:43.434698+0000","last_peered":"2023-10-06T11:08:43.434698+0000","last_clean":"2023-10-06T11:08:43.434698+0000","last_became_active":"2023-10-06T11:08:43.431105+0000","last_became_peered":"2023-10-06T11:08:43.431105+0000","last_unstale":"2023-10-06T11:08:43.434698+0000","last_undegraded":"2023-10-06T11:08:43.434698+0000","last_fullsized":"2023-10-06T11:08:43.434698+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:33.013845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.407235+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:59:13.774226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":39,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.415532+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:08:43.415532+0000","last_peered":"2023-10-06T11:08:43.415532+0000","last_clean":"2023-10-06T11:08:43.415532+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:08:43.415532+0000","last_undegraded":"2023-10-06T11:08:43.415532+0000","last_fullsized":"2023-10-06T11:08:43.415532+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.429728+0000","last_change":"2023-10-06T11:08:43.428796+0000","last_active":"2023-10-06T11:08:43.429728+0000","last_peered":"2023-10-06T11:08:43.429728+0000","last_clean":"2023-10-06T11:08:43.429728+0000","last_became_active":"2023-10-06T11:08:43.424121+0000","last_became_peered":"2023-10-06T11:08:43.424121+0000","last_unstale":"2023-10-06T11:08:43.429728+0000","last_undegraded":"2023-10-06T11:08:43.429728+0000","last_fullsized":"2023-10-06T11:08:43.429728+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:06:21.706780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.415243+0000","last_change":"2023-10-06T11:08:42.426380+0000","last_active":"2023-10-06T11:08:43.415243+0000","last_peered":"2023-10-06T11:08:43.415243+0000","last_clean":"2023-10-06T11:08:43.415243+0000","last_became_active":"2023-10-06T11:08:42.426061+0000","last_became_peered":"2023-10-06T11:08:42.426061+0000","last_unstale":"2023-10-06T11:08:43.415243+0000","last_undegraded":"2023-10-06T11:08:43.415243+0000","last_fullsized":"2023-10-06T11:08:43.415243+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:31:32.728096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":35,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T11:08:38.495549+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:08:38.495549+0000","last_peered":"2023-10-06T11:08:38.495549+0000","last_clean":"2023-10-06T11:08:38.495549+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:08:38.495549+0000","last_undegraded":"2023-10-06T11:08:38.495549+0000","last_fullsized":"2023-10-06T11:08:38.495549+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.433687+0000","last_change":"2023-10-06T11:08:43.423239+0000","last_active":"2023-10-06T11:08:43.433687+0000","last_peered":"2023-10-06T11:08:43.433687+0000","last_clean":"2023-10-06T11:08:43.433687+0000","last_became_active":"2023-10-06T11:08:43.422974+0000","last_became_peered":"2023-10-06T11:08:43.422974+0000","last_unstale":"2023-10-06T11:08:43.433687+0000","last_undegraded":"2023-10-06T11:08:43.433687+0000","last_fullsized":"2023-10-06T11:08:43.433687+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:56:57.888412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.405542+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:43.267112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":35,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T11:08:38.495552+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:08:38.495552+0000","last_peered":"2023-10-06T11:08:38.495552+0000","last_clean":"2023-10-06T11:08:38.495552+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:08:38.495552+0000","last_undegraded":"2023-10-06T11:08:38.495552+0000","last_fullsized":"2023-10-06T11:08:38.495552+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":1682,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25,"ondisk_log_size":25,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":86,"acting":86,"num_store_stats":5},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574889,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298416,"kb_used_data":1128,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073424,"statfs":{"total":96636764160,"available":96331186176,"internally_reserved":0,"allocated":1155072,"data_stored":829993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":1.871,"5min":0.73999999999999999,"15min":0.56999999999999995},"min":{"1min":0.41199999999999998,"5min":0.248,"15min":0.248},"max":{"1min":23.908999999999999,"5min":23.908999999999999,"15min":23.908999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":1.127,"5min":0.629,"15min":0.56499999999999995},"min":{"1min":0.374,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":9.0600000000000005,"5min":9.0600000000000005,"15min":9.0600000000000005},"last":0.52500000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":0.63900000000000001,"15min":0.57099999999999995},"min":{"1min":0.40899999999999997,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":9.2360000000000007,"5min":9.2360000000000007,"15min":9.2360000000000007},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.53900000000000003,"15min":0.51600000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":4.327,"5min":4.327,"15min":4.327},"last":0.53400000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.504,"15min":0.50900000000000001},"min":{"1min":0.311,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.505},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.59599999999999997,"15min":0.55800000000000005},"min":{"1min":0.436,"5min":0.309,"15min":0.309},"max":{"1min":4.7309999999999999,"5min":4.7309999999999999,"15min":4.7309999999999999},"last":0.64000000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.55400000000000005,"15min":0.51400000000000001},"min":{"1min":0.35299999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":4.3540000000000001,"5min":4.3540000000000001,"15min":4.3540000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":1.1870000000000001,"5min":0.67300000000000004,"15min":0.59999999999999998},"min":{"1min":0.45300000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":9.3879999999999999,"5min":9.3879999999999999,"15min":9.3879999999999999},"last":0.60899999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.50800000000000001,"15min":0.47499999999999998},"min":{"1min":0.34100000000000003,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":4.5709999999999997,"5min":4.5709999999999997,"15min":4.5709999999999997},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.753,"5min":0.55800000000000005,"15min":0.53500000000000003},"min":{"1min":0.33100000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":4.3129999999999997,"5min":4.3129999999999997,"15min":4.3129999999999997},"last":0.33100000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":0.64100000000000001,"15min":0.58099999999999996},"min":{"1min":0.34200000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":9.3499999999999996,"5min":9.3499999999999996,"15min":9.3499999999999996},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.58299999999999996,"15min":0.56699999999999995},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":4.444,"5min":4.444,"15min":4.444},"last":0.35099999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":0.67300000000000004,"15min":0.622},"min":{"1min":0.39700000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":9.4969999999999999,"5min":9.4969999999999999,"15min":9.4969999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.66200000000000003,"15min":0.62},"min":{"1min":0.44800000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":7.2039999999999997,"5min":7.2039999999999997,"15min":7.2039999999999997},"last":0.46100000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574890,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310076,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061764,"statfs":{"total":96636764160,"available":96319246336,"internally_reserved":0,"allocated":512000,"data_stored":217775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.48199999999999998,"15min":0.497},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52100000000000002,"15min":0.53300000000000003},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.52400000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.48299999999999998,"15min":0.499},"min":{"1min":0.34100000000000003,"5min":0.253,"15min":0.253},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.504},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48499999999999999,"15min":0.499},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.76400000000000001,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.624}]},{"osd":2,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.53100000000000003,"15min":0.498},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":7.0659999999999998,"5min":7.0659999999999998,"15min":7.0659999999999998},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.56100000000000005,"15min":0.52900000000000003},"min":{"1min":0.32500000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":7.0819999999999999,"5min":7.0819999999999999,"15min":7.0819999999999999},"last":0.57899999999999996}]},{"osd":3,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.49399999999999999,"15min":0.49299999999999999},"min":{"1min":0.32600000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.52700000000000002,"15min":0.53600000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.72799999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.64500000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.48699999999999999,"15min":0.50700000000000001},"min":{"1min":0.29599999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.64300000000000002,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54300000000000004,"15min":0.56799999999999995},"min":{"1min":0.32100000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.77100000000000002,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.72199999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52200000000000002,"15min":0.53800000000000003},"min":{"1min":0.307,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.75},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56299999999999994,"15min":0.58699999999999997},"min":{"1min":0.39500000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.79000000000000004,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.79000000000000004}]},{"osd":7,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56200000000000006,"15min":0.57699999999999996},"min":{"1min":0.36899999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79500000000000004,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.624,"5min":0.58999999999999997,"15min":0.60699999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83899999999999997,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.80800000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574889,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306564,"kb_used_data":1084,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065276,"statfs":{"total":96636764160,"available":96322842624,"internally_reserved":0,"allocated":1110016,"data_stored":809496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:39 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33100000000000002,"15min":0.34100000000000003},"min":{"1min":0.216,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.46000000000000002,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.316},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.34000000000000002,"15min":0.34399999999999997},"min":{"1min":0.26900000000000002,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.48799999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.30299999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:08:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.33600000000000002,"15min":0.33400000000000002},"min":{"1min":0.27300000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.5,"5min":0.505,"15min":0.505},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.435,"5min":0.38700000000000001,"15min":0.38600000000000001},"min":{"1min":0.251,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.38700000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:08:39 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.29599999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.60299999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.372,"15min":0.36599999999999999},"min":{"1min":0.30499999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.55400000000000005,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.40100000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:08:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.51600000000000001,"15min":0.503},"min":{"1min":0.42499999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.54600000000000004,"15min":0.53600000000000003},"min":{"1min":0.39900000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.752,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.63300000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:08:39 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.55300000000000005,"15min":0.54700000000000004},"min":{"1min":0.438,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.54800000000000004,"15min":0.53600000000000003},"min":{"1min":0.46400000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.80600000000000005,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.59199999999999997}]},{"osd":6,"last update":"Fri Oct 6 11:08:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.56799999999999995,"15min":0.56100000000000005},"min":{"1min":0.45500000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.57599999999999996,"15min":0.56899999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84899999999999998,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.61899999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:08:39 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.59099999999999997,"15min":0.58699999999999997},"min":{"1min":0.441,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.86199999999999999,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.58299999999999996,"15min":0.57999999999999996},"min":{"1min":0.41099999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.77600000000000002,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.57699999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297832,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074008,"statfs":{"total":96636764160,"available":96331784192,"internally_reserved":0,"allocated":557056,"data_stored":238204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32700000000000001,"15min":0.33300000000000002},"min":{"1min":0.223,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.503,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.34200000000000003,"15min":0.34100000000000003},"min":{"1min":0.246,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.24099999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.371,"15min":0.377},"min":{"1min":0.27400000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.435,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36099999999999999,"15min":0.36599999999999999},"min":{"1min":0.27200000000000002,"5min":0.219,"15min":0.219},"max":{"1min":0.46100000000000002,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.311}]},{"osd":3,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.371,"15min":0.373},"min":{"1min":0.26500000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.432,"15min":0.438},"min":{"1min":0.33000000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.55700000000000005,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.34200000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.55900000000000005,"15min":0.56000000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.60799999999999998,"15min":0.61499999999999999},"min":{"1min":0.36199999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.83999999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.75900000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54700000000000004,"15min":0.55100000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67900000000000005,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.55100000000000005,"15min":0.54500000000000004},"min":{"1min":0.40000000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.67900000000000005}]},{"osd":6,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60399999999999998,"15min":0.61199999999999999},"min":{"1min":0.432,"5min":0.375,"15min":0.375},"max":{"1min":0.84499999999999997,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60099999999999998,"15min":0.60499999999999998},"min":{"1min":0.42399999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.57999999999999996}]},{"osd":7,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59799999999999998,"15min":0.60499999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.81299999999999994,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.62},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.42099999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.70199999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574890,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310124,"kb_used_data":548,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061716,"statfs":{"total":96636764160,"available":96319197184,"internally_reserved":0,"allocated":561152,"data_stored":239684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.309,"15min":0.309},"min":{"1min":0.22500000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.437,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38100000000000001,"15min":0.38500000000000001},"min":{"1min":0.26900000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.51400000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.495}]},{"osd":1,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36899999999999999,"15min":0.375},"min":{"1min":0.24399999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.35399999999999998,"15min":0.34799999999999998},"min":{"1min":0.26900000000000002,"5min":0.217,"15min":0.217},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.45700000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.37,"15min":0.373},"min":{"1min":0.27800000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.438},{"interface":"front","average":{"1min":0.373,"5min":0.36499999999999999,"15min":0.36699999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.378}]},{"osd":4,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.33900000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.38900000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.58699999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.55200000000000005,"15min":0.55000000000000004},"min":{"1min":0.374,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.625},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.41799999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.67000000000000004}]},{"osd":6,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58299999999999996,"15min":0.58399999999999996},"min":{"1min":0.43099999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41399999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.68400000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.55900000000000005,"15min":0.55000000000000004},"min":{"1min":0.436,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.57099999999999995,"15min":0.56999999999999995},"min":{"1min":0.38600000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.70299999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574890,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310128,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061712,"statfs":{"total":96636764160,"available":96319193088,"internally_reserved":0,"allocated":565248,"data_stored":239706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.315,"15min":0.32800000000000001},"min":{"1min":0.248,"5min":0.188,"15min":0.188},"max":{"1min":0.46500000000000002,"5min":1.095,"15min":1.095},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38900000000000001,"15min":0.40500000000000003},"min":{"1min":0.29999999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.50600000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.39500000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.314,"15min":0.309},"min":{"1min":0.255,"5min":0.219,"15min":0.219},"max":{"1min":0.47499999999999998,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.36699999999999999,"15min":0.373},"min":{"1min":0.26500000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.51500000000000001,"5min":1.196,"15min":1.196},"last":0.36799999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.38100000000000001,"15min":0.39400000000000002},"min":{"1min":0.24199999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.54500000000000004,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.31},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.42399999999999999},"min":{"1min":0.33700000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.55900000000000005,"5min":1.224,"15min":1.224},"last":0.40999999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.55700000000000005,"15min":0.57499999999999996},"min":{"1min":0.38200000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.92500000000000004,"5min":1.694,"15min":1.694},"last":0.627},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53800000000000003,"15min":0.54500000000000004},"min":{"1min":0.36599999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.78200000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.41599999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55700000000000005,"15min":0.56599999999999995},"min":{"1min":0.39200000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.82199999999999995,"5min":1.165,"15min":1.165},"last":0.82199999999999995}]},{"osd":6,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58499999999999996,"15min":0.59499999999999997},"min":{"1min":0.40200000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.89900000000000002,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.59399999999999997,"15min":0.60499999999999998},"min":{"1min":0.45400000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83399999999999996,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.83399999999999996}]},{"osd":7,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58299999999999996,"15min":0.59699999999999998},"min":{"1min":0.40999999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84799999999999998,"5min":1.657,"15min":1.657},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.57099999999999995,"15min":0.57399999999999995},"min":{"1min":0.46700000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.68200000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310080,"kb_used_data":504,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061760,"statfs":{"total":96636764160,"available":96319242240,"internally_reserved":0,"allocated":516096,"data_stored":219128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:07:42 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.57699999999999996,"15min":0.61299999999999999},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.62,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.48799999999999999,"15min":0.501},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.65500000000000003,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.439}]},{"osd":1,"last update":"Fri Oct 6 11:07:42 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.60799999999999998,"15min":0.63900000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.60399999999999998,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.436,"5min":0.61199999999999999,"15min":0.64100000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.67500000000000004,"5min":2.7610000000000001,"15min":2.7610000000000001},"last":0.52700000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:07:42 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.56999999999999995,"15min":0.59099999999999997},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69099999999999995,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.377},{"interface":"front","average":{"1min":0.498,"5min":0.60599999999999998,"15min":0.624},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69299999999999995,"5min":1.718,"15min":1.718},"last":0.497}]},{"osd":3,"last update":"Fri Oct 6 11:07:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.63,"15min":0.65700000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.67700000000000005,"5min":2.677,"15min":2.677},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.51600000000000001,"15min":0.52600000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.63100000000000001,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.45400000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:07:42 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.48799999999999999,"15min":0.502},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.60499999999999998,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.44,"5min":0.53500000000000003,"15min":0.55100000000000005},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.64300000000000002,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.51300000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:07:42 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.52300000000000002,"15min":0.53900000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.624,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.58099999999999996,"15min":0.60099999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.64700000000000002,"5min":1.165,"15min":1.165},"last":0.56499999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:07:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.54900000000000004,"15min":0.56100000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.63700000000000001,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.60099999999999998,"15min":0.61899999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.66100000000000003,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.57399999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310104,"kb_used_data":528,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061736,"statfs":{"total":96636764160,"available":96319217664,"internally_reserved":0,"allocated":540672,"data_stored":232860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.66600000000000004,"15min":0.72399999999999998},"min":{"1min":0.36199999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.71899999999999997,"5min":5.0490000000000004,"15min":5.0490000000000004},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.627,"15min":0.69299999999999995},"min":{"1min":0.254,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.755,"5min":5.1449999999999996,"15min":5.1449999999999996},"last":0.39000000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48999999999999999,"15min":0.49199999999999999},"min":{"1min":0.315,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.70699999999999996,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.70699999999999996,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.56000000000000005}]},{"osd":2,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.57999999999999996,"15min":0.56699999999999995},"min":{"1min":0.379,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.81799999999999995,"5min":4.234,"15min":4.234},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56899999999999995,"15min":0.57799999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76600000000000001,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.59899999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.66700000000000004,"15min":0.74399999999999999},"min":{"1min":0.29299999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.72099999999999997,"5min":5.2169999999999996,"15min":5.2169999999999996},"last":0.438},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55100000000000005,"15min":0.55500000000000005},"min":{"1min":0.39600000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.83399999999999996,"5min":1.008,"15min":1.008},"last":0.53300000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.52900000000000003,"15min":0.53800000000000003},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.871,"5min":1.917,"15min":1.917},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.53800000000000003,"15min":0.55500000000000005},"min":{"1min":0.27200000000000002,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.85499999999999998,"5min":0.87,"15min":0.87},"last":0.50900000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.34899999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.89500000000000002,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.624,"15min":0.63200000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.92300000000000004,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":0.64400000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58999999999999997,"15min":0.60899999999999999},"min":{"1min":0.32100000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.84299999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.621,"15min":0.63},"min":{"1min":0.372,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.93899999999999995,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.629}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:08:47.487 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:08:47.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.633+0000 7f7200fe3700 1 Processor -- start 2023-10-06T11:08:47.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.633+0000 7f7200fe3700 1 -- start start 2023-10-06T11:08:47.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.634+0000 7f7200fe3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71fc153ab0 0x7f71fc15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:47.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.634+0000 7f7200fe3700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f71fc153e80 0x7f71fc068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:47.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.634+0000 7f7200fe3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71fc15ac30 con 0x7f71fc0689d0 2023-10-06T11:08:47.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.634+0000 7f7200fe3700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71fc068e50 con 0x7f71fc153e80 2023-10-06T11:08:47.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.634+0000 7f7200fe3700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71fc0b4510 con 0x7f71fc153ab0 2023-10-06T11:08:47.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.634+0000 7f71fad9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f71fc0689d0 0x7f71fc15d270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40052/0 (socket says 172.21.15.146:40052) 2023-10-06T11:08:47.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.634+0000 7f71fad9d700 1 -- 172.21.15.146:0/3482293634 learned_addr learned my addr 172.21.15.146:0/3482293634 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:08:47.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.634+0000 7f71f9d9b700 1 -- 172.21.15.146:0/3482293634 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 916677647 0 0) 0x7f71f4001490 con 0x7f71fc0689d0 2023-10-06T11:08:47.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.634+0000 7f71fa59c700 1 --2- 172.21.15.146:0/3482293634 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71fc153ab0 0x7f71fc15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:47.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.634+0000 7f71f1d9b700 1 --2- 172.21.15.146:0/3482293634 >> v2:172.21.15.151:3300/0 conn(0x7f71fc153e80 0x7f71fc068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:47.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.634+0000 7f71f9d9b700 1 -- 172.21.15.146:0/3482293634 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71e8003570 con 0x7f71fc0689d0 2023-10-06T11:08:47.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.635+0000 7f71f9d9b700 1 -- 172.21.15.146:0/3482293634 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 608417761 0 0) 0x7f71e8003570 con 0x7f71fc0689d0 2023-10-06T11:08:47.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.635+0000 7f71f9d9b700 1 -- 172.21.15.146:0/3482293634 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71fc153ab0 msgr2=0x7f71fc15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:47.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.635+0000 7f71f9d9b700 1 --2- 172.21.15.146:0/3482293634 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71fc153ab0 0x7f71fc15a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:47.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.635+0000 7f71f9d9b700 1 -- 172.21.15.146:0/3482293634 >> v2:172.21.15.151:3300/0 conn(0x7f71fc153e80 msgr2=0x7f71fc068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:47.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.635+0000 7f71f9d9b700 1 --2- 172.21.15.146:0/3482293634 >> v2:172.21.15.151:3300/0 conn(0x7f71fc153e80 0x7f71fc068490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:47.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.635+0000 7f71f9d9b700 1 -- 172.21.15.146:0/3482293634 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71fc0b6530 con 0x7f71fc0689d0 2023-10-06T11:08:47.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.635+0000 7f71f9d9b700 1 -- 172.21.15.146:0/3482293634 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f71f4001980 con 0x7f71fc0689d0 2023-10-06T11:08:47.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.635+0000 7f71f9d9b700 1 -- 172.21.15.146:0/3482293634 >> v1:172.21.15.146:6789/0 conn(0x7f71fc0689d0 legacy=0x7f71fc15d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:47.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.635+0000 7f71f9d9b700 1 --2- 172.21.15.146:0/3482293634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71e8003a60 0x7f71e8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:47.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.635+0000 7f71f9d9b700 1 --2- 172.21.15.146:0/3482293634 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71fc153ab0 0x7f71e8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:47.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.635+0000 7f71f9d9b700 1 --2- 172.21.15.146:0/3482293634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71e8004d50 0x7f71e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:47.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.635+0000 7f71f9d9b700 1 -- 172.21.15.146:0/3482293634 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71fc068e50 con 0x7f71e8003a60 2023-10-06T11:08:47.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.635+0000 7f71f9d9b700 1 -- 172.21.15.146:0/3482293634 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71fc0b4510 con 0x7f71e8004d50 2023-10-06T11:08:47.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.635+0000 7f71f9d9b700 1 -- 172.21.15.146:0/3482293634 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71e800ba60 con 0x7f71fc153ab0 2023-10-06T11:08:47.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.635+0000 7f71fa59c700 1 --2- 172.21.15.146:0/3482293634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71e8003a60 0x7f71e8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:47.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.635+0000 7f71fad9d700 1 --2- 172.21.15.146:0/3482293634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71e8004d50 0x7f71e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:47.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.635+0000 7f71f1d9b700 1 --2- 172.21.15.146:0/3482293634 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71fc153ab0 0x7f71e8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:47.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.635+0000 7f71fa59c700 1 -- 172.21.15.146:0/3482293634 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71fc153ab0 msgr2=0x7f71e8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:47.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.635+0000 7f71fa59c700 1 --2- 172.21.15.146:0/3482293634 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71fc153ab0 0x7f71e8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:47.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.635+0000 7f71fa59c700 1 -- 172.21.15.146:0/3482293634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71e8004d50 msgr2=0x7f71e80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:47.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.635+0000 7f71fa59c700 1 --2- 172.21.15.146:0/3482293634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71e8004d50 0x7f71e80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:47.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.635+0000 7f71fa59c700 1 -- 172.21.15.146:0/3482293634 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e8003570 con 0x7f71e8003a60 2023-10-06T11:08:47.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.635+0000 7f71fad9d700 1 --2- 172.21.15.146:0/3482293634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71e8004d50 0x7f71e80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:08:47.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.635+0000 7f71fa59c700 1 --2- 172.21.15.146:0/3482293634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71e8003a60 0x7f71e8003e70 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f71ec009c00 tx=0x7f71ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e335f2b2c8cd3a4b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:47.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.636+0000 7f71f9d9b700 1 -- 172.21.15.146:0/3482293634 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec00e6b0 con 0x7f71e8003a60 2023-10-06T11:08:47.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.636+0000 7f71f9d9b700 1 -- 172.21.15.146:0/3482293634 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ec00e810 con 0x7f71e8003a60 2023-10-06T11:08:47.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.636+0000 7f71f9d9b700 1 -- 172.21.15.146:0/3482293634 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec00ebd0 con 0x7f71e8003a60 2023-10-06T11:08:47.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.636+0000 7f7200fe3700 1 -- 172.21.15.146:0/3482293634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71e8003a60 msgr2=0x7f71e8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:47.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.636+0000 7f7200fe3700 1 --2- 172.21.15.146:0/3482293634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71e8003a60 0x7f71e8003e70 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f71ec009c00 tx=0x7f71ec0091a0 comp rx=0 tx=0).stop 2023-10-06T11:08:47.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.636+0000 7f71fad9d700 1 -- 172.21.15.146:0/3482293634 reap_dead start 2023-10-06T11:08:47.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.636+0000 7f7200fe3700 1 -- 172.21.15.146:0/3482293634 shutdown_connections 2023-10-06T11:08:47.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.636+0000 7f7200fe3700 1 -- 172.21.15.146:0/3482293634 >> 172.21.15.146:0/3482293634 conn(0x7f71fc06eba0 msgr2=0x7f71fc06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:47.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.636+0000 7f7200fe3700 1 -- 172.21.15.146:0/3482293634 shutdown_connections 2023-10-06T11:08:47.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.636+0000 7f7200fe3700 1 -- 172.21.15.146:0/3482293634 wait complete. 2023-10-06T11:08:47.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.637+0000 7f7200fe3700 1 Processor -- start 2023-10-06T11:08:47.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.637+0000 7f7200fe3700 1 -- start start 2023-10-06T11:08:47.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.638+0000 7f7200fe3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71e8003a60 0x7f71fc16a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:47.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.638+0000 7f7200fe3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71fc1567f0 0x7f71fc1470e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:47.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.638+0000 7f7200fe3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71fc157fe0 0x7f71fc158430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:47.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.638+0000 7f7200fe3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71fc16a9b0 con 0x7f71e8003a60 2023-10-06T11:08:47.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.638+0000 7f7200fe3700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71fc147620 con 0x7f71fc1567f0 2023-10-06T11:08:47.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.638+0000 7f7200fe3700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71fc157b50 con 0x7f71fc157fe0 2023-10-06T11:08:47.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.638+0000 7f71fa59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71e8003a60 0x7f71fc16a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:47.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.638+0000 7f71fa59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71e8003a60 0x7f71fc16a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60872/0 (socket says 172.21.15.146:60872) 2023-10-06T11:08:47.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.638+0000 7f71fa59c700 1 -- 172.21.15.146:0/2066315813 learned_addr learned my addr 172.21.15.146:0/2066315813 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:47.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.638+0000 7f71fad9d700 1 --2- 172.21.15.146:0/2066315813 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71fc157fe0 0x7f71fc158430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:47.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.638+0000 7f71f1d9b700 1 --2- 172.21.15.146:0/2066315813 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71fc1567f0 0x7f71fc1470e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:47.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.638+0000 7f71fa59c700 1 -- 172.21.15.146:0/2066315813 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71fc157fe0 msgr2=0x7f71fc158430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:47.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.638+0000 7f71fa59c700 1 --2- 172.21.15.146:0/2066315813 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71fc157fe0 0x7f71fc158430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:47.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.638+0000 7f71fa59c700 1 -- 172.21.15.146:0/2066315813 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71fc1567f0 msgr2=0x7f71fc1470e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:47.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.638+0000 7f71fa59c700 1 --2- 172.21.15.146:0/2066315813 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71fc1567f0 0x7f71fc1470e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:47.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.638+0000 7f71fa59c700 1 -- 172.21.15.146:0/2066315813 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71fc156db0 con 0x7f71e8003a60 2023-10-06T11:08:47.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.639+0000 7f71fa59c700 1 --2- 172.21.15.146:0/2066315813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71e8003a60 0x7f71fc16a470 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f71e8004730 tx=0x7f71ec01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:47.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.639+0000 7f71f2ffd700 1 -- 172.21.15.146:0/2066315813 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec022070 con 0x7f71e8003a60 2023-10-06T11:08:47.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.639+0000 7f71f2ffd700 1 -- 172.21.15.146:0/2066315813 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ec00e980 con 0x7f71e8003a60 2023-10-06T11:08:47.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.639+0000 7f7200fe3700 1 -- 172.21.15.146:0/2066315813 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71fc157220 con 0x7f71e8003a60 2023-10-06T11:08:47.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.639+0000 7f71f2ffd700 1 -- 172.21.15.146:0/2066315813 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec027470 con 0x7f71e8003a60 2023-10-06T11:08:47.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.639+0000 7f7200fe3700 1 -- 172.21.15.146:0/2066315813 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71fc1577e0 con 0x7f71e8003a60 2023-10-06T11:08:47.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.640+0000 7f7200fe3700 1 -- 172.21.15.146:0/2066315813 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71fc16a9b0 con 0x7f71e8003a60 2023-10-06T11:08:47.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.640+0000 7f71f2ffd700 1 -- 172.21.15.146:0/2066315813 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f71ec01c450 con 0x7f71e8003a60 2023-10-06T11:08:47.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.641+0000 7f71f2ffd700 1 --2- 172.21.15.146:0/2066315813 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f71dc066f30 0x7f71dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:47.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.641+0000 7f71f2ffd700 1 -- 172.21.15.146:0/2066315813 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f71ec0862f0 con 0x7f71e8003a60 2023-10-06T11:08:47.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.641+0000 7f71f1d9b700 1 --2- 172.21.15.146:0/2066315813 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f71dc066f30 0x7f71dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:47.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.641+0000 7f71f1d9b700 1 --2- 172.21.15.146:0/2066315813 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f71dc066f30 0x7f71dc0693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f71e4006dc0 tx=0x7f71e4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:47.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.645+0000 7f71f2ffd700 1 -- 172.21.15.146:0/2066315813 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f71fc16a9b0 con 0x7f71e8003a60 2023-10-06T11:08:47.712 INFO:tasks.ceph.mds.c.smithi146.stderr:2023-10-06T11:08:47.710+0000 7ff43ac5b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T11:08:47.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.824+0000 7f7200fe3700 1 -- 172.21.15.146:0/2066315813 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f71fc157c90 con 0x7f71dc066f30 2023-10-06T11:08:47.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.832+0000 7f71f2ffd700 1 -- 172.21.15.146:0/2066315813 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+307619 (secure 0 0 0) 0x7f71e4009e00 con 0x7f71dc066f30 2023-10-06T11:08:47.838 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:08:47.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.835+0000 7f7200fe3700 1 -- 172.21.15.146:0/2066315813 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f71dc066f30 msgr2=0x7f71dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:47.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.835+0000 7f7200fe3700 1 --2- 172.21.15.146:0/2066315813 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f71dc066f30 0x7f71dc0693e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f71e4006dc0 tx=0x7f71e4008040 comp rx=0 tx=0).stop 2023-10-06T11:08:47.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.835+0000 7f7200fe3700 1 -- 172.21.15.146:0/2066315813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71e8003a60 msgr2=0x7f71fc16a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:47.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.835+0000 7f7200fe3700 1 --2- 172.21.15.146:0/2066315813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71e8003a60 0x7f71fc16a470 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f71e8004730 tx=0x7f71ec01a000 comp rx=0 tx=0).stop 2023-10-06T11:08:47.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.835+0000 7f7200fe3700 1 -- 172.21.15.146:0/2066315813 shutdown_connections 2023-10-06T11:08:47.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.835+0000 7f7200fe3700 1 --2- 172.21.15.146:0/2066315813 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f71dc066f30 0x7f71dc0693e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:47.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.835+0000 7f7200fe3700 1 --2- 172.21.15.146:0/2066315813 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71fc157fe0 0x7f71fc158430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:47.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.835+0000 7f7200fe3700 1 --2- 172.21.15.146:0/2066315813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71e8003a60 0x7f71fc16a470 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:47.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.835+0000 7f7200fe3700 1 --2- 172.21.15.146:0/2066315813 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71fc1567f0 0x7f71fc1470e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:47.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.835+0000 7f7200fe3700 1 -- 172.21.15.146:0/2066315813 >> 172.21.15.146:0/2066315813 conn(0x7f71fc06eba0 msgr2=0x7f71fc0b1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:47.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.836+0000 7f7200fe3700 1 -- 172.21.15.146:0/2066315813 shutdown_connections 2023-10-06T11:08:47.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:47.836+0000 7f7200fe3700 1 -- 172.21.15.146:0/2066315813 wait complete. 2023-10-06T11:08:47.843 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:08:47.850 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":135,"stamp":"2023-10-06T11:08:47.179426+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592050,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":191,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":142,"ondisk_log_size":142,"up":168,"acting":168,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":104,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2453324,"kb_used_data":5388,"kb_used_omap":0,"kb_used_meta":2447872,"kb_avail":752521396,"statfs":{"total":773094113280,"available":770581909504,"internally_reserved":0,"allocated":5517312,"data_stored":3026846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2506620928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1682,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.776512"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.437128+0000","last_change":"2023-10-06T11:08:43.429477+0000","last_active":"2023-10-06T11:08:43.437128+0000","last_peered":"2023-10-06T11:08:43.437128+0000","last_clean":"2023-10-06T11:08:43.437128+0000","last_became_active":"2023-10-06T11:08:43.429245+0000","last_became_peered":"2023-10-06T11:08:43.429245+0000","last_unstale":"2023-10-06T11:08:43.437128+0000","last_undegraded":"2023-10-06T11:08:43.437128+0000","last_fullsized":"2023-10-06T11:08:43.437128+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:30.771237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.434216+0000","last_change":"2023-10-06T11:08:43.425499+0000","last_active":"2023-10-06T11:08:43.434216+0000","last_peered":"2023-10-06T11:08:43.434216+0000","last_clean":"2023-10-06T11:08:43.434216+0000","last_became_active":"2023-10-06T11:08:43.425262+0000","last_became_peered":"2023-10-06T11:08:43.425262+0000","last_unstale":"2023-10-06T11:08:43.434216+0000","last_undegraded":"2023-10-06T11:08:43.434216+0000","last_fullsized":"2023-10-06T11:08:43.434216+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:04:54.615565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.437292+0000","last_change":"2023-10-06T11:08:43.433555+0000","last_active":"2023-10-06T11:08:43.437292+0000","last_peered":"2023-10-06T11:08:43.437292+0000","last_clean":"2023-10-06T11:08:43.437292+0000","last_became_active":"2023-10-06T11:08:43.429961+0000","last_became_peered":"2023-10-06T11:08:43.429961+0000","last_unstale":"2023-10-06T11:08:43.437292+0000","last_undegraded":"2023-10-06T11:08:43.437292+0000","last_fullsized":"2023-10-06T11:08:43.437292+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:45:44.809943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435566+0000","last_change":"2023-10-06T11:08:43.424718+0000","last_active":"2023-10-06T11:08:43.435566+0000","last_peered":"2023-10-06T11:08:43.435566+0000","last_clean":"2023-10-06T11:08:43.435566+0000","last_became_active":"2023-10-06T11:08:43.424156+0000","last_became_peered":"2023-10-06T11:08:43.424156+0000","last_unstale":"2023-10-06T11:08:43.435566+0000","last_undegraded":"2023-10-06T11:08:43.435566+0000","last_fullsized":"2023-10-06T11:08:43.435566+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:52:09.529056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.429675+0000","last_change":"2023-10-06T11:08:43.428465+0000","last_active":"2023-10-06T11:08:43.429675+0000","last_peered":"2023-10-06T11:08:43.429675+0000","last_clean":"2023-10-06T11:08:43.429675+0000","last_became_active":"2023-10-06T11:08:43.427865+0000","last_became_peered":"2023-10-06T11:08:43.427865+0000","last_unstale":"2023-10-06T11:08:43.429675+0000","last_undegraded":"2023-10-06T11:08:43.429675+0000","last_fullsized":"2023-10-06T11:08:43.429675+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:23.831368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435190+0000","last_change":"2023-10-06T11:08:43.431433+0000","last_active":"2023-10-06T11:08:43.435190+0000","last_peered":"2023-10-06T11:08:43.435190+0000","last_clean":"2023-10-06T11:08:43.435190+0000","last_became_active":"2023-10-06T11:08:43.430675+0000","last_became_peered":"2023-10-06T11:08:43.430675+0000","last_unstale":"2023-10-06T11:08:43.435190+0000","last_undegraded":"2023-10-06T11:08:43.435190+0000","last_fullsized":"2023-10-06T11:08:43.435190+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:04:54.615565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.439131+0000","last_change":"2023-10-06T11:08:43.430750+0000","last_active":"2023-10-06T11:08:43.439131+0000","last_peered":"2023-10-06T11:08:43.439131+0000","last_clean":"2023-10-06T11:08:43.439131+0000","last_became_active":"2023-10-06T11:08:43.430457+0000","last_became_peered":"2023-10-06T11:08:43.430457+0000","last_unstale":"2023-10-06T11:08:43.439131+0000","last_undegraded":"2023-10-06T11:08:43.439131+0000","last_fullsized":"2023-10-06T11:08:43.439131+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:46.781626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.429682+0000","last_change":"2023-10-06T11:08:43.426994+0000","last_active":"2023-10-06T11:08:43.429682+0000","last_peered":"2023-10-06T11:08:43.429682+0000","last_clean":"2023-10-06T11:08:43.429682+0000","last_became_active":"2023-10-06T11:08:43.426729+0000","last_became_peered":"2023-10-06T11:08:43.426729+0000","last_unstale":"2023-10-06T11:08:43.429682+0000","last_undegraded":"2023-10-06T11:08:43.429682+0000","last_fullsized":"2023-10-06T11:08:43.429682+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:08:40.633452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435568+0000","last_change":"2023-10-06T11:08:43.428408+0000","last_active":"2023-10-06T11:08:43.435568+0000","last_peered":"2023-10-06T11:08:43.435568+0000","last_clean":"2023-10-06T11:08:43.435568+0000","last_became_active":"2023-10-06T11:08:43.428142+0000","last_became_peered":"2023-10-06T11:08:43.428142+0000","last_unstale":"2023-10-06T11:08:43.435568+0000","last_undegraded":"2023-10-06T11:08:43.435568+0000","last_fullsized":"2023-10-06T11:08:43.435568+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:23.831368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.437137+0000","last_change":"2023-10-06T11:08:43.429906+0000","last_active":"2023-10-06T11:08:43.437137+0000","last_peered":"2023-10-06T11:08:43.437137+0000","last_clean":"2023-10-06T11:08:43.437137+0000","last_became_active":"2023-10-06T11:08:43.429640+0000","last_became_peered":"2023-10-06T11:08:43.429640+0000","last_unstale":"2023-10-06T11:08:43.437137+0000","last_undegraded":"2023-10-06T11:08:43.437137+0000","last_fullsized":"2023-10-06T11:08:43.437137+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:33:49.431732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.433510+0000","last_change":"2023-10-06T11:08:43.422104+0000","last_active":"2023-10-06T11:08:43.433510+0000","last_peered":"2023-10-06T11:08:43.433510+0000","last_clean":"2023-10-06T11:08:43.433510+0000","last_became_active":"2023-10-06T11:08:43.421669+0000","last_became_peered":"2023-10-06T11:08:43.421669+0000","last_unstale":"2023-10-06T11:08:43.433510+0000","last_undegraded":"2023-10-06T11:08:43.433510+0000","last_fullsized":"2023-10-06T11:08:43.433510+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:28.243301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.437180+0000","last_change":"2023-10-06T11:08:43.433205+0000","last_active":"2023-10-06T11:08:43.437180+0000","last_peered":"2023-10-06T11:08:43.437180+0000","last_clean":"2023-10-06T11:08:43.437180+0000","last_became_active":"2023-10-06T11:08:43.429348+0000","last_became_peered":"2023-10-06T11:08:43.429348+0000","last_unstale":"2023-10-06T11:08:43.437180+0000","last_undegraded":"2023-10-06T11:08:43.437180+0000","last_fullsized":"2023-10-06T11:08:43.437180+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:31:49.189518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.434252+0000","last_change":"2023-10-06T11:08:43.427751+0000","last_active":"2023-10-06T11:08:43.434252+0000","last_peered":"2023-10-06T11:08:43.434252+0000","last_clean":"2023-10-06T11:08:43.434252+0000","last_became_active":"2023-10-06T11:08:43.427469+0000","last_became_peered":"2023-10-06T11:08:43.427469+0000","last_unstale":"2023-10-06T11:08:43.434252+0000","last_undegraded":"2023-10-06T11:08:43.434252+0000","last_fullsized":"2023-10-06T11:08:43.434252+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:26.368790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435606+0000","last_change":"2023-10-06T11:08:43.431889+0000","last_active":"2023-10-06T11:08:43.435606+0000","last_peered":"2023-10-06T11:08:43.435606+0000","last_clean":"2023-10-06T11:08:43.435606+0000","last_became_active":"2023-10-06T11:08:43.431636+0000","last_became_peered":"2023-10-06T11:08:43.431636+0000","last_unstale":"2023-10-06T11:08:43.435606+0000","last_undegraded":"2023-10-06T11:08:43.435606+0000","last_fullsized":"2023-10-06T11:08:43.435606+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:27:02.499415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.431264+0000","last_change":"2023-10-06T11:08:43.426550+0000","last_active":"2023-10-06T11:08:43.431264+0000","last_peered":"2023-10-06T11:08:43.431264+0000","last_clean":"2023-10-06T11:08:43.431264+0000","last_became_active":"2023-10-06T11:08:43.426263+0000","last_became_peered":"2023-10-06T11:08:43.426263+0000","last_unstale":"2023-10-06T11:08:43.431264+0000","last_undegraded":"2023-10-06T11:08:43.431264+0000","last_fullsized":"2023-10-06T11:08:43.431264+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:29:00.361399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.433487+0000","last_change":"2023-10-06T11:08:43.423917+0000","last_active":"2023-10-06T11:08:43.433487+0000","last_peered":"2023-10-06T11:08:43.433487+0000","last_clean":"2023-10-06T11:08:43.433487+0000","last_became_active":"2023-10-06T11:08:43.423665+0000","last_became_peered":"2023-10-06T11:08:43.423665+0000","last_unstale":"2023-10-06T11:08:43.433487+0000","last_undegraded":"2023-10-06T11:08:43.433487+0000","last_fullsized":"2023-10-06T11:08:43.433487+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:06:21.706780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435638+0000","last_change":"2023-10-06T11:08:43.430289+0000","last_active":"2023-10-06T11:08:43.435638+0000","last_peered":"2023-10-06T11:08:43.435638+0000","last_clean":"2023-10-06T11:08:43.435638+0000","last_became_active":"2023-10-06T11:08:43.430041+0000","last_became_peered":"2023-10-06T11:08:43.430041+0000","last_unstale":"2023-10-06T11:08:43.435638+0000","last_undegraded":"2023-10-06T11:08:43.435638+0000","last_fullsized":"2023-10-06T11:08:43.435638+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:01:46.808227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.429634+0000","last_change":"2023-10-06T11:08:43.426790+0000","last_active":"2023-10-06T11:08:43.429634+0000","last_peered":"2023-10-06T11:08:43.429634+0000","last_clean":"2023-10-06T11:08:43.429634+0000","last_became_active":"2023-10-06T11:08:43.426546+0000","last_became_peered":"2023-10-06T11:08:43.426546+0000","last_unstale":"2023-10-06T11:08:43.429634+0000","last_undegraded":"2023-10-06T11:08:43.429634+0000","last_fullsized":"2023-10-06T11:08:43.429634+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:39:00.400333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435640+0000","last_change":"2023-10-06T11:08:43.432649+0000","last_active":"2023-10-06T11:08:43.435640+0000","last_peered":"2023-10-06T11:08:43.435640+0000","last_clean":"2023-10-06T11:08:43.435640+0000","last_became_active":"2023-10-06T11:08:43.432398+0000","last_became_peered":"2023-10-06T11:08:43.432398+0000","last_unstale":"2023-10-06T11:08:43.435640+0000","last_undegraded":"2023-10-06T11:08:43.435640+0000","last_fullsized":"2023-10-06T11:08:43.435640+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:50:26.239260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.437343+0000","last_change":"2023-10-06T11:08:43.435236+0000","last_active":"2023-10-06T11:08:43.437343+0000","last_peered":"2023-10-06T11:08:43.437343+0000","last_clean":"2023-10-06T11:08:43.437343+0000","last_became_active":"2023-10-06T11:08:43.434990+0000","last_became_peered":"2023-10-06T11:08:43.434990+0000","last_unstale":"2023-10-06T11:08:43.437343+0000","last_undegraded":"2023-10-06T11:08:43.437343+0000","last_fullsized":"2023-10-06T11:08:43.437343+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:29.015502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435588+0000","last_change":"2023-10-06T11:08:43.424872+0000","last_active":"2023-10-06T11:08:43.435588+0000","last_peered":"2023-10-06T11:08:43.435588+0000","last_clean":"2023-10-06T11:08:43.435588+0000","last_became_active":"2023-10-06T11:08:43.424349+0000","last_became_peered":"2023-10-06T11:08:43.424349+0000","last_unstale":"2023-10-06T11:08:43.435588+0000","last_undegraded":"2023-10-06T11:08:43.435588+0000","last_fullsized":"2023-10-06T11:08:43.435588+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:03:16.583418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.434680+0000","last_change":"2023-10-06T11:08:43.431580+0000","last_active":"2023-10-06T11:08:43.434680+0000","last_peered":"2023-10-06T11:08:43.434680+0000","last_clean":"2023-10-06T11:08:43.434680+0000","last_became_active":"2023-10-06T11:08:43.430722+0000","last_became_peered":"2023-10-06T11:08:43.430722+0000","last_unstale":"2023-10-06T11:08:43.434680+0000","last_undegraded":"2023-10-06T11:08:43.434680+0000","last_fullsized":"2023-10-06T11:08:43.434680+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:54:07.391040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.428430+0000","last_change":"2023-10-06T11:08:43.427248+0000","last_active":"2023-10-06T11:08:43.428430+0000","last_peered":"2023-10-06T11:08:43.428430+0000","last_clean":"2023-10-06T11:08:43.428430+0000","last_became_active":"2023-10-06T11:08:43.426986+0000","last_became_peered":"2023-10-06T11:08:43.426986+0000","last_unstale":"2023-10-06T11:08:43.428430+0000","last_undegraded":"2023-10-06T11:08:43.428430+0000","last_fullsized":"2023-10-06T11:08:43.428430+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:33.013845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.407835+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:03.751012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.428786+0000","last_change":"2023-10-06T11:08:43.427311+0000","last_active":"2023-10-06T11:08:43.428786+0000","last_peered":"2023-10-06T11:08:43.428786+0000","last_clean":"2023-10-06T11:08:43.428786+0000","last_became_active":"2023-10-06T11:08:43.427059+0000","last_became_peered":"2023-10-06T11:08:43.427059+0000","last_unstale":"2023-10-06T11:08:43.428786+0000","last_undegraded":"2023-10-06T11:08:43.428786+0000","last_fullsized":"2023-10-06T11:08:43.428786+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:33:09.554346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.407802+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:13:18.791935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.407406+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:51:07.091891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.429699+0000","last_change":"2023-10-06T11:08:43.427507+0000","last_active":"2023-10-06T11:08:43.429699+0000","last_peered":"2023-10-06T11:08:43.429699+0000","last_clean":"2023-10-06T11:08:43.429699+0000","last_became_active":"2023-10-06T11:08:43.427268+0000","last_became_peered":"2023-10-06T11:08:43.427268+0000","last_unstale":"2023-10-06T11:08:43.429699+0000","last_undegraded":"2023-10-06T11:08:43.429699+0000","last_fullsized":"2023-10-06T11:08:43.429699+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:03:16.583418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"46'2","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.438968+0000","last_change":"2023-10-06T11:08:42.422232+0000","last_active":"2023-10-06T11:08:43.438968+0000","last_peered":"2023-10-06T11:08:43.438968+0000","last_clean":"2023-10-06T11:08:43.438968+0000","last_became_active":"2023-10-06T11:08:42.421943+0000","last_became_peered":"2023-10-06T11:08:42.421943+0000","last_unstale":"2023-10-06T11:08:43.438968+0000","last_undegraded":"2023-10-06T11:08:43.438968+0000","last_fullsized":"2023-10-06T11:08:43.438968+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:26:25.091803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"46'1","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.439458+0000","last_change":"2023-10-06T11:08:42.428856+0000","last_active":"2023-10-06T11:08:43.439458+0000","last_peered":"2023-10-06T11:08:43.439458+0000","last_clean":"2023-10-06T11:08:43.439458+0000","last_became_active":"2023-10-06T11:08:42.428382+0000","last_became_peered":"2023-10-06T11:08:42.428382+0000","last_unstale":"2023-10-06T11:08:43.439458+0000","last_undegraded":"2023-10-06T11:08:43.439458+0000","last_fullsized":"2023-10-06T11:08:43.439458+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:21.442104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.437333+0000","last_change":"2023-10-06T11:08:43.435060+0000","last_active":"2023-10-06T11:08:43.437333+0000","last_peered":"2023-10-06T11:08:43.437333+0000","last_clean":"2023-10-06T11:08:43.437333+0000","last_became_active":"2023-10-06T11:08:43.434067+0000","last_became_peered":"2023-10-06T11:08:43.434067+0000","last_unstale":"2023-10-06T11:08:43.437333+0000","last_undegraded":"2023-10-06T11:08:43.437333+0000","last_fullsized":"2023-10-06T11:08:43.437333+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:10.212258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.404858+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:25.209537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.429405+0000","last_change":"2023-10-06T11:08:43.426045+0000","last_active":"2023-10-06T11:08:43.429405+0000","last_peered":"2023-10-06T11:08:43.429405+0000","last_clean":"2023-10-06T11:08:43.429405+0000","last_became_active":"2023-10-06T11:08:43.425808+0000","last_became_peered":"2023-10-06T11:08:43.425808+0000","last_unstale":"2023-10-06T11:08:43.429405+0000","last_undegraded":"2023-10-06T11:08:43.429405+0000","last_fullsized":"2023-10-06T11:08:43.429405+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:26.368790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.407305+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:24:24.468404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.437296+0000","last_change":"2023-10-06T11:08:43.434561+0000","last_active":"2023-10-06T11:08:43.437296+0000","last_peered":"2023-10-06T11:08:43.437296+0000","last_clean":"2023-10-06T11:08:43.437296+0000","last_became_active":"2023-10-06T11:08:43.434261+0000","last_became_peered":"2023-10-06T11:08:43.434261+0000","last_unstale":"2023-10-06T11:08:43.437296+0000","last_undegraded":"2023-10-06T11:08:43.437296+0000","last_fullsized":"2023-10-06T11:08:43.437296+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:25:01.083898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.419445+0000","last_change":"2023-10-06T11:08:42.426277+0000","last_active":"2023-10-06T11:08:43.419445+0000","last_peered":"2023-10-06T11:08:43.419445+0000","last_clean":"2023-10-06T11:08:43.419445+0000","last_became_active":"2023-10-06T11:08:42.425809+0000","last_became_peered":"2023-10-06T11:08:42.425809+0000","last_unstale":"2023-10-06T11:08:43.419445+0000","last_undegraded":"2023-10-06T11:08:43.419445+0000","last_fullsized":"2023-10-06T11:08:43.419445+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:43.267112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.422360+0000","last_change":"2023-10-06T11:08:42.424509+0000","last_active":"2023-10-06T11:08:43.422360+0000","last_peered":"2023-10-06T11:08:43.422360+0000","last_clean":"2023-10-06T11:08:43.422360+0000","last_became_active":"2023-10-06T11:08:42.424227+0000","last_became_peered":"2023-10-06T11:08:42.424227+0000","last_unstale":"2023-10-06T11:08:43.422360+0000","last_undegraded":"2023-10-06T11:08:43.422360+0000","last_fullsized":"2023-10-06T11:08:43.422360+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:20:21.116613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.428755+0000","last_change":"2023-10-06T11:08:43.425933+0000","last_active":"2023-10-06T11:08:43.428755+0000","last_peered":"2023-10-06T11:08:43.428755+0000","last_clean":"2023-10-06T11:08:43.428755+0000","last_became_active":"2023-10-06T11:08:43.425682+0000","last_became_peered":"2023-10-06T11:08:43.425682+0000","last_unstale":"2023-10-06T11:08:43.428755+0000","last_undegraded":"2023-10-06T11:08:43.428755+0000","last_fullsized":"2023-10-06T11:08:43.428755+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:22.451552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.405987+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:06:38.366301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435589+0000","last_change":"2023-10-06T11:08:43.430989+0000","last_active":"2023-10-06T11:08:43.435589+0000","last_peered":"2023-10-06T11:08:43.435589+0000","last_clean":"2023-10-06T11:08:43.435589+0000","last_became_active":"2023-10-06T11:08:43.430743+0000","last_became_peered":"2023-10-06T11:08:43.430743+0000","last_unstale":"2023-10-06T11:08:43.435589+0000","last_undegraded":"2023-10-06T11:08:43.435589+0000","last_fullsized":"2023-10-06T11:08:43.435589+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:29:21.767861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"46'3","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.439412+0000","last_change":"2023-10-06T11:08:42.429474+0000","last_active":"2023-10-06T11:08:43.439412+0000","last_peered":"2023-10-06T11:08:43.439412+0000","last_clean":"2023-10-06T11:08:43.439412+0000","last_became_active":"2023-10-06T11:08:42.429213+0000","last_became_peered":"2023-10-06T11:08:42.429213+0000","last_unstale":"2023-10-06T11:08:43.439412+0000","last_undegraded":"2023-10-06T11:08:43.439412+0000","last_fullsized":"2023-10-06T11:08:43.439412+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:32:09.873020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"46'6","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.441588+0000","last_change":"2023-10-06T11:08:42.425248+0000","last_active":"2023-10-06T11:08:43.441588+0000","last_peered":"2023-10-06T11:08:43.441588+0000","last_clean":"2023-10-06T11:08:43.441588+0000","last_became_active":"2023-10-06T11:08:42.425015+0000","last_became_peered":"2023-10-06T11:08:42.425015+0000","last_unstale":"2023-10-06T11:08:43.441588+0000","last_undegraded":"2023-10-06T11:08:43.441588+0000","last_fullsized":"2023-10-06T11:08:43.441588+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:54:06.381591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.428699+0000","last_change":"2023-10-06T11:08:43.424775+0000","last_active":"2023-10-06T11:08:43.428699+0000","last_peered":"2023-10-06T11:08:43.428699+0000","last_clean":"2023-10-06T11:08:43.428699+0000","last_became_active":"2023-10-06T11:08:43.424530+0000","last_became_peered":"2023-10-06T11:08:43.424530+0000","last_unstale":"2023-10-06T11:08:43.428699+0000","last_undegraded":"2023-10-06T11:08:43.428699+0000","last_fullsized":"2023-10-06T11:08:43.428699+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:33:49.431732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"46'2","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.438255+0000","last_change":"2023-10-06T11:08:42.429006+0000","last_active":"2023-10-06T11:08:43.438255+0000","last_peered":"2023-10-06T11:08:43.438255+0000","last_clean":"2023-10-06T11:08:43.438255+0000","last_became_active":"2023-10-06T11:08:42.428634+0000","last_became_peered":"2023-10-06T11:08:42.428634+0000","last_unstale":"2023-10-06T11:08:43.438255+0000","last_undegraded":"2023-10-06T11:08:43.438255+0000","last_fullsized":"2023-10-06T11:08:43.438255+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:35.607875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.434236+0000","last_change":"2023-10-06T11:08:43.427213+0000","last_active":"2023-10-06T11:08:43.434236+0000","last_peered":"2023-10-06T11:08:43.434236+0000","last_clean":"2023-10-06T11:08:43.434236+0000","last_became_active":"2023-10-06T11:08:43.426968+0000","last_became_peered":"2023-10-06T11:08:43.426968+0000","last_unstale":"2023-10-06T11:08:43.434236+0000","last_undegraded":"2023-10-06T11:08:43.434236+0000","last_fullsized":"2023-10-06T11:08:43.434236+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:27:02.499415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.407354+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:51.790939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.429655+0000","last_change":"2023-10-06T11:08:43.427942+0000","last_active":"2023-10-06T11:08:43.429655+0000","last_peered":"2023-10-06T11:08:43.429655+0000","last_clean":"2023-10-06T11:08:43.429655+0000","last_became_active":"2023-10-06T11:08:43.427700+0000","last_became_peered":"2023-10-06T11:08:43.427700+0000","last_unstale":"2023-10-06T11:08:43.429655+0000","last_undegraded":"2023-10-06T11:08:43.429655+0000","last_fullsized":"2023-10-06T11:08:43.429655+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:01:46.808227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.421807+0000","last_change":"2023-10-06T11:08:42.423739+0000","last_active":"2023-10-06T11:08:43.421807+0000","last_peered":"2023-10-06T11:08:43.421807+0000","last_clean":"2023-10-06T11:08:43.421807+0000","last_became_active":"2023-10-06T11:08:42.423397+0000","last_became_peered":"2023-10-06T11:08:42.423397+0000","last_unstale":"2023-10-06T11:08:43.421807+0000","last_undegraded":"2023-10-06T11:08:43.421807+0000","last_fullsized":"2023-10-06T11:08:43.421807+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:06:22.465949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435617+0000","last_change":"2023-10-06T11:08:43.427656+0000","last_active":"2023-10-06T11:08:43.435617+0000","last_peered":"2023-10-06T11:08:43.435617+0000","last_clean":"2023-10-06T11:08:43.435617+0000","last_became_active":"2023-10-06T11:08:43.427354+0000","last_became_peered":"2023-10-06T11:08:43.427354+0000","last_unstale":"2023-10-06T11:08:43.435617+0000","last_undegraded":"2023-10-06T11:08:43.435617+0000","last_fullsized":"2023-10-06T11:08:43.435617+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:39:00.400333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"46'8","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.440505+0000","last_change":"2023-10-06T11:08:42.424889+0000","last_active":"2023-10-06T11:08:43.440505+0000","last_peered":"2023-10-06T11:08:43.440505+0000","last_clean":"2023-10-06T11:08:43.440505+0000","last_became_active":"2023-10-06T11:08:42.424633+0000","last_became_peered":"2023-10-06T11:08:42.424633+0000","last_unstale":"2023-10-06T11:08:43.440505+0000","last_undegraded":"2023-10-06T11:08:43.440505+0000","last_fullsized":"2023-10-06T11:08:43.440505+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:32.004396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.429696+0000","last_change":"2023-10-06T11:08:43.428620+0000","last_active":"2023-10-06T11:08:43.429696+0000","last_peered":"2023-10-06T11:08:43.429696+0000","last_clean":"2023-10-06T11:08:43.429696+0000","last_became_active":"2023-10-06T11:08:43.428142+0000","last_became_peered":"2023-10-06T11:08:43.428142+0000","last_unstale":"2023-10-06T11:08:43.429696+0000","last_undegraded":"2023-10-06T11:08:43.429696+0000","last_fullsized":"2023-10-06T11:08:43.429696+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:28.243301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"46'1","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.436390+0000","last_change":"2023-10-06T11:08:42.432219+0000","last_active":"2023-10-06T11:08:43.436390+0000","last_peered":"2023-10-06T11:08:43.436390+0000","last_clean":"2023-10-06T11:08:43.436390+0000","last_became_active":"2023-10-06T11:08:42.431764+0000","last_became_peered":"2023-10-06T11:08:42.431764+0000","last_unstale":"2023-10-06T11:08:43.436390+0000","last_undegraded":"2023-10-06T11:08:43.436390+0000","last_fullsized":"2023-10-06T11:08:43.436390+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:45:43.800494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"46'2","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.439915+0000","last_change":"2023-10-06T11:08:42.419848+0000","last_active":"2023-10-06T11:08:43.439915+0000","last_peered":"2023-10-06T11:08:43.439915+0000","last_clean":"2023-10-06T11:08:43.439915+0000","last_became_active":"2023-10-06T11:08:42.419544+0000","last_became_peered":"2023-10-06T11:08:42.419544+0000","last_unstale":"2023-10-06T11:08:43.439915+0000","last_undegraded":"2023-10-06T11:08:43.439915+0000","last_fullsized":"2023-10-06T11:08:43.439915+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:07:14.329644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.407701+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:35:14.166168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.407347+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:07:14.329644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.428782+0000","last_change":"2023-10-06T11:08:43.426219+0000","last_active":"2023-10-06T11:08:43.428782+0000","last_peered":"2023-10-06T11:08:43.428782+0000","last_clean":"2023-10-06T11:08:43.428782+0000","last_became_active":"2023-10-06T11:08:43.425974+0000","last_became_peered":"2023-10-06T11:08:43.425974+0000","last_unstale":"2023-10-06T11:08:43.428782+0000","last_undegraded":"2023-10-06T11:08:43.428782+0000","last_fullsized":"2023-10-06T11:08:43.428782+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:07:16.658185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.407311+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:39:11.705262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.416345+0000","last_change":"2023-10-06T11:08:42.424867+0000","last_active":"2023-10-06T11:08:43.416345+0000","last_peered":"2023-10-06T11:08:43.416345+0000","last_clean":"2023-10-06T11:08:43.416345+0000","last_became_active":"2023-10-06T11:08:42.424670+0000","last_became_peered":"2023-10-06T11:08:42.424670+0000","last_unstale":"2023-10-06T11:08:43.416345+0000","last_undegraded":"2023-10-06T11:08:43.416345+0000","last_fullsized":"2023-10-06T11:08:43.416345+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:28.006053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.434353+0000","last_change":"2023-10-06T11:08:43.426134+0000","last_active":"2023-10-06T11:08:43.434353+0000","last_peered":"2023-10-06T11:08:43.434353+0000","last_clean":"2023-10-06T11:08:43.434353+0000","last_became_active":"2023-10-06T11:08:43.425902+0000","last_became_peered":"2023-10-06T11:08:43.425902+0000","last_unstale":"2023-10-06T11:08:43.434353+0000","last_undegraded":"2023-10-06T11:08:43.434353+0000","last_fullsized":"2023-10-06T11:08:43.434353+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:51:36.859426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.419934+0000","last_change":"2023-10-06T11:08:42.430104+0000","last_active":"2023-10-06T11:08:43.419934+0000","last_peered":"2023-10-06T11:08:43.419934+0000","last_clean":"2023-10-06T11:08:43.419934+0000","last_became_active":"2023-10-06T11:08:42.429143+0000","last_became_peered":"2023-10-06T11:08:42.429143+0000","last_unstale":"2023-10-06T11:08:43.419934+0000","last_undegraded":"2023-10-06T11:08:43.419934+0000","last_fullsized":"2023-10-06T11:08:43.419934+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:33:48.422283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.414859+0000","last_change":"2023-10-06T11:08:42.422089+0000","last_active":"2023-10-06T11:08:43.414859+0000","last_peered":"2023-10-06T11:08:43.414859+0000","last_clean":"2023-10-06T11:08:43.414859+0000","last_became_active":"2023-10-06T11:08:42.421847+0000","last_became_peered":"2023-10-06T11:08:42.421847+0000","last_unstale":"2023-10-06T11:08:43.414859+0000","last_undegraded":"2023-10-06T11:08:43.414859+0000","last_fullsized":"2023-10-06T11:08:43.414859+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:24:24.468404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435505+0000","last_change":"2023-10-06T11:08:43.429380+0000","last_active":"2023-10-06T11:08:43.435505+0000","last_peered":"2023-10-06T11:08:43.435505+0000","last_clean":"2023-10-06T11:08:43.435505+0000","last_became_active":"2023-10-06T11:08:43.429113+0000","last_became_peered":"2023-10-06T11:08:43.429113+0000","last_unstale":"2023-10-06T11:08:43.435505+0000","last_undegraded":"2023-10-06T11:08:43.435505+0000","last_fullsized":"2023-10-06T11:08:43.435505+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:43.781886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.416288+0000","last_change":"2023-10-06T11:08:42.425700+0000","last_active":"2023-10-06T11:08:43.416288+0000","last_peered":"2023-10-06T11:08:43.416288+0000","last_clean":"2023-10-06T11:08:43.416288+0000","last_became_active":"2023-10-06T11:08:42.425460+0000","last_became_peered":"2023-10-06T11:08:42.425460+0000","last_unstale":"2023-10-06T11:08:43.416288+0000","last_undegraded":"2023-10-06T11:08:43.416288+0000","last_fullsized":"2023-10-06T11:08:43.416288+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:31:48.180069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":33,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T11:08:38.388420+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:08:38.388420+0000","last_peered":"2023-10-06T11:08:38.388420+0000","last_clean":"2023-10-06T11:08:38.388420+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:08:38.388420+0000","last_undegraded":"2023-10-06T11:08:38.388420+0000","last_fullsized":"2023-10-06T11:08:38.388420+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.428719+0000","last_change":"2023-10-06T11:08:43.425187+0000","last_active":"2023-10-06T11:08:43.428719+0000","last_peered":"2023-10-06T11:08:43.428719+0000","last_clean":"2023-10-06T11:08:43.428719+0000","last_became_active":"2023-10-06T11:08:43.424989+0000","last_became_peered":"2023-10-06T11:08:43.424989+0000","last_unstale":"2023-10-06T11:08:43.428719+0000","last_undegraded":"2023-10-06T11:08:43.428719+0000","last_fullsized":"2023-10-06T11:08:43.428719+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:45:44.809943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.416439+0000","last_change":"2023-10-06T11:08:42.428698+0000","last_active":"2023-10-06T11:08:43.416439+0000","last_peered":"2023-10-06T11:08:43.416439+0000","last_clean":"2023-10-06T11:08:43.416439+0000","last_became_active":"2023-10-06T11:08:42.428458+0000","last_became_peered":"2023-10-06T11:08:42.428458+0000","last_unstale":"2023-10-06T11:08:43.416439+0000","last_undegraded":"2023-10-06T11:08:43.416439+0000","last_fullsized":"2023-10-06T11:08:43.416439+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:29.761788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":39,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.416332+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:08:43.416332+0000","last_peered":"2023-10-06T11:08:43.416332+0000","last_clean":"2023-10-06T11:08:43.416332+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:08:43.416332+0000","last_undegraded":"2023-10-06T11:08:43.416332+0000","last_fullsized":"2023-10-06T11:08:43.416332+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.422039+0000","last_change":"2023-10-06T11:08:42.427034+0000","last_active":"2023-10-06T11:08:43.422039+0000","last_peered":"2023-10-06T11:08:43.422039+0000","last_clean":"2023-10-06T11:08:43.422039+0000","last_became_active":"2023-10-06T11:08:42.426733+0000","last_became_peered":"2023-10-06T11:08:42.426733+0000","last_unstale":"2023-10-06T11:08:43.422039+0000","last_undegraded":"2023-10-06T11:08:43.422039+0000","last_fullsized":"2023-10-06T11:08:43.422039+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:26:25.091803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":31,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T11:08:38.495257+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:08:38.495257+0000","last_peered":"2023-10-06T11:08:38.495257+0000","last_clean":"2023-10-06T11:08:38.495257+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:08:38.495257+0000","last_undegraded":"2023-10-06T11:08:38.495257+0000","last_fullsized":"2023-10-06T11:08:38.495257+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":184,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.421836+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:08:43.421836+0000","last_peered":"2023-10-06T11:08:43.421836+0000","last_clean":"2023-10-06T11:08:43.421836+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:08:43.421836+0000","last_undegraded":"2023-10-06T11:08:43.421836+0000","last_fullsized":"2023-10-06T11:08:43.421836+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.427071+0000","last_change":"2023-10-06T11:08:43.423061+0000","last_active":"2023-10-06T11:08:43.427071+0000","last_peered":"2023-10-06T11:08:43.427071+0000","last_clean":"2023-10-06T11:08:43.427071+0000","last_became_active":"2023-10-06T11:08:43.422802+0000","last_became_peered":"2023-10-06T11:08:43.422802+0000","last_unstale":"2023-10-06T11:08:43.427071+0000","last_undegraded":"2023-10-06T11:08:43.427071+0000","last_fullsized":"2023-10-06T11:08:43.427071+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:43.781886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.421298+0000","last_change":"2023-10-06T11:08:42.427910+0000","last_active":"2023-10-06T11:08:43.421298+0000","last_peered":"2023-10-06T11:08:43.421298+0000","last_clean":"2023-10-06T11:08:43.421298+0000","last_became_active":"2023-10-06T11:08:42.427478+0000","last_became_peered":"2023-10-06T11:08:42.427478+0000","last_unstale":"2023-10-06T11:08:43.421298+0000","last_undegraded":"2023-10-06T11:08:43.421298+0000","last_fullsized":"2023-10-06T11:08:43.421298+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:33:08.544897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.422507+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:08:43.422507+0000","last_peered":"2023-10-06T11:08:43.422507+0000","last_clean":"2023-10-06T11:08:43.422507+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:08:43.422507+0000","last_undegraded":"2023-10-06T11:08:43.422507+0000","last_fullsized":"2023-10-06T11:08:43.422507+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.421792+0000","last_change":"2023-10-06T11:08:42.428676+0000","last_active":"2023-10-06T11:08:43.421792+0000","last_peered":"2023-10-06T11:08:43.421792+0000","last_clean":"2023-10-06T11:08:43.421792+0000","last_became_active":"2023-10-06T11:08:42.428426+0000","last_became_peered":"2023-10-06T11:08:42.428426+0000","last_unstale":"2023-10-06T11:08:43.421792+0000","last_undegraded":"2023-10-06T11:08:43.421792+0000","last_fullsized":"2023-10-06T11:08:43.421792+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:07:15.648736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.421780+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:08:43.421780+0000","last_peered":"2023-10-06T11:08:43.421780+0000","last_clean":"2023-10-06T11:08:43.421780+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:08:43.421780+0000","last_undegraded":"2023-10-06T11:08:43.421780+0000","last_fullsized":"2023-10-06T11:08:43.421780+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.434698+0000","last_change":"2023-10-06T11:08:43.431756+0000","last_active":"2023-10-06T11:08:43.434698+0000","last_peered":"2023-10-06T11:08:43.434698+0000","last_clean":"2023-10-06T11:08:43.434698+0000","last_became_active":"2023-10-06T11:08:43.431105+0000","last_became_peered":"2023-10-06T11:08:43.431105+0000","last_unstale":"2023-10-06T11:08:43.434698+0000","last_undegraded":"2023-10-06T11:08:43.434698+0000","last_fullsized":"2023-10-06T11:08:43.434698+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:33.013845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.407235+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:59:13.774226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":39,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.415532+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:08:43.415532+0000","last_peered":"2023-10-06T11:08:43.415532+0000","last_clean":"2023-10-06T11:08:43.415532+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:08:43.415532+0000","last_undegraded":"2023-10-06T11:08:43.415532+0000","last_fullsized":"2023-10-06T11:08:43.415532+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.429728+0000","last_change":"2023-10-06T11:08:43.428796+0000","last_active":"2023-10-06T11:08:43.429728+0000","last_peered":"2023-10-06T11:08:43.429728+0000","last_clean":"2023-10-06T11:08:43.429728+0000","last_became_active":"2023-10-06T11:08:43.424121+0000","last_became_peered":"2023-10-06T11:08:43.424121+0000","last_unstale":"2023-10-06T11:08:43.429728+0000","last_undegraded":"2023-10-06T11:08:43.429728+0000","last_fullsized":"2023-10-06T11:08:43.429728+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:06:21.706780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.415243+0000","last_change":"2023-10-06T11:08:42.426380+0000","last_active":"2023-10-06T11:08:43.415243+0000","last_peered":"2023-10-06T11:08:43.415243+0000","last_clean":"2023-10-06T11:08:43.415243+0000","last_became_active":"2023-10-06T11:08:42.426061+0000","last_became_peered":"2023-10-06T11:08:42.426061+0000","last_unstale":"2023-10-06T11:08:43.415243+0000","last_undegraded":"2023-10-06T11:08:43.415243+0000","last_fullsized":"2023-10-06T11:08:43.415243+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:31:32.728096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":35,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T11:08:38.495549+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:08:38.495549+0000","last_peered":"2023-10-06T11:08:38.495549+0000","last_clean":"2023-10-06T11:08:38.495549+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:08:38.495549+0000","last_undegraded":"2023-10-06T11:08:38.495549+0000","last_fullsized":"2023-10-06T11:08:38.495549+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.433687+0000","last_change":"2023-10-06T11:08:43.423239+0000","last_active":"2023-10-06T11:08:43.433687+0000","last_peered":"2023-10-06T11:08:43.433687+0000","last_clean":"2023-10-06T11:08:43.433687+0000","last_became_active":"2023-10-06T11:08:43.422974+0000","last_became_peered":"2023-10-06T11:08:43.422974+0000","last_unstale":"2023-10-06T11:08:43.433687+0000","last_undegraded":"2023-10-06T11:08:43.433687+0000","last_fullsized":"2023-10-06T11:08:43.433687+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:56:57.888412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.405542+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:43.267112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":35,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T11:08:38.495552+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:08:38.495552+0000","last_peered":"2023-10-06T11:08:38.495552+0000","last_clean":"2023-10-06T11:08:38.495552+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:08:38.495552+0000","last_undegraded":"2023-10-06T11:08:38.495552+0000","last_fullsized":"2023-10-06T11:08:38.495552+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":1682,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25,"ondisk_log_size":25,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":86,"acting":86,"num_store_stats":5},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574889,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298416,"kb_used_data":1128,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073424,"statfs":{"total":96636764160,"available":96331186176,"internally_reserved":0,"allocated":1155072,"data_stored":829993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":1.871,"5min":0.73999999999999999,"15min":0.56999999999999995},"min":{"1min":0.41199999999999998,"5min":0.248,"15min":0.248},"max":{"1min":23.908999999999999,"5min":23.908999999999999,"15min":23.908999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":1.127,"5min":0.629,"15min":0.56499999999999995},"min":{"1min":0.374,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":9.0600000000000005,"5min":9.0600000000000005,"15min":9.0600000000000005},"last":0.52500000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":0.63900000000000001,"15min":0.57099999999999995},"min":{"1min":0.40899999999999997,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":9.2360000000000007,"5min":9.2360000000000007,"15min":9.2360000000000007},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.53900000000000003,"15min":0.51600000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":4.327,"5min":4.327,"15min":4.327},"last":0.53400000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.504,"15min":0.50900000000000001},"min":{"1min":0.311,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.505},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.59599999999999997,"15min":0.55800000000000005},"min":{"1min":0.436,"5min":0.309,"15min":0.309},"max":{"1min":4.7309999999999999,"5min":4.7309999999999999,"15min":4.7309999999999999},"last":0.64000000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.55400000000000005,"15min":0.51400000000000001},"min":{"1min":0.35299999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":4.3540000000000001,"5min":4.3540000000000001,"15min":4.3540000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":1.1870000000000001,"5min":0.67300000000000004,"15min":0.59999999999999998},"min":{"1min":0.45300000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":9.3879999999999999,"5min":9.3879999999999999,"15min":9.3879999999999999},"last":0.60899999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.50800000000000001,"15min":0.47499999999999998},"min":{"1min":0.34100000000000003,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":4.5709999999999997,"5min":4.5709999999999997,"15min":4.5709999999999997},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.753,"5min":0.55800000000000005,"15min":0.53500000000000003},"min":{"1min":0.33100000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":4.3129999999999997,"5min":4.3129999999999997,"15min":4.3129999999999997},"last":0.33100000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":0.64100000000000001,"15min":0.58099999999999996},"min":{"1min":0.34200000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":9.3499999999999996,"5min":9.3499999999999996,"15min":9.3499999999999996},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.58299999999999996,"15min":0.56699999999999995},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":4.444,"5min":4.444,"15min":4.444},"last":0.35099999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":0.67300000000000004,"15min":0.622},"min":{"1min":0.39700000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":9.4969999999999999,"5min":9.4969999999999999,"15min":9.4969999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.66200000000000003,"15min":0.62},"min":{"1min":0.44800000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":7.2039999999999997,"5min":7.2039999999999997,"15min":7.2039999999999997},"last":0.46100000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574890,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310076,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061764,"statfs":{"total":96636764160,"available":96319246336,"internally_reserved":0,"allocated":512000,"data_stored":217775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.48199999999999998,"15min":0.497},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52100000000000002,"15min":0.53300000000000003},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.52400000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.48299999999999998,"15min":0.499},"min":{"1min":0.34100000000000003,"5min":0.253,"15min":0.253},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.504},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48499999999999999,"15min":0.499},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.76400000000000001,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.624}]},{"osd":2,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.53100000000000003,"15min":0.498},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":7.0659999999999998,"5min":7.0659999999999998,"15min":7.0659999999999998},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.56100000000000005,"15min":0.52900000000000003},"min":{"1min":0.32500000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":7.0819999999999999,"5min":7.0819999999999999,"15min":7.0819999999999999},"last":0.57899999999999996}]},{"osd":3,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.49399999999999999,"15min":0.49299999999999999},"min":{"1min":0.32600000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.52700000000000002,"15min":0.53600000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.72799999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.64500000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.48699999999999999,"15min":0.50700000000000001},"min":{"1min":0.29599999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.64300000000000002,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54300000000000004,"15min":0.56799999999999995},"min":{"1min":0.32100000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.77100000000000002,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.72199999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52200000000000002,"15min":0.53800000000000003},"min":{"1min":0.307,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.75},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56299999999999994,"15min":0.58699999999999997},"min":{"1min":0.39500000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.79000000000000004,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.79000000000000004}]},{"osd":7,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56200000000000006,"15min":0.57699999999999996},"min":{"1min":0.36899999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79500000000000004,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.624,"5min":0.58999999999999997,"15min":0.60699999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83899999999999997,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.80800000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574889,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306564,"kb_used_data":1084,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065276,"statfs":{"total":96636764160,"available":96322842624,"internally_reserved":0,"allocated":1110016,"data_stored":809496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:39 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33100000000000002,"15min":0.34100000000000003},"min":{"1min":0.216,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.46000000000000002,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.316},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.34000000000000002,"15min":0.34399999999999997},"min":{"1min":0.26900000000000002,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.48799999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.30299999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:08:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.33600000000000002,"15min":0.33400000000000002},"min":{"1min":0.27300000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.5,"5min":0.505,"15min":0.505},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.435,"5min":0.38700000000000001,"15min":0.38600000000000001},"min":{"1min":0.251,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.38700000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:08:39 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.29599999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.60299999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.372,"15min":0.36599999999999999},"min":{"1min":0.30499999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.55400000000000005,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.40100000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:08:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.51600000000000001,"15min":0.503},"min":{"1min":0.42499999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.54600000000000004,"15min":0.53600000000000003},"min":{"1min":0.39900000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.752,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.63300000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:08:39 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.55300000000000005,"15min":0.54700000000000004},"min":{"1min":0.438,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.54800000000000004,"15min":0.53600000000000003},"min":{"1min":0.46400000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.80600000000000005,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.59199999999999997}]},{"osd":6,"last update":"Fri Oct 6 11:08:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.56799999999999995,"15min":0.56100000000000005},"min":{"1min":0.45500000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.57599999999999996,"15min":0.56899999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84899999999999998,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.61899999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:08:39 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.59099999999999997,"15min":0.58699999999999997},"min":{"1min":0.441,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.86199999999999999,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.58299999999999996,"15min":0.57999999999999996},"min":{"1min":0.41099999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.77600000000000002,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.57699999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297832,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074008,"statfs":{"total":96636764160,"available":96331784192,"internally_reserved":0,"allocated":557056,"data_stored":238204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32700000000000001,"15min":0.33300000000000002},"min":{"1min":0.223,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.503,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.34200000000000003,"15min":0.34100000000000003},"min":{"1min":0.246,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.24099999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.371,"15min":0.377},"min":{"1min":0.27400000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.435,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36099999999999999,"15min":0.36599999999999999},"min":{"1min":0.27200000000000002,"5min":0.219,"15min":0.219},"max":{"1min":0.46100000000000002,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.311}]},{"osd":3,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.371,"15min":0.373},"min":{"1min":0.26500000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.432,"15min":0.438},"min":{"1min":0.33000000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.55700000000000005,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.34200000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.55900000000000005,"15min":0.56000000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.60799999999999998,"15min":0.61499999999999999},"min":{"1min":0.36199999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.83999999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.75900000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54700000000000004,"15min":0.55100000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67900000000000005,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.55100000000000005,"15min":0.54500000000000004},"min":{"1min":0.40000000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.67900000000000005}]},{"osd":6,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60399999999999998,"15min":0.61199999999999999},"min":{"1min":0.432,"5min":0.375,"15min":0.375},"max":{"1min":0.84499999999999997,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60099999999999998,"15min":0.60499999999999998},"min":{"1min":0.42399999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.57999999999999996}]},{"osd":7,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59799999999999998,"15min":0.60499999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.81299999999999994,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.62},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.42099999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.70199999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574890,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310124,"kb_used_data":548,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061716,"statfs":{"total":96636764160,"available":96319197184,"internally_reserved":0,"allocated":561152,"data_stored":239684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.309,"15min":0.309},"min":{"1min":0.22500000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.437,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38100000000000001,"15min":0.38500000000000001},"min":{"1min":0.26900000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.51400000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.495}]},{"osd":1,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36899999999999999,"15min":0.375},"min":{"1min":0.24399999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.35399999999999998,"15min":0.34799999999999998},"min":{"1min":0.26900000000000002,"5min":0.217,"15min":0.217},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.45700000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.37,"15min":0.373},"min":{"1min":0.27800000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.438},{"interface":"front","average":{"1min":0.373,"5min":0.36499999999999999,"15min":0.36699999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.378}]},{"osd":4,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.33900000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.38900000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.58699999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.55200000000000005,"15min":0.55000000000000004},"min":{"1min":0.374,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.625},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.41799999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.67000000000000004}]},{"osd":6,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58299999999999996,"15min":0.58399999999999996},"min":{"1min":0.43099999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41399999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.68400000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.55900000000000005,"15min":0.55000000000000004},"min":{"1min":0.436,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.57099999999999995,"15min":0.56999999999999995},"min":{"1min":0.38600000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.70299999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574890,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310128,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061712,"statfs":{"total":96636764160,"available":96319193088,"internally_reserved":0,"allocated":565248,"data_stored":239706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.315,"15min":0.32800000000000001},"min":{"1min":0.248,"5min":0.188,"15min":0.188},"max":{"1min":0.46500000000000002,"5min":1.095,"15min":1.095},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38900000000000001,"15min":0.40500000000000003},"min":{"1min":0.29999999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.50600000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.39500000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.314,"15min":0.309},"min":{"1min":0.255,"5min":0.219,"15min":0.219},"max":{"1min":0.47499999999999998,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.36699999999999999,"15min":0.373},"min":{"1min":0.26500000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.51500000000000001,"5min":1.196,"15min":1.196},"last":0.36799999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.38100000000000001,"15min":0.39400000000000002},"min":{"1min":0.24199999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.54500000000000004,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.31},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.42399999999999999},"min":{"1min":0.33700000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.55900000000000005,"5min":1.224,"15min":1.224},"last":0.40999999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.55700000000000005,"15min":0.57499999999999996},"min":{"1min":0.38200000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.92500000000000004,"5min":1.694,"15min":1.694},"last":0.627},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53800000000000003,"15min":0.54500000000000004},"min":{"1min":0.36599999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.78200000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.41599999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55700000000000005,"15min":0.56599999999999995},"min":{"1min":0.39200000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.82199999999999995,"5min":1.165,"15min":1.165},"last":0.82199999999999995}]},{"osd":6,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58499999999999996,"15min":0.59499999999999997},"min":{"1min":0.40200000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.89900000000000002,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.59399999999999997,"15min":0.60499999999999998},"min":{"1min":0.45400000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83399999999999996,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.83399999999999996}]},{"osd":7,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58299999999999996,"15min":0.59699999999999998},"min":{"1min":0.40999999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84799999999999998,"5min":1.657,"15min":1.657},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.57099999999999995,"15min":0.57399999999999995},"min":{"1min":0.46700000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.68200000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310080,"kb_used_data":504,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061760,"statfs":{"total":96636764160,"available":96319242240,"internally_reserved":0,"allocated":516096,"data_stored":219128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:07:42 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.57699999999999996,"15min":0.61299999999999999},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.62,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.48799999999999999,"15min":0.501},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.65500000000000003,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.439}]},{"osd":1,"last update":"Fri Oct 6 11:07:42 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.60799999999999998,"15min":0.63900000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.60399999999999998,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.436,"5min":0.61199999999999999,"15min":0.64100000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.67500000000000004,"5min":2.7610000000000001,"15min":2.7610000000000001},"last":0.52700000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:07:42 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.56999999999999995,"15min":0.59099999999999997},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69099999999999995,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.377},{"interface":"front","average":{"1min":0.498,"5min":0.60599999999999998,"15min":0.624},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69299999999999995,"5min":1.718,"15min":1.718},"last":0.497}]},{"osd":3,"last update":"Fri Oct 6 11:07:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.63,"15min":0.65700000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.67700000000000005,"5min":2.677,"15min":2.677},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.51600000000000001,"15min":0.52600000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.63100000000000001,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.45400000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:07:42 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.48799999999999999,"15min":0.502},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.60499999999999998,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.44,"5min":0.53500000000000003,"15min":0.55100000000000005},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.64300000000000002,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.51300000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:07:42 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.52300000000000002,"15min":0.53900000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.624,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.58099999999999996,"15min":0.60099999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.64700000000000002,"5min":1.165,"15min":1.165},"last":0.56499999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:07:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.54900000000000004,"15min":0.56100000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.63700000000000001,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.60099999999999998,"15min":0.61899999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.66100000000000003,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.57399999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310104,"kb_used_data":528,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061736,"statfs":{"total":96636764160,"available":96319217664,"internally_reserved":0,"allocated":540672,"data_stored":232860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.66600000000000004,"15min":0.72399999999999998},"min":{"1min":0.36199999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.71899999999999997,"5min":5.0490000000000004,"15min":5.0490000000000004},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.627,"15min":0.69299999999999995},"min":{"1min":0.254,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.755,"5min":5.1449999999999996,"15min":5.1449999999999996},"last":0.39000000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48999999999999999,"15min":0.49199999999999999},"min":{"1min":0.315,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.70699999999999996,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.70699999999999996,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.56000000000000005}]},{"osd":2,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.57999999999999996,"15min":0.56699999999999995},"min":{"1min":0.379,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.81799999999999995,"5min":4.234,"15min":4.234},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56899999999999995,"15min":0.57799999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76600000000000001,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.59899999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.66700000000000004,"15min":0.74399999999999999},"min":{"1min":0.29299999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.72099999999999997,"5min":5.2169999999999996,"15min":5.2169999999999996},"last":0.438},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55100000000000005,"15min":0.55500000000000005},"min":{"1min":0.39600000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.83399999999999996,"5min":1.008,"15min":1.008},"last":0.53300000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.52900000000000003,"15min":0.53800000000000003},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.871,"5min":1.917,"15min":1.917},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.53800000000000003,"15min":0.55500000000000005},"min":{"1min":0.27200000000000002,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.85499999999999998,"5min":0.87,"15min":0.87},"last":0.50900000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.34899999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.89500000000000002,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.624,"15min":0.63200000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.92300000000000004,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":0.64400000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58999999999999997,"15min":0.60899999999999999},"min":{"1min":0.32100000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.84299999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.621,"15min":0.63},"min":{"1min":0.372,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.93899999999999995,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.629}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:08:47.859 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:08:48.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.003+0000 7fcbb7537700 1 Processor -- start 2023-10-06T11:08:48.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.003+0000 7fcbb7537700 1 -- start start 2023-10-06T11:08:48.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.004+0000 7fcbb7537700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcbb0157430 0x7fcbb0157800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:48.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.004+0000 7fcbb7537700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcbb00ca070 0x7fcbb00cc240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:48.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.004+0000 7fcbb7537700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbb00ccf20 con 0x7fcbb00ab010 2023-10-06T11:08:48.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.004+0000 7fcbb7537700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbb00ca4f0 con 0x7fcbb00ca070 2023-10-06T11:08:48.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.004+0000 7fcbb7537700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbb00c3dd0 con 0x7fcbb0157430 2023-10-06T11:08:48.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.004+0000 7fcbb5ad4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcbb00ca070 0x7fcbb00cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:48.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.004+0000 7fcbb4ad2700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fcbb00ab010 0x7fcbb00ceb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40068/0 (socket says 172.21.15.146:40068) 2023-10-06T11:08:48.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.004+0000 7fcbb4ad2700 1 -- 172.21.15.146:0/372027725 learned_addr learned my addr 172.21.15.146:0/372027725 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:08:48.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.005+0000 7fcbb52d3700 1 --2- 172.21.15.146:0/372027725 >> v2:172.21.15.151:3300/0 conn(0x7fcbb0157430 0x7fcbb0157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:48.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.005+0000 7fcbb5ad4700 1 -- 172.21.15.146:0/372027725 >> v2:172.21.15.151:3300/0 conn(0x7fcbb0157430 msgr2=0x7fcbb0157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:48.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.005+0000 7fcbb5ad4700 1 --2- 172.21.15.146:0/372027725 >> v2:172.21.15.151:3300/0 conn(0x7fcbb0157430 0x7fcbb0157800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:48.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.005+0000 7fcbb5ad4700 1 -- 172.21.15.146:0/372027725 >> v1:172.21.15.146:6789/0 conn(0x7fcbb00ab010 legacy=0x7fcbb00ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:48.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.005+0000 7fcbb5ad4700 1 -- 172.21.15.146:0/372027725 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb00cd200 con 0x7fcbb00ca070 2023-10-06T11:08:48.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.005+0000 7fcba7fff700 1 -- 172.21.15.146:0/372027725 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2654344588 0 0) 0x7fcbb00ccf20 con 0x7fcbb00ab010 2023-10-06T11:08:48.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.005+0000 7fcbb5ad4700 1 --2- 172.21.15.146:0/372027725 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbb00ca070 0x7fcbb00cc240 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fcbb006eec0 tx=0x7fcba8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e9341b17164aa9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:48.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.005+0000 7fcba7fff700 1 -- 172.21.15.146:0/372027725 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba800e070 con 0x7fcbb00ca070 2023-10-06T11:08:48.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.005+0000 7fcba7fff700 1 -- 172.21.15.146:0/372027725 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba800bc30 con 0x7fcbb00ca070 2023-10-06T11:08:48.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.005+0000 7fcba7fff700 1 -- 172.21.15.146:0/372027725 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba8012430 con 0x7fcbb00ca070 2023-10-06T11:08:48.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.005+0000 7fcbb7537700 1 -- 172.21.15.146:0/372027725 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbb00ca070 msgr2=0x7fcbb00cc240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:48.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.005+0000 7fcbb7537700 1 --2- 172.21.15.146:0/372027725 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbb00ca070 0x7fcbb00cc240 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fcbb006eec0 tx=0x7fcba8009780 comp rx=0 tx=0).stop 2023-10-06T11:08:48.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.006+0000 7fcbb7537700 1 -- 172.21.15.146:0/372027725 shutdown_connections 2023-10-06T11:08:48.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.006+0000 7fcbb7537700 1 --2- 172.21.15.146:0/372027725 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbb00ca070 0x7fcbb00cc240 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:48.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.006+0000 7fcbb7537700 1 --2- 172.21.15.146:0/372027725 >> v2:172.21.15.151:3300/0 conn(0x7fcbb0157430 0x7fcbb0157800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:48.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.006+0000 7fcbb7537700 1 -- 172.21.15.146:0/372027725 >> 172.21.15.146:0/372027725 conn(0x7fcbb0067c50 msgr2=0x7fcbb00ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:48.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.006+0000 7fcbb7537700 1 -- 172.21.15.146:0/372027725 shutdown_connections 2023-10-06T11:08:48.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.006+0000 7fcbb7537700 1 -- 172.21.15.146:0/372027725 wait complete. 2023-10-06T11:08:48.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.007+0000 7fcbb7537700 1 Processor -- start 2023-10-06T11:08:48.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.007+0000 7fcbb7537700 1 -- start start 2023-10-06T11:08:48.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.008+0000 7fcbb7537700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbb00ab010 0x7fcbb0151930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:48.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.008+0000 7fcbb7537700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbb00ca070 0x7fcbb00aceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:48.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.008+0000 7fcbb7537700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbb0157430 0x7fcbb006bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:48.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.008+0000 7fcbb7537700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb00ac260 con 0x7fcbb00ca070 2023-10-06T11:08:48.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.008+0000 7fcbb7537700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb00ab650 con 0x7fcbb0157430 2023-10-06T11:08:48.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.008+0000 7fcbb7537700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb00ab930 con 0x7fcbb00ab010 2023-10-06T11:08:48.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.008+0000 7fcbb4ad2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbb00ca070 0x7fcbb00aceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:48.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.008+0000 7fcbb4ad2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbb00ca070 0x7fcbb00aceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60898/0 (socket says 172.21.15.146:60898) 2023-10-06T11:08:48.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.008+0000 7fcbb4ad2700 1 -- 172.21.15.146:0/983669921 learned_addr learned my addr 172.21.15.146:0/983669921 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:48.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.008+0000 7fcbb5ad4700 1 --2- 172.21.15.146:0/983669921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbb0157430 0x7fcbb006bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:48.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.008+0000 7fcbb52d3700 1 --2- 172.21.15.146:0/983669921 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbb00ab010 0x7fcbb0151930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:48.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.008+0000 7fcbb4ad2700 1 -- 172.21.15.146:0/983669921 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbb00ab010 msgr2=0x7fcbb0151930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:48.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.008+0000 7fcbb4ad2700 1 --2- 172.21.15.146:0/983669921 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbb00ab010 0x7fcbb0151930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:48.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.008+0000 7fcbb4ad2700 1 -- 172.21.15.146:0/983669921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbb0157430 msgr2=0x7fcbb006bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:48.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.008+0000 7fcbb4ad2700 1 --2- 172.21.15.146:0/983669921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbb0157430 0x7fcbb006bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:48.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.008+0000 7fcbb4ad2700 1 -- 172.21.15.146:0/983669921 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba8009a20 con 0x7fcbb00ca070 2023-10-06T11:08:48.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.008+0000 7fcbb5ad4700 1 --2- 172.21.15.146:0/983669921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbb0157430 0x7fcbb006bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:08:48.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.008+0000 7fcbb52d3700 1 --2- 172.21.15.146:0/983669921 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbb00ab010 0x7fcbb0151930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:08:48.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.008+0000 7fcbb4ad2700 1 --2- 172.21.15.146:0/983669921 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbb00ca070 0x7fcbb00aceb0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fcba000c7e0 tx=0x7fcba0007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:48.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.008+0000 7fcba57fa700 1 -- 172.21.15.146:0/983669921 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba0005b30 con 0x7fcbb00ca070 2023-10-06T11:08:48.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.008+0000 7fcba57fa700 1 -- 172.21.15.146:0/983669921 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba0005c90 con 0x7fcbb00ca070 2023-10-06T11:08:48.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.008+0000 7fcbb7537700 1 -- 172.21.15.146:0/983669921 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbb00abc10 con 0x7fcbb00ca070 2023-10-06T11:08:48.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.008+0000 7fcba57fa700 1 -- 172.21.15.146:0/983669921 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba0007300 con 0x7fcbb00ca070 2023-10-06T11:08:48.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.008+0000 7fcbb7537700 1 -- 172.21.15.146:0/983669921 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbb0151e70 con 0x7fcbb00ca070 2023-10-06T11:08:48.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.009+0000 7fcbb7537700 1 -- 172.21.15.146:0/983669921 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbb00ac410 con 0x7fcbb00ca070 2023-10-06T11:08:48.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.010+0000 7fcba57fa700 1 -- 172.21.15.146:0/983669921 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcba001b400 con 0x7fcbb00ca070 2023-10-06T11:08:48.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.010+0000 7fcba57fa700 1 --2- 172.21.15.146:0/983669921 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcb94066f30 0x7fcb940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:48.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.010+0000 7fcba57fa700 1 -- 172.21.15.146:0/983669921 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcba0084120 con 0x7fcbb00ca070 2023-10-06T11:08:48.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.010+0000 7fcbb52d3700 1 --2- 172.21.15.146:0/983669921 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcb94066f30 0x7fcb940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:48.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.011+0000 7fcbb52d3700 1 --2- 172.21.15.146:0/983669921 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcb94066f30 0x7fcb940693e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcbac006fd0 tx=0x7fcbac008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:48.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.014+0000 7fcba57fa700 1 -- 172.21.15.146:0/983669921 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcbb00ac410 con 0x7fcbb00ca070 2023-10-06T11:08:48.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.194+0000 7fcbb7537700 1 -- 172.21.15.146:0/983669921 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcbb004c380 con 0x7fcb94066f30 2023-10-06T11:08:48.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.202+0000 7fcba57fa700 1 -- 172.21.15.146:0/983669921 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+307619 (secure 0 0 0) 0x7fcbb004c380 con 0x7fcb94066f30 2023-10-06T11:08:48.208 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:08:48.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.205+0000 7fcbb7537700 1 -- 172.21.15.146:0/983669921 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcb94066f30 msgr2=0x7fcb940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:48.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.205+0000 7fcbb7537700 1 --2- 172.21.15.146:0/983669921 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcb94066f30 0x7fcb940693e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcbac006fd0 tx=0x7fcbac008040 comp rx=0 tx=0).stop 2023-10-06T11:08:48.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.205+0000 7fcbb7537700 1 -- 172.21.15.146:0/983669921 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbb00ca070 msgr2=0x7fcbb00aceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:48.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.205+0000 7fcbb7537700 1 --2- 172.21.15.146:0/983669921 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbb00ca070 0x7fcbb00aceb0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fcba000c7e0 tx=0x7fcba0007df0 comp rx=0 tx=0).stop 2023-10-06T11:08:48.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.206+0000 7fcbb7537700 1 -- 172.21.15.146:0/983669921 shutdown_connections 2023-10-06T11:08:48.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.206+0000 7fcbb7537700 1 --2- 172.21.15.146:0/983669921 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcb94066f30 0x7fcb940693e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:48.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.206+0000 7fcbb7537700 1 --2- 172.21.15.146:0/983669921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbb0157430 0x7fcbb006bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:48.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.206+0000 7fcbb7537700 1 --2- 172.21.15.146:0/983669921 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbb00ab010 0x7fcbb0151930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:48.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.206+0000 7fcbb7537700 1 --2- 172.21.15.146:0/983669921 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcbb00ca070 0x7fcbb00aceb0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:48.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.206+0000 7fcbb7537700 1 -- 172.21.15.146:0/983669921 >> 172.21.15.146:0/983669921 conn(0x7fcbb0067c50 msgr2=0x7fcbb00ca780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:48.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.206+0000 7fcbb7537700 1 -- 172.21.15.146:0/983669921 shutdown_connections 2023-10-06T11:08:48.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.206+0000 7fcbb7537700 1 -- 172.21.15.146:0/983669921 wait complete. 2023-10-06T11:08:48.213 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:08:48.219 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":135,"stamp":"2023-10-06T11:08:47.179426+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592050,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":191,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":142,"ondisk_log_size":142,"up":168,"acting":168,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":104,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2453324,"kb_used_data":5388,"kb_used_omap":0,"kb_used_meta":2447872,"kb_avail":752521396,"statfs":{"total":773094113280,"available":770581909504,"internally_reserved":0,"allocated":5517312,"data_stored":3026846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2506620928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1682,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.776512"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.437128+0000","last_change":"2023-10-06T11:08:43.429477+0000","last_active":"2023-10-06T11:08:43.437128+0000","last_peered":"2023-10-06T11:08:43.437128+0000","last_clean":"2023-10-06T11:08:43.437128+0000","last_became_active":"2023-10-06T11:08:43.429245+0000","last_became_peered":"2023-10-06T11:08:43.429245+0000","last_unstale":"2023-10-06T11:08:43.437128+0000","last_undegraded":"2023-10-06T11:08:43.437128+0000","last_fullsized":"2023-10-06T11:08:43.437128+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:30.771237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.434216+0000","last_change":"2023-10-06T11:08:43.425499+0000","last_active":"2023-10-06T11:08:43.434216+0000","last_peered":"2023-10-06T11:08:43.434216+0000","last_clean":"2023-10-06T11:08:43.434216+0000","last_became_active":"2023-10-06T11:08:43.425262+0000","last_became_peered":"2023-10-06T11:08:43.425262+0000","last_unstale":"2023-10-06T11:08:43.434216+0000","last_undegraded":"2023-10-06T11:08:43.434216+0000","last_fullsized":"2023-10-06T11:08:43.434216+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:04:54.615565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.437292+0000","last_change":"2023-10-06T11:08:43.433555+0000","last_active":"2023-10-06T11:08:43.437292+0000","last_peered":"2023-10-06T11:08:43.437292+0000","last_clean":"2023-10-06T11:08:43.437292+0000","last_became_active":"2023-10-06T11:08:43.429961+0000","last_became_peered":"2023-10-06T11:08:43.429961+0000","last_unstale":"2023-10-06T11:08:43.437292+0000","last_undegraded":"2023-10-06T11:08:43.437292+0000","last_fullsized":"2023-10-06T11:08:43.437292+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:45:44.809943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435566+0000","last_change":"2023-10-06T11:08:43.424718+0000","last_active":"2023-10-06T11:08:43.435566+0000","last_peered":"2023-10-06T11:08:43.435566+0000","last_clean":"2023-10-06T11:08:43.435566+0000","last_became_active":"2023-10-06T11:08:43.424156+0000","last_became_peered":"2023-10-06T11:08:43.424156+0000","last_unstale":"2023-10-06T11:08:43.435566+0000","last_undegraded":"2023-10-06T11:08:43.435566+0000","last_fullsized":"2023-10-06T11:08:43.435566+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:52:09.529056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.429675+0000","last_change":"2023-10-06T11:08:43.428465+0000","last_active":"2023-10-06T11:08:43.429675+0000","last_peered":"2023-10-06T11:08:43.429675+0000","last_clean":"2023-10-06T11:08:43.429675+0000","last_became_active":"2023-10-06T11:08:43.427865+0000","last_became_peered":"2023-10-06T11:08:43.427865+0000","last_unstale":"2023-10-06T11:08:43.429675+0000","last_undegraded":"2023-10-06T11:08:43.429675+0000","last_fullsized":"2023-10-06T11:08:43.429675+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:23.831368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435190+0000","last_change":"2023-10-06T11:08:43.431433+0000","last_active":"2023-10-06T11:08:43.435190+0000","last_peered":"2023-10-06T11:08:43.435190+0000","last_clean":"2023-10-06T11:08:43.435190+0000","last_became_active":"2023-10-06T11:08:43.430675+0000","last_became_peered":"2023-10-06T11:08:43.430675+0000","last_unstale":"2023-10-06T11:08:43.435190+0000","last_undegraded":"2023-10-06T11:08:43.435190+0000","last_fullsized":"2023-10-06T11:08:43.435190+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:04:54.615565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.439131+0000","last_change":"2023-10-06T11:08:43.430750+0000","last_active":"2023-10-06T11:08:43.439131+0000","last_peered":"2023-10-06T11:08:43.439131+0000","last_clean":"2023-10-06T11:08:43.439131+0000","last_became_active":"2023-10-06T11:08:43.430457+0000","last_became_peered":"2023-10-06T11:08:43.430457+0000","last_unstale":"2023-10-06T11:08:43.439131+0000","last_undegraded":"2023-10-06T11:08:43.439131+0000","last_fullsized":"2023-10-06T11:08:43.439131+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:46.781626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.429682+0000","last_change":"2023-10-06T11:08:43.426994+0000","last_active":"2023-10-06T11:08:43.429682+0000","last_peered":"2023-10-06T11:08:43.429682+0000","last_clean":"2023-10-06T11:08:43.429682+0000","last_became_active":"2023-10-06T11:08:43.426729+0000","last_became_peered":"2023-10-06T11:08:43.426729+0000","last_unstale":"2023-10-06T11:08:43.429682+0000","last_undegraded":"2023-10-06T11:08:43.429682+0000","last_fullsized":"2023-10-06T11:08:43.429682+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:08:40.633452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435568+0000","last_change":"2023-10-06T11:08:43.428408+0000","last_active":"2023-10-06T11:08:43.435568+0000","last_peered":"2023-10-06T11:08:43.435568+0000","last_clean":"2023-10-06T11:08:43.435568+0000","last_became_active":"2023-10-06T11:08:43.428142+0000","last_became_peered":"2023-10-06T11:08:43.428142+0000","last_unstale":"2023-10-06T11:08:43.435568+0000","last_undegraded":"2023-10-06T11:08:43.435568+0000","last_fullsized":"2023-10-06T11:08:43.435568+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:23.831368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.437137+0000","last_change":"2023-10-06T11:08:43.429906+0000","last_active":"2023-10-06T11:08:43.437137+0000","last_peered":"2023-10-06T11:08:43.437137+0000","last_clean":"2023-10-06T11:08:43.437137+0000","last_became_active":"2023-10-06T11:08:43.429640+0000","last_became_peered":"2023-10-06T11:08:43.429640+0000","last_unstale":"2023-10-06T11:08:43.437137+0000","last_undegraded":"2023-10-06T11:08:43.437137+0000","last_fullsized":"2023-10-06T11:08:43.437137+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:33:49.431732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.433510+0000","last_change":"2023-10-06T11:08:43.422104+0000","last_active":"2023-10-06T11:08:43.433510+0000","last_peered":"2023-10-06T11:08:43.433510+0000","last_clean":"2023-10-06T11:08:43.433510+0000","last_became_active":"2023-10-06T11:08:43.421669+0000","last_became_peered":"2023-10-06T11:08:43.421669+0000","last_unstale":"2023-10-06T11:08:43.433510+0000","last_undegraded":"2023-10-06T11:08:43.433510+0000","last_fullsized":"2023-10-06T11:08:43.433510+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:28.243301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.437180+0000","last_change":"2023-10-06T11:08:43.433205+0000","last_active":"2023-10-06T11:08:43.437180+0000","last_peered":"2023-10-06T11:08:43.437180+0000","last_clean":"2023-10-06T11:08:43.437180+0000","last_became_active":"2023-10-06T11:08:43.429348+0000","last_became_peered":"2023-10-06T11:08:43.429348+0000","last_unstale":"2023-10-06T11:08:43.437180+0000","last_undegraded":"2023-10-06T11:08:43.437180+0000","last_fullsized":"2023-10-06T11:08:43.437180+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:31:49.189518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.434252+0000","last_change":"2023-10-06T11:08:43.427751+0000","last_active":"2023-10-06T11:08:43.434252+0000","last_peered":"2023-10-06T11:08:43.434252+0000","last_clean":"2023-10-06T11:08:43.434252+0000","last_became_active":"2023-10-06T11:08:43.427469+0000","last_became_peered":"2023-10-06T11:08:43.427469+0000","last_unstale":"2023-10-06T11:08:43.434252+0000","last_undegraded":"2023-10-06T11:08:43.434252+0000","last_fullsized":"2023-10-06T11:08:43.434252+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:26.368790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435606+0000","last_change":"2023-10-06T11:08:43.431889+0000","last_active":"2023-10-06T11:08:43.435606+0000","last_peered":"2023-10-06T11:08:43.435606+0000","last_clean":"2023-10-06T11:08:43.435606+0000","last_became_active":"2023-10-06T11:08:43.431636+0000","last_became_peered":"2023-10-06T11:08:43.431636+0000","last_unstale":"2023-10-06T11:08:43.435606+0000","last_undegraded":"2023-10-06T11:08:43.435606+0000","last_fullsized":"2023-10-06T11:08:43.435606+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:27:02.499415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.431264+0000","last_change":"2023-10-06T11:08:43.426550+0000","last_active":"2023-10-06T11:08:43.431264+0000","last_peered":"2023-10-06T11:08:43.431264+0000","last_clean":"2023-10-06T11:08:43.431264+0000","last_became_active":"2023-10-06T11:08:43.426263+0000","last_became_peered":"2023-10-06T11:08:43.426263+0000","last_unstale":"2023-10-06T11:08:43.431264+0000","last_undegraded":"2023-10-06T11:08:43.431264+0000","last_fullsized":"2023-10-06T11:08:43.431264+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:29:00.361399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.433487+0000","last_change":"2023-10-06T11:08:43.423917+0000","last_active":"2023-10-06T11:08:43.433487+0000","last_peered":"2023-10-06T11:08:43.433487+0000","last_clean":"2023-10-06T11:08:43.433487+0000","last_became_active":"2023-10-06T11:08:43.423665+0000","last_became_peered":"2023-10-06T11:08:43.423665+0000","last_unstale":"2023-10-06T11:08:43.433487+0000","last_undegraded":"2023-10-06T11:08:43.433487+0000","last_fullsized":"2023-10-06T11:08:43.433487+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:06:21.706780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435638+0000","last_change":"2023-10-06T11:08:43.430289+0000","last_active":"2023-10-06T11:08:43.435638+0000","last_peered":"2023-10-06T11:08:43.435638+0000","last_clean":"2023-10-06T11:08:43.435638+0000","last_became_active":"2023-10-06T11:08:43.430041+0000","last_became_peered":"2023-10-06T11:08:43.430041+0000","last_unstale":"2023-10-06T11:08:43.435638+0000","last_undegraded":"2023-10-06T11:08:43.435638+0000","last_fullsized":"2023-10-06T11:08:43.435638+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:01:46.808227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.429634+0000","last_change":"2023-10-06T11:08:43.426790+0000","last_active":"2023-10-06T11:08:43.429634+0000","last_peered":"2023-10-06T11:08:43.429634+0000","last_clean":"2023-10-06T11:08:43.429634+0000","last_became_active":"2023-10-06T11:08:43.426546+0000","last_became_peered":"2023-10-06T11:08:43.426546+0000","last_unstale":"2023-10-06T11:08:43.429634+0000","last_undegraded":"2023-10-06T11:08:43.429634+0000","last_fullsized":"2023-10-06T11:08:43.429634+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:39:00.400333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435640+0000","last_change":"2023-10-06T11:08:43.432649+0000","last_active":"2023-10-06T11:08:43.435640+0000","last_peered":"2023-10-06T11:08:43.435640+0000","last_clean":"2023-10-06T11:08:43.435640+0000","last_became_active":"2023-10-06T11:08:43.432398+0000","last_became_peered":"2023-10-06T11:08:43.432398+0000","last_unstale":"2023-10-06T11:08:43.435640+0000","last_undegraded":"2023-10-06T11:08:43.435640+0000","last_fullsized":"2023-10-06T11:08:43.435640+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:50:26.239260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.437343+0000","last_change":"2023-10-06T11:08:43.435236+0000","last_active":"2023-10-06T11:08:43.437343+0000","last_peered":"2023-10-06T11:08:43.437343+0000","last_clean":"2023-10-06T11:08:43.437343+0000","last_became_active":"2023-10-06T11:08:43.434990+0000","last_became_peered":"2023-10-06T11:08:43.434990+0000","last_unstale":"2023-10-06T11:08:43.437343+0000","last_undegraded":"2023-10-06T11:08:43.437343+0000","last_fullsized":"2023-10-06T11:08:43.437343+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:29.015502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435588+0000","last_change":"2023-10-06T11:08:43.424872+0000","last_active":"2023-10-06T11:08:43.435588+0000","last_peered":"2023-10-06T11:08:43.435588+0000","last_clean":"2023-10-06T11:08:43.435588+0000","last_became_active":"2023-10-06T11:08:43.424349+0000","last_became_peered":"2023-10-06T11:08:43.424349+0000","last_unstale":"2023-10-06T11:08:43.435588+0000","last_undegraded":"2023-10-06T11:08:43.435588+0000","last_fullsized":"2023-10-06T11:08:43.435588+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:03:16.583418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.434680+0000","last_change":"2023-10-06T11:08:43.431580+0000","last_active":"2023-10-06T11:08:43.434680+0000","last_peered":"2023-10-06T11:08:43.434680+0000","last_clean":"2023-10-06T11:08:43.434680+0000","last_became_active":"2023-10-06T11:08:43.430722+0000","last_became_peered":"2023-10-06T11:08:43.430722+0000","last_unstale":"2023-10-06T11:08:43.434680+0000","last_undegraded":"2023-10-06T11:08:43.434680+0000","last_fullsized":"2023-10-06T11:08:43.434680+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:54:07.391040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.428430+0000","last_change":"2023-10-06T11:08:43.427248+0000","last_active":"2023-10-06T11:08:43.428430+0000","last_peered":"2023-10-06T11:08:43.428430+0000","last_clean":"2023-10-06T11:08:43.428430+0000","last_became_active":"2023-10-06T11:08:43.426986+0000","last_became_peered":"2023-10-06T11:08:43.426986+0000","last_unstale":"2023-10-06T11:08:43.428430+0000","last_undegraded":"2023-10-06T11:08:43.428430+0000","last_fullsized":"2023-10-06T11:08:43.428430+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:33.013845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.407835+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:03.751012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.428786+0000","last_change":"2023-10-06T11:08:43.427311+0000","last_active":"2023-10-06T11:08:43.428786+0000","last_peered":"2023-10-06T11:08:43.428786+0000","last_clean":"2023-10-06T11:08:43.428786+0000","last_became_active":"2023-10-06T11:08:43.427059+0000","last_became_peered":"2023-10-06T11:08:43.427059+0000","last_unstale":"2023-10-06T11:08:43.428786+0000","last_undegraded":"2023-10-06T11:08:43.428786+0000","last_fullsized":"2023-10-06T11:08:43.428786+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:33:09.554346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.407802+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:13:18.791935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.407406+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:51:07.091891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.429699+0000","last_change":"2023-10-06T11:08:43.427507+0000","last_active":"2023-10-06T11:08:43.429699+0000","last_peered":"2023-10-06T11:08:43.429699+0000","last_clean":"2023-10-06T11:08:43.429699+0000","last_became_active":"2023-10-06T11:08:43.427268+0000","last_became_peered":"2023-10-06T11:08:43.427268+0000","last_unstale":"2023-10-06T11:08:43.429699+0000","last_undegraded":"2023-10-06T11:08:43.429699+0000","last_fullsized":"2023-10-06T11:08:43.429699+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:03:16.583418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"46'2","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.438968+0000","last_change":"2023-10-06T11:08:42.422232+0000","last_active":"2023-10-06T11:08:43.438968+0000","last_peered":"2023-10-06T11:08:43.438968+0000","last_clean":"2023-10-06T11:08:43.438968+0000","last_became_active":"2023-10-06T11:08:42.421943+0000","last_became_peered":"2023-10-06T11:08:42.421943+0000","last_unstale":"2023-10-06T11:08:43.438968+0000","last_undegraded":"2023-10-06T11:08:43.438968+0000","last_fullsized":"2023-10-06T11:08:43.438968+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:26:25.091803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"46'1","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.439458+0000","last_change":"2023-10-06T11:08:42.428856+0000","last_active":"2023-10-06T11:08:43.439458+0000","last_peered":"2023-10-06T11:08:43.439458+0000","last_clean":"2023-10-06T11:08:43.439458+0000","last_became_active":"2023-10-06T11:08:42.428382+0000","last_became_peered":"2023-10-06T11:08:42.428382+0000","last_unstale":"2023-10-06T11:08:43.439458+0000","last_undegraded":"2023-10-06T11:08:43.439458+0000","last_fullsized":"2023-10-06T11:08:43.439458+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:21.442104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.437333+0000","last_change":"2023-10-06T11:08:43.435060+0000","last_active":"2023-10-06T11:08:43.437333+0000","last_peered":"2023-10-06T11:08:43.437333+0000","last_clean":"2023-10-06T11:08:43.437333+0000","last_became_active":"2023-10-06T11:08:43.434067+0000","last_became_peered":"2023-10-06T11:08:43.434067+0000","last_unstale":"2023-10-06T11:08:43.437333+0000","last_undegraded":"2023-10-06T11:08:43.437333+0000","last_fullsized":"2023-10-06T11:08:43.437333+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:10.212258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.404858+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:25.209537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.429405+0000","last_change":"2023-10-06T11:08:43.426045+0000","last_active":"2023-10-06T11:08:43.429405+0000","last_peered":"2023-10-06T11:08:43.429405+0000","last_clean":"2023-10-06T11:08:43.429405+0000","last_became_active":"2023-10-06T11:08:43.425808+0000","last_became_peered":"2023-10-06T11:08:43.425808+0000","last_unstale":"2023-10-06T11:08:43.429405+0000","last_undegraded":"2023-10-06T11:08:43.429405+0000","last_fullsized":"2023-10-06T11:08:43.429405+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:26.368790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.407305+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:24:24.468404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.437296+0000","last_change":"2023-10-06T11:08:43.434561+0000","last_active":"2023-10-06T11:08:43.437296+0000","last_peered":"2023-10-06T11:08:43.437296+0000","last_clean":"2023-10-06T11:08:43.437296+0000","last_became_active":"2023-10-06T11:08:43.434261+0000","last_became_peered":"2023-10-06T11:08:43.434261+0000","last_unstale":"2023-10-06T11:08:43.437296+0000","last_undegraded":"2023-10-06T11:08:43.437296+0000","last_fullsized":"2023-10-06T11:08:43.437296+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:25:01.083898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.419445+0000","last_change":"2023-10-06T11:08:42.426277+0000","last_active":"2023-10-06T11:08:43.419445+0000","last_peered":"2023-10-06T11:08:43.419445+0000","last_clean":"2023-10-06T11:08:43.419445+0000","last_became_active":"2023-10-06T11:08:42.425809+0000","last_became_peered":"2023-10-06T11:08:42.425809+0000","last_unstale":"2023-10-06T11:08:43.419445+0000","last_undegraded":"2023-10-06T11:08:43.419445+0000","last_fullsized":"2023-10-06T11:08:43.419445+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:43.267112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.422360+0000","last_change":"2023-10-06T11:08:42.424509+0000","last_active":"2023-10-06T11:08:43.422360+0000","last_peered":"2023-10-06T11:08:43.422360+0000","last_clean":"2023-10-06T11:08:43.422360+0000","last_became_active":"2023-10-06T11:08:42.424227+0000","last_became_peered":"2023-10-06T11:08:42.424227+0000","last_unstale":"2023-10-06T11:08:43.422360+0000","last_undegraded":"2023-10-06T11:08:43.422360+0000","last_fullsized":"2023-10-06T11:08:43.422360+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:20:21.116613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.428755+0000","last_change":"2023-10-06T11:08:43.425933+0000","last_active":"2023-10-06T11:08:43.428755+0000","last_peered":"2023-10-06T11:08:43.428755+0000","last_clean":"2023-10-06T11:08:43.428755+0000","last_became_active":"2023-10-06T11:08:43.425682+0000","last_became_peered":"2023-10-06T11:08:43.425682+0000","last_unstale":"2023-10-06T11:08:43.428755+0000","last_undegraded":"2023-10-06T11:08:43.428755+0000","last_fullsized":"2023-10-06T11:08:43.428755+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:22.451552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.405987+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:06:38.366301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435589+0000","last_change":"2023-10-06T11:08:43.430989+0000","last_active":"2023-10-06T11:08:43.435589+0000","last_peered":"2023-10-06T11:08:43.435589+0000","last_clean":"2023-10-06T11:08:43.435589+0000","last_became_active":"2023-10-06T11:08:43.430743+0000","last_became_peered":"2023-10-06T11:08:43.430743+0000","last_unstale":"2023-10-06T11:08:43.435589+0000","last_undegraded":"2023-10-06T11:08:43.435589+0000","last_fullsized":"2023-10-06T11:08:43.435589+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:29:21.767861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"46'3","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.439412+0000","last_change":"2023-10-06T11:08:42.429474+0000","last_active":"2023-10-06T11:08:43.439412+0000","last_peered":"2023-10-06T11:08:43.439412+0000","last_clean":"2023-10-06T11:08:43.439412+0000","last_became_active":"2023-10-06T11:08:42.429213+0000","last_became_peered":"2023-10-06T11:08:42.429213+0000","last_unstale":"2023-10-06T11:08:43.439412+0000","last_undegraded":"2023-10-06T11:08:43.439412+0000","last_fullsized":"2023-10-06T11:08:43.439412+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:32:09.873020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"46'6","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.441588+0000","last_change":"2023-10-06T11:08:42.425248+0000","last_active":"2023-10-06T11:08:43.441588+0000","last_peered":"2023-10-06T11:08:43.441588+0000","last_clean":"2023-10-06T11:08:43.441588+0000","last_became_active":"2023-10-06T11:08:42.425015+0000","last_became_peered":"2023-10-06T11:08:42.425015+0000","last_unstale":"2023-10-06T11:08:43.441588+0000","last_undegraded":"2023-10-06T11:08:43.441588+0000","last_fullsized":"2023-10-06T11:08:43.441588+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:54:06.381591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.428699+0000","last_change":"2023-10-06T11:08:43.424775+0000","last_active":"2023-10-06T11:08:43.428699+0000","last_peered":"2023-10-06T11:08:43.428699+0000","last_clean":"2023-10-06T11:08:43.428699+0000","last_became_active":"2023-10-06T11:08:43.424530+0000","last_became_peered":"2023-10-06T11:08:43.424530+0000","last_unstale":"2023-10-06T11:08:43.428699+0000","last_undegraded":"2023-10-06T11:08:43.428699+0000","last_fullsized":"2023-10-06T11:08:43.428699+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:33:49.431732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"46'2","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.438255+0000","last_change":"2023-10-06T11:08:42.429006+0000","last_active":"2023-10-06T11:08:43.438255+0000","last_peered":"2023-10-06T11:08:43.438255+0000","last_clean":"2023-10-06T11:08:43.438255+0000","last_became_active":"2023-10-06T11:08:42.428634+0000","last_became_peered":"2023-10-06T11:08:42.428634+0000","last_unstale":"2023-10-06T11:08:43.438255+0000","last_undegraded":"2023-10-06T11:08:43.438255+0000","last_fullsized":"2023-10-06T11:08:43.438255+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:35.607875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.434236+0000","last_change":"2023-10-06T11:08:43.427213+0000","last_active":"2023-10-06T11:08:43.434236+0000","last_peered":"2023-10-06T11:08:43.434236+0000","last_clean":"2023-10-06T11:08:43.434236+0000","last_became_active":"2023-10-06T11:08:43.426968+0000","last_became_peered":"2023-10-06T11:08:43.426968+0000","last_unstale":"2023-10-06T11:08:43.434236+0000","last_undegraded":"2023-10-06T11:08:43.434236+0000","last_fullsized":"2023-10-06T11:08:43.434236+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:27:02.499415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.407354+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:51.790939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.429655+0000","last_change":"2023-10-06T11:08:43.427942+0000","last_active":"2023-10-06T11:08:43.429655+0000","last_peered":"2023-10-06T11:08:43.429655+0000","last_clean":"2023-10-06T11:08:43.429655+0000","last_became_active":"2023-10-06T11:08:43.427700+0000","last_became_peered":"2023-10-06T11:08:43.427700+0000","last_unstale":"2023-10-06T11:08:43.429655+0000","last_undegraded":"2023-10-06T11:08:43.429655+0000","last_fullsized":"2023-10-06T11:08:43.429655+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:01:46.808227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.421807+0000","last_change":"2023-10-06T11:08:42.423739+0000","last_active":"2023-10-06T11:08:43.421807+0000","last_peered":"2023-10-06T11:08:43.421807+0000","last_clean":"2023-10-06T11:08:43.421807+0000","last_became_active":"2023-10-06T11:08:42.423397+0000","last_became_peered":"2023-10-06T11:08:42.423397+0000","last_unstale":"2023-10-06T11:08:43.421807+0000","last_undegraded":"2023-10-06T11:08:43.421807+0000","last_fullsized":"2023-10-06T11:08:43.421807+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:06:22.465949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435617+0000","last_change":"2023-10-06T11:08:43.427656+0000","last_active":"2023-10-06T11:08:43.435617+0000","last_peered":"2023-10-06T11:08:43.435617+0000","last_clean":"2023-10-06T11:08:43.435617+0000","last_became_active":"2023-10-06T11:08:43.427354+0000","last_became_peered":"2023-10-06T11:08:43.427354+0000","last_unstale":"2023-10-06T11:08:43.435617+0000","last_undegraded":"2023-10-06T11:08:43.435617+0000","last_fullsized":"2023-10-06T11:08:43.435617+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:39:00.400333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"46'8","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.440505+0000","last_change":"2023-10-06T11:08:42.424889+0000","last_active":"2023-10-06T11:08:43.440505+0000","last_peered":"2023-10-06T11:08:43.440505+0000","last_clean":"2023-10-06T11:08:43.440505+0000","last_became_active":"2023-10-06T11:08:42.424633+0000","last_became_peered":"2023-10-06T11:08:42.424633+0000","last_unstale":"2023-10-06T11:08:43.440505+0000","last_undegraded":"2023-10-06T11:08:43.440505+0000","last_fullsized":"2023-10-06T11:08:43.440505+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:32.004396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.429696+0000","last_change":"2023-10-06T11:08:43.428620+0000","last_active":"2023-10-06T11:08:43.429696+0000","last_peered":"2023-10-06T11:08:43.429696+0000","last_clean":"2023-10-06T11:08:43.429696+0000","last_became_active":"2023-10-06T11:08:43.428142+0000","last_became_peered":"2023-10-06T11:08:43.428142+0000","last_unstale":"2023-10-06T11:08:43.429696+0000","last_undegraded":"2023-10-06T11:08:43.429696+0000","last_fullsized":"2023-10-06T11:08:43.429696+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:28.243301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"46'1","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.436390+0000","last_change":"2023-10-06T11:08:42.432219+0000","last_active":"2023-10-06T11:08:43.436390+0000","last_peered":"2023-10-06T11:08:43.436390+0000","last_clean":"2023-10-06T11:08:43.436390+0000","last_became_active":"2023-10-06T11:08:42.431764+0000","last_became_peered":"2023-10-06T11:08:42.431764+0000","last_unstale":"2023-10-06T11:08:43.436390+0000","last_undegraded":"2023-10-06T11:08:43.436390+0000","last_fullsized":"2023-10-06T11:08:43.436390+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:45:43.800494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"46'2","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.439915+0000","last_change":"2023-10-06T11:08:42.419848+0000","last_active":"2023-10-06T11:08:43.439915+0000","last_peered":"2023-10-06T11:08:43.439915+0000","last_clean":"2023-10-06T11:08:43.439915+0000","last_became_active":"2023-10-06T11:08:42.419544+0000","last_became_peered":"2023-10-06T11:08:42.419544+0000","last_unstale":"2023-10-06T11:08:43.439915+0000","last_undegraded":"2023-10-06T11:08:43.439915+0000","last_fullsized":"2023-10-06T11:08:43.439915+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:07:14.329644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.407701+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:35:14.166168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.407347+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:07:14.329644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.428782+0000","last_change":"2023-10-06T11:08:43.426219+0000","last_active":"2023-10-06T11:08:43.428782+0000","last_peered":"2023-10-06T11:08:43.428782+0000","last_clean":"2023-10-06T11:08:43.428782+0000","last_became_active":"2023-10-06T11:08:43.425974+0000","last_became_peered":"2023-10-06T11:08:43.425974+0000","last_unstale":"2023-10-06T11:08:43.428782+0000","last_undegraded":"2023-10-06T11:08:43.428782+0000","last_fullsized":"2023-10-06T11:08:43.428782+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:07:16.658185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.407311+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:39:11.705262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.416345+0000","last_change":"2023-10-06T11:08:42.424867+0000","last_active":"2023-10-06T11:08:43.416345+0000","last_peered":"2023-10-06T11:08:43.416345+0000","last_clean":"2023-10-06T11:08:43.416345+0000","last_became_active":"2023-10-06T11:08:42.424670+0000","last_became_peered":"2023-10-06T11:08:42.424670+0000","last_unstale":"2023-10-06T11:08:43.416345+0000","last_undegraded":"2023-10-06T11:08:43.416345+0000","last_fullsized":"2023-10-06T11:08:43.416345+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:28.006053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.434353+0000","last_change":"2023-10-06T11:08:43.426134+0000","last_active":"2023-10-06T11:08:43.434353+0000","last_peered":"2023-10-06T11:08:43.434353+0000","last_clean":"2023-10-06T11:08:43.434353+0000","last_became_active":"2023-10-06T11:08:43.425902+0000","last_became_peered":"2023-10-06T11:08:43.425902+0000","last_unstale":"2023-10-06T11:08:43.434353+0000","last_undegraded":"2023-10-06T11:08:43.434353+0000","last_fullsized":"2023-10-06T11:08:43.434353+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:51:36.859426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.419934+0000","last_change":"2023-10-06T11:08:42.430104+0000","last_active":"2023-10-06T11:08:43.419934+0000","last_peered":"2023-10-06T11:08:43.419934+0000","last_clean":"2023-10-06T11:08:43.419934+0000","last_became_active":"2023-10-06T11:08:42.429143+0000","last_became_peered":"2023-10-06T11:08:42.429143+0000","last_unstale":"2023-10-06T11:08:43.419934+0000","last_undegraded":"2023-10-06T11:08:43.419934+0000","last_fullsized":"2023-10-06T11:08:43.419934+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:33:48.422283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.414859+0000","last_change":"2023-10-06T11:08:42.422089+0000","last_active":"2023-10-06T11:08:43.414859+0000","last_peered":"2023-10-06T11:08:43.414859+0000","last_clean":"2023-10-06T11:08:43.414859+0000","last_became_active":"2023-10-06T11:08:42.421847+0000","last_became_peered":"2023-10-06T11:08:42.421847+0000","last_unstale":"2023-10-06T11:08:43.414859+0000","last_undegraded":"2023-10-06T11:08:43.414859+0000","last_fullsized":"2023-10-06T11:08:43.414859+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:24:24.468404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435505+0000","last_change":"2023-10-06T11:08:43.429380+0000","last_active":"2023-10-06T11:08:43.435505+0000","last_peered":"2023-10-06T11:08:43.435505+0000","last_clean":"2023-10-06T11:08:43.435505+0000","last_became_active":"2023-10-06T11:08:43.429113+0000","last_became_peered":"2023-10-06T11:08:43.429113+0000","last_unstale":"2023-10-06T11:08:43.435505+0000","last_undegraded":"2023-10-06T11:08:43.435505+0000","last_fullsized":"2023-10-06T11:08:43.435505+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:43.781886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.416288+0000","last_change":"2023-10-06T11:08:42.425700+0000","last_active":"2023-10-06T11:08:43.416288+0000","last_peered":"2023-10-06T11:08:43.416288+0000","last_clean":"2023-10-06T11:08:43.416288+0000","last_became_active":"2023-10-06T11:08:42.425460+0000","last_became_peered":"2023-10-06T11:08:42.425460+0000","last_unstale":"2023-10-06T11:08:43.416288+0000","last_undegraded":"2023-10-06T11:08:43.416288+0000","last_fullsized":"2023-10-06T11:08:43.416288+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:31:48.180069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":33,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T11:08:38.388420+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:08:38.388420+0000","last_peered":"2023-10-06T11:08:38.388420+0000","last_clean":"2023-10-06T11:08:38.388420+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:08:38.388420+0000","last_undegraded":"2023-10-06T11:08:38.388420+0000","last_fullsized":"2023-10-06T11:08:38.388420+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.428719+0000","last_change":"2023-10-06T11:08:43.425187+0000","last_active":"2023-10-06T11:08:43.428719+0000","last_peered":"2023-10-06T11:08:43.428719+0000","last_clean":"2023-10-06T11:08:43.428719+0000","last_became_active":"2023-10-06T11:08:43.424989+0000","last_became_peered":"2023-10-06T11:08:43.424989+0000","last_unstale":"2023-10-06T11:08:43.428719+0000","last_undegraded":"2023-10-06T11:08:43.428719+0000","last_fullsized":"2023-10-06T11:08:43.428719+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:45:44.809943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.416439+0000","last_change":"2023-10-06T11:08:42.428698+0000","last_active":"2023-10-06T11:08:43.416439+0000","last_peered":"2023-10-06T11:08:43.416439+0000","last_clean":"2023-10-06T11:08:43.416439+0000","last_became_active":"2023-10-06T11:08:42.428458+0000","last_became_peered":"2023-10-06T11:08:42.428458+0000","last_unstale":"2023-10-06T11:08:43.416439+0000","last_undegraded":"2023-10-06T11:08:43.416439+0000","last_fullsized":"2023-10-06T11:08:43.416439+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:29.761788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":39,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.416332+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:08:43.416332+0000","last_peered":"2023-10-06T11:08:43.416332+0000","last_clean":"2023-10-06T11:08:43.416332+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:08:43.416332+0000","last_undegraded":"2023-10-06T11:08:43.416332+0000","last_fullsized":"2023-10-06T11:08:43.416332+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.422039+0000","last_change":"2023-10-06T11:08:42.427034+0000","last_active":"2023-10-06T11:08:43.422039+0000","last_peered":"2023-10-06T11:08:43.422039+0000","last_clean":"2023-10-06T11:08:43.422039+0000","last_became_active":"2023-10-06T11:08:42.426733+0000","last_became_peered":"2023-10-06T11:08:42.426733+0000","last_unstale":"2023-10-06T11:08:43.422039+0000","last_undegraded":"2023-10-06T11:08:43.422039+0000","last_fullsized":"2023-10-06T11:08:43.422039+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:26:25.091803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":31,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T11:08:38.495257+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:08:38.495257+0000","last_peered":"2023-10-06T11:08:38.495257+0000","last_clean":"2023-10-06T11:08:38.495257+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:08:38.495257+0000","last_undegraded":"2023-10-06T11:08:38.495257+0000","last_fullsized":"2023-10-06T11:08:38.495257+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":184,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.421836+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:08:43.421836+0000","last_peered":"2023-10-06T11:08:43.421836+0000","last_clean":"2023-10-06T11:08:43.421836+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:08:43.421836+0000","last_undegraded":"2023-10-06T11:08:43.421836+0000","last_fullsized":"2023-10-06T11:08:43.421836+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.427071+0000","last_change":"2023-10-06T11:08:43.423061+0000","last_active":"2023-10-06T11:08:43.427071+0000","last_peered":"2023-10-06T11:08:43.427071+0000","last_clean":"2023-10-06T11:08:43.427071+0000","last_became_active":"2023-10-06T11:08:43.422802+0000","last_became_peered":"2023-10-06T11:08:43.422802+0000","last_unstale":"2023-10-06T11:08:43.427071+0000","last_undegraded":"2023-10-06T11:08:43.427071+0000","last_fullsized":"2023-10-06T11:08:43.427071+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:43.781886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.421298+0000","last_change":"2023-10-06T11:08:42.427910+0000","last_active":"2023-10-06T11:08:43.421298+0000","last_peered":"2023-10-06T11:08:43.421298+0000","last_clean":"2023-10-06T11:08:43.421298+0000","last_became_active":"2023-10-06T11:08:42.427478+0000","last_became_peered":"2023-10-06T11:08:42.427478+0000","last_unstale":"2023-10-06T11:08:43.421298+0000","last_undegraded":"2023-10-06T11:08:43.421298+0000","last_fullsized":"2023-10-06T11:08:43.421298+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:33:08.544897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.422507+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:08:43.422507+0000","last_peered":"2023-10-06T11:08:43.422507+0000","last_clean":"2023-10-06T11:08:43.422507+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:08:43.422507+0000","last_undegraded":"2023-10-06T11:08:43.422507+0000","last_fullsized":"2023-10-06T11:08:43.422507+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.421792+0000","last_change":"2023-10-06T11:08:42.428676+0000","last_active":"2023-10-06T11:08:43.421792+0000","last_peered":"2023-10-06T11:08:43.421792+0000","last_clean":"2023-10-06T11:08:43.421792+0000","last_became_active":"2023-10-06T11:08:42.428426+0000","last_became_peered":"2023-10-06T11:08:42.428426+0000","last_unstale":"2023-10-06T11:08:43.421792+0000","last_undegraded":"2023-10-06T11:08:43.421792+0000","last_fullsized":"2023-10-06T11:08:43.421792+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:07:15.648736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.421780+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:08:43.421780+0000","last_peered":"2023-10-06T11:08:43.421780+0000","last_clean":"2023-10-06T11:08:43.421780+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:08:43.421780+0000","last_undegraded":"2023-10-06T11:08:43.421780+0000","last_fullsized":"2023-10-06T11:08:43.421780+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.434698+0000","last_change":"2023-10-06T11:08:43.431756+0000","last_active":"2023-10-06T11:08:43.434698+0000","last_peered":"2023-10-06T11:08:43.434698+0000","last_clean":"2023-10-06T11:08:43.434698+0000","last_became_active":"2023-10-06T11:08:43.431105+0000","last_became_peered":"2023-10-06T11:08:43.431105+0000","last_unstale":"2023-10-06T11:08:43.434698+0000","last_undegraded":"2023-10-06T11:08:43.434698+0000","last_fullsized":"2023-10-06T11:08:43.434698+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:33.013845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.407235+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:59:13.774226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":39,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.415532+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:08:43.415532+0000","last_peered":"2023-10-06T11:08:43.415532+0000","last_clean":"2023-10-06T11:08:43.415532+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:08:43.415532+0000","last_undegraded":"2023-10-06T11:08:43.415532+0000","last_fullsized":"2023-10-06T11:08:43.415532+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.429728+0000","last_change":"2023-10-06T11:08:43.428796+0000","last_active":"2023-10-06T11:08:43.429728+0000","last_peered":"2023-10-06T11:08:43.429728+0000","last_clean":"2023-10-06T11:08:43.429728+0000","last_became_active":"2023-10-06T11:08:43.424121+0000","last_became_peered":"2023-10-06T11:08:43.424121+0000","last_unstale":"2023-10-06T11:08:43.429728+0000","last_undegraded":"2023-10-06T11:08:43.429728+0000","last_fullsized":"2023-10-06T11:08:43.429728+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:06:21.706780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.415243+0000","last_change":"2023-10-06T11:08:42.426380+0000","last_active":"2023-10-06T11:08:43.415243+0000","last_peered":"2023-10-06T11:08:43.415243+0000","last_clean":"2023-10-06T11:08:43.415243+0000","last_became_active":"2023-10-06T11:08:42.426061+0000","last_became_peered":"2023-10-06T11:08:42.426061+0000","last_unstale":"2023-10-06T11:08:43.415243+0000","last_undegraded":"2023-10-06T11:08:43.415243+0000","last_fullsized":"2023-10-06T11:08:43.415243+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:31:32.728096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":35,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T11:08:38.495549+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:08:38.495549+0000","last_peered":"2023-10-06T11:08:38.495549+0000","last_clean":"2023-10-06T11:08:38.495549+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:08:38.495549+0000","last_undegraded":"2023-10-06T11:08:38.495549+0000","last_fullsized":"2023-10-06T11:08:38.495549+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.433687+0000","last_change":"2023-10-06T11:08:43.423239+0000","last_active":"2023-10-06T11:08:43.433687+0000","last_peered":"2023-10-06T11:08:43.433687+0000","last_clean":"2023-10-06T11:08:43.433687+0000","last_became_active":"2023-10-06T11:08:43.422974+0000","last_became_peered":"2023-10-06T11:08:43.422974+0000","last_unstale":"2023-10-06T11:08:43.433687+0000","last_undegraded":"2023-10-06T11:08:43.433687+0000","last_fullsized":"2023-10-06T11:08:43.433687+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:56:57.888412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.405542+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:43.267112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":35,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T11:08:38.495552+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:08:38.495552+0000","last_peered":"2023-10-06T11:08:38.495552+0000","last_clean":"2023-10-06T11:08:38.495552+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:08:38.495552+0000","last_undegraded":"2023-10-06T11:08:38.495552+0000","last_fullsized":"2023-10-06T11:08:38.495552+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":1682,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25,"ondisk_log_size":25,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":86,"acting":86,"num_store_stats":5},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574889,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298416,"kb_used_data":1128,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073424,"statfs":{"total":96636764160,"available":96331186176,"internally_reserved":0,"allocated":1155072,"data_stored":829993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":1.871,"5min":0.73999999999999999,"15min":0.56999999999999995},"min":{"1min":0.41199999999999998,"5min":0.248,"15min":0.248},"max":{"1min":23.908999999999999,"5min":23.908999999999999,"15min":23.908999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":1.127,"5min":0.629,"15min":0.56499999999999995},"min":{"1min":0.374,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":9.0600000000000005,"5min":9.0600000000000005,"15min":9.0600000000000005},"last":0.52500000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":0.63900000000000001,"15min":0.57099999999999995},"min":{"1min":0.40899999999999997,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":9.2360000000000007,"5min":9.2360000000000007,"15min":9.2360000000000007},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.53900000000000003,"15min":0.51600000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":4.327,"5min":4.327,"15min":4.327},"last":0.53400000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.504,"15min":0.50900000000000001},"min":{"1min":0.311,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.505},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.59599999999999997,"15min":0.55800000000000005},"min":{"1min":0.436,"5min":0.309,"15min":0.309},"max":{"1min":4.7309999999999999,"5min":4.7309999999999999,"15min":4.7309999999999999},"last":0.64000000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.55400000000000005,"15min":0.51400000000000001},"min":{"1min":0.35299999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":4.3540000000000001,"5min":4.3540000000000001,"15min":4.3540000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":1.1870000000000001,"5min":0.67300000000000004,"15min":0.59999999999999998},"min":{"1min":0.45300000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":9.3879999999999999,"5min":9.3879999999999999,"15min":9.3879999999999999},"last":0.60899999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.50800000000000001,"15min":0.47499999999999998},"min":{"1min":0.34100000000000003,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":4.5709999999999997,"5min":4.5709999999999997,"15min":4.5709999999999997},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.753,"5min":0.55800000000000005,"15min":0.53500000000000003},"min":{"1min":0.33100000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":4.3129999999999997,"5min":4.3129999999999997,"15min":4.3129999999999997},"last":0.33100000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":0.64100000000000001,"15min":0.58099999999999996},"min":{"1min":0.34200000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":9.3499999999999996,"5min":9.3499999999999996,"15min":9.3499999999999996},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.58299999999999996,"15min":0.56699999999999995},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":4.444,"5min":4.444,"15min":4.444},"last":0.35099999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":0.67300000000000004,"15min":0.622},"min":{"1min":0.39700000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":9.4969999999999999,"5min":9.4969999999999999,"15min":9.4969999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.66200000000000003,"15min":0.62},"min":{"1min":0.44800000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":7.2039999999999997,"5min":7.2039999999999997,"15min":7.2039999999999997},"last":0.46100000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574890,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310076,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061764,"statfs":{"total":96636764160,"available":96319246336,"internally_reserved":0,"allocated":512000,"data_stored":217775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.48199999999999998,"15min":0.497},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52100000000000002,"15min":0.53300000000000003},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.52400000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.48299999999999998,"15min":0.499},"min":{"1min":0.34100000000000003,"5min":0.253,"15min":0.253},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.504},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48499999999999999,"15min":0.499},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.76400000000000001,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.624}]},{"osd":2,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.53100000000000003,"15min":0.498},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":7.0659999999999998,"5min":7.0659999999999998,"15min":7.0659999999999998},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.56100000000000005,"15min":0.52900000000000003},"min":{"1min":0.32500000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":7.0819999999999999,"5min":7.0819999999999999,"15min":7.0819999999999999},"last":0.57899999999999996}]},{"osd":3,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.49399999999999999,"15min":0.49299999999999999},"min":{"1min":0.32600000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.52700000000000002,"15min":0.53600000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.72799999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.64500000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.48699999999999999,"15min":0.50700000000000001},"min":{"1min":0.29599999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.64300000000000002,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54300000000000004,"15min":0.56799999999999995},"min":{"1min":0.32100000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.77100000000000002,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.72199999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52200000000000002,"15min":0.53800000000000003},"min":{"1min":0.307,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.75},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56299999999999994,"15min":0.58699999999999997},"min":{"1min":0.39500000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.79000000000000004,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.79000000000000004}]},{"osd":7,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56200000000000006,"15min":0.57699999999999996},"min":{"1min":0.36899999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79500000000000004,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.624,"5min":0.58999999999999997,"15min":0.60699999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83899999999999997,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.80800000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574889,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306564,"kb_used_data":1084,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065276,"statfs":{"total":96636764160,"available":96322842624,"internally_reserved":0,"allocated":1110016,"data_stored":809496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:39 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33100000000000002,"15min":0.34100000000000003},"min":{"1min":0.216,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.46000000000000002,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.316},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.34000000000000002,"15min":0.34399999999999997},"min":{"1min":0.26900000000000002,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.48799999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.30299999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:08:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.33600000000000002,"15min":0.33400000000000002},"min":{"1min":0.27300000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.5,"5min":0.505,"15min":0.505},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.435,"5min":0.38700000000000001,"15min":0.38600000000000001},"min":{"1min":0.251,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.38700000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:08:39 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.29599999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.60299999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.372,"15min":0.36599999999999999},"min":{"1min":0.30499999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.55400000000000005,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.40100000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:08:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.51600000000000001,"15min":0.503},"min":{"1min":0.42499999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.54600000000000004,"15min":0.53600000000000003},"min":{"1min":0.39900000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.752,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.63300000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:08:39 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.55300000000000005,"15min":0.54700000000000004},"min":{"1min":0.438,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.54800000000000004,"15min":0.53600000000000003},"min":{"1min":0.46400000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.80600000000000005,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.59199999999999997}]},{"osd":6,"last update":"Fri Oct 6 11:08:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.56799999999999995,"15min":0.56100000000000005},"min":{"1min":0.45500000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.57599999999999996,"15min":0.56899999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84899999999999998,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.61899999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:08:39 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.59099999999999997,"15min":0.58699999999999997},"min":{"1min":0.441,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.86199999999999999,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.58299999999999996,"15min":0.57999999999999996},"min":{"1min":0.41099999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.77600000000000002,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.57699999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297832,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074008,"statfs":{"total":96636764160,"available":96331784192,"internally_reserved":0,"allocated":557056,"data_stored":238204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32700000000000001,"15min":0.33300000000000002},"min":{"1min":0.223,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.503,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.34200000000000003,"15min":0.34100000000000003},"min":{"1min":0.246,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.24099999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.371,"15min":0.377},"min":{"1min":0.27400000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.435,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36099999999999999,"15min":0.36599999999999999},"min":{"1min":0.27200000000000002,"5min":0.219,"15min":0.219},"max":{"1min":0.46100000000000002,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.311}]},{"osd":3,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.371,"15min":0.373},"min":{"1min":0.26500000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.432,"15min":0.438},"min":{"1min":0.33000000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.55700000000000005,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.34200000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.55900000000000005,"15min":0.56000000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.60799999999999998,"15min":0.61499999999999999},"min":{"1min":0.36199999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.83999999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.75900000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54700000000000004,"15min":0.55100000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67900000000000005,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.55100000000000005,"15min":0.54500000000000004},"min":{"1min":0.40000000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.67900000000000005}]},{"osd":6,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60399999999999998,"15min":0.61199999999999999},"min":{"1min":0.432,"5min":0.375,"15min":0.375},"max":{"1min":0.84499999999999997,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60099999999999998,"15min":0.60499999999999998},"min":{"1min":0.42399999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.57999999999999996}]},{"osd":7,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59799999999999998,"15min":0.60499999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.81299999999999994,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.62},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.42099999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.70199999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574890,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310124,"kb_used_data":548,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061716,"statfs":{"total":96636764160,"available":96319197184,"internally_reserved":0,"allocated":561152,"data_stored":239684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.309,"15min":0.309},"min":{"1min":0.22500000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.437,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38100000000000001,"15min":0.38500000000000001},"min":{"1min":0.26900000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.51400000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.495}]},{"osd":1,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36899999999999999,"15min":0.375},"min":{"1min":0.24399999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.35399999999999998,"15min":0.34799999999999998},"min":{"1min":0.26900000000000002,"5min":0.217,"15min":0.217},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.45700000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.37,"15min":0.373},"min":{"1min":0.27800000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.438},{"interface":"front","average":{"1min":0.373,"5min":0.36499999999999999,"15min":0.36699999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.378}]},{"osd":4,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.33900000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.38900000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.58699999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.55200000000000005,"15min":0.55000000000000004},"min":{"1min":0.374,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.625},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.41799999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.67000000000000004}]},{"osd":6,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58299999999999996,"15min":0.58399999999999996},"min":{"1min":0.43099999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41399999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.68400000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.55900000000000005,"15min":0.55000000000000004},"min":{"1min":0.436,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.57099999999999995,"15min":0.56999999999999995},"min":{"1min":0.38600000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.70299999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574890,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310128,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061712,"statfs":{"total":96636764160,"available":96319193088,"internally_reserved":0,"allocated":565248,"data_stored":239706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.315,"15min":0.32800000000000001},"min":{"1min":0.248,"5min":0.188,"15min":0.188},"max":{"1min":0.46500000000000002,"5min":1.095,"15min":1.095},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38900000000000001,"15min":0.40500000000000003},"min":{"1min":0.29999999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.50600000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.39500000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.314,"15min":0.309},"min":{"1min":0.255,"5min":0.219,"15min":0.219},"max":{"1min":0.47499999999999998,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.36699999999999999,"15min":0.373},"min":{"1min":0.26500000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.51500000000000001,"5min":1.196,"15min":1.196},"last":0.36799999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.38100000000000001,"15min":0.39400000000000002},"min":{"1min":0.24199999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.54500000000000004,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.31},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.42399999999999999},"min":{"1min":0.33700000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.55900000000000005,"5min":1.224,"15min":1.224},"last":0.40999999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.55700000000000005,"15min":0.57499999999999996},"min":{"1min":0.38200000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.92500000000000004,"5min":1.694,"15min":1.694},"last":0.627},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53800000000000003,"15min":0.54500000000000004},"min":{"1min":0.36599999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.78200000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.41599999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55700000000000005,"15min":0.56599999999999995},"min":{"1min":0.39200000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.82199999999999995,"5min":1.165,"15min":1.165},"last":0.82199999999999995}]},{"osd":6,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58499999999999996,"15min":0.59499999999999997},"min":{"1min":0.40200000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.89900000000000002,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.59399999999999997,"15min":0.60499999999999998},"min":{"1min":0.45400000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83399999999999996,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.83399999999999996}]},{"osd":7,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58299999999999996,"15min":0.59699999999999998},"min":{"1min":0.40999999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84799999999999998,"5min":1.657,"15min":1.657},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.57099999999999995,"15min":0.57399999999999995},"min":{"1min":0.46700000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.68200000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310080,"kb_used_data":504,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061760,"statfs":{"total":96636764160,"available":96319242240,"internally_reserved":0,"allocated":516096,"data_stored":219128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:07:42 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.57699999999999996,"15min":0.61299999999999999},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.62,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.48799999999999999,"15min":0.501},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.65500000000000003,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.439}]},{"osd":1,"last update":"Fri Oct 6 11:07:42 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.60799999999999998,"15min":0.63900000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.60399999999999998,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.436,"5min":0.61199999999999999,"15min":0.64100000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.67500000000000004,"5min":2.7610000000000001,"15min":2.7610000000000001},"last":0.52700000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:07:42 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.56999999999999995,"15min":0.59099999999999997},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69099999999999995,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.377},{"interface":"front","average":{"1min":0.498,"5min":0.60599999999999998,"15min":0.624},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69299999999999995,"5min":1.718,"15min":1.718},"last":0.497}]},{"osd":3,"last update":"Fri Oct 6 11:07:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.63,"15min":0.65700000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.67700000000000005,"5min":2.677,"15min":2.677},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.51600000000000001,"15min":0.52600000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.63100000000000001,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.45400000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:07:42 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.48799999999999999,"15min":0.502},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.60499999999999998,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.44,"5min":0.53500000000000003,"15min":0.55100000000000005},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.64300000000000002,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.51300000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:07:42 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.52300000000000002,"15min":0.53900000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.624,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.58099999999999996,"15min":0.60099999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.64700000000000002,"5min":1.165,"15min":1.165},"last":0.56499999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:07:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.54900000000000004,"15min":0.56100000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.63700000000000001,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.60099999999999998,"15min":0.61899999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.66100000000000003,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.57399999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310104,"kb_used_data":528,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061736,"statfs":{"total":96636764160,"available":96319217664,"internally_reserved":0,"allocated":540672,"data_stored":232860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.66600000000000004,"15min":0.72399999999999998},"min":{"1min":0.36199999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.71899999999999997,"5min":5.0490000000000004,"15min":5.0490000000000004},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.627,"15min":0.69299999999999995},"min":{"1min":0.254,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.755,"5min":5.1449999999999996,"15min":5.1449999999999996},"last":0.39000000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48999999999999999,"15min":0.49199999999999999},"min":{"1min":0.315,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.70699999999999996,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.70699999999999996,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.56000000000000005}]},{"osd":2,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.57999999999999996,"15min":0.56699999999999995},"min":{"1min":0.379,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.81799999999999995,"5min":4.234,"15min":4.234},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56899999999999995,"15min":0.57799999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76600000000000001,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.59899999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.66700000000000004,"15min":0.74399999999999999},"min":{"1min":0.29299999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.72099999999999997,"5min":5.2169999999999996,"15min":5.2169999999999996},"last":0.438},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55100000000000005,"15min":0.55500000000000005},"min":{"1min":0.39600000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.83399999999999996,"5min":1.008,"15min":1.008},"last":0.53300000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.52900000000000003,"15min":0.53800000000000003},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.871,"5min":1.917,"15min":1.917},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.53800000000000003,"15min":0.55500000000000005},"min":{"1min":0.27200000000000002,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.85499999999999998,"5min":0.87,"15min":0.87},"last":0.50900000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.34899999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.89500000000000002,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.624,"15min":0.63200000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.92300000000000004,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":0.64400000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58999999999999997,"15min":0.60899999999999999},"min":{"1min":0.32100000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.84299999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.621,"15min":0.63},"min":{"1min":0.372,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.93899999999999995,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.629}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:08:48.227 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3f is not active+clean 2023-10-06T11:08:48.227 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:08:42.402071+0000', 'last_change': '2023-10-06T11:08:42.402071+0000', 'last_active': '2023-10-06T11:08:42.402071+0000', 'last_peered': '2023-10-06T11:08:42.402071+0000', 'last_clean': '2023-10-06T11:08:42.402071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:08:42.402071+0000', 'last_undegraded': '2023-10-06T11:08:42.402071+0000', 'last_fullsized': '2023-10-06T11:08:42.402071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'last_clean_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:08:48.227 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3b is not active+clean 2023-10-06T11:08:48.227 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:08:42.402071+0000', 'last_change': '2023-10-06T11:08:42.402071+0000', 'last_active': '2023-10-06T11:08:42.402071+0000', 'last_peered': '2023-10-06T11:08:42.402071+0000', 'last_clean': '2023-10-06T11:08:42.402071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:08:42.402071+0000', 'last_undegraded': '2023-10-06T11:08:42.402071+0000', 'last_fullsized': '2023-10-06T11:08:42.402071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'last_clean_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:08:48.227 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3a is not active+clean 2023-10-06T11:08:48.227 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:08:42.402071+0000', 'last_change': '2023-10-06T11:08:42.402071+0000', 'last_active': '2023-10-06T11:08:42.402071+0000', 'last_peered': '2023-10-06T11:08:42.402071+0000', 'last_clean': '2023-10-06T11:08:42.402071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:08:42.402071+0000', 'last_undegraded': '2023-10-06T11:08:42.402071+0000', 'last_fullsized': '2023-10-06T11:08:42.402071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'last_clean_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:08:48.227 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.36 is not active+clean 2023-10-06T11:08:48.227 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:08:42.402071+0000', 'last_change': '2023-10-06T11:08:42.402071+0000', 'last_active': '2023-10-06T11:08:42.402071+0000', 'last_peered': '2023-10-06T11:08:42.402071+0000', 'last_clean': '2023-10-06T11:08:42.402071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:08:42.402071+0000', 'last_undegraded': '2023-10-06T11:08:42.402071+0000', 'last_fullsized': '2023-10-06T11:08:42.402071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'last_clean_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:08:48.228 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.33 is not active+clean 2023-10-06T11:08:48.228 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:08:42.402071+0000', 'last_change': '2023-10-06T11:08:42.402071+0000', 'last_active': '2023-10-06T11:08:42.402071+0000', 'last_peered': '2023-10-06T11:08:42.402071+0000', 'last_clean': '2023-10-06T11:08:42.402071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:08:42.402071+0000', 'last_undegraded': '2023-10-06T11:08:42.402071+0000', 'last_fullsized': '2023-10-06T11:08:42.402071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'last_clean_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:08:48.228 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.30 is not active+clean 2023-10-06T11:08:48.228 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:08:42.402071+0000', 'last_change': '2023-10-06T11:08:42.402071+0000', 'last_active': '2023-10-06T11:08:42.402071+0000', 'last_peered': '2023-10-06T11:08:42.402071+0000', 'last_clean': '2023-10-06T11:08:42.402071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:08:42.402071+0000', 'last_undegraded': '2023-10-06T11:08:42.402071+0000', 'last_fullsized': '2023-10-06T11:08:42.402071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'last_clean_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:08:48.228 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2c is not active+clean 2023-10-06T11:08:48.228 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:08:42.402071+0000', 'last_change': '2023-10-06T11:08:42.402071+0000', 'last_active': '2023-10-06T11:08:42.402071+0000', 'last_peered': '2023-10-06T11:08:42.402071+0000', 'last_clean': '2023-10-06T11:08:42.402071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:08:42.402071+0000', 'last_undegraded': '2023-10-06T11:08:42.402071+0000', 'last_fullsized': '2023-10-06T11:08:42.402071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'last_clean_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:08:48.228 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2b is not active+clean 2023-10-06T11:08:48.228 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:08:42.402071+0000', 'last_change': '2023-10-06T11:08:42.402071+0000', 'last_active': '2023-10-06T11:08:42.402071+0000', 'last_peered': '2023-10-06T11:08:42.402071+0000', 'last_clean': '2023-10-06T11:08:42.402071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:08:42.402071+0000', 'last_undegraded': '2023-10-06T11:08:42.402071+0000', 'last_fullsized': '2023-10-06T11:08:42.402071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'last_clean_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:08:48.228 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.25 is not active+clean 2023-10-06T11:08:48.229 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:08:42.402071+0000', 'last_change': '2023-10-06T11:08:42.402071+0000', 'last_active': '2023-10-06T11:08:42.402071+0000', 'last_peered': '2023-10-06T11:08:42.402071+0000', 'last_clean': '2023-10-06T11:08:42.402071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:08:42.402071+0000', 'last_undegraded': '2023-10-06T11:08:42.402071+0000', 'last_fullsized': '2023-10-06T11:08:42.402071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'last_clean_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:08:48.229 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.24 is not active+clean 2023-10-06T11:08:48.229 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:08:42.402071+0000', 'last_change': '2023-10-06T11:08:42.402071+0000', 'last_active': '2023-10-06T11:08:42.402071+0000', 'last_peered': '2023-10-06T11:08:42.402071+0000', 'last_clean': '2023-10-06T11:08:42.402071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:08:42.402071+0000', 'last_undegraded': '2023-10-06T11:08:42.402071+0000', 'last_fullsized': '2023-10-06T11:08:42.402071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'last_clean_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:08:48.229 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2023-10-06T11:08:48.229 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:08:41.392622+0000', 'last_change': '2023-10-06T11:08:41.407835+0000', 'last_active': '2023-10-06T11:08:41.392622+0000', 'last_peered': '2023-10-06T11:08:41.392622+0000', 'last_clean': '2023-10-06T11:08:41.392622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:08:41.392622+0000', 'last_undegraded': '2023-10-06T11:08:41.392622+0000', 'last_fullsized': '2023-10-06T11:08:41.392622+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:08:41.392622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:08:41.392622+0000', 'last_clean_scrub_stamp': '2023-10-06T11:08:41.392622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:32:03.751012+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:08:48.229 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1e is not active+clean 2023-10-06T11:08:48.229 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:08:41.392622+0000', 'last_change': '2023-10-06T11:08:41.407802+0000', 'last_active': '2023-10-06T11:08:41.392622+0000', 'last_peered': '2023-10-06T11:08:41.392622+0000', 'last_clean': '2023-10-06T11:08:41.392622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:08:41.392622+0000', 'last_undegraded': '2023-10-06T11:08:41.392622+0000', 'last_fullsized': '2023-10-06T11:08:41.392622+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:08:41.392622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:08:41.392622+0000', 'last_clean_scrub_stamp': '2023-10-06T11:08:41.392622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:13:18.791935+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T11:08:48.229 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.12 is not active+clean 2023-10-06T11:08:48.229 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:08:42.402071+0000', 'last_change': '2023-10-06T11:08:42.402071+0000', 'last_active': '2023-10-06T11:08:42.402071+0000', 'last_peered': '2023-10-06T11:08:42.402071+0000', 'last_clean': '2023-10-06T11:08:42.402071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:08:42.402071+0000', 'last_undegraded': '2023-10-06T11:08:42.402071+0000', 'last_fullsized': '2023-10-06T11:08:42.402071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'last_clean_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:08:48.230 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1d is not active+clean 2023-10-06T11:08:48.230 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:08:41.392622+0000', 'last_change': '2023-10-06T11:08:41.407406+0000', 'last_active': '2023-10-06T11:08:41.392622+0000', 'last_peered': '2023-10-06T11:08:41.392622+0000', 'last_clean': '2023-10-06T11:08:41.392622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:08:41.392622+0000', 'last_undegraded': '2023-10-06T11:08:41.392622+0000', 'last_fullsized': '2023-10-06T11:08:41.392622+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:08:41.392622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:08:41.392622+0000', 'last_clean_scrub_stamp': '2023-10-06T11:08:41.392622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:51:07.091891+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T11:08:48.230 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.14 is not active+clean 2023-10-06T11:08:48.230 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:08:42.402071+0000', 'last_change': '2023-10-06T11:08:42.402071+0000', 'last_active': '2023-10-06T11:08:42.402071+0000', 'last_peered': '2023-10-06T11:08:42.402071+0000', 'last_clean': '2023-10-06T11:08:42.402071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:08:42.402071+0000', 'last_undegraded': '2023-10-06T11:08:42.402071+0000', 'last_fullsized': '2023-10-06T11:08:42.402071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'last_clean_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:08:48.230 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2023-10-06T11:08:48.230 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:08:41.392622+0000', 'last_change': '2023-10-06T11:08:41.404858+0000', 'last_active': '2023-10-06T11:08:41.392622+0000', 'last_peered': '2023-10-06T11:08:41.392622+0000', 'last_clean': '2023-10-06T11:08:41.392622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:08:41.392622+0000', 'last_undegraded': '2023-10-06T11:08:41.392622+0000', 'last_fullsized': '2023-10-06T11:08:41.392622+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:08:41.392622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:08:41.392622+0000', 'last_clean_scrub_stamp': '2023-10-06T11:08:41.392622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:44:25.209537+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T11:08:48.231 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2023-10-06T11:08:48.231 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:08:41.392622+0000', 'last_change': '2023-10-06T11:08:41.407305+0000', 'last_active': '2023-10-06T11:08:41.392622+0000', 'last_peered': '2023-10-06T11:08:41.392622+0000', 'last_clean': '2023-10-06T11:08:41.392622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:08:41.392622+0000', 'last_undegraded': '2023-10-06T11:08:41.392622+0000', 'last_fullsized': '2023-10-06T11:08:41.392622+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:08:41.392622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:08:41.392622+0000', 'last_clean_scrub_stamp': '2023-10-06T11:08:41.392622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:24:24.468404+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:08:48.231 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.18 is not active+clean 2023-10-06T11:08:48.231 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:08:42.402071+0000', 'last_change': '2023-10-06T11:08:42.402071+0000', 'last_active': '2023-10-06T11:08:42.402071+0000', 'last_peered': '2023-10-06T11:08:42.402071+0000', 'last_clean': '2023-10-06T11:08:42.402071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:08:42.402071+0000', 'last_undegraded': '2023-10-06T11:08:42.402071+0000', 'last_fullsized': '2023-10-06T11:08:42.402071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'last_clean_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:08:48.231 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2023-10-06T11:08:48.231 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:08:41.392622+0000', 'last_change': '2023-10-06T11:08:41.405987+0000', 'last_active': '2023-10-06T11:08:41.392622+0000', 'last_peered': '2023-10-06T11:08:41.392622+0000', 'last_clean': '2023-10-06T11:08:41.392622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:08:41.392622+0000', 'last_undegraded': '2023-10-06T11:08:41.392622+0000', 'last_fullsized': '2023-10-06T11:08:41.392622+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:08:41.392622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:08:41.392622+0000', 'last_clean_scrub_stamp': '2023-10-06T11:08:41.392622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:06:38.366301+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T11:08:48.231 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1b is not active+clean 2023-10-06T11:08:48.231 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:08:42.402071+0000', 'last_change': '2023-10-06T11:08:42.402071+0000', 'last_active': '2023-10-06T11:08:42.402071+0000', 'last_peered': '2023-10-06T11:08:42.402071+0000', 'last_clean': '2023-10-06T11:08:42.402071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:08:42.402071+0000', 'last_undegraded': '2023-10-06T11:08:42.402071+0000', 'last_fullsized': '2023-10-06T11:08:42.402071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'last_clean_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:08:48.231 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2023-10-06T11:08:48.232 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:08:41.392622+0000', 'last_change': '2023-10-06T11:08:41.407354+0000', 'last_active': '2023-10-06T11:08:41.392622+0000', 'last_peered': '2023-10-06T11:08:41.392622+0000', 'last_clean': '2023-10-06T11:08:41.392622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:08:41.392622+0000', 'last_undegraded': '2023-10-06T11:08:41.392622+0000', 'last_fullsized': '2023-10-06T11:08:41.392622+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:08:41.392622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:08:41.392622+0000', 'last_clean_scrub_stamp': '2023-10-06T11:08:41.392622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:58:51.790939+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:08:48.232 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.1 is not active+clean 2023-10-06T11:08:48.232 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:08:42.402071+0000', 'last_change': '2023-10-06T11:08:42.402071+0000', 'last_active': '2023-10-06T11:08:42.402071+0000', 'last_peered': '2023-10-06T11:08:42.402071+0000', 'last_clean': '2023-10-06T11:08:42.402071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:08:42.402071+0000', 'last_undegraded': '2023-10-06T11:08:42.402071+0000', 'last_fullsized': '2023-10-06T11:08:42.402071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'last_clean_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:08:48.232 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.2 is not active+clean 2023-10-06T11:08:48.232 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:08:42.402071+0000', 'last_change': '2023-10-06T11:08:42.402071+0000', 'last_active': '2023-10-06T11:08:42.402071+0000', 'last_peered': '2023-10-06T11:08:42.402071+0000', 'last_clean': '2023-10-06T11:08:42.402071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:08:42.402071+0000', 'last_undegraded': '2023-10-06T11:08:42.402071+0000', 'last_fullsized': '2023-10-06T11:08:42.402071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'last_clean_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:08:48.232 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2023-10-06T11:08:48.232 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:08:41.392622+0000', 'last_change': '2023-10-06T11:08:41.407701+0000', 'last_active': '2023-10-06T11:08:41.392622+0000', 'last_peered': '2023-10-06T11:08:41.392622+0000', 'last_clean': '2023-10-06T11:08:41.392622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:08:41.392622+0000', 'last_undegraded': '2023-10-06T11:08:41.392622+0000', 'last_fullsized': '2023-10-06T11:08:41.392622+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:08:41.392622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:08:41.392622+0000', 'last_clean_scrub_stamp': '2023-10-06T11:08:41.392622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:35:14.166168+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:08:48.232 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.3 is not active+clean 2023-10-06T11:08:48.232 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:08:42.402071+0000', 'last_change': '2023-10-06T11:08:42.402071+0000', 'last_active': '2023-10-06T11:08:42.402071+0000', 'last_peered': '2023-10-06T11:08:42.402071+0000', 'last_clean': '2023-10-06T11:08:42.402071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:08:42.402071+0000', 'last_undegraded': '2023-10-06T11:08:42.402071+0000', 'last_fullsized': '2023-10-06T11:08:42.402071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'last_clean_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:08:48.233 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.c is not active+clean 2023-10-06T11:08:48.233 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:08:41.392622+0000', 'last_change': '2023-10-06T11:08:41.407347+0000', 'last_active': '2023-10-06T11:08:41.392622+0000', 'last_peered': '2023-10-06T11:08:41.392622+0000', 'last_clean': '2023-10-06T11:08:41.392622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:08:41.392622+0000', 'last_undegraded': '2023-10-06T11:08:41.392622+0000', 'last_fullsized': '2023-10-06T11:08:41.392622+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:08:41.392622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:08:41.392622+0000', 'last_clean_scrub_stamp': '2023-10-06T11:08:41.392622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T18:07:14.329644+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:08:48.233 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.b is not active+clean 2023-10-06T11:08:48.233 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:08:41.392622+0000', 'last_change': '2023-10-06T11:08:41.407311+0000', 'last_active': '2023-10-06T11:08:41.392622+0000', 'last_peered': '2023-10-06T11:08:41.392622+0000', 'last_clean': '2023-10-06T11:08:41.392622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:08:41.392622+0000', 'last_undegraded': '2023-10-06T11:08:41.392622+0000', 'last_fullsized': '2023-10-06T11:08:41.392622+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:08:41.392622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:08:41.392622+0000', 'last_clean_scrub_stamp': '2023-10-06T11:08:41.392622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:39:11.705262+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T11:08:48.233 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.5 is not active+clean 2023-10-06T11:08:48.233 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:08:42.402071+0000', 'last_change': '2023-10-06T11:08:42.402071+0000', 'last_active': '2023-10-06T11:08:42.402071+0000', 'last_peered': '2023-10-06T11:08:42.402071+0000', 'last_clean': '2023-10-06T11:08:42.402071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:08:42.402071+0000', 'last_undegraded': '2023-10-06T11:08:42.402071+0000', 'last_fullsized': '2023-10-06T11:08:42.402071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'last_clean_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:08:48.233 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.7 is not active+clean 2023-10-06T11:08:48.233 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:08:42.402071+0000', 'last_change': '2023-10-06T11:08:42.402071+0000', 'last_active': '2023-10-06T11:08:42.402071+0000', 'last_peered': '2023-10-06T11:08:42.402071+0000', 'last_clean': '2023-10-06T11:08:42.402071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:08:42.402071+0000', 'last_undegraded': '2023-10-06T11:08:42.402071+0000', 'last_fullsized': '2023-10-06T11:08:42.402071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'last_clean_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:08:48.233 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.a is not active+clean 2023-10-06T11:08:48.233 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:08:42.402071+0000', 'last_change': '2023-10-06T11:08:42.402071+0000', 'last_active': '2023-10-06T11:08:42.402071+0000', 'last_peered': '2023-10-06T11:08:42.402071+0000', 'last_clean': '2023-10-06T11:08:42.402071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:08:42.402071+0000', 'last_undegraded': '2023-10-06T11:08:42.402071+0000', 'last_fullsized': '2023-10-06T11:08:42.402071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'last_clean_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:08:48.234 INFO:tasks.cephfs.filesystem.ceph_manager:PG 8.9 is not active+clean 2023-10-06T11:08:48.234 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '8.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:08:42.402071+0000', 'last_change': '2023-10-06T11:08:42.402071+0000', 'last_active': '2023-10-06T11:08:42.402071+0000', 'last_peered': '2023-10-06T11:08:42.402071+0000', 'last_clean': '2023-10-06T11:08:42.402071+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:08:42.402071+0000', 'last_undegraded': '2023-10-06T11:08:42.402071+0000', 'last_fullsized': '2023-10-06T11:08:42.402071+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'last_clean_scrub_stamp': '2023-10-06T11:08:42.402071+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:08:48.234 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2023-10-06T11:08:48.234 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:08:41.392622+0000', 'last_change': '2023-10-06T11:08:41.407235+0000', 'last_active': '2023-10-06T11:08:41.392622+0000', 'last_peered': '2023-10-06T11:08:41.392622+0000', 'last_clean': '2023-10-06T11:08:41.392622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:08:41.392622+0000', 'last_undegraded': '2023-10-06T11:08:41.392622+0000', 'last_fullsized': '2023-10-06T11:08:41.392622+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:08:41.392622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:08:41.392622+0000', 'last_clean_scrub_stamp': '2023-10-06T11:08:41.392622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:59:13.774226+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:08:48.234 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1 is not active+clean 2023-10-06T11:08:48.234 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:08:41.392622+0000', 'last_change': '2023-10-06T11:08:41.405542+0000', 'last_active': '2023-10-06T11:08:41.392622+0000', 'last_peered': '2023-10-06T11:08:41.392622+0000', 'last_clean': '2023-10-06T11:08:41.392622+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:08:41.392622+0000', 'last_undegraded': '2023-10-06T11:08:41.392622+0000', 'last_fullsized': '2023-10-06T11:08:41.392622+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:08:41.392622+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:08:41.392622+0000', 'last_clean_scrub_stamp': '2023-10-06T11:08:41.392622+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:16:43.267112+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T11:08:48.235 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T11:08:48.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.371+0000 7f5e6cfb3700 1 Processor -- start 2023-10-06T11:08:48.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.371+0000 7f5e6cfb3700 1 -- start start 2023-10-06T11:08:48.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.372+0000 7f5e6cfb3700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5e68068ba0 0x7f5e6815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:48.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.372+0000 7f5e6cfb3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e68153e80 0x7f5e680b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:48.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.372+0000 7f5e6cfb3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e6815ac30 con 0x7f5e68153ab0 2023-10-06T11:08:48.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.372+0000 7f5e6cfb3700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e680b4510 con 0x7f5e68068ba0 2023-10-06T11:08:48.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.372+0000 7f5e6cfb3700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e680b6530 con 0x7f5e68153e80 2023-10-06T11:08:48.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.372+0000 7f5e6659c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f5e68153ab0 0x7f5e68068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40082/0 (socket says 172.21.15.146:40082) 2023-10-06T11:08:48.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.372+0000 7f5e6659c700 1 -- 172.21.15.146:0/1141491388 learned_addr learned my addr 172.21.15.146:0/1141491388 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:08:48.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.372+0000 7f5e65d9b700 1 --2- 172.21.15.146:0/1141491388 >> v2:172.21.15.151:3300/0 conn(0x7f5e68068ba0 0x7f5e6815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:48.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.372+0000 7f5e66d9d700 1 --2- 172.21.15.146:0/1141491388 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e68153e80 0x7f5e680b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:48.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.372+0000 7f5e6559a700 1 -- 172.21.15.146:0/1141491388 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1394093079 0 0) 0x7f5e58001110 con 0x7f5e68153ab0 2023-10-06T11:08:48.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.372+0000 7f5e6559a700 1 -- 172.21.15.146:0/1141491388 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e54003570 con 0x7f5e68153ab0 2023-10-06T11:08:48.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.372+0000 7f5e6559a700 1 -- 172.21.15.146:0/1141491388 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3268064915 0 0) 0x7f5e54003570 con 0x7f5e68153ab0 2023-10-06T11:08:48.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.372+0000 7f5e66d9d700 1 -- 172.21.15.146:0/1141491388 >> v2:172.21.15.151:3300/0 conn(0x7f5e68068ba0 msgr2=0x7f5e6815a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:48.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.372+0000 7f5e66d9d700 1 --2- 172.21.15.146:0/1141491388 >> v2:172.21.15.151:3300/0 conn(0x7f5e68068ba0 0x7f5e6815a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:48.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.372+0000 7f5e66d9d700 1 -- 172.21.15.146:0/1141491388 >> v1:172.21.15.146:6789/0 conn(0x7f5e68153ab0 legacy=0x7f5e68068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:48.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.372+0000 7f5e66d9d700 1 -- 172.21.15.146:0/1141491388 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e680b5c50 con 0x7f5e68153e80 2023-10-06T11:08:48.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.373+0000 7f5e66d9d700 1 --2- 172.21.15.146:0/1141491388 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e68153e80 0x7f5e680b49a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5e60009e60 tx=0x7f5e60009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf88ae96eedd2204 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:48.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.373+0000 7f5e6559a700 1 -- 172.21.15.146:0/1141491388 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6000e070 con 0x7f5e68153e80 2023-10-06T11:08:48.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.373+0000 7f5e6559a700 1 -- 172.21.15.146:0/1141491388 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6000b7a0 con 0x7f5e68153e80 2023-10-06T11:08:48.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.373+0000 7f5e6559a700 1 -- 172.21.15.146:0/1141491388 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e58001600 con 0x7f5e68153e80 2023-10-06T11:08:48.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.373+0000 7f5e6cfb3700 1 -- 172.21.15.146:0/1141491388 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e68153e80 msgr2=0x7f5e680b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:48.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.373+0000 7f5e6cfb3700 1 --2- 172.21.15.146:0/1141491388 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e68153e80 0x7f5e680b49a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5e60009e60 tx=0x7f5e60009780 comp rx=0 tx=0).stop 2023-10-06T11:08:48.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.373+0000 7f5e6cfb3700 1 -- 172.21.15.146:0/1141491388 shutdown_connections 2023-10-06T11:08:48.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.373+0000 7f5e6cfb3700 1 --2- 172.21.15.146:0/1141491388 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e68153e80 0x7f5e680b49a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:48.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.373+0000 7f5e6cfb3700 1 --2- 172.21.15.146:0/1141491388 >> v2:172.21.15.151:3300/0 conn(0x7f5e68068ba0 0x7f5e6815a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:48.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.373+0000 7f5e6cfb3700 1 -- 172.21.15.146:0/1141491388 >> 172.21.15.146:0/1141491388 conn(0x7f5e6806eba0 msgr2=0x7f5e6806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:48.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.373+0000 7f5e6cfb3700 1 -- 172.21.15.146:0/1141491388 shutdown_connections 2023-10-06T11:08:48.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.373+0000 7f5e6cfb3700 1 -- 172.21.15.146:0/1141491388 wait complete. 2023-10-06T11:08:48.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.374+0000 7f5e6cfb3700 1 Processor -- start 2023-10-06T11:08:48.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.374+0000 7f5e6cfb3700 1 -- start start 2023-10-06T11:08:48.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.375+0000 7f5e6cfb3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e68068ba0 0x7f5e68159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:48.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.375+0000 7f5e6cfb3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e68153ab0 0x7f5e68157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:48.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.375+0000 7f5e6cfb3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e68153e80 0x7f5e6814fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:48.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.375+0000 7f5e6cfb3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e68155f00 con 0x7f5e68153ab0 2023-10-06T11:08:48.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.375+0000 7f5e6cfb3700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6815a180 con 0x7f5e68068ba0 2023-10-06T11:08:48.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.375+0000 7f5e6cfb3700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e681552f0 con 0x7f5e68153e80 2023-10-06T11:08:48.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.375+0000 7f5e65d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e68153ab0 0x7f5e68157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:48.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.375+0000 7f5e65d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e68153ab0 0x7f5e68157080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60900/0 (socket says 172.21.15.146:60900) 2023-10-06T11:08:48.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.375+0000 7f5e65d9b700 1 -- 172.21.15.146:0/3749033407 learned_addr learned my addr 172.21.15.146:0/3749033407 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:48.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.375+0000 7f5e66d9d700 1 --2- 172.21.15.146:0/3749033407 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e68153e80 0x7f5e6814fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:48.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.375+0000 7f5e6659c700 1 --2- 172.21.15.146:0/3749033407 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e68068ba0 0x7f5e68159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:48.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.376+0000 7f5e65d9b700 1 -- 172.21.15.146:0/3749033407 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e68153e80 msgr2=0x7f5e6814fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:48.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.376+0000 7f5e65d9b700 1 --2- 172.21.15.146:0/3749033407 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e68153e80 0x7f5e6814fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:48.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.376+0000 7f5e65d9b700 1 -- 172.21.15.146:0/3749033407 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e68068ba0 msgr2=0x7f5e68159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:48.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.376+0000 7f5e65d9b700 1 --2- 172.21.15.146:0/3749033407 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e68068ba0 0x7f5e68159c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:48.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.376+0000 7f5e65d9b700 1 -- 172.21.15.146:0/3749033407 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e60009a20 con 0x7f5e68153ab0 2023-10-06T11:08:48.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.376+0000 7f5e6659c700 1 --2- 172.21.15.146:0/3749033407 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e68068ba0 0x7f5e68159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:08:48.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.376+0000 7f5e65d9b700 1 --2- 172.21.15.146:0/3749033407 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e68153ab0 0x7f5e68157080 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f5e5000e900 tx=0x7f5e500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:48.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.376+0000 7f5e5e7fc700 1 -- 172.21.15.146:0/3749033407 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e50013680 con 0x7f5e68153ab0 2023-10-06T11:08:48.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.376+0000 7f5e5e7fc700 1 -- 172.21.15.146:0/3749033407 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e500137e0 con 0x7f5e68153ab0 2023-10-06T11:08:48.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.376+0000 7f5e6cfb3700 1 -- 172.21.15.146:0/3749033407 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e681555d0 con 0x7f5e68153ab0 2023-10-06T11:08:48.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.376+0000 7f5e5e7fc700 1 -- 172.21.15.146:0/3749033407 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e50013ba0 con 0x7f5e68153ab0 2023-10-06T11:08:48.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.376+0000 7f5e6cfb3700 1 -- 172.21.15.146:0/3749033407 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e68155b90 con 0x7f5e68153ab0 2023-10-06T11:08:48.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.377+0000 7f5e6cfb3700 1 -- 172.21.15.146:0/3749033407 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e681560b0 con 0x7f5e68153ab0 2023-10-06T11:08:48.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.377+0000 7f5e5e7fc700 1 -- 172.21.15.146:0/3749033407 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5e5000c460 con 0x7f5e68153ab0 2023-10-06T11:08:48.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.378+0000 7f5e5e7fc700 1 --2- 172.21.15.146:0/3749033407 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5e48066f30 0x7f5e480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:48.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.378+0000 7f5e6659c700 1 --2- 172.21.15.146:0/3749033407 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5e48066f30 0x7f5e480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:48.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.378+0000 7f5e5e7fc700 1 -- 172.21.15.146:0/3749033407 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5e500847d0 con 0x7f5e68153ab0 2023-10-06T11:08:48.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.378+0000 7f5e6659c700 1 --2- 172.21.15.146:0/3749033407 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5e48066f30 0x7f5e480693e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5e58005ce0 tx=0x7f5e58001dc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:48.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.382+0000 7f5e5e7fc700 1 -- 172.21.15.146:0/3749033407 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5e681560b0 con 0x7f5e68153ab0 2023-10-06T11:08:48.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.642+0000 7f5e6cfb3700 1 -- 172.21.15.146:0/3749033407 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f5e68069160 con 0x7f5e68153ab0 2023-10-06T11:08:48.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.642+0000 7f5e5e7fc700 1 -- 172.21.15.146:0/3749033407 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1339 (secure 0 0 0) 0x7f5e500518e0 con 0x7f5e68153ab0 2023-10-06T11:08:48.644 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:08:48.645 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":203,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":47,"num_osds":8,"num_up_osds":8,"osd_up_since":1696590336,"num_in_osds":8,"osd_in_since":1696590327,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":72},{"state_name":"unknown","count":21},{"state_name":"creating+peering","count":12}],"num_pgs":105,"num_pools":4,"num_objects":17,"data_bytes":592050,"bytes_used":2512203776,"bytes_avail":770581909504,"bytes_total":773094113280,"unknown_pgs_ratio":0.20000000298023224,"inactive_pgs_ratio":0.11428571492433548,"write_bytes_sec":1949,"read_op_per_sec":0,"write_op_per_sec":5},"fsmap":{"epoch":35,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":5481}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2023-10-06T11:08:07.170471+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T11:08:48.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.644+0000 7f5e6cfb3700 1 -- 172.21.15.146:0/3749033407 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5e48066f30 msgr2=0x7f5e480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:48.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.644+0000 7f5e6cfb3700 1 --2- 172.21.15.146:0/3749033407 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5e48066f30 0x7f5e480693e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5e58005ce0 tx=0x7f5e58001dc0 comp rx=0 tx=0).stop 2023-10-06T11:08:48.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.644+0000 7f5e6cfb3700 1 -- 172.21.15.146:0/3749033407 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e68153ab0 msgr2=0x7f5e68157080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:48.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.644+0000 7f5e6cfb3700 1 --2- 172.21.15.146:0/3749033407 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e68153ab0 0x7f5e68157080 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f5e5000e900 tx=0x7f5e500091a0 comp rx=0 tx=0).stop 2023-10-06T11:08:48.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.644+0000 7f5e6cfb3700 1 -- 172.21.15.146:0/3749033407 shutdown_connections 2023-10-06T11:08:48.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.644+0000 7f5e6cfb3700 1 --2- 172.21.15.146:0/3749033407 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5e48066f30 0x7f5e480693e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:48.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.644+0000 7f5e6cfb3700 1 --2- 172.21.15.146:0/3749033407 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e68153e80 0x7f5e6814fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:48.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.644+0000 7f5e6cfb3700 1 --2- 172.21.15.146:0/3749033407 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e68068ba0 0x7f5e68159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:48.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.644+0000 7f5e6cfb3700 1 --2- 172.21.15.146:0/3749033407 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e68153ab0 0x7f5e68157080 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:48.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.644+0000 7f5e6cfb3700 1 -- 172.21.15.146:0/3749033407 >> 172.21.15.146:0/3749033407 conn(0x7f5e6806eba0 msgr2=0x7f5e68152fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:48.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.644+0000 7f5e6cfb3700 1 -- 172.21.15.146:0/3749033407 shutdown_connections 2023-10-06T11:08:48.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.644+0000 7f5e6cfb3700 1 -- 172.21.15.146:0/3749033407 wait complete. 2023-10-06T11:08:48.658 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-06T11:08:48.659 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:08:48.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.771+0000 7f4d2ebde700 1 Processor -- start 2023-10-06T11:08:48.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.771+0000 7f4d2ebde700 1 -- start start 2023-10-06T11:08:48.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.772+0000 7f4d2ebde700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4d280b2530 0x7f4d2815cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:48.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.772+0000 7f4d2ebde700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d2815c630 con 0x7f4d2815a7f0 2023-10-06T11:08:48.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.772+0000 7f4d2ebde700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d2815ba20 con 0x7f4d2815a420 2023-10-06T11:08:48.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.772+0000 7f4d2ebde700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d280ce040 con 0x7f4d280b2530 2023-10-06T11:08:48.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.772+0000 7f4d2d3db700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4d2815a7f0 0x7f4d2815acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40084/0 (socket says 172.21.15.146:40084) 2023-10-06T11:08:48.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.772+0000 7f4d2d3db700 1 -- 172.21.15.146:0/1026278270 learned_addr learned my addr 172.21.15.146:0/1026278270 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:08:48.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.772+0000 7f4d2e3dd700 1 --2- 172.21.15.146:0/1026278270 >> v2:172.21.15.151:3300/0 conn(0x7f4d280b2530 0x7f4d2815cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:48.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.772+0000 7f4d2cbda700 1 -- 172.21.15.146:0/1026278270 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2848955922 0 0) 0x7f4d2815c630 con 0x7f4d2815a7f0 2023-10-06T11:08:48.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.772+0000 7f4d2cbda700 1 -- 172.21.15.146:0/1026278270 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d10003570 con 0x7f4d2815a7f0 2023-10-06T11:08:48.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.772+0000 7f4d2cbda700 1 -- 172.21.15.146:0/1026278270 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 667813023 0 0) 0x7f4d10003570 con 0x7f4d2815a7f0 2023-10-06T11:08:48.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.772+0000 7f4d2cbda700 1 -- 172.21.15.146:0/1026278270 >> v2:172.21.15.151:3300/0 conn(0x7f4d280b2530 msgr2=0x7f4d2815cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:48.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.772+0000 7f4d2cbda700 1 --2- 172.21.15.146:0/1026278270 >> v2:172.21.15.151:3300/0 conn(0x7f4d280b2530 0x7f4d2815cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:48.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.772+0000 7f4d2cbda700 1 -- 172.21.15.146:0/1026278270 >> v1:172.21.15.151:6789/0 conn(0x7f4d2815a420 legacy=0x7f4d280b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:48.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.772+0000 7f4d2cbda700 1 -- 172.21.15.146:0/1026278270 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d2815bd00 con 0x7f4d2815a7f0 2023-10-06T11:08:48.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.772+0000 7f4d2cbda700 1 -- 172.21.15.146:0/1026278270 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f4d1c0017f0 con 0x7f4d2815a7f0 2023-10-06T11:08:48.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.772+0000 7f4d2cbda700 1 -- 172.21.15.146:0/1026278270 >> v1:172.21.15.146:6789/0 conn(0x7f4d2815a7f0 legacy=0x7f4d2815acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:48.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.773+0000 7f4d2cbda700 1 --2- 172.21.15.146:0/1026278270 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d10003a60 0x7f4d10003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:48.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.773+0000 7f4d2cbda700 1 --2- 172.21.15.146:0/1026278270 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d10004810 0x7f4d10004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:48.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.773+0000 7f4d2cbda700 1 --2- 172.21.15.146:0/1026278270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d100051c0 0x7f4d1000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:48.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.773+0000 7f4d2cbda700 1 -- 172.21.15.146:0/1026278270 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1000c0a0 con 0x7f4d100051c0 2023-10-06T11:08:48.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.773+0000 7f4d2cbda700 1 -- 172.21.15.146:0/1026278270 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1000c210 con 0x7f4d10004810 2023-10-06T11:08:48.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.773+0000 7f4d2cbda700 1 -- 172.21.15.146:0/1026278270 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1000c3d0 con 0x7f4d10003a60 2023-10-06T11:08:48.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.773+0000 7f4d2e3dd700 1 --2- 172.21.15.146:0/1026278270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d100051c0 0x7f4d1000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:48.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.773+0000 7f4d2d3db700 1 --2- 172.21.15.146:0/1026278270 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d10004810 0x7f4d10004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:48.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.773+0000 7f4d2dbdc700 1 --2- 172.21.15.146:0/1026278270 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d10003a60 0x7f4d10003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:48.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.773+0000 7f4d2e3dd700 1 -- 172.21.15.146:0/1026278270 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d10003a60 msgr2=0x7f4d10003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:48.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.773+0000 7f4d2e3dd700 1 --2- 172.21.15.146:0/1026278270 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d10003a60 0x7f4d10003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:48.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.773+0000 7f4d2e3dd700 1 -- 172.21.15.146:0/1026278270 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d10004810 msgr2=0x7f4d10004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:48.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.773+0000 7f4d2e3dd700 1 --2- 172.21.15.146:0/1026278270 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d10004810 0x7f4d10004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:48.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.773+0000 7f4d2e3dd700 1 -- 172.21.15.146:0/1026278270 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d10003570 con 0x7f4d100051c0 2023-10-06T11:08:48.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.773+0000 7f4d2e3dd700 1 -- 172.21.15.146:0/1026278270 reap_dead start 2023-10-06T11:08:48.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.773+0000 7f4d2e3dd700 1 --2- 172.21.15.146:0/1026278270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d100051c0 0x7f4d1000ba60 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f4d280b2930 tx=0x7f4d180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d7268cd8eb62298 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:48.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.773+0000 7f4d2cbda700 1 -- 172.21.15.146:0/1026278270 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1800e710 con 0x7f4d100051c0 2023-10-06T11:08:48.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.773+0000 7f4d2cbda700 1 -- 172.21.15.146:0/1026278270 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1800e890 con 0x7f4d100051c0 2023-10-06T11:08:48.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.773+0000 7f4d2cbda700 1 -- 172.21.15.146:0/1026278270 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1800ec50 con 0x7f4d100051c0 2023-10-06T11:08:48.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.774+0000 7f4d2ebde700 1 -- 172.21.15.146:0/1026278270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d100051c0 msgr2=0x7f4d1000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:48.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.774+0000 7f4d2ebde700 1 --2- 172.21.15.146:0/1026278270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d100051c0 0x7f4d1000ba60 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f4d280b2930 tx=0x7f4d180091a0 comp rx=0 tx=0).stop 2023-10-06T11:08:48.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.774+0000 7f4d2ebde700 1 -- 172.21.15.146:0/1026278270 shutdown_connections 2023-10-06T11:08:48.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.774+0000 7f4d2ebde700 1 --2- 172.21.15.146:0/1026278270 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d100051c0 0x7f4d1000ba60 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:48.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.774+0000 7f4d2ebde700 1 -- 172.21.15.146:0/1026278270 >> 172.21.15.146:0/1026278270 conn(0x7f4d2806eba0 msgr2=0x7f4d2806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:48.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.774+0000 7f4d2ebde700 1 -- 172.21.15.146:0/1026278270 shutdown_connections 2023-10-06T11:08:48.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.774+0000 7f4d2ebde700 1 -- 172.21.15.146:0/1026278270 wait complete. 2023-10-06T11:08:48.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.775+0000 7f4d2ebde700 1 Processor -- start 2023-10-06T11:08:48.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.775+0000 7f4d2ebde700 1 -- start start 2023-10-06T11:08:48.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.776+0000 7f4d2ebde700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d100051c0 0x7f4d2814a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:48.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.776+0000 7f4d2ebde700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d28147f70 0x7f4d2814ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:48.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.776+0000 7f4d2ebde700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d2814d3a0 0x7f4d280ce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:48.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.776+0000 7f4d2ebde700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2814d820 con 0x7f4d100051c0 2023-10-06T11:08:48.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.776+0000 7f4d2ebde700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d28149b60 con 0x7f4d28147f70 2023-10-06T11:08:48.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.776+0000 7f4d2ebde700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d28148ac0 con 0x7f4d2814d3a0 2023-10-06T11:08:48.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.776+0000 7f4d2dbdc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d100051c0 0x7f4d2814a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:48.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.776+0000 7f4d2dbdc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d100051c0 0x7f4d2814a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:60920/0 (socket says 172.21.15.146:60920) 2023-10-06T11:08:48.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.776+0000 7f4d2dbdc700 1 -- 172.21.15.146:0/615547834 learned_addr learned my addr 172.21.15.146:0/615547834 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:48.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.776+0000 7f4d2d3db700 1 --2- 172.21.15.146:0/615547834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d28147f70 0x7f4d2814ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:48.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.776+0000 7f4d2e3dd700 1 --2- 172.21.15.146:0/615547834 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d2814d3a0 0x7f4d280ce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:48.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.776+0000 7f4d2dbdc700 1 -- 172.21.15.146:0/615547834 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d2814d3a0 msgr2=0x7f4d280ce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:48.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.776+0000 7f4d2dbdc700 1 --2- 172.21.15.146:0/615547834 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d2814d3a0 0x7f4d280ce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:48.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.776+0000 7f4d2dbdc700 1 -- 172.21.15.146:0/615547834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d28147f70 msgr2=0x7f4d2814ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:48.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.776+0000 7f4d2dbdc700 1 --2- 172.21.15.146:0/615547834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d28147f70 0x7f4d2814ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:48.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.776+0000 7f4d2dbdc700 1 -- 172.21.15.146:0/615547834 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d28148da0 con 0x7f4d100051c0 2023-10-06T11:08:48.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.776+0000 7f4d2dbdc700 1 --2- 172.21.15.146:0/615547834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d100051c0 0x7f4d2814a660 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f4d20002950 tx=0x7f4d20007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:48.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.777+0000 7f4d25ffb700 1 -- 172.21.15.146:0/615547834 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d20002e90 con 0x7f4d100051c0 2023-10-06T11:08:48.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.777+0000 7f4d25ffb700 1 -- 172.21.15.146:0/615547834 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2000f8d0 con 0x7f4d100051c0 2023-10-06T11:08:48.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.777+0000 7f4d2ebde700 1 -- 172.21.15.146:0/615547834 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d28149080 con 0x7f4d100051c0 2023-10-06T11:08:48.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.777+0000 7f4d25ffb700 1 -- 172.21.15.146:0/615547834 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2000fc70 con 0x7f4d100051c0 2023-10-06T11:08:48.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.777+0000 7f4d2ebde700 1 -- 172.21.15.146:0/615547834 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d28149640 con 0x7f4d100051c0 2023-10-06T11:08:48.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.778+0000 7f4d2ebde700 1 -- 172.21.15.146:0/615547834 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d280afae0 con 0x7f4d100051c0 2023-10-06T11:08:48.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.778+0000 7f4d25ffb700 1 -- 172.21.15.146:0/615547834 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4d2001c400 con 0x7f4d100051c0 2023-10-06T11:08:48.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.778+0000 7f4d25ffb700 1 --2- 172.21.15.146:0/615547834 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4d14066f30 0x7f4d140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:48.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.778+0000 7f4d25ffb700 1 -- 172.21.15.146:0/615547834 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4d20084b60 con 0x7f4d100051c0 2023-10-06T11:08:48.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.779+0000 7f4d2d3db700 1 --2- 172.21.15.146:0/615547834 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4d14066f30 0x7f4d140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:48.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.779+0000 7f4d2d3db700 1 --2- 172.21.15.146:0/615547834 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4d14066f30 0x7f4d140693e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c002060 tx=0x7f4d1c006040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:48.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.783+0000 7f4d25ffb700 1 -- 172.21.15.146:0/615547834 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4d20051d20 con 0x7f4d100051c0 2023-10-06T11:08:48.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.961+0000 7f4d2ebde700 1 -- 172.21.15.146:0/615547834 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4d2815bfe0 con 0x7f4d14066f30 2023-10-06T11:08:48.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.969+0000 7f4d25ffb700 1 -- 172.21.15.146:0/615547834 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+307619 (secure 0 0 0) 0x7f4d2815bfe0 con 0x7f4d14066f30 2023-10-06T11:08:48.974 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:08:48.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.972+0000 7f4d2ebde700 1 -- 172.21.15.146:0/615547834 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4d14066f30 msgr2=0x7f4d140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:48.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.972+0000 7f4d2ebde700 1 --2- 172.21.15.146:0/615547834 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4d14066f30 0x7f4d140693e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c002060 tx=0x7f4d1c006040 comp rx=0 tx=0).stop 2023-10-06T11:08:48.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.972+0000 7f4d2ebde700 1 -- 172.21.15.146:0/615547834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d100051c0 msgr2=0x7f4d2814a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:48.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.972+0000 7f4d2ebde700 1 --2- 172.21.15.146:0/615547834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d100051c0 0x7f4d2814a660 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f4d20002950 tx=0x7f4d20007d30 comp rx=0 tx=0).stop 2023-10-06T11:08:48.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.972+0000 7f4d2ebde700 1 -- 172.21.15.146:0/615547834 shutdown_connections 2023-10-06T11:08:48.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.972+0000 7f4d2ebde700 1 --2- 172.21.15.146:0/615547834 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4d14066f30 0x7f4d140693e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:48.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.972+0000 7f4d2ebde700 1 --2- 172.21.15.146:0/615547834 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d2814d3a0 0x7f4d280ce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:48.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.972+0000 7f4d2ebde700 1 --2- 172.21.15.146:0/615547834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d100051c0 0x7f4d2814a660 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:48.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.973+0000 7f4d2ebde700 1 --2- 172.21.15.146:0/615547834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d28147f70 0x7f4d2814ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:48.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.973+0000 7f4d2ebde700 1 -- 172.21.15.146:0/615547834 >> 172.21.15.146:0/615547834 conn(0x7f4d2806eba0 msgr2=0x7f4d280b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:48.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.973+0000 7f4d2ebde700 1 -- 172.21.15.146:0/615547834 shutdown_connections 2023-10-06T11:08:48.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:48.973+0000 7f4d2ebde700 1 -- 172.21.15.146:0/615547834 wait complete. 2023-10-06T11:08:48.978 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:08:48.986 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":135,"stamp":"2023-10-06T11:08:47.179426+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592050,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":191,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":142,"ondisk_log_size":142,"up":168,"acting":168,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":104,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2453324,"kb_used_data":5388,"kb_used_omap":0,"kb_used_meta":2447872,"kb_avail":752521396,"statfs":{"total":773094113280,"available":770581909504,"internally_reserved":0,"allocated":5517312,"data_stored":3026846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2506620928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1682,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.776512"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.437128+0000","last_change":"2023-10-06T11:08:43.429477+0000","last_active":"2023-10-06T11:08:43.437128+0000","last_peered":"2023-10-06T11:08:43.437128+0000","last_clean":"2023-10-06T11:08:43.437128+0000","last_became_active":"2023-10-06T11:08:43.429245+0000","last_became_peered":"2023-10-06T11:08:43.429245+0000","last_unstale":"2023-10-06T11:08:43.437128+0000","last_undegraded":"2023-10-06T11:08:43.437128+0000","last_fullsized":"2023-10-06T11:08:43.437128+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:30.771237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.434216+0000","last_change":"2023-10-06T11:08:43.425499+0000","last_active":"2023-10-06T11:08:43.434216+0000","last_peered":"2023-10-06T11:08:43.434216+0000","last_clean":"2023-10-06T11:08:43.434216+0000","last_became_active":"2023-10-06T11:08:43.425262+0000","last_became_peered":"2023-10-06T11:08:43.425262+0000","last_unstale":"2023-10-06T11:08:43.434216+0000","last_undegraded":"2023-10-06T11:08:43.434216+0000","last_fullsized":"2023-10-06T11:08:43.434216+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:04:54.615565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.437292+0000","last_change":"2023-10-06T11:08:43.433555+0000","last_active":"2023-10-06T11:08:43.437292+0000","last_peered":"2023-10-06T11:08:43.437292+0000","last_clean":"2023-10-06T11:08:43.437292+0000","last_became_active":"2023-10-06T11:08:43.429961+0000","last_became_peered":"2023-10-06T11:08:43.429961+0000","last_unstale":"2023-10-06T11:08:43.437292+0000","last_undegraded":"2023-10-06T11:08:43.437292+0000","last_fullsized":"2023-10-06T11:08:43.437292+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:45:44.809943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435566+0000","last_change":"2023-10-06T11:08:43.424718+0000","last_active":"2023-10-06T11:08:43.435566+0000","last_peered":"2023-10-06T11:08:43.435566+0000","last_clean":"2023-10-06T11:08:43.435566+0000","last_became_active":"2023-10-06T11:08:43.424156+0000","last_became_peered":"2023-10-06T11:08:43.424156+0000","last_unstale":"2023-10-06T11:08:43.435566+0000","last_undegraded":"2023-10-06T11:08:43.435566+0000","last_fullsized":"2023-10-06T11:08:43.435566+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:52:09.529056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.429675+0000","last_change":"2023-10-06T11:08:43.428465+0000","last_active":"2023-10-06T11:08:43.429675+0000","last_peered":"2023-10-06T11:08:43.429675+0000","last_clean":"2023-10-06T11:08:43.429675+0000","last_became_active":"2023-10-06T11:08:43.427865+0000","last_became_peered":"2023-10-06T11:08:43.427865+0000","last_unstale":"2023-10-06T11:08:43.429675+0000","last_undegraded":"2023-10-06T11:08:43.429675+0000","last_fullsized":"2023-10-06T11:08:43.429675+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:23.831368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435190+0000","last_change":"2023-10-06T11:08:43.431433+0000","last_active":"2023-10-06T11:08:43.435190+0000","last_peered":"2023-10-06T11:08:43.435190+0000","last_clean":"2023-10-06T11:08:43.435190+0000","last_became_active":"2023-10-06T11:08:43.430675+0000","last_became_peered":"2023-10-06T11:08:43.430675+0000","last_unstale":"2023-10-06T11:08:43.435190+0000","last_undegraded":"2023-10-06T11:08:43.435190+0000","last_fullsized":"2023-10-06T11:08:43.435190+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:04:54.615565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.439131+0000","last_change":"2023-10-06T11:08:43.430750+0000","last_active":"2023-10-06T11:08:43.439131+0000","last_peered":"2023-10-06T11:08:43.439131+0000","last_clean":"2023-10-06T11:08:43.439131+0000","last_became_active":"2023-10-06T11:08:43.430457+0000","last_became_peered":"2023-10-06T11:08:43.430457+0000","last_unstale":"2023-10-06T11:08:43.439131+0000","last_undegraded":"2023-10-06T11:08:43.439131+0000","last_fullsized":"2023-10-06T11:08:43.439131+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:46.781626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.429682+0000","last_change":"2023-10-06T11:08:43.426994+0000","last_active":"2023-10-06T11:08:43.429682+0000","last_peered":"2023-10-06T11:08:43.429682+0000","last_clean":"2023-10-06T11:08:43.429682+0000","last_became_active":"2023-10-06T11:08:43.426729+0000","last_became_peered":"2023-10-06T11:08:43.426729+0000","last_unstale":"2023-10-06T11:08:43.429682+0000","last_undegraded":"2023-10-06T11:08:43.429682+0000","last_fullsized":"2023-10-06T11:08:43.429682+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:08:40.633452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435568+0000","last_change":"2023-10-06T11:08:43.428408+0000","last_active":"2023-10-06T11:08:43.435568+0000","last_peered":"2023-10-06T11:08:43.435568+0000","last_clean":"2023-10-06T11:08:43.435568+0000","last_became_active":"2023-10-06T11:08:43.428142+0000","last_became_peered":"2023-10-06T11:08:43.428142+0000","last_unstale":"2023-10-06T11:08:43.435568+0000","last_undegraded":"2023-10-06T11:08:43.435568+0000","last_fullsized":"2023-10-06T11:08:43.435568+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:23.831368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.437137+0000","last_change":"2023-10-06T11:08:43.429906+0000","last_active":"2023-10-06T11:08:43.437137+0000","last_peered":"2023-10-06T11:08:43.437137+0000","last_clean":"2023-10-06T11:08:43.437137+0000","last_became_active":"2023-10-06T11:08:43.429640+0000","last_became_peered":"2023-10-06T11:08:43.429640+0000","last_unstale":"2023-10-06T11:08:43.437137+0000","last_undegraded":"2023-10-06T11:08:43.437137+0000","last_fullsized":"2023-10-06T11:08:43.437137+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:33:49.431732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.433510+0000","last_change":"2023-10-06T11:08:43.422104+0000","last_active":"2023-10-06T11:08:43.433510+0000","last_peered":"2023-10-06T11:08:43.433510+0000","last_clean":"2023-10-06T11:08:43.433510+0000","last_became_active":"2023-10-06T11:08:43.421669+0000","last_became_peered":"2023-10-06T11:08:43.421669+0000","last_unstale":"2023-10-06T11:08:43.433510+0000","last_undegraded":"2023-10-06T11:08:43.433510+0000","last_fullsized":"2023-10-06T11:08:43.433510+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:28.243301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.437180+0000","last_change":"2023-10-06T11:08:43.433205+0000","last_active":"2023-10-06T11:08:43.437180+0000","last_peered":"2023-10-06T11:08:43.437180+0000","last_clean":"2023-10-06T11:08:43.437180+0000","last_became_active":"2023-10-06T11:08:43.429348+0000","last_became_peered":"2023-10-06T11:08:43.429348+0000","last_unstale":"2023-10-06T11:08:43.437180+0000","last_undegraded":"2023-10-06T11:08:43.437180+0000","last_fullsized":"2023-10-06T11:08:43.437180+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:31:49.189518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.434252+0000","last_change":"2023-10-06T11:08:43.427751+0000","last_active":"2023-10-06T11:08:43.434252+0000","last_peered":"2023-10-06T11:08:43.434252+0000","last_clean":"2023-10-06T11:08:43.434252+0000","last_became_active":"2023-10-06T11:08:43.427469+0000","last_became_peered":"2023-10-06T11:08:43.427469+0000","last_unstale":"2023-10-06T11:08:43.434252+0000","last_undegraded":"2023-10-06T11:08:43.434252+0000","last_fullsized":"2023-10-06T11:08:43.434252+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:26.368790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435606+0000","last_change":"2023-10-06T11:08:43.431889+0000","last_active":"2023-10-06T11:08:43.435606+0000","last_peered":"2023-10-06T11:08:43.435606+0000","last_clean":"2023-10-06T11:08:43.435606+0000","last_became_active":"2023-10-06T11:08:43.431636+0000","last_became_peered":"2023-10-06T11:08:43.431636+0000","last_unstale":"2023-10-06T11:08:43.435606+0000","last_undegraded":"2023-10-06T11:08:43.435606+0000","last_fullsized":"2023-10-06T11:08:43.435606+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:27:02.499415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.431264+0000","last_change":"2023-10-06T11:08:43.426550+0000","last_active":"2023-10-06T11:08:43.431264+0000","last_peered":"2023-10-06T11:08:43.431264+0000","last_clean":"2023-10-06T11:08:43.431264+0000","last_became_active":"2023-10-06T11:08:43.426263+0000","last_became_peered":"2023-10-06T11:08:43.426263+0000","last_unstale":"2023-10-06T11:08:43.431264+0000","last_undegraded":"2023-10-06T11:08:43.431264+0000","last_fullsized":"2023-10-06T11:08:43.431264+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:29:00.361399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.433487+0000","last_change":"2023-10-06T11:08:43.423917+0000","last_active":"2023-10-06T11:08:43.433487+0000","last_peered":"2023-10-06T11:08:43.433487+0000","last_clean":"2023-10-06T11:08:43.433487+0000","last_became_active":"2023-10-06T11:08:43.423665+0000","last_became_peered":"2023-10-06T11:08:43.423665+0000","last_unstale":"2023-10-06T11:08:43.433487+0000","last_undegraded":"2023-10-06T11:08:43.433487+0000","last_fullsized":"2023-10-06T11:08:43.433487+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:06:21.706780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435638+0000","last_change":"2023-10-06T11:08:43.430289+0000","last_active":"2023-10-06T11:08:43.435638+0000","last_peered":"2023-10-06T11:08:43.435638+0000","last_clean":"2023-10-06T11:08:43.435638+0000","last_became_active":"2023-10-06T11:08:43.430041+0000","last_became_peered":"2023-10-06T11:08:43.430041+0000","last_unstale":"2023-10-06T11:08:43.435638+0000","last_undegraded":"2023-10-06T11:08:43.435638+0000","last_fullsized":"2023-10-06T11:08:43.435638+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:01:46.808227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.429634+0000","last_change":"2023-10-06T11:08:43.426790+0000","last_active":"2023-10-06T11:08:43.429634+0000","last_peered":"2023-10-06T11:08:43.429634+0000","last_clean":"2023-10-06T11:08:43.429634+0000","last_became_active":"2023-10-06T11:08:43.426546+0000","last_became_peered":"2023-10-06T11:08:43.426546+0000","last_unstale":"2023-10-06T11:08:43.429634+0000","last_undegraded":"2023-10-06T11:08:43.429634+0000","last_fullsized":"2023-10-06T11:08:43.429634+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:39:00.400333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435640+0000","last_change":"2023-10-06T11:08:43.432649+0000","last_active":"2023-10-06T11:08:43.435640+0000","last_peered":"2023-10-06T11:08:43.435640+0000","last_clean":"2023-10-06T11:08:43.435640+0000","last_became_active":"2023-10-06T11:08:43.432398+0000","last_became_peered":"2023-10-06T11:08:43.432398+0000","last_unstale":"2023-10-06T11:08:43.435640+0000","last_undegraded":"2023-10-06T11:08:43.435640+0000","last_fullsized":"2023-10-06T11:08:43.435640+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:50:26.239260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.437343+0000","last_change":"2023-10-06T11:08:43.435236+0000","last_active":"2023-10-06T11:08:43.437343+0000","last_peered":"2023-10-06T11:08:43.437343+0000","last_clean":"2023-10-06T11:08:43.437343+0000","last_became_active":"2023-10-06T11:08:43.434990+0000","last_became_peered":"2023-10-06T11:08:43.434990+0000","last_unstale":"2023-10-06T11:08:43.437343+0000","last_undegraded":"2023-10-06T11:08:43.437343+0000","last_fullsized":"2023-10-06T11:08:43.437343+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:29.015502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435588+0000","last_change":"2023-10-06T11:08:43.424872+0000","last_active":"2023-10-06T11:08:43.435588+0000","last_peered":"2023-10-06T11:08:43.435588+0000","last_clean":"2023-10-06T11:08:43.435588+0000","last_became_active":"2023-10-06T11:08:43.424349+0000","last_became_peered":"2023-10-06T11:08:43.424349+0000","last_unstale":"2023-10-06T11:08:43.435588+0000","last_undegraded":"2023-10-06T11:08:43.435588+0000","last_fullsized":"2023-10-06T11:08:43.435588+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:03:16.583418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.434680+0000","last_change":"2023-10-06T11:08:43.431580+0000","last_active":"2023-10-06T11:08:43.434680+0000","last_peered":"2023-10-06T11:08:43.434680+0000","last_clean":"2023-10-06T11:08:43.434680+0000","last_became_active":"2023-10-06T11:08:43.430722+0000","last_became_peered":"2023-10-06T11:08:43.430722+0000","last_unstale":"2023-10-06T11:08:43.434680+0000","last_undegraded":"2023-10-06T11:08:43.434680+0000","last_fullsized":"2023-10-06T11:08:43.434680+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:54:07.391040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.428430+0000","last_change":"2023-10-06T11:08:43.427248+0000","last_active":"2023-10-06T11:08:43.428430+0000","last_peered":"2023-10-06T11:08:43.428430+0000","last_clean":"2023-10-06T11:08:43.428430+0000","last_became_active":"2023-10-06T11:08:43.426986+0000","last_became_peered":"2023-10-06T11:08:43.426986+0000","last_unstale":"2023-10-06T11:08:43.428430+0000","last_undegraded":"2023-10-06T11:08:43.428430+0000","last_fullsized":"2023-10-06T11:08:43.428430+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:33.013845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.407835+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:03.751012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.428786+0000","last_change":"2023-10-06T11:08:43.427311+0000","last_active":"2023-10-06T11:08:43.428786+0000","last_peered":"2023-10-06T11:08:43.428786+0000","last_clean":"2023-10-06T11:08:43.428786+0000","last_became_active":"2023-10-06T11:08:43.427059+0000","last_became_peered":"2023-10-06T11:08:43.427059+0000","last_unstale":"2023-10-06T11:08:43.428786+0000","last_undegraded":"2023-10-06T11:08:43.428786+0000","last_fullsized":"2023-10-06T11:08:43.428786+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:33:09.554346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.407802+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:13:18.791935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.407406+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:51:07.091891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.429699+0000","last_change":"2023-10-06T11:08:43.427507+0000","last_active":"2023-10-06T11:08:43.429699+0000","last_peered":"2023-10-06T11:08:43.429699+0000","last_clean":"2023-10-06T11:08:43.429699+0000","last_became_active":"2023-10-06T11:08:43.427268+0000","last_became_peered":"2023-10-06T11:08:43.427268+0000","last_unstale":"2023-10-06T11:08:43.429699+0000","last_undegraded":"2023-10-06T11:08:43.429699+0000","last_fullsized":"2023-10-06T11:08:43.429699+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:03:16.583418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"46'2","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.438968+0000","last_change":"2023-10-06T11:08:42.422232+0000","last_active":"2023-10-06T11:08:43.438968+0000","last_peered":"2023-10-06T11:08:43.438968+0000","last_clean":"2023-10-06T11:08:43.438968+0000","last_became_active":"2023-10-06T11:08:42.421943+0000","last_became_peered":"2023-10-06T11:08:42.421943+0000","last_unstale":"2023-10-06T11:08:43.438968+0000","last_undegraded":"2023-10-06T11:08:43.438968+0000","last_fullsized":"2023-10-06T11:08:43.438968+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:26:25.091803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"46'1","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.439458+0000","last_change":"2023-10-06T11:08:42.428856+0000","last_active":"2023-10-06T11:08:43.439458+0000","last_peered":"2023-10-06T11:08:43.439458+0000","last_clean":"2023-10-06T11:08:43.439458+0000","last_became_active":"2023-10-06T11:08:42.428382+0000","last_became_peered":"2023-10-06T11:08:42.428382+0000","last_unstale":"2023-10-06T11:08:43.439458+0000","last_undegraded":"2023-10-06T11:08:43.439458+0000","last_fullsized":"2023-10-06T11:08:43.439458+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:21.442104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.437333+0000","last_change":"2023-10-06T11:08:43.435060+0000","last_active":"2023-10-06T11:08:43.437333+0000","last_peered":"2023-10-06T11:08:43.437333+0000","last_clean":"2023-10-06T11:08:43.437333+0000","last_became_active":"2023-10-06T11:08:43.434067+0000","last_became_peered":"2023-10-06T11:08:43.434067+0000","last_unstale":"2023-10-06T11:08:43.437333+0000","last_undegraded":"2023-10-06T11:08:43.437333+0000","last_fullsized":"2023-10-06T11:08:43.437333+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:10.212258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.404858+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:25.209537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.429405+0000","last_change":"2023-10-06T11:08:43.426045+0000","last_active":"2023-10-06T11:08:43.429405+0000","last_peered":"2023-10-06T11:08:43.429405+0000","last_clean":"2023-10-06T11:08:43.429405+0000","last_became_active":"2023-10-06T11:08:43.425808+0000","last_became_peered":"2023-10-06T11:08:43.425808+0000","last_unstale":"2023-10-06T11:08:43.429405+0000","last_undegraded":"2023-10-06T11:08:43.429405+0000","last_fullsized":"2023-10-06T11:08:43.429405+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:26.368790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.407305+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:24:24.468404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.437296+0000","last_change":"2023-10-06T11:08:43.434561+0000","last_active":"2023-10-06T11:08:43.437296+0000","last_peered":"2023-10-06T11:08:43.437296+0000","last_clean":"2023-10-06T11:08:43.437296+0000","last_became_active":"2023-10-06T11:08:43.434261+0000","last_became_peered":"2023-10-06T11:08:43.434261+0000","last_unstale":"2023-10-06T11:08:43.437296+0000","last_undegraded":"2023-10-06T11:08:43.437296+0000","last_fullsized":"2023-10-06T11:08:43.437296+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:25:01.083898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.419445+0000","last_change":"2023-10-06T11:08:42.426277+0000","last_active":"2023-10-06T11:08:43.419445+0000","last_peered":"2023-10-06T11:08:43.419445+0000","last_clean":"2023-10-06T11:08:43.419445+0000","last_became_active":"2023-10-06T11:08:42.425809+0000","last_became_peered":"2023-10-06T11:08:42.425809+0000","last_unstale":"2023-10-06T11:08:43.419445+0000","last_undegraded":"2023-10-06T11:08:43.419445+0000","last_fullsized":"2023-10-06T11:08:43.419445+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:43.267112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.422360+0000","last_change":"2023-10-06T11:08:42.424509+0000","last_active":"2023-10-06T11:08:43.422360+0000","last_peered":"2023-10-06T11:08:43.422360+0000","last_clean":"2023-10-06T11:08:43.422360+0000","last_became_active":"2023-10-06T11:08:42.424227+0000","last_became_peered":"2023-10-06T11:08:42.424227+0000","last_unstale":"2023-10-06T11:08:43.422360+0000","last_undegraded":"2023-10-06T11:08:43.422360+0000","last_fullsized":"2023-10-06T11:08:43.422360+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:20:21.116613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.428755+0000","last_change":"2023-10-06T11:08:43.425933+0000","last_active":"2023-10-06T11:08:43.428755+0000","last_peered":"2023-10-06T11:08:43.428755+0000","last_clean":"2023-10-06T11:08:43.428755+0000","last_became_active":"2023-10-06T11:08:43.425682+0000","last_became_peered":"2023-10-06T11:08:43.425682+0000","last_unstale":"2023-10-06T11:08:43.428755+0000","last_undegraded":"2023-10-06T11:08:43.428755+0000","last_fullsized":"2023-10-06T11:08:43.428755+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:22.451552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.405987+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:06:38.366301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435589+0000","last_change":"2023-10-06T11:08:43.430989+0000","last_active":"2023-10-06T11:08:43.435589+0000","last_peered":"2023-10-06T11:08:43.435589+0000","last_clean":"2023-10-06T11:08:43.435589+0000","last_became_active":"2023-10-06T11:08:43.430743+0000","last_became_peered":"2023-10-06T11:08:43.430743+0000","last_unstale":"2023-10-06T11:08:43.435589+0000","last_undegraded":"2023-10-06T11:08:43.435589+0000","last_fullsized":"2023-10-06T11:08:43.435589+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:29:21.767861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"46'3","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.439412+0000","last_change":"2023-10-06T11:08:42.429474+0000","last_active":"2023-10-06T11:08:43.439412+0000","last_peered":"2023-10-06T11:08:43.439412+0000","last_clean":"2023-10-06T11:08:43.439412+0000","last_became_active":"2023-10-06T11:08:42.429213+0000","last_became_peered":"2023-10-06T11:08:42.429213+0000","last_unstale":"2023-10-06T11:08:43.439412+0000","last_undegraded":"2023-10-06T11:08:43.439412+0000","last_fullsized":"2023-10-06T11:08:43.439412+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:32:09.873020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"46'6","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.441588+0000","last_change":"2023-10-06T11:08:42.425248+0000","last_active":"2023-10-06T11:08:43.441588+0000","last_peered":"2023-10-06T11:08:43.441588+0000","last_clean":"2023-10-06T11:08:43.441588+0000","last_became_active":"2023-10-06T11:08:42.425015+0000","last_became_peered":"2023-10-06T11:08:42.425015+0000","last_unstale":"2023-10-06T11:08:43.441588+0000","last_undegraded":"2023-10-06T11:08:43.441588+0000","last_fullsized":"2023-10-06T11:08:43.441588+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:54:06.381591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.428699+0000","last_change":"2023-10-06T11:08:43.424775+0000","last_active":"2023-10-06T11:08:43.428699+0000","last_peered":"2023-10-06T11:08:43.428699+0000","last_clean":"2023-10-06T11:08:43.428699+0000","last_became_active":"2023-10-06T11:08:43.424530+0000","last_became_peered":"2023-10-06T11:08:43.424530+0000","last_unstale":"2023-10-06T11:08:43.428699+0000","last_undegraded":"2023-10-06T11:08:43.428699+0000","last_fullsized":"2023-10-06T11:08:43.428699+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:33:49.431732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"46'2","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.438255+0000","last_change":"2023-10-06T11:08:42.429006+0000","last_active":"2023-10-06T11:08:43.438255+0000","last_peered":"2023-10-06T11:08:43.438255+0000","last_clean":"2023-10-06T11:08:43.438255+0000","last_became_active":"2023-10-06T11:08:42.428634+0000","last_became_peered":"2023-10-06T11:08:42.428634+0000","last_unstale":"2023-10-06T11:08:43.438255+0000","last_undegraded":"2023-10-06T11:08:43.438255+0000","last_fullsized":"2023-10-06T11:08:43.438255+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:35.607875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.434236+0000","last_change":"2023-10-06T11:08:43.427213+0000","last_active":"2023-10-06T11:08:43.434236+0000","last_peered":"2023-10-06T11:08:43.434236+0000","last_clean":"2023-10-06T11:08:43.434236+0000","last_became_active":"2023-10-06T11:08:43.426968+0000","last_became_peered":"2023-10-06T11:08:43.426968+0000","last_unstale":"2023-10-06T11:08:43.434236+0000","last_undegraded":"2023-10-06T11:08:43.434236+0000","last_fullsized":"2023-10-06T11:08:43.434236+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:27:02.499415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.407354+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:51.790939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.429655+0000","last_change":"2023-10-06T11:08:43.427942+0000","last_active":"2023-10-06T11:08:43.429655+0000","last_peered":"2023-10-06T11:08:43.429655+0000","last_clean":"2023-10-06T11:08:43.429655+0000","last_became_active":"2023-10-06T11:08:43.427700+0000","last_became_peered":"2023-10-06T11:08:43.427700+0000","last_unstale":"2023-10-06T11:08:43.429655+0000","last_undegraded":"2023-10-06T11:08:43.429655+0000","last_fullsized":"2023-10-06T11:08:43.429655+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:01:46.808227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.421807+0000","last_change":"2023-10-06T11:08:42.423739+0000","last_active":"2023-10-06T11:08:43.421807+0000","last_peered":"2023-10-06T11:08:43.421807+0000","last_clean":"2023-10-06T11:08:43.421807+0000","last_became_active":"2023-10-06T11:08:42.423397+0000","last_became_peered":"2023-10-06T11:08:42.423397+0000","last_unstale":"2023-10-06T11:08:43.421807+0000","last_undegraded":"2023-10-06T11:08:43.421807+0000","last_fullsized":"2023-10-06T11:08:43.421807+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:06:22.465949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435617+0000","last_change":"2023-10-06T11:08:43.427656+0000","last_active":"2023-10-06T11:08:43.435617+0000","last_peered":"2023-10-06T11:08:43.435617+0000","last_clean":"2023-10-06T11:08:43.435617+0000","last_became_active":"2023-10-06T11:08:43.427354+0000","last_became_peered":"2023-10-06T11:08:43.427354+0000","last_unstale":"2023-10-06T11:08:43.435617+0000","last_undegraded":"2023-10-06T11:08:43.435617+0000","last_fullsized":"2023-10-06T11:08:43.435617+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:39:00.400333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"46'8","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.440505+0000","last_change":"2023-10-06T11:08:42.424889+0000","last_active":"2023-10-06T11:08:43.440505+0000","last_peered":"2023-10-06T11:08:43.440505+0000","last_clean":"2023-10-06T11:08:43.440505+0000","last_became_active":"2023-10-06T11:08:42.424633+0000","last_became_peered":"2023-10-06T11:08:42.424633+0000","last_unstale":"2023-10-06T11:08:43.440505+0000","last_undegraded":"2023-10-06T11:08:43.440505+0000","last_fullsized":"2023-10-06T11:08:43.440505+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:32.004396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.429696+0000","last_change":"2023-10-06T11:08:43.428620+0000","last_active":"2023-10-06T11:08:43.429696+0000","last_peered":"2023-10-06T11:08:43.429696+0000","last_clean":"2023-10-06T11:08:43.429696+0000","last_became_active":"2023-10-06T11:08:43.428142+0000","last_became_peered":"2023-10-06T11:08:43.428142+0000","last_unstale":"2023-10-06T11:08:43.429696+0000","last_undegraded":"2023-10-06T11:08:43.429696+0000","last_fullsized":"2023-10-06T11:08:43.429696+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:28.243301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"46'1","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.436390+0000","last_change":"2023-10-06T11:08:42.432219+0000","last_active":"2023-10-06T11:08:43.436390+0000","last_peered":"2023-10-06T11:08:43.436390+0000","last_clean":"2023-10-06T11:08:43.436390+0000","last_became_active":"2023-10-06T11:08:42.431764+0000","last_became_peered":"2023-10-06T11:08:42.431764+0000","last_unstale":"2023-10-06T11:08:43.436390+0000","last_undegraded":"2023-10-06T11:08:43.436390+0000","last_fullsized":"2023-10-06T11:08:43.436390+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:45:43.800494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"46'2","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.439915+0000","last_change":"2023-10-06T11:08:42.419848+0000","last_active":"2023-10-06T11:08:43.439915+0000","last_peered":"2023-10-06T11:08:43.439915+0000","last_clean":"2023-10-06T11:08:43.439915+0000","last_became_active":"2023-10-06T11:08:42.419544+0000","last_became_peered":"2023-10-06T11:08:42.419544+0000","last_unstale":"2023-10-06T11:08:43.439915+0000","last_undegraded":"2023-10-06T11:08:43.439915+0000","last_fullsized":"2023-10-06T11:08:43.439915+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:07:14.329644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.407701+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:35:14.166168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.407347+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:07:14.329644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.428782+0000","last_change":"2023-10-06T11:08:43.426219+0000","last_active":"2023-10-06T11:08:43.428782+0000","last_peered":"2023-10-06T11:08:43.428782+0000","last_clean":"2023-10-06T11:08:43.428782+0000","last_became_active":"2023-10-06T11:08:43.425974+0000","last_became_peered":"2023-10-06T11:08:43.425974+0000","last_unstale":"2023-10-06T11:08:43.428782+0000","last_undegraded":"2023-10-06T11:08:43.428782+0000","last_fullsized":"2023-10-06T11:08:43.428782+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:07:16.658185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.407311+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:39:11.705262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.416345+0000","last_change":"2023-10-06T11:08:42.424867+0000","last_active":"2023-10-06T11:08:43.416345+0000","last_peered":"2023-10-06T11:08:43.416345+0000","last_clean":"2023-10-06T11:08:43.416345+0000","last_became_active":"2023-10-06T11:08:42.424670+0000","last_became_peered":"2023-10-06T11:08:42.424670+0000","last_unstale":"2023-10-06T11:08:43.416345+0000","last_undegraded":"2023-10-06T11:08:43.416345+0000","last_fullsized":"2023-10-06T11:08:43.416345+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:28.006053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.434353+0000","last_change":"2023-10-06T11:08:43.426134+0000","last_active":"2023-10-06T11:08:43.434353+0000","last_peered":"2023-10-06T11:08:43.434353+0000","last_clean":"2023-10-06T11:08:43.434353+0000","last_became_active":"2023-10-06T11:08:43.425902+0000","last_became_peered":"2023-10-06T11:08:43.425902+0000","last_unstale":"2023-10-06T11:08:43.434353+0000","last_undegraded":"2023-10-06T11:08:43.434353+0000","last_fullsized":"2023-10-06T11:08:43.434353+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:51:36.859426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.419934+0000","last_change":"2023-10-06T11:08:42.430104+0000","last_active":"2023-10-06T11:08:43.419934+0000","last_peered":"2023-10-06T11:08:43.419934+0000","last_clean":"2023-10-06T11:08:43.419934+0000","last_became_active":"2023-10-06T11:08:42.429143+0000","last_became_peered":"2023-10-06T11:08:42.429143+0000","last_unstale":"2023-10-06T11:08:43.419934+0000","last_undegraded":"2023-10-06T11:08:43.419934+0000","last_fullsized":"2023-10-06T11:08:43.419934+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:33:48.422283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.414859+0000","last_change":"2023-10-06T11:08:42.422089+0000","last_active":"2023-10-06T11:08:43.414859+0000","last_peered":"2023-10-06T11:08:43.414859+0000","last_clean":"2023-10-06T11:08:43.414859+0000","last_became_active":"2023-10-06T11:08:42.421847+0000","last_became_peered":"2023-10-06T11:08:42.421847+0000","last_unstale":"2023-10-06T11:08:43.414859+0000","last_undegraded":"2023-10-06T11:08:43.414859+0000","last_fullsized":"2023-10-06T11:08:43.414859+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:24:24.468404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435505+0000","last_change":"2023-10-06T11:08:43.429380+0000","last_active":"2023-10-06T11:08:43.435505+0000","last_peered":"2023-10-06T11:08:43.435505+0000","last_clean":"2023-10-06T11:08:43.435505+0000","last_became_active":"2023-10-06T11:08:43.429113+0000","last_became_peered":"2023-10-06T11:08:43.429113+0000","last_unstale":"2023-10-06T11:08:43.435505+0000","last_undegraded":"2023-10-06T11:08:43.435505+0000","last_fullsized":"2023-10-06T11:08:43.435505+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:43.781886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.416288+0000","last_change":"2023-10-06T11:08:42.425700+0000","last_active":"2023-10-06T11:08:43.416288+0000","last_peered":"2023-10-06T11:08:43.416288+0000","last_clean":"2023-10-06T11:08:43.416288+0000","last_became_active":"2023-10-06T11:08:42.425460+0000","last_became_peered":"2023-10-06T11:08:42.425460+0000","last_unstale":"2023-10-06T11:08:43.416288+0000","last_undegraded":"2023-10-06T11:08:43.416288+0000","last_fullsized":"2023-10-06T11:08:43.416288+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:31:48.180069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":33,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T11:08:38.388420+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:08:38.388420+0000","last_peered":"2023-10-06T11:08:38.388420+0000","last_clean":"2023-10-06T11:08:38.388420+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:08:38.388420+0000","last_undegraded":"2023-10-06T11:08:38.388420+0000","last_fullsized":"2023-10-06T11:08:38.388420+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.428719+0000","last_change":"2023-10-06T11:08:43.425187+0000","last_active":"2023-10-06T11:08:43.428719+0000","last_peered":"2023-10-06T11:08:43.428719+0000","last_clean":"2023-10-06T11:08:43.428719+0000","last_became_active":"2023-10-06T11:08:43.424989+0000","last_became_peered":"2023-10-06T11:08:43.424989+0000","last_unstale":"2023-10-06T11:08:43.428719+0000","last_undegraded":"2023-10-06T11:08:43.428719+0000","last_fullsized":"2023-10-06T11:08:43.428719+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:45:44.809943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.416439+0000","last_change":"2023-10-06T11:08:42.428698+0000","last_active":"2023-10-06T11:08:43.416439+0000","last_peered":"2023-10-06T11:08:43.416439+0000","last_clean":"2023-10-06T11:08:43.416439+0000","last_became_active":"2023-10-06T11:08:42.428458+0000","last_became_peered":"2023-10-06T11:08:42.428458+0000","last_unstale":"2023-10-06T11:08:43.416439+0000","last_undegraded":"2023-10-06T11:08:43.416439+0000","last_fullsized":"2023-10-06T11:08:43.416439+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:29.761788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":39,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.416332+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:08:43.416332+0000","last_peered":"2023-10-06T11:08:43.416332+0000","last_clean":"2023-10-06T11:08:43.416332+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:08:43.416332+0000","last_undegraded":"2023-10-06T11:08:43.416332+0000","last_fullsized":"2023-10-06T11:08:43.416332+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.422039+0000","last_change":"2023-10-06T11:08:42.427034+0000","last_active":"2023-10-06T11:08:43.422039+0000","last_peered":"2023-10-06T11:08:43.422039+0000","last_clean":"2023-10-06T11:08:43.422039+0000","last_became_active":"2023-10-06T11:08:42.426733+0000","last_became_peered":"2023-10-06T11:08:42.426733+0000","last_unstale":"2023-10-06T11:08:43.422039+0000","last_undegraded":"2023-10-06T11:08:43.422039+0000","last_fullsized":"2023-10-06T11:08:43.422039+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:26:25.091803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":31,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T11:08:38.495257+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:08:38.495257+0000","last_peered":"2023-10-06T11:08:38.495257+0000","last_clean":"2023-10-06T11:08:38.495257+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:08:38.495257+0000","last_undegraded":"2023-10-06T11:08:38.495257+0000","last_fullsized":"2023-10-06T11:08:38.495257+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":184,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.421836+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:08:43.421836+0000","last_peered":"2023-10-06T11:08:43.421836+0000","last_clean":"2023-10-06T11:08:43.421836+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:08:43.421836+0000","last_undegraded":"2023-10-06T11:08:43.421836+0000","last_fullsized":"2023-10-06T11:08:43.421836+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.427071+0000","last_change":"2023-10-06T11:08:43.423061+0000","last_active":"2023-10-06T11:08:43.427071+0000","last_peered":"2023-10-06T11:08:43.427071+0000","last_clean":"2023-10-06T11:08:43.427071+0000","last_became_active":"2023-10-06T11:08:43.422802+0000","last_became_peered":"2023-10-06T11:08:43.422802+0000","last_unstale":"2023-10-06T11:08:43.427071+0000","last_undegraded":"2023-10-06T11:08:43.427071+0000","last_fullsized":"2023-10-06T11:08:43.427071+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:43.781886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.421298+0000","last_change":"2023-10-06T11:08:42.427910+0000","last_active":"2023-10-06T11:08:43.421298+0000","last_peered":"2023-10-06T11:08:43.421298+0000","last_clean":"2023-10-06T11:08:43.421298+0000","last_became_active":"2023-10-06T11:08:42.427478+0000","last_became_peered":"2023-10-06T11:08:42.427478+0000","last_unstale":"2023-10-06T11:08:43.421298+0000","last_undegraded":"2023-10-06T11:08:43.421298+0000","last_fullsized":"2023-10-06T11:08:43.421298+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:33:08.544897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.422507+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:08:43.422507+0000","last_peered":"2023-10-06T11:08:43.422507+0000","last_clean":"2023-10-06T11:08:43.422507+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:08:43.422507+0000","last_undegraded":"2023-10-06T11:08:43.422507+0000","last_fullsized":"2023-10-06T11:08:43.422507+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:08:42.402071+0000","last_change":"2023-10-06T11:08:42.402071+0000","last_active":"2023-10-06T11:08:42.402071+0000","last_peered":"2023-10-06T11:08:42.402071+0000","last_clean":"2023-10-06T11:08:42.402071+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:42.402071+0000","last_undegraded":"2023-10-06T11:08:42.402071+0000","last_fullsized":"2023-10-06T11:08:42.402071+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.421792+0000","last_change":"2023-10-06T11:08:42.428676+0000","last_active":"2023-10-06T11:08:43.421792+0000","last_peered":"2023-10-06T11:08:43.421792+0000","last_clean":"2023-10-06T11:08:43.421792+0000","last_became_active":"2023-10-06T11:08:42.428426+0000","last_became_peered":"2023-10-06T11:08:42.428426+0000","last_unstale":"2023-10-06T11:08:43.421792+0000","last_undegraded":"2023-10-06T11:08:43.421792+0000","last_fullsized":"2023-10-06T11:08:43.421792+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:07:15.648736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.421780+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:08:43.421780+0000","last_peered":"2023-10-06T11:08:43.421780+0000","last_clean":"2023-10-06T11:08:43.421780+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:08:43.421780+0000","last_undegraded":"2023-10-06T11:08:43.421780+0000","last_fullsized":"2023-10-06T11:08:43.421780+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.434698+0000","last_change":"2023-10-06T11:08:43.431756+0000","last_active":"2023-10-06T11:08:43.434698+0000","last_peered":"2023-10-06T11:08:43.434698+0000","last_clean":"2023-10-06T11:08:43.434698+0000","last_became_active":"2023-10-06T11:08:43.431105+0000","last_became_peered":"2023-10-06T11:08:43.431105+0000","last_unstale":"2023-10-06T11:08:43.434698+0000","last_undegraded":"2023-10-06T11:08:43.434698+0000","last_fullsized":"2023-10-06T11:08:43.434698+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:33.013845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.407235+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:59:13.774226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":39,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.415532+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:08:43.415532+0000","last_peered":"2023-10-06T11:08:43.415532+0000","last_clean":"2023-10-06T11:08:43.415532+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:08:43.415532+0000","last_undegraded":"2023-10-06T11:08:43.415532+0000","last_fullsized":"2023-10-06T11:08:43.415532+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.429728+0000","last_change":"2023-10-06T11:08:43.428796+0000","last_active":"2023-10-06T11:08:43.429728+0000","last_peered":"2023-10-06T11:08:43.429728+0000","last_clean":"2023-10-06T11:08:43.429728+0000","last_became_active":"2023-10-06T11:08:43.424121+0000","last_became_peered":"2023-10-06T11:08:43.424121+0000","last_unstale":"2023-10-06T11:08:43.429728+0000","last_undegraded":"2023-10-06T11:08:43.429728+0000","last_fullsized":"2023-10-06T11:08:43.429728+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:06:21.706780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.415243+0000","last_change":"2023-10-06T11:08:42.426380+0000","last_active":"2023-10-06T11:08:43.415243+0000","last_peered":"2023-10-06T11:08:43.415243+0000","last_clean":"2023-10-06T11:08:43.415243+0000","last_became_active":"2023-10-06T11:08:42.426061+0000","last_became_peered":"2023-10-06T11:08:42.426061+0000","last_unstale":"2023-10-06T11:08:43.415243+0000","last_undegraded":"2023-10-06T11:08:43.415243+0000","last_fullsized":"2023-10-06T11:08:43.415243+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:31:32.728096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":35,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T11:08:38.495549+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:08:38.495549+0000","last_peered":"2023-10-06T11:08:38.495549+0000","last_clean":"2023-10-06T11:08:38.495549+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:08:38.495549+0000","last_undegraded":"2023-10-06T11:08:38.495549+0000","last_fullsized":"2023-10-06T11:08:38.495549+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.433687+0000","last_change":"2023-10-06T11:08:43.423239+0000","last_active":"2023-10-06T11:08:43.433687+0000","last_peered":"2023-10-06T11:08:43.433687+0000","last_clean":"2023-10-06T11:08:43.433687+0000","last_became_active":"2023-10-06T11:08:43.422974+0000","last_became_peered":"2023-10-06T11:08:43.422974+0000","last_unstale":"2023-10-06T11:08:43.433687+0000","last_undegraded":"2023-10-06T11:08:43.433687+0000","last_fullsized":"2023-10-06T11:08:43.433687+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:56:57.888412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:08:41.392622+0000","last_change":"2023-10-06T11:08:41.405542+0000","last_active":"2023-10-06T11:08:41.392622+0000","last_peered":"2023-10-06T11:08:41.392622+0000","last_clean":"2023-10-06T11:08:41.392622+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:08:41.392622+0000","last_undegraded":"2023-10-06T11:08:41.392622+0000","last_fullsized":"2023-10-06T11:08:41.392622+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:43.267112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":35,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-10-06T11:08:38.495552+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:08:38.495552+0000","last_peered":"2023-10-06T11:08:38.495552+0000","last_clean":"2023-10-06T11:08:38.495552+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:08:38.495552+0000","last_undegraded":"2023-10-06T11:08:38.495552+0000","last_fullsized":"2023-10-06T11:08:38.495552+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":1682,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25,"ondisk_log_size":25,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":86,"acting":86,"num_store_stats":5},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574889,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298416,"kb_used_data":1128,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073424,"statfs":{"total":96636764160,"available":96331186176,"internally_reserved":0,"allocated":1155072,"data_stored":829993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":1.871,"5min":0.73999999999999999,"15min":0.56999999999999995},"min":{"1min":0.41199999999999998,"5min":0.248,"15min":0.248},"max":{"1min":23.908999999999999,"5min":23.908999999999999,"15min":23.908999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":1.127,"5min":0.629,"15min":0.56499999999999995},"min":{"1min":0.374,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":9.0600000000000005,"5min":9.0600000000000005,"15min":9.0600000000000005},"last":0.52500000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":0.63900000000000001,"15min":0.57099999999999995},"min":{"1min":0.40899999999999997,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":9.2360000000000007,"5min":9.2360000000000007,"15min":9.2360000000000007},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.53900000000000003,"15min":0.51600000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":4.327,"5min":4.327,"15min":4.327},"last":0.53400000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.504,"15min":0.50900000000000001},"min":{"1min":0.311,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.505},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.59599999999999997,"15min":0.55800000000000005},"min":{"1min":0.436,"5min":0.309,"15min":0.309},"max":{"1min":4.7309999999999999,"5min":4.7309999999999999,"15min":4.7309999999999999},"last":0.64000000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.55400000000000005,"15min":0.51400000000000001},"min":{"1min":0.35299999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":4.3540000000000001,"5min":4.3540000000000001,"15min":4.3540000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":1.1870000000000001,"5min":0.67300000000000004,"15min":0.59999999999999998},"min":{"1min":0.45300000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":9.3879999999999999,"5min":9.3879999999999999,"15min":9.3879999999999999},"last":0.60899999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.50800000000000001,"15min":0.47499999999999998},"min":{"1min":0.34100000000000003,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":4.5709999999999997,"5min":4.5709999999999997,"15min":4.5709999999999997},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.753,"5min":0.55800000000000005,"15min":0.53500000000000003},"min":{"1min":0.33100000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":4.3129999999999997,"5min":4.3129999999999997,"15min":4.3129999999999997},"last":0.33100000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":0.64100000000000001,"15min":0.58099999999999996},"min":{"1min":0.34200000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":9.3499999999999996,"5min":9.3499999999999996,"15min":9.3499999999999996},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.58299999999999996,"15min":0.56699999999999995},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":4.444,"5min":4.444,"15min":4.444},"last":0.35099999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":0.67300000000000004,"15min":0.622},"min":{"1min":0.39700000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":9.4969999999999999,"5min":9.4969999999999999,"15min":9.4969999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.66200000000000003,"15min":0.62},"min":{"1min":0.44800000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":7.2039999999999997,"5min":7.2039999999999997,"15min":7.2039999999999997},"last":0.46100000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574890,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310076,"kb_used_data":500,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061764,"statfs":{"total":96636764160,"available":96319246336,"internally_reserved":0,"allocated":512000,"data_stored":217775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.48199999999999998,"15min":0.497},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52100000000000002,"15min":0.53300000000000003},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.52400000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.48299999999999998,"15min":0.499},"min":{"1min":0.34100000000000003,"5min":0.253,"15min":0.253},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.504},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48499999999999999,"15min":0.499},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.76400000000000001,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.624}]},{"osd":2,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.53100000000000003,"15min":0.498},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":7.0659999999999998,"5min":7.0659999999999998,"15min":7.0659999999999998},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.56100000000000005,"15min":0.52900000000000003},"min":{"1min":0.32500000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":7.0819999999999999,"5min":7.0819999999999999,"15min":7.0819999999999999},"last":0.57899999999999996}]},{"osd":3,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.49399999999999999,"15min":0.49299999999999999},"min":{"1min":0.32600000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.52700000000000002,"15min":0.53600000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.72799999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.64500000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.48699999999999999,"15min":0.50700000000000001},"min":{"1min":0.29599999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.64300000000000002,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54300000000000004,"15min":0.56799999999999995},"min":{"1min":0.32100000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.77100000000000002,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.72199999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52200000000000002,"15min":0.53800000000000003},"min":{"1min":0.307,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.75},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56299999999999994,"15min":0.58699999999999997},"min":{"1min":0.39500000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.79000000000000004,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.79000000000000004}]},{"osd":7,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56200000000000006,"15min":0.57699999999999996},"min":{"1min":0.36899999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79500000000000004,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.624,"5min":0.58999999999999997,"15min":0.60699999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83899999999999997,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.80800000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574889,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306564,"kb_used_data":1084,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065276,"statfs":{"total":96636764160,"available":96322842624,"internally_reserved":0,"allocated":1110016,"data_stored":809496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:39 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33100000000000002,"15min":0.34100000000000003},"min":{"1min":0.216,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.46000000000000002,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.316},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.34000000000000002,"15min":0.34399999999999997},"min":{"1min":0.26900000000000002,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.48799999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.30299999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:08:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.33600000000000002,"15min":0.33400000000000002},"min":{"1min":0.27300000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.5,"5min":0.505,"15min":0.505},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.435,"5min":0.38700000000000001,"15min":0.38600000000000001},"min":{"1min":0.251,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.38700000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:08:39 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.29599999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.60299999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.372,"15min":0.36599999999999999},"min":{"1min":0.30499999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.55400000000000005,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.40100000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:08:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.51600000000000001,"15min":0.503},"min":{"1min":0.42499999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.54600000000000004,"15min":0.53600000000000003},"min":{"1min":0.39900000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.752,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.63300000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:08:39 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.55300000000000005,"15min":0.54700000000000004},"min":{"1min":0.438,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.54800000000000004,"15min":0.53600000000000003},"min":{"1min":0.46400000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.80600000000000005,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.59199999999999997}]},{"osd":6,"last update":"Fri Oct 6 11:08:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.56799999999999995,"15min":0.56100000000000005},"min":{"1min":0.45500000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.57599999999999996,"15min":0.56899999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84899999999999998,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.61899999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:08:39 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.59099999999999997,"15min":0.58699999999999997},"min":{"1min":0.441,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.86199999999999999,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.58299999999999996,"15min":0.57999999999999996},"min":{"1min":0.41099999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.77600000000000002,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.57699999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297832,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074008,"statfs":{"total":96636764160,"available":96331784192,"internally_reserved":0,"allocated":557056,"data_stored":238204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32700000000000001,"15min":0.33300000000000002},"min":{"1min":0.223,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.503,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.34200000000000003,"15min":0.34100000000000003},"min":{"1min":0.246,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.24099999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.371,"15min":0.377},"min":{"1min":0.27400000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.435,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36099999999999999,"15min":0.36599999999999999},"min":{"1min":0.27200000000000002,"5min":0.219,"15min":0.219},"max":{"1min":0.46100000000000002,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.311}]},{"osd":3,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.371,"15min":0.373},"min":{"1min":0.26500000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.432,"15min":0.438},"min":{"1min":0.33000000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.55700000000000005,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.34200000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.55900000000000005,"15min":0.56000000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.60799999999999998,"15min":0.61499999999999999},"min":{"1min":0.36199999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.83999999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.75900000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54700000000000004,"15min":0.55100000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67900000000000005,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.55100000000000005,"15min":0.54500000000000004},"min":{"1min":0.40000000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.67900000000000005}]},{"osd":6,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60399999999999998,"15min":0.61199999999999999},"min":{"1min":0.432,"5min":0.375,"15min":0.375},"max":{"1min":0.84499999999999997,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60099999999999998,"15min":0.60499999999999998},"min":{"1min":0.42399999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.57999999999999996}]},{"osd":7,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59799999999999998,"15min":0.60499999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.81299999999999994,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.62},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.42099999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.70199999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574890,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310124,"kb_used_data":548,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061716,"statfs":{"total":96636764160,"available":96319197184,"internally_reserved":0,"allocated":561152,"data_stored":239684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.309,"15min":0.309},"min":{"1min":0.22500000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.437,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38100000000000001,"15min":0.38500000000000001},"min":{"1min":0.26900000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.51400000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.495}]},{"osd":1,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36899999999999999,"15min":0.375},"min":{"1min":0.24399999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.35399999999999998,"15min":0.34799999999999998},"min":{"1min":0.26900000000000002,"5min":0.217,"15min":0.217},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.45700000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.37,"15min":0.373},"min":{"1min":0.27800000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.438},{"interface":"front","average":{"1min":0.373,"5min":0.36499999999999999,"15min":0.36699999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.378}]},{"osd":4,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.33900000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.38900000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.58699999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.55200000000000005,"15min":0.55000000000000004},"min":{"1min":0.374,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.625},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.41799999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.67000000000000004}]},{"osd":6,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58299999999999996,"15min":0.58399999999999996},"min":{"1min":0.43099999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41399999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.68400000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.55900000000000005,"15min":0.55000000000000004},"min":{"1min":0.436,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.57099999999999995,"15min":0.56999999999999995},"min":{"1min":0.38600000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.70299999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574890,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310128,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061712,"statfs":{"total":96636764160,"available":96319193088,"internally_reserved":0,"allocated":565248,"data_stored":239706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.315,"15min":0.32800000000000001},"min":{"1min":0.248,"5min":0.188,"15min":0.188},"max":{"1min":0.46500000000000002,"5min":1.095,"15min":1.095},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38900000000000001,"15min":0.40500000000000003},"min":{"1min":0.29999999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.50600000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.39500000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.314,"15min":0.309},"min":{"1min":0.255,"5min":0.219,"15min":0.219},"max":{"1min":0.47499999999999998,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.36699999999999999,"15min":0.373},"min":{"1min":0.26500000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.51500000000000001,"5min":1.196,"15min":1.196},"last":0.36799999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.38100000000000001,"15min":0.39400000000000002},"min":{"1min":0.24199999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.54500000000000004,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.31},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.42399999999999999},"min":{"1min":0.33700000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.55900000000000005,"5min":1.224,"15min":1.224},"last":0.40999999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.55700000000000005,"15min":0.57499999999999996},"min":{"1min":0.38200000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.92500000000000004,"5min":1.694,"15min":1.694},"last":0.627},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53800000000000003,"15min":0.54500000000000004},"min":{"1min":0.36599999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.78200000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.41599999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55700000000000005,"15min":0.56599999999999995},"min":{"1min":0.39200000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.82199999999999995,"5min":1.165,"15min":1.165},"last":0.82199999999999995}]},{"osd":6,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58499999999999996,"15min":0.59499999999999997},"min":{"1min":0.40200000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.89900000000000002,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.59399999999999997,"15min":0.60499999999999998},"min":{"1min":0.45400000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83399999999999996,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.83399999999999996}]},{"osd":7,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58299999999999996,"15min":0.59699999999999998},"min":{"1min":0.40999999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84799999999999998,"5min":1.657,"15min":1.657},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.57099999999999995,"15min":0.57399999999999995},"min":{"1min":0.46700000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.68200000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310080,"kb_used_data":504,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061760,"statfs":{"total":96636764160,"available":96319242240,"internally_reserved":0,"allocated":516096,"data_stored":219128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:07:42 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.57699999999999996,"15min":0.61299999999999999},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.62,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.48799999999999999,"15min":0.501},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.65500000000000003,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.439}]},{"osd":1,"last update":"Fri Oct 6 11:07:42 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.60799999999999998,"15min":0.63900000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.60399999999999998,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.436,"5min":0.61199999999999999,"15min":0.64100000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.67500000000000004,"5min":2.7610000000000001,"15min":2.7610000000000001},"last":0.52700000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:07:42 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.56999999999999995,"15min":0.59099999999999997},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.69099999999999995,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.377},{"interface":"front","average":{"1min":0.498,"5min":0.60599999999999998,"15min":0.624},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69299999999999995,"5min":1.718,"15min":1.718},"last":0.497}]},{"osd":3,"last update":"Fri Oct 6 11:07:42 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.63,"15min":0.65700000000000003},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.67700000000000005,"5min":2.677,"15min":2.677},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.51600000000000001,"15min":0.52600000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.63100000000000001,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.45400000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:07:42 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.48799999999999999,"15min":0.502},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.60499999999999998,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.44,"5min":0.53500000000000003,"15min":0.55100000000000005},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.64300000000000002,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.51300000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:07:42 2023","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.52300000000000002,"15min":0.53900000000000003},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.624,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.58099999999999996,"15min":0.60099999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.64700000000000002,"5min":1.165,"15min":1.165},"last":0.56499999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:07:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.54900000000000004,"15min":0.56100000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.63700000000000001,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.60099999999999998,"15min":0.61899999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.66100000000000003,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.57399999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310104,"kb_used_data":528,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061736,"statfs":{"total":96636764160,"available":96319217664,"internally_reserved":0,"allocated":540672,"data_stored":232860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.66600000000000004,"15min":0.72399999999999998},"min":{"1min":0.36199999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.71899999999999997,"5min":5.0490000000000004,"15min":5.0490000000000004},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.627,"15min":0.69299999999999995},"min":{"1min":0.254,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.755,"5min":5.1449999999999996,"15min":5.1449999999999996},"last":0.39000000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48999999999999999,"15min":0.49199999999999999},"min":{"1min":0.315,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.70699999999999996,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.70699999999999996,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.56000000000000005}]},{"osd":2,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.57999999999999996,"15min":0.56699999999999995},"min":{"1min":0.379,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.81799999999999995,"5min":4.234,"15min":4.234},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56899999999999995,"15min":0.57799999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76600000000000001,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.59899999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.66700000000000004,"15min":0.74399999999999999},"min":{"1min":0.29299999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.72099999999999997,"5min":5.2169999999999996,"15min":5.2169999999999996},"last":0.438},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55100000000000005,"15min":0.55500000000000005},"min":{"1min":0.39600000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.83399999999999996,"5min":1.008,"15min":1.008},"last":0.53300000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.52900000000000003,"15min":0.53800000000000003},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.871,"5min":1.917,"15min":1.917},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.53800000000000003,"15min":0.55500000000000005},"min":{"1min":0.27200000000000002,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.85499999999999998,"5min":0.87,"15min":0.87},"last":0.50900000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.34899999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.89500000000000002,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.624,"15min":0.63200000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.92300000000000004,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":0.64400000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58999999999999997,"15min":0.60899999999999999},"min":{"1min":0.32100000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.84299999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.621,"15min":0.63},"min":{"1min":0.372,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.93899999999999995,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.629}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:08:50.255 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:08:50.257 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:08:51.994 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:08:52.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.121+0000 7f091546b700 1 Processor -- start 2023-10-06T11:08:52.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.121+0000 7f091546b700 1 -- start start 2023-10-06T11:08:52.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.121+0000 7f091546b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f09100b28e0 0x7f09100c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:52.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.121+0000 7f091546b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09100ad2a0 con 0x7f09100c53f0 2023-10-06T11:08:52.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.121+0000 7f091546b700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0910099ec0 con 0x7f09100cf2d0 2023-10-06T11:08:52.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.121+0000 7f091546b700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09100c7240 con 0x7f09100b28e0 2023-10-06T11:08:52.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.122+0000 7f09067fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f09100c53f0 0x7f09100cebc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35708/0 (socket says 172.21.15.146:35708) 2023-10-06T11:08:52.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.122+0000 7f09067fc700 1 -- 172.21.15.146:0/728408845 learned_addr learned my addr 172.21.15.146:0/728408845 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:08:52.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.122+0000 7f090effd700 1 --2- 172.21.15.146:0/728408845 >> v2:172.21.15.151:3300/0 conn(0x7f09100b28e0 0x7f09100c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:52.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.122+0000 7f090e7fc700 1 -- 172.21.15.146:0/728408845 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1399787671 0 0) 0x7f09100ad2a0 con 0x7f09100c53f0 2023-10-06T11:08:52.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.122+0000 7f090e7fc700 1 -- 172.21.15.146:0/728408845 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08fc003570 con 0x7f09100c53f0 2023-10-06T11:08:52.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.122+0000 7f090e7fc700 1 -- 172.21.15.146:0/728408845 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3540431987 0 0) 0x7f08fc003570 con 0x7f09100c53f0 2023-10-06T11:08:52.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.122+0000 7f090e7fc700 1 -- 172.21.15.146:0/728408845 >> v2:172.21.15.151:3300/0 conn(0x7f09100b28e0 msgr2=0x7f09100c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:52.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.122+0000 7f090e7fc700 1 --2- 172.21.15.146:0/728408845 >> v2:172.21.15.151:3300/0 conn(0x7f09100b28e0 0x7f09100c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:52.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.122+0000 7f090e7fc700 1 -- 172.21.15.146:0/728408845 >> v1:172.21.15.151:6789/0 conn(0x7f09100cf2d0 legacy=0x7f09100ad730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:52.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.122+0000 7f090e7fc700 1 -- 172.21.15.146:0/728408845 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09100c69a0 con 0x7f09100c53f0 2023-10-06T11:08:52.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.122+0000 7f090e7fc700 1 -- 172.21.15.146:0/728408845 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f08f8001470 con 0x7f09100c53f0 2023-10-06T11:08:52.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.122+0000 7f090e7fc700 1 -- 172.21.15.146:0/728408845 >> v1:172.21.15.146:6789/0 conn(0x7f09100c53f0 legacy=0x7f09100cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:52.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.122+0000 7f090e7fc700 1 --2- 172.21.15.146:0/728408845 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f08fc003a60 0x7f08fc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:52.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.122+0000 7f090e7fc700 1 --2- 172.21.15.146:0/728408845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08fc004810 0x7f08fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:52.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.122+0000 7f090e7fc700 1 --2- 172.21.15.146:0/728408845 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08fc0051c0 0x7f08fc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:52.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.122+0000 7f090e7fc700 1 -- 172.21.15.146:0/728408845 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09100c7240 con 0x7f08fc004810 2023-10-06T11:08:52.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.122+0000 7f090e7fc700 1 -- 172.21.15.146:0/728408845 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc00c0d0 con 0x7f08fc0051c0 2023-10-06T11:08:52.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.122+0000 7f090e7fc700 1 -- 172.21.15.146:0/728408845 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc00c290 con 0x7f08fc003a60 2023-10-06T11:08:52.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.122+0000 7f090effd700 1 --2- 172.21.15.146:0/728408845 >> v2:172.21.15.151:3300/0 conn(0x7f09100b28e0 0x7f09100c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:08:52.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.122+0000 7f09067fc700 1 --2- 172.21.15.146:0/728408845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08fc004810 0x7f08fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:52.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.122+0000 7f090f7fe700 1 --2- 172.21.15.146:0/728408845 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08fc0051c0 0x7f08fc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:52.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.123+0000 7f090effd700 1 --2- 172.21.15.146:0/728408845 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f08fc003a60 0x7f08fc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:52.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.123+0000 7f09067fc700 1 -- 172.21.15.146:0/728408845 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f08fc003a60 msgr2=0x7f08fc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:52.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.123+0000 7f09067fc700 1 --2- 172.21.15.146:0/728408845 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f08fc003a60 0x7f08fc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:52.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.123+0000 7f09067fc700 1 -- 172.21.15.146:0/728408845 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08fc0051c0 msgr2=0x7f08fc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:52.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.123+0000 7f09067fc700 1 --2- 172.21.15.146:0/728408845 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08fc0051c0 0x7f08fc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:52.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.123+0000 7f090f7fe700 1 -- 172.21.15.146:0/728408845 reap_dead start 2023-10-06T11:08:52.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.123+0000 7f09067fc700 1 -- 172.21.15.146:0/728408845 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08fc003570 con 0x7f08fc004810 2023-10-06T11:08:52.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.123+0000 7f090effd700 1 --2- 172.21.15.146:0/728408845 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f08fc003a60 0x7f08fc003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:08:52.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.123+0000 7f09067fc700 1 --2- 172.21.15.146:0/728408845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08fc004810 0x7f08fc004c80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f08f800c390 tx=0x7f09100ad100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a111c386a64c6e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:52.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.123+0000 7f090e7fc700 1 -- 172.21.15.146:0/728408845 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f800cc60 con 0x7f08fc004810 2023-10-06T11:08:52.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.123+0000 7f090e7fc700 1 -- 172.21.15.146:0/728408845 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f800cdc0 con 0x7f08fc004810 2023-10-06T11:08:52.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.123+0000 7f090e7fc700 1 -- 172.21.15.146:0/728408845 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f8005b70 con 0x7f08fc004810 2023-10-06T11:08:52.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.123+0000 7f091546b700 1 -- 172.21.15.146:0/728408845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08fc004810 msgr2=0x7f08fc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:52.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.123+0000 7f091546b700 1 --2- 172.21.15.146:0/728408845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08fc004810 0x7f08fc004c80 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f08f800c390 tx=0x7f09100ad100 comp rx=0 tx=0).stop 2023-10-06T11:08:52.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.123+0000 7f091546b700 1 -- 172.21.15.146:0/728408845 shutdown_connections 2023-10-06T11:08:52.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.123+0000 7f091546b700 1 --2- 172.21.15.146:0/728408845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08fc004810 0x7f08fc004c80 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:52.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.123+0000 7f091546b700 1 -- 172.21.15.146:0/728408845 >> 172.21.15.146:0/728408845 conn(0x7f09100999a0 msgr2=0x7f091006f380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:52.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.124+0000 7f091546b700 1 -- 172.21.15.146:0/728408845 shutdown_connections 2023-10-06T11:08:52.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.124+0000 7f091546b700 1 -- 172.21.15.146:0/728408845 wait complete. 2023-10-06T11:08:52.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.125+0000 7f091546b700 1 Processor -- start 2023-10-06T11:08:52.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.125+0000 7f091546b700 1 -- start start 2023-10-06T11:08:52.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.126+0000 7f091546b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08fc004810 0x7f09100c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:52.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.126+0000 7f091546b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0910155810 0x7f09100c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:52.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.126+0000 7f091546b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09100b5cf0 0x7f09100cc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:52.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.126+0000 7f091546b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09100c7c10 con 0x7f08fc004810 2023-10-06T11:08:52.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.126+0000 7f091546b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0910155c80 con 0x7f09100b5cf0 2023-10-06T11:08:52.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.126+0000 7f091546b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09100c85e0 con 0x7f0910155810 2023-10-06T11:08:52.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.126+0000 7f090effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08fc004810 0x7f09100c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:52.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.126+0000 7f090effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08fc004810 0x7f09100c8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34546/0 (socket says 172.21.15.146:34546) 2023-10-06T11:08:52.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.126+0000 7f090effd700 1 -- 172.21.15.146:0/2562093657 learned_addr learned my addr 172.21.15.146:0/2562093657 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:52.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.126+0000 7f09067fc700 1 --2- 172.21.15.146:0/2562093657 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0910155810 0x7f09100c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:52.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.126+0000 7f090f7fe700 1 --2- 172.21.15.146:0/2562093657 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09100b5cf0 0x7f09100cc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:52.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.126+0000 7f090effd700 1 -- 172.21.15.146:0/2562093657 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0910155810 msgr2=0x7f09100c80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:52.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.126+0000 7f090effd700 1 --2- 172.21.15.146:0/2562093657 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0910155810 0x7f09100c80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:52.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.126+0000 7f090effd700 1 -- 172.21.15.146:0/2562093657 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09100b5cf0 msgr2=0x7f09100cc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:52.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.126+0000 7f090effd700 1 --2- 172.21.15.146:0/2562093657 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09100b5cf0 0x7f09100cc8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:52.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.126+0000 7f090effd700 1 -- 172.21.15.146:0/2562093657 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09100c9520 con 0x7f08fc004810 2023-10-06T11:08:52.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.126+0000 7f09067fc700 1 --2- 172.21.15.146:0/2562093657 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0910155810 0x7f09100c80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:08:52.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.126+0000 7f090effd700 1 --2- 172.21.15.146:0/2562093657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08fc004810 0x7f09100c8f40 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f0900011940 tx=0x7f0900008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:52.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.126+0000 7f09077fe700 1 -- 172.21.15.146:0/2562093657 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0900011e80 con 0x7f08fc004810 2023-10-06T11:08:52.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.126+0000 7f09077fe700 1 -- 172.21.15.146:0/2562093657 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090000f8e0 con 0x7f08fc004810 2023-10-06T11:08:52.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.126+0000 7f09077fe700 1 -- 172.21.15.146:0/2562093657 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090000fca0 con 0x7f08fc004810 2023-10-06T11:08:52.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.126+0000 7f091546b700 1 -- 172.21.15.146:0/2562093657 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09100c9800 con 0x7f08fc004810 2023-10-06T11:08:52.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.126+0000 7f091546b700 1 -- 172.21.15.146:0/2562093657 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09100c78a0 con 0x7f08fc004810 2023-10-06T11:08:52.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.127+0000 7f091546b700 1 -- 172.21.15.146:0/2562093657 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09100c76e0 con 0x7f08fc004810 2023-10-06T11:08:52.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.128+0000 7f09077fe700 1 -- 172.21.15.146:0/2562093657 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0900015670 con 0x7f08fc004810 2023-10-06T11:08:52.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.128+0000 7f09077fe700 1 --2- 172.21.15.146:0/2562093657 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f08f0066f30 0x7f08f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:52.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.128+0000 7f09077fe700 1 -- 172.21.15.146:0/2562093657 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0900084f30 con 0x7f08fc004810 2023-10-06T11:08:52.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.128+0000 7f09067fc700 1 --2- 172.21.15.146:0/2562093657 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f08f0066f30 0x7f08f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:52.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.128+0000 7f09067fc700 1 --2- 172.21.15.146:0/2562093657 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f08f0066f30 0x7f08f00693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f08f8007cd0 tx=0x7f08f8015000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:52.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.132+0000 7f09077fe700 1 -- 172.21.15.146:0/2562093657 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0900052040 con 0x7f08fc004810 2023-10-06T11:08:52.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.312+0000 7f091546b700 1 -- 172.21.15.146:0/2562093657 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f09100c7d50 con 0x7f08f0066f30 2023-10-06T11:08:52.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.321+0000 7f09077fe700 1 -- 172.21.15.146:0/2562093657 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311263 (secure 0 0 0) 0x7f08f8000c30 con 0x7f08f0066f30 2023-10-06T11:08:52.326 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:08:52.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.324+0000 7f091546b700 1 -- 172.21.15.146:0/2562093657 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f08f0066f30 msgr2=0x7f08f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:52.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.324+0000 7f091546b700 1 --2- 172.21.15.146:0/2562093657 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f08f0066f30 0x7f08f00693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f08f8007cd0 tx=0x7f08f8015000 comp rx=0 tx=0).stop 2023-10-06T11:08:52.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.324+0000 7f091546b700 1 -- 172.21.15.146:0/2562093657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08fc004810 msgr2=0x7f09100c8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:52.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.324+0000 7f091546b700 1 --2- 172.21.15.146:0/2562093657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08fc004810 0x7f09100c8f40 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f0900011940 tx=0x7f0900008040 comp rx=0 tx=0).stop 2023-10-06T11:08:52.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.325+0000 7f091546b700 1 -- 172.21.15.146:0/2562093657 shutdown_connections 2023-10-06T11:08:52.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.325+0000 7f091546b700 1 --2- 172.21.15.146:0/2562093657 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f08f0066f30 0x7f08f00693e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:52.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.325+0000 7f091546b700 1 --2- 172.21.15.146:0/2562093657 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09100b5cf0 0x7f09100cc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:52.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.325+0000 7f091546b700 1 --2- 172.21.15.146:0/2562093657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f08fc004810 0x7f09100c8f40 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:52.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.325+0000 7f091546b700 1 --2- 172.21.15.146:0/2562093657 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0910155810 0x7f09100c80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:52.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.325+0000 7f091546b700 1 -- 172.21.15.146:0/2562093657 >> 172.21.15.146:0/2562093657 conn(0x7f09100999a0 msgr2=0x7f0910068510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:52.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.325+0000 7f091546b700 1 -- 172.21.15.146:0/2562093657 shutdown_connections 2023-10-06T11:08:52.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.325+0000 7f091546b700 1 -- 172.21.15.146:0/2562093657 wait complete. 2023-10-06T11:08:52.330 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:08:52.338 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2023-10-06T11:08:51.180326+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2453452,"kb_used_data":5516,"kb_used_omap":0,"kb_used_meta":2447872,"kb_avail":752521268,"statfs":{"total":773094113280,"available":770581778432,"internally_reserved":0,"allocated":5648384,"data_stored":3089303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2506620928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001731"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.427917+0000","last_change":"2023-10-06T11:08:43.418658+0000","last_active":"2023-10-06T11:08:43.427917+0000","last_peered":"2023-10-06T11:08:43.427917+0000","last_clean":"2023-10-06T11:08:43.427917+0000","last_became_active":"2023-10-06T11:08:43.418248+0000","last_became_peered":"2023-10-06T11:08:43.418248+0000","last_unstale":"2023-10-06T11:08:43.427917+0000","last_undegraded":"2023-10-06T11:08:43.427917+0000","last_fullsized":"2023-10-06T11:08:43.427917+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:33:09.554346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.437128+0000","last_change":"2023-10-06T11:08:43.429477+0000","last_active":"2023-10-06T11:08:43.437128+0000","last_peered":"2023-10-06T11:08:43.437128+0000","last_clean":"2023-10-06T11:08:43.437128+0000","last_became_active":"2023-10-06T11:08:43.429245+0000","last_became_peered":"2023-10-06T11:08:43.429245+0000","last_unstale":"2023-10-06T11:08:43.437128+0000","last_undegraded":"2023-10-06T11:08:43.437128+0000","last_fullsized":"2023-10-06T11:08:43.437128+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:30.771237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.434216+0000","last_change":"2023-10-06T11:08:43.425499+0000","last_active":"2023-10-06T11:08:43.434216+0000","last_peered":"2023-10-06T11:08:43.434216+0000","last_clean":"2023-10-06T11:08:43.434216+0000","last_became_active":"2023-10-06T11:08:43.425262+0000","last_became_peered":"2023-10-06T11:08:43.425262+0000","last_unstale":"2023-10-06T11:08:43.434216+0000","last_undegraded":"2023-10-06T11:08:43.434216+0000","last_fullsized":"2023-10-06T11:08:43.434216+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:04:54.615565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.437292+0000","last_change":"2023-10-06T11:08:43.433555+0000","last_active":"2023-10-06T11:08:43.437292+0000","last_peered":"2023-10-06T11:08:43.437292+0000","last_clean":"2023-10-06T11:08:43.437292+0000","last_became_active":"2023-10-06T11:08:43.429961+0000","last_became_peered":"2023-10-06T11:08:43.429961+0000","last_unstale":"2023-10-06T11:08:43.437292+0000","last_undegraded":"2023-10-06T11:08:43.437292+0000","last_fullsized":"2023-10-06T11:08:43.437292+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:45:44.809943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.426858+0000","last_change":"2023-10-06T11:08:43.425513+0000","last_active":"2023-10-06T11:08:43.426858+0000","last_peered":"2023-10-06T11:08:43.426858+0000","last_clean":"2023-10-06T11:08:43.426858+0000","last_became_active":"2023-10-06T11:08:43.424888+0000","last_became_peered":"2023-10-06T11:08:43.424888+0000","last_unstale":"2023-10-06T11:08:43.426858+0000","last_undegraded":"2023-10-06T11:08:43.426858+0000","last_fullsized":"2023-10-06T11:08:43.426858+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:29.015502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.438612+0000","last_change":"2023-10-06T11:08:43.432568+0000","last_active":"2023-10-06T11:08:43.438612+0000","last_peered":"2023-10-06T11:08:43.438612+0000","last_clean":"2023-10-06T11:08:43.438612+0000","last_became_active":"2023-10-06T11:08:43.432307+0000","last_became_peered":"2023-10-06T11:08:43.432307+0000","last_unstale":"2023-10-06T11:08:43.438612+0000","last_undegraded":"2023-10-06T11:08:43.438612+0000","last_fullsized":"2023-10-06T11:08:43.438612+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:06:39.375750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435566+0000","last_change":"2023-10-06T11:08:43.424718+0000","last_active":"2023-10-06T11:08:43.435566+0000","last_peered":"2023-10-06T11:08:43.435566+0000","last_clean":"2023-10-06T11:08:43.435566+0000","last_became_active":"2023-10-06T11:08:43.424156+0000","last_became_peered":"2023-10-06T11:08:43.424156+0000","last_unstale":"2023-10-06T11:08:43.435566+0000","last_undegraded":"2023-10-06T11:08:43.435566+0000","last_fullsized":"2023-10-06T11:08:43.435566+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:52:09.529056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.429675+0000","last_change":"2023-10-06T11:08:43.428465+0000","last_active":"2023-10-06T11:08:43.429675+0000","last_peered":"2023-10-06T11:08:43.429675+0000","last_clean":"2023-10-06T11:08:43.429675+0000","last_became_active":"2023-10-06T11:08:43.427865+0000","last_became_peered":"2023-10-06T11:08:43.427865+0000","last_unstale":"2023-10-06T11:08:43.429675+0000","last_undegraded":"2023-10-06T11:08:43.429675+0000","last_fullsized":"2023-10-06T11:08:43.429675+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:23.831368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435190+0000","last_change":"2023-10-06T11:08:43.431433+0000","last_active":"2023-10-06T11:08:43.435190+0000","last_peered":"2023-10-06T11:08:43.435190+0000","last_clean":"2023-10-06T11:08:43.435190+0000","last_became_active":"2023-10-06T11:08:43.430675+0000","last_became_peered":"2023-10-06T11:08:43.430675+0000","last_unstale":"2023-10-06T11:08:43.435190+0000","last_undegraded":"2023-10-06T11:08:43.435190+0000","last_fullsized":"2023-10-06T11:08:43.435190+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:04:54.615565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.426384+0000","last_change":"2023-10-06T11:08:43.417096+0000","last_active":"2023-10-06T11:08:43.426384+0000","last_peered":"2023-10-06T11:08:43.426384+0000","last_clean":"2023-10-06T11:08:43.426384+0000","last_became_active":"2023-10-06T11:08:43.416839+0000","last_became_peered":"2023-10-06T11:08:43.416839+0000","last_unstale":"2023-10-06T11:08:43.426384+0000","last_undegraded":"2023-10-06T11:08:43.426384+0000","last_fullsized":"2023-10-06T11:08:43.426384+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:32:10.882469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.439131+0000","last_change":"2023-10-06T11:08:43.430750+0000","last_active":"2023-10-06T11:08:43.439131+0000","last_peered":"2023-10-06T11:08:43.439131+0000","last_clean":"2023-10-06T11:08:43.439131+0000","last_became_active":"2023-10-06T11:08:43.430457+0000","last_became_peered":"2023-10-06T11:08:43.430457+0000","last_unstale":"2023-10-06T11:08:43.439131+0000","last_undegraded":"2023-10-06T11:08:43.439131+0000","last_fullsized":"2023-10-06T11:08:43.439131+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:46.781626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.429682+0000","last_change":"2023-10-06T11:08:43.426994+0000","last_active":"2023-10-06T11:08:43.429682+0000","last_peered":"2023-10-06T11:08:43.429682+0000","last_clean":"2023-10-06T11:08:43.429682+0000","last_became_active":"2023-10-06T11:08:43.426729+0000","last_became_peered":"2023-10-06T11:08:43.426729+0000","last_unstale":"2023-10-06T11:08:43.429682+0000","last_undegraded":"2023-10-06T11:08:43.429682+0000","last_fullsized":"2023-10-06T11:08:43.429682+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:08:40.633452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.426484+0000","last_change":"2023-10-06T11:08:43.422599+0000","last_active":"2023-10-06T11:08:43.426484+0000","last_peered":"2023-10-06T11:08:43.426484+0000","last_clean":"2023-10-06T11:08:43.426484+0000","last_became_active":"2023-10-06T11:08:43.422342+0000","last_became_peered":"2023-10-06T11:08:43.422342+0000","last_unstale":"2023-10-06T11:08:43.426484+0000","last_undegraded":"2023-10-06T11:08:43.426484+0000","last_fullsized":"2023-10-06T11:08:43.426484+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:36.617324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435568+0000","last_change":"2023-10-06T11:08:43.428408+0000","last_active":"2023-10-06T11:08:43.435568+0000","last_peered":"2023-10-06T11:08:43.435568+0000","last_clean":"2023-10-06T11:08:43.435568+0000","last_became_active":"2023-10-06T11:08:43.428142+0000","last_became_peered":"2023-10-06T11:08:43.428142+0000","last_unstale":"2023-10-06T11:08:43.435568+0000","last_undegraded":"2023-10-06T11:08:43.435568+0000","last_fullsized":"2023-10-06T11:08:43.435568+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:23.831368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.437137+0000","last_change":"2023-10-06T11:08:43.429906+0000","last_active":"2023-10-06T11:08:43.437137+0000","last_peered":"2023-10-06T11:08:43.437137+0000","last_clean":"2023-10-06T11:08:43.437137+0000","last_became_active":"2023-10-06T11:08:43.429640+0000","last_became_peered":"2023-10-06T11:08:43.429640+0000","last_unstale":"2023-10-06T11:08:43.437137+0000","last_undegraded":"2023-10-06T11:08:43.437137+0000","last_fullsized":"2023-10-06T11:08:43.437137+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:33:49.431732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.420813+0000","last_change":"2023-10-06T11:08:43.416061+0000","last_active":"2023-10-06T11:08:43.420813+0000","last_peered":"2023-10-06T11:08:43.420813+0000","last_clean":"2023-10-06T11:08:43.420813+0000","last_became_active":"2023-10-06T11:08:43.415794+0000","last_became_peered":"2023-10-06T11:08:43.415794+0000","last_unstale":"2023-10-06T11:08:43.420813+0000","last_undegraded":"2023-10-06T11:08:43.420813+0000","last_fullsized":"2023-10-06T11:08:43.420813+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:45:44.809943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.433510+0000","last_change":"2023-10-06T11:08:43.422104+0000","last_active":"2023-10-06T11:08:43.433510+0000","last_peered":"2023-10-06T11:08:43.433510+0000","last_clean":"2023-10-06T11:08:43.433510+0000","last_became_active":"2023-10-06T11:08:43.421669+0000","last_became_peered":"2023-10-06T11:08:43.421669+0000","last_unstale":"2023-10-06T11:08:43.433510+0000","last_undegraded":"2023-10-06T11:08:43.433510+0000","last_fullsized":"2023-10-06T11:08:43.433510+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:28.243301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.437180+0000","last_change":"2023-10-06T11:08:43.433205+0000","last_active":"2023-10-06T11:08:43.437180+0000","last_peered":"2023-10-06T11:08:43.437180+0000","last_clean":"2023-10-06T11:08:43.437180+0000","last_became_active":"2023-10-06T11:08:43.429348+0000","last_became_peered":"2023-10-06T11:08:43.429348+0000","last_unstale":"2023-10-06T11:08:43.437180+0000","last_undegraded":"2023-10-06T11:08:43.437180+0000","last_fullsized":"2023-10-06T11:08:43.437180+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:31:49.189518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.434252+0000","last_change":"2023-10-06T11:08:43.427751+0000","last_active":"2023-10-06T11:08:43.434252+0000","last_peered":"2023-10-06T11:08:43.434252+0000","last_clean":"2023-10-06T11:08:43.434252+0000","last_became_active":"2023-10-06T11:08:43.427469+0000","last_became_peered":"2023-10-06T11:08:43.427469+0000","last_unstale":"2023-10-06T11:08:43.434252+0000","last_undegraded":"2023-10-06T11:08:43.434252+0000","last_fullsized":"2023-10-06T11:08:43.434252+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:26.368790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.428583+0000","last_change":"2023-10-06T11:08:43.422515+0000","last_active":"2023-10-06T11:08:43.428583+0000","last_peered":"2023-10-06T11:08:43.428583+0000","last_clean":"2023-10-06T11:08:43.428583+0000","last_became_active":"2023-10-06T11:08:43.422138+0000","last_became_peered":"2023-10-06T11:08:43.422138+0000","last_unstale":"2023-10-06T11:08:43.428583+0000","last_undegraded":"2023-10-06T11:08:43.428583+0000","last_fullsized":"2023-10-06T11:08:43.428583+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:26:26.101252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.431075+0000","last_change":"2023-10-06T11:08:43.425130+0000","last_active":"2023-10-06T11:08:43.431075+0000","last_peered":"2023-10-06T11:08:43.431075+0000","last_clean":"2023-10-06T11:08:43.431075+0000","last_became_active":"2023-10-06T11:08:43.424867+0000","last_became_peered":"2023-10-06T11:08:43.424867+0000","last_unstale":"2023-10-06T11:08:43.431075+0000","last_undegraded":"2023-10-06T11:08:43.431075+0000","last_fullsized":"2023-10-06T11:08:43.431075+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:06:23.475398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435606+0000","last_change":"2023-10-06T11:08:43.431889+0000","last_active":"2023-10-06T11:08:43.435606+0000","last_peered":"2023-10-06T11:08:43.435606+0000","last_clean":"2023-10-06T11:08:43.435606+0000","last_became_active":"2023-10-06T11:08:43.431636+0000","last_became_peered":"2023-10-06T11:08:43.431636+0000","last_unstale":"2023-10-06T11:08:43.435606+0000","last_undegraded":"2023-10-06T11:08:43.435606+0000","last_fullsized":"2023-10-06T11:08:43.435606+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:27:02.499415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.431264+0000","last_change":"2023-10-06T11:08:43.426550+0000","last_active":"2023-10-06T11:08:43.431264+0000","last_peered":"2023-10-06T11:08:43.431264+0000","last_clean":"2023-10-06T11:08:43.431264+0000","last_became_active":"2023-10-06T11:08:43.426263+0000","last_became_peered":"2023-10-06T11:08:43.426263+0000","last_unstale":"2023-10-06T11:08:43.431264+0000","last_undegraded":"2023-10-06T11:08:43.431264+0000","last_fullsized":"2023-10-06T11:08:43.431264+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:29:00.361399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.433487+0000","last_change":"2023-10-06T11:08:43.423917+0000","last_active":"2023-10-06T11:08:43.433487+0000","last_peered":"2023-10-06T11:08:43.433487+0000","last_clean":"2023-10-06T11:08:43.433487+0000","last_became_active":"2023-10-06T11:08:43.423665+0000","last_became_peered":"2023-10-06T11:08:43.423665+0000","last_unstale":"2023-10-06T11:08:43.433487+0000","last_undegraded":"2023-10-06T11:08:43.433487+0000","last_fullsized":"2023-10-06T11:08:43.433487+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:06:21.706780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435638+0000","last_change":"2023-10-06T11:08:43.430289+0000","last_active":"2023-10-06T11:08:43.435638+0000","last_peered":"2023-10-06T11:08:43.435638+0000","last_clean":"2023-10-06T11:08:43.435638+0000","last_became_active":"2023-10-06T11:08:43.430041+0000","last_became_peered":"2023-10-06T11:08:43.430041+0000","last_unstale":"2023-10-06T11:08:43.435638+0000","last_undegraded":"2023-10-06T11:08:43.435638+0000","last_fullsized":"2023-10-06T11:08:43.435638+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:01:46.808227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.429634+0000","last_change":"2023-10-06T11:08:43.426790+0000","last_active":"2023-10-06T11:08:43.429634+0000","last_peered":"2023-10-06T11:08:43.429634+0000","last_clean":"2023-10-06T11:08:43.429634+0000","last_became_active":"2023-10-06T11:08:43.426546+0000","last_became_peered":"2023-10-06T11:08:43.426546+0000","last_unstale":"2023-10-06T11:08:43.429634+0000","last_undegraded":"2023-10-06T11:08:43.429634+0000","last_fullsized":"2023-10-06T11:08:43.429634+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:39:00.400333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.438503+0000","last_change":"2023-10-06T11:08:43.432148+0000","last_active":"2023-10-06T11:08:43.438503+0000","last_peered":"2023-10-06T11:08:43.438503+0000","last_clean":"2023-10-06T11:08:43.438503+0000","last_became_active":"2023-10-06T11:08:43.431869+0000","last_became_peered":"2023-10-06T11:08:43.431869+0000","last_unstale":"2023-10-06T11:08:43.438503+0000","last_undegraded":"2023-10-06T11:08:43.438503+0000","last_fullsized":"2023-10-06T11:08:43.438503+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:33.013845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.428604+0000","last_change":"2023-10-06T11:08:43.423916+0000","last_active":"2023-10-06T11:08:43.428604+0000","last_peered":"2023-10-06T11:08:43.428604+0000","last_clean":"2023-10-06T11:08:43.428604+0000","last_became_active":"2023-10-06T11:08:43.423646+0000","last_became_peered":"2023-10-06T11:08:43.423646+0000","last_unstale":"2023-10-06T11:08:43.428604+0000","last_undegraded":"2023-10-06T11:08:43.428604+0000","last_fullsized":"2023-10-06T11:08:43.428604+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:31:33.737545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435640+0000","last_change":"2023-10-06T11:08:43.432649+0000","last_active":"2023-10-06T11:08:43.435640+0000","last_peered":"2023-10-06T11:08:43.435640+0000","last_clean":"2023-10-06T11:08:43.435640+0000","last_became_active":"2023-10-06T11:08:43.432398+0000","last_became_peered":"2023-10-06T11:08:43.432398+0000","last_unstale":"2023-10-06T11:08:43.435640+0000","last_undegraded":"2023-10-06T11:08:43.435640+0000","last_fullsized":"2023-10-06T11:08:43.435640+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:50:26.239260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.437343+0000","last_change":"2023-10-06T11:08:43.435236+0000","last_active":"2023-10-06T11:08:43.437343+0000","last_peered":"2023-10-06T11:08:43.437343+0000","last_clean":"2023-10-06T11:08:43.437343+0000","last_became_active":"2023-10-06T11:08:43.434990+0000","last_became_peered":"2023-10-06T11:08:43.434990+0000","last_unstale":"2023-10-06T11:08:43.437343+0000","last_undegraded":"2023-10-06T11:08:43.437343+0000","last_fullsized":"2023-10-06T11:08:43.437343+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:29.015502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435588+0000","last_change":"2023-10-06T11:08:43.424872+0000","last_active":"2023-10-06T11:08:43.435588+0000","last_peered":"2023-10-06T11:08:43.435588+0000","last_clean":"2023-10-06T11:08:43.435588+0000","last_became_active":"2023-10-06T11:08:43.424349+0000","last_became_peered":"2023-10-06T11:08:43.424349+0000","last_unstale":"2023-10-06T11:08:43.435588+0000","last_undegraded":"2023-10-06T11:08:43.435588+0000","last_fullsized":"2023-10-06T11:08:43.435588+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:03:16.583418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.434680+0000","last_change":"2023-10-06T11:08:43.431580+0000","last_active":"2023-10-06T11:08:43.434680+0000","last_peered":"2023-10-06T11:08:43.434680+0000","last_clean":"2023-10-06T11:08:43.434680+0000","last_became_active":"2023-10-06T11:08:43.430722+0000","last_became_peered":"2023-10-06T11:08:43.430722+0000","last_unstale":"2023-10-06T11:08:43.434680+0000","last_undegraded":"2023-10-06T11:08:43.434680+0000","last_fullsized":"2023-10-06T11:08:43.434680+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:54:07.391040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.428430+0000","last_change":"2023-10-06T11:08:43.427248+0000","last_active":"2023-10-06T11:08:43.428430+0000","last_peered":"2023-10-06T11:08:43.428430+0000","last_clean":"2023-10-06T11:08:43.428430+0000","last_became_active":"2023-10-06T11:08:43.426986+0000","last_became_peered":"2023-10-06T11:08:43.426986+0000","last_unstale":"2023-10-06T11:08:43.428430+0000","last_undegraded":"2023-10-06T11:08:43.428430+0000","last_fullsized":"2023-10-06T11:08:43.428430+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:33.013845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"46'4","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.437047+0000","last_change":"2023-10-06T11:08:42.418928+0000","last_active":"2023-10-06T11:08:43.437047+0000","last_peered":"2023-10-06T11:08:43.437047+0000","last_clean":"2023-10-06T11:08:43.437047+0000","last_became_active":"2023-10-06T11:08:42.418664+0000","last_became_peered":"2023-10-06T11:08:42.418664+0000","last_unstale":"2023-10-06T11:08:43.437047+0000","last_undegraded":"2023-10-06T11:08:43.437047+0000","last_fullsized":"2023-10-06T11:08:43.437047+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:28:59.351950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.428786+0000","last_change":"2023-10-06T11:08:43.427311+0000","last_active":"2023-10-06T11:08:43.428786+0000","last_peered":"2023-10-06T11:08:43.428786+0000","last_clean":"2023-10-06T11:08:43.428786+0000","last_became_active":"2023-10-06T11:08:43.427059+0000","last_became_peered":"2023-10-06T11:08:43.427059+0000","last_unstale":"2023-10-06T11:08:43.428786+0000","last_undegraded":"2023-10-06T11:08:43.428786+0000","last_fullsized":"2023-10-06T11:08:43.428786+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:33:09.554346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"46'1","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.438793+0000","last_change":"2023-10-06T11:08:42.429606+0000","last_active":"2023-10-06T11:08:43.438793+0000","last_peered":"2023-10-06T11:08:43.438793+0000","last_clean":"2023-10-06T11:08:43.438793+0000","last_became_active":"2023-10-06T11:08:42.429352+0000","last_became_peered":"2023-10-06T11:08:42.429352+0000","last_unstale":"2023-10-06T11:08:43.438793+0000","last_undegraded":"2023-10-06T11:08:43.438793+0000","last_fullsized":"2023-10-06T11:08:43.438793+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:19.889703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.432815+0000","last_change":"2023-10-06T11:08:43.427677+0000","last_active":"2023-10-06T11:08:43.432815+0000","last_peered":"2023-10-06T11:08:43.432815+0000","last_clean":"2023-10-06T11:08:43.432815+0000","last_became_active":"2023-10-06T11:08:43.427379+0000","last_became_peered":"2023-10-06T11:08:43.427379+0000","last_unstale":"2023-10-06T11:08:43.432815+0000","last_undegraded":"2023-10-06T11:08:43.432815+0000","last_fullsized":"2023-10-06T11:08:43.432815+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:20:22.126062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"46'2","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.438878+0000","last_change":"2023-10-06T11:08:42.428665+0000","last_active":"2023-10-06T11:08:43.438878+0000","last_peered":"2023-10-06T11:08:43.438878+0000","last_clean":"2023-10-06T11:08:43.438878+0000","last_became_active":"2023-10-06T11:08:42.428368+0000","last_became_peered":"2023-10-06T11:08:42.428368+0000","last_unstale":"2023-10-06T11:08:43.438878+0000","last_undegraded":"2023-10-06T11:08:43.438878+0000","last_fullsized":"2023-10-06T11:08:43.438878+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:12:06.633423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.429699+0000","last_change":"2023-10-06T11:08:43.427507+0000","last_active":"2023-10-06T11:08:43.429699+0000","last_peered":"2023-10-06T11:08:43.429699+0000","last_clean":"2023-10-06T11:08:43.429699+0000","last_became_active":"2023-10-06T11:08:43.427268+0000","last_became_peered":"2023-10-06T11:08:43.427268+0000","last_unstale":"2023-10-06T11:08:43.429699+0000","last_undegraded":"2023-10-06T11:08:43.429699+0000","last_fullsized":"2023-10-06T11:08:43.429699+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:03:16.583418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"46'2","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.438968+0000","last_change":"2023-10-06T11:08:42.422232+0000","last_active":"2023-10-06T11:08:43.438968+0000","last_peered":"2023-10-06T11:08:43.438968+0000","last_clean":"2023-10-06T11:08:43.438968+0000","last_became_active":"2023-10-06T11:08:42.421943+0000","last_became_peered":"2023-10-06T11:08:42.421943+0000","last_unstale":"2023-10-06T11:08:43.438968+0000","last_undegraded":"2023-10-06T11:08:43.438968+0000","last_fullsized":"2023-10-06T11:08:43.438968+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:26:25.091803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.425422+0000","last_change":"2023-10-06T11:08:43.424301+0000","last_active":"2023-10-06T11:08:43.425422+0000","last_peered":"2023-10-06T11:08:43.425422+0000","last_clean":"2023-10-06T11:08:43.425422+0000","last_became_active":"2023-10-06T11:08:43.424040+0000","last_became_peered":"2023-10-06T11:08:43.424040+0000","last_unstale":"2023-10-06T11:08:43.425422+0000","last_undegraded":"2023-10-06T11:08:43.425422+0000","last_fullsized":"2023-10-06T11:08:43.425422+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:25:01.083898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"46'1","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.439458+0000","last_change":"2023-10-06T11:08:42.428856+0000","last_active":"2023-10-06T11:08:43.439458+0000","last_peered":"2023-10-06T11:08:43.439458+0000","last_clean":"2023-10-06T11:08:43.439458+0000","last_became_active":"2023-10-06T11:08:42.428382+0000","last_became_peered":"2023-10-06T11:08:42.428382+0000","last_unstale":"2023-10-06T11:08:43.439458+0000","last_undegraded":"2023-10-06T11:08:43.439458+0000","last_fullsized":"2023-10-06T11:08:43.439458+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:21.442104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.437333+0000","last_change":"2023-10-06T11:08:43.435060+0000","last_active":"2023-10-06T11:08:43.437333+0000","last_peered":"2023-10-06T11:08:43.437333+0000","last_clean":"2023-10-06T11:08:43.437333+0000","last_became_active":"2023-10-06T11:08:43.434067+0000","last_became_peered":"2023-10-06T11:08:43.434067+0000","last_unstale":"2023-10-06T11:08:43.437333+0000","last_undegraded":"2023-10-06T11:08:43.437333+0000","last_fullsized":"2023-10-06T11:08:43.437333+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:10.212258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"46'1","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435549+0000","last_change":"2023-10-06T11:08:42.421055+0000","last_active":"2023-10-06T11:08:43.435549+0000","last_peered":"2023-10-06T11:08:43.435549+0000","last_clean":"2023-10-06T11:08:43.435549+0000","last_became_active":"2023-10-06T11:08:42.420751+0000","last_became_peered":"2023-10-06T11:08:42.420751+0000","last_unstale":"2023-10-06T11:08:43.435549+0000","last_undegraded":"2023-10-06T11:08:43.435549+0000","last_fullsized":"2023-10-06T11:08:43.435549+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:35.607875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.429405+0000","last_change":"2023-10-06T11:08:43.426045+0000","last_active":"2023-10-06T11:08:43.429405+0000","last_peered":"2023-10-06T11:08:43.429405+0000","last_clean":"2023-10-06T11:08:43.429405+0000","last_became_active":"2023-10-06T11:08:43.425808+0000","last_became_peered":"2023-10-06T11:08:43.425808+0000","last_unstale":"2023-10-06T11:08:43.429405+0000","last_undegraded":"2023-10-06T11:08:43.429405+0000","last_fullsized":"2023-10-06T11:08:43.429405+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:20:26.368790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.416749+0000","last_change":"2023-10-06T11:08:42.422265+0000","last_active":"2023-10-06T11:08:43.416749+0000","last_peered":"2023-10-06T11:08:43.416749+0000","last_clean":"2023-10-06T11:08:43.416749+0000","last_became_active":"2023-10-06T11:08:42.421951+0000","last_became_peered":"2023-10-06T11:08:42.421951+0000","last_unstale":"2023-10-06T11:08:43.416749+0000","last_undegraded":"2023-10-06T11:08:43.416749+0000","last_fullsized":"2023-10-06T11:08:43.416749+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:15:39.150034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.437296+0000","last_change":"2023-10-06T11:08:43.434561+0000","last_active":"2023-10-06T11:08:43.437296+0000","last_peered":"2023-10-06T11:08:43.437296+0000","last_clean":"2023-10-06T11:08:43.437296+0000","last_became_active":"2023-10-06T11:08:43.434261+0000","last_became_peered":"2023-10-06T11:08:43.434261+0000","last_unstale":"2023-10-06T11:08:43.437296+0000","last_undegraded":"2023-10-06T11:08:43.437296+0000","last_fullsized":"2023-10-06T11:08:43.437296+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:25:01.083898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.419445+0000","last_change":"2023-10-06T11:08:42.426277+0000","last_active":"2023-10-06T11:08:43.419445+0000","last_peered":"2023-10-06T11:08:43.419445+0000","last_clean":"2023-10-06T11:08:43.419445+0000","last_became_active":"2023-10-06T11:08:42.425809+0000","last_became_peered":"2023-10-06T11:08:42.425809+0000","last_unstale":"2023-10-06T11:08:43.419445+0000","last_undegraded":"2023-10-06T11:08:43.419445+0000","last_fullsized":"2023-10-06T11:08:43.419445+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:43.267112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.434453+0000","last_change":"2023-10-06T11:08:43.431467+0000","last_active":"2023-10-06T11:08:43.434453+0000","last_peered":"2023-10-06T11:08:43.434453+0000","last_clean":"2023-10-06T11:08:43.434453+0000","last_became_active":"2023-10-06T11:08:43.431189+0000","last_became_peered":"2023-10-06T11:08:43.431189+0000","last_unstale":"2023-10-06T11:08:43.434453+0000","last_undegraded":"2023-10-06T11:08:43.434453+0000","last_fullsized":"2023-10-06T11:08:43.434453+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:10.212258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.422360+0000","last_change":"2023-10-06T11:08:42.424509+0000","last_active":"2023-10-06T11:08:43.422360+0000","last_peered":"2023-10-06T11:08:43.422360+0000","last_clean":"2023-10-06T11:08:43.422360+0000","last_became_active":"2023-10-06T11:08:42.424227+0000","last_became_peered":"2023-10-06T11:08:42.424227+0000","last_unstale":"2023-10-06T11:08:43.422360+0000","last_undegraded":"2023-10-06T11:08:43.422360+0000","last_fullsized":"2023-10-06T11:08:43.422360+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:20:21.116613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.428755+0000","last_change":"2023-10-06T11:08:43.425933+0000","last_active":"2023-10-06T11:08:43.428755+0000","last_peered":"2023-10-06T11:08:43.428755+0000","last_clean":"2023-10-06T11:08:43.428755+0000","last_became_active":"2023-10-06T11:08:43.425682+0000","last_became_peered":"2023-10-06T11:08:43.425682+0000","last_unstale":"2023-10-06T11:08:43.428755+0000","last_undegraded":"2023-10-06T11:08:43.428755+0000","last_fullsized":"2023-10-06T11:08:43.428755+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:22.451552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.413067+0000","last_change":"2023-10-06T11:08:42.432452+0000","last_active":"2023-10-06T11:08:43.413067+0000","last_peered":"2023-10-06T11:08:43.413067+0000","last_clean":"2023-10-06T11:08:43.413067+0000","last_became_active":"2023-10-06T11:08:42.432156+0000","last_became_peered":"2023-10-06T11:08:42.432156+0000","last_unstale":"2023-10-06T11:08:43.413067+0000","last_undegraded":"2023-10-06T11:08:43.413067+0000","last_fullsized":"2023-10-06T11:08:43.413067+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:07:15.648736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435589+0000","last_change":"2023-10-06T11:08:43.430989+0000","last_active":"2023-10-06T11:08:43.435589+0000","last_peered":"2023-10-06T11:08:43.435589+0000","last_clean":"2023-10-06T11:08:43.435589+0000","last_became_active":"2023-10-06T11:08:43.430743+0000","last_became_peered":"2023-10-06T11:08:43.430743+0000","last_unstale":"2023-10-06T11:08:43.435589+0000","last_undegraded":"2023-10-06T11:08:43.435589+0000","last_fullsized":"2023-10-06T11:08:43.435589+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:29:21.767861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"46'3","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.439412+0000","last_change":"2023-10-06T11:08:42.429474+0000","last_active":"2023-10-06T11:08:43.439412+0000","last_peered":"2023-10-06T11:08:43.439412+0000","last_clean":"2023-10-06T11:08:43.439412+0000","last_became_active":"2023-10-06T11:08:42.429213+0000","last_became_peered":"2023-10-06T11:08:42.429213+0000","last_unstale":"2023-10-06T11:08:43.439412+0000","last_undegraded":"2023-10-06T11:08:43.439412+0000","last_fullsized":"2023-10-06T11:08:43.439412+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:32:09.873020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.425589+0000","last_change":"2023-10-06T11:08:43.419712+0000","last_active":"2023-10-06T11:08:43.425589+0000","last_peered":"2023-10-06T11:08:43.425589+0000","last_clean":"2023-10-06T11:08:43.425589+0000","last_became_active":"2023-10-06T11:08:43.419434+0000","last_became_peered":"2023-10-06T11:08:43.419434+0000","last_unstale":"2023-10-06T11:08:43.425589+0000","last_undegraded":"2023-10-06T11:08:43.425589+0000","last_fullsized":"2023-10-06T11:08:43.425589+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:30.771237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"46'6","reported_seq":16,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.441588+0000","last_change":"2023-10-06T11:08:42.425248+0000","last_active":"2023-10-06T11:08:43.441588+0000","last_peered":"2023-10-06T11:08:43.441588+0000","last_clean":"2023-10-06T11:08:43.441588+0000","last_became_active":"2023-10-06T11:08:42.425015+0000","last_became_peered":"2023-10-06T11:08:42.425015+0000","last_unstale":"2023-10-06T11:08:43.441588+0000","last_undegraded":"2023-10-06T11:08:43.441588+0000","last_fullsized":"2023-10-06T11:08:43.441588+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:54:06.381591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.428699+0000","last_change":"2023-10-06T11:08:43.424775+0000","last_active":"2023-10-06T11:08:43.428699+0000","last_peered":"2023-10-06T11:08:43.428699+0000","last_clean":"2023-10-06T11:08:43.428699+0000","last_became_active":"2023-10-06T11:08:43.424530+0000","last_became_peered":"2023-10-06T11:08:43.424530+0000","last_unstale":"2023-10-06T11:08:43.428699+0000","last_undegraded":"2023-10-06T11:08:43.428699+0000","last_fullsized":"2023-10-06T11:08:43.428699+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:33:49.431732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"46'2","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.438255+0000","last_change":"2023-10-06T11:08:42.429006+0000","last_active":"2023-10-06T11:08:43.438255+0000","last_peered":"2023-10-06T11:08:43.438255+0000","last_clean":"2023-10-06T11:08:43.438255+0000","last_became_active":"2023-10-06T11:08:42.428634+0000","last_became_peered":"2023-10-06T11:08:42.428634+0000","last_unstale":"2023-10-06T11:08:43.438255+0000","last_undegraded":"2023-10-06T11:08:43.438255+0000","last_fullsized":"2023-10-06T11:08:43.438255+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:34:35.607875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.434236+0000","last_change":"2023-10-06T11:08:43.427213+0000","last_active":"2023-10-06T11:08:43.434236+0000","last_peered":"2023-10-06T11:08:43.434236+0000","last_clean":"2023-10-06T11:08:43.434236+0000","last_became_active":"2023-10-06T11:08:43.426968+0000","last_became_peered":"2023-10-06T11:08:43.426968+0000","last_unstale":"2023-10-06T11:08:43.434236+0000","last_undegraded":"2023-10-06T11:08:43.434236+0000","last_fullsized":"2023-10-06T11:08:43.434236+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:27:02.499415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.416452+0000","last_change":"2023-10-06T11:08:42.429725+0000","last_active":"2023-10-06T11:08:43.416452+0000","last_peered":"2023-10-06T11:08:43.416452+0000","last_clean":"2023-10-06T11:08:43.416452+0000","last_became_active":"2023-10-06T11:08:42.429436+0000","last_became_peered":"2023-10-06T11:08:42.429436+0000","last_unstale":"2023-10-06T11:08:43.416452+0000","last_undegraded":"2023-10-06T11:08:43.416452+0000","last_fullsized":"2023-10-06T11:08:43.416452+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:23:04.852141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.429655+0000","last_change":"2023-10-06T11:08:43.427942+0000","last_active":"2023-10-06T11:08:43.429655+0000","last_peered":"2023-10-06T11:08:43.429655+0000","last_clean":"2023-10-06T11:08:43.429655+0000","last_became_active":"2023-10-06T11:08:43.427700+0000","last_became_peered":"2023-10-06T11:08:43.427700+0000","last_unstale":"2023-10-06T11:08:43.429655+0000","last_undegraded":"2023-10-06T11:08:43.429655+0000","last_fullsized":"2023-10-06T11:08:43.429655+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:01:46.808227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.421807+0000","last_change":"2023-10-06T11:08:42.423739+0000","last_active":"2023-10-06T11:08:43.421807+0000","last_peered":"2023-10-06T11:08:43.421807+0000","last_clean":"2023-10-06T11:08:43.421807+0000","last_became_active":"2023-10-06T11:08:42.423397+0000","last_became_peered":"2023-10-06T11:08:42.423397+0000","last_unstale":"2023-10-06T11:08:43.421807+0000","last_undegraded":"2023-10-06T11:08:43.421807+0000","last_fullsized":"2023-10-06T11:08:43.421807+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:06:22.465949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435617+0000","last_change":"2023-10-06T11:08:43.427656+0000","last_active":"2023-10-06T11:08:43.435617+0000","last_peered":"2023-10-06T11:08:43.435617+0000","last_clean":"2023-10-06T11:08:43.435617+0000","last_became_active":"2023-10-06T11:08:43.427354+0000","last_became_peered":"2023-10-06T11:08:43.427354+0000","last_unstale":"2023-10-06T11:08:43.435617+0000","last_undegraded":"2023-10-06T11:08:43.435617+0000","last_fullsized":"2023-10-06T11:08:43.435617+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:39:00.400333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"46'8","reported_seq":18,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.440505+0000","last_change":"2023-10-06T11:08:42.424889+0000","last_active":"2023-10-06T11:08:43.440505+0000","last_peered":"2023-10-06T11:08:43.440505+0000","last_clean":"2023-10-06T11:08:43.440505+0000","last_became_active":"2023-10-06T11:08:42.424633+0000","last_became_peered":"2023-10-06T11:08:42.424633+0000","last_unstale":"2023-10-06T11:08:43.440505+0000","last_undegraded":"2023-10-06T11:08:43.440505+0000","last_fullsized":"2023-10-06T11:08:43.440505+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:32.004396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.429696+0000","last_change":"2023-10-06T11:08:43.428620+0000","last_active":"2023-10-06T11:08:43.429696+0000","last_peered":"2023-10-06T11:08:43.429696+0000","last_clean":"2023-10-06T11:08:43.429696+0000","last_became_active":"2023-10-06T11:08:43.428142+0000","last_became_peered":"2023-10-06T11:08:43.428142+0000","last_unstale":"2023-10-06T11:08:43.429696+0000","last_undegraded":"2023-10-06T11:08:43.429696+0000","last_fullsized":"2023-10-06T11:08:43.429696+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:28:28.243301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"46'1","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.436390+0000","last_change":"2023-10-06T11:08:42.432219+0000","last_active":"2023-10-06T11:08:43.436390+0000","last_peered":"2023-10-06T11:08:43.436390+0000","last_clean":"2023-10-06T11:08:43.436390+0000","last_became_active":"2023-10-06T11:08:42.431764+0000","last_became_peered":"2023-10-06T11:08:42.431764+0000","last_unstale":"2023-10-06T11:08:43.436390+0000","last_undegraded":"2023-10-06T11:08:43.436390+0000","last_fullsized":"2023-10-06T11:08:43.436390+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:45:43.800494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.426657+0000","last_change":"2023-10-06T11:08:43.423290+0000","last_active":"2023-10-06T11:08:43.426657+0000","last_peered":"2023-10-06T11:08:43.426657+0000","last_clean":"2023-10-06T11:08:43.426657+0000","last_became_active":"2023-10-06T11:08:43.423075+0000","last_became_peered":"2023-10-06T11:08:43.423075+0000","last_unstale":"2023-10-06T11:08:43.426657+0000","last_undegraded":"2023-10-06T11:08:43.426657+0000","last_fullsized":"2023-10-06T11:08:43.426657+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:54:07.391040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"46'2","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.439915+0000","last_change":"2023-10-06T11:08:42.419848+0000","last_active":"2023-10-06T11:08:43.439915+0000","last_peered":"2023-10-06T11:08:43.439915+0000","last_clean":"2023-10-06T11:08:43.439915+0000","last_became_active":"2023-10-06T11:08:42.419544+0000","last_became_peered":"2023-10-06T11:08:42.419544+0000","last_unstale":"2023-10-06T11:08:43.439915+0000","last_undegraded":"2023-10-06T11:08:43.439915+0000","last_fullsized":"2023-10-06T11:08:43.439915+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:07:14.329644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.426285+0000","last_change":"2023-10-06T11:08:43.424493+0000","last_active":"2023-10-06T11:08:43.426285+0000","last_peered":"2023-10-06T11:08:43.426285+0000","last_clean":"2023-10-06T11:08:43.426285+0000","last_became_active":"2023-10-06T11:08:43.424201+0000","last_became_peered":"2023-10-06T11:08:43.424201+0000","last_unstale":"2023-10-06T11:08:43.426285+0000","last_undegraded":"2023-10-06T11:08:43.426285+0000","last_fullsized":"2023-10-06T11:08:43.426285+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:59:54.714771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"46'1","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.438711+0000","last_change":"2023-10-06T11:08:42.431246+0000","last_active":"2023-10-06T11:08:43.438711+0000","last_peered":"2023-10-06T11:08:43.438711+0000","last_clean":"2023-10-06T11:08:43.438711+0000","last_became_active":"2023-10-06T11:08:42.430997+0000","last_became_peered":"2023-10-06T11:08:42.430997+0000","last_unstale":"2023-10-06T11:08:43.438711+0000","last_undegraded":"2023-10-06T11:08:43.438711+0000","last_fullsized":"2023-10-06T11:08:43.438711+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:32:03.017104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.426466+0000","last_change":"2023-10-06T11:08:43.418491+0000","last_active":"2023-10-06T11:08:43.426466+0000","last_peered":"2023-10-06T11:08:43.426466+0000","last_clean":"2023-10-06T11:08:43.426466+0000","last_became_active":"2023-10-06T11:08:43.418235+0000","last_became_peered":"2023-10-06T11:08:43.418235+0000","last_unstale":"2023-10-06T11:08:43.426466+0000","last_undegraded":"2023-10-06T11:08:43.426466+0000","last_fullsized":"2023-10-06T11:08:43.426466+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:07:16.658185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.417279+0000","last_change":"2023-10-06T11:08:42.425121+0000","last_active":"2023-10-06T11:08:43.417279+0000","last_peered":"2023-10-06T11:08:43.417279+0000","last_clean":"2023-10-06T11:08:43.417279+0000","last_became_active":"2023-10-06T11:08:42.424805+0000","last_became_peered":"2023-10-06T11:08:42.424805+0000","last_unstale":"2023-10-06T11:08:43.417279+0000","last_undegraded":"2023-10-06T11:08:43.417279+0000","last_fullsized":"2023-10-06T11:08:43.417279+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:05:02.415381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.428782+0000","last_change":"2023-10-06T11:08:43.426219+0000","last_active":"2023-10-06T11:08:43.428782+0000","last_peered":"2023-10-06T11:08:43.428782+0000","last_clean":"2023-10-06T11:08:43.428782+0000","last_became_active":"2023-10-06T11:08:43.425974+0000","last_became_peered":"2023-10-06T11:08:43.425974+0000","last_unstale":"2023-10-06T11:08:43.428782+0000","last_undegraded":"2023-10-06T11:08:43.428782+0000","last_fullsized":"2023-10-06T11:08:43.428782+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:07:16.658185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"46'2","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.440117+0000","last_change":"2023-10-06T11:08:42.424092+0000","last_active":"2023-10-06T11:08:43.440117+0000","last_peered":"2023-10-06T11:08:43.440117+0000","last_clean":"2023-10-06T11:08:43.440117+0000","last_became_active":"2023-10-06T11:08:42.423826+0000","last_became_peered":"2023-10-06T11:08:42.423826+0000","last_unstale":"2023-10-06T11:08:43.440117+0000","last_undegraded":"2023-10-06T11:08:43.440117+0000","last_fullsized":"2023-10-06T11:08:43.440117+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:01:42.358815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.432208+0000","last_change":"2023-10-06T11:08:43.426155+0000","last_active":"2023-10-06T11:08:43.432208+0000","last_peered":"2023-10-06T11:08:43.432208+0000","last_clean":"2023-10-06T11:08:43.432208+0000","last_became_active":"2023-10-06T11:08:43.425892+0000","last_became_peered":"2023-10-06T11:08:43.425892+0000","last_unstale":"2023-10-06T11:08:43.432208+0000","last_undegraded":"2023-10-06T11:08:43.432208+0000","last_fullsized":"2023-10-06T11:08:43.432208+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:38:28.506700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.416345+0000","last_change":"2023-10-06T11:08:42.424867+0000","last_active":"2023-10-06T11:08:43.416345+0000","last_peered":"2023-10-06T11:08:43.416345+0000","last_clean":"2023-10-06T11:08:43.416345+0000","last_became_active":"2023-10-06T11:08:42.424670+0000","last_became_peered":"2023-10-06T11:08:42.424670+0000","last_unstale":"2023-10-06T11:08:43.416345+0000","last_undegraded":"2023-10-06T11:08:43.416345+0000","last_fullsized":"2023-10-06T11:08:43.416345+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:28.006053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.434353+0000","last_change":"2023-10-06T11:08:43.426134+0000","last_active":"2023-10-06T11:08:43.434353+0000","last_peered":"2023-10-06T11:08:43.434353+0000","last_clean":"2023-10-06T11:08:43.434353+0000","last_became_active":"2023-10-06T11:08:43.425902+0000","last_became_peered":"2023-10-06T11:08:43.425902+0000","last_unstale":"2023-10-06T11:08:43.434353+0000","last_undegraded":"2023-10-06T11:08:43.434353+0000","last_fullsized":"2023-10-06T11:08:43.434353+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:51:36.859426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.419934+0000","last_change":"2023-10-06T11:08:42.430104+0000","last_active":"2023-10-06T11:08:43.419934+0000","last_peered":"2023-10-06T11:08:43.419934+0000","last_clean":"2023-10-06T11:08:43.419934+0000","last_became_active":"2023-10-06T11:08:42.429143+0000","last_became_peered":"2023-10-06T11:08:42.429143+0000","last_unstale":"2023-10-06T11:08:43.419934+0000","last_undegraded":"2023-10-06T11:08:43.419934+0000","last_fullsized":"2023-10-06T11:08:43.419934+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:33:48.422283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.427935+0000","last_change":"2023-10-06T11:08:43.424989+0000","last_active":"2023-10-06T11:08:43.427935+0000","last_peered":"2023-10-06T11:08:43.427935+0000","last_clean":"2023-10-06T11:08:43.427935+0000","last_became_active":"2023-10-06T11:08:43.424738+0000","last_became_peered":"2023-10-06T11:08:43.424738+0000","last_unstale":"2023-10-06T11:08:43.427935+0000","last_undegraded":"2023-10-06T11:08:43.427935+0000","last_fullsized":"2023-10-06T11:08:43.427935+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:33:49.431732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.414859+0000","last_change":"2023-10-06T11:08:42.422089+0000","last_active":"2023-10-06T11:08:43.414859+0000","last_peered":"2023-10-06T11:08:43.414859+0000","last_clean":"2023-10-06T11:08:43.414859+0000","last_became_active":"2023-10-06T11:08:42.421847+0000","last_became_peered":"2023-10-06T11:08:42.421847+0000","last_unstale":"2023-10-06T11:08:43.414859+0000","last_undegraded":"2023-10-06T11:08:43.414859+0000","last_fullsized":"2023-10-06T11:08:43.414859+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:24:24.468404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.435505+0000","last_change":"2023-10-06T11:08:43.429380+0000","last_active":"2023-10-06T11:08:43.435505+0000","last_peered":"2023-10-06T11:08:43.435505+0000","last_clean":"2023-10-06T11:08:43.435505+0000","last_became_active":"2023-10-06T11:08:43.429113+0000","last_became_peered":"2023-10-06T11:08:43.429113+0000","last_unstale":"2023-10-06T11:08:43.435505+0000","last_undegraded":"2023-10-06T11:08:43.435505+0000","last_fullsized":"2023-10-06T11:08:43.435505+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:43.781886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.416288+0000","last_change":"2023-10-06T11:08:42.425700+0000","last_active":"2023-10-06T11:08:43.416288+0000","last_peered":"2023-10-06T11:08:43.416288+0000","last_clean":"2023-10-06T11:08:43.416288+0000","last_became_active":"2023-10-06T11:08:42.425460+0000","last_became_peered":"2023-10-06T11:08:42.425460+0000","last_unstale":"2023-10-06T11:08:43.416288+0000","last_undegraded":"2023-10-06T11:08:43.416288+0000","last_fullsized":"2023-10-06T11:08:43.416288+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:31:48.180069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":36,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.412807+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:08:43.412807+0000","last_peered":"2023-10-06T11:08:43.412807+0000","last_clean":"2023-10-06T11:08:43.412807+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:08:43.412807+0000","last_undegraded":"2023-10-06T11:08:43.412807+0000","last_fullsized":"2023-10-06T11:08:43.412807+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.428719+0000","last_change":"2023-10-06T11:08:43.425187+0000","last_active":"2023-10-06T11:08:43.428719+0000","last_peered":"2023-10-06T11:08:43.428719+0000","last_clean":"2023-10-06T11:08:43.428719+0000","last_became_active":"2023-10-06T11:08:43.424989+0000","last_became_peered":"2023-10-06T11:08:43.424989+0000","last_unstale":"2023-10-06T11:08:43.428719+0000","last_undegraded":"2023-10-06T11:08:43.428719+0000","last_fullsized":"2023-10-06T11:08:43.428719+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:45:44.809943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.416439+0000","last_change":"2023-10-06T11:08:42.428698+0000","last_active":"2023-10-06T11:08:43.416439+0000","last_peered":"2023-10-06T11:08:43.416439+0000","last_clean":"2023-10-06T11:08:43.416439+0000","last_became_active":"2023-10-06T11:08:42.428458+0000","last_became_peered":"2023-10-06T11:08:42.428458+0000","last_unstale":"2023-10-06T11:08:43.416439+0000","last_undegraded":"2023-10-06T11:08:43.416439+0000","last_fullsized":"2023-10-06T11:08:43.416439+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:29.761788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":39,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.416332+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:08:43.416332+0000","last_peered":"2023-10-06T11:08:43.416332+0000","last_clean":"2023-10-06T11:08:43.416332+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:08:43.416332+0000","last_undegraded":"2023-10-06T11:08:43.416332+0000","last_fullsized":"2023-10-06T11:08:43.416332+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.433728+0000","last_change":"2023-10-06T11:08:43.422621+0000","last_active":"2023-10-06T11:08:43.433728+0000","last_peered":"2023-10-06T11:08:43.433728+0000","last_clean":"2023-10-06T11:08:43.433728+0000","last_became_active":"2023-10-06T11:08:43.422370+0000","last_became_peered":"2023-10-06T11:08:43.422370+0000","last_unstale":"2023-10-06T11:08:43.433728+0000","last_undegraded":"2023-10-06T11:08:43.433728+0000","last_fullsized":"2023-10-06T11:08:43.433728+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:22.451552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.422039+0000","last_change":"2023-10-06T11:08:42.427034+0000","last_active":"2023-10-06T11:08:43.422039+0000","last_peered":"2023-10-06T11:08:43.422039+0000","last_clean":"2023-10-06T11:08:43.422039+0000","last_became_active":"2023-10-06T11:08:42.426733+0000","last_became_peered":"2023-10-06T11:08:42.426733+0000","last_unstale":"2023-10-06T11:08:43.422039+0000","last_undegraded":"2023-10-06T11:08:43.422039+0000","last_fullsized":"2023-10-06T11:08:43.422039+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:26:25.091803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.412604+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:08:43.412604+0000","last_peered":"2023-10-06T11:08:43.412604+0000","last_clean":"2023-10-06T11:08:43.412604+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:08:43.412604+0000","last_undegraded":"2023-10-06T11:08:43.412604+0000","last_fullsized":"2023-10-06T11:08:43.412604+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":184,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.421836+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:08:43.421836+0000","last_peered":"2023-10-06T11:08:43.421836+0000","last_clean":"2023-10-06T11:08:43.421836+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:08:43.421836+0000","last_undegraded":"2023-10-06T11:08:43.421836+0000","last_fullsized":"2023-10-06T11:08:43.421836+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.427071+0000","last_change":"2023-10-06T11:08:43.423061+0000","last_active":"2023-10-06T11:08:43.427071+0000","last_peered":"2023-10-06T11:08:43.427071+0000","last_clean":"2023-10-06T11:08:43.427071+0000","last_became_active":"2023-10-06T11:08:43.422802+0000","last_became_peered":"2023-10-06T11:08:43.422802+0000","last_unstale":"2023-10-06T11:08:43.427071+0000","last_undegraded":"2023-10-06T11:08:43.427071+0000","last_fullsized":"2023-10-06T11:08:43.427071+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:59:43.781886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.421298+0000","last_change":"2023-10-06T11:08:42.427910+0000","last_active":"2023-10-06T11:08:43.421298+0000","last_peered":"2023-10-06T11:08:43.421298+0000","last_clean":"2023-10-06T11:08:43.421298+0000","last_became_active":"2023-10-06T11:08:42.427478+0000","last_became_peered":"2023-10-06T11:08:42.427478+0000","last_unstale":"2023-10-06T11:08:43.421298+0000","last_undegraded":"2023-10-06T11:08:43.421298+0000","last_fullsized":"2023-10-06T11:08:43.421298+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:33:08.544897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.422507+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:08:43.422507+0000","last_peered":"2023-10-06T11:08:43.422507+0000","last_clean":"2023-10-06T11:08:43.422507+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:08:43.422507+0000","last_undegraded":"2023-10-06T11:08:43.422507+0000","last_fullsized":"2023-10-06T11:08:43.422507+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.428422+0000","last_change":"2023-10-06T11:08:43.419487+0000","last_active":"2023-10-06T11:08:43.428422+0000","last_peered":"2023-10-06T11:08:43.428422+0000","last_clean":"2023-10-06T11:08:43.428422+0000","last_became_active":"2023-10-06T11:08:43.419228+0000","last_became_peered":"2023-10-06T11:08:43.419228+0000","last_unstale":"2023-10-06T11:08:43.428422+0000","last_undegraded":"2023-10-06T11:08:43.428422+0000","last_fullsized":"2023-10-06T11:08:43.428422+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:34:07.970490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.421792+0000","last_change":"2023-10-06T11:08:42.428676+0000","last_active":"2023-10-06T11:08:43.421792+0000","last_peered":"2023-10-06T11:08:43.421792+0000","last_clean":"2023-10-06T11:08:43.421792+0000","last_became_active":"2023-10-06T11:08:42.428426+0000","last_became_peered":"2023-10-06T11:08:42.428426+0000","last_unstale":"2023-10-06T11:08:43.421792+0000","last_undegraded":"2023-10-06T11:08:43.421792+0000","last_fullsized":"2023-10-06T11:08:43.421792+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:07:15.648736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":34,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.421780+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:08:43.421780+0000","last_peered":"2023-10-06T11:08:43.421780+0000","last_clean":"2023-10-06T11:08:43.421780+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:08:43.421780+0000","last_undegraded":"2023-10-06T11:08:43.421780+0000","last_fullsized":"2023-10-06T11:08:43.421780+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.434698+0000","last_change":"2023-10-06T11:08:43.431756+0000","last_active":"2023-10-06T11:08:43.434698+0000","last_peered":"2023-10-06T11:08:43.434698+0000","last_clean":"2023-10-06T11:08:43.434698+0000","last_became_active":"2023-10-06T11:08:43.431105+0000","last_became_peered":"2023-10-06T11:08:43.431105+0000","last_unstale":"2023-10-06T11:08:43.434698+0000","last_undegraded":"2023-10-06T11:08:43.434698+0000","last_fullsized":"2023-10-06T11:08:43.434698+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:33.013845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"46'2","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.436168+0000","last_change":"2023-10-06T11:08:42.429632+0000","last_active":"2023-10-06T11:08:43.436168+0000","last_peered":"2023-10-06T11:08:43.436168+0000","last_clean":"2023-10-06T11:08:43.436168+0000","last_became_active":"2023-10-06T11:08:42.429339+0000","last_became_peered":"2023-10-06T11:08:42.429339+0000","last_unstale":"2023-10-06T11:08:43.436168+0000","last_undegraded":"2023-10-06T11:08:43.436168+0000","last_fullsized":"2023-10-06T11:08:43.436168+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:45.772177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":39,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.415532+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:08:43.415532+0000","last_peered":"2023-10-06T11:08:43.415532+0000","last_clean":"2023-10-06T11:08:43.415532+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:08:43.415532+0000","last_undegraded":"2023-10-06T11:08:43.415532+0000","last_fullsized":"2023-10-06T11:08:43.415532+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.429728+0000","last_change":"2023-10-06T11:08:43.428796+0000","last_active":"2023-10-06T11:08:43.429728+0000","last_peered":"2023-10-06T11:08:43.429728+0000","last_clean":"2023-10-06T11:08:43.429728+0000","last_became_active":"2023-10-06T11:08:43.424121+0000","last_became_peered":"2023-10-06T11:08:43.424121+0000","last_unstale":"2023-10-06T11:08:43.429728+0000","last_undegraded":"2023-10-06T11:08:43.429728+0000","last_fullsized":"2023-10-06T11:08:43.429728+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:06:21.706780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.415243+0000","last_change":"2023-10-06T11:08:42.426380+0000","last_active":"2023-10-06T11:08:43.415243+0000","last_peered":"2023-10-06T11:08:43.415243+0000","last_clean":"2023-10-06T11:08:43.415243+0000","last_became_active":"2023-10-06T11:08:42.426061+0000","last_became_peered":"2023-10-06T11:08:42.426061+0000","last_unstale":"2023-10-06T11:08:43.415243+0000","last_undegraded":"2023-10-06T11:08:43.415243+0000","last_fullsized":"2023-10-06T11:08:43.415243+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:31:32.728096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":38,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.416561+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:08:43.416561+0000","last_peered":"2023-10-06T11:08:43.416561+0000","last_clean":"2023-10-06T11:08:43.416561+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:08:43.416561+0000","last_undegraded":"2023-10-06T11:08:43.416561+0000","last_fullsized":"2023-10-06T11:08:43.416561+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.433687+0000","last_change":"2023-10-06T11:08:43.423239+0000","last_active":"2023-10-06T11:08:43.433687+0000","last_peered":"2023-10-06T11:08:43.433687+0000","last_clean":"2023-10-06T11:08:43.433687+0000","last_became_active":"2023-10-06T11:08:43.422974+0000","last_became_peered":"2023-10-06T11:08:43.422974+0000","last_unstale":"2023-10-06T11:08:43.433687+0000","last_undegraded":"2023-10-06T11:08:43.433687+0000","last_fullsized":"2023-10-06T11:08:43.433687+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:42.402071+0000","last_clean_scrub_stamp":"2023-10-06T11:08:42.402071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:56:57.888412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.412808+0000","last_change":"2023-10-06T11:08:42.428848+0000","last_active":"2023-10-06T11:08:43.412808+0000","last_peered":"2023-10-06T11:08:43.412808+0000","last_clean":"2023-10-06T11:08:43.412808+0000","last_became_active":"2023-10-06T11:08:42.428550+0000","last_became_peered":"2023-10-06T11:08:42.428550+0000","last_unstale":"2023-10-06T11:08:43.412808+0000","last_undegraded":"2023-10-06T11:08:43.412808+0000","last_fullsized":"2023-10-06T11:08:43.412808+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:08:41.392622+0000","last_clean_scrub_stamp":"2023-10-06T11:08:41.392622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:21.442104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":38,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-06T11:08:43.416442+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:08:43.416442+0000","last_peered":"2023-10-06T11:08:43.416442+0000","last_clean":"2023-10-06T11:08:43.416442+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:08:43.416442+0000","last_undegraded":"2023-10-06T11:08:43.416442+0000","last_fullsized":"2023-10-06T11:08:43.416442+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574889,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298416,"kb_used_data":1128,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073424,"statfs":{"total":96636764160,"available":96331186176,"internally_reserved":0,"allocated":1155072,"data_stored":829993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":1.871,"5min":0.73999999999999999,"15min":0.56999999999999995},"min":{"1min":0.41199999999999998,"5min":0.248,"15min":0.248},"max":{"1min":23.908999999999999,"5min":23.908999999999999,"15min":23.908999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":1.127,"5min":0.629,"15min":0.56499999999999995},"min":{"1min":0.374,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":9.0600000000000005,"5min":9.0600000000000005,"15min":9.0600000000000005},"last":0.52500000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":0.63900000000000001,"15min":0.57099999999999995},"min":{"1min":0.40899999999999997,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":9.2360000000000007,"5min":9.2360000000000007,"15min":9.2360000000000007},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.53900000000000003,"15min":0.51600000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":4.327,"5min":4.327,"15min":4.327},"last":0.53400000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.504,"15min":0.50900000000000001},"min":{"1min":0.311,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.505},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.59599999999999997,"15min":0.55800000000000005},"min":{"1min":0.436,"5min":0.309,"15min":0.309},"max":{"1min":4.7309999999999999,"5min":4.7309999999999999,"15min":4.7309999999999999},"last":0.64000000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.55400000000000005,"15min":0.51400000000000001},"min":{"1min":0.35299999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":4.3540000000000001,"5min":4.3540000000000001,"15min":4.3540000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":1.1870000000000001,"5min":0.67300000000000004,"15min":0.59999999999999998},"min":{"1min":0.45300000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":9.3879999999999999,"5min":9.3879999999999999,"15min":9.3879999999999999},"last":0.60899999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.50800000000000001,"15min":0.47499999999999998},"min":{"1min":0.34100000000000003,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":4.5709999999999997,"5min":4.5709999999999997,"15min":4.5709999999999997},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.753,"5min":0.55800000000000005,"15min":0.53500000000000003},"min":{"1min":0.33100000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":4.3129999999999997,"5min":4.3129999999999997,"15min":4.3129999999999997},"last":0.33100000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":0.64100000000000001,"15min":0.58099999999999996},"min":{"1min":0.34200000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":9.3499999999999996,"5min":9.3499999999999996,"15min":9.3499999999999996},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.58299999999999996,"15min":0.56699999999999995},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":4.444,"5min":4.444,"15min":4.444},"last":0.35099999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":0.67300000000000004,"15min":0.622},"min":{"1min":0.39700000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":9.4969999999999999,"5min":9.4969999999999999,"15min":9.4969999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.66200000000000003,"15min":0.62},"min":{"1min":0.44800000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":7.2039999999999997,"5min":7.2039999999999997,"15min":7.2039999999999997},"last":0.46100000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574891,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310120,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061720,"statfs":{"total":96636764160,"available":96319201280,"internally_reserved":0,"allocated":557056,"data_stored":238772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.48199999999999998,"15min":0.497},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52100000000000002,"15min":0.53300000000000003},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.45500000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.48299999999999998,"15min":0.499},"min":{"1min":0.34100000000000003,"5min":0.253,"15min":0.253},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48499999999999999,"15min":0.499},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.76400000000000001,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.42099999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.53100000000000003,"15min":0.498},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":7.0659999999999998,"5min":7.0659999999999998,"15min":7.0659999999999998},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.56100000000000005,"15min":0.52900000000000003},"min":{"1min":0.32500000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":7.0819999999999999,"5min":7.0819999999999999,"15min":7.0819999999999999},"last":0.46500000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.49399999999999999,"15min":0.49299999999999999},"min":{"1min":0.32600000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.52700000000000002,"15min":0.53600000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.72799999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.442}]},{"osd":4,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.48699999999999999,"15min":0.50700000000000001},"min":{"1min":0.29599999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.64300000000000002,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.314},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54300000000000004,"15min":0.56799999999999995},"min":{"1min":0.32100000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.77100000000000002,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.36099999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52200000000000002,"15min":0.53800000000000003},"min":{"1min":0.307,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56299999999999994,"15min":0.58699999999999997},"min":{"1min":0.39500000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.79000000000000004,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.39100000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56200000000000006,"15min":0.57699999999999996},"min":{"1min":0.36899999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79500000000000004,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.58999999999999997,"15min":0.60699999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83899999999999997,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.51000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306608,"kb_used_data":1128,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065232,"statfs":{"total":96636764160,"available":96322797568,"internally_reserved":0,"allocated":1155072,"data_stored":830029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:39 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.33100000000000002,"15min":0.34100000000000003},"min":{"1min":0.216,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.46000000000000002,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.34000000000000002,"15min":0.34399999999999997},"min":{"1min":0.26900000000000002,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.48799999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.23599999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:08:39 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.33600000000000002,"15min":0.33400000000000002},"min":{"1min":0.27300000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.5,"5min":0.505,"15min":0.505},"last":0.249},{"interface":"front","average":{"1min":0.435,"5min":0.38700000000000001,"15min":0.38600000000000001},"min":{"1min":0.251,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.34000000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:08:39 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.29599999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.60299999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.372,"15min":0.36599999999999999},"min":{"1min":0.30499999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.55400000000000005,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.30399999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:08:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.51600000000000001,"15min":0.503},"min":{"1min":0.42499999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.54600000000000004,"15min":0.53600000000000003},"min":{"1min":0.39900000000000002,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.752,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.54300000000000004}]},{"osd":5,"last update":"Fri Oct 6 11:08:39 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.55300000000000005,"15min":0.54700000000000004},"min":{"1min":0.438,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.54800000000000004,"15min":0.53600000000000003},"min":{"1min":0.46400000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.80600000000000005,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.50800000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:08:39 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.56799999999999995,"15min":0.56100000000000005},"min":{"1min":0.45500000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.57599999999999996,"15min":0.56899999999999995},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84899999999999998,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.628}]},{"osd":7,"last update":"Fri Oct 6 11:08:39 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.59099999999999997,"15min":0.58699999999999997},"min":{"1min":0.441,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.86199999999999999,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.58299999999999996,"15min":0.57999999999999996},"min":{"1min":0.41099999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.77600000000000002,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.58799999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297832,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074008,"statfs":{"total":96636764160,"available":96331784192,"internally_reserved":0,"allocated":557056,"data_stored":238204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32700000000000001,"15min":0.33300000000000002},"min":{"1min":0.223,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.503,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.34200000000000003,"15min":0.34100000000000003},"min":{"1min":0.246,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.24099999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.371,"15min":0.377},"min":{"1min":0.27400000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.435,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36099999999999999,"15min":0.36599999999999999},"min":{"1min":0.27200000000000002,"5min":0.219,"15min":0.219},"max":{"1min":0.46100000000000002,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.311}]},{"osd":3,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.371,"15min":0.373},"min":{"1min":0.26500000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.432,"15min":0.438},"min":{"1min":0.33000000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.55700000000000005,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.34200000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.55900000000000005,"15min":0.56000000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.60799999999999998,"15min":0.61499999999999999},"min":{"1min":0.36199999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.83999999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.75900000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54700000000000004,"15min":0.55100000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67900000000000005,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.55100000000000005,"15min":0.54500000000000004},"min":{"1min":0.40000000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.67900000000000005}]},{"osd":6,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60399999999999998,"15min":0.61199999999999999},"min":{"1min":0.432,"5min":0.375,"15min":0.375},"max":{"1min":0.84499999999999997,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60099999999999998,"15min":0.60499999999999998},"min":{"1min":0.42399999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.57999999999999996}]},{"osd":7,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59799999999999998,"15min":0.60499999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.81299999999999994,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.62},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.42099999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.70199999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574890,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310124,"kb_used_data":548,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061716,"statfs":{"total":96636764160,"available":96319197184,"internally_reserved":0,"allocated":561152,"data_stored":239684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.309,"15min":0.309},"min":{"1min":0.22500000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.437,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38100000000000001,"15min":0.38500000000000001},"min":{"1min":0.26900000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.51400000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.495}]},{"osd":1,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36899999999999999,"15min":0.375},"min":{"1min":0.24399999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.35399999999999998,"15min":0.34799999999999998},"min":{"1min":0.26900000000000002,"5min":0.217,"15min":0.217},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.45700000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.37,"15min":0.373},"min":{"1min":0.27800000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.438},{"interface":"front","average":{"1min":0.373,"5min":0.36499999999999999,"15min":0.36699999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.378}]},{"osd":4,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.33900000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.38900000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.58699999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.55200000000000005,"15min":0.55000000000000004},"min":{"1min":0.374,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.625},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.41799999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.67000000000000004}]},{"osd":6,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58299999999999996,"15min":0.58399999999999996},"min":{"1min":0.43099999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41399999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.68400000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.55900000000000005,"15min":0.55000000000000004},"min":{"1min":0.436,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.57099999999999995,"15min":0.56999999999999995},"min":{"1min":0.38600000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.70299999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574890,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310128,"kb_used_data":552,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061712,"statfs":{"total":96636764160,"available":96319193088,"internally_reserved":0,"allocated":565248,"data_stored":239706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.315,"15min":0.32800000000000001},"min":{"1min":0.248,"5min":0.188,"15min":0.188},"max":{"1min":0.46500000000000002,"5min":1.095,"15min":1.095},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38900000000000001,"15min":0.40500000000000003},"min":{"1min":0.29999999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.50600000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.39500000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.314,"15min":0.309},"min":{"1min":0.255,"5min":0.219,"15min":0.219},"max":{"1min":0.47499999999999998,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.36699999999999999,"15min":0.373},"min":{"1min":0.26500000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.51500000000000001,"5min":1.196,"15min":1.196},"last":0.36799999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.38100000000000001,"15min":0.39400000000000002},"min":{"1min":0.24199999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.54500000000000004,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.31},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.42399999999999999},"min":{"1min":0.33700000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.55900000000000005,"5min":1.224,"15min":1.224},"last":0.40999999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.55700000000000005,"15min":0.57499999999999996},"min":{"1min":0.38200000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.92500000000000004,"5min":1.694,"15min":1.694},"last":0.627},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53800000000000003,"15min":0.54500000000000004},"min":{"1min":0.36599999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.78200000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.41599999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55700000000000005,"15min":0.56599999999999995},"min":{"1min":0.39200000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.82199999999999995,"5min":1.165,"15min":1.165},"last":0.82199999999999995}]},{"osd":6,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58499999999999996,"15min":0.59499999999999997},"min":{"1min":0.40200000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.89900000000000002,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.59399999999999997,"15min":0.60499999999999998},"min":{"1min":0.45400000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83399999999999996,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.83399999999999996}]},{"osd":7,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58299999999999996,"15min":0.59699999999999998},"min":{"1min":0.40999999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84799999999999998,"5min":1.657,"15min":1.657},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.57099999999999995,"15min":0.57399999999999995},"min":{"1min":0.46700000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.68200000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574889,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310120,"kb_used_data":544,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061720,"statfs":{"total":96636764160,"available":96319201280,"internally_reserved":0,"allocated":557056,"data_stored":240055,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.54800000000000004,"15min":0.60299999999999998},"min":{"1min":0.28899999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.74099999999999999,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48299999999999998,"15min":0.499},"min":{"1min":0.28599999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.64500000000000002,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.60199999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.57499999999999996,"15min":0.628},"min":{"1min":0.28799999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66100000000000003,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.57699999999999996,"15min":0.629},"min":{"1min":0.32900000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.74199999999999999,"5min":2.7610000000000001,"15min":2.7610000000000001},"last":0.54000000000000004}]},{"osd":2,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.54200000000000004,"15min":0.58199999999999996},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.60399999999999998,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.378},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58999999999999997,"15min":0.61899999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.76500000000000001,"5min":1.718,"15min":1.718},"last":0.71699999999999997}]},{"osd":3,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.60199999999999998,"15min":0.64800000000000002},"min":{"1min":0.36799999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.67600000000000005,"5min":2.677,"15min":2.677},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.51100000000000001,"15min":0.52400000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.42199999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.47299999999999998,"15min":0.497},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.442},{"interface":"front","average":{"1min":0.5,"5min":0.52300000000000002,"15min":0.54700000000000004},"min":{"1min":0.307,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.71999999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.57499999999999996}]},{"osd":6,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.51000000000000001,"15min":0.53400000000000003},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.5},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.56100000000000005,"15min":0.59499999999999997},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.86899999999999999,"5min":1.165,"15min":1.165},"last":0.65200000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.55900000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.622},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59099999999999997,"15min":0.61599999999999999},"min":{"1min":0.37,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.67200000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310104,"kb_used_data":528,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061736,"statfs":{"total":96636764160,"available":96319217664,"internally_reserved":0,"allocated":540672,"data_stored":232860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.66600000000000004,"15min":0.72399999999999998},"min":{"1min":0.36199999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.71899999999999997,"5min":5.0490000000000004,"15min":5.0490000000000004},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.627,"15min":0.69299999999999995},"min":{"1min":0.254,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.755,"5min":5.1449999999999996,"15min":5.1449999999999996},"last":0.39000000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48999999999999999,"15min":0.49199999999999999},"min":{"1min":0.315,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.70699999999999996,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.70699999999999996,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.56000000000000005}]},{"osd":2,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.57999999999999996,"15min":0.56699999999999995},"min":{"1min":0.379,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.81799999999999995,"5min":4.234,"15min":4.234},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56899999999999995,"15min":0.57799999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76600000000000001,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.59899999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.66700000000000004,"15min":0.74399999999999999},"min":{"1min":0.29299999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.72099999999999997,"5min":5.2169999999999996,"15min":5.2169999999999996},"last":0.438},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55100000000000005,"15min":0.55500000000000005},"min":{"1min":0.39600000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.83399999999999996,"5min":1.008,"15min":1.008},"last":0.53300000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.52900000000000003,"15min":0.53800000000000003},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.871,"5min":1.917,"15min":1.917},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.53800000000000003,"15min":0.55500000000000005},"min":{"1min":0.27200000000000002,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.85499999999999998,"5min":0.87,"15min":0.87},"last":0.50900000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.34899999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.89500000000000002,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.624,"15min":0.63200000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.92300000000000004,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":0.64400000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58999999999999997,"15min":0.60899999999999999},"min":{"1min":0.32100000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.84299999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.621,"15min":0.63},"min":{"1min":0.372,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.93899999999999995,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.629}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:08:52.346 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T11:08:52.346 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T11:08:52.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.499+0000 7f95edc32700 1 Processor -- start 2023-10-06T11:08:52.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.499+0000 7f95edc32700 1 -- start start 2023-10-06T11:08:52.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.500+0000 7f95edc32700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f95e80ab670 0x7f95e815a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:52.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.500+0000 7f95edc32700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f95e806a040 0x7f95e8068480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:52.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.500+0000 7f95edc32700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95e80689c0 0x7f95e815d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:52.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.500+0000 7f95edc32700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95e8068e60 con 0x7f95e80ab670 2023-10-06T11:08:52.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.500+0000 7f95edc32700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95e81578b0 con 0x7f95e806a040 2023-10-06T11:08:52.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.500+0000 7f95edc32700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e80aba40 con 0x7f95e80689c0 2023-10-06T11:08:52.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.500+0000 7f95e77fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f95e80ab670 0x7f95e815a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:52.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.500+0000 7f95e77fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f95e80ab670 0x7f95e815a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34562/0 (socket says 172.21.15.146:34562) 2023-10-06T11:08:52.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.500+0000 7f95e77fe700 1 -- 172.21.15.146:0/3211717090 learned_addr learned my addr 172.21.15.146:0/3211717090 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:52.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.500+0000 7f95e7fff700 1 --2- 172.21.15.146:0/3211717090 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95e80689c0 0x7f95e815d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:52.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.500+0000 7f95e6ffd700 1 --2- 172.21.15.146:0/3211717090 >> v2:172.21.15.151:3300/0 conn(0x7f95e806a040 0x7f95e8068480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:52.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.501+0000 7f95e77fe700 1 -- 172.21.15.146:0/3211717090 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95e80689c0 msgr2=0x7f95e815d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:52.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.501+0000 7f95e77fe700 1 --2- 172.21.15.146:0/3211717090 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95e80689c0 0x7f95e815d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:52.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.501+0000 7f95e77fe700 1 -- 172.21.15.146:0/3211717090 >> v2:172.21.15.151:3300/0 conn(0x7f95e806a040 msgr2=0x7f95e8068480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:52.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.501+0000 7f95e77fe700 1 --2- 172.21.15.146:0/3211717090 >> v2:172.21.15.151:3300/0 conn(0x7f95e806a040 0x7f95e8068480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:52.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.501+0000 7f95e77fe700 1 -- 172.21.15.146:0/3211717090 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e806ecd0 con 0x7f95e80ab670 2023-10-06T11:08:52.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.501+0000 7f95e77fe700 1 --2- 172.21.15.146:0/3211717090 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95e80ab670 0x7f95e815a850 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f95e8159e30 tx=0x7f95d8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98bad33240164c4e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:52.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.501+0000 7f95e67fc700 1 -- 172.21.15.146:0/3211717090 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d800e070 con 0x7f95e80ab670 2023-10-06T11:08:52.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.501+0000 7f95e67fc700 1 -- 172.21.15.146:0/3211717090 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d800ba50 con 0x7f95e80ab670 2023-10-06T11:08:52.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.501+0000 7f95e67fc700 1 -- 172.21.15.146:0/3211717090 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d80092e0 con 0x7f95e80ab670 2023-10-06T11:08:52.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.501+0000 7f95edc32700 1 -- 172.21.15.146:0/3211717090 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95e80ab670 msgr2=0x7f95e815a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:52.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.501+0000 7f95edc32700 1 --2- 172.21.15.146:0/3211717090 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95e80ab670 0x7f95e815a850 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f95e8159e30 tx=0x7f95d8009840 comp rx=0 tx=0).stop 2023-10-06T11:08:52.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.501+0000 7f95edc32700 1 -- 172.21.15.146:0/3211717090 shutdown_connections 2023-10-06T11:08:52.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.501+0000 7f95edc32700 1 --2- 172.21.15.146:0/3211717090 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95e80689c0 0x7f95e815d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:52.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.501+0000 7f95edc32700 1 --2- 172.21.15.146:0/3211717090 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95e80ab670 0x7f95e815a850 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:52.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.501+0000 7f95edc32700 1 --2- 172.21.15.146:0/3211717090 >> v2:172.21.15.151:3300/0 conn(0x7f95e806a040 0x7f95e8068480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:52.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.501+0000 7f95edc32700 1 -- 172.21.15.146:0/3211717090 >> 172.21.15.146:0/3211717090 conn(0x7f95e80c9f90 msgr2=0x7f95e806dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:52.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.501+0000 7f95edc32700 1 -- 172.21.15.146:0/3211717090 shutdown_connections 2023-10-06T11:08:52.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.501+0000 7f95edc32700 1 -- 172.21.15.146:0/3211717090 wait complete. 2023-10-06T11:08:52.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.503+0000 7f95edc32700 1 Processor -- start 2023-10-06T11:08:52.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.503+0000 7f95edc32700 1 -- start start 2023-10-06T11:08:52.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.503+0000 7f95edc32700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95e80689c0 0x7f95e8156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:52.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.503+0000 7f95edc32700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95e806a040 0x7f95e80ac4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:52.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.503+0000 7f95edc32700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95e80ab670 0x7f95e816d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:52.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.503+0000 7f95edc32700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e8156940 con 0x7f95e80689c0 2023-10-06T11:08:52.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.503+0000 7f95edc32700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e815fb60 con 0x7f95e80ab670 2023-10-06T11:08:52.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.503+0000 7f95edc32700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e815ef90 con 0x7f95e806a040 2023-10-06T11:08:52.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.503+0000 7f95e77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95e80689c0 0x7f95e8156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:52.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.503+0000 7f95e77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95e80689c0 0x7f95e8156400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34570/0 (socket says 172.21.15.146:34570) 2023-10-06T11:08:52.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.503+0000 7f95e77fe700 1 -- 172.21.15.146:0/1071721853 learned_addr learned my addr 172.21.15.146:0/1071721853 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:52.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.504+0000 7f95e7fff700 1 --2- 172.21.15.146:0/1071721853 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95e80ab670 0x7f95e816d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:52.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.504+0000 7f95e6ffd700 1 --2- 172.21.15.146:0/1071721853 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95e806a040 0x7f95e80ac4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:52.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.504+0000 7f95e77fe700 1 -- 172.21.15.146:0/1071721853 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95e806a040 msgr2=0x7f95e80ac4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:52.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.504+0000 7f95e77fe700 1 --2- 172.21.15.146:0/1071721853 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95e806a040 0x7f95e80ac4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:52.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.504+0000 7f95e77fe700 1 -- 172.21.15.146:0/1071721853 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95e80ab670 msgr2=0x7f95e816d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:52.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.504+0000 7f95e77fe700 1 --2- 172.21.15.146:0/1071721853 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95e80ab670 0x7f95e816d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:52.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.504+0000 7f95e77fe700 1 -- 172.21.15.146:0/1071721853 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d8009ae0 con 0x7f95e80689c0 2023-10-06T11:08:52.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.504+0000 7f95e6ffd700 1 --2- 172.21.15.146:0/1071721853 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95e806a040 0x7f95e80ac4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:08:52.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.504+0000 7f95e77fe700 1 --2- 172.21.15.146:0/1071721853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95e80689c0 0x7f95e8156400 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f95d8009430 tx=0x7f95d8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:52.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.504+0000 7f95cf7fe700 1 -- 172.21.15.146:0/1071721853 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d8008a80 con 0x7f95e80689c0 2023-10-06T11:08:52.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.504+0000 7f95cf7fe700 1 -- 172.21.15.146:0/1071721853 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d8008be0 con 0x7f95e80689c0 2023-10-06T11:08:52.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.504+0000 7f95cf7fe700 1 -- 172.21.15.146:0/1071721853 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d8025460 con 0x7f95e80689c0 2023-10-06T11:08:52.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.504+0000 7f95edc32700 1 -- 172.21.15.146:0/1071721853 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95e815f230 con 0x7f95e80689c0 2023-10-06T11:08:52.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.504+0000 7f95edc32700 1 -- 172.21.15.146:0/1071721853 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95e815f7f0 con 0x7f95e80689c0 2023-10-06T11:08:52.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.505+0000 7f95edc32700 1 -- 172.21.15.146:0/1071721853 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95e804c380 con 0x7f95e80689c0 2023-10-06T11:08:52.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.505+0000 7f95cf7fe700 1 -- 172.21.15.146:0/1071721853 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f95d8003040 con 0x7f95e80689c0 2023-10-06T11:08:52.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.506+0000 7f95cf7fe700 1 --2- 172.21.15.146:0/1071721853 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f95d4066f30 0x7f95d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:52.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.506+0000 7f95cf7fe700 1 -- 172.21.15.146:0/1071721853 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f95d8085a60 con 0x7f95e80689c0 2023-10-06T11:08:52.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.506+0000 7f95e6ffd700 1 --2- 172.21.15.146:0/1071721853 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f95d4066f30 0x7f95d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:52.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.506+0000 7f95e6ffd700 1 --2- 172.21.15.146:0/1071721853 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f95d4066f30 0x7f95d40693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f95e815c6b0 tx=0x7f95dc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:52.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.510+0000 7f95cf7fe700 1 -- 172.21.15.146:0/1071721853 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f95d8052c20 con 0x7f95e80689c0 2023-10-06T11:08:52.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.772+0000 7f95edc32700 1 -- 172.21.15.146:0/1071721853 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f95e806a520 con 0x7f95e80689c0 2023-10-06T11:08:52.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.775+0000 7f95cf7fe700 1 -- 172.21.15.146:0/1071721853 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+0 (secure 0 0 0) 0x7f95d8056240 con 0x7f95e80689c0 2023-10-06T11:08:52.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.778+0000 7f95edc32700 1 -- 172.21.15.146:0/1071721853 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f95d4066f30 msgr2=0x7f95d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:52.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.778+0000 7f95edc32700 1 --2- 172.21.15.146:0/1071721853 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f95d4066f30 0x7f95d40693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f95e815c6b0 tx=0x7f95dc008040 comp rx=0 tx=0).stop 2023-10-06T11:08:52.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.778+0000 7f95edc32700 1 -- 172.21.15.146:0/1071721853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95e80689c0 msgr2=0x7f95e8156400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:52.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.778+0000 7f95edc32700 1 --2- 172.21.15.146:0/1071721853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95e80689c0 0x7f95e8156400 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f95d8009430 tx=0x7f95d8018000 comp rx=0 tx=0).stop 2023-10-06T11:08:52.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.778+0000 7f95edc32700 1 -- 172.21.15.146:0/1071721853 shutdown_connections 2023-10-06T11:08:52.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.778+0000 7f95edc32700 1 --2- 172.21.15.146:0/1071721853 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f95d4066f30 0x7f95d40693e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:52.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.778+0000 7f95edc32700 1 --2- 172.21.15.146:0/1071721853 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95e80ab670 0x7f95e816d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:52.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.778+0000 7f95edc32700 1 --2- 172.21.15.146:0/1071721853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95e80689c0 0x7f95e8156400 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:52.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.778+0000 7f95edc32700 1 --2- 172.21.15.146:0/1071721853 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95e806a040 0x7f95e80ac4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:52.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.778+0000 7f95edc32700 1 -- 172.21.15.146:0/1071721853 >> 172.21.15.146:0/1071721853 conn(0x7f95e80c9f90 msgr2=0x7f95e80ca990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:52.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.778+0000 7f95edc32700 1 -- 172.21.15.146:0/1071721853 shutdown_connections 2023-10-06T11:08:52.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.778+0000 7f95edc32700 1 -- 172.21.15.146:0/1071721853 wait complete. 2023-10-06T11:08:52.781 INFO:teuthology.orchestra.run.smithi146.stderr:updated caps for client.0 2023-10-06T11:08:52.795 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:08:52.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.908+0000 7f0f57e8f700 1 Processor -- start 2023-10-06T11:08:52.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.908+0000 7f0f57e8f700 1 -- start start 2023-10-06T11:08:52.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.909+0000 7f0f57e8f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0f50153ab0 0x7f0f5015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:52.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.909+0000 7f0f57e8f700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0f50153e80 0x7f0f50068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:52.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.909+0000 7f0f57e8f700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f5015ac30 con 0x7f0f500689d0 2023-10-06T11:08:52.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.909+0000 7f0f57e8f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f500b4510 con 0x7f0f50153ab0 2023-10-06T11:08:52.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.909+0000 7f0f57e8f700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f500b6530 con 0x7f0f50153e80 2023-10-06T11:08:52.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.909+0000 7f0f55c2b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0f50153ab0 0x7f0f5015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:52.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.909+0000 7f0f55c2b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0f50153ab0 0x7f0f5015a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34572/0 (socket says 172.21.15.146:34572) 2023-10-06T11:08:52.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.909+0000 7f0f55c2b700 1 -- 172.21.15.146:0/1573594901 learned_addr learned my addr 172.21.15.146:0/1573594901 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:52.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.909+0000 7f0f5542a700 1 --2- 172.21.15.146:0/1573594901 >> v2:172.21.15.151:3300/0 conn(0x7f0f50153e80 0x7f0f50068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:52.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.909+0000 7f0f55c2b700 1 -- 172.21.15.146:0/1573594901 >> v2:172.21.15.151:3300/0 conn(0x7f0f50153e80 msgr2=0x7f0f50068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:52.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.909+0000 7f0f55c2b700 1 --2- 172.21.15.146:0/1573594901 >> v2:172.21.15.151:3300/0 conn(0x7f0f50153e80 0x7f0f50068490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:52.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.909+0000 7f0f55c2b700 1 -- 172.21.15.146:0/1573594901 >> v1:172.21.15.151:6789/0 conn(0x7f0f500689d0 legacy=0x7f0f5015d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:52.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.909+0000 7f0f55c2b700 1 -- 172.21.15.146:0/1573594901 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f50068dd0 con 0x7f0f50153ab0 2023-10-06T11:08:52.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.909+0000 7f0f5542a700 1 --2- 172.21.15.146:0/1573594901 >> v2:172.21.15.151:3300/0 conn(0x7f0f50153e80 0x7f0f50068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:08:52.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.909+0000 7f0f55c2b700 1 --2- 172.21.15.146:0/1573594901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f50153ab0 0x7f0f5015a6f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f0f50089770 tx=0x7f0f48009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b42bbf0077680fd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:52.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.909+0000 7f0f54c29700 1 -- 172.21.15.146:0/1573594901 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4800e070 con 0x7f0f50153ab0 2023-10-06T11:08:52.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.909+0000 7f0f54c29700 1 -- 172.21.15.146:0/1573594901 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4800ba10 con 0x7f0f50153ab0 2023-10-06T11:08:52.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.909+0000 7f0f54c29700 1 -- 172.21.15.146:0/1573594901 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f480092e0 con 0x7f0f50153ab0 2023-10-06T11:08:52.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.910+0000 7f0f57e8f700 1 -- 172.21.15.146:0/1573594901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f50153ab0 msgr2=0x7f0f5015a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:52.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.910+0000 7f0f57e8f700 1 --2- 172.21.15.146:0/1573594901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f50153ab0 0x7f0f5015a6f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f0f50089770 tx=0x7f0f48009840 comp rx=0 tx=0).stop 2023-10-06T11:08:52.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.910+0000 7f0f57e8f700 1 -- 172.21.15.146:0/1573594901 shutdown_connections 2023-10-06T11:08:52.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.910+0000 7f0f57e8f700 1 --2- 172.21.15.146:0/1573594901 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f50153ab0 0x7f0f5015a6f0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:52.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.910+0000 7f0f57e8f700 1 --2- 172.21.15.146:0/1573594901 >> v2:172.21.15.151:3300/0 conn(0x7f0f50153e80 0x7f0f50068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:52.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.910+0000 7f0f57e8f700 1 -- 172.21.15.146:0/1573594901 >> 172.21.15.146:0/1573594901 conn(0x7f0f5006eba0 msgr2=0x7f0f5006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:52.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.910+0000 7f0f57e8f700 1 -- 172.21.15.146:0/1573594901 shutdown_connections 2023-10-06T11:08:52.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.910+0000 7f0f57e8f700 1 -- 172.21.15.146:0/1573594901 wait complete. 2023-10-06T11:08:52.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.911+0000 7f0f57e8f700 1 Processor -- start 2023-10-06T11:08:52.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.911+0000 7f0f57e8f700 1 -- start start 2023-10-06T11:08:52.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.912+0000 7f0f57e8f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f500689d0 0x7f0f50142fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:52.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.912+0000 7f0f57e8f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f50153ab0 0x7f0f500b0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:52.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.912+0000 7f0f57e8f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f50153e80 0x7f0f50154f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:52.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.912+0000 7f0f57e8f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f50150fc0 con 0x7f0f50153e80 2023-10-06T11:08:52.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.912+0000 7f0f57e8f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f500b1d80 con 0x7f0f50153ab0 2023-10-06T11:08:52.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.912+0000 7f0f57e8f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f500b1ff0 con 0x7f0f500689d0 2023-10-06T11:08:52.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.912+0000 7f0f5642c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f50153e80 0x7f0f50154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:52.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.912+0000 7f0f5642c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f50153e80 0x7f0f50154f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34578/0 (socket says 172.21.15.146:34578) 2023-10-06T11:08:52.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.912+0000 7f0f5642c700 1 -- 172.21.15.146:0/3952414839 learned_addr learned my addr 172.21.15.146:0/3952414839 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:52.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.912+0000 7f0f5542a700 1 --2- 172.21.15.146:0/3952414839 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f50153ab0 0x7f0f500b0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:52.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.912+0000 7f0f55c2b700 1 --2- 172.21.15.146:0/3952414839 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f500689d0 0x7f0f50142fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:52.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.912+0000 7f0f5642c700 1 -- 172.21.15.146:0/3952414839 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f500689d0 msgr2=0x7f0f50142fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:52.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.912+0000 7f0f5642c700 1 --2- 172.21.15.146:0/3952414839 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f500689d0 0x7f0f50142fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:52.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.912+0000 7f0f5642c700 1 -- 172.21.15.146:0/3952414839 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f50153ab0 msgr2=0x7f0f500b0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:52.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.912+0000 7f0f5642c700 1 --2- 172.21.15.146:0/3952414839 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f50153ab0 0x7f0f500b0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:52.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.912+0000 7f0f5642c700 1 -- 172.21.15.146:0/3952414839 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f48009ae0 con 0x7f0f50153e80 2023-10-06T11:08:52.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.912+0000 7f0f55c2b700 1 --2- 172.21.15.146:0/3952414839 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f500689d0 0x7f0f50142fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:08:52.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.912+0000 7f0f5542a700 1 --2- 172.21.15.146:0/3952414839 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f50153ab0 0x7f0f500b0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:08:52.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.912+0000 7f0f5642c700 1 --2- 172.21.15.146:0/3952414839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f50153e80 0x7f0f50154f20 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f0f4000b510 tx=0x7f0f40006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:52.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.912+0000 7f0f4dffb700 1 -- 172.21.15.146:0/3952414839 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4000f510 con 0x7f0f50153e80 2023-10-06T11:08:52.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.912+0000 7f0f4dffb700 1 -- 172.21.15.146:0/3952414839 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4000f690 con 0x7f0f50153e80 2023-10-06T11:08:52.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.912+0000 7f0f57e8f700 1 -- 172.21.15.146:0/3952414839 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f500b22d0 con 0x7f0f50153e80 2023-10-06T11:08:52.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.912+0000 7f0f4dffb700 1 -- 172.21.15.146:0/3952414839 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4000fa50 con 0x7f0f50153e80 2023-10-06T11:08:52.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.913+0000 7f0f57e8f700 1 -- 172.21.15.146:0/3952414839 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f500b0eb0 con 0x7f0f50153e80 2023-10-06T11:08:52.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.913+0000 7f0f57e8f700 1 -- 172.21.15.146:0/3952414839 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f500b1100 con 0x7f0f50153e80 2023-10-06T11:08:52.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.914+0000 7f0f4dffb700 1 -- 172.21.15.146:0/3952414839 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0f4001a400 con 0x7f0f50153e80 2023-10-06T11:08:52.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.914+0000 7f0f4dffb700 1 --2- 172.21.15.146:0/3952414839 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0f3c066f30 0x7f0f3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:52.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.914+0000 7f0f4dffb700 1 -- 172.21.15.146:0/3952414839 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0f40084120 con 0x7f0f50153e80 2023-10-06T11:08:52.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.914+0000 7f0f55c2b700 1 --2- 172.21.15.146:0/3952414839 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0f3c066f30 0x7f0f3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:52.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.915+0000 7f0f55c2b700 1 --2- 172.21.15.146:0/3952414839 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0f3c066f30 0x7f0f3c0693e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0f48009880 tx=0x7f0f48017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:52.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:52.918+0000 7f0f4dffb700 1 -- 172.21.15.146:0/3952414839 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0f400512b0 con 0x7f0f50153e80 2023-10-06T11:08:53.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.140+0000 7f0f57e8f700 1 -- 172.21.15.146:0/3952414839 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0f500b24c0 con 0x7f0f50153e80 2023-10-06T11:08:53.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.141+0000 7f0f4dffb700 1 -- 172.21.15.146:0/3952414839 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4609 (secure 0 0 0) 0x7f0f400548d0 con 0x7f0f50153e80 2023-10-06T11:08:53.143 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:08:53.143 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":35,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5248,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3360977916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3360977916},{"type":"v1","addr":"172.21.15.151:6834","nonce":3360977916}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5251,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2265934004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":2265934004},{"type":"v1","addr":"172.21.15.151:6835","nonce":2265934004}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2387575667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2387575667},{"type":"v1","addr":"172.21.15.146:6836","nonce":2387575667}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:08:42.797557+0000","modified":"2023-10-06T11:08:46.435072+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5481":{"gid":5481,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/2252184844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2252184844},{"type":"v1","addr":"172.21.15.146:6837","nonce":2252184844}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T11:08:53.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.143+0000 7f0f57e8f700 1 -- 172.21.15.146:0/3952414839 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0f3c066f30 msgr2=0x7f0f3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:53.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.143+0000 7f0f57e8f700 1 --2- 172.21.15.146:0/3952414839 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0f3c066f30 0x7f0f3c0693e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0f48009880 tx=0x7f0f48017000 comp rx=0 tx=0).stop 2023-10-06T11:08:53.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.143+0000 7f0f57e8f700 1 -- 172.21.15.146:0/3952414839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f50153e80 msgr2=0x7f0f50154f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:53.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.143+0000 7f0f57e8f700 1 --2- 172.21.15.146:0/3952414839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f50153e80 0x7f0f50154f20 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f0f4000b510 tx=0x7f0f40006f90 comp rx=0 tx=0).stop 2023-10-06T11:08:53.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.143+0000 7f0f57e8f700 1 -- 172.21.15.146:0/3952414839 shutdown_connections 2023-10-06T11:08:53.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.143+0000 7f0f57e8f700 1 --2- 172.21.15.146:0/3952414839 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0f3c066f30 0x7f0f3c0693e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:53.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.143+0000 7f0f57e8f700 1 --2- 172.21.15.146:0/3952414839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f50153e80 0x7f0f50154f20 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:53.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.143+0000 7f0f57e8f700 1 --2- 172.21.15.146:0/3952414839 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f500689d0 0x7f0f50142fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:53.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.143+0000 7f0f57e8f700 1 --2- 172.21.15.146:0/3952414839 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f50153ab0 0x7f0f500b0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:53.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.143+0000 7f0f57e8f700 1 -- 172.21.15.146:0/3952414839 >> 172.21.15.146:0/3952414839 conn(0x7f0f5006eba0 msgr2=0x7f0f501531c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:53.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.143+0000 7f0f57e8f700 1 -- 172.21.15.146:0/3952414839 shutdown_connections 2023-10-06T11:08:53.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.143+0000 7f0f57e8f700 1 -- 172.21.15.146:0/3952414839 wait complete. 2023-10-06T11:08:53.147 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 35 2023-10-06T11:08:53.559 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 35, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T11:08:42.797557+0000', 'modified': '2023-10-06T11:08:46.435072+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5481}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5481': {'gid': 5481, 'name': 'c', 'rank': 0, 'incarnation': 31, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.146:6837/2252184844', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6835', 'nonce': 2252184844}, {'type': 'v1', 'addr': '172.21.15.146:6837', 'nonce': 2252184844}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T11:08:53.560 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T11:08:53.560 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T11:08:53.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.675+0000 7f5d311bd700 1 Processor -- start 2023-10-06T11:08:53.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.675+0000 7f5d311bd700 1 -- start start 2023-10-06T11:08:53.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.676+0000 7f5d311bd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5d2c0b3cf0 0x7f5d2c0ce860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:53.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.676+0000 7f5d311bd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d2c0b2430 0x7f5d2c0b5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:53.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.676+0000 7f5d311bd700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d2c0b4ec0 con 0x7f5d2c0b2060 2023-10-06T11:08:53.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.676+0000 7f5d311bd700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d2c0cd470 con 0x7f5d2c0b3cf0 2023-10-06T11:08:53.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.676+0000 7f5d311bd700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c0b42b0 con 0x7f5d2c0b2430 2023-10-06T11:08:53.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.676+0000 7f5d2b7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5d2c0b3cf0 0x7f5d2c0ce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:53.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.676+0000 7f5d2b7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5d2c0b3cf0 0x7f5d2c0ce860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34586/0 (socket says 172.21.15.146:34586) 2023-10-06T11:08:53.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.676+0000 7f5d2b7fe700 1 -- 172.21.15.146:0/2490592906 learned_addr learned my addr 172.21.15.146:0/2490592906 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:53.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.676+0000 7f5d309bc700 1 --2- 172.21.15.146:0/2490592906 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d2c0b2430 0x7f5d2c0b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:53.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.676+0000 7f5d2b7fe700 1 -- 172.21.15.146:0/2490592906 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d2c0b2430 msgr2=0x7f5d2c0b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:53.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.677+0000 7f5d2b7fe700 1 --2- 172.21.15.146:0/2490592906 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d2c0b2430 0x7f5d2c0b5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:53.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.677+0000 7f5d2b7fe700 1 -- 172.21.15.146:0/2490592906 >> v1:172.21.15.151:6789/0 conn(0x7f5d2c0b2060 legacy=0x7f5d2c0ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:53.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.677+0000 7f5d2b7fe700 1 -- 172.21.15.146:0/2490592906 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d2c0b4590 con 0x7f5d2c0b3cf0 2023-10-06T11:08:53.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.677+0000 7f5d309bc700 1 --2- 172.21.15.146:0/2490592906 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d2c0b2430 0x7f5d2c0b5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:08:53.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.677+0000 7f5d2b7fe700 1 --2- 172.21.15.146:0/2490592906 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d2c0b3cf0 0x7f5d2c0ce860 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f5d200099b0 tx=0x7f5d20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae5ea978d818a807 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:53.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.677+0000 7f5d2affd700 1 -- 172.21.15.146:0/2490592906 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2000b820 con 0x7f5d2c0b3cf0 2023-10-06T11:08:53.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.677+0000 7f5d2affd700 1 -- 172.21.15.146:0/2490592906 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2000b980 con 0x7f5d2c0b3cf0 2023-10-06T11:08:53.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.677+0000 7f5d2affd700 1 -- 172.21.15.146:0/2490592906 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2000bd20 con 0x7f5d2c0b3cf0 2023-10-06T11:08:53.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.677+0000 7f5d311bd700 1 -- 172.21.15.146:0/2490592906 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d2c0b3cf0 msgr2=0x7f5d2c0ce860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:53.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.677+0000 7f5d311bd700 1 --2- 172.21.15.146:0/2490592906 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d2c0b3cf0 0x7f5d2c0ce860 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f5d200099b0 tx=0x7f5d20009250 comp rx=0 tx=0).stop 2023-10-06T11:08:53.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.677+0000 7f5d311bd700 1 -- 172.21.15.146:0/2490592906 shutdown_connections 2023-10-06T11:08:53.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.677+0000 7f5d311bd700 1 --2- 172.21.15.146:0/2490592906 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d2c0b2430 0x7f5d2c0b5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:53.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.677+0000 7f5d311bd700 1 --2- 172.21.15.146:0/2490592906 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d2c0b3cf0 0x7f5d2c0ce860 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:53.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.677+0000 7f5d311bd700 1 -- 172.21.15.146:0/2490592906 >> 172.21.15.146:0/2490592906 conn(0x7f5d2c06eba0 msgr2=0x7f5d2c06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:53.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.677+0000 7f5d311bd700 1 -- 172.21.15.146:0/2490592906 shutdown_connections 2023-10-06T11:08:53.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.677+0000 7f5d311bd700 1 -- 172.21.15.146:0/2490592906 wait complete. 2023-10-06T11:08:53.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.678+0000 7f5d311bd700 1 Processor -- start 2023-10-06T11:08:53.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.679+0000 7f5d311bd700 1 -- start start 2023-10-06T11:08:53.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.679+0000 7f5d311bd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d2c0b2060 0x7f5d2c0cc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:53.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.679+0000 7f5d311bd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d2c0b2430 0x7f5d2c151580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:53.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.679+0000 7f5d311bd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d2c0b3cf0 0x7f5d2c15a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:53.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.679+0000 7f5d311bd700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c15c7a0 con 0x7f5d2c0b2060 2023-10-06T11:08:53.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.679+0000 7f5d311bd700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c159940 con 0x7f5d2c0b2430 2023-10-06T11:08:53.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.679+0000 7f5d311bd700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2c15ca40 con 0x7f5d2c0b3cf0 2023-10-06T11:08:53.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.679+0000 7f5d2bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d2c0b2060 0x7f5d2c0cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:53.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.679+0000 7f5d2bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d2c0b2060 0x7f5d2c0cc550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34600/0 (socket says 172.21.15.146:34600) 2023-10-06T11:08:53.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.679+0000 7f5d2bfff700 1 -- 172.21.15.146:0/3995853485 learned_addr learned my addr 172.21.15.146:0/3995853485 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:53.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.680+0000 7f5d309bc700 1 --2- 172.21.15.146:0/3995853485 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d2c0b3cf0 0x7f5d2c15a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:53.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.680+0000 7f5d2b7fe700 1 --2- 172.21.15.146:0/3995853485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d2c0b2430 0x7f5d2c151580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:53.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.680+0000 7f5d2bfff700 1 -- 172.21.15.146:0/3995853485 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d2c0b3cf0 msgr2=0x7f5d2c15a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:53.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.680+0000 7f5d2bfff700 1 --2- 172.21.15.146:0/3995853485 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d2c0b3cf0 0x7f5d2c15a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:53.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.680+0000 7f5d2bfff700 1 -- 172.21.15.146:0/3995853485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d2c0b2430 msgr2=0x7f5d2c151580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:53.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.680+0000 7f5d2bfff700 1 --2- 172.21.15.146:0/3995853485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d2c0b2430 0x7f5d2c151580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:53.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.680+0000 7f5d2bfff700 1 -- 172.21.15.146:0/3995853485 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d200094f0 con 0x7f5d2c0b2060 2023-10-06T11:08:53.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.680+0000 7f5d2bfff700 1 --2- 172.21.15.146:0/3995853485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d2c0b2060 0x7f5d2c0cc550 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c00c5d0 tx=0x7f5d1c007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:53.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.680+0000 7f5d13fff700 1 -- 172.21.15.146:0/3995853485 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c011590 con 0x7f5d2c0b2060 2023-10-06T11:08:53.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.680+0000 7f5d13fff700 1 -- 172.21.15.146:0/3995853485 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d1c011710 con 0x7f5d2c0b2060 2023-10-06T11:08:53.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.680+0000 7f5d311bd700 1 -- 172.21.15.146:0/3995853485 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d2c15cd20 con 0x7f5d2c0b2060 2023-10-06T11:08:53.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.680+0000 7f5d13fff700 1 -- 172.21.15.146:0/3995853485 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c011ad0 con 0x7f5d2c0b2060 2023-10-06T11:08:53.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.680+0000 7f5d311bd700 1 -- 172.21.15.146:0/3995853485 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d2c0cca90 con 0x7f5d2c0b2060 2023-10-06T11:08:53.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.681+0000 7f5d13fff700 1 -- 172.21.15.146:0/3995853485 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5d1c01c460 con 0x7f5d2c0b2060 2023-10-06T11:08:53.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.682+0000 7f5d13fff700 1 --2- 172.21.15.146:0/3995853485 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5d18066f30 0x7f5d180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:53.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.682+0000 7f5d13fff700 1 -- 172.21.15.146:0/3995853485 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5d1c084490 con 0x7f5d2c0b2060 2023-10-06T11:08:53.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.682+0000 7f5d2b7fe700 1 --2- 172.21.15.146:0/3995853485 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5d18066f30 0x7f5d180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:53.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.682+0000 7f5d2b7fe700 1 --2- 172.21.15.146:0/3995853485 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5d18066f30 0x7f5d180693e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5d200099b0 tx=0x7f5d20016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:53.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.684+0000 7f5d3b717b80 1 Processor -- start 2023-10-06T11:08:53.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.684+0000 7f5d3b717b80 1 -- start start 2023-10-06T11:08:53.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.685+0000 7f5d3b717b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9f4144950 0x55b9f4144d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:53.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.685+0000 7f5d3b717b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b9f418ebc0 0x55b9f416d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:53.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.685+0000 7f5d3b717b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9f416de60 0x55b9f4140990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:53.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.685+0000 7f5d3b717b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9f40c4c80 con 0x55b9f4144950 2023-10-06T11:08:53.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.685+0000 7f5d3b717b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9f409ba70 con 0x55b9f416de60 2023-10-06T11:08:53.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.685+0000 7f5d3b717b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b9f4099270 con 0x55b9f418ebc0 2023-10-06T11:08:53.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.685+0000 7f5d2bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9f4144950 0x55b9f4144d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:53.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.685+0000 7f5d2bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9f4144950 0x55b9f4144d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34602/0 (socket says 172.21.15.146:34602) 2023-10-06T11:08:53.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.685+0000 7f5d2bfff700 1 -- 172.21.15.146:0/2041987565 learned_addr learned my addr 172.21.15.146:0/2041987565 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:53.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.685+0000 7f5d2bfff700 1 -- 172.21.15.146:0/2041987565 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b9f418ebc0 msgr2=0x55b9f416d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:53.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.685+0000 7f5d2bfff700 1 --2- 172.21.15.146:0/2041987565 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b9f418ebc0 0x55b9f416d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:53.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.685+0000 7f5d2bfff700 1 -- 172.21.15.146:0/2041987565 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9f416de60 msgr2=0x55b9f4140990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:53.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.685+0000 7f5d2bfff700 1 --2- 172.21.15.146:0/2041987565 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9f416de60 0x55b9f4140990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:53.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.685+0000 7f5d2bfff700 1 -- 172.21.15.146:0/2041987565 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b9f3f2f270 con 0x55b9f4144950 2023-10-06T11:08:53.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.685+0000 7f5d2bfff700 1 --2- 172.21.15.146:0/2041987565 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9f4144950 0x55b9f4144d20 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c051760 tx=0x7f5d1c0827b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57afaa6d3cfeacb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:53.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.685+0000 7f5d117fa700 1 -- 172.21.15.146:0/2041987565 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c055260 con 0x55b9f4144950 2023-10-06T11:08:53.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.685+0000 7f5d117fa700 1 -- 172.21.15.146:0/2041987565 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d1c0584b0 con 0x55b9f4144950 2023-10-06T11:08:53.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.685+0000 7f5d117fa700 1 -- 172.21.15.146:0/2041987565 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c05c200 con 0x55b9f4144950 2023-10-06T11:08:53.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.686+0000 7f5d3b717b80 1 -- 172.21.15.146:0/2041987565 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9f4144950 msgr2=0x55b9f4144d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:53.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.686+0000 7f5d3b717b80 1 --2- 172.21.15.146:0/2041987565 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9f4144950 0x55b9f4144d20 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c051760 tx=0x7f5d1c0827b0 comp rx=0 tx=0).stop 2023-10-06T11:08:53.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.686+0000 7f5d3b717b80 1 -- 172.21.15.146:0/2041987565 shutdown_connections 2023-10-06T11:08:53.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.686+0000 7f5d3b717b80 1 --2- 172.21.15.146:0/2041987565 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9f416de60 0x55b9f4140990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:53.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.686+0000 7f5d3b717b80 1 --2- 172.21.15.146:0/2041987565 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9f4144950 0x55b9f4144d20 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:53.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.686+0000 7f5d3b717b80 1 --2- 172.21.15.146:0/2041987565 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b9f418ebc0 0x55b9f416d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:53.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.686+0000 7f5d3b717b80 1 -- 172.21.15.146:0/2041987565 >> 172.21.15.146:0/2041987565 conn(0x55b9f4146270 msgr2=0x55b9f4146640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:53.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.686+0000 7f5d3b717b80 1 -- 172.21.15.146:0/2041987565 shutdown_connections 2023-10-06T11:08:53.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.686+0000 7f5d3b717b80 1 -- 172.21.15.146:0/2041987565 wait complete. 2023-10-06T11:08:53.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.687+0000 7f5d3b717b80 1 -- start start 2023-10-06T11:08:53.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.687+0000 7f5d3b717b80 1 Processor -- start 2023-10-06T11:08:53.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.687+0000 7f5d3b717b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9f4144950 0x55b9f419b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:53.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.687+0000 7f5d3b717b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b9f416de60 0x55b9f4184bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:53.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.687+0000 7f5d3b717b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9f418ebc0 0x55b9f41850f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:53.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.687+0000 7f5d3b717b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9f4095060 con 0x55b9f418ebc0 2023-10-06T11:08:53.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.687+0000 7f5d3b717b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9f4040890 con 0x55b9f4144950 2023-10-06T11:08:53.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.687+0000 7f5d3b717b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b9f405bea0 con 0x55b9f416de60 2023-10-06T11:08:53.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.687+0000 7f5d3b717b80 10 client.0 _ll_register_callbacks cb 0x55b9f3f31f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:08:53.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.687+0000 7f5d309bc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9f418ebc0 0x55b9f41850f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:53.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.687+0000 7f5d309bc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9f418ebc0 0x55b9f41850f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34604/0 (socket says 172.21.15.146:34604) 2023-10-06T11:08:53.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.688+0000 7f5d309bc700 1 -- 172.21.15.146:0/3561425139 learned_addr learned my addr 172.21.15.146:0/3561425139 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:53.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.688+0000 7f5d309bc700 1 -- 172.21.15.146:0/3561425139 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b9f416de60 msgr2=0x55b9f4184bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:53.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.688+0000 7f5d309bc700 1 --2- 172.21.15.146:0/3561425139 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b9f416de60 0x55b9f4184bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:53.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.688+0000 7f5d2bfff700 1 --2- 172.21.15.146:0/3561425139 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9f4144950 0x55b9f419b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:53.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.688+0000 7f5d309bc700 1 -- 172.21.15.146:0/3561425139 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9f4144950 msgr2=0x55b9f419b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:53.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.688+0000 7f5d309bc700 1 --2- 172.21.15.146:0/3561425139 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9f4144950 0x55b9f419b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:53.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.688+0000 7f5d309bc700 1 -- 172.21.15.146:0/3561425139 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d2c0cca90 con 0x55b9f418ebc0 2023-10-06T11:08:53.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.688+0000 7f5d309bc700 1 --2- 172.21.15.146:0/3561425139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9f418ebc0 0x55b9f41850f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f5d2400ed50 tx=0x7f5d24007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1aa7ed5ba33415b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:53.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.688+0000 7f5d0a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:08:53.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.688+0000 7f5d0a7fc700 1 -- 172.21.15.146:0/3561425139 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2400ce00 con 0x55b9f418ebc0 2023-10-06T11:08:53.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.688+0000 7f5d0a7fc700 1 -- 172.21.15.146:0/3561425139 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5d2400a440 con 0x55b9f418ebc0 2023-10-06T11:08:53.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.688+0000 7f5d3b717b80 1 -- 172.21.15.146:0/3561425139 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b9f4139690 con 0x55b9f418ebc0 2023-10-06T11:08:53.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.688+0000 7f5d0a7fc700 1 -- 172.21.15.146:0/3561425139 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d2400a810 con 0x55b9f418ebc0 2023-10-06T11:08:53.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.688+0000 7f5d3b717b80 10 client.5652 fetch_fsmap learned FSMap version 35 2023-10-06T11:08:53.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.688+0000 7f5d3b717b80 1 -- 172.21.15.146:0/3561425139 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) v3 -- 0x55b9f3ed1fe0 con 0x55b9f418ebc0 2023-10-06T11:08:53.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.688+0000 7f5d0a7fc700 1 -- 172.21.15.146:0/3561425139 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b9f4139690 con 0x55b9f418ebc0 2023-10-06T11:08:53.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.688+0000 7f5d0a7fc700 1 -- 172.21.15.146:0/3561425139 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 35) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5d2400a970 con 0x55b9f418ebc0 2023-10-06T11:08:53.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.688+0000 7f5d3b717b80 10 client.5652 fetch_fsmap finished waiting for FSMap version 35 2023-10-06T11:08:53.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.688+0000 7f5d3b717b80 10 client.5652 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T11:08:53.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.688+0000 7f5d3b717b80 20 client.5652 populate_metadata read hostname 'smithi146' 2023-10-06T11:08:53.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.688+0000 7f5d3b717b80 1 --2- 172.21.15.146:0/3561425139 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55b9f419bac0 0x55b9f416c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:53.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.688+0000 7f5d3b717b80 4 client.5652 mds_command: new command op to 5481 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:08:53.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.688+0000 7f5d3b717b80 1 -- 172.21.15.146:0/3561425139 --> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b9f41165c0 con 0x55b9f419bac0 2023-10-06T11:08:53.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.689+0000 7f5d2bfff700 1 --2- 172.21.15.146:0/3561425139 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55b9f419bac0 0x55b9f416c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:53.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.689+0000 7f5d0a7fc700 10 client.5652 ms_handle_connect on v2:172.21.15.146:6835/2252184844 2023-10-06T11:08:53.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.689+0000 7f5d2bfff700 1 --2- 172.21.15.146:0/3561425139 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55b9f419bac0 0x55b9f416c010 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=426075e38c36c8f2 server_cookie=9b0ed352e86ef996 in_seq=0 out_seq=0 2023-10-06T11:08:53.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.689+0000 7f5d0a7fc700 1 -- 172.21.15.146:0/3561425139 <== mds.0 v2:172.21.15.146:6835/2252184844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55b9f41165c0 con 0x55b9f419bac0 2023-10-06T11:08:53.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.689+0000 7f5d0a7fc700 10 client.5652 handle_command_reply: tid=0 2023-10-06T11:08:53.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.689+0000 7f5d3b717b80 1 client.5652 shutdown 2023-10-06T11:08:53.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.689+0000 7f5d3b717b80 1 -- 172.21.15.146:0/3561425139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9f418ebc0 msgr2=0x55b9f41850f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:53.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.689+0000 7f5d3b717b80 1 --2- 172.21.15.146:0/3561425139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9f418ebc0 0x55b9f41850f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f5d2400ed50 tx=0x7f5d24007a20 comp rx=0 tx=0).stop 2023-10-06T11:08:53.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.690+0000 7f5d3b717b80 1 -- 172.21.15.146:0/3561425139 shutdown_connections 2023-10-06T11:08:53.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.690+0000 7f5d3b717b80 1 --2- 172.21.15.146:0/3561425139 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55b9f419bac0 0x55b9f416c010 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:53.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.690+0000 7f5d3b717b80 1 --2- 172.21.15.146:0/3561425139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9f418ebc0 0x55b9f41850f0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:53.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.690+0000 7f5d0a7fc700 0 client.5652 ms_handle_reset on v2:172.21.15.146:6835/2252184844 2023-10-06T11:08:53.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.690+0000 7f5d3b717b80 1 --2- 172.21.15.146:0/3561425139 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9f4144950 0x55b9f419b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:53.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.690+0000 7f5d3b717b80 1 --2- 172.21.15.146:0/3561425139 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b9f416de60 0x55b9f4184bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:53.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.690+0000 7f5d3b717b80 1 -- 172.21.15.146:0/3561425139 >> 172.21.15.146:0/3561425139 conn(0x55b9f4146270 msgr2=0x55b9f418a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:53.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.690+0000 7f5d3b717b80 1 -- 172.21.15.146:0/3561425139 shutdown_connections 2023-10-06T11:08:53.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.690+0000 7f5d3b717b80 1 -- 172.21.15.146:0/3561425139 wait complete. 2023-10-06T11:08:53.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.690+0000 7f5d3b717b80 20 client.5652 trim_cache size 0 max 16384 2023-10-06T11:08:53.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.707+0000 7f5d3b717b80 1 Processor -- start 2023-10-06T11:08:53.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.707+0000 7f5d3b717b80 1 -- start start 2023-10-06T11:08:53.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.707+0000 7f5d3b717b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9f4144950 0x55b9f4169920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:53.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.707+0000 7f5d3b717b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b9f416de60 0x55b9f4184b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:53.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.707+0000 7f5d3b717b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9f418ebc0 0x55b9f4185040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:53.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.707+0000 7f5d3b717b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9f4143c40 con 0x55b9f418ebc0 2023-10-06T11:08:53.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.707+0000 7f5d3b717b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9f3f17e30 con 0x55b9f4144950 2023-10-06T11:08:53.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.707+0000 7f5d3b717b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b9f413d280 con 0x55b9f416de60 2023-10-06T11:08:53.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.708+0000 7f5d309bc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9f418ebc0 0x55b9f4185040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:53.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.708+0000 7f5d309bc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9f418ebc0 0x55b9f4185040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34606/0 (socket says 172.21.15.146:34606) 2023-10-06T11:08:53.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.708+0000 7f5d309bc700 1 -- 172.21.15.146:0/678449047 learned_addr learned my addr 172.21.15.146:0/678449047 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:53.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.708+0000 7f5d2bfff700 1 --2- 172.21.15.146:0/678449047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9f4144950 0x55b9f4169920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:53.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.708+0000 7f5d2b7fe700 1 --2- 172.21.15.146:0/678449047 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b9f416de60 0x55b9f4184b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:53.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.708+0000 7f5d309bc700 1 -- 172.21.15.146:0/678449047 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b9f416de60 msgr2=0x55b9f4184b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:53.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.708+0000 7f5d309bc700 1 --2- 172.21.15.146:0/678449047 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b9f416de60 0x55b9f4184b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:53.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.708+0000 7f5d309bc700 1 -- 172.21.15.146:0/678449047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9f4144950 msgr2=0x55b9f4169920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:53.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.708+0000 7f5d309bc700 1 --2- 172.21.15.146:0/678449047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9f4144950 0x55b9f4169920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:53.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.708+0000 7f5d309bc700 1 -- 172.21.15.146:0/678449047 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b9f4063780 con 0x55b9f418ebc0 2023-10-06T11:08:53.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.708+0000 7f5d309bc700 1 --2- 172.21.15.146:0/678449047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9f418ebc0 0x55b9f4185040 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f5d2400afd0 tx=0x7f5d24019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=898d22a77b8a138e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:53.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.708+0000 7f5d11ffb700 1 -- 172.21.15.146:0/678449047 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2400a440 con 0x55b9f418ebc0 2023-10-06T11:08:53.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.708+0000 7f5d11ffb700 1 -- 172.21.15.146:0/678449047 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d240076d0 con 0x55b9f418ebc0 2023-10-06T11:08:53.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.708+0000 7f5d11ffb700 1 -- 172.21.15.146:0/678449047 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2400a810 con 0x55b9f418ebc0 2023-10-06T11:08:53.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.709+0000 7f5d3b717b80 1 -- 172.21.15.146:0/678449047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9f418ebc0 msgr2=0x55b9f4185040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:53.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.709+0000 7f5d3b717b80 1 --2- 172.21.15.146:0/678449047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9f418ebc0 0x55b9f4185040 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f5d2400afd0 tx=0x7f5d24019000 comp rx=0 tx=0).stop 2023-10-06T11:08:53.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.709+0000 7f5d3b717b80 1 -- 172.21.15.146:0/678449047 shutdown_connections 2023-10-06T11:08:53.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.709+0000 7f5d3b717b80 1 --2- 172.21.15.146:0/678449047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9f418ebc0 0x55b9f4185040 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:53.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.709+0000 7f5d3b717b80 1 --2- 172.21.15.146:0/678449047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9f4144950 0x55b9f4169920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:53.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.709+0000 7f5d3b717b80 1 --2- 172.21.15.146:0/678449047 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b9f416de60 0x55b9f4184b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:53.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.709+0000 7f5d3b717b80 1 -- 172.21.15.146:0/678449047 >> 172.21.15.146:0/678449047 conn(0x55b9f4146270 msgr2=0x55b9f4147cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:53.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.709+0000 7f5d3b717b80 1 -- 172.21.15.146:0/678449047 shutdown_connections 2023-10-06T11:08:53.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.709+0000 7f5d3b717b80 1 -- 172.21.15.146:0/678449047 wait complete. 2023-10-06T11:08:53.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.709+0000 7f5d3b717b80 1 -- start start 2023-10-06T11:08:53.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.709+0000 7f5d3b717b80 1 Processor -- start 2023-10-06T11:08:53.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.710+0000 7f5d3b717b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b9f4144950 0x55b9f41eb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:53.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.710+0000 7f5d3b717b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9f416de60 0x55b9f41745a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:53.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.710+0000 7f5d3b717b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9f418ebc0 0x55b9f4174ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:53.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.710+0000 7f5d3b717b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9f41ad2d0 con 0x55b9f416de60 2023-10-06T11:08:53.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.710+0000 7f5d3b717b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9f41f2830 con 0x55b9f418ebc0 2023-10-06T11:08:53.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.710+0000 7f5d3b717b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b9f4188a00 con 0x55b9f4144950 2023-10-06T11:08:53.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.710+0000 7f5d3b717b80 10 client.0 _ll_register_callbacks cb 0x55b9f3f31f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:08:53.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.710+0000 7f5d2b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9f416de60 0x55b9f41745a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:53.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.710+0000 7f5d2b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9f416de60 0x55b9f41745a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34620/0 (socket says 172.21.15.146:34620) 2023-10-06T11:08:53.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.710+0000 7f5d2b7fe700 1 -- 172.21.15.146:0/2566876518 learned_addr learned my addr 172.21.15.146:0/2566876518 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:53.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.710+0000 7f5d2bfff700 1 --2- 172.21.15.146:0/2566876518 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b9f4144950 0x55b9f41eb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:53.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.710+0000 7f5d309bc700 1 --2- 172.21.15.146:0/2566876518 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9f418ebc0 0x55b9f4174ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:53.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.710+0000 7f5d2b7fe700 1 -- 172.21.15.146:0/2566876518 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b9f4144950 msgr2=0x55b9f41eb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:53.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.710+0000 7f5d2b7fe700 1 --2- 172.21.15.146:0/2566876518 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b9f4144950 0x55b9f41eb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:53.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.710+0000 7f5d2b7fe700 1 -- 172.21.15.146:0/2566876518 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9f418ebc0 msgr2=0x55b9f4174ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:53.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.710+0000 7f5d2b7fe700 1 --2- 172.21.15.146:0/2566876518 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9f418ebc0 0x55b9f4174ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:53.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.710+0000 7f5d2b7fe700 1 -- 172.21.15.146:0/2566876518 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b9f3ed1fe0 con 0x55b9f416de60 2023-10-06T11:08:53.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.711+0000 7f5d2b7fe700 1 --2- 172.21.15.146:0/2566876518 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9f416de60 0x55b9f41745a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c088db0 tx=0x7f5d2001f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7122bd797b3b1f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:53.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.711+0000 7f5d0a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:08:53.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.711+0000 7f5d0a7fc700 1 -- 172.21.15.146:0/2566876518 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2000be50 con 0x55b9f416de60 2023-10-06T11:08:53.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.711+0000 7f5d0a7fc700 1 -- 172.21.15.146:0/2566876518 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5d20034c50 con 0x55b9f416de60 2023-10-06T11:08:53.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.711+0000 7f5d3b717b80 1 -- 172.21.15.146:0/2566876518 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5d1c0584b0 con 0x55b9f416de60 2023-10-06T11:08:53.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.711+0000 7f5d0a7fc700 1 -- 172.21.15.146:0/2566876518 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d20011ab0 con 0x55b9f416de60 2023-10-06T11:08:53.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.711+0000 7f5d3b717b80 10 client.5658 fetch_fsmap learned FSMap version 35 2023-10-06T11:08:53.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.711+0000 7f5d3b717b80 1 -- 172.21.15.146:0/2566876518 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) v3 -- 0x55b9f404a470 con 0x55b9f416de60 2023-10-06T11:08:53.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.711+0000 7f5d0a7fc700 1 -- 172.21.15.146:0/2566876518 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d1c0584b0 con 0x55b9f416de60 2023-10-06T11:08:53.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.711+0000 7f5d0a7fc700 1 -- 172.21.15.146:0/2566876518 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 35) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5d20011c10 con 0x55b9f416de60 2023-10-06T11:08:53.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.711+0000 7f5d3b717b80 10 client.5658 fetch_fsmap finished waiting for FSMap version 35 2023-10-06T11:08:53.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.711+0000 7f5d3b717b80 10 client.5658 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T11:08:53.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.711+0000 7f5d3b717b80 20 client.5658 populate_metadata read hostname 'smithi146' 2023-10-06T11:08:53.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.711+0000 7f5d3b717b80 1 --2- 172.21.15.146:0/2566876518 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55b9f41f1650 0x55b9f41f1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:53.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.711+0000 7f5d3b717b80 4 client.5658 mds_command: new command op to 5481 tid=0[{"prefix": "status"}] 2023-10-06T11:08:53.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.711+0000 7f5d3b717b80 1 -- 172.21.15.146:0/2566876518 --> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b9f4037e00 con 0x55b9f41f1650 2023-10-06T11:08:53.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.711+0000 7f5d2bfff700 1 --2- 172.21.15.146:0/2566876518 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55b9f41f1650 0x55b9f41f1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:53.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.712+0000 7f5d0a7fc700 10 client.5658 ms_handle_connect on v2:172.21.15.146:6835/2252184844 2023-10-06T11:08:53.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.712+0000 7f5d2bfff700 1 --2- 172.21.15.146:0/2566876518 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55b9f41f1650 0x55b9f41f1a20 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bab320cba1a93cc server_cookie=d6c4c1a643fb9a6b in_seq=0 out_seq=0 2023-10-06T11:08:53.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.712+0000 7f5d0a7fc700 1 -- 172.21.15.146:0/2566876518 <== mds.0 v2:172.21.15.146:6835/2252184844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55b9f4037e00 con 0x55b9f41f1650 2023-10-06T11:08:53.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.712+0000 7f5d0a7fc700 10 client.5658 handle_command_reply: tid=0 2023-10-06T11:08:53.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.712+0000 7f5d3b717b80 1 client.5658 shutdown 2023-10-06T11:08:53.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.712+0000 7f5d3b717b80 1 -- 172.21.15.146:0/2566876518 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9f416de60 msgr2=0x55b9f41745a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:53.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.712+0000 7f5d3b717b80 1 --2- 172.21.15.146:0/2566876518 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9f416de60 0x55b9f41745a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c088db0 tx=0x7f5d2001f040 comp rx=0 tx=0).stop 2023-10-06T11:08:53.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.712+0000 7f5d3b717b80 1 -- 172.21.15.146:0/2566876518 shutdown_connections 2023-10-06T11:08:53.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.712+0000 7f5d3b717b80 1 --2- 172.21.15.146:0/2566876518 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55b9f41f1650 0x55b9f41f1a20 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:53.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.712+0000 7f5d3b717b80 1 --2- 172.21.15.146:0/2566876518 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9f418ebc0 0x55b9f4174ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:53.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.712+0000 7f5d0a7fc700 0 client.5658 ms_handle_reset on v2:172.21.15.146:6835/2252184844 2023-10-06T11:08:53.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.712+0000 7f5d3b717b80 1 --2- 172.21.15.146:0/2566876518 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b9f4144950 0x55b9f41eb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:53.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.712+0000 7f5d3b717b80 1 --2- 172.21.15.146:0/2566876518 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b9f416de60 0x55b9f41745a0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:53.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.712+0000 7f5d3b717b80 1 -- 172.21.15.146:0/2566876518 >> 172.21.15.146:0/2566876518 conn(0x55b9f4146270 msgr2=0x55b9f4185920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:53.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.712+0000 7f5d3b717b80 1 -- 172.21.15.146:0/2566876518 shutdown_connections 2023-10-06T11:08:53.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.712+0000 7f5d3b717b80 1 -- 172.21.15.146:0/2566876518 wait complete. 2023-10-06T11:08:53.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.712+0000 7f5d3b717b80 20 client.5658 trim_cache size 0 max 16384 2023-10-06T11:08:53.722 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:08:53.722 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1", 2023-10-06T11:08:53.722 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2023-10-06T11:08:53.722 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 5481, 2023-10-06T11:08:53.723 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2023-10-06T11:08:53.723 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2023-10-06T11:08:53.723 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2023-10-06T11:08:53.723 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 10.293090960000001, 2023-10-06T11:08:53.723 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 35, 2023-10-06T11:08:53.723 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 47, 2023-10-06T11:08:53.723 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 47, 2023-10-06T11:08:53.723 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 16.417171699000001 2023-10-06T11:08:53.723 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:08:53.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.712+0000 7f5d311bd700 1 -- 172.21.15.146:0/3995853485 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5d18066f30 msgr2=0x7f5d180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:53.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.712+0000 7f5d311bd700 1 --2- 172.21.15.146:0/3995853485 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5d18066f30 0x7f5d180693e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5d200099b0 tx=0x7f5d20016000 comp rx=0 tx=0).stop 2023-10-06T11:08:53.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.712+0000 7f5d311bd700 1 -- 172.21.15.146:0/3995853485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d2c0b2060 msgr2=0x7f5d2c0cc550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:53.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.712+0000 7f5d311bd700 1 --2- 172.21.15.146:0/3995853485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d2c0b2060 0x7f5d2c0cc550 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c00c5d0 tx=0x7f5d1c007f60 comp rx=0 tx=0).stop 2023-10-06T11:08:53.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.712+0000 7f5d311bd700 1 -- 172.21.15.146:0/3995853485 shutdown_connections 2023-10-06T11:08:53.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.712+0000 7f5d311bd700 1 --2- 172.21.15.146:0/3995853485 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5d18066f30 0x7f5d180693e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:53.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.712+0000 7f5d311bd700 1 --2- 172.21.15.146:0/3995853485 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5d2c0b3cf0 0x7f5d2c15a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:53.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.712+0000 7f5d311bd700 1 --2- 172.21.15.146:0/3995853485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5d2c0b2060 0x7f5d2c0cc550 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:53.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.712+0000 7f5d311bd700 1 --2- 172.21.15.146:0/3995853485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d2c0b2430 0x7f5d2c151580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:53.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.713+0000 7f5d311bd700 1 -- 172.21.15.146:0/3995853485 >> 172.21.15.146:0/3995853485 conn(0x7f5d2c06eba0 msgr2=0x7f5d2c0ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:53.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.713+0000 7f5d311bd700 1 -- 172.21.15.146:0/3995853485 shutdown_connections 2023-10-06T11:08:53.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.713+0000 7f5d311bd700 1 -- 172.21.15.146:0/3995853485 wait complete. 2023-10-06T11:08:53.726 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T11:08:53.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.840+0000 7f325f59e700 1 Processor -- start 2023-10-06T11:08:53.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.840+0000 7f325f59e700 1 -- start start 2023-10-06T11:08:53.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.841+0000 7f325f59e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f326015a7f0 0x7f326015cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:53.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.841+0000 7f325f59e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f326015c630 con 0x7f326015a420 2023-10-06T11:08:53.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.841+0000 7f325f59e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f326015ba20 con 0x7f32600b2530 2023-10-06T11:08:53.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.841+0000 7f325f59e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32600ce040 con 0x7f326015a7f0 2023-10-06T11:08:53.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.841+0000 7f325e59c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f326015a420 0x7f32600b1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35720/0 (socket says 172.21.15.146:35720) 2023-10-06T11:08:53.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.841+0000 7f325e59c700 1 -- 172.21.15.146:0/28055818 learned_addr learned my addr 172.21.15.146:0/28055818 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:08:53.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.841+0000 7f325d59a700 1 -- 172.21.15.146:0/28055818 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1101289540 0 0) 0x7f326015c630 con 0x7f326015a420 2023-10-06T11:08:53.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.841+0000 7f325d59a700 1 -- 172.21.15.146:0/28055818 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3248003570 con 0x7f326015a420 2023-10-06T11:08:53.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.841+0000 7f325dd9b700 1 --2- 172.21.15.146:0/28055818 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f326015a7f0 0x7f326015cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:53.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.841+0000 7f325d59a700 1 -- 172.21.15.146:0/28055818 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 527941870 0 0) 0x7f3248003570 con 0x7f326015a420 2023-10-06T11:08:53.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.841+0000 7f325d59a700 1 -- 172.21.15.146:0/28055818 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f326015a7f0 msgr2=0x7f326015cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:53.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.841+0000 7f325d59a700 1 --2- 172.21.15.146:0/28055818 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f326015a7f0 0x7f326015cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:53.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.842+0000 7f325d59a700 1 -- 172.21.15.146:0/28055818 >> v1:172.21.15.151:6789/0 conn(0x7f32600b2530 legacy=0x7f326015acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:53.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.842+0000 7f325d59a700 1 -- 172.21.15.146:0/28055818 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f326015bd00 con 0x7f326015a420 2023-10-06T11:08:53.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.842+0000 7f325d59a700 1 -- 172.21.15.146:0/28055818 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f3250001470 con 0x7f326015a420 2023-10-06T11:08:53.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.842+0000 7f325d59a700 1 -- 172.21.15.146:0/28055818 >> v1:172.21.15.146:6789/0 conn(0x7f326015a420 legacy=0x7f32600b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:53.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.842+0000 7f325d59a700 1 --2- 172.21.15.146:0/28055818 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3248003a90 0x7f3248003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:53.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.842+0000 7f325d59a700 1 --2- 172.21.15.146:0/28055818 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f326015a7f0 0x7f3248004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:53.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.842+0000 7f325d59a700 1 --2- 172.21.15.146:0/28055818 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3248004d50 0x7f32480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:53.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.842+0000 7f325d59a700 1 -- 172.21.15.146:0/28055818 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f324800bb40 con 0x7f3248003a90 2023-10-06T11:08:53.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.842+0000 7f325d59a700 1 -- 172.21.15.146:0/28055818 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f324800bcb0 con 0x7f3248004d50 2023-10-06T11:08:53.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.842+0000 7f325d59a700 1 -- 172.21.15.146:0/28055818 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f324800be70 con 0x7f326015a7f0 2023-10-06T11:08:53.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.842+0000 7f325e59c700 1 --2- 172.21.15.146:0/28055818 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3248003a90 0x7f3248003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:53.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.842+0000 7f325dd9b700 1 --2- 172.21.15.146:0/28055818 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f326015a7f0 0x7f3248004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:53.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.842+0000 7f325ed9d700 1 --2- 172.21.15.146:0/28055818 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3248004d50 0x7f32480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:53.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.842+0000 7f325e59c700 1 -- 172.21.15.146:0/28055818 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f326015a7f0 msgr2=0x7f3248004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:53.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.842+0000 7f325e59c700 1 --2- 172.21.15.146:0/28055818 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f326015a7f0 0x7f3248004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:53.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.842+0000 7f325e59c700 1 -- 172.21.15.146:0/28055818 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3248004d50 msgr2=0x7f32480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:08:53.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.842+0000 7f325e59c700 1 --2- 172.21.15.146:0/28055818 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3248004d50 0x7f32480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:53.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.842+0000 7f325e59c700 1 -- 172.21.15.146:0/28055818 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3248003570 con 0x7f3248003a90 2023-10-06T11:08:53.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.842+0000 7f325e59c700 1 --2- 172.21.15.146:0/28055818 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3248003a90 0x7f3248003ea0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f325000c3c0 tx=0x7f3250001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d53c766b9426d0b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:53.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.842+0000 7f325d59a700 1 -- 172.21.15.146:0/28055818 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325000cc90 con 0x7f3248003a90 2023-10-06T11:08:53.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.842+0000 7f325d59a700 1 -- 172.21.15.146:0/28055818 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f325000cdf0 con 0x7f3248003a90 2023-10-06T11:08:53.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.842+0000 7f325d59a700 1 -- 172.21.15.146:0/28055818 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3250005b50 con 0x7f3248003a90 2023-10-06T11:08:53.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.843+0000 7f325f59e700 1 -- 172.21.15.146:0/28055818 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3248003a90 msgr2=0x7f3248003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:53.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.843+0000 7f325f59e700 1 --2- 172.21.15.146:0/28055818 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3248003a90 0x7f3248003ea0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f325000c3c0 tx=0x7f3250001e50 comp rx=0 tx=0).stop 2023-10-06T11:08:53.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.843+0000 7f325ed9d700 1 -- 172.21.15.146:0/28055818 reap_dead start 2023-10-06T11:08:53.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.843+0000 7f325f59e700 1 -- 172.21.15.146:0/28055818 shutdown_connections 2023-10-06T11:08:53.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.843+0000 7f325f59e700 1 -- 172.21.15.146:0/28055818 >> 172.21.15.146:0/28055818 conn(0x7f326006eba0 msgr2=0x7f326006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:53.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.843+0000 7f325f59e700 1 -- 172.21.15.146:0/28055818 shutdown_connections 2023-10-06T11:08:53.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.843+0000 7f325f59e700 1 -- 172.21.15.146:0/28055818 wait complete. 2023-10-06T11:08:53.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.844+0000 7f325f59e700 1 Processor -- start 2023-10-06T11:08:53.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.844+0000 7f325f59e700 1 -- start start 2023-10-06T11:08:53.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.845+0000 7f325f59e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3248003a90 0x7f3260150b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:53.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.845+0000 7f325f59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3260138e00 0x7f326006efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:53.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.845+0000 7f325f59e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f326006f4e0 0x7f3260152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:53.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.845+0000 7f325f59e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f326006f980 con 0x7f3260138e00 2023-10-06T11:08:53.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.845+0000 7f325f59e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3260169d50 con 0x7f3248003a90 2023-10-06T11:08:53.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.845+0000 7f325f59e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f326016a030 con 0x7f326006f4e0 2023-10-06T11:08:53.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.845+0000 7f325dd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3260138e00 0x7f326006efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:53.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.845+0000 7f325dd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3260138e00 0x7f326006efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34642/0 (socket says 172.21.15.146:34642) 2023-10-06T11:08:53.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.845+0000 7f325dd9b700 1 -- 172.21.15.146:0/1907232996 learned_addr learned my addr 172.21.15.146:0/1907232996 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:08:53.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.845+0000 7f325e59c700 1 --2- 172.21.15.146:0/1907232996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3248003a90 0x7f3260150b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:53.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.845+0000 7f325ed9d700 1 --2- 172.21.15.146:0/1907232996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f326006f4e0 0x7f3260152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:53.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.845+0000 7f325dd9b700 1 -- 172.21.15.146:0/1907232996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f326006f4e0 msgr2=0x7f3260152a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:53.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.845+0000 7f325dd9b700 1 --2- 172.21.15.146:0/1907232996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f326006f4e0 0x7f3260152a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:53.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.845+0000 7f325dd9b700 1 -- 172.21.15.146:0/1907232996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3248003a90 msgr2=0x7f3260150b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:53.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.845+0000 7f325dd9b700 1 --2- 172.21.15.146:0/1907232996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3248003a90 0x7f3260150b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:53.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.845+0000 7f325dd9b700 1 -- 172.21.15.146:0/1907232996 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f326016a310 con 0x7f3260138e00 2023-10-06T11:08:53.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.845+0000 7f325e59c700 1 --2- 172.21.15.146:0/1907232996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3248003a90 0x7f3260150b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:08:53.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.845+0000 7f325dd9b700 1 --2- 172.21.15.146:0/1907232996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3260138e00 0x7f326006efa0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f3254011990 tx=0x7f3254008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:53.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.845+0000 7f324e7fc700 1 -- 172.21.15.146:0/1907232996 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325400f6d0 con 0x7f3260138e00 2023-10-06T11:08:53.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.845+0000 7f324e7fc700 1 -- 172.21.15.146:0/1907232996 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f325400f830 con 0x7f3260138e00 2023-10-06T11:08:53.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.845+0000 7f325f59e700 1 -- 172.21.15.146:0/1907232996 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f326016a5f0 con 0x7f3260138e00 2023-10-06T11:08:53.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.845+0000 7f324e7fc700 1 -- 172.21.15.146:0/1907232996 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f325400fbf0 con 0x7f3260138e00 2023-10-06T11:08:53.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.845+0000 7f325f59e700 1 -- 172.21.15.146:0/1907232996 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3260139270 con 0x7f3260138e00 2023-10-06T11:08:53.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.846+0000 7f325f59e700 1 -- 172.21.15.146:0/1907232996 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f326016d1c0 con 0x7f3260138e00 2023-10-06T11:08:53.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.847+0000 7f324e7fc700 1 -- 172.21.15.146:0/1907232996 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3254015460 con 0x7f3260138e00 2023-10-06T11:08:53.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.847+0000 7f324e7fc700 1 --2- 172.21.15.146:0/1907232996 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3240066f30 0x7f32400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:08:53.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.847+0000 7f324e7fc700 1 -- 172.21.15.146:0/1907232996 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f32540847b0 con 0x7f3260138e00 2023-10-06T11:08:53.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.847+0000 7f325e59c700 1 --2- 172.21.15.146:0/1907232996 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3240066f30 0x7f32400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:08:53.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.847+0000 7f325e59c700 1 --2- 172.21.15.146:0/1907232996 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3240066f30 0x7f32400693e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f326016cff0 tx=0x7f3250015000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:08:53.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:53.851+0000 7f324e7fc700 1 -- 172.21.15.146:0/1907232996 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f32540518c0 con 0x7f3260138e00 2023-10-06T11:08:54.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:54.078+0000 7f325f59e700 1 -- 172.21.15.146:0/1907232996 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f32600afae0 con 0x7f3260138e00 2023-10-06T11:08:54.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:54.078+0000 7f324e7fc700 1 -- 172.21.15.146:0/1907232996 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v35) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3254054ee0 con 0x7f3260138e00 2023-10-06T11:08:54.080 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T11:08:54.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:54.080+0000 7f325f59e700 1 -- 172.21.15.146:0/1907232996 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3240066f30 msgr2=0x7f32400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:54.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:54.080+0000 7f325f59e700 1 --2- 172.21.15.146:0/1907232996 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3240066f30 0x7f32400693e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f326016cff0 tx=0x7f3250015000 comp rx=0 tx=0).stop 2023-10-06T11:08:54.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:54.080+0000 7f325f59e700 1 -- 172.21.15.146:0/1907232996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3260138e00 msgr2=0x7f326006efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:08:54.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:54.080+0000 7f325f59e700 1 --2- 172.21.15.146:0/1907232996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3260138e00 0x7f326006efa0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f3254011990 tx=0x7f3254008040 comp rx=0 tx=0).stop 2023-10-06T11:08:54.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:54.080+0000 7f325f59e700 1 -- 172.21.15.146:0/1907232996 shutdown_connections 2023-10-06T11:08:54.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:54.080+0000 7f325f59e700 1 --2- 172.21.15.146:0/1907232996 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3240066f30 0x7f32400693e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:54.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:54.080+0000 7f325f59e700 1 --2- 172.21.15.146:0/1907232996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f326006f4e0 0x7f3260152a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:54.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:54.080+0000 7f325f59e700 1 --2- 172.21.15.146:0/1907232996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3248003a90 0x7f3260150b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:54.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:54.080+0000 7f325f59e700 1 --2- 172.21.15.146:0/1907232996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3260138e00 0x7f326006efa0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:08:54.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:54.080+0000 7f325f59e700 1 -- 172.21.15.146:0/1907232996 >> 172.21.15.146:0/1907232996 conn(0x7f326006eba0 msgr2=0x7f326014f950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:08:54.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:54.080+0000 7f325f59e700 1 -- 172.21.15.146:0/1907232996 shutdown_connections 2023-10-06T11:08:54.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:08:54.080+0000 7f325f59e700 1 -- 172.21.15.146:0/1907232996 wait complete. 2023-10-06T11:08:54.094 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T11:08:54.094 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T11:08:54.094 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2023-10-06T11:08:54.094 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T11:08:54.094 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T11:08:54.094 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T11:08:54.094 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T11:08:54.094 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T11:08:54.095 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:08:54.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:08:54.095 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2023-10-06T11:08:54.110 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:08:54.110 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:08:54.110 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:08:54.110 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:08:54.111 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2023-10-06T11:08:54.111 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:08:54.111 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:08:54.111 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2023-10-06T11:08:54.111 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2023-10-06T11:08:54.111 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:08:54.111 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2023-10-06T11:08:54.111 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2023-10-06T11:08:54.111 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:08:54.111 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2023-10-06T11:08:54.111 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T11:08:54.111 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2023-10-06T11:08:54.111 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T11:08:54.112 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42323sec preferred_lft 42323sec 2023-10-06T11:08:54.112 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link noprefixroute 2023-10-06T11:08:54.112 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:08:54.112 INFO:teuthology.orchestra.run.smithi146.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T11:08:54.112 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0e:4f:33:80:c4:0e brd ff:ff:ff:ff:ff:ff 2023-10-06T11:08:54.112 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T11:08:54.112 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:08:54.112 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3884:6eff:fefc:ffc7/64 scope link 2023-10-06T11:08:54.112 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:08:54.112 INFO:teuthology.orchestra.run.smithi146.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:08:54.112 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0e:4f:33:80:c4:0e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T11:08:54.112 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::c4f:33ff:fe80:c40e/64 scope link 2023-10-06T11:08:54.113 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:08:54.113 INFO:teuthology.orchestra.run.smithi146.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:08:54.113 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 36:96:28:73:57:c4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T11:08:54.113 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3496:28ff:fe73:57c4/64 scope link 2023-10-06T11:08:54.113 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:08:54.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:08:54.113 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T11:08:54.173 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-06T11:08:54.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:08:54.174 DEBUG:teuthology.orchestra.run.smithi146:> route 2023-10-06T11:08:54.230 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2023-10-06T11:08:54.230 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T11:08:54.230 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T11:08:54.231 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T11:08:54.231 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T11:08:54.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:08:54.231 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-10-06T11:08:54.231 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:08:54.231 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T11:08:54.231 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T11:08:54.231 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T11:08:54.231 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:08:54.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:08:54.331 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-10-06T11:08:54.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T11:08:54.345 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T11:08:54.346 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:08:54.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:08:54.346 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2023-10-06T11:08:54.410 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T11:08:54.410 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:08:54.410 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T11:08:54.465 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:08:54.465 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:08:54.466 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:08:54.520 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-06T11:08:54.584 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:08:54.584 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:08:54.648 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:08:54.649 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:08:54.649 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:08:54.649 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-06T11:08:54.704 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T11:08:54.705 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T11:08:54.747 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-06T11:08:54.771 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:08:54.772 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:08:54.829 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:2023-10-06T11:08:54.827+0000 7fb872055540 -1 init, newargv = 0x563c4f58aca0 newargc=15 2023-10-06T11:08:54.829 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[112923]: starting ceph client 2023-10-06T11:08:54.833 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[112923]: starting fuse 2023-10-06T11:08:54.837 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:08:54.838 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:08:54.839 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:08:54.839 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-06T11:08:54.894 INFO:teuthology.orchestra.run.smithi146.stdout:46 2023-10-06T11:08:54.894 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-06T11:08:54.894 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T11:08:54.894 DEBUG:teuthology.orchestra.run.smithi146:> import glob 2023-10-06T11:08:54.895 DEBUG:teuthology.orchestra.run.smithi146:> import re 2023-10-06T11:08:54.895 DEBUG:teuthology.orchestra.run.smithi146:> import os 2023-10-06T11:08:54.895 DEBUG:teuthology.orchestra.run.smithi146:> import subprocess 2023-10-06T11:08:54.895 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:08:54.895 DEBUG:teuthology.orchestra.run.smithi146:> def _find_admin_socket(client_name): 2023-10-06T11:08:54.895 DEBUG:teuthology.orchestra.run.smithi146:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T11:08:54.895 DEBUG:teuthology.orchestra.run.smithi146:> files = glob.glob(asok_path) 2023-10-06T11:08:54.895 DEBUG:teuthology.orchestra.run.smithi146:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T11:08:54.895 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:08:54.895 DEBUG:teuthology.orchestra.run.smithi146:> # Given a non-glob path, it better be there 2023-10-06T11:08:54.896 DEBUG:teuthology.orchestra.run.smithi146:> if "*" not in asok_path: 2023-10-06T11:08:54.896 DEBUG:teuthology.orchestra.run.smithi146:> assert(len(files) == 1) 2023-10-06T11:08:54.896 DEBUG:teuthology.orchestra.run.smithi146:> return files[0] 2023-10-06T11:08:54.896 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:08:54.896 DEBUG:teuthology.orchestra.run.smithi146:> for f in files: 2023-10-06T11:08:54.896 DEBUG:teuthology.orchestra.run.smithi146:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T11:08:54.896 DEBUG:teuthology.orchestra.run.smithi146:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T11:08:54.896 DEBUG:teuthology.orchestra.run.smithi146:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T11:08:54.896 DEBUG:teuthology.orchestra.run.smithi146:> contents = proc_f.read() 2023-10-06T11:08:54.896 DEBUG:teuthology.orchestra.run.smithi146:> if mountpoint in contents: 2023-10-06T11:08:54.896 DEBUG:teuthology.orchestra.run.smithi146:> return f 2023-10-06T11:08:54.896 DEBUG:teuthology.orchestra.run.smithi146:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T11:08:54.896 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:08:54.897 DEBUG:teuthology.orchestra.run.smithi146:> print(_find_admin_socket("client.0")) 2023-10-06T11:08:54.897 DEBUG:teuthology.orchestra.run.smithi146:> ' 2023-10-06T11:08:55.015 INFO:teuthology.orchestra.run.smithi146.stdout:/var/run/ceph/ceph-client.0.112923.asok 2023-10-06T11:08:55.198 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.112923.asok 2023-10-06T11:08:55.198 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:08:55.198 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.112923.asok status 2023-10-06T11:08:55.350 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:08:55.350 INFO:teuthology.orchestra.run.smithi146.stdout: "metadata": { 2023-10-06T11:08:55.350 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T11:08:55.350 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T11:08:55.350 INFO:teuthology.orchestra.run.smithi146.stdout: "entity_id": "0", 2023-10-06T11:08:55.351 INFO:teuthology.orchestra.run.smithi146.stdout: "hostname": "smithi146", 2023-10-06T11:08:55.351 INFO:teuthology.orchestra.run.smithi146.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T11:08:55.351 INFO:teuthology.orchestra.run.smithi146.stdout: "pid": "112923", 2023-10-06T11:08:55.351 INFO:teuthology.orchestra.run.smithi146.stdout: "root": "/" 2023-10-06T11:08:55.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:55.351 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_count": 0, 2023-10-06T11:08:55.351 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_pinned_count": 0, 2023-10-06T11:08:55.351 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 5670, 2023-10-06T11:08:55.351 INFO:teuthology.orchestra.run.smithi146.stdout: "inst": { 2023-10-06T11:08:55.351 INFO:teuthology.orchestra.run.smithi146.stdout: "name": { 2023-10-06T11:08:55.351 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "client", 2023-10-06T11:08:55.351 INFO:teuthology.orchestra.run.smithi146.stdout: "num": 5670 2023-10-06T11:08:55.351 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:55.352 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-06T11:08:55.352 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-06T11:08:55.352 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:08:55.352 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 3706615611 2023-10-06T11:08:55.352 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:08:55.352 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:55.352 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-06T11:08:55.352 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-06T11:08:55.352 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:08:55.352 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 3706615611 2023-10-06T11:08:55.352 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:08:55.352 INFO:teuthology.orchestra.run.smithi146.stdout: "inst_str": "client.5670 192.168.0.1:0/3706615611", 2023-10-06T11:08:55.352 INFO:teuthology.orchestra.run.smithi146.stdout: "addr_str": "192.168.0.1:0/3706615611", 2023-10-06T11:08:55.353 INFO:teuthology.orchestra.run.smithi146.stdout: "inode_count": 1, 2023-10-06T11:08:55.353 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_epoch": 35, 2023-10-06T11:08:55.353 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch": 47, 2023-10-06T11:08:55.353 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch_barrier": 0, 2023-10-06T11:08:55.353 INFO:teuthology.orchestra.run.smithi146.stdout: "blocklisted": false, 2023-10-06T11:08:55.353 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs" 2023-10-06T11:08:55.353 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:08:55.360 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:08:55.360 DEBUG:teuthology.orchestra.run.smithi146:> stat --file-system '--printf=%T 2023-10-06T11:08:55.360 DEBUG:teuthology.orchestra.run.smithi146:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T11:08:55.376 INFO:teuthology.orchestra.run.smithi146.stdout:fuseblk 2023-10-06T11:08:55.376 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T11:08:55.376 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:08:55.376 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:08:55.441 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2023-10-06T11:08:55.441 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_test_path 2023-10-06T11:08:55.441 INFO:tasks.cephfs.test_scrub_checks:Cloning repo into place 2023-10-06T11:08:55.441 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:08:55.441 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p /home/ubuntu/cephtest/mnt.0/scrub_test_path) 2023-10-06T11:08:55.501 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T11:08:55.501 DEBUG:teuthology.orchestra.run.smithi146:> import os 2023-10-06T11:08:55.501 DEBUG:teuthology.orchestra.run.smithi146:> import stat 2023-10-06T11:08:55.501 DEBUG:teuthology.orchestra.run.smithi146:> import json 2023-10-06T11:08:55.501 DEBUG:teuthology.orchestra.run.smithi146:> import sys 2023-10-06T11:08:55.502 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:08:55.502 DEBUG:teuthology.orchestra.run.smithi146:> try: 2023-10-06T11:08:55.502 DEBUG:teuthology.orchestra.run.smithi146:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'"'"') 2023-10-06T11:08:55.502 DEBUG:teuthology.orchestra.run.smithi146:> except OSError as e: 2023-10-06T11:08:55.502 DEBUG:teuthology.orchestra.run.smithi146:> sys.exit(e.errno) 2023-10-06T11:08:55.502 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:08:55.502 DEBUG:teuthology.orchestra.run.smithi146:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2023-10-06T11:08:55.502 DEBUG:teuthology.orchestra.run.smithi146:> print(json.dumps( 2023-10-06T11:08:55.502 DEBUG:teuthology.orchestra.run.smithi146:> dict([(a, getattr(s, a)) for a in attrs]), 2023-10-06T11:08:55.502 DEBUG:teuthology.orchestra.run.smithi146:> indent=2)) 2023-10-06T11:08:55.502 DEBUG:teuthology.orchestra.run.smithi146:> ' 2023-10-06T11:08:55.789 INFO:teuthology.orchestra.run.smithi146.stderr:daemon-helper: command failed with exit status 2 2023-10-06T11:08:55.793 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-10-06T11:08:55.794 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:08:55.794 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone --branch giant http://github.com/ceph/ceph-qa-suite /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite) 2023-10-06T11:08:55.854 INFO:teuthology.orchestra.run.smithi146.stderr:Cloning into '/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'... 2023-10-06T11:08:56.187 INFO:teuthology.orchestra.run.smithi146.stderr:warning: redirecting to https://github.com/ceph/ceph-qa-suite/ 2023-10-06T11:09:04.202 INFO:teuthology.orchestra.run.smithi146.stderr:Updating files: 22% (308/1398) Updating files: 23% (322/1398) Updating files: 24% (336/1398) Updating files: 25% (350/1398) Updating files: 26% (364/1398) Updating files: 27% (378/1398) Updating files: 28% (392/1398) Updating files: 29% (406/1398) Updating files: 30% (420/1398) Updating files: 31% (434/1398) Updating files: 32% (448/1398) Updating files: 33% (462/1398) Updating files: 34% (476/1398) Updating files: 35% (490/1398) Updating files: 36% (504/1398) Updating files: 37% (518/1398) Updating files: 38% (532/1398) Updating files: 39% (546/1398) Updating files: 40% (560/1398) Updating files: 41% (574/1398) Updating files: 42% (588/1398) Updating files: 43% (602/1398) Updating files: 44% (616/1398) Updating files: 44% (629/1398) Updating files: 45% (630/1398) Updating files: 46% (644/1398) Updating files: 47% (658/1398) Updating files: 48% (672/1398) Updating files: 49% (686/1398) Updating files: 50% (699/1398) Updating files: 51% (713/1398) Updating files: 52% (727/1398) Updating files: 53% (741/1398) Updating files: 54% (755/1398) Updating files: 55% (769/1398) Updating files: 56% (783/1398) Updating files: 57% (797/1398) Updating files: 58% (811/1398) Updating files: 59% (825/1398) Updating files: 59% (830/1398) Updating files: 60% (839/1398) Updating files: 61% (853/1398) Updating files: 62% (867/1398) Updating files: 63% (881/1398) Updating files: 64% (895/1398) Updating files: 65% (909/1398) Updating files: 66% (923/1398) Updating files: 67% (937/1398) Updating files: 68% (951/1398) Updating files: 69% (965/1398) Updating files: 70% (979/1398) Updating files: 71% (993/1398) Updating files: 71% (995/1398) Updating files: 72% (1007/1398) Updating files: 73% (1021/1398) Updating files: 74% (1035/1398) Updating files: 75% (1049/1398) Updating files: 76% (1063/1398) Updating files: 77% (1077/1398) Updating files: 78% (1091/1398) Updating files: 79% (1105/1398) Updating files: 80% (1119/1398) Updating files: 81% (1133/1398) Updating files: 82% (1147/1398) Updating files: 83% (1161/1398) Updating files: 84% (1175/1398) Updating files: 85% (1189/1398) Updating files: 86% (1203/1398) Updating files: 87% (1217/1398) Updating files: 87% (1223/1398) Updating files: 88% (1231/1398) Updating files: 89% (1245/1398) Updating files: 90% (1259/1398) Updating files: 91% (1273/1398) Updating files: 92% (1287/1398) Updating files: 93% (1301/1398) Updating files: 94% (1315/1398) Updating files: 95% (1329/1398) Updating files: 96% (1343/1398) Updating files: 97% (1357/1398) Updating files: 98% (1371/1398) Updating files: 99% (1385/1398) Updating files: 100% (1398/1398) Updating files: 100% (1398/1398), done. 2023-10-06T11:09:04.214 INFO:tasks.cephfs.test_scrub_checks:Initiating mds_scrub_checks on mds.0 test_path /scrub_test_path, run_seq 0 2023-10-06T11:09:04.214 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/i/dont/exist' 2023-10-06T11:09:04.214 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:09:04.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.370+0000 7f84c3477700 1 Processor -- start 2023-10-06T11:09:04.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.370+0000 7f84c3477700 1 -- start start 2023-10-06T11:09:04.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.371+0000 7f84c3477700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84bc15cbd0 0x7f84bc0b0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:04.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.371+0000 7f84c3477700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f84bc0b1950 0x7f84bc1633d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:04.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.371+0000 7f84c3477700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84bc0ae100 con 0x7f84bc0b3770 2023-10-06T11:09:04.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.371+0000 7f84c3477700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84bc0b0db0 con 0x7f84bc0b1950 2023-10-06T11:09:04.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.371+0000 7f84c3477700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc0d0f10 con 0x7f84bc15cbd0 2023-10-06T11:09:04.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.371+0000 7f84c2c76700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f84bc0b1950 0x7f84bc1633d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:04.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.371+0000 7f84c2c76700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f84bc0b1950 0x7f84bc1633d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48914/0 (socket says 172.21.15.146:48914) 2023-10-06T11:09:04.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.371+0000 7f84c2c76700 1 -- 172.21.15.146:0/2850123111 learned_addr learned my addr 172.21.15.146:0/2850123111 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:04.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.371+0000 7f84c1c74700 1 --1- 172.21.15.146:0/2850123111 >> v1:172.21.15.146:6789/0 conn(0x7f84bc0b3770 0x7f84bc0b1240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38778/0 (socket says 172.21.15.146:38778) 2023-10-06T11:09:04.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.371+0000 7f84c2c76700 1 -- 172.21.15.146:0/2850123111 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84bc15cbd0 msgr2=0x7f84bc0b0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:04.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.371+0000 7f84c2475700 1 --2- 172.21.15.146:0/2850123111 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84bc15cbd0 0x7f84bc0b0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:04.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.371+0000 7f84c1473700 1 -- 172.21.15.146:0/2850123111 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2178391023 0 0) 0x7f84bc0ae100 con 0x7f84bc0b3770 2023-10-06T11:09:04.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.371+0000 7f84c2c76700 1 --2- 172.21.15.146:0/2850123111 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84bc15cbd0 0x7f84bc0b0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:04.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.371+0000 7f84c2c76700 1 -- 172.21.15.146:0/2850123111 >> v1:172.21.15.146:6789/0 conn(0x7f84bc0b3770 legacy=0x7f84bc0b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:04.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.371+0000 7f84c2c76700 1 -- 172.21.15.146:0/2850123111 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84bc0d11f0 con 0x7f84bc0b1950 2023-10-06T11:09:04.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.371+0000 7f84c2475700 1 --2- 172.21.15.146:0/2850123111 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84bc15cbd0 0x7f84bc0b0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:09:04.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.372+0000 7f84c2c76700 1 --2- 172.21.15.146:0/2850123111 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84bc0b1950 0x7f84bc1633d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f84b4009f50 tx=0x7f84b4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=407581bac35b3820 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:04.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.372+0000 7f84c1473700 1 -- 172.21.15.146:0/2850123111 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b400e070 con 0x7f84bc0b1950 2023-10-06T11:09:04.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.372+0000 7f84c1473700 1 -- 172.21.15.146:0/2850123111 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b400ba70 con 0x7f84bc0b1950 2023-10-06T11:09:04.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.372+0000 7f84c1473700 1 -- 172.21.15.146:0/2850123111 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b40092e0 con 0x7f84bc0b1950 2023-10-06T11:09:04.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.372+0000 7f84c3477700 1 -- 172.21.15.146:0/2850123111 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84bc0b1950 msgr2=0x7f84bc1633d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:04.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.372+0000 7f84c3477700 1 --2- 172.21.15.146:0/2850123111 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84bc0b1950 0x7f84bc1633d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f84b4009f50 tx=0x7f84b4009840 comp rx=0 tx=0).stop 2023-10-06T11:09:04.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.372+0000 7f84c3477700 1 -- 172.21.15.146:0/2850123111 shutdown_connections 2023-10-06T11:09:04.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.372+0000 7f84c3477700 1 --2- 172.21.15.146:0/2850123111 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84bc0b1950 0x7f84bc1633d0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:04.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.372+0000 7f84c3477700 1 --2- 172.21.15.146:0/2850123111 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84bc15cbd0 0x7f84bc0b0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:04.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.372+0000 7f84c3477700 1 -- 172.21.15.146:0/2850123111 >> 172.21.15.146:0/2850123111 conn(0x7f84bc06f380 msgr2=0x7f84bc0d0660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:04.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.372+0000 7f84c3477700 1 -- 172.21.15.146:0/2850123111 shutdown_connections 2023-10-06T11:09:04.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.372+0000 7f84c3477700 1 -- 172.21.15.146:0/2850123111 wait complete. 2023-10-06T11:09:04.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.373+0000 7f84c3477700 1 Processor -- start 2023-10-06T11:09:04.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.374+0000 7f84c3477700 1 -- start start 2023-10-06T11:09:04.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.374+0000 7f84c3477700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84bc0b1950 0x7f84bc0b47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:04.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.374+0000 7f84c3477700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84bc0b3770 0x7f84bc14dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:04.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.374+0000 7f84c3477700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84bc15cbd0 0x7f84bc157dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:04.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.374+0000 7f84c3477700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc0b4350 con 0x7f84bc0b1950 2023-10-06T11:09:04.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.374+0000 7f84c3477700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc0b4d20 con 0x7f84bc15cbd0 2023-10-06T11:09:04.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.374+0000 7f84c3477700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc16a400 con 0x7f84bc0b3770 2023-10-06T11:09:04.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.374+0000 7f84c2475700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84bc0b1950 0x7f84bc0b47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:04.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.374+0000 7f84c2475700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84bc0b1950 0x7f84bc0b47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48918/0 (socket says 172.21.15.146:48918) 2023-10-06T11:09:04.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.374+0000 7f84c2475700 1 -- 172.21.15.146:0/864741569 learned_addr learned my addr 172.21.15.146:0/864741569 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:04.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.374+0000 7f84c1c74700 1 --2- 172.21.15.146:0/864741569 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84bc0b3770 0x7f84bc14dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:04.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.374+0000 7f84c2c76700 1 --2- 172.21.15.146:0/864741569 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84bc15cbd0 0x7f84bc157dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:04.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.375+0000 7f84c2475700 1 -- 172.21.15.146:0/864741569 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84bc0b3770 msgr2=0x7f84bc14dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:04.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.375+0000 7f84c2475700 1 --2- 172.21.15.146:0/864741569 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84bc0b3770 0x7f84bc14dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:04.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.375+0000 7f84c2475700 1 -- 172.21.15.146:0/864741569 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84bc15cbd0 msgr2=0x7f84bc157dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:04.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.375+0000 7f84c2475700 1 --2- 172.21.15.146:0/864741569 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84bc15cbd0 0x7f84bc157dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:04.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.375+0000 7f84c2475700 1 -- 172.21.15.146:0/864741569 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b4009ae0 con 0x7f84bc0b1950 2023-10-06T11:09:04.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.375+0000 7f84c2475700 1 --2- 172.21.15.146:0/864741569 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84bc0b1950 0x7f84bc0b47e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f84b800c850 tx=0x7f84b8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:04.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.375+0000 7f84b27fc700 1 -- 172.21.15.146:0/864741569 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b8011600 con 0x7f84bc0b1950 2023-10-06T11:09:04.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.375+0000 7f84b27fc700 1 -- 172.21.15.146:0/864741569 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b8011760 con 0x7f84bc0b1950 2023-10-06T11:09:04.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.375+0000 7f84c3477700 1 -- 172.21.15.146:0/864741569 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84bc0b3d00 con 0x7f84bc0b1950 2023-10-06T11:09:04.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.375+0000 7f84b27fc700 1 -- 172.21.15.146:0/864741569 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b8011b00 con 0x7f84bc0b1950 2023-10-06T11:09:04.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.375+0000 7f84c3477700 1 -- 172.21.15.146:0/864741569 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84bc14e000 con 0x7f84bc0b1950 2023-10-06T11:09:04.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.376+0000 7f84c3477700 1 -- 172.21.15.146:0/864741569 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84bc0b3b60 con 0x7f84bc0b1950 2023-10-06T11:09:04.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.376+0000 7f84b27fc700 1 -- 172.21.15.146:0/864741569 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f84b80223a0 con 0x7f84bc0b1950 2023-10-06T11:09:04.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.377+0000 7f84b27fc700 1 --2- 172.21.15.146:0/864741569 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f84a0066f30 0x7f84a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:04.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.377+0000 7f84b27fc700 1 -- 172.21.15.146:0/864741569 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f84b8084810 con 0x7f84bc0b1950 2023-10-06T11:09:04.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.377+0000 7f84c1c74700 1 --2- 172.21.15.146:0/864741569 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f84a0066f30 0x7f84a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:04.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.377+0000 7f84c1c74700 1 --2- 172.21.15.146:0/864741569 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f84a0066f30 0x7f84a00693e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f84bc154b50 tx=0x7f84ac007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:04.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.381+0000 7f84b27fc700 1 -- 172.21.15.146:0/864741569 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f84bc0b3b60 con 0x7f84bc0b1950 2023-10-06T11:09:04.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.609+0000 7f84c3477700 1 -- 172.21.15.146:0/864741569 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f84bc0b3b60 con 0x7f84bc0b1950 2023-10-06T11:09:04.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.610+0000 7f84b27fc700 1 -- 172.21.15.146:0/864741569 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4609 (secure 0 0 0) 0x7f84bc0b3b60 con 0x7f84bc0b1950 2023-10-06T11:09:04.612 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:09:04.612 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":35,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5248,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3360977916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3360977916},{"type":"v1","addr":"172.21.15.151:6834","nonce":3360977916}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5251,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2265934004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":2265934004},{"type":"v1","addr":"172.21.15.151:6835","nonce":2265934004}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2387575667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2387575667},{"type":"v1","addr":"172.21.15.146:6836","nonce":2387575667}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:08:42.797557+0000","modified":"2023-10-06T11:08:46.435072+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5481":{"gid":5481,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/2252184844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2252184844},{"type":"v1","addr":"172.21.15.146:6837","nonce":2252184844}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T11:09:04.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.612+0000 7f84c3477700 1 -- 172.21.15.146:0/864741569 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f84a0066f30 msgr2=0x7f84a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:04.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.612+0000 7f84c3477700 1 --2- 172.21.15.146:0/864741569 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f84a0066f30 0x7f84a00693e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f84bc154b50 tx=0x7f84ac007d50 comp rx=0 tx=0).stop 2023-10-06T11:09:04.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.612+0000 7f84c3477700 1 -- 172.21.15.146:0/864741569 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84bc0b1950 msgr2=0x7f84bc0b47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:04.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.612+0000 7f84c3477700 1 --2- 172.21.15.146:0/864741569 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84bc0b1950 0x7f84bc0b47e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f84b800c850 tx=0x7f84b8008040 comp rx=0 tx=0).stop 2023-10-06T11:09:04.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.612+0000 7f84c3477700 1 -- 172.21.15.146:0/864741569 shutdown_connections 2023-10-06T11:09:04.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.612+0000 7f84c3477700 1 --2- 172.21.15.146:0/864741569 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f84a0066f30 0x7f84a00693e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:04.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.612+0000 7f84c3477700 1 --2- 172.21.15.146:0/864741569 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84bc15cbd0 0x7f84bc157dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:04.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.612+0000 7f84c3477700 1 --2- 172.21.15.146:0/864741569 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84bc0b1950 0x7f84bc0b47e0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:04.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.612+0000 7f84c3477700 1 --2- 172.21.15.146:0/864741569 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84bc0b3770 0x7f84bc14dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:04.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.612+0000 7f84c3477700 1 -- 172.21.15.146:0/864741569 >> 172.21.15.146:0/864741569 conn(0x7f84bc06f380 msgr2=0x7f84bc15bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:04.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.612+0000 7f84c3477700 1 -- 172.21.15.146:0/864741569 shutdown_connections 2023-10-06T11:09:04.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.612+0000 7f84c3477700 1 -- 172.21.15.146:0/864741569 wait complete. 2023-10-06T11:09:04.615 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 35 2023-10-06T11:09:04.626 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok flush_path /scrub_test_path/i/dont/exist 2023-10-06T11:09:04.748 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:09:04.748 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": -2 2023-10-06T11:09:04.748 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:09:04.758 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/i/dont/exist' got response code '0' and stdout '{ "return_code": -2 } ' 2023-10-06T11:09:04.758 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/i/dont/exist' 2023-10-06T11:09:04.758 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/i/dont/exist 2023-10-06T11:09:04.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.876+0000 7fc6ea5dd700 1 Processor -- start 2023-10-06T11:09:04.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.876+0000 7fc6ea5dd700 1 -- start start 2023-10-06T11:09:04.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.877+0000 7fc6ea5dd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6e415ade0 0x7fc6e4155f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:04.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.877+0000 7fc6ea5dd700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6e406c390 con 0x7fc6e40686d0 2023-10-06T11:09:04.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.877+0000 7fc6ea5dd700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6e406c820 con 0x7fc6e4068aa0 2023-10-06T11:09:04.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.877+0000 7fc6ea5dd700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e406b780 con 0x7fc6e415ade0 2023-10-06T11:09:04.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.877+0000 7fc6e3fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc6e40686d0 0x7fc6e406ed30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38780/0 (socket says 172.21.15.146:38780) 2023-10-06T11:09:04.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.877+0000 7fc6e3fff700 1 -- 172.21.15.146:0/3876527364 learned_addr learned my addr 172.21.15.146:0/3876527364 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:04.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.877+0000 7fc6e37fe700 1 --2- 172.21.15.146:0/3876527364 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6e415ade0 0x7fc6e4155f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:04.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.878+0000 7fc6e2ffd700 1 -- 172.21.15.146:0/3876527364 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2925377981 0 0) 0x7fc6e406c390 con 0x7fc6e40686d0 2023-10-06T11:09:04.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.878+0000 7fc6e2ffd700 1 -- 172.21.15.146:0/3876527364 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6cc003570 con 0x7fc6e40686d0 2023-10-06T11:09:04.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.878+0000 7fc6e2ffd700 1 -- 172.21.15.146:0/3876527364 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2041650318 0 0) 0x7fc6e406c820 con 0x7fc6e4068aa0 2023-10-06T11:09:04.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.878+0000 7fc6e2ffd700 1 -- 172.21.15.146:0/3876527364 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6e406c390 con 0x7fc6e4068aa0 2023-10-06T11:09:04.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.878+0000 7fc6e2ffd700 1 -- 172.21.15.146:0/3876527364 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 449181159 0 0) 0x7fc6cc003570 con 0x7fc6e40686d0 2023-10-06T11:09:04.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.878+0000 7fc6e2ffd700 1 -- 172.21.15.146:0/3876527364 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6e415ade0 msgr2=0x7fc6e4155f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:04.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.878+0000 7fc6e2ffd700 1 --2- 172.21.15.146:0/3876527364 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6e415ade0 0x7fc6e4155f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:04.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.878+0000 7fc6e2ffd700 1 -- 172.21.15.146:0/3876527364 >> v1:172.21.15.151:6789/0 conn(0x7fc6e4068aa0 legacy=0x7fc6e41564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:04.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.878+0000 7fc6e2ffd700 1 -- 172.21.15.146:0/3876527364 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e406ba60 con 0x7fc6e40686d0 2023-10-06T11:09:04.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.878+0000 7fc6e2ffd700 1 -- 172.21.15.146:0/3876527364 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fc6d4001470 con 0x7fc6e40686d0 2023-10-06T11:09:04.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.878+0000 7fc6e2ffd700 1 -- 172.21.15.146:0/3876527364 >> v1:172.21.15.146:6789/0 conn(0x7fc6e40686d0 legacy=0x7fc6e406ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:04.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.878+0000 7fc6e2ffd700 1 --2- 172.21.15.146:0/3876527364 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6cc003c20 0x7fc6cc004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:04.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.878+0000 7fc6e2ffd700 1 --2- 172.21.15.146:0/3876527364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6cc004810 0x7fc6cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:04.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.878+0000 7fc6e2ffd700 1 --2- 172.21.15.146:0/3876527364 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6e415ade0 0x7fc6cc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:04.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.878+0000 7fc6e2ffd700 1 -- 172.21.15.146:0/3876527364 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e406b780 con 0x7fc6cc004810 2023-10-06T11:09:04.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.878+0000 7fc6e2ffd700 1 -- 172.21.15.146:0/3876527364 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc00bb40 con 0x7fc6cc003c20 2023-10-06T11:09:04.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.878+0000 7fc6e2ffd700 1 -- 172.21.15.146:0/3876527364 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc00bd00 con 0x7fc6e415ade0 2023-10-06T11:09:04.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.878+0000 7fc6e37fe700 1 --2- 172.21.15.146:0/3876527364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6cc004810 0x7fc6cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:04.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.878+0000 7fc6e3fff700 1 --2- 172.21.15.146:0/3876527364 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6cc003c20 0x7fc6cc004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:04.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.878+0000 7fc6e8b7a700 1 --2- 172.21.15.146:0/3876527364 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6e415ade0 0x7fc6cc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:04.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.878+0000 7fc6e37fe700 1 -- 172.21.15.146:0/3876527364 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6e415ade0 msgr2=0x7fc6cc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:04.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.878+0000 7fc6e37fe700 1 --2- 172.21.15.146:0/3876527364 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6e415ade0 0x7fc6cc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:04.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.878+0000 7fc6e37fe700 1 -- 172.21.15.146:0/3876527364 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6cc003c20 msgr2=0x7fc6cc004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:04.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.878+0000 7fc6e37fe700 1 --2- 172.21.15.146:0/3876527364 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6cc003c20 0x7fc6cc004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:04.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.879+0000 7fc6e37fe700 1 -- 172.21.15.146:0/3876527364 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e406ba60 con 0x7fc6cc004810 2023-10-06T11:09:04.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.879+0000 7fc6e37fe700 1 --2- 172.21.15.146:0/3876527364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6cc004810 0x7fc6cc004c80 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fc6e415b230 tx=0x7fc6d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7841cd696f242098 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:04.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.879+0000 7fc6e2ffd700 1 -- 172.21.15.146:0/3876527364 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d800e710 con 0x7fc6cc004810 2023-10-06T11:09:04.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.879+0000 7fc6e2ffd700 1 -- 172.21.15.146:0/3876527364 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d800e870 con 0x7fc6cc004810 2023-10-06T11:09:04.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.879+0000 7fc6e2ffd700 1 -- 172.21.15.146:0/3876527364 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d800ec30 con 0x7fc6cc004810 2023-10-06T11:09:04.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.879+0000 7fc6ea5dd700 1 -- 172.21.15.146:0/3876527364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6cc004810 msgr2=0x7fc6cc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:04.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.879+0000 7fc6ea5dd700 1 --2- 172.21.15.146:0/3876527364 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6cc004810 0x7fc6cc004c80 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fc6e415b230 tx=0x7fc6d80091a0 comp rx=0 tx=0).stop 2023-10-06T11:09:04.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.879+0000 7fc6e8b7a700 1 -- 172.21.15.146:0/3876527364 reap_dead start 2023-10-06T11:09:04.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.879+0000 7fc6ea5dd700 1 -- 172.21.15.146:0/3876527364 shutdown_connections 2023-10-06T11:09:04.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.879+0000 7fc6ea5dd700 1 -- 172.21.15.146:0/3876527364 >> 172.21.15.146:0/3876527364 conn(0x7fc6e40c9fa0 msgr2=0x7fc6e406de70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:04.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.879+0000 7fc6ea5dd700 1 -- 172.21.15.146:0/3876527364 shutdown_connections 2023-10-06T11:09:04.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.879+0000 7fc6ea5dd700 1 -- 172.21.15.146:0/3876527364 wait complete. 2023-10-06T11:09:04.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.881+0000 7fc6ea5dd700 1 Processor -- start 2023-10-06T11:09:04.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.881+0000 7fc6ea5dd700 1 -- start start 2023-10-06T11:09:04.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.881+0000 7fc6ea5dd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6cc004810 0x7fc6e4145050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:04.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.881+0000 7fc6ea5dd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6e4149a40 0x7fc6e40c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:04.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.881+0000 7fc6ea5dd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6e40c5940 0x7fc6e40c18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:04.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.881+0000 7fc6ea5dd700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e4148d80 con 0x7fc6e4149a40 2023-10-06T11:09:04.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.881+0000 7fc6ea5dd700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e4149eb0 con 0x7fc6e40c5940 2023-10-06T11:09:04.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.881+0000 7fc6ea5dd700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e40c6130 con 0x7fc6cc004810 2023-10-06T11:09:04.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.882+0000 7fc6e37fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6e4149a40 0x7fc6e40c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:04.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.882+0000 7fc6e37fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6e4149a40 0x7fc6e40c5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48940/0 (socket says 172.21.15.146:48940) 2023-10-06T11:09:04.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.882+0000 7fc6e37fe700 1 -- 172.21.15.146:0/3829817393 learned_addr learned my addr 172.21.15.146:0/3829817393 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:04.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.882+0000 7fc6e8b7a700 1 --2- 172.21.15.146:0/3829817393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6e40c5940 0x7fc6e40c18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:04.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.882+0000 7fc6e3fff700 1 --2- 172.21.15.146:0/3829817393 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6cc004810 0x7fc6e4145050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:04.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.882+0000 7fc6e37fe700 1 -- 172.21.15.146:0/3829817393 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6cc004810 msgr2=0x7fc6e4145050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:04.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.882+0000 7fc6e37fe700 1 --2- 172.21.15.146:0/3829817393 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6cc004810 0x7fc6e4145050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:04.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.882+0000 7fc6e37fe700 1 -- 172.21.15.146:0/3829817393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6e40c5940 msgr2=0x7fc6e40c18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:04.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.882+0000 7fc6e37fe700 1 --2- 172.21.15.146:0/3829817393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6e40c5940 0x7fc6e40c18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:04.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.882+0000 7fc6e37fe700 1 -- 172.21.15.146:0/3829817393 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e41495b0 con 0x7fc6e4149a40 2023-10-06T11:09:04.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.882+0000 7fc6e37fe700 1 --2- 172.21.15.146:0/3829817393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6e4149a40 0x7fc6e40c5400 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc00bb10 tx=0x7fc6d801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:04.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.882+0000 7fc6cbfff700 1 -- 172.21.15.146:0/3829817393 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d8023070 con 0x7fc6e4149a40 2023-10-06T11:09:04.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.882+0000 7fc6cbfff700 1 -- 172.21.15.146:0/3829817393 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d801e2e0 con 0x7fc6e4149a40 2023-10-06T11:09:04.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.882+0000 7fc6cbfff700 1 -- 172.21.15.146:0/3829817393 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d801eaf0 con 0x7fc6e4149a40 2023-10-06T11:09:04.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.882+0000 7fc6ea5dd700 1 -- 172.21.15.146:0/3829817393 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e40c5e50 con 0x7fc6e4149a40 2023-10-06T11:09:04.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.882+0000 7fc6ea5dd700 1 -- 172.21.15.146:0/3829817393 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e4149240 con 0x7fc6e4149a40 2023-10-06T11:09:04.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.884+0000 7fc6cbfff700 1 -- 172.21.15.146:0/3829817393 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc6d8013470 con 0x7fc6e4149a40 2023-10-06T11:09:04.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.884+0000 7fc6cbfff700 1 --2- 172.21.15.146:0/3829817393 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc6d0066f30 0x7fc6d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:04.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.884+0000 7fc6cbfff700 1 -- 172.21.15.146:0/3829817393 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc6d8085d40 con 0x7fc6e4149a40 2023-10-06T11:09:04.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.884+0000 7fc6e3fff700 1 --2- 172.21.15.146:0/3829817393 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc6d0066f30 0x7fc6d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:04.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.884+0000 7fc6e3fff700 1 --2- 172.21.15.146:0/3829817393 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc6d0066f30 0x7fc6d00693e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4007fd0 tx=0x7fc6d4007c70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:04.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.886+0000 7fc6f38d5b80 1 Processor -- start 2023-10-06T11:09:04.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.886+0000 7fc6f38d5b80 1 -- start start 2023-10-06T11:09:04.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.887+0000 7fc6f38d5b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5641b0ab0b50 0x5641b0ab0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:04.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.887+0000 7fc6f38d5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5641b0a6ca60 0x5641b0a69640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:04.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.887+0000 7fc6f38d5b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b0a6ac90 0x5641b0a69b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:04.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.887+0000 7fc6f38d5b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641b09e9d40 con 0x5641b0a6ac90 2023-10-06T11:09:04.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.887+0000 7fc6f38d5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641b09c0b30 con 0x5641b0a6ca60 2023-10-06T11:09:04.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.887+0000 7fc6f38d5b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5641b09be330 con 0x5641b0ab0b50 2023-10-06T11:09:04.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.887+0000 7fc6e8b7a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b0a6ac90 0x5641b0a69b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:04.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.887+0000 7fc6e8b7a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b0a6ac90 0x5641b0a69b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48942/0 (socket says 172.21.15.146:48942) 2023-10-06T11:09:04.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.887+0000 7fc6e8b7a700 1 -- 172.21.15.146:0/880942312 learned_addr learned my addr 172.21.15.146:0/880942312 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:04.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.887+0000 7fc6e37fe700 1 --2- 172.21.15.146:0/880942312 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5641b0a6ca60 0x5641b0a69640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:04.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.887+0000 7fc6e3fff700 1 --2- 172.21.15.146:0/880942312 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5641b0ab0b50 0x5641b0ab0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:04.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.887+0000 7fc6e8b7a700 1 -- 172.21.15.146:0/880942312 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5641b0ab0b50 msgr2=0x5641b0ab0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:04.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.887+0000 7fc6e8b7a700 1 --2- 172.21.15.146:0/880942312 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5641b0ab0b50 0x5641b0ab0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:04.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.887+0000 7fc6e8b7a700 1 -- 172.21.15.146:0/880942312 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5641b0a6ca60 msgr2=0x5641b0a69640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:04.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.887+0000 7fc6e8b7a700 1 --2- 172.21.15.146:0/880942312 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5641b0a6ca60 0x5641b0a69640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:04.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.887+0000 7fc6e8b7a700 1 -- 172.21.15.146:0/880942312 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641b0854330 con 0x5641b0a6ac90 2023-10-06T11:09:04.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.887+0000 7fc6e37fe700 1 --2- 172.21.15.146:0/880942312 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5641b0a6ca60 0x5641b0a69640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:09:04.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.887+0000 7fc6e8b7a700 1 --2- 172.21.15.146:0/880942312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b0a6ac90 0x5641b0a69b80 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fc6e40af5a0 tx=0x7fc6dc0017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74b91d28776fe72e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:04.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.887+0000 7fc6c97fa700 1 -- 172.21.15.146:0/880942312 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc001d90 con 0x5641b0a6ac90 2023-10-06T11:09:04.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.887+0000 7fc6c97fa700 1 -- 172.21.15.146:0/880942312 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6dc006ba0 con 0x5641b0a6ac90 2023-10-06T11:09:04.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.887+0000 7fc6c97fa700 1 -- 172.21.15.146:0/880942312 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc011890 con 0x5641b0a6ac90 2023-10-06T11:09:04.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.888+0000 7fc6f38d5b80 1 -- 172.21.15.146:0/880942312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b0a6ac90 msgr2=0x5641b0a69b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:04.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.888+0000 7fc6f38d5b80 1 --2- 172.21.15.146:0/880942312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b0a6ac90 0x5641b0a69b80 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fc6e40af5a0 tx=0x7fc6dc0017a0 comp rx=0 tx=0).stop 2023-10-06T11:09:04.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.888+0000 7fc6f38d5b80 1 -- 172.21.15.146:0/880942312 shutdown_connections 2023-10-06T11:09:04.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.888+0000 7fc6f38d5b80 1 --2- 172.21.15.146:0/880942312 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b0a6ac90 0x5641b0a69b80 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:04.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.888+0000 7fc6f38d5b80 1 --2- 172.21.15.146:0/880942312 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5641b0ab0b50 0x5641b0ab0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:04.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.888+0000 7fc6f38d5b80 1 --2- 172.21.15.146:0/880942312 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5641b0a6ca60 0x5641b0a69640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:04.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.888+0000 7fc6f38d5b80 1 -- 172.21.15.146:0/880942312 >> 172.21.15.146:0/880942312 conn(0x5641b0a6b130 msgr2=0x5641b0a6b500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:04.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.888+0000 7fc6f38d5b80 1 -- 172.21.15.146:0/880942312 shutdown_connections 2023-10-06T11:09:04.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.888+0000 7fc6f38d5b80 1 -- 172.21.15.146:0/880942312 wait complete. 2023-10-06T11:09:04.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.889+0000 7fc6f38d5b80 1 -- start start 2023-10-06T11:09:04.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.889+0000 7fc6f38d5b80 1 Processor -- start 2023-10-06T11:09:04.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.889+0000 7fc6f38d5b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5641b0a6ac90 0x5641b0a90480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:04.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.889+0000 7fc6f38d5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5641b0a6ca60 0x5641b0a943c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:04.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.889+0000 7fc6f38d5b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b0ab0b50 0x5641b0a91c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:04.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.889+0000 7fc6f38d5b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641b09ba120 con 0x5641b0ab0b50 2023-10-06T11:09:04.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.890+0000 7fc6f38d5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641b0965950 con 0x5641b0a6ca60 2023-10-06T11:09:04.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.890+0000 7fc6f38d5b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5641b0980f60 con 0x5641b0a6ac90 2023-10-06T11:09:04.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.890+0000 7fc6f38d5b80 10 client.0 _ll_register_callbacks cb 0x5641b0856ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:09:04.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.890+0000 7fc6e8b7a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b0ab0b50 0x5641b0a91c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:04.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.890+0000 7fc6e8b7a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b0ab0b50 0x5641b0a91c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48950/0 (socket says 172.21.15.146:48950) 2023-10-06T11:09:04.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.890+0000 7fc6e8b7a700 1 -- 172.21.15.146:0/2197497776 learned_addr learned my addr 172.21.15.146:0/2197497776 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:04.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.890+0000 7fc6e3fff700 1 --2- 172.21.15.146:0/2197497776 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5641b0a6ac90 0x5641b0a90480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:04.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.890+0000 7fc6e37fe700 1 --2- 172.21.15.146:0/2197497776 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5641b0a6ca60 0x5641b0a943c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:04.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.890+0000 7fc6e8b7a700 1 -- 172.21.15.146:0/2197497776 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5641b0a6ac90 msgr2=0x5641b0a90480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:04.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.890+0000 7fc6e8b7a700 1 --2- 172.21.15.146:0/2197497776 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5641b0a6ac90 0x5641b0a90480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:04.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.890+0000 7fc6e8b7a700 1 -- 172.21.15.146:0/2197497776 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5641b0a6ca60 msgr2=0x5641b0a943c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:04.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.890+0000 7fc6e8b7a700 1 --2- 172.21.15.146:0/2197497776 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5641b0a6ca60 0x5641b0a943c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:04.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.890+0000 7fc6e8b7a700 1 -- 172.21.15.146:0/2197497776 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6dc00f040 con 0x5641b0ab0b50 2023-10-06T11:09:04.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.890+0000 7fc6e8b7a700 1 --2- 172.21.15.146:0/2197497776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b0ab0b50 0x5641b0a91c30 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x5641b0a6cfb0 tx=0x7fc6dc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a65af8d4a3a948b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:04.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.890+0000 7fc6c27fc700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:09:04.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.890+0000 7fc6c27fc700 1 -- 172.21.15.146:0/2197497776 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6dc015750 con 0x5641b0ab0b50 2023-10-06T11:09:04.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.890+0000 7fc6c27fc700 1 -- 172.21.15.146:0/2197497776 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc6dc00a900 con 0x5641b0ab0b50 2023-10-06T11:09:04.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.890+0000 7fc6f38d5b80 1 -- 172.21.15.146:0/2197497776 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5641b0a5e750 con 0x5641b0ab0b50 2023-10-06T11:09:04.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.890+0000 7fc6c27fc700 1 -- 172.21.15.146:0/2197497776 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc6dc00acd0 con 0x5641b0ab0b50 2023-10-06T11:09:04.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.891+0000 7fc6f38d5b80 10 client.5691 fetch_fsmap learned FSMap version 35 2023-10-06T11:09:04.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.891+0000 7fc6f38d5b80 1 -- 172.21.15.146:0/2197497776 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) v3 -- 0x5641b07f70a0 con 0x5641b0ab0b50 2023-10-06T11:09:04.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.891+0000 7fc6c27fc700 1 -- 172.21.15.146:0/2197497776 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6dc02f020 con 0x5641b0ab0b50 2023-10-06T11:09:04.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.891+0000 7fc6c27fc700 1 -- 172.21.15.146:0/2197497776 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 35) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc6dc029020 con 0x5641b0ab0b50 2023-10-06T11:09:04.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.891+0000 7fc6f38d5b80 10 client.5691 fetch_fsmap finished waiting for FSMap version 35 2023-10-06T11:09:04.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.891+0000 7fc6f38d5b80 10 client.5691 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-10-06T11:09:04.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.891+0000 7fc6f38d5b80 20 client.5691 populate_metadata read hostname 'smithi146' 2023-10-06T11:09:04.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.891+0000 7fc6f38d5b80 1 --2- 172.21.15.146:0/2197497776 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x5641b0a94900 0x5641b0aacbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:04.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.891+0000 7fc6f38d5b80 4 client.5691 mds_command: new command op to 5481 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:09:04.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.891+0000 7fc6f38d5b80 1 -- 172.21.15.146:0/2197497776 --> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5641b0a3b680 con 0x5641b0a94900 2023-10-06T11:09:04.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.891+0000 7fc6e3fff700 1 --2- 172.21.15.146:0/2197497776 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x5641b0a94900 0x5641b0aacbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:04.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.891+0000 7fc6c27fc700 10 client.5691 ms_handle_connect on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:04.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.891+0000 7fc6e3fff700 1 --2- 172.21.15.146:0/2197497776 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x5641b0a94900 0x5641b0aacbe0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f05726a691fc284b server_cookie=d384eb01a8b11c63 in_seq=0 out_seq=0 2023-10-06T11:09:04.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.893+0000 7fc6c27fc700 1 -- 172.21.15.146:0/2197497776 <== mds.0 v2:172.21.15.146:6835/2252184844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5641b0a3b680 con 0x5641b0a94900 2023-10-06T11:09:04.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.893+0000 7fc6c27fc700 10 client.5691 handle_command_reply: tid=0 2023-10-06T11:09:04.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.893+0000 7fc6f38d5b80 1 client.5691 shutdown 2023-10-06T11:09:04.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.893+0000 7fc6f38d5b80 1 -- 172.21.15.146:0/2197497776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b0ab0b50 msgr2=0x5641b0a91c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:04.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.893+0000 7fc6f38d5b80 1 --2- 172.21.15.146:0/2197497776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b0ab0b50 0x5641b0a91c30 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x5641b0a6cfb0 tx=0x7fc6dc018000 comp rx=0 tx=0).stop 2023-10-06T11:09:04.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.893+0000 7fc6f38d5b80 1 -- 172.21.15.146:0/2197497776 shutdown_connections 2023-10-06T11:09:04.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.893+0000 7fc6f38d5b80 1 --2- 172.21.15.146:0/2197497776 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x5641b0a94900 0x5641b0aacbe0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:04.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.893+0000 7fc6f38d5b80 1 --2- 172.21.15.146:0/2197497776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b0ab0b50 0x5641b0a91c30 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:04.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.893+0000 7fc6f38d5b80 1 --2- 172.21.15.146:0/2197497776 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5641b0a6ac90 0x5641b0a90480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:04.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.893+0000 7fc6f38d5b80 1 --2- 172.21.15.146:0/2197497776 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5641b0a6ca60 0x5641b0a943c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:04.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.893+0000 7fc6c27fc700 0 client.5691 ms_handle_reset on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:04.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.893+0000 7fc6f38d5b80 1 -- 172.21.15.146:0/2197497776 >> 172.21.15.146:0/2197497776 conn(0x5641b0a6b130 msgr2=0x5641b0aae420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:04.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.893+0000 7fc6f38d5b80 1 -- 172.21.15.146:0/2197497776 shutdown_connections 2023-10-06T11:09:04.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.893+0000 7fc6f38d5b80 1 -- 172.21.15.146:0/2197497776 wait complete. 2023-10-06T11:09:04.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.893+0000 7fc6f38d5b80 20 client.5691 trim_cache size 0 max 16384 2023-10-06T11:09:04.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.910+0000 7fc6f38d5b80 1 Processor -- start 2023-10-06T11:09:04.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.910+0000 7fc6f38d5b80 1 -- start start 2023-10-06T11:09:04.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.911+0000 7fc6f38d5b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b0a6ac90 0x5641b0ac2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:04.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.911+0000 7fc6f38d5b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5641b0a6ca60 0x5641b0aae420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:04.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.911+0000 7fc6f38d5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5641b0ab0b50 0x5641b0a93730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:04.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.911+0000 7fc6f38d5b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641b083cef0 con 0x5641b0a6ac90 2023-10-06T11:09:04.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.911+0000 7fc6f38d5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641b0ad2b40 con 0x5641b0ab0b50 2023-10-06T11:09:04.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.911+0000 7fc6f38d5b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5641b0ab91d0 con 0x5641b0a6ca60 2023-10-06T11:09:04.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.911+0000 7fc6e3fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b0a6ac90 0x5641b0ac2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:04.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.911+0000 7fc6e3fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b0a6ac90 0x5641b0ac2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48960/0 (socket says 172.21.15.146:48960) 2023-10-06T11:09:04.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.911+0000 7fc6e3fff700 1 -- 172.21.15.146:0/1027498452 learned_addr learned my addr 172.21.15.146:0/1027498452 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:04.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.911+0000 7fc6e8b7a700 1 --2- 172.21.15.146:0/1027498452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5641b0ab0b50 0x5641b0a93730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:04.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.911+0000 7fc6e37fe700 1 --2- 172.21.15.146:0/1027498452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5641b0a6ca60 0x5641b0aae420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:04.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.911+0000 7fc6e3fff700 1 -- 172.21.15.146:0/1027498452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5641b0a6ca60 msgr2=0x5641b0aae420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:04.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.911+0000 7fc6e3fff700 1 --2- 172.21.15.146:0/1027498452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5641b0a6ca60 0x5641b0aae420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:04.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.911+0000 7fc6e3fff700 1 -- 172.21.15.146:0/1027498452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5641b0ab0b50 msgr2=0x5641b0a93730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:04.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.911+0000 7fc6e3fff700 1 --2- 172.21.15.146:0/1027498452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5641b0ab0b50 0x5641b0a93730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:04.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.911+0000 7fc6e3fff700 1 -- 172.21.15.146:0/1027498452 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5641b0988840 con 0x5641b0a6ac90 2023-10-06T11:09:04.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.911+0000 7fc6e3fff700 1 --2- 172.21.15.146:0/1027498452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b0a6ac90 0x5641b0ac2dd0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4007800 tx=0x7fc6d4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a64f6e14b88324 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:04.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.912+0000 7fc6c9ffb700 1 -- 172.21.15.146:0/1027498452 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d4005ea0 con 0x5641b0a6ac90 2023-10-06T11:09:04.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.912+0000 7fc6c9ffb700 1 -- 172.21.15.146:0/1027498452 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d4015c60 con 0x5641b0a6ac90 2023-10-06T11:09:04.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.912+0000 7fc6c9ffb700 1 -- 172.21.15.146:0/1027498452 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d402a430 con 0x5641b0a6ac90 2023-10-06T11:09:04.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.912+0000 7fc6f38d5b80 1 -- 172.21.15.146:0/1027498452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b0a6ac90 msgr2=0x5641b0ac2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:04.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.912+0000 7fc6f38d5b80 1 --2- 172.21.15.146:0/1027498452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b0a6ac90 0x5641b0ac2dd0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4007800 tx=0x7fc6d4017000 comp rx=0 tx=0).stop 2023-10-06T11:09:04.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.912+0000 7fc6f38d5b80 1 -- 172.21.15.146:0/1027498452 shutdown_connections 2023-10-06T11:09:04.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.912+0000 7fc6f38d5b80 1 --2- 172.21.15.146:0/1027498452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5641b0ab0b50 0x5641b0a93730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:04.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.912+0000 7fc6f38d5b80 1 --2- 172.21.15.146:0/1027498452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b0a6ac90 0x5641b0ac2dd0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:04.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.912+0000 7fc6f38d5b80 1 --2- 172.21.15.146:0/1027498452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5641b0a6ca60 0x5641b0aae420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:04.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.912+0000 7fc6f38d5b80 1 -- 172.21.15.146:0/1027498452 >> 172.21.15.146:0/1027498452 conn(0x5641b0a6b130 msgr2=0x5641b0aad350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:04.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.912+0000 7fc6f38d5b80 1 -- 172.21.15.146:0/1027498452 shutdown_connections 2023-10-06T11:09:04.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.912+0000 7fc6f38d5b80 1 -- 172.21.15.146:0/1027498452 wait complete. 2023-10-06T11:09:04.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.913+0000 7fc6f38d5b80 1 -- start start 2023-10-06T11:09:04.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.913+0000 7fc6f38d5b80 1 Processor -- start 2023-10-06T11:09:04.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.914+0000 7fc6f38d5b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b0a6ac90 0x5641b0a90e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:04.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.914+0000 7fc6f38d5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5641b0a6ca60 0x5641b0aaf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:04.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.914+0000 7fc6f38d5b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5641b0ab0b50 0x5641b0aaf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:04.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.914+0000 7fc6f38d5b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641b0ab66e0 con 0x5641b0a6ac90 2023-10-06T11:09:04.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.914+0000 7fc6f38d5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641b0b17e60 con 0x5641b0a6ca60 2023-10-06T11:09:04.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.914+0000 7fc6f38d5b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5641b0a662f0 con 0x5641b0ab0b50 2023-10-06T11:09:04.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.914+0000 7fc6f38d5b80 10 client.0 _ll_register_callbacks cb 0x5641b0856ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:09:04.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.914+0000 7fc6e3fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b0a6ac90 0x5641b0a90e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:04.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.914+0000 7fc6e3fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b0a6ac90 0x5641b0a90e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48964/0 (socket says 172.21.15.146:48964) 2023-10-06T11:09:04.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.914+0000 7fc6e3fff700 1 -- 172.21.15.146:0/1321624799 learned_addr learned my addr 172.21.15.146:0/1321624799 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:04.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.914+0000 7fc6e37fe700 1 --2- 172.21.15.146:0/1321624799 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5641b0a6ca60 0x5641b0aaf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:04.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.914+0000 7fc6e8b7a700 1 --2- 172.21.15.146:0/1321624799 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5641b0ab0b50 0x5641b0aaf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:04.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.914+0000 7fc6e3fff700 1 -- 172.21.15.146:0/1321624799 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5641b0ab0b50 msgr2=0x5641b0aaf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:04.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.914+0000 7fc6e3fff700 1 --2- 172.21.15.146:0/1321624799 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5641b0ab0b50 0x5641b0aaf880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:04.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.914+0000 7fc6e3fff700 1 -- 172.21.15.146:0/1321624799 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5641b0a6ca60 msgr2=0x5641b0aaf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:04.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.914+0000 7fc6e3fff700 1 --2- 172.21.15.146:0/1321624799 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5641b0a6ca60 0x5641b0aaf340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:04.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.914+0000 7fc6e3fff700 1 -- 172.21.15.146:0/1321624799 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6d4007670 con 0x5641b0a6ac90 2023-10-06T11:09:04.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.914+0000 7fc6e3fff700 1 --2- 172.21.15.146:0/1321624799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b0a6ac90 0x5641b0a90e30 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4007400 tx=0x7fc6d4023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c859f509f26df53 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:04.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.914+0000 7fc6c27fc700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:09:04.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.915+0000 7fc6c27fc700 1 -- 172.21.15.146:0/1321624799 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6d4005ea0 con 0x5641b0a6ac90 2023-10-06T11:09:04.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.915+0000 7fc6f38d5b80 1 -- 172.21.15.146:0/1321624799 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc6dc006ba0 con 0x5641b0a6ac90 2023-10-06T11:09:04.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.915+0000 7fc6c27fc700 1 -- 172.21.15.146:0/1321624799 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc6d402acd0 con 0x5641b0a6ac90 2023-10-06T11:09:04.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.915+0000 7fc6c27fc700 1 -- 172.21.15.146:0/1321624799 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc6d4035c90 con 0x5641b0a6ac90 2023-10-06T11:09:04.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.915+0000 7fc6f38d5b80 10 client.5697 fetch_fsmap learned FSMap version 35 2023-10-06T11:09:04.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.915+0000 7fc6f38d5b80 1 -- 172.21.15.146:0/1321624799 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) v3 -- 0x5641b096f530 con 0x5641b0a6ac90 2023-10-06T11:09:04.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.915+0000 7fc6c27fc700 1 -- 172.21.15.146:0/1321624799 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6dc006ba0 con 0x5641b0a6ac90 2023-10-06T11:09:04.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.915+0000 7fc6c27fc700 1 -- 172.21.15.146:0/1321624799 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 35) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc6d4034470 con 0x5641b0a6ac90 2023-10-06T11:09:04.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.915+0000 7fc6f38d5b80 10 client.5697 fetch_fsmap finished waiting for FSMap version 35 2023-10-06T11:09:04.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.915+0000 7fc6f38d5b80 10 client.5697 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-10-06T11:09:04.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.915+0000 7fc6f38d5b80 20 client.5697 populate_metadata read hostname 'smithi146' 2023-10-06T11:09:04.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.915+0000 7fc6f38d5b80 1 --2- 172.21.15.146:0/1321624799 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x5641b0afcdb0 0x5641b0aa9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:04.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.915+0000 7fc6f38d5b80 4 client.5697 mds_command: new command op to 5481 tid=0[{"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}] 2023-10-06T11:09:04.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.915+0000 7fc6f38d5b80 1 -- 172.21.15.146:0/1321624799 --> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}) v1 -- 0x5641b095cec0 con 0x5641b0afcdb0 2023-10-06T11:09:04.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.915+0000 7fc6e37fe700 1 --2- 172.21.15.146:0/1321624799 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x5641b0afcdb0 0x5641b0aa9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:04.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.916+0000 7fc6c27fc700 10 client.5697 ms_handle_connect on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:04.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.916+0000 7fc6e37fe700 1 --2- 172.21.15.146:0/1321624799 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x5641b0afcdb0 0x5641b0aa9aa0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=928b11d906579596 server_cookie=7a97d2ba20ba1f68 in_seq=0 out_seq=0 2023-10-06T11:09:04.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.917+0000 7fc6c27fc700 1 -- 172.21.15.146:0/1321624799 <== mds.0 v2:172.21.15.146:6835/2252184844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+26 (crc 0 0 0) 0x5641b095cec0 con 0x5641b0afcdb0 2023-10-06T11:09:04.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.917+0000 7fc6c27fc700 10 client.5697 handle_command_reply: tid=0 2023-10-06T11:09:04.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.917+0000 7fc6f38d5b80 1 client.5697 shutdown 2023-10-06T11:09:04.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.917+0000 7fc6f38d5b80 1 -- 172.21.15.146:0/1321624799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b0a6ac90 msgr2=0x5641b0a90e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:04.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.917+0000 7fc6f38d5b80 1 --2- 172.21.15.146:0/1321624799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b0a6ac90 0x5641b0a90e30 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4007400 tx=0x7fc6d4023000 comp rx=0 tx=0).stop 2023-10-06T11:09:04.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.917+0000 7fc6f38d5b80 1 -- 172.21.15.146:0/1321624799 shutdown_connections 2023-10-06T11:09:04.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.917+0000 7fc6f38d5b80 1 --2- 172.21.15.146:0/1321624799 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x5641b0afcdb0 0x5641b0aa9aa0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:04.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.917+0000 7fc6f38d5b80 1 --2- 172.21.15.146:0/1321624799 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5641b0ab0b50 0x5641b0aaf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:04.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.917+0000 7fc6f38d5b80 1 --2- 172.21.15.146:0/1321624799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5641b0a6ac90 0x5641b0a90e30 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:04.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.917+0000 7fc6c27fc700 0 client.5697 ms_handle_reset on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:04.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.917+0000 7fc6f38d5b80 1 --2- 172.21.15.146:0/1321624799 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5641b0a6ca60 0x5641b0aaf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:04.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.917+0000 7fc6f38d5b80 1 -- 172.21.15.146:0/1321624799 >> 172.21.15.146:0/1321624799 conn(0x5641b0a6b130 msgr2=0x5641b0aad350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:04.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.917+0000 7fc6f38d5b80 1 -- 172.21.15.146:0/1321624799 shutdown_connections 2023-10-06T11:09:04.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.917+0000 7fc6f38d5b80 1 -- 172.21.15.146:0/1321624799 wait complete. 2023-10-06T11:09:04.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.917+0000 7fc6f38d5b80 20 client.5697 trim_cache size 0 max 16384 2023-10-06T11:09:04.924 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:09:04.925 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": -2 2023-10-06T11:09:04.925 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:09:04.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.918+0000 7fc6ea5dd700 1 -- 172.21.15.146:0/3829817393 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc6d0066f30 msgr2=0x7fc6d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:04.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.918+0000 7fc6ea5dd700 1 --2- 172.21.15.146:0/3829817393 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc6d0066f30 0x7fc6d00693e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4007fd0 tx=0x7fc6d4007c70 comp rx=0 tx=0).stop 2023-10-06T11:09:04.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.918+0000 7fc6ea5dd700 1 -- 172.21.15.146:0/3829817393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6e4149a40 msgr2=0x7fc6e40c5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:04.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.918+0000 7fc6ea5dd700 1 --2- 172.21.15.146:0/3829817393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6e4149a40 0x7fc6e40c5400 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc00bb10 tx=0x7fc6d801a000 comp rx=0 tx=0).stop 2023-10-06T11:09:04.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.918+0000 7fc6ea5dd700 1 -- 172.21.15.146:0/3829817393 shutdown_connections 2023-10-06T11:09:04.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.918+0000 7fc6ea5dd700 1 --2- 172.21.15.146:0/3829817393 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc6d0066f30 0x7fc6d00693e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:04.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.918+0000 7fc6ea5dd700 1 --2- 172.21.15.146:0/3829817393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6e40c5940 0x7fc6e40c18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:04.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.918+0000 7fc6ea5dd700 1 --2- 172.21.15.146:0/3829817393 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6cc004810 0x7fc6e4145050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:04.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.918+0000 7fc6ea5dd700 1 --2- 172.21.15.146:0/3829817393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6e4149a40 0x7fc6e40c5400 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:04.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.918+0000 7fc6ea5dd700 1 -- 172.21.15.146:0/3829817393 >> 172.21.15.146:0/3829817393 conn(0x7fc6e40c9fa0 msgr2=0x7fc6e414f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:04.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.918+0000 7fc6ea5dd700 1 -- 172.21.15.146:0/3829817393 shutdown_connections 2023-10-06T11:09:04.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:04.918+0000 7fc6ea5dd700 1 -- 172.21.15.146:0/3829817393 wait complete. 2023-10-06T11:09:04.931 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/i/dont/exist' returned '{'return_code': -2}' 2023-10-06T11:09:04.931 INFO:tasks.cephfs.test_scrub_checks:First run: flushing /scrub_test_path/ceph-qa-suite/suites 2023-10-06T11:09:04.931 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/suites' 2023-10-06T11:09:04.931 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:09:05.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.045+0000 7fc9682c6700 1 Processor -- start 2023-10-06T11:09:05.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.045+0000 7fc9682c6700 1 -- start start 2023-10-06T11:09:05.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.046+0000 7fc9682c6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9600cc950 0x7fc960157800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:05.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.046+0000 7fc9682c6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9600ccf20 con 0x7fc960157430 2023-10-06T11:09:05.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.046+0000 7fc9682c6700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9600cd200 con 0x7fc9600ab010 2023-10-06T11:09:05.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.046+0000 7fc9682c6700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9600c3dd0 con 0x7fc9600cc950 2023-10-06T11:09:05.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.046+0000 7fc966062700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc960157430 0x7fc9600ceb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38784/0 (socket says 172.21.15.146:38784) 2023-10-06T11:09:05.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.046+0000 7fc966062700 1 -- 172.21.15.146:0/3587268166 learned_addr learned my addr 172.21.15.146:0/3587268166 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:05.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.047+0000 7fc966863700 1 --2- 172.21.15.146:0/3587268166 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9600cc950 0x7fc960157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:05.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.047+0000 7fc965060700 1 -- 172.21.15.146:0/3587268166 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 774869836 0 0) 0x7fc9600ccf20 con 0x7fc960157430 2023-10-06T11:09:05.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.047+0000 7fc965060700 1 -- 172.21.15.146:0/3587268166 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc94c003570 con 0x7fc960157430 2023-10-06T11:09:05.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.047+0000 7fc965060700 1 -- 172.21.15.146:0/3587268166 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2075914231 0 0) 0x7fc9600cd200 con 0x7fc9600ab010 2023-10-06T11:09:05.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.047+0000 7fc965060700 1 -- 172.21.15.146:0/3587268166 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9600ccf20 con 0x7fc9600ab010 2023-10-06T11:09:05.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.047+0000 7fc966863700 1 -- 172.21.15.146:0/3587268166 >> v1:172.21.15.151:6789/0 conn(0x7fc9600ab010 legacy=0x7fc9600cc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:05.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.047+0000 7fc966863700 1 -- 172.21.15.146:0/3587268166 >> v1:172.21.15.146:6789/0 conn(0x7fc960157430 legacy=0x7fc9600ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:05.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.047+0000 7fc966863700 1 -- 172.21.15.146:0/3587268166 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9600cd4e0 con 0x7fc9600cc950 2023-10-06T11:09:05.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.047+0000 7fc966863700 1 --2- 172.21.15.146:0/3587268166 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9600cc950 0x7fc960157800 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc958009910 tx=0x7fc9580091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e66177b9f8748837 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:05.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.047+0000 7fc965060700 1 -- 172.21.15.146:0/3587268166 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc958011630 con 0x7fc9600cc950 2023-10-06T11:09:05.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.047+0000 7fc965060700 1 -- 172.21.15.146:0/3587268166 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc958011790 con 0x7fc9600cc950 2023-10-06T11:09:05.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.047+0000 7fc965060700 1 -- 172.21.15.146:0/3587268166 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc958011b10 con 0x7fc9600cc950 2023-10-06T11:09:05.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.048+0000 7fc9682c6700 1 -- 172.21.15.146:0/3587268166 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9600cc950 msgr2=0x7fc960157800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:05.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.048+0000 7fc9682c6700 1 --2- 172.21.15.146:0/3587268166 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9600cc950 0x7fc960157800 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc958009910 tx=0x7fc9580091a0 comp rx=0 tx=0).stop 2023-10-06T11:09:05.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.048+0000 7fc9682c6700 1 -- 172.21.15.146:0/3587268166 shutdown_connections 2023-10-06T11:09:05.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.048+0000 7fc9682c6700 1 --2- 172.21.15.146:0/3587268166 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9600cc950 0x7fc960157800 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:05.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.048+0000 7fc9682c6700 1 -- 172.21.15.146:0/3587268166 >> 172.21.15.146:0/3587268166 conn(0x7fc960067c50 msgr2=0x7fc9600ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:05.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.048+0000 7fc9682c6700 1 -- 172.21.15.146:0/3587268166 shutdown_connections 2023-10-06T11:09:05.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.048+0000 7fc9682c6700 1 -- 172.21.15.146:0/3587268166 wait complete. 2023-10-06T11:09:05.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.049+0000 7fc9682c6700 1 Processor -- start 2023-10-06T11:09:05.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.049+0000 7fc9682c6700 1 -- start start 2023-10-06T11:09:05.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.050+0000 7fc9682c6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9600ab010 0x7fc9600ae950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:05.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.050+0000 7fc9682c6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9600cc950 0x7fc9600b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:05.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.050+0000 7fc9682c6700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc960157430 0x7fc960068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:05.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.050+0000 7fc9682c6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96014d860 con 0x7fc9600ab010 2023-10-06T11:09:05.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.050+0000 7fc9682c6700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9600aee90 con 0x7fc960157430 2023-10-06T11:09:05.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.050+0000 7fc9682c6700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9600af150 con 0x7fc9600cc950 2023-10-06T11:09:05.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.050+0000 7fc966062700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9600ab010 0x7fc9600ae950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:05.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.050+0000 7fc966062700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9600ab010 0x7fc9600ae950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48978/0 (socket says 172.21.15.146:48978) 2023-10-06T11:09:05.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.050+0000 7fc966062700 1 -- 172.21.15.146:0/2369962908 learned_addr learned my addr 172.21.15.146:0/2369962908 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:05.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.050+0000 7fc966863700 1 --2- 172.21.15.146:0/2369962908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc960157430 0x7fc960068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:05.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.050+0000 7fc965861700 1 --2- 172.21.15.146:0/2369962908 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9600cc950 0x7fc9600b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:05.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.050+0000 7fc966062700 1 -- 172.21.15.146:0/2369962908 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9600cc950 msgr2=0x7fc9600b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:05.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.050+0000 7fc966062700 1 --2- 172.21.15.146:0/2369962908 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9600cc950 0x7fc9600b02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:05.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.050+0000 7fc966062700 1 -- 172.21.15.146:0/2369962908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc960157430 msgr2=0x7fc960068580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:05.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.050+0000 7fc966062700 1 --2- 172.21.15.146:0/2369962908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc960157430 0x7fc960068580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:05.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.050+0000 7fc966062700 1 -- 172.21.15.146:0/2369962908 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc958009420 con 0x7fc9600ab010 2023-10-06T11:09:05.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.050+0000 7fc966062700 1 --2- 172.21.15.146:0/2369962908 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9600ab010 0x7fc9600ae950 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc95c00cce0 tx=0x7fc95c001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:05.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.051+0000 7fc9567fc700 1 -- 172.21.15.146:0/2369962908 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c00a8d0 con 0x7fc9600ab010 2023-10-06T11:09:05.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.051+0000 7fc9567fc700 1 -- 172.21.15.146:0/2369962908 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95c00aa30 con 0x7fc9600ab010 2023-10-06T11:09:05.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.051+0000 7fc9682c6700 1 -- 172.21.15.146:0/2369962908 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9600af430 con 0x7fc9600ab010 2023-10-06T11:09:05.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.051+0000 7fc9567fc700 1 -- 172.21.15.146:0/2369962908 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c00add0 con 0x7fc9600ab010 2023-10-06T11:09:05.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.051+0000 7fc9682c6700 1 -- 172.21.15.146:0/2369962908 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9600af9f0 con 0x7fc9600ab010 2023-10-06T11:09:05.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.052+0000 7fc9682c6700 1 -- 172.21.15.146:0/2369962908 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9600afd60 con 0x7fc9600ab010 2023-10-06T11:09:05.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.052+0000 7fc9567fc700 1 -- 172.21.15.146:0/2369962908 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc95c007300 con 0x7fc9600ab010 2023-10-06T11:09:05.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.052+0000 7fc9567fc700 1 --2- 172.21.15.146:0/2369962908 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc944066f30 0x7fc9440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:05.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.052+0000 7fc9567fc700 1 -- 172.21.15.146:0/2369962908 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc95c0849c0 con 0x7fc9600ab010 2023-10-06T11:09:05.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.052+0000 7fc965861700 1 --2- 172.21.15.146:0/2369962908 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc944066f30 0x7fc9440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:05.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.053+0000 7fc965861700 1 --2- 172.21.15.146:0/2369962908 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc944066f30 0x7fc9440693e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc9600cb4f0 tx=0x7fc950007d00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:05.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.057+0000 7fc9567fc700 1 -- 172.21.15.146:0/2369962908 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc95c051b50 con 0x7fc9600ab010 2023-10-06T11:09:05.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.280+0000 7fc9682c6700 1 -- 172.21.15.146:0/2369962908 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc9600b1200 con 0x7fc9600ab010 2023-10-06T11:09:05.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.281+0000 7fc9567fc700 1 -- 172.21.15.146:0/2369962908 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4609 (secure 0 0 0) 0x7fc95c055170 con 0x7fc9600ab010 2023-10-06T11:09:05.283 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:09:05.283 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":35,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5248,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3360977916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3360977916},{"type":"v1","addr":"172.21.15.151:6834","nonce":3360977916}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5251,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2265934004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":2265934004},{"type":"v1","addr":"172.21.15.151:6835","nonce":2265934004}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2387575667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2387575667},{"type":"v1","addr":"172.21.15.146:6836","nonce":2387575667}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:08:42.797557+0000","modified":"2023-10-06T11:08:46.435072+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5481":{"gid":5481,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/2252184844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2252184844},{"type":"v1","addr":"172.21.15.146:6837","nonce":2252184844}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T11:09:05.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.283+0000 7fc9682c6700 1 -- 172.21.15.146:0/2369962908 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc944066f30 msgr2=0x7fc9440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:05.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.283+0000 7fc9682c6700 1 --2- 172.21.15.146:0/2369962908 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc944066f30 0x7fc9440693e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc9600cb4f0 tx=0x7fc950007d00 comp rx=0 tx=0).stop 2023-10-06T11:09:05.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.283+0000 7fc9682c6700 1 -- 172.21.15.146:0/2369962908 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9600ab010 msgr2=0x7fc9600ae950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:05.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.283+0000 7fc9682c6700 1 --2- 172.21.15.146:0/2369962908 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9600ab010 0x7fc9600ae950 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc95c00cce0 tx=0x7fc95c001b10 comp rx=0 tx=0).stop 2023-10-06T11:09:05.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.283+0000 7fc9682c6700 1 -- 172.21.15.146:0/2369962908 shutdown_connections 2023-10-06T11:09:05.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.283+0000 7fc9682c6700 1 --2- 172.21.15.146:0/2369962908 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc944066f30 0x7fc9440693e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:05.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.283+0000 7fc9682c6700 1 --2- 172.21.15.146:0/2369962908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc960157430 0x7fc960068580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:05.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.283+0000 7fc9682c6700 1 --2- 172.21.15.146:0/2369962908 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9600ab010 0x7fc9600ae950 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:05.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.283+0000 7fc9682c6700 1 --2- 172.21.15.146:0/2369962908 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9600cc950 0x7fc9600b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:05.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.283+0000 7fc9682c6700 1 -- 172.21.15.146:0/2369962908 >> 172.21.15.146:0/2369962908 conn(0x7fc960067c50 msgr2=0x7fc9600ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:05.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.283+0000 7fc9682c6700 1 -- 172.21.15.146:0/2369962908 shutdown_connections 2023-10-06T11:09:05.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.283+0000 7fc9682c6700 1 -- 172.21.15.146:0/2369962908 wait complete. 2023-10-06T11:09:05.286 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 35 2023-10-06T11:09:05.297 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok flush_path /scrub_test_path/ceph-qa-suite/suites 2023-10-06T11:09:05.571 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:09:05.571 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0 2023-10-06T11:09:05.572 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:09:05.582 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/suites' got response code '0' and stdout '{ "return_code": 0 } ' 2023-10-06T11:09:05.582 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites' 2023-10-06T11:09:05.582 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites 2023-10-06T11:09:05.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.698+0000 7f0cc76f2700 1 Processor -- start 2023-10-06T11:09:05.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.698+0000 7f0cc76f2700 1 -- start start 2023-10-06T11:09:05.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.699+0000 7f0cc76f2700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cc00cc960 0x7f0cc0164c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:05.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.699+0000 7f0cc76f2700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc00ae2a0 con 0x7f0cc00ae730 2023-10-06T11:09:05.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.699+0000 7f0cc76f2700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc015a530 con 0x7f0cc015a160 2023-10-06T11:09:05.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.699+0000 7f0cc76f2700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc00ccdc0 con 0x7f0cc00cc960 2023-10-06T11:09:05.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.699+0000 7f0cc4c8d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0cc00ae730 0x7f0cc00aebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38790/0 (socket says 172.21.15.146:38790) 2023-10-06T11:09:05.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.699+0000 7f0cc4c8d700 1 -- 172.21.15.146:0/2116697821 learned_addr learned my addr 172.21.15.146:0/2116697821 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:05.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.699+0000 7f0cc5c8f700 1 --2- 172.21.15.146:0/2116697821 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cc00cc960 0x7f0cc0164c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:05.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.699+0000 7f0cb7fff700 1 -- 172.21.15.146:0/2116697821 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2496897146 0 0) 0x7f0cc00ae2a0 con 0x7f0cc00ae730 2023-10-06T11:09:05.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.699+0000 7f0cb7fff700 1 -- 172.21.15.146:0/2116697821 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cac003570 con 0x7f0cc00ae730 2023-10-06T11:09:05.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.699+0000 7f0cb7fff700 1 -- 172.21.15.146:0/2116697821 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 471230529 0 0) 0x7f0cc015a530 con 0x7f0cc015a160 2023-10-06T11:09:05.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.699+0000 7f0cb7fff700 1 -- 172.21.15.146:0/2116697821 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cc00ae2a0 con 0x7f0cc015a160 2023-10-06T11:09:05.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.699+0000 7f0cc5c8f700 1 -- 172.21.15.146:0/2116697821 >> v1:172.21.15.151:6789/0 conn(0x7f0cc015a160 legacy=0x7f0cc00c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:05.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.699+0000 7f0cc5c8f700 1 -- 172.21.15.146:0/2116697821 >> v1:172.21.15.146:6789/0 conn(0x7f0cc00ae730 legacy=0x7f0cc00aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:05.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.699+0000 7f0cc5c8f700 1 -- 172.21.15.146:0/2116697821 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc00c5cb0 con 0x7f0cc00cc960 2023-10-06T11:09:05.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.700+0000 7f0cc5c8f700 1 --2- 172.21.15.146:0/2116697821 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cc00cc960 0x7f0cc0164c60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8009e90 tx=0x7f0cb8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b94ec0205d16f62a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:05.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.700+0000 7f0cb7fff700 1 -- 172.21.15.146:0/2116697821 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb800e070 con 0x7f0cc00cc960 2023-10-06T11:09:05.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.700+0000 7f0cb7fff700 1 -- 172.21.15.146:0/2116697821 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb800bb80 con 0x7f0cc00cc960 2023-10-06T11:09:05.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.700+0000 7f0cb7fff700 1 -- 172.21.15.146:0/2116697821 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb8012430 con 0x7f0cc00cc960 2023-10-06T11:09:05.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.700+0000 7f0cc76f2700 1 -- 172.21.15.146:0/2116697821 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cc00cc960 msgr2=0x7f0cc0164c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:05.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.700+0000 7f0cc76f2700 1 --2- 172.21.15.146:0/2116697821 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cc00cc960 0x7f0cc0164c60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8009e90 tx=0x7f0cb8009780 comp rx=0 tx=0).stop 2023-10-06T11:09:05.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.700+0000 7f0cc76f2700 1 -- 172.21.15.146:0/2116697821 shutdown_connections 2023-10-06T11:09:05.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.700+0000 7f0cc76f2700 1 --2- 172.21.15.146:0/2116697821 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cc00cc960 0x7f0cc0164c60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:05.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.700+0000 7f0cc76f2700 1 -- 172.21.15.146:0/2116697821 >> 172.21.15.146:0/2116697821 conn(0x7f0cc006f380 msgr2=0x7f0cc00d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:05.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.700+0000 7f0cc76f2700 1 -- 172.21.15.146:0/2116697821 shutdown_connections 2023-10-06T11:09:05.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.700+0000 7f0cc76f2700 1 -- 172.21.15.146:0/2116697821 wait complete. 2023-10-06T11:09:05.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.701+0000 7f0cc76f2700 1 Processor -- start 2023-10-06T11:09:05.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.701+0000 7f0cc76f2700 1 -- start start 2023-10-06T11:09:05.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.702+0000 7f0cc76f2700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cc00ae730 0x7f0cc0156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:05.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.702+0000 7f0cc76f2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0cc00cc960 0x7f0cc0156da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:05.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.702+0000 7f0cc76f2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cc015a160 0x7f0cc00b5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:05.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.702+0000 7f0cc76f2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc009a480 con 0x7f0cc015a160 2023-10-06T11:09:05.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.702+0000 7f0cc76f2700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc009ded0 con 0x7f0cc00cc960 2023-10-06T11:09:05.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.702+0000 7f0cc76f2700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc0156bc0 con 0x7f0cc00ae730 2023-10-06T11:09:05.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.702+0000 7f0cc5c8f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cc015a160 0x7f0cc00b5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:05.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.702+0000 7f0cc5c8f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cc015a160 0x7f0cc00b5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48986/0 (socket says 172.21.15.146:48986) 2023-10-06T11:09:05.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.702+0000 7f0cc5c8f700 1 -- 172.21.15.146:0/1009696453 learned_addr learned my addr 172.21.15.146:0/1009696453 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:05.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.703+0000 7f0cc5c8f700 1 -- 172.21.15.146:0/1009696453 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cc00ae730 msgr2=0x7f0cc0156680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:05.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.703+0000 7f0cc5c8f700 1 --2- 172.21.15.146:0/1009696453 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cc00ae730 0x7f0cc0156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:05.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.703+0000 7f0cc5c8f700 1 -- 172.21.15.146:0/1009696453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0cc00cc960 msgr2=0x7f0cc0156da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:05.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.703+0000 7f0cc4c8d700 1 --2- 172.21.15.146:0/1009696453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0cc00cc960 0x7f0cc0156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:05.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.703+0000 7f0cc5c8f700 1 --2- 172.21.15.146:0/1009696453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0cc00cc960 0x7f0cc0156da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:05.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.703+0000 7f0cc5c8f700 1 -- 172.21.15.146:0/1009696453 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb8009a20 con 0x7f0cc015a160 2023-10-06T11:09:05.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.703+0000 7f0cc5c8f700 1 --2- 172.21.15.146:0/1009696453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cc015a160 0x7f0cc00b5960 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0088c60 tx=0x7f0cb8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:05.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.703+0000 7f0cb57fa700 1 -- 172.21.15.146:0/1009696453 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb8012e00 con 0x7f0cc015a160 2023-10-06T11:09:05.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.703+0000 7f0cb57fa700 1 -- 172.21.15.146:0/1009696453 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb801b630 con 0x7f0cc015a160 2023-10-06T11:09:05.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.703+0000 7f0cc76f2700 1 -- 172.21.15.146:0/1009696453 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc009dbc0 con 0x7f0cc015a160 2023-10-06T11:09:05.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.703+0000 7f0cb57fa700 1 -- 172.21.15.146:0/1009696453 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb801b9f0 con 0x7f0cc015a160 2023-10-06T11:09:05.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.703+0000 7f0cc76f2700 1 -- 172.21.15.146:0/1009696453 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc016ac60 con 0x7f0cc015a160 2023-10-06T11:09:05.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.704+0000 7f0cb57fa700 1 -- 172.21.15.146:0/1009696453 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0cb801c400 con 0x7f0cc015a160 2023-10-06T11:09:05.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.705+0000 7f0cb57fa700 1 --2- 172.21.15.146:0/1009696453 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0ca4066f30 0x7f0ca40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:05.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.705+0000 7f0cb57fa700 1 -- 172.21.15.146:0/1009696453 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0cb80865d0 con 0x7f0cc015a160 2023-10-06T11:09:05.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.705+0000 7f0cc548e700 1 --2- 172.21.15.146:0/1009696453 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0ca4066f30 0x7f0ca40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:05.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.705+0000 7f0cc548e700 1 --2- 172.21.15.146:0/1009696453 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0ca4066f30 0x7f0ca40693e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0cc00b29d0 tx=0x7f0cbc0079c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:05.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.707+0000 7f0cd09eab80 1 Processor -- start 2023-10-06T11:09:05.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.707+0000 7f0cd09eab80 1 -- start start 2023-10-06T11:09:05.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.707+0000 7f0cd09eab80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561da3c04b70 0x561da3c04f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:05.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.707+0000 7f0cd09eab80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561da3bc0a80 0x561da3bbd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:05.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.707+0000 7f0cd09eab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561da3bbecb0 0x561da3bbdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:05.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.707+0000 7f0cd09eab80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x561da3b3dd60 con 0x561da3c04b70 2023-10-06T11:09:05.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.707+0000 7f0cd09eab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561da3b14b50 con 0x561da3bbecb0 2023-10-06T11:09:05.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.707+0000 7f0cd09eab80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x561da3b12350 con 0x561da3bc0a80 2023-10-06T11:09:05.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.707+0000 7f0cc548e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561da3c04b70 0x561da3c04f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:05.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.707+0000 7f0cc548e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561da3c04b70 0x561da3c04f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48996/0 (socket says 172.21.15.146:48996) 2023-10-06T11:09:05.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.708+0000 7f0cc548e700 1 -- 172.21.15.146:0/1805750023 learned_addr learned my addr 172.21.15.146:0/1805750023 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:05.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.708+0000 7f0cc548e700 1 -- 172.21.15.146:0/1805750023 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561da3bc0a80 msgr2=0x561da3bbd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:05.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.708+0000 7f0cc548e700 1 --2- 172.21.15.146:0/1805750023 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561da3bc0a80 0x561da3bbd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:05.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.708+0000 7f0cc548e700 1 -- 172.21.15.146:0/1805750023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561da3bbecb0 msgr2=0x561da3bbdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:05.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.708+0000 7f0cc548e700 1 --2- 172.21.15.146:0/1805750023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561da3bbecb0 0x561da3bbdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:05.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.708+0000 7f0cc548e700 1 -- 172.21.15.146:0/1805750023 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561da39a8350 con 0x561da3c04b70 2023-10-06T11:09:05.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.708+0000 7f0cc548e700 1 --2- 172.21.15.146:0/1805750023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561da3c04b70 0x561da3c04f40 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc0168d0 tx=0x7f0cbc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d37436e197b1701 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:05.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.708+0000 7f0caa7fc700 1 -- 172.21.15.146:0/1805750023 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc01b070 con 0x561da3c04b70 2023-10-06T11:09:05.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.708+0000 7f0caa7fc700 1 -- 172.21.15.146:0/1805750023 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cbc0160d0 con 0x561da3c04b70 2023-10-06T11:09:05.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.708+0000 7f0caa7fc700 1 -- 172.21.15.146:0/1805750023 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc013a70 con 0x561da3c04b70 2023-10-06T11:09:05.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.708+0000 7f0cd09eab80 1 -- 172.21.15.146:0/1805750023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561da3c04b70 msgr2=0x561da3c04f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:05.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.708+0000 7f0cd09eab80 1 --2- 172.21.15.146:0/1805750023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561da3c04b70 0x561da3c04f40 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc0168d0 tx=0x7f0cbc013000 comp rx=0 tx=0).stop 2023-10-06T11:09:05.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.709+0000 7f0cd09eab80 1 -- 172.21.15.146:0/1805750023 shutdown_connections 2023-10-06T11:09:05.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.709+0000 7f0cd09eab80 1 --2- 172.21.15.146:0/1805750023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561da3bbecb0 0x561da3bbdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:05.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.709+0000 7f0cd09eab80 1 --2- 172.21.15.146:0/1805750023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561da3c04b70 0x561da3c04f40 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:05.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.709+0000 7f0cd09eab80 1 --2- 172.21.15.146:0/1805750023 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561da3bc0a80 0x561da3bbd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:05.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.709+0000 7f0cd09eab80 1 -- 172.21.15.146:0/1805750023 >> 172.21.15.146:0/1805750023 conn(0x561da3bbf150 msgr2=0x561da3bbf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:05.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.709+0000 7f0cd09eab80 1 -- 172.21.15.146:0/1805750023 shutdown_connections 2023-10-06T11:09:05.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.709+0000 7f0cd09eab80 1 -- 172.21.15.146:0/1805750023 wait complete. 2023-10-06T11:09:05.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.709+0000 7f0cd09eab80 1 -- start start 2023-10-06T11:09:05.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.709+0000 7f0cd09eab80 1 Processor -- start 2023-10-06T11:09:05.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.710+0000 7f0cd09eab80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561da3bbecb0 0x561da3be8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:05.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.710+0000 7f0cd09eab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561da3bc0a80 0x561da3be5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:05.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.710+0000 7f0cd09eab80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561da3c04b70 0x561da3be60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:05.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.710+0000 7f0cd09eab80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x561da3b0e140 con 0x561da3bbecb0 2023-10-06T11:09:05.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.710+0000 7f0cd09eab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561da3ab9970 con 0x561da3bc0a80 2023-10-06T11:09:05.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.710+0000 7f0cd09eab80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x561da3ad4f80 con 0x561da3c04b70 2023-10-06T11:09:05.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.710+0000 7f0cd09eab80 10 client.0 _ll_register_callbacks cb 0x561da39ab010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:09:05.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.710+0000 7f0cc548e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561da3bbecb0 0x561da3be8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:05.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.710+0000 7f0cc548e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561da3bbecb0 0x561da3be8160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49010/0 (socket says 172.21.15.146:49010) 2023-10-06T11:09:05.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.710+0000 7f0cc548e700 1 -- 172.21.15.146:0/1381618845 learned_addr learned my addr 172.21.15.146:0/1381618845 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:05.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.710+0000 7f0cc548e700 1 -- 172.21.15.146:0/1381618845 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561da3c04b70 msgr2=0x561da3be60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:05.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.710+0000 7f0cc548e700 1 --2- 172.21.15.146:0/1381618845 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561da3c04b70 0x561da3be60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:05.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.710+0000 7f0cc548e700 1 -- 172.21.15.146:0/1381618845 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561da3bc0a80 msgr2=0x561da3be5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:05.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.710+0000 7f0cc548e700 1 --2- 172.21.15.146:0/1381618845 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561da3bc0a80 0x561da3be5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:05.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.710+0000 7f0cc548e700 1 -- 172.21.15.146:0/1381618845 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc00ae2a0 con 0x561da3bbecb0 2023-10-06T11:09:05.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.711+0000 7f0cc548e700 1 --2- 172.21.15.146:0/1381618845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561da3bbecb0 0x561da3be8160 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc007fd0 tx=0x7f0cbc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3351522bf28efca8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:05.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.711+0000 7f0c9f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:09:05.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.711+0000 7f0c9f7fe700 1 -- 172.21.15.146:0/1381618845 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc016240 con 0x561da3bbecb0 2023-10-06T11:09:05.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.711+0000 7f0c9f7fe700 1 -- 172.21.15.146:0/1381618845 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0cbc02a630 con 0x561da3bbecb0 2023-10-06T11:09:05.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.711+0000 7f0cd09eab80 1 -- 172.21.15.146:0/1381618845 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561da3bb2770 con 0x561da3bbecb0 2023-10-06T11:09:05.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.711+0000 7f0c9f7fe700 1 -- 172.21.15.146:0/1381618845 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0cbc02aa00 con 0x561da3bbecb0 2023-10-06T11:09:05.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.711+0000 7f0cd09eab80 10 client.5715 fetch_fsmap learned FSMap version 35 2023-10-06T11:09:05.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.711+0000 7f0cd09eab80 1 -- 172.21.15.146:0/1381618845 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) v3 -- 0x561da394b0c0 con 0x561da3bbecb0 2023-10-06T11:09:05.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.711+0000 7f0c9f7fe700 1 -- 172.21.15.146:0/1381618845 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561da3bb2770 con 0x561da3bbecb0 2023-10-06T11:09:05.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.711+0000 7f0c9f7fe700 1 -- 172.21.15.146:0/1381618845 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 35) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0cbc02ab60 con 0x561da3bbecb0 2023-10-06T11:09:05.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.711+0000 7f0cd09eab80 10 client.5715 fetch_fsmap finished waiting for FSMap version 35 2023-10-06T11:09:05.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.711+0000 7f0cd09eab80 10 client.5715 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-10-06T11:09:05.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.711+0000 7f0cd09eab80 20 client.5715 populate_metadata read hostname 'smithi146' 2023-10-06T11:09:05.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.711+0000 7f0cd09eab80 1 --2- 172.21.15.146:0/1381618845 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x561da3be4540 0x561da3c00e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:05.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.711+0000 7f0cd09eab80 4 client.5715 mds_command: new command op to 5481 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:09:05.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.711+0000 7f0cd09eab80 1 -- 172.21.15.146:0/1381618845 --> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561da3b8f6a0 con 0x561da3be4540 2023-10-06T11:09:05.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.711+0000 7f0cc4c8d700 1 --2- 172.21.15.146:0/1381618845 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x561da3be4540 0x561da3c00e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:05.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.712+0000 7f0c9f7fe700 10 client.5715 ms_handle_connect on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:05.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.712+0000 7f0cc4c8d700 1 --2- 172.21.15.146:0/1381618845 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x561da3be4540 0x561da3c00e30 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acff5e47af1295cf server_cookie=4e0566dbd133a639 in_seq=0 out_seq=0 2023-10-06T11:09:05.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.712+0000 7f0c9f7fe700 1 -- 172.21.15.146:0/1381618845 <== mds.0 v2:172.21.15.146:6835/2252184844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x561da3b8f6a0 con 0x561da3be4540 2023-10-06T11:09:05.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.712+0000 7f0c9f7fe700 10 client.5715 handle_command_reply: tid=0 2023-10-06T11:09:05.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.712+0000 7f0cd09eab80 1 client.5715 shutdown 2023-10-06T11:09:05.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.712+0000 7f0cd09eab80 1 -- 172.21.15.146:0/1381618845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561da3bbecb0 msgr2=0x561da3be8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:05.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.712+0000 7f0cd09eab80 1 --2- 172.21.15.146:0/1381618845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561da3bbecb0 0x561da3be8160 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc007fd0 tx=0x7f0cbc016000 comp rx=0 tx=0).stop 2023-10-06T11:09:05.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.712+0000 7f0cd09eab80 1 -- 172.21.15.146:0/1381618845 shutdown_connections 2023-10-06T11:09:05.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.712+0000 7f0cd09eab80 1 --2- 172.21.15.146:0/1381618845 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x561da3be4540 0x561da3c00e30 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:05.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.712+0000 7f0cd09eab80 1 --2- 172.21.15.146:0/1381618845 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561da3c04b70 0x561da3be60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:05.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.712+0000 7f0cd09eab80 1 --2- 172.21.15.146:0/1381618845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561da3bbecb0 0x561da3be8160 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:05.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.712+0000 7f0c9f7fe700 0 client.5715 ms_handle_reset on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:05.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.712+0000 7f0cd09eab80 1 --2- 172.21.15.146:0/1381618845 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561da3bc0a80 0x561da3be5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:05.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.712+0000 7f0cd09eab80 1 -- 172.21.15.146:0/1381618845 >> 172.21.15.146:0/1381618845 conn(0x561da3bbf150 msgr2=0x561da3c02640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:05.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.712+0000 7f0cd09eab80 1 -- 172.21.15.146:0/1381618845 shutdown_connections 2023-10-06T11:09:05.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.712+0000 7f0cd09eab80 1 -- 172.21.15.146:0/1381618845 wait complete. 2023-10-06T11:09:05.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.712+0000 7f0cd09eab80 20 client.5715 trim_cache size 0 max 16384 2023-10-06T11:09:05.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.728+0000 7f0cd09eab80 1 Processor -- start 2023-10-06T11:09:05.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.728+0000 7f0cd09eab80 1 -- start start 2023-10-06T11:09:05.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.729+0000 7f0cd09eab80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561da3bbecb0 0x561da3be7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:05.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.729+0000 7f0cd09eab80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561da3bc0a80 0x561da3be34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:05.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.729+0000 7f0cd09eab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561da3c04b70 0x561da3be3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:05.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.729+0000 7f0cd09eab80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x561da3990f10 con 0x561da3bbecb0 2023-10-06T11:09:05.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.729+0000 7f0cd09eab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561da3bbb4b0 con 0x561da3c04b70 2023-10-06T11:09:05.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.729+0000 7f0cd09eab80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x561da3c035c0 con 0x561da3bc0a80 2023-10-06T11:09:05.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.729+0000 7f0cc548e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561da3bbecb0 0x561da3be7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:05.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.729+0000 7f0cc548e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561da3bbecb0 0x561da3be7c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49020/0 (socket says 172.21.15.146:49020) 2023-10-06T11:09:05.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.729+0000 7f0cc548e700 1 -- 172.21.15.146:0/2609828564 learned_addr learned my addr 172.21.15.146:0/2609828564 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:05.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.729+0000 7f0cc5c8f700 1 --2- 172.21.15.146:0/2609828564 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561da3c04b70 0x561da3be3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:05.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.730+0000 7f0cc4c8d700 1 --2- 172.21.15.146:0/2609828564 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561da3bc0a80 0x561da3be34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:05.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.730+0000 7f0cc548e700 1 -- 172.21.15.146:0/2609828564 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561da3bc0a80 msgr2=0x561da3be34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:05.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.730+0000 7f0cc548e700 1 --2- 172.21.15.146:0/2609828564 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561da3bc0a80 0x561da3be34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:05.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.730+0000 7f0cc548e700 1 -- 172.21.15.146:0/2609828564 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561da3c04b70 msgr2=0x561da3be3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:05.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.730+0000 7f0cc548e700 1 --2- 172.21.15.146:0/2609828564 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561da3c04b70 0x561da3be3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:05.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.730+0000 7f0cc548e700 1 -- 172.21.15.146:0/2609828564 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561da3adc860 con 0x561da3bbecb0 2023-10-06T11:09:05.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.730+0000 7f0cc4c8d700 1 --2- 172.21.15.146:0/2609828564 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561da3bc0a80 0x561da3be34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:09:05.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.730+0000 7f0cc548e700 1 --2- 172.21.15.146:0/2609828564 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561da3bbecb0 0x561da3be7c80 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc000f70 tx=0x7f0cbc02a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49aa945895397d3e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:05.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.730+0000 7f0caaffd700 1 -- 172.21.15.146:0/2609828564 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc0024d0 con 0x561da3bbecb0 2023-10-06T11:09:05.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.730+0000 7f0caaffd700 1 -- 172.21.15.146:0/2609828564 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cbc02a630 con 0x561da3bbecb0 2023-10-06T11:09:05.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.730+0000 7f0caaffd700 1 -- 172.21.15.146:0/2609828564 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc02aa00 con 0x561da3bbecb0 2023-10-06T11:09:05.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.730+0000 7f0cd09eab80 1 -- 172.21.15.146:0/2609828564 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561da3bbecb0 msgr2=0x561da3be7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:05.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.730+0000 7f0cd09eab80 1 --2- 172.21.15.146:0/2609828564 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561da3bbecb0 0x561da3be7c80 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc000f70 tx=0x7f0cbc02a000 comp rx=0 tx=0).stop 2023-10-06T11:09:05.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.730+0000 7f0cd09eab80 1 -- 172.21.15.146:0/2609828564 shutdown_connections 2023-10-06T11:09:05.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.730+0000 7f0cd09eab80 1 --2- 172.21.15.146:0/2609828564 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561da3c04b70 0x561da3be3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:05.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.730+0000 7f0cd09eab80 1 --2- 172.21.15.146:0/2609828564 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561da3bbecb0 0x561da3be7c80 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:05.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.730+0000 7f0cd09eab80 1 --2- 172.21.15.146:0/2609828564 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561da3bc0a80 0x561da3be34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:05.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.730+0000 7f0cd09eab80 1 -- 172.21.15.146:0/2609828564 >> 172.21.15.146:0/2609828564 conn(0x561da3bbf150 msgr2=0x561da3bbf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:05.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.730+0000 7f0cd09eab80 1 -- 172.21.15.146:0/2609828564 shutdown_connections 2023-10-06T11:09:05.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.730+0000 7f0cd09eab80 1 -- 172.21.15.146:0/2609828564 wait complete. 2023-10-06T11:09:05.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.731+0000 7f0cd09eab80 1 -- start start 2023-10-06T11:09:05.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.731+0000 7f0cd09eab80 1 Processor -- start 2023-10-06T11:09:05.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.732+0000 7f0cd09eab80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561da3bbecb0 0x561da3c0ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:05.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.732+0000 7f0cd09eab80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561da3bc0a80 0x561da3be34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:05.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.732+0000 7f0cd09eab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561da3c04b70 0x561da3be3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:05.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.732+0000 7f0cd09eab80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x561da3c6a8a0 con 0x561da3bbecb0 2023-10-06T11:09:05.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.732+0000 7f0cd09eab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561da3be4b40 con 0x561da3c04b70 2023-10-06T11:09:05.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.732+0000 7f0cd09eab80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x561da3bfaab0 con 0x561da3bc0a80 2023-10-06T11:09:05.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.732+0000 7f0cd09eab80 10 client.0 _ll_register_callbacks cb 0x561da39ab010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:09:05.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.732+0000 7f0cc548e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561da3bbecb0 0x561da3c0ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:05.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.732+0000 7f0cc548e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561da3bbecb0 0x561da3c0ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49034/0 (socket says 172.21.15.146:49034) 2023-10-06T11:09:05.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.732+0000 7f0cc548e700 1 -- 172.21.15.146:0/3668342153 learned_addr learned my addr 172.21.15.146:0/3668342153 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:05.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.732+0000 7f0cc4c8d700 1 --2- 172.21.15.146:0/3668342153 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561da3bc0a80 0x561da3be34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:05.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.732+0000 7f0cc5c8f700 1 --2- 172.21.15.146:0/3668342153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561da3c04b70 0x561da3be3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:05.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.732+0000 7f0cc548e700 1 -- 172.21.15.146:0/3668342153 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561da3bc0a80 msgr2=0x561da3be34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:05.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.732+0000 7f0cc548e700 1 --2- 172.21.15.146:0/3668342153 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561da3bc0a80 0x561da3be34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:05.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.732+0000 7f0cc548e700 1 -- 172.21.15.146:0/3668342153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561da3c04b70 msgr2=0x561da3be3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:05.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.732+0000 7f0cc548e700 1 --2- 172.21.15.146:0/3668342153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561da3c04b70 0x561da3be3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:05.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.732+0000 7f0cc548e700 1 -- 172.21.15.146:0/3668342153 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561da394b0c0 con 0x561da3bbecb0 2023-10-06T11:09:05.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.732+0000 7f0cc548e700 1 --2- 172.21.15.146:0/3668342153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561da3bbecb0 0x561da3c0ca30 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc040040 tx=0x7f0cbc02b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=646d4ce275f1d03b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:05.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.732+0000 7f0c9f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:09:05.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.733+0000 7f0c9f7fe700 1 -- 172.21.15.146:0/3668342153 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cbc0024d0 con 0x561da3bbecb0 2023-10-06T11:09:05.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.733+0000 7f0c9f7fe700 1 -- 172.21.15.146:0/3668342153 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0cbc02aa00 con 0x561da3bbecb0 2023-10-06T11:09:05.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.733+0000 7f0cd09eab80 1 -- 172.21.15.146:0/3668342153 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0cbc0160d0 con 0x561da3bbecb0 2023-10-06T11:09:05.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.733+0000 7f0c9f7fe700 1 -- 172.21.15.146:0/3668342153 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0cbc0339b0 con 0x561da3bbecb0 2023-10-06T11:09:05.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.733+0000 7f0cd09eab80 10 client.5721 fetch_fsmap learned FSMap version 35 2023-10-06T11:09:05.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.733+0000 7f0cd09eab80 1 -- 172.21.15.146:0/3668342153 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) v3 -- 0x561da3ac3550 con 0x561da3bbecb0 2023-10-06T11:09:05.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.733+0000 7f0c9f7fe700 1 -- 172.21.15.146:0/3668342153 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cbc055080 con 0x561da3bbecb0 2023-10-06T11:09:05.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.733+0000 7f0c9f7fe700 1 -- 172.21.15.146:0/3668342153 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 35) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0cbc033b10 con 0x561da3bbecb0 2023-10-06T11:09:05.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.733+0000 7f0cd09eab80 10 client.5721 fetch_fsmap finished waiting for FSMap version 35 2023-10-06T11:09:05.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.733+0000 7f0cd09eab80 10 client.5721 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-10-06T11:09:05.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.733+0000 7f0cd09eab80 20 client.5721 populate_metadata read hostname 'smithi146' 2023-10-06T11:09:05.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.733+0000 7f0cd09eab80 1 --2- 172.21.15.146:0/3668342153 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x561da3c0cf70 0x561da3c1d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:05.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.733+0000 7f0cd09eab80 4 client.5721 mds_command: new command op to 5481 tid=0[{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}] 2023-10-06T11:09:05.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.733+0000 7f0cd09eab80 1 -- 172.21.15.146:0/3668342153 --> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}) v1 -- 0x561da3ab0ee0 con 0x561da3c0cf70 2023-10-06T11:09:05.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.733+0000 7f0cc4c8d700 1 --2- 172.21.15.146:0/3668342153 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x561da3c0cf70 0x561da3c1d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:05.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.733+0000 7f0c9f7fe700 10 client.5721 ms_handle_connect on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:05.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.733+0000 7f0cc4c8d700 1 --2- 172.21.15.146:0/3668342153 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x561da3c0cf70 0x561da3c1d050 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b281ed69160e1fa5 server_cookie=47575c67538aba8c in_seq=0 out_seq=0 2023-10-06T11:09:05.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.734+0000 7f0c9f7fe700 1 -- 172.21.15.146:0/3668342153 <== mds.0 v2:172.21.15.146:6835/2252184844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x561da3ab0ee0 con 0x561da3c0cf70 2023-10-06T11:09:05.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.734+0000 7f0c9f7fe700 10 client.5721 handle_command_reply: tid=0 2023-10-06T11:09:05.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.734+0000 7f0cd09eab80 1 client.5721 shutdown 2023-10-06T11:09:05.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.734+0000 7f0cd09eab80 1 -- 172.21.15.146:0/3668342153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561da3bbecb0 msgr2=0x561da3c0ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:05.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.734+0000 7f0cd09eab80 1 --2- 172.21.15.146:0/3668342153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561da3bbecb0 0x561da3c0ca30 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc040040 tx=0x7f0cbc02b000 comp rx=0 tx=0).stop 2023-10-06T11:09:05.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.734+0000 7f0cd09eab80 1 -- 172.21.15.146:0/3668342153 shutdown_connections 2023-10-06T11:09:05.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.734+0000 7f0cd09eab80 1 --2- 172.21.15.146:0/3668342153 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x561da3c0cf70 0x561da3c1d050 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:05.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.734+0000 7f0cd09eab80 1 --2- 172.21.15.146:0/3668342153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561da3c04b70 0x561da3be3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:05.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.734+0000 7f0c9f7fe700 0 client.5721 ms_handle_reset on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:05.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.734+0000 7f0cd09eab80 1 --2- 172.21.15.146:0/3668342153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561da3bbecb0 0x561da3c0ca30 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:05.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.734+0000 7f0cd09eab80 1 --2- 172.21.15.146:0/3668342153 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561da3bc0a80 0x561da3be34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:05.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.734+0000 7f0cd09eab80 1 -- 172.21.15.146:0/3668342153 >> 172.21.15.146:0/3668342153 conn(0x561da3bbf150 msgr2=0x561da3bbf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:05.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.734+0000 7f0cd09eab80 1 -- 172.21.15.146:0/3668342153 shutdown_connections 2023-10-06T11:09:05.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.734+0000 7f0cd09eab80 1 -- 172.21.15.146:0/3668342153 wait complete. 2023-10-06T11:09:05.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.734+0000 7f0cd09eab80 20 client.5721 trim_cache size 0 max 16384 2023-10-06T11:09:05.743 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:09:05.744 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0, 2023-10-06T11:09:05.744 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_tag": "a3866a16-2dd9-4a7b-a799-2072ca69e6aa", 2023-10-06T11:09:05.744 INFO:teuthology.orchestra.run.smithi146.stdout: "mode": "asynchronous" 2023-10-06T11:09:05.744 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:09:05.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.735+0000 7f0cc76f2700 1 -- 172.21.15.146:0/1009696453 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0ca4066f30 msgr2=0x7f0ca40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:05.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.735+0000 7f0cc76f2700 1 --2- 172.21.15.146:0/1009696453 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0ca4066f30 0x7f0ca40693e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0cc00b29d0 tx=0x7f0cbc0079c0 comp rx=0 tx=0).stop 2023-10-06T11:09:05.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.735+0000 7f0cc76f2700 1 -- 172.21.15.146:0/1009696453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cc015a160 msgr2=0x7f0cc00b5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:05.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.735+0000 7f0cc76f2700 1 --2- 172.21.15.146:0/1009696453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cc015a160 0x7f0cc00b5960 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0088c60 tx=0x7f0cb8019000 comp rx=0 tx=0).stop 2023-10-06T11:09:05.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.735+0000 7f0cc76f2700 1 -- 172.21.15.146:0/1009696453 shutdown_connections 2023-10-06T11:09:05.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.735+0000 7f0cc76f2700 1 --2- 172.21.15.146:0/1009696453 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0ca4066f30 0x7f0ca40693e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:05.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.735+0000 7f0cc76f2700 1 --2- 172.21.15.146:0/1009696453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cc015a160 0x7f0cc00b5960 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:05.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.735+0000 7f0cc76f2700 1 --2- 172.21.15.146:0/1009696453 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cc00ae730 0x7f0cc0156680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:05.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.735+0000 7f0cc76f2700 1 --2- 172.21.15.146:0/1009696453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0cc00cc960 0x7f0cc0156da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:05.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.735+0000 7f0cc76f2700 1 -- 172.21.15.146:0/1009696453 >> 172.21.15.146:0/1009696453 conn(0x7f0cc006f380 msgr2=0x7f0cc0069900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:05.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.735+0000 7f0cc76f2700 1 -- 172.21.15.146:0/1009696453 shutdown_connections 2023-10-06T11:09:05.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.735+0000 7f0cc76f2700 1 -- 172.21.15.146:0/1009696453 wait complete. 2023-10-06T11:09:05.748 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites' returned '{'return_code': 0, 'scrub_tag': 'a3866a16-2dd9-4a7b-a799-2072ca69e6aa', 'mode': 'asynchronous'}' 2023-10-06T11:09:05.748 INFO:tasks.cephfs.test_scrub_checks:First run: flushing /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2023-10-06T11:09:05.748 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2023-10-06T11:09:05.748 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:09:05.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.861+0000 7fca6f6c3700 1 Processor -- start 2023-10-06T11:09:05.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.861+0000 7fca6f6c3700 1 -- start start 2023-10-06T11:09:05.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.862+0000 7fca6f6c3700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fca680b0c00 0x7fca680c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:05.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.862+0000 7fca6f6c3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fca680c3910 0x7fca680cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:05.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.862+0000 7fca6f6c3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca680cf210 con 0x7fca680ced80 2023-10-06T11:09:05.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.862+0000 7fca6f6c3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca680682f0 con 0x7fca680c3910 2023-10-06T11:09:05.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.862+0000 7fca6f6c3700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca68068580 con 0x7fca680b0c00 2023-10-06T11:09:05.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.862+0000 7fca6dc60700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fca680c3910 0x7fca680cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:05.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.862+0000 7fca6dc60700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fca680c3910 0x7fca680cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49038/0 (socket says 172.21.15.146:49038) 2023-10-06T11:09:05.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.862+0000 7fca6dc60700 1 -- 172.21.15.146:0/2733415170 learned_addr learned my addr 172.21.15.146:0/2733415170 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:05.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.862+0000 7fca6cc5e700 1 --1- 172.21.15.146:0/2733415170 >> v1:172.21.15.146:6789/0 conn(0x7fca680ced80 0x7fca680c3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38796/0 (socket says 172.21.15.146:38796) 2023-10-06T11:09:05.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.863+0000 7fca6d45f700 1 --2- 172.21.15.146:0/2733415170 >> v2:172.21.15.151:3300/0 conn(0x7fca680b0c00 0x7fca680c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:05.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.863+0000 7fca6dc60700 1 -- 172.21.15.146:0/2733415170 >> v2:172.21.15.151:3300/0 conn(0x7fca680b0c00 msgr2=0x7fca680c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:05.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.863+0000 7fca6dc60700 1 --2- 172.21.15.146:0/2733415170 >> v2:172.21.15.151:3300/0 conn(0x7fca680b0c00 0x7fca680c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:05.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.863+0000 7fca6dc60700 1 -- 172.21.15.146:0/2733415170 >> v1:172.21.15.146:6789/0 conn(0x7fca680ced80 legacy=0x7fca680c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:05.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.863+0000 7fca6dc60700 1 -- 172.21.15.146:0/2733415170 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca68068790 con 0x7fca680c3910 2023-10-06T11:09:05.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.863+0000 7fca5ffff700 1 -- 172.21.15.146:0/2733415170 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2692130160 0 0) 0x7fca680cf210 con 0x7fca680ced80 2023-10-06T11:09:05.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.863+0000 7fca6dc60700 1 --2- 172.21.15.146:0/2733415170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca680c3910 0x7fca680cd8c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fca6806e7c0 tx=0x7fca60009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=975699590f834581 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:05.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.863+0000 7fca5ffff700 1 -- 172.21.15.146:0/2733415170 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6000e070 con 0x7fca680c3910 2023-10-06T11:09:05.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.863+0000 7fca5ffff700 1 -- 172.21.15.146:0/2733415170 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6000bae0 con 0x7fca680c3910 2023-10-06T11:09:05.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.863+0000 7fca5ffff700 1 -- 172.21.15.146:0/2733415170 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca600092e0 con 0x7fca680c3910 2023-10-06T11:09:05.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.864+0000 7fca6f6c3700 1 -- 172.21.15.146:0/2733415170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca680c3910 msgr2=0x7fca680cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:05.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.864+0000 7fca6f6c3700 1 --2- 172.21.15.146:0/2733415170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca680c3910 0x7fca680cd8c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fca6806e7c0 tx=0x7fca60009840 comp rx=0 tx=0).stop 2023-10-06T11:09:05.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.864+0000 7fca6f6c3700 1 -- 172.21.15.146:0/2733415170 shutdown_connections 2023-10-06T11:09:05.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.864+0000 7fca6f6c3700 1 --2- 172.21.15.146:0/2733415170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca680c3910 0x7fca680cd8c0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:05.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.864+0000 7fca6f6c3700 1 --2- 172.21.15.146:0/2733415170 >> v2:172.21.15.151:3300/0 conn(0x7fca680b0c00 0x7fca680c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:05.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.864+0000 7fca6f6c3700 1 -- 172.21.15.146:0/2733415170 >> 172.21.15.146:0/2733415170 conn(0x7fca68067c50 msgr2=0x7fca680ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:05.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.864+0000 7fca6f6c3700 1 -- 172.21.15.146:0/2733415170 shutdown_connections 2023-10-06T11:09:05.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.864+0000 7fca6f6c3700 1 -- 172.21.15.146:0/2733415170 wait complete. 2023-10-06T11:09:05.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.865+0000 7fca6f6c3700 1 Processor -- start 2023-10-06T11:09:05.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.865+0000 7fca6f6c3700 1 -- start start 2023-10-06T11:09:05.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.866+0000 7fca6f6c3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca680b0c00 0x7fca680c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:05.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.866+0000 7fca6f6c3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca680c3910 0x7fca6814a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:05.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.866+0000 7fca6f6c3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca680ced80 0x7fca680c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:05.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.866+0000 7fca6f6c3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca680b1200 con 0x7fca680b0c00 2023-10-06T11:09:05.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.866+0000 7fca6f6c3700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca680b14e0 con 0x7fca680ced80 2023-10-06T11:09:05.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.866+0000 7fca6f6c3700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca680b17c0 con 0x7fca680c3910 2023-10-06T11:09:05.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.866+0000 7fca6d45f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca680b0c00 0x7fca680c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:05.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.866+0000 7fca6d45f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca680b0c00 0x7fca680c8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49048/0 (socket says 172.21.15.146:49048) 2023-10-06T11:09:05.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.866+0000 7fca6d45f700 1 -- 172.21.15.146:0/4051360383 learned_addr learned my addr 172.21.15.146:0/4051360383 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:05.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.866+0000 7fca6dc60700 1 --2- 172.21.15.146:0/4051360383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca680ced80 0x7fca680c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:05.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.866+0000 7fca6cc5e700 1 --2- 172.21.15.146:0/4051360383 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca680c3910 0x7fca6814a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:05.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.866+0000 7fca6d45f700 1 -- 172.21.15.146:0/4051360383 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca680c3910 msgr2=0x7fca6814a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:05.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.866+0000 7fca6d45f700 1 --2- 172.21.15.146:0/4051360383 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca680c3910 0x7fca6814a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:05.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.866+0000 7fca6d45f700 1 -- 172.21.15.146:0/4051360383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca680ced80 msgr2=0x7fca680c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:05.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.866+0000 7fca6d45f700 1 --2- 172.21.15.146:0/4051360383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca680ced80 0x7fca680c62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:05.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.866+0000 7fca6d45f700 1 -- 172.21.15.146:0/4051360383 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca60009ae0 con 0x7fca680b0c00 2023-10-06T11:09:05.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.866+0000 7fca6dc60700 1 --2- 172.21.15.146:0/4051360383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca680ced80 0x7fca680c62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:09:05.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.866+0000 7fca6cc5e700 1 --2- 172.21.15.146:0/4051360383 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca680c3910 0x7fca6814a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:09:05.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.866+0000 7fca6d45f700 1 --2- 172.21.15.146:0/4051360383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca680b0c00 0x7fca680c8310 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fca6400d890 tx=0x7fca64008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:05.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.866+0000 7fca5d7fa700 1 -- 172.21.15.146:0/4051360383 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6400b600 con 0x7fca680b0c00 2023-10-06T11:09:05.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.866+0000 7fca5d7fa700 1 -- 172.21.15.146:0/4051360383 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6400b760 con 0x7fca680b0c00 2023-10-06T11:09:05.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.866+0000 7fca6f6c3700 1 -- 172.21.15.146:0/4051360383 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca680b1aa0 con 0x7fca680b0c00 2023-10-06T11:09:05.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.866+0000 7fca5d7fa700 1 -- 172.21.15.146:0/4051360383 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6400bae0 con 0x7fca680b0c00 2023-10-06T11:09:05.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.867+0000 7fca6f6c3700 1 -- 172.21.15.146:0/4051360383 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca680b2060 con 0x7fca680b0c00 2023-10-06T11:09:05.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.867+0000 7fca6f6c3700 1 -- 172.21.15.146:0/4051360383 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca680b21f0 con 0x7fca680b0c00 2023-10-06T11:09:05.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.868+0000 7fca5d7fa700 1 -- 172.21.15.146:0/4051360383 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fca6401e460 con 0x7fca680b0c00 2023-10-06T11:09:05.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.868+0000 7fca5d7fa700 1 --2- 172.21.15.146:0/4051360383 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fca4c066f30 0x7fca4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:05.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.868+0000 7fca5d7fa700 1 -- 172.21.15.146:0/4051360383 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fca64084d70 con 0x7fca680b0c00 2023-10-06T11:09:05.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.868+0000 7fca6cc5e700 1 --2- 172.21.15.146:0/4051360383 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fca4c066f30 0x7fca4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:05.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.868+0000 7fca6cc5e700 1 --2- 172.21.15.146:0/4051360383 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fca4c066f30 0x7fca4c0693e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fca680cbe10 tx=0x7fca58009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:05.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:05.872+0000 7fca5d7fa700 1 -- 172.21.15.146:0/4051360383 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca64051e80 con 0x7fca680b0c00 2023-10-06T11:09:06.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.151+0000 7fca6f6c3700 1 -- 172.21.15.146:0/4051360383 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fca6804c380 con 0x7fca680b0c00 2023-10-06T11:09:06.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.151+0000 7fca5d7fa700 1 -- 172.21.15.146:0/4051360383 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4609 (secure 0 0 0) 0x7fca640554a0 con 0x7fca680b0c00 2023-10-06T11:09:06.153 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:09:06.154 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":35,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5248,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3360977916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3360977916},{"type":"v1","addr":"172.21.15.151:6834","nonce":3360977916}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5251,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2265934004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":2265934004},{"type":"v1","addr":"172.21.15.151:6835","nonce":2265934004}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2387575667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2387575667},{"type":"v1","addr":"172.21.15.146:6836","nonce":2387575667}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:08:42.797557+0000","modified":"2023-10-06T11:08:46.435072+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5481":{"gid":5481,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/2252184844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2252184844},{"type":"v1","addr":"172.21.15.146:6837","nonce":2252184844}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T11:09:06.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.153+0000 7fca6f6c3700 1 -- 172.21.15.146:0/4051360383 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fca4c066f30 msgr2=0x7fca4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:06.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.153+0000 7fca6f6c3700 1 --2- 172.21.15.146:0/4051360383 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fca4c066f30 0x7fca4c0693e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fca680cbe10 tx=0x7fca58009040 comp rx=0 tx=0).stop 2023-10-06T11:09:06.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.153+0000 7fca6f6c3700 1 -- 172.21.15.146:0/4051360383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca680b0c00 msgr2=0x7fca680c8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:06.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.153+0000 7fca6f6c3700 1 --2- 172.21.15.146:0/4051360383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca680b0c00 0x7fca680c8310 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fca6400d890 tx=0x7fca64008040 comp rx=0 tx=0).stop 2023-10-06T11:09:06.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.153+0000 7fca6f6c3700 1 -- 172.21.15.146:0/4051360383 shutdown_connections 2023-10-06T11:09:06.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.153+0000 7fca6f6c3700 1 --2- 172.21.15.146:0/4051360383 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fca4c066f30 0x7fca4c0693e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:06.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.153+0000 7fca6f6c3700 1 --2- 172.21.15.146:0/4051360383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca680ced80 0x7fca680c62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:06.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.153+0000 7fca6f6c3700 1 --2- 172.21.15.146:0/4051360383 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca680b0c00 0x7fca680c8310 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:06.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.154+0000 7fca6f6c3700 1 --2- 172.21.15.146:0/4051360383 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca680c3910 0x7fca6814a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:06.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.154+0000 7fca6f6c3700 1 -- 172.21.15.146:0/4051360383 >> 172.21.15.146:0/4051360383 conn(0x7fca68067c50 msgr2=0x7fca68069170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:06.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.154+0000 7fca6f6c3700 1 -- 172.21.15.146:0/4051360383 shutdown_connections 2023-10-06T11:09:06.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.154+0000 7fca6f6c3700 1 -- 172.21.15.146:0/4051360383 wait complete. 2023-10-06T11:09:06.157 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 35 2023-10-06T11:09:06.167 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2023-10-06T11:09:06.292 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:09:06.292 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0 2023-10-06T11:09:06.292 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:09:06.306 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' got response code '0' and stdout '{ "return_code": 0 } ' 2023-10-06T11:09:06.306 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2023-10-06T11:09:06.306 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2023-10-06T11:09:06.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.425+0000 7f5f8931e700 1 Processor -- start 2023-10-06T11:09:06.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.425+0000 7f5f8931e700 1 -- start start 2023-10-06T11:09:06.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.426+0000 7f5f8931e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5f84067a90 0x7f5f840b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:06.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.426+0000 7f5f8931e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f8406e690 0x7f5f8406eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:06.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.426+0000 7f5f8931e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f8415e4c0 con 0x7f5f840676c0 2023-10-06T11:09:06.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.426+0000 7f5f8931e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f8406f050 con 0x7f5f84067a90 2023-10-06T11:09:06.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.426+0000 7f5f8931e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8415a840 con 0x7f5f8406e690 2023-10-06T11:09:06.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.426+0000 7f5f827fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5f84067a90 0x7f5f840b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:06.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.426+0000 7f5f827fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5f84067a90 0x7f5f840b0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49050/0 (socket says 172.21.15.146:49050) 2023-10-06T11:09:06.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.426+0000 7f5f827fc700 1 -- 172.21.15.146:0/3124637073 learned_addr learned my addr 172.21.15.146:0/3124637073 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:06.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.426+0000 7f5f837fe700 1 --2- 172.21.15.146:0/3124637073 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f8406e690 0x7f5f8406eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:06.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.426+0000 7f5f827fc700 1 -- 172.21.15.146:0/3124637073 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f8406e690 msgr2=0x7f5f8406eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:06.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.426+0000 7f5f827fc700 1 --2- 172.21.15.146:0/3124637073 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f8406e690 0x7f5f8406eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:06.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.426+0000 7f5f827fc700 1 -- 172.21.15.146:0/3124637073 >> v1:172.21.15.151:6789/0 conn(0x7f5f840676c0 legacy=0x7f5f8415ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:06.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.426+0000 7f5f827fc700 1 -- 172.21.15.146:0/3124637073 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f8415ab20 con 0x7f5f84067a90 2023-10-06T11:09:06.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.426+0000 7f5f827fc700 1 --2- 172.21.15.146:0/3124637073 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f84067a90 0x7f5f840b0fa0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f5f780099b0 tx=0x7f5f78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1690ac980e2404bc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:06.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.427+0000 7f5f81ffb700 1 -- 172.21.15.146:0/3124637073 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f78009ea0 con 0x7f5f84067a90 2023-10-06T11:09:06.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.427+0000 7f5f81ffb700 1 -- 172.21.15.146:0/3124637073 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f7800b860 con 0x7f5f84067a90 2023-10-06T11:09:06.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.427+0000 7f5f81ffb700 1 -- 172.21.15.146:0/3124637073 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7800bc00 con 0x7f5f84067a90 2023-10-06T11:09:06.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.427+0000 7f5f8931e700 1 -- 172.21.15.146:0/3124637073 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f84067a90 msgr2=0x7f5f840b0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:06.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.427+0000 7f5f8931e700 1 --2- 172.21.15.146:0/3124637073 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f84067a90 0x7f5f840b0fa0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f5f780099b0 tx=0x7f5f78009250 comp rx=0 tx=0).stop 2023-10-06T11:09:06.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.427+0000 7f5f8931e700 1 -- 172.21.15.146:0/3124637073 shutdown_connections 2023-10-06T11:09:06.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.427+0000 7f5f8931e700 1 --2- 172.21.15.146:0/3124637073 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f8406e690 0x7f5f8406eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:06.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.427+0000 7f5f8931e700 1 --2- 172.21.15.146:0/3124637073 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f84067a90 0x7f5f840b0fa0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:06.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.427+0000 7f5f8931e700 1 -- 172.21.15.146:0/3124637073 >> 172.21.15.146:0/3124637073 conn(0x7f5f84068580 msgr2=0x7f5f84068980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:06.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.427+0000 7f5f8931e700 1 -- 172.21.15.146:0/3124637073 shutdown_connections 2023-10-06T11:09:06.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.428+0000 7f5f8931e700 1 -- 172.21.15.146:0/3124637073 wait complete. 2023-10-06T11:09:06.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.429+0000 7f5f8931e700 1 Processor -- start 2023-10-06T11:09:06.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.429+0000 7f5f8931e700 1 -- start start 2023-10-06T11:09:06.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.430+0000 7f5f8931e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f840676c0 0x7f5f841488d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:06.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.430+0000 7f5f8931e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f84067a90 0x7f5f84149390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:06.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.430+0000 7f5f8931e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f8406e690 0x7f5f840a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:06.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.430+0000 7f5f8931e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f840aae60 con 0x7f5f8406e690 2023-10-06T11:09:06.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.430+0000 7f5f8931e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f840aab80 con 0x7f5f840676c0 2023-10-06T11:09:06.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.430+0000 7f5f8931e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f840ab8a0 con 0x7f5f84067a90 2023-10-06T11:09:06.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.430+0000 7f5f837fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f8406e690 0x7f5f840a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:06.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.430+0000 7f5f837fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f8406e690 0x7f5f840a98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49066/0 (socket says 172.21.15.146:49066) 2023-10-06T11:09:06.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.430+0000 7f5f827fc700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f84067a90 0x7f5f84149390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:06.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.430+0000 7f5f837fe700 1 -- 172.21.15.146:0/1502282542 learned_addr learned my addr 172.21.15.146:0/1502282542 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:06.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.430+0000 7f5f82ffd700 1 --2- 172.21.15.146:0/1502282542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f840676c0 0x7f5f841488d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:06.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.430+0000 7f5f837fe700 1 -- 172.21.15.146:0/1502282542 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f84067a90 msgr2=0x7f5f84149390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:06.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.430+0000 7f5f837fe700 1 --2- 172.21.15.146:0/1502282542 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f84067a90 0x7f5f84149390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:06.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.430+0000 7f5f837fe700 1 -- 172.21.15.146:0/1502282542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f840676c0 msgr2=0x7f5f841488d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:06.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.430+0000 7f5f837fe700 1 --2- 172.21.15.146:0/1502282542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f840676c0 0x7f5f841488d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:06.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.430+0000 7f5f837fe700 1 -- 172.21.15.146:0/1502282542 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f780094f0 con 0x7f5f8406e690 2023-10-06T11:09:06.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.430+0000 7f5f827fc700 1 --2- 172.21.15.146:0/1502282542 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f84067a90 0x7f5f84149390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:09:06.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.430+0000 7f5f837fe700 1 --2- 172.21.15.146:0/1502282542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f8406e690 0x7f5f840a98c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c009e90 tx=0x7f5f7c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:06.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.430+0000 7f5f6affd700 1 -- 172.21.15.146:0/1502282542 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c00cb70 con 0x7f5f8406e690 2023-10-06T11:09:06.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.431+0000 7f5f6affd700 1 -- 172.21.15.146:0/1502282542 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f7c00f040 con 0x7f5f8406e690 2023-10-06T11:09:06.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.431+0000 7f5f8931e700 1 -- 172.21.15.146:0/1502282542 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f840abb80 con 0x7f5f8406e690 2023-10-06T11:09:06.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.431+0000 7f5f6affd700 1 -- 172.21.15.146:0/1502282542 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c014480 con 0x7f5f8406e690 2023-10-06T11:09:06.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.431+0000 7f5f8931e700 1 -- 172.21.15.146:0/1502282542 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f840ac380 con 0x7f5f8406e690 2023-10-06T11:09:06.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.432+0000 7f5f6affd700 1 -- 172.21.15.146:0/1502282542 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5f7c014830 con 0x7f5f8406e690 2023-10-06T11:09:06.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.432+0000 7f5f6affd700 1 --2- 172.21.15.146:0/1502282542 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5f70066f30 0x7f5f700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:06.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.433+0000 7f5f6affd700 1 -- 172.21.15.146:0/1502282542 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5f7c085060 con 0x7f5f8406e690 2023-10-06T11:09:06.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.433+0000 7f5f82ffd700 1 --2- 172.21.15.146:0/1502282542 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5f70066f30 0x7f5f700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:06.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.433+0000 7f5f82ffd700 1 --2- 172.21.15.146:0/1502282542 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5f70066f30 0x7f5f700693e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5f740039e0 tx=0x7f5f74007ec0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:06.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.434+0000 7f5f92616b80 1 Processor -- start 2023-10-06T11:09:06.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.434+0000 7f5f92616b80 1 -- start start 2023-10-06T11:09:06.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.435+0000 7f5f92616b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564523c39c00 0x564523c39fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:06.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.435+0000 7f5f92616b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564523bf5b10 0x564523bf26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:06.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.435+0000 7f5f92616b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564523bf3d40 0x564523bf2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:06.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.435+0000 7f5f92616b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x564523b72df0 con 0x564523c39c00 2023-10-06T11:09:06.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.435+0000 7f5f92616b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x564523b49be0 con 0x564523bf3d40 2023-10-06T11:09:06.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.435+0000 7f5f92616b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x564523b473e0 con 0x564523bf5b10 2023-10-06T11:09:06.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.435+0000 7f5f82ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564523c39c00 0x564523c39fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:06.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.435+0000 7f5f82ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564523c39c00 0x564523c39fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49078/0 (socket says 172.21.15.146:49078) 2023-10-06T11:09:06.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.435+0000 7f5f82ffd700 1 -- 172.21.15.146:0/87196394 learned_addr learned my addr 172.21.15.146:0/87196394 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:06.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.435+0000 7f5f82ffd700 1 -- 172.21.15.146:0/87196394 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564523bf5b10 msgr2=0x564523bf26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:06.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.435+0000 7f5f82ffd700 1 --2- 172.21.15.146:0/87196394 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564523bf5b10 0x564523bf26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:06.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.435+0000 7f5f82ffd700 1 -- 172.21.15.146:0/87196394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564523bf3d40 msgr2=0x564523bf2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:06.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.435+0000 7f5f82ffd700 1 --2- 172.21.15.146:0/87196394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564523bf3d40 0x564523bf2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:06.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.435+0000 7f5f82ffd700 1 -- 172.21.15.146:0/87196394 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5645239dd3e0 con 0x564523c39c00 2023-10-06T11:09:06.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.435+0000 7f5f82ffd700 1 --2- 172.21.15.146:0/87196394 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564523c39c00 0x564523c39fd0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f5f74002920 tx=0x7f5f74015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc77c58fc4cd10e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:06.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.436+0000 7f5f63fff700 1 -- 172.21.15.146:0/87196394 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f74014660 con 0x564523c39c00 2023-10-06T11:09:06.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.436+0000 7f5f63fff700 1 -- 172.21.15.146:0/87196394 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f740147c0 con 0x564523c39c00 2023-10-06T11:09:06.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.436+0000 7f5f63fff700 1 -- 172.21.15.146:0/87196394 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f74014b40 con 0x564523c39c00 2023-10-06T11:09:06.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.436+0000 7f5f92616b80 1 -- 172.21.15.146:0/87196394 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564523c39c00 msgr2=0x564523c39fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:06.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.436+0000 7f5f92616b80 1 --2- 172.21.15.146:0/87196394 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564523c39c00 0x564523c39fd0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f5f74002920 tx=0x7f5f74015000 comp rx=0 tx=0).stop 2023-10-06T11:09:06.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.436+0000 7f5f92616b80 1 -- 172.21.15.146:0/87196394 shutdown_connections 2023-10-06T11:09:06.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.436+0000 7f5f92616b80 1 --2- 172.21.15.146:0/87196394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564523bf3d40 0x564523bf2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:06.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.436+0000 7f5f92616b80 1 --2- 172.21.15.146:0/87196394 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564523c39c00 0x564523c39fd0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:06.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.436+0000 7f5f92616b80 1 --2- 172.21.15.146:0/87196394 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564523bf5b10 0x564523bf26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:06.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.436+0000 7f5f92616b80 1 -- 172.21.15.146:0/87196394 >> 172.21.15.146:0/87196394 conn(0x564523bf41e0 msgr2=0x564523bf45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:06.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.436+0000 7f5f92616b80 1 -- 172.21.15.146:0/87196394 shutdown_connections 2023-10-06T11:09:06.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.436+0000 7f5f92616b80 1 -- 172.21.15.146:0/87196394 wait complete. 2023-10-06T11:09:06.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.437+0000 7f5f92616b80 1 -- start start 2023-10-06T11:09:06.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.437+0000 7f5f92616b80 1 Processor -- start 2023-10-06T11:09:06.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.438+0000 7f5f92616b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564523bf3d40 0x564523c34040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:06.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.438+0000 7f5f92616b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564523bf5b10 0x564523c1d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:06.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.438+0000 7f5f92616b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564523c39c00 0x564523c1b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:06.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.438+0000 7f5f92616b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x564523b431d0 con 0x564523c39c00 2023-10-06T11:09:06.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.438+0000 7f5f92616b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x564523aeea00 con 0x564523bf3d40 2023-10-06T11:09:06.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.438+0000 7f5f92616b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x564523b0a010 con 0x564523bf5b10 2023-10-06T11:09:06.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.438+0000 7f5f92616b80 10 client.0 _ll_register_callbacks cb 0x5645239e00a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:09:06.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.438+0000 7f5f837fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564523c39c00 0x564523c1b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:06.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.438+0000 7f5f837fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564523c39c00 0x564523c1b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49088/0 (socket says 172.21.15.146:49088) 2023-10-06T11:09:06.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.438+0000 7f5f837fe700 1 -- 172.21.15.146:0/3970661045 learned_addr learned my addr 172.21.15.146:0/3970661045 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:06.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.438+0000 7f5f82ffd700 1 --2- 172.21.15.146:0/3970661045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564523bf3d40 0x564523c34040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:06.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.438+0000 7f5f827fc700 1 --2- 172.21.15.146:0/3970661045 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564523bf5b10 0x564523c1d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:06.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.438+0000 7f5f837fe700 1 -- 172.21.15.146:0/3970661045 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564523bf5b10 msgr2=0x564523c1d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:06.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.438+0000 7f5f837fe700 1 --2- 172.21.15.146:0/3970661045 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564523bf5b10 0x564523c1d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:06.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.438+0000 7f5f837fe700 1 -- 172.21.15.146:0/3970661045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564523bf3d40 msgr2=0x564523c34040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:06.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.438+0000 7f5f837fe700 1 --2- 172.21.15.146:0/3970661045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564523bf3d40 0x564523c34040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:06.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.438+0000 7f5f837fe700 1 -- 172.21.15.146:0/3970661045 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f8415e4c0 con 0x564523c39c00 2023-10-06T11:09:06.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.439+0000 7f5f837fe700 1 --2- 172.21.15.146:0/3970661045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564523c39c00 0x564523c1b190 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c055b30 tx=0x7f5f7c083380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aad99ffcc00daa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:06.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.439+0000 7f5f617fa700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:09:06.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.439+0000 7f5f617fa700 1 -- 172.21.15.146:0/3970661045 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c055e90 con 0x564523c39c00 2023-10-06T11:09:06.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.439+0000 7f5f617fa700 1 -- 172.21.15.146:0/3970661045 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5f7c059080 con 0x564523c39c00 2023-10-06T11:09:06.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.439+0000 7f5f92616b80 1 -- 172.21.15.146:0/3970661045 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564523be7800 con 0x564523c39c00 2023-10-06T11:09:06.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.439+0000 7f5f617fa700 1 -- 172.21.15.146:0/3970661045 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f7c05cdd0 con 0x564523c39c00 2023-10-06T11:09:06.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.439+0000 7f5f92616b80 10 client.5742 fetch_fsmap learned FSMap version 35 2023-10-06T11:09:06.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.439+0000 7f5f92616b80 1 -- 172.21.15.146:0/3970661045 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) v3 -- 0x564523980150 con 0x564523c39c00 2023-10-06T11:09:06.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.439+0000 7f5f617fa700 1 -- 172.21.15.146:0/3970661045 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f7c081070 con 0x564523c39c00 2023-10-06T11:09:06.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.439+0000 7f5f617fa700 1 -- 172.21.15.146:0/3970661045 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 35) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5f7c055320 con 0x564523c39c00 2023-10-06T11:09:06.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.439+0000 7f5f92616b80 10 client.5742 fetch_fsmap finished waiting for FSMap version 35 2023-10-06T11:09:06.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.439+0000 7f5f92616b80 10 client.5742 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-10-06T11:09:06.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.439+0000 7f5f92616b80 20 client.5742 populate_metadata read hostname 'smithi146' 2023-10-06T11:09:06.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.439+0000 7f5f92616b80 1 --2- 172.21.15.146:0/3970661045 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x564523c36c20 0x564523c189c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:06.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.439+0000 7f5f92616b80 4 client.5742 mds_command: new command op to 5481 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:09:06.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.439+0000 7f5f92616b80 1 -- 172.21.15.146:0/3970661045 --> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564523bc4730 con 0x564523c36c20 2023-10-06T11:09:06.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.439+0000 7f5f82ffd700 1 --2- 172.21.15.146:0/3970661045 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x564523c36c20 0x564523c189c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:06.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.440+0000 7f5f617fa700 10 client.5742 ms_handle_connect on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:06.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.440+0000 7f5f82ffd700 1 --2- 172.21.15.146:0/3970661045 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x564523c36c20 0x564523c189c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2712631e3409ac0c server_cookie=501ac589dad410a8 in_seq=0 out_seq=0 2023-10-06T11:09:06.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.440+0000 7f5f617fa700 1 -- 172.21.15.146:0/3970661045 <== mds.0 v2:172.21.15.146:6835/2252184844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x564523bc4730 con 0x564523c36c20 2023-10-06T11:09:06.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.440+0000 7f5f617fa700 10 client.5742 handle_command_reply: tid=0 2023-10-06T11:09:06.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.440+0000 7f5f92616b80 1 client.5742 shutdown 2023-10-06T11:09:06.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.440+0000 7f5f92616b80 1 -- 172.21.15.146:0/3970661045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564523c39c00 msgr2=0x564523c1b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:06.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.440+0000 7f5f92616b80 1 --2- 172.21.15.146:0/3970661045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564523c39c00 0x564523c1b190 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c055b30 tx=0x7f5f7c083380 comp rx=0 tx=0).stop 2023-10-06T11:09:06.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.440+0000 7f5f92616b80 1 -- 172.21.15.146:0/3970661045 shutdown_connections 2023-10-06T11:09:06.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.440+0000 7f5f92616b80 1 --2- 172.21.15.146:0/3970661045 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x564523c36c20 0x564523c189c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:06.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.440+0000 7f5f92616b80 1 --2- 172.21.15.146:0/3970661045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564523c39c00 0x564523c1b190 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:06.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.440+0000 7f5f617fa700 0 client.5742 ms_handle_reset on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:06.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.440+0000 7f5f92616b80 1 --2- 172.21.15.146:0/3970661045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564523bf3d40 0x564523c34040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:06.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.440+0000 7f5f92616b80 1 --2- 172.21.15.146:0/3970661045 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564523bf5b10 0x564523c1d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:06.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.440+0000 7f5f92616b80 1 -- 172.21.15.146:0/3970661045 >> 172.21.15.146:0/3970661045 conn(0x564523bf41e0 msgr2=0x564523befa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:06.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.440+0000 7f5f92616b80 1 -- 172.21.15.146:0/3970661045 shutdown_connections 2023-10-06T11:09:06.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.440+0000 7f5f92616b80 1 -- 172.21.15.146:0/3970661045 wait complete. 2023-10-06T11:09:06.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.441+0000 7f5f92616b80 20 client.5742 trim_cache size 0 max 16384 2023-10-06T11:09:06.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.457+0000 7f5f92616b80 1 Processor -- start 2023-10-06T11:09:06.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.457+0000 7f5f92616b80 1 -- start start 2023-10-06T11:09:06.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.458+0000 7f5f92616b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564523bf41e0 0x564523c18960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:06.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.458+0000 7f5f92616b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564523bf3d40 0x564523c18ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:06.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.458+0000 7f5f92616b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564523bf5b10 0x564523c1c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:06.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.458+0000 7f5f92616b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645239c5fa0 con 0x564523bf5b10 2023-10-06T11:09:06.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.458+0000 7f5f92616b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x564523c38130 con 0x564523bf41e0 2023-10-06T11:09:06.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.458+0000 7f5f92616b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x564523c426e0 con 0x564523bf3d40 2023-10-06T11:09:06.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.458+0000 7f5f837fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564523bf5b10 0x564523c1c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:06.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.458+0000 7f5f837fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564523bf5b10 0x564523c1c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49102/0 (socket says 172.21.15.146:49102) 2023-10-06T11:09:06.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.458+0000 7f5f837fe700 1 -- 172.21.15.146:0/2506604044 learned_addr learned my addr 172.21.15.146:0/2506604044 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:06.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.458+0000 7f5f82ffd700 1 --2- 172.21.15.146:0/2506604044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564523bf41e0 0x564523c18960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:06.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.458+0000 7f5f837fe700 1 -- 172.21.15.146:0/2506604044 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564523bf3d40 msgr2=0x564523c18ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:06.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.458+0000 7f5f837fe700 1 --2- 172.21.15.146:0/2506604044 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564523bf3d40 0x564523c18ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:06.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.458+0000 7f5f837fe700 1 -- 172.21.15.146:0/2506604044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564523bf41e0 msgr2=0x564523c18960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:06.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.458+0000 7f5f837fe700 1 --2- 172.21.15.146:0/2506604044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564523bf41e0 0x564523c18960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:06.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.458+0000 7f5f837fe700 1 -- 172.21.15.146:0/2506604044 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564523b118f0 con 0x564523bf5b10 2023-10-06T11:09:06.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.458+0000 7f5f82ffd700 1 --2- 172.21.15.146:0/2506604044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564523bf41e0 0x564523c18960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:09:06.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.458+0000 7f5f837fe700 1 --2- 172.21.15.146:0/2506604044 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564523bf5b10 0x564523c1c7e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c085340 tx=0x7f5f7c01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35d4445b2e591b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:06.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.458+0000 7f5f68ff9700 1 -- 172.21.15.146:0/2506604044 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c055e90 con 0x564523bf5b10 2023-10-06T11:09:06.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.458+0000 7f5f68ff9700 1 -- 172.21.15.146:0/2506604044 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f7c081050 con 0x564523bf5b10 2023-10-06T11:09:06.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.458+0000 7f5f68ff9700 1 -- 172.21.15.146:0/2506604044 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c059080 con 0x564523bf5b10 2023-10-06T11:09:06.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.459+0000 7f5f92616b80 1 -- 172.21.15.146:0/2506604044 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564523bf5b10 msgr2=0x564523c1c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:06.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.459+0000 7f5f92616b80 1 --2- 172.21.15.146:0/2506604044 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564523bf5b10 0x564523c1c7e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c085340 tx=0x7f5f7c01f000 comp rx=0 tx=0).stop 2023-10-06T11:09:06.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.459+0000 7f5f92616b80 1 -- 172.21.15.146:0/2506604044 shutdown_connections 2023-10-06T11:09:06.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.459+0000 7f5f92616b80 1 --2- 172.21.15.146:0/2506604044 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564523bf5b10 0x564523c1c7e0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:06.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.459+0000 7f5f92616b80 1 --2- 172.21.15.146:0/2506604044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564523bf41e0 0x564523c18960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:06.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.459+0000 7f5f92616b80 1 --2- 172.21.15.146:0/2506604044 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564523bf3d40 0x564523c18ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:06.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.459+0000 7f5f92616b80 1 -- 172.21.15.146:0/2506604044 >> 172.21.15.146:0/2506604044 conn(0x564523c33a10 msgr2=0x564523c32f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:06.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.459+0000 7f5f92616b80 1 -- 172.21.15.146:0/2506604044 shutdown_connections 2023-10-06T11:09:06.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.459+0000 7f5f92616b80 1 -- 172.21.15.146:0/2506604044 wait complete. 2023-10-06T11:09:06.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.460+0000 7f5f92616b80 1 -- start start 2023-10-06T11:09:06.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.460+0000 7f5f92616b80 1 Processor -- start 2023-10-06T11:09:06.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.460+0000 7f5f92616b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564523bf3d40 0x564523c53df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:06.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.460+0000 7f5f92616b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564523bf41e0 0x564523c3ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:06.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.461+0000 7f5f92616b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564523bf5b10 0x564523c18960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:06.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.461+0000 7f5f92616b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x564523c54330 con 0x564523bf3d40 2023-10-06T11:09:06.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.461+0000 7f5f92616b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x564523c3fad0 con 0x564523bf41e0 2023-10-06T11:09:06.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.461+0000 7f5f92616b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x564523c53370 con 0x564523bf5b10 2023-10-06T11:09:06.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.461+0000 7f5f92616b80 10 client.0 _ll_register_callbacks cb 0x5645239e00a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:09:06.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.461+0000 7f5f82ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564523bf3d40 0x564523c53df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:06.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.461+0000 7f5f82ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564523bf3d40 0x564523c53df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49112/0 (socket says 172.21.15.146:49112) 2023-10-06T11:09:06.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.461+0000 7f5f82ffd700 1 -- 172.21.15.146:0/4231261550 learned_addr learned my addr 172.21.15.146:0/4231261550 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:06.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.461+0000 7f5f827fc700 1 --2- 172.21.15.146:0/4231261550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564523bf41e0 0x564523c3ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:06.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.461+0000 7f5f837fe700 1 --2- 172.21.15.146:0/4231261550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564523bf5b10 0x564523c18960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:06.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.461+0000 7f5f82ffd700 1 -- 172.21.15.146:0/4231261550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564523bf5b10 msgr2=0x564523c18960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:06.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.461+0000 7f5f82ffd700 1 --2- 172.21.15.146:0/4231261550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564523bf5b10 0x564523c18960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:06.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.461+0000 7f5f82ffd700 1 -- 172.21.15.146:0/4231261550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564523bf41e0 msgr2=0x564523c3ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:06.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.461+0000 7f5f82ffd700 1 --2- 172.21.15.146:0/4231261550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564523bf41e0 0x564523c3ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:06.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.461+0000 7f5f82ffd700 1 -- 172.21.15.146:0/4231261550 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564523980150 con 0x564523bf3d40 2023-10-06T11:09:06.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.461+0000 7f5f827fc700 1 --2- 172.21.15.146:0/4231261550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564523bf41e0 0x564523c3ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:06.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.461+0000 7f5f82ffd700 1 --2- 172.21.15.146:0/4231261550 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564523bf3d40 0x564523c53df0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f5f74020000 tx=0x7f5f74032250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e0df38a73a8f813 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:06.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.461+0000 7f5f617fa700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:09:06.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.461+0000 7f5f617fa700 1 -- 172.21.15.146:0/4231261550 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f74014b40 con 0x564523bf3d40 2023-10-06T11:09:06.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.461+0000 7f5f617fa700 1 -- 172.21.15.146:0/4231261550 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5f7401c040 con 0x564523bf3d40 2023-10-06T11:09:06.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.461+0000 7f5f92616b80 1 -- 172.21.15.146:0/4231261550 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5f740147c0 con 0x564523bf3d40 2023-10-06T11:09:06.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.461+0000 7f5f617fa700 1 -- 172.21.15.146:0/4231261550 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f7402ea60 con 0x564523bf3d40 2023-10-06T11:09:06.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.461+0000 7f5f92616b80 10 client.5748 fetch_fsmap learned FSMap version 35 2023-10-06T11:09:06.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.461+0000 7f5f92616b80 1 -- 172.21.15.146:0/4231261550 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) v3 -- 0x564523af85e0 con 0x564523bf3d40 2023-10-06T11:09:06.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.462+0000 7f5f617fa700 1 -- 172.21.15.146:0/4231261550 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f74042020 con 0x564523bf3d40 2023-10-06T11:09:06.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.462+0000 7f5f617fa700 1 -- 172.21.15.146:0/4231261550 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 35) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5f7402ebc0 con 0x564523bf3d40 2023-10-06T11:09:06.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.462+0000 7f5f92616b80 10 client.5748 fetch_fsmap finished waiting for FSMap version 35 2023-10-06T11:09:06.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.462+0000 7f5f92616b80 10 client.5748 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-10-06T11:09:06.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.462+0000 7f5f92616b80 20 client.5748 populate_metadata read hostname 'smithi146' 2023-10-06T11:09:06.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.462+0000 7f5f92616b80 1 --2- 172.21.15.146:0/4231261550 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x564523c39c00 0x564523c18ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:06.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.462+0000 7f5f92616b80 4 client.5748 mds_command: new command op to 5481 tid=0[{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}] 2023-10-06T11:09:06.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.462+0000 7f5f92616b80 1 -- 172.21.15.146:0/4231261550 --> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}) v1 -- 0x564523ae5f70 con 0x564523c39c00 2023-10-06T11:09:06.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.462+0000 7f5f827fc700 1 --2- 172.21.15.146:0/4231261550 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x564523c39c00 0x564523c18ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:06.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.462+0000 7f5f617fa700 10 client.5748 ms_handle_connect on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:06.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.462+0000 7f5f827fc700 1 --2- 172.21.15.146:0/4231261550 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x564523c39c00 0x564523c18ea0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae67d3b18b59c5e5 server_cookie=d7068a4100a6a6d7 in_seq=0 out_seq=0 2023-10-06T11:09:06.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.463+0000 7f5f617fa700 1 -- 172.21.15.146:0/4231261550 <== mds.0 v2:172.21.15.146:6835/2252184844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x564523ae5f70 con 0x564523c39c00 2023-10-06T11:09:06.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.463+0000 7f5f617fa700 10 client.5748 handle_command_reply: tid=0 2023-10-06T11:09:06.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.463+0000 7f5f92616b80 1 client.5748 shutdown 2023-10-06T11:09:06.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.463+0000 7f5f92616b80 1 -- 172.21.15.146:0/4231261550 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564523bf3d40 msgr2=0x564523c53df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:06.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.463+0000 7f5f92616b80 1 --2- 172.21.15.146:0/4231261550 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564523bf3d40 0x564523c53df0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f5f74020000 tx=0x7f5f74032250 comp rx=0 tx=0).stop 2023-10-06T11:09:06.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.463+0000 7f5f92616b80 1 -- 172.21.15.146:0/4231261550 shutdown_connections 2023-10-06T11:09:06.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.463+0000 7f5f92616b80 1 --2- 172.21.15.146:0/4231261550 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x564523c39c00 0x564523c18ea0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:06.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.463+0000 7f5f92616b80 1 --2- 172.21.15.146:0/4231261550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564523bf5b10 0x564523c18960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:06.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.463+0000 7f5f92616b80 1 --2- 172.21.15.146:0/4231261550 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564523bf3d40 0x564523c53df0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:06.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.463+0000 7f5f92616b80 1 --2- 172.21.15.146:0/4231261550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564523bf41e0 0x564523c3ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:06.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.463+0000 7f5f617fa700 0 client.5748 ms_handle_reset on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:06.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.463+0000 7f5f92616b80 1 -- 172.21.15.146:0/4231261550 >> 172.21.15.146:0/4231261550 conn(0x564523c33a10 msgr2=0x564523c330b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:06.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.463+0000 7f5f92616b80 1 -- 172.21.15.146:0/4231261550 shutdown_connections 2023-10-06T11:09:06.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.463+0000 7f5f92616b80 1 -- 172.21.15.146:0/4231261550 wait complete. 2023-10-06T11:09:06.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.463+0000 7f5f92616b80 20 client.5748 trim_cache size 0 max 16384 2023-10-06T11:09:06.472 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:09:06.472 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0, 2023-10-06T11:09:06.472 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_tag": "83ade311-e72a-4e0a-8a3c-2041f71d3994", 2023-10-06T11:09:06.472 INFO:teuthology.orchestra.run.smithi146.stdout: "mode": "asynchronous" 2023-10-06T11:09:06.472 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:09:06.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.463+0000 7f5f8931e700 1 -- 172.21.15.146:0/1502282542 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5f70066f30 msgr2=0x7f5f700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:06.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.463+0000 7f5f8931e700 1 --2- 172.21.15.146:0/1502282542 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5f70066f30 0x7f5f700693e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5f740039e0 tx=0x7f5f74007ec0 comp rx=0 tx=0).stop 2023-10-06T11:09:06.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.463+0000 7f5f8931e700 1 -- 172.21.15.146:0/1502282542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f8406e690 msgr2=0x7f5f840a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:06.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.463+0000 7f5f8931e700 1 --2- 172.21.15.146:0/1502282542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f8406e690 0x7f5f840a98c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c009e90 tx=0x7f5f7c00b040 comp rx=0 tx=0).stop 2023-10-06T11:09:06.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.463+0000 7f5f8931e700 1 -- 172.21.15.146:0/1502282542 shutdown_connections 2023-10-06T11:09:06.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.464+0000 7f5f8931e700 1 --2- 172.21.15.146:0/1502282542 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5f70066f30 0x7f5f700693e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:06.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.464+0000 7f5f8931e700 1 --2- 172.21.15.146:0/1502282542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f8406e690 0x7f5f840a98c0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:06.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.464+0000 7f5f8931e700 1 --2- 172.21.15.146:0/1502282542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f840676c0 0x7f5f841488d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:06.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.464+0000 7f5f8931e700 1 --2- 172.21.15.146:0/1502282542 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f84067a90 0x7f5f84149390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:06.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.464+0000 7f5f8931e700 1 -- 172.21.15.146:0/1502282542 >> 172.21.15.146:0/1502282542 conn(0x7f5f84068580 msgr2=0x7f5f84159ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:06.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.464+0000 7f5f8931e700 1 -- 172.21.15.146:0/1502282542 shutdown_connections 2023-10-06T11:09:06.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.464+0000 7f5f8931e700 1 -- 172.21.15.146:0/1502282542 wait complete. 2023-10-06T11:09:06.477 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' returned '{'return_code': 0, 'scrub_tag': '83ade311-e72a-4e0a-8a3c-2041f71d3994', 'mode': 'asynchronous'}' 2023-10-06T11:09:06.477 INFO:tasks.cephfs.test_scrub_checks:First run: flushing base dir / 2023-10-06T11:09:06.477 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2023-10-06T11:09:06.477 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:09:06.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.591+0000 7f486f8be700 1 Processor -- start 2023-10-06T11:09:06.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.591+0000 7f486f8be700 1 -- start start 2023-10-06T11:09:06.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.592+0000 7f486f8be700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4868153ab0 0x7f486815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:06.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.592+0000 7f486f8be700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f486815ac30 con 0x7f4868153e80 2023-10-06T11:09:06.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.592+0000 7f486f8be700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48680b4510 con 0x7f4868068ba0 2023-10-06T11:09:06.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.592+0000 7f486f8be700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48680b6530 con 0x7f4868153ab0 2023-10-06T11:09:06.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.592+0000 7f486d65a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4868153ab0 0x7f486815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:06.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.592+0000 7f486d65a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4868153ab0 0x7f486815a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49128/0 (socket says 172.21.15.146:49128) 2023-10-06T11:09:06.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.592+0000 7f486d65a700 1 -- 172.21.15.146:0/3962041025 learned_addr learned my addr 172.21.15.146:0/3962041025 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:06.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.592+0000 7f486ce59700 1 --1- 172.21.15.146:0/3962041025 >> v1:172.21.15.146:6789/0 conn(0x7f4868153e80 0x7f4868068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38810/0 (socket says 172.21.15.146:38810) 2023-10-06T11:09:06.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.592+0000 7f486d65a700 1 -- 172.21.15.146:0/3962041025 >> v1:172.21.15.151:6789/0 conn(0x7f4868068ba0 legacy=0x7f48680b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:06.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.592+0000 7f486d65a700 1 -- 172.21.15.146:0/3962041025 >> v1:172.21.15.146:6789/0 conn(0x7f4868153e80 legacy=0x7f4868068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:06.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.592+0000 7f486d65a700 1 -- 172.21.15.146:0/3962041025 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48680b5c50 con 0x7f4868153ab0 2023-10-06T11:09:06.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.592+0000 7f486d65a700 1 --2- 172.21.15.146:0/3962041025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4868153ab0 0x7f486815a6f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f48640099b0 tx=0x7f4864009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c55b7c44dd27415 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:06.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.592+0000 7f485ffff700 1 -- 172.21.15.146:0/3962041025 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486400b860 con 0x7f4868153ab0 2023-10-06T11:09:06.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.593+0000 7f485ffff700 1 -- 172.21.15.146:0/3962041025 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486400b9c0 con 0x7f4868153ab0 2023-10-06T11:09:06.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.593+0000 7f485ffff700 1 -- 172.21.15.146:0/3962041025 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486400bd60 con 0x7f4868153ab0 2023-10-06T11:09:06.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.593+0000 7f486f8be700 1 -- 172.21.15.146:0/3962041025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4868153ab0 msgr2=0x7f486815a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:06.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.593+0000 7f486f8be700 1 --2- 172.21.15.146:0/3962041025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4868153ab0 0x7f486815a6f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f48640099b0 tx=0x7f4864009250 comp rx=0 tx=0).stop 2023-10-06T11:09:06.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.593+0000 7f486f8be700 1 -- 172.21.15.146:0/3962041025 shutdown_connections 2023-10-06T11:09:06.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.593+0000 7f486f8be700 1 --2- 172.21.15.146:0/3962041025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4868153ab0 0x7f486815a6f0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:06.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.593+0000 7f486f8be700 1 -- 172.21.15.146:0/3962041025 >> 172.21.15.146:0/3962041025 conn(0x7f486806eba0 msgr2=0x7f486806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:06.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.593+0000 7f486f8be700 1 -- 172.21.15.146:0/3962041025 shutdown_connections 2023-10-06T11:09:06.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.593+0000 7f486f8be700 1 -- 172.21.15.146:0/3962041025 wait complete. 2023-10-06T11:09:06.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.594+0000 7f486f8be700 1 Processor -- start 2023-10-06T11:09:06.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.594+0000 7f486f8be700 1 -- start start 2023-10-06T11:09:06.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.595+0000 7f486f8be700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4868068ba0 0x7f4868156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:06.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.595+0000 7f486f8be700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4868153ab0 0x7f48680cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:06.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.595+0000 7f486f8be700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4868153e80 0x7f48680d0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:06.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.595+0000 7f486f8be700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f486816a0c0 con 0x7f4868153e80 2023-10-06T11:09:06.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.595+0000 7f486f8be700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4868157530 con 0x7f4868153ab0 2023-10-06T11:09:06.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.595+0000 7f486f8be700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4868157810 con 0x7f4868068ba0 2023-10-06T11:09:06.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.595+0000 7f486de5b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4868153e80 0x7f48680d0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:06.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.595+0000 7f486de5b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4868153e80 0x7f48680d0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49140/0 (socket says 172.21.15.146:49140) 2023-10-06T11:09:06.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.595+0000 7f486de5b700 1 -- 172.21.15.146:0/2100773167 learned_addr learned my addr 172.21.15.146:0/2100773167 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:06.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.595+0000 7f486de5b700 1 -- 172.21.15.146:0/2100773167 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4868068ba0 msgr2=0x7f4868156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:06.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.595+0000 7f486de5b700 1 --2- 172.21.15.146:0/2100773167 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4868068ba0 0x7f4868156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:06.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.595+0000 7f486ce59700 1 --2- 172.21.15.146:0/2100773167 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4868153ab0 0x7f48680cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:06.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.595+0000 7f486de5b700 1 -- 172.21.15.146:0/2100773167 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4868153ab0 msgr2=0x7f48680cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:06.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.595+0000 7f486de5b700 1 --2- 172.21.15.146:0/2100773167 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4868153ab0 0x7f48680cbac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:06.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.595+0000 7f486de5b700 1 -- 172.21.15.146:0/2100773167 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48640094f0 con 0x7f4868153e80 2023-10-06T11:09:06.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.596+0000 7f486de5b700 1 --2- 172.21.15.146:0/2100773167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4868153e80 0x7f48680d0430 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f486000c810 tx=0x7f4860001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:06.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.596+0000 7f485d7fa700 1 -- 172.21.15.146:0/2100773167 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4860012630 con 0x7f4868153e80 2023-10-06T11:09:06.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.596+0000 7f485d7fa700 1 -- 172.21.15.146:0/2100773167 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48600127b0 con 0x7f4868153e80 2023-10-06T11:09:06.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.596+0000 7f485d7fa700 1 -- 172.21.15.146:0/2100773167 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4860012b70 con 0x7f4868153e80 2023-10-06T11:09:06.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.596+0000 7f486f8be700 1 -- 172.21.15.146:0/2100773167 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4868157af0 con 0x7f4868153e80 2023-10-06T11:09:06.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.596+0000 7f486f8be700 1 -- 172.21.15.146:0/2100773167 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4868157100 con 0x7f4868153e80 2023-10-06T11:09:06.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.597+0000 7f486f8be700 1 -- 172.21.15.146:0/2100773167 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f486816a5c0 con 0x7f4868153e80 2023-10-06T11:09:06.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.597+0000 7f485d7fa700 1 -- 172.21.15.146:0/2100773167 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4860003030 con 0x7f4868153e80 2023-10-06T11:09:06.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.598+0000 7f485d7fa700 1 --2- 172.21.15.146:0/2100773167 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f484c066f30 0x7f484c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:06.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.598+0000 7f486d65a700 1 --2- 172.21.15.146:0/2100773167 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f484c066f30 0x7f484c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:06.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.598+0000 7f485d7fa700 1 -- 172.21.15.146:0/2100773167 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4860084630 con 0x7f4868153e80 2023-10-06T11:09:06.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.598+0000 7f486d65a700 1 --2- 172.21.15.146:0/2100773167 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f484c066f30 0x7f484c0693e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f48640099b0 tx=0x7f4864017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:06.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.602+0000 7f485d7fa700 1 -- 172.21.15.146:0/2100773167 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f486816a5c0 con 0x7f4868153e80 2023-10-06T11:09:06.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.832+0000 7f486f8be700 1 -- 172.21.15.146:0/2100773167 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f486816a5c0 con 0x7f4868153e80 2023-10-06T11:09:06.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.832+0000 7f485d7fa700 1 -- 172.21.15.146:0/2100773167 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4609 (secure 0 0 0) 0x7f486816a5c0 con 0x7f4868153e80 2023-10-06T11:09:06.834 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:09:06.834 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":35,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5248,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3360977916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3360977916},{"type":"v1","addr":"172.21.15.151:6834","nonce":3360977916}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5251,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2265934004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":2265934004},{"type":"v1","addr":"172.21.15.151:6835","nonce":2265934004}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2387575667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2387575667},{"type":"v1","addr":"172.21.15.146:6836","nonce":2387575667}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:08:42.797557+0000","modified":"2023-10-06T11:08:46.435072+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5481":{"gid":5481,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/2252184844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2252184844},{"type":"v1","addr":"172.21.15.146:6837","nonce":2252184844}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T11:09:06.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.834+0000 7f486f8be700 1 -- 172.21.15.146:0/2100773167 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f484c066f30 msgr2=0x7f484c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:06.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.834+0000 7f486f8be700 1 --2- 172.21.15.146:0/2100773167 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f484c066f30 0x7f484c0693e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f48640099b0 tx=0x7f4864017000 comp rx=0 tx=0).stop 2023-10-06T11:09:06.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.834+0000 7f486f8be700 1 -- 172.21.15.146:0/2100773167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4868153e80 msgr2=0x7f48680d0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:06.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.834+0000 7f486f8be700 1 --2- 172.21.15.146:0/2100773167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4868153e80 0x7f48680d0430 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f486000c810 tx=0x7f4860001650 comp rx=0 tx=0).stop 2023-10-06T11:09:06.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.835+0000 7f486f8be700 1 -- 172.21.15.146:0/2100773167 shutdown_connections 2023-10-06T11:09:06.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.835+0000 7f486f8be700 1 --2- 172.21.15.146:0/2100773167 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f484c066f30 0x7f484c0693e0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:06.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.835+0000 7f486f8be700 1 --2- 172.21.15.146:0/2100773167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4868153e80 0x7f48680d0430 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:06.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.835+0000 7f486f8be700 1 --2- 172.21.15.146:0/2100773167 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4868068ba0 0x7f4868156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:06.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.835+0000 7f486f8be700 1 --2- 172.21.15.146:0/2100773167 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4868153ab0 0x7f48680cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:06.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.835+0000 7f486f8be700 1 -- 172.21.15.146:0/2100773167 >> 172.21.15.146:0/2100773167 conn(0x7f486806eba0 msgr2=0x7f486815c180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:06.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.835+0000 7f486f8be700 1 -- 172.21.15.146:0/2100773167 shutdown_connections 2023-10-06T11:09:06.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:06.835+0000 7f486f8be700 1 -- 172.21.15.146:0/2100773167 wait complete. 2023-10-06T11:09:06.838 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 35 2023-10-06T11:09:06.848 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok flush_path / 2023-10-06T11:09:06.978 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:09:06.978 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0 2023-10-06T11:09:06.978 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:09:06.989 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' got response code '0' and stdout '{ "return_code": 0 } ' 2023-10-06T11:09:06.989 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /' 2023-10-06T11:09:06.989 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / 2023-10-06T11:09:07.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.104+0000 7f7a7b37f700 1 Processor -- start 2023-10-06T11:09:07.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.105+0000 7f7a7b37f700 1 -- start start 2023-10-06T11:09:07.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.105+0000 7f7a7b37f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a740676c0 0x7f7a740b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:07.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.105+0000 7f7a7b37f700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7a74067a90 0x7f7a7415ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:07.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.105+0000 7f7a7b37f700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a7415a840 con 0x7f7a7406e690 2023-10-06T11:09:07.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.105+0000 7f7a7b37f700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a7415ab20 con 0x7f7a74067a90 2023-10-06T11:09:07.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.105+0000 7f7a7b37f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7415ae00 con 0x7f7a740676c0 2023-10-06T11:09:07.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.106+0000 7f7a7911b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a740676c0 0x7f7a740b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:07.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.106+0000 7f7a7891a700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7a74067a90 0x7f7a7415ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:07.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.106+0000 7f7a7891a700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7a74067a90 0x7f7a7415ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:34554/0 (socket says 172.21.15.146:34554) 2023-10-06T11:09:07.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.106+0000 7f7a7911b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a740676c0 0x7f7a740b0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:45942/0 (socket says 172.21.15.146:45942) 2023-10-06T11:09:07.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.106+0000 7f7a7891a700 1 -- 172.21.15.146:0/163028797 learned_addr learned my addr 172.21.15.146:0/163028797 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:07.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.106+0000 7f7a7991c700 1 --1- 172.21.15.146:0/163028797 >> v1:172.21.15.151:6789/0 conn(0x7f7a7406e690 0x7f7a7406eae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:44996/0 (socket says 172.21.15.146:44996) 2023-10-06T11:09:07.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.106+0000 7f7a7891a700 1 -- 172.21.15.146:0/163028797 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a740676c0 msgr2=0x7f7a740b0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:07.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.106+0000 7f7a7891a700 1 --2- 172.21.15.146:0/163028797 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a740676c0 0x7f7a740b0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:07.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.106+0000 7f7a7891a700 1 -- 172.21.15.146:0/163028797 >> v1:172.21.15.151:6789/0 conn(0x7f7a7406e690 legacy=0x7f7a7406eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:07.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.106+0000 7f7a7891a700 1 -- 172.21.15.146:0/163028797 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a7415d5b0 con 0x7f7a74067a90 2023-10-06T11:09:07.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.106+0000 7f7a6bfff700 1 -- 172.21.15.146:0/163028797 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 341667797 0 0) 0x7f7a7415a840 con 0x7f7a7406e690 2023-10-06T11:09:07.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.106+0000 7f7a7911b700 1 --2- 172.21.15.146:0/163028797 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a740676c0 0x7f7a740b0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:09:07.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.106+0000 7f7a7891a700 1 --2- 172.21.15.146:0/163028797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a74067a90 0x7f7a7415ddb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7a640099b0 tx=0x7f7a64009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ab7dbc8ae9e74b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:07.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.106+0000 7f7a6bfff700 1 -- 172.21.15.146:0/163028797 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a64009ea0 con 0x7f7a74067a90 2023-10-06T11:09:07.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.106+0000 7f7a6bfff700 1 -- 172.21.15.146:0/163028797 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a6400b860 con 0x7f7a74067a90 2023-10-06T11:09:07.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.106+0000 7f7a6bfff700 1 -- 172.21.15.146:0/163028797 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6400bc00 con 0x7f7a74067a90 2023-10-06T11:09:07.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.107+0000 7f7a7b37f700 1 -- 172.21.15.146:0/163028797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a74067a90 msgr2=0x7f7a7415ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:07.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.107+0000 7f7a7b37f700 1 --2- 172.21.15.146:0/163028797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a74067a90 0x7f7a7415ddb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7a640099b0 tx=0x7f7a64009250 comp rx=0 tx=0).stop 2023-10-06T11:09:07.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.107+0000 7f7a7b37f700 1 -- 172.21.15.146:0/163028797 shutdown_connections 2023-10-06T11:09:07.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.107+0000 7f7a7b37f700 1 --2- 172.21.15.146:0/163028797 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a740676c0 0x7f7a740b0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:07.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.107+0000 7f7a7b37f700 1 --2- 172.21.15.146:0/163028797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a74067a90 0x7f7a7415ddb0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:07.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.107+0000 7f7a7b37f700 1 -- 172.21.15.146:0/163028797 >> 172.21.15.146:0/163028797 conn(0x7f7a74068580 msgr2=0x7f7a74068980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:07.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.107+0000 7f7a7b37f700 1 -- 172.21.15.146:0/163028797 shutdown_connections 2023-10-06T11:09:07.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.107+0000 7f7a7b37f700 1 -- 172.21.15.146:0/163028797 wait complete. 2023-10-06T11:09:07.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.108+0000 7f7a7b37f700 1 Processor -- start 2023-10-06T11:09:07.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.108+0000 7f7a7b37f700 1 -- start start 2023-10-06T11:09:07.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.109+0000 7f7a7b37f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a740676c0 0x7f7a740aa4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:07.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.109+0000 7f7a7b37f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a74067a90 0x7f7a740acd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:07.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.109+0000 7f7a7b37f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a7406e690 0x7f7a7413cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:07.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.109+0000 7f7a7b37f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a740ae130 con 0x7f7a7406e690 2023-10-06T11:09:07.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.109+0000 7f7a7b37f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a740ad250 con 0x7f7a74067a90 2023-10-06T11:09:07.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.109+0000 7f7a7b37f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a740ad520 con 0x7f7a740676c0 2023-10-06T11:09:07.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.109+0000 7f7a7991c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a7406e690 0x7f7a7413cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:07.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.109+0000 7f7a7991c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a7406e690 0x7f7a7413cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49146/0 (socket says 172.21.15.146:49146) 2023-10-06T11:09:07.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.109+0000 7f7a7991c700 1 -- 172.21.15.146:0/2519090709 learned_addr learned my addr 172.21.15.146:0/2519090709 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:07.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.109+0000 7f7a7911b700 1 --2- 172.21.15.146:0/2519090709 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a740676c0 0x7f7a740aa4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:07.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.109+0000 7f7a7891a700 1 --2- 172.21.15.146:0/2519090709 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a74067a90 0x7f7a740acd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:07.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.109+0000 7f7a7991c700 1 -- 172.21.15.146:0/2519090709 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a740676c0 msgr2=0x7f7a740aa4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:07.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.109+0000 7f7a7991c700 1 --2- 172.21.15.146:0/2519090709 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a740676c0 0x7f7a740aa4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:07.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.110+0000 7f7a7991c700 1 -- 172.21.15.146:0/2519090709 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a74067a90 msgr2=0x7f7a740acd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:07.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.110+0000 7f7a7991c700 1 --2- 172.21.15.146:0/2519090709 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a74067a90 0x7f7a740acd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:07.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.110+0000 7f7a7991c700 1 -- 172.21.15.146:0/2519090709 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a70009420 con 0x7f7a7406e690 2023-10-06T11:09:07.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.110+0000 7f7a7891a700 1 --2- 172.21.15.146:0/2519090709 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a74067a90 0x7f7a740acd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:07.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.110+0000 7f7a7911b700 1 --2- 172.21.15.146:0/2519090709 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a740676c0 0x7f7a740aa4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:07.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.110+0000 7f7a7991c700 1 --2- 172.21.15.146:0/2519090709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a7406e690 0x7f7a7413cbf0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c00cd50 tx=0x7f7a6c001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:07.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.110+0000 7f7a697fa700 1 -- 172.21.15.146:0/2519090709 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c005df0 con 0x7f7a7406e690 2023-10-06T11:09:07.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.110+0000 7f7a697fa700 1 -- 172.21.15.146:0/2519090709 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a6c00a960 con 0x7f7a7406e690 2023-10-06T11:09:07.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.110+0000 7f7a697fa700 1 -- 172.21.15.146:0/2519090709 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c00ad20 con 0x7f7a7406e690 2023-10-06T11:09:07.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.110+0000 7f7a7b37f700 1 -- 172.21.15.146:0/2519090709 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a640094f0 con 0x7f7a7406e690 2023-10-06T11:09:07.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.110+0000 7f7a7b37f700 1 -- 172.21.15.146:0/2519090709 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a740adae0 con 0x7f7a7406e690 2023-10-06T11:09:07.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.112+0000 7f7a697fa700 1 -- 172.21.15.146:0/2519090709 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7a6c007300 con 0x7f7a7406e690 2023-10-06T11:09:07.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.112+0000 7f7a697fa700 1 --2- 172.21.15.146:0/2519090709 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7a58066f30 0x7f7a580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:07.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.112+0000 7f7a697fa700 1 -- 172.21.15.146:0/2519090709 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7a6c084870 con 0x7f7a7406e690 2023-10-06T11:09:07.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.112+0000 7f7a7911b700 1 --2- 172.21.15.146:0/2519090709 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7a58066f30 0x7f7a580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:07.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.112+0000 7f7a7911b700 1 --2- 172.21.15.146:0/2519090709 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7a58066f30 0x7f7a580693e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7a700093f0 tx=0x7f7a70008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:07.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.114+0000 7f7a84677b80 1 Processor -- start 2023-10-06T11:09:07.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.114+0000 7f7a84677b80 1 -- start start 2023-10-06T11:09:07.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.114+0000 7f7a84677b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac9565caf0 0x55ac9565cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:07.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.114+0000 7f7a84677b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ac95618a00 0x55ac956155e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:07.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.114+0000 7f7a84677b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac95616c30 0x55ac95615b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:07.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.114+0000 7f7a84677b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac95595ce0 con 0x55ac9565caf0 2023-10-06T11:09:07.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.114+0000 7f7a84677b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac9556cad0 con 0x55ac95616c30 2023-10-06T11:09:07.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.114+0000 7f7a84677b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ac9556a2d0 con 0x55ac95618a00 2023-10-06T11:09:07.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.115+0000 7f7a7911b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac9565caf0 0x55ac9565cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:07.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.115+0000 7f7a7911b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac9565caf0 0x55ac9565cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49160/0 (socket says 172.21.15.146:49160) 2023-10-06T11:09:07.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.115+0000 7f7a7911b700 1 -- 172.21.15.146:0/966474418 learned_addr learned my addr 172.21.15.146:0/966474418 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:07.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.115+0000 7f7a7911b700 1 -- 172.21.15.146:0/966474418 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ac95618a00 msgr2=0x55ac956155e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:07.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.115+0000 7f7a7911b700 1 --2- 172.21.15.146:0/966474418 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ac95618a00 0x55ac956155e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:07.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.115+0000 7f7a7911b700 1 -- 172.21.15.146:0/966474418 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac95616c30 msgr2=0x55ac95615b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:07.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.115+0000 7f7a7911b700 1 --2- 172.21.15.146:0/966474418 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac95616c30 0x55ac95615b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:07.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.115+0000 7f7a7911b700 1 -- 172.21.15.146:0/966474418 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ac954002d0 con 0x55ac9565caf0 2023-10-06T11:09:07.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.115+0000 7f7a7911b700 1 --2- 172.21.15.146:0/966474418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac9565caf0 0x55ac9565cec0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f7a70011f90 tx=0x7f7a70018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4faecf947cc256c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:07.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.115+0000 7f7a5e7fc700 1 -- 172.21.15.146:0/966474418 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a70015c90 con 0x55ac9565caf0 2023-10-06T11:09:07.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.115+0000 7f7a5e7fc700 1 -- 172.21.15.146:0/966474418 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a70015df0 con 0x55ac9565caf0 2023-10-06T11:09:07.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.115+0000 7f7a5e7fc700 1 -- 172.21.15.146:0/966474418 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a70021440 con 0x55ac9565caf0 2023-10-06T11:09:07.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.116+0000 7f7a84677b80 1 -- 172.21.15.146:0/966474418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac9565caf0 msgr2=0x55ac9565cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:07.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.116+0000 7f7a84677b80 1 --2- 172.21.15.146:0/966474418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac9565caf0 0x55ac9565cec0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f7a70011f90 tx=0x7f7a70018000 comp rx=0 tx=0).stop 2023-10-06T11:09:07.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.116+0000 7f7a84677b80 1 -- 172.21.15.146:0/966474418 shutdown_connections 2023-10-06T11:09:07.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.116+0000 7f7a84677b80 1 --2- 172.21.15.146:0/966474418 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac95616c30 0x55ac95615b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:07.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.116+0000 7f7a84677b80 1 --2- 172.21.15.146:0/966474418 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac9565caf0 0x55ac9565cec0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:07.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.116+0000 7f7a84677b80 1 --2- 172.21.15.146:0/966474418 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ac95618a00 0x55ac956155e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:07.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.116+0000 7f7a84677b80 1 -- 172.21.15.146:0/966474418 >> 172.21.15.146:0/966474418 conn(0x55ac956170d0 msgr2=0x55ac956174a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:07.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.116+0000 7f7a84677b80 1 -- 172.21.15.146:0/966474418 shutdown_connections 2023-10-06T11:09:07.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.116+0000 7f7a84677b80 1 -- 172.21.15.146:0/966474418 wait complete. 2023-10-06T11:09:07.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.116+0000 7f7a84677b80 1 -- start start 2023-10-06T11:09:07.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.117+0000 7f7a84677b80 1 Processor -- start 2023-10-06T11:09:07.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.117+0000 7f7a84677b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac95616c30 0x55ac9563e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:07.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.117+0000 7f7a84677b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ac95618a00 0x55ac9563be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:07.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.117+0000 7f7a84677b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac9565caf0 0x55ac9563c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:07.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.117+0000 7f7a84677b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac955660c0 con 0x55ac95616c30 2023-10-06T11:09:07.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.117+0000 7f7a84677b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac955118f0 con 0x55ac9565caf0 2023-10-06T11:09:07.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.117+0000 7f7a84677b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ac9552cf00 con 0x55ac95618a00 2023-10-06T11:09:07.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.117+0000 7f7a84677b80 10 client.0 _ll_register_callbacks cb 0x55ac95402f90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:09:07.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.117+0000 7f7a7911b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac95616c30 0x55ac9563e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:07.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.117+0000 7f7a7911b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac95616c30 0x55ac9563e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49162/0 (socket says 172.21.15.146:49162) 2023-10-06T11:09:07.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.117+0000 7f7a7911b700 1 -- 172.21.15.146:0/918420161 learned_addr learned my addr 172.21.15.146:0/918420161 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:07.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.118+0000 7f7a7891a700 1 --2- 172.21.15.146:0/918420161 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ac95618a00 0x55ac9563be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:07.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.118+0000 7f7a7991c700 1 --2- 172.21.15.146:0/918420161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac9565caf0 0x55ac9563c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:07.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.118+0000 7f7a7911b700 1 -- 172.21.15.146:0/918420161 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ac95618a00 msgr2=0x55ac9563be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:07.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.118+0000 7f7a7911b700 1 --2- 172.21.15.146:0/918420161 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ac95618a00 0x55ac9563be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:07.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.118+0000 7f7a7911b700 1 -- 172.21.15.146:0/918420161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac9565caf0 msgr2=0x55ac9563c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:07.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.118+0000 7f7a7911b700 1 --2- 172.21.15.146:0/918420161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac9565caf0 0x55ac9563c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:07.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.118+0000 7f7a7911b700 1 -- 172.21.15.146:0/918420161 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a70011b90 con 0x55ac95616c30 2023-10-06T11:09:07.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.118+0000 7f7a7911b700 1 --2- 172.21.15.146:0/918420161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac95616c30 0x55ac9563e620 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f7a70008010 tx=0x7f7a7001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4251d85e8d623171 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:07.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.118+0000 7f7a537fe700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:09:07.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.118+0000 7f7a537fe700 1 -- 172.21.15.146:0/918420161 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a70036480 con 0x55ac95616c30 2023-10-06T11:09:07.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.118+0000 7f7a537fe700 1 -- 172.21.15.146:0/918420161 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7a70031070 con 0x55ac95616c30 2023-10-06T11:09:07.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.118+0000 7f7a84677b80 1 -- 172.21.15.146:0/918420161 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ac9560a6f0 con 0x55ac95616c30 2023-10-06T11:09:07.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.118+0000 7f7a537fe700 1 -- 172.21.15.146:0/918420161 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a7002a610 con 0x55ac95616c30 2023-10-06T11:09:07.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.118+0000 7f7a84677b80 10 client.5766 fetch_fsmap learned FSMap version 35 2023-10-06T11:09:07.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.118+0000 7f7a84677b80 1 -- 172.21.15.146:0/918420161 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) v3 -- 0x55ac953a3040 con 0x55ac95616c30 2023-10-06T11:09:07.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.118+0000 7f7a537fe700 1 -- 172.21.15.146:0/918420161 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ac9560a6f0 con 0x55ac95616c30 2023-10-06T11:09:07.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.118+0000 7f7a537fe700 1 -- 172.21.15.146:0/918420161 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 35) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f7a7002a980 con 0x55ac95616c30 2023-10-06T11:09:07.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.118+0000 7f7a84677b80 10 client.5766 fetch_fsmap finished waiting for FSMap version 35 2023-10-06T11:09:07.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.118+0000 7f7a84677b80 10 client.5766 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-10-06T11:09:07.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.118+0000 7f7a84677b80 20 client.5766 populate_metadata read hostname 'smithi146' 2023-10-06T11:09:07.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.118+0000 7f7a84677b80 1 --2- 172.21.15.146:0/918420161 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55ac9563a2e0 0x55ac9566f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:07.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.118+0000 7f7a84677b80 4 client.5766 mds_command: new command op to 5481 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:09:07.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.118+0000 7f7a84677b80 1 -- 172.21.15.146:0/918420161 --> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ac955e7620 con 0x55ac9563a2e0 2023-10-06T11:09:07.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.119+0000 7f7a7891a700 1 --2- 172.21.15.146:0/918420161 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55ac9563a2e0 0x55ac9566f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:07.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.119+0000 7f7a537fe700 10 client.5766 ms_handle_connect on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:07.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.119+0000 7f7a7891a700 1 --2- 172.21.15.146:0/918420161 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55ac9563a2e0 0x55ac9566f130 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8de95f97f162c70c server_cookie=601f3fc5c6ac2a6e in_seq=0 out_seq=0 2023-10-06T11:09:07.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.119+0000 7f7a537fe700 1 -- 172.21.15.146:0/918420161 <== mds.0 v2:172.21.15.146:6835/2252184844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55ac955e7620 con 0x55ac9563a2e0 2023-10-06T11:09:07.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.119+0000 7f7a537fe700 10 client.5766 handle_command_reply: tid=0 2023-10-06T11:09:07.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.119+0000 7f7a84677b80 1 client.5766 shutdown 2023-10-06T11:09:07.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.119+0000 7f7a84677b80 1 -- 172.21.15.146:0/918420161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac95616c30 msgr2=0x55ac9563e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:07.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.119+0000 7f7a84677b80 1 --2- 172.21.15.146:0/918420161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac95616c30 0x55ac9563e620 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f7a70008010 tx=0x7f7a7001b000 comp rx=0 tx=0).stop 2023-10-06T11:09:07.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.119+0000 7f7a84677b80 1 -- 172.21.15.146:0/918420161 shutdown_connections 2023-10-06T11:09:07.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.119+0000 7f7a84677b80 1 --2- 172.21.15.146:0/918420161 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55ac9563a2e0 0x55ac9566f130 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:07.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.119+0000 7f7a84677b80 1 --2- 172.21.15.146:0/918420161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac9565caf0 0x55ac9563c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:07.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.120+0000 7f7a537fe700 0 client.5766 ms_handle_reset on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:07.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.120+0000 7f7a84677b80 1 --2- 172.21.15.146:0/918420161 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac95616c30 0x55ac9563e620 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:07.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.120+0000 7f7a84677b80 1 --2- 172.21.15.146:0/918420161 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ac95618a00 0x55ac9563be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:07.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.120+0000 7f7a84677b80 1 -- 172.21.15.146:0/918420161 >> 172.21.15.146:0/918420161 conn(0x55ac956170d0 msgr2=0x55ac9565a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:07.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.120+0000 7f7a84677b80 1 -- 172.21.15.146:0/918420161 shutdown_connections 2023-10-06T11:09:07.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.120+0000 7f7a84677b80 1 -- 172.21.15.146:0/918420161 wait complete. 2023-10-06T11:09:07.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.120+0000 7f7a84677b80 20 client.5766 trim_cache size 0 max 16384 2023-10-06T11:09:07.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.136+0000 7f7a84677b80 1 Processor -- start 2023-10-06T11:09:07.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.136+0000 7f7a84677b80 1 -- start start 2023-10-06T11:09:07.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.136+0000 7f7a84677b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ac95616c30 0x55ac9565f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:07.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.136+0000 7f7a84677b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac95618a00 0x55ac95644940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:07.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.136+0000 7f7a84677b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac9565caf0 0x55ac95644e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:07.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.136+0000 7f7a84677b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac953e8e90 con 0x55ac9565caf0 2023-10-06T11:09:07.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.136+0000 7f7a84677b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac95613120 con 0x55ac95618a00 2023-10-06T11:09:07.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.136+0000 7f7a84677b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ac9565a330 con 0x55ac95616c30 2023-10-06T11:09:07.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.137+0000 7f7a7991c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac9565caf0 0x55ac95644e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:07.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.137+0000 7f7a7991c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac9565caf0 0x55ac95644e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49166/0 (socket says 172.21.15.146:49166) 2023-10-06T11:09:07.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.137+0000 7f7a7991c700 1 -- 172.21.15.146:0/2376762047 learned_addr learned my addr 172.21.15.146:0/2376762047 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:07.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.137+0000 7f7a7991c700 1 -- 172.21.15.146:0/2376762047 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ac95616c30 msgr2=0x55ac9565f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:07.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.137+0000 7f7a7891a700 1 --2- 172.21.15.146:0/2376762047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac95618a00 0x55ac95644940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:07.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.137+0000 7f7a7911b700 1 --2- 172.21.15.146:0/2376762047 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ac95616c30 0x55ac9565f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:07.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.137+0000 7f7a7991c700 1 --2- 172.21.15.146:0/2376762047 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ac95616c30 0x55ac9565f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:07.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.137+0000 7f7a7991c700 1 -- 172.21.15.146:0/2376762047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac95618a00 msgr2=0x55ac95644940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:07.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.137+0000 7f7a7991c700 1 --2- 172.21.15.146:0/2376762047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac95618a00 0x55ac95644940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:07.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.137+0000 7f7a7991c700 1 -- 172.21.15.146:0/2376762047 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ac95653810 con 0x55ac9565caf0 2023-10-06T11:09:07.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.137+0000 7f7a7891a700 1 --2- 172.21.15.146:0/2376762047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac95618a00 0x55ac95644940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:09:07.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.137+0000 7f7a7911b700 1 --2- 172.21.15.146:0/2376762047 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ac95616c30 0x55ac9565f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:09:07.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.137+0000 7f7a7991c700 1 --2- 172.21.15.146:0/2376762047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac9565caf0 0x55ac95644e80 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c051bc0 tx=0x7f7a6c082b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1a623adbe4acba7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:07.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.137+0000 7f7a5effd700 1 -- 172.21.15.146:0/2376762047 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c055490 con 0x55ac9565caf0 2023-10-06T11:09:07.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.137+0000 7f7a5effd700 1 -- 172.21.15.146:0/2376762047 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a6c058910 con 0x55ac9565caf0 2023-10-06T11:09:07.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.137+0000 7f7a5effd700 1 -- 172.21.15.146:0/2376762047 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c05c660 con 0x55ac9565caf0 2023-10-06T11:09:07.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.138+0000 7f7a84677b80 1 -- 172.21.15.146:0/2376762047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac9565caf0 msgr2=0x55ac95644e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:07.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.138+0000 7f7a84677b80 1 --2- 172.21.15.146:0/2376762047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac9565caf0 0x55ac95644e80 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c051bc0 tx=0x7f7a6c082b90 comp rx=0 tx=0).stop 2023-10-06T11:09:07.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.138+0000 7f7a84677b80 1 -- 172.21.15.146:0/2376762047 shutdown_connections 2023-10-06T11:09:07.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.138+0000 7f7a84677b80 1 --2- 172.21.15.146:0/2376762047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac9565caf0 0x55ac95644e80 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:07.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.138+0000 7f7a84677b80 1 --2- 172.21.15.146:0/2376762047 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ac95616c30 0x55ac9565f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:07.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.138+0000 7f7a84677b80 1 --2- 172.21.15.146:0/2376762047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac95618a00 0x55ac95644940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:07.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.138+0000 7f7a84677b80 1 -- 172.21.15.146:0/2376762047 >> 172.21.15.146:0/2376762047 conn(0x55ac956170d0 msgr2=0x55ac9565a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:07.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.138+0000 7f7a84677b80 1 -- 172.21.15.146:0/2376762047 shutdown_connections 2023-10-06T11:09:07.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.138+0000 7f7a84677b80 1 -- 172.21.15.146:0/2376762047 wait complete. 2023-10-06T11:09:07.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.138+0000 7f7a84677b80 1 -- start start 2023-10-06T11:09:07.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.138+0000 7f7a84677b80 1 Processor -- start 2023-10-06T11:09:07.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.139+0000 7f7a84677b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ac95616c30 0x55ac956bc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:07.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.139+0000 7f7a84677b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac95618a00 0x55ac956522c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:07.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.139+0000 7f7a84677b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac9565caf0 0x55ac95652800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:07.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.139+0000 7f7a84677b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac95662fd0 con 0x55ac95618a00 2023-10-06T11:09:07.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.139+0000 7f7a84677b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac95661400 con 0x55ac9565caf0 2023-10-06T11:09:07.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.139+0000 7f7a84677b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ac956165b0 con 0x55ac95616c30 2023-10-06T11:09:07.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.139+0000 7f7a84677b80 10 client.0 _ll_register_callbacks cb 0x55ac95402f90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:09:07.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.139+0000 7f7a7891a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac95618a00 0x55ac956522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:07.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.139+0000 7f7a7891a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac95618a00 0x55ac956522c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49178/0 (socket says 172.21.15.146:49178) 2023-10-06T11:09:07.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.139+0000 7f7a7891a700 1 -- 172.21.15.146:0/4231148110 learned_addr learned my addr 172.21.15.146:0/4231148110 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:07.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.139+0000 7f7a7991c700 1 --2- 172.21.15.146:0/4231148110 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac9565caf0 0x55ac95652800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:07.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.139+0000 7f7a7911b700 1 --2- 172.21.15.146:0/4231148110 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ac95616c30 0x55ac956bc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:07.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.140+0000 7f7a7891a700 1 -- 172.21.15.146:0/4231148110 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ac95616c30 msgr2=0x55ac956bc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:07.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.140+0000 7f7a7891a700 1 --2- 172.21.15.146:0/4231148110 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ac95616c30 0x55ac956bc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:07.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.140+0000 7f7a7891a700 1 -- 172.21.15.146:0/4231148110 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac9565caf0 msgr2=0x55ac95652800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:07.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.140+0000 7f7a7891a700 1 --2- 172.21.15.146:0/4231148110 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac9565caf0 0x55ac95652800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:07.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.140+0000 7f7a7891a700 1 -- 172.21.15.146:0/4231148110 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a740adae0 con 0x55ac95618a00 2023-10-06T11:09:07.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.140+0000 7f7a7891a700 1 --2- 172.21.15.146:0/4231148110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac95618a00 0x55ac956522c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f7a64006fd0 tx=0x7f7a6401d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3874c2e4917c00c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:07.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.140+0000 7f7a537fe700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:09:07.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.140+0000 7f7a537fe700 1 -- 172.21.15.146:0/4231148110 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a64020040 con 0x55ac95618a00 2023-10-06T11:09:07.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.140+0000 7f7a537fe700 1 -- 172.21.15.146:0/4231148110 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7a640274a0 con 0x55ac95618a00 2023-10-06T11:09:07.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.140+0000 7f7a84677b80 1 -- 172.21.15.146:0/4231148110 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7a70015df0 con 0x55ac95618a00 2023-10-06T11:09:07.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.140+0000 7f7a537fe700 1 -- 172.21.15.146:0/4231148110 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a640278d0 con 0x55ac95618a00 2023-10-06T11:09:07.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.140+0000 7f7a84677b80 10 client.5772 fetch_fsmap learned FSMap version 35 2023-10-06T11:09:07.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.140+0000 7f7a84677b80 1 -- 172.21.15.146:0/4231148110 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) v3 -- 0x55ac955347e0 con 0x55ac95618a00 2023-10-06T11:09:07.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.140+0000 7f7a537fe700 1 -- 172.21.15.146:0/4231148110 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a70015df0 con 0x55ac95618a00 2023-10-06T11:09:07.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.140+0000 7f7a537fe700 1 -- 172.21.15.146:0/4231148110 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 35) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f7a64027a30 con 0x55ac95618a00 2023-10-06T11:09:07.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.140+0000 7f7a84677b80 10 client.5772 fetch_fsmap finished waiting for FSMap version 35 2023-10-06T11:09:07.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.140+0000 7f7a84677b80 10 client.5772 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-10-06T11:09:07.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.140+0000 7f7a84677b80 20 client.5772 populate_metadata read hostname 'smithi146' 2023-10-06T11:09:07.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.140+0000 7f7a84677b80 1 --2- 172.21.15.146:0/4231148110 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55ac9563ee90 0x55ac95655a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:07.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.140+0000 7f7a84677b80 4 client.5772 mds_command: new command op to 5481 tid=0[{"prefix": "scrub start", "path": "/"}] 2023-10-06T11:09:07.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.140+0000 7f7a84677b80 1 -- 172.21.15.146:0/4231148110 --> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] -- command(tid 0: {"prefix": "scrub start", "path": "/"}) v1 -- 0x55ac95508e60 con 0x55ac9563ee90 2023-10-06T11:09:07.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.140+0000 7f7a7911b700 1 --2- 172.21.15.146:0/4231148110 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55ac9563ee90 0x55ac95655a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:07.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.141+0000 7f7a537fe700 10 client.5772 ms_handle_connect on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:07.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.141+0000 7f7a7911b700 1 --2- 172.21.15.146:0/4231148110 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55ac9563ee90 0x55ac95655a40 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0fbace4f23bebed server_cookie=d9f0ced1b974aebf in_seq=0 out_seq=0 2023-10-06T11:09:07.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.141+0000 7f7a537fe700 1 -- 172.21.15.146:0/4231148110 <== mds.0 v2:172.21.15.146:6835/2252184844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55ac95508e60 con 0x55ac9563ee90 2023-10-06T11:09:07.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.141+0000 7f7a537fe700 10 client.5772 handle_command_reply: tid=0 2023-10-06T11:09:07.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.141+0000 7f7a84677b80 1 client.5772 shutdown 2023-10-06T11:09:07.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.141+0000 7f7a84677b80 1 -- 172.21.15.146:0/4231148110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac95618a00 msgr2=0x55ac956522c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:07.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.141+0000 7f7a84677b80 1 --2- 172.21.15.146:0/4231148110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac95618a00 0x55ac956522c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f7a64006fd0 tx=0x7f7a6401d040 comp rx=0 tx=0).stop 2023-10-06T11:09:07.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.141+0000 7f7a84677b80 1 -- 172.21.15.146:0/4231148110 shutdown_connections 2023-10-06T11:09:07.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.141+0000 7f7a84677b80 1 --2- 172.21.15.146:0/4231148110 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55ac9563ee90 0x55ac95655a40 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:07.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.141+0000 7f7a84677b80 1 --2- 172.21.15.146:0/4231148110 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac9565caf0 0x55ac95652800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:07.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.141+0000 7f7a84677b80 1 --2- 172.21.15.146:0/4231148110 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55ac95616c30 0x55ac956bc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:07.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.141+0000 7f7a537fe700 0 client.5772 ms_handle_reset on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:07.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.141+0000 7f7a84677b80 1 --2- 172.21.15.146:0/4231148110 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55ac95618a00 0x55ac956522c0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:07.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.141+0000 7f7a84677b80 1 -- 172.21.15.146:0/4231148110 >> 172.21.15.146:0/4231148110 conn(0x55ac956170d0 msgr2=0x55ac9565a560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:07.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.141+0000 7f7a84677b80 1 -- 172.21.15.146:0/4231148110 shutdown_connections 2023-10-06T11:09:07.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.141+0000 7f7a84677b80 1 -- 172.21.15.146:0/4231148110 wait complete. 2023-10-06T11:09:07.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.142+0000 7f7a84677b80 20 client.5772 trim_cache size 0 max 16384 2023-10-06T11:09:07.154 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:09:07.154 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0, 2023-10-06T11:09:07.154 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_tag": "20832184-6974-4e20-b017-73fc8fb483ef", 2023-10-06T11:09:07.154 INFO:teuthology.orchestra.run.smithi146.stdout: "mode": "asynchronous" 2023-10-06T11:09:07.155 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:09:07.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.142+0000 7f7a7b37f700 1 -- 172.21.15.146:0/2519090709 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7a58066f30 msgr2=0x7f7a580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:07.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.142+0000 7f7a7b37f700 1 --2- 172.21.15.146:0/2519090709 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7a58066f30 0x7f7a580693e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7a700093f0 tx=0x7f7a70008040 comp rx=0 tx=0).stop 2023-10-06T11:09:07.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.142+0000 7f7a7b37f700 1 -- 172.21.15.146:0/2519090709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a7406e690 msgr2=0x7f7a7413cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:07.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.142+0000 7f7a7b37f700 1 --2- 172.21.15.146:0/2519090709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a7406e690 0x7f7a7413cbf0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c00cd50 tx=0x7f7a6c001b10 comp rx=0 tx=0).stop 2023-10-06T11:09:07.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.142+0000 7f7a7b37f700 1 -- 172.21.15.146:0/2519090709 shutdown_connections 2023-10-06T11:09:07.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.142+0000 7f7a7b37f700 1 --2- 172.21.15.146:0/2519090709 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7a58066f30 0x7f7a580693e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:07.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.142+0000 7f7a7b37f700 1 --2- 172.21.15.146:0/2519090709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7a7406e690 0x7f7a7413cbf0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:07.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.142+0000 7f7a7b37f700 1 --2- 172.21.15.146:0/2519090709 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7a740676c0 0x7f7a740aa4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:07.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.142+0000 7f7a7b37f700 1 --2- 172.21.15.146:0/2519090709 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a74067a90 0x7f7a740acd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:07.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.142+0000 7f7a7b37f700 1 -- 172.21.15.146:0/2519090709 >> 172.21.15.146:0/2519090709 conn(0x7f7a74068580 msgr2=0x7f7a7415b150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:07.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.142+0000 7f7a7b37f700 1 -- 172.21.15.146:0/2519090709 shutdown_connections 2023-10-06T11:09:07.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.142+0000 7f7a7b37f700 1 -- 172.21.15.146:0/2519090709 wait complete. 2023-10-06T11:09:07.158 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /' returned '{'return_code': 0, 'scrub_tag': '20832184-6974-4e20-b017-73fc8fb483ef', 'mode': 'asynchronous'}' 2023-10-06T11:09:07.158 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:09:07.158 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_dir_0) 2023-10-06T11:09:07.176 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_0' 2023-10-06T11:09:07.176 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:09:07.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.334+0000 7fe5b362c700 1 Processor -- start 2023-10-06T11:09:07.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.334+0000 7fe5b362c700 1 -- start start 2023-10-06T11:09:07.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.335+0000 7fe5b362c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5ac0aa1e0 0x7fe5ac15dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:07.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.335+0000 7fe5b362c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe5ac159990 0x7fe5ac159df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:07.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.335+0000 7fe5b362c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5ac15e320 con 0x7fe5ac1595c0 2023-10-06T11:09:07.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.335+0000 7fe5b362c700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5ac068420 con 0x7fe5ac159990 2023-10-06T11:09:07.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.335+0000 7fe5b362c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ac06f090 con 0x7fe5ac0aa1e0 2023-10-06T11:09:07.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.335+0000 7fe5b13c8700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe5ac1595c0 0x7fe5ac0a9ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38826/0 (socket says 172.21.15.146:38826) 2023-10-06T11:09:07.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.335+0000 7fe5b13c8700 1 -- 172.21.15.146:0/2028072162 learned_addr learned my addr 172.21.15.146:0/2028072162 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:07.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.336+0000 7fe5b0bc7700 1 --2- 172.21.15.146:0/2028072162 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5ac0aa1e0 0x7fe5ac15dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:07.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.336+0000 7fe5a3fff700 1 -- 172.21.15.146:0/2028072162 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2782748850 0 0) 0x7fe59c001110 con 0x7fe5ac1595c0 2023-10-06T11:09:07.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.336+0000 7fe5a3fff700 1 -- 172.21.15.146:0/2028072162 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe598003570 con 0x7fe5ac1595c0 2023-10-06T11:09:07.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.336+0000 7fe5b1bc9700 1 --2- 172.21.15.146:0/2028072162 >> v2:172.21.15.151:3300/0 conn(0x7fe5ac159990 0x7fe5ac159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:07.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.336+0000 7fe5b0bc7700 1 -- 172.21.15.146:0/2028072162 >> v2:172.21.15.151:3300/0 conn(0x7fe5ac159990 msgr2=0x7fe5ac159df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:07.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.336+0000 7fe5b0bc7700 1 --2- 172.21.15.146:0/2028072162 >> v2:172.21.15.151:3300/0 conn(0x7fe5ac159990 0x7fe5ac159df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:07.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.336+0000 7fe5b0bc7700 1 -- 172.21.15.146:0/2028072162 >> v1:172.21.15.146:6789/0 conn(0x7fe5ac1595c0 legacy=0x7fe5ac0a9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:07.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.336+0000 7fe5b0bc7700 1 -- 172.21.15.146:0/2028072162 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5ac067810 con 0x7fe5ac0aa1e0 2023-10-06T11:09:07.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.336+0000 7fe5b0bc7700 1 --2- 172.21.15.146:0/2028072162 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5ac0aa1e0 0x7fe5ac15dde0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe5a80098e0 tx=0x7fe5a80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc1cc7021a2a9c5f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:07.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.336+0000 7fe5a3fff700 1 -- 172.21.15.146:0/2028072162 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a800b640 con 0x7fe5ac0aa1e0 2023-10-06T11:09:07.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.337+0000 7fe5a3fff700 1 -- 172.21.15.146:0/2028072162 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a800b7a0 con 0x7fe5ac0aa1e0 2023-10-06T11:09:07.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.337+0000 7fe5a3fff700 1 -- 172.21.15.146:0/2028072162 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a800bb40 con 0x7fe5ac0aa1e0 2023-10-06T11:09:07.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.337+0000 7fe5b362c700 1 -- 172.21.15.146:0/2028072162 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5ac0aa1e0 msgr2=0x7fe5ac15dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:07.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.337+0000 7fe5b362c700 1 --2- 172.21.15.146:0/2028072162 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5ac0aa1e0 0x7fe5ac15dde0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe5a80098e0 tx=0x7fe5a80091a0 comp rx=0 tx=0).stop 2023-10-06T11:09:07.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.337+0000 7fe5b362c700 1 -- 172.21.15.146:0/2028072162 shutdown_connections 2023-10-06T11:09:07.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.337+0000 7fe5b362c700 1 --2- 172.21.15.146:0/2028072162 >> v2:172.21.15.151:3300/0 conn(0x7fe5ac159990 0x7fe5ac159df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:07.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.337+0000 7fe5b362c700 1 --2- 172.21.15.146:0/2028072162 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5ac0aa1e0 0x7fe5ac15dde0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:07.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.337+0000 7fe5b362c700 1 -- 172.21.15.146:0/2028072162 >> 172.21.15.146:0/2028072162 conn(0x7fe5ac0cd530 msgr2=0x7fe5ac069f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:07.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.338+0000 7fe5b362c700 1 -- 172.21.15.146:0/2028072162 shutdown_connections 2023-10-06T11:09:07.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.338+0000 7fe5b362c700 1 -- 172.21.15.146:0/2028072162 wait complete. 2023-10-06T11:09:07.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.340+0000 7fe5b362c700 1 Processor -- start 2023-10-06T11:09:07.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.340+0000 7fe5b362c700 1 -- start start 2023-10-06T11:09:07.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.341+0000 7fe5b362c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5ac0aa1e0 0x7fe5ac1510e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:07.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.341+0000 7fe5b362c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5ac1595c0 0x7fe5ac1506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:07.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.341+0000 7fe5b362c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5ac159990 0x7fe5ac15c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:07.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.341+0000 7fe5b362c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ac1531c0 con 0x7fe5ac1595c0 2023-10-06T11:09:07.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.341+0000 7fe5b362c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ac151620 con 0x7fe5ac0aa1e0 2023-10-06T11:09:07.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.341+0000 7fe5b362c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ac15b580 con 0x7fe5ac159990 2023-10-06T11:09:07.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.341+0000 7fe5b0bc7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5ac1595c0 0x7fe5ac1506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:07.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.341+0000 7fe5b0bc7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5ac1595c0 0x7fe5ac1506d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49180/0 (socket says 172.21.15.146:49180) 2023-10-06T11:09:07.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.341+0000 7fe5b0bc7700 1 -- 172.21.15.146:0/2343181855 learned_addr learned my addr 172.21.15.146:0/2343181855 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:07.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.341+0000 7fe5b1bc9700 1 --2- 172.21.15.146:0/2343181855 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5ac159990 0x7fe5ac15c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:07.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.341+0000 7fe5b13c8700 1 --2- 172.21.15.146:0/2343181855 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5ac0aa1e0 0x7fe5ac1510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:07.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.341+0000 7fe5b0bc7700 1 -- 172.21.15.146:0/2343181855 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5ac159990 msgr2=0x7fe5ac15c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:07.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.341+0000 7fe5b0bc7700 1 --2- 172.21.15.146:0/2343181855 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5ac159990 0x7fe5ac15c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:07.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.341+0000 7fe5b0bc7700 1 -- 172.21.15.146:0/2343181855 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5ac0aa1e0 msgr2=0x7fe5ac1510e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:07.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.341+0000 7fe5b0bc7700 1 --2- 172.21.15.146:0/2343181855 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5ac0aa1e0 0x7fe5ac1510e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:07.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.341+0000 7fe5b0bc7700 1 -- 172.21.15.146:0/2343181855 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a8009420 con 0x7fe5ac1595c0 2023-10-06T11:09:07.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.342+0000 7fe5b0bc7700 1 --2- 172.21.15.146:0/2343181855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5ac1595c0 0x7fe5ac1506d0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac06d2d0 tx=0x7fe5a8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:07.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.342+0000 7fe5a17fa700 1 -- 172.21.15.146:0/2343181855 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a801bcf0 con 0x7fe5ac1595c0 2023-10-06T11:09:07.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.342+0000 7fe5b362c700 1 -- 172.21.15.146:0/2343181855 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5ac15b860 con 0x7fe5ac1595c0 2023-10-06T11:09:07.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.342+0000 7fe5a17fa700 1 -- 172.21.15.146:0/2343181855 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a801be70 con 0x7fe5ac1595c0 2023-10-06T11:09:07.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.342+0000 7fe5a17fa700 1 -- 172.21.15.146:0/2343181855 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8011650 con 0x7fe5ac1595c0 2023-10-06T11:09:07.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.342+0000 7fe5b362c700 1 -- 172.21.15.146:0/2343181855 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5ac152b40 con 0x7fe5ac1595c0 2023-10-06T11:09:07.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.343+0000 7fe5b362c700 1 -- 172.21.15.146:0/2343181855 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5ac0cc7b0 con 0x7fe5ac1595c0 2023-10-06T11:09:07.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.344+0000 7fe5a17fa700 1 -- 172.21.15.146:0/2343181855 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe5a8011a00 con 0x7fe5ac1595c0 2023-10-06T11:09:07.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.345+0000 7fe5a17fa700 1 --2- 172.21.15.146:0/2343181855 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe590066f30 0x7fe5900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:07.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.345+0000 7fe5a17fa700 1 -- 172.21.15.146:0/2343181855 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe5a8085fa0 con 0x7fe5ac1595c0 2023-10-06T11:09:07.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.345+0000 7fe5b13c8700 1 --2- 172.21.15.146:0/2343181855 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe590066f30 0x7fe5900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:07.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.345+0000 7fe5b13c8700 1 --2- 172.21.15.146:0/2343181855 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe590066f30 0x7fe5900693e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe59c0058d0 tx=0x7fe59c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:07.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.349+0000 7fe5a17fa700 1 -- 172.21.15.146:0/2343181855 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe5a80b75a0 con 0x7fe5ac1595c0 2023-10-06T11:09:07.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.725+0000 7fe5b362c700 1 -- 172.21.15.146:0/2343181855 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe5ac04c380 con 0x7fe5ac1595c0 2023-10-06T11:09:07.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.726+0000 7fe5a17fa700 1 -- 172.21.15.146:0/2343181855 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4609 (secure 0 0 0) 0x7fe5a80530b0 con 0x7fe5ac1595c0 2023-10-06T11:09:07.728 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:09:07.728 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":36,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5248,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3360977916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3360977916},{"type":"v1","addr":"172.21.15.151:6834","nonce":3360977916}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5251,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2265934004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":2265934004},{"type":"v1","addr":"172.21.15.151:6835","nonce":2265934004}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2387575667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2387575667},{"type":"v1","addr":"172.21.15.146:6836","nonce":2387575667}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:08:42.797557+0000","modified":"2023-10-06T11:09:07.489130+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5481":{"gid":5481,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":9,"addr":"172.21.15.146:6837/2252184844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2252184844},{"type":"v1","addr":"172.21.15.146:6837","nonce":2252184844}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T11:09:07.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.728+0000 7fe5b362c700 1 -- 172.21.15.146:0/2343181855 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe590066f30 msgr2=0x7fe5900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:07.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.728+0000 7fe5b362c700 1 --2- 172.21.15.146:0/2343181855 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe590066f30 0x7fe5900693e0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe59c0058d0 tx=0x7fe59c009040 comp rx=0 tx=0).stop 2023-10-06T11:09:07.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.728+0000 7fe5b362c700 1 -- 172.21.15.146:0/2343181855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5ac1595c0 msgr2=0x7fe5ac1506d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:07.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.728+0000 7fe5b362c700 1 --2- 172.21.15.146:0/2343181855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5ac1595c0 0x7fe5ac1506d0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac06d2d0 tx=0x7fe5a8017000 comp rx=0 tx=0).stop 2023-10-06T11:09:07.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.728+0000 7fe5b362c700 1 -- 172.21.15.146:0/2343181855 shutdown_connections 2023-10-06T11:09:07.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.728+0000 7fe5b362c700 1 --2- 172.21.15.146:0/2343181855 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe590066f30 0x7fe5900693e0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:07.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.728+0000 7fe5b362c700 1 --2- 172.21.15.146:0/2343181855 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe5ac159990 0x7fe5ac15c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:07.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.728+0000 7fe5b362c700 1 --2- 172.21.15.146:0/2343181855 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5ac0aa1e0 0x7fe5ac1510e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:07.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.728+0000 7fe5b362c700 1 --2- 172.21.15.146:0/2343181855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe5ac1595c0 0x7fe5ac1506d0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:07.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.728+0000 7fe5b362c700 1 -- 172.21.15.146:0/2343181855 >> 172.21.15.146:0/2343181855 conn(0x7fe5ac0cd530 msgr2=0x7fe5ac0cc020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:07.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.728+0000 7fe5b362c700 1 -- 172.21.15.146:0/2343181855 shutdown_connections 2023-10-06T11:09:07.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:07.728+0000 7fe5b362c700 1 -- 172.21.15.146:0/2343181855 wait complete. 2023-10-06T11:09:07.731 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 36 2023-10-06T11:09:07.741 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok flush_path /scrub_test_path/ceph-qa-suite/new_dir_0 2023-10-06T11:09:07.864 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:09:07.864 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0 2023-10-06T11:09:07.864 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:09:07.874 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_0' got response code '0' and stdout '{ "return_code": 0 } ' 2023-10-06T11:09:07.875 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:09:07.875 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_0 bs=1M conv=fdatasync count=1 seek=0) 2023-10-06T11:09:07.904 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:09:07.904 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:09:07.905 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120447 s, 87.1 MB/s 2023-10-06T11:09:07.905 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_0' 2023-10-06T11:09:07.906 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:09:08.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.059+0000 7f43ce1cd700 1 Processor -- start 2023-10-06T11:09:08.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.059+0000 7f43ce1cd700 1 -- start start 2023-10-06T11:09:08.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.060+0000 7f43ce1cd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f43c815a7f0 0x7f43c815cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:08.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.060+0000 7f43ce1cd700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f43c80b2530 0x7f43c815acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:08.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.060+0000 7f43ce1cd700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43c815c630 con 0x7f43c815a420 2023-10-06T11:09:08.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.060+0000 7f43ce1cd700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43c80ce040 con 0x7f43c815a7f0 2023-10-06T11:09:08.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.060+0000 7f43ce1cd700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43c815ba20 con 0x7f43c80b2530 2023-10-06T11:09:08.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.060+0000 7f43cd1cb700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f43c815a420 0x7f43c80b1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38830/0 (socket says 172.21.15.146:38830) 2023-10-06T11:09:08.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.060+0000 7f43cd1cb700 1 -- 172.21.15.146:0/935529330 learned_addr learned my addr 172.21.15.146:0/935529330 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:08.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.060+0000 7f43cc9ca700 1 --2- 172.21.15.146:0/935529330 >> v2:172.21.15.146:3300/0 conn(0x7f43c815a7f0 0x7f43c815cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:08.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.060+0000 7f43cd9cc700 1 --2- 172.21.15.146:0/935529330 >> v2:172.21.15.151:3300/0 conn(0x7f43c80b2530 0x7f43c815acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:08.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.060+0000 7f43c7fff700 1 -- 172.21.15.146:0/935529330 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 724173645 0 0) 0x7f43c815c630 con 0x7f43c815a420 2023-10-06T11:09:08.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.060+0000 7f43c7fff700 1 -- 172.21.15.146:0/935529330 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43b0003570 con 0x7f43c815a420 2023-10-06T11:09:08.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.060+0000 7f43cc9ca700 1 -- 172.21.15.146:0/935529330 >> v2:172.21.15.151:3300/0 conn(0x7f43c80b2530 msgr2=0x7f43c815acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:08.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.060+0000 7f43cc9ca700 1 --2- 172.21.15.146:0/935529330 >> v2:172.21.15.151:3300/0 conn(0x7f43c80b2530 0x7f43c815acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.060+0000 7f43cc9ca700 1 -- 172.21.15.146:0/935529330 >> v1:172.21.15.146:6789/0 conn(0x7f43c815a420 legacy=0x7f43c80b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:08.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.060+0000 7f43cc9ca700 1 -- 172.21.15.146:0/935529330 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c815bd00 con 0x7f43c815a7f0 2023-10-06T11:09:08.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.060+0000 7f43cc9ca700 1 --2- 172.21.15.146:0/935529330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43c815a7f0 0x7f43c815cac0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f43c815c5a0 tx=0x7f43bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11ebe6ce654cb73a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:08.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.061+0000 7f43c7fff700 1 -- 172.21.15.146:0/935529330 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc011630 con 0x7f43c815a7f0 2023-10-06T11:09:08.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.061+0000 7f43c7fff700 1 -- 172.21.15.146:0/935529330 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43bc0117b0 con 0x7f43c815a7f0 2023-10-06T11:09:08.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.061+0000 7f43c7fff700 1 -- 172.21.15.146:0/935529330 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43bc011b70 con 0x7f43c815a7f0 2023-10-06T11:09:08.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.061+0000 7f43ce1cd700 1 -- 172.21.15.146:0/935529330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43c815a7f0 msgr2=0x7f43c815cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:08.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.061+0000 7f43ce1cd700 1 --2- 172.21.15.146:0/935529330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43c815a7f0 0x7f43c815cac0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f43c815c5a0 tx=0x7f43bc0091a0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.061+0000 7f43ce1cd700 1 -- 172.21.15.146:0/935529330 shutdown_connections 2023-10-06T11:09:08.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.061+0000 7f43ce1cd700 1 --2- 172.21.15.146:0/935529330 >> v2:172.21.15.151:3300/0 conn(0x7f43c80b2530 0x7f43c815acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.061+0000 7f43ce1cd700 1 --2- 172.21.15.146:0/935529330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43c815a7f0 0x7f43c815cac0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.061+0000 7f43ce1cd700 1 -- 172.21.15.146:0/935529330 >> 172.21.15.146:0/935529330 conn(0x7f43c806eba0 msgr2=0x7f43c806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:08.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.061+0000 7f43ce1cd700 1 -- 172.21.15.146:0/935529330 shutdown_connections 2023-10-06T11:09:08.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.061+0000 7f43ce1cd700 1 -- 172.21.15.146:0/935529330 wait complete. 2023-10-06T11:09:08.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.062+0000 7f43ce1cd700 1 Processor -- start 2023-10-06T11:09:08.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.062+0000 7f43ce1cd700 1 -- start start 2023-10-06T11:09:08.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.063+0000 7f43ce1cd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43c80b2530 0x7f43c813b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:08.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.063+0000 7f43ce1cd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43c815a420 0x7f43c81538d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:08.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.063+0000 7f43ce1cd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43c815a7f0 0x7f43c80d0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:08.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.063+0000 7f43ce1cd700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c8153440 con 0x7f43c815a7f0 2023-10-06T11:09:08.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.063+0000 7f43ce1cd700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c813beb0 con 0x7f43c80b2530 2023-10-06T11:09:08.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.063+0000 7f43ce1cd700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43c8152b10 con 0x7f43c815a420 2023-10-06T11:09:08.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.063+0000 7f43cd9cc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43c815a7f0 0x7f43c80d0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:08.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.063+0000 7f43cd9cc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43c815a7f0 0x7f43c80d0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49206/0 (socket says 172.21.15.146:49206) 2023-10-06T11:09:08.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.063+0000 7f43cd9cc700 1 -- 172.21.15.146:0/2757200709 learned_addr learned my addr 172.21.15.146:0/2757200709 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:08.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.064+0000 7f43cd1cb700 1 --2- 172.21.15.146:0/2757200709 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43c80b2530 0x7f43c813b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:08.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.064+0000 7f43cc9ca700 1 --2- 172.21.15.146:0/2757200709 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43c815a420 0x7f43c81538d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:08.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.064+0000 7f43cd9cc700 1 -- 172.21.15.146:0/2757200709 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43c815a420 msgr2=0x7f43c81538d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:08.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.064+0000 7f43cd9cc700 1 --2- 172.21.15.146:0/2757200709 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43c815a420 0x7f43c81538d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.064+0000 7f43cd9cc700 1 -- 172.21.15.146:0/2757200709 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43c80b2530 msgr2=0x7f43c813b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:08.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.064+0000 7f43cd9cc700 1 --2- 172.21.15.146:0/2757200709 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43c80b2530 0x7f43c813b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.064+0000 7f43cd9cc700 1 -- 172.21.15.146:0/2757200709 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43bc009420 con 0x7f43c815a7f0 2023-10-06T11:09:08.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.064+0000 7f43cc9ca700 1 --2- 172.21.15.146:0/2757200709 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43c815a420 0x7f43c81538d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:09:08.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.064+0000 7f43cd1cb700 1 --2- 172.21.15.146:0/2757200709 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43c80b2530 0x7f43c813b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:09:08.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.064+0000 7f43cd9cc700 1 --2- 172.21.15.146:0/2757200709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43c815a7f0 0x7f43c80d0450 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f43b800ea50 tx=0x7f43b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:08.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.064+0000 7f43c57fa700 1 -- 172.21.15.146:0/2757200709 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b800c8c0 con 0x7f43c815a7f0 2023-10-06T11:09:08.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.064+0000 7f43c57fa700 1 -- 172.21.15.146:0/2757200709 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43b800ca40 con 0x7f43c815a7f0 2023-10-06T11:09:08.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.064+0000 7f43ce1cd700 1 -- 172.21.15.146:0/2757200709 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c8152df0 con 0x7f43c815a7f0 2023-10-06T11:09:08.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.064+0000 7f43c57fa700 1 -- 172.21.15.146:0/2757200709 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43b800ce00 con 0x7f43c815a7f0 2023-10-06T11:09:08.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.064+0000 7f43ce1cd700 1 -- 172.21.15.146:0/2757200709 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c8153e10 con 0x7f43c815a7f0 2023-10-06T11:09:08.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.065+0000 7f43ce1cd700 1 -- 172.21.15.146:0/2757200709 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43c81535b0 con 0x7f43c815a7f0 2023-10-06T11:09:08.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.065+0000 7f43c57fa700 1 -- 172.21.15.146:0/2757200709 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f43b8013680 con 0x7f43c815a7f0 2023-10-06T11:09:08.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.066+0000 7f43c57fa700 1 --2- 172.21.15.146:0/2757200709 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f43b4066f30 0x7f43b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:08.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.066+0000 7f43c57fa700 1 -- 172.21.15.146:0/2757200709 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f43b8084ab0 con 0x7f43c815a7f0 2023-10-06T11:09:08.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.066+0000 7f43cd1cb700 1 --2- 172.21.15.146:0/2757200709 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f43b4066f30 0x7f43b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:08.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.066+0000 7f43cd1cb700 1 --2- 172.21.15.146:0/2757200709 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f43b4066f30 0x7f43b40693e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f43c0005c50 tx=0x7f43c0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:08.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.070+0000 7f43c57fa700 1 -- 172.21.15.146:0/2757200709 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f43b8051bc0 con 0x7f43c815a7f0 2023-10-06T11:09:08.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.298+0000 7f43ce1cd700 1 -- 172.21.15.146:0/2757200709 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f43c80afae0 con 0x7f43c815a7f0 2023-10-06T11:09:08.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.299+0000 7f43c57fa700 1 -- 172.21.15.146:0/2757200709 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4609 (secure 0 0 0) 0x7f43b80551e0 con 0x7f43c815a7f0 2023-10-06T11:09:08.300 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:09:08.301 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":36,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5248,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3360977916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3360977916},{"type":"v1","addr":"172.21.15.151:6834","nonce":3360977916}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5251,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2265934004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":2265934004},{"type":"v1","addr":"172.21.15.151:6835","nonce":2265934004}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2387575667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2387575667},{"type":"v1","addr":"172.21.15.146:6836","nonce":2387575667}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:08:42.797557+0000","modified":"2023-10-06T11:09:07.489130+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5481":{"gid":5481,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":9,"addr":"172.21.15.146:6837/2252184844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2252184844},{"type":"v1","addr":"172.21.15.146:6837","nonce":2252184844}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T11:09:08.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.301+0000 7f43ce1cd700 1 -- 172.21.15.146:0/2757200709 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f43b4066f30 msgr2=0x7f43b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:08.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.301+0000 7f43ce1cd700 1 --2- 172.21.15.146:0/2757200709 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f43b4066f30 0x7f43b40693e0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f43c0005c50 tx=0x7f43c0009040 comp rx=0 tx=0).stop 2023-10-06T11:09:08.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.301+0000 7f43ce1cd700 1 -- 172.21.15.146:0/2757200709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43c815a7f0 msgr2=0x7f43c80d0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:08.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.301+0000 7f43ce1cd700 1 --2- 172.21.15.146:0/2757200709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43c815a7f0 0x7f43c80d0450 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f43b800ea50 tx=0x7f43b80091a0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.301+0000 7f43ce1cd700 1 -- 172.21.15.146:0/2757200709 shutdown_connections 2023-10-06T11:09:08.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.301+0000 7f43ce1cd700 1 --2- 172.21.15.146:0/2757200709 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f43b4066f30 0x7f43b40693e0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.301+0000 7f43ce1cd700 1 --2- 172.21.15.146:0/2757200709 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43c815a7f0 0x7f43c80d0450 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.301+0000 7f43ce1cd700 1 --2- 172.21.15.146:0/2757200709 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43c80b2530 0x7f43c813b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.301+0000 7f43ce1cd700 1 --2- 172.21.15.146:0/2757200709 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43c815a420 0x7f43c81538d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.301+0000 7f43ce1cd700 1 -- 172.21.15.146:0/2757200709 >> 172.21.15.146:0/2757200709 conn(0x7f43c806eba0 msgr2=0x7f43c814d930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:08.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.301+0000 7f43ce1cd700 1 -- 172.21.15.146:0/2757200709 shutdown_connections 2023-10-06T11:09:08.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.301+0000 7f43ce1cd700 1 -- 172.21.15.146:0/2757200709 wait complete. 2023-10-06T11:09:08.304 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 36 2023-10-06T11:09:08.315 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok flush_path /scrub_test_path/ceph-qa-suite/new_file_0 2023-10-06T11:09:08.467 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:09:08.467 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0 2023-10-06T11:09:08.467 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:09:08.478 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_0' got response code '0' and stdout '{ "return_code": 0 } ' 2023-10-06T11:09:08.478 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T11:09:08.478 DEBUG:teuthology.orchestra.run.smithi146:> import os 2023-10-06T11:09:08.478 DEBUG:teuthology.orchestra.run.smithi146:> import stat 2023-10-06T11:09:08.478 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:09:08.479 DEBUG:teuthology.orchestra.run.smithi146:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_0").st_ino) 2023-10-06T11:09:08.479 DEBUG:teuthology.orchestra.run.smithi146:> ' 2023-10-06T11:09:08.545 INFO:teuthology.orchestra.run.smithi146.stdout:1099511630406 2023-10-06T11:09:08.733 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2023-10-06T11:09:08.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.893+0000 7f9e6f2fc700 1 Processor -- start 2023-10-06T11:09:08.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.893+0000 7f9e6f2fc700 1 -- start start 2023-10-06T11:09:08.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.894+0000 7f9e6f2fc700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e6815cff0 0x7f9e6815d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:08.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.894+0000 7f9e6f2fc700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9e680d0c50 0x7f9e6815a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:08.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.894+0000 7f9e6f2fc700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e680cf030 con 0x7f9e6815cc20 2023-10-06T11:09:08.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.894+0000 7f9e6f2fc700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e6815e390 con 0x7f9e680d0c50 2023-10-06T11:09:08.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.894+0000 7f9e6f2fc700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e680ced20 con 0x7f9e6815cff0 2023-10-06T11:09:08.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.894+0000 7f9e6c897700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e6815cff0 0x7f9e6815d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:08.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.894+0000 7f9e6d899700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9e680d0c50 0x7f9e6815a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:08.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.894+0000 7f9e6d098700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f9e6815cc20 0x7f9e680d0540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:45004/0 (socket says 172.21.15.146:45004) 2023-10-06T11:09:08.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.894+0000 7f9e6d098700 1 -- 172.21.15.146:0/398052586 learned_addr learned my addr 172.21.15.146:0/398052586 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:08.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.894+0000 7f9e5ffff700 1 -- 172.21.15.146:0/398052586 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 767874199 0 0) 0x7f9e680cf030 con 0x7f9e6815cc20 2023-10-06T11:09:08.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.894+0000 7f9e5ffff700 1 -- 172.21.15.146:0/398052586 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e54003570 con 0x7f9e6815cc20 2023-10-06T11:09:08.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.894+0000 7f9e6c897700 1 -- 172.21.15.146:0/398052586 >> v2:172.21.15.151:3300/0 conn(0x7f9e680d0c50 msgr2=0x7f9e6815a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:08.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.894+0000 7f9e6c897700 1 --2- 172.21.15.146:0/398052586 >> v2:172.21.15.151:3300/0 conn(0x7f9e680d0c50 0x7f9e6815a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.894+0000 7f9e6c897700 1 -- 172.21.15.146:0/398052586 >> v1:172.21.15.151:6789/0 conn(0x7f9e6815cc20 legacy=0x7f9e680d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:08.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.894+0000 7f9e6c897700 1 -- 172.21.15.146:0/398052586 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e6815daf0 con 0x7f9e6815cff0 2023-10-06T11:09:08.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.894+0000 7f9e6d899700 1 --2- 172.21.15.146:0/398052586 >> v2:172.21.15.151:3300/0 conn(0x7f9e680d0c50 0x7f9e6815a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:09:08.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.895+0000 7f9e6c897700 1 --2- 172.21.15.146:0/398052586 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e6815cff0 0x7f9e6815d460 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9e580098e0 tx=0x7f9e580091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c29ce31289a645b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:08.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.895+0000 7f9e5ffff700 1 -- 172.21.15.146:0/398052586 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e58011630 con 0x7f9e6815cff0 2023-10-06T11:09:08.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.895+0000 7f9e5ffff700 1 -- 172.21.15.146:0/398052586 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e58011790 con 0x7f9e6815cff0 2023-10-06T11:09:08.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.895+0000 7f9e5ffff700 1 -- 172.21.15.146:0/398052586 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e58011b30 con 0x7f9e6815cff0 2023-10-06T11:09:08.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.895+0000 7f9e6f2fc700 1 -- 172.21.15.146:0/398052586 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e6815cff0 msgr2=0x7f9e6815d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:08.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.895+0000 7f9e6f2fc700 1 --2- 172.21.15.146:0/398052586 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e6815cff0 0x7f9e6815d460 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9e580098e0 tx=0x7f9e580091a0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.895+0000 7f9e6f2fc700 1 -- 172.21.15.146:0/398052586 shutdown_connections 2023-10-06T11:09:08.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.895+0000 7f9e6f2fc700 1 --2- 172.21.15.146:0/398052586 >> v2:172.21.15.151:3300/0 conn(0x7f9e680d0c50 0x7f9e6815a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.895+0000 7f9e6f2fc700 1 --2- 172.21.15.146:0/398052586 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e6815cff0 0x7f9e6815d460 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.895+0000 7f9e6f2fc700 1 -- 172.21.15.146:0/398052586 >> 172.21.15.146:0/398052586 conn(0x7f9e6806eba0 msgr2=0x7f9e6806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:08.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.895+0000 7f9e6f2fc700 1 -- 172.21.15.146:0/398052586 shutdown_connections 2023-10-06T11:09:08.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.895+0000 7f9e6f2fc700 1 -- 172.21.15.146:0/398052586 wait complete. 2023-10-06T11:09:08.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.896+0000 7f9e6f2fc700 1 Processor -- start 2023-10-06T11:09:08.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.896+0000 7f9e6f2fc700 1 -- start start 2023-10-06T11:09:08.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.897+0000 7f9e6f2fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e680d0c50 0x7f9e68142fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:08.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.897+0000 7f9e6f2fc700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e6815cc20 0x7f9e680b1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:08.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.897+0000 7f9e6f2fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e6815cff0 0x7f9e680b2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:08.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.897+0000 7f9e6f2fc700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e68150970 con 0x7f9e6815cff0 2023-10-06T11:09:08.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.897+0000 7f9e6f2fc700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6814f680 con 0x7f9e680d0c50 2023-10-06T11:09:08.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.897+0000 7f9e6f2fc700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e681504e0 con 0x7f9e6815cc20 2023-10-06T11:09:08.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.897+0000 7f9e6d899700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e6815cff0 0x7f9e680b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:08.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.897+0000 7f9e6d899700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e6815cff0 0x7f9e680b2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49218/0 (socket says 172.21.15.146:49218) 2023-10-06T11:09:08.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.897+0000 7f9e6d899700 1 -- 172.21.15.146:0/1968430043 learned_addr learned my addr 172.21.15.146:0/1968430043 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:08.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.898+0000 7f9e6c897700 1 --2- 172.21.15.146:0/1968430043 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e6815cc20 0x7f9e680b1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:08.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.898+0000 7f9e6d098700 1 --2- 172.21.15.146:0/1968430043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e680d0c50 0x7f9e68142fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:08.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.898+0000 7f9e6d899700 1 -- 172.21.15.146:0/1968430043 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e6815cc20 msgr2=0x7f9e680b1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:08.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.898+0000 7f9e6d899700 1 --2- 172.21.15.146:0/1968430043 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e6815cc20 0x7f9e680b1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.898+0000 7f9e6d899700 1 -- 172.21.15.146:0/1968430043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e680d0c50 msgr2=0x7f9e68142fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:08.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.898+0000 7f9e6d899700 1 --2- 172.21.15.146:0/1968430043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e680d0c50 0x7f9e68142fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.898+0000 7f9e6d899700 1 -- 172.21.15.146:0/1968430043 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e60009a20 con 0x7f9e6815cff0 2023-10-06T11:09:08.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.898+0000 7f9e6d899700 1 --2- 172.21.15.146:0/1968430043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e6815cff0 0x7f9e680b2240 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f9e60009f90 tx=0x7f9e6000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:08.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.898+0000 7f9e5d7fa700 1 -- 172.21.15.146:0/1968430043 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6000cd30 con 0x7f9e6815cff0 2023-10-06T11:09:08.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.898+0000 7f9e5d7fa700 1 -- 172.21.15.146:0/1968430043 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e6000f040 con 0x7f9e6815cff0 2023-10-06T11:09:08.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.898+0000 7f9e6f2fc700 1 -- 172.21.15.146:0/1968430043 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e58009420 con 0x7f9e6815cff0 2023-10-06T11:09:08.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.898+0000 7f9e5d7fa700 1 -- 172.21.15.146:0/1968430043 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e600146d0 con 0x7f9e6815cff0 2023-10-06T11:09:08.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.898+0000 7f9e6f2fc700 1 -- 172.21.15.146:0/1968430043 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e6814fbb0 con 0x7f9e6815cff0 2023-10-06T11:09:08.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.900+0000 7f9e5d7fa700 1 -- 172.21.15.146:0/1968430043 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9e60003020 con 0x7f9e6815cff0 2023-10-06T11:09:08.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.900+0000 7f9e5d7fa700 1 --2- 172.21.15.146:0/1968430043 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9e4c066f30 0x7f9e4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:08.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.900+0000 7f9e5d7fa700 1 -- 172.21.15.146:0/1968430043 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9e60085110 con 0x7f9e6815cff0 2023-10-06T11:09:08.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.900+0000 7f9e6d098700 1 --2- 172.21.15.146:0/1968430043 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9e4c066f30 0x7f9e4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:08.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.901+0000 7f9e6d098700 1 --2- 172.21.15.146:0/1968430043 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9e4c066f30 0x7f9e4c0693e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9e64005920 tx=0x7f9e64009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:08.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.902+0000 7f9e785f4b80 1 Processor -- start 2023-10-06T11:09:08.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.902+0000 7f9e785f4b80 1 -- start start 2023-10-06T11:09:08.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.903+0000 7f9e785f4b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eea1f5eae0 0x55eea1f5eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:08.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.903+0000 7f9e785f4b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55eea1f1a9f0 0x55eea1f175d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:08.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.903+0000 7f9e785f4b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eea1f18c20 0x55eea1f17b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:08.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.903+0000 7f9e785f4b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eea1e97cd0 con 0x55eea1f18c20 2023-10-06T11:09:08.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.903+0000 7f9e785f4b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eea1e6eac0 con 0x55eea1f5eae0 2023-10-06T11:09:08.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.903+0000 7f9e785f4b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eea1e6c2c0 con 0x55eea1f1a9f0 2023-10-06T11:09:08.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.903+0000 7f9e6d899700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eea1f18c20 0x55eea1f17b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:08.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.903+0000 7f9e6d899700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eea1f18c20 0x55eea1f17b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49232/0 (socket says 172.21.15.146:49232) 2023-10-06T11:09:08.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.903+0000 7f9e6d899700 1 -- 172.21.15.146:0/4212712812 learned_addr learned my addr 172.21.15.146:0/4212712812 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:08.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.903+0000 7f9e6d098700 1 --2- 172.21.15.146:0/4212712812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eea1f5eae0 0x55eea1f5eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:08.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.903+0000 7f9e6c897700 1 --2- 172.21.15.146:0/4212712812 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55eea1f1a9f0 0x55eea1f175d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:08.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.903+0000 7f9e6d899700 1 -- 172.21.15.146:0/4212712812 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55eea1f1a9f0 msgr2=0x55eea1f175d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:08.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.903+0000 7f9e6d899700 1 --2- 172.21.15.146:0/4212712812 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55eea1f1a9f0 0x55eea1f175d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.903+0000 7f9e6d899700 1 -- 172.21.15.146:0/4212712812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eea1f5eae0 msgr2=0x55eea1f5eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:08.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.903+0000 7f9e6d899700 1 --2- 172.21.15.146:0/4212712812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eea1f5eae0 0x55eea1f5eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.903+0000 7f9e6d899700 1 -- 172.21.15.146:0/4212712812 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eea1d022c0 con 0x55eea1f18c20 2023-10-06T11:09:08.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.903+0000 7f9e6d899700 1 --2- 172.21.15.146:0/4212712812 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eea1f18c20 0x55eea1f17b10 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f9e600834d0 tx=0x7f9e60083430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89e24d822916468e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:08.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.903+0000 7f9e527fc700 1 -- 172.21.15.146:0/4212712812 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e60056660 con 0x55eea1f18c20 2023-10-06T11:09:08.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.903+0000 7f9e527fc700 1 -- 172.21.15.146:0/4212712812 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e60055ee0 con 0x55eea1f18c20 2023-10-06T11:09:08.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.903+0000 7f9e527fc700 1 -- 172.21.15.146:0/4212712812 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e60059130 con 0x55eea1f18c20 2023-10-06T11:09:08.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.904+0000 7f9e785f4b80 1 -- 172.21.15.146:0/4212712812 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eea1f18c20 msgr2=0x55eea1f17b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:08.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.904+0000 7f9e785f4b80 1 --2- 172.21.15.146:0/4212712812 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eea1f18c20 0x55eea1f17b10 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f9e600834d0 tx=0x7f9e60083430 comp rx=0 tx=0).stop 2023-10-06T11:09:08.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.904+0000 7f9e785f4b80 1 -- 172.21.15.146:0/4212712812 shutdown_connections 2023-10-06T11:09:08.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.904+0000 7f9e785f4b80 1 --2- 172.21.15.146:0/4212712812 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eea1f18c20 0x55eea1f17b10 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.904+0000 7f9e785f4b80 1 --2- 172.21.15.146:0/4212712812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eea1f5eae0 0x55eea1f5eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.904+0000 7f9e785f4b80 1 --2- 172.21.15.146:0/4212712812 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55eea1f1a9f0 0x55eea1f175d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.904+0000 7f9e785f4b80 1 -- 172.21.15.146:0/4212712812 >> 172.21.15.146:0/4212712812 conn(0x55eea1f190c0 msgr2=0x55eea1f19490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:08.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.904+0000 7f9e785f4b80 1 -- 172.21.15.146:0/4212712812 shutdown_connections 2023-10-06T11:09:08.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.904+0000 7f9e785f4b80 1 -- 172.21.15.146:0/4212712812 wait complete. 2023-10-06T11:09:08.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.905+0000 7f9e785f4b80 1 -- start start 2023-10-06T11:09:08.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.905+0000 7f9e785f4b80 1 Processor -- start 2023-10-06T11:09:08.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.906+0000 7f9e785f4b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55eea1f18c20 0x55eea1f3db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:08.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.906+0000 7f9e785f4b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eea1f1a9f0 0x55eea1f12790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:08.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.906+0000 7f9e785f4b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eea1f5eae0 0x55eea1f12cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:08.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.906+0000 7f9e785f4b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eea1e680b0 con 0x55eea1f5eae0 2023-10-06T11:09:08.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.906+0000 7f9e785f4b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eea1e138e0 con 0x55eea1f1a9f0 2023-10-06T11:09:08.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.906+0000 7f9e785f4b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eea1e2eef0 con 0x55eea1f18c20 2023-10-06T11:09:08.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.906+0000 7f9e785f4b80 10 client.0 _ll_register_callbacks cb 0x55eea1d04f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:09:08.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.906+0000 7f9e6d899700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eea1f5eae0 0x55eea1f12cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:08.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.906+0000 7f9e6d899700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eea1f5eae0 0x55eea1f12cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49244/0 (socket says 172.21.15.146:49244) 2023-10-06T11:09:08.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.906+0000 7f9e6d899700 1 -- 172.21.15.146:0/562188228 learned_addr learned my addr 172.21.15.146:0/562188228 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:08.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.906+0000 7f9e6c897700 1 --2- 172.21.15.146:0/562188228 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eea1f1a9f0 0x55eea1f12790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:08.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.906+0000 7f9e6d098700 1 --2- 172.21.15.146:0/562188228 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55eea1f18c20 0x55eea1f3db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:08.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.906+0000 7f9e6d899700 1 -- 172.21.15.146:0/562188228 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55eea1f18c20 msgr2=0x55eea1f3db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:08.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.906+0000 7f9e6d899700 1 --2- 172.21.15.146:0/562188228 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55eea1f18c20 0x55eea1f3db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.906+0000 7f9e6d899700 1 -- 172.21.15.146:0/562188228 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eea1f1a9f0 msgr2=0x55eea1f12790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:08.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.906+0000 7f9e6d899700 1 --2- 172.21.15.146:0/562188228 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eea1f1a9f0 0x55eea1f12790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.906+0000 7f9e6d899700 1 -- 172.21.15.146:0/562188228 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e6814fbb0 con 0x55eea1f5eae0 2023-10-06T11:09:08.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.906+0000 7f9e6d899700 1 --2- 172.21.15.146:0/562188228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eea1f5eae0 0x55eea1f12cd0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f9e60059010 tx=0x7f9e6006a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8222284318a91de server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:08.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.906+0000 7f9e477fe700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:09:08.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.906+0000 7f9e477fe700 1 -- 172.21.15.146:0/562188228 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e600832d0 con 0x55eea1f5eae0 2023-10-06T11:09:08.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.906+0000 7f9e477fe700 1 -- 172.21.15.146:0/562188228 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9e60059130 con 0x55eea1f5eae0 2023-10-06T11:09:08.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.906+0000 7f9e785f4b80 1 -- 172.21.15.146:0/562188228 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55eea1f0c6e0 con 0x55eea1f5eae0 2023-10-06T11:09:08.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.906+0000 7f9e477fe700 1 -- 172.21.15.146:0/562188228 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e6006c310 con 0x55eea1f5eae0 2023-10-06T11:09:08.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.906+0000 7f9e785f4b80 10 client.5796 fetch_fsmap learned FSMap version 36 2023-10-06T11:09:08.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.906+0000 7f9e785f4b80 1 -- 172.21.15.146:0/562188228 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x55eea1ca5030 con 0x55eea1f5eae0 2023-10-06T11:09:08.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.907+0000 7f9e477fe700 1 -- 172.21.15.146:0/562188228 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55eea1f0c6e0 con 0x55eea1f5eae0 2023-10-06T11:09:08.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.907+0000 7f9e477fe700 1 -- 172.21.15.146:0/562188228 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 36) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9e600682f0 con 0x55eea1f5eae0 2023-10-06T11:09:08.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.907+0000 7f9e785f4b80 10 client.5796 fetch_fsmap finished waiting for FSMap version 36 2023-10-06T11:09:08.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.907+0000 7f9e785f4b80 10 client.5796 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-10-06T11:09:08.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.907+0000 7f9e785f4b80 20 client.5796 populate_metadata read hostname 'smithi146' 2023-10-06T11:09:08.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.907+0000 7f9e785f4b80 1 --2- 172.21.15.146:0/562188228 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55eea1f44000 0x55eea1f46ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:08.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.907+0000 7f9e785f4b80 4 client.5796 mds_command: new command op to 5481 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:09:08.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.907+0000 7f9e785f4b80 1 -- 172.21.15.146:0/562188228 --> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55eea1ee9610 con 0x55eea1f44000 2023-10-06T11:09:08.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.907+0000 7f9e6d098700 1 --2- 172.21.15.146:0/562188228 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55eea1f44000 0x55eea1f46ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:08.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.907+0000 7f9e477fe700 10 client.5796 ms_handle_connect on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:08.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.907+0000 7f9e6d098700 1 --2- 172.21.15.146:0/562188228 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55eea1f44000 0x55eea1f46ab0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=feb32f8bd12439dd server_cookie=e8761fef248048ab in_seq=0 out_seq=0 2023-10-06T11:09:08.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.908+0000 7f9e477fe700 1 -- 172.21.15.146:0/562188228 <== mds.0 v2:172.21.15.146:6835/2252184844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55eea1ee9610 con 0x55eea1f44000 2023-10-06T11:09:08.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.908+0000 7f9e477fe700 10 client.5796 handle_command_reply: tid=0 2023-10-06T11:09:08.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.908+0000 7f9e785f4b80 1 client.5796 shutdown 2023-10-06T11:09:08.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.908+0000 7f9e785f4b80 1 -- 172.21.15.146:0/562188228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eea1f5eae0 msgr2=0x55eea1f12cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:08.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.908+0000 7f9e785f4b80 1 --2- 172.21.15.146:0/562188228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eea1f5eae0 0x55eea1f12cd0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f9e60059010 tx=0x7f9e6006a000 comp rx=0 tx=0).stop 2023-10-06T11:09:08.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.908+0000 7f9e785f4b80 1 -- 172.21.15.146:0/562188228 shutdown_connections 2023-10-06T11:09:08.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.908+0000 7f9e785f4b80 1 --2- 172.21.15.146:0/562188228 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55eea1f44000 0x55eea1f46ab0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.908+0000 7f9e785f4b80 1 --2- 172.21.15.146:0/562188228 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eea1f5eae0 0x55eea1f12cd0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.908+0000 7f9e477fe700 0 client.5796 ms_handle_reset on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:08.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.908+0000 7f9e785f4b80 1 --2- 172.21.15.146:0/562188228 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55eea1f18c20 0x55eea1f3db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.908+0000 7f9e785f4b80 1 --2- 172.21.15.146:0/562188228 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eea1f1a9f0 0x55eea1f12790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.908+0000 7f9e785f4b80 1 -- 172.21.15.146:0/562188228 >> 172.21.15.146:0/562188228 conn(0x55eea1f190c0 msgr2=0x55eea1f14740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:08.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.908+0000 7f9e785f4b80 1 -- 172.21.15.146:0/562188228 shutdown_connections 2023-10-06T11:09:08.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.908+0000 7f9e785f4b80 1 -- 172.21.15.146:0/562188228 wait complete. 2023-10-06T11:09:08.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.908+0000 7f9e785f4b80 20 client.5796 trim_cache size 0 max 16384 2023-10-06T11:09:08.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.920+0000 7f9e785f4b80 1 Processor -- start 2023-10-06T11:09:08.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.920+0000 7f9e785f4b80 1 -- start start 2023-10-06T11:09:08.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.921+0000 7f9e785f4b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eea1f18c20 0x55eea1f416c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:08.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.921+0000 7f9e785f4b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55eea1f1a9f0 0x55eea1f41c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:08.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.921+0000 7f9e785f4b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eea1f5eae0 0x55eea1f5aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:08.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.921+0000 7f9e785f4b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eea1ceae80 con 0x55eea1f5eae0 2023-10-06T11:09:08.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.921+0000 7f9e785f4b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eea1f6d500 con 0x55eea1f18c20 2023-10-06T11:09:08.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.921+0000 7f9e785f4b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eea1f42d70 con 0x55eea1f1a9f0 2023-10-06T11:09:08.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.921+0000 7f9e6c897700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55eea1f1a9f0 0x55eea1f41c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:08.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.921+0000 7f9e6c897700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55eea1f1a9f0 0x55eea1f41c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:46068/0 (socket says 172.21.15.146:46068) 2023-10-06T11:09:08.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.921+0000 7f9e6d098700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eea1f18c20 0x55eea1f416c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:08.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.921+0000 7f9e6c897700 1 -- 172.21.15.146:0/2854705016 learned_addr learned my addr 172.21.15.146:0/2854705016 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:08.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.922+0000 7f9e6d899700 1 --2- 172.21.15.146:0/2854705016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eea1f5eae0 0x55eea1f5aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:08.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.922+0000 7f9e6c897700 1 -- 172.21.15.146:0/2854705016 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eea1f18c20 msgr2=0x55eea1f416c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:08.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.922+0000 7f9e6c897700 1 --2- 172.21.15.146:0/2854705016 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eea1f18c20 0x55eea1f416c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.922+0000 7f9e6c897700 1 -- 172.21.15.146:0/2854705016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eea1f5eae0 msgr2=0x55eea1f5aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:08.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.922+0000 7f9e6c897700 1 --2- 172.21.15.146:0/2854705016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eea1f5eae0 0x55eea1f5aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.922+0000 7f9e6c897700 1 -- 172.21.15.146:0/2854705016 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eea1f102f0 con 0x55eea1f1a9f0 2023-10-06T11:09:08.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.922+0000 7f9e6d899700 1 --2- 172.21.15.146:0/2854705016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eea1f5eae0 0x55eea1f5aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:09:08.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.922+0000 7f9e6c897700 1 --2- 172.21.15.146:0/2854705016 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55eea1f1a9f0 0x55eea1f41c00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9e58011ee0 tx=0x7f9e58017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d2881d088248d83 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:08.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.922+0000 7f9e52ffd700 1 -- 172.21.15.146:0/2854705016 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e58020070 con 0x55eea1f1a9f0 2023-10-06T11:09:08.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.922+0000 7f9e52ffd700 1 -- 172.21.15.146:0/2854705016 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e58021040 con 0x55eea1f1a9f0 2023-10-06T11:09:08.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.922+0000 7f9e52ffd700 1 -- 172.21.15.146:0/2854705016 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e58000c90 con 0x55eea1f1a9f0 2023-10-06T11:09:08.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.923+0000 7f9e785f4b80 1 -- 172.21.15.146:0/2854705016 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55eea1f1a9f0 msgr2=0x55eea1f41c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:08.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.923+0000 7f9e785f4b80 1 --2- 172.21.15.146:0/2854705016 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55eea1f1a9f0 0x55eea1f41c00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9e58011ee0 tx=0x7f9e58017000 comp rx=0 tx=0).stop 2023-10-06T11:09:08.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.923+0000 7f9e785f4b80 1 -- 172.21.15.146:0/2854705016 shutdown_connections 2023-10-06T11:09:08.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.923+0000 7f9e785f4b80 1 --2- 172.21.15.146:0/2854705016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eea1f5eae0 0x55eea1f5aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.923+0000 7f9e785f4b80 1 --2- 172.21.15.146:0/2854705016 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eea1f18c20 0x55eea1f416c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.923+0000 7f9e785f4b80 1 --2- 172.21.15.146:0/2854705016 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55eea1f1a9f0 0x55eea1f41c00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.923+0000 7f9e785f4b80 1 -- 172.21.15.146:0/2854705016 >> 172.21.15.146:0/2854705016 conn(0x55eea1f190c0 msgr2=0x55eea1f175d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:08.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.923+0000 7f9e785f4b80 1 -- 172.21.15.146:0/2854705016 shutdown_connections 2023-10-06T11:09:08.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.923+0000 7f9e785f4b80 1 -- 172.21.15.146:0/2854705016 wait complete. 2023-10-06T11:09:08.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.924+0000 7f9e785f4b80 1 -- start start 2023-10-06T11:09:08.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.924+0000 7f9e785f4b80 1 Processor -- start 2023-10-06T11:09:08.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.925+0000 7f9e785f4b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eea1f18c20 0x55eea1f19490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:08.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.925+0000 7f9e785f4b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eea1f1a9f0 0x55eea1fbcfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:08.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.925+0000 7f9e785f4b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55eea1f5eae0 0x55eea1f46df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:08.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.925+0000 7f9e785f4b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eea1f19c50 con 0x55eea1f18c20 2023-10-06T11:09:08.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.925+0000 7f9e785f4b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eea1fc67b0 con 0x55eea1f1a9f0 2023-10-06T11:09:08.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.925+0000 7f9e785f4b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eea1f3c400 con 0x55eea1f5eae0 2023-10-06T11:09:08.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.925+0000 7f9e785f4b80 10 client.0 _ll_register_callbacks cb 0x55eea1f3e0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:09:08.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.926+0000 7f9e6d098700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eea1f18c20 0x55eea1f19490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:08.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.926+0000 7f9e6d098700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eea1f18c20 0x55eea1f19490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49260/0 (socket says 172.21.15.146:49260) 2023-10-06T11:09:08.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.926+0000 7f9e6d098700 1 -- 172.21.15.146:0/2404411864 learned_addr learned my addr 172.21.15.146:0/2404411864 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:08.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.926+0000 7f9e6c897700 1 --2- 172.21.15.146:0/2404411864 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eea1f1a9f0 0x55eea1fbcfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:08.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.926+0000 7f9e6d899700 1 --2- 172.21.15.146:0/2404411864 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55eea1f5eae0 0x55eea1f46df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:08.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.926+0000 7f9e6d098700 1 -- 172.21.15.146:0/2404411864 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55eea1f5eae0 msgr2=0x55eea1f46df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:08.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.926+0000 7f9e6d098700 1 --2- 172.21.15.146:0/2404411864 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55eea1f5eae0 0x55eea1f46df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.926+0000 7f9e6d098700 1 -- 172.21.15.146:0/2404411864 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eea1f1a9f0 msgr2=0x55eea1fbcfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:08.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.926+0000 7f9e6d098700 1 --2- 172.21.15.146:0/2404411864 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eea1f1a9f0 0x55eea1fbcfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.926+0000 7f9e6d098700 1 -- 172.21.15.146:0/2404411864 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e6815daf0 con 0x55eea1f18c20 2023-10-06T11:09:08.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.926+0000 7f9e6d098700 1 --2- 172.21.15.146:0/2404411864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eea1f18c20 0x55eea1f19490 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9e64001f20 tx=0x7f9e64027040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f051310283903add server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:08.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.926+0000 7f9e477fe700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:09:08.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.926+0000 7f9e477fe700 1 -- 172.21.15.146:0/2404411864 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e64007350 con 0x55eea1f18c20 2023-10-06T11:09:08.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.926+0000 7f9e785f4b80 1 -- 172.21.15.146:0/2404411864 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9e60055ee0 con 0x55eea1f18c20 2023-10-06T11:09:08.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.926+0000 7f9e477fe700 1 -- 172.21.15.146:0/2404411864 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9e640074b0 con 0x55eea1f18c20 2023-10-06T11:09:08.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.926+0000 7f9e477fe700 1 -- 172.21.15.146:0/2404411864 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e64007880 con 0x55eea1f18c20 2023-10-06T11:09:08.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.926+0000 7f9e785f4b80 10 client.5799 fetch_fsmap learned FSMap version 36 2023-10-06T11:09:08.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.927+0000 7f9e785f4b80 1 -- 172.21.15.146:0/2404411864 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x55eea1e367d0 con 0x55eea1f18c20 2023-10-06T11:09:08.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.927+0000 7f9e477fe700 1 -- 172.21.15.146:0/2404411864 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e60055ee0 con 0x55eea1f18c20 2023-10-06T11:09:08.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.927+0000 7f9e477fe700 1 -- 172.21.15.146:0/2404411864 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 36) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9e64025540 con 0x55eea1f18c20 2023-10-06T11:09:08.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.927+0000 7f9e785f4b80 10 client.5799 fetch_fsmap finished waiting for FSMap version 36 2023-10-06T11:09:08.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.927+0000 7f9e785f4b80 10 client.5799 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-10-06T11:09:08.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.927+0000 7f9e785f4b80 20 client.5799 populate_metadata read hostname 'smithi146' 2023-10-06T11:09:08.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.927+0000 7f9e785f4b80 1 --2- 172.21.15.146:0/2404411864 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55eea1f17620 0x55eea1f47330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:08.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.927+0000 7f9e785f4b80 4 client.5799 mds_command: new command op to 5481 tid=0[{"prefix": "damage ls"}] 2023-10-06T11:09:08.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.927+0000 7f9e785f4b80 1 -- 172.21.15.146:0/2404411864 --> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55eea1e0ae50 con 0x55eea1f17620 2023-10-06T11:09:08.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.927+0000 7f9e6c897700 1 --2- 172.21.15.146:0/2404411864 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55eea1f17620 0x55eea1f47330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:08.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.927+0000 7f9e477fe700 10 client.5799 ms_handle_connect on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:08.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.928+0000 7f9e6c897700 1 --2- 172.21.15.146:0/2404411864 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55eea1f17620 0x55eea1f47330 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=165612e7008e0456 server_cookie=48798d1ea65ab741 in_seq=0 out_seq=0 2023-10-06T11:09:08.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.929+0000 7f9e477fe700 1 -- 172.21.15.146:0/2404411864 <== mds.0 v2:172.21.15.146:6835/2252184844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55eea1e0ae50 con 0x55eea1f17620 2023-10-06T11:09:08.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.929+0000 7f9e477fe700 10 client.5799 handle_command_reply: tid=0 2023-10-06T11:09:08.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.929+0000 7f9e785f4b80 1 client.5799 shutdown 2023-10-06T11:09:08.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.929+0000 7f9e785f4b80 1 -- 172.21.15.146:0/2404411864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eea1f18c20 msgr2=0x55eea1f19490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:08.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.929+0000 7f9e785f4b80 1 --2- 172.21.15.146:0/2404411864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eea1f18c20 0x55eea1f19490 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9e64001f20 tx=0x7f9e64027040 comp rx=0 tx=0).stop 2023-10-06T11:09:08.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.929+0000 7f9e785f4b80 1 -- 172.21.15.146:0/2404411864 shutdown_connections 2023-10-06T11:09:08.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.929+0000 7f9e785f4b80 1 --2- 172.21.15.146:0/2404411864 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55eea1f17620 0x55eea1f47330 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.929+0000 7f9e785f4b80 1 --2- 172.21.15.146:0/2404411864 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55eea1f5eae0 0x55eea1f46df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.929+0000 7f9e785f4b80 1 --2- 172.21.15.146:0/2404411864 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55eea1f18c20 0x55eea1f19490 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.929+0000 7f9e785f4b80 1 --2- 172.21.15.146:0/2404411864 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eea1f1a9f0 0x55eea1fbcfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.929+0000 7f9e785f4b80 1 -- 172.21.15.146:0/2404411864 >> 172.21.15.146:0/2404411864 conn(0x55eea1f190c0 msgr2=0x55eea1f6f950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:08.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.929+0000 7f9e477fe700 0 client.5799 ms_handle_reset on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:08.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.929+0000 7f9e785f4b80 1 -- 172.21.15.146:0/2404411864 shutdown_connections 2023-10-06T11:09:08.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.929+0000 7f9e785f4b80 1 -- 172.21.15.146:0/2404411864 wait complete. 2023-10-06T11:09:08.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.929+0000 7f9e785f4b80 20 client.5799 trim_cache size 0 max 16384 2023-10-06T11:09:08.935 INFO:teuthology.orchestra.run.smithi146.stdout:[] 2023-10-06T11:09:08.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.930+0000 7f9e6f2fc700 1 -- 172.21.15.146:0/1968430043 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9e4c066f30 msgr2=0x7f9e4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:08.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.930+0000 7f9e6f2fc700 1 --2- 172.21.15.146:0/1968430043 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9e4c066f30 0x7f9e4c0693e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9e64005920 tx=0x7f9e64009040 comp rx=0 tx=0).stop 2023-10-06T11:09:08.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.930+0000 7f9e6f2fc700 1 -- 172.21.15.146:0/1968430043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e6815cff0 msgr2=0x7f9e680b2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:08.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.930+0000 7f9e6f2fc700 1 --2- 172.21.15.146:0/1968430043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e6815cff0 0x7f9e680b2240 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f9e60009f90 tx=0x7f9e6000b040 comp rx=0 tx=0).stop 2023-10-06T11:09:08.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.930+0000 7f9e6f2fc700 1 -- 172.21.15.146:0/1968430043 shutdown_connections 2023-10-06T11:09:08.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.930+0000 7f9e6f2fc700 1 --2- 172.21.15.146:0/1968430043 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9e4c066f30 0x7f9e4c0693e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.930+0000 7f9e6f2fc700 1 --2- 172.21.15.146:0/1968430043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e6815cff0 0x7f9e680b2240 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.930+0000 7f9e6f2fc700 1 --2- 172.21.15.146:0/1968430043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e680d0c50 0x7f9e68142fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.930+0000 7f9e6f2fc700 1 --2- 172.21.15.146:0/1968430043 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e6815cc20 0x7f9e680b1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.930+0000 7f9e6f2fc700 1 -- 172.21.15.146:0/1968430043 >> 172.21.15.146:0/1968430043 conn(0x7f9e6806eba0 msgr2=0x7f9e68151150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:08.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.930+0000 7f9e6f2fc700 1 -- 172.21.15.146:0/1968430043 shutdown_connections 2023-10-06T11:09:08.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.930+0000 7f9e6f2fc700 1 -- 172.21.15.146:0/1968430043 wait complete. 2023-10-06T11:09:08.945 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data rmxattr 10000000a46.00000000 parent 2023-10-06T11:09:08.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.989+0000 7f87395a3000 1 Processor -- start 2023-10-06T11:09:08.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.989+0000 7f87395a3000 1 -- start start 2023-10-06T11:09:08.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.990+0000 7f87395a3000 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7520b6f70 0x55d7520a0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:08.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.990+0000 7f87395a3000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d75212cc60 0x55d752128bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:08.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.990+0000 7f87395a3000 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d75212d030 0x55d752145fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:08.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.990+0000 7f87395a3000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d751fb7980 con 0x55d75212cc60 2023-10-06T11:09:08.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.990+0000 7f87395a3000 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d751fb7620 con 0x55d7520b6f70 2023-10-06T11:09:08.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.990+0000 7f87395a3000 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d751fae400 con 0x55d75212d030 2023-10-06T11:09:08.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.990+0000 7f8731fdd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d75212cc60 0x55d752128bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:08.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.990+0000 7f8731fdd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d75212cc60 0x55d752128bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49280/0 (socket says 172.21.15.146:49280) 2023-10-06T11:09:08.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.990+0000 7f8731fdd700 1 -- 172.21.15.146:0/3468798346 learned_addr learned my addr 172.21.15.146:0/3468798346 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:08.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.990+0000 7f8732fdf700 1 --2- 172.21.15.146:0/3468798346 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d75212d030 0x55d752145fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:08.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.990+0000 7f87327de700 1 --2- 172.21.15.146:0/3468798346 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7520b6f70 0x55d7520a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:08.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.990+0000 7f8731fdd700 1 -- 172.21.15.146:0/3468798346 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d75212d030 msgr2=0x55d752145fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:08.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.990+0000 7f8731fdd700 1 --2- 172.21.15.146:0/3468798346 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d75212d030 0x55d752145fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.991+0000 7f8731fdd700 1 -- 172.21.15.146:0/3468798346 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7520b6f70 msgr2=0x55d7520a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:08.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.991+0000 7f8731fdd700 1 --2- 172.21.15.146:0/3468798346 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7520b6f70 0x55d7520a0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.991+0000 7f8731fdd700 1 -- 172.21.15.146:0/3468798346 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8728005db0 con 0x55d75212cc60 2023-10-06T11:09:08.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.991+0000 7f8731fdd700 1 --2- 172.21.15.146:0/3468798346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d75212cc60 0x55d752128bd0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f8724009980 tx=0x7f872400c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d72be22ba773efa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:08.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.991+0000 7f8730fdb700 1 -- 172.21.15.146:0/3468798346 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872400f040 con 0x55d75212cc60 2023-10-06T11:09:08.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.991+0000 7f8730fdb700 1 -- 172.21.15.146:0/3468798346 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87240089e0 con 0x55d75212cc60 2023-10-06T11:09:08.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.991+0000 7f8730fdb700 1 -- 172.21.15.146:0/3468798346 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8724008d80 con 0x55d75212cc60 2023-10-06T11:09:08.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.991+0000 7f87395a3000 1 -- 172.21.15.146:0/3468798346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d75212cc60 msgr2=0x55d752128bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:08.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.991+0000 7f87395a3000 1 --2- 172.21.15.146:0/3468798346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d75212cc60 0x55d752128bd0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f8724009980 tx=0x7f872400c040 comp rx=0 tx=0).stop 2023-10-06T11:09:08.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.992+0000 7f87395a3000 1 -- 172.21.15.146:0/3468798346 shutdown_connections 2023-10-06T11:09:08.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.992+0000 7f87395a3000 1 --2- 172.21.15.146:0/3468798346 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d75212d030 0x55d752145fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.992+0000 7f87395a3000 1 --2- 172.21.15.146:0/3468798346 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7520b6f70 0x55d7520a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.992+0000 7f87395a3000 1 --2- 172.21.15.146:0/3468798346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d75212cc60 0x55d752128bd0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:08.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.992+0000 7f87395a3000 1 -- 172.21.15.146:0/3468798346 >> 172.21.15.146:0/3468798346 conn(0x55d75206aff0 msgr2=0x55d7520b7340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:08.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.992+0000 7f87395a3000 1 -- 172.21.15.146:0/3468798346 shutdown_connections 2023-10-06T11:09:08.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.992+0000 7f87395a3000 1 -- 172.21.15.146:0/3468798346 wait complete. 2023-10-06T11:09:08.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.992+0000 7f87395a3000 1 Processor -- start 2023-10-06T11:09:08.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.992+0000 7f87395a3000 1 -- start start 2023-10-06T11:09:08.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.993+0000 7f87395a3000 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d7520b6f70 0x55d7520aff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:08.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.993+0000 7f87395a3000 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d75212cc60 0x55d752142cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:08.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.993+0000 7f87395a3000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d75212d030 0x55d7520b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:09.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.993+0000 7f87395a3000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7520b2c90 con 0x55d75212d030 2023-10-06T11:09:09.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.993+0000 7f87395a3000 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7520b09e0 con 0x55d75212cc60 2023-10-06T11:09:09.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.993+0000 7f87395a3000 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d752125670 con 0x55d7520b6f70 2023-10-06T11:09:09.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.993+0000 7f8732fdf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d75212d030 0x55d7520b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.993+0000 7f8732fdf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d75212d030 0x55d7520b0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49292/0 (socket says 172.21.15.146:49292) 2023-10-06T11:09:09.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.993+0000 7f8732fdf700 1 -- 172.21.15.146:0/3419035314 learned_addr learned my addr 172.21.15.146:0/3419035314 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:09.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.993+0000 7f87327de700 1 --2- 172.21.15.146:0/3419035314 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d7520b6f70 0x55d7520aff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.993+0000 7f8731fdd700 1 --2- 172.21.15.146:0/3419035314 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d75212cc60 0x55d752142cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.993+0000 7f8732fdf700 1 -- 172.21.15.146:0/3419035314 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d7520b6f70 msgr2=0x55d7520aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:09.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.993+0000 7f8732fdf700 1 --2- 172.21.15.146:0/3419035314 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d7520b6f70 0x55d7520aff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.993+0000 7f8732fdf700 1 -- 172.21.15.146:0/3419035314 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d75212cc60 msgr2=0x55d752142cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:09.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.993+0000 7f8732fdf700 1 --2- 172.21.15.146:0/3419035314 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d75212cc60 0x55d752142cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.993+0000 7f8732fdf700 1 -- 172.21.15.146:0/3419035314 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8724009580 con 0x55d75212d030 2023-10-06T11:09:09.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.993+0000 7f8732fdf700 1 --2- 172.21.15.146:0/3419035314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d75212d030 0x55d7520b0e20 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f872c00e5a0 tx=0x7f872c006ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:09.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.994+0000 7f8722ffd700 1 -- 172.21.15.146:0/3419035314 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872c010590 con 0x55d75212d030 2023-10-06T11:09:09.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.994+0000 7f8722ffd700 1 -- 172.21.15.146:0/3419035314 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872c010710 con 0x55d75212d030 2023-10-06T11:09:09.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.994+0000 7f8722ffd700 1 -- 172.21.15.146:0/3419035314 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f872c010ad0 con 0x55d75212d030 2023-10-06T11:09:09.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.994+0000 7f87395a3000 1 -- 172.21.15.146:0/3419035314 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d751fc63d0 con 0x55d75212d030 2023-10-06T11:09:09.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.994+0000 7f87395a3000 1 -- 172.21.15.146:0/3419035314 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d751fb9ae0 con 0x55d75212d030 2023-10-06T11:09:09.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.995+0000 7f8722ffd700 1 -- 172.21.15.146:0/3419035314 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f872c01c460 con 0x55d75212d030 2023-10-06T11:09:09.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.995+0000 7f8722ffd700 1 --2- 172.21.15.146:0/3419035314 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f87140658c0 0x7f8714067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:09.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.995+0000 7f8722ffd700 1 -- 172.21.15.146:0/3419035314 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f872c0836e0 con 0x55d75212d030 2023-10-06T11:09:09.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.995+0000 7f87327de700 1 --2- 172.21.15.146:0/3419035314 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f87140658c0 0x7f8714067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.996+0000 7f87395a3000 1 --2- 172.21.15.146:0/3419035314 >> [v2:172.21.15.151:6824/90920,v1:172.21.15.151:6825/90920] conn(0x55d752143200 0x55d75215f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:09.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.996+0000 7f87395a3000 1 -- 172.21.15.146:0/3419035314 --> [v2:172.21.15.151:6824/90920,v1:172.21.15.151:6825/90920] -- osd_op(unknown.0.0:1 8.2c 8:36265322:::10000000a46.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47) v8 -- 0x55d7520b6450 con 0x55d752143200 2023-10-06T11:09:09.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.996+0000 7f8731fdd700 1 --2- 172.21.15.146:0/3419035314 >> [v2:172.21.15.151:6824/90920,v1:172.21.15.151:6825/90920] conn(0x55d752143200 0x55d75215f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.996+0000 7f87327de700 1 --2- 172.21.15.146:0/3419035314 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f87140658c0 0x7f8714067d70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8728008fd0 tx=0x7f8728016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:09.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.996+0000 7f8731fdd700 1 --2- 172.21.15.146:0/3419035314 >> [v2:172.21.15.151:6824/90920,v1:172.21.15.151:6825/90920] conn(0x55d752143200 0x55d75215f660 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:09.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.997+0000 7f8731fdd700 1 -- 172.21.15.146:0/3419035314 <== osd.6 v2:172.21.15.151:6824/90920 1 ==== osd_op_reply(1 10000000a46.00000000 [rmxattr] v47'41 uv41 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f8724019020 con 0x55d752143200 2023-10-06T11:09:09.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.997+0000 7f87395a3000 1 -- 172.21.15.146:0/3419035314 >> [v2:172.21.15.151:6824/90920,v1:172.21.15.151:6825/90920] conn(0x55d752143200 msgr2=0x55d75215f660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:09.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.997+0000 7f87395a3000 1 --2- 172.21.15.146:0/3419035314 >> [v2:172.21.15.151:6824/90920,v1:172.21.15.151:6825/90920] conn(0x55d752143200 0x55d75215f660 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.998+0000 7f87395a3000 1 -- 172.21.15.146:0/3419035314 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f87140658c0 msgr2=0x7f8714067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:09.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.998+0000 7f87395a3000 1 --2- 172.21.15.146:0/3419035314 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f87140658c0 0x7f8714067d70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8728008fd0 tx=0x7f8728016000 comp rx=0 tx=0).stop 2023-10-06T11:09:09.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.998+0000 7f87395a3000 1 -- 172.21.15.146:0/3419035314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d75212d030 msgr2=0x55d7520b0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:09.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.998+0000 7f87395a3000 1 --2- 172.21.15.146:0/3419035314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d75212d030 0x55d7520b0e20 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f872c00e5a0 tx=0x7f872c006ae0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.998+0000 7f8732fdf700 1 -- 172.21.15.146:0/3419035314 reap_dead start 2023-10-06T11:09:09.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.998+0000 7f87395a3000 1 -- 172.21.15.146:0/3419035314 shutdown_connections 2023-10-06T11:09:09.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.998+0000 7f87395a3000 1 -- 172.21.15.146:0/3419035314 >> 172.21.15.146:0/3419035314 conn(0x55d75206aff0 msgr2=0x55d7520b7340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:09.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.998+0000 7f87395a3000 1 -- 172.21.15.146:0/3419035314 shutdown_connections 2023-10-06T11:09:09.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:08.998+0000 7f87395a3000 1 -- 172.21.15.146:0/3419035314 wait complete. 2023-10-06T11:09:09.004 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_0' 2023-10-06T11:09:09.004 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/new_file_0 2023-10-06T11:09:09.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.118+0000 7f9818712700 1 Processor -- start 2023-10-06T11:09:09.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.118+0000 7f9818712700 1 -- start start 2023-10-06T11:09:09.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.119+0000 7f9818712700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f98100ceb50 0x7f98100af5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:09.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.119+0000 7f9818712700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f98100ac3b0 0x7f98100ac800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:09.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.119+0000 7f9818712700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98100ae550 con 0x7f98100abfe0 2023-10-06T11:09:09.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.119+0000 7f9818712700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98100ae830 con 0x7f98100ac3b0 2023-10-06T11:09:09.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.119+0000 7f9818712700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98100aeb10 con 0x7f98100ceb50 2023-10-06T11:09:09.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.120+0000 7f9816caf700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f98100ac3b0 0x7f98100ac800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.120+0000 7f9815cad700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f98100ceb50 0x7f98100af5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.120+0000 7f98164ae700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f98100abfe0 0x7f98100add00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:45026/0 (socket says 172.21.15.146:45026) 2023-10-06T11:09:09.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.120+0000 7f98164ae700 1 -- 172.21.15.146:0/700115937 learned_addr learned my addr 172.21.15.146:0/700115937 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:09.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.120+0000 7f9816caf700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f98100ac3b0 0x7f98100ac800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:34706/0 (socket says 172.21.15.146:34706) 2023-10-06T11:09:09.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.120+0000 7f9815cad700 1 -- 172.21.15.146:0/700115937 >> v2:172.21.15.151:3300/0 conn(0x7f98100ac3b0 msgr2=0x7f98100ac800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:09.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.120+0000 7f9815cad700 1 --2- 172.21.15.146:0/700115937 >> v2:172.21.15.151:3300/0 conn(0x7f98100ac3b0 0x7f98100ac800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.120+0000 7f9815cad700 1 -- 172.21.15.146:0/700115937 >> v1:172.21.15.151:6789/0 conn(0x7f98100abfe0 legacy=0x7f98100add00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:09.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.120+0000 7f98154ac700 1 -- 172.21.15.146:0/700115937 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 488850850 0 0) 0x7f98100ae550 con 0x7f98100abfe0 2023-10-06T11:09:09.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.120+0000 7f9815cad700 1 -- 172.21.15.146:0/700115937 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98100aedf0 con 0x7f98100ceb50 2023-10-06T11:09:09.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.120+0000 7f9815cad700 1 --2- 172.21.15.146:0/700115937 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f98100ceb50 0x7f98100af5f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f98000098e0 tx=0x7f98000091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3f7ed0ca3fb5507 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:09.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.120+0000 7f98154ac700 1 -- 172.21.15.146:0/700115937 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980000b640 con 0x7f98100ceb50 2023-10-06T11:09:09.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.120+0000 7f98154ac700 1 -- 172.21.15.146:0/700115937 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980000b7a0 con 0x7f98100ceb50 2023-10-06T11:09:09.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.120+0000 7f98154ac700 1 -- 172.21.15.146:0/700115937 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980000bb40 con 0x7f98100ceb50 2023-10-06T11:09:09.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.121+0000 7f9818712700 1 -- 172.21.15.146:0/700115937 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f98100ceb50 msgr2=0x7f98100af5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:09.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.121+0000 7f9818712700 1 --2- 172.21.15.146:0/700115937 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f98100ceb50 0x7f98100af5f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f98000098e0 tx=0x7f98000091a0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.121+0000 7f9818712700 1 -- 172.21.15.146:0/700115937 shutdown_connections 2023-10-06T11:09:09.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.121+0000 7f9818712700 1 --2- 172.21.15.146:0/700115937 >> v2:172.21.15.151:3300/0 conn(0x7f98100ac3b0 0x7f98100ac800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.121+0000 7f9818712700 1 --2- 172.21.15.146:0/700115937 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f98100ceb50 0x7f98100af5f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.121+0000 7f9818712700 1 -- 172.21.15.146:0/700115937 >> 172.21.15.146:0/700115937 conn(0x7f9810067c50 msgr2=0x7f98100ce440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:09.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.121+0000 7f9818712700 1 -- 172.21.15.146:0/700115937 shutdown_connections 2023-10-06T11:09:09.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.121+0000 7f9818712700 1 -- 172.21.15.146:0/700115937 wait complete. 2023-10-06T11:09:09.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.122+0000 7f9818712700 1 Processor -- start 2023-10-06T11:09:09.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.122+0000 7f9818712700 1 -- start start 2023-10-06T11:09:09.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.123+0000 7f9818712700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98100abfe0 0x7f9810152690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:09.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.123+0000 7f9818712700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f98100ac3b0 0x7f9810167b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:09.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.123+0000 7f9818712700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98100ceb50 0x7f98101680d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:09.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.123+0000 7f9818712700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981015c2b0 con 0x7f98100abfe0 2023-10-06T11:09:09.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.123+0000 7f9818712700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981015b980 con 0x7f98100ceb50 2023-10-06T11:09:09.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.123+0000 7f9818712700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f981015bc60 con 0x7f98100ac3b0 2023-10-06T11:09:09.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.123+0000 7f98164ae700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98100abfe0 0x7f9810152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.123+0000 7f98164ae700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98100abfe0 0x7f9810152690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49294/0 (socket says 172.21.15.146:49294) 2023-10-06T11:09:09.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.123+0000 7f98164ae700 1 -- 172.21.15.146:0/3520910984 learned_addr learned my addr 172.21.15.146:0/3520910984 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:09.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.123+0000 7f9816caf700 1 --2- 172.21.15.146:0/3520910984 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98100ceb50 0x7f98101680d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.123+0000 7f9815cad700 1 --2- 172.21.15.146:0/3520910984 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f98100ac3b0 0x7f9810167b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.123+0000 7f98164ae700 1 -- 172.21.15.146:0/3520910984 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f98100ac3b0 msgr2=0x7f9810167b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:09.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.123+0000 7f98164ae700 1 --2- 172.21.15.146:0/3520910984 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f98100ac3b0 0x7f9810167b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.123+0000 7f98164ae700 1 -- 172.21.15.146:0/3520910984 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98100ceb50 msgr2=0x7f98101680d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:09.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.123+0000 7f98164ae700 1 --2- 172.21.15.146:0/3520910984 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98100ceb50 0x7f98101680d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.123+0000 7f98164ae700 1 -- 172.21.15.146:0/3520910984 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9800009420 con 0x7f98100abfe0 2023-10-06T11:09:09.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.124+0000 7f98164ae700 1 --2- 172.21.15.146:0/3520910984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98100abfe0 0x7f9810152690 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f980c00cd80 tx=0x7f980c001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:09.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.124+0000 7f98067fc700 1 -- 172.21.15.146:0/3520910984 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c00ab10 con 0x7f98100abfe0 2023-10-06T11:09:09.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.124+0000 7f98067fc700 1 -- 172.21.15.146:0/3520910984 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980c00ac70 con 0x7f98100abfe0 2023-10-06T11:09:09.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.124+0000 7f9818712700 1 -- 172.21.15.146:0/3520910984 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f981015bf40 con 0x7f98100abfe0 2023-10-06T11:09:09.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.124+0000 7f98067fc700 1 -- 172.21.15.146:0/3520910984 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c0070f0 con 0x7f98100abfe0 2023-10-06T11:09:09.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.124+0000 7f9818712700 1 -- 172.21.15.146:0/3520910984 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f981015c740 con 0x7f98100abfe0 2023-10-06T11:09:09.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.125+0000 7f98067fc700 1 -- 172.21.15.146:0/3520910984 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f980c0074e0 con 0x7f98100abfe0 2023-10-06T11:09:09.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.125+0000 7f98067fc700 1 --2- 172.21.15.146:0/3520910984 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f97f4066f30 0x7f97f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:09.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.125+0000 7f98067fc700 1 -- 172.21.15.146:0/3520910984 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f980c084bc0 con 0x7f98100abfe0 2023-10-06T11:09:09.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.126+0000 7f9815cad700 1 --2- 172.21.15.146:0/3520910984 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f97f4066f30 0x7f97f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.126+0000 7f9815cad700 1 --2- 172.21.15.146:0/3520910984 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f97f4066f30 0x7f97f40693e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f98000093f0 tx=0x7f9800017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:09.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.127+0000 7f9821a0ab80 1 Processor -- start 2023-10-06T11:09:09.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.127+0000 7f9821a0ab80 1 -- start start 2023-10-06T11:09:09.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.128+0000 7f9821a0ab80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5574fbff6b80 0x5574fbff6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:09.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.128+0000 7f9821a0ab80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5574fbfb2a90 0x5574fbfaf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:09.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.128+0000 7f9821a0ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5574fbfb0cc0 0x5574fbfafbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:09.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.128+0000 7f9821a0ab80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574fbf2fd70 con 0x5574fbff6b80 2023-10-06T11:09:09.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.128+0000 7f9821a0ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574fbf06b60 con 0x5574fbfb0cc0 2023-10-06T11:09:09.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.128+0000 7f9821a0ab80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5574fbf04360 con 0x5574fbfb2a90 2023-10-06T11:09:09.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.128+0000 7f98164ae700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5574fbff6b80 0x5574fbff6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.128+0000 7f98164ae700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5574fbff6b80 0x5574fbff6f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49310/0 (socket says 172.21.15.146:49310) 2023-10-06T11:09:09.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.128+0000 7f98164ae700 1 -- 172.21.15.146:0/472924175 learned_addr learned my addr 172.21.15.146:0/472924175 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:09.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.128+0000 7f9815cad700 1 --2- 172.21.15.146:0/472924175 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5574fbfb2a90 0x5574fbfaf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.129+0000 7f9816caf700 1 --2- 172.21.15.146:0/472924175 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5574fbfb0cc0 0x5574fbfafbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.129+0000 7f98164ae700 1 -- 172.21.15.146:0/472924175 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5574fbfb2a90 msgr2=0x5574fbfaf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:09.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.129+0000 7f98164ae700 1 --2- 172.21.15.146:0/472924175 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5574fbfb2a90 0x5574fbfaf670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.129+0000 7f98164ae700 1 -- 172.21.15.146:0/472924175 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5574fbfb0cc0 msgr2=0x5574fbfafbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:09.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.129+0000 7f98164ae700 1 --2- 172.21.15.146:0/472924175 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5574fbfb0cc0 0x5574fbfafbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.129+0000 7f98164ae700 1 -- 172.21.15.146:0/472924175 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5574fbd9a360 con 0x5574fbff6b80 2023-10-06T11:09:09.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.129+0000 7f98164ae700 1 --2- 172.21.15.146:0/472924175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5574fbff6b80 0x5574fbff6f50 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f980c00cfd0 tx=0x7f980c082ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7beea45af117daac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:09.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.129+0000 7f97f37fe700 1 -- 172.21.15.146:0/472924175 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c05c9b0 con 0x5574fbff6b80 2023-10-06T11:09:09.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.129+0000 7f97f37fe700 1 -- 172.21.15.146:0/472924175 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980c053b50 con 0x5574fbff6b80 2023-10-06T11:09:09.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.129+0000 7f97f37fe700 1 -- 172.21.15.146:0/472924175 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c007790 con 0x5574fbff6b80 2023-10-06T11:09:09.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.129+0000 7f9821a0ab80 1 -- 172.21.15.146:0/472924175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5574fbff6b80 msgr2=0x5574fbff6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:09.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.129+0000 7f9821a0ab80 1 --2- 172.21.15.146:0/472924175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5574fbff6b80 0x5574fbff6f50 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f980c00cfd0 tx=0x7f980c082ee0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.129+0000 7f9821a0ab80 1 -- 172.21.15.146:0/472924175 shutdown_connections 2023-10-06T11:09:09.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.129+0000 7f9821a0ab80 1 --2- 172.21.15.146:0/472924175 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5574fbfb0cc0 0x5574fbfafbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.129+0000 7f9821a0ab80 1 --2- 172.21.15.146:0/472924175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5574fbff6b80 0x5574fbff6f50 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.129+0000 7f9821a0ab80 1 --2- 172.21.15.146:0/472924175 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5574fbfb2a90 0x5574fbfaf670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.130+0000 7f9821a0ab80 1 -- 172.21.15.146:0/472924175 >> 172.21.15.146:0/472924175 conn(0x5574fbfb1160 msgr2=0x5574fbfb1530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:09.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.130+0000 7f9821a0ab80 1 -- 172.21.15.146:0/472924175 shutdown_connections 2023-10-06T11:09:09.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.130+0000 7f9821a0ab80 1 -- 172.21.15.146:0/472924175 wait complete. 2023-10-06T11:09:09.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.130+0000 7f9821a0ab80 1 -- start start 2023-10-06T11:09:09.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.130+0000 7f9821a0ab80 1 Processor -- start 2023-10-06T11:09:09.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.131+0000 7f9821a0ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5574fbfb0cc0 0x5574fbfd7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:09.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.131+0000 7f9821a0ab80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5574fbfb2a90 0x5574fbfdc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:09.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.131+0000 7f9821a0ab80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5574fbff6b80 0x5574fbfda220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:09.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.131+0000 7f9821a0ab80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574fbf00150 con 0x5574fbff6b80 2023-10-06T11:09:09.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.131+0000 7f9821a0ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574fbeab980 con 0x5574fbfb0cc0 2023-10-06T11:09:09.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.131+0000 7f9821a0ab80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5574fbec6f90 con 0x5574fbfb2a90 2023-10-06T11:09:09.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.131+0000 7f9821a0ab80 10 client.0 _ll_register_callbacks cb 0x5574fbd9d020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:09:09.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.131+0000 7f9816caf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5574fbff6b80 0x5574fbfda220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.131+0000 7f9816caf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5574fbff6b80 0x5574fbfda220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49318/0 (socket says 172.21.15.146:49318) 2023-10-06T11:09:09.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.131+0000 7f9816caf700 1 -- 172.21.15.146:0/3650394642 learned_addr learned my addr 172.21.15.146:0/3650394642 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:09.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.131+0000 7f98164ae700 1 --2- 172.21.15.146:0/3650394642 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5574fbfb0cc0 0x5574fbfd7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.131+0000 7f9815cad700 1 --2- 172.21.15.146:0/3650394642 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5574fbfb2a90 0x5574fbfdc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.131+0000 7f9816caf700 1 -- 172.21.15.146:0/3650394642 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5574fbfb2a90 msgr2=0x5574fbfdc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:09.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.131+0000 7f9816caf700 1 --2- 172.21.15.146:0/3650394642 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5574fbfb2a90 0x5574fbfdc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.131+0000 7f9816caf700 1 -- 172.21.15.146:0/3650394642 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5574fbfb0cc0 msgr2=0x5574fbfd7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:09.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.131+0000 7f9816caf700 1 --2- 172.21.15.146:0/3650394642 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5574fbfb0cc0 0x5574fbfd7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.132+0000 7f9816caf700 1 -- 172.21.15.146:0/3650394642 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f981015c740 con 0x5574fbff6b80 2023-10-06T11:09:09.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.132+0000 7f9816caf700 1 --2- 172.21.15.146:0/3650394642 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5574fbff6b80 0x5574fbfda220 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f9808009f30 tx=0x7f9808008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f97c5fe8c317d3e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:09.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.132+0000 7f97f0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:09:09.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.132+0000 7f97f0ff9700 1 -- 172.21.15.146:0/3650394642 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9808013d10 con 0x5574fbff6b80 2023-10-06T11:09:09.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.132+0000 7f97f0ff9700 1 -- 172.21.15.146:0/3650394642 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9808013e70 con 0x5574fbff6b80 2023-10-06T11:09:09.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.132+0000 7f9821a0ab80 1 -- 172.21.15.146:0/3650394642 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5574fbfa4780 con 0x5574fbff6b80 2023-10-06T11:09:09.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.132+0000 7f97f0ff9700 1 -- 172.21.15.146:0/3650394642 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9808016670 con 0x5574fbff6b80 2023-10-06T11:09:09.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.132+0000 7f9821a0ab80 10 client.5817 fetch_fsmap learned FSMap version 36 2023-10-06T11:09:09.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.132+0000 7f9821a0ab80 1 -- 172.21.15.146:0/3650394642 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x5574fbd3d0d0 con 0x5574fbff6b80 2023-10-06T11:09:09.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.132+0000 7f97f0ff9700 1 -- 172.21.15.146:0/3650394642 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5574fbfa4780 con 0x5574fbff6b80 2023-10-06T11:09:09.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.132+0000 7f97f0ff9700 1 -- 172.21.15.146:0/3650394642 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 36) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f98080167d0 con 0x5574fbff6b80 2023-10-06T11:09:09.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.132+0000 7f9821a0ab80 10 client.5817 fetch_fsmap finished waiting for FSMap version 36 2023-10-06T11:09:09.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.132+0000 7f9821a0ab80 10 client.5817 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-10-06T11:09:09.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.132+0000 7f9821a0ab80 20 client.5817 populate_metadata read hostname 'smithi146' 2023-10-06T11:09:09.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.132+0000 7f9821a0ab80 1 --2- 172.21.15.146:0/3650394642 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x5574fbfda760 0x5574fbfd5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:09.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.132+0000 7f9821a0ab80 4 client.5817 mds_command: new command op to 5481 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:09:09.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.132+0000 7f9821a0ab80 1 -- 172.21.15.146:0/3650394642 --> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5574fbf816b0 con 0x5574fbfda760 2023-10-06T11:09:09.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.132+0000 7f98164ae700 1 --2- 172.21.15.146:0/3650394642 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x5574fbfda760 0x5574fbfd5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.133+0000 7f97f0ff9700 10 client.5817 ms_handle_connect on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:09.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.133+0000 7f98164ae700 1 --2- 172.21.15.146:0/3650394642 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x5574fbfda760 0x5574fbfd5ea0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79bbdf00d36dbe67 server_cookie=62d920082e2907f3 in_seq=0 out_seq=0 2023-10-06T11:09:09.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.133+0000 7f97f0ff9700 1 -- 172.21.15.146:0/3650394642 <== mds.0 v2:172.21.15.146:6835/2252184844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5574fbf816b0 con 0x5574fbfda760 2023-10-06T11:09:09.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.133+0000 7f97f0ff9700 10 client.5817 handle_command_reply: tid=0 2023-10-06T11:09:09.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.133+0000 7f9821a0ab80 1 client.5817 shutdown 2023-10-06T11:09:09.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.133+0000 7f9821a0ab80 1 -- 172.21.15.146:0/3650394642 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5574fbff6b80 msgr2=0x5574fbfda220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:09.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.133+0000 7f9821a0ab80 1 --2- 172.21.15.146:0/3650394642 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5574fbff6b80 0x5574fbfda220 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f9808009f30 tx=0x7f9808008040 comp rx=0 tx=0).stop 2023-10-06T11:09:09.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.133+0000 7f9821a0ab80 1 -- 172.21.15.146:0/3650394642 shutdown_connections 2023-10-06T11:09:09.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.133+0000 7f9821a0ab80 1 --2- 172.21.15.146:0/3650394642 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x5574fbfda760 0x5574fbfd5ea0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.133+0000 7f9821a0ab80 1 --2- 172.21.15.146:0/3650394642 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5574fbff6b80 0x5574fbfda220 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.133+0000 7f9821a0ab80 1 --2- 172.21.15.146:0/3650394642 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5574fbfb0cc0 0x5574fbfd7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.133+0000 7f97f0ff9700 0 client.5817 ms_handle_reset on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:09.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.133+0000 7f9821a0ab80 1 --2- 172.21.15.146:0/3650394642 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5574fbfb2a90 0x5574fbfdc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.133+0000 7f9821a0ab80 1 -- 172.21.15.146:0/3650394642 >> 172.21.15.146:0/3650394642 conn(0x5574fbfb1160 msgr2=0x5574fbfac7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:09.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.133+0000 7f9821a0ab80 1 -- 172.21.15.146:0/3650394642 shutdown_connections 2023-10-06T11:09:09.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.133+0000 7f9821a0ab80 1 -- 172.21.15.146:0/3650394642 wait complete. 2023-10-06T11:09:09.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.134+0000 7f9821a0ab80 20 client.5817 trim_cache size 0 max 16384 2023-10-06T11:09:09.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.149+0000 7f9821a0ab80 1 Processor -- start 2023-10-06T11:09:09.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.150+0000 7f9821a0ab80 1 -- start start 2023-10-06T11:09:09.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.150+0000 7f9821a0ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5574fbfb0cc0 0x5574fbff6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:09.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.150+0000 7f9821a0ab80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5574fbfb2a90 0x5574fbff0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:09.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.150+0000 7f9821a0ab80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5574fbff6b80 0x5574fbfd8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:09.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.150+0000 7f9821a0ab80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574fbd82f20 con 0x5574fbff6b80 2023-10-06T11:09:09.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.150+0000 7f9821a0ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574fbfdb4f0 con 0x5574fbfb0cc0 2023-10-06T11:09:09.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.150+0000 7f9821a0ab80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5574fbfface0 con 0x5574fbfb2a90 2023-10-06T11:09:09.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.150+0000 7f9816caf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5574fbff6b80 0x5574fbfd8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.150+0000 7f9816caf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5574fbff6b80 0x5574fbfd8930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49330/0 (socket says 172.21.15.146:49330) 2023-10-06T11:09:09.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.150+0000 7f9816caf700 1 -- 172.21.15.146:0/1160004327 learned_addr learned my addr 172.21.15.146:0/1160004327 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:09.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.150+0000 7f9815cad700 1 --2- 172.21.15.146:0/1160004327 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5574fbfb2a90 0x5574fbff0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.150+0000 7f98164ae700 1 --2- 172.21.15.146:0/1160004327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5574fbfb0cc0 0x5574fbff6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.151+0000 7f9816caf700 1 -- 172.21.15.146:0/1160004327 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5574fbfb2a90 msgr2=0x5574fbff0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:09.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.151+0000 7f9816caf700 1 --2- 172.21.15.146:0/1160004327 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5574fbfb2a90 0x5574fbff0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.151+0000 7f9816caf700 1 -- 172.21.15.146:0/1160004327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5574fbfb0cc0 msgr2=0x5574fbff6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:09.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.151+0000 7f9816caf700 1 --2- 172.21.15.146:0/1160004327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5574fbfb0cc0 0x5574fbff6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.151+0000 7f9816caf700 1 -- 172.21.15.146:0/1160004327 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5574fbfa8390 con 0x5574fbff6b80 2023-10-06T11:09:09.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.151+0000 7f98164ae700 1 --2- 172.21.15.146:0/1160004327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5574fbfb0cc0 0x5574fbff6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:09.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.151+0000 7f9816caf700 1 --2- 172.21.15.146:0/1160004327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5574fbff6b80 0x5574fbfd8930 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x5574fbff41d0 tx=0x7f980801d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f1b4b1c7554b3e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:09.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.151+0000 7f97f3fff700 1 -- 172.21.15.146:0/1160004327 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9808016ce0 con 0x5574fbff6b80 2023-10-06T11:09:09.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.151+0000 7f97f3fff700 1 -- 172.21.15.146:0/1160004327 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9808009720 con 0x5574fbff6b80 2023-10-06T11:09:09.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.151+0000 7f97f3fff700 1 -- 172.21.15.146:0/1160004327 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9808016670 con 0x5574fbff6b80 2023-10-06T11:09:09.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.151+0000 7f9821a0ab80 1 -- 172.21.15.146:0/1160004327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5574fbff6b80 msgr2=0x5574fbfd8930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:09.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.151+0000 7f9821a0ab80 1 --2- 172.21.15.146:0/1160004327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5574fbff6b80 0x5574fbfd8930 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x5574fbff41d0 tx=0x7f980801d000 comp rx=0 tx=0).stop 2023-10-06T11:09:09.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.151+0000 7f9821a0ab80 1 -- 172.21.15.146:0/1160004327 shutdown_connections 2023-10-06T11:09:09.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.151+0000 7f9821a0ab80 1 --2- 172.21.15.146:0/1160004327 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5574fbff6b80 0x5574fbfd8930 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.151+0000 7f9821a0ab80 1 --2- 172.21.15.146:0/1160004327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5574fbfb0cc0 0x5574fbff6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.151+0000 7f9821a0ab80 1 --2- 172.21.15.146:0/1160004327 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5574fbfb2a90 0x5574fbff0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.151+0000 7f9821a0ab80 1 -- 172.21.15.146:0/1160004327 >> 172.21.15.146:0/1160004327 conn(0x5574fbfb1160 msgr2=0x5574fbff3900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:09.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.152+0000 7f9821a0ab80 1 -- 172.21.15.146:0/1160004327 shutdown_connections 2023-10-06T11:09:09.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.152+0000 7f9821a0ab80 1 -- 172.21.15.146:0/1160004327 wait complete. 2023-10-06T11:09:09.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.152+0000 7f9821a0ab80 1 -- start start 2023-10-06T11:09:09.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.152+0000 7f9821a0ab80 1 Processor -- start 2023-10-06T11:09:09.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.153+0000 7f9821a0ab80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5574fbfb0cc0 0x5574fbfb06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:09.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.153+0000 7f9821a0ab80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5574fbfb2a90 0x5574fc0457f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:09.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.153+0000 7f9821a0ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5574fbff6b80 0x5574fbff0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:09.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.153+0000 7f9821a0ab80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574fbff6290 con 0x5574fbfb2a90 2023-10-06T11:09:09.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.153+0000 7f9821a0ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574fbfac120 con 0x5574fbff6b80 2023-10-06T11:09:09.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.153+0000 7f9821a0ab80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5574fc05c3c0 con 0x5574fbfb0cc0 2023-10-06T11:09:09.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.153+0000 7f9821a0ab80 10 client.0 _ll_register_callbacks cb 0x5574fbd9d020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:09:09.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.153+0000 7f9815cad700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5574fbfb2a90 0x5574fc0457f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.153+0000 7f9815cad700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5574fbfb2a90 0x5574fc0457f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49332/0 (socket says 172.21.15.146:49332) 2023-10-06T11:09:09.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.153+0000 7f9815cad700 1 -- 172.21.15.146:0/2064226636 learned_addr learned my addr 172.21.15.146:0/2064226636 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:09.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.153+0000 7f98164ae700 1 --2- 172.21.15.146:0/2064226636 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5574fbfb0cc0 0x5574fbfb06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.153+0000 7f9816caf700 1 --2- 172.21.15.146:0/2064226636 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5574fbff6b80 0x5574fbff0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.153+0000 7f9815cad700 1 -- 172.21.15.146:0/2064226636 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5574fbfb0cc0 msgr2=0x5574fbfb06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:09.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.153+0000 7f9815cad700 1 --2- 172.21.15.146:0/2064226636 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5574fbfb0cc0 0x5574fbfb06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.153+0000 7f9815cad700 1 -- 172.21.15.146:0/2064226636 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5574fbff6b80 msgr2=0x5574fbff0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:09.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.153+0000 7f9815cad700 1 --2- 172.21.15.146:0/2064226636 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5574fbff6b80 0x5574fbff0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.153+0000 7f9815cad700 1 -- 172.21.15.146:0/2064226636 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5574fbd3d0d0 con 0x5574fbfb2a90 2023-10-06T11:09:09.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.153+0000 7f98164ae700 1 --2- 172.21.15.146:0/2064226636 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5574fbfb0cc0 0x5574fbfb06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:09:09.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.154+0000 7f9815cad700 1 --2- 172.21.15.146:0/2064226636 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5574fbfb2a90 0x5574fc0457f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9800006ec0 tx=0x7f9800021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8275631fc7aa16f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:09.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.154+0000 7f97f0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:09:09.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.154+0000 7f97f0ff9700 1 -- 172.21.15.146:0/2064226636 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9800021070 con 0x5574fbfb2a90 2023-10-06T11:09:09.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.154+0000 7f97f0ff9700 1 -- 172.21.15.146:0/2064226636 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9800011630 con 0x5574fbfb2a90 2023-10-06T11:09:09.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.154+0000 7f9821a0ab80 1 -- 172.21.15.146:0/2064226636 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f980c053b50 con 0x5574fbfb2a90 2023-10-06T11:09:09.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.154+0000 7f97f0ff9700 1 -- 172.21.15.146:0/2064226636 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9800011a00 con 0x5574fbfb2a90 2023-10-06T11:09:09.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.154+0000 7f9821a0ab80 10 client.5823 fetch_fsmap learned FSMap version 36 2023-10-06T11:09:09.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.154+0000 7f9821a0ab80 1 -- 172.21.15.146:0/2064226636 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x5574fbece870 con 0x5574fbfb2a90 2023-10-06T11:09:09.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.154+0000 7f97f0ff9700 1 -- 172.21.15.146:0/2064226636 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980c053b50 con 0x5574fbfb2a90 2023-10-06T11:09:09.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.154+0000 7f97f0ff9700 1 -- 172.21.15.146:0/2064226636 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 36) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9800033070 con 0x5574fbfb2a90 2023-10-06T11:09:09.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.154+0000 7f9821a0ab80 10 client.5823 fetch_fsmap finished waiting for FSMap version 36 2023-10-06T11:09:09.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.154+0000 7f9821a0ab80 10 client.5823 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-10-06T11:09:09.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.154+0000 7f9821a0ab80 20 client.5823 populate_metadata read hostname 'smithi146' 2023-10-06T11:09:09.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.154+0000 7f9821a0ab80 1 --2- 172.21.15.146:0/2064226636 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x5574fbff0f60 0x5574fbff5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:09.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.154+0000 7f9821a0ab80 4 client.5823 mds_command: new command op to 5481 tid=0[{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}] 2023-10-06T11:09:09.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.154+0000 7f9821a0ab80 1 -- 172.21.15.146:0/2064226636 --> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_0"}) v1 -- 0x5574fbea2ef0 con 0x5574fbff0f60 2023-10-06T11:09:09.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.154+0000 7f98164ae700 1 --2- 172.21.15.146:0/2064226636 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x5574fbff0f60 0x5574fbff5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.155+0000 7f97f0ff9700 10 client.5823 ms_handle_connect on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:09.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.155+0000 7f98164ae700 1 --2- 172.21.15.146:0/2064226636 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x5574fbff0f60 0x5574fbff5370 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a103f26890323e0f server_cookie=88d604ab924373fa in_seq=0 out_seq=0 2023-10-06T11:09:09.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.155+0000 7f97f0ff9700 1 -- 172.21.15.146:0/2064226636 <== mds.0 v2:172.21.15.146:6835/2252184844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5574fbea2ef0 con 0x5574fbff0f60 2023-10-06T11:09:09.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.155+0000 7f97f0ff9700 10 client.5823 handle_command_reply: tid=0 2023-10-06T11:09:09.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.155+0000 7f9821a0ab80 1 client.5823 shutdown 2023-10-06T11:09:09.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.155+0000 7f9821a0ab80 1 -- 172.21.15.146:0/2064226636 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5574fbfb2a90 msgr2=0x5574fc0457f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:09.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.155+0000 7f9821a0ab80 1 --2- 172.21.15.146:0/2064226636 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5574fbfb2a90 0x5574fc0457f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9800006ec0 tx=0x7f9800021000 comp rx=0 tx=0).stop 2023-10-06T11:09:09.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.155+0000 7f9821a0ab80 1 -- 172.21.15.146:0/2064226636 shutdown_connections 2023-10-06T11:09:09.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.155+0000 7f9821a0ab80 1 --2- 172.21.15.146:0/2064226636 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x5574fbff0f60 0x5574fbff5370 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.155+0000 7f9821a0ab80 1 --2- 172.21.15.146:0/2064226636 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5574fbff6b80 0x5574fbff0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.155+0000 7f9821a0ab80 1 --2- 172.21.15.146:0/2064226636 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5574fbfb0cc0 0x5574fbfb06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.155+0000 7f97f0ff9700 0 client.5823 ms_handle_reset on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:09.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.155+0000 7f9821a0ab80 1 --2- 172.21.15.146:0/2064226636 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5574fbfb2a90 0x5574fc0457f0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.155+0000 7f9821a0ab80 1 -- 172.21.15.146:0/2064226636 >> 172.21.15.146:0/2064226636 conn(0x5574fbfb1160 msgr2=0x5574fbfd8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:09.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.155+0000 7f9821a0ab80 1 -- 172.21.15.146:0/2064226636 shutdown_connections 2023-10-06T11:09:09.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.155+0000 7f9821a0ab80 1 -- 172.21.15.146:0/2064226636 wait complete. 2023-10-06T11:09:09.164 INFO:tasks.ceph.mds.c.smithi146.stderr:2023-10-06T11:09:09.155+0000 7ff437454700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a46 [2,head] /scrub_test_path/ceph-qa-suite/new_file_0 auth v628 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={5670=0-4194304@1} caps={5670=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5670 | request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x5566dd7b0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000a46:[<0x10000000001/new_file_0 v628>,<0x10000000000/ceph-qa-suite v65>,<0x1/scrub_test_path v21>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":-61} 2023-10-06T11:09:09.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.155+0000 7f9821a0ab80 20 client.5823 trim_cache size 0 max 16384 2023-10-06T11:09:09.165 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:09:09.165 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0, 2023-10-06T11:09:09.165 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_tag": "4246ec7a-b5ef-488c-b232-1059cb013fc0", 2023-10-06T11:09:09.165 INFO:teuthology.orchestra.run.smithi146.stdout: "mode": "asynchronous" 2023-10-06T11:09:09.165 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:09:09.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.156+0000 7f9818712700 1 -- 172.21.15.146:0/3520910984 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f97f4066f30 msgr2=0x7f97f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:09.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.156+0000 7f9818712700 1 --2- 172.21.15.146:0/3520910984 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f97f4066f30 0x7f97f40693e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f98000093f0 tx=0x7f9800017000 comp rx=0 tx=0).stop 2023-10-06T11:09:09.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.156+0000 7f9818712700 1 -- 172.21.15.146:0/3520910984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98100abfe0 msgr2=0x7f9810152690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:09.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.156+0000 7f9818712700 1 --2- 172.21.15.146:0/3520910984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98100abfe0 0x7f9810152690 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f980c00cd80 tx=0x7f980c001ae0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.156+0000 7f9818712700 1 -- 172.21.15.146:0/3520910984 shutdown_connections 2023-10-06T11:09:09.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.156+0000 7f9818712700 1 --2- 172.21.15.146:0/3520910984 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f97f4066f30 0x7f97f40693e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.156+0000 7f9818712700 1 --2- 172.21.15.146:0/3520910984 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98100ceb50 0x7f98101680d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.156+0000 7f9818712700 1 --2- 172.21.15.146:0/3520910984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98100abfe0 0x7f9810152690 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.156+0000 7f9818712700 1 --2- 172.21.15.146:0/3520910984 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f98100ac3b0 0x7f9810167b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.156+0000 7f9818712700 1 -- 172.21.15.146:0/3520910984 >> 172.21.15.146:0/3520910984 conn(0x7f9810067c50 msgr2=0x7f98100b3520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:09.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.156+0000 7f9818712700 1 -- 172.21.15.146:0/3520910984 shutdown_connections 2023-10-06T11:09:09.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.156+0000 7f9818712700 1 -- 172.21.15.146:0/3520910984 wait complete. 2023-10-06T11:09:09.169 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_0' returned '{'return_code': 0, 'scrub_tag': '4246ec7a-b5ef-488c-b232-1059cb013fc0', 'mode': 'asynchronous'}' 2023-10-06T11:09:09.169 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub status 2023-10-06T11:09:09.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.285+0000 7f62148fa700 1 Processor -- start 2023-10-06T11:09:09.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.285+0000 7f62148fa700 1 -- start start 2023-10-06T11:09:09.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.286+0000 7f62148fa700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f62101595d0 0x7f6210068480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:09.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.286+0000 7f62148fa700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62100c8b80 con 0x7f621006ec90 2023-10-06T11:09:09.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.286+0000 7f62148fa700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62100c7fb0 con 0x7f62100689c0 2023-10-06T11:09:09.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.286+0000 7f62148fa700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62100ca7d0 con 0x7f62101595d0 2023-10-06T11:09:09.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.286+0000 7f620ffff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f621006ec90 0x7f6210069d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38842/0 (socket says 172.21.15.146:38842) 2023-10-06T11:09:09.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.286+0000 7f620ffff700 1 -- 172.21.15.146:0/2608594823 learned_addr learned my addr 172.21.15.146:0/2608594823 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:09.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.286+0000 7f620e7fc700 1 -- 172.21.15.146:0/2608594823 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3521552845 0 0) 0x7f62100c8b80 con 0x7f621006ec90 2023-10-06T11:09:09.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.286+0000 7f620f7fe700 1 --2- 172.21.15.146:0/2608594823 >> v2:172.21.15.151:3300/0 conn(0x7f62101595d0 0x7f6210068480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.286+0000 7f620e7fc700 1 -- 172.21.15.146:0/2608594823 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61fc003570 con 0x7f621006ec90 2023-10-06T11:09:09.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.286+0000 7f620e7fc700 1 -- 172.21.15.146:0/2608594823 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 699376628 0 0) 0x7f61fc003570 con 0x7f621006ec90 2023-10-06T11:09:09.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.286+0000 7f620e7fc700 1 -- 172.21.15.146:0/2608594823 >> v2:172.21.15.151:3300/0 conn(0x7f62101595d0 msgr2=0x7f6210068480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:09.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.286+0000 7f620e7fc700 1 --2- 172.21.15.146:0/2608594823 >> v2:172.21.15.151:3300/0 conn(0x7f62101595d0 0x7f6210068480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.286+0000 7f620e7fc700 1 -- 172.21.15.146:0/2608594823 >> v1:172.21.15.151:6789/0 conn(0x7f62100689c0 legacy=0x7f621006e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:09.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.286+0000 7f620e7fc700 1 -- 172.21.15.146:0/2608594823 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62100c8250 con 0x7f621006ec90 2023-10-06T11:09:09.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.286+0000 7f620e7fc700 1 -- 172.21.15.146:0/2608594823 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f6200001470 con 0x7f621006ec90 2023-10-06T11:09:09.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.287+0000 7f620e7fc700 1 -- 172.21.15.146:0/2608594823 >> v1:172.21.15.146:6789/0 conn(0x7f621006ec90 legacy=0x7f6210069d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:09.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.287+0000 7f620e7fc700 1 --2- 172.21.15.146:0/2608594823 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61fc003a60 0x7f61fc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:09.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.287+0000 7f620e7fc700 1 --2- 172.21.15.146:0/2608594823 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61fc004810 0x7f61fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:09.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.287+0000 7f620e7fc700 1 --2- 172.21.15.146:0/2608594823 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61fc0051c0 0x7f61fc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:09.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.287+0000 7f620e7fc700 1 -- 172.21.15.146:0/2608594823 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61fc00c130 con 0x7f61fc003a60 2023-10-06T11:09:09.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.287+0000 7f620e7fc700 1 -- 172.21.15.146:0/2608594823 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61fc00c2a0 con 0x7f61fc0051c0 2023-10-06T11:09:09.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.287+0000 7f620e7fc700 1 -- 172.21.15.146:0/2608594823 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61fc00c460 con 0x7f61fc004810 2023-10-06T11:09:09.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.287+0000 7f620f7fe700 1 --2- 172.21.15.146:0/2608594823 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61fc003a60 0x7f61fc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.287+0000 7f620ffff700 1 --2- 172.21.15.146:0/2608594823 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61fc0051c0 0x7f61fc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.287+0000 7f620effd700 1 --2- 172.21.15.146:0/2608594823 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61fc004810 0x7f61fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.287+0000 7f620f7fe700 1 -- 172.21.15.146:0/2608594823 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61fc004810 msgr2=0x7f61fc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:09.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.287+0000 7f620f7fe700 1 --2- 172.21.15.146:0/2608594823 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61fc004810 0x7f61fc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.287+0000 7f620f7fe700 1 -- 172.21.15.146:0/2608594823 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61fc0051c0 msgr2=0x7f61fc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:09.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.287+0000 7f620f7fe700 1 --2- 172.21.15.146:0/2608594823 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61fc0051c0 0x7f61fc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.287+0000 7f620ffff700 1 -- 172.21.15.146:0/2608594823 reap_dead start 2023-10-06T11:09:09.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.287+0000 7f620f7fe700 1 -- 172.21.15.146:0/2608594823 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61fc003570 con 0x7f61fc003a60 2023-10-06T11:09:09.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.287+0000 7f620f7fe700 1 --2- 172.21.15.146:0/2608594823 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61fc003a60 0x7f61fc003e70 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f620800e210 tx=0x7f620800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b4bf4cce23a59f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:09.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.287+0000 7f620e7fc700 1 -- 172.21.15.146:0/2608594823 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620800eac0 con 0x7f61fc003a60 2023-10-06T11:09:09.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.287+0000 7f620e7fc700 1 -- 172.21.15.146:0/2608594823 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f620800f040 con 0x7f61fc003a60 2023-10-06T11:09:09.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.287+0000 7f620e7fc700 1 -- 172.21.15.146:0/2608594823 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620800ee70 con 0x7f61fc003a60 2023-10-06T11:09:09.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.288+0000 7f62148fa700 1 -- 172.21.15.146:0/2608594823 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61fc003a60 msgr2=0x7f61fc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:09.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.288+0000 7f62148fa700 1 --2- 172.21.15.146:0/2608594823 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61fc003a60 0x7f61fc003e70 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f620800e210 tx=0x7f620800b040 comp rx=0 tx=0).stop 2023-10-06T11:09:09.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.288+0000 7f62148fa700 1 -- 172.21.15.146:0/2608594823 shutdown_connections 2023-10-06T11:09:09.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.288+0000 7f62148fa700 1 --2- 172.21.15.146:0/2608594823 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61fc003a60 0x7f61fc003e70 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.288+0000 7f62148fa700 1 -- 172.21.15.146:0/2608594823 >> 172.21.15.146:0/2608594823 conn(0x7f62100c9dc0 msgr2=0x7f621006dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:09.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.288+0000 7f62148fa700 1 -- 172.21.15.146:0/2608594823 shutdown_connections 2023-10-06T11:09:09.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.288+0000 7f62148fa700 1 -- 172.21.15.146:0/2608594823 wait complete. 2023-10-06T11:09:09.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.289+0000 7f62148fa700 1 Processor -- start 2023-10-06T11:09:09.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.289+0000 7f62148fa700 1 -- start start 2023-10-06T11:09:09.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.290+0000 7f62148fa700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61fc003a60 0x7f62100b11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:09.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.290+0000 7f62148fa700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62100b19d0 0x7f621015ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:09.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.290+0000 7f62148fa700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62100c5d50 0x7f62100c61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:09.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.290+0000 7f62148fa700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621015a890 con 0x7f61fc003a60 2023-10-06T11:09:09.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.290+0000 7f62148fa700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62100b1700 con 0x7f62100c5d50 2023-10-06T11:09:09.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.290+0000 7f62148fa700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62101599a0 con 0x7f62100b19d0 2023-10-06T11:09:09.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.290+0000 7f620f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61fc003a60 0x7f62100b11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.290+0000 7f620f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61fc003a60 0x7f62100b11c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49354/0 (socket says 172.21.15.146:49354) 2023-10-06T11:09:09.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.290+0000 7f620f7fe700 1 -- 172.21.15.146:0/1474868974 learned_addr learned my addr 172.21.15.146:0/1474868974 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:09.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.290+0000 7f620f7fe700 1 -- 172.21.15.146:0/1474868974 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62100b19d0 msgr2=0x7f621015ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:09.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.290+0000 7f620effd700 1 --2- 172.21.15.146:0/1474868974 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62100b19d0 0x7f621015ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.290+0000 7f620ffff700 1 --2- 172.21.15.146:0/1474868974 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62100c5d50 0x7f62100c61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.290+0000 7f620f7fe700 1 --2- 172.21.15.146:0/1474868974 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62100b19d0 0x7f621015ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.290+0000 7f620f7fe700 1 -- 172.21.15.146:0/1474868974 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62100c5d50 msgr2=0x7f62100c61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:09.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.290+0000 7f620f7fe700 1 --2- 172.21.15.146:0/1474868974 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62100c5d50 0x7f62100c61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.290+0000 7f620f7fe700 1 -- 172.21.15.146:0/1474868974 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6210159c80 con 0x7f61fc003a60 2023-10-06T11:09:09.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.290+0000 7f620effd700 1 --2- 172.21.15.146:0/1474868974 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62100b19d0 0x7f621015ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:09:09.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.290+0000 7f620ffff700 1 --2- 172.21.15.146:0/1474868974 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62100c5d50 0x7f62100c61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:09:09.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.291+0000 7f620f7fe700 1 --2- 172.21.15.146:0/1474868974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61fc003a60 0x7f62100b11c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f620800afd0 tx=0x7f620801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:09.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.291+0000 7f62077fe700 1 -- 172.21.15.146:0/1474868974 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6208029450 con 0x7f61fc003a60 2023-10-06T11:09:09.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.291+0000 7f62077fe700 1 -- 172.21.15.146:0/1474868974 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62080295b0 con 0x7f61fc003a60 2023-10-06T11:09:09.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.291+0000 7f62148fa700 1 -- 172.21.15.146:0/1474868974 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6210159f60 con 0x7f61fc003a60 2023-10-06T11:09:09.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.291+0000 7f62077fe700 1 -- 172.21.15.146:0/1474868974 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62080299b0 con 0x7f61fc003a60 2023-10-06T11:09:09.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.291+0000 7f62148fa700 1 -- 172.21.15.146:0/1474868974 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f621015a520 con 0x7f61fc003a60 2023-10-06T11:09:09.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.292+0000 7f62077fe700 1 -- 172.21.15.146:0/1474868974 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6208003040 con 0x7f61fc003a60 2023-10-06T11:09:09.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.293+0000 7f62077fe700 1 --2- 172.21.15.146:0/1474868974 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f61f0066f30 0x7f61f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:09.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.293+0000 7f620effd700 1 --2- 172.21.15.146:0/1474868974 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f61f0066f30 0x7f61f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.293+0000 7f62077fe700 1 -- 172.21.15.146:0/1474868974 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6208086910 con 0x7f61fc003a60 2023-10-06T11:09:09.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.293+0000 7f620effd700 1 --2- 172.21.15.146:0/1474868974 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f61f0066f30 0x7f61f00693e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f61f8007bc0 tx=0x7f61f8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:09.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.295+0000 7f621ee54b80 1 Processor -- start 2023-10-06T11:09:09.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.295+0000 7f621ee54b80 1 -- start start 2023-10-06T11:09:09.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.295+0000 7f621ee54b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557403e269a0 0x557403e26d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:09.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.295+0000 7f621ee54b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557403e70c10 0x557403e4f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:09.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.295+0000 7f621ee54b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557403e4feb0 0x557403e229e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:09.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.295+0000 7f621ee54b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x557403da6cd0 con 0x557403e269a0 2023-10-06T11:09:09.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.295+0000 7f621ee54b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557403d7dac0 con 0x557403e4feb0 2023-10-06T11:09:09.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.295+0000 7f621ee54b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x557403d7b2c0 con 0x557403e70c10 2023-10-06T11:09:09.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.296+0000 7f620f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557403e269a0 0x557403e26d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.296+0000 7f620f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557403e269a0 0x557403e26d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49366/0 (socket says 172.21.15.146:49366) 2023-10-06T11:09:09.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.296+0000 7f620f7fe700 1 -- 172.21.15.146:0/1228597039 learned_addr learned my addr 172.21.15.146:0/1228597039 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:09.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.296+0000 7f620ffff700 1 --2- 172.21.15.146:0/1228597039 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557403e4feb0 0x557403e229e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.296+0000 7f620effd700 1 --2- 172.21.15.146:0/1228597039 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557403e70c10 0x557403e4f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.296+0000 7f620f7fe700 1 -- 172.21.15.146:0/1228597039 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557403e70c10 msgr2=0x557403e4f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:09.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.296+0000 7f620f7fe700 1 --2- 172.21.15.146:0/1228597039 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557403e70c10 0x557403e4f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.296+0000 7f620f7fe700 1 -- 172.21.15.146:0/1228597039 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557403e4feb0 msgr2=0x557403e229e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:09.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.296+0000 7f620f7fe700 1 --2- 172.21.15.146:0/1228597039 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557403e4feb0 0x557403e229e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.296+0000 7f620f7fe700 1 -- 172.21.15.146:0/1228597039 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557403c112c0 con 0x557403e269a0 2023-10-06T11:09:09.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.296+0000 7f620ffff700 1 --2- 172.21.15.146:0/1228597039 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557403e4feb0 0x557403e229e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:09:09.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.296+0000 7f620effd700 1 --2- 172.21.15.146:0/1228597039 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557403e70c10 0x557403e4f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:09:09.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.296+0000 7f620f7fe700 1 --2- 172.21.15.146:0/1228597039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557403e269a0 0x557403e26d70 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f6208053be0 tx=0x7f6208084c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7c62e8c891f2a67 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:09.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.296+0000 7f6204ff9700 1 -- 172.21.15.146:0/1228597039 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6208057de0 con 0x557403e269a0 2023-10-06T11:09:09.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.296+0000 7f6204ff9700 1 -- 172.21.15.146:0/1228597039 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62080576e0 con 0x557403e269a0 2023-10-06T11:09:09.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.296+0000 7f6204ff9700 1 -- 172.21.15.146:0/1228597039 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620805a930 con 0x557403e269a0 2023-10-06T11:09:09.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.297+0000 7f621ee54b80 1 -- 172.21.15.146:0/1228597039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557403e269a0 msgr2=0x557403e26d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:09.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.297+0000 7f621ee54b80 1 --2- 172.21.15.146:0/1228597039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557403e269a0 0x557403e26d70 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f6208053be0 tx=0x7f6208084c30 comp rx=0 tx=0).stop 2023-10-06T11:09:09.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.297+0000 7f621ee54b80 1 -- 172.21.15.146:0/1228597039 shutdown_connections 2023-10-06T11:09:09.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.297+0000 7f621ee54b80 1 --2- 172.21.15.146:0/1228597039 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557403e4feb0 0x557403e229e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.297+0000 7f621ee54b80 1 --2- 172.21.15.146:0/1228597039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557403e269a0 0x557403e26d70 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.297+0000 7f621ee54b80 1 --2- 172.21.15.146:0/1228597039 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557403e70c10 0x557403e4f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.297+0000 7f621ee54b80 1 -- 172.21.15.146:0/1228597039 >> 172.21.15.146:0/1228597039 conn(0x557403e282c0 msgr2=0x557403e28690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:09.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.297+0000 7f621ee54b80 1 -- 172.21.15.146:0/1228597039 shutdown_connections 2023-10-06T11:09:09.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.297+0000 7f621ee54b80 1 -- 172.21.15.146:0/1228597039 wait complete. 2023-10-06T11:09:09.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.297+0000 7f621ee54b80 1 -- start start 2023-10-06T11:09:09.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.298+0000 7f621ee54b80 1 Processor -- start 2023-10-06T11:09:09.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.298+0000 7f621ee54b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557403e269a0 0x557403e4bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:09.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.298+0000 7f621ee54b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557403e4feb0 0x557403e3ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:09.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.298+0000 7f621ee54b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557403e70c10 0x557403e1d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:09.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.298+0000 7f621ee54b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x557403d770b0 con 0x557403e4feb0 2023-10-06T11:09:09.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.298+0000 7f621ee54b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557403d228e0 con 0x557403e70c10 2023-10-06T11:09:09.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.298+0000 7f621ee54b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x557403d3def0 con 0x557403e269a0 2023-10-06T11:09:09.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.298+0000 7f620effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557403e4feb0 0x557403e3ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.298+0000 7f621ee54b80 10 client.0 _ll_register_callbacks cb 0x557403c13f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:09:09.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.298+0000 7f620effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557403e4feb0 0x557403e3ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49376/0 (socket says 172.21.15.146:49376) 2023-10-06T11:09:09.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.298+0000 7f620effd700 1 -- 172.21.15.146:0/1553558805 learned_addr learned my addr 172.21.15.146:0/1553558805 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:09.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.298+0000 7f620f7fe700 1 --2- 172.21.15.146:0/1553558805 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557403e269a0 0x557403e4bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.299+0000 7f620ffff700 1 --2- 172.21.15.146:0/1553558805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557403e70c10 0x557403e1d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.299+0000 7f620effd700 1 -- 172.21.15.146:0/1553558805 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557403e269a0 msgr2=0x557403e4bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:09.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.299+0000 7f620effd700 1 --2- 172.21.15.146:0/1553558805 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557403e269a0 0x557403e4bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.299+0000 7f620effd700 1 -- 172.21.15.146:0/1553558805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557403e70c10 msgr2=0x557403e1d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:09.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.299+0000 7f620effd700 1 --2- 172.21.15.146:0/1553558805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557403e70c10 0x557403e1d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.299+0000 7f620effd700 1 -- 172.21.15.146:0/1553558805 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f621015a520 con 0x557403e4feb0 2023-10-06T11:09:09.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.299+0000 7f620effd700 1 --2- 172.21.15.146:0/1553558805 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557403e4feb0 0x557403e3ffa0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f62100ae610 tx=0x7f61f8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b81f35433155444 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:09.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.299+0000 7f61edffb700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:09:09.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.299+0000 7f61edffb700 1 -- 172.21.15.146:0/1553558805 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f8015e80 con 0x557403e4feb0 2023-10-06T11:09:09.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.299+0000 7f61edffb700 1 -- 172.21.15.146:0/1553558805 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f61f8021420 con 0x557403e4feb0 2023-10-06T11:09:09.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.299+0000 7f621ee54b80 1 -- 172.21.15.146:0/1553558805 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557403e1b6e0 con 0x557403e4feb0 2023-10-06T11:09:09.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.299+0000 7f61edffb700 1 -- 172.21.15.146:0/1553558805 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61f80217f0 con 0x557403e4feb0 2023-10-06T11:09:09.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.299+0000 7f621ee54b80 10 client.5835 fetch_fsmap learned FSMap version 36 2023-10-06T11:09:09.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.299+0000 7f621ee54b80 1 -- 172.21.15.146:0/1553558805 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x557403bb4030 con 0x557403e4feb0 2023-10-06T11:09:09.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.299+0000 7f61edffb700 1 -- 172.21.15.146:0/1553558805 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557403e1b6e0 con 0x557403e4feb0 2023-10-06T11:09:09.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.299+0000 7f61edffb700 1 -- 172.21.15.146:0/1553558805 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 36) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f61f8021950 con 0x557403e4feb0 2023-10-06T11:09:09.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.299+0000 7f621ee54b80 10 client.5835 fetch_fsmap finished waiting for FSMap version 36 2023-10-06T11:09:09.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.299+0000 7f621ee54b80 10 client.5835 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-10-06T11:09:09.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.299+0000 7f621ee54b80 20 client.5835 populate_metadata read hostname 'smithi146' 2023-10-06T11:09:09.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.299+0000 7f621ee54b80 1 --2- 172.21.15.146:0/1553558805 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x557403e7d560 0x557403e6ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:09.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.299+0000 7f621ee54b80 4 client.5835 mds_command: new command op to 5481 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:09:09.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.299+0000 7f621ee54b80 1 -- 172.21.15.146:0/1553558805 --> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557403df8610 con 0x557403e7d560 2023-10-06T11:09:09.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.300+0000 7f620f7fe700 1 --2- 172.21.15.146:0/1553558805 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x557403e7d560 0x557403e6ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.300+0000 7f61edffb700 10 client.5835 ms_handle_connect on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:09.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.300+0000 7f620f7fe700 1 --2- 172.21.15.146:0/1553558805 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x557403e7d560 0x557403e6ebe0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab13da091c525e46 server_cookie=e46d526ef8cc5d88 in_seq=0 out_seq=0 2023-10-06T11:09:09.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.300+0000 7f61edffb700 1 -- 172.21.15.146:0/1553558805 <== mds.0 v2:172.21.15.146:6835/2252184844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x557403df8610 con 0x557403e7d560 2023-10-06T11:09:09.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.300+0000 7f61edffb700 10 client.5835 handle_command_reply: tid=0 2023-10-06T11:09:09.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.300+0000 7f621ee54b80 1 client.5835 shutdown 2023-10-06T11:09:09.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.300+0000 7f621ee54b80 1 -- 172.21.15.146:0/1553558805 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557403e4feb0 msgr2=0x557403e3ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:09.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.300+0000 7f621ee54b80 1 --2- 172.21.15.146:0/1553558805 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557403e4feb0 0x557403e3ffa0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f62100ae610 tx=0x7f61f8016000 comp rx=0 tx=0).stop 2023-10-06T11:09:09.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.300+0000 7f621ee54b80 1 -- 172.21.15.146:0/1553558805 shutdown_connections 2023-10-06T11:09:09.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.300+0000 7f621ee54b80 1 --2- 172.21.15.146:0/1553558805 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x557403e7d560 0x557403e6ebe0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.300+0000 7f621ee54b80 1 --2- 172.21.15.146:0/1553558805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557403e70c10 0x557403e1d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.300+0000 7f621ee54b80 1 --2- 172.21.15.146:0/1553558805 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557403e269a0 0x557403e4bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.300+0000 7f61edffb700 0 client.5835 ms_handle_reset on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:09.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.300+0000 7f621ee54b80 1 --2- 172.21.15.146:0/1553558805 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557403e4feb0 0x557403e3ffa0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.300+0000 7f621ee54b80 1 -- 172.21.15.146:0/1553558805 >> 172.21.15.146:0/1553558805 conn(0x557403e282c0 msgr2=0x557403e4c850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:09.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.301+0000 7f621ee54b80 1 -- 172.21.15.146:0/1553558805 shutdown_connections 2023-10-06T11:09:09.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.301+0000 7f621ee54b80 1 -- 172.21.15.146:0/1553558805 wait complete. 2023-10-06T11:09:09.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.301+0000 7f621ee54b80 20 client.5835 trim_cache size 0 max 16384 2023-10-06T11:09:09.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.317+0000 7f621ee54b80 1 Processor -- start 2023-10-06T11:09:09.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.317+0000 7f621ee54b80 1 -- start start 2023-10-06T11:09:09.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.318+0000 7f621ee54b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557403e269a0 0x557403e4f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:09.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.318+0000 7f621ee54b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557403e4feb0 0x557403e27bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:09.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.318+0000 7f621ee54b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557403e70c10 0x557403e27310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:09.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.318+0000 7f621ee54b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x557403bf9e80 con 0x557403e70c10 2023-10-06T11:09:09.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.318+0000 7f621ee54b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557403e27a50 con 0x557403e269a0 2023-10-06T11:09:09.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.318+0000 7f621ee54b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x557403e27850 con 0x557403e4feb0 2023-10-06T11:09:09.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.318+0000 7f620ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557403e70c10 0x557403e27310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.318+0000 7f620ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557403e70c10 0x557403e27310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49382/0 (socket says 172.21.15.146:49382) 2023-10-06T11:09:09.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.318+0000 7f620ffff700 1 -- 172.21.15.146:0/1910713172 learned_addr learned my addr 172.21.15.146:0/1910713172 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:09.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.318+0000 7f620effd700 1 --2- 172.21.15.146:0/1910713172 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557403e4feb0 0x557403e27bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.318+0000 7f620ffff700 1 -- 172.21.15.146:0/1910713172 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557403e4feb0 msgr2=0x557403e27bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:09.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.318+0000 7f620ffff700 1 --2- 172.21.15.146:0/1910713172 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557403e4feb0 0x557403e27bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.318+0000 7f620ffff700 1 -- 172.21.15.146:0/1910713172 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557403e269a0 msgr2=0x557403e4f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:09.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.318+0000 7f620ffff700 1 --2- 172.21.15.146:0/1910713172 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557403e269a0 0x557403e4f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.318+0000 7f620ffff700 1 -- 172.21.15.146:0/1910713172 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557403d457d0 con 0x557403e70c10 2023-10-06T11:09:09.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.318+0000 7f620ffff700 1 --2- 172.21.15.146:0/1910713172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557403e70c10 0x557403e27310 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f6200000c00 tx=0x7f6200009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44a2a7b212d5dc74 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:09.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.318+0000 7f62057fa700 1 -- 172.21.15.146:0/1910713172 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6200007120 con 0x557403e70c10 2023-10-06T11:09:09.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.318+0000 7f62057fa700 1 -- 172.21.15.146:0/1910713172 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6200007280 con 0x557403e70c10 2023-10-06T11:09:09.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.318+0000 7f62057fa700 1 -- 172.21.15.146:0/1910713172 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6200007640 con 0x557403e70c10 2023-10-06T11:09:09.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.319+0000 7f621ee54b80 1 -- 172.21.15.146:0/1910713172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557403e70c10 msgr2=0x557403e27310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:09.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.319+0000 7f621ee54b80 1 --2- 172.21.15.146:0/1910713172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557403e70c10 0x557403e27310 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f6200000c00 tx=0x7f6200009040 comp rx=0 tx=0).stop 2023-10-06T11:09:09.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.319+0000 7f621ee54b80 1 -- 172.21.15.146:0/1910713172 shutdown_connections 2023-10-06T11:09:09.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.319+0000 7f621ee54b80 1 --2- 172.21.15.146:0/1910713172 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557403e70c10 0x557403e27310 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.319+0000 7f621ee54b80 1 --2- 172.21.15.146:0/1910713172 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557403e269a0 0x557403e4f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.319+0000 7f621ee54b80 1 --2- 172.21.15.146:0/1910713172 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557403e4feb0 0x557403e27bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.319+0000 7f621ee54b80 1 -- 172.21.15.146:0/1910713172 >> 172.21.15.146:0/1910713172 conn(0x557403e282c0 msgr2=0x557403e4c850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:09.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.319+0000 7f621ee54b80 1 -- 172.21.15.146:0/1910713172 shutdown_connections 2023-10-06T11:09:09.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.319+0000 7f621ee54b80 1 -- 172.21.15.146:0/1910713172 wait complete. 2023-10-06T11:09:09.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.319+0000 7f621ee54b80 1 -- start start 2023-10-06T11:09:09.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.319+0000 7f621ee54b80 1 Processor -- start 2023-10-06T11:09:09.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.320+0000 7f621ee54b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557403e269a0 0x557403e66860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:09.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.320+0000 7f621ee54b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557403e4feb0 0x557403ed2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:09.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.320+0000 7f621ee54b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557403e70c10 0x557403e70fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:09.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.320+0000 7f621ee54b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x557403e7d260 con 0x557403e269a0 2023-10-06T11:09:09.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.320+0000 7f621ee54b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557403e71de0 con 0x557403e4feb0 2023-10-06T11:09:09.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.320+0000 7f621ee54b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x557403e23b20 con 0x557403e70c10 2023-10-06T11:09:09.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.320+0000 7f621ee54b80 10 client.0 _ll_register_callbacks cb 0x557403c13f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:09:09.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.320+0000 7f620f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557403e269a0 0x557403e66860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.320+0000 7f620f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557403e269a0 0x557403e66860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49398/0 (socket says 172.21.15.146:49398) 2023-10-06T11:09:09.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.320+0000 7f620f7fe700 1 -- 172.21.15.146:0/897051189 learned_addr learned my addr 172.21.15.146:0/897051189 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:09.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.320+0000 7f620effd700 1 --2- 172.21.15.146:0/897051189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557403e4feb0 0x557403ed2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.320+0000 7f620ffff700 1 --2- 172.21.15.146:0/897051189 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557403e70c10 0x557403e70fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.320+0000 7f620f7fe700 1 -- 172.21.15.146:0/897051189 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557403e70c10 msgr2=0x557403e70fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:09.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.320+0000 7f620f7fe700 1 --2- 172.21.15.146:0/897051189 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557403e70c10 0x557403e70fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.320+0000 7f620f7fe700 1 -- 172.21.15.146:0/897051189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557403e4feb0 msgr2=0x557403ed2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:09.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.320+0000 7f620f7fe700 1 --2- 172.21.15.146:0/897051189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557403e4feb0 0x557403ed2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.320+0000 7f620f7fe700 1 -- 172.21.15.146:0/897051189 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f620000f040 con 0x557403e269a0 2023-10-06T11:09:09.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.320+0000 7f620ffff700 1 --2- 172.21.15.146:0/897051189 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557403e70c10 0x557403e70fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:09.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.321+0000 7f620f7fe700 1 --2- 172.21.15.146:0/897051189 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557403e269a0 0x557403e66860 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f6208084db0 tx=0x7f620806f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45daba9c1eb91358 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:09.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.321+0000 7f61edffb700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:09:09.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.321+0000 7f61edffb700 1 -- 172.21.15.146:0/897051189 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620805e680 con 0x557403e269a0 2023-10-06T11:09:09.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.321+0000 7f61edffb700 1 -- 172.21.15.146:0/897051189 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f620805a930 con 0x557403e269a0 2023-10-06T11:09:09.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.321+0000 7f621ee54b80 1 -- 172.21.15.146:0/897051189 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f62080576e0 con 0x557403e269a0 2023-10-06T11:09:09.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.321+0000 7f61edffb700 1 -- 172.21.15.146:0/897051189 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6208073280 con 0x557403e269a0 2023-10-06T11:09:09.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.321+0000 7f621ee54b80 10 client.5841 fetch_fsmap learned FSMap version 36 2023-10-06T11:09:09.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.321+0000 7f621ee54b80 1 -- 172.21.15.146:0/897051189 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x557403d2c4c0 con 0x557403e269a0 2023-10-06T11:09:09.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.321+0000 7f61edffb700 1 -- 172.21.15.146:0/897051189 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62080576e0 con 0x557403e269a0 2023-10-06T11:09:09.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.321+0000 7f61edffb700 1 -- 172.21.15.146:0/897051189 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 36) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f6208056bd0 con 0x557403e269a0 2023-10-06T11:09:09.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.321+0000 7f621ee54b80 10 client.5841 fetch_fsmap finished waiting for FSMap version 36 2023-10-06T11:09:09.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.321+0000 7f621ee54b80 10 client.5841 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-10-06T11:09:09.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.321+0000 7f621ee54b80 20 client.5841 populate_metadata read hostname 'smithi146' 2023-10-06T11:09:09.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.321+0000 7f621ee54b80 1 --2- 172.21.15.146:0/897051189 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x557403e4f130 0x557403e71520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:09.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.321+0000 7f621ee54b80 4 client.5841 mds_command: new command op to 5481 tid=0[{"prefix": "scrub status"}] 2023-10-06T11:09:09.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.321+0000 7f621ee54b80 1 -- 172.21.15.146:0/897051189 --> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x557403d19e50 con 0x557403e4f130 2023-10-06T11:09:09.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.321+0000 7f620effd700 1 --2- 172.21.15.146:0/897051189 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x557403e4f130 0x557403e71520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:09.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.321+0000 7f61edffb700 10 client.5841 ms_handle_connect on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:09.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.321+0000 7f620effd700 1 --2- 172.21.15.146:0/897051189 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x557403e4f130 0x557403e71520 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=695ebaf1ef0d9448 server_cookie=a1f271566016782a in_seq=0 out_seq=0 2023-10-06T11:09:09.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.322+0000 7f61edffb700 1 -- 172.21.15.146:0/897051189 <== mds.0 v2:172.21.15.146:6835/2252184844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+284 (crc 0 0 0) 0x557403d19e50 con 0x557403e4f130 2023-10-06T11:09:09.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.322+0000 7f61edffb700 10 client.5841 handle_command_reply: tid=0 2023-10-06T11:09:09.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.322+0000 7f621ee54b80 1 client.5841 shutdown 2023-10-06T11:09:09.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.322+0000 7f621ee54b80 1 -- 172.21.15.146:0/897051189 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557403e269a0 msgr2=0x557403e66860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:09.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.322+0000 7f621ee54b80 1 --2- 172.21.15.146:0/897051189 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557403e269a0 0x557403e66860 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f6208084db0 tx=0x7f620806f040 comp rx=0 tx=0).stop 2023-10-06T11:09:09.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.322+0000 7f621ee54b80 1 -- 172.21.15.146:0/897051189 shutdown_connections 2023-10-06T11:09:09.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.322+0000 7f621ee54b80 1 --2- 172.21.15.146:0/897051189 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x557403e4f130 0x557403e71520 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.322+0000 7f621ee54b80 1 --2- 172.21.15.146:0/897051189 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557403e70c10 0x557403e70fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.322+0000 7f61edffb700 0 client.5841 ms_handle_reset on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:09.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.322+0000 7f621ee54b80 1 --2- 172.21.15.146:0/897051189 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557403e269a0 0x557403e66860 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.322+0000 7f621ee54b80 1 --2- 172.21.15.146:0/897051189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557403e4feb0 0x557403ed2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.322+0000 7f621ee54b80 1 -- 172.21.15.146:0/897051189 >> 172.21.15.146:0/897051189 conn(0x557403e282c0 msgr2=0x557403e4c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:09.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.322+0000 7f621ee54b80 1 -- 172.21.15.146:0/897051189 shutdown_connections 2023-10-06T11:09:09.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.322+0000 7f621ee54b80 1 -- 172.21.15.146:0/897051189 wait complete. 2023-10-06T11:09:09.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.322+0000 7f621ee54b80 20 client.5841 trim_cache size 0 max 16384 2023-10-06T11:09:09.332 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:09:09.332 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-06T11:09:09.332 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": { 2023-10-06T11:09:09.332 INFO:teuthology.orchestra.run.smithi146.stdout: "4246ec7a-b5ef-488c-b232-1059cb013fc0": { 2023-10-06T11:09:09.333 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0", 2023-10-06T11:09:09.333 INFO:teuthology.orchestra.run.smithi146.stdout: "tag": "4246ec7a-b5ef-488c-b232-1059cb013fc0", 2023-10-06T11:09:09.333 INFO:teuthology.orchestra.run.smithi146.stdout: "options": "" 2023-10-06T11:09:09.333 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:09:09.333 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:09:09.333 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:09:09.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.322+0000 7f62148fa700 1 -- 172.21.15.146:0/1474868974 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f61f0066f30 msgr2=0x7f61f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:09.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.322+0000 7f62148fa700 1 --2- 172.21.15.146:0/1474868974 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f61f0066f30 0x7f61f00693e0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f61f8007bc0 tx=0x7f61f8009040 comp rx=0 tx=0).stop 2023-10-06T11:09:09.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.322+0000 7f62148fa700 1 -- 172.21.15.146:0/1474868974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61fc003a60 msgr2=0x7f62100b11c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:09.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.322+0000 7f62148fa700 1 --2- 172.21.15.146:0/1474868974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61fc003a60 0x7f62100b11c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f620800afd0 tx=0x7f620801a000 comp rx=0 tx=0).stop 2023-10-06T11:09:09.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.322+0000 7f62148fa700 1 -- 172.21.15.146:0/1474868974 shutdown_connections 2023-10-06T11:09:09.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.322+0000 7f62148fa700 1 --2- 172.21.15.146:0/1474868974 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f61f0066f30 0x7f61f00693e0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.322+0000 7f62148fa700 1 --2- 172.21.15.146:0/1474868974 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62100c5d50 0x7f62100c61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.322+0000 7f62148fa700 1 --2- 172.21.15.146:0/1474868974 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61fc003a60 0x7f62100b11c0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.322+0000 7f62148fa700 1 --2- 172.21.15.146:0/1474868974 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62100b19d0 0x7f621015ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:09.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.322+0000 7f62148fa700 1 -- 172.21.15.146:0/1474868974 >> 172.21.15.146:0/1474868974 conn(0x7f62100c9dc0 msgr2=0x7f62100c2db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:09.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.322+0000 7f62148fa700 1 -- 172.21.15.146:0/1474868974 shutdown_connections 2023-10-06T11:09:09.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:09.322+0000 7f62148fa700 1 -- 172.21.15.146:0/1474868974 wait complete. 2023-10-06T11:09:14.336 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub status 2023-10-06T11:09:14.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.464+0000 7f4dd2d9c700 1 Processor -- start 2023-10-06T11:09:14.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.464+0000 7f4dd2d9c700 1 -- start start 2023-10-06T11:09:14.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.464+0000 7f4dd2d9c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4dcc06f3a0 0x7f4dcc067470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:14.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.464+0000 7f4dd2d9c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4dcc159ab0 0x7f4dcc0679b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:14.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.464+0000 7f4dd2d9c700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dcc06ef10 con 0x7f4dcc1596e0 2023-10-06T11:09:14.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.464+0000 7f4dd2d9c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dcc0cbe50 con 0x7f4dcc159ab0 2023-10-06T11:09:14.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.464+0000 7f4dd2d9c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dcc06e6b0 con 0x7f4dcc06f3a0 2023-10-06T11:09:14.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.464+0000 7f4dd1339700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4dcc159ab0 0x7f4dcc0679b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:14.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.465+0000 7f4dd1339700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4dcc159ab0 0x7f4dcc0679b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53434/0 (socket says 172.21.15.146:53434) 2023-10-06T11:09:14.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.465+0000 7f4dd1339700 1 -- 172.21.15.146:0/1349097075 learned_addr learned my addr 172.21.15.146:0/1349097075 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:14.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.465+0000 7f4dcbfff700 1 --2- 172.21.15.146:0/1349097075 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4dcc06f3a0 0x7f4dcc067470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:14.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.465+0000 7f4dd1339700 1 -- 172.21.15.146:0/1349097075 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4dcc06f3a0 msgr2=0x7f4dcc067470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:14.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.465+0000 7f4dd1339700 1 --2- 172.21.15.146:0/1349097075 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4dcc06f3a0 0x7f4dcc067470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.465+0000 7f4dd1339700 1 -- 172.21.15.146:0/1349097075 >> v1:172.21.15.151:6789/0 conn(0x7f4dcc1596e0 legacy=0x7f4dcc0cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:14.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.465+0000 7f4dd1339700 1 -- 172.21.15.146:0/1349097075 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dcc0cb8a0 con 0x7f4dcc159ab0 2023-10-06T11:09:14.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.465+0000 7f4dd1339700 1 --2- 172.21.15.146:0/1349097075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4dcc159ab0 0x7f4dcc0679b0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f4dc40099b0 tx=0x7f4dc4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faee4d967a9a4488 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:14.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.465+0000 7f4dcb7fe700 1 -- 172.21.15.146:0/1349097075 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc400b860 con 0x7f4dcc159ab0 2023-10-06T11:09:14.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.465+0000 7f4dcb7fe700 1 -- 172.21.15.146:0/1349097075 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc400b9c0 con 0x7f4dcc159ab0 2023-10-06T11:09:14.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.465+0000 7f4dcb7fe700 1 -- 172.21.15.146:0/1349097075 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc400bd60 con 0x7f4dcc159ab0 2023-10-06T11:09:14.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.466+0000 7f4dd2d9c700 1 -- 172.21.15.146:0/1349097075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4dcc159ab0 msgr2=0x7f4dcc0679b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:14.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.466+0000 7f4dd2d9c700 1 --2- 172.21.15.146:0/1349097075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4dcc159ab0 0x7f4dcc0679b0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f4dc40099b0 tx=0x7f4dc4009250 comp rx=0 tx=0).stop 2023-10-06T11:09:14.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.466+0000 7f4dd2d9c700 1 -- 172.21.15.146:0/1349097075 shutdown_connections 2023-10-06T11:09:14.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.466+0000 7f4dd2d9c700 1 --2- 172.21.15.146:0/1349097075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4dcc159ab0 0x7f4dcc0679b0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.466+0000 7f4dd2d9c700 1 --2- 172.21.15.146:0/1349097075 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4dcc06f3a0 0x7f4dcc067470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.466+0000 7f4dd2d9c700 1 -- 172.21.15.146:0/1349097075 >> 172.21.15.146:0/1349097075 conn(0x7f4dcc069050 msgr2=0x7f4dcc0cd300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:14.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.466+0000 7f4dd2d9c700 1 -- 172.21.15.146:0/1349097075 shutdown_connections 2023-10-06T11:09:14.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.466+0000 7f4dd2d9c700 1 -- 172.21.15.146:0/1349097075 wait complete. 2023-10-06T11:09:14.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.467+0000 7f4dd2d9c700 1 Processor -- start 2023-10-06T11:09:14.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.467+0000 7f4dd2d9c700 1 -- start start 2023-10-06T11:09:14.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.468+0000 7f4dd2d9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4dcc06f3a0 0x7f4dcc157f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:14.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.468+0000 7f4dd2d9c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4dcc1596e0 0x7f4dcc0af260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:14.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.468+0000 7f4dd2d9c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4dcc159ab0 0x7f4dcc0c31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:14.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.468+0000 7f4dd2d9c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dcc1584a0 con 0x7f4dcc1596e0 2023-10-06T11:09:14.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.468+0000 7f4dd2d9c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dcc0b1020 con 0x7f4dcc06f3a0 2023-10-06T11:09:14.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.468+0000 7f4dd2d9c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dcc0adf60 con 0x7f4dcc159ab0 2023-10-06T11:09:14.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.468+0000 7f4dcbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4dcc1596e0 0x7f4dcc0af260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:14.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.468+0000 7f4dcbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4dcc1596e0 0x7f4dcc0af260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53436/0 (socket says 172.21.15.146:53436) 2023-10-06T11:09:14.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.468+0000 7f4dcbfff700 1 -- 172.21.15.146:0/2683764646 learned_addr learned my addr 172.21.15.146:0/2683764646 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:14.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.468+0000 7f4dd1339700 1 --2- 172.21.15.146:0/2683764646 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4dcc159ab0 0x7f4dcc0c31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:14.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.468+0000 7f4dd0b38700 1 --2- 172.21.15.146:0/2683764646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4dcc06f3a0 0x7f4dcc157f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:14.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.468+0000 7f4dcbfff700 1 -- 172.21.15.146:0/2683764646 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4dcc159ab0 msgr2=0x7f4dcc0c31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:14.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.468+0000 7f4dcbfff700 1 --2- 172.21.15.146:0/2683764646 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4dcc159ab0 0x7f4dcc0c31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.468+0000 7f4dcbfff700 1 -- 172.21.15.146:0/2683764646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4dcc06f3a0 msgr2=0x7f4dcc157f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:14.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.468+0000 7f4dcbfff700 1 --2- 172.21.15.146:0/2683764646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4dcc06f3a0 0x7f4dcc157f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.468+0000 7f4dcbfff700 1 -- 172.21.15.146:0/2683764646 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc40094f0 con 0x7f4dcc1596e0 2023-10-06T11:09:14.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.468+0000 7f4dcbfff700 1 --2- 172.21.15.146:0/2683764646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4dcc1596e0 0x7f4dcc0af260 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0006b00 tx=0x7f4dc0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:14.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.468+0000 7f4dc8ff9700 1 -- 172.21.15.146:0/2683764646 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc00125f0 con 0x7f4dcc1596e0 2023-10-06T11:09:14.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.469+0000 7f4dc8ff9700 1 -- 172.21.15.146:0/2683764646 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc0012770 con 0x7f4dcc1596e0 2023-10-06T11:09:14.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.469+0000 7f4dc8ff9700 1 -- 172.21.15.146:0/2683764646 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc0012b30 con 0x7f4dcc1596e0 2023-10-06T11:09:14.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.469+0000 7f4dd2d9c700 1 -- 172.21.15.146:0/2683764646 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dcc0ae240 con 0x7f4dcc1596e0 2023-10-06T11:09:14.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.469+0000 7f4dd2d9c700 1 -- 172.21.15.146:0/2683764646 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dcc0ae800 con 0x7f4dcc1596e0 2023-10-06T11:09:14.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.470+0000 7f4dc8ff9700 1 -- 172.21.15.146:0/2683764646 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4dc001e460 con 0x7f4dcc1596e0 2023-10-06T11:09:14.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.470+0000 7f4dc8ff9700 1 --2- 172.21.15.146:0/2683764646 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4db8066f30 0x7f4db80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:14.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.470+0000 7f4dc8ff9700 1 -- 172.21.15.146:0/2683764646 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4dc0084b90 con 0x7f4dcc1596e0 2023-10-06T11:09:14.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.470+0000 7f4dd0b38700 1 --2- 172.21.15.146:0/2683764646 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4db8066f30 0x7f4db80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:14.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.471+0000 7f4dd0b38700 1 --2- 172.21.15.146:0/2683764646 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4db8066f30 0x7f4db80693e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc007fd0 tx=0x7f4dbc0016f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:14.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.472+0000 7f4ddc094b80 1 Processor -- start 2023-10-06T11:09:14.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.472+0000 7f4ddc094b80 1 -- start start 2023-10-06T11:09:14.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.473+0000 7f4ddc094b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55cd6d94eae0 0x55cd6d94eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:14.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.473+0000 7f4ddc094b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd6d90a9f0 0x55cd6d9075d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:14.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.473+0000 7f4ddc094b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd6d908c20 0x55cd6d907b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:14.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.473+0000 7f4ddc094b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd6d887cd0 con 0x55cd6d908c20 2023-10-06T11:09:14.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.473+0000 7f4ddc094b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd6d85eac0 con 0x55cd6d90a9f0 2023-10-06T11:09:14.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.473+0000 7f4ddc094b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cd6d85c2c0 con 0x55cd6d94eae0 2023-10-06T11:09:14.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.473+0000 7f4dd1339700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd6d908c20 0x55cd6d907b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:14.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.473+0000 7f4dd1339700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd6d908c20 0x55cd6d907b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53448/0 (socket says 172.21.15.146:53448) 2023-10-06T11:09:14.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.473+0000 7f4dd1339700 1 -- 172.21.15.146:0/3454227536 learned_addr learned my addr 172.21.15.146:0/3454227536 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:14.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.473+0000 7f4dd1339700 1 -- 172.21.15.146:0/3454227536 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55cd6d94eae0 msgr2=0x55cd6d94eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:14.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.473+0000 7f4dd1339700 1 --2- 172.21.15.146:0/3454227536 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55cd6d94eae0 0x55cd6d94eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.473+0000 7f4dd1339700 1 -- 172.21.15.146:0/3454227536 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd6d90a9f0 msgr2=0x55cd6d9075d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:14.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.473+0000 7f4dcbfff700 1 --2- 172.21.15.146:0/3454227536 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd6d90a9f0 0x55cd6d9075d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:14.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.473+0000 7f4dd1339700 1 --2- 172.21.15.146:0/3454227536 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd6d90a9f0 0x55cd6d9075d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.473+0000 7f4dd1339700 1 -- 172.21.15.146:0/3454227536 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cd6d6f22c0 con 0x55cd6d908c20 2023-10-06T11:09:14.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.474+0000 7f4dd1339700 1 --2- 172.21.15.146:0/3454227536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd6d908c20 0x55cd6d907b10 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4006fd0 tx=0x7f4dc4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63363a6ded949a29 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:14.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.474+0000 7f4db1ffb700 1 -- 172.21.15.146:0/3454227536 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc4022070 con 0x55cd6d908c20 2023-10-06T11:09:14.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.474+0000 7f4db1ffb700 1 -- 172.21.15.146:0/3454227536 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc400bb30 con 0x55cd6d908c20 2023-10-06T11:09:14.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.474+0000 7f4db1ffb700 1 -- 172.21.15.146:0/3454227536 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc400bed0 con 0x55cd6d908c20 2023-10-06T11:09:14.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.474+0000 7f4ddc094b80 1 -- 172.21.15.146:0/3454227536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd6d908c20 msgr2=0x55cd6d907b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:14.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.474+0000 7f4ddc094b80 1 --2- 172.21.15.146:0/3454227536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd6d908c20 0x55cd6d907b10 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4006fd0 tx=0x7f4dc4017000 comp rx=0 tx=0).stop 2023-10-06T11:09:14.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.474+0000 7f4ddc094b80 1 -- 172.21.15.146:0/3454227536 shutdown_connections 2023-10-06T11:09:14.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.474+0000 7f4ddc094b80 1 --2- 172.21.15.146:0/3454227536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd6d908c20 0x55cd6d907b10 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.474+0000 7f4ddc094b80 1 --2- 172.21.15.146:0/3454227536 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55cd6d94eae0 0x55cd6d94eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.474+0000 7f4ddc094b80 1 --2- 172.21.15.146:0/3454227536 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd6d90a9f0 0x55cd6d9075d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.474+0000 7f4ddc094b80 1 -- 172.21.15.146:0/3454227536 >> 172.21.15.146:0/3454227536 conn(0x55cd6d9090c0 msgr2=0x55cd6d909490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:14.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.474+0000 7f4ddc094b80 1 -- 172.21.15.146:0/3454227536 shutdown_connections 2023-10-06T11:09:14.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.474+0000 7f4ddc094b80 1 -- 172.21.15.146:0/3454227536 wait complete. 2023-10-06T11:09:14.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.475+0000 7f4ddc094b80 1 -- start start 2023-10-06T11:09:14.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.475+0000 7f4ddc094b80 1 Processor -- start 2023-10-06T11:09:14.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.476+0000 7f4ddc094b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd6d908c20 0x55cd6d9325b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:14.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.476+0000 7f4ddc094b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55cd6d90a9f0 0x55cd6d92ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:14.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.476+0000 7f4ddc094b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd6d94eae0 0x55cd6d92f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:14.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.476+0000 7f4ddc094b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd6d8580b0 con 0x55cd6d94eae0 2023-10-06T11:09:14.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.476+0000 7f4ddc094b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd6d8038e0 con 0x55cd6d908c20 2023-10-06T11:09:14.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.476+0000 7f4ddc094b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cd6d81eef0 con 0x55cd6d90a9f0 2023-10-06T11:09:14.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.476+0000 7f4ddc094b80 10 client.0 _ll_register_callbacks cb 0x55cd6d6f4f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:09:14.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.476+0000 7f4dd1339700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd6d94eae0 0x55cd6d92f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:14.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.476+0000 7f4dd1339700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd6d94eae0 0x55cd6d92f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53456/0 (socket says 172.21.15.146:53456) 2023-10-06T11:09:14.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.476+0000 7f4dd1339700 1 -- 172.21.15.146:0/1590434562 learned_addr learned my addr 172.21.15.146:0/1590434562 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:14.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.476+0000 7f4dd0b38700 1 --2- 172.21.15.146:0/1590434562 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd6d908c20 0x55cd6d9325b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:14.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.476+0000 7f4dcbfff700 1 --2- 172.21.15.146:0/1590434562 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55cd6d90a9f0 0x55cd6d92ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:14.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.476+0000 7f4dd1339700 1 -- 172.21.15.146:0/1590434562 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55cd6d90a9f0 msgr2=0x55cd6d92ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:14.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.476+0000 7f4dd1339700 1 --2- 172.21.15.146:0/1590434562 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55cd6d90a9f0 0x55cd6d92ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.476+0000 7f4dd1339700 1 -- 172.21.15.146:0/1590434562 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd6d908c20 msgr2=0x55cd6d9325b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:14.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.476+0000 7f4dd1339700 1 --2- 172.21.15.146:0/1590434562 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd6d908c20 0x55cd6d9325b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.476+0000 7f4dd1339700 1 -- 172.21.15.146:0/1590434562 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dcc0cb8a0 con 0x55cd6d94eae0 2023-10-06T11:09:14.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.476+0000 7f4dd0b38700 1 --2- 172.21.15.146:0/1590434562 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd6d908c20 0x55cd6d9325b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:14.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.476+0000 7f4dd1339700 1 --2- 172.21.15.146:0/1590434562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd6d94eae0 0x55cd6d92f230 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f4dc401f000 tx=0x7f4dc4022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=247a34659423be8e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:14.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.476+0000 7f4daaffd700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:09:14.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.477+0000 7f4daaffd700 1 -- 172.21.15.146:0/1590434562 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc4011a50 con 0x55cd6d94eae0 2023-10-06T11:09:14.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.477+0000 7f4daaffd700 1 -- 172.21.15.146:0/1590434562 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4dc4011bb0 con 0x55cd6d94eae0 2023-10-06T11:09:14.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.477+0000 7f4ddc094b80 1 -- 172.21.15.146:0/1590434562 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cd6d8fc6e0 con 0x55cd6d94eae0 2023-10-06T11:09:14.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.477+0000 7f4daaffd700 1 -- 172.21.15.146:0/1590434562 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4dc4031470 con 0x55cd6d94eae0 2023-10-06T11:09:14.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.477+0000 7f4ddc094b80 10 client.5853 fetch_fsmap learned FSMap version 36 2023-10-06T11:09:14.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.477+0000 7f4ddc094b80 1 -- 172.21.15.146:0/1590434562 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x55cd6d695030 con 0x55cd6d94eae0 2023-10-06T11:09:14.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.477+0000 7f4daaffd700 1 -- 172.21.15.146:0/1590434562 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cd6d8fc6e0 con 0x55cd6d94eae0 2023-10-06T11:09:14.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.477+0000 7f4daaffd700 1 -- 172.21.15.146:0/1590434562 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 36) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4dc40315d0 con 0x55cd6d94eae0 2023-10-06T11:09:14.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.477+0000 7f4ddc094b80 10 client.5853 fetch_fsmap finished waiting for FSMap version 36 2023-10-06T11:09:14.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.477+0000 7f4ddc094b80 10 client.5853 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-10-06T11:09:14.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.477+0000 7f4ddc094b80 20 client.5853 populate_metadata read hostname 'smithi146' 2023-10-06T11:09:14.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.477+0000 7f4ddc094b80 1 --2- 172.21.15.146:0/1590434562 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55cd6d92dec0 0x55cd6d934a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:14.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.477+0000 7f4ddc094b80 4 client.5853 mds_command: new command op to 5481 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:09:14.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.477+0000 7f4ddc094b80 1 -- 172.21.15.146:0/1590434562 --> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cd6d8d9610 con 0x55cd6d92dec0 2023-10-06T11:09:14.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.477+0000 7f4dd0b38700 1 --2- 172.21.15.146:0/1590434562 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55cd6d92dec0 0x55cd6d934a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:14.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.477+0000 7f4dd0b38700 1 --2- 172.21.15.146:0/1590434562 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55cd6d92dec0 0x55cd6d934a90 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43427f5678635e18 server_cookie=6c5ec59952846247 in_seq=0 out_seq=0 2023-10-06T11:09:14.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.477+0000 7f4daaffd700 10 client.5853 ms_handle_connect on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:14.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.478+0000 7f4daaffd700 1 -- 172.21.15.146:0/1590434562 <== mds.0 v2:172.21.15.146:6835/2252184844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55cd6d8d9610 con 0x55cd6d92dec0 2023-10-06T11:09:14.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.478+0000 7f4daaffd700 10 client.5853 handle_command_reply: tid=0 2023-10-06T11:09:14.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.478+0000 7f4ddc094b80 1 client.5853 shutdown 2023-10-06T11:09:14.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.478+0000 7f4ddc094b80 1 -- 172.21.15.146:0/1590434562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd6d94eae0 msgr2=0x55cd6d92f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:14.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.478+0000 7f4ddc094b80 1 --2- 172.21.15.146:0/1590434562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd6d94eae0 0x55cd6d92f230 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f4dc401f000 tx=0x7f4dc4022000 comp rx=0 tx=0).stop 2023-10-06T11:09:14.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.478+0000 7f4ddc094b80 1 -- 172.21.15.146:0/1590434562 shutdown_connections 2023-10-06T11:09:14.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.478+0000 7f4ddc094b80 1 --2- 172.21.15.146:0/1590434562 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55cd6d92dec0 0x55cd6d934a90 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.478+0000 7f4ddc094b80 1 --2- 172.21.15.146:0/1590434562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd6d94eae0 0x55cd6d92f230 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.478+0000 7f4daaffd700 0 client.5853 ms_handle_reset on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:14.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.478+0000 7f4ddc094b80 1 --2- 172.21.15.146:0/1590434562 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd6d908c20 0x55cd6d9325b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.478+0000 7f4ddc094b80 1 --2- 172.21.15.146:0/1590434562 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55cd6d90a9f0 0x55cd6d92ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.478+0000 7f4ddc094b80 1 -- 172.21.15.146:0/1590434562 >> 172.21.15.146:0/1590434562 conn(0x55cd6d9090c0 msgr2=0x55cd6d904870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:14.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.478+0000 7f4ddc094b80 1 -- 172.21.15.146:0/1590434562 shutdown_connections 2023-10-06T11:09:14.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.478+0000 7f4ddc094b80 1 -- 172.21.15.146:0/1590434562 wait complete. 2023-10-06T11:09:14.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.478+0000 7f4ddc094b80 20 client.5853 trim_cache size 0 max 16384 2023-10-06T11:09:14.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.494+0000 7f4ddc094b80 1 Processor -- start 2023-10-06T11:09:14.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.494+0000 7f4ddc094b80 1 -- start start 2023-10-06T11:09:14.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.495+0000 7f4ddc094b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55cd6d908c20 0x55cd6d94ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:14.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.495+0000 7f4ddc094b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd6d90a9f0 0x55cd6d94c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:14.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.495+0000 7f4ddc094b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd6d94eae0 0x55cd6d94cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:14.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.495+0000 7f4ddc094b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd6d6dae80 con 0x55cd6d94eae0 2023-10-06T11:09:14.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.495+0000 7f4ddc094b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd6d8e7080 con 0x55cd6d90a9f0 2023-10-06T11:09:14.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.495+0000 7f4ddc094b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cd6d90a1b0 con 0x55cd6d908c20 2023-10-06T11:09:14.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.495+0000 7f4dd1339700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd6d94eae0 0x55cd6d94cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:14.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.495+0000 7f4dd1339700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd6d94eae0 0x55cd6d94cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53468/0 (socket says 172.21.15.146:53468) 2023-10-06T11:09:14.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.495+0000 7f4dd1339700 1 -- 172.21.15.146:0/775003859 learned_addr learned my addr 172.21.15.146:0/775003859 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:14.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.495+0000 7f4dd1339700 1 -- 172.21.15.146:0/775003859 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55cd6d908c20 msgr2=0x55cd6d94ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:14.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.495+0000 7f4dd1339700 1 --2- 172.21.15.146:0/775003859 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55cd6d908c20 0x55cd6d94ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.495+0000 7f4dd1339700 1 -- 172.21.15.146:0/775003859 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd6d90a9f0 msgr2=0x55cd6d94c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:14.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.495+0000 7f4dcbfff700 1 --2- 172.21.15.146:0/775003859 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd6d90a9f0 0x55cd6d94c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:14.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.495+0000 7f4dd1339700 1 --2- 172.21.15.146:0/775003859 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd6d90a9f0 0x55cd6d94c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.495+0000 7f4dd1339700 1 -- 172.21.15.146:0/775003859 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cd6d8267d0 con 0x55cd6d94eae0 2023-10-06T11:09:14.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.495+0000 7f4dd1339700 1 --2- 172.21.15.146:0/775003859 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd6d94eae0 0x55cd6d94cb60 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x55cd6d933f90 tx=0x7f4dc402d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ad5b7575e998571 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:14.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.495+0000 7f4db27fc700 1 -- 172.21.15.146:0/775003859 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc4022040 con 0x55cd6d94eae0 2023-10-06T11:09:14.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.495+0000 7f4db27fc700 1 -- 172.21.15.146:0/775003859 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc4011a50 con 0x55cd6d94eae0 2023-10-06T11:09:14.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.495+0000 7f4db27fc700 1 -- 172.21.15.146:0/775003859 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc4011bc0 con 0x55cd6d94eae0 2023-10-06T11:09:14.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.496+0000 7f4ddc094b80 1 -- 172.21.15.146:0/775003859 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd6d94eae0 msgr2=0x55cd6d94cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:14.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.496+0000 7f4ddc094b80 1 --2- 172.21.15.146:0/775003859 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd6d94eae0 0x55cd6d94cb60 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x55cd6d933f90 tx=0x7f4dc402d000 comp rx=0 tx=0).stop 2023-10-06T11:09:14.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.496+0000 7f4ddc094b80 1 -- 172.21.15.146:0/775003859 shutdown_connections 2023-10-06T11:09:14.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.496+0000 7f4ddc094b80 1 --2- 172.21.15.146:0/775003859 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd6d94eae0 0x55cd6d94cb60 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.496+0000 7f4ddc094b80 1 --2- 172.21.15.146:0/775003859 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55cd6d908c20 0x55cd6d94ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.496+0000 7f4ddc094b80 1 --2- 172.21.15.146:0/775003859 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd6d90a9f0 0x55cd6d94c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.496+0000 7f4ddc094b80 1 -- 172.21.15.146:0/775003859 >> 172.21.15.146:0/775003859 conn(0x55cd6d9090c0 msgr2=0x55cd6d9342a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:14.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.496+0000 7f4ddc094b80 1 -- 172.21.15.146:0/775003859 shutdown_connections 2023-10-06T11:09:14.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.496+0000 7f4ddc094b80 1 -- 172.21.15.146:0/775003859 wait complete. 2023-10-06T11:09:14.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.496+0000 7f4ddc094b80 1 -- start start 2023-10-06T11:09:14.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.497+0000 7f4ddc094b80 1 Processor -- start 2023-10-06T11:09:14.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.497+0000 7f4ddc094b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55cd6d908c20 0x55cd6d9aa300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:14.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.497+0000 7f4ddc094b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd6d90a9f0 0x55cd6d9442b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:14.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.497+0000 7f4ddc094b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd6d94eae0 0x55cd6d949530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:14.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.497+0000 7f4ddc094b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd6d9b3f90 con 0x55cd6d94eae0 2023-10-06T11:09:14.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.497+0000 7f4ddc094b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd6d9b6df0 con 0x55cd6d90a9f0 2023-10-06T11:09:14.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.497+0000 7f4ddc094b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cd6d944d50 con 0x55cd6d908c20 2023-10-06T11:09:14.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.497+0000 7f4ddc094b80 10 client.0 _ll_register_callbacks cb 0x55cd6d968130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:09:14.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.497+0000 7f4dd1339700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd6d94eae0 0x55cd6d949530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:14.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.497+0000 7f4dd1339700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd6d94eae0 0x55cd6d949530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53470/0 (socket says 172.21.15.146:53470) 2023-10-06T11:09:14.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.497+0000 7f4dd1339700 1 -- 172.21.15.146:0/2299693977 learned_addr learned my addr 172.21.15.146:0/2299693977 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:14.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.498+0000 7f4dd0b38700 1 --2- 172.21.15.146:0/2299693977 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55cd6d908c20 0x55cd6d9aa300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:14.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.498+0000 7f4dcbfff700 1 --2- 172.21.15.146:0/2299693977 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd6d90a9f0 0x55cd6d9442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:14.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.498+0000 7f4dd1339700 1 -- 172.21.15.146:0/2299693977 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55cd6d908c20 msgr2=0x55cd6d9aa300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:14.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.498+0000 7f4dd1339700 1 --2- 172.21.15.146:0/2299693977 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55cd6d908c20 0x55cd6d9aa300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.498+0000 7f4dd1339700 1 -- 172.21.15.146:0/2299693977 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd6d90a9f0 msgr2=0x55cd6d9442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:14.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.498+0000 7f4dd1339700 1 --2- 172.21.15.146:0/2299693977 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd6d90a9f0 0x55cd6d9442b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.498+0000 7f4dd1339700 1 -- 172.21.15.146:0/2299693977 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cd6d695030 con 0x55cd6d94eae0 2023-10-06T11:09:14.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.498+0000 7f4dd1339700 1 --2- 172.21.15.146:0/2299693977 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd6d94eae0 0x55cd6d949530 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f4dc400b990 tx=0x7f4dc403b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc0d80ce44d3b547 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:14.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.498+0000 7f4daaffd700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:09:14.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.498+0000 7f4daaffd700 1 -- 172.21.15.146:0/2299693977 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc4022070 con 0x55cd6d94eae0 2023-10-06T11:09:14.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.498+0000 7f4daaffd700 1 -- 172.21.15.146:0/2299693977 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4dc4031640 con 0x55cd6d94eae0 2023-10-06T11:09:14.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.498+0000 7f4ddc094b80 1 -- 172.21.15.146:0/2299693977 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4dc400bb30 con 0x55cd6d94eae0 2023-10-06T11:09:14.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.498+0000 7f4daaffd700 1 -- 172.21.15.146:0/2299693977 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4dc401b640 con 0x55cd6d94eae0 2023-10-06T11:09:14.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.498+0000 7f4ddc094b80 10 client.5859 fetch_fsmap learned FSMap version 36 2023-10-06T11:09:14.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.498+0000 7f4ddc094b80 1 -- 172.21.15.146:0/2299693977 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x55cd6d80d4c0 con 0x55cd6d94eae0 2023-10-06T11:09:14.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.498+0000 7f4daaffd700 1 -- 172.21.15.146:0/2299693977 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc400bb30 con 0x55cd6d94eae0 2023-10-06T11:09:14.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.498+0000 7f4daaffd700 1 -- 172.21.15.146:0/2299693977 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 36) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4dc4031d20 con 0x55cd6d94eae0 2023-10-06T11:09:14.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.498+0000 7f4ddc094b80 10 client.5859 fetch_fsmap finished waiting for FSMap version 36 2023-10-06T11:09:14.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.498+0000 7f4ddc094b80 10 client.5859 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-10-06T11:09:14.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.498+0000 7f4ddc094b80 20 client.5859 populate_metadata read hostname 'smithi146' 2023-10-06T11:09:14.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.498+0000 7f4ddc094b80 1 --2- 172.21.15.146:0/2299693977 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55cd6d9447f0 0x55cd6d949a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:14.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.498+0000 7f4ddc094b80 4 client.5859 mds_command: new command op to 5481 tid=0[{"prefix": "scrub status"}] 2023-10-06T11:09:14.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.498+0000 7f4ddc094b80 1 -- 172.21.15.146:0/2299693977 --> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55cd6d7fae50 con 0x55cd6d9447f0 2023-10-06T11:09:14.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.499+0000 7f4dd0b38700 1 --2- 172.21.15.146:0/2299693977 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55cd6d9447f0 0x55cd6d949a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:14.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.499+0000 7f4daaffd700 10 client.5859 ms_handle_connect on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:14.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.499+0000 7f4dd0b38700 1 --2- 172.21.15.146:0/2299693977 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55cd6d9447f0 0x55cd6d949a70 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc034b65c88c6fa7 server_cookie=cab86980774ea113 in_seq=0 out_seq=0 2023-10-06T11:09:14.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.499+0000 7f4daaffd700 1 -- 172.21.15.146:0/2299693977 <== mds.0 v2:172.21.15.146:6835/2252184844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55cd6d7fae50 con 0x55cd6d9447f0 2023-10-06T11:09:14.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.499+0000 7f4daaffd700 10 client.5859 handle_command_reply: tid=0 2023-10-06T11:09:14.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.499+0000 7f4ddc094b80 1 client.5859 shutdown 2023-10-06T11:09:14.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.499+0000 7f4ddc094b80 1 -- 172.21.15.146:0/2299693977 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd6d94eae0 msgr2=0x55cd6d949530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:14.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.499+0000 7f4ddc094b80 1 --2- 172.21.15.146:0/2299693977 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd6d94eae0 0x55cd6d949530 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f4dc400b990 tx=0x7f4dc403b000 comp rx=0 tx=0).stop 2023-10-06T11:09:14.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.499+0000 7f4ddc094b80 1 -- 172.21.15.146:0/2299693977 shutdown_connections 2023-10-06T11:09:14.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.499+0000 7f4ddc094b80 1 --2- 172.21.15.146:0/2299693977 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55cd6d9447f0 0x55cd6d949a70 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.499+0000 7f4ddc094b80 1 --2- 172.21.15.146:0/2299693977 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55cd6d94eae0 0x55cd6d949530 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.499+0000 7f4ddc094b80 1 --2- 172.21.15.146:0/2299693977 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55cd6d908c20 0x55cd6d9aa300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.499+0000 7f4ddc094b80 1 --2- 172.21.15.146:0/2299693977 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd6d90a9f0 0x55cd6d9442b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.499+0000 7f4daaffd700 0 client.5859 ms_handle_reset on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:14.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.499+0000 7f4ddc094b80 1 -- 172.21.15.146:0/2299693977 >> 172.21.15.146:0/2299693977 conn(0x55cd6d9090c0 msgr2=0x55cd6d934060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:14.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.499+0000 7f4ddc094b80 1 -- 172.21.15.146:0/2299693977 shutdown_connections 2023-10-06T11:09:14.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.499+0000 7f4ddc094b80 1 -- 172.21.15.146:0/2299693977 wait complete. 2023-10-06T11:09:14.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.499+0000 7f4ddc094b80 20 client.5859 trim_cache size 0 max 16384 2023-10-06T11:09:14.509 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:09:14.509 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "no active scrubs running", 2023-10-06T11:09:14.509 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": {} 2023-10-06T11:09:14.509 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:09:14.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.500+0000 7f4dd2d9c700 1 -- 172.21.15.146:0/2683764646 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4db8066f30 msgr2=0x7f4db80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:14.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.500+0000 7f4dd2d9c700 1 --2- 172.21.15.146:0/2683764646 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4db8066f30 0x7f4db80693e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc007fd0 tx=0x7f4dbc0016f0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.500+0000 7f4dd2d9c700 1 -- 172.21.15.146:0/2683764646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4dcc1596e0 msgr2=0x7f4dcc0af260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:14.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.500+0000 7f4dd2d9c700 1 --2- 172.21.15.146:0/2683764646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4dcc1596e0 0x7f4dcc0af260 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0006b00 tx=0x7f4dc0008040 comp rx=0 tx=0).stop 2023-10-06T11:09:14.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.500+0000 7f4dd2d9c700 1 -- 172.21.15.146:0/2683764646 shutdown_connections 2023-10-06T11:09:14.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.500+0000 7f4dd2d9c700 1 --2- 172.21.15.146:0/2683764646 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4db8066f30 0x7f4db80693e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.500+0000 7f4dd2d9c700 1 --2- 172.21.15.146:0/2683764646 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4dcc159ab0 0x7f4dcc0c31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.500+0000 7f4dd2d9c700 1 --2- 172.21.15.146:0/2683764646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4dcc06f3a0 0x7f4dcc157f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.500+0000 7f4dd2d9c700 1 --2- 172.21.15.146:0/2683764646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4dcc1596e0 0x7f4dcc0af260 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.500+0000 7f4dd2d9c700 1 -- 172.21.15.146:0/2683764646 >> 172.21.15.146:0/2683764646 conn(0x7f4dcc069050 msgr2=0x7f4dcc0ab8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:14.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.500+0000 7f4dd2d9c700 1 -- 172.21.15.146:0/2683764646 shutdown_connections 2023-10-06T11:09:14.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.500+0000 7f4dd2d9c700 1 -- 172.21.15.146:0/2683764646 wait complete. 2023-10-06T11:09:14.512 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-06T11:09:14.512 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2023-10-06T11:09:14.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.628+0000 7f4662612700 1 Processor -- start 2023-10-06T11:09:14.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.628+0000 7f4662612700 1 -- start start 2023-10-06T11:09:14.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.629+0000 7f4662612700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f465c159f40 0x7f465c15d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:14.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.629+0000 7f4662612700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f465c0d1670 con 0x7f465c15e5f0 2023-10-06T11:09:14.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.629+0000 7f4662612700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f465c0cee70 con 0x7f465c0c7810 2023-10-06T11:09:14.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.629+0000 7f4662612700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f465c0cc4b0 con 0x7f465c159f40 2023-10-06T11:09:14.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.629+0000 7f465bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f465c159f40 0x7f465c15d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:14.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.629+0000 7f4660baf700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f465c15e5f0 0x7f465c0cada0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50876/0 (socket says 172.21.15.146:50876) 2023-10-06T11:09:14.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.629+0000 7f4660baf700 1 -- 172.21.15.146:0/2194673708 learned_addr learned my addr 172.21.15.146:0/2194673708 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:14.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.630+0000 7f465bfff700 1 -- 172.21.15.146:0/2194673708 >> v1:172.21.15.151:6789/0 conn(0x7f465c0c7810 legacy=0x7f465c15dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:14.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.630+0000 7f465bfff700 1 -- 172.21.15.146:0/2194673708 >> v1:172.21.15.146:6789/0 conn(0x7f465c15e5f0 legacy=0x7f465c0cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:14.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.630+0000 7f465bfff700 1 -- 172.21.15.146:0/2194673708 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f465c06f990 con 0x7f465c159f40 2023-10-06T11:09:14.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.630+0000 7f465affd700 1 -- 172.21.15.146:0/2194673708 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3161192449 0 0) 0x7f465c0d1670 con 0x7f465c15e5f0 2023-10-06T11:09:14.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.630+0000 7f465bfff700 1 --2- 172.21.15.146:0/2194673708 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f465c159f40 0x7f465c15d9a0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f464c0098d0 tx=0x7f464c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6e4a5451ead81dc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:14.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.630+0000 7f465affd700 1 -- 172.21.15.146:0/2194673708 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464c009e70 con 0x7f465c159f40 2023-10-06T11:09:14.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.630+0000 7f465affd700 1 -- 172.21.15.146:0/2194673708 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464c005c10 con 0x7f465c159f40 2023-10-06T11:09:14.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.630+0000 7f465affd700 1 -- 172.21.15.146:0/2194673708 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464c00b610 con 0x7f465c159f40 2023-10-06T11:09:14.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.630+0000 7f4662612700 1 -- 172.21.15.146:0/2194673708 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f465c159f40 msgr2=0x7f465c15d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:14.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.630+0000 7f4662612700 1 --2- 172.21.15.146:0/2194673708 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f465c159f40 0x7f465c15d9a0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f464c0098d0 tx=0x7f464c009120 comp rx=0 tx=0).stop 2023-10-06T11:09:14.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.630+0000 7f4662612700 1 -- 172.21.15.146:0/2194673708 shutdown_connections 2023-10-06T11:09:14.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.631+0000 7f4662612700 1 --2- 172.21.15.146:0/2194673708 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f465c159f40 0x7f465c15d9a0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.631+0000 7f4662612700 1 -- 172.21.15.146:0/2194673708 >> 172.21.15.146:0/2194673708 conn(0x7f465c06f380 msgr2=0x7f465c0d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:14.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.631+0000 7f4662612700 1 -- 172.21.15.146:0/2194673708 shutdown_connections 2023-10-06T11:09:14.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.631+0000 7f4662612700 1 -- 172.21.15.146:0/2194673708 wait complete. 2023-10-06T11:09:14.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.632+0000 7f4662612700 1 Processor -- start 2023-10-06T11:09:14.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.632+0000 7f4662612700 1 -- start start 2023-10-06T11:09:14.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.632+0000 7f4662612700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f465c0c7810 0x7f465c0c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:14.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.633+0000 7f4662612700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f465c159f40 0x7f465c16c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:14.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.633+0000 7f4662612700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f465c15e5f0 0x7f465c157040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:14.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.633+0000 7f4662612700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465c09bcb0 con 0x7f465c0c7810 2023-10-06T11:09:14.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.633+0000 7f4662612700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465c0b4ec0 con 0x7f465c159f40 2023-10-06T11:09:14.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.633+0000 7f4662612700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f465c09bf70 con 0x7f465c15e5f0 2023-10-06T11:09:14.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.633+0000 7f465bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f465c0c7810 0x7f465c0c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:14.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.633+0000 7f465bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f465c0c7810 0x7f465c0c6d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53490/0 (socket says 172.21.15.146:53490) 2023-10-06T11:09:14.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.633+0000 7f465bfff700 1 -- 172.21.15.146:0/3938442146 learned_addr learned my addr 172.21.15.146:0/3938442146 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:14.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.633+0000 7f465b7fe700 1 --2- 172.21.15.146:0/3938442146 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f465c159f40 0x7f465c16c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:14.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.633+0000 7f4660baf700 1 --2- 172.21.15.146:0/3938442146 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f465c15e5f0 0x7f465c157040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:14.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.633+0000 7f465bfff700 1 -- 172.21.15.146:0/3938442146 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f465c15e5f0 msgr2=0x7f465c157040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:14.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.633+0000 7f465bfff700 1 --2- 172.21.15.146:0/3938442146 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f465c15e5f0 0x7f465c157040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.633+0000 7f465bfff700 1 -- 172.21.15.146:0/3938442146 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f465c159f40 msgr2=0x7f465c16c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:14.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.633+0000 7f465bfff700 1 --2- 172.21.15.146:0/3938442146 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f465c159f40 0x7f465c16c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.633+0000 7f465bfff700 1 -- 172.21.15.146:0/3938442146 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f464c0093c0 con 0x7f465c0c7810 2023-10-06T11:09:14.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.633+0000 7f465b7fe700 1 --2- 172.21.15.146:0/3938442146 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f465c159f40 0x7f465c16c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:14.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.633+0000 7f465bfff700 1 --2- 172.21.15.146:0/3938442146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f465c0c7810 0x7f465c0c6d10 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f464c009160 tx=0x7f464c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:14.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.633+0000 7f4643fff700 1 -- 172.21.15.146:0/3938442146 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464c0065f0 con 0x7f465c0c7810 2023-10-06T11:09:14.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.633+0000 7f4643fff700 1 -- 172.21.15.146:0/3938442146 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464c006770 con 0x7f465c0c7810 2023-10-06T11:09:14.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.633+0000 7f4643fff700 1 -- 172.21.15.146:0/3938442146 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464c01c680 con 0x7f465c0c7810 2023-10-06T11:09:14.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.633+0000 7f4662612700 1 -- 172.21.15.146:0/3938442146 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f465c09c250 con 0x7f465c0c7810 2023-10-06T11:09:14.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.633+0000 7f4662612700 1 -- 172.21.15.146:0/3938442146 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f465c16cb60 con 0x7f465c0c7810 2023-10-06T11:09:14.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.635+0000 7f4643fff700 1 -- 172.21.15.146:0/3938442146 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f464c023070 con 0x7f465c0c7810 2023-10-06T11:09:14.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.635+0000 7f4643fff700 1 --2- 172.21.15.146:0/3938442146 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4648066f30 0x7f46480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:14.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.635+0000 7f4643fff700 1 -- 172.21.15.146:0/3938442146 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f464c0866f0 con 0x7f465c0c7810 2023-10-06T11:09:14.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.635+0000 7f465b7fe700 1 --2- 172.21.15.146:0/3938442146 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4648066f30 0x7f46480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:14.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.635+0000 7f465b7fe700 1 --2- 172.21.15.146:0/3938442146 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4648066f30 0x7f46480693e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4650006fd0 tx=0x7f4650008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:14.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.637+0000 7f466b90ab80 1 Processor -- start 2023-10-06T11:09:14.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.637+0000 7f466b90ab80 1 -- start start 2023-10-06T11:09:14.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.638+0000 7f466b90ab80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baf2342ae0 0x55baf2342eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:14.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.638+0000 7f466b90ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55baf22fe9f0 0x55baf22fb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:14.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.638+0000 7f466b90ab80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55baf22fcc20 0x55baf22fbb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:14.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.638+0000 7f466b90ab80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baf227bcd0 con 0x55baf2342ae0 2023-10-06T11:09:14.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.638+0000 7f466b90ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baf2252ac0 con 0x55baf22fe9f0 2023-10-06T11:09:14.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.638+0000 7f466b90ab80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55baf22502c0 con 0x55baf22fcc20 2023-10-06T11:09:14.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.638+0000 7f465bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baf2342ae0 0x55baf2342eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:14.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.638+0000 7f465bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baf2342ae0 0x55baf2342eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53506/0 (socket says 172.21.15.146:53506) 2023-10-06T11:09:14.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.638+0000 7f465bfff700 1 -- 172.21.15.146:0/1651356100 learned_addr learned my addr 172.21.15.146:0/1651356100 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:14.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.638+0000 7f465b7fe700 1 --2- 172.21.15.146:0/1651356100 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55baf22fe9f0 0x55baf22fb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:14.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.638+0000 7f4660baf700 1 --2- 172.21.15.146:0/1651356100 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55baf22fcc20 0x55baf22fbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:14.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.638+0000 7f465bfff700 1 -- 172.21.15.146:0/1651356100 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55baf22fcc20 msgr2=0x55baf22fbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:14.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.638+0000 7f465bfff700 1 --2- 172.21.15.146:0/1651356100 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55baf22fcc20 0x55baf22fbb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.638+0000 7f465bfff700 1 -- 172.21.15.146:0/1651356100 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55baf22fe9f0 msgr2=0x55baf22fb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:14.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.638+0000 7f465bfff700 1 --2- 172.21.15.146:0/1651356100 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55baf22fe9f0 0x55baf22fb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.638+0000 7f465bfff700 1 -- 172.21.15.146:0/1651356100 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55baf20e62c0 con 0x55baf2342ae0 2023-10-06T11:09:14.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.638+0000 7f4660baf700 1 --2- 172.21.15.146:0/1651356100 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55baf22fcc20 0x55baf22fbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:14.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.638+0000 7f465bfff700 1 --2- 172.21.15.146:0/1651356100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baf2342ae0 0x55baf2342eb0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f464c00b720 tx=0x7f464c084a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b67bcd6619ea6db server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:14.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.638+0000 7f46417fa700 1 -- 172.21.15.146:0/1651356100 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464c0574c0 con 0x55baf2342ae0 2023-10-06T11:09:14.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.639+0000 7f46417fa700 1 -- 172.21.15.146:0/1651356100 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464c05a710 con 0x55baf2342ae0 2023-10-06T11:09:14.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.639+0000 7f46417fa700 1 -- 172.21.15.146:0/1651356100 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464c05e460 con 0x55baf2342ae0 2023-10-06T11:09:14.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.639+0000 7f466b90ab80 1 -- 172.21.15.146:0/1651356100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baf2342ae0 msgr2=0x55baf2342eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:14.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.639+0000 7f466b90ab80 1 --2- 172.21.15.146:0/1651356100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baf2342ae0 0x55baf2342eb0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f464c00b720 tx=0x7f464c084a10 comp rx=0 tx=0).stop 2023-10-06T11:09:14.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.639+0000 7f466b90ab80 1 -- 172.21.15.146:0/1651356100 shutdown_connections 2023-10-06T11:09:14.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.639+0000 7f466b90ab80 1 --2- 172.21.15.146:0/1651356100 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55baf22fcc20 0x55baf22fbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.639+0000 7f466b90ab80 1 --2- 172.21.15.146:0/1651356100 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baf2342ae0 0x55baf2342eb0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.639+0000 7f466b90ab80 1 --2- 172.21.15.146:0/1651356100 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55baf22fe9f0 0x55baf22fb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.639+0000 7f466b90ab80 1 -- 172.21.15.146:0/1651356100 >> 172.21.15.146:0/1651356100 conn(0x55baf22fd0c0 msgr2=0x55baf22fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:14.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.639+0000 7f466b90ab80 1 -- 172.21.15.146:0/1651356100 shutdown_connections 2023-10-06T11:09:14.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.639+0000 7f466b90ab80 1 -- 172.21.15.146:0/1651356100 wait complete. 2023-10-06T11:09:14.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.640+0000 7f466b90ab80 1 -- start start 2023-10-06T11:09:14.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.640+0000 7f466b90ab80 1 Processor -- start 2023-10-06T11:09:14.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.641+0000 7f466b90ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55baf22fcc20 0x55baf2322520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:14.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.641+0000 7f466b90ab80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baf22fe9f0 0x55baf2326650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:14.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.641+0000 7f466b90ab80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55baf2342ae0 0x55baf2323c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:14.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.641+0000 7f466b90ab80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baf224c0b0 con 0x55baf22fe9f0 2023-10-06T11:09:14.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.641+0000 7f466b90ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baf21f78e0 con 0x55baf22fcc20 2023-10-06T11:09:14.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.641+0000 7f466b90ab80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55baf2212ef0 con 0x55baf2342ae0 2023-10-06T11:09:14.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.641+0000 7f466b90ab80 10 client.0 _ll_register_callbacks cb 0x55baf20e8f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:09:14.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.641+0000 7f465b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baf22fe9f0 0x55baf2326650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:14.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.641+0000 7f465b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baf22fe9f0 0x55baf2326650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53512/0 (socket says 172.21.15.146:53512) 2023-10-06T11:09:14.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.641+0000 7f465b7fe700 1 -- 172.21.15.146:0/3195504780 learned_addr learned my addr 172.21.15.146:0/3195504780 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:14.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.641+0000 7f465bfff700 1 --2- 172.21.15.146:0/3195504780 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55baf22fcc20 0x55baf2322520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:14.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.641+0000 7f4660baf700 1 --2- 172.21.15.146:0/3195504780 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55baf2342ae0 0x55baf2323c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:14.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.641+0000 7f465b7fe700 1 -- 172.21.15.146:0/3195504780 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55baf2342ae0 msgr2=0x55baf2323c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:14.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.641+0000 7f465b7fe700 1 --2- 172.21.15.146:0/3195504780 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55baf2342ae0 0x55baf2323c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.641+0000 7f465b7fe700 1 -- 172.21.15.146:0/3195504780 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55baf22fcc20 msgr2=0x55baf2322520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:14.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.641+0000 7f465b7fe700 1 --2- 172.21.15.146:0/3195504780 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55baf22fcc20 0x55baf2322520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.641+0000 7f465b7fe700 1 -- 172.21.15.146:0/3195504780 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f465c16cb60 con 0x55baf22fe9f0 2023-10-06T11:09:14.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.641+0000 7f465b7fe700 1 --2- 172.21.15.146:0/3195504780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baf22fe9f0 0x55baf2326650 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f465000df10 tx=0x7f4650012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc4c54e6bd86323c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:14.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.641+0000 7f463a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:09:14.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.641+0000 7f463a7fc700 1 -- 172.21.15.146:0/3195504780 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4650006e50 con 0x55baf22fe9f0 2023-10-06T11:09:14.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.641+0000 7f463a7fc700 1 -- 172.21.15.146:0/3195504780 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4650013db0 con 0x55baf22fe9f0 2023-10-06T11:09:14.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.641+0000 7f466b90ab80 1 -- 172.21.15.146:0/3195504780 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55baf22f06e0 con 0x55baf22fe9f0 2023-10-06T11:09:14.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.642+0000 7f463a7fc700 1 -- 172.21.15.146:0/3195504780 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4650021660 con 0x55baf22fe9f0 2023-10-06T11:09:14.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.642+0000 7f466b90ab80 10 client.5874 fetch_fsmap learned FSMap version 36 2023-10-06T11:09:14.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.642+0000 7f466b90ab80 1 -- 172.21.15.146:0/3195504780 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x55baf2089030 con 0x55baf22fe9f0 2023-10-06T11:09:14.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.642+0000 7f463a7fc700 1 -- 172.21.15.146:0/3195504780 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55baf22f06e0 con 0x55baf22fe9f0 2023-10-06T11:09:14.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.642+0000 7f463a7fc700 1 -- 172.21.15.146:0/3195504780 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 36) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f465001f070 con 0x55baf22fe9f0 2023-10-06T11:09:14.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.642+0000 7f466b90ab80 10 client.5874 fetch_fsmap finished waiting for FSMap version 36 2023-10-06T11:09:14.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.642+0000 7f466b90ab80 10 client.5874 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-10-06T11:09:14.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.642+0000 7f466b90ab80 20 client.5874 populate_metadata read hostname 'smithi146' 2023-10-06T11:09:14.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.642+0000 7f466b90ab80 1 --2- 172.21.15.146:0/3195504780 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55baf2326b90 0x55baf23241d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:14.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.642+0000 7f466b90ab80 4 client.5874 mds_command: new command op to 5481 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:09:14.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.642+0000 7f466b90ab80 1 -- 172.21.15.146:0/3195504780 --> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55baf22cd610 con 0x55baf2326b90 2023-10-06T11:09:14.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.642+0000 7f465bfff700 1 --2- 172.21.15.146:0/3195504780 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55baf2326b90 0x55baf23241d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:14.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.642+0000 7f465bfff700 1 --2- 172.21.15.146:0/3195504780 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55baf2326b90 0x55baf23241d0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4a207a900c467ea server_cookie=14d2d8b469d758b0 in_seq=0 out_seq=0 2023-10-06T11:09:14.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.642+0000 7f463a7fc700 10 client.5874 ms_handle_connect on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:14.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.643+0000 7f463a7fc700 1 -- 172.21.15.146:0/3195504780 <== mds.0 v2:172.21.15.146:6835/2252184844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55baf22cd610 con 0x55baf2326b90 2023-10-06T11:09:14.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.643+0000 7f463a7fc700 10 client.5874 handle_command_reply: tid=0 2023-10-06T11:09:14.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.643+0000 7f466b90ab80 1 client.5874 shutdown 2023-10-06T11:09:14.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.643+0000 7f466b90ab80 1 -- 172.21.15.146:0/3195504780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baf22fe9f0 msgr2=0x55baf2326650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:14.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.643+0000 7f466b90ab80 1 --2- 172.21.15.146:0/3195504780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baf22fe9f0 0x55baf2326650 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f465000df10 tx=0x7f4650012000 comp rx=0 tx=0).stop 2023-10-06T11:09:14.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.643+0000 7f466b90ab80 1 -- 172.21.15.146:0/3195504780 shutdown_connections 2023-10-06T11:09:14.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.643+0000 7f466b90ab80 1 --2- 172.21.15.146:0/3195504780 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55baf2326b90 0x55baf23241d0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.643+0000 7f466b90ab80 1 --2- 172.21.15.146:0/3195504780 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55baf2342ae0 0x55baf2323c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.643+0000 7f463a7fc700 0 client.5874 ms_handle_reset on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:14.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.643+0000 7f466b90ab80 1 --2- 172.21.15.146:0/3195504780 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55baf22fcc20 0x55baf2322520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.643+0000 7f466b90ab80 1 --2- 172.21.15.146:0/3195504780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baf22fe9f0 0x55baf2326650 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.643+0000 7f466b90ab80 1 -- 172.21.15.146:0/3195504780 >> 172.21.15.146:0/3195504780 conn(0x55baf22fd0c0 msgr2=0x55baf2342030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:14.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.643+0000 7f466b90ab80 1 -- 172.21.15.146:0/3195504780 shutdown_connections 2023-10-06T11:09:14.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.643+0000 7f466b90ab80 1 -- 172.21.15.146:0/3195504780 wait complete. 2023-10-06T11:09:14.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.643+0000 7f466b90ab80 20 client.5874 trim_cache size 0 max 16384 2023-10-06T11:09:14.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.655+0000 7f466b90ab80 1 Processor -- start 2023-10-06T11:09:14.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.655+0000 7f466b90ab80 1 -- start start 2023-10-06T11:09:14.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.656+0000 7f466b90ab80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baf22fcc20 0x55baf233f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:14.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.656+0000 7f466b90ab80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55baf22fe9f0 0x55baf233fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:14.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.656+0000 7f466b90ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55baf2342ae0 0x55baf232b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:14.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.656+0000 7f466b90ab80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baf22f7880 con 0x55baf22fcc20 2023-10-06T11:09:14.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.656+0000 7f466b90ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baf20cee80 con 0x55baf2342ae0 2023-10-06T11:09:14.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.656+0000 7f466b90ab80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55baf22f6410 con 0x55baf22fe9f0 2023-10-06T11:09:14.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.656+0000 7f465bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baf22fcc20 0x55baf233f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:14.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.656+0000 7f465bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baf22fcc20 0x55baf233f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53524/0 (socket says 172.21.15.146:53524) 2023-10-06T11:09:14.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.656+0000 7f465bfff700 1 -- 172.21.15.146:0/3155008120 learned_addr learned my addr 172.21.15.146:0/3155008120 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:14.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.656+0000 7f465bfff700 1 -- 172.21.15.146:0/3155008120 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55baf22fe9f0 msgr2=0x55baf233fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:14.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.656+0000 7f465bfff700 1 --2- 172.21.15.146:0/3155008120 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55baf22fe9f0 0x55baf233fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.656+0000 7f465bfff700 1 -- 172.21.15.146:0/3155008120 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55baf2342ae0 msgr2=0x55baf232b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:14.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.656+0000 7f465bfff700 1 --2- 172.21.15.146:0/3155008120 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55baf2342ae0 0x55baf232b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.656+0000 7f465bfff700 1 -- 172.21.15.146:0/3155008120 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55baf221a7d0 con 0x55baf22fcc20 2023-10-06T11:09:14.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.656+0000 7f465bfff700 1 --2- 172.21.15.146:0/3155008120 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baf22fcc20 0x55baf233f750 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f464c000e10 tx=0x7f464c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d73993ccad4a0d84 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:14.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.657+0000 7f4641ffb700 1 -- 172.21.15.146:0/3155008120 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464c073040 con 0x55baf22fcc20 2023-10-06T11:09:14.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.657+0000 7f4641ffb700 1 -- 172.21.15.146:0/3155008120 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464c053800 con 0x55baf22fcc20 2023-10-06T11:09:14.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.657+0000 7f4641ffb700 1 -- 172.21.15.146:0/3155008120 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464c0574c0 con 0x55baf22fcc20 2023-10-06T11:09:14.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.657+0000 7f466b90ab80 1 -- 172.21.15.146:0/3155008120 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baf22fcc20 msgr2=0x55baf233f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:14.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.657+0000 7f466b90ab80 1 --2- 172.21.15.146:0/3155008120 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baf22fcc20 0x55baf233f750 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f464c000e10 tx=0x7f464c012000 comp rx=0 tx=0).stop 2023-10-06T11:09:14.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.657+0000 7f466b90ab80 1 -- 172.21.15.146:0/3155008120 shutdown_connections 2023-10-06T11:09:14.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.657+0000 7f466b90ab80 1 --2- 172.21.15.146:0/3155008120 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55baf2342ae0 0x55baf232b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.657+0000 7f466b90ab80 1 --2- 172.21.15.146:0/3155008120 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baf22fcc20 0x55baf233f750 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.657+0000 7f466b90ab80 1 --2- 172.21.15.146:0/3155008120 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55baf22fe9f0 0x55baf233fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.657+0000 7f466b90ab80 1 -- 172.21.15.146:0/3155008120 >> 172.21.15.146:0/3155008120 conn(0x55baf22fd0c0 msgr2=0x55baf2323c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:14.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.657+0000 7f466b90ab80 1 -- 172.21.15.146:0/3155008120 shutdown_connections 2023-10-06T11:09:14.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.657+0000 7f466b90ab80 1 -- 172.21.15.146:0/3155008120 wait complete. 2023-10-06T11:09:14.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.658+0000 7f466b90ab80 1 -- start start 2023-10-06T11:09:14.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.658+0000 7f466b90ab80 1 Processor -- start 2023-10-06T11:09:14.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.658+0000 7f466b90ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55baf22fcc20 0x55baf232b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:14.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.658+0000 7f466b90ab80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55baf22fe9f0 0x55baf232b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:14.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.658+0000 7f466b90ab80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baf2342ae0 0x55baf23a6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:14.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.658+0000 7f466b90ab80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baf2322aa0 con 0x55baf2342ae0 2023-10-06T11:09:14.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.658+0000 7f466b90ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55baf233bd60 con 0x55baf22fcc20 2023-10-06T11:09:14.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.658+0000 7f466b90ab80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55baf233cbc0 con 0x55baf22fe9f0 2023-10-06T11:09:14.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.659+0000 7f466b90ab80 10 client.0 _ll_register_callbacks cb 0x55baf20e8f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:09:14.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.659+0000 7f4660baf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baf2342ae0 0x55baf23a6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:14.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.659+0000 7f4660baf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baf2342ae0 0x55baf23a6f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53528/0 (socket says 172.21.15.146:53528) 2023-10-06T11:09:14.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.659+0000 7f4660baf700 1 -- 172.21.15.146:0/85528277 learned_addr learned my addr 172.21.15.146:0/85528277 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:14.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.659+0000 7f465bfff700 1 --2- 172.21.15.146:0/85528277 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55baf22fcc20 0x55baf232b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:14.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.659+0000 7f465b7fe700 1 --2- 172.21.15.146:0/85528277 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55baf22fe9f0 0x55baf232b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:14.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.659+0000 7f4660baf700 1 -- 172.21.15.146:0/85528277 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55baf22fe9f0 msgr2=0x55baf232b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:14.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.659+0000 7f4660baf700 1 --2- 172.21.15.146:0/85528277 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55baf22fe9f0 0x55baf232b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.659+0000 7f4660baf700 1 -- 172.21.15.146:0/85528277 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55baf22fcc20 msgr2=0x55baf232b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:14.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.659+0000 7f4660baf700 1 --2- 172.21.15.146:0/85528277 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55baf22fcc20 0x55baf232b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.659+0000 7f4660baf700 1 -- 172.21.15.146:0/85528277 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55baf20e62c0 con 0x55baf2342ae0 2023-10-06T11:09:14.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.659+0000 7f4660baf700 1 --2- 172.21.15.146:0/85528277 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baf2342ae0 0x55baf23a6f60 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f465c0c4200 tx=0x7f4654009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c208434cd0d6f121 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:14.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.659+0000 7f463a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:09:14.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.659+0000 7f463a7fc700 1 -- 172.21.15.146:0/85528277 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4654015690 con 0x55baf2342ae0 2023-10-06T11:09:14.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.659+0000 7f463a7fc700 1 -- 172.21.15.146:0/85528277 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f46540157f0 con 0x55baf2342ae0 2023-10-06T11:09:14.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.659+0000 7f466b90ab80 1 -- 172.21.15.146:0/85528277 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f464c05a710 con 0x55baf2342ae0 2023-10-06T11:09:14.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.659+0000 7f463a7fc700 1 -- 172.21.15.146:0/85528277 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4654015bc0 con 0x55baf2342ae0 2023-10-06T11:09:14.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.659+0000 7f466b90ab80 10 client.5880 fetch_fsmap learned FSMap version 36 2023-10-06T11:09:14.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.659+0000 7f466b90ab80 1 -- 172.21.15.146:0/85528277 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x55baf22014c0 con 0x55baf2342ae0 2023-10-06T11:09:14.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.659+0000 7f463a7fc700 1 -- 172.21.15.146:0/85528277 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464c05a710 con 0x55baf2342ae0 2023-10-06T11:09:14.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.660+0000 7f463a7fc700 1 -- 172.21.15.146:0/85528277 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 36) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4654015d20 con 0x55baf2342ae0 2023-10-06T11:09:14.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.660+0000 7f466b90ab80 10 client.5880 fetch_fsmap finished waiting for FSMap version 36 2023-10-06T11:09:14.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.660+0000 7f466b90ab80 10 client.5880 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-10-06T11:09:14.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.660+0000 7f466b90ab80 20 client.5880 populate_metadata read hostname 'smithi146' 2023-10-06T11:09:14.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.660+0000 7f466b90ab80 1 --2- 172.21.15.146:0/85528277 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55baf234b210 0x55baf23a74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:14.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.660+0000 7f466b90ab80 4 client.5880 mds_command: new command op to 5481 tid=0[{"prefix": "damage ls"}] 2023-10-06T11:09:14.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.660+0000 7f466b90ab80 1 -- 172.21.15.146:0/85528277 --> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55baf21eee50 con 0x55baf234b210 2023-10-06T11:09:14.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.660+0000 7f465bfff700 1 --2- 172.21.15.146:0/85528277 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55baf234b210 0x55baf23a74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:14.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.660+0000 7f463a7fc700 10 client.5880 ms_handle_connect on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:14.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.660+0000 7f465bfff700 1 --2- 172.21.15.146:0/85528277 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55baf234b210 0x55baf23a74a0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21cd408bcd5cb0cb server_cookie=a972517ffac2ca00 in_seq=0 out_seq=0 2023-10-06T11:09:14.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.660+0000 7f463a7fc700 1 -- 172.21.15.146:0/85528277 <== mds.0 v2:172.21.15.146:6835/2252184844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+168 (crc 0 0 0) 0x55baf21eee50 con 0x55baf234b210 2023-10-06T11:09:14.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.660+0000 7f463a7fc700 10 client.5880 handle_command_reply: tid=0 2023-10-06T11:09:14.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.660+0000 7f466b90ab80 1 client.5880 shutdown 2023-10-06T11:09:14.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.660+0000 7f466b90ab80 1 -- 172.21.15.146:0/85528277 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baf2342ae0 msgr2=0x55baf23a6f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:14.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.660+0000 7f466b90ab80 1 --2- 172.21.15.146:0/85528277 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baf2342ae0 0x55baf23a6f60 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f465c0c4200 tx=0x7f4654009040 comp rx=0 tx=0).stop 2023-10-06T11:09:14.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.660+0000 7f466b90ab80 1 -- 172.21.15.146:0/85528277 shutdown_connections 2023-10-06T11:09:14.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.660+0000 7f466b90ab80 1 --2- 172.21.15.146:0/85528277 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55baf234b210 0x55baf23a74a0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.660+0000 7f466b90ab80 1 --2- 172.21.15.146:0/85528277 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55baf2342ae0 0x55baf23a6f60 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.660+0000 7f463a7fc700 0 client.5880 ms_handle_reset on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:14.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.660+0000 7f466b90ab80 1 --2- 172.21.15.146:0/85528277 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55baf22fcc20 0x55baf232b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.660+0000 7f466b90ab80 1 --2- 172.21.15.146:0/85528277 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55baf22fe9f0 0x55baf232b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.660+0000 7f466b90ab80 1 -- 172.21.15.146:0/85528277 >> 172.21.15.146:0/85528277 conn(0x55baf22fd0c0 msgr2=0x55baf2340320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:14.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.660+0000 7f466b90ab80 1 -- 172.21.15.146:0/85528277 shutdown_connections 2023-10-06T11:09:14.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.660+0000 7f466b90ab80 1 -- 172.21.15.146:0/85528277 wait complete. 2023-10-06T11:09:14.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.660+0000 7f466b90ab80 20 client.5880 trim_cache size 0 max 16384 2023-10-06T11:09:14.669 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2023-10-06T11:09:14.669 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:09:14.669 INFO:teuthology.orchestra.run.smithi146.stdout: "damage_type": "backtrace", 2023-10-06T11:09:14.670 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 1095234618, 2023-10-06T11:09:14.670 INFO:teuthology.orchestra.run.smithi146.stdout: "ino": 1099511630406, 2023-10-06T11:09:14.670 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_0" 2023-10-06T11:09:14.670 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:09:14.670 INFO:teuthology.orchestra.run.smithi146.stdout:] 2023-10-06T11:09:14.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.661+0000 7f4662612700 1 -- 172.21.15.146:0/3938442146 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4648066f30 msgr2=0x7f46480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:14.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.661+0000 7f4662612700 1 --2- 172.21.15.146:0/3938442146 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4648066f30 0x7f46480693e0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4650006fd0 tx=0x7f4650008040 comp rx=0 tx=0).stop 2023-10-06T11:09:14.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.661+0000 7f4662612700 1 -- 172.21.15.146:0/3938442146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f465c0c7810 msgr2=0x7f465c0c6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:14.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.661+0000 7f4662612700 1 --2- 172.21.15.146:0/3938442146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f465c0c7810 0x7f465c0c6d10 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f464c009160 tx=0x7f464c015000 comp rx=0 tx=0).stop 2023-10-06T11:09:14.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.661+0000 7f4662612700 1 -- 172.21.15.146:0/3938442146 shutdown_connections 2023-10-06T11:09:14.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.661+0000 7f4662612700 1 --2- 172.21.15.146:0/3938442146 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4648066f30 0x7f46480693e0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.661+0000 7f4662612700 1 --2- 172.21.15.146:0/3938442146 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f465c15e5f0 0x7f465c157040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.661+0000 7f4662612700 1 --2- 172.21.15.146:0/3938442146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f465c0c7810 0x7f465c0c6d10 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.661+0000 7f4662612700 1 --2- 172.21.15.146:0/3938442146 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f465c159f40 0x7f465c16c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.661+0000 7f4662612700 1 -- 172.21.15.146:0/3938442146 >> 172.21.15.146:0/3938442146 conn(0x7f465c06f380 msgr2=0x7f465c0c7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:14.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.661+0000 7f4662612700 1 -- 172.21.15.146:0/3938442146 shutdown_connections 2023-10-06T11:09:14.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.661+0000 7f4662612700 1 -- 172.21.15.146:0/3938442146 wait complete. 2023-10-06T11:09:14.673 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:09:14.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.787+0000 7faaf99da700 1 Processor -- start 2023-10-06T11:09:14.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.787+0000 7faaf99da700 1 -- start start 2023-10-06T11:09:14.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.788+0000 7faaf99da700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faaf40b2530 0x7faaf415cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:14.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.788+0000 7faaf99da700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaf415c630 con 0x7faaf415a420 2023-10-06T11:09:14.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.788+0000 7faaf99da700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaf415ba20 con 0x7faaf415a7f0 2023-10-06T11:09:14.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.788+0000 7faaf99da700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf40ce040 con 0x7faaf40b2530 2023-10-06T11:09:14.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.788+0000 7faaf89d8700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7faaf415a420 0x7faaf40b1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50882/0 (socket says 172.21.15.146:50882) 2023-10-06T11:09:14.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.788+0000 7faaf89d8700 1 -- 172.21.15.146:0/1578310911 learned_addr learned my addr 172.21.15.146:0/1578310911 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:14.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.788+0000 7faaf91d9700 1 --2- 172.21.15.146:0/1578310911 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faaf40b2530 0x7faaf415cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:14.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.788+0000 7faaeb7fe700 1 -- 172.21.15.146:0/1578310911 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3610956030 0 0) 0x7faaf415c630 con 0x7faaf415a420 2023-10-06T11:09:14.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.788+0000 7faaeb7fe700 1 -- 172.21.15.146:0/1578310911 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faadc003570 con 0x7faaf415a420 2023-10-06T11:09:14.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.789+0000 7faaeb7fe700 1 -- 172.21.15.146:0/1578310911 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1937509345 0 0) 0x7faaf415ba20 con 0x7faaf415a7f0 2023-10-06T11:09:14.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.789+0000 7faaeb7fe700 1 -- 172.21.15.146:0/1578310911 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faaf415c630 con 0x7faaf415a7f0 2023-10-06T11:09:14.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.789+0000 7faaf91d9700 1 -- 172.21.15.146:0/1578310911 >> v1:172.21.15.151:6789/0 conn(0x7faaf415a7f0 legacy=0x7faaf415acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:14.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.789+0000 7faaf91d9700 1 -- 172.21.15.146:0/1578310911 >> v1:172.21.15.146:6789/0 conn(0x7faaf415a420 legacy=0x7faaf40b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:14.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.789+0000 7faaf91d9700 1 -- 172.21.15.146:0/1578310911 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf415bd00 con 0x7faaf40b2530 2023-10-06T11:09:14.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.789+0000 7faaf91d9700 1 --2- 172.21.15.146:0/1578310911 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faaf40b2530 0x7faaf415cac0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7faaec009910 tx=0x7faaec0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5d827cf2cdd7833 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:14.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.789+0000 7faaeb7fe700 1 -- 172.21.15.146:0/1578310911 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaec011630 con 0x7faaf40b2530 2023-10-06T11:09:14.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.789+0000 7faaeb7fe700 1 -- 172.21.15.146:0/1578310911 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaec011790 con 0x7faaf40b2530 2023-10-06T11:09:14.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.789+0000 7faaeb7fe700 1 -- 172.21.15.146:0/1578310911 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaec011b10 con 0x7faaf40b2530 2023-10-06T11:09:14.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.789+0000 7faaf99da700 1 -- 172.21.15.146:0/1578310911 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faaf40b2530 msgr2=0x7faaf415cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:14.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.789+0000 7faaf99da700 1 --2- 172.21.15.146:0/1578310911 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faaf40b2530 0x7faaf415cac0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7faaec009910 tx=0x7faaec0091a0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.789+0000 7faaf99da700 1 -- 172.21.15.146:0/1578310911 shutdown_connections 2023-10-06T11:09:14.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.789+0000 7faaf99da700 1 --2- 172.21.15.146:0/1578310911 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faaf40b2530 0x7faaf415cac0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.789+0000 7faaf99da700 1 -- 172.21.15.146:0/1578310911 >> 172.21.15.146:0/1578310911 conn(0x7faaf406eba0 msgr2=0x7faaf406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:14.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.790+0000 7faaf99da700 1 -- 172.21.15.146:0/1578310911 shutdown_connections 2023-10-06T11:09:14.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.790+0000 7faaf99da700 1 -- 172.21.15.146:0/1578310911 wait complete. 2023-10-06T11:09:14.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.791+0000 7faaf99da700 1 Processor -- start 2023-10-06T11:09:14.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.791+0000 7faaf99da700 1 -- start start 2023-10-06T11:09:14.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.791+0000 7faaf99da700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaf40b2530 0x7faaf416a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:14.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.791+0000 7faaf99da700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faaf415a420 0x7faaf414d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:14.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.792+0000 7faaf99da700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faaf415a7f0 0x7faaf4158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:14.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.792+0000 7faaf99da700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf416aac0 con 0x7faaf40b2530 2023-10-06T11:09:14.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.792+0000 7faaf99da700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf4158570 con 0x7faaf415a7f0 2023-10-06T11:09:14.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.792+0000 7faaf99da700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf4157960 con 0x7faaf415a420 2023-10-06T11:09:14.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.792+0000 7faaf89d8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaf40b2530 0x7faaf416a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:14.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.792+0000 7faaf89d8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaf40b2530 0x7faaf416a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53532/0 (socket says 172.21.15.146:53532) 2023-10-06T11:09:14.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.792+0000 7faaf89d8700 1 -- 172.21.15.146:0/4024466380 learned_addr learned my addr 172.21.15.146:0/4024466380 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:14.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.792+0000 7faaebfff700 1 --2- 172.21.15.146:0/4024466380 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faaf415a420 0x7faaf414d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:14.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.792+0000 7faaf91d9700 1 --2- 172.21.15.146:0/4024466380 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faaf415a7f0 0x7faaf4158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:14.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.792+0000 7faaf89d8700 1 -- 172.21.15.146:0/4024466380 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faaf415a420 msgr2=0x7faaf414d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:14.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.792+0000 7faaf89d8700 1 --2- 172.21.15.146:0/4024466380 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faaf415a420 0x7faaf414d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.792+0000 7faaf89d8700 1 -- 172.21.15.146:0/4024466380 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faaf415a7f0 msgr2=0x7faaf4158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:14.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.792+0000 7faaf89d8700 1 --2- 172.21.15.146:0/4024466380 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faaf415a7f0 0x7faaf4158a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:14.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.792+0000 7faaf89d8700 1 -- 172.21.15.146:0/4024466380 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaec009420 con 0x7faaf40b2530 2023-10-06T11:09:14.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.792+0000 7faaf91d9700 1 --2- 172.21.15.146:0/4024466380 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faaf415a7f0 0x7faaf4158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:14.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.792+0000 7faaf89d8700 1 --2- 172.21.15.146:0/4024466380 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaf40b2530 0x7faaf416a580 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7faaf0002250 tx=0x7faaf0001bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:14.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.792+0000 7faae8ff9700 1 -- 172.21.15.146:0/4024466380 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf000ce90 con 0x7faaf40b2530 2023-10-06T11:09:14.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.792+0000 7faae8ff9700 1 -- 172.21.15.146:0/4024466380 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaf000ab30 con 0x7faaf40b2530 2023-10-06T11:09:14.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.792+0000 7faae8ff9700 1 -- 172.21.15.146:0/4024466380 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaf00070f0 con 0x7faaf40b2530 2023-10-06T11:09:14.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.792+0000 7faaf99da700 1 -- 172.21.15.146:0/4024466380 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaf4157c40 con 0x7faaf40b2530 2023-10-06T11:09:14.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.792+0000 7faaf99da700 1 -- 172.21.15.146:0/4024466380 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaf4158200 con 0x7faaf40b2530 2023-10-06T11:09:14.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.793+0000 7faaf99da700 1 -- 172.21.15.146:0/4024466380 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaf40afae0 con 0x7faaf40b2530 2023-10-06T11:09:14.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.794+0000 7faae8ff9700 1 -- 172.21.15.146:0/4024466380 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faaf00074e0 con 0x7faaf40b2530 2023-10-06T11:09:14.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.794+0000 7faae8ff9700 1 --2- 172.21.15.146:0/4024466380 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faae0066f30 0x7faae00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:14.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.794+0000 7faae8ff9700 1 -- 172.21.15.146:0/4024466380 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7faaf0084b50 con 0x7faaf40b2530 2023-10-06T11:09:14.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.794+0000 7faaebfff700 1 --2- 172.21.15.146:0/4024466380 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faae0066f30 0x7faae00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:14.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.795+0000 7faaebfff700 1 --2- 172.21.15.146:0/4024466380 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faae0066f30 0x7faae00693e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7faaf4152a80 tx=0x7faae4007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:14.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:14.799+0000 7faae8ff9700 1 -- 172.21.15.146:0/4024466380 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faaf0051ce0 con 0x7faaf40b2530 2023-10-06T11:09:15.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.023+0000 7faaf99da700 1 -- 172.21.15.146:0/4024466380 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faaf415bfe0 con 0x7faaf40b2530 2023-10-06T11:09:15.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.024+0000 7faae8ff9700 1 -- 172.21.15.146:0/4024466380 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4609 (secure 0 0 0) 0x7faaf0055300 con 0x7faaf40b2530 2023-10-06T11:09:15.025 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:09:15.025 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":36,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5248,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3360977916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3360977916},{"type":"v1","addr":"172.21.15.151:6834","nonce":3360977916}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5251,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2265934004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":2265934004},{"type":"v1","addr":"172.21.15.151:6835","nonce":2265934004}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2387575667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2387575667},{"type":"v1","addr":"172.21.15.146:6836","nonce":2387575667}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:08:42.797557+0000","modified":"2023-10-06T11:09:07.489130+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5481":{"gid":5481,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":9,"addr":"172.21.15.146:6837/2252184844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2252184844},{"type":"v1","addr":"172.21.15.146:6837","nonce":2252184844}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T11:09:15.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.025+0000 7faaf99da700 1 -- 172.21.15.146:0/4024466380 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faae0066f30 msgr2=0x7faae00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:15.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.025+0000 7faaf99da700 1 --2- 172.21.15.146:0/4024466380 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faae0066f30 0x7faae00693e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7faaf4152a80 tx=0x7faae4007d30 comp rx=0 tx=0).stop 2023-10-06T11:09:15.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.025+0000 7faaf99da700 1 -- 172.21.15.146:0/4024466380 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaf40b2530 msgr2=0x7faaf416a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:15.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.025+0000 7faaf99da700 1 --2- 172.21.15.146:0/4024466380 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaf40b2530 0x7faaf416a580 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7faaf0002250 tx=0x7faaf0001bb0 comp rx=0 tx=0).stop 2023-10-06T11:09:15.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.026+0000 7faaf99da700 1 -- 172.21.15.146:0/4024466380 shutdown_connections 2023-10-06T11:09:15.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.026+0000 7faaf99da700 1 --2- 172.21.15.146:0/4024466380 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faae0066f30 0x7faae00693e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:15.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.026+0000 7faaf99da700 1 --2- 172.21.15.146:0/4024466380 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faaf415a7f0 0x7faaf4158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:15.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.026+0000 7faaf99da700 1 --2- 172.21.15.146:0/4024466380 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaf40b2530 0x7faaf416a580 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:15.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.026+0000 7faaf99da700 1 --2- 172.21.15.146:0/4024466380 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faaf415a420 0x7faaf414d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:15.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.026+0000 7faaf99da700 1 -- 172.21.15.146:0/4024466380 >> 172.21.15.146:0/4024466380 conn(0x7faaf406eba0 msgr2=0x7faaf406ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:15.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.026+0000 7faaf99da700 1 -- 172.21.15.146:0/4024466380 shutdown_connections 2023-10-06T11:09:15.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.026+0000 7faaf99da700 1 -- 172.21.15.146:0/4024466380 wait complete. 2023-10-06T11:09:15.028 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 36 2023-10-06T11:09:15.038 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage rm 1095234618 2023-10-06T11:09:15.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.155+0000 7f0a0af80700 1 Processor -- start 2023-10-06T11:09:15.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.155+0000 7f0a0af80700 1 -- start start 2023-10-06T11:09:15.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.156+0000 7f0a0af80700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0a0415d710 0x7f0a040ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:15.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.156+0000 7f0a0af80700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0a040aef20 0x7f0a04068580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:15.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.156+0000 7f0a0af80700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a040b0010 con 0x7f0a04068ac0 2023-10-06T11:09:15.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.156+0000 7f0a0af80700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a0415e340 con 0x7f0a040aef20 2023-10-06T11:09:15.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.156+0000 7f0a0af80700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a040cf090 con 0x7f0a0415d710 2023-10-06T11:09:15.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.156+0000 7f09fbfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0a040aef20 0x7f0a04068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:15.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.156+0000 7f09fbfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0a040aef20 0x7f0a04068580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53546/0 (socket says 172.21.15.146:53546) 2023-10-06T11:09:15.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.156+0000 7f09fbfff700 1 -- 172.21.15.146:0/4116468758 learned_addr learned my addr 172.21.15.146:0/4116468758 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:15.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.156+0000 7f0a0951d700 1 --1- 172.21.15.146:0/4116468758 >> v1:172.21.15.146:6789/0 conn(0x7f0a04068ac0 0x7f0a040b04a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50898/0 (socket says 172.21.15.146:50898) 2023-10-06T11:09:15.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.157+0000 7f0a08d1c700 1 --2- 172.21.15.146:0/4116468758 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0a0415d710 0x7f0a040ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:15.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.157+0000 7f09fbfff700 1 -- 172.21.15.146:0/4116468758 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0a0415d710 msgr2=0x7f0a040ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:15.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.157+0000 7f09fbfff700 1 --2- 172.21.15.146:0/4116468758 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0a0415d710 0x7f0a040ceb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:15.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.157+0000 7f09fbfff700 1 -- 172.21.15.146:0/4116468758 >> v1:172.21.15.146:6789/0 conn(0x7f0a04068ac0 legacy=0x7f0a040b04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:15.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.157+0000 7f09fb7fe700 1 -- 172.21.15.146:0/4116468758 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2680601261 0 0) 0x7f0a040b0010 con 0x7f0a04068ac0 2023-10-06T11:09:15.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.157+0000 7f09fbfff700 1 -- 172.21.15.146:0/4116468758 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a040af400 con 0x7f0a040aef20 2023-10-06T11:09:15.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.157+0000 7f09fbfff700 1 --2- 172.21.15.146:0/4116468758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a040aef20 0x7f0a04068580 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f09f40099b0 tx=0x7f09f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36b247b88a3ce03c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:15.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.157+0000 7f09fb7fe700 1 -- 172.21.15.146:0/4116468758 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f400b860 con 0x7f0a040aef20 2023-10-06T11:09:15.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.157+0000 7f09fb7fe700 1 -- 172.21.15.146:0/4116468758 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f400b9c0 con 0x7f0a040aef20 2023-10-06T11:09:15.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.157+0000 7f09fb7fe700 1 -- 172.21.15.146:0/4116468758 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f400bd60 con 0x7f0a040aef20 2023-10-06T11:09:15.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.158+0000 7f0a0af80700 1 -- 172.21.15.146:0/4116468758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a040aef20 msgr2=0x7f0a04068580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:15.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.158+0000 7f0a0af80700 1 --2- 172.21.15.146:0/4116468758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a040aef20 0x7f0a04068580 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f09f40099b0 tx=0x7f09f4009250 comp rx=0 tx=0).stop 2023-10-06T11:09:15.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.158+0000 7f0a0af80700 1 -- 172.21.15.146:0/4116468758 shutdown_connections 2023-10-06T11:09:15.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.158+0000 7f0a0af80700 1 --2- 172.21.15.146:0/4116468758 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0a0415d710 0x7f0a040ceb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:15.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.158+0000 7f0a0af80700 1 --2- 172.21.15.146:0/4116468758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a040aef20 0x7f0a04068580 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:15.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.158+0000 7f0a0af80700 1 -- 172.21.15.146:0/4116468758 >> 172.21.15.146:0/4116468758 conn(0x7f0a04067c50 msgr2=0x7f0a040ce440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:15.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.158+0000 7f0a0af80700 1 -- 172.21.15.146:0/4116468758 shutdown_connections 2023-10-06T11:09:15.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.158+0000 7f0a0af80700 1 -- 172.21.15.146:0/4116468758 wait complete. 2023-10-06T11:09:15.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.159+0000 7f0a0af80700 1 Processor -- start 2023-10-06T11:09:15.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.159+0000 7f0a0af80700 1 -- start start 2023-10-06T11:09:15.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.160+0000 7f0a0af80700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a04068ac0 0x7f0a0416d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:15.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.160+0000 7f0a0af80700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0a040aef20 0x7f0a0416d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:15.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.160+0000 7f0a0af80700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0a0415d710 0x7f0a040c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:15.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.160+0000 7f0a0af80700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a040c8fd0 con 0x7f0a04068ac0 2023-10-06T11:09:15.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.160+0000 7f0a0af80700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0416ba50 con 0x7f0a040aef20 2023-10-06T11:09:15.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.160+0000 7f0a0af80700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0416b120 con 0x7f0a0415d710 2023-10-06T11:09:15.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.160+0000 7f0a08d1c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a04068ac0 0x7f0a0416d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:15.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.160+0000 7f0a08d1c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a04068ac0 0x7f0a0416d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53558/0 (socket says 172.21.15.146:53558) 2023-10-06T11:09:15.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.160+0000 7f0a08d1c700 1 -- 172.21.15.146:0/4043109811 learned_addr learned my addr 172.21.15.146:0/4043109811 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:15.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.160+0000 7f0a0951d700 1 --2- 172.21.15.146:0/4043109811 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0a0415d710 0x7f0a040c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:15.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.160+0000 7f09fbfff700 1 --2- 172.21.15.146:0/4043109811 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0a040aef20 0x7f0a0416d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:15.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.160+0000 7f0a08d1c700 1 -- 172.21.15.146:0/4043109811 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0a0415d710 msgr2=0x7f0a040c8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:15.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.160+0000 7f0a08d1c700 1 --2- 172.21.15.146:0/4043109811 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0a0415d710 0x7f0a040c8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:15.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.160+0000 7f0a08d1c700 1 -- 172.21.15.146:0/4043109811 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0a040aef20 msgr2=0x7f0a0416d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:15.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.160+0000 7f0a08d1c700 1 --2- 172.21.15.146:0/4043109811 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0a040aef20 0x7f0a0416d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:15.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.160+0000 7f0a08d1c700 1 -- 172.21.15.146:0/4043109811 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f40094f0 con 0x7f0a04068ac0 2023-10-06T11:09:15.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.160+0000 7f0a08d1c700 1 --2- 172.21.15.146:0/4043109811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a04068ac0 0x7f0a0416d3b0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f0a00009fa0 tx=0x7f0a00009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:15.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.160+0000 7f09f8ff9700 1 -- 172.21.15.146:0/4043109811 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0000ebc0 con 0x7f0a04068ac0 2023-10-06T11:09:15.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.160+0000 7f09f8ff9700 1 -- 172.21.15.146:0/4043109811 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0000ed20 con 0x7f0a04068ac0 2023-10-06T11:09:15.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.160+0000 7f0a0af80700 1 -- 172.21.15.146:0/4043109811 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a0416b400 con 0x7f0a04068ac0 2023-10-06T11:09:15.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.160+0000 7f09f8ff9700 1 -- 172.21.15.146:0/4043109811 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a00014670 con 0x7f0a04068ac0 2023-10-06T11:09:15.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.160+0000 7f0a0af80700 1 -- 172.21.15.146:0/4043109811 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a04140a20 con 0x7f0a04068ac0 2023-10-06T11:09:15.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.162+0000 7f09f8ff9700 1 -- 172.21.15.146:0/4043109811 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0a000149e0 con 0x7f0a04068ac0 2023-10-06T11:09:15.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.162+0000 7f09f8ff9700 1 --2- 172.21.15.146:0/4043109811 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f09f0066f30 0x7f09f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:15.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.162+0000 7f09f8ff9700 1 -- 172.21.15.146:0/4043109811 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0a00084c70 con 0x7f0a04068ac0 2023-10-06T11:09:15.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.162+0000 7f09fbfff700 1 --2- 172.21.15.146:0/4043109811 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f09f0066f30 0x7f09f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:15.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.163+0000 7f09fbfff700 1 --2- 172.21.15.146:0/4043109811 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f09f0066f30 0x7f09f00693e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f09f40099b0 tx=0x7f09f4017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:15.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.164+0000 7f0a14278b80 1 Processor -- start 2023-10-06T11:09:15.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.164+0000 7f0a14278b80 1 -- start start 2023-10-06T11:09:15.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.165+0000 7f0a14278b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55849352cb10 0x55849352cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:15.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.165+0000 7f0a14278b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584934e8a20 0x5584934e5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:15.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.165+0000 7f0a14278b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5584934e6c50 0x5584934e5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:15.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.165+0000 7f0a14278b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x558493465d00 con 0x55849352cb10 2023-10-06T11:09:15.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.165+0000 7f0a14278b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55849343caf0 con 0x5584934e8a20 2023-10-06T11:09:15.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.165+0000 7f0a14278b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55849343a2f0 con 0x5584934e6c50 2023-10-06T11:09:15.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.165+0000 7f0a08d1c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55849352cb10 0x55849352cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:15.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.165+0000 7f0a08d1c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55849352cb10 0x55849352cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53568/0 (socket says 172.21.15.146:53568) 2023-10-06T11:09:15.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.165+0000 7f0a08d1c700 1 -- 172.21.15.146:0/2466563649 learned_addr learned my addr 172.21.15.146:0/2466563649 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:15.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.165+0000 7f0a08d1c700 1 -- 172.21.15.146:0/2466563649 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5584934e6c50 msgr2=0x5584934e5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:15.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.165+0000 7f0a08d1c700 1 --2- 172.21.15.146:0/2466563649 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5584934e6c50 0x5584934e5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:15.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.165+0000 7f0a08d1c700 1 -- 172.21.15.146:0/2466563649 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584934e8a20 msgr2=0x5584934e5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:15.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.165+0000 7f09fbfff700 1 --2- 172.21.15.146:0/2466563649 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584934e8a20 0x5584934e5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:15.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.165+0000 7f0a08d1c700 1 --2- 172.21.15.146:0/2466563649 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584934e8a20 0x5584934e5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:15.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.165+0000 7f0a08d1c700 1 -- 172.21.15.146:0/2466563649 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5584932d02f0 con 0x55849352cb10 2023-10-06T11:09:15.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.165+0000 7f09fbfff700 1 --2- 172.21.15.146:0/2466563649 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584934e8a20 0x5584934e5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:09:15.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.165+0000 7f0a08d1c700 1 --2- 172.21.15.146:0/2466563649 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55849352cb10 0x55849352cee0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f0a0000c040 tx=0x7f0a00082f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3934d9a094a4c7df server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:15.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.166+0000 7f09e9ffb700 1 -- 172.21.15.146:0/2466563649 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a00055a40 con 0x55849352cb10 2023-10-06T11:09:15.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.166+0000 7f09e9ffb700 1 -- 172.21.15.146:0/2466563649 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a00058c90 con 0x55849352cb10 2023-10-06T11:09:15.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.166+0000 7f09e9ffb700 1 -- 172.21.15.146:0/2466563649 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0005c9e0 con 0x55849352cb10 2023-10-06T11:09:15.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.166+0000 7f0a14278b80 1 -- 172.21.15.146:0/2466563649 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55849352cb10 msgr2=0x55849352cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:15.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.166+0000 7f0a14278b80 1 --2- 172.21.15.146:0/2466563649 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55849352cb10 0x55849352cee0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f0a0000c040 tx=0x7f0a00082f90 comp rx=0 tx=0).stop 2023-10-06T11:09:15.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.166+0000 7f0a14278b80 1 -- 172.21.15.146:0/2466563649 shutdown_connections 2023-10-06T11:09:15.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.166+0000 7f0a14278b80 1 --2- 172.21.15.146:0/2466563649 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5584934e6c50 0x5584934e5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:15.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.166+0000 7f0a14278b80 1 --2- 172.21.15.146:0/2466563649 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55849352cb10 0x55849352cee0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:15.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.166+0000 7f0a14278b80 1 --2- 172.21.15.146:0/2466563649 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584934e8a20 0x5584934e5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:15.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.166+0000 7f0a14278b80 1 -- 172.21.15.146:0/2466563649 >> 172.21.15.146:0/2466563649 conn(0x5584934e70f0 msgr2=0x5584934e74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:15.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.166+0000 7f0a14278b80 1 -- 172.21.15.146:0/2466563649 shutdown_connections 2023-10-06T11:09:15.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.166+0000 7f0a14278b80 1 -- 172.21.15.146:0/2466563649 wait complete. 2023-10-06T11:09:15.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.167+0000 7f0a14278b80 1 -- start start 2023-10-06T11:09:15.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.167+0000 7f0a14278b80 1 Processor -- start 2023-10-06T11:09:15.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.168+0000 7f0a14278b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5584934e6c50 0x55849350e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:15.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.168+0000 7f0a14278b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5584934e8a20 0x55849350bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:15.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.168+0000 7f0a14278b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55849352cb10 0x55849350c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:15.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.168+0000 7f0a14278b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584934360e0 con 0x5584934e8a20 2023-10-06T11:09:15.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.168+0000 7f0a14278b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584933e1910 con 0x55849352cb10 2023-10-06T11:09:15.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.168+0000 7f0a14278b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5584933fcf20 con 0x5584934e6c50 2023-10-06T11:09:15.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.168+0000 7f0a14278b80 10 client.0 _ll_register_callbacks cb 0x5584932d2fb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:09:15.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.168+0000 7f09fbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5584934e8a20 0x55849350bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:15.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.168+0000 7f09fbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5584934e8a20 0x55849350bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53580/0 (socket says 172.21.15.146:53580) 2023-10-06T11:09:15.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.168+0000 7f09fbfff700 1 -- 172.21.15.146:0/2493547694 learned_addr learned my addr 172.21.15.146:0/2493547694 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:15.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.168+0000 7f0a0951d700 1 --2- 172.21.15.146:0/2493547694 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55849352cb10 0x55849350c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:15.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.168+0000 7f0a08d1c700 1 --2- 172.21.15.146:0/2493547694 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5584934e6c50 0x55849350e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:15.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.168+0000 7f09fbfff700 1 -- 172.21.15.146:0/2493547694 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5584934e6c50 msgr2=0x55849350e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:15.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.168+0000 7f09fbfff700 1 --2- 172.21.15.146:0/2493547694 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5584934e6c50 0x55849350e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:15.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.168+0000 7f09fbfff700 1 -- 172.21.15.146:0/2493547694 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55849352cb10 msgr2=0x55849350c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:15.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.168+0000 7f09fbfff700 1 --2- 172.21.15.146:0/2493547694 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55849352cb10 0x55849350c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:15.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.168+0000 7f09fbfff700 1 -- 172.21.15.146:0/2493547694 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a04140a20 con 0x5584934e8a20 2023-10-06T11:09:15.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.168+0000 7f09fbfff700 1 --2- 172.21.15.146:0/2493547694 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5584934e8a20 0x55849350bed0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f09f400b3c0 tx=0x7f09f4021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94dba16d6b1a1663 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:15.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.168+0000 7f09e2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:09:15.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.168+0000 7f09e2ffd700 1 -- 172.21.15.146:0/2493547694 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f4021070 con 0x5584934e8a20 2023-10-06T11:09:15.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.168+0000 7f09e2ffd700 1 -- 172.21.15.146:0/2493547694 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f09f400bda0 con 0x5584934e8a20 2023-10-06T11:09:15.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.168+0000 7f0a14278b80 1 -- 172.21.15.146:0/2493547694 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5584934da710 con 0x5584934e8a20 2023-10-06T11:09:15.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.169+0000 7f09e2ffd700 1 -- 172.21.15.146:0/2493547694 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09f401a630 con 0x5584934e8a20 2023-10-06T11:09:15.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.169+0000 7f0a14278b80 10 client.5901 fetch_fsmap learned FSMap version 36 2023-10-06T11:09:15.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.169+0000 7f0a14278b80 1 -- 172.21.15.146:0/2493547694 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x558493273060 con 0x5584934e8a20 2023-10-06T11:09:15.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.169+0000 7f09e2ffd700 1 -- 172.21.15.146:0/2493547694 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5584934da710 con 0x5584934e8a20 2023-10-06T11:09:15.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.169+0000 7f09e2ffd700 1 -- 172.21.15.146:0/2493547694 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 36) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f09f4030070 con 0x5584934e8a20 2023-10-06T11:09:15.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.169+0000 7f0a14278b80 10 client.5901 fetch_fsmap finished waiting for FSMap version 36 2023-10-06T11:09:15.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.169+0000 7f0a14278b80 10 client.5901 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T11:09:15.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.169+0000 7f0a14278b80 20 client.5901 populate_metadata read hostname 'smithi146' 2023-10-06T11:09:15.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.169+0000 7f0a14278b80 1 --2- 172.21.15.146:0/2493547694 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55849353f930 0x55849353fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:15.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.169+0000 7f0a14278b80 4 client.5901 mds_command: new command op to 5481 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:09:15.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.169+0000 7f0a14278b80 1 -- 172.21.15.146:0/2493547694 --> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5584934b7640 con 0x55849353f930 2023-10-06T11:09:15.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.169+0000 7f0a08d1c700 1 --2- 172.21.15.146:0/2493547694 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55849353f930 0x55849353fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:15.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.169+0000 7f09e2ffd700 10 client.5901 ms_handle_connect on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:15.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.169+0000 7f0a08d1c700 1 --2- 172.21.15.146:0/2493547694 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55849353f930 0x55849353fd00 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ed2d08b69aa29c server_cookie=b610ac43a8fb5f9a in_seq=0 out_seq=0 2023-10-06T11:09:15.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.170+0000 7f09e2ffd700 1 -- 172.21.15.146:0/2493547694 <== mds.0 v2:172.21.15.146:6835/2252184844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5584934b7640 con 0x55849353f930 2023-10-06T11:09:15.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.170+0000 7f09e2ffd700 10 client.5901 handle_command_reply: tid=0 2023-10-06T11:09:15.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.170+0000 7f0a14278b80 1 client.5901 shutdown 2023-10-06T11:09:15.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.170+0000 7f0a14278b80 1 -- 172.21.15.146:0/2493547694 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5584934e8a20 msgr2=0x55849350bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:15.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.170+0000 7f0a14278b80 1 --2- 172.21.15.146:0/2493547694 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5584934e8a20 0x55849350bed0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f09f400b3c0 tx=0x7f09f4021000 comp rx=0 tx=0).stop 2023-10-06T11:09:15.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.170+0000 7f0a14278b80 1 -- 172.21.15.146:0/2493547694 shutdown_connections 2023-10-06T11:09:15.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.170+0000 7f0a14278b80 1 --2- 172.21.15.146:0/2493547694 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55849353f930 0x55849353fd00 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:15.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.170+0000 7f0a14278b80 1 --2- 172.21.15.146:0/2493547694 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55849352cb10 0x55849350c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:15.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.170+0000 7f0a14278b80 1 --2- 172.21.15.146:0/2493547694 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5584934e6c50 0x55849350e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:15.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.170+0000 7f0a14278b80 1 --2- 172.21.15.146:0/2493547694 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5584934e8a20 0x55849350bed0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:15.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.170+0000 7f09e2ffd700 0 client.5901 ms_handle_reset on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:15.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.170+0000 7f0a14278b80 1 -- 172.21.15.146:0/2493547694 >> 172.21.15.146:0/2493547694 conn(0x5584934e70f0 msgr2=0x55849352a510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:15.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.170+0000 7f0a14278b80 1 -- 172.21.15.146:0/2493547694 shutdown_connections 2023-10-06T11:09:15.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.170+0000 7f0a14278b80 1 -- 172.21.15.146:0/2493547694 wait complete. 2023-10-06T11:09:15.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.170+0000 7f0a14278b80 20 client.5901 trim_cache size 0 max 16384 2023-10-06T11:09:15.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.182+0000 7f0a14278b80 1 Processor -- start 2023-10-06T11:09:15.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.182+0000 7f0a14278b80 1 -- start start 2023-10-06T11:09:15.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.183+0000 7f0a14278b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5584934e6c50 0x55849353b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:15.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.183+0000 7f0a14278b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5584934e8a20 0x55849352a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:15.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.183+0000 7f0a14278b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55849352cb10 0x55849350e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:15.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.183+0000 7f0a14278b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584934e1490 con 0x5584934e8a20 2023-10-06T11:09:15.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.183+0000 7f0a14278b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584932b8eb0 con 0x55849352cb10 2023-10-06T11:09:15.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.183+0000 7f0a14278b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55849352d770 con 0x5584934e6c50 2023-10-06T11:09:15.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.183+0000 7f09fbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5584934e8a20 0x55849352a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:15.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.183+0000 7f09fbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5584934e8a20 0x55849352a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53586/0 (socket says 172.21.15.146:53586) 2023-10-06T11:09:15.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.183+0000 7f09fbfff700 1 -- 172.21.15.146:0/906009572 learned_addr learned my addr 172.21.15.146:0/906009572 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:15.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.184+0000 7f09fbfff700 1 -- 172.21.15.146:0/906009572 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5584934e6c50 msgr2=0x55849353b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:15.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.184+0000 7f09fbfff700 1 --2- 172.21.15.146:0/906009572 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5584934e6c50 0x55849353b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:15.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.184+0000 7f09fbfff700 1 -- 172.21.15.146:0/906009572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55849352cb10 msgr2=0x55849350e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:15.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.184+0000 7f09fbfff700 1 --2- 172.21.15.146:0/906009572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55849352cb10 0x55849350e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:15.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.184+0000 7f09fbfff700 1 -- 172.21.15.146:0/906009572 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558493404800 con 0x5584934e8a20 2023-10-06T11:09:15.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.184+0000 7f09fbfff700 1 --2- 172.21.15.146:0/906009572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5584934e8a20 0x55849352a9f0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f09f4006df0 tx=0x7f09f4029070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31c4176bbad9650 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:15.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.184+0000 7f09ea7fc700 1 -- 172.21.15.146:0/906009572 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f4021050 con 0x5584934e8a20 2023-10-06T11:09:15.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.184+0000 7f09ea7fc700 1 -- 172.21.15.146:0/906009572 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f402d040 con 0x5584934e8a20 2023-10-06T11:09:15.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.184+0000 7f09ea7fc700 1 -- 172.21.15.146:0/906009572 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f401a7e0 con 0x5584934e8a20 2023-10-06T11:09:15.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.184+0000 7f0a14278b80 1 -- 172.21.15.146:0/906009572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5584934e8a20 msgr2=0x55849352a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:15.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.184+0000 7f0a14278b80 1 --2- 172.21.15.146:0/906009572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5584934e8a20 0x55849352a9f0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f09f4006df0 tx=0x7f09f4029070 comp rx=0 tx=0).stop 2023-10-06T11:09:15.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.184+0000 7f0a14278b80 1 -- 172.21.15.146:0/906009572 shutdown_connections 2023-10-06T11:09:15.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.184+0000 7f0a14278b80 1 --2- 172.21.15.146:0/906009572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55849352cb10 0x55849350e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:15.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.184+0000 7f0a14278b80 1 --2- 172.21.15.146:0/906009572 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5584934e6c50 0x55849353b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:15.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.184+0000 7f0a14278b80 1 --2- 172.21.15.146:0/906009572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5584934e8a20 0x55849352a9f0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:15.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.184+0000 7f0a14278b80 1 -- 172.21.15.146:0/906009572 >> 172.21.15.146:0/906009572 conn(0x5584934e70f0 msgr2=0x558493527430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:15.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.184+0000 7f0a14278b80 1 -- 172.21.15.146:0/906009572 shutdown_connections 2023-10-06T11:09:15.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.184+0000 7f0a14278b80 1 -- 172.21.15.146:0/906009572 wait complete. 2023-10-06T11:09:15.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.185+0000 7f0a14278b80 1 -- start start 2023-10-06T11:09:15.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.185+0000 7f0a14278b80 1 Processor -- start 2023-10-06T11:09:15.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.186+0000 7f0a14278b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5584934e6c50 0x55849350e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:15.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.186+0000 7f0a14278b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5584934e8a20 0x55849350ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:15.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.186+0000 7f0a14278b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55849352cb10 0x558493525dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:15.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.186+0000 7f0a14278b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x558493530260 con 0x5584934e8a20 2023-10-06T11:09:15.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.186+0000 7f0a14278b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584935222e0 con 0x55849352cb10 2023-10-06T11:09:15.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.186+0000 7f0a14278b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x558493592770 con 0x5584934e6c50 2023-10-06T11:09:15.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.186+0000 7f0a14278b80 10 client.0 _ll_register_callbacks cb 0x5584932d2fb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:09:15.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.186+0000 7f09fbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5584934e8a20 0x55849350ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:15.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.186+0000 7f09fbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5584934e8a20 0x55849350ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53594/0 (socket says 172.21.15.146:53594) 2023-10-06T11:09:15.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.186+0000 7f09fbfff700 1 -- 172.21.15.146:0/1589084144 learned_addr learned my addr 172.21.15.146:0/1589084144 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:15.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.186+0000 7f0a08d1c700 1 --2- 172.21.15.146:0/1589084144 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5584934e6c50 0x55849350e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:15.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.186+0000 7f0a0951d700 1 --2- 172.21.15.146:0/1589084144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55849352cb10 0x558493525dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:15.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.186+0000 7f09fbfff700 1 -- 172.21.15.146:0/1589084144 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5584934e6c50 msgr2=0x55849350e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:15.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.186+0000 7f09fbfff700 1 --2- 172.21.15.146:0/1589084144 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5584934e6c50 0x55849350e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:15.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.186+0000 7f09fbfff700 1 -- 172.21.15.146:0/1589084144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55849352cb10 msgr2=0x558493525dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:15.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.186+0000 7f09fbfff700 1 --2- 172.21.15.146:0/1589084144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55849352cb10 0x558493525dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:15.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.186+0000 7f09fbfff700 1 -- 172.21.15.146:0/1589084144 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558493273060 con 0x5584934e8a20 2023-10-06T11:09:15.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.187+0000 7f09fbfff700 1 --2- 172.21.15.146:0/1589084144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5584934e8a20 0x55849350ed20 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f09f4009290 tx=0x7f09f400d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17bb651840e71c94 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:15.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.187+0000 7f09e2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:09:15.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.187+0000 7f09e2ffd700 1 -- 172.21.15.146:0/1589084144 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f4050070 con 0x5584934e8a20 2023-10-06T11:09:15.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.187+0000 7f09e2ffd700 1 -- 172.21.15.146:0/1589084144 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f09f404c420 con 0x5584934e8a20 2023-10-06T11:09:15.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.187+0000 7f0a14278b80 1 -- 172.21.15.146:0/1589084144 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0a00058c90 con 0x5584934e8a20 2023-10-06T11:09:15.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.187+0000 7f09e2ffd700 1 -- 172.21.15.146:0/1589084144 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09f4021040 con 0x5584934e8a20 2023-10-06T11:09:15.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.187+0000 7f0a14278b80 10 client.5907 fetch_fsmap learned FSMap version 36 2023-10-06T11:09:15.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.187+0000 7f0a14278b80 1 -- 172.21.15.146:0/1589084144 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x5584933eb4f0 con 0x5584934e8a20 2023-10-06T11:09:15.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.187+0000 7f09e2ffd700 1 -- 172.21.15.146:0/1589084144 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a00058c90 con 0x5584934e8a20 2023-10-06T11:09:15.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.187+0000 7f09e2ffd700 1 -- 172.21.15.146:0/1589084144 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 36) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f09f4053030 con 0x5584934e8a20 2023-10-06T11:09:15.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.187+0000 7f0a14278b80 10 client.5907 fetch_fsmap finished waiting for FSMap version 36 2023-10-06T11:09:15.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.187+0000 7f0a14278b80 10 client.5907 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T11:09:15.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.187+0000 7f0a14278b80 20 client.5907 populate_metadata read hostname 'smithi146' 2023-10-06T11:09:15.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.187+0000 7f0a14278b80 1 --2- 172.21.15.146:0/1589084144 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55849352cf90 0x558493526310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:15.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.187+0000 7f0a14278b80 4 client.5907 mds_command: new command op to 5481 tid=0[{"prefix": "damage rm", "damage_id": 1095234618}] 2023-10-06T11:09:15.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.187+0000 7f0a14278b80 1 -- 172.21.15.146:0/1589084144 --> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] -- command(tid 0: {"prefix": "damage rm", "damage_id": 1095234618}) v1 -- 0x5584933d8e80 con 0x55849352cf90 2023-10-06T11:09:15.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.187+0000 7f0a08d1c700 1 --2- 172.21.15.146:0/1589084144 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55849352cf90 0x558493526310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:15.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.188+0000 7f09e2ffd700 10 client.5907 ms_handle_connect on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:15.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.188+0000 7f0a08d1c700 1 --2- 172.21.15.146:0/1589084144 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55849352cf90 0x558493526310 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=618aef8b4abf0b7a server_cookie=38ec2beecec0bdc6 in_seq=0 out_seq=0 2023-10-06T11:09:15.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.188+0000 7f09e2ffd700 1 -- 172.21.15.146:0/1589084144 <== mds.0 v2:172.21.15.146:6835/2252184844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+0 (crc 0 0 0) 0x5584933d8e80 con 0x55849352cf90 2023-10-06T11:09:15.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.188+0000 7f09e2ffd700 10 client.5907 handle_command_reply: tid=0 2023-10-06T11:09:15.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.188+0000 7f0a14278b80 1 client.5907 shutdown 2023-10-06T11:09:15.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.188+0000 7f0a14278b80 1 -- 172.21.15.146:0/1589084144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5584934e8a20 msgr2=0x55849350ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:15.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.188+0000 7f0a14278b80 1 --2- 172.21.15.146:0/1589084144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5584934e8a20 0x55849350ed20 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f09f4009290 tx=0x7f09f400d000 comp rx=0 tx=0).stop 2023-10-06T11:09:15.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.188+0000 7f0a14278b80 1 -- 172.21.15.146:0/1589084144 shutdown_connections 2023-10-06T11:09:15.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.188+0000 7f0a14278b80 1 --2- 172.21.15.146:0/1589084144 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55849352cf90 0x558493526310 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:15.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.188+0000 7f0a14278b80 1 --2- 172.21.15.146:0/1589084144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55849352cb10 0x558493525dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:15.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.188+0000 7f09e2ffd700 0 client.5907 ms_handle_reset on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:15.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.188+0000 7f0a14278b80 1 --2- 172.21.15.146:0/1589084144 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5584934e6c50 0x55849350e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:15.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.188+0000 7f0a14278b80 1 --2- 172.21.15.146:0/1589084144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5584934e8a20 0x55849350ed20 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:15.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.188+0000 7f0a14278b80 1 -- 172.21.15.146:0/1589084144 >> 172.21.15.146:0/1589084144 conn(0x5584934e70f0 msgr2=0x55849352aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:15.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.188+0000 7f0a14278b80 1 -- 172.21.15.146:0/1589084144 shutdown_connections 2023-10-06T11:09:15.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.188+0000 7f0a14278b80 1 -- 172.21.15.146:0/1589084144 wait complete. 2023-10-06T11:09:15.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.188+0000 7f0a14278b80 20 client.5907 trim_cache size 0 max 16384 2023-10-06T11:09:15.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.189+0000 7f0a0af80700 1 -- 172.21.15.146:0/4043109811 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f09f0066f30 msgr2=0x7f09f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:15.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.189+0000 7f0a0af80700 1 --2- 172.21.15.146:0/4043109811 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f09f0066f30 0x7f09f00693e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f09f40099b0 tx=0x7f09f4017000 comp rx=0 tx=0).stop 2023-10-06T11:09:15.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.189+0000 7f0a0af80700 1 -- 172.21.15.146:0/4043109811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a04068ac0 msgr2=0x7f0a0416d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:15.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.189+0000 7f0a0af80700 1 --2- 172.21.15.146:0/4043109811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a04068ac0 0x7f0a0416d3b0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f0a00009fa0 tx=0x7f0a00009880 comp rx=0 tx=0).stop 2023-10-06T11:09:15.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.189+0000 7f0a0af80700 1 -- 172.21.15.146:0/4043109811 shutdown_connections 2023-10-06T11:09:15.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.189+0000 7f0a0af80700 1 --2- 172.21.15.146:0/4043109811 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f09f0066f30 0x7f09f00693e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:15.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.189+0000 7f0a0af80700 1 --2- 172.21.15.146:0/4043109811 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0a0415d710 0x7f0a040c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:15.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.189+0000 7f0a0af80700 1 --2- 172.21.15.146:0/4043109811 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0a04068ac0 0x7f0a0416d3b0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:15.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.189+0000 7f0a0af80700 1 --2- 172.21.15.146:0/4043109811 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0a040aef20 0x7f0a0416d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:15.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.189+0000 7f0a0af80700 1 -- 172.21.15.146:0/4043109811 >> 172.21.15.146:0/4043109811 conn(0x7f0a04067c50 msgr2=0x7f0a04152e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:15.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.189+0000 7f0a0af80700 1 -- 172.21.15.146:0/4043109811 shutdown_connections 2023-10-06T11:09:15.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.189+0000 7f0a0af80700 1 -- 172.21.15.146:0/4043109811 wait complete. 2023-10-06T11:09:15.201 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2023-10-06T11:09:15.201 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:09:15.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.315+0000 7fa133a0d700 1 Processor -- start 2023-10-06T11:09:15.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.316+0000 7fa133a0d700 1 -- start start 2023-10-06T11:09:15.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.316+0000 7fa133a0d700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa12c0ab010 0x7fa12c157800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:15.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.316+0000 7fa133a0d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa12c0ca070 0x7fa12c0cc240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:15.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.316+0000 7fa133a0d700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa12c0ccf20 con 0x7fa12c157430 2023-10-06T11:09:15.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.316+0000 7fa133a0d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa12c0ca4f0 con 0x7fa12c0ca070 2023-10-06T11:09:15.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.316+0000 7fa133a0d700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa12c0c3dd0 con 0x7fa12c0ab010 2023-10-06T11:09:15.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.317+0000 7fa131faa700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa12c0ca070 0x7fa12c0cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:15.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.317+0000 7fa131faa700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa12c0ca070 0x7fa12c0cc240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53604/0 (socket says 172.21.15.146:53604) 2023-10-06T11:09:15.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.317+0000 7fa131faa700 1 -- 172.21.15.146:0/118663900 learned_addr learned my addr 172.21.15.146:0/118663900 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:15.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.317+0000 7fa130fa8700 1 --2- 172.21.15.146:0/118663900 >> v2:172.21.15.151:3300/0 conn(0x7fa12c0ab010 0x7fa12c157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:15.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.317+0000 7fa131faa700 1 -- 172.21.15.146:0/118663900 >> v2:172.21.15.151:3300/0 conn(0x7fa12c0ab010 msgr2=0x7fa12c157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:15.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.317+0000 7fa131faa700 1 --2- 172.21.15.146:0/118663900 >> v2:172.21.15.151:3300/0 conn(0x7fa12c0ab010 0x7fa12c157800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:15.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.317+0000 7fa131faa700 1 -- 172.21.15.146:0/118663900 >> v1:172.21.15.151:6789/0 conn(0x7fa12c157430 legacy=0x7fa12c0ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:15.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.317+0000 7fa131faa700 1 -- 172.21.15.146:0/118663900 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa12c0cd200 con 0x7fa12c0ca070 2023-10-06T11:09:15.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.317+0000 7fa131faa700 1 --2- 172.21.15.146:0/118663900 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa12c0ca070 0x7fa12c0cc240 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa12c06f1a0 tx=0x7fa124009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33cd82cea35833a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:15.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.317+0000 7fa123fff700 1 -- 172.21.15.146:0/118663900 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12400b820 con 0x7fa12c0ca070 2023-10-06T11:09:15.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.317+0000 7fa123fff700 1 -- 172.21.15.146:0/118663900 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa12400b980 con 0x7fa12c0ca070 2023-10-06T11:09:15.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.317+0000 7fa123fff700 1 -- 172.21.15.146:0/118663900 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12400bd40 con 0x7fa12c0ca070 2023-10-06T11:09:15.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.318+0000 7fa133a0d700 1 -- 172.21.15.146:0/118663900 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa12c0ca070 msgr2=0x7fa12c0cc240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:15.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.318+0000 7fa133a0d700 1 --2- 172.21.15.146:0/118663900 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa12c0ca070 0x7fa12c0cc240 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fa12c06f1a0 tx=0x7fa124009250 comp rx=0 tx=0).stop 2023-10-06T11:09:15.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.318+0000 7fa133a0d700 1 -- 172.21.15.146:0/118663900 shutdown_connections 2023-10-06T11:09:15.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.318+0000 7fa133a0d700 1 --2- 172.21.15.146:0/118663900 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa12c0ca070 0x7fa12c0cc240 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:15.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.318+0000 7fa133a0d700 1 --2- 172.21.15.146:0/118663900 >> v2:172.21.15.151:3300/0 conn(0x7fa12c0ab010 0x7fa12c157800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:15.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.318+0000 7fa133a0d700 1 -- 172.21.15.146:0/118663900 >> 172.21.15.146:0/118663900 conn(0x7fa12c067c50 msgr2=0x7fa12c0ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:15.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.318+0000 7fa133a0d700 1 -- 172.21.15.146:0/118663900 shutdown_connections 2023-10-06T11:09:15.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.318+0000 7fa133a0d700 1 -- 172.21.15.146:0/118663900 wait complete. 2023-10-06T11:09:15.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.319+0000 7fa133a0d700 1 Processor -- start 2023-10-06T11:09:15.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.319+0000 7fa133a0d700 1 -- start start 2023-10-06T11:09:15.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.320+0000 7fa133a0d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa12c0ab010 0x7fa12c14bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:15.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.320+0000 7fa133a0d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa12c0ca070 0x7fa12c0ada40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:15.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.320+0000 7fa133a0d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa12c157430 0x7fa12c0acc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:15.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.320+0000 7fa133a0d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12c0aef50 con 0x7fa12c0ca070 2023-10-06T11:09:15.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.320+0000 7fa133a0d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12c0ae340 con 0x7fa12c0ab010 2023-10-06T11:09:15.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.320+0000 7fa133a0d700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa12c0ae620 con 0x7fa12c157430 2023-10-06T11:09:15.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.320+0000 7fa130fa8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa12c0ca070 0x7fa12c0ada40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:15.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.320+0000 7fa130fa8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa12c0ca070 0x7fa12c0ada40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53616/0 (socket says 172.21.15.146:53616) 2023-10-06T11:09:15.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.320+0000 7fa130fa8700 1 -- 172.21.15.146:0/3466881695 learned_addr learned my addr 172.21.15.146:0/3466881695 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:15.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.320+0000 7fa131faa700 1 --2- 172.21.15.146:0/3466881695 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa12c157430 0x7fa12c0acc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:15.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.320+0000 7fa1317a9700 1 --2- 172.21.15.146:0/3466881695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa12c0ab010 0x7fa12c14bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:15.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.320+0000 7fa130fa8700 1 -- 172.21.15.146:0/3466881695 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa12c157430 msgr2=0x7fa12c0acc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:15.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.320+0000 7fa130fa8700 1 --2- 172.21.15.146:0/3466881695 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa12c157430 0x7fa12c0acc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:15.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.320+0000 7fa130fa8700 1 -- 172.21.15.146:0/3466881695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa12c0ab010 msgr2=0x7fa12c14bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:15.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.320+0000 7fa130fa8700 1 --2- 172.21.15.146:0/3466881695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa12c0ab010 0x7fa12c14bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:15.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.320+0000 7fa130fa8700 1 -- 172.21.15.146:0/3466881695 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1240094f0 con 0x7fa12c0ca070 2023-10-06T11:09:15.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.320+0000 7fa1317a9700 1 --2- 172.21.15.146:0/3466881695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa12c0ab010 0x7fa12c14bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:15.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.320+0000 7fa130fa8700 1 --2- 172.21.15.146:0/3466881695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa12c0ca070 0x7fa12c0ada40 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa11c00d890 tx=0x7fa11c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:15.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.320+0000 7fa1217fa700 1 -- 172.21.15.146:0/3466881695 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11c0125f0 con 0x7fa12c0ca070 2023-10-06T11:09:15.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.320+0000 7fa1217fa700 1 -- 172.21.15.146:0/3466881695 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11c012750 con 0x7fa12c0ca070 2023-10-06T11:09:15.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.321+0000 7fa1217fa700 1 -- 172.21.15.146:0/3466881695 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11c012ad0 con 0x7fa12c0ca070 2023-10-06T11:09:15.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.321+0000 7fa133a0d700 1 -- 172.21.15.146:0/3466881695 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa12c0ae900 con 0x7fa12c0ca070 2023-10-06T11:09:15.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.321+0000 7fa133a0d700 1 -- 172.21.15.146:0/3466881695 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa12c14c400 con 0x7fa12c0ca070 2023-10-06T11:09:15.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.321+0000 7fa133a0d700 1 -- 172.21.15.146:0/3466881695 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa12c064010 con 0x7fa12c0ca070 2023-10-06T11:09:15.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.322+0000 7fa1217fa700 1 -- 172.21.15.146:0/3466881695 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa11c01e460 con 0x7fa12c0ca070 2023-10-06T11:09:15.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.322+0000 7fa1217fa700 1 --2- 172.21.15.146:0/3466881695 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa110066f30 0x7fa1100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:15.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.322+0000 7fa1217fa700 1 -- 172.21.15.146:0/3466881695 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa11c084d50 con 0x7fa12c0ca070 2023-10-06T11:09:15.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.322+0000 7fa1317a9700 1 --2- 172.21.15.146:0/3466881695 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa110066f30 0x7fa1100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:15.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.323+0000 7fa1317a9700 1 --2- 172.21.15.146:0/3466881695 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa110066f30 0x7fa1100693e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa128001370 tx=0x7fa128009680 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:15.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.327+0000 7fa1217fa700 1 -- 172.21.15.146:0/3466881695 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa11c051dc0 con 0x7fa12c0ca070 2023-10-06T11:09:15.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.560+0000 7fa133a0d700 1 -- 172.21.15.146:0/3466881695 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa12c04c380 con 0x7fa12c0ca070 2023-10-06T11:09:15.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.560+0000 7fa1217fa700 1 -- 172.21.15.146:0/3466881695 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4609 (secure 0 0 0) 0x7fa11c0553e0 con 0x7fa12c0ca070 2023-10-06T11:09:15.561 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:09:15.561 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":36,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5248,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3360977916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3360977916},{"type":"v1","addr":"172.21.15.151:6834","nonce":3360977916}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5251,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2265934004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":2265934004},{"type":"v1","addr":"172.21.15.151:6835","nonce":2265934004}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2387575667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2387575667},{"type":"v1","addr":"172.21.15.146:6836","nonce":2387575667}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:08:42.797557+0000","modified":"2023-10-06T11:09:07.489130+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5481":{"gid":5481,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":9,"addr":"172.21.15.146:6837/2252184844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2252184844},{"type":"v1","addr":"172.21.15.146:6837","nonce":2252184844}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T11:09:15.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.562+0000 7fa133a0d700 1 -- 172.21.15.146:0/3466881695 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa110066f30 msgr2=0x7fa1100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:15.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.562+0000 7fa133a0d700 1 --2- 172.21.15.146:0/3466881695 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa110066f30 0x7fa1100693e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa128001370 tx=0x7fa128009680 comp rx=0 tx=0).stop 2023-10-06T11:09:15.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.562+0000 7fa133a0d700 1 -- 172.21.15.146:0/3466881695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa12c0ca070 msgr2=0x7fa12c0ada40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:15.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.562+0000 7fa133a0d700 1 --2- 172.21.15.146:0/3466881695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa12c0ca070 0x7fa12c0ada40 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa11c00d890 tx=0x7fa11c008040 comp rx=0 tx=0).stop 2023-10-06T11:09:15.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.562+0000 7fa133a0d700 1 -- 172.21.15.146:0/3466881695 shutdown_connections 2023-10-06T11:09:15.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.562+0000 7fa133a0d700 1 --2- 172.21.15.146:0/3466881695 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa110066f30 0x7fa1100693e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:15.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.562+0000 7fa133a0d700 1 --2- 172.21.15.146:0/3466881695 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa12c157430 0x7fa12c0acc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:15.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.562+0000 7fa133a0d700 1 --2- 172.21.15.146:0/3466881695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa12c0ab010 0x7fa12c14bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:15.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.562+0000 7fa133a0d700 1 --2- 172.21.15.146:0/3466881695 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa12c0ca070 0x7fa12c0ada40 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:15.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.563+0000 7fa133a0d700 1 -- 172.21.15.146:0/3466881695 >> 172.21.15.146:0/3466881695 conn(0x7fa12c067c50 msgr2=0x7fa12c0cb260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:15.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.563+0000 7fa133a0d700 1 -- 172.21.15.146:0/3466881695 shutdown_connections 2023-10-06T11:09:15.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:15.563+0000 7fa133a0d700 1 -- 172.21.15.146:0/3466881695 wait complete. 2023-10-06T11:09:15.564 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 36 2023-10-06T11:09:15.575 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok flush_path / 2023-10-06T11:09:15.697 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:09:15.697 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0 2023-10-06T11:09:15.697 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:09:15.707 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' got response code '0' and stdout '{ "return_code": 0 } ' 2023-10-06T11:09:15.708 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2023-10-06T11:09:15.708 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_test_path 2023-10-06T11:09:15.708 INFO:tasks.cephfs.test_scrub_checks:Cloning repo into place 2023-10-06T11:09:15.708 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:09:15.708 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p /home/ubuntu/cephtest/mnt.0/scrub_test_path) 2023-10-06T11:09:15.723 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T11:09:15.723 DEBUG:teuthology.orchestra.run.smithi146:> import os 2023-10-06T11:09:15.724 DEBUG:teuthology.orchestra.run.smithi146:> import stat 2023-10-06T11:09:15.724 DEBUG:teuthology.orchestra.run.smithi146:> import json 2023-10-06T11:09:15.724 DEBUG:teuthology.orchestra.run.smithi146:> import sys 2023-10-06T11:09:15.724 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:09:15.724 DEBUG:teuthology.orchestra.run.smithi146:> try: 2023-10-06T11:09:15.724 DEBUG:teuthology.orchestra.run.smithi146:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite'"'"') 2023-10-06T11:09:15.724 DEBUG:teuthology.orchestra.run.smithi146:> except OSError as e: 2023-10-06T11:09:15.724 DEBUG:teuthology.orchestra.run.smithi146:> sys.exit(e.errno) 2023-10-06T11:09:15.724 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:09:15.724 DEBUG:teuthology.orchestra.run.smithi146:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2023-10-06T11:09:15.724 DEBUG:teuthology.orchestra.run.smithi146:> print(json.dumps( 2023-10-06T11:09:15.724 DEBUG:teuthology.orchestra.run.smithi146:> dict([(a, getattr(s, a)) for a in attrs]), 2023-10-06T11:09:15.725 DEBUG:teuthology.orchestra.run.smithi146:> indent=2)) 2023-10-06T11:09:15.725 DEBUG:teuthology.orchestra.run.smithi146:> ' 2023-10-06T11:09:15.830 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:09:15.831 INFO:teuthology.orchestra.run.smithi146.stdout: "st_mode": 16893, 2023-10-06T11:09:15.831 INFO:teuthology.orchestra.run.smithi146.stdout: "st_ino": 1099511627777, 2023-10-06T11:09:15.831 INFO:teuthology.orchestra.run.smithi146.stdout: "st_dev": 46, 2023-10-06T11:09:15.831 INFO:teuthology.orchestra.run.smithi146.stdout: "st_nlink": 16, 2023-10-06T11:09:15.831 INFO:teuthology.orchestra.run.smithi146.stdout: "st_uid": 1000, 2023-10-06T11:09:15.831 INFO:teuthology.orchestra.run.smithi146.stdout: "st_gid": 1275, 2023-10-06T11:09:15.831 INFO:teuthology.orchestra.run.smithi146.stdout: "st_size": 9198928, 2023-10-06T11:09:15.831 INFO:teuthology.orchestra.run.smithi146.stdout: "st_atime": 1696590535.8522348, 2023-10-06T11:09:15.831 INFO:teuthology.orchestra.run.smithi146.stdout: "st_mtime": 1696590547.891404, 2023-10-06T11:09:15.831 INFO:teuthology.orchestra.run.smithi146.stdout: "st_ctime": 1696590547.891404 2023-10-06T11:09:15.831 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:09:16.016 INFO:tasks.cephfs.test_scrub_checks:Initiating mds_scrub_checks on mds.0 test_path /scrub_test_path, run_seq 1 2023-10-06T11:09:16.016 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/i/dont/exist' 2023-10-06T11:09:16.017 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:09:16.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.170+0000 7fca0f6a0700 1 Processor -- start 2023-10-06T11:09:16.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.170+0000 7fca0f6a0700 1 -- start start 2023-10-06T11:09:16.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.171+0000 7fca0f6a0700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca08153ab0 0x7fca0815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:16.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.171+0000 7fca0f6a0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fca08068ba0 0x7fca080b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:16.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.171+0000 7fca0f6a0700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca0815ac30 con 0x7fca08153e80 2023-10-06T11:09:16.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.171+0000 7fca0f6a0700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca080b4510 con 0x7fca08068ba0 2023-10-06T11:09:16.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.171+0000 7fca0f6a0700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca080b6530 con 0x7fca08153ab0 2023-10-06T11:09:16.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.171+0000 7fca0dc3d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fca08068ba0 0x7fca080b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:16.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.171+0000 7fca0dc3d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fca08068ba0 0x7fca080b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53626/0 (socket says 172.21.15.146:53626) 2023-10-06T11:09:16.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.171+0000 7fca0dc3d700 1 -- 172.21.15.146:0/2935911373 learned_addr learned my addr 172.21.15.146:0/2935911373 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:16.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.172+0000 7fca0d43c700 1 --2- 172.21.15.146:0/2935911373 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca08153ab0 0x7fca0815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:16.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.172+0000 7fca0dc3d700 1 -- 172.21.15.146:0/2935911373 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca08153ab0 msgr2=0x7fca0815a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:16.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.172+0000 7fca0dc3d700 1 --2- 172.21.15.146:0/2935911373 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca08153ab0 0x7fca0815a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.172+0000 7fca0dc3d700 1 -- 172.21.15.146:0/2935911373 >> v1:172.21.15.151:6789/0 conn(0x7fca08153e80 legacy=0x7fca08068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:16.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.172+0000 7fca0dc3d700 1 -- 172.21.15.146:0/2935911373 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca080b5c50 con 0x7fca08068ba0 2023-10-06T11:09:16.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.172+0000 7fca0dc3d700 1 --2- 172.21.15.146:0/2935911373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca08068ba0 0x7fca080b49a0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fca00009f20 tx=0x7fca00009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d07bc93b9bc4c27 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:16.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.172+0000 7fc9fffff700 1 -- 172.21.15.146:0/2935911373 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0000e070 con 0x7fca08068ba0 2023-10-06T11:09:16.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.172+0000 7fc9fffff700 1 -- 172.21.15.146:0/2935911373 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca0000ba40 con 0x7fca08068ba0 2023-10-06T11:09:16.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.172+0000 7fc9fffff700 1 -- 172.21.15.146:0/2935911373 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca000092e0 con 0x7fca08068ba0 2023-10-06T11:09:16.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.173+0000 7fca0f6a0700 1 -- 172.21.15.146:0/2935911373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca08068ba0 msgr2=0x7fca080b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:16.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.173+0000 7fca0f6a0700 1 --2- 172.21.15.146:0/2935911373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca08068ba0 0x7fca080b49a0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fca00009f20 tx=0x7fca00009840 comp rx=0 tx=0).stop 2023-10-06T11:09:16.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.173+0000 7fca0f6a0700 1 -- 172.21.15.146:0/2935911373 shutdown_connections 2023-10-06T11:09:16.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.173+0000 7fca0f6a0700 1 --2- 172.21.15.146:0/2935911373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca08068ba0 0x7fca080b49a0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.173+0000 7fca0f6a0700 1 --2- 172.21.15.146:0/2935911373 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca08153ab0 0x7fca0815a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.173+0000 7fca0f6a0700 1 -- 172.21.15.146:0/2935911373 >> 172.21.15.146:0/2935911373 conn(0x7fca0806eba0 msgr2=0x7fca0806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:16.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.173+0000 7fca0f6a0700 1 -- 172.21.15.146:0/2935911373 shutdown_connections 2023-10-06T11:09:16.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.173+0000 7fca0f6a0700 1 -- 172.21.15.146:0/2935911373 wait complete. 2023-10-06T11:09:16.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.174+0000 7fca0f6a0700 1 Processor -- start 2023-10-06T11:09:16.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.174+0000 7fca0f6a0700 1 -- start start 2023-10-06T11:09:16.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.175+0000 7fca0f6a0700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca08068ba0 0x7fca0814fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:16.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.175+0000 7fca0f6a0700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca08153ab0 0x7fca080cea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:16.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.175+0000 7fca0f6a0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca08153e80 0x7fca080cef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:16.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.175+0000 7fca0f6a0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca08156fe0 con 0x7fca08153e80 2023-10-06T11:09:16.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.175+0000 7fca0f6a0700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca08154690 con 0x7fca08153ab0 2023-10-06T11:09:16.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.175+0000 7fca0f6a0700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca0815a350 con 0x7fca08068ba0 2023-10-06T11:09:16.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.175+0000 7fca0dc3d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca08153e80 0x7fca080cef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:16.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.175+0000 7fca0dc3d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca08153e80 0x7fca080cef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53630/0 (socket says 172.21.15.146:53630) 2023-10-06T11:09:16.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.175+0000 7fca0dc3d700 1 -- 172.21.15.146:0/3955755549 learned_addr learned my addr 172.21.15.146:0/3955755549 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:16.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.175+0000 7fca0d43c700 1 --2- 172.21.15.146:0/3955755549 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca08068ba0 0x7fca0814fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:16.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.175+0000 7fca0cc3b700 1 --2- 172.21.15.146:0/3955755549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca08153ab0 0x7fca080cea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:16.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.175+0000 7fca0dc3d700 1 -- 172.21.15.146:0/3955755549 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca08068ba0 msgr2=0x7fca0814fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:16.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.175+0000 7fca0dc3d700 1 --2- 172.21.15.146:0/3955755549 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca08068ba0 0x7fca0814fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.175+0000 7fca0dc3d700 1 -- 172.21.15.146:0/3955755549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca08153ab0 msgr2=0x7fca080cea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:16.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.175+0000 7fca0dc3d700 1 --2- 172.21.15.146:0/3955755549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca08153ab0 0x7fca080cea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.175+0000 7fca0dc3d700 1 -- 172.21.15.146:0/3955755549 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca00009ae0 con 0x7fca08153e80 2023-10-06T11:09:16.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.175+0000 7fca0cc3b700 1 --2- 172.21.15.146:0/3955755549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca08153ab0 0x7fca080cea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:09:16.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.175+0000 7fca0dc3d700 1 --2- 172.21.15.146:0/3955755549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca08153e80 0x7fca080cef50 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fca00003000 tx=0x7fca00017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:16.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.175+0000 7fc9fd7fa700 1 -- 172.21.15.146:0/3955755549 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca000032f0 con 0x7fca08153e80 2023-10-06T11:09:16.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.175+0000 7fc9fd7fa700 1 -- 172.21.15.146:0/3955755549 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca00012e60 con 0x7fca08153e80 2023-10-06T11:09:16.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.175+0000 7fc9fd7fa700 1 -- 172.21.15.146:0/3955755549 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0001d670 con 0x7fca08153e80 2023-10-06T11:09:16.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.175+0000 7fca0f6a0700 1 -- 172.21.15.146:0/3955755549 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca0815a630 con 0x7fca08153e80 2023-10-06T11:09:16.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.175+0000 7fca0f6a0700 1 -- 172.21.15.146:0/3955755549 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca08154320 con 0x7fca08153e80 2023-10-06T11:09:16.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.176+0000 7fca0f6a0700 1 -- 172.21.15.146:0/3955755549 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca08154840 con 0x7fca08153e80 2023-10-06T11:09:16.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.177+0000 7fc9fd7fa700 1 -- 172.21.15.146:0/3955755549 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fca0001da60 con 0x7fca08153e80 2023-10-06T11:09:16.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.177+0000 7fc9fd7fa700 1 --2- 172.21.15.146:0/3955755549 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc9ec066f30 0x7fc9ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:16.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.177+0000 7fc9fd7fa700 1 -- 172.21.15.146:0/3955755549 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fca00085e70 con 0x7fca08153e80 2023-10-06T11:09:16.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.177+0000 7fca0d43c700 1 --2- 172.21.15.146:0/3955755549 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc9ec066f30 0x7fc9ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:16.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.178+0000 7fca0d43c700 1 --2- 172.21.15.146:0/3955755549 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc9ec066f30 0x7fc9ec0693e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fca0400ab30 tx=0x7fca04008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:16.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.182+0000 7fc9fd7fa700 1 -- 172.21.15.146:0/3955755549 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca08154840 con 0x7fca08153e80 2023-10-06T11:09:16.329 INFO:tasks.ceph.mon.a.smithi146.stderr:2023-10-06T11:09:16.328+0000 7f011e2a6700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-06T11:09:16.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.408+0000 7fca0f6a0700 1 -- 172.21.15.146:0/3955755549 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fca0815ac30 con 0x7fca08153e80 2023-10-06T11:09:16.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.409+0000 7fc9fd7fa700 1 -- 172.21.15.146:0/3955755549 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4610 (secure 0 0 0) 0x7fca0815ac30 con 0x7fca08153e80 2023-10-06T11:09:16.410 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:09:16.410 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":37,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5248,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3360977916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3360977916},{"type":"v1","addr":"172.21.15.151:6834","nonce":3360977916}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5251,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2265934004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":2265934004},{"type":"v1","addr":"172.21.15.151:6835","nonce":2265934004}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2387575667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2387575667},{"type":"v1","addr":"172.21.15.146:6836","nonce":2387575667}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:08:42.797557+0000","modified":"2023-10-06T11:09:16.328424+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5481":{"gid":5481,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":11,"addr":"172.21.15.146:6837/2252184844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2252184844},{"type":"v1","addr":"172.21.15.146:6837","nonce":2252184844}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T11:09:16.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.411+0000 7fca0f6a0700 1 -- 172.21.15.146:0/3955755549 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc9ec066f30 msgr2=0x7fc9ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:16.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.411+0000 7fca0f6a0700 1 --2- 172.21.15.146:0/3955755549 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc9ec066f30 0x7fc9ec0693e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fca0400ab30 tx=0x7fca04008040 comp rx=0 tx=0).stop 2023-10-06T11:09:16.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.411+0000 7fca0f6a0700 1 -- 172.21.15.146:0/3955755549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca08153e80 msgr2=0x7fca080cef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:16.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.411+0000 7fca0f6a0700 1 --2- 172.21.15.146:0/3955755549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca08153e80 0x7fca080cef50 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fca00003000 tx=0x7fca00017000 comp rx=0 tx=0).stop 2023-10-06T11:09:16.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.411+0000 7fca0f6a0700 1 -- 172.21.15.146:0/3955755549 shutdown_connections 2023-10-06T11:09:16.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.411+0000 7fca0f6a0700 1 --2- 172.21.15.146:0/3955755549 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc9ec066f30 0x7fc9ec0693e0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.411+0000 7fca0f6a0700 1 --2- 172.21.15.146:0/3955755549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca08153e80 0x7fca080cef50 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.411+0000 7fca0f6a0700 1 --2- 172.21.15.146:0/3955755549 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca08068ba0 0x7fca0814fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.411+0000 7fca0f6a0700 1 --2- 172.21.15.146:0/3955755549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca08153ab0 0x7fca080cea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.411+0000 7fca0f6a0700 1 -- 172.21.15.146:0/3955755549 >> 172.21.15.146:0/3955755549 conn(0x7fca0806eba0 msgr2=0x7fca0815c640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:16.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.411+0000 7fca0f6a0700 1 -- 172.21.15.146:0/3955755549 shutdown_connections 2023-10-06T11:09:16.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.411+0000 7fca0f6a0700 1 -- 172.21.15.146:0/3955755549 wait complete. 2023-10-06T11:09:16.414 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 37 2023-10-06T11:09:16.424 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok flush_path /scrub_test_path/i/dont/exist 2023-10-06T11:09:16.544 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:09:16.545 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": -2 2023-10-06T11:09:16.545 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:09:16.555 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/i/dont/exist' got response code '0' and stdout '{ "return_code": -2 } ' 2023-10-06T11:09:16.556 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/i/dont/exist' 2023-10-06T11:09:16.556 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/i/dont/exist 2023-10-06T11:09:16.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.673+0000 7fd8c4041700 1 Processor -- start 2023-10-06T11:09:16.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.673+0000 7fd8c4041700 1 -- start start 2023-10-06T11:09:16.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.674+0000 7fd8c4041700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8bc15a160 0x7fd8bc0c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:16.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.674+0000 7fd8c4041700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd8bc0cb950 0x7fd8bc0cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:16.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.674+0000 7fd8c4041700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8bc0ae2a0 con 0x7fd8bc0ae730 2023-10-06T11:09:16.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.674+0000 7fd8c4041700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8bc15a530 con 0x7fd8bc0cb950 2023-10-06T11:09:16.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.674+0000 7fd8c4041700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc0ad690 con 0x7fd8bc15a160 2023-10-06T11:09:16.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.674+0000 7fd8c25de700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd8bc0cb950 0x7fd8bc0cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:16.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.674+0000 7fd8c25de700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd8bc0cb950 0x7fd8bc0cbdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53640/0 (socket says 172.21.15.146:53640) 2023-10-06T11:09:16.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.674+0000 7fd8c15dc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd8bc0ae730 0x7fd8bc0aeb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50902/0 (socket says 172.21.15.146:50902) 2023-10-06T11:09:16.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.674+0000 7fd8c25de700 1 -- 172.21.15.146:0/3545582971 learned_addr learned my addr 172.21.15.146:0/3545582971 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:16.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.674+0000 7fd8c1ddd700 1 --2- 172.21.15.146:0/3545582971 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8bc15a160 0x7fd8bc0c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:16.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.674+0000 7fd8c25de700 1 -- 172.21.15.146:0/3545582971 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8bc15a160 msgr2=0x7fd8bc0c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:16.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.674+0000 7fd8c25de700 1 --2- 172.21.15.146:0/3545582971 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8bc15a160 0x7fd8bc0c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.674+0000 7fd8c25de700 1 -- 172.21.15.146:0/3545582971 >> v1:172.21.15.146:6789/0 conn(0x7fd8bc0ae730 legacy=0x7fd8bc0aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:16.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.674+0000 7fd8c0ddb700 1 -- 172.21.15.146:0/3545582971 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2183565891 0 0) 0x7fd8bc0ae2a0 con 0x7fd8bc0ae730 2023-10-06T11:09:16.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.674+0000 7fd8c25de700 1 -- 172.21.15.146:0/3545582971 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8bc0ad970 con 0x7fd8bc0cb950 2023-10-06T11:09:16.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.674+0000 7fd8c25de700 1 --2- 172.21.15.146:0/3545582971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8bc0cb950 0x7fd8bc0cbdb0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fd8b40099b0 tx=0x7fd8b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f713915e6f21a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:16.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.675+0000 7fd8c0ddb700 1 -- 172.21.15.146:0/3545582971 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b400b860 con 0x7fd8bc0cb950 2023-10-06T11:09:16.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.675+0000 7fd8c0ddb700 1 -- 172.21.15.146:0/3545582971 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b400b9c0 con 0x7fd8bc0cb950 2023-10-06T11:09:16.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.675+0000 7fd8c0ddb700 1 -- 172.21.15.146:0/3545582971 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b400bd60 con 0x7fd8bc0cb950 2023-10-06T11:09:16.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.675+0000 7fd8c4041700 1 -- 172.21.15.146:0/3545582971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8bc0cb950 msgr2=0x7fd8bc0cbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:16.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.675+0000 7fd8c4041700 1 --2- 172.21.15.146:0/3545582971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8bc0cb950 0x7fd8bc0cbdb0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fd8b40099b0 tx=0x7fd8b4009250 comp rx=0 tx=0).stop 2023-10-06T11:09:16.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.675+0000 7fd8c4041700 1 -- 172.21.15.146:0/3545582971 shutdown_connections 2023-10-06T11:09:16.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.675+0000 7fd8c4041700 1 --2- 172.21.15.146:0/3545582971 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8bc0cb950 0x7fd8bc0cbdb0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.675+0000 7fd8c4041700 1 --2- 172.21.15.146:0/3545582971 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8bc15a160 0x7fd8bc0c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.675+0000 7fd8c4041700 1 -- 172.21.15.146:0/3545582971 >> 172.21.15.146:0/3545582971 conn(0x7fd8bc06f380 msgr2=0x7fd8bc0d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:16.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.675+0000 7fd8c4041700 1 -- 172.21.15.146:0/3545582971 shutdown_connections 2023-10-06T11:09:16.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.675+0000 7fd8c4041700 1 -- 172.21.15.146:0/3545582971 wait complete. 2023-10-06T11:09:16.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.676+0000 7fd8c4041700 1 Processor -- start 2023-10-06T11:09:16.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.676+0000 7fd8c4041700 1 -- start start 2023-10-06T11:09:16.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.677+0000 7fd8c4041700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8bc0ae730 0x7fd8bc14b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:16.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.677+0000 7fd8c4041700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8bc0cb950 0x7fd8bc0cd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:16.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.677+0000 7fd8c4041700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8bc15a160 0x7fd8bc0b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:16.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.677+0000 7fd8c4041700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc0cc370 con 0x7fd8bc0cb950 2023-10-06T11:09:16.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.677+0000 7fd8c4041700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc0cc650 con 0x7fd8bc15a160 2023-10-06T11:09:16.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.677+0000 7fd8c4041700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8bc0cc930 con 0x7fd8bc0ae730 2023-10-06T11:09:16.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.677+0000 7fd8c15dc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8bc0cb950 0x7fd8bc0cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:16.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.677+0000 7fd8c15dc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8bc0cb950 0x7fd8bc0cd410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53646/0 (socket says 172.21.15.146:53646) 2023-10-06T11:09:16.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.677+0000 7fd8c15dc700 1 -- 172.21.15.146:0/1895027407 learned_addr learned my addr 172.21.15.146:0/1895027407 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:16.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.677+0000 7fd8c1ddd700 1 --2- 172.21.15.146:0/1895027407 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8bc0ae730 0x7fd8bc14b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:16.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.677+0000 7fd8c25de700 1 --2- 172.21.15.146:0/1895027407 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8bc15a160 0x7fd8bc0b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:16.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.677+0000 7fd8c15dc700 1 -- 172.21.15.146:0/1895027407 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8bc0ae730 msgr2=0x7fd8bc14b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:16.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.677+0000 7fd8c15dc700 1 --2- 172.21.15.146:0/1895027407 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8bc0ae730 0x7fd8bc14b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.677+0000 7fd8c15dc700 1 -- 172.21.15.146:0/1895027407 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8bc15a160 msgr2=0x7fd8bc0b1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:16.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.677+0000 7fd8c15dc700 1 --2- 172.21.15.146:0/1895027407 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8bc15a160 0x7fd8bc0b1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.677+0000 7fd8c15dc700 1 -- 172.21.15.146:0/1895027407 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b40094f0 con 0x7fd8bc0cb950 2023-10-06T11:09:16.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.677+0000 7fd8c1ddd700 1 --2- 172.21.15.146:0/1895027407 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8bc0ae730 0x7fd8bc14b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:16.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.678+0000 7fd8c15dc700 1 --2- 172.21.15.146:0/1895027407 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8bc0cb950 0x7fd8bc0cd410 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac00c5b0 tx=0x7fd8ac001040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:16.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.678+0000 7fd8b1ffb700 1 -- 172.21.15.146:0/1895027407 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac005a70 con 0x7fd8bc0cb950 2023-10-06T11:09:16.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.678+0000 7fd8b1ffb700 1 -- 172.21.15.146:0/1895027407 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ac005bd0 con 0x7fd8bc0cb950 2023-10-06T11:09:16.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.678+0000 7fd8c4041700 1 -- 172.21.15.146:0/1895027407 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8bc0ccc10 con 0x7fd8bc0cb950 2023-10-06T11:09:16.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.678+0000 7fd8b1ffb700 1 -- 172.21.15.146:0/1895027407 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac0070d0 con 0x7fd8bc0cb950 2023-10-06T11:09:16.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.678+0000 7fd8c4041700 1 -- 172.21.15.146:0/1895027407 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8bc157600 con 0x7fd8bc0cb950 2023-10-06T11:09:16.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.680+0000 7fd8b1ffb700 1 -- 172.21.15.146:0/1895027407 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd8ac007480 con 0x7fd8bc0cb950 2023-10-06T11:09:16.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.680+0000 7fd8b1ffb700 1 --2- 172.21.15.146:0/1895027407 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd8a0066f30 0x7fd8a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:16.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.680+0000 7fd8b1ffb700 1 -- 172.21.15.146:0/1895027407 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd8ac083b70 con 0x7fd8bc0cb950 2023-10-06T11:09:16.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.680+0000 7fd8c1ddd700 1 --2- 172.21.15.146:0/1895027407 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd8a0066f30 0x7fd8a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:16.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.680+0000 7fd8c1ddd700 1 --2- 172.21.15.146:0/1895027407 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd8a0066f30 0x7fd8a00693e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8007620 tx=0x7fd8b8009830 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:16.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.682+0000 7fd8cd339b80 1 Processor -- start 2023-10-06T11:09:16.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.682+0000 7fd8cd339b80 1 -- start start 2023-10-06T11:09:16.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.682+0000 7fd8cd339b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5642d15b0b50 0x5642d15b0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:16.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.682+0000 7fd8cd339b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642d156ca60 0x5642d1569640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:16.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.682+0000 7fd8cd339b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5642d156ac90 0x5642d1569b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:16.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.682+0000 7fd8cd339b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d14e9d40 con 0x5642d156ac90 2023-10-06T11:09:16.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.682+0000 7fd8cd339b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d14c0b30 con 0x5642d156ca60 2023-10-06T11:09:16.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.682+0000 7fd8cd339b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5642d14be330 con 0x5642d15b0b50 2023-10-06T11:09:16.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.683+0000 7fd8c25de700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5642d156ac90 0x5642d1569b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:16.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.683+0000 7fd8c25de700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5642d156ac90 0x5642d1569b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53660/0 (socket says 172.21.15.146:53660) 2023-10-06T11:09:16.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.683+0000 7fd8c25de700 1 -- 172.21.15.146:0/955314875 learned_addr learned my addr 172.21.15.146:0/955314875 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:16.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.683+0000 7fd8c1ddd700 1 --2- 172.21.15.146:0/955314875 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5642d15b0b50 0x5642d15b0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:16.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.683+0000 7fd8c15dc700 1 --2- 172.21.15.146:0/955314875 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642d156ca60 0x5642d1569640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:16.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.683+0000 7fd8c25de700 1 -- 172.21.15.146:0/955314875 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5642d15b0b50 msgr2=0x5642d15b0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:16.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.683+0000 7fd8c25de700 1 --2- 172.21.15.146:0/955314875 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5642d15b0b50 0x5642d15b0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.683+0000 7fd8c25de700 1 -- 172.21.15.146:0/955314875 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642d156ca60 msgr2=0x5642d1569640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:16.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.683+0000 7fd8c25de700 1 --2- 172.21.15.146:0/955314875 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642d156ca60 0x5642d1569640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.683+0000 7fd8c25de700 1 -- 172.21.15.146:0/955314875 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5642d1354330 con 0x5642d156ac90 2023-10-06T11:09:16.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.683+0000 7fd8c15dc700 1 --2- 172.21.15.146:0/955314875 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642d156ca60 0x5642d1569640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:16.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.683+0000 7fd8c25de700 1 --2- 172.21.15.146:0/955314875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5642d156ac90 0x5642d1569b80 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fd8b400b3c0 tx=0x7fd8b4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20bdc59d92fb5ce9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:16.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.683+0000 7fd8a6ffd700 1 -- 172.21.15.146:0/955314875 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4021070 con 0x5642d156ac90 2023-10-06T11:09:16.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.683+0000 7fd8a6ffd700 1 -- 172.21.15.146:0/955314875 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b400bb30 con 0x5642d156ac90 2023-10-06T11:09:16.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.683+0000 7fd8a6ffd700 1 -- 172.21.15.146:0/955314875 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4006d50 con 0x5642d156ac90 2023-10-06T11:09:16.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.684+0000 7fd8cd339b80 1 -- 172.21.15.146:0/955314875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5642d156ac90 msgr2=0x5642d1569b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:16.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.684+0000 7fd8cd339b80 1 --2- 172.21.15.146:0/955314875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5642d156ac90 0x5642d1569b80 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fd8b400b3c0 tx=0x7fd8b4017000 comp rx=0 tx=0).stop 2023-10-06T11:09:16.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.684+0000 7fd8cd339b80 1 -- 172.21.15.146:0/955314875 shutdown_connections 2023-10-06T11:09:16.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.684+0000 7fd8cd339b80 1 --2- 172.21.15.146:0/955314875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5642d156ac90 0x5642d1569b80 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.684+0000 7fd8cd339b80 1 --2- 172.21.15.146:0/955314875 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5642d15b0b50 0x5642d15b0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.684+0000 7fd8cd339b80 1 --2- 172.21.15.146:0/955314875 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642d156ca60 0x5642d1569640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.684+0000 7fd8cd339b80 1 -- 172.21.15.146:0/955314875 >> 172.21.15.146:0/955314875 conn(0x5642d156b130 msgr2=0x5642d156b500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:16.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.684+0000 7fd8cd339b80 1 -- 172.21.15.146:0/955314875 shutdown_connections 2023-10-06T11:09:16.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.684+0000 7fd8cd339b80 1 -- 172.21.15.146:0/955314875 wait complete. 2023-10-06T11:09:16.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.684+0000 7fd8cd339b80 1 -- start start 2023-10-06T11:09:16.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.684+0000 7fd8cd339b80 1 Processor -- start 2023-10-06T11:09:16.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.685+0000 7fd8cd339b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5642d156ac90 0x5642d158c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:16.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.685+0000 7fd8cd339b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5642d156ca60 0x5642d15ab000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:16.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.685+0000 7fd8cd339b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642d15b0b50 0x5642d15b3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:16.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.685+0000 7fd8cd339b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d14ba120 con 0x5642d156ca60 2023-10-06T11:09:16.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.685+0000 7fd8cd339b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d1465950 con 0x5642d15b0b50 2023-10-06T11:09:16.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.685+0000 7fd8cd339b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5642d1480f60 con 0x5642d156ac90 2023-10-06T11:09:16.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.685+0000 7fd8cd339b80 10 client.0 _ll_register_callbacks cb 0x5642d1356ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:09:16.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.685+0000 7fd8c15dc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5642d156ca60 0x5642d15ab000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:16.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.685+0000 7fd8c15dc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5642d156ca60 0x5642d15ab000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53670/0 (socket says 172.21.15.146:53670) 2023-10-06T11:09:16.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.685+0000 7fd8c15dc700 1 -- 172.21.15.146:0/2885377043 learned_addr learned my addr 172.21.15.146:0/2885377043 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:16.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.686+0000 7fd8c1ddd700 1 --2- 172.21.15.146:0/2885377043 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5642d156ac90 0x5642d158c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:16.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.686+0000 7fd8c25de700 1 --2- 172.21.15.146:0/2885377043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642d15b0b50 0x5642d15b3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:16.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.686+0000 7fd8c15dc700 1 -- 172.21.15.146:0/2885377043 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5642d156ac90 msgr2=0x5642d158c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:16.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.686+0000 7fd8c15dc700 1 --2- 172.21.15.146:0/2885377043 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5642d156ac90 0x5642d158c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.686+0000 7fd8c15dc700 1 -- 172.21.15.146:0/2885377043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642d15b0b50 msgr2=0x5642d15b3f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:16.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.686+0000 7fd8c15dc700 1 --2- 172.21.15.146:0/2885377043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642d15b0b50 0x5642d15b3f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.686+0000 7fd8c15dc700 1 -- 172.21.15.146:0/2885377043 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8bc0ad970 con 0x5642d156ca60 2023-10-06T11:09:16.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.686+0000 7fd8c25de700 1 --2- 172.21.15.146:0/2885377043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642d15b0b50 0x5642d15b3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:16.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.686+0000 7fd8c15dc700 1 --2- 172.21.15.146:0/2885377043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5642d156ca60 0x5642d15ab000 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac081fe0 tx=0x7fd8ac00f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1e709f146e7ac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:16.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.686+0000 7fd89bfff700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:09:16.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.686+0000 7fd89bfff700 1 -- 172.21.15.146:0/2885377043 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac057b90 con 0x5642d156ca60 2023-10-06T11:09:16.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.686+0000 7fd89bfff700 1 -- 172.21.15.146:0/2885377043 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd8ac068070 con 0x5642d156ca60 2023-10-06T11:09:16.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.686+0000 7fd8cd339b80 1 -- 172.21.15.146:0/2885377043 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5642d155e750 con 0x5642d156ca60 2023-10-06T11:09:16.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.686+0000 7fd89bfff700 1 -- 172.21.15.146:0/2885377043 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd8ac050c80 con 0x5642d156ca60 2023-10-06T11:09:16.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.686+0000 7fd8cd339b80 10 client.5934 fetch_fsmap learned FSMap version 37 2023-10-06T11:09:16.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.686+0000 7fd8cd339b80 1 -- 172.21.15.146:0/2885377043 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x5642d12f70a0 con 0x5642d156ca60 2023-10-06T11:09:16.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.686+0000 7fd89bfff700 1 -- 172.21.15.146:0/2885377043 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ac05f020 con 0x5642d156ca60 2023-10-06T11:09:16.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.686+0000 7fd89bfff700 1 -- 172.21.15.146:0/2885377043 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 37) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd8ac05bb30 con 0x5642d156ca60 2023-10-06T11:09:16.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.686+0000 7fd8cd339b80 10 client.5934 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T11:09:16.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.686+0000 7fd8cd339b80 10 client.5934 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-10-06T11:09:16.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.686+0000 7fd8cd339b80 20 client.5934 populate_metadata read hostname 'smithi146' 2023-10-06T11:09:16.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.686+0000 7fd8cd339b80 1 --2- 172.21.15.146:0/2885377043 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x5642d15b4450 0x5642d158f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:16.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.686+0000 7fd8cd339b80 4 client.5934 mds_command: new command op to 5481 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:09:16.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.686+0000 7fd8cd339b80 1 -- 172.21.15.146:0/2885377043 --> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5642d153b680 con 0x5642d15b4450 2023-10-06T11:09:16.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.686+0000 7fd8c1ddd700 1 --2- 172.21.15.146:0/2885377043 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x5642d15b4450 0x5642d158f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:16.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.687+0000 7fd89bfff700 10 client.5934 ms_handle_connect on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:16.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.687+0000 7fd8c1ddd700 1 --2- 172.21.15.146:0/2885377043 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x5642d15b4450 0x5642d158f8e0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee0ed6ad68289cfa server_cookie=81494de4e20ec1b5 in_seq=0 out_seq=0 2023-10-06T11:09:16.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.687+0000 7fd89bfff700 1 -- 172.21.15.146:0/2885377043 <== mds.0 v2:172.21.15.146:6835/2252184844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5642d153b680 con 0x5642d15b4450 2023-10-06T11:09:16.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.687+0000 7fd89bfff700 10 client.5934 handle_command_reply: tid=0 2023-10-06T11:09:16.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.687+0000 7fd8cd339b80 1 client.5934 shutdown 2023-10-06T11:09:16.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.687+0000 7fd8cd339b80 1 -- 172.21.15.146:0/2885377043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5642d156ca60 msgr2=0x5642d15ab000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:16.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.687+0000 7fd8cd339b80 1 --2- 172.21.15.146:0/2885377043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5642d156ca60 0x5642d15ab000 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac081fe0 tx=0x7fd8ac00f000 comp rx=0 tx=0).stop 2023-10-06T11:09:16.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.687+0000 7fd8cd339b80 1 -- 172.21.15.146:0/2885377043 shutdown_connections 2023-10-06T11:09:16.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.687+0000 7fd8cd339b80 1 --2- 172.21.15.146:0/2885377043 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x5642d15b4450 0x5642d158f8e0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.687+0000 7fd8cd339b80 1 --2- 172.21.15.146:0/2885377043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642d15b0b50 0x5642d15b3f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.688+0000 7fd8cd339b80 1 --2- 172.21.15.146:0/2885377043 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5642d156ac90 0x5642d158c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.687+0000 7fd89bfff700 0 client.5934 ms_handle_reset on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:16.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.688+0000 7fd8cd339b80 1 --2- 172.21.15.146:0/2885377043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5642d156ca60 0x5642d15ab000 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.688+0000 7fd8cd339b80 1 -- 172.21.15.146:0/2885377043 >> 172.21.15.146:0/2885377043 conn(0x5642d156b130 msgr2=0x5642d15afef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:16.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.688+0000 7fd8cd339b80 1 -- 172.21.15.146:0/2885377043 shutdown_connections 2023-10-06T11:09:16.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.688+0000 7fd8cd339b80 1 -- 172.21.15.146:0/2885377043 wait complete. 2023-10-06T11:09:16.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.688+0000 7fd8cd339b80 20 client.5934 trim_cache size 0 max 16384 2023-10-06T11:09:16.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.704+0000 7fd8cd339b80 1 Processor -- start 2023-10-06T11:09:16.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.704+0000 7fd8cd339b80 1 -- start start 2023-10-06T11:09:16.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.705+0000 7fd8cd339b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5642d156ac90 0x5642d15aaf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:16.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.705+0000 7fd8cd339b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642d156ca60 0x5642d1565810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:16.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.705+0000 7fd8cd339b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5642d15b0b50 0x5642d1565d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:16.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.705+0000 7fd8cd339b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d133cef0 con 0x5642d156ac90 2023-10-06T11:09:16.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.705+0000 7fd8cd339b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d15af340 con 0x5642d156ca60 2023-10-06T11:09:16.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.705+0000 7fd8cd339b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5642d15abdd0 con 0x5642d15b0b50 2023-10-06T11:09:16.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.705+0000 7fd8c1ddd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5642d156ac90 0x5642d15aaf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:16.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.705+0000 7fd8c1ddd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5642d156ac90 0x5642d15aaf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53678/0 (socket says 172.21.15.146:53678) 2023-10-06T11:09:16.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.705+0000 7fd8c1ddd700 1 -- 172.21.15.146:0/3546983147 learned_addr learned my addr 172.21.15.146:0/3546983147 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:16.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.705+0000 7fd8c1ddd700 1 -- 172.21.15.146:0/3546983147 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5642d15b0b50 msgr2=0x5642d1565d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:16.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.705+0000 7fd8c25de700 1 --2- 172.21.15.146:0/3546983147 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5642d15b0b50 0x5642d1565d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:16.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.705+0000 7fd8c15dc700 1 --2- 172.21.15.146:0/3546983147 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642d156ca60 0x5642d1565810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:16.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.705+0000 7fd8c1ddd700 1 --2- 172.21.15.146:0/3546983147 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5642d15b0b50 0x5642d1565d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.705+0000 7fd8c1ddd700 1 -- 172.21.15.146:0/3546983147 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642d156ca60 msgr2=0x5642d1565810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:16.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.705+0000 7fd8c1ddd700 1 --2- 172.21.15.146:0/3546983147 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642d156ca60 0x5642d1565810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.705+0000 7fd8c1ddd700 1 -- 172.21.15.146:0/3546983147 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5642d1488840 con 0x5642d156ac90 2023-10-06T11:09:16.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.705+0000 7fd8c15dc700 1 --2- 172.21.15.146:0/3546983147 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642d156ca60 0x5642d1565810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:09:16.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.705+0000 7fd8c1ddd700 1 --2- 172.21.15.146:0/3546983147 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5642d156ac90 0x5642d15aaf50 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8007d70 tx=0x7fd8b8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aebe286151a4511e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:16.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.705+0000 7fd8a77fe700 1 -- 172.21.15.146:0/3546983147 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b8025550 con 0x5642d156ac90 2023-10-06T11:09:16.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.705+0000 7fd8a77fe700 1 -- 172.21.15.146:0/3546983147 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b80256b0 con 0x5642d156ac90 2023-10-06T11:09:16.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.705+0000 7fd8a77fe700 1 -- 172.21.15.146:0/3546983147 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b8025a30 con 0x5642d156ac90 2023-10-06T11:09:16.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.706+0000 7fd8cd339b80 1 -- 172.21.15.146:0/3546983147 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5642d156ac90 msgr2=0x5642d15aaf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:16.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.706+0000 7fd8cd339b80 1 --2- 172.21.15.146:0/3546983147 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5642d156ac90 0x5642d15aaf50 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8007d70 tx=0x7fd8b8014000 comp rx=0 tx=0).stop 2023-10-06T11:09:16.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.706+0000 7fd8cd339b80 1 -- 172.21.15.146:0/3546983147 shutdown_connections 2023-10-06T11:09:16.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.706+0000 7fd8cd339b80 1 --2- 172.21.15.146:0/3546983147 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5642d15b0b50 0x5642d1565d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.706+0000 7fd8cd339b80 1 --2- 172.21.15.146:0/3546983147 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5642d156ac90 0x5642d15aaf50 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.706+0000 7fd8cd339b80 1 --2- 172.21.15.146:0/3546983147 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642d156ca60 0x5642d1565810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.706+0000 7fd8cd339b80 1 -- 172.21.15.146:0/3546983147 >> 172.21.15.146:0/3546983147 conn(0x5642d156b130 msgr2=0x5642d1590950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:16.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.706+0000 7fd8cd339b80 1 -- 172.21.15.146:0/3546983147 shutdown_connections 2023-10-06T11:09:16.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.706+0000 7fd8cd339b80 1 -- 172.21.15.146:0/3546983147 wait complete. 2023-10-06T11:09:16.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.706+0000 7fd8cd339b80 1 -- start start 2023-10-06T11:09:16.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.706+0000 7fd8cd339b80 1 Processor -- start 2023-10-06T11:09:16.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.707+0000 7fd8cd339b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5642d156ac90 0x5642d1615f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:16.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.707+0000 7fd8cd339b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5642d156ca60 0x5642d158fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:16.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.707+0000 7fd8cd339b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642d15b0b50 0x5642d15ae390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:16.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.707+0000 7fd8cd339b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d16164c0 con 0x5642d156ac90 2023-10-06T11:09:16.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.707+0000 7fd8cd339b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642d16168f0 con 0x5642d15b0b50 2023-10-06T11:09:16.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.707+0000 7fd8cd339b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5642d15a6970 con 0x5642d156ca60 2023-10-06T11:09:16.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.707+0000 7fd8cd339b80 10 client.0 _ll_register_callbacks cb 0x5642d1356ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:09:16.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.707+0000 7fd8c1ddd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5642d156ac90 0x5642d1615f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:16.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.707+0000 7fd8c1ddd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5642d156ac90 0x5642d1615f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53690/0 (socket says 172.21.15.146:53690) 2023-10-06T11:09:16.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.707+0000 7fd8c1ddd700 1 -- 172.21.15.146:0/1826298090 learned_addr learned my addr 172.21.15.146:0/1826298090 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:16.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.708+0000 7fd8c1ddd700 1 -- 172.21.15.146:0/1826298090 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5642d156ca60 msgr2=0x5642d158fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:16.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.708+0000 7fd8c1ddd700 1 --2- 172.21.15.146:0/1826298090 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5642d156ca60 0x5642d158fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.708+0000 7fd8c1ddd700 1 -- 172.21.15.146:0/1826298090 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642d15b0b50 msgr2=0x5642d15ae390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:16.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.708+0000 7fd8c1ddd700 1 --2- 172.21.15.146:0/1826298090 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642d15b0b50 0x5642d15ae390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.708+0000 7fd8c1ddd700 1 -- 172.21.15.146:0/1826298090 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8b8016940 con 0x5642d156ac90 2023-10-06T11:09:16.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.708+0000 7fd8c1ddd700 1 --2- 172.21.15.146:0/1826298090 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5642d156ac90 0x5642d1615f80 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8016fd0 tx=0x7fd8b8027000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8283972e10688eb7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:16.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.708+0000 7fd89bfff700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:09:16.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.708+0000 7fd89bfff700 1 -- 172.21.15.146:0/1826298090 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b802c860 con 0x5642d156ac90 2023-10-06T11:09:16.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.708+0000 7fd8cd339b80 1 -- 172.21.15.146:0/1826298090 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd8b400bb30 con 0x5642d156ac90 2023-10-06T11:09:16.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.708+0000 7fd89bfff700 1 -- 172.21.15.146:0/1826298090 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd8b802c9c0 con 0x5642d156ac90 2023-10-06T11:09:16.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.708+0000 7fd89bfff700 1 -- 172.21.15.146:0/1826298090 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd8b802cd90 con 0x5642d156ac90 2023-10-06T11:09:16.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.708+0000 7fd8cd339b80 10 client.5940 fetch_fsmap learned FSMap version 37 2023-10-06T11:09:16.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.708+0000 7fd8cd339b80 1 -- 172.21.15.146:0/1826298090 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x5642d146f530 con 0x5642d156ac90 2023-10-06T11:09:16.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.708+0000 7fd89bfff700 1 -- 172.21.15.146:0/1826298090 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b400bb30 con 0x5642d156ac90 2023-10-06T11:09:16.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.708+0000 7fd89bfff700 1 -- 172.21.15.146:0/1826298090 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 37) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd8b8040410 con 0x5642d156ac90 2023-10-06T11:09:16.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.708+0000 7fd8cd339b80 10 client.5940 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T11:09:16.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.708+0000 7fd8cd339b80 10 client.5940 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-10-06T11:09:16.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.708+0000 7fd8cd339b80 20 client.5940 populate_metadata read hostname 'smithi146' 2023-10-06T11:09:16.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.708+0000 7fd8cd339b80 1 --2- 172.21.15.146:0/1826298090 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x5642d15ab060 0x5642d15ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:16.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.708+0000 7fd8cd339b80 4 client.5940 mds_command: new command op to 5481 tid=0[{"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}] 2023-10-06T11:09:16.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.708+0000 7fd8cd339b80 1 -- 172.21.15.146:0/1826298090 --> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/i/dont/exist"}) v1 -- 0x5642d145cec0 con 0x5642d15ab060 2023-10-06T11:09:16.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.708+0000 7fd8c15dc700 1 --2- 172.21.15.146:0/1826298090 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x5642d15ab060 0x5642d15ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:16.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.709+0000 7fd89bfff700 10 client.5940 ms_handle_connect on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:16.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.709+0000 7fd8c15dc700 1 --2- 172.21.15.146:0/1826298090 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x5642d15ab060 0x5642d15ae8d0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d45012f8d8de513f server_cookie=2a03697863f5d4ba in_seq=0 out_seq=0 2023-10-06T11:09:16.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.709+0000 7fd89bfff700 1 -- 172.21.15.146:0/1826298090 <== mds.0 v2:172.21.15.146:6835/2252184844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+26 (crc 0 0 0) 0x5642d145cec0 con 0x5642d15ab060 2023-10-06T11:09:16.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.709+0000 7fd89bfff700 10 client.5940 handle_command_reply: tid=0 2023-10-06T11:09:16.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.709+0000 7fd8cd339b80 1 client.5940 shutdown 2023-10-06T11:09:16.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.709+0000 7fd8cd339b80 1 -- 172.21.15.146:0/1826298090 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5642d156ac90 msgr2=0x5642d1615f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:16.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.709+0000 7fd8cd339b80 1 --2- 172.21.15.146:0/1826298090 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5642d156ac90 0x5642d1615f80 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8016fd0 tx=0x7fd8b8027000 comp rx=0 tx=0).stop 2023-10-06T11:09:16.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.709+0000 7fd8cd339b80 1 -- 172.21.15.146:0/1826298090 shutdown_connections 2023-10-06T11:09:16.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.709+0000 7fd8cd339b80 1 --2- 172.21.15.146:0/1826298090 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x5642d15ab060 0x5642d15ae8d0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.709+0000 7fd8cd339b80 1 --2- 172.21.15.146:0/1826298090 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642d15b0b50 0x5642d15ae390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.709+0000 7fd8cd339b80 1 --2- 172.21.15.146:0/1826298090 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5642d156ac90 0x5642d1615f80 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.709+0000 7fd8cd339b80 1 --2- 172.21.15.146:0/1826298090 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5642d156ca60 0x5642d158fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.709+0000 7fd89bfff700 0 client.5940 ms_handle_reset on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:16.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.709+0000 7fd8cd339b80 1 -- 172.21.15.146:0/1826298090 >> 172.21.15.146:0/1826298090 conn(0x5642d156b130 msgr2=0x5642d1599720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:16.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.709+0000 7fd8cd339b80 1 -- 172.21.15.146:0/1826298090 shutdown_connections 2023-10-06T11:09:16.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.709+0000 7fd8cd339b80 1 -- 172.21.15.146:0/1826298090 wait complete. 2023-10-06T11:09:16.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.709+0000 7fd8cd339b80 20 client.5940 trim_cache size 0 max 16384 2023-10-06T11:09:16.718 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:09:16.718 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": -2 2023-10-06T11:09:16.718 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:09:16.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.710+0000 7fd8c4041700 1 -- 172.21.15.146:0/1895027407 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd8a0066f30 msgr2=0x7fd8a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:16.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.710+0000 7fd8c4041700 1 --2- 172.21.15.146:0/1895027407 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd8a0066f30 0x7fd8a00693e0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8007620 tx=0x7fd8b8009830 comp rx=0 tx=0).stop 2023-10-06T11:09:16.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.710+0000 7fd8c4041700 1 -- 172.21.15.146:0/1895027407 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8bc0cb950 msgr2=0x7fd8bc0cd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:16.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.710+0000 7fd8c4041700 1 --2- 172.21.15.146:0/1895027407 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8bc0cb950 0x7fd8bc0cd410 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac00c5b0 tx=0x7fd8ac001040 comp rx=0 tx=0).stop 2023-10-06T11:09:16.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.710+0000 7fd8c4041700 1 -- 172.21.15.146:0/1895027407 shutdown_connections 2023-10-06T11:09:16.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.710+0000 7fd8c4041700 1 --2- 172.21.15.146:0/1895027407 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd8a0066f30 0x7fd8a00693e0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.710+0000 7fd8c4041700 1 --2- 172.21.15.146:0/1895027407 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8bc15a160 0x7fd8bc0b1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.710+0000 7fd8c4041700 1 --2- 172.21.15.146:0/1895027407 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd8bc0ae730 0x7fd8bc14b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.710+0000 7fd8c4041700 1 --2- 172.21.15.146:0/1895027407 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8bc0cb950 0x7fd8bc0cd410 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.710+0000 7fd8c4041700 1 -- 172.21.15.146:0/1895027407 >> 172.21.15.146:0/1895027407 conn(0x7fd8bc06f380 msgr2=0x7fd8bc1593e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:16.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.710+0000 7fd8c4041700 1 -- 172.21.15.146:0/1895027407 shutdown_connections 2023-10-06T11:09:16.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.710+0000 7fd8c4041700 1 -- 172.21.15.146:0/1895027407 wait complete. 2023-10-06T11:09:16.722 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/i/dont/exist' returned '{'return_code': -2}' 2023-10-06T11:09:16.722 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites' 2023-10-06T11:09:16.722 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites 2023-10-06T11:09:16.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.839+0000 7f9c02fa2700 1 Processor -- start 2023-10-06T11:09:16.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.840+0000 7f9c02fa2700 1 -- start start 2023-10-06T11:09:16.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.840+0000 7f9c02fa2700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9bfc140f10 0x7f9bfc0b0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:16.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.840+0000 7f9c02fa2700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bfc0c90f0 con 0x7f9bfc06bc70 2023-10-06T11:09:16.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.840+0000 7f9c02fa2700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bfc0cc350 con 0x7f9bfc06b8a0 2023-10-06T11:09:16.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.840+0000 7f9c02fa2700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bfc0c9d40 con 0x7f9bfc140f10 2023-10-06T11:09:16.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.840+0000 7f9c0179f700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f9bfc06bc70 0x7f9bfc140800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50912/0 (socket says 172.21.15.146:50912) 2023-10-06T11:09:16.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.840+0000 7f9c0179f700 1 -- 172.21.15.146:0/3856548221 learned_addr learned my addr 172.21.15.146:0/3856548221 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:16.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.841+0000 7f9c027a1700 1 --2- 172.21.15.146:0/3856548221 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9bfc140f10 0x7f9bfc0b0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:16.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.841+0000 7f9c00f9e700 1 -- 172.21.15.146:0/3856548221 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3698727333 0 0) 0x7f9bec001110 con 0x7f9bfc06bc70 2023-10-06T11:09:16.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.841+0000 7f9c00f9e700 1 -- 172.21.15.146:0/3856548221 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9be8003570 con 0x7f9bfc06bc70 2023-10-06T11:09:16.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.841+0000 7f9c00f9e700 1 -- 172.21.15.146:0/3856548221 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1212669893 0 0) 0x7f9bfc0cc350 con 0x7f9bfc06b8a0 2023-10-06T11:09:16.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.841+0000 7f9c00f9e700 1 -- 172.21.15.146:0/3856548221 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bec001110 con 0x7f9bfc06b8a0 2023-10-06T11:09:16.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.841+0000 7f9c027a1700 1 -- 172.21.15.146:0/3856548221 >> v1:172.21.15.151:6789/0 conn(0x7f9bfc06b8a0 legacy=0x7f9bfc15b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:16.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.841+0000 7f9c027a1700 1 -- 172.21.15.146:0/3856548221 >> v1:172.21.15.146:6789/0 conn(0x7f9bfc06bc70 legacy=0x7f9bfc140800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:16.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.841+0000 7f9c027a1700 1 -- 172.21.15.146:0/3856548221 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bfc0c8870 con 0x7f9bfc140f10 2023-10-06T11:09:16.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.841+0000 7f9c027a1700 1 --2- 172.21.15.146:0/3856548221 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9bfc140f10 0x7f9bfc0b0ff0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4009e90 tx=0x7f9bf4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2ffe1cd2e86f7a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:16.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.841+0000 7f9c00f9e700 1 -- 172.21.15.146:0/3856548221 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf400e070 con 0x7f9bfc140f10 2023-10-06T11:09:16.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.841+0000 7f9c00f9e700 1 -- 172.21.15.146:0/3856548221 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf400bb80 con 0x7f9bfc140f10 2023-10-06T11:09:16.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.841+0000 7f9c00f9e700 1 -- 172.21.15.146:0/3856548221 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf4012430 con 0x7f9bfc140f10 2023-10-06T11:09:16.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.842+0000 7f9c02fa2700 1 -- 172.21.15.146:0/3856548221 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9bfc140f10 msgr2=0x7f9bfc0b0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:16.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.842+0000 7f9c02fa2700 1 --2- 172.21.15.146:0/3856548221 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9bfc140f10 0x7f9bfc0b0ff0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4009e90 tx=0x7f9bf4009780 comp rx=0 tx=0).stop 2023-10-06T11:09:16.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.842+0000 7f9c02fa2700 1 -- 172.21.15.146:0/3856548221 shutdown_connections 2023-10-06T11:09:16.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.842+0000 7f9c02fa2700 1 --2- 172.21.15.146:0/3856548221 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9bfc140f10 0x7f9bfc0b0ff0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.842+0000 7f9c02fa2700 1 -- 172.21.15.146:0/3856548221 >> 172.21.15.146:0/3856548221 conn(0x7f9bfc0ce230 msgr2=0x7f9bfc0ce630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:16.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.842+0000 7f9c02fa2700 1 -- 172.21.15.146:0/3856548221 shutdown_connections 2023-10-06T11:09:16.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.842+0000 7f9c02fa2700 1 -- 172.21.15.146:0/3856548221 wait complete. 2023-10-06T11:09:16.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.843+0000 7f9c02fa2700 1 Processor -- start 2023-10-06T11:09:16.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.843+0000 7f9c02fa2700 1 -- start start 2023-10-06T11:09:16.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.844+0000 7f9c02fa2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9bfc06b8a0 0x7f9bfc0c56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:16.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.844+0000 7f9c02fa2700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9bfc06bc70 0x7f9bfc0c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:16.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.844+0000 7f9c02fa2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bfc140f10 0x7f9bfc0c6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:16.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.844+0000 7f9c02fa2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bfc0cbe00 con 0x7f9bfc140f10 2023-10-06T11:09:16.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.844+0000 7f9c02fa2700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bfc069420 con 0x7f9bfc06b8a0 2023-10-06T11:09:16.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.844+0000 7f9c02fa2700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bfc069700 con 0x7f9bfc06bc70 2023-10-06T11:09:16.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.844+0000 7f9c027a1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bfc140f10 0x7f9bfc0c6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:16.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.844+0000 7f9c027a1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bfc140f10 0x7f9bfc0c6140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53692/0 (socket says 172.21.15.146:53692) 2023-10-06T11:09:16.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.844+0000 7f9c027a1700 1 -- 172.21.15.146:0/3817643239 learned_addr learned my addr 172.21.15.146:0/3817643239 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:16.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.844+0000 7f9c01fa0700 1 --2- 172.21.15.146:0/3817643239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9bfc06b8a0 0x7f9bfc0c56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:16.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.844+0000 7f9c0179f700 1 --2- 172.21.15.146:0/3817643239 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9bfc06bc70 0x7f9bfc0c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:16.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.844+0000 7f9c027a1700 1 -- 172.21.15.146:0/3817643239 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9bfc06bc70 msgr2=0x7f9bfc0c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:16.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.844+0000 7f9c027a1700 1 --2- 172.21.15.146:0/3817643239 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9bfc06bc70 0x7f9bfc0c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.844+0000 7f9c027a1700 1 -- 172.21.15.146:0/3817643239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9bfc06b8a0 msgr2=0x7f9bfc0c56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:16.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.844+0000 7f9c027a1700 1 --2- 172.21.15.146:0/3817643239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9bfc06b8a0 0x7f9bfc0c56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.844+0000 7f9c027a1700 1 -- 172.21.15.146:0/3817643239 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf4009a20 con 0x7f9bfc140f10 2023-10-06T11:09:16.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.844+0000 7f9c01fa0700 1 --2- 172.21.15.146:0/3817643239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9bfc06b8a0 0x7f9bfc0c56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:09:16.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.844+0000 7f9c027a1700 1 --2- 172.21.15.146:0/3817643239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bfc140f10 0x7f9bfc0c6140 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc06fdd0 tx=0x7f9bf4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:16.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.844+0000 7f9bf1ffb700 1 -- 172.21.15.146:0/3817643239 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf4012e30 con 0x7f9bfc140f10 2023-10-06T11:09:16.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.844+0000 7f9bf1ffb700 1 -- 172.21.15.146:0/3817643239 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf401b420 con 0x7f9bfc140f10 2023-10-06T11:09:16.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.844+0000 7f9c02fa2700 1 -- 172.21.15.146:0/3817643239 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bfc0699e0 con 0x7f9bfc140f10 2023-10-06T11:09:16.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.845+0000 7f9bf1ffb700 1 -- 172.21.15.146:0/3817643239 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf401b7e0 con 0x7f9bfc140f10 2023-10-06T11:09:16.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.845+0000 7f9c02fa2700 1 -- 172.21.15.146:0/3817643239 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bfc0aff20 con 0x7f9bfc140f10 2023-10-06T11:09:16.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.846+0000 7f9bf1ffb700 1 -- 172.21.15.146:0/3817643239 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9bf401bb50 con 0x7f9bfc140f10 2023-10-06T11:09:16.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.846+0000 7f9bf1ffb700 1 --2- 172.21.15.146:0/3817643239 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9be0066f30 0x7f9be00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:16.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.847+0000 7f9bf1ffb700 1 -- 172.21.15.146:0/3817643239 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9bf4086410 con 0x7f9bfc140f10 2023-10-06T11:09:16.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.847+0000 7f9c01fa0700 1 --2- 172.21.15.146:0/3817643239 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9be0066f30 0x7f9be00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:16.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.847+0000 7f9c01fa0700 1 --2- 172.21.15.146:0/3817643239 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9be0066f30 0x7f9be00693e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8007fd0 tx=0x7f9bf8007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:16.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.848+0000 7f9c0d4fcb80 1 Processor -- start 2023-10-06T11:09:16.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.848+0000 7f9c0d4fcb80 1 -- start start 2023-10-06T11:09:16.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.849+0000 7f9c0d4fcb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581009e1a30 0x5581009e1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:16.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.849+0000 7f9c0d4fcb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558100a2bca0 0x558100a0aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:16.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.849+0000 7f9c0d4fcb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558100a0af40 0x5581009dda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:16.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.849+0000 7f9c0d4fcb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x558100961d60 con 0x5581009e1a30 2023-10-06T11:09:16.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.849+0000 7f9c0d4fcb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x558100938b50 con 0x558100a0af40 2023-10-06T11:09:16.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.849+0000 7f9c0d4fcb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x558100936350 con 0x558100a2bca0 2023-10-06T11:09:16.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.849+0000 7f9c01fa0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581009e1a30 0x5581009e1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:16.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.849+0000 7f9c01fa0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581009e1a30 0x5581009e1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53706/0 (socket says 172.21.15.146:53706) 2023-10-06T11:09:16.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.849+0000 7f9c01fa0700 1 -- 172.21.15.146:0/2251820667 learned_addr learned my addr 172.21.15.146:0/2251820667 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:16.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.849+0000 7f9c0179f700 1 --2- 172.21.15.146:0/2251820667 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558100a2bca0 0x558100a0aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:16.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.849+0000 7f9c027a1700 1 --2- 172.21.15.146:0/2251820667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558100a0af40 0x5581009dda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:16.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.850+0000 7f9c01fa0700 1 -- 172.21.15.146:0/2251820667 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558100a2bca0 msgr2=0x558100a0aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:16.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.850+0000 7f9c01fa0700 1 --2- 172.21.15.146:0/2251820667 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558100a2bca0 0x558100a0aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.850+0000 7f9c01fa0700 1 -- 172.21.15.146:0/2251820667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558100a0af40 msgr2=0x5581009dda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:16.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.850+0000 7f9c01fa0700 1 --2- 172.21.15.146:0/2251820667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558100a0af40 0x5581009dda70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.850+0000 7f9c01fa0700 1 -- 172.21.15.146:0/2251820667 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5581007cc350 con 0x5581009e1a30 2023-10-06T11:09:16.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.850+0000 7f9c01fa0700 1 --2- 172.21.15.146:0/2251820667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581009e1a30 0x5581009e1e00 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f9bf800fc70 tx=0x7f9bf8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc7174cf47956517 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:16.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.850+0000 7f9be6ffd700 1 -- 172.21.15.146:0/2251820667 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf8014760 con 0x5581009e1a30 2023-10-06T11:09:16.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.850+0000 7f9be6ffd700 1 -- 172.21.15.146:0/2251820667 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf8019070 con 0x5581009e1a30 2023-10-06T11:09:16.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.850+0000 7f9be6ffd700 1 -- 172.21.15.146:0/2251820667 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf8014b10 con 0x5581009e1a30 2023-10-06T11:09:16.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.850+0000 7f9c0d4fcb80 1 -- 172.21.15.146:0/2251820667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581009e1a30 msgr2=0x5581009e1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:16.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.850+0000 7f9c0d4fcb80 1 --2- 172.21.15.146:0/2251820667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581009e1a30 0x5581009e1e00 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f9bf800fc70 tx=0x7f9bf8016000 comp rx=0 tx=0).stop 2023-10-06T11:09:16.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.851+0000 7f9c0d4fcb80 1 -- 172.21.15.146:0/2251820667 shutdown_connections 2023-10-06T11:09:16.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.851+0000 7f9c0d4fcb80 1 --2- 172.21.15.146:0/2251820667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558100a0af40 0x5581009dda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.851+0000 7f9c0d4fcb80 1 --2- 172.21.15.146:0/2251820667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581009e1a30 0x5581009e1e00 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.851+0000 7f9c0d4fcb80 1 --2- 172.21.15.146:0/2251820667 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558100a2bca0 0x558100a0aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.851+0000 7f9c0d4fcb80 1 -- 172.21.15.146:0/2251820667 >> 172.21.15.146:0/2251820667 conn(0x5581009e3350 msgr2=0x5581009e3720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:16.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.851+0000 7f9c0d4fcb80 1 -- 172.21.15.146:0/2251820667 shutdown_connections 2023-10-06T11:09:16.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.851+0000 7f9c0d4fcb80 1 -- 172.21.15.146:0/2251820667 wait complete. 2023-10-06T11:09:16.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.851+0000 7f9c0d4fcb80 1 -- start start 2023-10-06T11:09:16.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.851+0000 7f9c0d4fcb80 1 Processor -- start 2023-10-06T11:09:16.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.852+0000 7f9c0d4fcb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581009e1a30 0x558100a21cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:16.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.852+0000 7f9c0d4fcb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558100a0af40 0x558100a09b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:16.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.852+0000 7f9c0d4fcb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558100a2bca0 0x558100a37e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:16.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.852+0000 7f9c0d4fcb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x558100932140 con 0x558100a0af40 2023-10-06T11:09:16.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.852+0000 7f9c0d4fcb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581008dd970 con 0x5581009e1a30 2023-10-06T11:09:16.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.852+0000 7f9c0d4fcb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5581008f8f80 con 0x558100a2bca0 2023-10-06T11:09:16.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.852+0000 7f9c0d4fcb80 10 client.0 _ll_register_callbacks cb 0x5581007cf010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:09:16.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.852+0000 7f9c0179f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558100a0af40 0x558100a09b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:16.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.852+0000 7f9c0179f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558100a0af40 0x558100a09b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53722/0 (socket says 172.21.15.146:53722) 2023-10-06T11:09:16.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.852+0000 7f9c0179f700 1 -- 172.21.15.146:0/76225180 learned_addr learned my addr 172.21.15.146:0/76225180 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:16.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.852+0000 7f9c01fa0700 1 --2- 172.21.15.146:0/76225180 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581009e1a30 0x558100a21cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:16.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.852+0000 7f9c027a1700 1 --2- 172.21.15.146:0/76225180 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558100a2bca0 0x558100a37e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:16.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.853+0000 7f9c0179f700 1 -- 172.21.15.146:0/76225180 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558100a2bca0 msgr2=0x558100a37e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:16.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.853+0000 7f9c0179f700 1 --2- 172.21.15.146:0/76225180 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558100a2bca0 0x558100a37e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.853+0000 7f9c0179f700 1 -- 172.21.15.146:0/76225180 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581009e1a30 msgr2=0x558100a21cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:16.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.853+0000 7f9c0179f700 1 --2- 172.21.15.146:0/76225180 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581009e1a30 0x558100a21cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.853+0000 7f9c0179f700 1 -- 172.21.15.146:0/76225180 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bec001110 con 0x558100a0af40 2023-10-06T11:09:16.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.853+0000 7f9c0179f700 1 --2- 172.21.15.146:0/76225180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558100a0af40 0x558100a09b40 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f9bec007fd0 tx=0x7f9bec009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42a364775fa53a59 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:16.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.853+0000 7f9bdbfff700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:09:16.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.853+0000 7f9bdbfff700 1 -- 172.21.15.146:0/76225180 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bec005b10 con 0x558100a0af40 2023-10-06T11:09:16.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.853+0000 7f9bdbfff700 1 -- 172.21.15.146:0/76225180 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9bec005c70 con 0x558100a0af40 2023-10-06T11:09:16.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.853+0000 7f9c0d4fcb80 1 -- 172.21.15.146:0/76225180 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5581009d6770 con 0x558100a0af40 2023-10-06T11:09:16.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.853+0000 7f9bdbfff700 1 -- 172.21.15.146:0/76225180 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9bec005e30 con 0x558100a0af40 2023-10-06T11:09:16.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.853+0000 7f9c0d4fcb80 10 client.5952 fetch_fsmap learned FSMap version 37 2023-10-06T11:09:16.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.853+0000 7f9c0d4fcb80 1 -- 172.21.15.146:0/76225180 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x55810076f0c0 con 0x558100a0af40 2023-10-06T11:09:16.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.853+0000 7f9bdbfff700 1 -- 172.21.15.146:0/76225180 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5581009d6770 con 0x558100a0af40 2023-10-06T11:09:16.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.853+0000 7f9bdbfff700 1 -- 172.21.15.146:0/76225180 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 37) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9bec0072e0 con 0x558100a0af40 2023-10-06T11:09:16.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.853+0000 7f9c0d4fcb80 10 client.5952 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T11:09:16.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.853+0000 7f9c0d4fcb80 10 client.5952 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-10-06T11:09:16.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.853+0000 7f9c0d4fcb80 20 client.5952 populate_metadata read hostname 'smithi146' 2023-10-06T11:09:16.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.853+0000 7f9c0d4fcb80 1 --2- 172.21.15.146:0/76225180 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x558100a20400 0x5581009d8770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:16.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.853+0000 7f9c0d4fcb80 4 client.5952 mds_command: new command op to 5481 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:09:16.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.853+0000 7f9c0d4fcb80 1 -- 172.21.15.146:0/76225180 --> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5581009b36a0 con 0x558100a20400 2023-10-06T11:09:16.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.853+0000 7f9c01fa0700 1 --2- 172.21.15.146:0/76225180 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x558100a20400 0x5581009d8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:16.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.854+0000 7f9bdbfff700 10 client.5952 ms_handle_connect on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:16.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.854+0000 7f9c01fa0700 1 --2- 172.21.15.146:0/76225180 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x558100a20400 0x5581009d8770 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=415fdaabf29c41ba server_cookie=bd5b62afffed664c in_seq=0 out_seq=0 2023-10-06T11:09:16.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.854+0000 7f9bdbfff700 1 -- 172.21.15.146:0/76225180 <== mds.0 v2:172.21.15.146:6835/2252184844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5581009b36a0 con 0x558100a20400 2023-10-06T11:09:16.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.854+0000 7f9bdbfff700 10 client.5952 handle_command_reply: tid=0 2023-10-06T11:09:16.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.854+0000 7f9c0d4fcb80 1 client.5952 shutdown 2023-10-06T11:09:16.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.854+0000 7f9c0d4fcb80 1 -- 172.21.15.146:0/76225180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558100a0af40 msgr2=0x558100a09b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:16.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.854+0000 7f9c0d4fcb80 1 --2- 172.21.15.146:0/76225180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558100a0af40 0x558100a09b40 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f9bec007fd0 tx=0x7f9bec009040 comp rx=0 tx=0).stop 2023-10-06T11:09:16.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.854+0000 7f9c0d4fcb80 1 -- 172.21.15.146:0/76225180 shutdown_connections 2023-10-06T11:09:16.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.854+0000 7f9c0d4fcb80 1 --2- 172.21.15.146:0/76225180 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x558100a20400 0x5581009d8770 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.854+0000 7f9c0d4fcb80 1 --2- 172.21.15.146:0/76225180 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558100a2bca0 0x558100a37e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.854+0000 7f9c0d4fcb80 1 --2- 172.21.15.146:0/76225180 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581009e1a30 0x558100a21cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.854+0000 7f9bdbfff700 0 client.5952 ms_handle_reset on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:16.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.854+0000 7f9c0d4fcb80 1 --2- 172.21.15.146:0/76225180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558100a0af40 0x558100a09b40 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.854+0000 7f9c0d4fcb80 1 -- 172.21.15.146:0/76225180 >> 172.21.15.146:0/76225180 conn(0x5581009e3350 msgr2=0x5581009e2280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:16.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.855+0000 7f9c0d4fcb80 1 -- 172.21.15.146:0/76225180 shutdown_connections 2023-10-06T11:09:16.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.855+0000 7f9c0d4fcb80 1 -- 172.21.15.146:0/76225180 wait complete. 2023-10-06T11:09:16.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.855+0000 7f9c0d4fcb80 20 client.5952 trim_cache size 0 max 16384 2023-10-06T11:09:16.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.870+0000 7f9c0d4fcb80 1 Processor -- start 2023-10-06T11:09:16.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.870+0000 7f9c0d4fcb80 1 -- start start 2023-10-06T11:09:16.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.871+0000 7f9c0d4fcb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581009e1a30 0x558100a208f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:16.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.871+0000 7f9c0d4fcb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558100a0af40 0x558100a20e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:16.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.871+0000 7f9c0d4fcb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558100a2bca0 0x558100a89070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:16.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.871+0000 7f9c0d4fcb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581009e0d20 con 0x5581009e1a30 2023-10-06T11:09:16.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.871+0000 7f9c0d4fcb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581007b4f10 con 0x558100a0af40 2023-10-06T11:09:16.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.871+0000 7f9c0d4fcb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x558100a21830 con 0x558100a2bca0 2023-10-06T11:09:16.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.871+0000 7f9c01fa0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581009e1a30 0x558100a208f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:16.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.871+0000 7f9c01fa0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581009e1a30 0x558100a208f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53734/0 (socket says 172.21.15.146:53734) 2023-10-06T11:09:16.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.871+0000 7f9c01fa0700 1 -- 172.21.15.146:0/4161112675 learned_addr learned my addr 172.21.15.146:0/4161112675 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:16.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.871+0000 7f9c01fa0700 1 -- 172.21.15.146:0/4161112675 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558100a2bca0 msgr2=0x558100a89070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:16.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.871+0000 7f9c01fa0700 1 --2- 172.21.15.146:0/4161112675 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558100a2bca0 0x558100a89070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.871+0000 7f9c01fa0700 1 -- 172.21.15.146:0/4161112675 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558100a0af40 msgr2=0x558100a20e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:16.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.871+0000 7f9c01fa0700 1 --2- 172.21.15.146:0/4161112675 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558100a0af40 0x558100a20e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.871+0000 7f9c01fa0700 1 -- 172.21.15.146:0/4161112675 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558100a1fe90 con 0x5581009e1a30 2023-10-06T11:09:16.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.872+0000 7f9c01fa0700 1 --2- 172.21.15.146:0/4161112675 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581009e1a30 0x558100a208f0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f9bf800fbc0 tx=0x7f9bf8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b7c0e9ced56ee3a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:16.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.872+0000 7f9be77fe700 1 -- 172.21.15.146:0/4161112675 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf8030040 con 0x5581009e1a30 2023-10-06T11:09:16.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.872+0000 7f9be77fe700 1 -- 172.21.15.146:0/4161112675 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf8000c30 con 0x5581009e1a30 2023-10-06T11:09:16.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.872+0000 7f9be77fe700 1 -- 172.21.15.146:0/4161112675 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf8014760 con 0x5581009e1a30 2023-10-06T11:09:16.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.872+0000 7f9c0d4fcb80 1 -- 172.21.15.146:0/4161112675 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581009e1a30 msgr2=0x558100a208f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:16.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.872+0000 7f9c0d4fcb80 1 --2- 172.21.15.146:0/4161112675 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581009e1a30 0x558100a208f0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f9bf800fbc0 tx=0x7f9bf8019000 comp rx=0 tx=0).stop 2023-10-06T11:09:16.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.872+0000 7f9c0d4fcb80 1 -- 172.21.15.146:0/4161112675 shutdown_connections 2023-10-06T11:09:16.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.872+0000 7f9c0d4fcb80 1 --2- 172.21.15.146:0/4161112675 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558100a2bca0 0x558100a89070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.872+0000 7f9c0d4fcb80 1 --2- 172.21.15.146:0/4161112675 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5581009e1a30 0x558100a208f0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.872+0000 7f9c0d4fcb80 1 --2- 172.21.15.146:0/4161112675 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558100a0af40 0x558100a20e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.872+0000 7f9c0d4fcb80 1 -- 172.21.15.146:0/4161112675 >> 172.21.15.146:0/4161112675 conn(0x5581009e3350 msgr2=0x558100a09b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:16.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.872+0000 7f9c0d4fcb80 1 -- 172.21.15.146:0/4161112675 shutdown_connections 2023-10-06T11:09:16.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.872+0000 7f9c0d4fcb80 1 -- 172.21.15.146:0/4161112675 wait complete. 2023-10-06T11:09:16.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.873+0000 7f9c0d4fcb80 1 -- start start 2023-10-06T11:09:16.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.873+0000 7f9c0d4fcb80 1 Processor -- start 2023-10-06T11:09:16.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.874+0000 7f9c0d4fcb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581009e1a30 0x558100a8f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:16.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.874+0000 7f9c0d4fcb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558100a0af40 0x558100a8bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:16.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.874+0000 7f9c0d4fcb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558100a2bca0 0x558100a208f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:16.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.874+0000 7f9c0d4fcb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x558100a05ac0 con 0x558100a2bca0 2023-10-06T11:09:16.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.874+0000 7f9c0d4fcb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x558100a1eed0 con 0x5581009e1a30 2023-10-06T11:09:16.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.874+0000 7f9c0d4fcb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x558100a22ea0 con 0x558100a0af40 2023-10-06T11:09:16.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.874+0000 7f9c0d4fcb80 10 client.0 _ll_register_callbacks cb 0x5581007cf010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:09:16.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.874+0000 7f9c027a1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558100a2bca0 0x558100a208f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:16.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.874+0000 7f9c027a1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558100a2bca0 0x558100a208f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53740/0 (socket says 172.21.15.146:53740) 2023-10-06T11:09:16.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.874+0000 7f9c0179f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558100a0af40 0x558100a8bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:16.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.874+0000 7f9c027a1700 1 -- 172.21.15.146:0/368407353 learned_addr learned my addr 172.21.15.146:0/368407353 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:16.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.874+0000 7f9c01fa0700 1 --2- 172.21.15.146:0/368407353 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581009e1a30 0x558100a8f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:16.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.874+0000 7f9c027a1700 1 -- 172.21.15.146:0/368407353 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558100a0af40 msgr2=0x558100a8bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:16.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.874+0000 7f9c027a1700 1 --2- 172.21.15.146:0/368407353 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558100a0af40 0x558100a8bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.874+0000 7f9c027a1700 1 -- 172.21.15.146:0/368407353 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581009e1a30 msgr2=0x558100a8f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:16.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.874+0000 7f9c027a1700 1 --2- 172.21.15.146:0/368407353 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581009e1a30 0x558100a8f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.874+0000 7f9c027a1700 1 -- 172.21.15.146:0/368407353 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5581007cc350 con 0x558100a2bca0 2023-10-06T11:09:16.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.874+0000 7f9c027a1700 1 --2- 172.21.15.146:0/368407353 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558100a2bca0 0x558100a208f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4056ee0 tx=0x7f9bf4031040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4da47d651db8446f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:16.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.874+0000 7f9bdbfff700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:09:16.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.874+0000 7f9bdbfff700 1 -- 172.21.15.146:0/368407353 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf400e030 con 0x558100a2bca0 2023-10-06T11:09:16.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.875+0000 7f9bdbfff700 1 -- 172.21.15.146:0/368407353 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9bf40578e0 con 0x558100a2bca0 2023-10-06T11:09:16.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.875+0000 7f9c0d4fcb80 1 -- 172.21.15.146:0/368407353 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9bf8019070 con 0x558100a2bca0 2023-10-06T11:09:16.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.875+0000 7f9bdbfff700 1 -- 172.21.15.146:0/368407353 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9bf40571e0 con 0x558100a2bca0 2023-10-06T11:09:16.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.875+0000 7f9c0d4fcb80 10 client.5958 fetch_fsmap learned FSMap version 37 2023-10-06T11:09:16.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.875+0000 7f9c0d4fcb80 1 -- 172.21.15.146:0/368407353 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x558100900860 con 0x558100a2bca0 2023-10-06T11:09:16.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.875+0000 7f9bdbfff700 1 -- 172.21.15.146:0/368407353 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf8019070 con 0x558100a2bca0 2023-10-06T11:09:16.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.875+0000 7f9bdbfff700 1 -- 172.21.15.146:0/368407353 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 37) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9bf405dcf0 con 0x558100a2bca0 2023-10-06T11:09:16.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.875+0000 7f9c0d4fcb80 10 client.5958 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T11:09:16.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.875+0000 7f9c0d4fcb80 10 client.5958 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-10-06T11:09:16.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.875+0000 7f9c0d4fcb80 20 client.5958 populate_metadata read hostname 'smithi146' 2023-10-06T11:09:16.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.875+0000 7f9c0d4fcb80 1 --2- 172.21.15.146:0/368407353 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x558100a20e30 0x558100a07990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:16.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.875+0000 7f9c0d4fcb80 4 client.5958 mds_command: new command op to 5481 tid=0[{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}] 2023-10-06T11:09:16.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.875+0000 7f9c0d4fcb80 1 -- 172.21.15.146:0/368407353 --> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites"}) v1 -- 0x5581008d4ee0 con 0x558100a20e30 2023-10-06T11:09:16.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.875+0000 7f9c01fa0700 1 --2- 172.21.15.146:0/368407353 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x558100a20e30 0x558100a07990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:16.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.875+0000 7f9bdbfff700 10 client.5958 ms_handle_connect on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:16.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.875+0000 7f9c01fa0700 1 --2- 172.21.15.146:0/368407353 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x558100a20e30 0x558100a07990 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7513260623ffd011 server_cookie=4687dcf469584b1f in_seq=0 out_seq=0 2023-10-06T11:09:16.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.876+0000 7f9bdbfff700 1 -- 172.21.15.146:0/368407353 <== mds.0 v2:172.21.15.146:6835/2252184844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5581008d4ee0 con 0x558100a20e30 2023-10-06T11:09:16.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.876+0000 7f9bdbfff700 10 client.5958 handle_command_reply: tid=0 2023-10-06T11:09:16.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.876+0000 7f9c0d4fcb80 1 client.5958 shutdown 2023-10-06T11:09:16.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.876+0000 7f9c0d4fcb80 1 -- 172.21.15.146:0/368407353 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558100a2bca0 msgr2=0x558100a208f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:16.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.876+0000 7f9c0d4fcb80 1 --2- 172.21.15.146:0/368407353 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558100a2bca0 0x558100a208f0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4056ee0 tx=0x7f9bf4031040 comp rx=0 tx=0).stop 2023-10-06T11:09:16.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.876+0000 7f9c0d4fcb80 1 -- 172.21.15.146:0/368407353 shutdown_connections 2023-10-06T11:09:16.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.876+0000 7f9c0d4fcb80 1 --2- 172.21.15.146:0/368407353 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x558100a20e30 0x558100a07990 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.876+0000 7f9c0d4fcb80 1 --2- 172.21.15.146:0/368407353 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558100a2bca0 0x558100a208f0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.876+0000 7f9c0d4fcb80 1 --2- 172.21.15.146:0/368407353 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581009e1a30 0x558100a8f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.876+0000 7f9bdbfff700 0 client.5958 ms_handle_reset on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:16.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.876+0000 7f9c0d4fcb80 1 --2- 172.21.15.146:0/368407353 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558100a0af40 0x558100a8bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.876+0000 7f9c0d4fcb80 1 -- 172.21.15.146:0/368407353 >> 172.21.15.146:0/368407353 conn(0x5581009e3350 msgr2=0x558100a06c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:16.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.876+0000 7f9c0d4fcb80 1 -- 172.21.15.146:0/368407353 shutdown_connections 2023-10-06T11:09:16.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.876+0000 7f9c0d4fcb80 1 -- 172.21.15.146:0/368407353 wait complete. 2023-10-06T11:09:16.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.876+0000 7f9c0d4fcb80 20 client.5958 trim_cache size 0 max 16384 2023-10-06T11:09:16.883 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:09:16.883 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0, 2023-10-06T11:09:16.884 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_tag": "a2171ce4-a22a-40ab-b973-a2cb237399c5", 2023-10-06T11:09:16.884 INFO:teuthology.orchestra.run.smithi146.stdout: "mode": "asynchronous" 2023-10-06T11:09:16.884 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:09:16.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.877+0000 7f9c02fa2700 1 -- 172.21.15.146:0/3817643239 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9be0066f30 msgr2=0x7f9be00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:16.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.877+0000 7f9c02fa2700 1 --2- 172.21.15.146:0/3817643239 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9be0066f30 0x7f9be00693e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9bf8007fd0 tx=0x7f9bf8007d50 comp rx=0 tx=0).stop 2023-10-06T11:09:16.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.877+0000 7f9c02fa2700 1 -- 172.21.15.146:0/3817643239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bfc140f10 msgr2=0x7f9bfc0c6140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:16.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.877+0000 7f9c02fa2700 1 --2- 172.21.15.146:0/3817643239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bfc140f10 0x7f9bfc0c6140 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc06fdd0 tx=0x7f9bf4019000 comp rx=0 tx=0).stop 2023-10-06T11:09:16.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.877+0000 7f9c02fa2700 1 -- 172.21.15.146:0/3817643239 shutdown_connections 2023-10-06T11:09:16.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.877+0000 7f9c02fa2700 1 --2- 172.21.15.146:0/3817643239 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9be0066f30 0x7f9be00693e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.877+0000 7f9c02fa2700 1 --2- 172.21.15.146:0/3817643239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bfc140f10 0x7f9bfc0c6140 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.877+0000 7f9c02fa2700 1 --2- 172.21.15.146:0/3817643239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9bfc06b8a0 0x7f9bfc0c56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.877+0000 7f9c02fa2700 1 --2- 172.21.15.146:0/3817643239 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9bfc06bc70 0x7f9bfc0c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:16.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.877+0000 7f9c02fa2700 1 -- 172.21.15.146:0/3817643239 >> 172.21.15.146:0/3817643239 conn(0x7f9bfc0ce230 msgr2=0x7f9bfc0b1120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:16.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.877+0000 7f9c02fa2700 1 -- 172.21.15.146:0/3817643239 shutdown_connections 2023-10-06T11:09:16.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:16.877+0000 7f9c02fa2700 1 -- 172.21.15.146:0/3817643239 wait complete. 2023-10-06T11:09:16.889 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites' returned '{'return_code': 0, 'scrub_tag': 'a2171ce4-a22a-40ab-b973-a2cb237399c5', 'mode': 'asynchronous'}' 2023-10-06T11:09:16.889 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' 2023-10-06T11:09:16.889 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2023-10-06T11:09:17.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.005+0000 7f5e469e8700 1 Processor -- start 2023-10-06T11:09:17.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.005+0000 7f5e469e8700 1 -- start start 2023-10-06T11:09:17.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.006+0000 7f5e469e8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e4014c6f0 0x7f5e4006ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.006+0000 7f5e469e8700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e40156070 con 0x7f5e400c1d60 2023-10-06T11:09:17.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.006+0000 7f5e469e8700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e40156350 con 0x7f5e4014cac0 2023-10-06T11:09:17.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.006+0000 7f5e469e8700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e40156cf0 con 0x7f5e4014c6f0 2023-10-06T11:09:17.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.006+0000 7f5e461e7700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f5e400c1d60 0x7f5e400cace0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50914/0 (socket says 172.21.15.146:50914) 2023-10-06T11:09:17.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.006+0000 7f5e461e7700 1 -- 172.21.15.146:0/1802204121 learned_addr learned my addr 172.21.15.146:0/1802204121 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:17.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.006+0000 7f5e459e6700 1 --2- 172.21.15.146:0/1802204121 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e4014c6f0 0x7f5e4006ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.007+0000 7f5e449e4700 1 -- 172.21.15.146:0/1802204121 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2454231526 0 0) 0x7f5e40156070 con 0x7f5e400c1d60 2023-10-06T11:09:17.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.007+0000 7f5e449e4700 1 -- 172.21.15.146:0/1802204121 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e2c004680 con 0x7f5e400c1d60 2023-10-06T11:09:17.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.007+0000 7f5e449e4700 1 -- 172.21.15.146:0/1802204121 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1560602879 0 0) 0x7f5e40156350 con 0x7f5e4014cac0 2023-10-06T11:09:17.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.007+0000 7f5e449e4700 1 -- 172.21.15.146:0/1802204121 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e40156070 con 0x7f5e4014cac0 2023-10-06T11:09:17.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.007+0000 7f5e459e6700 1 -- 172.21.15.146:0/1802204121 >> v1:172.21.15.151:6789/0 conn(0x7f5e4014cac0 legacy=0x7f5e400c1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:17.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.007+0000 7f5e459e6700 1 -- 172.21.15.146:0/1802204121 >> v1:172.21.15.146:6789/0 conn(0x7f5e400c1d60 legacy=0x7f5e400cace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:17.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.007+0000 7f5e459e6700 1 -- 172.21.15.146:0/1802204121 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e40156630 con 0x7f5e4014c6f0 2023-10-06T11:09:17.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.007+0000 7f5e459e6700 1 --2- 172.21.15.146:0/1802204121 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e4014c6f0 0x7f5e4006ef50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c009910 tx=0x7f5e3c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9b040095dba2ae8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:17.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.007+0000 7f5e449e4700 1 -- 172.21.15.146:0/1802204121 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c011630 con 0x7f5e4014c6f0 2023-10-06T11:09:17.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.007+0000 7f5e449e4700 1 -- 172.21.15.146:0/1802204121 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3c011790 con 0x7f5e4014c6f0 2023-10-06T11:09:17.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.007+0000 7f5e449e4700 1 -- 172.21.15.146:0/1802204121 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c011b30 con 0x7f5e4014c6f0 2023-10-06T11:09:17.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.008+0000 7f5e469e8700 1 -- 172.21.15.146:0/1802204121 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e4014c6f0 msgr2=0x7f5e4006ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:17.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.008+0000 7f5e469e8700 1 --2- 172.21.15.146:0/1802204121 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e4014c6f0 0x7f5e4006ef50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c009910 tx=0x7f5e3c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.008+0000 7f5e469e8700 1 -- 172.21.15.146:0/1802204121 shutdown_connections 2023-10-06T11:09:17.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.008+0000 7f5e469e8700 1 --2- 172.21.15.146:0/1802204121 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e4014c6f0 0x7f5e4006ef50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.008+0000 7f5e469e8700 1 -- 172.21.15.146:0/1802204121 >> 172.21.15.146:0/1802204121 conn(0x7f5e400cc020 msgr2=0x7f5e400cc420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:17.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.008+0000 7f5e469e8700 1 -- 172.21.15.146:0/1802204121 shutdown_connections 2023-10-06T11:09:17.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.008+0000 7f5e469e8700 1 -- 172.21.15.146:0/1802204121 wait complete. 2023-10-06T11:09:17.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.009+0000 7f5e469e8700 1 Processor -- start 2023-10-06T11:09:17.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.009+0000 7f5e469e8700 1 -- start start 2023-10-06T11:09:17.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.010+0000 7f5e469e8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e400c1d60 0x7f5e4014b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.010+0000 7f5e469e8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e4014c6f0 0x7f5e4013dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.010+0000 7f5e469e8700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e4014cac0 0x7f5e400aedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.010+0000 7f5e469e8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e400b0190 con 0x7f5e400c1d60 2023-10-06T11:09:17.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.010+0000 7f5e469e8700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e400af300 con 0x7f5e4014cac0 2023-10-06T11:09:17.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.010+0000 7f5e469e8700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e400af580 con 0x7f5e4014c6f0 2023-10-06T11:09:17.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.010+0000 7f5e459e6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e400c1d60 0x7f5e4014b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.010+0000 7f5e459e6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e400c1d60 0x7f5e4014b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53754/0 (socket says 172.21.15.146:53754) 2023-10-06T11:09:17.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.010+0000 7f5e459e6700 1 -- 172.21.15.146:0/1999193763 learned_addr learned my addr 172.21.15.146:0/1999193763 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:17.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.010+0000 7f5e451e5700 1 --2- 172.21.15.146:0/1999193763 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e4014c6f0 0x7f5e4013dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.010+0000 7f5e461e7700 1 --2- 172.21.15.146:0/1999193763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e4014cac0 0x7f5e400aedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.010+0000 7f5e459e6700 1 -- 172.21.15.146:0/1999193763 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e4014c6f0 msgr2=0x7f5e4013dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:17.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.010+0000 7f5e459e6700 1 --2- 172.21.15.146:0/1999193763 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e4014c6f0 0x7f5e4013dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.010+0000 7f5e459e6700 1 -- 172.21.15.146:0/1999193763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e4014cac0 msgr2=0x7f5e400aedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:17.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.010+0000 7f5e459e6700 1 --2- 172.21.15.146:0/1999193763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e4014cac0 0x7f5e400aedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.010+0000 7f5e459e6700 1 -- 172.21.15.146:0/1999193763 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e3c009420 con 0x7f5e400c1d60 2023-10-06T11:09:17.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.010+0000 7f5e459e6700 1 --2- 172.21.15.146:0/1999193763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e400c1d60 0x7f5e4014b570 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c009fd0 tx=0x7f5e3c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:17.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.010+0000 7f5e35ffb700 1 -- 172.21.15.146:0/1999193763 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c01f070 con 0x7f5e400c1d60 2023-10-06T11:09:17.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.010+0000 7f5e35ffb700 1 -- 172.21.15.146:0/1999193763 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3c002f70 con 0x7f5e400c1d60 2023-10-06T11:09:17.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.010+0000 7f5e35ffb700 1 -- 172.21.15.146:0/1999193763 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c011900 con 0x7f5e400c1d60 2023-10-06T11:09:17.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.010+0000 7f5e469e8700 1 -- 172.21.15.146:0/1999193763 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e400af860 con 0x7f5e400c1d60 2023-10-06T11:09:17.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.011+0000 7f5e469e8700 1 -- 172.21.15.146:0/1999193763 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e400afe20 con 0x7f5e400c1d60 2023-10-06T11:09:17.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.012+0000 7f5e35ffb700 1 -- 172.21.15.146:0/1999193763 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5e3c023070 con 0x7f5e400c1d60 2023-10-06T11:09:17.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.012+0000 7f5e35ffb700 1 --2- 172.21.15.146:0/1999193763 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5e24066f30 0x7f5e240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.012+0000 7f5e35ffb700 1 -- 172.21.15.146:0/1999193763 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5e3c085950 con 0x7f5e400c1d60 2023-10-06T11:09:17.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.012+0000 7f5e451e5700 1 --2- 172.21.15.146:0/1999193763 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5e24066f30 0x7f5e240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.013+0000 7f5e451e5700 1 --2- 172.21.15.146:0/1999193763 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5e24066f30 0x7f5e240693e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5e30007fd0 tx=0x7f5e30007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:17.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.015+0000 7f5e50f42b80 1 Processor -- start 2023-10-06T11:09:17.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.015+0000 7f5e50f42b80 1 -- start start 2023-10-06T11:09:17.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.015+0000 7f5e50f42b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5644945b0ac0 0x5644945b0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.015+0000 7f5e50f42b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5644945fad30 0x5644945d9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.015+0000 7f5e50f42b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5644945d9fd0 0x5644945acb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.015+0000 7f5e50f42b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x564494530df0 con 0x5644945d9fd0 2023-10-06T11:09:17.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.015+0000 7f5e50f42b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x564494507be0 con 0x5644945b0ac0 2023-10-06T11:09:17.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.015+0000 7f5e50f42b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5644945053e0 con 0x5644945fad30 2023-10-06T11:09:17.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.016+0000 7f5e461e7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5644945d9fd0 0x5644945acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.016+0000 7f5e461e7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5644945d9fd0 0x5644945acb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53770/0 (socket says 172.21.15.146:53770) 2023-10-06T11:09:17.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.016+0000 7f5e461e7700 1 -- 172.21.15.146:0/2059604810 learned_addr learned my addr 172.21.15.146:0/2059604810 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:17.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.016+0000 7f5e451e5700 1 --2- 172.21.15.146:0/2059604810 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5644945fad30 0x5644945d9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.016+0000 7f5e459e6700 1 --2- 172.21.15.146:0/2059604810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5644945b0ac0 0x5644945b0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.016+0000 7f5e461e7700 1 -- 172.21.15.146:0/2059604810 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5644945fad30 msgr2=0x5644945d9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:17.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.016+0000 7f5e461e7700 1 --2- 172.21.15.146:0/2059604810 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5644945fad30 0x5644945d9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.016+0000 7f5e461e7700 1 -- 172.21.15.146:0/2059604810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5644945b0ac0 msgr2=0x5644945b0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:17.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.016+0000 7f5e461e7700 1 --2- 172.21.15.146:0/2059604810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5644945b0ac0 0x5644945b0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.016+0000 7f5e461e7700 1 -- 172.21.15.146:0/2059604810 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56449439b3e0 con 0x5644945d9fd0 2023-10-06T11:09:17.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.016+0000 7f5e459e6700 1 --2- 172.21.15.146:0/2059604810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5644945b0ac0 0x5644945b0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:17.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.016+0000 7f5e461e7700 1 --2- 172.21.15.146:0/2059604810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5644945d9fd0 0x5644945acb00 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f5e3800f280 tx=0x7f5e38009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=478db294b158ec6b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:17.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.016+0000 7f5e22ffd700 1 -- 172.21.15.146:0/2059604810 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3800fec0 con 0x5644945d9fd0 2023-10-06T11:09:17.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.016+0000 7f5e22ffd700 1 -- 172.21.15.146:0/2059604810 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e380070d0 con 0x5644945d9fd0 2023-10-06T11:09:17.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.016+0000 7f5e22ffd700 1 -- 172.21.15.146:0/2059604810 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e38007450 con 0x5644945d9fd0 2023-10-06T11:09:17.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.017+0000 7f5e50f42b80 1 -- 172.21.15.146:0/2059604810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5644945d9fd0 msgr2=0x5644945acb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:17.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.017+0000 7f5e50f42b80 1 --2- 172.21.15.146:0/2059604810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5644945d9fd0 0x5644945acb00 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f5e3800f280 tx=0x7f5e38009040 comp rx=0 tx=0).stop 2023-10-06T11:09:17.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.017+0000 7f5e50f42b80 1 -- 172.21.15.146:0/2059604810 shutdown_connections 2023-10-06T11:09:17.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.017+0000 7f5e50f42b80 1 --2- 172.21.15.146:0/2059604810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5644945d9fd0 0x5644945acb00 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.017+0000 7f5e50f42b80 1 --2- 172.21.15.146:0/2059604810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5644945b0ac0 0x5644945b0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.017+0000 7f5e50f42b80 1 --2- 172.21.15.146:0/2059604810 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5644945fad30 0x5644945d9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.017+0000 7f5e50f42b80 1 -- 172.21.15.146:0/2059604810 >> 172.21.15.146:0/2059604810 conn(0x5644945b23e0 msgr2=0x5644945b27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:17.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.017+0000 7f5e50f42b80 1 -- 172.21.15.146:0/2059604810 shutdown_connections 2023-10-06T11:09:17.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.017+0000 7f5e50f42b80 1 -- 172.21.15.146:0/2059604810 wait complete. 2023-10-06T11:09:17.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.017+0000 7f5e50f42b80 1 -- start start 2023-10-06T11:09:17.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.017+0000 7f5e50f42b80 1 Processor -- start 2023-10-06T11:09:17.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.018+0000 7f5e50f42b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5644945b0ac0 0x5644945f3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.018+0000 7f5e50f42b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5644945d9fd0 0x5644945f15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.018+0000 7f5e50f42b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5644945fad30 0x5644945d71b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.018+0000 7f5e50f42b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644945011d0 con 0x5644945fad30 2023-10-06T11:09:17.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.018+0000 7f5e50f42b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644944aca00 con 0x5644945d9fd0 2023-10-06T11:09:17.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.018+0000 7f5e50f42b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5644944c8010 con 0x5644945b0ac0 2023-10-06T11:09:17.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.018+0000 7f5e50f42b80 10 client.0 _ll_register_callbacks cb 0x56449439e0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:09:17.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.018+0000 7f5e461e7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5644945fad30 0x5644945d71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.018+0000 7f5e461e7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5644945fad30 0x5644945d71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53782/0 (socket says 172.21.15.146:53782) 2023-10-06T11:09:17.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.018+0000 7f5e461e7700 1 -- 172.21.15.146:0/1022235903 learned_addr learned my addr 172.21.15.146:0/1022235903 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:17.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.018+0000 7f5e451e5700 1 --2- 172.21.15.146:0/1022235903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5644945d9fd0 0x5644945f15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.018+0000 7f5e459e6700 1 --2- 172.21.15.146:0/1022235903 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5644945b0ac0 0x5644945f3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.019+0000 7f5e461e7700 1 -- 172.21.15.146:0/1022235903 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5644945b0ac0 msgr2=0x5644945f3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:17.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.019+0000 7f5e461e7700 1 --2- 172.21.15.146:0/1022235903 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5644945b0ac0 0x5644945f3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.019+0000 7f5e461e7700 1 -- 172.21.15.146:0/1022235903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5644945d9fd0 msgr2=0x5644945f15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:17.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.019+0000 7f5e461e7700 1 --2- 172.21.15.146:0/1022235903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5644945d9fd0 0x5644945f15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.019+0000 7f5e461e7700 1 -- 172.21.15.146:0/1022235903 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e2c004680 con 0x5644945fad30 2023-10-06T11:09:17.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.019+0000 7f5e461e7700 1 --2- 172.21.15.146:0/1022235903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5644945fad30 0x5644945d71b0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f5e38015040 tx=0x7f5e38013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f9829067f2c92f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:17.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.019+0000 7f5e1bfff700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:09:17.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.019+0000 7f5e1bfff700 1 -- 172.21.15.146:0/1022235903 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e38001f30 con 0x5644945fad30 2023-10-06T11:09:17.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.019+0000 7f5e1bfff700 1 -- 172.21.15.146:0/1022235903 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5e38004dc0 con 0x5644945fad30 2023-10-06T11:09:17.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.019+0000 7f5e50f42b80 1 -- 172.21.15.146:0/1022235903 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5644945a5800 con 0x5644945fad30 2023-10-06T11:09:17.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.019+0000 7f5e1bfff700 1 -- 172.21.15.146:0/1022235903 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e3801c630 con 0x5644945fad30 2023-10-06T11:09:17.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.019+0000 7f5e50f42b80 10 client.5970 fetch_fsmap learned FSMap version 37 2023-10-06T11:09:17.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.019+0000 7f5e50f42b80 1 -- 172.21.15.146:0/1022235903 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x56449433e150 con 0x5644945fad30 2023-10-06T11:09:17.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.019+0000 7f5e1bfff700 1 -- 172.21.15.146:0/1022235903 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5644945a5800 con 0x5644945fad30 2023-10-06T11:09:17.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.019+0000 7f5e1bfff700 1 -- 172.21.15.146:0/1022235903 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 37) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5e38012070 con 0x5644945fad30 2023-10-06T11:09:17.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.019+0000 7f5e50f42b80 10 client.5970 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T11:09:17.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.019+0000 7f5e50f42b80 10 client.5970 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-10-06T11:09:17.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.019+0000 7f5e50f42b80 20 client.5970 populate_metadata read hostname 'smithi146' 2023-10-06T11:09:17.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.019+0000 7f5e50f42b80 1 --2- 172.21.15.146:0/1022235903 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x5644945f23c0 0x5644945f41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.019+0000 7f5e50f42b80 4 client.5970 mds_command: new command op to 5481 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:09:17.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.019+0000 7f5e50f42b80 1 -- 172.21.15.146:0/1022235903 --> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564494582730 con 0x5644945f23c0 2023-10-06T11:09:17.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.020+0000 7f5e459e6700 1 --2- 172.21.15.146:0/1022235903 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x5644945f23c0 0x5644945f41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.020+0000 7f5e1bfff700 10 client.5970 ms_handle_connect on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:17.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.020+0000 7f5e459e6700 1 --2- 172.21.15.146:0/1022235903 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x5644945f23c0 0x5644945f41f0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=448d4c301ed5e2ca server_cookie=6b2086249c0d2a2e in_seq=0 out_seq=0 2023-10-06T11:09:17.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.020+0000 7f5e1bfff700 1 -- 172.21.15.146:0/1022235903 <== mds.0 v2:172.21.15.146:6835/2252184844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x564494582730 con 0x5644945f23c0 2023-10-06T11:09:17.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.020+0000 7f5e1bfff700 10 client.5970 handle_command_reply: tid=0 2023-10-06T11:09:17.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.020+0000 7f5e50f42b80 1 client.5970 shutdown 2023-10-06T11:09:17.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.020+0000 7f5e50f42b80 1 -- 172.21.15.146:0/1022235903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5644945fad30 msgr2=0x5644945d71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:17.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.020+0000 7f5e50f42b80 1 --2- 172.21.15.146:0/1022235903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5644945fad30 0x5644945d71b0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f5e38015040 tx=0x7f5e38013000 comp rx=0 tx=0).stop 2023-10-06T11:09:17.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.021+0000 7f5e50f42b80 1 -- 172.21.15.146:0/1022235903 shutdown_connections 2023-10-06T11:09:17.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.021+0000 7f5e50f42b80 1 --2- 172.21.15.146:0/1022235903 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x5644945f23c0 0x5644945f41f0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.021+0000 7f5e50f42b80 1 --2- 172.21.15.146:0/1022235903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5644945fad30 0x5644945d71b0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.021+0000 7f5e50f42b80 1 --2- 172.21.15.146:0/1022235903 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5644945b0ac0 0x5644945f3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.021+0000 7f5e1bfff700 0 client.5970 ms_handle_reset on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:17.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.021+0000 7f5e50f42b80 1 --2- 172.21.15.146:0/1022235903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5644945d9fd0 0x5644945f15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.021+0000 7f5e50f42b80 1 -- 172.21.15.146:0/1022235903 >> 172.21.15.146:0/1022235903 conn(0x5644945b23e0 msgr2=0x5644945a7310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:17.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.021+0000 7f5e50f42b80 1 -- 172.21.15.146:0/1022235903 shutdown_connections 2023-10-06T11:09:17.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.021+0000 7f5e50f42b80 1 -- 172.21.15.146:0/1022235903 wait complete. 2023-10-06T11:09:17.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.021+0000 7f5e50f42b80 20 client.5970 trim_cache size 0 max 16384 2023-10-06T11:09:17.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.037+0000 7f5e50f42b80 1 Processor -- start 2023-10-06T11:09:17.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.037+0000 7f5e50f42b80 1 -- start start 2023-10-06T11:09:17.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.037+0000 7f5e50f42b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5644945b23e0 0x5644945aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.037+0000 7f5e50f42b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5644945b0ac0 0x5644945a74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.037+0000 7f5e50f42b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5644945d9fd0 0x5644945d7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.037+0000 7f5e50f42b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x564494383fa0 con 0x5644945b0ac0 2023-10-06T11:09:17.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.037+0000 7f5e50f42b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644945b3510 con 0x5644945b23e0 2023-10-06T11:09:17.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.037+0000 7f5e50f42b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5644945d6270 con 0x5644945d9fd0 2023-10-06T11:09:17.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.038+0000 7f5e451e5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5644945b0ac0 0x5644945a74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.038+0000 7f5e451e5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5644945b0ac0 0x5644945a74e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53790/0 (socket says 172.21.15.146:53790) 2023-10-06T11:09:17.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.038+0000 7f5e451e5700 1 -- 172.21.15.146:0/2769378839 learned_addr learned my addr 172.21.15.146:0/2769378839 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:17.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.038+0000 7f5e461e7700 1 --2- 172.21.15.146:0/2769378839 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5644945d9fd0 0x5644945d7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.038+0000 7f5e459e6700 1 --2- 172.21.15.146:0/2769378839 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5644945b23e0 0x5644945aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.038+0000 7f5e451e5700 1 -- 172.21.15.146:0/2769378839 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5644945d9fd0 msgr2=0x5644945d7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:17.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.038+0000 7f5e451e5700 1 --2- 172.21.15.146:0/2769378839 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5644945d9fd0 0x5644945d7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.038+0000 7f5e451e5700 1 -- 172.21.15.146:0/2769378839 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5644945b23e0 msgr2=0x5644945aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:17.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.038+0000 7f5e451e5700 1 --2- 172.21.15.146:0/2769378839 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5644945b23e0 0x5644945aebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.038+0000 7f5e451e5700 1 -- 172.21.15.146:0/2769378839 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5644944cf8f0 con 0x5644945b0ac0 2023-10-06T11:09:17.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.038+0000 7f5e459e6700 1 --2- 172.21.15.146:0/2769378839 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5644945b23e0 0x5644945aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:17.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.038+0000 7f5e451e5700 1 --2- 172.21.15.146:0/2769378839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5644945b0ac0 0x5644945a74e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f5e3000f4b0 tx=0x7f5e30015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eee5561de96005db server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:17.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.038+0000 7f5e237fe700 1 -- 172.21.15.146:0/2769378839 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e30023690 con 0x5644945b0ac0 2023-10-06T11:09:17.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.038+0000 7f5e237fe700 1 -- 172.21.15.146:0/2769378839 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e300237f0 con 0x5644945b0ac0 2023-10-06T11:09:17.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.038+0000 7f5e237fe700 1 -- 172.21.15.146:0/2769378839 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e30023b70 con 0x5644945b0ac0 2023-10-06T11:09:17.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.039+0000 7f5e50f42b80 1 -- 172.21.15.146:0/2769378839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5644945b0ac0 msgr2=0x5644945a74e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:17.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.039+0000 7f5e50f42b80 1 --2- 172.21.15.146:0/2769378839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5644945b0ac0 0x5644945a74e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f5e3000f4b0 tx=0x7f5e30015000 comp rx=0 tx=0).stop 2023-10-06T11:09:17.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.039+0000 7f5e50f42b80 1 -- 172.21.15.146:0/2769378839 shutdown_connections 2023-10-06T11:09:17.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.039+0000 7f5e50f42b80 1 --2- 172.21.15.146:0/2769378839 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5644945d9fd0 0x5644945d7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.039+0000 7f5e50f42b80 1 --2- 172.21.15.146:0/2769378839 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5644945b23e0 0x5644945aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.039+0000 7f5e50f42b80 1 --2- 172.21.15.146:0/2769378839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5644945b0ac0 0x5644945a74e0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.039+0000 7f5e50f42b80 1 -- 172.21.15.146:0/2769378839 >> 172.21.15.146:0/2769378839 conn(0x5644945afb20 msgr2=0x5644945b1870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:17.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.039+0000 7f5e50f42b80 1 -- 172.21.15.146:0/2769378839 shutdown_connections 2023-10-06T11:09:17.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.039+0000 7f5e50f42b80 1 -- 172.21.15.146:0/2769378839 wait complete. 2023-10-06T11:09:17.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.039+0000 7f5e50f42b80 1 -- start start 2023-10-06T11:09:17.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.039+0000 7f5e50f42b80 1 Processor -- start 2023-10-06T11:09:17.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.040+0000 7f5e50f42b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5644945b0ac0 0x56449460c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.040+0000 7f5e50f42b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5644945b23e0 0x56449460fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.040+0000 7f5e50f42b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5644945d9fd0 0x564494610050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.040+0000 7f5e50f42b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x56449465eb40 con 0x5644945b0ac0 2023-10-06T11:09:17.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.040+0000 7f5e50f42b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56449460cdf0 con 0x5644945d9fd0 2023-10-06T11:09:17.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.040+0000 7f5e50f42b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5644945adc10 con 0x5644945b23e0 2023-10-06T11:09:17.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.040+0000 7f5e50f42b80 10 client.0 _ll_register_callbacks cb 0x5644945f1230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:09:17.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.040+0000 7f5e459e6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5644945b0ac0 0x56449460c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.040+0000 7f5e459e6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5644945b0ac0 0x56449460c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53796/0 (socket says 172.21.15.146:53796) 2023-10-06T11:09:17.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.040+0000 7f5e459e6700 1 -- 172.21.15.146:0/787372368 learned_addr learned my addr 172.21.15.146:0/787372368 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:17.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.041+0000 7f5e459e6700 1 -- 172.21.15.146:0/787372368 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5644945b23e0 msgr2=0x56449460fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:17.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.041+0000 7f5e459e6700 1 --2- 172.21.15.146:0/787372368 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5644945b23e0 0x56449460fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.041+0000 7f5e459e6700 1 -- 172.21.15.146:0/787372368 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5644945d9fd0 msgr2=0x564494610050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:17.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.041+0000 7f5e459e6700 1 --2- 172.21.15.146:0/787372368 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5644945d9fd0 0x564494610050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.041+0000 7f5e459e6700 1 -- 172.21.15.146:0/787372368 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e40156070 con 0x5644945b0ac0 2023-10-06T11:09:17.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.041+0000 7f5e459e6700 1 --2- 172.21.15.146:0/787372368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5644945b0ac0 0x56449460c560 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c011ea0 tx=0x7f5e3c027040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7174af83018c817d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:17.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.041+0000 7f5e1bfff700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:09:17.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.041+0000 7f5e1bfff700 1 -- 172.21.15.146:0/787372368 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c085040 con 0x5644945b0ac0 2023-10-06T11:09:17.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.041+0000 7f5e1bfff700 1 -- 172.21.15.146:0/787372368 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5e3c05d6c0 con 0x5644945b0ac0 2023-10-06T11:09:17.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.041+0000 7f5e50f42b80 1 -- 172.21.15.146:0/787372368 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5e380070d0 con 0x5644945b0ac0 2023-10-06T11:09:17.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.041+0000 7f5e1bfff700 1 -- 172.21.15.146:0/787372368 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e3c0722c0 con 0x5644945b0ac0 2023-10-06T11:09:17.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.041+0000 7f5e50f42b80 10 client.5976 fetch_fsmap learned FSMap version 37 2023-10-06T11:09:17.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.041+0000 7f5e50f42b80 1 -- 172.21.15.146:0/787372368 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x5644944b65e0 con 0x5644945b0ac0 2023-10-06T11:09:17.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.041+0000 7f5e1bfff700 1 -- 172.21.15.146:0/787372368 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e380070d0 con 0x5644945b0ac0 2023-10-06T11:09:17.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.041+0000 7f5e1bfff700 1 -- 172.21.15.146:0/787372368 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 37) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5e3c055c10 con 0x5644945b0ac0 2023-10-06T11:09:17.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.041+0000 7f5e50f42b80 10 client.5976 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T11:09:17.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.041+0000 7f5e50f42b80 10 client.5976 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-10-06T11:09:17.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.041+0000 7f5e50f42b80 20 client.5976 populate_metadata read hostname 'smithi146' 2023-10-06T11:09:17.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.041+0000 7f5e50f42b80 1 --2- 172.21.15.146:0/787372368 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x5644945fad30 0x5644945f3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.041+0000 7f5e50f42b80 4 client.5976 mds_command: new command op to 5481 tid=0[{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}] 2023-10-06T11:09:17.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.041+0000 7f5e50f42b80 1 -- 172.21.15.146:0/787372368 --> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml"}) v1 -- 0x5644944a3f70 con 0x5644945fad30 2023-10-06T11:09:17.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.041+0000 7f5e451e5700 1 --2- 172.21.15.146:0/787372368 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x5644945fad30 0x5644945f3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.042+0000 7f5e1bfff700 10 client.5976 ms_handle_connect on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:17.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.042+0000 7f5e451e5700 1 --2- 172.21.15.146:0/787372368 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x5644945fad30 0x5644945f3f50 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b1b3e90e6e5ff06 server_cookie=bf8708d0768e0f6b in_seq=0 out_seq=0 2023-10-06T11:09:17.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.042+0000 7f5e1bfff700 1 -- 172.21.15.146:0/787372368 <== mds.0 v2:172.21.15.146:6835/2252184844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5644944a3f70 con 0x5644945fad30 2023-10-06T11:09:17.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.042+0000 7f5e1bfff700 10 client.5976 handle_command_reply: tid=0 2023-10-06T11:09:17.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.042+0000 7f5e50f42b80 1 client.5976 shutdown 2023-10-06T11:09:17.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.042+0000 7f5e50f42b80 1 -- 172.21.15.146:0/787372368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5644945b0ac0 msgr2=0x56449460c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:17.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.042+0000 7f5e50f42b80 1 --2- 172.21.15.146:0/787372368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5644945b0ac0 0x56449460c560 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c011ea0 tx=0x7f5e3c027040 comp rx=0 tx=0).stop 2023-10-06T11:09:17.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.042+0000 7f5e50f42b80 1 -- 172.21.15.146:0/787372368 shutdown_connections 2023-10-06T11:09:17.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.042+0000 7f5e50f42b80 1 --2- 172.21.15.146:0/787372368 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x5644945fad30 0x5644945f3f50 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.042+0000 7f5e50f42b80 1 --2- 172.21.15.146:0/787372368 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5644945d9fd0 0x564494610050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.042+0000 7f5e50f42b80 1 --2- 172.21.15.146:0/787372368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5644945b0ac0 0x56449460c560 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.042+0000 7f5e50f42b80 1 --2- 172.21.15.146:0/787372368 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5644945b23e0 0x56449460fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.042+0000 7f5e1bfff700 0 client.5976 ms_handle_reset on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:17.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.042+0000 7f5e50f42b80 1 -- 172.21.15.146:0/787372368 >> 172.21.15.146:0/787372368 conn(0x5644945afb20 msgr2=0x5644945a74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:17.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.043+0000 7f5e50f42b80 1 -- 172.21.15.146:0/787372368 shutdown_connections 2023-10-06T11:09:17.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.043+0000 7f5e50f42b80 1 -- 172.21.15.146:0/787372368 wait complete. 2023-10-06T11:09:17.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.043+0000 7f5e50f42b80 20 client.5976 trim_cache size 0 max 16384 2023-10-06T11:09:17.052 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:09:17.052 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0, 2023-10-06T11:09:17.052 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_tag": "0f3d4c31-a384-4add-b963-9cd3e24c328c", 2023-10-06T11:09:17.053 INFO:teuthology.orchestra.run.smithi146.stdout: "mode": "asynchronous" 2023-10-06T11:09:17.053 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:09:17.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.043+0000 7f5e469e8700 1 -- 172.21.15.146:0/1999193763 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5e24066f30 msgr2=0x7f5e240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:17.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.043+0000 7f5e469e8700 1 --2- 172.21.15.146:0/1999193763 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5e24066f30 0x7f5e240693e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f5e30007fd0 tx=0x7f5e30007d50 comp rx=0 tx=0).stop 2023-10-06T11:09:17.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.043+0000 7f5e469e8700 1 -- 172.21.15.146:0/1999193763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e400c1d60 msgr2=0x7f5e4014b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:17.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.043+0000 7f5e469e8700 1 --2- 172.21.15.146:0/1999193763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e400c1d60 0x7f5e4014b570 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c009fd0 tx=0x7f5e3c017000 comp rx=0 tx=0).stop 2023-10-06T11:09:17.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.043+0000 7f5e469e8700 1 -- 172.21.15.146:0/1999193763 shutdown_connections 2023-10-06T11:09:17.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.043+0000 7f5e469e8700 1 --2- 172.21.15.146:0/1999193763 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5e24066f30 0x7f5e240693e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.043+0000 7f5e469e8700 1 --2- 172.21.15.146:0/1999193763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e4014cac0 0x7f5e400aedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.043+0000 7f5e469e8700 1 --2- 172.21.15.146:0/1999193763 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e400c1d60 0x7f5e4014b570 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.043+0000 7f5e469e8700 1 --2- 172.21.15.146:0/1999193763 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e4014c6f0 0x7f5e4013dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.043+0000 7f5e469e8700 1 -- 172.21.15.146:0/1999193763 >> 172.21.15.146:0/1999193763 conn(0x7f5e400cc020 msgr2=0x7f5e40069620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:17.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.043+0000 7f5e469e8700 1 -- 172.21.15.146:0/1999193763 shutdown_connections 2023-10-06T11:09:17.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.043+0000 7f5e469e8700 1 -- 172.21.15.146:0/1999193763 wait complete. 2023-10-06T11:09:17.057 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml' returned '{'return_code': 0, 'scrub_tag': '0f3d4c31-a384-4add-b963-9cd3e24c328c', 'mode': 'asynchronous'}' 2023-10-06T11:09:17.057 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /' 2023-10-06T11:09:17.057 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / 2023-10-06T11:09:17.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.173+0000 7fe47c91e700 1 Processor -- start 2023-10-06T11:09:17.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.173+0000 7fe47c91e700 1 -- start start 2023-10-06T11:09:17.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.174+0000 7fe47c91e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe4780c7810 0x7fe47815e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.174+0000 7fe47c91e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4780d1670 con 0x7fe47815e5f0 2023-10-06T11:09:17.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.174+0000 7fe47c91e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4780cee70 con 0x7fe478159f40 2023-10-06T11:09:17.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.174+0000 7fe47c91e700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4780cc4b0 con 0x7fe4780c7810 2023-10-06T11:09:17.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.174+0000 7fe476d9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe47815e5f0 0x7fe4780cada0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50918/0 (socket says 172.21.15.146:50918) 2023-10-06T11:09:17.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.174+0000 7fe476d9d700 1 -- 172.21.15.146:0/998148240 learned_addr learned my addr 172.21.15.146:0/998148240 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:17.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.174+0000 7fe46dd9b700 1 --2- 172.21.15.146:0/998148240 >> v2:172.21.15.151:3300/0 conn(0x7fe4780c7810 0x7fe47815e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.175+0000 7fe475d9b700 1 -- 172.21.15.146:0/998148240 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3640350657 0 0) 0x7fe4780d1670 con 0x7fe47815e5f0 2023-10-06T11:09:17.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.175+0000 7fe475d9b700 1 -- 172.21.15.146:0/998148240 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe464003570 con 0x7fe47815e5f0 2023-10-06T11:09:17.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.175+0000 7fe475d9b700 1 -- 172.21.15.146:0/998148240 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 304094544 0 0) 0x7fe4780cee70 con 0x7fe478159f40 2023-10-06T11:09:17.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.175+0000 7fe475d9b700 1 -- 172.21.15.146:0/998148240 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4780d1670 con 0x7fe478159f40 2023-10-06T11:09:17.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.175+0000 7fe46dd9b700 1 -- 172.21.15.146:0/998148240 >> v1:172.21.15.151:6789/0 conn(0x7fe478159f40 legacy=0x7fe47815d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:17.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.175+0000 7fe46dd9b700 1 -- 172.21.15.146:0/998148240 >> v1:172.21.15.146:6789/0 conn(0x7fe47815e5f0 legacy=0x7fe4780cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:17.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.175+0000 7fe475d9b700 1 -- 172.21.15.146:0/998148240 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3927371358 0 0) 0x7fe464003570 con 0x7fe47815e5f0 2023-10-06T11:09:17.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.175+0000 7fe46dd9b700 1 -- 172.21.15.146:0/998148240 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe47806f990 con 0x7fe4780c7810 2023-10-06T11:09:17.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.175+0000 7fe46dd9b700 1 --2- 172.21.15.146:0/998148240 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe4780c7810 0x7fe47815e0b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe4600098e0 tx=0x7fe4600091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87fb03e1c18ddab5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:17.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.175+0000 7fe475d9b700 1 -- 172.21.15.146:0/998148240 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4700017f0 con 0x7fe4780c7810 2023-10-06T11:09:17.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.175+0000 7fe475d9b700 1 -- 172.21.15.146:0/998148240 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe460011420 con 0x7fe4780c7810 2023-10-06T11:09:17.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.175+0000 7fe475d9b700 1 -- 172.21.15.146:0/998148240 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4600117c0 con 0x7fe4780c7810 2023-10-06T11:09:17.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.176+0000 7fe47c91e700 1 -- 172.21.15.146:0/998148240 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe4780c7810 msgr2=0x7fe47815e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:17.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.176+0000 7fe47c91e700 1 --2- 172.21.15.146:0/998148240 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe4780c7810 0x7fe47815e0b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe4600098e0 tx=0x7fe4600091a0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.176+0000 7fe47c91e700 1 -- 172.21.15.146:0/998148240 shutdown_connections 2023-10-06T11:09:17.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.176+0000 7fe47c91e700 1 --2- 172.21.15.146:0/998148240 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe4780c7810 0x7fe47815e0b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.176+0000 7fe47c91e700 1 -- 172.21.15.146:0/998148240 >> 172.21.15.146:0/998148240 conn(0x7fe47806f380 msgr2=0x7fe4780d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:17.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.176+0000 7fe47c91e700 1 -- 172.21.15.146:0/998148240 shutdown_connections 2023-10-06T11:09:17.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.176+0000 7fe47c91e700 1 -- 172.21.15.146:0/998148240 wait complete. 2023-10-06T11:09:17.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.177+0000 7fe47c91e700 1 Processor -- start 2023-10-06T11:09:17.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.177+0000 7fe47c91e700 1 -- start start 2023-10-06T11:09:17.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.178+0000 7fe47c91e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4780c7810 0x7fe4780b5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.178+0000 7fe47c91e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe478159f40 0x7fe47809b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.178+0000 7fe47c91e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe47815e5f0 0x7fe4780b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.178+0000 7fe47c91e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4780c70d0 con 0x7fe4780c7810 2023-10-06T11:09:17.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.178+0000 7fe47c91e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4780c4400 con 0x7fe47815e5f0 2023-10-06T11:09:17.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.178+0000 7fe47c91e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4780c46e0 con 0x7fe478159f40 2023-10-06T11:09:17.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.178+0000 7fe47659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4780c7810 0x7fe4780b5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.178+0000 7fe47659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4780c7810 0x7fe4780b5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53800/0 (socket says 172.21.15.146:53800) 2023-10-06T11:09:17.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.178+0000 7fe47659c700 1 -- 172.21.15.146:0/369252969 learned_addr learned my addr 172.21.15.146:0/369252969 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:17.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.178+0000 7fe46dd9b700 1 --2- 172.21.15.146:0/369252969 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe478159f40 0x7fe47809b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.178+0000 7fe476d9d700 1 --2- 172.21.15.146:0/369252969 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe47815e5f0 0x7fe4780b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.178+0000 7fe47659c700 1 -- 172.21.15.146:0/369252969 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe478159f40 msgr2=0x7fe47809b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:17.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.178+0000 7fe47659c700 1 --2- 172.21.15.146:0/369252969 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe478159f40 0x7fe47809b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.178+0000 7fe47659c700 1 -- 172.21.15.146:0/369252969 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe47815e5f0 msgr2=0x7fe4780b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:17.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.178+0000 7fe47659c700 1 --2- 172.21.15.146:0/369252969 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe47815e5f0 0x7fe4780b3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.178+0000 7fe47659c700 1 -- 172.21.15.146:0/369252969 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe460009420 con 0x7fe4780c7810 2023-10-06T11:09:17.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.178+0000 7fe47659c700 1 --2- 172.21.15.146:0/369252969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4780c7810 0x7fe4780b5910 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fe46800c7c0 tx=0x7fe468007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:17.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.178+0000 7fe46effd700 1 -- 172.21.15.146:0/369252969 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe468001530 con 0x7fe4780c7810 2023-10-06T11:09:17.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.178+0000 7fe46effd700 1 -- 172.21.15.146:0/369252969 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4680016b0 con 0x7fe4780c7810 2023-10-06T11:09:17.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.178+0000 7fe47c91e700 1 -- 172.21.15.146:0/369252969 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4780c49c0 con 0x7fe4780c7810 2023-10-06T11:09:17.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.178+0000 7fe46effd700 1 -- 172.21.15.146:0/369252969 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe468001a70 con 0x7fe4780c7810 2023-10-06T11:09:17.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.178+0000 7fe47c91e700 1 -- 172.21.15.146:0/369252969 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4780b5e50 con 0x7fe4780c7810 2023-10-06T11:09:17.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.180+0000 7fe46effd700 1 -- 172.21.15.146:0/369252969 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe46801b3b0 con 0x7fe4780c7810 2023-10-06T11:09:17.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.180+0000 7fe46effd700 1 --2- 172.21.15.146:0/369252969 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe458066f30 0x7fe4580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.180+0000 7fe46effd700 1 -- 172.21.15.146:0/369252969 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe468083ef0 con 0x7fe4780c7810 2023-10-06T11:09:17.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.180+0000 7fe46dd9b700 1 --2- 172.21.15.146:0/369252969 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe458066f30 0x7fe4580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.181+0000 7fe46dd9b700 1 --2- 172.21.15.146:0/369252969 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe458066f30 0x7fe4580693e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe4600093f0 tx=0x7fe460016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:17.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.182+0000 7fe485c16b80 1 Processor -- start 2023-10-06T11:09:17.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.182+0000 7fe485c16b80 1 -- start start 2023-10-06T11:09:17.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.183+0000 7fe485c16b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f85985eaf0 0x55f85985eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.183+0000 7fe485c16b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f85981aa00 0x55f8598175e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.183+0000 7fe485c16b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f859818c30 0x55f859817b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.183+0000 7fe485c16b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f859797ce0 con 0x55f85981aa00 2023-10-06T11:09:17.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.183+0000 7fe485c16b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f85976ead0 con 0x55f859818c30 2023-10-06T11:09:17.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.183+0000 7fe485c16b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f85976c2d0 con 0x55f85985eaf0 2023-10-06T11:09:17.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.183+0000 7fe46dd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f85981aa00 0x55f8598175e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.183+0000 7fe46dd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f85981aa00 0x55f8598175e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53806/0 (socket says 172.21.15.146:53806) 2023-10-06T11:09:17.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.183+0000 7fe46dd9b700 1 -- 172.21.15.146:0/2609229285 learned_addr learned my addr 172.21.15.146:0/2609229285 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:17.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.183+0000 7fe476d9d700 1 --2- 172.21.15.146:0/2609229285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f859818c30 0x55f859817b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.183+0000 7fe47659c700 1 --2- 172.21.15.146:0/2609229285 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f85985eaf0 0x55f85985eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.184+0000 7fe46dd9b700 1 -- 172.21.15.146:0/2609229285 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f85985eaf0 msgr2=0x55f85985eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:17.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.184+0000 7fe46dd9b700 1 --2- 172.21.15.146:0/2609229285 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f85985eaf0 0x55f85985eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.184+0000 7fe46dd9b700 1 -- 172.21.15.146:0/2609229285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f859818c30 msgr2=0x55f859817b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:17.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.184+0000 7fe46dd9b700 1 --2- 172.21.15.146:0/2609229285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f859818c30 0x55f859817b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.184+0000 7fe46dd9b700 1 -- 172.21.15.146:0/2609229285 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8596022d0 con 0x55f85981aa00 2023-10-06T11:09:17.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.184+0000 7fe476d9d700 1 --2- 172.21.15.146:0/2609229285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f859818c30 0x55f859817b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:09:17.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.184+0000 7fe46dd9b700 1 --2- 172.21.15.146:0/2609229285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f85981aa00 0x55f8598175e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fe460009ed0 tx=0x7fe460022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29270f4ae21e7a31 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:17.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.184+0000 7fe4577fe700 1 -- 172.21.15.146:0/2609229285 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe460022070 con 0x55f85981aa00 2023-10-06T11:09:17.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.184+0000 7fe4577fe700 1 -- 172.21.15.146:0/2609229285 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46001c5a0 con 0x55f85981aa00 2023-10-06T11:09:17.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.184+0000 7fe4577fe700 1 -- 172.21.15.146:0/2609229285 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46001c750 con 0x55f85981aa00 2023-10-06T11:09:17.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.185+0000 7fe485c16b80 1 -- 172.21.15.146:0/2609229285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f85981aa00 msgr2=0x55f8598175e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:17.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.185+0000 7fe485c16b80 1 --2- 172.21.15.146:0/2609229285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f85981aa00 0x55f8598175e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fe460009ed0 tx=0x7fe460022000 comp rx=0 tx=0).stop 2023-10-06T11:09:17.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.185+0000 7fe485c16b80 1 -- 172.21.15.146:0/2609229285 shutdown_connections 2023-10-06T11:09:17.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.185+0000 7fe485c16b80 1 --2- 172.21.15.146:0/2609229285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f859818c30 0x55f859817b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.185+0000 7fe485c16b80 1 --2- 172.21.15.146:0/2609229285 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f85985eaf0 0x55f85985eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.185+0000 7fe485c16b80 1 --2- 172.21.15.146:0/2609229285 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f85981aa00 0x55f8598175e0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.185+0000 7fe485c16b80 1 -- 172.21.15.146:0/2609229285 >> 172.21.15.146:0/2609229285 conn(0x55f8598190d0 msgr2=0x55f8598194a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:17.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.185+0000 7fe485c16b80 1 -- 172.21.15.146:0/2609229285 shutdown_connections 2023-10-06T11:09:17.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.185+0000 7fe485c16b80 1 -- 172.21.15.146:0/2609229285 wait complete. 2023-10-06T11:09:17.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.185+0000 7fe485c16b80 1 -- start start 2023-10-06T11:09:17.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.185+0000 7fe485c16b80 1 Processor -- start 2023-10-06T11:09:17.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.186+0000 7fe485c16b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f859818c30 0x55f859861eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.186+0000 7fe485c16b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f85981aa00 0x55f8598175e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.186+0000 7fe485c16b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f85985eaf0 0x55f859817b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.186+0000 7fe485c16b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8597680c0 con 0x55f85981aa00 2023-10-06T11:09:17.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.186+0000 7fe485c16b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8597138f0 con 0x55f85985eaf0 2023-10-06T11:09:17.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.186+0000 7fe485c16b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f85972ef00 con 0x55f859818c30 2023-10-06T11:09:17.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.186+0000 7fe485c16b80 10 client.0 _ll_register_callbacks cb 0x55f859604f90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:09:17.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.186+0000 7fe46dd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f85981aa00 0x55f8598175e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.186+0000 7fe46dd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f85981aa00 0x55f8598175e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53822/0 (socket says 172.21.15.146:53822) 2023-10-06T11:09:17.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.186+0000 7fe46dd9b700 1 -- 172.21.15.146:0/609679044 learned_addr learned my addr 172.21.15.146:0/609679044 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:17.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.187+0000 7fe476d9d700 1 --2- 172.21.15.146:0/609679044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f85985eaf0 0x55f859817b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.187+0000 7fe47659c700 1 --2- 172.21.15.146:0/609679044 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f859818c30 0x55f859861eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.187+0000 7fe46dd9b700 1 -- 172.21.15.146:0/609679044 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f859818c30 msgr2=0x55f859861eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:17.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.187+0000 7fe46dd9b700 1 --2- 172.21.15.146:0/609679044 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f859818c30 0x55f859861eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.187+0000 7fe46dd9b700 1 -- 172.21.15.146:0/609679044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f85985eaf0 msgr2=0x55f859817b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:17.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.187+0000 7fe46dd9b700 1 --2- 172.21.15.146:0/609679044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f85985eaf0 0x55f859817b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.187+0000 7fe46dd9b700 1 -- 172.21.15.146:0/609679044 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe470004e10 con 0x55f85981aa00 2023-10-06T11:09:17.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.187+0000 7fe476d9d700 1 --2- 172.21.15.146:0/609679044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f85985eaf0 0x55f859817b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:09:17.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.187+0000 7fe46dd9b700 1 --2- 172.21.15.146:0/609679044 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f85981aa00 0x55f8598175e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fe460003010 tx=0x7fe46002c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e556ae37a63b107 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:17.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.187+0000 7fe454ff9700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:09:17.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.187+0000 7fe454ff9700 1 -- 172.21.15.146:0/609679044 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe460022040 con 0x55f85981aa00 2023-10-06T11:09:17.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.187+0000 7fe454ff9700 1 -- 172.21.15.146:0/609679044 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe46003ec10 con 0x55f85981aa00 2023-10-06T11:09:17.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.187+0000 7fe485c16b80 1 -- 172.21.15.146:0/609679044 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f85980c6f0 con 0x55f85981aa00 2023-10-06T11:09:17.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.187+0000 7fe454ff9700 1 -- 172.21.15.146:0/609679044 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe460033760 con 0x55f85981aa00 2023-10-06T11:09:17.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.187+0000 7fe485c16b80 10 client.5988 fetch_fsmap learned FSMap version 37 2023-10-06T11:09:17.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.187+0000 7fe485c16b80 1 -- 172.21.15.146:0/609679044 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x7fe47806f990 con 0x55f85981aa00 2023-10-06T11:09:17.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.187+0000 7fe454ff9700 1 -- 172.21.15.146:0/609679044 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f85980c6f0 con 0x55f85981aa00 2023-10-06T11:09:17.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.187+0000 7fe454ff9700 1 -- 172.21.15.146:0/609679044 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 37) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fe4600338c0 con 0x55f85981aa00 2023-10-06T11:09:17.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.187+0000 7fe485c16b80 10 client.5988 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T11:09:17.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.187+0000 7fe485c16b80 10 client.5988 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-10-06T11:09:17.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.187+0000 7fe485c16b80 20 client.5988 populate_metadata read hostname 'smithi146' 2023-10-06T11:09:17.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.187+0000 7fe485c16b80 1 --2- 172.21.15.146:0/609679044 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55f8598444a0 0x55f85983cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.187+0000 7fe485c16b80 4 client.5988 mds_command: new command op to 5481 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:09:17.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.187+0000 7fe485c16b80 1 -- 172.21.15.146:0/609679044 --> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f8597e9620 con 0x55f8598444a0 2023-10-06T11:09:17.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.188+0000 7fe47659c700 1 --2- 172.21.15.146:0/609679044 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55f8598444a0 0x55f85983cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.188+0000 7fe454ff9700 10 client.5988 ms_handle_connect on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:17.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.188+0000 7fe47659c700 1 --2- 172.21.15.146:0/609679044 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55f8598444a0 0x55f85983cef0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f031c978e8973ff server_cookie=e404de6ae73c864f in_seq=0 out_seq=0 2023-10-06T11:09:17.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.188+0000 7fe454ff9700 1 -- 172.21.15.146:0/609679044 <== mds.0 v2:172.21.15.146:6835/2252184844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55f8597e9620 con 0x55f8598444a0 2023-10-06T11:09:17.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.188+0000 7fe454ff9700 10 client.5988 handle_command_reply: tid=0 2023-10-06T11:09:17.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.188+0000 7fe485c16b80 1 client.5988 shutdown 2023-10-06T11:09:17.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.189+0000 7fe485c16b80 1 -- 172.21.15.146:0/609679044 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f85981aa00 msgr2=0x55f8598175e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:17.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.189+0000 7fe485c16b80 1 --2- 172.21.15.146:0/609679044 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f85981aa00 0x55f8598175e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fe460003010 tx=0x7fe46002c040 comp rx=0 tx=0).stop 2023-10-06T11:09:17.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.189+0000 7fe485c16b80 1 -- 172.21.15.146:0/609679044 shutdown_connections 2023-10-06T11:09:17.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.189+0000 7fe485c16b80 1 --2- 172.21.15.146:0/609679044 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55f8598444a0 0x55f85983cef0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.189+0000 7fe485c16b80 1 --2- 172.21.15.146:0/609679044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f85985eaf0 0x55f859817b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.189+0000 7fe485c16b80 1 --2- 172.21.15.146:0/609679044 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f859818c30 0x55f859861eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.189+0000 7fe454ff9700 0 client.5988 ms_handle_reset on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:17.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.189+0000 7fe485c16b80 1 --2- 172.21.15.146:0/609679044 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f85981aa00 0x55f8598175e0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.189+0000 7fe485c16b80 1 -- 172.21.15.146:0/609679044 >> 172.21.15.146:0/609679044 conn(0x55f8598190d0 msgr2=0x55f859814690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:17.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.189+0000 7fe485c16b80 1 -- 172.21.15.146:0/609679044 shutdown_connections 2023-10-06T11:09:17.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.189+0000 7fe485c16b80 1 -- 172.21.15.146:0/609679044 wait complete. 2023-10-06T11:09:17.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.189+0000 7fe485c16b80 20 client.5988 trim_cache size 0 max 16384 2023-10-06T11:09:17.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.205+0000 7fe485c16b80 1 Processor -- start 2023-10-06T11:09:17.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.205+0000 7fe485c16b80 1 -- start start 2023-10-06T11:09:17.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.206+0000 7fe485c16b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f859818c30 0x55f859861eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.206+0000 7fe485c16b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f85981aa00 0x55f859813b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.206+0000 7fe485c16b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f85985eaf0 0x55f859857a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.206+0000 7fe485c16b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8595eae90 con 0x55f85981aa00 2023-10-06T11:09:17.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.206+0000 7fe485c16b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f859847850 con 0x55f859818c30 2023-10-06T11:09:17.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.206+0000 7fe485c16b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f85985f680 con 0x55f85985eaf0 2023-10-06T11:09:17.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.206+0000 7fe46dd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f85981aa00 0x55f859813b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.206+0000 7fe46dd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f85981aa00 0x55f859813b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53830/0 (socket says 172.21.15.146:53830) 2023-10-06T11:09:17.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.206+0000 7fe46dd9b700 1 -- 172.21.15.146:0/1405121425 learned_addr learned my addr 172.21.15.146:0/1405121425 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:17.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.206+0000 7fe47659c700 1 --2- 172.21.15.146:0/1405121425 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f859818c30 0x55f859861eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.206+0000 7fe476d9d700 1 --2- 172.21.15.146:0/1405121425 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f85985eaf0 0x55f859857a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.206+0000 7fe46dd9b700 1 -- 172.21.15.146:0/1405121425 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f85985eaf0 msgr2=0x55f859857a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:17.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.206+0000 7fe46dd9b700 1 --2- 172.21.15.146:0/1405121425 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f85985eaf0 0x55f859857a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.206+0000 7fe46dd9b700 1 -- 172.21.15.146:0/1405121425 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f859818c30 msgr2=0x55f859861eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:17.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.206+0000 7fe46dd9b700 1 --2- 172.21.15.146:0/1405121425 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f859818c30 0x55f859861eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.206+0000 7fe46dd9b700 1 -- 172.21.15.146:0/1405121425 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8595a5040 con 0x55f85981aa00 2023-10-06T11:09:17.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.206+0000 7fe46dd9b700 1 --2- 172.21.15.146:0/1405121425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f85981aa00 0x55f859813b40 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fe460003080 tx=0x7fe460034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27bdf95ab3840fb9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:17.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.206+0000 7fe457fff700 1 -- 172.21.15.146:0/1405121425 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe460022070 con 0x55f85981aa00 2023-10-06T11:09:17.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.206+0000 7fe457fff700 1 -- 172.21.15.146:0/1405121425 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe460033dd0 con 0x55f85981aa00 2023-10-06T11:09:17.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.206+0000 7fe457fff700 1 -- 172.21.15.146:0/1405121425 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe460033760 con 0x55f85981aa00 2023-10-06T11:09:17.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.207+0000 7fe485c16b80 1 -- 172.21.15.146:0/1405121425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f85981aa00 msgr2=0x55f859813b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:17.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.207+0000 7fe485c16b80 1 --2- 172.21.15.146:0/1405121425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f85981aa00 0x55f859813b40 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fe460003080 tx=0x7fe460034000 comp rx=0 tx=0).stop 2023-10-06T11:09:17.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.207+0000 7fe485c16b80 1 -- 172.21.15.146:0/1405121425 shutdown_connections 2023-10-06T11:09:17.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.207+0000 7fe485c16b80 1 --2- 172.21.15.146:0/1405121425 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f85985eaf0 0x55f859857a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.207+0000 7fe485c16b80 1 --2- 172.21.15.146:0/1405121425 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f859818c30 0x55f859861eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.207+0000 7fe485c16b80 1 --2- 172.21.15.146:0/1405121425 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f85981aa00 0x55f859813b40 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.207+0000 7fe485c16b80 1 -- 172.21.15.146:0/1405121425 >> 172.21.15.146:0/1405121425 conn(0x55f8598190d0 msgr2=0x55f85985d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:17.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.207+0000 7fe485c16b80 1 -- 172.21.15.146:0/1405121425 shutdown_connections 2023-10-06T11:09:17.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.207+0000 7fe485c16b80 1 -- 172.21.15.146:0/1405121425 wait complete. 2023-10-06T11:09:17.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.207+0000 7fe485c16b80 1 -- start start 2023-10-06T11:09:17.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.207+0000 7fe485c16b80 1 Processor -- start 2023-10-06T11:09:17.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.208+0000 7fe485c16b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f859818c30 0x55f8598bda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.208+0000 7fe485c16b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f85981aa00 0x55f8598ac4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.208+0000 7fe485c16b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f85985eaf0 0x55f8598180f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.208+0000 7fe485c16b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8598c4490 con 0x55f859818c30 2023-10-06T11:09:17.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.208+0000 7fe485c16b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f85983e360 con 0x55f85981aa00 2023-10-06T11:09:17.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.208+0000 7fe485c16b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f859842090 con 0x55f85985eaf0 2023-10-06T11:09:17.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.208+0000 7fe485c16b80 10 client.0 _ll_register_callbacks cb 0x55f859604f90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:09:17.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.208+0000 7fe47659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f859818c30 0x55f8598bda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.208+0000 7fe47659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f859818c30 0x55f8598bda20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53836/0 (socket says 172.21.15.146:53836) 2023-10-06T11:09:17.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.208+0000 7fe47659c700 1 -- 172.21.15.146:0/1179094311 learned_addr learned my addr 172.21.15.146:0/1179094311 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:17.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.209+0000 7fe46dd9b700 1 --2- 172.21.15.146:0/1179094311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f85981aa00 0x55f8598ac4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.209+0000 7fe476d9d700 1 --2- 172.21.15.146:0/1179094311 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f85985eaf0 0x55f8598180f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.209+0000 7fe47659c700 1 -- 172.21.15.146:0/1179094311 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f85985eaf0 msgr2=0x55f8598180f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:17.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.209+0000 7fe47659c700 1 --2- 172.21.15.146:0/1179094311 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f85985eaf0 0x55f8598180f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.209+0000 7fe47659c700 1 -- 172.21.15.146:0/1179094311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f85981aa00 msgr2=0x55f8598ac4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:17.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.209+0000 7fe47659c700 1 --2- 172.21.15.146:0/1179094311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f85981aa00 0x55f8598ac4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.209+0000 7fe47659c700 1 -- 172.21.15.146:0/1179094311 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe47806f990 con 0x55f859818c30 2023-10-06T11:09:17.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.209+0000 7fe47659c700 1 --2- 172.21.15.146:0/1179094311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f859818c30 0x55f8598bda20 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fe46800c790 tx=0x7fe468014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7359e4fc582b250e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:17.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.209+0000 7fe454ff9700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:09:17.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.209+0000 7fe454ff9700 1 -- 172.21.15.146:0/1179094311 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe468080070 con 0x55f859818c30 2023-10-06T11:09:17.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.209+0000 7fe454ff9700 1 -- 172.21.15.146:0/1179094311 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe46805bc60 con 0x55f859818c30 2023-10-06T11:09:17.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.209+0000 7fe485c16b80 1 -- 172.21.15.146:0/1179094311 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe46001c5a0 con 0x55f859818c30 2023-10-06T11:09:17.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.209+0000 7fe454ff9700 1 -- 172.21.15.146:0/1179094311 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe468053060 con 0x55f859818c30 2023-10-06T11:09:17.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.209+0000 7fe485c16b80 10 client.5994 fetch_fsmap learned FSMap version 37 2023-10-06T11:09:17.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.209+0000 7fe485c16b80 1 -- 172.21.15.146:0/1179094311 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x55f8597367e0 con 0x55f859818c30 2023-10-06T11:09:17.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.209+0000 7fe454ff9700 1 -- 172.21.15.146:0/1179094311 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46001c5a0 con 0x55f859818c30 2023-10-06T11:09:17.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.209+0000 7fe454ff9700 1 -- 172.21.15.146:0/1179094311 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 37) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fe46805b7d0 con 0x55f859818c30 2023-10-06T11:09:17.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.209+0000 7fe485c16b80 10 client.5994 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T11:09:17.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.209+0000 7fe485c16b80 10 client.5994 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-10-06T11:09:17.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.209+0000 7fe485c16b80 20 client.5994 populate_metadata read hostname 'smithi146' 2023-10-06T11:09:17.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.209+0000 7fe485c16b80 1 --2- 172.21.15.146:0/1179094311 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55f859818630 0x55f8598c33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.209+0000 7fe485c16b80 4 client.5994 mds_command: new command op to 5481 tid=0[{"prefix": "scrub start", "path": "/"}] 2023-10-06T11:09:17.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.209+0000 7fe485c16b80 1 -- 172.21.15.146:0/1179094311 --> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] -- command(tid 0: {"prefix": "scrub start", "path": "/"}) v1 -- 0x55f85970ae60 con 0x55f859818630 2023-10-06T11:09:17.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.209+0000 7fe46dd9b700 1 --2- 172.21.15.146:0/1179094311 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55f859818630 0x55f8598c33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.210+0000 7fe454ff9700 10 client.5994 ms_handle_connect on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:17.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.210+0000 7fe46dd9b700 1 --2- 172.21.15.146:0/1179094311 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55f859818630 0x55f8598c33f0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=759b69da0618e7e5 server_cookie=7beea6a0f24254e8 in_seq=0 out_seq=0 2023-10-06T11:09:17.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.210+0000 7fe454ff9700 1 -- 172.21.15.146:0/1179094311 <== mds.0 v2:172.21.15.146:6835/2252184844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55f85970ae60 con 0x55f859818630 2023-10-06T11:09:17.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.210+0000 7fe454ff9700 10 client.5994 handle_command_reply: tid=0 2023-10-06T11:09:17.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.210+0000 7fe485c16b80 1 client.5994 shutdown 2023-10-06T11:09:17.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.210+0000 7fe485c16b80 1 -- 172.21.15.146:0/1179094311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f859818c30 msgr2=0x55f8598bda20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:17.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.210+0000 7fe485c16b80 1 --2- 172.21.15.146:0/1179094311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f859818c30 0x55f8598bda20 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fe46800c790 tx=0x7fe468014040 comp rx=0 tx=0).stop 2023-10-06T11:09:17.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.210+0000 7fe485c16b80 1 -- 172.21.15.146:0/1179094311 shutdown_connections 2023-10-06T11:09:17.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.210+0000 7fe485c16b80 1 --2- 172.21.15.146:0/1179094311 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55f859818630 0x55f8598c33f0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.210+0000 7fe485c16b80 1 --2- 172.21.15.146:0/1179094311 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f85985eaf0 0x55f8598180f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.210+0000 7fe485c16b80 1 --2- 172.21.15.146:0/1179094311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f859818c30 0x55f8598bda20 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.210+0000 7fe485c16b80 1 --2- 172.21.15.146:0/1179094311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f85981aa00 0x55f8598ac4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.210+0000 7fe454ff9700 0 client.5994 ms_handle_reset on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:17.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.210+0000 7fe485c16b80 1 -- 172.21.15.146:0/1179094311 >> 172.21.15.146:0/1179094311 conn(0x55f8598190d0 msgr2=0x55f85985d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:17.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.211+0000 7fe485c16b80 1 -- 172.21.15.146:0/1179094311 shutdown_connections 2023-10-06T11:09:17.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.211+0000 7fe485c16b80 1 -- 172.21.15.146:0/1179094311 wait complete. 2023-10-06T11:09:17.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.211+0000 7fe485c16b80 20 client.5994 trim_cache size 0 max 16384 2023-10-06T11:09:17.220 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:09:17.220 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0, 2023-10-06T11:09:17.220 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_tag": "7358d033-1042-4448-8553-f766a5d95d93", 2023-10-06T11:09:17.220 INFO:teuthology.orchestra.run.smithi146.stdout: "mode": "asynchronous" 2023-10-06T11:09:17.220 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:09:17.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.211+0000 7fe47c91e700 1 -- 172.21.15.146:0/369252969 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe458066f30 msgr2=0x7fe4580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:17.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.211+0000 7fe47c91e700 1 --2- 172.21.15.146:0/369252969 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe458066f30 0x7fe4580693e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe4600093f0 tx=0x7fe460016000 comp rx=0 tx=0).stop 2023-10-06T11:09:17.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.211+0000 7fe47c91e700 1 -- 172.21.15.146:0/369252969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4780c7810 msgr2=0x7fe4780b5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:17.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.211+0000 7fe47c91e700 1 --2- 172.21.15.146:0/369252969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4780c7810 0x7fe4780b5910 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fe46800c7c0 tx=0x7fe468007e00 comp rx=0 tx=0).stop 2023-10-06T11:09:17.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.211+0000 7fe47c91e700 1 -- 172.21.15.146:0/369252969 shutdown_connections 2023-10-06T11:09:17.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.211+0000 7fe47c91e700 1 --2- 172.21.15.146:0/369252969 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe458066f30 0x7fe4580693e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.211+0000 7fe47c91e700 1 --2- 172.21.15.146:0/369252969 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe47815e5f0 0x7fe4780b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.211+0000 7fe47c91e700 1 --2- 172.21.15.146:0/369252969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe4780c7810 0x7fe4780b5910 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.211+0000 7fe47c91e700 1 --2- 172.21.15.146:0/369252969 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe478159f40 0x7fe47809b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.211+0000 7fe47c91e700 1 -- 172.21.15.146:0/369252969 >> 172.21.15.146:0/369252969 conn(0x7fe47806f380 msgr2=0x7fe4780b2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:17.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.211+0000 7fe47c91e700 1 -- 172.21.15.146:0/369252969 shutdown_connections 2023-10-06T11:09:17.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.211+0000 7fe47c91e700 1 -- 172.21.15.146:0/369252969 wait complete. 2023-10-06T11:09:17.224 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /' returned '{'return_code': 0, 'scrub_tag': '7358d033-1042-4448-8553-f766a5d95d93', 'mode': 'asynchronous'}' 2023-10-06T11:09:17.225 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:09:17.225 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_dir_1) 2023-10-06T11:09:17.242 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_1' 2023-10-06T11:09:17.242 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:09:17.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.407+0000 7fab329c4700 1 Processor -- start 2023-10-06T11:09:17.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.407+0000 7fab329c4700 1 -- start start 2023-10-06T11:09:17.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.408+0000 7fab329c4700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fab2c067b80 0x7fab2c0b1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.408+0000 7fab329c4700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab2c15a270 con 0x7fab2c0b0bd0 2023-10-06T11:09:17.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.408+0000 7fab329c4700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab2c15a550 con 0x7fab2c153e00 2023-10-06T11:09:17.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.408+0000 7fab329c4700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab2c15a830 con 0x7fab2c067b80 2023-10-06T11:09:17.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.408+0000 7fab2b7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fab2c0b0bd0 0x7fab2c067470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50932/0 (socket says 172.21.15.146:50932) 2023-10-06T11:09:17.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.408+0000 7fab2b7fe700 1 -- 172.21.15.146:0/2291184177 learned_addr learned my addr 172.21.15.146:0/2291184177 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:17.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.408+0000 7fab30f61700 1 --2- 172.21.15.146:0/2291184177 >> v2:172.21.15.151:3300/0 conn(0x7fab2c067b80 0x7fab2c0b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.408+0000 7fab2affd700 1 -- 172.21.15.146:0/2291184177 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2004013208 0 0) 0x7fab2c15a270 con 0x7fab2c0b0bd0 2023-10-06T11:09:17.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.408+0000 7fab2affd700 1 -- 172.21.15.146:0/2291184177 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab14003570 con 0x7fab2c0b0bd0 2023-10-06T11:09:17.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.409+0000 7fab2affd700 1 -- 172.21.15.146:0/2291184177 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 746002532 0 0) 0x7fab14003570 con 0x7fab2c0b0bd0 2023-10-06T11:09:17.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.409+0000 7fab2affd700 1 -- 172.21.15.146:0/2291184177 >> v2:172.21.15.151:3300/0 conn(0x7fab2c067b80 msgr2=0x7fab2c0b1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:17.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.409+0000 7fab2affd700 1 --2- 172.21.15.146:0/2291184177 >> v2:172.21.15.151:3300/0 conn(0x7fab2c067b80 0x7fab2c0b1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.409+0000 7fab2affd700 1 -- 172.21.15.146:0/2291184177 >> v1:172.21.15.151:6789/0 conn(0x7fab2c153e00 legacy=0x7fab2c06b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:17.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.409+0000 7fab2affd700 1 -- 172.21.15.146:0/2291184177 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab2c15ab10 con 0x7fab2c0b0bd0 2023-10-06T11:09:17.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.409+0000 7fab2affd700 1 -- 172.21.15.146:0/2291184177 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fab200015f0 con 0x7fab2c0b0bd0 2023-10-06T11:09:17.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.409+0000 7fab30f61700 1 --2- 172.21.15.146:0/2291184177 >> v2:172.21.15.151:3300/0 conn(0x7fab2c067b80 0x7fab2c0b1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:09:17.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.409+0000 7fab2affd700 1 -- 172.21.15.146:0/2291184177 >> v1:172.21.15.146:6789/0 conn(0x7fab2c0b0bd0 legacy=0x7fab2c067470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:17.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.409+0000 7fab2affd700 1 --2- 172.21.15.146:0/2291184177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab14003a60 0x7fab14003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.409+0000 7fab2affd700 1 --2- 172.21.15.146:0/2291184177 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fab14004810 0x7fab14004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.409+0000 7fab2affd700 1 --2- 172.21.15.146:0/2291184177 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab140051c0 0x7fab1400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.409+0000 7fab2affd700 1 -- 172.21.15.146:0/2291184177 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab2c15a830 con 0x7fab14003a60 2023-10-06T11:09:17.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.409+0000 7fab2affd700 1 -- 172.21.15.146:0/2291184177 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab1400c160 con 0x7fab140051c0 2023-10-06T11:09:17.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.409+0000 7fab2affd700 1 -- 172.21.15.146:0/2291184177 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab1400c320 con 0x7fab14004810 2023-10-06T11:09:17.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.409+0000 7fab2bfff700 1 --2- 172.21.15.146:0/2291184177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab14003a60 0x7fab14003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.409+0000 7fab30f61700 1 --2- 172.21.15.146:0/2291184177 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab140051c0 0x7fab1400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.409+0000 7fab2b7fe700 1 --2- 172.21.15.146:0/2291184177 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fab14004810 0x7fab14004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.409+0000 7fab2bfff700 1 -- 172.21.15.146:0/2291184177 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fab14004810 msgr2=0x7fab14004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:17.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.409+0000 7fab2bfff700 1 --2- 172.21.15.146:0/2291184177 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fab14004810 0x7fab14004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.409+0000 7fab2bfff700 1 -- 172.21.15.146:0/2291184177 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab140051c0 msgr2=0x7fab1400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:17.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.409+0000 7fab2bfff700 1 --2- 172.21.15.146:0/2291184177 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab140051c0 0x7fab1400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.409+0000 7fab30f61700 1 -- 172.21.15.146:0/2291184177 reap_dead start 2023-10-06T11:09:17.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.409+0000 7fab2bfff700 1 -- 172.21.15.146:0/2291184177 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab14003570 con 0x7fab14003a60 2023-10-06T11:09:17.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.409+0000 7fab2b7fe700 1 --2- 172.21.15.146:0/2291184177 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fab14004810 0x7fab14004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:17.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.409+0000 7fab2bfff700 1 --2- 172.21.15.146:0/2291184177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab14003a60 0x7fab14003e70 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fab1c0018e0 tx=0x7fab1c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d292501ebd4e6e72 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:17.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.409+0000 7fab2affd700 1 -- 172.21.15.146:0/2291184177 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1c012420 con 0x7fab14003a60 2023-10-06T11:09:17.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.409+0000 7fab2affd700 1 -- 172.21.15.146:0/2291184177 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab1c0125a0 con 0x7fab14003a60 2023-10-06T11:09:17.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.409+0000 7fab2affd700 1 -- 172.21.15.146:0/2291184177 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1c012960 con 0x7fab14003a60 2023-10-06T11:09:17.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.410+0000 7fab329c4700 1 -- 172.21.15.146:0/2291184177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab14003a60 msgr2=0x7fab14003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:17.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.410+0000 7fab329c4700 1 --2- 172.21.15.146:0/2291184177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab14003a60 0x7fab14003e70 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fab1c0018e0 tx=0x7fab1c007d30 comp rx=0 tx=0).stop 2023-10-06T11:09:17.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.410+0000 7fab329c4700 1 -- 172.21.15.146:0/2291184177 shutdown_connections 2023-10-06T11:09:17.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.410+0000 7fab329c4700 1 --2- 172.21.15.146:0/2291184177 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab14003a60 0x7fab14003e70 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.410+0000 7fab329c4700 1 -- 172.21.15.146:0/2291184177 >> 172.21.15.146:0/2291184177 conn(0x7fab2c06b060 msgr2=0x7fab2c0aecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:17.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.410+0000 7fab329c4700 1 -- 172.21.15.146:0/2291184177 shutdown_connections 2023-10-06T11:09:17.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.410+0000 7fab329c4700 1 -- 172.21.15.146:0/2291184177 wait complete. 2023-10-06T11:09:17.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.411+0000 7fab329c4700 1 Processor -- start 2023-10-06T11:09:17.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.411+0000 7fab329c4700 1 -- start start 2023-10-06T11:09:17.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.412+0000 7fab329c4700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fab14003a60 0x7fab2c0ac4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.412+0000 7fab329c4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab2c0aacc0 0x7fab2c1558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.412+0000 7fab329c4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab2c151230 0x7fab2c157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.412+0000 7fab329c4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab2c155de0 con 0x7fab2c151230 2023-10-06T11:09:17.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.412+0000 7fab329c4700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab2c0ac020 con 0x7fab2c0aacc0 2023-10-06T11:09:17.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.412+0000 7fab329c4700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab2c0ab410 con 0x7fab14003a60 2023-10-06T11:09:17.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.412+0000 7fab30f61700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab2c151230 0x7fab2c157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.412+0000 7fab30f61700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab2c151230 0x7fab2c157d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53850/0 (socket says 172.21.15.146:53850) 2023-10-06T11:09:17.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.412+0000 7fab30f61700 1 -- 172.21.15.146:0/1485570192 learned_addr learned my addr 172.21.15.146:0/1485570192 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:17.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.412+0000 7fab2b7fe700 1 --2- 172.21.15.146:0/1485570192 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab2c0aacc0 0x7fab2c1558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.412+0000 7fab2bfff700 1 --2- 172.21.15.146:0/1485570192 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fab14003a60 0x7fab2c0ac4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.412+0000 7fab30f61700 1 -- 172.21.15.146:0/1485570192 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fab14003a60 msgr2=0x7fab2c0ac4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:17.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.412+0000 7fab30f61700 1 --2- 172.21.15.146:0/1485570192 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fab14003a60 0x7fab2c0ac4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.413+0000 7fab30f61700 1 -- 172.21.15.146:0/1485570192 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab2c0aacc0 msgr2=0x7fab2c1558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:17.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.413+0000 7fab30f61700 1 --2- 172.21.15.146:0/1485570192 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab2c0aacc0 0x7fab2c1558a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.413+0000 7fab30f61700 1 -- 172.21.15.146:0/1485570192 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab2c0ab6f0 con 0x7fab2c151230 2023-10-06T11:09:17.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.413+0000 7fab30f61700 1 --2- 172.21.15.146:0/1485570192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab2c151230 0x7fab2c157d90 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fab2c067f80 tx=0x7fab2400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:17.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.413+0000 7fab13fff700 1 -- 172.21.15.146:0/1485570192 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2400e040 con 0x7fab2c151230 2023-10-06T11:09:17.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.413+0000 7fab13fff700 1 -- 172.21.15.146:0/1485570192 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab2400f040 con 0x7fab2c151230 2023-10-06T11:09:17.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.413+0000 7fab13fff700 1 -- 172.21.15.146:0/1485570192 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab24015430 con 0x7fab2c151230 2023-10-06T11:09:17.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.413+0000 7fab329c4700 1 -- 172.21.15.146:0/1485570192 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab2c0ab9d0 con 0x7fab2c151230 2023-10-06T11:09:17.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.413+0000 7fab329c4700 1 -- 172.21.15.146:0/1485570192 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab2c0ab130 con 0x7fab2c151230 2023-10-06T11:09:17.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.414+0000 7fab329c4700 1 -- 172.21.15.146:0/1485570192 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab2c0ac1b0 con 0x7fab2c151230 2023-10-06T11:09:17.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.414+0000 7fab13fff700 1 -- 172.21.15.146:0/1485570192 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fab24015800 con 0x7fab2c151230 2023-10-06T11:09:17.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.415+0000 7fab13fff700 1 --2- 172.21.15.146:0/1485570192 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fab18066f30 0x7fab180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.415+0000 7fab13fff700 1 -- 172.21.15.146:0/1485570192 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fab24085300 con 0x7fab2c151230 2023-10-06T11:09:17.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.415+0000 7fab2bfff700 1 --2- 172.21.15.146:0/1485570192 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fab18066f30 0x7fab180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.415+0000 7fab2bfff700 1 --2- 172.21.15.146:0/1485570192 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fab18066f30 0x7fab180693e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fab1c0016c0 tx=0x7fab1c015000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:17.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.419+0000 7fab13fff700 1 -- 172.21.15.146:0/1485570192 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fab24052410 con 0x7fab2c151230 2023-10-06T11:09:17.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.645+0000 7fab329c4700 1 -- 172.21.15.146:0/1485570192 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fab2c04c380 con 0x7fab2c151230 2023-10-06T11:09:17.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.646+0000 7fab13fff700 1 -- 172.21.15.146:0/1485570192 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4610 (secure 0 0 0) 0x7fab24055a30 con 0x7fab2c151230 2023-10-06T11:09:17.648 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:09:17.648 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":37,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5248,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3360977916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3360977916},{"type":"v1","addr":"172.21.15.151:6834","nonce":3360977916}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5251,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2265934004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":2265934004},{"type":"v1","addr":"172.21.15.151:6835","nonce":2265934004}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2387575667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2387575667},{"type":"v1","addr":"172.21.15.146:6836","nonce":2387575667}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:08:42.797557+0000","modified":"2023-10-06T11:09:16.328424+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5481":{"gid":5481,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":11,"addr":"172.21.15.146:6837/2252184844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2252184844},{"type":"v1","addr":"172.21.15.146:6837","nonce":2252184844}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T11:09:17.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.648+0000 7fab329c4700 1 -- 172.21.15.146:0/1485570192 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fab18066f30 msgr2=0x7fab180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:17.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.648+0000 7fab329c4700 1 --2- 172.21.15.146:0/1485570192 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fab18066f30 0x7fab180693e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fab1c0016c0 tx=0x7fab1c015000 comp rx=0 tx=0).stop 2023-10-06T11:09:17.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.648+0000 7fab329c4700 1 -- 172.21.15.146:0/1485570192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab2c151230 msgr2=0x7fab2c157d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:17.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.648+0000 7fab329c4700 1 --2- 172.21.15.146:0/1485570192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab2c151230 0x7fab2c157d90 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fab2c067f80 tx=0x7fab2400b040 comp rx=0 tx=0).stop 2023-10-06T11:09:17.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.648+0000 7fab329c4700 1 -- 172.21.15.146:0/1485570192 shutdown_connections 2023-10-06T11:09:17.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.648+0000 7fab329c4700 1 --2- 172.21.15.146:0/1485570192 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fab18066f30 0x7fab180693e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.648+0000 7fab329c4700 1 --2- 172.21.15.146:0/1485570192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab2c151230 0x7fab2c157d90 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.648+0000 7fab329c4700 1 --2- 172.21.15.146:0/1485570192 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fab14003a60 0x7fab2c0ac4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.648+0000 7fab329c4700 1 --2- 172.21.15.146:0/1485570192 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab2c0aacc0 0x7fab2c1558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.648+0000 7fab329c4700 1 -- 172.21.15.146:0/1485570192 >> 172.21.15.146:0/1485570192 conn(0x7fab2c06b060 msgr2=0x7fab2c06b960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:17.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.648+0000 7fab329c4700 1 -- 172.21.15.146:0/1485570192 shutdown_connections 2023-10-06T11:09:17.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.648+0000 7fab329c4700 1 -- 172.21.15.146:0/1485570192 wait complete. 2023-10-06T11:09:17.651 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 37 2023-10-06T11:09:17.662 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok flush_path /scrub_test_path/ceph-qa-suite/new_dir_1 2023-10-06T11:09:17.785 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:09:17.785 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0 2023-10-06T11:09:17.785 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:09:17.797 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_dir_1' got response code '0' and stdout '{ "return_code": 0 } ' 2023-10-06T11:09:17.797 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:09:17.797 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_1 bs=1M conv=fdatasync count=1 seek=0) 2023-10-06T11:09:17.829 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:09:17.829 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:09:17.829 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0139463 s, 75.2 MB/s 2023-10-06T11:09:17.829 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_1' 2023-10-06T11:09:17.829 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:09:17.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.981+0000 7f3dbdaf1700 1 Processor -- start 2023-10-06T11:09:17.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.981+0000 7f3dbdaf1700 1 -- start start 2023-10-06T11:09:17.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.982+0000 7f3dbdaf1700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3db81595d0 0x7f3db80a98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.982+0000 7f3dbdaf1700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3db80c70e0 0x7f3db806ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.982+0000 7f3dbdaf1700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3db80a9e10 con 0x7f3db81599a0 2023-10-06T11:09:17.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.982+0000 7f3dbdaf1700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3db80c7650 con 0x7f3db80c70e0 2023-10-06T11:09:17.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.982+0000 7f3dbdaf1700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3db80c7930 con 0x7f3db81595d0 2023-10-06T11:09:17.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.982+0000 7f3db6ffd700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3db80c70e0 0x7f3db806ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.983+0000 7f3db77fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3db81595d0 0x7f3db80a98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.983+0000 7f3db7fff700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f3db81599a0 0x7f3db8068480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:39508/0 (socket says 172.21.15.146:39508) 2023-10-06T11:09:17.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.983+0000 7f3db77fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3db81595d0 0x7f3db80a98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:46612/0 (socket says 172.21.15.146:46612) 2023-10-06T11:09:17.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.983+0000 7f3db6ffd700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3db80c70e0 0x7f3db806ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:55878/0 (socket says 172.21.15.146:55878) 2023-10-06T11:09:17.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.983+0000 7f3db77fe700 1 -- 172.21.15.146:0/2646100410 learned_addr learned my addr 172.21.15.146:0/2646100410 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:17.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.983+0000 7f3db6ffd700 1 -- 172.21.15.146:0/2646100410 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3db81595d0 msgr2=0x7f3db80a98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:17.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.983+0000 7f3db6ffd700 1 --2- 172.21.15.146:0/2646100410 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3db81595d0 0x7f3db80a98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.983+0000 7f3db6ffd700 1 -- 172.21.15.146:0/2646100410 >> v1:172.21.15.151:6789/0 conn(0x7f3db81599a0 legacy=0x7f3db8068480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:17.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.983+0000 7f3db6ffd700 1 -- 172.21.15.146:0/2646100410 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db80c7c10 con 0x7f3db80c70e0 2023-10-06T11:09:17.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.983+0000 7f3db77fe700 1 --2- 172.21.15.146:0/2646100410 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3db81595d0 0x7f3db80a98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:09:17.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.983+0000 7f3db6ffd700 1 --2- 172.21.15.146:0/2646100410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3db80c70e0 0x7f3db806ec10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3dac0098e0 tx=0x7f3dac0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19044141689fbcbf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:17.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.983+0000 7f3db67fc700 1 -- 172.21.15.146:0/2646100410 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dac00b640 con 0x7f3db80c70e0 2023-10-06T11:09:17.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.983+0000 7f3db67fc700 1 -- 172.21.15.146:0/2646100410 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dac00b7a0 con 0x7f3db80c70e0 2023-10-06T11:09:17.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.983+0000 7f3db67fc700 1 -- 172.21.15.146:0/2646100410 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dac00bb40 con 0x7f3db80c70e0 2023-10-06T11:09:17.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.984+0000 7f3dbdaf1700 1 -- 172.21.15.146:0/2646100410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3db80c70e0 msgr2=0x7f3db806ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:17.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.984+0000 7f3dbdaf1700 1 --2- 172.21.15.146:0/2646100410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3db80c70e0 0x7f3db806ec10 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3dac0098e0 tx=0x7f3dac0091a0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.984+0000 7f3dbdaf1700 1 -- 172.21.15.146:0/2646100410 shutdown_connections 2023-10-06T11:09:17.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.984+0000 7f3dbdaf1700 1 --2- 172.21.15.146:0/2646100410 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3db81595d0 0x7f3db80a98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.984+0000 7f3dbdaf1700 1 --2- 172.21.15.146:0/2646100410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3db80c70e0 0x7f3db806ec10 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.984+0000 7f3dbdaf1700 1 -- 172.21.15.146:0/2646100410 >> 172.21.15.146:0/2646100410 conn(0x7f3db80c9fe0 msgr2=0x7f3db806dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:17.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.984+0000 7f3dbdaf1700 1 -- 172.21.15.146:0/2646100410 shutdown_connections 2023-10-06T11:09:17.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.984+0000 7f3dbdaf1700 1 -- 172.21.15.146:0/2646100410 wait complete. 2023-10-06T11:09:17.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.985+0000 7f3dbdaf1700 1 Processor -- start 2023-10-06T11:09:17.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.985+0000 7f3dbdaf1700 1 -- start start 2023-10-06T11:09:17.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.986+0000 7f3dbdaf1700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3db80c70e0 0x7f3db80b1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.986+0000 7f3dbdaf1700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3db81595d0 0x7f3db81479e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.986+0000 7f3dbdaf1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3db81599a0 0x7f3db8147f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.986+0000 7f3dbdaf1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db8148460 con 0x7f3db81599a0 2023-10-06T11:09:17.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.986+0000 7f3dbdaf1700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db80c6230 con 0x7f3db80c70e0 2023-10-06T11:09:17.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.986+0000 7f3dbdaf1700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3db80c5640 con 0x7f3db81595d0 2023-10-06T11:09:17.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.986+0000 7f3db7fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3db81599a0 0x7f3db8147f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.986+0000 7f3db77fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3db80c70e0 0x7f3db80b1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.986+0000 7f3db7fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3db81599a0 0x7f3db8147f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53866/0 (socket says 172.21.15.146:53866) 2023-10-06T11:09:17.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.986+0000 7f3db6ffd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3db81595d0 0x7f3db81479e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.986+0000 7f3db7fff700 1 -- 172.21.15.146:0/2893194941 learned_addr learned my addr 172.21.15.146:0/2893194941 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:17.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.986+0000 7f3db77fe700 1 -- 172.21.15.146:0/2893194941 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3db81595d0 msgr2=0x7f3db81479e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:17.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.986+0000 7f3db77fe700 1 --2- 172.21.15.146:0/2893194941 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3db81595d0 0x7f3db81479e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.986+0000 7f3db77fe700 1 -- 172.21.15.146:0/2893194941 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3db81599a0 msgr2=0x7f3db8147f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:17.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.986+0000 7f3db77fe700 1 --2- 172.21.15.146:0/2893194941 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3db81599a0 0x7f3db8147f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:17.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.986+0000 7f3db77fe700 1 -- 172.21.15.146:0/2893194941 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da8009ae0 con 0x7f3db80c70e0 2023-10-06T11:09:17.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.986+0000 7f3db7fff700 1 --2- 172.21.15.146:0/2893194941 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3db81599a0 0x7f3db8147f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:09:17.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.986+0000 7f3db77fe700 1 --2- 172.21.15.146:0/2893194941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3db80c70e0 0x7f3db80b1950 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3da8009f30 tx=0x7f3da800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:17.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.987+0000 7f3d9f7fe700 1 -- 172.21.15.146:0/2893194941 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da800c9f0 con 0x7f3db80c70e0 2023-10-06T11:09:17.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.987+0000 7f3d9f7fe700 1 -- 172.21.15.146:0/2893194941 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da800f040 con 0x7f3db80c70e0 2023-10-06T11:09:17.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.987+0000 7f3d9f7fe700 1 -- 172.21.15.146:0/2893194941 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da800cda0 con 0x7f3db80c70e0 2023-10-06T11:09:17.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.987+0000 7f3dbdaf1700 1 -- 172.21.15.146:0/2893194941 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dac009420 con 0x7f3db80c70e0 2023-10-06T11:09:17.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.987+0000 7f3dbdaf1700 1 -- 172.21.15.146:0/2893194941 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3db80c5be0 con 0x7f3db80c70e0 2023-10-06T11:09:17.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.988+0000 7f3dbdaf1700 1 -- 172.21.15.146:0/2893194941 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3db804c380 con 0x7f3db80c70e0 2023-10-06T11:09:17.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.988+0000 7f3d9f7fe700 1 -- 172.21.15.146:0/2893194941 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3da8014690 con 0x7f3db80c70e0 2023-10-06T11:09:17.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.989+0000 7f3d9f7fe700 1 --2- 172.21.15.146:0/2893194941 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3da4066f60 0x7f3da4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:17.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.989+0000 7f3d9f7fe700 1 -- 172.21.15.146:0/2893194941 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3da8085320 con 0x7f3db80c70e0 2023-10-06T11:09:17.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.989+0000 7f3db6ffd700 1 --2- 172.21.15.146:0/2893194941 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3da4066f60 0x7f3da4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:17.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.989+0000 7f3db6ffd700 1 --2- 172.21.15.146:0/2893194941 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3da4066f60 0x7f3da4069410 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3dac0093f0 tx=0x7f3dac017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:17.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:17.993+0000 7f3d9f7fe700 1 -- 172.21.15.146:0/2893194941 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3da8052410 con 0x7f3db80c70e0 2023-10-06T11:09:18.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.215+0000 7f3dbdaf1700 1 -- 172.21.15.146:0/2893194941 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3db80c7ef0 con 0x7f3db80c70e0 2023-10-06T11:09:18.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.216+0000 7f3d9f7fe700 1 -- 172.21.15.146:0/2893194941 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4610 (secure 0 0 0) 0x7f3da8055a30 con 0x7f3db80c70e0 2023-10-06T11:09:18.217 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:09:18.217 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":37,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5248,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3360977916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3360977916},{"type":"v1","addr":"172.21.15.151:6834","nonce":3360977916}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5251,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2265934004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":2265934004},{"type":"v1","addr":"172.21.15.151:6835","nonce":2265934004}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2387575667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2387575667},{"type":"v1","addr":"172.21.15.146:6836","nonce":2387575667}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:08:42.797557+0000","modified":"2023-10-06T11:09:16.328424+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5481":{"gid":5481,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":11,"addr":"172.21.15.146:6837/2252184844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2252184844},{"type":"v1","addr":"172.21.15.146:6837","nonce":2252184844}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T11:09:18.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.217+0000 7f3dbdaf1700 1 -- 172.21.15.146:0/2893194941 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3da4066f60 msgr2=0x7f3da4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:18.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.217+0000 7f3dbdaf1700 1 --2- 172.21.15.146:0/2893194941 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3da4066f60 0x7f3da4069410 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3dac0093f0 tx=0x7f3dac017000 comp rx=0 tx=0).stop 2023-10-06T11:09:18.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.217+0000 7f3dbdaf1700 1 -- 172.21.15.146:0/2893194941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3db80c70e0 msgr2=0x7f3db80b1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:18.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.217+0000 7f3dbdaf1700 1 --2- 172.21.15.146:0/2893194941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3db80c70e0 0x7f3db80b1950 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3da8009f30 tx=0x7f3da800b040 comp rx=0 tx=0).stop 2023-10-06T11:09:18.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.218+0000 7f3dbdaf1700 1 -- 172.21.15.146:0/2893194941 shutdown_connections 2023-10-06T11:09:18.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.218+0000 7f3dbdaf1700 1 --2- 172.21.15.146:0/2893194941 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3da4066f60 0x7f3da4069410 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:18.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.218+0000 7f3dbdaf1700 1 --2- 172.21.15.146:0/2893194941 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3db81599a0 0x7f3db8147f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:18.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.218+0000 7f3dbdaf1700 1 --2- 172.21.15.146:0/2893194941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3db80c70e0 0x7f3db80b1950 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:18.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.218+0000 7f3dbdaf1700 1 --2- 172.21.15.146:0/2893194941 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3db81595d0 0x7f3db81479e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:18.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.218+0000 7f3dbdaf1700 1 -- 172.21.15.146:0/2893194941 >> 172.21.15.146:0/2893194941 conn(0x7f3db80c9fe0 msgr2=0x7f3db8153e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:18.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.218+0000 7f3dbdaf1700 1 -- 172.21.15.146:0/2893194941 shutdown_connections 2023-10-06T11:09:18.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.218+0000 7f3dbdaf1700 1 -- 172.21.15.146:0/2893194941 wait complete. 2023-10-06T11:09:18.221 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 37 2023-10-06T11:09:18.231 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok flush_path /scrub_test_path/ceph-qa-suite/new_file_1 2023-10-06T11:09:18.355 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:09:18.355 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0 2023-10-06T11:09:18.355 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:09:18.366 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /scrub_test_path/ceph-qa-suite/new_file_1' got response code '0' and stdout '{ "return_code": 0 } ' 2023-10-06T11:09:18.366 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T11:09:18.366 DEBUG:teuthology.orchestra.run.smithi146:> import os 2023-10-06T11:09:18.366 DEBUG:teuthology.orchestra.run.smithi146:> import stat 2023-10-06T11:09:18.366 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:09:18.366 DEBUG:teuthology.orchestra.run.smithi146:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_test_path/ceph-qa-suite/new_file_1").st_ino) 2023-10-06T11:09:18.367 DEBUG:teuthology.orchestra.run.smithi146:> ' 2023-10-06T11:09:18.432 INFO:teuthology.orchestra.run.smithi146.stdout:1099511630408 2023-10-06T11:09:18.619 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2023-10-06T11:09:18.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.775+0000 7f4ef7530700 1 Processor -- start 2023-10-06T11:09:18.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.775+0000 7f4ef7530700 1 -- start start 2023-10-06T11:09:18.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.776+0000 7f4ef7530700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4ef015a160 0x7f4ef00c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:18.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.776+0000 7f4ef7530700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef00ae2a0 con 0x7f4ef00ae730 2023-10-06T11:09:18.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.776+0000 7f4ef7530700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef015a530 con 0x7f4ef00cb950 2023-10-06T11:09:18.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.776+0000 7f4ef7530700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef00ad690 con 0x7f4ef015a160 2023-10-06T11:09:18.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.776+0000 7f4ef4acb700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4ef00ae730 0x7f4ef00aebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50946/0 (socket says 172.21.15.146:50946) 2023-10-06T11:09:18.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.776+0000 7f4ef4acb700 1 -- 172.21.15.146:0/1669238047 learned_addr learned my addr 172.21.15.146:0/1669238047 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:18.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.776+0000 7f4ee7fff700 1 -- 172.21.15.146:0/1669238047 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1584872302 0 0) 0x7f4ef00ae2a0 con 0x7f4ef00ae730 2023-10-06T11:09:18.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.776+0000 7f4ee7fff700 1 -- 172.21.15.146:0/1669238047 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4edc003570 con 0x7f4ef00ae730 2023-10-06T11:09:18.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.776+0000 7f4ef52cc700 1 --2- 172.21.15.146:0/1669238047 >> v2:172.21.15.151:3300/0 conn(0x7f4ef015a160 0x7f4ef00c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:18.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.777+0000 7f4ee7fff700 1 -- 172.21.15.146:0/1669238047 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2279718367 0 0) 0x7f4edc003570 con 0x7f4ef00ae730 2023-10-06T11:09:18.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.777+0000 7f4ee7fff700 1 -- 172.21.15.146:0/1669238047 >> v2:172.21.15.151:3300/0 conn(0x7f4ef015a160 msgr2=0x7f4ef00c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:18.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.777+0000 7f4ee7fff700 1 --2- 172.21.15.146:0/1669238047 >> v2:172.21.15.151:3300/0 conn(0x7f4ef015a160 0x7f4ef00c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:18.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.777+0000 7f4ee7fff700 1 -- 172.21.15.146:0/1669238047 >> v1:172.21.15.151:6789/0 conn(0x7f4ef00cb950 legacy=0x7f4ef00cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:18.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.777+0000 7f4ee7fff700 1 -- 172.21.15.146:0/1669238047 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef00ad970 con 0x7f4ef00ae730 2023-10-06T11:09:18.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.777+0000 7f4ee7fff700 1 -- 172.21.15.146:0/1669238047 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f4ee0001470 con 0x7f4ef00ae730 2023-10-06T11:09:18.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.777+0000 7f4ee7fff700 1 -- 172.21.15.146:0/1669238047 >> v1:172.21.15.146:6789/0 conn(0x7f4ef00ae730 legacy=0x7f4ef00aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:18.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.777+0000 7f4ee7fff700 1 --2- 172.21.15.146:0/1669238047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4edc003a60 0x7f4edc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:18.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.777+0000 7f4ee7fff700 1 --2- 172.21.15.146:0/1669238047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4edc004810 0x7f4edc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:18.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.777+0000 7f4ee7fff700 1 --2- 172.21.15.146:0/1669238047 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4edc0051c0 0x7f4edc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:18.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.777+0000 7f4ee7fff700 1 -- 172.21.15.146:0/1669238047 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef00ad690 con 0x7f4edc003a60 2023-10-06T11:09:18.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.777+0000 7f4ee7fff700 1 -- 172.21.15.146:0/1669238047 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc00c0d0 con 0x7f4edc004810 2023-10-06T11:09:18.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.777+0000 7f4ee7fff700 1 -- 172.21.15.146:0/1669238047 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4edc00c290 con 0x7f4edc0051c0 2023-10-06T11:09:18.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.777+0000 7f4ef52cc700 1 --2- 172.21.15.146:0/1669238047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4edc003a60 0x7f4edc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:18.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.777+0000 7f4ef4acb700 1 --2- 172.21.15.146:0/1669238047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4edc004810 0x7f4edc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:18.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.777+0000 7f4ef5acd700 1 --2- 172.21.15.146:0/1669238047 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4edc0051c0 0x7f4edc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:18.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.777+0000 7f4ef52cc700 1 -- 172.21.15.146:0/1669238047 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4edc0051c0 msgr2=0x7f4edc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:18.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.777+0000 7f4ef52cc700 1 --2- 172.21.15.146:0/1669238047 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4edc0051c0 0x7f4edc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:18.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.777+0000 7f4ef52cc700 1 -- 172.21.15.146:0/1669238047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4edc004810 msgr2=0x7f4edc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:18.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.777+0000 7f4ef52cc700 1 --2- 172.21.15.146:0/1669238047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4edc004810 0x7f4edc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:18.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.777+0000 7f4ef52cc700 1 -- 172.21.15.146:0/1669238047 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4edc003570 con 0x7f4edc003a60 2023-10-06T11:09:18.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.777+0000 7f4ef5acd700 1 --2- 172.21.15.146:0/1669238047 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4edc0051c0 0x7f4edc00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:09:18.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.777+0000 7f4ef5acd700 1 -- 172.21.15.146:0/1669238047 reap_dead start 2023-10-06T11:09:18.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.777+0000 7f4ef52cc700 1 --2- 172.21.15.146:0/1669238047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4edc003a60 0x7f4edc003e70 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f4eec009bf0 tx=0x7f4eec009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbba1f7781ea0ccb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:18.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.777+0000 7f4ee7fff700 1 -- 172.21.15.146:0/1669238047 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eec005a00 con 0x7f4edc003a60 2023-10-06T11:09:18.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.777+0000 7f4ee7fff700 1 -- 172.21.15.146:0/1669238047 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eec005b60 con 0x7f4edc003a60 2023-10-06T11:09:18.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.777+0000 7f4ee7fff700 1 -- 172.21.15.146:0/1669238047 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eec00e710 con 0x7f4edc003a60 2023-10-06T11:09:18.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.778+0000 7f4ef7530700 1 -- 172.21.15.146:0/1669238047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4edc003a60 msgr2=0x7f4edc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:18.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.778+0000 7f4ef7530700 1 --2- 172.21.15.146:0/1669238047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4edc003a60 0x7f4edc003e70 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f4eec009bf0 tx=0x7f4eec009120 comp rx=0 tx=0).stop 2023-10-06T11:09:18.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.778+0000 7f4ef7530700 1 -- 172.21.15.146:0/1669238047 shutdown_connections 2023-10-06T11:09:18.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.778+0000 7f4ef7530700 1 --2- 172.21.15.146:0/1669238047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4edc003a60 0x7f4edc003e70 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:18.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.778+0000 7f4ef7530700 1 -- 172.21.15.146:0/1669238047 >> 172.21.15.146:0/1669238047 conn(0x7f4ef006f380 msgr2=0x7f4ef00d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:18.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.778+0000 7f4ef7530700 1 -- 172.21.15.146:0/1669238047 shutdown_connections 2023-10-06T11:09:18.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.778+0000 7f4ef7530700 1 -- 172.21.15.146:0/1669238047 wait complete. 2023-10-06T11:09:18.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.779+0000 7f4ef7530700 1 Processor -- start 2023-10-06T11:09:18.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.779+0000 7f4ef7530700 1 -- start start 2023-10-06T11:09:18.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.780+0000 7f4ef7530700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4edc003a60 0x7f4ef00b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:18.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.780+0000 7f4ef7530700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ef00b4020 0x7f4ef00c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:18.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.780+0000 7f4ef7530700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ef014b460 0x7f4ef00c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:18.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.780+0000 7f4ef7530700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef00b21e0 con 0x7f4ef00b4020 2023-10-06T11:09:18.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.780+0000 7f4ef7530700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef00c8800 con 0x7f4ef014b460 2023-10-06T11:09:18.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.780+0000 7f4ef7530700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef00c8a30 con 0x7f4edc003a60 2023-10-06T11:09:18.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.780+0000 7f4ef4acb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ef00b4020 0x7f4ef00c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:18.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.780+0000 7f4ef4acb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ef00b4020 0x7f4ef00c82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53882/0 (socket says 172.21.15.146:53882) 2023-10-06T11:09:18.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.780+0000 7f4ef4acb700 1 -- 172.21.15.146:0/73885814 learned_addr learned my addr 172.21.15.146:0/73885814 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:18.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.780+0000 7f4ef52cc700 1 --2- 172.21.15.146:0/73885814 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4edc003a60 0x7f4ef00b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:18.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.780+0000 7f4ef5acd700 1 --2- 172.21.15.146:0/73885814 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ef014b460 0x7f4ef00c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:18.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.780+0000 7f4ef4acb700 1 -- 172.21.15.146:0/73885814 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4edc003a60 msgr2=0x7f4ef00b1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:18.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.780+0000 7f4ef4acb700 1 --2- 172.21.15.146:0/73885814 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4edc003a60 0x7f4ef00b1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:18.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.780+0000 7f4ef4acb700 1 -- 172.21.15.146:0/73885814 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ef014b460 msgr2=0x7f4ef00c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:18.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.780+0000 7f4ef4acb700 1 --2- 172.21.15.146:0/73885814 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ef014b460 0x7f4ef00c92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:18.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.780+0000 7f4ef4acb700 1 -- 172.21.15.146:0/73885814 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef00af300 con 0x7f4ef00b4020 2023-10-06T11:09:18.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.780+0000 7f4ef52cc700 1 --2- 172.21.15.146:0/73885814 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4edc003a60 0x7f4ef00b1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:18.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.781+0000 7f4ef4acb700 1 --2- 172.21.15.146:0/73885814 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ef00b4020 0x7f4ef00c82c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f4ee00073a0 tx=0x7f4ee0001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:18.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.781+0000 7f4ee57fa700 1 -- 172.21.15.146:0/73885814 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee000f8d0 con 0x7f4ef00b4020 2023-10-06T11:09:18.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.781+0000 7f4ee57fa700 1 -- 172.21.15.146:0/73885814 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee000fa50 con 0x7f4ef00b4020 2023-10-06T11:09:18.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.781+0000 7f4ef7530700 1 -- 172.21.15.146:0/73885814 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ef00af5e0 con 0x7f4ef00b4020 2023-10-06T11:09:18.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.781+0000 7f4ee57fa700 1 -- 172.21.15.146:0/73885814 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee000fe10 con 0x7f4ef00b4020 2023-10-06T11:09:18.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.781+0000 7f4ef7530700 1 -- 172.21.15.146:0/73885814 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef00afba0 con 0x7f4ef00b4020 2023-10-06T11:09:18.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.782+0000 7f4ee57fa700 1 -- 172.21.15.146:0/73885814 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4ee00135c0 con 0x7f4ef00b4020 2023-10-06T11:09:18.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.782+0000 7f4ee57fa700 1 --2- 172.21.15.146:0/73885814 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4ed4066f30 0x7f4ed40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:18.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.782+0000 7f4ee57fa700 1 -- 172.21.15.146:0/73885814 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4ee00844e0 con 0x7f4ef00b4020 2023-10-06T11:09:18.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.783+0000 7f4ef52cc700 1 --2- 172.21.15.146:0/73885814 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4ed4066f30 0x7f4ed40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:18.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.783+0000 7f4ef52cc700 1 --2- 172.21.15.146:0/73885814 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4ed4066f30 0x7f4ed40693e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4eec009160 tx=0x7f4eec019000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:18.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.784+0000 7f4f00828b80 1 Processor -- start 2023-10-06T11:09:18.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.785+0000 7f4f00828b80 1 -- start start 2023-10-06T11:09:18.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.785+0000 7f4f00828b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55dcaac35ae0 0x55dcaac35eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:18.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.785+0000 7f4f00828b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dcaabf19f0 0x55dcaabee5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:18.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.785+0000 7f4f00828b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcaabefc20 0x55dcaabeeb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:18.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.785+0000 7f4f00828b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcaab6ecd0 con 0x55dcaabf19f0 2023-10-06T11:09:18.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.785+0000 7f4f00828b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcaab45ac0 con 0x55dcaabefc20 2023-10-06T11:09:18.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.785+0000 7f4f00828b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dcaab432c0 con 0x55dcaac35ae0 2023-10-06T11:09:18.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.785+0000 7f4ef4acb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dcaabf19f0 0x55dcaabee5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:18.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.785+0000 7f4ef4acb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dcaabf19f0 0x55dcaabee5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53890/0 (socket says 172.21.15.146:53890) 2023-10-06T11:09:18.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.785+0000 7f4ef4acb700 1 -- 172.21.15.146:0/745708097 learned_addr learned my addr 172.21.15.146:0/745708097 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:18.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.786+0000 7f4ef52cc700 1 --2- 172.21.15.146:0/745708097 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55dcaac35ae0 0x55dcaac35eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:18.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.786+0000 7f4ef5acd700 1 --2- 172.21.15.146:0/745708097 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcaabefc20 0x55dcaabeeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:18.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.786+0000 7f4ef4acb700 1 -- 172.21.15.146:0/745708097 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55dcaac35ae0 msgr2=0x55dcaac35eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:18.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.786+0000 7f4ef4acb700 1 --2- 172.21.15.146:0/745708097 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55dcaac35ae0 0x55dcaac35eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:18.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.786+0000 7f4ef4acb700 1 -- 172.21.15.146:0/745708097 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcaabefc20 msgr2=0x55dcaabeeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:18.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.786+0000 7f4ef4acb700 1 --2- 172.21.15.146:0/745708097 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcaabefc20 0x55dcaabeeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:18.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.786+0000 7f4ef4acb700 1 -- 172.21.15.146:0/745708097 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dcaa9d92c0 con 0x55dcaabf19f0 2023-10-06T11:09:18.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.786+0000 7f4ef4acb700 1 --2- 172.21.15.146:0/745708097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dcaabf19f0 0x55dcaabee5d0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0082870 tx=0x7f4ee0082800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a84d1ed49d1460c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:18.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.786+0000 7f4eda7fc700 1 -- 172.21.15.146:0/745708097 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee0058500 con 0x55dcaabf19f0 2023-10-06T11:09:18.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.786+0000 7f4eda7fc700 1 -- 172.21.15.146:0/745708097 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee005c250 con 0x55dcaabf19f0 2023-10-06T11:09:18.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.786+0000 7f4eda7fc700 1 -- 172.21.15.146:0/745708097 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee0053650 con 0x55dcaabf19f0 2023-10-06T11:09:18.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.786+0000 7f4f00828b80 1 -- 172.21.15.146:0/745708097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dcaabf19f0 msgr2=0x55dcaabee5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:18.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.786+0000 7f4f00828b80 1 --2- 172.21.15.146:0/745708097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dcaabf19f0 0x55dcaabee5d0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0082870 tx=0x7f4ee0082800 comp rx=0 tx=0).stop 2023-10-06T11:09:18.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.786+0000 7f4f00828b80 1 -- 172.21.15.146:0/745708097 shutdown_connections 2023-10-06T11:09:18.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.786+0000 7f4f00828b80 1 --2- 172.21.15.146:0/745708097 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcaabefc20 0x55dcaabeeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:18.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.786+0000 7f4f00828b80 1 --2- 172.21.15.146:0/745708097 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55dcaac35ae0 0x55dcaac35eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:18.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.786+0000 7f4f00828b80 1 --2- 172.21.15.146:0/745708097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dcaabf19f0 0x55dcaabee5d0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:18.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.786+0000 7f4f00828b80 1 -- 172.21.15.146:0/745708097 >> 172.21.15.146:0/745708097 conn(0x55dcaabf00c0 msgr2=0x55dcaabf0490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:18.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.787+0000 7f4f00828b80 1 -- 172.21.15.146:0/745708097 shutdown_connections 2023-10-06T11:09:18.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.787+0000 7f4f00828b80 1 -- 172.21.15.146:0/745708097 wait complete. 2023-10-06T11:09:18.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.787+0000 7f4f00828b80 1 -- start start 2023-10-06T11:09:18.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.787+0000 7f4f00828b80 1 Processor -- start 2023-10-06T11:09:18.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.788+0000 7f4f00828b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dcaabefc20 0x55dcaac15530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:18.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.788+0000 7f4f00828b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55dcaabf19f0 0x55dcaac16e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:18.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.788+0000 7f4f00828b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcaac35ae0 0x55dcaac19080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:18.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.788+0000 7f4f00828b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcaab3f0b0 con 0x55dcaabefc20 2023-10-06T11:09:18.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.788+0000 7f4f00828b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcaaaea8e0 con 0x55dcaac35ae0 2023-10-06T11:09:18.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.788+0000 7f4f00828b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dcaab05ef0 con 0x55dcaabf19f0 2023-10-06T11:09:18.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.788+0000 7f4f00828b80 10 client.0 _ll_register_callbacks cb 0x55dcaa9dbf80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:09:18.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.788+0000 7f4ef52cc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dcaabefc20 0x55dcaac15530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:18.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.788+0000 7f4ef52cc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dcaabefc20 0x55dcaac15530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53896/0 (socket says 172.21.15.146:53896) 2023-10-06T11:09:18.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.788+0000 7f4ef52cc700 1 -- 172.21.15.146:0/2342345738 learned_addr learned my addr 172.21.15.146:0/2342345738 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:18.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.788+0000 7f4ef5acd700 1 --2- 172.21.15.146:0/2342345738 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcaac35ae0 0x55dcaac19080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:18.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.788+0000 7f4ef4acb700 1 --2- 172.21.15.146:0/2342345738 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55dcaabf19f0 0x55dcaac16e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:18.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.788+0000 7f4ef52cc700 1 -- 172.21.15.146:0/2342345738 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55dcaabf19f0 msgr2=0x55dcaac16e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:18.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.788+0000 7f4ef52cc700 1 --2- 172.21.15.146:0/2342345738 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55dcaabf19f0 0x55dcaac16e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:18.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.788+0000 7f4ef52cc700 1 -- 172.21.15.146:0/2342345738 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcaac35ae0 msgr2=0x55dcaac19080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:18.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.788+0000 7f4ef52cc700 1 --2- 172.21.15.146:0/2342345738 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcaac35ae0 0x55dcaac19080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:18.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.788+0000 7f4ef52cc700 1 -- 172.21.15.146:0/2342345738 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef00afba0 con 0x55dcaabefc20 2023-10-06T11:09:18.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.789+0000 7f4ef5acd700 1 --2- 172.21.15.146:0/2342345738 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcaac35ae0 0x55dcaac19080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:18.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.789+0000 7f4ef52cc700 1 --2- 172.21.15.146:0/2342345738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dcaabefc20 0x55dcaac15530 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f4eec00ee80 tx=0x7f4eec01f050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=903787f29aa0c312 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:18.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.789+0000 7f4ecf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:09:18.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.789+0000 7f4ecf7fe700 1 -- 172.21.15.146:0/2342345738 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eec006240 con 0x55dcaabefc20 2023-10-06T11:09:18.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.789+0000 7f4ecf7fe700 1 -- 172.21.15.146:0/2342345738 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4eec037c60 con 0x55dcaabefc20 2023-10-06T11:09:18.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.789+0000 7f4f00828b80 1 -- 172.21.15.146:0/2342345738 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dcaabe36e0 con 0x55dcaabefc20 2023-10-06T11:09:18.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.789+0000 7f4ecf7fe700 1 -- 172.21.15.146:0/2342345738 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4eec037e20 con 0x55dcaabefc20 2023-10-06T11:09:18.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.789+0000 7f4f00828b80 10 client.6015 fetch_fsmap learned FSMap version 37 2023-10-06T11:09:18.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.789+0000 7f4f00828b80 1 -- 172.21.15.146:0/2342345738 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x55dcaa97c030 con 0x55dcaabefc20 2023-10-06T11:09:18.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.789+0000 7f4ecf7fe700 1 -- 172.21.15.146:0/2342345738 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55dcaabe36e0 con 0x55dcaabefc20 2023-10-06T11:09:18.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.789+0000 7f4ecf7fe700 1 -- 172.21.15.146:0/2342345738 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 37) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4eec0065b0 con 0x55dcaabefc20 2023-10-06T11:09:18.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.789+0000 7f4f00828b80 10 client.6015 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T11:09:18.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.789+0000 7f4f00828b80 10 client.6015 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-10-06T11:09:18.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.789+0000 7f4f00828b80 20 client.6015 populate_metadata read hostname 'smithi146' 2023-10-06T11:09:18.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.789+0000 7f4f00828b80 1 --2- 172.21.15.146:0/2342345738 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55dcaac195c0 0x55dcaac1b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:18.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.789+0000 7f4f00828b80 4 client.6015 mds_command: new command op to 5481 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:09:18.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.789+0000 7f4f00828b80 1 -- 172.21.15.146:0/2342345738 --> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dcaabc0610 con 0x55dcaac195c0 2023-10-06T11:09:18.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.789+0000 7f4ef4acb700 1 --2- 172.21.15.146:0/2342345738 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55dcaac195c0 0x55dcaac1b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:18.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.790+0000 7f4ecf7fe700 10 client.6015 ms_handle_connect on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:18.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.790+0000 7f4ef4acb700 1 --2- 172.21.15.146:0/2342345738 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55dcaac195c0 0x55dcaac1b940 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7607742b6e9b9863 server_cookie=71c66e1c6db626b0 in_seq=0 out_seq=0 2023-10-06T11:09:18.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.790+0000 7f4ecf7fe700 1 -- 172.21.15.146:0/2342345738 <== mds.0 v2:172.21.15.146:6835/2252184844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55dcaabc0610 con 0x55dcaac195c0 2023-10-06T11:09:18.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.790+0000 7f4ecf7fe700 10 client.6015 handle_command_reply: tid=0 2023-10-06T11:09:18.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.790+0000 7f4f00828b80 1 client.6015 shutdown 2023-10-06T11:09:18.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.790+0000 7f4f00828b80 1 -- 172.21.15.146:0/2342345738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dcaabefc20 msgr2=0x55dcaac15530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:18.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.790+0000 7f4f00828b80 1 --2- 172.21.15.146:0/2342345738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dcaabefc20 0x55dcaac15530 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f4eec00ee80 tx=0x7f4eec01f050 comp rx=0 tx=0).stop 2023-10-06T11:09:18.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.790+0000 7f4f00828b80 1 -- 172.21.15.146:0/2342345738 shutdown_connections 2023-10-06T11:09:18.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.790+0000 7f4f00828b80 1 --2- 172.21.15.146:0/2342345738 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55dcaac195c0 0x55dcaac1b940 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:18.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.790+0000 7f4f00828b80 1 --2- 172.21.15.146:0/2342345738 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcaac35ae0 0x55dcaac19080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:18.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.790+0000 7f4f00828b80 1 --2- 172.21.15.146:0/2342345738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dcaabefc20 0x55dcaac15530 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:18.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.790+0000 7f4f00828b80 1 --2- 172.21.15.146:0/2342345738 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55dcaabf19f0 0x55dcaac16e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:18.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.790+0000 7f4f00828b80 1 -- 172.21.15.146:0/2342345738 >> 172.21.15.146:0/2342345738 conn(0x55dcaabf00c0 msgr2=0x55dcaabe9790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:18.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.790+0000 7f4ecf7fe700 0 client.6015 ms_handle_reset on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:18.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.791+0000 7f4f00828b80 1 -- 172.21.15.146:0/2342345738 shutdown_connections 2023-10-06T11:09:18.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.791+0000 7f4f00828b80 1 -- 172.21.15.146:0/2342345738 wait complete. 2023-10-06T11:09:18.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.791+0000 7f4f00828b80 20 client.6015 trim_cache size 0 max 16384 2023-10-06T11:09:18.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.803+0000 7f4f00828b80 1 Processor -- start 2023-10-06T11:09:18.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.803+0000 7f4f00828b80 1 -- start start 2023-10-06T11:09:18.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.804+0000 7f4f00828b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55dcaabf00c0 0x55dcaabe70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:18.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.804+0000 7f4f00828b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dcaabefc20 0x55dcaabeb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:18.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.804+0000 7f4f00828b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcaabf19f0 0x55dcaac1e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:18.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.804+0000 7f4f00828b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcaa9c1e80 con 0x55dcaabefc20 2023-10-06T11:09:18.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.804+0000 7f4f00828b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcaabebba0 con 0x55dcaabf19f0 2023-10-06T11:09:18.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.804+0000 7f4f00828b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dcaabeb990 con 0x55dcaabf00c0 2023-10-06T11:09:18.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.804+0000 7f4ef4acb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dcaabefc20 0x55dcaabeb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:18.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.804+0000 7f4ef4acb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dcaabefc20 0x55dcaabeb110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53912/0 (socket says 172.21.15.146:53912) 2023-10-06T11:09:18.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.804+0000 7f4ef4acb700 1 -- 172.21.15.146:0/1593420726 learned_addr learned my addr 172.21.15.146:0/1593420726 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:18.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.804+0000 7f4ef5acd700 1 --2- 172.21.15.146:0/1593420726 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcaabf19f0 0x55dcaac1e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:18.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.804+0000 7f4ef52cc700 1 --2- 172.21.15.146:0/1593420726 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55dcaabf00c0 0x55dcaabe70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:18.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.804+0000 7f4ef4acb700 1 -- 172.21.15.146:0/1593420726 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55dcaabf00c0 msgr2=0x55dcaabe70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:18.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.804+0000 7f4ef4acb700 1 --2- 172.21.15.146:0/1593420726 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55dcaabf00c0 0x55dcaabe70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:18.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.804+0000 7f4ef4acb700 1 -- 172.21.15.146:0/1593420726 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcaabf19f0 msgr2=0x55dcaac1e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:18.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.804+0000 7f4ef4acb700 1 --2- 172.21.15.146:0/1593420726 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcaabf19f0 0x55dcaac1e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:18.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.804+0000 7f4ef4acb700 1 -- 172.21.15.146:0/1593420726 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dcaac2c800 con 0x55dcaabefc20 2023-10-06T11:09:18.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.804+0000 7f4ef5acd700 1 --2- 172.21.15.146:0/1593420726 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcaabf19f0 0x55dcaac1e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:18.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.804+0000 7f4ef4acb700 1 --2- 172.21.15.146:0/1593420726 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dcaabefc20 0x55dcaabeb110 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0000c90 tx=0x7f4ee006d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fc1183d5d39d2af server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:18.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.804+0000 7f4edaffd700 1 -- 172.21.15.146:0/1593420726 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee0058500 con 0x55dcaabefc20 2023-10-06T11:09:18.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.804+0000 7f4edaffd700 1 -- 172.21.15.146:0/1593420726 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee00552b0 con 0x55dcaabefc20 2023-10-06T11:09:18.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.804+0000 7f4edaffd700 1 -- 172.21.15.146:0/1593420726 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee00133b0 con 0x55dcaabefc20 2023-10-06T11:09:18.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.805+0000 7f4f00828b80 1 -- 172.21.15.146:0/1593420726 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dcaabefc20 msgr2=0x55dcaabeb110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:18.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.805+0000 7f4f00828b80 1 --2- 172.21.15.146:0/1593420726 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dcaabefc20 0x55dcaabeb110 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f4ee0000c90 tx=0x7f4ee006d040 comp rx=0 tx=0).stop 2023-10-06T11:09:18.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.805+0000 7f4f00828b80 1 -- 172.21.15.146:0/1593420726 shutdown_connections 2023-10-06T11:09:18.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.805+0000 7f4f00828b80 1 --2- 172.21.15.146:0/1593420726 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcaabf19f0 0x55dcaac1e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:18.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.805+0000 7f4f00828b80 1 --2- 172.21.15.146:0/1593420726 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55dcaabf00c0 0x55dcaabe70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:18.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.805+0000 7f4f00828b80 1 --2- 172.21.15.146:0/1593420726 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dcaabefc20 0x55dcaabeb110 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:18.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.805+0000 7f4f00828b80 1 -- 172.21.15.146:0/1593420726 >> 172.21.15.146:0/1593420726 conn(0x55dcaac32510 msgr2=0x55dcaabe9790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:18.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.805+0000 7f4f00828b80 1 -- 172.21.15.146:0/1593420726 shutdown_connections 2023-10-06T11:09:18.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.805+0000 7f4f00828b80 1 -- 172.21.15.146:0/1593420726 wait complete. 2023-10-06T11:09:18.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.805+0000 7f4f00828b80 1 -- start start 2023-10-06T11:09:18.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.805+0000 7f4f00828b80 1 Processor -- start 2023-10-06T11:09:18.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.806+0000 7f4f00828b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcaabefc20 0x55dcaac97a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:18.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.806+0000 7f4f00828b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dcaabf00c0 0x55dcaac16cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:18.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.806+0000 7f4f00828b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55dcaabf19f0 0x55dcaac32980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:18.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.806+0000 7f4f00828b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcaac3cc80 con 0x55dcaabf00c0 2023-10-06T11:09:18.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.806+0000 7f4f00828b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcaac9bb20 con 0x55dcaabefc20 2023-10-06T11:09:18.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.806+0000 7f4f00828b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55dcaac9af70 con 0x55dcaabf19f0 2023-10-06T11:09:18.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.806+0000 7f4f00828b80 10 client.0 _ll_register_callbacks cb 0x55dcaa9dbf80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:09:18.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.806+0000 7f4ef4acb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dcaabf00c0 0x55dcaac16cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:18.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.806+0000 7f4ef4acb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dcaabf00c0 0x55dcaac16cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53914/0 (socket says 172.21.15.146:53914) 2023-10-06T11:09:18.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.806+0000 7f4ef4acb700 1 -- 172.21.15.146:0/3184716648 learned_addr learned my addr 172.21.15.146:0/3184716648 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:18.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.806+0000 7f4ef5acd700 1 --2- 172.21.15.146:0/3184716648 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55dcaabf19f0 0x55dcaac32980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:18.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.806+0000 7f4ef52cc700 1 --2- 172.21.15.146:0/3184716648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcaabefc20 0x55dcaac97a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:18.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.806+0000 7f4ef4acb700 1 -- 172.21.15.146:0/3184716648 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55dcaabf19f0 msgr2=0x55dcaac32980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:18.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.806+0000 7f4ef4acb700 1 --2- 172.21.15.146:0/3184716648 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55dcaabf19f0 0x55dcaac32980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:18.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.806+0000 7f4ef4acb700 1 -- 172.21.15.146:0/3184716648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcaabefc20 msgr2=0x55dcaac97a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:18.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.806+0000 7f4ef4acb700 1 --2- 172.21.15.146:0/3184716648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcaabefc20 0x55dcaac97a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:18.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.806+0000 7f4ef4acb700 1 -- 172.21.15.146:0/3184716648 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dcaa9d92c0 con 0x55dcaabf00c0 2023-10-06T11:09:18.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.807+0000 7f4ef5acd700 1 --2- 172.21.15.146:0/3184716648 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55dcaabf19f0 0x55dcaac32980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:18.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.807+0000 7f4ef52cc700 1 --2- 172.21.15.146:0/3184716648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcaabefc20 0x55dcaac97a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:18.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.807+0000 7f4ef4acb700 1 --2- 172.21.15.146:0/3184716648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dcaabf00c0 0x55dcaac16cc0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f4ee000f4b0 tx=0x7f4ee007e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7623c76275894fe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:18.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.807+0000 7f4ecf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:09:18.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.807+0000 7f4ecf7fe700 1 -- 172.21.15.146:0/3184716648 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee0072020 con 0x55dcaabf00c0 2023-10-06T11:09:18.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.807+0000 7f4ecf7fe700 1 -- 172.21.15.146:0/3184716648 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4ee0053650 con 0x55dcaabf00c0 2023-10-06T11:09:18.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.807+0000 7f4f00828b80 1 -- 172.21.15.146:0/3184716648 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4ee005c250 con 0x55dcaabf00c0 2023-10-06T11:09:18.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.807+0000 7f4ecf7fe700 1 -- 172.21.15.146:0/3184716648 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ee0055510 con 0x55dcaabf00c0 2023-10-06T11:09:18.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.807+0000 7f4f00828b80 10 client.6021 fetch_fsmap learned FSMap version 37 2023-10-06T11:09:18.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.807+0000 7f4f00828b80 1 -- 172.21.15.146:0/3184716648 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x55dcaab0d7d0 con 0x55dcaabf00c0 2023-10-06T11:09:18.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.807+0000 7f4ecf7fe700 1 -- 172.21.15.146:0/3184716648 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee005c250 con 0x55dcaabf00c0 2023-10-06T11:09:18.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.807+0000 7f4ecf7fe700 1 -- 172.21.15.146:0/3184716648 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 37) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4ee0062070 con 0x55dcaabf00c0 2023-10-06T11:09:18.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.807+0000 7f4f00828b80 10 client.6021 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T11:09:18.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.807+0000 7f4f00828b80 10 client.6021 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-10-06T11:09:18.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.807+0000 7f4f00828b80 20 client.6021 populate_metadata read hostname 'smithi146' 2023-10-06T11:09:18.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.807+0000 7f4f00828b80 1 --2- 172.21.15.146:0/3184716648 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55dcaac35ae0 0x55dcaac32ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:18.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.807+0000 7f4f00828b80 4 client.6021 mds_command: new command op to 5481 tid=0[{"prefix": "damage ls"}] 2023-10-06T11:09:18.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.807+0000 7f4f00828b80 1 -- 172.21.15.146:0/3184716648 --> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55dcaaae1e50 con 0x55dcaac35ae0 2023-10-06T11:09:18.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.807+0000 7f4ef52cc700 1 --2- 172.21.15.146:0/3184716648 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55dcaac35ae0 0x55dcaac32ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:18.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.807+0000 7f4ecf7fe700 10 client.6021 ms_handle_connect on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:18.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.808+0000 7f4ef52cc700 1 --2- 172.21.15.146:0/3184716648 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55dcaac35ae0 0x55dcaac32ec0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=994f692673c5816e server_cookie=b151422e565db004 in_seq=0 out_seq=0 2023-10-06T11:09:18.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.808+0000 7f4ecf7fe700 1 -- 172.21.15.146:0/3184716648 <== mds.0 v2:172.21.15.146:6835/2252184844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55dcaaae1e50 con 0x55dcaac35ae0 2023-10-06T11:09:18.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.808+0000 7f4ecf7fe700 10 client.6021 handle_command_reply: tid=0 2023-10-06T11:09:18.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.808+0000 7f4f00828b80 1 client.6021 shutdown 2023-10-06T11:09:18.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.808+0000 7f4f00828b80 1 -- 172.21.15.146:0/3184716648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dcaabf00c0 msgr2=0x55dcaac16cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:18.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.808+0000 7f4f00828b80 1 --2- 172.21.15.146:0/3184716648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dcaabf00c0 0x55dcaac16cc0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f4ee000f4b0 tx=0x7f4ee007e040 comp rx=0 tx=0).stop 2023-10-06T11:09:18.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.808+0000 7f4f00828b80 1 -- 172.21.15.146:0/3184716648 shutdown_connections 2023-10-06T11:09:18.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.808+0000 7f4f00828b80 1 --2- 172.21.15.146:0/3184716648 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55dcaac35ae0 0x55dcaac32ec0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:18.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.808+0000 7f4f00828b80 1 --2- 172.21.15.146:0/3184716648 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55dcaabf19f0 0x55dcaac32980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:18.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.808+0000 7f4f00828b80 1 --2- 172.21.15.146:0/3184716648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcaabefc20 0x55dcaac97a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:18.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.808+0000 7f4ecf7fe700 0 client.6021 ms_handle_reset on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:18.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.808+0000 7f4f00828b80 1 --2- 172.21.15.146:0/3184716648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55dcaabf00c0 0x55dcaac16cc0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:18.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.808+0000 7f4f00828b80 1 -- 172.21.15.146:0/3184716648 >> 172.21.15.146:0/3184716648 conn(0x55dcaac32510 msgr2=0x55dcaac14670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:18.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.808+0000 7f4f00828b80 1 -- 172.21.15.146:0/3184716648 shutdown_connections 2023-10-06T11:09:18.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.808+0000 7f4f00828b80 1 -- 172.21.15.146:0/3184716648 wait complete. 2023-10-06T11:09:18.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.808+0000 7f4f00828b80 20 client.6021 trim_cache size 0 max 16384 2023-10-06T11:09:18.829 INFO:teuthology.orchestra.run.smithi146.stdout:[] 2023-10-06T11:09:18.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.808+0000 7f4ef7530700 1 -- 172.21.15.146:0/73885814 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4ed4066f30 msgr2=0x7f4ed40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:18.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.808+0000 7f4ef7530700 1 --2- 172.21.15.146:0/73885814 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4ed4066f30 0x7f4ed40693e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f4eec009160 tx=0x7f4eec019000 comp rx=0 tx=0).stop 2023-10-06T11:09:18.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.808+0000 7f4ef7530700 1 -- 172.21.15.146:0/73885814 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ef00b4020 msgr2=0x7f4ef00c82c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:18.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.808+0000 7f4ef7530700 1 --2- 172.21.15.146:0/73885814 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ef00b4020 0x7f4ef00c82c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f4ee00073a0 tx=0x7f4ee0001e50 comp rx=0 tx=0).stop 2023-10-06T11:09:18.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.809+0000 7f4ef7530700 1 -- 172.21.15.146:0/73885814 shutdown_connections 2023-10-06T11:09:18.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.809+0000 7f4ef7530700 1 --2- 172.21.15.146:0/73885814 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4ed4066f30 0x7f4ed40693e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:18.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.809+0000 7f4ef7530700 1 --2- 172.21.15.146:0/73885814 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ef014b460 0x7f4ef00c92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:18.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.809+0000 7f4ef7530700 1 --2- 172.21.15.146:0/73885814 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4edc003a60 0x7f4ef00b1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:18.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.809+0000 7f4ef7530700 1 --2- 172.21.15.146:0/73885814 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ef00b4020 0x7f4ef00c82c0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:18.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.809+0000 7f4ef7530700 1 -- 172.21.15.146:0/73885814 >> 172.21.15.146:0/73885814 conn(0x7f4ef006f380 msgr2=0x7f4ef0159630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:18.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.809+0000 7f4ef7530700 1 -- 172.21.15.146:0/73885814 shutdown_connections 2023-10-06T11:09:18.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.809+0000 7f4ef7530700 1 -- 172.21.15.146:0/73885814 wait complete. 2023-10-06T11:09:18.833 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data rmxattr 10000000a48.00000000 parent 2023-10-06T11:09:18.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.869+0000 7f5ef19d8000 1 Processor -- start 2023-10-06T11:09:18.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.869+0000 7f5ef19d8000 1 -- start start 2023-10-06T11:09:18.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.870+0000 7f5ef19d8000 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555af1bf9950 0x555af1c12a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:18.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.870+0000 7f5ef19d8000 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555af1bf9d20 0x555af1b66810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:18.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.870+0000 7f5ef19d8000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555af1c11860 0x555af1b6a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:18.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.870+0000 7f5ef19d8000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af1a86980 con 0x555af1c11860 2023-10-06T11:09:18.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.870+0000 7f5ef19d8000 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af1a86620 con 0x555af1bf9950 2023-10-06T11:09:18.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.870+0000 7f5ef19d8000 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x555af1a7d400 con 0x555af1bf9d20 2023-10-06T11:09:18.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.870+0000 7f5eeb414700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555af1c11860 0x555af1b6a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:18.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.870+0000 7f5eeb414700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555af1c11860 0x555af1b6a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53932/0 (socket says 172.21.15.146:53932) 2023-10-06T11:09:18.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.870+0000 7f5eeb414700 1 -- 172.21.15.146:0/4033734379 learned_addr learned my addr 172.21.15.146:0/4033734379 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:18.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.870+0000 7f5eeac13700 1 --2- 172.21.15.146:0/4033734379 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555af1bf9950 0x555af1c12a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:18.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.870+0000 7f5eea412700 1 --2- 172.21.15.146:0/4033734379 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555af1bf9d20 0x555af1b66810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:18.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.870+0000 7f5eeb414700 1 -- 172.21.15.146:0/4033734379 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555af1bf9d20 msgr2=0x555af1b66810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:18.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.870+0000 7f5eeb414700 1 --2- 172.21.15.146:0/4033734379 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555af1bf9d20 0x555af1b66810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:18.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.870+0000 7f5eeb414700 1 -- 172.21.15.146:0/4033734379 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555af1bf9950 msgr2=0x555af1c12a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:18.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.870+0000 7f5eeb414700 1 --2- 172.21.15.146:0/4033734379 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555af1bf9950 0x555af1c12a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:18.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.870+0000 7f5eeb414700 1 -- 172.21.15.146:0/4033734379 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee0005db0 con 0x555af1c11860 2023-10-06T11:09:18.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.870+0000 7f5eeac13700 1 --2- 172.21.15.146:0/4033734379 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555af1bf9950 0x555af1c12a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:18.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.870+0000 7f5eeb414700 1 --2- 172.21.15.146:0/4033734379 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555af1c11860 0x555af1b6a700 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f5ee4009530 tx=0x7f5ee4005ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a054cd29bd93edf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:18.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.870+0000 7f5ee9410700 1 -- 172.21.15.146:0/4033734379 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee400e070 con 0x555af1c11860 2023-10-06T11:09:18.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.871+0000 7f5ee9410700 1 -- 172.21.15.146:0/4033734379 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee4012410 con 0x555af1c11860 2023-10-06T11:09:18.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.871+0000 7f5ee9410700 1 -- 172.21.15.146:0/4033734379 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee40127d0 con 0x555af1c11860 2023-10-06T11:09:18.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.871+0000 7f5ef19d8000 1 -- 172.21.15.146:0/4033734379 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555af1c11860 msgr2=0x555af1b6a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:18.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.871+0000 7f5ef19d8000 1 --2- 172.21.15.146:0/4033734379 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555af1c11860 0x555af1b6a700 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f5ee4009530 tx=0x7f5ee4005ac0 comp rx=0 tx=0).stop 2023-10-06T11:09:18.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.871+0000 7f5ef19d8000 1 -- 172.21.15.146:0/4033734379 shutdown_connections 2023-10-06T11:09:18.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.871+0000 7f5ef19d8000 1 --2- 172.21.15.146:0/4033734379 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555af1c11860 0x555af1b6a700 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:18.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.871+0000 7f5ef19d8000 1 --2- 172.21.15.146:0/4033734379 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555af1bf9950 0x555af1c12a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:18.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.871+0000 7f5ef19d8000 1 --2- 172.21.15.146:0/4033734379 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555af1bf9d20 0x555af1b66810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:18.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.871+0000 7f5ef19d8000 1 -- 172.21.15.146:0/4033734379 >> 172.21.15.146:0/4033734379 conn(0x555af1b3d0a0 msgr2=0x555af1b68460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:18.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.871+0000 7f5ef19d8000 1 -- 172.21.15.146:0/4033734379 shutdown_connections 2023-10-06T11:09:18.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.871+0000 7f5ef19d8000 1 -- 172.21.15.146:0/4033734379 wait complete. 2023-10-06T11:09:18.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.872+0000 7f5ef19d8000 1 Processor -- start 2023-10-06T11:09:18.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.872+0000 7f5ef19d8000 1 -- start start 2023-10-06T11:09:18.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.872+0000 7f5ef19d8000 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555af1bf9950 0x555af1b809f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:18.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.872+0000 7f5ef19d8000 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555af1bf9d20 0x555af1bf37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:18.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.872+0000 7f5ef19d8000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555af1c11860 0x555af1b81470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:18.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.872+0000 7f5ef19d8000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af1bf4230 con 0x555af1c11860 2023-10-06T11:09:18.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.872+0000 7f5ef19d8000 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x555af1b80f30 con 0x555af1bf9d20 2023-10-06T11:09:18.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.872+0000 7f5ef19d8000 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x555af1b7fde0 con 0x555af1bf9950 2023-10-06T11:09:18.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.872+0000 7f5eeb414700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555af1c11860 0x555af1b81470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:18.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.872+0000 7f5eeb414700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555af1c11860 0x555af1b81470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53948/0 (socket says 172.21.15.146:53948) 2023-10-06T11:09:18.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.872+0000 7f5eeb414700 1 -- 172.21.15.146:0/3874575933 learned_addr learned my addr 172.21.15.146:0/3874575933 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:18.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.873+0000 7f5eeac13700 1 --2- 172.21.15.146:0/3874575933 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555af1bf9950 0x555af1b809f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:18.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.873+0000 7f5eea412700 1 --2- 172.21.15.146:0/3874575933 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555af1bf9d20 0x555af1bf37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:18.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.873+0000 7f5eeb414700 1 -- 172.21.15.146:0/3874575933 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555af1bf9950 msgr2=0x555af1b809f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:18.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.873+0000 7f5eeb414700 1 --2- 172.21.15.146:0/3874575933 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x555af1bf9950 0x555af1b809f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:18.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.873+0000 7f5eeb414700 1 -- 172.21.15.146:0/3874575933 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555af1bf9d20 msgr2=0x555af1bf37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:18.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.873+0000 7f5eeb414700 1 --2- 172.21.15.146:0/3874575933 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555af1bf9d20 0x555af1bf37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:18.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.873+0000 7f5eeb414700 1 -- 172.21.15.146:0/3874575933 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ee4005d80 con 0x555af1c11860 2023-10-06T11:09:18.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.873+0000 7f5eeb414700 1 --2- 172.21.15.146:0/3874575933 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555af1c11860 0x555af1b81470 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f5ee4009c80 tx=0x7f5ee4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:18.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.873+0000 7f5edb7fe700 1 -- 172.21.15.146:0/3874575933 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee4005be0 con 0x555af1c11860 2023-10-06T11:09:18.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.873+0000 7f5edb7fe700 1 -- 172.21.15.146:0/3874575933 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ee4005780 con 0x555af1c11860 2023-10-06T11:09:18.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.873+0000 7f5edb7fe700 1 -- 172.21.15.146:0/3874575933 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ee4007db0 con 0x555af1c11860 2023-10-06T11:09:18.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.873+0000 7f5ef19d8000 1 -- 172.21.15.146:0/3874575933 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555af1a953d0 con 0x555af1c11860 2023-10-06T11:09:18.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.873+0000 7f5ef19d8000 1 -- 172.21.15.146:0/3874575933 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555af1a88ae0 con 0x555af1c11860 2023-10-06T11:09:18.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.874+0000 7f5edb7fe700 1 -- 172.21.15.146:0/3874575933 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5ee401f670 con 0x555af1c11860 2023-10-06T11:09:18.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.875+0000 7f5edb7fe700 1 --2- 172.21.15.146:0/3874575933 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5ed00658c0 0x7f5ed0067d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:18.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.875+0000 7f5edb7fe700 1 -- 172.21.15.146:0/3874575933 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5ee4085200 con 0x555af1c11860 2023-10-06T11:09:18.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.875+0000 7f5eeac13700 1 --2- 172.21.15.146:0/3874575933 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5ed00658c0 0x7f5ed0067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:18.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.875+0000 7f5ef19d8000 1 --2- 172.21.15.146:0/3874575933 >> [v2:172.21.15.146:6808/90665,v1:172.21.15.146:6809/90665] conn(0x555af1c10fe0 0x555af1b5ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:18.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.875+0000 7f5ef19d8000 1 -- 172.21.15.146:0/3874575933 --> [v2:172.21.15.146:6808/90665,v1:172.21.15.146:6809/90665] -- osd_op(unknown.0.0:1 8.21 8:87acc59f:::10000000a48.00000000:head [rmxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47) v8 -- 0x555af1b5f370 con 0x555af1c10fe0 2023-10-06T11:09:18.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.875+0000 7f5eea412700 1 --2- 172.21.15.146:0/3874575933 >> [v2:172.21.15.146:6808/90665,v1:172.21.15.146:6809/90665] conn(0x555af1c10fe0 0x555af1b5ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:18.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.875+0000 7f5eeac13700 1 --2- 172.21.15.146:0/3874575933 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5ed00658c0 0x7f5ed0067d70 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5edc00e800 tx=0x7f5edc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:18.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.875+0000 7f5eea412700 1 --2- 172.21.15.146:0/3874575933 >> [v2:172.21.15.146:6808/90665,v1:172.21.15.146:6809/90665] conn(0x555af1c10fe0 0x555af1b5ee30 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:18.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.876+0000 7f5eea412700 1 -- 172.21.15.146:0/3874575933 <== osd.0 v2:172.21.15.146:6808/90665 1 ==== osd_op_reply(1 10000000a48.00000000 [rmxattr] v47'56 uv56 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f5ee0008a30 con 0x555af1c10fe0 2023-10-06T11:09:18.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.876+0000 7f5ef19d8000 1 -- 172.21.15.146:0/3874575933 >> [v2:172.21.15.146:6808/90665,v1:172.21.15.146:6809/90665] conn(0x555af1c10fe0 msgr2=0x555af1b5ee30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:18.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.876+0000 7f5ef19d8000 1 --2- 172.21.15.146:0/3874575933 >> [v2:172.21.15.146:6808/90665,v1:172.21.15.146:6809/90665] conn(0x555af1c10fe0 0x555af1b5ee30 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:18.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.876+0000 7f5ef19d8000 1 -- 172.21.15.146:0/3874575933 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5ed00658c0 msgr2=0x7f5ed0067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:18.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.876+0000 7f5ef19d8000 1 --2- 172.21.15.146:0/3874575933 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5ed00658c0 0x7f5ed0067d70 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5edc00e800 tx=0x7f5edc008040 comp rx=0 tx=0).stop 2023-10-06T11:09:18.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.876+0000 7f5ef19d8000 1 -- 172.21.15.146:0/3874575933 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555af1c11860 msgr2=0x555af1b81470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:18.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.876+0000 7f5ef19d8000 1 --2- 172.21.15.146:0/3874575933 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x555af1c11860 0x555af1b81470 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f5ee4009c80 tx=0x7f5ee4014000 comp rx=0 tx=0).stop 2023-10-06T11:09:18.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.876+0000 7f5eeb414700 1 -- 172.21.15.146:0/3874575933 reap_dead start 2023-10-06T11:09:18.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.877+0000 7f5ef19d8000 1 -- 172.21.15.146:0/3874575933 shutdown_connections 2023-10-06T11:09:18.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.877+0000 7f5ef19d8000 1 -- 172.21.15.146:0/3874575933 >> 172.21.15.146:0/3874575933 conn(0x555af1b3d0a0 msgr2=0x555af1c0fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:18.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.877+0000 7f5ef19d8000 1 -- 172.21.15.146:0/3874575933 shutdown_connections 2023-10-06T11:09:18.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:18.877+0000 7f5ef19d8000 1 -- 172.21.15.146:0/3874575933 wait complete. 2023-10-06T11:09:18.884 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_1' 2023-10-06T11:09:18.884 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start /scrub_test_path/ceph-qa-suite/new_file_1 2023-10-06T11:09:19.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.039+0000 7f0e47c60700 1 Processor -- start 2023-10-06T11:09:19.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.039+0000 7f0e47c60700 1 -- start start 2023-10-06T11:09:19.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.040+0000 7f0e47c60700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0e4015a160 0x7f0e400c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:19.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.040+0000 7f0e47c60700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0e400ae730 0x7f0e400aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:19.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.040+0000 7f0e47c60700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e400ce3d0 0x7f0e400ce810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:19.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.040+0000 7f0e47c60700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e400ae2a0 con 0x7f0e4015a160 2023-10-06T11:09:19.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.040+0000 7f0e47c60700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e4015a530 con 0x7f0e400ae730 2023-10-06T11:09:19.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.040+0000 7f0e47c60700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e400af0f0 con 0x7f0e400ce3d0 2023-10-06T11:09:19.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.040+0000 7f0e459fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0e4015a160 0x7f0e400c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:19.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.040+0000 7f0e459fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0e4015a160 0x7f0e400c55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53964/0 (socket says 172.21.15.146:53964) 2023-10-06T11:09:19.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.040+0000 7f0e459fc700 1 -- 172.21.15.146:0/769757028 learned_addr learned my addr 172.21.15.146:0/769757028 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:19.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.040+0000 7f0e451fb700 1 --2- 172.21.15.146:0/769757028 >> v2:172.21.15.151:3300/0 conn(0x7f0e400ae730 0x7f0e400aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:19.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.040+0000 7f0e461fd700 1 --2- 172.21.15.146:0/769757028 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e400ce3d0 0x7f0e400ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:19.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.040+0000 7f0e459fc700 1 -- 172.21.15.146:0/769757028 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e400ce3d0 msgr2=0x7f0e400ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:19.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.040+0000 7f0e459fc700 1 --2- 172.21.15.146:0/769757028 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e400ce3d0 0x7f0e400ce810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.040+0000 7f0e459fc700 1 -- 172.21.15.146:0/769757028 >> v2:172.21.15.151:3300/0 conn(0x7f0e400ae730 msgr2=0x7f0e400aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:19.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.040+0000 7f0e459fc700 1 --2- 172.21.15.146:0/769757028 >> v2:172.21.15.151:3300/0 conn(0x7f0e400ae730 0x7f0e400aebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.040+0000 7f0e459fc700 1 -- 172.21.15.146:0/769757028 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e400ad690 con 0x7f0e4015a160 2023-10-06T11:09:19.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.040+0000 7f0e459fc700 1 --2- 172.21.15.146:0/769757028 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e4015a160 0x7f0e400c55a0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f0e400d16e0 tx=0x7f0e3c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca1bf5d1bae2a2dc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:19.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.040+0000 7f0e449fa700 1 -- 172.21.15.146:0/769757028 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c005c10 con 0x7f0e4015a160 2023-10-06T11:09:19.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.041+0000 7f0e449fa700 1 -- 172.21.15.146:0/769757028 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3c005d70 con 0x7f0e4015a160 2023-10-06T11:09:19.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.041+0000 7f0e449fa700 1 -- 172.21.15.146:0/769757028 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c006260 con 0x7f0e4015a160 2023-10-06T11:09:19.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.041+0000 7f0e47c60700 1 -- 172.21.15.146:0/769757028 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e4015a160 msgr2=0x7f0e400c55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:19.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.041+0000 7f0e47c60700 1 --2- 172.21.15.146:0/769757028 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e4015a160 0x7f0e400c55a0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f0e400d16e0 tx=0x7f0e3c009220 comp rx=0 tx=0).stop 2023-10-06T11:09:19.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.041+0000 7f0e47c60700 1 -- 172.21.15.146:0/769757028 shutdown_connections 2023-10-06T11:09:19.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.041+0000 7f0e47c60700 1 --2- 172.21.15.146:0/769757028 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e400ce3d0 0x7f0e400ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.041+0000 7f0e47c60700 1 --2- 172.21.15.146:0/769757028 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e4015a160 0x7f0e400c55a0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.041+0000 7f0e47c60700 1 --2- 172.21.15.146:0/769757028 >> v2:172.21.15.151:3300/0 conn(0x7f0e400ae730 0x7f0e400aebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.041+0000 7f0e47c60700 1 -- 172.21.15.146:0/769757028 >> 172.21.15.146:0/769757028 conn(0x7f0e4006f380 msgr2=0x7f0e400d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:19.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.041+0000 7f0e47c60700 1 -- 172.21.15.146:0/769757028 shutdown_connections 2023-10-06T11:09:19.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.041+0000 7f0e47c60700 1 -- 172.21.15.146:0/769757028 wait complete. 2023-10-06T11:09:19.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.042+0000 7f0e47c60700 1 Processor -- start 2023-10-06T11:09:19.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.042+0000 7f0e47c60700 1 -- start start 2023-10-06T11:09:19.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.043+0000 7f0e47c60700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e400ae730 0x7f0e4015dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:19.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.043+0000 7f0e47c60700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e400ce3d0 0x7f0e400687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:19.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.043+0000 7f0e47c60700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e4015a160 0x7f0e40157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:19.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.043+0000 7f0e47c60700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4015f1b0 con 0x7f0e400ce3d0 2023-10-06T11:09:19.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.043+0000 7f0e47c60700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4015e5a0 con 0x7f0e4015a160 2023-10-06T11:09:19.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.043+0000 7f0e47c60700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4015e880 con 0x7f0e400ae730 2023-10-06T11:09:19.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.043+0000 7f0e451fb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e400ce3d0 0x7f0e400687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:19.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.043+0000 7f0e451fb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e400ce3d0 0x7f0e400687a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53974/0 (socket says 172.21.15.146:53974) 2023-10-06T11:09:19.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.043+0000 7f0e451fb700 1 -- 172.21.15.146:0/710735538 learned_addr learned my addr 172.21.15.146:0/710735538 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:19.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.043+0000 7f0e461fd700 1 --2- 172.21.15.146:0/710735538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e4015a160 0x7f0e40157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:19.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.043+0000 7f0e459fc700 1 --2- 172.21.15.146:0/710735538 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e400ae730 0x7f0e4015dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:19.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.043+0000 7f0e451fb700 1 -- 172.21.15.146:0/710735538 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e400ae730 msgr2=0x7f0e4015dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:19.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.043+0000 7f0e451fb700 1 --2- 172.21.15.146:0/710735538 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e400ae730 0x7f0e4015dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.043+0000 7f0e451fb700 1 -- 172.21.15.146:0/710735538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e4015a160 msgr2=0x7f0e40157450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:19.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.043+0000 7f0e451fb700 1 --2- 172.21.15.146:0/710735538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e4015a160 0x7f0e40157450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.043+0000 7f0e451fb700 1 -- 172.21.15.146:0/710735538 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3c009480 con 0x7f0e400ce3d0 2023-10-06T11:09:19.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.043+0000 7f0e451fb700 1 --2- 172.21.15.146:0/710735538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e400ce3d0 0x7f0e400687a0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f0e3000e930 tx=0x7f0e300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:19.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.044+0000 7f0e35ffb700 1 -- 172.21.15.146:0/710735538 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3000eed0 con 0x7f0e400ce3d0 2023-10-06T11:09:19.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.044+0000 7f0e35ffb700 1 -- 172.21.15.146:0/710735538 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3000c850 con 0x7f0e400ce3d0 2023-10-06T11:09:19.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.044+0000 7f0e47c60700 1 -- 172.21.15.146:0/710735538 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e4015eb60 con 0x7f0e400ce3d0 2023-10-06T11:09:19.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.044+0000 7f0e35ffb700 1 -- 172.21.15.146:0/710735538 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3000cbf0 con 0x7f0e400ce3d0 2023-10-06T11:09:19.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.044+0000 7f0e47c60700 1 -- 172.21.15.146:0/710735538 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e4015e190 con 0x7f0e400ce3d0 2023-10-06T11:09:19.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.045+0000 7f0e35ffb700 1 -- 172.21.15.146:0/710735538 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0e30013470 con 0x7f0e400ce3d0 2023-10-06T11:09:19.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.046+0000 7f0e35ffb700 1 --2- 172.21.15.146:0/710735538 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0e24066f30 0x7f0e240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:19.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.046+0000 7f0e35ffb700 1 -- 172.21.15.146:0/710735538 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0e30084920 con 0x7f0e400ce3d0 2023-10-06T11:09:19.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.046+0000 7f0e459fc700 1 --2- 172.21.15.146:0/710735538 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0e24066f30 0x7f0e240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:19.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.046+0000 7f0e459fc700 1 --2- 172.21.15.146:0/710735538 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0e24066f30 0x7f0e240693e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c009260 tx=0x7f0e3c016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:19.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.047+0000 7f0e50f58b80 1 Processor -- start 2023-10-06T11:09:19.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.048+0000 7f0e50f58b80 1 -- start start 2023-10-06T11:09:19.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.048+0000 7f0e50f58b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556842c56b80 0x556842c56f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:19.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.048+0000 7f0e50f58b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556842c12a90 0x556842c0f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:19.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.048+0000 7f0e50f58b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556842c10cc0 0x556842c0fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:19.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.048+0000 7f0e50f58b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x556842b8fd70 con 0x556842c12a90 2023-10-06T11:09:19.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.048+0000 7f0e50f58b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x556842b66b60 con 0x556842c56b80 2023-10-06T11:09:19.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.048+0000 7f0e50f58b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x556842b64360 con 0x556842c10cc0 2023-10-06T11:09:19.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.048+0000 7f0e451fb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556842c12a90 0x556842c0f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:19.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.048+0000 7f0e451fb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556842c12a90 0x556842c0f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53986/0 (socket says 172.21.15.146:53986) 2023-10-06T11:09:19.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.048+0000 7f0e451fb700 1 -- 172.21.15.146:0/1137952039 learned_addr learned my addr 172.21.15.146:0/1137952039 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:19.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.048+0000 7f0e461fd700 1 --2- 172.21.15.146:0/1137952039 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556842c10cc0 0x556842c0fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:19.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.049+0000 7f0e459fc700 1 --2- 172.21.15.146:0/1137952039 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556842c56b80 0x556842c56f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:19.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.049+0000 7f0e451fb700 1 -- 172.21.15.146:0/1137952039 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556842c10cc0 msgr2=0x556842c0fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:19.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.049+0000 7f0e451fb700 1 --2- 172.21.15.146:0/1137952039 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556842c10cc0 0x556842c0fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.049+0000 7f0e451fb700 1 -- 172.21.15.146:0/1137952039 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556842c56b80 msgr2=0x556842c56f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:19.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.049+0000 7f0e451fb700 1 --2- 172.21.15.146:0/1137952039 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556842c56b80 0x556842c56f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.049+0000 7f0e451fb700 1 -- 172.21.15.146:0/1137952039 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568429fa360 con 0x556842c12a90 2023-10-06T11:09:19.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.049+0000 7f0e461fd700 1 --2- 172.21.15.146:0/1137952039 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556842c10cc0 0x556842c0fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:19.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.049+0000 7f0e459fc700 1 --2- 172.21.15.146:0/1137952039 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556842c56b80 0x556842c56f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:19.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.049+0000 7f0e451fb700 1 --2- 172.21.15.146:0/1137952039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556842c12a90 0x556842c0f670 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f0e30082c10 tx=0x7f0e30082ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a1a2db4b0f69ad0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:19.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.049+0000 7f0e2affd700 1 -- 172.21.15.146:0/1137952039 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e30067ea0 con 0x556842c12a90 2023-10-06T11:09:19.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.049+0000 7f0e2affd700 1 -- 172.21.15.146:0/1137952039 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e30055190 con 0x556842c12a90 2023-10-06T11:09:19.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.049+0000 7f0e2affd700 1 -- 172.21.15.146:0/1137952039 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3005c5f0 con 0x556842c12a90 2023-10-06T11:09:19.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.049+0000 7f0e50f58b80 1 -- 172.21.15.146:0/1137952039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556842c12a90 msgr2=0x556842c0f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:19.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.049+0000 7f0e50f58b80 1 --2- 172.21.15.146:0/1137952039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556842c12a90 0x556842c0f670 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f0e30082c10 tx=0x7f0e30082ba0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.050+0000 7f0e50f58b80 1 -- 172.21.15.146:0/1137952039 shutdown_connections 2023-10-06T11:09:19.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.050+0000 7f0e50f58b80 1 --2- 172.21.15.146:0/1137952039 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556842c10cc0 0x556842c0fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.050+0000 7f0e50f58b80 1 --2- 172.21.15.146:0/1137952039 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556842c56b80 0x556842c56f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.050+0000 7f0e50f58b80 1 --2- 172.21.15.146:0/1137952039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556842c12a90 0x556842c0f670 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.050+0000 7f0e50f58b80 1 -- 172.21.15.146:0/1137952039 >> 172.21.15.146:0/1137952039 conn(0x556842c11160 msgr2=0x556842c11530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.050+0000 7f0e50f58b80 1 -- 172.21.15.146:0/1137952039 shutdown_connections 2023-10-06T11:09:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.050+0000 7f0e50f58b80 1 -- 172.21.15.146:0/1137952039 wait complete. 2023-10-06T11:09:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.050+0000 7f0e50f58b80 1 -- start start 2023-10-06T11:09:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.050+0000 7f0e50f58b80 1 Processor -- start 2023-10-06T11:09:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.051+0000 7f0e50f58b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556842c10cc0 0x556842c65c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.051+0000 7f0e50f58b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556842c12a90 0x556842c3b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.051+0000 7f0e50f58b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556842c56b80 0x556842c3bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.051+0000 7f0e50f58b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x556842b60150 con 0x556842c12a90 2023-10-06T11:09:19.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.051+0000 7f0e50f58b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x556842b0b980 con 0x556842c10cc0 2023-10-06T11:09:19.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.051+0000 7f0e50f58b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x556842b26f90 con 0x556842c56b80 2023-10-06T11:09:19.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.051+0000 7f0e50f58b80 10 client.0 _ll_register_callbacks cb 0x5568429fd020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:09:19.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.051+0000 7f0e451fb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556842c12a90 0x556842c3b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:19.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.051+0000 7f0e451fb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556842c12a90 0x556842c3b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53992/0 (socket says 172.21.15.146:53992) 2023-10-06T11:09:19.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.051+0000 7f0e451fb700 1 -- 172.21.15.146:0/3268138126 learned_addr learned my addr 172.21.15.146:0/3268138126 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:19.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.051+0000 7f0e459fc700 1 --2- 172.21.15.146:0/3268138126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556842c10cc0 0x556842c65c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:19.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.051+0000 7f0e461fd700 1 --2- 172.21.15.146:0/3268138126 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556842c56b80 0x556842c3bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:19.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.052+0000 7f0e451fb700 1 -- 172.21.15.146:0/3268138126 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556842c56b80 msgr2=0x556842c3bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:19.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.052+0000 7f0e451fb700 1 --2- 172.21.15.146:0/3268138126 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556842c56b80 0x556842c3bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.052+0000 7f0e451fb700 1 -- 172.21.15.146:0/3268138126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556842c10cc0 msgr2=0x556842c65c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:19.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.052+0000 7f0e451fb700 1 --2- 172.21.15.146:0/3268138126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556842c10cc0 0x556842c65c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.052+0000 7f0e451fb700 1 -- 172.21.15.146:0/3268138126 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e4015e190 con 0x556842c12a90 2023-10-06T11:09:19.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.052+0000 7f0e451fb700 1 --2- 172.21.15.146:0/3268138126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556842c12a90 0x556842c3b9b0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f0e3000e900 tx=0x7f0e3006b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e9e62a58643e775 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:19.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.052+0000 7f0e1ffff700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:09:19.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.052+0000 7f0e1ffff700 1 -- 172.21.15.146:0/3268138126 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e30071290 con 0x556842c12a90 2023-10-06T11:09:19.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.052+0000 7f0e1ffff700 1 -- 172.21.15.146:0/3268138126 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0e30054b40 con 0x556842c12a90 2023-10-06T11:09:19.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.052+0000 7f0e50f58b80 1 -- 172.21.15.146:0/3268138126 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556842c04780 con 0x556842c12a90 2023-10-06T11:09:19.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.052+0000 7f0e1ffff700 1 -- 172.21.15.146:0/3268138126 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e3005c160 con 0x556842c12a90 2023-10-06T11:09:19.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.052+0000 7f0e50f58b80 10 client.6042 fetch_fsmap learned FSMap version 37 2023-10-06T11:09:19.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.052+0000 7f0e50f58b80 1 -- 172.21.15.146:0/3268138126 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x55684299d0d0 con 0x556842c12a90 2023-10-06T11:09:19.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.052+0000 7f0e1ffff700 1 -- 172.21.15.146:0/3268138126 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556842c04780 con 0x556842c12a90 2023-10-06T11:09:19.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.052+0000 7f0e1ffff700 1 -- 172.21.15.146:0/3268138126 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 37) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0e30051440 con 0x556842c12a90 2023-10-06T11:09:19.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.052+0000 7f0e50f58b80 10 client.6042 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T11:09:19.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.052+0000 7f0e50f58b80 10 client.6042 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-10-06T11:09:19.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.052+0000 7f0e50f58b80 20 client.6042 populate_metadata read hostname 'smithi146' 2023-10-06T11:09:19.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.052+0000 7f0e50f58b80 1 --2- 172.21.15.146:0/3268138126 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x556842c38b80 0x556842c4dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:19.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.052+0000 7f0e50f58b80 4 client.6042 mds_command: new command op to 5481 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:09:19.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.052+0000 7f0e50f58b80 1 -- 172.21.15.146:0/3268138126 --> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556842be16b0 con 0x556842c38b80 2023-10-06T11:09:19.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.052+0000 7f0e459fc700 1 --2- 172.21.15.146:0/3268138126 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x556842c38b80 0x556842c4dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:19.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.053+0000 7f0e1ffff700 10 client.6042 ms_handle_connect on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:19.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.053+0000 7f0e459fc700 1 --2- 172.21.15.146:0/3268138126 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x556842c38b80 0x556842c4dfb0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a78a91b656b57d9 server_cookie=ee6fee0cb32efbd3 in_seq=0 out_seq=0 2023-10-06T11:09:19.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.053+0000 7f0e1ffff700 1 -- 172.21.15.146:0/3268138126 <== mds.0 v2:172.21.15.146:6835/2252184844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x556842be16b0 con 0x556842c38b80 2023-10-06T11:09:19.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.053+0000 7f0e1ffff700 10 client.6042 handle_command_reply: tid=0 2023-10-06T11:09:19.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.053+0000 7f0e50f58b80 1 client.6042 shutdown 2023-10-06T11:09:19.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.053+0000 7f0e50f58b80 1 -- 172.21.15.146:0/3268138126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556842c12a90 msgr2=0x556842c3b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:19.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.053+0000 7f0e50f58b80 1 --2- 172.21.15.146:0/3268138126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556842c12a90 0x556842c3b9b0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f0e3000e900 tx=0x7f0e3006b000 comp rx=0 tx=0).stop 2023-10-06T11:09:19.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.053+0000 7f0e50f58b80 1 -- 172.21.15.146:0/3268138126 shutdown_connections 2023-10-06T11:09:19.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.053+0000 7f0e50f58b80 1 --2- 172.21.15.146:0/3268138126 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x556842c38b80 0x556842c4dfb0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.053+0000 7f0e50f58b80 1 --2- 172.21.15.146:0/3268138126 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556842c56b80 0x556842c3bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.053+0000 7f0e50f58b80 1 --2- 172.21.15.146:0/3268138126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556842c10cc0 0x556842c65c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.053+0000 7f0e1ffff700 0 client.6042 ms_handle_reset on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:19.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.053+0000 7f0e50f58b80 1 --2- 172.21.15.146:0/3268138126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556842c12a90 0x556842c3b9b0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.053+0000 7f0e50f58b80 1 -- 172.21.15.146:0/3268138126 >> 172.21.15.146:0/3268138126 conn(0x556842c11160 msgr2=0x556842c560d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:19.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.053+0000 7f0e50f58b80 1 -- 172.21.15.146:0/3268138126 shutdown_connections 2023-10-06T11:09:19.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.054+0000 7f0e50f58b80 1 -- 172.21.15.146:0/3268138126 wait complete. 2023-10-06T11:09:19.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.054+0000 7f0e50f58b80 20 client.6042 trim_cache size 0 max 16384 2023-10-06T11:09:19.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.070+0000 7f0e50f58b80 1 Processor -- start 2023-10-06T11:09:19.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.070+0000 7f0e50f58b80 1 -- start start 2023-10-06T11:09:19.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.070+0000 7f0e50f58b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556842c10cc0 0x556842c5a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:19.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.070+0000 7f0e50f58b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556842c12a90 0x556842c3b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:19.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.070+0000 7f0e50f58b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556842c56b80 0x556842c4e180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:19.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.070+0000 7f0e50f58b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568429e2f20 con 0x556842c12a90 2023-10-06T11:09:19.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.070+0000 7f0e50f58b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x556842c574f0 con 0x556842c56b80 2023-10-06T11:09:19.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.070+0000 7f0e50f58b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x556842c6f890 con 0x556842c10cc0 2023-10-06T11:09:19.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.070+0000 7f0e451fb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556842c12a90 0x556842c3b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:19.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.070+0000 7f0e451fb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556842c12a90 0x556842c3b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54006/0 (socket says 172.21.15.146:54006) 2023-10-06T11:09:19.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.070+0000 7f0e451fb700 1 -- 172.21.15.146:0/778341610 learned_addr learned my addr 172.21.15.146:0/778341610 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:19.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.071+0000 7f0e461fd700 1 --2- 172.21.15.146:0/778341610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556842c56b80 0x556842c4e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:19.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.071+0000 7f0e459fc700 1 --2- 172.21.15.146:0/778341610 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556842c10cc0 0x556842c5a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:19.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.071+0000 7f0e451fb700 1 -- 172.21.15.146:0/778341610 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556842c10cc0 msgr2=0x556842c5a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:19.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.071+0000 7f0e451fb700 1 --2- 172.21.15.146:0/778341610 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556842c10cc0 0x556842c5a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.071+0000 7f0e451fb700 1 -- 172.21.15.146:0/778341610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556842c56b80 msgr2=0x556842c4e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:19.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.071+0000 7f0e451fb700 1 --2- 172.21.15.146:0/778341610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556842c56b80 0x556842c4e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.071+0000 7f0e451fb700 1 -- 172.21.15.146:0/778341610 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556842b2e870 con 0x556842c12a90 2023-10-06T11:09:19.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.071+0000 7f0e461fd700 1 --2- 172.21.15.146:0/778341610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556842c56b80 0x556842c4e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:09:19.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.071+0000 7f0e459fc700 1 --2- 172.21.15.146:0/778341610 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556842c10cc0 0x556842c5a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:09:19.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.071+0000 7f0e451fb700 1 --2- 172.21.15.146:0/778341610 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556842c12a90 0x556842c3b770 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f0e30067fd0 tx=0x7f0e3006e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bdaffbe9e2f15a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:19.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.071+0000 7f0e2b7fe700 1 -- 172.21.15.146:0/778341610 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e300588a0 con 0x556842c12a90 2023-10-06T11:09:19.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.071+0000 7f0e2b7fe700 1 -- 172.21.15.146:0/778341610 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3000e040 con 0x556842c12a90 2023-10-06T11:09:19.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.071+0000 7f0e2b7fe700 1 -- 172.21.15.146:0/778341610 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e30054b40 con 0x556842c12a90 2023-10-06T11:09:19.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.071+0000 7f0e50f58b80 1 -- 172.21.15.146:0/778341610 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556842c12a90 msgr2=0x556842c3b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:19.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.071+0000 7f0e50f58b80 1 --2- 172.21.15.146:0/778341610 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556842c12a90 0x556842c3b770 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f0e30067fd0 tx=0x7f0e3006e040 comp rx=0 tx=0).stop 2023-10-06T11:09:19.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.071+0000 7f0e50f58b80 1 -- 172.21.15.146:0/778341610 shutdown_connections 2023-10-06T11:09:19.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.071+0000 7f0e50f58b80 1 --2- 172.21.15.146:0/778341610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556842c56b80 0x556842c4e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.071+0000 7f0e50f58b80 1 --2- 172.21.15.146:0/778341610 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556842c10cc0 0x556842c5a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.071+0000 7f0e50f58b80 1 --2- 172.21.15.146:0/778341610 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556842c12a90 0x556842c3b770 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.071+0000 7f0e50f58b80 1 -- 172.21.15.146:0/778341610 >> 172.21.15.146:0/778341610 conn(0x556842c11160 msgr2=0x556842c0cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:19.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.072+0000 7f0e50f58b80 1 -- 172.21.15.146:0/778341610 shutdown_connections 2023-10-06T11:09:19.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.072+0000 7f0e50f58b80 1 -- 172.21.15.146:0/778341610 wait complete. 2023-10-06T11:09:19.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.072+0000 7f0e50f58b80 1 -- start start 2023-10-06T11:09:19.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.072+0000 7f0e50f58b80 1 Processor -- start 2023-10-06T11:09:19.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.073+0000 7f0e50f58b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556842c10cc0 0x556842c65bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:19.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.073+0000 7f0e50f58b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556842c12a90 0x556842c66100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:19.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.073+0000 7f0e50f58b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556842c56b80 0x556842cb1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:19.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.073+0000 7f0e50f58b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x556842c75a90 con 0x556842c56b80 2023-10-06T11:09:19.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.073+0000 7f0e50f58b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x556842c37fc0 con 0x556842c12a90 2023-10-06T11:09:19.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.073+0000 7f0e50f58b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x556842c755c0 con 0x556842c10cc0 2023-10-06T11:09:19.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.073+0000 7f0e50f58b80 10 client.0 _ll_register_callbacks cb 0x5568429fd020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:09:19.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.073+0000 7f0e461fd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556842c56b80 0x556842cb1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:19.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.073+0000 7f0e461fd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556842c56b80 0x556842cb1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54022/0 (socket says 172.21.15.146:54022) 2023-10-06T11:09:19.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.073+0000 7f0e461fd700 1 -- 172.21.15.146:0/1005492580 learned_addr learned my addr 172.21.15.146:0/1005492580 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:19.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.073+0000 7f0e451fb700 1 --2- 172.21.15.146:0/1005492580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556842c12a90 0x556842c66100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:19.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.073+0000 7f0e459fc700 1 --2- 172.21.15.146:0/1005492580 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556842c10cc0 0x556842c65bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:19.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.073+0000 7f0e461fd700 1 -- 172.21.15.146:0/1005492580 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556842c10cc0 msgr2=0x556842c65bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:19.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.073+0000 7f0e461fd700 1 --2- 172.21.15.146:0/1005492580 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556842c10cc0 0x556842c65bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.073+0000 7f0e461fd700 1 -- 172.21.15.146:0/1005492580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556842c12a90 msgr2=0x556842c66100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:19.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.073+0000 7f0e461fd700 1 --2- 172.21.15.146:0/1005492580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556842c12a90 0x556842c66100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.073+0000 7f0e461fd700 1 -- 172.21.15.146:0/1005492580 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55684299d0d0 con 0x556842c56b80 2023-10-06T11:09:19.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.073+0000 7f0e459fc700 1 --2- 172.21.15.146:0/1005492580 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556842c10cc0 0x556842c65bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:19.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.074+0000 7f0e461fd700 1 --2- 172.21.15.146:0/1005492580 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556842c56b80 0x556842cb1440 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x556842c11130 tx=0x7f0e3800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44d3b17c39050f0a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:19.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.074+0000 7f0e1ffff700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:09:19.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.074+0000 7f0e1ffff700 1 -- 172.21.15.146:0/1005492580 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3800e040 con 0x556842c56b80 2023-10-06T11:09:19.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.074+0000 7f0e1ffff700 1 -- 172.21.15.146:0/1005492580 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0e38007da0 con 0x556842c56b80 2023-10-06T11:09:19.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.074+0000 7f0e50f58b80 1 -- 172.21.15.146:0/1005492580 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0e30055190 con 0x556842c56b80 2023-10-06T11:09:19.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.074+0000 7f0e1ffff700 1 -- 172.21.15.146:0/1005492580 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e38018630 con 0x556842c56b80 2023-10-06T11:09:19.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.074+0000 7f0e50f58b80 10 client.6048 fetch_fsmap learned FSMap version 37 2023-10-06T11:09:19.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.074+0000 7f0e50f58b80 1 -- 172.21.15.146:0/1005492580 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x556842b15560 con 0x556842c56b80 2023-10-06T11:09:19.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.074+0000 7f0e1ffff700 1 -- 172.21.15.146:0/1005492580 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e30055190 con 0x556842c56b80 2023-10-06T11:09:19.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.074+0000 7f0e1ffff700 1 -- 172.21.15.146:0/1005492580 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 37) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0e38014050 con 0x556842c56b80 2023-10-06T11:09:19.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.074+0000 7f0e50f58b80 10 client.6048 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T11:09:19.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.074+0000 7f0e50f58b80 10 client.6048 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-10-06T11:09:19.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.074+0000 7f0e50f58b80 20 client.6048 populate_metadata read hostname 'smithi146' 2023-10-06T11:09:19.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.074+0000 7f0e50f58b80 1 --2- 172.21.15.146:0/1005492580 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x556842cb1980 0x556842cbf430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:19.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.074+0000 7f0e50f58b80 4 client.6048 mds_command: new command op to 5481 tid=0[{"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}] 2023-10-06T11:09:19.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.074+0000 7f0e50f58b80 1 -- 172.21.15.146:0/1005492580 --> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_test_path/ceph-qa-suite/new_file_1"}) v1 -- 0x556842b02ef0 con 0x556842cb1980 2023-10-06T11:09:19.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.074+0000 7f0e459fc700 1 --2- 172.21.15.146:0/1005492580 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x556842cb1980 0x556842cbf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:19.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.075+0000 7f0e1ffff700 10 client.6048 ms_handle_connect on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:19.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.075+0000 7f0e459fc700 1 --2- 172.21.15.146:0/1005492580 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x556842cb1980 0x556842cbf430 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a59fd83eabe934f server_cookie=73dcfdce93c3c848 in_seq=0 out_seq=0 2023-10-06T11:09:19.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.075+0000 7f0e1ffff700 1 -- 172.21.15.146:0/1005492580 <== mds.0 v2:172.21.15.146:6835/2252184844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x556842b02ef0 con 0x556842cb1980 2023-10-06T11:09:19.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.075+0000 7f0e1ffff700 10 client.6048 handle_command_reply: tid=0 2023-10-06T11:09:19.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.075+0000 7f0e50f58b80 1 client.6048 shutdown 2023-10-06T11:09:19.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.075+0000 7f0e50f58b80 1 -- 172.21.15.146:0/1005492580 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556842c56b80 msgr2=0x556842cb1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:19.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.075+0000 7f0e50f58b80 1 --2- 172.21.15.146:0/1005492580 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556842c56b80 0x556842cb1440 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x556842c11130 tx=0x7f0e3800b040 comp rx=0 tx=0).stop 2023-10-06T11:09:19.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.075+0000 7f0e50f58b80 1 -- 172.21.15.146:0/1005492580 shutdown_connections 2023-10-06T11:09:19.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.075+0000 7f0e50f58b80 1 --2- 172.21.15.146:0/1005492580 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x556842cb1980 0x556842cbf430 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.075+0000 7f0e50f58b80 1 --2- 172.21.15.146:0/1005492580 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556842c56b80 0x556842cb1440 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.075+0000 7f0e50f58b80 1 --2- 172.21.15.146:0/1005492580 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556842c10cc0 0x556842c65bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.075+0000 7f0e50f58b80 1 --2- 172.21.15.146:0/1005492580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556842c12a90 0x556842c66100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.075+0000 7f0e50f58b80 1 -- 172.21.15.146:0/1005492580 >> 172.21.15.146:0/1005492580 conn(0x556842c11160 msgr2=0x556842c55e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:19.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.075+0000 7f0e1ffff700 0 client.6048 ms_handle_reset on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:19.084 INFO:tasks.ceph.mds.c.smithi146.stderr:2023-10-06T11:09:19.075+0000 7ff437454700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a48 [2,head] /scrub_test_path/ceph-qa-suite/new_file_1 auth v847 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={5670=0-4194304@1} caps={5670=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@3},l=5670 | request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x5566dd7b1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000a48:[<0x10000000001/new_file_1 v847>,<0x10000000000/ceph-qa-suite v92>,<0x1/scrub_test_path v33>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":-61} 2023-10-06T11:09:19.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.075+0000 7f0e50f58b80 1 -- 172.21.15.146:0/1005492580 shutdown_connections 2023-10-06T11:09:19.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.075+0000 7f0e50f58b80 1 -- 172.21.15.146:0/1005492580 wait complete. 2023-10-06T11:09:19.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.075+0000 7f0e50f58b80 20 client.6048 trim_cache size 0 max 16384 2023-10-06T11:09:19.085 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:09:19.085 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0, 2023-10-06T11:09:19.085 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_tag": "c8d65b2e-1da9-499f-8d6e-21743fb958ec", 2023-10-06T11:09:19.085 INFO:teuthology.orchestra.run.smithi146.stdout: "mode": "asynchronous" 2023-10-06T11:09:19.085 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:09:19.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.076+0000 7f0e47c60700 1 -- 172.21.15.146:0/710735538 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0e24066f30 msgr2=0x7f0e240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:19.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.076+0000 7f0e47c60700 1 --2- 172.21.15.146:0/710735538 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0e24066f30 0x7f0e240693e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c009260 tx=0x7f0e3c016000 comp rx=0 tx=0).stop 2023-10-06T11:09:19.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.076+0000 7f0e47c60700 1 -- 172.21.15.146:0/710735538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e400ce3d0 msgr2=0x7f0e400687a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:19.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.076+0000 7f0e47c60700 1 --2- 172.21.15.146:0/710735538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e400ce3d0 0x7f0e400687a0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f0e3000e930 tx=0x7f0e300091a0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.076+0000 7f0e47c60700 1 -- 172.21.15.146:0/710735538 shutdown_connections 2023-10-06T11:09:19.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.076+0000 7f0e47c60700 1 --2- 172.21.15.146:0/710735538 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0e24066f30 0x7f0e240693e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.076+0000 7f0e47c60700 1 --2- 172.21.15.146:0/710735538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e4015a160 0x7f0e40157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.076+0000 7f0e47c60700 1 --2- 172.21.15.146:0/710735538 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e400ae730 0x7f0e4015dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.076+0000 7f0e47c60700 1 --2- 172.21.15.146:0/710735538 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e400ce3d0 0x7f0e400687a0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.076+0000 7f0e47c60700 1 -- 172.21.15.146:0/710735538 >> 172.21.15.146:0/710735538 conn(0x7f0e4006f380 msgr2=0x7f0e40159690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:19.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.076+0000 7f0e47c60700 1 -- 172.21.15.146:0/710735538 shutdown_connections 2023-10-06T11:09:19.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.076+0000 7f0e47c60700 1 -- 172.21.15.146:0/710735538 wait complete. 2023-10-06T11:09:19.089 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_test_path/ceph-qa-suite/new_file_1' returned '{'return_code': 0, 'scrub_tag': 'c8d65b2e-1da9-499f-8d6e-21743fb958ec', 'mode': 'asynchronous'}' 2023-10-06T11:09:19.089 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub status 2023-10-06T11:09:19.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.205+0000 7f6ea1a07700 1 Processor -- start 2023-10-06T11:09:19.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.205+0000 7f6ea1a07700 1 -- start start 2023-10-06T11:09:19.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.206+0000 7f6ea1a07700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6e9c06f3c0 0x7f6e9c15aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:19.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.206+0000 7f6ea1a07700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e9c15b3f0 0x7f6e9c0c0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:19.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.206+0000 7f6ea1a07700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e9c0c7e80 con 0x7f6e9c154cb0 2023-10-06T11:09:19.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.206+0000 7f6ea1a07700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e9c0c6ff0 con 0x7f6e9c06f3c0 2023-10-06T11:09:19.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.206+0000 7f6ea1a07700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9c15b810 con 0x7f6e9c15b3f0 2023-10-06T11:09:19.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.206+0000 7f6ea0a05700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6e9c154cb0 0x7f6e9c0c68e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50958/0 (socket says 172.21.15.146:50958) 2023-10-06T11:09:19.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.206+0000 7f6ea0a05700 1 -- 172.21.15.146:0/1476858696 learned_addr learned my addr 172.21.15.146:0/1476858696 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:19.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.206+0000 7f6e9b7fe700 1 -- 172.21.15.146:0/1476858696 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3664263128 0 0) 0x7f6e9c0c7e80 con 0x7f6e9c154cb0 2023-10-06T11:09:19.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.206+0000 7f6ea1206700 1 --2- 172.21.15.146:0/1476858696 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e9c15b3f0 0x7f6e9c0c0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:19.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.206+0000 7f6e9b7fe700 1 -- 172.21.15.146:0/1476858696 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e8c003570 con 0x7f6e9c154cb0 2023-10-06T11:09:19.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.206+0000 7f6e9bfff700 1 --2- 172.21.15.146:0/1476858696 >> v2:172.21.15.151:3300/0 conn(0x7f6e9c06f3c0 0x7f6e9c15aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:19.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.206+0000 7f6e9b7fe700 1 -- 172.21.15.146:0/1476858696 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 40111719 0 0) 0x7f6e8c003570 con 0x7f6e9c154cb0 2023-10-06T11:09:19.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.207+0000 7f6e9b7fe700 1 -- 172.21.15.146:0/1476858696 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e9c15b3f0 msgr2=0x7f6e9c0c0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:19.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.207+0000 7f6e9b7fe700 1 --2- 172.21.15.146:0/1476858696 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e9c15b3f0 0x7f6e9c0c0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.207+0000 7f6e9b7fe700 1 -- 172.21.15.146:0/1476858696 >> v2:172.21.15.151:3300/0 conn(0x7f6e9c06f3c0 msgr2=0x7f6e9c15aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:19.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.207+0000 7f6e9b7fe700 1 --2- 172.21.15.146:0/1476858696 >> v2:172.21.15.151:3300/0 conn(0x7f6e9c06f3c0 0x7f6e9c15aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.207+0000 7f6e9b7fe700 1 -- 172.21.15.146:0/1476858696 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e9c0c7270 con 0x7f6e9c154cb0 2023-10-06T11:09:19.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.207+0000 7f6e9b7fe700 1 -- 172.21.15.146:0/1476858696 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f6e90001470 con 0x7f6e9c154cb0 2023-10-06T11:09:19.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.207+0000 7f6e9b7fe700 1 -- 172.21.15.146:0/1476858696 >> v1:172.21.15.146:6789/0 conn(0x7f6e9c154cb0 legacy=0x7f6e9c0c68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:19.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.207+0000 7f6e9b7fe700 1 --2- 172.21.15.146:0/1476858696 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e9c15b3f0 0x7f6e8c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:19.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.207+0000 7f6e9b7fe700 1 --2- 172.21.15.146:0/1476858696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e8c003fe0 0x7f6e8c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:19.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.207+0000 7f6e9b7fe700 1 --2- 172.21.15.146:0/1476858696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e8c004d50 0x7f6e8c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:19.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.207+0000 7f6e9b7fe700 1 -- 172.21.15.146:0/1476858696 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9c0c6ff0 con 0x7f6e8c003fe0 2023-10-06T11:09:19.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.207+0000 7f6e9b7fe700 1 -- 172.21.15.146:0/1476858696 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9c15b810 con 0x7f6e8c004d50 2023-10-06T11:09:19.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.207+0000 7f6e9b7fe700 1 -- 172.21.15.146:0/1476858696 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8c00ba90 con 0x7f6e9c15b3f0 2023-10-06T11:09:19.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.207+0000 7f6e9bfff700 1 --2- 172.21.15.146:0/1476858696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e8c003fe0 0x7f6e8c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:19.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.207+0000 7f6ea0a05700 1 --2- 172.21.15.146:0/1476858696 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e9c15b3f0 0x7f6e8c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:19.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.207+0000 7f6ea1206700 1 --2- 172.21.15.146:0/1476858696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e8c004d50 0x7f6e8c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:19.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.207+0000 7f6e9bfff700 1 -- 172.21.15.146:0/1476858696 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e9c15b3f0 msgr2=0x7f6e8c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:19.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.207+0000 7f6e9bfff700 1 --2- 172.21.15.146:0/1476858696 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e9c15b3f0 0x7f6e8c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.207+0000 7f6e9bfff700 1 -- 172.21.15.146:0/1476858696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e8c004d50 msgr2=0x7f6e8c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:19.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.207+0000 7f6e9bfff700 1 --2- 172.21.15.146:0/1476858696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e8c004d50 0x7f6e8c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.207+0000 7f6e9bfff700 1 -- 172.21.15.146:0/1476858696 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e8c003570 con 0x7f6e8c003fe0 2023-10-06T11:09:19.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.207+0000 7f6ea1206700 1 --2- 172.21.15.146:0/1476858696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e8c004d50 0x7f6e8c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:19.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.207+0000 7f6e9bfff700 1 --2- 172.21.15.146:0/1476858696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e8c003fe0 0x7f6e8c004810 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f6e88009c00 tx=0x7f6e880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d369013357fb1cbb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:19.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.207+0000 7f6e9b7fe700 1 -- 172.21.15.146:0/1476858696 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8800e6b0 con 0x7f6e8c003fe0 2023-10-06T11:09:19.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.207+0000 7f6e9b7fe700 1 -- 172.21.15.146:0/1476858696 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e8800e810 con 0x7f6e8c003fe0 2023-10-06T11:09:19.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.207+0000 7f6e9b7fe700 1 -- 172.21.15.146:0/1476858696 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8800ebd0 con 0x7f6e8c003fe0 2023-10-06T11:09:19.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.208+0000 7f6ea1a07700 1 -- 172.21.15.146:0/1476858696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e8c003fe0 msgr2=0x7f6e8c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:19.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.208+0000 7f6ea1a07700 1 --2- 172.21.15.146:0/1476858696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e8c003fe0 0x7f6e8c004810 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f6e88009c00 tx=0x7f6e880091a0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.208+0000 7f6ea1206700 1 -- 172.21.15.146:0/1476858696 reap_dead start 2023-10-06T11:09:19.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.208+0000 7f6ea1a07700 1 -- 172.21.15.146:0/1476858696 shutdown_connections 2023-10-06T11:09:19.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.208+0000 7f6ea1a07700 1 -- 172.21.15.146:0/1476858696 >> 172.21.15.146:0/1476858696 conn(0x7f6e9c0cc020 msgr2=0x7f6e9c0cc420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:19.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.208+0000 7f6ea1a07700 1 -- 172.21.15.146:0/1476858696 shutdown_connections 2023-10-06T11:09:19.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.208+0000 7f6ea1a07700 1 -- 172.21.15.146:0/1476858696 wait complete. 2023-10-06T11:09:19.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.209+0000 7f6ea1a07700 1 Processor -- start 2023-10-06T11:09:19.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.209+0000 7f6ea1a07700 1 -- start start 2023-10-06T11:09:19.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.210+0000 7f6ea1a07700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e8c003fe0 0x7f6e9c0c4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:19.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.210+0000 7f6ea1a07700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e9c0c9e40 0x7f6e9c153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:19.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.210+0000 7f6ea1a07700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e9c0ca2b0 0x7f6e9c153a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:19.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.210+0000 7f6ea1a07700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9c157b60 con 0x7f6e9c0c9e40 2023-10-06T11:09:19.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.210+0000 7f6ea1a07700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9c153fc0 con 0x7f6e9c0ca2b0 2023-10-06T11:09:19.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.210+0000 7f6ea1a07700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9c156f50 con 0x7f6e8c003fe0 2023-10-06T11:09:19.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.210+0000 7f6e9bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e9c0c9e40 0x7f6e9c153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:19.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.210+0000 7f6e9bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e9c0c9e40 0x7f6e9c153540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54040/0 (socket says 172.21.15.146:54040) 2023-10-06T11:09:19.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.210+0000 7f6e9bfff700 1 -- 172.21.15.146:0/631327338 learned_addr learned my addr 172.21.15.146:0/631327338 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:19.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.210+0000 7f6e9bfff700 1 -- 172.21.15.146:0/631327338 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e8c003fe0 msgr2=0x7f6e9c0c4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:19.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.210+0000 7f6ea0a05700 1 --2- 172.21.15.146:0/631327338 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e8c003fe0 0x7f6e9c0c4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:19.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.210+0000 7f6ea1206700 1 --2- 172.21.15.146:0/631327338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e9c0ca2b0 0x7f6e9c153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:19.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.210+0000 7f6e9bfff700 1 --2- 172.21.15.146:0/631327338 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e8c003fe0 0x7f6e9c0c4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.210+0000 7f6e9bfff700 1 -- 172.21.15.146:0/631327338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e9c0ca2b0 msgr2=0x7f6e9c153a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:19.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.210+0000 7f6e9bfff700 1 --2- 172.21.15.146:0/631327338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e9c0ca2b0 0x7f6e9c153a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.210+0000 7f6e9bfff700 1 -- 172.21.15.146:0/631327338 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e9c157230 con 0x7f6e9c0c9e40 2023-10-06T11:09:19.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.210+0000 7f6e9bfff700 1 --2- 172.21.15.146:0/631327338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e9c0c9e40 0x7f6e9c153540 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f6e8800e4b0 tx=0x7f6e8801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:19.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.211+0000 7f6e98ff9700 1 -- 172.21.15.146:0/631327338 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e88022070 con 0x7f6e9c0c9e40 2023-10-06T11:09:19.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.211+0000 7f6e98ff9700 1 -- 172.21.15.146:0/631327338 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e8800e980 con 0x7f6e9c0c9e40 2023-10-06T11:09:19.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.211+0000 7f6e98ff9700 1 -- 172.21.15.146:0/631327338 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e88027470 con 0x7f6e9c0c9e40 2023-10-06T11:09:19.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.211+0000 7f6ea1a07700 1 -- 172.21.15.146:0/631327338 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e9c157510 con 0x7f6e9c0c9e40 2023-10-06T11:09:19.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.211+0000 7f6ea1a07700 1 -- 172.21.15.146:0/631327338 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e9c0ca880 con 0x7f6e9c0c9e40 2023-10-06T11:09:19.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.212+0000 7f6e98ff9700 1 -- 172.21.15.146:0/631327338 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6e88027860 con 0x7f6e9c0c9e40 2023-10-06T11:09:19.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.212+0000 7f6e98ff9700 1 --2- 172.21.15.146:0/631327338 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6e80066f30 0x7f6e800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:19.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.212+0000 7f6e98ff9700 1 -- 172.21.15.146:0/631327338 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6e880861e0 con 0x7f6e9c0c9e40 2023-10-06T11:09:19.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.212+0000 7f6ea0a05700 1 --2- 172.21.15.146:0/631327338 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6e80066f30 0x7f6e800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:19.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.213+0000 7f6ea0a05700 1 --2- 172.21.15.146:0/631327338 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6e80066f30 0x7f6e800693e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6e90000e10 tx=0x7f6e90009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:19.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.214+0000 7f6eabf61b80 1 Processor -- start 2023-10-06T11:09:19.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.214+0000 7f6eabf61b80 1 -- start start 2023-10-06T11:09:19.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.215+0000 7f6eabf61b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a77125f9a0 0x55a77125fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:19.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.215+0000 7f6eabf61b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a7712a9c10 0x55a771288970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:19.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.215+0000 7f6eabf61b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a771288eb0 0x55a77125b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:19.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.215+0000 7f6eabf61b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7711dfcd0 con 0x55a77125f9a0 2023-10-06T11:09:19.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.215+0000 7f6eabf61b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7711b6ac0 con 0x55a771288eb0 2023-10-06T11:09:19.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.215+0000 7f6eabf61b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a7711b42c0 con 0x55a7712a9c10 2023-10-06T11:09:19.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.215+0000 7f6ea0a05700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a77125f9a0 0x55a77125fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:19.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.215+0000 7f6ea0a05700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a77125f9a0 0x55a77125fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54052/0 (socket says 172.21.15.146:54052) 2023-10-06T11:09:19.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.215+0000 7f6ea0a05700 1 -- 172.21.15.146:0/2695573034 learned_addr learned my addr 172.21.15.146:0/2695573034 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:19.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.215+0000 7f6ea1206700 1 --2- 172.21.15.146:0/2695573034 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a771288eb0 0x55a77125b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:19.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.215+0000 7f6e9bfff700 1 --2- 172.21.15.146:0/2695573034 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a7712a9c10 0x55a771288970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:19.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.215+0000 7f6ea0a05700 1 -- 172.21.15.146:0/2695573034 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a7712a9c10 msgr2=0x55a771288970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:19.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.215+0000 7f6ea0a05700 1 --2- 172.21.15.146:0/2695573034 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a7712a9c10 0x55a771288970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.215+0000 7f6ea0a05700 1 -- 172.21.15.146:0/2695573034 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a771288eb0 msgr2=0x55a77125b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:19.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.215+0000 7f6ea0a05700 1 --2- 172.21.15.146:0/2695573034 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a771288eb0 0x55a77125b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.215+0000 7f6ea0a05700 1 -- 172.21.15.146:0/2695573034 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a77104a2c0 con 0x55a77125f9a0 2023-10-06T11:09:19.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.215+0000 7f6ea1206700 1 --2- 172.21.15.146:0/2695573034 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a771288eb0 0x55a77125b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:19.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.216+0000 7f6ea0a05700 1 --2- 172.21.15.146:0/2695573034 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a77125f9a0 0x55a77125fd70 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f6e90007240 tx=0x7f6e90015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0dd6f2bafe8cbce server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:19.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.216+0000 7f6e85ffb700 1 -- 172.21.15.146:0/2695573034 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e90014780 con 0x55a77125f9a0 2023-10-06T11:09:19.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.216+0000 7f6e85ffb700 1 -- 172.21.15.146:0/2695573034 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e900148e0 con 0x55a77125f9a0 2023-10-06T11:09:19.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.216+0000 7f6e85ffb700 1 -- 172.21.15.146:0/2695573034 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e90014c60 con 0x55a77125f9a0 2023-10-06T11:09:19.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.216+0000 7f6eabf61b80 1 -- 172.21.15.146:0/2695573034 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a77125f9a0 msgr2=0x55a77125fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:19.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.216+0000 7f6eabf61b80 1 --2- 172.21.15.146:0/2695573034 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a77125f9a0 0x55a77125fd70 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f6e90007240 tx=0x7f6e90015000 comp rx=0 tx=0).stop 2023-10-06T11:09:19.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.216+0000 7f6eabf61b80 1 -- 172.21.15.146:0/2695573034 shutdown_connections 2023-10-06T11:09:19.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.216+0000 7f6eabf61b80 1 --2- 172.21.15.146:0/2695573034 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a771288eb0 0x55a77125b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.216+0000 7f6eabf61b80 1 --2- 172.21.15.146:0/2695573034 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a77125f9a0 0x55a77125fd70 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.216+0000 7f6eabf61b80 1 --2- 172.21.15.146:0/2695573034 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a7712a9c10 0x55a771288970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.216+0000 7f6eabf61b80 1 -- 172.21.15.146:0/2695573034 >> 172.21.15.146:0/2695573034 conn(0x55a7712612c0 msgr2=0x55a771261690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:19.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.216+0000 7f6eabf61b80 1 -- 172.21.15.146:0/2695573034 shutdown_connections 2023-10-06T11:09:19.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.216+0000 7f6eabf61b80 1 -- 172.21.15.146:0/2695573034 wait complete. 2023-10-06T11:09:19.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.217+0000 7f6eabf61b80 1 -- start start 2023-10-06T11:09:19.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.217+0000 7f6eabf61b80 1 Processor -- start 2023-10-06T11:09:19.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.218+0000 7f6eabf61b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a77125f9a0 0x55a7712b6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:19.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.218+0000 7f6eabf61b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a771288eb0 0x55a7712b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:19.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.218+0000 7f6eabf61b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a7712a9c10 0x55a7712561f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:19.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.218+0000 7f6eabf61b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7711b00b0 con 0x55a7712a9c10 2023-10-06T11:09:19.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.218+0000 7f6eabf61b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a77115b8e0 con 0x55a77125f9a0 2023-10-06T11:09:19.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.218+0000 7f6eabf61b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a771176ef0 con 0x55a771288eb0 2023-10-06T11:09:19.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.218+0000 7f6eabf61b80 10 client.0 _ll_register_callbacks cb 0x55a77104cf80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:09:19.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.218+0000 7f6ea1206700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a7712a9c10 0x55a7712561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:19.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.218+0000 7f6ea1206700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a7712a9c10 0x55a7712561f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54068/0 (socket says 172.21.15.146:54068) 2023-10-06T11:09:19.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.218+0000 7f6ea1206700 1 -- 172.21.15.146:0/1120414000 learned_addr learned my addr 172.21.15.146:0/1120414000 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:19.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.218+0000 7f6ea0a05700 1 --2- 172.21.15.146:0/1120414000 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a77125f9a0 0x55a7712b6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:19.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.218+0000 7f6e9bfff700 1 --2- 172.21.15.146:0/1120414000 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a771288eb0 0x55a7712b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:19.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.218+0000 7f6ea1206700 1 -- 172.21.15.146:0/1120414000 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a771288eb0 msgr2=0x55a7712b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:19.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.218+0000 7f6ea1206700 1 --2- 172.21.15.146:0/1120414000 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a771288eb0 0x55a7712b58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.218+0000 7f6ea1206700 1 -- 172.21.15.146:0/1120414000 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a77125f9a0 msgr2=0x55a7712b6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:19.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.218+0000 7f6ea1206700 1 --2- 172.21.15.146:0/1120414000 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a77125f9a0 0x55a7712b6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.218+0000 7f6ea1206700 1 -- 172.21.15.146:0/1120414000 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e9000f040 con 0x55a7712a9c10 2023-10-06T11:09:19.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.219+0000 7f6ea1206700 1 --2- 172.21.15.146:0/1120414000 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a7712a9c10 0x55a7712561f0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c06f800 tx=0x7f6e9400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=119972b19c0c4f83 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:19.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.219+0000 7f6e7affd700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:09:19.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.219+0000 7f6e7affd700 1 -- 172.21.15.146:0/1120414000 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9400e040 con 0x55a7712a9c10 2023-10-06T11:09:19.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.219+0000 7f6e7affd700 1 -- 172.21.15.146:0/1120414000 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6e94015670 con 0x55a7712a9c10 2023-10-06T11:09:19.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.219+0000 7f6eabf61b80 1 -- 172.21.15.146:0/1120414000 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a7712546e0 con 0x55a7712a9c10 2023-10-06T11:09:19.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.219+0000 7f6e7affd700 1 -- 172.21.15.146:0/1120414000 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e94015a40 con 0x55a7712a9c10 2023-10-06T11:09:19.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.219+0000 7f6eabf61b80 10 client.6060 fetch_fsmap learned FSMap version 37 2023-10-06T11:09:19.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.219+0000 7f6eabf61b80 1 -- 172.21.15.146:0/1120414000 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x55a770fed030 con 0x55a7712a9c10 2023-10-06T11:09:19.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.219+0000 7f6e7affd700 1 -- 172.21.15.146:0/1120414000 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a7712546e0 con 0x55a7712a9c10 2023-10-06T11:09:19.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.219+0000 7f6e7affd700 1 -- 172.21.15.146:0/1120414000 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 37) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f6e94015ba0 con 0x55a7712a9c10 2023-10-06T11:09:19.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.219+0000 7f6eabf61b80 10 client.6060 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T11:09:19.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.219+0000 7f6eabf61b80 10 client.6060 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-10-06T11:09:19.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.219+0000 7f6eabf61b80 20 client.6060 populate_metadata read hostname 'smithi146' 2023-10-06T11:09:19.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.219+0000 7f6eabf61b80 1 --2- 172.21.15.146:0/1120414000 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55a7712b8770 0x55a7712b8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:19.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.219+0000 7f6eabf61b80 4 client.6060 mds_command: new command op to 5481 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:09:19.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.219+0000 7f6eabf61b80 1 -- 172.21.15.146:0/1120414000 --> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a771231610 con 0x55a7712b8770 2023-10-06T11:09:19.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.219+0000 7f6ea0a05700 1 --2- 172.21.15.146:0/1120414000 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55a7712b8770 0x55a7712b8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:19.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.220+0000 7f6e7affd700 10 client.6060 ms_handle_connect on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:19.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.220+0000 7f6ea0a05700 1 --2- 172.21.15.146:0/1120414000 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55a7712b8770 0x55a7712b8b70 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3ca09c51b6a0bad server_cookie=d8ce92e7e0e69df1 in_seq=0 out_seq=0 2023-10-06T11:09:19.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.220+0000 7f6e7affd700 1 -- 172.21.15.146:0/1120414000 <== mds.0 v2:172.21.15.146:6835/2252184844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55a771231610 con 0x55a7712b8770 2023-10-06T11:09:19.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.220+0000 7f6e7affd700 10 client.6060 handle_command_reply: tid=0 2023-10-06T11:09:19.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.220+0000 7f6eabf61b80 1 client.6060 shutdown 2023-10-06T11:09:19.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.220+0000 7f6eabf61b80 1 -- 172.21.15.146:0/1120414000 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a7712a9c10 msgr2=0x55a7712561f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:19.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.220+0000 7f6eabf61b80 1 --2- 172.21.15.146:0/1120414000 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a7712a9c10 0x55a7712561f0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c06f800 tx=0x7f6e9400b040 comp rx=0 tx=0).stop 2023-10-06T11:09:19.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.220+0000 7f6eabf61b80 1 -- 172.21.15.146:0/1120414000 shutdown_connections 2023-10-06T11:09:19.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.220+0000 7f6eabf61b80 1 --2- 172.21.15.146:0/1120414000 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55a7712b8770 0x55a7712b8b70 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.220+0000 7f6eabf61b80 1 --2- 172.21.15.146:0/1120414000 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a7712a9c10 0x55a7712561f0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.220+0000 7f6e7affd700 0 client.6060 ms_handle_reset on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:19.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.220+0000 7f6eabf61b80 1 --2- 172.21.15.146:0/1120414000 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a77125f9a0 0x55a7712b6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.220+0000 7f6eabf61b80 1 --2- 172.21.15.146:0/1120414000 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a771288eb0 0x55a7712b58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.220+0000 7f6eabf61b80 1 -- 172.21.15.146:0/1120414000 >> 172.21.15.146:0/1120414000 conn(0x55a7712612c0 msgr2=0x55a7712601f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:19.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.220+0000 7f6eabf61b80 1 -- 172.21.15.146:0/1120414000 shutdown_connections 2023-10-06T11:09:19.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.220+0000 7f6eabf61b80 1 -- 172.21.15.146:0/1120414000 wait complete. 2023-10-06T11:09:19.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.221+0000 7f6eabf61b80 20 client.6060 trim_cache size 0 max 16384 2023-10-06T11:09:19.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.237+0000 7f6eabf61b80 1 Processor -- start 2023-10-06T11:09:19.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.237+0000 7f6eabf61b80 1 -- start start 2023-10-06T11:09:19.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.237+0000 7f6eabf61b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a77125f9a0 0x55a77125da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:19.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.237+0000 7f6eabf61b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a771288eb0 0x55a771260150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:19.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.237+0000 7f6eabf61b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a7712a9c10 0x55a771260690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:19.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.237+0000 7f6eabf61b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a771032e80 con 0x55a771288eb0 2023-10-06T11:09:19.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.237+0000 7f6eabf61b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a77129ee00 con 0x55a77125f9a0 2023-10-06T11:09:19.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.237+0000 7f6eabf61b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a77125dfc0 con 0x55a7712a9c10 2023-10-06T11:09:19.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.237+0000 7f6e9bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a771288eb0 0x55a771260150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:19.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.237+0000 7f6e9bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a771288eb0 0x55a771260150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54076/0 (socket says 172.21.15.146:54076) 2023-10-06T11:09:19.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.237+0000 7f6e9bfff700 1 -- 172.21.15.146:0/4140765148 learned_addr learned my addr 172.21.15.146:0/4140765148 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:19.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.238+0000 7f6ea1206700 1 --2- 172.21.15.146:0/4140765148 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a7712a9c10 0x55a771260690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:19.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.238+0000 7f6ea0a05700 1 --2- 172.21.15.146:0/4140765148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a77125f9a0 0x55a77125da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:19.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.238+0000 7f6e9bfff700 1 -- 172.21.15.146:0/4140765148 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a7712a9c10 msgr2=0x55a771260690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:19.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.238+0000 7f6e9bfff700 1 --2- 172.21.15.146:0/4140765148 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a7712a9c10 0x55a771260690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.238+0000 7f6e9bfff700 1 -- 172.21.15.146:0/4140765148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a77125f9a0 msgr2=0x55a77125da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:19.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.238+0000 7f6e9bfff700 1 --2- 172.21.15.146:0/4140765148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a77125f9a0 0x55a77125da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.238+0000 7f6e9bfff700 1 -- 172.21.15.146:0/4140765148 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a77117e7d0 con 0x55a771288eb0 2023-10-06T11:09:19.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.238+0000 7f6e9bfff700 1 --2- 172.21.15.146:0/4140765148 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a771288eb0 0x55a771260150 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f6e88053560 tx=0x7f6e8801f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b4bf7fca3de3eea server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:19.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.238+0000 7f6e867fc700 1 -- 172.21.15.146:0/4140765148 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e880569c0 con 0x55a771288eb0 2023-10-06T11:09:19.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.238+0000 7f6e867fc700 1 -- 172.21.15.146:0/4140765148 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e88057060 con 0x55a771288eb0 2023-10-06T11:09:19.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.238+0000 7f6e867fc700 1 -- 172.21.15.146:0/4140765148 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8805a200 con 0x55a771288eb0 2023-10-06T11:09:19.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.238+0000 7f6eabf61b80 1 -- 172.21.15.146:0/4140765148 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a771288eb0 msgr2=0x55a771260150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:19.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.238+0000 7f6eabf61b80 1 --2- 172.21.15.146:0/4140765148 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a771288eb0 0x55a771260150 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f6e88053560 tx=0x7f6e8801f040 comp rx=0 tx=0).stop 2023-10-06T11:09:19.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.238+0000 7f6eabf61b80 1 -- 172.21.15.146:0/4140765148 shutdown_connections 2023-10-06T11:09:19.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.238+0000 7f6eabf61b80 1 --2- 172.21.15.146:0/4140765148 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a7712a9c10 0x55a771260690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.238+0000 7f6eabf61b80 1 --2- 172.21.15.146:0/4140765148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a77125f9a0 0x55a77125da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.238+0000 7f6eabf61b80 1 --2- 172.21.15.146:0/4140765148 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a771288eb0 0x55a771260150 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.238+0000 7f6eabf61b80 1 -- 172.21.15.146:0/4140765148 >> 172.21.15.146:0/4140765148 conn(0x55a7712612c0 msgr2=0x55a77129de60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:19.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.239+0000 7f6eabf61b80 1 -- 172.21.15.146:0/4140765148 shutdown_connections 2023-10-06T11:09:19.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.239+0000 7f6eabf61b80 1 -- 172.21.15.146:0/4140765148 wait complete. 2023-10-06T11:09:19.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.239+0000 7f6eabf61b80 1 -- start start 2023-10-06T11:09:19.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.239+0000 7f6eabf61b80 1 Processor -- start 2023-10-06T11:09:19.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.240+0000 7f6eabf61b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a77125f9a0 0x55a77130b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:19.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.240+0000 7f6eabf61b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a771288eb0 0x55a7712600e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:19.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.240+0000 7f6eabf61b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a7712a9c10 0x55a771260620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:19.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.240+0000 7f6eabf61b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7712b6b50 con 0x55a7712a9c10 2023-10-06T11:09:19.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.240+0000 7f6eabf61b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a77130be70 con 0x55a771288eb0 2023-10-06T11:09:19.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.240+0000 7f6eabf61b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a7712b72d0 con 0x55a77125f9a0 2023-10-06T11:09:19.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.240+0000 7f6eabf61b80 10 client.0 _ll_register_callbacks cb 0x55a77104cf80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:09:19.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.240+0000 7f6ea1206700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a7712a9c10 0x55a771260620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:19.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.240+0000 7f6ea1206700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a7712a9c10 0x55a771260620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:54088/0 (socket says 172.21.15.146:54088) 2023-10-06T11:09:19.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.240+0000 7f6ea1206700 1 -- 172.21.15.146:0/3171502434 learned_addr learned my addr 172.21.15.146:0/3171502434 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:19.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.240+0000 7f6ea0a05700 1 --2- 172.21.15.146:0/3171502434 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a77125f9a0 0x55a77130b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:19.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.240+0000 7f6e9bfff700 1 --2- 172.21.15.146:0/3171502434 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a771288eb0 0x55a7712600e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:19.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.240+0000 7f6ea1206700 1 -- 172.21.15.146:0/3171502434 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a77125f9a0 msgr2=0x55a77130b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:19.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.240+0000 7f6ea1206700 1 --2- 172.21.15.146:0/3171502434 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a77125f9a0 0x55a77130b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.240+0000 7f6ea1206700 1 -- 172.21.15.146:0/3171502434 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a771288eb0 msgr2=0x55a7712600e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:19.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.240+0000 7f6ea1206700 1 --2- 172.21.15.146:0/3171502434 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a771288eb0 0x55a7712600e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.240+0000 7f6ea1206700 1 -- 172.21.15.146:0/3171502434 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e9c0ca880 con 0x55a7712a9c10 2023-10-06T11:09:19.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.240+0000 7f6e9bfff700 1 --2- 172.21.15.146:0/3171502434 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a771288eb0 0x55a7712600e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:19.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.241+0000 7f6ea1206700 1 --2- 172.21.15.146:0/3171502434 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a7712a9c10 0x55a771260620 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f6e940214c0 tx=0x7f6e9401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9793b168647c28bb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:19.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.241+0000 7f6e7affd700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:09:19.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.241+0000 7f6e7affd700 1 -- 172.21.15.146:0/3171502434 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9400e050 con 0x55a7712a9c10 2023-10-06T11:09:19.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.241+0000 7f6e7affd700 1 -- 172.21.15.146:0/3171502434 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6e94013ae0 con 0x55a7712a9c10 2023-10-06T11:09:19.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.241+0000 7f6eabf61b80 1 -- 172.21.15.146:0/3171502434 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6e900148e0 con 0x55a7712a9c10 2023-10-06T11:09:19.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.241+0000 7f6e7affd700 1 -- 172.21.15.146:0/3171502434 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e94015c50 con 0x55a7712a9c10 2023-10-06T11:09:19.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.241+0000 7f6eabf61b80 10 client.6066 fetch_fsmap learned FSMap version 37 2023-10-06T11:09:19.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.241+0000 7f6eabf61b80 1 -- 172.21.15.146:0/3171502434 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=2+}) v3 -- 0x55a7711654c0 con 0x55a7712a9c10 2023-10-06T11:09:19.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.241+0000 7f6e7affd700 1 -- 172.21.15.146:0/3171502434 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e94038070 con 0x55a7712a9c10 2023-10-06T11:09:19.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.241+0000 7f6e7affd700 1 -- 172.21.15.146:0/3171502434 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 37) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f6e94021800 con 0x55a7712a9c10 2023-10-06T11:09:19.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.241+0000 7f6eabf61b80 10 client.6066 fetch_fsmap finished waiting for FSMap version 37 2023-10-06T11:09:19.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.241+0000 7f6eabf61b80 10 client.6066 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-10-06T11:09:19.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.241+0000 7f6eabf61b80 20 client.6066 populate_metadata read hostname 'smithi146' 2023-10-06T11:09:19.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.241+0000 7f6eabf61b80 1 --2- 172.21.15.146:0/3171502434 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55a771289280 0x55a7712b7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:19.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.241+0000 7f6eabf61b80 4 client.6066 mds_command: new command op to 5481 tid=0[{"prefix": "scrub status"}] 2023-10-06T11:09:19.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.241+0000 7f6eabf61b80 1 -- 172.21.15.146:0/3171502434 --> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a771152e50 con 0x55a771289280 2023-10-06T11:09:19.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.241+0000 7f6ea0a05700 1 --2- 172.21.15.146:0/3171502434 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55a771289280 0x55a7712b7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:19.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.241+0000 7f6e7affd700 10 client.6066 ms_handle_connect on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:19.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.241+0000 7f6ea0a05700 1 --2- 172.21.15.146:0/3171502434 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55a771289280 0x55a7712b7760 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3493365e87924a4 server_cookie=9d0ed12e7b55af96 in_seq=0 out_seq=0 2023-10-06T11:09:19.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.242+0000 7f6e7affd700 1 -- 172.21.15.146:0/3171502434 <== mds.0 v2:172.21.15.146:6835/2252184844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+284 (crc 0 0 0) 0x55a771152e50 con 0x55a771289280 2023-10-06T11:09:19.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.242+0000 7f6e7affd700 10 client.6066 handle_command_reply: tid=0 2023-10-06T11:09:19.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.242+0000 7f6eabf61b80 1 client.6066 shutdown 2023-10-06T11:09:19.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.242+0000 7f6eabf61b80 1 -- 172.21.15.146:0/3171502434 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a7712a9c10 msgr2=0x55a771260620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:19.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.242+0000 7f6eabf61b80 1 --2- 172.21.15.146:0/3171502434 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a7712a9c10 0x55a771260620 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f6e940214c0 tx=0x7f6e9401f000 comp rx=0 tx=0).stop 2023-10-06T11:09:19.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.242+0000 7f6eabf61b80 1 -- 172.21.15.146:0/3171502434 shutdown_connections 2023-10-06T11:09:19.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.242+0000 7f6eabf61b80 1 --2- 172.21.15.146:0/3171502434 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x55a771289280 0x55a7712b7760 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.242+0000 7f6eabf61b80 1 --2- 172.21.15.146:0/3171502434 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a7712a9c10 0x55a771260620 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.242+0000 7f6eabf61b80 1 --2- 172.21.15.146:0/3171502434 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a77125f9a0 0x55a77130b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.242+0000 7f6e7affd700 0 client.6066 ms_handle_reset on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:19.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.242+0000 7f6eabf61b80 1 --2- 172.21.15.146:0/3171502434 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a771288eb0 0x55a7712600e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.242+0000 7f6eabf61b80 1 -- 172.21.15.146:0/3171502434 >> 172.21.15.146:0/3171502434 conn(0x55a7712612c0 msgr2=0x55a7712a4d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:19.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.242+0000 7f6eabf61b80 1 -- 172.21.15.146:0/3171502434 shutdown_connections 2023-10-06T11:09:19.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.242+0000 7f6eabf61b80 1 -- 172.21.15.146:0/3171502434 wait complete. 2023-10-06T11:09:19.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.242+0000 7f6eabf61b80 20 client.6066 trim_cache size 0 max 16384 2023-10-06T11:09:19.252 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:09:19.252 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-06T11:09:19.252 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": { 2023-10-06T11:09:19.252 INFO:teuthology.orchestra.run.smithi146.stdout: "c8d65b2e-1da9-499f-8d6e-21743fb958ec": { 2023-10-06T11:09:19.252 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_1", 2023-10-06T11:09:19.252 INFO:teuthology.orchestra.run.smithi146.stdout: "tag": "c8d65b2e-1da9-499f-8d6e-21743fb958ec", 2023-10-06T11:09:19.252 INFO:teuthology.orchestra.run.smithi146.stdout: "options": "" 2023-10-06T11:09:19.252 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:09:19.252 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:09:19.252 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:09:19.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.242+0000 7f6ea1a07700 1 -- 172.21.15.146:0/631327338 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6e80066f30 msgr2=0x7f6e800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:19.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.242+0000 7f6ea1a07700 1 --2- 172.21.15.146:0/631327338 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6e80066f30 0x7f6e800693e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6e90000e10 tx=0x7f6e90009040 comp rx=0 tx=0).stop 2023-10-06T11:09:19.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.242+0000 7f6ea1a07700 1 -- 172.21.15.146:0/631327338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e9c0c9e40 msgr2=0x7f6e9c153540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:19.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.242+0000 7f6ea1a07700 1 --2- 172.21.15.146:0/631327338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e9c0c9e40 0x7f6e9c153540 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f6e8800e4b0 tx=0x7f6e8801a000 comp rx=0 tx=0).stop 2023-10-06T11:09:19.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.242+0000 7f6ea1a07700 1 -- 172.21.15.146:0/631327338 shutdown_connections 2023-10-06T11:09:19.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.242+0000 7f6ea1a07700 1 --2- 172.21.15.146:0/631327338 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6e80066f30 0x7f6e800693e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.243+0000 7f6ea1a07700 1 --2- 172.21.15.146:0/631327338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e9c0ca2b0 0x7f6e9c153a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.243+0000 7f6ea1a07700 1 --2- 172.21.15.146:0/631327338 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6e8c003fe0 0x7f6e9c0c4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.243+0000 7f6ea1a07700 1 --2- 172.21.15.146:0/631327338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6e9c0c9e40 0x7f6e9c153540 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:19.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.243+0000 7f6ea1a07700 1 -- 172.21.15.146:0/631327338 >> 172.21.15.146:0/631327338 conn(0x7f6e9c0cc020 msgr2=0x7f6e9c0ad8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:19.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.243+0000 7f6ea1a07700 1 -- 172.21.15.146:0/631327338 shutdown_connections 2023-10-06T11:09:19.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:19.243+0000 7f6ea1a07700 1 -- 172.21.15.146:0/631327338 wait complete. 2023-10-06T11:09:20.318 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:09:20.320 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:09:23.555 INFO:tasks.ceph.mon.a.smithi146.stderr:2023-10-06T11:09:23.553+0000 7f011e2a6700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-10-06T11:09:24.257 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub status 2023-10-06T11:09:24.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.385+0000 7fbbe3e5b700 1 Processor -- start 2023-10-06T11:09:24.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.385+0000 7fbbe3e5b700 1 -- start start 2023-10-06T11:09:24.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.386+0000 7fbbe3e5b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbbdc15a160 0x7fbbdc0c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:24.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.386+0000 7fbbe3e5b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbbdc0ae730 0x7fbbdc0aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:24.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.386+0000 7fbbe3e5b700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbdc0ae2a0 con 0x7fbbdc0ce3d0 2023-10-06T11:09:24.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.386+0000 7fbbe3e5b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbdc15a530 con 0x7fbbdc15a160 2023-10-06T11:09:24.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.386+0000 7fbbe3e5b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc0ad690 con 0x7fbbdc0ae730 2023-10-06T11:09:24.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.386+0000 7fbbe1bf7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbbdc15a160 0x7fbbdc0c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:24.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.386+0000 7fbbe1bf7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbbdc15a160 0x7fbbdc0c55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41270/0 (socket says 172.21.15.146:41270) 2023-10-06T11:09:24.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.386+0000 7fbbe1bf7700 1 -- 172.21.15.146:0/1918222532 learned_addr learned my addr 172.21.15.146:0/1918222532 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:24.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.386+0000 7fbbe13f6700 1 --2- 172.21.15.146:0/1918222532 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbbdc0ae730 0x7fbbdc0aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:24.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.386+0000 7fbbe1bf7700 1 -- 172.21.15.146:0/1918222532 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbbdc0ae730 msgr2=0x7fbbdc0aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:24.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.386+0000 7fbbe1bf7700 1 --2- 172.21.15.146:0/1918222532 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbbdc0ae730 0x7fbbdc0aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.386+0000 7fbbe1bf7700 1 -- 172.21.15.146:0/1918222532 >> v1:172.21.15.151:6789/0 conn(0x7fbbdc0ce3d0 legacy=0x7fbbdc0ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:24.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.386+0000 7fbbe1bf7700 1 -- 172.21.15.146:0/1918222532 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbdc0ad970 con 0x7fbbdc15a160 2023-10-06T11:09:24.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.386+0000 7fbbe13f6700 1 --2- 172.21.15.146:0/1918222532 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbbdc0ae730 0x7fbbdc0aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:09:24.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.386+0000 7fbbe1bf7700 1 --2- 172.21.15.146:0/1918222532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbdc15a160 0x7fbbdc0c55a0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8009990 tx=0x7fbbd8009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=423567d477930b70 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:24.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.387+0000 7fbbe0bf5700 1 -- 172.21.15.146:0/1918222532 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd8005c10 con 0x7fbbdc15a160 2023-10-06T11:09:24.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.387+0000 7fbbe0bf5700 1 -- 172.21.15.146:0/1918222532 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd8005d70 con 0x7fbbdc15a160 2023-10-06T11:09:24.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.387+0000 7fbbe0bf5700 1 -- 172.21.15.146:0/1918222532 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd800b840 con 0x7fbbdc15a160 2023-10-06T11:09:24.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.387+0000 7fbbe3e5b700 1 -- 172.21.15.146:0/1918222532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbdc15a160 msgr2=0x7fbbdc0c55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:24.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.387+0000 7fbbe3e5b700 1 --2- 172.21.15.146:0/1918222532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbdc15a160 0x7fbbdc0c55a0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8009990 tx=0x7fbbd8009220 comp rx=0 tx=0).stop 2023-10-06T11:09:24.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.387+0000 7fbbe3e5b700 1 -- 172.21.15.146:0/1918222532 shutdown_connections 2023-10-06T11:09:24.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.387+0000 7fbbe3e5b700 1 --2- 172.21.15.146:0/1918222532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbdc15a160 0x7fbbdc0c55a0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.387+0000 7fbbe3e5b700 1 --2- 172.21.15.146:0/1918222532 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbbdc0ae730 0x7fbbdc0aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.387+0000 7fbbe3e5b700 1 -- 172.21.15.146:0/1918222532 >> 172.21.15.146:0/1918222532 conn(0x7fbbdc06f380 msgr2=0x7fbbdc0d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:24.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.387+0000 7fbbe3e5b700 1 -- 172.21.15.146:0/1918222532 shutdown_connections 2023-10-06T11:09:24.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.387+0000 7fbbe3e5b700 1 -- 172.21.15.146:0/1918222532 wait complete. 2023-10-06T11:09:24.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.388+0000 7fbbe3e5b700 1 Processor -- start 2023-10-06T11:09:24.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.388+0000 7fbbe3e5b700 1 -- start start 2023-10-06T11:09:24.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.389+0000 7fbbe3e5b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbbdc0ae730 0x7fbbdc14d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:24.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.389+0000 7fbbe3e5b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbdc0ce3d0 0x7fbbdc0c5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:24.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.389+0000 7fbbe3e5b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbdc15a160 0x7fbbdc0c6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:24.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.389+0000 7fbbe3e5b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc0b38d0 con 0x7fbbdc15a160 2023-10-06T11:09:24.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.389+0000 7fbbe3e5b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc16b4c0 con 0x7fbbdc0ce3d0 2023-10-06T11:09:24.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.389+0000 7fbbe3e5b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc16ba80 con 0x7fbbdc0ae730 2023-10-06T11:09:24.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.389+0000 7fbbe23f8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbdc15a160 0x7fbbdc0c6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:24.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.389+0000 7fbbe23f8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbdc15a160 0x7fbbdc0c6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41272/0 (socket says 172.21.15.146:41272) 2023-10-06T11:09:24.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.389+0000 7fbbe23f8700 1 -- 172.21.15.146:0/4294006525 learned_addr learned my addr 172.21.15.146:0/4294006525 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:24.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.389+0000 7fbbe13f6700 1 --2- 172.21.15.146:0/4294006525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbdc0ce3d0 0x7fbbdc0c5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:24.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.389+0000 7fbbe1bf7700 1 --2- 172.21.15.146:0/4294006525 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbbdc0ae730 0x7fbbdc14d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:24.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.390+0000 7fbbe23f8700 1 -- 172.21.15.146:0/4294006525 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbbdc0ae730 msgr2=0x7fbbdc14d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:24.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.390+0000 7fbbe23f8700 1 --2- 172.21.15.146:0/4294006525 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbbdc0ae730 0x7fbbdc14d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.390+0000 7fbbe23f8700 1 -- 172.21.15.146:0/4294006525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbdc0ce3d0 msgr2=0x7fbbdc0c5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:24.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.390+0000 7fbbe23f8700 1 --2- 172.21.15.146:0/4294006525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbdc0ce3d0 0x7fbbdc0c5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.390+0000 7fbbe23f8700 1 -- 172.21.15.146:0/4294006525 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd8009480 con 0x7fbbdc15a160 2023-10-06T11:09:24.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.390+0000 7fbbe13f6700 1 --2- 172.21.15.146:0/4294006525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbdc0ce3d0 0x7fbbdc0c5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:24.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.390+0000 7fbbe23f8700 1 --2- 172.21.15.146:0/4294006525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbdc15a160 0x7fbbdc0c6030 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fbbd400c960 tx=0x7fbbd40026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:24.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.390+0000 7fbbd1ffb700 1 -- 172.21.15.146:0/4294006525 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd4012630 con 0x7fbbdc15a160 2023-10-06T11:09:24.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.390+0000 7fbbd1ffb700 1 -- 172.21.15.146:0/4294006525 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd4012790 con 0x7fbbdc15a160 2023-10-06T11:09:24.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.390+0000 7fbbe3e5b700 1 -- 172.21.15.146:0/4294006525 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbdc0b50a0 con 0x7fbbdc15a160 2023-10-06T11:09:24.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.390+0000 7fbbd1ffb700 1 -- 172.21.15.146:0/4294006525 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd4012b50 con 0x7fbbdc15a160 2023-10-06T11:09:24.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.390+0000 7fbbe3e5b700 1 -- 172.21.15.146:0/4294006525 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbdc16b710 con 0x7fbbdc15a160 2023-10-06T11:09:24.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.391+0000 7fbbd1ffb700 1 -- 172.21.15.146:0/4294006525 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbbd401b400 con 0x7fbbdc15a160 2023-10-06T11:09:24.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.392+0000 7fbbd1ffb700 1 --2- 172.21.15.146:0/4294006525 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbbc0066f30 0x7fbbc00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:24.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.392+0000 7fbbd1ffb700 1 -- 172.21.15.146:0/4294006525 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbbd4084aa0 con 0x7fbbdc15a160 2023-10-06T11:09:24.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.392+0000 7fbbe1bf7700 1 --2- 172.21.15.146:0/4294006525 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbbc0066f30 0x7fbbc00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:24.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.392+0000 7fbbe1bf7700 1 --2- 172.21.15.146:0/4294006525 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbbc0066f30 0x7fbbc00693e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fbbd80030c0 tx=0x7fbbd8015000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:24.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.394+0000 7fbbed153b80 1 Processor -- start 2023-10-06T11:09:24.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.394+0000 7fbbed153b80 1 -- start start 2023-10-06T11:09:24.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.394+0000 7fbbed153b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560309f12ae0 0x560309f08d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:24.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.394+0000 7fbbed153b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560309eccc20 0x560309f12340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:24.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.395+0000 7fbbed153b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560309f12eb0 0x560309ec7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:24.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.395+0000 7fbbed153b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x560309e4bcd0 con 0x560309f12eb0 2023-10-06T11:09:24.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.395+0000 7fbbed153b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x560309e22ac0 con 0x560309eccc20 2023-10-06T11:09:24.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.395+0000 7fbbed153b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x560309e202c0 con 0x560309f12ae0 2023-10-06T11:09:24.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.395+0000 7fbbe23f8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560309f12eb0 0x560309ec7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:24.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.395+0000 7fbbe23f8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560309f12eb0 0x560309ec7820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41274/0 (socket says 172.21.15.146:41274) 2023-10-06T11:09:24.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.395+0000 7fbbe23f8700 1 -- 172.21.15.146:0/790852751 learned_addr learned my addr 172.21.15.146:0/790852751 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:24.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.395+0000 7fbbe1bf7700 1 --2- 172.21.15.146:0/790852751 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560309f12ae0 0x560309f08d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:24.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.395+0000 7fbbe13f6700 1 --2- 172.21.15.146:0/790852751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560309eccc20 0x560309f12340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:24.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.395+0000 7fbbe23f8700 1 -- 172.21.15.146:0/790852751 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560309f12ae0 msgr2=0x560309f08d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:24.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.395+0000 7fbbe23f8700 1 --2- 172.21.15.146:0/790852751 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560309f12ae0 0x560309f08d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.395+0000 7fbbe23f8700 1 -- 172.21.15.146:0/790852751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560309eccc20 msgr2=0x560309f12340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:24.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.395+0000 7fbbe23f8700 1 --2- 172.21.15.146:0/790852751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560309eccc20 0x560309f12340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.395+0000 7fbbe23f8700 1 -- 172.21.15.146:0/790852751 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560309cb62c0 con 0x560309f12eb0 2023-10-06T11:09:24.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.395+0000 7fbbe23f8700 1 --2- 172.21.15.146:0/790852751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560309f12eb0 0x560309ec7820 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4082f10 tx=0x7fbbd4082dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad07c5fdfe92f419 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:24.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.395+0000 7fbbc6ffd700 1 -- 172.21.15.146:0/790852751 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd405c810 con 0x560309f12eb0 2023-10-06T11:09:24.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.395+0000 7fbbc6ffd700 1 -- 172.21.15.146:0/790852751 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd406be90 con 0x560309f12eb0 2023-10-06T11:09:24.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.395+0000 7fbbc6ffd700 1 -- 172.21.15.146:0/790852751 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd4053cc0 con 0x560309f12eb0 2023-10-06T11:09:24.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.396+0000 7fbbed153b80 1 -- 172.21.15.146:0/790852751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560309f12eb0 msgr2=0x560309ec7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:24.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.396+0000 7fbbed153b80 1 --2- 172.21.15.146:0/790852751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560309f12eb0 0x560309ec7820 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4082f10 tx=0x7fbbd4082dc0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.396+0000 7fbbed153b80 1 -- 172.21.15.146:0/790852751 shutdown_connections 2023-10-06T11:09:24.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.396+0000 7fbbed153b80 1 --2- 172.21.15.146:0/790852751 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560309f12eb0 0x560309ec7820 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.396+0000 7fbbed153b80 1 --2- 172.21.15.146:0/790852751 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560309f12ae0 0x560309f08d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.396+0000 7fbbed153b80 1 --2- 172.21.15.146:0/790852751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560309eccc20 0x560309f12340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.396+0000 7fbbed153b80 1 -- 172.21.15.146:0/790852751 >> 172.21.15.146:0/790852751 conn(0x560309ecd0c0 msgr2=0x560309ecd490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:24.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.396+0000 7fbbed153b80 1 -- 172.21.15.146:0/790852751 shutdown_connections 2023-10-06T11:09:24.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.396+0000 7fbbed153b80 1 -- 172.21.15.146:0/790852751 wait complete. 2023-10-06T11:09:24.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.396+0000 7fbbed153b80 1 -- start start 2023-10-06T11:09:24.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.396+0000 7fbbed153b80 1 Processor -- start 2023-10-06T11:09:24.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.397+0000 7fbbed153b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560309eccc20 0x560309ef5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:24.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.397+0000 7fbbed153b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560309f12ae0 0x560309f0cf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:24.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.397+0000 7fbbed153b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560309f12eb0 0x560309efb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:24.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.397+0000 7fbbed153b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x560309e1c0b0 con 0x560309f12eb0 2023-10-06T11:09:24.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.397+0000 7fbbed153b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x560309dc78e0 con 0x560309eccc20 2023-10-06T11:09:24.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.397+0000 7fbbed153b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x560309de2ef0 con 0x560309f12ae0 2023-10-06T11:09:24.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.397+0000 7fbbed153b80 10 client.0 _ll_register_callbacks cb 0x560309cb8f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:09:24.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.398+0000 7fbbe23f8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560309f12eb0 0x560309efb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:24.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.398+0000 7fbbe23f8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560309f12eb0 0x560309efb080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41286/0 (socket says 172.21.15.146:41286) 2023-10-06T11:09:24.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.398+0000 7fbbe23f8700 1 -- 172.21.15.146:0/4236079151 learned_addr learned my addr 172.21.15.146:0/4236079151 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:24.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.398+0000 7fbbe13f6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560309f12ae0 0x560309f0cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:24.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.398+0000 7fbbe1bf7700 1 --2- 172.21.15.146:0/4236079151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560309eccc20 0x560309ef5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:24.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.398+0000 7fbbe23f8700 1 -- 172.21.15.146:0/4236079151 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560309f12ae0 msgr2=0x560309f0cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:24.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.398+0000 7fbbe23f8700 1 --2- 172.21.15.146:0/4236079151 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560309f12ae0 0x560309f0cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.398+0000 7fbbe23f8700 1 -- 172.21.15.146:0/4236079151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560309eccc20 msgr2=0x560309ef5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:24.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.398+0000 7fbbe23f8700 1 --2- 172.21.15.146:0/4236079151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560309eccc20 0x560309ef5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.398+0000 7fbbe23f8700 1 -- 172.21.15.146:0/4236079151 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbdc16b710 con 0x560309f12eb0 2023-10-06T11:09:24.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.398+0000 7fbbe23f8700 1 --2- 172.21.15.146:0/4236079151 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560309f12eb0 0x560309efb080 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4055f80 tx=0x7fbbd406c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34ed5e6ec3f0d2ad server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:24.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.398+0000 7fbbbbfff700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:09:24.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.398+0000 7fbbbbfff700 1 -- 172.21.15.146:0/4236079151 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd4053cc0 con 0x560309f12eb0 2023-10-06T11:09:24.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.398+0000 7fbbbbfff700 1 -- 172.21.15.146:0/4236079151 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbbd4054e10 con 0x560309f12eb0 2023-10-06T11:09:24.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.398+0000 7fbbed153b80 1 -- 172.21.15.146:0/4236079151 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560309ec06e0 con 0x560309f12eb0 2023-10-06T11:09:24.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.398+0000 7fbbbbfff700 1 -- 172.21.15.146:0/4236079151 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbbd405c380 con 0x560309f12eb0 2023-10-06T11:09:24.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.398+0000 7fbbed153b80 10 client.6078 fetch_fsmap learned FSMap version 39 2023-10-06T11:09:24.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.398+0000 7fbbed153b80 1 -- 172.21.15.146:0/4236079151 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x560309c59030 con 0x560309f12eb0 2023-10-06T11:09:24.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.398+0000 7fbbbbfff700 1 -- 172.21.15.146:0/4236079151 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd4075020 con 0x560309f12eb0 2023-10-06T11:09:24.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.398+0000 7fbbbbfff700 1 -- 172.21.15.146:0/4236079151 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 39) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fbbd4006ba0 con 0x560309f12eb0 2023-10-06T11:09:24.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.398+0000 7fbbed153b80 10 client.6078 fetch_fsmap finished waiting for FSMap version 39 2023-10-06T11:09:24.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.399+0000 7fbbed153b80 10 client.6078 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-10-06T11:09:24.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.399+0000 7fbbed153b80 20 client.6078 populate_metadata read hostname 'smithi146' 2023-10-06T11:09:24.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.399+0000 7fbbed153b80 1 --2- 172.21.15.146:0/4236079151 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x560309f2e240 0x560309f0d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:24.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.399+0000 7fbbed153b80 4 client.6078 mds_command: new command op to 5481 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:09:24.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.399+0000 7fbbed153b80 1 -- 172.21.15.146:0/4236079151 --> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560309e9d610 con 0x560309f2e240 2023-10-06T11:09:24.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.399+0000 7fbbe1bf7700 1 --2- 172.21.15.146:0/4236079151 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x560309f2e240 0x560309f0d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:24.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.399+0000 7fbbbbfff700 10 client.6078 ms_handle_connect on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:24.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.399+0000 7fbbe1bf7700 1 --2- 172.21.15.146:0/4236079151 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x560309f2e240 0x560309f0d460 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee9fba3636793c83 server_cookie=1787678d17216f8b in_seq=0 out_seq=0 2023-10-06T11:09:24.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.399+0000 7fbbbbfff700 1 -- 172.21.15.146:0/4236079151 <== mds.0 v2:172.21.15.146:6835/2252184844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x560309e9d610 con 0x560309f2e240 2023-10-06T11:09:24.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.399+0000 7fbbbbfff700 10 client.6078 handle_command_reply: tid=0 2023-10-06T11:09:24.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.399+0000 7fbbed153b80 1 client.6078 shutdown 2023-10-06T11:09:24.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.400+0000 7fbbed153b80 1 -- 172.21.15.146:0/4236079151 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560309f12eb0 msgr2=0x560309efb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:24.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.400+0000 7fbbed153b80 1 --2- 172.21.15.146:0/4236079151 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560309f12eb0 0x560309efb080 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fbbd4055f80 tx=0x7fbbd406c000 comp rx=0 tx=0).stop 2023-10-06T11:09:24.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.400+0000 7fbbed153b80 1 -- 172.21.15.146:0/4236079151 shutdown_connections 2023-10-06T11:09:24.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.400+0000 7fbbed153b80 1 --2- 172.21.15.146:0/4236079151 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x560309f2e240 0x560309f0d460 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.400+0000 7fbbed153b80 1 --2- 172.21.15.146:0/4236079151 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560309f12eb0 0x560309efb080 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.400+0000 7fbbbbfff700 0 client.6078 ms_handle_reset on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:24.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.400+0000 7fbbed153b80 1 --2- 172.21.15.146:0/4236079151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560309eccc20 0x560309ef5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.400+0000 7fbbed153b80 1 --2- 172.21.15.146:0/4236079151 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560309f12ae0 0x560309f0cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.400+0000 7fbbed153b80 1 -- 172.21.15.146:0/4236079151 >> 172.21.15.146:0/4236079151 conn(0x560309ecd0c0 msgr2=0x560309ec6790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:24.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.400+0000 7fbbed153b80 1 -- 172.21.15.146:0/4236079151 shutdown_connections 2023-10-06T11:09:24.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.400+0000 7fbbed153b80 1 -- 172.21.15.146:0/4236079151 wait complete. 2023-10-06T11:09:24.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.400+0000 7fbbed153b80 20 client.6078 trim_cache size 0 max 16384 2023-10-06T11:09:24.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.416+0000 7fbbed153b80 1 Processor -- start 2023-10-06T11:09:24.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.416+0000 7fbbed153b80 1 -- start start 2023-10-06T11:09:24.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.416+0000 7fbbed153b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560309eccc20 0x560309ec7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:24.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.416+0000 7fbbed153b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560309f12ae0 0x560309ef6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:24.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.416+0000 7fbbed153b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560309f12eb0 0x560309ef6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:24.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.416+0000 7fbbed153b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x560309c9ee80 con 0x560309eccc20 2023-10-06T11:09:24.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.416+0000 7fbbed153b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x560309f207e0 con 0x560309f12eb0 2023-10-06T11:09:24.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.416+0000 7fbbed153b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x560309efa5f0 con 0x560309f12ae0 2023-10-06T11:09:24.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.416+0000 7fbbe1bf7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560309eccc20 0x560309ec7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:24.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.417+0000 7fbbe1bf7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560309eccc20 0x560309ec7ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41294/0 (socket says 172.21.15.146:41294) 2023-10-06T11:09:24.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.417+0000 7fbbe1bf7700 1 -- 172.21.15.146:0/1385841333 learned_addr learned my addr 172.21.15.146:0/1385841333 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:24.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.417+0000 7fbbe1bf7700 1 -- 172.21.15.146:0/1385841333 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560309f12ae0 msgr2=0x560309ef6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:24.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.417+0000 7fbbe1bf7700 1 --2- 172.21.15.146:0/1385841333 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560309f12ae0 0x560309ef6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.417+0000 7fbbe1bf7700 1 -- 172.21.15.146:0/1385841333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560309f12eb0 msgr2=0x560309ef6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:24.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.417+0000 7fbbe1bf7700 1 --2- 172.21.15.146:0/1385841333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560309f12eb0 0x560309ef6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.417+0000 7fbbe1bf7700 1 -- 172.21.15.146:0/1385841333 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560309dea7d0 con 0x560309eccc20 2023-10-06T11:09:24.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.417+0000 7fbbe1bf7700 1 --2- 172.21.15.146:0/1385841333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560309eccc20 0x560309ec7ce0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fbbd800b3c0 tx=0x7fbbd802b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4504e19072d772aa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:24.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.417+0000 7fbbc77fe700 1 -- 172.21.15.146:0/1385841333 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd800be10 con 0x560309eccc20 2023-10-06T11:09:24.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.417+0000 7fbbc77fe700 1 -- 172.21.15.146:0/1385841333 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd802f040 con 0x560309eccc20 2023-10-06T11:09:24.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.417+0000 7fbbc77fe700 1 -- 172.21.15.146:0/1385841333 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd801ebe0 con 0x560309eccc20 2023-10-06T11:09:24.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.417+0000 7fbbed153b80 1 -- 172.21.15.146:0/1385841333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560309eccc20 msgr2=0x560309ec7ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:24.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.417+0000 7fbbed153b80 1 --2- 172.21.15.146:0/1385841333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560309eccc20 0x560309ec7ce0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fbbd800b3c0 tx=0x7fbbd802b040 comp rx=0 tx=0).stop 2023-10-06T11:09:24.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.418+0000 7fbbed153b80 1 -- 172.21.15.146:0/1385841333 shutdown_connections 2023-10-06T11:09:24.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.418+0000 7fbbed153b80 1 --2- 172.21.15.146:0/1385841333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560309f12eb0 0x560309ef6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.418+0000 7fbbed153b80 1 --2- 172.21.15.146:0/1385841333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560309eccc20 0x560309ec7ce0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.418+0000 7fbbed153b80 1 --2- 172.21.15.146:0/1385841333 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560309f12ae0 0x560309ef6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.418+0000 7fbbed153b80 1 -- 172.21.15.146:0/1385841333 >> 172.21.15.146:0/1385841333 conn(0x560309ecd0c0 msgr2=0x560309ec6ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:24.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.418+0000 7fbbed153b80 1 -- 172.21.15.146:0/1385841333 shutdown_connections 2023-10-06T11:09:24.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.418+0000 7fbbed153b80 1 -- 172.21.15.146:0/1385841333 wait complete. 2023-10-06T11:09:24.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.418+0000 7fbbed153b80 1 -- start start 2023-10-06T11:09:24.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.418+0000 7fbbed153b80 1 Processor -- start 2023-10-06T11:09:24.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.419+0000 7fbbed153b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560309eccc20 0x560309ec7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:24.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.419+0000 7fbbed153b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560309f12ae0 0x560309f69280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:24.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.419+0000 7fbbed153b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560309f12eb0 0x560309f80250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:24.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.419+0000 7fbbed153b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x560309f814f0 con 0x560309eccc20 2023-10-06T11:09:24.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.419+0000 7fbbed153b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x560309ef3870 con 0x560309f12eb0 2023-10-06T11:09:24.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.419+0000 7fbbed153b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x560309ef3ab0 con 0x560309f12ae0 2023-10-06T11:09:24.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.419+0000 7fbbed153b80 10 client.0 _ll_register_callbacks cb 0x560309cb8f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:09:24.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.419+0000 7fbbe1bf7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560309eccc20 0x560309ec7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:24.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.419+0000 7fbbe1bf7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560309eccc20 0x560309ec7ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41306/0 (socket says 172.21.15.146:41306) 2023-10-06T11:09:24.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.419+0000 7fbbe1bf7700 1 -- 172.21.15.146:0/1333589046 learned_addr learned my addr 172.21.15.146:0/1333589046 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:24.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.419+0000 7fbbe13f6700 1 --2- 172.21.15.146:0/1333589046 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560309f12ae0 0x560309f69280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:24.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.419+0000 7fbbe23f8700 1 --2- 172.21.15.146:0/1333589046 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560309f12eb0 0x560309f80250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:24.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.419+0000 7fbbe1bf7700 1 -- 172.21.15.146:0/1333589046 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560309f12ae0 msgr2=0x560309f69280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:24.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.419+0000 7fbbe1bf7700 1 --2- 172.21.15.146:0/1333589046 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560309f12ae0 0x560309f69280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.419+0000 7fbbe1bf7700 1 -- 172.21.15.146:0/1333589046 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560309f12eb0 msgr2=0x560309f80250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:24.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.419+0000 7fbbe1bf7700 1 --2- 172.21.15.146:0/1333589046 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560309f12eb0 0x560309f80250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.419+0000 7fbbe1bf7700 1 -- 172.21.15.146:0/1333589046 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbdc0ad970 con 0x560309eccc20 2023-10-06T11:09:24.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.419+0000 7fbbe13f6700 1 --2- 172.21.15.146:0/1333589046 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560309f12ae0 0x560309f69280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:24.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.420+0000 7fbbe1bf7700 1 --2- 172.21.15.146:0/1333589046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560309eccc20 0x560309ec7ce0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fbbd801efd0 tx=0x7fbbd8030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3272befd4ce7a4d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:24.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.420+0000 7fbbbbfff700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:09:24.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.420+0000 7fbbbbfff700 1 -- 172.21.15.146:0/1333589046 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd803f650 con 0x560309eccc20 2023-10-06T11:09:24.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.420+0000 7fbbbbfff700 1 -- 172.21.15.146:0/1333589046 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbbd803f7b0 con 0x560309eccc20 2023-10-06T11:09:24.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.420+0000 7fbbed153b80 1 -- 172.21.15.146:0/1333589046 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbbd406be90 con 0x560309eccc20 2023-10-06T11:09:24.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.420+0000 7fbbbbfff700 1 -- 172.21.15.146:0/1333589046 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbbd803fb80 con 0x560309eccc20 2023-10-06T11:09:24.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.420+0000 7fbbed153b80 10 client.6084 fetch_fsmap learned FSMap version 39 2023-10-06T11:09:24.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.420+0000 7fbbed153b80 1 -- 172.21.15.146:0/1333589046 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x560309dd14c0 con 0x560309eccc20 2023-10-06T11:09:24.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.420+0000 7fbbbbfff700 1 -- 172.21.15.146:0/1333589046 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd406be90 con 0x560309eccc20 2023-10-06T11:09:24.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.420+0000 7fbbbbfff700 1 -- 172.21.15.146:0/1333589046 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 39) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fbbd8034430 con 0x560309eccc20 2023-10-06T11:09:24.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.420+0000 7fbbed153b80 10 client.6084 fetch_fsmap finished waiting for FSMap version 39 2023-10-06T11:09:24.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.420+0000 7fbbed153b80 10 client.6084 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-10-06T11:09:24.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.420+0000 7fbbed153b80 20 client.6084 populate_metadata read hostname 'smithi146' 2023-10-06T11:09:24.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.420+0000 7fbbed153b80 1 --2- 172.21.15.146:0/1333589046 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x560309f80790 0x560309f80b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:24.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.420+0000 7fbbed153b80 4 client.6084 mds_command: new command op to 5481 tid=0[{"prefix": "scrub status"}] 2023-10-06T11:09:24.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.420+0000 7fbbed153b80 1 -- 172.21.15.146:0/1333589046 --> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560309dbee50 con 0x560309f80790 2023-10-06T11:09:24.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.420+0000 7fbbe13f6700 1 --2- 172.21.15.146:0/1333589046 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x560309f80790 0x560309f80b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:24.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.421+0000 7fbbbbfff700 10 client.6084 ms_handle_connect on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:24.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.421+0000 7fbbe13f6700 1 --2- 172.21.15.146:0/1333589046 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x560309f80790 0x560309f80b60 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f0b3b8e78baed40 server_cookie=32674eedef4151cc in_seq=0 out_seq=0 2023-10-06T11:09:24.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.421+0000 7fbbbbfff700 1 -- 172.21.15.146:0/1333589046 <== mds.0 v2:172.21.15.146:6835/2252184844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x560309dbee50 con 0x560309f80790 2023-10-06T11:09:24.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.421+0000 7fbbbbfff700 10 client.6084 handle_command_reply: tid=0 2023-10-06T11:09:24.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.421+0000 7fbbed153b80 1 client.6084 shutdown 2023-10-06T11:09:24.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.421+0000 7fbbed153b80 1 -- 172.21.15.146:0/1333589046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560309eccc20 msgr2=0x560309ec7ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:24.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.421+0000 7fbbed153b80 1 --2- 172.21.15.146:0/1333589046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560309eccc20 0x560309ec7ce0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fbbd801efd0 tx=0x7fbbd8030000 comp rx=0 tx=0).stop 2023-10-06T11:09:24.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.421+0000 7fbbed153b80 1 -- 172.21.15.146:0/1333589046 shutdown_connections 2023-10-06T11:09:24.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.421+0000 7fbbed153b80 1 --2- 172.21.15.146:0/1333589046 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x560309f80790 0x560309f80b60 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.421+0000 7fbbed153b80 1 --2- 172.21.15.146:0/1333589046 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560309f12eb0 0x560309f80250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.421+0000 7fbbed153b80 1 --2- 172.21.15.146:0/1333589046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560309eccc20 0x560309ec7ce0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.421+0000 7fbbbbfff700 0 client.6084 ms_handle_reset on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:24.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.421+0000 7fbbed153b80 1 --2- 172.21.15.146:0/1333589046 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560309f12ae0 0x560309f69280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.421+0000 7fbbed153b80 1 -- 172.21.15.146:0/1333589046 >> 172.21.15.146:0/1333589046 conn(0x560309ecd0c0 msgr2=0x560309f0b910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:24.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.421+0000 7fbbed153b80 1 -- 172.21.15.146:0/1333589046 shutdown_connections 2023-10-06T11:09:24.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.421+0000 7fbbed153b80 1 -- 172.21.15.146:0/1333589046 wait complete. 2023-10-06T11:09:24.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.421+0000 7fbbed153b80 20 client.6084 trim_cache size 0 max 16384 2023-10-06T11:09:24.431 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:09:24.431 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "no active scrubs running", 2023-10-06T11:09:24.431 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": {} 2023-10-06T11:09:24.431 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:09:24.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.422+0000 7fbbe3e5b700 1 -- 172.21.15.146:0/4294006525 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbbc0066f30 msgr2=0x7fbbc00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:24.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.422+0000 7fbbe3e5b700 1 --2- 172.21.15.146:0/4294006525 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbbc0066f30 0x7fbbc00693e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fbbd80030c0 tx=0x7fbbd8015000 comp rx=0 tx=0).stop 2023-10-06T11:09:24.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.422+0000 7fbbe3e5b700 1 -- 172.21.15.146:0/4294006525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbdc15a160 msgr2=0x7fbbdc0c6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:24.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.422+0000 7fbbe3e5b700 1 --2- 172.21.15.146:0/4294006525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbdc15a160 0x7fbbdc0c6030 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fbbd400c960 tx=0x7fbbd40026e0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.422+0000 7fbbe3e5b700 1 -- 172.21.15.146:0/4294006525 shutdown_connections 2023-10-06T11:09:24.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.422+0000 7fbbe3e5b700 1 --2- 172.21.15.146:0/4294006525 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbbc0066f30 0x7fbbc00693e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.422+0000 7fbbe3e5b700 1 --2- 172.21.15.146:0/4294006525 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbbdc15a160 0x7fbbdc0c6030 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.422+0000 7fbbe3e5b700 1 --2- 172.21.15.146:0/4294006525 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbbdc0ae730 0x7fbbdc14d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.422+0000 7fbbe3e5b700 1 --2- 172.21.15.146:0/4294006525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbdc0ce3d0 0x7fbbdc0c5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.422+0000 7fbbe3e5b700 1 -- 172.21.15.146:0/4294006525 >> 172.21.15.146:0/4294006525 conn(0x7fbbdc06f380 msgr2=0x7fbbdc0cd250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:24.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.422+0000 7fbbe3e5b700 1 -- 172.21.15.146:0/4294006525 shutdown_connections 2023-10-06T11:09:24.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.422+0000 7fbbe3e5b700 1 -- 172.21.15.146:0/4294006525 wait complete. 2023-10-06T11:09:24.435 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-06T11:09:24.435 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 damage ls 2023-10-06T11:09:24.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.550+0000 7fbc108ae700 1 Processor -- start 2023-10-06T11:09:24.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.550+0000 7fbc108ae700 1 -- start start 2023-10-06T11:09:24.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.551+0000 7fbc108ae700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbc0c0cdde0 0x7fbc0c0b00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:24.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.551+0000 7fbc108ae700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbc0c0aecd0 0x7fbc0c0af110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:24.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.551+0000 7fbc108ae700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc0c0cb870 con 0x7fbc0c159a90 2023-10-06T11:09:24.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.551+0000 7fbc108ae700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc0c0caa40 con 0x7fbc0c0aecd0 2023-10-06T11:09:24.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.551+0000 7fbc108ae700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc0c0af650 con 0x7fbc0c0cdde0 2023-10-06T11:09:24.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.551+0000 7fbc0ad9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbc0c0aecd0 0x7fbc0c0af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:24.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.552+0000 7fbc0ad9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbc0c0aecd0 0x7fbc0c0af110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41318/0 (socket says 172.21.15.146:41318) 2023-10-06T11:09:24.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.552+0000 7fbc0ad9d700 1 -- 172.21.15.146:0/2820349379 learned_addr learned my addr 172.21.15.146:0/2820349379 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:24.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.552+0000 7fbc09d9b700 1 --2- 172.21.15.146:0/2820349379 >> v2:172.21.15.151:3300/0 conn(0x7fbc0c0cdde0 0x7fbc0c0b00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:24.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.552+0000 7fbc0ad9d700 1 -- 172.21.15.146:0/2820349379 >> v2:172.21.15.151:3300/0 conn(0x7fbc0c0cdde0 msgr2=0x7fbc0c0b00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:24.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.552+0000 7fbc0ad9d700 1 --2- 172.21.15.146:0/2820349379 >> v2:172.21.15.151:3300/0 conn(0x7fbc0c0cdde0 0x7fbc0c0b00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.552+0000 7fbc0ad9d700 1 -- 172.21.15.146:0/2820349379 >> v1:172.21.15.151:6789/0 conn(0x7fbc0c159a90 legacy=0x7fbc0c0ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:24.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.552+0000 7fbc0ad9d700 1 -- 172.21.15.146:0/2820349379 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc0c0cac60 con 0x7fbc0c0aecd0 2023-10-06T11:09:24.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.552+0000 7fbc0ad9d700 1 --2- 172.21.15.146:0/2820349379 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc0c0aecd0 0x7fbc0c0af110 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c06ecb0 tx=0x7fbc04009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1968cbf3f8d1f26 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:24.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.552+0000 7fbc0959a700 1 -- 172.21.15.146:0/2820349379 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0400e070 con 0x7fbc0c0aecd0 2023-10-06T11:09:24.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.552+0000 7fbc0959a700 1 -- 172.21.15.146:0/2820349379 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc0400ba20 con 0x7fbc0c0aecd0 2023-10-06T11:09:24.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.552+0000 7fbc0959a700 1 -- 172.21.15.146:0/2820349379 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc040092e0 con 0x7fbc0c0aecd0 2023-10-06T11:09:24.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.553+0000 7fbc108ae700 1 -- 172.21.15.146:0/2820349379 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc0c0aecd0 msgr2=0x7fbc0c0af110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:24.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.553+0000 7fbc108ae700 1 --2- 172.21.15.146:0/2820349379 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc0c0aecd0 0x7fbc0c0af110 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c06ecb0 tx=0x7fbc04009840 comp rx=0 tx=0).stop 2023-10-06T11:09:24.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.553+0000 7fbc108ae700 1 -- 172.21.15.146:0/2820349379 shutdown_connections 2023-10-06T11:09:24.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.553+0000 7fbc108ae700 1 --2- 172.21.15.146:0/2820349379 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc0c0aecd0 0x7fbc0c0af110 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.553+0000 7fbc108ae700 1 --2- 172.21.15.146:0/2820349379 >> v2:172.21.15.151:3300/0 conn(0x7fbc0c0cdde0 0x7fbc0c0b00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.553+0000 7fbc108ae700 1 -- 172.21.15.146:0/2820349379 >> 172.21.15.146:0/2820349379 conn(0x7fbc0c068580 msgr2=0x7fbc0c068980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:24.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.553+0000 7fbc108ae700 1 -- 172.21.15.146:0/2820349379 shutdown_connections 2023-10-06T11:09:24.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.553+0000 7fbc108ae700 1 -- 172.21.15.146:0/2820349379 wait complete. 2023-10-06T11:09:24.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.554+0000 7fbc108ae700 1 Processor -- start 2023-10-06T11:09:24.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.554+0000 7fbc108ae700 1 -- start start 2023-10-06T11:09:24.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.555+0000 7fbc108ae700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc0c0aecd0 0x7fbc0c144680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:24.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.555+0000 7fbc108ae700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc0c0cdde0 0x7fbc0c0aab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:24.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.555+0000 7fbc108ae700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc0c159a90 0x7fbc0c0ab0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:24.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.555+0000 7fbc108ae700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0c0a6df0 con 0x7fbc0c159a90 2023-10-06T11:09:24.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.555+0000 7fbc108ae700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0c0a8380 con 0x7fbc0c0aecd0 2023-10-06T11:09:24.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.555+0000 7fbc108ae700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0c0a8660 con 0x7fbc0c0cdde0 2023-10-06T11:09:24.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.555+0000 7fbc0ad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc0c159a90 0x7fbc0c0ab0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:24.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.555+0000 7fbc0ad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc0c159a90 0x7fbc0c0ab0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41332/0 (socket says 172.21.15.146:41332) 2023-10-06T11:09:24.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.555+0000 7fbc0ad9d700 1 -- 172.21.15.146:0/4274251824 learned_addr learned my addr 172.21.15.146:0/4274251824 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:24.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.555+0000 7fbc0a59c700 1 --2- 172.21.15.146:0/4274251824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc0c0aecd0 0x7fbc0c144680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:24.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.555+0000 7fbc09d9b700 1 --2- 172.21.15.146:0/4274251824 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc0c0cdde0 0x7fbc0c0aab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:24.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.555+0000 7fbc0ad9d700 1 -- 172.21.15.146:0/4274251824 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc0c0cdde0 msgr2=0x7fbc0c0aab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:24.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.555+0000 7fbc0ad9d700 1 --2- 172.21.15.146:0/4274251824 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc0c0cdde0 0x7fbc0c0aab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.555+0000 7fbc0ad9d700 1 -- 172.21.15.146:0/4274251824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc0c0aecd0 msgr2=0x7fbc0c144680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:24.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.555+0000 7fbc0ad9d700 1 --2- 172.21.15.146:0/4274251824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc0c0aecd0 0x7fbc0c144680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.555+0000 7fbc0ad9d700 1 -- 172.21.15.146:0/4274251824 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc04009ae0 con 0x7fbc0c159a90 2023-10-06T11:09:24.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.555+0000 7fbc0ad9d700 1 --2- 172.21.15.146:0/4274251824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc0c159a90 0x7fbc0c0ab0a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fbc04009880 tx=0x7fbc04018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:24.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.555+0000 7fbbfa7fc700 1 -- 172.21.15.146:0/4274251824 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc04008a80 con 0x7fbc0c159a90 2023-10-06T11:09:24.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.555+0000 7fbbfa7fc700 1 -- 172.21.15.146:0/4274251824 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc04008be0 con 0x7fbc0c159a90 2023-10-06T11:09:24.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.555+0000 7fbc108ae700 1 -- 172.21.15.146:0/4274251824 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc0c0a8940 con 0x7fbc0c159a90 2023-10-06T11:09:24.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.555+0000 7fbbfa7fc700 1 -- 172.21.15.146:0/4274251824 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc04025460 con 0x7fbc0c159a90 2023-10-06T11:09:24.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.555+0000 7fbc108ae700 1 -- 172.21.15.146:0/4274251824 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc0c144bc0 con 0x7fbc0c159a90 2023-10-06T11:09:24.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.557+0000 7fbbfa7fc700 1 -- 172.21.15.146:0/4274251824 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbc04003040 con 0x7fbc0c159a90 2023-10-06T11:09:24.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.557+0000 7fbbfa7fc700 1 --2- 172.21.15.146:0/4274251824 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbbec066f30 0x7fbbec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:24.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.557+0000 7fbbfa7fc700 1 -- 172.21.15.146:0/4274251824 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbc040861d0 con 0x7fbc0c159a90 2023-10-06T11:09:24.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.557+0000 7fbc0a59c700 1 --2- 172.21.15.146:0/4274251824 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbbec066f30 0x7fbbec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:24.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.558+0000 7fbc0a59c700 1 --2- 172.21.15.146:0/4274251824 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbbec066f30 0x7fbbec0693e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c0ac440 tx=0x7fbbfc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:24.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.559+0000 7fbc19ba6b80 1 Processor -- start 2023-10-06T11:09:24.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.559+0000 7fbc19ba6b80 1 -- start start 2023-10-06T11:09:24.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.560+0000 7fbc19ba6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562278589ae0 0x562278589eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:24.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.560+0000 7fbc19ba6b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5622785459f0 0x5622785425d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:24.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.560+0000 7fbc19ba6b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562278543c20 0x562278542b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:24.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.560+0000 7fbc19ba6b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622784c2cd0 con 0x5622785459f0 2023-10-06T11:09:24.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.560+0000 7fbc19ba6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562278499ac0 con 0x562278589ae0 2023-10-06T11:09:24.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.560+0000 7fbc19ba6b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5622784972c0 con 0x562278543c20 2023-10-06T11:09:24.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.560+0000 7fbc09d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5622785459f0 0x5622785425d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:24.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.560+0000 7fbc09d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5622785459f0 0x5622785425d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41342/0 (socket says 172.21.15.146:41342) 2023-10-06T11:09:24.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.560+0000 7fbc09d9b700 1 -- 172.21.15.146:0/3813751692 learned_addr learned my addr 172.21.15.146:0/3813751692 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:24.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.560+0000 7fbc0a59c700 1 --2- 172.21.15.146:0/3813751692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562278589ae0 0x562278589eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:24.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.560+0000 7fbc0ad9d700 1 --2- 172.21.15.146:0/3813751692 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562278543c20 0x562278542b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:24.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.560+0000 7fbc09d9b700 1 -- 172.21.15.146:0/3813751692 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562278543c20 msgr2=0x562278542b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:24.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.560+0000 7fbc09d9b700 1 --2- 172.21.15.146:0/3813751692 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562278543c20 0x562278542b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.560+0000 7fbc09d9b700 1 -- 172.21.15.146:0/3813751692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562278589ae0 msgr2=0x562278589eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:24.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.560+0000 7fbc09d9b700 1 --2- 172.21.15.146:0/3813751692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562278589ae0 0x562278589eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.560+0000 7fbc09d9b700 1 -- 172.21.15.146:0/3813751692 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56227832d2c0 con 0x5622785459f0 2023-10-06T11:09:24.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.560+0000 7fbc0ad9d700 1 --2- 172.21.15.146:0/3813751692 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562278543c20 0x562278542b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:09:24.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.560+0000 7fbc09d9b700 1 --2- 172.21.15.146:0/3813751692 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5622785459f0 0x5622785425d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fbc00009da0 tx=0x7fbc000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c83dded38aec0186 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:24.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.561+0000 7fbbeb7fe700 1 -- 172.21.15.146:0/3813751692 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc00011d50 con 0x5622785459f0 2023-10-06T11:09:24.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.561+0000 7fbbeb7fe700 1 -- 172.21.15.146:0/3813751692 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc00011eb0 con 0x5622785459f0 2023-10-06T11:09:24.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.561+0000 7fbbeb7fe700 1 -- 172.21.15.146:0/3813751692 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc00014650 con 0x5622785459f0 2023-10-06T11:09:24.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.561+0000 7fbc19ba6b80 1 -- 172.21.15.146:0/3813751692 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5622785459f0 msgr2=0x5622785425d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:24.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.561+0000 7fbc19ba6b80 1 --2- 172.21.15.146:0/3813751692 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5622785459f0 0x5622785425d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fbc00009da0 tx=0x7fbc000091a0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.561+0000 7fbc19ba6b80 1 -- 172.21.15.146:0/3813751692 shutdown_connections 2023-10-06T11:09:24.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.561+0000 7fbc19ba6b80 1 --2- 172.21.15.146:0/3813751692 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562278543c20 0x562278542b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.561+0000 7fbc19ba6b80 1 --2- 172.21.15.146:0/3813751692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562278589ae0 0x562278589eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.561+0000 7fbc19ba6b80 1 --2- 172.21.15.146:0/3813751692 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5622785459f0 0x5622785425d0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.561+0000 7fbc19ba6b80 1 -- 172.21.15.146:0/3813751692 >> 172.21.15.146:0/3813751692 conn(0x5622785440c0 msgr2=0x562278544490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:24.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.561+0000 7fbc19ba6b80 1 -- 172.21.15.146:0/3813751692 shutdown_connections 2023-10-06T11:09:24.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.561+0000 7fbc19ba6b80 1 -- 172.21.15.146:0/3813751692 wait complete. 2023-10-06T11:09:24.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.562+0000 7fbc19ba6b80 1 -- start start 2023-10-06T11:09:24.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.562+0000 7fbc19ba6b80 1 Processor -- start 2023-10-06T11:09:24.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.563+0000 7fbc19ba6b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562278543c20 0x562278586480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:24.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.563+0000 7fbc19ba6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622785459f0 0x562278542d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:24.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.563+0000 7fbc19ba6b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562278589ae0 0x56227859b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:24.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.563+0000 7fbc19ba6b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622784930b0 con 0x562278589ae0 2023-10-06T11:09:24.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.563+0000 7fbc19ba6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56227843e8e0 con 0x5622785459f0 2023-10-06T11:09:24.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.563+0000 7fbc19ba6b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x562278459ef0 con 0x562278543c20 2023-10-06T11:09:24.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.563+0000 7fbc19ba6b80 10 client.0 _ll_register_callbacks cb 0x56227832ff80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:09:24.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.563+0000 7fbc0ad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562278589ae0 0x56227859b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:24.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.563+0000 7fbc0ad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562278589ae0 0x56227859b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41350/0 (socket says 172.21.15.146:41350) 2023-10-06T11:09:24.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.563+0000 7fbc0ad9d700 1 -- 172.21.15.146:0/1490041367 learned_addr learned my addr 172.21.15.146:0/1490041367 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:24.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.563+0000 7fbc0a59c700 1 --2- 172.21.15.146:0/1490041367 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562278543c20 0x562278586480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:24.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.563+0000 7fbc09d9b700 1 --2- 172.21.15.146:0/1490041367 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622785459f0 0x562278542d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:24.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.563+0000 7fbc0ad9d700 1 -- 172.21.15.146:0/1490041367 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562278543c20 msgr2=0x562278586480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:24.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.563+0000 7fbc0ad9d700 1 --2- 172.21.15.146:0/1490041367 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562278543c20 0x562278586480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.563+0000 7fbc0ad9d700 1 -- 172.21.15.146:0/1490041367 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622785459f0 msgr2=0x562278542d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:24.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.563+0000 7fbc0ad9d700 1 --2- 172.21.15.146:0/1490041367 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622785459f0 0x562278542d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.563+0000 7fbc0ad9d700 1 -- 172.21.15.146:0/1490041367 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc00009a20 con 0x562278589ae0 2023-10-06T11:09:24.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.563+0000 7fbc09d9b700 1 --2- 172.21.15.146:0/1490041367 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622785459f0 0x562278542d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:24.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.563+0000 7fbc0ad9d700 1 --2- 172.21.15.146:0/1490041367 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562278589ae0 0x56227859b4d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fbc04084640 tx=0x7fbc0405c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beb1842875f3be00 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:24.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.563+0000 7fbbe8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:09:24.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.564+0000 7fbbe8ff9700 1 -- 172.21.15.146:0/1490041367 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0400e070 con 0x562278589ae0 2023-10-06T11:09:24.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.564+0000 7fbbe8ff9700 1 -- 172.21.15.146:0/1490041367 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbc0405dfc0 con 0x562278589ae0 2023-10-06T11:09:24.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.564+0000 7fbc19ba6b80 1 -- 172.21.15.146:0/1490041367 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5622785376e0 con 0x562278589ae0 2023-10-06T11:09:24.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.564+0000 7fbbe8ff9700 1 -- 172.21.15.146:0/1490041367 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc0405a2d0 con 0x562278589ae0 2023-10-06T11:09:24.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.564+0000 7fbc19ba6b80 10 client.6096 fetch_fsmap learned FSMap version 39 2023-10-06T11:09:24.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.564+0000 7fbc19ba6b80 1 -- 172.21.15.146:0/1490041367 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x5622782d0030 con 0x562278589ae0 2023-10-06T11:09:24.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.564+0000 7fbbe8ff9700 1 -- 172.21.15.146:0/1490041367 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5622785376e0 con 0x562278589ae0 2023-10-06T11:09:24.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.564+0000 7fbbe8ff9700 1 -- 172.21.15.146:0/1490041367 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 39) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fbc040565c0 con 0x562278589ae0 2023-10-06T11:09:24.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.564+0000 7fbc19ba6b80 10 client.6096 fetch_fsmap finished waiting for FSMap version 39 2023-10-06T11:09:24.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.564+0000 7fbc19ba6b80 10 client.6096 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-10-06T11:09:24.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.564+0000 7fbc19ba6b80 20 client.6096 populate_metadata read hostname 'smithi146' 2023-10-06T11:09:24.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.564+0000 7fbc19ba6b80 1 --2- 172.21.15.146:0/1490041367 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x562278598bf0 0x56227856d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:24.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.564+0000 7fbc19ba6b80 4 client.6096 mds_command: new command op to 5481 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:09:24.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.564+0000 7fbc19ba6b80 1 -- 172.21.15.146:0/1490041367 --> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562278514610 con 0x562278598bf0 2023-10-06T11:09:24.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.564+0000 7fbc0a59c700 1 --2- 172.21.15.146:0/1490041367 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x562278598bf0 0x56227856d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:24.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.564+0000 7fbbe8ff9700 10 client.6096 ms_handle_connect on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:24.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.564+0000 7fbc0a59c700 1 --2- 172.21.15.146:0/1490041367 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x562278598bf0 0x56227856d440 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=839b586f892af145 server_cookie=55894b8afb595584 in_seq=0 out_seq=0 2023-10-06T11:09:24.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.565+0000 7fbbe8ff9700 1 -- 172.21.15.146:0/1490041367 <== mds.0 v2:172.21.15.146:6835/2252184844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x562278514610 con 0x562278598bf0 2023-10-06T11:09:24.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.565+0000 7fbbe8ff9700 10 client.6096 handle_command_reply: tid=0 2023-10-06T11:09:24.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.565+0000 7fbc19ba6b80 1 client.6096 shutdown 2023-10-06T11:09:24.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.565+0000 7fbc19ba6b80 1 -- 172.21.15.146:0/1490041367 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562278589ae0 msgr2=0x56227859b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:24.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.565+0000 7fbc19ba6b80 1 --2- 172.21.15.146:0/1490041367 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562278589ae0 0x56227859b4d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fbc04084640 tx=0x7fbc0405c040 comp rx=0 tx=0).stop 2023-10-06T11:09:24.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.565+0000 7fbc19ba6b80 1 -- 172.21.15.146:0/1490041367 shutdown_connections 2023-10-06T11:09:24.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.565+0000 7fbc19ba6b80 1 --2- 172.21.15.146:0/1490041367 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x562278598bf0 0x56227856d440 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.565+0000 7fbc19ba6b80 1 --2- 172.21.15.146:0/1490041367 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562278589ae0 0x56227859b4d0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.565+0000 7fbc19ba6b80 1 --2- 172.21.15.146:0/1490041367 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562278543c20 0x562278586480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.565+0000 7fbbe8ff9700 0 client.6096 ms_handle_reset on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:24.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.565+0000 7fbc19ba6b80 1 --2- 172.21.15.146:0/1490041367 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622785459f0 0x562278542d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.565+0000 7fbc19ba6b80 1 -- 172.21.15.146:0/1490041367 >> 172.21.15.146:0/1490041367 conn(0x5622785440c0 msgr2=0x5622785874e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:24.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.565+0000 7fbc19ba6b80 1 -- 172.21.15.146:0/1490041367 shutdown_connections 2023-10-06T11:09:24.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.565+0000 7fbc19ba6b80 1 -- 172.21.15.146:0/1490041367 wait complete. 2023-10-06T11:09:24.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.566+0000 7fbc19ba6b80 20 client.6096 trim_cache size 0 max 16384 2023-10-06T11:09:24.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.578+0000 7fbc19ba6b80 1 Processor -- start 2023-10-06T11:09:24.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.578+0000 7fbc19ba6b80 1 -- start start 2023-10-06T11:09:24.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.578+0000 7fbc19ba6b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562278543c20 0x56227858bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:24.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.578+0000 7fbc19ba6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622785459f0 0x56227858c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:24.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.578+0000 7fbc19ba6b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562278589ae0 0x5622785688d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:24.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.578+0000 7fbc19ba6b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x562278315e80 con 0x562278589ae0 2023-10-06T11:09:24.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.578+0000 7fbc19ba6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622785ab510 con 0x5622785459f0 2023-10-06T11:09:24.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.578+0000 7fbc19ba6b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x56227859b8c0 con 0x562278543c20 2023-10-06T11:09:24.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.579+0000 7fbc0ad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562278589ae0 0x5622785688d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:24.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.579+0000 7fbc0ad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562278589ae0 0x5622785688d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41356/0 (socket says 172.21.15.146:41356) 2023-10-06T11:09:24.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.579+0000 7fbc0ad9d700 1 -- 172.21.15.146:0/4142811187 learned_addr learned my addr 172.21.15.146:0/4142811187 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:24.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.579+0000 7fbc0ad9d700 1 -- 172.21.15.146:0/4142811187 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562278543c20 msgr2=0x56227858bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:24.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.579+0000 7fbc0a59c700 1 --2- 172.21.15.146:0/4142811187 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562278543c20 0x56227858bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:24.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.579+0000 7fbc0ad9d700 1 --2- 172.21.15.146:0/4142811187 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562278543c20 0x56227858bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.579+0000 7fbc0ad9d700 1 -- 172.21.15.146:0/4142811187 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622785459f0 msgr2=0x56227858c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:24.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.579+0000 7fbc09d9b700 1 --2- 172.21.15.146:0/4142811187 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622785459f0 0x56227858c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:24.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.579+0000 7fbc0ad9d700 1 --2- 172.21.15.146:0/4142811187 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622785459f0 0x56227858c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.579+0000 7fbc0ad9d700 1 -- 172.21.15.146:0/4142811187 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5622784617d0 con 0x562278589ae0 2023-10-06T11:09:24.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.579+0000 7fbc0ad9d700 1 --2- 172.21.15.146:0/4142811187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562278589ae0 0x5622785688d0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fbc040535d0 tx=0x7fbc0406a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2209b1ee4cdadf02 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:24.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.579+0000 7fbbebfff700 1 -- 172.21.15.146:0/4142811187 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc0405dfc0 con 0x562278589ae0 2023-10-06T11:09:24.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.579+0000 7fbbebfff700 1 -- 172.21.15.146:0/4142811187 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc04008870 con 0x562278589ae0 2023-10-06T11:09:24.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.579+0000 7fbbebfff700 1 -- 172.21.15.146:0/4142811187 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc040842c0 con 0x562278589ae0 2023-10-06T11:09:24.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.580+0000 7fbc19ba6b80 1 -- 172.21.15.146:0/4142811187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562278589ae0 msgr2=0x5622785688d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:24.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.580+0000 7fbc19ba6b80 1 --2- 172.21.15.146:0/4142811187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562278589ae0 0x5622785688d0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fbc040535d0 tx=0x7fbc0406a000 comp rx=0 tx=0).stop 2023-10-06T11:09:24.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.580+0000 7fbc19ba6b80 1 -- 172.21.15.146:0/4142811187 shutdown_connections 2023-10-06T11:09:24.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.580+0000 7fbc19ba6b80 1 --2- 172.21.15.146:0/4142811187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562278589ae0 0x5622785688d0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.580+0000 7fbc19ba6b80 1 --2- 172.21.15.146:0/4142811187 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562278543c20 0x56227858bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.580+0000 7fbc19ba6b80 1 --2- 172.21.15.146:0/4142811187 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622785459f0 0x56227858c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.580+0000 7fbc19ba6b80 1 -- 172.21.15.146:0/4142811187 >> 172.21.15.146:0/4142811187 conn(0x5622785440c0 msgr2=0x5622785873e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:24.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.580+0000 7fbc19ba6b80 1 -- 172.21.15.146:0/4142811187 shutdown_connections 2023-10-06T11:09:24.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.580+0000 7fbc19ba6b80 1 -- 172.21.15.146:0/4142811187 wait complete. 2023-10-06T11:09:24.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.580+0000 7fbc19ba6b80 1 -- start start 2023-10-06T11:09:24.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.580+0000 7fbc19ba6b80 1 Processor -- start 2023-10-06T11:09:24.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.581+0000 7fbc19ba6b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562278543c20 0x5622785f0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:24.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.581+0000 7fbc19ba6b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5622785459f0 0x5622785698d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:24.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.581+0000 7fbc19ba6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562278589ae0 0x562278569e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:24.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.581+0000 7fbc19ba6b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622785915e0 con 0x5622785459f0 2023-10-06T11:09:24.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.581+0000 7fbc19ba6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562278563050 con 0x562278589ae0 2023-10-06T11:09:24.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.581+0000 7fbc19ba6b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x562278562a00 con 0x562278543c20 2023-10-06T11:09:24.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.581+0000 7fbc19ba6b80 10 client.0 _ll_register_callbacks cb 0x56227832ff80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:09:24.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.581+0000 7fbc09d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5622785459f0 0x5622785698d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:24.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.581+0000 7fbc09d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5622785459f0 0x5622785698d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41362/0 (socket says 172.21.15.146:41362) 2023-10-06T11:09:24.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.581+0000 7fbc09d9b700 1 -- 172.21.15.146:0/3557602794 learned_addr learned my addr 172.21.15.146:0/3557602794 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:24.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.581+0000 7fbc0ad9d700 1 --2- 172.21.15.146:0/3557602794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562278589ae0 0x562278569e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:24.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.581+0000 7fbc0a59c700 1 --2- 172.21.15.146:0/3557602794 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562278543c20 0x5622785f0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:24.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.582+0000 7fbc09d9b700 1 -- 172.21.15.146:0/3557602794 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562278543c20 msgr2=0x5622785f0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:24.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.582+0000 7fbc09d9b700 1 --2- 172.21.15.146:0/3557602794 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562278543c20 0x5622785f0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.582+0000 7fbc09d9b700 1 -- 172.21.15.146:0/3557602794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562278589ae0 msgr2=0x562278569e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:24.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.582+0000 7fbc09d9b700 1 --2- 172.21.15.146:0/3557602794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562278589ae0 0x562278569e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.582+0000 7fbc09d9b700 1 -- 172.21.15.146:0/3557602794 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5622782d0030 con 0x5622785459f0 2023-10-06T11:09:24.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.582+0000 7fbc0ad9d700 1 --2- 172.21.15.146:0/3557602794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562278589ae0 0x562278569e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:24.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.582+0000 7fbc09d9b700 1 --2- 172.21.15.146:0/3557602794 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5622785459f0 0x5622785698d0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fbc00009d40 tx=0x7fbc0001c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5373844a3c17b93c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:24.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.582+0000 7fbbe8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:09:24.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.582+0000 7fbbe8ff9700 1 -- 172.21.15.146:0/3557602794 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc00026070 con 0x5622785459f0 2023-10-06T11:09:24.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.582+0000 7fbbe8ff9700 1 -- 172.21.15.146:0/3557602794 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbc00018030 con 0x5622785459f0 2023-10-06T11:09:24.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.582+0000 7fbc19ba6b80 1 -- 172.21.15.146:0/3557602794 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbc00011eb0 con 0x5622785459f0 2023-10-06T11:09:24.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.582+0000 7fbbe8ff9700 1 -- 172.21.15.146:0/3557602794 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc00014a80 con 0x5622785459f0 2023-10-06T11:09:24.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.582+0000 7fbc19ba6b80 10 client.6102 fetch_fsmap learned FSMap version 39 2023-10-06T11:09:24.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.582+0000 7fbc19ba6b80 1 -- 172.21.15.146:0/3557602794 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x5622784484c0 con 0x5622785459f0 2023-10-06T11:09:24.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.582+0000 7fbbe8ff9700 1 -- 172.21.15.146:0/3557602794 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc00011eb0 con 0x5622785459f0 2023-10-06T11:09:24.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.582+0000 7fbbe8ff9700 1 -- 172.21.15.146:0/3557602794 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 39) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fbc00014be0 con 0x5622785459f0 2023-10-06T11:09:24.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.582+0000 7fbc19ba6b80 10 client.6102 fetch_fsmap finished waiting for FSMap version 39 2023-10-06T11:09:24.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.582+0000 7fbc19ba6b80 10 client.6102 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.c 2023-10-06T11:09:24.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.582+0000 7fbc19ba6b80 20 client.6102 populate_metadata read hostname 'smithi146' 2023-10-06T11:09:24.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.582+0000 7fbc19ba6b80 1 --2- 172.21.15.146:0/3557602794 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x5622785804d0 0x562278571aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:24.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.582+0000 7fbc19ba6b80 4 client.6102 mds_command: new command op to 5481 tid=0[{"prefix": "damage ls"}] 2023-10-06T11:09:24.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.582+0000 7fbc19ba6b80 1 -- 172.21.15.146:0/3557602794 --> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562278435e50 con 0x5622785804d0 2023-10-06T11:09:24.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.582+0000 7fbc0a59c700 1 --2- 172.21.15.146:0/3557602794 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x5622785804d0 0x562278571aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:24.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.583+0000 7fbbe8ff9700 10 client.6102 ms_handle_connect on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:24.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.583+0000 7fbc0a59c700 1 --2- 172.21.15.146:0/3557602794 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x5622785804d0 0x562278571aa0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bc199a137947bb8 server_cookie=a2907cf5edb87367 in_seq=0 out_seq=0 2023-10-06T11:09:24.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.583+0000 7fbbe8ff9700 1 -- 172.21.15.146:0/3557602794 <== mds.0 v2:172.21.15.146:6835/2252184844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+168 (crc 0 0 0) 0x562278435e50 con 0x5622785804d0 2023-10-06T11:09:24.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.583+0000 7fbbe8ff9700 10 client.6102 handle_command_reply: tid=0 2023-10-06T11:09:24.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.583+0000 7fbc19ba6b80 1 client.6102 shutdown 2023-10-06T11:09:24.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.583+0000 7fbc19ba6b80 1 -- 172.21.15.146:0/3557602794 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5622785459f0 msgr2=0x5622785698d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:24.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.583+0000 7fbc19ba6b80 1 --2- 172.21.15.146:0/3557602794 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5622785459f0 0x5622785698d0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fbc00009d40 tx=0x7fbc0001c000 comp rx=0 tx=0).stop 2023-10-06T11:09:24.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.583+0000 7fbc19ba6b80 1 -- 172.21.15.146:0/3557602794 shutdown_connections 2023-10-06T11:09:24.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.583+0000 7fbc19ba6b80 1 --2- 172.21.15.146:0/3557602794 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x5622785804d0 0x562278571aa0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.583+0000 7fbc19ba6b80 1 --2- 172.21.15.146:0/3557602794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562278589ae0 0x562278569e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.583+0000 7fbbe8ff9700 0 client.6102 ms_handle_reset on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:24.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.583+0000 7fbc19ba6b80 1 --2- 172.21.15.146:0/3557602794 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562278543c20 0x5622785f0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.583+0000 7fbc19ba6b80 1 --2- 172.21.15.146:0/3557602794 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5622785459f0 0x5622785698d0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.583+0000 7fbc19ba6b80 1 -- 172.21.15.146:0/3557602794 >> 172.21.15.146:0/3557602794 conn(0x5622785440c0 msgr2=0x5622785872a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:24.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.583+0000 7fbc19ba6b80 1 -- 172.21.15.146:0/3557602794 shutdown_connections 2023-10-06T11:09:24.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.583+0000 7fbc19ba6b80 1 -- 172.21.15.146:0/3557602794 wait complete. 2023-10-06T11:09:24.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.583+0000 7fbc19ba6b80 20 client.6102 trim_cache size 0 max 16384 2023-10-06T11:09:24.593 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2023-10-06T11:09:24.593 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:09:24.593 INFO:teuthology.orchestra.run.smithi146.stdout: "damage_type": "backtrace", 2023-10-06T11:09:24.593 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 1055442507, 2023-10-06T11:09:24.593 INFO:teuthology.orchestra.run.smithi146.stdout: "ino": 1099511630408, 2023-10-06T11:09:24.593 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_test_path/ceph-qa-suite/new_file_1" 2023-10-06T11:09:24.593 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:09:24.594 INFO:teuthology.orchestra.run.smithi146.stdout:] 2023-10-06T11:09:24.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.584+0000 7fbc108ae700 1 -- 172.21.15.146:0/4274251824 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbbec066f30 msgr2=0x7fbbec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:24.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.584+0000 7fbc108ae700 1 --2- 172.21.15.146:0/4274251824 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbbec066f30 0x7fbbec0693e0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c0ac440 tx=0x7fbbfc009040 comp rx=0 tx=0).stop 2023-10-06T11:09:24.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.584+0000 7fbc108ae700 1 -- 172.21.15.146:0/4274251824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc0c159a90 msgr2=0x7fbc0c0ab0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:24.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.584+0000 7fbc108ae700 1 --2- 172.21.15.146:0/4274251824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc0c159a90 0x7fbc0c0ab0a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fbc04009880 tx=0x7fbc04018000 comp rx=0 tx=0).stop 2023-10-06T11:09:24.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.584+0000 7fbc108ae700 1 -- 172.21.15.146:0/4274251824 shutdown_connections 2023-10-06T11:09:24.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.584+0000 7fbc108ae700 1 --2- 172.21.15.146:0/4274251824 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbbec066f30 0x7fbbec0693e0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.584+0000 7fbc108ae700 1 --2- 172.21.15.146:0/4274251824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc0c159a90 0x7fbc0c0ab0a0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.584+0000 7fbc108ae700 1 --2- 172.21.15.146:0/4274251824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc0c0aecd0 0x7fbc0c144680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.584+0000 7fbc108ae700 1 --2- 172.21.15.146:0/4274251824 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc0c0cdde0 0x7fbc0c0aab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.584+0000 7fbc108ae700 1 -- 172.21.15.146:0/4274251824 >> 172.21.15.146:0/4274251824 conn(0x7fbc0c068580 msgr2=0x7fbc0c0ad960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:24.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.584+0000 7fbc108ae700 1 -- 172.21.15.146:0/4274251824 shutdown_connections 2023-10-06T11:09:24.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.584+0000 7fbc108ae700 1 -- 172.21.15.146:0/4274251824 wait complete. 2023-10-06T11:09:24.597 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:09:24.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.710+0000 7f84cfbe3700 1 Processor -- start 2023-10-06T11:09:24.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.710+0000 7f84cfbe3700 1 -- start start 2023-10-06T11:09:24.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.711+0000 7f84cfbe3700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f84c8068ba0 0x7f84c815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:24.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.711+0000 7f84cfbe3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84c815ac30 con 0x7f84c8153e80 2023-10-06T11:09:24.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.711+0000 7f84cfbe3700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84c80b4510 con 0x7f84c8153ab0 2023-10-06T11:09:24.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.711+0000 7f84cfbe3700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84c80b6530 con 0x7f84c8068ba0 2023-10-06T11:09:24.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.711+0000 7f84ce180700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f84c8153e80 0x7f84c80b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36580/0 (socket says 172.21.15.146:36580) 2023-10-06T11:09:24.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.711+0000 7f84ce180700 1 -- 172.21.15.146:0/2843197334 learned_addr learned my addr 172.21.15.146:0/2843197334 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:24.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.711+0000 7f84cd17e700 1 --2- 172.21.15.146:0/2843197334 >> v2:172.21.15.151:3300/0 conn(0x7f84c8068ba0 0x7f84c815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:24.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.712+0000 7f84cc97d700 1 -- 172.21.15.146:0/2843197334 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1685333096 0 0) 0x7f84c0001490 con 0x7f84c8153e80 2023-10-06T11:09:24.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.712+0000 7f84cc97d700 1 -- 172.21.15.146:0/2843197334 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84b4003570 con 0x7f84c8153e80 2023-10-06T11:09:24.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.712+0000 7f84cc97d700 1 -- 172.21.15.146:0/2843197334 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2607398153 0 0) 0x7f84c80b4510 con 0x7f84c8153ab0 2023-10-06T11:09:24.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.712+0000 7f84cc97d700 1 -- 172.21.15.146:0/2843197334 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84c0001490 con 0x7f84c8153ab0 2023-10-06T11:09:24.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.712+0000 7f84cd17e700 1 -- 172.21.15.146:0/2843197334 >> v1:172.21.15.151:6789/0 conn(0x7f84c8153ab0 legacy=0x7f84c8068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:24.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.712+0000 7f84cd17e700 1 -- 172.21.15.146:0/2843197334 >> v1:172.21.15.146:6789/0 conn(0x7f84c8153e80 legacy=0x7f84c80b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:24.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.712+0000 7f84cc97d700 1 -- 172.21.15.146:0/2843197334 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2314992973 0 0) 0x7f84b4003570 con 0x7f84c8153e80 2023-10-06T11:09:24.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.712+0000 7f84cd17e700 1 -- 172.21.15.146:0/2843197334 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c80b5c50 con 0x7f84c8068ba0 2023-10-06T11:09:24.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.712+0000 7f84cd17e700 1 --2- 172.21.15.146:0/2843197334 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84c8068ba0 0x7f84c815a6f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f84b80098e0 tx=0x7f84b80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9871c7b84a198cbf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:24.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.712+0000 7f84cc97d700 1 -- 172.21.15.146:0/2843197334 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c0001980 con 0x7f84c8068ba0 2023-10-06T11:09:24.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.712+0000 7f84cc97d700 1 -- 172.21.15.146:0/2843197334 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b8011420 con 0x7f84c8068ba0 2023-10-06T11:09:24.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.712+0000 7f84cc97d700 1 -- 172.21.15.146:0/2843197334 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b80117c0 con 0x7f84c8068ba0 2023-10-06T11:09:24.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.713+0000 7f84cfbe3700 1 -- 172.21.15.146:0/2843197334 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84c8068ba0 msgr2=0x7f84c815a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:24.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.713+0000 7f84cfbe3700 1 --2- 172.21.15.146:0/2843197334 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84c8068ba0 0x7f84c815a6f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f84b80098e0 tx=0x7f84b80091a0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.713+0000 7f84cfbe3700 1 -- 172.21.15.146:0/2843197334 shutdown_connections 2023-10-06T11:09:24.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.713+0000 7f84cfbe3700 1 --2- 172.21.15.146:0/2843197334 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84c8068ba0 0x7f84c815a6f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.713+0000 7f84cfbe3700 1 -- 172.21.15.146:0/2843197334 >> 172.21.15.146:0/2843197334 conn(0x7f84c806eba0 msgr2=0x7f84c806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:24.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.713+0000 7f84cfbe3700 1 -- 172.21.15.146:0/2843197334 shutdown_connections 2023-10-06T11:09:24.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.713+0000 7f84cfbe3700 1 -- 172.21.15.146:0/2843197334 wait complete. 2023-10-06T11:09:24.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.714+0000 7f84cfbe3700 1 Processor -- start 2023-10-06T11:09:24.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.714+0000 7f84cfbe3700 1 -- start start 2023-10-06T11:09:24.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.714+0000 7f84cfbe3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84c8068ba0 0x7f84c8154e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:24.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.714+0000 7f84cfbe3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84c8153ab0 0x7f84c80cbc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:24.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.715+0000 7f84cfbe3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84c8153e80 0x7f84c8154490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:24.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.715+0000 7f84cfbe3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c8156d70 con 0x7f84c8153ab0 2023-10-06T11:09:24.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.715+0000 7f84cfbe3700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c80cc160 con 0x7f84c8068ba0 2023-10-06T11:09:24.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.715+0000 7f84cfbe3700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84c8156fe0 con 0x7f84c8153e80 2023-10-06T11:09:24.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.715+0000 7f84cd17e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84c8153ab0 0x7f84c80cbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:24.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.715+0000 7f84cd17e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84c8153ab0 0x7f84c80cbc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41378/0 (socket says 172.21.15.146:41378) 2023-10-06T11:09:24.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.715+0000 7f84cd17e700 1 -- 172.21.15.146:0/3288751694 learned_addr learned my addr 172.21.15.146:0/3288751694 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:24.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.715+0000 7f84cd97f700 1 --2- 172.21.15.146:0/3288751694 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84c8068ba0 0x7f84c8154e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:24.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.715+0000 7f84cd17e700 1 -- 172.21.15.146:0/3288751694 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84c8153e80 msgr2=0x7f84c8154490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:24.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.715+0000 7f84cd17e700 1 --2- 172.21.15.146:0/3288751694 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84c8153e80 0x7f84c8154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.715+0000 7f84cd17e700 1 -- 172.21.15.146:0/3288751694 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84c8068ba0 msgr2=0x7f84c8154e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:24.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.715+0000 7f84cd17e700 1 --2- 172.21.15.146:0/3288751694 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84c8068ba0 0x7f84c8154e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.715+0000 7f84cd17e700 1 -- 172.21.15.146:0/3288751694 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b8009420 con 0x7f84c8153ab0 2023-10-06T11:09:24.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.715+0000 7f84cd17e700 1 --2- 172.21.15.146:0/3288751694 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84c8153ab0 0x7f84c80cbc20 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f84b8002000 tx=0x7f84b8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:24.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.715+0000 7f84bdffb700 1 -- 172.21.15.146:0/3288751694 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b801cc90 con 0x7f84c8153ab0 2023-10-06T11:09:24.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.715+0000 7f84bdffb700 1 -- 172.21.15.146:0/3288751694 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b801cdf0 con 0x7f84c8153ab0 2023-10-06T11:09:24.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.715+0000 7f84cfbe3700 1 -- 172.21.15.146:0/3288751694 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84c81572c0 con 0x7f84c8153ab0 2023-10-06T11:09:24.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.715+0000 7f84bdffb700 1 -- 172.21.15.146:0/3288751694 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b801a6a0 con 0x7f84c8153ab0 2023-10-06T11:09:24.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.715+0000 7f84cfbe3700 1 -- 172.21.15.146:0/3288751694 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84c8157880 con 0x7f84c8153ab0 2023-10-06T11:09:24.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.716+0000 7f84cfbe3700 1 -- 172.21.15.146:0/3288751694 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84c815add0 con 0x7f84c8153ab0 2023-10-06T11:09:24.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.717+0000 7f84bdffb700 1 -- 172.21.15.146:0/3288751694 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f84b801aa50 con 0x7f84c8153ab0 2023-10-06T11:09:24.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.717+0000 7f84bdffb700 1 --2- 172.21.15.146:0/3288751694 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f84ac066f30 0x7f84ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:24.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.717+0000 7f84bdffb700 1 -- 172.21.15.146:0/3288751694 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f84b8085c00 con 0x7f84c8153ab0 2023-10-06T11:09:24.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.717+0000 7f84cd97f700 1 --2- 172.21.15.146:0/3288751694 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f84ac066f30 0x7f84ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:24.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.718+0000 7f84cd97f700 1 --2- 172.21.15.146:0/3288751694 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f84ac066f30 0x7f84ac0693e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f84c40027d0 tx=0x7f84c4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:24.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.722+0000 7f84bdffb700 1 -- 172.21.15.146:0/3288751694 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f84c815add0 con 0x7f84c8153ab0 2023-10-06T11:09:24.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.947+0000 7f84cfbe3700 1 -- 172.21.15.146:0/3288751694 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f84c815add0 con 0x7f84c8153ab0 2023-10-06T11:09:24.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.948+0000 7f84bdffb700 1 -- 172.21.15.146:0/3288751694 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4610 (secure 0 0 0) 0x7f84c815add0 con 0x7f84c8153ab0 2023-10-06T11:09:24.950 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:09:24.950 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":39,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5248,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3360977916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3360977916},{"type":"v1","addr":"172.21.15.151:6834","nonce":3360977916}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5251,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2265934004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":2265934004},{"type":"v1","addr":"172.21.15.151:6835","nonce":2265934004}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2387575667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2387575667},{"type":"v1","addr":"172.21.15.146:6836","nonce":2387575667}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:08:42.797557+0000","modified":"2023-10-06T11:09:23.554479+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5481":{"gid":5481,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":13,"addr":"172.21.15.146:6837/2252184844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2252184844},{"type":"v1","addr":"172.21.15.146:6837","nonce":2252184844}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T11:09:24.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.950+0000 7f84cfbe3700 1 -- 172.21.15.146:0/3288751694 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f84ac066f30 msgr2=0x7f84ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:24.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.950+0000 7f84cfbe3700 1 --2- 172.21.15.146:0/3288751694 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f84ac066f30 0x7f84ac0693e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f84c40027d0 tx=0x7f84c4009040 comp rx=0 tx=0).stop 2023-10-06T11:09:24.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.950+0000 7f84cfbe3700 1 -- 172.21.15.146:0/3288751694 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84c8153ab0 msgr2=0x7f84c80cbc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:24.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.950+0000 7f84cfbe3700 1 --2- 172.21.15.146:0/3288751694 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84c8153ab0 0x7f84c80cbc20 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f84b8002000 tx=0x7f84b8016000 comp rx=0 tx=0).stop 2023-10-06T11:09:24.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.950+0000 7f84cfbe3700 1 -- 172.21.15.146:0/3288751694 shutdown_connections 2023-10-06T11:09:24.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.950+0000 7f84cfbe3700 1 --2- 172.21.15.146:0/3288751694 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f84ac066f30 0x7f84ac0693e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.950+0000 7f84cfbe3700 1 --2- 172.21.15.146:0/3288751694 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84c8153e80 0x7f84c8154490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.950+0000 7f84cfbe3700 1 --2- 172.21.15.146:0/3288751694 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84c8068ba0 0x7f84c8154e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.950+0000 7f84cfbe3700 1 --2- 172.21.15.146:0/3288751694 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84c8153ab0 0x7f84c80cbc20 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:24.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.950+0000 7f84cfbe3700 1 -- 172.21.15.146:0/3288751694 >> 172.21.15.146:0/3288751694 conn(0x7f84c806eba0 msgr2=0x7f84c815d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:24.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.950+0000 7f84cfbe3700 1 -- 172.21.15.146:0/3288751694 shutdown_connections 2023-10-06T11:09:24.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:24.950+0000 7f84cfbe3700 1 -- 172.21.15.146:0/3288751694 wait complete. 2023-10-06T11:09:24.953 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 39 2023-10-06T11:09:24.964 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c damage rm 1055442507 2023-10-06T11:09:25.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.078+0000 7fc8c1232700 1 Processor -- start 2023-10-06T11:09:25.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.078+0000 7fc8c1232700 1 -- start start 2023-10-06T11:09:25.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.079+0000 7fc8c1232700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc8bc0ae730 0x7fc8bc0aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:25.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.079+0000 7fc8c1232700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc8bc0cb950 0x7fc8bc0cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:25.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.079+0000 7fc8c1232700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8bc0ae2a0 con 0x7fc8bc15a160 2023-10-06T11:09:25.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.079+0000 7fc8c1232700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8bc15a530 con 0x7fc8bc0ae730 2023-10-06T11:09:25.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.079+0000 7fc8c1232700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8bc0c5cb0 con 0x7fc8bc0cb950 2023-10-06T11:09:25.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.079+0000 7fc8b259c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc8bc0ae730 0x7fc8bc0aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:25.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.079+0000 7fc8b259c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc8bc0ae730 0x7fc8bc0aebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41390/0 (socket says 172.21.15.146:41390) 2023-10-06T11:09:25.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.079+0000 7fc8b259c700 1 -- 172.21.15.146:0/2777063133 learned_addr learned my addr 172.21.15.146:0/2777063133 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:25.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.079+0000 7fc8bb59e700 1 --2- 172.21.15.146:0/2777063133 >> v2:172.21.15.151:3300/0 conn(0x7fc8bc0cb950 0x7fc8bc0cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:25.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.079+0000 7fc8b259c700 1 -- 172.21.15.146:0/2777063133 >> v2:172.21.15.151:3300/0 conn(0x7fc8bc0cb950 msgr2=0x7fc8bc0cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:25.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.079+0000 7fc8b259c700 1 --2- 172.21.15.146:0/2777063133 >> v2:172.21.15.151:3300/0 conn(0x7fc8bc0cb950 0x7fc8bc0cbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:25.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.079+0000 7fc8b259c700 1 -- 172.21.15.146:0/2777063133 >> v1:172.21.15.151:6789/0 conn(0x7fc8bc15a160 legacy=0x7fc8bc0c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:25.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.079+0000 7fc8b259c700 1 -- 172.21.15.146:0/2777063133 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8bc0af0f0 con 0x7fc8bc0ae730 2023-10-06T11:09:25.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.080+0000 7fc8b259c700 1 --2- 172.21.15.146:0/2777063133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8bc0ae730 0x7fc8bc0aebb0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc08b000 tx=0x7fc8a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2b46de0dc655f12 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:25.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.080+0000 7fc8ba59c700 1 -- 172.21.15.146:0/2777063133 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a400b860 con 0x7fc8bc0ae730 2023-10-06T11:09:25.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.080+0000 7fc8ba59c700 1 -- 172.21.15.146:0/2777063133 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a400b9c0 con 0x7fc8bc0ae730 2023-10-06T11:09:25.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.080+0000 7fc8ba59c700 1 -- 172.21.15.146:0/2777063133 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a400bd60 con 0x7fc8bc0ae730 2023-10-06T11:09:25.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.080+0000 7fc8c1232700 1 -- 172.21.15.146:0/2777063133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8bc0ae730 msgr2=0x7fc8bc0aebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:25.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.080+0000 7fc8c1232700 1 --2- 172.21.15.146:0/2777063133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8bc0ae730 0x7fc8bc0aebb0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc08b000 tx=0x7fc8a4009250 comp rx=0 tx=0).stop 2023-10-06T11:09:25.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.080+0000 7fc8c1232700 1 -- 172.21.15.146:0/2777063133 shutdown_connections 2023-10-06T11:09:25.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.080+0000 7fc8c1232700 1 --2- 172.21.15.146:0/2777063133 >> v2:172.21.15.151:3300/0 conn(0x7fc8bc0cb950 0x7fc8bc0cbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:25.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.080+0000 7fc8c1232700 1 --2- 172.21.15.146:0/2777063133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8bc0ae730 0x7fc8bc0aebb0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:25.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.080+0000 7fc8c1232700 1 -- 172.21.15.146:0/2777063133 >> 172.21.15.146:0/2777063133 conn(0x7fc8bc06f380 msgr2=0x7fc8bc0d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:25.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.080+0000 7fc8c1232700 1 -- 172.21.15.146:0/2777063133 shutdown_connections 2023-10-06T11:09:25.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.080+0000 7fc8c1232700 1 -- 172.21.15.146:0/2777063133 wait complete. 2023-10-06T11:09:25.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.081+0000 7fc8c1232700 1 Processor -- start 2023-10-06T11:09:25.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.082+0000 7fc8c1232700 1 -- start start 2023-10-06T11:09:25.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.082+0000 7fc8c1232700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8bc0ae730 0x7fc8bc0af680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:25.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.082+0000 7fc8c1232700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8bc0cb950 0x7fc8bc0b5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:25.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.082+0000 7fc8c1232700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8bc15a160 0x7fc8bc0cd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:25.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.082+0000 7fc8c1232700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc0b35a0 con 0x7fc8bc0ae730 2023-10-06T11:09:25.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.082+0000 7fc8c1232700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc0aff80 con 0x7fc8bc0cb950 2023-10-06T11:09:25.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.082+0000 7fc8c1232700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc0b0260 con 0x7fc8bc15a160 2023-10-06T11:09:25.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.082+0000 7fc8bad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8bc0ae730 0x7fc8bc0af680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:25.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.082+0000 7fc8bad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8bc0ae730 0x7fc8bc0af680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41406/0 (socket says 172.21.15.146:41406) 2023-10-06T11:09:25.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.082+0000 7fc8bad9d700 1 -- 172.21.15.146:0/69435836 learned_addr learned my addr 172.21.15.146:0/69435836 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:25.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.082+0000 7fc8bb59e700 1 --2- 172.21.15.146:0/69435836 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8bc15a160 0x7fc8bc0cd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:25.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.082+0000 7fc8b259c700 1 --2- 172.21.15.146:0/69435836 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8bc0cb950 0x7fc8bc0b5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:25.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.083+0000 7fc8bad9d700 1 -- 172.21.15.146:0/69435836 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8bc15a160 msgr2=0x7fc8bc0cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:25.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.083+0000 7fc8bad9d700 1 --2- 172.21.15.146:0/69435836 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8bc15a160 0x7fc8bc0cd260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:25.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.083+0000 7fc8bad9d700 1 -- 172.21.15.146:0/69435836 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8bc0cb950 msgr2=0x7fc8bc0b5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:25.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.083+0000 7fc8bad9d700 1 --2- 172.21.15.146:0/69435836 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8bc0cb950 0x7fc8bc0b5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:25.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.083+0000 7fc8bad9d700 1 -- 172.21.15.146:0/69435836 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a40094f0 con 0x7fc8bc0ae730 2023-10-06T11:09:25.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.083+0000 7fc8bad9d700 1 --2- 172.21.15.146:0/69435836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8bc0ae730 0x7fc8bc0af680 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac00c540 tx=0x7fc8ac001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:25.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.083+0000 7fc8b37fe700 1 -- 172.21.15.146:0/69435836 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac011590 con 0x7fc8bc0ae730 2023-10-06T11:09:25.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.083+0000 7fc8b37fe700 1 -- 172.21.15.146:0/69435836 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8ac0116f0 con 0x7fc8bc0ae730 2023-10-06T11:09:25.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.083+0000 7fc8b37fe700 1 -- 172.21.15.146:0/69435836 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac011ab0 con 0x7fc8bc0ae730 2023-10-06T11:09:25.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.083+0000 7fc8c1232700 1 -- 172.21.15.146:0/69435836 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8bc0b0540 con 0x7fc8bc0ae730 2023-10-06T11:09:25.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.083+0000 7fc8c1232700 1 -- 172.21.15.146:0/69435836 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8bc154c40 con 0x7fc8bc0ae730 2023-10-06T11:09:25.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.084+0000 7fc8b37fe700 1 -- 172.21.15.146:0/69435836 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc8ac01b3b0 con 0x7fc8bc0ae730 2023-10-06T11:09:25.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.085+0000 7fc8b37fe700 1 --2- 172.21.15.146:0/69435836 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc89c066f30 0x7fc89c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:25.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.085+0000 7fc8b37fe700 1 -- 172.21.15.146:0/69435836 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc8ac083980 con 0x7fc8bc0ae730 2023-10-06T11:09:25.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.085+0000 7fc8b259c700 1 --2- 172.21.15.146:0/69435836 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc89c066f30 0x7fc89c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:25.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.085+0000 7fc8b259c700 1 --2- 172.21.15.146:0/69435836 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc89c066f30 0x7fc89c0693e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc08b000 tx=0x7fc8a4017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:25.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.087+0000 7fc8ca52ab80 1 Processor -- start 2023-10-06T11:09:25.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.087+0000 7fc8ca52ab80 1 -- start start 2023-10-06T11:09:25.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.088+0000 7fc8ca52ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604e4e64b10 0x5604e4e64ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:25.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.088+0000 7fc8ca52ab80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604e4e20a20 0x5604e4e1d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:25.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.088+0000 7fc8ca52ab80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604e4e1ec50 0x5604e4e1db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:25.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.088+0000 7fc8ca52ab80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604e4d9dd00 con 0x5604e4e1ec50 2023-10-06T11:09:25.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.088+0000 7fc8ca52ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604e4d74af0 con 0x5604e4e64b10 2023-10-06T11:09:25.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.088+0000 7fc8ca52ab80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5604e4d722f0 con 0x5604e4e20a20 2023-10-06T11:09:25.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.088+0000 7fc8bb59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604e4e1ec50 0x5604e4e1db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:25.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.088+0000 7fc8bb59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604e4e1ec50 0x5604e4e1db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41410/0 (socket says 172.21.15.146:41410) 2023-10-06T11:09:25.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.088+0000 7fc8bb59e700 1 -- 172.21.15.146:0/1564402089 learned_addr learned my addr 172.21.15.146:0/1564402089 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:25.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.088+0000 7fc8b259c700 1 --2- 172.21.15.146:0/1564402089 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604e4e20a20 0x5604e4e1d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:25.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.088+0000 7fc8bad9d700 1 --2- 172.21.15.146:0/1564402089 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604e4e64b10 0x5604e4e64ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:25.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.088+0000 7fc8bb59e700 1 -- 172.21.15.146:0/1564402089 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604e4e20a20 msgr2=0x5604e4e1d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:25.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.088+0000 7fc8bb59e700 1 --2- 172.21.15.146:0/1564402089 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604e4e20a20 0x5604e4e1d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:25.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.088+0000 7fc8bb59e700 1 -- 172.21.15.146:0/1564402089 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604e4e64b10 msgr2=0x5604e4e64ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:25.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.088+0000 7fc8bb59e700 1 --2- 172.21.15.146:0/1564402089 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604e4e64b10 0x5604e4e64ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:25.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.088+0000 7fc8bb59e700 1 -- 172.21.15.146:0/1564402089 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604e4c082f0 con 0x5604e4e1ec50 2023-10-06T11:09:25.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.088+0000 7fc8bb59e700 1 --2- 172.21.15.146:0/1564402089 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604e4e1ec50 0x5604e4e1db40 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4007370 tx=0x7fc8b4009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e6601083c056fdb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:25.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.088+0000 7fc89bfff700 1 -- 172.21.15.146:0/1564402089 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b4015420 con 0x5604e4e1ec50 2023-10-06T11:09:25.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.088+0000 7fc89bfff700 1 -- 172.21.15.146:0/1564402089 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b4015580 con 0x5604e4e1ec50 2023-10-06T11:09:25.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.088+0000 7fc89bfff700 1 -- 172.21.15.146:0/1564402089 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b4015940 con 0x5604e4e1ec50 2023-10-06T11:09:25.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.089+0000 7fc8ca52ab80 1 -- 172.21.15.146:0/1564402089 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604e4e1ec50 msgr2=0x5604e4e1db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:25.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.089+0000 7fc8ca52ab80 1 --2- 172.21.15.146:0/1564402089 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604e4e1ec50 0x5604e4e1db40 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4007370 tx=0x7fc8b4009850 comp rx=0 tx=0).stop 2023-10-06T11:09:25.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.089+0000 7fc8ca52ab80 1 -- 172.21.15.146:0/1564402089 shutdown_connections 2023-10-06T11:09:25.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.089+0000 7fc8ca52ab80 1 --2- 172.21.15.146:0/1564402089 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604e4e1ec50 0x5604e4e1db40 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:25.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.089+0000 7fc8ca52ab80 1 --2- 172.21.15.146:0/1564402089 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604e4e64b10 0x5604e4e64ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:25.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.089+0000 7fc8ca52ab80 1 --2- 172.21.15.146:0/1564402089 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604e4e20a20 0x5604e4e1d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:25.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.089+0000 7fc8ca52ab80 1 -- 172.21.15.146:0/1564402089 >> 172.21.15.146:0/1564402089 conn(0x5604e4e1f0f0 msgr2=0x5604e4e1f4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:25.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.089+0000 7fc8ca52ab80 1 -- 172.21.15.146:0/1564402089 shutdown_connections 2023-10-06T11:09:25.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.089+0000 7fc8ca52ab80 1 -- 172.21.15.146:0/1564402089 wait complete. 2023-10-06T11:09:25.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.090+0000 7fc8ca52ab80 1 -- start start 2023-10-06T11:09:25.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.090+0000 7fc8ca52ab80 1 Processor -- start 2023-10-06T11:09:25.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.091+0000 7fc8ca52ab80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604e4e1ec50 0x5604e4e445c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:25.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.091+0000 7fc8ca52ab80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604e4e20a20 0x5604e4e48ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:25.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.091+0000 7fc8ca52ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604e4e64b10 0x5604e4e4aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:25.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.091+0000 7fc8ca52ab80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604e4d6e0e0 con 0x5604e4e20a20 2023-10-06T11:09:25.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.091+0000 7fc8ca52ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604e4d19910 con 0x5604e4e64b10 2023-10-06T11:09:25.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.091+0000 7fc8ca52ab80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5604e4d34f20 con 0x5604e4e1ec50 2023-10-06T11:09:25.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.091+0000 7fc8ca52ab80 10 client.0 _ll_register_callbacks cb 0x5604e4c0afb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:09:25.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.091+0000 7fc8b259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604e4e20a20 0x5604e4e48ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:25.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.091+0000 7fc8b259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604e4e20a20 0x5604e4e48ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41422/0 (socket says 172.21.15.146:41422) 2023-10-06T11:09:25.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.091+0000 7fc8b259c700 1 -- 172.21.15.146:0/2651309266 learned_addr learned my addr 172.21.15.146:0/2651309266 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:25.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.091+0000 7fc8bad9d700 1 --2- 172.21.15.146:0/2651309266 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604e4e1ec50 0x5604e4e445c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:25.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.091+0000 7fc8bb59e700 1 --2- 172.21.15.146:0/2651309266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604e4e64b10 0x5604e4e4aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:25.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.091+0000 7fc8b259c700 1 -- 172.21.15.146:0/2651309266 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604e4e1ec50 msgr2=0x5604e4e445c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:25.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.091+0000 7fc8b259c700 1 --2- 172.21.15.146:0/2651309266 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604e4e1ec50 0x5604e4e445c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:25.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.091+0000 7fc8b259c700 1 -- 172.21.15.146:0/2651309266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604e4e64b10 msgr2=0x5604e4e4aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:25.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.091+0000 7fc8b259c700 1 --2- 172.21.15.146:0/2651309266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604e4e64b10 0x5604e4e4aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:25.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.091+0000 7fc8b259c700 1 -- 172.21.15.146:0/2651309266 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8b4011040 con 0x5604e4e20a20 2023-10-06T11:09:25.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.091+0000 7fc8bb59e700 1 --2- 172.21.15.146:0/2651309266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604e4e64b10 0x5604e4e4aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:25.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.091+0000 7fc8b259c700 1 --2- 172.21.15.146:0/2651309266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604e4e20a20 0x5604e4e48ae0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fc8a400b3c0 tx=0x7fc8a4021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a2b38256e3b30e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:25.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.091+0000 7fc8997fa700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:09:25.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.092+0000 7fc8997fa700 1 -- 172.21.15.146:0/2651309266 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a4030070 con 0x5604e4e20a20 2023-10-06T11:09:25.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.092+0000 7fc8997fa700 1 -- 172.21.15.146:0/2651309266 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc8a4027650 con 0x5604e4e20a20 2023-10-06T11:09:25.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.092+0000 7fc8ca52ab80 1 -- 172.21.15.146:0/2651309266 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5604e4e12710 con 0x5604e4e20a20 2023-10-06T11:09:25.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.092+0000 7fc8997fa700 1 -- 172.21.15.146:0/2651309266 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8a4021070 con 0x5604e4e20a20 2023-10-06T11:09:25.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.092+0000 7fc8ca52ab80 10 client.6120 fetch_fsmap learned FSMap version 39 2023-10-06T11:09:25.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.092+0000 7fc8ca52ab80 1 -- 172.21.15.146:0/2651309266 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x5604e4bab060 con 0x5604e4e20a20 2023-10-06T11:09:25.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.092+0000 7fc8997fa700 1 -- 172.21.15.146:0/2651309266 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5604e4e12710 con 0x5604e4e20a20 2023-10-06T11:09:25.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.092+0000 7fc8997fa700 1 -- 172.21.15.146:0/2651309266 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 39) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc8a4027a20 con 0x5604e4e20a20 2023-10-06T11:09:25.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.092+0000 7fc8ca52ab80 10 client.6120 fetch_fsmap finished waiting for FSMap version 39 2023-10-06T11:09:25.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.092+0000 7fc8ca52ab80 10 client.6120 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T11:09:25.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.092+0000 7fc8ca52ab80 20 client.6120 populate_metadata read hostname 'smithi146' 2023-10-06T11:09:25.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.092+0000 7fc8ca52ab80 1 --2- 172.21.15.146:0/2651309266 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x5604e4e67ed0 0x5604e4e682a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:25.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.092+0000 7fc8ca52ab80 4 client.6120 mds_command: new command op to 5481 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:09:25.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.092+0000 7fc8ca52ab80 1 -- 172.21.15.146:0/2651309266 --> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5604e4def640 con 0x5604e4e67ed0 2023-10-06T11:09:25.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.092+0000 7fc8bad9d700 1 --2- 172.21.15.146:0/2651309266 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x5604e4e67ed0 0x5604e4e682a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:25.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.092+0000 7fc8997fa700 10 client.6120 ms_handle_connect on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:25.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.093+0000 7fc8bad9d700 1 --2- 172.21.15.146:0/2651309266 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x5604e4e67ed0 0x5604e4e682a0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56e5ee464766539d server_cookie=c1a1b54bb887616e in_seq=0 out_seq=0 2023-10-06T11:09:25.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.093+0000 7fc8997fa700 1 -- 172.21.15.146:0/2651309266 <== mds.0 v2:172.21.15.146:6835/2252184844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5604e4def640 con 0x5604e4e67ed0 2023-10-06T11:09:25.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.093+0000 7fc8997fa700 10 client.6120 handle_command_reply: tid=0 2023-10-06T11:09:25.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.093+0000 7fc8ca52ab80 1 client.6120 shutdown 2023-10-06T11:09:25.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.093+0000 7fc8ca52ab80 1 -- 172.21.15.146:0/2651309266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604e4e20a20 msgr2=0x5604e4e48ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:25.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.093+0000 7fc8ca52ab80 1 --2- 172.21.15.146:0/2651309266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604e4e20a20 0x5604e4e48ae0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fc8a400b3c0 tx=0x7fc8a4021000 comp rx=0 tx=0).stop 2023-10-06T11:09:25.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.093+0000 7fc8ca52ab80 1 -- 172.21.15.146:0/2651309266 shutdown_connections 2023-10-06T11:09:25.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.093+0000 7fc8ca52ab80 1 --2- 172.21.15.146:0/2651309266 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x5604e4e67ed0 0x5604e4e682a0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:25.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.093+0000 7fc8ca52ab80 1 --2- 172.21.15.146:0/2651309266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604e4e64b10 0x5604e4e4aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:25.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.093+0000 7fc8ca52ab80 1 --2- 172.21.15.146:0/2651309266 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604e4e1ec50 0x5604e4e445c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:25.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.093+0000 7fc8997fa700 0 client.6120 ms_handle_reset on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:25.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.093+0000 7fc8ca52ab80 1 --2- 172.21.15.146:0/2651309266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604e4e20a20 0x5604e4e48ae0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:25.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.093+0000 7fc8ca52ab80 1 -- 172.21.15.146:0/2651309266 >> 172.21.15.146:0/2651309266 conn(0x5604e4e1f0f0 msgr2=0x5604e4e1a740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:25.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.093+0000 7fc8ca52ab80 1 -- 172.21.15.146:0/2651309266 shutdown_connections 2023-10-06T11:09:25.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.093+0000 7fc8ca52ab80 1 -- 172.21.15.146:0/2651309266 wait complete. 2023-10-06T11:09:25.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.093+0000 7fc8ca52ab80 20 client.6120 trim_cache size 0 max 16384 2023-10-06T11:09:25.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.106+0000 7fc8ca52ab80 1 Processor -- start 2023-10-06T11:09:25.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.106+0000 7fc8ca52ab80 1 -- start start 2023-10-06T11:09:25.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.106+0000 7fc8ca52ab80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604e4e1ec50 0x5604e4e4d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:25.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.106+0000 7fc8ca52ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604e4e20a20 0x5604e4e1acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:25.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.106+0000 7fc8ca52ab80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604e4e64b10 0x5604e4e7d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:25.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.107+0000 7fc8ca52ab80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604e4bf0eb0 con 0x5604e4e1ec50 2023-10-06T11:09:25.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.107+0000 7fc8ca52ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604e4e1ff20 con 0x5604e4e20a20 2023-10-06T11:09:25.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.107+0000 7fc8ca52ab80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5604e4e65080 con 0x5604e4e64b10 2023-10-06T11:09:25.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.107+0000 7fc8bad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604e4e1ec50 0x5604e4e4d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:25.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.107+0000 7fc8bad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604e4e1ec50 0x5604e4e4d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41438/0 (socket says 172.21.15.146:41438) 2023-10-06T11:09:25.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.107+0000 7fc8bad9d700 1 -- 172.21.15.146:0/3952502126 learned_addr learned my addr 172.21.15.146:0/3952502126 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:25.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.107+0000 7fc8bb59e700 1 --2- 172.21.15.146:0/3952502126 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604e4e64b10 0x5604e4e7d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:25.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.107+0000 7fc8b259c700 1 --2- 172.21.15.146:0/3952502126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604e4e20a20 0x5604e4e1acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:25.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.107+0000 7fc8bad9d700 1 -- 172.21.15.146:0/3952502126 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604e4e64b10 msgr2=0x5604e4e7d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:25.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.107+0000 7fc8bad9d700 1 --2- 172.21.15.146:0/3952502126 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604e4e64b10 0x5604e4e7d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:25.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.107+0000 7fc8bad9d700 1 -- 172.21.15.146:0/3952502126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604e4e20a20 msgr2=0x5604e4e1acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:25.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.107+0000 7fc8bad9d700 1 --2- 172.21.15.146:0/3952502126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604e4e20a20 0x5604e4e1acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:25.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.107+0000 7fc8bad9d700 1 -- 172.21.15.146:0/3952502126 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604e4d3c800 con 0x5604e4e1ec50 2023-10-06T11:09:25.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.107+0000 7fc8bb59e700 1 --2- 172.21.15.146:0/3952502126 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604e4e64b10 0x5604e4e7d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:09:25.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.107+0000 7fc8b259c700 1 --2- 172.21.15.146:0/3952502126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604e4e20a20 0x5604e4e1acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:09:25.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.107+0000 7fc8bad9d700 1 --2- 172.21.15.146:0/3952502126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604e4e1ec50 0x5604e4e4d890 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac00cb30 tx=0x7fc8ac057040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=745d91258453e50 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:25.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.107+0000 7fc8b0d99700 1 -- 172.21.15.146:0/3952502126 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac081e50 con 0x5604e4e1ec50 2023-10-06T11:09:25.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.107+0000 7fc8b0d99700 1 -- 172.21.15.146:0/3952502126 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8ac011e60 con 0x5604e4e1ec50 2023-10-06T11:09:25.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.107+0000 7fc8b0d99700 1 -- 172.21.15.146:0/3952502126 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac052ba0 con 0x5604e4e1ec50 2023-10-06T11:09:25.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.108+0000 7fc8ca52ab80 1 -- 172.21.15.146:0/3952502126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604e4e1ec50 msgr2=0x5604e4e4d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:25.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.108+0000 7fc8ca52ab80 1 --2- 172.21.15.146:0/3952502126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604e4e1ec50 0x5604e4e4d890 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac00cb30 tx=0x7fc8ac057040 comp rx=0 tx=0).stop 2023-10-06T11:09:25.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.108+0000 7fc8ca52ab80 1 -- 172.21.15.146:0/3952502126 shutdown_connections 2023-10-06T11:09:25.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.108+0000 7fc8ca52ab80 1 --2- 172.21.15.146:0/3952502126 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604e4e64b10 0x5604e4e7d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:25.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.108+0000 7fc8ca52ab80 1 --2- 172.21.15.146:0/3952502126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604e4e1ec50 0x5604e4e4d890 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:25.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.108+0000 7fc8ca52ab80 1 --2- 172.21.15.146:0/3952502126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604e4e20a20 0x5604e4e1acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:25.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.108+0000 7fc8ca52ab80 1 -- 172.21.15.146:0/3952502126 >> 172.21.15.146:0/3952502126 conn(0x5604e4e1f0f0 msgr2=0x5604e4e19dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:25.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.108+0000 7fc8ca52ab80 1 -- 172.21.15.146:0/3952502126 shutdown_connections 2023-10-06T11:09:25.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.108+0000 7fc8ca52ab80 1 -- 172.21.15.146:0/3952502126 wait complete. 2023-10-06T11:09:25.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.108+0000 7fc8ca52ab80 1 -- start start 2023-10-06T11:09:25.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.108+0000 7fc8ca52ab80 1 Processor -- start 2023-10-06T11:09:25.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.109+0000 7fc8ca52ab80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604e4e1ec50 0x5604e4e612a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:25.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.109+0000 7fc8ca52ab80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604e4e20a20 0x5604e4e5a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:25.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.109+0000 7fc8ca52ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604e4e64b10 0x5604e4e5a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:25.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.109+0000 7fc8ca52ab80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604e4eca510 con 0x5604e4e20a20 2023-10-06T11:09:25.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.109+0000 7fc8ca52ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604e4eca760 con 0x5604e4e64b10 2023-10-06T11:09:25.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.109+0000 7fc8ca52ab80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5604e4e1b3f0 con 0x5604e4e1ec50 2023-10-06T11:09:25.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.109+0000 7fc8ca52ab80 10 client.0 _ll_register_callbacks cb 0x5604e4c0afb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:09:25.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.109+0000 7fc8b259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604e4e20a20 0x5604e4e5a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:25.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.109+0000 7fc8b259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604e4e20a20 0x5604e4e5a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41454/0 (socket says 172.21.15.146:41454) 2023-10-06T11:09:25.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.109+0000 7fc8b259c700 1 -- 172.21.15.146:0/2798383070 learned_addr learned my addr 172.21.15.146:0/2798383070 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:25.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.109+0000 7fc8bad9d700 1 --2- 172.21.15.146:0/2798383070 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604e4e1ec50 0x5604e4e612a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:25.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.109+0000 7fc8bb59e700 1 --2- 172.21.15.146:0/2798383070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604e4e64b10 0x5604e4e5a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:25.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.110+0000 7fc8b259c700 1 -- 172.21.15.146:0/2798383070 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604e4e1ec50 msgr2=0x5604e4e612a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:25.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.110+0000 7fc8b259c700 1 --2- 172.21.15.146:0/2798383070 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604e4e1ec50 0x5604e4e612a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:25.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.110+0000 7fc8b259c700 1 -- 172.21.15.146:0/2798383070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604e4e64b10 msgr2=0x5604e4e5a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:25.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.110+0000 7fc8b259c700 1 --2- 172.21.15.146:0/2798383070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604e4e64b10 0x5604e4e5a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:25.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.110+0000 7fc8b259c700 1 -- 172.21.15.146:0/2798383070 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8ac083040 con 0x5604e4e20a20 2023-10-06T11:09:25.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.110+0000 7fc8bb59e700 1 --2- 172.21.15.146:0/2798383070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604e4e64b10 0x5604e4e5a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:25.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.110+0000 7fc8bad9d700 1 --2- 172.21.15.146:0/2798383070 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604e4e1ec50 0x5604e4e612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:25.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.110+0000 7fc8b259c700 1 --2- 172.21.15.146:0/2798383070 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604e4e20a20 0x5604e4e5a2e0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4007fe0 tx=0x7fc8a402c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b45ee5d8b321356 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:25.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.110+0000 7fc8997fa700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:09:25.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.110+0000 7fc8997fa700 1 -- 172.21.15.146:0/2798383070 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a4021070 con 0x5604e4e20a20 2023-10-06T11:09:25.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.110+0000 7fc8997fa700 1 -- 172.21.15.146:0/2798383070 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc8a4027650 con 0x5604e4e20a20 2023-10-06T11:09:25.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.110+0000 7fc8ca52ab80 1 -- 172.21.15.146:0/2798383070 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc8b4015580 con 0x5604e4e20a20 2023-10-06T11:09:25.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.110+0000 7fc8997fa700 1 -- 172.21.15.146:0/2798383070 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8a4030040 con 0x5604e4e20a20 2023-10-06T11:09:25.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.110+0000 7fc8ca52ab80 10 client.6126 fetch_fsmap learned FSMap version 39 2023-10-06T11:09:25.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.110+0000 7fc8ca52ab80 1 -- 172.21.15.146:0/2798383070 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) v3 -- 0x5604e4d234f0 con 0x5604e4e20a20 2023-10-06T11:09:25.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.110+0000 7fc8997fa700 1 -- 172.21.15.146:0/2798383070 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b4015580 con 0x5604e4e20a20 2023-10-06T11:09:25.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.110+0000 7fc8997fa700 1 -- 172.21.15.146:0/2798383070 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 39) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc8a4027a20 con 0x5604e4e20a20 2023-10-06T11:09:25.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.110+0000 7fc8ca52ab80 10 client.6126 fetch_fsmap finished waiting for FSMap version 39 2023-10-06T11:09:25.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.110+0000 7fc8ca52ab80 10 client.6126 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T11:09:25.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.110+0000 7fc8ca52ab80 20 client.6126 populate_metadata read hostname 'smithi146' 2023-10-06T11:09:25.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.110+0000 7fc8ca52ab80 1 --2- 172.21.15.146:0/2798383070 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x5604e4e63510 0x5604e4e638e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:25.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.110+0000 7fc8ca52ab80 4 client.6126 mds_command: new command op to 5481 tid=0[{"prefix": "damage rm", "damage_id": 1055442507}] 2023-10-06T11:09:25.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.110+0000 7fc8ca52ab80 1 -- 172.21.15.146:0/2798383070 --> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] -- command(tid 0: {"prefix": "damage rm", "damage_id": 1055442507}) v1 -- 0x5604e4d10e80 con 0x5604e4e63510 2023-10-06T11:09:25.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.110+0000 7fc8bad9d700 1 --2- 172.21.15.146:0/2798383070 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x5604e4e63510 0x5604e4e638e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:25.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.111+0000 7fc8997fa700 10 client.6126 ms_handle_connect on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:25.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.111+0000 7fc8bad9d700 1 --2- 172.21.15.146:0/2798383070 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x5604e4e63510 0x5604e4e638e0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39c5c1296502d10e server_cookie=a6bf69dfa684b156 in_seq=0 out_seq=0 2023-10-06T11:09:25.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.111+0000 7fc8997fa700 1 -- 172.21.15.146:0/2798383070 <== mds.0 v2:172.21.15.146:6835/2252184844 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+0 (crc 0 0 0) 0x5604e4d10e80 con 0x5604e4e63510 2023-10-06T11:09:25.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.111+0000 7fc8997fa700 10 client.6126 handle_command_reply: tid=0 2023-10-06T11:09:25.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.111+0000 7fc8ca52ab80 1 client.6126 shutdown 2023-10-06T11:09:25.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.111+0000 7fc8ca52ab80 1 -- 172.21.15.146:0/2798383070 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604e4e20a20 msgr2=0x5604e4e5a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:25.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.111+0000 7fc8ca52ab80 1 --2- 172.21.15.146:0/2798383070 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604e4e20a20 0x5604e4e5a2e0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4007fe0 tx=0x7fc8a402c070 comp rx=0 tx=0).stop 2023-10-06T11:09:25.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.111+0000 7fc8ca52ab80 1 -- 172.21.15.146:0/2798383070 shutdown_connections 2023-10-06T11:09:25.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.111+0000 7fc8ca52ab80 1 --2- 172.21.15.146:0/2798383070 >> [v2:172.21.15.146:6835/2252184844,v1:172.21.15.146:6837/2252184844] conn(0x5604e4e63510 0x5604e4e638e0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:25.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.111+0000 7fc8ca52ab80 1 --2- 172.21.15.146:0/2798383070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604e4e64b10 0x5604e4e5a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:25.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.111+0000 7fc8ca52ab80 1 --2- 172.21.15.146:0/2798383070 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604e4e1ec50 0x5604e4e612a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:25.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.111+0000 7fc8ca52ab80 1 --2- 172.21.15.146:0/2798383070 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604e4e20a20 0x5604e4e5a2e0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:25.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.111+0000 7fc8997fa700 0 client.6126 ms_handle_reset on v2:172.21.15.146:6835/2252184844 2023-10-06T11:09:25.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.111+0000 7fc8ca52ab80 1 -- 172.21.15.146:0/2798383070 >> 172.21.15.146:0/2798383070 conn(0x5604e4e1f0f0 msgr2=0x5604e4e684d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:25.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.111+0000 7fc8ca52ab80 1 -- 172.21.15.146:0/2798383070 shutdown_connections 2023-10-06T11:09:25.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.111+0000 7fc8ca52ab80 1 -- 172.21.15.146:0/2798383070 wait complete. 2023-10-06T11:09:25.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.111+0000 7fc8ca52ab80 20 client.6126 trim_cache size 0 max 16384 2023-10-06T11:09:25.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.112+0000 7fc8c1232700 1 -- 172.21.15.146:0/69435836 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc89c066f30 msgr2=0x7fc89c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:25.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.112+0000 7fc8c1232700 1 --2- 172.21.15.146:0/69435836 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc89c066f30 0x7fc89c0693e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc08b000 tx=0x7fc8a4017000 comp rx=0 tx=0).stop 2023-10-06T11:09:25.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.112+0000 7fc8c1232700 1 -- 172.21.15.146:0/69435836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8bc0ae730 msgr2=0x7fc8bc0af680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:25.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.112+0000 7fc8c1232700 1 --2- 172.21.15.146:0/69435836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8bc0ae730 0x7fc8bc0af680 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac00c540 tx=0x7fc8ac001070 comp rx=0 tx=0).stop 2023-10-06T11:09:25.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.112+0000 7fc8c1232700 1 -- 172.21.15.146:0/69435836 shutdown_connections 2023-10-06T11:09:25.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.112+0000 7fc8c1232700 1 --2- 172.21.15.146:0/69435836 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc89c066f30 0x7fc89c0693e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:25.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.112+0000 7fc8c1232700 1 --2- 172.21.15.146:0/69435836 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8bc15a160 0x7fc8bc0cd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:25.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.112+0000 7fc8c1232700 1 --2- 172.21.15.146:0/69435836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8bc0ae730 0x7fc8bc0af680 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:25.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.112+0000 7fc8c1232700 1 --2- 172.21.15.146:0/69435836 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8bc0cb950 0x7fc8bc0b5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:25.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.112+0000 7fc8c1232700 1 -- 172.21.15.146:0/69435836 >> 172.21.15.146:0/69435836 conn(0x7fc8bc06f380 msgr2=0x7fc8bc0c55a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:25.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.112+0000 7fc8c1232700 1 -- 172.21.15.146:0/69435836 shutdown_connections 2023-10-06T11:09:25.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.112+0000 7fc8c1232700 1 -- 172.21.15.146:0/69435836 wait complete. 2023-10-06T11:09:25.125 INFO:tasks.cephfs.test_scrub_checks:Running command 'flush_path /' 2023-10-06T11:09:25.125 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:09:25.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.238+0000 7f9c6bfff700 1 Processor -- start 2023-10-06T11:09:25.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.238+0000 7f9c6bfff700 1 -- start start 2023-10-06T11:09:25.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.239+0000 7f9c6bfff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c6c15a420 0x7f9c6c15cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:25.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.239+0000 7f9c6bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9c6c0b2530 0x7f9c6c15acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:25.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.239+0000 7f9c6bfff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c6c15c630 con 0x7f9c6c15a7f0 2023-10-06T11:09:25.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.239+0000 7f9c6bfff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c6c0ce040 con 0x7f9c6c0b2530 2023-10-06T11:09:25.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.239+0000 7f9c6bfff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c15ba20 con 0x7f9c6c15a420 2023-10-06T11:09:25.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.239+0000 7f9c6b7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9c6c0b2530 0x7f9c6c15acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:25.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.239+0000 7f9c6b7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9c6c0b2530 0x7f9c6c15acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41456/0 (socket says 172.21.15.146:41456) 2023-10-06T11:09:25.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.239+0000 7f9c627fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f9c6c15a7f0 0x7f9c6c0b1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36590/0 (socket says 172.21.15.146:36590) 2023-10-06T11:09:25.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.239+0000 7f9c6b7fe700 1 -- 172.21.15.146:0/3093049146 learned_addr learned my addr 172.21.15.146:0/3093049146 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:25.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.239+0000 7f9c6affd700 1 --2- 172.21.15.146:0/3093049146 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c6c15a420 0x7f9c6c15cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:25.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.239+0000 7f9c6b7fe700 1 -- 172.21.15.146:0/3093049146 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c6c15a420 msgr2=0x7f9c6c15cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:25.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.239+0000 7f9c6b7fe700 1 --2- 172.21.15.146:0/3093049146 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c6c15a420 0x7f9c6c15cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:25.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.239+0000 7f9c6b7fe700 1 -- 172.21.15.146:0/3093049146 >> v1:172.21.15.146:6789/0 conn(0x7f9c6c15a7f0 legacy=0x7f9c6c0b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:25.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.240+0000 7f9c6b7fe700 1 -- 172.21.15.146:0/3093049146 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c6c15bd00 con 0x7f9c6c0b2530 2023-10-06T11:09:25.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.240+0000 7f9c6b7fe700 1 --2- 172.21.15.146:0/3093049146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c6c0b2530 0x7f9c6c15acd0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f9c64009f20 tx=0x7f9c64009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=923842cd8e74d96e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:25.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.240+0000 7f9c6a7fc700 1 -- 172.21.15.146:0/3093049146 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6400e070 con 0x7f9c6c0b2530 2023-10-06T11:09:25.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.240+0000 7f9c6a7fc700 1 -- 172.21.15.146:0/3093049146 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c6400ba80 con 0x7f9c6c0b2530 2023-10-06T11:09:25.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.240+0000 7f9c6a7fc700 1 -- 172.21.15.146:0/3093049146 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c640092e0 con 0x7f9c6c0b2530 2023-10-06T11:09:25.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.240+0000 7f9c6bfff700 1 -- 172.21.15.146:0/3093049146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c6c0b2530 msgr2=0x7f9c6c15acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:25.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.240+0000 7f9c6bfff700 1 --2- 172.21.15.146:0/3093049146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c6c0b2530 0x7f9c6c15acd0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f9c64009f20 tx=0x7f9c64009840 comp rx=0 tx=0).stop 2023-10-06T11:09:25.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.240+0000 7f9c6bfff700 1 -- 172.21.15.146:0/3093049146 shutdown_connections 2023-10-06T11:09:25.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.240+0000 7f9c6bfff700 1 --2- 172.21.15.146:0/3093049146 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c6c0b2530 0x7f9c6c15acd0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:25.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.240+0000 7f9c6bfff700 1 --2- 172.21.15.146:0/3093049146 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c6c15a420 0x7f9c6c15cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:25.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.240+0000 7f9c6bfff700 1 -- 172.21.15.146:0/3093049146 >> 172.21.15.146:0/3093049146 conn(0x7f9c6c06eba0 msgr2=0x7f9c6c06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:25.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.240+0000 7f9c6bfff700 1 -- 172.21.15.146:0/3093049146 shutdown_connections 2023-10-06T11:09:25.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.240+0000 7f9c6bfff700 1 -- 172.21.15.146:0/3093049146 wait complete. 2023-10-06T11:09:25.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.242+0000 7f9c6bfff700 1 Processor -- start 2023-10-06T11:09:25.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.242+0000 7f9c6bfff700 1 -- start start 2023-10-06T11:09:25.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.242+0000 7f9c6bfff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c6c0b2530 0x7f9c6c146f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:25.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.242+0000 7f9c6bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c6c15a420 0x7f9c6c151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:25.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.242+0000 7f9c6bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c6c15a7f0 0x7f9c6c14ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:25.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.242+0000 7f9c6bfff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c14c590 con 0x7f9c6c15a7f0 2023-10-06T11:09:25.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.242+0000 7f9c6bfff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c14bc60 con 0x7f9c6c15a420 2023-10-06T11:09:25.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.242+0000 7f9c6bfff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c14bf40 con 0x7f9c6c0b2530 2023-10-06T11:09:25.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.242+0000 7f9c6b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c6c15a7f0 0x7f9c6c14ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:25.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.242+0000 7f9c6b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c6c15a7f0 0x7f9c6c14ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41470/0 (socket says 172.21.15.146:41470) 2023-10-06T11:09:25.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.242+0000 7f9c6b7fe700 1 -- 172.21.15.146:0/561752527 learned_addr learned my addr 172.21.15.146:0/561752527 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:25.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.243+0000 7f9c6affd700 1 --2- 172.21.15.146:0/561752527 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c6c0b2530 0x7f9c6c146f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:25.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.243+0000 7f9c627fc700 1 --2- 172.21.15.146:0/561752527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c6c15a420 0x7f9c6c151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:25.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.243+0000 7f9c6b7fe700 1 -- 172.21.15.146:0/561752527 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c6c0b2530 msgr2=0x7f9c6c146f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:25.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.243+0000 7f9c6b7fe700 1 --2- 172.21.15.146:0/561752527 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c6c0b2530 0x7f9c6c146f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:25.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.243+0000 7f9c6b7fe700 1 -- 172.21.15.146:0/561752527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c6c15a420 msgr2=0x7f9c6c151af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:25.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.243+0000 7f9c6b7fe700 1 --2- 172.21.15.146:0/561752527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c6c15a420 0x7f9c6c151af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:25.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.243+0000 7f9c6b7fe700 1 -- 172.21.15.146:0/561752527 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c64009ae0 con 0x7f9c6c15a7f0 2023-10-06T11:09:25.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.243+0000 7f9c627fc700 1 --2- 172.21.15.146:0/561752527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c6c15a420 0x7f9c6c151af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:25.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.243+0000 7f9c6b7fe700 1 --2- 172.21.15.146:0/561752527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c6c15a7f0 0x7f9c6c14ca20 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c088e40 tx=0x7f9c64018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:25.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.243+0000 7f9c637fe700 1 -- 172.21.15.146:0/561752527 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c640032f0 con 0x7f9c6c15a7f0 2023-10-06T11:09:25.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.243+0000 7f9c637fe700 1 -- 172.21.15.146:0/561752527 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c64008dd0 con 0x7f9c6c15a7f0 2023-10-06T11:09:25.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.243+0000 7f9c6bfff700 1 -- 172.21.15.146:0/561752527 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c6c14c220 con 0x7f9c6c15a7f0 2023-10-06T11:09:25.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.243+0000 7f9c637fe700 1 -- 172.21.15.146:0/561752527 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c64026690 con 0x7f9c6c15a7f0 2023-10-06T11:09:25.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.243+0000 7f9c6bfff700 1 -- 172.21.15.146:0/561752527 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c6c14b910 con 0x7f9c6c15a7f0 2023-10-06T11:09:25.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.244+0000 7f9c6bfff700 1 -- 172.21.15.146:0/561752527 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c6c0afae0 con 0x7f9c6c15a7f0 2023-10-06T11:09:25.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.244+0000 7f9c637fe700 1 -- 172.21.15.146:0/561752527 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9c64003040 con 0x7f9c6c15a7f0 2023-10-06T11:09:25.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.245+0000 7f9c637fe700 1 --2- 172.21.15.146:0/561752527 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9c4c066f30 0x7f9c4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:25.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.245+0000 7f9c637fe700 1 -- 172.21.15.146:0/561752527 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9c640865a0 con 0x7f9c6c15a7f0 2023-10-06T11:09:25.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.245+0000 7f9c6affd700 1 --2- 172.21.15.146:0/561752527 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9c4c066f30 0x7f9c4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:25.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.245+0000 7f9c6affd700 1 --2- 172.21.15.146:0/561752527 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9c4c066f30 0x7f9c4c0693e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c006fd0 tx=0x7f9c5c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:25.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.249+0000 7f9c637fe700 1 -- 172.21.15.146:0/561752527 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9c640536b0 con 0x7f9c6c15a7f0 2023-10-06T11:09:25.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.474+0000 7f9c6bfff700 1 -- 172.21.15.146:0/561752527 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9c6c14c6d0 con 0x7f9c6c15a7f0 2023-10-06T11:09:25.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.475+0000 7f9c637fe700 1 -- 172.21.15.146:0/561752527 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4610 (secure 0 0 0) 0x7f9c64056cd0 con 0x7f9c6c15a7f0 2023-10-06T11:09:25.477 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:09:25.477 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":39,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5248,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3360977916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3360977916},{"type":"v1","addr":"172.21.15.151:6834","nonce":3360977916}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5251,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2265934004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":2265934004},{"type":"v1","addr":"172.21.15.151:6835","nonce":2265934004}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2387575667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2387575667},{"type":"v1","addr":"172.21.15.146:6836","nonce":2387575667}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:08:42.797557+0000","modified":"2023-10-06T11:09:23.554479+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5481":{"gid":5481,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":13,"addr":"172.21.15.146:6837/2252184844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2252184844},{"type":"v1","addr":"172.21.15.146:6837","nonce":2252184844}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T11:09:25.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.477+0000 7f9c6bfff700 1 -- 172.21.15.146:0/561752527 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9c4c066f30 msgr2=0x7f9c4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:25.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.477+0000 7f9c6bfff700 1 --2- 172.21.15.146:0/561752527 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9c4c066f30 0x7f9c4c0693e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c006fd0 tx=0x7f9c5c008040 comp rx=0 tx=0).stop 2023-10-06T11:09:25.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.477+0000 7f9c6bfff700 1 -- 172.21.15.146:0/561752527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c6c15a7f0 msgr2=0x7f9c6c14ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:25.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.477+0000 7f9c6bfff700 1 --2- 172.21.15.146:0/561752527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c6c15a7f0 0x7f9c6c14ca20 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c088e40 tx=0x7f9c64018000 comp rx=0 tx=0).stop 2023-10-06T11:09:25.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.477+0000 7f9c6bfff700 1 -- 172.21.15.146:0/561752527 shutdown_connections 2023-10-06T11:09:25.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.477+0000 7f9c6bfff700 1 --2- 172.21.15.146:0/561752527 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9c4c066f30 0x7f9c4c0693e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:25.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.477+0000 7f9c6bfff700 1 --2- 172.21.15.146:0/561752527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9c6c15a7f0 0x7f9c6c14ca20 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:25.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.477+0000 7f9c6bfff700 1 --2- 172.21.15.146:0/561752527 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c6c0b2530 0x7f9c6c146f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:25.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.477+0000 7f9c6bfff700 1 --2- 172.21.15.146:0/561752527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c6c15a420 0x7f9c6c151af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:25.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.477+0000 7f9c6bfff700 1 -- 172.21.15.146:0/561752527 >> 172.21.15.146:0/561752527 conn(0x7f9c6c06eba0 msgr2=0x7f9c6c0d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:25.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.477+0000 7f9c6bfff700 1 -- 172.21.15.146:0/561752527 shutdown_connections 2023-10-06T11:09:25.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:25.477+0000 7f9c6bfff700 1 -- 172.21.15.146:0/561752527 wait complete. 2023-10-06T11:09:25.481 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 39 2023-10-06T11:09:25.491 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok flush_path / 2023-10-06T11:09:25.614 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:09:25.614 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0 2023-10-06T11:09:25.614 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:09:25.625 INFO:tasks.cephfs.test_scrub_checks:command 'flush_path /' got response code '0' and stdout '{ "return_code": 0 } ' 2023-10-06T11:09:25.626 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T11:09:25.626 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:09:25.667 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:09:25.710 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T11:09:25.710 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi146.front.sepia.ceph.com... 2023-10-06T11:09:25.710 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T11:09:25.711 DEBUG:teuthology.orchestra.run.smithi146:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T11:09:25.742 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[112923]: fuse finished with error 0 and tester_r 0 2023-10-06T11:09:25.747 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-10-06T11:09:25.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:09:25.748 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T11:09:25.915 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-10-06T11:09:25.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:09:25.916 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T11:09:25.932 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:09:25.933 INFO:teuthology.orchestra.run.smithi151.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-06T11:09:25.933 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-10-06T11:09:25.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:09:25.934 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T11:09:25.970 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:09:25.971 INFO:teuthology.orchestra.run.smithi146.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-06T11:09:25.971 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-10-06T11:09:25.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:09:25.971 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T11:09:25.990 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:09:25.990 INFO:teuthology.orchestra.run.smithi151.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-06T11:09:25.990 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:09:26.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.125+0000 7fdacea8b700 1 Processor -- start 2023-10-06T11:09:26.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.125+0000 7fdacea8b700 1 -- start start 2023-10-06T11:09:26.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.126+0000 7fdacea8b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdac81562f0 0x7fdac80c8210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:26.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.126+0000 7fdacea8b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdac80cac20 0x7fdac80cb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:26.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.126+0000 7fdacea8b700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdac80cb5d0 con 0x7fdac8159f80 2023-10-06T11:09:26.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.126+0000 7fdacea8b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdac80c6580 con 0x7fdac80cac20 2023-10-06T11:09:26.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.126+0000 7fdacea8b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac80c67d0 con 0x7fdac81562f0 2023-10-06T11:09:26.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.126+0000 7fdacd288700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdac80cac20 0x7fdac80cb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:26.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.126+0000 7fdacd288700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdac80cac20 0x7fdac80cb090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41486/0 (socket says 172.21.15.146:41486) 2023-10-06T11:09:26.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.126+0000 7fdacd288700 1 -- 172.21.15.146:0/824945107 learned_addr learned my addr 172.21.15.146:0/824945107 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:26.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.126+0000 7fdacda89700 1 --2- 172.21.15.146:0/824945107 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdac81562f0 0x7fdac80c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:26.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.126+0000 7fdacd288700 1 -- 172.21.15.146:0/824945107 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdac81562f0 msgr2=0x7fdac80c8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:26.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.126+0000 7fdacd288700 1 --2- 172.21.15.146:0/824945107 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdac81562f0 0x7fdac80c8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:26.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.126+0000 7fdacd288700 1 -- 172.21.15.146:0/824945107 >> v1:172.21.15.151:6789/0 conn(0x7fdac8159f80 legacy=0x7fdac815a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:26.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.126+0000 7fdacd288700 1 -- 172.21.15.146:0/824945107 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac80c6ab0 con 0x7fdac80cac20 2023-10-06T11:09:26.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.127+0000 7fdacd288700 1 --2- 172.21.15.146:0/824945107 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdac80cac20 0x7fdac80cb090 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fdab80099b0 tx=0x7fdab8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=648e0b4fc0daa2de server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:26.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.127+0000 7fdacca87700 1 -- 172.21.15.146:0/824945107 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab800b860 con 0x7fdac80cac20 2023-10-06T11:09:26.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.127+0000 7fdacca87700 1 -- 172.21.15.146:0/824945107 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab800b9c0 con 0x7fdac80cac20 2023-10-06T11:09:26.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.127+0000 7fdacca87700 1 -- 172.21.15.146:0/824945107 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab800bd60 con 0x7fdac80cac20 2023-10-06T11:09:26.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.127+0000 7fdacea8b700 1 -- 172.21.15.146:0/824945107 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdac80cac20 msgr2=0x7fdac80cb090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:26.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.127+0000 7fdacea8b700 1 --2- 172.21.15.146:0/824945107 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdac80cac20 0x7fdac80cb090 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fdab80099b0 tx=0x7fdab8009250 comp rx=0 tx=0).stop 2023-10-06T11:09:26.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.127+0000 7fdacea8b700 1 -- 172.21.15.146:0/824945107 shutdown_connections 2023-10-06T11:09:26.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.127+0000 7fdacea8b700 1 --2- 172.21.15.146:0/824945107 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdac81562f0 0x7fdac80c8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:26.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.127+0000 7fdacea8b700 1 --2- 172.21.15.146:0/824945107 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdac80cac20 0x7fdac80cb090 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:26.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.127+0000 7fdacea8b700 1 -- 172.21.15.146:0/824945107 >> 172.21.15.146:0/824945107 conn(0x7fdac8067f40 msgr2=0x7fdac80cbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:26.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.127+0000 7fdacea8b700 1 -- 172.21.15.146:0/824945107 shutdown_connections 2023-10-06T11:09:26.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.127+0000 7fdacea8b700 1 -- 172.21.15.146:0/824945107 wait complete. 2023-10-06T11:09:26.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.128+0000 7fdacea8b700 1 Processor -- start 2023-10-06T11:09:26.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.129+0000 7fdacea8b700 1 -- start start 2023-10-06T11:09:26.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.129+0000 7fdacea8b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdac80cac20 0x7fdac8153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:26.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.129+0000 7fdacea8b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdac81562f0 0x7fdac80b0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:26.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.129+0000 7fdacea8b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdac8159f80 0x7fdac80afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:26.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.129+0000 7fdacea8b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac80aee10 con 0x7fdac80cac20 2023-10-06T11:09:26.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.129+0000 7fdacea8b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac80b1180 con 0x7fdac81562f0 2023-10-06T11:09:26.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.129+0000 7fdacea8b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac80af0d0 con 0x7fdac8159f80 2023-10-06T11:09:26.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.129+0000 7fdacda89700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdac80cac20 0x7fdac8153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:26.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.129+0000 7fdacda89700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdac80cac20 0x7fdac8153c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41502/0 (socket says 172.21.15.146:41502) 2023-10-06T11:09:26.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.129+0000 7fdacda89700 1 -- 172.21.15.146:0/2268371130 learned_addr learned my addr 172.21.15.146:0/2268371130 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:26.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.129+0000 7fdacd288700 1 --2- 172.21.15.146:0/2268371130 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdac81562f0 0x7fdac80b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:26.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.129+0000 7fdace28a700 1 --2- 172.21.15.146:0/2268371130 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdac8159f80 0x7fdac80afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:26.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.130+0000 7fdacda89700 1 -- 172.21.15.146:0/2268371130 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdac8159f80 msgr2=0x7fdac80afbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:26.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.130+0000 7fdacda89700 1 --2- 172.21.15.146:0/2268371130 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdac8159f80 0x7fdac80afbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:26.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.130+0000 7fdacda89700 1 -- 172.21.15.146:0/2268371130 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdac81562f0 msgr2=0x7fdac80b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:26.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.130+0000 7fdacda89700 1 --2- 172.21.15.146:0/2268371130 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdac81562f0 0x7fdac80b0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:26.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.130+0000 7fdacda89700 1 -- 172.21.15.146:0/2268371130 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab80094f0 con 0x7fdac80cac20 2023-10-06T11:09:26.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.130+0000 7fdace28a700 1 --2- 172.21.15.146:0/2268371130 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdac8159f80 0x7fdac80afbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:26.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.130+0000 7fdacda89700 1 --2- 172.21.15.146:0/2268371130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdac80cac20 0x7fdac8153c20 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fdac400d890 tx=0x7fdac4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:26.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.130+0000 7fdabdffb700 1 -- 172.21.15.146:0/2268371130 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac40125f0 con 0x7fdac80cac20 2023-10-06T11:09:26.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.130+0000 7fdabdffb700 1 -- 172.21.15.146:0/2268371130 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac4012750 con 0x7fdac80cac20 2023-10-06T11:09:26.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.130+0000 7fdacea8b700 1 -- 172.21.15.146:0/2268371130 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdac80af3b0 con 0x7fdac80cac20 2023-10-06T11:09:26.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.130+0000 7fdabdffb700 1 -- 172.21.15.146:0/2268371130 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac4012ad0 con 0x7fdac80cac20 2023-10-06T11:09:26.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.130+0000 7fdacea8b700 1 -- 172.21.15.146:0/2268371130 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdac80aa6f0 con 0x7fdac80cac20 2023-10-06T11:09:26.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.131+0000 7fdacea8b700 1 -- 172.21.15.146:0/2268371130 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdac806c5e0 con 0x7fdac80cac20 2023-10-06T11:09:26.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.132+0000 7fdabdffb700 1 -- 172.21.15.146:0/2268371130 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdac401e460 con 0x7fdac80cac20 2023-10-06T11:09:26.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.132+0000 7fdabdffb700 1 --2- 172.21.15.146:0/2268371130 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdaac066f30 0x7fdaac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:26.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.132+0000 7fdabdffb700 1 -- 172.21.15.146:0/2268371130 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdac4084cb0 con 0x7fdac80cac20 2023-10-06T11:09:26.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.132+0000 7fdacd288700 1 --2- 172.21.15.146:0/2268371130 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdaac066f30 0x7fdaac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:26.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.132+0000 7fdacd288700 1 --2- 172.21.15.146:0/2268371130 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdaac066f30 0x7fdaac0693e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdab80099b0 tx=0x7fdab8017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:26.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.136+0000 7fdabdffb700 1 -- 172.21.15.146:0/2268371130 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdac4051dc0 con 0x7fdac80cac20 2023-10-06T11:09:26.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.364+0000 7fdacea8b700 1 -- 172.21.15.146:0/2268371130 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdac80c6d90 con 0x7fdac80cac20 2023-10-06T11:09:26.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.365+0000 7fdabdffb700 1 -- 172.21.15.146:0/2268371130 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4610 (secure 0 0 0) 0x7fdac40553e0 con 0x7fdac80cac20 2023-10-06T11:09:26.367 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:09:26.367 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":39,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5248,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3360977916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3360977916},{"type":"v1","addr":"172.21.15.151:6834","nonce":3360977916}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5251,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2265934004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":2265934004},{"type":"v1","addr":"172.21.15.151:6835","nonce":2265934004}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2387575667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2387575667},{"type":"v1","addr":"172.21.15.146:6836","nonce":2387575667}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:08:42.797557+0000","modified":"2023-10-06T11:09:23.554479+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5481":{"gid":5481,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":13,"addr":"172.21.15.146:6837/2252184844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2252184844},{"type":"v1","addr":"172.21.15.146:6837","nonce":2252184844}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T11:09:26.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.367+0000 7fdacea8b700 1 -- 172.21.15.146:0/2268371130 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdaac066f30 msgr2=0x7fdaac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:26.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.367+0000 7fdacea8b700 1 --2- 172.21.15.146:0/2268371130 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdaac066f30 0x7fdaac0693e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdab80099b0 tx=0x7fdab8017000 comp rx=0 tx=0).stop 2023-10-06T11:09:26.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.367+0000 7fdacea8b700 1 -- 172.21.15.146:0/2268371130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdac80cac20 msgr2=0x7fdac8153c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:26.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.367+0000 7fdacea8b700 1 --2- 172.21.15.146:0/2268371130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdac80cac20 0x7fdac8153c20 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fdac400d890 tx=0x7fdac4008040 comp rx=0 tx=0).stop 2023-10-06T11:09:26.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.367+0000 7fdacea8b700 1 -- 172.21.15.146:0/2268371130 shutdown_connections 2023-10-06T11:09:26.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.367+0000 7fdacea8b700 1 --2- 172.21.15.146:0/2268371130 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdaac066f30 0x7fdaac0693e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:26.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.367+0000 7fdacea8b700 1 --2- 172.21.15.146:0/2268371130 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdac8159f80 0x7fdac80afbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:26.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.367+0000 7fdacea8b700 1 --2- 172.21.15.146:0/2268371130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdac80cac20 0x7fdac8153c20 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:26.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.367+0000 7fdacea8b700 1 --2- 172.21.15.146:0/2268371130 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdac81562f0 0x7fdac80b0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:26.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.367+0000 7fdacea8b700 1 -- 172.21.15.146:0/2268371130 >> 172.21.15.146:0/2268371130 conn(0x7fdac8067f40 msgr2=0x7fdac815a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:26.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.367+0000 7fdacea8b700 1 -- 172.21.15.146:0/2268371130 shutdown_connections 2023-10-06T11:09:26.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.367+0000 7fdacea8b700 1 -- 172.21.15.146:0/2268371130 wait complete. 2023-10-06T11:09:26.371 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 39 2023-10-06T11:09:26.382 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:09:26.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.495+0000 7ffab896b700 1 Processor -- start 2023-10-06T11:09:26.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.495+0000 7ffab896b700 1 -- start start 2023-10-06T11:09:26.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.496+0000 7ffab896b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ffab4153ab0 0x7ffab415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:26.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.496+0000 7ffab896b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffab4068ba0 0x7ffab40b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:26.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.496+0000 7ffab896b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffab415ac30 con 0x7ffab4153e80 2023-10-06T11:09:26.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.496+0000 7ffab896b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab40b4510 con 0x7ffab4068ba0 2023-10-06T11:09:26.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.496+0000 7ffab896b700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab40b6530 con 0x7ffab4153ab0 2023-10-06T11:09:26.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.496+0000 7ffab2d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffab4068ba0 0x7ffab40b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:26.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.496+0000 7ffaa9d9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ffab4153e80 0x7ffab4068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36596/0 (socket says 172.21.15.146:36596) 2023-10-06T11:09:26.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.496+0000 7ffaa9d9b700 1 -- 172.21.15.146:0/4272415753 learned_addr learned my addr 172.21.15.146:0/4272415753 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:26.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.497+0000 7ffab259c700 1 --2- 172.21.15.146:0/4272415753 >> v2:172.21.15.151:3300/0 conn(0x7ffab4153ab0 0x7ffab415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:26.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.497+0000 7ffab2d9d700 1 -- 172.21.15.146:0/4272415753 >> v2:172.21.15.151:3300/0 conn(0x7ffab4153ab0 msgr2=0x7ffab415a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:26.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.497+0000 7ffab2d9d700 1 --2- 172.21.15.146:0/4272415753 >> v2:172.21.15.151:3300/0 conn(0x7ffab4153ab0 0x7ffab415a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:26.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.497+0000 7ffab2d9d700 1 -- 172.21.15.146:0/4272415753 >> v1:172.21.15.146:6789/0 conn(0x7ffab4153e80 legacy=0x7ffab4068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:26.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.497+0000 7ffab1d9b700 1 -- 172.21.15.146:0/4272415753 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1692970681 0 0) 0x7ffa9c001110 con 0x7ffab4153e80 2023-10-06T11:09:26.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.497+0000 7ffab2d9d700 1 -- 172.21.15.146:0/4272415753 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab40b5c50 con 0x7ffab4068ba0 2023-10-06T11:09:26.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.497+0000 7ffab2d9d700 1 --2- 172.21.15.146:0/4272415753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffab4068ba0 0x7ffab40b49a0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7ffab40b5eb0 tx=0x7ffaac009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a5fb6efda497725 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:26.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.497+0000 7ffab1d9b700 1 -- 172.21.15.146:0/4272415753 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac00e070 con 0x7ffab4068ba0 2023-10-06T11:09:26.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.497+0000 7ffab1d9b700 1 -- 172.21.15.146:0/4272415753 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaac00bb60 con 0x7ffab4068ba0 2023-10-06T11:09:26.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.497+0000 7ffab1d9b700 1 -- 172.21.15.146:0/4272415753 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac012430 con 0x7ffab4068ba0 2023-10-06T11:09:26.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.498+0000 7ffab896b700 1 -- 172.21.15.146:0/4272415753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffab4068ba0 msgr2=0x7ffab40b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:26.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.498+0000 7ffab896b700 1 --2- 172.21.15.146:0/4272415753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffab4068ba0 0x7ffab40b49a0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7ffab40b5eb0 tx=0x7ffaac009780 comp rx=0 tx=0).stop 2023-10-06T11:09:26.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.498+0000 7ffab896b700 1 -- 172.21.15.146:0/4272415753 shutdown_connections 2023-10-06T11:09:26.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.498+0000 7ffab896b700 1 --2- 172.21.15.146:0/4272415753 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffab4068ba0 0x7ffab40b49a0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:26.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.498+0000 7ffab896b700 1 --2- 172.21.15.146:0/4272415753 >> v2:172.21.15.151:3300/0 conn(0x7ffab4153ab0 0x7ffab415a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:26.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.498+0000 7ffab896b700 1 -- 172.21.15.146:0/4272415753 >> 172.21.15.146:0/4272415753 conn(0x7ffab406eba0 msgr2=0x7ffab406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:26.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.498+0000 7ffab896b700 1 -- 172.21.15.146:0/4272415753 shutdown_connections 2023-10-06T11:09:26.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.498+0000 7ffab896b700 1 -- 172.21.15.146:0/4272415753 wait complete. 2023-10-06T11:09:26.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.499+0000 7ffab896b700 1 Processor -- start 2023-10-06T11:09:26.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.499+0000 7ffab896b700 1 -- start start 2023-10-06T11:09:26.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.500+0000 7ffab896b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffab4068ba0 0x7ffab4155590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:26.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.500+0000 7ffab896b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffab4153ab0 0x7ffab415b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:26.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.500+0000 7ffab896b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffab4153e80 0x7ffab413e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:26.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.500+0000 7ffab896b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab416de80 con 0x7ffab4068ba0 2023-10-06T11:09:26.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.500+0000 7ffab896b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab416d300 con 0x7ffab4153ab0 2023-10-06T11:09:26.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.500+0000 7ffab896b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab416d5e0 con 0x7ffab4153e80 2023-10-06T11:09:26.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.500+0000 7ffab259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffab4068ba0 0x7ffab4155590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:26.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.500+0000 7ffab259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffab4068ba0 0x7ffab4155590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41518/0 (socket says 172.21.15.146:41518) 2023-10-06T11:09:26.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.500+0000 7ffab259c700 1 -- 172.21.15.146:0/1136956512 learned_addr learned my addr 172.21.15.146:0/1136956512 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:26.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.500+0000 7ffaa9d9b700 1 --2- 172.21.15.146:0/1136956512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffab4153ab0 0x7ffab415b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:26.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.500+0000 7ffab2d9d700 1 --2- 172.21.15.146:0/1136956512 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffab4153e80 0x7ffab413e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:26.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.500+0000 7ffab259c700 1 -- 172.21.15.146:0/1136956512 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffab4153e80 msgr2=0x7ffab413e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:26.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.500+0000 7ffab259c700 1 --2- 172.21.15.146:0/1136956512 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffab4153e80 0x7ffab413e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:26.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.500+0000 7ffab259c700 1 -- 172.21.15.146:0/1136956512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffab4153ab0 msgr2=0x7ffab415b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:26.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.500+0000 7ffab259c700 1 --2- 172.21.15.146:0/1136956512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffab4153ab0 0x7ffab415b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:26.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.500+0000 7ffab259c700 1 -- 172.21.15.146:0/1136956512 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaac009a20 con 0x7ffab4068ba0 2023-10-06T11:09:26.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.500+0000 7ffab259c700 1 --2- 172.21.15.146:0/1136956512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffab4068ba0 0x7ffab4155590 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ffaa400ec80 tx=0x7ffaa40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:26.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.500+0000 7ffaaaffd700 1 -- 172.21.15.146:0/1136956512 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa400c850 con 0x7ffab4068ba0 2023-10-06T11:09:26.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.500+0000 7ffaaaffd700 1 -- 172.21.15.146:0/1136956512 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa400c9b0 con 0x7ffab4068ba0 2023-10-06T11:09:26.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.500+0000 7ffab896b700 1 -- 172.21.15.146:0/1136956512 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffab416d8c0 con 0x7ffab4068ba0 2023-10-06T11:09:26.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.500+0000 7ffaaaffd700 1 -- 172.21.15.146:0/1136956512 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa400cd50 con 0x7ffab4068ba0 2023-10-06T11:09:26.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.500+0000 7ffab896b700 1 -- 172.21.15.146:0/1136956512 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab4155ad0 con 0x7ffab4068ba0 2023-10-06T11:09:26.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.501+0000 7ffab896b700 1 -- 172.21.15.146:0/1136956512 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab41560c0 con 0x7ffab4068ba0 2023-10-06T11:09:26.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.502+0000 7ffaaaffd700 1 -- 172.21.15.146:0/1136956512 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffaa4013680 con 0x7ffab4068ba0 2023-10-06T11:09:26.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.502+0000 7ffaaaffd700 1 --2- 172.21.15.146:0/1136956512 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ffa94066f30 0x7ffa940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:26.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.502+0000 7ffaa9d9b700 1 --2- 172.21.15.146:0/1136956512 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ffa94066f30 0x7ffa940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:26.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.502+0000 7ffaaaffd700 1 -- 172.21.15.146:0/1136956512 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ffaa4084950 con 0x7ffab4068ba0 2023-10-06T11:09:26.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.503+0000 7ffaa9d9b700 1 --2- 172.21.15.146:0/1136956512 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ffa94066f30 0x7ffa940693e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ffab416cdf0 tx=0x7ffa9c007b90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:26.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.506+0000 7ffaaaffd700 1 -- 172.21.15.146:0/1136956512 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffaa4051a60 con 0x7ffab4068ba0 2023-10-06T11:09:26.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.695+0000 7ffab896b700 1 -- 172.21.15.146:0/1136956512 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffab404c380 con 0x7ffab4068ba0 2023-10-06T11:09:26.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.696+0000 7ffaaaffd700 1 -- 172.21.15.146:0/1136956512 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16914 (secure 0 0 0) 0x7ffaa4055080 con 0x7ffab4068ba0 2023-10-06T11:09:26.698 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:09:26.698 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":47,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:08:44.410124+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:08:40.456040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-06T11:08:41.764122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:09:26.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.698+0000 7ffab896b700 1 -- 172.21.15.146:0/1136956512 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ffa94066f30 msgr2=0x7ffa940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:26.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.698+0000 7ffab896b700 1 --2- 172.21.15.146:0/1136956512 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ffa94066f30 0x7ffa940693e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ffab416cdf0 tx=0x7ffa9c007b90 comp rx=0 tx=0).stop 2023-10-06T11:09:26.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.698+0000 7ffab896b700 1 -- 172.21.15.146:0/1136956512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffab4068ba0 msgr2=0x7ffab4155590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:26.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.698+0000 7ffab896b700 1 --2- 172.21.15.146:0/1136956512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffab4068ba0 0x7ffab4155590 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ffaa400ec80 tx=0x7ffaa40091a0 comp rx=0 tx=0).stop 2023-10-06T11:09:26.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.698+0000 7ffab896b700 1 -- 172.21.15.146:0/1136956512 shutdown_connections 2023-10-06T11:09:26.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.698+0000 7ffab896b700 1 --2- 172.21.15.146:0/1136956512 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ffa94066f30 0x7ffa940693e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:26.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.698+0000 7ffab896b700 1 --2- 172.21.15.146:0/1136956512 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffab4153e80 0x7ffab413e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:26.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.698+0000 7ffab896b700 1 --2- 172.21.15.146:0/1136956512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffab4068ba0 0x7ffab4155590 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:26.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.698+0000 7ffab896b700 1 --2- 172.21.15.146:0/1136956512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffab4153ab0 0x7ffab415b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:26.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.698+0000 7ffab896b700 1 -- 172.21.15.146:0/1136956512 >> 172.21.15.146:0/1136956512 conn(0x7ffab406eba0 msgr2=0x7ffab40d04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:26.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.698+0000 7ffab896b700 1 -- 172.21.15.146:0/1136956512 shutdown_connections 2023-10-06T11:09:26.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.698+0000 7ffab896b700 1 -- 172.21.15.146:0/1136956512 wait complete. 2023-10-06T11:09:26.712 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:05:36.687307+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:05:37.171199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T11:08:40.456040+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T11:08:41.764122+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T11:09:26.713 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:09:26.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.830+0000 7f9eacae2700 1 Processor -- start 2023-10-06T11:09:26.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.830+0000 7f9eacae2700 1 -- start start 2023-10-06T11:09:26.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.831+0000 7f9eacae2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9ea80ae730 0x7f9ea80aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:26.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.831+0000 7f9eacae2700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9ea80cb950 0x7f9ea80cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:26.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.831+0000 7f9eacae2700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ea80ae2a0 con 0x7f9ea815a160 2023-10-06T11:09:26.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.831+0000 7f9eacae2700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ea815a530 con 0x7f9ea80ae730 2023-10-06T11:09:26.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.831+0000 7f9eacae2700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ea80c5cb0 con 0x7f9ea80cb950 2023-10-06T11:09:26.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.831+0000 7f9e9dd9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9ea80ae730 0x7f9ea80aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:26.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.831+0000 7f9ea659c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f9ea815a160 0x7f9ea80c55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36606/0 (socket says 172.21.15.146:36606) 2023-10-06T11:09:26.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.831+0000 7f9ea659c700 1 -- 172.21.15.146:0/2852857882 learned_addr learned my addr 172.21.15.146:0/2852857882 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:26.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.831+0000 7f9ea6d9d700 1 --2- 172.21.15.146:0/2852857882 >> v2:172.21.15.151:3300/0 conn(0x7f9ea80cb950 0x7f9ea80cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:26.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.831+0000 7f9e9dd9b700 1 -- 172.21.15.146:0/2852857882 >> v2:172.21.15.151:3300/0 conn(0x7f9ea80cb950 msgr2=0x7f9ea80cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:26.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.831+0000 7f9e9dd9b700 1 --2- 172.21.15.146:0/2852857882 >> v2:172.21.15.151:3300/0 conn(0x7f9ea80cb950 0x7f9ea80cbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:26.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.831+0000 7f9e9dd9b700 1 -- 172.21.15.146:0/2852857882 >> v1:172.21.15.146:6789/0 conn(0x7f9ea815a160 legacy=0x7f9ea80c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:26.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.831+0000 7f9ea5d9b700 1 -- 172.21.15.146:0/2852857882 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3500552452 0 0) 0x7f9ea80ae2a0 con 0x7f9ea815a160 2023-10-06T11:09:26.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.831+0000 7f9e9dd9b700 1 -- 172.21.15.146:0/2852857882 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea80af0f0 con 0x7f9ea80ae730 2023-10-06T11:09:26.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.831+0000 7f9ea6d9d700 1 --2- 172.21.15.146:0/2852857882 >> v2:172.21.15.151:3300/0 conn(0x7f9ea80cb950 0x7f9ea80cbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:09:26.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.831+0000 7f9e9dd9b700 1 --2- 172.21.15.146:0/2852857882 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ea80ae730 0x7f9ea80aebb0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f9ea808b000 tx=0x7f9e900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57e360cec2454996 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:26.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.832+0000 7f9ea5d9b700 1 -- 172.21.15.146:0/2852857882 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9000b6b0 con 0x7f9ea80ae730 2023-10-06T11:09:26.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.832+0000 7f9ea5d9b700 1 -- 172.21.15.146:0/2852857882 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e9000b810 con 0x7f9ea80ae730 2023-10-06T11:09:26.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.832+0000 7f9ea5d9b700 1 -- 172.21.15.146:0/2852857882 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9000bbb0 con 0x7f9ea80ae730 2023-10-06T11:09:26.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.832+0000 7f9eacae2700 1 -- 172.21.15.146:0/2852857882 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ea80ae730 msgr2=0x7f9ea80aebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:26.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.832+0000 7f9eacae2700 1 --2- 172.21.15.146:0/2852857882 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ea80ae730 0x7f9ea80aebb0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f9ea808b000 tx=0x7f9e900091a0 comp rx=0 tx=0).stop 2023-10-06T11:09:26.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.832+0000 7f9eacae2700 1 -- 172.21.15.146:0/2852857882 shutdown_connections 2023-10-06T11:09:26.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.832+0000 7f9eacae2700 1 --2- 172.21.15.146:0/2852857882 >> v2:172.21.15.151:3300/0 conn(0x7f9ea80cb950 0x7f9ea80cbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:26.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.832+0000 7f9eacae2700 1 --2- 172.21.15.146:0/2852857882 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ea80ae730 0x7f9ea80aebb0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:26.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.832+0000 7f9eacae2700 1 -- 172.21.15.146:0/2852857882 >> 172.21.15.146:0/2852857882 conn(0x7f9ea806f380 msgr2=0x7f9ea80d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:26.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.832+0000 7f9eacae2700 1 -- 172.21.15.146:0/2852857882 shutdown_connections 2023-10-06T11:09:26.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.832+0000 7f9eacae2700 1 -- 172.21.15.146:0/2852857882 wait complete. 2023-10-06T11:09:26.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.833+0000 7f9eacae2700 1 Processor -- start 2023-10-06T11:09:26.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.833+0000 7f9eacae2700 1 -- start start 2023-10-06T11:09:26.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.834+0000 7f9eacae2700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ea80ae730 0x7f9ea8157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:26.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.834+0000 7f9eacae2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ea80cb950 0x7f9ea80b51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:26.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.834+0000 7f9eacae2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ea815a160 0x7f9ea80cc440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:26.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.834+0000 7f9eacae2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea816a430 con 0x7f9ea815a160 2023-10-06T11:09:26.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.834+0000 7f9eacae2700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea816aca0 con 0x7f9ea80cb950 2023-10-06T11:09:26.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.834+0000 7f9eacae2700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ea80b5ac0 con 0x7f9ea80ae730 2023-10-06T11:09:26.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.834+0000 7f9ea6d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ea815a160 0x7f9ea80cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:26.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.834+0000 7f9ea6d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ea815a160 0x7f9ea80cc440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41538/0 (socket says 172.21.15.146:41538) 2023-10-06T11:09:26.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.834+0000 7f9ea6d9d700 1 -- 172.21.15.146:0/700227467 learned_addr learned my addr 172.21.15.146:0/700227467 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:26.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.834+0000 7f9e9dd9b700 1 --2- 172.21.15.146:0/700227467 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ea80cb950 0x7f9ea80b51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:26.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.834+0000 7f9ea659c700 1 --2- 172.21.15.146:0/700227467 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ea80ae730 0x7f9ea8157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:26.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.835+0000 7f9ea6d9d700 1 -- 172.21.15.146:0/700227467 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ea80ae730 msgr2=0x7f9ea8157130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:26.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.835+0000 7f9ea6d9d700 1 --2- 172.21.15.146:0/700227467 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ea80ae730 0x7f9ea8157130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:26.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.835+0000 7f9ea6d9d700 1 -- 172.21.15.146:0/700227467 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ea80cb950 msgr2=0x7f9ea80b51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:26.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.835+0000 7f9ea6d9d700 1 --2- 172.21.15.146:0/700227467 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ea80cb950 0x7f9ea80b51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:26.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.835+0000 7f9ea6d9d700 1 -- 172.21.15.146:0/700227467 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e90009420 con 0x7f9ea815a160 2023-10-06T11:09:26.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.835+0000 7f9ea6d9d700 1 --2- 172.21.15.146:0/700227467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ea815a160 0x7f9ea80cc440 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f9ea000a380 tx=0x7f9ea0007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:26.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.835+0000 7f9e9effd700 1 -- 172.21.15.146:0/700227467 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea000ae10 con 0x7f9ea815a160 2023-10-06T11:09:26.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.835+0000 7f9e9effd700 1 -- 172.21.15.146:0/700227467 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea000d650 con 0x7f9ea815a160 2023-10-06T11:09:26.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.835+0000 7f9eacae2700 1 -- 172.21.15.146:0/700227467 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ea816a650 con 0x7f9ea815a160 2023-10-06T11:09:26.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.835+0000 7f9e9effd700 1 -- 172.21.15.146:0/700227467 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea000da10 con 0x7f9ea815a160 2023-10-06T11:09:26.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.835+0000 7f9eacae2700 1 -- 172.21.15.146:0/700227467 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ea80b5720 con 0x7f9ea815a160 2023-10-06T11:09:26.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.836+0000 7f9eacae2700 1 -- 172.21.15.146:0/700227467 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ea816ae50 con 0x7f9ea815a160 2023-10-06T11:09:26.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.836+0000 7f9e9effd700 1 -- 172.21.15.146:0/700227467 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9ea001e3b0 con 0x7f9ea815a160 2023-10-06T11:09:26.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.837+0000 7f9e9effd700 1 --2- 172.21.15.146:0/700227467 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9e88066f30 0x7f9e880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:26.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.837+0000 7f9e9effd700 1 -- 172.21.15.146:0/700227467 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9ea0085080 con 0x7f9ea815a160 2023-10-06T11:09:26.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.837+0000 7f9ea659c700 1 --2- 172.21.15.146:0/700227467 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9e88066f30 0x7f9e880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:26.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.837+0000 7f9ea659c700 1 --2- 172.21.15.146:0/700227467 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9e88066f30 0x7f9e880693e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9e98002800 tx=0x7f9e98009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:26.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:26.841+0000 7f9e9effd700 1 -- 172.21.15.146:0/700227467 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ea816ae50 con 0x7f9ea815a160 2023-10-06T11:09:27.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.024+0000 7f9eacae2700 1 -- 172.21.15.146:0/700227467 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9ea816ae50 con 0x7f9ea815a160 2023-10-06T11:09:27.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.025+0000 7f9e9effd700 1 -- 172.21.15.146:0/700227467 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v47) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9ea816ae50 con 0x7f9ea815a160 2023-10-06T11:09:27.027 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-10-06T11:09:27.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.027+0000 7f9eacae2700 1 -- 172.21.15.146:0/700227467 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9e88066f30 msgr2=0x7f9e880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:27.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.027+0000 7f9eacae2700 1 --2- 172.21.15.146:0/700227467 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9e88066f30 0x7f9e880693e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9e98002800 tx=0x7f9e98009040 comp rx=0 tx=0).stop 2023-10-06T11:09:27.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.027+0000 7f9eacae2700 1 -- 172.21.15.146:0/700227467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ea815a160 msgr2=0x7f9ea80cc440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:27.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.027+0000 7f9eacae2700 1 --2- 172.21.15.146:0/700227467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ea815a160 0x7f9ea80cc440 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f9ea000a380 tx=0x7f9ea0007900 comp rx=0 tx=0).stop 2023-10-06T11:09:27.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.027+0000 7f9eacae2700 1 -- 172.21.15.146:0/700227467 shutdown_connections 2023-10-06T11:09:27.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.027+0000 7f9eacae2700 1 --2- 172.21.15.146:0/700227467 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9e88066f30 0x7f9e880693e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:27.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.027+0000 7f9eacae2700 1 --2- 172.21.15.146:0/700227467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ea815a160 0x7f9ea80cc440 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:27.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.027+0000 7f9eacae2700 1 --2- 172.21.15.146:0/700227467 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ea80ae730 0x7f9ea8157130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:27.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.027+0000 7f9eacae2700 1 --2- 172.21.15.146:0/700227467 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ea80cb950 0x7f9ea80b51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:27.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.027+0000 7f9eacae2700 1 -- 172.21.15.146:0/700227467 >> 172.21.15.146:0/700227467 conn(0x7f9ea806f380 msgr2=0x7f9ea81594f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:27.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.027+0000 7f9eacae2700 1 -- 172.21.15.146:0/700227467 shutdown_connections 2023-10-06T11:09:27.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.027+0000 7f9eacae2700 1 -- 172.21.15.146:0/700227467 wait complete. 2023-10-06T11:09:27.041 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:09:27.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.157+0000 7fa08bd0a700 1 Processor -- start 2023-10-06T11:09:27.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.157+0000 7fa08bd0a700 1 -- start start 2023-10-06T11:09:27.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.158+0000 7fa08bd0a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0840c7810 0x7fa08415e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:27.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.158+0000 7fa08bd0a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0840d1670 con 0x7fa084159f40 2023-10-06T11:09:27.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.158+0000 7fa08bd0a700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0840cee70 con 0x7fa08415e5f0 2023-10-06T11:09:27.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.158+0000 7fa08bd0a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0840cc4b0 con 0x7fa0840c7810 2023-10-06T11:09:27.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.158+0000 7fa089aa6700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa084159f40 0x7fa08415d9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36618/0 (socket says 172.21.15.146:36618) 2023-10-06T11:09:27.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.158+0000 7fa089aa6700 1 -- 172.21.15.146:0/3016891959 learned_addr learned my addr 172.21.15.146:0/3016891959 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:27.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.159+0000 7fa0892a5700 1 --2- 172.21.15.146:0/3016891959 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0840c7810 0x7fa08415e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:27.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.159+0000 7fa088aa4700 1 -- 172.21.15.146:0/3016891959 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1021902756 0 0) 0x7fa0840d1670 con 0x7fa084159f40 2023-10-06T11:09:27.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.159+0000 7fa088aa4700 1 -- 172.21.15.146:0/3016891959 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa070003570 con 0x7fa084159f40 2023-10-06T11:09:27.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.159+0000 7fa088aa4700 1 -- 172.21.15.146:0/3016891959 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1421983269 0 0) 0x7fa0840cee70 con 0x7fa08415e5f0 2023-10-06T11:09:27.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.159+0000 7fa088aa4700 1 -- 172.21.15.146:0/3016891959 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0840d1670 con 0x7fa08415e5f0 2023-10-06T11:09:27.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.159+0000 7fa0892a5700 1 -- 172.21.15.146:0/3016891959 >> v1:172.21.15.151:6789/0 conn(0x7fa08415e5f0 legacy=0x7fa0840cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:27.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.159+0000 7fa088aa4700 1 -- 172.21.15.146:0/3016891959 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2274077262 0 0) 0x7fa070003570 con 0x7fa084159f40 2023-10-06T11:09:27.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.159+0000 7fa0892a5700 1 -- 172.21.15.146:0/3016891959 >> v1:172.21.15.146:6789/0 conn(0x7fa084159f40 legacy=0x7fa08415d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:27.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.159+0000 7fa0892a5700 1 -- 172.21.15.146:0/3016891959 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa08406f990 con 0x7fa0840c7810 2023-10-06T11:09:27.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.159+0000 7fa0892a5700 1 --2- 172.21.15.146:0/3016891959 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0840c7810 0x7fa08415e0b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa074009910 tx=0x7fa0740091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b845e52188772a64 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:27.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.159+0000 7fa088aa4700 1 -- 172.21.15.146:0/3016891959 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa080001970 con 0x7fa0840c7810 2023-10-06T11:09:27.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.159+0000 7fa088aa4700 1 -- 172.21.15.146:0/3016891959 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa074011420 con 0x7fa0840c7810 2023-10-06T11:09:27.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.159+0000 7fa088aa4700 1 -- 172.21.15.146:0/3016891959 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0740117c0 con 0x7fa0840c7810 2023-10-06T11:09:27.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.160+0000 7fa08bd0a700 1 -- 172.21.15.146:0/3016891959 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0840c7810 msgr2=0x7fa08415e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:27.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.160+0000 7fa08bd0a700 1 --2- 172.21.15.146:0/3016891959 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0840c7810 0x7fa08415e0b0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa074009910 tx=0x7fa0740091a0 comp rx=0 tx=0).stop 2023-10-06T11:09:27.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.160+0000 7fa08bd0a700 1 -- 172.21.15.146:0/3016891959 shutdown_connections 2023-10-06T11:09:27.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.160+0000 7fa08bd0a700 1 --2- 172.21.15.146:0/3016891959 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa0840c7810 0x7fa08415e0b0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:27.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.160+0000 7fa08bd0a700 1 -- 172.21.15.146:0/3016891959 >> 172.21.15.146:0/3016891959 conn(0x7fa08406f380 msgr2=0x7fa0840d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:27.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.160+0000 7fa08bd0a700 1 -- 172.21.15.146:0/3016891959 shutdown_connections 2023-10-06T11:09:27.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.160+0000 7fa08bd0a700 1 -- 172.21.15.146:0/3016891959 wait complete. 2023-10-06T11:09:27.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.161+0000 7fa08bd0a700 1 Processor -- start 2023-10-06T11:09:27.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.161+0000 7fa08bd0a700 1 -- start start 2023-10-06T11:09:27.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.162+0000 7fa08bd0a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0840c7810 0x7fa08414a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:27.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.162+0000 7fa08bd0a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa084159f40 0x7fa08414ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:27.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.162+0000 7fa08bd0a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa08415e5f0 0x7fa08416dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:27.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.162+0000 7fa08bd0a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0840cb6e0 con 0x7fa08415e5f0 2023-10-06T11:09:27.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.162+0000 7fa08bd0a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0840cb400 con 0x7fa0840c7810 2023-10-06T11:09:27.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.162+0000 7fa08bd0a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0840c87e0 con 0x7fa084159f40 2023-10-06T11:09:27.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.162+0000 7fa08a2a7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa08415e5f0 0x7fa08416dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:27.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.162+0000 7fa089aa6700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0840c7810 0x7fa08414a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:27.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.162+0000 7fa08a2a7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa08415e5f0 0x7fa08416dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41540/0 (socket says 172.21.15.146:41540) 2023-10-06T11:09:27.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.162+0000 7fa08a2a7700 1 -- 172.21.15.146:0/3225268801 learned_addr learned my addr 172.21.15.146:0/3225268801 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:27.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.162+0000 7fa0892a5700 1 --2- 172.21.15.146:0/3225268801 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa084159f40 0x7fa08414ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:27.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.162+0000 7fa08a2a7700 1 -- 172.21.15.146:0/3225268801 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa084159f40 msgr2=0x7fa08414ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:27.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.162+0000 7fa08a2a7700 1 --2- 172.21.15.146:0/3225268801 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa084159f40 0x7fa08414ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:27.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.162+0000 7fa08a2a7700 1 -- 172.21.15.146:0/3225268801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0840c7810 msgr2=0x7fa08414a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:27.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.162+0000 7fa08a2a7700 1 --2- 172.21.15.146:0/3225268801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0840c7810 0x7fa08414a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:27.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.162+0000 7fa08a2a7700 1 -- 172.21.15.146:0/3225268801 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa074009420 con 0x7fa08415e5f0 2023-10-06T11:09:27.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.162+0000 7fa08a2a7700 1 --2- 172.21.15.146:0/3225268801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa08415e5f0 0x7fa08416dd70 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fa07c00c560 tx=0x7fa07c007d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:27.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.162+0000 7fa079ffb700 1 -- 172.21.15.146:0/3225268801 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07c011590 con 0x7fa08415e5f0 2023-10-06T11:09:27.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.162+0000 7fa079ffb700 1 -- 172.21.15.146:0/3225268801 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa07c0116f0 con 0x7fa08415e5f0 2023-10-06T11:09:27.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.162+0000 7fa08bd0a700 1 -- 172.21.15.146:0/3225268801 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0840c8ac0 con 0x7fa08415e5f0 2023-10-06T11:09:27.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.162+0000 7fa079ffb700 1 -- 172.21.15.146:0/3225268801 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07c011a90 con 0x7fa08415e5f0 2023-10-06T11:09:27.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.163+0000 7fa08bd0a700 1 -- 172.21.15.146:0/3225268801 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa08414b2c0 con 0x7fa08415e5f0 2023-10-06T11:09:27.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.163+0000 7fa08bd0a700 1 -- 172.21.15.146:0/3225268801 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa08404c380 con 0x7fa08415e5f0 2023-10-06T11:09:27.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.164+0000 7fa079ffb700 1 -- 172.21.15.146:0/3225268801 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa07c01c460 con 0x7fa08415e5f0 2023-10-06T11:09:27.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.164+0000 7fa079ffb700 1 --2- 172.21.15.146:0/3225268801 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa068066f30 0x7fa0680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:27.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.164+0000 7fa079ffb700 1 -- 172.21.15.146:0/3225268801 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa07c084270 con 0x7fa08415e5f0 2023-10-06T11:09:27.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.164+0000 7fa089aa6700 1 --2- 172.21.15.146:0/3225268801 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa068066f30 0x7fa0680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:27.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.165+0000 7fa089aa6700 1 --2- 172.21.15.146:0/3225268801 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa068066f30 0x7fa0680693e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa080000f80 tx=0x7fa080001a40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:27.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.169+0000 7fa079ffb700 1 -- 172.21.15.146:0/3225268801 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa07c051380 con 0x7fa08415e5f0 2023-10-06T11:09:27.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.354+0000 7fa08bd0a700 1 -- 172.21.15.146:0/3225268801 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa084089ec0 con 0x7fa08415e5f0 2023-10-06T11:09:27.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.355+0000 7fa079ffb700 1 -- 172.21.15.146:0/3225268801 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa07c0549a0 con 0x7fa08415e5f0 2023-10-06T11:09:27.357 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-10-06T11:09:27.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.357+0000 7fa08bd0a700 1 -- 172.21.15.146:0/3225268801 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa068066f30 msgr2=0x7fa0680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:27.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.357+0000 7fa08bd0a700 1 --2- 172.21.15.146:0/3225268801 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa068066f30 0x7fa0680693e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa080000f80 tx=0x7fa080001a40 comp rx=0 tx=0).stop 2023-10-06T11:09:27.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.357+0000 7fa08bd0a700 1 -- 172.21.15.146:0/3225268801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa08415e5f0 msgr2=0x7fa08416dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:27.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.357+0000 7fa08bd0a700 1 --2- 172.21.15.146:0/3225268801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa08415e5f0 0x7fa08416dd70 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fa07c00c560 tx=0x7fa07c007d50 comp rx=0 tx=0).stop 2023-10-06T11:09:27.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.357+0000 7fa08bd0a700 1 -- 172.21.15.146:0/3225268801 shutdown_connections 2023-10-06T11:09:27.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.357+0000 7fa08bd0a700 1 --2- 172.21.15.146:0/3225268801 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa068066f30 0x7fa0680693e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:27.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.357+0000 7fa08bd0a700 1 --2- 172.21.15.146:0/3225268801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa08415e5f0 0x7fa08416dd70 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:27.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.357+0000 7fa08bd0a700 1 --2- 172.21.15.146:0/3225268801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0840c7810 0x7fa08414a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:27.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.357+0000 7fa08bd0a700 1 --2- 172.21.15.146:0/3225268801 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa084159f40 0x7fa08414ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:27.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.357+0000 7fa08bd0a700 1 -- 172.21.15.146:0/3225268801 >> 172.21.15.146:0/3225268801 conn(0x7fa08406f380 msgr2=0x7fa084069bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:27.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.357+0000 7fa08bd0a700 1 -- 172.21.15.146:0/3225268801 shutdown_connections 2023-10-06T11:09:27.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.357+0000 7fa08bd0a700 1 -- 172.21.15.146:0/3225268801 wait complete. 2023-10-06T11:09:27.371 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T11:09:27.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.487+0000 7f93a90d4700 1 Processor -- start 2023-10-06T11:09:27.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.487+0000 7f93a90d4700 1 -- start start 2023-10-06T11:09:27.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.488+0000 7f93a90d4700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93a40ceb50 0x7f93a40af5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:27.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.488+0000 7f93a90d4700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f93a40ac3b0 0x7f93a40ac800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:27.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.488+0000 7f93a90d4700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93a40ae550 con 0x7f93a40abfe0 2023-10-06T11:09:27.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.488+0000 7f93a90d4700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93a40ae830 con 0x7f93a40ac3b0 2023-10-06T11:09:27.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.488+0000 7f93a90d4700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a40aeb10 con 0x7f93a40ceb50 2023-10-06T11:09:27.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.488+0000 7f93a2d9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f93a40abfe0 0x7f93a40add00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36630/0 (socket says 172.21.15.146:36630) 2023-10-06T11:09:27.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.488+0000 7f93a2d9d700 1 -- 172.21.15.146:0/1034083387 learned_addr learned my addr 172.21.15.146:0/1034083387 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:27.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.488+0000 7f93a359e700 1 --2- 172.21.15.146:0/1034083387 >> v2:172.21.15.151:3300/0 conn(0x7f93a40ac3b0 0x7f93a40ac800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:27.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.488+0000 7f939a59c700 1 --2- 172.21.15.146:0/1034083387 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93a40ceb50 0x7f93a40af5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:27.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.488+0000 7f93a259c700 1 -- 172.21.15.146:0/1034083387 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3576130418 0 0) 0x7f93a40ae550 con 0x7f93a40abfe0 2023-10-06T11:09:27.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.488+0000 7f93a259c700 1 -- 172.21.15.146:0/1034083387 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9390003570 con 0x7f93a40abfe0 2023-10-06T11:09:27.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.489+0000 7f939a59c700 1 -- 172.21.15.146:0/1034083387 >> v2:172.21.15.151:3300/0 conn(0x7f93a40ac3b0 msgr2=0x7f93a40ac800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:27.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.489+0000 7f939a59c700 1 --2- 172.21.15.146:0/1034083387 >> v2:172.21.15.151:3300/0 conn(0x7f93a40ac3b0 0x7f93a40ac800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:27.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.489+0000 7f939a59c700 1 -- 172.21.15.146:0/1034083387 >> v1:172.21.15.146:6789/0 conn(0x7f93a40abfe0 legacy=0x7f93a40add00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:27.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.489+0000 7f939a59c700 1 -- 172.21.15.146:0/1034083387 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a40aedf0 con 0x7f93a40ceb50 2023-10-06T11:09:27.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.489+0000 7f93a359e700 1 --2- 172.21.15.146:0/1034083387 >> v2:172.21.15.151:3300/0 conn(0x7f93a40ac3b0 0x7f93a40ac800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:09:27.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.489+0000 7f939a59c700 1 --2- 172.21.15.146:0/1034083387 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93a40ceb50 0x7f93a40af5f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f938c0098e0 tx=0x7f938c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edd145d9d5408518 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:27.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.489+0000 7f93a259c700 1 -- 172.21.15.146:0/1034083387 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938c011630 con 0x7f93a40ceb50 2023-10-06T11:09:27.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.489+0000 7f93a259c700 1 -- 172.21.15.146:0/1034083387 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f938c011790 con 0x7f93a40ceb50 2023-10-06T11:09:27.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.489+0000 7f93a259c700 1 -- 172.21.15.146:0/1034083387 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938c011b30 con 0x7f93a40ceb50 2023-10-06T11:09:27.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.489+0000 7f93a90d4700 1 -- 172.21.15.146:0/1034083387 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93a40ceb50 msgr2=0x7f93a40af5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:27.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.489+0000 7f93a90d4700 1 --2- 172.21.15.146:0/1034083387 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93a40ceb50 0x7f93a40af5f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f938c0098e0 tx=0x7f938c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:09:27.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.489+0000 7f93a90d4700 1 -- 172.21.15.146:0/1034083387 shutdown_connections 2023-10-06T11:09:27.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.489+0000 7f93a90d4700 1 --2- 172.21.15.146:0/1034083387 >> v2:172.21.15.151:3300/0 conn(0x7f93a40ac3b0 0x7f93a40ac800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:27.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.489+0000 7f93a90d4700 1 --2- 172.21.15.146:0/1034083387 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93a40ceb50 0x7f93a40af5f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:27.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.489+0000 7f93a90d4700 1 -- 172.21.15.146:0/1034083387 >> 172.21.15.146:0/1034083387 conn(0x7f93a4067c50 msgr2=0x7f93a40ce440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:27.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.489+0000 7f93a90d4700 1 -- 172.21.15.146:0/1034083387 shutdown_connections 2023-10-06T11:09:27.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.490+0000 7f93a90d4700 1 -- 172.21.15.146:0/1034083387 wait complete. 2023-10-06T11:09:27.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.491+0000 7f93a90d4700 1 Processor -- start 2023-10-06T11:09:27.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.491+0000 7f93a90d4700 1 -- start start 2023-10-06T11:09:27.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.491+0000 7f93a90d4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93a40abfe0 0x7f93a414dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:27.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.491+0000 7f93a90d4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93a40ac3b0 0x7f93a4151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:27.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.491+0000 7f93a90d4700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93a40ceb50 0x7f93a415b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:27.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.491+0000 7f93a90d4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a40b3480 con 0x7f93a40ac3b0 2023-10-06T11:09:27.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.491+0000 7f93a90d4700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a415a760 con 0x7f93a40abfe0 2023-10-06T11:09:27.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.491+0000 7f93a90d4700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a415aa40 con 0x7f93a40ceb50 2023-10-06T11:09:27.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.492+0000 7f939a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93a40ac3b0 0x7f93a4151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:27.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.492+0000 7f939a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93a40ac3b0 0x7f93a4151fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41556/0 (socket says 172.21.15.146:41556) 2023-10-06T11:09:27.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.492+0000 7f939a59c700 1 -- 172.21.15.146:0/3471275036 learned_addr learned my addr 172.21.15.146:0/3471275036 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:27.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.492+0000 7f93a2d9d700 1 --2- 172.21.15.146:0/3471275036 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93a40abfe0 0x7f93a414dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:27.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.492+0000 7f93a359e700 1 --2- 172.21.15.146:0/3471275036 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93a40ceb50 0x7f93a415b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:27.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.492+0000 7f939a59c700 1 -- 172.21.15.146:0/3471275036 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93a40ceb50 msgr2=0x7f93a415b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:27.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.492+0000 7f939a59c700 1 --2- 172.21.15.146:0/3471275036 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93a40ceb50 0x7f93a415b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:27.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.492+0000 7f939a59c700 1 -- 172.21.15.146:0/3471275036 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93a40abfe0 msgr2=0x7f93a414dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:27.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.492+0000 7f939a59c700 1 --2- 172.21.15.146:0/3471275036 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93a40abfe0 0x7f93a414dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:27.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.492+0000 7f939a59c700 1 -- 172.21.15.146:0/3471275036 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f939c009a20 con 0x7f93a40ac3b0 2023-10-06T11:09:27.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.492+0000 7f939a59c700 1 --2- 172.21.15.146:0/3471275036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93a40ac3b0 0x7f93a4151fb0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f93a40aec50 tx=0x7f938c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:27.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.492+0000 7f939b7fe700 1 -- 172.21.15.146:0/3471275036 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938c01f070 con 0x7f93a40ac3b0 2023-10-06T11:09:27.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.492+0000 7f939b7fe700 1 -- 172.21.15.146:0/3471275036 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f938c011900 con 0x7f93a40ac3b0 2023-10-06T11:09:27.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.492+0000 7f93a90d4700 1 -- 172.21.15.146:0/3471275036 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f938c009420 con 0x7f93a40ac3b0 2023-10-06T11:09:27.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.492+0000 7f939b7fe700 1 -- 172.21.15.146:0/3471275036 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f938c023410 con 0x7f93a40ac3b0 2023-10-06T11:09:27.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.492+0000 7f93a90d4700 1 -- 172.21.15.146:0/3471275036 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93a414e510 con 0x7f93a40ac3b0 2023-10-06T11:09:27.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.493+0000 7f93a90d4700 1 -- 172.21.15.146:0/3471275036 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93a415a5c0 con 0x7f93a40ac3b0 2023-10-06T11:09:27.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.493+0000 7f939b7fe700 1 -- 172.21.15.146:0/3471275036 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f938c023800 con 0x7f93a40ac3b0 2023-10-06T11:09:27.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.494+0000 7f939b7fe700 1 --2- 172.21.15.146:0/3471275036 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9384066f30 0x7f93840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:27.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.494+0000 7f939b7fe700 1 -- 172.21.15.146:0/3471275036 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f938c085840 con 0x7f93a40ac3b0 2023-10-06T11:09:27.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.494+0000 7f93a2d9d700 1 --2- 172.21.15.146:0/3471275036 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9384066f30 0x7f93840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:27.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.494+0000 7f93a2d9d700 1 --2- 172.21.15.146:0/3471275036 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9384066f30 0x7f93840693e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f93940058d0 tx=0x7f9394009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:27.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.498+0000 7f939b7fe700 1 -- 172.21.15.146:0/3471275036 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f93a415a5c0 con 0x7f93a40ac3b0 2023-10-06T11:09:27.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.682+0000 7f93a90d4700 1 -- 172.21.15.146:0/3471275036 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f93a415a5c0 con 0x7f93a40ac3b0 2023-10-06T11:09:27.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.683+0000 7f939b7fe700 1 -- 172.21.15.146:0/3471275036 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v47) v1 ==== 104+0+11 (secure 0 0 0) 0x7f93a415a5c0 con 0x7f93a40ac3b0 2023-10-06T11:09:27.685 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2023-10-06T11:09:27.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.685+0000 7f93a90d4700 1 -- 172.21.15.146:0/3471275036 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9384066f30 msgr2=0x7f93840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:27.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.685+0000 7f93a90d4700 1 --2- 172.21.15.146:0/3471275036 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9384066f30 0x7f93840693e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f93940058d0 tx=0x7f9394009040 comp rx=0 tx=0).stop 2023-10-06T11:09:27.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.685+0000 7f93a90d4700 1 -- 172.21.15.146:0/3471275036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93a40ac3b0 msgr2=0x7f93a4151fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:27.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.685+0000 7f93a90d4700 1 --2- 172.21.15.146:0/3471275036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93a40ac3b0 0x7f93a4151fb0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f93a40aec50 tx=0x7f938c017000 comp rx=0 tx=0).stop 2023-10-06T11:09:27.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.685+0000 7f93a90d4700 1 -- 172.21.15.146:0/3471275036 shutdown_connections 2023-10-06T11:09:27.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.685+0000 7f93a90d4700 1 --2- 172.21.15.146:0/3471275036 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9384066f30 0x7f93840693e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:27.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.685+0000 7f93a90d4700 1 --2- 172.21.15.146:0/3471275036 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93a40ceb50 0x7f93a415b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:27.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.685+0000 7f93a90d4700 1 --2- 172.21.15.146:0/3471275036 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93a40abfe0 0x7f93a414dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:27.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.685+0000 7f93a90d4700 1 --2- 172.21.15.146:0/3471275036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f93a40ac3b0 0x7f93a4151fb0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:27.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.685+0000 7f93a90d4700 1 -- 172.21.15.146:0/3471275036 >> 172.21.15.146:0/3471275036 conn(0x7f93a4067c50 msgr2=0x7f93a4156ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:27.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.685+0000 7f93a90d4700 1 -- 172.21.15.146:0/3471275036 shutdown_connections 2023-10-06T11:09:27.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.685+0000 7f93a90d4700 1 -- 172.21.15.146:0/3471275036 wait complete. 2023-10-06T11:09:27.699 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T11:09:27.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.815+0000 7fcb9b82a700 1 Processor -- start 2023-10-06T11:09:27.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.815+0000 7fcb9b82a700 1 -- start start 2023-10-06T11:09:27.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.816+0000 7fcb9b82a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcb9415a160 0x7fcb940c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:27.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.816+0000 7fcb9b82a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb940cb950 0x7fcb940cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:27.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.816+0000 7fcb9b82a700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb940ae2a0 con 0x7fcb940ae730 2023-10-06T11:09:27.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.816+0000 7fcb9b82a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb9415a530 con 0x7fcb9415a160 2023-10-06T11:09:27.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.816+0000 7fcb9b82a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb940ad690 con 0x7fcb940cb950 2023-10-06T11:09:27.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.816+0000 7fcb995c6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcb9415a160 0x7fcb940c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:27.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.816+0000 7fcb995c6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcb9415a160 0x7fcb940c55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41562/0 (socket says 172.21.15.146:41562) 2023-10-06T11:09:27.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.816+0000 7fcb995c6700 1 -- 172.21.15.146:0/786374321 learned_addr learned my addr 172.21.15.146:0/786374321 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:27.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.816+0000 7fcb99dc7700 1 --2- 172.21.15.146:0/786374321 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb940cb950 0x7fcb940cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:27.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.816+0000 7fcb995c6700 1 -- 172.21.15.146:0/786374321 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb940cb950 msgr2=0x7fcb940cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:27.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.816+0000 7fcb995c6700 1 --2- 172.21.15.146:0/786374321 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb940cb950 0x7fcb940cbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:27.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.816+0000 7fcb995c6700 1 -- 172.21.15.146:0/786374321 >> v1:172.21.15.151:6789/0 conn(0x7fcb940ae730 legacy=0x7fcb940aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:27.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.816+0000 7fcb995c6700 1 -- 172.21.15.146:0/786374321 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb940ad970 con 0x7fcb9415a160 2023-10-06T11:09:27.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.816+0000 7fcb995c6700 1 --2- 172.21.15.146:0/786374321 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb9415a160 0x7fcb940c55a0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c009f70 tx=0x7fcb8c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=615591d1ec5c0724 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:27.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.816+0000 7fcb93fff700 1 -- 172.21.15.146:0/786374321 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c00e070 con 0x7fcb9415a160 2023-10-06T11:09:27.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.817+0000 7fcb93fff700 1 -- 172.21.15.146:0/786374321 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8c00ba20 con 0x7fcb9415a160 2023-10-06T11:09:27.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.817+0000 7fcb93fff700 1 -- 172.21.15.146:0/786374321 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8c0092e0 con 0x7fcb9415a160 2023-10-06T11:09:27.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.817+0000 7fcb9b82a700 1 -- 172.21.15.146:0/786374321 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb9415a160 msgr2=0x7fcb940c55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:27.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.817+0000 7fcb9b82a700 1 --2- 172.21.15.146:0/786374321 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb9415a160 0x7fcb940c55a0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c009f70 tx=0x7fcb8c009840 comp rx=0 tx=0).stop 2023-10-06T11:09:27.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.817+0000 7fcb9b82a700 1 -- 172.21.15.146:0/786374321 shutdown_connections 2023-10-06T11:09:27.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.817+0000 7fcb9b82a700 1 --2- 172.21.15.146:0/786374321 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb940cb950 0x7fcb940cbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:27.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.817+0000 7fcb9b82a700 1 --2- 172.21.15.146:0/786374321 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb9415a160 0x7fcb940c55a0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:27.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.817+0000 7fcb9b82a700 1 -- 172.21.15.146:0/786374321 >> 172.21.15.146:0/786374321 conn(0x7fcb9406f380 msgr2=0x7fcb940d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:27.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.817+0000 7fcb9b82a700 1 -- 172.21.15.146:0/786374321 shutdown_connections 2023-10-06T11:09:27.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.817+0000 7fcb9b82a700 1 -- 172.21.15.146:0/786374321 wait complete. 2023-10-06T11:09:27.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.818+0000 7fcb9b82a700 1 Processor -- start 2023-10-06T11:09:27.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.818+0000 7fcb9b82a700 1 -- start start 2023-10-06T11:09:27.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.819+0000 7fcb9b82a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb940ae730 0x7fcb9414f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:27.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.819+0000 7fcb9b82a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb940cb950 0x7fcb940c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:27.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.819+0000 7fcb9b82a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb9415a160 0x7fcb940c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:27.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.819+0000 7fcb9b82a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb940c9040 con 0x7fcb940cb950 2023-10-06T11:09:27.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.819+0000 7fcb9b82a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb940b47f0 con 0x7fcb940ae730 2023-10-06T11:09:27.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.819+0000 7fcb9b82a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb940b5090 con 0x7fcb9415a160 2023-10-06T11:09:27.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.819+0000 7fcb98dc5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb940cb950 0x7fcb940c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:27.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.819+0000 7fcb98dc5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb940cb950 0x7fcb940c7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41574/0 (socket says 172.21.15.146:41574) 2023-10-06T11:09:27.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.819+0000 7fcb98dc5700 1 -- 172.21.15.146:0/1447178153 learned_addr learned my addr 172.21.15.146:0/1447178153 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:27.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.819+0000 7fcb98dc5700 1 -- 172.21.15.146:0/1447178153 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb9415a160 msgr2=0x7fcb940c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:27.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.819+0000 7fcb98dc5700 1 --2- 172.21.15.146:0/1447178153 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb9415a160 0x7fcb940c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:27.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.819+0000 7fcb98dc5700 1 -- 172.21.15.146:0/1447178153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb940ae730 msgr2=0x7fcb9414f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:27.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.820+0000 7fcb98dc5700 1 --2- 172.21.15.146:0/1447178153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb940ae730 0x7fcb9414f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:27.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.820+0000 7fcb98dc5700 1 -- 172.21.15.146:0/1447178153 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb8c009ae0 con 0x7fcb940cb950 2023-10-06T11:09:27.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.820+0000 7fcb98dc5700 1 --2- 172.21.15.146:0/1447178153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb940cb950 0x7fcb940c7ac0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fcb8800c4e0 tx=0x7fcb8800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:27.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.820+0000 7fcb917fa700 1 -- 172.21.15.146:0/1447178153 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb88011590 con 0x7fcb940cb950 2023-10-06T11:09:27.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.820+0000 7fcb917fa700 1 -- 172.21.15.146:0/1447178153 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb88011710 con 0x7fcb940cb950 2023-10-06T11:09:27.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.820+0000 7fcb917fa700 1 -- 172.21.15.146:0/1447178153 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb88011ad0 con 0x7fcb940cb950 2023-10-06T11:09:27.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.820+0000 7fcb9b82a700 1 -- 172.21.15.146:0/1447178153 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb94152150 con 0x7fcb940cb950 2023-10-06T11:09:27.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.820+0000 7fcb9b82a700 1 -- 172.21.15.146:0/1447178153 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb940b4d20 con 0x7fcb940cb950 2023-10-06T11:09:27.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.821+0000 7fcb9b82a700 1 -- 172.21.15.146:0/1447178153 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb94068390 con 0x7fcb940cb950 2023-10-06T11:09:27.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.821+0000 7fcb917fa700 1 -- 172.21.15.146:0/1447178153 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcb88001020 con 0x7fcb940cb950 2023-10-06T11:09:27.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.822+0000 7fcb917fa700 1 --2- 172.21.15.146:0/1447178153 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcb80066f30 0x7fcb800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:27.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.822+0000 7fcb917fa700 1 -- 172.21.15.146:0/1447178153 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcb88083a50 con 0x7fcb940cb950 2023-10-06T11:09:27.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.822+0000 7fcb995c6700 1 --2- 172.21.15.146:0/1447178153 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcb80066f30 0x7fcb800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:27.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.822+0000 7fcb995c6700 1 --2- 172.21.15.146:0/1447178153 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcb80066f30 0x7fcb800693e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c009f70 tx=0x7fcb8c018000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:27.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:27.826+0000 7fcb917fa700 1 -- 172.21.15.146:0/1447178153 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb88050b60 con 0x7fcb940cb950 2023-10-06T11:09:28.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.008+0000 7fcb9b82a700 1 -- 172.21.15.146:0/1447178153 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcb940b5200 con 0x7fcb940cb950 2023-10-06T11:09:28.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.008+0000 7fcb917fa700 1 -- 172.21.15.146:0/1447178153 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v47) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcb88017070 con 0x7fcb940cb950 2023-10-06T11:09:28.010 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2023-10-06T11:09:28.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.010+0000 7fcb9b82a700 1 -- 172.21.15.146:0/1447178153 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcb80066f30 msgr2=0x7fcb800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:28.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.010+0000 7fcb9b82a700 1 --2- 172.21.15.146:0/1447178153 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcb80066f30 0x7fcb800693e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c009f70 tx=0x7fcb8c018000 comp rx=0 tx=0).stop 2023-10-06T11:09:28.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.010+0000 7fcb9b82a700 1 -- 172.21.15.146:0/1447178153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb940cb950 msgr2=0x7fcb940c7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:28.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.010+0000 7fcb9b82a700 1 --2- 172.21.15.146:0/1447178153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb940cb950 0x7fcb940c7ac0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fcb8800c4e0 tx=0x7fcb8800c8a0 comp rx=0 tx=0).stop 2023-10-06T11:09:28.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.011+0000 7fcb9b82a700 1 -- 172.21.15.146:0/1447178153 shutdown_connections 2023-10-06T11:09:28.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.011+0000 7fcb9b82a700 1 --2- 172.21.15.146:0/1447178153 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcb80066f30 0x7fcb800693e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:28.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.011+0000 7fcb9b82a700 1 --2- 172.21.15.146:0/1447178153 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb9415a160 0x7fcb940c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:28.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.011+0000 7fcb9b82a700 1 --2- 172.21.15.146:0/1447178153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb940ae730 0x7fcb9414f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:28.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.011+0000 7fcb9b82a700 1 --2- 172.21.15.146:0/1447178153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb940cb950 0x7fcb940c7ac0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:28.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.011+0000 7fcb9b82a700 1 -- 172.21.15.146:0/1447178153 >> 172.21.15.146:0/1447178153 conn(0x7fcb9406f380 msgr2=0x7fcb941526c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:28.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.011+0000 7fcb9b82a700 1 -- 172.21.15.146:0/1447178153 shutdown_connections 2023-10-06T11:09:28.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.011+0000 7fcb9b82a700 1 -- 172.21.15.146:0/1447178153 wait complete. 2023-10-06T11:09:28.024 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:09:28.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.137+0000 7f23c53e3700 1 Processor -- start 2023-10-06T11:09:28.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.137+0000 7f23c53e3700 1 -- start start 2023-10-06T11:09:28.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.138+0000 7f23c53e3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23c0153e80 0x7f23c015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:28.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.138+0000 7f23c53e3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23c015ac30 con 0x7f23c0068ba0 2023-10-06T11:09:28.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.138+0000 7f23c53e3700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23c00b4510 con 0x7f23c0153ab0 2023-10-06T11:09:28.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.138+0000 7f23c53e3700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c00b6530 con 0x7f23c0153e80 2023-10-06T11:09:28.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.138+0000 7f23b67fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f23c0068ba0 0x7f23c00b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36632/0 (socket says 172.21.15.146:36632) 2023-10-06T11:09:28.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.138+0000 7f23b67fc700 1 -- 172.21.15.146:0/3382901466 learned_addr learned my addr 172.21.15.146:0/3382901466 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:28.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.138+0000 7f23bf7fe700 1 --2- 172.21.15.146:0/3382901466 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23c0153e80 0x7f23c015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:28.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.138+0000 7f23be7fc700 1 -- 172.21.15.146:0/3382901466 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3073688182 0 0) 0x7f23a8001110 con 0x7f23c0068ba0 2023-10-06T11:09:28.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.138+0000 7f23be7fc700 1 -- 172.21.15.146:0/3382901466 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23ac003570 con 0x7f23c0068ba0 2023-10-06T11:09:28.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.139+0000 7f23be7fc700 1 -- 172.21.15.146:0/3382901466 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2678655636 0 0) 0x7f23c00b4510 con 0x7f23c0153ab0 2023-10-06T11:09:28.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.139+0000 7f23be7fc700 1 -- 172.21.15.146:0/3382901466 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23a8001110 con 0x7f23c0153ab0 2023-10-06T11:09:28.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.139+0000 7f23be7fc700 1 -- 172.21.15.146:0/3382901466 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1249529312 0 0) 0x7f23ac003570 con 0x7f23c0068ba0 2023-10-06T11:09:28.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.139+0000 7f23be7fc700 1 -- 172.21.15.146:0/3382901466 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23c0153e80 msgr2=0x7f23c015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:28.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.139+0000 7f23be7fc700 1 --2- 172.21.15.146:0/3382901466 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23c0153e80 0x7f23c015a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:28.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.139+0000 7f23be7fc700 1 -- 172.21.15.146:0/3382901466 >> v1:172.21.15.151:6789/0 conn(0x7f23c0153ab0 legacy=0x7f23c0068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:28.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.139+0000 7f23be7fc700 1 -- 172.21.15.146:0/3382901466 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c00b5c50 con 0x7f23c0068ba0 2023-10-06T11:09:28.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.139+0000 7f23be7fc700 1 -- 172.21.15.146:0/3382901466 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f23a8001600 con 0x7f23c0068ba0 2023-10-06T11:09:28.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.139+0000 7f23be7fc700 1 -- 172.21.15.146:0/3382901466 >> v1:172.21.15.146:6789/0 conn(0x7f23c0068ba0 legacy=0x7f23c00b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:28.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.139+0000 7f23be7fc700 1 --2- 172.21.15.146:0/3382901466 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23ac003c20 0x7f23ac004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:28.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.139+0000 7f23be7fc700 1 --2- 172.21.15.146:0/3382901466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23ac004810 0x7f23ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:28.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.139+0000 7f23be7fc700 1 --2- 172.21.15.146:0/3382901466 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23c0153e80 0x7f23ac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:28.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.139+0000 7f23be7fc700 1 -- 172.21.15.146:0/3382901466 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c00b6530 con 0x7f23ac003c20 2023-10-06T11:09:28.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.139+0000 7f23be7fc700 1 -- 172.21.15.146:0/3382901466 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac00bb40 con 0x7f23ac004810 2023-10-06T11:09:28.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.139+0000 7f23be7fc700 1 -- 172.21.15.146:0/3382901466 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac00bd00 con 0x7f23c0153e80 2023-10-06T11:09:28.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.139+0000 7f23beffd700 1 --2- 172.21.15.146:0/3382901466 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23ac003c20 0x7f23ac004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:28.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.139+0000 7f23b67fc700 1 --2- 172.21.15.146:0/3382901466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23ac004810 0x7f23ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:28.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.139+0000 7f23bf7fe700 1 --2- 172.21.15.146:0/3382901466 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23c0153e80 0x7f23ac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:28.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.139+0000 7f23beffd700 1 -- 172.21.15.146:0/3382901466 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23c0153e80 msgr2=0x7f23ac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:28.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.139+0000 7f23beffd700 1 --2- 172.21.15.146:0/3382901466 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23c0153e80 0x7f23ac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:28.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.139+0000 7f23beffd700 1 -- 172.21.15.146:0/3382901466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23ac004810 msgr2=0x7f23ac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:28.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.139+0000 7f23beffd700 1 --2- 172.21.15.146:0/3382901466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23ac004810 0x7f23ac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:28.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.139+0000 7f23beffd700 1 -- 172.21.15.146:0/3382901466 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23ac003570 con 0x7f23ac003c20 2023-10-06T11:09:28.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.139+0000 7f23bf7fe700 1 --2- 172.21.15.146:0/3382901466 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23c0153e80 0x7f23ac0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:28.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.139+0000 7f23beffd700 1 --2- 172.21.15.146:0/3382901466 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23ac003c20 0x7f23ac004010 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f23b0001a10 tx=0x7f23b0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ce4613397c2c8db server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:28.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.139+0000 7f23be7fc700 1 -- 172.21.15.146:0/3382901466 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b000c5d0 con 0x7f23ac003c20 2023-10-06T11:09:28.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.139+0000 7f23be7fc700 1 -- 172.21.15.146:0/3382901466 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b000c730 con 0x7f23ac003c20 2023-10-06T11:09:28.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.139+0000 7f23be7fc700 1 -- 172.21.15.146:0/3382901466 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b000cad0 con 0x7f23ac003c20 2023-10-06T11:09:28.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.140+0000 7f23c53e3700 1 -- 172.21.15.146:0/3382901466 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23ac003c20 msgr2=0x7f23ac004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:28.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.140+0000 7f23c53e3700 1 --2- 172.21.15.146:0/3382901466 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23ac003c20 0x7f23ac004010 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f23b0001a10 tx=0x7f23b0007d30 comp rx=0 tx=0).stop 2023-10-06T11:09:28.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.140+0000 7f23bf7fe700 1 -- 172.21.15.146:0/3382901466 reap_dead start 2023-10-06T11:09:28.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.140+0000 7f23c53e3700 1 -- 172.21.15.146:0/3382901466 shutdown_connections 2023-10-06T11:09:28.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.140+0000 7f23c53e3700 1 -- 172.21.15.146:0/3382901466 >> 172.21.15.146:0/3382901466 conn(0x7f23c006eba0 msgr2=0x7f23c006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:28.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.140+0000 7f23c53e3700 1 -- 172.21.15.146:0/3382901466 shutdown_connections 2023-10-06T11:09:28.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.140+0000 7f23c53e3700 1 -- 172.21.15.146:0/3382901466 wait complete. 2023-10-06T11:09:28.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.141+0000 7f23c53e3700 1 Processor -- start 2023-10-06T11:09:28.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.141+0000 7f23c53e3700 1 -- start start 2023-10-06T11:09:28.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.142+0000 7f23c53e3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23ac003c20 0x7f23c0150000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:28.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.142+0000 7f23c53e3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23c00b16f0 0x7f23c0154320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:28.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.142+0000 7f23c53e3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23c015c080 0x7f23c015c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:28.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.142+0000 7f23c53e3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c015ca60 con 0x7f23c015c080 2023-10-06T11:09:28.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.142+0000 7f23c53e3700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c01578d0 con 0x7f23c00b16f0 2023-10-06T11:09:28.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.142+0000 7f23c53e3700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c0150540 con 0x7f23ac003c20 2023-10-06T11:09:28.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.142+0000 7f23bf7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23c015c080 0x7f23c015c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:28.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.142+0000 7f23bf7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23c015c080 0x7f23c015c520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41604/0 (socket says 172.21.15.146:41604) 2023-10-06T11:09:28.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.142+0000 7f23bf7fe700 1 -- 172.21.15.146:0/3419880023 learned_addr learned my addr 172.21.15.146:0/3419880023 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:28.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.142+0000 7f23bf7fe700 1 -- 172.21.15.146:0/3419880023 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23ac003c20 msgr2=0x7f23c0150000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:28.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.142+0000 7f23bf7fe700 1 --2- 172.21.15.146:0/3419880023 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23ac003c20 0x7f23c0150000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:28.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.142+0000 7f23bf7fe700 1 -- 172.21.15.146:0/3419880023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23c00b16f0 msgr2=0x7f23c0154320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:28.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.142+0000 7f23b67fc700 1 --2- 172.21.15.146:0/3419880023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23c00b16f0 0x7f23c0154320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:28.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.142+0000 7f23bf7fe700 1 --2- 172.21.15.146:0/3419880023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23c00b16f0 0x7f23c0154320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:28.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.142+0000 7f23bf7fe700 1 -- 172.21.15.146:0/3419880023 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c0154b70 con 0x7f23c015c080 2023-10-06T11:09:28.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.143+0000 7f23bf7fe700 1 --2- 172.21.15.146:0/3419880023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23c015c080 0x7f23c015c520 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f23c006fa70 tx=0x7f23b800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:28.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.143+0000 7f23b77fe700 1 -- 172.21.15.146:0/3419880023 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b801b070 con 0x7f23c015c080 2023-10-06T11:09:28.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.143+0000 7f23b77fe700 1 -- 172.21.15.146:0/3419880023 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b800f040 con 0x7f23c015c080 2023-10-06T11:09:28.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.143+0000 7f23b77fe700 1 -- 172.21.15.146:0/3419880023 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b800e050 con 0x7f23c015c080 2023-10-06T11:09:28.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.143+0000 7f23c53e3700 1 -- 172.21.15.146:0/3419880023 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23c0154e50 con 0x7f23c015c080 2023-10-06T11:09:28.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.143+0000 7f23c53e3700 1 -- 172.21.15.146:0/3419880023 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23c0157560 con 0x7f23c015c080 2023-10-06T11:09:28.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.144+0000 7f23c53e3700 1 -- 172.21.15.146:0/3419880023 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23c01573c0 con 0x7f23c015c080 2023-10-06T11:09:28.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.144+0000 7f23b77fe700 1 -- 172.21.15.146:0/3419880023 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f23b8003020 con 0x7f23c015c080 2023-10-06T11:09:28.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.144+0000 7f23b77fe700 1 --2- 172.21.15.146:0/3419880023 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f23a0066f30 0x7f23a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:28.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.145+0000 7f23b77fe700 1 -- 172.21.15.146:0/3419880023 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f23b8084c00 con 0x7f23c015c080 2023-10-06T11:09:28.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.145+0000 7f23beffd700 1 --2- 172.21.15.146:0/3419880023 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f23a0066f30 0x7f23a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:28.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.145+0000 7f23beffd700 1 --2- 172.21.15.146:0/3419880023 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f23a0066f30 0x7f23a00693e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f23b0008fd0 tx=0x7f23b0015000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:28.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.149+0000 7f23b77fe700 1 -- 172.21.15.146:0/3419880023 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f23c01573c0 con 0x7f23c015c080 2023-10-06T11:09:28.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.374+0000 7f23c53e3700 1 -- 172.21.15.146:0/3419880023 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23c01573c0 con 0x7f23c015c080 2023-10-06T11:09:28.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.375+0000 7f23b77fe700 1 -- 172.21.15.146:0/3419880023 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4610 (secure 0 0 0) 0x7f23c01573c0 con 0x7f23c015c080 2023-10-06T11:09:28.377 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:09:28.377 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":40,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5248,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3360977916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3360977916},{"type":"v1","addr":"172.21.15.151:6834","nonce":3360977916}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5251,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2265934004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":2265934004},{"type":"v1","addr":"172.21.15.151:6835","nonce":2265934004}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2387575667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2387575667},{"type":"v1","addr":"172.21.15.146:6836","nonce":2387575667}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:08:42.797557+0000","modified":"2023-10-06T11:09:27.617786+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5481":{"gid":5481,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6837/2252184844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2252184844},{"type":"v1","addr":"172.21.15.146:6837","nonce":2252184844}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T11:09:28.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.377+0000 7f23c53e3700 1 -- 172.21.15.146:0/3419880023 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f23a0066f30 msgr2=0x7f23a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:28.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.377+0000 7f23c53e3700 1 --2- 172.21.15.146:0/3419880023 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f23a0066f30 0x7f23a00693e0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f23b0008fd0 tx=0x7f23b0015000 comp rx=0 tx=0).stop 2023-10-06T11:09:28.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.377+0000 7f23c53e3700 1 -- 172.21.15.146:0/3419880023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23c015c080 msgr2=0x7f23c015c520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:28.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.377+0000 7f23c53e3700 1 --2- 172.21.15.146:0/3419880023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23c015c080 0x7f23c015c520 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f23c006fa70 tx=0x7f23b800b040 comp rx=0 tx=0).stop 2023-10-06T11:09:28.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.377+0000 7f23c53e3700 1 -- 172.21.15.146:0/3419880023 shutdown_connections 2023-10-06T11:09:28.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.377+0000 7f23c53e3700 1 --2- 172.21.15.146:0/3419880023 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f23a0066f30 0x7f23a00693e0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:28.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.377+0000 7f23c53e3700 1 --2- 172.21.15.146:0/3419880023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23c015c080 0x7f23c015c520 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:28.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.377+0000 7f23c53e3700 1 --2- 172.21.15.146:0/3419880023 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23ac003c20 0x7f23c0150000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:28.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.377+0000 7f23c53e3700 1 --2- 172.21.15.146:0/3419880023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23c00b16f0 0x7f23c0154320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:28.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.377+0000 7f23c53e3700 1 -- 172.21.15.146:0/3419880023 >> 172.21.15.146:0/3419880023 conn(0x7f23c006eba0 msgr2=0x7f23c0151df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:28.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.377+0000 7f23c53e3700 1 -- 172.21.15.146:0/3419880023 shutdown_connections 2023-10-06T11:09:28.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.377+0000 7f23c53e3700 1 -- 172.21.15.146:0/3419880023 wait complete. 2023-10-06T11:09:28.380 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 40 2023-10-06T11:09:28.391 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:09:28.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.504+0000 7fe1b1a2a700 1 Processor -- start 2023-10-06T11:09:28.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.505+0000 7fe1b1a2a700 1 -- start start 2023-10-06T11:09:28.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.505+0000 7fe1b1a2a700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe1ac068ba0 0x7fe1ac15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:28.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.505+0000 7fe1b1a2a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe1ac153e80 0x7fe1ac0b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:28.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.505+0000 7fe1b1a2a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1ac15ac30 con 0x7fe1ac153ab0 2023-10-06T11:09:28.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.505+0000 7fe1b1a2a700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1ac0b4510 con 0x7fe1ac068ba0 2023-10-06T11:09:28.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.505+0000 7fe1b1a2a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac0b6530 con 0x7fe1ac153e80 2023-10-06T11:09:28.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.505+0000 7fe1aaffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe1ac153ab0 0x7fe1ac068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36648/0 (socket says 172.21.15.146:36648) 2023-10-06T11:09:28.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.505+0000 7fe1aaffd700 1 -- 172.21.15.146:0/610355290 learned_addr learned my addr 172.21.15.146:0/610355290 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:28.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.506+0000 7fe1aa7fc700 1 -- 172.21.15.146:0/610355290 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3656113072 0 0) 0x7fe19c001110 con 0x7fe1ac153ab0 2023-10-06T11:09:28.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.506+0000 7fe1aa7fc700 1 -- 172.21.15.146:0/610355290 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe198003570 con 0x7fe1ac153ab0 2023-10-06T11:09:28.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.506+0000 7fe1a27fc700 1 --2- 172.21.15.146:0/610355290 >> v2:172.21.15.151:3300/0 conn(0x7fe1ac068ba0 0x7fe1ac15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:28.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.506+0000 7fe1ab7fe700 1 --2- 172.21.15.146:0/610355290 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe1ac153e80 0x7fe1ac0b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:28.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.506+0000 7fe1aa7fc700 1 -- 172.21.15.146:0/610355290 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2713535427 0 0) 0x7fe198003570 con 0x7fe1ac153ab0 2023-10-06T11:09:28.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.506+0000 7fe1aa7fc700 1 -- 172.21.15.146:0/610355290 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe1ac153e80 msgr2=0x7fe1ac0b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:28.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.506+0000 7fe1aa7fc700 1 --2- 172.21.15.146:0/610355290 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe1ac153e80 0x7fe1ac0b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:28.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.506+0000 7fe1aa7fc700 1 -- 172.21.15.146:0/610355290 >> v2:172.21.15.151:3300/0 conn(0x7fe1ac068ba0 msgr2=0x7fe1ac15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:28.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.506+0000 7fe1aa7fc700 1 --2- 172.21.15.146:0/610355290 >> v2:172.21.15.151:3300/0 conn(0x7fe1ac068ba0 0x7fe1ac15a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:28.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.506+0000 7fe1aa7fc700 1 -- 172.21.15.146:0/610355290 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ac0b5c50 con 0x7fe1ac153ab0 2023-10-06T11:09:28.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.506+0000 7fe1aa7fc700 1 -- 172.21.15.146:0/610355290 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fe19c001600 con 0x7fe1ac153ab0 2023-10-06T11:09:28.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.506+0000 7fe1aa7fc700 1 -- 172.21.15.146:0/610355290 >> v1:172.21.15.146:6789/0 conn(0x7fe1ac153ab0 legacy=0x7fe1ac068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:28.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.506+0000 7fe1aa7fc700 1 --2- 172.21.15.146:0/610355290 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe198003a60 0x7fe198003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:28.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.506+0000 7fe1aa7fc700 1 --2- 172.21.15.146:0/610355290 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe198004810 0x7fe198004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:28.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.506+0000 7fe1aa7fc700 1 --2- 172.21.15.146:0/610355290 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe1ac153e80 0x7fe1980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:28.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.506+0000 7fe1aa7fc700 1 -- 172.21.15.146:0/610355290 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac0b4510 con 0x7fe198004810 2023-10-06T11:09:28.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.506+0000 7fe1aa7fc700 1 -- 172.21.15.146:0/610355290 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac0b6530 con 0x7fe198003a60 2023-10-06T11:09:28.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.506+0000 7fe1aa7fc700 1 -- 172.21.15.146:0/610355290 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe19800ba60 con 0x7fe1ac153e80 2023-10-06T11:09:28.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.506+0000 7fe1a27fc700 1 --2- 172.21.15.146:0/610355290 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe198004810 0x7fe198004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:28.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.506+0000 7fe1aaffd700 1 --2- 172.21.15.146:0/610355290 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe198003a60 0x7fe198003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:28.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.506+0000 7fe1a27fc700 1 -- 172.21.15.146:0/610355290 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe1ac153e80 msgr2=0x7fe1980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:28.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.506+0000 7fe1ab7fe700 1 --2- 172.21.15.146:0/610355290 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe1ac153e80 0x7fe1980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:28.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.507+0000 7fe1a27fc700 1 --2- 172.21.15.146:0/610355290 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe1ac153e80 0x7fe1980051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:28.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.507+0000 7fe1a27fc700 1 -- 172.21.15.146:0/610355290 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe198003a60 msgr2=0x7fe198003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:28.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.507+0000 7fe1a27fc700 1 --2- 172.21.15.146:0/610355290 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe198003a60 0x7fe198003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:28.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.507+0000 7fe1a27fc700 1 -- 172.21.15.146:0/610355290 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe198003570 con 0x7fe198004810 2023-10-06T11:09:28.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.507+0000 7fe1ab7fe700 1 --2- 172.21.15.146:0/610355290 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe1ac153e80 0x7fe1980051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:09:28.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.507+0000 7fe1aaffd700 1 --2- 172.21.15.146:0/610355290 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe198003a60 0x7fe198003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:28.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.507+0000 7fe1a27fc700 1 --2- 172.21.15.146:0/610355290 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe198004810 0x7fe198004c80 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fe194009c00 tx=0x7fe1940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ea2d5816e53bf7b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:28.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.507+0000 7fe1aa7fc700 1 -- 172.21.15.146:0/610355290 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19400e710 con 0x7fe198004810 2023-10-06T11:09:28.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.507+0000 7fe1aa7fc700 1 -- 172.21.15.146:0/610355290 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe19400e870 con 0x7fe198004810 2023-10-06T11:09:28.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.507+0000 7fe1aa7fc700 1 -- 172.21.15.146:0/610355290 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe19400ec30 con 0x7fe198004810 2023-10-06T11:09:28.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.508+0000 7fe1b1a2a700 1 -- 172.21.15.146:0/610355290 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe198004810 msgr2=0x7fe198004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:28.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.508+0000 7fe1b1a2a700 1 --2- 172.21.15.146:0/610355290 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe198004810 0x7fe198004c80 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fe194009c00 tx=0x7fe1940091a0 comp rx=0 tx=0).stop 2023-10-06T11:09:28.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.508+0000 7fe1ab7fe700 1 -- 172.21.15.146:0/610355290 reap_dead start 2023-10-06T11:09:28.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.508+0000 7fe1b1a2a700 1 -- 172.21.15.146:0/610355290 shutdown_connections 2023-10-06T11:09:28.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.508+0000 7fe1b1a2a700 1 -- 172.21.15.146:0/610355290 >> 172.21.15.146:0/610355290 conn(0x7fe1ac06eba0 msgr2=0x7fe1ac06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:28.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.508+0000 7fe1b1a2a700 1 -- 172.21.15.146:0/610355290 shutdown_connections 2023-10-06T11:09:28.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.508+0000 7fe1b1a2a700 1 -- 172.21.15.146:0/610355290 wait complete. 2023-10-06T11:09:28.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.509+0000 7fe1b1a2a700 1 Processor -- start 2023-10-06T11:09:28.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.509+0000 7fe1b1a2a700 1 -- start start 2023-10-06T11:09:28.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.510+0000 7fe1b1a2a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe198004810 0x7fe1ac0c55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:28.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.510+0000 7fe1b1a2a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe1ac140c20 0x7fe1ac141090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:28.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.510+0000 7fe1b1a2a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1ac1561a0 0x7fe1ac156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:28.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.510+0000 7fe1b1a2a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac1415d0 con 0x7fe1ac1561a0 2023-10-06T11:09:28.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.510+0000 7fe1b1a2a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac1586e0 con 0x7fe198004810 2023-10-06T11:09:28.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.510+0000 7fe1b1a2a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1ac157df0 con 0x7fe1ac140c20 2023-10-06T11:09:28.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.510+0000 7fe1ab7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1ac1561a0 0x7fe1ac156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:28.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.510+0000 7fe1ab7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1ac1561a0 0x7fe1ac156620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41624/0 (socket says 172.21.15.146:41624) 2023-10-06T11:09:28.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.510+0000 7fe1ab7fe700 1 -- 172.21.15.146:0/1929080833 learned_addr learned my addr 172.21.15.146:0/1929080833 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:28.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.510+0000 7fe1aaffd700 1 --2- 172.21.15.146:0/1929080833 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe198004810 0x7fe1ac0c55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:28.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.510+0000 7fe1a27fc700 1 --2- 172.21.15.146:0/1929080833 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe1ac140c20 0x7fe1ac141090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:28.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.510+0000 7fe1ab7fe700 1 -- 172.21.15.146:0/1929080833 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe1ac140c20 msgr2=0x7fe1ac141090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:28.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.510+0000 7fe1ab7fe700 1 --2- 172.21.15.146:0/1929080833 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe1ac140c20 0x7fe1ac141090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:28.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.510+0000 7fe1ab7fe700 1 -- 172.21.15.146:0/1929080833 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe198004810 msgr2=0x7fe1ac0c55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:28.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.510+0000 7fe1ab7fe700 1 --2- 172.21.15.146:0/1929080833 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe198004810 0x7fe1ac0c55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:28.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.510+0000 7fe1ab7fe700 1 -- 172.21.15.146:0/1929080833 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ac158090 con 0x7fe1ac1561a0 2023-10-06T11:09:28.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.511+0000 7fe1ab7fe700 1 --2- 172.21.15.146:0/1929080833 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1ac1561a0 0x7fe1ac156620 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac0ce6b0 tx=0x7fe1a400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:28.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.511+0000 7fe1a37fe700 1 -- 172.21.15.146:0/1929080833 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a400fc80 con 0x7fe1ac1561a0 2023-10-06T11:09:28.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.511+0000 7fe1a37fe700 1 -- 172.21.15.146:0/1929080833 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a400fde0 con 0x7fe1ac1561a0 2023-10-06T11:09:28.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.511+0000 7fe1a37fe700 1 -- 172.21.15.146:0/1929080833 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a4016650 con 0x7fe1ac1561a0 2023-10-06T11:09:28.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.511+0000 7fe1b1a2a700 1 -- 172.21.15.146:0/1929080833 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1ac158370 con 0x7fe1ac1561a0 2023-10-06T11:09:28.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.511+0000 7fe1b1a2a700 1 -- 172.21.15.146:0/1929080833 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1ac156b60 con 0x7fe1ac1561a0 2023-10-06T11:09:28.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.512+0000 7fe1b1a2a700 1 -- 172.21.15.146:0/1929080833 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1ac158890 con 0x7fe1ac1561a0 2023-10-06T11:09:28.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.512+0000 7fe1a37fe700 1 -- 172.21.15.146:0/1929080833 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe1a40169c0 con 0x7fe1ac1561a0 2023-10-06T11:09:28.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.513+0000 7fe1a37fe700 1 --2- 172.21.15.146:0/1929080833 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe18c066f30 0x7fe18c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:28.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.513+0000 7fe1aaffd700 1 --2- 172.21.15.146:0/1929080833 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe18c066f30 0x7fe18c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:28.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.513+0000 7fe1a37fe700 1 -- 172.21.15.146:0/1929080833 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe1a4085140 con 0x7fe1ac1561a0 2023-10-06T11:09:28.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.513+0000 7fe1aaffd700 1 --2- 172.21.15.146:0/1929080833 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe18c066f30 0x7fe18c0693e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe19c0012b0 tx=0x7fe19c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:28.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.517+0000 7fe1a37fe700 1 -- 172.21.15.146:0/1929080833 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe1ac158890 con 0x7fe1ac1561a0 2023-10-06T11:09:28.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.707+0000 7fe1b1a2a700 1 -- 172.21.15.146:0/1929080833 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1ac158850 con 0x7fe1ac1561a0 2023-10-06T11:09:28.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.707+0000 7fe1a37fe700 1 -- 172.21.15.146:0/1929080833 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16914 (secure 0 0 0) 0x7fe1a4052250 con 0x7fe1ac1561a0 2023-10-06T11:09:28.709 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:09:28.709 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":47,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:08:44.410124+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:08:40.456040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-06T11:08:41.764122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:09:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.710+0000 7fe1b1a2a700 1 -- 172.21.15.146:0/1929080833 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe18c066f30 msgr2=0x7fe18c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.710+0000 7fe1b1a2a700 1 --2- 172.21.15.146:0/1929080833 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe18c066f30 0x7fe18c0693e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe19c0012b0 tx=0x7fe19c009040 comp rx=0 tx=0).stop 2023-10-06T11:09:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.710+0000 7fe1b1a2a700 1 -- 172.21.15.146:0/1929080833 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1ac1561a0 msgr2=0x7fe1ac156620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.710+0000 7fe1b1a2a700 1 --2- 172.21.15.146:0/1929080833 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1ac1561a0 0x7fe1ac156620 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac0ce6b0 tx=0x7fe1a400b040 comp rx=0 tx=0).stop 2023-10-06T11:09:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.710+0000 7fe1b1a2a700 1 -- 172.21.15.146:0/1929080833 shutdown_connections 2023-10-06T11:09:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.710+0000 7fe1b1a2a700 1 --2- 172.21.15.146:0/1929080833 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe18c066f30 0x7fe18c0693e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.710+0000 7fe1b1a2a700 1 --2- 172.21.15.146:0/1929080833 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe1ac1561a0 0x7fe1ac156620 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.710+0000 7fe1b1a2a700 1 --2- 172.21.15.146:0/1929080833 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe198004810 0x7fe1ac0c55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.710+0000 7fe1b1a2a700 1 --2- 172.21.15.146:0/1929080833 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe1ac140c20 0x7fe1ac141090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.710+0000 7fe1b1a2a700 1 -- 172.21.15.146:0/1929080833 >> 172.21.15.146:0/1929080833 conn(0x7fe1ac06eba0 msgr2=0x7fe1ac0cf1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.710+0000 7fe1b1a2a700 1 -- 172.21.15.146:0/1929080833 shutdown_connections 2023-10-06T11:09:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.710+0000 7fe1b1a2a700 1 -- 172.21.15.146:0/1929080833 wait complete. 2023-10-06T11:09:28.724 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T11:09:28.725 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:09:28.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.837+0000 7f8e11e77700 1 Processor -- start 2023-10-06T11:09:28.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.837+0000 7f8e11e77700 1 -- start start 2023-10-06T11:09:28.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.838+0000 7f8e11e77700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e0c153ab0 0x7f8e0c15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:28.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.838+0000 7f8e11e77700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e0c15ac30 con 0x7f8e0c068ba0 2023-10-06T11:09:28.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.838+0000 7f8e11e77700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e0c0b4510 con 0x7f8e0c153e80 2023-10-06T11:09:28.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.838+0000 7f8e11e77700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0c0b6530 con 0x7f8e0c153ab0 2023-10-06T11:09:28.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.838+0000 7f8e0bfff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8e0c068ba0 0x7f8e0c0b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36654/0 (socket says 172.21.15.146:36654) 2023-10-06T11:09:28.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.838+0000 7f8e0bfff700 1 -- 172.21.15.146:0/536943574 learned_addr learned my addr 172.21.15.146:0/536943574 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:28.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.839+0000 7f8e0b7fe700 1 --2- 172.21.15.146:0/536943574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e0c153ab0 0x7f8e0c15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:28.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.839+0000 7f8e0a7fc700 1 -- 172.21.15.146:0/536943574 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2144775247 0 0) 0x7f8e04001110 con 0x7f8e0c068ba0 2023-10-06T11:09:28.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.839+0000 7f8e0a7fc700 1 -- 172.21.15.146:0/536943574 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8df4003570 con 0x7f8e0c068ba0 2023-10-06T11:09:28.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.839+0000 7f8e0a7fc700 1 -- 172.21.15.146:0/536943574 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 952003640 0 0) 0x7f8df4003570 con 0x7f8e0c068ba0 2023-10-06T11:09:28.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.839+0000 7f8e0a7fc700 1 -- 172.21.15.146:0/536943574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e0c153ab0 msgr2=0x7f8e0c15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:28.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.839+0000 7f8e0a7fc700 1 --2- 172.21.15.146:0/536943574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e0c153ab0 0x7f8e0c15a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:28.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.839+0000 7f8e0a7fc700 1 -- 172.21.15.146:0/536943574 >> v1:172.21.15.151:6789/0 conn(0x7f8e0c153e80 legacy=0x7f8e0c068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:28.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.839+0000 7f8e0a7fc700 1 -- 172.21.15.146:0/536943574 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e0c0b5c50 con 0x7f8e0c068ba0 2023-10-06T11:09:28.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.839+0000 7f8e0a7fc700 1 -- 172.21.15.146:0/536943574 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f8e04001600 con 0x7f8e0c068ba0 2023-10-06T11:09:28.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.839+0000 7f8e0a7fc700 1 -- 172.21.15.146:0/536943574 >> v1:172.21.15.146:6789/0 conn(0x7f8e0c068ba0 legacy=0x7f8e0c0b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:28.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.839+0000 7f8e0a7fc700 1 --2- 172.21.15.146:0/536943574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8df4003a90 0x7f8df4003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:28.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.839+0000 7f8e0a7fc700 1 --2- 172.21.15.146:0/536943574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e0c153ab0 0x7f8df4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:28.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.839+0000 7f8e0a7fc700 1 --2- 172.21.15.146:0/536943574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8df4004d50 0x7f8df40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:28.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.839+0000 7f8e0a7fc700 1 -- 172.21.15.146:0/536943574 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0c0b6530 con 0x7f8df4004d50 2023-10-06T11:09:28.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.839+0000 7f8e0a7fc700 1 -- 172.21.15.146:0/536943574 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df400bb10 con 0x7f8df4003a90 2023-10-06T11:09:28.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.839+0000 7f8e0a7fc700 1 -- 172.21.15.146:0/536943574 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df400bcd0 con 0x7f8e0c153ab0 2023-10-06T11:09:28.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.839+0000 7f8e0bfff700 1 --2- 172.21.15.146:0/536943574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8df4004d50 0x7f8df40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:28.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.839+0000 7f8e0b7fe700 1 --2- 172.21.15.146:0/536943574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8df4003a90 0x7f8df4003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:28.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.839+0000 7f8e0affd700 1 --2- 172.21.15.146:0/536943574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e0c153ab0 0x7f8df4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:28.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.839+0000 7f8e0bfff700 1 -- 172.21.15.146:0/536943574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e0c153ab0 msgr2=0x7f8df4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:28.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.839+0000 7f8e0bfff700 1 --2- 172.21.15.146:0/536943574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e0c153ab0 0x7f8df4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:28.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.839+0000 7f8e0bfff700 1 -- 172.21.15.146:0/536943574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8df4003a90 msgr2=0x7f8df4003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:28.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.839+0000 7f8e0bfff700 1 --2- 172.21.15.146:0/536943574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8df4003a90 0x7f8df4003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:28.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.839+0000 7f8e0bfff700 1 -- 172.21.15.146:0/536943574 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df4003570 con 0x7f8df4004d50 2023-10-06T11:09:28.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.839+0000 7f8e0b7fe700 1 --2- 172.21.15.146:0/536943574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8df4003a90 0x7f8df4003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:28.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.840+0000 7f8e0bfff700 1 --2- 172.21.15.146:0/536943574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8df4004d50 0x7f8df40051c0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c068fa0 tx=0x7f8e0c159c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b6bc9e8d57c5f32 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:28.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.840+0000 7f8e0a7fc700 1 -- 172.21.15.146:0/536943574 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0400cd60 con 0x7f8df4004d50 2023-10-06T11:09:28.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.840+0000 7f8e0a7fc700 1 -- 172.21.15.146:0/536943574 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e04005920 con 0x7f8df4004d50 2023-10-06T11:09:28.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.840+0000 7f8e0a7fc700 1 -- 172.21.15.146:0/536943574 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e04005cc0 con 0x7f8df4004d50 2023-10-06T11:09:28.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.840+0000 7f8e11e77700 1 -- 172.21.15.146:0/536943574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8df4004d50 msgr2=0x7f8df40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:28.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.840+0000 7f8e11e77700 1 --2- 172.21.15.146:0/536943574 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8df4004d50 0x7f8df40051c0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c068fa0 tx=0x7f8e0c159c70 comp rx=0 tx=0).stop 2023-10-06T11:09:28.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.840+0000 7f8e0bfff700 1 -- 172.21.15.146:0/536943574 reap_dead start 2023-10-06T11:09:28.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.840+0000 7f8e11e77700 1 -- 172.21.15.146:0/536943574 shutdown_connections 2023-10-06T11:09:28.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.840+0000 7f8e11e77700 1 -- 172.21.15.146:0/536943574 >> 172.21.15.146:0/536943574 conn(0x7f8e0c06eba0 msgr2=0x7f8e0c06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:28.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.840+0000 7f8e11e77700 1 -- 172.21.15.146:0/536943574 shutdown_connections 2023-10-06T11:09:28.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.840+0000 7f8e11e77700 1 -- 172.21.15.146:0/536943574 wait complete. 2023-10-06T11:09:28.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.842+0000 7f8e11e77700 1 Processor -- start 2023-10-06T11:09:28.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.842+0000 7f8e11e77700 1 -- start start 2023-10-06T11:09:28.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.842+0000 7f8e11e77700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8df4004d50 0x7f8e0c169ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:28.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.842+0000 7f8e11e77700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e0c154470 0x7f8e0c0cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:28.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.842+0000 7f8e11e77700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e0c16a1e0 0x7f8e0c0d0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:28.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.842+0000 7f8e11e77700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0c16ac70 con 0x7f8e0c16a1e0 2023-10-06T11:09:28.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.842+0000 7f8e11e77700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0c1589d0 con 0x7f8e0c154470 2023-10-06T11:09:28.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.842+0000 7f8e11e77700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0c158f70 con 0x7f8df4004d50 2023-10-06T11:09:28.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.842+0000 7f8e0bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e0c16a1e0 0x7f8e0c0d0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:28.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.842+0000 7f8e0bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e0c16a1e0 0x7f8e0c0d0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41640/0 (socket says 172.21.15.146:41640) 2023-10-06T11:09:28.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.842+0000 7f8e0bfff700 1 -- 172.21.15.146:0/1405201965 learned_addr learned my addr 172.21.15.146:0/1405201965 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:28.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.843+0000 7f8e0b7fe700 1 --2- 172.21.15.146:0/1405201965 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8df4004d50 0x7f8e0c169ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:28.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.843+0000 7f8e0affd700 1 --2- 172.21.15.146:0/1405201965 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e0c154470 0x7f8e0c0cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:28.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.843+0000 7f8e0bfff700 1 -- 172.21.15.146:0/1405201965 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8df4004d50 msgr2=0x7f8e0c169ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:28.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.843+0000 7f8e0bfff700 1 --2- 172.21.15.146:0/1405201965 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8df4004d50 0x7f8e0c169ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:28.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.843+0000 7f8e0bfff700 1 -- 172.21.15.146:0/1405201965 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e0c154470 msgr2=0x7f8e0c0cfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:28.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.843+0000 7f8e0bfff700 1 --2- 172.21.15.146:0/1405201965 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e0c154470 0x7f8e0c0cfe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:28.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.843+0000 7f8e0bfff700 1 -- 172.21.15.146:0/1405201965 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e0c16a6b0 con 0x7f8e0c16a1e0 2023-10-06T11:09:28.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.843+0000 7f8e0affd700 1 --2- 172.21.15.146:0/1405201965 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e0c154470 0x7f8e0c0cfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:28.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.843+0000 7f8e0b7fe700 1 --2- 172.21.15.146:0/1405201965 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8df4004d50 0x7f8e0c169ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:28.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.843+0000 7f8e0bfff700 1 --2- 172.21.15.146:0/1405201965 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e0c16a1e0 0x7f8e0c0d0350 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f8e04007e50 tx=0x7f8e04015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:28.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.843+0000 7f8df37fe700 1 -- 172.21.15.146:0/1405201965 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e04001130 con 0x7f8e0c16a1e0 2023-10-06T11:09:28.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.843+0000 7f8df37fe700 1 -- 172.21.15.146:0/1405201965 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e040072e0 con 0x7f8e0c16a1e0 2023-10-06T11:09:28.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.843+0000 7f8e11e77700 1 -- 172.21.15.146:0/1405201965 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e0c16a990 con 0x7f8e0c16a1e0 2023-10-06T11:09:28.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.843+0000 7f8df37fe700 1 -- 172.21.15.146:0/1405201965 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e040076c0 con 0x7f8e0c16a1e0 2023-10-06T11:09:28.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.843+0000 7f8e11e77700 1 -- 172.21.15.146:0/1405201965 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e0c154950 con 0x7f8e0c16a1e0 2023-10-06T11:09:28.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.844+0000 7f8e11e77700 1 -- 172.21.15.146:0/1405201965 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e0c154c00 con 0x7f8e0c16a1e0 2023-10-06T11:09:28.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.844+0000 7f8df37fe700 1 -- 172.21.15.146:0/1405201965 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8e0401e640 con 0x7f8e0c16a1e0 2023-10-06T11:09:28.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.845+0000 7f8df37fe700 1 --2- 172.21.15.146:0/1405201965 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8df8066f30 0x7f8df80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:28.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.845+0000 7f8df37fe700 1 -- 172.21.15.146:0/1405201965 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8e04085a60 con 0x7f8e0c16a1e0 2023-10-06T11:09:28.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.845+0000 7f8e0b7fe700 1 --2- 172.21.15.146:0/1405201965 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8df8066f30 0x7f8df80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:28.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.845+0000 7f8e0b7fe700 1 --2- 172.21.15.146:0/1405201965 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8df8066f30 0x7f8df80693e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c0b2c40 tx=0x7f8dfc00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:28.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:28.849+0000 7f8df37fe700 1 -- 172.21.15.146:0/1405201965 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8e0c154c00 con 0x7f8e0c16a1e0 2023-10-06T11:09:29.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.073+0000 7f8e11e77700 1 -- 172.21.15.146:0/1405201965 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e0c154c00 con 0x7f8e0c16a1e0 2023-10-06T11:09:29.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.074+0000 7f8df37fe700 1 -- 172.21.15.146:0/1405201965 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4610 (secure 0 0 0) 0x7f8e0c154c00 con 0x7f8e0c16a1e0 2023-10-06T11:09:29.076 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:09:29.076 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":40,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5248,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3360977916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3360977916},{"type":"v1","addr":"172.21.15.151:6834","nonce":3360977916}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5251,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2265934004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":2265934004},{"type":"v1","addr":"172.21.15.151:6835","nonce":2265934004}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2387575667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2387575667},{"type":"v1","addr":"172.21.15.146:6836","nonce":2387575667}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:08:42.797557+0000","modified":"2023-10-06T11:09:27.617786+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5481":{"gid":5481,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6837/2252184844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2252184844},{"type":"v1","addr":"172.21.15.146:6837","nonce":2252184844}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T11:09:29.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.076+0000 7f8e11e77700 1 -- 172.21.15.146:0/1405201965 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8df8066f30 msgr2=0x7f8df80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:29.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.076+0000 7f8e11e77700 1 --2- 172.21.15.146:0/1405201965 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8df8066f30 0x7f8df80693e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8e0c0b2c40 tx=0x7f8dfc00b040 comp rx=0 tx=0).stop 2023-10-06T11:09:29.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.076+0000 7f8e11e77700 1 -- 172.21.15.146:0/1405201965 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e0c16a1e0 msgr2=0x7f8e0c0d0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:29.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.076+0000 7f8e11e77700 1 --2- 172.21.15.146:0/1405201965 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e0c16a1e0 0x7f8e0c0d0350 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f8e04007e50 tx=0x7f8e04015000 comp rx=0 tx=0).stop 2023-10-06T11:09:29.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.076+0000 7f8e11e77700 1 -- 172.21.15.146:0/1405201965 shutdown_connections 2023-10-06T11:09:29.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.076+0000 7f8e11e77700 1 --2- 172.21.15.146:0/1405201965 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8df8066f30 0x7f8df80693e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:29.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.076+0000 7f8e11e77700 1 --2- 172.21.15.146:0/1405201965 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e0c16a1e0 0x7f8e0c0d0350 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:29.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.076+0000 7f8e11e77700 1 --2- 172.21.15.146:0/1405201965 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8df4004d50 0x7f8e0c169ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:29.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.076+0000 7f8e11e77700 1 --2- 172.21.15.146:0/1405201965 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e0c154470 0x7f8e0c0cfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:29.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.076+0000 7f8e11e77700 1 -- 172.21.15.146:0/1405201965 >> 172.21.15.146:0/1405201965 conn(0x7f8e0c06eba0 msgr2=0x7f8e0c151e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:29.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.076+0000 7f8e11e77700 1 -- 172.21.15.146:0/1405201965 shutdown_connections 2023-10-06T11:09:29.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.076+0000 7f8e11e77700 1 -- 172.21.15.146:0/1405201965 wait complete. 2023-10-06T11:09:29.079 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 40 2023-10-06T11:09:29.090 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:09:29.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.203+0000 7fae5bc66700 1 Processor -- start 2023-10-06T11:09:29.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.203+0000 7fae5bc66700 1 -- start start 2023-10-06T11:09:29.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.204+0000 7fae5bc66700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fae54157430 0x7fae54157800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:29.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.204+0000 7fae5bc66700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae540ab010 0x7fae540ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:29.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.204+0000 7fae5bc66700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae540cf0b0 con 0x7fae540cc240 2023-10-06T11:09:29.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.204+0000 7fae5bc66700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae540c3dd0 con 0x7fae54157430 2023-10-06T11:09:29.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.204+0000 7fae5bc66700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae540ccf20 con 0x7fae540ab010 2023-10-06T11:09:29.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.205+0000 7fae5a203700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fae540cc240 0x7fae540cc6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36658/0 (socket says 172.21.15.146:36658) 2023-10-06T11:09:29.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.205+0000 7fae5a203700 1 -- 172.21.15.146:0/1626322622 learned_addr learned my addr 172.21.15.146:0/1626322622 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:29.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.205+0000 7fae59a02700 1 --2- 172.21.15.146:0/1626322622 >> v2:172.21.15.151:3300/0 conn(0x7fae54157430 0x7fae54157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:29.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.205+0000 7fae59201700 1 --2- 172.21.15.146:0/1626322622 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae540ab010 0x7fae540ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:29.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.205+0000 7fae58a00700 1 -- 172.21.15.146:0/1626322622 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 451904174 0 0) 0x7fae540cf0b0 con 0x7fae540cc240 2023-10-06T11:09:29.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.205+0000 7fae58a00700 1 -- 172.21.15.146:0/1626322622 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae40003570 con 0x7fae540cc240 2023-10-06T11:09:29.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.205+0000 7fae58a00700 1 -- 172.21.15.146:0/1626322622 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1417351046 0 0) 0x7fae40003570 con 0x7fae540cc240 2023-10-06T11:09:29.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.205+0000 7fae58a00700 1 -- 172.21.15.146:0/1626322622 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae540ab010 msgr2=0x7fae540ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:29.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.205+0000 7fae58a00700 1 --2- 172.21.15.146:0/1626322622 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae540ab010 0x7fae540ceb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:29.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.205+0000 7fae58a00700 1 -- 172.21.15.146:0/1626322622 >> v2:172.21.15.151:3300/0 conn(0x7fae54157430 msgr2=0x7fae54157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:29.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.205+0000 7fae58a00700 1 --2- 172.21.15.146:0/1626322622 >> v2:172.21.15.151:3300/0 conn(0x7fae54157430 0x7fae54157800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:29.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.205+0000 7fae58a00700 1 -- 172.21.15.146:0/1626322622 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae540cd200 con 0x7fae540cc240 2023-10-06T11:09:29.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.205+0000 7fae58a00700 1 -- 172.21.15.146:0/1626322622 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fae4c0017f0 con 0x7fae540cc240 2023-10-06T11:09:29.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.205+0000 7fae58a00700 1 -- 172.21.15.146:0/1626322622 >> v1:172.21.15.146:6789/0 conn(0x7fae540cc240 legacy=0x7fae540cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:29.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.205+0000 7fae58a00700 1 --2- 172.21.15.146:0/1626322622 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae40003a60 0x7fae40003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:29.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.205+0000 7fae58a00700 1 --2- 172.21.15.146:0/1626322622 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae540ab010 0x7fae40004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:29.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.205+0000 7fae58a00700 1 --2- 172.21.15.146:0/1626322622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae40004d50 0x7fae400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:29.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.205+0000 7fae58a00700 1 -- 172.21.15.146:0/1626322622 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae540c3dd0 con 0x7fae40004d50 2023-10-06T11:09:29.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.205+0000 7fae58a00700 1 -- 172.21.15.146:0/1626322622 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae540ccf20 con 0x7fae40003a60 2023-10-06T11:09:29.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.205+0000 7fae58a00700 1 -- 172.21.15.146:0/1626322622 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae4000ba60 con 0x7fae540ab010 2023-10-06T11:09:29.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.205+0000 7fae5a203700 1 --2- 172.21.15.146:0/1626322622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae40004d50 0x7fae400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:29.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.205+0000 7fae59201700 1 --2- 172.21.15.146:0/1626322622 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae540ab010 0x7fae40004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:29.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.205+0000 7fae59a02700 1 --2- 172.21.15.146:0/1626322622 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae40003a60 0x7fae40003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:29.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.206+0000 7fae5a203700 1 -- 172.21.15.146:0/1626322622 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae540ab010 msgr2=0x7fae40004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:29.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.206+0000 7fae5a203700 1 --2- 172.21.15.146:0/1626322622 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae540ab010 0x7fae40004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:29.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.206+0000 7fae5a203700 1 -- 172.21.15.146:0/1626322622 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae40003a60 msgr2=0x7fae40003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:29.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.206+0000 7fae5a203700 1 --2- 172.21.15.146:0/1626322622 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae40003a60 0x7fae40003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:29.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.206+0000 7fae5a203700 1 -- 172.21.15.146:0/1626322622 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae40003570 con 0x7fae40004d50 2023-10-06T11:09:29.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.206+0000 7fae5a203700 1 --2- 172.21.15.146:0/1626322622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae40004d50 0x7fae400051c0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fae4c00a970 tx=0x7fae4c002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca3b702c5f98924b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:29.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.206+0000 7fae58a00700 1 -- 172.21.15.146:0/1626322622 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4c012440 con 0x7fae40004d50 2023-10-06T11:09:29.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.206+0000 7fae58a00700 1 -- 172.21.15.146:0/1626322622 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4c0125c0 con 0x7fae40004d50 2023-10-06T11:09:29.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.206+0000 7fae58a00700 1 -- 172.21.15.146:0/1626322622 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4c012980 con 0x7fae40004d50 2023-10-06T11:09:29.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.207+0000 7fae5bc66700 1 -- 172.21.15.146:0/1626322622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae40004d50 msgr2=0x7fae400051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:29.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.207+0000 7fae5bc66700 1 --2- 172.21.15.146:0/1626322622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae40004d50 0x7fae400051c0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fae4c00a970 tx=0x7fae4c002210 comp rx=0 tx=0).stop 2023-10-06T11:09:29.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.207+0000 7fae5a203700 1 -- 172.21.15.146:0/1626322622 reap_dead start 2023-10-06T11:09:29.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.207+0000 7fae5bc66700 1 -- 172.21.15.146:0/1626322622 shutdown_connections 2023-10-06T11:09:29.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.207+0000 7fae5bc66700 1 -- 172.21.15.146:0/1626322622 >> 172.21.15.146:0/1626322622 conn(0x7fae54067c50 msgr2=0x7fae540ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:29.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.207+0000 7fae5bc66700 1 -- 172.21.15.146:0/1626322622 shutdown_connections 2023-10-06T11:09:29.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.207+0000 7fae5bc66700 1 -- 172.21.15.146:0/1626322622 wait complete. 2023-10-06T11:09:29.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.208+0000 7fae5bc66700 1 Processor -- start 2023-10-06T11:09:29.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.208+0000 7fae5bc66700 1 -- start start 2023-10-06T11:09:29.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.209+0000 7fae5bc66700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae40004d50 0x7fae54167650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:29.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.209+0000 7fae5bc66700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae5416ac80 0x7fae54168850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:29.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.209+0000 7fae5bc66700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae5406ca50 0x7fae540b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:29.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.209+0000 7fae5bc66700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5416b0f0 con 0x7fae40004d50 2023-10-06T11:09:29.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.209+0000 7fae5bc66700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae540c6610 con 0x7fae5406ca50 2023-10-06T11:09:29.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.209+0000 7fae5bc66700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae5416bbb0 con 0x7fae5416ac80 2023-10-06T11:09:29.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.209+0000 7fae59a02700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae40004d50 0x7fae54167650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:29.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.209+0000 7fae59a02700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae40004d50 0x7fae54167650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41658/0 (socket says 172.21.15.146:41658) 2023-10-06T11:09:29.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.209+0000 7fae59a02700 1 -- 172.21.15.146:0/2744850453 learned_addr learned my addr 172.21.15.146:0/2744850453 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:29.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.209+0000 7fae5a203700 1 --2- 172.21.15.146:0/2744850453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae5406ca50 0x7fae540b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:29.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.209+0000 7fae59201700 1 --2- 172.21.15.146:0/2744850453 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae5416ac80 0x7fae54168850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:29.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.209+0000 7fae59a02700 1 -- 172.21.15.146:0/2744850453 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae5416ac80 msgr2=0x7fae54168850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:29.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.209+0000 7fae59a02700 1 --2- 172.21.15.146:0/2744850453 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae5416ac80 0x7fae54168850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:29.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.209+0000 7fae59a02700 1 -- 172.21.15.146:0/2744850453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae5406ca50 msgr2=0x7fae540b34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:29.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.209+0000 7fae59a02700 1 --2- 172.21.15.146:0/2744850453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae5406ca50 0x7fae540b34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:29.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.209+0000 7fae59a02700 1 -- 172.21.15.146:0/2744850453 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae540c68d0 con 0x7fae40004d50 2023-10-06T11:09:29.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.209+0000 7fae59a02700 1 --2- 172.21.15.146:0/2744850453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae40004d50 0x7fae54167650 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fae50011b10 tx=0x7fae500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:29.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.209+0000 7fae49ffb700 1 -- 172.21.15.146:0/2744850453 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5000f940 con 0x7fae40004d50 2023-10-06T11:09:29.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.209+0000 7fae49ffb700 1 -- 172.21.15.146:0/2744850453 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae5000faa0 con 0x7fae40004d50 2023-10-06T11:09:29.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.209+0000 7fae49ffb700 1 -- 172.21.15.146:0/2744850453 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5000fe20 con 0x7fae40004d50 2023-10-06T11:09:29.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.209+0000 7fae5bc66700 1 -- 172.21.15.146:0/2744850453 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae54159750 con 0x7fae40004d50 2023-10-06T11:09:29.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.209+0000 7fae5bc66700 1 -- 172.21.15.146:0/2744850453 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae5416b5f0 con 0x7fae40004d50 2023-10-06T11:09:29.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.210+0000 7fae5bc66700 1 -- 172.21.15.146:0/2744850453 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae5404c380 con 0x7fae40004d50 2023-10-06T11:09:29.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.211+0000 7fae49ffb700 1 -- 172.21.15.146:0/2744850453 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fae50014650 con 0x7fae40004d50 2023-10-06T11:09:29.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.211+0000 7fae49ffb700 1 --2- 172.21.15.146:0/2744850453 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fae38066f30 0x7fae380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:29.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.211+0000 7fae49ffb700 1 -- 172.21.15.146:0/2744850453 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fae50018030 con 0x7fae40004d50 2023-10-06T11:09:29.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.211+0000 7fae59201700 1 --2- 172.21.15.146:0/2744850453 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fae38066f30 0x7fae380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:29.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.212+0000 7fae59201700 1 --2- 172.21.15.146:0/2744850453 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fae38066f30 0x7fae380693e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fae540c4e60 tx=0x7fae440091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:29.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.215+0000 7fae49ffb700 1 -- 172.21.15.146:0/2744850453 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fae50052050 con 0x7fae40004d50 2023-10-06T11:09:29.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.438+0000 7fae5bc66700 1 -- 172.21.15.146:0/2744850453 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fae540cd4e0 con 0x7fae40004d50 2023-10-06T11:09:29.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.438+0000 7fae49ffb700 1 -- 172.21.15.146:0/2744850453 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4610 (secure 0 0 0) 0x7fae50022090 con 0x7fae40004d50 2023-10-06T11:09:29.440 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:09:29.441 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":40,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5248,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3360977916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3360977916},{"type":"v1","addr":"172.21.15.151:6834","nonce":3360977916}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5251,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2265934004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":2265934004},{"type":"v1","addr":"172.21.15.151:6835","nonce":2265934004}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2387575667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2387575667},{"type":"v1","addr":"172.21.15.146:6836","nonce":2387575667}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:08:42.797557+0000","modified":"2023-10-06T11:09:27.617786+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5481},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5481":{"gid":5481,"name":"c","rank":0,"incarnation":31,"state":"up:active","state_seq":14,"addr":"172.21.15.146:6837/2252184844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2252184844},{"type":"v1","addr":"172.21.15.146:6837","nonce":2252184844}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2023-10-06T11:09:29.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.440+0000 7fae5bc66700 1 -- 172.21.15.146:0/2744850453 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fae38066f30 msgr2=0x7fae380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:29.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.440+0000 7fae5bc66700 1 --2- 172.21.15.146:0/2744850453 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fae38066f30 0x7fae380693e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fae540c4e60 tx=0x7fae440091a0 comp rx=0 tx=0).stop 2023-10-06T11:09:29.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.440+0000 7fae5bc66700 1 -- 172.21.15.146:0/2744850453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae40004d50 msgr2=0x7fae54167650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:29.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.440+0000 7fae5bc66700 1 --2- 172.21.15.146:0/2744850453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae40004d50 0x7fae54167650 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fae50011b10 tx=0x7fae500091a0 comp rx=0 tx=0).stop 2023-10-06T11:09:29.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.440+0000 7fae5bc66700 1 -- 172.21.15.146:0/2744850453 shutdown_connections 2023-10-06T11:09:29.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.440+0000 7fae5bc66700 1 --2- 172.21.15.146:0/2744850453 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fae38066f30 0x7fae380693e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:29.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.440+0000 7fae5bc66700 1 --2- 172.21.15.146:0/2744850453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae5406ca50 0x7fae540b34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:29.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.440+0000 7fae5bc66700 1 --2- 172.21.15.146:0/2744850453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae40004d50 0x7fae54167650 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:29.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.440+0000 7fae5bc66700 1 --2- 172.21.15.146:0/2744850453 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae5416ac80 0x7fae54168850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:29.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.440+0000 7fae5bc66700 1 -- 172.21.15.146:0/2744850453 >> 172.21.15.146:0/2744850453 conn(0x7fae54067c50 msgr2=0x7fae54153e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:29.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.440+0000 7fae5bc66700 1 -- 172.21.15.146:0/2744850453 shutdown_connections 2023-10-06T11:09:29.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.440+0000 7fae5bc66700 1 -- 172.21.15.146:0/2744850453 wait complete. 2023-10-06T11:09:29.444 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 40 2023-10-06T11:09:29.455 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:09:29.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.568+0000 7f11ff7d1700 1 Processor -- start 2023-10-06T11:09:29.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.568+0000 7f11ff7d1700 1 -- start start 2023-10-06T11:09:29.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.569+0000 7f11ff7d1700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f11f80b28e0 0x7f11f80c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:29.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.569+0000 7f11ff7d1700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11f80ad2a0 con 0x7f11f80cf2d0 2023-10-06T11:09:29.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.569+0000 7f11ff7d1700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11f8099ec0 con 0x7f11f80c53f0 2023-10-06T11:09:29.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.569+0000 7f11ff7d1700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11f80c7240 con 0x7f11f80b28e0 2023-10-06T11:09:29.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.569+0000 7f11fdd6e700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f11f80cf2d0 0x7f11f80ad730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36670/0 (socket says 172.21.15.146:36670) 2023-10-06T11:09:29.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.569+0000 7f11fdd6e700 1 -- 172.21.15.146:0/3374730125 learned_addr learned my addr 172.21.15.146:0/3374730125 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:29.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.569+0000 7f11effff700 1 -- 172.21.15.146:0/3374730125 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 848214992 0 0) 0x7f11f80ad2a0 con 0x7f11f80cf2d0 2023-10-06T11:09:29.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.569+0000 7f11fd56d700 1 --2- 172.21.15.146:0/3374730125 >> v2:172.21.15.151:3300/0 conn(0x7f11f80b28e0 0x7f11f80c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:29.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.569+0000 7f11effff700 1 -- 172.21.15.146:0/3374730125 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11e4003570 con 0x7f11f80cf2d0 2023-10-06T11:09:29.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.569+0000 7f11effff700 1 -- 172.21.15.146:0/3374730125 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2464322396 0 0) 0x7f11e4003570 con 0x7f11f80cf2d0 2023-10-06T11:09:29.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.569+0000 7f11effff700 1 -- 172.21.15.146:0/3374730125 >> v2:172.21.15.151:3300/0 conn(0x7f11f80b28e0 msgr2=0x7f11f80c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:29.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.569+0000 7f11effff700 1 --2- 172.21.15.146:0/3374730125 >> v2:172.21.15.151:3300/0 conn(0x7f11f80b28e0 0x7f11f80c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:29.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.569+0000 7f11effff700 1 -- 172.21.15.146:0/3374730125 >> v1:172.21.15.151:6789/0 conn(0x7f11f80c53f0 legacy=0x7f11f80cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:29.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.569+0000 7f11effff700 1 -- 172.21.15.146:0/3374730125 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f80c69a0 con 0x7f11f80cf2d0 2023-10-06T11:09:29.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.569+0000 7f11effff700 1 -- 172.21.15.146:0/3374730125 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f11f00017f0 con 0x7f11f80cf2d0 2023-10-06T11:09:29.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.569+0000 7f11effff700 1 -- 172.21.15.146:0/3374730125 >> v1:172.21.15.146:6789/0 conn(0x7f11f80cf2d0 legacy=0x7f11f80ad730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:29.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.570+0000 7f11effff700 1 --2- 172.21.15.146:0/3374730125 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11e4003a60 0x7f11e4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:29.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.570+0000 7f11effff700 1 --2- 172.21.15.146:0/3374730125 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11e4004810 0x7f11e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:29.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.570+0000 7f11effff700 1 --2- 172.21.15.146:0/3374730125 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11e40051c0 0x7f11e400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:29.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.570+0000 7f11effff700 1 -- 172.21.15.146:0/3374730125 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f80c7240 con 0x7f11e4004810 2023-10-06T11:09:29.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.570+0000 7f11effff700 1 -- 172.21.15.146:0/3374730125 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e400c0d0 con 0x7f11e40051c0 2023-10-06T11:09:29.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.570+0000 7f11effff700 1 -- 172.21.15.146:0/3374730125 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e400c290 con 0x7f11e4003a60 2023-10-06T11:09:29.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.570+0000 7f11fcd6c700 1 --2- 172.21.15.146:0/3374730125 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11e4004810 0x7f11e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:29.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.570+0000 7f11fd56d700 1 --2- 172.21.15.146:0/3374730125 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11e4003a60 0x7f11e4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:29.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.570+0000 7f11fdd6e700 1 --2- 172.21.15.146:0/3374730125 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11e40051c0 0x7f11e400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:29.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.570+0000 7f11fcd6c700 1 -- 172.21.15.146:0/3374730125 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11e4003a60 msgr2=0x7f11e4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:29.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.570+0000 7f11fcd6c700 1 --2- 172.21.15.146:0/3374730125 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11e4003a60 0x7f11e4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:29.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.570+0000 7f11fcd6c700 1 -- 172.21.15.146:0/3374730125 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11e40051c0 msgr2=0x7f11e400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:29.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.570+0000 7f11fcd6c700 1 --2- 172.21.15.146:0/3374730125 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11e40051c0 0x7f11e400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:29.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.570+0000 7f11fcd6c700 1 -- 172.21.15.146:0/3374730125 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e4003570 con 0x7f11e4004810 2023-10-06T11:09:29.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.570+0000 7f11fdd6e700 1 --2- 172.21.15.146:0/3374730125 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11e40051c0 0x7f11e400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:29.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.570+0000 7f11fd56d700 1 --2- 172.21.15.146:0/3374730125 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11e4003a60 0x7f11e4003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:29.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.570+0000 7f11fdd6e700 1 -- 172.21.15.146:0/3374730125 reap_dead start 2023-10-06T11:09:29.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.570+0000 7f11fcd6c700 1 --2- 172.21.15.146:0/3374730125 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11e4004810 0x7f11e4004c80 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f11e80018b0 tx=0x7f11e8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e8ccd44c1beba78 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:29.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.570+0000 7f11effff700 1 -- 172.21.15.146:0/3374730125 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e8012420 con 0x7f11e4004810 2023-10-06T11:09:29.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.570+0000 7f11effff700 1 -- 172.21.15.146:0/3374730125 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e80125a0 con 0x7f11e4004810 2023-10-06T11:09:29.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.570+0000 7f11effff700 1 -- 172.21.15.146:0/3374730125 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e8012960 con 0x7f11e4004810 2023-10-06T11:09:29.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.571+0000 7f11ff7d1700 1 -- 172.21.15.146:0/3374730125 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11e4004810 msgr2=0x7f11e4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:29.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.571+0000 7f11ff7d1700 1 --2- 172.21.15.146:0/3374730125 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11e4004810 0x7f11e4004c80 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f11e80018b0 tx=0x7f11e8007d30 comp rx=0 tx=0).stop 2023-10-06T11:09:29.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.571+0000 7f11ff7d1700 1 -- 172.21.15.146:0/3374730125 shutdown_connections 2023-10-06T11:09:29.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.571+0000 7f11ff7d1700 1 --2- 172.21.15.146:0/3374730125 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11e4004810 0x7f11e4004c80 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:29.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.571+0000 7f11ff7d1700 1 -- 172.21.15.146:0/3374730125 >> 172.21.15.146:0/3374730125 conn(0x7f11f80999a0 msgr2=0x7f11f806f380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:29.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.571+0000 7f11ff7d1700 1 -- 172.21.15.146:0/3374730125 shutdown_connections 2023-10-06T11:09:29.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.571+0000 7f11ff7d1700 1 -- 172.21.15.146:0/3374730125 wait complete. 2023-10-06T11:09:29.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.572+0000 7f11ff7d1700 1 Processor -- start 2023-10-06T11:09:29.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.572+0000 7f11ff7d1700 1 -- start start 2023-10-06T11:09:29.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.573+0000 7f11ff7d1700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11e4004810 0x7f11f81481e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:29.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.573+0000 7f11ff7d1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11f80c9470 0x7f11f816d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:29.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.573+0000 7f11ff7d1700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11f80ccab0 0x7f11f80ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:29.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.573+0000 7f11ff7d1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f80cd490 con 0x7f11f80c9470 2023-10-06T11:09:29.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.573+0000 7f11ff7d1700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f80b3be0 con 0x7f11f80ccab0 2023-10-06T11:09:29.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.573+0000 7f11ff7d1700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11f80c99e0 con 0x7f11e4004810 2023-10-06T11:09:29.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.573+0000 7f11fcd6c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11f80c9470 0x7f11f816d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:29.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.573+0000 7f11fcd6c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11f80c9470 0x7f11f816d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41668/0 (socket says 172.21.15.146:41668) 2023-10-06T11:09:29.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.573+0000 7f11fcd6c700 1 -- 172.21.15.146:0/713446911 learned_addr learned my addr 172.21.15.146:0/713446911 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:29.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.573+0000 7f11fd56d700 1 --2- 172.21.15.146:0/713446911 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11e4004810 0x7f11f81481e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:29.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.573+0000 7f11fdd6e700 1 --2- 172.21.15.146:0/713446911 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11f80ccab0 0x7f11f80ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:29.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.573+0000 7f11fcd6c700 1 -- 172.21.15.146:0/713446911 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11e4004810 msgr2=0x7f11f81481e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:29.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.573+0000 7f11fcd6c700 1 --2- 172.21.15.146:0/713446911 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11e4004810 0x7f11f81481e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:29.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.573+0000 7f11fcd6c700 1 -- 172.21.15.146:0/713446911 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11f80ccab0 msgr2=0x7f11f80ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:29.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.573+0000 7f11fcd6c700 1 --2- 172.21.15.146:0/713446911 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11f80ccab0 0x7f11f80ccf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:29.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.573+0000 7f11fcd6c700 1 -- 172.21.15.146:0/713446911 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f80b3590 con 0x7f11f80c9470 2023-10-06T11:09:29.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.573+0000 7f11fcd6c700 1 --2- 172.21.15.146:0/713446911 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11f80c9470 0x7f11f816d6f0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f11e800c3f0 tx=0x7f11e8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:29.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.573+0000 7f11ed7fa700 1 -- 172.21.15.146:0/713446911 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e800c800 con 0x7f11f80c9470 2023-10-06T11:09:29.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.573+0000 7f11ed7fa700 1 -- 172.21.15.146:0/713446911 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e800c960 con 0x7f11f80c9470 2023-10-06T11:09:29.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.573+0000 7f11ff7d1700 1 -- 172.21.15.146:0/713446911 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11f80b3870 con 0x7f11f80c9470 2023-10-06T11:09:29.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.573+0000 7f11ed7fa700 1 -- 172.21.15.146:0/713446911 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e800cd00 con 0x7f11f80c9470 2023-10-06T11:09:29.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.573+0000 7f11ff7d1700 1 -- 172.21.15.146:0/713446911 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11f80c7700 con 0x7f11f80c9470 2023-10-06T11:09:29.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.574+0000 7f11ff7d1700 1 -- 172.21.15.146:0/713446911 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11f80b33f0 con 0x7f11f80c9470 2023-10-06T11:09:29.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.575+0000 7f11ed7fa700 1 -- 172.21.15.146:0/713446911 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f11e801f620 con 0x7f11f80c9470 2023-10-06T11:09:29.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.575+0000 7f11ed7fa700 1 --2- 172.21.15.146:0/713446911 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f11dc066f30 0x7f11dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:29.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.575+0000 7f11ed7fa700 1 -- 172.21.15.146:0/713446911 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f11e8085e60 con 0x7f11f80c9470 2023-10-06T11:09:29.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.575+0000 7f11fd56d700 1 --2- 172.21.15.146:0/713446911 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f11dc066f30 0x7f11dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:29.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.575+0000 7f11fd56d700 1 --2- 172.21.15.146:0/713446911 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f11dc066f30 0x7f11dc0693e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f11f804cc00 tx=0x7f11f4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:29.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.579+0000 7f11ed7fa700 1 -- 172.21.15.146:0/713446911 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f11f80b33f0 con 0x7f11f80c9470 2023-10-06T11:09:29.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.764+0000 7f11ff7d1700 1 -- 172.21.15.146:0/713446911 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11f80b33f0 con 0x7f11f80c9470 2023-10-06T11:09:29.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.765+0000 7f11ed7fa700 1 -- 172.21.15.146:0/713446911 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16914 (secure 0 0 0) 0x7f11f80b33f0 con 0x7f11f80c9470 2023-10-06T11:09:29.767 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:09:29.767 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":47,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:08:44.410124+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:08:40.456040+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2023-10-06T11:08:41.764122+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:09:29.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.767+0000 7f11ff7d1700 1 -- 172.21.15.146:0/713446911 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f11dc066f30 msgr2=0x7f11dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:29.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.767+0000 7f11ff7d1700 1 --2- 172.21.15.146:0/713446911 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f11dc066f30 0x7f11dc0693e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f11f804cc00 tx=0x7f11f4008040 comp rx=0 tx=0).stop 2023-10-06T11:09:29.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.767+0000 7f11ff7d1700 1 -- 172.21.15.146:0/713446911 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11f80c9470 msgr2=0x7f11f816d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:29.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.767+0000 7f11ff7d1700 1 --2- 172.21.15.146:0/713446911 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11f80c9470 0x7f11f816d6f0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f11e800c3f0 tx=0x7f11e8015000 comp rx=0 tx=0).stop 2023-10-06T11:09:29.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.767+0000 7f11ff7d1700 1 -- 172.21.15.146:0/713446911 shutdown_connections 2023-10-06T11:09:29.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.767+0000 7f11ff7d1700 1 --2- 172.21.15.146:0/713446911 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f11dc066f30 0x7f11dc0693e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:29.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.767+0000 7f11ff7d1700 1 --2- 172.21.15.146:0/713446911 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11f80ccab0 0x7f11f80ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:29.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.767+0000 7f11ff7d1700 1 --2- 172.21.15.146:0/713446911 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11e4004810 0x7f11f81481e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:29.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.767+0000 7f11ff7d1700 1 --2- 172.21.15.146:0/713446911 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11f80c9470 0x7f11f816d6f0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:29.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.767+0000 7f11ff7d1700 1 -- 172.21.15.146:0/713446911 >> 172.21.15.146:0/713446911 conn(0x7f11f80999a0 msgr2=0x7f11f8157200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:29.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.767+0000 7f11ff7d1700 1 -- 172.21.15.146:0/713446911 shutdown_connections 2023-10-06T11:09:29.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.767+0000 7f11ff7d1700 1 -- 172.21.15.146:0/713446911 wait complete. 2023-10-06T11:09:29.782 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T11:09:29.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.895+0000 7fdc09636700 1 Processor -- start 2023-10-06T11:09:29.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.895+0000 7fdc09636700 1 -- start start 2023-10-06T11:09:29.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.896+0000 7fdc09636700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdc041572f0 0x7fdc040cfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:29.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.896+0000 7fdc09636700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc040ceb90 con 0x7fdc0415b7e0 2023-10-06T11:09:29.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.896+0000 7fdc09636700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc0415e250 con 0x7fdc040d05c0 2023-10-06T11:09:29.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.896+0000 7fdc09636700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc040ce3c0 con 0x7fdc041572f0 2023-10-06T11:09:29.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.896+0000 7fdc03fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdc041572f0 0x7fdc040cfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:29.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.896+0000 7fdc08e35700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fdc0415b7e0 0x7fdc0415d520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36684/0 (socket says 172.21.15.146:36684) 2023-10-06T11:09:29.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.896+0000 7fdc08e35700 1 -- 172.21.15.146:0/888037060 learned_addr learned my addr 172.21.15.146:0/888037060 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:29.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.896+0000 7fdc03fff700 1 -- 172.21.15.146:0/888037060 >> v1:172.21.15.151:6789/0 conn(0x7fdc040d05c0 legacy=0x7fdc0415b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:29.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.896+0000 7fdc03fff700 1 -- 172.21.15.146:0/888037060 >> v1:172.21.15.146:6789/0 conn(0x7fdc0415b7e0 legacy=0x7fdc0415d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:29.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.896+0000 7fdc03fff700 1 -- 172.21.15.146:0/888037060 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc040cf6f0 con 0x7fdc041572f0 2023-10-06T11:09:29.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.896+0000 7fdc02ffd700 1 -- 172.21.15.146:0/888037060 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1607262542 0 0) 0x7fdc040ceb90 con 0x7fdc0415b7e0 2023-10-06T11:09:29.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.897+0000 7fdc03fff700 1 --2- 172.21.15.146:0/888037060 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc041572f0 0x7fdc040cfb80 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fdbf40098d0 tx=0x7fdbf4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98af4fa5d874b5a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:29.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.897+0000 7fdc02ffd700 1 -- 172.21.15.146:0/888037060 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf4009e70 con 0x7fdc041572f0 2023-10-06T11:09:29.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.897+0000 7fdc02ffd700 1 -- 172.21.15.146:0/888037060 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf4005c10 con 0x7fdc041572f0 2023-10-06T11:09:29.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.897+0000 7fdc02ffd700 1 -- 172.21.15.146:0/888037060 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf400b610 con 0x7fdc041572f0 2023-10-06T11:09:29.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.897+0000 7fdc09636700 1 -- 172.21.15.146:0/888037060 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc041572f0 msgr2=0x7fdc040cfb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:29.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.897+0000 7fdc09636700 1 --2- 172.21.15.146:0/888037060 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc041572f0 0x7fdc040cfb80 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fdbf40098d0 tx=0x7fdbf4009120 comp rx=0 tx=0).stop 2023-10-06T11:09:29.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.897+0000 7fdc09636700 1 -- 172.21.15.146:0/888037060 shutdown_connections 2023-10-06T11:09:29.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.897+0000 7fdc09636700 1 --2- 172.21.15.146:0/888037060 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc041572f0 0x7fdc040cfb80 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:29.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.897+0000 7fdc09636700 1 -- 172.21.15.146:0/888037060 >> 172.21.15.146:0/888037060 conn(0x7fdc0406eba0 msgr2=0x7fdc0406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:29.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.897+0000 7fdc09636700 1 -- 172.21.15.146:0/888037060 shutdown_connections 2023-10-06T11:09:29.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.897+0000 7fdc09636700 1 -- 172.21.15.146:0/888037060 wait complete. 2023-10-06T11:09:29.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.898+0000 7fdc09636700 1 Processor -- start 2023-10-06T11:09:29.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.899+0000 7fdc09636700 1 -- start start 2023-10-06T11:09:29.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.899+0000 7fdc09636700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc040d05c0 0x7fdc0416aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:29.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.899+0000 7fdc09636700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc041572f0 0x7fdc040ccb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:29.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.899+0000 7fdc09636700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc0415b7e0 0x7fdc040c7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:29.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.899+0000 7fdc09636700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0416b010 con 0x7fdc040d05c0 2023-10-06T11:09:29.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.899+0000 7fdc09636700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc040c5740 con 0x7fdc041572f0 2023-10-06T11:09:29.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.899+0000 7fdc09636700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc040c5a20 con 0x7fdc0415b7e0 2023-10-06T11:09:29.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.899+0000 7fdc03fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc040d05c0 0x7fdc0416aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:29.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.899+0000 7fdc03fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc040d05c0 0x7fdc0416aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41696/0 (socket says 172.21.15.146:41696) 2023-10-06T11:09:29.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.899+0000 7fdc03fff700 1 -- 172.21.15.146:0/1091673792 learned_addr learned my addr 172.21.15.146:0/1091673792 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:29.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.900+0000 7fdc03fff700 1 -- 172.21.15.146:0/1091673792 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc0415b7e0 msgr2=0x7fdc040c7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:29.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.900+0000 7fdc03fff700 1 --2- 172.21.15.146:0/1091673792 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc0415b7e0 0x7fdc040c7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:29.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.900+0000 7fdc03fff700 1 -- 172.21.15.146:0/1091673792 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc041572f0 msgr2=0x7fdc040ccb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:29.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.900+0000 7fdc03fff700 1 --2- 172.21.15.146:0/1091673792 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc041572f0 0x7fdc040ccb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:29.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.900+0000 7fdc03fff700 1 -- 172.21.15.146:0/1091673792 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf40093c0 con 0x7fdc040d05c0 2023-10-06T11:09:29.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.900+0000 7fdc03fff700 1 --2- 172.21.15.146:0/1091673792 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc040d05c0 0x7fdc0416aad0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4009390 tx=0x7fdbf4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:29.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.900+0000 7fdbebfff700 1 -- 172.21.15.146:0/1091673792 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf4006570 con 0x7fdc040d05c0 2023-10-06T11:09:29.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.900+0000 7fdbebfff700 1 -- 172.21.15.146:0/1091673792 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf40066d0 con 0x7fdc040d05c0 2023-10-06T11:09:29.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.900+0000 7fdc09636700 1 -- 172.21.15.146:0/1091673792 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc040c5d00 con 0x7fdc040d05c0 2023-10-06T11:09:29.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.900+0000 7fdbebfff700 1 -- 172.21.15.146:0/1091673792 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf401c430 con 0x7fdc040d05c0 2023-10-06T11:09:29.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.900+0000 7fdc09636700 1 -- 172.21.15.146:0/1091673792 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc040c62c0 con 0x7fdc040d05c0 2023-10-06T11:09:29.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.901+0000 7fdc09636700 1 -- 172.21.15.146:0/1091673792 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc040c64b0 con 0x7fdc040d05c0 2023-10-06T11:09:29.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.901+0000 7fdbebfff700 1 -- 172.21.15.146:0/1091673792 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdbf4023070 con 0x7fdc040d05c0 2023-10-06T11:09:29.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.902+0000 7fdbebfff700 1 --2- 172.21.15.146:0/1091673792 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdbf0066f30 0x7fdbf00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:29.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.902+0000 7fdbebfff700 1 -- 172.21.15.146:0/1091673792 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdbf4086740 con 0x7fdc040d05c0 2023-10-06T11:09:29.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.902+0000 7fdc037fe700 1 --2- 172.21.15.146:0/1091673792 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdbf0066f30 0x7fdbf00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:29.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.902+0000 7fdc037fe700 1 --2- 172.21.15.146:0/1091673792 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdbf0066f30 0x7fdbf00693e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fdc0416d5b0 tx=0x7fdbf8006c60 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:29.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:29.906+0000 7fdbebfff700 1 -- 172.21.15.146:0/1091673792 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdbf4053850 con 0x7fdc040d05c0 2023-10-06T11:09:30.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.133+0000 7fdc09636700 1 -- 172.21.15.146:0/1091673792 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fdc0404bb40 con 0x7fdc040d05c0 2023-10-06T11:09:30.135 INFO:tasks.ceph.mon.a.smithi146.stderr:2023-10-06T11:09:30.134+0000 7f011baa1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T11:09:30.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.140+0000 7fdbebfff700 1 -- 172.21.15.146:0/1091673792 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v41) v1 ==== 161+0+0 (secure 0 0 0) 0x7fdbf4056e70 con 0x7fdc040d05c0 2023-10-06T11:09:30.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.143+0000 7fdc09636700 1 -- 172.21.15.146:0/1091673792 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdbf0066f30 msgr2=0x7fdbf00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:30.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.143+0000 7fdc09636700 1 --2- 172.21.15.146:0/1091673792 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdbf0066f30 0x7fdbf00693e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fdc0416d5b0 tx=0x7fdbf8006c60 comp rx=0 tx=0).stop 2023-10-06T11:09:30.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.143+0000 7fdc09636700 1 -- 172.21.15.146:0/1091673792 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc040d05c0 msgr2=0x7fdc0416aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:30.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.143+0000 7fdc09636700 1 --2- 172.21.15.146:0/1091673792 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc040d05c0 0x7fdc0416aad0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4009390 tx=0x7fdbf4015000 comp rx=0 tx=0).stop 2023-10-06T11:09:30.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.143+0000 7fdc09636700 1 -- 172.21.15.146:0/1091673792 shutdown_connections 2023-10-06T11:09:30.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.143+0000 7fdc09636700 1 --2- 172.21.15.146:0/1091673792 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdbf0066f30 0x7fdbf00693e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:30.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.143+0000 7fdc09636700 1 --2- 172.21.15.146:0/1091673792 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc0415b7e0 0x7fdc040c7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:30.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.143+0000 7fdc09636700 1 --2- 172.21.15.146:0/1091673792 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc040d05c0 0x7fdc0416aad0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:30.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.143+0000 7fdc09636700 1 --2- 172.21.15.146:0/1091673792 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc041572f0 0x7fdc040ccb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:30.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.143+0000 7fdc09636700 1 -- 172.21.15.146:0/1091673792 >> 172.21.15.146:0/1091673792 conn(0x7fdc0406eba0 msgr2=0x7fdc04156220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:30.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.143+0000 7fdc09636700 1 -- 172.21.15.146:0/1091673792 shutdown_connections 2023-10-06T11:09:30.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.143+0000 7fdc09636700 1 -- 172.21.15.146:0/1091673792 wait complete. 2023-10-06T11:09:30.146 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T11:09:30.151 INFO:tasks.ceph.mds.c.smithi146.stderr: -2146> 2023-10-06T11:09:19.075+0000 7ff437454700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000a48 [2,head] /scrub_test_path/ceph-qa-suite/new_file_1 auth v847 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={5670=0-4194304@1} caps={5670=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@3},l=5670 | request=0 lock=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x5566dd7b1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000a48:[<0x10000000001/new_file_1 v847>,<0x10000000000/ceph-qa-suite v92>,<0x1/scrub_test_path v33>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":-61} 2023-10-06T11:09:30.158 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T11:09:30.176 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2023-10-06T11:09:30.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.275+0000 7fcdb1d90700 1 Processor -- start 2023-10-06T11:09:30.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.275+0000 7fcdb1d90700 1 -- start start 2023-10-06T11:09:30.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.275+0000 7fcdb1d90700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcdac15a160 0x7fcdac0c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:30.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.275+0000 7fcdb1d90700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcdac0ae730 0x7fcdac0aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:30.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.275+0000 7fcdb1d90700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdac0ae2a0 con 0x7fcdac0ce3d0 2023-10-06T11:09:30.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.275+0000 7fcdb1d90700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdac15a530 con 0x7fcdac0ae730 2023-10-06T11:09:30.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.275+0000 7fcdb1d90700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdac0af0f0 con 0x7fcdac15a160 2023-10-06T11:09:30.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.276+0000 7fcdaaffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcdac0ae730 0x7fcdac0aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:30.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.276+0000 7fcdabfff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fcdac0ce3d0 0x7fcdac0ce7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36702/0 (socket says 172.21.15.146:36702) 2023-10-06T11:09:30.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.276+0000 7fcdabfff700 1 -- 172.21.15.146:0/2184251 learned_addr learned my addr 172.21.15.146:0/2184251 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:30.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.276+0000 7fcdab7fe700 1 --2- 172.21.15.146:0/2184251 >> v2:172.21.15.151:3300/0 conn(0x7fcdac15a160 0x7fcdac0c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:30.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.276+0000 7fcdaaffd700 1 -- 172.21.15.146:0/2184251 >> v2:172.21.15.151:3300/0 conn(0x7fcdac15a160 msgr2=0x7fcdac0c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:30.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.276+0000 7fcdaaffd700 1 --2- 172.21.15.146:0/2184251 >> v2:172.21.15.151:3300/0 conn(0x7fcdac15a160 0x7fcdac0c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:30.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.276+0000 7fcdaaffd700 1 -- 172.21.15.146:0/2184251 >> v1:172.21.15.146:6789/0 conn(0x7fcdac0ce3d0 legacy=0x7fcdac0ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:30.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.276+0000 7fcdaaffd700 1 -- 172.21.15.146:0/2184251 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdac0ad690 con 0x7fcdac0ae730 2023-10-06T11:09:30.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.276+0000 7fcdaa7fc700 1 -- 172.21.15.146:0/2184251 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4022406555 0 0) 0x7fcdac0ae2a0 con 0x7fcdac0ce3d0 2023-10-06T11:09:30.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.276+0000 7fcdaaffd700 1 --2- 172.21.15.146:0/2184251 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcdac0ae730 0x7fcdac0aebb0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fcdac065100 tx=0x7fcda00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35171249a7079f80 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:30.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.276+0000 7fcdaa7fc700 1 -- 172.21.15.146:0/2184251 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda000b6b0 con 0x7fcdac0ae730 2023-10-06T11:09:30.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.276+0000 7fcdaa7fc700 1 -- 172.21.15.146:0/2184251 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda000b810 con 0x7fcdac0ae730 2023-10-06T11:09:30.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.276+0000 7fcdaa7fc700 1 -- 172.21.15.146:0/2184251 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda000bbb0 con 0x7fcdac0ae730 2023-10-06T11:09:30.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.277+0000 7fcdb1d90700 1 -- 172.21.15.146:0/2184251 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcdac0ae730 msgr2=0x7fcdac0aebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:30.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.277+0000 7fcdb1d90700 1 --2- 172.21.15.146:0/2184251 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcdac0ae730 0x7fcdac0aebb0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fcdac065100 tx=0x7fcda00091a0 comp rx=0 tx=0).stop 2023-10-06T11:09:30.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.277+0000 7fcdb1d90700 1 -- 172.21.15.146:0/2184251 shutdown_connections 2023-10-06T11:09:30.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.277+0000 7fcdb1d90700 1 --2- 172.21.15.146:0/2184251 >> v2:172.21.15.151:3300/0 conn(0x7fcdac15a160 0x7fcdac0c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:30.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.277+0000 7fcdb1d90700 1 --2- 172.21.15.146:0/2184251 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcdac0ae730 0x7fcdac0aebb0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:30.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.277+0000 7fcdb1d90700 1 -- 172.21.15.146:0/2184251 >> 172.21.15.146:0/2184251 conn(0x7fcdac06f380 msgr2=0x7fcdac0d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:30.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.277+0000 7fcdb1d90700 1 -- 172.21.15.146:0/2184251 shutdown_connections 2023-10-06T11:09:30.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.277+0000 7fcdb1d90700 1 -- 172.21.15.146:0/2184251 wait complete. 2023-10-06T11:09:30.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.278+0000 7fcdb1d90700 1 Processor -- start 2023-10-06T11:09:30.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.278+0000 7fcdb1d90700 1 -- start start 2023-10-06T11:09:30.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.279+0000 7fcdb1d90700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcdac0ae730 0x7fcdac0c5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:30.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.279+0000 7fcdb1d90700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcdac0ce3d0 0x7fcdac0696d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:30.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.279+0000 7fcdb1d90700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdac15a160 0x7fcdac0c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:30.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.279+0000 7fcdb1d90700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac0b5040 con 0x7fcdac0ae730 2023-10-06T11:09:30.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.279+0000 7fcdb1d90700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac0b5320 con 0x7fcdac0ce3d0 2023-10-06T11:09:30.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.279+0000 7fcdb1d90700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac0b5600 con 0x7fcdac15a160 2023-10-06T11:09:30.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.279+0000 7fcdab7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcdac0ae730 0x7fcdac0c5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:30.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.279+0000 7fcdab7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcdac0ae730 0x7fcdac0c5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41742/0 (socket says 172.21.15.146:41742) 2023-10-06T11:09:30.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.279+0000 7fcdab7fe700 1 -- 172.21.15.146:0/2463116269 learned_addr learned my addr 172.21.15.146:0/2463116269 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:30.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.279+0000 7fcdaaffd700 1 --2- 172.21.15.146:0/2463116269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcdac0ce3d0 0x7fcdac0696d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:30.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.279+0000 7fcdabfff700 1 --2- 172.21.15.146:0/2463116269 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdac15a160 0x7fcdac0c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:30.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.279+0000 7fcdab7fe700 1 -- 172.21.15.146:0/2463116269 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdac15a160 msgr2=0x7fcdac0c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:30.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.279+0000 7fcdab7fe700 1 --2- 172.21.15.146:0/2463116269 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdac15a160 0x7fcdac0c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:30.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.279+0000 7fcdab7fe700 1 -- 172.21.15.146:0/2463116269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcdac0ce3d0 msgr2=0x7fcdac0696d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:30.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.279+0000 7fcdab7fe700 1 --2- 172.21.15.146:0/2463116269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcdac0ce3d0 0x7fcdac0696d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:30.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.279+0000 7fcdab7fe700 1 -- 172.21.15.146:0/2463116269 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda0009420 con 0x7fcdac0ae730 2023-10-06T11:09:30.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.279+0000 7fcdab7fe700 1 --2- 172.21.15.146:0/2463116269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcdac0ae730 0x7fcdac0c5fb0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c00d810 tx=0x7fcd9c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:30.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.279+0000 7fcd937fe700 1 -- 172.21.15.146:0/2463116269 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c0125f0 con 0x7fcdac0ae730 2023-10-06T11:09:30.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.280+0000 7fcd937fe700 1 -- 172.21.15.146:0/2463116269 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9c012750 con 0x7fcdac0ae730 2023-10-06T11:09:30.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.280+0000 7fcdb1d90700 1 -- 172.21.15.146:0/2463116269 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdac0b4c60 con 0x7fcdac0ae730 2023-10-06T11:09:30.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.280+0000 7fcd937fe700 1 -- 172.21.15.146:0/2463116269 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c012b10 con 0x7fcdac0ae730 2023-10-06T11:09:30.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.280+0000 7fcdb1d90700 1 -- 172.21.15.146:0/2463116269 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdac0c66b0 con 0x7fcdac0ae730 2023-10-06T11:09:30.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.280+0000 7fcdb1d90700 1 -- 172.21.15.146:0/2463116269 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdac068390 con 0x7fcdac0ae730 2023-10-06T11:09:30.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.281+0000 7fcd937fe700 1 -- 172.21.15.146:0/2463116269 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcd9c01e460 con 0x7fcdac0ae730 2023-10-06T11:09:30.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.281+0000 7fcd937fe700 1 --2- 172.21.15.146:0/2463116269 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcd98066f30 0x7fcd980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:30.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.281+0000 7fcd937fe700 1 -- 172.21.15.146:0/2463116269 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fcd9c084ca0 con 0x7fcdac0ae730 2023-10-06T11:09:30.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.281+0000 7fcdaaffd700 1 --2- 172.21.15.146:0/2463116269 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcd98066f30 0x7fcd980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:30.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.282+0000 7fcdaaffd700 1 --2- 172.21.15.146:0/2463116269 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcd98066f30 0x7fcd980693e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcda00093f0 tx=0x7fcda0017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:30.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.286+0000 7fcd937fe700 1 -- 172.21.15.146:0/2463116269 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcd9c051d60 con 0x7fcdac0ae730 2023-10-06T11:09:30.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:30.520+0000 7fcdb1d90700 1 -- 172.21.15.146:0/2463116269 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcdac0b5180 con 0x7fcdac0ae730 2023-10-06T11:09:31.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.141+0000 7fcd937fe700 1 -- 172.21.15.146:0/2463116269 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v42) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcdac0b5180 con 0x7fcdac0ae730 2023-10-06T11:09:31.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.143+0000 7fcdb1d90700 1 -- 172.21.15.146:0/2463116269 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcd98066f30 msgr2=0x7fcd980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:31.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.143+0000 7fcdb1d90700 1 --2- 172.21.15.146:0/2463116269 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcd98066f30 0x7fcd980693e0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcda00093f0 tx=0x7fcda0017000 comp rx=0 tx=0).stop 2023-10-06T11:09:31.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.143+0000 7fcdb1d90700 1 -- 172.21.15.146:0/2463116269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcdac0ae730 msgr2=0x7fcdac0c5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:31.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.143+0000 7fcdb1d90700 1 --2- 172.21.15.146:0/2463116269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcdac0ae730 0x7fcdac0c5fb0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c00d810 tx=0x7fcd9c008040 comp rx=0 tx=0).stop 2023-10-06T11:09:31.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.143+0000 7fcdb1d90700 1 -- 172.21.15.146:0/2463116269 shutdown_connections 2023-10-06T11:09:31.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.143+0000 7fcdb1d90700 1 --2- 172.21.15.146:0/2463116269 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcd98066f30 0x7fcd980693e0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:31.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.143+0000 7fcdb1d90700 1 --2- 172.21.15.146:0/2463116269 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdac15a160 0x7fcdac0c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:31.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.143+0000 7fcdb1d90700 1 --2- 172.21.15.146:0/2463116269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcdac0ae730 0x7fcdac0c5fb0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:31.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.143+0000 7fcdb1d90700 1 --2- 172.21.15.146:0/2463116269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcdac0ce3d0 0x7fcdac0696d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:31.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.143+0000 7fcdb1d90700 1 -- 172.21.15.146:0/2463116269 >> 172.21.15.146:0/2463116269 conn(0x7fcdac06f380 msgr2=0x7fcdac0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:31.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.144+0000 7fcdb1d90700 1 -- 172.21.15.146:0/2463116269 shutdown_connections 2023-10-06T11:09:31.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.144+0000 7fcdb1d90700 1 -- 172.21.15.146:0/2463116269 wait complete. 2023-10-06T11:09:31.158 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T11:09:31.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.317+0000 7f6670491700 1 Processor -- start 2023-10-06T11:09:31.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.317+0000 7f6670491700 1 -- start start 2023-10-06T11:09:31.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.318+0000 7f6670491700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f66680ae730 0x7f66680aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:31.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.318+0000 7f6670491700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f66680cb950 0x7f66680cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:31.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.318+0000 7f6670491700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66680ae2a0 con 0x7f666815a160 2023-10-06T11:09:31.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.318+0000 7f6670491700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f666815a530 con 0x7f66680ae730 2023-10-06T11:09:31.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.318+0000 7f6670491700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66680c5cb0 con 0x7f66680cb950 2023-10-06T11:09:31.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.318+0000 7f666da2c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f66680ae730 0x7f66680aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:31.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.318+0000 7f666e22d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f666815a160 0x7f66680c55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36712/0 (socket says 172.21.15.146:36712) 2023-10-06T11:09:31.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.318+0000 7f666e22d700 1 -- 172.21.15.146:0/1393026371 learned_addr learned my addr 172.21.15.146:0/1393026371 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:31.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.318+0000 7f666ea2e700 1 --2- 172.21.15.146:0/1393026371 >> v2:172.21.15.151:3300/0 conn(0x7f66680cb950 0x7f66680cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:31.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.318+0000 7f666da2c700 1 -- 172.21.15.146:0/1393026371 >> v2:172.21.15.151:3300/0 conn(0x7f66680cb950 msgr2=0x7f66680cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:31.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.318+0000 7f666da2c700 1 --2- 172.21.15.146:0/1393026371 >> v2:172.21.15.151:3300/0 conn(0x7f66680cb950 0x7f66680cbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:31.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.318+0000 7f666da2c700 1 -- 172.21.15.146:0/1393026371 >> v1:172.21.15.146:6789/0 conn(0x7f666815a160 legacy=0x7f66680c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:31.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.318+0000 7f666d22b700 1 -- 172.21.15.146:0/1393026371 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2519746052 0 0) 0x7f66680ae2a0 con 0x7f666815a160 2023-10-06T11:09:31.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.318+0000 7f666da2c700 1 -- 172.21.15.146:0/1393026371 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66680af0f0 con 0x7f66680ae730 2023-10-06T11:09:31.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.318+0000 7f666ea2e700 1 --2- 172.21.15.146:0/1393026371 >> v2:172.21.15.151:3300/0 conn(0x7f66680cb950 0x7f66680cbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:31.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.318+0000 7f666da2c700 1 --2- 172.21.15.146:0/1393026371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66680ae730 0x7f66680aebb0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f666808b000 tx=0x7f665c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c041308c6eb30229 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:31.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.318+0000 7f666d22b700 1 -- 172.21.15.146:0/1393026371 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665c00b6b0 con 0x7f66680ae730 2023-10-06T11:09:31.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.319+0000 7f666d22b700 1 -- 172.21.15.146:0/1393026371 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f665c00b810 con 0x7f66680ae730 2023-10-06T11:09:31.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.319+0000 7f666d22b700 1 -- 172.21.15.146:0/1393026371 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665c00bbb0 con 0x7f66680ae730 2023-10-06T11:09:31.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.319+0000 7f6670491700 1 -- 172.21.15.146:0/1393026371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66680ae730 msgr2=0x7f66680aebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:31.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.319+0000 7f6670491700 1 --2- 172.21.15.146:0/1393026371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66680ae730 0x7f66680aebb0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f666808b000 tx=0x7f665c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:09:31.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.319+0000 7f6670491700 1 -- 172.21.15.146:0/1393026371 shutdown_connections 2023-10-06T11:09:31.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.319+0000 7f6670491700 1 --2- 172.21.15.146:0/1393026371 >> v2:172.21.15.151:3300/0 conn(0x7f66680cb950 0x7f66680cbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:31.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.319+0000 7f6670491700 1 --2- 172.21.15.146:0/1393026371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66680ae730 0x7f66680aebb0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:31.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.319+0000 7f6670491700 1 -- 172.21.15.146:0/1393026371 >> 172.21.15.146:0/1393026371 conn(0x7f666806f380 msgr2=0x7f66680d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:31.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.319+0000 7f6670491700 1 -- 172.21.15.146:0/1393026371 shutdown_connections 2023-10-06T11:09:31.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.319+0000 7f6670491700 1 -- 172.21.15.146:0/1393026371 wait complete. 2023-10-06T11:09:31.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.320+0000 7f6670491700 1 Processor -- start 2023-10-06T11:09:31.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.320+0000 7f6670491700 1 -- start start 2023-10-06T11:09:31.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.321+0000 7f6670491700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66680ae730 0x7f6668157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:31.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.321+0000 7f6670491700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66680cb950 0x7f66680c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:31.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.321+0000 7f6670491700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f666815a160 0x7f666809d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:31.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.321+0000 7f6670491700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66680af2e0 con 0x7f66680cb950 2023-10-06T11:09:31.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.321+0000 7f6670491700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66680af5c0 con 0x7f666815a160 2023-10-06T11:09:31.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.321+0000 7f6670491700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66680c8bc0 con 0x7f66680ae730 2023-10-06T11:09:31.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.321+0000 7f666da2c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66680cb950 0x7f66680c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:31.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.321+0000 7f666da2c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66680cb950 0x7f66680c8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41756/0 (socket says 172.21.15.146:41756) 2023-10-06T11:09:31.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.321+0000 7f666da2c700 1 -- 172.21.15.146:0/2951549306 learned_addr learned my addr 172.21.15.146:0/2951549306 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:31.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.321+0000 7f666e22d700 1 --2- 172.21.15.146:0/2951549306 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66680ae730 0x7f6668157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:31.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.321+0000 7f666da2c700 1 -- 172.21.15.146:0/2951549306 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66680ae730 msgr2=0x7f6668157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:31.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.321+0000 7f666ea2e700 1 --2- 172.21.15.146:0/2951549306 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f666815a160 0x7f666809d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:31.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.321+0000 7f666da2c700 1 --2- 172.21.15.146:0/2951549306 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66680ae730 0x7f6668157600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:31.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.321+0000 7f666da2c700 1 -- 172.21.15.146:0/2951549306 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f666815a160 msgr2=0x7f666809d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:31.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.321+0000 7f666da2c700 1 --2- 172.21.15.146:0/2951549306 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f666815a160 0x7f666809d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:31.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.321+0000 7f666da2c700 1 -- 172.21.15.146:0/2951549306 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f665c009420 con 0x7f66680cb950 2023-10-06T11:09:31.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.321+0000 7f666e22d700 1 --2- 172.21.15.146:0/2951549306 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66680ae730 0x7f6668157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:09:31.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.321+0000 7f666ea2e700 1 --2- 172.21.15.146:0/2951549306 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f666815a160 0x7f666809d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:09:31.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.321+0000 7f666da2c700 1 --2- 172.21.15.146:0/2951549306 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66680cb950 0x7f66680c8270 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f6668088c60 tx=0x7f665c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:31.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.322+0000 7f66667fc700 1 -- 172.21.15.146:0/2951549306 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665c00bb90 con 0x7f66680cb950 2023-10-06T11:09:31.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.322+0000 7f66667fc700 1 -- 172.21.15.146:0/2951549306 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f665c011420 con 0x7f66680cb950 2023-10-06T11:09:31.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.322+0000 7f6670491700 1 -- 172.21.15.146:0/2951549306 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66680c8ea0 con 0x7f66680cb950 2023-10-06T11:09:31.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.322+0000 7f66667fc700 1 -- 172.21.15.146:0/2951549306 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665c0117a0 con 0x7f66680cb950 2023-10-06T11:09:31.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.322+0000 7f6670491700 1 -- 172.21.15.146:0/2951549306 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6668157b40 con 0x7f66680cb950 2023-10-06T11:09:31.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.322+0000 7f6670491700 1 -- 172.21.15.146:0/2951549306 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6668068390 con 0x7f66680cb950 2023-10-06T11:09:31.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.323+0000 7f66667fc700 1 -- 172.21.15.146:0/2951549306 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f665c011b90 con 0x7f66680cb950 2023-10-06T11:09:31.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.323+0000 7f66667fc700 1 --2- 172.21.15.146:0/2951549306 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6654066f30 0x7f66540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:31.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.323+0000 7f66667fc700 1 -- 172.21.15.146:0/2951549306 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f665c085b10 con 0x7f66680cb950 2023-10-06T11:09:31.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.323+0000 7f666e22d700 1 --2- 172.21.15.146:0/2951549306 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6654066f30 0x7f66540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:31.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.324+0000 7f666e22d700 1 --2- 172.21.15.146:0/2951549306 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6654066f30 0x7f66540693e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6660001f00 tx=0x7f6660009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:31.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.328+0000 7f66667fc700 1 -- 172.21.15.146:0/2951549306 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f665c052c50 con 0x7f66680cb950 2023-10-06T11:09:31.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:31.519+0000 7f6670491700 1 -- 172.21.15.146:0/2951549306 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f66680af730 con 0x7f66680cb950 2023-10-06T11:09:32.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.152+0000 7f66667fc700 1 -- 172.21.15.146:0/2951549306 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v49) v1 ==== 181+0+0 (secure 0 0 0) 0x7f665c056270 con 0x7f66680cb950 2023-10-06T11:09:32.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.157+0000 7f6670491700 1 -- 172.21.15.146:0/2951549306 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6654066f30 msgr2=0x7f66540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:32.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.157+0000 7f6670491700 1 --2- 172.21.15.146:0/2951549306 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6654066f30 0x7f66540693e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6660001f00 tx=0x7f6660009040 comp rx=0 tx=0).stop 2023-10-06T11:09:32.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.157+0000 7f6670491700 1 -- 172.21.15.146:0/2951549306 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66680cb950 msgr2=0x7f66680c8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:32.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.157+0000 7f6670491700 1 --2- 172.21.15.146:0/2951549306 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66680cb950 0x7f66680c8270 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f6668088c60 tx=0x7f665c017000 comp rx=0 tx=0).stop 2023-10-06T11:09:32.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.158+0000 7f6670491700 1 -- 172.21.15.146:0/2951549306 shutdown_connections 2023-10-06T11:09:32.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.158+0000 7f6670491700 1 --2- 172.21.15.146:0/2951549306 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6654066f30 0x7f66540693e0 secure :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f6660001f00 tx=0x7f6660009040 comp rx=0 tx=0).stop 2023-10-06T11:09:32.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.158+0000 7f6670491700 1 --2- 172.21.15.146:0/2951549306 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f666815a160 0x7f666809d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:32.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.158+0000 7f6670491700 1 --2- 172.21.15.146:0/2951549306 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66680ae730 0x7f6668157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:32.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.158+0000 7f6670491700 1 --2- 172.21.15.146:0/2951549306 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f66680cb950 0x7f66680c8270 secure :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f6668088c60 tx=0x7f665c017000 comp rx=0 tx=0).stop 2023-10-06T11:09:32.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.158+0000 7f6670491700 1 -- 172.21.15.146:0/2951549306 >> 172.21.15.146:0/2951549306 conn(0x7f666806f380 msgr2=0x7f6668159560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:32.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.158+0000 7f6670491700 1 -- 172.21.15.146:0/2951549306 shutdown_connections 2023-10-06T11:09:32.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.158+0000 7f6670491700 1 -- 172.21.15.146:0/2951549306 wait complete. 2023-10-06T11:09:32.165 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' removed 2023-10-06T11:09:32.179 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T11:09:32.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.296+0000 7fc726fec700 1 Processor -- start 2023-10-06T11:09:32.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.296+0000 7fc726fec700 1 -- start start 2023-10-06T11:09:32.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.296+0000 7fc726fec700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc72015a160 0x7fc7200c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:32.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.296+0000 7fc726fec700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc7200ae730 0x7fc7200aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:32.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.296+0000 7fc726fec700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7200ae2a0 con 0x7fc7200ce3d0 2023-10-06T11:09:32.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.296+0000 7fc726fec700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc72015a530 con 0x7fc72015a160 2023-10-06T11:09:32.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.296+0000 7fc726fec700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7200af0f0 con 0x7fc7200ae730 2023-10-06T11:09:32.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.297+0000 7fc724d88700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc72015a160 0x7fc7200c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:32.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.297+0000 7fc725589700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc7200ce3d0 0x7fc7200ce7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39280/0 (socket says 172.21.15.146:39280) 2023-10-06T11:09:32.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.297+0000 7fc725589700 1 -- 172.21.15.146:0/504658396 learned_addr learned my addr 172.21.15.146:0/504658396 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:32.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.297+0000 7fc717fff700 1 --2- 172.21.15.146:0/504658396 >> v2:172.21.15.151:3300/0 conn(0x7fc7200ae730 0x7fc7200aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:32.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.297+0000 7fc724d88700 1 -- 172.21.15.146:0/504658396 >> v2:172.21.15.151:3300/0 conn(0x7fc7200ae730 msgr2=0x7fc7200aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:32.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.297+0000 7fc724d88700 1 --2- 172.21.15.146:0/504658396 >> v2:172.21.15.151:3300/0 conn(0x7fc7200ae730 0x7fc7200aebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:32.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.297+0000 7fc724d88700 1 -- 172.21.15.146:0/504658396 >> v1:172.21.15.146:6789/0 conn(0x7fc7200ce3d0 legacy=0x7fc7200ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:32.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.297+0000 7fc7177fe700 1 -- 172.21.15.146:0/504658396 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1175979769 0 0) 0x7fc7200ae2a0 con 0x7fc7200ce3d0 2023-10-06T11:09:32.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.297+0000 7fc724d88700 1 -- 172.21.15.146:0/504658396 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7200ad690 con 0x7fc72015a160 2023-10-06T11:09:32.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.297+0000 7fc717fff700 1 --2- 172.21.15.146:0/504658396 >> v2:172.21.15.151:3300/0 conn(0x7fc7200ae730 0x7fc7200aebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:09:32.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.297+0000 7fc724d88700 1 --2- 172.21.15.146:0/504658396 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc72015a160 0x7fc7200c55a0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fc7200d16e0 tx=0x7fc71c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f9c5b1e85d8650 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:32.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.297+0000 7fc7177fe700 1 -- 172.21.15.146:0/504658396 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71c005c10 con 0x7fc72015a160 2023-10-06T11:09:32.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.297+0000 7fc7177fe700 1 -- 172.21.15.146:0/504658396 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc71c005d70 con 0x7fc72015a160 2023-10-06T11:09:32.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.297+0000 7fc7177fe700 1 -- 172.21.15.146:0/504658396 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71c006260 con 0x7fc72015a160 2023-10-06T11:09:32.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.298+0000 7fc726fec700 1 -- 172.21.15.146:0/504658396 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc72015a160 msgr2=0x7fc7200c55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:32.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.298+0000 7fc726fec700 1 --2- 172.21.15.146:0/504658396 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc72015a160 0x7fc7200c55a0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fc7200d16e0 tx=0x7fc71c009120 comp rx=0 tx=0).stop 2023-10-06T11:09:32.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.298+0000 7fc726fec700 1 -- 172.21.15.146:0/504658396 shutdown_connections 2023-10-06T11:09:32.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.298+0000 7fc726fec700 1 --2- 172.21.15.146:0/504658396 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc72015a160 0x7fc7200c55a0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:32.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.298+0000 7fc726fec700 1 --2- 172.21.15.146:0/504658396 >> v2:172.21.15.151:3300/0 conn(0x7fc7200ae730 0x7fc7200aebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:32.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.298+0000 7fc726fec700 1 -- 172.21.15.146:0/504658396 >> 172.21.15.146:0/504658396 conn(0x7fc72006f380 msgr2=0x7fc7200d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:32.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.298+0000 7fc726fec700 1 -- 172.21.15.146:0/504658396 shutdown_connections 2023-10-06T11:09:32.302 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.298+0000 7fc726fec700 1 -- 172.21.15.146:0/504658396 wait complete. 2023-10-06T11:09:32.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.299+0000 7fc726fec700 1 Processor -- start 2023-10-06T11:09:32.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.299+0000 7fc726fec700 1 -- start start 2023-10-06T11:09:32.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.300+0000 7fc726fec700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7200ae730 0x7fc72015a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:32.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.300+0000 7fc726fec700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7200ce3d0 0x7fc7200cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:32.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.300+0000 7fc726fec700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc72015a160 0x7fc720157180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:32.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.300+0000 7fc726fec700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72015b790 con 0x7fc72015a160 2023-10-06T11:09:32.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.300+0000 7fc726fec700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc72015de60 con 0x7fc7200ce3d0 2023-10-06T11:09:32.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.300+0000 7fc726fec700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc72015e120 con 0x7fc7200ae730 2023-10-06T11:09:32.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.300+0000 7fc725589700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc72015a160 0x7fc720157180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:32.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.300+0000 7fc725589700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc72015a160 0x7fc720157180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40064/0 (socket says 172.21.15.146:40064) 2023-10-06T11:09:32.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.300+0000 7fc725589700 1 -- 172.21.15.146:0/2426617994 learned_addr learned my addr 172.21.15.146:0/2426617994 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:32.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.300+0000 7fc717fff700 1 --2- 172.21.15.146:0/2426617994 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7200ce3d0 0x7fc7200cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:32.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.300+0000 7fc724d88700 1 --2- 172.21.15.146:0/2426617994 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7200ae730 0x7fc72015a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:32.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.300+0000 7fc725589700 1 -- 172.21.15.146:0/2426617994 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7200ae730 msgr2=0x7fc72015a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:32.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.300+0000 7fc725589700 1 --2- 172.21.15.146:0/2426617994 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7200ae730 0x7fc72015a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:32.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.300+0000 7fc725589700 1 -- 172.21.15.146:0/2426617994 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7200ce3d0 msgr2=0x7fc7200cc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:32.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.300+0000 7fc725589700 1 --2- 172.21.15.146:0/2426617994 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7200ce3d0 0x7fc7200cc7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:32.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.300+0000 7fc725589700 1 -- 172.21.15.146:0/2426617994 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc71c0093c0 con 0x7fc72015a160 2023-10-06T11:09:32.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.300+0000 7fc725589700 1 --2- 172.21.15.146:0/2426617994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc72015a160 0x7fc720157180 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fc71800ccc0 tx=0x7fc718001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:32.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.300+0000 7fc714ff9700 1 -- 172.21.15.146:0/2426617994 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71800a860 con 0x7fc72015a160 2023-10-06T11:09:32.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.300+0000 7fc714ff9700 1 -- 172.21.15.146:0/2426617994 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc71800a9c0 con 0x7fc72015a160 2023-10-06T11:09:32.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.300+0000 7fc726fec700 1 -- 172.21.15.146:0/2426617994 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc72015aef0 con 0x7fc72015a160 2023-10-06T11:09:32.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.301+0000 7fc714ff9700 1 -- 172.21.15.146:0/2426617994 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71800ad80 con 0x7fc72015a160 2023-10-06T11:09:32.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.301+0000 7fc726fec700 1 -- 172.21.15.146:0/2426617994 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc72015abe0 con 0x7fc72015a160 2023-10-06T11:09:32.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.301+0000 7fc726fec700 1 -- 172.21.15.146:0/2426617994 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc72015b2f0 con 0x7fc72015a160 2023-10-06T11:09:32.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.302+0000 7fc714ff9700 1 -- 172.21.15.146:0/2426617994 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc718007300 con 0x7fc72015a160 2023-10-06T11:09:32.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.302+0000 7fc714ff9700 1 --2- 172.21.15.146:0/2426617994 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc70c066fb0 0x7fc70c069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:32.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.302+0000 7fc714ff9700 1 -- 172.21.15.146:0/2426617994 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5764+0+0 (secure 0 0 0) 0x7fc718084900 con 0x7fc72015a160 2023-10-06T11:09:32.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.302+0000 7fc724d88700 1 --2- 172.21.15.146:0/2426617994 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc70c066fb0 0x7fc70c069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:32.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.303+0000 7fc724d88700 1 --2- 172.21.15.146:0/2426617994 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc70c066fb0 0x7fc70c069460 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc71c009160 tx=0x7fc71c016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:32.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.306+0000 7fc714ff9700 1 -- 172.21.15.146:0/2426617994 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc718051b10 con 0x7fc72015a160 2023-10-06T11:09:32.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:32.492+0000 7fc726fec700 1 -- 172.21.15.146:0/2426617994 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc72004c380 con 0x7fc72015a160 2023-10-06T11:09:33.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.150+0000 7fc714ff9700 1 -- 172.21.15.146:0/2426617994 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v50) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc718055130 con 0x7fc72015a160 2023-10-06T11:09:33.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.154+0000 7fc726fec700 1 -- 172.21.15.146:0/2426617994 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc70c066fb0 msgr2=0x7fc70c069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:33.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.154+0000 7fc726fec700 1 --2- 172.21.15.146:0/2426617994 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc70c066fb0 0x7fc70c069460 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc71c009160 tx=0x7fc71c016000 comp rx=0 tx=0).stop 2023-10-06T11:09:33.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.154+0000 7fc726fec700 1 -- 172.21.15.146:0/2426617994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc72015a160 msgr2=0x7fc720157180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:33.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.154+0000 7fc726fec700 1 --2- 172.21.15.146:0/2426617994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc72015a160 0x7fc720157180 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fc71800ccc0 tx=0x7fc718001a20 comp rx=0 tx=0).stop 2023-10-06T11:09:33.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.154+0000 7fc726fec700 1 -- 172.21.15.146:0/2426617994 shutdown_connections 2023-10-06T11:09:33.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.154+0000 7fc726fec700 1 --2- 172.21.15.146:0/2426617994 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc70c066fb0 0x7fc70c069460 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:33.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.154+0000 7fc726fec700 1 --2- 172.21.15.146:0/2426617994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc72015a160 0x7fc720157180 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:33.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.154+0000 7fc726fec700 1 --2- 172.21.15.146:0/2426617994 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7200ae730 0x7fc72015a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:33.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.154+0000 7fc726fec700 1 --2- 172.21.15.146:0/2426617994 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7200ce3d0 0x7fc7200cc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:33.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.154+0000 7fc726fec700 1 -- 172.21.15.146:0/2426617994 >> 172.21.15.146:0/2426617994 conn(0x7fc72006f380 msgr2=0x7fc7201594f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:33.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.154+0000 7fc726fec700 1 -- 172.21.15.146:0/2426617994 shutdown_connections 2023-10-06T11:09:33.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.154+0000 7fc726fec700 1 -- 172.21.15.146:0/2426617994 wait complete. 2023-10-06T11:09:33.160 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' removed 2023-10-06T11:09:33.172 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T11:09:33.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.300+0000 7f84910b6700 1 Processor -- start 2023-10-06T11:09:33.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.300+0000 7f84910b6700 1 -- start start 2023-10-06T11:09:33.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.301+0000 7f84910b6700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f848c159550 0x7f848c06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:33.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.301+0000 7f84910b6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f848c159920 0x7f848c0aaf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:33.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.301+0000 7f84910b6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f848c0ab460 0x7f848c068480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:33.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.301+0000 7f84910b6700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f848c0aaa90 con 0x7f848c159920 2023-10-06T11:09:33.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.301+0000 7f84910b6700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f848c06f340 con 0x7f848c159550 2023-10-06T11:09:33.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.301+0000 7f84910b6700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f848c0a9e80 con 0x7f848c0ab460 2023-10-06T11:09:33.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.301+0000 7f8483fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f848c159920 0x7f848c0aaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:33.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.301+0000 7f8483fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f848c159920 0x7f848c0aaf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40080/0 (socket says 172.21.15.146:40080) 2023-10-06T11:09:33.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.301+0000 7f8483fff700 1 -- 172.21.15.146:0/1961435725 learned_addr learned my addr 172.21.15.146:0/1961435725 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:33.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.301+0000 7f848ad9d700 1 --2- 172.21.15.146:0/1961435725 >> v2:172.21.15.151:3300/0 conn(0x7f848c159550 0x7f848c06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:33.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.301+0000 7f848b59e700 1 --2- 172.21.15.146:0/1961435725 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f848c0ab460 0x7f848c068480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:33.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.302+0000 7f8483fff700 1 -- 172.21.15.146:0/1961435725 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f848c0ab460 msgr2=0x7f848c068480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:33.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.302+0000 7f8483fff700 1 --2- 172.21.15.146:0/1961435725 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f848c0ab460 0x7f848c068480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:33.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.302+0000 7f8483fff700 1 -- 172.21.15.146:0/1961435725 >> v2:172.21.15.151:3300/0 conn(0x7f848c159550 msgr2=0x7f848c06ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:33.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.302+0000 7f8483fff700 1 --2- 172.21.15.146:0/1961435725 >> v2:172.21.15.151:3300/0 conn(0x7f848c159550 0x7f848c06ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:33.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.302+0000 7f8483fff700 1 -- 172.21.15.146:0/1961435725 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f848c0aa160 con 0x7f848c159920 2023-10-06T11:09:33.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.302+0000 7f8483fff700 1 --2- 172.21.15.146:0/1961435725 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f848c159920 0x7f848c0aaf20 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f848c06d2c0 tx=0x7f8474009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9b804c3b9a4264a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:33.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.302+0000 7f848a59c700 1 -- 172.21.15.146:0/1961435725 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f847400b640 con 0x7f848c159920 2023-10-06T11:09:33.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.302+0000 7f848a59c700 1 -- 172.21.15.146:0/1961435725 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f847400b7a0 con 0x7f848c159920 2023-10-06T11:09:33.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.302+0000 7f848a59c700 1 -- 172.21.15.146:0/1961435725 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f847400bb60 con 0x7f848c159920 2023-10-06T11:09:33.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.303+0000 7f84910b6700 1 -- 172.21.15.146:0/1961435725 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f848c159920 msgr2=0x7f848c0aaf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:33.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.303+0000 7f84910b6700 1 --2- 172.21.15.146:0/1961435725 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f848c159920 0x7f848c0aaf20 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f848c06d2c0 tx=0x7f8474009250 comp rx=0 tx=0).stop 2023-10-06T11:09:33.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.303+0000 7f84910b6700 1 -- 172.21.15.146:0/1961435725 shutdown_connections 2023-10-06T11:09:33.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.303+0000 7f84910b6700 1 --2- 172.21.15.146:0/1961435725 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f848c0ab460 0x7f848c068480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:33.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.303+0000 7f84910b6700 1 --2- 172.21.15.146:0/1961435725 >> v2:172.21.15.151:3300/0 conn(0x7f848c159550 0x7f848c06ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:33.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.303+0000 7f84910b6700 1 --2- 172.21.15.146:0/1961435725 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f848c159920 0x7f848c0aaf20 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:33.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.303+0000 7f84910b6700 1 -- 172.21.15.146:0/1961435725 >> 172.21.15.146:0/1961435725 conn(0x7f848c0c9fa0 msgr2=0x7f848c06de70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:33.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.303+0000 7f84910b6700 1 -- 172.21.15.146:0/1961435725 shutdown_connections 2023-10-06T11:09:33.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.303+0000 7f84910b6700 1 -- 172.21.15.146:0/1961435725 wait complete. 2023-10-06T11:09:33.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.304+0000 7f84910b6700 1 Processor -- start 2023-10-06T11:09:33.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.304+0000 7f84910b6700 1 -- start start 2023-10-06T11:09:33.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.304+0000 7f84910b6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f848c0ab460 0x7f848c14a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:33.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.304+0000 7f84910b6700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f848c159550 0x7f848c15cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:33.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.304+0000 7f84910b6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f848c159920 0x7f848c0b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:33.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.304+0000 7f84910b6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848c15dc80 con 0x7f848c159920 2023-10-06T11:09:33.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.304+0000 7f84910b6700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848c0adcb0 con 0x7f848c159550 2023-10-06T11:09:33.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.304+0000 7f84910b6700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f848c14ac40 con 0x7f848c0ab460 2023-10-06T11:09:33.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.305+0000 7f848b59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f848c159920 0x7f848c0b1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:33.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.305+0000 7f848b59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f848c159920 0x7f848c0b1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40088/0 (socket says 172.21.15.146:40088) 2023-10-06T11:09:33.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.305+0000 7f848b59e700 1 -- 172.21.15.146:0/901603092 learned_addr learned my addr 172.21.15.146:0/901603092 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:33.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.305+0000 7f848ad9d700 1 --2- 172.21.15.146:0/901603092 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f848c0ab460 0x7f848c14a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:33.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.305+0000 7f8483fff700 1 --2- 172.21.15.146:0/901603092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f848c159550 0x7f848c15cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:33.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.305+0000 7f848b59e700 1 -- 172.21.15.146:0/901603092 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f848c0ab460 msgr2=0x7f848c14a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:33.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.305+0000 7f848b59e700 1 --2- 172.21.15.146:0/901603092 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f848c0ab460 0x7f848c14a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:33.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.305+0000 7f848b59e700 1 -- 172.21.15.146:0/901603092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f848c159550 msgr2=0x7f848c15cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:33.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.305+0000 7f848b59e700 1 --2- 172.21.15.146:0/901603092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f848c159550 0x7f848c15cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:33.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.305+0000 7f848b59e700 1 -- 172.21.15.146:0/901603092 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84740094f0 con 0x7f848c159920 2023-10-06T11:09:33.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.305+0000 7f848b59e700 1 --2- 172.21.15.146:0/901603092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f848c159920 0x7f848c0b1aa0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f8484009da0 tx=0x7f848400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:33.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.305+0000 7f8482ffd700 1 -- 172.21.15.146:0/901603092 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848400caa0 con 0x7f848c159920 2023-10-06T11:09:33.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.305+0000 7f8482ffd700 1 -- 172.21.15.146:0/901603092 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848400f040 con 0x7f848c159920 2023-10-06T11:09:33.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.305+0000 7f8482ffd700 1 -- 172.21.15.146:0/901603092 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848400ce50 con 0x7f848c159920 2023-10-06T11:09:33.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.305+0000 7f84910b6700 1 -- 172.21.15.146:0/901603092 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f848c15d9a0 con 0x7f848c159920 2023-10-06T11:09:33.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.305+0000 7f84910b6700 1 -- 172.21.15.146:0/901603092 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f848c0ad940 con 0x7f848c159920 2023-10-06T11:09:33.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.306+0000 7f84910b6700 1 -- 172.21.15.146:0/901603092 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f848c0ade40 con 0x7f848c159920 2023-10-06T11:09:33.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.306+0000 7f8482ffd700 1 -- 172.21.15.146:0/901603092 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8484014690 con 0x7f848c159920 2023-10-06T11:09:33.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.307+0000 7f8482ffd700 1 --2- 172.21.15.146:0/901603092 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f846c066f30 0x7f846c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:33.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.307+0000 7f848ad9d700 1 --2- 172.21.15.146:0/901603092 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f846c066f30 0x7f846c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:33.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.307+0000 7f8482ffd700 1 -- 172.21.15.146:0/901603092 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f8484084df0 con 0x7f848c159920 2023-10-06T11:09:33.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.307+0000 7f848ad9d700 1 --2- 172.21.15.146:0/901603092 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f846c066f30 0x7f846c0693e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f847c009c80 tx=0x7f847c0091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:33.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.311+0000 7f8482ffd700 1 -- 172.21.15.146:0/901603092 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8484052200 con 0x7f848c159920 2023-10-06T11:09:33.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.496+0000 7f84910b6700 1 -- 172.21.15.146:0/901603092 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f848c04c380 con 0x7f848c159920 2023-10-06T11:09:33.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.500+0000 7f8482ffd700 1 -- 172.21.15.146:0/901603092 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8484055820 con 0x7f848c159920 2023-10-06T11:09:33.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.502+0000 7f84910b6700 1 -- 172.21.15.146:0/901603092 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f846c066f30 msgr2=0x7f846c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:33.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.502+0000 7f84910b6700 1 --2- 172.21.15.146:0/901603092 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f846c066f30 0x7f846c0693e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f847c009c80 tx=0x7f847c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:09:33.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.502+0000 7f84910b6700 1 -- 172.21.15.146:0/901603092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f848c159920 msgr2=0x7f848c0b1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:33.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.502+0000 7f84910b6700 1 --2- 172.21.15.146:0/901603092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f848c159920 0x7f848c0b1aa0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f8484009da0 tx=0x7f848400b040 comp rx=0 tx=0).stop 2023-10-06T11:09:33.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.502+0000 7f84910b6700 1 -- 172.21.15.146:0/901603092 shutdown_connections 2023-10-06T11:09:33.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.502+0000 7f84910b6700 1 --2- 172.21.15.146:0/901603092 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f846c066f30 0x7f846c0693e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:33.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.502+0000 7f84910b6700 1 --2- 172.21.15.146:0/901603092 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f848c159920 0x7f848c0b1aa0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:33.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.502+0000 7f84910b6700 1 --2- 172.21.15.146:0/901603092 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f848c0ab460 0x7f848c14a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:33.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.502+0000 7f84910b6700 1 --2- 172.21.15.146:0/901603092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f848c159550 0x7f848c15cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:33.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.502+0000 7f84910b6700 1 -- 172.21.15.146:0/901603092 >> 172.21.15.146:0/901603092 conn(0x7f848c0c9fa0 msgr2=0x7f848c156700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:33.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.502+0000 7f84910b6700 1 -- 172.21.15.146:0/901603092 shutdown_connections 2023-10-06T11:09:33.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.502+0000 7f84910b6700 1 -- 172.21.15.146:0/901603092 wait complete. 2023-10-06T11:09:33.516 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks' 2023-10-06T11:09:33.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.629+0000 7f3fa33d1700 1 Processor -- start 2023-10-06T11:09:33.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.630+0000 7f3fa33d1700 1 -- start start 2023-10-06T11:09:33.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.630+0000 7f3fa33d1700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f9c0c4750 0x7f3f9c0cd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:33.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.630+0000 7f3fa33d1700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f9c068a90 con 0x7f3f9c0c3960 2023-10-06T11:09:33.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.630+0000 7f3fa33d1700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f9c159fd0 con 0x7f3f9c0b08d0 2023-10-06T11:09:33.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.630+0000 7f3fa33d1700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c0cdcf0 con 0x7f3f9c0c4750 2023-10-06T11:09:33.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.631+0000 7f3fa096c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3f9c0c3960 0x7f3f9c0cc990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39292/0 (socket says 172.21.15.146:39292) 2023-10-06T11:09:33.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.631+0000 7f3fa096c700 1 -- 172.21.15.146:0/2510231356 learned_addr learned my addr 172.21.15.146:0/2510231356 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:33.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.631+0000 7f3fa196e700 1 --2- 172.21.15.146:0/2510231356 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f9c0c4750 0x7f3f9c0cd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:33.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.631+0000 7f3f93fff700 1 -- 172.21.15.146:0/2510231356 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4243745225 0 0) 0x7f3f9c068a90 con 0x7f3f9c0c3960 2023-10-06T11:09:33.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.631+0000 7f3f93fff700 1 -- 172.21.15.146:0/2510231356 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f88003570 con 0x7f3f9c0c3960 2023-10-06T11:09:33.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.631+0000 7f3f93fff700 1 -- 172.21.15.146:0/2510231356 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4051537941 0 0) 0x7f3f88003570 con 0x7f3f9c0c3960 2023-10-06T11:09:33.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.631+0000 7f3f93fff700 1 -- 172.21.15.146:0/2510231356 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f9c0c4750 msgr2=0x7f3f9c0cd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:33.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.631+0000 7f3f93fff700 1 --2- 172.21.15.146:0/2510231356 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f9c0c4750 0x7f3f9c0cd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:33.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.631+0000 7f3f93fff700 1 -- 172.21.15.146:0/2510231356 >> v1:172.21.15.151:6789/0 conn(0x7f3f9c0b08d0 legacy=0x7f3f9c0c3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:33.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.631+0000 7f3f93fff700 1 -- 172.21.15.146:0/2510231356 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f9c0cdfd0 con 0x7f3f9c0c3960 2023-10-06T11:09:33.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.631+0000 7f3f93fff700 1 -- 172.21.15.146:0/2510231356 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f3f8c001470 con 0x7f3f9c0c3960 2023-10-06T11:09:33.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.631+0000 7f3f93fff700 1 -- 172.21.15.146:0/2510231356 >> v1:172.21.15.146:6789/0 conn(0x7f3f9c0c3960 legacy=0x7f3f9c0cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:33.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.631+0000 7f3f93fff700 1 --2- 172.21.15.146:0/2510231356 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f9c0c4750 0x7f3f88003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:33.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.631+0000 7f3f93fff700 1 --2- 172.21.15.146:0/2510231356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f88003fd0 0x7f3f88004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:33.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.631+0000 7f3f93fff700 1 --2- 172.21.15.146:0/2510231356 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f88004d50 0x7f3f880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:33.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.631+0000 7f3f93fff700 1 -- 172.21.15.146:0/2510231356 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c0cdcf0 con 0x7f3f88003fd0 2023-10-06T11:09:33.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.631+0000 7f3f93fff700 1 -- 172.21.15.146:0/2510231356 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8800bb40 con 0x7f3f88004d50 2023-10-06T11:09:33.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.631+0000 7f3f93fff700 1 -- 172.21.15.146:0/2510231356 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8800bd00 con 0x7f3f9c0c4750 2023-10-06T11:09:33.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.631+0000 7f3fa096c700 1 --2- 172.21.15.146:0/2510231356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f88003fd0 0x7f3f88004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:33.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.631+0000 7f3fa116d700 1 --2- 172.21.15.146:0/2510231356 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f9c0c4750 0x7f3f88003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:33.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.631+0000 7f3fa196e700 1 --2- 172.21.15.146:0/2510231356 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f88004d50 0x7f3f880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:33.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.631+0000 7f3fa096c700 1 -- 172.21.15.146:0/2510231356 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f9c0c4750 msgr2=0x7f3f88003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:33.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.631+0000 7f3fa096c700 1 --2- 172.21.15.146:0/2510231356 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f9c0c4750 0x7f3f88003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:33.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.631+0000 7f3fa096c700 1 -- 172.21.15.146:0/2510231356 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f88004d50 msgr2=0x7f3f880051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:33.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.631+0000 7f3fa096c700 1 --2- 172.21.15.146:0/2510231356 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f88004d50 0x7f3f880051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:33.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.631+0000 7f3fa096c700 1 -- 172.21.15.146:0/2510231356 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f88003570 con 0x7f3f88003fd0 2023-10-06T11:09:33.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.631+0000 7f3fa116d700 1 --2- 172.21.15.146:0/2510231356 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f9c0c4750 0x7f3f88003a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:33.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.632+0000 7f3fa096c700 1 --2- 172.21.15.146:0/2510231356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f88003fd0 0x7f3f88004810 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c00c390 tx=0x7f3f8c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=191652022c6b579c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:33.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.632+0000 7f3f93fff700 1 -- 172.21.15.146:0/2510231356 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c00cc60 con 0x7f3f88003fd0 2023-10-06T11:09:33.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.632+0000 7f3f93fff700 1 -- 172.21.15.146:0/2510231356 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8c00cdc0 con 0x7f3f88003fd0 2023-10-06T11:09:33.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.632+0000 7f3f93fff700 1 -- 172.21.15.146:0/2510231356 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c005b70 con 0x7f3f88003fd0 2023-10-06T11:09:33.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.632+0000 7f3fa33d1700 1 -- 172.21.15.146:0/2510231356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f88003fd0 msgr2=0x7f3f88004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:33.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.632+0000 7f3fa33d1700 1 --2- 172.21.15.146:0/2510231356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f88003fd0 0x7f3f88004810 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c00c390 tx=0x7f3f8c001e70 comp rx=0 tx=0).stop 2023-10-06T11:09:33.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.632+0000 7f3fa196e700 1 -- 172.21.15.146:0/2510231356 reap_dead start 2023-10-06T11:09:33.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.632+0000 7f3fa33d1700 1 -- 172.21.15.146:0/2510231356 shutdown_connections 2023-10-06T11:09:33.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.632+0000 7f3fa33d1700 1 -- 172.21.15.146:0/2510231356 >> 172.21.15.146:0/2510231356 conn(0x7f3f9c067c50 msgr2=0x7f3f9c0ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:33.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.632+0000 7f3fa33d1700 1 -- 172.21.15.146:0/2510231356 shutdown_connections 2023-10-06T11:09:33.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.632+0000 7f3fa33d1700 1 -- 172.21.15.146:0/2510231356 wait complete. 2023-10-06T11:09:33.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.633+0000 7f3fa33d1700 1 Processor -- start 2023-10-06T11:09:33.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.634+0000 7f3fa33d1700 1 -- start start 2023-10-06T11:09:33.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.634+0000 7f3fa33d1700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f88003fd0 0x7f3f9c16a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:33.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.634+0000 7f3fa33d1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f9c0c7ce0 0x7f3f9c155500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:33.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.634+0000 7f3fa33d1700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f9c0b2080 0x7f3f9c0c5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:33.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.634+0000 7f3fa33d1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c06bec0 con 0x7f3f9c0c7ce0 2023-10-06T11:09:33.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.634+0000 7f3fa33d1700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c06b8b0 con 0x7f3f88003fd0 2023-10-06T11:09:33.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.634+0000 7f3fa33d1700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c0c81a0 con 0x7f3f9c0b2080 2023-10-06T11:09:33.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.634+0000 7f3fa096c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f9c0c7ce0 0x7f3f9c155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:33.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.634+0000 7f3fa096c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f9c0c7ce0 0x7f3f9c155500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40108/0 (socket says 172.21.15.146:40108) 2023-10-06T11:09:33.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.635+0000 7f3fa096c700 1 -- 172.21.15.146:0/49917215 learned_addr learned my addr 172.21.15.146:0/49917215 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:33.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.635+0000 7f3fa116d700 1 --2- 172.21.15.146:0/49917215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f88003fd0 0x7f3f9c16a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:33.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.635+0000 7f3fa196e700 1 --2- 172.21.15.146:0/49917215 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f9c0b2080 0x7f3f9c0c5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:33.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.635+0000 7f3fa096c700 1 -- 172.21.15.146:0/49917215 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f9c0b2080 msgr2=0x7f3f9c0c5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:33.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.635+0000 7f3fa096c700 1 --2- 172.21.15.146:0/49917215 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f9c0b2080 0x7f3f9c0c5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:33.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.635+0000 7f3fa096c700 1 -- 172.21.15.146:0/49917215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f88003fd0 msgr2=0x7f3f9c16a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:33.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.635+0000 7f3fa096c700 1 --2- 172.21.15.146:0/49917215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f88003fd0 0x7f3f9c16a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:33.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.635+0000 7f3fa096c700 1 -- 172.21.15.146:0/49917215 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f9c06bb50 con 0x7f3f9c0c7ce0 2023-10-06T11:09:33.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.635+0000 7f3fa196e700 1 --2- 172.21.15.146:0/49917215 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f9c0b2080 0x7f3f9c0c5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:09:33.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.635+0000 7f3fa096c700 1 --2- 172.21.15.146:0/49917215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f9c0c7ce0 0x7f3f9c155500 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f3f8800bb10 tx=0x7f3f8c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:33.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.635+0000 7f3f917fa700 1 -- 172.21.15.146:0/49917215 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c00cc60 con 0x7f3f9c0c7ce0 2023-10-06T11:09:33.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.635+0000 7f3f917fa700 1 -- 172.21.15.146:0/49917215 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8c000fe0 con 0x7f3f9c0c7ce0 2023-10-06T11:09:33.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.635+0000 7f3fa33d1700 1 -- 172.21.15.146:0/49917215 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f9c0c8480 con 0x7f3f9c0c7ce0 2023-10-06T11:09:33.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.635+0000 7f3f917fa700 1 -- 172.21.15.146:0/49917215 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c0072e0 con 0x7f3f9c0c7ce0 2023-10-06T11:09:33.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.635+0000 7f3fa33d1700 1 -- 172.21.15.146:0/49917215 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f9c155f30 con 0x7f3f9c0c7ce0 2023-10-06T11:09:33.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.636+0000 7f3fa33d1700 1 -- 172.21.15.146:0/49917215 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f9c06c030 con 0x7f3f9c0c7ce0 2023-10-06T11:09:33.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.636+0000 7f3f917fa700 1 -- 172.21.15.146:0/49917215 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3f8c019030 con 0x7f3f9c0c7ce0 2023-10-06T11:09:33.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.637+0000 7f3f917fa700 1 --2- 172.21.15.146:0/49917215 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3f80066f60 0x7f3f80069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:33.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.637+0000 7f3f917fa700 1 -- 172.21.15.146:0/49917215 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f3f8c085630 con 0x7f3f9c0c7ce0 2023-10-06T11:09:33.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.637+0000 7f3fa116d700 1 --2- 172.21.15.146:0/49917215 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3f80066f60 0x7f3f80069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:33.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.637+0000 7f3fa116d700 1 --2- 172.21.15.146:0/49917215 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3f80066f60 0x7f3f80069410 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3f98000c00 tx=0x7f3f98009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:33.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.641+0000 7f3f917fa700 1 -- 172.21.15.146:0/49917215 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3f8c052af0 con 0x7f3f9c0c7ce0 2023-10-06T11:09:33.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:33.898+0000 7f3fa33d1700 1 -- 172.21.15.146:0/49917215 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]} v 0) v1 -- 0x7f3f9c04c380 con 0x7f3f9c0c7ce0 2023-10-06T11:09:34.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.167+0000 7f3f917fa700 1 -- 172.21.15.146:0/49917215 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_checks"]}]=0 v193) v1 ==== 143+0+0 (secure 0 0 0) 0x7f3f8c056110 con 0x7f3f9c0c7ce0 2023-10-06T11:09:34.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.169+0000 7f3fa33d1700 1 -- 172.21.15.146:0/49917215 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3f80066f60 msgr2=0x7f3f80069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:34.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.169+0000 7f3fa33d1700 1 --2- 172.21.15.146:0/49917215 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3f80066f60 0x7f3f80069410 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3f98000c00 tx=0x7f3f98009040 comp rx=0 tx=0).stop 2023-10-06T11:09:34.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.169+0000 7f3fa33d1700 1 -- 172.21.15.146:0/49917215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f9c0c7ce0 msgr2=0x7f3f9c155500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:34.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.169+0000 7f3fa33d1700 1 --2- 172.21.15.146:0/49917215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f9c0c7ce0 0x7f3f9c155500 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f3f8800bb10 tx=0x7f3f8c015000 comp rx=0 tx=0).stop 2023-10-06T11:09:34.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.169+0000 7f3fa33d1700 1 -- 172.21.15.146:0/49917215 shutdown_connections 2023-10-06T11:09:34.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.169+0000 7f3fa33d1700 1 --2- 172.21.15.146:0/49917215 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3f80066f60 0x7f3f80069410 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:34.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.169+0000 7f3fa33d1700 1 --2- 172.21.15.146:0/49917215 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f9c0b2080 0x7f3f9c0c5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:34.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.169+0000 7f3fa33d1700 1 --2- 172.21.15.146:0/49917215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f88003fd0 0x7f3f9c16a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:34.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.169+0000 7f3fa33d1700 1 --2- 172.21.15.146:0/49917215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f9c0c7ce0 0x7f3f9c155500 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:34.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.169+0000 7f3fa33d1700 1 -- 172.21.15.146:0/49917215 >> 172.21.15.146:0/49917215 conn(0x7f3f9c067c50 msgr2=0x7f3f9c157c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:34.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.169+0000 7f3fa33d1700 1 -- 172.21.15.146:0/49917215 shutdown_connections 2023-10-06T11:09:34.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.169+0000 7f3fa33d1700 1 -- 172.21.15.146:0/49917215 wait complete. 2023-10-06T11:09:34.183 INFO:tasks.cephfs_test_runner:test_scrub_checks (tasks.cephfs.test_scrub_checks.TestScrubChecks) ... ok 2023-10-06T11:09:34.183 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_repair (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2023-10-06T11:09:34.184 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair' 2023-10-06T11:09:34.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.297+0000 7f80c8fba700 1 Processor -- start 2023-10-06T11:09:34.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.297+0000 7f80c8fba700 1 -- start start 2023-10-06T11:09:34.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.298+0000 7f80c8fba700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f80c4153ab0 0x7f80c415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:34.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.298+0000 7f80c8fba700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80c415ac30 con 0x7f80c4068ba0 2023-10-06T11:09:34.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.298+0000 7f80c8fba700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80c40b4510 con 0x7f80c4153e80 2023-10-06T11:09:34.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.298+0000 7f80c8fba700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80c40b6530 con 0x7f80c4153ab0 2023-10-06T11:09:34.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.298+0000 7f80c259c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f80c4153ab0 0x7f80c415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:34.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.298+0000 7f80c2d9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f80c4068ba0 0x7f80c40b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39308/0 (socket says 172.21.15.146:39308) 2023-10-06T11:09:34.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.298+0000 7f80c2d9d700 1 -- 172.21.15.146:0/885911893 learned_addr learned my addr 172.21.15.146:0/885911893 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:34.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.298+0000 7f80c259c700 1 -- 172.21.15.146:0/885911893 >> v1:172.21.15.151:6789/0 conn(0x7f80c4153e80 legacy=0x7f80c4068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:34.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.298+0000 7f80c259c700 1 -- 172.21.15.146:0/885911893 >> v1:172.21.15.146:6789/0 conn(0x7f80c4068ba0 legacy=0x7f80c40b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:34.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.298+0000 7f80c259c700 1 -- 172.21.15.146:0/885911893 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c40b5c50 con 0x7f80c4153ab0 2023-10-06T11:09:34.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.298+0000 7f80c1d9b700 1 -- 172.21.15.146:0/885911893 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1693060589 0 0) 0x7f80bc001490 con 0x7f80c4068ba0 2023-10-06T11:09:34.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.299+0000 7f80c259c700 1 --2- 172.21.15.146:0/885911893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80c4153ab0 0x7f80c415a6f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f80b40098e0 tx=0x7f80b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=564d31cd72cded06 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:34.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.299+0000 7f80c1d9b700 1 -- 172.21.15.146:0/885911893 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b4009e80 con 0x7f80c4153ab0 2023-10-06T11:09:34.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.299+0000 7f80c1d9b700 1 -- 172.21.15.146:0/885911893 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b400b820 con 0x7f80c4153ab0 2023-10-06T11:09:34.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.299+0000 7f80c1d9b700 1 -- 172.21.15.146:0/885911893 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b400bba0 con 0x7f80c4153ab0 2023-10-06T11:09:34.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.299+0000 7f80c8fba700 1 -- 172.21.15.146:0/885911893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80c4153ab0 msgr2=0x7f80c415a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:34.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.299+0000 7f80c8fba700 1 --2- 172.21.15.146:0/885911893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80c4153ab0 0x7f80c415a6f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f80b40098e0 tx=0x7f80b40091a0 comp rx=0 tx=0).stop 2023-10-06T11:09:34.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.299+0000 7f80c8fba700 1 -- 172.21.15.146:0/885911893 shutdown_connections 2023-10-06T11:09:34.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.299+0000 7f80c8fba700 1 --2- 172.21.15.146:0/885911893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80c4153ab0 0x7f80c415a6f0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:34.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.299+0000 7f80c8fba700 1 -- 172.21.15.146:0/885911893 >> 172.21.15.146:0/885911893 conn(0x7f80c406eba0 msgr2=0x7f80c406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:34.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.299+0000 7f80c8fba700 1 -- 172.21.15.146:0/885911893 shutdown_connections 2023-10-06T11:09:34.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.299+0000 7f80c8fba700 1 -- 172.21.15.146:0/885911893 wait complete. 2023-10-06T11:09:34.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.300+0000 7f80c8fba700 1 Processor -- start 2023-10-06T11:09:34.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.300+0000 7f80c8fba700 1 -- start start 2023-10-06T11:09:34.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.301+0000 7f80c8fba700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80c4068ba0 0x7f80c41552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:34.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.301+0000 7f80c8fba700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80c4153ab0 0x7f80c41440f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:34.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.301+0000 7f80c8fba700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80c4153e80 0x7f80c4158d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:34.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.301+0000 7f80c8fba700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c4144630 con 0x7f80c4153ab0 2023-10-06T11:09:34.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.301+0000 7f80c8fba700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c41542e0 con 0x7f80c4068ba0 2023-10-06T11:09:34.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.301+0000 7f80c8fba700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c4154e60 con 0x7f80c4153e80 2023-10-06T11:09:34.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.301+0000 7f80bbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80c4153ab0 0x7f80c41440f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:34.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.301+0000 7f80bbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80c4153ab0 0x7f80c41440f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40124/0 (socket says 172.21.15.146:40124) 2023-10-06T11:09:34.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.301+0000 7f80bbfff700 1 -- 172.21.15.146:0/3196622018 learned_addr learned my addr 172.21.15.146:0/3196622018 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:34.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.301+0000 7f80c259c700 1 --2- 172.21.15.146:0/3196622018 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80c4068ba0 0x7f80c41552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:34.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.301+0000 7f80c2d9d700 1 --2- 172.21.15.146:0/3196622018 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80c4153e80 0x7f80c4158d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:34.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.301+0000 7f80bbfff700 1 -- 172.21.15.146:0/3196622018 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80c4153e80 msgr2=0x7f80c4158d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:34.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.301+0000 7f80bbfff700 1 --2- 172.21.15.146:0/3196622018 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80c4153e80 0x7f80c4158d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:34.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.301+0000 7f80bbfff700 1 -- 172.21.15.146:0/3196622018 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80c4068ba0 msgr2=0x7f80c41552f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:34.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.301+0000 7f80bbfff700 1 --2- 172.21.15.146:0/3196622018 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80c4068ba0 0x7f80c41552f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:34.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.302+0000 7f80bbfff700 1 -- 172.21.15.146:0/3196622018 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b4009420 con 0x7f80c4153ab0 2023-10-06T11:09:34.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.302+0000 7f80bbfff700 1 --2- 172.21.15.146:0/3196622018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80c4153ab0 0x7f80c41440f0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f80ac00c5d0 tx=0x7f80ac007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:34.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.302+0000 7f80ba7fc700 1 -- 172.21.15.146:0/3196622018 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac011590 con 0x7f80c4153ab0 2023-10-06T11:09:34.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.302+0000 7f80ba7fc700 1 -- 172.21.15.146:0/3196622018 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ac011710 con 0x7f80c4153ab0 2023-10-06T11:09:34.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.302+0000 7f80c8fba700 1 -- 172.21.15.146:0/3196622018 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80c40b29d0 con 0x7f80c4153ab0 2023-10-06T11:09:34.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.302+0000 7f80ba7fc700 1 -- 172.21.15.146:0/3196622018 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac011ad0 con 0x7f80c4153ab0 2023-10-06T11:09:34.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.302+0000 7f80c8fba700 1 -- 172.21.15.146:0/3196622018 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80c4154810 con 0x7f80c4153ab0 2023-10-06T11:09:34.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.303+0000 7f80c8fba700 1 -- 172.21.15.146:0/3196622018 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80c4155010 con 0x7f80c4153ab0 2023-10-06T11:09:34.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.303+0000 7f80ba7fc700 1 -- 172.21.15.146:0/3196622018 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f80ac01c460 con 0x7f80c4153ab0 2023-10-06T11:09:34.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.303+0000 7f80ba7fc700 1 --2- 172.21.15.146:0/3196622018 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f80a4066f30 0x7f80a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:34.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.304+0000 7f80ba7fc700 1 -- 172.21.15.146:0/3196622018 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f80ac084150 con 0x7f80c4153ab0 2023-10-06T11:09:34.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.304+0000 7f80c259c700 1 --2- 172.21.15.146:0/3196622018 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f80a4066f30 0x7f80a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:34.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.304+0000 7f80c259c700 1 --2- 172.21.15.146:0/3196622018 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f80a4066f30 0x7f80a40693e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f80b40091e0 tx=0x7f80b4016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:34.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.308+0000 7f80ba7fc700 1 -- 172.21.15.146:0/3196622018 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f80c4155010 con 0x7f80c4153ab0 2023-10-06T11:09:34.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:34.565+0000 7f80c8fba700 1 -- 172.21.15.146:0/3196622018 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]} v 0) v1 -- 0x7f80c4154fd0 con 0x7f80c4153ab0 2023-10-06T11:09:35.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.166+0000 7f80ba7fc700 1 -- 172.21.15.146:0/3196622018 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]}]=0 v194) v1 ==== 146+0+0 (secure 0 0 0) 0x7f80ac051560 con 0x7f80c4153ab0 2023-10-06T11:09:35.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.169+0000 7f80c8fba700 1 -- 172.21.15.146:0/3196622018 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f80a4066f30 msgr2=0x7f80a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:35.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.169+0000 7f80c8fba700 1 --2- 172.21.15.146:0/3196622018 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f80a4066f30 0x7f80a40693e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f80b40091e0 tx=0x7f80b4016000 comp rx=0 tx=0).stop 2023-10-06T11:09:35.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.169+0000 7f80c8fba700 1 -- 172.21.15.146:0/3196622018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80c4153ab0 msgr2=0x7f80c41440f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:35.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.169+0000 7f80c8fba700 1 --2- 172.21.15.146:0/3196622018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80c4153ab0 0x7f80c41440f0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f80ac00c5d0 tx=0x7f80ac007f60 comp rx=0 tx=0).stop 2023-10-06T11:09:35.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.169+0000 7f80c8fba700 1 -- 172.21.15.146:0/3196622018 shutdown_connections 2023-10-06T11:09:35.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.169+0000 7f80c8fba700 1 --2- 172.21.15.146:0/3196622018 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f80a4066f30 0x7f80a40693e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:35.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.169+0000 7f80c8fba700 1 --2- 172.21.15.146:0/3196622018 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80c4153e80 0x7f80c4158d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:35.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.169+0000 7f80c8fba700 1 --2- 172.21.15.146:0/3196622018 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80c4068ba0 0x7f80c41552f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:35.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.169+0000 7f80c8fba700 1 --2- 172.21.15.146:0/3196622018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80c4153ab0 0x7f80c41440f0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:35.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.169+0000 7f80c8fba700 1 -- 172.21.15.146:0/3196622018 >> 172.21.15.146:0/3196622018 conn(0x7f80c406eba0 msgr2=0x7f80c4151f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:35.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.169+0000 7f80c8fba700 1 -- 172.21.15.146:0/3196622018 shutdown_connections 2023-10-06T11:09:35.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.169+0000 7f80c8fba700 1 -- 172.21.15.146:0/3196622018 wait complete. 2023-10-06T11:09:35.184 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T11:09:35.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.302+0000 7f5896d76700 1 Processor -- start 2023-10-06T11:09:35.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.302+0000 7f5896d76700 1 -- start start 2023-10-06T11:09:35.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.303+0000 7f5896d76700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f58900b5640 0x7f589015a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:35.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.303+0000 7f5896d76700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f58900cb090 0x7f58900cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:35.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.303+0000 7f5896d76700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58900cc130 con 0x7f5890068780 2023-10-06T11:09:35.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.303+0000 7f5896d76700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58900b2660 con 0x7f58900b5640 2023-10-06T11:09:35.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.303+0000 7f5896d76700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f589015adb0 con 0x7f58900cb090 2023-10-06T11:09:35.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.303+0000 7f5895d74700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f58900b5640 0x7f589015a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:35.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.303+0000 7f5896575700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f5890068780 0x7f589015b010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39316/0 (socket says 172.21.15.146:39316) 2023-10-06T11:09:35.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.303+0000 7f5896575700 1 -- 172.21.15.146:0/909646169 learned_addr learned my addr 172.21.15.146:0/909646169 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:35.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.303+0000 7f5895573700 1 --2- 172.21.15.146:0/909646169 >> v2:172.21.15.151:3300/0 conn(0x7f58900cb090 0x7f58900cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:35.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.304+0000 7f5895d74700 1 -- 172.21.15.146:0/909646169 >> v2:172.21.15.151:3300/0 conn(0x7f58900cb090 msgr2=0x7f58900cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:35.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.304+0000 7f5895d74700 1 --2- 172.21.15.146:0/909646169 >> v2:172.21.15.151:3300/0 conn(0x7f58900cb090 0x7f58900cc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:35.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.304+0000 7f5895d74700 1 -- 172.21.15.146:0/909646169 >> v1:172.21.15.146:6789/0 conn(0x7f5890068780 legacy=0x7f589015b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:35.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.304+0000 7f5895d74700 1 -- 172.21.15.146:0/909646169 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58900cb520 con 0x7f58900b5640 2023-10-06T11:09:35.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.304+0000 7f5894d72700 1 -- 172.21.15.146:0/909646169 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4089174474 0 0) 0x7f58900cc130 con 0x7f5890068780 2023-10-06T11:09:35.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.304+0000 7f5895d74700 1 --2- 172.21.15.146:0/909646169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58900b5640 0x7f589015a870 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f5890159e40 tx=0x7f588c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62f7b4935d031940 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:35.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.304+0000 7f5894d72700 1 -- 172.21.15.146:0/909646169 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588c011630 con 0x7f58900b5640 2023-10-06T11:09:35.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.304+0000 7f5894d72700 1 -- 172.21.15.146:0/909646169 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588c011790 con 0x7f58900b5640 2023-10-06T11:09:35.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.304+0000 7f5894d72700 1 -- 172.21.15.146:0/909646169 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588c011b30 con 0x7f58900b5640 2023-10-06T11:09:35.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.304+0000 7f5896d76700 1 -- 172.21.15.146:0/909646169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58900b5640 msgr2=0x7f589015a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:35.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.304+0000 7f5896d76700 1 --2- 172.21.15.146:0/909646169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58900b5640 0x7f589015a870 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f5890159e40 tx=0x7f588c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:09:35.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.304+0000 7f5896d76700 1 -- 172.21.15.146:0/909646169 shutdown_connections 2023-10-06T11:09:35.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.304+0000 7f5896d76700 1 --2- 172.21.15.146:0/909646169 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58900b5640 0x7f589015a870 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:35.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.304+0000 7f5896d76700 1 --2- 172.21.15.146:0/909646169 >> v2:172.21.15.151:3300/0 conn(0x7f58900cb090 0x7f58900cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:35.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.304+0000 7f5896d76700 1 -- 172.21.15.146:0/909646169 >> 172.21.15.146:0/909646169 conn(0x7f58900703f0 msgr2=0x7f58900707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:35.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.304+0000 7f5896d76700 1 -- 172.21.15.146:0/909646169 shutdown_connections 2023-10-06T11:09:35.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.304+0000 7f5896d76700 1 -- 172.21.15.146:0/909646169 wait complete. 2023-10-06T11:09:35.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.306+0000 7f5896d76700 1 Processor -- start 2023-10-06T11:09:35.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.306+0000 7f5896d76700 1 -- start start 2023-10-06T11:09:35.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.306+0000 7f5896d76700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5890068780 0x7f58900c3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:35.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.306+0000 7f5896d76700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58900b5640 0x7f5890153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:35.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.306+0000 7f5896d76700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58900cb090 0x7f58900c6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:35.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.306+0000 7f5896d76700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f589015ec60 con 0x7f58900cb090 2023-10-06T11:09:35.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.306+0000 7f5896d76700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58900c4050 con 0x7f5890068780 2023-10-06T11:09:35.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.306+0000 7f5896d76700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58900d11c0 con 0x7f58900b5640 2023-10-06T11:09:35.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.306+0000 7f5896575700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58900cb090 0x7f58900c6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:35.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.306+0000 7f5896575700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58900cb090 0x7f58900c6220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40132/0 (socket says 172.21.15.146:40132) 2023-10-06T11:09:35.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.306+0000 7f5896575700 1 -- 172.21.15.146:0/3839386079 learned_addr learned my addr 172.21.15.146:0/3839386079 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:35.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.307+0000 7f5895573700 1 --2- 172.21.15.146:0/3839386079 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58900b5640 0x7f5890153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:35.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.307+0000 7f5895d74700 1 --2- 172.21.15.146:0/3839386079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5890068780 0x7f58900c3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:35.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.307+0000 7f5896575700 1 -- 172.21.15.146:0/3839386079 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58900b5640 msgr2=0x7f5890153bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:35.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.307+0000 7f5896575700 1 --2- 172.21.15.146:0/3839386079 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58900b5640 0x7f5890153bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:35.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.307+0000 7f5896575700 1 -- 172.21.15.146:0/3839386079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5890068780 msgr2=0x7f58900c3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:35.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.307+0000 7f5896575700 1 --2- 172.21.15.146:0/3839386079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5890068780 0x7f58900c3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:35.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.307+0000 7f5896575700 1 -- 172.21.15.146:0/3839386079 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f588c009420 con 0x7f58900cb090 2023-10-06T11:09:35.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.307+0000 7f5896575700 1 --2- 172.21.15.146:0/3839386079 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58900cb090 0x7f58900c6220 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f588800cbf0 tx=0x7f58880019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:35.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.307+0000 7f5885ffb700 1 -- 172.21.15.146:0/3839386079 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588800a8b0 con 0x7f58900cb090 2023-10-06T11:09:35.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.307+0000 7f5885ffb700 1 -- 172.21.15.146:0/3839386079 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588800aa10 con 0x7f58900cb090 2023-10-06T11:09:35.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.307+0000 7f5896d76700 1 -- 172.21.15.146:0/3839386079 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5890154100 con 0x7f58900cb090 2023-10-06T11:09:35.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.307+0000 7f5885ffb700 1 -- 172.21.15.146:0/3839386079 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588800add0 con 0x7f58900cb090 2023-10-06T11:09:35.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.307+0000 7f5896d76700 1 -- 172.21.15.146:0/3839386079 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f589015e610 con 0x7f58900cb090 2023-10-06T11:09:35.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.308+0000 7f5896d76700 1 -- 172.21.15.146:0/3839386079 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f589015ee10 con 0x7f58900cb090 2023-10-06T11:09:35.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.309+0000 7f5885ffb700 1 -- 172.21.15.146:0/3839386079 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5888007300 con 0x7f58900cb090 2023-10-06T11:09:35.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.309+0000 7f5885ffb700 1 --2- 172.21.15.146:0/3839386079 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5874066f30 0x7f58740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:35.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.309+0000 7f5885ffb700 1 -- 172.21.15.146:0/3839386079 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f5888084660 con 0x7f58900cb090 2023-10-06T11:09:35.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.309+0000 7f5895d74700 1 --2- 172.21.15.146:0/3839386079 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5874066f30 0x7f58740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:35.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.309+0000 7f5895d74700 1 --2- 172.21.15.146:0/3839386079 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5874066f30 0x7f58740693e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f588c0093f0 tx=0x7f588c017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:35.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.313+0000 7f5885ffb700 1 -- 172.21.15.146:0/3839386079 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f589015ee10 con 0x7f58900cb090 2023-10-06T11:09:35.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.495+0000 7f5896d76700 1 -- 172.21.15.146:0/3839386079 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f589015eda0 con 0x7f58900cb090 2023-10-06T11:09:35.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.502+0000 7f5885ffb700 1 -- 172.21.15.146:0/3839386079 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5888051af0 con 0x7f58900cb090 2023-10-06T11:09:35.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.505+0000 7f5896d76700 1 -- 172.21.15.146:0/3839386079 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5874066f30 msgr2=0x7f58740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:35.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.505+0000 7f5896d76700 1 --2- 172.21.15.146:0/3839386079 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5874066f30 0x7f58740693e0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f588c0093f0 tx=0x7f588c017000 comp rx=0 tx=0).stop 2023-10-06T11:09:35.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.505+0000 7f5896d76700 1 -- 172.21.15.146:0/3839386079 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58900cb090 msgr2=0x7f58900c6220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:35.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.505+0000 7f5896d76700 1 --2- 172.21.15.146:0/3839386079 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58900cb090 0x7f58900c6220 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f588800cbf0 tx=0x7f58880019b0 comp rx=0 tx=0).stop 2023-10-06T11:09:35.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.505+0000 7f5896d76700 1 -- 172.21.15.146:0/3839386079 shutdown_connections 2023-10-06T11:09:35.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.505+0000 7f5896d76700 1 --2- 172.21.15.146:0/3839386079 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5874066f30 0x7f58740693e0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:35.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.505+0000 7f5896d76700 1 --2- 172.21.15.146:0/3839386079 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58900cb090 0x7f58900c6220 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:35.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.505+0000 7f5896d76700 1 --2- 172.21.15.146:0/3839386079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5890068780 0x7f58900c3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:35.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.505+0000 7f5896d76700 1 --2- 172.21.15.146:0/3839386079 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58900b5640 0x7f5890153bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:35.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.505+0000 7f5896d76700 1 -- 172.21.15.146:0/3839386079 >> 172.21.15.146:0/3839386079 conn(0x7f58900703f0 msgr2=0x7f589015c660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:35.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.505+0000 7f5896d76700 1 -- 172.21.15.146:0/3839386079 shutdown_connections 2023-10-06T11:09:35.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.505+0000 7f5896d76700 1 -- 172.21.15.146:0/3839386079 wait complete. 2023-10-06T11:09:35.519 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T11:09:35.519 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:09:35.552 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:09:35.592 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T11:09:35.592 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T11:09:35.592 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:09:35.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.706+0000 7f48d135c700 1 Processor -- start 2023-10-06T11:09:35.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.706+0000 7f48d135c700 1 -- start start 2023-10-06T11:09:35.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.707+0000 7f48d135c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f48cc068ba0 0x7f48cc15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:35.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.707+0000 7f48d135c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48cc15ac30 con 0x7f48cc153e80 2023-10-06T11:09:35.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.707+0000 7f48d135c700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48cc0b4510 con 0x7f48cc153ab0 2023-10-06T11:09:35.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.707+0000 7f48d135c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48cc0b6530 con 0x7f48cc068ba0 2023-10-06T11:09:35.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.707+0000 7f48c27fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f48cc068ba0 0x7f48cc15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:35.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.707+0000 7f48cb7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f48cc153e80 0x7f48cc0b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39318/0 (socket says 172.21.15.146:39318) 2023-10-06T11:09:35.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.707+0000 7f48cb7fe700 1 -- 172.21.15.146:0/2423102004 learned_addr learned my addr 172.21.15.146:0/2423102004 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:35.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.707+0000 7f48c27fc700 1 -- 172.21.15.146:0/2423102004 >> v1:172.21.15.151:6789/0 conn(0x7f48cc153ab0 legacy=0x7f48cc068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:35.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.707+0000 7f48c27fc700 1 -- 172.21.15.146:0/2423102004 >> v1:172.21.15.146:6789/0 conn(0x7f48cc153e80 legacy=0x7f48cc0b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:35.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.707+0000 7f48c27fc700 1 -- 172.21.15.146:0/2423102004 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48cc0b5c50 con 0x7f48cc068ba0 2023-10-06T11:09:35.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.707+0000 7f48c27fc700 1 --2- 172.21.15.146:0/2423102004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48cc068ba0 0x7f48cc15a6f0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f48b40098e0 tx=0x7f48b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b8e1473ab8bb0a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:35.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.708+0000 7f48ca7fc700 1 -- 172.21.15.146:0/2423102004 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b4009e80 con 0x7f48cc068ba0 2023-10-06T11:09:35.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.708+0000 7f48ca7fc700 1 -- 172.21.15.146:0/2423102004 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b400b860 con 0x7f48cc068ba0 2023-10-06T11:09:35.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.708+0000 7f48ca7fc700 1 -- 172.21.15.146:0/2423102004 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b400bbe0 con 0x7f48cc068ba0 2023-10-06T11:09:35.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.708+0000 7f48d135c700 1 -- 172.21.15.146:0/2423102004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48cc068ba0 msgr2=0x7f48cc15a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:35.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.708+0000 7f48d135c700 1 --2- 172.21.15.146:0/2423102004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48cc068ba0 0x7f48cc15a6f0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f48b40098e0 tx=0x7f48b40091a0 comp rx=0 tx=0).stop 2023-10-06T11:09:35.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.708+0000 7f48d135c700 1 -- 172.21.15.146:0/2423102004 shutdown_connections 2023-10-06T11:09:35.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.708+0000 7f48d135c700 1 --2- 172.21.15.146:0/2423102004 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48cc068ba0 0x7f48cc15a6f0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:35.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.708+0000 7f48d135c700 1 -- 172.21.15.146:0/2423102004 >> 172.21.15.146:0/2423102004 conn(0x7f48cc06eba0 msgr2=0x7f48cc06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:35.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.708+0000 7f48d135c700 1 -- 172.21.15.146:0/2423102004 shutdown_connections 2023-10-06T11:09:35.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.708+0000 7f48d135c700 1 -- 172.21.15.146:0/2423102004 wait complete. 2023-10-06T11:09:35.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.709+0000 7f48d135c700 1 Processor -- start 2023-10-06T11:09:35.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.709+0000 7f48d135c700 1 -- start start 2023-10-06T11:09:35.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.710+0000 7f48d135c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f48cc068ba0 0x7f48cc16c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:35.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.710+0000 7f48d135c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48cc153ab0 0x7f48cc0c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:35.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.710+0000 7f48d135c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48cc153e80 0x7f48cc0c58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:35.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.710+0000 7f48d135c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc155f50 con 0x7f48cc153e80 2023-10-06T11:09:35.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.710+0000 7f48d135c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc155340 con 0x7f48cc153ab0 2023-10-06T11:09:35.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.710+0000 7f48d135c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc155620 con 0x7f48cc068ba0 2023-10-06T11:09:35.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.710+0000 7f48cb7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48cc153e80 0x7f48cc0c58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:35.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.710+0000 7f48cb7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48cc153e80 0x7f48cc0c58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40144/0 (socket says 172.21.15.146:40144) 2023-10-06T11:09:35.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.710+0000 7f48cb7fe700 1 -- 172.21.15.146:0/283880485 learned_addr learned my addr 172.21.15.146:0/283880485 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:35.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.710+0000 7f48cb7fe700 1 -- 172.21.15.146:0/283880485 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f48cc068ba0 msgr2=0x7f48cc16c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:35.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.710+0000 7f48cb7fe700 1 --2- 172.21.15.146:0/283880485 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f48cc068ba0 0x7f48cc16c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:35.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.710+0000 7f48cb7fe700 1 -- 172.21.15.146:0/283880485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48cc153ab0 msgr2=0x7f48cc0c53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:35.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.710+0000 7f48c27fc700 1 --2- 172.21.15.146:0/283880485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48cc153ab0 0x7f48cc0c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:35.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.711+0000 7f48cb7fe700 1 --2- 172.21.15.146:0/283880485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48cc153ab0 0x7f48cc0c53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:35.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.711+0000 7f48cb7fe700 1 -- 172.21.15.146:0/283880485 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b4009420 con 0x7f48cc153e80 2023-10-06T11:09:35.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.711+0000 7f48cb7fe700 1 --2- 172.21.15.146:0/283880485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48cc153e80 0x7f48cc0c58e0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f48c400cc40 tx=0x7f48c4001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:35.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.711+0000 7f48c37fe700 1 -- 172.21.15.146:0/283880485 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c400a9c0 con 0x7f48cc153e80 2023-10-06T11:09:35.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.711+0000 7f48c37fe700 1 -- 172.21.15.146:0/283880485 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c400ab20 con 0x7f48cc153e80 2023-10-06T11:09:35.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.711+0000 7f48d135c700 1 -- 172.21.15.146:0/283880485 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48cc155900 con 0x7f48cc153e80 2023-10-06T11:09:35.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.711+0000 7f48c37fe700 1 -- 172.21.15.146:0/283880485 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c40070f0 con 0x7f48cc153e80 2023-10-06T11:09:35.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.711+0000 7f48d135c700 1 -- 172.21.15.146:0/283880485 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48cc16ce60 con 0x7f48cc153e80 2023-10-06T11:09:35.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.712+0000 7f48d135c700 1 -- 172.21.15.146:0/283880485 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48cc04c380 con 0x7f48cc153e80 2023-10-06T11:09:35.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.712+0000 7f48c37fe700 1 -- 172.21.15.146:0/283880485 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f48c40074e0 con 0x7f48cc153e80 2023-10-06T11:09:35.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.712+0000 7f48c37fe700 1 --2- 172.21.15.146:0/283880485 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f48ac066f30 0x7f48ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:35.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.713+0000 7f48c37fe700 1 -- 172.21.15.146:0/283880485 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f48c4084600 con 0x7f48cc153e80 2023-10-06T11:09:35.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.713+0000 7f48caffd700 1 --2- 172.21.15.146:0/283880485 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f48ac066f30 0x7f48ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:35.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.713+0000 7f48caffd700 1 --2- 172.21.15.146:0/283880485 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f48ac066f30 0x7f48ac0693e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f48bc007fd0 tx=0x7f48bc007b20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:35.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.717+0000 7f48c37fe700 1 -- 172.21.15.146:0/283880485 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f48c4051b40 con 0x7f48cc153e80 2023-10-06T11:09:35.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.941+0000 7f48d135c700 1 -- 172.21.15.146:0/283880485 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f48cc15ac30 con 0x7f48cc153e80 2023-10-06T11:09:35.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.941+0000 7f48c37fe700 1 -- 172.21.15.146:0/283880485 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+3538 (secure 0 0 0) 0x7f48cc15ac30 con 0x7f48cc153e80 2023-10-06T11:09:35.943 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:09:35.944 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":42,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5248,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3360977916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3360977916},{"type":"v1","addr":"172.21.15.151:6834","nonce":3360977916}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5251,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2265934004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":2265934004},{"type":"v1","addr":"172.21.15.151:6835","nonce":2265934004}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":5478,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2387575667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2387575667},{"type":"v1","addr":"172.21.15.146:6836","nonce":2387575667}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":30},{"gid":6222,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/831536706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":831536706},{"type":"v1","addr":"172.21.15.146:6837","nonce":831536706}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[]} 2023-10-06T11:09:35.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.944+0000 7f48d135c700 1 -- 172.21.15.146:0/283880485 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f48ac066f30 msgr2=0x7f48ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:35.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.944+0000 7f48d135c700 1 --2- 172.21.15.146:0/283880485 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f48ac066f30 0x7f48ac0693e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f48bc007fd0 tx=0x7f48bc007b20 comp rx=0 tx=0).stop 2023-10-06T11:09:35.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.944+0000 7f48d135c700 1 -- 172.21.15.146:0/283880485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48cc153e80 msgr2=0x7f48cc0c58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:35.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.944+0000 7f48d135c700 1 --2- 172.21.15.146:0/283880485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48cc153e80 0x7f48cc0c58e0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f48c400cc40 tx=0x7f48c4001a50 comp rx=0 tx=0).stop 2023-10-06T11:09:35.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.944+0000 7f48d135c700 1 -- 172.21.15.146:0/283880485 shutdown_connections 2023-10-06T11:09:35.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.944+0000 7f48d135c700 1 --2- 172.21.15.146:0/283880485 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f48ac066f30 0x7f48ac0693e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:35.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.944+0000 7f48d135c700 1 --2- 172.21.15.146:0/283880485 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48cc153e80 0x7f48cc0c58e0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:35.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.944+0000 7f48d135c700 1 --2- 172.21.15.146:0/283880485 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f48cc068ba0 0x7f48cc16c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:35.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.944+0000 7f48d135c700 1 --2- 172.21.15.146:0/283880485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48cc153ab0 0x7f48cc0c53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:35.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.944+0000 7f48d135c700 1 -- 172.21.15.146:0/283880485 >> 172.21.15.146:0/283880485 conn(0x7f48cc06eba0 msgr2=0x7f48cc0cf5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:35.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.944+0000 7f48d135c700 1 -- 172.21.15.146:0/283880485 shutdown_connections 2023-10-06T11:09:35.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:35.944+0000 7f48d135c700 1 -- 172.21.15.146:0/283880485 wait complete. 2023-10-06T11:09:35.947 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 42 2023-10-06T11:09:35.958 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T11:09:35.958 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T11:09:35.959 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T11:09:35.959 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:09:35.959 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T11:09:35.959 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T11:09:35.959 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T11:09:35.959 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:09:35.960 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T11:09:35.960 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T11:09:35.960 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T11:09:35.960 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:09:35.960 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T11:09:35.960 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T11:09:35.961 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T11:09:35.961 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:09:35.968 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T11:09:35.968 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T11:09:35.969 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T11:09:35.969 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T11:09:35.971 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T11:09:35.972 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T11:09:35.972 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T11:09:35.973 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T11:09:36.011 INFO:tasks.ceph.mds.a:Started 2023-10-06T11:09:36.011 DEBUG:teuthology.parallel:result is None 2023-10-06T11:09:36.011 INFO:tasks.ceph.mds.c:Started 2023-10-06T11:09:36.012 DEBUG:teuthology.parallel:result is None 2023-10-06T11:09:36.014 INFO:tasks.ceph.mds.b:Started 2023-10-06T11:09:36.014 DEBUG:teuthology.parallel:result is None 2023-10-06T11:09:36.014 INFO:tasks.ceph.mds.d:Started 2023-10-06T11:09:36.015 DEBUG:teuthology.parallel:result is None 2023-10-06T11:09:36.015 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T11:09:36.084 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2023-10-06T11:09:36.084 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2023-10-06T11:09:36.095 INFO:tasks.ceph.mds.b.smithi151.stdout:starting mds.b at 2023-10-06T11:09:36.096 INFO:tasks.ceph.mds.d.smithi151.stdout:starting mds.d at 2023-10-06T11:09:36.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.135+0000 7f9e5cd72700 1 Processor -- start 2023-10-06T11:09:36.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.135+0000 7f9e5cd72700 1 -- start start 2023-10-06T11:09:36.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.136+0000 7f9e5cd72700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9e5815a160 0x7f9e580c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:36.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.136+0000 7f9e5cd72700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9e580ae730 0x7f9e580aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:36.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.136+0000 7f9e5cd72700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e580ce3d0 0x7f9e580ce810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:36.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.136+0000 7f9e5cd72700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e580ae2a0 con 0x7f9e580ae730 2023-10-06T11:09:36.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.136+0000 7f9e5cd72700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e5815a530 con 0x7f9e5815a160 2023-10-06T11:09:36.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.136+0000 7f9e5cd72700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e580af0f0 con 0x7f9e580ce3d0 2023-10-06T11:09:36.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.136+0000 7f9e4dd9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9e580ae730 0x7f9e580aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:36.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.136+0000 7f9e4dd9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9e580ae730 0x7f9e580aebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40204/0 (socket says 172.21.15.146:40204) 2023-10-06T11:09:36.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.136+0000 7f9e4dd9b700 1 -- 172.21.15.146:0/3074282779 learned_addr learned my addr 172.21.15.146:0/3074282779 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:36.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.137+0000 7f9e56d9d700 1 --2- 172.21.15.146:0/3074282779 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e580ce3d0 0x7f9e580ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:36.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.137+0000 7f9e5659c700 1 --2- 172.21.15.146:0/3074282779 >> v2:172.21.15.151:3300/0 conn(0x7f9e5815a160 0x7f9e580c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:36.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.137+0000 7f9e4dd9b700 1 -- 172.21.15.146:0/3074282779 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e580ce3d0 msgr2=0x7f9e580ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:36.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.137+0000 7f9e4dd9b700 1 --2- 172.21.15.146:0/3074282779 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e580ce3d0 0x7f9e580ce810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:36.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.137+0000 7f9e4dd9b700 1 -- 172.21.15.146:0/3074282779 >> v2:172.21.15.151:3300/0 conn(0x7f9e5815a160 msgr2=0x7f9e580c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:36.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.137+0000 7f9e4dd9b700 1 --2- 172.21.15.146:0/3074282779 >> v2:172.21.15.151:3300/0 conn(0x7f9e5815a160 0x7f9e580c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:36.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.137+0000 7f9e4dd9b700 1 -- 172.21.15.146:0/3074282779 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e580ad690 con 0x7f9e580ae730 2023-10-06T11:09:36.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.137+0000 7f9e4dd9b700 1 --2- 172.21.15.146:0/3074282779 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e580ae730 0x7f9e580aebb0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f9e58065100 tx=0x7f9e40009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8fe25176675806c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:36.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.137+0000 7f9e55d9b700 1 -- 172.21.15.146:0/3074282779 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4000b640 con 0x7f9e580ae730 2023-10-06T11:09:36.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.137+0000 7f9e55d9b700 1 -- 172.21.15.146:0/3074282779 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e4000b7a0 con 0x7f9e580ae730 2023-10-06T11:09:36.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.137+0000 7f9e55d9b700 1 -- 172.21.15.146:0/3074282779 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4000bb60 con 0x7f9e580ae730 2023-10-06T11:09:36.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.137+0000 7f9e5cd72700 1 -- 172.21.15.146:0/3074282779 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e580ae730 msgr2=0x7f9e580aebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:36.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.137+0000 7f9e5cd72700 1 --2- 172.21.15.146:0/3074282779 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e580ae730 0x7f9e580aebb0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f9e58065100 tx=0x7f9e40009250 comp rx=0 tx=0).stop 2023-10-06T11:09:36.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.138+0000 7f9e5cd72700 1 -- 172.21.15.146:0/3074282779 shutdown_connections 2023-10-06T11:09:36.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.138+0000 7f9e5cd72700 1 --2- 172.21.15.146:0/3074282779 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e580ce3d0 0x7f9e580ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:36.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.138+0000 7f9e5cd72700 1 --2- 172.21.15.146:0/3074282779 >> v2:172.21.15.151:3300/0 conn(0x7f9e5815a160 0x7f9e580c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:36.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.138+0000 7f9e5cd72700 1 --2- 172.21.15.146:0/3074282779 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e580ae730 0x7f9e580aebb0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:36.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.138+0000 7f9e5cd72700 1 -- 172.21.15.146:0/3074282779 >> 172.21.15.146:0/3074282779 conn(0x7f9e5806f380 msgr2=0x7f9e580d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:36.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.138+0000 7f9e5cd72700 1 -- 172.21.15.146:0/3074282779 shutdown_connections 2023-10-06T11:09:36.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.138+0000 7f9e5cd72700 1 -- 172.21.15.146:0/3074282779 wait complete. 2023-10-06T11:09:36.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.139+0000 7f9e5cd72700 1 Processor -- start 2023-10-06T11:09:36.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.139+0000 7f9e5cd72700 1 -- start start 2023-10-06T11:09:36.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.139+0000 7f9e5cd72700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e580ae730 0x7f9e581569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:36.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.140+0000 7f9e5cd72700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e580ce3d0 0x7f9e5815e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:36.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.140+0000 7f9e5cd72700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e5815a160 0x7f9e580b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:36.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.140+0000 7f9e5cd72700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e58157930 con 0x7f9e580ae730 2023-10-06T11:09:36.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.140+0000 7f9e5cd72700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5815eec0 con 0x7f9e580ce3d0 2023-10-06T11:09:36.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.140+0000 7f9e5cd72700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5815f1a0 con 0x7f9e5815a160 2023-10-06T11:09:36.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.140+0000 7f9e5659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e580ae730 0x7f9e581569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:36.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.140+0000 7f9e5659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e580ae730 0x7f9e581569b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40208/0 (socket says 172.21.15.146:40208) 2023-10-06T11:09:36.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.140+0000 7f9e5659c700 1 -- 172.21.15.146:0/3699074603 learned_addr learned my addr 172.21.15.146:0/3699074603 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:36.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.140+0000 7f9e56d9d700 1 --2- 172.21.15.146:0/3699074603 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e5815a160 0x7f9e580b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:36.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.140+0000 7f9e4dd9b700 1 --2- 172.21.15.146:0/3699074603 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e580ce3d0 0x7f9e5815e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:36.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.140+0000 7f9e5659c700 1 -- 172.21.15.146:0/3699074603 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e5815a160 msgr2=0x7f9e580b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:36.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.140+0000 7f9e5659c700 1 --2- 172.21.15.146:0/3699074603 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e5815a160 0x7f9e580b3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:36.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.140+0000 7f9e5659c700 1 -- 172.21.15.146:0/3699074603 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e580ce3d0 msgr2=0x7f9e5815e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:36.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.140+0000 7f9e5659c700 1 --2- 172.21.15.146:0/3699074603 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e580ce3d0 0x7f9e5815e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:36.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.140+0000 7f9e5659c700 1 -- 172.21.15.146:0/3699074603 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e400094f0 con 0x7f9e580ae730 2023-10-06T11:09:36.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.140+0000 7f9e5659c700 1 --2- 172.21.15.146:0/3699074603 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e580ae730 0x7f9e581569b0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f9e4800ec80 tx=0x7f9e48009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:36.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.140+0000 7f9e4effd700 1 -- 172.21.15.146:0/3699074603 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4800c850 con 0x7f9e580ae730 2023-10-06T11:09:36.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.140+0000 7f9e4effd700 1 -- 172.21.15.146:0/3699074603 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e4800c9b0 con 0x7f9e580ae730 2023-10-06T11:09:36.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.140+0000 7f9e5cd72700 1 -- 172.21.15.146:0/3699074603 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e5815f480 con 0x7f9e580ae730 2023-10-06T11:09:36.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.140+0000 7f9e4effd700 1 -- 172.21.15.146:0/3699074603 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4800cd30 con 0x7f9e580ae730 2023-10-06T11:09:36.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.140+0000 7f9e5cd72700 1 -- 172.21.15.146:0/3699074603 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e5815eab0 con 0x7f9e580ae730 2023-10-06T11:09:36.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.141+0000 7f9e5cd72700 1 -- 172.21.15.146:0/3699074603 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e58157c10 con 0x7f9e580ae730 2023-10-06T11:09:36.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.142+0000 7f9e4effd700 1 -- 172.21.15.146:0/3699074603 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9e48013680 con 0x7f9e580ae730 2023-10-06T11:09:36.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.142+0000 7f9e4effd700 1 --2- 172.21.15.146:0/3699074603 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9e38066f30 0x7f9e380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:36.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.142+0000 7f9e4effd700 1 -- 172.21.15.146:0/3699074603 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f9e480849a0 con 0x7f9e580ae730 2023-10-06T11:09:36.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.142+0000 7f9e4dd9b700 1 --2- 172.21.15.146:0/3699074603 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9e38066f30 0x7f9e380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:36.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.142+0000 7f9e4dd9b700 1 --2- 172.21.15.146:0/3699074603 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9e38066f30 0x7f9e380693e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9e58065100 tx=0x7f9e40017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:36.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.146+0000 7f9e4effd700 1 -- 172.21.15.146:0/3699074603 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9e48051db0 con 0x7f9e580ae730 2023-10-06T11:09:36.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:36.347+0000 7f9e5cd72700 1 -- 172.21.15.146:0/3699074603 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f9e580ad3f0 con 0x7f9e580ae730 2023-10-06T11:09:37.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.186+0000 7f9e4effd700 1 -- 172.21.15.146:0/3699074603 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v55) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9e48021080 con 0x7f9e580ae730 2023-10-06T11:09:37.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.188+0000 7f9e5cd72700 1 -- 172.21.15.146:0/3699074603 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9e38066f30 msgr2=0x7f9e380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:37.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.188+0000 7f9e5cd72700 1 --2- 172.21.15.146:0/3699074603 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9e38066f30 0x7f9e380693e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9e58065100 tx=0x7f9e40017000 comp rx=0 tx=0).stop 2023-10-06T11:09:37.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.189+0000 7f9e5cd72700 1 -- 172.21.15.146:0/3699074603 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e580ae730 msgr2=0x7f9e581569b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:37.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.189+0000 7f9e5cd72700 1 --2- 172.21.15.146:0/3699074603 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e580ae730 0x7f9e581569b0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f9e4800ec80 tx=0x7f9e48009120 comp rx=0 tx=0).stop 2023-10-06T11:09:37.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.189+0000 7f9e5cd72700 1 -- 172.21.15.146:0/3699074603 shutdown_connections 2023-10-06T11:09:37.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.189+0000 7f9e5cd72700 1 --2- 172.21.15.146:0/3699074603 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9e38066f30 0x7f9e380693e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:37.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.189+0000 7f9e5cd72700 1 --2- 172.21.15.146:0/3699074603 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e5815a160 0x7f9e580b3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:37.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.189+0000 7f9e5cd72700 1 --2- 172.21.15.146:0/3699074603 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e580ae730 0x7f9e581569b0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:37.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.189+0000 7f9e5cd72700 1 --2- 172.21.15.146:0/3699074603 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e580ce3d0 0x7f9e5815e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:37.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.189+0000 7f9e5cd72700 1 -- 172.21.15.146:0/3699074603 >> 172.21.15.146:0/3699074603 conn(0x7f9e5806f380 msgr2=0x7f9e58069e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:37.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.189+0000 7f9e5cd72700 1 -- 172.21.15.146:0/3699074603 shutdown_connections 2023-10-06T11:09:37.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.189+0000 7f9e5cd72700 1 -- 172.21.15.146:0/3699074603 wait complete. 2023-10-06T11:09:37.192 INFO:teuthology.orchestra.run.smithi146.stderr: removed all blocklist entries 2023-10-06T11:09:37.206 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T11:09:37.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.326+0000 7fa50de82700 1 Processor -- start 2023-10-06T11:09:37.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.326+0000 7fa50de82700 1 -- start start 2023-10-06T11:09:37.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.326+0000 7fa50de82700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa5080c97c0 0x7fa50815aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:37.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.326+0000 7fa50de82700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5080ca330 0x7fa50806e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:37.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.326+0000 7fa50de82700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa5080ca7d0 0x7fa50806ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:37.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.326+0000 7fa50de82700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5080b00c0 con 0x7fa5080ca7d0 2023-10-06T11:09:37.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.326+0000 7fa50de82700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5080afc30 con 0x7fa5080c97c0 2023-10-06T11:09:37.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.326+0000 7fa50de82700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5081569b0 con 0x7fa5080ca330 2023-10-06T11:09:37.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.327+0000 7fa507fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa5080ca7d0 0x7fa50806ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:37.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.327+0000 7fa507fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa5080ca7d0 0x7fa50806ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40218/0 (socket says 172.21.15.146:40218) 2023-10-06T11:09:37.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.327+0000 7fa507fff700 1 -- 172.21.15.146:0/2080576244 learned_addr learned my addr 172.21.15.146:0/2080576244 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:37.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.327+0000 7fa506ffd700 1 --2- 172.21.15.146:0/2080576244 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5080ca330 0x7fa50806e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:37.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.327+0000 7fa5077fe700 1 --2- 172.21.15.146:0/2080576244 >> v2:172.21.15.151:3300/0 conn(0x7fa5080c97c0 0x7fa50815aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:37.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.327+0000 7fa507fff700 1 -- 172.21.15.146:0/2080576244 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5080ca330 msgr2=0x7fa50806e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:37.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.327+0000 7fa507fff700 1 --2- 172.21.15.146:0/2080576244 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5080ca330 0x7fa50806e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:37.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.327+0000 7fa507fff700 1 -- 172.21.15.146:0/2080576244 >> v2:172.21.15.151:3300/0 conn(0x7fa5080c97c0 msgr2=0x7fa50815aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:37.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.327+0000 7fa507fff700 1 --2- 172.21.15.146:0/2080576244 >> v2:172.21.15.151:3300/0 conn(0x7fa5080c97c0 0x7fa50815aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:37.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.327+0000 7fa507fff700 1 -- 172.21.15.146:0/2080576244 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5080b1c60 con 0x7fa5080ca7d0 2023-10-06T11:09:37.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.327+0000 7fa5077fe700 1 --2- 172.21.15.146:0/2080576244 >> v2:172.21.15.151:3300/0 conn(0x7fa5080c97c0 0x7fa50815aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:09:37.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.327+0000 7fa507fff700 1 --2- 172.21.15.146:0/2080576244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5080ca7d0 0x7fa50806ead0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fa508071990 tx=0x7fa50000ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f863d5e263528be5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:37.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.327+0000 7fa5067fc700 1 -- 172.21.15.146:0/2080576244 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa500010070 con 0x7fa5080ca7d0 2023-10-06T11:09:37.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.327+0000 7fa5067fc700 1 -- 172.21.15.146:0/2080576244 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa50000de90 con 0x7fa5080ca7d0 2023-10-06T11:09:37.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.327+0000 7fa5067fc700 1 -- 172.21.15.146:0/2080576244 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50000b320 con 0x7fa5080ca7d0 2023-10-06T11:09:37.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.328+0000 7fa50de82700 1 -- 172.21.15.146:0/2080576244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5080ca7d0 msgr2=0x7fa50806ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:37.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.328+0000 7fa50de82700 1 --2- 172.21.15.146:0/2080576244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5080ca7d0 0x7fa50806ead0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fa508071990 tx=0x7fa50000ba50 comp rx=0 tx=0).stop 2023-10-06T11:09:37.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.328+0000 7fa50de82700 1 -- 172.21.15.146:0/2080576244 shutdown_connections 2023-10-06T11:09:37.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.328+0000 7fa50de82700 1 --2- 172.21.15.146:0/2080576244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5080ca7d0 0x7fa50806ead0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:37.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.328+0000 7fa50de82700 1 --2- 172.21.15.146:0/2080576244 >> v2:172.21.15.151:3300/0 conn(0x7fa5080c97c0 0x7fa50815aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:37.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.328+0000 7fa50de82700 1 --2- 172.21.15.146:0/2080576244 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5080ca330 0x7fa50806e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:37.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.328+0000 7fa50de82700 1 -- 172.21.15.146:0/2080576244 >> 172.21.15.146:0/2080576244 conn(0x7fa50806b060 msgr2=0x7fa5080aecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:37.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.328+0000 7fa50de82700 1 -- 172.21.15.146:0/2080576244 shutdown_connections 2023-10-06T11:09:37.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.328+0000 7fa50de82700 1 -- 172.21.15.146:0/2080576244 wait complete. 2023-10-06T11:09:37.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.329+0000 7fa50de82700 1 Processor -- start 2023-10-06T11:09:37.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.329+0000 7fa50de82700 1 -- start start 2023-10-06T11:09:37.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.330+0000 7fa50de82700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5080c97c0 0x7fa508145d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:37.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.330+0000 7fa50de82700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5080ca330 0x7fa5080c2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:37.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.330+0000 7fa50de82700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5080c2e80 0x7fa5080adde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:37.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.330+0000 7fa50de82700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5080c3300 con 0x7fa5080c2e80 2023-10-06T11:09:37.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.330+0000 7fa50de82700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa508146270 con 0x7fa5080c97c0 2023-10-06T11:09:37.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.330+0000 7fa50de82700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa508166a00 con 0x7fa5080ca330 2023-10-06T11:09:37.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.330+0000 7fa507fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5080c2e80 0x7fa5080adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:37.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.330+0000 7fa507fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5080c2e80 0x7fa5080adde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40232/0 (socket says 172.21.15.146:40232) 2023-10-06T11:09:37.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.330+0000 7fa507fff700 1 -- 172.21.15.146:0/3528098416 learned_addr learned my addr 172.21.15.146:0/3528098416 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:37.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.330+0000 7fa506ffd700 1 --2- 172.21.15.146:0/3528098416 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5080ca330 0x7fa5080c2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:37.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.330+0000 7fa5077fe700 1 --2- 172.21.15.146:0/3528098416 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5080c97c0 0x7fa508145d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:37.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.330+0000 7fa507fff700 1 -- 172.21.15.146:0/3528098416 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5080ca330 msgr2=0x7fa5080c2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:37.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.330+0000 7fa507fff700 1 --2- 172.21.15.146:0/3528098416 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5080ca330 0x7fa5080c2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:37.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.330+0000 7fa507fff700 1 -- 172.21.15.146:0/3528098416 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5080c97c0 msgr2=0x7fa508145d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:37.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.330+0000 7fa507fff700 1 --2- 172.21.15.146:0/3528098416 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5080c97c0 0x7fa508145d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:37.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.330+0000 7fa507fff700 1 -- 172.21.15.146:0/3528098416 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50000bcf0 con 0x7fa5080c2e80 2023-10-06T11:09:37.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.330+0000 7fa507fff700 1 --2- 172.21.15.146:0/3528098416 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5080c2e80 0x7fa5080adde0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fa50806e100 tx=0x7fa50001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:37.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.331+0000 7fa4ff7fe700 1 -- 172.21.15.146:0/3528098416 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa500027460 con 0x7fa5080c2e80 2023-10-06T11:09:37.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.331+0000 7fa4ff7fe700 1 -- 172.21.15.146:0/3528098416 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5000275c0 con 0x7fa5080c2e80 2023-10-06T11:09:37.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.331+0000 7fa4ff7fe700 1 -- 172.21.15.146:0/3528098416 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa500027980 con 0x7fa5080c2e80 2023-10-06T11:09:37.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.331+0000 7fa50de82700 1 -- 172.21.15.146:0/3528098416 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa508166ce0 con 0x7fa5080c2e80 2023-10-06T11:09:37.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.331+0000 7fa50de82700 1 -- 172.21.15.146:0/3528098416 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5081672a0 con 0x7fa5080c2e80 2023-10-06T11:09:37.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.332+0000 7fa50de82700 1 -- 172.21.15.146:0/3528098416 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa50804c380 con 0x7fa5080c2e80 2023-10-06T11:09:37.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.332+0000 7fa4ff7fe700 1 -- 172.21.15.146:0/3528098416 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa500003040 con 0x7fa5080c2e80 2023-10-06T11:09:37.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.332+0000 7fa4ff7fe700 1 --2- 172.21.15.146:0/3528098416 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa4e8066f30 0x7fa4e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:37.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.333+0000 7fa4ff7fe700 1 -- 172.21.15.146:0/3528098416 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fa500088230 con 0x7fa5080c2e80 2023-10-06T11:09:37.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.333+0000 7fa5077fe700 1 --2- 172.21.15.146:0/3528098416 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa4e8066f30 0x7fa4e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:37.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.333+0000 7fa5077fe700 1 --2- 172.21.15.146:0/3528098416 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa4e8066f30 0x7fa4e80693e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa508155ec0 tx=0x7fa4f0006f90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:37.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.337+0000 7fa4ff7fe700 1 -- 172.21.15.146:0/3528098416 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa500055740 con 0x7fa5080c2e80 2023-10-06T11:09:37.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.596+0000 7fa50de82700 1 -- 172.21.15.146:0/3528098416 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa5080b1f40 con 0x7fa5080c2e80 2023-10-06T11:09:37.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.597+0000 7fa4ff7fe700 1 -- 172.21.15.146:0/3528098416 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fa500058d60 con 0x7fa5080c2e80 2023-10-06T11:09:37.599 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:09:37.599 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:09:37.599 INFO:teuthology.orchestra.run.smithi146.stdout: "auth_dump": [ 2023-10-06T11:09:37.599 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:09:37.599 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.a", 2023-10-06T11:09:37.599 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lG4F8DBAAp5A4Dtfzvv8n9ORgkmiP9g==", 2023-10-06T11:09:37.599 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:09:37.599 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:09:37.599 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:09:37.599 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:09:37.599 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:09:37.600 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:09:37.600 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:09:37.600 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:09:37.600 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.b", 2023-10-06T11:09:37.600 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lDIceGBAA4cr0oGVaXiy5hrruKY5DGw==", 2023-10-06T11:09:37.600 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:09:37.600 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:09:37.600 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:09:37.600 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:09:37.600 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:09:37.600 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:09:37.600 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:09:37.601 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:09:37.601 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.c", 2023-10-06T11:09:37.601 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lbYA7ExAAAopKjS7+WMUE5fuVQygILQ==", 2023-10-06T11:09:37.601 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:09:37.601 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:09:37.601 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:09:37.601 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:09:37.601 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:09:37.601 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:09:37.601 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:09:37.601 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:09:37.601 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.d", 2023-10-06T11:09:37.602 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9laygiHxAAasUUn7Wk9EwLa36ggsZtHw==", 2023-10-06T11:09:37.602 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:09:37.602 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:09:37.602 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:09:37.602 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:09:37.602 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:09:37.602 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:09:37.602 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:09:37.602 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:09:37.602 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.0", 2023-10-06T11:09:37.602 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDX6R9lLGo9NhAAcWJuUeOdEUsdDw84W9nLPw==", 2023-10-06T11:09:37.602 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:09:37.603 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:09:37.603 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:09:37.603 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:09:37.603 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:09:37.603 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:09:37.603 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:09:37.603 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.1", 2023-10-06T11:09:37.603 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDa6R9lk02gNBAA9YqWT2/Xds20lv0sGtBApg==", 2023-10-06T11:09:37.603 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:09:37.603 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:09:37.603 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:09:37.603 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:09:37.604 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:09:37.604 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:09:37.604 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:09:37.604 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.2", 2023-10-06T11:09:37.604 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDd6R9lrA6xMxAAmH8r6m2p4Jpa82xfYNcq+g==", 2023-10-06T11:09:37.604 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:09:37.604 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:09:37.604 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:09:37.604 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:09:37.604 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:09:37.604 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:09:37.604 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:09:37.605 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.3", 2023-10-06T11:09:37.605 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDg6R9ltlHXNBAAvhfI1yjlaWCIE9Xr/4F/PA==", 2023-10-06T11:09:37.605 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:09:37.605 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:09:37.605 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:09:37.605 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:09:37.605 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:09:37.605 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:09:37.605 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:09:37.605 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.4", 2023-10-06T11:09:37.605 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDm6R9lPUCvMhAAGbUNfpoFi9SvYdelpnL1jA==", 2023-10-06T11:09:37.605 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:09:37.606 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:09:37.606 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:09:37.606 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:09:37.606 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:09:37.606 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:09:37.606 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:09:37.606 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.5", 2023-10-06T11:09:37.606 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDp6R9lMfrMMBAAUEtnXDNr7+L3dQm4QE9qDw==", 2023-10-06T11:09:37.606 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:09:37.606 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:09:37.606 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:09:37.606 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:09:37.607 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:09:37.607 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:09:37.607 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:09:37.607 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.6", 2023-10-06T11:09:37.607 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDs6R9lAmSDMBAArPp+6dVt/NyH9is46tL49g==", 2023-10-06T11:09:37.607 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:09:37.607 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:09:37.607 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:09:37.607 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:09:37.607 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:09:37.607 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:09:37.607 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:09:37.607 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.7", 2023-10-06T11:09:37.608 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDv6R9lnunMLRAA3o5ZtAyYDUoXTzjX9H8FCw==", 2023-10-06T11:09:37.608 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:09:37.608 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:09:37.608 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:09:37.608 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:09:37.608 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:09:37.608 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:09:37.608 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:09:37.608 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.0", 2023-10-06T11:09:37.608 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lCrPrIhAARrzj2VxVFkzF5L/ifIAqmw==", 2023-10-06T11:09:37.608 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:09:37.608 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:09:37.609 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow r", 2023-10-06T11:09:37.609 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T11:09:37.609 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:09:37.609 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:09:37.609 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:09:37.609 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.1", 2023-10-06T11:09:37.609 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9l10VSKxAA0HmXejgRRCQ7XpsMB7ljkQ==", 2023-10-06T11:09:37.609 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:09:37.609 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:09:37.609 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2023-10-06T11:09:37.609 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2023-10-06T11:09:37.609 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2023-10-06T11:09:37.610 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:09:37.610 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:09:37.610 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:09:37.610 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.2", 2023-10-06T11:09:37.610 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lpLpJKBAAF/vLDkBg9/VBqMK4pVVIkg==", 2023-10-06T11:09:37.610 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:09:37.610 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:09:37.610 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2023-10-06T11:09:37.610 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2023-10-06T11:09:37.610 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2023-10-06T11:09:37.610 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:09:37.610 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:09:37.610 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:09:37.611 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.3", 2023-10-06T11:09:37.611 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9luMqwMBAA4Y4I9hWTk2IqAzYwVQ13Pw==", 2023-10-06T11:09:37.611 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:09:37.611 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:09:37.611 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2023-10-06T11:09:37.611 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2023-10-06T11:09:37.611 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2023-10-06T11:09:37.611 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:09:37.611 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:09:37.611 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:09:37.611 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.admin", 2023-10-06T11:09:37.611 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDT6R9lSr9qIhAAiNEN9xFWUwFGsB+oUE1cXw==", 2023-10-06T11:09:37.612 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:09:37.612 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2023-10-06T11:09:37.612 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:09:37.612 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:09:37.612 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:09:37.612 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:09:37.612 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:09:37.612 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:09:37.612 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.x", 2023-10-06T11:09:37.612 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9llLpwCRAA4UH9Uqli2de9HIJR2fZ9xg==", 2023-10-06T11:09:37.612 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:09:37.612 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2023-10-06T11:09:37.612 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2023-10-06T11:09:37.613 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:09:37.613 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:09:37.613 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:09:37.613 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:09:37.613 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.y", 2023-10-06T11:09:37.613 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDT6R9l2uQxNxAAVSMhKVzbf2vC4opL7YCLdg==", 2023-10-06T11:09:37.613 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:09:37.613 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2023-10-06T11:09:37.613 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2023-10-06T11:09:37.613 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:09:37.613 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:09:37.613 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:09:37.613 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2023-10-06T11:09:37.614 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:09:37.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.599+0000 7fa50de82700 1 -- 172.21.15.146:0/3528098416 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa4e8066f30 msgr2=0x7fa4e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:37.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.599+0000 7fa50de82700 1 --2- 172.21.15.146:0/3528098416 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa4e8066f30 0x7fa4e80693e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa508155ec0 tx=0x7fa4f0006f90 comp rx=0 tx=0).stop 2023-10-06T11:09:37.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.599+0000 7fa50de82700 1 -- 172.21.15.146:0/3528098416 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5080c2e80 msgr2=0x7fa5080adde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:37.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.599+0000 7fa50de82700 1 --2- 172.21.15.146:0/3528098416 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5080c2e80 0x7fa5080adde0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fa50806e100 tx=0x7fa50001a000 comp rx=0 tx=0).stop 2023-10-06T11:09:37.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.599+0000 7fa50de82700 1 -- 172.21.15.146:0/3528098416 shutdown_connections 2023-10-06T11:09:37.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.599+0000 7fa50de82700 1 --2- 172.21.15.146:0/3528098416 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa4e8066f30 0x7fa4e80693e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:37.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.599+0000 7fa50de82700 1 --2- 172.21.15.146:0/3528098416 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5080c2e80 0x7fa5080adde0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:37.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.599+0000 7fa50de82700 1 --2- 172.21.15.146:0/3528098416 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5080c97c0 0x7fa508145d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:37.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.599+0000 7fa50de82700 1 --2- 172.21.15.146:0/3528098416 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5080ca330 0x7fa5080c2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:37.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.599+0000 7fa50de82700 1 -- 172.21.15.146:0/3528098416 >> 172.21.15.146:0/3528098416 conn(0x7fa50806b060 msgr2=0x7fa50806e590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:37.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.599+0000 7fa50de82700 1 -- 172.21.15.146:0/3528098416 shutdown_connections 2023-10-06T11:09:37.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.599+0000 7fa50de82700 1 -- 172.21.15.146:0/3528098416 wait complete. 2023-10-06T11:09:37.617 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:09:37.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.731+0000 7f19a1dc8700 1 Processor -- start 2023-10-06T11:09:37.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.731+0000 7f19a1dc8700 1 -- start start 2023-10-06T11:09:37.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.732+0000 7f19a1dc8700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f199c156230 0x7f199c0c8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:37.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.732+0000 7f19a1dc8700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f199c0c8a30 con 0x7f199c06ae20 2023-10-06T11:09:37.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.732+0000 7f19a1dc8700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f199c0c8d10 con 0x7f199c15a500 2023-10-06T11:09:37.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.732+0000 7f19a1dc8700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f199c0c8ff0 con 0x7f199c156230 2023-10-06T11:09:37.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.732+0000 7f199bfff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f199c06ae20 0x7f199c159df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39322/0 (socket says 172.21.15.146:39322) 2023-10-06T11:09:37.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.732+0000 7f199bfff700 1 -- 172.21.15.146:0/2230094605 learned_addr learned my addr 172.21.15.146:0/2230094605 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:37.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.732+0000 7f19a0dc6700 1 --2- 172.21.15.146:0/2230094605 >> v2:172.21.15.151:3300/0 conn(0x7f199c156230 0x7f199c0c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:37.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.732+0000 7f199b7fe700 1 -- 172.21.15.146:0/2230094605 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 356163266 0 0) 0x7f199c0c8a30 con 0x7f199c06ae20 2023-10-06T11:09:37.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.732+0000 7f199b7fe700 1 -- 172.21.15.146:0/2230094605 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f198c003570 con 0x7f199c06ae20 2023-10-06T11:09:37.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.733+0000 7f199b7fe700 1 -- 172.21.15.146:0/2230094605 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3004066392 0 0) 0x7f199c0c8d10 con 0x7f199c15a500 2023-10-06T11:09:37.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.733+0000 7f199b7fe700 1 -- 172.21.15.146:0/2230094605 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f199c0c8a30 con 0x7f199c15a500 2023-10-06T11:09:37.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.733+0000 7f199b7fe700 1 -- 172.21.15.146:0/2230094605 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3788548184 0 0) 0x7f198c003570 con 0x7f199c06ae20 2023-10-06T11:09:37.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.733+0000 7f199b7fe700 1 -- 172.21.15.146:0/2230094605 >> v2:172.21.15.151:3300/0 conn(0x7f199c156230 msgr2=0x7f199c0c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:37.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.733+0000 7f199b7fe700 1 --2- 172.21.15.146:0/2230094605 >> v2:172.21.15.151:3300/0 conn(0x7f199c156230 0x7f199c0c8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:37.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.733+0000 7f199b7fe700 1 -- 172.21.15.146:0/2230094605 >> v1:172.21.15.151:6789/0 conn(0x7f199c15a500 legacy=0x7f199c0caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:37.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.733+0000 7f199b7fe700 1 -- 172.21.15.146:0/2230094605 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199c0c92d0 con 0x7f199c06ae20 2023-10-06T11:09:37.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.733+0000 7f199b7fe700 1 -- 172.21.15.146:0/2230094605 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f1988001470 con 0x7f199c06ae20 2023-10-06T11:09:37.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.733+0000 7f199b7fe700 1 -- 172.21.15.146:0/2230094605 >> v1:172.21.15.146:6789/0 conn(0x7f199c06ae20 legacy=0x7f199c159df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:37.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.733+0000 7f199b7fe700 1 --2- 172.21.15.146:0/2230094605 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f198c003bf0 0x7f198c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:37.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.733+0000 7f199b7fe700 1 --2- 172.21.15.146:0/2230094605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f198c004810 0x7f198c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:37.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.733+0000 7f199b7fe700 1 --2- 172.21.15.146:0/2230094605 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f198c0051c0 0x7f198c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:37.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.733+0000 7f199b7fe700 1 -- 172.21.15.146:0/2230094605 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c0c8ff0 con 0x7f198c004810 2023-10-06T11:09:37.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.733+0000 7f199b7fe700 1 -- 172.21.15.146:0/2230094605 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198c00c160 con 0x7f198c0051c0 2023-10-06T11:09:37.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.733+0000 7f199b7fe700 1 -- 172.21.15.146:0/2230094605 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f198c00c320 con 0x7f198c003bf0 2023-10-06T11:09:37.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.733+0000 7f199bfff700 1 --2- 172.21.15.146:0/2230094605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f198c004810 0x7f198c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:37.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.733+0000 7f19a0dc6700 1 --2- 172.21.15.146:0/2230094605 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f198c003bf0 0x7f198c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:37.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.733+0000 7f19a15c7700 1 --2- 172.21.15.146:0/2230094605 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f198c0051c0 0x7f198c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:37.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.733+0000 7f199bfff700 1 -- 172.21.15.146:0/2230094605 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f198c003bf0 msgr2=0x7f198c003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:37.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.733+0000 7f199bfff700 1 --2- 172.21.15.146:0/2230094605 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f198c003bf0 0x7f198c003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:37.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.733+0000 7f199bfff700 1 -- 172.21.15.146:0/2230094605 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f198c0051c0 msgr2=0x7f198c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:37.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.733+0000 7f199bfff700 1 --2- 172.21.15.146:0/2230094605 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f198c0051c0 0x7f198c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:37.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.733+0000 7f19a15c7700 1 -- 172.21.15.146:0/2230094605 reap_dead start 2023-10-06T11:09:37.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.733+0000 7f199bfff700 1 -- 172.21.15.146:0/2230094605 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f198c003570 con 0x7f198c004810 2023-10-06T11:09:37.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.733+0000 7f199bfff700 1 --2- 172.21.15.146:0/2230094605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f198c004810 0x7f198c004c80 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f1988007c80 tx=0x7f199c0c8c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e25a6dee34684b1d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:37.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.733+0000 7f199b7fe700 1 -- 172.21.15.146:0/2230094605 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198800cc10 con 0x7f198c004810 2023-10-06T11:09:37.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.733+0000 7f199b7fe700 1 -- 172.21.15.146:0/2230094605 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f198800cd90 con 0x7f198c004810 2023-10-06T11:09:37.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.733+0000 7f199b7fe700 1 -- 172.21.15.146:0/2230094605 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1988005b70 con 0x7f198c004810 2023-10-06T11:09:37.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.734+0000 7f19a1dc8700 1 -- 172.21.15.146:0/2230094605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f198c004810 msgr2=0x7f198c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:37.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.734+0000 7f19a1dc8700 1 --2- 172.21.15.146:0/2230094605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f198c004810 0x7f198c004c80 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f1988007c80 tx=0x7f199c0c8c00 comp rx=0 tx=0).stop 2023-10-06T11:09:37.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.734+0000 7f19a1dc8700 1 -- 172.21.15.146:0/2230094605 shutdown_connections 2023-10-06T11:09:37.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.734+0000 7f19a1dc8700 1 --2- 172.21.15.146:0/2230094605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f198c004810 0x7f198c004c80 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:37.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.734+0000 7f19a1dc8700 1 -- 172.21.15.146:0/2230094605 >> 172.21.15.146:0/2230094605 conn(0x7f199c069010 msgr2=0x7f199c0cd120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:37.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.734+0000 7f19a1dc8700 1 -- 172.21.15.146:0/2230094605 shutdown_connections 2023-10-06T11:09:37.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.734+0000 7f19a1dc8700 1 -- 172.21.15.146:0/2230094605 wait complete. 2023-10-06T11:09:37.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.735+0000 7f19a1dc8700 1 Processor -- start 2023-10-06T11:09:37.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.735+0000 7f19a1dc8700 1 -- start start 2023-10-06T11:09:37.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.736+0000 7f19a1dc8700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f198c004810 0x7f199c14fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:37.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.736+0000 7f19a1dc8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f199c0c57f0 0x7f199c0ade50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:37.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.736+0000 7f19a1dc8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f199c0c1ec0 0x7f199c0c2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:37.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.736+0000 7f19a1dc8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c0c2880 con 0x7f199c0c57f0 2023-10-06T11:09:37.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.736+0000 7f19a1dc8700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c0af7f0 con 0x7f198c004810 2023-10-06T11:09:37.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.736+0000 7f19a1dc8700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f199c0ae750 con 0x7f199c0c1ec0 2023-10-06T11:09:37.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.736+0000 7f199bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f199c0c57f0 0x7f199c0ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:37.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.736+0000 7f199bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f199c0c57f0 0x7f199c0ade50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40250/0 (socket says 172.21.15.146:40250) 2023-10-06T11:09:37.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.736+0000 7f199bfff700 1 -- 172.21.15.146:0/2726476150 learned_addr learned my addr 172.21.15.146:0/2726476150 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:37.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.736+0000 7f19a15c7700 1 --2- 172.21.15.146:0/2726476150 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f199c0c1ec0 0x7f199c0c2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:37.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.736+0000 7f19a0dc6700 1 --2- 172.21.15.146:0/2726476150 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f198c004810 0x7f199c14fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:37.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.736+0000 7f199bfff700 1 -- 172.21.15.146:0/2726476150 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f199c0c1ec0 msgr2=0x7f199c0c2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:37.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.736+0000 7f199bfff700 1 --2- 172.21.15.146:0/2726476150 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f199c0c1ec0 0x7f199c0c2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:37.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.736+0000 7f199bfff700 1 -- 172.21.15.146:0/2726476150 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f198c004810 msgr2=0x7f199c14fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:37.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.736+0000 7f199bfff700 1 --2- 172.21.15.146:0/2726476150 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f198c004810 0x7f199c14fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:37.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.737+0000 7f199bfff700 1 -- 172.21.15.146:0/2726476150 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199c0aea30 con 0x7f199c0c57f0 2023-10-06T11:09:37.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.737+0000 7f199bfff700 1 --2- 172.21.15.146:0/2726476150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f199c0c57f0 0x7f199c0ade50 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f1988001ed0 tx=0x7f1988017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:37.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.737+0000 7f1998ff9700 1 -- 172.21.15.146:0/2726476150 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1988007ae0 con 0x7f199c0c57f0 2023-10-06T11:09:37.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.737+0000 7f1998ff9700 1 -- 172.21.15.146:0/2726476150 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1988001690 con 0x7f199c0c57f0 2023-10-06T11:09:37.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.737+0000 7f19a1dc8700 1 -- 172.21.15.146:0/2726476150 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f199c0aed10 con 0x7f199c0c57f0 2023-10-06T11:09:37.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.737+0000 7f1998ff9700 1 -- 172.21.15.146:0/2726476150 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1988007340 con 0x7f199c0c57f0 2023-10-06T11:09:37.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.737+0000 7f19a1dc8700 1 -- 172.21.15.146:0/2726476150 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f199c0af2d0 con 0x7f199c0c57f0 2023-10-06T11:09:37.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.738+0000 7f19a1dc8700 1 -- 172.21.15.146:0/2726476150 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f199c0c95b0 con 0x7f199c0c57f0 2023-10-06T11:09:37.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.738+0000 7f1998ff9700 1 -- 172.21.15.146:0/2726476150 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f19880076b0 con 0x7f199c0c57f0 2023-10-06T11:09:37.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.739+0000 7f1998ff9700 1 --2- 172.21.15.146:0/2726476150 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1980066f30 0x7f19800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:37.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.739+0000 7f1998ff9700 1 -- 172.21.15.146:0/2726476150 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f1988087350 con 0x7f199c0c57f0 2023-10-06T11:09:37.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.739+0000 7f19a0dc6700 1 --2- 172.21.15.146:0/2726476150 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1980066f30 0x7f19800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:37.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.739+0000 7f19a0dc6700 1 --2- 172.21.15.146:0/2726476150 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1980066f30 0x7f19800693e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f199c15ad60 tx=0x7f19900091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:37.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.743+0000 7f1998ff9700 1 -- 172.21.15.146:0/2726476150 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f19880547b0 con 0x7f199c0c57f0 2023-10-06T11:09:37.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.927+0000 7f19a1dc8700 1 -- 172.21.15.146:0/2726476150 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f199c0afa30 con 0x7f199c0c57f0 2023-10-06T11:09:37.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.928+0000 7f1998ff9700 1 -- 172.21.15.146:0/2726476150 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+13698 (secure 0 0 0) 0x7f1988057dd0 con 0x7f199c0c57f0 2023-10-06T11:09:37.930 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:09:37.930 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":55,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:09:37.182715+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:09:37.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.930+0000 7f19a1dc8700 1 -- 172.21.15.146:0/2726476150 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1980066f30 msgr2=0x7f19800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:37.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.930+0000 7f19a1dc8700 1 --2- 172.21.15.146:0/2726476150 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1980066f30 0x7f19800693e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f199c15ad60 tx=0x7f19900091a0 comp rx=0 tx=0).stop 2023-10-06T11:09:37.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.930+0000 7f19a1dc8700 1 -- 172.21.15.146:0/2726476150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f199c0c57f0 msgr2=0x7f199c0ade50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:37.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.930+0000 7f19a1dc8700 1 --2- 172.21.15.146:0/2726476150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f199c0c57f0 0x7f199c0ade50 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f1988001ed0 tx=0x7f1988017000 comp rx=0 tx=0).stop 2023-10-06T11:09:37.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.930+0000 7f19a1dc8700 1 -- 172.21.15.146:0/2726476150 shutdown_connections 2023-10-06T11:09:37.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.930+0000 7f19a1dc8700 1 --2- 172.21.15.146:0/2726476150 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1980066f30 0x7f19800693e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:37.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.930+0000 7f19a1dc8700 1 --2- 172.21.15.146:0/2726476150 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f199c0c1ec0 0x7f199c0c2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:37.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.930+0000 7f19a1dc8700 1 --2- 172.21.15.146:0/2726476150 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f198c004810 0x7f199c14fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:37.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.930+0000 7f19a1dc8700 1 --2- 172.21.15.146:0/2726476150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f199c0c57f0 0x7f199c0ade50 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:37.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.930+0000 7f19a1dc8700 1 -- 172.21.15.146:0/2726476150 >> 172.21.15.146:0/2726476150 conn(0x7f199c069010 msgr2=0x7f199c152560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:37.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.930+0000 7f19a1dc8700 1 -- 172.21.15.146:0/2726476150 shutdown_connections 2023-10-06T11:09:37.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:37.930+0000 7f19a1dc8700 1 -- 172.21.15.146:0/2726476150 wait complete. 2023-10-06T11:09:37.945 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:05:36.687307+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:05:37.171199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T11:09:37.945 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:09:38.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.061+0000 7fe8cf39d700 1 Processor -- start 2023-10-06T11:09:38.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.061+0000 7fe8cf39d700 1 -- start start 2023-10-06T11:09:38.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.062+0000 7fe8cf39d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe8c8068780 0x7fe8c8068bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:38.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.062+0000 7fe8cf39d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8c80cc130 con 0x7fe8c80cb090 2023-10-06T11:09:38.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.062+0000 7fe8cf39d700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8c80cccd0 con 0x7fe8c80b5640 2023-10-06T11:09:38.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.062+0000 7fe8cf39d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8c8069100 con 0x7fe8c8068780 2023-10-06T11:09:38.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.062+0000 7fe8ceb9c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe8c8068780 0x7fe8c8068bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:38.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.062+0000 7fe8cdb9a700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe8c80cb090 0x7fe8c80cc5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39334/0 (socket says 172.21.15.146:39334) 2023-10-06T11:09:38.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.062+0000 7fe8cdb9a700 1 -- 172.21.15.146:0/3366860311 learned_addr learned my addr 172.21.15.146:0/3366860311 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:38.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.062+0000 7fe8ceb9c700 1 -- 172.21.15.146:0/3366860311 >> v1:172.21.15.151:6789/0 conn(0x7fe8c80b5640 legacy=0x7fe8c815a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:38.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.062+0000 7fe8ceb9c700 1 -- 172.21.15.146:0/3366860311 >> v1:172.21.15.146:6789/0 conn(0x7fe8c80cb090 legacy=0x7fe8c80cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:38.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.062+0000 7fe8ceb9c700 1 -- 172.21.15.146:0/3366860311 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c80b2660 con 0x7fe8c8068780 2023-10-06T11:09:38.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.062+0000 7fe8cd399700 1 -- 172.21.15.146:0/3366860311 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2894346372 0 0) 0x7fe8c80cc130 con 0x7fe8c80cb090 2023-10-06T11:09:38.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.062+0000 7fe8ceb9c700 1 --2- 172.21.15.146:0/3366860311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8c8068780 0x7fe8c8068bc0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0009e60 tx=0x7fe8c0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abbc95e3253939f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:38.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.062+0000 7fe8cd399700 1 -- 172.21.15.146:0/3366860311 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c000e070 con 0x7fe8c8068780 2023-10-06T11:09:38.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.063+0000 7fe8cd399700 1 -- 172.21.15.146:0/3366860311 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c000bc30 con 0x7fe8c8068780 2023-10-06T11:09:38.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.063+0000 7fe8cd399700 1 -- 172.21.15.146:0/3366860311 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c0012430 con 0x7fe8c8068780 2023-10-06T11:09:38.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.063+0000 7fe8cf39d700 1 -- 172.21.15.146:0/3366860311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8c8068780 msgr2=0x7fe8c8068bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:38.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.063+0000 7fe8cf39d700 1 --2- 172.21.15.146:0/3366860311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8c8068780 0x7fe8c8068bc0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0009e60 tx=0x7fe8c0009780 comp rx=0 tx=0).stop 2023-10-06T11:09:38.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.063+0000 7fe8cf39d700 1 -- 172.21.15.146:0/3366860311 shutdown_connections 2023-10-06T11:09:38.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.063+0000 7fe8cf39d700 1 --2- 172.21.15.146:0/3366860311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8c8068780 0x7fe8c8068bc0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:38.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.063+0000 7fe8cf39d700 1 -- 172.21.15.146:0/3366860311 >> 172.21.15.146:0/3366860311 conn(0x7fe8c80703f0 msgr2=0x7fe8c80707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:38.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.063+0000 7fe8cf39d700 1 -- 172.21.15.146:0/3366860311 shutdown_connections 2023-10-06T11:09:38.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.063+0000 7fe8cf39d700 1 -- 172.21.15.146:0/3366860311 wait complete. 2023-10-06T11:09:38.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.064+0000 7fe8cf39d700 1 Processor -- start 2023-10-06T11:09:38.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.064+0000 7fe8cf39d700 1 -- start start 2023-10-06T11:09:38.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.065+0000 7fe8cf39d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8c8068780 0x7fe8c80c4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:38.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.065+0000 7fe8cf39d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8c80b5640 0x7fe8c81538b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:38.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.065+0000 7fe8cf39d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8c80cb090 0x7fe8c80c3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:38.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.065+0000 7fe8cf39d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c80c87b0 con 0x7fe8c8068780 2023-10-06T11:09:38.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.065+0000 7fe8cf39d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c8153df0 con 0x7fe8c80cb090 2023-10-06T11:09:38.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.065+0000 7fe8cf39d700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c80c4910 con 0x7fe8c80b5640 2023-10-06T11:09:38.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.065+0000 7fe8ce39b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8c8068780 0x7fe8c80c4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:38.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.065+0000 7fe8ce39b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8c8068780 0x7fe8c80c4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40274/0 (socket says 172.21.15.146:40274) 2023-10-06T11:09:38.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.065+0000 7fe8ce39b700 1 -- 172.21.15.146:0/3108575943 learned_addr learned my addr 172.21.15.146:0/3108575943 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:38.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.065+0000 7fe8cdb9a700 1 --2- 172.21.15.146:0/3108575943 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8c80b5640 0x7fe8c81538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:38.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.065+0000 7fe8ceb9c700 1 --2- 172.21.15.146:0/3108575943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8c80cb090 0x7fe8c80c3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:38.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.065+0000 7fe8ce39b700 1 -- 172.21.15.146:0/3108575943 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8c80b5640 msgr2=0x7fe8c81538b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:38.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.065+0000 7fe8ce39b700 1 --2- 172.21.15.146:0/3108575943 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8c80b5640 0x7fe8c81538b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:38.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.065+0000 7fe8ce39b700 1 -- 172.21.15.146:0/3108575943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8c80cb090 msgr2=0x7fe8c80c3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:38.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.065+0000 7fe8ce39b700 1 --2- 172.21.15.146:0/3108575943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8c80cb090 0x7fe8c80c3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:38.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.065+0000 7fe8ce39b700 1 -- 172.21.15.146:0/3108575943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c0009a20 con 0x7fe8c8068780 2023-10-06T11:09:38.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.065+0000 7fe8cdb9a700 1 --2- 172.21.15.146:0/3108575943 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8c80b5640 0x7fe8c81538b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:38.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.066+0000 7fe8ce39b700 1 --2- 172.21.15.146:0/3108575943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8c8068780 0x7fe8c80c4330 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fe8c400c590 tx=0x7fe8c400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:38.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.066+0000 7fe8be7fc700 1 -- 172.21.15.146:0/3108575943 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c4011590 con 0x7fe8c8068780 2023-10-06T11:09:38.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.066+0000 7fe8be7fc700 1 -- 172.21.15.146:0/3108575943 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c40116f0 con 0x7fe8c8068780 2023-10-06T11:09:38.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.066+0000 7fe8cf39d700 1 -- 172.21.15.146:0/3108575943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8c80c7e80 con 0x7fe8c8068780 2023-10-06T11:09:38.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.066+0000 7fe8be7fc700 1 -- 172.21.15.146:0/3108575943 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c4011ab0 con 0x7fe8c8068780 2023-10-06T11:09:38.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.066+0000 7fe8cf39d700 1 -- 172.21.15.146:0/3108575943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8c80c8440 con 0x7fe8c8068780 2023-10-06T11:09:38.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.067+0000 7fe8cf39d700 1 -- 172.21.15.146:0/3108575943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8c80c8a90 con 0x7fe8c8068780 2023-10-06T11:09:38.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.067+0000 7fe8be7fc700 1 -- 172.21.15.146:0/3108575943 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe8c401b3b0 con 0x7fe8c8068780 2023-10-06T11:09:38.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.068+0000 7fe8be7fc700 1 --2- 172.21.15.146:0/3108575943 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe8ac066f30 0x7fe8ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:38.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.068+0000 7fe8cdb9a700 1 --2- 172.21.15.146:0/3108575943 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe8ac066f30 0x7fe8ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:38.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.068+0000 7fe8be7fc700 1 -- 172.21.15.146:0/3108575943 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fe8c40838f0 con 0x7fe8c8068780 2023-10-06T11:09:38.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.068+0000 7fe8cdb9a700 1 --2- 172.21.15.146:0/3108575943 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe8ac066f30 0x7fe8ac0693e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe8c816cd60 tx=0x7fe8b8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:38.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.072+0000 7fe8be7fc700 1 -- 172.21.15.146:0/3108575943 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe8c4050d50 con 0x7fe8c8068780 2023-10-06T11:09:38.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.256+0000 7fe8cf39d700 1 -- 172.21.15.146:0/3108575943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe8c80b60a0 con 0x7fe8c8068780 2023-10-06T11:09:38.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.257+0000 7fe8be7fc700 1 -- 172.21.15.146:0/3108575943 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v55) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe8c4017070 con 0x7fe8c8068780 2023-10-06T11:09:38.259 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-10-06T11:09:38.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.259+0000 7fe8cf39d700 1 -- 172.21.15.146:0/3108575943 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe8ac066f30 msgr2=0x7fe8ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:38.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.259+0000 7fe8cf39d700 1 --2- 172.21.15.146:0/3108575943 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe8ac066f30 0x7fe8ac0693e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe8c816cd60 tx=0x7fe8b8009040 comp rx=0 tx=0).stop 2023-10-06T11:09:38.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.259+0000 7fe8cf39d700 1 -- 172.21.15.146:0/3108575943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8c8068780 msgr2=0x7fe8c80c4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:38.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.259+0000 7fe8cf39d700 1 --2- 172.21.15.146:0/3108575943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8c8068780 0x7fe8c80c4330 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fe8c400c590 tx=0x7fe8c400c950 comp rx=0 tx=0).stop 2023-10-06T11:09:38.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.259+0000 7fe8cf39d700 1 -- 172.21.15.146:0/3108575943 shutdown_connections 2023-10-06T11:09:38.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.259+0000 7fe8cf39d700 1 --2- 172.21.15.146:0/3108575943 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe8ac066f30 0x7fe8ac0693e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:38.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.259+0000 7fe8cf39d700 1 --2- 172.21.15.146:0/3108575943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8c80cb090 0x7fe8c80c3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:38.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.259+0000 7fe8cf39d700 1 --2- 172.21.15.146:0/3108575943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8c8068780 0x7fe8c80c4330 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:38.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.259+0000 7fe8cf39d700 1 --2- 172.21.15.146:0/3108575943 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8c80b5640 0x7fe8c81538b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:38.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.259+0000 7fe8cf39d700 1 -- 172.21.15.146:0/3108575943 >> 172.21.15.146:0/3108575943 conn(0x7fe8c80703f0 msgr2=0x7fe8c80cc4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:38.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.259+0000 7fe8cf39d700 1 -- 172.21.15.146:0/3108575943 shutdown_connections 2023-10-06T11:09:38.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.259+0000 7fe8cf39d700 1 -- 172.21.15.146:0/3108575943 wait complete. 2023-10-06T11:09:38.273 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:09:38.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.389+0000 7f9fafafa700 1 Processor -- start 2023-10-06T11:09:38.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.389+0000 7f9fafafa700 1 -- start start 2023-10-06T11:09:38.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.390+0000 7f9fafafa700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9fa815a160 0x7f9fa80c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:38.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.390+0000 7f9fafafa700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9fa80cb950 0x7f9fa80cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:38.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.390+0000 7f9fafafa700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fa80ae2a0 con 0x7f9fa80ae730 2023-10-06T11:09:38.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.390+0000 7f9fafafa700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fa815a530 con 0x7f9fa815a160 2023-10-06T11:09:38.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.390+0000 7f9fafafa700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa80ad690 con 0x7f9fa80cb950 2023-10-06T11:09:38.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.390+0000 7f9fad095700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f9fa80ae730 0x7f9fa80aebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39346/0 (socket says 172.21.15.146:39346) 2023-10-06T11:09:38.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.390+0000 7f9fad095700 1 -- 172.21.15.146:0/3711391347 learned_addr learned my addr 172.21.15.146:0/3711391347 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:38.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.391+0000 7f9fac894700 1 -- 172.21.15.146:0/3711391347 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1746561739 0 0) 0x7f9fa80ae2a0 con 0x7f9fa80ae730 2023-10-06T11:09:38.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.391+0000 7f9fae097700 1 --2- 172.21.15.146:0/3711391347 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9fa80cb950 0x7f9fa80cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:38.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.391+0000 7f9fad896700 1 --2- 172.21.15.146:0/3711391347 >> v2:172.21.15.151:3300/0 conn(0x7f9fa815a160 0x7f9fa80c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:38.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.391+0000 7f9fac894700 1 -- 172.21.15.146:0/3711391347 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f94003570 con 0x7f9fa80ae730 2023-10-06T11:09:38.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.391+0000 7f9fac894700 1 -- 172.21.15.146:0/3711391347 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1360714021 0 0) 0x7f9f94003570 con 0x7f9fa80ae730 2023-10-06T11:09:38.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.391+0000 7f9fac894700 1 -- 172.21.15.146:0/3711391347 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9fa80cb950 msgr2=0x7f9fa80cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:38.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.391+0000 7f9fac894700 1 --2- 172.21.15.146:0/3711391347 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9fa80cb950 0x7f9fa80cbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:38.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.391+0000 7f9fac894700 1 -- 172.21.15.146:0/3711391347 >> v2:172.21.15.151:3300/0 conn(0x7f9fa815a160 msgr2=0x7f9fa80c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:38.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.391+0000 7f9fac894700 1 --2- 172.21.15.146:0/3711391347 >> v2:172.21.15.151:3300/0 conn(0x7f9fa815a160 0x7f9fa80c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:38.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.391+0000 7f9fac894700 1 -- 172.21.15.146:0/3711391347 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa80ad970 con 0x7f9fa80ae730 2023-10-06T11:09:38.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.391+0000 7f9fac894700 1 -- 172.21.15.146:0/3711391347 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f9f98001470 con 0x7f9fa80ae730 2023-10-06T11:09:38.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.391+0000 7f9fac894700 1 -- 172.21.15.146:0/3711391347 >> v1:172.21.15.146:6789/0 conn(0x7f9fa80ae730 legacy=0x7f9fa80aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:38.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.391+0000 7f9fac894700 1 --2- 172.21.15.146:0/3711391347 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f94003a60 0x7f9f94003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:38.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.391+0000 7f9fac894700 1 --2- 172.21.15.146:0/3711391347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f94004810 0x7f9f94004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:38.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.391+0000 7f9fac894700 1 --2- 172.21.15.146:0/3711391347 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9fa80cb950 0x7f9f940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:38.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.391+0000 7f9fac894700 1 -- 172.21.15.146:0/3711391347 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa815a530 con 0x7f9f94004810 2023-10-06T11:09:38.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.391+0000 7f9fac894700 1 -- 172.21.15.146:0/3711391347 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa80ad690 con 0x7f9f94003a60 2023-10-06T11:09:38.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.391+0000 7f9fac894700 1 -- 172.21.15.146:0/3711391347 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9400ba60 con 0x7f9fa80cb950 2023-10-06T11:09:38.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.391+0000 7f9fad095700 1 --2- 172.21.15.146:0/3711391347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f94004810 0x7f9f94004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:38.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.391+0000 7f9fad896700 1 --2- 172.21.15.146:0/3711391347 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f94003a60 0x7f9f94003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:38.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.391+0000 7f9fae097700 1 --2- 172.21.15.146:0/3711391347 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9fa80cb950 0x7f9f940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:38.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.391+0000 7f9fad095700 1 -- 172.21.15.146:0/3711391347 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9fa80cb950 msgr2=0x7f9f940051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:38.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.391+0000 7f9fad095700 1 --2- 172.21.15.146:0/3711391347 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9fa80cb950 0x7f9f940051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:38.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.391+0000 7f9fad095700 1 -- 172.21.15.146:0/3711391347 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f94003a60 msgr2=0x7f9f94003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:38.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.391+0000 7f9fad095700 1 --2- 172.21.15.146:0/3711391347 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f94003a60 0x7f9f94003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:38.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.391+0000 7f9fad095700 1 -- 172.21.15.146:0/3711391347 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f94003570 con 0x7f9f94004810 2023-10-06T11:09:38.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.392+0000 7f9fad095700 1 --2- 172.21.15.146:0/3711391347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f94004810 0x7f9f94004c80 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f9f9800c3f0 tx=0x7f9f98001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1186687fd85408a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:38.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.392+0000 7f9fac894700 1 -- 172.21.15.146:0/3711391347 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9800cc80 con 0x7f9f94004810 2023-10-06T11:09:38.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.392+0000 7f9fac894700 1 -- 172.21.15.146:0/3711391347 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f9800ce00 con 0x7f9f94004810 2023-10-06T11:09:38.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.392+0000 7f9fac894700 1 -- 172.21.15.146:0/3711391347 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f98005b70 con 0x7f9f94004810 2023-10-06T11:09:38.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.392+0000 7f9fafafa700 1 -- 172.21.15.146:0/3711391347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f94004810 msgr2=0x7f9f94004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:38.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.392+0000 7f9fafafa700 1 --2- 172.21.15.146:0/3711391347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f94004810 0x7f9f94004c80 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f9f9800c3f0 tx=0x7f9f98001e90 comp rx=0 tx=0).stop 2023-10-06T11:09:38.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.392+0000 7f9fae097700 1 -- 172.21.15.146:0/3711391347 reap_dead start 2023-10-06T11:09:38.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.392+0000 7f9fafafa700 1 -- 172.21.15.146:0/3711391347 shutdown_connections 2023-10-06T11:09:38.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.392+0000 7f9fafafa700 1 -- 172.21.15.146:0/3711391347 >> 172.21.15.146:0/3711391347 conn(0x7f9fa806f380 msgr2=0x7f9fa80d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:38.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.392+0000 7f9fafafa700 1 -- 172.21.15.146:0/3711391347 shutdown_connections 2023-10-06T11:09:38.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.392+0000 7f9fafafa700 1 -- 172.21.15.146:0/3711391347 wait complete. 2023-10-06T11:09:38.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.393+0000 7f9fafafa700 1 Processor -- start 2023-10-06T11:09:38.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.393+0000 7f9fafafa700 1 -- start start 2023-10-06T11:09:38.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.394+0000 7f9fafafa700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9f94004810 0x7f9fa8158480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:38.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.394+0000 7f9fafafa700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9fa8145010 0x7f9fa815f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:38.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.394+0000 7f9fafafa700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fa815c810 0x7f9fa815cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:38.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.394+0000 7f9fafafa700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa80c8c30 con 0x7f9fa815c810 2023-10-06T11:09:38.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.394+0000 7f9fafafa700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa815d1c0 con 0x7f9fa8145010 2023-10-06T11:09:38.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.394+0000 7f9fafafa700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa815fab0 con 0x7f9f94004810 2023-10-06T11:09:38.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.394+0000 7f9fae097700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fa815c810 0x7f9fa815cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:38.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.394+0000 7f9fae097700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fa815c810 0x7f9fa815cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40294/0 (socket says 172.21.15.146:40294) 2023-10-06T11:09:38.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.394+0000 7f9fae097700 1 -- 172.21.15.146:0/1362538907 learned_addr learned my addr 172.21.15.146:0/1362538907 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:38.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.394+0000 7f9fad896700 1 --2- 172.21.15.146:0/1362538907 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9f94004810 0x7f9fa8158480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:38.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.394+0000 7f9fad095700 1 --2- 172.21.15.146:0/1362538907 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9fa8145010 0x7f9fa815f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:38.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.395+0000 7f9fae097700 1 -- 172.21.15.146:0/1362538907 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9f94004810 msgr2=0x7f9fa8158480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:38.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.395+0000 7f9fae097700 1 --2- 172.21.15.146:0/1362538907 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9f94004810 0x7f9fa8158480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:38.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.395+0000 7f9fae097700 1 -- 172.21.15.146:0/1362538907 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9fa8145010 msgr2=0x7f9fa815f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:38.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.395+0000 7f9fae097700 1 --2- 172.21.15.146:0/1362538907 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9fa8145010 0x7f9fa815f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:38.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.395+0000 7f9fae097700 1 -- 172.21.15.146:0/1362538907 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa8145480 con 0x7f9fa815c810 2023-10-06T11:09:38.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.395+0000 7f9fae097700 1 --2- 172.21.15.146:0/1362538907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fa815c810 0x7f9fa815cc80 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f9fa80b3360 tx=0x7f9fa00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:38.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.395+0000 7f9f9dffb700 1 -- 172.21.15.146:0/1362538907 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa0013680 con 0x7f9fa815c810 2023-10-06T11:09:38.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.395+0000 7f9f9dffb700 1 -- 172.21.15.146:0/1362538907 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa00137e0 con 0x7f9fa815c810 2023-10-06T11:09:38.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.395+0000 7f9fafafa700 1 -- 172.21.15.146:0/1362538907 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fa80c8300 con 0x7f9fa815c810 2023-10-06T11:09:38.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.395+0000 7f9f9dffb700 1 -- 172.21.15.146:0/1362538907 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa0013b60 con 0x7f9fa815c810 2023-10-06T11:09:38.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.395+0000 7f9fafafa700 1 -- 172.21.15.146:0/1362538907 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fa80c88c0 con 0x7f9fa815c810 2023-10-06T11:09:38.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.396+0000 7f9fafafa700 1 -- 172.21.15.146:0/1362538907 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fa80c8de0 con 0x7f9fa815c810 2023-10-06T11:09:38.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.396+0000 7f9f9dffb700 1 -- 172.21.15.146:0/1362538907 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9fa0014440 con 0x7f9fa815c810 2023-10-06T11:09:38.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.397+0000 7f9f9dffb700 1 --2- 172.21.15.146:0/1362538907 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9f8c066f30 0x7f9f8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:38.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.397+0000 7f9fad896700 1 --2- 172.21.15.146:0/1362538907 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9f8c066f30 0x7f9f8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:38.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.397+0000 7f9f9dffb700 1 -- 172.21.15.146:0/1362538907 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f9fa0084650 con 0x7f9fa815c810 2023-10-06T11:09:38.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.397+0000 7f9fad896700 1 --2- 172.21.15.146:0/1362538907 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9f8c066f30 0x7f9f8c0693e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9fa40094d0 tx=0x7f9fa400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:38.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.401+0000 7f9f9dffb700 1 -- 172.21.15.146:0/1362538907 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9fa80c8de0 con 0x7f9fa815c810 2023-10-06T11:09:38.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.584+0000 7f9fafafa700 1 -- 172.21.15.146:0/1362538907 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9fa80c8de0 con 0x7f9fa815c810 2023-10-06T11:09:38.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.584+0000 7f9f9dffb700 1 -- 172.21.15.146:0/1362538907 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v55) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9fa80c8de0 con 0x7f9fa815c810 2023-10-06T11:09:38.586 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-10-06T11:09:38.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.586+0000 7f9fafafa700 1 -- 172.21.15.146:0/1362538907 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9f8c066f30 msgr2=0x7f9f8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:38.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.586+0000 7f9fafafa700 1 --2- 172.21.15.146:0/1362538907 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9f8c066f30 0x7f9f8c0693e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9fa40094d0 tx=0x7f9fa400b040 comp rx=0 tx=0).stop 2023-10-06T11:09:38.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.586+0000 7f9fafafa700 1 -- 172.21.15.146:0/1362538907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fa815c810 msgr2=0x7f9fa815cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:38.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.586+0000 7f9fafafa700 1 --2- 172.21.15.146:0/1362538907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fa815c810 0x7f9fa815cc80 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f9fa80b3360 tx=0x7f9fa00091a0 comp rx=0 tx=0).stop 2023-10-06T11:09:38.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.586+0000 7f9fafafa700 1 -- 172.21.15.146:0/1362538907 shutdown_connections 2023-10-06T11:09:38.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.586+0000 7f9fafafa700 1 --2- 172.21.15.146:0/1362538907 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9f8c066f30 0x7f9f8c0693e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:38.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.586+0000 7f9fafafa700 1 --2- 172.21.15.146:0/1362538907 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fa815c810 0x7f9fa815cc80 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:38.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.586+0000 7f9fafafa700 1 --2- 172.21.15.146:0/1362538907 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9f94004810 0x7f9fa8158480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:38.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.586+0000 7f9fafafa700 1 --2- 172.21.15.146:0/1362538907 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9fa8145010 0x7f9fa815f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:38.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.586+0000 7f9fafafa700 1 -- 172.21.15.146:0/1362538907 >> 172.21.15.146:0/1362538907 conn(0x7f9fa806f380 msgr2=0x7f9fa81594d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:38.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.586+0000 7f9fafafa700 1 -- 172.21.15.146:0/1362538907 shutdown_connections 2023-10-06T11:09:38.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.586+0000 7f9fafafa700 1 -- 172.21.15.146:0/1362538907 wait complete. 2023-10-06T11:09:38.600 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T11:09:38.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.713+0000 7f41dc00e700 1 Processor -- start 2023-10-06T11:09:38.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.713+0000 7f41dc00e700 1 -- start start 2023-10-06T11:09:38.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.714+0000 7f41dc00e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41d4068ba0 0x7f41d415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:38.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.714+0000 7f41dc00e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41d415ac30 con 0x7f41d4153ab0 2023-10-06T11:09:38.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.714+0000 7f41dc00e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41d40b4510 con 0x7f41d4153e80 2023-10-06T11:09:38.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.714+0000 7f41dc00e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d40b6530 con 0x7f41d4068ba0 2023-10-06T11:09:38.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.714+0000 7f41d9daa700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f41d4153ab0 0x7f41d4068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39348/0 (socket says 172.21.15.146:39348) 2023-10-06T11:09:38.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.714+0000 7f41d9daa700 1 -- 172.21.15.146:0/3259514956 learned_addr learned my addr 172.21.15.146:0/3259514956 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:38.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.714+0000 7f41d95a9700 1 --2- 172.21.15.146:0/3259514956 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41d4068ba0 0x7f41d415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:38.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.714+0000 7f41d8da8700 1 -- 172.21.15.146:0/3259514956 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 348866798 0 0) 0x7f41d0001110 con 0x7f41d4153ab0 2023-10-06T11:09:38.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.715+0000 7f41d8da8700 1 -- 172.21.15.146:0/3259514956 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41c0003570 con 0x7f41d4153ab0 2023-10-06T11:09:38.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.715+0000 7f41d8da8700 1 -- 172.21.15.146:0/3259514956 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 451925341 0 0) 0x7f41c0003570 con 0x7f41d4153ab0 2023-10-06T11:09:38.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.715+0000 7f41d8da8700 1 -- 172.21.15.146:0/3259514956 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41d4068ba0 msgr2=0x7f41d415a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:38.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.715+0000 7f41d8da8700 1 --2- 172.21.15.146:0/3259514956 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41d4068ba0 0x7f41d415a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:38.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.715+0000 7f41d8da8700 1 -- 172.21.15.146:0/3259514956 >> v1:172.21.15.151:6789/0 conn(0x7f41d4153e80 legacy=0x7f41d40b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:38.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.715+0000 7f41d8da8700 1 -- 172.21.15.146:0/3259514956 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d40b5c50 con 0x7f41d4153ab0 2023-10-06T11:09:38.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.715+0000 7f41d8da8700 1 -- 172.21.15.146:0/3259514956 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f41d0001600 con 0x7f41d4153ab0 2023-10-06T11:09:38.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.715+0000 7f41d8da8700 1 -- 172.21.15.146:0/3259514956 >> v1:172.21.15.146:6789/0 conn(0x7f41d4153ab0 legacy=0x7f41d4068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:38.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.715+0000 7f41d8da8700 1 --2- 172.21.15.146:0/3259514956 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41d4068ba0 0x7f41c0003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:38.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.715+0000 7f41d8da8700 1 --2- 172.21.15.146:0/3259514956 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41c0004010 0x7f41c0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:38.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.715+0000 7f41d8da8700 1 --2- 172.21.15.146:0/3259514956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41c0004d50 0x7f41c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:38.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.715+0000 7f41d8da8700 1 -- 172.21.15.146:0/3259514956 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d40b6530 con 0x7f41c0004d50 2023-10-06T11:09:38.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.715+0000 7f41d8da8700 1 -- 172.21.15.146:0/3259514956 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c000bbf0 con 0x7f41c0004010 2023-10-06T11:09:38.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.715+0000 7f41d8da8700 1 -- 172.21.15.146:0/3259514956 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c000bdb0 con 0x7f41d4068ba0 2023-10-06T11:09:38.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.715+0000 7f41da5ab700 1 --2- 172.21.15.146:0/3259514956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41c0004d50 0x7f41c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:38.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.715+0000 7f41d9daa700 1 --2- 172.21.15.146:0/3259514956 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41d4068ba0 0x7f41c0003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:38.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.715+0000 7f41d95a9700 1 --2- 172.21.15.146:0/3259514956 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41c0004010 0x7f41c0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:38.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.715+0000 7f41da5ab700 1 -- 172.21.15.146:0/3259514956 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41d4068ba0 msgr2=0x7f41c0003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:38.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.715+0000 7f41da5ab700 1 --2- 172.21.15.146:0/3259514956 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41d4068ba0 0x7f41c0003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:38.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.715+0000 7f41da5ab700 1 -- 172.21.15.146:0/3259514956 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41c0004010 msgr2=0x7f41c0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:38.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.715+0000 7f41da5ab700 1 --2- 172.21.15.146:0/3259514956 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41c0004010 0x7f41c0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:38.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.715+0000 7f41da5ab700 1 -- 172.21.15.146:0/3259514956 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c0003570 con 0x7f41c0004d50 2023-10-06T11:09:38.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.715+0000 7f41da5ab700 1 --2- 172.21.15.146:0/3259514956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41c0004d50 0x7f41c00051c0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f41cc001f90 tx=0x7f41cc001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c27698f7e6923600 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:38.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.716+0000 7f41d8da8700 1 -- 172.21.15.146:0/3259514956 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc001950 con 0x7f41c0004d50 2023-10-06T11:09:38.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.716+0000 7f41d8da8700 1 -- 172.21.15.146:0/3259514956 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41cc00c8b0 con 0x7f41c0004d50 2023-10-06T11:09:38.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.716+0000 7f41d8da8700 1 -- 172.21.15.146:0/3259514956 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41cc00cc70 con 0x7f41c0004d50 2023-10-06T11:09:38.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.716+0000 7f41dc00e700 1 -- 172.21.15.146:0/3259514956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41c0004d50 msgr2=0x7f41c00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:38.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.716+0000 7f41dc00e700 1 --2- 172.21.15.146:0/3259514956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41c0004d50 0x7f41c00051c0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f41cc001f90 tx=0x7f41cc001640 comp rx=0 tx=0).stop 2023-10-06T11:09:38.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.716+0000 7f41da5ab700 1 -- 172.21.15.146:0/3259514956 reap_dead start 2023-10-06T11:09:38.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.716+0000 7f41dc00e700 1 -- 172.21.15.146:0/3259514956 shutdown_connections 2023-10-06T11:09:38.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.716+0000 7f41dc00e700 1 -- 172.21.15.146:0/3259514956 >> 172.21.15.146:0/3259514956 conn(0x7f41d406eba0 msgr2=0x7f41d406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:38.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.716+0000 7f41dc00e700 1 -- 172.21.15.146:0/3259514956 shutdown_connections 2023-10-06T11:09:38.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.716+0000 7f41dc00e700 1 -- 172.21.15.146:0/3259514956 wait complete. 2023-10-06T11:09:38.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.717+0000 7f41dc00e700 1 Processor -- start 2023-10-06T11:09:38.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.717+0000 7f41dc00e700 1 -- start start 2023-10-06T11:09:38.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.718+0000 7f41dc00e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41d414aa20 0x7f41d414adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:38.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.718+0000 7f41dc00e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41d414fd60 0x7f41d40b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:38.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.718+0000 7f41dc00e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41d40b1190 0x7f41d415ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:38.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.718+0000 7f41dc00e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d40b0510 con 0x7f41d414fd60 2023-10-06T11:09:38.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.718+0000 7f41dc00e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d40b19e0 con 0x7f41d414aa20 2023-10-06T11:09:38.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.718+0000 7f41dc00e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d40b1cc0 con 0x7f41d40b1190 2023-10-06T11:09:38.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.718+0000 7f41d95a9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41d414fd60 0x7f41d40b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:38.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.718+0000 7f41d95a9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41d414fd60 0x7f41d40b09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40310/0 (socket says 172.21.15.146:40310) 2023-10-06T11:09:38.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.718+0000 7f41d95a9700 1 -- 172.21.15.146:0/416246155 learned_addr learned my addr 172.21.15.146:0/416246155 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:38.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.718+0000 7f41da5ab700 1 --2- 172.21.15.146:0/416246155 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41d40b1190 0x7f41d415ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:38.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.718+0000 7f41d95a9700 1 -- 172.21.15.146:0/416246155 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41d40b1190 msgr2=0x7f41d415ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:38.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.718+0000 7f41d95a9700 1 --2- 172.21.15.146:0/416246155 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41d40b1190 0x7f41d415ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:38.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.718+0000 7f41d95a9700 1 -- 172.21.15.146:0/416246155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41d414aa20 msgr2=0x7f41d414adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:38.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.718+0000 7f41d9daa700 1 --2- 172.21.15.146:0/416246155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41d414aa20 0x7f41d414adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:38.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.718+0000 7f41d95a9700 1 --2- 172.21.15.146:0/416246155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41d414aa20 0x7f41d414adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:38.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.718+0000 7f41d95a9700 1 -- 172.21.15.146:0/416246155 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d40afec0 con 0x7f41d414fd60 2023-10-06T11:09:38.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.718+0000 7f41da5ab700 1 --2- 172.21.15.146:0/416246155 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41d40b1190 0x7f41d415ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:09:38.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.718+0000 7f41d9daa700 1 --2- 172.21.15.146:0/416246155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41d414aa20 0x7f41d414adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:09:38.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.719+0000 7f41d95a9700 1 --2- 172.21.15.146:0/416246155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41d414fd60 0x7f41d40b09a0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f41c4006ac0 tx=0x7f41c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:38.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.719+0000 7f41c9ffb700 1 -- 172.21.15.146:0/416246155 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c400fa10 con 0x7f41d414fd60 2023-10-06T11:09:38.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.719+0000 7f41c9ffb700 1 -- 172.21.15.146:0/416246155 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c400fb70 con 0x7f41d414fd60 2023-10-06T11:09:38.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.719+0000 7f41dc00e700 1 -- 172.21.15.146:0/416246155 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41d40b01a0 con 0x7f41d414fd60 2023-10-06T11:09:38.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.719+0000 7f41c9ffb700 1 -- 172.21.15.146:0/416246155 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c4014440 con 0x7f41d414fd60 2023-10-06T11:09:38.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.719+0000 7f41dc00e700 1 -- 172.21.15.146:0/416246155 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41d40b1600 con 0x7f41d414fd60 2023-10-06T11:09:38.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.720+0000 7f41dc00e700 1 -- 172.21.15.146:0/416246155 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41d40b06c0 con 0x7f41d414fd60 2023-10-06T11:09:38.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.720+0000 7f41c9ffb700 1 -- 172.21.15.146:0/416246155 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f41c4014870 con 0x7f41d414fd60 2023-10-06T11:09:38.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.721+0000 7f41c9ffb700 1 --2- 172.21.15.146:0/416246155 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f41b8066f30 0x7f41b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:38.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.721+0000 7f41c9ffb700 1 -- 172.21.15.146:0/416246155 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f41c4018030 con 0x7f41d414fd60 2023-10-06T11:09:38.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.721+0000 7f41d9daa700 1 --2- 172.21.15.146:0/416246155 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f41b8066f30 0x7f41b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:38.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.721+0000 7f41d9daa700 1 --2- 172.21.15.146:0/416246155 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f41b8066f30 0x7f41b80693e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f41d0007b20 tx=0x7f41d0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:38.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.725+0000 7f41c9ffb700 1 -- 172.21.15.146:0/416246155 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f41d40b06c0 con 0x7f41d414fd60 2023-10-06T11:09:38.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.911+0000 7f41dc00e700 1 -- 172.21.15.146:0/416246155 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f41d40689e0 con 0x7f41d414fd60 2023-10-06T11:09:38.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.912+0000 7f41c9ffb700 1 -- 172.21.15.146:0/416246155 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v55) v1 ==== 84+0+126 (secure 0 0 0) 0x7f41c4022090 con 0x7f41d414fd60 2023-10-06T11:09:38.914 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:09:38.914 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2023-10-06T11:09:38.914 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:09:38.915 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 1, 2023-10-06T11:09:38.915 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": "rbd" 2023-10-06T11:09:38.915 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:09:38.915 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:09:38.915 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 2, 2023-10-06T11:09:38.915 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": ".mgr" 2023-10-06T11:09:38.916 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:09:38.916 INFO:teuthology.orchestra.run.smithi146.stdout:] 2023-10-06T11:09:38.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.914+0000 7f41dc00e700 1 -- 172.21.15.146:0/416246155 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f41b8066f30 msgr2=0x7f41b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:38.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.914+0000 7f41dc00e700 1 --2- 172.21.15.146:0/416246155 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f41b8066f30 0x7f41b80693e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f41d0007b20 tx=0x7f41d0009040 comp rx=0 tx=0).stop 2023-10-06T11:09:38.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.914+0000 7f41dc00e700 1 -- 172.21.15.146:0/416246155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41d414fd60 msgr2=0x7f41d40b09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:38.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.914+0000 7f41dc00e700 1 --2- 172.21.15.146:0/416246155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41d414fd60 0x7f41d40b09a0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f41c4006ac0 tx=0x7f41c40091a0 comp rx=0 tx=0).stop 2023-10-06T11:09:38.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.914+0000 7f41dc00e700 1 -- 172.21.15.146:0/416246155 shutdown_connections 2023-10-06T11:09:38.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.914+0000 7f41dc00e700 1 --2- 172.21.15.146:0/416246155 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f41b8066f30 0x7f41b80693e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:38.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.914+0000 7f41dc00e700 1 --2- 172.21.15.146:0/416246155 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41d40b1190 0x7f41d415ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:38.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.914+0000 7f41dc00e700 1 --2- 172.21.15.146:0/416246155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41d414aa20 0x7f41d414adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:38.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.914+0000 7f41dc00e700 1 --2- 172.21.15.146:0/416246155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41d414fd60 0x7f41d40b09a0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:38.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.914+0000 7f41dc00e700 1 -- 172.21.15.146:0/416246155 >> 172.21.15.146:0/416246155 conn(0x7f41d406eba0 msgr2=0x7f41d40b49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:38.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.914+0000 7f41dc00e700 1 -- 172.21.15.146:0/416246155 shutdown_connections 2023-10-06T11:09:38.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:38.914+0000 7f41dc00e700 1 -- 172.21.15.146:0/416246155 wait complete. 2023-10-06T11:09:38.928 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T11:09:38.928 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T11:09:39.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.045+0000 7f126654a700 1 Processor -- start 2023-10-06T11:09:39.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.045+0000 7f126654a700 1 -- start start 2023-10-06T11:09:39.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.046+0000 7f126654a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f12600cb090 0x7f12600cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:39.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.046+0000 7f126654a700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1260068780 0x7f1260068bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:39.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.046+0000 7f126654a700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12600cc130 con 0x7f12600b5640 2023-10-06T11:09:39.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.046+0000 7f126654a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1260069100 con 0x7f12600cb090 2023-10-06T11:09:39.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.046+0000 7f126654a700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12600b2660 con 0x7f1260068780 2023-10-06T11:09:39.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.046+0000 7f1264d47700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f12600cb090 0x7f12600cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:39.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.046+0000 7f1264d47700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f12600cb090 0x7f12600cc5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40320/0 (socket says 172.21.15.146:40320) 2023-10-06T11:09:39.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.046+0000 7f1264d47700 1 -- 172.21.15.146:0/3751595677 learned_addr learned my addr 172.21.15.146:0/3751595677 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:39.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.046+0000 7f1265d49700 1 --2- 172.21.15.146:0/3751595677 >> v2:172.21.15.151:3300/0 conn(0x7f1260068780 0x7f1260068bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:39.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.047+0000 7f1264d47700 1 -- 172.21.15.146:0/3751595677 >> v2:172.21.15.151:3300/0 conn(0x7f1260068780 msgr2=0x7f1260068bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:39.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.047+0000 7f1264d47700 1 --2- 172.21.15.146:0/3751595677 >> v2:172.21.15.151:3300/0 conn(0x7f1260068780 0x7f1260068bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:39.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.047+0000 7f1264d47700 1 -- 172.21.15.146:0/3751595677 >> v1:172.21.15.151:6789/0 conn(0x7f12600b5640 legacy=0x7f126015a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:39.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.047+0000 7f1264d47700 1 -- 172.21.15.146:0/3751595677 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12600cb520 con 0x7f12600cb090 2023-10-06T11:09:39.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.047+0000 7f1265d49700 1 --2- 172.21.15.146:0/3751595677 >> v2:172.21.15.151:3300/0 conn(0x7f1260068780 0x7f1260068bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:39.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.047+0000 7f1264d47700 1 --2- 172.21.15.146:0/3751595677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12600cb090 0x7f12600cc5c0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f1260159e40 tx=0x7f1250009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35130925952f8f14 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:39.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.047+0000 7f1257fff700 1 -- 172.21.15.146:0/3751595677 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125000b860 con 0x7f12600cb090 2023-10-06T11:09:39.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.047+0000 7f1257fff700 1 -- 172.21.15.146:0/3751595677 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f125000b9c0 con 0x7f12600cb090 2023-10-06T11:09:39.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.047+0000 7f1257fff700 1 -- 172.21.15.146:0/3751595677 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125000bd60 con 0x7f12600cb090 2023-10-06T11:09:39.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.047+0000 7f126654a700 1 -- 172.21.15.146:0/3751595677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12600cb090 msgr2=0x7f12600cc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:39.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.047+0000 7f126654a700 1 --2- 172.21.15.146:0/3751595677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12600cb090 0x7f12600cc5c0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f1260159e40 tx=0x7f1250009250 comp rx=0 tx=0).stop 2023-10-06T11:09:39.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.047+0000 7f126654a700 1 -- 172.21.15.146:0/3751595677 shutdown_connections 2023-10-06T11:09:39.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.047+0000 7f126654a700 1 --2- 172.21.15.146:0/3751595677 >> v2:172.21.15.151:3300/0 conn(0x7f1260068780 0x7f1260068bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:39.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.047+0000 7f126654a700 1 --2- 172.21.15.146:0/3751595677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12600cb090 0x7f12600cc5c0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:39.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.047+0000 7f126654a700 1 -- 172.21.15.146:0/3751595677 >> 172.21.15.146:0/3751595677 conn(0x7f12600703f0 msgr2=0x7f12600707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:39.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.048+0000 7f126654a700 1 -- 172.21.15.146:0/3751595677 shutdown_connections 2023-10-06T11:09:39.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.048+0000 7f126654a700 1 -- 172.21.15.146:0/3751595677 wait complete. 2023-10-06T11:09:39.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.049+0000 7f126654a700 1 Processor -- start 2023-10-06T11:09:39.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.049+0000 7f126654a700 1 -- start start 2023-10-06T11:09:39.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.050+0000 7f126654a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1260068780 0x7f12600c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:39.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.050+0000 7f126654a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12600b5640 0x7f12600c3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:39.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.050+0000 7f126654a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12600cb090 0x7f126015e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:39.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.050+0000 7f126654a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12600c95e0 con 0x7f12600b5640 2023-10-06T11:09:39.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.050+0000 7f126654a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12600c44b0 con 0x7f12600cb090 2023-10-06T11:09:39.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.050+0000 7f126654a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12600c4790 con 0x7f1260068780 2023-10-06T11:09:39.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.050+0000 7f1264d47700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12600b5640 0x7f12600c3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:39.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.050+0000 7f1264d47700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12600b5640 0x7f12600c3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40328/0 (socket says 172.21.15.146:40328) 2023-10-06T11:09:39.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.050+0000 7f1264d47700 1 -- 172.21.15.146:0/521103060 learned_addr learned my addr 172.21.15.146:0/521103060 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:39.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.050+0000 7f1265d49700 1 --2- 172.21.15.146:0/521103060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12600cb090 0x7f126015e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:39.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.050+0000 7f1265548700 1 --2- 172.21.15.146:0/521103060 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1260068780 0x7f12600c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:39.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.050+0000 7f1264d47700 1 -- 172.21.15.146:0/521103060 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1260068780 msgr2=0x7f12600c9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:39.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.050+0000 7f1264d47700 1 --2- 172.21.15.146:0/521103060 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1260068780 0x7f12600c9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:39.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.050+0000 7f1264d47700 1 -- 172.21.15.146:0/521103060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12600cb090 msgr2=0x7f126015e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:39.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.050+0000 7f1264d47700 1 --2- 172.21.15.146:0/521103060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12600cb090 0x7f126015e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:39.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.050+0000 7f1264d47700 1 -- 172.21.15.146:0/521103060 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12500094f0 con 0x7f12600b5640 2023-10-06T11:09:39.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.050+0000 7f1264d47700 1 --2- 172.21.15.146:0/521103060 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12600b5640 0x7f12600c3a80 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f1250009290 tx=0x7f1250017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:39.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.050+0000 7f12557fa700 1 -- 172.21.15.146:0/521103060 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1250026480 con 0x7f12600b5640 2023-10-06T11:09:39.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.050+0000 7f12557fa700 1 -- 172.21.15.146:0/521103060 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f125001f070 con 0x7f12600b5640 2023-10-06T11:09:39.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.050+0000 7f126654a700 1 -- 172.21.15.146:0/521103060 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12600c9270 con 0x7f12600b5640 2023-10-06T11:09:39.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.050+0000 7f12557fa700 1 -- 172.21.15.146:0/521103060 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1250026850 con 0x7f12600b5640 2023-10-06T11:09:39.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.050+0000 7f126654a700 1 -- 172.21.15.146:0/521103060 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1260152f30 con 0x7f12600b5640 2023-10-06T11:09:39.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.051+0000 7f126654a700 1 -- 172.21.15.146:0/521103060 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12600894b0 con 0x7f12600b5640 2023-10-06T11:09:39.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.052+0000 7f12557fa700 1 -- 172.21.15.146:0/521103060 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f125001a430 con 0x7f12600b5640 2023-10-06T11:09:39.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.052+0000 7f12557fa700 1 --2- 172.21.15.146:0/521103060 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1244066f30 0x7f12440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:39.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.052+0000 7f12557fa700 1 -- 172.21.15.146:0/521103060 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f1250021070 con 0x7f12600b5640 2023-10-06T11:09:39.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.052+0000 7f1265548700 1 --2- 172.21.15.146:0/521103060 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1244066f30 0x7f12440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:39.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.052+0000 7f1265548700 1 --2- 172.21.15.146:0/521103060 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1244066f30 0x7f12440693e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f125c003a80 tx=0x7f125c007ec0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:39.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.056+0000 7f12557fa700 1 -- 172.21.15.146:0/521103060 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f12500b75a0 con 0x7f12600b5640 2023-10-06T11:09:39.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:39.242+0000 7f126654a700 1 -- 172.21.15.146:0/521103060 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f12600c9720 con 0x7f12600b5640 2023-10-06T11:09:40.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.196+0000 7f12557fa700 1 -- 172.21.15.146:0/521103060 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v56) v1 ==== 138+0+0 (secure 0 0 0) 0x7f12500535d0 con 0x7f12600b5640 2023-10-06T11:09:40.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.199+0000 7f126654a700 1 -- 172.21.15.146:0/521103060 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1244066f30 msgr2=0x7f12440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:40.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.199+0000 7f126654a700 1 --2- 172.21.15.146:0/521103060 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1244066f30 0x7f12440693e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f125c003a80 tx=0x7f125c007ec0 comp rx=0 tx=0).stop 2023-10-06T11:09:40.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.199+0000 7f126654a700 1 -- 172.21.15.146:0/521103060 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12600b5640 msgr2=0x7f12600c3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:40.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.199+0000 7f126654a700 1 --2- 172.21.15.146:0/521103060 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12600b5640 0x7f12600c3a80 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f1250009290 tx=0x7f1250017000 comp rx=0 tx=0).stop 2023-10-06T11:09:40.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.199+0000 7f126654a700 1 -- 172.21.15.146:0/521103060 shutdown_connections 2023-10-06T11:09:40.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.199+0000 7f126654a700 1 --2- 172.21.15.146:0/521103060 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1244066f30 0x7f12440693e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:40.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.199+0000 7f126654a700 1 --2- 172.21.15.146:0/521103060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12600cb090 0x7f126015e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:40.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.199+0000 7f126654a700 1 --2- 172.21.15.146:0/521103060 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1260068780 0x7f12600c9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:40.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.199+0000 7f126654a700 1 --2- 172.21.15.146:0/521103060 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f12600b5640 0x7f12600c3a80 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:40.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.199+0000 7f126654a700 1 -- 172.21.15.146:0/521103060 >> 172.21.15.146:0/521103060 conn(0x7f12600703f0 msgr2=0x7f12600b4980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:40.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.200+0000 7f126654a700 1 -- 172.21.15.146:0/521103060 shutdown_connections 2023-10-06T11:09:40.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.201+0000 7f126654a700 1 -- 172.21.15.146:0/521103060 wait complete. 2023-10-06T11:09:40.206 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' created 2023-10-06T11:09:40.216 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T11:09:40.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.337+0000 7f1c0ffff700 1 Processor -- start 2023-10-06T11:09:40.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.338+0000 7f1c0ffff700 1 -- start start 2023-10-06T11:09:40.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.338+0000 7f1c0ffff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c1006b8a0 0x7f1c100b0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:40.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.338+0000 7f1c0ffff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1c1006bc70 0x7f1c1015b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:40.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.338+0000 7f1c0ffff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c100c90f0 con 0x7f1c10140800 2023-10-06T11:09:40.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.338+0000 7f1c0ffff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c100c9d40 con 0x7f1c1006bc70 2023-10-06T11:09:40.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.338+0000 7f1c0ffff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c100cbe00 con 0x7f1c1006b8a0 2023-10-06T11:09:40.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.338+0000 7f1c0f7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f1c10140800 0x7f1c10140c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39364/0 (socket says 172.21.15.146:39364) 2023-10-06T11:09:40.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.338+0000 7f1c0f7fe700 1 -- 172.21.15.146:0/4168065217 learned_addr learned my addr 172.21.15.146:0/4168065217 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:40.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.339+0000 7f1c0e7fc700 1 -- 172.21.15.146:0/4168065217 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1695359089 0 0) 0x7f1c08001490 con 0x7f1c10140800 2023-10-06T11:09:40.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.339+0000 7f1c0e7fc700 1 -- 172.21.15.146:0/4168065217 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bfc003570 con 0x7f1c10140800 2023-10-06T11:09:40.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.339+0000 7f1c07fff700 1 --2- 172.21.15.146:0/4168065217 >> v2:172.21.15.151:3300/0 conn(0x7f1c1006bc70 0x7f1c1015b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:40.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.339+0000 7f1c0effd700 1 --2- 172.21.15.146:0/4168065217 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c1006b8a0 0x7f1c100b0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:40.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.339+0000 7f1c0e7fc700 1 -- 172.21.15.146:0/4168065217 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 640161865 0 0) 0x7f1bfc003570 con 0x7f1c10140800 2023-10-06T11:09:40.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.339+0000 7f1c0e7fc700 1 -- 172.21.15.146:0/4168065217 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c1006b8a0 msgr2=0x7f1c100b0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:40.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.339+0000 7f1c0e7fc700 1 --2- 172.21.15.146:0/4168065217 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c1006b8a0 0x7f1c100b0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:40.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.339+0000 7f1c0e7fc700 1 -- 172.21.15.146:0/4168065217 >> v2:172.21.15.151:3300/0 conn(0x7f1c1006bc70 msgr2=0x7f1c1015b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:40.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.339+0000 7f1c0e7fc700 1 --2- 172.21.15.146:0/4168065217 >> v2:172.21.15.151:3300/0 conn(0x7f1c1006bc70 0x7f1c1015b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:40.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.339+0000 7f1c0e7fc700 1 -- 172.21.15.146:0/4168065217 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c100cc350 con 0x7f1c10140800 2023-10-06T11:09:40.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.339+0000 7f1c0e7fc700 1 -- 172.21.15.146:0/4168065217 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f1c08001980 con 0x7f1c10140800 2023-10-06T11:09:40.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.339+0000 7f1c0e7fc700 1 -- 172.21.15.146:0/4168065217 >> v1:172.21.15.146:6789/0 conn(0x7f1c10140800 legacy=0x7f1c10140c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:40.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.339+0000 7f1c0e7fc700 1 --2- 172.21.15.146:0/4168065217 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c1006b8a0 0x7f1bfc003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:40.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.339+0000 7f1c0e7fc700 1 --2- 172.21.15.146:0/4168065217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bfc004010 0x7f1bfc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:40.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.339+0000 7f1c0e7fc700 1 --2- 172.21.15.146:0/4168065217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bfc004d50 0x7f1bfc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:40.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.339+0000 7f1c0e7fc700 1 -- 172.21.15.146:0/4168065217 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c100c9d40 con 0x7f1bfc004010 2023-10-06T11:09:40.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.339+0000 7f1c0e7fc700 1 -- 172.21.15.146:0/4168065217 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c100cbe00 con 0x7f1bfc004d50 2023-10-06T11:09:40.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.339+0000 7f1c0e7fc700 1 -- 172.21.15.146:0/4168065217 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc00bab0 con 0x7f1c1006b8a0 2023-10-06T11:09:40.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.339+0000 7f1c07fff700 1 --2- 172.21.15.146:0/4168065217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bfc004010 0x7f1bfc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:40.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.339+0000 7f1c0effd700 1 --2- 172.21.15.146:0/4168065217 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c1006b8a0 0x7f1bfc003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:40.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.339+0000 7f1c0f7fe700 1 --2- 172.21.15.146:0/4168065217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bfc004d50 0x7f1bfc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:40.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.339+0000 7f1c07fff700 1 -- 172.21.15.146:0/4168065217 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c1006b8a0 msgr2=0x7f1bfc003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:40.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.339+0000 7f1c07fff700 1 --2- 172.21.15.146:0/4168065217 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c1006b8a0 0x7f1bfc003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:40.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.339+0000 7f1c07fff700 1 -- 172.21.15.146:0/4168065217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bfc004d50 msgr2=0x7f1bfc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:40.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.339+0000 7f1c07fff700 1 --2- 172.21.15.146:0/4168065217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bfc004d50 0x7f1bfc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:40.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.339+0000 7f1c07fff700 1 -- 172.21.15.146:0/4168065217 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bfc003570 con 0x7f1bfc004010 2023-10-06T11:09:40.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.339+0000 7f1c0f7fe700 1 --2- 172.21.15.146:0/4168065217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1bfc004d50 0x7f1bfc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:40.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.339+0000 7f1c0effd700 1 --2- 172.21.15.146:0/4168065217 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c1006b8a0 0x7f1bfc003a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:40.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.340+0000 7f1c07fff700 1 --2- 172.21.15.146:0/4168065217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bfc004010 0x7f1bfc004810 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8009c00 tx=0x7f1bf80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc0c2c3d962b5201 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:40.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.340+0000 7f1c0e7fc700 1 -- 172.21.15.146:0/4168065217 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf800e710 con 0x7f1bfc004010 2023-10-06T11:09:40.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.340+0000 7f1c0e7fc700 1 -- 172.21.15.146:0/4168065217 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf800e870 con 0x7f1bfc004010 2023-10-06T11:09:40.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.340+0000 7f1c0e7fc700 1 -- 172.21.15.146:0/4168065217 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf800ec30 con 0x7f1bfc004010 2023-10-06T11:09:40.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.340+0000 7f1c0ffff700 1 -- 172.21.15.146:0/4168065217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bfc004010 msgr2=0x7f1bfc004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:40.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.340+0000 7f1c0ffff700 1 --2- 172.21.15.146:0/4168065217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bfc004010 0x7f1bfc004810 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8009c00 tx=0x7f1bf80091a0 comp rx=0 tx=0).stop 2023-10-06T11:09:40.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.340+0000 7f1c0f7fe700 1 -- 172.21.15.146:0/4168065217 reap_dead start 2023-10-06T11:09:40.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.340+0000 7f1c0ffff700 1 -- 172.21.15.146:0/4168065217 shutdown_connections 2023-10-06T11:09:40.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.340+0000 7f1c0ffff700 1 -- 172.21.15.146:0/4168065217 >> 172.21.15.146:0/4168065217 conn(0x7f1c100ce230 msgr2=0x7f1c100ce630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:40.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.340+0000 7f1c0ffff700 1 -- 172.21.15.146:0/4168065217 shutdown_connections 2023-10-06T11:09:40.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.340+0000 7f1c0ffff700 1 -- 172.21.15.146:0/4168065217 wait complete. 2023-10-06T11:09:40.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.341+0000 7f1c0ffff700 1 Processor -- start 2023-10-06T11:09:40.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.342+0000 7f1c0ffff700 1 -- start start 2023-10-06T11:09:40.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.342+0000 7f1c0ffff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bfc004010 0x7f1c10158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:40.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.342+0000 7f1c0ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c100b0010 0x7f1c100c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:40.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.342+0000 7f1c0ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c100cc6a0 0x7f1c100ccb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:40.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.342+0000 7f1c0ffff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c100cd050 con 0x7f1c100b0010 2023-10-06T11:09:40.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.342+0000 7f1c0ffff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c10168700 con 0x7f1c100cc6a0 2023-10-06T11:09:40.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.342+0000 7f1c0ffff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c101593d0 con 0x7f1bfc004010 2023-10-06T11:09:40.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.342+0000 7f1c07fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c100b0010 0x7f1c100c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:40.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.342+0000 7f1c07fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c100b0010 0x7f1c100c7c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40340/0 (socket says 172.21.15.146:40340) 2023-10-06T11:09:40.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.342+0000 7f1c07fff700 1 -- 172.21.15.146:0/2526199929 learned_addr learned my addr 172.21.15.146:0/2526199929 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:40.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.343+0000 7f1c0effd700 1 --2- 172.21.15.146:0/2526199929 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bfc004010 0x7f1c10158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:40.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.343+0000 7f1c07fff700 1 -- 172.21.15.146:0/2526199929 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bfc004010 msgr2=0x7f1c10158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:40.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.343+0000 7f1c07fff700 1 --2- 172.21.15.146:0/2526199929 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bfc004010 0x7f1c10158e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:40.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.343+0000 7f1c07fff700 1 -- 172.21.15.146:0/2526199929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c100cc6a0 msgr2=0x7f1c100ccb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:40.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.343+0000 7f1c07fff700 1 --2- 172.21.15.146:0/2526199929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c100cc6a0 0x7f1c100ccb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:40.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.343+0000 7f1c07fff700 1 -- 172.21.15.146:0/2526199929 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c100c8140 con 0x7f1c100b0010 2023-10-06T11:09:40.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.343+0000 7f1c07fff700 1 --2- 172.21.15.146:0/2526199929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c100b0010 0x7f1c100c7c00 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc004760 tx=0x7f1bf801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:40.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.343+0000 7f1c06ffd700 1 -- 172.21.15.146:0/2526199929 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf8022070 con 0x7f1c100b0010 2023-10-06T11:09:40.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.343+0000 7f1c06ffd700 1 -- 172.21.15.146:0/2526199929 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf800ebf0 con 0x7f1c100b0010 2023-10-06T11:09:40.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.343+0000 7f1c0ffff700 1 -- 172.21.15.146:0/2526199929 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c10167b10 con 0x7f1c100b0010 2023-10-06T11:09:40.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.343+0000 7f1c06ffd700 1 -- 172.21.15.146:0/2526199929 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf801c6a0 con 0x7f1c100b0010 2023-10-06T11:09:40.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.343+0000 7f1c0ffff700 1 -- 172.21.15.146:0/2526199929 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c101680b0 con 0x7f1c100b0010 2023-10-06T11:09:40.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.344+0000 7f1c0ffff700 1 -- 172.21.15.146:0/2526199929 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c1006eb80 con 0x7f1c100b0010 2023-10-06T11:09:40.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.344+0000 7f1c06ffd700 1 -- 172.21.15.146:0/2526199929 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1bf801ca50 con 0x7f1c100b0010 2023-10-06T11:09:40.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.345+0000 7f1c06ffd700 1 --2- 172.21.15.146:0/2526199929 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1bf0066f30 0x7f1bf00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:40.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.345+0000 7f1c06ffd700 1 -- 172.21.15.146:0/2526199929 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f1bf8085e60 con 0x7f1c100b0010 2023-10-06T11:09:40.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.345+0000 7f1c0effd700 1 --2- 172.21.15.146:0/2526199929 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1bf0066f30 0x7f1bf00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:40.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.345+0000 7f1c0effd700 1 --2- 172.21.15.146:0/2526199929 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1bf0066f30 0x7f1bf00693e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1c00006f00 tx=0x7f1c00008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:40.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.349+0000 7f1c06ffd700 1 -- 172.21.15.146:0/2526199929 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1bf8053150 con 0x7f1c100b0010 2023-10-06T11:09:40.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:40.534+0000 7f1c0ffff700 1 -- 172.21.15.146:0/2526199929 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1c100c8870 con 0x7f1c100b0010 2023-10-06T11:09:41.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.199+0000 7f1c06ffd700 1 -- 172.21.15.146:0/2526199929 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v57) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1bf8056770 con 0x7f1c100b0010 2023-10-06T11:09:41.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.202+0000 7f1c0ffff700 1 -- 172.21.15.146:0/2526199929 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1bf0066f30 msgr2=0x7f1bf00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:41.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.202+0000 7f1c0ffff700 1 --2- 172.21.15.146:0/2526199929 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1bf0066f30 0x7f1bf00693e0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1c00006f00 tx=0x7f1c00008040 comp rx=0 tx=0).stop 2023-10-06T11:09:41.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.203+0000 7f1c0ffff700 1 -- 172.21.15.146:0/2526199929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c100b0010 msgr2=0x7f1c100c7c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:41.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.203+0000 7f1c0ffff700 1 --2- 172.21.15.146:0/2526199929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c100b0010 0x7f1c100c7c00 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc004760 tx=0x7f1bf801a000 comp rx=0 tx=0).stop 2023-10-06T11:09:41.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.204+0000 7f1c0ffff700 1 -- 172.21.15.146:0/2526199929 shutdown_connections 2023-10-06T11:09:41.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.204+0000 7f1c0ffff700 1 --2- 172.21.15.146:0/2526199929 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1bf0066f30 0x7f1bf00693e0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:41.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.204+0000 7f1c0ffff700 1 --2- 172.21.15.146:0/2526199929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c100cc6a0 0x7f1c100ccb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:41.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.204+0000 7f1c0ffff700 1 --2- 172.21.15.146:0/2526199929 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bfc004010 0x7f1c10158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:41.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.204+0000 7f1c0ffff700 1 --2- 172.21.15.146:0/2526199929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c100b0010 0x7f1c100c7c00 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:41.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.204+0000 7f1c0ffff700 1 -- 172.21.15.146:0/2526199929 >> 172.21.15.146:0/2526199929 conn(0x7f1c100ce230 msgr2=0x7f1c1013fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:41.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.206+0000 7f1c0ffff700 1 -- 172.21.15.146:0/2526199929 shutdown_connections 2023-10-06T11:09:41.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.206+0000 7f1c0ffff700 1 -- 172.21.15.146:0/2526199929 wait complete. 2023-10-06T11:09:41.210 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' created 2023-10-06T11:09:41.227 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T11:09:41.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.344+0000 7f2adc313700 1 Processor -- start 2023-10-06T11:09:41.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.344+0000 7f2adc313700 1 -- start start 2023-10-06T11:09:41.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.345+0000 7f2adc313700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ad40ae730 0x7f2ad40aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:41.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.345+0000 7f2adc313700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ad40ae2a0 con 0x7f2ad415a160 2023-10-06T11:09:41.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.345+0000 7f2adc313700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ad415a530 con 0x7f2ad40cb950 2023-10-06T11:09:41.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.345+0000 7f2adc313700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad40c5cb0 con 0x7f2ad40ae730 2023-10-06T11:09:41.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.345+0000 7f2ada0af700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2ad415a160 0x7f2ad40c55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35666/0 (socket says 172.21.15.146:35666) 2023-10-06T11:09:41.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.345+0000 7f2ada0af700 1 -- 172.21.15.146:0/1980331666 learned_addr learned my addr 172.21.15.146:0/1980331666 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:41.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.345+0000 7f2ad98ae700 1 --2- 172.21.15.146:0/1980331666 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ad40ae730 0x7f2ad40aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:41.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.345+0000 7f2ad90ad700 1 -- 172.21.15.146:0/1980331666 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2091149755 0 0) 0x7f2ad40ae2a0 con 0x7f2ad415a160 2023-10-06T11:09:41.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.345+0000 7f2ad90ad700 1 -- 172.21.15.146:0/1980331666 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ac0003570 con 0x7f2ad415a160 2023-10-06T11:09:41.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.345+0000 7f2ad90ad700 1 -- 172.21.15.146:0/1980331666 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1894834277 0 0) 0x7f2ad415a530 con 0x7f2ad40cb950 2023-10-06T11:09:41.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.345+0000 7f2ad90ad700 1 -- 172.21.15.146:0/1980331666 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ad40ae2a0 con 0x7f2ad40cb950 2023-10-06T11:09:41.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.345+0000 7f2ad90ad700 1 -- 172.21.15.146:0/1980331666 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3077728510 0 0) 0x7f2ac0003570 con 0x7f2ad415a160 2023-10-06T11:09:41.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.345+0000 7f2ad90ad700 1 -- 172.21.15.146:0/1980331666 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ad40ae730 msgr2=0x7f2ad40aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:41.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.345+0000 7f2ad90ad700 1 --2- 172.21.15.146:0/1980331666 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ad40ae730 0x7f2ad40aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:41.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.345+0000 7f2ad90ad700 1 -- 172.21.15.146:0/1980331666 >> v1:172.21.15.151:6789/0 conn(0x7f2ad40cb950 legacy=0x7f2ad40cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:41.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.345+0000 7f2ad90ad700 1 -- 172.21.15.146:0/1980331666 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad40ad690 con 0x7f2ad415a160 2023-10-06T11:09:41.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.345+0000 7f2ad90ad700 1 -- 172.21.15.146:0/1980331666 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f2ad00015f0 con 0x7f2ad415a160 2023-10-06T11:09:41.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.345+0000 7f2ad90ad700 1 -- 172.21.15.146:0/1980331666 >> v1:172.21.15.146:6789/0 conn(0x7f2ad415a160 legacy=0x7f2ad40c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:41.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.345+0000 7f2ad90ad700 1 --2- 172.21.15.146:0/1980331666 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ad40ae730 0x7f2ac0003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:41.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.345+0000 7f2ad90ad700 1 --2- 172.21.15.146:0/1980331666 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ac00041d0 0x7f2ac0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:41.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.345+0000 7f2ad90ad700 1 --2- 172.21.15.146:0/1980331666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ac0004d50 0x7f2ac00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:41.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.345+0000 7f2ad90ad700 1 -- 172.21.15.146:0/1980331666 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad40c5cb0 con 0x7f2ac0004d50 2023-10-06T11:09:41.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.345+0000 7f2ad90ad700 1 -- 172.21.15.146:0/1980331666 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac000bbf0 con 0x7f2ac00041d0 2023-10-06T11:09:41.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.345+0000 7f2ad90ad700 1 -- 172.21.15.146:0/1980331666 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac000bdb0 con 0x7f2ad40ae730 2023-10-06T11:09:41.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.345+0000 7f2ada8b0700 1 --2- 172.21.15.146:0/1980331666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ac0004d50 0x7f2ac00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:41.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.345+0000 7f2ada0af700 1 --2- 172.21.15.146:0/1980331666 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ad40ae730 0x7f2ac0003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:41.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.345+0000 7f2ad98ae700 1 --2- 172.21.15.146:0/1980331666 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ac00041d0 0x7f2ac0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:41.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.346+0000 7f2ada8b0700 1 -- 172.21.15.146:0/1980331666 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ad40ae730 msgr2=0x7f2ac0003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:41.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.346+0000 7f2ada8b0700 1 --2- 172.21.15.146:0/1980331666 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ad40ae730 0x7f2ac0003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:41.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.346+0000 7f2ada8b0700 1 -- 172.21.15.146:0/1980331666 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ac00041d0 msgr2=0x7f2ac0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:41.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.346+0000 7f2ada8b0700 1 --2- 172.21.15.146:0/1980331666 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ac00041d0 0x7f2ac0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:41.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.346+0000 7f2ada8b0700 1 -- 172.21.15.146:0/1980331666 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac0003570 con 0x7f2ac0004d50 2023-10-06T11:09:41.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.346+0000 7f2ada8b0700 1 --2- 172.21.15.146:0/1980331666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ac0004d50 0x7f2ac00051c0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f2acc002120 tx=0x7f2acc0017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4c4b69a4a504cb7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:41.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.346+0000 7f2ad90ad700 1 -- 172.21.15.146:0/1980331666 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc001ab0 con 0x7f2ac0004d50 2023-10-06T11:09:41.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.346+0000 7f2ad90ad700 1 -- 172.21.15.146:0/1980331666 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2acc00c980 con 0x7f2ac0004d50 2023-10-06T11:09:41.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.346+0000 7f2ad90ad700 1 -- 172.21.15.146:0/1980331666 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2acc00cd20 con 0x7f2ac0004d50 2023-10-06T11:09:41.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.346+0000 7f2adc313700 1 -- 172.21.15.146:0/1980331666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ac0004d50 msgr2=0x7f2ac00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:41.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.346+0000 7f2adc313700 1 --2- 172.21.15.146:0/1980331666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ac0004d50 0x7f2ac00051c0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f2acc002120 tx=0x7f2acc0017a0 comp rx=0 tx=0).stop 2023-10-06T11:09:41.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.346+0000 7f2ada8b0700 1 -- 172.21.15.146:0/1980331666 reap_dead start 2023-10-06T11:09:41.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.347+0000 7f2adc313700 1 -- 172.21.15.146:0/1980331666 shutdown_connections 2023-10-06T11:09:41.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.347+0000 7f2adc313700 1 -- 172.21.15.146:0/1980331666 >> 172.21.15.146:0/1980331666 conn(0x7f2ad406f380 msgr2=0x7f2ad40d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:41.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.347+0000 7f2adc313700 1 -- 172.21.15.146:0/1980331666 shutdown_connections 2023-10-06T11:09:41.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.347+0000 7f2adc313700 1 -- 172.21.15.146:0/1980331666 wait complete. 2023-10-06T11:09:41.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.348+0000 7f2adc313700 1 Processor -- start 2023-10-06T11:09:41.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.348+0000 7f2adc313700 1 -- start start 2023-10-06T11:09:41.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.348+0000 7f2adc313700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ac0004d50 0x7f2ad416e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:41.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.348+0000 7f2adc313700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ad415a730 0x7f2ad4157f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:41.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.348+0000 7f2adc313700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ad40c9040 0x7f2ad4156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:41.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.348+0000 7f2adc313700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad40b5b80 con 0x7f2ac0004d50 2023-10-06T11:09:41.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.348+0000 7f2adc313700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad40c98c0 con 0x7f2ad415a730 2023-10-06T11:09:41.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.348+0000 7f2adc313700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad40b3d90 con 0x7f2ad40c9040 2023-10-06T11:09:41.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.348+0000 7f2ada0af700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ac0004d50 0x7f2ad416e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:41.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.348+0000 7f2ada0af700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ac0004d50 0x7f2ad416e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40660/0 (socket says 172.21.15.146:40660) 2023-10-06T11:09:41.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.348+0000 7f2ada0af700 1 -- 172.21.15.146:0/2066915261 learned_addr learned my addr 172.21.15.146:0/2066915261 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:41.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.349+0000 7f2ada8b0700 1 --2- 172.21.15.146:0/2066915261 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ad40c9040 0x7f2ad4156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:41.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.349+0000 7f2ad98ae700 1 --2- 172.21.15.146:0/2066915261 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ad415a730 0x7f2ad4157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:41.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.349+0000 7f2ada0af700 1 -- 172.21.15.146:0/2066915261 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ad40c9040 msgr2=0x7f2ad4156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:41.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.349+0000 7f2ada0af700 1 --2- 172.21.15.146:0/2066915261 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ad40c9040 0x7f2ad4156430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:41.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.349+0000 7f2ada0af700 1 -- 172.21.15.146:0/2066915261 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ad415a730 msgr2=0x7f2ad4157f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:41.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.349+0000 7f2ada0af700 1 --2- 172.21.15.146:0/2066915261 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ad415a730 0x7f2ad4157f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:41.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.349+0000 7f2ada0af700 1 -- 172.21.15.146:0/2066915261 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad40c95e0 con 0x7f2ac0004d50 2023-10-06T11:09:41.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.349+0000 7f2ada0af700 1 --2- 172.21.15.146:0/2066915261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ac0004d50 0x7f2ad416e6d0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f2ad000f8b0 tx=0x7f2ad0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:41.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.349+0000 7f2aca7fc700 1 -- 172.21.15.146:0/2066915261 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad00072e0 con 0x7f2ac0004d50 2023-10-06T11:09:41.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.349+0000 7f2aca7fc700 1 -- 172.21.15.146:0/2066915261 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad0007460 con 0x7f2ac0004d50 2023-10-06T11:09:41.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.349+0000 7f2adc313700 1 -- 172.21.15.146:0/2066915261 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad40b3740 con 0x7f2ac0004d50 2023-10-06T11:09:41.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.349+0000 7f2aca7fc700 1 -- 172.21.15.146:0/2066915261 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad00057f0 con 0x7f2ac0004d50 2023-10-06T11:09:41.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.349+0000 7f2adc313700 1 -- 172.21.15.146:0/2066915261 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad416ec10 con 0x7f2ac0004d50 2023-10-06T11:09:41.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.350+0000 7f2adc313700 1 -- 172.21.15.146:0/2066915261 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad40b35a0 con 0x7f2ac0004d50 2023-10-06T11:09:41.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.351+0000 7f2aca7fc700 1 -- 172.21.15.146:0/2066915261 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2ad0005b60 con 0x7f2ac0004d50 2023-10-06T11:09:41.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.351+0000 7f2aca7fc700 1 --2- 172.21.15.146:0/2066915261 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2ab8066f30 0x7f2ab80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:41.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.351+0000 7f2aca7fc700 1 -- 172.21.15.146:0/2066915261 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f2ad00846d0 con 0x7f2ac0004d50 2023-10-06T11:09:41.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.351+0000 7f2ad98ae700 1 --2- 172.21.15.146:0/2066915261 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2ab8066f30 0x7f2ab80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:41.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.352+0000 7f2ad98ae700 1 --2- 172.21.15.146:0/2066915261 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2ab8066f30 0x7f2ab80693e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2ad415ab60 tx=0x7f2ac40091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:41.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.356+0000 7f2aca7fc700 1 -- 172.21.15.146:0/2066915261 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ad40b35a0 con 0x7f2ac0004d50 2023-10-06T11:09:41.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:41.579+0000 7f2adc313700 1 -- 172.21.15.146:0/2066915261 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f2ad40b35a0 con 0x7f2ac0004d50 2023-10-06T11:09:42.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.336+0000 7f2aca7fc700 1 -- 172.21.15.146:0/2066915261 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 9 and data pool 10 v44) v1 ==== 173+0+0 (secure 0 0 0) 0x7f2ad40b35a0 con 0x7f2ac0004d50 2023-10-06T11:09:42.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.339+0000 7f2adc313700 1 -- 172.21.15.146:0/2066915261 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2ab8066f30 msgr2=0x7f2ab80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:42.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.339+0000 7f2adc313700 1 --2- 172.21.15.146:0/2066915261 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2ab8066f30 0x7f2ab80693e0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2ad415ab60 tx=0x7f2ac40091a0 comp rx=0 tx=0).stop 2023-10-06T11:09:42.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.339+0000 7f2adc313700 1 -- 172.21.15.146:0/2066915261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ac0004d50 msgr2=0x7f2ad416e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:42.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.339+0000 7f2adc313700 1 --2- 172.21.15.146:0/2066915261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ac0004d50 0x7f2ad416e6d0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f2ad000f8b0 tx=0x7f2ad0009040 comp rx=0 tx=0).stop 2023-10-06T11:09:42.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.339+0000 7f2adc313700 1 -- 172.21.15.146:0/2066915261 shutdown_connections 2023-10-06T11:09:42.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.339+0000 7f2adc313700 1 --2- 172.21.15.146:0/2066915261 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2ab8066f30 0x7f2ab80693e0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:42.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.339+0000 7f2adc313700 1 --2- 172.21.15.146:0/2066915261 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ad40c9040 0x7f2ad4156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:42.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.339+0000 7f2adc313700 1 --2- 172.21.15.146:0/2066915261 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ac0004d50 0x7f2ad416e6d0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:42.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.339+0000 7f2adc313700 1 --2- 172.21.15.146:0/2066915261 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ad415a730 0x7f2ad4157f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:42.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.339+0000 7f2adc313700 1 -- 172.21.15.146:0/2066915261 >> 172.21.15.146:0/2066915261 conn(0x7f2ad406f380 msgr2=0x7f2ad4159630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:42.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.340+0000 7f2adc313700 1 -- 172.21.15.146:0/2066915261 shutdown_connections 2023-10-06T11:09:42.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.340+0000 7f2adc313700 1 -- 172.21.15.146:0/2066915261 wait complete. 2023-10-06T11:09:42.343 INFO:teuthology.orchestra.run.smithi146.stderr:new fs with metadata pool 9 and data pool 10 2023-10-06T11:09:42.355 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:09:42.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.469+0000 7f9a81d1a700 1 Processor -- start 2023-10-06T11:09:42.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.469+0000 7f9a81d1a700 1 -- start start 2023-10-06T11:09:42.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.470+0000 7f9a81d1a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a7c153ab0 0x7f9a7c15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:42.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.470+0000 7f9a81d1a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9a7c068ba0 0x7f9a7c0b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:42.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.470+0000 7f9a81d1a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a7c15ac30 con 0x7f9a7c153e80 2023-10-06T11:09:42.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.470+0000 7f9a81d1a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a7c0b4510 con 0x7f9a7c068ba0 2023-10-06T11:09:42.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.470+0000 7f9a81d1a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c0b6530 con 0x7f9a7c153ab0 2023-10-06T11:09:42.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.470+0000 7f9a7bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9a7c068ba0 0x7f9a7c0b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:42.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.470+0000 7f9a7affd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f9a7c153e80 0x7f9a7c068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35674/0 (socket says 172.21.15.146:35674) 2023-10-06T11:09:42.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.470+0000 7f9a7affd700 1 -- 172.21.15.146:0/1798268823 learned_addr learned my addr 172.21.15.146:0/1798268823 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:42.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.470+0000 7f9a7b7fe700 1 --2- 172.21.15.146:0/1798268823 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a7c153ab0 0x7f9a7c15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:42.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.470+0000 7f9a7bfff700 1 -- 172.21.15.146:0/1798268823 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a7c153ab0 msgr2=0x7f9a7c15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:42.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.470+0000 7f9a7bfff700 1 --2- 172.21.15.146:0/1798268823 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a7c153ab0 0x7f9a7c15a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:42.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.470+0000 7f9a7bfff700 1 -- 172.21.15.146:0/1798268823 >> v1:172.21.15.146:6789/0 conn(0x7f9a7c153e80 legacy=0x7f9a7c068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:42.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.470+0000 7f9a7bfff700 1 -- 172.21.15.146:0/1798268823 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a7c0b5c50 con 0x7f9a7c068ba0 2023-10-06T11:09:42.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.470+0000 7f9a7a7fc700 1 -- 172.21.15.146:0/1798268823 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 751048606 0 0) 0x7f9a6c001110 con 0x7f9a7c153e80 2023-10-06T11:09:42.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.470+0000 7f9a7bfff700 1 --2- 172.21.15.146:0/1798268823 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a7c068ba0 0x7f9a7c0b49a0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f9a74009e60 tx=0x7f9a74009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=925f677a2189b8f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:42.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.470+0000 7f9a7a7fc700 1 -- 172.21.15.146:0/1798268823 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7400e070 con 0x7f9a7c068ba0 2023-10-06T11:09:42.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.470+0000 7f9a7a7fc700 1 -- 172.21.15.146:0/1798268823 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a7400bc30 con 0x7f9a7c068ba0 2023-10-06T11:09:42.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.470+0000 7f9a7a7fc700 1 -- 172.21.15.146:0/1798268823 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a74012430 con 0x7f9a7c068ba0 2023-10-06T11:09:42.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.471+0000 7f9a81d1a700 1 -- 172.21.15.146:0/1798268823 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a7c068ba0 msgr2=0x7f9a7c0b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:42.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.471+0000 7f9a81d1a700 1 --2- 172.21.15.146:0/1798268823 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a7c068ba0 0x7f9a7c0b49a0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f9a74009e60 tx=0x7f9a74009780 comp rx=0 tx=0).stop 2023-10-06T11:09:42.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.471+0000 7f9a81d1a700 1 -- 172.21.15.146:0/1798268823 shutdown_connections 2023-10-06T11:09:42.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.471+0000 7f9a81d1a700 1 --2- 172.21.15.146:0/1798268823 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a7c068ba0 0x7f9a7c0b49a0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:42.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.471+0000 7f9a81d1a700 1 --2- 172.21.15.146:0/1798268823 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a7c153ab0 0x7f9a7c15a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:42.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.471+0000 7f9a81d1a700 1 -- 172.21.15.146:0/1798268823 >> 172.21.15.146:0/1798268823 conn(0x7f9a7c06eba0 msgr2=0x7f9a7c06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:42.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.471+0000 7f9a81d1a700 1 -- 172.21.15.146:0/1798268823 shutdown_connections 2023-10-06T11:09:42.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.471+0000 7f9a81d1a700 1 -- 172.21.15.146:0/1798268823 wait complete. 2023-10-06T11:09:42.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.472+0000 7f9a81d1a700 1 Processor -- start 2023-10-06T11:09:42.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.472+0000 7f9a81d1a700 1 -- start start 2023-10-06T11:09:42.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.473+0000 7f9a81d1a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a7c068ba0 0x7f9a7c14b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:42.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.473+0000 7f9a81d1a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a7c153ab0 0x7f9a7c0b2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:42.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.473+0000 7f9a81d1a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a7c153e80 0x7f9a7c14aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:42.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.473+0000 7f9a81d1a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c0b1de0 con 0x7f9a7c068ba0 2023-10-06T11:09:42.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.473+0000 7f9a81d1a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c14b430 con 0x7f9a7c153ab0 2023-10-06T11:09:42.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.473+0000 7f9a81d1a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7c0b1060 con 0x7f9a7c153e80 2023-10-06T11:09:42.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.473+0000 7f9a7b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a7c068ba0 0x7f9a7c14b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:42.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.473+0000 7f9a7b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a7c068ba0 0x7f9a7c14b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40688/0 (socket says 172.21.15.146:40688) 2023-10-06T11:09:42.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.473+0000 7f9a7b7fe700 1 -- 172.21.15.146:0/1804197568 learned_addr learned my addr 172.21.15.146:0/1804197568 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:42.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.473+0000 7f9a7bfff700 1 --2- 172.21.15.146:0/1804197568 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a7c153e80 0x7f9a7c14aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:42.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.473+0000 7f9a7affd700 1 --2- 172.21.15.146:0/1804197568 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a7c153ab0 0x7f9a7c0b2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:42.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.473+0000 7f9a7b7fe700 1 -- 172.21.15.146:0/1804197568 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a7c153e80 msgr2=0x7f9a7c14aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:42.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.473+0000 7f9a7b7fe700 1 --2- 172.21.15.146:0/1804197568 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a7c153e80 0x7f9a7c14aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:42.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.473+0000 7f9a7b7fe700 1 -- 172.21.15.146:0/1804197568 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a7c153ab0 msgr2=0x7f9a7c0b2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:42.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.473+0000 7f9a7b7fe700 1 --2- 172.21.15.146:0/1804197568 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a7c153ab0 0x7f9a7c0b2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:42.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.473+0000 7f9a7b7fe700 1 -- 172.21.15.146:0/1804197568 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a74009a20 con 0x7f9a7c068ba0 2023-10-06T11:09:42.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.473+0000 7f9a7affd700 1 --2- 172.21.15.146:0/1804197568 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a7c153ab0 0x7f9a7c0b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:09:42.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.474+0000 7f9a7b7fe700 1 --2- 172.21.15.146:0/1804197568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a7c068ba0 0x7f9a7c14b790 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f9a7000d890 tx=0x7f9a70008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:42.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.474+0000 7f9a637fe700 1 -- 172.21.15.146:0/1804197568 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7000b600 con 0x7f9a7c068ba0 2023-10-06T11:09:42.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.474+0000 7f9a637fe700 1 -- 172.21.15.146:0/1804197568 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a7000b760 con 0x7f9a7c068ba0 2023-10-06T11:09:42.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.474+0000 7f9a81d1a700 1 -- 172.21.15.146:0/1804197568 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a7c0b0aa0 con 0x7f9a7c068ba0 2023-10-06T11:09:42.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.474+0000 7f9a637fe700 1 -- 172.21.15.146:0/1804197568 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7000bae0 con 0x7f9a7c068ba0 2023-10-06T11:09:42.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.474+0000 7f9a81d1a700 1 -- 172.21.15.146:0/1804197568 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a7c14bd70 con 0x7f9a7c068ba0 2023-10-06T11:09:42.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.475+0000 7f9a81d1a700 1 -- 172.21.15.146:0/1804197568 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a7c04c380 con 0x7f9a7c068ba0 2023-10-06T11:09:42.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.475+0000 7f9a637fe700 1 -- 172.21.15.146:0/1804197568 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9a7001e460 con 0x7f9a7c068ba0 2023-10-06T11:09:42.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.475+0000 7f9a637fe700 1 --2- 172.21.15.146:0/1804197568 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9a68066f30 0x7f9a680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:42.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.476+0000 7f9a637fe700 1 -- 172.21.15.146:0/1804197568 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9a70084d40 con 0x7f9a7c068ba0 2023-10-06T11:09:42.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.476+0000 7f9a7affd700 1 --2- 172.21.15.146:0/1804197568 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9a68066f30 0x7f9a680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:42.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.476+0000 7f9a7affd700 1 --2- 172.21.15.146:0/1804197568 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9a68066f30 0x7f9a680693e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c1542f0 tx=0x7f9a6c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:42.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.480+0000 7f9a637fe700 1 -- 172.21.15.146:0/1804197568 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9a70051e50 con 0x7f9a7c068ba0 2023-10-06T11:09:42.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.666+0000 7f9a81d1a700 1 -- 172.21.15.146:0/1804197568 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a7c0b20c0 con 0x7f9a7c068ba0 2023-10-06T11:09:42.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.667+0000 7f9a637fe700 1 -- 172.21.15.146:0/1804197568 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+16929 (secure 0 0 0) 0x7f9a70055470 con 0x7f9a7c068ba0 2023-10-06T11:09:42.669 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:09:42.669 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":58,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:09:41.580644+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:09:39.260612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-06T11:09:40.552424+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:09:42.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.669+0000 7f9a81d1a700 1 -- 172.21.15.146:0/1804197568 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9a68066f30 msgr2=0x7f9a680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:42.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.669+0000 7f9a81d1a700 1 --2- 172.21.15.146:0/1804197568 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9a68066f30 0x7f9a680693e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c1542f0 tx=0x7f9a6c009040 comp rx=0 tx=0).stop 2023-10-06T11:09:42.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.669+0000 7f9a81d1a700 1 -- 172.21.15.146:0/1804197568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a7c068ba0 msgr2=0x7f9a7c14b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:42.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.669+0000 7f9a81d1a700 1 --2- 172.21.15.146:0/1804197568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a7c068ba0 0x7f9a7c14b790 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f9a7000d890 tx=0x7f9a70008040 comp rx=0 tx=0).stop 2023-10-06T11:09:42.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.669+0000 7f9a81d1a700 1 -- 172.21.15.146:0/1804197568 shutdown_connections 2023-10-06T11:09:42.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.669+0000 7f9a81d1a700 1 --2- 172.21.15.146:0/1804197568 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9a68066f30 0x7f9a680693e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:42.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.669+0000 7f9a81d1a700 1 --2- 172.21.15.146:0/1804197568 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a7c153e80 0x7f9a7c14aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:42.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.669+0000 7f9a81d1a700 1 --2- 172.21.15.146:0/1804197568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a7c068ba0 0x7f9a7c14b790 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:42.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.669+0000 7f9a81d1a700 1 --2- 172.21.15.146:0/1804197568 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a7c153ab0 0x7f9a7c0b2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:42.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.669+0000 7f9a81d1a700 1 -- 172.21.15.146:0/1804197568 >> 172.21.15.146:0/1804197568 conn(0x7f9a7c06eba0 msgr2=0x7f9a7c151f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:42.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.669+0000 7f9a81d1a700 1 -- 172.21.15.146:0/1804197568 shutdown_connections 2023-10-06T11:09:42.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.669+0000 7f9a81d1a700 1 -- 172.21.15.146:0/1804197568 wait complete. 2023-10-06T11:09:42.683 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:09:42.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.796+0000 7fa8ba5c5700 1 Processor -- start 2023-10-06T11:09:42.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.796+0000 7fa8ba5c5700 1 -- start start 2023-10-06T11:09:42.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.797+0000 7fa8ba5c5700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8b415a7f0 0x7fa8b415cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:42.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.797+0000 7fa8ba5c5700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa8b40b2530 0x7fa8b415acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:42.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.797+0000 7fa8ba5c5700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b415c630 con 0x7fa8b415a420 2023-10-06T11:09:42.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.797+0000 7fa8ba5c5700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8b40ce040 con 0x7fa8b40b2530 2023-10-06T11:09:42.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.797+0000 7fa8ba5c5700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b415ba20 con 0x7fa8b415a7f0 2023-10-06T11:09:42.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.797+0000 7fa8b9dc4700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa8b40b2530 0x7fa8b415acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:42.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.797+0000 7fa8b8dc2700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8b415a7f0 0x7fa8b415cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:42.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.797+0000 7fa8b8dc2700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8b415a7f0 0x7fa8b415cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:53108/0 (socket says 172.21.15.146:53108) 2023-10-06T11:09:42.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.797+0000 7fa8b8dc2700 1 -- 172.21.15.146:0/1664446125 learned_addr learned my addr 172.21.15.146:0/1664446125 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:42.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.797+0000 7fa8b9dc4700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa8b40b2530 0x7fa8b415acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:57734/0 (socket says 172.21.15.146:57734) 2023-10-06T11:09:42.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.797+0000 7fa8b95c3700 1 --1- 172.21.15.146:0/1664446125 >> v1:172.21.15.151:6789/0 conn(0x7fa8b415a420 0x7fa8b40b1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:37082/0 (socket says 172.21.15.146:37082) 2023-10-06T11:09:42.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.798+0000 7fa8b8dc2700 1 -- 172.21.15.146:0/1664446125 >> v2:172.21.15.151:3300/0 conn(0x7fa8b40b2530 msgr2=0x7fa8b415acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:42.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.798+0000 7fa8b8dc2700 1 --2- 172.21.15.146:0/1664446125 >> v2:172.21.15.151:3300/0 conn(0x7fa8b40b2530 0x7fa8b415acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:42.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.798+0000 7fa8b8dc2700 1 -- 172.21.15.146:0/1664446125 >> v1:172.21.15.151:6789/0 conn(0x7fa8b415a420 legacy=0x7fa8b40b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:42.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.798+0000 7fa8b8dc2700 1 -- 172.21.15.146:0/1664446125 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b415bd00 con 0x7fa8b415a7f0 2023-10-06T11:09:42.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.798+0000 7fa8b9dc4700 1 --2- 172.21.15.146:0/1664446125 >> v2:172.21.15.151:3300/0 conn(0x7fa8b40b2530 0x7fa8b415acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:09:42.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.798+0000 7fa8b8dc2700 1 --2- 172.21.15.146:0/1664446125 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8b415a7f0 0x7fa8b415cac0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa8a40099b0 tx=0x7fa8a4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37a41b730f7c849d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:42.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.798+0000 7fa8abfff700 1 -- 172.21.15.146:0/1664446125 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a4009ea0 con 0x7fa8b415a7f0 2023-10-06T11:09:42.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.798+0000 7fa8abfff700 1 -- 172.21.15.146:0/1664446125 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a400b860 con 0x7fa8b415a7f0 2023-10-06T11:09:42.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.798+0000 7fa8abfff700 1 -- 172.21.15.146:0/1664446125 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a400bc00 con 0x7fa8b415a7f0 2023-10-06T11:09:42.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.798+0000 7fa8ba5c5700 1 -- 172.21.15.146:0/1664446125 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8b415a7f0 msgr2=0x7fa8b415cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:42.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.798+0000 7fa8ba5c5700 1 --2- 172.21.15.146:0/1664446125 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8b415a7f0 0x7fa8b415cac0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa8a40099b0 tx=0x7fa8a4009250 comp rx=0 tx=0).stop 2023-10-06T11:09:42.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.798+0000 7fa8ba5c5700 1 -- 172.21.15.146:0/1664446125 shutdown_connections 2023-10-06T11:09:42.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.798+0000 7fa8ba5c5700 1 --2- 172.21.15.146:0/1664446125 >> v2:172.21.15.151:3300/0 conn(0x7fa8b40b2530 0x7fa8b415acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:42.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.798+0000 7fa8ba5c5700 1 --2- 172.21.15.146:0/1664446125 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8b415a7f0 0x7fa8b415cac0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:42.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.798+0000 7fa8ba5c5700 1 -- 172.21.15.146:0/1664446125 >> 172.21.15.146:0/1664446125 conn(0x7fa8b406eba0 msgr2=0x7fa8b406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:42.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.799+0000 7fa8ba5c5700 1 -- 172.21.15.146:0/1664446125 shutdown_connections 2023-10-06T11:09:42.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.799+0000 7fa8ba5c5700 1 -- 172.21.15.146:0/1664446125 wait complete. 2023-10-06T11:09:42.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.800+0000 7fa8ba5c5700 1 Processor -- start 2023-10-06T11:09:42.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.800+0000 7fa8ba5c5700 1 -- start start 2023-10-06T11:09:42.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.801+0000 7fa8ba5c5700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8b40b2530 0x7fa8b41595d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:42.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.801+0000 7fa8ba5c5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8b415a420 0x7fa8b414d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:42.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.801+0000 7fa8ba5c5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8b415a7f0 0x7fa8b416d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:42.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.801+0000 7fa8ba5c5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b414d5a0 con 0x7fa8b415a420 2023-10-06T11:09:42.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.801+0000 7fa8ba5c5700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b416e5f0 con 0x7fa8b415a7f0 2023-10-06T11:09:42.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.801+0000 7fa8ba5c5700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b4158cb0 con 0x7fa8b40b2530 2023-10-06T11:09:42.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.801+0000 7fa8b8dc2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8b415a420 0x7fa8b414d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:42.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.801+0000 7fa8b8dc2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8b415a420 0x7fa8b414d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40704/0 (socket says 172.21.15.146:40704) 2023-10-06T11:09:42.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.801+0000 7fa8b8dc2700 1 -- 172.21.15.146:0/2101151771 learned_addr learned my addr 172.21.15.146:0/2101151771 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:42.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.801+0000 7fa8b95c3700 1 --2- 172.21.15.146:0/2101151771 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8b40b2530 0x7fa8b41595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:42.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.801+0000 7fa8b9dc4700 1 --2- 172.21.15.146:0/2101151771 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8b415a7f0 0x7fa8b416d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:42.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.801+0000 7fa8b8dc2700 1 -- 172.21.15.146:0/2101151771 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8b40b2530 msgr2=0x7fa8b41595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:42.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.801+0000 7fa8b8dc2700 1 --2- 172.21.15.146:0/2101151771 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8b40b2530 0x7fa8b41595d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:42.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.801+0000 7fa8b8dc2700 1 -- 172.21.15.146:0/2101151771 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8b415a7f0 msgr2=0x7fa8b416d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:42.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.801+0000 7fa8b8dc2700 1 --2- 172.21.15.146:0/2101151771 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8b415a7f0 0x7fa8b416d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:42.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.801+0000 7fa8b8dc2700 1 -- 172.21.15.146:0/2101151771 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ac009a20 con 0x7fa8b415a420 2023-10-06T11:09:42.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.801+0000 7fa8b8dc2700 1 --2- 172.21.15.146:0/2101151771 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8b415a420 0x7fa8b414d060 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fa8b415bb60 tx=0x7fa8a4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:42.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.801+0000 7fa8a97fa700 1 -- 172.21.15.146:0/2101151771 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a4000d10 con 0x7fa8b415a420 2023-10-06T11:09:42.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.802+0000 7fa8a97fa700 1 -- 172.21.15.146:0/2101151771 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a400bbe0 con 0x7fa8b415a420 2023-10-06T11:09:42.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.802+0000 7fa8ba5c5700 1 -- 172.21.15.146:0/2101151771 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a40094f0 con 0x7fa8b415a420 2023-10-06T11:09:42.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.802+0000 7fa8a97fa700 1 -- 172.21.15.146:0/2101151771 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a4011670 con 0x7fa8b415a420 2023-10-06T11:09:42.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.802+0000 7fa8ba5c5700 1 -- 172.21.15.146:0/2101151771 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b4158380 con 0x7fa8b415a420 2023-10-06T11:09:42.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.802+0000 7fa8ba5c5700 1 -- 172.21.15.146:0/2101151771 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8b4150b20 con 0x7fa8b415a420 2023-10-06T11:09:42.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.803+0000 7fa8a97fa700 1 -- 172.21.15.146:0/2101151771 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa8a4011aa0 con 0x7fa8b415a420 2023-10-06T11:09:42.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.803+0000 7fa8a97fa700 1 --2- 172.21.15.146:0/2101151771 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa898066f30 0x7fa8980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:42.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.803+0000 7fa8a97fa700 1 -- 172.21.15.146:0/2101151771 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa8a4085e80 con 0x7fa8b415a420 2023-10-06T11:09:42.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.803+0000 7fa8b95c3700 1 --2- 172.21.15.146:0/2101151771 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa898066f30 0x7fa8980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:42.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.804+0000 7fa8b95c3700 1 --2- 172.21.15.146:0/2101151771 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa898066f30 0x7fa8980693e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0004fd0 tx=0x7fa8b0007eb0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:42.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.808+0000 7fa8a97fa700 1 -- 172.21.15.146:0/2101151771 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa8b4150b20 con 0x7fa8b415a420 2023-10-06T11:09:42.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.992+0000 7fa8ba5c5700 1 -- 172.21.15.146:0/2101151771 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8b4150b20 con 0x7fa8b415a420 2023-10-06T11:09:42.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.993+0000 7fa8a97fa700 1 -- 172.21.15.146:0/2101151771 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) v1 ==== 74+0+16929 (secure 0 0 0) 0x7fa8b4150b20 con 0x7fa8b415a420 2023-10-06T11:09:42.995 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:09:42.995 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":58,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:09:41.580644+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:09:39.260612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-06T11:09:40.552424+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:09:42.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.995+0000 7fa8ba5c5700 1 -- 172.21.15.146:0/2101151771 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa898066f30 msgr2=0x7fa8980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:42.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.995+0000 7fa8ba5c5700 1 --2- 172.21.15.146:0/2101151771 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa898066f30 0x7fa8980693e0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0004fd0 tx=0x7fa8b0007eb0 comp rx=0 tx=0).stop 2023-10-06T11:09:42.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.995+0000 7fa8ba5c5700 1 -- 172.21.15.146:0/2101151771 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8b415a420 msgr2=0x7fa8b414d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:42.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.995+0000 7fa8ba5c5700 1 --2- 172.21.15.146:0/2101151771 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8b415a420 0x7fa8b414d060 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fa8b415bb60 tx=0x7fa8a4017000 comp rx=0 tx=0).stop 2023-10-06T11:09:42.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.995+0000 7fa8ba5c5700 1 -- 172.21.15.146:0/2101151771 shutdown_connections 2023-10-06T11:09:42.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.995+0000 7fa8ba5c5700 1 --2- 172.21.15.146:0/2101151771 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa898066f30 0x7fa8980693e0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:42.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.995+0000 7fa8ba5c5700 1 --2- 172.21.15.146:0/2101151771 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8b415a7f0 0x7fa8b416d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:42.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.995+0000 7fa8ba5c5700 1 --2- 172.21.15.146:0/2101151771 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8b40b2530 0x7fa8b41595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:42.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.995+0000 7fa8ba5c5700 1 --2- 172.21.15.146:0/2101151771 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8b415a420 0x7fa8b414d060 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:42.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.995+0000 7fa8ba5c5700 1 -- 172.21.15.146:0/2101151771 >> 172.21.15.146:0/2101151771 conn(0x7fa8b406eba0 msgr2=0x7fa8b414dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:42.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.995+0000 7fa8ba5c5700 1 -- 172.21.15.146:0/2101151771 shutdown_connections 2023-10-06T11:09:42.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:42.995+0000 7fa8ba5c5700 1 -- 172.21.15.146:0/2101151771 wait complete. 2023-10-06T11:09:43.009 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T11:09:43.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.126+0000 7f54758f5700 1 Processor -- start 2023-10-06T11:09:43.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.126+0000 7f54758f5700 1 -- start start 2023-10-06T11:09:43.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.127+0000 7f54758f5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f54700cb090 0x7f54700cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:43.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.127+0000 7f54758f5700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5470068780 0x7f5470068b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:43.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.127+0000 7f54758f5700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54700cc130 con 0x7f54700b5640 2023-10-06T11:09:43.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.127+0000 7f54758f5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54700b2660 con 0x7f54700cb090 2023-10-06T11:09:43.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.127+0000 7f54758f5700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54700690d0 con 0x7f5470068780 2023-10-06T11:09:43.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.127+0000 7f5467fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f54700cb090 0x7f54700cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:43.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.127+0000 7f5467fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f54700cb090 0x7f54700cc5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40720/0 (socket says 172.21.15.146:40720) 2023-10-06T11:09:43.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.127+0000 7f5467fff700 1 -- 172.21.15.146:0/2995348555 learned_addr learned my addr 172.21.15.146:0/2995348555 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:43.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.127+0000 7f54750f4700 1 --2- 172.21.15.146:0/2995348555 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5470068780 0x7f5470068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:43.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.127+0000 7f5467fff700 1 -- 172.21.15.146:0/2995348555 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5470068780 msgr2=0x7f5470068b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:43.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.127+0000 7f5467fff700 1 --2- 172.21.15.146:0/2995348555 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5470068780 0x7f5470068b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:43.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.127+0000 7f5467fff700 1 -- 172.21.15.146:0/2995348555 >> v1:172.21.15.151:6789/0 conn(0x7f54700b5640 legacy=0x7f547015a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:43.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.127+0000 7f5467fff700 1 -- 172.21.15.146:0/2995348555 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54700cb520 con 0x7f54700cb090 2023-10-06T11:09:43.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.127+0000 7f54750f4700 1 --2- 172.21.15.146:0/2995348555 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5470068780 0x7f5470068b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:09:43.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.128+0000 7f5467fff700 1 --2- 172.21.15.146:0/2995348555 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54700cb090 0x7f54700cc5c0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f54600099b0 tx=0x7f5460009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b516e98a1223e6d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:43.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.128+0000 7f54677fe700 1 -- 172.21.15.146:0/2995348555 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546000b820 con 0x7f54700cb090 2023-10-06T11:09:43.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.128+0000 7f54677fe700 1 -- 172.21.15.146:0/2995348555 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546000b980 con 0x7f54700cb090 2023-10-06T11:09:43.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.128+0000 7f54677fe700 1 -- 172.21.15.146:0/2995348555 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546000bd20 con 0x7f54700cb090 2023-10-06T11:09:43.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.128+0000 7f54758f5700 1 -- 172.21.15.146:0/2995348555 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54700cb090 msgr2=0x7f54700cc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:43.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.128+0000 7f54758f5700 1 --2- 172.21.15.146:0/2995348555 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54700cb090 0x7f54700cc5c0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f54600099b0 tx=0x7f5460009250 comp rx=0 tx=0).stop 2023-10-06T11:09:43.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.128+0000 7f54758f5700 1 -- 172.21.15.146:0/2995348555 shutdown_connections 2023-10-06T11:09:43.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.128+0000 7f54758f5700 1 --2- 172.21.15.146:0/2995348555 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5470068780 0x7f5470068b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:43.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.128+0000 7f54758f5700 1 --2- 172.21.15.146:0/2995348555 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54700cb090 0x7f54700cc5c0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:43.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.128+0000 7f54758f5700 1 -- 172.21.15.146:0/2995348555 >> 172.21.15.146:0/2995348555 conn(0x7f54700703f0 msgr2=0x7f54700707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:43.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.128+0000 7f54758f5700 1 -- 172.21.15.146:0/2995348555 shutdown_connections 2023-10-06T11:09:43.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.128+0000 7f54758f5700 1 -- 172.21.15.146:0/2995348555 wait complete. 2023-10-06T11:09:43.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.129+0000 7f54758f5700 1 Processor -- start 2023-10-06T11:09:43.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.130+0000 7f54758f5700 1 -- start start 2023-10-06T11:09:43.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.130+0000 7f54758f5700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5470068780 0x7f5470151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:43.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.130+0000 7f54758f5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54700b5640 0x7f54700c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:43.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.130+0000 7f54758f5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54700cb090 0x7f547015a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:43.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.130+0000 7f54758f5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5470151bb0 con 0x7f54700b5640 2023-10-06T11:09:43.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.130+0000 7f54758f5700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54700c4820 con 0x7f54700cb090 2023-10-06T11:09:43.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.130+0000 7f54758f5700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54700c3ef0 con 0x7f5470068780 2023-10-06T11:09:43.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.130+0000 7f5467fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54700b5640 0x7f54700c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:43.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.130+0000 7f5467fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54700b5640 0x7f54700c9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40728/0 (socket says 172.21.15.146:40728) 2023-10-06T11:09:43.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.130+0000 7f5467fff700 1 -- 172.21.15.146:0/1498868330 learned_addr learned my addr 172.21.15.146:0/1498868330 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:43.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.131+0000 7f54748f3700 1 --2- 172.21.15.146:0/1498868330 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5470068780 0x7f5470151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:43.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.131+0000 7f54750f4700 1 --2- 172.21.15.146:0/1498868330 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54700cb090 0x7f547015a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:43.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.131+0000 7f5467fff700 1 -- 172.21.15.146:0/1498868330 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5470068780 msgr2=0x7f5470151670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:43.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.131+0000 7f5467fff700 1 --2- 172.21.15.146:0/1498868330 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5470068780 0x7f5470151670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:43.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.131+0000 7f5467fff700 1 -- 172.21.15.146:0/1498868330 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54700cb090 msgr2=0x7f547015a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:43.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.131+0000 7f5467fff700 1 --2- 172.21.15.146:0/1498868330 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54700cb090 0x7f547015a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:43.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.131+0000 7f5467fff700 1 -- 172.21.15.146:0/1498868330 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54600094f0 con 0x7f54700b5640 2023-10-06T11:09:43.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.131+0000 7f54750f4700 1 --2- 172.21.15.146:0/1498868330 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54700cb090 0x7f547015a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:09:43.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.131+0000 7f5467fff700 1 --2- 172.21.15.146:0/1498868330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54700b5640 0x7f54700c9d10 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f5460009290 tx=0x7f5460016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:43.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.131+0000 7f5464ff9700 1 -- 172.21.15.146:0/1498868330 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5460011d70 con 0x7f54700b5640 2023-10-06T11:09:43.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.131+0000 7f5464ff9700 1 -- 172.21.15.146:0/1498868330 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5460020070 con 0x7f54700b5640 2023-10-06T11:09:43.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.131+0000 7f54758f5700 1 -- 172.21.15.146:0/1498868330 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54700c41d0 con 0x7f54700b5640 2023-10-06T11:09:43.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.131+0000 7f5464ff9700 1 -- 172.21.15.146:0/1498868330 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546001b6a0 con 0x7f54700b5640 2023-10-06T11:09:43.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.131+0000 7f54758f5700 1 -- 172.21.15.146:0/1498868330 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54700ca760 con 0x7f54700b5640 2023-10-06T11:09:43.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.132+0000 7f54758f5700 1 -- 172.21.15.146:0/1498868330 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54700c49b0 con 0x7f54700b5640 2023-10-06T11:09:43.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.132+0000 7f5464ff9700 1 -- 172.21.15.146:0/1498868330 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5460022030 con 0x7f54700b5640 2023-10-06T11:09:43.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.133+0000 7f5464ff9700 1 --2- 172.21.15.146:0/1498868330 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f545c066f30 0x7f545c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:43.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.133+0000 7f5464ff9700 1 -- 172.21.15.146:0/1498868330 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f54600865f0 con 0x7f54700b5640 2023-10-06T11:09:43.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.133+0000 7f54748f3700 1 --2- 172.21.15.146:0/1498868330 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f545c066f30 0x7f545c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:43.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.133+0000 7f54748f3700 1 --2- 172.21.15.146:0/1498868330 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f545c066f30 0x7f545c0693e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f546c003870 tx=0x7f546c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:43.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.137+0000 7f5464ff9700 1 -- 172.21.15.146:0/1498868330 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5460053700 con 0x7f54700b5640 2023-10-06T11:09:43.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:43.366+0000 7f54758f5700 1 -- 172.21.15.146:0/1498868330 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f54700c49b0 con 0x7f54700b5640 2023-10-06T11:09:44.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.346+0000 7f5464ff9700 1 -- 172.21.15.146:0/1498868330 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v47) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5460056d20 con 0x7f54700b5640 2023-10-06T11:09:44.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.349+0000 7f54758f5700 1 -- 172.21.15.146:0/1498868330 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f545c066f30 msgr2=0x7f545c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:44.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.349+0000 7f54758f5700 1 --2- 172.21.15.146:0/1498868330 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f545c066f30 0x7f545c0693e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f546c003870 tx=0x7f546c009040 comp rx=0 tx=0).stop 2023-10-06T11:09:44.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.349+0000 7f54758f5700 1 -- 172.21.15.146:0/1498868330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54700b5640 msgr2=0x7f54700c9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:44.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.349+0000 7f54758f5700 1 --2- 172.21.15.146:0/1498868330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54700b5640 0x7f54700c9d10 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f5460009290 tx=0x7f5460016000 comp rx=0 tx=0).stop 2023-10-06T11:09:44.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.349+0000 7f54758f5700 1 -- 172.21.15.146:0/1498868330 shutdown_connections 2023-10-06T11:09:44.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.349+0000 7f54758f5700 1 --2- 172.21.15.146:0/1498868330 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f545c066f30 0x7f545c0693e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:44.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.349+0000 7f54758f5700 1 --2- 172.21.15.146:0/1498868330 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54700cb090 0x7f547015a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:44.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.349+0000 7f54758f5700 1 --2- 172.21.15.146:0/1498868330 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5470068780 0x7f5470151670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:44.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.349+0000 7f54758f5700 1 --2- 172.21.15.146:0/1498868330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54700b5640 0x7f54700c9d10 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:44.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.349+0000 7f54758f5700 1 -- 172.21.15.146:0/1498868330 >> 172.21.15.146:0/1498868330 conn(0x7f54700703f0 msgr2=0x7f54700b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:44.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.349+0000 7f54758f5700 1 -- 172.21.15.146:0/1498868330 shutdown_connections 2023-10-06T11:09:44.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.349+0000 7f54758f5700 1 -- 172.21.15.146:0/1498868330 wait complete. 2023-10-06T11:09:44.363 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T11:09:44.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.480+0000 7f75b45c6700 1 Processor -- start 2023-10-06T11:09:44.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.480+0000 7f75b45c6700 1 -- start start 2023-10-06T11:09:44.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.481+0000 7f75b45c6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f75ac0b0f70 0x7f75ac0c8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:44.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.481+0000 7f75b45c6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75ac0c9900 con 0x7f75ac0c83c0 2023-10-06T11:09:44.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.481+0000 7f75b45c6700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75ac0ae7a0 con 0x7f75ac0adc70 2023-10-06T11:09:44.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.481+0000 7f75b45c6700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75ac0ae1e0 con 0x7f75ac0b0f70 2023-10-06T11:09:44.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.482+0000 7f75b1b61700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f75ac0b0f70 0x7f75ac0c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:44.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.482+0000 7f75b2362700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f75ac0c83c0 0x7f75ac0b0860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35676/0 (socket says 172.21.15.146:35676) 2023-10-06T11:09:44.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.482+0000 7f75b2362700 1 -- 172.21.15.146:0/2749736812 learned_addr learned my addr 172.21.15.146:0/2749736812 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:44.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.482+0000 7f75b1b61700 1 -- 172.21.15.146:0/2749736812 >> v1:172.21.15.151:6789/0 conn(0x7f75ac0adc70 legacy=0x7f75ac0c9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:44.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.482+0000 7f75b1b61700 1 -- 172.21.15.146:0/2749736812 >> v1:172.21.15.146:6789/0 conn(0x7f75ac0c83c0 legacy=0x7f75ac0b0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:44.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.482+0000 7f75b1360700 1 -- 172.21.15.146:0/2749736812 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1405629985 0 0) 0x7f75ac0c9900 con 0x7f75ac0c83c0 2023-10-06T11:09:44.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.482+0000 7f75b1b61700 1 -- 172.21.15.146:0/2749736812 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ac0ae4c0 con 0x7f75ac0b0f70 2023-10-06T11:09:44.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.482+0000 7f75b1b61700 1 --2- 172.21.15.146:0/2749736812 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75ac0b0f70 0x7f75ac0c8790 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f759c00bbc0 tx=0x7f759c00b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dbbde72bb238665 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:44.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.482+0000 7f75b1360700 1 -- 172.21.15.146:0/2749736812 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759c00db50 con 0x7f75ac0b0f70 2023-10-06T11:09:44.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.482+0000 7f75b1360700 1 -- 172.21.15.146:0/2749736812 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f759c00dcb0 con 0x7f75ac0b0f70 2023-10-06T11:09:44.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.482+0000 7f75b1360700 1 -- 172.21.15.146:0/2749736812 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f759c0106a0 con 0x7f75ac0b0f70 2023-10-06T11:09:44.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.483+0000 7f75b45c6700 1 -- 172.21.15.146:0/2749736812 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75ac0b0f70 msgr2=0x7f75ac0c8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:44.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.483+0000 7f75b45c6700 1 --2- 172.21.15.146:0/2749736812 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75ac0b0f70 0x7f75ac0c8790 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f759c00bbc0 tx=0x7f759c00b430 comp rx=0 tx=0).stop 2023-10-06T11:09:44.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.483+0000 7f75b45c6700 1 -- 172.21.15.146:0/2749736812 shutdown_connections 2023-10-06T11:09:44.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.483+0000 7f75b45c6700 1 --2- 172.21.15.146:0/2749736812 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75ac0b0f70 0x7f75ac0c8790 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:44.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.483+0000 7f75b45c6700 1 -- 172.21.15.146:0/2749736812 >> 172.21.15.146:0/2749736812 conn(0x7f75ac06a070 msgr2=0x7f75ac067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:44.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.483+0000 7f75b45c6700 1 -- 172.21.15.146:0/2749736812 shutdown_connections 2023-10-06T11:09:44.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.483+0000 7f75b45c6700 1 -- 172.21.15.146:0/2749736812 wait complete. 2023-10-06T11:09:44.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.484+0000 7f75b45c6700 1 Processor -- start 2023-10-06T11:09:44.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.484+0000 7f75b45c6700 1 -- start start 2023-10-06T11:09:44.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.485+0000 7f75b45c6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75ac0adc70 0x7f75ac16d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:44.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.485+0000 7f75b45c6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f75ac0b0f70 0x7f75ac169aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:44.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.485+0000 7f75b45c6700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75ac0c83c0 0x7f75ac1547f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:44.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.485+0000 7f75b45c6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac0a8830 con 0x7f75ac0adc70 2023-10-06T11:09:44.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.485+0000 7f75b45c6700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac0a7070 con 0x7f75ac0c83c0 2023-10-06T11:09:44.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.485+0000 7f75b45c6700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75ac16def0 con 0x7f75ac0b0f70 2023-10-06T11:09:44.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.485+0000 7f75b2362700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75ac0adc70 0x7f75ac16d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:44.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.485+0000 7f75b2362700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75ac0adc70 0x7f75ac16d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40744/0 (socket says 172.21.15.146:40744) 2023-10-06T11:09:44.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.485+0000 7f75b2362700 1 -- 172.21.15.146:0/3207409112 learned_addr learned my addr 172.21.15.146:0/3207409112 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:44.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.485+0000 7f75b1b61700 1 --2- 172.21.15.146:0/3207409112 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f75ac0b0f70 0x7f75ac169aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:44.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.485+0000 7f75b2362700 1 -- 172.21.15.146:0/3207409112 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f75ac0b0f70 msgr2=0x7f75ac169aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:44.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.485+0000 7f75b2362700 1 --2- 172.21.15.146:0/3207409112 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f75ac0b0f70 0x7f75ac169aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:44.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.485+0000 7f75b2362700 1 -- 172.21.15.146:0/3207409112 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75ac0c83c0 msgr2=0x7f75ac1547f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:44.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.485+0000 7f75b2b63700 1 --2- 172.21.15.146:0/3207409112 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75ac0c83c0 0x7f75ac1547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:44.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.485+0000 7f75b2362700 1 --2- 172.21.15.146:0/3207409112 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75ac0c83c0 0x7f75ac1547f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:44.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.485+0000 7f75b2362700 1 -- 172.21.15.146:0/3207409112 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f759c00b6d0 con 0x7f75ac0adc70 2023-10-06T11:09:44.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.485+0000 7f75b2b63700 1 --2- 172.21.15.146:0/3207409112 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75ac0c83c0 0x7f75ac1547f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:09:44.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.485+0000 7f75b2362700 1 --2- 172.21.15.146:0/3207409112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75ac0adc70 0x7f75ac16d9b0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f75a800cd80 tx=0x7f75a8001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:44.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.485+0000 7f75a27fc700 1 -- 172.21.15.146:0/3207409112 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a800ab10 con 0x7f75ac0adc70 2023-10-06T11:09:44.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.485+0000 7f75a27fc700 1 -- 172.21.15.146:0/3207409112 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a800ac70 con 0x7f75ac0adc70 2023-10-06T11:09:44.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.485+0000 7f75b45c6700 1 -- 172.21.15.146:0/3207409112 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75ac0a59e0 con 0x7f75ac0adc70 2023-10-06T11:09:44.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.485+0000 7f75a27fc700 1 -- 172.21.15.146:0/3207409112 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a80070f0 con 0x7f75ac0adc70 2023-10-06T11:09:44.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.485+0000 7f75b45c6700 1 -- 172.21.15.146:0/3207409112 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75ac0a5fa0 con 0x7f75ac0adc70 2023-10-06T11:09:44.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.486+0000 7f75b45c6700 1 -- 172.21.15.146:0/3207409112 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75ac04c380 con 0x7f75ac0adc70 2023-10-06T11:09:44.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.487+0000 7f75a27fc700 1 -- 172.21.15.146:0/3207409112 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f75a80074e0 con 0x7f75ac0adc70 2023-10-06T11:09:44.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.487+0000 7f75a27fc700 1 --2- 172.21.15.146:0/3207409112 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7590066f30 0x7f75900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:44.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.487+0000 7f75a27fc700 1 -- 172.21.15.146:0/3207409112 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f75a8084bb0 con 0x7f75ac0adc70 2023-10-06T11:09:44.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.487+0000 7f75b1b61700 1 --2- 172.21.15.146:0/3207409112 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7590066f30 0x7f75900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:44.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.488+0000 7f75b1b61700 1 --2- 172.21.15.146:0/3207409112 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7590066f30 0x7f75900693e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f75ac0b1370 tx=0x7f759c01a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:44.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.491+0000 7f75a27fc700 1 -- 172.21.15.146:0/3207409112 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f75a8051d40 con 0x7f75ac0adc70 2023-10-06T11:09:44.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:44.718+0000 7f75b45c6700 1 -- 172.21.15.146:0/3207409112 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f75ac0c9590 con 0x7f75ac0adc70 2023-10-06T11:09:45.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.352+0000 7f75a27fc700 1 -- 172.21.15.146:0/3207409112 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v48) v1 ==== 122+0+0 (secure 0 0 0) 0x7f75a8001c20 con 0x7f75ac0adc70 2023-10-06T11:09:45.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.354+0000 7f75b45c6700 1 -- 172.21.15.146:0/3207409112 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7590066f30 msgr2=0x7f75900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:45.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.354+0000 7f75b45c6700 1 --2- 172.21.15.146:0/3207409112 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7590066f30 0x7f75900693e0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f75ac0b1370 tx=0x7f759c01a000 comp rx=0 tx=0).stop 2023-10-06T11:09:45.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.354+0000 7f75b45c6700 1 -- 172.21.15.146:0/3207409112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75ac0adc70 msgr2=0x7f75ac16d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:45.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.354+0000 7f75b45c6700 1 --2- 172.21.15.146:0/3207409112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75ac0adc70 0x7f75ac16d9b0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f75a800cd80 tx=0x7f75a8001ae0 comp rx=0 tx=0).stop 2023-10-06T11:09:45.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.354+0000 7f75b45c6700 1 -- 172.21.15.146:0/3207409112 shutdown_connections 2023-10-06T11:09:45.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.354+0000 7f75b45c6700 1 --2- 172.21.15.146:0/3207409112 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7590066f30 0x7f75900693e0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:45.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.354+0000 7f75b45c6700 1 --2- 172.21.15.146:0/3207409112 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75ac0c83c0 0x7f75ac1547f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:45.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.354+0000 7f75b45c6700 1 --2- 172.21.15.146:0/3207409112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f75ac0adc70 0x7f75ac16d9b0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:45.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.354+0000 7f75b45c6700 1 --2- 172.21.15.146:0/3207409112 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f75ac0b0f70 0x7f75ac169aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:45.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.354+0000 7f75b45c6700 1 -- 172.21.15.146:0/3207409112 >> 172.21.15.146:0/3207409112 conn(0x7f75ac06a070 msgr2=0x7f75ac0cb690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:45.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.355+0000 7f75b45c6700 1 -- 172.21.15.146:0/3207409112 shutdown_connections 2023-10-06T11:09:45.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.355+0000 7f75b45c6700 1 -- 172.21.15.146:0/3207409112 wait complete. 2023-10-06T11:09:45.368 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:09:45.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.482+0000 7fb5bbbd4700 1 Processor -- start 2023-10-06T11:09:45.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.482+0000 7fb5bbbd4700 1 -- start start 2023-10-06T11:09:45.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.483+0000 7fb5bbbd4700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5b4068ba0 0x7fb5b415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:45.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.483+0000 7fb5bbbd4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb5b4153e80 0x7fb5b40b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:45.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.483+0000 7fb5bbbd4700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5b415ac30 con 0x7fb5b4153ab0 2023-10-06T11:09:45.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.483+0000 7fb5bbbd4700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5b40b4510 con 0x7fb5b4153e80 2023-10-06T11:09:45.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.483+0000 7fb5bbbd4700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b40b6530 con 0x7fb5b4068ba0 2023-10-06T11:09:45.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.483+0000 7fb5ba171700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb5b4153e80 0x7fb5b40b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:45.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.484+0000 7fb5ba171700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb5b4153e80 0x7fb5b40b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40750/0 (socket says 172.21.15.146:40750) 2023-10-06T11:09:45.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.484+0000 7fb5ba171700 1 -- 172.21.15.146:0/2763418528 learned_addr learned my addr 172.21.15.146:0/2763418528 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:45.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.484+0000 7fb5b9970700 1 --1- 172.21.15.146:0/2763418528 >> v1:172.21.15.146:6789/0 conn(0x7fb5b4153ab0 0x7fb5b4068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35682/0 (socket says 172.21.15.146:35682) 2023-10-06T11:09:45.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.484+0000 7fb5b916f700 1 --2- 172.21.15.146:0/2763418528 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5b4068ba0 0x7fb5b415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:45.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.484+0000 7fb5ba171700 1 -- 172.21.15.146:0/2763418528 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5b4068ba0 msgr2=0x7fb5b415a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:45.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.484+0000 7fb5ba171700 1 --2- 172.21.15.146:0/2763418528 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5b4068ba0 0x7fb5b415a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:45.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.484+0000 7fb5ba171700 1 -- 172.21.15.146:0/2763418528 >> v1:172.21.15.146:6789/0 conn(0x7fb5b4153ab0 legacy=0x7fb5b4068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:45.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.484+0000 7fb5ba171700 1 -- 172.21.15.146:0/2763418528 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b40b5c50 con 0x7fb5b4153e80 2023-10-06T11:09:45.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.484+0000 7fb5ba171700 1 --2- 172.21.15.146:0/2763418528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5b4153e80 0x7fb5b40b49a0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac009f20 tx=0x7fb5ac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a79a556aec552b0a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:45.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.484+0000 7fb5b896e700 1 -- 172.21.15.146:0/2763418528 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac00e070 con 0x7fb5b4153e80 2023-10-06T11:09:45.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.484+0000 7fb5b896e700 1 -- 172.21.15.146:0/2763418528 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5ac00ba80 con 0x7fb5b4153e80 2023-10-06T11:09:45.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.484+0000 7fb5b896e700 1 -- 172.21.15.146:0/2763418528 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ac0092e0 con 0x7fb5b4153e80 2023-10-06T11:09:45.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.485+0000 7fb5bbbd4700 1 -- 172.21.15.146:0/2763418528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5b4153e80 msgr2=0x7fb5b40b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:45.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.485+0000 7fb5bbbd4700 1 --2- 172.21.15.146:0/2763418528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5b4153e80 0x7fb5b40b49a0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac009f20 tx=0x7fb5ac009840 comp rx=0 tx=0).stop 2023-10-06T11:09:45.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.485+0000 7fb5bbbd4700 1 -- 172.21.15.146:0/2763418528 shutdown_connections 2023-10-06T11:09:45.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.485+0000 7fb5bbbd4700 1 --2- 172.21.15.146:0/2763418528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5b4153e80 0x7fb5b40b49a0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:45.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.485+0000 7fb5bbbd4700 1 --2- 172.21.15.146:0/2763418528 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5b4068ba0 0x7fb5b415a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:45.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.485+0000 7fb5bbbd4700 1 -- 172.21.15.146:0/2763418528 >> 172.21.15.146:0/2763418528 conn(0x7fb5b406eba0 msgr2=0x7fb5b406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:45.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.485+0000 7fb5bbbd4700 1 -- 172.21.15.146:0/2763418528 shutdown_connections 2023-10-06T11:09:45.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.485+0000 7fb5bbbd4700 1 -- 172.21.15.146:0/2763418528 wait complete. 2023-10-06T11:09:45.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.486+0000 7fb5bbbd4700 1 Processor -- start 2023-10-06T11:09:45.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.486+0000 7fb5bbbd4700 1 -- start start 2023-10-06T11:09:45.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.486+0000 7fb5bbbd4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5b4068ba0 0x7fb5b4151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:45.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.486+0000 7fb5bbbd4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5b4153ab0 0x7fb5b415bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:45.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.486+0000 7fb5bbbd4700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5b4153e80 0x7fb5b413fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:45.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.486+0000 7fb5bbbd4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b4151a50 con 0x7fb5b4153ab0 2023-10-06T11:09:45.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.486+0000 7fb5bbbd4700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b4150e40 con 0x7fb5b4068ba0 2023-10-06T11:09:45.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.486+0000 7fb5bbbd4700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5b4151120 con 0x7fb5b4153e80 2023-10-06T11:09:45.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.487+0000 7fb5b916f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5b4153ab0 0x7fb5b415bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:45.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.487+0000 7fb5b916f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5b4153ab0 0x7fb5b415bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40762/0 (socket says 172.21.15.146:40762) 2023-10-06T11:09:45.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.487+0000 7fb5b916f700 1 -- 172.21.15.146:0/2404063492 learned_addr learned my addr 172.21.15.146:0/2404063492 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:45.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.487+0000 7fb5b9970700 1 --2- 172.21.15.146:0/2404063492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5b4068ba0 0x7fb5b4151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:45.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.487+0000 7fb5ba171700 1 --2- 172.21.15.146:0/2404063492 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5b4153e80 0x7fb5b413fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:45.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.487+0000 7fb5b916f700 1 -- 172.21.15.146:0/2404063492 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5b4153e80 msgr2=0x7fb5b413fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:45.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.487+0000 7fb5b916f700 1 --2- 172.21.15.146:0/2404063492 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5b4153e80 0x7fb5b413fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:45.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.487+0000 7fb5b916f700 1 -- 172.21.15.146:0/2404063492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5b4068ba0 msgr2=0x7fb5b4151ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:45.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.487+0000 7fb5b916f700 1 --2- 172.21.15.146:0/2404063492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5b4068ba0 0x7fb5b4151ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:45.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.487+0000 7fb5b916f700 1 -- 172.21.15.146:0/2404063492 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ac009ae0 con 0x7fb5b4153ab0 2023-10-06T11:09:45.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.487+0000 7fb5ba171700 1 --2- 172.21.15.146:0/2404063492 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5b4153e80 0x7fb5b413fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:45.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.487+0000 7fb5b9970700 1 --2- 172.21.15.146:0/2404063492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5b4068ba0 0x7fb5b4151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:45.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.487+0000 7fb5b916f700 1 --2- 172.21.15.146:0/2404063492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5b4153ab0 0x7fb5b415bff0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fb5a400d860 tx=0x7fb5a4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:45.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.487+0000 7fb5a9ffb700 1 -- 172.21.15.146:0/2404063492 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a40096a0 con 0x7fb5b4153ab0 2023-10-06T11:09:45.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.487+0000 7fb5a9ffb700 1 -- 172.21.15.146:0/2404063492 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5a4009800 con 0x7fb5b4153ab0 2023-10-06T11:09:45.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.487+0000 7fb5bbbd4700 1 -- 172.21.15.146:0/2404063492 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5b4151400 con 0x7fb5b4153ab0 2023-10-06T11:09:45.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.487+0000 7fb5a9ffb700 1 -- 172.21.15.146:0/2404063492 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5a4009bc0 con 0x7fb5b4153ab0 2023-10-06T11:09:45.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.487+0000 7fb5bbbd4700 1 -- 172.21.15.146:0/2404063492 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5b415c530 con 0x7fb5b4153ab0 2023-10-06T11:09:45.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.488+0000 7fb5bbbd4700 1 -- 172.21.15.146:0/2404063492 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5b41518a0 con 0x7fb5b4153ab0 2023-10-06T11:09:45.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.488+0000 7fb5a9ffb700 1 -- 172.21.15.146:0/2404063492 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb5a401e460 con 0x7fb5b4153ab0 2023-10-06T11:09:45.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.489+0000 7fb5a9ffb700 1 --2- 172.21.15.146:0/2404063492 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb598066f30 0x7fb5980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:45.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.489+0000 7fb5a9ffb700 1 -- 172.21.15.146:0/2404063492 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb5a4084d90 con 0x7fb5b4153ab0 2023-10-06T11:09:45.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.489+0000 7fb5b9970700 1 --2- 172.21.15.146:0/2404063492 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb598066f30 0x7fb5980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:45.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.489+0000 7fb5b9970700 1 --2- 172.21.15.146:0/2404063492 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb598066f30 0x7fb5980693e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0007fd0 tx=0x7fb5b0007e10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:45.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.493+0000 7fb5a9ffb700 1 -- 172.21.15.146:0/2404063492 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb5a4051ea0 con 0x7fb5b4153ab0 2023-10-06T11:09:45.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.720+0000 7fb5bbbd4700 1 -- 172.21.15.146:0/2404063492 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb5b4151c10 con 0x7fb5b4153ab0 2023-10-06T11:09:45.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.720+0000 7fb5a9ffb700 1 -- 172.21.15.146:0/2404063492 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4607 (secure 0 0 0) 0x7fb5a40554c0 con 0x7fb5b4153ab0 2023-10-06T11:09:45.722 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:09:45.722 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":48,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5450,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/1721234096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1721234096},{"type":"v1","addr":"172.21.15.151:6834","nonce":1721234096}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6297,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/236648406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":236648406},{"type":"v1","addr":"172.21.15.146:6836","nonce":236648406}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6300,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/2529977172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2529977172},{"type":"v1","addr":"172.21.15.146:6837","nonce":2529977172}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:09:41.580951+0000","modified":"2023-10-06T11:09:45.346284+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6306":{"gid":6306,"name":"b","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6835/2990544048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":2990544048},{"type":"v1","addr":"172.21.15.151:6835","nonce":2990544048}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T11:09:45.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.722+0000 7fb5bbbd4700 1 -- 172.21.15.146:0/2404063492 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb598066f30 msgr2=0x7fb5980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:45.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.722+0000 7fb5bbbd4700 1 --2- 172.21.15.146:0/2404063492 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb598066f30 0x7fb5980693e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0007fd0 tx=0x7fb5b0007e10 comp rx=0 tx=0).stop 2023-10-06T11:09:45.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.722+0000 7fb5bbbd4700 1 -- 172.21.15.146:0/2404063492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5b4153ab0 msgr2=0x7fb5b415bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:45.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.722+0000 7fb5bbbd4700 1 --2- 172.21.15.146:0/2404063492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5b4153ab0 0x7fb5b415bff0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fb5a400d860 tx=0x7fb5a4008040 comp rx=0 tx=0).stop 2023-10-06T11:09:45.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.722+0000 7fb5bbbd4700 1 -- 172.21.15.146:0/2404063492 shutdown_connections 2023-10-06T11:09:45.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.722+0000 7fb5bbbd4700 1 --2- 172.21.15.146:0/2404063492 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb598066f30 0x7fb5980693e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:45.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.722+0000 7fb5bbbd4700 1 --2- 172.21.15.146:0/2404063492 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5b4153e80 0x7fb5b413fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:45.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.722+0000 7fb5bbbd4700 1 --2- 172.21.15.146:0/2404063492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5b4068ba0 0x7fb5b4151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:45.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.722+0000 7fb5bbbd4700 1 --2- 172.21.15.146:0/2404063492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5b4153ab0 0x7fb5b415bff0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:45.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.722+0000 7fb5bbbd4700 1 -- 172.21.15.146:0/2404063492 >> 172.21.15.146:0/2404063492 conn(0x7fb5b406eba0 msgr2=0x7fb5b40cf360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:45.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.722+0000 7fb5bbbd4700 1 -- 172.21.15.146:0/2404063492 shutdown_connections 2023-10-06T11:09:45.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.722+0000 7fb5bbbd4700 1 -- 172.21.15.146:0/2404063492 wait complete. 2023-10-06T11:09:45.726 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 48 2023-10-06T11:09:45.736 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:09:45.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.849+0000 7fd34dbb0700 1 Processor -- start 2023-10-06T11:09:45.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.849+0000 7fd34dbb0700 1 -- start start 2023-10-06T11:09:45.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.850+0000 7fd34dbb0700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd3480c3960 0x7fd3480cc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:45.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.850+0000 7fd34dbb0700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd348068a90 con 0x7fd3480c4750 2023-10-06T11:09:45.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.850+0000 7fd34dbb0700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd348159fd0 con 0x7fd3480b08d0 2023-10-06T11:09:45.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.850+0000 7fd34dbb0700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3480cdcf0 con 0x7fd3480c3960 2023-10-06T11:09:45.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.850+0000 7fd347fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd3480c4750 0x7fd3480cced0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35686/0 (socket says 172.21.15.146:35686) 2023-10-06T11:09:45.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.851+0000 7fd347fff700 1 -- 172.21.15.146:0/896031987 learned_addr learned my addr 172.21.15.146:0/896031987 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:45.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.851+0000 7fd3467fc700 1 -- 172.21.15.146:0/896031987 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2699818703 0 0) 0x7fd348068a90 con 0x7fd3480c4750 2023-10-06T11:09:45.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.851+0000 7fd346ffd700 1 --2- 172.21.15.146:0/896031987 >> v2:172.21.15.151:3300/0 conn(0x7fd3480c3960 0x7fd3480cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:45.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.851+0000 7fd3467fc700 1 -- 172.21.15.146:0/896031987 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd330003570 con 0x7fd3480c4750 2023-10-06T11:09:45.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.851+0000 7fd3467fc700 1 -- 172.21.15.146:0/896031987 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1242935117 0 0) 0x7fd330003570 con 0x7fd3480c4750 2023-10-06T11:09:45.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.851+0000 7fd3467fc700 1 -- 172.21.15.146:0/896031987 >> v2:172.21.15.151:3300/0 conn(0x7fd3480c3960 msgr2=0x7fd3480cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:45.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.851+0000 7fd3467fc700 1 --2- 172.21.15.146:0/896031987 >> v2:172.21.15.151:3300/0 conn(0x7fd3480c3960 0x7fd3480cc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:45.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.851+0000 7fd3467fc700 1 -- 172.21.15.146:0/896031987 >> v1:172.21.15.151:6789/0 conn(0x7fd3480b08d0 legacy=0x7fd3480c3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:45.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.851+0000 7fd3467fc700 1 -- 172.21.15.146:0/896031987 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3480cdfd0 con 0x7fd3480c4750 2023-10-06T11:09:45.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.851+0000 7fd3467fc700 1 -- 172.21.15.146:0/896031987 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fd340001470 con 0x7fd3480c4750 2023-10-06T11:09:45.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.851+0000 7fd3467fc700 1 -- 172.21.15.146:0/896031987 >> v1:172.21.15.146:6789/0 conn(0x7fd3480c4750 legacy=0x7fd3480cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:45.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.851+0000 7fd3467fc700 1 --2- 172.21.15.146:0/896031987 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd330003a60 0x7fd330003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:45.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.851+0000 7fd3467fc700 1 --2- 172.21.15.146:0/896031987 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd330004810 0x7fd330004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:45.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.851+0000 7fd3467fc700 1 --2- 172.21.15.146:0/896031987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3300051c0 0x7fd33000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:45.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.851+0000 7fd3467fc700 1 -- 172.21.15.146:0/896031987 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3480cdcf0 con 0x7fd3300051c0 2023-10-06T11:09:45.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.851+0000 7fd3467fc700 1 -- 172.21.15.146:0/896031987 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33000c160 con 0x7fd330004810 2023-10-06T11:09:45.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.851+0000 7fd3467fc700 1 -- 172.21.15.146:0/896031987 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33000c320 con 0x7fd330003a60 2023-10-06T11:09:45.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.851+0000 7fd347fff700 1 --2- 172.21.15.146:0/896031987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3300051c0 0x7fd33000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:45.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.851+0000 7fd3477fe700 1 --2- 172.21.15.146:0/896031987 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd330003a60 0x7fd330003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:45.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.851+0000 7fd346ffd700 1 --2- 172.21.15.146:0/896031987 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd330004810 0x7fd330004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:45.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.851+0000 7fd347fff700 1 -- 172.21.15.146:0/896031987 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd330003a60 msgr2=0x7fd330003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:45.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.851+0000 7fd347fff700 1 --2- 172.21.15.146:0/896031987 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd330003a60 0x7fd330003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:45.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.851+0000 7fd347fff700 1 -- 172.21.15.146:0/896031987 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd330004810 msgr2=0x7fd330004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:45.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.851+0000 7fd347fff700 1 --2- 172.21.15.146:0/896031987 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd330004810 0x7fd330004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:45.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.851+0000 7fd347fff700 1 -- 172.21.15.146:0/896031987 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd330003570 con 0x7fd3300051c0 2023-10-06T11:09:45.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.852+0000 7fd347fff700 1 -- 172.21.15.146:0/896031987 reap_dead start 2023-10-06T11:09:45.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.852+0000 7fd347fff700 1 --2- 172.21.15.146:0/896031987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3300051c0 0x7fd33000ba60 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fd34000c3c0 tx=0x7fd340001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e1eebd2479da55e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:45.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.852+0000 7fd3467fc700 1 -- 172.21.15.146:0/896031987 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34000cc90 con 0x7fd3300051c0 2023-10-06T11:09:45.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.852+0000 7fd3467fc700 1 -- 172.21.15.146:0/896031987 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34000cdf0 con 0x7fd3300051c0 2023-10-06T11:09:45.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.852+0000 7fd3467fc700 1 -- 172.21.15.146:0/896031987 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd340005b50 con 0x7fd3300051c0 2023-10-06T11:09:45.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.852+0000 7fd34dbb0700 1 -- 172.21.15.146:0/896031987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3300051c0 msgr2=0x7fd33000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:45.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.852+0000 7fd34dbb0700 1 --2- 172.21.15.146:0/896031987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3300051c0 0x7fd33000ba60 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fd34000c3c0 tx=0x7fd340001e50 comp rx=0 tx=0).stop 2023-10-06T11:09:45.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.852+0000 7fd34dbb0700 1 -- 172.21.15.146:0/896031987 shutdown_connections 2023-10-06T11:09:45.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.852+0000 7fd34dbb0700 1 --2- 172.21.15.146:0/896031987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3300051c0 0x7fd33000ba60 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:45.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.852+0000 7fd34dbb0700 1 -- 172.21.15.146:0/896031987 >> 172.21.15.146:0/896031987 conn(0x7fd348067c50 msgr2=0x7fd3480ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:45.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.852+0000 7fd34dbb0700 1 -- 172.21.15.146:0/896031987 shutdown_connections 2023-10-06T11:09:45.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.852+0000 7fd34dbb0700 1 -- 172.21.15.146:0/896031987 wait complete. 2023-10-06T11:09:45.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.854+0000 7fd34dbb0700 1 Processor -- start 2023-10-06T11:09:45.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.854+0000 7fd34dbb0700 1 -- start start 2023-10-06T11:09:45.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.854+0000 7fd34dbb0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3300051c0 0x7fd34815d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:45.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.854+0000 7fd34dbb0700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd348160220 0x7fd34806c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:45.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.854+0000 7fd34dbb0700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd348160690 0x7fd34806cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:45.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.854+0000 7fd34dbb0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3480c72f0 con 0x7fd3300051c0 2023-10-06T11:09:45.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.854+0000 7fd34dbb0700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3480c6420 con 0x7fd348160220 2023-10-06T11:09:45.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.854+0000 7fd34dbb0700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3480c6ca0 con 0x7fd348160690 2023-10-06T11:09:45.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.854+0000 7fd3477fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3300051c0 0x7fd34815d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:45.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.855+0000 7fd3477fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3300051c0 0x7fd34815d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40780/0 (socket says 172.21.15.146:40780) 2023-10-06T11:09:45.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.855+0000 7fd3477fe700 1 -- 172.21.15.146:0/3555623711 learned_addr learned my addr 172.21.15.146:0/3555623711 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:45.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.855+0000 7fd346ffd700 1 --2- 172.21.15.146:0/3555623711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd348160220 0x7fd34806c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:45.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.855+0000 7fd347fff700 1 --2- 172.21.15.146:0/3555623711 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd348160690 0x7fd34806cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:45.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.855+0000 7fd3477fe700 1 -- 172.21.15.146:0/3555623711 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd348160690 msgr2=0x7fd34806cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:45.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.855+0000 7fd3477fe700 1 --2- 172.21.15.146:0/3555623711 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd348160690 0x7fd34806cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:45.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.855+0000 7fd3477fe700 1 -- 172.21.15.146:0/3555623711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd348160220 msgr2=0x7fd34806c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:45.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.855+0000 7fd3477fe700 1 --2- 172.21.15.146:0/3555623711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd348160220 0x7fd34806c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:45.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.855+0000 7fd3477fe700 1 -- 172.21.15.146:0/3555623711 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3480c6f80 con 0x7fd3300051c0 2023-10-06T11:09:45.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.855+0000 7fd347fff700 1 --2- 172.21.15.146:0/3555623711 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd348160690 0x7fd34806cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:45.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.855+0000 7fd3477fe700 1 --2- 172.21.15.146:0/3555623711 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3300051c0 0x7fd34815d660 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fd33800ebc0 tx=0x7fd338001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:45.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.855+0000 7fd32f7fe700 1 -- 172.21.15.146:0/3555623711 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd338006ba0 con 0x7fd3300051c0 2023-10-06T11:09:45.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.855+0000 7fd32f7fe700 1 -- 172.21.15.146:0/3555623711 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd338006d00 con 0x7fd3300051c0 2023-10-06T11:09:45.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.855+0000 7fd34dbb0700 1 -- 172.21.15.146:0/3555623711 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3480c6700 con 0x7fd3300051c0 2023-10-06T11:09:45.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.855+0000 7fd32f7fe700 1 -- 172.21.15.146:0/3555623711 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33800ca00 con 0x7fd3300051c0 2023-10-06T11:09:45.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.855+0000 7fd34dbb0700 1 -- 172.21.15.146:0/3555623711 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3480c58f0 con 0x7fd3300051c0 2023-10-06T11:09:45.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.856+0000 7fd34dbb0700 1 -- 172.21.15.146:0/3555623711 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd34804c380 con 0x7fd3300051c0 2023-10-06T11:09:45.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.856+0000 7fd32f7fe700 1 -- 172.21.15.146:0/3555623711 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd338015430 con 0x7fd3300051c0 2023-10-06T11:09:45.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.857+0000 7fd32f7fe700 1 --2- 172.21.15.146:0/3555623711 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd334066f30 0x7fd3340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:45.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.857+0000 7fd32f7fe700 1 -- 172.21.15.146:0/3555623711 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd338084b40 con 0x7fd3300051c0 2023-10-06T11:09:45.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.857+0000 7fd346ffd700 1 --2- 172.21.15.146:0/3555623711 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd334066f30 0x7fd3340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:45.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.857+0000 7fd346ffd700 1 --2- 172.21.15.146:0/3555623711 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd334066f30 0x7fd3340693e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd3481585e0 tx=0x7fd33c0091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:45.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:45.861+0000 7fd32f7fe700 1 -- 172.21.15.146:0/3555623711 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd338051c50 con 0x7fd3300051c0 2023-10-06T11:09:46.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.045+0000 7fd34dbb0700 1 -- 172.21.15.146:0/3555623711 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd348068720 con 0x7fd3300051c0 2023-10-06T11:09:46.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.046+0000 7fd32f7fe700 1 -- 172.21.15.146:0/3555623711 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+16916 (secure 0 0 0) 0x7fd338055270 con 0x7fd3300051c0 2023-10-06T11:09:46.047 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:09:46.048 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":59,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:09:43.213507+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:09:39.260612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-06T11:09:40.552424+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:09:46.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.048+0000 7fd34dbb0700 1 -- 172.21.15.146:0/3555623711 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd334066f30 msgr2=0x7fd3340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:46.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.048+0000 7fd34dbb0700 1 --2- 172.21.15.146:0/3555623711 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd334066f30 0x7fd3340693e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd3481585e0 tx=0x7fd33c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:09:46.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.048+0000 7fd34dbb0700 1 -- 172.21.15.146:0/3555623711 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3300051c0 msgr2=0x7fd34815d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:46.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.048+0000 7fd34dbb0700 1 --2- 172.21.15.146:0/3555623711 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3300051c0 0x7fd34815d660 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fd33800ebc0 tx=0x7fd338001640 comp rx=0 tx=0).stop 2023-10-06T11:09:46.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.048+0000 7fd34dbb0700 1 -- 172.21.15.146:0/3555623711 shutdown_connections 2023-10-06T11:09:46.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.048+0000 7fd34dbb0700 1 --2- 172.21.15.146:0/3555623711 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd334066f30 0x7fd3340693e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:46.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.048+0000 7fd34dbb0700 1 --2- 172.21.15.146:0/3555623711 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd348160690 0x7fd34806cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:46.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.048+0000 7fd34dbb0700 1 --2- 172.21.15.146:0/3555623711 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3300051c0 0x7fd34815d660 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:46.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.048+0000 7fd34dbb0700 1 --2- 172.21.15.146:0/3555623711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd348160220 0x7fd34806c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:46.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.048+0000 7fd34dbb0700 1 -- 172.21.15.146:0/3555623711 >> 172.21.15.146:0/3555623711 conn(0x7fd348067c50 msgr2=0x7fd3480cc990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:46.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.048+0000 7fd34dbb0700 1 -- 172.21.15.146:0/3555623711 shutdown_connections 2023-10-06T11:09:46.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.048+0000 7fd34dbb0700 1 -- 172.21.15.146:0/3555623711 wait complete. 2023-10-06T11:09:46.062 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T11:09:46.063 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:09:46.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.176+0000 7f77cfd46700 1 Processor -- start 2023-10-06T11:09:46.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.176+0000 7f77cfd46700 1 -- start start 2023-10-06T11:09:46.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.177+0000 7f77cfd46700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77c8153e80 0x7f77c815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:46.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.177+0000 7f77cfd46700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77c815ac30 con 0x7f77c8068ba0 2023-10-06T11:09:46.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.177+0000 7f77cfd46700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77c80b4510 con 0x7f77c8153ab0 2023-10-06T11:09:46.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.177+0000 7f77cfd46700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c80b6530 con 0x7f77c8153e80 2023-10-06T11:09:46.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.177+0000 7f77cd2e1700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f77c8068ba0 0x7f77c80b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35696/0 (socket says 172.21.15.146:35696) 2023-10-06T11:09:46.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.177+0000 7f77cd2e1700 1 -- 172.21.15.146:0/2531679560 learned_addr learned my addr 172.21.15.146:0/2531679560 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:46.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.177+0000 7f77ce2e3700 1 --2- 172.21.15.146:0/2531679560 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77c8153e80 0x7f77c815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:46.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.177+0000 7f77ccae0700 1 -- 172.21.15.146:0/2531679560 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3821918290 0 0) 0x7f77b8001110 con 0x7f77c8068ba0 2023-10-06T11:09:46.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.177+0000 7f77ccae0700 1 -- 172.21.15.146:0/2531679560 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77b4003570 con 0x7f77c8068ba0 2023-10-06T11:09:46.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.177+0000 7f77ccae0700 1 -- 172.21.15.146:0/2531679560 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1436241622 0 0) 0x7f77c80b4510 con 0x7f77c8153ab0 2023-10-06T11:09:46.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.177+0000 7f77ce2e3700 1 -- 172.21.15.146:0/2531679560 >> v1:172.21.15.151:6789/0 conn(0x7f77c8153ab0 legacy=0x7f77c8068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:46.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.177+0000 7f77ce2e3700 1 -- 172.21.15.146:0/2531679560 >> v1:172.21.15.146:6789/0 conn(0x7f77c8068ba0 legacy=0x7f77c80b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:46.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.177+0000 7f77ce2e3700 1 -- 172.21.15.146:0/2531679560 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c80b5c50 con 0x7f77c8153e80 2023-10-06T11:09:46.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.178+0000 7f77ce2e3700 1 --2- 172.21.15.146:0/2531679560 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77c8153e80 0x7f77c815a6f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f77c0009e90 tx=0x7f77c0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc5bb8bd62103445 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:46.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.178+0000 7f77ccae0700 1 -- 172.21.15.146:0/2531679560 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c000e070 con 0x7f77c8153e80 2023-10-06T11:09:46.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.178+0000 7f77ccae0700 1 -- 172.21.15.146:0/2531679560 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c000bc30 con 0x7f77c8153e80 2023-10-06T11:09:46.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.178+0000 7f77ccae0700 1 -- 172.21.15.146:0/2531679560 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c0012430 con 0x7f77c8153e80 2023-10-06T11:09:46.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.178+0000 7f77cfd46700 1 -- 172.21.15.146:0/2531679560 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77c8153e80 msgr2=0x7f77c815a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:46.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.178+0000 7f77cfd46700 1 --2- 172.21.15.146:0/2531679560 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77c8153e80 0x7f77c815a6f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f77c0009e90 tx=0x7f77c0009780 comp rx=0 tx=0).stop 2023-10-06T11:09:46.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.178+0000 7f77cfd46700 1 -- 172.21.15.146:0/2531679560 shutdown_connections 2023-10-06T11:09:46.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.178+0000 7f77cfd46700 1 --2- 172.21.15.146:0/2531679560 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77c8153e80 0x7f77c815a6f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:46.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.178+0000 7f77cfd46700 1 -- 172.21.15.146:0/2531679560 >> 172.21.15.146:0/2531679560 conn(0x7f77c806eba0 msgr2=0x7f77c806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:46.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.178+0000 7f77cfd46700 1 -- 172.21.15.146:0/2531679560 shutdown_connections 2023-10-06T11:09:46.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.178+0000 7f77cfd46700 1 -- 172.21.15.146:0/2531679560 wait complete. 2023-10-06T11:09:46.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.179+0000 7f77cfd46700 1 Processor -- start 2023-10-06T11:09:46.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.180+0000 7f77cfd46700 1 -- start start 2023-10-06T11:09:46.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.180+0000 7f77cfd46700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77c8068ba0 0x7f77c8152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:46.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.180+0000 7f77cfd46700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77c8153ab0 0x7f77c8152db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:46.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.180+0000 7f77cfd46700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77c8153e80 0x7f77c80b0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:46.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.180+0000 7f77cfd46700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c813aa80 con 0x7f77c8068ba0 2023-10-06T11:09:46.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.180+0000 7f77cfd46700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c8139e70 con 0x7f77c8153e80 2023-10-06T11:09:46.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.180+0000 7f77cfd46700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c813a150 con 0x7f77c8153ab0 2023-10-06T11:09:46.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.180+0000 7f77cdae2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77c8068ba0 0x7f77c8152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:46.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.180+0000 7f77cdae2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77c8068ba0 0x7f77c8152870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40784/0 (socket says 172.21.15.146:40784) 2023-10-06T11:09:46.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.180+0000 7f77cdae2700 1 -- 172.21.15.146:0/3352471273 learned_addr learned my addr 172.21.15.146:0/3352471273 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:46.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.181+0000 7f77ce2e3700 1 --2- 172.21.15.146:0/3352471273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77c8153e80 0x7f77c80b0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:46.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.181+0000 7f77cd2e1700 1 --2- 172.21.15.146:0/3352471273 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77c8153ab0 0x7f77c8152db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:46.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.181+0000 7f77cdae2700 1 -- 172.21.15.146:0/3352471273 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77c8153ab0 msgr2=0x7f77c8152db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:46.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.181+0000 7f77cdae2700 1 --2- 172.21.15.146:0/3352471273 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77c8153ab0 0x7f77c8152db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:46.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.181+0000 7f77cdae2700 1 -- 172.21.15.146:0/3352471273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77c8153e80 msgr2=0x7f77c80b0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:46.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.181+0000 7f77cdae2700 1 --2- 172.21.15.146:0/3352471273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77c8153e80 0x7f77c80b0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:46.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.181+0000 7f77cdae2700 1 -- 172.21.15.146:0/3352471273 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c0009a20 con 0x7f77c8068ba0 2023-10-06T11:09:46.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.181+0000 7f77cd2e1700 1 --2- 172.21.15.146:0/3352471273 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77c8153ab0 0x7f77c8152db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:46.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.181+0000 7f77ce2e3700 1 --2- 172.21.15.146:0/3352471273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77c8153e80 0x7f77c80b0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:46.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.181+0000 7f77cdae2700 1 --2- 172.21.15.146:0/3352471273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77c8068ba0 0x7f77c8152870 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f77c400c7e0 tx=0x7f77c4007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:46.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.181+0000 7f77bdffb700 1 -- 172.21.15.146:0/3352471273 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c4012700 con 0x7f77c8068ba0 2023-10-06T11:09:46.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.181+0000 7f77bdffb700 1 -- 172.21.15.146:0/3352471273 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c4012880 con 0x7f77c8068ba0 2023-10-06T11:09:46.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.181+0000 7f77cfd46700 1 -- 172.21.15.146:0/3352471273 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77c813a430 con 0x7f77c8068ba0 2023-10-06T11:09:46.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.181+0000 7f77bdffb700 1 -- 172.21.15.146:0/3352471273 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c4012c40 con 0x7f77c8068ba0 2023-10-06T11:09:46.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.181+0000 7f77cfd46700 1 -- 172.21.15.146:0/3352471273 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77c8139ab0 con 0x7f77c8068ba0 2023-10-06T11:09:46.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.182+0000 7f77cfd46700 1 -- 172.21.15.146:0/3352471273 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77c804c380 con 0x7f77c8068ba0 2023-10-06T11:09:46.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.182+0000 7f77bdffb700 1 -- 172.21.15.146:0/3352471273 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f77c401b400 con 0x7f77c8068ba0 2023-10-06T11:09:46.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.183+0000 7f77bdffb700 1 --2- 172.21.15.146:0/3352471273 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f77ac066f30 0x7f77ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:46.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.183+0000 7f77bdffb700 1 -- 172.21.15.146:0/3352471273 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f77c4084260 con 0x7f77c8068ba0 2023-10-06T11:09:46.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.183+0000 7f77cd2e1700 1 --2- 172.21.15.146:0/3352471273 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f77ac066f30 0x7f77ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:46.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.183+0000 7f77cd2e1700 1 --2- 172.21.15.146:0/3352471273 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f77ac066f30 0x7f77ac0693e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f77c814a450 tx=0x7f77b8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:46.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.187+0000 7f77bdffb700 1 -- 172.21.15.146:0/3352471273 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f77c4051370 con 0x7f77c8068ba0 2023-10-06T11:09:46.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.368+0000 7f77cfd46700 1 -- 172.21.15.146:0/3352471273 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f77c813abc0 con 0x7f77ac066f30 2023-10-06T11:09:46.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.377+0000 7f77bdffb700 1 -- 172.21.15.146:0/3352471273 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309902 (secure 0 0 0) 0x7f77b8001570 con 0x7f77ac066f30 2023-10-06T11:09:46.382 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:09:46.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.380+0000 7f77cfd46700 1 -- 172.21.15.146:0/3352471273 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f77ac066f30 msgr2=0x7f77ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:46.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.380+0000 7f77cfd46700 1 --2- 172.21.15.146:0/3352471273 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f77ac066f30 0x7f77ac0693e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f77c814a450 tx=0x7f77b8009040 comp rx=0 tx=0).stop 2023-10-06T11:09:46.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.380+0000 7f77cfd46700 1 -- 172.21.15.146:0/3352471273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77c8068ba0 msgr2=0x7f77c8152870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:46.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.380+0000 7f77cfd46700 1 --2- 172.21.15.146:0/3352471273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77c8068ba0 0x7f77c8152870 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f77c400c7e0 tx=0x7f77c4007df0 comp rx=0 tx=0).stop 2023-10-06T11:09:46.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.380+0000 7f77cfd46700 1 -- 172.21.15.146:0/3352471273 shutdown_connections 2023-10-06T11:09:46.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.380+0000 7f77cfd46700 1 --2- 172.21.15.146:0/3352471273 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f77ac066f30 0x7f77ac0693e0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:46.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.380+0000 7f77cfd46700 1 --2- 172.21.15.146:0/3352471273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77c8153e80 0x7f77c80b0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:46.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.380+0000 7f77cfd46700 1 --2- 172.21.15.146:0/3352471273 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77c8068ba0 0x7f77c8152870 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:46.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.380+0000 7f77cfd46700 1 --2- 172.21.15.146:0/3352471273 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77c8153ab0 0x7f77c8152db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:46.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.380+0000 7f77cfd46700 1 -- 172.21.15.146:0/3352471273 >> 172.21.15.146:0/3352471273 conn(0x7f77c806eba0 msgr2=0x7f77c815afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:46.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.380+0000 7f77cfd46700 1 -- 172.21.15.146:0/3352471273 shutdown_connections 2023-10-06T11:09:46.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.380+0000 7f77cfd46700 1 -- 172.21.15.146:0/3352471273 wait complete. 2023-10-06T11:09:46.386 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:09:46.394 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2023-10-06T11:09:45.192065+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":46,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2437980,"kb_used_data":6428,"kb_used_omap":0,"kb_used_meta":2431488,"kb_avail":752536740,"statfs":{"total":773094113280,"available":770597621760,"internally_reserved":0,"allocated":6582272,"data_stored":3530356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2489843712},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.995402"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.232857+0000","last_change":"2023-10-06T11:09:42.232857+0000","last_active":"2023-10-06T11:09:42.232857+0000","last_peered":"2023-10-06T11:09:42.232857+0000","last_clean":"2023-10-06T11:09:42.232857+0000","last_became_active":"2023-10-06T11:09:42.232668+0000","last_became_peered":"2023-10-06T11:09:42.232668+0000","last_unstale":"2023-10-06T11:09:42.232857+0000","last_undegraded":"2023-10-06T11:09:42.232857+0000","last_fullsized":"2023-10-06T11:09:42.232857+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:05:31.432383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.235533+0000","last_change":"2023-10-06T11:09:42.235533+0000","last_active":"2023-10-06T11:09:42.235533+0000","last_peered":"2023-10-06T11:09:42.235533+0000","last_clean":"2023-10-06T11:09:42.235533+0000","last_became_active":"2023-10-06T11:09:42.235247+0000","last_became_peered":"2023-10-06T11:09:42.235247+0000","last_unstale":"2023-10-06T11:09:42.235533+0000","last_undegraded":"2023-10-06T11:09:42.235533+0000","last_fullsized":"2023-10-06T11:09:42.235533+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:04:57.888469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.206807+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:11:07.460296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.236341+0000","last_change":"2023-10-06T11:09:42.236341+0000","last_active":"2023-10-06T11:09:42.236341+0000","last_peered":"2023-10-06T11:09:42.236341+0000","last_clean":"2023-10-06T11:09:42.236341+0000","last_became_active":"2023-10-06T11:09:42.236063+0000","last_became_peered":"2023-10-06T11:09:42.236063+0000","last_unstale":"2023-10-06T11:09:42.236341+0000","last_undegraded":"2023-10-06T11:09:42.236341+0000","last_fullsized":"2023-10-06T11:09:42.236341+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:25.857721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.233776+0000","last_change":"2023-10-06T11:09:42.233776+0000","last_active":"2023-10-06T11:09:42.233776+0000","last_peered":"2023-10-06T11:09:42.233776+0000","last_clean":"2023-10-06T11:09:42.233776+0000","last_became_active":"2023-10-06T11:09:42.233510+0000","last_became_peered":"2023-10-06T11:09:42.233510+0000","last_unstale":"2023-10-06T11:09:42.233776+0000","last_undegraded":"2023-10-06T11:09:42.233776+0000","last_fullsized":"2023-10-06T11:09:42.233776+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:51:40.439269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.205594+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:52:24.958762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.207166+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:41:31.941213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.203856+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:04:57.888469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.206003+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:10:47.746855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.209210+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:28.755325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.232740+0000","last_change":"2023-10-06T11:09:42.232740+0000","last_active":"2023-10-06T11:09:42.232740+0000","last_peered":"2023-10-06T11:09:42.232740+0000","last_clean":"2023-10-06T11:09:42.232740+0000","last_became_active":"2023-10-06T11:09:42.230980+0000","last_became_peered":"2023-10-06T11:09:42.230980+0000","last_unstale":"2023-10-06T11:09:42.232740+0000","last_undegraded":"2023-10-06T11:09:42.232740+0000","last_fullsized":"2023-10-06T11:09:42.232740+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:53.894745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.201907+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:47:49.153165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.203023+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:52:18.608330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.206348+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:06:54.424848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.206937+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:06:18.955546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.207291+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:00:59.550068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.230670+0000","last_change":"2023-10-06T11:09:42.230670+0000","last_active":"2023-10-06T11:09:42.230670+0000","last_peered":"2023-10-06T11:09:42.230670+0000","last_clean":"2023-10-06T11:09:42.230670+0000","last_became_active":"2023-10-06T11:09:42.230448+0000","last_became_peered":"2023-10-06T11:09:42.230448+0000","last_unstale":"2023-10-06T11:09:42.230670+0000","last_undegraded":"2023-10-06T11:09:42.230670+0000","last_fullsized":"2023-10-06T11:09:42.230670+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:01:57.169564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.232284+0000","last_change":"2023-10-06T11:09:42.232284+0000","last_active":"2023-10-06T11:09:42.232284+0000","last_peered":"2023-10-06T11:09:42.232284+0000","last_clean":"2023-10-06T11:09:42.232284+0000","last_became_active":"2023-10-06T11:09:42.231990+0000","last_became_peered":"2023-10-06T11:09:42.231990+0000","last_unstale":"2023-10-06T11:09:42.232284+0000","last_undegraded":"2023-10-06T11:09:42.232284+0000","last_fullsized":"2023-10-06T11:09:42.232284+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:10:47.746855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.232237+0000","last_change":"2023-10-06T11:09:42.232237+0000","last_active":"2023-10-06T11:09:42.232237+0000","last_peered":"2023-10-06T11:09:42.232237+0000","last_clean":"2023-10-06T11:09:42.232237+0000","last_became_active":"2023-10-06T11:09:42.231280+0000","last_became_peered":"2023-10-06T11:09:42.231280+0000","last_unstale":"2023-10-06T11:09:42.232237+0000","last_undegraded":"2023-10-06T11:09:42.232237+0000","last_fullsized":"2023-10-06T11:09:42.232237+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:15.427811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.206576+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:08:15.143503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.202548+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:33:15.386582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.207015+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:01:52.167469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.205394+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:32:21.749142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.209443+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:51:53.450814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.203498+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:53.894745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.204222+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:05:31.432383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.231444+0000","last_change":"2023-10-06T11:09:42.231444+0000","last_active":"2023-10-06T11:09:42.231444+0000","last_peered":"2023-10-06T11:09:42.231444+0000","last_clean":"2023-10-06T11:09:42.231444+0000","last_became_active":"2023-10-06T11:09:42.230697+0000","last_became_peered":"2023-10-06T11:09:42.230697+0000","last_unstale":"2023-10-06T11:09:42.231444+0000","last_undegraded":"2023-10-06T11:09:42.231444+0000","last_fullsized":"2023-10-06T11:09:42.231444+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:05:31.432383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.238581+0000","last_change":"2023-10-06T11:09:42.238581+0000","last_active":"2023-10-06T11:09:42.238581+0000","last_peered":"2023-10-06T11:09:42.238581+0000","last_clean":"2023-10-06T11:09:42.238581+0000","last_became_active":"2023-10-06T11:09:42.238389+0000","last_became_peered":"2023-10-06T11:09:42.238389+0000","last_unstale":"2023-10-06T11:09:42.238581+0000","last_undegraded":"2023-10-06T11:09:42.238581+0000","last_fullsized":"2023-10-06T11:09:42.238581+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:13.716196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.207408+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:13:28.565091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.202867+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:01:57.169564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.230451+0000","last_change":"2023-10-06T11:09:42.230451+0000","last_active":"2023-10-06T11:09:42.230451+0000","last_peered":"2023-10-06T11:09:42.230451+0000","last_clean":"2023-10-06T11:09:42.230451+0000","last_became_active":"2023-10-06T11:09:42.230170+0000","last_became_peered":"2023-10-06T11:09:42.230170+0000","last_unstale":"2023-10-06T11:09:42.230451+0000","last_undegraded":"2023-10-06T11:09:42.230451+0000","last_fullsized":"2023-10-06T11:09:42.230451+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:07:11.162512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.205915+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:40:31.710840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.230224+0000","last_change":"2023-10-06T11:09:42.230224+0000","last_active":"2023-10-06T11:09:42.230224+0000","last_peered":"2023-10-06T11:09:42.230224+0000","last_clean":"2023-10-06T11:09:42.230224+0000","last_became_active":"2023-10-06T11:09:42.229962+0000","last_became_peered":"2023-10-06T11:09:42.229962+0000","last_unstale":"2023-10-06T11:09:42.230224+0000","last_undegraded":"2023-10-06T11:09:42.230224+0000","last_fullsized":"2023-10-06T11:09:42.230224+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:39:11.614060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.215964+0000","last_change":"2023-10-06T11:09:41.213260+0000","last_active":"2023-10-06T11:09:41.215964+0000","last_peered":"2023-10-06T11:09:41.215964+0000","last_clean":"2023-10-06T11:09:41.215964+0000","last_became_active":"2023-10-06T11:09:41.213069+0000","last_became_peered":"2023-10-06T11:09:41.213069+0000","last_unstale":"2023-10-06T11:09:41.215964+0000","last_undegraded":"2023-10-06T11:09:41.215964+0000","last_fullsized":"2023-10-06T11:09:41.215964+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:48:05.076777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.231249+0000","last_change":"2023-10-06T11:09:42.231249+0000","last_active":"2023-10-06T11:09:42.231249+0000","last_peered":"2023-10-06T11:09:42.231249+0000","last_clean":"2023-10-06T11:09:42.231249+0000","last_became_active":"2023-10-06T11:09:42.230418+0000","last_became_peered":"2023-10-06T11:09:42.230418+0000","last_unstale":"2023-10-06T11:09:42.231249+0000","last_undegraded":"2023-10-06T11:09:42.231249+0000","last_fullsized":"2023-10-06T11:09:42.231249+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:29:33.571825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.216511+0000","last_change":"2023-10-06T11:09:41.216511+0000","last_active":"2023-10-06T11:09:41.216511+0000","last_peered":"2023-10-06T11:09:41.216511+0000","last_clean":"2023-10-06T11:09:41.216511+0000","last_became_active":"2023-10-06T11:09:41.216244+0000","last_became_peered":"2023-10-06T11:09:41.216244+0000","last_unstale":"2023-10-06T11:09:41.216511+0000","last_undegraded":"2023-10-06T11:09:41.216511+0000","last_fullsized":"2023-10-06T11:09:41.216511+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:01:51.162810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.205914+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:20:43.051092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.213108+0000","last_change":"2023-10-06T11:09:41.213108+0000","last_active":"2023-10-06T11:09:41.213108+0000","last_peered":"2023-10-06T11:09:41.213108+0000","last_clean":"2023-10-06T11:09:41.213108+0000","last_became_active":"2023-10-06T11:09:41.212695+0000","last_became_peered":"2023-10-06T11:09:41.212695+0000","last_unstale":"2023-10-06T11:09:41.213108+0000","last_undegraded":"2023-10-06T11:09:41.213108+0000","last_fullsized":"2023-10-06T11:09:41.213108+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:32:20.744483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.204954+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:37:07.428678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.216502+0000","last_change":"2023-10-06T11:09:41.216502+0000","last_active":"2023-10-06T11:09:41.216502+0000","last_peered":"2023-10-06T11:09:41.216502+0000","last_clean":"2023-10-06T11:09:41.216502+0000","last_became_active":"2023-10-06T11:09:41.216217+0000","last_became_peered":"2023-10-06T11:09:41.216217+0000","last_unstale":"2023-10-06T11:09:41.216502+0000","last_undegraded":"2023-10-06T11:09:41.216502+0000","last_fullsized":"2023-10-06T11:09:41.216502+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:08:14.138844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.206842+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:48:27.535076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.218930+0000","last_change":"2023-10-06T11:09:41.218930+0000","last_active":"2023-10-06T11:09:41.218930+0000","last_peered":"2023-10-06T11:09:41.218930+0000","last_clean":"2023-10-06T11:09:41.218930+0000","last_became_active":"2023-10-06T11:09:41.218683+0000","last_became_peered":"2023-10-06T11:09:41.218683+0000","last_unstale":"2023-10-06T11:09:41.218930+0000","last_undegraded":"2023-10-06T11:09:41.218930+0000","last_fullsized":"2023-10-06T11:09:41.218930+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:13:27.560433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.232629+0000","last_change":"2023-10-06T11:09:42.232629+0000","last_active":"2023-10-06T11:09:42.232629+0000","last_peered":"2023-10-06T11:09:42.232629+0000","last_clean":"2023-10-06T11:09:42.232629+0000","last_became_active":"2023-10-06T11:09:42.232390+0000","last_became_peered":"2023-10-06T11:09:42.232390+0000","last_unstale":"2023-10-06T11:09:42.232629+0000","last_undegraded":"2023-10-06T11:09:42.232629+0000","last_fullsized":"2023-10-06T11:09:42.232629+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:40:23.620747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.208722+0000","last_change":"2023-10-06T11:09:41.208722+0000","last_active":"2023-10-06T11:09:41.208722+0000","last_peered":"2023-10-06T11:09:41.208722+0000","last_clean":"2023-10-06T11:09:41.208722+0000","last_became_active":"2023-10-06T11:09:41.208481+0000","last_became_peered":"2023-10-06T11:09:41.208481+0000","last_unstale":"2023-10-06T11:09:41.208722+0000","last_undegraded":"2023-10-06T11:09:41.208722+0000","last_fullsized":"2023-10-06T11:09:41.208722+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:06:53.420190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.227251+0000","last_change":"2023-10-06T11:09:42.227251+0000","last_active":"2023-10-06T11:09:42.227251+0000","last_peered":"2023-10-06T11:09:42.227251+0000","last_clean":"2023-10-06T11:09:42.227251+0000","last_became_active":"2023-10-06T11:09:42.226952+0000","last_became_peered":"2023-10-06T11:09:42.226952+0000","last_unstale":"2023-10-06T11:09:42.227251+0000","last_undegraded":"2023-10-06T11:09:42.227251+0000","last_fullsized":"2023-10-06T11:09:42.227251+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:59.957433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.218780+0000","last_change":"2023-10-06T11:09:41.218780+0000","last_active":"2023-10-06T11:09:41.218780+0000","last_peered":"2023-10-06T11:09:41.218780+0000","last_clean":"2023-10-06T11:09:41.218780+0000","last_became_active":"2023-10-06T11:09:41.218522+0000","last_became_peered":"2023-10-06T11:09:41.218522+0000","last_unstale":"2023-10-06T11:09:41.218780+0000","last_undegraded":"2023-10-06T11:09:41.218780+0000","last_fullsized":"2023-10-06T11:09:41.218780+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:25.585394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.205267+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:15.899968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.219309+0000","last_change":"2023-10-06T11:09:41.215714+0000","last_active":"2023-10-06T11:09:41.219309+0000","last_peered":"2023-10-06T11:09:41.219309+0000","last_clean":"2023-10-06T11:09:41.219309+0000","last_became_active":"2023-10-06T11:09:41.215430+0000","last_became_peered":"2023-10-06T11:09:41.215430+0000","last_unstale":"2023-10-06T11:09:41.219309+0000","last_undegraded":"2023-10-06T11:09:41.219309+0000","last_fullsized":"2023-10-06T11:09:41.219309+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:48:06.642258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.227904+0000","last_change":"2023-10-06T11:09:42.227904+0000","last_active":"2023-10-06T11:09:42.227904+0000","last_peered":"2023-10-06T11:09:42.227904+0000","last_clean":"2023-10-06T11:09:42.227904+0000","last_became_active":"2023-10-06T11:09:42.227654+0000","last_became_peered":"2023-10-06T11:09:42.227654+0000","last_unstale":"2023-10-06T11:09:42.227904+0000","last_undegraded":"2023-10-06T11:09:42.227904+0000","last_fullsized":"2023-10-06T11:09:42.227904+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:53.894745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.217448+0000","last_change":"2023-10-06T11:09:41.217448+0000","last_active":"2023-10-06T11:09:41.217448+0000","last_peered":"2023-10-06T11:09:41.217448+0000","last_clean":"2023-10-06T11:09:41.217448+0000","last_became_active":"2023-10-06T11:09:41.217135+0000","last_became_peered":"2023-10-06T11:09:41.217135+0000","last_unstale":"2023-10-06T11:09:41.217448+0000","last_undegraded":"2023-10-06T11:09:41.217448+0000","last_fullsized":"2023-10-06T11:09:41.217448+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:40:22.616089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.205645+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:22:01.027500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.214378+0000","last_change":"2023-10-06T11:09:41.212720+0000","last_active":"2023-10-06T11:09:41.214378+0000","last_peered":"2023-10-06T11:09:41.214378+0000","last_clean":"2023-10-06T11:09:41.214378+0000","last_became_active":"2023-10-06T11:09:41.212468+0000","last_became_peered":"2023-10-06T11:09:41.212468+0000","last_unstale":"2023-10-06T11:09:41.214378+0000","last_undegraded":"2023-10-06T11:09:41.214378+0000","last_fullsized":"2023-10-06T11:09:41.214378+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:57.202092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.231969+0000","last_change":"2023-10-06T11:09:42.231969+0000","last_active":"2023-10-06T11:09:42.231969+0000","last_peered":"2023-10-06T11:09:42.231969+0000","last_clean":"2023-10-06T11:09:42.231969+0000","last_became_active":"2023-10-06T11:09:42.231685+0000","last_became_peered":"2023-10-06T11:09:42.231685+0000","last_unstale":"2023-10-06T11:09:42.231969+0000","last_undegraded":"2023-10-06T11:09:42.231969+0000","last_fullsized":"2023-10-06T11:09:42.231969+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:58.206751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.217623+0000","last_change":"2023-10-06T11:09:41.217623+0000","last_active":"2023-10-06T11:09:41.217623+0000","last_peered":"2023-10-06T11:09:41.217623+0000","last_clean":"2023-10-06T11:09:41.217623+0000","last_became_active":"2023-10-06T11:09:41.216779+0000","last_became_peered":"2023-10-06T11:09:41.216779+0000","last_unstale":"2023-10-06T11:09:41.217623+0000","last_undegraded":"2023-10-06T11:09:41.217623+0000","last_fullsized":"2023-10-06T11:09:41.217623+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:12.711537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.257176+0000","last_change":"2023-10-06T11:09:42.257176+0000","last_active":"2023-10-06T11:09:42.257176+0000","last_peered":"2023-10-06T11:09:42.257176+0000","last_clean":"2023-10-06T11:09:42.257176+0000","last_became_active":"2023-10-06T11:09:42.256930+0000","last_became_peered":"2023-10-06T11:09:42.256930+0000","last_unstale":"2023-10-06T11:09:42.257176+0000","last_undegraded":"2023-10-06T11:09:42.257176+0000","last_fullsized":"2023-10-06T11:09:42.257176+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:52:18.608330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.216096+0000","last_change":"2023-10-06T11:09:41.213317+0000","last_active":"2023-10-06T11:09:41.216096+0000","last_peered":"2023-10-06T11:09:41.216096+0000","last_clean":"2023-10-06T11:09:41.216096+0000","last_became_active":"2023-10-06T11:09:41.212888+0000","last_became_peered":"2023-10-06T11:09:41.212888+0000","last_unstale":"2023-10-06T11:09:41.216096+0000","last_undegraded":"2023-10-06T11:09:41.216096+0000","last_fullsized":"2023-10-06T11:09:41.216096+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:14.423152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.235268+0000","last_change":"2023-10-06T11:09:42.235268+0000","last_active":"2023-10-06T11:09:42.235268+0000","last_peered":"2023-10-06T11:09:42.235268+0000","last_clean":"2023-10-06T11:09:42.235268+0000","last_became_active":"2023-10-06T11:09:42.234996+0000","last_became_peered":"2023-10-06T11:09:42.234996+0000","last_unstale":"2023-10-06T11:09:42.235268+0000","last_undegraded":"2023-10-06T11:09:42.235268+0000","last_fullsized":"2023-10-06T11:09:42.235268+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:39:06.623968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.216177+0000","last_change":"2023-10-06T11:09:41.216177+0000","last_active":"2023-10-06T11:09:41.216177+0000","last_peered":"2023-10-06T11:09:41.216177+0000","last_clean":"2023-10-06T11:09:41.216177+0000","last_became_active":"2023-10-06T11:09:41.215915+0000","last_became_peered":"2023-10-06T11:09:41.215915+0000","last_unstale":"2023-10-06T11:09:41.216177+0000","last_undegraded":"2023-10-06T11:09:41.216177+0000","last_fullsized":"2023-10-06T11:09:41.216177+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:05:30.427724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.202455+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:59:20.350433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.217104+0000","last_change":"2023-10-06T11:09:41.217104+0000","last_active":"2023-10-06T11:09:41.217104+0000","last_peered":"2023-10-06T11:09:41.217104+0000","last_clean":"2023-10-06T11:09:41.217104+0000","last_became_active":"2023-10-06T11:09:41.216693+0000","last_became_peered":"2023-10-06T11:09:41.216693+0000","last_unstale":"2023-10-06T11:09:41.217104+0000","last_undegraded":"2023-10-06T11:09:41.217104+0000","last_fullsized":"2023-10-06T11:09:41.217104+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:30.756704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.230985+0000","last_change":"2023-10-06T11:09:42.230985+0000","last_active":"2023-10-06T11:09:42.230985+0000","last_peered":"2023-10-06T11:09:42.230985+0000","last_clean":"2023-10-06T11:09:42.230985+0000","last_became_active":"2023-10-06T11:09:42.230741+0000","last_became_peered":"2023-10-06T11:09:42.230741+0000","last_unstale":"2023-10-06T11:09:42.230985+0000","last_undegraded":"2023-10-06T11:09:42.230985+0000","last_fullsized":"2023-10-06T11:09:42.230985+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:04:41.583424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.217240+0000","last_change":"2023-10-06T11:09:41.217240+0000","last_active":"2023-10-06T11:09:41.217240+0000","last_peered":"2023-10-06T11:09:41.217240+0000","last_clean":"2023-10-06T11:09:41.217240+0000","last_became_active":"2023-10-06T11:09:41.216980+0000","last_became_peered":"2023-10-06T11:09:41.216980+0000","last_unstale":"2023-10-06T11:09:41.217240+0000","last_undegraded":"2023-10-06T11:09:41.217240+0000","last_fullsized":"2023-10-06T11:09:41.217240+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:07:10.157853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.234850+0000","last_change":"2023-10-06T11:09:42.234850+0000","last_active":"2023-10-06T11:09:42.234850+0000","last_peered":"2023-10-06T11:09:42.234850+0000","last_clean":"2023-10-06T11:09:42.234850+0000","last_became_active":"2023-10-06T11:09:42.234572+0000","last_became_peered":"2023-10-06T11:09:42.234572+0000","last_unstale":"2023-10-06T11:09:42.234850+0000","last_undegraded":"2023-10-06T11:09:42.234850+0000","last_fullsized":"2023-10-06T11:09:42.234850+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:25.857721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.214988+0000","last_change":"2023-10-06T11:09:41.213789+0000","last_active":"2023-10-06T11:09:41.214988+0000","last_peered":"2023-10-06T11:09:41.214988+0000","last_clean":"2023-10-06T11:09:41.214988+0000","last_became_active":"2023-10-06T11:09:41.213505+0000","last_became_peered":"2023-10-06T11:09:41.213505+0000","last_unstale":"2023-10-06T11:09:41.214988+0000","last_undegraded":"2023-10-06T11:09:41.214988+0000","last_fullsized":"2023-10-06T11:09:41.214988+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:14.423152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.204665+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:57:54.298243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.213087+0000","last_change":"2023-10-06T11:09:41.213087+0000","last_active":"2023-10-06T11:09:41.213087+0000","last_peered":"2023-10-06T11:09:41.213087+0000","last_clean":"2023-10-06T11:09:41.213087+0000","last_became_active":"2023-10-06T11:09:41.212812+0000","last_became_peered":"2023-10-06T11:09:41.212812+0000","last_unstale":"2023-10-06T11:09:41.213087+0000","last_undegraded":"2023-10-06T11:09:41.213087+0000","last_fullsized":"2023-10-06T11:09:41.213087+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:14.423152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.206785+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:13:19.786801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.211660+0000","last_change":"2023-10-06T11:09:41.211660+0000","last_active":"2023-10-06T11:09:41.211660+0000","last_peered":"2023-10-06T11:09:41.211660+0000","last_clean":"2023-10-06T11:09:41.211660+0000","last_became_active":"2023-10-06T11:09:41.209522+0000","last_became_peered":"2023-10-06T11:09:41.209522+0000","last_unstale":"2023-10-06T11:09:41.211660+0000","last_undegraded":"2023-10-06T11:09:41.211660+0000","last_fullsized":"2023-10-06T11:09:41.211660+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:29.500970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.203481+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:40:23.620747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.212942+0000","last_change":"2023-10-06T11:09:41.212942+0000","last_active":"2023-10-06T11:09:41.212942+0000","last_peered":"2023-10-06T11:09:41.212942+0000","last_clean":"2023-10-06T11:09:41.212942+0000","last_became_active":"2023-10-06T11:09:41.212251+0000","last_became_peered":"2023-10-06T11:09:41.212251+0000","last_unstale":"2023-10-06T11:09:41.212942+0000","last_undegraded":"2023-10-06T11:09:41.212942+0000","last_fullsized":"2023-10-06T11:09:41.212942+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:14.895309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.257270+0000","last_change":"2023-10-06T11:09:42.257270+0000","last_active":"2023-10-06T11:09:42.257270+0000","last_peered":"2023-10-06T11:09:42.257270+0000","last_clean":"2023-10-06T11:09:42.257270+0000","last_became_active":"2023-10-06T11:09:42.256903+0000","last_became_peered":"2023-10-06T11:09:42.256903+0000","last_unstale":"2023-10-06T11:09:42.257270+0000","last_undegraded":"2023-10-06T11:09:42.257270+0000","last_fullsized":"2023-10-06T11:09:42.257270+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:30.505629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.216079+0000","last_change":"2023-10-06T11:09:41.213157+0000","last_active":"2023-10-06T11:09:41.216079+0000","last_peered":"2023-10-06T11:09:41.216079+0000","last_clean":"2023-10-06T11:09:41.216079+0000","last_became_active":"2023-10-06T11:09:41.212578+0000","last_became_peered":"2023-10-06T11:09:41.212578+0000","last_unstale":"2023-10-06T11:09:41.216079+0000","last_undegraded":"2023-10-06T11:09:41.216079+0000","last_fullsized":"2023-10-06T11:09:41.216079+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:55:58.933120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.232043+0000","last_change":"2023-10-06T11:09:42.232043+0000","last_active":"2023-10-06T11:09:42.232043+0000","last_peered":"2023-10-06T11:09:42.232043+0000","last_clean":"2023-10-06T11:09:42.232043+0000","last_became_active":"2023-10-06T11:09:42.231775+0000","last_became_peered":"2023-10-06T11:09:42.231775+0000","last_unstale":"2023-10-06T11:09:42.232043+0000","last_undegraded":"2023-10-06T11:09:42.232043+0000","last_fullsized":"2023-10-06T11:09:42.232043+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:05:12.404425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.218001+0000","last_change":"2023-10-06T11:09:41.218001+0000","last_active":"2023-10-06T11:09:41.218001+0000","last_peered":"2023-10-06T11:09:41.218001+0000","last_clean":"2023-10-06T11:09:41.218001+0000","last_became_active":"2023-10-06T11:09:41.217073+0000","last_became_peered":"2023-10-06T11:09:41.217073+0000","last_unstale":"2023-10-06T11:09:41.218001+0000","last_undegraded":"2023-10-06T11:09:41.218001+0000","last_fullsized":"2023-10-06T11:09:41.218001+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:29:32.567167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.236348+0000","last_change":"2023-10-06T11:09:42.236348+0000","last_active":"2023-10-06T11:09:42.236348+0000","last_peered":"2023-10-06T11:09:42.236348+0000","last_clean":"2023-10-06T11:09:42.236348+0000","last_became_active":"2023-10-06T11:09:42.236035+0000","last_became_peered":"2023-10-06T11:09:42.236035+0000","last_unstale":"2023-10-06T11:09:42.236348+0000","last_undegraded":"2023-10-06T11:09:42.236348+0000","last_fullsized":"2023-10-06T11:09:42.236348+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:37:07.428678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.211301+0000","last_change":"2023-10-06T11:09:41.211301+0000","last_active":"2023-10-06T11:09:41.211301+0000","last_peered":"2023-10-06T11:09:41.211301+0000","last_clean":"2023-10-06T11:09:41.211301+0000","last_became_active":"2023-10-06T11:09:41.211014+0000","last_became_peered":"2023-10-06T11:09:41.211014+0000","last_unstale":"2023-10-06T11:09:41.211301+0000","last_undegraded":"2023-10-06T11:09:41.211301+0000","last_fullsized":"2023-10-06T11:09:41.211301+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:51:52.446155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.230829+0000","last_change":"2023-10-06T11:09:42.230829+0000","last_active":"2023-10-06T11:09:42.230829+0000","last_peered":"2023-10-06T11:09:42.230829+0000","last_clean":"2023-10-06T11:09:42.230829+0000","last_became_active":"2023-10-06T11:09:42.230511+0000","last_became_peered":"2023-10-06T11:09:42.230511+0000","last_unstale":"2023-10-06T11:09:42.230829+0000","last_undegraded":"2023-10-06T11:09:42.230829+0000","last_fullsized":"2023-10-06T11:09:42.230829+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:52:18.608330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.218854+0000","last_change":"2023-10-06T11:09:41.218854+0000","last_active":"2023-10-06T11:09:41.218854+0000","last_peered":"2023-10-06T11:09:41.218854+0000","last_clean":"2023-10-06T11:09:41.218854+0000","last_became_active":"2023-10-06T11:09:41.218572+0000","last_became_peered":"2023-10-06T11:09:41.218572+0000","last_unstale":"2023-10-06T11:09:41.218854+0000","last_undegraded":"2023-10-06T11:09:41.218854+0000","last_fullsized":"2023-10-06T11:09:41.218854+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:06:06.843348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.206441+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:30:41.551826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.217159+0000","last_change":"2023-10-06T11:09:41.214668+0000","last_active":"2023-10-06T11:09:41.217159+0000","last_peered":"2023-10-06T11:09:41.217159+0000","last_clean":"2023-10-06T11:09:41.217159+0000","last_became_active":"2023-10-06T11:09:41.214427+0000","last_became_peered":"2023-10-06T11:09:41.214427+0000","last_unstale":"2023-10-06T11:09:41.217159+0000","last_undegraded":"2023-10-06T11:09:41.217159+0000","last_fullsized":"2023-10-06T11:09:41.217159+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:08:49.990834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.228930+0000","last_change":"2023-10-06T11:09:42.228930+0000","last_active":"2023-10-06T11:09:42.228930+0000","last_peered":"2023-10-06T11:09:42.228930+0000","last_clean":"2023-10-06T11:09:42.228930+0000","last_became_active":"2023-10-06T11:09:42.228558+0000","last_became_peered":"2023-10-06T11:09:42.228558+0000","last_unstale":"2023-10-06T11:09:42.228930+0000","last_undegraded":"2023-10-06T11:09:42.228930+0000","last_fullsized":"2023-10-06T11:09:42.228930+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:13.716196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.218292+0000","last_change":"2023-10-06T11:09:41.218292+0000","last_active":"2023-10-06T11:09:41.218292+0000","last_peered":"2023-10-06T11:09:41.218292+0000","last_clean":"2023-10-06T11:09:41.218292+0000","last_became_active":"2023-10-06T11:09:41.217963+0000","last_became_peered":"2023-10-06T11:09:41.217963+0000","last_unstale":"2023-10-06T11:09:41.218292+0000","last_undegraded":"2023-10-06T11:09:41.218292+0000","last_fullsized":"2023-10-06T11:09:41.218292+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:52.890087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":47,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.205019+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:09:41.205019+0000","last_peered":"2023-10-06T11:09:41.205019+0000","last_clean":"2023-10-06T11:09:41.205019+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:09:41.205019+0000","last_undegraded":"2023-10-06T11:09:41.205019+0000","last_fullsized":"2023-10-06T11:09:41.205019+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.257731+0000","last_change":"2023-10-06T11:09:42.257731+0000","last_active":"2023-10-06T11:09:42.257731+0000","last_peered":"2023-10-06T11:09:42.257731+0000","last_clean":"2023-10-06T11:09:42.257731+0000","last_became_active":"2023-10-06T11:09:42.257516+0000","last_became_peered":"2023-10-06T11:09:42.257516+0000","last_unstale":"2023-10-06T11:09:42.257731+0000","last_undegraded":"2023-10-06T11:09:42.257731+0000","last_fullsized":"2023-10-06T11:09:42.257731+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:31.761363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.213322+0000","last_change":"2023-10-06T11:09:41.213322+0000","last_active":"2023-10-06T11:09:41.213322+0000","last_peered":"2023-10-06T11:09:41.213322+0000","last_clean":"2023-10-06T11:09:41.213322+0000","last_became_active":"2023-10-06T11:09:41.213046+0000","last_became_peered":"2023-10-06T11:09:41.213046+0000","last_unstale":"2023-10-06T11:09:41.213322+0000","last_undegraded":"2023-10-06T11:09:41.213322+0000","last_fullsized":"2023-10-06T11:09:41.213322+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:27.750667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:09:40.204482+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:09:40.204482+0000","last_peered":"2023-10-06T11:09:40.204482+0000","last_clean":"2023-10-06T11:09:40.204482+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:09:40.204482+0000","last_undegraded":"2023-10-06T11:09:40.204482+0000","last_fullsized":"2023-10-06T11:09:40.204482+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.204968+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:26.358337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.215573+0000","last_change":"2023-10-06T11:09:41.215573+0000","last_active":"2023-10-06T11:09:41.215573+0000","last_peered":"2023-10-06T11:09:41.215573+0000","last_clean":"2023-10-06T11:09:41.215573+0000","last_became_active":"2023-10-06T11:09:41.215351+0000","last_became_peered":"2023-10-06T11:09:41.215351+0000","last_unstale":"2023-10-06T11:09:41.215573+0000","last_undegraded":"2023-10-06T11:09:41.215573+0000","last_fullsized":"2023-10-06T11:09:41.215573+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:53:09.457192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":44,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.199334+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:09:41.199334+0000","last_peered":"2023-10-06T11:09:41.199334+0000","last_clean":"2023-10-06T11:09:41.199334+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:09:41.199334+0000","last_undegraded":"2023-10-06T11:09:41.199334+0000","last_fullsized":"2023-10-06T11:09:41.199334+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":191,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:09:40.202973+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:09:40.202973+0000","last_peered":"2023-10-06T11:09:40.202973+0000","last_clean":"2023-10-06T11:09:40.202973+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:09:40.202973+0000","last_undegraded":"2023-10-06T11:09:40.202973+0000","last_fullsized":"2023-10-06T11:09:40.202973+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.201858+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:39:11.614060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.216944+0000","last_change":"2023-10-06T11:09:41.216944+0000","last_active":"2023-10-06T11:09:41.216944+0000","last_peered":"2023-10-06T11:09:41.216944+0000","last_clean":"2023-10-06T11:09:41.216944+0000","last_became_active":"2023-10-06T11:09:41.216394+0000","last_became_peered":"2023-10-06T11:09:41.216394+0000","last_unstale":"2023-10-06T11:09:41.216944+0000","last_undegraded":"2023-10-06T11:09:41.216944+0000","last_fullsized":"2023-10-06T11:09:41.216944+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:57.202092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":41,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:09:40.202973+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:09:40.202973+0000","last_peered":"2023-10-06T11:09:40.202973+0000","last_clean":"2023-10-06T11:09:40.202973+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:09:40.202973+0000","last_undegraded":"2023-10-06T11:09:40.202973+0000","last_fullsized":"2023-10-06T11:09:40.202973+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.228539+0000","last_change":"2023-10-06T11:09:42.228539+0000","last_active":"2023-10-06T11:09:42.228539+0000","last_peered":"2023-10-06T11:09:42.228539+0000","last_clean":"2023-10-06T11:09:42.228539+0000","last_became_active":"2023-10-06T11:09:42.228200+0000","last_became_peered":"2023-10-06T11:09:42.228200+0000","last_unstale":"2023-10-06T11:09:42.228539+0000","last_undegraded":"2023-10-06T11:09:42.228539+0000","last_fullsized":"2023-10-06T11:09:42.228539+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:47:49.153165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.219234+0000","last_change":"2023-10-06T11:09:41.219234+0000","last_active":"2023-10-06T11:09:41.219234+0000","last_peered":"2023-10-06T11:09:41.219234+0000","last_clean":"2023-10-06T11:09:41.219234+0000","last_became_active":"2023-10-06T11:09:41.218988+0000","last_became_peered":"2023-10-06T11:09:41.218988+0000","last_unstale":"2023-10-06T11:09:41.219234+0000","last_undegraded":"2023-10-06T11:09:41.219234+0000","last_fullsized":"2023-10-06T11:09:41.219234+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:06:17.950887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":41,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:09:40.202753+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:09:40.202753+0000","last_peered":"2023-10-06T11:09:40.202753+0000","last_clean":"2023-10-06T11:09:40.202753+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:09:40.202753+0000","last_undegraded":"2023-10-06T11:09:40.202753+0000","last_fullsized":"2023-10-06T11:09:40.202753+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.226066+0000","last_change":"2023-10-06T11:09:42.226066+0000","last_active":"2023-10-06T11:09:42.226066+0000","last_peered":"2023-10-06T11:09:42.226066+0000","last_clean":"2023-10-06T11:09:42.226066+0000","last_became_active":"2023-10-06T11:09:42.225791+0000","last_became_peered":"2023-10-06T11:09:42.225791+0000","last_unstale":"2023-10-06T11:09:42.226066+0000","last_undegraded":"2023-10-06T11:09:42.226066+0000","last_fullsized":"2023-10-06T11:09:42.226066+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:08:50.995493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.214421+0000","last_change":"2023-10-06T11:09:41.214421+0000","last_active":"2023-10-06T11:09:41.214421+0000","last_peered":"2023-10-06T11:09:41.214421+0000","last_clean":"2023-10-06T11:09:41.214421+0000","last_became_active":"2023-10-06T11:09:41.214113+0000","last_became_peered":"2023-10-06T11:09:41.214113+0000","last_unstale":"2023-10-06T11:09:41.214421+0000","last_undegraded":"2023-10-06T11:09:41.214421+0000","last_fullsized":"2023-10-06T11:09:41.214421+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:22:00.022841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":49,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:09:40.200831+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:09:40.200831+0000","last_peered":"2023-10-06T11:09:40.200831+0000","last_clean":"2023-10-06T11:09:40.200831+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:09:40.200831+0000","last_undegraded":"2023-10-06T11:09:40.200831+0000","last_fullsized":"2023-10-06T11:09:40.200831+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.234133+0000","last_change":"2023-10-06T11:09:42.234133+0000","last_active":"2023-10-06T11:09:42.234133+0000","last_peered":"2023-10-06T11:09:42.234133+0000","last_clean":"2023-10-06T11:09:42.234133+0000","last_became_active":"2023-10-06T11:09:42.233860+0000","last_became_peered":"2023-10-06T11:09:42.233860+0000","last_unstale":"2023-10-06T11:09:42.234133+0000","last_undegraded":"2023-10-06T11:09:42.234133+0000","last_fullsized":"2023-10-06T11:09:42.234133+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:55:59.937779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.215052+0000","last_change":"2023-10-06T11:09:41.215052+0000","last_active":"2023-10-06T11:09:41.215052+0000","last_peered":"2023-10-06T11:09:41.215052+0000","last_clean":"2023-10-06T11:09:41.215052+0000","last_became_active":"2023-10-06T11:09:41.214778+0000","last_became_peered":"2023-10-06T11:09:41.214778+0000","last_unstale":"2023-10-06T11:09:41.215052+0000","last_undegraded":"2023-10-06T11:09:41.215052+0000","last_fullsized":"2023-10-06T11:09:41.215052+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:24.853062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":46,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.208694+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:09:41.208694+0000","last_peered":"2023-10-06T11:09:41.208694+0000","last_clean":"2023-10-06T11:09:41.208694+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:09:41.208694+0000","last_undegraded":"2023-10-06T11:09:41.208694+0000","last_fullsized":"2023-10-06T11:09:41.208694+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.207874+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:06:07.848007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.218783+0000","last_change":"2023-10-06T11:09:41.218783+0000","last_active":"2023-10-06T11:09:41.218783+0000","last_peered":"2023-10-06T11:09:41.218783+0000","last_clean":"2023-10-06T11:09:41.218783+0000","last_became_active":"2023-10-06T11:09:41.216107+0000","last_became_peered":"2023-10-06T11:09:41.216107+0000","last_unstale":"2023-10-06T11:09:41.218783+0000","last_undegraded":"2023-10-06T11:09:41.218783+0000","last_fullsized":"2023-10-06T11:09:41.218783+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:58.952774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":46,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.207562+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:09:41.207562+0000","last_peered":"2023-10-06T11:09:41.207562+0000","last_clean":"2023-10-06T11:09:41.207562+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:09:41.207562+0000","last_undegraded":"2023-10-06T11:09:41.207562+0000","last_fullsized":"2023-10-06T11:09:41.207562+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574900,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298524,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073316,"statfs":{"total":96636764160,"available":96331075584,"internally_reserved":0,"allocated":1265664,"data_stored":882269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":1.871,"5min":0.73999999999999999,"15min":0.56999999999999995},"min":{"1min":0.41199999999999998,"5min":0.248,"15min":0.248},"max":{"1min":23.908999999999999,"5min":23.908999999999999,"15min":23.908999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":1.127,"5min":0.629,"15min":0.56499999999999995},"min":{"1min":0.374,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":9.0600000000000005,"5min":9.0600000000000005,"15min":9.0600000000000005},"last":0.55200000000000005}]},{"osd":1,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":0.63900000000000001,"15min":0.57099999999999995},"min":{"1min":0.40899999999999997,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":9.2360000000000007,"5min":9.2360000000000007,"15min":9.2360000000000007},"last":0.62},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.53900000000000003,"15min":0.51600000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":4.327,"5min":4.327,"15min":4.327},"last":0.57799999999999996}]},{"osd":2,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.504,"15min":0.50900000000000001},"min":{"1min":0.311,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.59599999999999997,"15min":0.55800000000000005},"min":{"1min":0.436,"5min":0.309,"15min":0.309},"max":{"1min":4.7309999999999999,"5min":4.7309999999999999,"15min":4.7309999999999999},"last":0.51300000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.55400000000000005,"15min":0.51400000000000001},"min":{"1min":0.35299999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":4.3540000000000001,"5min":4.3540000000000001,"15min":4.3540000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":1.1870000000000001,"5min":0.67300000000000004,"15min":0.59999999999999998},"min":{"1min":0.45300000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":9.3879999999999999,"5min":9.3879999999999999,"15min":9.3879999999999999},"last":0.58999999999999997}]},{"osd":4,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.50800000000000001,"15min":0.47499999999999998},"min":{"1min":0.34100000000000003,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":4.5709999999999997,"5min":4.5709999999999997,"15min":4.5709999999999997},"last":0.498},{"interface":"front","average":{"1min":0.753,"5min":0.55800000000000005,"15min":0.53500000000000003},"min":{"1min":0.33100000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":4.3129999999999997,"5min":4.3129999999999997,"15min":4.3129999999999997},"last":0.41199999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":0.64100000000000001,"15min":0.58099999999999996},"min":{"1min":0.34200000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":9.3499999999999996,"5min":9.3499999999999996,"15min":9.3499999999999996},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.58299999999999996,"15min":0.56699999999999995},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":4.444,"5min":4.444,"15min":4.444},"last":0.54000000000000004}]},{"osd":6,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":0.67300000000000004,"15min":0.622},"min":{"1min":0.39700000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":9.4969999999999999,"5min":9.4969999999999999,"15min":9.4969999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.66200000000000003,"15min":0.62},"min":{"1min":0.44800000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":7.2039999999999997,"5min":7.2039999999999997,"15min":7.2039999999999997},"last":0.60499999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310240,"kb_used_data":664,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061600,"statfs":{"total":96636764160,"available":96319078400,"internally_reserved":0,"allocated":679936,"data_stored":297156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.48199999999999998,"15min":0.497},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52100000000000002,"15min":0.53300000000000003},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.60599999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.48299999999999998,"15min":0.499},"min":{"1min":0.34100000000000003,"5min":0.253,"15min":0.253},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48499999999999999,"15min":0.499},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.76400000000000001,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.47899999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.53100000000000003,"15min":0.498},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":7.0659999999999998,"5min":7.0659999999999998,"15min":7.0659999999999998},"last":0.502},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.56100000000000005,"15min":0.52900000000000003},"min":{"1min":0.32500000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":7.0819999999999999,"5min":7.0819999999999999,"15min":7.0819999999999999},"last":0.42199999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.49399999999999999,"15min":0.49299999999999999},"min":{"1min":0.32600000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.52700000000000002,"15min":0.53600000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.72799999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.59099999999999997}]},{"osd":4,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.48699999999999999,"15min":0.50700000000000001},"min":{"1min":0.29599999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.64300000000000002,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54300000000000004,"15min":0.56799999999999995},"min":{"1min":0.32100000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.77100000000000002,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.65000000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52200000000000002,"15min":0.53800000000000003},"min":{"1min":0.307,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56299999999999994,"15min":0.58699999999999997},"min":{"1min":0.39500000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.79000000000000004,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.626}]},{"osd":7,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56200000000000006,"15min":0.57699999999999996},"min":{"1min":0.36899999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79500000000000004,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.58999999999999997,"15min":0.60699999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83899999999999997,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.63800000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310824,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061016,"statfs":{"total":96636764160,"available":96318480384,"internally_reserved":0,"allocated":1277952,"data_stored":888877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.33200000000000002,"15min":0.34200000000000003},"min":{"1min":0.24199999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.215,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.307}]},{"osd":2,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.34399999999999997,"15min":0.33600000000000002},"min":{"1min":0.23599999999999999,"5min":0.22,"15min":0.22},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.39600000000000002,"15min":0.38900000000000001},"min":{"1min":0.26500000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.35899999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.41399999999999998,"15min":0.41099999999999998},"min":{"1min":0.28299999999999997,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.68999999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.38100000000000001,"15min":0.36899999999999999},"min":{"1min":0.29799999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.33800000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.53000000000000003,"15min":0.50800000000000001},"min":{"1min":0.34399999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55800000000000005,"15min":0.54000000000000004},"min":{"1min":0.45300000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.503}]},{"osd":5,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55900000000000005,"15min":0.54900000000000004},"min":{"1min":0.38800000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.56299999999999994,"15min":0.54100000000000004},"min":{"1min":0.40000000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.52200000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57199999999999995,"15min":0.56200000000000006},"min":{"1min":0.36899999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.59199999999999997,"15min":0.57399999999999995},"min":{"1min":0.376,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.56399999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.59999999999999998,"15min":0.58999999999999997},"min":{"1min":0.48699999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84299999999999997,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.42899999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.45600000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574900,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302036,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069804,"statfs":{"total":96636764160,"available":96327479296,"internally_reserved":0,"allocated":667648,"data_stored":290548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32700000000000001,"15min":0.33300000000000002},"min":{"1min":0.223,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.503,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.34200000000000003,"15min":0.34100000000000003},"min":{"1min":0.246,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.32300000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.371,"15min":0.377},"min":{"1min":0.27400000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.435,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36099999999999999,"15min":0.36599999999999999},"min":{"1min":0.27200000000000002,"5min":0.219,"15min":0.219},"max":{"1min":0.46100000000000002,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.28399999999999997}]},{"osd":3,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.371,"15min":0.373},"min":{"1min":0.26500000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.437},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.432,"15min":0.438},"min":{"1min":0.33000000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.55700000000000005,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.30499999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.55900000000000005,"15min":0.56000000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.626,"5min":0.60799999999999998,"15min":0.61499999999999999},"min":{"1min":0.36199999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.83999999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.621}]},{"osd":5,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54700000000000004,"15min":0.55100000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67900000000000005,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.55100000000000005,"15min":0.54500000000000004},"min":{"1min":0.40000000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.52500000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60399999999999998,"15min":0.61199999999999999},"min":{"1min":0.432,"5min":0.375,"15min":0.375},"max":{"1min":0.84499999999999997,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60099999999999998,"15min":0.60499999999999998},"min":{"1min":0.42399999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.64000000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59799999999999998,"15min":0.60499999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.81299999999999994,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.42099999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.54600000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574901,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310228,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061612,"statfs":{"total":96636764160,"available":96319090688,"internally_reserved":0,"allocated":667648,"data_stored":290548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.309,"15min":0.309},"min":{"1min":0.22500000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.437,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38100000000000001,"15min":0.38500000000000001},"min":{"1min":0.26900000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.51400000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.35999999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36899999999999999,"15min":0.375},"min":{"1min":0.24399999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.35399999999999998,"15min":0.34799999999999998},"min":{"1min":0.26900000000000002,"5min":0.217,"15min":0.217},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.33900000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.37,"15min":0.373},"min":{"1min":0.27800000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.36499999999999999,"15min":0.36699999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.29099999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.33900000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.38900000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.60999999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.55200000000000005,"15min":0.55000000000000004},"min":{"1min":0.374,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.41799999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.64300000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58299999999999996,"15min":0.58399999999999996},"min":{"1min":0.43099999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41399999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.59099999999999997}]},{"osd":7,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.55900000000000005,"15min":0.55000000000000004},"min":{"1min":0.436,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.57099999999999995,"15min":0.56999999999999995},"min":{"1min":0.38600000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.60199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574901,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297940,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073900,"statfs":{"total":96636764160,"available":96331673600,"internally_reserved":0,"allocated":667648,"data_stored":290548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.315,"15min":0.32800000000000001},"min":{"1min":0.248,"5min":0.188,"15min":0.188},"max":{"1min":0.46500000000000002,"5min":1.095,"15min":1.095},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38900000000000001,"15min":0.40500000000000003},"min":{"1min":0.29999999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.50600000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.38200000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.314,"15min":0.309},"min":{"1min":0.255,"5min":0.219,"15min":0.219},"max":{"1min":0.47499999999999998,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.36699999999999999,"15min":0.373},"min":{"1min":0.26500000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.51500000000000001,"5min":1.196,"15min":1.196},"last":0.35999999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.38100000000000001,"15min":0.39400000000000002},"min":{"1min":0.24199999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.54500000000000004,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.42399999999999999},"min":{"1min":0.33700000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.55900000000000005,"5min":1.224,"15min":1.224},"last":0.32700000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.55700000000000005,"15min":0.57499999999999996},"min":{"1min":0.38200000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.92500000000000004,"5min":1.694,"15min":1.694},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53800000000000003,"15min":0.54500000000000004},"min":{"1min":0.36599999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.54500000000000004}]},{"osd":5,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.41599999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55700000000000005,"15min":0.56599999999999995},"min":{"1min":0.39200000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.82199999999999995,"5min":1.165,"15min":1.165},"last":0.49399999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58499999999999996,"15min":0.59499999999999997},"min":{"1min":0.40200000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.89900000000000002,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.59399999999999997,"15min":0.60499999999999998},"min":{"1min":0.45400000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83399999999999996,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.58199999999999996}]},{"osd":7,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58299999999999996,"15min":0.59699999999999998},"min":{"1min":0.40999999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84799999999999998,"5min":1.657,"15min":1.657},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.57099999999999995,"15min":0.57399999999999995},"min":{"1min":0.46700000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.47899999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297956,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073884,"statfs":{"total":96636764160,"available":96331657216,"internally_reserved":0,"allocated":684032,"data_stored":298509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.54800000000000004,"15min":0.60299999999999998},"min":{"1min":0.28899999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.74099999999999999,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48299999999999998,"15min":0.499},"min":{"1min":0.28599999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.64500000000000002,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.624}]},{"osd":1,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.57499999999999996,"15min":0.628},"min":{"1min":0.28799999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66100000000000003,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.57699999999999996,"15min":0.629},"min":{"1min":0.32900000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.74199999999999999,"5min":2.7610000000000001,"15min":2.7610000000000001},"last":0.64000000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.54200000000000004,"15min":0.58199999999999996},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.60399999999999998,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58999999999999997,"15min":0.61899999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.76500000000000001,"5min":1.718,"15min":1.718},"last":0.58299999999999996}]},{"osd":3,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.60199999999999998,"15min":0.64800000000000002},"min":{"1min":0.36799999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.67600000000000005,"5min":2.677,"15min":2.677},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.51100000000000001,"15min":0.52400000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.48399999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.47299999999999998,"15min":0.497},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.52300000000000002,"15min":0.54700000000000004},"min":{"1min":0.307,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.71999999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.54400000000000004}]},{"osd":6,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.51000000000000001,"15min":0.53400000000000003},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.56100000000000005,"15min":0.59499999999999997},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.86899999999999999,"5min":1.165,"15min":1.165},"last":0.50800000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.55900000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59099999999999997,"15min":0.61599999999999999},"min":{"1min":0.37,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.76700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310232,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061608,"statfs":{"total":96636764160,"available":96319086592,"internally_reserved":0,"allocated":671744,"data_stored":291901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.66600000000000004,"15min":0.72399999999999998},"min":{"1min":0.36199999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.71899999999999997,"5min":5.0490000000000004,"15min":5.0490000000000004},"last":0.439},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.627,"15min":0.69299999999999995},"min":{"1min":0.254,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.755,"5min":5.1449999999999996,"15min":5.1449999999999996},"last":0.35099999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48999999999999999,"15min":0.49199999999999999},"min":{"1min":0.315,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.70699999999999996,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.70699999999999996,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.49199999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.57999999999999996,"15min":0.56699999999999995},"min":{"1min":0.379,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.81799999999999995,"5min":4.234,"15min":4.234},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56899999999999995,"15min":0.57799999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76600000000000001,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.53900000000000003}]},{"osd":3,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.66700000000000004,"15min":0.74399999999999999},"min":{"1min":0.29299999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.72099999999999997,"5min":5.2169999999999996,"15min":5.2169999999999996},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55100000000000005,"15min":0.55500000000000005},"min":{"1min":0.39600000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.83399999999999996,"5min":1.008,"15min":1.008},"last":0.46999999999999997}]},{"osd":4,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.52900000000000003,"15min":0.53800000000000003},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.871,"5min":1.917,"15min":1.917},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.497,"5min":0.53800000000000003,"15min":0.55500000000000005},"min":{"1min":0.27200000000000002,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.85499999999999998,"5min":0.87,"15min":0.87},"last":0.58499999999999996}]},{"osd":6,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.34899999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.89500000000000002,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.624,"15min":0.63200000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.92300000000000004,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":0.59999999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58999999999999997,"15min":0.60899999999999999},"min":{"1min":0.32100000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.84299999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.63},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.621,"15min":0.63},"min":{"1min":0.372,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.93899999999999995,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.60999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:09:46.545 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:09:46.547 INFO:tasks.ceph.mds.b.smithi151.stderr:2023-10-06T11:09:46.510+0000 7f0c73900700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T11:09:46.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.659+0000 7f7d74ccf700 1 Processor -- start 2023-10-06T11:09:46.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.659+0000 7f7d74ccf700 1 -- start start 2023-10-06T11:09:46.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.660+0000 7f7d74ccf700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7d700b08d0 0x7f7d700c3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:46.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.660+0000 7f7d74ccf700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7d700cef00 0x7f7d700c3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:46.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.660+0000 7f7d74ccf700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d70068a90 con 0x7f7d700c4750 2023-10-06T11:09:46.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.660+0000 7f7d74ccf700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d70159fd0 con 0x7f7d700b08d0 2023-10-06T11:09:46.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.660+0000 7f7d74ccf700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d700cdcf0 con 0x7f7d700cef00 2023-10-06T11:09:46.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.660+0000 7f7d65d9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7d700c4750 0x7f7d70068f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35706/0 (socket says 172.21.15.146:35706) 2023-10-06T11:09:46.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.660+0000 7f7d65d9b700 1 -- 172.21.15.146:0/3303988611 learned_addr learned my addr 172.21.15.146:0/3303988611 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:46.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.661+0000 7f7d6dd9b700 1 -- 172.21.15.146:0/3303988611 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2453773110 0 0) 0x7f7d70068a90 con 0x7f7d700c4750 2023-10-06T11:09:46.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.661+0000 7f7d6dd9b700 1 -- 172.21.15.146:0/3303988611 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d5c003570 con 0x7f7d700c4750 2023-10-06T11:09:46.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.661+0000 7f7d6e59c700 1 --2- 172.21.15.146:0/3303988611 >> v2:172.21.15.151:3300/0 conn(0x7f7d700b08d0 0x7f7d700c3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:46.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.661+0000 7f7d6ed9d700 1 --2- 172.21.15.146:0/3303988611 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7d700cef00 0x7f7d700c3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:46.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.661+0000 7f7d6dd9b700 1 -- 172.21.15.146:0/3303988611 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1611419486 0 0) 0x7f7d5c003570 con 0x7f7d700c4750 2023-10-06T11:09:46.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.661+0000 7f7d6dd9b700 1 -- 172.21.15.146:0/3303988611 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7d700cef00 msgr2=0x7f7d700c3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:46.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.661+0000 7f7d6dd9b700 1 --2- 172.21.15.146:0/3303988611 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7d700cef00 0x7f7d700c3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:46.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.661+0000 7f7d6dd9b700 1 -- 172.21.15.146:0/3303988611 >> v2:172.21.15.151:3300/0 conn(0x7f7d700b08d0 msgr2=0x7f7d700c3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:46.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.661+0000 7f7d6dd9b700 1 --2- 172.21.15.146:0/3303988611 >> v2:172.21.15.151:3300/0 conn(0x7f7d700b08d0 0x7f7d700c3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:46.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.661+0000 7f7d6dd9b700 1 -- 172.21.15.146:0/3303988611 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d700cdfd0 con 0x7f7d700c4750 2023-10-06T11:09:46.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.661+0000 7f7d6dd9b700 1 -- 172.21.15.146:0/3303988611 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f7d58001470 con 0x7f7d700c4750 2023-10-06T11:09:46.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.661+0000 7f7d6dd9b700 1 -- 172.21.15.146:0/3303988611 >> v1:172.21.15.146:6789/0 conn(0x7f7d700c4750 legacy=0x7f7d70068f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:46.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.661+0000 7f7d6dd9b700 1 --2- 172.21.15.146:0/3303988611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d5c003a60 0x7f7d5c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:46.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.661+0000 7f7d6dd9b700 1 --2- 172.21.15.146:0/3303988611 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7d700cef00 0x7f7d5c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:46.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.661+0000 7f7d6dd9b700 1 --2- 172.21.15.146:0/3303988611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d5c004d50 0x7f7d5c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:46.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.661+0000 7f7d6dd9b700 1 -- 172.21.15.146:0/3303988611 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d70159fd0 con 0x7f7d5c004d50 2023-10-06T11:09:46.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.661+0000 7f7d6dd9b700 1 -- 172.21.15.146:0/3303988611 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d700cdcf0 con 0x7f7d5c003a60 2023-10-06T11:09:46.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.661+0000 7f7d6dd9b700 1 -- 172.21.15.146:0/3303988611 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c00ba60 con 0x7f7d700cef00 2023-10-06T11:09:46.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.661+0000 7f7d6ed9d700 1 --2- 172.21.15.146:0/3303988611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d5c004d50 0x7f7d5c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:46.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.661+0000 7f7d65d9b700 1 --2- 172.21.15.146:0/3303988611 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7d700cef00 0x7f7d5c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:46.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.661+0000 7f7d6e59c700 1 --2- 172.21.15.146:0/3303988611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d5c003a60 0x7f7d5c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:46.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.661+0000 7f7d6ed9d700 1 -- 172.21.15.146:0/3303988611 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7d700cef00 msgr2=0x7f7d5c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:46.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.661+0000 7f7d6ed9d700 1 --2- 172.21.15.146:0/3303988611 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7d700cef00 0x7f7d5c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:46.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.661+0000 7f7d6ed9d700 1 -- 172.21.15.146:0/3303988611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d5c003a60 msgr2=0x7f7d5c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:46.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.661+0000 7f7d6ed9d700 1 --2- 172.21.15.146:0/3303988611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d5c003a60 0x7f7d5c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:46.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.661+0000 7f7d6ed9d700 1 -- 172.21.15.146:0/3303988611 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d5c003570 con 0x7f7d5c004d50 2023-10-06T11:09:46.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.661+0000 7f7d6ed9d700 1 --2- 172.21.15.146:0/3303988611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d5c004d50 0x7f7d5c0051c0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f7d6800e210 tx=0x7f7d6800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bcc758ba94309d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:46.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.662+0000 7f7d6dd9b700 1 -- 172.21.15.146:0/3303988611 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6800ea60 con 0x7f7d5c004d50 2023-10-06T11:09:46.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.662+0000 7f7d6dd9b700 1 -- 172.21.15.146:0/3303988611 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6800f040 con 0x7f7d5c004d50 2023-10-06T11:09:46.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.662+0000 7f7d6dd9b700 1 -- 172.21.15.146:0/3303988611 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6800ee10 con 0x7f7d5c004d50 2023-10-06T11:09:46.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.662+0000 7f7d74ccf700 1 -- 172.21.15.146:0/3303988611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d5c004d50 msgr2=0x7f7d5c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:46.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.662+0000 7f7d74ccf700 1 --2- 172.21.15.146:0/3303988611 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d5c004d50 0x7f7d5c0051c0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f7d6800e210 tx=0x7f7d6800b040 comp rx=0 tx=0).stop 2023-10-06T11:09:46.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.662+0000 7f7d6ed9d700 1 -- 172.21.15.146:0/3303988611 reap_dead start 2023-10-06T11:09:46.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.662+0000 7f7d74ccf700 1 -- 172.21.15.146:0/3303988611 shutdown_connections 2023-10-06T11:09:46.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.662+0000 7f7d74ccf700 1 -- 172.21.15.146:0/3303988611 >> 172.21.15.146:0/3303988611 conn(0x7f7d70067c50 msgr2=0x7f7d700ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:46.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.662+0000 7f7d74ccf700 1 -- 172.21.15.146:0/3303988611 shutdown_connections 2023-10-06T11:09:46.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.662+0000 7f7d74ccf700 1 -- 172.21.15.146:0/3303988611 wait complete. 2023-10-06T11:09:46.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.663+0000 7f7d74ccf700 1 Processor -- start 2023-10-06T11:09:46.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.663+0000 7f7d74ccf700 1 -- start start 2023-10-06T11:09:46.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.664+0000 7f7d74ccf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d5c004d50 0x7f7d70157650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:46.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.664+0000 7f7d74ccf700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d700990d0 0x7f7d70099540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:46.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.664+0000 7f7d74ccf700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7d7006be40 0x7f7d7006c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:46.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.664+0000 7f7d74ccf700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d70157b90 con 0x7f7d5c004d50 2023-10-06T11:09:46.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.664+0000 7f7d74ccf700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7006c7f0 con 0x7f7d700990d0 2023-10-06T11:09:46.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.664+0000 7f7d74ccf700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7016ae10 con 0x7f7d7006be40 2023-10-06T11:09:46.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.664+0000 7f7d6e59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d5c004d50 0x7f7d70157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:46.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.664+0000 7f7d6e59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d5c004d50 0x7f7d70157650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40806/0 (socket says 172.21.15.146:40806) 2023-10-06T11:09:46.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.664+0000 7f7d6e59c700 1 -- 172.21.15.146:0/3560969719 learned_addr learned my addr 172.21.15.146:0/3560969719 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:46.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.664+0000 7f7d6e59c700 1 -- 172.21.15.146:0/3560969719 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7d7006be40 msgr2=0x7f7d7006c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:46.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.664+0000 7f7d65d9b700 1 --2- 172.21.15.146:0/3560969719 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d700990d0 0x7f7d70099540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:46.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.664+0000 7f7d6e59c700 1 --2- 172.21.15.146:0/3560969719 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7d7006be40 0x7f7d7006c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:46.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.664+0000 7f7d6e59c700 1 -- 172.21.15.146:0/3560969719 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d700990d0 msgr2=0x7f7d70099540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:46.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.664+0000 7f7d6e59c700 1 --2- 172.21.15.146:0/3560969719 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d700990d0 0x7f7d70099540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:46.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.665+0000 7f7d6e59c700 1 -- 172.21.15.146:0/3560969719 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7016a200 con 0x7f7d5c004d50 2023-10-06T11:09:46.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.665+0000 7f7d6e59c700 1 --2- 172.21.15.146:0/3560969719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d5c004d50 0x7f7d70157650 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f7d60011b40 tx=0x7f7d600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:46.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.665+0000 7f7d66ffd700 1 -- 172.21.15.146:0/3560969719 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6000fa10 con 0x7f7d5c004d50 2023-10-06T11:09:46.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.665+0000 7f7d66ffd700 1 -- 172.21.15.146:0/3560969719 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6000fb70 con 0x7f7d5c004d50 2023-10-06T11:09:46.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.665+0000 7f7d74ccf700 1 -- 172.21.15.146:0/3560969719 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d7016a4e0 con 0x7f7d5c004d50 2023-10-06T11:09:46.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.665+0000 7f7d66ffd700 1 -- 172.21.15.146:0/3560969719 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d60014440 con 0x7f7d5c004d50 2023-10-06T11:09:46.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.665+0000 7f7d74ccf700 1 -- 172.21.15.146:0/3560969719 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d7016aaa0 con 0x7f7d5c004d50 2023-10-06T11:09:46.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.666+0000 7f7d74ccf700 1 -- 172.21.15.146:0/3560969719 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d7004c380 con 0x7f7d5c004d50 2023-10-06T11:09:46.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.666+0000 7f7d66ffd700 1 -- 172.21.15.146:0/3560969719 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7d60014830 con 0x7f7d5c004d50 2023-10-06T11:09:46.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.666+0000 7f7d66ffd700 1 --2- 172.21.15.146:0/3560969719 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7d50066f30 0x7f7d500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:46.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.667+0000 7f7d66ffd700 1 -- 172.21.15.146:0/3560969719 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7d60018030 con 0x7f7d5c004d50 2023-10-06T11:09:46.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.667+0000 7f7d65d9b700 1 --2- 172.21.15.146:0/3560969719 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7d50066f30 0x7f7d500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:46.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.667+0000 7f7d65d9b700 1 --2- 172.21.15.146:0/3560969719 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7d50066f30 0x7f7d500693e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7d580079e0 tx=0x7f7d58009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:46.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.671+0000 7f7d66ffd700 1 -- 172.21.15.146:0/3560969719 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7d600521c0 con 0x7f7d5c004d50 2023-10-06T11:09:46.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.852+0000 7f7d74ccf700 1 -- 172.21.15.146:0/3560969719 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7d7016af50 con 0x7f7d50066f30 2023-10-06T11:09:46.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.860+0000 7f7d66ffd700 1 -- 172.21.15.146:0/3560969719 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309902 (secure 0 0 0) 0x7f7d580070b0 con 0x7f7d50066f30 2023-10-06T11:09:46.865 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:09:46.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.864+0000 7f7d74ccf700 1 -- 172.21.15.146:0/3560969719 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7d50066f30 msgr2=0x7f7d500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:46.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.864+0000 7f7d74ccf700 1 --2- 172.21.15.146:0/3560969719 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7d50066f30 0x7f7d500693e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7d580079e0 tx=0x7f7d58009040 comp rx=0 tx=0).stop 2023-10-06T11:09:46.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.864+0000 7f7d74ccf700 1 -- 172.21.15.146:0/3560969719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d5c004d50 msgr2=0x7f7d70157650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:46.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.864+0000 7f7d74ccf700 1 --2- 172.21.15.146:0/3560969719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d5c004d50 0x7f7d70157650 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f7d60011b40 tx=0x7f7d600091a0 comp rx=0 tx=0).stop 2023-10-06T11:09:46.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.864+0000 7f7d74ccf700 1 -- 172.21.15.146:0/3560969719 shutdown_connections 2023-10-06T11:09:46.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.864+0000 7f7d74ccf700 1 --2- 172.21.15.146:0/3560969719 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7d50066f30 0x7f7d500693e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:46.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.864+0000 7f7d74ccf700 1 --2- 172.21.15.146:0/3560969719 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7d7006be40 0x7f7d7006c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:46.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.864+0000 7f7d74ccf700 1 --2- 172.21.15.146:0/3560969719 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7d5c004d50 0x7f7d70157650 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:46.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.864+0000 7f7d74ccf700 1 --2- 172.21.15.146:0/3560969719 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d700990d0 0x7f7d70099540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:46.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.864+0000 7f7d74ccf700 1 -- 172.21.15.146:0/3560969719 >> 172.21.15.146:0/3560969719 conn(0x7f7d70067c50 msgr2=0x7f7d700c8ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:46.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.864+0000 7f7d74ccf700 1 -- 172.21.15.146:0/3560969719 shutdown_connections 2023-10-06T11:09:46.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:46.864+0000 7f7d74ccf700 1 -- 172.21.15.146:0/3560969719 wait complete. 2023-10-06T11:09:46.869 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:09:46.878 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2023-10-06T11:09:45.192065+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":46,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2437980,"kb_used_data":6428,"kb_used_omap":0,"kb_used_meta":2431488,"kb_avail":752536740,"statfs":{"total":773094113280,"available":770597621760,"internally_reserved":0,"allocated":6582272,"data_stored":3530356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2489843712},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.995402"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.232857+0000","last_change":"2023-10-06T11:09:42.232857+0000","last_active":"2023-10-06T11:09:42.232857+0000","last_peered":"2023-10-06T11:09:42.232857+0000","last_clean":"2023-10-06T11:09:42.232857+0000","last_became_active":"2023-10-06T11:09:42.232668+0000","last_became_peered":"2023-10-06T11:09:42.232668+0000","last_unstale":"2023-10-06T11:09:42.232857+0000","last_undegraded":"2023-10-06T11:09:42.232857+0000","last_fullsized":"2023-10-06T11:09:42.232857+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:05:31.432383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.235533+0000","last_change":"2023-10-06T11:09:42.235533+0000","last_active":"2023-10-06T11:09:42.235533+0000","last_peered":"2023-10-06T11:09:42.235533+0000","last_clean":"2023-10-06T11:09:42.235533+0000","last_became_active":"2023-10-06T11:09:42.235247+0000","last_became_peered":"2023-10-06T11:09:42.235247+0000","last_unstale":"2023-10-06T11:09:42.235533+0000","last_undegraded":"2023-10-06T11:09:42.235533+0000","last_fullsized":"2023-10-06T11:09:42.235533+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:04:57.888469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.206807+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:11:07.460296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.236341+0000","last_change":"2023-10-06T11:09:42.236341+0000","last_active":"2023-10-06T11:09:42.236341+0000","last_peered":"2023-10-06T11:09:42.236341+0000","last_clean":"2023-10-06T11:09:42.236341+0000","last_became_active":"2023-10-06T11:09:42.236063+0000","last_became_peered":"2023-10-06T11:09:42.236063+0000","last_unstale":"2023-10-06T11:09:42.236341+0000","last_undegraded":"2023-10-06T11:09:42.236341+0000","last_fullsized":"2023-10-06T11:09:42.236341+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:25.857721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.233776+0000","last_change":"2023-10-06T11:09:42.233776+0000","last_active":"2023-10-06T11:09:42.233776+0000","last_peered":"2023-10-06T11:09:42.233776+0000","last_clean":"2023-10-06T11:09:42.233776+0000","last_became_active":"2023-10-06T11:09:42.233510+0000","last_became_peered":"2023-10-06T11:09:42.233510+0000","last_unstale":"2023-10-06T11:09:42.233776+0000","last_undegraded":"2023-10-06T11:09:42.233776+0000","last_fullsized":"2023-10-06T11:09:42.233776+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:51:40.439269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.205594+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:52:24.958762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.207166+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:41:31.941213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.203856+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:04:57.888469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.206003+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:10:47.746855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.209210+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:28.755325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.232740+0000","last_change":"2023-10-06T11:09:42.232740+0000","last_active":"2023-10-06T11:09:42.232740+0000","last_peered":"2023-10-06T11:09:42.232740+0000","last_clean":"2023-10-06T11:09:42.232740+0000","last_became_active":"2023-10-06T11:09:42.230980+0000","last_became_peered":"2023-10-06T11:09:42.230980+0000","last_unstale":"2023-10-06T11:09:42.232740+0000","last_undegraded":"2023-10-06T11:09:42.232740+0000","last_fullsized":"2023-10-06T11:09:42.232740+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:53.894745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.201907+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:47:49.153165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.203023+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:52:18.608330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.206348+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:06:54.424848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.206937+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:06:18.955546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.207291+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:00:59.550068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.230670+0000","last_change":"2023-10-06T11:09:42.230670+0000","last_active":"2023-10-06T11:09:42.230670+0000","last_peered":"2023-10-06T11:09:42.230670+0000","last_clean":"2023-10-06T11:09:42.230670+0000","last_became_active":"2023-10-06T11:09:42.230448+0000","last_became_peered":"2023-10-06T11:09:42.230448+0000","last_unstale":"2023-10-06T11:09:42.230670+0000","last_undegraded":"2023-10-06T11:09:42.230670+0000","last_fullsized":"2023-10-06T11:09:42.230670+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:01:57.169564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.232284+0000","last_change":"2023-10-06T11:09:42.232284+0000","last_active":"2023-10-06T11:09:42.232284+0000","last_peered":"2023-10-06T11:09:42.232284+0000","last_clean":"2023-10-06T11:09:42.232284+0000","last_became_active":"2023-10-06T11:09:42.231990+0000","last_became_peered":"2023-10-06T11:09:42.231990+0000","last_unstale":"2023-10-06T11:09:42.232284+0000","last_undegraded":"2023-10-06T11:09:42.232284+0000","last_fullsized":"2023-10-06T11:09:42.232284+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:10:47.746855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.232237+0000","last_change":"2023-10-06T11:09:42.232237+0000","last_active":"2023-10-06T11:09:42.232237+0000","last_peered":"2023-10-06T11:09:42.232237+0000","last_clean":"2023-10-06T11:09:42.232237+0000","last_became_active":"2023-10-06T11:09:42.231280+0000","last_became_peered":"2023-10-06T11:09:42.231280+0000","last_unstale":"2023-10-06T11:09:42.232237+0000","last_undegraded":"2023-10-06T11:09:42.232237+0000","last_fullsized":"2023-10-06T11:09:42.232237+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:15.427811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.206576+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:08:15.143503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.202548+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:33:15.386582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.207015+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:01:52.167469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.205394+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:32:21.749142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.209443+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:51:53.450814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.203498+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:53.894745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.204222+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:05:31.432383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.231444+0000","last_change":"2023-10-06T11:09:42.231444+0000","last_active":"2023-10-06T11:09:42.231444+0000","last_peered":"2023-10-06T11:09:42.231444+0000","last_clean":"2023-10-06T11:09:42.231444+0000","last_became_active":"2023-10-06T11:09:42.230697+0000","last_became_peered":"2023-10-06T11:09:42.230697+0000","last_unstale":"2023-10-06T11:09:42.231444+0000","last_undegraded":"2023-10-06T11:09:42.231444+0000","last_fullsized":"2023-10-06T11:09:42.231444+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:05:31.432383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.238581+0000","last_change":"2023-10-06T11:09:42.238581+0000","last_active":"2023-10-06T11:09:42.238581+0000","last_peered":"2023-10-06T11:09:42.238581+0000","last_clean":"2023-10-06T11:09:42.238581+0000","last_became_active":"2023-10-06T11:09:42.238389+0000","last_became_peered":"2023-10-06T11:09:42.238389+0000","last_unstale":"2023-10-06T11:09:42.238581+0000","last_undegraded":"2023-10-06T11:09:42.238581+0000","last_fullsized":"2023-10-06T11:09:42.238581+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:13.716196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.207408+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:13:28.565091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.202867+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:01:57.169564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.230451+0000","last_change":"2023-10-06T11:09:42.230451+0000","last_active":"2023-10-06T11:09:42.230451+0000","last_peered":"2023-10-06T11:09:42.230451+0000","last_clean":"2023-10-06T11:09:42.230451+0000","last_became_active":"2023-10-06T11:09:42.230170+0000","last_became_peered":"2023-10-06T11:09:42.230170+0000","last_unstale":"2023-10-06T11:09:42.230451+0000","last_undegraded":"2023-10-06T11:09:42.230451+0000","last_fullsized":"2023-10-06T11:09:42.230451+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:07:11.162512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.205915+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:40:31.710840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.230224+0000","last_change":"2023-10-06T11:09:42.230224+0000","last_active":"2023-10-06T11:09:42.230224+0000","last_peered":"2023-10-06T11:09:42.230224+0000","last_clean":"2023-10-06T11:09:42.230224+0000","last_became_active":"2023-10-06T11:09:42.229962+0000","last_became_peered":"2023-10-06T11:09:42.229962+0000","last_unstale":"2023-10-06T11:09:42.230224+0000","last_undegraded":"2023-10-06T11:09:42.230224+0000","last_fullsized":"2023-10-06T11:09:42.230224+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:39:11.614060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.215964+0000","last_change":"2023-10-06T11:09:41.213260+0000","last_active":"2023-10-06T11:09:41.215964+0000","last_peered":"2023-10-06T11:09:41.215964+0000","last_clean":"2023-10-06T11:09:41.215964+0000","last_became_active":"2023-10-06T11:09:41.213069+0000","last_became_peered":"2023-10-06T11:09:41.213069+0000","last_unstale":"2023-10-06T11:09:41.215964+0000","last_undegraded":"2023-10-06T11:09:41.215964+0000","last_fullsized":"2023-10-06T11:09:41.215964+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:48:05.076777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.231249+0000","last_change":"2023-10-06T11:09:42.231249+0000","last_active":"2023-10-06T11:09:42.231249+0000","last_peered":"2023-10-06T11:09:42.231249+0000","last_clean":"2023-10-06T11:09:42.231249+0000","last_became_active":"2023-10-06T11:09:42.230418+0000","last_became_peered":"2023-10-06T11:09:42.230418+0000","last_unstale":"2023-10-06T11:09:42.231249+0000","last_undegraded":"2023-10-06T11:09:42.231249+0000","last_fullsized":"2023-10-06T11:09:42.231249+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:29:33.571825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.216511+0000","last_change":"2023-10-06T11:09:41.216511+0000","last_active":"2023-10-06T11:09:41.216511+0000","last_peered":"2023-10-06T11:09:41.216511+0000","last_clean":"2023-10-06T11:09:41.216511+0000","last_became_active":"2023-10-06T11:09:41.216244+0000","last_became_peered":"2023-10-06T11:09:41.216244+0000","last_unstale":"2023-10-06T11:09:41.216511+0000","last_undegraded":"2023-10-06T11:09:41.216511+0000","last_fullsized":"2023-10-06T11:09:41.216511+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:01:51.162810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.205914+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:20:43.051092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.213108+0000","last_change":"2023-10-06T11:09:41.213108+0000","last_active":"2023-10-06T11:09:41.213108+0000","last_peered":"2023-10-06T11:09:41.213108+0000","last_clean":"2023-10-06T11:09:41.213108+0000","last_became_active":"2023-10-06T11:09:41.212695+0000","last_became_peered":"2023-10-06T11:09:41.212695+0000","last_unstale":"2023-10-06T11:09:41.213108+0000","last_undegraded":"2023-10-06T11:09:41.213108+0000","last_fullsized":"2023-10-06T11:09:41.213108+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:32:20.744483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.204954+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:37:07.428678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.216502+0000","last_change":"2023-10-06T11:09:41.216502+0000","last_active":"2023-10-06T11:09:41.216502+0000","last_peered":"2023-10-06T11:09:41.216502+0000","last_clean":"2023-10-06T11:09:41.216502+0000","last_became_active":"2023-10-06T11:09:41.216217+0000","last_became_peered":"2023-10-06T11:09:41.216217+0000","last_unstale":"2023-10-06T11:09:41.216502+0000","last_undegraded":"2023-10-06T11:09:41.216502+0000","last_fullsized":"2023-10-06T11:09:41.216502+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:08:14.138844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.206842+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:48:27.535076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.218930+0000","last_change":"2023-10-06T11:09:41.218930+0000","last_active":"2023-10-06T11:09:41.218930+0000","last_peered":"2023-10-06T11:09:41.218930+0000","last_clean":"2023-10-06T11:09:41.218930+0000","last_became_active":"2023-10-06T11:09:41.218683+0000","last_became_peered":"2023-10-06T11:09:41.218683+0000","last_unstale":"2023-10-06T11:09:41.218930+0000","last_undegraded":"2023-10-06T11:09:41.218930+0000","last_fullsized":"2023-10-06T11:09:41.218930+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:13:27.560433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.232629+0000","last_change":"2023-10-06T11:09:42.232629+0000","last_active":"2023-10-06T11:09:42.232629+0000","last_peered":"2023-10-06T11:09:42.232629+0000","last_clean":"2023-10-06T11:09:42.232629+0000","last_became_active":"2023-10-06T11:09:42.232390+0000","last_became_peered":"2023-10-06T11:09:42.232390+0000","last_unstale":"2023-10-06T11:09:42.232629+0000","last_undegraded":"2023-10-06T11:09:42.232629+0000","last_fullsized":"2023-10-06T11:09:42.232629+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:40:23.620747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.208722+0000","last_change":"2023-10-06T11:09:41.208722+0000","last_active":"2023-10-06T11:09:41.208722+0000","last_peered":"2023-10-06T11:09:41.208722+0000","last_clean":"2023-10-06T11:09:41.208722+0000","last_became_active":"2023-10-06T11:09:41.208481+0000","last_became_peered":"2023-10-06T11:09:41.208481+0000","last_unstale":"2023-10-06T11:09:41.208722+0000","last_undegraded":"2023-10-06T11:09:41.208722+0000","last_fullsized":"2023-10-06T11:09:41.208722+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:06:53.420190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.227251+0000","last_change":"2023-10-06T11:09:42.227251+0000","last_active":"2023-10-06T11:09:42.227251+0000","last_peered":"2023-10-06T11:09:42.227251+0000","last_clean":"2023-10-06T11:09:42.227251+0000","last_became_active":"2023-10-06T11:09:42.226952+0000","last_became_peered":"2023-10-06T11:09:42.226952+0000","last_unstale":"2023-10-06T11:09:42.227251+0000","last_undegraded":"2023-10-06T11:09:42.227251+0000","last_fullsized":"2023-10-06T11:09:42.227251+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:59.957433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.218780+0000","last_change":"2023-10-06T11:09:41.218780+0000","last_active":"2023-10-06T11:09:41.218780+0000","last_peered":"2023-10-06T11:09:41.218780+0000","last_clean":"2023-10-06T11:09:41.218780+0000","last_became_active":"2023-10-06T11:09:41.218522+0000","last_became_peered":"2023-10-06T11:09:41.218522+0000","last_unstale":"2023-10-06T11:09:41.218780+0000","last_undegraded":"2023-10-06T11:09:41.218780+0000","last_fullsized":"2023-10-06T11:09:41.218780+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:25.585394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.205267+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:15.899968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.219309+0000","last_change":"2023-10-06T11:09:41.215714+0000","last_active":"2023-10-06T11:09:41.219309+0000","last_peered":"2023-10-06T11:09:41.219309+0000","last_clean":"2023-10-06T11:09:41.219309+0000","last_became_active":"2023-10-06T11:09:41.215430+0000","last_became_peered":"2023-10-06T11:09:41.215430+0000","last_unstale":"2023-10-06T11:09:41.219309+0000","last_undegraded":"2023-10-06T11:09:41.219309+0000","last_fullsized":"2023-10-06T11:09:41.219309+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:48:06.642258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.227904+0000","last_change":"2023-10-06T11:09:42.227904+0000","last_active":"2023-10-06T11:09:42.227904+0000","last_peered":"2023-10-06T11:09:42.227904+0000","last_clean":"2023-10-06T11:09:42.227904+0000","last_became_active":"2023-10-06T11:09:42.227654+0000","last_became_peered":"2023-10-06T11:09:42.227654+0000","last_unstale":"2023-10-06T11:09:42.227904+0000","last_undegraded":"2023-10-06T11:09:42.227904+0000","last_fullsized":"2023-10-06T11:09:42.227904+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:53.894745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.217448+0000","last_change":"2023-10-06T11:09:41.217448+0000","last_active":"2023-10-06T11:09:41.217448+0000","last_peered":"2023-10-06T11:09:41.217448+0000","last_clean":"2023-10-06T11:09:41.217448+0000","last_became_active":"2023-10-06T11:09:41.217135+0000","last_became_peered":"2023-10-06T11:09:41.217135+0000","last_unstale":"2023-10-06T11:09:41.217448+0000","last_undegraded":"2023-10-06T11:09:41.217448+0000","last_fullsized":"2023-10-06T11:09:41.217448+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:40:22.616089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.205645+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:22:01.027500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.214378+0000","last_change":"2023-10-06T11:09:41.212720+0000","last_active":"2023-10-06T11:09:41.214378+0000","last_peered":"2023-10-06T11:09:41.214378+0000","last_clean":"2023-10-06T11:09:41.214378+0000","last_became_active":"2023-10-06T11:09:41.212468+0000","last_became_peered":"2023-10-06T11:09:41.212468+0000","last_unstale":"2023-10-06T11:09:41.214378+0000","last_undegraded":"2023-10-06T11:09:41.214378+0000","last_fullsized":"2023-10-06T11:09:41.214378+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:57.202092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.231969+0000","last_change":"2023-10-06T11:09:42.231969+0000","last_active":"2023-10-06T11:09:42.231969+0000","last_peered":"2023-10-06T11:09:42.231969+0000","last_clean":"2023-10-06T11:09:42.231969+0000","last_became_active":"2023-10-06T11:09:42.231685+0000","last_became_peered":"2023-10-06T11:09:42.231685+0000","last_unstale":"2023-10-06T11:09:42.231969+0000","last_undegraded":"2023-10-06T11:09:42.231969+0000","last_fullsized":"2023-10-06T11:09:42.231969+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:58.206751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.217623+0000","last_change":"2023-10-06T11:09:41.217623+0000","last_active":"2023-10-06T11:09:41.217623+0000","last_peered":"2023-10-06T11:09:41.217623+0000","last_clean":"2023-10-06T11:09:41.217623+0000","last_became_active":"2023-10-06T11:09:41.216779+0000","last_became_peered":"2023-10-06T11:09:41.216779+0000","last_unstale":"2023-10-06T11:09:41.217623+0000","last_undegraded":"2023-10-06T11:09:41.217623+0000","last_fullsized":"2023-10-06T11:09:41.217623+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:12.711537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.257176+0000","last_change":"2023-10-06T11:09:42.257176+0000","last_active":"2023-10-06T11:09:42.257176+0000","last_peered":"2023-10-06T11:09:42.257176+0000","last_clean":"2023-10-06T11:09:42.257176+0000","last_became_active":"2023-10-06T11:09:42.256930+0000","last_became_peered":"2023-10-06T11:09:42.256930+0000","last_unstale":"2023-10-06T11:09:42.257176+0000","last_undegraded":"2023-10-06T11:09:42.257176+0000","last_fullsized":"2023-10-06T11:09:42.257176+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:52:18.608330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.216096+0000","last_change":"2023-10-06T11:09:41.213317+0000","last_active":"2023-10-06T11:09:41.216096+0000","last_peered":"2023-10-06T11:09:41.216096+0000","last_clean":"2023-10-06T11:09:41.216096+0000","last_became_active":"2023-10-06T11:09:41.212888+0000","last_became_peered":"2023-10-06T11:09:41.212888+0000","last_unstale":"2023-10-06T11:09:41.216096+0000","last_undegraded":"2023-10-06T11:09:41.216096+0000","last_fullsized":"2023-10-06T11:09:41.216096+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:14.423152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.235268+0000","last_change":"2023-10-06T11:09:42.235268+0000","last_active":"2023-10-06T11:09:42.235268+0000","last_peered":"2023-10-06T11:09:42.235268+0000","last_clean":"2023-10-06T11:09:42.235268+0000","last_became_active":"2023-10-06T11:09:42.234996+0000","last_became_peered":"2023-10-06T11:09:42.234996+0000","last_unstale":"2023-10-06T11:09:42.235268+0000","last_undegraded":"2023-10-06T11:09:42.235268+0000","last_fullsized":"2023-10-06T11:09:42.235268+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:39:06.623968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.216177+0000","last_change":"2023-10-06T11:09:41.216177+0000","last_active":"2023-10-06T11:09:41.216177+0000","last_peered":"2023-10-06T11:09:41.216177+0000","last_clean":"2023-10-06T11:09:41.216177+0000","last_became_active":"2023-10-06T11:09:41.215915+0000","last_became_peered":"2023-10-06T11:09:41.215915+0000","last_unstale":"2023-10-06T11:09:41.216177+0000","last_undegraded":"2023-10-06T11:09:41.216177+0000","last_fullsized":"2023-10-06T11:09:41.216177+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:05:30.427724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.202455+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:59:20.350433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.217104+0000","last_change":"2023-10-06T11:09:41.217104+0000","last_active":"2023-10-06T11:09:41.217104+0000","last_peered":"2023-10-06T11:09:41.217104+0000","last_clean":"2023-10-06T11:09:41.217104+0000","last_became_active":"2023-10-06T11:09:41.216693+0000","last_became_peered":"2023-10-06T11:09:41.216693+0000","last_unstale":"2023-10-06T11:09:41.217104+0000","last_undegraded":"2023-10-06T11:09:41.217104+0000","last_fullsized":"2023-10-06T11:09:41.217104+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:30.756704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.230985+0000","last_change":"2023-10-06T11:09:42.230985+0000","last_active":"2023-10-06T11:09:42.230985+0000","last_peered":"2023-10-06T11:09:42.230985+0000","last_clean":"2023-10-06T11:09:42.230985+0000","last_became_active":"2023-10-06T11:09:42.230741+0000","last_became_peered":"2023-10-06T11:09:42.230741+0000","last_unstale":"2023-10-06T11:09:42.230985+0000","last_undegraded":"2023-10-06T11:09:42.230985+0000","last_fullsized":"2023-10-06T11:09:42.230985+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:04:41.583424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.217240+0000","last_change":"2023-10-06T11:09:41.217240+0000","last_active":"2023-10-06T11:09:41.217240+0000","last_peered":"2023-10-06T11:09:41.217240+0000","last_clean":"2023-10-06T11:09:41.217240+0000","last_became_active":"2023-10-06T11:09:41.216980+0000","last_became_peered":"2023-10-06T11:09:41.216980+0000","last_unstale":"2023-10-06T11:09:41.217240+0000","last_undegraded":"2023-10-06T11:09:41.217240+0000","last_fullsized":"2023-10-06T11:09:41.217240+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:07:10.157853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.234850+0000","last_change":"2023-10-06T11:09:42.234850+0000","last_active":"2023-10-06T11:09:42.234850+0000","last_peered":"2023-10-06T11:09:42.234850+0000","last_clean":"2023-10-06T11:09:42.234850+0000","last_became_active":"2023-10-06T11:09:42.234572+0000","last_became_peered":"2023-10-06T11:09:42.234572+0000","last_unstale":"2023-10-06T11:09:42.234850+0000","last_undegraded":"2023-10-06T11:09:42.234850+0000","last_fullsized":"2023-10-06T11:09:42.234850+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:25.857721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.214988+0000","last_change":"2023-10-06T11:09:41.213789+0000","last_active":"2023-10-06T11:09:41.214988+0000","last_peered":"2023-10-06T11:09:41.214988+0000","last_clean":"2023-10-06T11:09:41.214988+0000","last_became_active":"2023-10-06T11:09:41.213505+0000","last_became_peered":"2023-10-06T11:09:41.213505+0000","last_unstale":"2023-10-06T11:09:41.214988+0000","last_undegraded":"2023-10-06T11:09:41.214988+0000","last_fullsized":"2023-10-06T11:09:41.214988+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:14.423152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.204665+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:57:54.298243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.213087+0000","last_change":"2023-10-06T11:09:41.213087+0000","last_active":"2023-10-06T11:09:41.213087+0000","last_peered":"2023-10-06T11:09:41.213087+0000","last_clean":"2023-10-06T11:09:41.213087+0000","last_became_active":"2023-10-06T11:09:41.212812+0000","last_became_peered":"2023-10-06T11:09:41.212812+0000","last_unstale":"2023-10-06T11:09:41.213087+0000","last_undegraded":"2023-10-06T11:09:41.213087+0000","last_fullsized":"2023-10-06T11:09:41.213087+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:14.423152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.206785+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:13:19.786801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.211660+0000","last_change":"2023-10-06T11:09:41.211660+0000","last_active":"2023-10-06T11:09:41.211660+0000","last_peered":"2023-10-06T11:09:41.211660+0000","last_clean":"2023-10-06T11:09:41.211660+0000","last_became_active":"2023-10-06T11:09:41.209522+0000","last_became_peered":"2023-10-06T11:09:41.209522+0000","last_unstale":"2023-10-06T11:09:41.211660+0000","last_undegraded":"2023-10-06T11:09:41.211660+0000","last_fullsized":"2023-10-06T11:09:41.211660+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:29.500970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.203481+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:40:23.620747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.212942+0000","last_change":"2023-10-06T11:09:41.212942+0000","last_active":"2023-10-06T11:09:41.212942+0000","last_peered":"2023-10-06T11:09:41.212942+0000","last_clean":"2023-10-06T11:09:41.212942+0000","last_became_active":"2023-10-06T11:09:41.212251+0000","last_became_peered":"2023-10-06T11:09:41.212251+0000","last_unstale":"2023-10-06T11:09:41.212942+0000","last_undegraded":"2023-10-06T11:09:41.212942+0000","last_fullsized":"2023-10-06T11:09:41.212942+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:14.895309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.257270+0000","last_change":"2023-10-06T11:09:42.257270+0000","last_active":"2023-10-06T11:09:42.257270+0000","last_peered":"2023-10-06T11:09:42.257270+0000","last_clean":"2023-10-06T11:09:42.257270+0000","last_became_active":"2023-10-06T11:09:42.256903+0000","last_became_peered":"2023-10-06T11:09:42.256903+0000","last_unstale":"2023-10-06T11:09:42.257270+0000","last_undegraded":"2023-10-06T11:09:42.257270+0000","last_fullsized":"2023-10-06T11:09:42.257270+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:30.505629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.216079+0000","last_change":"2023-10-06T11:09:41.213157+0000","last_active":"2023-10-06T11:09:41.216079+0000","last_peered":"2023-10-06T11:09:41.216079+0000","last_clean":"2023-10-06T11:09:41.216079+0000","last_became_active":"2023-10-06T11:09:41.212578+0000","last_became_peered":"2023-10-06T11:09:41.212578+0000","last_unstale":"2023-10-06T11:09:41.216079+0000","last_undegraded":"2023-10-06T11:09:41.216079+0000","last_fullsized":"2023-10-06T11:09:41.216079+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:55:58.933120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.232043+0000","last_change":"2023-10-06T11:09:42.232043+0000","last_active":"2023-10-06T11:09:42.232043+0000","last_peered":"2023-10-06T11:09:42.232043+0000","last_clean":"2023-10-06T11:09:42.232043+0000","last_became_active":"2023-10-06T11:09:42.231775+0000","last_became_peered":"2023-10-06T11:09:42.231775+0000","last_unstale":"2023-10-06T11:09:42.232043+0000","last_undegraded":"2023-10-06T11:09:42.232043+0000","last_fullsized":"2023-10-06T11:09:42.232043+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:05:12.404425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.218001+0000","last_change":"2023-10-06T11:09:41.218001+0000","last_active":"2023-10-06T11:09:41.218001+0000","last_peered":"2023-10-06T11:09:41.218001+0000","last_clean":"2023-10-06T11:09:41.218001+0000","last_became_active":"2023-10-06T11:09:41.217073+0000","last_became_peered":"2023-10-06T11:09:41.217073+0000","last_unstale":"2023-10-06T11:09:41.218001+0000","last_undegraded":"2023-10-06T11:09:41.218001+0000","last_fullsized":"2023-10-06T11:09:41.218001+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:29:32.567167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.236348+0000","last_change":"2023-10-06T11:09:42.236348+0000","last_active":"2023-10-06T11:09:42.236348+0000","last_peered":"2023-10-06T11:09:42.236348+0000","last_clean":"2023-10-06T11:09:42.236348+0000","last_became_active":"2023-10-06T11:09:42.236035+0000","last_became_peered":"2023-10-06T11:09:42.236035+0000","last_unstale":"2023-10-06T11:09:42.236348+0000","last_undegraded":"2023-10-06T11:09:42.236348+0000","last_fullsized":"2023-10-06T11:09:42.236348+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:37:07.428678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.211301+0000","last_change":"2023-10-06T11:09:41.211301+0000","last_active":"2023-10-06T11:09:41.211301+0000","last_peered":"2023-10-06T11:09:41.211301+0000","last_clean":"2023-10-06T11:09:41.211301+0000","last_became_active":"2023-10-06T11:09:41.211014+0000","last_became_peered":"2023-10-06T11:09:41.211014+0000","last_unstale":"2023-10-06T11:09:41.211301+0000","last_undegraded":"2023-10-06T11:09:41.211301+0000","last_fullsized":"2023-10-06T11:09:41.211301+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:51:52.446155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.230829+0000","last_change":"2023-10-06T11:09:42.230829+0000","last_active":"2023-10-06T11:09:42.230829+0000","last_peered":"2023-10-06T11:09:42.230829+0000","last_clean":"2023-10-06T11:09:42.230829+0000","last_became_active":"2023-10-06T11:09:42.230511+0000","last_became_peered":"2023-10-06T11:09:42.230511+0000","last_unstale":"2023-10-06T11:09:42.230829+0000","last_undegraded":"2023-10-06T11:09:42.230829+0000","last_fullsized":"2023-10-06T11:09:42.230829+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:52:18.608330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.218854+0000","last_change":"2023-10-06T11:09:41.218854+0000","last_active":"2023-10-06T11:09:41.218854+0000","last_peered":"2023-10-06T11:09:41.218854+0000","last_clean":"2023-10-06T11:09:41.218854+0000","last_became_active":"2023-10-06T11:09:41.218572+0000","last_became_peered":"2023-10-06T11:09:41.218572+0000","last_unstale":"2023-10-06T11:09:41.218854+0000","last_undegraded":"2023-10-06T11:09:41.218854+0000","last_fullsized":"2023-10-06T11:09:41.218854+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:06:06.843348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.206441+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:30:41.551826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.217159+0000","last_change":"2023-10-06T11:09:41.214668+0000","last_active":"2023-10-06T11:09:41.217159+0000","last_peered":"2023-10-06T11:09:41.217159+0000","last_clean":"2023-10-06T11:09:41.217159+0000","last_became_active":"2023-10-06T11:09:41.214427+0000","last_became_peered":"2023-10-06T11:09:41.214427+0000","last_unstale":"2023-10-06T11:09:41.217159+0000","last_undegraded":"2023-10-06T11:09:41.217159+0000","last_fullsized":"2023-10-06T11:09:41.217159+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:08:49.990834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.228930+0000","last_change":"2023-10-06T11:09:42.228930+0000","last_active":"2023-10-06T11:09:42.228930+0000","last_peered":"2023-10-06T11:09:42.228930+0000","last_clean":"2023-10-06T11:09:42.228930+0000","last_became_active":"2023-10-06T11:09:42.228558+0000","last_became_peered":"2023-10-06T11:09:42.228558+0000","last_unstale":"2023-10-06T11:09:42.228930+0000","last_undegraded":"2023-10-06T11:09:42.228930+0000","last_fullsized":"2023-10-06T11:09:42.228930+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:13.716196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.218292+0000","last_change":"2023-10-06T11:09:41.218292+0000","last_active":"2023-10-06T11:09:41.218292+0000","last_peered":"2023-10-06T11:09:41.218292+0000","last_clean":"2023-10-06T11:09:41.218292+0000","last_became_active":"2023-10-06T11:09:41.217963+0000","last_became_peered":"2023-10-06T11:09:41.217963+0000","last_unstale":"2023-10-06T11:09:41.218292+0000","last_undegraded":"2023-10-06T11:09:41.218292+0000","last_fullsized":"2023-10-06T11:09:41.218292+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:52.890087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":47,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.205019+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:09:41.205019+0000","last_peered":"2023-10-06T11:09:41.205019+0000","last_clean":"2023-10-06T11:09:41.205019+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:09:41.205019+0000","last_undegraded":"2023-10-06T11:09:41.205019+0000","last_fullsized":"2023-10-06T11:09:41.205019+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.257731+0000","last_change":"2023-10-06T11:09:42.257731+0000","last_active":"2023-10-06T11:09:42.257731+0000","last_peered":"2023-10-06T11:09:42.257731+0000","last_clean":"2023-10-06T11:09:42.257731+0000","last_became_active":"2023-10-06T11:09:42.257516+0000","last_became_peered":"2023-10-06T11:09:42.257516+0000","last_unstale":"2023-10-06T11:09:42.257731+0000","last_undegraded":"2023-10-06T11:09:42.257731+0000","last_fullsized":"2023-10-06T11:09:42.257731+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:31.761363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.213322+0000","last_change":"2023-10-06T11:09:41.213322+0000","last_active":"2023-10-06T11:09:41.213322+0000","last_peered":"2023-10-06T11:09:41.213322+0000","last_clean":"2023-10-06T11:09:41.213322+0000","last_became_active":"2023-10-06T11:09:41.213046+0000","last_became_peered":"2023-10-06T11:09:41.213046+0000","last_unstale":"2023-10-06T11:09:41.213322+0000","last_undegraded":"2023-10-06T11:09:41.213322+0000","last_fullsized":"2023-10-06T11:09:41.213322+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:27.750667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":46,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:09:40.204482+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:09:40.204482+0000","last_peered":"2023-10-06T11:09:40.204482+0000","last_clean":"2023-10-06T11:09:40.204482+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:09:40.204482+0000","last_undegraded":"2023-10-06T11:09:40.204482+0000","last_fullsized":"2023-10-06T11:09:40.204482+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.204968+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:26.358337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.215573+0000","last_change":"2023-10-06T11:09:41.215573+0000","last_active":"2023-10-06T11:09:41.215573+0000","last_peered":"2023-10-06T11:09:41.215573+0000","last_clean":"2023-10-06T11:09:41.215573+0000","last_became_active":"2023-10-06T11:09:41.215351+0000","last_became_peered":"2023-10-06T11:09:41.215351+0000","last_unstale":"2023-10-06T11:09:41.215573+0000","last_undegraded":"2023-10-06T11:09:41.215573+0000","last_fullsized":"2023-10-06T11:09:41.215573+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:53:09.457192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":44,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.199334+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:09:41.199334+0000","last_peered":"2023-10-06T11:09:41.199334+0000","last_clean":"2023-10-06T11:09:41.199334+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:09:41.199334+0000","last_undegraded":"2023-10-06T11:09:41.199334+0000","last_fullsized":"2023-10-06T11:09:41.199334+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":191,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:09:40.202973+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:09:40.202973+0000","last_peered":"2023-10-06T11:09:40.202973+0000","last_clean":"2023-10-06T11:09:40.202973+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:09:40.202973+0000","last_undegraded":"2023-10-06T11:09:40.202973+0000","last_fullsized":"2023-10-06T11:09:40.202973+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.201858+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:39:11.614060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.216944+0000","last_change":"2023-10-06T11:09:41.216944+0000","last_active":"2023-10-06T11:09:41.216944+0000","last_peered":"2023-10-06T11:09:41.216944+0000","last_clean":"2023-10-06T11:09:41.216944+0000","last_became_active":"2023-10-06T11:09:41.216394+0000","last_became_peered":"2023-10-06T11:09:41.216394+0000","last_unstale":"2023-10-06T11:09:41.216944+0000","last_undegraded":"2023-10-06T11:09:41.216944+0000","last_fullsized":"2023-10-06T11:09:41.216944+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:57.202092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":41,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:09:40.202973+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:09:40.202973+0000","last_peered":"2023-10-06T11:09:40.202973+0000","last_clean":"2023-10-06T11:09:40.202973+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:09:40.202973+0000","last_undegraded":"2023-10-06T11:09:40.202973+0000","last_fullsized":"2023-10-06T11:09:40.202973+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.228539+0000","last_change":"2023-10-06T11:09:42.228539+0000","last_active":"2023-10-06T11:09:42.228539+0000","last_peered":"2023-10-06T11:09:42.228539+0000","last_clean":"2023-10-06T11:09:42.228539+0000","last_became_active":"2023-10-06T11:09:42.228200+0000","last_became_peered":"2023-10-06T11:09:42.228200+0000","last_unstale":"2023-10-06T11:09:42.228539+0000","last_undegraded":"2023-10-06T11:09:42.228539+0000","last_fullsized":"2023-10-06T11:09:42.228539+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:47:49.153165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.219234+0000","last_change":"2023-10-06T11:09:41.219234+0000","last_active":"2023-10-06T11:09:41.219234+0000","last_peered":"2023-10-06T11:09:41.219234+0000","last_clean":"2023-10-06T11:09:41.219234+0000","last_became_active":"2023-10-06T11:09:41.218988+0000","last_became_peered":"2023-10-06T11:09:41.218988+0000","last_unstale":"2023-10-06T11:09:41.219234+0000","last_undegraded":"2023-10-06T11:09:41.219234+0000","last_fullsized":"2023-10-06T11:09:41.219234+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:06:17.950887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":41,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:09:40.202753+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:09:40.202753+0000","last_peered":"2023-10-06T11:09:40.202753+0000","last_clean":"2023-10-06T11:09:40.202753+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:09:40.202753+0000","last_undegraded":"2023-10-06T11:09:40.202753+0000","last_fullsized":"2023-10-06T11:09:40.202753+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.226066+0000","last_change":"2023-10-06T11:09:42.226066+0000","last_active":"2023-10-06T11:09:42.226066+0000","last_peered":"2023-10-06T11:09:42.226066+0000","last_clean":"2023-10-06T11:09:42.226066+0000","last_became_active":"2023-10-06T11:09:42.225791+0000","last_became_peered":"2023-10-06T11:09:42.225791+0000","last_unstale":"2023-10-06T11:09:42.226066+0000","last_undegraded":"2023-10-06T11:09:42.226066+0000","last_fullsized":"2023-10-06T11:09:42.226066+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:08:50.995493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.214421+0000","last_change":"2023-10-06T11:09:41.214421+0000","last_active":"2023-10-06T11:09:41.214421+0000","last_peered":"2023-10-06T11:09:41.214421+0000","last_clean":"2023-10-06T11:09:41.214421+0000","last_became_active":"2023-10-06T11:09:41.214113+0000","last_became_peered":"2023-10-06T11:09:41.214113+0000","last_unstale":"2023-10-06T11:09:41.214421+0000","last_undegraded":"2023-10-06T11:09:41.214421+0000","last_fullsized":"2023-10-06T11:09:41.214421+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:22:00.022841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":49,"reported_epoch":56,"state":"active+clean","last_fresh":"2023-10-06T11:09:40.200831+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:09:40.200831+0000","last_peered":"2023-10-06T11:09:40.200831+0000","last_clean":"2023-10-06T11:09:40.200831+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:09:40.200831+0000","last_undegraded":"2023-10-06T11:09:40.200831+0000","last_fullsized":"2023-10-06T11:09:40.200831+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.234133+0000","last_change":"2023-10-06T11:09:42.234133+0000","last_active":"2023-10-06T11:09:42.234133+0000","last_peered":"2023-10-06T11:09:42.234133+0000","last_clean":"2023-10-06T11:09:42.234133+0000","last_became_active":"2023-10-06T11:09:42.233860+0000","last_became_peered":"2023-10-06T11:09:42.233860+0000","last_unstale":"2023-10-06T11:09:42.234133+0000","last_undegraded":"2023-10-06T11:09:42.234133+0000","last_fullsized":"2023-10-06T11:09:42.234133+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:55:59.937779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.215052+0000","last_change":"2023-10-06T11:09:41.215052+0000","last_active":"2023-10-06T11:09:41.215052+0000","last_peered":"2023-10-06T11:09:41.215052+0000","last_clean":"2023-10-06T11:09:41.215052+0000","last_became_active":"2023-10-06T11:09:41.214778+0000","last_became_peered":"2023-10-06T11:09:41.214778+0000","last_unstale":"2023-10-06T11:09:41.215052+0000","last_undegraded":"2023-10-06T11:09:41.215052+0000","last_fullsized":"2023-10-06T11:09:41.215052+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:24.853062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":46,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.208694+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:09:41.208694+0000","last_peered":"2023-10-06T11:09:41.208694+0000","last_clean":"2023-10-06T11:09:41.208694+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:09:41.208694+0000","last_undegraded":"2023-10-06T11:09:41.208694+0000","last_fullsized":"2023-10-06T11:09:41.208694+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:09:41.195713+0000","last_change":"2023-10-06T11:09:41.207874+0000","last_active":"2023-10-06T11:09:41.195713+0000","last_peered":"2023-10-06T11:09:41.195713+0000","last_clean":"2023-10-06T11:09:41.195713+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:09:41.195713+0000","last_undegraded":"2023-10-06T11:09:41.195713+0000","last_fullsized":"2023-10-06T11:09:41.195713+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:06:07.848007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":8,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.218783+0000","last_change":"2023-10-06T11:09:41.218783+0000","last_active":"2023-10-06T11:09:41.218783+0000","last_peered":"2023-10-06T11:09:41.218783+0000","last_clean":"2023-10-06T11:09:41.218783+0000","last_became_active":"2023-10-06T11:09:41.216107+0000","last_became_peered":"2023-10-06T11:09:41.216107+0000","last_unstale":"2023-10-06T11:09:41.218783+0000","last_undegraded":"2023-10-06T11:09:41.218783+0000","last_fullsized":"2023-10-06T11:09:41.218783+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:58.952774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":46,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.207562+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:09:41.207562+0000","last_peered":"2023-10-06T11:09:41.207562+0000","last_clean":"2023-10-06T11:09:41.207562+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:09:41.207562+0000","last_undegraded":"2023-10-06T11:09:41.207562+0000","last_fullsized":"2023-10-06T11:09:41.207562+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574900,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298524,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073316,"statfs":{"total":96636764160,"available":96331075584,"internally_reserved":0,"allocated":1265664,"data_stored":882269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":1.871,"5min":0.73999999999999999,"15min":0.56999999999999995},"min":{"1min":0.41199999999999998,"5min":0.248,"15min":0.248},"max":{"1min":23.908999999999999,"5min":23.908999999999999,"15min":23.908999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":1.127,"5min":0.629,"15min":0.56499999999999995},"min":{"1min":0.374,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":9.0600000000000005,"5min":9.0600000000000005,"15min":9.0600000000000005},"last":0.55200000000000005}]},{"osd":1,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":0.63900000000000001,"15min":0.57099999999999995},"min":{"1min":0.40899999999999997,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":9.2360000000000007,"5min":9.2360000000000007,"15min":9.2360000000000007},"last":0.62},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.53900000000000003,"15min":0.51600000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":4.327,"5min":4.327,"15min":4.327},"last":0.57799999999999996}]},{"osd":2,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.504,"15min":0.50900000000000001},"min":{"1min":0.311,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.59599999999999997,"15min":0.55800000000000005},"min":{"1min":0.436,"5min":0.309,"15min":0.309},"max":{"1min":4.7309999999999999,"5min":4.7309999999999999,"15min":4.7309999999999999},"last":0.51300000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.55400000000000005,"15min":0.51400000000000001},"min":{"1min":0.35299999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":4.3540000000000001,"5min":4.3540000000000001,"15min":4.3540000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":1.1870000000000001,"5min":0.67300000000000004,"15min":0.59999999999999998},"min":{"1min":0.45300000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":9.3879999999999999,"5min":9.3879999999999999,"15min":9.3879999999999999},"last":0.58999999999999997}]},{"osd":4,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.50800000000000001,"15min":0.47499999999999998},"min":{"1min":0.34100000000000003,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":4.5709999999999997,"5min":4.5709999999999997,"15min":4.5709999999999997},"last":0.498},{"interface":"front","average":{"1min":0.753,"5min":0.55800000000000005,"15min":0.53500000000000003},"min":{"1min":0.33100000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":4.3129999999999997,"5min":4.3129999999999997,"15min":4.3129999999999997},"last":0.41199999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":0.64100000000000001,"15min":0.58099999999999996},"min":{"1min":0.34200000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":9.3499999999999996,"5min":9.3499999999999996,"15min":9.3499999999999996},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.58299999999999996,"15min":0.56699999999999995},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":4.444,"5min":4.444,"15min":4.444},"last":0.54000000000000004}]},{"osd":6,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":0.67300000000000004,"15min":0.622},"min":{"1min":0.39700000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":9.4969999999999999,"5min":9.4969999999999999,"15min":9.4969999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.66200000000000003,"15min":0.62},"min":{"1min":0.44800000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":7.2039999999999997,"5min":7.2039999999999997,"15min":7.2039999999999997},"last":0.60499999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310240,"kb_used_data":664,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061600,"statfs":{"total":96636764160,"available":96319078400,"internally_reserved":0,"allocated":679936,"data_stored":297156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.48199999999999998,"15min":0.497},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52100000000000002,"15min":0.53300000000000003},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.60599999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.48299999999999998,"15min":0.499},"min":{"1min":0.34100000000000003,"5min":0.253,"15min":0.253},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48499999999999999,"15min":0.499},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.76400000000000001,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.47899999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.53100000000000003,"15min":0.498},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":7.0659999999999998,"5min":7.0659999999999998,"15min":7.0659999999999998},"last":0.502},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.56100000000000005,"15min":0.52900000000000003},"min":{"1min":0.32500000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":7.0819999999999999,"5min":7.0819999999999999,"15min":7.0819999999999999},"last":0.42199999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.49399999999999999,"15min":0.49299999999999999},"min":{"1min":0.32600000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.52700000000000002,"15min":0.53600000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.72799999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.59099999999999997}]},{"osd":4,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.48699999999999999,"15min":0.50700000000000001},"min":{"1min":0.29599999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.64300000000000002,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54300000000000004,"15min":0.56799999999999995},"min":{"1min":0.32100000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.77100000000000002,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.65000000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52200000000000002,"15min":0.53800000000000003},"min":{"1min":0.307,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56299999999999994,"15min":0.58699999999999997},"min":{"1min":0.39500000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.79000000000000004,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.626}]},{"osd":7,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56200000000000006,"15min":0.57699999999999996},"min":{"1min":0.36899999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79500000000000004,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.58999999999999997,"15min":0.60699999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83899999999999997,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.63800000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310824,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061016,"statfs":{"total":96636764160,"available":96318480384,"internally_reserved":0,"allocated":1277952,"data_stored":888877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.33200000000000002,"15min":0.34200000000000003},"min":{"1min":0.24199999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.215,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.307}]},{"osd":2,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.34399999999999997,"15min":0.33600000000000002},"min":{"1min":0.23599999999999999,"5min":0.22,"15min":0.22},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.39600000000000002,"15min":0.38900000000000001},"min":{"1min":0.26500000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.35899999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.41399999999999998,"15min":0.41099999999999998},"min":{"1min":0.28299999999999997,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.68999999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.38100000000000001,"15min":0.36899999999999999},"min":{"1min":0.29799999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.33800000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.53000000000000003,"15min":0.50800000000000001},"min":{"1min":0.34399999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55800000000000005,"15min":0.54000000000000004},"min":{"1min":0.45300000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.503}]},{"osd":5,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55900000000000005,"15min":0.54900000000000004},"min":{"1min":0.38800000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.56299999999999994,"15min":0.54100000000000004},"min":{"1min":0.40000000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.52200000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57199999999999995,"15min":0.56200000000000006},"min":{"1min":0.36899999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.59199999999999997,"15min":0.57399999999999995},"min":{"1min":0.376,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.56399999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.59999999999999998,"15min":0.58999999999999997},"min":{"1min":0.48699999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84299999999999997,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.42899999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.45600000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574900,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302036,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069804,"statfs":{"total":96636764160,"available":96327479296,"internally_reserved":0,"allocated":667648,"data_stored":290548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.32700000000000001,"15min":0.33300000000000002},"min":{"1min":0.223,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.503,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.34200000000000003,"15min":0.34100000000000003},"min":{"1min":0.246,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"last":0.32300000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.371,"15min":0.377},"min":{"1min":0.27400000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.435,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36099999999999999,"15min":0.36599999999999999},"min":{"1min":0.27200000000000002,"5min":0.219,"15min":0.219},"max":{"1min":0.46100000000000002,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.28399999999999997}]},{"osd":3,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.371,"15min":0.373},"min":{"1min":0.26500000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"last":0.437},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.432,"15min":0.438},"min":{"1min":0.33000000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.55700000000000005,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.30499999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.55900000000000005,"15min":0.56000000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.626,"5min":0.60799999999999998,"15min":0.61499999999999999},"min":{"1min":0.36199999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.83999999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.621}]},{"osd":5,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54700000000000004,"15min":0.55100000000000005},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67900000000000005,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.55100000000000005,"15min":0.54500000000000004},"min":{"1min":0.40000000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.52500000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60399999999999998,"15min":0.61199999999999999},"min":{"1min":0.432,"5min":0.375,"15min":0.375},"max":{"1min":0.84499999999999997,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.60099999999999998,"15min":0.60499999999999998},"min":{"1min":0.42399999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.64000000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59799999999999998,"15min":0.60499999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.81299999999999994,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.42099999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.54600000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574901,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310228,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061612,"statfs":{"total":96636764160,"available":96319090688,"internally_reserved":0,"allocated":667648,"data_stored":290548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.309,"15min":0.309},"min":{"1min":0.22500000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.437,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38100000000000001,"15min":0.38500000000000001},"min":{"1min":0.26900000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.51400000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.35999999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36899999999999999,"15min":0.375},"min":{"1min":0.24399999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.35399999999999998,"15min":0.34799999999999998},"min":{"1min":0.26900000000000002,"5min":0.217,"15min":0.217},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.33900000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.37,"15min":0.373},"min":{"1min":0.27800000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.36499999999999999,"15min":0.36699999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.29099999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.33900000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.38900000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.60999999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.55200000000000005,"15min":0.55000000000000004},"min":{"1min":0.374,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.41799999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.64300000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58299999999999996,"15min":0.58399999999999996},"min":{"1min":0.43099999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41399999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.59099999999999997}]},{"osd":7,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.55900000000000005,"15min":0.55000000000000004},"min":{"1min":0.436,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.57099999999999995,"15min":0.56999999999999995},"min":{"1min":0.38600000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.60199999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574901,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297940,"kb_used_data":652,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073900,"statfs":{"total":96636764160,"available":96331673600,"internally_reserved":0,"allocated":667648,"data_stored":290548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.32600000000000001,"5min":0.315,"15min":0.32800000000000001},"min":{"1min":0.248,"5min":0.188,"15min":0.188},"max":{"1min":0.46500000000000002,"5min":1.095,"15min":1.095},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.38900000000000001,"15min":0.40500000000000003},"min":{"1min":0.29999999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.50600000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.38200000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.314,"15min":0.309},"min":{"1min":0.255,"5min":0.219,"15min":0.219},"max":{"1min":0.47499999999999998,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.36699999999999999,"15min":0.373},"min":{"1min":0.26500000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.51500000000000001,"5min":1.196,"15min":1.196},"last":0.35999999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.38100000000000001,"15min":0.39400000000000002},"min":{"1min":0.24199999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.54500000000000004,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.41499999999999998,"15min":0.42399999999999999},"min":{"1min":0.33700000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.55900000000000005,"5min":1.224,"15min":1.224},"last":0.32700000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.55700000000000005,"15min":0.57499999999999996},"min":{"1min":0.38200000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.92500000000000004,"5min":1.694,"15min":1.694},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53800000000000003,"15min":0.54500000000000004},"min":{"1min":0.36599999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.54500000000000004}]},{"osd":5,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.41599999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55700000000000005,"15min":0.56599999999999995},"min":{"1min":0.39200000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.82199999999999995,"5min":1.165,"15min":1.165},"last":0.49399999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58499999999999996,"15min":0.59499999999999997},"min":{"1min":0.40200000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.89900000000000002,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.59399999999999997,"15min":0.60499999999999998},"min":{"1min":0.45400000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83399999999999996,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.58199999999999996}]},{"osd":7,"last update":"Fri Oct 6 11:08:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58299999999999996,"15min":0.59699999999999998},"min":{"1min":0.40999999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.84799999999999998,"5min":1.657,"15min":1.657},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.57099999999999995,"15min":0.57399999999999995},"min":{"1min":0.46700000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.47899999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297956,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073884,"statfs":{"total":96636764160,"available":96331657216,"internally_reserved":0,"allocated":684032,"data_stored":298509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.54800000000000004,"15min":0.60299999999999998},"min":{"1min":0.28899999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.74099999999999999,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48299999999999998,"15min":0.499},"min":{"1min":0.28599999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.64500000000000002,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.624}]},{"osd":1,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.57499999999999996,"15min":0.628},"min":{"1min":0.28799999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66100000000000003,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.57699999999999996,"15min":0.629},"min":{"1min":0.32900000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.74199999999999999,"5min":2.7610000000000001,"15min":2.7610000000000001},"last":0.64000000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.54200000000000004,"15min":0.58199999999999996},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.60399999999999998,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58999999999999997,"15min":0.61899999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.76500000000000001,"5min":1.718,"15min":1.718},"last":0.58299999999999996}]},{"osd":3,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.60199999999999998,"15min":0.64800000000000002},"min":{"1min":0.36799999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.67600000000000005,"5min":2.677,"15min":2.677},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.51100000000000001,"15min":0.52400000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.48399999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.47299999999999998,"15min":0.497},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.52300000000000002,"15min":0.54700000000000004},"min":{"1min":0.307,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.71999999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.54400000000000004}]},{"osd":6,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.51000000000000001,"15min":0.53400000000000003},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.56100000000000005,"15min":0.59499999999999997},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.86899999999999999,"5min":1.165,"15min":1.165},"last":0.50800000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.55900000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59099999999999997,"15min":0.61599999999999999},"min":{"1min":0.37,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.76700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574902,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310232,"kb_used_data":656,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061608,"statfs":{"total":96636764160,"available":96319086592,"internally_reserved":0,"allocated":671744,"data_stored":291901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.66600000000000004,"15min":0.72399999999999998},"min":{"1min":0.36199999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.71899999999999997,"5min":5.0490000000000004,"15min":5.0490000000000004},"last":0.439},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.627,"15min":0.69299999999999995},"min":{"1min":0.254,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.755,"5min":5.1449999999999996,"15min":5.1449999999999996},"last":0.35099999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48999999999999999,"15min":0.49199999999999999},"min":{"1min":0.315,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.70699999999999996,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.70699999999999996,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.49199999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.57999999999999996,"15min":0.56699999999999995},"min":{"1min":0.379,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.81799999999999995,"5min":4.234,"15min":4.234},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56899999999999995,"15min":0.57799999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76600000000000001,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.53900000000000003}]},{"osd":3,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.66700000000000004,"15min":0.74399999999999999},"min":{"1min":0.29299999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.72099999999999997,"5min":5.2169999999999996,"15min":5.2169999999999996},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55100000000000005,"15min":0.55500000000000005},"min":{"1min":0.39600000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.83399999999999996,"5min":1.008,"15min":1.008},"last":0.46999999999999997}]},{"osd":4,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.52900000000000003,"15min":0.53800000000000003},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.871,"5min":1.917,"15min":1.917},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.497,"5min":0.53800000000000003,"15min":0.55500000000000005},"min":{"1min":0.27200000000000002,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.85499999999999998,"5min":0.87,"15min":0.87},"last":0.58499999999999996}]},{"osd":6,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.57799999999999996,"15min":0.58399999999999996},"min":{"1min":0.34899999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.89500000000000002,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.624,"15min":0.63200000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.92300000000000004,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":0.59999999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:08:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58999999999999997,"15min":0.60899999999999999},"min":{"1min":0.32100000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.84299999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.63},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.621,"15min":0.63},"min":{"1min":0.372,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.93899999999999995,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.60999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:09:46.893 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:09:47.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.032+0000 7f0e9b198700 1 Processor -- start 2023-10-06T11:09:47.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.032+0000 7f0e9b198700 1 -- start start 2023-10-06T11:09:47.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.033+0000 7f0e9b198700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0e94153ab0 0x7f0e9415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:47.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.033+0000 7f0e9b198700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0e94068ba0 0x7f0e940b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:47.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.033+0000 7f0e9b198700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e9415ac30 con 0x7f0e94153e80 2023-10-06T11:09:47.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.033+0000 7f0e9b198700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e940b4510 con 0x7f0e94153ab0 2023-10-06T11:09:47.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.033+0000 7f0e9b198700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e940b6530 con 0x7f0e94068ba0 2023-10-06T11:09:47.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.033+0000 7f0e98f34700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0e94153ab0 0x7f0e9415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:47.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.033+0000 7f0e98f34700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0e94153ab0 0x7f0e9415a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40808/0 (socket says 172.21.15.146:40808) 2023-10-06T11:09:47.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.033+0000 7f0e98f34700 1 -- 172.21.15.146:0/3182414646 learned_addr learned my addr 172.21.15.146:0/3182414646 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:47.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.033+0000 7f0e99735700 1 --2- 172.21.15.146:0/3182414646 >> v2:172.21.15.151:3300/0 conn(0x7f0e94068ba0 0x7f0e940b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:47.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.034+0000 7f0e98f34700 1 -- 172.21.15.146:0/3182414646 >> v2:172.21.15.151:3300/0 conn(0x7f0e94068ba0 msgr2=0x7f0e940b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:47.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.034+0000 7f0e98f34700 1 --2- 172.21.15.146:0/3182414646 >> v2:172.21.15.151:3300/0 conn(0x7f0e94068ba0 0x7f0e940b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:47.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.034+0000 7f0e98f34700 1 -- 172.21.15.146:0/3182414646 >> v1:172.21.15.146:6789/0 conn(0x7f0e94153e80 legacy=0x7f0e94068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:47.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.034+0000 7f0e98f34700 1 -- 172.21.15.146:0/3182414646 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e940b5c50 con 0x7f0e94153ab0 2023-10-06T11:09:47.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.034+0000 7f0e8b7fe700 1 -- 172.21.15.146:0/3182414646 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1684495053 0 0) 0x7f0e84001110 con 0x7f0e94153e80 2023-10-06T11:09:47.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.034+0000 7f0e99735700 1 --2- 172.21.15.146:0/3182414646 >> v2:172.21.15.151:3300/0 conn(0x7f0e94068ba0 0x7f0e940b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:47.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.034+0000 7f0e98f34700 1 --2- 172.21.15.146:0/3182414646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e94153ab0 0x7f0e9415a6f0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f0e940b36d0 tx=0x7f0e90009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f380e4bb58567a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:47.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.034+0000 7f0e8b7fe700 1 -- 172.21.15.146:0/3182414646 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9000e070 con 0x7f0e94153ab0 2023-10-06T11:09:47.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.034+0000 7f0e8b7fe700 1 -- 172.21.15.146:0/3182414646 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e9000ba50 con 0x7f0e94153ab0 2023-10-06T11:09:47.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.034+0000 7f0e8b7fe700 1 -- 172.21.15.146:0/3182414646 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e900092e0 con 0x7f0e94153ab0 2023-10-06T11:09:47.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.034+0000 7f0e9b198700 1 -- 172.21.15.146:0/3182414646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e94153ab0 msgr2=0x7f0e9415a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:47.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.034+0000 7f0e9b198700 1 --2- 172.21.15.146:0/3182414646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e94153ab0 0x7f0e9415a6f0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f0e940b36d0 tx=0x7f0e90009840 comp rx=0 tx=0).stop 2023-10-06T11:09:47.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.034+0000 7f0e9b198700 1 -- 172.21.15.146:0/3182414646 shutdown_connections 2023-10-06T11:09:47.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.034+0000 7f0e9b198700 1 --2- 172.21.15.146:0/3182414646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e94153ab0 0x7f0e9415a6f0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:47.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.034+0000 7f0e9b198700 1 --2- 172.21.15.146:0/3182414646 >> v2:172.21.15.151:3300/0 conn(0x7f0e94068ba0 0x7f0e940b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:47.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.034+0000 7f0e9b198700 1 -- 172.21.15.146:0/3182414646 >> 172.21.15.146:0/3182414646 conn(0x7f0e9406eba0 msgr2=0x7f0e9406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:47.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.035+0000 7f0e9b198700 1 -- 172.21.15.146:0/3182414646 shutdown_connections 2023-10-06T11:09:47.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.035+0000 7f0e9b198700 1 -- 172.21.15.146:0/3182414646 wait complete. 2023-10-06T11:09:47.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.036+0000 7f0e9b198700 1 Processor -- start 2023-10-06T11:09:47.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.036+0000 7f0e9b198700 1 -- start start 2023-10-06T11:09:47.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.036+0000 7f0e9b198700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e94068ba0 0x7f0e941440e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:47.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.036+0000 7f0e9b198700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e94153ab0 0x7f0e94157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:47.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.036+0000 7f0e9b198700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e94153e80 0x7f0e941575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:47.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.036+0000 7f0e9b198700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e94144620 con 0x7f0e94153ab0 2023-10-06T11:09:47.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.036+0000 7f0e9b198700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e940b1200 con 0x7f0e94153e80 2023-10-06T11:09:47.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.036+0000 7f0e9b198700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9415a380 con 0x7f0e94068ba0 2023-10-06T11:09:47.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.037+0000 7f0e8bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e94153ab0 0x7f0e94157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:47.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.037+0000 7f0e8bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e94153ab0 0x7f0e94157080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40824/0 (socket says 172.21.15.146:40824) 2023-10-06T11:09:47.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.037+0000 7f0e8bfff700 1 -- 172.21.15.146:0/1893562493 learned_addr learned my addr 172.21.15.146:0/1893562493 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:47.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.037+0000 7f0e98f34700 1 --2- 172.21.15.146:0/1893562493 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e94068ba0 0x7f0e941440e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:47.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.037+0000 7f0e99735700 1 --2- 172.21.15.146:0/1893562493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e94153e80 0x7f0e941575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:47.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.037+0000 7f0e8bfff700 1 -- 172.21.15.146:0/1893562493 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e94068ba0 msgr2=0x7f0e941440e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:47.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.037+0000 7f0e8bfff700 1 --2- 172.21.15.146:0/1893562493 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e94068ba0 0x7f0e941440e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:47.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.037+0000 7f0e8bfff700 1 -- 172.21.15.146:0/1893562493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e94153e80 msgr2=0x7f0e941575c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:47.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.037+0000 7f0e8bfff700 1 --2- 172.21.15.146:0/1893562493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e94153e80 0x7f0e941575c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:47.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.037+0000 7f0e8bfff700 1 -- 172.21.15.146:0/1893562493 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e90009ae0 con 0x7f0e94153ab0 2023-10-06T11:09:47.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.037+0000 7f0e99735700 1 --2- 172.21.15.146:0/1893562493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e94153e80 0x7f0e941575c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:47.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.037+0000 7f0e8bfff700 1 --2- 172.21.15.146:0/1893562493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e94153ab0 0x7f0e94157080 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f0e8400c7e0 tx=0x7f0e84007c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:47.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.037+0000 7f0e88ff9700 1 -- 172.21.15.146:0/1893562493 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e84011590 con 0x7f0e94153ab0 2023-10-06T11:09:47.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.037+0000 7f0e88ff9700 1 -- 172.21.15.146:0/1893562493 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e84011710 con 0x7f0e94153ab0 2023-10-06T11:09:47.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.037+0000 7f0e9b198700 1 -- 172.21.15.146:0/1893562493 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e9415a660 con 0x7f0e94153ab0 2023-10-06T11:09:47.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.037+0000 7f0e88ff9700 1 -- 172.21.15.146:0/1893562493 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e84011ad0 con 0x7f0e94153ab0 2023-10-06T11:09:47.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.037+0000 7f0e9b198700 1 -- 172.21.15.146:0/1893562493 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e940b0e90 con 0x7f0e94153ab0 2023-10-06T11:09:47.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.038+0000 7f0e9b198700 1 -- 172.21.15.146:0/1893562493 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e9404c380 con 0x7f0e94153ab0 2023-10-06T11:09:47.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.039+0000 7f0e88ff9700 1 -- 172.21.15.146:0/1893562493 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0e8401b3b0 con 0x7f0e94153ab0 2023-10-06T11:09:47.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.039+0000 7f0e88ff9700 1 --2- 172.21.15.146:0/1893562493 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0e80066f30 0x7f0e800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:47.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.039+0000 7f0e88ff9700 1 -- 172.21.15.146:0/1893562493 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0e84083a70 con 0x7f0e94153ab0 2023-10-06T11:09:47.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.039+0000 7f0e98f34700 1 --2- 172.21.15.146:0/1893562493 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0e80066f30 0x7f0e800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:47.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.039+0000 7f0e98f34700 1 --2- 172.21.15.146:0/1893562493 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0e80066f30 0x7f0e800693e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0e90009ab0 tx=0x7f0e90018000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:47.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.043+0000 7f0e88ff9700 1 -- 172.21.15.146:0/1893562493 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e84050b80 con 0x7f0e94153ab0 2023-10-06T11:09:47.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.223+0000 7f0e9b198700 1 -- 172.21.15.146:0/1893562493 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0e9415ac30 con 0x7f0e80066f30 2023-10-06T11:09:47.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.232+0000 7f0e88ff9700 1 -- 172.21.15.146:0/1893562493 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311245 (secure 0 0 0) 0x7f0e9415ac30 con 0x7f0e80066f30 2023-10-06T11:09:47.237 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:09:47.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.235+0000 7f0e9b198700 1 -- 172.21.15.146:0/1893562493 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0e80066f30 msgr2=0x7f0e800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:47.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.235+0000 7f0e9b198700 1 --2- 172.21.15.146:0/1893562493 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0e80066f30 0x7f0e800693e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f0e90009ab0 tx=0x7f0e90018000 comp rx=0 tx=0).stop 2023-10-06T11:09:47.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.235+0000 7f0e9b198700 1 -- 172.21.15.146:0/1893562493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e94153ab0 msgr2=0x7f0e94157080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:47.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.235+0000 7f0e9b198700 1 --2- 172.21.15.146:0/1893562493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e94153ab0 0x7f0e94157080 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f0e8400c7e0 tx=0x7f0e84007c60 comp rx=0 tx=0).stop 2023-10-06T11:09:47.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.235+0000 7f0e9b198700 1 -- 172.21.15.146:0/1893562493 shutdown_connections 2023-10-06T11:09:47.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.235+0000 7f0e9b198700 1 --2- 172.21.15.146:0/1893562493 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0e80066f30 0x7f0e800693e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:47.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.235+0000 7f0e9b198700 1 --2- 172.21.15.146:0/1893562493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e94153e80 0x7f0e941575c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:47.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.235+0000 7f0e9b198700 1 --2- 172.21.15.146:0/1893562493 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e94068ba0 0x7f0e941440e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:47.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.235+0000 7f0e9b198700 1 --2- 172.21.15.146:0/1893562493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e94153ab0 0x7f0e94157080 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:47.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.235+0000 7f0e9b198700 1 -- 172.21.15.146:0/1893562493 >> 172.21.15.146:0/1893562493 conn(0x7f0e9406eba0 msgr2=0x7f0e94152000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:47.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.235+0000 7f0e9b198700 1 -- 172.21.15.146:0/1893562493 shutdown_connections 2023-10-06T11:09:47.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.235+0000 7f0e9b198700 1 -- 172.21.15.146:0/1893562493 wait complete. 2023-10-06T11:09:47.240 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:09:47.249 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":177,"stamp":"2023-10-06T11:09:47.192439+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590584,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":182,"num_write_kb":2425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":141,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2438180,"kb_used_data":6628,"kb_used_omap":0,"kb_used_meta":2431488,"kb_avail":752536540,"statfs":{"total":773094113280,"available":770597416960,"internally_reserved":0,"allocated":6787072,"data_stored":3632951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2489843712},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":216,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001277"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.232857+0000","last_change":"2023-10-06T11:09:42.232857+0000","last_active":"2023-10-06T11:09:42.232857+0000","last_peered":"2023-10-06T11:09:42.232857+0000","last_clean":"2023-10-06T11:09:42.232857+0000","last_became_active":"2023-10-06T11:09:42.232668+0000","last_became_peered":"2023-10-06T11:09:42.232668+0000","last_unstale":"2023-10-06T11:09:42.232857+0000","last_undegraded":"2023-10-06T11:09:42.232857+0000","last_fullsized":"2023-10-06T11:09:42.232857+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:05:31.432383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.235533+0000","last_change":"2023-10-06T11:09:42.235533+0000","last_active":"2023-10-06T11:09:42.235533+0000","last_peered":"2023-10-06T11:09:42.235533+0000","last_clean":"2023-10-06T11:09:42.235533+0000","last_became_active":"2023-10-06T11:09:42.235247+0000","last_became_peered":"2023-10-06T11:09:42.235247+0000","last_unstale":"2023-10-06T11:09:42.235533+0000","last_undegraded":"2023-10-06T11:09:42.235533+0000","last_fullsized":"2023-10-06T11:09:42.235533+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:04:57.888469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.233847+0000","last_change":"2023-10-06T11:09:42.225563+0000","last_active":"2023-10-06T11:09:42.233847+0000","last_peered":"2023-10-06T11:09:42.233847+0000","last_clean":"2023-10-06T11:09:42.233847+0000","last_became_active":"2023-10-06T11:09:42.225297+0000","last_became_peered":"2023-10-06T11:09:42.225297+0000","last_unstale":"2023-10-06T11:09:42.233847+0000","last_undegraded":"2023-10-06T11:09:42.233847+0000","last_fullsized":"2023-10-06T11:09:42.233847+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:22:01.027500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.236341+0000","last_change":"2023-10-06T11:09:42.236341+0000","last_active":"2023-10-06T11:09:42.236341+0000","last_peered":"2023-10-06T11:09:42.236341+0000","last_clean":"2023-10-06T11:09:42.236341+0000","last_became_active":"2023-10-06T11:09:42.236063+0000","last_became_peered":"2023-10-06T11:09:42.236063+0000","last_unstale":"2023-10-06T11:09:42.236341+0000","last_undegraded":"2023-10-06T11:09:42.236341+0000","last_fullsized":"2023-10-06T11:09:42.236341+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:25.857721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.233776+0000","last_change":"2023-10-06T11:09:42.233776+0000","last_active":"2023-10-06T11:09:42.233776+0000","last_peered":"2023-10-06T11:09:42.233776+0000","last_clean":"2023-10-06T11:09:42.233776+0000","last_became_active":"2023-10-06T11:09:42.233510+0000","last_became_peered":"2023-10-06T11:09:42.233510+0000","last_unstale":"2023-10-06T11:09:42.233776+0000","last_undegraded":"2023-10-06T11:09:42.233776+0000","last_fullsized":"2023-10-06T11:09:42.233776+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:51:40.439269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.236999+0000","last_change":"2023-10-06T11:09:42.234386+0000","last_active":"2023-10-06T11:09:42.236999+0000","last_peered":"2023-10-06T11:09:42.236999+0000","last_clean":"2023-10-06T11:09:42.236999+0000","last_became_active":"2023-10-06T11:09:42.234150+0000","last_became_peered":"2023-10-06T11:09:42.234150+0000","last_unstale":"2023-10-06T11:09:42.236999+0000","last_undegraded":"2023-10-06T11:09:42.236999+0000","last_fullsized":"2023-10-06T11:09:42.236999+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:23:07.383775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.227283+0000","last_change":"2023-10-06T11:09:42.223581+0000","last_active":"2023-10-06T11:09:42.227283+0000","last_peered":"2023-10-06T11:09:42.227283+0000","last_clean":"2023-10-06T11:09:42.227283+0000","last_became_active":"2023-10-06T11:09:42.223299+0000","last_became_peered":"2023-10-06T11:09:42.223299+0000","last_unstale":"2023-10-06T11:09:42.227283+0000","last_undegraded":"2023-10-06T11:09:42.227283+0000","last_fullsized":"2023-10-06T11:09:42.227283+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:37:14.750346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.240913+0000","last_change":"2023-10-06T11:09:42.237243+0000","last_active":"2023-10-06T11:09:42.240913+0000","last_peered":"2023-10-06T11:09:42.240913+0000","last_clean":"2023-10-06T11:09:42.240913+0000","last_became_active":"2023-10-06T11:09:42.236962+0000","last_became_peered":"2023-10-06T11:09:42.236962+0000","last_unstale":"2023-10-06T11:09:42.240913+0000","last_undegraded":"2023-10-06T11:09:42.240913+0000","last_fullsized":"2023-10-06T11:09:42.240913+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:11:07.460296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.236771+0000","last_change":"2023-10-06T11:09:42.233949+0000","last_active":"2023-10-06T11:09:42.236771+0000","last_peered":"2023-10-06T11:09:42.236771+0000","last_clean":"2023-10-06T11:09:42.236771+0000","last_became_active":"2023-10-06T11:09:42.233703+0000","last_became_peered":"2023-10-06T11:09:42.233703+0000","last_unstale":"2023-10-06T11:09:42.236771+0000","last_undegraded":"2023-10-06T11:09:42.236771+0000","last_fullsized":"2023-10-06T11:09:42.236771+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:53:10.461851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.240935+0000","last_change":"2023-10-06T11:09:42.235877+0000","last_active":"2023-10-06T11:09:42.240935+0000","last_peered":"2023-10-06T11:09:42.240935+0000","last_clean":"2023-10-06T11:09:42.240935+0000","last_became_active":"2023-10-06T11:09:42.235615+0000","last_became_peered":"2023-10-06T11:09:42.235615+0000","last_unstale":"2023-10-06T11:09:42.240935+0000","last_undegraded":"2023-10-06T11:09:42.240935+0000","last_fullsized":"2023-10-06T11:09:42.240935+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:01:52.167469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.232740+0000","last_change":"2023-10-06T11:09:42.232740+0000","last_active":"2023-10-06T11:09:42.232740+0000","last_peered":"2023-10-06T11:09:42.232740+0000","last_clean":"2023-10-06T11:09:42.232740+0000","last_became_active":"2023-10-06T11:09:42.230980+0000","last_became_peered":"2023-10-06T11:09:42.230980+0000","last_unstale":"2023-10-06T11:09:42.232740+0000","last_undegraded":"2023-10-06T11:09:42.232740+0000","last_fullsized":"2023-10-06T11:09:42.232740+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:53.894745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.240874+0000","last_change":"2023-10-06T11:09:42.237074+0000","last_active":"2023-10-06T11:09:42.240874+0000","last_peered":"2023-10-06T11:09:42.240874+0000","last_clean":"2023-10-06T11:09:42.240874+0000","last_became_active":"2023-10-06T11:09:42.236805+0000","last_became_peered":"2023-10-06T11:09:42.236805+0000","last_unstale":"2023-10-06T11:09:42.240874+0000","last_undegraded":"2023-10-06T11:09:42.240874+0000","last_fullsized":"2023-10-06T11:09:42.240874+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:06:54.424848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.238322+0000","last_change":"2023-10-06T11:09:42.234158+0000","last_active":"2023-10-06T11:09:42.238322+0000","last_peered":"2023-10-06T11:09:42.238322+0000","last_clean":"2023-10-06T11:09:42.238322+0000","last_became_active":"2023-10-06T11:09:42.233239+0000","last_became_peered":"2023-10-06T11:09:42.233239+0000","last_unstale":"2023-10-06T11:09:42.238322+0000","last_undegraded":"2023-10-06T11:09:42.238322+0000","last_fullsized":"2023-10-06T11:09:42.238322+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:37:07.428678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.233777+0000","last_change":"2023-10-06T11:09:42.225677+0000","last_active":"2023-10-06T11:09:42.233777+0000","last_peered":"2023-10-06T11:09:42.233777+0000","last_clean":"2023-10-06T11:09:42.233777+0000","last_became_active":"2023-10-06T11:09:42.225397+0000","last_became_peered":"2023-10-06T11:09:42.225397+0000","last_unstale":"2023-10-06T11:09:42.233777+0000","last_undegraded":"2023-10-06T11:09:42.233777+0000","last_fullsized":"2023-10-06T11:09:42.233777+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:15.899968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.234807+0000","last_change":"2023-10-06T11:09:42.231826+0000","last_active":"2023-10-06T11:09:42.234807+0000","last_peered":"2023-10-06T11:09:42.234807+0000","last_clean":"2023-10-06T11:09:42.234807+0000","last_became_active":"2023-10-06T11:09:42.229429+0000","last_became_peered":"2023-10-06T11:09:42.229429+0000","last_unstale":"2023-10-06T11:09:42.234807+0000","last_undegraded":"2023-10-06T11:09:42.234807+0000","last_fullsized":"2023-10-06T11:09:42.234807+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:00:08.984931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.238250+0000","last_change":"2023-10-06T11:09:42.235593+0000","last_active":"2023-10-06T11:09:42.238250+0000","last_peered":"2023-10-06T11:09:42.238250+0000","last_clean":"2023-10-06T11:09:42.238250+0000","last_became_active":"2023-10-06T11:09:42.235344+0000","last_became_peered":"2023-10-06T11:09:42.235344+0000","last_unstale":"2023-10-06T11:09:42.238250+0000","last_undegraded":"2023-10-06T11:09:42.238250+0000","last_fullsized":"2023-10-06T11:09:42.238250+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:32:33.321028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.230670+0000","last_change":"2023-10-06T11:09:42.230670+0000","last_active":"2023-10-06T11:09:42.230670+0000","last_peered":"2023-10-06T11:09:42.230670+0000","last_clean":"2023-10-06T11:09:42.230670+0000","last_became_active":"2023-10-06T11:09:42.230448+0000","last_became_peered":"2023-10-06T11:09:42.230448+0000","last_unstale":"2023-10-06T11:09:42.230670+0000","last_undegraded":"2023-10-06T11:09:42.230670+0000","last_fullsized":"2023-10-06T11:09:42.230670+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:01:57.169564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.232284+0000","last_change":"2023-10-06T11:09:42.232284+0000","last_active":"2023-10-06T11:09:42.232284+0000","last_peered":"2023-10-06T11:09:42.232284+0000","last_clean":"2023-10-06T11:09:42.232284+0000","last_became_active":"2023-10-06T11:09:42.231990+0000","last_became_peered":"2023-10-06T11:09:42.231990+0000","last_unstale":"2023-10-06T11:09:42.232284+0000","last_undegraded":"2023-10-06T11:09:42.232284+0000","last_fullsized":"2023-10-06T11:09:42.232284+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:10:47.746855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.232237+0000","last_change":"2023-10-06T11:09:42.232237+0000","last_active":"2023-10-06T11:09:42.232237+0000","last_peered":"2023-10-06T11:09:42.232237+0000","last_clean":"2023-10-06T11:09:42.232237+0000","last_became_active":"2023-10-06T11:09:42.231280+0000","last_became_peered":"2023-10-06T11:09:42.231280+0000","last_unstale":"2023-10-06T11:09:42.232237+0000","last_undegraded":"2023-10-06T11:09:42.232237+0000","last_fullsized":"2023-10-06T11:09:42.232237+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:15.427811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.256915+0000","last_change":"2023-10-06T11:09:42.256441+0000","last_active":"2023-10-06T11:09:42.256915+0000","last_peered":"2023-10-06T11:09:42.256915+0000","last_clean":"2023-10-06T11:09:42.256915+0000","last_became_active":"2023-10-06T11:09:42.256203+0000","last_became_peered":"2023-10-06T11:09:42.256203+0000","last_unstale":"2023-10-06T11:09:42.256915+0000","last_undegraded":"2023-10-06T11:09:42.256915+0000","last_fullsized":"2023-10-06T11:09:42.256915+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:26.358337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.238311+0000","last_change":"2023-10-06T11:09:42.234079+0000","last_active":"2023-10-06T11:09:42.238311+0000","last_peered":"2023-10-06T11:09:42.238311+0000","last_clean":"2023-10-06T11:09:42.238311+0000","last_became_active":"2023-10-06T11:09:42.232879+0000","last_became_peered":"2023-10-06T11:09:42.232879+0000","last_unstale":"2023-10-06T11:09:42.238311+0000","last_undegraded":"2023-10-06T11:09:42.238311+0000","last_fullsized":"2023-10-06T11:09:42.238311+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:39:06.623968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.256450+0000","last_change":"2023-10-06T11:09:42.255496+0000","last_active":"2023-10-06T11:09:42.256450+0000","last_peered":"2023-10-06T11:09:42.256450+0000","last_clean":"2023-10-06T11:09:42.256450+0000","last_became_active":"2023-10-06T11:09:42.255193+0000","last_became_peered":"2023-10-06T11:09:42.255193+0000","last_unstale":"2023-10-06T11:09:42.256450+0000","last_undegraded":"2023-10-06T11:09:42.256450+0000","last_fullsized":"2023-10-06T11:09:42.256450+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:52:24.958762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.256178+0000","last_change":"2023-10-06T11:09:42.255340+0000","last_active":"2023-10-06T11:09:42.256178+0000","last_peered":"2023-10-06T11:09:42.256178+0000","last_clean":"2023-10-06T11:09:42.256178+0000","last_became_active":"2023-10-06T11:09:42.255102+0000","last_became_peered":"2023-10-06T11:09:42.255102+0000","last_unstale":"2023-10-06T11:09:42.256178+0000","last_undegraded":"2023-10-06T11:09:42.256178+0000","last_fullsized":"2023-10-06T11:09:42.256178+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:40:31.710840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.233890+0000","last_change":"2023-10-06T11:09:42.226062+0000","last_active":"2023-10-06T11:09:42.233890+0000","last_peered":"2023-10-06T11:09:42.233890+0000","last_clean":"2023-10-06T11:09:42.233890+0000","last_became_active":"2023-10-06T11:09:42.225828+0000","last_became_peered":"2023-10-06T11:09:42.225828+0000","last_unstale":"2023-10-06T11:09:42.233890+0000","last_undegraded":"2023-10-06T11:09:42.233890+0000","last_fullsized":"2023-10-06T11:09:42.233890+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:32:21.749142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.240752+0000","last_change":"2023-10-06T11:09:42.236411+0000","last_active":"2023-10-06T11:09:42.240752+0000","last_peered":"2023-10-06T11:09:42.240752+0000","last_clean":"2023-10-06T11:09:42.240752+0000","last_became_active":"2023-10-06T11:09:42.236152+0000","last_became_peered":"2023-10-06T11:09:42.236152+0000","last_unstale":"2023-10-06T11:09:42.240752+0000","last_undegraded":"2023-10-06T11:09:42.240752+0000","last_fullsized":"2023-10-06T11:09:42.240752+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:13.716196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.234008+0000","last_change":"2023-10-06T11:09:42.232091+0000","last_active":"2023-10-06T11:09:42.234008+0000","last_peered":"2023-10-06T11:09:42.234008+0000","last_clean":"2023-10-06T11:09:42.234008+0000","last_became_active":"2023-10-06T11:09:42.231833+0000","last_became_peered":"2023-10-06T11:09:42.231833+0000","last_unstale":"2023-10-06T11:09:42.234008+0000","last_undegraded":"2023-10-06T11:09:42.234008+0000","last_fullsized":"2023-10-06T11:09:42.234008+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:29:33.571825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.231444+0000","last_change":"2023-10-06T11:09:42.231444+0000","last_active":"2023-10-06T11:09:42.231444+0000","last_peered":"2023-10-06T11:09:42.231444+0000","last_clean":"2023-10-06T11:09:42.231444+0000","last_became_active":"2023-10-06T11:09:42.230697+0000","last_became_peered":"2023-10-06T11:09:42.230697+0000","last_unstale":"2023-10-06T11:09:42.231444+0000","last_undegraded":"2023-10-06T11:09:42.231444+0000","last_fullsized":"2023-10-06T11:09:42.231444+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:05:31.432383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.238581+0000","last_change":"2023-10-06T11:09:42.238581+0000","last_active":"2023-10-06T11:09:42.238581+0000","last_peered":"2023-10-06T11:09:42.238581+0000","last_clean":"2023-10-06T11:09:42.238581+0000","last_became_active":"2023-10-06T11:09:42.238389+0000","last_became_peered":"2023-10-06T11:09:42.238389+0000","last_unstale":"2023-10-06T11:09:42.238581+0000","last_undegraded":"2023-10-06T11:09:42.238581+0000","last_fullsized":"2023-10-06T11:09:42.238581+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:13.716196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.234930+0000","last_change":"2023-10-06T11:09:42.232845+0000","last_active":"2023-10-06T11:09:42.234930+0000","last_peered":"2023-10-06T11:09:42.234930+0000","last_clean":"2023-10-06T11:09:42.234930+0000","last_became_active":"2023-10-06T11:09:42.232569+0000","last_became_peered":"2023-10-06T11:09:42.232569+0000","last_unstale":"2023-10-06T11:09:42.234930+0000","last_undegraded":"2023-10-06T11:09:42.234930+0000","last_fullsized":"2023-10-06T11:09:42.234930+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:26.590053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.241020+0000","last_change":"2023-10-06T11:09:42.239073+0000","last_active":"2023-10-06T11:09:42.241020+0000","last_peered":"2023-10-06T11:09:42.241020+0000","last_clean":"2023-10-06T11:09:42.241020+0000","last_became_active":"2023-10-06T11:09:42.238822+0000","last_became_peered":"2023-10-06T11:09:42.238822+0000","last_unstale":"2023-10-06T11:09:42.241020+0000","last_undegraded":"2023-10-06T11:09:42.241020+0000","last_fullsized":"2023-10-06T11:09:42.241020+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:06:18.955546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.230451+0000","last_change":"2023-10-06T11:09:42.230451+0000","last_active":"2023-10-06T11:09:42.230451+0000","last_peered":"2023-10-06T11:09:42.230451+0000","last_clean":"2023-10-06T11:09:42.230451+0000","last_became_active":"2023-10-06T11:09:42.230170+0000","last_became_peered":"2023-10-06T11:09:42.230170+0000","last_unstale":"2023-10-06T11:09:42.230451+0000","last_undegraded":"2023-10-06T11:09:42.230451+0000","last_fullsized":"2023-10-06T11:09:42.230451+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:07:11.162512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.234677+0000","last_change":"2023-10-06T11:09:42.228466+0000","last_active":"2023-10-06T11:09:42.234677+0000","last_peered":"2023-10-06T11:09:42.234677+0000","last_clean":"2023-10-06T11:09:42.234677+0000","last_became_active":"2023-10-06T11:09:42.228215+0000","last_became_peered":"2023-10-06T11:09:42.228215+0000","last_unstale":"2023-10-06T11:09:42.234677+0000","last_undegraded":"2023-10-06T11:09:42.234677+0000","last_fullsized":"2023-10-06T11:09:42.234677+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:20:39.904258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.230224+0000","last_change":"2023-10-06T11:09:42.230224+0000","last_active":"2023-10-06T11:09:42.230224+0000","last_peered":"2023-10-06T11:09:42.230224+0000","last_clean":"2023-10-06T11:09:42.230224+0000","last_became_active":"2023-10-06T11:09:42.229962+0000","last_became_peered":"2023-10-06T11:09:42.229962+0000","last_unstale":"2023-10-06T11:09:42.230224+0000","last_undegraded":"2023-10-06T11:09:42.230224+0000","last_fullsized":"2023-10-06T11:09:42.230224+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:39:11.614060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.215964+0000","last_change":"2023-10-06T11:09:41.213260+0000","last_active":"2023-10-06T11:09:41.215964+0000","last_peered":"2023-10-06T11:09:41.215964+0000","last_clean":"2023-10-06T11:09:41.215964+0000","last_became_active":"2023-10-06T11:09:41.213069+0000","last_became_peered":"2023-10-06T11:09:41.213069+0000","last_unstale":"2023-10-06T11:09:41.215964+0000","last_undegraded":"2023-10-06T11:09:41.215964+0000","last_fullsized":"2023-10-06T11:09:41.215964+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:48:05.076777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.231249+0000","last_change":"2023-10-06T11:09:42.231249+0000","last_active":"2023-10-06T11:09:42.231249+0000","last_peered":"2023-10-06T11:09:42.231249+0000","last_clean":"2023-10-06T11:09:42.231249+0000","last_became_active":"2023-10-06T11:09:42.230418+0000","last_became_peered":"2023-10-06T11:09:42.230418+0000","last_unstale":"2023-10-06T11:09:42.231249+0000","last_undegraded":"2023-10-06T11:09:42.231249+0000","last_fullsized":"2023-10-06T11:09:42.231249+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:29:33.571825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"58'1","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.341943+0000","last_change":"2023-10-06T11:09:41.216511+0000","last_active":"2023-10-06T11:09:42.341943+0000","last_peered":"2023-10-06T11:09:42.341943+0000","last_clean":"2023-10-06T11:09:42.341943+0000","last_became_active":"2023-10-06T11:09:41.216244+0000","last_became_peered":"2023-10-06T11:09:41.216244+0000","last_unstale":"2023-10-06T11:09:42.341943+0000","last_undegraded":"2023-10-06T11:09:42.341943+0000","last_fullsized":"2023-10-06T11:09:42.341943+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:01:51.162810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.234861+0000","last_change":"2023-10-06T11:09:42.229034+0000","last_active":"2023-10-06T11:09:42.234861+0000","last_peered":"2023-10-06T11:09:42.234861+0000","last_clean":"2023-10-06T11:09:42.234861+0000","last_became_active":"2023-10-06T11:09:42.228734+0000","last_became_peered":"2023-10-06T11:09:42.228734+0000","last_unstale":"2023-10-06T11:09:42.234861+0000","last_undegraded":"2023-10-06T11:09:42.234861+0000","last_fullsized":"2023-10-06T11:09:42.234861+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:17:44.409872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"58'2","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.342510+0000","last_change":"2023-10-06T11:09:41.213108+0000","last_active":"2023-10-06T11:09:42.342510+0000","last_peered":"2023-10-06T11:09:42.342510+0000","last_clean":"2023-10-06T11:09:42.342510+0000","last_became_active":"2023-10-06T11:09:41.212695+0000","last_became_peered":"2023-10-06T11:09:41.212695+0000","last_unstale":"2023-10-06T11:09:42.342510+0000","last_undegraded":"2023-10-06T11:09:42.342510+0000","last_fullsized":"2023-10-06T11:09:42.342510+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:32:20.744483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.234526+0000","last_change":"2023-10-06T11:09:42.227750+0000","last_active":"2023-10-06T11:09:42.234526+0000","last_peered":"2023-10-06T11:09:42.234526+0000","last_clean":"2023-10-06T11:09:42.234526+0000","last_became_active":"2023-10-06T11:09:42.227479+0000","last_became_peered":"2023-10-06T11:09:42.227479+0000","last_unstale":"2023-10-06T11:09:42.234526+0000","last_undegraded":"2023-10-06T11:09:42.234526+0000","last_fullsized":"2023-10-06T11:09:42.234526+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:08:15.143503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"58'2","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.342311+0000","last_change":"2023-10-06T11:09:41.216502+0000","last_active":"2023-10-06T11:09:42.342311+0000","last_peered":"2023-10-06T11:09:42.342311+0000","last_clean":"2023-10-06T11:09:42.342311+0000","last_became_active":"2023-10-06T11:09:41.216217+0000","last_became_peered":"2023-10-06T11:09:41.216217+0000","last_unstale":"2023-10-06T11:09:42.342311+0000","last_undegraded":"2023-10-06T11:09:42.342311+0000","last_fullsized":"2023-10-06T11:09:42.342311+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:08:14.138844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.236789+0000","last_change":"2023-10-06T11:09:42.231963+0000","last_active":"2023-10-06T11:09:42.236789+0000","last_peered":"2023-10-06T11:09:42.236789+0000","last_clean":"2023-10-06T11:09:42.236789+0000","last_became_active":"2023-10-06T11:09:42.231567+0000","last_became_peered":"2023-10-06T11:09:42.231567+0000","last_unstale":"2023-10-06T11:09:42.236789+0000","last_undegraded":"2023-10-06T11:09:42.236789+0000","last_fullsized":"2023-10-06T11:09:42.236789+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:57:11.763583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"58'1","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.341518+0000","last_change":"2023-10-06T11:09:41.218930+0000","last_active":"2023-10-06T11:09:42.341518+0000","last_peered":"2023-10-06T11:09:42.341518+0000","last_clean":"2023-10-06T11:09:42.341518+0000","last_became_active":"2023-10-06T11:09:41.218683+0000","last_became_peered":"2023-10-06T11:09:41.218683+0000","last_unstale":"2023-10-06T11:09:42.341518+0000","last_undegraded":"2023-10-06T11:09:42.341518+0000","last_fullsized":"2023-10-06T11:09:42.341518+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:13:27.560433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.232629+0000","last_change":"2023-10-06T11:09:42.232629+0000","last_active":"2023-10-06T11:09:42.232629+0000","last_peered":"2023-10-06T11:09:42.232629+0000","last_clean":"2023-10-06T11:09:42.232629+0000","last_became_active":"2023-10-06T11:09:42.232390+0000","last_became_peered":"2023-10-06T11:09:42.232390+0000","last_unstale":"2023-10-06T11:09:42.232629+0000","last_undegraded":"2023-10-06T11:09:42.232629+0000","last_fullsized":"2023-10-06T11:09:42.232629+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:40:23.620747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"58'1","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.341177+0000","last_change":"2023-10-06T11:09:41.208722+0000","last_active":"2023-10-06T11:09:42.341177+0000","last_peered":"2023-10-06T11:09:42.341177+0000","last_clean":"2023-10-06T11:09:42.341177+0000","last_became_active":"2023-10-06T11:09:41.208481+0000","last_became_peered":"2023-10-06T11:09:41.208481+0000","last_unstale":"2023-10-06T11:09:42.341177+0000","last_undegraded":"2023-10-06T11:09:42.341177+0000","last_fullsized":"2023-10-06T11:09:42.341177+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:06:53.420190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.227251+0000","last_change":"2023-10-06T11:09:42.227251+0000","last_active":"2023-10-06T11:09:42.227251+0000","last_peered":"2023-10-06T11:09:42.227251+0000","last_clean":"2023-10-06T11:09:42.227251+0000","last_became_active":"2023-10-06T11:09:42.226952+0000","last_became_peered":"2023-10-06T11:09:42.226952+0000","last_unstale":"2023-10-06T11:09:42.227251+0000","last_undegraded":"2023-10-06T11:09:42.227251+0000","last_fullsized":"2023-10-06T11:09:42.227251+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:59.957433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.221721+0000","last_change":"2023-10-06T11:09:41.218780+0000","last_active":"2023-10-06T11:09:42.221721+0000","last_peered":"2023-10-06T11:09:42.221721+0000","last_clean":"2023-10-06T11:09:42.221721+0000","last_became_active":"2023-10-06T11:09:41.218522+0000","last_became_peered":"2023-10-06T11:09:41.218522+0000","last_unstale":"2023-10-06T11:09:42.221721+0000","last_undegraded":"2023-10-06T11:09:42.221721+0000","last_fullsized":"2023-10-06T11:09:42.221721+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:25.585394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.259245+0000","last_change":"2023-10-06T11:09:42.258941+0000","last_active":"2023-10-06T11:09:42.259245+0000","last_peered":"2023-10-06T11:09:42.259245+0000","last_clean":"2023-10-06T11:09:42.259245+0000","last_became_active":"2023-10-06T11:09:42.258749+0000","last_became_peered":"2023-10-06T11:09:42.258749+0000","last_unstale":"2023-10-06T11:09:42.259245+0000","last_undegraded":"2023-10-06T11:09:42.259245+0000","last_fullsized":"2023-10-06T11:09:42.259245+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:00:08.984931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.219309+0000","last_change":"2023-10-06T11:09:41.215714+0000","last_active":"2023-10-06T11:09:41.219309+0000","last_peered":"2023-10-06T11:09:41.219309+0000","last_clean":"2023-10-06T11:09:41.219309+0000","last_became_active":"2023-10-06T11:09:41.215430+0000","last_became_peered":"2023-10-06T11:09:41.215430+0000","last_unstale":"2023-10-06T11:09:41.219309+0000","last_undegraded":"2023-10-06T11:09:41.219309+0000","last_fullsized":"2023-10-06T11:09:41.219309+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:48:06.642258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.227904+0000","last_change":"2023-10-06T11:09:42.227904+0000","last_active":"2023-10-06T11:09:42.227904+0000","last_peered":"2023-10-06T11:09:42.227904+0000","last_clean":"2023-10-06T11:09:42.227904+0000","last_became_active":"2023-10-06T11:09:42.227654+0000","last_became_peered":"2023-10-06T11:09:42.227654+0000","last_unstale":"2023-10-06T11:09:42.227904+0000","last_undegraded":"2023-10-06T11:09:42.227904+0000","last_fullsized":"2023-10-06T11:09:42.227904+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:53.894745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.219586+0000","last_change":"2023-10-06T11:09:41.217448+0000","last_active":"2023-10-06T11:09:42.219586+0000","last_peered":"2023-10-06T11:09:42.219586+0000","last_clean":"2023-10-06T11:09:42.219586+0000","last_became_active":"2023-10-06T11:09:41.217135+0000","last_became_peered":"2023-10-06T11:09:41.217135+0000","last_unstale":"2023-10-06T11:09:42.219586+0000","last_undegraded":"2023-10-06T11:09:42.219586+0000","last_fullsized":"2023-10-06T11:09:42.219586+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:40:22.616089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.256653+0000","last_change":"2023-10-06T11:09:42.256154+0000","last_active":"2023-10-06T11:09:42.256653+0000","last_peered":"2023-10-06T11:09:42.256653+0000","last_clean":"2023-10-06T11:09:42.256653+0000","last_became_active":"2023-10-06T11:09:42.255559+0000","last_became_peered":"2023-10-06T11:09:42.255559+0000","last_unstale":"2023-10-06T11:09:42.256653+0000","last_undegraded":"2023-10-06T11:09:42.256653+0000","last_fullsized":"2023-10-06T11:09:42.256653+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:57:54.298243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.214378+0000","last_change":"2023-10-06T11:09:41.212720+0000","last_active":"2023-10-06T11:09:41.214378+0000","last_peered":"2023-10-06T11:09:41.214378+0000","last_clean":"2023-10-06T11:09:41.214378+0000","last_became_active":"2023-10-06T11:09:41.212468+0000","last_became_peered":"2023-10-06T11:09:41.212468+0000","last_unstale":"2023-10-06T11:09:41.214378+0000","last_undegraded":"2023-10-06T11:09:41.214378+0000","last_fullsized":"2023-10-06T11:09:41.214378+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:57.202092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.231969+0000","last_change":"2023-10-06T11:09:42.231969+0000","last_active":"2023-10-06T11:09:42.231969+0000","last_peered":"2023-10-06T11:09:42.231969+0000","last_clean":"2023-10-06T11:09:42.231969+0000","last_became_active":"2023-10-06T11:09:42.231685+0000","last_became_peered":"2023-10-06T11:09:42.231685+0000","last_unstale":"2023-10-06T11:09:42.231969+0000","last_undegraded":"2023-10-06T11:09:42.231969+0000","last_fullsized":"2023-10-06T11:09:42.231969+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:58.206751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"58'3","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.342621+0000","last_change":"2023-10-06T11:09:41.217623+0000","last_active":"2023-10-06T11:09:42.342621+0000","last_peered":"2023-10-06T11:09:42.342621+0000","last_clean":"2023-10-06T11:09:42.342621+0000","last_became_active":"2023-10-06T11:09:41.216779+0000","last_became_peered":"2023-10-06T11:09:41.216779+0000","last_unstale":"2023-10-06T11:09:42.342621+0000","last_undegraded":"2023-10-06T11:09:42.342621+0000","last_fullsized":"2023-10-06T11:09:42.342621+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:12.711537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.257176+0000","last_change":"2023-10-06T11:09:42.257176+0000","last_active":"2023-10-06T11:09:42.257176+0000","last_peered":"2023-10-06T11:09:42.257176+0000","last_clean":"2023-10-06T11:09:42.257176+0000","last_became_active":"2023-10-06T11:09:42.256930+0000","last_became_peered":"2023-10-06T11:09:42.256930+0000","last_unstale":"2023-10-06T11:09:42.257176+0000","last_undegraded":"2023-10-06T11:09:42.257176+0000","last_fullsized":"2023-10-06T11:09:42.257176+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:52:18.608330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.216096+0000","last_change":"2023-10-06T11:09:41.213317+0000","last_active":"2023-10-06T11:09:41.216096+0000","last_peered":"2023-10-06T11:09:41.216096+0000","last_clean":"2023-10-06T11:09:41.216096+0000","last_became_active":"2023-10-06T11:09:41.212888+0000","last_became_peered":"2023-10-06T11:09:41.212888+0000","last_unstale":"2023-10-06T11:09:41.216096+0000","last_undegraded":"2023-10-06T11:09:41.216096+0000","last_fullsized":"2023-10-06T11:09:41.216096+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:14.423152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.235268+0000","last_change":"2023-10-06T11:09:42.235268+0000","last_active":"2023-10-06T11:09:42.235268+0000","last_peered":"2023-10-06T11:09:42.235268+0000","last_clean":"2023-10-06T11:09:42.235268+0000","last_became_active":"2023-10-06T11:09:42.234996+0000","last_became_peered":"2023-10-06T11:09:42.234996+0000","last_unstale":"2023-10-06T11:09:42.235268+0000","last_undegraded":"2023-10-06T11:09:42.235268+0000","last_fullsized":"2023-10-06T11:09:42.235268+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:39:06.623968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"58'2","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.344725+0000","last_change":"2023-10-06T11:09:41.216177+0000","last_active":"2023-10-06T11:09:42.344725+0000","last_peered":"2023-10-06T11:09:42.344725+0000","last_clean":"2023-10-06T11:09:42.344725+0000","last_became_active":"2023-10-06T11:09:41.215915+0000","last_became_peered":"2023-10-06T11:09:41.215915+0000","last_unstale":"2023-10-06T11:09:42.344725+0000","last_undegraded":"2023-10-06T11:09:42.344725+0000","last_fullsized":"2023-10-06T11:09:42.344725+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:05:30.427724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.239145+0000","last_change":"2023-10-06T11:09:42.235415+0000","last_active":"2023-10-06T11:09:42.239145+0000","last_peered":"2023-10-06T11:09:42.239145+0000","last_clean":"2023-10-06T11:09:42.239145+0000","last_became_active":"2023-10-06T11:09:42.235022+0000","last_became_peered":"2023-10-06T11:09:42.235022+0000","last_unstale":"2023-10-06T11:09:42.239145+0000","last_undegraded":"2023-10-06T11:09:42.239145+0000","last_fullsized":"2023-10-06T11:09:42.239145+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:25.857721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.231353+0000","last_change":"2023-10-06T11:09:41.217104+0000","last_active":"2023-10-06T11:09:42.231353+0000","last_peered":"2023-10-06T11:09:42.231353+0000","last_clean":"2023-10-06T11:09:42.231353+0000","last_became_active":"2023-10-06T11:09:41.216693+0000","last_became_peered":"2023-10-06T11:09:41.216693+0000","last_unstale":"2023-10-06T11:09:42.231353+0000","last_undegraded":"2023-10-06T11:09:42.231353+0000","last_fullsized":"2023-10-06T11:09:42.231353+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:30.756704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.230985+0000","last_change":"2023-10-06T11:09:42.230985+0000","last_active":"2023-10-06T11:09:42.230985+0000","last_peered":"2023-10-06T11:09:42.230985+0000","last_clean":"2023-10-06T11:09:42.230985+0000","last_became_active":"2023-10-06T11:09:42.230741+0000","last_became_peered":"2023-10-06T11:09:42.230741+0000","last_unstale":"2023-10-06T11:09:42.230985+0000","last_undegraded":"2023-10-06T11:09:42.230985+0000","last_fullsized":"2023-10-06T11:09:42.230985+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:04:41.583424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.218104+0000","last_change":"2023-10-06T11:09:41.217240+0000","last_active":"2023-10-06T11:09:42.218104+0000","last_peered":"2023-10-06T11:09:42.218104+0000","last_clean":"2023-10-06T11:09:42.218104+0000","last_became_active":"2023-10-06T11:09:41.216980+0000","last_became_peered":"2023-10-06T11:09:41.216980+0000","last_unstale":"2023-10-06T11:09:42.218104+0000","last_undegraded":"2023-10-06T11:09:42.218104+0000","last_fullsized":"2023-10-06T11:09:42.218104+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:07:10.157853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.234850+0000","last_change":"2023-10-06T11:09:42.234850+0000","last_active":"2023-10-06T11:09:42.234850+0000","last_peered":"2023-10-06T11:09:42.234850+0000","last_clean":"2023-10-06T11:09:42.234850+0000","last_became_active":"2023-10-06T11:09:42.234572+0000","last_became_peered":"2023-10-06T11:09:42.234572+0000","last_unstale":"2023-10-06T11:09:42.234850+0000","last_undegraded":"2023-10-06T11:09:42.234850+0000","last_fullsized":"2023-10-06T11:09:42.234850+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:25.857721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.214988+0000","last_change":"2023-10-06T11:09:41.213789+0000","last_active":"2023-10-06T11:09:41.214988+0000","last_peered":"2023-10-06T11:09:41.214988+0000","last_clean":"2023-10-06T11:09:41.214988+0000","last_became_active":"2023-10-06T11:09:41.213505+0000","last_became_peered":"2023-10-06T11:09:41.213505+0000","last_unstale":"2023-10-06T11:09:41.214988+0000","last_undegraded":"2023-10-06T11:09:41.214988+0000","last_fullsized":"2023-10-06T11:09:41.214988+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:14.423152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.236925+0000","last_change":"2023-10-06T11:09:42.232334+0000","last_active":"2023-10-06T11:09:42.236925+0000","last_peered":"2023-10-06T11:09:42.236925+0000","last_clean":"2023-10-06T11:09:42.236925+0000","last_became_active":"2023-10-06T11:09:42.232077+0000","last_became_peered":"2023-10-06T11:09:42.232077+0000","last_unstale":"2023-10-06T11:09:42.236925+0000","last_undegraded":"2023-10-06T11:09:42.236925+0000","last_fullsized":"2023-10-06T11:09:42.236925+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:00:29.071879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"58'2","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.343400+0000","last_change":"2023-10-06T11:09:41.213087+0000","last_active":"2023-10-06T11:09:42.343400+0000","last_peered":"2023-10-06T11:09:42.343400+0000","last_clean":"2023-10-06T11:09:42.343400+0000","last_became_active":"2023-10-06T11:09:41.212812+0000","last_became_peered":"2023-10-06T11:09:41.212812+0000","last_unstale":"2023-10-06T11:09:42.343400+0000","last_undegraded":"2023-10-06T11:09:42.343400+0000","last_fullsized":"2023-10-06T11:09:42.343400+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:14.423152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.227689+0000","last_change":"2023-10-06T11:09:42.225271+0000","last_active":"2023-10-06T11:09:42.227689+0000","last_peered":"2023-10-06T11:09:42.227689+0000","last_clean":"2023-10-06T11:09:42.227689+0000","last_became_active":"2023-10-06T11:09:42.225049+0000","last_became_peered":"2023-10-06T11:09:42.225049+0000","last_unstale":"2023-10-06T11:09:42.227689+0000","last_undegraded":"2023-10-06T11:09:42.227689+0000","last_fullsized":"2023-10-06T11:09:42.227689+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:51:25.725356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"59'1","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T11:09:43.221169+0000","last_change":"2023-10-06T11:09:41.211660+0000","last_active":"2023-10-06T11:09:43.221169+0000","last_peered":"2023-10-06T11:09:43.221169+0000","last_clean":"2023-10-06T11:09:43.221169+0000","last_became_active":"2023-10-06T11:09:41.209522+0000","last_became_peered":"2023-10-06T11:09:41.209522+0000","last_unstale":"2023-10-06T11:09:43.221169+0000","last_undegraded":"2023-10-06T11:09:43.221169+0000","last_fullsized":"2023-10-06T11:09:43.221169+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:29.500970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.238282+0000","last_change":"2023-10-06T11:09:42.235095+0000","last_active":"2023-10-06T11:09:42.238282+0000","last_peered":"2023-10-06T11:09:42.238282+0000","last_clean":"2023-10-06T11:09:42.238282+0000","last_became_active":"2023-10-06T11:09:42.234870+0000","last_became_peered":"2023-10-06T11:09:42.234870+0000","last_unstale":"2023-10-06T11:09:42.238282+0000","last_undegraded":"2023-10-06T11:09:42.238282+0000","last_fullsized":"2023-10-06T11:09:42.238282+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:10:47.746855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.224304+0000","last_change":"2023-10-06T11:09:41.212942+0000","last_active":"2023-10-06T11:09:42.224304+0000","last_peered":"2023-10-06T11:09:42.224304+0000","last_clean":"2023-10-06T11:09:42.224304+0000","last_became_active":"2023-10-06T11:09:41.212251+0000","last_became_peered":"2023-10-06T11:09:41.212251+0000","last_unstale":"2023-10-06T11:09:42.224304+0000","last_undegraded":"2023-10-06T11:09:42.224304+0000","last_fullsized":"2023-10-06T11:09:42.224304+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:14.895309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.257270+0000","last_change":"2023-10-06T11:09:42.257270+0000","last_active":"2023-10-06T11:09:42.257270+0000","last_peered":"2023-10-06T11:09:42.257270+0000","last_clean":"2023-10-06T11:09:42.257270+0000","last_became_active":"2023-10-06T11:09:42.256903+0000","last_became_peered":"2023-10-06T11:09:42.256903+0000","last_unstale":"2023-10-06T11:09:42.257270+0000","last_undegraded":"2023-10-06T11:09:42.257270+0000","last_fullsized":"2023-10-06T11:09:42.257270+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:30.505629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.216079+0000","last_change":"2023-10-06T11:09:41.213157+0000","last_active":"2023-10-06T11:09:41.216079+0000","last_peered":"2023-10-06T11:09:41.216079+0000","last_clean":"2023-10-06T11:09:41.216079+0000","last_became_active":"2023-10-06T11:09:41.212578+0000","last_became_peered":"2023-10-06T11:09:41.212578+0000","last_unstale":"2023-10-06T11:09:41.216079+0000","last_undegraded":"2023-10-06T11:09:41.216079+0000","last_fullsized":"2023-10-06T11:09:41.216079+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:55:58.933120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.232043+0000","last_change":"2023-10-06T11:09:42.232043+0000","last_active":"2023-10-06T11:09:42.232043+0000","last_peered":"2023-10-06T11:09:42.232043+0000","last_clean":"2023-10-06T11:09:42.232043+0000","last_became_active":"2023-10-06T11:09:42.231775+0000","last_became_peered":"2023-10-06T11:09:42.231775+0000","last_unstale":"2023-10-06T11:09:42.232043+0000","last_undegraded":"2023-10-06T11:09:42.232043+0000","last_fullsized":"2023-10-06T11:09:42.232043+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:05:12.404425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.220015+0000","last_change":"2023-10-06T11:09:41.218001+0000","last_active":"2023-10-06T11:09:42.220015+0000","last_peered":"2023-10-06T11:09:42.220015+0000","last_clean":"2023-10-06T11:09:42.220015+0000","last_became_active":"2023-10-06T11:09:41.217073+0000","last_became_peered":"2023-10-06T11:09:41.217073+0000","last_unstale":"2023-10-06T11:09:42.220015+0000","last_undegraded":"2023-10-06T11:09:42.220015+0000","last_fullsized":"2023-10-06T11:09:42.220015+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:29:32.567167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.236348+0000","last_change":"2023-10-06T11:09:42.236348+0000","last_active":"2023-10-06T11:09:42.236348+0000","last_peered":"2023-10-06T11:09:42.236348+0000","last_clean":"2023-10-06T11:09:42.236348+0000","last_became_active":"2023-10-06T11:09:42.236035+0000","last_became_peered":"2023-10-06T11:09:42.236035+0000","last_unstale":"2023-10-06T11:09:42.236348+0000","last_undegraded":"2023-10-06T11:09:42.236348+0000","last_fullsized":"2023-10-06T11:09:42.236348+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:37:07.428678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.222013+0000","last_change":"2023-10-06T11:09:41.211301+0000","last_active":"2023-10-06T11:09:42.222013+0000","last_peered":"2023-10-06T11:09:42.222013+0000","last_clean":"2023-10-06T11:09:42.222013+0000","last_became_active":"2023-10-06T11:09:41.211014+0000","last_became_peered":"2023-10-06T11:09:41.211014+0000","last_unstale":"2023-10-06T11:09:42.222013+0000","last_undegraded":"2023-10-06T11:09:42.222013+0000","last_fullsized":"2023-10-06T11:09:42.222013+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:51:52.446155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.230829+0000","last_change":"2023-10-06T11:09:42.230829+0000","last_active":"2023-10-06T11:09:42.230829+0000","last_peered":"2023-10-06T11:09:42.230829+0000","last_clean":"2023-10-06T11:09:42.230829+0000","last_became_active":"2023-10-06T11:09:42.230511+0000","last_became_peered":"2023-10-06T11:09:42.230511+0000","last_unstale":"2023-10-06T11:09:42.230829+0000","last_undegraded":"2023-10-06T11:09:42.230829+0000","last_fullsized":"2023-10-06T11:09:42.230829+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:52:18.608330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.221814+0000","last_change":"2023-10-06T11:09:41.218854+0000","last_active":"2023-10-06T11:09:42.221814+0000","last_peered":"2023-10-06T11:09:42.221814+0000","last_clean":"2023-10-06T11:09:42.221814+0000","last_became_active":"2023-10-06T11:09:41.218572+0000","last_became_peered":"2023-10-06T11:09:41.218572+0000","last_unstale":"2023-10-06T11:09:42.221814+0000","last_undegraded":"2023-10-06T11:09:42.221814+0000","last_fullsized":"2023-10-06T11:09:42.221814+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:06:06.843348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.234800+0000","last_change":"2023-10-06T11:09:42.229708+0000","last_active":"2023-10-06T11:09:42.234800+0000","last_peered":"2023-10-06T11:09:42.234800+0000","last_clean":"2023-10-06T11:09:42.234800+0000","last_became_active":"2023-10-06T11:09:42.229446+0000","last_became_peered":"2023-10-06T11:09:42.229446+0000","last_unstale":"2023-10-06T11:09:42.234800+0000","last_undegraded":"2023-10-06T11:09:42.234800+0000","last_fullsized":"2023-10-06T11:09:42.234800+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:33:05.628031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.217159+0000","last_change":"2023-10-06T11:09:41.214668+0000","last_active":"2023-10-06T11:09:41.217159+0000","last_peered":"2023-10-06T11:09:41.217159+0000","last_clean":"2023-10-06T11:09:41.217159+0000","last_became_active":"2023-10-06T11:09:41.214427+0000","last_became_peered":"2023-10-06T11:09:41.214427+0000","last_unstale":"2023-10-06T11:09:41.217159+0000","last_undegraded":"2023-10-06T11:09:41.217159+0000","last_fullsized":"2023-10-06T11:09:41.217159+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:08:49.990834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.228930+0000","last_change":"2023-10-06T11:09:42.228930+0000","last_active":"2023-10-06T11:09:42.228930+0000","last_peered":"2023-10-06T11:09:42.228930+0000","last_clean":"2023-10-06T11:09:42.228930+0000","last_became_active":"2023-10-06T11:09:42.228558+0000","last_became_peered":"2023-10-06T11:09:42.228558+0000","last_unstale":"2023-10-06T11:09:42.228930+0000","last_undegraded":"2023-10-06T11:09:42.228930+0000","last_fullsized":"2023-10-06T11:09:42.228930+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:13.716196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"58'1","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.342602+0000","last_change":"2023-10-06T11:09:41.218292+0000","last_active":"2023-10-06T11:09:42.342602+0000","last_peered":"2023-10-06T11:09:42.342602+0000","last_clean":"2023-10-06T11:09:42.342602+0000","last_became_active":"2023-10-06T11:09:41.217963+0000","last_became_peered":"2023-10-06T11:09:41.217963+0000","last_unstale":"2023-10-06T11:09:42.342602+0000","last_undegraded":"2023-10-06T11:09:42.342602+0000","last_fullsized":"2023-10-06T11:09:42.342602+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:52.890087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":47,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.205019+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:09:41.205019+0000","last_peered":"2023-10-06T11:09:41.205019+0000","last_clean":"2023-10-06T11:09:41.205019+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:09:41.205019+0000","last_undegraded":"2023-10-06T11:09:41.205019+0000","last_fullsized":"2023-10-06T11:09:41.205019+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.257731+0000","last_change":"2023-10-06T11:09:42.257731+0000","last_active":"2023-10-06T11:09:42.257731+0000","last_peered":"2023-10-06T11:09:42.257731+0000","last_clean":"2023-10-06T11:09:42.257731+0000","last_became_active":"2023-10-06T11:09:42.257516+0000","last_became_peered":"2023-10-06T11:09:42.257516+0000","last_unstale":"2023-10-06T11:09:42.257731+0000","last_undegraded":"2023-10-06T11:09:42.257731+0000","last_fullsized":"2023-10-06T11:09:42.257731+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:31.761363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.222148+0000","last_change":"2023-10-06T11:09:41.213322+0000","last_active":"2023-10-06T11:09:42.222148+0000","last_peered":"2023-10-06T11:09:42.222148+0000","last_clean":"2023-10-06T11:09:42.222148+0000","last_became_active":"2023-10-06T11:09:41.213046+0000","last_became_peered":"2023-10-06T11:09:41.213046+0000","last_unstale":"2023-10-06T11:09:42.222148+0000","last_undegraded":"2023-10-06T11:09:42.222148+0000","last_fullsized":"2023-10-06T11:09:42.222148+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:27.750667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":48,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.222224+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:09:42.222224+0000","last_peered":"2023-10-06T11:09:42.222224+0000","last_clean":"2023-10-06T11:09:42.222224+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:09:42.222224+0000","last_undegraded":"2023-10-06T11:09:42.222224+0000","last_fullsized":"2023-10-06T11:09:42.222224+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.234657+0000","last_change":"2023-10-06T11:09:42.228444+0000","last_active":"2023-10-06T11:09:42.234657+0000","last_peered":"2023-10-06T11:09:42.234657+0000","last_clean":"2023-10-06T11:09:42.234657+0000","last_became_active":"2023-10-06T11:09:42.228189+0000","last_became_peered":"2023-10-06T11:09:42.228189+0000","last_unstale":"2023-10-06T11:09:42.234657+0000","last_undegraded":"2023-10-06T11:09:42.234657+0000","last_fullsized":"2023-10-06T11:09:42.234657+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:33.287742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"58'2","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.344680+0000","last_change":"2023-10-06T11:09:41.215573+0000","last_active":"2023-10-06T11:09:42.344680+0000","last_peered":"2023-10-06T11:09:42.344680+0000","last_clean":"2023-10-06T11:09:42.344680+0000","last_became_active":"2023-10-06T11:09:41.215351+0000","last_became_peered":"2023-10-06T11:09:41.215351+0000","last_unstale":"2023-10-06T11:09:42.344680+0000","last_undegraded":"2023-10-06T11:09:42.344680+0000","last_fullsized":"2023-10-06T11:09:42.344680+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:53:09.457192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":44,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.199334+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:09:41.199334+0000","last_peered":"2023-10-06T11:09:41.199334+0000","last_clean":"2023-10-06T11:09:41.199334+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:09:41.199334+0000","last_undegraded":"2023-10-06T11:09:41.199334+0000","last_fullsized":"2023-10-06T11:09:41.199334+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":193,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.220446+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:09:42.220446+0000","last_peered":"2023-10-06T11:09:42.220446+0000","last_clean":"2023-10-06T11:09:42.220446+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:09:42.220446+0000","last_undegraded":"2023-10-06T11:09:42.220446+0000","last_fullsized":"2023-10-06T11:09:42.220446+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.233181+0000","last_change":"2023-10-06T11:09:42.229398+0000","last_active":"2023-10-06T11:09:42.233181+0000","last_peered":"2023-10-06T11:09:42.233181+0000","last_clean":"2023-10-06T11:09:42.233181+0000","last_became_active":"2023-10-06T11:09:42.229067+0000","last_became_peered":"2023-10-06T11:09:42.229067+0000","last_unstale":"2023-10-06T11:09:42.233181+0000","last_undegraded":"2023-10-06T11:09:42.233181+0000","last_fullsized":"2023-10-06T11:09:42.233181+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:07:11.162512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.231947+0000","last_change":"2023-10-06T11:09:41.216944+0000","last_active":"2023-10-06T11:09:42.231947+0000","last_peered":"2023-10-06T11:09:42.231947+0000","last_clean":"2023-10-06T11:09:42.231947+0000","last_became_active":"2023-10-06T11:09:41.216394+0000","last_became_peered":"2023-10-06T11:09:41.216394+0000","last_unstale":"2023-10-06T11:09:42.231947+0000","last_undegraded":"2023-10-06T11:09:42.231947+0000","last_fullsized":"2023-10-06T11:09:42.231947+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:57.202092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":43,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.218488+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:09:42.218488+0000","last_peered":"2023-10-06T11:09:42.218488+0000","last_clean":"2023-10-06T11:09:42.218488+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:09:42.218488+0000","last_undegraded":"2023-10-06T11:09:42.218488+0000","last_fullsized":"2023-10-06T11:09:42.218488+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.228539+0000","last_change":"2023-10-06T11:09:42.228539+0000","last_active":"2023-10-06T11:09:42.228539+0000","last_peered":"2023-10-06T11:09:42.228539+0000","last_clean":"2023-10-06T11:09:42.228539+0000","last_became_active":"2023-10-06T11:09:42.228200+0000","last_became_peered":"2023-10-06T11:09:42.228200+0000","last_unstale":"2023-10-06T11:09:42.228539+0000","last_undegraded":"2023-10-06T11:09:42.228539+0000","last_fullsized":"2023-10-06T11:09:42.228539+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:47:49.153165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.221497+0000","last_change":"2023-10-06T11:09:41.219234+0000","last_active":"2023-10-06T11:09:42.221497+0000","last_peered":"2023-10-06T11:09:42.221497+0000","last_clean":"2023-10-06T11:09:42.221497+0000","last_became_active":"2023-10-06T11:09:41.218988+0000","last_became_peered":"2023-10-06T11:09:41.218988+0000","last_unstale":"2023-10-06T11:09:42.221497+0000","last_undegraded":"2023-10-06T11:09:42.221497+0000","last_fullsized":"2023-10-06T11:09:42.221497+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:06:17.950887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":43,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.220549+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:09:42.220549+0000","last_peered":"2023-10-06T11:09:42.220549+0000","last_clean":"2023-10-06T11:09:42.220549+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:09:42.220549+0000","last_undegraded":"2023-10-06T11:09:42.220549+0000","last_fullsized":"2023-10-06T11:09:42.220549+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.226066+0000","last_change":"2023-10-06T11:09:42.226066+0000","last_active":"2023-10-06T11:09:42.226066+0000","last_peered":"2023-10-06T11:09:42.226066+0000","last_clean":"2023-10-06T11:09:42.226066+0000","last_became_active":"2023-10-06T11:09:42.225791+0000","last_became_peered":"2023-10-06T11:09:42.225791+0000","last_unstale":"2023-10-06T11:09:42.226066+0000","last_undegraded":"2023-10-06T11:09:42.226066+0000","last_fullsized":"2023-10-06T11:09:42.226066+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:08:50.995493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.223496+0000","last_change":"2023-10-06T11:09:41.214421+0000","last_active":"2023-10-06T11:09:42.223496+0000","last_peered":"2023-10-06T11:09:42.223496+0000","last_clean":"2023-10-06T11:09:42.223496+0000","last_became_active":"2023-10-06T11:09:41.214113+0000","last_became_peered":"2023-10-06T11:09:41.214113+0000","last_unstale":"2023-10-06T11:09:42.223496+0000","last_undegraded":"2023-10-06T11:09:42.223496+0000","last_fullsized":"2023-10-06T11:09:42.223496+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:22:00.022841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":51,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.225391+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:09:42.225391+0000","last_peered":"2023-10-06T11:09:42.225391+0000","last_clean":"2023-10-06T11:09:42.225391+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:09:42.225391+0000","last_undegraded":"2023-10-06T11:09:42.225391+0000","last_fullsized":"2023-10-06T11:09:42.225391+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.234133+0000","last_change":"2023-10-06T11:09:42.234133+0000","last_active":"2023-10-06T11:09:42.234133+0000","last_peered":"2023-10-06T11:09:42.234133+0000","last_clean":"2023-10-06T11:09:42.234133+0000","last_became_active":"2023-10-06T11:09:42.233860+0000","last_became_peered":"2023-10-06T11:09:42.233860+0000","last_unstale":"2023-10-06T11:09:42.234133+0000","last_undegraded":"2023-10-06T11:09:42.234133+0000","last_fullsized":"2023-10-06T11:09:42.234133+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:55:59.937779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"58'2","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.345008+0000","last_change":"2023-10-06T11:09:41.215052+0000","last_active":"2023-10-06T11:09:42.345008+0000","last_peered":"2023-10-06T11:09:42.345008+0000","last_clean":"2023-10-06T11:09:42.345008+0000","last_became_active":"2023-10-06T11:09:41.214778+0000","last_became_peered":"2023-10-06T11:09:41.214778+0000","last_unstale":"2023-10-06T11:09:42.345008+0000","last_undegraded":"2023-10-06T11:09:42.345008+0000","last_fullsized":"2023-10-06T11:09:42.345008+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:24.853062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":46,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.208694+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:09:41.208694+0000","last_peered":"2023-10-06T11:09:41.208694+0000","last_clean":"2023-10-06T11:09:41.208694+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:09:41.208694+0000","last_undegraded":"2023-10-06T11:09:41.208694+0000","last_fullsized":"2023-10-06T11:09:41.208694+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.236061+0000","last_change":"2023-10-06T11:09:42.233367+0000","last_active":"2023-10-06T11:09:42.236061+0000","last_peered":"2023-10-06T11:09:42.236061+0000","last_clean":"2023-10-06T11:09:42.236061+0000","last_became_active":"2023-10-06T11:09:42.233105+0000","last_became_peered":"2023-10-06T11:09:42.233105+0000","last_unstale":"2023-10-06T11:09:42.236061+0000","last_undegraded":"2023-10-06T11:09:42.236061+0000","last_fullsized":"2023-10-06T11:09:42.236061+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:28:02.987423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"58'1","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.342255+0000","last_change":"2023-10-06T11:09:41.218783+0000","last_active":"2023-10-06T11:09:42.342255+0000","last_peered":"2023-10-06T11:09:42.342255+0000","last_clean":"2023-10-06T11:09:42.342255+0000","last_became_active":"2023-10-06T11:09:41.216107+0000","last_became_peered":"2023-10-06T11:09:41.216107+0000","last_unstale":"2023-10-06T11:09:42.342255+0000","last_undegraded":"2023-10-06T11:09:42.342255+0000","last_fullsized":"2023-10-06T11:09:42.342255+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:58.952774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":46,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.207562+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:09:41.207562+0000","last_peered":"2023-10-06T11:09:41.207562+0000","last_clean":"2023-10-06T11:09:41.207562+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:09:41.207562+0000","last_undegraded":"2023-10-06T11:09:41.207562+0000","last_fullsized":"2023-10-06T11:09:41.207562+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":216,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574901,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298576,"kb_used_data":1288,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073264,"statfs":{"total":96636764160,"available":96331022336,"internally_reserved":0,"allocated":1318912,"data_stored":903382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":1.871,"5min":0.73999999999999999,"15min":0.56999999999999995},"min":{"1min":0.41199999999999998,"5min":0.248,"15min":0.248},"max":{"1min":23.908999999999999,"5min":23.908999999999999,"15min":23.908999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":1.127,"5min":0.629,"15min":0.56499999999999995},"min":{"1min":0.374,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":9.0600000000000005,"5min":9.0600000000000005,"15min":9.0600000000000005},"last":0.64200000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":0.63900000000000001,"15min":0.57099999999999995},"min":{"1min":0.40899999999999997,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":9.2360000000000007,"5min":9.2360000000000007,"15min":9.2360000000000007},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.53900000000000003,"15min":0.51600000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":4.327,"5min":4.327,"15min":4.327},"last":0.436}]},{"osd":2,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.504,"15min":0.50900000000000001},"min":{"1min":0.311,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.59599999999999997,"15min":0.55800000000000005},"min":{"1min":0.436,"5min":0.309,"15min":0.309},"max":{"1min":4.7309999999999999,"5min":4.7309999999999999,"15min":4.7309999999999999},"last":0.56599999999999995}]},{"osd":3,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.55400000000000005,"15min":0.51400000000000001},"min":{"1min":0.35299999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":4.3540000000000001,"5min":4.3540000000000001,"15min":4.3540000000000001},"last":0.626},{"interface":"front","average":{"1min":1.1870000000000001,"5min":0.67300000000000004,"15min":0.59999999999999998},"min":{"1min":0.45300000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":9.3879999999999999,"5min":9.3879999999999999,"15min":9.3879999999999999},"last":0.46200000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.50800000000000001,"15min":0.47499999999999998},"min":{"1min":0.34100000000000003,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":4.5709999999999997,"5min":4.5709999999999997,"15min":4.5709999999999997},"last":0.5},{"interface":"front","average":{"1min":0.753,"5min":0.55800000000000005,"15min":0.53500000000000003},"min":{"1min":0.33100000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":4.3129999999999997,"5min":4.3129999999999997,"15min":4.3129999999999997},"last":0.41199999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":0.64100000000000001,"15min":0.58099999999999996},"min":{"1min":0.34200000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":9.3499999999999996,"5min":9.3499999999999996,"15min":9.3499999999999996},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.58299999999999996,"15min":0.56699999999999995},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":4.444,"5min":4.444,"15min":4.444},"last":0.55400000000000005}]},{"osd":6,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":0.67300000000000004,"15min":0.622},"min":{"1min":0.39700000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":9.4969999999999999,"5min":9.4969999999999999,"15min":9.4969999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.66200000000000003,"15min":0.62},"min":{"1min":0.44800000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":7.2039999999999997,"5min":7.2039999999999997,"15min":7.2039999999999997},"last":0.52400000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310240,"kb_used_data":664,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061600,"statfs":{"total":96636764160,"available":96319078400,"internally_reserved":0,"allocated":679936,"data_stored":297156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.48199999999999998,"15min":0.497},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52100000000000002,"15min":0.53300000000000003},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.60599999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.48299999999999998,"15min":0.499},"min":{"1min":0.34100000000000003,"5min":0.253,"15min":0.253},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48499999999999999,"15min":0.499},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.76400000000000001,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.47899999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.53100000000000003,"15min":0.498},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":7.0659999999999998,"5min":7.0659999999999998,"15min":7.0659999999999998},"last":0.502},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.56100000000000005,"15min":0.52900000000000003},"min":{"1min":0.32500000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":7.0819999999999999,"5min":7.0819999999999999,"15min":7.0819999999999999},"last":0.42199999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.49399999999999999,"15min":0.49299999999999999},"min":{"1min":0.32600000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.52700000000000002,"15min":0.53600000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.72799999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.59099999999999997}]},{"osd":4,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.48699999999999999,"15min":0.50700000000000001},"min":{"1min":0.29599999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.64300000000000002,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54300000000000004,"15min":0.56799999999999995},"min":{"1min":0.32100000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.77100000000000002,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.65000000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52200000000000002,"15min":0.53800000000000003},"min":{"1min":0.307,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56299999999999994,"15min":0.58699999999999997},"min":{"1min":0.39500000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.79000000000000004,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.626}]},{"osd":7,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56200000000000006,"15min":0.57699999999999996},"min":{"1min":0.36899999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79500000000000004,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.58999999999999997,"15min":0.60699999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83899999999999997,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.63800000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310824,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061016,"statfs":{"total":96636764160,"available":96318480384,"internally_reserved":0,"allocated":1277952,"data_stored":888877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.33200000000000002,"15min":0.34200000000000003},"min":{"1min":0.24199999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.215,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.307}]},{"osd":2,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.34399999999999997,"15min":0.33600000000000002},"min":{"1min":0.23599999999999999,"5min":0.22,"15min":0.22},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.39600000000000002,"15min":0.38900000000000001},"min":{"1min":0.26500000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.35899999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.41399999999999998,"15min":0.41099999999999998},"min":{"1min":0.28299999999999997,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.68999999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.38100000000000001,"15min":0.36899999999999999},"min":{"1min":0.29799999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.33800000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.53000000000000003,"15min":0.50800000000000001},"min":{"1min":0.34399999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55800000000000005,"15min":0.54000000000000004},"min":{"1min":0.45300000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.503}]},{"osd":5,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55900000000000005,"15min":0.54900000000000004},"min":{"1min":0.38800000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.56299999999999994,"15min":0.54100000000000004},"min":{"1min":0.40000000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.52200000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57199999999999995,"15min":0.56200000000000006},"min":{"1min":0.36899999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.59199999999999997,"15min":0.57399999999999995},"min":{"1min":0.376,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.56399999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.59999999999999998,"15min":0.58999999999999997},"min":{"1min":0.48699999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84299999999999997,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.42899999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.45600000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302072,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069768,"statfs":{"total":96636764160,"available":96327442432,"internally_reserved":0,"allocated":704512,"data_stored":310913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":1.9379999999999999,"5min":0.64700000000000002,"15min":0.44},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":36.097999999999999,"5min":36.097999999999999,"15min":36.097999999999999},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.35999999999999999,"15min":0.34699999999999998},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.33000000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":1.9810000000000001,"5min":0.69099999999999995,"15min":0.48299999999999998},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":36.07,"5min":36.07,"15min":36.07},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.40000000000000002,"15min":0.379},"min":{"1min":0.23200000000000001,"5min":0.219,"15min":0.219},"max":{"1min":5.125,"5min":5.125,"15min":5.125},"last":0.375}]},{"osd":3,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.44,"15min":0.39600000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":8.4130000000000003,"5min":8.4130000000000003,"15min":8.4130000000000003},"last":0.35899999999999999},{"interface":"front","average":{"1min":2.0030000000000001,"5min":0.74399999999999999,"15min":0.54200000000000004},"min":{"1min":0.30199999999999999,"5min":0.252,"15min":0.252},"max":{"1min":35.959000000000003,"5min":35.959000000000003,"15min":35.959000000000003},"last":0.41399999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.56799999999999995,"15min":0.56299999999999994},"min":{"1min":0.48199999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.497},{"interface":"front","average":{"1min":2.2120000000000002,"5min":0.92700000000000005,"15min":0.72099999999999997},"min":{"1min":0.48999999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":36.005000000000003,"5min":36.005000000000003,"15min":36.005000000000003},"last":0.52000000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.55700000000000005,"15min":0.55400000000000005},"min":{"1min":0.433,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56299999999999994,"15min":0.54900000000000004},"min":{"1min":0.45700000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.59899999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":2.194,"5min":0.91900000000000004,"15min":0.71699999999999997},"min":{"1min":0.47199999999999998,"5min":0.375,"15min":0.375},"max":{"1min":36.037999999999997,"5min":36.037999999999997,"15min":36.037999999999997},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.63900000000000001,"15min":0.61699999999999999},"min":{"1min":0.434,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":4.8810000000000002,"5min":4.8810000000000002,"15min":4.8810000000000002},"last":0.64400000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60599999999999998,"15min":0.60799999999999998},"min":{"1min":0.41499999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":2.3530000000000002,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.626,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.44500000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.65500000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574902,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310264,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061576,"statfs":{"total":96636764160,"available":96319053824,"internally_reserved":0,"allocated":704512,"data_stored":310913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.309,"15min":0.309},"min":{"1min":0.22500000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.437,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.218},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38100000000000001,"15min":0.38500000000000001},"min":{"1min":0.26900000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.51400000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.33000000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36899999999999999,"15min":0.375},"min":{"1min":0.24399999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.254},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.35399999999999998,"15min":0.34799999999999998},"min":{"1min":0.26900000000000002,"5min":0.217,"15min":0.217},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.34399999999999997}]},{"osd":3,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.37,"15min":0.373},"min":{"1min":0.27800000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.373,"5min":0.36499999999999999,"15min":0.36699999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.31}]},{"osd":4,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.33900000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.38900000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.52800000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.55200000000000005,"15min":0.55000000000000004},"min":{"1min":0.374,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.41799999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.64300000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58299999999999996,"15min":0.58399999999999996},"min":{"1min":0.43099999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41399999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.627}]},{"osd":7,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.55900000000000005,"15min":0.55000000000000004},"min":{"1min":0.436,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.57099999999999995,"15min":0.56999999999999995},"min":{"1min":0.38600000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.61599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574902,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297976,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073864,"statfs":{"total":96636764160,"available":96331636736,"internally_reserved":0,"allocated":704512,"data_stored":310913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.313,"15min":0.32700000000000001},"min":{"1min":0.218,"5min":0.188,"15min":0.188},"max":{"1min":0.47099999999999997,"5min":1.095,"15min":1.095},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.38,"15min":0.40200000000000002},"min":{"1min":0.30399999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.52400000000000002,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.31}]},{"osd":1,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.313,"15min":0.309},"min":{"1min":0.23200000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.46899999999999997,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.35999999999999999,"15min":0.37},"min":{"1min":0.25900000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.48599999999999999,"5min":1.196,"15min":1.196},"last":0.33100000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.374,"15min":0.39200000000000002},"min":{"1min":0.26500000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.54000000000000004,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.40799999999999997,"15min":0.42199999999999999},"min":{"1min":0.32700000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.55900000000000005,"5min":1.224,"15min":1.224},"last":0.36499999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.55400000000000005,"15min":0.57399999999999995},"min":{"1min":0.41699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69399999999999995,"5min":1.694,"15min":1.694},"last":0.628},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.54600000000000004,"15min":0.54800000000000004},"min":{"1min":0.46400000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.58699999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.54600000000000004,"15min":0.52800000000000002},"min":{"1min":0.436,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79400000000000004,"5min":0.878,"15min":0.878},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55900000000000005,"15min":0.56699999999999995},"min":{"1min":0.49399999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72699999999999998,"5min":1.165,"15min":1.165},"last":0.68700000000000006}]},{"osd":6,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58699999999999997,"15min":0.59499999999999997},"min":{"1min":0.46200000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.81299999999999994,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.59599999999999997,"15min":0.60599999999999998},"min":{"1min":0.47099999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78000000000000003,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.70599999999999996}]},{"osd":7,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58199999999999996,"15min":0.59599999999999997},"min":{"1min":0.44800000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.74199999999999999,"5min":1.657,"15min":1.657},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.47899999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83399999999999996,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.61799999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297956,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073884,"statfs":{"total":96636764160,"available":96331657216,"internally_reserved":0,"allocated":684032,"data_stored":298509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.54800000000000004,"15min":0.60299999999999998},"min":{"1min":0.28899999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.74099999999999999,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48299999999999998,"15min":0.499},"min":{"1min":0.28599999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.64500000000000002,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.624}]},{"osd":1,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.57499999999999996,"15min":0.628},"min":{"1min":0.28799999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66100000000000003,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.57699999999999996,"15min":0.629},"min":{"1min":0.32900000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.74199999999999999,"5min":2.7610000000000001,"15min":2.7610000000000001},"last":0.64000000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.54200000000000004,"15min":0.58199999999999996},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.60399999999999998,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58999999999999997,"15min":0.61899999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.76500000000000001,"5min":1.718,"15min":1.718},"last":0.58299999999999996}]},{"osd":3,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.60199999999999998,"15min":0.64800000000000002},"min":{"1min":0.36799999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.67600000000000005,"5min":2.677,"15min":2.677},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.51100000000000001,"15min":0.52400000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.48399999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.47299999999999998,"15min":0.497},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.52300000000000002,"15min":0.54700000000000004},"min":{"1min":0.307,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.71999999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.54400000000000004}]},{"osd":6,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.51000000000000001,"15min":0.53400000000000003},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.56100000000000005,"15min":0.59499999999999997},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.86899999999999999,"5min":1.165,"15min":1.165},"last":0.50800000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.55900000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59099999999999997,"15min":0.61599999999999999},"min":{"1min":0.37,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.76700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574903,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310272,"kb_used_data":696,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061568,"statfs":{"total":96636764160,"available":96319045632,"internally_reserved":0,"allocated":712704,"data_stored":312288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.61799999999999999,"15min":0.70799999999999996},"min":{"1min":0.28399999999999997,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.69499999999999995,"5min":5.0490000000000004,"15min":5.0490000000000004},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.57599999999999996,"15min":0.67600000000000005},"min":{"1min":0.28100000000000003,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.64700000000000002,"5min":5.1449999999999996,"15min":5.1449999999999996},"last":0.41599999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48499999999999999,"15min":0.49099999999999999},"min":{"1min":0.27500000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.75600000000000001,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.438},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52100000000000002,"15min":0.52900000000000003},"min":{"1min":0.30299999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.70999999999999996,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.52300000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57899999999999996,"15min":0.56699999999999995},"min":{"1min":0.41299999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.74099999999999999,"5min":4.234,"15min":4.234},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56699999999999995,"15min":0.57699999999999996},"min":{"1min":0.40000000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72999999999999998,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.55000000000000004}]},{"osd":3,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.61499999999999999,"15min":0.72699999999999998},"min":{"1min":0.32600000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.72099999999999997,"5min":5.2169999999999996,"15min":5.2169999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54900000000000004,"15min":0.55500000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.70199999999999996,"5min":1.008,"15min":1.008},"last":0.57699999999999996}]},{"osd":4,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52200000000000002,"15min":0.53600000000000003},"min":{"1min":0.32700000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.745,"5min":1.917,"15min":1.917},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53700000000000003,"15min":0.55500000000000005},"min":{"1min":0.34399999999999997,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.68600000000000005,"5min":0.87,"15min":0.87},"last":0.46500000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56999999999999995,"15min":0.58099999999999996},"min":{"1min":0.34100000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.68700000000000006,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":0.496},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.61399999999999999,"15min":0.629},"min":{"1min":0.42199999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.77200000000000002,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":0.48599999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58399999999999996,"15min":0.60699999999999998},"min":{"1min":0.39600000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.70199999999999996,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61499999999999999,"15min":0.628},"min":{"1min":0.38700000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.72999999999999998,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.61099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:09:47.256 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T11:09:47.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.403+0000 7f1a25133700 1 Processor -- start 2023-10-06T11:09:47.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.404+0000 7f1a25133700 1 -- start start 2023-10-06T11:09:47.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.404+0000 7f1a25133700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a20153ab0 0x7f1a2015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:47.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.404+0000 7f1a25133700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1a20153e80 0x7f1a20068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:47.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.404+0000 7f1a25133700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a2015ac30 con 0x7f1a200689d0 2023-10-06T11:09:47.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.404+0000 7f1a25133700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a20068e50 con 0x7f1a20153e80 2023-10-06T11:09:47.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.404+0000 7f1a25133700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a200b4510 con 0x7f1a20153ab0 2023-10-06T11:09:47.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.405+0000 7f1a1ed9d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a20153ab0 0x7f1a2015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:47.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.405+0000 7f1a1e59c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1a20153e80 0x7f1a20068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:47.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.405+0000 7f1a1e59c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1a20153e80 0x7f1a20068490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:57882/0 (socket says 172.21.15.146:57882) 2023-10-06T11:09:47.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.405+0000 7f1a1ed9d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a20153ab0 0x7f1a2015a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:53224/0 (socket says 172.21.15.146:53224) 2023-10-06T11:09:47.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.405+0000 7f1a1f59e700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f1a200689d0 0x7f1a2015d270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:37124/0 (socket says 172.21.15.146:37124) 2023-10-06T11:09:47.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.405+0000 7f1a1e59c700 1 -- 172.21.15.146:0/2976982878 learned_addr learned my addr 172.21.15.146:0/2976982878 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:47.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.405+0000 7f1a1e59c700 1 -- 172.21.15.146:0/2976982878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a20153ab0 msgr2=0x7f1a2015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:47.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.405+0000 7f1a1e59c700 1 --2- 172.21.15.146:0/2976982878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a20153ab0 0x7f1a2015a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:47.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.405+0000 7f1a1e59c700 1 -- 172.21.15.146:0/2976982878 >> v1:172.21.15.151:6789/0 conn(0x7f1a200689d0 legacy=0x7f1a2015d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:47.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.405+0000 7f1a1e59c700 1 -- 172.21.15.146:0/2976982878 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a200b6530 con 0x7f1a20153e80 2023-10-06T11:09:47.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.405+0000 7f1a1ed9d700 1 --2- 172.21.15.146:0/2976982878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a20153ab0 0x7f1a2015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:09:47.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.405+0000 7f1a1e59c700 1 --2- 172.21.15.146:0/2976982878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a20153e80 0x7f1a20068490 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1a140099b0 tx=0x7f1a14009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8cb3ee7ebf4b866 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:47.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.405+0000 7f1a1dd9b700 1 -- 172.21.15.146:0/2976982878 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a14009ea0 con 0x7f1a20153e80 2023-10-06T11:09:47.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.405+0000 7f1a1dd9b700 1 -- 172.21.15.146:0/2976982878 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a1400b860 con 0x7f1a20153e80 2023-10-06T11:09:47.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.405+0000 7f1a1dd9b700 1 -- 172.21.15.146:0/2976982878 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1400bc00 con 0x7f1a20153e80 2023-10-06T11:09:47.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.406+0000 7f1a25133700 1 -- 172.21.15.146:0/2976982878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a20153e80 msgr2=0x7f1a20068490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:47.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.406+0000 7f1a25133700 1 --2- 172.21.15.146:0/2976982878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a20153e80 0x7f1a20068490 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1a140099b0 tx=0x7f1a14009250 comp rx=0 tx=0).stop 2023-10-06T11:09:47.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.406+0000 7f1a25133700 1 -- 172.21.15.146:0/2976982878 shutdown_connections 2023-10-06T11:09:47.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.406+0000 7f1a25133700 1 --2- 172.21.15.146:0/2976982878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a20153ab0 0x7f1a2015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:47.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.406+0000 7f1a25133700 1 --2- 172.21.15.146:0/2976982878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a20153e80 0x7f1a20068490 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:47.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.406+0000 7f1a25133700 1 -- 172.21.15.146:0/2976982878 >> 172.21.15.146:0/2976982878 conn(0x7f1a2006eba0 msgr2=0x7f1a2006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:47.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.406+0000 7f1a25133700 1 -- 172.21.15.146:0/2976982878 shutdown_connections 2023-10-06T11:09:47.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.406+0000 7f1a25133700 1 -- 172.21.15.146:0/2976982878 wait complete. 2023-10-06T11:09:47.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.407+0000 7f1a25133700 1 Processor -- start 2023-10-06T11:09:47.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.407+0000 7f1a25133700 1 -- start start 2023-10-06T11:09:47.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.408+0000 7f1a25133700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a200689d0 0x7f1a201440d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:47.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.408+0000 7f1a25133700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a20153ab0 0x7f1a20156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:47.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.408+0000 7f1a25133700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a20153e80 0x7f1a20156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:47.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.408+0000 7f1a25133700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a20144610 con 0x7f1a20153ab0 2023-10-06T11:09:47.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.408+0000 7f1a25133700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2015a040 con 0x7f1a20153e80 2023-10-06T11:09:47.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.408+0000 7f1a25133700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a201597a0 con 0x7f1a200689d0 2023-10-06T11:09:47.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.408+0000 7f1a1e59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a20153ab0 0x7f1a20156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:47.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.408+0000 7f1a1e59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a20153ab0 0x7f1a20156620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40836/0 (socket says 172.21.15.146:40836) 2023-10-06T11:09:47.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.408+0000 7f1a1e59c700 1 -- 172.21.15.146:0/875564355 learned_addr learned my addr 172.21.15.146:0/875564355 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:47.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.408+0000 7f1a1ed9d700 1 --2- 172.21.15.146:0/875564355 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a200689d0 0x7f1a201440d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:47.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.408+0000 7f1a1f59e700 1 --2- 172.21.15.146:0/875564355 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a20153e80 0x7f1a20156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:47.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.409+0000 7f1a1e59c700 1 -- 172.21.15.146:0/875564355 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a200689d0 msgr2=0x7f1a201440d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:47.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.409+0000 7f1a1e59c700 1 --2- 172.21.15.146:0/875564355 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a200689d0 0x7f1a201440d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:47.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.409+0000 7f1a1e59c700 1 -- 172.21.15.146:0/875564355 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a20153e80 msgr2=0x7f1a20156b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:47.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.409+0000 7f1a1e59c700 1 --2- 172.21.15.146:0/875564355 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a20153e80 0x7f1a20156b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:47.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.409+0000 7f1a1e59c700 1 -- 172.21.15.146:0/875564355 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a10009420 con 0x7f1a20153ab0 2023-10-06T11:09:47.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.409+0000 7f1a1e59c700 1 --2- 172.21.15.146:0/875564355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a20153ab0 0x7f1a20156620 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f1a20089010 tx=0x7f1a14017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:47.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.409+0000 7f1a06ffd700 1 -- 172.21.15.146:0/875564355 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1400bbe0 con 0x7f1a20153ab0 2023-10-06T11:09:47.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.409+0000 7f1a06ffd700 1 -- 172.21.15.146:0/875564355 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a14000c90 con 0x7f1a20153ab0 2023-10-06T11:09:47.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.409+0000 7f1a25133700 1 -- 172.21.15.146:0/875564355 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a140094f0 con 0x7f1a20153ab0 2023-10-06T11:09:47.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.409+0000 7f1a06ffd700 1 -- 172.21.15.146:0/875564355 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a14011650 con 0x7f1a20153ab0 2023-10-06T11:09:47.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.409+0000 7f1a25133700 1 -- 172.21.15.146:0/875564355 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a20159d60 con 0x7f1a20153ab0 2023-10-06T11:09:47.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.410+0000 7f1a25133700 1 -- 172.21.15.146:0/875564355 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a20069180 con 0x7f1a20153ab0 2023-10-06T11:09:47.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.410+0000 7f1a06ffd700 1 -- 172.21.15.146:0/875564355 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1a14011a00 con 0x7f1a20153ab0 2023-10-06T11:09:47.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.411+0000 7f1a06ffd700 1 --2- 172.21.15.146:0/875564355 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1a0c066f30 0x7f1a0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:47.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.411+0000 7f1a06ffd700 1 -- 172.21.15.146:0/875564355 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1a14085e40 con 0x7f1a20153ab0 2023-10-06T11:09:47.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.411+0000 7f1a1ed9d700 1 --2- 172.21.15.146:0/875564355 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1a0c066f30 0x7f1a0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:47.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.411+0000 7f1a1ed9d700 1 --2- 172.21.15.146:0/875564355 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1a0c066f30 0x7f1a0c0693e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1a10009f40 tx=0x7f1a100091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:47.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.415+0000 7f1a06ffd700 1 -- 172.21.15.146:0/875564355 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1a14052f50 con 0x7f1a20153ab0 2023-10-06T11:09:47.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.675+0000 7f1a25133700 1 -- 172.21.15.146:0/875564355 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f1a2004c380 con 0x7f1a20153ab0 2023-10-06T11:09:47.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.676+0000 7f1a06ffd700 1 -- 172.21.15.146:0/875564355 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1566 (secure 0 0 0) 0x7f1a14011cb0 con 0x7f1a20153ab0 2023-10-06T11:09:47.678 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:09:47.678 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":262,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":59,"num_osds":8,"num_up_osds":8,"osd_up_since":1696590336,"num_in_osds":8,"osd_in_since":1696590327,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":14,"data_bytes":590584,"bytes_used":2496696320,"bytes_avail":770597416960,"bytes_total":773094113280,"write_bytes_sec":1535,"read_op_per_sec":0,"write_op_per_sec":3},"fsmap":{"epoch":48,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"b","status":"up:active","gid":6306}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":12,"modified":"2023-10-06T11:09:29.189176+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T11:09:47.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.678+0000 7f1a25133700 1 -- 172.21.15.146:0/875564355 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1a0c066f30 msgr2=0x7f1a0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:47.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.678+0000 7f1a25133700 1 --2- 172.21.15.146:0/875564355 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1a0c066f30 0x7f1a0c0693e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1a10009f40 tx=0x7f1a100091a0 comp rx=0 tx=0).stop 2023-10-06T11:09:47.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.678+0000 7f1a25133700 1 -- 172.21.15.146:0/875564355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a20153ab0 msgr2=0x7f1a20156620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:47.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.678+0000 7f1a25133700 1 --2- 172.21.15.146:0/875564355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a20153ab0 0x7f1a20156620 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f1a20089010 tx=0x7f1a14017000 comp rx=0 tx=0).stop 2023-10-06T11:09:47.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.678+0000 7f1a25133700 1 -- 172.21.15.146:0/875564355 shutdown_connections 2023-10-06T11:09:47.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.678+0000 7f1a25133700 1 --2- 172.21.15.146:0/875564355 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1a0c066f30 0x7f1a0c0693e0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:47.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.678+0000 7f1a25133700 1 --2- 172.21.15.146:0/875564355 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a20153e80 0x7f1a20156b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:47.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.678+0000 7f1a25133700 1 --2- 172.21.15.146:0/875564355 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a200689d0 0x7f1a201440d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:47.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.678+0000 7f1a25133700 1 --2- 172.21.15.146:0/875564355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1a20153ab0 0x7f1a20156620 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:47.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.678+0000 7f1a25133700 1 -- 172.21.15.146:0/875564355 >> 172.21.15.146:0/875564355 conn(0x7f1a2006eba0 msgr2=0x7f1a20151f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:47.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.678+0000 7f1a25133700 1 -- 172.21.15.146:0/875564355 shutdown_connections 2023-10-06T11:09:47.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.678+0000 7f1a25133700 1 -- 172.21.15.146:0/875564355 wait complete. 2023-10-06T11:09:47.694 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-06T11:09:47.694 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:09:47.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.807+0000 7ff62759e700 1 Processor -- start 2023-10-06T11:09:47.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.807+0000 7ff62759e700 1 -- start start 2023-10-06T11:09:47.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.808+0000 7ff62759e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff62815a420 0x7ff62815cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:47.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.808+0000 7ff62759e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff62815c630 con 0x7ff62815a7f0 2023-10-06T11:09:47.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.808+0000 7ff62759e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff62815ba20 con 0x7ff6280b2530 2023-10-06T11:09:47.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.808+0000 7ff62759e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6280ce040 con 0x7ff62815a420 2023-10-06T11:09:47.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.808+0000 7ff625d9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff62815a7f0 0x7ff6280b1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35730/0 (socket says 172.21.15.146:35730) 2023-10-06T11:09:47.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.808+0000 7ff625d9b700 1 -- 172.21.15.146:0/1027489734 learned_addr learned my addr 172.21.15.146:0/1027489734 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:47.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.808+0000 7ff62659c700 1 --2- 172.21.15.146:0/1027489734 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff62815a420 0x7ff62815cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:47.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.809+0000 7ff62559a700 1 -- 172.21.15.146:0/1027489734 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 907876191 0 0) 0x7ff62815c630 con 0x7ff62815a7f0 2023-10-06T11:09:47.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.809+0000 7ff62559a700 1 -- 172.21.15.146:0/1027489734 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff614003570 con 0x7ff62815a7f0 2023-10-06T11:09:47.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.809+0000 7ff62559a700 1 -- 172.21.15.146:0/1027489734 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2729082355 0 0) 0x7ff614003570 con 0x7ff62815a7f0 2023-10-06T11:09:47.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.809+0000 7ff62559a700 1 -- 172.21.15.146:0/1027489734 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff62815a420 msgr2=0x7ff62815cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:47.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.809+0000 7ff62559a700 1 --2- 172.21.15.146:0/1027489734 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff62815a420 0x7ff62815cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:47.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.809+0000 7ff62559a700 1 -- 172.21.15.146:0/1027489734 >> v1:172.21.15.151:6789/0 conn(0x7ff6280b2530 legacy=0x7ff62815acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:47.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.809+0000 7ff62559a700 1 -- 172.21.15.146:0/1027489734 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff62815bd00 con 0x7ff62815a7f0 2023-10-06T11:09:47.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.809+0000 7ff62559a700 1 -- 172.21.15.146:0/1027489734 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7ff610001470 con 0x7ff62815a7f0 2023-10-06T11:09:47.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.809+0000 7ff62559a700 1 -- 172.21.15.146:0/1027489734 >> v1:172.21.15.146:6789/0 conn(0x7ff62815a7f0 legacy=0x7ff6280b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:47.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.809+0000 7ff62559a700 1 --2- 172.21.15.146:0/1027489734 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff62815a420 0x7ff614003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:47.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.809+0000 7ff62559a700 1 --2- 172.21.15.146:0/1027489734 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff614003fd0 0x7ff614004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:47.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.809+0000 7ff62559a700 1 --2- 172.21.15.146:0/1027489734 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff614004d50 0x7ff6140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:47.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.809+0000 7ff62559a700 1 -- 172.21.15.146:0/1027489734 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61400bb10 con 0x7ff614003fd0 2023-10-06T11:09:47.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.809+0000 7ff62559a700 1 -- 172.21.15.146:0/1027489734 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61400bc80 con 0x7ff614004d50 2023-10-06T11:09:47.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.809+0000 7ff62559a700 1 -- 172.21.15.146:0/1027489734 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff61400be40 con 0x7ff62815a420 2023-10-06T11:09:47.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.809+0000 7ff625d9b700 1 --2- 172.21.15.146:0/1027489734 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff614003fd0 0x7ff614004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:47.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.809+0000 7ff62659c700 1 --2- 172.21.15.146:0/1027489734 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff62815a420 0x7ff614003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:47.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.809+0000 7ff626d9d700 1 --2- 172.21.15.146:0/1027489734 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff614004d50 0x7ff6140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:47.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.809+0000 7ff625d9b700 1 -- 172.21.15.146:0/1027489734 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff62815a420 msgr2=0x7ff614003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:47.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.809+0000 7ff625d9b700 1 --2- 172.21.15.146:0/1027489734 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff62815a420 0x7ff614003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:47.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.809+0000 7ff625d9b700 1 -- 172.21.15.146:0/1027489734 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff614004d50 msgr2=0x7ff6140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:47.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.809+0000 7ff625d9b700 1 --2- 172.21.15.146:0/1027489734 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff614004d50 0x7ff6140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:47.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.809+0000 7ff625d9b700 1 -- 172.21.15.146:0/1027489734 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff614003570 con 0x7ff614003fd0 2023-10-06T11:09:47.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.809+0000 7ff625d9b700 1 --2- 172.21.15.146:0/1027489734 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff614003fd0 0x7ff614004810 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7ff61000c390 tx=0x7ff610001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b58d4f1fca613b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:47.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.810+0000 7ff62559a700 1 -- 172.21.15.146:0/1027489734 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61000cc60 con 0x7ff614003fd0 2023-10-06T11:09:47.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.810+0000 7ff62559a700 1 -- 172.21.15.146:0/1027489734 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff61000cde0 con 0x7ff614003fd0 2023-10-06T11:09:47.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.810+0000 7ff62559a700 1 -- 172.21.15.146:0/1027489734 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff610005b70 con 0x7ff614003fd0 2023-10-06T11:09:47.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.810+0000 7ff62759e700 1 -- 172.21.15.146:0/1027489734 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff614003fd0 msgr2=0x7ff614004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:47.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.810+0000 7ff62759e700 1 --2- 172.21.15.146:0/1027489734 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff614003fd0 0x7ff614004810 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7ff61000c390 tx=0x7ff610001e70 comp rx=0 tx=0).stop 2023-10-06T11:09:47.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.810+0000 7ff626d9d700 1 -- 172.21.15.146:0/1027489734 reap_dead start 2023-10-06T11:09:47.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.810+0000 7ff62759e700 1 -- 172.21.15.146:0/1027489734 shutdown_connections 2023-10-06T11:09:47.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.810+0000 7ff62759e700 1 -- 172.21.15.146:0/1027489734 >> 172.21.15.146:0/1027489734 conn(0x7ff62806eba0 msgr2=0x7ff62806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:47.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.810+0000 7ff62759e700 1 -- 172.21.15.146:0/1027489734 shutdown_connections 2023-10-06T11:09:47.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.810+0000 7ff62759e700 1 -- 172.21.15.146:0/1027489734 wait complete. 2023-10-06T11:09:47.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.811+0000 7ff62759e700 1 Processor -- start 2023-10-06T11:09:47.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.811+0000 7ff62759e700 1 -- start start 2023-10-06T11:09:47.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.812+0000 7ff62759e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff614003fd0 0x7ff62814af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:47.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.812+0000 7ff62759e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6280b3cf0 0x7ff628147ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:47.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.812+0000 7ff62759e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6280d00b0 0x7ff6280d0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:47.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.812+0000 7ff62759e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62814ad10 con 0x7ff6280b3cf0 2023-10-06T11:09:47.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.812+0000 7ff62759e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62814b460 con 0x7ff614003fd0 2023-10-06T11:09:47.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.812+0000 7ff62759e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6280d0a50 con 0x7ff6280d00b0 2023-10-06T11:09:47.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.812+0000 7ff625d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6280b3cf0 0x7ff628147ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:47.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.812+0000 7ff625d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6280b3cf0 0x7ff628147ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40868/0 (socket says 172.21.15.146:40868) 2023-10-06T11:09:47.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.812+0000 7ff625d9b700 1 -- 172.21.15.146:0/4198557673 learned_addr learned my addr 172.21.15.146:0/4198557673 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:47.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.812+0000 7ff626d9d700 1 --2- 172.21.15.146:0/4198557673 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6280d00b0 0x7ff6280d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:47.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.812+0000 7ff62659c700 1 --2- 172.21.15.146:0/4198557673 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff614003fd0 0x7ff62814af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:47.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.812+0000 7ff625d9b700 1 -- 172.21.15.146:0/4198557673 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6280d00b0 msgr2=0x7ff6280d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:47.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.812+0000 7ff625d9b700 1 --2- 172.21.15.146:0/4198557673 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6280d00b0 0x7ff6280d0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:47.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.812+0000 7ff625d9b700 1 -- 172.21.15.146:0/4198557673 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff614003fd0 msgr2=0x7ff62814af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:47.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.812+0000 7ff625d9b700 1 --2- 172.21.15.146:0/4198557673 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff614003fd0 0x7ff62814af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:47.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.812+0000 7ff625d9b700 1 -- 172.21.15.146:0/4198557673 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff628148430 con 0x7ff6280b3cf0 2023-10-06T11:09:47.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.812+0000 7ff625d9b700 1 --2- 172.21.15.146:0/4198557673 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6280b3cf0 0x7ff628147ef0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7ff610007cf0 tx=0x7ff610015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:47.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.813+0000 7ff61e7fc700 1 -- 172.21.15.146:0/4198557673 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61000c9b0 con 0x7ff6280b3cf0 2023-10-06T11:09:47.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.813+0000 7ff61e7fc700 1 -- 172.21.15.146:0/4198557673 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6100072e0 con 0x7ff6280b3cf0 2023-10-06T11:09:47.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.813+0000 7ff62759e700 1 -- 172.21.15.146:0/4198557673 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6280b41f0 con 0x7ff6280b3cf0 2023-10-06T11:09:47.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.813+0000 7ff61e7fc700 1 -- 172.21.15.146:0/4198557673 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6100076a0 con 0x7ff6280b3cf0 2023-10-06T11:09:47.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.813+0000 7ff62759e700 1 -- 172.21.15.146:0/4198557673 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6280b47b0 con 0x7ff6280b3cf0 2023-10-06T11:09:47.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.813+0000 7ff62759e700 1 -- 172.21.15.146:0/4198557673 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6280afae0 con 0x7ff6280b3cf0 2023-10-06T11:09:47.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.814+0000 7ff61e7fc700 1 -- 172.21.15.146:0/4198557673 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff610019030 con 0x7ff6280b3cf0 2023-10-06T11:09:47.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.814+0000 7ff61e7fc700 1 --2- 172.21.15.146:0/4198557673 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff608066f30 0x7ff6080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:47.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.814+0000 7ff61e7fc700 1 -- 172.21.15.146:0/4198557673 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff610085910 con 0x7ff6280b3cf0 2023-10-06T11:09:47.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.814+0000 7ff62659c700 1 --2- 172.21.15.146:0/4198557673 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff608066f30 0x7ff6080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:47.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.815+0000 7ff62659c700 1 --2- 172.21.15.146:0/4198557673 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff608066f30 0x7ff6080693e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff618009fd0 tx=0x7ff61800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:47.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.819+0000 7ff61e7fc700 1 -- 172.21.15.146:0/4198557673 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff610052a20 con 0x7ff6280b3cf0 2023-10-06T11:09:47.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:47.997+0000 7ff62759e700 1 -- 172.21.15.146:0/4198557673 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff62815bfe0 con 0x7ff608066f30 2023-10-06T11:09:48.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:48.006+0000 7ff61e7fc700 1 -- 172.21.15.146:0/4198557673 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311245 (secure 0 0 0) 0x7ff62815bfe0 con 0x7ff608066f30 2023-10-06T11:09:48.011 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:09:48.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:48.009+0000 7ff62759e700 1 -- 172.21.15.146:0/4198557673 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff608066f30 msgr2=0x7ff6080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:48.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:48.009+0000 7ff62759e700 1 --2- 172.21.15.146:0/4198557673 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff608066f30 0x7ff6080693e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff618009fd0 tx=0x7ff61800b040 comp rx=0 tx=0).stop 2023-10-06T11:09:48.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:48.009+0000 7ff62759e700 1 -- 172.21.15.146:0/4198557673 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6280b3cf0 msgr2=0x7ff628147ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:48.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:48.009+0000 7ff62759e700 1 --2- 172.21.15.146:0/4198557673 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6280b3cf0 0x7ff628147ef0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7ff610007cf0 tx=0x7ff610015000 comp rx=0 tx=0).stop 2023-10-06T11:09:48.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:48.009+0000 7ff62759e700 1 -- 172.21.15.146:0/4198557673 shutdown_connections 2023-10-06T11:09:48.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:48.009+0000 7ff62759e700 1 --2- 172.21.15.146:0/4198557673 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff608066f30 0x7ff6080693e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:48.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:48.009+0000 7ff62759e700 1 --2- 172.21.15.146:0/4198557673 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6280d00b0 0x7ff6280d0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:48.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:48.009+0000 7ff62759e700 1 --2- 172.21.15.146:0/4198557673 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff614003fd0 0x7ff62814af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:48.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:48.009+0000 7ff62759e700 1 --2- 172.21.15.146:0/4198557673 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6280b3cf0 0x7ff628147ef0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:48.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:48.009+0000 7ff62759e700 1 -- 172.21.15.146:0/4198557673 >> 172.21.15.146:0/4198557673 conn(0x7ff62806eba0 msgr2=0x7ff6280b0470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:48.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:48.009+0000 7ff62759e700 1 -- 172.21.15.146:0/4198557673 shutdown_connections 2023-10-06T11:09:48.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:48.009+0000 7ff62759e700 1 -- 172.21.15.146:0/4198557673 wait complete. 2023-10-06T11:09:48.015 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:09:48.023 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":177,"stamp":"2023-10-06T11:09:47.192439+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590584,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":182,"num_write_kb":2425,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":141,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2438180,"kb_used_data":6628,"kb_used_omap":0,"kb_used_meta":2431488,"kb_avail":752536540,"statfs":{"total":773094113280,"available":770597416960,"internally_reserved":0,"allocated":6787072,"data_stored":3632951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2489843712},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":216,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001277"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.232857+0000","last_change":"2023-10-06T11:09:42.232857+0000","last_active":"2023-10-06T11:09:42.232857+0000","last_peered":"2023-10-06T11:09:42.232857+0000","last_clean":"2023-10-06T11:09:42.232857+0000","last_became_active":"2023-10-06T11:09:42.232668+0000","last_became_peered":"2023-10-06T11:09:42.232668+0000","last_unstale":"2023-10-06T11:09:42.232857+0000","last_undegraded":"2023-10-06T11:09:42.232857+0000","last_fullsized":"2023-10-06T11:09:42.232857+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:05:31.432383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.235533+0000","last_change":"2023-10-06T11:09:42.235533+0000","last_active":"2023-10-06T11:09:42.235533+0000","last_peered":"2023-10-06T11:09:42.235533+0000","last_clean":"2023-10-06T11:09:42.235533+0000","last_became_active":"2023-10-06T11:09:42.235247+0000","last_became_peered":"2023-10-06T11:09:42.235247+0000","last_unstale":"2023-10-06T11:09:42.235533+0000","last_undegraded":"2023-10-06T11:09:42.235533+0000","last_fullsized":"2023-10-06T11:09:42.235533+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:04:57.888469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.233847+0000","last_change":"2023-10-06T11:09:42.225563+0000","last_active":"2023-10-06T11:09:42.233847+0000","last_peered":"2023-10-06T11:09:42.233847+0000","last_clean":"2023-10-06T11:09:42.233847+0000","last_became_active":"2023-10-06T11:09:42.225297+0000","last_became_peered":"2023-10-06T11:09:42.225297+0000","last_unstale":"2023-10-06T11:09:42.233847+0000","last_undegraded":"2023-10-06T11:09:42.233847+0000","last_fullsized":"2023-10-06T11:09:42.233847+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:22:01.027500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.236341+0000","last_change":"2023-10-06T11:09:42.236341+0000","last_active":"2023-10-06T11:09:42.236341+0000","last_peered":"2023-10-06T11:09:42.236341+0000","last_clean":"2023-10-06T11:09:42.236341+0000","last_became_active":"2023-10-06T11:09:42.236063+0000","last_became_peered":"2023-10-06T11:09:42.236063+0000","last_unstale":"2023-10-06T11:09:42.236341+0000","last_undegraded":"2023-10-06T11:09:42.236341+0000","last_fullsized":"2023-10-06T11:09:42.236341+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:25.857721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.233776+0000","last_change":"2023-10-06T11:09:42.233776+0000","last_active":"2023-10-06T11:09:42.233776+0000","last_peered":"2023-10-06T11:09:42.233776+0000","last_clean":"2023-10-06T11:09:42.233776+0000","last_became_active":"2023-10-06T11:09:42.233510+0000","last_became_peered":"2023-10-06T11:09:42.233510+0000","last_unstale":"2023-10-06T11:09:42.233776+0000","last_undegraded":"2023-10-06T11:09:42.233776+0000","last_fullsized":"2023-10-06T11:09:42.233776+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:51:40.439269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.236999+0000","last_change":"2023-10-06T11:09:42.234386+0000","last_active":"2023-10-06T11:09:42.236999+0000","last_peered":"2023-10-06T11:09:42.236999+0000","last_clean":"2023-10-06T11:09:42.236999+0000","last_became_active":"2023-10-06T11:09:42.234150+0000","last_became_peered":"2023-10-06T11:09:42.234150+0000","last_unstale":"2023-10-06T11:09:42.236999+0000","last_undegraded":"2023-10-06T11:09:42.236999+0000","last_fullsized":"2023-10-06T11:09:42.236999+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:23:07.383775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.227283+0000","last_change":"2023-10-06T11:09:42.223581+0000","last_active":"2023-10-06T11:09:42.227283+0000","last_peered":"2023-10-06T11:09:42.227283+0000","last_clean":"2023-10-06T11:09:42.227283+0000","last_became_active":"2023-10-06T11:09:42.223299+0000","last_became_peered":"2023-10-06T11:09:42.223299+0000","last_unstale":"2023-10-06T11:09:42.227283+0000","last_undegraded":"2023-10-06T11:09:42.227283+0000","last_fullsized":"2023-10-06T11:09:42.227283+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:37:14.750346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.240913+0000","last_change":"2023-10-06T11:09:42.237243+0000","last_active":"2023-10-06T11:09:42.240913+0000","last_peered":"2023-10-06T11:09:42.240913+0000","last_clean":"2023-10-06T11:09:42.240913+0000","last_became_active":"2023-10-06T11:09:42.236962+0000","last_became_peered":"2023-10-06T11:09:42.236962+0000","last_unstale":"2023-10-06T11:09:42.240913+0000","last_undegraded":"2023-10-06T11:09:42.240913+0000","last_fullsized":"2023-10-06T11:09:42.240913+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:11:07.460296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.236771+0000","last_change":"2023-10-06T11:09:42.233949+0000","last_active":"2023-10-06T11:09:42.236771+0000","last_peered":"2023-10-06T11:09:42.236771+0000","last_clean":"2023-10-06T11:09:42.236771+0000","last_became_active":"2023-10-06T11:09:42.233703+0000","last_became_peered":"2023-10-06T11:09:42.233703+0000","last_unstale":"2023-10-06T11:09:42.236771+0000","last_undegraded":"2023-10-06T11:09:42.236771+0000","last_fullsized":"2023-10-06T11:09:42.236771+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:53:10.461851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.240935+0000","last_change":"2023-10-06T11:09:42.235877+0000","last_active":"2023-10-06T11:09:42.240935+0000","last_peered":"2023-10-06T11:09:42.240935+0000","last_clean":"2023-10-06T11:09:42.240935+0000","last_became_active":"2023-10-06T11:09:42.235615+0000","last_became_peered":"2023-10-06T11:09:42.235615+0000","last_unstale":"2023-10-06T11:09:42.240935+0000","last_undegraded":"2023-10-06T11:09:42.240935+0000","last_fullsized":"2023-10-06T11:09:42.240935+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:01:52.167469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.232740+0000","last_change":"2023-10-06T11:09:42.232740+0000","last_active":"2023-10-06T11:09:42.232740+0000","last_peered":"2023-10-06T11:09:42.232740+0000","last_clean":"2023-10-06T11:09:42.232740+0000","last_became_active":"2023-10-06T11:09:42.230980+0000","last_became_peered":"2023-10-06T11:09:42.230980+0000","last_unstale":"2023-10-06T11:09:42.232740+0000","last_undegraded":"2023-10-06T11:09:42.232740+0000","last_fullsized":"2023-10-06T11:09:42.232740+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:53.894745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.240874+0000","last_change":"2023-10-06T11:09:42.237074+0000","last_active":"2023-10-06T11:09:42.240874+0000","last_peered":"2023-10-06T11:09:42.240874+0000","last_clean":"2023-10-06T11:09:42.240874+0000","last_became_active":"2023-10-06T11:09:42.236805+0000","last_became_peered":"2023-10-06T11:09:42.236805+0000","last_unstale":"2023-10-06T11:09:42.240874+0000","last_undegraded":"2023-10-06T11:09:42.240874+0000","last_fullsized":"2023-10-06T11:09:42.240874+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:06:54.424848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.238322+0000","last_change":"2023-10-06T11:09:42.234158+0000","last_active":"2023-10-06T11:09:42.238322+0000","last_peered":"2023-10-06T11:09:42.238322+0000","last_clean":"2023-10-06T11:09:42.238322+0000","last_became_active":"2023-10-06T11:09:42.233239+0000","last_became_peered":"2023-10-06T11:09:42.233239+0000","last_unstale":"2023-10-06T11:09:42.238322+0000","last_undegraded":"2023-10-06T11:09:42.238322+0000","last_fullsized":"2023-10-06T11:09:42.238322+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:37:07.428678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.233777+0000","last_change":"2023-10-06T11:09:42.225677+0000","last_active":"2023-10-06T11:09:42.233777+0000","last_peered":"2023-10-06T11:09:42.233777+0000","last_clean":"2023-10-06T11:09:42.233777+0000","last_became_active":"2023-10-06T11:09:42.225397+0000","last_became_peered":"2023-10-06T11:09:42.225397+0000","last_unstale":"2023-10-06T11:09:42.233777+0000","last_undegraded":"2023-10-06T11:09:42.233777+0000","last_fullsized":"2023-10-06T11:09:42.233777+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:15.899968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.234807+0000","last_change":"2023-10-06T11:09:42.231826+0000","last_active":"2023-10-06T11:09:42.234807+0000","last_peered":"2023-10-06T11:09:42.234807+0000","last_clean":"2023-10-06T11:09:42.234807+0000","last_became_active":"2023-10-06T11:09:42.229429+0000","last_became_peered":"2023-10-06T11:09:42.229429+0000","last_unstale":"2023-10-06T11:09:42.234807+0000","last_undegraded":"2023-10-06T11:09:42.234807+0000","last_fullsized":"2023-10-06T11:09:42.234807+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:00:08.984931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.238250+0000","last_change":"2023-10-06T11:09:42.235593+0000","last_active":"2023-10-06T11:09:42.238250+0000","last_peered":"2023-10-06T11:09:42.238250+0000","last_clean":"2023-10-06T11:09:42.238250+0000","last_became_active":"2023-10-06T11:09:42.235344+0000","last_became_peered":"2023-10-06T11:09:42.235344+0000","last_unstale":"2023-10-06T11:09:42.238250+0000","last_undegraded":"2023-10-06T11:09:42.238250+0000","last_fullsized":"2023-10-06T11:09:42.238250+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:32:33.321028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.230670+0000","last_change":"2023-10-06T11:09:42.230670+0000","last_active":"2023-10-06T11:09:42.230670+0000","last_peered":"2023-10-06T11:09:42.230670+0000","last_clean":"2023-10-06T11:09:42.230670+0000","last_became_active":"2023-10-06T11:09:42.230448+0000","last_became_peered":"2023-10-06T11:09:42.230448+0000","last_unstale":"2023-10-06T11:09:42.230670+0000","last_undegraded":"2023-10-06T11:09:42.230670+0000","last_fullsized":"2023-10-06T11:09:42.230670+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:01:57.169564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.232284+0000","last_change":"2023-10-06T11:09:42.232284+0000","last_active":"2023-10-06T11:09:42.232284+0000","last_peered":"2023-10-06T11:09:42.232284+0000","last_clean":"2023-10-06T11:09:42.232284+0000","last_became_active":"2023-10-06T11:09:42.231990+0000","last_became_peered":"2023-10-06T11:09:42.231990+0000","last_unstale":"2023-10-06T11:09:42.232284+0000","last_undegraded":"2023-10-06T11:09:42.232284+0000","last_fullsized":"2023-10-06T11:09:42.232284+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:10:47.746855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.232237+0000","last_change":"2023-10-06T11:09:42.232237+0000","last_active":"2023-10-06T11:09:42.232237+0000","last_peered":"2023-10-06T11:09:42.232237+0000","last_clean":"2023-10-06T11:09:42.232237+0000","last_became_active":"2023-10-06T11:09:42.231280+0000","last_became_peered":"2023-10-06T11:09:42.231280+0000","last_unstale":"2023-10-06T11:09:42.232237+0000","last_undegraded":"2023-10-06T11:09:42.232237+0000","last_fullsized":"2023-10-06T11:09:42.232237+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:15.427811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.256915+0000","last_change":"2023-10-06T11:09:42.256441+0000","last_active":"2023-10-06T11:09:42.256915+0000","last_peered":"2023-10-06T11:09:42.256915+0000","last_clean":"2023-10-06T11:09:42.256915+0000","last_became_active":"2023-10-06T11:09:42.256203+0000","last_became_peered":"2023-10-06T11:09:42.256203+0000","last_unstale":"2023-10-06T11:09:42.256915+0000","last_undegraded":"2023-10-06T11:09:42.256915+0000","last_fullsized":"2023-10-06T11:09:42.256915+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:26.358337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.238311+0000","last_change":"2023-10-06T11:09:42.234079+0000","last_active":"2023-10-06T11:09:42.238311+0000","last_peered":"2023-10-06T11:09:42.238311+0000","last_clean":"2023-10-06T11:09:42.238311+0000","last_became_active":"2023-10-06T11:09:42.232879+0000","last_became_peered":"2023-10-06T11:09:42.232879+0000","last_unstale":"2023-10-06T11:09:42.238311+0000","last_undegraded":"2023-10-06T11:09:42.238311+0000","last_fullsized":"2023-10-06T11:09:42.238311+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:39:06.623968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.256450+0000","last_change":"2023-10-06T11:09:42.255496+0000","last_active":"2023-10-06T11:09:42.256450+0000","last_peered":"2023-10-06T11:09:42.256450+0000","last_clean":"2023-10-06T11:09:42.256450+0000","last_became_active":"2023-10-06T11:09:42.255193+0000","last_became_peered":"2023-10-06T11:09:42.255193+0000","last_unstale":"2023-10-06T11:09:42.256450+0000","last_undegraded":"2023-10-06T11:09:42.256450+0000","last_fullsized":"2023-10-06T11:09:42.256450+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:52:24.958762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.256178+0000","last_change":"2023-10-06T11:09:42.255340+0000","last_active":"2023-10-06T11:09:42.256178+0000","last_peered":"2023-10-06T11:09:42.256178+0000","last_clean":"2023-10-06T11:09:42.256178+0000","last_became_active":"2023-10-06T11:09:42.255102+0000","last_became_peered":"2023-10-06T11:09:42.255102+0000","last_unstale":"2023-10-06T11:09:42.256178+0000","last_undegraded":"2023-10-06T11:09:42.256178+0000","last_fullsized":"2023-10-06T11:09:42.256178+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:40:31.710840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.233890+0000","last_change":"2023-10-06T11:09:42.226062+0000","last_active":"2023-10-06T11:09:42.233890+0000","last_peered":"2023-10-06T11:09:42.233890+0000","last_clean":"2023-10-06T11:09:42.233890+0000","last_became_active":"2023-10-06T11:09:42.225828+0000","last_became_peered":"2023-10-06T11:09:42.225828+0000","last_unstale":"2023-10-06T11:09:42.233890+0000","last_undegraded":"2023-10-06T11:09:42.233890+0000","last_fullsized":"2023-10-06T11:09:42.233890+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:32:21.749142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.240752+0000","last_change":"2023-10-06T11:09:42.236411+0000","last_active":"2023-10-06T11:09:42.240752+0000","last_peered":"2023-10-06T11:09:42.240752+0000","last_clean":"2023-10-06T11:09:42.240752+0000","last_became_active":"2023-10-06T11:09:42.236152+0000","last_became_peered":"2023-10-06T11:09:42.236152+0000","last_unstale":"2023-10-06T11:09:42.240752+0000","last_undegraded":"2023-10-06T11:09:42.240752+0000","last_fullsized":"2023-10-06T11:09:42.240752+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:13.716196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.234008+0000","last_change":"2023-10-06T11:09:42.232091+0000","last_active":"2023-10-06T11:09:42.234008+0000","last_peered":"2023-10-06T11:09:42.234008+0000","last_clean":"2023-10-06T11:09:42.234008+0000","last_became_active":"2023-10-06T11:09:42.231833+0000","last_became_peered":"2023-10-06T11:09:42.231833+0000","last_unstale":"2023-10-06T11:09:42.234008+0000","last_undegraded":"2023-10-06T11:09:42.234008+0000","last_fullsized":"2023-10-06T11:09:42.234008+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:29:33.571825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.231444+0000","last_change":"2023-10-06T11:09:42.231444+0000","last_active":"2023-10-06T11:09:42.231444+0000","last_peered":"2023-10-06T11:09:42.231444+0000","last_clean":"2023-10-06T11:09:42.231444+0000","last_became_active":"2023-10-06T11:09:42.230697+0000","last_became_peered":"2023-10-06T11:09:42.230697+0000","last_unstale":"2023-10-06T11:09:42.231444+0000","last_undegraded":"2023-10-06T11:09:42.231444+0000","last_fullsized":"2023-10-06T11:09:42.231444+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:05:31.432383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.238581+0000","last_change":"2023-10-06T11:09:42.238581+0000","last_active":"2023-10-06T11:09:42.238581+0000","last_peered":"2023-10-06T11:09:42.238581+0000","last_clean":"2023-10-06T11:09:42.238581+0000","last_became_active":"2023-10-06T11:09:42.238389+0000","last_became_peered":"2023-10-06T11:09:42.238389+0000","last_unstale":"2023-10-06T11:09:42.238581+0000","last_undegraded":"2023-10-06T11:09:42.238581+0000","last_fullsized":"2023-10-06T11:09:42.238581+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:13.716196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.234930+0000","last_change":"2023-10-06T11:09:42.232845+0000","last_active":"2023-10-06T11:09:42.234930+0000","last_peered":"2023-10-06T11:09:42.234930+0000","last_clean":"2023-10-06T11:09:42.234930+0000","last_became_active":"2023-10-06T11:09:42.232569+0000","last_became_peered":"2023-10-06T11:09:42.232569+0000","last_unstale":"2023-10-06T11:09:42.234930+0000","last_undegraded":"2023-10-06T11:09:42.234930+0000","last_fullsized":"2023-10-06T11:09:42.234930+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:26.590053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.241020+0000","last_change":"2023-10-06T11:09:42.239073+0000","last_active":"2023-10-06T11:09:42.241020+0000","last_peered":"2023-10-06T11:09:42.241020+0000","last_clean":"2023-10-06T11:09:42.241020+0000","last_became_active":"2023-10-06T11:09:42.238822+0000","last_became_peered":"2023-10-06T11:09:42.238822+0000","last_unstale":"2023-10-06T11:09:42.241020+0000","last_undegraded":"2023-10-06T11:09:42.241020+0000","last_fullsized":"2023-10-06T11:09:42.241020+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:06:18.955546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.230451+0000","last_change":"2023-10-06T11:09:42.230451+0000","last_active":"2023-10-06T11:09:42.230451+0000","last_peered":"2023-10-06T11:09:42.230451+0000","last_clean":"2023-10-06T11:09:42.230451+0000","last_became_active":"2023-10-06T11:09:42.230170+0000","last_became_peered":"2023-10-06T11:09:42.230170+0000","last_unstale":"2023-10-06T11:09:42.230451+0000","last_undegraded":"2023-10-06T11:09:42.230451+0000","last_fullsized":"2023-10-06T11:09:42.230451+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:07:11.162512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.234677+0000","last_change":"2023-10-06T11:09:42.228466+0000","last_active":"2023-10-06T11:09:42.234677+0000","last_peered":"2023-10-06T11:09:42.234677+0000","last_clean":"2023-10-06T11:09:42.234677+0000","last_became_active":"2023-10-06T11:09:42.228215+0000","last_became_peered":"2023-10-06T11:09:42.228215+0000","last_unstale":"2023-10-06T11:09:42.234677+0000","last_undegraded":"2023-10-06T11:09:42.234677+0000","last_fullsized":"2023-10-06T11:09:42.234677+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:20:39.904258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.230224+0000","last_change":"2023-10-06T11:09:42.230224+0000","last_active":"2023-10-06T11:09:42.230224+0000","last_peered":"2023-10-06T11:09:42.230224+0000","last_clean":"2023-10-06T11:09:42.230224+0000","last_became_active":"2023-10-06T11:09:42.229962+0000","last_became_peered":"2023-10-06T11:09:42.229962+0000","last_unstale":"2023-10-06T11:09:42.230224+0000","last_undegraded":"2023-10-06T11:09:42.230224+0000","last_fullsized":"2023-10-06T11:09:42.230224+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:39:11.614060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.215964+0000","last_change":"2023-10-06T11:09:41.213260+0000","last_active":"2023-10-06T11:09:41.215964+0000","last_peered":"2023-10-06T11:09:41.215964+0000","last_clean":"2023-10-06T11:09:41.215964+0000","last_became_active":"2023-10-06T11:09:41.213069+0000","last_became_peered":"2023-10-06T11:09:41.213069+0000","last_unstale":"2023-10-06T11:09:41.215964+0000","last_undegraded":"2023-10-06T11:09:41.215964+0000","last_fullsized":"2023-10-06T11:09:41.215964+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:48:05.076777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.231249+0000","last_change":"2023-10-06T11:09:42.231249+0000","last_active":"2023-10-06T11:09:42.231249+0000","last_peered":"2023-10-06T11:09:42.231249+0000","last_clean":"2023-10-06T11:09:42.231249+0000","last_became_active":"2023-10-06T11:09:42.230418+0000","last_became_peered":"2023-10-06T11:09:42.230418+0000","last_unstale":"2023-10-06T11:09:42.231249+0000","last_undegraded":"2023-10-06T11:09:42.231249+0000","last_fullsized":"2023-10-06T11:09:42.231249+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:29:33.571825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"58'1","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.341943+0000","last_change":"2023-10-06T11:09:41.216511+0000","last_active":"2023-10-06T11:09:42.341943+0000","last_peered":"2023-10-06T11:09:42.341943+0000","last_clean":"2023-10-06T11:09:42.341943+0000","last_became_active":"2023-10-06T11:09:41.216244+0000","last_became_peered":"2023-10-06T11:09:41.216244+0000","last_unstale":"2023-10-06T11:09:42.341943+0000","last_undegraded":"2023-10-06T11:09:42.341943+0000","last_fullsized":"2023-10-06T11:09:42.341943+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:01:51.162810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.234861+0000","last_change":"2023-10-06T11:09:42.229034+0000","last_active":"2023-10-06T11:09:42.234861+0000","last_peered":"2023-10-06T11:09:42.234861+0000","last_clean":"2023-10-06T11:09:42.234861+0000","last_became_active":"2023-10-06T11:09:42.228734+0000","last_became_peered":"2023-10-06T11:09:42.228734+0000","last_unstale":"2023-10-06T11:09:42.234861+0000","last_undegraded":"2023-10-06T11:09:42.234861+0000","last_fullsized":"2023-10-06T11:09:42.234861+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:17:44.409872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"58'2","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.342510+0000","last_change":"2023-10-06T11:09:41.213108+0000","last_active":"2023-10-06T11:09:42.342510+0000","last_peered":"2023-10-06T11:09:42.342510+0000","last_clean":"2023-10-06T11:09:42.342510+0000","last_became_active":"2023-10-06T11:09:41.212695+0000","last_became_peered":"2023-10-06T11:09:41.212695+0000","last_unstale":"2023-10-06T11:09:42.342510+0000","last_undegraded":"2023-10-06T11:09:42.342510+0000","last_fullsized":"2023-10-06T11:09:42.342510+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:32:20.744483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.234526+0000","last_change":"2023-10-06T11:09:42.227750+0000","last_active":"2023-10-06T11:09:42.234526+0000","last_peered":"2023-10-06T11:09:42.234526+0000","last_clean":"2023-10-06T11:09:42.234526+0000","last_became_active":"2023-10-06T11:09:42.227479+0000","last_became_peered":"2023-10-06T11:09:42.227479+0000","last_unstale":"2023-10-06T11:09:42.234526+0000","last_undegraded":"2023-10-06T11:09:42.234526+0000","last_fullsized":"2023-10-06T11:09:42.234526+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:08:15.143503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"58'2","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.342311+0000","last_change":"2023-10-06T11:09:41.216502+0000","last_active":"2023-10-06T11:09:42.342311+0000","last_peered":"2023-10-06T11:09:42.342311+0000","last_clean":"2023-10-06T11:09:42.342311+0000","last_became_active":"2023-10-06T11:09:41.216217+0000","last_became_peered":"2023-10-06T11:09:41.216217+0000","last_unstale":"2023-10-06T11:09:42.342311+0000","last_undegraded":"2023-10-06T11:09:42.342311+0000","last_fullsized":"2023-10-06T11:09:42.342311+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:08:14.138844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.236789+0000","last_change":"2023-10-06T11:09:42.231963+0000","last_active":"2023-10-06T11:09:42.236789+0000","last_peered":"2023-10-06T11:09:42.236789+0000","last_clean":"2023-10-06T11:09:42.236789+0000","last_became_active":"2023-10-06T11:09:42.231567+0000","last_became_peered":"2023-10-06T11:09:42.231567+0000","last_unstale":"2023-10-06T11:09:42.236789+0000","last_undegraded":"2023-10-06T11:09:42.236789+0000","last_fullsized":"2023-10-06T11:09:42.236789+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:57:11.763583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"58'1","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.341518+0000","last_change":"2023-10-06T11:09:41.218930+0000","last_active":"2023-10-06T11:09:42.341518+0000","last_peered":"2023-10-06T11:09:42.341518+0000","last_clean":"2023-10-06T11:09:42.341518+0000","last_became_active":"2023-10-06T11:09:41.218683+0000","last_became_peered":"2023-10-06T11:09:41.218683+0000","last_unstale":"2023-10-06T11:09:42.341518+0000","last_undegraded":"2023-10-06T11:09:42.341518+0000","last_fullsized":"2023-10-06T11:09:42.341518+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:13:27.560433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.232629+0000","last_change":"2023-10-06T11:09:42.232629+0000","last_active":"2023-10-06T11:09:42.232629+0000","last_peered":"2023-10-06T11:09:42.232629+0000","last_clean":"2023-10-06T11:09:42.232629+0000","last_became_active":"2023-10-06T11:09:42.232390+0000","last_became_peered":"2023-10-06T11:09:42.232390+0000","last_unstale":"2023-10-06T11:09:42.232629+0000","last_undegraded":"2023-10-06T11:09:42.232629+0000","last_fullsized":"2023-10-06T11:09:42.232629+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:40:23.620747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"58'1","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.341177+0000","last_change":"2023-10-06T11:09:41.208722+0000","last_active":"2023-10-06T11:09:42.341177+0000","last_peered":"2023-10-06T11:09:42.341177+0000","last_clean":"2023-10-06T11:09:42.341177+0000","last_became_active":"2023-10-06T11:09:41.208481+0000","last_became_peered":"2023-10-06T11:09:41.208481+0000","last_unstale":"2023-10-06T11:09:42.341177+0000","last_undegraded":"2023-10-06T11:09:42.341177+0000","last_fullsized":"2023-10-06T11:09:42.341177+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:06:53.420190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.227251+0000","last_change":"2023-10-06T11:09:42.227251+0000","last_active":"2023-10-06T11:09:42.227251+0000","last_peered":"2023-10-06T11:09:42.227251+0000","last_clean":"2023-10-06T11:09:42.227251+0000","last_became_active":"2023-10-06T11:09:42.226952+0000","last_became_peered":"2023-10-06T11:09:42.226952+0000","last_unstale":"2023-10-06T11:09:42.227251+0000","last_undegraded":"2023-10-06T11:09:42.227251+0000","last_fullsized":"2023-10-06T11:09:42.227251+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:59.957433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.221721+0000","last_change":"2023-10-06T11:09:41.218780+0000","last_active":"2023-10-06T11:09:42.221721+0000","last_peered":"2023-10-06T11:09:42.221721+0000","last_clean":"2023-10-06T11:09:42.221721+0000","last_became_active":"2023-10-06T11:09:41.218522+0000","last_became_peered":"2023-10-06T11:09:41.218522+0000","last_unstale":"2023-10-06T11:09:42.221721+0000","last_undegraded":"2023-10-06T11:09:42.221721+0000","last_fullsized":"2023-10-06T11:09:42.221721+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:25.585394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.259245+0000","last_change":"2023-10-06T11:09:42.258941+0000","last_active":"2023-10-06T11:09:42.259245+0000","last_peered":"2023-10-06T11:09:42.259245+0000","last_clean":"2023-10-06T11:09:42.259245+0000","last_became_active":"2023-10-06T11:09:42.258749+0000","last_became_peered":"2023-10-06T11:09:42.258749+0000","last_unstale":"2023-10-06T11:09:42.259245+0000","last_undegraded":"2023-10-06T11:09:42.259245+0000","last_fullsized":"2023-10-06T11:09:42.259245+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:00:08.984931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.219309+0000","last_change":"2023-10-06T11:09:41.215714+0000","last_active":"2023-10-06T11:09:41.219309+0000","last_peered":"2023-10-06T11:09:41.219309+0000","last_clean":"2023-10-06T11:09:41.219309+0000","last_became_active":"2023-10-06T11:09:41.215430+0000","last_became_peered":"2023-10-06T11:09:41.215430+0000","last_unstale":"2023-10-06T11:09:41.219309+0000","last_undegraded":"2023-10-06T11:09:41.219309+0000","last_fullsized":"2023-10-06T11:09:41.219309+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:48:06.642258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.227904+0000","last_change":"2023-10-06T11:09:42.227904+0000","last_active":"2023-10-06T11:09:42.227904+0000","last_peered":"2023-10-06T11:09:42.227904+0000","last_clean":"2023-10-06T11:09:42.227904+0000","last_became_active":"2023-10-06T11:09:42.227654+0000","last_became_peered":"2023-10-06T11:09:42.227654+0000","last_unstale":"2023-10-06T11:09:42.227904+0000","last_undegraded":"2023-10-06T11:09:42.227904+0000","last_fullsized":"2023-10-06T11:09:42.227904+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:53.894745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.219586+0000","last_change":"2023-10-06T11:09:41.217448+0000","last_active":"2023-10-06T11:09:42.219586+0000","last_peered":"2023-10-06T11:09:42.219586+0000","last_clean":"2023-10-06T11:09:42.219586+0000","last_became_active":"2023-10-06T11:09:41.217135+0000","last_became_peered":"2023-10-06T11:09:41.217135+0000","last_unstale":"2023-10-06T11:09:42.219586+0000","last_undegraded":"2023-10-06T11:09:42.219586+0000","last_fullsized":"2023-10-06T11:09:42.219586+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:40:22.616089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.256653+0000","last_change":"2023-10-06T11:09:42.256154+0000","last_active":"2023-10-06T11:09:42.256653+0000","last_peered":"2023-10-06T11:09:42.256653+0000","last_clean":"2023-10-06T11:09:42.256653+0000","last_became_active":"2023-10-06T11:09:42.255559+0000","last_became_peered":"2023-10-06T11:09:42.255559+0000","last_unstale":"2023-10-06T11:09:42.256653+0000","last_undegraded":"2023-10-06T11:09:42.256653+0000","last_fullsized":"2023-10-06T11:09:42.256653+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:57:54.298243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.214378+0000","last_change":"2023-10-06T11:09:41.212720+0000","last_active":"2023-10-06T11:09:41.214378+0000","last_peered":"2023-10-06T11:09:41.214378+0000","last_clean":"2023-10-06T11:09:41.214378+0000","last_became_active":"2023-10-06T11:09:41.212468+0000","last_became_peered":"2023-10-06T11:09:41.212468+0000","last_unstale":"2023-10-06T11:09:41.214378+0000","last_undegraded":"2023-10-06T11:09:41.214378+0000","last_fullsized":"2023-10-06T11:09:41.214378+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:57.202092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.231969+0000","last_change":"2023-10-06T11:09:42.231969+0000","last_active":"2023-10-06T11:09:42.231969+0000","last_peered":"2023-10-06T11:09:42.231969+0000","last_clean":"2023-10-06T11:09:42.231969+0000","last_became_active":"2023-10-06T11:09:42.231685+0000","last_became_peered":"2023-10-06T11:09:42.231685+0000","last_unstale":"2023-10-06T11:09:42.231969+0000","last_undegraded":"2023-10-06T11:09:42.231969+0000","last_fullsized":"2023-10-06T11:09:42.231969+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:58.206751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"58'3","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.342621+0000","last_change":"2023-10-06T11:09:41.217623+0000","last_active":"2023-10-06T11:09:42.342621+0000","last_peered":"2023-10-06T11:09:42.342621+0000","last_clean":"2023-10-06T11:09:42.342621+0000","last_became_active":"2023-10-06T11:09:41.216779+0000","last_became_peered":"2023-10-06T11:09:41.216779+0000","last_unstale":"2023-10-06T11:09:42.342621+0000","last_undegraded":"2023-10-06T11:09:42.342621+0000","last_fullsized":"2023-10-06T11:09:42.342621+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:12.711537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.257176+0000","last_change":"2023-10-06T11:09:42.257176+0000","last_active":"2023-10-06T11:09:42.257176+0000","last_peered":"2023-10-06T11:09:42.257176+0000","last_clean":"2023-10-06T11:09:42.257176+0000","last_became_active":"2023-10-06T11:09:42.256930+0000","last_became_peered":"2023-10-06T11:09:42.256930+0000","last_unstale":"2023-10-06T11:09:42.257176+0000","last_undegraded":"2023-10-06T11:09:42.257176+0000","last_fullsized":"2023-10-06T11:09:42.257176+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:52:18.608330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.216096+0000","last_change":"2023-10-06T11:09:41.213317+0000","last_active":"2023-10-06T11:09:41.216096+0000","last_peered":"2023-10-06T11:09:41.216096+0000","last_clean":"2023-10-06T11:09:41.216096+0000","last_became_active":"2023-10-06T11:09:41.212888+0000","last_became_peered":"2023-10-06T11:09:41.212888+0000","last_unstale":"2023-10-06T11:09:41.216096+0000","last_undegraded":"2023-10-06T11:09:41.216096+0000","last_fullsized":"2023-10-06T11:09:41.216096+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:14.423152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.235268+0000","last_change":"2023-10-06T11:09:42.235268+0000","last_active":"2023-10-06T11:09:42.235268+0000","last_peered":"2023-10-06T11:09:42.235268+0000","last_clean":"2023-10-06T11:09:42.235268+0000","last_became_active":"2023-10-06T11:09:42.234996+0000","last_became_peered":"2023-10-06T11:09:42.234996+0000","last_unstale":"2023-10-06T11:09:42.235268+0000","last_undegraded":"2023-10-06T11:09:42.235268+0000","last_fullsized":"2023-10-06T11:09:42.235268+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:39:06.623968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"58'2","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.344725+0000","last_change":"2023-10-06T11:09:41.216177+0000","last_active":"2023-10-06T11:09:42.344725+0000","last_peered":"2023-10-06T11:09:42.344725+0000","last_clean":"2023-10-06T11:09:42.344725+0000","last_became_active":"2023-10-06T11:09:41.215915+0000","last_became_peered":"2023-10-06T11:09:41.215915+0000","last_unstale":"2023-10-06T11:09:42.344725+0000","last_undegraded":"2023-10-06T11:09:42.344725+0000","last_fullsized":"2023-10-06T11:09:42.344725+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:05:30.427724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.239145+0000","last_change":"2023-10-06T11:09:42.235415+0000","last_active":"2023-10-06T11:09:42.239145+0000","last_peered":"2023-10-06T11:09:42.239145+0000","last_clean":"2023-10-06T11:09:42.239145+0000","last_became_active":"2023-10-06T11:09:42.235022+0000","last_became_peered":"2023-10-06T11:09:42.235022+0000","last_unstale":"2023-10-06T11:09:42.239145+0000","last_undegraded":"2023-10-06T11:09:42.239145+0000","last_fullsized":"2023-10-06T11:09:42.239145+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:25.857721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.231353+0000","last_change":"2023-10-06T11:09:41.217104+0000","last_active":"2023-10-06T11:09:42.231353+0000","last_peered":"2023-10-06T11:09:42.231353+0000","last_clean":"2023-10-06T11:09:42.231353+0000","last_became_active":"2023-10-06T11:09:41.216693+0000","last_became_peered":"2023-10-06T11:09:41.216693+0000","last_unstale":"2023-10-06T11:09:42.231353+0000","last_undegraded":"2023-10-06T11:09:42.231353+0000","last_fullsized":"2023-10-06T11:09:42.231353+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:30.756704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.230985+0000","last_change":"2023-10-06T11:09:42.230985+0000","last_active":"2023-10-06T11:09:42.230985+0000","last_peered":"2023-10-06T11:09:42.230985+0000","last_clean":"2023-10-06T11:09:42.230985+0000","last_became_active":"2023-10-06T11:09:42.230741+0000","last_became_peered":"2023-10-06T11:09:42.230741+0000","last_unstale":"2023-10-06T11:09:42.230985+0000","last_undegraded":"2023-10-06T11:09:42.230985+0000","last_fullsized":"2023-10-06T11:09:42.230985+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:04:41.583424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.218104+0000","last_change":"2023-10-06T11:09:41.217240+0000","last_active":"2023-10-06T11:09:42.218104+0000","last_peered":"2023-10-06T11:09:42.218104+0000","last_clean":"2023-10-06T11:09:42.218104+0000","last_became_active":"2023-10-06T11:09:41.216980+0000","last_became_peered":"2023-10-06T11:09:41.216980+0000","last_unstale":"2023-10-06T11:09:42.218104+0000","last_undegraded":"2023-10-06T11:09:42.218104+0000","last_fullsized":"2023-10-06T11:09:42.218104+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:07:10.157853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.234850+0000","last_change":"2023-10-06T11:09:42.234850+0000","last_active":"2023-10-06T11:09:42.234850+0000","last_peered":"2023-10-06T11:09:42.234850+0000","last_clean":"2023-10-06T11:09:42.234850+0000","last_became_active":"2023-10-06T11:09:42.234572+0000","last_became_peered":"2023-10-06T11:09:42.234572+0000","last_unstale":"2023-10-06T11:09:42.234850+0000","last_undegraded":"2023-10-06T11:09:42.234850+0000","last_fullsized":"2023-10-06T11:09:42.234850+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:25.857721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.214988+0000","last_change":"2023-10-06T11:09:41.213789+0000","last_active":"2023-10-06T11:09:41.214988+0000","last_peered":"2023-10-06T11:09:41.214988+0000","last_clean":"2023-10-06T11:09:41.214988+0000","last_became_active":"2023-10-06T11:09:41.213505+0000","last_became_peered":"2023-10-06T11:09:41.213505+0000","last_unstale":"2023-10-06T11:09:41.214988+0000","last_undegraded":"2023-10-06T11:09:41.214988+0000","last_fullsized":"2023-10-06T11:09:41.214988+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:14.423152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.236925+0000","last_change":"2023-10-06T11:09:42.232334+0000","last_active":"2023-10-06T11:09:42.236925+0000","last_peered":"2023-10-06T11:09:42.236925+0000","last_clean":"2023-10-06T11:09:42.236925+0000","last_became_active":"2023-10-06T11:09:42.232077+0000","last_became_peered":"2023-10-06T11:09:42.232077+0000","last_unstale":"2023-10-06T11:09:42.236925+0000","last_undegraded":"2023-10-06T11:09:42.236925+0000","last_fullsized":"2023-10-06T11:09:42.236925+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:00:29.071879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"58'2","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.343400+0000","last_change":"2023-10-06T11:09:41.213087+0000","last_active":"2023-10-06T11:09:42.343400+0000","last_peered":"2023-10-06T11:09:42.343400+0000","last_clean":"2023-10-06T11:09:42.343400+0000","last_became_active":"2023-10-06T11:09:41.212812+0000","last_became_peered":"2023-10-06T11:09:41.212812+0000","last_unstale":"2023-10-06T11:09:42.343400+0000","last_undegraded":"2023-10-06T11:09:42.343400+0000","last_fullsized":"2023-10-06T11:09:42.343400+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:14.423152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.227689+0000","last_change":"2023-10-06T11:09:42.225271+0000","last_active":"2023-10-06T11:09:42.227689+0000","last_peered":"2023-10-06T11:09:42.227689+0000","last_clean":"2023-10-06T11:09:42.227689+0000","last_became_active":"2023-10-06T11:09:42.225049+0000","last_became_peered":"2023-10-06T11:09:42.225049+0000","last_unstale":"2023-10-06T11:09:42.227689+0000","last_undegraded":"2023-10-06T11:09:42.227689+0000","last_fullsized":"2023-10-06T11:09:42.227689+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:51:25.725356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"59'1","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T11:09:43.221169+0000","last_change":"2023-10-06T11:09:41.211660+0000","last_active":"2023-10-06T11:09:43.221169+0000","last_peered":"2023-10-06T11:09:43.221169+0000","last_clean":"2023-10-06T11:09:43.221169+0000","last_became_active":"2023-10-06T11:09:41.209522+0000","last_became_peered":"2023-10-06T11:09:41.209522+0000","last_unstale":"2023-10-06T11:09:43.221169+0000","last_undegraded":"2023-10-06T11:09:43.221169+0000","last_fullsized":"2023-10-06T11:09:43.221169+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:29.500970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.238282+0000","last_change":"2023-10-06T11:09:42.235095+0000","last_active":"2023-10-06T11:09:42.238282+0000","last_peered":"2023-10-06T11:09:42.238282+0000","last_clean":"2023-10-06T11:09:42.238282+0000","last_became_active":"2023-10-06T11:09:42.234870+0000","last_became_peered":"2023-10-06T11:09:42.234870+0000","last_unstale":"2023-10-06T11:09:42.238282+0000","last_undegraded":"2023-10-06T11:09:42.238282+0000","last_fullsized":"2023-10-06T11:09:42.238282+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:10:47.746855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.224304+0000","last_change":"2023-10-06T11:09:41.212942+0000","last_active":"2023-10-06T11:09:42.224304+0000","last_peered":"2023-10-06T11:09:42.224304+0000","last_clean":"2023-10-06T11:09:42.224304+0000","last_became_active":"2023-10-06T11:09:41.212251+0000","last_became_peered":"2023-10-06T11:09:41.212251+0000","last_unstale":"2023-10-06T11:09:42.224304+0000","last_undegraded":"2023-10-06T11:09:42.224304+0000","last_fullsized":"2023-10-06T11:09:42.224304+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:14.895309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.257270+0000","last_change":"2023-10-06T11:09:42.257270+0000","last_active":"2023-10-06T11:09:42.257270+0000","last_peered":"2023-10-06T11:09:42.257270+0000","last_clean":"2023-10-06T11:09:42.257270+0000","last_became_active":"2023-10-06T11:09:42.256903+0000","last_became_peered":"2023-10-06T11:09:42.256903+0000","last_unstale":"2023-10-06T11:09:42.257270+0000","last_undegraded":"2023-10-06T11:09:42.257270+0000","last_fullsized":"2023-10-06T11:09:42.257270+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:30.505629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.216079+0000","last_change":"2023-10-06T11:09:41.213157+0000","last_active":"2023-10-06T11:09:41.216079+0000","last_peered":"2023-10-06T11:09:41.216079+0000","last_clean":"2023-10-06T11:09:41.216079+0000","last_became_active":"2023-10-06T11:09:41.212578+0000","last_became_peered":"2023-10-06T11:09:41.212578+0000","last_unstale":"2023-10-06T11:09:41.216079+0000","last_undegraded":"2023-10-06T11:09:41.216079+0000","last_fullsized":"2023-10-06T11:09:41.216079+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:55:58.933120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.232043+0000","last_change":"2023-10-06T11:09:42.232043+0000","last_active":"2023-10-06T11:09:42.232043+0000","last_peered":"2023-10-06T11:09:42.232043+0000","last_clean":"2023-10-06T11:09:42.232043+0000","last_became_active":"2023-10-06T11:09:42.231775+0000","last_became_peered":"2023-10-06T11:09:42.231775+0000","last_unstale":"2023-10-06T11:09:42.232043+0000","last_undegraded":"2023-10-06T11:09:42.232043+0000","last_fullsized":"2023-10-06T11:09:42.232043+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:05:12.404425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.220015+0000","last_change":"2023-10-06T11:09:41.218001+0000","last_active":"2023-10-06T11:09:42.220015+0000","last_peered":"2023-10-06T11:09:42.220015+0000","last_clean":"2023-10-06T11:09:42.220015+0000","last_became_active":"2023-10-06T11:09:41.217073+0000","last_became_peered":"2023-10-06T11:09:41.217073+0000","last_unstale":"2023-10-06T11:09:42.220015+0000","last_undegraded":"2023-10-06T11:09:42.220015+0000","last_fullsized":"2023-10-06T11:09:42.220015+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:29:32.567167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.236348+0000","last_change":"2023-10-06T11:09:42.236348+0000","last_active":"2023-10-06T11:09:42.236348+0000","last_peered":"2023-10-06T11:09:42.236348+0000","last_clean":"2023-10-06T11:09:42.236348+0000","last_became_active":"2023-10-06T11:09:42.236035+0000","last_became_peered":"2023-10-06T11:09:42.236035+0000","last_unstale":"2023-10-06T11:09:42.236348+0000","last_undegraded":"2023-10-06T11:09:42.236348+0000","last_fullsized":"2023-10-06T11:09:42.236348+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:37:07.428678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.222013+0000","last_change":"2023-10-06T11:09:41.211301+0000","last_active":"2023-10-06T11:09:42.222013+0000","last_peered":"2023-10-06T11:09:42.222013+0000","last_clean":"2023-10-06T11:09:42.222013+0000","last_became_active":"2023-10-06T11:09:41.211014+0000","last_became_peered":"2023-10-06T11:09:41.211014+0000","last_unstale":"2023-10-06T11:09:42.222013+0000","last_undegraded":"2023-10-06T11:09:42.222013+0000","last_fullsized":"2023-10-06T11:09:42.222013+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:51:52.446155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.230829+0000","last_change":"2023-10-06T11:09:42.230829+0000","last_active":"2023-10-06T11:09:42.230829+0000","last_peered":"2023-10-06T11:09:42.230829+0000","last_clean":"2023-10-06T11:09:42.230829+0000","last_became_active":"2023-10-06T11:09:42.230511+0000","last_became_peered":"2023-10-06T11:09:42.230511+0000","last_unstale":"2023-10-06T11:09:42.230829+0000","last_undegraded":"2023-10-06T11:09:42.230829+0000","last_fullsized":"2023-10-06T11:09:42.230829+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:52:18.608330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.221814+0000","last_change":"2023-10-06T11:09:41.218854+0000","last_active":"2023-10-06T11:09:42.221814+0000","last_peered":"2023-10-06T11:09:42.221814+0000","last_clean":"2023-10-06T11:09:42.221814+0000","last_became_active":"2023-10-06T11:09:41.218572+0000","last_became_peered":"2023-10-06T11:09:41.218572+0000","last_unstale":"2023-10-06T11:09:42.221814+0000","last_undegraded":"2023-10-06T11:09:42.221814+0000","last_fullsized":"2023-10-06T11:09:42.221814+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:06:06.843348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.234800+0000","last_change":"2023-10-06T11:09:42.229708+0000","last_active":"2023-10-06T11:09:42.234800+0000","last_peered":"2023-10-06T11:09:42.234800+0000","last_clean":"2023-10-06T11:09:42.234800+0000","last_became_active":"2023-10-06T11:09:42.229446+0000","last_became_peered":"2023-10-06T11:09:42.229446+0000","last_unstale":"2023-10-06T11:09:42.234800+0000","last_undegraded":"2023-10-06T11:09:42.234800+0000","last_fullsized":"2023-10-06T11:09:42.234800+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:33:05.628031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":9,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.217159+0000","last_change":"2023-10-06T11:09:41.214668+0000","last_active":"2023-10-06T11:09:41.217159+0000","last_peered":"2023-10-06T11:09:41.217159+0000","last_clean":"2023-10-06T11:09:41.217159+0000","last_became_active":"2023-10-06T11:09:41.214427+0000","last_became_peered":"2023-10-06T11:09:41.214427+0000","last_unstale":"2023-10-06T11:09:41.217159+0000","last_undegraded":"2023-10-06T11:09:41.217159+0000","last_fullsized":"2023-10-06T11:09:41.217159+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:08:49.990834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.228930+0000","last_change":"2023-10-06T11:09:42.228930+0000","last_active":"2023-10-06T11:09:42.228930+0000","last_peered":"2023-10-06T11:09:42.228930+0000","last_clean":"2023-10-06T11:09:42.228930+0000","last_became_active":"2023-10-06T11:09:42.228558+0000","last_became_peered":"2023-10-06T11:09:42.228558+0000","last_unstale":"2023-10-06T11:09:42.228930+0000","last_undegraded":"2023-10-06T11:09:42.228930+0000","last_fullsized":"2023-10-06T11:09:42.228930+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:13.716196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"58'1","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.342602+0000","last_change":"2023-10-06T11:09:41.218292+0000","last_active":"2023-10-06T11:09:42.342602+0000","last_peered":"2023-10-06T11:09:42.342602+0000","last_clean":"2023-10-06T11:09:42.342602+0000","last_became_active":"2023-10-06T11:09:41.217963+0000","last_became_peered":"2023-10-06T11:09:41.217963+0000","last_unstale":"2023-10-06T11:09:42.342602+0000","last_undegraded":"2023-10-06T11:09:42.342602+0000","last_fullsized":"2023-10-06T11:09:42.342602+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:52.890087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":47,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.205019+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:09:41.205019+0000","last_peered":"2023-10-06T11:09:41.205019+0000","last_clean":"2023-10-06T11:09:41.205019+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:09:41.205019+0000","last_undegraded":"2023-10-06T11:09:41.205019+0000","last_fullsized":"2023-10-06T11:09:41.205019+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.257731+0000","last_change":"2023-10-06T11:09:42.257731+0000","last_active":"2023-10-06T11:09:42.257731+0000","last_peered":"2023-10-06T11:09:42.257731+0000","last_clean":"2023-10-06T11:09:42.257731+0000","last_became_active":"2023-10-06T11:09:42.257516+0000","last_became_peered":"2023-10-06T11:09:42.257516+0000","last_unstale":"2023-10-06T11:09:42.257731+0000","last_undegraded":"2023-10-06T11:09:42.257731+0000","last_fullsized":"2023-10-06T11:09:42.257731+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:31.761363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.222148+0000","last_change":"2023-10-06T11:09:41.213322+0000","last_active":"2023-10-06T11:09:42.222148+0000","last_peered":"2023-10-06T11:09:42.222148+0000","last_clean":"2023-10-06T11:09:42.222148+0000","last_became_active":"2023-10-06T11:09:41.213046+0000","last_became_peered":"2023-10-06T11:09:41.213046+0000","last_unstale":"2023-10-06T11:09:42.222148+0000","last_undegraded":"2023-10-06T11:09:42.222148+0000","last_fullsized":"2023-10-06T11:09:42.222148+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:27.750667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":48,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.222224+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:09:42.222224+0000","last_peered":"2023-10-06T11:09:42.222224+0000","last_clean":"2023-10-06T11:09:42.222224+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:09:42.222224+0000","last_undegraded":"2023-10-06T11:09:42.222224+0000","last_fullsized":"2023-10-06T11:09:42.222224+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.234657+0000","last_change":"2023-10-06T11:09:42.228444+0000","last_active":"2023-10-06T11:09:42.234657+0000","last_peered":"2023-10-06T11:09:42.234657+0000","last_clean":"2023-10-06T11:09:42.234657+0000","last_became_active":"2023-10-06T11:09:42.228189+0000","last_became_peered":"2023-10-06T11:09:42.228189+0000","last_unstale":"2023-10-06T11:09:42.234657+0000","last_undegraded":"2023-10-06T11:09:42.234657+0000","last_fullsized":"2023-10-06T11:09:42.234657+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:33.287742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"58'2","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.344680+0000","last_change":"2023-10-06T11:09:41.215573+0000","last_active":"2023-10-06T11:09:42.344680+0000","last_peered":"2023-10-06T11:09:42.344680+0000","last_clean":"2023-10-06T11:09:42.344680+0000","last_became_active":"2023-10-06T11:09:41.215351+0000","last_became_peered":"2023-10-06T11:09:41.215351+0000","last_unstale":"2023-10-06T11:09:42.344680+0000","last_undegraded":"2023-10-06T11:09:42.344680+0000","last_fullsized":"2023-10-06T11:09:42.344680+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:53:09.457192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":44,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.199334+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:09:41.199334+0000","last_peered":"2023-10-06T11:09:41.199334+0000","last_clean":"2023-10-06T11:09:41.199334+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:09:41.199334+0000","last_undegraded":"2023-10-06T11:09:41.199334+0000","last_fullsized":"2023-10-06T11:09:41.199334+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":193,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.220446+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:09:42.220446+0000","last_peered":"2023-10-06T11:09:42.220446+0000","last_clean":"2023-10-06T11:09:42.220446+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:09:42.220446+0000","last_undegraded":"2023-10-06T11:09:42.220446+0000","last_fullsized":"2023-10-06T11:09:42.220446+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.233181+0000","last_change":"2023-10-06T11:09:42.229398+0000","last_active":"2023-10-06T11:09:42.233181+0000","last_peered":"2023-10-06T11:09:42.233181+0000","last_clean":"2023-10-06T11:09:42.233181+0000","last_became_active":"2023-10-06T11:09:42.229067+0000","last_became_peered":"2023-10-06T11:09:42.229067+0000","last_unstale":"2023-10-06T11:09:42.233181+0000","last_undegraded":"2023-10-06T11:09:42.233181+0000","last_fullsized":"2023-10-06T11:09:42.233181+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:07:11.162512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.231947+0000","last_change":"2023-10-06T11:09:41.216944+0000","last_active":"2023-10-06T11:09:42.231947+0000","last_peered":"2023-10-06T11:09:42.231947+0000","last_clean":"2023-10-06T11:09:42.231947+0000","last_became_active":"2023-10-06T11:09:41.216394+0000","last_became_peered":"2023-10-06T11:09:41.216394+0000","last_unstale":"2023-10-06T11:09:42.231947+0000","last_undegraded":"2023-10-06T11:09:42.231947+0000","last_fullsized":"2023-10-06T11:09:42.231947+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:57.202092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":43,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.218488+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:09:42.218488+0000","last_peered":"2023-10-06T11:09:42.218488+0000","last_clean":"2023-10-06T11:09:42.218488+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:09:42.218488+0000","last_undegraded":"2023-10-06T11:09:42.218488+0000","last_fullsized":"2023-10-06T11:09:42.218488+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.228539+0000","last_change":"2023-10-06T11:09:42.228539+0000","last_active":"2023-10-06T11:09:42.228539+0000","last_peered":"2023-10-06T11:09:42.228539+0000","last_clean":"2023-10-06T11:09:42.228539+0000","last_became_active":"2023-10-06T11:09:42.228200+0000","last_became_peered":"2023-10-06T11:09:42.228200+0000","last_unstale":"2023-10-06T11:09:42.228539+0000","last_undegraded":"2023-10-06T11:09:42.228539+0000","last_fullsized":"2023-10-06T11:09:42.228539+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:47:49.153165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.221497+0000","last_change":"2023-10-06T11:09:41.219234+0000","last_active":"2023-10-06T11:09:42.221497+0000","last_peered":"2023-10-06T11:09:42.221497+0000","last_clean":"2023-10-06T11:09:42.221497+0000","last_became_active":"2023-10-06T11:09:41.218988+0000","last_became_peered":"2023-10-06T11:09:41.218988+0000","last_unstale":"2023-10-06T11:09:42.221497+0000","last_undegraded":"2023-10-06T11:09:42.221497+0000","last_fullsized":"2023-10-06T11:09:42.221497+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:06:17.950887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":43,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.220549+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:09:42.220549+0000","last_peered":"2023-10-06T11:09:42.220549+0000","last_clean":"2023-10-06T11:09:42.220549+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:09:42.220549+0000","last_undegraded":"2023-10-06T11:09:42.220549+0000","last_fullsized":"2023-10-06T11:09:42.220549+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.226066+0000","last_change":"2023-10-06T11:09:42.226066+0000","last_active":"2023-10-06T11:09:42.226066+0000","last_peered":"2023-10-06T11:09:42.226066+0000","last_clean":"2023-10-06T11:09:42.226066+0000","last_became_active":"2023-10-06T11:09:42.225791+0000","last_became_peered":"2023-10-06T11:09:42.225791+0000","last_unstale":"2023-10-06T11:09:42.226066+0000","last_undegraded":"2023-10-06T11:09:42.226066+0000","last_fullsized":"2023-10-06T11:09:42.226066+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:08:50.995493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.223496+0000","last_change":"2023-10-06T11:09:41.214421+0000","last_active":"2023-10-06T11:09:42.223496+0000","last_peered":"2023-10-06T11:09:42.223496+0000","last_clean":"2023-10-06T11:09:42.223496+0000","last_became_active":"2023-10-06T11:09:41.214113+0000","last_became_peered":"2023-10-06T11:09:41.214113+0000","last_unstale":"2023-10-06T11:09:42.223496+0000","last_undegraded":"2023-10-06T11:09:42.223496+0000","last_fullsized":"2023-10-06T11:09:42.223496+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:22:00.022841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":51,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.225391+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:09:42.225391+0000","last_peered":"2023-10-06T11:09:42.225391+0000","last_clean":"2023-10-06T11:09:42.225391+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:09:42.225391+0000","last_undegraded":"2023-10-06T11:09:42.225391+0000","last_fullsized":"2023-10-06T11:09:42.225391+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":8,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.234133+0000","last_change":"2023-10-06T11:09:42.234133+0000","last_active":"2023-10-06T11:09:42.234133+0000","last_peered":"2023-10-06T11:09:42.234133+0000","last_clean":"2023-10-06T11:09:42.234133+0000","last_became_active":"2023-10-06T11:09:42.233860+0000","last_became_peered":"2023-10-06T11:09:42.233860+0000","last_unstale":"2023-10-06T11:09:42.234133+0000","last_undegraded":"2023-10-06T11:09:42.234133+0000","last_fullsized":"2023-10-06T11:09:42.234133+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:55:59.937779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"58'2","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.345008+0000","last_change":"2023-10-06T11:09:41.215052+0000","last_active":"2023-10-06T11:09:42.345008+0000","last_peered":"2023-10-06T11:09:42.345008+0000","last_clean":"2023-10-06T11:09:42.345008+0000","last_became_active":"2023-10-06T11:09:41.214778+0000","last_became_peered":"2023-10-06T11:09:41.214778+0000","last_unstale":"2023-10-06T11:09:42.345008+0000","last_undegraded":"2023-10-06T11:09:42.345008+0000","last_fullsized":"2023-10-06T11:09:42.345008+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:24.853062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":46,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.208694+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:09:41.208694+0000","last_peered":"2023-10-06T11:09:41.208694+0000","last_clean":"2023-10-06T11:09:41.208694+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:09:41.208694+0000","last_undegraded":"2023-10-06T11:09:41.208694+0000","last_fullsized":"2023-10-06T11:09:41.208694+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.236061+0000","last_change":"2023-10-06T11:09:42.233367+0000","last_active":"2023-10-06T11:09:42.236061+0000","last_peered":"2023-10-06T11:09:42.236061+0000","last_clean":"2023-10-06T11:09:42.236061+0000","last_became_active":"2023-10-06T11:09:42.233105+0000","last_became_peered":"2023-10-06T11:09:42.233105+0000","last_unstale":"2023-10-06T11:09:42.236061+0000","last_undegraded":"2023-10-06T11:09:42.236061+0000","last_fullsized":"2023-10-06T11:09:42.236061+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:28:02.987423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"58'1","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.342255+0000","last_change":"2023-10-06T11:09:41.218783+0000","last_active":"2023-10-06T11:09:42.342255+0000","last_peered":"2023-10-06T11:09:42.342255+0000","last_clean":"2023-10-06T11:09:42.342255+0000","last_became_active":"2023-10-06T11:09:41.216107+0000","last_became_peered":"2023-10-06T11:09:41.216107+0000","last_unstale":"2023-10-06T11:09:42.342255+0000","last_undegraded":"2023-10-06T11:09:42.342255+0000","last_fullsized":"2023-10-06T11:09:42.342255+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:58.952774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":46,"reported_epoch":57,"state":"active+clean","last_fresh":"2023-10-06T11:09:41.207562+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:09:41.207562+0000","last_peered":"2023-10-06T11:09:41.207562+0000","last_clean":"2023-10-06T11:09:41.207562+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:09:41.207562+0000","last_undegraded":"2023-10-06T11:09:41.207562+0000","last_fullsized":"2023-10-06T11:09:41.207562+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":216,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574901,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298576,"kb_used_data":1288,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073264,"statfs":{"total":96636764160,"available":96331022336,"internally_reserved":0,"allocated":1318912,"data_stored":903382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":1.871,"5min":0.73999999999999999,"15min":0.56999999999999995},"min":{"1min":0.41199999999999998,"5min":0.248,"15min":0.248},"max":{"1min":23.908999999999999,"5min":23.908999999999999,"15min":23.908999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":1.127,"5min":0.629,"15min":0.56499999999999995},"min":{"1min":0.374,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":9.0600000000000005,"5min":9.0600000000000005,"15min":9.0600000000000005},"last":0.64200000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":0.63900000000000001,"15min":0.57099999999999995},"min":{"1min":0.40899999999999997,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":9.2360000000000007,"5min":9.2360000000000007,"15min":9.2360000000000007},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.53900000000000003,"15min":0.51600000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":4.327,"5min":4.327,"15min":4.327},"last":0.436}]},{"osd":2,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.504,"15min":0.50900000000000001},"min":{"1min":0.311,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.59599999999999997,"15min":0.55800000000000005},"min":{"1min":0.436,"5min":0.309,"15min":0.309},"max":{"1min":4.7309999999999999,"5min":4.7309999999999999,"15min":4.7309999999999999},"last":0.56599999999999995}]},{"osd":3,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.55400000000000005,"15min":0.51400000000000001},"min":{"1min":0.35299999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":4.3540000000000001,"5min":4.3540000000000001,"15min":4.3540000000000001},"last":0.626},{"interface":"front","average":{"1min":1.1870000000000001,"5min":0.67300000000000004,"15min":0.59999999999999998},"min":{"1min":0.45300000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":9.3879999999999999,"5min":9.3879999999999999,"15min":9.3879999999999999},"last":0.46200000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.50800000000000001,"15min":0.47499999999999998},"min":{"1min":0.34100000000000003,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":4.5709999999999997,"5min":4.5709999999999997,"15min":4.5709999999999997},"last":0.5},{"interface":"front","average":{"1min":0.753,"5min":0.55800000000000005,"15min":0.53500000000000003},"min":{"1min":0.33100000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":4.3129999999999997,"5min":4.3129999999999997,"15min":4.3129999999999997},"last":0.41199999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":0.64100000000000001,"15min":0.58099999999999996},"min":{"1min":0.34200000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":9.3499999999999996,"5min":9.3499999999999996,"15min":9.3499999999999996},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.58299999999999996,"15min":0.56699999999999995},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":4.444,"5min":4.444,"15min":4.444},"last":0.55400000000000005}]},{"osd":6,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":0.67300000000000004,"15min":0.622},"min":{"1min":0.39700000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":9.4969999999999999,"5min":9.4969999999999999,"15min":9.4969999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.66200000000000003,"15min":0.62},"min":{"1min":0.44800000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":7.2039999999999997,"5min":7.2039999999999997,"15min":7.2039999999999997},"last":0.52400000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310240,"kb_used_data":664,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061600,"statfs":{"total":96636764160,"available":96319078400,"internally_reserved":0,"allocated":679936,"data_stored":297156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.48199999999999998,"15min":0.497},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.52100000000000002,"15min":0.53300000000000003},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.60599999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.48299999999999998,"15min":0.499},"min":{"1min":0.34100000000000003,"5min":0.253,"15min":0.253},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48499999999999999,"15min":0.499},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.76400000000000001,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.47899999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.53100000000000003,"15min":0.498},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":7.0659999999999998,"5min":7.0659999999999998,"15min":7.0659999999999998},"last":0.502},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.56100000000000005,"15min":0.52900000000000003},"min":{"1min":0.32500000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":7.0819999999999999,"5min":7.0819999999999999,"15min":7.0819999999999999},"last":0.42199999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.49399999999999999,"15min":0.49299999999999999},"min":{"1min":0.32600000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.52700000000000002,"15min":0.53600000000000003},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.72799999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.59099999999999997}]},{"osd":4,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.48699999999999999,"15min":0.50700000000000001},"min":{"1min":0.29599999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.64300000000000002,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.54300000000000004,"15min":0.56799999999999995},"min":{"1min":0.32100000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.77100000000000002,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.65000000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52200000000000002,"15min":0.53800000000000003},"min":{"1min":0.307,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56299999999999994,"15min":0.58699999999999997},"min":{"1min":0.39500000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.79000000000000004,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.626}]},{"osd":7,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.56200000000000006,"15min":0.57699999999999996},"min":{"1min":0.36899999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79500000000000004,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.58999999999999997,"15min":0.60699999999999998},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83899999999999997,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.63800000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310824,"kb_used_data":1248,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061016,"statfs":{"total":96636764160,"available":96318480384,"internally_reserved":0,"allocated":1277952,"data_stored":888877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.33200000000000002,"15min":0.34200000000000003},"min":{"1min":0.24199999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.215,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.307}]},{"osd":2,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.34399999999999997,"15min":0.33600000000000002},"min":{"1min":0.23599999999999999,"5min":0.22,"15min":0.22},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.432,"5min":0.39600000000000002,"15min":0.38900000000000001},"min":{"1min":0.26500000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.35899999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.41399999999999998,"15min":0.41099999999999998},"min":{"1min":0.28299999999999997,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.68999999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.38100000000000001,"15min":0.36899999999999999},"min":{"1min":0.29799999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.33800000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.53000000000000003,"15min":0.50800000000000001},"min":{"1min":0.34399999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55800000000000005,"15min":0.54000000000000004},"min":{"1min":0.45300000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.503}]},{"osd":5,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55900000000000005,"15min":0.54900000000000004},"min":{"1min":0.38800000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.56299999999999994,"15min":0.54100000000000004},"min":{"1min":0.40000000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.52200000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57199999999999995,"15min":0.56200000000000006},"min":{"1min":0.36899999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.59199999999999997,"15min":0.57399999999999995},"min":{"1min":0.376,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.56399999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.59999999999999998,"15min":0.58999999999999997},"min":{"1min":0.48699999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84299999999999997,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.42899999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.45600000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302072,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069768,"statfs":{"total":96636764160,"available":96327442432,"internally_reserved":0,"allocated":704512,"data_stored":310913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":1.9379999999999999,"5min":0.64700000000000002,"15min":0.44},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":36.097999999999999,"5min":36.097999999999999,"15min":36.097999999999999},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.35999999999999999,"15min":0.34699999999999998},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.33000000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":1.9810000000000001,"5min":0.69099999999999995,"15min":0.48299999999999998},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":36.07,"5min":36.07,"15min":36.07},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.40000000000000002,"15min":0.379},"min":{"1min":0.23200000000000001,"5min":0.219,"15min":0.219},"max":{"1min":5.125,"5min":5.125,"15min":5.125},"last":0.375}]},{"osd":3,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.44,"15min":0.39600000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":8.4130000000000003,"5min":8.4130000000000003,"15min":8.4130000000000003},"last":0.35899999999999999},{"interface":"front","average":{"1min":2.0030000000000001,"5min":0.74399999999999999,"15min":0.54200000000000004},"min":{"1min":0.30199999999999999,"5min":0.252,"15min":0.252},"max":{"1min":35.959000000000003,"5min":35.959000000000003,"15min":35.959000000000003},"last":0.41399999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.56799999999999995,"15min":0.56299999999999994},"min":{"1min":0.48199999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.497},{"interface":"front","average":{"1min":2.2120000000000002,"5min":0.92700000000000005,"15min":0.72099999999999997},"min":{"1min":0.48999999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":36.005000000000003,"5min":36.005000000000003,"15min":36.005000000000003},"last":0.52000000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.55700000000000005,"15min":0.55400000000000005},"min":{"1min":0.433,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56299999999999994,"15min":0.54900000000000004},"min":{"1min":0.45700000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.59899999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":2.194,"5min":0.91900000000000004,"15min":0.71699999999999997},"min":{"1min":0.47199999999999998,"5min":0.375,"15min":0.375},"max":{"1min":36.037999999999997,"5min":36.037999999999997,"15min":36.037999999999997},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.63900000000000001,"15min":0.61699999999999999},"min":{"1min":0.434,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":4.8810000000000002,"5min":4.8810000000000002,"15min":4.8810000000000002},"last":0.64400000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60599999999999998,"15min":0.60799999999999998},"min":{"1min":0.41499999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":2.3530000000000002,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.626,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.44500000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.65500000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574902,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310264,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061576,"statfs":{"total":96636764160,"available":96319053824,"internally_reserved":0,"allocated":704512,"data_stored":310913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.309,"15min":0.309},"min":{"1min":0.22500000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.437,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.218},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38100000000000001,"15min":0.38500000000000001},"min":{"1min":0.26900000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.51400000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.33000000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36899999999999999,"15min":0.375},"min":{"1min":0.24399999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.254},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.35399999999999998,"15min":0.34799999999999998},"min":{"1min":0.26900000000000002,"5min":0.217,"15min":0.217},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.34399999999999997}]},{"osd":3,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.37,"15min":0.373},"min":{"1min":0.27800000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.373,"5min":0.36499999999999999,"15min":0.36699999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.31}]},{"osd":4,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.33900000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.38900000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.52800000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.55200000000000005,"15min":0.55000000000000004},"min":{"1min":0.374,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.41799999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.64300000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58299999999999996,"15min":0.58399999999999996},"min":{"1min":0.43099999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41399999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.627}]},{"osd":7,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.55900000000000005,"15min":0.55000000000000004},"min":{"1min":0.436,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.57099999999999995,"15min":0.56999999999999995},"min":{"1min":0.38600000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.61599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574902,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297976,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073864,"statfs":{"total":96636764160,"available":96331636736,"internally_reserved":0,"allocated":704512,"data_stored":310913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.313,"15min":0.32700000000000001},"min":{"1min":0.218,"5min":0.188,"15min":0.188},"max":{"1min":0.47099999999999997,"5min":1.095,"15min":1.095},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.38,"15min":0.40200000000000002},"min":{"1min":0.30399999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.52400000000000002,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.31}]},{"osd":1,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.313,"15min":0.309},"min":{"1min":0.23200000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.46899999999999997,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.35999999999999999,"15min":0.37},"min":{"1min":0.25900000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.48599999999999999,"5min":1.196,"15min":1.196},"last":0.33100000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.374,"15min":0.39200000000000002},"min":{"1min":0.26500000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.54000000000000004,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.40799999999999997,"15min":0.42199999999999999},"min":{"1min":0.32700000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.55900000000000005,"5min":1.224,"15min":1.224},"last":0.36499999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.55400000000000005,"15min":0.57399999999999995},"min":{"1min":0.41699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69399999999999995,"5min":1.694,"15min":1.694},"last":0.628},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.54600000000000004,"15min":0.54800000000000004},"min":{"1min":0.46400000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.58699999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.54600000000000004,"15min":0.52800000000000002},"min":{"1min":0.436,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79400000000000004,"5min":0.878,"15min":0.878},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55900000000000005,"15min":0.56699999999999995},"min":{"1min":0.49399999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72699999999999998,"5min":1.165,"15min":1.165},"last":0.68700000000000006}]},{"osd":6,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58699999999999997,"15min":0.59499999999999997},"min":{"1min":0.46200000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.81299999999999994,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.59599999999999997,"15min":0.60599999999999998},"min":{"1min":0.47099999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78000000000000003,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.70599999999999996}]},{"osd":7,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58199999999999996,"15min":0.59599999999999997},"min":{"1min":0.44800000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.74199999999999999,"5min":1.657,"15min":1.657},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.47899999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83399999999999996,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.61799999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297956,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073884,"statfs":{"total":96636764160,"available":96331657216,"internally_reserved":0,"allocated":684032,"data_stored":298509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.54800000000000004,"15min":0.60299999999999998},"min":{"1min":0.28899999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.74099999999999999,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48299999999999998,"15min":0.499},"min":{"1min":0.28599999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.64500000000000002,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.624}]},{"osd":1,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.57499999999999996,"15min":0.628},"min":{"1min":0.28799999999999998,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.66100000000000003,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.57699999999999996,"15min":0.629},"min":{"1min":0.32900000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.74199999999999999,"5min":2.7610000000000001,"15min":2.7610000000000001},"last":0.64000000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.54200000000000004,"15min":0.58199999999999996},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.60399999999999998,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.58999999999999997,"15min":0.61899999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.76500000000000001,"5min":1.718,"15min":1.718},"last":0.58299999999999996}]},{"osd":3,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.60199999999999998,"15min":0.64800000000000002},"min":{"1min":0.36799999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.67600000000000005,"5min":2.677,"15min":2.677},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.51100000000000001,"15min":0.52400000000000002},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.48399999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.47299999999999998,"15min":0.497},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.52300000000000002,"15min":0.54700000000000004},"min":{"1min":0.307,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.71999999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.54400000000000004}]},{"osd":6,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.51000000000000001,"15min":0.53400000000000003},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.56100000000000005,"15min":0.59499999999999997},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.86899999999999999,"5min":1.165,"15min":1.165},"last":0.50800000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.55900000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.59099999999999997,"15min":0.61599999999999999},"min":{"1min":0.37,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.76700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574903,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310272,"kb_used_data":696,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061568,"statfs":{"total":96636764160,"available":96319045632,"internally_reserved":0,"allocated":712704,"data_stored":312288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.61799999999999999,"15min":0.70799999999999996},"min":{"1min":0.28399999999999997,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.69499999999999995,"5min":5.0490000000000004,"15min":5.0490000000000004},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.57599999999999996,"15min":0.67600000000000005},"min":{"1min":0.28100000000000003,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.64700000000000002,"5min":5.1449999999999996,"15min":5.1449999999999996},"last":0.41599999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48499999999999999,"15min":0.49099999999999999},"min":{"1min":0.27500000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.75600000000000001,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.438},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52100000000000002,"15min":0.52900000000000003},"min":{"1min":0.30299999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.70999999999999996,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.52300000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57899999999999996,"15min":0.56699999999999995},"min":{"1min":0.41299999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.74099999999999999,"5min":4.234,"15min":4.234},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56699999999999995,"15min":0.57699999999999996},"min":{"1min":0.40000000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72999999999999998,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.55000000000000004}]},{"osd":3,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.61499999999999999,"15min":0.72699999999999998},"min":{"1min":0.32600000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.72099999999999997,"5min":5.2169999999999996,"15min":5.2169999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54900000000000004,"15min":0.55500000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.70199999999999996,"5min":1.008,"15min":1.008},"last":0.57699999999999996}]},{"osd":4,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52200000000000002,"15min":0.53600000000000003},"min":{"1min":0.32700000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.745,"5min":1.917,"15min":1.917},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53700000000000003,"15min":0.55500000000000005},"min":{"1min":0.34399999999999997,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.68600000000000005,"5min":0.87,"15min":0.87},"last":0.46500000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56999999999999995,"15min":0.58099999999999996},"min":{"1min":0.34100000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.68700000000000006,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":0.496},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.61399999999999999,"15min":0.629},"min":{"1min":0.42199999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.77200000000000002,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":0.48599999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58399999999999996,"15min":0.60699999999999998},"min":{"1min":0.39600000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.70199999999999996,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61499999999999999,"15min":0.628},"min":{"1min":0.38700000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.72999999999999998,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.61099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:09:50.386 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:09:50.389 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:09:51.030 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:09:51.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.155+0000 7efe0838b700 1 Processor -- start 2023-10-06T11:09:51.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.155+0000 7efe0838b700 1 -- start start 2023-10-06T11:09:51.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.156+0000 7efe0838b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe000b28e0 0x7efe000c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:51.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.156+0000 7efe0838b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7efe000c53f0 0x7efe000cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:51.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.156+0000 7efe0838b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efe000b2cb0 0x7efe000cf100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:51.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.156+0000 7efe0838b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe000ad2a0 con 0x7efe000b2cb0 2023-10-06T11:09:51.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.156+0000 7efe0838b700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe00099ec0 con 0x7efe000c53f0 2023-10-06T11:09:51.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.156+0000 7efe0838b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe000c7240 con 0x7efe000b28e0 2023-10-06T11:09:51.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.156+0000 7efe06928700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efe000b2cb0 0x7efe000cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:51.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.156+0000 7efe06928700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efe000b2cb0 0x7efe000cf100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40884/0 (socket says 172.21.15.146:40884) 2023-10-06T11:09:51.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.156+0000 7efe06928700 1 -- 172.21.15.146:0/3273691590 learned_addr learned my addr 172.21.15.146:0/3273691590 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:51.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.157+0000 7efe06127700 1 --2- 172.21.15.146:0/3273691590 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe000b28e0 0x7efe000c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:51.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.157+0000 7efe05926700 1 --2- 172.21.15.146:0/3273691590 >> v2:172.21.15.151:3300/0 conn(0x7efe000c53f0 0x7efe000cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:51.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.157+0000 7efe06928700 1 -- 172.21.15.146:0/3273691590 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe000b28e0 msgr2=0x7efe000c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:51.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.157+0000 7efe06928700 1 --2- 172.21.15.146:0/3273691590 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe000b28e0 0x7efe000c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:51.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.157+0000 7efe06928700 1 -- 172.21.15.146:0/3273691590 >> v2:172.21.15.151:3300/0 conn(0x7efe000c53f0 msgr2=0x7efe000cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:51.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.157+0000 7efe06928700 1 --2- 172.21.15.146:0/3273691590 >> v2:172.21.15.151:3300/0 conn(0x7efe000c53f0 0x7efe000cebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:51.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.157+0000 7efe06928700 1 -- 172.21.15.146:0/3273691590 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe000c69a0 con 0x7efe000b2cb0 2023-10-06T11:09:51.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.157+0000 7efe06928700 1 --2- 172.21.15.146:0/3273691590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe000b2cb0 0x7efe000cf100 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7efe00071370 tx=0x7efdf8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a4dd8fbf08a097a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:51.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.157+0000 7efe05125700 1 -- 172.21.15.146:0/3273691590 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf800b640 con 0x7efe000b2cb0 2023-10-06T11:09:51.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.157+0000 7efe05125700 1 -- 172.21.15.146:0/3273691590 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf800b7a0 con 0x7efe000b2cb0 2023-10-06T11:09:51.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.157+0000 7efe05125700 1 -- 172.21.15.146:0/3273691590 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf800bb60 con 0x7efe000b2cb0 2023-10-06T11:09:51.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.158+0000 7efe0838b700 1 -- 172.21.15.146:0/3273691590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe000b2cb0 msgr2=0x7efe000cf100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:51.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.158+0000 7efe0838b700 1 --2- 172.21.15.146:0/3273691590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe000b2cb0 0x7efe000cf100 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7efe00071370 tx=0x7efdf8009250 comp rx=0 tx=0).stop 2023-10-06T11:09:51.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.158+0000 7efe0838b700 1 -- 172.21.15.146:0/3273691590 shutdown_connections 2023-10-06T11:09:51.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.158+0000 7efe0838b700 1 --2- 172.21.15.146:0/3273691590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe000b2cb0 0x7efe000cf100 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:51.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.158+0000 7efe0838b700 1 --2- 172.21.15.146:0/3273691590 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe000b28e0 0x7efe000c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:51.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.158+0000 7efe0838b700 1 --2- 172.21.15.146:0/3273691590 >> v2:172.21.15.151:3300/0 conn(0x7efe000c53f0 0x7efe000cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:51.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.158+0000 7efe0838b700 1 -- 172.21.15.146:0/3273691590 >> 172.21.15.146:0/3273691590 conn(0x7efe000999a0 msgr2=0x7efe0006f380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:51.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.158+0000 7efe0838b700 1 -- 172.21.15.146:0/3273691590 shutdown_connections 2023-10-06T11:09:51.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.158+0000 7efe0838b700 1 -- 172.21.15.146:0/3273691590 wait complete. 2023-10-06T11:09:51.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.159+0000 7efe0838b700 1 Processor -- start 2023-10-06T11:09:51.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.159+0000 7efe0838b700 1 -- start start 2023-10-06T11:09:51.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.160+0000 7efe0838b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe000b28e0 0x7efe000b49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:51.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.160+0000 7efe0838b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe000b2cb0 0x7efe000cc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:51.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.160+0000 7efe0838b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe000c53f0 0x7efe000b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:51.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.160+0000 7efe0838b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe000b4f30 con 0x7efe000c53f0 2023-10-06T11:09:51.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.160+0000 7efe0838b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe000b6200 con 0x7efe000b2cb0 2023-10-06T11:09:51.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.160+0000 7efe0838b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe000b5160 con 0x7efe000b28e0 2023-10-06T11:09:51.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.160+0000 7efe06928700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe000c53f0 0x7efe000b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:51.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.160+0000 7efe06928700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe000c53f0 0x7efe000b33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40900/0 (socket says 172.21.15.146:40900) 2023-10-06T11:09:51.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.160+0000 7efe06928700 1 -- 172.21.15.146:0/778043316 learned_addr learned my addr 172.21.15.146:0/778043316 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:51.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.160+0000 7efe06127700 1 --2- 172.21.15.146:0/778043316 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe000b28e0 0x7efe000b49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:51.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.160+0000 7efe05926700 1 --2- 172.21.15.146:0/778043316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe000b2cb0 0x7efe000cc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:51.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.160+0000 7efe06928700 1 -- 172.21.15.146:0/778043316 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe000b28e0 msgr2=0x7efe000b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:51.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.160+0000 7efe06928700 1 --2- 172.21.15.146:0/778043316 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe000b28e0 0x7efe000b49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:51.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.160+0000 7efe06928700 1 -- 172.21.15.146:0/778043316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe000b2cb0 msgr2=0x7efe000cc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:51.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.160+0000 7efe06928700 1 --2- 172.21.15.146:0/778043316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe000b2cb0 0x7efe000cc750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:51.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.160+0000 7efe06928700 1 -- 172.21.15.146:0/778043316 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf80094f0 con 0x7efe000c53f0 2023-10-06T11:09:51.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.160+0000 7efe06928700 1 --2- 172.21.15.146:0/778043316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe000c53f0 0x7efe000b33f0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7efdf80094c0 tx=0x7efdf8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:51.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.160+0000 7efdf67fc700 1 -- 172.21.15.146:0/778043316 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf800bb20 con 0x7efe000c53f0 2023-10-06T11:09:51.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.160+0000 7efdf67fc700 1 -- 172.21.15.146:0/778043316 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf8011420 con 0x7efe000c53f0 2023-10-06T11:09:51.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.160+0000 7efe0838b700 1 -- 172.21.15.146:0/778043316 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe000b5440 con 0x7efe000c53f0 2023-10-06T11:09:51.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.160+0000 7efdf67fc700 1 -- 172.21.15.146:0/778043316 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf80117e0 con 0x7efe000c53f0 2023-10-06T11:09:51.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.160+0000 7efe0838b700 1 -- 172.21.15.146:0/778043316 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe000b5a00 con 0x7efe000c53f0 2023-10-06T11:09:51.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.161+0000 7efe0838b700 1 -- 172.21.15.146:0/778043316 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe0004c380 con 0x7efe000c53f0 2023-10-06T11:09:51.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.162+0000 7efdf67fc700 1 -- 172.21.15.146:0/778043316 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efdf8011b50 con 0x7efe000c53f0 2023-10-06T11:09:51.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.162+0000 7efdf67fc700 1 --2- 172.21.15.146:0/778043316 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7efde4066f30 0x7efde40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:51.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.162+0000 7efe06127700 1 --2- 172.21.15.146:0/778043316 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7efde4066f30 0x7efde40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:51.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.162+0000 7efdf67fc700 1 -- 172.21.15.146:0/778043316 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6058+0+0 (secure 0 0 0) 0x7efdf8085f50 con 0x7efe000c53f0 2023-10-06T11:09:51.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.163+0000 7efe06127700 1 --2- 172.21.15.146:0/778043316 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7efde4066f30 0x7efde40693e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7efe001569f0 tx=0x7efdfc00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:51.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.167+0000 7efdf67fc700 1 -- 172.21.15.146:0/778043316 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efdf80530e0 con 0x7efe000c53f0 2023-10-06T11:09:51.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.344+0000 7efe0838b700 1 -- 172.21.15.146:0/778043316 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efe000c6c80 con 0x7efde4066f30 2023-10-06T11:09:51.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.353+0000 7efdf67fc700 1 -- 172.21.15.146:0/778043316 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311121 (secure 0 0 0) 0x7efe000c6c80 con 0x7efde4066f30 2023-10-06T11:09:51.358 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:09:51.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.356+0000 7efe0838b700 1 -- 172.21.15.146:0/778043316 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7efde4066f30 msgr2=0x7efde40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:51.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.356+0000 7efe0838b700 1 --2- 172.21.15.146:0/778043316 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7efde4066f30 0x7efde40693e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7efe001569f0 tx=0x7efdfc00b040 comp rx=0 tx=0).stop 2023-10-06T11:09:51.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.356+0000 7efe0838b700 1 -- 172.21.15.146:0/778043316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe000c53f0 msgr2=0x7efe000b33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:51.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.356+0000 7efe0838b700 1 --2- 172.21.15.146:0/778043316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe000c53f0 0x7efe000b33f0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7efdf80094c0 tx=0x7efdf8017000 comp rx=0 tx=0).stop 2023-10-06T11:09:51.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.356+0000 7efe0838b700 1 -- 172.21.15.146:0/778043316 shutdown_connections 2023-10-06T11:09:51.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.356+0000 7efe0838b700 1 --2- 172.21.15.146:0/778043316 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7efde4066f30 0x7efde40693e0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:51.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.356+0000 7efe0838b700 1 --2- 172.21.15.146:0/778043316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe000c53f0 0x7efe000b33f0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:51.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.356+0000 7efe0838b700 1 --2- 172.21.15.146:0/778043316 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe000b28e0 0x7efe000b49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:51.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.356+0000 7efe0838b700 1 --2- 172.21.15.146:0/778043316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe000b2cb0 0x7efe000cc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:51.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.356+0000 7efe0838b700 1 -- 172.21.15.146:0/778043316 >> 172.21.15.146:0/778043316 conn(0x7efe000999a0 msgr2=0x7efe001573d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:51.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.357+0000 7efe0838b700 1 -- 172.21.15.146:0/778043316 shutdown_connections 2023-10-06T11:09:51.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.357+0000 7efe0838b700 1 -- 172.21.15.146:0/778043316 wait complete. 2023-10-06T11:09:51.361 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:09:51.371 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2023-10-06T11:09:51.193416+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":199,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2438296,"kb_used_data":6744,"kb_used_omap":0,"kb_used_meta":2431488,"kb_avail":752536424,"statfs":{"total":773094113280,"available":770597298176,"internally_reserved":0,"allocated":6905856,"data_stored":3678064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2489843712},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.979296"},"pg_stats":[{"pgid":"10.3f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.237242+0000","last_change":"2023-10-06T11:09:42.232857+0000","last_active":"2023-10-06T11:09:42.237242+0000","last_peered":"2023-10-06T11:09:42.237242+0000","last_clean":"2023-10-06T11:09:42.237242+0000","last_became_active":"2023-10-06T11:09:42.232668+0000","last_became_peered":"2023-10-06T11:09:42.232668+0000","last_unstale":"2023-10-06T11:09:42.237242+0000","last_undegraded":"2023-10-06T11:09:42.237242+0000","last_fullsized":"2023-10-06T11:09:42.237242+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:05:31.432383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.236852+0000","last_change":"2023-10-06T11:09:42.235533+0000","last_active":"2023-10-06T11:09:42.236852+0000","last_peered":"2023-10-06T11:09:42.236852+0000","last_clean":"2023-10-06T11:09:42.236852+0000","last_became_active":"2023-10-06T11:09:42.235247+0000","last_became_peered":"2023-10-06T11:09:42.235247+0000","last_unstale":"2023-10-06T11:09:42.236852+0000","last_undegraded":"2023-10-06T11:09:42.236852+0000","last_fullsized":"2023-10-06T11:09:42.236852+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:04:57.888469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.3d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.233847+0000","last_change":"2023-10-06T11:09:42.225563+0000","last_active":"2023-10-06T11:09:42.233847+0000","last_peered":"2023-10-06T11:09:42.233847+0000","last_clean":"2023-10-06T11:09:42.233847+0000","last_became_active":"2023-10-06T11:09:42.225297+0000","last_became_peered":"2023-10-06T11:09:42.225297+0000","last_unstale":"2023-10-06T11:09:42.233847+0000","last_undegraded":"2023-10-06T11:09:42.233847+0000","last_fullsized":"2023-10-06T11:09:42.233847+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:22:01.027500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.3c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.240968+0000","last_change":"2023-10-06T11:09:42.236341+0000","last_active":"2023-10-06T11:09:42.240968+0000","last_peered":"2023-10-06T11:09:42.240968+0000","last_clean":"2023-10-06T11:09:42.240968+0000","last_became_active":"2023-10-06T11:09:42.236063+0000","last_became_peered":"2023-10-06T11:09:42.236063+0000","last_unstale":"2023-10-06T11:09:42.240968+0000","last_undegraded":"2023-10-06T11:09:42.240968+0000","last_fullsized":"2023-10-06T11:09:42.240968+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:25.857721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.3b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.241155+0000","last_change":"2023-10-06T11:09:42.233776+0000","last_active":"2023-10-06T11:09:42.241155+0000","last_peered":"2023-10-06T11:09:42.241155+0000","last_clean":"2023-10-06T11:09:42.241155+0000","last_became_active":"2023-10-06T11:09:42.233510+0000","last_became_peered":"2023-10-06T11:09:42.233510+0000","last_unstale":"2023-10-06T11:09:42.241155+0000","last_undegraded":"2023-10-06T11:09:42.241155+0000","last_fullsized":"2023-10-06T11:09:42.241155+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:51:40.439269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.3a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.236999+0000","last_change":"2023-10-06T11:09:42.234386+0000","last_active":"2023-10-06T11:09:42.236999+0000","last_peered":"2023-10-06T11:09:42.236999+0000","last_clean":"2023-10-06T11:09:42.236999+0000","last_became_active":"2023-10-06T11:09:42.234150+0000","last_became_peered":"2023-10-06T11:09:42.234150+0000","last_unstale":"2023-10-06T11:09:42.236999+0000","last_undegraded":"2023-10-06T11:09:42.236999+0000","last_fullsized":"2023-10-06T11:09:42.236999+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:23:07.383775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.39","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.227283+0000","last_change":"2023-10-06T11:09:42.223581+0000","last_active":"2023-10-06T11:09:42.227283+0000","last_peered":"2023-10-06T11:09:42.227283+0000","last_clean":"2023-10-06T11:09:42.227283+0000","last_became_active":"2023-10-06T11:09:42.223299+0000","last_became_peered":"2023-10-06T11:09:42.223299+0000","last_unstale":"2023-10-06T11:09:42.227283+0000","last_undegraded":"2023-10-06T11:09:42.227283+0000","last_fullsized":"2023-10-06T11:09:42.227283+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:37:14.750346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.38","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.240913+0000","last_change":"2023-10-06T11:09:42.237243+0000","last_active":"2023-10-06T11:09:42.240913+0000","last_peered":"2023-10-06T11:09:42.240913+0000","last_clean":"2023-10-06T11:09:42.240913+0000","last_became_active":"2023-10-06T11:09:42.236962+0000","last_became_peered":"2023-10-06T11:09:42.236962+0000","last_unstale":"2023-10-06T11:09:42.240913+0000","last_undegraded":"2023-10-06T11:09:42.240913+0000","last_fullsized":"2023-10-06T11:09:42.240913+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:11:07.460296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.37","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.236771+0000","last_change":"2023-10-06T11:09:42.233949+0000","last_active":"2023-10-06T11:09:42.236771+0000","last_peered":"2023-10-06T11:09:42.236771+0000","last_clean":"2023-10-06T11:09:42.236771+0000","last_became_active":"2023-10-06T11:09:42.233703+0000","last_became_peered":"2023-10-06T11:09:42.233703+0000","last_unstale":"2023-10-06T11:09:42.236771+0000","last_undegraded":"2023-10-06T11:09:42.236771+0000","last_fullsized":"2023-10-06T11:09:42.236771+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:53:10.461851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.36","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.240935+0000","last_change":"2023-10-06T11:09:42.235877+0000","last_active":"2023-10-06T11:09:42.240935+0000","last_peered":"2023-10-06T11:09:42.240935+0000","last_clean":"2023-10-06T11:09:42.240935+0000","last_became_active":"2023-10-06T11:09:42.235615+0000","last_became_peered":"2023-10-06T11:09:42.235615+0000","last_unstale":"2023-10-06T11:09:42.240935+0000","last_undegraded":"2023-10-06T11:09:42.240935+0000","last_fullsized":"2023-10-06T11:09:42.240935+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:01:52.167469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.35","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.238386+0000","last_change":"2023-10-06T11:09:42.232740+0000","last_active":"2023-10-06T11:09:42.238386+0000","last_peered":"2023-10-06T11:09:42.238386+0000","last_clean":"2023-10-06T11:09:42.238386+0000","last_became_active":"2023-10-06T11:09:42.230980+0000","last_became_peered":"2023-10-06T11:09:42.230980+0000","last_unstale":"2023-10-06T11:09:42.238386+0000","last_undegraded":"2023-10-06T11:09:42.238386+0000","last_fullsized":"2023-10-06T11:09:42.238386+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:53.894745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.34","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.240874+0000","last_change":"2023-10-06T11:09:42.237074+0000","last_active":"2023-10-06T11:09:42.240874+0000","last_peered":"2023-10-06T11:09:42.240874+0000","last_clean":"2023-10-06T11:09:42.240874+0000","last_became_active":"2023-10-06T11:09:42.236805+0000","last_became_peered":"2023-10-06T11:09:42.236805+0000","last_unstale":"2023-10-06T11:09:42.240874+0000","last_undegraded":"2023-10-06T11:09:42.240874+0000","last_fullsized":"2023-10-06T11:09:42.240874+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:06:54.424848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.33","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.238322+0000","last_change":"2023-10-06T11:09:42.234158+0000","last_active":"2023-10-06T11:09:42.238322+0000","last_peered":"2023-10-06T11:09:42.238322+0000","last_clean":"2023-10-06T11:09:42.238322+0000","last_became_active":"2023-10-06T11:09:42.233239+0000","last_became_peered":"2023-10-06T11:09:42.233239+0000","last_unstale":"2023-10-06T11:09:42.238322+0000","last_undegraded":"2023-10-06T11:09:42.238322+0000","last_fullsized":"2023-10-06T11:09:42.238322+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:37:07.428678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.32","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.233777+0000","last_change":"2023-10-06T11:09:42.225677+0000","last_active":"2023-10-06T11:09:42.233777+0000","last_peered":"2023-10-06T11:09:42.233777+0000","last_clean":"2023-10-06T11:09:42.233777+0000","last_became_active":"2023-10-06T11:09:42.225397+0000","last_became_peered":"2023-10-06T11:09:42.225397+0000","last_unstale":"2023-10-06T11:09:42.233777+0000","last_undegraded":"2023-10-06T11:09:42.233777+0000","last_fullsized":"2023-10-06T11:09:42.233777+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:15.899968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.31","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.234807+0000","last_change":"2023-10-06T11:09:42.231826+0000","last_active":"2023-10-06T11:09:42.234807+0000","last_peered":"2023-10-06T11:09:42.234807+0000","last_clean":"2023-10-06T11:09:42.234807+0000","last_became_active":"2023-10-06T11:09:42.229429+0000","last_became_peered":"2023-10-06T11:09:42.229429+0000","last_unstale":"2023-10-06T11:09:42.234807+0000","last_undegraded":"2023-10-06T11:09:42.234807+0000","last_fullsized":"2023-10-06T11:09:42.234807+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:00:08.984931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.30","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.238250+0000","last_change":"2023-10-06T11:09:42.235593+0000","last_active":"2023-10-06T11:09:42.238250+0000","last_peered":"2023-10-06T11:09:42.238250+0000","last_clean":"2023-10-06T11:09:42.238250+0000","last_became_active":"2023-10-06T11:09:42.235344+0000","last_became_peered":"2023-10-06T11:09:42.235344+0000","last_unstale":"2023-10-06T11:09:42.238250+0000","last_undegraded":"2023-10-06T11:09:42.238250+0000","last_fullsized":"2023-10-06T11:09:42.238250+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:32:33.321028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.2f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.234797+0000","last_change":"2023-10-06T11:09:42.230670+0000","last_active":"2023-10-06T11:09:42.234797+0000","last_peered":"2023-10-06T11:09:42.234797+0000","last_clean":"2023-10-06T11:09:42.234797+0000","last_became_active":"2023-10-06T11:09:42.230448+0000","last_became_peered":"2023-10-06T11:09:42.230448+0000","last_unstale":"2023-10-06T11:09:42.234797+0000","last_undegraded":"2023-10-06T11:09:42.234797+0000","last_fullsized":"2023-10-06T11:09:42.234797+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:01:57.169564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.238315+0000","last_change":"2023-10-06T11:09:42.232284+0000","last_active":"2023-10-06T11:09:42.238315+0000","last_peered":"2023-10-06T11:09:42.238315+0000","last_clean":"2023-10-06T11:09:42.238315+0000","last_became_active":"2023-10-06T11:09:42.231990+0000","last_became_peered":"2023-10-06T11:09:42.231990+0000","last_unstale":"2023-10-06T11:09:42.238315+0000","last_undegraded":"2023-10-06T11:09:42.238315+0000","last_fullsized":"2023-10-06T11:09:42.238315+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:10:47.746855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.2d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.241072+0000","last_change":"2023-10-06T11:09:42.232237+0000","last_active":"2023-10-06T11:09:42.241072+0000","last_peered":"2023-10-06T11:09:42.241072+0000","last_clean":"2023-10-06T11:09:42.241072+0000","last_became_active":"2023-10-06T11:09:42.231280+0000","last_became_peered":"2023-10-06T11:09:42.231280+0000","last_unstale":"2023-10-06T11:09:42.241072+0000","last_undegraded":"2023-10-06T11:09:42.241072+0000","last_fullsized":"2023-10-06T11:09:42.241072+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:15.427811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.256915+0000","last_change":"2023-10-06T11:09:42.256441+0000","last_active":"2023-10-06T11:09:42.256915+0000","last_peered":"2023-10-06T11:09:42.256915+0000","last_clean":"2023-10-06T11:09:42.256915+0000","last_became_active":"2023-10-06T11:09:42.256203+0000","last_became_peered":"2023-10-06T11:09:42.256203+0000","last_unstale":"2023-10-06T11:09:42.256915+0000","last_undegraded":"2023-10-06T11:09:42.256915+0000","last_fullsized":"2023-10-06T11:09:42.256915+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:26.358337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.238311+0000","last_change":"2023-10-06T11:09:42.234079+0000","last_active":"2023-10-06T11:09:42.238311+0000","last_peered":"2023-10-06T11:09:42.238311+0000","last_clean":"2023-10-06T11:09:42.238311+0000","last_became_active":"2023-10-06T11:09:42.232879+0000","last_became_peered":"2023-10-06T11:09:42.232879+0000","last_unstale":"2023-10-06T11:09:42.238311+0000","last_undegraded":"2023-10-06T11:09:42.238311+0000","last_fullsized":"2023-10-06T11:09:42.238311+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:39:06.623968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.2a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.256450+0000","last_change":"2023-10-06T11:09:42.255496+0000","last_active":"2023-10-06T11:09:42.256450+0000","last_peered":"2023-10-06T11:09:42.256450+0000","last_clean":"2023-10-06T11:09:42.256450+0000","last_became_active":"2023-10-06T11:09:42.255193+0000","last_became_peered":"2023-10-06T11:09:42.255193+0000","last_unstale":"2023-10-06T11:09:42.256450+0000","last_undegraded":"2023-10-06T11:09:42.256450+0000","last_fullsized":"2023-10-06T11:09:42.256450+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:52:24.958762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.29","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.256178+0000","last_change":"2023-10-06T11:09:42.255340+0000","last_active":"2023-10-06T11:09:42.256178+0000","last_peered":"2023-10-06T11:09:42.256178+0000","last_clean":"2023-10-06T11:09:42.256178+0000","last_became_active":"2023-10-06T11:09:42.255102+0000","last_became_peered":"2023-10-06T11:09:42.255102+0000","last_unstale":"2023-10-06T11:09:42.256178+0000","last_undegraded":"2023-10-06T11:09:42.256178+0000","last_fullsized":"2023-10-06T11:09:42.256178+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:40:31.710840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.28","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.233890+0000","last_change":"2023-10-06T11:09:42.226062+0000","last_active":"2023-10-06T11:09:42.233890+0000","last_peered":"2023-10-06T11:09:42.233890+0000","last_clean":"2023-10-06T11:09:42.233890+0000","last_became_active":"2023-10-06T11:09:42.225828+0000","last_became_peered":"2023-10-06T11:09:42.225828+0000","last_unstale":"2023-10-06T11:09:42.233890+0000","last_undegraded":"2023-10-06T11:09:42.233890+0000","last_fullsized":"2023-10-06T11:09:42.233890+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:32:21.749142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.27","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.240752+0000","last_change":"2023-10-06T11:09:42.236411+0000","last_active":"2023-10-06T11:09:42.240752+0000","last_peered":"2023-10-06T11:09:42.240752+0000","last_clean":"2023-10-06T11:09:42.240752+0000","last_became_active":"2023-10-06T11:09:42.236152+0000","last_became_peered":"2023-10-06T11:09:42.236152+0000","last_unstale":"2023-10-06T11:09:42.240752+0000","last_undegraded":"2023-10-06T11:09:42.240752+0000","last_fullsized":"2023-10-06T11:09:42.240752+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:13.716196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.26","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.234008+0000","last_change":"2023-10-06T11:09:42.232091+0000","last_active":"2023-10-06T11:09:42.234008+0000","last_peered":"2023-10-06T11:09:42.234008+0000","last_clean":"2023-10-06T11:09:42.234008+0000","last_became_active":"2023-10-06T11:09:42.231833+0000","last_became_peered":"2023-10-06T11:09:42.231833+0000","last_unstale":"2023-10-06T11:09:42.234008+0000","last_undegraded":"2023-10-06T11:09:42.234008+0000","last_fullsized":"2023-10-06T11:09:42.234008+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:29:33.571825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.25","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.238369+0000","last_change":"2023-10-06T11:09:42.231444+0000","last_active":"2023-10-06T11:09:42.238369+0000","last_peered":"2023-10-06T11:09:42.238369+0000","last_clean":"2023-10-06T11:09:42.238369+0000","last_became_active":"2023-10-06T11:09:42.230697+0000","last_became_peered":"2023-10-06T11:09:42.230697+0000","last_unstale":"2023-10-06T11:09:42.238369+0000","last_undegraded":"2023-10-06T11:09:42.238369+0000","last_fullsized":"2023-10-06T11:09:42.238369+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:05:31.432383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.24","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.239846+0000","last_change":"2023-10-06T11:09:42.238581+0000","last_active":"2023-10-06T11:09:42.239846+0000","last_peered":"2023-10-06T11:09:42.239846+0000","last_clean":"2023-10-06T11:09:42.239846+0000","last_became_active":"2023-10-06T11:09:42.238389+0000","last_became_peered":"2023-10-06T11:09:42.238389+0000","last_unstale":"2023-10-06T11:09:42.239846+0000","last_undegraded":"2023-10-06T11:09:42.239846+0000","last_fullsized":"2023-10-06T11:09:42.239846+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:13.716196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.23","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.234930+0000","last_change":"2023-10-06T11:09:42.232845+0000","last_active":"2023-10-06T11:09:42.234930+0000","last_peered":"2023-10-06T11:09:42.234930+0000","last_clean":"2023-10-06T11:09:42.234930+0000","last_became_active":"2023-10-06T11:09:42.232569+0000","last_became_peered":"2023-10-06T11:09:42.232569+0000","last_unstale":"2023-10-06T11:09:42.234930+0000","last_undegraded":"2023-10-06T11:09:42.234930+0000","last_fullsized":"2023-10-06T11:09:42.234930+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:26.590053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.22","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.241020+0000","last_change":"2023-10-06T11:09:42.239073+0000","last_active":"2023-10-06T11:09:42.241020+0000","last_peered":"2023-10-06T11:09:42.241020+0000","last_clean":"2023-10-06T11:09:42.241020+0000","last_became_active":"2023-10-06T11:09:42.238822+0000","last_became_peered":"2023-10-06T11:09:42.238822+0000","last_unstale":"2023-10-06T11:09:42.241020+0000","last_undegraded":"2023-10-06T11:09:42.241020+0000","last_fullsized":"2023-10-06T11:09:42.241020+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:06:18.955546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.21","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.232116+0000","last_change":"2023-10-06T11:09:42.230451+0000","last_active":"2023-10-06T11:09:42.232116+0000","last_peered":"2023-10-06T11:09:42.232116+0000","last_clean":"2023-10-06T11:09:42.232116+0000","last_became_active":"2023-10-06T11:09:42.230170+0000","last_became_peered":"2023-10-06T11:09:42.230170+0000","last_unstale":"2023-10-06T11:09:42.232116+0000","last_undegraded":"2023-10-06T11:09:42.232116+0000","last_fullsized":"2023-10-06T11:09:42.232116+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:07:11.162512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.20","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.234677+0000","last_change":"2023-10-06T11:09:42.228466+0000","last_active":"2023-10-06T11:09:42.234677+0000","last_peered":"2023-10-06T11:09:42.234677+0000","last_clean":"2023-10-06T11:09:42.234677+0000","last_became_active":"2023-10-06T11:09:42.228215+0000","last_became_peered":"2023-10-06T11:09:42.228215+0000","last_unstale":"2023-10-06T11:09:42.234677+0000","last_undegraded":"2023-10-06T11:09:42.234677+0000","last_fullsized":"2023-10-06T11:09:42.234677+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:20:39.904258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.240926+0000","last_change":"2023-10-06T11:09:42.230224+0000","last_active":"2023-10-06T11:09:42.240926+0000","last_peered":"2023-10-06T11:09:42.240926+0000","last_clean":"2023-10-06T11:09:42.240926+0000","last_became_active":"2023-10-06T11:09:42.229962+0000","last_became_peered":"2023-10-06T11:09:42.229962+0000","last_unstale":"2023-10-06T11:09:42.240926+0000","last_undegraded":"2023-10-06T11:09:42.240926+0000","last_fullsized":"2023-10-06T11:09:42.240926+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:39:11.614060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"58'4","reported_seq":14,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.345081+0000","last_change":"2023-10-06T11:09:41.213260+0000","last_active":"2023-10-06T11:09:42.345081+0000","last_peered":"2023-10-06T11:09:42.345081+0000","last_clean":"2023-10-06T11:09:42.345081+0000","last_became_active":"2023-10-06T11:09:41.213069+0000","last_became_peered":"2023-10-06T11:09:41.213069+0000","last_unstale":"2023-10-06T11:09:42.345081+0000","last_undegraded":"2023-10-06T11:09:42.345081+0000","last_fullsized":"2023-10-06T11:09:42.345081+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:48:05.076777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.238347+0000","last_change":"2023-10-06T11:09:42.231249+0000","last_active":"2023-10-06T11:09:42.238347+0000","last_peered":"2023-10-06T11:09:42.238347+0000","last_clean":"2023-10-06T11:09:42.238347+0000","last_became_active":"2023-10-06T11:09:42.230418+0000","last_became_peered":"2023-10-06T11:09:42.230418+0000","last_unstale":"2023-10-06T11:09:42.238347+0000","last_undegraded":"2023-10-06T11:09:42.238347+0000","last_fullsized":"2023-10-06T11:09:42.238347+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:29:33.571825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"58'1","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.341943+0000","last_change":"2023-10-06T11:09:41.216511+0000","last_active":"2023-10-06T11:09:42.341943+0000","last_peered":"2023-10-06T11:09:42.341943+0000","last_clean":"2023-10-06T11:09:42.341943+0000","last_became_active":"2023-10-06T11:09:41.216244+0000","last_became_peered":"2023-10-06T11:09:41.216244+0000","last_unstale":"2023-10-06T11:09:42.341943+0000","last_undegraded":"2023-10-06T11:09:42.341943+0000","last_fullsized":"2023-10-06T11:09:42.341943+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:01:51.162810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.234861+0000","last_change":"2023-10-06T11:09:42.229034+0000","last_active":"2023-10-06T11:09:42.234861+0000","last_peered":"2023-10-06T11:09:42.234861+0000","last_clean":"2023-10-06T11:09:42.234861+0000","last_became_active":"2023-10-06T11:09:42.228734+0000","last_became_peered":"2023-10-06T11:09:42.228734+0000","last_unstale":"2023-10-06T11:09:42.234861+0000","last_undegraded":"2023-10-06T11:09:42.234861+0000","last_fullsized":"2023-10-06T11:09:42.234861+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:17:44.409872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"58'2","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.342510+0000","last_change":"2023-10-06T11:09:41.213108+0000","last_active":"2023-10-06T11:09:42.342510+0000","last_peered":"2023-10-06T11:09:42.342510+0000","last_clean":"2023-10-06T11:09:42.342510+0000","last_became_active":"2023-10-06T11:09:41.212695+0000","last_became_peered":"2023-10-06T11:09:41.212695+0000","last_unstale":"2023-10-06T11:09:42.342510+0000","last_undegraded":"2023-10-06T11:09:42.342510+0000","last_fullsized":"2023-10-06T11:09:42.342510+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:32:20.744483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.234526+0000","last_change":"2023-10-06T11:09:42.227750+0000","last_active":"2023-10-06T11:09:42.234526+0000","last_peered":"2023-10-06T11:09:42.234526+0000","last_clean":"2023-10-06T11:09:42.234526+0000","last_became_active":"2023-10-06T11:09:42.227479+0000","last_became_peered":"2023-10-06T11:09:42.227479+0000","last_unstale":"2023-10-06T11:09:42.234526+0000","last_undegraded":"2023-10-06T11:09:42.234526+0000","last_fullsized":"2023-10-06T11:09:42.234526+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:08:15.143503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"58'2","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.342311+0000","last_change":"2023-10-06T11:09:41.216502+0000","last_active":"2023-10-06T11:09:42.342311+0000","last_peered":"2023-10-06T11:09:42.342311+0000","last_clean":"2023-10-06T11:09:42.342311+0000","last_became_active":"2023-10-06T11:09:41.216217+0000","last_became_peered":"2023-10-06T11:09:41.216217+0000","last_unstale":"2023-10-06T11:09:42.342311+0000","last_undegraded":"2023-10-06T11:09:42.342311+0000","last_fullsized":"2023-10-06T11:09:42.342311+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:08:14.138844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.236789+0000","last_change":"2023-10-06T11:09:42.231963+0000","last_active":"2023-10-06T11:09:42.236789+0000","last_peered":"2023-10-06T11:09:42.236789+0000","last_clean":"2023-10-06T11:09:42.236789+0000","last_became_active":"2023-10-06T11:09:42.231567+0000","last_became_peered":"2023-10-06T11:09:42.231567+0000","last_unstale":"2023-10-06T11:09:42.236789+0000","last_undegraded":"2023-10-06T11:09:42.236789+0000","last_fullsized":"2023-10-06T11:09:42.236789+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:57:11.763583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"58'1","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.341518+0000","last_change":"2023-10-06T11:09:41.218930+0000","last_active":"2023-10-06T11:09:42.341518+0000","last_peered":"2023-10-06T11:09:42.341518+0000","last_clean":"2023-10-06T11:09:42.341518+0000","last_became_active":"2023-10-06T11:09:41.218683+0000","last_became_peered":"2023-10-06T11:09:41.218683+0000","last_unstale":"2023-10-06T11:09:42.341518+0000","last_undegraded":"2023-10-06T11:09:42.341518+0000","last_fullsized":"2023-10-06T11:09:42.341518+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:13:27.560433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.236526+0000","last_change":"2023-10-06T11:09:42.232629+0000","last_active":"2023-10-06T11:09:42.236526+0000","last_peered":"2023-10-06T11:09:42.236526+0000","last_clean":"2023-10-06T11:09:42.236526+0000","last_became_active":"2023-10-06T11:09:42.232390+0000","last_became_peered":"2023-10-06T11:09:42.232390+0000","last_unstale":"2023-10-06T11:09:42.236526+0000","last_undegraded":"2023-10-06T11:09:42.236526+0000","last_fullsized":"2023-10-06T11:09:42.236526+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:40:23.620747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"58'1","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.341177+0000","last_change":"2023-10-06T11:09:41.208722+0000","last_active":"2023-10-06T11:09:42.341177+0000","last_peered":"2023-10-06T11:09:42.341177+0000","last_clean":"2023-10-06T11:09:42.341177+0000","last_became_active":"2023-10-06T11:09:41.208481+0000","last_became_peered":"2023-10-06T11:09:41.208481+0000","last_unstale":"2023-10-06T11:09:42.341177+0000","last_undegraded":"2023-10-06T11:09:42.341177+0000","last_fullsized":"2023-10-06T11:09:42.341177+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:06:53.420190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.230558+0000","last_change":"2023-10-06T11:09:42.227251+0000","last_active":"2023-10-06T11:09:42.230558+0000","last_peered":"2023-10-06T11:09:42.230558+0000","last_clean":"2023-10-06T11:09:42.230558+0000","last_became_active":"2023-10-06T11:09:42.226952+0000","last_became_peered":"2023-10-06T11:09:42.226952+0000","last_unstale":"2023-10-06T11:09:42.230558+0000","last_undegraded":"2023-10-06T11:09:42.230558+0000","last_fullsized":"2023-10-06T11:09:42.230558+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:59.957433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.221721+0000","last_change":"2023-10-06T11:09:41.218780+0000","last_active":"2023-10-06T11:09:42.221721+0000","last_peered":"2023-10-06T11:09:42.221721+0000","last_clean":"2023-10-06T11:09:42.221721+0000","last_became_active":"2023-10-06T11:09:41.218522+0000","last_became_peered":"2023-10-06T11:09:41.218522+0000","last_unstale":"2023-10-06T11:09:42.221721+0000","last_undegraded":"2023-10-06T11:09:42.221721+0000","last_fullsized":"2023-10-06T11:09:42.221721+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:52:25.585394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.259245+0000","last_change":"2023-10-06T11:09:42.258941+0000","last_active":"2023-10-06T11:09:42.259245+0000","last_peered":"2023-10-06T11:09:42.259245+0000","last_clean":"2023-10-06T11:09:42.259245+0000","last_became_active":"2023-10-06T11:09:42.258749+0000","last_became_peered":"2023-10-06T11:09:42.258749+0000","last_unstale":"2023-10-06T11:09:42.259245+0000","last_undegraded":"2023-10-06T11:09:42.259245+0000","last_fullsized":"2023-10-06T11:09:42.259245+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:00:08.984931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.221470+0000","last_change":"2023-10-06T11:09:41.215714+0000","last_active":"2023-10-06T11:09:42.221470+0000","last_peered":"2023-10-06T11:09:42.221470+0000","last_clean":"2023-10-06T11:09:42.221470+0000","last_became_active":"2023-10-06T11:09:41.215430+0000","last_became_peered":"2023-10-06T11:09:41.215430+0000","last_unstale":"2023-10-06T11:09:42.221470+0000","last_undegraded":"2023-10-06T11:09:42.221470+0000","last_fullsized":"2023-10-06T11:09:42.221470+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:48:06.642258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.231030+0000","last_change":"2023-10-06T11:09:42.227904+0000","last_active":"2023-10-06T11:09:42.231030+0000","last_peered":"2023-10-06T11:09:42.231030+0000","last_clean":"2023-10-06T11:09:42.231030+0000","last_became_active":"2023-10-06T11:09:42.227654+0000","last_became_peered":"2023-10-06T11:09:42.227654+0000","last_unstale":"2023-10-06T11:09:42.231030+0000","last_undegraded":"2023-10-06T11:09:42.231030+0000","last_fullsized":"2023-10-06T11:09:42.231030+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:53.894745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.219586+0000","last_change":"2023-10-06T11:09:41.217448+0000","last_active":"2023-10-06T11:09:42.219586+0000","last_peered":"2023-10-06T11:09:42.219586+0000","last_clean":"2023-10-06T11:09:42.219586+0000","last_became_active":"2023-10-06T11:09:41.217135+0000","last_became_peered":"2023-10-06T11:09:41.217135+0000","last_unstale":"2023-10-06T11:09:42.219586+0000","last_undegraded":"2023-10-06T11:09:42.219586+0000","last_fullsized":"2023-10-06T11:09:42.219586+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:40:22.616089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.256653+0000","last_change":"2023-10-06T11:09:42.256154+0000","last_active":"2023-10-06T11:09:42.256653+0000","last_peered":"2023-10-06T11:09:42.256653+0000","last_clean":"2023-10-06T11:09:42.256653+0000","last_became_active":"2023-10-06T11:09:42.255559+0000","last_became_peered":"2023-10-06T11:09:42.255559+0000","last_unstale":"2023-10-06T11:09:42.256653+0000","last_undegraded":"2023-10-06T11:09:42.256653+0000","last_fullsized":"2023-10-06T11:09:42.256653+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:57:54.298243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.228811+0000","last_change":"2023-10-06T11:09:41.212720+0000","last_active":"2023-10-06T11:09:42.228811+0000","last_peered":"2023-10-06T11:09:42.228811+0000","last_clean":"2023-10-06T11:09:42.228811+0000","last_became_active":"2023-10-06T11:09:41.212468+0000","last_became_peered":"2023-10-06T11:09:41.212468+0000","last_unstale":"2023-10-06T11:09:42.228811+0000","last_undegraded":"2023-10-06T11:09:42.228811+0000","last_fullsized":"2023-10-06T11:09:42.228811+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:57.202092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.241033+0000","last_change":"2023-10-06T11:09:42.231969+0000","last_active":"2023-10-06T11:09:42.241033+0000","last_peered":"2023-10-06T11:09:42.241033+0000","last_clean":"2023-10-06T11:09:42.241033+0000","last_became_active":"2023-10-06T11:09:42.231685+0000","last_became_peered":"2023-10-06T11:09:42.231685+0000","last_unstale":"2023-10-06T11:09:42.241033+0000","last_undegraded":"2023-10-06T11:09:42.241033+0000","last_fullsized":"2023-10-06T11:09:42.241033+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:58.206751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"58'3","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.342621+0000","last_change":"2023-10-06T11:09:41.217623+0000","last_active":"2023-10-06T11:09:42.342621+0000","last_peered":"2023-10-06T11:09:42.342621+0000","last_clean":"2023-10-06T11:09:42.342621+0000","last_became_active":"2023-10-06T11:09:41.216779+0000","last_became_peered":"2023-10-06T11:09:41.216779+0000","last_unstale":"2023-10-06T11:09:42.342621+0000","last_undegraded":"2023-10-06T11:09:42.342621+0000","last_fullsized":"2023-10-06T11:09:42.342621+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:12.711537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.258731+0000","last_change":"2023-10-06T11:09:42.257176+0000","last_active":"2023-10-06T11:09:42.258731+0000","last_peered":"2023-10-06T11:09:42.258731+0000","last_clean":"2023-10-06T11:09:42.258731+0000","last_became_active":"2023-10-06T11:09:42.256930+0000","last_became_peered":"2023-10-06T11:09:42.256930+0000","last_unstale":"2023-10-06T11:09:42.258731+0000","last_undegraded":"2023-10-06T11:09:42.258731+0000","last_fullsized":"2023-10-06T11:09:42.258731+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:52:18.608330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"58'6","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.347769+0000","last_change":"2023-10-06T11:09:41.213317+0000","last_active":"2023-10-06T11:09:42.347769+0000","last_peered":"2023-10-06T11:09:42.347769+0000","last_clean":"2023-10-06T11:09:42.347769+0000","last_became_active":"2023-10-06T11:09:41.212888+0000","last_became_peered":"2023-10-06T11:09:41.212888+0000","last_unstale":"2023-10-06T11:09:42.347769+0000","last_undegraded":"2023-10-06T11:09:42.347769+0000","last_fullsized":"2023-10-06T11:09:42.347769+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:14.423152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.238423+0000","last_change":"2023-10-06T11:09:42.235268+0000","last_active":"2023-10-06T11:09:42.238423+0000","last_peered":"2023-10-06T11:09:42.238423+0000","last_clean":"2023-10-06T11:09:42.238423+0000","last_became_active":"2023-10-06T11:09:42.234996+0000","last_became_peered":"2023-10-06T11:09:42.234996+0000","last_unstale":"2023-10-06T11:09:42.238423+0000","last_undegraded":"2023-10-06T11:09:42.238423+0000","last_fullsized":"2023-10-06T11:09:42.238423+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:39:06.623968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"58'2","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.344725+0000","last_change":"2023-10-06T11:09:41.216177+0000","last_active":"2023-10-06T11:09:42.344725+0000","last_peered":"2023-10-06T11:09:42.344725+0000","last_clean":"2023-10-06T11:09:42.344725+0000","last_became_active":"2023-10-06T11:09:41.215915+0000","last_became_peered":"2023-10-06T11:09:41.215915+0000","last_unstale":"2023-10-06T11:09:42.344725+0000","last_undegraded":"2023-10-06T11:09:42.344725+0000","last_fullsized":"2023-10-06T11:09:42.344725+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:05:30.427724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.239145+0000","last_change":"2023-10-06T11:09:42.235415+0000","last_active":"2023-10-06T11:09:42.239145+0000","last_peered":"2023-10-06T11:09:42.239145+0000","last_clean":"2023-10-06T11:09:42.239145+0000","last_became_active":"2023-10-06T11:09:42.235022+0000","last_became_peered":"2023-10-06T11:09:42.235022+0000","last_unstale":"2023-10-06T11:09:42.239145+0000","last_undegraded":"2023-10-06T11:09:42.239145+0000","last_fullsized":"2023-10-06T11:09:42.239145+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:25.857721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.231353+0000","last_change":"2023-10-06T11:09:41.217104+0000","last_active":"2023-10-06T11:09:42.231353+0000","last_peered":"2023-10-06T11:09:42.231353+0000","last_clean":"2023-10-06T11:09:42.231353+0000","last_became_active":"2023-10-06T11:09:41.216693+0000","last_became_peered":"2023-10-06T11:09:41.216693+0000","last_unstale":"2023-10-06T11:09:42.231353+0000","last_undegraded":"2023-10-06T11:09:42.231353+0000","last_fullsized":"2023-10-06T11:09:42.231353+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:30.756704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.240907+0000","last_change":"2023-10-06T11:09:42.230985+0000","last_active":"2023-10-06T11:09:42.240907+0000","last_peered":"2023-10-06T11:09:42.240907+0000","last_clean":"2023-10-06T11:09:42.240907+0000","last_became_active":"2023-10-06T11:09:42.230741+0000","last_became_peered":"2023-10-06T11:09:42.230741+0000","last_unstale":"2023-10-06T11:09:42.240907+0000","last_undegraded":"2023-10-06T11:09:42.240907+0000","last_fullsized":"2023-10-06T11:09:42.240907+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:04:41.583424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.218104+0000","last_change":"2023-10-06T11:09:41.217240+0000","last_active":"2023-10-06T11:09:42.218104+0000","last_peered":"2023-10-06T11:09:42.218104+0000","last_clean":"2023-10-06T11:09:42.218104+0000","last_became_active":"2023-10-06T11:09:41.216980+0000","last_became_peered":"2023-10-06T11:09:41.216980+0000","last_unstale":"2023-10-06T11:09:42.218104+0000","last_undegraded":"2023-10-06T11:09:42.218104+0000","last_fullsized":"2023-10-06T11:09:42.218104+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:07:10.157853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.236821+0000","last_change":"2023-10-06T11:09:42.234850+0000","last_active":"2023-10-06T11:09:42.236821+0000","last_peered":"2023-10-06T11:09:42.236821+0000","last_clean":"2023-10-06T11:09:42.236821+0000","last_became_active":"2023-10-06T11:09:42.234572+0000","last_became_peered":"2023-10-06T11:09:42.234572+0000","last_unstale":"2023-10-06T11:09:42.236821+0000","last_undegraded":"2023-10-06T11:09:42.236821+0000","last_fullsized":"2023-10-06T11:09:42.236821+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:25.857721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"58'8","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.345932+0000","last_change":"2023-10-06T11:09:41.213789+0000","last_active":"2023-10-06T11:09:42.345932+0000","last_peered":"2023-10-06T11:09:42.345932+0000","last_clean":"2023-10-06T11:09:42.345932+0000","last_became_active":"2023-10-06T11:09:41.213505+0000","last_became_peered":"2023-10-06T11:09:41.213505+0000","last_unstale":"2023-10-06T11:09:42.345932+0000","last_undegraded":"2023-10-06T11:09:42.345932+0000","last_fullsized":"2023-10-06T11:09:42.345932+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:14.423152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.236925+0000","last_change":"2023-10-06T11:09:42.232334+0000","last_active":"2023-10-06T11:09:42.236925+0000","last_peered":"2023-10-06T11:09:42.236925+0000","last_clean":"2023-10-06T11:09:42.236925+0000","last_became_active":"2023-10-06T11:09:42.232077+0000","last_became_peered":"2023-10-06T11:09:42.232077+0000","last_unstale":"2023-10-06T11:09:42.236925+0000","last_undegraded":"2023-10-06T11:09:42.236925+0000","last_fullsized":"2023-10-06T11:09:42.236925+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:00:29.071879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"58'2","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.343400+0000","last_change":"2023-10-06T11:09:41.213087+0000","last_active":"2023-10-06T11:09:42.343400+0000","last_peered":"2023-10-06T11:09:42.343400+0000","last_clean":"2023-10-06T11:09:42.343400+0000","last_became_active":"2023-10-06T11:09:41.212812+0000","last_became_peered":"2023-10-06T11:09:41.212812+0000","last_unstale":"2023-10-06T11:09:42.343400+0000","last_undegraded":"2023-10-06T11:09:42.343400+0000","last_fullsized":"2023-10-06T11:09:42.343400+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:14.423152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.227689+0000","last_change":"2023-10-06T11:09:42.225271+0000","last_active":"2023-10-06T11:09:42.227689+0000","last_peered":"2023-10-06T11:09:42.227689+0000","last_clean":"2023-10-06T11:09:42.227689+0000","last_became_active":"2023-10-06T11:09:42.225049+0000","last_became_peered":"2023-10-06T11:09:42.225049+0000","last_unstale":"2023-10-06T11:09:42.227689+0000","last_undegraded":"2023-10-06T11:09:42.227689+0000","last_fullsized":"2023-10-06T11:09:42.227689+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:51:25.725356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"59'1","reported_seq":11,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-06T11:09:43.221169+0000","last_change":"2023-10-06T11:09:41.211660+0000","last_active":"2023-10-06T11:09:43.221169+0000","last_peered":"2023-10-06T11:09:43.221169+0000","last_clean":"2023-10-06T11:09:43.221169+0000","last_became_active":"2023-10-06T11:09:41.209522+0000","last_became_peered":"2023-10-06T11:09:41.209522+0000","last_unstale":"2023-10-06T11:09:43.221169+0000","last_undegraded":"2023-10-06T11:09:43.221169+0000","last_fullsized":"2023-10-06T11:09:43.221169+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:29.500970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.238282+0000","last_change":"2023-10-06T11:09:42.235095+0000","last_active":"2023-10-06T11:09:42.238282+0000","last_peered":"2023-10-06T11:09:42.238282+0000","last_clean":"2023-10-06T11:09:42.238282+0000","last_became_active":"2023-10-06T11:09:42.234870+0000","last_became_peered":"2023-10-06T11:09:42.234870+0000","last_unstale":"2023-10-06T11:09:42.238282+0000","last_undegraded":"2023-10-06T11:09:42.238282+0000","last_fullsized":"2023-10-06T11:09:42.238282+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:10:47.746855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.224304+0000","last_change":"2023-10-06T11:09:41.212942+0000","last_active":"2023-10-06T11:09:42.224304+0000","last_peered":"2023-10-06T11:09:42.224304+0000","last_clean":"2023-10-06T11:09:42.224304+0000","last_became_active":"2023-10-06T11:09:41.212251+0000","last_became_peered":"2023-10-06T11:09:41.212251+0000","last_unstale":"2023-10-06T11:09:42.224304+0000","last_undegraded":"2023-10-06T11:09:42.224304+0000","last_fullsized":"2023-10-06T11:09:42.224304+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:26:14.895309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.258924+0000","last_change":"2023-10-06T11:09:42.257270+0000","last_active":"2023-10-06T11:09:42.258924+0000","last_peered":"2023-10-06T11:09:42.258924+0000","last_clean":"2023-10-06T11:09:42.258924+0000","last_became_active":"2023-10-06T11:09:42.256903+0000","last_became_peered":"2023-10-06T11:09:42.256903+0000","last_unstale":"2023-10-06T11:09:42.258924+0000","last_undegraded":"2023-10-06T11:09:42.258924+0000","last_fullsized":"2023-10-06T11:09:42.258924+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:43:30.505629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.226537+0000","last_change":"2023-10-06T11:09:41.213157+0000","last_active":"2023-10-06T11:09:42.226537+0000","last_peered":"2023-10-06T11:09:42.226537+0000","last_clean":"2023-10-06T11:09:42.226537+0000","last_became_active":"2023-10-06T11:09:41.212578+0000","last_became_peered":"2023-10-06T11:09:41.212578+0000","last_unstale":"2023-10-06T11:09:42.226537+0000","last_undegraded":"2023-10-06T11:09:42.226537+0000","last_fullsized":"2023-10-06T11:09:42.226537+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:55:58.933120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.241059+0000","last_change":"2023-10-06T11:09:42.232043+0000","last_active":"2023-10-06T11:09:42.241059+0000","last_peered":"2023-10-06T11:09:42.241059+0000","last_clean":"2023-10-06T11:09:42.241059+0000","last_became_active":"2023-10-06T11:09:42.231775+0000","last_became_peered":"2023-10-06T11:09:42.231775+0000","last_unstale":"2023-10-06T11:09:42.241059+0000","last_undegraded":"2023-10-06T11:09:42.241059+0000","last_fullsized":"2023-10-06T11:09:42.241059+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:05:12.404425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.220015+0000","last_change":"2023-10-06T11:09:41.218001+0000","last_active":"2023-10-06T11:09:42.220015+0000","last_peered":"2023-10-06T11:09:42.220015+0000","last_clean":"2023-10-06T11:09:42.220015+0000","last_became_active":"2023-10-06T11:09:41.217073+0000","last_became_peered":"2023-10-06T11:09:41.217073+0000","last_unstale":"2023-10-06T11:09:42.220015+0000","last_undegraded":"2023-10-06T11:09:42.220015+0000","last_fullsized":"2023-10-06T11:09:42.220015+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:29:32.567167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.240893+0000","last_change":"2023-10-06T11:09:42.236348+0000","last_active":"2023-10-06T11:09:42.240893+0000","last_peered":"2023-10-06T11:09:42.240893+0000","last_clean":"2023-10-06T11:09:42.240893+0000","last_became_active":"2023-10-06T11:09:42.236035+0000","last_became_peered":"2023-10-06T11:09:42.236035+0000","last_unstale":"2023-10-06T11:09:42.240893+0000","last_undegraded":"2023-10-06T11:09:42.240893+0000","last_fullsized":"2023-10-06T11:09:42.240893+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:37:07.428678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.222013+0000","last_change":"2023-10-06T11:09:41.211301+0000","last_active":"2023-10-06T11:09:42.222013+0000","last_peered":"2023-10-06T11:09:42.222013+0000","last_clean":"2023-10-06T11:09:42.222013+0000","last_became_active":"2023-10-06T11:09:41.211014+0000","last_became_peered":"2023-10-06T11:09:41.211014+0000","last_unstale":"2023-10-06T11:09:42.222013+0000","last_undegraded":"2023-10-06T11:09:42.222013+0000","last_fullsized":"2023-10-06T11:09:42.222013+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:51:52.446155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.236448+0000","last_change":"2023-10-06T11:09:42.230829+0000","last_active":"2023-10-06T11:09:42.236448+0000","last_peered":"2023-10-06T11:09:42.236448+0000","last_clean":"2023-10-06T11:09:42.236448+0000","last_became_active":"2023-10-06T11:09:42.230511+0000","last_became_peered":"2023-10-06T11:09:42.230511+0000","last_unstale":"2023-10-06T11:09:42.236448+0000","last_undegraded":"2023-10-06T11:09:42.236448+0000","last_fullsized":"2023-10-06T11:09:42.236448+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:52:18.608330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.221814+0000","last_change":"2023-10-06T11:09:41.218854+0000","last_active":"2023-10-06T11:09:42.221814+0000","last_peered":"2023-10-06T11:09:42.221814+0000","last_clean":"2023-10-06T11:09:42.221814+0000","last_became_active":"2023-10-06T11:09:41.218572+0000","last_became_peered":"2023-10-06T11:09:41.218572+0000","last_unstale":"2023-10-06T11:09:42.221814+0000","last_undegraded":"2023-10-06T11:09:42.221814+0000","last_fullsized":"2023-10-06T11:09:42.221814+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:06:06.843348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.234800+0000","last_change":"2023-10-06T11:09:42.229708+0000","last_active":"2023-10-06T11:09:42.234800+0000","last_peered":"2023-10-06T11:09:42.234800+0000","last_clean":"2023-10-06T11:09:42.234800+0000","last_became_active":"2023-10-06T11:09:42.229446+0000","last_became_peered":"2023-10-06T11:09:42.229446+0000","last_unstale":"2023-10-06T11:09:42.234800+0000","last_undegraded":"2023-10-06T11:09:42.234800+0000","last_fullsized":"2023-10-06T11:09:42.234800+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:33:05.628031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.226164+0000","last_change":"2023-10-06T11:09:41.214668+0000","last_active":"2023-10-06T11:09:42.226164+0000","last_peered":"2023-10-06T11:09:42.226164+0000","last_clean":"2023-10-06T11:09:42.226164+0000","last_became_active":"2023-10-06T11:09:41.214427+0000","last_became_peered":"2023-10-06T11:09:41.214427+0000","last_unstale":"2023-10-06T11:09:42.226164+0000","last_undegraded":"2023-10-06T11:09:42.226164+0000","last_fullsized":"2023-10-06T11:09:42.226164+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:08:49.990834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.232712+0000","last_change":"2023-10-06T11:09:42.228930+0000","last_active":"2023-10-06T11:09:42.232712+0000","last_peered":"2023-10-06T11:09:42.232712+0000","last_clean":"2023-10-06T11:09:42.232712+0000","last_became_active":"2023-10-06T11:09:42.228558+0000","last_became_peered":"2023-10-06T11:09:42.228558+0000","last_unstale":"2023-10-06T11:09:42.232712+0000","last_undegraded":"2023-10-06T11:09:42.232712+0000","last_fullsized":"2023-10-06T11:09:42.232712+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:07:13.716196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"58'1","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.342602+0000","last_change":"2023-10-06T11:09:41.218292+0000","last_active":"2023-10-06T11:09:42.342602+0000","last_peered":"2023-10-06T11:09:42.342602+0000","last_clean":"2023-10-06T11:09:42.342602+0000","last_became_active":"2023-10-06T11:09:41.217963+0000","last_became_peered":"2023-10-06T11:09:41.217963+0000","last_unstale":"2023-10-06T11:09:42.342602+0000","last_undegraded":"2023-10-06T11:09:42.342602+0000","last_fullsized":"2023-10-06T11:09:42.342602+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:52.890087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":48,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.228929+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:09:42.228929+0000","last_peered":"2023-10-06T11:09:42.228929+0000","last_clean":"2023-10-06T11:09:42.228929+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:09:42.228929+0000","last_undegraded":"2023-10-06T11:09:42.228929+0000","last_fullsized":"2023-10-06T11:09:42.228929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.258944+0000","last_change":"2023-10-06T11:09:42.257731+0000","last_active":"2023-10-06T11:09:42.258944+0000","last_peered":"2023-10-06T11:09:42.258944+0000","last_clean":"2023-10-06T11:09:42.258944+0000","last_became_active":"2023-10-06T11:09:42.257516+0000","last_became_peered":"2023-10-06T11:09:42.257516+0000","last_unstale":"2023-10-06T11:09:42.258944+0000","last_undegraded":"2023-10-06T11:09:42.258944+0000","last_fullsized":"2023-10-06T11:09:42.258944+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:31.761363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.222148+0000","last_change":"2023-10-06T11:09:41.213322+0000","last_active":"2023-10-06T11:09:42.222148+0000","last_peered":"2023-10-06T11:09:42.222148+0000","last_clean":"2023-10-06T11:09:42.222148+0000","last_became_active":"2023-10-06T11:09:41.213046+0000","last_became_peered":"2023-10-06T11:09:41.213046+0000","last_unstale":"2023-10-06T11:09:42.222148+0000","last_undegraded":"2023-10-06T11:09:42.222148+0000","last_fullsized":"2023-10-06T11:09:42.222148+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:27.750667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":48,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.222224+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:09:42.222224+0000","last_peered":"2023-10-06T11:09:42.222224+0000","last_clean":"2023-10-06T11:09:42.222224+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:09:42.222224+0000","last_undegraded":"2023-10-06T11:09:42.222224+0000","last_fullsized":"2023-10-06T11:09:42.222224+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.234657+0000","last_change":"2023-10-06T11:09:42.228444+0000","last_active":"2023-10-06T11:09:42.234657+0000","last_peered":"2023-10-06T11:09:42.234657+0000","last_clean":"2023-10-06T11:09:42.234657+0000","last_became_active":"2023-10-06T11:09:42.228189+0000","last_became_peered":"2023-10-06T11:09:42.228189+0000","last_unstale":"2023-10-06T11:09:42.234657+0000","last_undegraded":"2023-10-06T11:09:42.234657+0000","last_fullsized":"2023-10-06T11:09:42.234657+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:16:33.287742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"58'2","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.344680+0000","last_change":"2023-10-06T11:09:41.215573+0000","last_active":"2023-10-06T11:09:42.344680+0000","last_peered":"2023-10-06T11:09:42.344680+0000","last_clean":"2023-10-06T11:09:42.344680+0000","last_became_active":"2023-10-06T11:09:41.215351+0000","last_became_peered":"2023-10-06T11:09:41.215351+0000","last_unstale":"2023-10-06T11:09:42.344680+0000","last_undegraded":"2023-10-06T11:09:42.344680+0000","last_fullsized":"2023-10-06T11:09:42.344680+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:53:09.457192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":45,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.227235+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:09:42.227235+0000","last_peered":"2023-10-06T11:09:42.227235+0000","last_clean":"2023-10-06T11:09:42.227235+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:09:42.227235+0000","last_undegraded":"2023-10-06T11:09:42.227235+0000","last_fullsized":"2023-10-06T11:09:42.227235+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":193,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.220446+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:09:42.220446+0000","last_peered":"2023-10-06T11:09:42.220446+0000","last_clean":"2023-10-06T11:09:42.220446+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:09:42.220446+0000","last_undegraded":"2023-10-06T11:09:42.220446+0000","last_fullsized":"2023-10-06T11:09:42.220446+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.233181+0000","last_change":"2023-10-06T11:09:42.229398+0000","last_active":"2023-10-06T11:09:42.233181+0000","last_peered":"2023-10-06T11:09:42.233181+0000","last_clean":"2023-10-06T11:09:42.233181+0000","last_became_active":"2023-10-06T11:09:42.229067+0000","last_became_peered":"2023-10-06T11:09:42.229067+0000","last_unstale":"2023-10-06T11:09:42.233181+0000","last_undegraded":"2023-10-06T11:09:42.233181+0000","last_fullsized":"2023-10-06T11:09:42.233181+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:07:11.162512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.231947+0000","last_change":"2023-10-06T11:09:41.216944+0000","last_active":"2023-10-06T11:09:42.231947+0000","last_peered":"2023-10-06T11:09:42.231947+0000","last_clean":"2023-10-06T11:09:42.231947+0000","last_became_active":"2023-10-06T11:09:41.216394+0000","last_became_peered":"2023-10-06T11:09:41.216394+0000","last_unstale":"2023-10-06T11:09:42.231947+0000","last_undegraded":"2023-10-06T11:09:42.231947+0000","last_fullsized":"2023-10-06T11:09:42.231947+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:57.202092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":43,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.218488+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:09:42.218488+0000","last_peered":"2023-10-06T11:09:42.218488+0000","last_clean":"2023-10-06T11:09:42.218488+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:09:42.218488+0000","last_undegraded":"2023-10-06T11:09:42.218488+0000","last_fullsized":"2023-10-06T11:09:42.218488+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.238721+0000","last_change":"2023-10-06T11:09:42.228539+0000","last_active":"2023-10-06T11:09:42.238721+0000","last_peered":"2023-10-06T11:09:42.238721+0000","last_clean":"2023-10-06T11:09:42.238721+0000","last_became_active":"2023-10-06T11:09:42.228200+0000","last_became_peered":"2023-10-06T11:09:42.228200+0000","last_unstale":"2023-10-06T11:09:42.238721+0000","last_undegraded":"2023-10-06T11:09:42.238721+0000","last_fullsized":"2023-10-06T11:09:42.238721+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:47:49.153165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.221497+0000","last_change":"2023-10-06T11:09:41.219234+0000","last_active":"2023-10-06T11:09:42.221497+0000","last_peered":"2023-10-06T11:09:42.221497+0000","last_clean":"2023-10-06T11:09:42.221497+0000","last_became_active":"2023-10-06T11:09:41.218988+0000","last_became_peered":"2023-10-06T11:09:41.218988+0000","last_unstale":"2023-10-06T11:09:42.221497+0000","last_undegraded":"2023-10-06T11:09:42.221497+0000","last_fullsized":"2023-10-06T11:09:42.221497+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:06:17.950887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":43,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.220549+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:09:42.220549+0000","last_peered":"2023-10-06T11:09:42.220549+0000","last_clean":"2023-10-06T11:09:42.220549+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:09:42.220549+0000","last_undegraded":"2023-10-06T11:09:42.220549+0000","last_fullsized":"2023-10-06T11:09:42.220549+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.227363+0000","last_change":"2023-10-06T11:09:42.226066+0000","last_active":"2023-10-06T11:09:42.227363+0000","last_peered":"2023-10-06T11:09:42.227363+0000","last_clean":"2023-10-06T11:09:42.227363+0000","last_became_active":"2023-10-06T11:09:42.225791+0000","last_became_peered":"2023-10-06T11:09:42.225791+0000","last_unstale":"2023-10-06T11:09:42.227363+0000","last_undegraded":"2023-10-06T11:09:42.227363+0000","last_fullsized":"2023-10-06T11:09:42.227363+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:08:50.995493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.223496+0000","last_change":"2023-10-06T11:09:41.214421+0000","last_active":"2023-10-06T11:09:42.223496+0000","last_peered":"2023-10-06T11:09:42.223496+0000","last_clean":"2023-10-06T11:09:42.223496+0000","last_became_active":"2023-10-06T11:09:41.214113+0000","last_became_peered":"2023-10-06T11:09:41.214113+0000","last_unstale":"2023-10-06T11:09:42.223496+0000","last_undegraded":"2023-10-06T11:09:42.223496+0000","last_fullsized":"2023-10-06T11:09:42.223496+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:22:00.022841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":51,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.225391+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:09:42.225391+0000","last_peered":"2023-10-06T11:09:42.225391+0000","last_clean":"2023-10-06T11:09:42.225391+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:09:42.225391+0000","last_undegraded":"2023-10-06T11:09:42.225391+0000","last_fullsized":"2023-10-06T11:09:42.225391+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.241113+0000","last_change":"2023-10-06T11:09:42.234133+0000","last_active":"2023-10-06T11:09:42.241113+0000","last_peered":"2023-10-06T11:09:42.241113+0000","last_clean":"2023-10-06T11:09:42.241113+0000","last_became_active":"2023-10-06T11:09:42.233860+0000","last_became_peered":"2023-10-06T11:09:42.233860+0000","last_unstale":"2023-10-06T11:09:42.241113+0000","last_undegraded":"2023-10-06T11:09:42.241113+0000","last_fullsized":"2023-10-06T11:09:42.241113+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:55:59.937779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"58'2","reported_seq":12,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.345008+0000","last_change":"2023-10-06T11:09:41.215052+0000","last_active":"2023-10-06T11:09:42.345008+0000","last_peered":"2023-10-06T11:09:42.345008+0000","last_clean":"2023-10-06T11:09:42.345008+0000","last_became_active":"2023-10-06T11:09:41.214778+0000","last_became_peered":"2023-10-06T11:09:41.214778+0000","last_unstale":"2023-10-06T11:09:42.345008+0000","last_undegraded":"2023-10-06T11:09:42.345008+0000","last_fullsized":"2023-10-06T11:09:42.345008+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:24.853062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":47,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.221484+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:09:42.221484+0000","last_peered":"2023-10-06T11:09:42.221484+0000","last_clean":"2023-10-06T11:09:42.221484+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:09:42.221484+0000","last_undegraded":"2023-10-06T11:09:42.221484+0000","last_fullsized":"2023-10-06T11:09:42.221484+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":9,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.236061+0000","last_change":"2023-10-06T11:09:42.233367+0000","last_active":"2023-10-06T11:09:42.236061+0000","last_peered":"2023-10-06T11:09:42.236061+0000","last_clean":"2023-10-06T11:09:42.236061+0000","last_became_active":"2023-10-06T11:09:42.233105+0000","last_became_peered":"2023-10-06T11:09:42.233105+0000","last_unstale":"2023-10-06T11:09:42.236061+0000","last_undegraded":"2023-10-06T11:09:42.236061+0000","last_fullsized":"2023-10-06T11:09:42.236061+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:41.195713+0000","last_clean_scrub_stamp":"2023-10-06T11:09:41.195713+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:28:02.987423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"58'1","reported_seq":11,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.342255+0000","last_change":"2023-10-06T11:09:41.218783+0000","last_active":"2023-10-06T11:09:42.342255+0000","last_peered":"2023-10-06T11:09:42.342255+0000","last_clean":"2023-10-06T11:09:42.342255+0000","last_became_active":"2023-10-06T11:09:41.216107+0000","last_became_peered":"2023-10-06T11:09:41.216107+0000","last_unstale":"2023-10-06T11:09:42.342255+0000","last_undegraded":"2023-10-06T11:09:42.342255+0000","last_fullsized":"2023-10-06T11:09:42.342255+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:09:40.191055+0000","last_clean_scrub_stamp":"2023-10-06T11:09:40.191055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:58.952774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":47,"reported_epoch":58,"state":"active+clean","last_fresh":"2023-10-06T11:09:42.221411+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:09:42.221411+0000","last_peered":"2023-10-06T11:09:42.221411+0000","last_clean":"2023-10-06T11:09:42.221411+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:09:42.221411+0000","last_undegraded":"2023-10-06T11:09:42.221411+0000","last_fullsized":"2023-10-06T11:09:42.221411+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":9,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574901,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298576,"kb_used_data":1288,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073264,"statfs":{"total":96636764160,"available":96331022336,"internally_reserved":0,"allocated":1318912,"data_stored":903382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":1.871,"5min":0.73999999999999999,"15min":0.56999999999999995},"min":{"1min":0.41199999999999998,"5min":0.248,"15min":0.248},"max":{"1min":23.908999999999999,"5min":23.908999999999999,"15min":23.908999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":1.127,"5min":0.629,"15min":0.56499999999999995},"min":{"1min":0.374,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":9.0600000000000005,"5min":9.0600000000000005,"15min":9.0600000000000005},"last":0.64200000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":0.63900000000000001,"15min":0.57099999999999995},"min":{"1min":0.40899999999999997,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":9.2360000000000007,"5min":9.2360000000000007,"15min":9.2360000000000007},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.53900000000000003,"15min":0.51600000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":4.327,"5min":4.327,"15min":4.327},"last":0.436}]},{"osd":2,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.504,"15min":0.50900000000000001},"min":{"1min":0.311,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.59599999999999997,"15min":0.55800000000000005},"min":{"1min":0.436,"5min":0.309,"15min":0.309},"max":{"1min":4.7309999999999999,"5min":4.7309999999999999,"15min":4.7309999999999999},"last":0.56599999999999995}]},{"osd":3,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.55400000000000005,"15min":0.51400000000000001},"min":{"1min":0.35299999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":4.3540000000000001,"5min":4.3540000000000001,"15min":4.3540000000000001},"last":0.626},{"interface":"front","average":{"1min":1.1870000000000001,"5min":0.67300000000000004,"15min":0.59999999999999998},"min":{"1min":0.45300000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":9.3879999999999999,"5min":9.3879999999999999,"15min":9.3879999999999999},"last":0.46200000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.50800000000000001,"15min":0.47499999999999998},"min":{"1min":0.34100000000000003,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":4.5709999999999997,"5min":4.5709999999999997,"15min":4.5709999999999997},"last":0.5},{"interface":"front","average":{"1min":0.753,"5min":0.55800000000000005,"15min":0.53500000000000003},"min":{"1min":0.33100000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":4.3129999999999997,"5min":4.3129999999999997,"15min":4.3129999999999997},"last":0.41199999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":0.64100000000000001,"15min":0.58099999999999996},"min":{"1min":0.34200000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":9.3499999999999996,"5min":9.3499999999999996,"15min":9.3499999999999996},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.58299999999999996,"15min":0.56699999999999995},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":4.444,"5min":4.444,"15min":4.444},"last":0.55400000000000005}]},{"osd":6,"last update":"Fri Oct 6 11:08:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":0.67300000000000004,"15min":0.622},"min":{"1min":0.39700000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":9.4969999999999999,"5min":9.4969999999999999,"15min":9.4969999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.66200000000000003,"15min":0.62},"min":{"1min":0.44800000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":7.2039999999999997,"5min":7.2039999999999997,"15min":7.2039999999999997},"last":0.52400000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574903,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310268,"kb_used_data":692,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061572,"statfs":{"total":96636764160,"available":96319049728,"internally_reserved":0,"allocated":708608,"data_stored":310947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:42 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48199999999999998,"15min":0.497},"min":{"1min":0.23799999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.64300000000000002,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.377},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51500000000000001,"15min":0.53100000000000003},"min":{"1min":0.35899999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.63,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.40100000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:09:42 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.47899999999999998,"15min":0.498},"min":{"1min":0.26400000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.629,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.47499999999999998,"15min":0.496},"min":{"1min":0.379,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.55400000000000005,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.53400000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:09:42 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.53300000000000003,"15min":0.499},"min":{"1min":0.31900000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.65800000000000003,"5min":7.0659999999999998,"15min":7.0659999999999998},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.55700000000000005,"15min":0.52700000000000002},"min":{"1min":0.29899999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.75800000000000001,"5min":7.0819999999999999,"15min":7.0819999999999999},"last":0.55500000000000005}]},{"osd":3,"last update":"Fri Oct 6 11:09:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.504,"15min":0.496},"min":{"1min":0.436,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.65500000000000003,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53100000000000003,"15min":0.53700000000000003},"min":{"1min":0.40000000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.72399999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.57599999999999996}]},{"osd":4,"last update":"Fri Oct 6 11:09:42 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.47599999999999998,"15min":0.503},"min":{"1min":0.30399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.52400000000000002,"15min":0.56200000000000006},"min":{"1min":0.33100000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69399999999999995,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.63900000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:09:42 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51300000000000001,"15min":0.53500000000000003},"min":{"1min":0.313,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.69299999999999995,"5min":0.75,"15min":0.75},"last":0.629},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54800000000000004,"15min":0.58199999999999996},"min":{"1min":0.34499999999999997,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78800000000000003,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.65300000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:09:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55600000000000005,"15min":0.57499999999999996},"min":{"1min":0.377,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71699999999999997,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58299999999999996,"15min":0.60499999999999998},"min":{"1min":0.36699999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.754,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.67300000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574902,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310876,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060964,"statfs":{"total":96636764160,"available":96318427136,"internally_reserved":0,"allocated":1331200,"data_stored":904906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.33200000000000002,"15min":0.34200000000000003},"min":{"1min":0.24199999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.215,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.378}]},{"osd":2,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.34399999999999997,"15min":0.33600000000000002},"min":{"1min":0.23599999999999999,"5min":0.22,"15min":0.22},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.432,"5min":0.39600000000000002,"15min":0.38900000000000001},"min":{"1min":0.26500000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.39600000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.41399999999999998,"15min":0.41099999999999998},"min":{"1min":0.28299999999999997,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.68999999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.38100000000000001,"15min":0.36899999999999999},"min":{"1min":0.29799999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.32100000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.53000000000000003,"15min":0.50800000000000001},"min":{"1min":0.34399999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.435},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55800000000000005,"15min":0.54000000000000004},"min":{"1min":0.45300000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.5}]},{"osd":5,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55900000000000005,"15min":0.54900000000000004},"min":{"1min":0.38800000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.56299999999999994,"15min":0.54100000000000004},"min":{"1min":0.40000000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.68899999999999995}]},{"osd":6,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57199999999999995,"15min":0.56200000000000006},"min":{"1min":0.36899999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.59199999999999997,"15min":0.57399999999999995},"min":{"1min":0.376,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.64000000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.59999999999999998,"15min":0.58999999999999997},"min":{"1min":0.48699999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84299999999999997,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.42899999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.61899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302072,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069768,"statfs":{"total":96636764160,"available":96327442432,"internally_reserved":0,"allocated":704512,"data_stored":310913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":1.9379999999999999,"5min":0.64700000000000002,"15min":0.44},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":36.097999999999999,"5min":36.097999999999999,"15min":36.097999999999999},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.35999999999999999,"15min":0.34699999999999998},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.33000000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":1.9810000000000001,"5min":0.69099999999999995,"15min":0.48299999999999998},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":36.07,"5min":36.07,"15min":36.07},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.40000000000000002,"15min":0.379},"min":{"1min":0.23200000000000001,"5min":0.219,"15min":0.219},"max":{"1min":5.125,"5min":5.125,"15min":5.125},"last":0.375}]},{"osd":3,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.44,"15min":0.39600000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":8.4130000000000003,"5min":8.4130000000000003,"15min":8.4130000000000003},"last":0.35899999999999999},{"interface":"front","average":{"1min":2.0030000000000001,"5min":0.74399999999999999,"15min":0.54200000000000004},"min":{"1min":0.30199999999999999,"5min":0.252,"15min":0.252},"max":{"1min":35.959000000000003,"5min":35.959000000000003,"15min":35.959000000000003},"last":0.41399999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.56799999999999995,"15min":0.56299999999999994},"min":{"1min":0.48199999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.497},{"interface":"front","average":{"1min":2.2120000000000002,"5min":0.92700000000000005,"15min":0.72099999999999997},"min":{"1min":0.48999999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":36.005000000000003,"5min":36.005000000000003,"15min":36.005000000000003},"last":0.52000000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.55700000000000005,"15min":0.55400000000000005},"min":{"1min":0.433,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56299999999999994,"15min":0.54900000000000004},"min":{"1min":0.45700000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.59899999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":2.194,"5min":0.91900000000000004,"15min":0.71699999999999997},"min":{"1min":0.47199999999999998,"5min":0.375,"15min":0.375},"max":{"1min":36.037999999999997,"5min":36.037999999999997,"15min":36.037999999999997},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.63900000000000001,"15min":0.61699999999999999},"min":{"1min":0.434,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":4.8810000000000002,"5min":4.8810000000000002,"15min":4.8810000000000002},"last":0.64400000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60599999999999998,"15min":0.60799999999999998},"min":{"1min":0.41499999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":2.3530000000000002,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.626,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.44500000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.65500000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574902,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310264,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061576,"statfs":{"total":96636764160,"available":96319053824,"internally_reserved":0,"allocated":704512,"data_stored":310913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.32400000000000001,"5min":0.309,"15min":0.309},"min":{"1min":0.22500000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.437,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.218},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.38100000000000001,"15min":0.38500000000000001},"min":{"1min":0.26900000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.51400000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.33000000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36899999999999999,"15min":0.375},"min":{"1min":0.24399999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.254},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.35399999999999998,"15min":0.34799999999999998},"min":{"1min":0.26900000000000002,"5min":0.217,"15min":0.217},"max":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"last":0.34399999999999997}]},{"osd":3,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.37,"15min":0.373},"min":{"1min":0.27800000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.373,"5min":0.36499999999999999,"15min":0.36699999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.31}]},{"osd":4,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.33900000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.38900000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.52800000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.55200000000000005,"15min":0.55000000000000004},"min":{"1min":0.374,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.41799999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.64300000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58299999999999996,"15min":0.58399999999999996},"min":{"1min":0.43099999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.41399999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.627}]},{"osd":7,"last update":"Fri Oct 6 11:08:42 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.55900000000000005,"15min":0.55000000000000004},"min":{"1min":0.436,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.57099999999999995,"15min":0.56999999999999995},"min":{"1min":0.38600000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.61599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574902,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297976,"kb_used_data":688,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073864,"statfs":{"total":96636764160,"available":96331636736,"internally_reserved":0,"allocated":704512,"data_stored":310913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.313,"15min":0.32700000000000001},"min":{"1min":0.218,"5min":0.188,"15min":0.188},"max":{"1min":0.47099999999999997,"5min":1.095,"15min":1.095},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.38,"15min":0.40200000000000002},"min":{"1min":0.30399999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.52400000000000002,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.31}]},{"osd":1,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.313,"15min":0.309},"min":{"1min":0.23200000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.46899999999999997,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.35999999999999999,"15min":0.37},"min":{"1min":0.25900000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.48599999999999999,"5min":1.196,"15min":1.196},"last":0.33100000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.374,"15min":0.39200000000000002},"min":{"1min":0.26500000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.54000000000000004,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.40799999999999997,"15min":0.42199999999999999},"min":{"1min":0.32700000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.55900000000000005,"5min":1.224,"15min":1.224},"last":0.36499999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.55400000000000005,"15min":0.57399999999999995},"min":{"1min":0.41699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69399999999999995,"5min":1.694,"15min":1.694},"last":0.628},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.54600000000000004,"15min":0.54800000000000004},"min":{"1min":0.46400000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.58699999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.54600000000000004,"15min":0.52800000000000002},"min":{"1min":0.436,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79400000000000004,"5min":0.878,"15min":0.878},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55900000000000005,"15min":0.56699999999999995},"min":{"1min":0.49399999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72699999999999998,"5min":1.165,"15min":1.165},"last":0.68700000000000006}]},{"osd":6,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58699999999999997,"15min":0.59499999999999997},"min":{"1min":0.46200000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.81299999999999994,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.59599999999999997,"15min":0.60599999999999998},"min":{"1min":0.47099999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78000000000000003,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.70599999999999996}]},{"osd":7,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58199999999999996,"15min":0.59599999999999997},"min":{"1min":0.44800000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.74199999999999999,"5min":1.657,"15min":1.657},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.47899999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83399999999999996,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.61799999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574901,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297992,"kb_used_data":704,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073848,"statfs":{"total":96636764160,"available":96331620352,"internally_reserved":0,"allocated":720896,"data_stored":313802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.51800000000000002,"15min":0.59299999999999997},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.76600000000000001,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.49199999999999999,"15min":0.502},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.436}]},{"osd":1,"last update":"Fri Oct 6 11:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.54400000000000004,"15min":0.61799999999999999},"min":{"1min":0.35999999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70899999999999996,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55300000000000005,"15min":0.621},"min":{"1min":0.33400000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.72399999999999998,"5min":2.7610000000000001,"15min":2.7610000000000001},"last":0.58899999999999997}]},{"osd":2,"last update":"Fri Oct 6 11:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.57699999999999996},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.78200000000000003,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58599999999999997,"15min":0.61799999999999999},"min":{"1min":0.45400000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.77400000000000002,"5min":1.718,"15min":1.718},"last":0.56899999999999995}]},{"osd":3,"last update":"Fri Oct 6 11:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.57799999999999996,"15min":0.64000000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.753,"5min":2.677,"15min":2.677},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.51600000000000001,"15min":0.52600000000000002},"min":{"1min":0.36799999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.747,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.47599999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.47099999999999997,"15min":0.497},"min":{"1min":0.33900000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.77600000000000002,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.629},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.52500000000000002,"15min":0.54700000000000004},"min":{"1min":0.35099999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.60699999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.51000000000000001,"15min":0.53400000000000003},"min":{"1min":0.34599999999999997,"5min":0.252,"15min":0.252},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54900000000000004,"15min":0.59099999999999997},"min":{"1min":0.40699999999999997,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.82099999999999995,"5min":1.165,"15min":1.165},"last":0.67100000000000004}]},{"osd":7,"last update":"Fri Oct 6 11:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.55200000000000005,"15min":0.56200000000000006},"min":{"1min":0.378,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.59099999999999997,"15min":0.61599999999999999},"min":{"1min":0.437,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80800000000000005,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.64200000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574903,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310272,"kb_used_data":696,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061568,"statfs":{"total":96636764160,"available":96319045632,"internally_reserved":0,"allocated":712704,"data_stored":312288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.61799999999999999,"15min":0.70799999999999996},"min":{"1min":0.28399999999999997,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.69499999999999995,"5min":5.0490000000000004,"15min":5.0490000000000004},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.57599999999999996,"15min":0.67600000000000005},"min":{"1min":0.28100000000000003,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.64700000000000002,"5min":5.1449999999999996,"15min":5.1449999999999996},"last":0.41599999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48499999999999999,"15min":0.49099999999999999},"min":{"1min":0.27500000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.75600000000000001,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.438},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52100000000000002,"15min":0.52900000000000003},"min":{"1min":0.30299999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.70999999999999996,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.52300000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57899999999999996,"15min":0.56699999999999995},"min":{"1min":0.41299999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.74099999999999999,"5min":4.234,"15min":4.234},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56699999999999995,"15min":0.57699999999999996},"min":{"1min":0.40000000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72999999999999998,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.55000000000000004}]},{"osd":3,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.61499999999999999,"15min":0.72699999999999998},"min":{"1min":0.32600000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.72099999999999997,"5min":5.2169999999999996,"15min":5.2169999999999996},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54900000000000004,"15min":0.55500000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.70199999999999996,"5min":1.008,"15min":1.008},"last":0.57699999999999996}]},{"osd":4,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52200000000000002,"15min":0.53600000000000003},"min":{"1min":0.32700000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.745,"5min":1.917,"15min":1.917},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53700000000000003,"15min":0.55500000000000005},"min":{"1min":0.34399999999999997,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.68600000000000005,"5min":0.87,"15min":0.87},"last":0.46500000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56999999999999995,"15min":0.58099999999999996},"min":{"1min":0.34100000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.68700000000000006,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":0.496},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.61399999999999999,"15min":0.629},"min":{"1min":0.42199999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.77200000000000002,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":0.48599999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58399999999999996,"15min":0.60699999999999998},"min":{"1min":0.39600000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.70199999999999996,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61499999999999999,"15min":0.628},"min":{"1min":0.38700000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.72999999999999998,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.61099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:09:51.377 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T11:09:51.378 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T11:09:51.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.531+0000 7fca75a95700 1 Processor -- start 2023-10-06T11:09:51.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.531+0000 7fca75a95700 1 -- start start 2023-10-06T11:09:51.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.532+0000 7fca75a95700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fca70157900 0x7fca700ceb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:51.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.532+0000 7fca75a95700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca70068050 0x7fca700adc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:51.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.532+0000 7fca75a95700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca700abfd0 con 0x7fca70157530 2023-10-06T11:09:51.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.532+0000 7fca75a95700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca700ac870 con 0x7fca70157900 2023-10-06T11:09:51.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.532+0000 7fca75a95700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca700b4290 con 0x7fca70068050 2023-10-06T11:09:51.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.532+0000 7fca6effd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fca70157900 0x7fca700ceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:51.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.532+0000 7fca6effd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fca70157900 0x7fca700ceb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37498/0 (socket says 172.21.15.146:37498) 2023-10-06T11:09:51.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.532+0000 7fca6effd700 1 -- 172.21.15.146:0/483168939 learned_addr learned my addr 172.21.15.146:0/483168939 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:51.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.533+0000 7fca6ffff700 1 --2- 172.21.15.146:0/483168939 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca70068050 0x7fca700adc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:51.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.533+0000 7fca6effd700 1 -- 172.21.15.146:0/483168939 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca70068050 msgr2=0x7fca700adc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:51.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.533+0000 7fca6effd700 1 --2- 172.21.15.146:0/483168939 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca70068050 0x7fca700adc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:51.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.533+0000 7fca6effd700 1 -- 172.21.15.146:0/483168939 >> v1:172.21.15.151:6789/0 conn(0x7fca70157530 legacy=0x7fca700b1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:51.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.533+0000 7fca6effd700 1 -- 172.21.15.146:0/483168939 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca700aea40 con 0x7fca70157900 2023-10-06T11:09:51.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.533+0000 7fca6effd700 1 --2- 172.21.15.146:0/483168939 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca70157900 0x7fca700ceb40 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fca640099b0 tx=0x7fca64009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80453fc483a84b6b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:51.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.533+0000 7fca6e7fc700 1 -- 172.21.15.146:0/483168939 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6400b860 con 0x7fca70157900 2023-10-06T11:09:51.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.533+0000 7fca6e7fc700 1 -- 172.21.15.146:0/483168939 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6400b9c0 con 0x7fca70157900 2023-10-06T11:09:51.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.533+0000 7fca6e7fc700 1 -- 172.21.15.146:0/483168939 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6400bd60 con 0x7fca70157900 2023-10-06T11:09:51.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.533+0000 7fca75a95700 1 -- 172.21.15.146:0/483168939 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca70157900 msgr2=0x7fca700ceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:51.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.533+0000 7fca75a95700 1 --2- 172.21.15.146:0/483168939 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca70157900 0x7fca700ceb40 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fca640099b0 tx=0x7fca64009250 comp rx=0 tx=0).stop 2023-10-06T11:09:51.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.534+0000 7fca75a95700 1 -- 172.21.15.146:0/483168939 shutdown_connections 2023-10-06T11:09:51.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.534+0000 7fca75a95700 1 --2- 172.21.15.146:0/483168939 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca70068050 0x7fca700adc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:51.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.534+0000 7fca75a95700 1 --2- 172.21.15.146:0/483168939 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca70157900 0x7fca700ceb40 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:51.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.534+0000 7fca75a95700 1 -- 172.21.15.146:0/483168939 >> 172.21.15.146:0/483168939 conn(0x7fca70067c50 msgr2=0x7fca700ce430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:51.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.534+0000 7fca75a95700 1 -- 172.21.15.146:0/483168939 shutdown_connections 2023-10-06T11:09:51.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.534+0000 7fca75a95700 1 -- 172.21.15.146:0/483168939 wait complete. 2023-10-06T11:09:51.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.535+0000 7fca75a95700 1 Processor -- start 2023-10-06T11:09:51.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.535+0000 7fca75a95700 1 -- start start 2023-10-06T11:09:51.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.535+0000 7fca75a95700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca70068050 0x7fca70168c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:51.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.535+0000 7fca75a95700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca70157530 0x7fca70157cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:51.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.536+0000 7fca75a95700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca70157900 0x7fca7006c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:51.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.536+0000 7fca75a95700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7014e810 con 0x7fca70068050 2023-10-06T11:09:51.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.536+0000 7fca75a95700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca70153100 con 0x7fca70157900 2023-10-06T11:09:51.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.536+0000 7fca75a95700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca700981d0 con 0x7fca70157530 2023-10-06T11:09:51.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.536+0000 7fca6f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca70068050 0x7fca70168c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:51.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.536+0000 7fca6f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca70068050 0x7fca70168c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37514/0 (socket says 172.21.15.146:37514) 2023-10-06T11:09:51.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.536+0000 7fca6f7fe700 1 -- 172.21.15.146:0/3255732995 learned_addr learned my addr 172.21.15.146:0/3255732995 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:51.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.536+0000 7fca6effd700 1 --2- 172.21.15.146:0/3255732995 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca70157530 0x7fca70157cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:51.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.536+0000 7fca6ffff700 1 --2- 172.21.15.146:0/3255732995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca70157900 0x7fca7006c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:51.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.536+0000 7fca6f7fe700 1 -- 172.21.15.146:0/3255732995 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca70157530 msgr2=0x7fca70157cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:51.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.536+0000 7fca6f7fe700 1 --2- 172.21.15.146:0/3255732995 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca70157530 0x7fca70157cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:51.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.536+0000 7fca6f7fe700 1 -- 172.21.15.146:0/3255732995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca70157900 msgr2=0x7fca7006c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:51.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.536+0000 7fca6f7fe700 1 --2- 172.21.15.146:0/3255732995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca70157900 0x7fca7006c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:51.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.536+0000 7fca6f7fe700 1 -- 172.21.15.146:0/3255732995 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca640094f0 con 0x7fca70068050 2023-10-06T11:09:51.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.536+0000 7fca6ffff700 1 --2- 172.21.15.146:0/3255732995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca70157900 0x7fca7006c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:51.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.536+0000 7fca6f7fe700 1 --2- 172.21.15.146:0/3255732995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca70068050 0x7fca70168c10 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fca6000c590 tx=0x7fca6000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:51.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.536+0000 7fca577fe700 1 -- 172.21.15.146:0/3255732995 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca60011590 con 0x7fca70068050 2023-10-06T11:09:51.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.536+0000 7fca577fe700 1 -- 172.21.15.146:0/3255732995 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca60011710 con 0x7fca70068050 2023-10-06T11:09:51.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.536+0000 7fca577fe700 1 -- 172.21.15.146:0/3255732995 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca60011ad0 con 0x7fca70068050 2023-10-06T11:09:51.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.536+0000 7fca75a95700 1 -- 172.21.15.146:0/3255732995 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca70158f00 con 0x7fca70068050 2023-10-06T11:09:51.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.536+0000 7fca75a95700 1 -- 172.21.15.146:0/3255732995 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca70158c20 con 0x7fca70068050 2023-10-06T11:09:51.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.537+0000 7fca75a95700 1 -- 172.21.15.146:0/3255732995 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca7004c380 con 0x7fca70068050 2023-10-06T11:09:51.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.538+0000 7fca577fe700 1 -- 172.21.15.146:0/3255732995 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fca6001b3b0 con 0x7fca70068050 2023-10-06T11:09:51.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.538+0000 7fca577fe700 1 --2- 172.21.15.146:0/3255732995 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fca5c066f30 0x7fca5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:51.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.538+0000 7fca577fe700 1 -- 172.21.15.146:0/3255732995 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fca60083bc0 con 0x7fca70068050 2023-10-06T11:09:51.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.538+0000 7fca6effd700 1 --2- 172.21.15.146:0/3255732995 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fca5c066f30 0x7fca5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:51.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.539+0000 7fca6effd700 1 --2- 172.21.15.146:0/3255732995 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fca5c066f30 0x7fca5c0693e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fca7006f740 tx=0x7fca64017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:51.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.542+0000 7fca577fe700 1 -- 172.21.15.146:0/3255732995 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca60050cd0 con 0x7fca70068050 2023-10-06T11:09:51.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.800+0000 7fca75a95700 1 -- 172.21.15.146:0/3255732995 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fca700ac220 con 0x7fca70068050 2023-10-06T11:09:51.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.803+0000 7fca577fe700 1 -- 172.21.15.146:0/3255732995 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7fca60017070 con 0x7fca70068050 2023-10-06T11:09:51.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.805+0000 7fca75a95700 1 -- 172.21.15.146:0/3255732995 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fca5c066f30 msgr2=0x7fca5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:51.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.805+0000 7fca75a95700 1 --2- 172.21.15.146:0/3255732995 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fca5c066f30 0x7fca5c0693e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fca7006f740 tx=0x7fca64017000 comp rx=0 tx=0).stop 2023-10-06T11:09:51.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.805+0000 7fca75a95700 1 -- 172.21.15.146:0/3255732995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca70068050 msgr2=0x7fca70168c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:51.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.805+0000 7fca75a95700 1 --2- 172.21.15.146:0/3255732995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca70068050 0x7fca70168c10 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fca6000c590 tx=0x7fca6000c8a0 comp rx=0 tx=0).stop 2023-10-06T11:09:51.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.805+0000 7fca75a95700 1 -- 172.21.15.146:0/3255732995 shutdown_connections 2023-10-06T11:09:51.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.805+0000 7fca75a95700 1 --2- 172.21.15.146:0/3255732995 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fca5c066f30 0x7fca5c0693e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:51.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.805+0000 7fca75a95700 1 --2- 172.21.15.146:0/3255732995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca70157900 0x7fca7006c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:51.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.805+0000 7fca75a95700 1 --2- 172.21.15.146:0/3255732995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca70068050 0x7fca70168c10 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:51.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.805+0000 7fca75a95700 1 --2- 172.21.15.146:0/3255732995 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca70157530 0x7fca70157cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:51.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.805+0000 7fca75a95700 1 -- 172.21.15.146:0/3255732995 >> 172.21.15.146:0/3255732995 conn(0x7fca70067c50 msgr2=0x7fca700af020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:51.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.805+0000 7fca75a95700 1 -- 172.21.15.146:0/3255732995 shutdown_connections 2023-10-06T11:09:51.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.805+0000 7fca75a95700 1 -- 172.21.15.146:0/3255732995 wait complete. 2023-10-06T11:09:51.810 INFO:teuthology.orchestra.run.smithi146.stderr:updated caps for client.0 2023-10-06T11:09:51.820 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:09:51.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.932+0000 7fcf8d076700 1 Processor -- start 2023-10-06T11:09:51.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.932+0000 7fcf8d076700 1 -- start start 2023-10-06T11:09:51.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.932+0000 7fcf8d076700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf880b28e0 0x7fcf880c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:51.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.932+0000 7fcf8d076700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcf880cf2d0 0x7fcf880ad730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:51.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.932+0000 7fcf8d076700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf880ad2a0 con 0x7fcf880c53f0 2023-10-06T11:09:51.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.933+0000 7fcf8d076700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf88099ec0 con 0x7fcf880cf2d0 2023-10-06T11:09:51.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.933+0000 7fcf8d076700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf880c7240 con 0x7fcf880b28e0 2023-10-06T11:09:51.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.933+0000 7fcf8759e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcf880cf2d0 0x7fcf880ad730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:51.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.933+0000 7fcf8659c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fcf880c53f0 0x7fcf880cebc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:43940/0 (socket says 172.21.15.146:43940) 2023-10-06T11:09:51.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.933+0000 7fcf8659c700 1 -- 172.21.15.146:0/2877983722 learned_addr learned my addr 172.21.15.146:0/2877983722 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:51.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.933+0000 7fcf86d9d700 1 --2- 172.21.15.146:0/2877983722 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf880b28e0 0x7fcf880c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:51.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.933+0000 7fcf8759e700 1 -- 172.21.15.146:0/2877983722 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf880b28e0 msgr2=0x7fcf880c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:51.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.933+0000 7fcf8759e700 1 --2- 172.21.15.146:0/2877983722 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf880b28e0 0x7fcf880c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:51.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.933+0000 7fcf8759e700 1 -- 172.21.15.146:0/2877983722 >> v1:172.21.15.146:6789/0 conn(0x7fcf880c53f0 legacy=0x7fcf880cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:51.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.933+0000 7fcf85d9b700 1 -- 172.21.15.146:0/2877983722 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2831888316 0 0) 0x7fcf880ad2a0 con 0x7fcf880c53f0 2023-10-06T11:09:51.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.933+0000 7fcf8759e700 1 -- 172.21.15.146:0/2877983722 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf880c69a0 con 0x7fcf880cf2d0 2023-10-06T11:09:51.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.933+0000 7fcf8759e700 1 --2- 172.21.15.146:0/2877983722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf880cf2d0 0x7fcf880ad730 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fcf80009e60 tx=0x7fcf80009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e346cde66dd7f1bf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:51.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.933+0000 7fcf85d9b700 1 -- 172.21.15.146:0/2877983722 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8000e070 con 0x7fcf880cf2d0 2023-10-06T11:09:51.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.933+0000 7fcf85d9b700 1 -- 172.21.15.146:0/2877983722 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf8000bcc0 con 0x7fcf880cf2d0 2023-10-06T11:09:51.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.933+0000 7fcf85d9b700 1 -- 172.21.15.146:0/2877983722 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf80012680 con 0x7fcf880cf2d0 2023-10-06T11:09:51.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.934+0000 7fcf8d076700 1 -- 172.21.15.146:0/2877983722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf880cf2d0 msgr2=0x7fcf880ad730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:51.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.934+0000 7fcf8d076700 1 --2- 172.21.15.146:0/2877983722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf880cf2d0 0x7fcf880ad730 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fcf80009e60 tx=0x7fcf80009780 comp rx=0 tx=0).stop 2023-10-06T11:09:51.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.934+0000 7fcf8d076700 1 -- 172.21.15.146:0/2877983722 shutdown_connections 2023-10-06T11:09:51.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.934+0000 7fcf8d076700 1 --2- 172.21.15.146:0/2877983722 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf880cf2d0 0x7fcf880ad730 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:51.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.934+0000 7fcf8d076700 1 --2- 172.21.15.146:0/2877983722 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf880b28e0 0x7fcf880c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:51.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.934+0000 7fcf8d076700 1 -- 172.21.15.146:0/2877983722 >> 172.21.15.146:0/2877983722 conn(0x7fcf880999a0 msgr2=0x7fcf8806f380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:51.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.934+0000 7fcf8d076700 1 -- 172.21.15.146:0/2877983722 shutdown_connections 2023-10-06T11:09:51.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.934+0000 7fcf8d076700 1 -- 172.21.15.146:0/2877983722 wait complete. 2023-10-06T11:09:51.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.935+0000 7fcf8d076700 1 Processor -- start 2023-10-06T11:09:51.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.935+0000 7fcf8d076700 1 -- start start 2023-10-06T11:09:51.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.936+0000 7fcf8d076700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf880b28e0 0x7fcf88154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:51.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.936+0000 7fcf8d076700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf880c53f0 0x7fcf880b5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:51.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.936+0000 7fcf8d076700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf880cf2d0 0x7fcf880c9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:51.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.936+0000 7fcf8d076700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf880b4bb0 con 0x7fcf880c53f0 2023-10-06T11:09:51.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.936+0000 7fcf8d076700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf88155130 con 0x7fcf880cf2d0 2023-10-06T11:09:51.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.936+0000 7fcf8d076700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf880b3fa0 con 0x7fcf880b28e0 2023-10-06T11:09:51.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.936+0000 7fcf8659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf880c53f0 0x7fcf880b5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:51.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.936+0000 7fcf8659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf880c53f0 0x7fcf880b5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37532/0 (socket says 172.21.15.146:37532) 2023-10-06T11:09:51.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.936+0000 7fcf8659c700 1 -- 172.21.15.146:0/48662609 learned_addr learned my addr 172.21.15.146:0/48662609 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:51.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.936+0000 7fcf86d9d700 1 --2- 172.21.15.146:0/48662609 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf880b28e0 0x7fcf88154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:51.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.936+0000 7fcf8759e700 1 --2- 172.21.15.146:0/48662609 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf880cf2d0 0x7fcf880c9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:51.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.936+0000 7fcf8659c700 1 -- 172.21.15.146:0/48662609 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf880b28e0 msgr2=0x7fcf88154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:51.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.936+0000 7fcf8659c700 1 --2- 172.21.15.146:0/48662609 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf880b28e0 0x7fcf88154bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:51.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.936+0000 7fcf8659c700 1 -- 172.21.15.146:0/48662609 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf880cf2d0 msgr2=0x7fcf880c9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:51.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.936+0000 7fcf8659c700 1 --2- 172.21.15.146:0/48662609 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf880cf2d0 0x7fcf880c9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:51.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.936+0000 7fcf8659c700 1 -- 172.21.15.146:0/48662609 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf80009a20 con 0x7fcf880c53f0 2023-10-06T11:09:51.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.936+0000 7fcf8759e700 1 --2- 172.21.15.146:0/48662609 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf880cf2d0 0x7fcf880c9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:51.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.936+0000 7fcf8659c700 1 --2- 172.21.15.146:0/48662609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf880c53f0 0x7fcf880b5c20 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c00c7e0 tx=0x7fcf7c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:51.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.937+0000 7fcf6effd700 1 -- 172.21.15.146:0/48662609 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c005b30 con 0x7fcf880c53f0 2023-10-06T11:09:51.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.937+0000 7fcf6effd700 1 -- 172.21.15.146:0/48662609 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf7c005c90 con 0x7fcf880c53f0 2023-10-06T11:09:51.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.937+0000 7fcf8d076700 1 -- 172.21.15.146:0/48662609 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf880b4280 con 0x7fcf880c53f0 2023-10-06T11:09:51.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.937+0000 7fcf6effd700 1 -- 172.21.15.146:0/48662609 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c007300 con 0x7fcf880c53f0 2023-10-06T11:09:51.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.937+0000 7fcf8d076700 1 -- 172.21.15.146:0/48662609 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf880b4840 con 0x7fcf880c53f0 2023-10-06T11:09:51.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.938+0000 7fcf8d076700 1 -- 172.21.15.146:0/48662609 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf8804c380 con 0x7fcf880c53f0 2023-10-06T11:09:51.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.938+0000 7fcf6effd700 1 -- 172.21.15.146:0/48662609 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcf7c0076b0 con 0x7fcf880c53f0 2023-10-06T11:09:51.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.938+0000 7fcf6effd700 1 --2- 172.21.15.146:0/48662609 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcf74066f30 0x7fcf740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:51.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.938+0000 7fcf6effd700 1 -- 172.21.15.146:0/48662609 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcf7c083c00 con 0x7fcf880c53f0 2023-10-06T11:09:51.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.938+0000 7fcf86d9d700 1 --2- 172.21.15.146:0/48662609 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcf74066f30 0x7fcf740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:51.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.939+0000 7fcf86d9d700 1 --2- 172.21.15.146:0/48662609 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcf74066f30 0x7fcf740693e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcf880c8a40 tx=0x7fcf78008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:51.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:51.943+0000 7fcf6effd700 1 -- 172.21.15.146:0/48662609 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcf7c08a080 con 0x7fcf880c53f0 2023-10-06T11:09:52.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.170+0000 7fcf8d076700 1 -- 172.21.15.146:0/48662609 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf880c6c80 con 0x7fcf880c53f0 2023-10-06T11:09:52.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.171+0000 7fcf6effd700 1 -- 172.21.15.146:0/48662609 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4607 (secure 0 0 0) 0x7fcf7c017090 con 0x7fcf880c53f0 2023-10-06T11:09:52.173 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:09:52.173 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":48,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5450,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/1721234096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1721234096},{"type":"v1","addr":"172.21.15.151:6834","nonce":1721234096}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6297,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/236648406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":236648406},{"type":"v1","addr":"172.21.15.146:6836","nonce":236648406}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6300,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/2529977172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2529977172},{"type":"v1","addr":"172.21.15.146:6837","nonce":2529977172}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:09:41.580951+0000","modified":"2023-10-06T11:09:45.346284+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6306":{"gid":6306,"name":"b","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6835/2990544048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":2990544048},{"type":"v1","addr":"172.21.15.151:6835","nonce":2990544048}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T11:09:52.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.173+0000 7fcf8d076700 1 -- 172.21.15.146:0/48662609 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcf74066f30 msgr2=0x7fcf740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:52.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.173+0000 7fcf8d076700 1 --2- 172.21.15.146:0/48662609 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcf74066f30 0x7fcf740693e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fcf880c8a40 tx=0x7fcf78008040 comp rx=0 tx=0).stop 2023-10-06T11:09:52.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.173+0000 7fcf8d076700 1 -- 172.21.15.146:0/48662609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf880c53f0 msgr2=0x7fcf880b5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:52.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.173+0000 7fcf8d076700 1 --2- 172.21.15.146:0/48662609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf880c53f0 0x7fcf880b5c20 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c00c7e0 tx=0x7fcf7c007df0 comp rx=0 tx=0).stop 2023-10-06T11:09:52.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.173+0000 7fcf8d076700 1 -- 172.21.15.146:0/48662609 shutdown_connections 2023-10-06T11:09:52.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.173+0000 7fcf8d076700 1 --2- 172.21.15.146:0/48662609 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcf74066f30 0x7fcf740693e0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:52.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.173+0000 7fcf8d076700 1 --2- 172.21.15.146:0/48662609 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf880cf2d0 0x7fcf880c9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:52.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.173+0000 7fcf8d076700 1 --2- 172.21.15.146:0/48662609 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf880b28e0 0x7fcf88154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:52.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.173+0000 7fcf8d076700 1 --2- 172.21.15.146:0/48662609 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf880c53f0 0x7fcf880b5c20 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:52.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.173+0000 7fcf8d076700 1 -- 172.21.15.146:0/48662609 >> 172.21.15.146:0/48662609 conn(0x7fcf880999a0 msgr2=0x7fcf880cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:52.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.173+0000 7fcf8d076700 1 -- 172.21.15.146:0/48662609 shutdown_connections 2023-10-06T11:09:52.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.173+0000 7fcf8d076700 1 -- 172.21.15.146:0/48662609 wait complete. 2023-10-06T11:09:52.176 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 48 2023-10-06T11:09:52.589 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 48, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T11:09:41.580951+0000', 'modified': '2023-10-06T11:09:45.346284+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6306}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6306': {'gid': 6306, 'name': 'b', 'rank': 0, 'incarnation': 44, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.151:6835/2990544048', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6833', 'nonce': 2990544048}, {'type': 'v1', 'addr': '172.21.15.151:6835', 'nonce': 2990544048}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T11:09:52.589 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T11:09:52.590 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-06T11:09:52.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.705+0000 7fb2c987a700 1 Processor -- start 2023-10-06T11:09:52.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.705+0000 7fb2c987a700 1 -- start start 2023-10-06T11:09:52.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.705+0000 7fb2c987a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb2c415a160 0x7fb2c40c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:52.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.705+0000 7fb2c987a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb2c40cb950 0x7fb2c40cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:52.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.705+0000 7fb2c987a700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2c40ae2a0 con 0x7fb2c40ae730 2023-10-06T11:09:52.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.705+0000 7fb2c987a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2c415a530 con 0x7fb2c40cb950 2023-10-06T11:09:52.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.705+0000 7fb2c987a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c40ad690 con 0x7fb2c415a160 2023-10-06T11:09:52.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.706+0000 7fb2c37fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb2c40cb950 0x7fb2c40cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:52.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.706+0000 7fb2c37fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb2c40cb950 0x7fb2c40cbdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37534/0 (socket says 172.21.15.146:37534) 2023-10-06T11:09:52.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.706+0000 7fb2c37fe700 1 -- 172.21.15.146:0/4261091026 learned_addr learned my addr 172.21.15.146:0/4261091026 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:52.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.706+0000 7fb2c2ffd700 1 --2- 172.21.15.146:0/4261091026 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb2c415a160 0x7fb2c40c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:52.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.706+0000 7fb2c37fe700 1 -- 172.21.15.146:0/4261091026 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb2c415a160 msgr2=0x7fb2c40c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:52.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.706+0000 7fb2c37fe700 1 --2- 172.21.15.146:0/4261091026 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb2c415a160 0x7fb2c40c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:52.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.706+0000 7fb2c37fe700 1 -- 172.21.15.146:0/4261091026 >> v1:172.21.15.151:6789/0 conn(0x7fb2c40ae730 legacy=0x7fb2c40aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:52.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.706+0000 7fb2c37fe700 1 -- 172.21.15.146:0/4261091026 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c40ad970 con 0x7fb2c40cb950 2023-10-06T11:09:52.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.706+0000 7fb2c37fe700 1 --2- 172.21.15.146:0/4261091026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2c40cb950 0x7fb2c40cbdb0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc009f20 tx=0x7fb2bc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aca9dd38d568f6c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:52.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.706+0000 7fb2c27fc700 1 -- 172.21.15.146:0/4261091026 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc00e070 con 0x7fb2c40cb950 2023-10-06T11:09:52.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.706+0000 7fb2c27fc700 1 -- 172.21.15.146:0/4261091026 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2bc00ba80 con 0x7fb2c40cb950 2023-10-06T11:09:52.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.706+0000 7fb2c27fc700 1 -- 172.21.15.146:0/4261091026 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc0092e0 con 0x7fb2c40cb950 2023-10-06T11:09:52.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.707+0000 7fb2c987a700 1 -- 172.21.15.146:0/4261091026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2c40cb950 msgr2=0x7fb2c40cbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:52.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.707+0000 7fb2c987a700 1 --2- 172.21.15.146:0/4261091026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2c40cb950 0x7fb2c40cbdb0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc009f20 tx=0x7fb2bc009840 comp rx=0 tx=0).stop 2023-10-06T11:09:52.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.707+0000 7fb2c987a700 1 -- 172.21.15.146:0/4261091026 shutdown_connections 2023-10-06T11:09:52.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.707+0000 7fb2c987a700 1 --2- 172.21.15.146:0/4261091026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2c40cb950 0x7fb2c40cbdb0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:52.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.707+0000 7fb2c987a700 1 --2- 172.21.15.146:0/4261091026 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb2c415a160 0x7fb2c40c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:52.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.707+0000 7fb2c987a700 1 -- 172.21.15.146:0/4261091026 >> 172.21.15.146:0/4261091026 conn(0x7fb2c406f380 msgr2=0x7fb2c40d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:52.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.707+0000 7fb2c987a700 1 -- 172.21.15.146:0/4261091026 shutdown_connections 2023-10-06T11:09:52.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.707+0000 7fb2c987a700 1 -- 172.21.15.146:0/4261091026 wait complete. 2023-10-06T11:09:52.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.708+0000 7fb2c987a700 1 Processor -- start 2023-10-06T11:09:52.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.708+0000 7fb2c987a700 1 -- start start 2023-10-06T11:09:52.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.709+0000 7fb2c987a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb2c40ae730 0x7fb2c4157730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:52.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.709+0000 7fb2c987a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2c40cb950 0x7fb2c415c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:52.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.709+0000 7fb2c987a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2c415a160 0x7fb2c415cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:52.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.709+0000 7fb2c987a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c4157c70 con 0x7fb2c40cb950 2023-10-06T11:09:52.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.709+0000 7fb2c987a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c415e540 con 0x7fb2c415a160 2023-10-06T11:09:52.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.709+0000 7fb2c987a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c415e7c0 con 0x7fb2c40ae730 2023-10-06T11:09:52.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.709+0000 7fb2ba7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2c40cb950 0x7fb2c415c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:52.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.709+0000 7fb2ba7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2c40cb950 0x7fb2c415c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37548/0 (socket says 172.21.15.146:37548) 2023-10-06T11:09:52.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.709+0000 7fb2ba7fc700 1 -- 172.21.15.146:0/625854394 learned_addr learned my addr 172.21.15.146:0/625854394 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:52.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.709+0000 7fb2c2ffd700 1 --2- 172.21.15.146:0/625854394 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb2c40ae730 0x7fb2c4157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:52.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.709+0000 7fb2c37fe700 1 --2- 172.21.15.146:0/625854394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2c415a160 0x7fb2c415cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:52.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.709+0000 7fb2ba7fc700 1 -- 172.21.15.146:0/625854394 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb2c40ae730 msgr2=0x7fb2c4157730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:52.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.709+0000 7fb2ba7fc700 1 --2- 172.21.15.146:0/625854394 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb2c40ae730 0x7fb2c4157730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:52.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.709+0000 7fb2ba7fc700 1 -- 172.21.15.146:0/625854394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2c415a160 msgr2=0x7fb2c415cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:52.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.709+0000 7fb2ba7fc700 1 --2- 172.21.15.146:0/625854394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2c415a160 0x7fb2c415cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:52.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.709+0000 7fb2ba7fc700 1 -- 172.21.15.146:0/625854394 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2bc009ae0 con 0x7fb2c40cb950 2023-10-06T11:09:52.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.709+0000 7fb2c37fe700 1 --2- 172.21.15.146:0/625854394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2c415a160 0x7fb2c415cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:09:52.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.709+0000 7fb2ba7fc700 1 --2- 172.21.15.146:0/625854394 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2c40cb950 0x7fb2c415c810 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac00c4e0 tx=0x7fb2ac00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:52.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.710+0000 7fb2bb7fe700 1 -- 172.21.15.146:0/625854394 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac011590 con 0x7fb2c40cb950 2023-10-06T11:09:52.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.710+0000 7fb2bb7fe700 1 -- 172.21.15.146:0/625854394 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2ac011710 con 0x7fb2c40cb950 2023-10-06T11:09:52.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.710+0000 7fb2c987a700 1 -- 172.21.15.146:0/625854394 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2c415eaa0 con 0x7fb2c40cb950 2023-10-06T11:09:52.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.710+0000 7fb2bb7fe700 1 -- 172.21.15.146:0/625854394 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac011ad0 con 0x7fb2c40cb950 2023-10-06T11:09:52.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.710+0000 7fb2c987a700 1 -- 172.21.15.146:0/625854394 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2c415f060 con 0x7fb2c40cb950 2023-10-06T11:09:52.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.711+0000 7fb2bb7fe700 1 -- 172.21.15.146:0/625854394 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb2ac01b3b0 con 0x7fb2c40cb950 2023-10-06T11:09:52.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.711+0000 7fb2bb7fe700 1 --2- 172.21.15.146:0/625854394 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb2a4066f30 0x7fb2a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:52.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.712+0000 7fb2bb7fe700 1 -- 172.21.15.146:0/625854394 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb2ac083b60 con 0x7fb2c40cb950 2023-10-06T11:09:52.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.712+0000 7fb2c2ffd700 1 --2- 172.21.15.146:0/625854394 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb2a4066f30 0x7fb2a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:52.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.712+0000 7fb2c2ffd700 1 --2- 172.21.15.146:0/625854394 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb2a4066f30 0x7fb2a40693e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4006aa0 tx=0x7fb2b4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:52.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.713+0000 7fb2d2b72b80 1 Processor -- start 2023-10-06T11:09:52.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.714+0000 7fb2d2b72b80 1 -- start start 2023-10-06T11:09:52.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.714+0000 7fb2d2b72b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f772dfa90 0x560f772dfe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:52.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.714+0000 7fb2d2b72b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560f7729b9a0 0x560f77298580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:52.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.714+0000 7fb2d2b72b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560f77299bd0 0x560f77298ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:52.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.714+0000 7fb2d2b72b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f77218c80 con 0x560f772dfa90 2023-10-06T11:09:52.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.714+0000 7fb2d2b72b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f771efa70 con 0x560f77299bd0 2023-10-06T11:09:52.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.714+0000 7fb2d2b72b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x560f771ed270 con 0x560f7729b9a0 2023-10-06T11:09:52.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.715+0000 7fb2c2ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f772dfa90 0x560f772dfe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:52.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.715+0000 7fb2c2ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f772dfa90 0x560f772dfe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37550/0 (socket says 172.21.15.146:37550) 2023-10-06T11:09:52.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.715+0000 7fb2c2ffd700 1 -- 172.21.15.146:0/171375165 learned_addr learned my addr 172.21.15.146:0/171375165 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:52.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.715+0000 7fb2ba7fc700 1 --2- 172.21.15.146:0/171375165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560f7729b9a0 0x560f77298580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:52.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.715+0000 7fb2c37fe700 1 --2- 172.21.15.146:0/171375165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560f77299bd0 0x560f77298ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:52.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.715+0000 7fb2c2ffd700 1 -- 172.21.15.146:0/171375165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560f7729b9a0 msgr2=0x560f77298580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:52.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.715+0000 7fb2c2ffd700 1 --2- 172.21.15.146:0/171375165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560f7729b9a0 0x560f77298580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:52.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.715+0000 7fb2c2ffd700 1 -- 172.21.15.146:0/171375165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560f77299bd0 msgr2=0x560f77298ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:52.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.715+0000 7fb2c2ffd700 1 --2- 172.21.15.146:0/171375165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560f77299bd0 0x560f77298ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:52.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.715+0000 7fb2c2ffd700 1 -- 172.21.15.146:0/171375165 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560f77083270 con 0x560f772dfa90 2023-10-06T11:09:52.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.715+0000 7fb2c2ffd700 1 --2- 172.21.15.146:0/171375165 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f772dfa90 0x560f772dfe60 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4010cb0 tx=0x7fb2b4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e13d59fc00cbb005 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:52.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.715+0000 7fb2a3fff700 1 -- 172.21.15.146:0/171375165 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b4010e60 con 0x560f772dfa90 2023-10-06T11:09:52.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.715+0000 7fb2a3fff700 1 -- 172.21.15.146:0/171375165 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b4014470 con 0x560f772dfa90 2023-10-06T11:09:52.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.715+0000 7fb2a3fff700 1 -- 172.21.15.146:0/171375165 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b40147f0 con 0x560f772dfa90 2023-10-06T11:09:52.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.716+0000 7fb2d2b72b80 1 -- 172.21.15.146:0/171375165 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f772dfa90 msgr2=0x560f772dfe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:52.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.716+0000 7fb2d2b72b80 1 --2- 172.21.15.146:0/171375165 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f772dfa90 0x560f772dfe60 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4010cb0 tx=0x7fb2b4015000 comp rx=0 tx=0).stop 2023-10-06T11:09:52.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.716+0000 7fb2d2b72b80 1 -- 172.21.15.146:0/171375165 shutdown_connections 2023-10-06T11:09:52.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.716+0000 7fb2d2b72b80 1 --2- 172.21.15.146:0/171375165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560f77299bd0 0x560f77298ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:52.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.716+0000 7fb2d2b72b80 1 --2- 172.21.15.146:0/171375165 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f772dfa90 0x560f772dfe60 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:52.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.716+0000 7fb2d2b72b80 1 --2- 172.21.15.146:0/171375165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560f7729b9a0 0x560f77298580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:52.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.716+0000 7fb2d2b72b80 1 -- 172.21.15.146:0/171375165 >> 172.21.15.146:0/171375165 conn(0x560f7729a070 msgr2=0x560f7729a440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:52.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.716+0000 7fb2d2b72b80 1 -- 172.21.15.146:0/171375165 shutdown_connections 2023-10-06T11:09:52.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.716+0000 7fb2d2b72b80 1 -- 172.21.15.146:0/171375165 wait complete. 2023-10-06T11:09:52.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.716+0000 7fb2d2b72b80 1 -- start start 2023-10-06T11:09:52.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.717+0000 7fb2d2b72b80 1 Processor -- start 2023-10-06T11:09:52.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.717+0000 7fb2d2b72b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f77299bd0 0x560f772c4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:52.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.717+0000 7fb2d2b72b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560f7729b9a0 0x560f772c0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:52.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.717+0000 7fb2d2b72b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560f772dfa90 0x560f772c1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:52.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.717+0000 7fb2d2b72b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f771e9060 con 0x560f77299bd0 2023-10-06T11:09:52.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.717+0000 7fb2d2b72b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f77194890 con 0x560f7729b9a0 2023-10-06T11:09:52.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.717+0000 7fb2d2b72b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x560f771afea0 con 0x560f772dfa90 2023-10-06T11:09:52.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.717+0000 7fb2d2b72b80 10 client.0 _ll_register_callbacks cb 0x560f77085f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:09:52.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.718+0000 7fb2c2ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f77299bd0 0x560f772c4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:52.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.718+0000 7fb2c2ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f77299bd0 0x560f772c4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37552/0 (socket says 172.21.15.146:37552) 2023-10-06T11:09:52.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.718+0000 7fb2c2ffd700 1 -- 172.21.15.146:0/4269251989 learned_addr learned my addr 172.21.15.146:0/4269251989 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:52.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.718+0000 7fb2c37fe700 1 --2- 172.21.15.146:0/4269251989 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560f772dfa90 0x560f772c1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:52.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.718+0000 7fb2ba7fc700 1 --2- 172.21.15.146:0/4269251989 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560f7729b9a0 0x560f772c0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:52.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.718+0000 7fb2c2ffd700 1 -- 172.21.15.146:0/4269251989 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560f772dfa90 msgr2=0x560f772c1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:52.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.718+0000 7fb2c2ffd700 1 --2- 172.21.15.146:0/4269251989 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560f772dfa90 0x560f772c1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:52.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.718+0000 7fb2c2ffd700 1 -- 172.21.15.146:0/4269251989 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560f7729b9a0 msgr2=0x560f772c0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:52.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.718+0000 7fb2c2ffd700 1 --2- 172.21.15.146:0/4269251989 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560f7729b9a0 0x560f772c0c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:52.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.718+0000 7fb2c2ffd700 1 -- 172.21.15.146:0/4269251989 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b400e040 con 0x560f77299bd0 2023-10-06T11:09:52.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.718+0000 7fb2c2ffd700 1 --2- 172.21.15.146:0/4269251989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f77299bd0 0x560f772c4610 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fb2b40105e0 tx=0x7fb2b4019030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dee13b61ae98d9d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:52.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.718+0000 7fb2a17fa700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:09:52.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.718+0000 7fb2a17fa700 1 -- 172.21.15.146:0/4269251989 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b4010ee0 con 0x560f77299bd0 2023-10-06T11:09:52.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.718+0000 7fb2d2b72b80 1 -- 172.21.15.146:0/4269251989 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560f7728d690 con 0x560f77299bd0 2023-10-06T11:09:52.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.718+0000 7fb2a17fa700 1 -- 172.21.15.146:0/4269251989 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(59..59 src has 1..59) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb2b4010890 con 0x560f77299bd0 2023-10-06T11:09:52.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.718+0000 7fb2a17fa700 1 -- 172.21.15.146:0/4269251989 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2b402b850 con 0x560f77299bd0 2023-10-06T11:09:52.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.718+0000 7fb2d2b72b80 10 client.6471 fetch_fsmap learned FSMap version 48 2023-10-06T11:09:52.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.718+0000 7fb2d2b72b80 1 -- 172.21.15.146:0/4269251989 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) v3 -- 0x560f77025fe0 con 0x560f77299bd0 2023-10-06T11:09:52.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.718+0000 7fb2a17fa700 1 -- 172.21.15.146:0/4269251989 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560f7728d690 con 0x560f77299bd0 2023-10-06T11:09:52.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.719+0000 7fb2a17fa700 1 -- 172.21.15.146:0/4269251989 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 48) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb2b402b9b0 con 0x560f77299bd0 2023-10-06T11:09:52.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.719+0000 7fb2d2b72b80 10 client.6471 fetch_fsmap finished waiting for FSMap version 48 2023-10-06T11:09:52.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.719+0000 7fb2d2b72b80 10 client.6471 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T11:09:52.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.719+0000 7fb2d2b72b80 20 client.6471 populate_metadata read hostname 'smithi146' 2023-10-06T11:09:52.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.719+0000 7fb2d2b72b80 1 --2- 172.21.15.146:0/4269251989 >> [v2:172.21.15.151:6833/2990544048,v1:172.21.15.151:6835/2990544048] conn(0x560f772da3c0 0x560f772fc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:52.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.719+0000 7fb2d2b72b80 4 client.6471 mds_command: new command op to 6306 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:09:52.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.719+0000 7fb2d2b72b80 1 -- 172.21.15.146:0/4269251989 --> [v2:172.21.15.151:6833/2990544048,v1:172.21.15.151:6835/2990544048] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560f7726a5c0 con 0x560f772da3c0 2023-10-06T11:09:52.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.719+0000 7fb2ba7fc700 1 --2- 172.21.15.146:0/4269251989 >> [v2:172.21.15.151:6833/2990544048,v1:172.21.15.151:6835/2990544048] conn(0x560f772da3c0 0x560f772fc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:52.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.719+0000 7fb2a17fa700 10 client.6471 ms_handle_connect on v2:172.21.15.151:6833/2990544048 2023-10-06T11:09:52.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.719+0000 7fb2ba7fc700 1 --2- 172.21.15.146:0/4269251989 >> [v2:172.21.15.151:6833/2990544048,v1:172.21.15.151:6835/2990544048] conn(0x560f772da3c0 0x560f772fc380 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66060b8795a75c90 server_cookie=78fb2481fc48d7eb in_seq=0 out_seq=0 2023-10-06T11:09:52.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.720+0000 7fb2a17fa700 1 -- 172.21.15.146:0/4269251989 <== mds.0 v2:172.21.15.151:6833/2990544048 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x560f7726a5c0 con 0x560f772da3c0 2023-10-06T11:09:52.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.720+0000 7fb2a17fa700 10 client.6471 handle_command_reply: tid=0 2023-10-06T11:09:52.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.720+0000 7fb2d2b72b80 1 client.6471 shutdown 2023-10-06T11:09:52.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.720+0000 7fb2d2b72b80 1 -- 172.21.15.146:0/4269251989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f77299bd0 msgr2=0x560f772c4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:52.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.720+0000 7fb2d2b72b80 1 --2- 172.21.15.146:0/4269251989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f77299bd0 0x560f772c4610 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fb2b40105e0 tx=0x7fb2b4019030 comp rx=0 tx=0).stop 2023-10-06T11:09:52.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.720+0000 7fb2d2b72b80 1 -- 172.21.15.146:0/4269251989 shutdown_connections 2023-10-06T11:09:52.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.720+0000 7fb2d2b72b80 1 --2- 172.21.15.146:0/4269251989 >> [v2:172.21.15.151:6833/2990544048,v1:172.21.15.151:6835/2990544048] conn(0x560f772da3c0 0x560f772fc380 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:52.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.720+0000 7fb2d2b72b80 1 --2- 172.21.15.146:0/4269251989 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560f772dfa90 0x560f772c1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:52.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.720+0000 7fb2a17fa700 0 client.6471 ms_handle_reset on v2:172.21.15.151:6833/2990544048 2023-10-06T11:09:52.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.720+0000 7fb2d2b72b80 1 --2- 172.21.15.146:0/4269251989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f77299bd0 0x560f772c4610 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:52.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.720+0000 7fb2d2b72b80 1 --2- 172.21.15.146:0/4269251989 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560f7729b9a0 0x560f772c0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:52.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.720+0000 7fb2d2b72b80 1 -- 172.21.15.146:0/4269251989 >> 172.21.15.146:0/4269251989 conn(0x560f7729a070 msgr2=0x560f772dd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:52.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.720+0000 7fb2d2b72b80 1 -- 172.21.15.146:0/4269251989 shutdown_connections 2023-10-06T11:09:52.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.720+0000 7fb2d2b72b80 1 -- 172.21.15.146:0/4269251989 wait complete. 2023-10-06T11:09:52.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.720+0000 7fb2d2b72b80 20 client.6471 trim_cache size 0 max 16384 2023-10-06T11:09:52.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.737+0000 7fb2d2b72b80 1 Processor -- start 2023-10-06T11:09:52.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.737+0000 7fb2d2b72b80 1 -- start start 2023-10-06T11:09:52.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.738+0000 7fb2d2b72b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560f77299bd0 0x560f772d9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:52.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.738+0000 7fb2d2b72b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f7729b9a0 0x560f772959a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:52.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.738+0000 7fb2d2b72b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560f772dfa90 0x560f77294980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:52.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.738+0000 7fb2d2b72b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f7706be30 con 0x560f7729b9a0 2023-10-06T11:09:52.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.738+0000 7fb2d2b72b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f772c2c30 con 0x560f772dfa90 2023-10-06T11:09:52.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.738+0000 7fb2d2b72b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x560f772910d0 con 0x560f77299bd0 2023-10-06T11:09:52.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.738+0000 7fb2ba7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f7729b9a0 0x560f772959a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:52.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.738+0000 7fb2ba7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f7729b9a0 0x560f772959a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37564/0 (socket says 172.21.15.146:37564) 2023-10-06T11:09:52.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.738+0000 7fb2ba7fc700 1 -- 172.21.15.146:0/3415457423 learned_addr learned my addr 172.21.15.146:0/3415457423 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:52.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.738+0000 7fb2c2ffd700 1 --2- 172.21.15.146:0/3415457423 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560f77299bd0 0x560f772d9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:52.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.738+0000 7fb2c37fe700 1 --2- 172.21.15.146:0/3415457423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560f772dfa90 0x560f77294980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:52.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.738+0000 7fb2ba7fc700 1 -- 172.21.15.146:0/3415457423 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560f77299bd0 msgr2=0x560f772d9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:52.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.738+0000 7fb2ba7fc700 1 --2- 172.21.15.146:0/3415457423 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560f77299bd0 0x560f772d9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:52.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.738+0000 7fb2ba7fc700 1 -- 172.21.15.146:0/3415457423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560f772dfa90 msgr2=0x560f77294980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:52.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.738+0000 7fb2ba7fc700 1 --2- 172.21.15.146:0/3415457423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560f772dfa90 0x560f77294980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:52.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.738+0000 7fb2ba7fc700 1 -- 172.21.15.146:0/3415457423 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560f772d67b0 con 0x560f7729b9a0 2023-10-06T11:09:52.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.738+0000 7fb2ba7fc700 1 --2- 172.21.15.146:0/3415457423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f7729b9a0 0x560f772959a0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac00c4b0 tx=0x7fb2ac014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e41beb6db98ed245 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:52.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.738+0000 7fb2b8ff9700 1 -- 172.21.15.146:0/3415457423 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac05b8b0 con 0x560f7729b9a0 2023-10-06T11:09:52.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.738+0000 7fb2b8ff9700 1 -- 172.21.15.146:0/3415457423 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2ac011e80 con 0x560f7729b9a0 2023-10-06T11:09:52.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.738+0000 7fb2b8ff9700 1 -- 172.21.15.146:0/3415457423 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac081f90 con 0x560f7729b9a0 2023-10-06T11:09:52.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.739+0000 7fb2d2b72b80 1 -- 172.21.15.146:0/3415457423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f7729b9a0 msgr2=0x560f772959a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:52.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.739+0000 7fb2d2b72b80 1 --2- 172.21.15.146:0/3415457423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f7729b9a0 0x560f772959a0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac00c4b0 tx=0x7fb2ac014040 comp rx=0 tx=0).stop 2023-10-06T11:09:52.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.739+0000 7fb2d2b72b80 1 -- 172.21.15.146:0/3415457423 shutdown_connections 2023-10-06T11:09:52.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.739+0000 7fb2d2b72b80 1 --2- 172.21.15.146:0/3415457423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560f772dfa90 0x560f77294980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:52.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.739+0000 7fb2d2b72b80 1 --2- 172.21.15.146:0/3415457423 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560f77299bd0 0x560f772d9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:52.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.739+0000 7fb2d2b72b80 1 --2- 172.21.15.146:0/3415457423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f7729b9a0 0x560f772959a0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:52.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.739+0000 7fb2d2b72b80 1 -- 172.21.15.146:0/3415457423 >> 172.21.15.146:0/3415457423 conn(0x560f7729a070 msgr2=0x560f773003a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:52.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.739+0000 7fb2d2b72b80 1 -- 172.21.15.146:0/3415457423 shutdown_connections 2023-10-06T11:09:52.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.739+0000 7fb2d2b72b80 1 -- 172.21.15.146:0/3415457423 wait complete. 2023-10-06T11:09:52.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.739+0000 7fb2d2b72b80 1 -- start start 2023-10-06T11:09:52.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.739+0000 7fb2d2b72b80 1 Processor -- start 2023-10-06T11:09:52.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.740+0000 7fb2d2b72b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560f77299bd0 0x560f773444c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:52.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.740+0000 7fb2d2b72b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560f7729b9a0 0x560f77298580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:52.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.740+0000 7fb2d2b72b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f772dfa90 0x560f772c4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:52.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.740+0000 7fb2d2b72b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f773461b0 con 0x560f772dfa90 2023-10-06T11:09:52.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.740+0000 7fb2d2b72b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f772937d0 con 0x560f7729b9a0 2023-10-06T11:09:52.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.740+0000 7fb2d2b72b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x560f77344a00 con 0x560f77299bd0 2023-10-06T11:09:52.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.740+0000 7fb2d2b72b80 10 client.0 _ll_register_callbacks cb 0x560f77085f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:09:52.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.741+0000 7fb2c37fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f772dfa90 0x560f772c4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:52.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.741+0000 7fb2c37fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f772dfa90 0x560f772c4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37566/0 (socket says 172.21.15.146:37566) 2023-10-06T11:09:52.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.741+0000 7fb2c37fe700 1 -- 172.21.15.146:0/510401777 learned_addr learned my addr 172.21.15.146:0/510401777 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:52.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.741+0000 7fb2ba7fc700 1 --2- 172.21.15.146:0/510401777 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560f7729b9a0 0x560f77298580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:52.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.741+0000 7fb2c2ffd700 1 --2- 172.21.15.146:0/510401777 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560f77299bd0 0x560f773444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:52.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.741+0000 7fb2c37fe700 1 -- 172.21.15.146:0/510401777 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560f77299bd0 msgr2=0x560f773444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:52.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.741+0000 7fb2c37fe700 1 --2- 172.21.15.146:0/510401777 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560f77299bd0 0x560f773444c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:52.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.741+0000 7fb2c37fe700 1 -- 172.21.15.146:0/510401777 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560f7729b9a0 msgr2=0x560f77298580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:52.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.741+0000 7fb2c37fe700 1 --2- 172.21.15.146:0/510401777 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560f7729b9a0 0x560f77298580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:52.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.741+0000 7fb2c37fe700 1 -- 172.21.15.146:0/510401777 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2ac06a040 con 0x560f772dfa90 2023-10-06T11:09:52.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.741+0000 7fb2c37fe700 1 --2- 172.21.15.146:0/510401777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f772dfa90 0x560f772c4c50 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fb2c4088c60 tx=0x7fb2bc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4ae9f1cf5e99217 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:52.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.741+0000 7fb2a17fa700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:09:52.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.741+0000 7fb2a17fa700 1 -- 172.21.15.146:0/510401777 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2bc007ca0 con 0x560f772dfa90 2023-10-06T11:09:52.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.741+0000 7fb2a17fa700 1 -- 172.21.15.146:0/510401777 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(59..59 src has 1..59) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb2bc007e00 con 0x560f772dfa90 2023-10-06T11:09:52.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.741+0000 7fb2d2b72b80 1 -- 172.21.15.146:0/510401777 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb2b4014470 con 0x560f772dfa90 2023-10-06T11:09:52.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.741+0000 7fb2a17fa700 1 -- 172.21.15.146:0/510401777 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2bc029e20 con 0x560f772dfa90 2023-10-06T11:09:52.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.741+0000 7fb2d2b72b80 10 client.6477 fetch_fsmap learned FSMap version 48 2023-10-06T11:09:52.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.741+0000 7fb2d2b72b80 1 -- 172.21.15.146:0/510401777 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) v3 -- 0x560f771b7780 con 0x560f772dfa90 2023-10-06T11:09:52.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.741+0000 7fb2a17fa700 1 -- 172.21.15.146:0/510401777 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b4014470 con 0x560f772dfa90 2023-10-06T11:09:52.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.741+0000 7fb2a17fa700 1 -- 172.21.15.146:0/510401777 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 48) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb2bc00b050 con 0x560f772dfa90 2023-10-06T11:09:52.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.741+0000 7fb2d2b72b80 10 client.6477 fetch_fsmap finished waiting for FSMap version 48 2023-10-06T11:09:52.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.741+0000 7fb2d2b72b80 10 client.6477 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T11:09:52.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.741+0000 7fb2d2b72b80 20 client.6477 populate_metadata read hostname 'smithi146' 2023-10-06T11:09:52.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.742+0000 7fb2d2b72b80 1 --2- 172.21.15.146:0/510401777 >> [v2:172.21.15.151:6833/2990544048,v1:172.21.15.151:6835/2990544048] conn(0x560f772beb10 0x560f772beee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:52.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.742+0000 7fb2d2b72b80 4 client.6477 mds_command: new command op to 6306 tid=0[{"prefix": "status"}] 2023-10-06T11:09:52.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.742+0000 7fb2d2b72b80 1 -- 172.21.15.146:0/510401777 --> [v2:172.21.15.151:6833/2990544048,v1:172.21.15.151:6835/2990544048] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560f7718be00 con 0x560f772beb10 2023-10-06T11:09:52.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.742+0000 7fb2c2ffd700 1 --2- 172.21.15.146:0/510401777 >> [v2:172.21.15.151:6833/2990544048,v1:172.21.15.151:6835/2990544048] conn(0x560f772beb10 0x560f772beee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:52.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.742+0000 7fb2a17fa700 10 client.6477 ms_handle_connect on v2:172.21.15.151:6833/2990544048 2023-10-06T11:09:52.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.742+0000 7fb2c2ffd700 1 --2- 172.21.15.146:0/510401777 >> [v2:172.21.15.151:6833/2990544048,v1:172.21.15.151:6835/2990544048] conn(0x560f772beb10 0x560f772beee0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b2f7c81a870e11e server_cookie=ef8c701a1bf97d5e in_seq=0 out_seq=0 2023-10-06T11:09:52.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.742+0000 7fb2a17fa700 1 -- 172.21.15.146:0/510401777 <== mds.0 v2:172.21.15.151:6833/2990544048 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x560f7718be00 con 0x560f772beb10 2023-10-06T11:09:52.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.742+0000 7fb2a17fa700 10 client.6477 handle_command_reply: tid=0 2023-10-06T11:09:52.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.742+0000 7fb2d2b72b80 1 client.6477 shutdown 2023-10-06T11:09:52.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.742+0000 7fb2d2b72b80 1 -- 172.21.15.146:0/510401777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f772dfa90 msgr2=0x560f772c4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:52.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.742+0000 7fb2d2b72b80 1 --2- 172.21.15.146:0/510401777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f772dfa90 0x560f772c4c50 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fb2c4088c60 tx=0x7fb2bc018000 comp rx=0 tx=0).stop 2023-10-06T11:09:52.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.742+0000 7fb2d2b72b80 1 -- 172.21.15.146:0/510401777 shutdown_connections 2023-10-06T11:09:52.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.743+0000 7fb2d2b72b80 1 --2- 172.21.15.146:0/510401777 >> [v2:172.21.15.151:6833/2990544048,v1:172.21.15.151:6835/2990544048] conn(0x560f772beb10 0x560f772beee0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:52.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.743+0000 7fb2d2b72b80 1 --2- 172.21.15.146:0/510401777 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560f772dfa90 0x560f772c4c50 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:52.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.743+0000 7fb2a17fa700 0 client.6477 ms_handle_reset on v2:172.21.15.151:6833/2990544048 2023-10-06T11:09:52.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.743+0000 7fb2d2b72b80 1 --2- 172.21.15.146:0/510401777 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560f77299bd0 0x560f773444c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:52.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.743+0000 7fb2d2b72b80 1 --2- 172.21.15.146:0/510401777 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560f7729b9a0 0x560f77298580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:52.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.743+0000 7fb2d2b72b80 1 -- 172.21.15.146:0/510401777 >> 172.21.15.146:0/510401777 conn(0x560f7729a070 msgr2=0x560f772dd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:52.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.743+0000 7fb2d2b72b80 1 -- 172.21.15.146:0/510401777 shutdown_connections 2023-10-06T11:09:52.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.743+0000 7fb2d2b72b80 1 -- 172.21.15.146:0/510401777 wait complete. 2023-10-06T11:09:52.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.743+0000 7fb2d2b72b80 20 client.6477 trim_cache size 0 max 16384 2023-10-06T11:09:52.752 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:09:52.752 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1", 2023-10-06T11:09:52.752 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2023-10-06T11:09:52.752 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 6306, 2023-10-06T11:09:52.752 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2023-10-06T11:09:52.752 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2023-10-06T11:09:52.752 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2023-10-06T11:09:52.752 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 10.408289035999999, 2023-10-06T11:09:52.752 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 48, 2023-10-06T11:09:52.753 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 59, 2023-10-06T11:09:52.753 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 59, 2023-10-06T11:09:52.753 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 16.647011449000001 2023-10-06T11:09:52.753 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:09:52.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.743+0000 7fb2c987a700 1 -- 172.21.15.146:0/625854394 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb2a4066f30 msgr2=0x7fb2a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:52.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.743+0000 7fb2c987a700 1 --2- 172.21.15.146:0/625854394 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb2a4066f30 0x7fb2a40693e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4006aa0 tx=0x7fb2b4008040 comp rx=0 tx=0).stop 2023-10-06T11:09:52.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.743+0000 7fb2c987a700 1 -- 172.21.15.146:0/625854394 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2c40cb950 msgr2=0x7fb2c415c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:52.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.743+0000 7fb2c987a700 1 --2- 172.21.15.146:0/625854394 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2c40cb950 0x7fb2c415c810 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac00c4e0 tx=0x7fb2ac00c7f0 comp rx=0 tx=0).stop 2023-10-06T11:09:52.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.743+0000 7fb2c987a700 1 -- 172.21.15.146:0/625854394 shutdown_connections 2023-10-06T11:09:52.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.743+0000 7fb2c987a700 1 --2- 172.21.15.146:0/625854394 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb2a4066f30 0x7fb2a40693e0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:52.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.743+0000 7fb2c987a700 1 --2- 172.21.15.146:0/625854394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2c415a160 0x7fb2c415cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:52.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.743+0000 7fb2c987a700 1 --2- 172.21.15.146:0/625854394 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb2c40ae730 0x7fb2c4157730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:52.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.743+0000 7fb2c987a700 1 --2- 172.21.15.146:0/625854394 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2c40cb950 0x7fb2c415c810 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:52.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.743+0000 7fb2c987a700 1 -- 172.21.15.146:0/625854394 >> 172.21.15.146:0/625854394 conn(0x7fb2c406f380 msgr2=0x7fb2c40d0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:52.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.743+0000 7fb2c987a700 1 -- 172.21.15.146:0/625854394 shutdown_connections 2023-10-06T11:09:52.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.743+0000 7fb2c987a700 1 -- 172.21.15.146:0/625854394 wait complete. 2023-10-06T11:09:52.757 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T11:09:52.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.869+0000 7fe05f5e2700 1 Processor -- start 2023-10-06T11:09:52.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.870+0000 7fe05f5e2700 1 -- start start 2023-10-06T11:09:52.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.870+0000 7fe05f5e2700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe058153ab0 0x7fe05815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:52.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.870+0000 7fe05f5e2700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe058153e80 0x7fe058068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:52.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.870+0000 7fe05f5e2700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe05815ac30 con 0x7fe0580689d0 2023-10-06T11:09:52.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.870+0000 7fe05f5e2700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe058068e50 con 0x7fe058153e80 2023-10-06T11:09:52.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.870+0000 7fe05f5e2700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0580b4510 con 0x7fe058153ab0 2023-10-06T11:09:52.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.870+0000 7fe05db7f700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe0580689d0 0x7fe05815d270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:43950/0 (socket says 172.21.15.146:43950) 2023-10-06T11:09:52.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.871+0000 7fe05db7f700 1 -- 172.21.15.146:0/1333690888 learned_addr learned my addr 172.21.15.146:0/1333690888 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:52.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.871+0000 7fe05d37e700 1 --2- 172.21.15.146:0/1333690888 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe058153ab0 0x7fe05815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:52.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.871+0000 7fe05cb7d700 1 --2- 172.21.15.146:0/1333690888 >> v2:172.21.15.151:3300/0 conn(0x7fe058153e80 0x7fe058068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:52.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.871+0000 7fe04ffff700 1 -- 172.21.15.146:0/1333690888 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3507536560 0 0) 0x7fe050001490 con 0x7fe0580689d0 2023-10-06T11:09:52.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.871+0000 7fe04ffff700 1 -- 172.21.15.146:0/1333690888 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe044003570 con 0x7fe0580689d0 2023-10-06T11:09:52.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.871+0000 7fe05d37e700 1 -- 172.21.15.146:0/1333690888 >> v2:172.21.15.151:3300/0 conn(0x7fe058153e80 msgr2=0x7fe058068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:52.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.871+0000 7fe05d37e700 1 --2- 172.21.15.146:0/1333690888 >> v2:172.21.15.151:3300/0 conn(0x7fe058153e80 0x7fe058068490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:52.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.871+0000 7fe05d37e700 1 -- 172.21.15.146:0/1333690888 >> v1:172.21.15.146:6789/0 conn(0x7fe0580689d0 legacy=0x7fe05815d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:52.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.871+0000 7fe05d37e700 1 -- 172.21.15.146:0/1333690888 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0580b6530 con 0x7fe058153ab0 2023-10-06T11:09:52.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.871+0000 7fe05d37e700 1 --2- 172.21.15.146:0/1333690888 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe058153ab0 0x7fe05815a6f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe0540098e0 tx=0x7fe0540091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d3efd70efe9eba server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:52.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.871+0000 7fe04ffff700 1 -- 172.21.15.146:0/1333690888 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe054011630 con 0x7fe058153ab0 2023-10-06T11:09:52.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.871+0000 7fe04ffff700 1 -- 172.21.15.146:0/1333690888 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe054011790 con 0x7fe058153ab0 2023-10-06T11:09:52.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.871+0000 7fe04ffff700 1 -- 172.21.15.146:0/1333690888 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe054011b30 con 0x7fe058153ab0 2023-10-06T11:09:52.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.872+0000 7fe05f5e2700 1 -- 172.21.15.146:0/1333690888 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe058153ab0 msgr2=0x7fe05815a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:52.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.872+0000 7fe05f5e2700 1 --2- 172.21.15.146:0/1333690888 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe058153ab0 0x7fe05815a6f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe0540098e0 tx=0x7fe0540091a0 comp rx=0 tx=0).stop 2023-10-06T11:09:52.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.872+0000 7fe05f5e2700 1 -- 172.21.15.146:0/1333690888 shutdown_connections 2023-10-06T11:09:52.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.872+0000 7fe05f5e2700 1 --2- 172.21.15.146:0/1333690888 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe058153ab0 0x7fe05815a6f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:52.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.872+0000 7fe05f5e2700 1 --2- 172.21.15.146:0/1333690888 >> v2:172.21.15.151:3300/0 conn(0x7fe058153e80 0x7fe058068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:52.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.872+0000 7fe05f5e2700 1 -- 172.21.15.146:0/1333690888 >> 172.21.15.146:0/1333690888 conn(0x7fe05806eba0 msgr2=0x7fe05806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:52.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.872+0000 7fe05f5e2700 1 -- 172.21.15.146:0/1333690888 shutdown_connections 2023-10-06T11:09:52.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.872+0000 7fe05f5e2700 1 -- 172.21.15.146:0/1333690888 wait complete. 2023-10-06T11:09:52.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.873+0000 7fe05f5e2700 1 Processor -- start 2023-10-06T11:09:52.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.873+0000 7fe05f5e2700 1 -- start start 2023-10-06T11:09:52.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.874+0000 7fe05f5e2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0580689d0 0x7fe058147090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:52.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.874+0000 7fe05f5e2700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe058153ab0 0x7fe05815de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:52.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.874+0000 7fe05f5e2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe058153e80 0x7fe05814bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:52.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.874+0000 7fe05f5e2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0580b11b0 con 0x7fe0580689d0 2023-10-06T11:09:52.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.874+0000 7fe05f5e2700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05815ef30 con 0x7fe058153e80 2023-10-06T11:09:52.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.874+0000 7fe05f5e2700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05815e970 con 0x7fe058153ab0 2023-10-06T11:09:52.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.874+0000 7fe05d37e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0580689d0 0x7fe058147090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:52.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.874+0000 7fe05d37e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0580689d0 0x7fe058147090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37574/0 (socket says 172.21.15.146:37574) 2023-10-06T11:09:52.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.874+0000 7fe05d37e700 1 -- 172.21.15.146:0/816504762 learned_addr learned my addr 172.21.15.146:0/816504762 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:52.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.874+0000 7fe05cb7d700 1 --2- 172.21.15.146:0/816504762 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe058153ab0 0x7fe05815de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:52.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.874+0000 7fe05db7f700 1 --2- 172.21.15.146:0/816504762 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe058153e80 0x7fe05814bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:52.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.874+0000 7fe05d37e700 1 -- 172.21.15.146:0/816504762 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe058153ab0 msgr2=0x7fe05815de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:52.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.874+0000 7fe05d37e700 1 --2- 172.21.15.146:0/816504762 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe058153ab0 0x7fe05815de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:52.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.874+0000 7fe05d37e700 1 -- 172.21.15.146:0/816504762 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe058153e80 msgr2=0x7fe05814bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:52.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.874+0000 7fe05d37e700 1 --2- 172.21.15.146:0/816504762 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe058153e80 0x7fe05814bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:52.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.874+0000 7fe05d37e700 1 -- 172.21.15.146:0/816504762 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe054009420 con 0x7fe0580689d0 2023-10-06T11:09:52.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.874+0000 7fe05db7f700 1 --2- 172.21.15.146:0/816504762 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe058153e80 0x7fe05814bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:09:52.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.874+0000 7fe05d37e700 1 --2- 172.21.15.146:0/816504762 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0580689d0 0x7fe058147090 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fe0580b4650 tx=0x7fe054017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:52.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.875+0000 7fe04d7fa700 1 -- 172.21.15.146:0/816504762 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe054011b10 con 0x7fe0580689d0 2023-10-06T11:09:52.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.875+0000 7fe04d7fa700 1 -- 172.21.15.146:0/816504762 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0540253f0 con 0x7fe0580689d0 2023-10-06T11:09:52.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.875+0000 7fe05f5e2700 1 -- 172.21.15.146:0/816504762 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe05815ec50 con 0x7fe0580689d0 2023-10-06T11:09:52.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.875+0000 7fe04d7fa700 1 -- 172.21.15.146:0/816504762 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe054025790 con 0x7fe0580689d0 2023-10-06T11:09:52.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.875+0000 7fe05f5e2700 1 -- 172.21.15.146:0/816504762 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe05814a3c0 con 0x7fe0580689d0 2023-10-06T11:09:52.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.876+0000 7fe05f5e2700 1 -- 172.21.15.146:0/816504762 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe05804c380 con 0x7fe0580689d0 2023-10-06T11:09:52.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.876+0000 7fe04d7fa700 1 -- 172.21.15.146:0/816504762 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe054025b80 con 0x7fe0580689d0 2023-10-06T11:09:52.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.876+0000 7fe04d7fa700 1 --2- 172.21.15.146:0/816504762 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe03c066f30 0x7fe03c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:52.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.876+0000 7fe04d7fa700 1 -- 172.21.15.146:0/816504762 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe054085fb0 con 0x7fe0580689d0 2023-10-06T11:09:52.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.876+0000 7fe05cb7d700 1 --2- 172.21.15.146:0/816504762 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe03c066f30 0x7fe03c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:52.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.877+0000 7fe05cb7d700 1 --2- 172.21.15.146:0/816504762 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe03c066f30 0x7fe03c0693e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe0580cc8a0 tx=0x7fe048008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:52.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:52.881+0000 7fe04d7fa700 1 -- 172.21.15.146:0/816504762 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe054053060 con 0x7fe0580689d0 2023-10-06T11:09:53.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:53.108+0000 7fe05f5e2700 1 -- 172.21.15.146:0/816504762 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe0580b3720 con 0x7fe0580689d0 2023-10-06T11:09:53.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:53.109+0000 7fe04d7fa700 1 -- 172.21.15.146:0/816504762 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v48) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe054056640 con 0x7fe0580689d0 2023-10-06T11:09:53.111 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T11:09:53.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:53.111+0000 7fe05f5e2700 1 -- 172.21.15.146:0/816504762 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe03c066f30 msgr2=0x7fe03c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:53.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:53.111+0000 7fe05f5e2700 1 --2- 172.21.15.146:0/816504762 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe03c066f30 0x7fe03c0693e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe0580cc8a0 tx=0x7fe048008040 comp rx=0 tx=0).stop 2023-10-06T11:09:53.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:53.111+0000 7fe05f5e2700 1 -- 172.21.15.146:0/816504762 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0580689d0 msgr2=0x7fe058147090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:53.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:53.111+0000 7fe05f5e2700 1 --2- 172.21.15.146:0/816504762 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0580689d0 0x7fe058147090 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fe0580b4650 tx=0x7fe054017000 comp rx=0 tx=0).stop 2023-10-06T11:09:53.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:53.111+0000 7fe05f5e2700 1 -- 172.21.15.146:0/816504762 shutdown_connections 2023-10-06T11:09:53.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:53.111+0000 7fe05f5e2700 1 --2- 172.21.15.146:0/816504762 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe03c066f30 0x7fe03c0693e0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:53.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:53.111+0000 7fe05f5e2700 1 --2- 172.21.15.146:0/816504762 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe058153e80 0x7fe05814bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:53.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:53.111+0000 7fe05f5e2700 1 --2- 172.21.15.146:0/816504762 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0580689d0 0x7fe058147090 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:53.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:53.111+0000 7fe05f5e2700 1 --2- 172.21.15.146:0/816504762 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe058153ab0 0x7fe05815de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:53.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:53.111+0000 7fe05f5e2700 1 -- 172.21.15.146:0/816504762 >> 172.21.15.146:0/816504762 conn(0x7fe05806eba0 msgr2=0x7fe0580d04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:53.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:53.111+0000 7fe05f5e2700 1 -- 172.21.15.146:0/816504762 shutdown_connections 2023-10-06T11:09:53.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:53.111+0000 7fe05f5e2700 1 -- 172.21.15.146:0/816504762 wait complete. 2023-10-06T11:09:53.125 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T11:09:53.125 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T11:09:53.125 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2023-10-06T11:09:53.125 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T11:09:53.125 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T11:09:53.125 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T11:09:53.125 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T11:09:53.126 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T11:09:53.126 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:09:53.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:09:53.126 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2023-10-06T11:09:53.141 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:09:53.141 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:09:53.141 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:09:53.141 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:09:53.141 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2023-10-06T11:09:53.142 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:09:53.142 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:09:53.142 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2023-10-06T11:09:53.142 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2023-10-06T11:09:53.142 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:09:53.142 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2023-10-06T11:09:53.142 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2023-10-06T11:09:53.142 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:09:53.142 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2023-10-06T11:09:53.142 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T11:09:53.142 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2023-10-06T11:09:53.142 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T11:09:53.143 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42264sec preferred_lft 42264sec 2023-10-06T11:09:53.143 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link noprefixroute 2023-10-06T11:09:53.143 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:09:53.143 INFO:teuthology.orchestra.run.smithi146.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T11:09:53.143 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0e:4f:33:80:c4:0e brd ff:ff:ff:ff:ff:ff 2023-10-06T11:09:53.143 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T11:09:53.143 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:09:53.143 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3884:6eff:fefc:ffc7/64 scope link 2023-10-06T11:09:53.143 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:09:53.143 INFO:teuthology.orchestra.run.smithi146.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:09:53.143 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0e:4f:33:80:c4:0e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T11:09:53.144 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::c4f:33ff:fe80:c40e/64 scope link 2023-10-06T11:09:53.144 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:09:53.144 INFO:teuthology.orchestra.run.smithi146.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:09:53.144 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 36:96:28:73:57:c4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T11:09:53.144 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3496:28ff:fe73:57c4/64 scope link 2023-10-06T11:09:53.144 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:09:53.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:09:53.144 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T11:09:53.204 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-06T11:09:53.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:09:53.206 DEBUG:teuthology.orchestra.run.smithi146:> route 2023-10-06T11:09:53.263 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2023-10-06T11:09:53.263 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T11:09:53.263 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T11:09:53.263 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T11:09:53.263 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T11:09:53.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:09:53.264 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-10-06T11:09:53.264 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:09:53.264 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T11:09:53.264 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T11:09:53.264 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T11:09:53.264 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:09:53.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:09:53.363 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-10-06T11:09:53.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T11:09:53.378 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T11:09:53.378 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:09:53.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:09:53.378 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2023-10-06T11:09:53.443 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T11:09:53.443 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:09:53.443 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T11:09:53.498 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:09:53.498 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:09:53.498 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:09:53.552 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-06T11:09:53.617 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:09:53.617 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:09:53.681 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:09:53.682 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:09:53.683 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:09:53.683 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-06T11:09:53.738 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T11:09:53.738 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T11:09:53.781 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-06T11:09:53.804 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:09:53.804 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:09:53.863 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:2023-10-06T11:09:53.861+0000 7f00e7a5a540 -1 init, newargv = 0x556f35913d80 newargc=15 2023-10-06T11:09:53.863 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[117791]: starting ceph client 2023-10-06T11:09:53.868 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[117791]: starting fuse 2023-10-06T11:09:53.870 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:09:53.871 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:09:53.872 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:09:53.872 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-06T11:09:53.927 INFO:teuthology.orchestra.run.smithi146.stdout:46 2023-10-06T11:09:53.927 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-06T11:09:53.928 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T11:09:53.928 DEBUG:teuthology.orchestra.run.smithi146:> import glob 2023-10-06T11:09:53.928 DEBUG:teuthology.orchestra.run.smithi146:> import re 2023-10-06T11:09:53.928 DEBUG:teuthology.orchestra.run.smithi146:> import os 2023-10-06T11:09:53.928 DEBUG:teuthology.orchestra.run.smithi146:> import subprocess 2023-10-06T11:09:53.928 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:09:53.928 DEBUG:teuthology.orchestra.run.smithi146:> def _find_admin_socket(client_name): 2023-10-06T11:09:53.929 DEBUG:teuthology.orchestra.run.smithi146:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T11:09:53.929 DEBUG:teuthology.orchestra.run.smithi146:> files = glob.glob(asok_path) 2023-10-06T11:09:53.929 DEBUG:teuthology.orchestra.run.smithi146:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T11:09:53.929 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:09:53.929 DEBUG:teuthology.orchestra.run.smithi146:> # Given a non-glob path, it better be there 2023-10-06T11:09:53.929 DEBUG:teuthology.orchestra.run.smithi146:> if "*" not in asok_path: 2023-10-06T11:09:53.929 DEBUG:teuthology.orchestra.run.smithi146:> assert(len(files) == 1) 2023-10-06T11:09:53.929 DEBUG:teuthology.orchestra.run.smithi146:> return files[0] 2023-10-06T11:09:53.929 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:09:53.929 DEBUG:teuthology.orchestra.run.smithi146:> for f in files: 2023-10-06T11:09:53.929 DEBUG:teuthology.orchestra.run.smithi146:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T11:09:53.930 DEBUG:teuthology.orchestra.run.smithi146:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T11:09:53.930 DEBUG:teuthology.orchestra.run.smithi146:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T11:09:53.930 DEBUG:teuthology.orchestra.run.smithi146:> contents = proc_f.read() 2023-10-06T11:09:53.930 DEBUG:teuthology.orchestra.run.smithi146:> if mountpoint in contents: 2023-10-06T11:09:53.930 DEBUG:teuthology.orchestra.run.smithi146:> return f 2023-10-06T11:09:53.930 DEBUG:teuthology.orchestra.run.smithi146:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T11:09:53.930 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:09:53.930 DEBUG:teuthology.orchestra.run.smithi146:> print(_find_admin_socket("client.0")) 2023-10-06T11:09:53.930 DEBUG:teuthology.orchestra.run.smithi146:> ' 2023-10-06T11:09:54.048 INFO:teuthology.orchestra.run.smithi146.stdout:/var/run/ceph/ceph-client.0.117791.asok 2023-10-06T11:09:54.230 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.117791.asok 2023-10-06T11:09:54.230 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:09:54.230 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.117791.asok status 2023-10-06T11:09:54.382 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:09:54.383 INFO:teuthology.orchestra.run.smithi146.stdout: "metadata": { 2023-10-06T11:09:54.383 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T11:09:54.383 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T11:09:54.383 INFO:teuthology.orchestra.run.smithi146.stdout: "entity_id": "0", 2023-10-06T11:09:54.383 INFO:teuthology.orchestra.run.smithi146.stdout: "hostname": "smithi146", 2023-10-06T11:09:54.383 INFO:teuthology.orchestra.run.smithi146.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T11:09:54.383 INFO:teuthology.orchestra.run.smithi146.stdout: "pid": "117791", 2023-10-06T11:09:54.383 INFO:teuthology.orchestra.run.smithi146.stdout: "root": "/" 2023-10-06T11:09:54.383 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:09:54.383 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_count": 0, 2023-10-06T11:09:54.383 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_pinned_count": 0, 2023-10-06T11:09:54.384 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 6486, 2023-10-06T11:09:54.384 INFO:teuthology.orchestra.run.smithi146.stdout: "inst": { 2023-10-06T11:09:54.384 INFO:teuthology.orchestra.run.smithi146.stdout: "name": { 2023-10-06T11:09:54.384 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "client", 2023-10-06T11:09:54.384 INFO:teuthology.orchestra.run.smithi146.stdout: "num": 6486 2023-10-06T11:09:54.384 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:09:54.384 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-06T11:09:54.384 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-06T11:09:54.384 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:09:54.384 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 3315757756 2023-10-06T11:09:54.384 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:09:54.385 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:09:54.385 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-06T11:09:54.385 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-06T11:09:54.385 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:09:54.385 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 3315757756 2023-10-06T11:09:54.385 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:09:54.385 INFO:teuthology.orchestra.run.smithi146.stdout: "inst_str": "client.6486 192.168.0.1:0/3315757756", 2023-10-06T11:09:54.385 INFO:teuthology.orchestra.run.smithi146.stdout: "addr_str": "192.168.0.1:0/3315757756", 2023-10-06T11:09:54.385 INFO:teuthology.orchestra.run.smithi146.stdout: "inode_count": 1, 2023-10-06T11:09:54.385 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_epoch": 48, 2023-10-06T11:09:54.386 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch": 59, 2023-10-06T11:09:54.386 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch_barrier": 0, 2023-10-06T11:09:54.386 INFO:teuthology.orchestra.run.smithi146.stdout: "blocklisted": false, 2023-10-06T11:09:54.386 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs" 2023-10-06T11:09:54.386 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:09:54.393 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:09:54.393 DEBUG:teuthology.orchestra.run.smithi146:> stat --file-system '--printf=%T 2023-10-06T11:09:54.393 DEBUG:teuthology.orchestra.run.smithi146:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T11:09:54.408 INFO:teuthology.orchestra.run.smithi146.stdout:fuseblk 2023-10-06T11:09:54.409 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T11:09:54.409 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:09:54.409 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:09:54.475 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:09:54.475 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scrub_repair_path) 2023-10-06T11:09:54.537 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:09:54.537 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch scrub_repair_path/file) 2023-10-06T11:09:54.596 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T11:09:54.596 DEBUG:teuthology.orchestra.run.smithi146:> import os 2023-10-06T11:09:54.596 DEBUG:teuthology.orchestra.run.smithi146:> import stat 2023-10-06T11:09:54.596 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:09:54.597 DEBUG:teuthology.orchestra.run.smithi146:> print(os.stat("/home/ubuntu/cephtest/mnt.0/scrub_repair_path").st_ino) 2023-10-06T11:09:54.597 DEBUG:teuthology.orchestra.run.smithi146:> ' 2023-10-06T11:09:54.700 INFO:teuthology.orchestra.run.smithi146.stdout:1099511627776 2023-10-06T11:09:54.889 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi146.front.sepia.ceph.com... 2023-10-06T11:09:54.889 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T11:09:54.890 DEBUG:teuthology.orchestra.run.smithi146:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T11:09:54.965 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[117791]: fuse finished with error 0 and tester_r 0 2023-10-06T11:09:54.967 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T11:09:55.055 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-10-06T11:09:55.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:09:55.055 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T11:09:55.070 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:09:55.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.223+0000 7fc8c7349700 1 Processor -- start 2023-10-06T11:09:55.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.223+0000 7fc8c7349700 1 -- start start 2023-10-06T11:09:55.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.224+0000 7fc8c7349700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc8c0153ab0 0x7fc8c015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:55.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.224+0000 7fc8c7349700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc8c0153e80 0x7fc8c0068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:55.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.224+0000 7fc8c7349700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8c015ac30 con 0x7fc8c00689d0 2023-10-06T11:09:55.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.224+0000 7fc8c7349700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8c00b4510 con 0x7fc8c0153e80 2023-10-06T11:09:55.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.224+0000 7fc8c7349700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8c00b6530 con 0x7fc8c0153ab0 2023-10-06T11:09:55.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.224+0000 7fc8c48e4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc8c0153e80 0x7fc8c0068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:55.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.224+0000 7fc8c58e6700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc8c00689d0 0x7fc8c015d270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:43952/0 (socket says 172.21.15.146:43952) 2023-10-06T11:09:55.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.224+0000 7fc8c48e4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc8c0153e80 0x7fc8c0068490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37590/0 (socket says 172.21.15.146:37590) 2023-10-06T11:09:55.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.224+0000 7fc8c58e6700 1 -- 172.21.15.146:0/1698895106 learned_addr learned my addr 172.21.15.146:0/1698895106 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:09:55.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.225+0000 7fc8c48e4700 1 -- 172.21.15.146:0/1698895106 >> v2:172.21.15.151:3300/0 conn(0x7fc8c0153ab0 msgr2=0x7fc8c015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:09:55.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.225+0000 7fc8c48e4700 1 --2- 172.21.15.146:0/1698895106 >> v2:172.21.15.151:3300/0 conn(0x7fc8c0153ab0 0x7fc8c015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:55.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.225+0000 7fc8c48e4700 1 -- 172.21.15.146:0/1698895106 >> v1:172.21.15.146:6789/0 conn(0x7fc8c00689d0 legacy=0x7fc8c015d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:55.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.225+0000 7fc8c48e4700 1 -- 172.21.15.146:0/1698895106 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8c0068dd0 con 0x7fc8c0153e80 2023-10-06T11:09:55.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.225+0000 7fc8b7fff700 1 -- 172.21.15.146:0/1698895106 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4138085589 0 0) 0x7fc8b8001490 con 0x7fc8c00689d0 2023-10-06T11:09:55.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.225+0000 7fc8c48e4700 1 --2- 172.21.15.146:0/1698895106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8c0153e80 0x7fc8c0068490 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fc8c00b5eb0 tx=0x7fc8b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3deb2baebd55f066 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:55.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.225+0000 7fc8b7fff700 1 -- 172.21.15.146:0/1698895106 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b000b6b0 con 0x7fc8c0153e80 2023-10-06T11:09:55.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.225+0000 7fc8b7fff700 1 -- 172.21.15.146:0/1698895106 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b000b810 con 0x7fc8c0153e80 2023-10-06T11:09:55.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.225+0000 7fc8b7fff700 1 -- 172.21.15.146:0/1698895106 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b000bbb0 con 0x7fc8c0153e80 2023-10-06T11:09:55.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.225+0000 7fc8c7349700 1 -- 172.21.15.146:0/1698895106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8c0153e80 msgr2=0x7fc8c0068490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:55.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.225+0000 7fc8c7349700 1 --2- 172.21.15.146:0/1698895106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8c0153e80 0x7fc8c0068490 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fc8c00b5eb0 tx=0x7fc8b00091a0 comp rx=0 tx=0).stop 2023-10-06T11:09:55.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.225+0000 7fc8c7349700 1 -- 172.21.15.146:0/1698895106 shutdown_connections 2023-10-06T11:09:55.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.225+0000 7fc8c7349700 1 --2- 172.21.15.146:0/1698895106 >> v2:172.21.15.151:3300/0 conn(0x7fc8c0153ab0 0x7fc8c015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:55.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.225+0000 7fc8c7349700 1 --2- 172.21.15.146:0/1698895106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8c0153e80 0x7fc8c0068490 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:55.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.225+0000 7fc8c7349700 1 -- 172.21.15.146:0/1698895106 >> 172.21.15.146:0/1698895106 conn(0x7fc8c006eba0 msgr2=0x7fc8c006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:55.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.225+0000 7fc8c7349700 1 -- 172.21.15.146:0/1698895106 shutdown_connections 2023-10-06T11:09:55.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.225+0000 7fc8c7349700 1 -- 172.21.15.146:0/1698895106 wait complete. 2023-10-06T11:09:55.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.227+0000 7fc8c7349700 1 Processor -- start 2023-10-06T11:09:55.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.227+0000 7fc8c7349700 1 -- start start 2023-10-06T11:09:55.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.227+0000 7fc8c7349700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8c00689d0 0x7fc8c01568f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:55.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.227+0000 7fc8c7349700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8c0153ab0 0x7fc8c01542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:55.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.227+0000 7fc8c7349700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8c0153e80 0x7fc8c0150130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:55.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.227+0000 7fc8c7349700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c0158220 con 0x7fc8c0153e80 2023-10-06T11:09:55.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.227+0000 7fc8c7349700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c0155320 con 0x7fc8c00689d0 2023-10-06T11:09:55.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.227+0000 7fc8c7349700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c0154800 con 0x7fc8c0153ab0 2023-10-06T11:09:55.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.228+0000 7fc8c58e6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8c0153e80 0x7fc8c0150130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:55.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.228+0000 7fc8c58e6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8c0153e80 0x7fc8c0150130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37592/0 (socket says 172.21.15.146:37592) 2023-10-06T11:09:55.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.228+0000 7fc8c58e6700 1 -- 172.21.15.146:0/2759872625 learned_addr learned my addr 172.21.15.146:0/2759872625 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:09:55.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.228+0000 7fc8c50e5700 1 --2- 172.21.15.146:0/2759872625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8c00689d0 0x7fc8c01568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:55.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.228+0000 7fc8c48e4700 1 --2- 172.21.15.146:0/2759872625 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8c0153ab0 0x7fc8c01542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:55.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.228+0000 7fc8c58e6700 1 -- 172.21.15.146:0/2759872625 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8c0153ab0 msgr2=0x7fc8c01542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:55.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.228+0000 7fc8c58e6700 1 --2- 172.21.15.146:0/2759872625 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8c0153ab0 0x7fc8c01542c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:55.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.228+0000 7fc8c58e6700 1 -- 172.21.15.146:0/2759872625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8c00689d0 msgr2=0x7fc8c01568f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:55.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.228+0000 7fc8c58e6700 1 --2- 172.21.15.146:0/2759872625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8c00689d0 0x7fc8c01568f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:55.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.228+0000 7fc8c58e6700 1 -- 172.21.15.146:0/2759872625 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b0009420 con 0x7fc8c0153e80 2023-10-06T11:09:55.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.228+0000 7fc8c58e6700 1 --2- 172.21.15.146:0/2759872625 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8c0153e80 0x7fc8c0150130 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fc8b800cbf0 tx=0x7fc8b80019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:55.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.228+0000 7fc8b57fa700 1 -- 172.21.15.146:0/2759872625 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b800a9c0 con 0x7fc8c0153e80 2023-10-06T11:09:55.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.228+0000 7fc8b57fa700 1 -- 172.21.15.146:0/2759872625 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8b800ab20 con 0x7fc8c0153e80 2023-10-06T11:09:55.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.228+0000 7fc8c7349700 1 -- 172.21.15.146:0/2759872625 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8c0154ae0 con 0x7fc8c0153e80 2023-10-06T11:09:55.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.228+0000 7fc8b57fa700 1 -- 172.21.15.146:0/2759872625 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b80070f0 con 0x7fc8c0153e80 2023-10-06T11:09:55.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.228+0000 7fc8c7349700 1 -- 172.21.15.146:0/2759872625 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8c0158450 con 0x7fc8c0153e80 2023-10-06T11:09:55.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.229+0000 7fc8c7349700 1 -- 172.21.15.146:0/2759872625 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8c004c380 con 0x7fc8c0153e80 2023-10-06T11:09:55.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.230+0000 7fc8b57fa700 1 -- 172.21.15.146:0/2759872625 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc8b8007520 con 0x7fc8c0153e80 2023-10-06T11:09:55.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.230+0000 7fc8b57fa700 1 --2- 172.21.15.146:0/2759872625 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc8a4066f30 0x7fc8a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:09:55.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.230+0000 7fc8b57fa700 1 -- 172.21.15.146:0/2759872625 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc8b8084930 con 0x7fc8c0153e80 2023-10-06T11:09:55.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.230+0000 7fc8c50e5700 1 --2- 172.21.15.146:0/2759872625 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc8a4066f30 0x7fc8a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:09:55.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.230+0000 7fc8c50e5700 1 --2- 172.21.15.146:0/2759872625 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc8a4066f30 0x7fc8a40693e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc006fd0 tx=0x7fc8bc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:09:55.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.234+0000 7fc8b57fa700 1 -- 172.21.15.146:0/2759872625 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc8b8051ac0 con 0x7fc8c0153e80 2023-10-06T11:09:55.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.463+0000 7fc8c7349700 1 -- 172.21.15.146:0/2759872625 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8c015ac30 con 0x7fc8c0153e80 2023-10-06T11:09:55.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.464+0000 7fc8b57fa700 1 -- 172.21.15.146:0/2759872625 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4607 (secure 0 0 0) 0x7fc8c015ac30 con 0x7fc8c0153e80 2023-10-06T11:09:55.466 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:09:55.466 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":48,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5450,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/1721234096","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1721234096},{"type":"v1","addr":"172.21.15.151:6834","nonce":1721234096}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6297,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/236648406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":236648406},{"type":"v1","addr":"172.21.15.146:6836","nonce":236648406}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6300,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/2529977172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2529977172},{"type":"v1","addr":"172.21.15.146:6837","nonce":2529977172}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:09:41.580951+0000","modified":"2023-10-06T11:09:45.346284+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6306":{"gid":6306,"name":"b","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6835/2990544048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":2990544048},{"type":"v1","addr":"172.21.15.151:6835","nonce":2990544048}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T11:09:55.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.466+0000 7fc8c7349700 1 -- 172.21.15.146:0/2759872625 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc8a4066f30 msgr2=0x7fc8a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:55.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.466+0000 7fc8c7349700 1 --2- 172.21.15.146:0/2759872625 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc8a4066f30 0x7fc8a40693e0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc006fd0 tx=0x7fc8bc008040 comp rx=0 tx=0).stop 2023-10-06T11:09:55.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.466+0000 7fc8c7349700 1 -- 172.21.15.146:0/2759872625 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8c0153e80 msgr2=0x7fc8c0150130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:09:55.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.466+0000 7fc8c7349700 1 --2- 172.21.15.146:0/2759872625 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8c0153e80 0x7fc8c0150130 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fc8b800cbf0 tx=0x7fc8b80019b0 comp rx=0 tx=0).stop 2023-10-06T11:09:55.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.466+0000 7fc8c7349700 1 -- 172.21.15.146:0/2759872625 shutdown_connections 2023-10-06T11:09:55.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.466+0000 7fc8c7349700 1 --2- 172.21.15.146:0/2759872625 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc8a4066f30 0x7fc8a40693e0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:55.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.466+0000 7fc8c7349700 1 --2- 172.21.15.146:0/2759872625 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8c0153e80 0x7fc8c0150130 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:55.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.466+0000 7fc8c7349700 1 --2- 172.21.15.146:0/2759872625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8c00689d0 0x7fc8c01568f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:55.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.466+0000 7fc8c7349700 1 --2- 172.21.15.146:0/2759872625 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8c0153ab0 0x7fc8c01542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:09:55.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.466+0000 7fc8c7349700 1 -- 172.21.15.146:0/2759872625 >> 172.21.15.146:0/2759872625 conn(0x7fc8c006eba0 msgr2=0x7fc8c0152060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:09:55.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.466+0000 7fc8c7349700 1 -- 172.21.15.146:0/2759872625 shutdown_connections 2023-10-06T11:09:55.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:09:55.466+0000 7fc8c7349700 1 -- 172.21.15.146:0/2759872625 wait complete. 2023-10-06T11:09:55.469 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 48 2023-10-06T11:09:55.480 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json flush journal 2023-10-06T11:09:55.632 INFO:teuthology.orchestra.run.smithi151.stdout:{"message":"","return_code":0} 2023-10-06T11:09:55.632 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-10-06T11:09:55.633 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T11:09:55.633 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:09:55.633 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T11:09:55.633 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:09:55.633 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T11:09:55.634 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:09:55.634 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T11:09:55.634 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:09:55.643 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T11:09:55.643 DEBUG:teuthology.parallel:result is None 2023-10-06T11:09:55.643 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T11:09:55.643 DEBUG:teuthology.parallel:result is None 2023-10-06T11:09:55.645 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T11:09:55.645 DEBUG:teuthology.parallel:result is None 2023-10-06T11:09:55.925 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-10-06T11:10:01.644 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T11:10:01.645 DEBUG:teuthology.parallel:result is None 2023-10-06T11:10:01.645 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmomapkey 10000000000.00000000 file_head 2023-10-06T11:10:01.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.690+0000 7fcb6fe0c000 1 Processor -- start 2023-10-06T11:10:01.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.690+0000 7fcb6fe0c000 1 -- start start 2023-10-06T11:10:01.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.691+0000 7fcb6fe0c000 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb54002330 0x55a9e8fee1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:01.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.691+0000 7fcb6fe0c000 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9e8fee730 0x55a9e8f52020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:01.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.691+0000 7fcb6fe0c000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a9e8feeb00 0x55a9e8f52560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:01.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.691+0000 7fcb6fe0c000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9e8eb1320 con 0x55a9e8feeb00 2023-10-06T11:10:01.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.691+0000 7fcb6fe0c000 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9e8e55980 con 0x55a9e8fee730 2023-10-06T11:10:01.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.691+0000 7fcb6fe0c000 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a9e8e55620 con 0x7fcb54002330 2023-10-06T11:10:01.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.691+0000 7fcb69848700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a9e8feeb00 0x55a9e8f52560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:01.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.691+0000 7fcb69047700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb54002330 0x55a9e8fee1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:01.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.691+0000 7fcb69047700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb54002330 0x55a9e8fee1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:33360/0 (socket says 172.21.15.146:33360) 2023-10-06T11:10:01.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.691+0000 7fcb69047700 1 -- 172.21.15.146:0/1547717856 learned_addr learned my addr 172.21.15.146:0/1547717856 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:01.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.691+0000 7fcb69848700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a9e8feeb00 0x55a9e8f52560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43788/0 (socket says 172.21.15.146:43788) 2023-10-06T11:10:01.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.691+0000 7fcb68846700 1 --2- 172.21.15.146:0/1547717856 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9e8fee730 0x55a9e8f52020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:01.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.691+0000 7fcb69848700 1 -- 172.21.15.146:0/1547717856 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb54002330 msgr2=0x55a9e8fee1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:01.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.691+0000 7fcb69848700 1 --2- 172.21.15.146:0/1547717856 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb54002330 0x55a9e8fee1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:01.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.691+0000 7fcb69848700 1 -- 172.21.15.146:0/1547717856 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9e8fee730 msgr2=0x55a9e8f52020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:01.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.691+0000 7fcb69848700 1 --2- 172.21.15.146:0/1547717856 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9e8fee730 0x55a9e8f52020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:01.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.691+0000 7fcb69848700 1 -- 172.21.15.146:0/1547717856 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a9e8e57ae0 con 0x55a9e8feeb00 2023-10-06T11:10:01.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.691+0000 7fcb69848700 1 --2- 172.21.15.146:0/1547717856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a9e8feeb00 0x55a9e8f52560 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fcb5400a650 tx=0x7fcb64008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b2f569494feaa34 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:01.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.692+0000 7fcb5b7fe700 1 -- 172.21.15.146:0/1547717856 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb64011380 con 0x55a9e8feeb00 2023-10-06T11:10:01.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.692+0000 7fcb5b7fe700 1 -- 172.21.15.146:0/1547717856 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb64011500 con 0x55a9e8feeb00 2023-10-06T11:10:01.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.692+0000 7fcb5b7fe700 1 -- 172.21.15.146:0/1547717856 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb640118c0 con 0x55a9e8feeb00 2023-10-06T11:10:01.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.692+0000 7fcb6fe0c000 1 -- 172.21.15.146:0/1547717856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a9e8feeb00 msgr2=0x55a9e8f52560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:01.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.692+0000 7fcb6fe0c000 1 --2- 172.21.15.146:0/1547717856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a9e8feeb00 0x55a9e8f52560 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fcb5400a650 tx=0x7fcb64008040 comp rx=0 tx=0).stop 2023-10-06T11:10:01.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.692+0000 7fcb6fe0c000 1 -- 172.21.15.146:0/1547717856 shutdown_connections 2023-10-06T11:10:01.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.692+0000 7fcb6fe0c000 1 --2- 172.21.15.146:0/1547717856 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a9e8feeb00 0x55a9e8f52560 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:01.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.692+0000 7fcb6fe0c000 1 --2- 172.21.15.146:0/1547717856 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb54002330 0x55a9e8fee1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:01.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.692+0000 7fcb6fe0c000 1 --2- 172.21.15.146:0/1547717856 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9e8fee730 0x55a9e8f52020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:01.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.692+0000 7fcb6fe0c000 1 -- 172.21.15.146:0/1547717856 >> 172.21.15.146:0/1547717856 conn(0x55a9e8f371a0 msgr2=0x55a9e8f39f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:01.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.692+0000 7fcb6fe0c000 1 -- 172.21.15.146:0/1547717856 shutdown_connections 2023-10-06T11:10:01.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.692+0000 7fcb6fe0c000 1 -- 172.21.15.146:0/1547717856 wait complete. 2023-10-06T11:10:01.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.693+0000 7fcb6fe0c000 1 Processor -- start 2023-10-06T11:10:01.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.693+0000 7fcb6fe0c000 1 -- start start 2023-10-06T11:10:01.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.694+0000 7fcb6fe0c000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a9e8fee730 0x55a9e8fde420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:01.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.694+0000 7fcb6fe0c000 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9e8feeb00 0x55a9e8fdfc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:01.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.694+0000 7fcb6fe0c000 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb54002330 0x55a9e8fc60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:01.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.694+0000 7fcb6fe0c000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9e8e4c400 con 0x55a9e8fee730 2023-10-06T11:10:01.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.694+0000 7fcb6fe0c000 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9e8fe1110 con 0x55a9e8feeb00 2023-10-06T11:10:01.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.694+0000 7fcb6fe0c000 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a9e8fe0690 con 0x7fcb54002330 2023-10-06T11:10:01.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.694+0000 7fcb69047700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a9e8fee730 0x55a9e8fde420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:01.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.694+0000 7fcb69047700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a9e8fee730 0x55a9e8fde420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43796/0 (socket says 172.21.15.146:43796) 2023-10-06T11:10:01.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.694+0000 7fcb69047700 1 -- 172.21.15.146:0/3733776983 learned_addr learned my addr 172.21.15.146:0/3733776983 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:01.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.694+0000 7fcb68846700 1 --2- 172.21.15.146:0/3733776983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9e8feeb00 0x55a9e8fdfc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:01.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.694+0000 7fcb69848700 1 --2- 172.21.15.146:0/3733776983 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb54002330 0x55a9e8fc60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:01.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.694+0000 7fcb69047700 1 -- 172.21.15.146:0/3733776983 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb54002330 msgr2=0x55a9e8fc60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:01.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.694+0000 7fcb69047700 1 --2- 172.21.15.146:0/3733776983 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb54002330 0x55a9e8fc60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:01.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.694+0000 7fcb69047700 1 -- 172.21.15.146:0/3733776983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9e8feeb00 msgr2=0x55a9e8fdfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:01.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.694+0000 7fcb69047700 1 --2- 172.21.15.146:0/3733776983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9e8feeb00 0x55a9e8fdfc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:01.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.694+0000 7fcb69047700 1 -- 172.21.15.146:0/3733776983 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb6400e040 con 0x55a9e8fee730 2023-10-06T11:10:01.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.694+0000 7fcb69047700 1 --2- 172.21.15.146:0/3733776983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a9e8fee730 0x55a9e8fde420 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c013750 tx=0x7fcb5c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:01.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.694+0000 7fcb59ffb700 1 -- 172.21.15.146:0/3733776983 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c022070 con 0x55a9e8fee730 2023-10-06T11:10:01.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.694+0000 7fcb59ffb700 1 -- 172.21.15.146:0/3733776983 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5c005bd0 con 0x55a9e8fee730 2023-10-06T11:10:01.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.694+0000 7fcb6fe0c000 1 -- 172.21.15.146:0/3733776983 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a9e8e57540 con 0x55a9e8fee730 2023-10-06T11:10:01.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.694+0000 7fcb59ffb700 1 -- 172.21.15.146:0/3733776983 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c00e040 con 0x55a9e8fee730 2023-10-06T11:10:01.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.694+0000 7fcb6fe0c000 1 -- 172.21.15.146:0/3733776983 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a9e8fe0bd0 con 0x55a9e8fee730 2023-10-06T11:10:01.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.696+0000 7fcb59ffb700 1 -- 172.21.15.146:0/3733776983 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcb5c025070 con 0x55a9e8fee730 2023-10-06T11:10:01.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.696+0000 7fcb59ffb700 1 --2- 172.21.15.146:0/3733776983 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcb4c065890 0x7fcb4c067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:01.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.696+0000 7fcb59ffb700 1 -- 172.21.15.146:0/3733776983 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcb5c084410 con 0x55a9e8fee730 2023-10-06T11:10:01.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.696+0000 7fcb68846700 1 --2- 172.21.15.146:0/3733776983 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcb4c065890 0x7fcb4c067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:01.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.697+0000 7fcb6fe0c000 1 --2- 172.21.15.146:0/3733776983 >> [v2:172.21.15.151:6816/90899,v1:172.21.15.151:6817/90899] conn(0x55a9e8fe0170 0x55a9e8fc5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:01.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.697+0000 7fcb6fe0c000 1 -- 172.21.15.146:0/3733776983 --> [v2:172.21.15.151:6816/90899,v1:172.21.15.151:6817/90899] -- osd_op(unknown.0.0:1 9.10 9:0cf6ad0f:::10000000000.00000000:head [omap-rm-keys in=17b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59) v8 -- 0x55a9e8fde960 con 0x55a9e8fe0170 2023-10-06T11:10:01.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.697+0000 7fcb68846700 1 --2- 172.21.15.146:0/3733776983 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcb4c065890 0x7fcb4c067d40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcb60001620 tx=0x7fcb60011040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:01.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.697+0000 7fcb69848700 1 --2- 172.21.15.146:0/3733776983 >> [v2:172.21.15.151:6816/90899,v1:172.21.15.151:6817/90899] conn(0x55a9e8fe0170 0x55a9e8fc5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:01.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.697+0000 7fcb69848700 1 --2- 172.21.15.146:0/3733776983 >> [v2:172.21.15.151:6816/90899,v1:172.21.15.151:6817/90899] conn(0x55a9e8fe0170 0x55a9e8fc5290 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:01.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.699+0000 7fcb69848700 1 -- 172.21.15.146:0/3733776983 <== osd.4 v2:172.21.15.151:6816/90899 1 ==== osd_op_reply(1 10000000000.00000000 [omap-rm-keys] v59'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fcb6401a040 con 0x55a9e8fe0170 2023-10-06T11:10:01.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.699+0000 7fcb6fe0c000 1 -- 172.21.15.146:0/3733776983 >> [v2:172.21.15.151:6816/90899,v1:172.21.15.151:6817/90899] conn(0x55a9e8fe0170 msgr2=0x55a9e8fc5290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:01.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.699+0000 7fcb6fe0c000 1 --2- 172.21.15.146:0/3733776983 >> [v2:172.21.15.151:6816/90899,v1:172.21.15.151:6817/90899] conn(0x55a9e8fe0170 0x55a9e8fc5290 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:01.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.699+0000 7fcb6fe0c000 1 -- 172.21.15.146:0/3733776983 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcb4c065890 msgr2=0x7fcb4c067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:01.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.699+0000 7fcb6fe0c000 1 --2- 172.21.15.146:0/3733776983 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcb4c065890 0x7fcb4c067d40 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcb60001620 tx=0x7fcb60011040 comp rx=0 tx=0).stop 2023-10-06T11:10:01.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.699+0000 7fcb6fe0c000 1 -- 172.21.15.146:0/3733776983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a9e8fee730 msgr2=0x55a9e8fde420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:01.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.699+0000 7fcb6fe0c000 1 --2- 172.21.15.146:0/3733776983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a9e8fee730 0x55a9e8fde420 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c013750 tx=0x7fcb5c018000 comp rx=0 tx=0).stop 2023-10-06T11:10:01.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.699+0000 7fcb69848700 1 -- 172.21.15.146:0/3733776983 reap_dead start 2023-10-06T11:10:01.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.699+0000 7fcb6fe0c000 1 -- 172.21.15.146:0/3733776983 shutdown_connections 2023-10-06T11:10:01.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.699+0000 7fcb6fe0c000 1 -- 172.21.15.146:0/3733776983 >> 172.21.15.146:0/3733776983 conn(0x55a9e8f371a0 msgr2=0x55a9e8f39f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:01.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.699+0000 7fcb6fe0c000 1 -- 172.21.15.146:0/3733776983 shutdown_connections 2023-10-06T11:10:01.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.699+0000 7fcb6fe0c000 1 -- 172.21.15.146:0/3733776983 wait complete. 2023-10-06T11:10:01.708 ERROR:tasks.ceph.mds.a:tried to stop a non-running daemon 2023-10-06T11:10:01.708 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail a 2023-10-06T11:10:01.709 ERROR:tasks.ceph.mds.c:tried to stop a non-running daemon 2023-10-06T11:10:01.709 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail c 2023-10-06T11:10:01.709 ERROR:tasks.ceph.mds.b:tried to stop a non-running daemon 2023-10-06T11:10:01.709 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail b 2023-10-06T11:10:01.710 ERROR:tasks.ceph.mds.d:tried to stop a non-running daemon 2023-10-06T11:10:01.710 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds fail d 2023-10-06T11:10:01.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.839+0000 7fb0d2079700 1 Processor -- start 2023-10-06T11:10:01.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.839+0000 7fca3d9c6700 1 Processor -- start 2023-10-06T11:10:01.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.839+0000 7fca3d9c6700 1 -- start start 2023-10-06T11:10:01.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.839+0000 7ff43f365700 1 Processor -- start 2023-10-06T11:10:01.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.839+0000 7fb0d2079700 1 -- start start 2023-10-06T11:10:01.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.839+0000 7f7035a3c700 1 Processor -- start 2023-10-06T11:10:01.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.839+0000 7ff43f365700 1 -- start start 2023-10-06T11:10:01.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.839+0000 7f7035a3c700 1 -- start start 2023-10-06T11:10:01.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.840+0000 7fca3d9c6700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fca3813fbc0 0x7fca380c94f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:01.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.840+0000 7fca3d9c6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca380afec0 0x7fca380b0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:01.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.840+0000 7fca3d9c6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca380cbc30 con 0x7fca380c8710 2023-10-06T11:10:01.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.840+0000 7fca3d9c6700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca380c9a30 con 0x7fca3813fbc0 2023-10-06T11:10:01.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.840+0000 7fca3d9c6700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca380cb020 con 0x7fca380afec0 2023-10-06T11:10:01.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.840+0000 7fca37fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fca380c8710 0x7fca380cc0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60034/0 (socket says 172.21.15.146:60034) 2023-10-06T11:10:01.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.840+0000 7fca37fff700 1 -- 172.21.15.146:0/1263744456 learned_addr learned my addr 172.21.15.146:0/1263744456 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:10:01.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.840+0000 7f7035a3c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7030159a90 0x7f70300ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:01.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.840+0000 7f7035a3c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70300cdde0 0x7f70300b00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:01.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.840+0000 7f7035a3c700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70300cb870 con 0x7f70300aecd0 2023-10-06T11:10:01.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.840+0000 7f7035a3c700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70300cac60 con 0x7f7030159a90 2023-10-06T11:10:01.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.840+0000 7f7035a3c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70300caf40 con 0x7f70300cdde0 2023-10-06T11:10:01.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.840+0000 7fca3d1c5700 1 --2- 172.21.15.146:0/1263744456 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca380afec0 0x7fca380b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:01.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.840+0000 7fca3c9c4700 1 --2- 172.21.15.146:0/1263744456 >> v2:172.21.15.151:3300/0 conn(0x7fca3813fbc0 0x7fca380c94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:01.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.840+0000 7fca377fe700 1 -- 172.21.15.146:0/1263744456 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2817142515 0 0) 0x7fca380cbc30 con 0x7fca380c8710 2023-10-06T11:10:01.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.840+0000 7fca377fe700 1 -- 172.21.15.146:0/1263744456 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca28003570 con 0x7fca380c8710 2023-10-06T11:10:01.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.840+0000 7fb0d2079700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb0cc15d810 0x7fb0cc15e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:01.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.840+0000 7fb0d2079700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb0cc15dbe0 0x7fb0cc0b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:01.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.840+0000 7fb0d2079700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0cc161530 0x7fb0cc0b1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:01.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.840+0000 7fb0d2079700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0cc0ccad0 con 0x7fb0cc15d810 2023-10-06T11:10:01.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.840+0000 7fb0d2079700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0cc15f100 con 0x7fb0cc15dbe0 2023-10-06T11:10:01.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.840+0000 7fb0d2079700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0cc15eee0 con 0x7fb0cc161530 2023-10-06T11:10:01.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.840+0000 7f702effd700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7030159a90 0x7f70300ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:01.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.840+0000 7f702effd700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7030159a90 0x7f70300ca330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:56058/0 (socket says 172.21.15.146:56058) 2023-10-06T11:10:01.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.840+0000 7f702effd700 1 -- 172.21.15.146:0/2606232330 learned_addr learned my addr 172.21.15.146:0/2606232330 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:01.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.840+0000 7f702e7fc700 1 --2- 172.21.15.146:0/2606232330 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70300cdde0 0x7f70300b00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:01.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.840+0000 7fb0d1878700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0cc161530 0x7fb0cc0b1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:01.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.840+0000 7fb0d1077700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb0cc15d810 0x7fb0cc15e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:01.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.840+0000 7fb0d0876700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb0cc15dbe0 0x7fb0cc0b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:01.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.840+0000 7fb0d0876700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb0cc15dbe0 0x7fb0cc0b11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:56062/0 (socket says 172.21.15.146:56062) 2023-10-06T11:10:01.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.840+0000 7fb0d1077700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb0cc15d810 0x7fb0cc15e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43802/0 (socket says 172.21.15.146:43802) 2023-10-06T11:10:01.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.840+0000 7fb0d0876700 1 -- 172.21.15.146:0/1770819839 learned_addr learned my addr 172.21.15.146:0/1770819839 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:01.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.840+0000 7fb0d1878700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0cc161530 0x7fb0cc0b1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:33396/0 (socket says 172.21.15.146:33396) 2023-10-06T11:10:01.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.840+0000 7ff43f365700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff4380cb450 0x7ff43806ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:01.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.840+0000 7ff43f365700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff43806f380 con 0x7ff438068aa0 2023-10-06T11:10:01.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.840+0000 7ff43f365700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff43815b410 con 0x7ff4380686d0 2023-10-06T11:10:01.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.840+0000 7ff43f365700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff43815b6f0 con 0x7ff4380cb450 2023-10-06T11:10:01.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.840+0000 7fca3d1c5700 1 -- 172.21.15.146:0/1263744456 >> v2:172.21.15.151:3300/0 conn(0x7fca3813fbc0 msgr2=0x7fca380c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:01.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.840+0000 7fca3d1c5700 1 --2- 172.21.15.146:0/1263744456 >> v2:172.21.15.151:3300/0 conn(0x7fca3813fbc0 0x7fca380c94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:01.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.841+0000 7fca3d1c5700 1 -- 172.21.15.146:0/1263744456 >> v1:172.21.15.146:6789/0 conn(0x7fca380c8710 legacy=0x7fca380cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:01.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.841+0000 7fca3d1c5700 1 -- 172.21.15.146:0/1263744456 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca380cb300 con 0x7fca380afec0 2023-10-06T11:10:01.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.841+0000 7ff43c900700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff438068aa0 0x7ff4380cad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60038/0 (socket says 172.21.15.146:60038) 2023-10-06T11:10:01.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.841+0000 7ff43c900700 1 -- 172.21.15.146:0/2917699077 learned_addr learned my addr 172.21.15.146:0/2917699077 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:10:01.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.841+0000 7ff43d101700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7ff4380686d0 0x7ff4380ca630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:53580/0 (socket says 172.21.15.146:53580) 2023-10-06T11:10:01.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.841+0000 7fca3d1c5700 1 --2- 172.21.15.146:0/1263744456 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca380afec0 0x7fca380b0340 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fca30009e60 tx=0x7fca30009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c014a8d1185f14ee server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:01.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.841+0000 7ff43d902700 1 --2- 172.21.15.146:0/2917699077 >> v2:172.21.15.151:3300/0 conn(0x7ff4380cb450 0x7ff43806ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:01.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.841+0000 7fb0d1077700 1 -- 172.21.15.146:0/1770819839 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0cc161530 msgr2=0x7fb0cc0b1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:01.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.841+0000 7f702e7fc700 1 -- 172.21.15.146:0/2606232330 >> v2:172.21.15.151:3300/0 conn(0x7f7030159a90 msgr2=0x7f70300ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:01.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.841+0000 7f702e7fc700 1 --2- 172.21.15.146:0/2606232330 >> v2:172.21.15.151:3300/0 conn(0x7f7030159a90 0x7f70300ca330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:01.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.841+0000 7fb0d1077700 1 --2- 172.21.15.146:0/1770819839 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0cc161530 0x7fb0cc0b1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:01.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.841+0000 7fb0d1077700 1 -- 172.21.15.146:0/1770819839 >> v2:172.21.15.151:3300/0 conn(0x7fb0cc15dbe0 msgr2=0x7fb0cc0b11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:01.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.841+0000 7f702e7fc700 1 -- 172.21.15.146:0/2606232330 >> v1:172.21.15.151:6789/0 conn(0x7f70300aecd0 legacy=0x7f70300cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:01.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.841+0000 7f702e7fc700 1 -- 172.21.15.146:0/2606232330 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70300cb220 con 0x7f70300cdde0 2023-10-06T11:10:01.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.841+0000 7fb0d1077700 1 --2- 172.21.15.146:0/1770819839 >> v2:172.21.15.151:3300/0 conn(0x7fb0cc15dbe0 0x7fb0cc0b11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:01.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.841+0000 7fb0d1077700 1 -- 172.21.15.146:0/1770819839 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0cc0b1c60 con 0x7fb0cc15d810 2023-10-06T11:10:01.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.841+0000 7fb0d1878700 1 --2- 172.21.15.146:0/1770819839 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0cc161530 0x7fb0cc0b1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:10:01.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.841+0000 7fca377fe700 1 -- 172.21.15.146:0/1263744456 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3000e070 con 0x7fca380afec0 2023-10-06T11:10:01.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.841+0000 7ff42ffff700 1 -- 172.21.15.146:0/2917699077 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1976100898 0 0) 0x7ff43806f380 con 0x7ff438068aa0 2023-10-06T11:10:01.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.841+0000 7ff42ffff700 1 -- 172.21.15.146:0/2917699077 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff424003570 con 0x7ff438068aa0 2023-10-06T11:10:01.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.841+0000 7fca377fe700 1 -- 172.21.15.146:0/1263744456 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3000bab0 con 0x7fca380afec0 2023-10-06T11:10:01.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.841+0000 7fca377fe700 1 -- 172.21.15.146:0/1263744456 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3000be50 con 0x7fca380afec0 2023-10-06T11:10:01.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.841+0000 7ff43d902700 1 -- 172.21.15.146:0/2917699077 >> v1:172.21.15.151:6789/0 conn(0x7ff4380686d0 legacy=0x7ff4380ca630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:01.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.841+0000 7ff43d902700 1 -- 172.21.15.146:0/2917699077 >> v1:172.21.15.146:6789/0 conn(0x7ff438068aa0 legacy=0x7ff4380cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:01.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.841+0000 7ff43d902700 1 -- 172.21.15.146:0/2917699077 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff43815b9d0 con 0x7ff4380cb450 2023-10-06T11:10:01.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.841+0000 7f702e7fc700 1 --2- 172.21.15.146:0/2606232330 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70300cdde0 0x7f70300b00c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f70240098e0 tx=0x7f70240091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8dc793ec1ca1a9e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:01.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.841+0000 7f702dffb700 1 -- 172.21.15.146:0/2606232330 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702400b640 con 0x7f70300cdde0 2023-10-06T11:10:01.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.841+0000 7ff43d902700 1 --2- 172.21.15.146:0/2917699077 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4380cb450 0x7ff43806ec80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff430009e60 tx=0x7ff430009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b294139de4da4a0a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:01.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.842+0000 7f702dffb700 1 -- 172.21.15.146:0/2606232330 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702400b7a0 con 0x7f70300cdde0 2023-10-06T11:10:01.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.842+0000 7f702dffb700 1 -- 172.21.15.146:0/2606232330 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702400bb40 con 0x7f70300cdde0 2023-10-06T11:10:01.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.842+0000 7ff42ffff700 1 -- 172.21.15.146:0/2917699077 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43000e070 con 0x7ff4380cb450 2023-10-06T11:10:01.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.842+0000 7ff42ffff700 1 -- 172.21.15.146:0/2917699077 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff43000bb60 con 0x7ff4380cb450 2023-10-06T11:10:01.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.842+0000 7ff42ffff700 1 -- 172.21.15.146:0/2917699077 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff430012430 con 0x7ff4380cb450 2023-10-06T11:10:01.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.842+0000 7fca3d9c6700 1 -- 172.21.15.146:0/1263744456 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca380afec0 msgr2=0x7fca380b0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:01.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.842+0000 7fca3d9c6700 1 --2- 172.21.15.146:0/1263744456 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca380afec0 0x7fca380b0340 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fca30009e60 tx=0x7fca30009780 comp rx=0 tx=0).stop 2023-10-06T11:10:01.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.841+0000 7fb0d1077700 1 --2- 172.21.15.146:0/1770819839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0cc15d810 0x7fb0cc15e9a0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc06cde0 tx=0x7fb0c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3804e4d432839fb0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:01.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.841+0000 7fb0c3fff700 1 -- 172.21.15.146:0/1770819839 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c8011630 con 0x7fb0cc15d810 2023-10-06T11:10:01.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.841+0000 7fb0c3fff700 1 -- 172.21.15.146:0/1770819839 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c8011790 con 0x7fb0cc15d810 2023-10-06T11:10:01.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.841+0000 7fb0c3fff700 1 -- 172.21.15.146:0/1770819839 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c8011b30 con 0x7fb0cc15d810 2023-10-06T11:10:01.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.842+0000 7fca3d9c6700 1 -- 172.21.15.146:0/1263744456 shutdown_connections 2023-10-06T11:10:01.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.842+0000 7fca3d9c6700 1 --2- 172.21.15.146:0/1263744456 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca380afec0 0x7fca380b0340 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:01.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.842+0000 7fca3d9c6700 1 --2- 172.21.15.146:0/1263744456 >> v2:172.21.15.151:3300/0 conn(0x7fca3813fbc0 0x7fca380c94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:01.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.842+0000 7fca3d9c6700 1 -- 172.21.15.146:0/1263744456 >> 172.21.15.146:0/1263744456 conn(0x7fca38069010 msgr2=0x7fca380cd100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:01.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.842+0000 7fca3d9c6700 1 -- 172.21.15.146:0/1263744456 shutdown_connections 2023-10-06T11:10:01.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.842+0000 7fca3d9c6700 1 -- 172.21.15.146:0/1263744456 wait complete. 2023-10-06T11:10:01.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.842+0000 7f7035a3c700 1 -- 172.21.15.146:0/2606232330 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70300cdde0 msgr2=0x7f70300b00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:01.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.842+0000 7f7035a3c700 1 --2- 172.21.15.146:0/2606232330 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70300cdde0 0x7f70300b00c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f70240098e0 tx=0x7f70240091a0 comp rx=0 tx=0).stop 2023-10-06T11:10:01.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.842+0000 7fb0d2079700 1 -- 172.21.15.146:0/1770819839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0cc15d810 msgr2=0x7fb0cc15e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:01.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.842+0000 7fb0d2079700 1 --2- 172.21.15.146:0/1770819839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0cc15d810 0x7fb0cc15e9a0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc06cde0 tx=0x7fb0c80091a0 comp rx=0 tx=0).stop 2023-10-06T11:10:01.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.842+0000 7f7035a3c700 1 -- 172.21.15.146:0/2606232330 shutdown_connections 2023-10-06T11:10:01.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.842+0000 7f7035a3c700 1 --2- 172.21.15.146:0/2606232330 >> v2:172.21.15.151:3300/0 conn(0x7f7030159a90 0x7f70300ca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:01.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.842+0000 7f7035a3c700 1 --2- 172.21.15.146:0/2606232330 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70300cdde0 0x7f70300b00c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:01.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.842+0000 7f7035a3c700 1 -- 172.21.15.146:0/2606232330 >> 172.21.15.146:0/2606232330 conn(0x7f7030068580 msgr2=0x7f7030068980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:01.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.842+0000 7f7035a3c700 1 -- 172.21.15.146:0/2606232330 shutdown_connections 2023-10-06T11:10:01.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.842+0000 7f7035a3c700 1 -- 172.21.15.146:0/2606232330 wait complete. 2023-10-06T11:10:01.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.842+0000 7ff43f365700 1 -- 172.21.15.146:0/2917699077 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4380cb450 msgr2=0x7ff43806ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:01.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.842+0000 7ff43f365700 1 --2- 172.21.15.146:0/2917699077 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4380cb450 0x7ff43806ec80 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff430009e60 tx=0x7ff430009780 comp rx=0 tx=0).stop 2023-10-06T11:10:01.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.843+0000 7fb0d2079700 1 -- 172.21.15.146:0/1770819839 shutdown_connections 2023-10-06T11:10:01.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.842+0000 7ff43f365700 1 -- 172.21.15.146:0/2917699077 shutdown_connections 2023-10-06T11:10:01.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.842+0000 7ff43f365700 1 --2- 172.21.15.146:0/2917699077 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4380cb450 0x7ff43806ec80 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:01.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.842+0000 7ff43f365700 1 -- 172.21.15.146:0/2917699077 >> 172.21.15.146:0/2917699077 conn(0x7ff4380c9fa0 msgr2=0x7ff43806de70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:01.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.843+0000 7fb0d2079700 1 --2- 172.21.15.146:0/1770819839 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0cc161530 0x7fb0cc0b1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:01.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.843+0000 7fb0d2079700 1 --2- 172.21.15.146:0/1770819839 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0cc15d810 0x7fb0cc15e9a0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:01.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.843+0000 7fb0d2079700 1 --2- 172.21.15.146:0/1770819839 >> v2:172.21.15.151:3300/0 conn(0x7fb0cc15dbe0 0x7fb0cc0b11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:01.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.843+0000 7fb0d2079700 1 -- 172.21.15.146:0/1770819839 >> 172.21.15.146:0/1770819839 conn(0x7fb0cc067ef0 msgr2=0x7fb0cc0cc010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:01.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.843+0000 7ff43f365700 1 -- 172.21.15.146:0/2917699077 shutdown_connections 2023-10-06T11:10:01.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.843+0000 7fb0d2079700 1 -- 172.21.15.146:0/1770819839 shutdown_connections 2023-10-06T11:10:01.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.843+0000 7fb0d2079700 1 -- 172.21.15.146:0/1770819839 wait complete. 2023-10-06T11:10:01.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.843+0000 7ff43f365700 1 -- 172.21.15.146:0/2917699077 wait complete. 2023-10-06T11:10:01.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.844+0000 7fb0d2079700 1 Processor -- start 2023-10-06T11:10:01.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.844+0000 7fca3d9c6700 1 Processor -- start 2023-10-06T11:10:01.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.844+0000 7f7035a3c700 1 Processor -- start 2023-10-06T11:10:01.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.844+0000 7fb0d2079700 1 -- start start 2023-10-06T11:10:01.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.844+0000 7f7035a3c700 1 -- start start 2023-10-06T11:10:01.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.844+0000 7ff43f365700 1 Processor -- start 2023-10-06T11:10:01.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.844+0000 7ff43f365700 1 -- start start 2023-10-06T11:10:01.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.844+0000 7fca3d9c6700 1 -- start start 2023-10-06T11:10:01.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.845+0000 7fca3d9c6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca380afec0 0x7fca381652c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:01.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.845+0000 7fca3d9c6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca380c8710 0x7fca380c5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:01.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.845+0000 7fca3d9c6700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca3813fbc0 0x7fca3813c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:01.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.845+0000 7fca3d9c6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca38165800 con 0x7fca380afec0 2023-10-06T11:10:01.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.845+0000 7fca3d9c6700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca380ac980 con 0x7fca3813fbc0 2023-10-06T11:10:01.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.845+0000 7fca3d9c6700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca380c5130 con 0x7fca380c8710 2023-10-06T11:10:01.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.845+0000 7fca3c9c4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca380afec0 0x7fca381652c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:01.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.845+0000 7fca3c9c4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca380afec0 0x7fca381652c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43806/0 (socket says 172.21.15.146:43806) 2023-10-06T11:10:01.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.845+0000 7fca3c9c4700 1 -- 172.21.15.146:0/1248227072 learned_addr learned my addr 172.21.15.146:0/1248227072 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:01.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.845+0000 7ff43f365700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4380686d0 0x7ff43814c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:01.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.845+0000 7ff43f365700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff438068aa0 0x7ff4380c4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:01.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.845+0000 7ff43f365700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4380cb450 0x7ff438157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:01.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.845+0000 7ff43f365700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4381508f0 con 0x7ff4380686d0 2023-10-06T11:10:01.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.845+0000 7ff43f365700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43814cbd0 con 0x7ff438068aa0 2023-10-06T11:10:01.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.845+0000 7ff43f365700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4381502e0 con 0x7ff4380cb450 2023-10-06T11:10:01.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.845+0000 7ff43d101700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4380686d0 0x7ff43814c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:01.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.846+0000 7fca3d1c5700 1 --2- 172.21.15.146:0/1248227072 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca3813fbc0 0x7fca3813c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:01.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.846+0000 7fca3c9c4700 1 -- 172.21.15.146:0/1248227072 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca380c8710 msgr2=0x7fca380c5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:01.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.846+0000 7fca3c9c4700 1 --2- 172.21.15.146:0/1248227072 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca380c8710 0x7fca380c5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:01.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.846+0000 7fca3c9c4700 1 -- 172.21.15.146:0/1248227072 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca3813fbc0 msgr2=0x7fca3813c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:01.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.846+0000 7fca3c9c4700 1 --2- 172.21.15.146:0/1248227072 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca3813fbc0 0x7fca3813c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:01.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.846+0000 7fca3c9c4700 1 -- 172.21.15.146:0/1248227072 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca30009a20 con 0x7fca380afec0 2023-10-06T11:10:01.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.846+0000 7fca3d1c5700 1 --2- 172.21.15.146:0/1248227072 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca3813fbc0 0x7fca3813c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:10:01.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.846+0000 7fb0d2079700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0cc15d810 0x7fb0cc171f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:01.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.846+0000 7fb0d2079700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0cc15dbe0 0x7fb0cc13baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:01.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.846+0000 7fb0d2079700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0cc161530 0x7fb0cc1649a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:01.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.846+0000 7fb0d2079700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0cc159820 con 0x7fb0cc15d810 2023-10-06T11:10:01.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.846+0000 7fb0d2079700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0cc15b5c0 con 0x7fb0cc15dbe0 2023-10-06T11:10:01.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.846+0000 7fb0d2079700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0cc15acd0 con 0x7fb0cc161530 2023-10-06T11:10:01.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.846+0000 7fb0d1878700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0cc161530 0x7fb0cc1649a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:01.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.846+0000 7fb0d0876700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0cc15dbe0 0x7fb0cc13baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:01.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.846+0000 7fb0d1878700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0cc161530 0x7fb0cc1649a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:33446/0 (socket says 172.21.15.146:33446) 2023-10-06T11:10:01.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.846+0000 7fb0d1878700 1 -- 172.21.15.146:0/898673286 learned_addr learned my addr 172.21.15.146:0/898673286 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:01.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.846+0000 7fb0d1077700 1 --2- 172.21.15.146:0/898673286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0cc15d810 0x7fb0cc171f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:01.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.845+0000 7ff43d101700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4380686d0 0x7ff43814c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43808/0 (socket says 172.21.15.146:43808) 2023-10-06T11:10:01.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.846+0000 7ff43d101700 1 -- 172.21.15.146:0/1312336131 learned_addr learned my addr 172.21.15.146:0/1312336131 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:01.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.846+0000 7ff43c900700 1 --2- 172.21.15.146:0/1312336131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff438068aa0 0x7ff4380c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:01.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.846+0000 7ff43d902700 1 --2- 172.21.15.146:0/1312336131 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4380cb450 0x7ff438157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:01.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.846+0000 7ff43d101700 1 -- 172.21.15.146:0/1312336131 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4380cb450 msgr2=0x7ff438157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:01.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.846+0000 7ff43d101700 1 --2- 172.21.15.146:0/1312336131 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4380cb450 0x7ff438157d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:01.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.846+0000 7ff43d101700 1 -- 172.21.15.146:0/1312336131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff438068aa0 msgr2=0x7ff4380c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:01.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.846+0000 7ff43d101700 1 --2- 172.21.15.146:0/1312336131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff438068aa0 0x7ff4380c4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:01.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.846+0000 7ff43d101700 1 -- 172.21.15.146:0/1312336131 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff430009a20 con 0x7ff4380686d0 2023-10-06T11:10:01.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.845+0000 7f7035a3c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70300aecd0 0x7f703016aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:01.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.845+0000 7f7035a3c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70300cdde0 0x7f70301500e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:01.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.845+0000 7f7035a3c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7030159a90 0x7f703016b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:01.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.845+0000 7f7035a3c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7030150620 con 0x7f7030159a90 2023-10-06T11:10:01.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.845+0000 7f7035a3c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70301510d0 con 0x7f70300aecd0 2023-10-06T11:10:01.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.845+0000 7f7035a3c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7030150830 con 0x7f70300cdde0 2023-10-06T11:10:01.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.846+0000 7f702f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7030159a90 0x7f703016b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:01.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.846+0000 7f702f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7030159a90 0x7f703016b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43816/0 (socket says 172.21.15.146:43816) 2023-10-06T11:10:01.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.846+0000 7f702f7fe700 1 -- 172.21.15.146:0/2535552382 learned_addr learned my addr 172.21.15.146:0/2535552382 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:01.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.846+0000 7f702effd700 1 --2- 172.21.15.146:0/2535552382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70300aecd0 0x7f703016aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:01.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.846+0000 7f702e7fc700 1 --2- 172.21.15.146:0/2535552382 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70300cdde0 0x7f70301500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:01.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.846+0000 7f702effd700 1 -- 172.21.15.146:0/2535552382 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70300cdde0 msgr2=0x7f70301500e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:01.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.846+0000 7f702effd700 1 --2- 172.21.15.146:0/2535552382 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70300cdde0 0x7f70301500e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:01.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.846+0000 7f702effd700 1 -- 172.21.15.146:0/2535552382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7030159a90 msgr2=0x7f703016b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:01.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.846+0000 7f702effd700 1 --2- 172.21.15.146:0/2535552382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7030159a90 0x7f703016b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:01.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.846+0000 7f702effd700 1 -- 172.21.15.146:0/2535552382 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7024009420 con 0x7f70300aecd0 2023-10-06T11:10:01.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.846+0000 7ff43d101700 1 --2- 172.21.15.146:0/1312336131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4380686d0 0x7ff43814c690 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7ff43400c7c0 tx=0x7ff434007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:01.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.846+0000 7fb0d0876700 1 -- 172.21.15.146:0/898673286 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0cc161530 msgr2=0x7fb0cc1649a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:01.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.846+0000 7fb0d0876700 1 --2- 172.21.15.146:0/898673286 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0cc161530 0x7fb0cc1649a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:01.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.846+0000 7fb0d0876700 1 -- 172.21.15.146:0/898673286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0cc15d810 msgr2=0x7fb0cc171f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:01.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.846+0000 7fb0d0876700 1 --2- 172.21.15.146:0/898673286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0cc15d810 0x7fb0cc171f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:01.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.846+0000 7fb0d0876700 1 -- 172.21.15.146:0/898673286 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c8009420 con 0x7fb0cc15dbe0 2023-10-06T11:10:01.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.846+0000 7fca3c9c4700 1 --2- 172.21.15.146:0/1248227072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca380afec0 0x7fca381652c0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fca2c010e90 tx=0x7fca2c00b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:01.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.846+0000 7f702effd700 1 --2- 172.21.15.146:0/2535552382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70300aecd0 0x7f703016aac0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f702000ea90 tx=0x7f702000b4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:01.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.847+0000 7ff42d7fa700 1 -- 172.21.15.146:0/1312336131 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff434005a70 con 0x7ff4380686d0 2023-10-06T11:10:01.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.847+0000 7ff42d7fa700 1 -- 172.21.15.146:0/1312336131 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff434005bd0 con 0x7ff4380686d0 2023-10-06T11:10:01.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.847+0000 7ff42d7fa700 1 -- 172.21.15.146:0/1312336131 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4340070d0 con 0x7ff4380686d0 2023-10-06T11:10:01.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.847+0000 7fca34ff9700 1 -- 172.21.15.146:0/1248227072 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2c011450 con 0x7fca380afec0 2023-10-06T11:10:01.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.847+0000 7f7016ffd700 1 -- 172.21.15.146:0/2535552382 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702000eed0 con 0x7f70300aecd0 2023-10-06T11:10:01.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.847+0000 7f7016ffd700 1 -- 172.21.15.146:0/2535552382 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702000da50 con 0x7f70300aecd0 2023-10-06T11:10:01.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.847+0000 7f7016ffd700 1 -- 172.21.15.146:0/2535552382 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702000ddd0 con 0x7f70300aecd0 2023-10-06T11:10:01.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.847+0000 7f7035a3c700 1 -- 172.21.15.146:0/2535552382 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7030150b10 con 0x7f70300aecd0 2023-10-06T11:10:01.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.847+0000 7fca34ff9700 1 -- 172.21.15.146:0/1248227072 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2c0115b0 con 0x7fca380afec0 2023-10-06T11:10:01.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.847+0000 7fca3d9c6700 1 -- 172.21.15.146:0/1248227072 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca380acbd0 con 0x7fca380afec0 2023-10-06T11:10:01.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.847+0000 7ff43f365700 1 -- 172.21.15.146:0/1312336131 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4380c5050 con 0x7ff4380686d0 2023-10-06T11:10:01.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.847+0000 7f7035a3c700 1 -- 172.21.15.146:0/2535552382 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f703014e730 con 0x7f70300aecd0 2023-10-06T11:10:01.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.848+0000 7fb0d0876700 1 --2- 172.21.15.146:0/898673286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0cc15dbe0 0x7fb0cc13baa0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc006d40 tx=0x7fb0bc009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:01.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.847+0000 7fca3d9c6700 1 -- 172.21.15.146:0/1248227072 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca380ad190 con 0x7fca380afec0 2023-10-06T11:10:01.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.847+0000 7ff43f365700 1 -- 172.21.15.146:0/1312336131 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4380c4d40 con 0x7ff4380686d0 2023-10-06T11:10:01.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.848+0000 7fb0c17fa700 1 -- 172.21.15.146:0/898673286 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc013680 con 0x7fb0cc15dbe0 2023-10-06T11:10:01.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.848+0000 7fca3d9c6700 1 -- 172.21.15.146:0/1248227072 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca380ad3a0 con 0x7fca380afec0 2023-10-06T11:10:01.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.848+0000 7fca34ff9700 1 -- 172.21.15.146:0/1248227072 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2c011950 con 0x7fca380afec0 2023-10-06T11:10:01.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.849+0000 7fca34ff9700 1 -- 172.21.15.146:0/1248227072 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fca2c011d00 con 0x7fca380afec0 2023-10-06T11:10:01.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.849+0000 7fca34ff9700 1 --2- 172.21.15.146:0/1248227072 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fca1c066f30 0x7fca1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:01.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.850+0000 7fca34ff9700 1 -- 172.21.15.146:0/1248227072 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fca2c0876f0 con 0x7fca380afec0 2023-10-06T11:10:01.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.850+0000 7fca37fff700 1 --2- 172.21.15.146:0/1248227072 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fca1c066f30 0x7fca1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:01.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.848+0000 7fb0c17fa700 1 -- 172.21.15.146:0/898673286 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0bc0137e0 con 0x7fb0cc15dbe0 2023-10-06T11:10:01.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.848+0000 7fb0d2079700 1 -- 172.21.15.146:0/898673286 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0cc1507d0 con 0x7fb0cc15dbe0 2023-10-06T11:10:01.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.848+0000 7fb0c17fa700 1 -- 172.21.15.146:0/898673286 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc013b80 con 0x7fb0cc15dbe0 2023-10-06T11:10:01.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.848+0000 7fb0d2079700 1 -- 172.21.15.146:0/898673286 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0cc15af70 con 0x7fb0cc15dbe0 2023-10-06T11:10:01.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.848+0000 7ff43f365700 1 -- 172.21.15.146:0/1312336131 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff43804c380 con 0x7ff4380686d0 2023-10-06T11:10:01.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.849+0000 7ff42d7fa700 1 -- 172.21.15.146:0/1312336131 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff4340074c0 con 0x7ff4380686d0 2023-10-06T11:10:01.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.848+0000 7f7035a3c700 1 -- 172.21.15.146:0/2535552382 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f703004c380 con 0x7f70300aecd0 2023-10-06T11:10:01.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.849+0000 7f7016ffd700 1 -- 172.21.15.146:0/2535552382 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7020010650 con 0x7f70300aecd0 2023-10-06T11:10:01.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.849+0000 7f7016ffd700 1 --2- 172.21.15.146:0/2535552382 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f701c066f30 0x7f701c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:01.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.849+0000 7f7016ffd700 1 -- 172.21.15.146:0/2535552382 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7020084730 con 0x7f70300aecd0 2023-10-06T11:10:01.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.849+0000 7f702e7fc700 1 --2- 172.21.15.146:0/2535552382 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f701c066f30 0x7f701c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:01.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.850+0000 7f702e7fc700 1 --2- 172.21.15.146:0/2535552382 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f701c066f30 0x7f701c0693e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f70240093f0 tx=0x7f7024017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:01.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.850+0000 7ff42d7fa700 1 --2- 172.21.15.146:0/1312336131 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff41c066f30 0x7ff41c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:01.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.850+0000 7ff43c900700 1 --2- 172.21.15.146:0/1312336131 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff41c066f30 0x7ff41c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:01.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.850+0000 7ff42d7fa700 1 -- 172.21.15.146:0/1312336131 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff434083ee0 con 0x7ff4380686d0 2023-10-06T11:10:01.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.850+0000 7fb0d2079700 1 -- 172.21.15.146:0/898673286 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0cc15b730 con 0x7fb0cc15dbe0 2023-10-06T11:10:01.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.850+0000 7fb0c17fa700 1 -- 172.21.15.146:0/898673286 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb0bc00c3e0 con 0x7fb0cc15dbe0 2023-10-06T11:10:01.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.850+0000 7fca37fff700 1 --2- 172.21.15.146:0/1248227072 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fca1c066f30 0x7fca1c0693e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fca240058d0 tx=0x7fca240079d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:01.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.850+0000 7ff43c900700 1 --2- 172.21.15.146:0/1312336131 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff41c066f30 0x7ff41c0693e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff438158d90 tx=0x7ff428009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:01.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.850+0000 7fb0c17fa700 1 --2- 172.21.15.146:0/898673286 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb0b0067080 0x7fb0b0069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:01.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.851+0000 7fb0c17fa700 1 -- 172.21.15.146:0/898673286 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb0bc084750 con 0x7fb0cc15dbe0 2023-10-06T11:10:01.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.851+0000 7fb0d1077700 1 --2- 172.21.15.146:0/898673286 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb0b0067080 0x7fb0b0069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:01.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.851+0000 7fb0d1077700 1 --2- 172.21.15.146:0/898673286 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb0b0067080 0x7fb0b0069530 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb0c80093f0 tx=0x7fb0c8017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:01.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.854+0000 7fca34ff9700 1 -- 172.21.15.146:0/1248227072 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca2c054880 con 0x7fca380afec0 2023-10-06T11:10:01.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.854+0000 7f7016ffd700 1 -- 172.21.15.146:0/2535552382 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7020051840 con 0x7f70300aecd0 2023-10-06T11:10:01.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.858+0000 7ff42d7fa700 1 -- 172.21.15.146:0/1312336131 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff434051070 con 0x7ff4380686d0 2023-10-06T11:10:01.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:01.858+0000 7fb0c17fa700 1 -- 172.21.15.146:0/898673286 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb0bc0552d0 con 0x7fb0cc15dbe0 2023-10-06T11:10:02.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:02.126+0000 7f7035a3c700 1 -- 172.21.15.146:0/2535552382 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "d"} v 0) v1 -- 0x7f703006ea00 con 0x7f70300aecd0 2023-10-06T11:10:02.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:02.130+0000 7ff43f365700 1 -- 172.21.15.146:0/1312336131 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7ff4380cbf60 con 0x7ff4380686d0 2023-10-06T11:10:02.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:02.154+0000 7fca3d9c6700 1 -- 172.21.15.146:0/1248227072 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7fca380cb5e0 con 0x7fca380afec0 2023-10-06T11:10:02.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:02.157+0000 7fb0d2079700 1 -- 172.21.15.146:0/898673286 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) v1 -- 0x7fb0cc161aa0 con 0x7fb0cc15dbe0 2023-10-06T11:10:02.234 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-10-06T11:10:02.393 INFO:tasks.ceph.mon.a.smithi146.stderr:2023-10-06T11:10:02.391+0000 7f011929c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T11:10:02.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:02.392+0000 7f7016ffd700 1 -- 172.21.15.146:0/2535552382 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "d"}]=0 failed mds gid 5450 v49) v1 ==== 95+0+0 (secure 0 0 0) 0x7f7020054e60 con 0x7f70300aecd0 2023-10-06T11:10:02.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:02.394+0000 7f7035a3c700 1 -- 172.21.15.146:0/2535552382 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f701c066f30 msgr2=0x7f701c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:02.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:02.394+0000 7f7035a3c700 1 --2- 172.21.15.146:0/2535552382 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f701c066f30 0x7f701c0693e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f70240093f0 tx=0x7f7024017000 comp rx=0 tx=0).stop 2023-10-06T11:10:02.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:02.394+0000 7f7035a3c700 1 -- 172.21.15.146:0/2535552382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70300aecd0 msgr2=0x7f703016aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:02.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:02.394+0000 7f7035a3c700 1 --2- 172.21.15.146:0/2535552382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70300aecd0 0x7f703016aac0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f702000ea90 tx=0x7f702000b4f0 comp rx=0 tx=0).stop 2023-10-06T11:10:02.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:02.394+0000 7f7035a3c700 1 -- 172.21.15.146:0/2535552382 shutdown_connections 2023-10-06T11:10:02.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:02.394+0000 7f7035a3c700 1 --2- 172.21.15.146:0/2535552382 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f701c066f30 0x7f701c0693e0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:02.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:02.394+0000 7f7035a3c700 1 --2- 172.21.15.146:0/2535552382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7030159a90 0x7f703016b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:02.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:02.394+0000 7f7035a3c700 1 --2- 172.21.15.146:0/2535552382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70300aecd0 0x7f703016aac0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:02.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:02.394+0000 7f7035a3c700 1 --2- 172.21.15.146:0/2535552382 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70300cdde0 0x7f70301500e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:02.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:02.394+0000 7f7035a3c700 1 -- 172.21.15.146:0/2535552382 >> 172.21.15.146:0/2535552382 conn(0x7f7030068580 msgr2=0x7f70300ae5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:02.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:02.394+0000 7f7035a3c700 1 -- 172.21.15.146:0/2535552382 shutdown_connections 2023-10-06T11:10:02.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:02.394+0000 7f7035a3c700 1 -- 172.21.15.146:0/2535552382 wait complete. 2023-10-06T11:10:02.398 INFO:teuthology.orchestra.run.smithi146.stderr:failed mds gid 5450 2023-10-06T11:10:02.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:02.400+0000 7ff42d7fa700 1 -- 172.21.15.146:0/1312336131 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 6306 v50) v1 ==== 95+0+0 (secure 0 0 0) 0x7ff434017090 con 0x7ff4380686d0 2023-10-06T11:10:02.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:02.404+0000 7ff43f365700 1 -- 172.21.15.146:0/1312336131 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff41c066f30 msgr2=0x7ff41c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:02.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:02.404+0000 7ff43f365700 1 --2- 172.21.15.146:0/1312336131 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff41c066f30 0x7ff41c0693e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7ff438158d90 tx=0x7ff428009040 comp rx=0 tx=0).stop 2023-10-06T11:10:02.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:02.404+0000 7ff43f365700 1 -- 172.21.15.146:0/1312336131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4380686d0 msgr2=0x7ff43814c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:02.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:02.404+0000 7ff43f365700 1 --2- 172.21.15.146:0/1312336131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4380686d0 0x7ff43814c690 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7ff43400c7c0 tx=0x7ff434007f70 comp rx=0 tx=0).stop 2023-10-06T11:10:02.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:02.404+0000 7ff43f365700 1 -- 172.21.15.146:0/1312336131 shutdown_connections 2023-10-06T11:10:02.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:02.404+0000 7ff43f365700 1 --2- 172.21.15.146:0/1312336131 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff41c066f30 0x7ff41c0693e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:02.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:02.404+0000 7ff43f365700 1 --2- 172.21.15.146:0/1312336131 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4380cb450 0x7ff438157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:02.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:02.404+0000 7ff43f365700 1 --2- 172.21.15.146:0/1312336131 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4380686d0 0x7ff43814c690 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:02.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:02.404+0000 7ff43f365700 1 --2- 172.21.15.146:0/1312336131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff438068aa0 0x7ff4380c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:02.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:02.404+0000 7ff43f365700 1 -- 172.21.15.146:0/1312336131 >> 172.21.15.146:0/1312336131 conn(0x7ff4380c9fa0 msgr2=0x7ff43815a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:02.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:02.404+0000 7ff43f365700 1 -- 172.21.15.146:0/1312336131 shutdown_connections 2023-10-06T11:10:02.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:02.404+0000 7ff43f365700 1 -- 172.21.15.146:0/1312336131 wait complete. 2023-10-06T11:10:02.407 INFO:teuthology.orchestra.run.smithi146.stderr:failed mds gid 6306 2023-10-06T11:10:02.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:02.408+0000 7fca34ff9700 1 -- 172.21.15.146:0/1248227072 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 6300 v51) v1 ==== 95+0+0 (secure 0 0 0) 0x7fca2c01e090 con 0x7fca380afec0 2023-10-06T11:10:02.411 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T11:10:02.411 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T11:10:02.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:02.411+0000 7fca3d9c6700 1 -- 172.21.15.146:0/1248227072 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fca1c066f30 msgr2=0x7fca1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:02.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:02.411+0000 7fca3d9c6700 1 --2- 172.21.15.146:0/1248227072 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fca1c066f30 0x7fca1c0693e0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fca240058d0 tx=0x7fca240079d0 comp rx=0 tx=0).stop 2023-10-06T11:10:02.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:02.411+0000 7fca3d9c6700 1 -- 172.21.15.146:0/1248227072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca380afec0 msgr2=0x7fca381652c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:02.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:02.411+0000 7fca3d9c6700 1 --2- 172.21.15.146:0/1248227072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca380afec0 0x7fca381652c0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fca2c010e90 tx=0x7fca2c00b430 comp rx=0 tx=0).stop 2023-10-06T11:10:02.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:02.411+0000 7fca3d9c6700 1 -- 172.21.15.146:0/1248227072 shutdown_connections 2023-10-06T11:10:02.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:02.411+0000 7fca3d9c6700 1 --2- 172.21.15.146:0/1248227072 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fca1c066f30 0x7fca1c0693e0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:02.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:02.411+0000 7fca3d9c6700 1 --2- 172.21.15.146:0/1248227072 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca3813fbc0 0x7fca3813c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:02.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:02.411+0000 7fca3d9c6700 1 --2- 172.21.15.146:0/1248227072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca380afec0 0x7fca381652c0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:02.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:02.411+0000 7fca3d9c6700 1 --2- 172.21.15.146:0/1248227072 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca380c8710 0x7fca380c5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:02.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:02.411+0000 7fca3d9c6700 1 -- 172.21.15.146:0/1248227072 >> 172.21.15.146:0/1248227072 conn(0x7fca38069010 msgr2=0x7fca380b2920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:02.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:02.411+0000 7fca3d9c6700 1 -- 172.21.15.146:0/1248227072 shutdown_connections 2023-10-06T11:10:02.414 INFO:tasks.ceph.mds.d:Started 2023-10-06T11:10:02.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:02.412+0000 7fca3d9c6700 1 -- 172.21.15.146:0/1248227072 wait complete. 2023-10-06T11:10:02.415 DEBUG:teuthology.parallel:result is None 2023-10-06T11:10:02.415 INFO:teuthology.orchestra.run.smithi146.stderr:failed mds gid 6300 2023-10-06T11:10:02.421 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T11:10:02.421 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T11:10:02.424 INFO:tasks.ceph.mds.b:Started 2023-10-06T11:10:02.424 DEBUG:teuthology.parallel:result is None 2023-10-06T11:10:02.427 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T11:10:02.427 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T11:10:02.470 INFO:tasks.ceph.mds.a:Started 2023-10-06T11:10:02.470 DEBUG:teuthology.parallel:result is None 2023-10-06T11:10:02.494 INFO:tasks.ceph.mds.d.smithi151.stdout:starting mds.d at 2023-10-06T11:10:02.503 INFO:tasks.ceph.mds.b.smithi151.stdout:starting mds.b at 2023-10-06T11:10:02.542 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2023-10-06T11:10:03.393 INFO:tasks.ceph.mon.a.smithi146.stderr:2023-10-06T11:10:03.391+0000 7f011929c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T11:10:03.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.400+0000 7fb0c17fa700 1 -- 172.21.15.146:0/898673286 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 6297 v52) v1 ==== 95+0+0 (secure 0 0 0) 0x7fb0bc054e60 con 0x7fb0cc15dbe0 2023-10-06T11:10:03.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.403+0000 7fb0d2079700 1 -- 172.21.15.146:0/898673286 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb0b0067080 msgr2=0x7fb0b0069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:03.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.403+0000 7fb0d2079700 1 --2- 172.21.15.146:0/898673286 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb0b0067080 0x7fb0b0069530 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb0c80093f0 tx=0x7fb0c8017000 comp rx=0 tx=0).stop 2023-10-06T11:10:03.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.403+0000 7fb0d2079700 1 -- 172.21.15.146:0/898673286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0cc15dbe0 msgr2=0x7fb0cc13baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:03.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.403+0000 7fb0d2079700 1 --2- 172.21.15.146:0/898673286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0cc15dbe0 0x7fb0cc13baa0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc006d40 tx=0x7fb0bc009250 comp rx=0 tx=0).stop 2023-10-06T11:10:03.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.403+0000 7fb0d2079700 1 -- 172.21.15.146:0/898673286 shutdown_connections 2023-10-06T11:10:03.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.403+0000 7fb0d2079700 1 --2- 172.21.15.146:0/898673286 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb0b0067080 0x7fb0b0069530 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:03.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.403+0000 7fb0d2079700 1 --2- 172.21.15.146:0/898673286 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0cc161530 0x7fb0cc1649a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:03.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.403+0000 7fb0d2079700 1 --2- 172.21.15.146:0/898673286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0cc15d810 0x7fb0cc171f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:03.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.403+0000 7fb0d2079700 1 --2- 172.21.15.146:0/898673286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0cc15dbe0 0x7fb0cc13baa0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:03.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.403+0000 7fb0d2079700 1 -- 172.21.15.146:0/898673286 >> 172.21.15.146:0/898673286 conn(0x7fb0cc067ef0 msgr2=0x7fb0cc06e680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:03.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.403+0000 7fb0d2079700 1 -- 172.21.15.146:0/898673286 shutdown_connections 2023-10-06T11:10:03.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.403+0000 7fb0d2079700 1 -- 172.21.15.146:0/898673286 wait complete. 2023-10-06T11:10:03.406 INFO:teuthology.orchestra.run.smithi146.stderr:failed mds gid 6297 2023-10-06T11:10:03.422 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T11:10:03.423 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T11:10:03.465 INFO:tasks.ceph.mds.c:Started 2023-10-06T11:10:03.465 DEBUG:teuthology.parallel:result is None 2023-10-06T11:10:03.465 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:10:03.540 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2023-10-06T11:10:03.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.583+0000 7f6f6e72d700 1 Processor -- start 2023-10-06T11:10:03.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.583+0000 7f6f6e72d700 1 -- start start 2023-10-06T11:10:03.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.584+0000 7f6f6e72d700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6f680b2530 0x7f6f6815cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:03.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.584+0000 7f6f6e72d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f6815c630 con 0x7f6f6815a420 2023-10-06T11:10:03.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.584+0000 7f6f6e72d700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f6815ba20 con 0x7f6f6815a7f0 2023-10-06T11:10:03.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.584+0000 7f6f6e72d700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f680ce040 con 0x7f6f680b2530 2023-10-06T11:10:03.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.584+0000 7f6f6d72b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6f6815a420 0x7f6f680b1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60042/0 (socket says 172.21.15.146:60042) 2023-10-06T11:10:03.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.584+0000 7f6f6d72b700 1 -- 172.21.15.146:0/3050297911 learned_addr learned my addr 172.21.15.146:0/3050297911 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:10:03.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.584+0000 7f6f6df2c700 1 --2- 172.21.15.146:0/3050297911 >> v2:172.21.15.151:3300/0 conn(0x7f6f680b2530 0x7f6f6815cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:03.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.584+0000 7f6f5ffff700 1 -- 172.21.15.146:0/3050297911 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2510565792 0 0) 0x7f6f6815c630 con 0x7f6f6815a420 2023-10-06T11:10:03.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.584+0000 7f6f5ffff700 1 -- 172.21.15.146:0/3050297911 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f54003570 con 0x7f6f6815a420 2023-10-06T11:10:03.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.585+0000 7f6f6df2c700 1 -- 172.21.15.146:0/3050297911 >> v1:172.21.15.151:6789/0 conn(0x7f6f6815a7f0 legacy=0x7f6f6815acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:03.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.585+0000 7f6f5ffff700 1 -- 172.21.15.146:0/3050297911 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1431031016 0 0) 0x7f6f6815ba20 con 0x7f6f6815a7f0 2023-10-06T11:10:03.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.585+0000 7f6f6df2c700 1 -- 172.21.15.146:0/3050297911 >> v1:172.21.15.146:6789/0 conn(0x7f6f6815a420 legacy=0x7f6f680b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:03.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.585+0000 7f6f6df2c700 1 -- 172.21.15.146:0/3050297911 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f6815bd00 con 0x7f6f680b2530 2023-10-06T11:10:03.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.585+0000 7f6f6df2c700 1 --2- 172.21.15.146:0/3050297911 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f680b2530 0x7f6f6815cac0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6f60009e60 tx=0x7f6f60009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db8a3041aca72ac3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:03.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.585+0000 7f6f5ffff700 1 -- 172.21.15.146:0/3050297911 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6000e070 con 0x7f6f680b2530 2023-10-06T11:10:03.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.585+0000 7f6f5ffff700 1 -- 172.21.15.146:0/3050297911 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6000b850 con 0x7f6f680b2530 2023-10-06T11:10:03.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.585+0000 7f6f5ffff700 1 -- 172.21.15.146:0/3050297911 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f64001470 con 0x7f6f680b2530 2023-10-06T11:10:03.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.586+0000 7f6f6e72d700 1 -- 172.21.15.146:0/3050297911 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f680b2530 msgr2=0x7f6f6815cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:03.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.586+0000 7f6f6e72d700 1 --2- 172.21.15.146:0/3050297911 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f680b2530 0x7f6f6815cac0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6f60009e60 tx=0x7f6f60009780 comp rx=0 tx=0).stop 2023-10-06T11:10:03.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.586+0000 7f6f6e72d700 1 -- 172.21.15.146:0/3050297911 shutdown_connections 2023-10-06T11:10:03.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.586+0000 7f6f6e72d700 1 --2- 172.21.15.146:0/3050297911 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f680b2530 0x7f6f6815cac0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:03.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.586+0000 7f6f6e72d700 1 -- 172.21.15.146:0/3050297911 >> 172.21.15.146:0/3050297911 conn(0x7f6f6806eba0 msgr2=0x7f6f6806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:03.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.586+0000 7f6f6e72d700 1 -- 172.21.15.146:0/3050297911 shutdown_connections 2023-10-06T11:10:03.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.586+0000 7f6f6e72d700 1 -- 172.21.15.146:0/3050297911 wait complete. 2023-10-06T11:10:03.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.587+0000 7f6f6e72d700 1 Processor -- start 2023-10-06T11:10:03.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.587+0000 7f6f6e72d700 1 -- start start 2023-10-06T11:10:03.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.588+0000 7f6f6e72d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f680b2530 0x7f6f68154a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:03.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.588+0000 7f6f6e72d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f6815a420 0x7f6f6814d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:03.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.588+0000 7f6f6e72d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f6815a7f0 0x7f6f68159450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:03.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.588+0000 7f6f6e72d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f681583b0 con 0x7f6f6815a7f0 2023-10-06T11:10:03.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.588+0000 7f6f6e72d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f68158690 con 0x7f6f680b2530 2023-10-06T11:10:03.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.588+0000 7f6f6e72d700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f68158970 con 0x7f6f6815a420 2023-10-06T11:10:03.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.588+0000 7f6f6df2c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f6815a7f0 0x7f6f68159450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:03.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.588+0000 7f6f6df2c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f6815a7f0 0x7f6f68159450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43860/0 (socket says 172.21.15.146:43860) 2023-10-06T11:10:03.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.588+0000 7f6f6df2c700 1 -- 172.21.15.146:0/2869193337 learned_addr learned my addr 172.21.15.146:0/2869193337 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:03.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.588+0000 7f6f6d72b700 1 --2- 172.21.15.146:0/2869193337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f680b2530 0x7f6f68154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:03.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.588+0000 7f6f6cf2a700 1 --2- 172.21.15.146:0/2869193337 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f6815a420 0x7f6f6814d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:03.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.588+0000 7f6f6df2c700 1 -- 172.21.15.146:0/2869193337 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f6815a420 msgr2=0x7f6f6814d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:03.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.588+0000 7f6f6df2c700 1 --2- 172.21.15.146:0/2869193337 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f6815a420 0x7f6f6814d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:03.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.588+0000 7f6f6df2c700 1 -- 172.21.15.146:0/2869193337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f680b2530 msgr2=0x7f6f68154a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:03.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.588+0000 7f6f6df2c700 1 --2- 172.21.15.146:0/2869193337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f680b2530 0x7f6f68154a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:03.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.588+0000 7f6f6df2c700 1 -- 172.21.15.146:0/2869193337 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f60009a20 con 0x7f6f6815a7f0 2023-10-06T11:10:03.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.588+0000 7f6f6df2c700 1 --2- 172.21.15.146:0/2869193337 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f6815a7f0 0x7f6f68159450 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f6f600097c0 tx=0x7f6f60017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:03.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.588+0000 7f6f5d7fa700 1 -- 172.21.15.146:0/2869193337 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6001f410 con 0x7f6f6815a7f0 2023-10-06T11:10:03.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.588+0000 7f6f5d7fa700 1 -- 172.21.15.146:0/2869193337 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6001f5b0 con 0x7f6f6815a7f0 2023-10-06T11:10:03.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.588+0000 7f6f6e72d700 1 -- 172.21.15.146:0/2869193337 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f68158c50 con 0x7f6f6815a7f0 2023-10-06T11:10:03.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.588+0000 7f6f5d7fa700 1 -- 172.21.15.146:0/2869193337 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6001f970 con 0x7f6f6815a7f0 2023-10-06T11:10:03.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.589+0000 7f6f6e72d700 1 -- 172.21.15.146:0/2869193337 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f681580a0 con 0x7f6f6815a7f0 2023-10-06T11:10:03.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.590+0000 7f6f6e72d700 1 -- 172.21.15.146:0/2869193337 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f68159170 con 0x7f6f6815a7f0 2023-10-06T11:10:03.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.590+0000 7f6f5d7fa700 1 -- 172.21.15.146:0/2869193337 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6f600113b0 con 0x7f6f6815a7f0 2023-10-06T11:10:03.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.590+0000 7f6f5d7fa700 1 --2- 172.21.15.146:0/2869193337 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6f4c066f30 0x7f6f4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:03.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.590+0000 7f6f5d7fa700 1 -- 172.21.15.146:0/2869193337 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f6f60086900 con 0x7f6f6815a7f0 2023-10-06T11:10:03.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.590+0000 7f6f6d72b700 1 --2- 172.21.15.146:0/2869193337 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6f4c066f30 0x7f6f4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:03.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.591+0000 7f6f6d72b700 1 --2- 172.21.15.146:0/2869193337 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6f4c066f30 0x7f6f4c0693e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6f640015a0 tx=0x7f6f64000bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:03.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.595+0000 7f6f5d7fa700 1 -- 172.21.15.146:0/2869193337 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f68159170 con 0x7f6f6815a7f0 2023-10-06T11:10:03.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.819+0000 7f6f6e72d700 1 -- 172.21.15.146:0/2869193337 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f68159170 con 0x7f6f6815a7f0 2023-10-06T11:10:03.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.820+0000 7f6f5d7fa700 1 -- 172.21.15.146:0/2869193337 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+3851 (secure 0 0 0) 0x7f6f68159170 con 0x7f6f6815a7f0 2023-10-06T11:10:03.822 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:10:03.822 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":53,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5621,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/1872666923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1872666923},{"type":"v1","addr":"172.21.15.151:6833","nonce":1872666923}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":6082,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1430806818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1430806818},{"type":"v1","addr":"172.21.15.151:6835","nonce":1430806818}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:09:41.580951+0000","modified":"2023-10-06T11:10:03.398193+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":63,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6540},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6540":{"gid":6540,"name":"a","rank":0,"incarnation":53,"state":"up:replay","state_seq":1,"addr":"172.21.15.146:6835/3512281867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3512281867},{"type":"v1","addr":"172.21.15.146:6835","nonce":3512281867}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T11:10:03.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.822+0000 7f6f6e72d700 1 -- 172.21.15.146:0/2869193337 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6f4c066f30 msgr2=0x7f6f4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:03.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.822+0000 7f6f6e72d700 1 --2- 172.21.15.146:0/2869193337 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6f4c066f30 0x7f6f4c0693e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6f640015a0 tx=0x7f6f64000bc0 comp rx=0 tx=0).stop 2023-10-06T11:10:03.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.822+0000 7f6f6e72d700 1 -- 172.21.15.146:0/2869193337 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f6815a7f0 msgr2=0x7f6f68159450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:03.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.822+0000 7f6f6e72d700 1 --2- 172.21.15.146:0/2869193337 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f6815a7f0 0x7f6f68159450 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f6f600097c0 tx=0x7f6f60017000 comp rx=0 tx=0).stop 2023-10-06T11:10:03.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.822+0000 7f6f6e72d700 1 -- 172.21.15.146:0/2869193337 shutdown_connections 2023-10-06T11:10:03.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.822+0000 7f6f6e72d700 1 --2- 172.21.15.146:0/2869193337 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6f4c066f30 0x7f6f4c0693e0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:03.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.822+0000 7f6f6e72d700 1 --2- 172.21.15.146:0/2869193337 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f6815a7f0 0x7f6f68159450 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:03.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.822+0000 7f6f6e72d700 1 --2- 172.21.15.146:0/2869193337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f680b2530 0x7f6f68154a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:03.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.822+0000 7f6f6e72d700 1 --2- 172.21.15.146:0/2869193337 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f6815a420 0x7f6f6814d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:03.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.822+0000 7f6f6e72d700 1 -- 172.21.15.146:0/2869193337 >> 172.21.15.146:0/2869193337 conn(0x7f6f6806eba0 msgr2=0x7f6f6806ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:03.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.822+0000 7f6f6e72d700 1 -- 172.21.15.146:0/2869193337 shutdown_connections 2023-10-06T11:10:03.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:03.822+0000 7f6f6e72d700 1 -- 172.21.15.146:0/2869193337 wait complete. 2023-10-06T11:10:03.825 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 53 2023-10-06T11:10:04.238 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 53, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T11:09:41.580951+0000', 'modified': '2023-10-06T11:10:03.398193+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 63, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6540}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6540': {'gid': 6540, 'name': 'a', 'rank': 0, 'incarnation': 53, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.146:6835/3512281867', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6834', 'nonce': 3512281867}, {'type': 'v1', 'addr': '172.21.15.146:6835', 'nonce': 3512281867}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T11:10:04.238 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6540:up:replay 2023-10-06T11:10:05.240 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:10:05.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.359+0000 7f7b08635700 1 Processor -- start 2023-10-06T11:10:05.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.359+0000 7f7b08635700 1 -- start start 2023-10-06T11:10:05.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.360+0000 7f7b08635700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7b000a6e00 0x7f7b000b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:05.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.360+0000 7f7b08635700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b000ac720 con 0x7f7b0006f090 2023-10-06T11:10:05.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.360+0000 7f7b08635700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b000b0610 con 0x7f7b0006f460 2023-10-06T11:10:05.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.360+0000 7f7b08635700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b001562b0 con 0x7f7b000a6e00 2023-10-06T11:10:05.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.360+0000 7f7b06bd2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7b000a6e00 0x7f7b000b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:05.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.360+0000 7f7b063d1700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7b0006f090 0x7f7b000aff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60046/0 (socket says 172.21.15.146:60046) 2023-10-06T11:10:05.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.361+0000 7f7b063d1700 1 -- 172.21.15.146:0/1040027198 learned_addr learned my addr 172.21.15.146:0/1040027198 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:10:05.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.361+0000 7f7b06bd2700 1 -- 172.21.15.146:0/1040027198 >> v1:172.21.15.151:6789/0 conn(0x7f7b0006f460 legacy=0x7f7b000a66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:05.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.361+0000 7f7b06bd2700 1 -- 172.21.15.146:0/1040027198 >> v1:172.21.15.146:6789/0 conn(0x7f7b0006f090 legacy=0x7f7b000aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:05.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.361+0000 7f7b06bd2700 1 -- 172.21.15.146:0/1040027198 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b000abb80 con 0x7f7b000a6e00 2023-10-06T11:10:05.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.361+0000 7f7b053cf700 1 -- 172.21.15.146:0/1040027198 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3094669728 0 0) 0x7f7b000ac720 con 0x7f7b0006f090 2023-10-06T11:10:05.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.361+0000 7f7b06bd2700 1 --2- 172.21.15.146:0/1040027198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b000a6e00 0x7f7b000b1a40 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f7af8009e60 tx=0x7f7af8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dada47b8f5cfd774 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:05.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.361+0000 7f7b053cf700 1 -- 172.21.15.146:0/1040027198 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af800e070 con 0x7f7b000a6e00 2023-10-06T11:10:05.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.361+0000 7f7b053cf700 1 -- 172.21.15.146:0/1040027198 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af800bcc0 con 0x7f7b000a6e00 2023-10-06T11:10:05.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.361+0000 7f7b053cf700 1 -- 172.21.15.146:0/1040027198 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af8012680 con 0x7f7b000a6e00 2023-10-06T11:10:05.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.362+0000 7f7b08635700 1 -- 172.21.15.146:0/1040027198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b000a6e00 msgr2=0x7f7b000b1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:05.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.362+0000 7f7b08635700 1 --2- 172.21.15.146:0/1040027198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b000a6e00 0x7f7b000b1a40 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f7af8009e60 tx=0x7f7af8009780 comp rx=0 tx=0).stop 2023-10-06T11:10:05.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.362+0000 7f7b08635700 1 -- 172.21.15.146:0/1040027198 shutdown_connections 2023-10-06T11:10:05.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.362+0000 7f7b08635700 1 --2- 172.21.15.146:0/1040027198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b000a6e00 0x7f7b000b1a40 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:05.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.362+0000 7f7b08635700 1 -- 172.21.15.146:0/1040027198 >> 172.21.15.146:0/1040027198 conn(0x7f7b000cc260 msgr2=0x7f7b000cc660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:05.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.362+0000 7f7b08635700 1 -- 172.21.15.146:0/1040027198 shutdown_connections 2023-10-06T11:10:05.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.362+0000 7f7b08635700 1 -- 172.21.15.146:0/1040027198 wait complete. 2023-10-06T11:10:05.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.363+0000 7f7b08635700 1 Processor -- start 2023-10-06T11:10:05.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.363+0000 7f7b08635700 1 -- start start 2023-10-06T11:10:05.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.364+0000 7f7b08635700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b0006f090 0x7f7b000aa9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:05.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.364+0000 7f7b08635700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b0006f460 0x7f7b000ad4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:05.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.364+0000 7f7b08635700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b000a6e00 0x7f7b000ad9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:05.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.364+0000 7f7b08635700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b00153fb0 con 0x7f7b000a6e00 2023-10-06T11:10:05.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.364+0000 7f7b08635700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b000a72a0 con 0x7f7b0006f460 2023-10-06T11:10:05.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.364+0000 7f7b08635700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b000a7de0 con 0x7f7b0006f090 2023-10-06T11:10:05.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.364+0000 7f7b06bd2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b000a6e00 0x7f7b000ad9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:05.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.364+0000 7f7b06bd2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b000a6e00 0x7f7b000ad9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43872/0 (socket says 172.21.15.146:43872) 2023-10-06T11:10:05.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.364+0000 7f7b06bd2700 1 -- 172.21.15.146:0/1604493190 learned_addr learned my addr 172.21.15.146:0/1604493190 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:05.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.364+0000 7f7b05bd0700 1 --2- 172.21.15.146:0/1604493190 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b0006f460 0x7f7b000ad4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:05.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.364+0000 7f7b063d1700 1 --2- 172.21.15.146:0/1604493190 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b0006f090 0x7f7b000aa9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:05.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.364+0000 7f7b06bd2700 1 -- 172.21.15.146:0/1604493190 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b0006f090 msgr2=0x7f7b000aa9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:05.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.364+0000 7f7b06bd2700 1 --2- 172.21.15.146:0/1604493190 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b0006f090 0x7f7b000aa9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:05.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.364+0000 7f7b06bd2700 1 -- 172.21.15.146:0/1604493190 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b0006f460 msgr2=0x7f7b000ad4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:05.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.364+0000 7f7b06bd2700 1 --2- 172.21.15.146:0/1604493190 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b0006f460 0x7f7b000ad4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:05.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.364+0000 7f7b06bd2700 1 -- 172.21.15.146:0/1604493190 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af8009a20 con 0x7f7b000a6e00 2023-10-06T11:10:05.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.364+0000 7f7b06bd2700 1 --2- 172.21.15.146:0/1604493190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b000a6e00 0x7f7b000ad9f0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f7af80099f0 tx=0x7f7af8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:05.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.364+0000 7f7af67fc700 1 -- 172.21.15.146:0/1604493190 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af800bed0 con 0x7f7b000a6e00 2023-10-06T11:10:05.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.364+0000 7f7af67fc700 1 -- 172.21.15.146:0/1604493190 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7af801b630 con 0x7f7b000a6e00 2023-10-06T11:10:05.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.364+0000 7f7b08635700 1 -- 172.21.15.146:0/1604493190 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b000aaf10 con 0x7f7b000a6e00 2023-10-06T11:10:05.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.364+0000 7f7af67fc700 1 -- 172.21.15.146:0/1604493190 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7af801b9f0 con 0x7f7b000a6e00 2023-10-06T11:10:05.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.364+0000 7f7b08635700 1 -- 172.21.15.146:0/1604493190 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b000a7790 con 0x7f7b000a6e00 2023-10-06T11:10:05.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.365+0000 7f7b08635700 1 -- 172.21.15.146:0/1604493190 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b0004c380 con 0x7f7b000a6e00 2023-10-06T11:10:05.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.366+0000 7f7af67fc700 1 -- 172.21.15.146:0/1604493190 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7af801c400 con 0x7f7b000a6e00 2023-10-06T11:10:05.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.366+0000 7f7af67fc700 1 --2- 172.21.15.146:0/1604493190 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7ae4066f30 0x7f7ae40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:05.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.366+0000 7f7b063d1700 1 --2- 172.21.15.146:0/1604493190 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7ae4066f30 0x7f7ae40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:05.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.366+0000 7f7af67fc700 1 -- 172.21.15.146:0/1604493190 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f7af8086500 con 0x7f7b000a6e00 2023-10-06T11:10:05.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.367+0000 7f7b063d1700 1 --2- 172.21.15.146:0/1604493190 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7ae4066f30 0x7f7ae40693e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7afc007fd0 tx=0x7f7afc007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:05.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.371+0000 7f7af67fc700 1 -- 172.21.15.146:0/1604493190 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7af8053610 con 0x7f7b000a6e00 2023-10-06T11:10:05.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.598+0000 7f7b08635700 1 -- 172.21.15.146:0/1604493190 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7b000a7f20 con 0x7f7b000a6e00 2023-10-06T11:10:05.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.598+0000 7f7af67fc700 1 -- 172.21.15.146:0/1604493190 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4611 (secure 0 0 0) 0x7f7af8056c30 con 0x7f7b000a6e00 2023-10-06T11:10:05.600 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:10:05.600 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":55,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5621,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/1872666923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1872666923},{"type":"v1","addr":"172.21.15.151:6833","nonce":1872666923}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":6082,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1430806818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1430806818},{"type":"v1","addr":"172.21.15.151:6835","nonce":1430806818}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":6546,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/1394956500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":1394956500},{"type":"v1","addr":"172.21.15.146:6837","nonce":1394956500}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:09:41.580951+0000","modified":"2023-10-06T11:10:05.411694+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":63,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6540},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6540":{"gid":6540,"name":"a","rank":0,"incarnation":53,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.146:6835/3512281867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3512281867},{"type":"v1","addr":"172.21.15.146:6835","nonce":3512281867}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T11:10:05.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.600+0000 7f7b08635700 1 -- 172.21.15.146:0/1604493190 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7ae4066f30 msgr2=0x7f7ae40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:05.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.600+0000 7f7b08635700 1 --2- 172.21.15.146:0/1604493190 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7ae4066f30 0x7f7ae40693e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7afc007fd0 tx=0x7f7afc007d30 comp rx=0 tx=0).stop 2023-10-06T11:10:05.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.600+0000 7f7b08635700 1 -- 172.21.15.146:0/1604493190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b000a6e00 msgr2=0x7f7b000ad9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:05.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.600+0000 7f7b08635700 1 --2- 172.21.15.146:0/1604493190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b000a6e00 0x7f7b000ad9f0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f7af80099f0 tx=0x7f7af8019000 comp rx=0 tx=0).stop 2023-10-06T11:10:05.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.600+0000 7f7b08635700 1 -- 172.21.15.146:0/1604493190 shutdown_connections 2023-10-06T11:10:05.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.600+0000 7f7b08635700 1 --2- 172.21.15.146:0/1604493190 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7ae4066f30 0x7f7ae40693e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:05.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.600+0000 7f7b08635700 1 --2- 172.21.15.146:0/1604493190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7b000a6e00 0x7f7b000ad9f0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:05.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.600+0000 7f7b08635700 1 --2- 172.21.15.146:0/1604493190 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b0006f090 0x7f7b000aa9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:05.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.600+0000 7f7b08635700 1 --2- 172.21.15.146:0/1604493190 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b0006f460 0x7f7b000ad4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:05.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.600+0000 7f7b08635700 1 -- 172.21.15.146:0/1604493190 >> 172.21.15.146:0/1604493190 conn(0x7f7b000cc260 msgr2=0x7f7b001563f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:05.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.600+0000 7f7b08635700 1 -- 172.21.15.146:0/1604493190 shutdown_connections 2023-10-06T11:10:05.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:05.600+0000 7f7b08635700 1 -- 172.21.15.146:0/1604493190 wait complete. 2023-10-06T11:10:05.603 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 55 2023-10-06T11:10:06.016 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 55, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T11:09:41.580951+0000', 'modified': '2023-10-06T11:10:05.411694+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 63, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6540}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6540': {'gid': 6540, 'name': 'a', 'rank': 0, 'incarnation': 53, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.146:6835/3512281867', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6834', 'nonce': 3512281867}, {'type': 'v1', 'addr': '172.21.15.146:6835', 'nonce': 3512281867}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T11:10:06.016 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6540:up:rejoin 2023-10-06T11:10:07.018 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:10:07.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.134+0000 7f843ce45700 1 Processor -- start 2023-10-06T11:10:07.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.134+0000 7f843ce45700 1 -- start start 2023-10-06T11:10:07.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.135+0000 7f843ce45700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f843815a420 0x7f843815cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:07.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.135+0000 7f843ce45700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f843815a7f0 0x7f84380b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:07.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.135+0000 7f843ce45700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f84380b2360 0x7f843815acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:07.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.135+0000 7f843ce45700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84380ce040 con 0x7f84380b2360 2023-10-06T11:10:07.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.135+0000 7f843ce45700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84380b27e0 con 0x7f843815a420 2023-10-06T11:10:07.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.135+0000 7f843ce45700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f843815c630 con 0x7f843815a7f0 2023-10-06T11:10:07.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.135+0000 7f8437fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f84380b2360 0x7f843815acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:07.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.135+0000 7f8437fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f84380b2360 0x7f843815acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43884/0 (socket says 172.21.15.146:43884) 2023-10-06T11:10:07.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.135+0000 7f8437fff700 1 -- 172.21.15.146:0/438881330 learned_addr learned my addr 172.21.15.146:0/438881330 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:07.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.135+0000 7f8436ffd700 1 --2- 172.21.15.146:0/438881330 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f843815a7f0 0x7f84380b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:07.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.135+0000 7f84377fe700 1 --2- 172.21.15.146:0/438881330 >> v2:172.21.15.151:3300/0 conn(0x7f843815a420 0x7f843815cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:07.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.135+0000 7f8437fff700 1 -- 172.21.15.146:0/438881330 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f843815a7f0 msgr2=0x7f84380b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:07.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.135+0000 7f8437fff700 1 --2- 172.21.15.146:0/438881330 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f843815a7f0 0x7f84380b1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:07.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.135+0000 7f8437fff700 1 -- 172.21.15.146:0/438881330 >> v2:172.21.15.151:3300/0 conn(0x7f843815a420 msgr2=0x7f843815cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:07.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.135+0000 7f8437fff700 1 --2- 172.21.15.146:0/438881330 >> v2:172.21.15.151:3300/0 conn(0x7f843815a420 0x7f843815cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:07.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.135+0000 7f8437fff700 1 -- 172.21.15.146:0/438881330 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843815ba20 con 0x7f84380b2360 2023-10-06T11:10:07.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.136+0000 7f8437fff700 1 --2- 172.21.15.146:0/438881330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84380b2360 0x7f843815acd0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f84380d1460 tx=0x7f8430009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a0a4d376c7e66f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:07.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.136+0000 7f84367fc700 1 -- 172.21.15.146:0/438881330 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843000e070 con 0x7f84380b2360 2023-10-06T11:10:07.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.136+0000 7f84367fc700 1 -- 172.21.15.146:0/438881330 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f843000ba40 con 0x7f84380b2360 2023-10-06T11:10:07.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.136+0000 7f84367fc700 1 -- 172.21.15.146:0/438881330 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84300092e0 con 0x7f84380b2360 2023-10-06T11:10:07.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.136+0000 7f843ce45700 1 -- 172.21.15.146:0/438881330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84380b2360 msgr2=0x7f843815acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:07.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.136+0000 7f843ce45700 1 --2- 172.21.15.146:0/438881330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84380b2360 0x7f843815acd0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f84380d1460 tx=0x7f8430009840 comp rx=0 tx=0).stop 2023-10-06T11:10:07.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.136+0000 7f843ce45700 1 -- 172.21.15.146:0/438881330 shutdown_connections 2023-10-06T11:10:07.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.136+0000 7f843ce45700 1 --2- 172.21.15.146:0/438881330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f84380b2360 0x7f843815acd0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:07.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.136+0000 7f843ce45700 1 --2- 172.21.15.146:0/438881330 >> v2:172.21.15.151:3300/0 conn(0x7f843815a420 0x7f843815cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:07.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.136+0000 7f843ce45700 1 --2- 172.21.15.146:0/438881330 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f843815a7f0 0x7f84380b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:07.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.136+0000 7f843ce45700 1 -- 172.21.15.146:0/438881330 >> 172.21.15.146:0/438881330 conn(0x7f843806eba0 msgr2=0x7f843806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:07.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.136+0000 7f843ce45700 1 -- 172.21.15.146:0/438881330 shutdown_connections 2023-10-06T11:10:07.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.136+0000 7f843ce45700 1 -- 172.21.15.146:0/438881330 wait complete. 2023-10-06T11:10:07.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.138+0000 7f843ce45700 1 Processor -- start 2023-10-06T11:10:07.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.138+0000 7f843ce45700 1 -- start start 2023-10-06T11:10:07.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.138+0000 7f843ce45700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84380b2360 0x7f84380b14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:07.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.138+0000 7f843ce45700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f843815a420 0x7f84380afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:07.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.138+0000 7f843ce45700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f843815a7f0 0x7f843814e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:07.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.138+0000 7f843ce45700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84381451d0 con 0x7f843815a7f0 2023-10-06T11:10:07.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.138+0000 7f843ce45700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84380b0230 con 0x7f843815a420 2023-10-06T11:10:07.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.138+0000 7f843ce45700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84380b0500 con 0x7f84380b2360 2023-10-06T11:10:07.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.138+0000 7f8437fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f843815a7f0 0x7f843814e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:07.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.138+0000 7f8437fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f843815a7f0 0x7f843814e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43900/0 (socket says 172.21.15.146:43900) 2023-10-06T11:10:07.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.138+0000 7f8437fff700 1 -- 172.21.15.146:0/3158513468 learned_addr learned my addr 172.21.15.146:0/3158513468 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:07.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.139+0000 7f8436ffd700 1 --2- 172.21.15.146:0/3158513468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f843815a420 0x7f84380afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:07.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.139+0000 7f84377fe700 1 --2- 172.21.15.146:0/3158513468 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84380b2360 0x7f84380b14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:07.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.139+0000 7f8437fff700 1 -- 172.21.15.146:0/3158513468 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84380b2360 msgr2=0x7f84380b14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:07.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.139+0000 7f8437fff700 1 --2- 172.21.15.146:0/3158513468 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84380b2360 0x7f84380b14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:07.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.139+0000 7f8437fff700 1 -- 172.21.15.146:0/3158513468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f843815a420 msgr2=0x7f84380afcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:07.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.139+0000 7f8437fff700 1 --2- 172.21.15.146:0/3158513468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f843815a420 0x7f84380afcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:07.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.139+0000 7f8437fff700 1 -- 172.21.15.146:0/3158513468 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8430009ae0 con 0x7f843815a7f0 2023-10-06T11:10:07.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.139+0000 7f8437fff700 1 --2- 172.21.15.146:0/3158513468 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f843815a7f0 0x7f843814e390 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f8438088e40 tx=0x7f8430018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:07.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.139+0000 7f841f7fe700 1 -- 172.21.15.146:0/3158513468 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84300032f0 con 0x7f843815a7f0 2023-10-06T11:10:07.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.139+0000 7f841f7fe700 1 -- 172.21.15.146:0/3158513468 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8430008ce0 con 0x7f843815a7f0 2023-10-06T11:10:07.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.139+0000 7f841f7fe700 1 -- 172.21.15.146:0/3158513468 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84300266b0 con 0x7f843815a7f0 2023-10-06T11:10:07.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.139+0000 7f843ce45700 1 -- 172.21.15.146:0/3158513468 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84380b07e0 con 0x7f843815a7f0 2023-10-06T11:10:07.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.139+0000 7f843ce45700 1 -- 172.21.15.146:0/3158513468 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8438145470 con 0x7f843815a7f0 2023-10-06T11:10:07.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.140+0000 7f843ce45700 1 -- 172.21.15.146:0/3158513468 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84380afae0 con 0x7f843815a7f0 2023-10-06T11:10:07.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.140+0000 7f841f7fe700 1 -- 172.21.15.146:0/3158513468 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8430003040 con 0x7f843815a7f0 2023-10-06T11:10:07.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.141+0000 7f841f7fe700 1 --2- 172.21.15.146:0/3158513468 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8424066f30 0x7f84240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:07.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.141+0000 7f841f7fe700 1 -- 172.21.15.146:0/3158513468 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f84300860c0 con 0x7f843815a7f0 2023-10-06T11:10:07.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.141+0000 7f84377fe700 1 --2- 172.21.15.146:0/3158513468 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8424066f30 0x7f84240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:07.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.141+0000 7f84377fe700 1 --2- 172.21.15.146:0/3158513468 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8424066f30 0x7f84240693e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8428006fd0 tx=0x7f8428008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:07.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.145+0000 7f841f7fe700 1 -- 172.21.15.146:0/3158513468 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8430053120 con 0x7f843815a7f0 2023-10-06T11:10:07.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.375+0000 7f843ce45700 1 -- 172.21.15.146:0/3158513468 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f843815bd00 con 0x7f843815a7f0 2023-10-06T11:10:07.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.375+0000 7f841f7fe700 1 -- 172.21.15.146:0/3158513468 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4611 (secure 0 0 0) 0x7f8430056740 con 0x7f843815a7f0 2023-10-06T11:10:07.377 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:10:07.377 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":56,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5621,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/1872666923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1872666923},{"type":"v1","addr":"172.21.15.151:6833","nonce":1872666923}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":6082,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1430806818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1430806818},{"type":"v1","addr":"172.21.15.151:6835","nonce":1430806818}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":6546,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/1394956500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":1394956500},{"type":"v1","addr":"172.21.15.146:6837","nonce":1394956500}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:09:41.580951+0000","modified":"2023-10-06T11:10:06.415726+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":63,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6540},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6540":{"gid":6540,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6835/3512281867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3512281867},{"type":"v1","addr":"172.21.15.146:6835","nonce":3512281867}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T11:10:07.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.377+0000 7f843ce45700 1 -- 172.21.15.146:0/3158513468 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8424066f30 msgr2=0x7f84240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:07.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.377+0000 7f843ce45700 1 --2- 172.21.15.146:0/3158513468 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8424066f30 0x7f84240693e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8428006fd0 tx=0x7f8428008040 comp rx=0 tx=0).stop 2023-10-06T11:10:07.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.377+0000 7f843ce45700 1 -- 172.21.15.146:0/3158513468 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f843815a7f0 msgr2=0x7f843814e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:07.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.377+0000 7f843ce45700 1 --2- 172.21.15.146:0/3158513468 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f843815a7f0 0x7f843814e390 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f8438088e40 tx=0x7f8430018000 comp rx=0 tx=0).stop 2023-10-06T11:10:07.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.377+0000 7f843ce45700 1 -- 172.21.15.146:0/3158513468 shutdown_connections 2023-10-06T11:10:07.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.377+0000 7f843ce45700 1 --2- 172.21.15.146:0/3158513468 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8424066f30 0x7f84240693e0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:07.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.377+0000 7f843ce45700 1 --2- 172.21.15.146:0/3158513468 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f843815a7f0 0x7f843814e390 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:07.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.377+0000 7f843ce45700 1 --2- 172.21.15.146:0/3158513468 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f84380b2360 0x7f84380b14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:07.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.377+0000 7f843ce45700 1 --2- 172.21.15.146:0/3158513468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f843815a420 0x7f84380afcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:07.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.377+0000 7f843ce45700 1 -- 172.21.15.146:0/3158513468 >> 172.21.15.146:0/3158513468 conn(0x7f843806eba0 msgr2=0x7f84380cf180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:07.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.377+0000 7f843ce45700 1 -- 172.21.15.146:0/3158513468 shutdown_connections 2023-10-06T11:10:07.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.377+0000 7f843ce45700 1 -- 172.21.15.146:0/3158513468 wait complete. 2023-10-06T11:10:07.381 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 56 2023-10-06T11:10:07.794 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 56, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T11:09:41.580951+0000', 'modified': '2023-10-06T11:10:06.415726+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 63, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6540}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6540': {'gid': 6540, 'name': 'a', 'rank': 0, 'incarnation': 53, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.146:6835/3512281867', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6834', 'nonce': 3512281867}, {'type': 'v1', 'addr': '172.21.15.146:6835', 'nonce': 3512281867}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T11:10:07.794 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T11:10:07.795 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T11:10:07.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.909+0000 7fec3407d700 1 Processor -- start 2023-10-06T11:10:07.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.909+0000 7fec3407d700 1 -- start start 2023-10-06T11:10:07.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.910+0000 7fec3407d700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fec2c0b1a00 0x7fec2c162310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:07.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.910+0000 7fec3407d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec2c0aeb80 con 0x7fec2c1574b0 2023-10-06T11:10:07.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.910+0000 7fec3407d700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec2c0cbcf0 con 0x7fec2c157880 2023-10-06T11:10:07.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.910+0000 7fec3407d700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec2c0cb170 con 0x7fec2c0b1a00 2023-10-06T11:10:07.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.910+0000 7fec31e19700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fec2c1574b0 0x7fec2c0ae470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60062/0 (socket says 172.21.15.146:60062) 2023-10-06T11:10:07.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.910+0000 7fec31e19700 1 -- 172.21.15.146:0/3488591192 learned_addr learned my addr 172.21.15.146:0/3488591192 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:10:07.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.910+0000 7fec3261a700 1 --2- 172.21.15.146:0/3488591192 >> v2:172.21.15.151:3300/0 conn(0x7fec2c0b1a00 0x7fec2c162310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:07.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.911+0000 7fec30e17700 1 -- 172.21.15.146:0/3488591192 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3209950237 0 0) 0x7fec2c0aeb80 con 0x7fec2c1574b0 2023-10-06T11:10:07.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.911+0000 7fec30e17700 1 -- 172.21.15.146:0/3488591192 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec18003570 con 0x7fec2c1574b0 2023-10-06T11:10:07.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.911+0000 7fec30e17700 1 -- 172.21.15.146:0/3488591192 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1674102402 0 0) 0x7fec18003570 con 0x7fec2c1574b0 2023-10-06T11:10:07.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.911+0000 7fec30e17700 1 -- 172.21.15.146:0/3488591192 >> v2:172.21.15.151:3300/0 conn(0x7fec2c0b1a00 msgr2=0x7fec2c162310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:07.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.911+0000 7fec30e17700 1 --2- 172.21.15.146:0/3488591192 >> v2:172.21.15.151:3300/0 conn(0x7fec2c0b1a00 0x7fec2c162310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:07.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.911+0000 7fec30e17700 1 -- 172.21.15.146:0/3488591192 >> v1:172.21.15.151:6789/0 conn(0x7fec2c157880 legacy=0x7fec2c0b12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:07.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.911+0000 7fec30e17700 1 -- 172.21.15.146:0/3488591192 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec2c0cb450 con 0x7fec2c1574b0 2023-10-06T11:10:07.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.911+0000 7fec30e17700 1 -- 172.21.15.146:0/3488591192 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fec280017f0 con 0x7fec2c1574b0 2023-10-06T11:10:07.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.911+0000 7fec30e17700 1 -- 172.21.15.146:0/3488591192 >> v1:172.21.15.146:6789/0 conn(0x7fec2c1574b0 legacy=0x7fec2c0ae470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:07.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.911+0000 7fec30e17700 1 --2- 172.21.15.146:0/3488591192 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec18003a60 0x7fec18003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:07.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.911+0000 7fec30e17700 1 --2- 172.21.15.146:0/3488591192 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec18004810 0x7fec18004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:07.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.911+0000 7fec30e17700 1 --2- 172.21.15.146:0/3488591192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec180051c0 0x7fec1800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:07.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.911+0000 7fec30e17700 1 -- 172.21.15.146:0/3488591192 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c0cb170 con 0x7fec180051c0 2023-10-06T11:10:07.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.911+0000 7fec30e17700 1 -- 172.21.15.146:0/3488591192 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1800c160 con 0x7fec18004810 2023-10-06T11:10:07.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.911+0000 7fec30e17700 1 -- 172.21.15.146:0/3488591192 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1800c320 con 0x7fec18003a60 2023-10-06T11:10:07.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.911+0000 7fec3261a700 1 --2- 172.21.15.146:0/3488591192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec180051c0 0x7fec1800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:07.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.911+0000 7fec31618700 1 --2- 172.21.15.146:0/3488591192 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec18004810 0x7fec18004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:07.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.911+0000 7fec31e19700 1 --2- 172.21.15.146:0/3488591192 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec18003a60 0x7fec18003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:07.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.911+0000 7fec3261a700 1 -- 172.21.15.146:0/3488591192 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec18003a60 msgr2=0x7fec18003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:07.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.911+0000 7fec3261a700 1 --2- 172.21.15.146:0/3488591192 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec18003a60 0x7fec18003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:07.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.911+0000 7fec3261a700 1 -- 172.21.15.146:0/3488591192 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec18004810 msgr2=0x7fec18004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:07.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.911+0000 7fec3261a700 1 --2- 172.21.15.146:0/3488591192 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec18004810 0x7fec18004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:07.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.911+0000 7fec3261a700 1 -- 172.21.15.146:0/3488591192 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec18003570 con 0x7fec180051c0 2023-10-06T11:10:07.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.911+0000 7fec3261a700 1 -- 172.21.15.146:0/3488591192 reap_dead start 2023-10-06T11:10:07.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.911+0000 7fec3261a700 1 --2- 172.21.15.146:0/3488591192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec180051c0 0x7fec1800ba60 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fec2c0b1e00 tx=0x7fec240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de830c9d615c84f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:07.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.912+0000 7fec30e17700 1 -- 172.21.15.146:0/3488591192 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2400e710 con 0x7fec180051c0 2023-10-06T11:10:07.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.912+0000 7fec30e17700 1 -- 172.21.15.146:0/3488591192 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec2400e890 con 0x7fec180051c0 2023-10-06T11:10:07.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.912+0000 7fec30e17700 1 -- 172.21.15.146:0/3488591192 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2400ec50 con 0x7fec180051c0 2023-10-06T11:10:07.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.912+0000 7fec3407d700 1 -- 172.21.15.146:0/3488591192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec180051c0 msgr2=0x7fec1800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:07.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.912+0000 7fec3407d700 1 --2- 172.21.15.146:0/3488591192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec180051c0 0x7fec1800ba60 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fec2c0b1e00 tx=0x7fec240091a0 comp rx=0 tx=0).stop 2023-10-06T11:10:07.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.912+0000 7fec3407d700 1 -- 172.21.15.146:0/3488591192 shutdown_connections 2023-10-06T11:10:07.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.912+0000 7fec3407d700 1 --2- 172.21.15.146:0/3488591192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec180051c0 0x7fec1800ba60 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:07.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.912+0000 7fec3407d700 1 -- 172.21.15.146:0/3488591192 >> 172.21.15.146:0/3488591192 conn(0x7fec2c06a070 msgr2=0x7fec2c067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:07.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.912+0000 7fec3407d700 1 -- 172.21.15.146:0/3488591192 shutdown_connections 2023-10-06T11:10:07.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.912+0000 7fec3407d700 1 -- 172.21.15.146:0/3488591192 wait complete. 2023-10-06T11:10:07.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.913+0000 7fec3407d700 1 Processor -- start 2023-10-06T11:10:07.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.913+0000 7fec3407d700 1 -- start start 2023-10-06T11:10:07.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.914+0000 7fec3407d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec180051c0 0x7fec2c138750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:07.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.914+0000 7fec3407d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec2c155db0 0x7fec2c156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:07.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.914+0000 7fec3407d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec2c0af560 0x7fec2c0af9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:07.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.914+0000 7fec3407d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c158520 con 0x7fec2c155db0 2023-10-06T11:10:07.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.914+0000 7fec3407d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c156760 con 0x7fec2c0af560 2023-10-06T11:10:07.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.914+0000 7fec3407d700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c138fc0 con 0x7fec180051c0 2023-10-06T11:10:07.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.914+0000 7fec31618700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec2c155db0 0x7fec2c156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:07.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.914+0000 7fec31618700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec2c155db0 0x7fec2c156220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43908/0 (socket says 172.21.15.146:43908) 2023-10-06T11:10:07.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.914+0000 7fec31618700 1 -- 172.21.15.146:0/1625069476 learned_addr learned my addr 172.21.15.146:0/1625069476 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:07.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.914+0000 7fec31e19700 1 --2- 172.21.15.146:0/1625069476 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec180051c0 0x7fec2c138750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:07.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.914+0000 7fec3261a700 1 --2- 172.21.15.146:0/1625069476 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec2c0af560 0x7fec2c0af9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:07.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.914+0000 7fec31618700 1 -- 172.21.15.146:0/1625069476 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec180051c0 msgr2=0x7fec2c138750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:07.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.914+0000 7fec31618700 1 --2- 172.21.15.146:0/1625069476 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec180051c0 0x7fec2c138750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:07.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.914+0000 7fec31618700 1 -- 172.21.15.146:0/1625069476 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec2c0af560 msgr2=0x7fec2c0af9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:07.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.914+0000 7fec31618700 1 --2- 172.21.15.146:0/1625069476 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec2c0af560 0x7fec2c0af9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:07.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.915+0000 7fec31618700 1 -- 172.21.15.146:0/1625069476 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec2c1392a0 con 0x7fec2c155db0 2023-10-06T11:10:07.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.915+0000 7fec31618700 1 --2- 172.21.15.146:0/1625069476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec2c155db0 0x7fec2c156220 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fec1c002980 tx=0x7fec1c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:07.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.915+0000 7fec21ffb700 1 -- 172.21.15.146:0/1625069476 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1c00f8d0 con 0x7fec2c155db0 2023-10-06T11:10:07.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.915+0000 7fec21ffb700 1 -- 172.21.15.146:0/1625069476 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec1c00fa30 con 0x7fec2c155db0 2023-10-06T11:10:07.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.915+0000 7fec3407d700 1 -- 172.21.15.146:0/1625069476 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec2c157e60 con 0x7fec2c155db0 2023-10-06T11:10:07.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.915+0000 7fec21ffb700 1 -- 172.21.15.146:0/1625069476 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1c00fdd0 con 0x7fec2c155db0 2023-10-06T11:10:07.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.915+0000 7fec3407d700 1 -- 172.21.15.146:0/1625069476 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec2c138c90 con 0x7fec2c155db0 2023-10-06T11:10:07.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.916+0000 7fec21ffb700 1 -- 172.21.15.146:0/1625069476 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fec1c013600 con 0x7fec2c155db0 2023-10-06T11:10:07.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.917+0000 7fec21ffb700 1 --2- 172.21.15.146:0/1625069476 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fec10066f30 0x7fec100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:07.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.917+0000 7fec31e19700 1 --2- 172.21.15.146:0/1625069476 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fec10066f30 0x7fec100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:07.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.917+0000 7fec21ffb700 1 -- 172.21.15.146:0/1625069476 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6230+0+0 (secure 0 0 0) 0x7fec1c084c20 con 0x7fec2c155db0 2023-10-06T11:10:07.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.917+0000 7fec31e19700 1 --2- 172.21.15.146:0/1625069476 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fec10066f30 0x7fec100693e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fec28002060 tx=0x7fec28006040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:07.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.919+0000 7fec3d375b80 1 Processor -- start 2023-10-06T11:10:07.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.919+0000 7fec3d375b80 1 -- start start 2023-10-06T11:10:07.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.919+0000 7fec3d375b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f3a8325a90 0x55f3a8325e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:07.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.920+0000 7fec3d375b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f3a82e19a0 0x55f3a82de580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:07.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.920+0000 7fec3d375b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f3a82dfbd0 0x55f3a82deac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:07.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.920+0000 7fec3d375b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3a825ec80 con 0x55f3a8325a90 2023-10-06T11:10:07.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.920+0000 7fec3d375b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3a8235a70 con 0x55f3a82e19a0 2023-10-06T11:10:07.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.920+0000 7fec3d375b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f3a8233270 con 0x55f3a82dfbd0 2023-10-06T11:10:07.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.920+0000 7fec31e19700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f3a8325a90 0x55f3a8325e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:07.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.920+0000 7fec31e19700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f3a8325a90 0x55f3a8325e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43914/0 (socket says 172.21.15.146:43914) 2023-10-06T11:10:07.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.920+0000 7fec31e19700 1 -- 172.21.15.146:0/3914952108 learned_addr learned my addr 172.21.15.146:0/3914952108 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:07.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.920+0000 7fec3261a700 1 --2- 172.21.15.146:0/3914952108 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f3a82dfbd0 0x55f3a82deac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:07.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.920+0000 7fec31618700 1 --2- 172.21.15.146:0/3914952108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f3a82e19a0 0x55f3a82de580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:07.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.920+0000 7fec31e19700 1 -- 172.21.15.146:0/3914952108 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f3a82dfbd0 msgr2=0x55f3a82deac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:07.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.920+0000 7fec31e19700 1 --2- 172.21.15.146:0/3914952108 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f3a82dfbd0 0x55f3a82deac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:07.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.920+0000 7fec31e19700 1 -- 172.21.15.146:0/3914952108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f3a82e19a0 msgr2=0x55f3a82de580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:07.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.920+0000 7fec31e19700 1 --2- 172.21.15.146:0/3914952108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f3a82e19a0 0x55f3a82de580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:07.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.920+0000 7fec31e19700 1 -- 172.21.15.146:0/3914952108 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3a80c9270 con 0x55f3a8325a90 2023-10-06T11:10:07.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.920+0000 7fec31e19700 1 --2- 172.21.15.146:0/3914952108 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f3a8325a90 0x55f3a8325e60 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fec28007b80 tx=0x7fec28016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c12ea3e8b577914 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:07.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.920+0000 7fec16ffd700 1 -- 172.21.15.146:0/3914952108 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec28023420 con 0x55f3a8325a90 2023-10-06T11:10:07.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.920+0000 7fec16ffd700 1 -- 172.21.15.146:0/3914952108 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec28023580 con 0x55f3a8325a90 2023-10-06T11:10:07.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.920+0000 7fec16ffd700 1 -- 172.21.15.146:0/3914952108 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec28023900 con 0x55f3a8325a90 2023-10-06T11:10:07.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.921+0000 7fec3d375b80 1 -- 172.21.15.146:0/3914952108 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f3a8325a90 msgr2=0x55f3a8325e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:07.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.921+0000 7fec3d375b80 1 --2- 172.21.15.146:0/3914952108 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f3a8325a90 0x55f3a8325e60 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fec28007b80 tx=0x7fec28016000 comp rx=0 tx=0).stop 2023-10-06T11:10:07.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.921+0000 7fec3d375b80 1 -- 172.21.15.146:0/3914952108 shutdown_connections 2023-10-06T11:10:07.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.921+0000 7fec3d375b80 1 --2- 172.21.15.146:0/3914952108 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f3a82dfbd0 0x55f3a82deac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:07.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.921+0000 7fec3d375b80 1 --2- 172.21.15.146:0/3914952108 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f3a8325a90 0x55f3a8325e60 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:07.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.921+0000 7fec3d375b80 1 --2- 172.21.15.146:0/3914952108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f3a82e19a0 0x55f3a82de580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:07.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.921+0000 7fec3d375b80 1 -- 172.21.15.146:0/3914952108 >> 172.21.15.146:0/3914952108 conn(0x55f3a82e0070 msgr2=0x55f3a82e0440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:07.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.921+0000 7fec3d375b80 1 -- 172.21.15.146:0/3914952108 shutdown_connections 2023-10-06T11:10:07.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.921+0000 7fec3d375b80 1 -- 172.21.15.146:0/3914952108 wait complete. 2023-10-06T11:10:07.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.921+0000 7fec3d375b80 1 -- start start 2023-10-06T11:10:07.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.922+0000 7fec3d375b80 1 Processor -- start 2023-10-06T11:10:07.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.922+0000 7fec3d375b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f3a82dfbd0 0x55f3a8305260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:07.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.922+0000 7fec3d375b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f3a82e19a0 0x55f3a830ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:07.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.922+0000 7fec3d375b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f3a8325a90 0x55f3a82d9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:07.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.922+0000 7fec3d375b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3a822f060 con 0x55f3a82e19a0 2023-10-06T11:10:07.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.922+0000 7fec3d375b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3a81da890 con 0x55f3a82dfbd0 2023-10-06T11:10:07.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.922+0000 7fec3d375b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f3a81f5ea0 con 0x55f3a8325a90 2023-10-06T11:10:07.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.923+0000 7fec3d375b80 10 client.0 _ll_register_callbacks cb 0x55f3a80cbf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:10:07.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.923+0000 7fec31618700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f3a82e19a0 0x55f3a830ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:07.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.923+0000 7fec31618700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f3a82e19a0 0x55f3a830ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43930/0 (socket says 172.21.15.146:43930) 2023-10-06T11:10:07.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.923+0000 7fec31618700 1 -- 172.21.15.146:0/3504276659 learned_addr learned my addr 172.21.15.146:0/3504276659 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:07.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.923+0000 7fec31e19700 1 --2- 172.21.15.146:0/3504276659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f3a82dfbd0 0x55f3a8305260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:07.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.923+0000 7fec3261a700 1 --2- 172.21.15.146:0/3504276659 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f3a8325a90 0x55f3a82d9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:07.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.923+0000 7fec31618700 1 -- 172.21.15.146:0/3504276659 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f3a8325a90 msgr2=0x55f3a82d9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:07.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.923+0000 7fec31618700 1 --2- 172.21.15.146:0/3504276659 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f3a8325a90 0x55f3a82d9740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:07.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.923+0000 7fec31618700 1 -- 172.21.15.146:0/3504276659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f3a82dfbd0 msgr2=0x55f3a8305260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:07.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.923+0000 7fec31618700 1 --2- 172.21.15.146:0/3504276659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f3a82dfbd0 0x55f3a8305260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:07.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.923+0000 7fec31618700 1 -- 172.21.15.146:0/3504276659 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec2c0cb450 con 0x55f3a82e19a0 2023-10-06T11:10:07.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.923+0000 7fec31618700 1 --2- 172.21.15.146:0/3504276659 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f3a82e19a0 0x55f3a830ac10 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fec1c00f4b0 tx=0x7fec1c058040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bc87e36408bd469 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:07.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.923+0000 7fec0bfff700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:10:07.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.923+0000 7fec0bfff700 1 -- 172.21.15.146:0/3504276659 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec1c058b50 con 0x55f3a82e19a0 2023-10-06T11:10:07.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.923+0000 7fec3d375b80 1 -- 172.21.15.146:0/3504276659 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f3a82d3690 con 0x55f3a82e19a0 2023-10-06T11:10:07.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.923+0000 7fec0bfff700 1 -- 172.21.15.146:0/3504276659 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(63..63 src has 1..63) v4 ==== 6230+0+0 (secure 0 0 0) 0x7fec1c06a070 con 0x55f3a82e19a0 2023-10-06T11:10:07.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.923+0000 7fec0bfff700 1 -- 172.21.15.146:0/3504276659 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7fec1c07eea0 con 0x55f3a82e19a0 2023-10-06T11:10:07.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.923+0000 7fec3d375b80 10 client.6579 fetch_fsmap learned FSMap version 56 2023-10-06T11:10:07.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.923+0000 7fec3d375b80 1 -- 172.21.15.146:0/3504276659 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x55f3a806bfe0 con 0x55f3a82e19a0 2023-10-06T11:10:07.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.923+0000 7fec0bfff700 1 -- 172.21.15.146:0/3504276659 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f3a82d3690 con 0x55f3a82e19a0 2023-10-06T11:10:07.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.923+0000 7fec0bfff700 1 -- 172.21.15.146:0/3504276659 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 56) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fec1c05c3b0 con 0x55f3a82e19a0 2023-10-06T11:10:07.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.924+0000 7fec3d375b80 10 client.6579 fetch_fsmap finished waiting for FSMap version 56 2023-10-06T11:10:07.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.924+0000 7fec3d375b80 10 client.6579 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T11:10:07.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.924+0000 7fec3d375b80 20 client.6579 populate_metadata read hostname 'smithi146' 2023-10-06T11:10:07.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.924+0000 7fec3d375b80 1 --2- 172.21.15.146:0/3504276659 >> [v2:172.21.15.146:6834/3512281867,v1:172.21.15.146:6835/3512281867] conn(0x55f3a82d9c80 0x55f3a82deaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:07.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.924+0000 7fec3d375b80 4 client.6579 mds_command: new command op to 6540 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:10:07.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.924+0000 7fec3d375b80 1 -- 172.21.15.146:0/3504276659 --> [v2:172.21.15.146:6834/3512281867,v1:172.21.15.146:6835/3512281867] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f3a82b05c0 con 0x55f3a82d9c80 2023-10-06T11:10:07.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.924+0000 7fec31e19700 1 --2- 172.21.15.146:0/3504276659 >> [v2:172.21.15.146:6834/3512281867,v1:172.21.15.146:6835/3512281867] conn(0x55f3a82d9c80 0x55f3a82deaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:07.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.924+0000 7fec0bfff700 10 client.6579 ms_handle_connect on v2:172.21.15.146:6834/3512281867 2023-10-06T11:10:07.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.924+0000 7fec31e19700 1 --2- 172.21.15.146:0/3504276659 >> [v2:172.21.15.146:6834/3512281867,v1:172.21.15.146:6835/3512281867] conn(0x55f3a82d9c80 0x55f3a82deaf0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bef324f59e35622b server_cookie=b89582b9dd20c8f in_seq=0 out_seq=0 2023-10-06T11:10:07.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.924+0000 7fec0bfff700 1 -- 172.21.15.146:0/3504276659 <== mds.0 v2:172.21.15.146:6834/3512281867 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55f3a82b05c0 con 0x55f3a82d9c80 2023-10-06T11:10:07.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.924+0000 7fec0bfff700 10 client.6579 handle_command_reply: tid=0 2023-10-06T11:10:07.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.924+0000 7fec3d375b80 1 client.6579 shutdown 2023-10-06T11:10:07.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.925+0000 7fec3d375b80 1 -- 172.21.15.146:0/3504276659 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f3a82e19a0 msgr2=0x55f3a830ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:07.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.925+0000 7fec3d375b80 1 --2- 172.21.15.146:0/3504276659 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f3a82e19a0 0x55f3a830ac10 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fec1c00f4b0 tx=0x7fec1c058040 comp rx=0 tx=0).stop 2023-10-06T11:10:07.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.925+0000 7fec3d375b80 1 -- 172.21.15.146:0/3504276659 shutdown_connections 2023-10-06T11:10:07.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.925+0000 7fec3d375b80 1 --2- 172.21.15.146:0/3504276659 >> [v2:172.21.15.146:6834/3512281867,v1:172.21.15.146:6835/3512281867] conn(0x55f3a82d9c80 0x55f3a82deaf0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:07.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.925+0000 7fec3d375b80 1 --2- 172.21.15.146:0/3504276659 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f3a8325a90 0x55f3a82d9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:07.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.925+0000 7fec3d375b80 1 --2- 172.21.15.146:0/3504276659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f3a82dfbd0 0x55f3a8305260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:07.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.925+0000 7fec3d375b80 1 --2- 172.21.15.146:0/3504276659 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f3a82e19a0 0x55f3a830ac10 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:07.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.925+0000 7fec0bfff700 0 client.6579 ms_handle_reset on v2:172.21.15.146:6834/3512281867 2023-10-06T11:10:07.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.925+0000 7fec3d375b80 1 -- 172.21.15.146:0/3504276659 >> 172.21.15.146:0/3504276659 conn(0x55f3a82e0070 msgr2=0x55f3a83232f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:07.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.925+0000 7fec3d375b80 1 -- 172.21.15.146:0/3504276659 shutdown_connections 2023-10-06T11:10:07.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.925+0000 7fec3d375b80 1 -- 172.21.15.146:0/3504276659 wait complete. 2023-10-06T11:10:07.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.925+0000 7fec3d375b80 20 client.6579 trim_cache size 0 max 16384 2023-10-06T11:10:07.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.941+0000 7fec3d375b80 1 Processor -- start 2023-10-06T11:10:07.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.941+0000 7fec3d375b80 1 -- start start 2023-10-06T11:10:07.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.942+0000 7fec3d375b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f3a82dfbd0 0x55f3a83232d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:07.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.942+0000 7fec3d375b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f3a82e19a0 0x55f3a8323810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:07.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.942+0000 7fec3d375b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f3a8325a90 0x55f3a8320410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:07.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.942+0000 7fec3d375b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3a80b1e30 con 0x55f3a82dfbd0 2023-10-06T11:10:07.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.942+0000 7fec3d375b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3a8321ad0 con 0x55f3a8325a90 2023-10-06T11:10:07.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.942+0000 7fec3d375b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f3a82d9350 con 0x55f3a82e19a0 2023-10-06T11:10:07.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.942+0000 7fec31e19700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f3a82dfbd0 0x55f3a83232d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:07.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.942+0000 7fec31e19700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f3a82dfbd0 0x55f3a83232d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43940/0 (socket says 172.21.15.146:43940) 2023-10-06T11:10:07.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.942+0000 7fec31e19700 1 -- 172.21.15.146:0/1444335323 learned_addr learned my addr 172.21.15.146:0/1444335323 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:07.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.942+0000 7fec31e19700 1 -- 172.21.15.146:0/1444335323 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f3a82e19a0 msgr2=0x55f3a8323810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:07.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.942+0000 7fec31e19700 1 --2- 172.21.15.146:0/1444335323 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f3a82e19a0 0x55f3a8323810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:07.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.942+0000 7fec31e19700 1 -- 172.21.15.146:0/1444335323 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f3a8325a90 msgr2=0x55f3a8320410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:07.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.942+0000 7fec31e19700 1 --2- 172.21.15.146:0/1444335323 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f3a8325a90 0x55f3a8320410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:07.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.942+0000 7fec31e19700 1 -- 172.21.15.146:0/1444335323 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3a81fd780 con 0x55f3a82dfbd0 2023-10-06T11:10:07.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.942+0000 7fec31e19700 1 --2- 172.21.15.146:0/1444335323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f3a82dfbd0 0x55f3a83232d0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fec28004d60 tx=0x7fec28017040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52ce84ca9da75d92 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:07.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.942+0000 7fec177fe700 1 -- 172.21.15.146:0/1444335323 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec28036070 con 0x55f3a82dfbd0 2023-10-06T11:10:07.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.943+0000 7fec177fe700 1 -- 172.21.15.146:0/1444335323 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec28001250 con 0x55f3a82dfbd0 2023-10-06T11:10:07.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.943+0000 7fec177fe700 1 -- 172.21.15.146:0/1444335323 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec28023420 con 0x55f3a82dfbd0 2023-10-06T11:10:07.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.943+0000 7fec3d375b80 1 -- 172.21.15.146:0/1444335323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f3a82dfbd0 msgr2=0x55f3a83232d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:07.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.943+0000 7fec3d375b80 1 --2- 172.21.15.146:0/1444335323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f3a82dfbd0 0x55f3a83232d0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fec28004d60 tx=0x7fec28017040 comp rx=0 tx=0).stop 2023-10-06T11:10:07.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.943+0000 7fec3d375b80 1 -- 172.21.15.146:0/1444335323 shutdown_connections 2023-10-06T11:10:07.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.943+0000 7fec3d375b80 1 --2- 172.21.15.146:0/1444335323 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f3a8325a90 0x55f3a8320410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:07.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.943+0000 7fec3d375b80 1 --2- 172.21.15.146:0/1444335323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f3a82dfbd0 0x55f3a83232d0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:07.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.943+0000 7fec3d375b80 1 --2- 172.21.15.146:0/1444335323 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f3a82e19a0 0x55f3a8323810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:07.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.943+0000 7fec3d375b80 1 -- 172.21.15.146:0/1444335323 >> 172.21.15.146:0/1444335323 conn(0x55f3a82e0070 msgr2=0x55f3a8324dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:07.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.943+0000 7fec3d375b80 1 -- 172.21.15.146:0/1444335323 shutdown_connections 2023-10-06T11:10:07.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.943+0000 7fec3d375b80 1 -- 172.21.15.146:0/1444335323 wait complete. 2023-10-06T11:10:07.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.944+0000 7fec3d375b80 1 -- start start 2023-10-06T11:10:07.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.944+0000 7fec3d375b80 1 Processor -- start 2023-10-06T11:10:07.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.945+0000 7fec3d375b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f3a82dfbd0 0x55f3a83296d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:07.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.945+0000 7fec3d375b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f3a82e19a0 0x55f3a83882b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:07.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.945+0000 7fec3d375b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f3a8325a90 0x55f3a8305c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:07.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.945+0000 7fec3d375b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3a8337400 con 0x55f3a82dfbd0 2023-10-06T11:10:07.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.945+0000 7fec3d375b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3a838bad0 con 0x55f3a82e19a0 2023-10-06T11:10:07.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.945+0000 7fec3d375b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f3a8329240 con 0x55f3a8325a90 2023-10-06T11:10:07.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.945+0000 7fec3d375b80 10 client.0 _ll_register_callbacks cb 0x55f3a80cbf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:10:07.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.945+0000 7fec31e19700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f3a82dfbd0 0x55f3a83296d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:07.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.945+0000 7fec31e19700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f3a82dfbd0 0x55f3a83296d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43942/0 (socket says 172.21.15.146:43942) 2023-10-06T11:10:07.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.945+0000 7fec31e19700 1 -- 172.21.15.146:0/1105112006 learned_addr learned my addr 172.21.15.146:0/1105112006 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:07.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.945+0000 7fec3261a700 1 --2- 172.21.15.146:0/1105112006 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f3a8325a90 0x55f3a8305c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:07.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.945+0000 7fec31e19700 1 -- 172.21.15.146:0/1105112006 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f3a8325a90 msgr2=0x55f3a8305c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:07.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.945+0000 7fec31e19700 1 --2- 172.21.15.146:0/1105112006 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f3a8325a90 0x55f3a8305c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:07.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.945+0000 7fec31618700 1 --2- 172.21.15.146:0/1105112006 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f3a82e19a0 0x55f3a83882b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:07.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.945+0000 7fec31e19700 1 -- 172.21.15.146:0/1105112006 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f3a82e19a0 msgr2=0x55f3a83882b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:07.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.945+0000 7fec31e19700 1 --2- 172.21.15.146:0/1105112006 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f3a82e19a0 0x55f3a83882b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:07.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.945+0000 7fec31e19700 1 -- 172.21.15.146:0/1105112006 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f3a80c9270 con 0x55f3a82dfbd0 2023-10-06T11:10:07.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.945+0000 7fec31e19700 1 --2- 172.21.15.146:0/1105112006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f3a82dfbd0 0x55f3a83296d0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fec28004d60 tx=0x7fec28036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b5a810538308065 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:07.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.945+0000 7fec0bfff700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:10:07.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.945+0000 7fec0bfff700 1 -- 172.21.15.146:0/1105112006 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec28042070 con 0x55f3a82dfbd0 2023-10-06T11:10:07.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.945+0000 7fec0bfff700 1 -- 172.21.15.146:0/1105112006 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(63..63 src has 1..63) v4 ==== 6230+0+0 (secure 0 0 0) 0x7fec2801d050 con 0x55f3a82dfbd0 2023-10-06T11:10:07.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.945+0000 7fec3d375b80 1 -- 172.21.15.146:0/1105112006 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fec28023580 con 0x55f3a82dfbd0 2023-10-06T11:10:07.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.945+0000 7fec0bfff700 1 -- 172.21.15.146:0/1105112006 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7fec2802f420 con 0x55f3a82dfbd0 2023-10-06T11:10:07.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.945+0000 7fec3d375b80 10 client.6585 fetch_fsmap learned FSMap version 56 2023-10-06T11:10:07.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.945+0000 7fec3d375b80 1 -- 172.21.15.146:0/1105112006 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x55f3a81e4470 con 0x55f3a82dfbd0 2023-10-06T11:10:07.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.945+0000 7fec0bfff700 1 -- 172.21.15.146:0/1105112006 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec28023580 con 0x55f3a82dfbd0 2023-10-06T11:10:07.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.946+0000 7fec0bfff700 1 -- 172.21.15.146:0/1105112006 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 56) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fec28045020 con 0x55f3a82dfbd0 2023-10-06T11:10:07.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.946+0000 7fec3d375b80 10 client.6585 fetch_fsmap finished waiting for FSMap version 56 2023-10-06T11:10:07.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.946+0000 7fec3d375b80 10 client.6585 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T11:10:07.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.946+0000 7fec3d375b80 20 client.6585 populate_metadata read hostname 'smithi146' 2023-10-06T11:10:07.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.946+0000 7fec3d375b80 1 --2- 172.21.15.146:0/1105112006 >> [v2:172.21.15.146:6834/3512281867,v1:172.21.15.146:6835/3512281867] conn(0x55f3a838b400 0x55f3a83232d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:07.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.946+0000 7fec3d375b80 4 client.6585 mds_command: new command op to 6540 tid=0[{"prefix": "status"}] 2023-10-06T11:10:07.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.946+0000 7fec3d375b80 1 -- 172.21.15.146:0/1105112006 --> [v2:172.21.15.146:6834/3512281867,v1:172.21.15.146:6835/3512281867] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f3a81d1e00 con 0x55f3a838b400 2023-10-06T11:10:07.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.946+0000 7fec31618700 1 --2- 172.21.15.146:0/1105112006 >> [v2:172.21.15.146:6834/3512281867,v1:172.21.15.146:6835/3512281867] conn(0x55f3a838b400 0x55f3a83232d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:07.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.946+0000 7fec0bfff700 10 client.6585 ms_handle_connect on v2:172.21.15.146:6834/3512281867 2023-10-06T11:10:07.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.946+0000 7fec31618700 1 --2- 172.21.15.146:0/1105112006 >> [v2:172.21.15.146:6834/3512281867,v1:172.21.15.146:6835/3512281867] conn(0x55f3a838b400 0x55f3a83232d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72475c828cf942b0 server_cookie=ded4dd5656ceb390 in_seq=0 out_seq=0 2023-10-06T11:10:07.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.946+0000 7fec0bfff700 1 -- 172.21.15.146:0/1105112006 <== mds.0 v2:172.21.15.146:6834/3512281867 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55f3a81d1e00 con 0x55f3a838b400 2023-10-06T11:10:07.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.946+0000 7fec0bfff700 10 client.6585 handle_command_reply: tid=0 2023-10-06T11:10:07.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.946+0000 7fec3d375b80 1 client.6585 shutdown 2023-10-06T11:10:07.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.946+0000 7fec3d375b80 1 -- 172.21.15.146:0/1105112006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f3a82dfbd0 msgr2=0x55f3a83296d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:07.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.946+0000 7fec3d375b80 1 --2- 172.21.15.146:0/1105112006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f3a82dfbd0 0x55f3a83296d0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fec28004d60 tx=0x7fec28036000 comp rx=0 tx=0).stop 2023-10-06T11:10:07.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.946+0000 7fec3d375b80 1 -- 172.21.15.146:0/1105112006 shutdown_connections 2023-10-06T11:10:07.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.946+0000 7fec3d375b80 1 --2- 172.21.15.146:0/1105112006 >> [v2:172.21.15.146:6834/3512281867,v1:172.21.15.146:6835/3512281867] conn(0x55f3a838b400 0x55f3a83232d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:07.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.946+0000 7fec3d375b80 1 --2- 172.21.15.146:0/1105112006 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f3a8325a90 0x55f3a8305c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:07.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.946+0000 7fec0bfff700 0 client.6585 ms_handle_reset on v2:172.21.15.146:6834/3512281867 2023-10-06T11:10:07.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.946+0000 7fec3d375b80 1 --2- 172.21.15.146:0/1105112006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f3a82dfbd0 0x55f3a83296d0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:07.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.946+0000 7fec3d375b80 1 --2- 172.21.15.146:0/1105112006 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f3a82e19a0 0x55f3a83882b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:07.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.946+0000 7fec3d375b80 1 -- 172.21.15.146:0/1105112006 >> 172.21.15.146:0/1105112006 conn(0x55f3a82e0070 msgr2=0x55f3a8324dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:07.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.947+0000 7fec3d375b80 1 -- 172.21.15.146:0/1105112006 shutdown_connections 2023-10-06T11:10:07.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.947+0000 7fec3d375b80 1 -- 172.21.15.146:0/1105112006 wait complete. 2023-10-06T11:10:07.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.947+0000 7fec3d375b80 20 client.6585 trim_cache size 0 max 16384 2023-10-06T11:10:07.956 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:10:07.956 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1", 2023-10-06T11:10:07.956 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2023-10-06T11:10:07.956 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 6540, 2023-10-06T11:10:07.957 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2023-10-06T11:10:07.957 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2023-10-06T11:10:07.957 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2023-10-06T11:10:07.957 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 4.5422178530000004, 2023-10-06T11:10:07.957 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 56, 2023-10-06T11:10:07.957 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 63, 2023-10-06T11:10:07.957 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 63, 2023-10-06T11:10:07.957 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 5.4045900979999999 2023-10-06T11:10:07.957 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:10:07.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.947+0000 7fec3407d700 1 -- 172.21.15.146:0/1625069476 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fec10066f30 msgr2=0x7fec100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:07.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.947+0000 7fec3407d700 1 --2- 172.21.15.146:0/1625069476 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fec10066f30 0x7fec100693e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fec28002060 tx=0x7fec28006040 comp rx=0 tx=0).stop 2023-10-06T11:10:07.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.947+0000 7fec3407d700 1 -- 172.21.15.146:0/1625069476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec2c155db0 msgr2=0x7fec2c156220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:07.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.947+0000 7fec3407d700 1 --2- 172.21.15.146:0/1625069476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec2c155db0 0x7fec2c156220 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fec1c002980 tx=0x7fec1c007d30 comp rx=0 tx=0).stop 2023-10-06T11:10:07.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.947+0000 7fec3407d700 1 -- 172.21.15.146:0/1625069476 shutdown_connections 2023-10-06T11:10:07.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.947+0000 7fec3407d700 1 --2- 172.21.15.146:0/1625069476 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fec10066f30 0x7fec100693e0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:07.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.947+0000 7fec3407d700 1 --2- 172.21.15.146:0/1625069476 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec2c0af560 0x7fec2c0af9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:07.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.947+0000 7fec3407d700 1 --2- 172.21.15.146:0/1625069476 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fec180051c0 0x7fec2c138750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:07.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.947+0000 7fec3407d700 1 --2- 172.21.15.146:0/1625069476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fec2c155db0 0x7fec2c156220 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:07.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.947+0000 7fec3407d700 1 -- 172.21.15.146:0/1625069476 >> 172.21.15.146:0/1625069476 conn(0x7fec2c06a070 msgr2=0x7fec2c0cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:07.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.947+0000 7fec3407d700 1 -- 172.21.15.146:0/1625069476 shutdown_connections 2023-10-06T11:10:07.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:07.947+0000 7fec3407d700 1 -- 172.21.15.146:0/1625069476 wait complete. 2023-10-06T11:10:07.961 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T11:10:08.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.073+0000 7f4f98343700 1 Processor -- start 2023-10-06T11:10:08.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.073+0000 7f4f98343700 1 -- start start 2023-10-06T11:10:08.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.074+0000 7f4f98343700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4f90153ab0 0x7f4f9015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:08.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.074+0000 7f4f98343700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4f90068ba0 0x7f4f900b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:08.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.074+0000 7f4f98343700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f9015ac30 con 0x7f4f90153e80 2023-10-06T11:10:08.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.074+0000 7f4f98343700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f900b4510 con 0x7f4f90153ab0 2023-10-06T11:10:08.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.074+0000 7f4f98343700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f900b6530 con 0x7f4f90068ba0 2023-10-06T11:10:08.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.074+0000 7f4f960df700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4f90153ab0 0x7f4f9015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:08.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.074+0000 7f4f960df700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4f90153ab0 0x7f4f9015a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43950/0 (socket says 172.21.15.146:43950) 2023-10-06T11:10:08.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.074+0000 7f4f960df700 1 -- 172.21.15.146:0/1016029084 learned_addr learned my addr 172.21.15.146:0/1016029084 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:08.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.074+0000 7f4f968e0700 1 --2- 172.21.15.146:0/1016029084 >> v2:172.21.15.151:3300/0 conn(0x7f4f90068ba0 0x7f4f900b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:08.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.074+0000 7f4f960df700 1 -- 172.21.15.146:0/1016029084 >> v2:172.21.15.151:3300/0 conn(0x7f4f90068ba0 msgr2=0x7f4f900b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:08.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.074+0000 7f4f960df700 1 --2- 172.21.15.146:0/1016029084 >> v2:172.21.15.151:3300/0 conn(0x7f4f90068ba0 0x7f4f900b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:08.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.074+0000 7f4f960df700 1 -- 172.21.15.146:0/1016029084 >> v1:172.21.15.151:6789/0 conn(0x7f4f90153e80 legacy=0x7f4f90068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:08.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.075+0000 7f4f960df700 1 -- 172.21.15.146:0/1016029084 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f900b5c50 con 0x7f4f90153ab0 2023-10-06T11:10:08.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.075+0000 7f4f968e0700 1 --2- 172.21.15.146:0/1016029084 >> v2:172.21.15.151:3300/0 conn(0x7f4f90068ba0 0x7f4f900b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:10:08.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.075+0000 7f4f960df700 1 --2- 172.21.15.146:0/1016029084 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f90153ab0 0x7f4f9015a6f0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f4f900b36d0 tx=0x7f4f8c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53b064d8f4998e2b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:08.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.075+0000 7f4f950dd700 1 -- 172.21.15.146:0/1016029084 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c00e070 con 0x7f4f90153ab0 2023-10-06T11:10:08.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.075+0000 7f4f950dd700 1 -- 172.21.15.146:0/1016029084 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8c00ba50 con 0x7f4f90153ab0 2023-10-06T11:10:08.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.075+0000 7f4f950dd700 1 -- 172.21.15.146:0/1016029084 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c0092e0 con 0x7f4f90153ab0 2023-10-06T11:10:08.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.075+0000 7f4f98343700 1 -- 172.21.15.146:0/1016029084 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f90153ab0 msgr2=0x7f4f9015a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:08.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.075+0000 7f4f98343700 1 --2- 172.21.15.146:0/1016029084 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f90153ab0 0x7f4f9015a6f0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f4f900b36d0 tx=0x7f4f8c009840 comp rx=0 tx=0).stop 2023-10-06T11:10:08.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.075+0000 7f4f98343700 1 -- 172.21.15.146:0/1016029084 shutdown_connections 2023-10-06T11:10:08.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.075+0000 7f4f98343700 1 --2- 172.21.15.146:0/1016029084 >> v2:172.21.15.151:3300/0 conn(0x7f4f90068ba0 0x7f4f900b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:08.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.075+0000 7f4f98343700 1 --2- 172.21.15.146:0/1016029084 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f90153ab0 0x7f4f9015a6f0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:08.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.075+0000 7f4f98343700 1 -- 172.21.15.146:0/1016029084 >> 172.21.15.146:0/1016029084 conn(0x7f4f9006eba0 msgr2=0x7f4f9006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:08.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.075+0000 7f4f98343700 1 -- 172.21.15.146:0/1016029084 shutdown_connections 2023-10-06T11:10:08.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.075+0000 7f4f98343700 1 -- 172.21.15.146:0/1016029084 wait complete. 2023-10-06T11:10:08.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.077+0000 7f4f98343700 1 Processor -- start 2023-10-06T11:10:08.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.077+0000 7f4f98343700 1 -- start start 2023-10-06T11:10:08.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.077+0000 7f4f98343700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f90068ba0 0x7f4f9013d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:08.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.077+0000 7f4f98343700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f90153ab0 0x7f4f90157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:08.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.077+0000 7f4f98343700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f90153e80 0x7f4f901575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:08.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.077+0000 7f4f98343700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f900b1fe0 con 0x7f4f90153ab0 2023-10-06T11:10:08.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.077+0000 7f4f98343700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f90154e80 con 0x7f4f90153e80 2023-10-06T11:10:08.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.077+0000 7f4f98343700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f900b1d00 con 0x7f4f90068ba0 2023-10-06T11:10:08.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.077+0000 7f4f958de700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f90153ab0 0x7f4f90157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:08.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.077+0000 7f4f958de700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f90153ab0 0x7f4f90157080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43962/0 (socket says 172.21.15.146:43962) 2023-10-06T11:10:08.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.077+0000 7f4f958de700 1 -- 172.21.15.146:0/3430214005 learned_addr learned my addr 172.21.15.146:0/3430214005 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:08.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.078+0000 7f4f968e0700 1 --2- 172.21.15.146:0/3430214005 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f90153e80 0x7f4f901575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:08.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.078+0000 7f4f960df700 1 --2- 172.21.15.146:0/3430214005 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f90068ba0 0x7f4f9013d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:08.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.078+0000 7f4f958de700 1 -- 172.21.15.146:0/3430214005 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f90068ba0 msgr2=0x7f4f9013d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:08.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.078+0000 7f4f958de700 1 --2- 172.21.15.146:0/3430214005 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f90068ba0 0x7f4f9013d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:08.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.078+0000 7f4f958de700 1 -- 172.21.15.146:0/3430214005 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f90153e80 msgr2=0x7f4f901575c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:08.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.078+0000 7f4f958de700 1 --2- 172.21.15.146:0/3430214005 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f90153e80 0x7f4f901575c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:08.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.078+0000 7f4f958de700 1 -- 172.21.15.146:0/3430214005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f8c009ae0 con 0x7f4f90153ab0 2023-10-06T11:10:08.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.078+0000 7f4f958de700 1 --2- 172.21.15.146:0/3430214005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f90153ab0 0x7f4f90157080 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f4f8000c590 tx=0x7f4f8000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:08.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.078+0000 7f4f867fc700 1 -- 172.21.15.146:0/3430214005 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f80011590 con 0x7f4f90153ab0 2023-10-06T11:10:08.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.078+0000 7f4f867fc700 1 -- 172.21.15.146:0/3430214005 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f80011710 con 0x7f4f90153ab0 2023-10-06T11:10:08.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.078+0000 7f4f98343700 1 -- 172.21.15.146:0/3430214005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f90154830 con 0x7f4f90153ab0 2023-10-06T11:10:08.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.078+0000 7f4f867fc700 1 -- 172.21.15.146:0/3430214005 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f80011ad0 con 0x7f4f90153ab0 2023-10-06T11:10:08.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.078+0000 7f4f98343700 1 -- 172.21.15.146:0/3430214005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f9013dc60 con 0x7f4f90153ab0 2023-10-06T11:10:08.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.079+0000 7f4f98343700 1 -- 172.21.15.146:0/3430214005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f90154690 con 0x7f4f90153ab0 2023-10-06T11:10:08.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.079+0000 7f4f867fc700 1 -- 172.21.15.146:0/3430214005 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4f8001b3b0 con 0x7f4f90153ab0 2023-10-06T11:10:08.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.080+0000 7f4f867fc700 1 --2- 172.21.15.146:0/3430214005 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4f74066f60 0x7f4f74069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:08.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.080+0000 7f4f867fc700 1 -- 172.21.15.146:0/3430214005 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f4f80083a00 con 0x7f4f90153ab0 2023-10-06T11:10:08.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.080+0000 7f4f960df700 1 --2- 172.21.15.146:0/3430214005 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4f74066f60 0x7f4f74069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:08.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.080+0000 7f4f960df700 1 --2- 172.21.15.146:0/3430214005 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4f74066f60 0x7f4f74069410 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c009880 tx=0x7f4f8c018000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:08.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.084+0000 7f4f867fc700 1 -- 172.21.15.146:0/3430214005 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4f90154690 con 0x7f4f90153ab0 2023-10-06T11:10:08.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.313+0000 7f4f98343700 1 -- 172.21.15.146:0/3430214005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4f9015ac30 con 0x7f4f90153ab0 2023-10-06T11:10:08.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.314+0000 7f4f867fc700 1 -- 172.21.15.146:0/3430214005 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v56) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4f9015ac30 con 0x7f4f90153ab0 2023-10-06T11:10:08.316 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T11:10:08.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.316+0000 7f4f98343700 1 -- 172.21.15.146:0/3430214005 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4f74066f60 msgr2=0x7f4f74069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:08.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.316+0000 7f4f98343700 1 --2- 172.21.15.146:0/3430214005 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4f74066f60 0x7f4f74069410 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c009880 tx=0x7f4f8c018000 comp rx=0 tx=0).stop 2023-10-06T11:10:08.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.316+0000 7f4f98343700 1 -- 172.21.15.146:0/3430214005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f90153ab0 msgr2=0x7f4f90157080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:08.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.316+0000 7f4f98343700 1 --2- 172.21.15.146:0/3430214005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f90153ab0 0x7f4f90157080 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f4f8000c590 tx=0x7f4f8000c8a0 comp rx=0 tx=0).stop 2023-10-06T11:10:08.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.316+0000 7f4f98343700 1 -- 172.21.15.146:0/3430214005 shutdown_connections 2023-10-06T11:10:08.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.316+0000 7f4f98343700 1 --2- 172.21.15.146:0/3430214005 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4f74066f60 0x7f4f74069410 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:08.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.316+0000 7f4f98343700 1 --2- 172.21.15.146:0/3430214005 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f90153e80 0x7f4f901575c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:08.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.316+0000 7f4f98343700 1 --2- 172.21.15.146:0/3430214005 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f90068ba0 0x7f4f9013d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:08.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.316+0000 7f4f98343700 1 --2- 172.21.15.146:0/3430214005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f90153ab0 0x7f4f90157080 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:08.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.316+0000 7f4f98343700 1 -- 172.21.15.146:0/3430214005 >> 172.21.15.146:0/3430214005 conn(0x7f4f9006eba0 msgr2=0x7f4f90151e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:08.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.316+0000 7f4f98343700 1 -- 172.21.15.146:0/3430214005 shutdown_connections 2023-10-06T11:10:08.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:08.316+0000 7f4f98343700 1 -- 172.21.15.146:0/3430214005 wait complete. 2023-10-06T11:10:08.330 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T11:10:08.330 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T11:10:08.330 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2023-10-06T11:10:08.331 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T11:10:08.331 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T11:10:08.331 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T11:10:08.331 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T11:10:08.331 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T11:10:08.331 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:10:08.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:10:08.332 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2023-10-06T11:10:08.348 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:10:08.348 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:10:08.348 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:10:08.348 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:10:08.349 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2023-10-06T11:10:08.349 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:10:08.349 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:10:08.349 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2023-10-06T11:10:08.349 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2023-10-06T11:10:08.349 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:10:08.349 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2023-10-06T11:10:08.349 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2023-10-06T11:10:08.349 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:10:08.350 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2023-10-06T11:10:08.350 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T11:10:08.350 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2023-10-06T11:10:08.350 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T11:10:08.350 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42249sec preferred_lft 42249sec 2023-10-06T11:10:08.350 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link noprefixroute 2023-10-06T11:10:08.350 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:10:08.350 INFO:teuthology.orchestra.run.smithi146.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T11:10:08.350 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0e:4f:33:80:c4:0e brd ff:ff:ff:ff:ff:ff 2023-10-06T11:10:08.350 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T11:10:08.351 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:10:08.351 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3884:6eff:fefc:ffc7/64 scope link 2023-10-06T11:10:08.351 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:10:08.351 INFO:teuthology.orchestra.run.smithi146.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:10:08.351 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0e:4f:33:80:c4:0e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T11:10:08.351 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::c4f:33ff:fe80:c40e/64 scope link 2023-10-06T11:10:08.351 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:10:08.351 INFO:teuthology.orchestra.run.smithi146.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:10:08.351 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 36:96:28:73:57:c4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T11:10:08.351 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3496:28ff:fe73:57c4/64 scope link 2023-10-06T11:10:08.352 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:10:08.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:10:08.352 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T11:10:08.411 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-06T11:10:08.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:10:08.413 DEBUG:teuthology.orchestra.run.smithi146:> route 2023-10-06T11:10:08.468 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2023-10-06T11:10:08.468 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T11:10:08.468 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T11:10:08.469 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T11:10:08.469 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T11:10:08.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:10:08.469 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-10-06T11:10:08.469 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:10:08.469 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T11:10:08.469 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T11:10:08.469 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T11:10:08.469 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:10:08.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:10:08.569 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-10-06T11:10:08.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T11:10:08.583 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T11:10:08.584 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:10:08.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:10:08.584 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2023-10-06T11:10:08.648 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T11:10:08.648 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:10:08.648 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T11:10:08.703 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:10:08.703 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:10:08.703 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:10:08.758 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-06T11:10:08.823 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:10:08.823 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:10:08.887 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:10:08.888 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:10:08.888 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:10:08.888 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-06T11:10:08.943 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T11:10:08.944 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T11:10:08.986 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-06T11:10:09.010 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:10:09.010 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:10:09.067 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:2023-10-06T11:10:09.065+0000 7f88453d9540 -1 init, newargv = 0x560765aa5db0 newargc=15 2023-10-06T11:10:09.067 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[118815]: starting ceph client 2023-10-06T11:10:09.072 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[118815]: starting fuse 2023-10-06T11:10:09.075 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:10:09.076 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:10:09.077 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:10:09.077 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-06T11:10:09.132 INFO:teuthology.orchestra.run.smithi146.stdout:46 2023-10-06T11:10:09.132 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-06T11:10:09.132 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T11:10:09.133 DEBUG:teuthology.orchestra.run.smithi146:> import glob 2023-10-06T11:10:09.133 DEBUG:teuthology.orchestra.run.smithi146:> import re 2023-10-06T11:10:09.133 DEBUG:teuthology.orchestra.run.smithi146:> import os 2023-10-06T11:10:09.133 DEBUG:teuthology.orchestra.run.smithi146:> import subprocess 2023-10-06T11:10:09.133 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:10:09.133 DEBUG:teuthology.orchestra.run.smithi146:> def _find_admin_socket(client_name): 2023-10-06T11:10:09.133 DEBUG:teuthology.orchestra.run.smithi146:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T11:10:09.133 DEBUG:teuthology.orchestra.run.smithi146:> files = glob.glob(asok_path) 2023-10-06T11:10:09.133 DEBUG:teuthology.orchestra.run.smithi146:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T11:10:09.133 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:10:09.133 DEBUG:teuthology.orchestra.run.smithi146:> # Given a non-glob path, it better be there 2023-10-06T11:10:09.133 DEBUG:teuthology.orchestra.run.smithi146:> if "*" not in asok_path: 2023-10-06T11:10:09.134 DEBUG:teuthology.orchestra.run.smithi146:> assert(len(files) == 1) 2023-10-06T11:10:09.134 DEBUG:teuthology.orchestra.run.smithi146:> return files[0] 2023-10-06T11:10:09.134 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:10:09.134 DEBUG:teuthology.orchestra.run.smithi146:> for f in files: 2023-10-06T11:10:09.134 DEBUG:teuthology.orchestra.run.smithi146:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T11:10:09.134 DEBUG:teuthology.orchestra.run.smithi146:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T11:10:09.134 DEBUG:teuthology.orchestra.run.smithi146:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T11:10:09.134 DEBUG:teuthology.orchestra.run.smithi146:> contents = proc_f.read() 2023-10-06T11:10:09.134 DEBUG:teuthology.orchestra.run.smithi146:> if mountpoint in contents: 2023-10-06T11:10:09.134 DEBUG:teuthology.orchestra.run.smithi146:> return f 2023-10-06T11:10:09.134 DEBUG:teuthology.orchestra.run.smithi146:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T11:10:09.134 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:10:09.134 DEBUG:teuthology.orchestra.run.smithi146:> print(_find_admin_socket("client.0")) 2023-10-06T11:10:09.135 DEBUG:teuthology.orchestra.run.smithi146:> ' 2023-10-06T11:10:09.253 INFO:teuthology.orchestra.run.smithi146.stdout:/var/run/ceph/ceph-client.0.118815.asok 2023-10-06T11:10:09.402 INFO:tasks.ceph.mds.a.smithi146.stderr:2023-10-06T11:10:09.401+0000 7f9f0e628700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T11:10:09.436 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.118815.asok 2023-10-06T11:10:09.436 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:10:09.436 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.118815.asok status 2023-10-06T11:10:09.587 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:10:09.587 INFO:teuthology.orchestra.run.smithi146.stdout: "metadata": { 2023-10-06T11:10:09.587 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T11:10:09.587 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T11:10:09.587 INFO:teuthology.orchestra.run.smithi146.stdout: "entity_id": "0", 2023-10-06T11:10:09.587 INFO:teuthology.orchestra.run.smithi146.stdout: "hostname": "smithi146", 2023-10-06T11:10:09.587 INFO:teuthology.orchestra.run.smithi146.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T11:10:09.587 INFO:teuthology.orchestra.run.smithi146.stdout: "pid": "118815", 2023-10-06T11:10:09.587 INFO:teuthology.orchestra.run.smithi146.stdout: "root": "/" 2023-10-06T11:10:09.588 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:10:09.588 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_count": 0, 2023-10-06T11:10:09.588 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_pinned_count": 0, 2023-10-06T11:10:09.588 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 6597, 2023-10-06T11:10:09.588 INFO:teuthology.orchestra.run.smithi146.stdout: "inst": { 2023-10-06T11:10:09.588 INFO:teuthology.orchestra.run.smithi146.stdout: "name": { 2023-10-06T11:10:09.588 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "client", 2023-10-06T11:10:09.588 INFO:teuthology.orchestra.run.smithi146.stdout: "num": 6597 2023-10-06T11:10:09.588 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:10:09.588 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-06T11:10:09.588 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-06T11:10:09.589 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:10:09.589 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 1864622978 2023-10-06T11:10:09.589 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:10:09.589 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:10:09.589 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-06T11:10:09.589 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-06T11:10:09.589 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:10:09.589 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 1864622978 2023-10-06T11:10:09.589 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:10:09.589 INFO:teuthology.orchestra.run.smithi146.stdout: "inst_str": "client.6597 192.168.0.1:0/1864622978", 2023-10-06T11:10:09.589 INFO:teuthology.orchestra.run.smithi146.stdout: "addr_str": "192.168.0.1:0/1864622978", 2023-10-06T11:10:09.590 INFO:teuthology.orchestra.run.smithi146.stdout: "inode_count": 1, 2023-10-06T11:10:09.590 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_epoch": 56, 2023-10-06T11:10:09.590 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch": 63, 2023-10-06T11:10:09.590 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch_barrier": 0, 2023-10-06T11:10:09.590 INFO:teuthology.orchestra.run.smithi146.stdout: "blocklisted": false, 2023-10-06T11:10:09.590 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs" 2023-10-06T11:10:09.590 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:10:09.597 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:10:09.597 DEBUG:teuthology.orchestra.run.smithi146:> stat --file-system '--printf=%T 2023-10-06T11:10:09.597 DEBUG:teuthology.orchestra.run.smithi146:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T11:10:09.614 INFO:teuthology.orchestra.run.smithi146.stdout:fuseblk 2023-10-06T11:10:09.615 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T11:10:09.615 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:10:09.615 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:10:09.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:10:09.682 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir scrub_repair_path) 2023-10-06T11:10:09.739 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:10:09.740 INFO:teuthology.orchestra.run.smithi146.stderr:rmdir: failed to remove 'scrub_repair_path': Directory not empty 2023-10-06T11:10:09.740 INFO:tasks.cephfs.test_scrub_checks:Running command 'scrub start /scrub_repair_path repair' 2023-10-06T11:10:09.740 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub start /scrub_repair_path repair 2023-10-06T11:10:09.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.897+0000 7f2790f73700 1 Processor -- start 2023-10-06T11:10:09.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.897+0000 7f2790f73700 1 -- start start 2023-10-06T11:10:09.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.898+0000 7f2790f73700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f278c0adbd0 0x7f278c156160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:09.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.898+0000 7f2790f73700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f278c1579f0 con 0x7f278c1566a0 2023-10-06T11:10:09.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.898+0000 7f2790f73700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f278c156b10 con 0x7f278c158e90 2023-10-06T11:10:09.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.898+0000 7f2790f73700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f278c156de0 con 0x7f278c0adbd0 2023-10-06T11:10:09.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.898+0000 7f2781d9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f278c1566a0 0x7f278c0adfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60078/0 (socket says 172.21.15.146:60078) 2023-10-06T11:10:09.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.898+0000 7f2781d9b700 1 -- 172.21.15.146:0/1386827973 learned_addr learned my addr 172.21.15.146:0/1386827973 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:10:09.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.898+0000 7f278a59c700 1 --2- 172.21.15.146:0/1386827973 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f278c0adbd0 0x7f278c156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:09.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.898+0000 7f2789d9b700 1 -- 172.21.15.146:0/1386827973 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 606993604 0 0) 0x7f278c1579f0 con 0x7f278c1566a0 2023-10-06T11:10:09.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.898+0000 7f2789d9b700 1 -- 172.21.15.146:0/1386827973 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2778004680 con 0x7f278c1566a0 2023-10-06T11:10:09.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.899+0000 7f2789d9b700 1 -- 172.21.15.146:0/1386827973 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1300583138 0 0) 0x7f2778004680 con 0x7f278c1566a0 2023-10-06T11:10:09.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.899+0000 7f2789d9b700 1 -- 172.21.15.146:0/1386827973 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f278c0adbd0 msgr2=0x7f278c156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:09.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.899+0000 7f2789d9b700 1 --2- 172.21.15.146:0/1386827973 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f278c0adbd0 0x7f278c156160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:09.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.899+0000 7f2789d9b700 1 -- 172.21.15.146:0/1386827973 >> v1:172.21.15.151:6789/0 conn(0x7f278c158e90 legacy=0x7f278c15f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:09.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.899+0000 7f2789d9b700 1 -- 172.21.15.146:0/1386827973 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f278c1570c0 con 0x7f278c1566a0 2023-10-06T11:10:09.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.899+0000 7f2789d9b700 1 -- 172.21.15.146:0/1386827973 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f2774001470 con 0x7f278c1566a0 2023-10-06T11:10:09.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.899+0000 7f2789d9b700 1 -- 172.21.15.146:0/1386827973 >> v1:172.21.15.146:6789/0 conn(0x7f278c1566a0 legacy=0x7f278c0adfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:09.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.899+0000 7f2789d9b700 1 --2- 172.21.15.146:0/1386827973 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f278c0adbd0 0x7f2778004ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:09.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.899+0000 7f2789d9b700 1 --2- 172.21.15.146:0/1386827973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2778005120 0x7f2778005920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:09.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.899+0000 7f2789d9b700 1 --2- 172.21.15.146:0/1386827973 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2778005e60 0x7f27780062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:09.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.899+0000 7f2789d9b700 1 -- 172.21.15.146:0/1386827973 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278c156de0 con 0x7f2778005e60 2023-10-06T11:10:09.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.899+0000 7f2789d9b700 1 -- 172.21.15.146:0/1386827973 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277800cd00 con 0x7f2778005120 2023-10-06T11:10:09.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.899+0000 7f2789d9b700 1 -- 172.21.15.146:0/1386827973 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f277800cec0 con 0x7f278c0adbd0 2023-10-06T11:10:09.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.899+0000 7f278a59c700 1 --2- 172.21.15.146:0/1386827973 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f278c0adbd0 0x7f2778004ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:09.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.899+0000 7f278ad9d700 1 --2- 172.21.15.146:0/1386827973 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2778005e60 0x7f27780062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:09.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.899+0000 7f2781d9b700 1 --2- 172.21.15.146:0/1386827973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2778005120 0x7f2778005920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:09.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.899+0000 7f278ad9d700 1 -- 172.21.15.146:0/1386827973 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f278c0adbd0 msgr2=0x7f2778004ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:09.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.899+0000 7f278ad9d700 1 --2- 172.21.15.146:0/1386827973 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f278c0adbd0 0x7f2778004ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:09.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.899+0000 7f278ad9d700 1 -- 172.21.15.146:0/1386827973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2778005120 msgr2=0x7f2778005920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:09.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.899+0000 7f278ad9d700 1 --2- 172.21.15.146:0/1386827973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2778005120 0x7f2778005920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:09.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.899+0000 7f278ad9d700 1 -- 172.21.15.146:0/1386827973 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2778004680 con 0x7f2778005e60 2023-10-06T11:10:09.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.899+0000 7f278a59c700 1 --2- 172.21.15.146:0/1386827973 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f278c0adbd0 0x7f2778004ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:10:09.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.899+0000 7f278ad9d700 1 --2- 172.21.15.146:0/1386827973 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2778005e60 0x7f27780062d0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f2784001f90 tx=0x7f2784001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87df3389fde6dace server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:09.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.899+0000 7f2789d9b700 1 -- 172.21.15.146:0/1386827973 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2784001950 con 0x7f2778005e60 2023-10-06T11:10:09.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.899+0000 7f2789d9b700 1 -- 172.21.15.146:0/1386827973 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f278400c8b0 con 0x7f2778005e60 2023-10-06T11:10:09.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.900+0000 7f2789d9b700 1 -- 172.21.15.146:0/1386827973 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278400cc70 con 0x7f2778005e60 2023-10-06T11:10:09.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.900+0000 7f2790f73700 1 -- 172.21.15.146:0/1386827973 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2778005e60 msgr2=0x7f27780062d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:09.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.900+0000 7f2790f73700 1 --2- 172.21.15.146:0/1386827973 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2778005e60 0x7f27780062d0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f2784001f90 tx=0x7f2784001640 comp rx=0 tx=0).stop 2023-10-06T11:10:09.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.900+0000 7f278ad9d700 1 -- 172.21.15.146:0/1386827973 reap_dead start 2023-10-06T11:10:09.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.900+0000 7f2790f73700 1 -- 172.21.15.146:0/1386827973 shutdown_connections 2023-10-06T11:10:09.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.900+0000 7f2790f73700 1 -- 172.21.15.146:0/1386827973 >> 172.21.15.146:0/1386827973 conn(0x7f278c06a070 msgr2=0x7f278c067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:09.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.900+0000 7f2790f73700 1 -- 172.21.15.146:0/1386827973 shutdown_connections 2023-10-06T11:10:09.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.900+0000 7f2790f73700 1 -- 172.21.15.146:0/1386827973 wait complete. 2023-10-06T11:10:09.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.901+0000 7f2790f73700 1 Processor -- start 2023-10-06T11:10:09.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.901+0000 7f2790f73700 1 -- start start 2023-10-06T11:10:09.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.902+0000 7f2790f73700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f278c14c480 0x7f278c06e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:09.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.902+0000 7f2790f73700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f278c06ebf0 0x7f278c15a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:09.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.902+0000 7f2790f73700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f278c15a860 0x7f278c15ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:09.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.902+0000 7f2790f73700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278c06f060 con 0x7f278c06ebf0 2023-10-06T11:10:09.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.902+0000 7f2790f73700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278c14e710 con 0x7f278c14c480 2023-10-06T11:10:09.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.902+0000 7f2790f73700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f278c14db90 con 0x7f278c15a860 2023-10-06T11:10:09.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.902+0000 7f2781d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f278c06ebf0 0x7f278c15a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:09.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.902+0000 7f2781d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f278c06ebf0 0x7f278c15a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43968/0 (socket says 172.21.15.146:43968) 2023-10-06T11:10:09.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.902+0000 7f2781d9b700 1 -- 172.21.15.146:0/3986887572 learned_addr learned my addr 172.21.15.146:0/3986887572 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:09.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.902+0000 7f2781d9b700 1 -- 172.21.15.146:0/3986887572 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f278c15a860 msgr2=0x7f278c15ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:09.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.902+0000 7f2781d9b700 1 --2- 172.21.15.146:0/3986887572 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f278c15a860 0x7f278c15ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:09.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.902+0000 7f2781d9b700 1 -- 172.21.15.146:0/3986887572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f278c14c480 msgr2=0x7f278c06e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:09.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.902+0000 7f2781d9b700 1 --2- 172.21.15.146:0/3986887572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f278c14c480 0x7f278c06e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:09.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.902+0000 7f2781d9b700 1 -- 172.21.15.146:0/3986887572 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f278c14de70 con 0x7f278c06ebf0 2023-10-06T11:10:09.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.902+0000 7f2781d9b700 1 --2- 172.21.15.146:0/3986887572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f278c06ebf0 0x7f278c15a320 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f27740015a0 tx=0x7f2774001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:09.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.903+0000 7f2782ffd700 1 -- 172.21.15.146:0/3986887572 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2774018030 con 0x7f278c06ebf0 2023-10-06T11:10:09.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.903+0000 7f2782ffd700 1 -- 172.21.15.146:0/3986887572 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277400f840 con 0x7f278c06ebf0 2023-10-06T11:10:09.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.903+0000 7f2782ffd700 1 -- 172.21.15.146:0/3986887572 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277400fbe0 con 0x7f278c06ebf0 2023-10-06T11:10:09.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.903+0000 7f2790f73700 1 -- 172.21.15.146:0/3986887572 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f278c14e150 con 0x7f278c06ebf0 2023-10-06T11:10:09.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.903+0000 7f2790f73700 1 -- 172.21.15.146:0/3986887572 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f278c14c850 con 0x7f278c06ebf0 2023-10-06T11:10:09.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.904+0000 7f2782ffd700 1 -- 172.21.15.146:0/3986887572 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f277401b070 con 0x7f278c06ebf0 2023-10-06T11:10:09.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.904+0000 7f2782ffd700 1 --2- 172.21.15.146:0/3986887572 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f276c066f30 0x7f276c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:09.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.904+0000 7f2782ffd700 1 -- 172.21.15.146:0/3986887572 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f2774019070 con 0x7f278c06ebf0 2023-10-06T11:10:09.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.904+0000 7f278a59c700 1 --2- 172.21.15.146:0/3986887572 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f276c066f30 0x7f276c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:09.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.905+0000 7f278a59c700 1 --2- 172.21.15.146:0/3986887572 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f276c066f30 0x7f276c0693e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f277c006eb0 tx=0x7f277c0091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:09.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.906+0000 7f279a26bb80 1 Processor -- start 2023-10-06T11:10:09.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.907+0000 7f279a26bb80 1 -- start start 2023-10-06T11:10:09.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.907+0000 7f279a26bb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586a5ddcda0 0x5586a5ddd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:09.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.907+0000 7f279a26bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586a5daf8c0 0x5586a5db5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:09.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.907+0000 7f279a26bb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5586a5df99c0 0x5586a5df9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:09.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.907+0000 7f279a26bb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586a5d33d70 con 0x5586a5ddcda0 2023-10-06T11:10:09.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.907+0000 7f279a26bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586a5d0ab60 con 0x5586a5daf8c0 2023-10-06T11:10:09.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.907+0000 7f279a26bb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5586a5d08360 con 0x5586a5df99c0 2023-10-06T11:10:09.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.907+0000 7f278a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586a5ddcda0 0x5586a5ddd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:09.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.907+0000 7f278a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586a5ddcda0 0x5586a5ddd170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43978/0 (socket says 172.21.15.146:43978) 2023-10-06T11:10:09.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.907+0000 7f278a59c700 1 -- 172.21.15.146:0/702745454 learned_addr learned my addr 172.21.15.146:0/702745454 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:09.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.908+0000 7f2781d9b700 1 --2- 172.21.15.146:0/702745454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586a5daf8c0 0x5586a5db5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:09.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.908+0000 7f278a59c700 1 -- 172.21.15.146:0/702745454 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5586a5df99c0 msgr2=0x5586a5df9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:09.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.908+0000 7f278a59c700 1 --2- 172.21.15.146:0/702745454 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5586a5df99c0 0x5586a5df9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:09.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.908+0000 7f278a59c700 1 -- 172.21.15.146:0/702745454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586a5daf8c0 msgr2=0x5586a5db5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:09.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.908+0000 7f278a59c700 1 --2- 172.21.15.146:0/702745454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586a5daf8c0 0x5586a5db5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:09.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.908+0000 7f278a59c700 1 -- 172.21.15.146:0/702745454 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5586a5b9e360 con 0x5586a5ddcda0 2023-10-06T11:10:09.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.908+0000 7f278a59c700 1 --2- 172.21.15.146:0/702745454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586a5ddcda0 0x5586a5ddd170 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f277c011f70 tx=0x7f277c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef2c861b6b829deb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:09.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.908+0000 7f276b7fe700 1 -- 172.21.15.146:0/702745454 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277c029410 con 0x5586a5ddcda0 2023-10-06T11:10:09.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.908+0000 7f276b7fe700 1 -- 172.21.15.146:0/702745454 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277c029590 con 0x5586a5ddcda0 2023-10-06T11:10:09.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.908+0000 7f276b7fe700 1 -- 172.21.15.146:0/702745454 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277c029950 con 0x5586a5ddcda0 2023-10-06T11:10:09.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.909+0000 7f279a26bb80 1 -- 172.21.15.146:0/702745454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586a5ddcda0 msgr2=0x5586a5ddd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:09.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.909+0000 7f279a26bb80 1 --2- 172.21.15.146:0/702745454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586a5ddcda0 0x5586a5ddd170 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f277c011f70 tx=0x7f277c019000 comp rx=0 tx=0).stop 2023-10-06T11:10:09.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.909+0000 7f279a26bb80 1 -- 172.21.15.146:0/702745454 shutdown_connections 2023-10-06T11:10:09.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.909+0000 7f279a26bb80 1 --2- 172.21.15.146:0/702745454 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5586a5df99c0 0x5586a5df9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:09.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.909+0000 7f279a26bb80 1 --2- 172.21.15.146:0/702745454 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586a5ddcda0 0x5586a5ddd170 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:09.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.909+0000 7f279a26bb80 1 --2- 172.21.15.146:0/702745454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586a5daf8c0 0x5586a5db5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:09.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.909+0000 7f279a26bb80 1 -- 172.21.15.146:0/702745454 >> 172.21.15.146:0/702745454 conn(0x5586a5db5160 msgr2=0x5586a5db5530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:09.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.909+0000 7f279a26bb80 1 -- 172.21.15.146:0/702745454 shutdown_connections 2023-10-06T11:10:09.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.909+0000 7f279a26bb80 1 -- 172.21.15.146:0/702745454 wait complete. 2023-10-06T11:10:09.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.909+0000 7f279a26bb80 1 -- start start 2023-10-06T11:10:09.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.909+0000 7f279a26bb80 1 Processor -- start 2023-10-06T11:10:09.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.910+0000 7f279a26bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586a5daf8c0 0x5586a5dde270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:09.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.910+0000 7f279a26bb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5586a5ddcda0 0x5586a5dd8720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:09.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.910+0000 7f279a26bb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586a5df99c0 0x5586a5df3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:09.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.910+0000 7f279a26bb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586a5d04150 con 0x5586a5df99c0 2023-10-06T11:10:09.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.910+0000 7f279a26bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586a5caf980 con 0x5586a5daf8c0 2023-10-06T11:10:09.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.910+0000 7f279a26bb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5586a5ccaf90 con 0x5586a5ddcda0 2023-10-06T11:10:09.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.910+0000 7f279a26bb80 10 client.0 _ll_register_callbacks cb 0x5586a5ba1020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:10:09.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.910+0000 7f278ad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586a5df99c0 0x5586a5df3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:09.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.910+0000 7f278ad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586a5df99c0 0x5586a5df3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43990/0 (socket says 172.21.15.146:43990) 2023-10-06T11:10:09.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.910+0000 7f278ad9d700 1 -- 172.21.15.146:0/1887866529 learned_addr learned my addr 172.21.15.146:0/1887866529 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:09.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.911+0000 7f278a59c700 1 --2- 172.21.15.146:0/1887866529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586a5daf8c0 0x5586a5dde270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:09.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.911+0000 7f2781d9b700 1 --2- 172.21.15.146:0/1887866529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5586a5ddcda0 0x5586a5dd8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:09.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.911+0000 7f278ad9d700 1 -- 172.21.15.146:0/1887866529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5586a5ddcda0 msgr2=0x5586a5dd8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:09.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.911+0000 7f278ad9d700 1 --2- 172.21.15.146:0/1887866529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5586a5ddcda0 0x5586a5dd8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:09.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.911+0000 7f278ad9d700 1 -- 172.21.15.146:0/1887866529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586a5daf8c0 msgr2=0x5586a5dde270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:09.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.911+0000 7f278ad9d700 1 --2- 172.21.15.146:0/1887866529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586a5daf8c0 0x5586a5dde270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:09.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.911+0000 7f278ad9d700 1 -- 172.21.15.146:0/1887866529 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f277c011b80 con 0x5586a5df99c0 2023-10-06T11:10:09.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.911+0000 7f278ad9d700 1 --2- 172.21.15.146:0/1887866529 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586a5df99c0 0x5586a5df3530 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f278400c6a0 tx=0x7f2784015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b15b67510a54c50 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:09.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.911+0000 7f2768ff9700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:10:09.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.911+0000 7f2768ff9700 1 -- 172.21.15.146:0/1887866529 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f278400c6d0 con 0x5586a5df99c0 2023-10-06T11:10:09.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.911+0000 7f2768ff9700 1 -- 172.21.15.146:0/1887866529 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(63..63 src has 1..63) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f2784006ba0 con 0x5586a5df99c0 2023-10-06T11:10:09.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.911+0000 7f279a26bb80 1 -- 172.21.15.146:0/1887866529 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5586a5da8780 con 0x5586a5df99c0 2023-10-06T11:10:09.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.911+0000 7f2768ff9700 1 -- 172.21.15.146:0/1887866529 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2784012650 con 0x5586a5df99c0 2023-10-06T11:10:09.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.911+0000 7f279a26bb80 10 client.6609 fetch_fsmap learned FSMap version 56 2023-10-06T11:10:09.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.911+0000 7f279a26bb80 1 -- 172.21.15.146:0/1887866529 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x5586a5b410d0 con 0x5586a5df99c0 2023-10-06T11:10:09.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.911+0000 7f2768ff9700 1 -- 172.21.15.146:0/1887866529 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5586a5da8780 con 0x5586a5df99c0 2023-10-06T11:10:09.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.911+0000 7f2768ff9700 1 -- 172.21.15.146:0/1887866529 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 56) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f27840127b0 con 0x5586a5df99c0 2023-10-06T11:10:09.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.911+0000 7f279a26bb80 10 client.6609 fetch_fsmap finished waiting for FSMap version 56 2023-10-06T11:10:09.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.911+0000 7f279a26bb80 10 client.6609 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-10-06T11:10:09.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.911+0000 7f279a26bb80 20 client.6609 populate_metadata read hostname 'smithi146' 2023-10-06T11:10:09.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.911+0000 7f279a26bb80 1 --2- 172.21.15.146:0/1887866529 >> [v2:172.21.15.146:6834/3512281867,v1:172.21.15.146:6835/3512281867] conn(0x5586a5dd9bf0 0x5586a5e11650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:09.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.911+0000 7f279a26bb80 4 client.6609 mds_command: new command op to 6540 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:10:09.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.911+0000 7f279a26bb80 1 -- 172.21.15.146:0/1887866529 --> [v2:172.21.15.146:6834/3512281867,v1:172.21.15.146:6835/3512281867] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5586a5d856b0 con 0x5586a5dd9bf0 2023-10-06T11:10:09.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.912+0000 7f278a59c700 1 --2- 172.21.15.146:0/1887866529 >> [v2:172.21.15.146:6834/3512281867,v1:172.21.15.146:6835/3512281867] conn(0x5586a5dd9bf0 0x5586a5e11650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:09.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.912+0000 7f2768ff9700 10 client.6609 ms_handle_connect on v2:172.21.15.146:6834/3512281867 2023-10-06T11:10:09.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.912+0000 7f278a59c700 1 --2- 172.21.15.146:0/1887866529 >> [v2:172.21.15.146:6834/3512281867,v1:172.21.15.146:6835/3512281867] conn(0x5586a5dd9bf0 0x5586a5e11650 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2c7202a5308747b server_cookie=7a8a5ee33a8f9e34 in_seq=0 out_seq=0 2023-10-06T11:10:09.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.912+0000 7f2768ff9700 1 -- 172.21.15.146:0/1887866529 <== mds.0 v2:172.21.15.146:6834/3512281867 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5586a5d856b0 con 0x5586a5dd9bf0 2023-10-06T11:10:09.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.912+0000 7f2768ff9700 10 client.6609 handle_command_reply: tid=0 2023-10-06T11:10:09.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.912+0000 7f279a26bb80 1 client.6609 shutdown 2023-10-06T11:10:09.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.913+0000 7f279a26bb80 1 -- 172.21.15.146:0/1887866529 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586a5df99c0 msgr2=0x5586a5df3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:09.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.913+0000 7f279a26bb80 1 --2- 172.21.15.146:0/1887866529 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586a5df99c0 0x5586a5df3530 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f278400c6a0 tx=0x7f2784015000 comp rx=0 tx=0).stop 2023-10-06T11:10:09.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.913+0000 7f279a26bb80 1 -- 172.21.15.146:0/1887866529 shutdown_connections 2023-10-06T11:10:09.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.913+0000 7f279a26bb80 1 --2- 172.21.15.146:0/1887866529 >> [v2:172.21.15.146:6834/3512281867,v1:172.21.15.146:6835/3512281867] conn(0x5586a5dd9bf0 0x5586a5e11650 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:09.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.913+0000 7f279a26bb80 1 --2- 172.21.15.146:0/1887866529 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586a5df99c0 0x5586a5df3530 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:09.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.913+0000 7f279a26bb80 1 --2- 172.21.15.146:0/1887866529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586a5daf8c0 0x5586a5dde270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:09.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.913+0000 7f2768ff9700 0 client.6609 ms_handle_reset on v2:172.21.15.146:6834/3512281867 2023-10-06T11:10:09.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.913+0000 7f279a26bb80 1 --2- 172.21.15.146:0/1887866529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5586a5ddcda0 0x5586a5dd8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:09.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.913+0000 7f279a26bb80 1 -- 172.21.15.146:0/1887866529 >> 172.21.15.146:0/1887866529 conn(0x5586a5db5160 msgr2=0x5586a5db44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:09.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.913+0000 7f279a26bb80 1 -- 172.21.15.146:0/1887866529 shutdown_connections 2023-10-06T11:10:09.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.913+0000 7f279a26bb80 1 -- 172.21.15.146:0/1887866529 wait complete. 2023-10-06T11:10:09.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.913+0000 7f279a26bb80 20 client.6609 trim_cache size 0 max 16384 2023-10-06T11:10:09.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.929+0000 7f279a26bb80 1 Processor -- start 2023-10-06T11:10:09.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.929+0000 7f279a26bb80 1 -- start start 2023-10-06T11:10:09.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.929+0000 7f279a26bb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5586a5daf8c0 0x5586a5daf240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:09.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.929+0000 7f279a26bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586a5ddcda0 0x5586a5e10130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:09.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.929+0000 7f279a26bb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586a5df99c0 0x5586a5df0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:09.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.929+0000 7f279a26bb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586a5b86f20 con 0x5586a5df99c0 2023-10-06T11:10:09.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.929+0000 7f279a26bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586a5db1930 con 0x5586a5ddcda0 2023-10-06T11:10:09.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.929+0000 7f279a26bb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5586a5dac1e0 con 0x5586a5daf8c0 2023-10-06T11:10:09.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.929+0000 7f278ad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586a5df99c0 0x5586a5df0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:09.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.929+0000 7f278ad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586a5df99c0 0x5586a5df0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44006/0 (socket says 172.21.15.146:44006) 2023-10-06T11:10:09.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.930+0000 7f278ad9d700 1 -- 172.21.15.146:0/2995854368 learned_addr learned my addr 172.21.15.146:0/2995854368 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:09.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.930+0000 7f278ad9d700 1 -- 172.21.15.146:0/2995854368 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5586a5daf8c0 msgr2=0x5586a5daf240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:09.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.930+0000 7f278a59c700 1 --2- 172.21.15.146:0/2995854368 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5586a5daf8c0 0x5586a5daf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:09.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.930+0000 7f2781d9b700 1 --2- 172.21.15.146:0/2995854368 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586a5ddcda0 0x5586a5e10130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:09.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.930+0000 7f278ad9d700 1 --2- 172.21.15.146:0/2995854368 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5586a5daf8c0 0x5586a5daf240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:09.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.930+0000 7f278ad9d700 1 -- 172.21.15.146:0/2995854368 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586a5ddcda0 msgr2=0x5586a5e10130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:09.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.930+0000 7f278ad9d700 1 --2- 172.21.15.146:0/2995854368 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586a5ddcda0 0x5586a5e10130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:09.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.930+0000 7f278ad9d700 1 -- 172.21.15.146:0/2995854368 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5586a5cd2870 con 0x5586a5df99c0 2023-10-06T11:10:09.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.930+0000 7f278a59c700 1 --2- 172.21.15.146:0/2995854368 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5586a5daf8c0 0x5586a5daf240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:10:09.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.930+0000 7f2781d9b700 1 --2- 172.21.15.146:0/2995854368 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586a5ddcda0 0x5586a5e10130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:10:09.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.930+0000 7f278ad9d700 1 --2- 172.21.15.146:0/2995854368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586a5df99c0 0x5586a5df0a10 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f2784012f80 tx=0x7f278401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e8a16c1fd903b0e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:09.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.930+0000 7f276bfff700 1 -- 172.21.15.146:0/2995854368 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2784006ba0 con 0x5586a5df99c0 2023-10-06T11:10:09.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.930+0000 7f276bfff700 1 -- 172.21.15.146:0/2995854368 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f278400c6d0 con 0x5586a5df99c0 2023-10-06T11:10:09.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.930+0000 7f276bfff700 1 -- 172.21.15.146:0/2995854368 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2784027b10 con 0x5586a5df99c0 2023-10-06T11:10:09.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.931+0000 7f279a26bb80 1 -- 172.21.15.146:0/2995854368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586a5df99c0 msgr2=0x5586a5df0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:09.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.931+0000 7f279a26bb80 1 --2- 172.21.15.146:0/2995854368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586a5df99c0 0x5586a5df0a10 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f2784012f80 tx=0x7f278401f000 comp rx=0 tx=0).stop 2023-10-06T11:10:09.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.931+0000 7f279a26bb80 1 -- 172.21.15.146:0/2995854368 shutdown_connections 2023-10-06T11:10:09.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.931+0000 7f279a26bb80 1 --2- 172.21.15.146:0/2995854368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586a5df99c0 0x5586a5df0a10 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:09.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.931+0000 7f279a26bb80 1 --2- 172.21.15.146:0/2995854368 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5586a5daf8c0 0x5586a5daf240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:09.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.931+0000 7f279a26bb80 1 --2- 172.21.15.146:0/2995854368 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586a5ddcda0 0x5586a5e10130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:09.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.931+0000 7f279a26bb80 1 -- 172.21.15.146:0/2995854368 >> 172.21.15.146:0/2995854368 conn(0x5586a5db5160 msgr2=0x5586a5e0d230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:09.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.931+0000 7f279a26bb80 1 -- 172.21.15.146:0/2995854368 shutdown_connections 2023-10-06T11:10:09.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.931+0000 7f279a26bb80 1 -- 172.21.15.146:0/2995854368 wait complete. 2023-10-06T11:10:09.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.931+0000 7f279a26bb80 1 -- start start 2023-10-06T11:10:09.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.931+0000 7f279a26bb80 1 Processor -- start 2023-10-06T11:10:09.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.932+0000 7f279a26bb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586a5daf8c0 0x5586a5e5e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:09.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.932+0000 7f279a26bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586a5ddcda0 0x5586a5e10130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:09.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.932+0000 7f279a26bb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5586a5df99c0 0x5586a5e10670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:09.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.932+0000 7f279a26bb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586a5ddd6b0 con 0x5586a5daf8c0 2023-10-06T11:10:09.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.932+0000 7f279a26bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586a5dfc390 con 0x5586a5ddcda0 2023-10-06T11:10:09.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.932+0000 7f279a26bb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5586a5e5ed90 con 0x5586a5df99c0 2023-10-06T11:10:09.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.932+0000 7f279a26bb80 10 client.0 _ll_register_callbacks cb 0x5586a5ba1020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:10:09.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.932+0000 7f278a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586a5daf8c0 0x5586a5e5e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:09.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.932+0000 7f278a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586a5daf8c0 0x5586a5e5e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44014/0 (socket says 172.21.15.146:44014) 2023-10-06T11:10:09.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.932+0000 7f278a59c700 1 -- 172.21.15.146:0/3538962453 learned_addr learned my addr 172.21.15.146:0/3538962453 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:09.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.932+0000 7f278ad9d700 1 --2- 172.21.15.146:0/3538962453 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5586a5df99c0 0x5586a5e10670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:09.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.932+0000 7f2781d9b700 1 --2- 172.21.15.146:0/3538962453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586a5ddcda0 0x5586a5e10130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:09.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.933+0000 7f278a59c700 1 -- 172.21.15.146:0/3538962453 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5586a5df99c0 msgr2=0x5586a5e10670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:09.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.933+0000 7f278a59c700 1 --2- 172.21.15.146:0/3538962453 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5586a5df99c0 0x5586a5e10670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:09.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.933+0000 7f278a59c700 1 -- 172.21.15.146:0/3538962453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586a5ddcda0 msgr2=0x5586a5e10130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:09.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.933+0000 7f278a59c700 1 --2- 172.21.15.146:0/3538962453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586a5ddcda0 0x5586a5e10130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:09.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.933+0000 7f278a59c700 1 -- 172.21.15.146:0/3538962453 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5586a5b410d0 con 0x5586a5daf8c0 2023-10-06T11:10:09.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.933+0000 7f2781d9b700 1 --2- 172.21.15.146:0/3538962453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586a5ddcda0 0x5586a5e10130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:10:09.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.933+0000 7f278a59c700 1 --2- 172.21.15.146:0/3538962453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586a5daf8c0 0x5586a5e5e760 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f277c009c20 tx=0x7f277c02b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e3d70bdae753830 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:09.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.933+0000 7f2768ff9700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:10:09.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.933+0000 7f2768ff9700 1 -- 172.21.15.146:0/3538962453 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277c02e040 con 0x5586a5daf8c0 2023-10-06T11:10:09.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.933+0000 7f2768ff9700 1 -- 172.21.15.146:0/3538962453 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(63..63 src has 1..63) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f277c01a040 con 0x5586a5daf8c0 2023-10-06T11:10:09.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.933+0000 7f279a26bb80 1 -- 172.21.15.146:0/3538962453 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f277c029590 con 0x5586a5daf8c0 2023-10-06T11:10:09.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.933+0000 7f2768ff9700 1 -- 172.21.15.146:0/3538962453 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f277c029700 con 0x5586a5daf8c0 2023-10-06T11:10:09.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.933+0000 7f279a26bb80 10 client.6615 fetch_fsmap learned FSMap version 56 2023-10-06T11:10:09.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.933+0000 7f279a26bb80 1 -- 172.21.15.146:0/3538962453 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) v3 -- 0x5586a5cb9560 con 0x5586a5daf8c0 2023-10-06T11:10:09.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.933+0000 7f2768ff9700 1 -- 172.21.15.146:0/3538962453 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277c029590 con 0x5586a5daf8c0 2023-10-06T11:10:09.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.933+0000 7f2768ff9700 1 -- 172.21.15.146:0/3538962453 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 56) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f277c037580 con 0x5586a5daf8c0 2023-10-06T11:10:09.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.933+0000 7f279a26bb80 10 client.6615 fetch_fsmap finished waiting for FSMap version 56 2023-10-06T11:10:09.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.933+0000 7f279a26bb80 10 client.6615 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.a 2023-10-06T11:10:09.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.933+0000 7f279a26bb80 20 client.6615 populate_metadata read hostname 'smithi146' 2023-10-06T11:10:09.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.933+0000 7f279a26bb80 1 --2- 172.21.15.146:0/3538962453 >> [v2:172.21.15.146:6834/3512281867,v1:172.21.15.146:6835/3512281867] conn(0x5586a5de06a0 0x5586a5dddb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:09.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.933+0000 7f279a26bb80 4 client.6615 mds_command: new command op to 6540 tid=0[{"prefix": "scrub start", "path": "/scrub_repair_path", "scrubops": ["repair"]}] 2023-10-06T11:10:09.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.933+0000 7f279a26bb80 1 -- 172.21.15.146:0/3538962453 --> [v2:172.21.15.146:6834/3512281867,v1:172.21.15.146:6835/3512281867] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_repair_path", "scrubops": ["repair"]}) v1 -- 0x5586a5ca6ef0 con 0x5586a5de06a0 2023-10-06T11:10:09.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.933+0000 7f2781d9b700 1 --2- 172.21.15.146:0/3538962453 >> [v2:172.21.15.146:6834/3512281867,v1:172.21.15.146:6835/3512281867] conn(0x5586a5de06a0 0x5586a5dddb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:09.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.934+0000 7f2768ff9700 10 client.6615 ms_handle_connect on v2:172.21.15.146:6834/3512281867 2023-10-06T11:10:09.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.934+0000 7f2781d9b700 1 --2- 172.21.15.146:0/3538962453 >> [v2:172.21.15.146:6834/3512281867,v1:172.21.15.146:6835/3512281867] conn(0x5586a5de06a0 0x5586a5dddb00 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc0bd7d46ae0ef01 server_cookie=2769b5dbfc9ed152 in_seq=0 out_seq=0 2023-10-06T11:10:09.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.934+0000 7f2768ff9700 1 -- 172.21.15.146:0/3538962453 <== mds.0 v2:172.21.15.146:6834/3512281867 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5586a5ca6ef0 con 0x5586a5de06a0 2023-10-06T11:10:09.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.934+0000 7f2768ff9700 10 client.6615 handle_command_reply: tid=0 2023-10-06T11:10:09.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.934+0000 7f279a26bb80 1 client.6615 shutdown 2023-10-06T11:10:09.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.934+0000 7f279a26bb80 1 -- 172.21.15.146:0/3538962453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586a5daf8c0 msgr2=0x5586a5e5e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:09.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.934+0000 7f279a26bb80 1 --2- 172.21.15.146:0/3538962453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586a5daf8c0 0x5586a5e5e760 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f277c009c20 tx=0x7f277c02b040 comp rx=0 tx=0).stop 2023-10-06T11:10:09.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.934+0000 7f279a26bb80 1 -- 172.21.15.146:0/3538962453 shutdown_connections 2023-10-06T11:10:09.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.934+0000 7f279a26bb80 1 --2- 172.21.15.146:0/3538962453 >> [v2:172.21.15.146:6834/3512281867,v1:172.21.15.146:6835/3512281867] conn(0x5586a5de06a0 0x5586a5dddb00 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:09.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.934+0000 7f279a26bb80 1 --2- 172.21.15.146:0/3538962453 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5586a5df99c0 0x5586a5e10670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:09.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.934+0000 7f279a26bb80 1 --2- 172.21.15.146:0/3538962453 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5586a5daf8c0 0x5586a5e5e760 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:09.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.934+0000 7f2768ff9700 0 client.6615 ms_handle_reset on v2:172.21.15.146:6834/3512281867 2023-10-06T11:10:09.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.934+0000 7f279a26bb80 1 --2- 172.21.15.146:0/3538962453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586a5ddcda0 0x5586a5e10130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:09.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.934+0000 7f279a26bb80 1 -- 172.21.15.146:0/3538962453 >> 172.21.15.146:0/3538962453 conn(0x5586a5db5160 msgr2=0x5586a5e0cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:09.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.934+0000 7f279a26bb80 1 -- 172.21.15.146:0/3538962453 shutdown_connections 2023-10-06T11:10:09.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.934+0000 7f279a26bb80 1 -- 172.21.15.146:0/3538962453 wait complete. 2023-10-06T11:10:09.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.935+0000 7f279a26bb80 20 client.6615 trim_cache size 0 max 16384 2023-10-06T11:10:09.946 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:10:09.946 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0, 2023-10-06T11:10:09.946 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_tag": "8e4878ed-1253-4b52-a69f-bf2bf9a3827d", 2023-10-06T11:10:09.946 INFO:teuthology.orchestra.run.smithi146.stdout: "mode": "asynchronous" 2023-10-06T11:10:09.946 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:10:09.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.935+0000 7f2790f73700 1 -- 172.21.15.146:0/3986887572 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f276c066f30 msgr2=0x7f276c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:09.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.935+0000 7f2790f73700 1 --2- 172.21.15.146:0/3986887572 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f276c066f30 0x7f276c0693e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f277c006eb0 tx=0x7f277c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:10:09.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.935+0000 7f2790f73700 1 -- 172.21.15.146:0/3986887572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f278c06ebf0 msgr2=0x7f278c15a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:09.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.935+0000 7f2790f73700 1 --2- 172.21.15.146:0/3986887572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f278c06ebf0 0x7f278c15a320 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f27740015a0 tx=0x7f2774001e50 comp rx=0 tx=0).stop 2023-10-06T11:10:09.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.935+0000 7f2790f73700 1 -- 172.21.15.146:0/3986887572 shutdown_connections 2023-10-06T11:10:09.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.935+0000 7f2790f73700 1 --2- 172.21.15.146:0/3986887572 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f276c066f30 0x7f276c0693e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:09.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.935+0000 7f2790f73700 1 --2- 172.21.15.146:0/3986887572 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f278c15a860 0x7f278c15ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:09.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.935+0000 7f2790f73700 1 --2- 172.21.15.146:0/3986887572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f278c14c480 0x7f278c06e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:09.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.935+0000 7f2790f73700 1 --2- 172.21.15.146:0/3986887572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f278c06ebf0 0x7f278c15a320 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:09.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.935+0000 7f2790f73700 1 -- 172.21.15.146:0/3986887572 >> 172.21.15.146:0/3986887572 conn(0x7f278c06a070 msgr2=0x7f278c1542c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:09.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.935+0000 7f2790f73700 1 -- 172.21.15.146:0/3986887572 shutdown_connections 2023-10-06T11:10:09.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:09.935+0000 7f2790f73700 1 -- 172.21.15.146:0/3986887572 wait complete. 2023-10-06T11:10:09.949 INFO:tasks.cephfs.test_scrub_checks:command 'scrub start /scrub_repair_path repair' returned '{'return_code': 0, 'scrub_tag': '8e4878ed-1253-4b52-a69f-bf2bf9a3827d', 'mode': 'asynchronous'}' 2023-10-06T11:10:19.951 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:10:19.951 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir scrub_repair_path) 2023-10-06T11:10:19.973 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T11:10:19.973 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:10:20.063 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:10:20.107 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T11:10:20.108 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi146.front.sepia.ceph.com... 2023-10-06T11:10:20.108 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T11:10:20.108 DEBUG:teuthology.orchestra.run.smithi146:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T11:10:20.143 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[118815]: fuse finished with error 0 and tester_r 0 2023-10-06T11:10:20.145 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-10-06T11:10:20.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:10:20.145 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T11:10:20.275 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-10-06T11:10:20.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:10:20.276 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T11:10:20.292 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:10:20.293 INFO:teuthology.orchestra.run.smithi151.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-06T11:10:20.293 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-10-06T11:10:20.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:10:20.293 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T11:10:20.308 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:10:20.309 INFO:teuthology.orchestra.run.smithi146.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-06T11:10:20.309 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-10-06T11:10:20.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:10:20.309 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T11:10:20.350 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:10:20.351 INFO:teuthology.orchestra.run.smithi151.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-06T11:10:20.351 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:10:20.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.470+0000 7f1478173700 1 Processor -- start 2023-10-06T11:10:20.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.470+0000 7f1478173700 1 -- start start 2023-10-06T11:10:20.473 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:10:20.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.470+0000 7f1478173700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14701595d0 0x7f14700a98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:20.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.470+0000 7f1478173700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f14700c70e0 0x7f147006ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:20.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.470+0000 7f1478173700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14700a9e10 con 0x7f14701599a0 2023-10-06T11:10:20.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.470+0000 7f1478173700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14700c7650 con 0x7f14700c70e0 2023-10-06T11:10:20.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.470+0000 7f1478173700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14700c7930 con 0x7f14701595d0 2023-10-06T11:10:20.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.470+0000 7f1476710700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f14701599a0 0x7f1470068480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:56698/0 (socket says 172.21.15.146:56698) 2023-10-06T11:10:20.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.470+0000 7f1476710700 1 -- 172.21.15.146:0/755439812 learned_addr learned my addr 172.21.15.146:0/755439812 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:10:20.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.471+0000 7f1474f0d700 1 -- 172.21.15.146:0/755439812 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3841117562 0 0) 0x7f14700a9e10 con 0x7f14701599a0 2023-10-06T11:10:20.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.471+0000 7f147570e700 1 --2- 172.21.15.146:0/755439812 >> v2:172.21.15.151:3300/0 conn(0x7f14700c70e0 0x7f147006ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:20.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.471+0000 7f1475f0f700 1 --2- 172.21.15.146:0/755439812 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14701595d0 0x7f14700a98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:20.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.471+0000 7f1474f0d700 1 -- 172.21.15.146:0/755439812 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f145c003570 con 0x7f14701599a0 2023-10-06T11:10:20.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.471+0000 7f1474f0d700 1 -- 172.21.15.146:0/755439812 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4175693531 0 0) 0x7f145c003570 con 0x7f14701599a0 2023-10-06T11:10:20.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.471+0000 7f1474f0d700 1 -- 172.21.15.146:0/755439812 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14701595d0 msgr2=0x7f14700a98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:20.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.471+0000 7f1474f0d700 1 --2- 172.21.15.146:0/755439812 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14701595d0 0x7f14700a98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:20.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.471+0000 7f1474f0d700 1 -- 172.21.15.146:0/755439812 >> v2:172.21.15.151:3300/0 conn(0x7f14700c70e0 msgr2=0x7f147006ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:20.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.471+0000 7f1474f0d700 1 --2- 172.21.15.146:0/755439812 >> v2:172.21.15.151:3300/0 conn(0x7f14700c70e0 0x7f147006ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:20.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.471+0000 7f1474f0d700 1 -- 172.21.15.146:0/755439812 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14700c7c10 con 0x7f14701599a0 2023-10-06T11:10:20.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.471+0000 7f1474f0d700 1 -- 172.21.15.146:0/755439812 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f14680017f0 con 0x7f14701599a0 2023-10-06T11:10:20.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.471+0000 7f1474f0d700 1 -- 172.21.15.146:0/755439812 >> v1:172.21.15.146:6789/0 conn(0x7f14701599a0 legacy=0x7f1470068480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:20.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.471+0000 7f1474f0d700 1 --2- 172.21.15.146:0/755439812 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f145c003a60 0x7f145c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:20.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.471+0000 7f1474f0d700 1 --2- 172.21.15.146:0/755439812 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14701595d0 0x7f145c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:20.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.471+0000 7f1474f0d700 1 --2- 172.21.15.146:0/755439812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f145c004d50 0x7f145c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:20.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.471+0000 7f1474f0d700 1 -- 172.21.15.146:0/755439812 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14700c7650 con 0x7f145c003a60 2023-10-06T11:10:20.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.471+0000 7f1474f0d700 1 -- 172.21.15.146:0/755439812 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14700c7930 con 0x7f145c004d50 2023-10-06T11:10:20.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.471+0000 7f1474f0d700 1 -- 172.21.15.146:0/755439812 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f145c00ba60 con 0x7f14701595d0 2023-10-06T11:10:20.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.471+0000 7f1475f0f700 1 --2- 172.21.15.146:0/755439812 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f145c003a60 0x7f145c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:20.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.471+0000 7f147570e700 1 --2- 172.21.15.146:0/755439812 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14701595d0 0x7f145c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:20.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.471+0000 7f1476710700 1 --2- 172.21.15.146:0/755439812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f145c004d50 0x7f145c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:20.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.471+0000 7f1475f0f700 1 -- 172.21.15.146:0/755439812 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14701595d0 msgr2=0x7f145c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:20.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.471+0000 7f1475f0f700 1 --2- 172.21.15.146:0/755439812 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14701595d0 0x7f145c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:20.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.471+0000 7f1475f0f700 1 -- 172.21.15.146:0/755439812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f145c004d50 msgr2=0x7f145c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:20.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.471+0000 7f1475f0f700 1 --2- 172.21.15.146:0/755439812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f145c004d50 0x7f145c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:20.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.471+0000 7f1475f0f700 1 -- 172.21.15.146:0/755439812 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f145c003570 con 0x7f145c003a60 2023-10-06T11:10:20.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.471+0000 7f1476710700 1 --2- 172.21.15.146:0/755439812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f145c004d50 0x7f145c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:10:20.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.472+0000 7f1475f0f700 1 --2- 172.21.15.146:0/755439812 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f145c003a60 0x7f145c003e70 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f146c009c00 tx=0x7f146c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdbe824155bd01d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:20.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.472+0000 7f1474f0d700 1 -- 172.21.15.146:0/755439812 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c00e6b0 con 0x7f145c003a60 2023-10-06T11:10:20.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.472+0000 7f1474f0d700 1 -- 172.21.15.146:0/755439812 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f146c00e810 con 0x7f145c003a60 2023-10-06T11:10:20.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.472+0000 7f1474f0d700 1 -- 172.21.15.146:0/755439812 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146c00ebd0 con 0x7f145c003a60 2023-10-06T11:10:20.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.472+0000 7f1478173700 1 -- 172.21.15.146:0/755439812 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f145c003a60 msgr2=0x7f145c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:20.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.472+0000 7f1478173700 1 --2- 172.21.15.146:0/755439812 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f145c003a60 0x7f145c003e70 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f146c009c00 tx=0x7f146c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:10:20.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.472+0000 7f1476710700 1 -- 172.21.15.146:0/755439812 reap_dead start 2023-10-06T11:10:20.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.472+0000 7f1478173700 1 -- 172.21.15.146:0/755439812 shutdown_connections 2023-10-06T11:10:20.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.472+0000 7f1478173700 1 -- 172.21.15.146:0/755439812 >> 172.21.15.146:0/755439812 conn(0x7f14700c9fe0 msgr2=0x7f147006dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:20.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.472+0000 7f1478173700 1 -- 172.21.15.146:0/755439812 shutdown_connections 2023-10-06T11:10:20.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.472+0000 7f1478173700 1 -- 172.21.15.146:0/755439812 wait complete. 2023-10-06T11:10:20.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.473+0000 7f1478173700 1 Processor -- start 2023-10-06T11:10:20.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.473+0000 7f1478173700 1 -- start start 2023-10-06T11:10:20.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.474+0000 7f1478173700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f145c003a60 0x7f14700c3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:20.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.474+0000 7f1478173700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f147016b250 0x7f147015c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:20.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.474+0000 7f1478173700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f147016d680 0x7f147016daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:20.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.474+0000 7f1478173700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147016e030 con 0x7f147016d680 2023-10-06T11:10:20.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.474+0000 7f1478173700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1470150d90 con 0x7f147016b250 2023-10-06T11:10:20.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.474+0000 7f1478173700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1470151630 con 0x7f145c003a60 2023-10-06T11:10:20.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.474+0000 7f1476710700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f147016d680 0x7f147016daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:20.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.474+0000 7f1476710700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f147016d680 0x7f147016daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44010/0 (socket says 172.21.15.146:44010) 2023-10-06T11:10:20.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.474+0000 7f1476710700 1 -- 172.21.15.146:0/3843158227 learned_addr learned my addr 172.21.15.146:0/3843158227 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:20.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.474+0000 7f1475f0f700 1 --2- 172.21.15.146:0/3843158227 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f145c003a60 0x7f14700c3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:20.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.474+0000 7f147570e700 1 --2- 172.21.15.146:0/3843158227 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f147016b250 0x7f147015c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:20.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.475+0000 7f1476710700 1 -- 172.21.15.146:0/3843158227 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f145c003a60 msgr2=0x7f14700c3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:20.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.475+0000 7f1476710700 1 --2- 172.21.15.146:0/3843158227 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f145c003a60 0x7f14700c3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:20.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.475+0000 7f1476710700 1 -- 172.21.15.146:0/3843158227 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f147016b250 msgr2=0x7f147015c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:20.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.475+0000 7f1476710700 1 --2- 172.21.15.146:0/3843158227 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f147016b250 0x7f147015c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:20.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.475+0000 7f1476710700 1 -- 172.21.15.146:0/3843158227 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f147015cb50 con 0x7f147016d680 2023-10-06T11:10:20.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.475+0000 7f1476710700 1 --2- 172.21.15.146:0/3843158227 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f147016d680 0x7f147016daf0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f1468000f80 tx=0x7f1468002180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:20.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.475+0000 7f1465ffb700 1 -- 172.21.15.146:0/3843158227 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1468017070 con 0x7f147016d680 2023-10-06T11:10:20.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.475+0000 7f1465ffb700 1 -- 172.21.15.146:0/3843158227 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f146800eb80 con 0x7f147016d680 2023-10-06T11:10:20.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.475+0000 7f1465ffb700 1 -- 172.21.15.146:0/3843158227 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1468013420 con 0x7f147016d680 2023-10-06T11:10:20.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.475+0000 7f1478173700 1 -- 172.21.15.146:0/3843158227 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1470150fe0 con 0x7f147016d680 2023-10-06T11:10:20.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.475+0000 7f1478173700 1 -- 172.21.15.146:0/3843158227 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f147015c860 con 0x7f147016d680 2023-10-06T11:10:20.494 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:10:20.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.476+0000 7f1478173700 1 -- 172.21.15.146:0/3843158227 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14701517c0 con 0x7f147016d680 2023-10-06T11:10:20.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.476+0000 7f1465ffb700 1 -- 172.21.15.146:0/3843158227 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1468013850 con 0x7f147016d680 2023-10-06T11:10:20.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.477+0000 7f1465ffb700 1 --2- 172.21.15.146:0/3843158227 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1454066f30 0x7f14540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:20.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.477+0000 7f1465ffb700 1 -- 172.21.15.146:0/3843158227 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f14680845f0 con 0x7f147016d680 2023-10-06T11:10:20.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.477+0000 7f1475f0f700 1 --2- 172.21.15.146:0/3843158227 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1454066f30 0x7f14540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:20.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.477+0000 7f1475f0f700 1 --2- 172.21.15.146:0/3843158227 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1454066f30 0x7f14540693e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f146c0091e0 tx=0x7f146c01a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:20.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.481+0000 7f1465ffb700 1 -- 172.21.15.146:0/3843158227 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1468051630 con 0x7f147016d680 2023-10-06T11:10:20.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.711+0000 7f1478173700 1 -- 172.21.15.146:0/3843158227 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f147004c380 con 0x7f147016d680 2023-10-06T11:10:20.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.711+0000 7f1465ffb700 1 -- 172.21.15.146:0/3843158227 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4611 (secure 0 0 0) 0x7f1468054c50 con 0x7f147016d680 2023-10-06T11:10:20.713 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:10:20.713 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":56,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5621,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/1872666923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1872666923},{"type":"v1","addr":"172.21.15.151:6833","nonce":1872666923}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":6082,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1430806818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1430806818},{"type":"v1","addr":"172.21.15.151:6835","nonce":1430806818}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":6546,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/1394956500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":1394956500},{"type":"v1","addr":"172.21.15.146:6837","nonce":1394956500}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:09:41.580951+0000","modified":"2023-10-06T11:10:06.415726+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":63,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6540},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6540":{"gid":6540,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6835/3512281867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3512281867},{"type":"v1","addr":"172.21.15.146:6835","nonce":3512281867}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T11:10:20.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.713+0000 7f1478173700 1 -- 172.21.15.146:0/3843158227 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1454066f30 msgr2=0x7f14540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:20.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.713+0000 7f1478173700 1 --2- 172.21.15.146:0/3843158227 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1454066f30 0x7f14540693e0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f146c0091e0 tx=0x7f146c01a000 comp rx=0 tx=0).stop 2023-10-06T11:10:20.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.713+0000 7f1478173700 1 -- 172.21.15.146:0/3843158227 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f147016d680 msgr2=0x7f147016daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:20.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.713+0000 7f1478173700 1 --2- 172.21.15.146:0/3843158227 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f147016d680 0x7f147016daf0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f1468000f80 tx=0x7f1468002180 comp rx=0 tx=0).stop 2023-10-06T11:10:20.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.713+0000 7f1478173700 1 -- 172.21.15.146:0/3843158227 shutdown_connections 2023-10-06T11:10:20.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.713+0000 7f1478173700 1 --2- 172.21.15.146:0/3843158227 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1454066f30 0x7f14540693e0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:20.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.713+0000 7f1478173700 1 --2- 172.21.15.146:0/3843158227 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f147016d680 0x7f147016daf0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:20.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.713+0000 7f1478173700 1 --2- 172.21.15.146:0/3843158227 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f145c003a60 0x7f14700c3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:20.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.713+0000 7f1478173700 1 --2- 172.21.15.146:0/3843158227 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f147016b250 0x7f147015c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:20.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.713+0000 7f1478173700 1 -- 172.21.15.146:0/3843158227 >> 172.21.15.146:0/3843158227 conn(0x7f14700c9fe0 msgr2=0x7f14700c2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:20.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.713+0000 7f1478173700 1 -- 172.21.15.146:0/3843158227 shutdown_connections 2023-10-06T11:10:20.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.713+0000 7f1478173700 1 -- 172.21.15.146:0/3843158227 wait complete. 2023-10-06T11:10:20.716 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 56 2023-10-06T11:10:20.727 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:10:20.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.841+0000 7f3e4163f700 1 Processor -- start 2023-10-06T11:10:20.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.841+0000 7f3e4163f700 1 -- start start 2023-10-06T11:10:20.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.842+0000 7f3e4163f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e3c153e80 0x7f3e3c15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:20.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.842+0000 7f3e4163f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e3c15ac30 con 0x7f3e3c068ba0 2023-10-06T11:10:20.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.842+0000 7f3e4163f700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e3c0b4510 con 0x7f3e3c153ab0 2023-10-06T11:10:20.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.842+0000 7f3e4163f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c0b6530 con 0x7f3e3c153e80 2023-10-06T11:10:20.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.842+0000 7f3e327fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3e3c068ba0 0x7f3e3c0b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:56700/0 (socket says 172.21.15.146:56700) 2023-10-06T11:10:20.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.842+0000 7f3e327fc700 1 -- 172.21.15.146:0/466298280 learned_addr learned my addr 172.21.15.146:0/466298280 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:10:20.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.842+0000 7f3e3b7fe700 1 --2- 172.21.15.146:0/466298280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e3c153e80 0x7f3e3c15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:20.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.843+0000 7f3e3a7fc700 1 -- 172.21.15.146:0/466298280 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1611109182 0 0) 0x7f3e24001110 con 0x7f3e3c068ba0 2023-10-06T11:10:20.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.843+0000 7f3e3a7fc700 1 -- 172.21.15.146:0/466298280 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e28003570 con 0x7f3e3c068ba0 2023-10-06T11:10:20.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.843+0000 7f3e3a7fc700 1 -- 172.21.15.146:0/466298280 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1745264548 0 0) 0x7f3e28003570 con 0x7f3e3c068ba0 2023-10-06T11:10:20.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.843+0000 7f3e3a7fc700 1 -- 172.21.15.146:0/466298280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e3c153e80 msgr2=0x7f3e3c15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:20.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.843+0000 7f3e3a7fc700 1 --2- 172.21.15.146:0/466298280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e3c153e80 0x7f3e3c15a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:20.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.843+0000 7f3e3a7fc700 1 -- 172.21.15.146:0/466298280 >> v1:172.21.15.151:6789/0 conn(0x7f3e3c153ab0 legacy=0x7f3e3c068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:20.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.843+0000 7f3e3a7fc700 1 -- 172.21.15.146:0/466298280 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3c0b5c50 con 0x7f3e3c068ba0 2023-10-06T11:10:20.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.843+0000 7f3e3a7fc700 1 -- 172.21.15.146:0/466298280 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f3e24001600 con 0x7f3e3c068ba0 2023-10-06T11:10:20.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.843+0000 7f3e3a7fc700 1 -- 172.21.15.146:0/466298280 >> v1:172.21.15.146:6789/0 conn(0x7f3e3c068ba0 legacy=0x7f3e3c0b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:20.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.843+0000 7f3e3a7fc700 1 --2- 172.21.15.146:0/466298280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e3c153e80 0x7f3e28003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:20.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.843+0000 7f3e3a7fc700 1 --2- 172.21.15.146:0/466298280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e28003fd0 0x7f3e28004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:20.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.843+0000 7f3e3a7fc700 1 --2- 172.21.15.146:0/466298280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e28004d50 0x7f3e280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:20.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.843+0000 7f3e3a7fc700 1 -- 172.21.15.146:0/466298280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c0b6530 con 0x7f3e28004d50 2023-10-06T11:10:20.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.843+0000 7f3e3a7fc700 1 -- 172.21.15.146:0/466298280 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2800bb40 con 0x7f3e28003fd0 2023-10-06T11:10:20.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.843+0000 7f3e3a7fc700 1 -- 172.21.15.146:0/466298280 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e2800bd00 con 0x7f3e3c153e80 2023-10-06T11:10:20.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.843+0000 7f3e3b7fe700 1 --2- 172.21.15.146:0/466298280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e28004d50 0x7f3e280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:20.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.843+0000 7f3e3affd700 1 --2- 172.21.15.146:0/466298280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e3c153e80 0x7f3e28003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:20.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.843+0000 7f3e327fc700 1 --2- 172.21.15.146:0/466298280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e28003fd0 0x7f3e28004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:20.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.843+0000 7f3e3b7fe700 1 -- 172.21.15.146:0/466298280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e3c153e80 msgr2=0x7f3e28003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:20.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.843+0000 7f3e3b7fe700 1 --2- 172.21.15.146:0/466298280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e3c153e80 0x7f3e28003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:20.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.843+0000 7f3e3b7fe700 1 -- 172.21.15.146:0/466298280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e28003fd0 msgr2=0x7f3e28004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:20.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.843+0000 7f3e3b7fe700 1 --2- 172.21.15.146:0/466298280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e28003fd0 0x7f3e28004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:20.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.843+0000 7f3e3b7fe700 1 -- 172.21.15.146:0/466298280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e28003570 con 0x7f3e28004d50 2023-10-06T11:10:20.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.843+0000 7f3e3b7fe700 1 --2- 172.21.15.146:0/466298280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e28004d50 0x7f3e280051c0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f3e3400e210 tx=0x7f3e3400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11a92e11ad7a9953 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:20.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.844+0000 7f3e3a7fc700 1 -- 172.21.15.146:0/466298280 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3400eac0 con 0x7f3e28004d50 2023-10-06T11:10:20.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.844+0000 7f3e3a7fc700 1 -- 172.21.15.146:0/466298280 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3400f040 con 0x7f3e28004d50 2023-10-06T11:10:20.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.844+0000 7f3e3a7fc700 1 -- 172.21.15.146:0/466298280 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3400ee70 con 0x7f3e28004d50 2023-10-06T11:10:20.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.844+0000 7f3e4163f700 1 -- 172.21.15.146:0/466298280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e28004d50 msgr2=0x7f3e280051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:20.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.844+0000 7f3e4163f700 1 --2- 172.21.15.146:0/466298280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e28004d50 0x7f3e280051c0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f3e3400e210 tx=0x7f3e3400b040 comp rx=0 tx=0).stop 2023-10-06T11:10:20.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.844+0000 7f3e3b7fe700 1 -- 172.21.15.146:0/466298280 reap_dead start 2023-10-06T11:10:20.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.844+0000 7f3e4163f700 1 -- 172.21.15.146:0/466298280 shutdown_connections 2023-10-06T11:10:20.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.844+0000 7f3e4163f700 1 -- 172.21.15.146:0/466298280 >> 172.21.15.146:0/466298280 conn(0x7f3e3c06eba0 msgr2=0x7f3e3c06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:20.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.844+0000 7f3e4163f700 1 -- 172.21.15.146:0/466298280 shutdown_connections 2023-10-06T11:10:20.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.844+0000 7f3e4163f700 1 -- 172.21.15.146:0/466298280 wait complete. 2023-10-06T11:10:20.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.845+0000 7f3e4163f700 1 Processor -- start 2023-10-06T11:10:20.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.845+0000 7f3e4163f700 1 -- start start 2023-10-06T11:10:20.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.846+0000 7f3e4163f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e28004d50 0x7f3e3c151240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:20.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.846+0000 7f3e4163f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e3c156250 0x7f3e3c16a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.846+0000 7f3e4163f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e3c16ad50 0x7f3e3c15c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.846+0000 7f3e4163f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c151780 con 0x7f3e3c16ad50 2023-10-06T11:10:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.846+0000 7f3e4163f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c1573b0 con 0x7f3e3c156250 2023-10-06T11:10:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.846+0000 7f3e4163f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c16ab40 con 0x7f3e28004d50 2023-10-06T11:10:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.846+0000 7f3e3b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e3c16ad50 0x7f3e3c15c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.846+0000 7f3e3b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e3c16ad50 0x7f3e3c15c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44028/0 (socket says 172.21.15.146:44028) 2023-10-06T11:10:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.846+0000 7f3e3b7fe700 1 -- 172.21.15.146:0/736124114 learned_addr learned my addr 172.21.15.146:0/736124114 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.847+0000 7f3e3affd700 1 --2- 172.21.15.146:0/736124114 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e28004d50 0x7f3e3c151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.847+0000 7f3e327fc700 1 --2- 172.21.15.146:0/736124114 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e3c156250 0x7f3e3c16a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.847+0000 7f3e3b7fe700 1 -- 172.21.15.146:0/736124114 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e28004d50 msgr2=0x7f3e3c151240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.847+0000 7f3e3b7fe700 1 --2- 172.21.15.146:0/736124114 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e28004d50 0x7f3e3c151240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:20.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.847+0000 7f3e3b7fe700 1 -- 172.21.15.146:0/736124114 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e3c156250 msgr2=0x7f3e3c16a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:20.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.847+0000 7f3e3b7fe700 1 --2- 172.21.15.146:0/736124114 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e3c156250 0x7f3e3c16a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:20.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.847+0000 7f3e3b7fe700 1 -- 172.21.15.146:0/736124114 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3c1567a0 con 0x7f3e3c16ad50 2023-10-06T11:10:20.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.847+0000 7f3e3affd700 1 --2- 172.21.15.146:0/736124114 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e28004d50 0x7f3e3c151240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:10:20.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.847+0000 7f3e3b7fe700 1 --2- 172.21.15.146:0/736124114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e3c16ad50 0x7f3e3c15c080 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f3e34016000 tx=0x7f3e3401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:20.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.847+0000 7f3e337fe700 1 -- 172.21.15.146:0/736124114 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3401d630 con 0x7f3e3c16ad50 2023-10-06T11:10:20.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.847+0000 7f3e337fe700 1 -- 172.21.15.146:0/736124114 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e3401d790 con 0x7f3e3c16ad50 2023-10-06T11:10:20.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.847+0000 7f3e4163f700 1 -- 172.21.15.146:0/736124114 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e3c156a80 con 0x7f3e3c16ad50 2023-10-06T11:10:20.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.847+0000 7f3e337fe700 1 -- 172.21.15.146:0/736124114 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e3401db50 con 0x7f3e3c16ad50 2023-10-06T11:10:20.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.847+0000 7f3e4163f700 1 -- 172.21.15.146:0/736124114 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e3c157040 con 0x7f3e3c16ad50 2023-10-06T11:10:20.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.848+0000 7f3e4163f700 1 -- 172.21.15.146:0/736124114 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e3c157540 con 0x7f3e3c16ad50 2023-10-06T11:10:20.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.848+0000 7f3e337fe700 1 -- 172.21.15.146:0/736124114 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3e34003040 con 0x7f3e3c16ad50 2023-10-06T11:10:20.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.849+0000 7f3e337fe700 1 --2- 172.21.15.146:0/736124114 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3e1c066f30 0x7f3e1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:20.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.849+0000 7f3e3affd700 1 --2- 172.21.15.146:0/736124114 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3e1c066f30 0x7f3e1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:20.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.849+0000 7f3e337fe700 1 -- 172.21.15.146:0/736124114 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f3e34086470 con 0x7f3e3c16ad50 2023-10-06T11:10:20.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.849+0000 7f3e3affd700 1 --2- 172.21.15.146:0/736124114 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3e1c066f30 0x7f3e1c0693e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c000f60 tx=0x7f3e2c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:20.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:20.853+0000 7f3e337fe700 1 -- 172.21.15.146:0/736124114 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3e340534d0 con 0x7f3e3c16ad50 2023-10-06T11:10:21.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.038+0000 7f3e4163f700 1 -- 172.21.15.146:0/736124114 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e3c04c380 con 0x7f3e3c16ad50 2023-10-06T11:10:21.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.039+0000 7f3e337fe700 1 -- 172.21.15.146:0/736124114 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+17177 (secure 0 0 0) 0x7f3e34056af0 con 0x7f3e3c16ad50 2023-10-06T11:10:21.041 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:10:21.041 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":63,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:10:03.392685+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:09:39.260612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-06T11:09:40.552424+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6834/236648406":"2023-10-07T11:10:03.392660+0000","172.21.15.146:6836/236648406":"2023-10-07T11:10:03.392660+0000","172.21.15.151:6833/2990544048":"2023-10-07T11:10:02.392572+0000","172.21.15.151:6835/2990544048":"2023-10-07T11:10:02.392572+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:10:21.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.042+0000 7f3e4163f700 1 -- 172.21.15.146:0/736124114 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3e1c066f30 msgr2=0x7f3e1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:21.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.042+0000 7f3e4163f700 1 --2- 172.21.15.146:0/736124114 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3e1c066f30 0x7f3e1c0693e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c000f60 tx=0x7f3e2c009040 comp rx=0 tx=0).stop 2023-10-06T11:10:21.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.042+0000 7f3e4163f700 1 -- 172.21.15.146:0/736124114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e3c16ad50 msgr2=0x7f3e3c15c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:21.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.042+0000 7f3e4163f700 1 --2- 172.21.15.146:0/736124114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e3c16ad50 0x7f3e3c15c080 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f3e34016000 tx=0x7f3e3401a000 comp rx=0 tx=0).stop 2023-10-06T11:10:21.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.042+0000 7f3e4163f700 1 -- 172.21.15.146:0/736124114 shutdown_connections 2023-10-06T11:10:21.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.042+0000 7f3e4163f700 1 --2- 172.21.15.146:0/736124114 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3e1c066f30 0x7f3e1c0693e0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:21.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.042+0000 7f3e4163f700 1 --2- 172.21.15.146:0/736124114 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e3c16ad50 0x7f3e3c15c080 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:21.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.042+0000 7f3e4163f700 1 --2- 172.21.15.146:0/736124114 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3e28004d50 0x7f3e3c151240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:21.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.042+0000 7f3e4163f700 1 --2- 172.21.15.146:0/736124114 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e3c156250 0x7f3e3c16a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:21.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.042+0000 7f3e4163f700 1 -- 172.21.15.146:0/736124114 >> 172.21.15.146:0/736124114 conn(0x7f3e3c06eba0 msgr2=0x7f3e3c068470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:21.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.042+0000 7f3e4163f700 1 -- 172.21.15.146:0/736124114 shutdown_connections 2023-10-06T11:10:21.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.042+0000 7f3e4163f700 1 -- 172.21.15.146:0/736124114 wait complete. 2023-10-06T11:10:21.055 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:05:36.687307+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:05:37.171199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T11:09:39.260612+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '58', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T11:09:40.552424+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T11:10:21.056 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:10:21.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.172+0000 7fbd53963700 1 Processor -- start 2023-10-06T11:10:21.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.172+0000 7fbd53963700 1 -- start start 2023-10-06T11:10:21.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.173+0000 7fbd53963700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbd4c0ae730 0x7fbd4c0aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:21.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.173+0000 7fbd53963700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbd4c0cb950 0x7fbd4c0cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:21.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.173+0000 7fbd53963700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd4c0ae2a0 con 0x7fbd4c15a160 2023-10-06T11:10:21.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.173+0000 7fbd53963700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd4c15a530 con 0x7fbd4c0ae730 2023-10-06T11:10:21.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.173+0000 7fbd53963700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd4c0c5cb0 con 0x7fbd4c0cb950 2023-10-06T11:10:21.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.173+0000 7fbd50efe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbd4c0ae730 0x7fbd4c0aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:21.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.173+0000 7fbd516ff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fbd4c15a160 0x7fbd4c0c55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:56704/0 (socket says 172.21.15.146:56704) 2023-10-06T11:10:21.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.173+0000 7fbd516ff700 1 -- 172.21.15.146:0/2844662226 learned_addr learned my addr 172.21.15.146:0/2844662226 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:10:21.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.173+0000 7fbd43fff700 1 -- 172.21.15.146:0/2844662226 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2138322065 0 0) 0x7fbd4c0ae2a0 con 0x7fbd4c15a160 2023-10-06T11:10:21.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.173+0000 7fbd51f00700 1 --2- 172.21.15.146:0/2844662226 >> v2:172.21.15.151:3300/0 conn(0x7fbd4c0cb950 0x7fbd4c0cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:21.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.173+0000 7fbd43fff700 1 -- 172.21.15.146:0/2844662226 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd38003570 con 0x7fbd4c15a160 2023-10-06T11:10:21.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.173+0000 7fbd50efe700 1 -- 172.21.15.146:0/2844662226 >> v2:172.21.15.151:3300/0 conn(0x7fbd4c0cb950 msgr2=0x7fbd4c0cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:21.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.173+0000 7fbd50efe700 1 --2- 172.21.15.146:0/2844662226 >> v2:172.21.15.151:3300/0 conn(0x7fbd4c0cb950 0x7fbd4c0cbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:21.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.173+0000 7fbd50efe700 1 -- 172.21.15.146:0/2844662226 >> v1:172.21.15.146:6789/0 conn(0x7fbd4c15a160 legacy=0x7fbd4c0c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:21.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.173+0000 7fbd50efe700 1 -- 172.21.15.146:0/2844662226 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4c0af0f0 con 0x7fbd4c0ae730 2023-10-06T11:10:21.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.173+0000 7fbd50efe700 1 --2- 172.21.15.146:0/2844662226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd4c0ae730 0x7fbd4c0aebb0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c08b000 tx=0x7fbd3c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2082d48e58cda08 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:21.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.173+0000 7fbd43fff700 1 -- 172.21.15.146:0/2844662226 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c011630 con 0x7fbd4c0ae730 2023-10-06T11:10:21.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.173+0000 7fbd43fff700 1 -- 172.21.15.146:0/2844662226 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3c011790 con 0x7fbd4c0ae730 2023-10-06T11:10:21.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.173+0000 7fbd43fff700 1 -- 172.21.15.146:0/2844662226 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c011b30 con 0x7fbd4c0ae730 2023-10-06T11:10:21.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.173+0000 7fbd53963700 1 -- 172.21.15.146:0/2844662226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd4c0ae730 msgr2=0x7fbd4c0aebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:21.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.173+0000 7fbd53963700 1 --2- 172.21.15.146:0/2844662226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd4c0ae730 0x7fbd4c0aebb0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c08b000 tx=0x7fbd3c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:10:21.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.173+0000 7fbd53963700 1 -- 172.21.15.146:0/2844662226 shutdown_connections 2023-10-06T11:10:21.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.173+0000 7fbd53963700 1 --2- 172.21.15.146:0/2844662226 >> v2:172.21.15.151:3300/0 conn(0x7fbd4c0cb950 0x7fbd4c0cbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:21.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.173+0000 7fbd53963700 1 --2- 172.21.15.146:0/2844662226 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd4c0ae730 0x7fbd4c0aebb0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:21.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.173+0000 7fbd53963700 1 -- 172.21.15.146:0/2844662226 >> 172.21.15.146:0/2844662226 conn(0x7fbd4c06f380 msgr2=0x7fbd4c0d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:21.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.173+0000 7fbd53963700 1 -- 172.21.15.146:0/2844662226 shutdown_connections 2023-10-06T11:10:21.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.173+0000 7fbd53963700 1 -- 172.21.15.146:0/2844662226 wait complete. 2023-10-06T11:10:21.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.174+0000 7fbd53963700 1 Processor -- start 2023-10-06T11:10:21.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.174+0000 7fbd53963700 1 -- start start 2023-10-06T11:10:21.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.176+0000 7fbd53963700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd4c0ae730 0x7fbd4c157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:21.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.176+0000 7fbd53963700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd4c0cb950 0x7fbd4c069680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:21.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.176+0000 7fbd53963700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd4c15a160 0x7fbd4c069bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:21.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.176+0000 7fbd53963700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c0af7f0 con 0x7fbd4c15a160 2023-10-06T11:10:21.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.176+0000 7fbd53963700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c0c8500 con 0x7fbd4c0cb950 2023-10-06T11:10:21.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.176+0000 7fbd53963700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4c0c87e0 con 0x7fbd4c0ae730 2023-10-06T11:10:21.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.176+0000 7fbd51f00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd4c15a160 0x7fbd4c069bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:21.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.176+0000 7fbd51f00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd4c15a160 0x7fbd4c069bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:44052/0 (socket says 172.21.15.146:44052) 2023-10-06T11:10:21.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.176+0000 7fbd51f00700 1 -- 172.21.15.146:0/687556301 learned_addr learned my addr 172.21.15.146:0/687556301 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:21.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.176+0000 7fbd516ff700 1 --2- 172.21.15.146:0/687556301 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd4c0ae730 0x7fbd4c157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:21.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.176+0000 7fbd50efe700 1 --2- 172.21.15.146:0/687556301 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd4c0cb950 0x7fbd4c069680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:21.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.176+0000 7fbd51f00700 1 -- 172.21.15.146:0/687556301 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd4c0ae730 msgr2=0x7fbd4c157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:21.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.176+0000 7fbd51f00700 1 --2- 172.21.15.146:0/687556301 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd4c0ae730 0x7fbd4c157620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:21.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.176+0000 7fbd51f00700 1 -- 172.21.15.146:0/687556301 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd4c0cb950 msgr2=0x7fbd4c069680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:21.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.176+0000 7fbd51f00700 1 --2- 172.21.15.146:0/687556301 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd4c0cb950 0x7fbd4c069680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:21.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.176+0000 7fbd51f00700 1 -- 172.21.15.146:0/687556301 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd3c009420 con 0x7fbd4c15a160 2023-10-06T11:10:21.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.176+0000 7fbd516ff700 1 --2- 172.21.15.146:0/687556301 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd4c0ae730 0x7fbd4c157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:10:21.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.176+0000 7fbd50efe700 1 --2- 172.21.15.146:0/687556301 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd4c0cb950 0x7fbd4c069680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:10:21.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.176+0000 7fbd51f00700 1 --2- 172.21.15.146:0/687556301 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd4c15a160 0x7fbd4c069bc0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fbd4400d890 tx=0x7fbd44008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:21.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.176+0000 7fbd417fa700 1 -- 172.21.15.146:0/687556301 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd440125f0 con 0x7fbd4c15a160 2023-10-06T11:10:21.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.176+0000 7fbd417fa700 1 -- 172.21.15.146:0/687556301 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd44012770 con 0x7fbd4c15a160 2023-10-06T11:10:21.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.176+0000 7fbd53963700 1 -- 172.21.15.146:0/687556301 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd4c0af480 con 0x7fbd4c15a160 2023-10-06T11:10:21.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.176+0000 7fbd417fa700 1 -- 172.21.15.146:0/687556301 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd44012b30 con 0x7fbd4c15a160 2023-10-06T11:10:21.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.176+0000 7fbd53963700 1 -- 172.21.15.146:0/687556301 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd4c157d20 con 0x7fbd4c15a160 2023-10-06T11:10:21.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.177+0000 7fbd53963700 1 -- 172.21.15.146:0/687556301 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd4c0af2e0 con 0x7fbd4c15a160 2023-10-06T11:10:21.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.177+0000 7fbd417fa700 1 -- 172.21.15.146:0/687556301 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbd4401e460 con 0x7fbd4c15a160 2023-10-06T11:10:21.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.177+0000 7fbd417fa700 1 --2- 172.21.15.146:0/687556301 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbd30066f30 0x7fbd300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:21.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.179+0000 7fbd516ff700 1 --2- 172.21.15.146:0/687556301 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbd30066f30 0x7fbd300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:21.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.179+0000 7fbd417fa700 1 -- 172.21.15.146:0/687556301 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6230+0+0 (secure 0 0 0) 0x7fbd44084c70 con 0x7fbd4c15a160 2023-10-06T11:10:21.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.179+0000 7fbd516ff700 1 --2- 172.21.15.146:0/687556301 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbd30066f30 0x7fbd300693e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fbd48007fd0 tx=0x7fbd48009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:21.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.182+0000 7fbd417fa700 1 -- 172.21.15.146:0/687556301 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbd4c0af2e0 con 0x7fbd4c15a160 2023-10-06T11:10:21.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.365+0000 7fbd53963700 1 -- 172.21.15.146:0/687556301 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbd4c0af2e0 con 0x7fbd4c15a160 2023-10-06T11:10:21.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.366+0000 7fbd417fa700 1 -- 172.21.15.146:0/687556301 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v63) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbd4c0af2e0 con 0x7fbd4c15a160 2023-10-06T11:10:21.367 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-10-06T11:10:21.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.368+0000 7fbd53963700 1 -- 172.21.15.146:0/687556301 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbd30066f30 msgr2=0x7fbd300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:21.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.368+0000 7fbd53963700 1 --2- 172.21.15.146:0/687556301 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbd30066f30 0x7fbd300693e0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fbd48007fd0 tx=0x7fbd48009040 comp rx=0 tx=0).stop 2023-10-06T11:10:21.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.368+0000 7fbd53963700 1 -- 172.21.15.146:0/687556301 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd4c15a160 msgr2=0x7fbd4c069bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:21.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.368+0000 7fbd53963700 1 --2- 172.21.15.146:0/687556301 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd4c15a160 0x7fbd4c069bc0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fbd4400d890 tx=0x7fbd44008040 comp rx=0 tx=0).stop 2023-10-06T11:10:21.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.368+0000 7fbd53963700 1 -- 172.21.15.146:0/687556301 shutdown_connections 2023-10-06T11:10:21.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.368+0000 7fbd53963700 1 --2- 172.21.15.146:0/687556301 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbd30066f30 0x7fbd300693e0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:21.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.368+0000 7fbd53963700 1 --2- 172.21.15.146:0/687556301 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd4c15a160 0x7fbd4c069bc0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:21.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.368+0000 7fbd53963700 1 --2- 172.21.15.146:0/687556301 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd4c0ae730 0x7fbd4c157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:21.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.368+0000 7fbd53963700 1 --2- 172.21.15.146:0/687556301 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd4c0cb950 0x7fbd4c069680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:21.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.368+0000 7fbd53963700 1 -- 172.21.15.146:0/687556301 >> 172.21.15.146:0/687556301 conn(0x7fbd4c06f380 msgr2=0x7fbd4c0c55a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:21.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.368+0000 7fbd53963700 1 -- 172.21.15.146:0/687556301 shutdown_connections 2023-10-06T11:10:21.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.368+0000 7fbd53963700 1 -- 172.21.15.146:0/687556301 wait complete. 2023-10-06T11:10:21.382 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:10:21.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.503+0000 7f8836b14700 1 Processor -- start 2023-10-06T11:10:21.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.503+0000 7f8836b14700 1 -- start start 2023-10-06T11:10:21.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.504+0000 7f8836b14700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8830159cc0 0x7f8830068480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:21.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.504+0000 7f8836b14700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88300a9950 con 0x7f88301598f0 2023-10-06T11:10:21.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.504+0000 7f8836b14700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8830068dd0 con 0x7f88300689c0 2023-10-06T11:10:21.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.504+0000 7f8836b14700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f883015a110 con 0x7f8830159cc0 2023-10-06T11:10:21.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.504+0000 7f882ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8830159cc0 0x7f8830068480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:21.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.504+0000 7f88348b0700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f88301598f0 0x7f88300ca570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36818/0 (socket says 172.21.15.146:36818) 2023-10-06T11:10:21.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.504+0000 7f88348b0700 1 -- 172.21.15.146:0/3710754640 learned_addr learned my addr 172.21.15.146:0/3710754640 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:10:21.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.504+0000 7f882ffff700 1 -- 172.21.15.146:0/3710754640 >> v1:172.21.15.151:6789/0 conn(0x7f88300689c0 legacy=0x7f88300a9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:21.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.504+0000 7f882ffff700 1 -- 172.21.15.146:0/3710754640 >> v1:172.21.15.146:6789/0 conn(0x7f88301598f0 legacy=0x7f88300ca570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:21.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.504+0000 7f882ffff700 1 -- 172.21.15.146:0/3710754640 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883015a3e0 con 0x7f8830159cc0 2023-10-06T11:10:21.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.504+0000 7f882ffff700 1 --2- 172.21.15.146:0/3710754640 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8830159cc0 0x7f8830068480 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f881c0098e0 tx=0x7f881c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c859148b7f46b0d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:21.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.505+0000 7f882f7fe700 1 -- 172.21.15.146:0/3710754640 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c009e80 con 0x7f8830159cc0 2023-10-06T11:10:21.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.505+0000 7f882f7fe700 1 -- 172.21.15.146:0/3710754640 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881c00b820 con 0x7f8830159cc0 2023-10-06T11:10:21.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.505+0000 7f882f7fe700 1 -- 172.21.15.146:0/3710754640 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c00bba0 con 0x7f8830159cc0 2023-10-06T11:10:21.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.505+0000 7f8836b14700 1 -- 172.21.15.146:0/3710754640 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8830159cc0 msgr2=0x7f8830068480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:21.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.505+0000 7f8836b14700 1 --2- 172.21.15.146:0/3710754640 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8830159cc0 0x7f8830068480 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f881c0098e0 tx=0x7f881c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:10:21.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.505+0000 7f8836b14700 1 -- 172.21.15.146:0/3710754640 shutdown_connections 2023-10-06T11:10:21.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.505+0000 7f8836b14700 1 --2- 172.21.15.146:0/3710754640 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8830159cc0 0x7f8830068480 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:21.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.505+0000 7f8836b14700 1 -- 172.21.15.146:0/3710754640 >> 172.21.15.146:0/3710754640 conn(0x7f88300c9f50 msgr2=0x7f883006dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:21.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.505+0000 7f8836b14700 1 -- 172.21.15.146:0/3710754640 shutdown_connections 2023-10-06T11:10:21.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.505+0000 7f8836b14700 1 -- 172.21.15.146:0/3710754640 wait complete. 2023-10-06T11:10:21.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.506+0000 7f8836b14700 1 Processor -- start 2023-10-06T11:10:21.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.506+0000 7f8836b14700 1 -- start start 2023-10-06T11:10:21.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.507+0000 7f8836b14700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88300689c0 0x7f88300b2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:21.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.507+0000 7f8836b14700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88301598f0 0x7f883006a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:21.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.507+0000 7f8836b14700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8830159cc0 0x7f88300afb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:21.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.507+0000 7f8836b14700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883006a980 con 0x7f88301598f0 2023-10-06T11:10:21.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.507+0000 7f8836b14700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8830169d00 con 0x7f8830159cc0 2023-10-06T11:10:21.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.507+0000 7f8836b14700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f883006af20 con 0x7f88300689c0 2023-10-06T11:10:21.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.507+0000 7f882ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88301598f0 0x7f883006a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:21.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.507+0000 7f882ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88301598f0 0x7f883006a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37344/0 (socket says 172.21.15.146:37344) 2023-10-06T11:10:21.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.507+0000 7f882ffff700 1 -- 172.21.15.146:0/642252135 learned_addr learned my addr 172.21.15.146:0/642252135 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:21.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.507+0000 7f88348b0700 1 --2- 172.21.15.146:0/642252135 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88300689c0 0x7f88300b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:21.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.507+0000 7f88350b1700 1 --2- 172.21.15.146:0/642252135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8830159cc0 0x7f88300afb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:21.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.507+0000 7f882ffff700 1 -- 172.21.15.146:0/642252135 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88300689c0 msgr2=0x7f88300b2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:21.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.507+0000 7f882ffff700 1 --2- 172.21.15.146:0/642252135 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88300689c0 0x7f88300b2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:21.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.507+0000 7f882ffff700 1 -- 172.21.15.146:0/642252135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8830159cc0 msgr2=0x7f88300afb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:21.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.507+0000 7f882ffff700 1 --2- 172.21.15.146:0/642252135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8830159cc0 0x7f88300afb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:21.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.508+0000 7f882ffff700 1 -- 172.21.15.146:0/642252135 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f881c009420 con 0x7f88301598f0 2023-10-06T11:10:21.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.508+0000 7f88350b1700 1 --2- 172.21.15.146:0/642252135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8830159cc0 0x7f88300afb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:10:21.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.508+0000 7f882ffff700 1 --2- 172.21.15.146:0/642252135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88301598f0 0x7f883006a440 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f881c0030c0 tx=0x7f881c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:21.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.508+0000 7f882cff9700 1 -- 172.21.15.146:0/642252135 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c00bae0 con 0x7f88301598f0 2023-10-06T11:10:21.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.508+0000 7f882cff9700 1 -- 172.21.15.146:0/642252135 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f881c020070 con 0x7f88301598f0 2023-10-06T11:10:21.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.508+0000 7f8836b14700 1 -- 172.21.15.146:0/642252135 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f883006b200 con 0x7f88301598f0 2023-10-06T11:10:21.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.508+0000 7f882cff9700 1 -- 172.21.15.146:0/642252135 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f881c01b6a0 con 0x7f88301598f0 2023-10-06T11:10:21.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.508+0000 7f8836b14700 1 -- 172.21.15.146:0/642252135 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f883006b7c0 con 0x7f88301598f0 2023-10-06T11:10:21.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.509+0000 7f8836b14700 1 -- 172.21.15.146:0/642252135 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f883004c380 con 0x7f88301598f0 2023-10-06T11:10:21.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.509+0000 7f882cff9700 1 -- 172.21.15.146:0/642252135 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f881c022030 con 0x7f88301598f0 2023-10-06T11:10:21.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.509+0000 7f882cff9700 1 --2- 172.21.15.146:0/642252135 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8814066f30 0x7f88140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:21.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.510+0000 7f882cff9700 1 -- 172.21.15.146:0/642252135 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f881c086710 con 0x7f88301598f0 2023-10-06T11:10:21.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.510+0000 7f88348b0700 1 --2- 172.21.15.146:0/642252135 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8814066f30 0x7f88140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:21.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.510+0000 7f88348b0700 1 --2- 172.21.15.146:0/642252135 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8814066f30 0x7f88140693e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8824001780 tx=0x7f8824009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:21.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.514+0000 7f882cff9700 1 -- 172.21.15.146:0/642252135 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f881c053770 con 0x7f88301598f0 2023-10-06T11:10:21.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.695+0000 7f8836b14700 1 -- 172.21.15.146:0/642252135 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f883004c380 con 0x7f88301598f0 2023-10-06T11:10:21.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.696+0000 7f882cff9700 1 -- 172.21.15.146:0/642252135 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v63) v1 ==== 93+0+10 (secure 0 0 0) 0x7f881c056d90 con 0x7f88301598f0 2023-10-06T11:10:21.697 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-10-06T11:10:21.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.697+0000 7f8836b14700 1 -- 172.21.15.146:0/642252135 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8814066f30 msgr2=0x7f88140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:21.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.697+0000 7f8836b14700 1 --2- 172.21.15.146:0/642252135 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8814066f30 0x7f88140693e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8824001780 tx=0x7f8824009040 comp rx=0 tx=0).stop 2023-10-06T11:10:21.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.697+0000 7f8836b14700 1 -- 172.21.15.146:0/642252135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88301598f0 msgr2=0x7f883006a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:21.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.697+0000 7f8836b14700 1 --2- 172.21.15.146:0/642252135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88301598f0 0x7f883006a440 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f881c0030c0 tx=0x7f881c016000 comp rx=0 tx=0).stop 2023-10-06T11:10:21.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.698+0000 7f8836b14700 1 -- 172.21.15.146:0/642252135 shutdown_connections 2023-10-06T11:10:21.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.698+0000 7f8836b14700 1 --2- 172.21.15.146:0/642252135 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8814066f30 0x7f88140693e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:21.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.698+0000 7f8836b14700 1 --2- 172.21.15.146:0/642252135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8830159cc0 0x7f88300afb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:21.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.698+0000 7f8836b14700 1 --2- 172.21.15.146:0/642252135 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88300689c0 0x7f88300b2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:21.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.698+0000 7f8836b14700 1 --2- 172.21.15.146:0/642252135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88301598f0 0x7f883006a440 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:21.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.698+0000 7f8836b14700 1 -- 172.21.15.146:0/642252135 >> 172.21.15.146:0/642252135 conn(0x7f88300c9f50 msgr2=0x7f88300c8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:21.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.698+0000 7f8836b14700 1 -- 172.21.15.146:0/642252135 shutdown_connections 2023-10-06T11:10:21.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.698+0000 7f8836b14700 1 -- 172.21.15.146:0/642252135 wait complete. 2023-10-06T11:10:21.711 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T11:10:21.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.829+0000 7f82d2af3700 1 Processor -- start 2023-10-06T11:10:21.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.829+0000 7f82d2af3700 1 -- start start 2023-10-06T11:10:21.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.830+0000 7f82d2af3700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f82cc15a160 0x7f82cc0c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:21.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.830+0000 7f82d2af3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f82cc0ae730 0x7f82cc0aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:21.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.830+0000 7f82d2af3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82cc0ae2a0 con 0x7f82cc0ce3d0 2023-10-06T11:10:21.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.830+0000 7f82d2af3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82cc15a530 con 0x7f82cc0ae730 2023-10-06T11:10:21.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.830+0000 7f82d2af3700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82cc0af0f0 con 0x7f82cc15a160 2023-10-06T11:10:21.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.830+0000 7f82c3fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f82cc0ae730 0x7f82cc0aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:21.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.830+0000 7f82d1090700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f82cc0ce3d0 0x7f82cc0ce7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36820/0 (socket says 172.21.15.146:36820) 2023-10-06T11:10:21.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.830+0000 7f82d1090700 1 -- 172.21.15.146:0/3894202113 learned_addr learned my addr 172.21.15.146:0/3894202113 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:10:21.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.830+0000 7f82c37fe700 1 -- 172.21.15.146:0/3894202113 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2667436426 0 0) 0x7f82cc0ae2a0 con 0x7f82cc0ce3d0 2023-10-06T11:10:21.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.830+0000 7f82c37fe700 1 -- 172.21.15.146:0/3894202113 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82b4003570 con 0x7f82cc0ce3d0 2023-10-06T11:10:21.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.830+0000 7f82d088f700 1 --2- 172.21.15.146:0/3894202113 >> v2:172.21.15.151:3300/0 conn(0x7f82cc15a160 0x7f82cc0c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:21.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.830+0000 7f82c3fff700 1 -- 172.21.15.146:0/3894202113 >> v2:172.21.15.151:3300/0 conn(0x7f82cc15a160 msgr2=0x7f82cc0c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:21.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.830+0000 7f82c3fff700 1 --2- 172.21.15.146:0/3894202113 >> v2:172.21.15.151:3300/0 conn(0x7f82cc15a160 0x7f82cc0c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:21.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.830+0000 7f82c3fff700 1 -- 172.21.15.146:0/3894202113 >> v1:172.21.15.146:6789/0 conn(0x7f82cc0ce3d0 legacy=0x7f82cc0ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:21.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.831+0000 7f82c3fff700 1 -- 172.21.15.146:0/3894202113 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82cc0ad690 con 0x7f82cc0ae730 2023-10-06T11:10:21.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.831+0000 7f82d088f700 1 --2- 172.21.15.146:0/3894202113 >> v2:172.21.15.151:3300/0 conn(0x7f82cc15a160 0x7f82cc0c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:10:21.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.831+0000 7f82c3fff700 1 --2- 172.21.15.146:0/3894202113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82cc0ae730 0x7f82cc0aebb0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f82cc065100 tx=0x7f82bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b8040e39449d8f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:21.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.831+0000 7f82c37fe700 1 -- 172.21.15.146:0/3894202113 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc011630 con 0x7f82cc0ae730 2023-10-06T11:10:21.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.831+0000 7f82c37fe700 1 -- 172.21.15.146:0/3894202113 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82bc011790 con 0x7f82cc0ae730 2023-10-06T11:10:21.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.831+0000 7f82c37fe700 1 -- 172.21.15.146:0/3894202113 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc011b30 con 0x7f82cc0ae730 2023-10-06T11:10:21.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.831+0000 7f82d2af3700 1 -- 172.21.15.146:0/3894202113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82cc0ae730 msgr2=0x7f82cc0aebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:21.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.831+0000 7f82d2af3700 1 --2- 172.21.15.146:0/3894202113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82cc0ae730 0x7f82cc0aebb0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f82cc065100 tx=0x7f82bc0091a0 comp rx=0 tx=0).stop 2023-10-06T11:10:21.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.831+0000 7f82d2af3700 1 -- 172.21.15.146:0/3894202113 shutdown_connections 2023-10-06T11:10:21.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.831+0000 7f82d2af3700 1 --2- 172.21.15.146:0/3894202113 >> v2:172.21.15.151:3300/0 conn(0x7f82cc15a160 0x7f82cc0c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:21.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.831+0000 7f82d2af3700 1 --2- 172.21.15.146:0/3894202113 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82cc0ae730 0x7f82cc0aebb0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:21.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.831+0000 7f82d2af3700 1 -- 172.21.15.146:0/3894202113 >> 172.21.15.146:0/3894202113 conn(0x7f82cc06f380 msgr2=0x7f82cc0d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:21.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.831+0000 7f82d2af3700 1 -- 172.21.15.146:0/3894202113 shutdown_connections 2023-10-06T11:10:21.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.831+0000 7f82d2af3700 1 -- 172.21.15.146:0/3894202113 wait complete. 2023-10-06T11:10:21.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.832+0000 7f82d2af3700 1 Processor -- start 2023-10-06T11:10:21.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.833+0000 7f82d2af3700 1 -- start start 2023-10-06T11:10:21.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.833+0000 7f82d2af3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82cc0ae730 0x7f82cc1572d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:21.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.833+0000 7f82d2af3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82cc0ce3d0 0x7f82cc0b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:21.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.833+0000 7f82d2af3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82cc15a160 0x7f82cc0b5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:21.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.833+0000 7f82d2af3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc16a330 con 0x7f82cc15a160 2023-10-06T11:10:21.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.833+0000 7f82d2af3700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc16b110 con 0x7f82cc0ae730 2023-10-06T11:10:21.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.833+0000 7f82d2af3700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82cc0c84e0 con 0x7f82cc0ce3d0 2023-10-06T11:10:21.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.833+0000 7f82d1090700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82cc15a160 0x7f82cc0b5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:21.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.833+0000 7f82d1090700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82cc15a160 0x7f82cc0b5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37364/0 (socket says 172.21.15.146:37364) 2023-10-06T11:10:21.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.833+0000 7f82d1090700 1 -- 172.21.15.146:0/517761775 learned_addr learned my addr 172.21.15.146:0/517761775 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:21.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.834+0000 7f82c3fff700 1 --2- 172.21.15.146:0/517761775 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82cc0ce3d0 0x7f82cc0b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:21.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.834+0000 7f82d088f700 1 --2- 172.21.15.146:0/517761775 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82cc0ae730 0x7f82cc1572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:21.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.834+0000 7f82d1090700 1 -- 172.21.15.146:0/517761775 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82cc0ce3d0 msgr2=0x7f82cc0b59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:21.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.834+0000 7f82d1090700 1 --2- 172.21.15.146:0/517761775 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82cc0ce3d0 0x7f82cc0b59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:21.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.834+0000 7f82d1090700 1 -- 172.21.15.146:0/517761775 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82cc0ae730 msgr2=0x7f82cc1572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:21.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.834+0000 7f82d1090700 1 --2- 172.21.15.146:0/517761775 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82cc0ae730 0x7f82cc1572d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:21.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.834+0000 7f82d1090700 1 -- 172.21.15.146:0/517761775 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82bc009420 con 0x7f82cc15a160 2023-10-06T11:10:21.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.834+0000 7f82c3fff700 1 --2- 172.21.15.146:0/517761775 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82cc0ce3d0 0x7f82cc0b59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:10:21.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.834+0000 7f82d088f700 1 --2- 172.21.15.146:0/517761775 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82cc0ae730 0x7f82cc1572d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:10:21.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.834+0000 7f82d1090700 1 --2- 172.21.15.146:0/517761775 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82cc15a160 0x7f82cc0b5f00 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f82c4001460 tx=0x7f82c4001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:21.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.834+0000 7f82c0ff9700 1 -- 172.21.15.146:0/517761775 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c400ce80 con 0x7f82cc15a160 2023-10-06T11:10:21.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.834+0000 7f82c0ff9700 1 -- 172.21.15.146:0/517761775 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c400ab70 con 0x7f82cc15a160 2023-10-06T11:10:21.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.834+0000 7f82c0ff9700 1 -- 172.21.15.146:0/517761775 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c40070f0 con 0x7f82cc15a160 2023-10-06T11:10:21.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.834+0000 7f82d2af3700 1 -- 172.21.15.146:0/517761775 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82cc16a540 con 0x7f82cc15a160 2023-10-06T11:10:21.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.834+0000 7f82d2af3700 1 -- 172.21.15.146:0/517761775 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82cc16aac0 con 0x7f82cc15a160 2023-10-06T11:10:21.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.835+0000 7f82d2af3700 1 -- 172.21.15.146:0/517761775 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82cc068390 con 0x7f82cc15a160 2023-10-06T11:10:21.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.836+0000 7f82c0ff9700 1 -- 172.21.15.146:0/517761775 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f82c4007520 con 0x7f82cc15a160 2023-10-06T11:10:21.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.836+0000 7f82c0ff9700 1 --2- 172.21.15.146:0/517761775 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f82b8066f30 0x7f82b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:21.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.836+0000 7f82c0ff9700 1 -- 172.21.15.146:0/517761775 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f82c4084c60 con 0x7f82cc15a160 2023-10-06T11:10:21.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.836+0000 7f82d088f700 1 --2- 172.21.15.146:0/517761775 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f82b8066f30 0x7f82b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:21.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.836+0000 7f82d088f700 1 --2- 172.21.15.146:0/517761775 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f82b8066f30 0x7f82b80693e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f82cc06a0d0 tx=0x7f82c8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:21.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:21.840+0000 7f82c0ff9700 1 -- 172.21.15.146:0/517761775 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f82c4051cb0 con 0x7f82cc15a160 2023-10-06T11:10:22.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.022+0000 7f82d2af3700 1 -- 172.21.15.146:0/517761775 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f82cc04c380 con 0x7f82cc15a160 2023-10-06T11:10:22.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.023+0000 7f82c0ff9700 1 -- 172.21.15.146:0/517761775 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v63) v1 ==== 104+0+11 (secure 0 0 0) 0x7f82c40552d0 con 0x7f82cc15a160 2023-10-06T11:10:22.024 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2023-10-06T11:10:22.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.025+0000 7f82d2af3700 1 -- 172.21.15.146:0/517761775 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f82b8066f30 msgr2=0x7f82b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:22.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.025+0000 7f82d2af3700 1 --2- 172.21.15.146:0/517761775 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f82b8066f30 0x7f82b80693e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f82cc06a0d0 tx=0x7f82c8008040 comp rx=0 tx=0).stop 2023-10-06T11:10:22.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.025+0000 7f82d2af3700 1 -- 172.21.15.146:0/517761775 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82cc15a160 msgr2=0x7f82cc0b5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:22.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.025+0000 7f82d2af3700 1 --2- 172.21.15.146:0/517761775 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82cc15a160 0x7f82cc0b5f00 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f82c4001460 tx=0x7f82c4001ae0 comp rx=0 tx=0).stop 2023-10-06T11:10:22.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.025+0000 7f82d2af3700 1 -- 172.21.15.146:0/517761775 shutdown_connections 2023-10-06T11:10:22.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.025+0000 7f82d2af3700 1 --2- 172.21.15.146:0/517761775 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f82b8066f30 0x7f82b80693e0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:22.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.025+0000 7f82d2af3700 1 --2- 172.21.15.146:0/517761775 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82cc15a160 0x7f82cc0b5f00 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:22.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.025+0000 7f82d2af3700 1 --2- 172.21.15.146:0/517761775 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82cc0ae730 0x7f82cc1572d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:22.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.025+0000 7f82d2af3700 1 --2- 172.21.15.146:0/517761775 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82cc0ce3d0 0x7f82cc0b59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:22.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.025+0000 7f82d2af3700 1 -- 172.21.15.146:0/517761775 >> 172.21.15.146:0/517761775 conn(0x7f82cc06f380 msgr2=0x7f82cc159500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:22.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.025+0000 7f82d2af3700 1 -- 172.21.15.146:0/517761775 shutdown_connections 2023-10-06T11:10:22.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.025+0000 7f82d2af3700 1 -- 172.21.15.146:0/517761775 wait complete. 2023-10-06T11:10:22.038 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T11:10:22.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.155+0000 7f74e509c700 1 Processor -- start 2023-10-06T11:10:22.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.155+0000 7f74e509c700 1 -- start start 2023-10-06T11:10:22.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.155+0000 7f74e509c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74e015a160 0x7f74e00c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:22.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.155+0000 7f74e509c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f74e00ae730 0x7f74e00aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:22.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.155+0000 7f74e509c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f74e00ce3d0 0x7f74e00ce830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:22.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.155+0000 7f74e509c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74e00ae2a0 con 0x7f74e00ce3d0 2023-10-06T11:10:22.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.155+0000 7f74e509c700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74e015a530 con 0x7f74e00ae730 2023-10-06T11:10:22.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.155+0000 7f74e509c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74e00ad690 con 0x7f74e015a160 2023-10-06T11:10:22.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.156+0000 7f74df59e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f74e00ce3d0 0x7f74e00ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:22.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.156+0000 7f74df59e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f74e00ce3d0 0x7f74e00ce830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37366/0 (socket says 172.21.15.146:37366) 2023-10-06T11:10:22.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.156+0000 7f74df59e700 1 -- 172.21.15.146:0/1623155236 learned_addr learned my addr 172.21.15.146:0/1623155236 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:22.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.156+0000 7f74ded9d700 1 --2- 172.21.15.146:0/1623155236 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74e015a160 0x7f74e00c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:22.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.156+0000 7f74d659c700 1 --2- 172.21.15.146:0/1623155236 >> v2:172.21.15.151:3300/0 conn(0x7f74e00ae730 0x7f74e00aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:22.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.156+0000 7f74df59e700 1 -- 172.21.15.146:0/1623155236 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74e015a160 msgr2=0x7f74e00c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:22.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.156+0000 7f74df59e700 1 --2- 172.21.15.146:0/1623155236 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74e015a160 0x7f74e00c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:22.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.156+0000 7f74df59e700 1 -- 172.21.15.146:0/1623155236 >> v2:172.21.15.151:3300/0 conn(0x7f74e00ae730 msgr2=0x7f74e00aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:22.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.156+0000 7f74df59e700 1 --2- 172.21.15.146:0/1623155236 >> v2:172.21.15.151:3300/0 conn(0x7f74e00ae730 0x7f74e00aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:22.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.156+0000 7f74df59e700 1 -- 172.21.15.146:0/1623155236 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e00ad970 con 0x7f74e00ce3d0 2023-10-06T11:10:22.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.156+0000 7f74df59e700 1 --2- 172.21.15.146:0/1623155236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74e00ce3d0 0x7f74e00ce830 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f74e0088a00 tx=0x7f74d8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4b88c1ead0ee2e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:22.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.156+0000 7f74de59c700 1 -- 172.21.15.146:0/1623155236 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d800e070 con 0x7f74e00ce3d0 2023-10-06T11:10:22.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.156+0000 7f74de59c700 1 -- 172.21.15.146:0/1623155236 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d800b970 con 0x7f74e00ce3d0 2023-10-06T11:10:22.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.156+0000 7f74de59c700 1 -- 172.21.15.146:0/1623155236 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d80092e0 con 0x7f74e00ce3d0 2023-10-06T11:10:22.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.157+0000 7f74e509c700 1 -- 172.21.15.146:0/1623155236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74e00ce3d0 msgr2=0x7f74e00ce830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:22.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.157+0000 7f74e509c700 1 --2- 172.21.15.146:0/1623155236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74e00ce3d0 0x7f74e00ce830 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f74e0088a00 tx=0x7f74d8009840 comp rx=0 tx=0).stop 2023-10-06T11:10:22.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.157+0000 7f74e509c700 1 -- 172.21.15.146:0/1623155236 shutdown_connections 2023-10-06T11:10:22.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.157+0000 7f74e509c700 1 --2- 172.21.15.146:0/1623155236 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74e00ce3d0 0x7f74e00ce830 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:22.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.157+0000 7f74e509c700 1 --2- 172.21.15.146:0/1623155236 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74e015a160 0x7f74e00c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:22.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.157+0000 7f74e509c700 1 --2- 172.21.15.146:0/1623155236 >> v2:172.21.15.151:3300/0 conn(0x7f74e00ae730 0x7f74e00aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:22.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.157+0000 7f74e509c700 1 -- 172.21.15.146:0/1623155236 >> 172.21.15.146:0/1623155236 conn(0x7f74e006f380 msgr2=0x7f74e00d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:22.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.157+0000 7f74e509c700 1 -- 172.21.15.146:0/1623155236 shutdown_connections 2023-10-06T11:10:22.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.157+0000 7f74e509c700 1 -- 172.21.15.146:0/1623155236 wait complete. 2023-10-06T11:10:22.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.158+0000 7f74e509c700 1 Processor -- start 2023-10-06T11:10:22.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.158+0000 7f74e509c700 1 -- start start 2023-10-06T11:10:22.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.159+0000 7f74e509c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74e00ae730 0x7f74e01594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:22.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.159+0000 7f74e509c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74e00ce3d0 0x7f74e0155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:22.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.159+0000 7f74e509c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74e015a160 0x7f74e015fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:22.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.159+0000 7f74e509c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e0155890 con 0x7f74e00ce3d0 2023-10-06T11:10:22.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.159+0000 7f74e509c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e01567c0 con 0x7f74e00ae730 2023-10-06T11:10:22.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.159+0000 7f74e509c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74e0154c80 con 0x7f74e015a160 2023-10-06T11:10:22.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.159+0000 7f74d659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74e00ce3d0 0x7f74e0155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:22.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.159+0000 7f74d659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74e00ce3d0 0x7f74e0155d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37380/0 (socket says 172.21.15.146:37380) 2023-10-06T11:10:22.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.159+0000 7f74d659c700 1 -- 172.21.15.146:0/1629245717 learned_addr learned my addr 172.21.15.146:0/1629245717 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:22.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.159+0000 7f74ded9d700 1 --2- 172.21.15.146:0/1629245717 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74e00ae730 0x7f74e01594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:22.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.159+0000 7f74df59e700 1 --2- 172.21.15.146:0/1629245717 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74e015a160 0x7f74e015fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:22.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.160+0000 7f74d659c700 1 -- 172.21.15.146:0/1629245717 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74e015a160 msgr2=0x7f74e015fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:22.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.160+0000 7f74d659c700 1 --2- 172.21.15.146:0/1629245717 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74e015a160 0x7f74e015fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:22.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.160+0000 7f74d659c700 1 -- 172.21.15.146:0/1629245717 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74e00ae730 msgr2=0x7f74e01594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:22.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.160+0000 7f74d659c700 1 --2- 172.21.15.146:0/1629245717 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74e00ae730 0x7f74e01594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:22.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.160+0000 7f74d659c700 1 -- 172.21.15.146:0/1629245717 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d8009ae0 con 0x7f74e00ce3d0 2023-10-06T11:10:22.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.160+0000 7f74d659c700 1 --2- 172.21.15.146:0/1629245717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74e00ce3d0 0x7f74e0155d20 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f74c800e930 tx=0x7f74c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:22.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.160+0000 7f74d77fe700 1 -- 172.21.15.146:0/1629245717 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c8013680 con 0x7f74e00ce3d0 2023-10-06T11:10:22.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.160+0000 7f74d77fe700 1 -- 172.21.15.146:0/1629245717 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c80137e0 con 0x7f74e00ce3d0 2023-10-06T11:10:22.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.160+0000 7f74e509c700 1 -- 172.21.15.146:0/1629245717 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74e0154f60 con 0x7f74e00ce3d0 2023-10-06T11:10:22.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.160+0000 7f74d77fe700 1 -- 172.21.15.146:0/1629245717 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c8013b80 con 0x7f74e00ce3d0 2023-10-06T11:10:22.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.160+0000 7f74e509c700 1 -- 172.21.15.146:0/1629245717 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74e0155520 con 0x7f74e00ce3d0 2023-10-06T11:10:22.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.161+0000 7f74e509c700 1 -- 172.21.15.146:0/1629245717 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74e0155a40 con 0x7f74e00ce3d0 2023-10-06T11:10:22.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.161+0000 7f74d77fe700 1 -- 172.21.15.146:0/1629245717 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f74c800c3e0 con 0x7f74e00ce3d0 2023-10-06T11:10:22.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.162+0000 7f74d77fe700 1 --2- 172.21.15.146:0/1629245717 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f74c0066f30 0x7f74c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:22.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.162+0000 7f74d77fe700 1 -- 172.21.15.146:0/1629245717 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f74c80847c0 con 0x7f74e00ce3d0 2023-10-06T11:10:22.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.162+0000 7f74ded9d700 1 --2- 172.21.15.146:0/1629245717 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f74c0066f30 0x7f74c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:22.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.162+0000 7f74ded9d700 1 --2- 172.21.15.146:0/1629245717 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f74c0066f30 0x7f74c00693e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f74e0152f40 tx=0x7f74d0009120 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:22.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.166+0000 7f74d77fe700 1 -- 172.21.15.146:0/1629245717 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f74e0155a40 con 0x7f74e00ce3d0 2023-10-06T11:10:22.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.353+0000 7f74e509c700 1 -- 172.21.15.146:0/1629245717 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f74e0068390 con 0x7f74e00ce3d0 2023-10-06T11:10:22.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.353+0000 7f74d77fe700 1 -- 172.21.15.146:0/1629245717 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v63) v1 ==== 100+0+11 (secure 0 0 0) 0x7f74c8051820 con 0x7f74e00ce3d0 2023-10-06T11:10:22.354 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2023-10-06T11:10:22.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.355+0000 7f74e509c700 1 -- 172.21.15.146:0/1629245717 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f74c0066f30 msgr2=0x7f74c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:22.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.355+0000 7f74e509c700 1 --2- 172.21.15.146:0/1629245717 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f74c0066f30 0x7f74c00693e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f74e0152f40 tx=0x7f74d0009120 comp rx=0 tx=0).stop 2023-10-06T11:10:22.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.355+0000 7f74e509c700 1 -- 172.21.15.146:0/1629245717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74e00ce3d0 msgr2=0x7f74e0155d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:22.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.355+0000 7f74e509c700 1 --2- 172.21.15.146:0/1629245717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74e00ce3d0 0x7f74e0155d20 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f74c800e930 tx=0x7f74c80091a0 comp rx=0 tx=0).stop 2023-10-06T11:10:22.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.355+0000 7f74e509c700 1 -- 172.21.15.146:0/1629245717 shutdown_connections 2023-10-06T11:10:22.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.355+0000 7f74e509c700 1 --2- 172.21.15.146:0/1629245717 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f74c0066f30 0x7f74c00693e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:22.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.355+0000 7f74e509c700 1 --2- 172.21.15.146:0/1629245717 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74e015a160 0x7f74e015fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:22.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.355+0000 7f74e509c700 1 --2- 172.21.15.146:0/1629245717 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74e00ae730 0x7f74e01594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:22.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.355+0000 7f74e509c700 1 --2- 172.21.15.146:0/1629245717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74e00ce3d0 0x7f74e0155d20 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:22.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.355+0000 7f74e509c700 1 -- 172.21.15.146:0/1629245717 >> 172.21.15.146:0/1629245717 conn(0x7f74e006f380 msgr2=0x7f74e00ccdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:22.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.355+0000 7f74e509c700 1 -- 172.21.15.146:0/1629245717 shutdown_connections 2023-10-06T11:10:22.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.355+0000 7f74e509c700 1 -- 172.21.15.146:0/1629245717 wait complete. 2023-10-06T11:10:22.369 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:10:22.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.485+0000 7f0ac9689700 1 Processor -- start 2023-10-06T11:10:22.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.485+0000 7f0ac9689700 1 -- start start 2023-10-06T11:10:22.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.486+0000 7f0ac9689700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0ac4068ba0 0x7f0ac415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:22.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.486+0000 7f0ac9689700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0ac4153e80 0x7f0ac40b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:22.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.486+0000 7f0ac9689700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ac415ac30 con 0x7f0ac4153ab0 2023-10-06T11:10:22.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.486+0000 7f0ac9689700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ac40b4510 con 0x7f0ac4153e80 2023-10-06T11:10:22.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.486+0000 7f0ac9689700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ac40b6530 con 0x7f0ac4068ba0 2023-10-06T11:10:22.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.486+0000 7f0ac37fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0ac4153e80 0x7f0ac40b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:22.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.486+0000 7f0ac37fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0ac4153e80 0x7f0ac40b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37386/0 (socket says 172.21.15.146:37386) 2023-10-06T11:10:22.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.486+0000 7f0ac37fe700 1 -- 172.21.15.146:0/2554167378 learned_addr learned my addr 172.21.15.146:0/2554167378 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:22.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.486+0000 7f0aba7fc700 1 --2- 172.21.15.146:0/2554167378 >> v2:172.21.15.151:3300/0 conn(0x7f0ac4068ba0 0x7f0ac415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:22.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.486+0000 7f0ac37fe700 1 -- 172.21.15.146:0/2554167378 >> v2:172.21.15.151:3300/0 conn(0x7f0ac4068ba0 msgr2=0x7f0ac415a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:22.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.486+0000 7f0ac37fe700 1 --2- 172.21.15.146:0/2554167378 >> v2:172.21.15.151:3300/0 conn(0x7f0ac4068ba0 0x7f0ac415a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:22.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.486+0000 7f0ac37fe700 1 -- 172.21.15.146:0/2554167378 >> v1:172.21.15.151:6789/0 conn(0x7f0ac4153ab0 legacy=0x7f0ac4068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:22.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.486+0000 7f0ac37fe700 1 -- 172.21.15.146:0/2554167378 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac40b5c50 con 0x7f0ac4153e80 2023-10-06T11:10:22.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.486+0000 7f0ac37fe700 1 --2- 172.21.15.146:0/2554167378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ac4153e80 0x7f0ac40b49a0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f0ac4089770 tx=0x7f0abc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acbfeadd24abb945 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:22.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.486+0000 7f0ac27fc700 1 -- 172.21.15.146:0/2554167378 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc00e070 con 0x7f0ac4153e80 2023-10-06T11:10:22.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.487+0000 7f0ac27fc700 1 -- 172.21.15.146:0/2554167378 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0abc00ba50 con 0x7f0ac4153e80 2023-10-06T11:10:22.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.487+0000 7f0ac27fc700 1 -- 172.21.15.146:0/2554167378 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0abc0092e0 con 0x7f0ac4153e80 2023-10-06T11:10:22.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.487+0000 7f0ac9689700 1 -- 172.21.15.146:0/2554167378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ac4153e80 msgr2=0x7f0ac40b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:22.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.487+0000 7f0ac9689700 1 --2- 172.21.15.146:0/2554167378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ac4153e80 0x7f0ac40b49a0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f0ac4089770 tx=0x7f0abc009840 comp rx=0 tx=0).stop 2023-10-06T11:10:22.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.487+0000 7f0ac9689700 1 -- 172.21.15.146:0/2554167378 shutdown_connections 2023-10-06T11:10:22.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.487+0000 7f0ac9689700 1 --2- 172.21.15.146:0/2554167378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ac4153e80 0x7f0ac40b49a0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:22.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.487+0000 7f0ac9689700 1 --2- 172.21.15.146:0/2554167378 >> v2:172.21.15.151:3300/0 conn(0x7f0ac4068ba0 0x7f0ac415a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:22.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.487+0000 7f0ac9689700 1 -- 172.21.15.146:0/2554167378 >> 172.21.15.146:0/2554167378 conn(0x7f0ac406eba0 msgr2=0x7f0ac406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:22.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.487+0000 7f0ac9689700 1 -- 172.21.15.146:0/2554167378 shutdown_connections 2023-10-06T11:10:22.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.487+0000 7f0ac9689700 1 -- 172.21.15.146:0/2554167378 wait complete. 2023-10-06T11:10:22.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.488+0000 7f0ac9689700 1 Processor -- start 2023-10-06T11:10:22.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.488+0000 7f0ac9689700 1 -- start start 2023-10-06T11:10:22.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.489+0000 7f0ac9689700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ac4068ba0 0x7f0ac40afec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:22.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.489+0000 7f0ac9689700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ac4153ab0 0x7f0ac40b2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:22.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.489+0000 7f0ac9689700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ac4153e80 0x7f0ac4158b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:22.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.489+0000 7f0ac9689700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac414bc70 con 0x7f0ac4153ab0 2023-10-06T11:10:22.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.489+0000 7f0ac9689700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac41590a0 con 0x7f0ac4153e80 2023-10-06T11:10:22.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.489+0000 7f0ac9689700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac4146c10 con 0x7f0ac4068ba0 2023-10-06T11:10:22.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.489+0000 7f0aba7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ac4153ab0 0x7f0ac40b2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:22.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.489+0000 7f0aba7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ac4153ab0 0x7f0ac40b2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37400/0 (socket says 172.21.15.146:37400) 2023-10-06T11:10:22.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.489+0000 7f0aba7fc700 1 -- 172.21.15.146:0/2705085066 learned_addr learned my addr 172.21.15.146:0/2705085066 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:22.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.489+0000 7f0ac37fe700 1 --2- 172.21.15.146:0/2705085066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ac4153e80 0x7f0ac4158b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:22.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.489+0000 7f0ac2ffd700 1 --2- 172.21.15.146:0/2705085066 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ac4068ba0 0x7f0ac40afec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:22.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.489+0000 7f0aba7fc700 1 -- 172.21.15.146:0/2705085066 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ac4068ba0 msgr2=0x7f0ac40afec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:22.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.489+0000 7f0aba7fc700 1 --2- 172.21.15.146:0/2705085066 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ac4068ba0 0x7f0ac40afec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:22.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.489+0000 7f0aba7fc700 1 -- 172.21.15.146:0/2705085066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ac4153e80 msgr2=0x7f0ac4158b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:22.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.489+0000 7f0aba7fc700 1 --2- 172.21.15.146:0/2705085066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ac4153e80 0x7f0ac4158b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:22.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.489+0000 7f0aba7fc700 1 -- 172.21.15.146:0/2705085066 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0abc009ae0 con 0x7f0ac4153ab0 2023-10-06T11:10:22.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.489+0000 7f0ac37fe700 1 --2- 172.21.15.146:0/2705085066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ac4153e80 0x7f0ac4158b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:10:22.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.490+0000 7f0aba7fc700 1 --2- 172.21.15.146:0/2705085066 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ac4153ab0 0x7f0ac40b2020 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f0aac00d810 tx=0x7f0aac008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:22.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.490+0000 7f0abb7fe700 1 -- 172.21.15.146:0/2705085066 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac0125f0 con 0x7f0ac4153ab0 2023-10-06T11:10:22.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.490+0000 7f0abb7fe700 1 -- 172.21.15.146:0/2705085066 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aac012750 con 0x7f0ac4153ab0 2023-10-06T11:10:22.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.490+0000 7f0ac9689700 1 -- 172.21.15.146:0/2705085066 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ac414a340 con 0x7f0ac4153ab0 2023-10-06T11:10:22.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.490+0000 7f0abb7fe700 1 -- 172.21.15.146:0/2705085066 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac012af0 con 0x7f0ac4153ab0 2023-10-06T11:10:22.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.490+0000 7f0ac9689700 1 -- 172.21.15.146:0/2705085066 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac414a620 con 0x7f0ac4153ab0 2023-10-06T11:10:22.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.491+0000 7f0ac9689700 1 -- 172.21.15.146:0/2705085066 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ac414a7b0 con 0x7f0ac4153ab0 2023-10-06T11:10:22.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.491+0000 7f0abb7fe700 1 -- 172.21.15.146:0/2705085066 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0aac01e460 con 0x7f0ac4153ab0 2023-10-06T11:10:22.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.491+0000 7f0abb7fe700 1 --2- 172.21.15.146:0/2705085066 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0aa4066f30 0x7f0aa40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:22.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.492+0000 7f0abb7fe700 1 -- 172.21.15.146:0/2705085066 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f0aac084d40 con 0x7f0ac4153ab0 2023-10-06T11:10:22.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.492+0000 7f0ac2ffd700 1 --2- 172.21.15.146:0/2705085066 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0aa4066f30 0x7f0aa40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:22.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.492+0000 7f0ac2ffd700 1 --2- 172.21.15.146:0/2705085066 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0aa4066f30 0x7f0aa40693e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4001760 tx=0x7f0ab4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:22.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.496+0000 7f0abb7fe700 1 -- 172.21.15.146:0/2705085066 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0aac055830 con 0x7f0ac4153ab0 2023-10-06T11:10:22.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.720+0000 7f0ac9689700 1 -- 172.21.15.146:0/2705085066 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ac404c380 con 0x7f0ac4153ab0 2023-10-06T11:10:22.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.720+0000 7f0abb7fe700 1 -- 172.21.15.146:0/2705085066 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4611 (secure 0 0 0) 0x7f0aac0553c0 con 0x7f0ac4153ab0 2023-10-06T11:10:22.721 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:10:22.721 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":56,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5621,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/1872666923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1872666923},{"type":"v1","addr":"172.21.15.151:6833","nonce":1872666923}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":6082,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1430806818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1430806818},{"type":"v1","addr":"172.21.15.151:6835","nonce":1430806818}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":6546,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/1394956500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":1394956500},{"type":"v1","addr":"172.21.15.146:6837","nonce":1394956500}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:09:41.580951+0000","modified":"2023-10-06T11:10:06.415726+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":63,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6540},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6540":{"gid":6540,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6835/3512281867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3512281867},{"type":"v1","addr":"172.21.15.146:6835","nonce":3512281867}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T11:10:22.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.722+0000 7f0ac9689700 1 -- 172.21.15.146:0/2705085066 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0aa4066f30 msgr2=0x7f0aa40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:22.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.722+0000 7f0ac9689700 1 --2- 172.21.15.146:0/2705085066 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0aa4066f30 0x7f0aa40693e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4001760 tx=0x7f0ab4009040 comp rx=0 tx=0).stop 2023-10-06T11:10:22.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.722+0000 7f0ac9689700 1 -- 172.21.15.146:0/2705085066 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ac4153ab0 msgr2=0x7f0ac40b2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:22.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.722+0000 7f0ac9689700 1 --2- 172.21.15.146:0/2705085066 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ac4153ab0 0x7f0ac40b2020 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f0aac00d810 tx=0x7f0aac008040 comp rx=0 tx=0).stop 2023-10-06T11:10:22.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.722+0000 7f0ac9689700 1 -- 172.21.15.146:0/2705085066 shutdown_connections 2023-10-06T11:10:22.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.722+0000 7f0ac9689700 1 --2- 172.21.15.146:0/2705085066 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0aa4066f30 0x7f0aa40693e0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:22.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.722+0000 7f0ac9689700 1 --2- 172.21.15.146:0/2705085066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ac4153e80 0x7f0ac4158b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:22.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.722+0000 7f0ac9689700 1 --2- 172.21.15.146:0/2705085066 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ac4068ba0 0x7f0ac40afec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:22.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.722+0000 7f0ac9689700 1 --2- 172.21.15.146:0/2705085066 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ac4153ab0 0x7f0ac40b2020 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:22.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.722+0000 7f0ac9689700 1 -- 172.21.15.146:0/2705085066 >> 172.21.15.146:0/2705085066 conn(0x7f0ac406eba0 msgr2=0x7f0ac40ce950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:22.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.722+0000 7f0ac9689700 1 -- 172.21.15.146:0/2705085066 shutdown_connections 2023-10-06T11:10:22.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.722+0000 7f0ac9689700 1 -- 172.21.15.146:0/2705085066 wait complete. 2023-10-06T11:10:22.725 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 56 2023-10-06T11:10:22.739 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:10:22.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.855+0000 7f2d5dee4700 1 Processor -- start 2023-10-06T11:10:22.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.855+0000 7f2d5dee4700 1 -- start start 2023-10-06T11:10:22.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.855+0000 7f2d5dee4700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d58068ba0 0x7f2d5815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:22.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.855+0000 7f2d5dee4700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2d58153e80 0x7f2d580b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:22.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.855+0000 7f2d5dee4700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d5815ac30 con 0x7f2d58153ab0 2023-10-06T11:10:22.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.855+0000 7f2d5dee4700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d580b4510 con 0x7f2d58153e80 2023-10-06T11:10:22.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.855+0000 7f2d5dee4700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d580b6530 con 0x7f2d58068ba0 2023-10-06T11:10:22.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.856+0000 7f2d577fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2d58153ab0 0x7f2d58068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36834/0 (socket says 172.21.15.146:36834) 2023-10-06T11:10:22.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.856+0000 7f2d577fe700 1 -- 172.21.15.146:0/559831050 learned_addr learned my addr 172.21.15.146:0/559831050 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:10:22.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.856+0000 7f2d57fff700 1 --2- 172.21.15.146:0/559831050 >> v2:172.21.15.151:3300/0 conn(0x7f2d58153e80 0x7f2d580b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:22.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.856+0000 7f2d56ffd700 1 --2- 172.21.15.146:0/559831050 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d58068ba0 0x7f2d5815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:22.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.856+0000 7f2d567fc700 1 -- 172.21.15.146:0/559831050 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2721074801 0 0) 0x7f2d48001110 con 0x7f2d58153ab0 2023-10-06T11:10:22.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.856+0000 7f2d567fc700 1 -- 172.21.15.146:0/559831050 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d44003570 con 0x7f2d58153ab0 2023-10-06T11:10:22.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.856+0000 7f2d567fc700 1 -- 172.21.15.146:0/559831050 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3629721715 0 0) 0x7f2d44003570 con 0x7f2d58153ab0 2023-10-06T11:10:22.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.856+0000 7f2d567fc700 1 -- 172.21.15.146:0/559831050 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d58068ba0 msgr2=0x7f2d5815a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:22.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.856+0000 7f2d567fc700 1 --2- 172.21.15.146:0/559831050 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d58068ba0 0x7f2d5815a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:22.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.856+0000 7f2d567fc700 1 -- 172.21.15.146:0/559831050 >> v2:172.21.15.151:3300/0 conn(0x7f2d58153e80 msgr2=0x7f2d580b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:22.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.856+0000 7f2d567fc700 1 --2- 172.21.15.146:0/559831050 >> v2:172.21.15.151:3300/0 conn(0x7f2d58153e80 0x7f2d580b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:22.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.856+0000 7f2d567fc700 1 -- 172.21.15.146:0/559831050 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d580b5c50 con 0x7f2d58153ab0 2023-10-06T11:10:22.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.856+0000 7f2d567fc700 1 -- 172.21.15.146:0/559831050 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f2d48001600 con 0x7f2d58153ab0 2023-10-06T11:10:22.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.856+0000 7f2d57fff700 1 --2- 172.21.15.146:0/559831050 >> v2:172.21.15.151:3300/0 conn(0x7f2d58153e80 0x7f2d580b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:10:22.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.856+0000 7f2d567fc700 1 -- 172.21.15.146:0/559831050 >> v1:172.21.15.146:6789/0 conn(0x7f2d58153ab0 legacy=0x7f2d58068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:22.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.856+0000 7f2d567fc700 1 --2- 172.21.15.146:0/559831050 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d44003a60 0x7f2d44003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:22.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.856+0000 7f2d567fc700 1 --2- 172.21.15.146:0/559831050 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d58068ba0 0x7f2d44004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:22.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.856+0000 7f2d567fc700 1 --2- 172.21.15.146:0/559831050 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d44004d50 0x7f2d440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:22.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.856+0000 7f2d567fc700 1 -- 172.21.15.146:0/559831050 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d580b4510 con 0x7f2d44004d50 2023-10-06T11:10:22.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.856+0000 7f2d567fc700 1 -- 172.21.15.146:0/559831050 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d580b6530 con 0x7f2d44003a60 2023-10-06T11:10:22.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.856+0000 7f2d567fc700 1 -- 172.21.15.146:0/559831050 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4400ba60 con 0x7f2d58068ba0 2023-10-06T11:10:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.856+0000 7f2d57fff700 1 --2- 172.21.15.146:0/559831050 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d44004d50 0x7f2d440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.856+0000 7f2d56ffd700 1 --2- 172.21.15.146:0/559831050 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d58068ba0 0x7f2d44004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.856+0000 7f2d577fe700 1 --2- 172.21.15.146:0/559831050 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d44003a60 0x7f2d44003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.857+0000 7f2d57fff700 1 -- 172.21.15.146:0/559831050 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d58068ba0 msgr2=0x7f2d44004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.857+0000 7f2d57fff700 1 --2- 172.21.15.146:0/559831050 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d58068ba0 0x7f2d44004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.857+0000 7f2d57fff700 1 -- 172.21.15.146:0/559831050 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d44003a60 msgr2=0x7f2d44003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.857+0000 7f2d57fff700 1 --2- 172.21.15.146:0/559831050 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d44003a60 0x7f2d44003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.857+0000 7f2d57fff700 1 -- 172.21.15.146:0/559831050 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d44003570 con 0x7f2d44004d50 2023-10-06T11:10:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.857+0000 7f2d577fe700 1 --2- 172.21.15.146:0/559831050 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d44003a60 0x7f2d44003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:10:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.857+0000 7f2d57fff700 1 --2- 172.21.15.146:0/559831050 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d44004d50 0x7f2d440051c0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f2d5000e3c0 tx=0x7f2d5000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f5a77f61b8a950a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.857+0000 7f2d567fc700 1 -- 172.21.15.146:0/559831050 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5000ec10 con 0x7f2d44004d50 2023-10-06T11:10:22.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.857+0000 7f2d567fc700 1 -- 172.21.15.146:0/559831050 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d5000f040 con 0x7f2d44004d50 2023-10-06T11:10:22.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.857+0000 7f2d567fc700 1 -- 172.21.15.146:0/559831050 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d50014480 con 0x7f2d44004d50 2023-10-06T11:10:22.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.857+0000 7f2d5dee4700 1 -- 172.21.15.146:0/559831050 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d44004d50 msgr2=0x7f2d440051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:22.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.857+0000 7f2d5dee4700 1 --2- 172.21.15.146:0/559831050 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d44004d50 0x7f2d440051c0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f2d5000e3c0 tx=0x7f2d5000b040 comp rx=0 tx=0).stop 2023-10-06T11:10:22.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.857+0000 7f2d57fff700 1 -- 172.21.15.146:0/559831050 reap_dead start 2023-10-06T11:10:22.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.857+0000 7f2d5dee4700 1 -- 172.21.15.146:0/559831050 shutdown_connections 2023-10-06T11:10:22.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.857+0000 7f2d5dee4700 1 -- 172.21.15.146:0/559831050 >> 172.21.15.146:0/559831050 conn(0x7f2d5806eba0 msgr2=0x7f2d5806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:22.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.857+0000 7f2d5dee4700 1 -- 172.21.15.146:0/559831050 shutdown_connections 2023-10-06T11:10:22.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.858+0000 7f2d5dee4700 1 -- 172.21.15.146:0/559831050 wait complete. 2023-10-06T11:10:22.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.859+0000 7f2d5dee4700 1 Processor -- start 2023-10-06T11:10:22.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.859+0000 7f2d5dee4700 1 -- start start 2023-10-06T11:10:22.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.859+0000 7f2d5dee4700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d58147170 0x7f2d581516e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:22.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.859+0000 7f2d5dee4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d58147540 0x7f2d5815f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:22.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.859+0000 7f2d5dee4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d58151c20 0x7f2d5815f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:22.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.859+0000 7f2d5dee4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d58150640 con 0x7f2d58151c20 2023-10-06T11:10:22.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.859+0000 7f2d5dee4700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d58150920 con 0x7f2d58147540 2023-10-06T11:10:22.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.859+0000 7f2d5dee4700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d58150c00 con 0x7f2d58147170 2023-10-06T11:10:22.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.860+0000 7f2d57fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d58151c20 0x7f2d5815f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:22.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.860+0000 7f2d57fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d58151c20 0x7f2d5815f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37422/0 (socket says 172.21.15.146:37422) 2023-10-06T11:10:22.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.860+0000 7f2d57fff700 1 -- 172.21.15.146:0/187184498 learned_addr learned my addr 172.21.15.146:0/187184498 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:22.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.860+0000 7f2d577fe700 1 --2- 172.21.15.146:0/187184498 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d58147170 0x7f2d581516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:22.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.860+0000 7f2d56ffd700 1 --2- 172.21.15.146:0/187184498 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d58147540 0x7f2d5815f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:22.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.860+0000 7f2d57fff700 1 -- 172.21.15.146:0/187184498 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d58147170 msgr2=0x7f2d581516e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:22.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.860+0000 7f2d57fff700 1 --2- 172.21.15.146:0/187184498 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d58147170 0x7f2d581516e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:22.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.860+0000 7f2d57fff700 1 -- 172.21.15.146:0/187184498 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d58147540 msgr2=0x7f2d5815f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:22.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.860+0000 7f2d57fff700 1 --2- 172.21.15.146:0/187184498 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d58147540 0x7f2d5815f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:22.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.860+0000 7f2d57fff700 1 -- 172.21.15.146:0/187184498 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d58150ee0 con 0x7f2d58151c20 2023-10-06T11:10:22.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.860+0000 7f2d57fff700 1 --2- 172.21.15.146:0/187184498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d58151c20 0x7f2d5815f950 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f2d50016000 tx=0x7f2d5001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:22.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.860+0000 7f2d4f7fe700 1 -- 172.21.15.146:0/187184498 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d50014480 con 0x7f2d58151c20 2023-10-06T11:10:22.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.860+0000 7f2d4f7fe700 1 -- 172.21.15.146:0/187184498 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d5001f650 con 0x7f2d58151c20 2023-10-06T11:10:22.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.860+0000 7f2d5dee4700 1 -- 172.21.15.146:0/187184498 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d581511c0 con 0x7f2d58151c20 2023-10-06T11:10:22.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.860+0000 7f2d4f7fe700 1 -- 172.21.15.146:0/187184498 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5001fa30 con 0x7f2d58151c20 2023-10-06T11:10:22.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.860+0000 7f2d5dee4700 1 -- 172.21.15.146:0/187184498 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d58169d10 con 0x7f2d58151c20 2023-10-06T11:10:22.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.861+0000 7f2d5dee4700 1 -- 172.21.15.146:0/187184498 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d581513b0 con 0x7f2d58151c20 2023-10-06T11:10:22.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.861+0000 7f2d4f7fe700 1 -- 172.21.15.146:0/187184498 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2d50003040 con 0x7f2d58151c20 2023-10-06T11:10:22.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.862+0000 7f2d4f7fe700 1 --2- 172.21.15.146:0/187184498 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2d38066f30 0x7f2d380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:22.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.862+0000 7f2d4f7fe700 1 -- 172.21.15.146:0/187184498 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f2d50086450 con 0x7f2d58151c20 2023-10-06T11:10:22.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.862+0000 7f2d577fe700 1 --2- 172.21.15.146:0/187184498 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2d38066f30 0x7f2d380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:22.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.862+0000 7f2d577fe700 1 --2- 172.21.15.146:0/187184498 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2d38066f30 0x7f2d380693e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2d48000c40 tx=0x7f2d4800c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:22.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:22.866+0000 7f2d4f7fe700 1 -- 172.21.15.146:0/187184498 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d500534b0 con 0x7f2d58151c20 2023-10-06T11:10:23.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.051+0000 7f2d5dee4700 1 -- 172.21.15.146:0/187184498 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d5804c380 con 0x7f2d58151c20 2023-10-06T11:10:23.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.052+0000 7f2d4f7fe700 1 -- 172.21.15.146:0/187184498 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+17177 (secure 0 0 0) 0x7f2d50056ad0 con 0x7f2d58151c20 2023-10-06T11:10:23.053 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:10:23.053 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":63,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:10:03.392685+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:09:39.260612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-06T11:09:40.552424+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6834/236648406":"2023-10-07T11:10:03.392660+0000","172.21.15.146:6836/236648406":"2023-10-07T11:10:03.392660+0000","172.21.15.151:6833/2990544048":"2023-10-07T11:10:02.392572+0000","172.21.15.151:6835/2990544048":"2023-10-07T11:10:02.392572+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:10:23.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.054+0000 7f2d5dee4700 1 -- 172.21.15.146:0/187184498 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2d38066f30 msgr2=0x7f2d380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:23.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.054+0000 7f2d5dee4700 1 --2- 172.21.15.146:0/187184498 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2d38066f30 0x7f2d380693e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f2d48000c40 tx=0x7f2d4800c040 comp rx=0 tx=0).stop 2023-10-06T11:10:23.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.054+0000 7f2d5dee4700 1 -- 172.21.15.146:0/187184498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d58151c20 msgr2=0x7f2d5815f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:23.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.054+0000 7f2d5dee4700 1 --2- 172.21.15.146:0/187184498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d58151c20 0x7f2d5815f950 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f2d50016000 tx=0x7f2d5001a000 comp rx=0 tx=0).stop 2023-10-06T11:10:23.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.054+0000 7f2d5dee4700 1 -- 172.21.15.146:0/187184498 shutdown_connections 2023-10-06T11:10:23.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.054+0000 7f2d5dee4700 1 --2- 172.21.15.146:0/187184498 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2d38066f30 0x7f2d380693e0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:23.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.054+0000 7f2d5dee4700 1 --2- 172.21.15.146:0/187184498 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2d58151c20 0x7f2d5815f950 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:23.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.054+0000 7f2d5dee4700 1 --2- 172.21.15.146:0/187184498 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d58147170 0x7f2d581516e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:23.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.054+0000 7f2d5dee4700 1 --2- 172.21.15.146:0/187184498 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d58147540 0x7f2d5815f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:23.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.054+0000 7f2d5dee4700 1 -- 172.21.15.146:0/187184498 >> 172.21.15.146:0/187184498 conn(0x7f2d5806eba0 msgr2=0x7f2d580ce950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:23.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.054+0000 7f2d5dee4700 1 -- 172.21.15.146:0/187184498 shutdown_connections 2023-10-06T11:10:23.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.054+0000 7f2d5dee4700 1 -- 172.21.15.146:0/187184498 wait complete. 2023-10-06T11:10:23.068 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T11:10:23.069 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:10:23.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.183+0000 7f4d6759e700 1 Processor -- start 2023-10-06T11:10:23.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.183+0000 7f4d6759e700 1 -- start start 2023-10-06T11:10:23.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.184+0000 7f4d6759e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4d68142d40 0x7f4d68067470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:23.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.184+0000 7f4d6759e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d6806f5d0 0x7f4d680c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:23.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.184+0000 7f4d6759e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d68067e20 con 0x7f4d680679b0 2023-10-06T11:10:23.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.184+0000 7f4d6759e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d680c77f0 con 0x7f4d68142d40 2023-10-06T11:10:23.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.184+0000 7f4d6759e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d680cad90 con 0x7f4d6806f5d0 2023-10-06T11:10:23.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.184+0000 7f4d6659c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4d68142d40 0x7f4d68067470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:23.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.184+0000 7f4d65d9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4d680679b0 0x7f4d6806eec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36848/0 (socket says 172.21.15.146:36848) 2023-10-06T11:10:23.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.184+0000 7f4d65d9b700 1 -- 172.21.15.146:0/3706530821 learned_addr learned my addr 172.21.15.146:0/3706530821 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:10:23.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.184+0000 7f4d66d9d700 1 --2- 172.21.15.146:0/3706530821 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d6806f5d0 0x7f4d680c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:23.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.184+0000 7f4d6659c700 1 -- 172.21.15.146:0/3706530821 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d6806f5d0 msgr2=0x7f4d680c7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:23.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.184+0000 7f4d6659c700 1 --2- 172.21.15.146:0/3706530821 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d6806f5d0 0x7f4d680c7c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:23.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.184+0000 7f4d6659c700 1 -- 172.21.15.146:0/3706530821 >> v1:172.21.15.146:6789/0 conn(0x7f4d680679b0 legacy=0x7f4d6806eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:23.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.184+0000 7f4d6659c700 1 -- 172.21.15.146:0/3706530821 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d680cb070 con 0x7f4d68142d40 2023-10-06T11:10:23.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.184+0000 7f4d6559a700 1 -- 172.21.15.146:0/3706530821 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 302715944 0 0) 0x7f4d68067e20 con 0x7f4d680679b0 2023-10-06T11:10:23.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.184+0000 7f4d6659c700 1 --2- 172.21.15.146:0/3706530821 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d68142d40 0x7f4d68067470 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f4d580098e0 tx=0x7f4d580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa981cec46c9350c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:23.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.185+0000 7f4d6559a700 1 -- 172.21.15.146:0/3706530821 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d58009e80 con 0x7f4d68142d40 2023-10-06T11:10:23.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.185+0000 7f4d6559a700 1 -- 172.21.15.146:0/3706530821 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5800b860 con 0x7f4d68142d40 2023-10-06T11:10:23.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.185+0000 7f4d6559a700 1 -- 172.21.15.146:0/3706530821 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5800bbe0 con 0x7f4d68142d40 2023-10-06T11:10:23.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.185+0000 7f4d6759e700 1 -- 172.21.15.146:0/3706530821 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d68142d40 msgr2=0x7f4d68067470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:23.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.185+0000 7f4d6759e700 1 --2- 172.21.15.146:0/3706530821 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d68142d40 0x7f4d68067470 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f4d580098e0 tx=0x7f4d580091a0 comp rx=0 tx=0).stop 2023-10-06T11:10:23.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.185+0000 7f4d6759e700 1 -- 172.21.15.146:0/3706530821 shutdown_connections 2023-10-06T11:10:23.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.185+0000 7f4d6759e700 1 --2- 172.21.15.146:0/3706530821 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d6806f5d0 0x7f4d680c7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:23.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.185+0000 7f4d6759e700 1 --2- 172.21.15.146:0/3706530821 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d68142d40 0x7f4d68067470 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:23.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.185+0000 7f4d6759e700 1 -- 172.21.15.146:0/3706530821 >> 172.21.15.146:0/3706530821 conn(0x7f4d68069010 msgr2=0x7f4d680cd120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:23.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.185+0000 7f4d6759e700 1 -- 172.21.15.146:0/3706530821 shutdown_connections 2023-10-06T11:10:23.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.185+0000 7f4d6759e700 1 -- 172.21.15.146:0/3706530821 wait complete. 2023-10-06T11:10:23.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.186+0000 7f4d6759e700 1 Processor -- start 2023-10-06T11:10:23.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.186+0000 7f4d6759e700 1 -- start start 2023-10-06T11:10:23.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.187+0000 7f4d6759e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d680679b0 0x7f4d68140d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:23.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.187+0000 7f4d6759e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d6806f5d0 0x7f4d68154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:23.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.187+0000 7f4d6759e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d68142d40 0x7f4d680b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:23.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.187+0000 7f4d6759e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d680b28a0 con 0x7f4d680679b0 2023-10-06T11:10:23.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.187+0000 7f4d6759e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d680b0970 con 0x7f4d68142d40 2023-10-06T11:10:23.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.187+0000 7f4d6759e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d68155580 con 0x7f4d6806f5d0 2023-10-06T11:10:23.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.187+0000 7f4d6659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d680679b0 0x7f4d68140d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:23.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.187+0000 7f4d6659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d680679b0 0x7f4d68140d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37452/0 (socket says 172.21.15.146:37452) 2023-10-06T11:10:23.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.187+0000 7f4d6659c700 1 -- 172.21.15.146:0/4210592813 learned_addr learned my addr 172.21.15.146:0/4210592813 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:23.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.187+0000 7f4d6659c700 1 -- 172.21.15.146:0/4210592813 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d6806f5d0 msgr2=0x7f4d68154ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:23.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.187+0000 7f4d6659c700 1 --2- 172.21.15.146:0/4210592813 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d6806f5d0 0x7f4d68154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:23.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.187+0000 7f4d6659c700 1 -- 172.21.15.146:0/4210592813 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d68142d40 msgr2=0x7f4d680b2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:23.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.187+0000 7f4d66d9d700 1 --2- 172.21.15.146:0/4210592813 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d68142d40 0x7f4d680b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:23.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.187+0000 7f4d6659c700 1 --2- 172.21.15.146:0/4210592813 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d68142d40 0x7f4d680b2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:23.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.187+0000 7f4d6659c700 1 -- 172.21.15.146:0/4210592813 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d58009420 con 0x7f4d680679b0 2023-10-06T11:10:23.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.188+0000 7f4d6659c700 1 --2- 172.21.15.146:0/4210592813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d680679b0 0x7f4d68140d20 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f4d680713f0 tx=0x7f4d58017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:23.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.188+0000 7f4d567fc700 1 -- 172.21.15.146:0/4210592813 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5800bbe0 con 0x7f4d680679b0 2023-10-06T11:10:23.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.188+0000 7f4d567fc700 1 -- 172.21.15.146:0/4210592813 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d58011420 con 0x7f4d680679b0 2023-10-06T11:10:23.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.188+0000 7f4d6759e700 1 -- 172.21.15.146:0/4210592813 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d68155860 con 0x7f4d680679b0 2023-10-06T11:10:23.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.188+0000 7f4d567fc700 1 -- 172.21.15.146:0/4210592813 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d580117e0 con 0x7f4d680679b0 2023-10-06T11:10:23.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.188+0000 7f4d6759e700 1 -- 172.21.15.146:0/4210592813 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d68155e20 con 0x7f4d680679b0 2023-10-06T11:10:23.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.189+0000 7f4d6759e700 1 -- 172.21.15.146:0/4210592813 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d680cc790 con 0x7f4d680679b0 2023-10-06T11:10:23.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.189+0000 7f4d567fc700 1 -- 172.21.15.146:0/4210592813 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4d58011bd0 con 0x7f4d680679b0 2023-10-06T11:10:23.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.189+0000 7f4d567fc700 1 --2- 172.21.15.146:0/4210592813 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4d48066f30 0x7f4d480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:23.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.190+0000 7f4d567fc700 1 -- 172.21.15.146:0/4210592813 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f4d58086120 con 0x7f4d680679b0 2023-10-06T11:10:23.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.190+0000 7f4d65d9b700 1 --2- 172.21.15.146:0/4210592813 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4d48066f30 0x7f4d480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:23.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.190+0000 7f4d65d9b700 1 --2- 172.21.15.146:0/4210592813 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4d48066f30 0x7f4d480693e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4d68154aa0 tx=0x7f4d5c0079d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:23.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.194+0000 7f4d567fc700 1 -- 172.21.15.146:0/4210592813 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4d58053180 con 0x7f4d680679b0 2023-10-06T11:10:23.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.419+0000 7f4d6759e700 1 -- 172.21.15.146:0/4210592813 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d680cb350 con 0x7f4d680679b0 2023-10-06T11:10:23.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.420+0000 7f4d567fc700 1 -- 172.21.15.146:0/4210592813 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4611 (secure 0 0 0) 0x7f4d580567a0 con 0x7f4d680679b0 2023-10-06T11:10:23.420 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:10:23.421 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":56,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5621,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/1872666923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1872666923},{"type":"v1","addr":"172.21.15.151:6833","nonce":1872666923}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":6082,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1430806818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1430806818},{"type":"v1","addr":"172.21.15.151:6835","nonce":1430806818}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":6546,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/1394956500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":1394956500},{"type":"v1","addr":"172.21.15.146:6837","nonce":1394956500}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:09:41.580951+0000","modified":"2023-10-06T11:10:06.415726+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":63,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6540},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6540":{"gid":6540,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6835/3512281867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3512281867},{"type":"v1","addr":"172.21.15.146:6835","nonce":3512281867}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T11:10:23.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.421+0000 7f4d6759e700 1 -- 172.21.15.146:0/4210592813 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4d48066f30 msgr2=0x7f4d480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:23.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.421+0000 7f4d6759e700 1 --2- 172.21.15.146:0/4210592813 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4d48066f30 0x7f4d480693e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f4d68154aa0 tx=0x7f4d5c0079d0 comp rx=0 tx=0).stop 2023-10-06T11:10:23.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.421+0000 7f4d6759e700 1 -- 172.21.15.146:0/4210592813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d680679b0 msgr2=0x7f4d68140d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:23.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.421+0000 7f4d6759e700 1 --2- 172.21.15.146:0/4210592813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d680679b0 0x7f4d68140d20 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f4d680713f0 tx=0x7f4d58017000 comp rx=0 tx=0).stop 2023-10-06T11:10:23.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.421+0000 7f4d6759e700 1 -- 172.21.15.146:0/4210592813 shutdown_connections 2023-10-06T11:10:23.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.421+0000 7f4d6759e700 1 --2- 172.21.15.146:0/4210592813 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4d48066f30 0x7f4d480693e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:23.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.421+0000 7f4d6759e700 1 --2- 172.21.15.146:0/4210592813 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d68142d40 0x7f4d680b2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:23.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.421+0000 7f4d6759e700 1 --2- 172.21.15.146:0/4210592813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d680679b0 0x7f4d68140d20 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:23.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.421+0000 7f4d6759e700 1 --2- 172.21.15.146:0/4210592813 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d6806f5d0 0x7f4d68154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:23.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.421+0000 7f4d6759e700 1 -- 172.21.15.146:0/4210592813 >> 172.21.15.146:0/4210592813 conn(0x7f4d68069010 msgr2=0x7f4d6806a350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:23.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.422+0000 7f4d6759e700 1 -- 172.21.15.146:0/4210592813 shutdown_connections 2023-10-06T11:10:23.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.422+0000 7f4d6759e700 1 -- 172.21.15.146:0/4210592813 wait complete. 2023-10-06T11:10:23.424 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 56 2023-10-06T11:10:23.434 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:10:23.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.548+0000 7f0cedca7700 1 Processor -- start 2023-10-06T11:10:23.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.548+0000 7f0cedca7700 1 -- start start 2023-10-06T11:10:23.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.549+0000 7f0cedca7700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ce8153ab0 0x7f0ce815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:23.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.549+0000 7f0cedca7700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0ce8153e80 0x7f0ce8068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:23.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.549+0000 7f0cedca7700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ce815ac30 con 0x7f0ce80689d0 2023-10-06T11:10:23.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.549+0000 7f0cedca7700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ce8068e50 con 0x7f0ce8153e80 2023-10-06T11:10:23.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.549+0000 7f0cedca7700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce80b4510 con 0x7f0ce8153ab0 2023-10-06T11:10:23.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.550+0000 7f0ce6ffd700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0ce8153e80 0x7f0ce8068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:23.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.550+0000 7f0ce77fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ce8153ab0 0x7f0ce815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:23.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.550+0000 7f0ce6ffd700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0ce8153e80 0x7f0ce8068490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:43168/0 (socket says 172.21.15.146:43168) 2023-10-06T11:10:23.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.550+0000 7f0ce7fff700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f0ce80689d0 0x7f0ce815d270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:37934/0 (socket says 172.21.15.146:37934) 2023-10-06T11:10:23.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.550+0000 7f0ce77fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ce8153ab0 0x7f0ce815a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:36002/0 (socket says 172.21.15.146:36002) 2023-10-06T11:10:23.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.550+0000 7f0ce6ffd700 1 -- 172.21.15.146:0/502585885 learned_addr learned my addr 172.21.15.146:0/502585885 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:23.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.550+0000 7f0ce6ffd700 1 -- 172.21.15.146:0/502585885 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ce8153ab0 msgr2=0x7f0ce815a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:23.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.550+0000 7f0ce6ffd700 1 --2- 172.21.15.146:0/502585885 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ce8153ab0 0x7f0ce815a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:23.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.550+0000 7f0ce6ffd700 1 -- 172.21.15.146:0/502585885 >> v1:172.21.15.151:6789/0 conn(0x7f0ce80689d0 legacy=0x7f0ce815d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:23.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.550+0000 7f0ce6ffd700 1 -- 172.21.15.146:0/502585885 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce80b6530 con 0x7f0ce8153e80 2023-10-06T11:10:23.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.550+0000 7f0ce67fc700 1 -- 172.21.15.146:0/502585885 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4162658912 0 0) 0x7f0ce0001110 con 0x7f0ce80689d0 2023-10-06T11:10:23.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.550+0000 7f0ce77fe700 1 --2- 172.21.15.146:0/502585885 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ce8153ab0 0x7f0ce815a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:10:23.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.550+0000 7f0ce6ffd700 1 --2- 172.21.15.146:0/502585885 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ce8153e80 0x7f0ce8068490 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc0099b0 tx=0x7f0cdc009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=661ac4303622f6da server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:23.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.550+0000 7f0ce67fc700 1 -- 172.21.15.146:0/502585885 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc009ea0 con 0x7f0ce8153e80 2023-10-06T11:10:23.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.550+0000 7f0ce67fc700 1 -- 172.21.15.146:0/502585885 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cdc00b860 con 0x7f0ce8153e80 2023-10-06T11:10:23.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.550+0000 7f0ce67fc700 1 -- 172.21.15.146:0/502585885 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc00bc00 con 0x7f0ce8153e80 2023-10-06T11:10:23.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.551+0000 7f0cedca7700 1 -- 172.21.15.146:0/502585885 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ce8153e80 msgr2=0x7f0ce8068490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:23.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.551+0000 7f0cedca7700 1 --2- 172.21.15.146:0/502585885 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ce8153e80 0x7f0ce8068490 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc0099b0 tx=0x7f0cdc009250 comp rx=0 tx=0).stop 2023-10-06T11:10:23.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.551+0000 7f0cedca7700 1 -- 172.21.15.146:0/502585885 shutdown_connections 2023-10-06T11:10:23.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.551+0000 7f0cedca7700 1 --2- 172.21.15.146:0/502585885 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ce8153ab0 0x7f0ce815a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:23.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.551+0000 7f0cedca7700 1 --2- 172.21.15.146:0/502585885 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ce8153e80 0x7f0ce8068490 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:23.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.551+0000 7f0cedca7700 1 -- 172.21.15.146:0/502585885 >> 172.21.15.146:0/502585885 conn(0x7f0ce806eba0 msgr2=0x7f0ce806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:23.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.551+0000 7f0cedca7700 1 -- 172.21.15.146:0/502585885 shutdown_connections 2023-10-06T11:10:23.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.551+0000 7f0cedca7700 1 -- 172.21.15.146:0/502585885 wait complete. 2023-10-06T11:10:23.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.552+0000 7f0cedca7700 1 Processor -- start 2023-10-06T11:10:23.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.552+0000 7f0cedca7700 1 -- start start 2023-10-06T11:10:23.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.553+0000 7f0cedca7700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ce80689d0 0x7f0ce815eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:23.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.553+0000 7f0cedca7700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ce8153ab0 0x7f0ce8143f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:23.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.553+0000 7f0cedca7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ce8153e80 0x7f0ce80ce940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:23.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.553+0000 7f0cedca7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce81547b0 con 0x7f0ce8153e80 2023-10-06T11:10:23.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.553+0000 7f0cedca7700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce8154a90 con 0x7f0ce80689d0 2023-10-06T11:10:23.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.553+0000 7f0cedca7700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce8154d70 con 0x7f0ce8153ab0 2023-10-06T11:10:23.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.553+0000 7f0ce7fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ce8153e80 0x7f0ce80ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:23.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.553+0000 7f0ce7fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ce8153e80 0x7f0ce80ce940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37468/0 (socket says 172.21.15.146:37468) 2023-10-06T11:10:23.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.553+0000 7f0ce7fff700 1 -- 172.21.15.146:0/2106752198 learned_addr learned my addr 172.21.15.146:0/2106752198 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:23.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.553+0000 7f0ce6ffd700 1 --2- 172.21.15.146:0/2106752198 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ce8153ab0 0x7f0ce8143f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:23.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.553+0000 7f0ce77fe700 1 --2- 172.21.15.146:0/2106752198 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ce80689d0 0x7f0ce815eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:23.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.553+0000 7f0ce7fff700 1 -- 172.21.15.146:0/2106752198 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ce8153ab0 msgr2=0x7f0ce8143f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:23.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.553+0000 7f0ce7fff700 1 --2- 172.21.15.146:0/2106752198 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ce8153ab0 0x7f0ce8143f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:23.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.553+0000 7f0ce7fff700 1 -- 172.21.15.146:0/2106752198 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ce80689d0 msgr2=0x7f0ce815eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:23.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.553+0000 7f0ce7fff700 1 --2- 172.21.15.146:0/2106752198 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ce80689d0 0x7f0ce815eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:23.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.553+0000 7f0ce7fff700 1 -- 172.21.15.146:0/2106752198 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd8009a20 con 0x7f0ce8153e80 2023-10-06T11:10:23.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.553+0000 7f0ce77fe700 1 --2- 172.21.15.146:0/2106752198 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ce80689d0 0x7f0ce815eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:10:23.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.553+0000 7f0ce6ffd700 1 --2- 172.21.15.146:0/2106752198 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ce8153ab0 0x7f0ce8143f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:10:23.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.554+0000 7f0ce7fff700 1 --2- 172.21.15.146:0/2106752198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ce8153e80 0x7f0ce80ce940 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f0ce000c4e0 tx=0x7f0ce0007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:23.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.554+0000 7f0ccf7fe700 1 -- 172.21.15.146:0/2106752198 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce0005b40 con 0x7f0ce8153e80 2023-10-06T11:10:23.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.554+0000 7f0ccf7fe700 1 -- 172.21.15.146:0/2106752198 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce0005ca0 con 0x7f0ce8153e80 2023-10-06T11:10:23.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.554+0000 7f0cedca7700 1 -- 172.21.15.146:0/2106752198 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cdc0094f0 con 0x7f0ce8153e80 2023-10-06T11:10:23.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.554+0000 7f0ccf7fe700 1 -- 172.21.15.146:0/2106752198 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce0007320 con 0x7f0ce8153e80 2023-10-06T11:10:23.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.554+0000 7f0cedca7700 1 -- 172.21.15.146:0/2106752198 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ce8155330 con 0x7f0ce8153e80 2023-10-06T11:10:23.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.555+0000 7f0cedca7700 1 -- 172.21.15.146:0/2106752198 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ce804c380 con 0x7f0ce8153e80 2023-10-06T11:10:23.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.555+0000 7f0ccf7fe700 1 -- 172.21.15.146:0/2106752198 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0ce001b3b0 con 0x7f0ce8153e80 2023-10-06T11:10:23.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.556+0000 7f0ccf7fe700 1 --2- 172.21.15.146:0/2106752198 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0cd4066f30 0x7f0cd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:23.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.556+0000 7f0ccf7fe700 1 -- 172.21.15.146:0/2106752198 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f0ce0083b70 con 0x7f0ce8153e80 2023-10-06T11:10:23.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.556+0000 7f0ce77fe700 1 --2- 172.21.15.146:0/2106752198 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0cd4066f30 0x7f0cd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:23.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.556+0000 7f0ce77fe700 1 --2- 172.21.15.146:0/2106752198 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0cd4066f30 0x7f0cd40693e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0cd80099f0 tx=0x7f0cd800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:23.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.560+0000 7f0ccf7fe700 1 -- 172.21.15.146:0/2106752198 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0ce0050bd0 con 0x7f0ce8153e80 2023-10-06T11:10:23.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.789+0000 7f0cedca7700 1 -- 172.21.15.146:0/2106752198 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ce815abf0 con 0x7f0ce8153e80 2023-10-06T11:10:23.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.789+0000 7f0ccf7fe700 1 -- 172.21.15.146:0/2106752198 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) v1 ==== 94+0+4611 (secure 0 0 0) 0x7f0ce0017020 con 0x7f0ce8153e80 2023-10-06T11:10:23.791 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:10:23.791 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":56,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5621,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/1872666923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1872666923},{"type":"v1","addr":"172.21.15.151:6833","nonce":1872666923}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":6082,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1430806818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1430806818},{"type":"v1","addr":"172.21.15.151:6835","nonce":1430806818}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":6546,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/1394956500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":1394956500},{"type":"v1","addr":"172.21.15.146:6837","nonce":1394956500}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:09:41.580951+0000","modified":"2023-10-06T11:10:06.415726+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":63,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6540},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6540":{"gid":6540,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":4,"addr":"172.21.15.146:6835/3512281867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3512281867},{"type":"v1","addr":"172.21.15.146:6835","nonce":3512281867}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-06T11:10:23.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.791+0000 7f0cedca7700 1 -- 172.21.15.146:0/2106752198 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0cd4066f30 msgr2=0x7f0cd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:23.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.791+0000 7f0cedca7700 1 --2- 172.21.15.146:0/2106752198 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0cd4066f30 0x7f0cd40693e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0cd80099f0 tx=0x7f0cd800b040 comp rx=0 tx=0).stop 2023-10-06T11:10:23.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.791+0000 7f0cedca7700 1 -- 172.21.15.146:0/2106752198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ce8153e80 msgr2=0x7f0ce80ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:23.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.791+0000 7f0cedca7700 1 --2- 172.21.15.146:0/2106752198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ce8153e80 0x7f0ce80ce940 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f0ce000c4e0 tx=0x7f0ce0007f40 comp rx=0 tx=0).stop 2023-10-06T11:10:23.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.791+0000 7f0cedca7700 1 -- 172.21.15.146:0/2106752198 shutdown_connections 2023-10-06T11:10:23.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.791+0000 7f0cedca7700 1 --2- 172.21.15.146:0/2106752198 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0cd4066f30 0x7f0cd40693e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:23.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.791+0000 7f0cedca7700 1 --2- 172.21.15.146:0/2106752198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ce8153e80 0x7f0ce80ce940 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:23.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.791+0000 7f0cedca7700 1 --2- 172.21.15.146:0/2106752198 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ce80689d0 0x7f0ce815eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:23.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.791+0000 7f0cedca7700 1 --2- 172.21.15.146:0/2106752198 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ce8153ab0 0x7f0ce8143f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:23.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.791+0000 7f0cedca7700 1 -- 172.21.15.146:0/2106752198 >> 172.21.15.146:0/2106752198 conn(0x7f0ce806eba0 msgr2=0x7f0ce80b1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:23.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.791+0000 7f0cedca7700 1 -- 172.21.15.146:0/2106752198 shutdown_connections 2023-10-06T11:10:23.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.791+0000 7f0cedca7700 1 -- 172.21.15.146:0/2106752198 wait complete. 2023-10-06T11:10:23.793 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 56 2023-10-06T11:10:23.804 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:10:23.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.918+0000 7fd704458700 1 Processor -- start 2023-10-06T11:10:23.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.918+0000 7fd704458700 1 -- start start 2023-10-06T11:10:23.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.919+0000 7fd704458700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6fc068ba0 0x7fd6fc15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:23.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.919+0000 7fd704458700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd6fc153e80 0x7fd6fc0b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:23.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.919+0000 7fd704458700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6fc15ac30 con 0x7fd6fc153ab0 2023-10-06T11:10:23.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.919+0000 7fd704458700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6fc0b4510 con 0x7fd6fc153e80 2023-10-06T11:10:23.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.919+0000 7fd704458700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc0b6530 con 0x7fd6fc068ba0 2023-10-06T11:10:23.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.919+0000 7fd7021f4700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd6fc153ab0 0x7fd6fc068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36862/0 (socket says 172.21.15.146:36862) 2023-10-06T11:10:23.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.919+0000 7fd7021f4700 1 -- 172.21.15.146:0/3688383133 learned_addr learned my addr 172.21.15.146:0/3688383133 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:10:23.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.919+0000 7fd7019f3700 1 --2- 172.21.15.146:0/3688383133 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6fc068ba0 0x7fd6fc15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:23.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.919+0000 7fd7029f5700 1 --2- 172.21.15.146:0/3688383133 >> v2:172.21.15.151:3300/0 conn(0x7fd6fc153e80 0x7fd6fc0b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:23.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.919+0000 7fd7011f2700 1 -- 172.21.15.146:0/3688383133 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 287202863 0 0) 0x7fd6f8001490 con 0x7fd6fc153ab0 2023-10-06T11:10:23.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.919+0000 7fd7011f2700 1 -- 172.21.15.146:0/3688383133 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6e8003570 con 0x7fd6fc153ab0 2023-10-06T11:10:23.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.920+0000 7fd7011f2700 1 -- 172.21.15.146:0/3688383133 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 998979152 0 0) 0x7fd6e8003570 con 0x7fd6fc153ab0 2023-10-06T11:10:23.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.920+0000 7fd7011f2700 1 -- 172.21.15.146:0/3688383133 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6fc068ba0 msgr2=0x7fd6fc15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:23.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.920+0000 7fd7011f2700 1 --2- 172.21.15.146:0/3688383133 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6fc068ba0 0x7fd6fc15a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:23.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.920+0000 7fd7011f2700 1 -- 172.21.15.146:0/3688383133 >> v2:172.21.15.151:3300/0 conn(0x7fd6fc153e80 msgr2=0x7fd6fc0b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:23.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.920+0000 7fd7011f2700 1 --2- 172.21.15.146:0/3688383133 >> v2:172.21.15.151:3300/0 conn(0x7fd6fc153e80 0x7fd6fc0b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:23.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.920+0000 7fd7011f2700 1 -- 172.21.15.146:0/3688383133 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6fc0b5c50 con 0x7fd6fc153ab0 2023-10-06T11:10:23.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.920+0000 7fd7011f2700 1 -- 172.21.15.146:0/3688383133 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fd6f8001980 con 0x7fd6fc153ab0 2023-10-06T11:10:23.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.920+0000 7fd7011f2700 1 -- 172.21.15.146:0/3688383133 >> v1:172.21.15.146:6789/0 conn(0x7fd6fc153ab0 legacy=0x7fd6fc068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:23.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.920+0000 7fd7011f2700 1 --2- 172.21.15.146:0/3688383133 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6e8003a60 0x7fd6e8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:23.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.920+0000 7fd7011f2700 1 --2- 172.21.15.146:0/3688383133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6e8004810 0x7fd6e8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:23.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.920+0000 7fd7011f2700 1 --2- 172.21.15.146:0/3688383133 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6e80051c0 0x7fd6e800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:23.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.920+0000 7fd7011f2700 1 -- 172.21.15.146:0/3688383133 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc0b4510 con 0x7fd6e8004810 2023-10-06T11:10:23.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.920+0000 7fd7011f2700 1 -- 172.21.15.146:0/3688383133 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc0b6530 con 0x7fd6e80051c0 2023-10-06T11:10:23.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.920+0000 7fd7011f2700 1 -- 172.21.15.146:0/3688383133 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e800bfa0 con 0x7fd6e8003a60 2023-10-06T11:10:23.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.920+0000 7fd7019f3700 1 --2- 172.21.15.146:0/3688383133 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6fc068ba0 0x7fd6fc15a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:10:23.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.920+0000 7fd7019f3700 1 --2- 172.21.15.146:0/3688383133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6e8004810 0x7fd6e8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:23.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.920+0000 7fd7021f4700 1 --2- 172.21.15.146:0/3688383133 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6e8003a60 0x7fd6e8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:23.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.920+0000 7fd7029f5700 1 --2- 172.21.15.146:0/3688383133 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6e80051c0 0x7fd6e800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:23.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.920+0000 7fd7019f3700 1 -- 172.21.15.146:0/3688383133 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6e8003a60 msgr2=0x7fd6e8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:23.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.920+0000 7fd7019f3700 1 --2- 172.21.15.146:0/3688383133 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6e8003a60 0x7fd6e8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:23.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.920+0000 7fd7019f3700 1 -- 172.21.15.146:0/3688383133 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6e80051c0 msgr2=0x7fd6e800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:23.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.920+0000 7fd7019f3700 1 --2- 172.21.15.146:0/3688383133 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6e80051c0 0x7fd6e800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:23.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.920+0000 7fd7019f3700 1 -- 172.21.15.146:0/3688383133 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e8003570 con 0x7fd6e8004810 2023-10-06T11:10:23.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.920+0000 7fd7019f3700 1 --2- 172.21.15.146:0/3688383133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6e8004810 0x7fd6e8004c80 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc0d16d0 tx=0x7fd6ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=832b42c00dabdd97 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:23.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.920+0000 7fd7011f2700 1 -- 172.21.15.146:0/3688383133 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec00e710 con 0x7fd6e8004810 2023-10-06T11:10:23.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.920+0000 7fd7011f2700 1 -- 172.21.15.146:0/3688383133 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6ec00e870 con 0x7fd6e8004810 2023-10-06T11:10:23.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.920+0000 7fd7011f2700 1 -- 172.21.15.146:0/3688383133 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec00ec10 con 0x7fd6e8004810 2023-10-06T11:10:23.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.921+0000 7fd704458700 1 -- 172.21.15.146:0/3688383133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6e8004810 msgr2=0x7fd6e8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:23.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.921+0000 7fd704458700 1 --2- 172.21.15.146:0/3688383133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6e8004810 0x7fd6e8004c80 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc0d16d0 tx=0x7fd6ec0091a0 comp rx=0 tx=0).stop 2023-10-06T11:10:23.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.921+0000 7fd7029f5700 1 -- 172.21.15.146:0/3688383133 reap_dead start 2023-10-06T11:10:23.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.921+0000 7fd704458700 1 -- 172.21.15.146:0/3688383133 shutdown_connections 2023-10-06T11:10:23.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.921+0000 7fd704458700 1 -- 172.21.15.146:0/3688383133 >> 172.21.15.146:0/3688383133 conn(0x7fd6fc06eba0 msgr2=0x7fd6fc06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:23.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.921+0000 7fd704458700 1 -- 172.21.15.146:0/3688383133 shutdown_connections 2023-10-06T11:10:23.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.921+0000 7fd704458700 1 -- 172.21.15.146:0/3688383133 wait complete. 2023-10-06T11:10:23.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.922+0000 7fd704458700 1 Processor -- start 2023-10-06T11:10:23.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.922+0000 7fd704458700 1 -- start start 2023-10-06T11:10:23.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.923+0000 7fd704458700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6e8004810 0x7fd6fc14f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:23.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.923+0000 7fd704458700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6fc1500c0 0x7fd6fc0b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:23.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.923+0000 7fd704458700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6fc0b20a0 0x7fd6fc0ce9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:23.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.923+0000 7fd704458700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc0aff60 con 0x7fd6fc1500c0 2023-10-06T11:10:23.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.923+0000 7fd704458700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc0b0240 con 0x7fd6fc0b20a0 2023-10-06T11:10:23.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.923+0000 7fd704458700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc0b0520 con 0x7fd6e8004810 2023-10-06T11:10:23.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.923+0000 7fd7019f3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6fc1500c0 0x7fd6fc0b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:23.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.923+0000 7fd7019f3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6fc1500c0 0x7fd6fc0b1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37482/0 (socket says 172.21.15.146:37482) 2023-10-06T11:10:23.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.923+0000 7fd7019f3700 1 -- 172.21.15.146:0/4064852985 learned_addr learned my addr 172.21.15.146:0/4064852985 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:23.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.923+0000 7fd7021f4700 1 --2- 172.21.15.146:0/4064852985 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6e8004810 0x7fd6fc14f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:23.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.923+0000 7fd7029f5700 1 --2- 172.21.15.146:0/4064852985 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6fc0b20a0 0x7fd6fc0ce9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:23.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.923+0000 7fd7019f3700 1 -- 172.21.15.146:0/4064852985 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6e8004810 msgr2=0x7fd6fc14f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:23.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.923+0000 7fd7019f3700 1 --2- 172.21.15.146:0/4064852985 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6e8004810 0x7fd6fc14f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:23.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.923+0000 7fd7019f3700 1 -- 172.21.15.146:0/4064852985 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6fc0b20a0 msgr2=0x7fd6fc0ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:23.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.923+0000 7fd7019f3700 1 --2- 172.21.15.146:0/4064852985 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6fc0b20a0 0x7fd6fc0ce9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:23.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.923+0000 7fd7019f3700 1 -- 172.21.15.146:0/4064852985 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6fc0b0800 con 0x7fd6fc1500c0 2023-10-06T11:10:23.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.923+0000 7fd7029f5700 1 --2- 172.21.15.146:0/4064852985 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6fc0b20a0 0x7fd6fc0ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:10:23.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.923+0000 7fd7019f3700 1 --2- 172.21.15.146:0/4064852985 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6fc1500c0 0x7fd6fc0b1b60 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec0091e0 tx=0x7fd6ec019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:23.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.924+0000 7fd6f27fc700 1 -- 172.21.15.146:0/4064852985 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec022070 con 0x7fd6fc1500c0 2023-10-06T11:10:23.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.924+0000 7fd6f27fc700 1 -- 172.21.15.146:0/4064852985 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6ec00ebf0 con 0x7fd6fc1500c0 2023-10-06T11:10:23.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.924+0000 7fd704458700 1 -- 172.21.15.146:0/4064852985 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6fc0b0ae0 con 0x7fd6fc1500c0 2023-10-06T11:10:23.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.924+0000 7fd6f27fc700 1 -- 172.21.15.146:0/4064852985 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec01c670 con 0x7fd6fc1500c0 2023-10-06T11:10:23.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.924+0000 7fd704458700 1 -- 172.21.15.146:0/4064852985 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6fc0cef30 con 0x7fd6fc1500c0 2023-10-06T11:10:23.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.924+0000 7fd704458700 1 -- 172.21.15.146:0/4064852985 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6fc04c380 con 0x7fd6fc1500c0 2023-10-06T11:10:23.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.925+0000 7fd6f27fc700 1 -- 172.21.15.146:0/4064852985 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd6ec01caa0 con 0x7fd6fc1500c0 2023-10-06T11:10:23.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.925+0000 7fd6f27fc700 1 --2- 172.21.15.146:0/4064852985 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd6e0066f30 0x7fd6e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:23.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.925+0000 7fd6f27fc700 1 -- 172.21.15.146:0/4064852985 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6230+0+0 (secure 0 0 0) 0x7fd6ec086150 con 0x7fd6fc1500c0 2023-10-06T11:10:23.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.925+0000 7fd7021f4700 1 --2- 172.21.15.146:0/4064852985 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd6e0066f30 0x7fd6e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:23.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.926+0000 7fd7021f4700 1 --2- 172.21.15.146:0/4064852985 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd6e0066f30 0x7fd6e00693e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd6f80013d0 tx=0x7fd6f8006040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:23.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:23.930+0000 7fd6f27fc700 1 -- 172.21.15.146:0/4064852985 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd6ec053110 con 0x7fd6fc1500c0 2023-10-06T11:10:24.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.114+0000 7fd704458700 1 -- 172.21.15.146:0/4064852985 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6fc0b6250 con 0x7fd6fc1500c0 2023-10-06T11:10:24.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.115+0000 7fd6f27fc700 1 -- 172.21.15.146:0/4064852985 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+17177 (secure 0 0 0) 0x7fd6ec056730 con 0x7fd6fc1500c0 2023-10-06T11:10:24.116 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:10:24.116 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":63,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:10:03.392685+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:09:39.260612+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2023-10-06T11:09:40.552424+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6834/236648406":"2023-10-07T11:10:03.392660+0000","172.21.15.146:6836/236648406":"2023-10-07T11:10:03.392660+0000","172.21.15.151:6833/2990544048":"2023-10-07T11:10:02.392572+0000","172.21.15.151:6835/2990544048":"2023-10-07T11:10:02.392572+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:10:24.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.117+0000 7fd704458700 1 -- 172.21.15.146:0/4064852985 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd6e0066f30 msgr2=0x7fd6e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:24.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.117+0000 7fd704458700 1 --2- 172.21.15.146:0/4064852985 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd6e0066f30 0x7fd6e00693e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd6f80013d0 tx=0x7fd6f8006040 comp rx=0 tx=0).stop 2023-10-06T11:10:24.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.117+0000 7fd704458700 1 -- 172.21.15.146:0/4064852985 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6fc1500c0 msgr2=0x7fd6fc0b1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:24.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.117+0000 7fd704458700 1 --2- 172.21.15.146:0/4064852985 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6fc1500c0 0x7fd6fc0b1b60 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec0091e0 tx=0x7fd6ec019000 comp rx=0 tx=0).stop 2023-10-06T11:10:24.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.117+0000 7fd704458700 1 -- 172.21.15.146:0/4064852985 shutdown_connections 2023-10-06T11:10:24.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.117+0000 7fd704458700 1 --2- 172.21.15.146:0/4064852985 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd6e0066f30 0x7fd6e00693e0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:24.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.117+0000 7fd704458700 1 --2- 172.21.15.146:0/4064852985 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6fc0b20a0 0x7fd6fc0ce9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:24.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.117+0000 7fd704458700 1 --2- 172.21.15.146:0/4064852985 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6e8004810 0x7fd6fc14f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:24.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.117+0000 7fd704458700 1 --2- 172.21.15.146:0/4064852985 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6fc1500c0 0x7fd6fc0b1b60 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:24.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.117+0000 7fd704458700 1 -- 172.21.15.146:0/4064852985 >> 172.21.15.146:0/4064852985 conn(0x7fd6fc06eba0 msgr2=0x7fd6fc152070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:24.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.117+0000 7fd704458700 1 -- 172.21.15.146:0/4064852985 shutdown_connections 2023-10-06T11:10:24.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.117+0000 7fd704458700 1 -- 172.21.15.146:0/4064852985 wait complete. 2023-10-06T11:10:24.130 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T11:10:24.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.246+0000 7f4b30765700 1 Processor -- start 2023-10-06T11:10:24.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.246+0000 7f4b30765700 1 -- start start 2023-10-06T11:10:24.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.247+0000 7f4b30765700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4b2815a160 0x7f4b280c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:24.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.247+0000 7f4b30765700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4b280ae730 0x7f4b280aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:24.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.247+0000 7f4b30765700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b280ae2a0 con 0x7f4b280ce3d0 2023-10-06T11:10:24.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.247+0000 7f4b30765700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b2815a530 con 0x7f4b280ae730 2023-10-06T11:10:24.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.247+0000 7f4b30765700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b280af0f0 con 0x7f4b2815a160 2023-10-06T11:10:24.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.247+0000 7f4b2dd00700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4b280ae730 0x7f4b280aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:24.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.247+0000 7f4b2ed02700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4b280ce3d0 0x7f4b280ce7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36872/0 (socket says 172.21.15.146:36872) 2023-10-06T11:10:24.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.247+0000 7f4b2ed02700 1 -- 172.21.15.146:0/4163631549 learned_addr learned my addr 172.21.15.146:0/4163631549 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:10:24.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.248+0000 7f4b2e501700 1 --2- 172.21.15.146:0/4163631549 >> v2:172.21.15.151:3300/0 conn(0x7f4b2815a160 0x7f4b280c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:24.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.248+0000 7f4b2dd00700 1 -- 172.21.15.146:0/4163631549 >> v2:172.21.15.151:3300/0 conn(0x7f4b2815a160 msgr2=0x7f4b280c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:24.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.248+0000 7f4b2dd00700 1 --2- 172.21.15.146:0/4163631549 >> v2:172.21.15.151:3300/0 conn(0x7f4b2815a160 0x7f4b280c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:24.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.248+0000 7f4b2dd00700 1 -- 172.21.15.146:0/4163631549 >> v1:172.21.15.146:6789/0 conn(0x7f4b280ce3d0 legacy=0x7f4b280ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:24.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.248+0000 7f4b2dd00700 1 -- 172.21.15.146:0/4163631549 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b280ad690 con 0x7f4b280ae730 2023-10-06T11:10:24.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.248+0000 7f4b2e501700 1 --2- 172.21.15.146:0/4163631549 >> v2:172.21.15.151:3300/0 conn(0x7f4b2815a160 0x7f4b280c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:10:24.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.248+0000 7f4b2d4ff700 1 -- 172.21.15.146:0/4163631549 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 232572559 0 0) 0x7f4b280ae2a0 con 0x7f4b280ce3d0 2023-10-06T11:10:24.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.248+0000 7f4b2dd00700 1 --2- 172.21.15.146:0/4163631549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b280ae730 0x7f4b280aebb0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f4b28065100 tx=0x7f4b180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d2aaa6cc38d7744 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:24.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.248+0000 7f4b2d4ff700 1 -- 172.21.15.146:0/4163631549 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1800b6b0 con 0x7f4b280ae730 2023-10-06T11:10:24.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.248+0000 7f4b2d4ff700 1 -- 172.21.15.146:0/4163631549 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1800b810 con 0x7f4b280ae730 2023-10-06T11:10:24.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.248+0000 7f4b2d4ff700 1 -- 172.21.15.146:0/4163631549 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1800bbb0 con 0x7f4b280ae730 2023-10-06T11:10:24.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.248+0000 7f4b30765700 1 -- 172.21.15.146:0/4163631549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b280ae730 msgr2=0x7f4b280aebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:24.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.248+0000 7f4b30765700 1 --2- 172.21.15.146:0/4163631549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b280ae730 0x7f4b280aebb0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f4b28065100 tx=0x7f4b180091a0 comp rx=0 tx=0).stop 2023-10-06T11:10:24.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.249+0000 7f4b30765700 1 -- 172.21.15.146:0/4163631549 shutdown_connections 2023-10-06T11:10:24.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.249+0000 7f4b30765700 1 --2- 172.21.15.146:0/4163631549 >> v2:172.21.15.151:3300/0 conn(0x7f4b2815a160 0x7f4b280c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:24.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.249+0000 7f4b30765700 1 --2- 172.21.15.146:0/4163631549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b280ae730 0x7f4b280aebb0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:24.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.249+0000 7f4b30765700 1 -- 172.21.15.146:0/4163631549 >> 172.21.15.146:0/4163631549 conn(0x7f4b2806f380 msgr2=0x7f4b280d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:24.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.249+0000 7f4b30765700 1 -- 172.21.15.146:0/4163631549 shutdown_connections 2023-10-06T11:10:24.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.249+0000 7f4b30765700 1 -- 172.21.15.146:0/4163631549 wait complete. 2023-10-06T11:10:24.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.250+0000 7f4b30765700 1 Processor -- start 2023-10-06T11:10:24.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.250+0000 7f4b30765700 1 -- start start 2023-10-06T11:10:24.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.250+0000 7f4b30765700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b280ae730 0x7f4b280b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:24.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.250+0000 7f4b30765700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b280ce3d0 0x7f4b281564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:24.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.250+0000 7f4b30765700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b2815a160 0x7f4b280c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:24.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.250+0000 7f4b30765700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b280c8880 con 0x7f4b280ce3d0 2023-10-06T11:10:24.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.250+0000 7f4b30765700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b280c8e40 con 0x7f4b2815a160 2023-10-06T11:10:24.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.250+0000 7f4b30765700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b280b54d0 con 0x7f4b280ae730 2023-10-06T11:10:24.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.250+0000 7f4b2dd00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b280ce3d0 0x7f4b281564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:24.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.250+0000 7f4b2dd00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b280ce3d0 0x7f4b281564f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37494/0 (socket says 172.21.15.146:37494) 2023-10-06T11:10:24.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.250+0000 7f4b2dd00700 1 -- 172.21.15.146:0/83124154 learned_addr learned my addr 172.21.15.146:0/83124154 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:24.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.251+0000 7f4b2ed02700 1 --2- 172.21.15.146:0/83124154 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b2815a160 0x7f4b280c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:24.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.251+0000 7f4b2e501700 1 --2- 172.21.15.146:0/83124154 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b280ae730 0x7f4b280b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:24.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.251+0000 7f4b2dd00700 1 -- 172.21.15.146:0/83124154 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b280ae730 msgr2=0x7f4b280b4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:24.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.251+0000 7f4b2dd00700 1 --2- 172.21.15.146:0/83124154 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b280ae730 0x7f4b280b4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:24.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.251+0000 7f4b2dd00700 1 -- 172.21.15.146:0/83124154 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b2815a160 msgr2=0x7f4b280c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:24.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.251+0000 7f4b2dd00700 1 --2- 172.21.15.146:0/83124154 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b2815a160 0x7f4b280c92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:24.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.251+0000 7f4b2dd00700 1 -- 172.21.15.146:0/83124154 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b18009420 con 0x7f4b280ce3d0 2023-10-06T11:10:24.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.251+0000 7f4b2ed02700 1 --2- 172.21.15.146:0/83124154 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b2815a160 0x7f4b280c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:10:24.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.251+0000 7f4b2dd00700 1 --2- 172.21.15.146:0/83124154 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b280ce3d0 0x7f4b281564f0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f4b1800b0e0 tx=0x7f4b18017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:24.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.251+0000 7f4b1e7fc700 1 -- 172.21.15.146:0/83124154 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1800bb90 con 0x7f4b280ce3d0 2023-10-06T11:10:24.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.251+0000 7f4b1e7fc700 1 -- 172.21.15.146:0/83124154 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b18000cc0 con 0x7f4b280ce3d0 2023-10-06T11:10:24.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.251+0000 7f4b30765700 1 -- 172.21.15.146:0/83124154 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b28156a30 con 0x7f4b280ce3d0 2023-10-06T11:10:24.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.251+0000 7f4b1e7fc700 1 -- 172.21.15.146:0/83124154 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b18011630 con 0x7f4b280ce3d0 2023-10-06T11:10:24.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.251+0000 7f4b30765700 1 -- 172.21.15.146:0/83124154 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b280b5770 con 0x7f4b280ce3d0 2023-10-06T11:10:24.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.252+0000 7f4b30765700 1 -- 172.21.15.146:0/83124154 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b28068390 con 0x7f4b280ce3d0 2023-10-06T11:10:24.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.252+0000 7f4b1e7fc700 1 -- 172.21.15.146:0/83124154 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4b18011a20 con 0x7f4b280ce3d0 2023-10-06T11:10:24.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.253+0000 7f4b1e7fc700 1 --2- 172.21.15.146:0/83124154 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4b0c066f30 0x7f4b0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:24.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.253+0000 7f4b1e7fc700 1 -- 172.21.15.146:0/83124154 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f4b18085f60 con 0x7f4b280ce3d0 2023-10-06T11:10:24.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.253+0000 7f4b2e501700 1 --2- 172.21.15.146:0/83124154 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4b0c066f30 0x7f4b0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:24.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.253+0000 7f4b2e501700 1 --2- 172.21.15.146:0/83124154 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4b0c066f30 0x7f4b0c0693e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4b28156d90 tx=0x7f4b24008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:24.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.257+0000 7f4b1e7fc700 1 -- 172.21.15.146:0/83124154 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b18052fc0 con 0x7f4b280ce3d0 2023-10-06T11:10:24.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.485+0000 7f4b30765700 1 -- 172.21.15.146:0/83124154 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4b2804c380 con 0x7f4b280ce3d0 2023-10-06T11:10:24.486 INFO:tasks.ceph.mon.a.smithi146.stderr:2023-10-06T11:10:24.485+0000 7f011baa1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T11:10:24.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.489+0000 7f4b1e7fc700 1 -- 172.21.15.146:0/83124154 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v57) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4b180565e0 con 0x7f4b280ce3d0 2023-10-06T11:10:24.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.491+0000 7f4b30765700 1 -- 172.21.15.146:0/83124154 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4b0c066f30 msgr2=0x7f4b0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:24.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.491+0000 7f4b30765700 1 --2- 172.21.15.146:0/83124154 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4b0c066f30 0x7f4b0c0693e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4b28156d90 tx=0x7f4b24008040 comp rx=0 tx=0).stop 2023-10-06T11:10:24.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.491+0000 7f4b30765700 1 -- 172.21.15.146:0/83124154 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b280ce3d0 msgr2=0x7f4b281564f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:24.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.491+0000 7f4b30765700 1 --2- 172.21.15.146:0/83124154 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b280ce3d0 0x7f4b281564f0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f4b1800b0e0 tx=0x7f4b18017000 comp rx=0 tx=0).stop 2023-10-06T11:10:24.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.491+0000 7f4b30765700 1 -- 172.21.15.146:0/83124154 shutdown_connections 2023-10-06T11:10:24.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.491+0000 7f4b30765700 1 --2- 172.21.15.146:0/83124154 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4b0c066f30 0x7f4b0c0693e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:24.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.491+0000 7f4b30765700 1 --2- 172.21.15.146:0/83124154 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b2815a160 0x7f4b280c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:24.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.491+0000 7f4b30765700 1 --2- 172.21.15.146:0/83124154 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b280ae730 0x7f4b280b4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:24.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.491+0000 7f4b30765700 1 --2- 172.21.15.146:0/83124154 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b280ce3d0 0x7f4b281564f0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:24.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.491+0000 7f4b30765700 1 -- 172.21.15.146:0/83124154 >> 172.21.15.146:0/83124154 conn(0x7f4b2806f380 msgr2=0x7f4b28159470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:24.493 INFO:tasks.ceph.mds.a.smithi146.stderr: -1960> 2023-10-06T11:10:09.401+0000 7f9f0e628700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T11:10:24.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.491+0000 7f4b30765700 1 -- 172.21.15.146:0/83124154 shutdown_connections 2023-10-06T11:10:24.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.491+0000 7f4b30765700 1 -- 172.21.15.146:0/83124154 wait complete. 2023-10-06T11:10:24.494 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T11:10:24.505 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T11:10:24.515 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2023-10-06T11:10:24.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.622+0000 7f71a6862700 1 Processor -- start 2023-10-06T11:10:24.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.622+0000 7f71a6862700 1 -- start start 2023-10-06T11:10:24.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.623+0000 7f71a6862700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f71a00cc520 0x7f71a0159e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:24.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.623+0000 7f71a6862700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f71a013fe10 0x7f71a015a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:24.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.623+0000 7f71a6862700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71a006e4e0 con 0x7f71a013fa40 2023-10-06T11:10:24.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.623+0000 7f71a6862700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71a006ed80 con 0x7f71a00cc520 2023-10-06T11:10:24.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.623+0000 7f71a6862700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71a015ab80 con 0x7f71a013fe10 2023-10-06T11:10:24.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.623+0000 7f71a5860700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f71a013fa40 0x7f71a00cbe10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36896/0 (socket says 172.21.15.146:36896) 2023-10-06T11:10:24.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.623+0000 7f71a5860700 1 -- 172.21.15.146:0/2512157212 learned_addr learned my addr 172.21.15.146:0/2512157212 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:10:24.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.623+0000 7f71a505f700 1 --2- 172.21.15.146:0/2512157212 >> v2:172.21.15.146:3300/0 conn(0x7f71a00cc520 0x7f71a0159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:24.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.623+0000 7f71a6061700 1 --2- 172.21.15.146:0/2512157212 >> v2:172.21.15.151:3300/0 conn(0x7f71a013fe10 0x7f71a015a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:24.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.623+0000 7f71a485e700 1 -- 172.21.15.146:0/2512157212 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3029128196 0 0) 0x7f71a006e4e0 con 0x7f71a013fa40 2023-10-06T11:10:24.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.623+0000 7f71a485e700 1 -- 172.21.15.146:0/2512157212 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f718c003570 con 0x7f71a013fa40 2023-10-06T11:10:24.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.624+0000 7f71a505f700 1 -- 172.21.15.146:0/2512157212 >> v2:172.21.15.151:3300/0 conn(0x7f71a013fe10 msgr2=0x7f71a015a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:24.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.624+0000 7f71a505f700 1 --2- 172.21.15.146:0/2512157212 >> v2:172.21.15.151:3300/0 conn(0x7f71a013fe10 0x7f71a015a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:24.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.624+0000 7f71a505f700 1 -- 172.21.15.146:0/2512157212 >> v1:172.21.15.146:6789/0 conn(0x7f71a013fa40 legacy=0x7f71a00cbe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:24.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.624+0000 7f71a505f700 1 -- 172.21.15.146:0/2512157212 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a006e730 con 0x7f71a00cc520 2023-10-06T11:10:24.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.624+0000 7f71a505f700 1 --2- 172.21.15.146:0/2512157212 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71a00cc520 0x7f71a0159e10 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f71a00c9b60 tx=0x7f71900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4feed01e4fba17d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:24.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.624+0000 7f71a485e700 1 -- 172.21.15.146:0/2512157212 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7190011630 con 0x7f71a00cc520 2023-10-06T11:10:24.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.624+0000 7f71a485e700 1 -- 172.21.15.146:0/2512157212 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7190011790 con 0x7f71a00cc520 2023-10-06T11:10:24.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.624+0000 7f71a485e700 1 -- 172.21.15.146:0/2512157212 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7190011b30 con 0x7f71a00cc520 2023-10-06T11:10:24.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.624+0000 7f71a6862700 1 -- 172.21.15.146:0/2512157212 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71a00cc520 msgr2=0x7f71a0159e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:24.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.624+0000 7f71a6862700 1 --2- 172.21.15.146:0/2512157212 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71a00cc520 0x7f71a0159e10 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f71a00c9b60 tx=0x7f71900091a0 comp rx=0 tx=0).stop 2023-10-06T11:10:24.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.624+0000 7f71a6862700 1 -- 172.21.15.146:0/2512157212 shutdown_connections 2023-10-06T11:10:24.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.624+0000 7f71a6862700 1 --2- 172.21.15.146:0/2512157212 >> v2:172.21.15.151:3300/0 conn(0x7f71a013fe10 0x7f71a015a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:24.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.624+0000 7f71a6862700 1 --2- 172.21.15.146:0/2512157212 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71a00cc520 0x7f71a0159e10 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:24.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.624+0000 7f71a6862700 1 -- 172.21.15.146:0/2512157212 >> 172.21.15.146:0/2512157212 conn(0x7f71a0069010 msgr2=0x7f71a00cd120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:24.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.624+0000 7f71a6862700 1 -- 172.21.15.146:0/2512157212 shutdown_connections 2023-10-06T11:10:24.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.624+0000 7f71a6862700 1 -- 172.21.15.146:0/2512157212 wait complete. 2023-10-06T11:10:24.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.626+0000 7f71a6862700 1 Processor -- start 2023-10-06T11:10:24.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.626+0000 7f71a6862700 1 -- start start 2023-10-06T11:10:24.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.626+0000 7f71a6862700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71a00cc520 0x7f71a016afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:24.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.626+0000 7f71a6862700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71a013fa40 0x7f71a0167800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:24.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.626+0000 7f71a6862700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71a013fe10 0x7f71a01573e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:24.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.626+0000 7f71a6862700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a00c4490 con 0x7f71a013fa40 2023-10-06T11:10:24.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.626+0000 7f71a6862700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a00c5010 con 0x7f71a00cc520 2023-10-06T11:10:24.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.626+0000 7f71a6862700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71a016bb60 con 0x7f71a013fe10 2023-10-06T11:10:24.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.626+0000 7f71a505f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71a013fa40 0x7f71a0167800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:24.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.626+0000 7f71a505f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71a013fa40 0x7f71a0167800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37528/0 (socket says 172.21.15.146:37528) 2023-10-06T11:10:24.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.626+0000 7f71a505f700 1 -- 172.21.15.146:0/395127139 learned_addr learned my addr 172.21.15.146:0/395127139 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:24.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.627+0000 7f71a6061700 1 --2- 172.21.15.146:0/395127139 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71a013fe10 0x7f71a01573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:24.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.627+0000 7f71a5860700 1 --2- 172.21.15.146:0/395127139 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71a00cc520 0x7f71a016afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:24.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.627+0000 7f71a505f700 1 -- 172.21.15.146:0/395127139 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71a013fe10 msgr2=0x7f71a01573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:24.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.627+0000 7f71a505f700 1 --2- 172.21.15.146:0/395127139 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71a013fe10 0x7f71a01573e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:24.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.627+0000 7f71a505f700 1 -- 172.21.15.146:0/395127139 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71a00cc520 msgr2=0x7f71a016afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:24.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.627+0000 7f71a505f700 1 --2- 172.21.15.146:0/395127139 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71a00cc520 0x7f71a016afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:24.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.627+0000 7f71a505f700 1 -- 172.21.15.146:0/395127139 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7190009420 con 0x7f71a013fa40 2023-10-06T11:10:24.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.627+0000 7f71a6061700 1 --2- 172.21.15.146:0/395127139 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71a013fe10 0x7f71a01573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:10:24.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.627+0000 7f71a5860700 1 --2- 172.21.15.146:0/395127139 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71a00cc520 0x7f71a016afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:10:24.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.627+0000 7f71a505f700 1 --2- 172.21.15.146:0/395127139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71a013fa40 0x7f71a0167800 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f7190009f50 tx=0x7f7190017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:24.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.627+0000 7f7195ffb700 1 -- 172.21.15.146:0/395127139 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7190011b10 con 0x7f71a013fa40 2023-10-06T11:10:24.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.627+0000 7f7195ffb700 1 -- 172.21.15.146:0/395127139 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71900253f0 con 0x7f71a013fa40 2023-10-06T11:10:24.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.627+0000 7f71a6862700 1 -- 172.21.15.146:0/395127139 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71a00c46e0 con 0x7f71a013fa40 2023-10-06T11:10:24.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.627+0000 7f7195ffb700 1 -- 172.21.15.146:0/395127139 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7190025790 con 0x7f71a013fa40 2023-10-06T11:10:24.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.627+0000 7f71a6862700 1 -- 172.21.15.146:0/395127139 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71a00c4ca0 con 0x7f71a013fa40 2023-10-06T11:10:24.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.628+0000 7f71a6862700 1 -- 172.21.15.146:0/395127139 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71a00c51a0 con 0x7f71a013fa40 2023-10-06T11:10:24.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.628+0000 7f7195ffb700 1 -- 172.21.15.146:0/395127139 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7190025b80 con 0x7f71a013fa40 2023-10-06T11:10:24.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.629+0000 7f7195ffb700 1 --2- 172.21.15.146:0/395127139 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7184066f30 0x7f71840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:24.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.629+0000 7f7195ffb700 1 -- 172.21.15.146:0/395127139 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6316+0+0 (secure 0 0 0) 0x7f7190086090 con 0x7f71a013fa40 2023-10-06T11:10:24.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.629+0000 7f71a5860700 1 --2- 172.21.15.146:0/395127139 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7184066f30 0x7f71840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:24.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.629+0000 7f71a5860700 1 --2- 172.21.15.146:0/395127139 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7184066f30 0x7f71840693e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f719c0058d0 tx=0x7f719c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:24.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.633+0000 7f7195ffb700 1 -- 172.21.15.146:0/395127139 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f71900530a0 con 0x7f71a013fa40 2023-10-06T11:10:24.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:24.860+0000 7f71a6862700 1 -- 172.21.15.146:0/395127139 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f71a006ea10 con 0x7f71a013fa40 2023-10-06T11:10:25.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.491+0000 7f7195ffb700 1 -- 172.21.15.146:0/395127139 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v58) v1 ==== 104+0+0 (secure 0 0 0) 0x7f71900566c0 con 0x7f71a013fa40 2023-10-06T11:10:25.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.493+0000 7f71a6862700 1 -- 172.21.15.146:0/395127139 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7184066f30 msgr2=0x7f71840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:25.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.493+0000 7f71a6862700 1 --2- 172.21.15.146:0/395127139 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7184066f30 0x7f71840693e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f719c0058d0 tx=0x7f719c009040 comp rx=0 tx=0).stop 2023-10-06T11:10:25.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.493+0000 7f71a6862700 1 -- 172.21.15.146:0/395127139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71a013fa40 msgr2=0x7f71a0167800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:25.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.493+0000 7f71a6862700 1 --2- 172.21.15.146:0/395127139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71a013fa40 0x7f71a0167800 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f7190009f50 tx=0x7f7190017000 comp rx=0 tx=0).stop 2023-10-06T11:10:25.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.493+0000 7f71a6862700 1 -- 172.21.15.146:0/395127139 shutdown_connections 2023-10-06T11:10:25.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.493+0000 7f71a6862700 1 --2- 172.21.15.146:0/395127139 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7184066f30 0x7f71840693e0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:25.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.493+0000 7f71a6862700 1 --2- 172.21.15.146:0/395127139 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71a013fe10 0x7f71a01573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:25.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.493+0000 7f71a6862700 1 --2- 172.21.15.146:0/395127139 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71a00cc520 0x7f71a016afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:25.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.493+0000 7f71a6862700 1 --2- 172.21.15.146:0/395127139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71a013fa40 0x7f71a0167800 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:25.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.494+0000 7f71a6862700 1 -- 172.21.15.146:0/395127139 >> 172.21.15.146:0/395127139 conn(0x7f71a0069010 msgr2=0x7f71a00c9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:25.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.494+0000 7f71a6862700 1 -- 172.21.15.146:0/395127139 shutdown_connections 2023-10-06T11:10:25.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.494+0000 7f71a6862700 1 -- 172.21.15.146:0/395127139 wait complete. 2023-10-06T11:10:25.509 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T11:10:25.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.667+0000 7fa6747ed700 1 Processor -- start 2023-10-06T11:10:25.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.667+0000 7fa6747ed700 1 -- start start 2023-10-06T11:10:25.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.668+0000 7fa6747ed700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa66c159f40 0x7fa66c15d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:25.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.668+0000 7fa6747ed700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa66c0d1670 con 0x7fa66c15e5f0 2023-10-06T11:10:25.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.668+0000 7fa6747ed700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa66c0cee70 con 0x7fa66c0c7810 2023-10-06T11:10:25.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.668+0000 7fa6747ed700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa66c0cc4b0 con 0x7fa66c159f40 2023-10-06T11:10:25.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.668+0000 7fa672d8a700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa66c15e5f0 0x7fa66c0cada0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36898/0 (socket says 172.21.15.146:36898) 2023-10-06T11:10:25.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.668+0000 7fa672d8a700 1 -- 172.21.15.146:0/1756222117 learned_addr learned my addr 172.21.15.146:0/1756222117 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:10:25.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.669+0000 7fa671587700 1 -- 172.21.15.146:0/1756222117 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3868670504 0 0) 0x7fa66c0d1670 con 0x7fa66c15e5f0 2023-10-06T11:10:25.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.669+0000 7fa672589700 1 --2- 172.21.15.146:0/1756222117 >> v2:172.21.15.151:3300/0 conn(0x7fa66c159f40 0x7fa66c15d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:25.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.669+0000 7fa671587700 1 -- 172.21.15.146:0/1756222117 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa658003570 con 0x7fa66c15e5f0 2023-10-06T11:10:25.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.669+0000 7fa671587700 1 -- 172.21.15.146:0/1756222117 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3591446596 0 0) 0x7fa658003570 con 0x7fa66c15e5f0 2023-10-06T11:10:25.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.669+0000 7fa671587700 1 -- 172.21.15.146:0/1756222117 >> v2:172.21.15.151:3300/0 conn(0x7fa66c159f40 msgr2=0x7fa66c15d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:25.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.669+0000 7fa671587700 1 --2- 172.21.15.146:0/1756222117 >> v2:172.21.15.151:3300/0 conn(0x7fa66c159f40 0x7fa66c15d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:25.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.669+0000 7fa671587700 1 -- 172.21.15.146:0/1756222117 >> v1:172.21.15.151:6789/0 conn(0x7fa66c0c7810 legacy=0x7fa66c15dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:25.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.669+0000 7fa671587700 1 -- 172.21.15.146:0/1756222117 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66c06f990 con 0x7fa66c15e5f0 2023-10-06T11:10:25.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.669+0000 7fa671587700 1 -- 172.21.15.146:0/1756222117 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fa664001470 con 0x7fa66c15e5f0 2023-10-06T11:10:25.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.669+0000 7fa671587700 1 -- 172.21.15.146:0/1756222117 >> v1:172.21.15.146:6789/0 conn(0x7fa66c15e5f0 legacy=0x7fa66c0cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:25.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.669+0000 7fa671587700 1 --2- 172.21.15.146:0/1756222117 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa658003a60 0x7fa658003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:25.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.669+0000 7fa671587700 1 --2- 172.21.15.146:0/1756222117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa658004810 0x7fa658004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:25.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.669+0000 7fa671587700 1 --2- 172.21.15.146:0/1756222117 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6580051c0 0x7fa65800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:25.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.669+0000 7fa671587700 1 -- 172.21.15.146:0/1756222117 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c0cc4b0 con 0x7fa658003a60 2023-10-06T11:10:25.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.669+0000 7fa671587700 1 -- 172.21.15.146:0/1756222117 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65800c0e0 con 0x7fa658004810 2023-10-06T11:10:25.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.669+0000 7fa671587700 1 -- 172.21.15.146:0/1756222117 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa65800c2a0 con 0x7fa6580051c0 2023-10-06T11:10:25.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.669+0000 7fa672589700 1 --2- 172.21.15.146:0/1756222117 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa658003a60 0x7fa658003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:25.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.669+0000 7fa671d88700 1 --2- 172.21.15.146:0/1756222117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa658004810 0x7fa658004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:25.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.669+0000 7fa672d8a700 1 --2- 172.21.15.146:0/1756222117 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6580051c0 0x7fa65800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:25.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.669+0000 7fa672589700 1 -- 172.21.15.146:0/1756222117 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6580051c0 msgr2=0x7fa65800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:25.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.669+0000 7fa672589700 1 --2- 172.21.15.146:0/1756222117 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6580051c0 0x7fa65800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:25.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.669+0000 7fa672589700 1 -- 172.21.15.146:0/1756222117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa658004810 msgr2=0x7fa658004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:25.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.669+0000 7fa672589700 1 --2- 172.21.15.146:0/1756222117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa658004810 0x7fa658004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:25.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.669+0000 7fa672589700 1 -- 172.21.15.146:0/1756222117 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa658003570 con 0x7fa658003a60 2023-10-06T11:10:25.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.669+0000 7fa671d88700 1 --2- 172.21.15.146:0/1756222117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa658004810 0x7fa658004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:10:25.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.669+0000 7fa672d8a700 1 --2- 172.21.15.146:0/1756222117 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa6580051c0 0x7fa65800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:10:25.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.669+0000 7fa672d8a700 1 -- 172.21.15.146:0/1756222117 reap_dead start 2023-10-06T11:10:25.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.670+0000 7fa672589700 1 --2- 172.21.15.146:0/1756222117 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa658003a60 0x7fa658003e30 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fa66800e2d0 tx=0x7fa66800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3197ccf503f0762 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:25.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.670+0000 7fa671587700 1 -- 172.21.15.146:0/1756222117 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66800eb20 con 0x7fa658003a60 2023-10-06T11:10:25.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.670+0000 7fa671587700 1 -- 172.21.15.146:0/1756222117 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66800f040 con 0x7fa658003a60 2023-10-06T11:10:25.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.670+0000 7fa671587700 1 -- 172.21.15.146:0/1756222117 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66800eed0 con 0x7fa658003a60 2023-10-06T11:10:25.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.670+0000 7fa6747ed700 1 -- 172.21.15.146:0/1756222117 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa658003a60 msgr2=0x7fa658003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:25.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.670+0000 7fa6747ed700 1 --2- 172.21.15.146:0/1756222117 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa658003a60 0x7fa658003e30 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fa66800e2d0 tx=0x7fa66800b040 comp rx=0 tx=0).stop 2023-10-06T11:10:25.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.670+0000 7fa6747ed700 1 -- 172.21.15.146:0/1756222117 shutdown_connections 2023-10-06T11:10:25.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.670+0000 7fa6747ed700 1 --2- 172.21.15.146:0/1756222117 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa658003a60 0x7fa658003e30 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:25.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.670+0000 7fa6747ed700 1 -- 172.21.15.146:0/1756222117 >> 172.21.15.146:0/1756222117 conn(0x7fa66c06f380 msgr2=0x7fa66c0d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:25.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.670+0000 7fa6747ed700 1 -- 172.21.15.146:0/1756222117 shutdown_connections 2023-10-06T11:10:25.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.670+0000 7fa6747ed700 1 -- 172.21.15.146:0/1756222117 wait complete. 2023-10-06T11:10:25.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.671+0000 7fa6747ed700 1 Processor -- start 2023-10-06T11:10:25.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.671+0000 7fa6747ed700 1 -- start start 2023-10-06T11:10:25.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.672+0000 7fa6747ed700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa658003a60 0x7fa66c0c5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:25.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.672+0000 7fa6747ed700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa66c169a90 0x7fa66c0b35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:25.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.672+0000 7fa6747ed700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa66c0b58a0 0x7fa66c0b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:25.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.672+0000 7fa6747ed700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c0b6250 con 0x7fa66c169a90 2023-10-06T11:10:25.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.672+0000 7fa6747ed700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c0c5fe0 con 0x7fa658003a60 2023-10-06T11:10:25.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.672+0000 7fa6747ed700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c0b3ed0 con 0x7fa66c0b58a0 2023-10-06T11:10:25.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.672+0000 7fa671d88700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa66c169a90 0x7fa66c0b35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:25.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.672+0000 7fa671d88700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa66c169a90 0x7fa66c0b35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37558/0 (socket says 172.21.15.146:37558) 2023-10-06T11:10:25.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.672+0000 7fa671d88700 1 -- 172.21.15.146:0/60551330 learned_addr learned my addr 172.21.15.146:0/60551330 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:25.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.672+0000 7fa672589700 1 --2- 172.21.15.146:0/60551330 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa658003a60 0x7fa66c0c5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:25.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.672+0000 7fa672d8a700 1 --2- 172.21.15.146:0/60551330 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa66c0b58a0 0x7fa66c0b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:25.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.672+0000 7fa671d88700 1 -- 172.21.15.146:0/60551330 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa66c0b58a0 msgr2=0x7fa66c0b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:25.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.672+0000 7fa671d88700 1 --2- 172.21.15.146:0/60551330 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa66c0b58a0 0x7fa66c0b5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:25.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.672+0000 7fa671d88700 1 -- 172.21.15.146:0/60551330 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa658003a60 msgr2=0x7fa66c0c5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:25.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.672+0000 7fa671d88700 1 --2- 172.21.15.146:0/60551330 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa658003a60 0x7fa66c0c5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:25.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.672+0000 7fa671d88700 1 -- 172.21.15.146:0/60551330 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66c0b41b0 con 0x7fa66c169a90 2023-10-06T11:10:25.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.673+0000 7fa671d88700 1 --2- 172.21.15.146:0/60551330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa66c169a90 0x7fa66c0b35d0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fa65c00e890 tx=0x7fa65c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:25.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.673+0000 7fa6627fc700 1 -- 172.21.15.146:0/60551330 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65c012590 con 0x7fa66c169a90 2023-10-06T11:10:25.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.673+0000 7fa6627fc700 1 -- 172.21.15.146:0/60551330 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa65c0126f0 con 0x7fa66c169a90 2023-10-06T11:10:25.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.673+0000 7fa6627fc700 1 -- 172.21.15.146:0/60551330 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa65c012a90 con 0x7fa66c169a90 2023-10-06T11:10:25.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.673+0000 7fa6747ed700 1 -- 172.21.15.146:0/60551330 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa66c0b4490 con 0x7fa66c169a90 2023-10-06T11:10:25.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.673+0000 7fa6747ed700 1 -- 172.21.15.146:0/60551330 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa66c0b4a50 con 0x7fa66c169a90 2023-10-06T11:10:25.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.674+0000 7fa6747ed700 1 -- 172.21.15.146:0/60551330 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa66c0b4c70 con 0x7fa66c169a90 2023-10-06T11:10:25.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.674+0000 7fa6627fc700 1 -- 172.21.15.146:0/60551330 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa65c01d460 con 0x7fa66c169a90 2023-10-06T11:10:25.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.674+0000 7fa6627fc700 1 --2- 172.21.15.146:0/60551330 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa650066f30 0x7fa6500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:25.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.675+0000 7fa6627fc700 1 -- 172.21.15.146:0/60551330 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6316+0+0 (secure 0 0 0) 0x7fa65c0846b0 con 0x7fa66c169a90 2023-10-06T11:10:25.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.675+0000 7fa672589700 1 --2- 172.21.15.146:0/60551330 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa650066f30 0x7fa6500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:25.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.675+0000 7fa672589700 1 --2- 172.21.15.146:0/60551330 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa650066f30 0x7fa6500693e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa66c0b5580 tx=0x7fa66801a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:25.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.679+0000 7fa6627fc700 1 -- 172.21.15.146:0/60551330 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa65c0516c0 con 0x7fa66c169a90 2023-10-06T11:10:25.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:25.863+0000 7fa6747ed700 1 -- 172.21.15.146:0/60551330 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa66c04c380 con 0x7fa66c169a90 2023-10-06T11:10:26.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.495+0000 7fa6627fc700 1 -- 172.21.15.146:0/60551330 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v65) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa65c054ce0 con 0x7fa66c169a90 2023-10-06T11:10:26.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.498+0000 7fa6747ed700 1 -- 172.21.15.146:0/60551330 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa650066f30 msgr2=0x7fa6500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:26.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.498+0000 7fa6747ed700 1 --2- 172.21.15.146:0/60551330 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa650066f30 0x7fa6500693e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa66c0b5580 tx=0x7fa66801a000 comp rx=0 tx=0).stop 2023-10-06T11:10:26.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.498+0000 7fa6747ed700 1 -- 172.21.15.146:0/60551330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa66c169a90 msgr2=0x7fa66c0b35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:26.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.498+0000 7fa6747ed700 1 --2- 172.21.15.146:0/60551330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa66c169a90 0x7fa66c0b35d0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fa65c00e890 tx=0x7fa65c009040 comp rx=0 tx=0).stop 2023-10-06T11:10:26.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.498+0000 7fa6747ed700 1 -- 172.21.15.146:0/60551330 shutdown_connections 2023-10-06T11:10:26.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.498+0000 7fa6747ed700 1 --2- 172.21.15.146:0/60551330 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa650066f30 0x7fa6500693e0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:26.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.498+0000 7fa6747ed700 1 --2- 172.21.15.146:0/60551330 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa66c0b58a0 0x7fa66c0b5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:26.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.498+0000 7fa6747ed700 1 --2- 172.21.15.146:0/60551330 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa658003a60 0x7fa66c0c5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:26.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.498+0000 7fa6747ed700 1 --2- 172.21.15.146:0/60551330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa66c169a90 0x7fa66c0b35d0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:26.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.498+0000 7fa6747ed700 1 -- 172.21.15.146:0/60551330 >> 172.21.15.146:0/60551330 conn(0x7fa66c06f380 msgr2=0x7fa66c156ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:26.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.498+0000 7fa6747ed700 1 -- 172.21.15.146:0/60551330 shutdown_connections 2023-10-06T11:10:26.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.498+0000 7fa6747ed700 1 -- 172.21.15.146:0/60551330 wait complete. 2023-10-06T11:10:26.501 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' removed 2023-10-06T11:10:26.513 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T11:10:26.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.631+0000 7f212b59e700 1 Processor -- start 2023-10-06T11:10:26.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.631+0000 7f212b59e700 1 -- start start 2023-10-06T11:10:26.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.632+0000 7f212b59e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f212c0cb090 0x7f212c0cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:26.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.632+0000 7f212b59e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f212c068780 0x7f212c068bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:26.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.632+0000 7f212b59e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f212c0cc130 con 0x7f212c0b5640 2023-10-06T11:10:26.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.632+0000 7f212b59e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f212c069100 con 0x7f212c0cb090 2023-10-06T11:10:26.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.632+0000 7f212b59e700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f212c0b2660 con 0x7f212c068780 2023-10-06T11:10:26.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.632+0000 7f2121d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f212c0cb090 0x7f212c0cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:26.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.632+0000 7f2121d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f212c0cb090 0x7f212c0cc5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37560/0 (socket says 172.21.15.146:37560) 2023-10-06T11:10:26.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.632+0000 7f212a59c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f212c0b5640 0x7f212c15a870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36914/0 (socket says 172.21.15.146:36914) 2023-10-06T11:10:26.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.632+0000 7f2121d9b700 1 -- 172.21.15.146:0/293337195 learned_addr learned my addr 172.21.15.146:0/293337195 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:26.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.632+0000 7f212ad9d700 1 --2- 172.21.15.146:0/293337195 >> v2:172.21.15.151:3300/0 conn(0x7f212c068780 0x7f212c068bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:26.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.632+0000 7f2121d9b700 1 -- 172.21.15.146:0/293337195 >> v2:172.21.15.151:3300/0 conn(0x7f212c068780 msgr2=0x7f212c068bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:26.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.632+0000 7f2121d9b700 1 --2- 172.21.15.146:0/293337195 >> v2:172.21.15.151:3300/0 conn(0x7f212c068780 0x7f212c068bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:26.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.632+0000 7f2121d9b700 1 -- 172.21.15.146:0/293337195 >> v1:172.21.15.146:6789/0 conn(0x7f212c0b5640 legacy=0x7f212c15a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:26.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.632+0000 7f2121d9b700 1 -- 172.21.15.146:0/293337195 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f212c0cb520 con 0x7f212c0cb090 2023-10-06T11:10:26.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.632+0000 7f212ad9d700 1 --2- 172.21.15.146:0/293337195 >> v2:172.21.15.151:3300/0 conn(0x7f212c068780 0x7f212c068bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:10:26.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.632+0000 7f2121d9b700 1 --2- 172.21.15.146:0/293337195 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f212c0cb090 0x7f212c0cc5c0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f212c159e40 tx=0x7f2114009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18534463a4114b83 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:26.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.632+0000 7f2129d9b700 1 -- 172.21.15.146:0/293337195 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211400b860 con 0x7f212c0cb090 2023-10-06T11:10:26.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.632+0000 7f2129d9b700 1 -- 172.21.15.146:0/293337195 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211400b9c0 con 0x7f212c0cb090 2023-10-06T11:10:26.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.632+0000 7f2129d9b700 1 -- 172.21.15.146:0/293337195 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211400bd60 con 0x7f212c0cb090 2023-10-06T11:10:26.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.633+0000 7f212b59e700 1 -- 172.21.15.146:0/293337195 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f212c0cb090 msgr2=0x7f212c0cc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:26.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.633+0000 7f212b59e700 1 --2- 172.21.15.146:0/293337195 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f212c0cb090 0x7f212c0cc5c0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f212c159e40 tx=0x7f2114009250 comp rx=0 tx=0).stop 2023-10-06T11:10:26.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.633+0000 7f212b59e700 1 -- 172.21.15.146:0/293337195 shutdown_connections 2023-10-06T11:10:26.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.633+0000 7f212b59e700 1 --2- 172.21.15.146:0/293337195 >> v2:172.21.15.151:3300/0 conn(0x7f212c068780 0x7f212c068bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:26.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.633+0000 7f212b59e700 1 --2- 172.21.15.146:0/293337195 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f212c0cb090 0x7f212c0cc5c0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:26.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.633+0000 7f212b59e700 1 -- 172.21.15.146:0/293337195 >> 172.21.15.146:0/293337195 conn(0x7f212c0703f0 msgr2=0x7f212c0707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:26.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.633+0000 7f212b59e700 1 -- 172.21.15.146:0/293337195 shutdown_connections 2023-10-06T11:10:26.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.633+0000 7f212b59e700 1 -- 172.21.15.146:0/293337195 wait complete. 2023-10-06T11:10:26.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.634+0000 7f212b59e700 1 Processor -- start 2023-10-06T11:10:26.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.634+0000 7f212b59e700 1 -- start start 2023-10-06T11:10:26.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.635+0000 7f212b59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f212c068780 0x7f212c0c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:26.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.635+0000 7f212b59e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f212c0b5640 0x7f212c0c3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:26.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.635+0000 7f212b59e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f212c0cb090 0x7f212c15e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:26.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.635+0000 7f212b59e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212c0c95e0 con 0x7f212c068780 2023-10-06T11:10:26.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.635+0000 7f212b59e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212c0c44b0 con 0x7f212c0b5640 2023-10-06T11:10:26.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.635+0000 7f212b59e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f212c0c4790 con 0x7f212c0cb090 2023-10-06T11:10:26.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.635+0000 7f212a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f212c068780 0x7f212c0c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:26.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.635+0000 7f212a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f212c068780 0x7f212c0c9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37568/0 (socket says 172.21.15.146:37568) 2023-10-06T11:10:26.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.635+0000 7f212a59c700 1 -- 172.21.15.146:0/442661576 learned_addr learned my addr 172.21.15.146:0/442661576 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:26.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.635+0000 7f2121d9b700 1 --2- 172.21.15.146:0/442661576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f212c0b5640 0x7f212c0c3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:26.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.635+0000 7f212ad9d700 1 --2- 172.21.15.146:0/442661576 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f212c0cb090 0x7f212c15e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:26.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.635+0000 7f212a59c700 1 -- 172.21.15.146:0/442661576 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f212c0cb090 msgr2=0x7f212c15e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:26.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.635+0000 7f212a59c700 1 --2- 172.21.15.146:0/442661576 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f212c0cb090 0x7f212c15e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:26.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.635+0000 7f212a59c700 1 -- 172.21.15.146:0/442661576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f212c0b5640 msgr2=0x7f212c0c3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:26.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.635+0000 7f212a59c700 1 --2- 172.21.15.146:0/442661576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f212c0b5640 0x7f212c0c3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:26.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.635+0000 7f212a59c700 1 -- 172.21.15.146:0/442661576 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21140094f0 con 0x7f212c068780 2023-10-06T11:10:26.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.635+0000 7f212a59c700 1 --2- 172.21.15.146:0/442661576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f212c068780 0x7f212c0c9a70 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f211c00c7c0 tx=0x7f211c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:26.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.636+0000 7f2122ffd700 1 -- 172.21.15.146:0/442661576 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211c005a70 con 0x7f212c068780 2023-10-06T11:10:26.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.636+0000 7f2122ffd700 1 -- 172.21.15.146:0/442661576 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211c005bf0 con 0x7f212c068780 2023-10-06T11:10:26.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.636+0000 7f212b59e700 1 -- 172.21.15.146:0/442661576 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f212c0c9270 con 0x7f212c068780 2023-10-06T11:10:26.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.636+0000 7f2122ffd700 1 -- 172.21.15.146:0/442661576 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211c0070f0 con 0x7f212c068780 2023-10-06T11:10:26.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.636+0000 7f212b59e700 1 -- 172.21.15.146:0/442661576 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f212c152f30 con 0x7f212c068780 2023-10-06T11:10:26.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.637+0000 7f212b59e700 1 -- 172.21.15.146:0/442661576 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f212c0c98c0 con 0x7f212c068780 2023-10-06T11:10:26.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.637+0000 7f2122ffd700 1 -- 172.21.15.146:0/442661576 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f211c007460 con 0x7f212c068780 2023-10-06T11:10:26.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.637+0000 7f2122ffd700 1 --2- 172.21.15.146:0/442661576 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f210c066f30 0x7f210c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:26.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.638+0000 7f2121d9b700 1 --2- 172.21.15.146:0/442661576 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f210c066f30 0x7f210c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:26.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.638+0000 7f2122ffd700 1 -- 172.21.15.146:0/442661576 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5878+0+0 (secure 0 0 0) 0x7f211c084080 con 0x7f212c068780 2023-10-06T11:10:26.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.638+0000 7f2121d9b700 1 --2- 172.21.15.146:0/442661576 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f210c066f30 0x7f210c0693e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f212c159e40 tx=0x7f2114017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:26.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.642+0000 7f2122ffd700 1 -- 172.21.15.146:0/442661576 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f211c0512c0 con 0x7f212c068780 2023-10-06T11:10:26.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:26.831+0000 7f212b59e700 1 -- 172.21.15.146:0/442661576 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f212c04bb40 con 0x7f212c068780 2023-10-06T11:10:27.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.504+0000 7f2122ffd700 1 -- 172.21.15.146:0/442661576 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v66) v1 ==== 169+0+0 (secure 0 0 0) 0x7f211c0548e0 con 0x7f212c068780 2023-10-06T11:10:27.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.506+0000 7f212b59e700 1 -- 172.21.15.146:0/442661576 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f210c066f30 msgr2=0x7f210c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:27.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.506+0000 7f212b59e700 1 --2- 172.21.15.146:0/442661576 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f210c066f30 0x7f210c0693e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f212c159e40 tx=0x7f2114017000 comp rx=0 tx=0).stop 2023-10-06T11:10:27.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.506+0000 7f212b59e700 1 -- 172.21.15.146:0/442661576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f212c068780 msgr2=0x7f212c0c9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:27.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.506+0000 7f212b59e700 1 --2- 172.21.15.146:0/442661576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f212c068780 0x7f212c0c9a70 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f211c00c7c0 tx=0x7f211c007f70 comp rx=0 tx=0).stop 2023-10-06T11:10:27.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.506+0000 7f212b59e700 1 -- 172.21.15.146:0/442661576 shutdown_connections 2023-10-06T11:10:27.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.506+0000 7f212b59e700 1 --2- 172.21.15.146:0/442661576 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f210c066f30 0x7f210c0693e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:27.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.506+0000 7f212b59e700 1 --2- 172.21.15.146:0/442661576 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f212c0cb090 0x7f212c15e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:27.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.506+0000 7f212b59e700 1 --2- 172.21.15.146:0/442661576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f212c068780 0x7f212c0c9a70 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:27.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.506+0000 7f212b59e700 1 --2- 172.21.15.146:0/442661576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f212c0b5640 0x7f212c0c3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:27.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.506+0000 7f212b59e700 1 -- 172.21.15.146:0/442661576 >> 172.21.15.146:0/442661576 conn(0x7f212c0703f0 msgr2=0x7f212c0b4980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:27.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.507+0000 7f212b59e700 1 -- 172.21.15.146:0/442661576 shutdown_connections 2023-10-06T11:10:27.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.507+0000 7f212b59e700 1 -- 172.21.15.146:0/442661576 wait complete. 2023-10-06T11:10:27.510 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' removed 2023-10-06T11:10:27.521 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T11:10:27.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.636+0000 7fb150c78700 1 Processor -- start 2023-10-06T11:10:27.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.636+0000 7fb150c78700 1 -- start start 2023-10-06T11:10:27.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.637+0000 7fb150c78700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb14c0cb090 0x7fb14c0cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:27.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.637+0000 7fb150c78700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb14c068780 0x7fb14c068bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:27.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.637+0000 7fb150c78700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb14c0cc130 con 0x7fb14c0b5640 2023-10-06T11:10:27.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.637+0000 7fb150c78700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb14c069100 con 0x7fb14c068780 2023-10-06T11:10:27.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.637+0000 7fb150c78700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb14c0b2660 con 0x7fb14c0cb090 2023-10-06T11:10:27.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.637+0000 7fb14bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb14c068780 0x7fb14c068bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:27.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.637+0000 7fb14b7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb14c0b5640 0x7fb14c15a870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36930/0 (socket says 172.21.15.146:36930) 2023-10-06T11:10:27.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.637+0000 7fb14b7fe700 1 -- 172.21.15.146:0/2414045818 learned_addr learned my addr 172.21.15.146:0/2414045818 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:10:27.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.637+0000 7fb14affd700 1 --2- 172.21.15.146:0/2414045818 >> v2:172.21.15.151:3300/0 conn(0x7fb14c0cb090 0x7fb14c0cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:27.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.637+0000 7fb14bfff700 1 -- 172.21.15.146:0/2414045818 >> v2:172.21.15.151:3300/0 conn(0x7fb14c0cb090 msgr2=0x7fb14c0cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:27.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.637+0000 7fb14bfff700 1 --2- 172.21.15.146:0/2414045818 >> v2:172.21.15.151:3300/0 conn(0x7fb14c0cb090 0x7fb14c0cc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:27.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.637+0000 7fb14bfff700 1 -- 172.21.15.146:0/2414045818 >> v1:172.21.15.146:6789/0 conn(0x7fb14c0b5640 legacy=0x7fb14c15a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:27.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.638+0000 7fb14bfff700 1 -- 172.21.15.146:0/2414045818 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb14c0cb520 con 0x7fb14c068780 2023-10-06T11:10:27.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.637+0000 7fb14a7fc700 1 -- 172.21.15.146:0/2414045818 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 697944086 0 0) 0x7fb14c0cc130 con 0x7fb14c0b5640 2023-10-06T11:10:27.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.638+0000 7fb14bfff700 1 --2- 172.21.15.146:0/2414045818 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb14c068780 0x7fb14c068bc0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fb14c0d13d0 tx=0x7fb1440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c389b3d3fcecde2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:27.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.638+0000 7fb14a7fc700 1 -- 172.21.15.146:0/2414045818 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14400b6b0 con 0x7fb14c068780 2023-10-06T11:10:27.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.638+0000 7fb14a7fc700 1 -- 172.21.15.146:0/2414045818 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb14400b810 con 0x7fb14c068780 2023-10-06T11:10:27.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.638+0000 7fb14a7fc700 1 -- 172.21.15.146:0/2414045818 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb14400bbb0 con 0x7fb14c068780 2023-10-06T11:10:27.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.638+0000 7fb150c78700 1 -- 172.21.15.146:0/2414045818 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb14c068780 msgr2=0x7fb14c068bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:27.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.638+0000 7fb150c78700 1 --2- 172.21.15.146:0/2414045818 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb14c068780 0x7fb14c068bc0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fb14c0d13d0 tx=0x7fb1440091a0 comp rx=0 tx=0).stop 2023-10-06T11:10:27.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.638+0000 7fb150c78700 1 -- 172.21.15.146:0/2414045818 shutdown_connections 2023-10-06T11:10:27.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.638+0000 7fb150c78700 1 --2- 172.21.15.146:0/2414045818 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb14c068780 0x7fb14c068bc0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:27.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.638+0000 7fb150c78700 1 --2- 172.21.15.146:0/2414045818 >> v2:172.21.15.151:3300/0 conn(0x7fb14c0cb090 0x7fb14c0cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:27.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.638+0000 7fb150c78700 1 -- 172.21.15.146:0/2414045818 >> 172.21.15.146:0/2414045818 conn(0x7fb14c0703f0 msgr2=0x7fb14c0707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:27.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.638+0000 7fb150c78700 1 -- 172.21.15.146:0/2414045818 shutdown_connections 2023-10-06T11:10:27.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.638+0000 7fb150c78700 1 -- 172.21.15.146:0/2414045818 wait complete. 2023-10-06T11:10:27.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.640+0000 7fb150c78700 1 Processor -- start 2023-10-06T11:10:27.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.640+0000 7fb150c78700 1 -- start start 2023-10-06T11:10:27.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.640+0000 7fb150c78700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb14c068780 0x7fb14c0c67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:27.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.640+0000 7fb150c78700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb14c0b5640 0x7fb14c0c4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:27.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.640+0000 7fb150c78700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb14c0cb090 0x7fb14c153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:27.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.640+0000 7fb150c78700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c0c4940 con 0x7fb14c0b5640 2023-10-06T11:10:27.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.640+0000 7fb150c78700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c0c5bf0 con 0x7fb14c0cb090 2023-10-06T11:10:27.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.640+0000 7fb150c78700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb14c0c4b50 con 0x7fb14c068780 2023-10-06T11:10:27.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.641+0000 7fb14affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb14c0b5640 0x7fb14c0c4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:27.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.641+0000 7fb14affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb14c0b5640 0x7fb14c0c4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37584/0 (socket says 172.21.15.146:37584) 2023-10-06T11:10:27.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.641+0000 7fb14affd700 1 -- 172.21.15.146:0/1748535496 learned_addr learned my addr 172.21.15.146:0/1748535496 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:27.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.641+0000 7fb14bfff700 1 --2- 172.21.15.146:0/1748535496 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb14c0cb090 0x7fb14c153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:27.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.641+0000 7fb14b7fe700 1 --2- 172.21.15.146:0/1748535496 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb14c068780 0x7fb14c0c67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:27.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.641+0000 7fb14affd700 1 -- 172.21.15.146:0/1748535496 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb14c068780 msgr2=0x7fb14c0c67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:27.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.641+0000 7fb14affd700 1 --2- 172.21.15.146:0/1748535496 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb14c068780 0x7fb14c0c67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:27.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.641+0000 7fb14affd700 1 -- 172.21.15.146:0/1748535496 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb14c0cb090 msgr2=0x7fb14c153110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:27.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.641+0000 7fb14affd700 1 --2- 172.21.15.146:0/1748535496 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb14c0cb090 0x7fb14c153110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:27.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.641+0000 7fb14affd700 1 -- 172.21.15.146:0/1748535496 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb144009420 con 0x7fb14c0b5640 2023-10-06T11:10:27.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.641+0000 7fb14affd700 1 --2- 172.21.15.146:0/1748535496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb14c0b5640 0x7fb14c0c4400 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fb14000d890 tx=0x7fb140008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:27.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.641+0000 7fb1337fe700 1 -- 172.21.15.146:0/1748535496 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1400125f0 con 0x7fb14c0b5640 2023-10-06T11:10:27.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.641+0000 7fb1337fe700 1 -- 172.21.15.146:0/1748535496 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb140012750 con 0x7fb14c0b5640 2023-10-06T11:10:27.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.641+0000 7fb150c78700 1 -- 172.21.15.146:0/1748535496 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb14c0c4e30 con 0x7fb14c0b5640 2023-10-06T11:10:27.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.641+0000 7fb1337fe700 1 -- 172.21.15.146:0/1748535496 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb140012af0 con 0x7fb14c0b5640 2023-10-06T11:10:27.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.641+0000 7fb150c78700 1 -- 172.21.15.146:0/1748535496 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb14c0c53f0 con 0x7fb14c0b5640 2023-10-06T11:10:27.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.642+0000 7fb150c78700 1 -- 172.21.15.146:0/1748535496 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb14c0894b0 con 0x7fb14c0b5640 2023-10-06T11:10:27.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.643+0000 7fb1337fe700 1 -- 172.21.15.146:0/1748535496 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb14001e460 con 0x7fb14c0b5640 2023-10-06T11:10:27.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.643+0000 7fb1337fe700 1 --2- 172.21.15.146:0/1748535496 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb138066f30 0x7fb1380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:27.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.643+0000 7fb1337fe700 1 -- 172.21.15.146:0/1748535496 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fb1400849b0 con 0x7fb14c0b5640 2023-10-06T11:10:27.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.643+0000 7fb14b7fe700 1 --2- 172.21.15.146:0/1748535496 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb138066f30 0x7fb1380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:27.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.643+0000 7fb14b7fe700 1 --2- 172.21.15.146:0/1748535496 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb138066f30 0x7fb1380693e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb13c002230 tx=0x7fb13c001a20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:27.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.647+0000 7fb1337fe700 1 -- 172.21.15.146:0/1748535496 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb1400557a0 con 0x7fb14c0b5640 2023-10-06T11:10:27.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.835+0000 7fb150c78700 1 -- 172.21.15.146:0/1748535496 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fb14c04bb40 con 0x7fb14c0b5640 2023-10-06T11:10:27.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.838+0000 7fb1337fe700 1 -- 172.21.15.146:0/1748535496 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb140055330 con 0x7fb14c0b5640 2023-10-06T11:10:27.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.840+0000 7fb150c78700 1 -- 172.21.15.146:0/1748535496 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb138066f30 msgr2=0x7fb1380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:27.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.840+0000 7fb150c78700 1 --2- 172.21.15.146:0/1748535496 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb138066f30 0x7fb1380693e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb13c002230 tx=0x7fb13c001a20 comp rx=0 tx=0).stop 2023-10-06T11:10:27.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.840+0000 7fb150c78700 1 -- 172.21.15.146:0/1748535496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb14c0b5640 msgr2=0x7fb14c0c4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:27.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.840+0000 7fb150c78700 1 --2- 172.21.15.146:0/1748535496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb14c0b5640 0x7fb14c0c4400 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fb14000d890 tx=0x7fb140008040 comp rx=0 tx=0).stop 2023-10-06T11:10:27.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.841+0000 7fb150c78700 1 -- 172.21.15.146:0/1748535496 shutdown_connections 2023-10-06T11:10:27.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.841+0000 7fb150c78700 1 --2- 172.21.15.146:0/1748535496 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb138066f30 0x7fb1380693e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:27.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.841+0000 7fb150c78700 1 --2- 172.21.15.146:0/1748535496 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb14c0cb090 0x7fb14c153110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:27.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.841+0000 7fb150c78700 1 --2- 172.21.15.146:0/1748535496 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb14c068780 0x7fb14c0c67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:27.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.841+0000 7fb150c78700 1 --2- 172.21.15.146:0/1748535496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb14c0b5640 0x7fb14c0c4400 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:27.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.841+0000 7fb150c78700 1 -- 172.21.15.146:0/1748535496 >> 172.21.15.146:0/1748535496 conn(0x7fb14c0703f0 msgr2=0x7fb14c15c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:27.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.841+0000 7fb150c78700 1 -- 172.21.15.146:0/1748535496 shutdown_connections 2023-10-06T11:10:27.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.841+0000 7fb150c78700 1 -- 172.21.15.146:0/1748535496 wait complete. 2023-10-06T11:10:27.855 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair' 2023-10-06T11:10:27.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.969+0000 7febe5849700 1 Processor -- start 2023-10-06T11:10:27.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.969+0000 7febe5849700 1 -- start start 2023-10-06T11:10:27.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.970+0000 7febe5849700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7febe0153ab0 0x7febe015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:27.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.970+0000 7febe5849700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe015ac30 con 0x7febe0068ba0 2023-10-06T11:10:27.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.970+0000 7febe5849700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe00b4510 con 0x7febe0153e80 2023-10-06T11:10:27.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.970+0000 7febe5849700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febe00b6530 con 0x7febe0153ab0 2023-10-06T11:10:27.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.970+0000 7febdf7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7febe0068ba0 0x7febe00b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36934/0 (socket says 172.21.15.146:36934) 2023-10-06T11:10:27.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.970+0000 7febdf7fe700 1 -- 172.21.15.146:0/4143724675 learned_addr learned my addr 172.21.15.146:0/4143724675 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:10:27.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.970+0000 7febdeffd700 1 --2- 172.21.15.146:0/4143724675 >> v2:172.21.15.151:3300/0 conn(0x7febe0153ab0 0x7febe015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:27.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.970+0000 7febde7fc700 1 -- 172.21.15.146:0/4143724675 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 792609696 0 0) 0x7febd8001490 con 0x7febe0068ba0 2023-10-06T11:10:27.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.970+0000 7febde7fc700 1 -- 172.21.15.146:0/4143724675 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febcc003570 con 0x7febe0068ba0 2023-10-06T11:10:27.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.971+0000 7febde7fc700 1 -- 172.21.15.146:0/4143724675 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1098262033 0 0) 0x7febcc003570 con 0x7febe0068ba0 2023-10-06T11:10:27.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.971+0000 7febde7fc700 1 -- 172.21.15.146:0/4143724675 >> v2:172.21.15.151:3300/0 conn(0x7febe0153ab0 msgr2=0x7febe015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:27.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.971+0000 7febde7fc700 1 --2- 172.21.15.146:0/4143724675 >> v2:172.21.15.151:3300/0 conn(0x7febe0153ab0 0x7febe015a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:27.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.971+0000 7febde7fc700 1 -- 172.21.15.146:0/4143724675 >> v1:172.21.15.151:6789/0 conn(0x7febe0153e80 legacy=0x7febe0068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:27.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.971+0000 7febde7fc700 1 -- 172.21.15.146:0/4143724675 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe00b5c50 con 0x7febe0068ba0 2023-10-06T11:10:27.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.971+0000 7febde7fc700 1 -- 172.21.15.146:0/4143724675 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7febd8001980 con 0x7febe0068ba0 2023-10-06T11:10:27.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.971+0000 7febde7fc700 1 -- 172.21.15.146:0/4143724675 >> v1:172.21.15.146:6789/0 conn(0x7febe0068ba0 legacy=0x7febe00b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:27.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.971+0000 7febde7fc700 1 --2- 172.21.15.146:0/4143724675 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7febcc003a60 0x7febcc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:27.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.971+0000 7febde7fc700 1 --2- 172.21.15.146:0/4143724675 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febcc004810 0x7febcc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:27.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.971+0000 7febde7fc700 1 --2- 172.21.15.146:0/4143724675 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febcc0051c0 0x7febcc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:27.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.971+0000 7febde7fc700 1 -- 172.21.15.146:0/4143724675 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe00b6530 con 0x7febcc004810 2023-10-06T11:10:27.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.971+0000 7febde7fc700 1 -- 172.21.15.146:0/4143724675 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febcc00c0d0 con 0x7febcc003a60 2023-10-06T11:10:27.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.971+0000 7febde7fc700 1 -- 172.21.15.146:0/4143724675 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febcc00c290 con 0x7febcc0051c0 2023-10-06T11:10:27.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.971+0000 7febd67fc700 1 --2- 172.21.15.146:0/4143724675 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febcc004810 0x7febcc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:27.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.971+0000 7febdeffd700 1 --2- 172.21.15.146:0/4143724675 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7febcc003a60 0x7febcc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:27.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.971+0000 7febdf7fe700 1 --2- 172.21.15.146:0/4143724675 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febcc0051c0 0x7febcc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:27.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.971+0000 7febd67fc700 1 -- 172.21.15.146:0/4143724675 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febcc0051c0 msgr2=0x7febcc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:27.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.971+0000 7febd67fc700 1 --2- 172.21.15.146:0/4143724675 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febcc0051c0 0x7febcc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:27.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.971+0000 7febd67fc700 1 -- 172.21.15.146:0/4143724675 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7febcc003a60 msgr2=0x7febcc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:27.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.971+0000 7febd67fc700 1 --2- 172.21.15.146:0/4143724675 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7febcc003a60 0x7febcc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:27.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.971+0000 7febd67fc700 1 -- 172.21.15.146:0/4143724675 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febcc003570 con 0x7febcc004810 2023-10-06T11:10:27.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.971+0000 7febdf7fe700 1 -- 172.21.15.146:0/4143724675 reap_dead start 2023-10-06T11:10:27.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.971+0000 7febd67fc700 1 --2- 172.21.15.146:0/4143724675 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febcc004810 0x7febcc004c80 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7febc80018b0 tx=0x7febc8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edd77bfd04c0143c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:27.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.971+0000 7febde7fc700 1 -- 172.21.15.146:0/4143724675 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc8012420 con 0x7febcc004810 2023-10-06T11:10:27.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.971+0000 7febde7fc700 1 -- 172.21.15.146:0/4143724675 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc8012580 con 0x7febcc004810 2023-10-06T11:10:27.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.971+0000 7febde7fc700 1 -- 172.21.15.146:0/4143724675 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc8012920 con 0x7febcc004810 2023-10-06T11:10:27.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.972+0000 7febe5849700 1 -- 172.21.15.146:0/4143724675 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febcc004810 msgr2=0x7febcc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:27.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.972+0000 7febe5849700 1 --2- 172.21.15.146:0/4143724675 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febcc004810 0x7febcc004c80 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7febc80018b0 tx=0x7febc8007d30 comp rx=0 tx=0).stop 2023-10-06T11:10:27.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.972+0000 7febe5849700 1 -- 172.21.15.146:0/4143724675 shutdown_connections 2023-10-06T11:10:27.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.972+0000 7febe5849700 1 --2- 172.21.15.146:0/4143724675 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febcc004810 0x7febcc004c80 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:27.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.972+0000 7febe5849700 1 -- 172.21.15.146:0/4143724675 >> 172.21.15.146:0/4143724675 conn(0x7febe006eba0 msgr2=0x7febe006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:27.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.972+0000 7febe5849700 1 -- 172.21.15.146:0/4143724675 shutdown_connections 2023-10-06T11:10:27.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.972+0000 7febe5849700 1 -- 172.21.15.146:0/4143724675 wait complete. 2023-10-06T11:10:27.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.973+0000 7febe5849700 1 Processor -- start 2023-10-06T11:10:27.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.973+0000 7febe5849700 1 -- start start 2023-10-06T11:10:27.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.974+0000 7febe5849700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febcc004810 0x7febe013e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:27.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.974+0000 7febe5849700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7febe00d0180 0x7febe00d05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:27.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.974+0000 7febe5849700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febe0158e20 0x7febe0159290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:27.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.974+0000 7febe5849700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe00d0b30 con 0x7febe0158e20 2023-10-06T11:10:27.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.974+0000 7febe5849700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe01542e0 con 0x7febe00d0180 2023-10-06T11:10:27.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.974+0000 7febe5849700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe0154e60 con 0x7febcc004810 2023-10-06T11:10:27.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.974+0000 7febdf7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febe0158e20 0x7febe0159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:27.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.974+0000 7febdf7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febe0158e20 0x7febe0159290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37600/0 (socket says 172.21.15.146:37600) 2023-10-06T11:10:27.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.974+0000 7febdf7fe700 1 -- 172.21.15.146:0/3928232499 learned_addr learned my addr 172.21.15.146:0/3928232499 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:27.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.974+0000 7febd67fc700 1 --2- 172.21.15.146:0/3928232499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7febe00d0180 0x7febe00d05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:27.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.974+0000 7febdeffd700 1 --2- 172.21.15.146:0/3928232499 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febcc004810 0x7febe013e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:27.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.974+0000 7febdf7fe700 1 -- 172.21.15.146:0/3928232499 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febcc004810 msgr2=0x7febe013e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:27.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.974+0000 7febdf7fe700 1 --2- 172.21.15.146:0/3928232499 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febcc004810 0x7febe013e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:27.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.974+0000 7febdf7fe700 1 -- 172.21.15.146:0/3928232499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7febe00d0180 msgr2=0x7febe00d05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:27.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.974+0000 7febdf7fe700 1 --2- 172.21.15.146:0/3928232499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7febe00d0180 0x7febe00d05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:27.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.974+0000 7febdf7fe700 1 -- 172.21.15.146:0/3928232499 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe0154530 con 0x7febe0158e20 2023-10-06T11:10:27.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.974+0000 7febd67fc700 1 --2- 172.21.15.146:0/3928232499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7febe00d0180 0x7febe00d05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:10:27.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.974+0000 7febdeffd700 1 --2- 172.21.15.146:0/3928232499 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febcc004810 0x7febe013e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:10:27.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.975+0000 7febdf7fe700 1 --2- 172.21.15.146:0/3928232499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febe0158e20 0x7febe0159290 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7febe015d1d0 tx=0x7febe00b3db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:27.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.975+0000 7febd77fe700 1 -- 172.21.15.146:0/3928232499 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd8007a60 con 0x7febe0158e20 2023-10-06T11:10:27.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.975+0000 7febd77fe700 1 -- 172.21.15.146:0/3928232499 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd80133f0 con 0x7febe0158e20 2023-10-06T11:10:27.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.975+0000 7febd77fe700 1 -- 172.21.15.146:0/3928232499 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd80137b0 con 0x7febe0158e20 2023-10-06T11:10:27.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.975+0000 7febe5849700 1 -- 172.21.15.146:0/3928232499 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febe0154810 con 0x7febe0158e20 2023-10-06T11:10:27.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.975+0000 7febe5849700 1 -- 172.21.15.146:0/3928232499 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febe013e7e0 con 0x7febe0158e20 2023-10-06T11:10:27.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.976+0000 7febe5849700 1 -- 172.21.15.146:0/3928232499 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febe004c380 con 0x7febe0158e20 2023-10-06T11:10:27.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.976+0000 7febd77fe700 1 -- 172.21.15.146:0/3928232499 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7febd8013be0 con 0x7febe0158e20 2023-10-06T11:10:27.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.976+0000 7febd77fe700 1 --2- 172.21.15.146:0/3928232499 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7febc0066f30 0x7febc00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:27.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.977+0000 7febd77fe700 1 -- 172.21.15.146:0/3928232499 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5464+0+0 (secure 0 0 0) 0x7febd8084a70 con 0x7febe0158e20 2023-10-06T11:10:27.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.977+0000 7febdeffd700 1 --2- 172.21.15.146:0/3928232499 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7febc0066f30 0x7febc00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:27.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.977+0000 7febdeffd700 1 --2- 172.21.15.146:0/3928232499 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7febc0066f30 0x7febc00693e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7febd00093f0 tx=0x7febd0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:27.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:27.981+0000 7febd77fe700 1 -- 172.21.15.146:0/3928232499 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7febd8051dd0 con 0x7febe0158e20 2023-10-06T11:10:28.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.239+0000 7febe5849700 1 -- 172.21.15.146:0/3928232499 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]} v 0) v1 -- 0x7febe015bdb0 con 0x7febe0158e20 2023-10-06T11:10:28.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.502+0000 7febd77fe700 1 -- 172.21.15.146:0/3928232499 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_scrub_repair"]}]=0 v238) v1 ==== 143+0+0 (secure 0 0 0) 0x7febe015bdb0 con 0x7febe0158e20 2023-10-06T11:10:28.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.504+0000 7febe5849700 1 -- 172.21.15.146:0/3928232499 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7febc0066f30 msgr2=0x7febc00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:28.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.504+0000 7febe5849700 1 --2- 172.21.15.146:0/3928232499 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7febc0066f30 0x7febc00693e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7febd00093f0 tx=0x7febd0008040 comp rx=0 tx=0).stop 2023-10-06T11:10:28.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.504+0000 7febe5849700 1 -- 172.21.15.146:0/3928232499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febe0158e20 msgr2=0x7febe0159290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:28.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.504+0000 7febe5849700 1 --2- 172.21.15.146:0/3928232499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febe0158e20 0x7febe0159290 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7febe015d1d0 tx=0x7febe00b3db0 comp rx=0 tx=0).stop 2023-10-06T11:10:28.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.504+0000 7febe5849700 1 -- 172.21.15.146:0/3928232499 shutdown_connections 2023-10-06T11:10:28.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.504+0000 7febe5849700 1 --2- 172.21.15.146:0/3928232499 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7febc0066f30 0x7febc00693e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:28.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.504+0000 7febe5849700 1 --2- 172.21.15.146:0/3928232499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febe0158e20 0x7febe0159290 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:28.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.504+0000 7febe5849700 1 --2- 172.21.15.146:0/3928232499 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febcc004810 0x7febe013e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:28.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.504+0000 7febe5849700 1 --2- 172.21.15.146:0/3928232499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7febe00d0180 0x7febe00d05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:28.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.505+0000 7febe5849700 1 -- 172.21.15.146:0/3928232499 >> 172.21.15.146:0/3928232499 conn(0x7febe006eba0 msgr2=0x7febe01531a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:28.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.505+0000 7febe5849700 1 -- 172.21.15.146:0/3928232499 shutdown_connections 2023-10-06T11:10:28.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.505+0000 7febe5849700 1 -- 172.21.15.146:0/3928232499 wait complete. 2023-10-06T11:10:28.519 INFO:tasks.cephfs_test_runner:test_scrub_repair (tasks.cephfs.test_scrub_checks.TestScrubChecks) ... ok 2023-10-06T11:10:28.519 INFO:tasks.cephfs_test_runner:Starting test: test_stray_evaluation_with_scrub (tasks.cephfs.test_scrub_checks.TestScrubChecks) test that scrub can iterate over ~mdsdir and evaluate strays 2023-10-06T11:10:28.519 INFO:tasks.cephfs_test_runner:test_stray_evaluation_with_scrub (tasks.cephfs.test_scrub_checks.TestScrubChecks) 2023-10-06T11:10:28.519 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub' 2023-10-06T11:10:28.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.633+0000 7f6d4068e700 1 Processor -- start 2023-10-06T11:10:28.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.633+0000 7f6d4068e700 1 -- start start 2023-10-06T11:10:28.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.634+0000 7f6d4068e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6d38153e80 0x7f6d3815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:28.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.634+0000 7f6d4068e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d3815ac30 con 0x7f6d38153ab0 2023-10-06T11:10:28.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.634+0000 7f6d4068e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d380b4510 con 0x7f6d38068ba0 2023-10-06T11:10:28.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.634+0000 7f6d4068e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d380b6530 con 0x7f6d38153e80 2023-10-06T11:10:28.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.634+0000 7f6d3ec2b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6d38153e80 0x7f6d3815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:28.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.634+0000 7f6d3e42a700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6d38153ab0 0x7f6d38068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36946/0 (socket says 172.21.15.146:36946) 2023-10-06T11:10:28.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.634+0000 7f6d3e42a700 1 -- 172.21.15.146:0/2648399072 learned_addr learned my addr 172.21.15.146:0/2648399072 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:10:28.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.634+0000 7f6d3ec2b700 1 -- 172.21.15.146:0/2648399072 >> v1:172.21.15.151:6789/0 conn(0x7f6d38068ba0 legacy=0x7f6d380b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:28.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.634+0000 7f6d3ec2b700 1 -- 172.21.15.146:0/2648399072 >> v1:172.21.15.146:6789/0 conn(0x7f6d38153ab0 legacy=0x7f6d38068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:28.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.634+0000 7f6d3ec2b700 1 -- 172.21.15.146:0/2648399072 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d380b5c50 con 0x7f6d38153e80 2023-10-06T11:10:28.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.634+0000 7f6d3d428700 1 -- 172.21.15.146:0/2648399072 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1319845242 0 0) 0x7f6d34001110 con 0x7f6d38153ab0 2023-10-06T11:10:28.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.635+0000 7f6d3ec2b700 1 --2- 172.21.15.146:0/2648399072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d38153e80 0x7f6d3815a6f0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f6d30009e60 tx=0x7f6d30009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7268f11f45ba8f35 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:28.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.635+0000 7f6d3d428700 1 -- 172.21.15.146:0/2648399072 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3000e070 con 0x7f6d38153e80 2023-10-06T11:10:28.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.635+0000 7f6d3d428700 1 -- 172.21.15.146:0/2648399072 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d3000bc30 con 0x7f6d38153e80 2023-10-06T11:10:28.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.635+0000 7f6d3d428700 1 -- 172.21.15.146:0/2648399072 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d30012430 con 0x7f6d38153e80 2023-10-06T11:10:28.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.635+0000 7f6d4068e700 1 -- 172.21.15.146:0/2648399072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d38153e80 msgr2=0x7f6d3815a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:28.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.635+0000 7f6d4068e700 1 --2- 172.21.15.146:0/2648399072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d38153e80 0x7f6d3815a6f0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f6d30009e60 tx=0x7f6d30009780 comp rx=0 tx=0).stop 2023-10-06T11:10:28.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.635+0000 7f6d4068e700 1 -- 172.21.15.146:0/2648399072 shutdown_connections 2023-10-06T11:10:28.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.635+0000 7f6d4068e700 1 --2- 172.21.15.146:0/2648399072 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d38153e80 0x7f6d3815a6f0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:28.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.635+0000 7f6d4068e700 1 -- 172.21.15.146:0/2648399072 >> 172.21.15.146:0/2648399072 conn(0x7f6d3806eba0 msgr2=0x7f6d3806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:28.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.635+0000 7f6d4068e700 1 -- 172.21.15.146:0/2648399072 shutdown_connections 2023-10-06T11:10:28.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.635+0000 7f6d4068e700 1 -- 172.21.15.146:0/2648399072 wait complete. 2023-10-06T11:10:28.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.636+0000 7f6d4068e700 1 Processor -- start 2023-10-06T11:10:28.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.636+0000 7f6d4068e700 1 -- start start 2023-10-06T11:10:28.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.637+0000 7f6d4068e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d38068ba0 0x7f6d380afec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:28.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.637+0000 7f6d4068e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d38153ab0 0x7f6d380b15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:28.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.637+0000 7f6d4068e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d38153e80 0x7f6d38155810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:28.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.637+0000 7f6d4068e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d38155d50 con 0x7f6d38153ab0 2023-10-06T11:10:28.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.637+0000 7f6d4068e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d380b1160 con 0x7f6d38068ba0 2023-10-06T11:10:28.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.637+0000 7f6d4068e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d380b0550 con 0x7f6d38153e80 2023-10-06T11:10:28.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.637+0000 7f6d3dc29700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d38153ab0 0x7f6d380b15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:28.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.637+0000 7f6d3dc29700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d38153ab0 0x7f6d380b15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37630/0 (socket says 172.21.15.146:37630) 2023-10-06T11:10:28.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.637+0000 7f6d3dc29700 1 -- 172.21.15.146:0/3839547141 learned_addr learned my addr 172.21.15.146:0/3839547141 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:28.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.637+0000 7f6d3e42a700 1 --2- 172.21.15.146:0/3839547141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d38068ba0 0x7f6d380afec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:28.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.637+0000 7f6d3ec2b700 1 --2- 172.21.15.146:0/3839547141 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d38153e80 0x7f6d38155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:28.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.638+0000 7f6d3dc29700 1 -- 172.21.15.146:0/3839547141 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d38153e80 msgr2=0x7f6d38155810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:28.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.638+0000 7f6d3dc29700 1 --2- 172.21.15.146:0/3839547141 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d38153e80 0x7f6d38155810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:28.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.638+0000 7f6d3dc29700 1 -- 172.21.15.146:0/3839547141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d38068ba0 msgr2=0x7f6d380afec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:28.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.638+0000 7f6d3dc29700 1 --2- 172.21.15.146:0/3839547141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d38068ba0 0x7f6d380afec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:28.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.638+0000 7f6d3dc29700 1 -- 172.21.15.146:0/3839547141 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d30009a20 con 0x7f6d38153ab0 2023-10-06T11:10:28.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.638+0000 7f6d3dc29700 1 --2- 172.21.15.146:0/3839547141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d38153ab0 0x7f6d380b15f0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f6d2800c590 tx=0x7f6d28007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:28.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.638+0000 7f6d2e7fc700 1 -- 172.21.15.146:0/3839547141 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2800cea0 con 0x7f6d38153ab0 2023-10-06T11:10:28.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.638+0000 7f6d2e7fc700 1 -- 172.21.15.146:0/3839547141 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d28011590 con 0x7f6d38153ab0 2023-10-06T11:10:28.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.638+0000 7f6d4068e700 1 -- 172.21.15.146:0/3839547141 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d380b0830 con 0x7f6d38153ab0 2023-10-06T11:10:28.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.638+0000 7f6d2e7fc700 1 -- 172.21.15.146:0/3839547141 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d28011930 con 0x7f6d38153ab0 2023-10-06T11:10:28.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.638+0000 7f6d4068e700 1 -- 172.21.15.146:0/3839547141 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d380b0df0 con 0x7f6d38153ab0 2023-10-06T11:10:28.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.639+0000 7f6d4068e700 1 -- 172.21.15.146:0/3839547141 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d3804c380 con 0x7f6d38153ab0 2023-10-06T11:10:28.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.639+0000 7f6d2e7fc700 1 -- 172.21.15.146:0/3839547141 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6d28011d20 con 0x7f6d38153ab0 2023-10-06T11:10:28.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.639+0000 7f6d2e7fc700 1 --2- 172.21.15.146:0/3839547141 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6d1c066f30 0x7f6d1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:28.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.640+0000 7f6d2e7fc700 1 -- 172.21.15.146:0/3839547141 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f6d28083690 con 0x7f6d38153ab0 2023-10-06T11:10:28.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.640+0000 7f6d3e42a700 1 --2- 172.21.15.146:0/3839547141 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6d1c066f30 0x7f6d1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:28.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.640+0000 7f6d3e42a700 1 --2- 172.21.15.146:0/3839547141 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6d1c066f30 0x7f6d1c0693e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6d34006fc0 tx=0x7f6d34007b90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:28.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.644+0000 7f6d2e7fc700 1 -- 172.21.15.146:0/3839547141 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6d280509f0 con 0x7f6d38153ab0 2023-10-06T11:10:28.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:28.901+0000 7f6d4068e700 1 -- 172.21.15.146:0/3839547141 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]} v 0) v1 -- 0x7f6d380b12a0 con 0x7f6d38153ab0 2023-10-06T11:10:29.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.506+0000 7f6d2e7fc700 1 -- 172.21.15.146:0/3839547141 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]}]=0 v239) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6d28017020 con 0x7f6d38153ab0 2023-10-06T11:10:29.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.508+0000 7f6d4068e700 1 -- 172.21.15.146:0/3839547141 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6d1c066f30 msgr2=0x7f6d1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:29.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.508+0000 7f6d4068e700 1 --2- 172.21.15.146:0/3839547141 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6d1c066f30 0x7f6d1c0693e0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6d34006fc0 tx=0x7f6d34007b90 comp rx=0 tx=0).stop 2023-10-06T11:10:29.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.508+0000 7f6d4068e700 1 -- 172.21.15.146:0/3839547141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d38153ab0 msgr2=0x7f6d380b15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:29.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.508+0000 7f6d4068e700 1 --2- 172.21.15.146:0/3839547141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d38153ab0 0x7f6d380b15f0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f6d2800c590 tx=0x7f6d28007f50 comp rx=0 tx=0).stop 2023-10-06T11:10:29.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.508+0000 7f6d4068e700 1 -- 172.21.15.146:0/3839547141 shutdown_connections 2023-10-06T11:10:29.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.508+0000 7f6d4068e700 1 --2- 172.21.15.146:0/3839547141 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6d1c066f30 0x7f6d1c0693e0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:29.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.508+0000 7f6d4068e700 1 --2- 172.21.15.146:0/3839547141 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d38153e80 0x7f6d38155810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:29.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.508+0000 7f6d4068e700 1 --2- 172.21.15.146:0/3839547141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d38068ba0 0x7f6d380afec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:29.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.508+0000 7f6d4068e700 1 --2- 172.21.15.146:0/3839547141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d38153ab0 0x7f6d380b15f0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:29.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.508+0000 7f6d4068e700 1 -- 172.21.15.146:0/3839547141 >> 172.21.15.146:0/3839547141 conn(0x7f6d3806eba0 msgr2=0x7f6d380cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:29.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.508+0000 7f6d4068e700 1 -- 172.21.15.146:0/3839547141 shutdown_connections 2023-10-06T11:10:29.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.508+0000 7f6d4068e700 1 -- 172.21.15.146:0/3839547141 wait complete. 2023-10-06T11:10:29.523 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T11:10:29.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.639+0000 7fd038b45700 1 Processor -- start 2023-10-06T11:10:29.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.639+0000 7fd038b45700 1 -- start start 2023-10-06T11:10:29.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.640+0000 7fd038b45700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd03415cc20 0x7fd03415d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:29.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.640+0000 7fd038b45700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0340cf030 con 0x7fd0340d0c50 2023-10-06T11:10:29.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.640+0000 7fd038b45700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0340ced20 con 0x7fd03415cff0 2023-10-06T11:10:29.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.640+0000 7fd038b45700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd03415e390 con 0x7fd03415cc20 2023-10-06T11:10:29.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.640+0000 7fd03259c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd03415cc20 0x7fd03415d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:29.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.640+0000 7fd032d9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd0340d0c50 0x7fd03415a890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36950/0 (socket says 172.21.15.146:36950) 2023-10-06T11:10:29.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.640+0000 7fd032d9d700 1 -- 172.21.15.146:0/2591657249 learned_addr learned my addr 172.21.15.146:0/2591657249 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:10:29.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.640+0000 7fd03259c700 1 -- 172.21.15.146:0/2591657249 >> v1:172.21.15.151:6789/0 conn(0x7fd03415cff0 legacy=0x7fd0340d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:29.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.641+0000 7fd03259c700 1 -- 172.21.15.146:0/2591657249 >> v1:172.21.15.146:6789/0 conn(0x7fd0340d0c50 legacy=0x7fd03415a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:29.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.641+0000 7fd03259c700 1 -- 172.21.15.146:0/2591657249 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd03415daf0 con 0x7fd03415cc20 2023-10-06T11:10:29.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.641+0000 7fd031d9b700 1 -- 172.21.15.146:0/2591657249 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 691283091 0 0) 0x7fd0340cf030 con 0x7fd0340d0c50 2023-10-06T11:10:29.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.641+0000 7fd03259c700 1 --2- 172.21.15.146:0/2591657249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd03415cc20 0x7fd03415d460 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fd0240098d0 tx=0x7fd024009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b14801a117a89e93 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:29.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.641+0000 7fd031d9b700 1 -- 172.21.15.146:0/2591657249 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd024009e70 con 0x7fd03415cc20 2023-10-06T11:10:29.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.641+0000 7fd031d9b700 1 -- 172.21.15.146:0/2591657249 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd024005c10 con 0x7fd03415cc20 2023-10-06T11:10:29.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.641+0000 7fd031d9b700 1 -- 172.21.15.146:0/2591657249 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02400b650 con 0x7fd03415cc20 2023-10-06T11:10:29.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.641+0000 7fd038b45700 1 -- 172.21.15.146:0/2591657249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd03415cc20 msgr2=0x7fd03415d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:29.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.641+0000 7fd038b45700 1 --2- 172.21.15.146:0/2591657249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd03415cc20 0x7fd03415d460 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fd0240098d0 tx=0x7fd024009120 comp rx=0 tx=0).stop 2023-10-06T11:10:29.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.641+0000 7fd038b45700 1 -- 172.21.15.146:0/2591657249 shutdown_connections 2023-10-06T11:10:29.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.641+0000 7fd038b45700 1 --2- 172.21.15.146:0/2591657249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd03415cc20 0x7fd03415d460 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:29.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.641+0000 7fd038b45700 1 -- 172.21.15.146:0/2591657249 >> 172.21.15.146:0/2591657249 conn(0x7fd03406eba0 msgr2=0x7fd03406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:29.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.641+0000 7fd038b45700 1 -- 172.21.15.146:0/2591657249 shutdown_connections 2023-10-06T11:10:29.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.641+0000 7fd038b45700 1 -- 172.21.15.146:0/2591657249 wait complete. 2023-10-06T11:10:29.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.642+0000 7fd038b45700 1 Processor -- start 2023-10-06T11:10:29.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.643+0000 7fd038b45700 1 -- start start 2023-10-06T11:10:29.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.643+0000 7fd038b45700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0340d0c50 0x7fd034157310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:29.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.643+0000 7fd038b45700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd03415cc20 0x7fd0340b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:29.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.643+0000 7fd038b45700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd03415cff0 0x7fd0340b5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:29.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.643+0000 7fd038b45700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0340b26d0 con 0x7fd0340d0c50 2023-10-06T11:10:29.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.643+0000 7fd038b45700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0340c5ca0 con 0x7fd03415cff0 2023-10-06T11:10:29.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.643+0000 7fd038b45700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd034157850 con 0x7fd03415cc20 2023-10-06T11:10:29.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.643+0000 7fd03259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0340d0c50 0x7fd034157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:29.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.643+0000 7fd03259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0340d0c50 0x7fd034157310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37650/0 (socket says 172.21.15.146:37650) 2023-10-06T11:10:29.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.643+0000 7fd03259c700 1 -- 172.21.15.146:0/2873504741 learned_addr learned my addr 172.21.15.146:0/2873504741 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:29.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.644+0000 7fd02bfff700 1 --2- 172.21.15.146:0/2873504741 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd03415cc20 0x7fd0340b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:29.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.644+0000 7fd032d9d700 1 --2- 172.21.15.146:0/2873504741 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd03415cff0 0x7fd0340b5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:29.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.644+0000 7fd03259c700 1 -- 172.21.15.146:0/2873504741 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd03415cc20 msgr2=0x7fd0340b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:29.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.644+0000 7fd03259c700 1 --2- 172.21.15.146:0/2873504741 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd03415cc20 0x7fd0340b5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:29.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.644+0000 7fd03259c700 1 -- 172.21.15.146:0/2873504741 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd03415cff0 msgr2=0x7fd0340b5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:29.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.644+0000 7fd03259c700 1 --2- 172.21.15.146:0/2873504741 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd03415cff0 0x7fd0340b5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:29.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.644+0000 7fd03259c700 1 -- 172.21.15.146:0/2873504741 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0240093c0 con 0x7fd0340d0c50 2023-10-06T11:10:29.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.644+0000 7fd02bfff700 1 --2- 172.21.15.146:0/2873504741 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd03415cc20 0x7fd0340b5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:10:29.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.644+0000 7fd032d9d700 1 --2- 172.21.15.146:0/2873504741 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd03415cff0 0x7fd0340b5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:10:29.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.644+0000 7fd03259c700 1 --2- 172.21.15.146:0/2873504741 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0340d0c50 0x7fd034157310 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fd024009160 tx=0x7fd024015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:29.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.644+0000 7fd02a7fc700 1 -- 172.21.15.146:0/2873504741 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0240066c0 con 0x7fd0340d0c50 2023-10-06T11:10:29.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.644+0000 7fd02a7fc700 1 -- 172.21.15.146:0/2873504741 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd024006820 con 0x7fd0340d0c50 2023-10-06T11:10:29.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.644+0000 7fd038b45700 1 -- 172.21.15.146:0/2873504741 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0340cbad0 con 0x7fd0340d0c50 2023-10-06T11:10:29.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.644+0000 7fd02a7fc700 1 -- 172.21.15.146:0/2873504741 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02401c660 con 0x7fd0340d0c50 2023-10-06T11:10:29.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.644+0000 7fd038b45700 1 -- 172.21.15.146:0/2873504741 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0340c5650 con 0x7fd0340d0c50 2023-10-06T11:10:29.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.645+0000 7fd038b45700 1 -- 172.21.15.146:0/2873504741 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd03404c380 con 0x7fd0340d0c50 2023-10-06T11:10:29.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.645+0000 7fd02a7fc700 1 -- 172.21.15.146:0/2873504741 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd024023070 con 0x7fd0340d0c50 2023-10-06T11:10:29.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.646+0000 7fd02a7fc700 1 --2- 172.21.15.146:0/2873504741 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd014066f30 0x7fd0140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:29.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.646+0000 7fd02bfff700 1 --2- 172.21.15.146:0/2873504741 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd014066f30 0x7fd0140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:29.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.646+0000 7fd02a7fc700 1 -- 172.21.15.146:0/2873504741 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fd024086180 con 0x7fd0340d0c50 2023-10-06T11:10:29.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.646+0000 7fd02bfff700 1 --2- 172.21.15.146:0/2873504741 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd014066f30 0x7fd0140693e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd0340ce4b0 tx=0x7fd01c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:29.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.650+0000 7fd02a7fc700 1 -- 172.21.15.146:0/2873504741 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd024053590 con 0x7fd0340d0c50 2023-10-06T11:10:29.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.833+0000 7fd038b45700 1 -- 172.21.15.146:0/2873504741 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd0340b3b50 con 0x7fd0340d0c50 2023-10-06T11:10:29.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.836+0000 7fd02a7fc700 1 -- 172.21.15.146:0/2873504741 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd024056bb0 con 0x7fd0340d0c50 2023-10-06T11:10:29.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.839+0000 7fd038b45700 1 -- 172.21.15.146:0/2873504741 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd014066f30 msgr2=0x7fd0140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:29.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.839+0000 7fd038b45700 1 --2- 172.21.15.146:0/2873504741 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd014066f30 0x7fd0140693e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd0340ce4b0 tx=0x7fd01c008040 comp rx=0 tx=0).stop 2023-10-06T11:10:29.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.839+0000 7fd038b45700 1 -- 172.21.15.146:0/2873504741 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0340d0c50 msgr2=0x7fd034157310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:29.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.839+0000 7fd038b45700 1 --2- 172.21.15.146:0/2873504741 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0340d0c50 0x7fd034157310 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fd024009160 tx=0x7fd024015000 comp rx=0 tx=0).stop 2023-10-06T11:10:29.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.839+0000 7fd038b45700 1 -- 172.21.15.146:0/2873504741 shutdown_connections 2023-10-06T11:10:29.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.839+0000 7fd038b45700 1 --2- 172.21.15.146:0/2873504741 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd014066f30 0x7fd0140693e0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:29.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.839+0000 7fd038b45700 1 --2- 172.21.15.146:0/2873504741 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd03415cff0 0x7fd0340b5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:29.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.839+0000 7fd038b45700 1 --2- 172.21.15.146:0/2873504741 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd0340d0c50 0x7fd034157310 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:29.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.839+0000 7fd038b45700 1 --2- 172.21.15.146:0/2873504741 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd03415cc20 0x7fd0340b5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:29.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.839+0000 7fd038b45700 1 -- 172.21.15.146:0/2873504741 >> 172.21.15.146:0/2873504741 conn(0x7fd03406eba0 msgr2=0x7fd0341590a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:29.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.839+0000 7fd038b45700 1 -- 172.21.15.146:0/2873504741 shutdown_connections 2023-10-06T11:10:29.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:29.839+0000 7fd038b45700 1 -- 172.21.15.146:0/2873504741 wait complete. 2023-10-06T11:10:29.853 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T11:10:29.853 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:10:29.891 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:10:29.932 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T11:10:29.932 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T11:10:29.933 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:10:30.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.046+0000 7f995a28b700 1 Processor -- start 2023-10-06T11:10:30.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.046+0000 7f995a28b700 1 -- start start 2023-10-06T11:10:30.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.047+0000 7f995a28b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f99540b3770 0x7f99540b1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:30.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.047+0000 7f995a28b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f995406f780 0x7f99540b1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:30.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.047+0000 7f995a28b700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99540ae100 con 0x7f995415cbd0 2023-10-06T11:10:30.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.047+0000 7f995a28b700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99540d0f10 con 0x7f99540b3770 2023-10-06T11:10:30.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.047+0000 7f995a28b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99540d11f0 con 0x7f995406f780 2023-10-06T11:10:30.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.048+0000 7f9958a88700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f99540b3770 0x7f99540b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:30.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.048+0000 7f9959a8a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f995406f780 0x7f99540b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:30.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.048+0000 7f9959289700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f995415cbd0 0x7f99540b0870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:38000/0 (socket says 172.21.15.146:38000) 2023-10-06T11:10:30.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.048+0000 7f9959289700 1 -- 172.21.15.146:0/2386227007 learned_addr learned my addr 172.21.15.146:0/2386227007 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:10:30.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.048+0000 7f9958a88700 1 -- 172.21.15.146:0/2386227007 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f995406f780 msgr2=0x7f99540b1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:30.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.048+0000 7f9958a88700 1 --2- 172.21.15.146:0/2386227007 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f995406f780 0x7f99540b1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:30.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.048+0000 7f9958a88700 1 -- 172.21.15.146:0/2386227007 >> v1:172.21.15.151:6789/0 conn(0x7f995415cbd0 legacy=0x7f99540b0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:30.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.048+0000 7f994bfff700 1 -- 172.21.15.146:0/2386227007 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2969078089 0 0) 0x7f99540ae100 con 0x7f995415cbd0 2023-10-06T11:10:30.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.048+0000 7f9958a88700 1 -- 172.21.15.146:0/2386227007 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99540ae350 con 0x7f99540b3770 2023-10-06T11:10:30.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.048+0000 7f9959a8a700 1 --2- 172.21.15.146:0/2386227007 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f995406f780 0x7f99540b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:10:30.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.048+0000 7f9958a88700 1 --2- 172.21.15.146:0/2386227007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f99540b3770 0x7f99540b1240 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f99440098e0 tx=0x7f99440091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1e2c21314df29dc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:30.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.048+0000 7f994bfff700 1 -- 172.21.15.146:0/2386227007 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994400b640 con 0x7f99540b3770 2023-10-06T11:10:30.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.048+0000 7f994bfff700 1 -- 172.21.15.146:0/2386227007 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f994400b7a0 con 0x7f99540b3770 2023-10-06T11:10:30.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.048+0000 7f994bfff700 1 -- 172.21.15.146:0/2386227007 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994400bb40 con 0x7f99540b3770 2023-10-06T11:10:30.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.049+0000 7f995a28b700 1 -- 172.21.15.146:0/2386227007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f99540b3770 msgr2=0x7f99540b1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:30.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.049+0000 7f995a28b700 1 --2- 172.21.15.146:0/2386227007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f99540b3770 0x7f99540b1240 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f99440098e0 tx=0x7f99440091a0 comp rx=0 tx=0).stop 2023-10-06T11:10:30.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.049+0000 7f995a28b700 1 -- 172.21.15.146:0/2386227007 shutdown_connections 2023-10-06T11:10:30.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.049+0000 7f995a28b700 1 --2- 172.21.15.146:0/2386227007 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f995406f780 0x7f99540b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:30.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.049+0000 7f995a28b700 1 --2- 172.21.15.146:0/2386227007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f99540b3770 0x7f99540b1240 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:30.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.049+0000 7f995a28b700 1 -- 172.21.15.146:0/2386227007 >> 172.21.15.146:0/2386227007 conn(0x7f995406f380 msgr2=0x7f99540d0660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:30.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.049+0000 7f995a28b700 1 -- 172.21.15.146:0/2386227007 shutdown_connections 2023-10-06T11:10:30.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.049+0000 7f995a28b700 1 -- 172.21.15.146:0/2386227007 wait complete. 2023-10-06T11:10:30.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.050+0000 7f995a28b700 1 Processor -- start 2023-10-06T11:10:30.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.050+0000 7f995a28b700 1 -- start start 2023-10-06T11:10:30.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.051+0000 7f995a28b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f995406f780 0x7f9954151d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:30.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.051+0000 7f995a28b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99540b3770 0x7f995416d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:30.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.051+0000 7f995a28b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f995415cbd0 0x7f995409b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:30.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.051+0000 7f995a28b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9954150120 con 0x7f99540b3770 2023-10-06T11:10:30.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.051+0000 7f995a28b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9954152570 con 0x7f995415cbd0 2023-10-06T11:10:30.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.051+0000 7f995a28b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9954152850 con 0x7f995406f780 2023-10-06T11:10:30.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.051+0000 7f9958a88700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99540b3770 0x7f995416d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:30.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.051+0000 7f9958a88700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99540b3770 0x7f995416d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37658/0 (socket says 172.21.15.146:37658) 2023-10-06T11:10:30.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.051+0000 7f9958a88700 1 -- 172.21.15.146:0/307232476 learned_addr learned my addr 172.21.15.146:0/307232476 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:30.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.051+0000 7f9959289700 1 --2- 172.21.15.146:0/307232476 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f995406f780 0x7f9954151d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:30.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.051+0000 7f9959a8a700 1 --2- 172.21.15.146:0/307232476 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f995415cbd0 0x7f995409b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:30.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.051+0000 7f9958a88700 1 -- 172.21.15.146:0/307232476 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f995406f780 msgr2=0x7f9954151d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:30.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.051+0000 7f9958a88700 1 --2- 172.21.15.146:0/307232476 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f995406f780 0x7f9954151d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:30.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.051+0000 7f9958a88700 1 -- 172.21.15.146:0/307232476 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f995415cbd0 msgr2=0x7f995409b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:30.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.051+0000 7f9958a88700 1 --2- 172.21.15.146:0/307232476 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f995415cbd0 0x7f995409b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:30.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.051+0000 7f9958a88700 1 -- 172.21.15.146:0/307232476 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f994c009a20 con 0x7f99540b3770 2023-10-06T11:10:30.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.052+0000 7f9958a88700 1 --2- 172.21.15.146:0/307232476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99540b3770 0x7f995416d720 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f9954088c30 tx=0x7f9944017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:30.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.052+0000 7f99497fa700 1 -- 172.21.15.146:0/307232476 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f994400bb20 con 0x7f99540b3770 2023-10-06T11:10:30.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.052+0000 7f99497fa700 1 -- 172.21.15.146:0/307232476 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9944000c40 con 0x7f99540b3770 2023-10-06T11:10:30.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.052+0000 7f995a28b700 1 -- 172.21.15.146:0/307232476 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9944009420 con 0x7f99540b3770 2023-10-06T11:10:30.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.052+0000 7f99497fa700 1 -- 172.21.15.146:0/307232476 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9944011650 con 0x7f99540b3770 2023-10-06T11:10:30.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.052+0000 7f995a28b700 1 -- 172.21.15.146:0/307232476 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9954152e10 con 0x7f99540b3770 2023-10-06T11:10:30.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.053+0000 7f995a28b700 1 -- 172.21.15.146:0/307232476 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9954088170 con 0x7f99540b3770 2023-10-06T11:10:30.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.053+0000 7f99497fa700 1 -- 172.21.15.146:0/307232476 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9944011a40 con 0x7f99540b3770 2023-10-06T11:10:30.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.054+0000 7f99497fa700 1 --2- 172.21.15.146:0/307232476 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9938066f30 0x7f99380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:30.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.054+0000 7f99497fa700 1 -- 172.21.15.146:0/307232476 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f9944085c80 con 0x7f99540b3770 2023-10-06T11:10:30.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.054+0000 7f9959289700 1 --2- 172.21.15.146:0/307232476 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9938066f30 0x7f99380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:30.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.054+0000 7f9959289700 1 --2- 172.21.15.146:0/307232476 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9938066f30 0x7f99380693e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9950007160 tx=0x7f9950007f50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:30.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.058+0000 7f99497fa700 1 -- 172.21.15.146:0/307232476 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f99440530a0 con 0x7f99540b3770 2023-10-06T11:10:30.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.283+0000 7f995a28b700 1 -- 172.21.15.146:0/307232476 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9954153470 con 0x7f99540b3770 2023-10-06T11:10:30.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.283+0000 7f99497fa700 1 -- 172.21.15.146:0/307232476 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+3541 (secure 0 0 0) 0x7f9944015df0 con 0x7f99540b3770 2023-10-06T11:10:30.285 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:10:30.286 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":58,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5621,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/1872666923","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1872666923},{"type":"v1","addr":"172.21.15.151:6833","nonce":1872666923}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":6082,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1430806818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":1430806818},{"type":"v1","addr":"172.21.15.151:6835","nonce":1430806818}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":6546,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/1394956500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":1394956500},{"type":"v1","addr":"172.21.15.146:6837","nonce":1394956500}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54},{"gid":6705,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/3667361984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3667361984},{"type":"v1","addr":"172.21.15.146:6835","nonce":3667361984}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[]} 2023-10-06T11:10:30.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.285+0000 7f995a28b700 1 -- 172.21.15.146:0/307232476 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9938066f30 msgr2=0x7f99380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:30.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.285+0000 7f995a28b700 1 --2- 172.21.15.146:0/307232476 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9938066f30 0x7f99380693e0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9950007160 tx=0x7f9950007f50 comp rx=0 tx=0).stop 2023-10-06T11:10:30.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.285+0000 7f995a28b700 1 -- 172.21.15.146:0/307232476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99540b3770 msgr2=0x7f995416d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:30.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.285+0000 7f995a28b700 1 --2- 172.21.15.146:0/307232476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99540b3770 0x7f995416d720 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f9954088c30 tx=0x7f9944017000 comp rx=0 tx=0).stop 2023-10-06T11:10:30.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.285+0000 7f995a28b700 1 -- 172.21.15.146:0/307232476 shutdown_connections 2023-10-06T11:10:30.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.285+0000 7f995a28b700 1 --2- 172.21.15.146:0/307232476 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9938066f30 0x7f99380693e0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:30.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.285+0000 7f995a28b700 1 --2- 172.21.15.146:0/307232476 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f995415cbd0 0x7f995409b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:30.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.285+0000 7f995a28b700 1 --2- 172.21.15.146:0/307232476 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f995406f780 0x7f9954151d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:30.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.285+0000 7f995a28b700 1 --2- 172.21.15.146:0/307232476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99540b3770 0x7f995416d720 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:30.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.285+0000 7f995a28b700 1 -- 172.21.15.146:0/307232476 >> 172.21.15.146:0/307232476 conn(0x7f995406f380 msgr2=0x7f995415e990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:30.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.285+0000 7f995a28b700 1 -- 172.21.15.146:0/307232476 shutdown_connections 2023-10-06T11:10:30.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.285+0000 7f995a28b700 1 -- 172.21.15.146:0/307232476 wait complete. 2023-10-06T11:10:30.290 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 58 2023-10-06T11:10:30.299 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T11:10:30.300 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T11:10:30.300 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T11:10:30.300 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:10:30.300 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T11:10:30.300 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T11:10:30.300 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T11:10:30.301 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:10:30.301 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T11:10:30.301 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T11:10:30.301 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T11:10:30.301 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:10:30.301 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T11:10:30.301 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T11:10:30.302 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T11:10:30.302 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:10:30.309 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T11:10:30.309 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T11:10:30.310 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T11:10:30.310 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T11:10:30.312 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T11:10:30.312 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T11:10:30.313 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T11:10:30.313 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T11:10:30.353 INFO:tasks.ceph.mds.a:Started 2023-10-06T11:10:30.353 DEBUG:teuthology.parallel:result is None 2023-10-06T11:10:30.355 INFO:tasks.ceph.mds.c:Started 2023-10-06T11:10:30.355 DEBUG:teuthology.parallel:result is None 2023-10-06T11:10:30.356 INFO:tasks.ceph.mds.b:Started 2023-10-06T11:10:30.356 DEBUG:teuthology.parallel:result is None 2023-10-06T11:10:30.357 INFO:tasks.ceph.mds.d:Started 2023-10-06T11:10:30.357 DEBUG:teuthology.parallel:result is None 2023-10-06T11:10:30.357 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T11:10:30.426 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2023-10-06T11:10:30.426 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2023-10-06T11:10:30.436 INFO:tasks.ceph.mds.d.smithi151.stdout:starting mds.d at 2023-10-06T11:10:30.436 INFO:tasks.ceph.mds.b.smithi151.stdout:starting mds.b at 2023-10-06T11:10:30.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.477+0000 7fbda34cf700 1 Processor -- start 2023-10-06T11:10:30.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.478+0000 7fbda34cf700 1 -- start start 2023-10-06T11:10:30.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.478+0000 7fbda34cf700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd9c159a90 0x7fbd9c0ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:30.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.478+0000 7fbda34cf700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbd9c0aecd0 0x7fbd9c0af150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:30.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.479+0000 7fbda34cf700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd9c0cb870 con 0x7fbd9c0cdde0 2023-10-06T11:10:30.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.479+0000 7fbda34cf700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd9c0af690 con 0x7fbd9c0aecd0 2023-10-06T11:10:30.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.479+0000 7fbda34cf700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9c0b07d0 con 0x7fbd9c159a90 2023-10-06T11:10:30.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.479+0000 7fbda126b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd9c159a90 0x7fbd9c0ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:30.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.479+0000 7fbda1a6c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbd9c0aecd0 0x7fbd9c0af150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:30.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.479+0000 7fbda0a6a700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fbd9c0cdde0 0x7fbd9c0b00c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:38018/0 (socket says 172.21.15.146:38018) 2023-10-06T11:10:30.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.479+0000 7fbda126b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd9c159a90 0x7fbd9c0ca330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:36180/0 (socket says 172.21.15.146:36180) 2023-10-06T11:10:30.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.479+0000 7fbda1a6c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbd9c0aecd0 0x7fbd9c0af150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:43440/0 (socket says 172.21.15.146:43440) 2023-10-06T11:10:30.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.479+0000 7fbda0a6a700 1 -- 172.21.15.146:0/2053873365 learned_addr learned my addr 172.21.15.146:0/2053873365 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:10:30.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.479+0000 7fbda126b700 1 -- 172.21.15.146:0/2053873365 >> v2:172.21.15.151:3300/0 conn(0x7fbd9c0aecd0 msgr2=0x7fbd9c0af150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:30.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.479+0000 7fbda126b700 1 --2- 172.21.15.146:0/2053873365 >> v2:172.21.15.151:3300/0 conn(0x7fbd9c0aecd0 0x7fbd9c0af150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:30.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.479+0000 7fbda126b700 1 -- 172.21.15.146:0/2053873365 >> v1:172.21.15.151:6789/0 conn(0x7fbd9c0cdde0 legacy=0x7fbd9c0b00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:30.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.479+0000 7fbda126b700 1 -- 172.21.15.146:0/2053873365 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd9c0cac60 con 0x7fbd9c159a90 2023-10-06T11:10:30.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.479+0000 7fbd93fff700 1 -- 172.21.15.146:0/2053873365 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3680949851 0 0) 0x7fbd9c0cb870 con 0x7fbd9c0cdde0 2023-10-06T11:10:30.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.479+0000 7fbda1a6c700 1 --2- 172.21.15.146:0/2053873365 >> v2:172.21.15.151:3300/0 conn(0x7fbd9c0aecd0 0x7fbd9c0af150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:10:30.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.479+0000 7fbda126b700 1 --2- 172.21.15.146:0/2053873365 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd9c159a90 0x7fbd9c0ca330 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbd980098e0 tx=0x7fbd980091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1718cc475db3fc83 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:30.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.479+0000 7fbd93fff700 1 -- 172.21.15.146:0/2053873365 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9800b640 con 0x7fbd9c159a90 2023-10-06T11:10:30.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.479+0000 7fbd93fff700 1 -- 172.21.15.146:0/2053873365 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9800b7a0 con 0x7fbd9c159a90 2023-10-06T11:10:30.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.480+0000 7fbd93fff700 1 -- 172.21.15.146:0/2053873365 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9800bb40 con 0x7fbd9c159a90 2023-10-06T11:10:30.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.480+0000 7fbda34cf700 1 -- 172.21.15.146:0/2053873365 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd9c159a90 msgr2=0x7fbd9c0ca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:30.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.480+0000 7fbda34cf700 1 --2- 172.21.15.146:0/2053873365 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd9c159a90 0x7fbd9c0ca330 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbd980098e0 tx=0x7fbd980091a0 comp rx=0 tx=0).stop 2023-10-06T11:10:30.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.480+0000 7fbda34cf700 1 -- 172.21.15.146:0/2053873365 shutdown_connections 2023-10-06T11:10:30.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.480+0000 7fbda34cf700 1 --2- 172.21.15.146:0/2053873365 >> v2:172.21.15.151:3300/0 conn(0x7fbd9c0aecd0 0x7fbd9c0af150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:30.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.480+0000 7fbda34cf700 1 --2- 172.21.15.146:0/2053873365 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd9c159a90 0x7fbd9c0ca330 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:30.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.480+0000 7fbda34cf700 1 -- 172.21.15.146:0/2053873365 >> 172.21.15.146:0/2053873365 conn(0x7fbd9c068580 msgr2=0x7fbd9c068980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:30.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.480+0000 7fbda34cf700 1 -- 172.21.15.146:0/2053873365 shutdown_connections 2023-10-06T11:10:30.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.480+0000 7fbda34cf700 1 -- 172.21.15.146:0/2053873365 wait complete. 2023-10-06T11:10:30.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.481+0000 7fbda34cf700 1 Processor -- start 2023-10-06T11:10:30.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.481+0000 7fbda34cf700 1 -- start start 2023-10-06T11:10:30.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.482+0000 7fbda34cf700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd9c0aecd0 0x7fbd9c0c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:30.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.482+0000 7fbda34cf700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd9c0cdde0 0x7fbd9c0c2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:30.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.482+0000 7fbda34cf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd9c159a90 0x7fbd9c0c2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:30.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.482+0000 7fbda34cf700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9c16a390 con 0x7fbd9c159a90 2023-10-06T11:10:30.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.482+0000 7fbda34cf700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9c0a6350 con 0x7fbd9c0aecd0 2023-10-06T11:10:30.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.482+0000 7fbda34cf700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9c0c92c0 con 0x7fbd9c0cdde0 2023-10-06T11:10:30.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.482+0000 7fbda1a6c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd9c159a90 0x7fbd9c0c2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:30.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.482+0000 7fbda1a6c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd9c159a90 0x7fbd9c0c2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37678/0 (socket says 172.21.15.146:37678) 2023-10-06T11:10:30.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.482+0000 7fbda1a6c700 1 -- 172.21.15.146:0/3048105705 learned_addr learned my addr 172.21.15.146:0/3048105705 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:30.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.482+0000 7fbda126b700 1 --2- 172.21.15.146:0/3048105705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd9c0aecd0 0x7fbd9c0c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:30.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.482+0000 7fbda0a6a700 1 --2- 172.21.15.146:0/3048105705 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd9c0cdde0 0x7fbd9c0c2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:30.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.482+0000 7fbda1a6c700 1 -- 172.21.15.146:0/3048105705 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd9c0cdde0 msgr2=0x7fbd9c0c2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:30.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.482+0000 7fbda1a6c700 1 --2- 172.21.15.146:0/3048105705 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd9c0cdde0 0x7fbd9c0c2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:30.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.482+0000 7fbda1a6c700 1 -- 172.21.15.146:0/3048105705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd9c0aecd0 msgr2=0x7fbd9c0c8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:30.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.482+0000 7fbda1a6c700 1 --2- 172.21.15.146:0/3048105705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd9c0aecd0 0x7fbd9c0c8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:30.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.483+0000 7fbda1a6c700 1 -- 172.21.15.146:0/3048105705 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd94009a20 con 0x7fbd9c159a90 2023-10-06T11:10:30.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.483+0000 7fbda0a6a700 1 --2- 172.21.15.146:0/3048105705 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd9c0cdde0 0x7fbd9c0c2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:10:30.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.483+0000 7fbda1a6c700 1 --2- 172.21.15.146:0/3048105705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd9c159a90 0x7fbd9c0c2ff0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fbd94009fc0 tx=0x7fbd9400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:30.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.483+0000 7fbd917fa700 1 -- 172.21.15.146:0/3048105705 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9400cd30 con 0x7fbd9c159a90 2023-10-06T11:10:30.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.483+0000 7fbd917fa700 1 -- 172.21.15.146:0/3048105705 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9400f040 con 0x7fbd9c159a90 2023-10-06T11:10:30.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.483+0000 7fbd917fa700 1 -- 172.21.15.146:0/3048105705 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd940146d0 con 0x7fbd9c159a90 2023-10-06T11:10:30.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.483+0000 7fbda34cf700 1 -- 172.21.15.146:0/3048105705 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd98009420 con 0x7fbd9c159a90 2023-10-06T11:10:30.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.483+0000 7fbda34cf700 1 -- 172.21.15.146:0/3048105705 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd9c0c3900 con 0x7fbd9c159a90 2023-10-06T11:10:30.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.484+0000 7fbda34cf700 1 -- 172.21.15.146:0/3048105705 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd9c04c380 con 0x7fbd9c159a90 2023-10-06T11:10:30.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.484+0000 7fbd917fa700 1 -- 172.21.15.146:0/3048105705 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbd94003020 con 0x7fbd9c159a90 2023-10-06T11:10:30.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.484+0000 7fbd917fa700 1 --2- 172.21.15.146:0/3048105705 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbd80066f30 0x7fbd800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:30.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.485+0000 7fbd917fa700 1 -- 172.21.15.146:0/3048105705 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fbd94084ed0 con 0x7fbd9c159a90 2023-10-06T11:10:30.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.485+0000 7fbda126b700 1 --2- 172.21.15.146:0/3048105705 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbd80066f30 0x7fbd800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:30.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.485+0000 7fbda126b700 1 --2- 172.21.15.146:0/3048105705 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbd80066f30 0x7fbd800693e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fbd980093f0 tx=0x7fbd98017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:30.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.489+0000 7fbd917fa700 1 -- 172.21.15.146:0/3048105705 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbd94052230 con 0x7fbd9c159a90 2023-10-06T11:10:30.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:30.688+0000 7fbda34cf700 1 -- 172.21.15.146:0/3048105705 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fbd9c06ece0 con 0x7fbd9c159a90 2023-10-06T11:10:31.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.526+0000 7fbd917fa700 1 -- 172.21.15.146:0/3048105705 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v71) v1 ==== 97+0+0 (secure 0 0 0) 0x7fbd94055850 con 0x7fbd9c159a90 2023-10-06T11:10:31.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.528+0000 7fbda34cf700 1 -- 172.21.15.146:0/3048105705 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbd80066f30 msgr2=0x7fbd800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:31.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.528+0000 7fbda34cf700 1 --2- 172.21.15.146:0/3048105705 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbd80066f30 0x7fbd800693e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fbd980093f0 tx=0x7fbd98017000 comp rx=0 tx=0).stop 2023-10-06T11:10:31.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.528+0000 7fbda34cf700 1 -- 172.21.15.146:0/3048105705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd9c159a90 msgr2=0x7fbd9c0c2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:31.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.528+0000 7fbda34cf700 1 --2- 172.21.15.146:0/3048105705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd9c159a90 0x7fbd9c0c2ff0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fbd94009fc0 tx=0x7fbd9400b040 comp rx=0 tx=0).stop 2023-10-06T11:10:31.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.528+0000 7fbda34cf700 1 -- 172.21.15.146:0/3048105705 shutdown_connections 2023-10-06T11:10:31.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.528+0000 7fbda34cf700 1 --2- 172.21.15.146:0/3048105705 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbd80066f30 0x7fbd800693e0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:31.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.528+0000 7fbda34cf700 1 --2- 172.21.15.146:0/3048105705 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd9c159a90 0x7fbd9c0c2ff0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:31.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.528+0000 7fbda34cf700 1 --2- 172.21.15.146:0/3048105705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd9c0aecd0 0x7fbd9c0c8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:31.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.528+0000 7fbda34cf700 1 --2- 172.21.15.146:0/3048105705 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd9c0cdde0 0x7fbd9c0c2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:31.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.528+0000 7fbda34cf700 1 -- 172.21.15.146:0/3048105705 >> 172.21.15.146:0/3048105705 conn(0x7fbd9c068580 msgr2=0x7fbd9c0adea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:31.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.528+0000 7fbda34cf700 1 -- 172.21.15.146:0/3048105705 shutdown_connections 2023-10-06T11:10:31.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.528+0000 7fbda34cf700 1 -- 172.21.15.146:0/3048105705 wait complete. 2023-10-06T11:10:31.532 INFO:teuthology.orchestra.run.smithi146.stderr: removed all blocklist entries 2023-10-06T11:10:31.543 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T11:10:31.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.656+0000 7f85d83e8700 1 Processor -- start 2023-10-06T11:10:31.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.656+0000 7f85d83e8700 1 -- start start 2023-10-06T11:10:31.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.657+0000 7f85d83e8700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f85d0153ab0 0x7f85d015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:31.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.657+0000 7f85d83e8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85d0153e80 0x7f85d0068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:31.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.657+0000 7f85d83e8700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85d015ac30 con 0x7f85d00689d0 2023-10-06T11:10:31.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.657+0000 7f85d83e8700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85d0068e50 con 0x7f85d0153ab0 2023-10-06T11:10:31.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.657+0000 7f85d83e8700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d00b4510 con 0x7f85d0153e80 2023-10-06T11:10:31.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.658+0000 7f85d5983700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85d0153e80 0x7f85d0068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:31.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.658+0000 7f85d6184700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f85d0153ab0 0x7f85d015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:31.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.658+0000 7f85d5983700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85d0153e80 0x7f85d0068490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:53548/0 (socket says 172.21.15.146:53548) 2023-10-06T11:10:31.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.658+0000 7f85d6985700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f85d00689d0 0x7f85d015d270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:56622/0 (socket says 172.21.15.146:56622) 2023-10-06T11:10:31.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.658+0000 7f85d5983700 1 -- 172.21.15.146:0/435013285 learned_addr learned my addr 172.21.15.146:0/435013285 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:31.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.658+0000 7f85d6184700 1 -- 172.21.15.146:0/435013285 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85d0153e80 msgr2=0x7f85d0068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:31.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.658+0000 7f85d6184700 1 --2- 172.21.15.146:0/435013285 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85d0153e80 0x7f85d0068490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:31.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.658+0000 7f85d6184700 1 -- 172.21.15.146:0/435013285 >> v1:172.21.15.151:6789/0 conn(0x7f85d00689d0 legacy=0x7f85d015d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:31.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.658+0000 7f85d6184700 1 -- 172.21.15.146:0/435013285 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d00b6530 con 0x7f85d0153ab0 2023-10-06T11:10:31.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.658+0000 7f85d5983700 1 --2- 172.21.15.146:0/435013285 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85d0153e80 0x7f85d0068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:10:31.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.658+0000 7f85d6184700 1 --2- 172.21.15.146:0/435013285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85d0153ab0 0x7f85d015a6f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f85cc0098e0 tx=0x7f85cc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2bb03f2751442808 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:31.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.658+0000 7f85d5182700 1 -- 172.21.15.146:0/435013285 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc00b640 con 0x7f85d0153ab0 2023-10-06T11:10:31.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.658+0000 7f85d5182700 1 -- 172.21.15.146:0/435013285 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85cc00b7a0 con 0x7f85d0153ab0 2023-10-06T11:10:31.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.658+0000 7f85d5182700 1 -- 172.21.15.146:0/435013285 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc00bb40 con 0x7f85d0153ab0 2023-10-06T11:10:31.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.659+0000 7f85d83e8700 1 -- 172.21.15.146:0/435013285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85d0153ab0 msgr2=0x7f85d015a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:31.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.659+0000 7f85d83e8700 1 --2- 172.21.15.146:0/435013285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85d0153ab0 0x7f85d015a6f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f85cc0098e0 tx=0x7f85cc0091a0 comp rx=0 tx=0).stop 2023-10-06T11:10:31.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.659+0000 7f85d83e8700 1 -- 172.21.15.146:0/435013285 shutdown_connections 2023-10-06T11:10:31.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.659+0000 7f85d83e8700 1 --2- 172.21.15.146:0/435013285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85d0153ab0 0x7f85d015a6f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:31.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.659+0000 7f85d83e8700 1 --2- 172.21.15.146:0/435013285 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85d0153e80 0x7f85d0068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:31.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.659+0000 7f85d83e8700 1 -- 172.21.15.146:0/435013285 >> 172.21.15.146:0/435013285 conn(0x7f85d006eba0 msgr2=0x7f85d006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:31.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.659+0000 7f85d83e8700 1 -- 172.21.15.146:0/435013285 shutdown_connections 2023-10-06T11:10:31.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.659+0000 7f85d83e8700 1 -- 172.21.15.146:0/435013285 wait complete. 2023-10-06T11:10:31.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.660+0000 7f85d83e8700 1 Processor -- start 2023-10-06T11:10:31.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.660+0000 7f85d83e8700 1 -- start start 2023-10-06T11:10:31.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.661+0000 7f85d83e8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85d00689d0 0x7f85d0169a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:31.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.661+0000 7f85d83e8700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85d0153ab0 0x7f85d01548a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:31.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.661+0000 7f85d83e8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85d0153e80 0x7f85d014ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:31.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.661+0000 7f85d83e8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d0155ce0 con 0x7f85d00689d0 2023-10-06T11:10:31.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.661+0000 7f85d83e8700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d01550d0 con 0x7f85d0153ab0 2023-10-06T11:10:31.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.661+0000 7f85d83e8700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d01553b0 con 0x7f85d0153e80 2023-10-06T11:10:31.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.661+0000 7f85d6184700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85d00689d0 0x7f85d0169a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:31.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.661+0000 7f85d6184700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85d00689d0 0x7f85d0169a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59440/0 (socket says 172.21.15.146:59440) 2023-10-06T11:10:31.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.661+0000 7f85d6184700 1 -- 172.21.15.146:0/2915578356 learned_addr learned my addr 172.21.15.146:0/2915578356 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:31.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.661+0000 7f85d5983700 1 --2- 172.21.15.146:0/2915578356 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85d0153ab0 0x7f85d01548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:31.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.661+0000 7f85d6985700 1 --2- 172.21.15.146:0/2915578356 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85d0153e80 0x7f85d014ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:31.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.661+0000 7f85d6184700 1 -- 172.21.15.146:0/2915578356 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85d0153e80 msgr2=0x7f85d014ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:31.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.661+0000 7f85d6184700 1 --2- 172.21.15.146:0/2915578356 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85d0153e80 0x7f85d014ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:31.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.661+0000 7f85d6184700 1 -- 172.21.15.146:0/2915578356 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85d0153ab0 msgr2=0x7f85d01548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:31.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.661+0000 7f85d6184700 1 --2- 172.21.15.146:0/2915578356 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85d0153ab0 0x7f85d01548a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:31.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.661+0000 7f85d6184700 1 -- 172.21.15.146:0/2915578356 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c00094f0 con 0x7f85d00689d0 2023-10-06T11:10:31.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.661+0000 7f85d6184700 1 --2- 172.21.15.146:0/2915578356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85d00689d0 0x7f85d0169a80 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f85d0089010 tx=0x7f85cc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:31.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.662+0000 7f85c67fc700 1 -- 172.21.15.146:0/2915578356 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc01bc40 con 0x7f85d00689d0 2023-10-06T11:10:31.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.662+0000 7f85c67fc700 1 -- 172.21.15.146:0/2915578356 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85cc01bde0 con 0x7f85d00689d0 2023-10-06T11:10:31.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.662+0000 7f85d83e8700 1 -- 172.21.15.146:0/2915578356 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85cc009420 con 0x7f85d00689d0 2023-10-06T11:10:31.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.662+0000 7f85c67fc700 1 -- 172.21.15.146:0/2915578356 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc011670 con 0x7f85d00689d0 2023-10-06T11:10:31.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.662+0000 7f85d83e8700 1 -- 172.21.15.146:0/2915578356 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85d0155970 con 0x7f85d00689d0 2023-10-06T11:10:31.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.663+0000 7f85d83e8700 1 -- 172.21.15.146:0/2915578356 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85d0155fc0 con 0x7f85d00689d0 2023-10-06T11:10:31.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.663+0000 7f85c67fc700 1 -- 172.21.15.146:0/2915578356 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f85cc0119e0 con 0x7f85d00689d0 2023-10-06T11:10:31.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.663+0000 7f85c67fc700 1 --2- 172.21.15.146:0/2915578356 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f85b4066f30 0x7f85b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:31.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.663+0000 7f85c67fc700 1 -- 172.21.15.146:0/2915578356 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f85cc085910 con 0x7f85d00689d0 2023-10-06T11:10:31.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.663+0000 7f85d5983700 1 --2- 172.21.15.146:0/2915578356 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f85b4066f30 0x7f85b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:31.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.664+0000 7f85d5983700 1 --2- 172.21.15.146:0/2915578356 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f85b4066f30 0x7f85b40693e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f85d01568e0 tx=0x7f85c0009250 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:31.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.668+0000 7f85c67fc700 1 -- 172.21.15.146:0/2915578356 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f85cc052d70 con 0x7f85d00689d0 2023-10-06T11:10:31.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.927+0000 7f85d83e8700 1 -- 172.21.15.146:0/2915578356 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f85d004c380 con 0x7f85d00689d0 2023-10-06T11:10:31.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.927+0000 7f85c67fc700 1 -- 172.21.15.146:0/2915578356 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f85cc056390 con 0x7f85d00689d0 2023-10-06T11:10:31.929 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:10:31.929 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:10:31.929 INFO:teuthology.orchestra.run.smithi146.stdout: "auth_dump": [ 2023-10-06T11:10:31.929 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:10:31.929 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.a", 2023-10-06T11:10:31.929 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lG4F8DBAAp5A4Dtfzvv8n9ORgkmiP9g==", 2023-10-06T11:10:31.930 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:10:31.930 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:10:31.930 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:10:31.930 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:10:31.930 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:10:31.930 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:10:31.930 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:10:31.930 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:10:31.930 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.b", 2023-10-06T11:10:31.930 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lDIceGBAA4cr0oGVaXiy5hrruKY5DGw==", 2023-10-06T11:10:31.930 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:10:31.931 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:10:31.931 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:10:31.931 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:10:31.931 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:10:31.931 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:10:31.931 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:10:31.931 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:10:31.931 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.c", 2023-10-06T11:10:31.931 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lbYA7ExAAAopKjS7+WMUE5fuVQygILQ==", 2023-10-06T11:10:31.931 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:10:31.931 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:10:31.931 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:10:31.931 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:10:31.932 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:10:31.932 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:10:31.932 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:10:31.932 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:10:31.932 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.d", 2023-10-06T11:10:31.932 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9laygiHxAAasUUn7Wk9EwLa36ggsZtHw==", 2023-10-06T11:10:31.932 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:10:31.932 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:10:31.932 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:10:31.932 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:10:31.932 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:10:31.932 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:10:31.933 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:10:31.933 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:10:31.933 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.0", 2023-10-06T11:10:31.933 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDX6R9lLGo9NhAAcWJuUeOdEUsdDw84W9nLPw==", 2023-10-06T11:10:31.933 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:10:31.933 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:10:31.933 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:10:31.933 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:10:31.933 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:10:31.933 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:10:31.933 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:10:31.933 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.1", 2023-10-06T11:10:31.934 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDa6R9lk02gNBAA9YqWT2/Xds20lv0sGtBApg==", 2023-10-06T11:10:31.934 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:10:31.934 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:10:31.934 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:10:31.934 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:10:31.934 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:10:31.934 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:10:31.934 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:10:31.934 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.2", 2023-10-06T11:10:31.934 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDd6R9lrA6xMxAAmH8r6m2p4Jpa82xfYNcq+g==", 2023-10-06T11:10:31.934 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:10:31.934 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:10:31.935 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:10:31.935 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:10:31.935 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:10:31.935 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:10:31.935 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:10:31.935 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.3", 2023-10-06T11:10:31.935 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDg6R9ltlHXNBAAvhfI1yjlaWCIE9Xr/4F/PA==", 2023-10-06T11:10:31.935 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:10:31.935 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:10:31.935 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:10:31.935 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:10:31.935 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:10:31.936 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:10:31.936 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:10:31.936 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.4", 2023-10-06T11:10:31.936 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDm6R9lPUCvMhAAGbUNfpoFi9SvYdelpnL1jA==", 2023-10-06T11:10:31.936 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:10:31.936 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:10:31.936 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:10:31.936 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:10:31.936 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:10:31.936 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:10:31.936 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:10:31.936 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.5", 2023-10-06T11:10:31.937 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDp6R9lMfrMMBAAUEtnXDNr7+L3dQm4QE9qDw==", 2023-10-06T11:10:31.937 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:10:31.937 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:10:31.937 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:10:31.937 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:10:31.937 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:10:31.937 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:10:31.937 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:10:31.937 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.6", 2023-10-06T11:10:31.937 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDs6R9lAmSDMBAArPp+6dVt/NyH9is46tL49g==", 2023-10-06T11:10:31.937 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:10:31.938 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:10:31.938 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:10:31.938 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:10:31.938 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:10:31.938 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:10:31.938 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:10:31.938 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.7", 2023-10-06T11:10:31.938 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDv6R9lnunMLRAA3o5ZtAyYDUoXTzjX9H8FCw==", 2023-10-06T11:10:31.938 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:10:31.938 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:10:31.938 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:10:31.938 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:10:31.938 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:10:31.939 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:10:31.939 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:10:31.939 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.0", 2023-10-06T11:10:31.939 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lCrPrIhAARrzj2VxVFkzF5L/ifIAqmw==", 2023-10-06T11:10:31.939 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:10:31.939 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:10:31.939 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow r", 2023-10-06T11:10:31.939 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T11:10:31.939 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:10:31.939 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:10:31.939 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:10:31.939 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.1", 2023-10-06T11:10:31.940 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9l10VSKxAA0HmXejgRRCQ7XpsMB7ljkQ==", 2023-10-06T11:10:31.940 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:10:31.940 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:10:31.940 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2023-10-06T11:10:31.940 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2023-10-06T11:10:31.940 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2023-10-06T11:10:31.940 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:10:31.940 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:10:31.940 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:10:31.940 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.2", 2023-10-06T11:10:31.940 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lpLpJKBAAF/vLDkBg9/VBqMK4pVVIkg==", 2023-10-06T11:10:31.940 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:10:31.940 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:10:31.941 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2023-10-06T11:10:31.941 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2023-10-06T11:10:31.941 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2023-10-06T11:10:31.941 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:10:31.941 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:10:31.941 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:10:31.941 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.3", 2023-10-06T11:10:31.941 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9luMqwMBAA4Y4I9hWTk2IqAzYwVQ13Pw==", 2023-10-06T11:10:31.941 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:10:31.941 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:10:31.942 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2023-10-06T11:10:31.942 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2023-10-06T11:10:31.942 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2023-10-06T11:10:31.942 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:10:31.942 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:10:31.942 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:10:31.942 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.admin", 2023-10-06T11:10:31.942 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDT6R9lSr9qIhAAiNEN9xFWUwFGsB+oUE1cXw==", 2023-10-06T11:10:31.942 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:10:31.942 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2023-10-06T11:10:31.942 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:10:31.943 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:10:31.943 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:10:31.943 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:10:31.943 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:10:31.943 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:10:31.943 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.x", 2023-10-06T11:10:31.943 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9llLpwCRAA4UH9Uqli2de9HIJR2fZ9xg==", 2023-10-06T11:10:31.943 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:10:31.943 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2023-10-06T11:10:31.943 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2023-10-06T11:10:31.943 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:10:31.944 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:10:31.944 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:10:31.944 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:10:31.944 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.y", 2023-10-06T11:10:31.944 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDT6R9l2uQxNxAAVSMhKVzbf2vC4opL7YCLdg==", 2023-10-06T11:10:31.944 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:10:31.944 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2023-10-06T11:10:31.944 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2023-10-06T11:10:31.944 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:10:31.944 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:10:31.944 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:10:31.945 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2023-10-06T11:10:31.945 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:10:31.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.929+0000 7f85d83e8700 1 -- 172.21.15.146:0/2915578356 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f85b4066f30 msgr2=0x7f85b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:31.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.929+0000 7f85d83e8700 1 --2- 172.21.15.146:0/2915578356 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f85b4066f30 0x7f85b40693e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f85d01568e0 tx=0x7f85c0009250 comp rx=0 tx=0).stop 2023-10-06T11:10:31.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.929+0000 7f85d83e8700 1 -- 172.21.15.146:0/2915578356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85d00689d0 msgr2=0x7f85d0169a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:31.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.929+0000 7f85d83e8700 1 --2- 172.21.15.146:0/2915578356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85d00689d0 0x7f85d0169a80 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f85d0089010 tx=0x7f85cc017000 comp rx=0 tx=0).stop 2023-10-06T11:10:31.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.929+0000 7f85d83e8700 1 -- 172.21.15.146:0/2915578356 shutdown_connections 2023-10-06T11:10:31.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.929+0000 7f85d83e8700 1 --2- 172.21.15.146:0/2915578356 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f85b4066f30 0x7f85b40693e0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:31.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.929+0000 7f85d83e8700 1 --2- 172.21.15.146:0/2915578356 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85d0153e80 0x7f85d014ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:31.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.929+0000 7f85d83e8700 1 --2- 172.21.15.146:0/2915578356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85d00689d0 0x7f85d0169a80 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:31.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.929+0000 7f85d83e8700 1 --2- 172.21.15.146:0/2915578356 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85d0153ab0 0x7f85d01548a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:31.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.929+0000 7f85d83e8700 1 -- 172.21.15.146:0/2915578356 >> 172.21.15.146:0/2915578356 conn(0x7f85d006eba0 msgr2=0x7f85d015c740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:31.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.929+0000 7f85d83e8700 1 -- 172.21.15.146:0/2915578356 shutdown_connections 2023-10-06T11:10:31.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:31.929+0000 7f85d83e8700 1 -- 172.21.15.146:0/2915578356 wait complete. 2023-10-06T11:10:31.948 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:10:32.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.061+0000 7fd404a28700 1 Processor -- start 2023-10-06T11:10:32.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.061+0000 7fd404a28700 1 -- start start 2023-10-06T11:10:32.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.062+0000 7fd404a28700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd400068ba0 0x7fd40015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:32.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.062+0000 7fd404a28700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd400153e80 0x7fd4000b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:32.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.062+0000 7fd404a28700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd40015ac30 con 0x7fd400153ab0 2023-10-06T11:10:32.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.062+0000 7fd404a28700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4000b4510 con 0x7fd400153e80 2023-10-06T11:10:32.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.062+0000 7fd404a28700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4000b6530 con 0x7fd400068ba0 2023-10-06T11:10:32.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.062+0000 7fd3fe59c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd400153ab0 0x7fd400068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59432/0 (socket says 172.21.15.146:59432) 2023-10-06T11:10:32.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.062+0000 7fd3fe59c700 1 -- 172.21.15.146:0/1316209927 learned_addr learned my addr 172.21.15.146:0/1316209927 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:10:32.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.062+0000 7fd3fed9d700 1 --2- 172.21.15.146:0/1316209927 >> v2:172.21.15.146:3300/0 conn(0x7fd400153e80 0x7fd4000b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:32.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.063+0000 7fd3f5d9b700 1 --2- 172.21.15.146:0/1316209927 >> v2:172.21.15.151:3300/0 conn(0x7fd400068ba0 0x7fd40015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:32.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.063+0000 7fd3fdd9b700 1 -- 172.21.15.146:0/1316209927 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 541335988 0 0) 0x7fd3f0001110 con 0x7fd400153ab0 2023-10-06T11:10:32.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.063+0000 7fd3fdd9b700 1 -- 172.21.15.146:0/1316209927 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3ec003570 con 0x7fd400153ab0 2023-10-06T11:10:32.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.063+0000 7fd3fed9d700 1 -- 172.21.15.146:0/1316209927 >> v2:172.21.15.151:3300/0 conn(0x7fd400068ba0 msgr2=0x7fd40015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:32.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.063+0000 7fd3fed9d700 1 --2- 172.21.15.146:0/1316209927 >> v2:172.21.15.151:3300/0 conn(0x7fd400068ba0 0x7fd40015a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:32.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.063+0000 7fd3fed9d700 1 -- 172.21.15.146:0/1316209927 >> v1:172.21.15.146:6789/0 conn(0x7fd400153ab0 legacy=0x7fd400068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:32.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.063+0000 7fd3fed9d700 1 -- 172.21.15.146:0/1316209927 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4000b5c50 con 0x7fd400153e80 2023-10-06T11:10:32.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.063+0000 7fd3fed9d700 1 --2- 172.21.15.146:0/1316209927 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd400153e80 0x7fd4000b49a0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fd400089770 tx=0x7fd3f8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2006cd4ebd3dc78 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:32.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.063+0000 7fd3fdd9b700 1 -- 172.21.15.146:0/1316209927 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f800e070 con 0x7fd400153e80 2023-10-06T11:10:32.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.063+0000 7fd3fdd9b700 1 -- 172.21.15.146:0/1316209927 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f800bb60 con 0x7fd400153e80 2023-10-06T11:10:32.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.063+0000 7fd3fdd9b700 1 -- 172.21.15.146:0/1316209927 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f8012430 con 0x7fd400153e80 2023-10-06T11:10:32.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.063+0000 7fd404a28700 1 -- 172.21.15.146:0/1316209927 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd400153e80 msgr2=0x7fd4000b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:32.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.063+0000 7fd404a28700 1 --2- 172.21.15.146:0/1316209927 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd400153e80 0x7fd4000b49a0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fd400089770 tx=0x7fd3f8009780 comp rx=0 tx=0).stop 2023-10-06T11:10:32.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.063+0000 7fd404a28700 1 -- 172.21.15.146:0/1316209927 shutdown_connections 2023-10-06T11:10:32.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.063+0000 7fd404a28700 1 --2- 172.21.15.146:0/1316209927 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd400153e80 0x7fd4000b49a0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:32.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.064+0000 7fd404a28700 1 --2- 172.21.15.146:0/1316209927 >> v2:172.21.15.151:3300/0 conn(0x7fd400068ba0 0x7fd40015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:32.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.064+0000 7fd404a28700 1 -- 172.21.15.146:0/1316209927 >> 172.21.15.146:0/1316209927 conn(0x7fd40006eba0 msgr2=0x7fd40006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:32.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.064+0000 7fd404a28700 1 -- 172.21.15.146:0/1316209927 shutdown_connections 2023-10-06T11:10:32.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.064+0000 7fd404a28700 1 -- 172.21.15.146:0/1316209927 wait complete. 2023-10-06T11:10:32.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.065+0000 7fd404a28700 1 Processor -- start 2023-10-06T11:10:32.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.065+0000 7fd404a28700 1 -- start start 2023-10-06T11:10:32.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.065+0000 7fd404a28700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd400068ba0 0x7fd400144fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:32.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.065+0000 7fd404a28700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd400153ab0 0x7fd400169bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:32.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.065+0000 7fd404a28700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd400153e80 0x7fd40015bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:32.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.066+0000 7fd404a28700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4001547f0 con 0x7fd400153e80 2023-10-06T11:10:32.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.066+0000 7fd404a28700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40016a6f0 con 0x7fd400153ab0 2023-10-06T11:10:32.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.066+0000 7fd404a28700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd40016a9d0 con 0x7fd400068ba0 2023-10-06T11:10:32.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.066+0000 7fd3fed9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd400153e80 0x7fd40015bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:32.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.066+0000 7fd3fed9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd400153e80 0x7fd40015bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59456/0 (socket says 172.21.15.146:59456) 2023-10-06T11:10:32.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.066+0000 7fd3fed9d700 1 -- 172.21.15.146:0/3030277557 learned_addr learned my addr 172.21.15.146:0/3030277557 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:32.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.066+0000 7fd3fe59c700 1 --2- 172.21.15.146:0/3030277557 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd400068ba0 0x7fd400144fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:32.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.066+0000 7fd3f5d9b700 1 --2- 172.21.15.146:0/3030277557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd400153ab0 0x7fd400169bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:32.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.066+0000 7fd3fed9d700 1 -- 172.21.15.146:0/3030277557 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd400068ba0 msgr2=0x7fd400144fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:32.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.066+0000 7fd3fed9d700 1 --2- 172.21.15.146:0/3030277557 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd400068ba0 0x7fd400144fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:32.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.066+0000 7fd3fed9d700 1 -- 172.21.15.146:0/3030277557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd400153ab0 msgr2=0x7fd400169bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:32.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.066+0000 7fd3fed9d700 1 --2- 172.21.15.146:0/3030277557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd400153ab0 0x7fd400169bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:32.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.066+0000 7fd3fed9d700 1 -- 172.21.15.146:0/3030277557 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f8009a20 con 0x7fd400153e80 2023-10-06T11:10:32.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.066+0000 7fd3fed9d700 1 --2- 172.21.15.146:0/3030277557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd400153e80 0x7fd40015bf50 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8009fd0 tx=0x7fd3f8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:32.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.066+0000 7fd3f6ffd700 1 -- 172.21.15.146:0/3030277557 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f8027470 con 0x7fd400153e80 2023-10-06T11:10:32.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.066+0000 7fd3f6ffd700 1 -- 172.21.15.146:0/3030277557 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f80275f0 con 0x7fd400153e80 2023-10-06T11:10:32.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.066+0000 7fd404a28700 1 -- 172.21.15.146:0/3030277557 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd400154480 con 0x7fd400153e80 2023-10-06T11:10:32.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.066+0000 7fd3f6ffd700 1 -- 172.21.15.146:0/3030277557 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f80279b0 con 0x7fd400153e80 2023-10-06T11:10:32.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.066+0000 7fd404a28700 1 -- 172.21.15.146:0/3030277557 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd400158ef0 con 0x7fd400153e80 2023-10-06T11:10:32.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.067+0000 7fd404a28700 1 -- 172.21.15.146:0/3030277557 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd40004c380 con 0x7fd400153e80 2023-10-06T11:10:32.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.068+0000 7fd3f6ffd700 1 -- 172.21.15.146:0/3030277557 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd3f8024070 con 0x7fd400153e80 2023-10-06T11:10:32.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.068+0000 7fd3f6ffd700 1 --2- 172.21.15.146:0/3030277557 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd3e0066f30 0x7fd3e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:32.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.068+0000 7fd3f6ffd700 1 -- 172.21.15.146:0/3030277557 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fd3f8086c10 con 0x7fd400153e80 2023-10-06T11:10:32.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.068+0000 7fd3fe59c700 1 --2- 172.21.15.146:0/3030277557 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd3e0066f30 0x7fd3e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:32.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.068+0000 7fd3fe59c700 1 --2- 172.21.15.146:0/3030277557 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd3e0066f30 0x7fd3e00693e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0001270 tx=0x7fd3f0007bf0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:32.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.072+0000 7fd3f6ffd700 1 -- 172.21.15.146:0/3030277557 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd3f8054070 con 0x7fd400153e80 2023-10-06T11:10:32.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.257+0000 7fd404a28700 1 -- 172.21.15.146:0/3030277557 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4000b6250 con 0x7fd400153e80 2023-10-06T11:10:32.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.258+0000 7fd3f6ffd700 1 -- 172.21.15.146:0/3030277557 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+13699 (secure 0 0 0) 0x7fd3f8057690 con 0x7fd400153e80 2023-10-06T11:10:32.260 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:10:32.260 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":71,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:10:31.521781+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:10:32.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.260+0000 7fd404a28700 1 -- 172.21.15.146:0/3030277557 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd3e0066f30 msgr2=0x7fd3e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:32.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.260+0000 7fd404a28700 1 --2- 172.21.15.146:0/3030277557 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd3e0066f30 0x7fd3e00693e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0001270 tx=0x7fd3f0007bf0 comp rx=0 tx=0).stop 2023-10-06T11:10:32.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.260+0000 7fd404a28700 1 -- 172.21.15.146:0/3030277557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd400153e80 msgr2=0x7fd40015bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:32.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.260+0000 7fd404a28700 1 --2- 172.21.15.146:0/3030277557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd400153e80 0x7fd40015bf50 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8009fd0 tx=0x7fd3f8019000 comp rx=0 tx=0).stop 2023-10-06T11:10:32.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.260+0000 7fd404a28700 1 -- 172.21.15.146:0/3030277557 shutdown_connections 2023-10-06T11:10:32.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.260+0000 7fd404a28700 1 --2- 172.21.15.146:0/3030277557 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd3e0066f30 0x7fd3e00693e0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:32.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.260+0000 7fd404a28700 1 --2- 172.21.15.146:0/3030277557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd400153e80 0x7fd40015bf50 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:32.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.260+0000 7fd404a28700 1 --2- 172.21.15.146:0/3030277557 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd400068ba0 0x7fd400144fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:32.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.260+0000 7fd404a28700 1 --2- 172.21.15.146:0/3030277557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd400153ab0 0x7fd400169bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:32.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.260+0000 7fd404a28700 1 -- 172.21.15.146:0/3030277557 >> 172.21.15.146:0/3030277557 conn(0x7fd40006eba0 msgr2=0x7fd40015afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:32.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.260+0000 7fd404a28700 1 -- 172.21.15.146:0/3030277557 shutdown_connections 2023-10-06T11:10:32.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.260+0000 7fd404a28700 1 -- 172.21.15.146:0/3030277557 wait complete. 2023-10-06T11:10:32.274 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:05:36.687307+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:05:37.171199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T11:10:32.275 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:10:32.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.391+0000 7f88ab3a3700 1 Processor -- start 2023-10-06T11:10:32.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.392+0000 7f88ab3a3700 1 -- start start 2023-10-06T11:10:32.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.392+0000 7f88ab3a3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88a415a160 0x7f88a40c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:32.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.392+0000 7f88ab3a3700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f88a40ae730 0x7f88a40aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:32.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.392+0000 7f88ab3a3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f88a40ce3d0 0x7f88a40ce830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:32.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.392+0000 7f88ab3a3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88a40ae2a0 con 0x7f88a40ce3d0 2023-10-06T11:10:32.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.392+0000 7f88ab3a3700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88a415a530 con 0x7f88a40ae730 2023-10-06T11:10:32.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.392+0000 7f88ab3a3700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a40ad690 con 0x7f88a415a160 2023-10-06T11:10:32.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.393+0000 7f88a9940700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f88a40ce3d0 0x7f88a40ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:32.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.393+0000 7f88a9940700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f88a40ce3d0 0x7f88a40ce830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59464/0 (socket says 172.21.15.146:59464) 2023-10-06T11:10:32.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.393+0000 7f88a9940700 1 -- 172.21.15.146:0/269727456 learned_addr learned my addr 172.21.15.146:0/269727456 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:32.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.393+0000 7f88a893e700 1 --2- 172.21.15.146:0/269727456 >> v2:172.21.15.151:3300/0 conn(0x7f88a40ae730 0x7f88a40aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:32.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.393+0000 7f88a913f700 1 --2- 172.21.15.146:0/269727456 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88a415a160 0x7f88a40c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:32.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.393+0000 7f88a9940700 1 -- 172.21.15.146:0/269727456 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88a415a160 msgr2=0x7f88a40c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:32.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.393+0000 7f88a9940700 1 --2- 172.21.15.146:0/269727456 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88a415a160 0x7f88a40c55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:32.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.393+0000 7f88a9940700 1 -- 172.21.15.146:0/269727456 >> v2:172.21.15.151:3300/0 conn(0x7f88a40ae730 msgr2=0x7f88a40aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:32.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.393+0000 7f88a9940700 1 --2- 172.21.15.146:0/269727456 >> v2:172.21.15.151:3300/0 conn(0x7f88a40ae730 0x7f88a40aeb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:32.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.393+0000 7f88a9940700 1 -- 172.21.15.146:0/269727456 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a40ad970 con 0x7f88a40ce3d0 2023-10-06T11:10:32.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.393+0000 7f88a9940700 1 --2- 172.21.15.146:0/269727456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88a40ce3d0 0x7f88a40ce830 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f88a4088a00 tx=0x7f889c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=859e111e0275a146 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:32.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.393+0000 7f889bfff700 1 -- 172.21.15.146:0/269727456 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889c00e070 con 0x7f88a40ce3d0 2023-10-06T11:10:32.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.393+0000 7f889bfff700 1 -- 172.21.15.146:0/269727456 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f889c00ba50 con 0x7f88a40ce3d0 2023-10-06T11:10:32.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.393+0000 7f889bfff700 1 -- 172.21.15.146:0/269727456 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889c0092e0 con 0x7f88a40ce3d0 2023-10-06T11:10:32.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.394+0000 7f88ab3a3700 1 -- 172.21.15.146:0/269727456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88a40ce3d0 msgr2=0x7f88a40ce830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:32.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.394+0000 7f88ab3a3700 1 --2- 172.21.15.146:0/269727456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88a40ce3d0 0x7f88a40ce830 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f88a4088a00 tx=0x7f889c009840 comp rx=0 tx=0).stop 2023-10-06T11:10:32.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.394+0000 7f88ab3a3700 1 -- 172.21.15.146:0/269727456 shutdown_connections 2023-10-06T11:10:32.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.394+0000 7f88ab3a3700 1 --2- 172.21.15.146:0/269727456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88a40ce3d0 0x7f88a40ce830 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:32.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.394+0000 7f88ab3a3700 1 --2- 172.21.15.146:0/269727456 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88a415a160 0x7f88a40c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:32.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.394+0000 7f88ab3a3700 1 --2- 172.21.15.146:0/269727456 >> v2:172.21.15.151:3300/0 conn(0x7f88a40ae730 0x7f88a40aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:32.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.394+0000 7f88ab3a3700 1 -- 172.21.15.146:0/269727456 >> 172.21.15.146:0/269727456 conn(0x7f88a406f380 msgr2=0x7f88a40d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:32.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.394+0000 7f88ab3a3700 1 -- 172.21.15.146:0/269727456 shutdown_connections 2023-10-06T11:10:32.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.394+0000 7f88ab3a3700 1 -- 172.21.15.146:0/269727456 wait complete. 2023-10-06T11:10:32.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.395+0000 7f88ab3a3700 1 Processor -- start 2023-10-06T11:10:32.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.395+0000 7f88ab3a3700 1 -- start start 2023-10-06T11:10:32.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.396+0000 7f88ab3a3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88a40ae730 0x7f88a41594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:32.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.396+0000 7f88ab3a3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88a40ce3d0 0x7f88a4155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:32.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.396+0000 7f88ab3a3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88a415a160 0x7f88a415fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:32.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.396+0000 7f88ab3a3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a4155890 con 0x7f88a415a160 2023-10-06T11:10:32.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.396+0000 7f88ab3a3700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a41567c0 con 0x7f88a40ce3d0 2023-10-06T11:10:32.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.396+0000 7f88ab3a3700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a4154c80 con 0x7f88a40ae730 2023-10-06T11:10:32.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.396+0000 7f88a9940700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88a415a160 0x7f88a415fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:32.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.396+0000 7f88a9940700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88a415a160 0x7f88a415fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59466/0 (socket says 172.21.15.146:59466) 2023-10-06T11:10:32.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.396+0000 7f88a9940700 1 -- 172.21.15.146:0/3162937317 learned_addr learned my addr 172.21.15.146:0/3162937317 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:32.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.396+0000 7f88a913f700 1 --2- 172.21.15.146:0/3162937317 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88a40ae730 0x7f88a41594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:32.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.396+0000 7f88a893e700 1 --2- 172.21.15.146:0/3162937317 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88a40ce3d0 0x7f88a4155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:32.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.396+0000 7f88a9940700 1 -- 172.21.15.146:0/3162937317 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88a40ae730 msgr2=0x7f88a41594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:32.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.396+0000 7f88a9940700 1 --2- 172.21.15.146:0/3162937317 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88a40ae730 0x7f88a41594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:32.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.396+0000 7f88a9940700 1 -- 172.21.15.146:0/3162937317 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88a40ce3d0 msgr2=0x7f88a4155d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:32.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.396+0000 7f88a9940700 1 --2- 172.21.15.146:0/3162937317 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88a40ce3d0 0x7f88a4155d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:32.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.396+0000 7f88a9940700 1 -- 172.21.15.146:0/3162937317 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f889c009ae0 con 0x7f88a415a160 2023-10-06T11:10:32.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.396+0000 7f88a9940700 1 --2- 172.21.15.146:0/3162937317 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88a415a160 0x7f88a415fba0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f88a4088c60 tx=0x7f889c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:32.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.397+0000 7f88997fa700 1 -- 172.21.15.146:0/3162937317 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889c0032f0 con 0x7f88a415a160 2023-10-06T11:10:32.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.397+0000 7f88997fa700 1 -- 172.21.15.146:0/3162937317 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f889c008d20 con 0x7f88a415a160 2023-10-06T11:10:32.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.397+0000 7f88ab3a3700 1 -- 172.21.15.146:0/3162937317 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88a4154f60 con 0x7f88a415a160 2023-10-06T11:10:32.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.397+0000 7f88997fa700 1 -- 172.21.15.146:0/3162937317 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889c026690 con 0x7f88a415a160 2023-10-06T11:10:32.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.397+0000 7f88ab3a3700 1 -- 172.21.15.146:0/3162937317 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88a4155520 con 0x7f88a415a160 2023-10-06T11:10:32.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.397+0000 7f88ab3a3700 1 -- 172.21.15.146:0/3162937317 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88a4068390 con 0x7f88a415a160 2023-10-06T11:10:32.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.398+0000 7f88997fa700 1 -- 172.21.15.146:0/3162937317 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f889c003040 con 0x7f88a415a160 2023-10-06T11:10:32.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.398+0000 7f88997fa700 1 --2- 172.21.15.146:0/3162937317 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8888066f30 0x7f88880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:32.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.399+0000 7f88997fa700 1 -- 172.21.15.146:0/3162937317 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f889c085d60 con 0x7f88a415a160 2023-10-06T11:10:32.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.399+0000 7f88a913f700 1 --2- 172.21.15.146:0/3162937317 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8888066f30 0x7f88880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:32.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.399+0000 7f88a913f700 1 --2- 172.21.15.146:0/3162937317 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8888066f30 0x7f88880693e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f88a0006fd0 tx=0x7f88a0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:32.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.403+0000 7f88997fa700 1 -- 172.21.15.146:0/3162937317 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f889c053270 con 0x7f88a415a160 2023-10-06T11:10:32.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.586+0000 7f88ab3a3700 1 -- 172.21.15.146:0/3162937317 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f88a404c380 con 0x7f88a415a160 2023-10-06T11:10:32.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.586+0000 7f88997fa700 1 -- 172.21.15.146:0/3162937317 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v71) v1 ==== 92+0+10 (secure 0 0 0) 0x7f889c0210a0 con 0x7f88a415a160 2023-10-06T11:10:32.588 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-10-06T11:10:32.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.588+0000 7f88ab3a3700 1 -- 172.21.15.146:0/3162937317 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8888066f30 msgr2=0x7f88880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:32.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.588+0000 7f88ab3a3700 1 --2- 172.21.15.146:0/3162937317 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8888066f30 0x7f88880693e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f88a0006fd0 tx=0x7f88a0008040 comp rx=0 tx=0).stop 2023-10-06T11:10:32.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.588+0000 7f88ab3a3700 1 -- 172.21.15.146:0/3162937317 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88a415a160 msgr2=0x7f88a415fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:32.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.588+0000 7f88ab3a3700 1 --2- 172.21.15.146:0/3162937317 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88a415a160 0x7f88a415fba0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f88a4088c60 tx=0x7f889c018000 comp rx=0 tx=0).stop 2023-10-06T11:10:32.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.588+0000 7f88ab3a3700 1 -- 172.21.15.146:0/3162937317 shutdown_connections 2023-10-06T11:10:32.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.588+0000 7f88ab3a3700 1 --2- 172.21.15.146:0/3162937317 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8888066f30 0x7f88880693e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:32.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.588+0000 7f88ab3a3700 1 --2- 172.21.15.146:0/3162937317 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f88a415a160 0x7f88a415fba0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:32.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.588+0000 7f88ab3a3700 1 --2- 172.21.15.146:0/3162937317 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88a40ae730 0x7f88a41594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:32.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.588+0000 7f88ab3a3700 1 --2- 172.21.15.146:0/3162937317 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88a40ce3d0 0x7f88a4155d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:32.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.588+0000 7f88ab3a3700 1 -- 172.21.15.146:0/3162937317 >> 172.21.15.146:0/3162937317 conn(0x7f88a406f380 msgr2=0x7f88a40ccdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:32.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.588+0000 7f88ab3a3700 1 -- 172.21.15.146:0/3162937317 shutdown_connections 2023-10-06T11:10:32.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.588+0000 7f88ab3a3700 1 -- 172.21.15.146:0/3162937317 wait complete. 2023-10-06T11:10:32.602 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:10:32.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.718+0000 7f6930de7700 1 Processor -- start 2023-10-06T11:10:32.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.718+0000 7f6930de7700 1 -- start start 2023-10-06T11:10:32.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.719+0000 7f6930de7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f692c0ceb50 0x7f692c0af5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:32.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.719+0000 7f6930de7700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f692c0ae550 con 0x7f692c0ac3b0 2023-10-06T11:10:32.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.719+0000 7f6930de7700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f692c0ae830 con 0x7f692c0abfe0 2023-10-06T11:10:32.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.719+0000 7f6930de7700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f692c0aeb10 con 0x7f692c0ceb50 2023-10-06T11:10:32.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.719+0000 7f6921d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f692c0ceb50 0x7f692c0af5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:32.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.719+0000 7f692ad9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f692c0ac3b0 0x7f692c0ac810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59446/0 (socket says 172.21.15.146:59446) 2023-10-06T11:10:32.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.719+0000 7f692ad9d700 1 -- 172.21.15.146:0/3241927496 learned_addr learned my addr 172.21.15.146:0/3241927496 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:10:32.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.720+0000 7f6921d9b700 1 -- 172.21.15.146:0/3241927496 >> v1:172.21.15.151:6789/0 conn(0x7f692c0abfe0 legacy=0x7f692c0add00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:32.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.720+0000 7f6921d9b700 1 -- 172.21.15.146:0/3241927496 >> v1:172.21.15.146:6789/0 conn(0x7f692c0ac3b0 legacy=0x7f692c0ac810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:32.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.720+0000 7f6921d9b700 1 -- 172.21.15.146:0/3241927496 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f692c0aedf0 con 0x7f692c0ceb50 2023-10-06T11:10:32.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.720+0000 7f6929d9b700 1 -- 172.21.15.146:0/3241927496 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2224742785 0 0) 0x7f692c0ae550 con 0x7f692c0ac3b0 2023-10-06T11:10:32.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.720+0000 7f6921d9b700 1 --2- 172.21.15.146:0/3241927496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f692c0ceb50 0x7f692c0af5f0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f69140098e0 tx=0x7f69140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74bf24fb0f2ee18d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:32.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.720+0000 7f6929d9b700 1 -- 172.21.15.146:0/3241927496 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6914009e80 con 0x7f692c0ceb50 2023-10-06T11:10:32.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.720+0000 7f6929d9b700 1 -- 172.21.15.146:0/3241927496 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691400b860 con 0x7f692c0ceb50 2023-10-06T11:10:32.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.720+0000 7f6929d9b700 1 -- 172.21.15.146:0/3241927496 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691400bbe0 con 0x7f692c0ceb50 2023-10-06T11:10:32.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.720+0000 7f6930de7700 1 -- 172.21.15.146:0/3241927496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f692c0ceb50 msgr2=0x7f692c0af5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:32.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.720+0000 7f6930de7700 1 --2- 172.21.15.146:0/3241927496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f692c0ceb50 0x7f692c0af5f0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f69140098e0 tx=0x7f69140091a0 comp rx=0 tx=0).stop 2023-10-06T11:10:32.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.720+0000 7f6930de7700 1 -- 172.21.15.146:0/3241927496 shutdown_connections 2023-10-06T11:10:32.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.720+0000 7f6930de7700 1 --2- 172.21.15.146:0/3241927496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f692c0ceb50 0x7f692c0af5f0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:32.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.720+0000 7f6930de7700 1 -- 172.21.15.146:0/3241927496 >> 172.21.15.146:0/3241927496 conn(0x7f692c067c50 msgr2=0x7f692c0ce440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:32.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.721+0000 7f6930de7700 1 -- 172.21.15.146:0/3241927496 shutdown_connections 2023-10-06T11:10:32.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.721+0000 7f6930de7700 1 -- 172.21.15.146:0/3241927496 wait complete. 2023-10-06T11:10:32.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.722+0000 7f6930de7700 1 Processor -- start 2023-10-06T11:10:32.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.722+0000 7f6930de7700 1 -- start start 2023-10-06T11:10:32.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.723+0000 7f6930de7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f692c0abfe0 0x7f692c14ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:32.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.723+0000 7f6930de7700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f692c0ac3b0 0x7f692c158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:32.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.723+0000 7f6930de7700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f692c0ceb50 0x7f692c0695b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:32.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.723+0000 7f6930de7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692c15a4c0 con 0x7f692c0abfe0 2023-10-06T11:10:32.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.723+0000 7f6930de7700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692c0b1a20 con 0x7f692c0ac3b0 2023-10-06T11:10:32.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.723+0000 7f6930de7700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f692c1590a0 con 0x7f692c0ceb50 2023-10-06T11:10:32.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.723+0000 7f692a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f692c0abfe0 0x7f692c14ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:32.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.723+0000 7f692a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f692c0abfe0 0x7f692c14ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59492/0 (socket says 172.21.15.146:59492) 2023-10-06T11:10:32.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.723+0000 7f692a59c700 1 -- 172.21.15.146:0/1774340778 learned_addr learned my addr 172.21.15.146:0/1774340778 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:32.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.723+0000 7f6921d9b700 1 --2- 172.21.15.146:0/1774340778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f692c0ac3b0 0x7f692c158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:32.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.723+0000 7f692ad9d700 1 --2- 172.21.15.146:0/1774340778 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f692c0ceb50 0x7f692c0695b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:32.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.723+0000 7f692a59c700 1 -- 172.21.15.146:0/1774340778 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f692c0ceb50 msgr2=0x7f692c0695b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:32.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.723+0000 7f692a59c700 1 --2- 172.21.15.146:0/1774340778 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f692c0ceb50 0x7f692c0695b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:32.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.723+0000 7f692a59c700 1 -- 172.21.15.146:0/1774340778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f692c0ac3b0 msgr2=0x7f692c158600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:32.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.723+0000 7f692a59c700 1 --2- 172.21.15.146:0/1774340778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f692c0ac3b0 0x7f692c158600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:32.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.723+0000 7f692a59c700 1 -- 172.21.15.146:0/1774340778 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6914009420 con 0x7f692c0abfe0 2023-10-06T11:10:32.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.723+0000 7f6921d9b700 1 --2- 172.21.15.146:0/1774340778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f692c0ac3b0 0x7f692c158600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:10:32.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.723+0000 7f692a59c700 1 --2- 172.21.15.146:0/1774340778 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f692c0abfe0 0x7f692c14ef50 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f691c00c590 tx=0x7f691c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:32.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.723+0000 7f6922ffd700 1 -- 172.21.15.146:0/1774340778 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c011590 con 0x7f692c0abfe0 2023-10-06T11:10:32.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.723+0000 7f6922ffd700 1 -- 172.21.15.146:0/1774340778 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691c0116f0 con 0x7f692c0abfe0 2023-10-06T11:10:32.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.723+0000 7f6930de7700 1 -- 172.21.15.146:0/1774340778 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f692c159380 con 0x7f692c0abfe0 2023-10-06T11:10:32.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.723+0000 7f6922ffd700 1 -- 172.21.15.146:0/1774340778 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c011ab0 con 0x7f692c0abfe0 2023-10-06T11:10:32.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.723+0000 7f6930de7700 1 -- 172.21.15.146:0/1774340778 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f692c0cdf10 con 0x7f692c0abfe0 2023-10-06T11:10:32.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.724+0000 7f6930de7700 1 -- 172.21.15.146:0/1774340778 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f692c0b1510 con 0x7f692c0abfe0 2023-10-06T11:10:32.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.725+0000 7f6922ffd700 1 -- 172.21.15.146:0/1774340778 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f691c01b3b0 con 0x7f692c0abfe0 2023-10-06T11:10:32.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.725+0000 7f6922ffd700 1 --2- 172.21.15.146:0/1774340778 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f690c066f30 0x7f690c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:32.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.725+0000 7f6922ffd700 1 -- 172.21.15.146:0/1774340778 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f691c083890 con 0x7f692c0abfe0 2023-10-06T11:10:32.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.725+0000 7f6921d9b700 1 --2- 172.21.15.146:0/1774340778 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f690c066f30 0x7f690c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:32.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.726+0000 7f6921d9b700 1 --2- 172.21.15.146:0/1774340778 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f690c066f30 0x7f690c0693e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f69140093f0 tx=0x7f6914017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:32.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.729+0000 7f6922ffd700 1 -- 172.21.15.146:0/1774340778 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f692c0b1510 con 0x7f692c0abfe0 2023-10-06T11:10:32.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.914+0000 7f6930de7700 1 -- 172.21.15.146:0/1774340778 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f692c0b1510 con 0x7f692c0abfe0 2023-10-06T11:10:32.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.915+0000 7f6922ffd700 1 -- 172.21.15.146:0/1774340778 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v71) v1 ==== 93+0+10 (secure 0 0 0) 0x7f692c0b1510 con 0x7f692c0abfe0 2023-10-06T11:10:32.917 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-10-06T11:10:32.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.917+0000 7f6930de7700 1 -- 172.21.15.146:0/1774340778 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f690c066f30 msgr2=0x7f690c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:32.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.917+0000 7f6930de7700 1 --2- 172.21.15.146:0/1774340778 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f690c066f30 0x7f690c0693e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f69140093f0 tx=0x7f6914017000 comp rx=0 tx=0).stop 2023-10-06T11:10:32.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.917+0000 7f6930de7700 1 -- 172.21.15.146:0/1774340778 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f692c0abfe0 msgr2=0x7f692c14ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:32.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.917+0000 7f6930de7700 1 --2- 172.21.15.146:0/1774340778 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f692c0abfe0 0x7f692c14ef50 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f691c00c590 tx=0x7f691c00c950 comp rx=0 tx=0).stop 2023-10-06T11:10:32.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.917+0000 7f6930de7700 1 -- 172.21.15.146:0/1774340778 shutdown_connections 2023-10-06T11:10:32.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.917+0000 7f6930de7700 1 --2- 172.21.15.146:0/1774340778 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f690c066f30 0x7f690c0693e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:32.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.917+0000 7f6930de7700 1 --2- 172.21.15.146:0/1774340778 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f692c0ceb50 0x7f692c0695b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:32.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.917+0000 7f6930de7700 1 --2- 172.21.15.146:0/1774340778 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f692c0abfe0 0x7f692c14ef50 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:32.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.917+0000 7f6930de7700 1 --2- 172.21.15.146:0/1774340778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f692c0ac3b0 0x7f692c158600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:32.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.917+0000 7f6930de7700 1 -- 172.21.15.146:0/1774340778 >> 172.21.15.146:0/1774340778 conn(0x7f692c067c50 msgr2=0x7f692c151140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:32.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.918+0000 7f6930de7700 1 -- 172.21.15.146:0/1774340778 shutdown_connections 2023-10-06T11:10:32.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:32.918+0000 7f6930de7700 1 -- 172.21.15.146:0/1774340778 wait complete. 2023-10-06T11:10:32.932 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T11:10:33.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.045+0000 7f74e9173700 1 Processor -- start 2023-10-06T11:10:33.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.045+0000 7f74e9173700 1 -- start start 2023-10-06T11:10:33.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.046+0000 7f74e9173700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f74e40b2530 0x7f74e415cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:33.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.046+0000 7f74e9173700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74e415c630 con 0x7f74e415a7f0 2023-10-06T11:10:33.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.046+0000 7f74e9173700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74e415ba20 con 0x7f74e415a420 2023-10-06T11:10:33.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.046+0000 7f74e9173700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74e40ce040 con 0x7f74e40b2530 2023-10-06T11:10:33.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.046+0000 7f74e37fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f74e415a7f0 0x7f74e415acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59452/0 (socket says 172.21.15.146:59452) 2023-10-06T11:10:33.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.046+0000 7f74e37fe700 1 -- 172.21.15.146:0/1928838895 learned_addr learned my addr 172.21.15.146:0/1928838895 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:10:33.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.046+0000 7f74e2ffd700 1 -- 172.21.15.146:0/1928838895 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3812225108 0 0) 0x7f74e415c630 con 0x7f74e415a7f0 2023-10-06T11:10:33.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.046+0000 7f74e2ffd700 1 -- 172.21.15.146:0/1928838895 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74cc003570 con 0x7f74e415a7f0 2023-10-06T11:10:33.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.046+0000 7f74e8972700 1 --2- 172.21.15.146:0/1928838895 >> v2:172.21.15.151:3300/0 conn(0x7f74e40b2530 0x7f74e415cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:33.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.047+0000 7f74e2ffd700 1 -- 172.21.15.146:0/1928838895 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2263592592 0 0) 0x7f74cc003570 con 0x7f74e415a7f0 2023-10-06T11:10:33.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.047+0000 7f74e2ffd700 1 -- 172.21.15.146:0/1928838895 >> v2:172.21.15.151:3300/0 conn(0x7f74e40b2530 msgr2=0x7f74e415cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:33.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.047+0000 7f74e2ffd700 1 --2- 172.21.15.146:0/1928838895 >> v2:172.21.15.151:3300/0 conn(0x7f74e40b2530 0x7f74e415cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:33.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.047+0000 7f74e2ffd700 1 -- 172.21.15.146:0/1928838895 >> v1:172.21.15.151:6789/0 conn(0x7f74e415a420 legacy=0x7f74e40b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:33.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.047+0000 7f74e2ffd700 1 -- 172.21.15.146:0/1928838895 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e415bd00 con 0x7f74e415a7f0 2023-10-06T11:10:33.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.047+0000 7f74e2ffd700 1 -- 172.21.15.146:0/1928838895 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f74d8001470 con 0x7f74e415a7f0 2023-10-06T11:10:33.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.047+0000 7f74e2ffd700 1 -- 172.21.15.146:0/1928838895 >> v1:172.21.15.146:6789/0 conn(0x7f74e415a7f0 legacy=0x7f74e415acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:33.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.047+0000 7f74e2ffd700 1 --2- 172.21.15.146:0/1928838895 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74cc003a60 0x7f74cc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:33.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.047+0000 7f74e2ffd700 1 --2- 172.21.15.146:0/1928838895 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74cc004810 0x7f74cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:33.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.047+0000 7f74e2ffd700 1 --2- 172.21.15.146:0/1928838895 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74cc0051c0 0x7f74cc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:33.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.047+0000 7f74e2ffd700 1 -- 172.21.15.146:0/1928838895 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc00c0a0 con 0x7f74cc004810 2023-10-06T11:10:33.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.047+0000 7f74e2ffd700 1 -- 172.21.15.146:0/1928838895 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc00c210 con 0x7f74cc003a60 2023-10-06T11:10:33.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.047+0000 7f74e2ffd700 1 -- 172.21.15.146:0/1928838895 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74cc00c3d0 con 0x7f74cc0051c0 2023-10-06T11:10:33.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.047+0000 7f74e37fe700 1 --2- 172.21.15.146:0/1928838895 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74cc004810 0x7f74cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:33.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.047+0000 7f74e3fff700 1 --2- 172.21.15.146:0/1928838895 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74cc003a60 0x7f74cc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:33.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.047+0000 7f74e8972700 1 --2- 172.21.15.146:0/1928838895 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74cc0051c0 0x7f74cc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:33.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.047+0000 7f74e37fe700 1 -- 172.21.15.146:0/1928838895 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74cc0051c0 msgr2=0x7f74cc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:33.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.047+0000 7f74e37fe700 1 --2- 172.21.15.146:0/1928838895 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74cc0051c0 0x7f74cc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:33.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.047+0000 7f74e37fe700 1 -- 172.21.15.146:0/1928838895 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74cc003a60 msgr2=0x7f74cc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:33.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.047+0000 7f74e37fe700 1 --2- 172.21.15.146:0/1928838895 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74cc003a60 0x7f74cc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:33.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.047+0000 7f74e37fe700 1 -- 172.21.15.146:0/1928838895 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74cc003570 con 0x7f74cc004810 2023-10-06T11:10:33.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.047+0000 7f74e8972700 1 --2- 172.21.15.146:0/1928838895 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74cc0051c0 0x7f74cc00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:10:33.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.047+0000 7f74e8972700 1 -- 172.21.15.146:0/1928838895 reap_dead start 2023-10-06T11:10:33.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.047+0000 7f74e37fe700 1 --2- 172.21.15.146:0/1928838895 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74cc004810 0x7f74cc004c80 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f74d800c3c0 tx=0x7f74d8001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba05da14444c536e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:33.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.047+0000 7f74e2ffd700 1 -- 172.21.15.146:0/1928838895 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d800cc90 con 0x7f74cc004810 2023-10-06T11:10:33.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.047+0000 7f74e2ffd700 1 -- 172.21.15.146:0/1928838895 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d800cdf0 con 0x7f74cc004810 2023-10-06T11:10:33.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.047+0000 7f74e2ffd700 1 -- 172.21.15.146:0/1928838895 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d8005b50 con 0x7f74cc004810 2023-10-06T11:10:33.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.048+0000 7f74e9173700 1 -- 172.21.15.146:0/1928838895 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74cc004810 msgr2=0x7f74cc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:33.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.048+0000 7f74e9173700 1 --2- 172.21.15.146:0/1928838895 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74cc004810 0x7f74cc004c80 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f74d800c3c0 tx=0x7f74d8001e50 comp rx=0 tx=0).stop 2023-10-06T11:10:33.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.048+0000 7f74e9173700 1 -- 172.21.15.146:0/1928838895 shutdown_connections 2023-10-06T11:10:33.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.048+0000 7f74e9173700 1 --2- 172.21.15.146:0/1928838895 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74cc004810 0x7f74cc004c80 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:33.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.048+0000 7f74e9173700 1 -- 172.21.15.146:0/1928838895 >> 172.21.15.146:0/1928838895 conn(0x7f74e406eba0 msgr2=0x7f74e406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:33.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.048+0000 7f74e9173700 1 -- 172.21.15.146:0/1928838895 shutdown_connections 2023-10-06T11:10:33.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.048+0000 7f74e9173700 1 -- 172.21.15.146:0/1928838895 wait complete. 2023-10-06T11:10:33.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.049+0000 7f74e9173700 1 Processor -- start 2023-10-06T11:10:33.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.049+0000 7f74e9173700 1 -- start start 2023-10-06T11:10:33.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.050+0000 7f74e9173700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74cc004810 0x7f74e414f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:33.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.050+0000 7f74e9173700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74e41530b0 0x7f74e4153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:33.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.050+0000 7f74e9173700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74e414d5f0 0x7f74e414da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:33.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.050+0000 7f74e9173700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e4155ba0 con 0x7f74e41530b0 2023-10-06T11:10:33.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.050+0000 7f74e9173700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e414df80 con 0x7f74e414d5f0 2023-10-06T11:10:33.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.050+0000 7f74e9173700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74e4154d40 con 0x7f74cc004810 2023-10-06T11:10:33.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.050+0000 7f74e37fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74e41530b0 0x7f74e4153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:33.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.050+0000 7f74e37fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74e41530b0 0x7f74e4153520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59496/0 (socket says 172.21.15.146:59496) 2023-10-06T11:10:33.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.050+0000 7f74e37fe700 1 -- 172.21.15.146:0/2593250196 learned_addr learned my addr 172.21.15.146:0/2593250196 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:33.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.050+0000 7f74e8972700 1 --2- 172.21.15.146:0/2593250196 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74e414d5f0 0x7f74e414da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:33.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.050+0000 7f74e3fff700 1 --2- 172.21.15.146:0/2593250196 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74cc004810 0x7f74e414f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:33.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.050+0000 7f74e37fe700 1 -- 172.21.15.146:0/2593250196 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74cc004810 msgr2=0x7f74e414f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:33.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.050+0000 7f74e37fe700 1 --2- 172.21.15.146:0/2593250196 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74cc004810 0x7f74e414f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:33.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.050+0000 7f74e37fe700 1 -- 172.21.15.146:0/2593250196 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74e414d5f0 msgr2=0x7f74e414da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:33.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.050+0000 7f74e37fe700 1 --2- 172.21.15.146:0/2593250196 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74e414d5f0 0x7f74e414da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:33.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.050+0000 7f74e37fe700 1 -- 172.21.15.146:0/2593250196 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e4155020 con 0x7f74e41530b0 2023-10-06T11:10:33.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.050+0000 7f74e8972700 1 --2- 172.21.15.146:0/2593250196 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74e414d5f0 0x7f74e414da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:10:33.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.050+0000 7f74e3fff700 1 --2- 172.21.15.146:0/2593250196 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74cc004810 0x7f74e414f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:10:33.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.051+0000 7f74e37fe700 1 --2- 172.21.15.146:0/2593250196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74e41530b0 0x7f74e4153520 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f74d800c9b0 tx=0x7f74d8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:33.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.051+0000 7f74cbfff700 1 -- 172.21.15.146:0/2593250196 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d8022070 con 0x7f74e41530b0 2023-10-06T11:10:33.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.051+0000 7f74cbfff700 1 -- 172.21.15.146:0/2593250196 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d80072e0 con 0x7f74e41530b0 2023-10-06T11:10:33.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.051+0000 7f74e9173700 1 -- 172.21.15.146:0/2593250196 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74e4155300 con 0x7f74e41530b0 2023-10-06T11:10:33.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.051+0000 7f74cbfff700 1 -- 172.21.15.146:0/2593250196 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d800cc90 con 0x7f74e41530b0 2023-10-06T11:10:33.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.051+0000 7f74e9173700 1 -- 172.21.15.146:0/2593250196 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74e41558c0 con 0x7f74e41530b0 2023-10-06T11:10:33.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.052+0000 7f74e9173700 1 -- 172.21.15.146:0/2593250196 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74e40afae0 con 0x7f74e41530b0 2023-10-06T11:10:33.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.052+0000 7f74cbfff700 1 -- 172.21.15.146:0/2593250196 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f74d801e430 con 0x7f74e41530b0 2023-10-06T11:10:33.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.052+0000 7f74cbfff700 1 --2- 172.21.15.146:0/2593250196 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f74d0066f30 0x7f74d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:33.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.052+0000 7f74cbfff700 1 -- 172.21.15.146:0/2593250196 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f74d80858c0 con 0x7f74e41530b0 2023-10-06T11:10:33.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.052+0000 7f74e3fff700 1 --2- 172.21.15.146:0/2593250196 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f74d0066f30 0x7f74d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:33.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.053+0000 7f74e3fff700 1 --2- 172.21.15.146:0/2593250196 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f74d0066f30 0x7f74d00693e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f74d4000c00 tx=0x7f74d4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:33.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.057+0000 7f74cbfff700 1 -- 172.21.15.146:0/2593250196 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f74d8052c80 con 0x7f74e41530b0 2023-10-06T11:10:33.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.242+0000 7f74e9173700 1 -- 172.21.15.146:0/2593250196 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f74e415bfe0 con 0x7f74e41530b0 2023-10-06T11:10:33.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.243+0000 7f74cbfff700 1 -- 172.21.15.146:0/2593250196 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v71) v1 ==== 84+0+126 (secure 0 0 0) 0x7f74d8017020 con 0x7f74e41530b0 2023-10-06T11:10:33.245 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:10:33.245 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2023-10-06T11:10:33.245 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:10:33.245 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 1, 2023-10-06T11:10:33.245 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": "rbd" 2023-10-06T11:10:33.246 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:10:33.246 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:10:33.246 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 2, 2023-10-06T11:10:33.246 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": ".mgr" 2023-10-06T11:10:33.246 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:10:33.246 INFO:teuthology.orchestra.run.smithi146.stdout:] 2023-10-06T11:10:33.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.245+0000 7f74e9173700 1 -- 172.21.15.146:0/2593250196 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f74d0066f30 msgr2=0x7f74d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:33.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.245+0000 7f74e9173700 1 --2- 172.21.15.146:0/2593250196 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f74d0066f30 0x7f74d00693e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f74d4000c00 tx=0x7f74d4009040 comp rx=0 tx=0).stop 2023-10-06T11:10:33.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.245+0000 7f74e9173700 1 -- 172.21.15.146:0/2593250196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74e41530b0 msgr2=0x7f74e4153520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:33.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.245+0000 7f74e9173700 1 --2- 172.21.15.146:0/2593250196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74e41530b0 0x7f74e4153520 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f74d800c9b0 tx=0x7f74d8015000 comp rx=0 tx=0).stop 2023-10-06T11:10:33.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.245+0000 7f74e9173700 1 -- 172.21.15.146:0/2593250196 shutdown_connections 2023-10-06T11:10:33.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.245+0000 7f74e9173700 1 --2- 172.21.15.146:0/2593250196 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f74d0066f30 0x7f74d00693e0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:33.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.245+0000 7f74e9173700 1 --2- 172.21.15.146:0/2593250196 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74e414d5f0 0x7f74e414da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:33.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.245+0000 7f74e9173700 1 --2- 172.21.15.146:0/2593250196 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74cc004810 0x7f74e414f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:33.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.245+0000 7f74e9173700 1 --2- 172.21.15.146:0/2593250196 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74e41530b0 0x7f74e4153520 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:33.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.245+0000 7f74e9173700 1 -- 172.21.15.146:0/2593250196 >> 172.21.15.146:0/2593250196 conn(0x7f74e406eba0 msgr2=0x7f74e415b160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:33.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.245+0000 7f74e9173700 1 -- 172.21.15.146:0/2593250196 shutdown_connections 2023-10-06T11:10:33.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.245+0000 7f74e9173700 1 -- 172.21.15.146:0/2593250196 wait complete. 2023-10-06T11:10:33.259 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T11:10:33.259 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T11:10:33.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.377+0000 7faadedc3700 1 Processor -- start 2023-10-06T11:10:33.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.377+0000 7faadedc3700 1 -- start start 2023-10-06T11:10:33.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.378+0000 7faadedc3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faad815cff0 0x7faad815d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:33.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.378+0000 7faadedc3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faad80cf030 con 0x7faad80d0c50 2023-10-06T11:10:33.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.378+0000 7faadedc3700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faad80ced20 con 0x7faad815cc20 2023-10-06T11:10:33.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.378+0000 7faadedc3700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad815e390 con 0x7faad815cff0 2023-10-06T11:10:33.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.378+0000 7faadd360700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7faad80d0c50 0x7faad815a890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59454/0 (socket says 172.21.15.146:59454) 2023-10-06T11:10:33.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.378+0000 7faadd360700 1 -- 172.21.15.146:0/392125067 learned_addr learned my addr 172.21.15.146:0/392125067 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:10:33.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.379+0000 7faad77fe700 1 -- 172.21.15.146:0/392125067 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1891318958 0 0) 0x7faad80cf030 con 0x7faad80d0c50 2023-10-06T11:10:33.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.379+0000 7faad7fff700 1 --2- 172.21.15.146:0/392125067 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faad815cff0 0x7faad815d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:33.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.379+0000 7faad77fe700 1 -- 172.21.15.146:0/392125067 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faac8003570 con 0x7faad80d0c50 2023-10-06T11:10:33.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.379+0000 7faad77fe700 1 -- 172.21.15.146:0/392125067 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3767642278 0 0) 0x7faac8003570 con 0x7faad80d0c50 2023-10-06T11:10:33.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.379+0000 7faad77fe700 1 -- 172.21.15.146:0/392125067 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faad815cff0 msgr2=0x7faad815d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:33.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.379+0000 7faad77fe700 1 --2- 172.21.15.146:0/392125067 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faad815cff0 0x7faad815d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:33.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.379+0000 7faad77fe700 1 -- 172.21.15.146:0/392125067 >> v1:172.21.15.151:6789/0 conn(0x7faad815cc20 legacy=0x7faad80d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:33.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.379+0000 7faad77fe700 1 -- 172.21.15.146:0/392125067 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad815daf0 con 0x7faad80d0c50 2023-10-06T11:10:33.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.379+0000 7faad77fe700 1 -- 172.21.15.146:0/392125067 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7faad00017f0 con 0x7faad80d0c50 2023-10-06T11:10:33.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.379+0000 7faad77fe700 1 -- 172.21.15.146:0/392125067 >> v1:172.21.15.146:6789/0 conn(0x7faad80d0c50 legacy=0x7faad815a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:33.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.379+0000 7faad77fe700 1 --2- 172.21.15.146:0/392125067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faac8003a90 0x7faac8003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:33.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.379+0000 7faad77fe700 1 --2- 172.21.15.146:0/392125067 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faad815cff0 0x7faac8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:33.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.379+0000 7faad77fe700 1 --2- 172.21.15.146:0/392125067 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faac8004d50 0x7faac80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:33.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.379+0000 7faad77fe700 1 -- 172.21.15.146:0/392125067 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad815e390 con 0x7faac8003a90 2023-10-06T11:10:33.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.379+0000 7faad77fe700 1 -- 172.21.15.146:0/392125067 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac800bb70 con 0x7faac8004d50 2023-10-06T11:10:33.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.379+0000 7faad77fe700 1 -- 172.21.15.146:0/392125067 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac800bd30 con 0x7faad815cff0 2023-10-06T11:10:33.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.379+0000 7faadcb5f700 1 --2- 172.21.15.146:0/392125067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faac8003a90 0x7faac8003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:33.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.379+0000 7faad7fff700 1 --2- 172.21.15.146:0/392125067 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faad815cff0 0x7faac8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:33.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.379+0000 7faadd360700 1 --2- 172.21.15.146:0/392125067 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faac8004d50 0x7faac80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:33.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.379+0000 7faadcb5f700 1 -- 172.21.15.146:0/392125067 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faad815cff0 msgr2=0x7faac8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:33.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.379+0000 7faadcb5f700 1 --2- 172.21.15.146:0/392125067 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faad815cff0 0x7faac8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:33.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.379+0000 7faadcb5f700 1 -- 172.21.15.146:0/392125067 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faac8004d50 msgr2=0x7faac80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:33.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.379+0000 7faadcb5f700 1 --2- 172.21.15.146:0/392125067 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faac8004d50 0x7faac80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:33.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.379+0000 7faadcb5f700 1 -- 172.21.15.146:0/392125067 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac8003570 con 0x7faac8003a90 2023-10-06T11:10:33.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.379+0000 7faadd360700 1 --2- 172.21.15.146:0/392125067 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faac8004d50 0x7faac80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:10:33.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.379+0000 7faadcb5f700 1 --2- 172.21.15.146:0/392125067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faac8003a90 0x7faac8003ea0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7faacc0018d0 tx=0x7faacc007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e6381e9144025f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:33.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.380+0000 7faad77fe700 1 -- 172.21.15.146:0/392125067 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc001290 con 0x7faac8003a90 2023-10-06T11:10:33.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.380+0000 7faad77fe700 1 -- 172.21.15.146:0/392125067 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faacc012420 con 0x7faac8003a90 2023-10-06T11:10:33.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.380+0000 7faad77fe700 1 -- 172.21.15.146:0/392125067 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc0127e0 con 0x7faac8003a90 2023-10-06T11:10:33.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.380+0000 7faadedc3700 1 -- 172.21.15.146:0/392125067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faac8003a90 msgr2=0x7faac8003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:33.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.380+0000 7faadedc3700 1 --2- 172.21.15.146:0/392125067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faac8003a90 0x7faac8003ea0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7faacc0018d0 tx=0x7faacc007d80 comp rx=0 tx=0).stop 2023-10-06T11:10:33.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.380+0000 7faadd360700 1 -- 172.21.15.146:0/392125067 reap_dead start 2023-10-06T11:10:33.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.380+0000 7faadedc3700 1 -- 172.21.15.146:0/392125067 shutdown_connections 2023-10-06T11:10:33.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.380+0000 7faadedc3700 1 -- 172.21.15.146:0/392125067 >> 172.21.15.146:0/392125067 conn(0x7faad806eba0 msgr2=0x7faad806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:33.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.380+0000 7faadedc3700 1 -- 172.21.15.146:0/392125067 shutdown_connections 2023-10-06T11:10:33.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.380+0000 7faadedc3700 1 -- 172.21.15.146:0/392125067 wait complete. 2023-10-06T11:10:33.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.381+0000 7faadedc3700 1 Processor -- start 2023-10-06T11:10:33.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.381+0000 7faadedc3700 1 -- start start 2023-10-06T11:10:33.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.382+0000 7faadedc3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faac8003a90 0x7faad814afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:33.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.382+0000 7faadedc3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faad814b4e0 0x7faad80cb840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:33.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.382+0000 7faadedc3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faad8169e50 0x7faad80cbd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:33.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.382+0000 7faadedc3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad80c6be0 con 0x7faac8003a90 2023-10-06T11:10:33.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.382+0000 7faadedc3700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faad80c7a00 con 0x7faad8169e50 2023-10-06T11:10:33.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.382+0000 7faadedc3700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad80c6df0 con 0x7faad814b4e0 2023-10-06T11:10:33.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.382+0000 7faadcb5f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faac8003a90 0x7faad814afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:33.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.382+0000 7faadcb5f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faac8003a90 0x7faad814afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59506/0 (socket says 172.21.15.146:59506) 2023-10-06T11:10:33.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.382+0000 7faadcb5f700 1 -- 172.21.15.146:0/2844273427 learned_addr learned my addr 172.21.15.146:0/2844273427 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:33.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.383+0000 7faadcb5f700 1 -- 172.21.15.146:0/2844273427 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faad814b4e0 msgr2=0x7faad80cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:33.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.383+0000 7faadcb5f700 1 --2- 172.21.15.146:0/2844273427 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faad814b4e0 0x7faad80cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:33.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.383+0000 7faadcb5f700 1 -- 172.21.15.146:0/2844273427 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faad8169e50 msgr2=0x7faad80cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:33.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.383+0000 7faadcb5f700 1 --2- 172.21.15.146:0/2844273427 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faad8169e50 0x7faad80cbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:33.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.383+0000 7faadcb5f700 1 -- 172.21.15.146:0/2844273427 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad80c70d0 con 0x7faac8003a90 2023-10-06T11:10:33.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.383+0000 7faadcb5f700 1 --2- 172.21.15.146:0/2844273427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faac8003a90 0x7faad814afa0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7faacc001ec0 tx=0x7faacc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:33.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.383+0000 7faad4ff9700 1 -- 172.21.15.146:0/2844273427 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc01f620 con 0x7faac8003a90 2023-10-06T11:10:33.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.383+0000 7faad4ff9700 1 -- 172.21.15.146:0/2844273427 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faacc01f7a0 con 0x7faac8003a90 2023-10-06T11:10:33.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.383+0000 7faadedc3700 1 -- 172.21.15.146:0/2844273427 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faad80c73b0 con 0x7faac8003a90 2023-10-06T11:10:33.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.383+0000 7faad4ff9700 1 -- 172.21.15.146:0/2844273427 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faacc01fb60 con 0x7faac8003a90 2023-10-06T11:10:33.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.383+0000 7faadedc3700 1 -- 172.21.15.146:0/2844273427 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faad80b1ea0 con 0x7faac8003a90 2023-10-06T11:10:33.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.384+0000 7faadedc3700 1 -- 172.21.15.146:0/2844273427 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faad80b3960 con 0x7faac8003a90 2023-10-06T11:10:33.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.384+0000 7faad4ff9700 1 -- 172.21.15.146:0/2844273427 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faacc011400 con 0x7faac8003a90 2023-10-06T11:10:33.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.385+0000 7faad4ff9700 1 --2- 172.21.15.146:0/2844273427 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faabc066f30 0x7faabc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:33.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.385+0000 7faad4ff9700 1 -- 172.21.15.146:0/2844273427 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5206+0+0 (secure 0 0 0) 0x7faacc085b60 con 0x7faac8003a90 2023-10-06T11:10:33.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.385+0000 7faad7fff700 1 --2- 172.21.15.146:0/2844273427 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faabc066f30 0x7faabc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:33.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.385+0000 7faad7fff700 1 --2- 172.21.15.146:0/2844273427 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faabc066f30 0x7faabc0693e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7faad80b6230 tx=0x7faac40091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:33.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.389+0000 7faad4ff9700 1 -- 172.21.15.146:0/2844273427 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faacc052fc0 con 0x7faac8003a90 2023-10-06T11:10:33.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:33.572+0000 7faadedc3700 1 -- 172.21.15.146:0/2844273427 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7faad804c380 con 0x7faac8003a90 2023-10-06T11:10:34.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.539+0000 7faad4ff9700 1 -- 172.21.15.146:0/2844273427 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v72) v1 ==== 138+0+0 (secure 0 0 0) 0x7faacc0565e0 con 0x7faac8003a90 2023-10-06T11:10:34.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.543+0000 7faadedc3700 1 -- 172.21.15.146:0/2844273427 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faabc066f30 msgr2=0x7faabc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:34.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.543+0000 7faadedc3700 1 --2- 172.21.15.146:0/2844273427 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faabc066f30 0x7faabc0693e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7faad80b6230 tx=0x7faac40091a0 comp rx=0 tx=0).stop 2023-10-06T11:10:34.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.543+0000 7faadedc3700 1 -- 172.21.15.146:0/2844273427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faac8003a90 msgr2=0x7faad814afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:34.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.543+0000 7faadedc3700 1 --2- 172.21.15.146:0/2844273427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faac8003a90 0x7faad814afa0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7faacc001ec0 tx=0x7faacc015000 comp rx=0 tx=0).stop 2023-10-06T11:10:34.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.543+0000 7faadedc3700 1 -- 172.21.15.146:0/2844273427 shutdown_connections 2023-10-06T11:10:34.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.543+0000 7faadedc3700 1 --2- 172.21.15.146:0/2844273427 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faabc066f30 0x7faabc0693e0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:34.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.543+0000 7faadedc3700 1 --2- 172.21.15.146:0/2844273427 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faad8169e50 0x7faad80cbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:34.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.543+0000 7faadedc3700 1 --2- 172.21.15.146:0/2844273427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faac8003a90 0x7faad814afa0 secure :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7faacc001ec0 tx=0x7faacc015000 comp rx=0 tx=0).stop 2023-10-06T11:10:34.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.543+0000 7faadedc3700 1 --2- 172.21.15.146:0/2844273427 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faad814b4e0 0x7faad80cb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:34.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.543+0000 7faadedc3700 1 -- 172.21.15.146:0/2844273427 >> 172.21.15.146:0/2844273427 conn(0x7faad806eba0 msgr2=0x7faad80b4460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:34.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.543+0000 7faadedc3700 1 -- 172.21.15.146:0/2844273427 shutdown_connections 2023-10-06T11:10:34.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.543+0000 7faadedc3700 1 -- 172.21.15.146:0/2844273427 wait complete. 2023-10-06T11:10:34.546 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' created 2023-10-06T11:10:34.559 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T11:10:34.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.679+0000 7f95ebe10700 1 Processor -- start 2023-10-06T11:10:34.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.679+0000 7f95ebe10700 1 -- start start 2023-10-06T11:10:34.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.680+0000 7f95ebe10700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f95e4159f60 0x7f95e40c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:34.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.680+0000 7f95ebe10700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95e40c5c20 con 0x7f95e40cc760 2023-10-06T11:10:34.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.680+0000 7f95ebe10700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95e40c5f00 con 0x7f95e40b35f0 2023-10-06T11:10:34.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.680+0000 7f95ebe10700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95e40b3260 con 0x7f95e4159f60 2023-10-06T11:10:34.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.680+0000 7f95e93ab700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f95e40cc760 0x7f95e40c6cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59470/0 (socket says 172.21.15.146:59470) 2023-10-06T11:10:34.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.680+0000 7f95e93ab700 1 -- 172.21.15.146:0/1859695049 learned_addr learned my addr 172.21.15.146:0/1859695049 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:10:34.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.680+0000 7f95e9bac700 1 --2- 172.21.15.146:0/1859695049 >> v2:172.21.15.151:3300/0 conn(0x7f95e4159f60 0x7f95e40c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:34.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.680+0000 7f95e8baa700 1 -- 172.21.15.146:0/1859695049 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1523399805 0 0) 0x7f95e40c5c20 con 0x7f95e40cc760 2023-10-06T11:10:34.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.680+0000 7f95e8baa700 1 -- 172.21.15.146:0/1859695049 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95d0003570 con 0x7f95e40cc760 2023-10-06T11:10:34.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.681+0000 7f95e8baa700 1 -- 172.21.15.146:0/1859695049 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3155903735 0 0) 0x7f95d0003570 con 0x7f95e40cc760 2023-10-06T11:10:34.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.681+0000 7f95e8baa700 1 -- 172.21.15.146:0/1859695049 >> v2:172.21.15.151:3300/0 conn(0x7f95e4159f60 msgr2=0x7f95e40c55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:34.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.681+0000 7f95e8baa700 1 --2- 172.21.15.146:0/1859695049 >> v2:172.21.15.151:3300/0 conn(0x7f95e4159f60 0x7f95e40c55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:34.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.681+0000 7f95e8baa700 1 -- 172.21.15.146:0/1859695049 >> v1:172.21.15.151:6789/0 conn(0x7f95e40b35f0 legacy=0x7f95e40b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:34.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.681+0000 7f95e8baa700 1 -- 172.21.15.146:0/1859695049 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e40c61e0 con 0x7f95e40cc760 2023-10-06T11:10:34.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.681+0000 7f95e8baa700 1 -- 172.21.15.146:0/1859695049 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f95d4001470 con 0x7f95e40cc760 2023-10-06T11:10:34.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.681+0000 7f95e8baa700 1 -- 172.21.15.146:0/1859695049 >> v1:172.21.15.146:6789/0 conn(0x7f95e40cc760 legacy=0x7f95e40c6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:34.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.681+0000 7f95e8baa700 1 --2- 172.21.15.146:0/1859695049 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95d0003a60 0x7f95d0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:34.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.681+0000 7f95e8baa700 1 --2- 172.21.15.146:0/1859695049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95d0004810 0x7f95d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:34.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.681+0000 7f95e8baa700 1 --2- 172.21.15.146:0/1859695049 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95d00051c0 0x7f95d000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:34.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.681+0000 7f95e8baa700 1 -- 172.21.15.146:0/1859695049 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e40b3260 con 0x7f95d0004810 2023-10-06T11:10:34.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.681+0000 7f95e8baa700 1 -- 172.21.15.146:0/1859695049 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95d000c0d0 con 0x7f95d0003a60 2023-10-06T11:10:34.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.681+0000 7f95e8baa700 1 -- 172.21.15.146:0/1859695049 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95d000c290 con 0x7f95d00051c0 2023-10-06T11:10:34.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.681+0000 7f95e93ab700 1 --2- 172.21.15.146:0/1859695049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95d0004810 0x7f95d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:34.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.681+0000 7f95e9bac700 1 --2- 172.21.15.146:0/1859695049 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95d0003a60 0x7f95d0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:34.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.681+0000 7f95ea3ad700 1 --2- 172.21.15.146:0/1859695049 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95d00051c0 0x7f95d000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:34.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.681+0000 7f95e93ab700 1 -- 172.21.15.146:0/1859695049 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95d00051c0 msgr2=0x7f95d000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:34.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.681+0000 7f95e93ab700 1 --2- 172.21.15.146:0/1859695049 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95d00051c0 0x7f95d000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:34.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.681+0000 7f95e93ab700 1 -- 172.21.15.146:0/1859695049 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95d0003a60 msgr2=0x7f95d0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:34.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.681+0000 7f95e93ab700 1 --2- 172.21.15.146:0/1859695049 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95d0003a60 0x7f95d0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:34.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.681+0000 7f95e93ab700 1 -- 172.21.15.146:0/1859695049 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d0003570 con 0x7f95d0004810 2023-10-06T11:10:34.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.681+0000 7f95ea3ad700 1 -- 172.21.15.146:0/1859695049 reap_dead start 2023-10-06T11:10:34.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.681+0000 7f95e93ab700 1 --2- 172.21.15.146:0/1859695049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95d0004810 0x7f95d0004c80 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f95d400c3c0 tx=0x7f95d4001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c79e951dda42fa1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:34.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.681+0000 7f95e8baa700 1 -- 172.21.15.146:0/1859695049 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d400cc90 con 0x7f95d0004810 2023-10-06T11:10:34.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.681+0000 7f95e8baa700 1 -- 172.21.15.146:0/1859695049 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d400cdf0 con 0x7f95d0004810 2023-10-06T11:10:34.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.681+0000 7f95e8baa700 1 -- 172.21.15.146:0/1859695049 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d4005b50 con 0x7f95d0004810 2023-10-06T11:10:34.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.682+0000 7f95ebe10700 1 -- 172.21.15.146:0/1859695049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95d0004810 msgr2=0x7f95d0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:34.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.682+0000 7f95ebe10700 1 --2- 172.21.15.146:0/1859695049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95d0004810 0x7f95d0004c80 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f95d400c3c0 tx=0x7f95d4001e50 comp rx=0 tx=0).stop 2023-10-06T11:10:34.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.682+0000 7f95ebe10700 1 -- 172.21.15.146:0/1859695049 shutdown_connections 2023-10-06T11:10:34.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.682+0000 7f95ebe10700 1 --2- 172.21.15.146:0/1859695049 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95d0004810 0x7f95d0004c80 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:34.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.682+0000 7f95ebe10700 1 -- 172.21.15.146:0/1859695049 >> 172.21.15.146:0/1859695049 conn(0x7f95e406f380 msgr2=0x7f95e40d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:34.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.682+0000 7f95ebe10700 1 -- 172.21.15.146:0/1859695049 shutdown_connections 2023-10-06T11:10:34.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.682+0000 7f95ebe10700 1 -- 172.21.15.146:0/1859695049 wait complete. 2023-10-06T11:10:34.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.683+0000 7f95ebe10700 1 Processor -- start 2023-10-06T11:10:34.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.683+0000 7f95ebe10700 1 -- start start 2023-10-06T11:10:34.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.684+0000 7f95ebe10700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95d0004810 0x7f95e4169b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:34.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.684+0000 7f95ebe10700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95e40ca270 0x7f95e4160240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:34.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.684+0000 7f95ebe10700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95e415c4e0 0x7f95e415c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:34.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.684+0000 7f95ebe10700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e40c8120 con 0x7f95d0004810 2023-10-06T11:10:34.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.684+0000 7f95ebe10700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e40b49c0 con 0x7f95e40ca270 2023-10-06T11:10:34.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.684+0000 7f95ebe10700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e416a0d0 con 0x7f95e415c4e0 2023-10-06T11:10:34.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.684+0000 7f95e9bac700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95d0004810 0x7f95e4169b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:34.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.684+0000 7f95e9bac700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95d0004810 0x7f95e4169b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59514/0 (socket says 172.21.15.146:59514) 2023-10-06T11:10:34.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.684+0000 7f95e9bac700 1 -- 172.21.15.146:0/3477386337 learned_addr learned my addr 172.21.15.146:0/3477386337 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:34.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.684+0000 7f95e93ab700 1 --2- 172.21.15.146:0/3477386337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95e40ca270 0x7f95e4160240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:34.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.684+0000 7f95ea3ad700 1 --2- 172.21.15.146:0/3477386337 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95e415c4e0 0x7f95e415c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:34.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.684+0000 7f95e9bac700 1 -- 172.21.15.146:0/3477386337 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95e415c4e0 msgr2=0x7f95e415c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:34.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.684+0000 7f95e9bac700 1 --2- 172.21.15.146:0/3477386337 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95e415c4e0 0x7f95e415c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:34.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.684+0000 7f95e9bac700 1 -- 172.21.15.146:0/3477386337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95e40ca270 msgr2=0x7f95e4160240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:34.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.684+0000 7f95e9bac700 1 --2- 172.21.15.146:0/3477386337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95e40ca270 0x7f95e4160240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:34.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.684+0000 7f95e9bac700 1 -- 172.21.15.146:0/3477386337 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e416a3a0 con 0x7f95d0004810 2023-10-06T11:10:34.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.684+0000 7f95e9bac700 1 --2- 172.21.15.146:0/3477386337 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95d0004810 0x7f95e4169b90 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f95e0009fd0 tx=0x7f95e000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:34.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.685+0000 7f95d9ffb700 1 -- 172.21.15.146:0/3477386337 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e000e040 con 0x7f95d0004810 2023-10-06T11:10:34.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.685+0000 7f95d9ffb700 1 -- 172.21.15.146:0/3477386337 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e000f040 con 0x7f95d0004810 2023-10-06T11:10:34.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.685+0000 7f95ebe10700 1 -- 172.21.15.146:0/3477386337 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95e416a680 con 0x7f95d0004810 2023-10-06T11:10:34.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.685+0000 7f95d9ffb700 1 -- 172.21.15.146:0/3477386337 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e0015430 con 0x7f95d0004810 2023-10-06T11:10:34.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.685+0000 7f95ebe10700 1 -- 172.21.15.146:0/3477386337 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95e40c8330 con 0x7f95d0004810 2023-10-06T11:10:34.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.686+0000 7f95ebe10700 1 -- 172.21.15.146:0/3477386337 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95e416ab80 con 0x7f95d0004810 2023-10-06T11:10:34.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.686+0000 7f95d9ffb700 1 -- 172.21.15.146:0/3477386337 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f95e00157e0 con 0x7f95d0004810 2023-10-06T11:10:34.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.687+0000 7f95d9ffb700 1 --2- 172.21.15.146:0/3477386337 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f95c8066f30 0x7f95c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:34.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.687+0000 7f95e93ab700 1 --2- 172.21.15.146:0/3477386337 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f95c8066f30 0x7f95c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:34.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.687+0000 7f95d9ffb700 1 -- 172.21.15.146:0/3477386337 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f95e0085160 con 0x7f95d0004810 2023-10-06T11:10:34.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.687+0000 7f95e93ab700 1 --2- 172.21.15.146:0/3477386337 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f95c8066f30 0x7f95c80693e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f95d4007cd0 tx=0x7f95d4015000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:34.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.691+0000 7f95d9ffb700 1 -- 172.21.15.146:0/3477386337 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f95e0052450 con 0x7f95d0004810 2023-10-06T11:10:34.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:34.874+0000 7f95ebe10700 1 -- 172.21.15.146:0/3477386337 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f95e4068390 con 0x7f95d0004810 2023-10-06T11:10:35.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.545+0000 7f95d9ffb700 1 -- 172.21.15.146:0/3477386337 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v73) v1 ==== 170+0+0 (secure 0 0 0) 0x7f95e0055a70 con 0x7f95d0004810 2023-10-06T11:10:35.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.550+0000 7f95ebe10700 1 -- 172.21.15.146:0/3477386337 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f95c8066f30 msgr2=0x7f95c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:35.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.550+0000 7f95ebe10700 1 --2- 172.21.15.146:0/3477386337 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f95c8066f30 0x7f95c80693e0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f95d4007cd0 tx=0x7f95d4015000 comp rx=0 tx=0).stop 2023-10-06T11:10:35.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.550+0000 7f95ebe10700 1 -- 172.21.15.146:0/3477386337 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95d0004810 msgr2=0x7f95e4169b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:35.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.550+0000 7f95ebe10700 1 --2- 172.21.15.146:0/3477386337 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95d0004810 0x7f95e4169b90 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f95e0009fd0 tx=0x7f95e000b040 comp rx=0 tx=0).stop 2023-10-06T11:10:35.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.550+0000 7f95ebe10700 1 -- 172.21.15.146:0/3477386337 shutdown_connections 2023-10-06T11:10:35.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.550+0000 7f95ebe10700 1 --2- 172.21.15.146:0/3477386337 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f95c8066f30 0x7f95c80693e0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:35.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.550+0000 7f95ebe10700 1 --2- 172.21.15.146:0/3477386337 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95e415c4e0 0x7f95e415c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:35.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.550+0000 7f95ebe10700 1 --2- 172.21.15.146:0/3477386337 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f95d0004810 0x7f95e4169b90 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:35.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.550+0000 7f95ebe10700 1 --2- 172.21.15.146:0/3477386337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95e40ca270 0x7f95e4160240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:35.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.550+0000 7f95ebe10700 1 -- 172.21.15.146:0/3477386337 >> 172.21.15.146:0/3477386337 conn(0x7f95e406f380 msgr2=0x7f95e40cdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:35.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.551+0000 7f95ebe10700 1 -- 172.21.15.146:0/3477386337 shutdown_connections 2023-10-06T11:10:35.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.551+0000 7f95ebe10700 1 -- 172.21.15.146:0/3477386337 wait complete. 2023-10-06T11:10:35.561 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' created 2023-10-06T11:10:35.573 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T11:10:35.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.688+0000 7fa4cb3a0700 1 Processor -- start 2023-10-06T11:10:35.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.689+0000 7fa4cb3a0700 1 -- start start 2023-10-06T11:10:35.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.689+0000 7fa4cb3a0700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa4c41574b0 0x7fa4c40ae470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:35.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.689+0000 7fa4cb3a0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa4c40b1a00 0x7fa4c4157f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:35.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.689+0000 7fa4cb3a0700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4c40cbcf0 con 0x7fa4c4157880 2023-10-06T11:10:35.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.689+0000 7fa4cb3a0700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4c40cb170 con 0x7fa4c40b1a00 2023-10-06T11:10:35.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.689+0000 7fa4cb3a0700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4c40cb450 con 0x7fa4c41574b0 2023-10-06T11:10:35.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.690+0000 7fa4c993d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa4c40b1a00 0x7fa4c4157f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:35.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.690+0000 7fa4c893b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa4c4157880 0x7fa4c40b12f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59486/0 (socket says 172.21.15.146:59486) 2023-10-06T11:10:35.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.690+0000 7fa4c893b700 1 -- 172.21.15.146:0/4094937644 learned_addr learned my addr 172.21.15.146:0/4094937644 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:10:35.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.690+0000 7fa4c913c700 1 --2- 172.21.15.146:0/4094937644 >> v2:172.21.15.151:3300/0 conn(0x7fa4c41574b0 0x7fa4c40ae470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:35.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.690+0000 7fa4c993d700 1 -- 172.21.15.146:0/4094937644 >> v2:172.21.15.151:3300/0 conn(0x7fa4c41574b0 msgr2=0x7fa4c40ae470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:35.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.690+0000 7fa4c993d700 1 --2- 172.21.15.146:0/4094937644 >> v2:172.21.15.151:3300/0 conn(0x7fa4c41574b0 0x7fa4c40ae470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:35.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.690+0000 7fa4c993d700 1 -- 172.21.15.146:0/4094937644 >> v1:172.21.15.146:6789/0 conn(0x7fa4c4157880 legacy=0x7fa4c40b12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:35.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.690+0000 7fa4bbfff700 1 -- 172.21.15.146:0/4094937644 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4153971464 0 0) 0x7fa4c40cbcf0 con 0x7fa4c4157880 2023-10-06T11:10:35.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.690+0000 7fa4c993d700 1 -- 172.21.15.146:0/4094937644 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c40cb730 con 0x7fa4c40b1a00 2023-10-06T11:10:35.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.690+0000 7fa4c993d700 1 --2- 172.21.15.146:0/4094937644 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4c40b1a00 0x7fa4c4157f70 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4065930 tx=0x7fa4bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33fc390798180b4a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:35.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.690+0000 7fa4bbfff700 1 -- 172.21.15.146:0/4094937644 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc011630 con 0x7fa4c40b1a00 2023-10-06T11:10:35.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.690+0000 7fa4bbfff700 1 -- 172.21.15.146:0/4094937644 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4bc011790 con 0x7fa4c40b1a00 2023-10-06T11:10:35.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.690+0000 7fa4bbfff700 1 -- 172.21.15.146:0/4094937644 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc011b30 con 0x7fa4c40b1a00 2023-10-06T11:10:35.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.691+0000 7fa4cb3a0700 1 -- 172.21.15.146:0/4094937644 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4c40b1a00 msgr2=0x7fa4c4157f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:35.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.691+0000 7fa4cb3a0700 1 --2- 172.21.15.146:0/4094937644 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4c40b1a00 0x7fa4c4157f70 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4065930 tx=0x7fa4bc0091a0 comp rx=0 tx=0).stop 2023-10-06T11:10:35.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.691+0000 7fa4cb3a0700 1 -- 172.21.15.146:0/4094937644 shutdown_connections 2023-10-06T11:10:35.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.691+0000 7fa4cb3a0700 1 --2- 172.21.15.146:0/4094937644 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4c40b1a00 0x7fa4c4157f70 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:35.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.691+0000 7fa4cb3a0700 1 --2- 172.21.15.146:0/4094937644 >> v2:172.21.15.151:3300/0 conn(0x7fa4c41574b0 0x7fa4c40ae470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:35.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.691+0000 7fa4cb3a0700 1 -- 172.21.15.146:0/4094937644 >> 172.21.15.146:0/4094937644 conn(0x7fa4c406a070 msgr2=0x7fa4c4067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:35.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.691+0000 7fa4cb3a0700 1 -- 172.21.15.146:0/4094937644 shutdown_connections 2023-10-06T11:10:35.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.691+0000 7fa4cb3a0700 1 -- 172.21.15.146:0/4094937644 wait complete. 2023-10-06T11:10:35.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.692+0000 7fa4cb3a0700 1 Processor -- start 2023-10-06T11:10:35.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.692+0000 7fa4cb3a0700 1 -- start start 2023-10-06T11:10:35.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.693+0000 7fa4cb3a0700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4c40b1a00 0x7fa4c4164bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:35.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.693+0000 7fa4cb3a0700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4c41574b0 0x7fa4c4168070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:35.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.693+0000 7fa4cb3a0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4c4157880 0x7fa4c416b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:35.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.693+0000 7fa4cb3a0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c4151520 con 0x7fa4c4157880 2023-10-06T11:10:35.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.693+0000 7fa4cb3a0700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c416bab0 con 0x7fa4c41574b0 2023-10-06T11:10:35.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.693+0000 7fa4cb3a0700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c4151700 con 0x7fa4c40b1a00 2023-10-06T11:10:35.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.693+0000 7fa4c993d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4c4157880 0x7fa4c416b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:35.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.693+0000 7fa4c993d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4c4157880 0x7fa4c416b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59538/0 (socket says 172.21.15.146:59538) 2023-10-06T11:10:35.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.693+0000 7fa4c993d700 1 -- 172.21.15.146:0/1136256022 learned_addr learned my addr 172.21.15.146:0/1136256022 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:35.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.693+0000 7fa4c893b700 1 --2- 172.21.15.146:0/1136256022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4c41574b0 0x7fa4c4168070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:35.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.693+0000 7fa4c913c700 1 --2- 172.21.15.146:0/1136256022 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4c40b1a00 0x7fa4c4164bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:35.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.693+0000 7fa4c993d700 1 -- 172.21.15.146:0/1136256022 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4c40b1a00 msgr2=0x7fa4c4164bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:35.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.693+0000 7fa4c993d700 1 --2- 172.21.15.146:0/1136256022 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4c40b1a00 0x7fa4c4164bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:35.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.693+0000 7fa4c993d700 1 -- 172.21.15.146:0/1136256022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4c41574b0 msgr2=0x7fa4c4168070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:35.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.693+0000 7fa4c993d700 1 --2- 172.21.15.146:0/1136256022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4c41574b0 0x7fa4c4168070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:35.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.693+0000 7fa4c993d700 1 -- 172.21.15.146:0/1136256022 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4bc009420 con 0x7fa4c4157880 2023-10-06T11:10:35.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.693+0000 7fa4c893b700 1 --2- 172.21.15.146:0/1136256022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4c41574b0 0x7fa4c4168070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:10:35.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.693+0000 7fa4c993d700 1 --2- 172.21.15.146:0/1136256022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4c4157880 0x7fa4c416b570 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc013000 tx=0x7fa4bc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:35.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.693+0000 7fa4b97fa700 1 -- 172.21.15.146:0/1136256022 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc0195c0 con 0x7fa4c4157880 2023-10-06T11:10:35.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.693+0000 7fa4b97fa700 1 -- 172.21.15.146:0/1136256022 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4bc019720 con 0x7fa4c4157880 2023-10-06T11:10:35.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.693+0000 7fa4b97fa700 1 -- 172.21.15.146:0/1136256022 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc019ae0 con 0x7fa4c4157880 2023-10-06T11:10:35.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.693+0000 7fa4cb3a0700 1 -- 172.21.15.146:0/1136256022 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4c41519e0 con 0x7fa4c4157880 2023-10-06T11:10:35.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.694+0000 7fa4cb3a0700 1 -- 172.21.15.146:0/1136256022 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4c4167b50 con 0x7fa4c4157880 2023-10-06T11:10:35.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.694+0000 7fa4cb3a0700 1 -- 172.21.15.146:0/1136256022 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4c4167d40 con 0x7fa4c4157880 2023-10-06T11:10:35.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.695+0000 7fa4b97fa700 1 -- 172.21.15.146:0/1136256022 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa4bc0253f0 con 0x7fa4c4157880 2023-10-06T11:10:35.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.695+0000 7fa4b97fa700 1 --2- 172.21.15.146:0/1136256022 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa4a8066f30 0x7fa4a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:35.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.695+0000 7fa4b97fa700 1 -- 172.21.15.146:0/1136256022 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5958+0+0 (secure 0 0 0) 0x7fa4bc086080 con 0x7fa4c4157880 2023-10-06T11:10:35.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.695+0000 7fa4c913c700 1 --2- 172.21.15.146:0/1136256022 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa4a8066f30 0x7fa4a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:35.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.696+0000 7fa4c913c700 1 --2- 172.21.15.146:0/1136256022 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa4a8066f30 0x7fa4a80693e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa4c00076a0 tx=0x7fa4c000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:35.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.700+0000 7fa4b97fa700 1 -- 172.21.15.146:0/1136256022 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa4bc0531f0 con 0x7fa4c4157880 2023-10-06T11:10:35.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:35.926+0000 7fa4cb3a0700 1 -- 172.21.15.146:0/1136256022 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa4c404c380 con 0x7fa4c4157880 2023-10-06T11:10:36.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.549+0000 7fa4b97fa700 1 -- 172.21.15.146:0/1136256022 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v60) v1 ==== 174+0+0 (secure 0 0 0) 0x7fa4bc056810 con 0x7fa4c4157880 2023-10-06T11:10:36.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.558+0000 7fa4cb3a0700 1 -- 172.21.15.146:0/1136256022 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa4a8066f30 msgr2=0x7fa4a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:36.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.558+0000 7fa4cb3a0700 1 --2- 172.21.15.146:0/1136256022 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa4a8066f30 0x7fa4a80693e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa4c00076a0 tx=0x7fa4c000b040 comp rx=0 tx=0).stop 2023-10-06T11:10:36.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.558+0000 7fa4cb3a0700 1 -- 172.21.15.146:0/1136256022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4c4157880 msgr2=0x7fa4c416b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:36.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.558+0000 7fa4cb3a0700 1 --2- 172.21.15.146:0/1136256022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4c4157880 0x7fa4c416b570 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc013000 tx=0x7fa4bc017000 comp rx=0 tx=0).stop 2023-10-06T11:10:36.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.563+0000 7fa4cb3a0700 1 -- 172.21.15.146:0/1136256022 shutdown_connections 2023-10-06T11:10:36.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.563+0000 7fa4cb3a0700 1 --2- 172.21.15.146:0/1136256022 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa4a8066f30 0x7fa4a80693e0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:36.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.563+0000 7fa4cb3a0700 1 --2- 172.21.15.146:0/1136256022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4c4157880 0x7fa4c416b570 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:36.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.563+0000 7fa4cb3a0700 1 --2- 172.21.15.146:0/1136256022 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4c40b1a00 0x7fa4c4164bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:36.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.563+0000 7fa4cb3a0700 1 --2- 172.21.15.146:0/1136256022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4c41574b0 0x7fa4c4168070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:36.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.563+0000 7fa4cb3a0700 1 -- 172.21.15.146:0/1136256022 >> 172.21.15.146:0/1136256022 conn(0x7fa4c406a070 msgr2=0x7fa4c4156510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:36.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.563+0000 7fa4cb3a0700 1 -- 172.21.15.146:0/1136256022 shutdown_connections 2023-10-06T11:10:36.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.564+0000 7fa4cb3a0700 1 -- 172.21.15.146:0/1136256022 wait complete. 2023-10-06T11:10:36.568 INFO:teuthology.orchestra.run.smithi146.stderr:new fs with metadata pool 11 and data pool 12 2023-10-06T11:10:36.585 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:10:36.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.700+0000 7fe0d4dd5700 1 Processor -- start 2023-10-06T11:10:36.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.700+0000 7fe0d4dd5700 1 -- start start 2023-10-06T11:10:36.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.701+0000 7fe0d4dd5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe0d015a7f0 0x7fe0d015cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:36.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.701+0000 7fe0d4dd5700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe0d00b2530 0x7fe0d015acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:36.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.701+0000 7fe0d4dd5700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0d015c630 con 0x7fe0d015a420 2023-10-06T11:10:36.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.701+0000 7fe0d4dd5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0d00ce040 con 0x7fe0d015a7f0 2023-10-06T11:10:36.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.701+0000 7fe0d4dd5700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0d015ba20 con 0x7fe0d00b2530 2023-10-06T11:10:36.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.701+0000 7fe0ceffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe0d015a7f0 0x7fe0d015cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:36.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.701+0000 7fe0ceffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe0d015a7f0 0x7fe0d015cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59546/0 (socket says 172.21.15.146:59546) 2023-10-06T11:10:36.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.701+0000 7fe0ceffd700 1 -- 172.21.15.146:0/137688790 learned_addr learned my addr 172.21.15.146:0/137688790 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:36.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.701+0000 7fe0cffff700 1 --2- 172.21.15.146:0/137688790 >> v2:172.21.15.151:3300/0 conn(0x7fe0d00b2530 0x7fe0d015acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:36.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.701+0000 7fe0ceffd700 1 -- 172.21.15.146:0/137688790 >> v2:172.21.15.151:3300/0 conn(0x7fe0d00b2530 msgr2=0x7fe0d015acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:36.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.701+0000 7fe0ceffd700 1 --2- 172.21.15.146:0/137688790 >> v2:172.21.15.151:3300/0 conn(0x7fe0d00b2530 0x7fe0d015acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:36.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.701+0000 7fe0ceffd700 1 -- 172.21.15.146:0/137688790 >> v1:172.21.15.151:6789/0 conn(0x7fe0d015a420 legacy=0x7fe0d00b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:36.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.701+0000 7fe0ceffd700 1 -- 172.21.15.146:0/137688790 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d015bd00 con 0x7fe0d015a7f0 2023-10-06T11:10:36.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.701+0000 7fe0ceffd700 1 --2- 172.21.15.146:0/137688790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0d015a7f0 0x7fe0d015cac0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fe0d015c5a0 tx=0x7fe0c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50142fe97a5baebc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:36.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.702+0000 7fe0ce7fc700 1 -- 172.21.15.146:0/137688790 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c400b820 con 0x7fe0d015a7f0 2023-10-06T11:10:36.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.702+0000 7fe0ce7fc700 1 -- 172.21.15.146:0/137688790 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c400b980 con 0x7fe0d015a7f0 2023-10-06T11:10:36.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.702+0000 7fe0ce7fc700 1 -- 172.21.15.146:0/137688790 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c400bd20 con 0x7fe0d015a7f0 2023-10-06T11:10:36.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.702+0000 7fe0d4dd5700 1 -- 172.21.15.146:0/137688790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0d015a7f0 msgr2=0x7fe0d015cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:36.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.702+0000 7fe0d4dd5700 1 --2- 172.21.15.146:0/137688790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0d015a7f0 0x7fe0d015cac0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fe0d015c5a0 tx=0x7fe0c4009250 comp rx=0 tx=0).stop 2023-10-06T11:10:36.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.702+0000 7fe0d4dd5700 1 -- 172.21.15.146:0/137688790 shutdown_connections 2023-10-06T11:10:36.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.702+0000 7fe0d4dd5700 1 --2- 172.21.15.146:0/137688790 >> v2:172.21.15.151:3300/0 conn(0x7fe0d00b2530 0x7fe0d015acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:36.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.702+0000 7fe0d4dd5700 1 --2- 172.21.15.146:0/137688790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0d015a7f0 0x7fe0d015cac0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:36.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.702+0000 7fe0d4dd5700 1 -- 172.21.15.146:0/137688790 >> 172.21.15.146:0/137688790 conn(0x7fe0d006eba0 msgr2=0x7fe0d006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:36.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.702+0000 7fe0d4dd5700 1 -- 172.21.15.146:0/137688790 shutdown_connections 2023-10-06T11:10:36.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.702+0000 7fe0d4dd5700 1 -- 172.21.15.146:0/137688790 wait complete. 2023-10-06T11:10:36.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.703+0000 7fe0d4dd5700 1 Processor -- start 2023-10-06T11:10:36.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.703+0000 7fe0d4dd5700 1 -- start start 2023-10-06T11:10:36.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.704+0000 7fe0d4dd5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0d00b2530 0x7fe0d014b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:36.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.704+0000 7fe0d4dd5700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0d015a420 0x7fe0d00b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:36.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.704+0000 7fe0d4dd5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0d015a7f0 0x7fe0d0153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:36.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.704+0000 7fe0d4dd5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d00b49b0 con 0x7fe0d00b2530 2023-10-06T11:10:36.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.704+0000 7fe0d4dd5700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d00b3de0 con 0x7fe0d015a7f0 2023-10-06T11:10:36.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.704+0000 7fe0d4dd5700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d014bc60 con 0x7fe0d015a420 2023-10-06T11:10:36.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.704+0000 7fe0cf7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0d00b2530 0x7fe0d014b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:36.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.704+0000 7fe0cf7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0d00b2530 0x7fe0d014b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59558/0 (socket says 172.21.15.146:59558) 2023-10-06T11:10:36.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.704+0000 7fe0cf7fe700 1 -- 172.21.15.146:0/2092810969 learned_addr learned my addr 172.21.15.146:0/2092810969 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:36.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.704+0000 7fe0cffff700 1 --2- 172.21.15.146:0/2092810969 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0d015a7f0 0x7fe0d0153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:36.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.704+0000 7fe0ceffd700 1 --2- 172.21.15.146:0/2092810969 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0d015a420 0x7fe0d00b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:36.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.705+0000 7fe0cf7fe700 1 -- 172.21.15.146:0/2092810969 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0d015a420 msgr2=0x7fe0d00b4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:36.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.705+0000 7fe0cf7fe700 1 --2- 172.21.15.146:0/2092810969 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0d015a420 0x7fe0d00b4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:36.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.705+0000 7fe0cf7fe700 1 -- 172.21.15.146:0/2092810969 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0d015a7f0 msgr2=0x7fe0d0153160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:36.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.705+0000 7fe0cf7fe700 1 --2- 172.21.15.146:0/2092810969 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0d015a7f0 0x7fe0d0153160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:36.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.705+0000 7fe0cf7fe700 1 -- 172.21.15.146:0/2092810969 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c40094f0 con 0x7fe0d00b2530 2023-10-06T11:10:36.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.705+0000 7fe0cffff700 1 --2- 172.21.15.146:0/2092810969 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0d015a7f0 0x7fe0d0153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:10:36.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.705+0000 7fe0ceffd700 1 --2- 172.21.15.146:0/2092810969 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0d015a420 0x7fe0d00b4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:10:36.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.705+0000 7fe0cf7fe700 1 --2- 172.21.15.146:0/2092810969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0d00b2530 0x7fe0d014b720 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fe0c000c950 tx=0x7fe0c0002760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:36.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.705+0000 7fe0b77fe700 1 -- 172.21.15.146:0/2092810969 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c000a7e0 con 0x7fe0d00b2530 2023-10-06T11:10:36.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.705+0000 7fe0b77fe700 1 -- 172.21.15.146:0/2092810969 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c000a940 con 0x7fe0d00b2530 2023-10-06T11:10:36.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.705+0000 7fe0b77fe700 1 -- 172.21.15.146:0/2092810969 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c000ad00 con 0x7fe0d00b2530 2023-10-06T11:10:36.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.705+0000 7fe0d4dd5700 1 -- 172.21.15.146:0/2092810969 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0d00b4080 con 0x7fe0d00b2530 2023-10-06T11:10:36.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.705+0000 7fe0d4dd5700 1 -- 172.21.15.146:0/2092810969 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0d00b4640 con 0x7fe0d00b2530 2023-10-06T11:10:36.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.706+0000 7fe0d4dd5700 1 -- 172.21.15.146:0/2092810969 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0d00b4c90 con 0x7fe0d00b2530 2023-10-06T11:10:36.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.706+0000 7fe0b77fe700 1 -- 172.21.15.146:0/2092810969 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe0c0012630 con 0x7fe0d00b2530 2023-10-06T11:10:36.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.707+0000 7fe0b77fe700 1 --2- 172.21.15.146:0/2092810969 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe0bc066f30 0x7fe0bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:36.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.707+0000 7fe0b77fe700 1 -- 172.21.15.146:0/2092810969 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe0c0084bd0 con 0x7fe0d00b2530 2023-10-06T11:10:36.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.707+0000 7fe0ceffd700 1 --2- 172.21.15.146:0/2092810969 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe0bc066f30 0x7fe0bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:36.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.707+0000 7fe0ceffd700 1 --2- 172.21.15.146:0/2092810969 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe0bc066f30 0x7fe0bc0693e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe0d015c5a0 tx=0x7fe0c4016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:36.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.711+0000 7fe0b77fe700 1 -- 172.21.15.146:0/2092810969 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe0c0051d90 con 0x7fe0d00b2530 2023-10-06T11:10:36.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.894+0000 7fe0d4dd5700 1 -- 172.21.15.146:0/2092810969 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0d00afae0 con 0x7fe0d00b2530 2023-10-06T11:10:36.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.895+0000 7fe0b77fe700 1 -- 172.21.15.146:0/2092810969 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+16930 (secure 0 0 0) 0x7fe0c0016090 con 0x7fe0d00b2530 2023-10-06T11:10:36.897 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:10:36.897 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":74,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:10:35.928212+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:10:33.590163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-10-06T11:10:34.892777+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:10:36.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.897+0000 7fe0d4dd5700 1 -- 172.21.15.146:0/2092810969 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe0bc066f30 msgr2=0x7fe0bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:36.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.897+0000 7fe0d4dd5700 1 --2- 172.21.15.146:0/2092810969 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe0bc066f30 0x7fe0bc0693e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe0d015c5a0 tx=0x7fe0c4016000 comp rx=0 tx=0).stop 2023-10-06T11:10:36.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.897+0000 7fe0d4dd5700 1 -- 172.21.15.146:0/2092810969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0d00b2530 msgr2=0x7fe0d014b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:36.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.897+0000 7fe0d4dd5700 1 --2- 172.21.15.146:0/2092810969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0d00b2530 0x7fe0d014b720 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fe0c000c950 tx=0x7fe0c0002760 comp rx=0 tx=0).stop 2023-10-06T11:10:36.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.897+0000 7fe0d4dd5700 1 -- 172.21.15.146:0/2092810969 shutdown_connections 2023-10-06T11:10:36.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.897+0000 7fe0d4dd5700 1 --2- 172.21.15.146:0/2092810969 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe0bc066f30 0x7fe0bc0693e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:36.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.897+0000 7fe0d4dd5700 1 --2- 172.21.15.146:0/2092810969 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0d015a7f0 0x7fe0d0153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:36.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.897+0000 7fe0d4dd5700 1 --2- 172.21.15.146:0/2092810969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0d00b2530 0x7fe0d014b720 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:36.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.897+0000 7fe0d4dd5700 1 --2- 172.21.15.146:0/2092810969 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0d015a420 0x7fe0d00b4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:36.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.897+0000 7fe0d4dd5700 1 -- 172.21.15.146:0/2092810969 >> 172.21.15.146:0/2092810969 conn(0x7fe0d006eba0 msgr2=0x7fe0d015b100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:36.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.897+0000 7fe0d4dd5700 1 -- 172.21.15.146:0/2092810969 shutdown_connections 2023-10-06T11:10:36.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:36.897+0000 7fe0d4dd5700 1 -- 172.21.15.146:0/2092810969 wait complete. 2023-10-06T11:10:36.912 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:10:37.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.025+0000 7f0625f40700 1 Processor -- start 2023-10-06T11:10:37.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.025+0000 7f0625f40700 1 -- start start 2023-10-06T11:10:37.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.026+0000 7f0625f40700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0620153e80 0x7f062015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:37.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.026+0000 7f0625f40700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f062015ac30 con 0x7f0620153ab0 2023-10-06T11:10:37.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.026+0000 7f0625f40700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06200b4510 con 0x7f0620068ba0 2023-10-06T11:10:37.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.026+0000 7f0625f40700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06200b6530 con 0x7f0620153e80 2023-10-06T11:10:37.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.026+0000 7f061f7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0620153ab0 0x7f0620068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59494/0 (socket says 172.21.15.146:59494) 2023-10-06T11:10:37.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.026+0000 7f061f7fe700 1 -- 172.21.15.146:0/1487408507 learned_addr learned my addr 172.21.15.146:0/1487408507 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:10:37.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.026+0000 7f061ffff700 1 --2- 172.21.15.146:0/1487408507 >> v2:172.21.15.146:3300/0 conn(0x7f0620153e80 0x7f062015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:37.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.026+0000 7f061e7fc700 1 -- 172.21.15.146:0/1487408507 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3368776465 0 0) 0x7f0610001490 con 0x7f0620153ab0 2023-10-06T11:10:37.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.027+0000 7f061e7fc700 1 -- 172.21.15.146:0/1487408507 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0608003570 con 0x7f0620153ab0 2023-10-06T11:10:37.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.027+0000 7f061ffff700 1 -- 172.21.15.146:0/1487408507 >> v1:172.21.15.151:6789/0 conn(0x7f0620068ba0 legacy=0x7f06200b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:37.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.027+0000 7f061ffff700 1 -- 172.21.15.146:0/1487408507 >> v1:172.21.15.146:6789/0 conn(0x7f0620153ab0 legacy=0x7f0620068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:37.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.027+0000 7f061ffff700 1 -- 172.21.15.146:0/1487408507 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06200b5c50 con 0x7f0620153e80 2023-10-06T11:10:37.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.027+0000 7f061ffff700 1 --2- 172.21.15.146:0/1487408507 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0620153e80 0x7f062015a6f0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f06180098e0 tx=0x7f06180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ccd34447510da8e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:37.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.027+0000 7f061e7fc700 1 -- 172.21.15.146:0/1487408507 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061800b640 con 0x7f0620153e80 2023-10-06T11:10:37.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.027+0000 7f061e7fc700 1 -- 172.21.15.146:0/1487408507 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061800b7a0 con 0x7f0620153e80 2023-10-06T11:10:37.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.027+0000 7f061e7fc700 1 -- 172.21.15.146:0/1487408507 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061800bb40 con 0x7f0620153e80 2023-10-06T11:10:37.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.027+0000 7f0625f40700 1 -- 172.21.15.146:0/1487408507 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0620153e80 msgr2=0x7f062015a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:37.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.027+0000 7f0625f40700 1 --2- 172.21.15.146:0/1487408507 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0620153e80 0x7f062015a6f0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f06180098e0 tx=0x7f06180091a0 comp rx=0 tx=0).stop 2023-10-06T11:10:37.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.027+0000 7f0625f40700 1 -- 172.21.15.146:0/1487408507 shutdown_connections 2023-10-06T11:10:37.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.027+0000 7f0625f40700 1 --2- 172.21.15.146:0/1487408507 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0620153e80 0x7f062015a6f0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:37.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.027+0000 7f0625f40700 1 -- 172.21.15.146:0/1487408507 >> 172.21.15.146:0/1487408507 conn(0x7f062006eba0 msgr2=0x7f062006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:37.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.028+0000 7f0625f40700 1 -- 172.21.15.146:0/1487408507 shutdown_connections 2023-10-06T11:10:37.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.028+0000 7f0625f40700 1 -- 172.21.15.146:0/1487408507 wait complete. 2023-10-06T11:10:37.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.029+0000 7f0625f40700 1 Processor -- start 2023-10-06T11:10:37.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.029+0000 7f0625f40700 1 -- start start 2023-10-06T11:10:37.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.029+0000 7f0625f40700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0620068ba0 0x7f0620152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:37.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.029+0000 7f0625f40700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0620153ab0 0x7f06200c5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:37.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.029+0000 7f0625f40700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0620153e80 0x7f06200b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:37.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.029+0000 7f0625f40700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062016a110 con 0x7f0620068ba0 2023-10-06T11:10:37.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.029+0000 7f0625f40700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062016a3f0 con 0x7f0620153e80 2023-10-06T11:10:37.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.029+0000 7f0625f40700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f062016a6d0 con 0x7f0620153ab0 2023-10-06T11:10:37.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.030+0000 7f061f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0620068ba0 0x7f0620152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:37.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.030+0000 7f061f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0620068ba0 0x7f0620152470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59574/0 (socket says 172.21.15.146:59574) 2023-10-06T11:10:37.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.030+0000 7f061f7fe700 1 -- 172.21.15.146:0/3508422223 learned_addr learned my addr 172.21.15.146:0/3508422223 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:37.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.030+0000 7f061ffff700 1 --2- 172.21.15.146:0/3508422223 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0620153e80 0x7f06200b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:37.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.030+0000 7f061effd700 1 --2- 172.21.15.146:0/3508422223 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0620153ab0 0x7f06200c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:37.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.030+0000 7f061f7fe700 1 -- 172.21.15.146:0/3508422223 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0620153ab0 msgr2=0x7f06200c5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:37.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.030+0000 7f061f7fe700 1 --2- 172.21.15.146:0/3508422223 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0620153ab0 0x7f06200c5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:37.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.030+0000 7f061f7fe700 1 -- 172.21.15.146:0/3508422223 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0620153e80 msgr2=0x7f06200b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:37.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.030+0000 7f061f7fe700 1 --2- 172.21.15.146:0/3508422223 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0620153e80 0x7f06200b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:37.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.030+0000 7f061f7fe700 1 -- 172.21.15.146:0/3508422223 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0618009420 con 0x7f0620068ba0 2023-10-06T11:10:37.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.030+0000 7f061f7fe700 1 --2- 172.21.15.146:0/3508422223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0620068ba0 0x7f0620152470 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f061000cd30 tx=0x7f0610001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:37.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.030+0000 7f06077fe700 1 -- 172.21.15.146:0/3508422223 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061000ce90 con 0x7f0620068ba0 2023-10-06T11:10:37.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.030+0000 7f06077fe700 1 -- 172.21.15.146:0/3508422223 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061000aac0 con 0x7f0620068ba0 2023-10-06T11:10:37.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.030+0000 7f0625f40700 1 -- 172.21.15.146:0/3508422223 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f062016a9b0 con 0x7f0620068ba0 2023-10-06T11:10:37.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.030+0000 7f06077fe700 1 -- 172.21.15.146:0/3508422223 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061000ae80 con 0x7f0620068ba0 2023-10-06T11:10:37.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.030+0000 7f0625f40700 1 -- 172.21.15.146:0/3508422223 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06201529b0 con 0x7f0620068ba0 2023-10-06T11:10:37.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.031+0000 7f0625f40700 1 -- 172.21.15.146:0/3508422223 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f062004c380 con 0x7f0620068ba0 2023-10-06T11:10:37.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.032+0000 7f06077fe700 1 -- 172.21.15.146:0/3508422223 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0610007300 con 0x7f0620068ba0 2023-10-06T11:10:37.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.032+0000 7f06077fe700 1 --2- 172.21.15.146:0/3508422223 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f060c066f30 0x7f060c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:37.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.032+0000 7f06077fe700 1 -- 172.21.15.146:0/3508422223 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f06100847e0 con 0x7f0620068ba0 2023-10-06T11:10:37.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.032+0000 7f061effd700 1 --2- 172.21.15.146:0/3508422223 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f060c066f30 0x7f060c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:37.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.032+0000 7f061effd700 1 --2- 172.21.15.146:0/3508422223 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f060c066f30 0x7f060c0693e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0620159320 tx=0x7f0614007ec0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:37.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.036+0000 7f06077fe700 1 -- 172.21.15.146:0/3508422223 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0610051970 con 0x7f0620068ba0 2023-10-06T11:10:37.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.221+0000 7f0625f40700 1 -- 172.21.15.146:0/3508422223 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f062015ac30 con 0x7f0620068ba0 2023-10-06T11:10:37.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.222+0000 7f06077fe700 1 -- 172.21.15.146:0/3508422223 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+16930 (secure 0 0 0) 0x7f062015ac30 con 0x7f0620068ba0 2023-10-06T11:10:37.224 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:10:37.224 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":74,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:10:35.928212+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:10:33.590163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-10-06T11:10:34.892777+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:10:37.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.224+0000 7f0625f40700 1 -- 172.21.15.146:0/3508422223 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f060c066f30 msgr2=0x7f060c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:37.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.225+0000 7f0625f40700 1 --2- 172.21.15.146:0/3508422223 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f060c066f30 0x7f060c0693e0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0620159320 tx=0x7f0614007ec0 comp rx=0 tx=0).stop 2023-10-06T11:10:37.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.225+0000 7f0625f40700 1 -- 172.21.15.146:0/3508422223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0620068ba0 msgr2=0x7f0620152470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:37.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.225+0000 7f0625f40700 1 --2- 172.21.15.146:0/3508422223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0620068ba0 0x7f0620152470 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f061000cd30 tx=0x7f0610001b10 comp rx=0 tx=0).stop 2023-10-06T11:10:37.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.225+0000 7f0625f40700 1 -- 172.21.15.146:0/3508422223 shutdown_connections 2023-10-06T11:10:37.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.225+0000 7f0625f40700 1 --2- 172.21.15.146:0/3508422223 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f060c066f30 0x7f060c0693e0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:37.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.225+0000 7f0625f40700 1 --2- 172.21.15.146:0/3508422223 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0620153e80 0x7f06200b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:37.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.225+0000 7f0625f40700 1 --2- 172.21.15.146:0/3508422223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0620068ba0 0x7f0620152470 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:37.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.225+0000 7f0625f40700 1 --2- 172.21.15.146:0/3508422223 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0620153ab0 0x7f06200c5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:37.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.225+0000 7f0625f40700 1 -- 172.21.15.146:0/3508422223 >> 172.21.15.146:0/3508422223 conn(0x7f062006eba0 msgr2=0x7f062015c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:37.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.225+0000 7f0625f40700 1 -- 172.21.15.146:0/3508422223 shutdown_connections 2023-10-06T11:10:37.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.225+0000 7f0625f40700 1 -- 172.21.15.146:0/3508422223 wait complete. 2023-10-06T11:10:37.239 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T11:10:37.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.356+0000 7f578853a700 1 Processor -- start 2023-10-06T11:10:37.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.356+0000 7f578853a700 1 -- start start 2023-10-06T11:10:37.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.357+0000 7f578853a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f57800ae730 0x7f57800aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:37.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.357+0000 7f578853a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57800cb950 0x7f57800cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:37.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.357+0000 7f578853a700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57800ae2a0 con 0x7f578015a160 2023-10-06T11:10:37.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.357+0000 7f578853a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f578015a530 con 0x7f57800ae730 2023-10-06T11:10:37.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.357+0000 7f578853a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57800c5cb0 con 0x7f57800cb950 2023-10-06T11:10:37.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.357+0000 7f5785ad5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f57800ae730 0x7f57800aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:37.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.357+0000 7f5785ad5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f57800ae730 0x7f57800aebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59578/0 (socket says 172.21.15.146:59578) 2023-10-06T11:10:37.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.357+0000 7f5785ad5700 1 -- 172.21.15.146:0/2483048535 learned_addr learned my addr 172.21.15.146:0/2483048535 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:37.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.357+0000 7f5786ad7700 1 --2- 172.21.15.146:0/2483048535 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57800cb950 0x7f57800cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:37.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.357+0000 7f5785ad5700 1 -- 172.21.15.146:0/2483048535 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57800cb950 msgr2=0x7f57800cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:37.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.357+0000 7f5785ad5700 1 --2- 172.21.15.146:0/2483048535 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57800cb950 0x7f57800cbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:37.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.357+0000 7f5785ad5700 1 -- 172.21.15.146:0/2483048535 >> v1:172.21.15.151:6789/0 conn(0x7f578015a160 legacy=0x7f57800c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:37.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.357+0000 7f5785ad5700 1 -- 172.21.15.146:0/2483048535 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57800af0f0 con 0x7f57800ae730 2023-10-06T11:10:37.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.357+0000 7f5786ad7700 1 --2- 172.21.15.146:0/2483048535 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57800cb950 0x7f57800cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:10:37.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.357+0000 7f5785ad5700 1 --2- 172.21.15.146:0/2483048535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57800ae730 0x7f57800aebb0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f57700099b0 tx=0x7f5770009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aba134e31aac2fdb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:37.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.357+0000 7f57852d4700 1 -- 172.21.15.146:0/2483048535 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577000b860 con 0x7f57800ae730 2023-10-06T11:10:37.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.357+0000 7f57852d4700 1 -- 172.21.15.146:0/2483048535 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f577000b9c0 con 0x7f57800ae730 2023-10-06T11:10:37.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.357+0000 7f57852d4700 1 -- 172.21.15.146:0/2483048535 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577000bd60 con 0x7f57800ae730 2023-10-06T11:10:37.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.358+0000 7f578853a700 1 -- 172.21.15.146:0/2483048535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57800ae730 msgr2=0x7f57800aebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:37.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.358+0000 7f578853a700 1 --2- 172.21.15.146:0/2483048535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57800ae730 0x7f57800aebb0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f57700099b0 tx=0x7f5770009250 comp rx=0 tx=0).stop 2023-10-06T11:10:37.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.358+0000 7f578853a700 1 -- 172.21.15.146:0/2483048535 shutdown_connections 2023-10-06T11:10:37.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.358+0000 7f578853a700 1 --2- 172.21.15.146:0/2483048535 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57800cb950 0x7f57800cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:37.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.358+0000 7f578853a700 1 --2- 172.21.15.146:0/2483048535 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57800ae730 0x7f57800aebb0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:37.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.358+0000 7f578853a700 1 -- 172.21.15.146:0/2483048535 >> 172.21.15.146:0/2483048535 conn(0x7f578006f380 msgr2=0x7f57800d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:37.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.358+0000 7f578853a700 1 -- 172.21.15.146:0/2483048535 shutdown_connections 2023-10-06T11:10:37.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.358+0000 7f578853a700 1 -- 172.21.15.146:0/2483048535 wait complete. 2023-10-06T11:10:37.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.359+0000 7f578853a700 1 Processor -- start 2023-10-06T11:10:37.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.359+0000 7f578853a700 1 -- start start 2023-10-06T11:10:37.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.360+0000 7f578853a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57800ae730 0x7f5780157260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:37.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.360+0000 7f578853a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57800cb950 0x7f57800c8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:37.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.360+0000 7f578853a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f578015a160 0x7f57800b5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:37.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.360+0000 7f578853a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57800c93d0 con 0x7f578015a160 2023-10-06T11:10:37.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.360+0000 7f578853a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57800c96b0 con 0x7f57800cb950 2023-10-06T11:10:37.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.360+0000 7f578853a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57800c9990 con 0x7f57800ae730 2023-10-06T11:10:37.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.360+0000 7f5786ad7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f578015a160 0x7f57800b5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:37.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.360+0000 7f5786ad7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f578015a160 0x7f57800b5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59580/0 (socket says 172.21.15.146:59580) 2023-10-06T11:10:37.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.360+0000 7f5786ad7700 1 -- 172.21.15.146:0/579257223 learned_addr learned my addr 172.21.15.146:0/579257223 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:37.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.360+0000 7f57862d6700 1 --2- 172.21.15.146:0/579257223 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57800ae730 0x7f5780157260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:37.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.360+0000 7f5785ad5700 1 --2- 172.21.15.146:0/579257223 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57800cb950 0x7f57800c8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:37.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.360+0000 7f5786ad7700 1 -- 172.21.15.146:0/579257223 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57800ae730 msgr2=0x7f5780157260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:37.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.360+0000 7f5786ad7700 1 --2- 172.21.15.146:0/579257223 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57800ae730 0x7f5780157260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:37.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.360+0000 7f5786ad7700 1 -- 172.21.15.146:0/579257223 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57800cb950 msgr2=0x7f57800c8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:37.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.360+0000 7f5786ad7700 1 --2- 172.21.15.146:0/579257223 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57800cb950 0x7f57800c8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:37.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.360+0000 7f5786ad7700 1 -- 172.21.15.146:0/579257223 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57700094f0 con 0x7f578015a160 2023-10-06T11:10:37.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.360+0000 7f5786ad7700 1 --2- 172.21.15.146:0/579257223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f578015a160 0x7f57800b5600 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f577800d180 tx=0x7f5778009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:37.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.361+0000 7f57767fc700 1 -- 172.21.15.146:0/579257223 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577800dcc0 con 0x7f578015a160 2023-10-06T11:10:37.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.361+0000 7f57767fc700 1 -- 172.21.15.146:0/579257223 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f577800f040 con 0x7f578015a160 2023-10-06T11:10:37.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.361+0000 7f578853a700 1 -- 172.21.15.146:0/579257223 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57800c9c70 con 0x7f578015a160 2023-10-06T11:10:37.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.361+0000 7f57767fc700 1 -- 172.21.15.146:0/579257223 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5778015690 con 0x7f578015a160 2023-10-06T11:10:37.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.361+0000 7f578853a700 1 -- 172.21.15.146:0/579257223 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57801577a0 con 0x7f578015a160 2023-10-06T11:10:37.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.362+0000 7f578853a700 1 -- 172.21.15.146:0/579257223 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5780068390 con 0x7f578015a160 2023-10-06T11:10:37.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.362+0000 7f57767fc700 1 -- 172.21.15.146:0/579257223 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f577801e3b0 con 0x7f578015a160 2023-10-06T11:10:37.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.363+0000 7f57767fc700 1 --2- 172.21.15.146:0/579257223 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5764066f30 0x7f57640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:37.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.363+0000 7f57767fc700 1 -- 172.21.15.146:0/579257223 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5778084b30 con 0x7f578015a160 2023-10-06T11:10:37.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.363+0000 7f57862d6700 1 --2- 172.21.15.146:0/579257223 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5764066f30 0x7f57640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:37.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.363+0000 7f57862d6700 1 --2- 172.21.15.146:0/579257223 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5764066f30 0x7f57640693e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f577c007fd0 tx=0x7f577c007eb0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:37.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.367+0000 7f57767fc700 1 -- 172.21.15.146:0/579257223 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5778051c40 con 0x7f578015a160 2023-10-06T11:10:37.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:37.595+0000 7f578853a700 1 -- 172.21.15.146:0/579257223 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f57800b3880 con 0x7f578015a160 2023-10-06T11:10:38.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.579+0000 7f57767fc700 1 -- 172.21.15.146:0/579257223 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v63) v1 ==== 118+0+0 (secure 0 0 0) 0x7f577801a0b0 con 0x7f578015a160 2023-10-06T11:10:38.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.581+0000 7f578853a700 1 -- 172.21.15.146:0/579257223 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5764066f30 msgr2=0x7f57640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:38.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.581+0000 7f578853a700 1 --2- 172.21.15.146:0/579257223 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5764066f30 0x7f57640693e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f577c007fd0 tx=0x7f577c007eb0 comp rx=0 tx=0).stop 2023-10-06T11:10:38.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.581+0000 7f578853a700 1 -- 172.21.15.146:0/579257223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f578015a160 msgr2=0x7f57800b5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:38.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.581+0000 7f578853a700 1 --2- 172.21.15.146:0/579257223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f578015a160 0x7f57800b5600 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f577800d180 tx=0x7f5778009a50 comp rx=0 tx=0).stop 2023-10-06T11:10:38.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.581+0000 7f578853a700 1 -- 172.21.15.146:0/579257223 shutdown_connections 2023-10-06T11:10:38.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.581+0000 7f578853a700 1 --2- 172.21.15.146:0/579257223 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5764066f30 0x7f57640693e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:38.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.581+0000 7f578853a700 1 --2- 172.21.15.146:0/579257223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f578015a160 0x7f57800b5600 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:38.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.581+0000 7f578853a700 1 --2- 172.21.15.146:0/579257223 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57800ae730 0x7f5780157260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:38.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.581+0000 7f578853a700 1 --2- 172.21.15.146:0/579257223 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57800cb950 0x7f57800c8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:38.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.581+0000 7f578853a700 1 -- 172.21.15.146:0/579257223 >> 172.21.15.146:0/579257223 conn(0x7f578006f380 msgr2=0x7f5780159360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:38.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.581+0000 7f578853a700 1 -- 172.21.15.146:0/579257223 shutdown_connections 2023-10-06T11:10:38.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.581+0000 7f578853a700 1 -- 172.21.15.146:0/579257223 wait complete. 2023-10-06T11:10:38.596 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T11:10:38.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.713+0000 7fa5b3c29700 1 Processor -- start 2023-10-06T11:10:38.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.713+0000 7fa5b3c29700 1 -- start start 2023-10-06T11:10:38.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.714+0000 7fa5b3c29700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5ac1577a0 0x7fa5ac0ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:38.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.714+0000 7fa5b3c29700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa5ac0c90c0 0x7fa5ac0c2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:38.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.714+0000 7fa5b3c29700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5ac0c20c0 con 0x7fa5ac0cf060 2023-10-06T11:10:38.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.714+0000 7fa5b3c29700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5ac0c9890 con 0x7fa5ac0c90c0 2023-10-06T11:10:38.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.714+0000 7fa5b3c29700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac0c9b70 con 0x7fa5ac1577a0 2023-10-06T11:10:38.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.714+0000 7fa5b11c4700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa5ac0cf060 0x7fa5ac0c89b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59502/0 (socket says 172.21.15.146:59502) 2023-10-06T11:10:38.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.714+0000 7fa5b11c4700 1 -- 172.21.15.146:0/3067504181 learned_addr learned my addr 172.21.15.146:0/3067504181 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:10:38.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.714+0000 7fa5b21c6700 1 --2- 172.21.15.146:0/3067504181 >> v2:172.21.15.151:3300/0 conn(0x7fa5ac0c90c0 0x7fa5ac0c2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:38.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.714+0000 7fa5b19c5700 1 --2- 172.21.15.146:0/3067504181 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5ac1577a0 0x7fa5ac0ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:38.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.715+0000 7fa5b09c3700 1 -- 172.21.15.146:0/3067504181 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3633081940 0 0) 0x7fa5ac0c20c0 con 0x7fa5ac0cf060 2023-10-06T11:10:38.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.715+0000 7fa5b09c3700 1 -- 172.21.15.146:0/3067504181 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa598003570 con 0x7fa5ac0cf060 2023-10-06T11:10:38.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.715+0000 7fa5b09c3700 1 -- 172.21.15.146:0/3067504181 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1202280772 0 0) 0x7fa598003570 con 0x7fa5ac0cf060 2023-10-06T11:10:38.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.715+0000 7fa5b09c3700 1 -- 172.21.15.146:0/3067504181 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5ac1577a0 msgr2=0x7fa5ac0ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:38.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.715+0000 7fa5b09c3700 1 --2- 172.21.15.146:0/3067504181 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5ac1577a0 0x7fa5ac0ceb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:38.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.715+0000 7fa5b09c3700 1 -- 172.21.15.146:0/3067504181 >> v2:172.21.15.151:3300/0 conn(0x7fa5ac0c90c0 msgr2=0x7fa5ac0c2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:38.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.715+0000 7fa5b09c3700 1 --2- 172.21.15.146:0/3067504181 >> v2:172.21.15.151:3300/0 conn(0x7fa5ac0c90c0 0x7fa5ac0c2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:38.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.715+0000 7fa5b09c3700 1 -- 172.21.15.146:0/3067504181 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ac0c9e50 con 0x7fa5ac0cf060 2023-10-06T11:10:38.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.715+0000 7fa5b09c3700 1 -- 172.21.15.146:0/3067504181 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fa59c001470 con 0x7fa5ac0cf060 2023-10-06T11:10:38.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.715+0000 7fa5b09c3700 1 -- 172.21.15.146:0/3067504181 >> v1:172.21.15.146:6789/0 conn(0x7fa5ac0cf060 legacy=0x7fa5ac0c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:38.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.715+0000 7fa5b09c3700 1 --2- 172.21.15.146:0/3067504181 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5ac1577a0 0x7fa598003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:38.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.715+0000 7fa5b09c3700 1 --2- 172.21.15.146:0/3067504181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa598003fe0 0x7fa598004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:38.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.715+0000 7fa5b09c3700 1 --2- 172.21.15.146:0/3067504181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa598004d50 0x7fa5980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:38.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.715+0000 7fa5b09c3700 1 -- 172.21.15.146:0/3067504181 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac0c9890 con 0x7fa598004d50 2023-10-06T11:10:38.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.715+0000 7fa5b09c3700 1 -- 172.21.15.146:0/3067504181 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac0c9b70 con 0x7fa598003fe0 2023-10-06T11:10:38.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.715+0000 7fa5b09c3700 1 -- 172.21.15.146:0/3067504181 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa59800ba90 con 0x7fa5ac1577a0 2023-10-06T11:10:38.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.715+0000 7fa5b21c6700 1 --2- 172.21.15.146:0/3067504181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa598004d50 0x7fa5980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:38.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.715+0000 7fa5b11c4700 1 --2- 172.21.15.146:0/3067504181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa598003fe0 0x7fa598004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:38.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.715+0000 7fa5b19c5700 1 --2- 172.21.15.146:0/3067504181 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5ac1577a0 0x7fa598003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:38.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.715+0000 7fa5b21c6700 1 -- 172.21.15.146:0/3067504181 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5ac1577a0 msgr2=0x7fa598003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:38.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.715+0000 7fa5b21c6700 1 --2- 172.21.15.146:0/3067504181 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5ac1577a0 0x7fa598003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:38.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.715+0000 7fa5b21c6700 1 -- 172.21.15.146:0/3067504181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa598003fe0 msgr2=0x7fa598004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:38.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.715+0000 7fa5b21c6700 1 --2- 172.21.15.146:0/3067504181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa598003fe0 0x7fa598004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:38.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.715+0000 7fa5b21c6700 1 -- 172.21.15.146:0/3067504181 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa598003570 con 0x7fa598004d50 2023-10-06T11:10:38.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.715+0000 7fa5b21c6700 1 --2- 172.21.15.146:0/3067504181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa598004d50 0x7fa5980051c0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fa5a4009c00 tx=0x7fa5a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d0746f91d6e9d3d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:38.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.716+0000 7fa5b09c3700 1 -- 172.21.15.146:0/3067504181 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a400e6b0 con 0x7fa598004d50 2023-10-06T11:10:38.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.716+0000 7fa5b09c3700 1 -- 172.21.15.146:0/3067504181 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a400e810 con 0x7fa598004d50 2023-10-06T11:10:38.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.716+0000 7fa5b09c3700 1 -- 172.21.15.146:0/3067504181 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a400ebd0 con 0x7fa598004d50 2023-10-06T11:10:38.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.716+0000 7fa5b3c29700 1 -- 172.21.15.146:0/3067504181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa598004d50 msgr2=0x7fa5980051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:38.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.716+0000 7fa5b3c29700 1 --2- 172.21.15.146:0/3067504181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa598004d50 0x7fa5980051c0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fa5a4009c00 tx=0x7fa5a40091a0 comp rx=0 tx=0).stop 2023-10-06T11:10:38.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.716+0000 7fa5b21c6700 1 -- 172.21.15.146:0/3067504181 reap_dead start 2023-10-06T11:10:38.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.716+0000 7fa5b3c29700 1 -- 172.21.15.146:0/3067504181 shutdown_connections 2023-10-06T11:10:38.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.716+0000 7fa5b3c29700 1 -- 172.21.15.146:0/3067504181 >> 172.21.15.146:0/3067504181 conn(0x7fa5ac067c50 msgr2=0x7fa5ac0ce410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:38.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.716+0000 7fa5b3c29700 1 -- 172.21.15.146:0/3067504181 shutdown_connections 2023-10-06T11:10:38.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.716+0000 7fa5b3c29700 1 -- 172.21.15.146:0/3067504181 wait complete. 2023-10-06T11:10:38.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.717+0000 7fa5b3c29700 1 Processor -- start 2023-10-06T11:10:38.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.717+0000 7fa5b3c29700 1 -- start start 2023-10-06T11:10:38.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.718+0000 7fa5b3c29700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa598004d50 0x7fa5ac167630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:38.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.718+0000 7fa5b3c29700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5ac15c2d0 0x7fa5ac1553a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:38.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.718+0000 7fa5b3c29700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5ac15c740 0x7fa5ac1558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:38.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.718+0000 7fa5b3c29700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac0c74f0 con 0x7fa598004d50 2023-10-06T11:10:38.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.718+0000 7fa5b3c29700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac09bfb0 con 0x7fa5ac15c2d0 2023-10-06T11:10:38.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.718+0000 7fa5b3c29700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac155e20 con 0x7fa5ac15c740 2023-10-06T11:10:38.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.718+0000 7fa5b19c5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa598004d50 0x7fa5ac167630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:38.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.718+0000 7fa5b19c5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa598004d50 0x7fa5ac167630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59598/0 (socket says 172.21.15.146:59598) 2023-10-06T11:10:38.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.718+0000 7fa5b19c5700 1 -- 172.21.15.146:0/994420878 learned_addr learned my addr 172.21.15.146:0/994420878 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:38.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.718+0000 7fa5b21c6700 1 --2- 172.21.15.146:0/994420878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5ac15c740 0x7fa5ac1558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:38.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.718+0000 7fa5b11c4700 1 --2- 172.21.15.146:0/994420878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5ac15c2d0 0x7fa5ac1553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:38.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.718+0000 7fa5b19c5700 1 -- 172.21.15.146:0/994420878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5ac15c740 msgr2=0x7fa5ac1558e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:38.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.718+0000 7fa5b19c5700 1 --2- 172.21.15.146:0/994420878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5ac15c740 0x7fa5ac1558e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:38.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.718+0000 7fa5b19c5700 1 -- 172.21.15.146:0/994420878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5ac15c2d0 msgr2=0x7fa5ac1553a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:38.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.718+0000 7fa5b19c5700 1 --2- 172.21.15.146:0/994420878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5ac15c2d0 0x7fa5ac1553a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:38.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.718+0000 7fa5b19c5700 1 -- 172.21.15.146:0/994420878 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ac09bcd0 con 0x7fa598004d50 2023-10-06T11:10:38.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.719+0000 7fa5b19c5700 1 --2- 172.21.15.146:0/994420878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa598004d50 0x7fa5ac167630 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8011f80 tx=0x7fa5a800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:38.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.719+0000 7fa5a1ffb700 1 -- 172.21.15.146:0/994420878 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a800e040 con 0x7fa598004d50 2023-10-06T11:10:38.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.719+0000 7fa5a1ffb700 1 -- 172.21.15.146:0/994420878 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a800f040 con 0x7fa598004d50 2023-10-06T11:10:38.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.719+0000 7fa5b3c29700 1 -- 172.21.15.146:0/994420878 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5ac0c6e30 con 0x7fa598004d50 2023-10-06T11:10:38.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.719+0000 7fa5a1ffb700 1 -- 172.21.15.146:0/994420878 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a800fed0 con 0x7fa598004d50 2023-10-06T11:10:38.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.719+0000 7fa5b3c29700 1 -- 172.21.15.146:0/994420878 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5ac09af60 con 0x7fa598004d50 2023-10-06T11:10:38.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.720+0000 7fa5b3c29700 1 -- 172.21.15.146:0/994420878 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5ac04c380 con 0x7fa598004d50 2023-10-06T11:10:38.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.720+0000 7fa5a1ffb700 1 -- 172.21.15.146:0/994420878 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa5a8015640 con 0x7fa598004d50 2023-10-06T11:10:38.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.721+0000 7fa5a1ffb700 1 --2- 172.21.15.146:0/994420878 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa590066f30 0x7fa5900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:38.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.721+0000 7fa5a1ffb700 1 -- 172.21.15.146:0/994420878 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa5a80851b0 con 0x7fa598004d50 2023-10-06T11:10:38.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.721+0000 7fa5b11c4700 1 --2- 172.21.15.146:0/994420878 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa590066f30 0x7fa5900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:38.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.721+0000 7fa5b11c4700 1 --2- 172.21.15.146:0/994420878 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa590066f30 0x7fa5900693e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa59c000e50 tx=0x7fa59c001e90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:38.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.725+0000 7fa5a1ffb700 1 -- 172.21.15.146:0/994420878 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa5a80522c0 con 0x7fa598004d50 2023-10-06T11:10:38.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:38.953+0000 7fa5b3c29700 1 -- 172.21.15.146:0/994420878 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa5ac0c9540 con 0x7fa598004d50 2023-10-06T11:10:39.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.584+0000 7fa5a1ffb700 1 -- 172.21.15.146:0/994420878 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v64) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa5a80558e0 con 0x7fa598004d50 2023-10-06T11:10:39.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.587+0000 7fa5b3c29700 1 -- 172.21.15.146:0/994420878 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa590066f30 msgr2=0x7fa5900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:39.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.587+0000 7fa5b3c29700 1 --2- 172.21.15.146:0/994420878 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa590066f30 0x7fa5900693e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fa59c000e50 tx=0x7fa59c001e90 comp rx=0 tx=0).stop 2023-10-06T11:10:39.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.587+0000 7fa5b3c29700 1 -- 172.21.15.146:0/994420878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa598004d50 msgr2=0x7fa5ac167630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:39.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.587+0000 7fa5b3c29700 1 --2- 172.21.15.146:0/994420878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa598004d50 0x7fa5ac167630 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8011f80 tx=0x7fa5a800b040 comp rx=0 tx=0).stop 2023-10-06T11:10:39.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.587+0000 7fa5b3c29700 1 -- 172.21.15.146:0/994420878 shutdown_connections 2023-10-06T11:10:39.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.587+0000 7fa5b3c29700 1 --2- 172.21.15.146:0/994420878 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa590066f30 0x7fa5900693e0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:39.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.587+0000 7fa5b3c29700 1 --2- 172.21.15.146:0/994420878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5ac15c740 0x7fa5ac1558e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:39.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.587+0000 7fa5b3c29700 1 --2- 172.21.15.146:0/994420878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa598004d50 0x7fa5ac167630 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:39.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.587+0000 7fa5b3c29700 1 --2- 172.21.15.146:0/994420878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5ac15c2d0 0x7fa5ac1553a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:39.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.587+0000 7fa5b3c29700 1 -- 172.21.15.146:0/994420878 >> 172.21.15.146:0/994420878 conn(0x7fa5ac067c50 msgr2=0x7fa5ac156b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:39.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.587+0000 7fa5b3c29700 1 -- 172.21.15.146:0/994420878 shutdown_connections 2023-10-06T11:10:39.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.587+0000 7fa5b3c29700 1 -- 172.21.15.146:0/994420878 wait complete. 2023-10-06T11:10:39.601 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:10:39.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.713+0000 7f8a67fff700 1 Processor -- start 2023-10-06T11:10:39.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.713+0000 7f8a67fff700 1 -- start start 2023-10-06T11:10:39.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.714+0000 7f8a67fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8a6815a420 0x7f8a6815cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:39.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.714+0000 7f8a67fff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8a6815a7f0 0x7f8a680b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:39.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.714+0000 7f8a67fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a6815c630 con 0x7f8a680b2360 2023-10-06T11:10:39.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.714+0000 7f8a67fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a680ce040 con 0x7f8a6815a420 2023-10-06T11:10:39.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.714+0000 7f8a67fff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a680b2780 con 0x7f8a6815a7f0 2023-10-06T11:10:39.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.714+0000 7f8a66ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8a6815a420 0x7f8a6815cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:39.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.714+0000 7f8a677fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8a680b2360 0x7f8a6815acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59514/0 (socket says 172.21.15.146:59514) 2023-10-06T11:10:39.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.714+0000 7f8a677fe700 1 -- 172.21.15.146:0/302229867 learned_addr learned my addr 172.21.15.146:0/302229867 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:10:39.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.714+0000 7f8a5e7fc700 1 --2- 172.21.15.146:0/302229867 >> v2:172.21.15.151:3300/0 conn(0x7f8a6815a7f0 0x7f8a680b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:39.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.714+0000 7f8a66ffd700 1 -- 172.21.15.146:0/302229867 >> v2:172.21.15.151:3300/0 conn(0x7f8a6815a7f0 msgr2=0x7f8a680b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:39.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.714+0000 7f8a66ffd700 1 --2- 172.21.15.146:0/302229867 >> v2:172.21.15.151:3300/0 conn(0x7f8a6815a7f0 0x7f8a680b1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:39.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.715+0000 7f8a66ffd700 1 -- 172.21.15.146:0/302229867 >> v1:172.21.15.146:6789/0 conn(0x7f8a680b2360 legacy=0x7f8a6815acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:39.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.715+0000 7f8a667fc700 1 -- 172.21.15.146:0/302229867 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3168562462 0 0) 0x7f8a6815c630 con 0x7f8a680b2360 2023-10-06T11:10:39.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.715+0000 7f8a66ffd700 1 -- 172.21.15.146:0/302229867 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a6815ba20 con 0x7f8a6815a420 2023-10-06T11:10:39.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.715+0000 7f8a5e7fc700 1 --2- 172.21.15.146:0/302229867 >> v2:172.21.15.151:3300/0 conn(0x7f8a6815a7f0 0x7f8a680b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:10:39.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.715+0000 7f8a66ffd700 1 --2- 172.21.15.146:0/302229867 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a6815a420 0x7f8a6815cac0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f8a680b33c0 tx=0x7f8a580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b58f8c84f089c4a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:39.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.715+0000 7f8a667fc700 1 -- 172.21.15.146:0/302229867 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5800b6b0 con 0x7f8a6815a420 2023-10-06T11:10:39.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.715+0000 7f8a667fc700 1 -- 172.21.15.146:0/302229867 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a5800b810 con 0x7f8a6815a420 2023-10-06T11:10:39.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.715+0000 7f8a667fc700 1 -- 172.21.15.146:0/302229867 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a5800bbb0 con 0x7f8a6815a420 2023-10-06T11:10:39.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.715+0000 7f8a67fff700 1 -- 172.21.15.146:0/302229867 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a6815a420 msgr2=0x7f8a6815cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:39.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.715+0000 7f8a67fff700 1 --2- 172.21.15.146:0/302229867 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a6815a420 0x7f8a6815cac0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f8a680b33c0 tx=0x7f8a580091a0 comp rx=0 tx=0).stop 2023-10-06T11:10:39.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.715+0000 7f8a67fff700 1 -- 172.21.15.146:0/302229867 shutdown_connections 2023-10-06T11:10:39.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.715+0000 7f8a67fff700 1 --2- 172.21.15.146:0/302229867 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a6815a420 0x7f8a6815cac0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:39.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.715+0000 7f8a67fff700 1 --2- 172.21.15.146:0/302229867 >> v2:172.21.15.151:3300/0 conn(0x7f8a6815a7f0 0x7f8a680b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:39.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.715+0000 7f8a67fff700 1 -- 172.21.15.146:0/302229867 >> 172.21.15.146:0/302229867 conn(0x7f8a6806eba0 msgr2=0x7f8a6806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:39.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.715+0000 7f8a67fff700 1 -- 172.21.15.146:0/302229867 shutdown_connections 2023-10-06T11:10:39.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.715+0000 7f8a67fff700 1 -- 172.21.15.146:0/302229867 wait complete. 2023-10-06T11:10:39.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.717+0000 7f8a67fff700 1 Processor -- start 2023-10-06T11:10:39.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.717+0000 7f8a67fff700 1 -- start start 2023-10-06T11:10:39.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.717+0000 7f8a67fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a680b2360 0x7f8a6816c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:39.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.717+0000 7f8a67fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a6815a420 0x7f8a6814d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:39.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.717+0000 7f8a67fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a6815a7f0 0x7f8a6814dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:39.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.717+0000 7f8a67fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6816a7a0 con 0x7f8a6815a7f0 2023-10-06T11:10:39.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.717+0000 7f8a67fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a6816ce10 con 0x7f8a6815a420 2023-10-06T11:10:39.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.717+0000 7f8a67fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a68169e70 con 0x7f8a680b2360 2023-10-06T11:10:39.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.718+0000 7f8a677fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a6815a7f0 0x7f8a6814dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:39.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.718+0000 7f8a677fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a6815a7f0 0x7f8a6814dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59618/0 (socket says 172.21.15.146:59618) 2023-10-06T11:10:39.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.718+0000 7f8a677fe700 1 -- 172.21.15.146:0/972858481 learned_addr learned my addr 172.21.15.146:0/972858481 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:39.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.718+0000 7f8a5e7fc700 1 --2- 172.21.15.146:0/972858481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a6815a420 0x7f8a6814d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:39.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.718+0000 7f8a66ffd700 1 --2- 172.21.15.146:0/972858481 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a680b2360 0x7f8a6816c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:39.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.718+0000 7f8a677fe700 1 -- 172.21.15.146:0/972858481 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a680b2360 msgr2=0x7f8a6816c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:39.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.718+0000 7f8a677fe700 1 --2- 172.21.15.146:0/972858481 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a680b2360 0x7f8a6816c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:39.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.718+0000 7f8a677fe700 1 -- 172.21.15.146:0/972858481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a6815a420 msgr2=0x7f8a6814d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:39.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.718+0000 7f8a677fe700 1 --2- 172.21.15.146:0/972858481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a6815a420 0x7f8a6814d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:39.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.718+0000 7f8a677fe700 1 -- 172.21.15.146:0/972858481 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a58009420 con 0x7f8a6815a7f0 2023-10-06T11:10:39.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.718+0000 7f8a677fe700 1 --2- 172.21.15.146:0/972858481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a6815a7f0 0x7f8a6814dd70 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f8a6000cbf0 tx=0x7f8a600019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:39.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.718+0000 7f8a5f7fe700 1 -- 172.21.15.146:0/972858481 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6000a8b0 con 0x7f8a6815a7f0 2023-10-06T11:10:39.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.718+0000 7f8a5f7fe700 1 -- 172.21.15.146:0/972858481 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a6000aa10 con 0x7f8a6815a7f0 2023-10-06T11:10:39.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.718+0000 7f8a67fff700 1 -- 172.21.15.146:0/972858481 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a6816a150 con 0x7f8a6815a7f0 2023-10-06T11:10:39.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.718+0000 7f8a5f7fe700 1 -- 172.21.15.146:0/972858481 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6000add0 con 0x7f8a6815a7f0 2023-10-06T11:10:39.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.718+0000 7f8a67fff700 1 -- 172.21.15.146:0/972858481 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a68169ad0 con 0x7f8a6815a7f0 2023-10-06T11:10:39.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.719+0000 7f8a67fff700 1 -- 172.21.15.146:0/972858481 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a680afae0 con 0x7f8a6815a7f0 2023-10-06T11:10:39.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.719+0000 7f8a5f7fe700 1 -- 172.21.15.146:0/972858481 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8a60007300 con 0x7f8a6815a7f0 2023-10-06T11:10:39.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.720+0000 7f8a5f7fe700 1 --2- 172.21.15.146:0/972858481 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8a48066f30 0x7f8a480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:39.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.720+0000 7f8a5f7fe700 1 -- 172.21.15.146:0/972858481 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8a60084960 con 0x7f8a6815a7f0 2023-10-06T11:10:39.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.720+0000 7f8a66ffd700 1 --2- 172.21.15.146:0/972858481 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8a48066f30 0x7f8a480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:39.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.720+0000 7f8a66ffd700 1 --2- 172.21.15.146:0/972858481 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8a48066f30 0x7f8a480693e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8a580093f0 tx=0x7f8a58017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:39.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.724+0000 7f8a5f7fe700 1 -- 172.21.15.146:0/972858481 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8a60051af0 con 0x7f8a6815a7f0 2023-10-06T11:10:39.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.947+0000 7f8a67fff700 1 -- 172.21.15.146:0/972858481 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a6816a8e0 con 0x7f8a6815a7f0 2023-10-06T11:10:39.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.948+0000 7f8a5f7fe700 1 -- 172.21.15.146:0/972858481 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4611 (secure 0 0 0) 0x7f8a60055110 con 0x7f8a6815a7f0 2023-10-06T11:10:39.950 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:10:39.950 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":64,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6274,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3700176588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3700176588},{"type":"v1","addr":"172.21.15.151:6834","nonce":3700176588}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6771,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/3753626989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3753626989},{"type":"v1","addr":"172.21.15.146:6836","nonce":3753626989}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6774,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/1712863503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":1712863503},{"type":"v1","addr":"172.21.15.146:6837","nonce":1712863503}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:10:35.928535+0000","modified":"2023-10-06T11:10:39.579368+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6786},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6786":{"gid":6786,"name":"b","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6835/3649668257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":3649668257},{"type":"v1","addr":"172.21.15.151:6835","nonce":3649668257}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T11:10:39.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.950+0000 7f8a67fff700 1 -- 172.21.15.146:0/972858481 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8a48066f30 msgr2=0x7f8a480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:39.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.950+0000 7f8a67fff700 1 --2- 172.21.15.146:0/972858481 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8a48066f30 0x7f8a480693e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8a580093f0 tx=0x7f8a58017000 comp rx=0 tx=0).stop 2023-10-06T11:10:39.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.950+0000 7f8a67fff700 1 -- 172.21.15.146:0/972858481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a6815a7f0 msgr2=0x7f8a6814dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:39.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.950+0000 7f8a67fff700 1 --2- 172.21.15.146:0/972858481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a6815a7f0 0x7f8a6814dd70 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f8a6000cbf0 tx=0x7f8a600019b0 comp rx=0 tx=0).stop 2023-10-06T11:10:39.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.950+0000 7f8a67fff700 1 -- 172.21.15.146:0/972858481 shutdown_connections 2023-10-06T11:10:39.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.950+0000 7f8a67fff700 1 --2- 172.21.15.146:0/972858481 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8a48066f30 0x7f8a480693e0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:39.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.950+0000 7f8a67fff700 1 --2- 172.21.15.146:0/972858481 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8a6815a7f0 0x7f8a6814dd70 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:39.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.950+0000 7f8a67fff700 1 --2- 172.21.15.146:0/972858481 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8a680b2360 0x7f8a6816c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:39.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.950+0000 7f8a67fff700 1 --2- 172.21.15.146:0/972858481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a6815a420 0x7f8a6814d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:39.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.950+0000 7f8a67fff700 1 -- 172.21.15.146:0/972858481 >> 172.21.15.146:0/972858481 conn(0x7f8a6806eba0 msgr2=0x7f8a6814ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:39.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.950+0000 7f8a67fff700 1 -- 172.21.15.146:0/972858481 shutdown_connections 2023-10-06T11:10:39.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:39.950+0000 7f8a67fff700 1 -- 172.21.15.146:0/972858481 wait complete. 2023-10-06T11:10:39.954 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 64 2023-10-06T11:10:39.966 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:10:40.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.078+0000 7f37200bd700 1 Processor -- start 2023-10-06T11:10:40.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.078+0000 7f37200bd700 1 -- start start 2023-10-06T11:10:40.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.079+0000 7f37200bd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3718153ab0 0x7f371815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:40.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.079+0000 7f37200bd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3718068ba0 0x7f37180b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:40.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.079+0000 7f37200bd700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f371815ac30 con 0x7f3718153e80 2023-10-06T11:10:40.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.079+0000 7f37200bd700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37180b4510 con 0x7f3718068ba0 2023-10-06T11:10:40.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.079+0000 7f37200bd700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37180b6530 con 0x7f3718153ab0 2023-10-06T11:10:40.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.079+0000 7f371e65a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3718068ba0 0x7f37180b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:40.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.079+0000 7f371d658700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3718153e80 0x7f3718068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59522/0 (socket says 172.21.15.146:59522) 2023-10-06T11:10:40.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.080+0000 7f371d658700 1 -- 172.21.15.146:0/1196182876 learned_addr learned my addr 172.21.15.146:0/1196182876 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:10:40.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.080+0000 7f371de59700 1 --2- 172.21.15.146:0/1196182876 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3718153ab0 0x7f371815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:40.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.080+0000 7f371e65a700 1 -- 172.21.15.146:0/1196182876 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3718153ab0 msgr2=0x7f371815a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:40.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.080+0000 7f371e65a700 1 --2- 172.21.15.146:0/1196182876 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3718153ab0 0x7f371815a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:40.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.080+0000 7f371e65a700 1 -- 172.21.15.146:0/1196182876 >> v1:172.21.15.146:6789/0 conn(0x7f3718153e80 legacy=0x7f3718068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:40.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.080+0000 7f371ce57700 1 -- 172.21.15.146:0/1196182876 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 181599069 0 0) 0x7f3708001110 con 0x7f3718153e80 2023-10-06T11:10:40.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.080+0000 7f371e65a700 1 -- 172.21.15.146:0/1196182876 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37180b5c50 con 0x7f3718068ba0 2023-10-06T11:10:40.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.080+0000 7f371e65a700 1 --2- 172.21.15.146:0/1196182876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3718068ba0 0x7f37180b49a0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f37100098e0 tx=0x7f37100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb7898b307031df1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:40.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.080+0000 7f371ce57700 1 -- 172.21.15.146:0/1196182876 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371000b640 con 0x7f3718068ba0 2023-10-06T11:10:40.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.080+0000 7f371ce57700 1 -- 172.21.15.146:0/1196182876 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f371000b7a0 con 0x7f3718068ba0 2023-10-06T11:10:40.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.080+0000 7f371ce57700 1 -- 172.21.15.146:0/1196182876 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371000bb40 con 0x7f3718068ba0 2023-10-06T11:10:40.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.081+0000 7f37200bd700 1 -- 172.21.15.146:0/1196182876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3718068ba0 msgr2=0x7f37180b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:40.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.081+0000 7f37200bd700 1 --2- 172.21.15.146:0/1196182876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3718068ba0 0x7f37180b49a0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f37100098e0 tx=0x7f37100091a0 comp rx=0 tx=0).stop 2023-10-06T11:10:40.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.081+0000 7f37200bd700 1 -- 172.21.15.146:0/1196182876 shutdown_connections 2023-10-06T11:10:40.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.081+0000 7f37200bd700 1 --2- 172.21.15.146:0/1196182876 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3718068ba0 0x7f37180b49a0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:40.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.081+0000 7f37200bd700 1 --2- 172.21.15.146:0/1196182876 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3718153ab0 0x7f371815a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:40.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.081+0000 7f37200bd700 1 -- 172.21.15.146:0/1196182876 >> 172.21.15.146:0/1196182876 conn(0x7f371806eba0 msgr2=0x7f371806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:40.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.081+0000 7f37200bd700 1 -- 172.21.15.146:0/1196182876 shutdown_connections 2023-10-06T11:10:40.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.081+0000 7f37200bd700 1 -- 172.21.15.146:0/1196182876 wait complete. 2023-10-06T11:10:40.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.082+0000 7f37200bd700 1 Processor -- start 2023-10-06T11:10:40.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.082+0000 7f37200bd700 1 -- start start 2023-10-06T11:10:40.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.083+0000 7f37200bd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3718068ba0 0x7f371814c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:40.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.083+0000 7f37200bd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3718153ab0 0x7f37180b26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:40.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.083+0000 7f37200bd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3718153e80 0x7f371815bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:40.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.083+0000 7f37200bd700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37180b1430 con 0x7f3718153e80 2023-10-06T11:10:40.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.083+0000 7f37200bd700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37180b2250 con 0x7f3718068ba0 2023-10-06T11:10:40.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.083+0000 7f37200bd700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f371814c800 con 0x7f3718153ab0 2023-10-06T11:10:40.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.083+0000 7f371e65a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3718153e80 0x7f371815bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:40.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.083+0000 7f371e65a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3718153e80 0x7f371815bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59646/0 (socket says 172.21.15.146:59646) 2023-10-06T11:10:40.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.083+0000 7f371e65a700 1 -- 172.21.15.146:0/1477386427 learned_addr learned my addr 172.21.15.146:0/1477386427 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:40.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.083+0000 7f371d658700 1 --2- 172.21.15.146:0/1477386427 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3718153ab0 0x7f37180b26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:40.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.083+0000 7f371e65a700 1 -- 172.21.15.146:0/1477386427 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3718153ab0 msgr2=0x7f37180b26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:40.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.083+0000 7f371e65a700 1 --2- 172.21.15.146:0/1477386427 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3718153ab0 0x7f37180b26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:40.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.083+0000 7f371e65a700 1 -- 172.21.15.146:0/1477386427 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3718068ba0 msgr2=0x7f371814c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:40.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.083+0000 7f371de59700 1 --2- 172.21.15.146:0/1477386427 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3718068ba0 0x7f371814c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:40.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.083+0000 7f371e65a700 1 --2- 172.21.15.146:0/1477386427 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3718068ba0 0x7f371814c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:40.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.083+0000 7f371e65a700 1 -- 172.21.15.146:0/1477386427 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3710009420 con 0x7f3718153e80 2023-10-06T11:10:40.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.083+0000 7f371e65a700 1 --2- 172.21.15.146:0/1477386427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3718153e80 0x7f371815bff0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f3710013000 tx=0x7f3710017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:40.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.083+0000 7f370dffb700 1 -- 172.21.15.146:0/1477386427 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3710011420 con 0x7f3718153e80 2023-10-06T11:10:40.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.083+0000 7f370dffb700 1 -- 172.21.15.146:0/1477386427 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3710011580 con 0x7f3718153e80 2023-10-06T11:10:40.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.083+0000 7f37200bd700 1 -- 172.21.15.146:0/1477386427 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37180b1640 con 0x7f3718153e80 2023-10-06T11:10:40.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.083+0000 7f370dffb700 1 -- 172.21.15.146:0/1477386427 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3710011920 con 0x7f3718153e80 2023-10-06T11:10:40.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.084+0000 7f37200bd700 1 -- 172.21.15.146:0/1477386427 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37180b1c00 con 0x7f3718153e80 2023-10-06T11:10:40.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.084+0000 7f37200bd700 1 -- 172.21.15.146:0/1477386427 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37180b23e0 con 0x7f3718153e80 2023-10-06T11:10:40.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.085+0000 7f370dffb700 1 -- 172.21.15.146:0/1477386427 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3710011c90 con 0x7f3718153e80 2023-10-06T11:10:40.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.085+0000 7f370dffb700 1 --2- 172.21.15.146:0/1477386427 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f36fc066f30 0x7f36fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:40.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.085+0000 7f370dffb700 1 -- 172.21.15.146:0/1477386427 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3710086190 con 0x7f3718153e80 2023-10-06T11:10:40.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.085+0000 7f371de59700 1 --2- 172.21.15.146:0/1477386427 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f36fc066f30 0x7f36fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:40.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.086+0000 7f371de59700 1 --2- 172.21.15.146:0/1477386427 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f36fc066f30 0x7f36fc0693e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f37140076c0 tx=0x7f371400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:40.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.090+0000 7f370dffb700 1 -- 172.21.15.146:0/1477386427 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f37100532a0 con 0x7f3718153e80 2023-10-06T11:10:40.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.272+0000 7f37200bd700 1 -- 172.21.15.146:0/1477386427 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37180b6250 con 0x7f3718153e80 2023-10-06T11:10:40.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.273+0000 7f370dffb700 1 -- 172.21.15.146:0/1477386427 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+16917 (secure 0 0 0) 0x7f37100568c0 con 0x7f3718153e80 2023-10-06T11:10:40.275 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:10:40.275 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":75,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:10:37.546095+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:10:33.590163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-10-06T11:10:34.892777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:10:40.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.275+0000 7f37200bd700 1 -- 172.21.15.146:0/1477386427 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f36fc066f30 msgr2=0x7f36fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:40.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.275+0000 7f37200bd700 1 --2- 172.21.15.146:0/1477386427 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f36fc066f30 0x7f36fc0693e0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f37140076c0 tx=0x7f371400b040 comp rx=0 tx=0).stop 2023-10-06T11:10:40.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.275+0000 7f37200bd700 1 -- 172.21.15.146:0/1477386427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3718153e80 msgr2=0x7f371815bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:40.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.275+0000 7f37200bd700 1 --2- 172.21.15.146:0/1477386427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3718153e80 0x7f371815bff0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f3710013000 tx=0x7f3710017000 comp rx=0 tx=0).stop 2023-10-06T11:10:40.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.275+0000 7f37200bd700 1 -- 172.21.15.146:0/1477386427 shutdown_connections 2023-10-06T11:10:40.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.275+0000 7f37200bd700 1 --2- 172.21.15.146:0/1477386427 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f36fc066f30 0x7f36fc0693e0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:40.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.275+0000 7f37200bd700 1 --2- 172.21.15.146:0/1477386427 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3718153e80 0x7f371815bff0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:40.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.275+0000 7f37200bd700 1 --2- 172.21.15.146:0/1477386427 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3718068ba0 0x7f371814c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:40.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.275+0000 7f37200bd700 1 --2- 172.21.15.146:0/1477386427 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3718153ab0 0x7f37180b26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:40.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.275+0000 7f37200bd700 1 -- 172.21.15.146:0/1477386427 >> 172.21.15.146:0/1477386427 conn(0x7f371806eba0 msgr2=0x7f3718153340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:40.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.275+0000 7f37200bd700 1 -- 172.21.15.146:0/1477386427 shutdown_connections 2023-10-06T11:10:40.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.275+0000 7f37200bd700 1 -- 172.21.15.146:0/1477386427 wait complete. 2023-10-06T11:10:40.289 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T11:10:40.289 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:10:40.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.403+0000 7fc3f28a6700 1 Processor -- start 2023-10-06T11:10:40.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.403+0000 7fc3f28a6700 1 -- start start 2023-10-06T11:10:40.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.404+0000 7fc3f28a6700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc3ec157430 0x7fc3ec157800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:40.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.404+0000 7fc3f28a6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc3ec0ab010 0x7fc3ec0ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:40.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.404+0000 7fc3f28a6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3ec0cf0b0 con 0x7fc3ec0cc240 2023-10-06T11:10:40.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.404+0000 7fc3f28a6700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3ec0c3dd0 con 0x7fc3ec0ab010 2023-10-06T11:10:40.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.404+0000 7fc3f28a6700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3ec0ccf20 con 0x7fc3ec157430 2023-10-06T11:10:40.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.404+0000 7fc3eb7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc3ec0ab010 0x7fc3ec0ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:40.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.404+0000 7fc3f0e43700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc3ec0cc240 0x7fc3ec0cc6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59524/0 (socket says 172.21.15.146:59524) 2023-10-06T11:10:40.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.404+0000 7fc3f0e43700 1 -- 172.21.15.146:0/3872195903 learned_addr learned my addr 172.21.15.146:0/3872195903 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:10:40.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.405+0000 7fc3ebfff700 1 --2- 172.21.15.146:0/3872195903 >> v2:172.21.15.151:3300/0 conn(0x7fc3ec157430 0x7fc3ec157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:40.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.405+0000 7fc3eb7fe700 1 -- 172.21.15.146:0/3872195903 >> v2:172.21.15.151:3300/0 conn(0x7fc3ec157430 msgr2=0x7fc3ec157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:40.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.405+0000 7fc3eb7fe700 1 --2- 172.21.15.146:0/3872195903 >> v2:172.21.15.151:3300/0 conn(0x7fc3ec157430 0x7fc3ec157800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:40.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.405+0000 7fc3eb7fe700 1 -- 172.21.15.146:0/3872195903 >> v1:172.21.15.146:6789/0 conn(0x7fc3ec0cc240 legacy=0x7fc3ec0cc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:40.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.405+0000 7fc3eb7fe700 1 -- 172.21.15.146:0/3872195903 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ec0cd200 con 0x7fc3ec0ab010 2023-10-06T11:10:40.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.405+0000 7fc3eaffd700 1 -- 172.21.15.146:0/3872195903 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2585463853 0 0) 0x7fc3ec0cf0b0 con 0x7fc3ec0cc240 2023-10-06T11:10:40.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.405+0000 7fc3eb7fe700 1 --2- 172.21.15.146:0/3872195903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3ec0ab010 0x7fc3ec0ceb70 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec06eec0 tx=0x7fc3e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b080c483e9cb1c65 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.405+0000 7fc3eaffd700 1 -- 172.21.15.146:0/3872195903 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e000b6b0 con 0x7fc3ec0ab010 2023-10-06T11:10:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.405+0000 7fc3eaffd700 1 -- 172.21.15.146:0/3872195903 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e000b810 con 0x7fc3ec0ab010 2023-10-06T11:10:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.405+0000 7fc3eaffd700 1 -- 172.21.15.146:0/3872195903 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e000bbb0 con 0x7fc3ec0ab010 2023-10-06T11:10:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.405+0000 7fc3f28a6700 1 -- 172.21.15.146:0/3872195903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3ec0ab010 msgr2=0x7fc3ec0ceb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.405+0000 7fc3f28a6700 1 --2- 172.21.15.146:0/3872195903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3ec0ab010 0x7fc3ec0ceb70 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec06eec0 tx=0x7fc3e00091a0 comp rx=0 tx=0).stop 2023-10-06T11:10:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.406+0000 7fc3f28a6700 1 -- 172.21.15.146:0/3872195903 shutdown_connections 2023-10-06T11:10:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.406+0000 7fc3f28a6700 1 --2- 172.21.15.146:0/3872195903 >> v2:172.21.15.151:3300/0 conn(0x7fc3ec157430 0x7fc3ec157800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.406+0000 7fc3f28a6700 1 --2- 172.21.15.146:0/3872195903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3ec0ab010 0x7fc3ec0ceb70 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.406+0000 7fc3f28a6700 1 -- 172.21.15.146:0/3872195903 >> 172.21.15.146:0/3872195903 conn(0x7fc3ec067c50 msgr2=0x7fc3ec0ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.406+0000 7fc3f28a6700 1 -- 172.21.15.146:0/3872195903 shutdown_connections 2023-10-06T11:10:40.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.406+0000 7fc3f28a6700 1 -- 172.21.15.146:0/3872195903 wait complete. 2023-10-06T11:10:40.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.407+0000 7fc3f28a6700 1 Processor -- start 2023-10-06T11:10:40.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.407+0000 7fc3f28a6700 1 -- start start 2023-10-06T11:10:40.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.407+0000 7fc3f28a6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3ec0ab010 0x7fc3ec153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:40.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.407+0000 7fc3f28a6700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3ec0cc240 0x7fc3ec0ab520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:40.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.407+0000 7fc3f28a6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3ec157430 0x7fc3ec0b2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:40.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.407+0000 7fc3f28a6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ec0b1b30 con 0x7fc3ec0ab010 2023-10-06T11:10:40.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.407+0000 7fc3f28a6700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ec0b2650 con 0x7fc3ec0cc240 2023-10-06T11:10:40.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.408+0000 7fc3f28a6700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ec0b1d20 con 0x7fc3ec157430 2023-10-06T11:10:40.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.408+0000 7fc3ebfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3ec0ab010 0x7fc3ec153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:40.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.408+0000 7fc3ebfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3ec0ab010 0x7fc3ec153f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59658/0 (socket says 172.21.15.146:59658) 2023-10-06T11:10:40.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.408+0000 7fc3ebfff700 1 -- 172.21.15.146:0/2813478713 learned_addr learned my addr 172.21.15.146:0/2813478713 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:40.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.408+0000 7fc3eb7fe700 1 --2- 172.21.15.146:0/2813478713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3ec0cc240 0x7fc3ec0ab520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:40.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.408+0000 7fc3f0e43700 1 --2- 172.21.15.146:0/2813478713 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3ec157430 0x7fc3ec0b2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:40.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.408+0000 7fc3ebfff700 1 -- 172.21.15.146:0/2813478713 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3ec157430 msgr2=0x7fc3ec0b2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:40.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.408+0000 7fc3ebfff700 1 --2- 172.21.15.146:0/2813478713 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3ec157430 0x7fc3ec0b2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:40.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.408+0000 7fc3ebfff700 1 -- 172.21.15.146:0/2813478713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3ec0cc240 msgr2=0x7fc3ec0ab520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:40.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.408+0000 7fc3ebfff700 1 --2- 172.21.15.146:0/2813478713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3ec0cc240 0x7fc3ec0ab520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:40.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.408+0000 7fc3ebfff700 1 -- 172.21.15.146:0/2813478713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e0009420 con 0x7fc3ec0ab010 2023-10-06T11:10:40.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.408+0000 7fc3ebfff700 1 --2- 172.21.15.146:0/2813478713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3ec0ab010 0x7fc3ec153f40 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc00d860 tx=0x7fc3dc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:40.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.408+0000 7fc3d3fff700 1 -- 172.21.15.146:0/2813478713 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc0125f0 con 0x7fc3ec0ab010 2023-10-06T11:10:40.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.408+0000 7fc3d3fff700 1 -- 172.21.15.146:0/2813478713 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3dc012750 con 0x7fc3ec0ab010 2023-10-06T11:10:40.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.408+0000 7fc3f28a6700 1 -- 172.21.15.146:0/2813478713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3ec0b2000 con 0x7fc3ec0ab010 2023-10-06T11:10:40.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.408+0000 7fc3d3fff700 1 -- 172.21.15.146:0/2813478713 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3dc012b10 con 0x7fc3ec0ab010 2023-10-06T11:10:40.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.408+0000 7fc3f28a6700 1 -- 172.21.15.146:0/2813478713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3ec15b800 con 0x7fc3ec0ab010 2023-10-06T11:10:40.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.409+0000 7fc3f28a6700 1 -- 172.21.15.146:0/2813478713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3ec04c380 con 0x7fc3ec0ab010 2023-10-06T11:10:40.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.410+0000 7fc3d3fff700 1 -- 172.21.15.146:0/2813478713 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc3dc01e460 con 0x7fc3ec0ab010 2023-10-06T11:10:40.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.410+0000 7fc3d3fff700 1 --2- 172.21.15.146:0/2813478713 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc3d8066f30 0x7fc3d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:40.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.410+0000 7fc3eb7fe700 1 --2- 172.21.15.146:0/2813478713 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc3d8066f30 0x7fc3d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:40.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.410+0000 7fc3d3fff700 1 -- 172.21.15.146:0/2813478713 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc3dc084bc0 con 0x7fc3ec0ab010 2023-10-06T11:10:40.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.410+0000 7fc3eb7fe700 1 --2- 172.21.15.146:0/2813478713 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc3d8066f30 0x7fc3d80693e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc3e00093f0 tx=0x7fc3e0017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:40.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.414+0000 7fc3d3fff700 1 -- 172.21.15.146:0/2813478713 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc3dc051cd0 con 0x7fc3ec0ab010 2023-10-06T11:10:40.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.594+0000 7fc3f28a6700 1 -- 172.21.15.146:0/2813478713 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc3ec0b2790 con 0x7fc3d8066f30 2023-10-06T11:10:40.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.602+0000 7fc3d3fff700 1 -- 172.21.15.146:0/2813478713 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309727 (secure 0 0 0) 0x7fc3e000b980 con 0x7fc3d8066f30 2023-10-06T11:10:40.608 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:10:40.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.605+0000 7fc3f28a6700 1 -- 172.21.15.146:0/2813478713 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc3d8066f30 msgr2=0x7fc3d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:40.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.605+0000 7fc3f28a6700 1 --2- 172.21.15.146:0/2813478713 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc3d8066f30 0x7fc3d80693e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fc3e00093f0 tx=0x7fc3e0017000 comp rx=0 tx=0).stop 2023-10-06T11:10:40.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.605+0000 7fc3f28a6700 1 -- 172.21.15.146:0/2813478713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3ec0ab010 msgr2=0x7fc3ec153f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:40.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.605+0000 7fc3f28a6700 1 --2- 172.21.15.146:0/2813478713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3ec0ab010 0x7fc3ec153f40 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc00d860 tx=0x7fc3dc008040 comp rx=0 tx=0).stop 2023-10-06T11:10:40.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.605+0000 7fc3f28a6700 1 -- 172.21.15.146:0/2813478713 shutdown_connections 2023-10-06T11:10:40.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.605+0000 7fc3f28a6700 1 --2- 172.21.15.146:0/2813478713 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc3d8066f30 0x7fc3d80693e0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:40.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.605+0000 7fc3f28a6700 1 --2- 172.21.15.146:0/2813478713 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3ec157430 0x7fc3ec0b2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:40.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.605+0000 7fc3f28a6700 1 --2- 172.21.15.146:0/2813478713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3ec0ab010 0x7fc3ec153f40 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:40.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.605+0000 7fc3f28a6700 1 --2- 172.21.15.146:0/2813478713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3ec0cc240 0x7fc3ec0ab520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:40.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.605+0000 7fc3f28a6700 1 -- 172.21.15.146:0/2813478713 >> 172.21.15.146:0/2813478713 conn(0x7fc3ec067c50 msgr2=0x7fc3ec0cb7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:40.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.605+0000 7fc3f28a6700 1 -- 172.21.15.146:0/2813478713 shutdown_connections 2023-10-06T11:10:40.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.605+0000 7fc3f28a6700 1 -- 172.21.15.146:0/2813478713 wait complete. 2023-10-06T11:10:40.611 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:10:40.619 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":219,"stamp":"2023-10-06T11:10:39.203694+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591904,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":171,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2443800,"kb_used_data":8152,"kb_used_omap":0,"kb_used_meta":2435584,"kb_avail":752530920,"statfs":{"total":773094113280,"available":770591662080,"internally_reserved":0,"allocated":8347648,"data_stored":4377152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2494038016},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1536,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.663423"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.552335+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:38:35.257233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.554801+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:22:51.093918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.562062+0000","last_change":"2023-10-06T11:10:36.562062+0000","last_active":"2023-10-06T11:10:36.562062+0000","last_peered":"2023-10-06T11:10:36.562062+0000","last_clean":"2023-10-06T11:10:36.562062+0000","last_became_active":"2023-10-06T11:10:36.561650+0000","last_became_peered":"2023-10-06T11:10:36.561650+0000","last_unstale":"2023-10-06T11:10:36.562062+0000","last_undegraded":"2023-10-06T11:10:36.562062+0000","last_fullsized":"2023-10-06T11:10:36.562062+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:01.339658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.549185+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:09.031116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.553578+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:24.551243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.553611+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:20.836849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.571352+0000","last_change":"2023-10-06T11:10:36.571352+0000","last_active":"2023-10-06T11:10:36.571352+0000","last_peered":"2023-10-06T11:10:36.571352+0000","last_clean":"2023-10-06T11:10:36.571352+0000","last_became_active":"2023-10-06T11:10:36.570697+0000","last_became_peered":"2023-10-06T11:10:36.570697+0000","last_unstale":"2023-10-06T11:10:36.571352+0000","last_undegraded":"2023-10-06T11:10:36.571352+0000","last_fullsized":"2023-10-06T11:10:36.571352+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:03:22.794550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.555782+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:00:33.203307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.564345+0000","last_change":"2023-10-06T11:10:36.564345+0000","last_active":"2023-10-06T11:10:36.564345+0000","last_peered":"2023-10-06T11:10:36.564345+0000","last_clean":"2023-10-06T11:10:36.564345+0000","last_became_active":"2023-10-06T11:10:36.562959+0000","last_became_peered":"2023-10-06T11:10:36.562959+0000","last_unstale":"2023-10-06T11:10:36.564345+0000","last_undegraded":"2023-10-06T11:10:36.564345+0000","last_fullsized":"2023-10-06T11:10:36.564345+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:09.031116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.548825+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:42.231134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.554210+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:55.429899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.548679+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:17:13.424540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.552957+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:39.156883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.553145+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:12:14.376199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.556432+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:55.888185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.552348+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:26:32.606626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.555261+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:09:50.794839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.571620+0000","last_change":"2023-10-06T11:10:36.571620+0000","last_active":"2023-10-06T11:10:36.571620+0000","last_peered":"2023-10-06T11:10:36.571620+0000","last_clean":"2023-10-06T11:10:36.571620+0000","last_became_active":"2023-10-06T11:10:36.571361+0000","last_became_peered":"2023-10-06T11:10:36.571361+0000","last_unstale":"2023-10-06T11:10:36.571620+0000","last_undegraded":"2023-10-06T11:10:36.571620+0000","last_fullsized":"2023-10-06T11:10:36.571620+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:11:53.044428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.552595+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:24:07.541940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.554842+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:01:59.255497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.565345+0000","last_change":"2023-10-06T11:10:36.565345+0000","last_active":"2023-10-06T11:10:36.565345+0000","last_peered":"2023-10-06T11:10:36.565345+0000","last_clean":"2023-10-06T11:10:36.565345+0000","last_became_active":"2023-10-06T11:10:36.564007+0000","last_became_peered":"2023-10-06T11:10:36.564007+0000","last_unstale":"2023-10-06T11:10:36.565345+0000","last_undegraded":"2023-10-06T11:10:36.565345+0000","last_fullsized":"2023-10-06T11:10:36.565345+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:07.338879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.553928+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:30:57.876539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.564288+0000","last_change":"2023-10-06T11:10:36.564288+0000","last_active":"2023-10-06T11:10:36.564288+0000","last_peered":"2023-10-06T11:10:36.564288+0000","last_clean":"2023-10-06T11:10:36.564288+0000","last_became_active":"2023-10-06T11:10:36.563482+0000","last_became_peered":"2023-10-06T11:10:36.563482+0000","last_unstale":"2023-10-06T11:10:36.564288+0000","last_undegraded":"2023-10-06T11:10:36.564288+0000","last_fullsized":"2023-10-06T11:10:36.564288+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:56:23.575265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.554368+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:35.094726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.554089+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:09.293990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.548095+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:49:54.089077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.553169+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:20.836849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.554359+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:57:30.963073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.554210+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:15:56.228848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.553038+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:12:14.376199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.563437+0000","last_change":"2023-10-06T11:10:36.563437+0000","last_active":"2023-10-06T11:10:36.563437+0000","last_peered":"2023-10-06T11:10:36.563437+0000","last_clean":"2023-10-06T11:10:36.563437+0000","last_became_active":"2023-10-06T11:10:36.563170+0000","last_became_peered":"2023-10-06T11:10:36.563170+0000","last_unstale":"2023-10-06T11:10:36.563437+0000","last_undegraded":"2023-10-06T11:10:36.563437+0000","last_fullsized":"2023-10-06T11:10:36.563437+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:26.706783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.551771+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:24:07.541940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.568203+0000","last_change":"2023-10-06T11:10:36.568203+0000","last_active":"2023-10-06T11:10:36.568203+0000","last_peered":"2023-10-06T11:10:36.568203+0000","last_clean":"2023-10-06T11:10:36.568203+0000","last_became_active":"2023-10-06T11:10:36.567772+0000","last_became_peered":"2023-10-06T11:10:36.567772+0000","last_unstale":"2023-10-06T11:10:36.568203+0000","last_undegraded":"2023-10-06T11:10:36.568203+0000","last_fullsized":"2023-10-06T11:10:36.568203+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:14:16.648125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.564448+0000","last_change":"2023-10-06T11:10:35.564448+0000","last_active":"2023-10-06T11:10:35.564448+0000","last_peered":"2023-10-06T11:10:35.564448+0000","last_clean":"2023-10-06T11:10:35.564448+0000","last_became_active":"2023-10-06T11:10:35.564175+0000","last_became_peered":"2023-10-06T11:10:35.564175+0000","last_unstale":"2023-10-06T11:10:35.564448+0000","last_undegraded":"2023-10-06T11:10:35.564448+0000","last_fullsized":"2023-10-06T11:10:35.564448+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:06:11.497822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.551757+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:20.836849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.561010+0000","last_change":"2023-10-06T11:10:35.561010+0000","last_active":"2023-10-06T11:10:35.561010+0000","last_peered":"2023-10-06T11:10:35.561010+0000","last_clean":"2023-10-06T11:10:35.561010+0000","last_became_active":"2023-10-06T11:10:35.560718+0000","last_became_peered":"2023-10-06T11:10:35.560718+0000","last_unstale":"2023-10-06T11:10:35.561010+0000","last_undegraded":"2023-10-06T11:10:35.561010+0000","last_fullsized":"2023-10-06T11:10:35.561010+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:35.057797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.564783+0000","last_change":"2023-10-06T11:10:36.564783+0000","last_active":"2023-10-06T11:10:36.564783+0000","last_peered":"2023-10-06T11:10:36.564783+0000","last_clean":"2023-10-06T11:10:36.564783+0000","last_became_active":"2023-10-06T11:10:36.564112+0000","last_became_peered":"2023-10-06T11:10:36.564112+0000","last_unstale":"2023-10-06T11:10:36.564783+0000","last_undegraded":"2023-10-06T11:10:36.564783+0000","last_fullsized":"2023-10-06T11:10:36.564783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:17:13.424540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.561374+0000","last_change":"2023-10-06T11:10:35.561374+0000","last_active":"2023-10-06T11:10:35.561374+0000","last_peered":"2023-10-06T11:10:35.561374+0000","last_clean":"2023-10-06T11:10:35.561374+0000","last_became_active":"2023-10-06T11:10:35.561034+0000","last_became_peered":"2023-10-06T11:10:35.561034+0000","last_unstale":"2023-10-06T11:10:35.561374+0000","last_undegraded":"2023-10-06T11:10:35.561374+0000","last_fullsized":"2023-10-06T11:10:35.561374+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:54:52.795843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.563943+0000","last_change":"2023-10-06T11:10:36.563943+0000","last_active":"2023-10-06T11:10:36.563943+0000","last_peered":"2023-10-06T11:10:36.563943+0000","last_clean":"2023-10-06T11:10:36.563943+0000","last_became_active":"2023-10-06T11:10:36.563685+0000","last_became_peered":"2023-10-06T11:10:36.563685+0000","last_unstale":"2023-10-06T11:10:36.563943+0000","last_undegraded":"2023-10-06T11:10:36.563943+0000","last_fullsized":"2023-10-06T11:10:36.563943+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:10:01.462268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"74'2","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.576935+0000","last_change":"2023-10-06T11:10:35.558480+0000","last_active":"2023-10-06T11:10:36.576935+0000","last_peered":"2023-10-06T11:10:36.576935+0000","last_clean":"2023-10-06T11:10:36.576935+0000","last_became_active":"2023-10-06T11:10:35.557916+0000","last_became_peered":"2023-10-06T11:10:35.557916+0000","last_unstale":"2023-10-06T11:10:36.576935+0000","last_undegraded":"2023-10-06T11:10:36.576935+0000","last_fullsized":"2023-10-06T11:10:36.576935+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:43.125026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.552197+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:21:08.092457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"74'1","reported_seq":10,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.555583+0000","last_change":"2023-10-06T11:10:35.563076+0000","last_active":"2023-10-06T11:10:36.555583+0000","last_peered":"2023-10-06T11:10:36.555583+0000","last_clean":"2023-10-06T11:10:36.555583+0000","last_became_active":"2023-10-06T11:10:35.561203+0000","last_became_peered":"2023-10-06T11:10:35.561203+0000","last_unstale":"2023-10-06T11:10:36.555583+0000","last_undegraded":"2023-10-06T11:10:36.555583+0000","last_fullsized":"2023-10-06T11:10:36.555583+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:56:40.528482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.551707+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:12:14.376199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.556455+0000","last_change":"2023-10-06T11:10:35.556455+0000","last_active":"2023-10-06T11:10:35.556455+0000","last_peered":"2023-10-06T11:10:35.556455+0000","last_clean":"2023-10-06T11:10:35.556455+0000","last_became_active":"2023-10-06T11:10:35.556167+0000","last_became_peered":"2023-10-06T11:10:35.556167+0000","last_unstale":"2023-10-06T11:10:35.556455+0000","last_undegraded":"2023-10-06T11:10:35.556455+0000","last_fullsized":"2023-10-06T11:10:35.556455+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:25.699995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.566820+0000","last_change":"2023-10-06T11:10:36.566820+0000","last_active":"2023-10-06T11:10:36.566820+0000","last_peered":"2023-10-06T11:10:36.566820+0000","last_clean":"2023-10-06T11:10:36.566820+0000","last_became_active":"2023-10-06T11:10:36.566558+0000","last_became_peered":"2023-10-06T11:10:36.566558+0000","last_unstale":"2023-10-06T11:10:36.566820+0000","last_undegraded":"2023-10-06T11:10:36.566820+0000","last_fullsized":"2023-10-06T11:10:36.566820+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:42.231134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.559140+0000","last_change":"2023-10-06T11:10:35.559140+0000","last_active":"2023-10-06T11:10:35.559140+0000","last_peered":"2023-10-06T11:10:35.559140+0000","last_clean":"2023-10-06T11:10:35.559140+0000","last_became_active":"2023-10-06T11:10:35.558843+0000","last_became_peered":"2023-10-06T11:10:35.558843+0000","last_unstale":"2023-10-06T11:10:35.559140+0000","last_undegraded":"2023-10-06T11:10:35.559140+0000","last_fullsized":"2023-10-06T11:10:35.559140+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:59:57.232416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.571387+0000","last_change":"2023-10-06T11:10:36.571387+0000","last_active":"2023-10-06T11:10:36.571387+0000","last_peered":"2023-10-06T11:10:36.571387+0000","last_clean":"2023-10-06T11:10:36.571387+0000","last_became_active":"2023-10-06T11:10:36.571001+0000","last_became_peered":"2023-10-06T11:10:36.571001+0000","last_unstale":"2023-10-06T11:10:36.571387+0000","last_undegraded":"2023-10-06T11:10:36.571387+0000","last_fullsized":"2023-10-06T11:10:36.571387+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:22:25.424782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.566163+0000","last_change":"2023-10-06T11:10:35.566163+0000","last_active":"2023-10-06T11:10:35.566163+0000","last_peered":"2023-10-06T11:10:35.566163+0000","last_clean":"2023-10-06T11:10:35.566163+0000","last_became_active":"2023-10-06T11:10:35.565869+0000","last_became_peered":"2023-10-06T11:10:35.565869+0000","last_unstale":"2023-10-06T11:10:35.566163+0000","last_undegraded":"2023-10-06T11:10:35.566163+0000","last_fullsized":"2023-10-06T11:10:35.566163+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:20:09.758618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.551700+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:20:30.493152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.561963+0000","last_change":"2023-10-06T11:10:35.561963+0000","last_active":"2023-10-06T11:10:35.561963+0000","last_peered":"2023-10-06T11:10:35.561963+0000","last_clean":"2023-10-06T11:10:35.561963+0000","last_became_active":"2023-10-06T11:10:35.561673+0000","last_became_peered":"2023-10-06T11:10:35.561673+0000","last_unstale":"2023-10-06T11:10:35.561963+0000","last_undegraded":"2023-10-06T11:10:35.561963+0000","last_fullsized":"2023-10-06T11:10:35.561963+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:16:25.755999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.548736+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:24:29.252009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.558239+0000","last_change":"2023-10-06T11:10:35.558239+0000","last_active":"2023-10-06T11:10:35.558239+0000","last_peered":"2023-10-06T11:10:35.558239+0000","last_clean":"2023-10-06T11:10:35.558239+0000","last_became_active":"2023-10-06T11:10:35.557904+0000","last_became_peered":"2023-10-06T11:10:35.557904+0000","last_unstale":"2023-10-06T11:10:35.558239+0000","last_undegraded":"2023-10-06T11:10:35.558239+0000","last_fullsized":"2023-10-06T11:10:35.558239+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:48:30.196153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.552701+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:20:30.493152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.562574+0000","last_change":"2023-10-06T11:10:35.562574+0000","last_active":"2023-10-06T11:10:35.562574+0000","last_peered":"2023-10-06T11:10:35.562574+0000","last_clean":"2023-10-06T11:10:35.562574+0000","last_became_active":"2023-10-06T11:10:35.562340+0000","last_became_peered":"2023-10-06T11:10:35.562340+0000","last_unstale":"2023-10-06T11:10:35.562574+0000","last_undegraded":"2023-10-06T11:10:35.562574+0000","last_fullsized":"2023-10-06T11:10:35.562574+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:04:45.233259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.558905+0000","last_change":"2023-10-06T11:10:36.558905+0000","last_active":"2023-10-06T11:10:36.558905+0000","last_peered":"2023-10-06T11:10:36.558905+0000","last_clean":"2023-10-06T11:10:36.558905+0000","last_became_active":"2023-10-06T11:10:36.558656+0000","last_became_peered":"2023-10-06T11:10:36.558656+0000","last_unstale":"2023-10-06T11:10:36.558905+0000","last_undegraded":"2023-10-06T11:10:36.558905+0000","last_fullsized":"2023-10-06T11:10:36.558905+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:05:23.675313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"74'6","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.577980+0000","last_change":"2023-10-06T11:10:35.565131+0000","last_active":"2023-10-06T11:10:36.577980+0000","last_peered":"2023-10-06T11:10:36.577980+0000","last_clean":"2023-10-06T11:10:36.577980+0000","last_became_active":"2023-10-06T11:10:35.564906+0000","last_became_peered":"2023-10-06T11:10:35.564906+0000","last_unstale":"2023-10-06T11:10:36.577980+0000","last_undegraded":"2023-10-06T11:10:36.577980+0000","last_fullsized":"2023-10-06T11:10:36.577980+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:17:20.645306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.548074+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:56:23.575265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.566952+0000","last_change":"2023-10-06T11:10:35.566952+0000","last_active":"2023-10-06T11:10:35.566952+0000","last_peered":"2023-10-06T11:10:35.566952+0000","last_clean":"2023-10-06T11:10:35.566952+0000","last_became_active":"2023-10-06T11:10:35.566661+0000","last_became_peered":"2023-10-06T11:10:35.566661+0000","last_unstale":"2023-10-06T11:10:35.566952+0000","last_undegraded":"2023-10-06T11:10:35.566952+0000","last_fullsized":"2023-10-06T11:10:35.566952+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:05:22.668525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.566928+0000","last_change":"2023-10-06T11:10:36.566928+0000","last_active":"2023-10-06T11:10:36.566928+0000","last_peered":"2023-10-06T11:10:36.566928+0000","last_clean":"2023-10-06T11:10:36.566928+0000","last_became_active":"2023-10-06T11:10:36.566624+0000","last_became_peered":"2023-10-06T11:10:36.566624+0000","last_unstale":"2023-10-06T11:10:36.566928+0000","last_undegraded":"2023-10-06T11:10:36.566928+0000","last_fullsized":"2023-10-06T11:10:36.566928+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:26.706783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.563787+0000","last_change":"2023-10-06T11:10:35.563787+0000","last_active":"2023-10-06T11:10:35.563787+0000","last_peered":"2023-10-06T11:10:35.563787+0000","last_clean":"2023-10-06T11:10:35.563787+0000","last_became_active":"2023-10-06T11:10:35.563566+0000","last_became_peered":"2023-10-06T11:10:35.563566+0000","last_unstale":"2023-10-06T11:10:35.563787+0000","last_undegraded":"2023-10-06T11:10:35.563787+0000","last_fullsized":"2023-10-06T11:10:35.563787+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:06.332091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.574907+0000","last_change":"2023-10-06T11:10:36.574907+0000","last_active":"2023-10-06T11:10:36.574907+0000","last_peered":"2023-10-06T11:10:36.574907+0000","last_clean":"2023-10-06T11:10:36.574907+0000","last_became_active":"2023-10-06T11:10:36.571648+0000","last_became_peered":"2023-10-06T11:10:36.571648+0000","last_unstale":"2023-10-06T11:10:36.574907+0000","last_undegraded":"2023-10-06T11:10:36.574907+0000","last_fullsized":"2023-10-06T11:10:36.574907+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:05:23.675313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.564482+0000","last_change":"2023-10-06T11:10:35.564482+0000","last_active":"2023-10-06T11:10:35.564482+0000","last_peered":"2023-10-06T11:10:35.564482+0000","last_clean":"2023-10-06T11:10:35.564482+0000","last_became_active":"2023-10-06T11:10:35.564219+0000","last_became_peered":"2023-10-06T11:10:35.564219+0000","last_unstale":"2023-10-06T11:10:35.564482+0000","last_undegraded":"2023-10-06T11:10:35.564482+0000","last_fullsized":"2023-10-06T11:10:35.564482+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:47.836534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.575443+0000","last_change":"2023-10-06T11:10:36.575443+0000","last_active":"2023-10-06T11:10:36.575443+0000","last_peered":"2023-10-06T11:10:36.575443+0000","last_clean":"2023-10-06T11:10:36.575443+0000","last_became_active":"2023-10-06T11:10:36.575101+0000","last_became_peered":"2023-10-06T11:10:36.575101+0000","last_unstale":"2023-10-06T11:10:36.575443+0000","last_undegraded":"2023-10-06T11:10:36.575443+0000","last_fullsized":"2023-10-06T11:10:36.575443+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:48:31.202941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.556135+0000","last_change":"2023-10-06T11:10:35.556135+0000","last_active":"2023-10-06T11:10:35.556135+0000","last_peered":"2023-10-06T11:10:35.556135+0000","last_clean":"2023-10-06T11:10:35.556135+0000","last_became_active":"2023-10-06T11:10:35.555884+0000","last_became_peered":"2023-10-06T11:10:35.555884+0000","last_unstale":"2023-10-06T11:10:35.556135+0000","last_undegraded":"2023-10-06T11:10:35.556135+0000","last_fullsized":"2023-10-06T11:10:35.556135+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:24:06.535152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.566853+0000","last_change":"2023-10-06T11:10:36.566853+0000","last_active":"2023-10-06T11:10:36.566853+0000","last_peered":"2023-10-06T11:10:36.566853+0000","last_clean":"2023-10-06T11:10:36.566853+0000","last_became_active":"2023-10-06T11:10:36.566589+0000","last_became_peered":"2023-10-06T11:10:36.566589+0000","last_unstale":"2023-10-06T11:10:36.566853+0000","last_undegraded":"2023-10-06T11:10:36.566853+0000","last_fullsized":"2023-10-06T11:10:36.566853+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:11:53.044428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.563007+0000","last_change":"2023-10-06T11:10:35.563007+0000","last_active":"2023-10-06T11:10:35.563007+0000","last_peered":"2023-10-06T11:10:35.563007+0000","last_clean":"2023-10-06T11:10:35.563007+0000","last_became_active":"2023-10-06T11:10:35.562469+0000","last_became_peered":"2023-10-06T11:10:35.562469+0000","last_unstale":"2023-10-06T11:10:35.563007+0000","last_undegraded":"2023-10-06T11:10:35.563007+0000","last_fullsized":"2023-10-06T11:10:35.563007+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:00.332870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.575103+0000","last_change":"2023-10-06T11:10:36.575103+0000","last_active":"2023-10-06T11:10:36.575103+0000","last_peered":"2023-10-06T11:10:36.575103+0000","last_clean":"2023-10-06T11:10:36.575103+0000","last_became_active":"2023-10-06T11:10:36.571536+0000","last_became_peered":"2023-10-06T11:10:36.571536+0000","last_unstale":"2023-10-06T11:10:36.575103+0000","last_undegraded":"2023-10-06T11:10:36.575103+0000","last_fullsized":"2023-10-06T11:10:36.575103+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:14:16.648125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.560230+0000","last_change":"2023-10-06T11:10:35.560230+0000","last_active":"2023-10-06T11:10:35.560230+0000","last_peered":"2023-10-06T11:10:35.560230+0000","last_clean":"2023-10-06T11:10:35.560230+0000","last_became_active":"2023-10-06T11:10:35.559955+0000","last_became_peered":"2023-10-06T11:10:35.559955+0000","last_unstale":"2023-10-06T11:10:35.560230+0000","last_undegraded":"2023-10-06T11:10:35.560230+0000","last_fullsized":"2023-10-06T11:10:35.560230+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:58.839836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.564609+0000","last_change":"2023-10-06T11:10:36.564609+0000","last_active":"2023-10-06T11:10:36.564609+0000","last_peered":"2023-10-06T11:10:36.564609+0000","last_clean":"2023-10-06T11:10:36.564609+0000","last_became_active":"2023-10-06T11:10:36.563769+0000","last_became_peered":"2023-10-06T11:10:36.563769+0000","last_unstale":"2023-10-06T11:10:36.564609+0000","last_undegraded":"2023-10-06T11:10:36.564609+0000","last_fullsized":"2023-10-06T11:10:36.564609+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:49:54.089077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.566590+0000","last_change":"2023-10-06T11:10:35.566590+0000","last_active":"2023-10-06T11:10:35.566590+0000","last_peered":"2023-10-06T11:10:35.566590+0000","last_clean":"2023-10-06T11:10:35.566590+0000","last_became_active":"2023-10-06T11:10:35.566333+0000","last_became_peered":"2023-10-06T11:10:35.566333+0000","last_unstale":"2023-10-06T11:10:35.566590+0000","last_undegraded":"2023-10-06T11:10:35.566590+0000","last_fullsized":"2023-10-06T11:10:35.566590+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:53:16.617219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.552115+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:26:32.606626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.561355+0000","last_change":"2023-10-06T11:10:35.561355+0000","last_active":"2023-10-06T11:10:35.561355+0000","last_peered":"2023-10-06T11:10:35.561355+0000","last_clean":"2023-10-06T11:10:35.561355+0000","last_became_active":"2023-10-06T11:10:35.560750+0000","last_became_peered":"2023-10-06T11:10:35.560750+0000","last_unstale":"2023-10-06T11:10:35.561355+0000","last_undegraded":"2023-10-06T11:10:35.561355+0000","last_fullsized":"2023-10-06T11:10:35.561355+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:58.839836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.575237+0000","last_change":"2023-10-06T11:10:36.575237+0000","last_active":"2023-10-06T11:10:36.575237+0000","last_peered":"2023-10-06T11:10:36.575237+0000","last_clean":"2023-10-06T11:10:36.575237+0000","last_became_active":"2023-10-06T11:10:36.574982+0000","last_became_peered":"2023-10-06T11:10:36.574982+0000","last_unstale":"2023-10-06T11:10:36.575237+0000","last_undegraded":"2023-10-06T11:10:36.575237+0000","last_fullsized":"2023-10-06T11:10:36.575237+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:01.339658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.560484+0000","last_change":"2023-10-06T11:10:35.558225+0000","last_active":"2023-10-06T11:10:35.560484+0000","last_peered":"2023-10-06T11:10:35.560484+0000","last_clean":"2023-10-06T11:10:35.560484+0000","last_became_active":"2023-10-06T11:10:35.557900+0000","last_became_peered":"2023-10-06T11:10:35.557900+0000","last_unstale":"2023-10-06T11:10:35.560484+0000","last_undegraded":"2023-10-06T11:10:35.560484+0000","last_fullsized":"2023-10-06T11:10:35.560484+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:35:59.639899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.563208+0000","last_change":"2023-10-06T11:10:36.563208+0000","last_active":"2023-10-06T11:10:36.563208+0000","last_peered":"2023-10-06T11:10:36.563208+0000","last_clean":"2023-10-06T11:10:36.563208+0000","last_became_active":"2023-10-06T11:10:36.562940+0000","last_became_peered":"2023-10-06T11:10:36.562940+0000","last_unstale":"2023-10-06T11:10:36.563208+0000","last_undegraded":"2023-10-06T11:10:36.563208+0000","last_fullsized":"2023-10-06T11:10:36.563208+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:56:41.535270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.561390+0000","last_change":"2023-10-06T11:10:35.561390+0000","last_active":"2023-10-06T11:10:35.561390+0000","last_peered":"2023-10-06T11:10:35.561390+0000","last_clean":"2023-10-06T11:10:35.561390+0000","last_became_active":"2023-10-06T11:10:35.561115+0000","last_became_peered":"2023-10-06T11:10:35.561115+0000","last_unstale":"2023-10-06T11:10:35.561390+0000","last_undegraded":"2023-10-06T11:10:35.561390+0000","last_fullsized":"2023-10-06T11:10:35.561390+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:01.065689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.563759+0000","last_change":"2023-10-06T11:10:36.563759+0000","last_active":"2023-10-06T11:10:36.563759+0000","last_peered":"2023-10-06T11:10:36.563759+0000","last_clean":"2023-10-06T11:10:36.563759+0000","last_became_active":"2023-10-06T11:10:36.563501+0000","last_became_peered":"2023-10-06T11:10:36.563501+0000","last_unstale":"2023-10-06T11:10:36.563759+0000","last_undegraded":"2023-10-06T11:10:36.563759+0000","last_fullsized":"2023-10-06T11:10:36.563759+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:08.343433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.566866+0000","last_change":"2023-10-06T11:10:35.564323+0000","last_active":"2023-10-06T11:10:35.566866+0000","last_peered":"2023-10-06T11:10:35.566866+0000","last_clean":"2023-10-06T11:10:35.566866+0000","last_became_active":"2023-10-06T11:10:35.564037+0000","last_became_peered":"2023-10-06T11:10:35.564037+0000","last_unstale":"2023-10-06T11:10:35.566866+0000","last_undegraded":"2023-10-06T11:10:35.566866+0000","last_fullsized":"2023-10-06T11:10:35.566866+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:28:03.257860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.567132+0000","last_change":"2023-10-06T11:10:36.567132+0000","last_active":"2023-10-06T11:10:36.567132+0000","last_peered":"2023-10-06T11:10:36.567132+0000","last_clean":"2023-10-06T11:10:36.567132+0000","last_became_active":"2023-10-06T11:10:36.566866+0000","last_became_peered":"2023-10-06T11:10:36.566866+0000","last_unstale":"2023-10-06T11:10:36.567132+0000","last_undegraded":"2023-10-06T11:10:36.567132+0000","last_fullsized":"2023-10-06T11:10:36.567132+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:48:31.202941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.562021+0000","last_change":"2023-10-06T11:10:35.552191+0000","last_active":"2023-10-06T11:10:35.562021+0000","last_peered":"2023-10-06T11:10:35.562021+0000","last_clean":"2023-10-06T11:10:35.562021+0000","last_became_active":"2023-10-06T11:10:35.551916+0000","last_became_peered":"2023-10-06T11:10:35.551916+0000","last_unstale":"2023-10-06T11:10:35.562021+0000","last_undegraded":"2023-10-06T11:10:35.562021+0000","last_fullsized":"2023-10-06T11:10:35.562021+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:07:42.227450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.552863+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:26:32.606626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.566516+0000","last_change":"2023-10-06T11:10:35.566516+0000","last_active":"2023-10-06T11:10:35.566516+0000","last_peered":"2023-10-06T11:10:35.566516+0000","last_clean":"2023-10-06T11:10:35.566516+0000","last_became_active":"2023-10-06T11:10:35.566258+0000","last_became_peered":"2023-10-06T11:10:35.566258+0000","last_unstale":"2023-10-06T11:10:35.566516+0000","last_undegraded":"2023-10-06T11:10:35.566516+0000","last_fullsized":"2023-10-06T11:10:35.566516+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:16:46.568672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":63,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.560581+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:10:35.560581+0000","last_peered":"2023-10-06T11:10:35.560581+0000","last_clean":"2023-10-06T11:10:35.560581+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:10:35.560581+0000","last_undegraded":"2023-10-06T11:10:35.560581+0000","last_fullsized":"2023-10-06T11:10:35.560581+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.553024+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:12:36.084850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"74'2","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.567133+0000","last_change":"2023-10-06T11:10:35.565002+0000","last_active":"2023-10-06T11:10:36.567133+0000","last_peered":"2023-10-06T11:10:36.567133+0000","last_clean":"2023-10-06T11:10:36.567133+0000","last_became_active":"2023-10-06T11:10:35.564718+0000","last_became_peered":"2023-10-06T11:10:35.564718+0000","last_unstale":"2023-10-06T11:10:36.567133+0000","last_undegraded":"2023-10-06T11:10:36.567133+0000","last_fullsized":"2023-10-06T11:10:36.567133+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:12:22.762358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":59,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-10-06T11:10:34.543614+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:10:34.543614+0000","last_peered":"2023-10-06T11:10:34.543614+0000","last_clean":"2023-10-06T11:10:34.543614+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:10:34.543614+0000","last_undegraded":"2023-10-06T11:10:34.543614+0000","last_fullsized":"2023-10-06T11:10:34.543614+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.551941+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:24:04.262059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.561062+0000","last_change":"2023-10-06T11:10:35.561062+0000","last_active":"2023-10-06T11:10:35.561062+0000","last_peered":"2023-10-06T11:10:35.561062+0000","last_clean":"2023-10-06T11:10:35.561062+0000","last_became_active":"2023-10-06T11:10:35.560873+0000","last_became_peered":"2023-10-06T11:10:35.560873+0000","last_unstale":"2023-10-06T11:10:35.561062+0000","last_undegraded":"2023-10-06T11:10:35.561062+0000","last_fullsized":"2023-10-06T11:10:35.561062+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:54:52.795843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":57,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.546220+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:10:35.546220+0000","last_peered":"2023-10-06T11:10:35.546220+0000","last_clean":"2023-10-06T11:10:35.546220+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:10:35.546220+0000","last_undegraded":"2023-10-06T11:10:35.546220+0000","last_fullsized":"2023-10-06T11:10:35.546220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":203,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-10-06T11:10:34.546553+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:10:34.546553+0000","last_peered":"2023-10-06T11:10:34.546553+0000","last_clean":"2023-10-06T11:10:34.546553+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:10:34.546553+0000","last_undegraded":"2023-10-06T11:10:34.546553+0000","last_fullsized":"2023-10-06T11:10:34.546553+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.575734+0000","last_change":"2023-10-06T11:10:36.575734+0000","last_active":"2023-10-06T11:10:36.575734+0000","last_peered":"2023-10-06T11:10:36.575734+0000","last_clean":"2023-10-06T11:10:36.575734+0000","last_became_active":"2023-10-06T11:10:36.575475+0000","last_became_peered":"2023-10-06T11:10:36.575475+0000","last_unstale":"2023-10-06T11:10:36.575734+0000","last_undegraded":"2023-10-06T11:10:36.575734+0000","last_fullsized":"2023-10-06T11:10:36.575734+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:08.343433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.560631+0000","last_change":"2023-10-06T11:10:35.560631+0000","last_active":"2023-10-06T11:10:35.560631+0000","last_peered":"2023-10-06T11:10:35.560631+0000","last_clean":"2023-10-06T11:10:35.560631+0000","last_became_active":"2023-10-06T11:10:35.560377+0000","last_became_peered":"2023-10-06T11:10:35.560377+0000","last_unstale":"2023-10-06T11:10:35.560631+0000","last_undegraded":"2023-10-06T11:10:35.560631+0000","last_fullsized":"2023-10-06T11:10:35.560631+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:16:25.755999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":53,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-10-06T11:10:34.547219+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:10:34.547219+0000","last_peered":"2023-10-06T11:10:34.547219+0000","last_clean":"2023-10-06T11:10:34.547219+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:10:34.547219+0000","last_undegraded":"2023-10-06T11:10:34.547219+0000","last_fullsized":"2023-10-06T11:10:34.547219+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.552732+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:20:30.493152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.560592+0000","last_change":"2023-10-06T11:10:35.560592+0000","last_active":"2023-10-06T11:10:35.560592+0000","last_peered":"2023-10-06T11:10:35.560592+0000","last_clean":"2023-10-06T11:10:35.560592+0000","last_became_active":"2023-10-06T11:10:35.560329+0000","last_became_peered":"2023-10-06T11:10:35.560329+0000","last_unstale":"2023-10-06T11:10:35.560592+0000","last_undegraded":"2023-10-06T11:10:35.560592+0000","last_fullsized":"2023-10-06T11:10:35.560592+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:58.839836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":53,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-10-06T11:10:34.546588+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:10:34.546588+0000","last_peered":"2023-10-06T11:10:34.546588+0000","last_clean":"2023-10-06T11:10:34.546588+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:10:34.546588+0000","last_undegraded":"2023-10-06T11:10:34.546588+0000","last_fullsized":"2023-10-06T11:10:34.546588+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.551778+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:06:36.489499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.562699+0000","last_change":"2023-10-06T11:10:35.562699+0000","last_active":"2023-10-06T11:10:35.562699+0000","last_peered":"2023-10-06T11:10:35.562699+0000","last_clean":"2023-10-06T11:10:35.562699+0000","last_became_active":"2023-10-06T11:10:35.562460+0000","last_became_peered":"2023-10-06T11:10:35.562460+0000","last_unstale":"2023-10-06T11:10:35.562699+0000","last_undegraded":"2023-10-06T11:10:35.562699+0000","last_fullsized":"2023-10-06T11:10:35.562699+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:35.057797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":64,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-10-06T11:10:34.542867+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:10:34.542867+0000","last_peered":"2023-10-06T11:10:34.542867+0000","last_clean":"2023-10-06T11:10:34.542867+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:10:34.542867+0000","last_undegraded":"2023-10-06T11:10:34.542867+0000","last_fullsized":"2023-10-06T11:10:34.542867+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.552588+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:38:35.257233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.563502+0000","last_change":"2023-10-06T11:10:35.558406+0000","last_active":"2023-10-06T11:10:35.563502+0000","last_peered":"2023-10-06T11:10:35.563502+0000","last_clean":"2023-10-06T11:10:35.563502+0000","last_became_active":"2023-10-06T11:10:35.558197+0000","last_became_peered":"2023-10-06T11:10:35.558197+0000","last_unstale":"2023-10-06T11:10:35.563502+0000","last_undegraded":"2023-10-06T11:10:35.563502+0000","last_fullsized":"2023-10-06T11:10:35.563502+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:54:06.008551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":58,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.550516+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:10:35.550516+0000","last_peered":"2023-10-06T11:10:35.550516+0000","last_clean":"2023-10-06T11:10:35.550516+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:10:35.550516+0000","last_undegraded":"2023-10-06T11:10:35.550516+0000","last_fullsized":"2023-10-06T11:10:35.550516+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.553478+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:14:01.696915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.565730+0000","last_change":"2023-10-06T11:10:35.565730+0000","last_active":"2023-10-06T11:10:35.565730+0000","last_peered":"2023-10-06T11:10:35.565730+0000","last_clean":"2023-10-06T11:10:35.565730+0000","last_became_active":"2023-10-06T11:10:35.565461+0000","last_became_peered":"2023-10-06T11:10:35.565461+0000","last_unstale":"2023-10-06T11:10:35.565730+0000","last_undegraded":"2023-10-06T11:10:35.565730+0000","last_fullsized":"2023-10-06T11:10:35.565730+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:16:47.518450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":58,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.550793+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:10:35.550793+0000","last_peered":"2023-10-06T11:10:35.550793+0000","last_clean":"2023-10-06T11:10:35.550793+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:10:35.550793+0000","last_undegraded":"2023-10-06T11:10:35.550793+0000","last_fullsized":"2023-10-06T11:10:35.550793+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":1536,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574911,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298736,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073104,"statfs":{"total":96636764160,"available":96330858496,"internally_reserved":0,"allocated":1482752,"data_stored":988344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":0.872,"15min":0.61399999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":15.506,"5min":23.908999999999999,"15min":23.908999999999999},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.70599999999999996,"15min":0.59099999999999997},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":9.3230000000000004,"5min":9.3230000000000004,"15min":9.3230000000000004},"last":0.40100000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.63400000000000001,"15min":0.56899999999999995},"min":{"1min":0.29999999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71399999999999997,"5min":9.2360000000000007,"15min":9.2360000000000007},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.53200000000000003,"15min":0.51400000000000001},"min":{"1min":0.308,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.60399999999999998,"5min":4.327,"15min":4.327},"last":0.57499999999999996}]},{"osd":2,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.5,"15min":0.50800000000000001},"min":{"1min":0.33200000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.63500000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.59599999999999997,"15min":0.55800000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.74299999999999999,"5min":4.7309999999999999,"15min":4.7309999999999999},"last":0.47699999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.52000000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.7609999999999999,"5min":4.3540000000000001,"15min":4.3540000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.67500000000000004,"15min":0.60099999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.125,"5min":9.3879999999999999,"15min":9.3879999999999999},"last":0.61399999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.50800000000000001,"15min":0.47499999999999998},"min":{"1min":0.25,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.66100000000000003,"5min":4.5709999999999997,"15min":4.5709999999999997},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.54600000000000004,"15min":0.53100000000000003},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.71299999999999997,"5min":4.3129999999999997,"15min":4.3129999999999997},"last":0.50700000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.63300000000000001,"15min":0.57799999999999996},"min":{"1min":0.29399999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.84699999999999998,"5min":9.3499999999999996,"15min":9.3499999999999996},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.57499999999999996,"15min":0.56399999999999995},"min":{"1min":0.36099999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.77200000000000002,"5min":4.444,"15min":4.444},"last":0.64500000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.66400000000000003,"15min":0.61899999999999999},"min":{"1min":0.39200000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.81399999999999995,"5min":9.4969999999999999,"15min":9.4969999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.65600000000000003,"15min":0.61799999999999999},"min":{"1min":0.40300000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88200000000000001,"5min":7.2039999999999997,"15min":7.2039999999999997},"last":0.59099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574913,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310464,"kb_used_data":888,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061376,"statfs":{"total":96636764160,"available":96318849024,"internally_reserved":0,"allocated":909312,"data_stored":405275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:42 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48199999999999998,"15min":0.497},"min":{"1min":0.23799999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.64300000000000002,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51500000000000001,"15min":0.53100000000000003},"min":{"1min":0.35899999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.63,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.39800000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:09:42 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.47899999999999998,"15min":0.498},"min":{"1min":0.26400000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.629,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.47499999999999998,"15min":0.496},"min":{"1min":0.379,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.55400000000000005,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.31900000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:09:42 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.53300000000000003,"15min":0.499},"min":{"1min":0.31900000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.65800000000000003,"5min":7.0659999999999998,"15min":7.0659999999999998},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.55700000000000005,"15min":0.52700000000000002},"min":{"1min":0.29899999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.75800000000000001,"5min":7.0819999999999999,"15min":7.0819999999999999},"last":0.44400000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:09:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.504,"15min":0.496},"min":{"1min":0.436,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.65500000000000003,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53100000000000003,"15min":0.53700000000000003},"min":{"1min":0.40000000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.72399999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.50800000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:09:42 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.47599999999999998,"15min":0.503},"min":{"1min":0.30399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.495},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.52400000000000002,"15min":0.56200000000000006},"min":{"1min":0.33100000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69399999999999995,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.42999999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:09:42 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51300000000000001,"15min":0.53500000000000003},"min":{"1min":0.313,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.69299999999999995,"5min":0.75,"15min":0.75},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54800000000000004,"15min":0.58199999999999996},"min":{"1min":0.34499999999999997,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78800000000000003,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.53700000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:09:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55600000000000005,"15min":0.57499999999999996},"min":{"1min":0.377,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71699999999999997,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58299999999999996,"15min":0.60499999999999998},"min":{"1min":0.36699999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.754,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.58399999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574912,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311044,"kb_used_data":1468,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060796,"statfs":{"total":96636764160,"available":96318255104,"internally_reserved":0,"allocated":1503232,"data_stored":995572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.33200000000000002,"15min":0.34200000000000003},"min":{"1min":0.24199999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.215,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.40999999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.34399999999999997,"15min":0.33600000000000002},"min":{"1min":0.23599999999999999,"5min":0.22,"15min":0.22},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.39600000000000002,"15min":0.38900000000000001},"min":{"1min":0.26500000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.38200000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.41399999999999998,"15min":0.41099999999999998},"min":{"1min":0.28299999999999997,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.68999999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.38100000000000001,"15min":0.36899999999999999},"min":{"1min":0.29799999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.33900000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.53000000000000003,"15min":0.50800000000000001},"min":{"1min":0.34399999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55800000000000005,"15min":0.54000000000000004},"min":{"1min":0.45300000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.68999999999999995}]},{"osd":5,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55900000000000005,"15min":0.54900000000000004},"min":{"1min":0.38800000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.56299999999999994,"15min":0.54100000000000004},"min":{"1min":0.40000000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.626}]},{"osd":6,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57199999999999995,"15min":0.56200000000000006},"min":{"1min":0.36899999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.59199999999999997,"15min":0.57399999999999995},"min":{"1min":0.376,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.73199999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.59999999999999998,"15min":0.58999999999999997},"min":{"1min":0.48699999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84299999999999997,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.42899999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.746}]}]},{"osd":0,"up_from":13,"seq":55834574911,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302248,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069592,"statfs":{"total":96636764160,"available":96327262208,"internally_reserved":0,"allocated":884736,"data_stored":396623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":1.9379999999999999,"5min":0.64700000000000002,"15min":0.44},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":36.097999999999999,"5min":36.097999999999999,"15min":36.097999999999999},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.35999999999999999,"15min":0.34699999999999998},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.39300000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":1.9810000000000001,"5min":0.69099999999999995,"15min":0.48299999999999998},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":36.07,"5min":36.07,"15min":36.07},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.40000000000000002,"15min":0.379},"min":{"1min":0.23200000000000001,"5min":0.219,"15min":0.219},"max":{"1min":5.125,"5min":5.125,"15min":5.125},"last":0.35199999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.44,"15min":0.39600000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":8.4130000000000003,"5min":8.4130000000000003,"15min":8.4130000000000003},"last":0.42499999999999999},{"interface":"front","average":{"1min":2.0030000000000001,"5min":0.74399999999999999,"15min":0.54200000000000004},"min":{"1min":0.30199999999999999,"5min":0.252,"15min":0.252},"max":{"1min":35.959000000000003,"5min":35.959000000000003,"15min":35.959000000000003},"last":0.371}]},{"osd":4,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.56799999999999995,"15min":0.56299999999999994},"min":{"1min":0.48199999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.61399999999999999},{"interface":"front","average":{"1min":2.2120000000000002,"5min":0.92700000000000005,"15min":0.72099999999999997},"min":{"1min":0.48999999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":36.005000000000003,"5min":36.005000000000003,"15min":36.005000000000003},"last":0.58899999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.55700000000000005,"15min":0.55400000000000005},"min":{"1min":0.433,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56299999999999994,"15min":0.54900000000000004},"min":{"1min":0.45700000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.64800000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":2.194,"5min":0.91900000000000004,"15min":0.71699999999999997},"min":{"1min":0.47199999999999998,"5min":0.375,"15min":0.375},"max":{"1min":36.037999999999997,"5min":36.037999999999997,"15min":36.037999999999997},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.63900000000000001,"15min":0.61699999999999999},"min":{"1min":0.434,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":4.8810000000000002,"5min":4.8810000000000002,"15min":4.8810000000000002},"last":0.57699999999999996}]},{"osd":7,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60599999999999998,"15min":0.60799999999999998},"min":{"1min":0.41499999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":2.3530000000000002,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.44500000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.56299999999999994}]}]},{"osd":2,"up_from":13,"seq":55834574912,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314536,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94057304,"statfs":{"total":96636764160,"available":96314679296,"internally_reserved":0,"allocated":884736,"data_stored":396623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.307,"15min":0.308},"min":{"1min":0.218,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.39700000000000002,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.375,"15min":0.38300000000000001},"min":{"1min":0.27700000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53300000000000003,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.32200000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36599999999999999,"15min":0.374},"min":{"1min":0.252,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56299999999999994,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.35399999999999998,"15min":0.34799999999999998},"min":{"1min":0.249,"5min":0.217,"15min":0.217},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.33400000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.36699999999999999,"15min":0.372},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.628,"5min":0.629,"15min":0.629},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.35899999999999999,"15min":0.36499999999999999},"min":{"1min":0.26200000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.47699999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.29499999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.36599999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.77500000000000002,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.502},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.42599999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72299999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.64400000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.35999999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.67600000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.623},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55700000000000005,"15min":0.55300000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72999999999999998,"5min":0.87,"15min":0.87},"last":0.49099999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76000000000000001,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57599999999999996,"15min":0.57799999999999996},"min":{"1min":0.39400000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.72199999999999998,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.53600000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56799999999999995,"15min":0.55300000000000005},"min":{"1min":0.40200000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.76600000000000001,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57299999999999995,"15min":0.57099999999999995},"min":{"1min":0.40200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73499999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.42599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574912,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298152,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073688,"statfs":{"total":96636764160,"available":96331456512,"internally_reserved":0,"allocated":884736,"data_stored":396623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.313,"15min":0.32700000000000001},"min":{"1min":0.218,"5min":0.188,"15min":0.188},"max":{"1min":0.47099999999999997,"5min":1.095,"15min":1.095},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.38,"15min":0.40200000000000002},"min":{"1min":0.30399999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.52400000000000002,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.32500000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.313,"15min":0.309},"min":{"1min":0.23200000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.46899999999999997,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.35999999999999999,"15min":0.37},"min":{"1min":0.25900000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.48599999999999999,"5min":1.196,"15min":1.196},"last":0.33800000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.374,"15min":0.39200000000000002},"min":{"1min":0.26500000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.54000000000000004,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.40799999999999997,"15min":0.42199999999999999},"min":{"1min":0.32700000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.55900000000000005,"5min":1.224,"15min":1.224},"last":0.39500000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.55400000000000005,"15min":0.57399999999999995},"min":{"1min":0.41699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69399999999999995,"5min":1.694,"15min":1.694},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.54600000000000004,"15min":0.54800000000000004},"min":{"1min":0.46400000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.496}]},{"osd":5,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.54600000000000004,"15min":0.52800000000000002},"min":{"1min":0.436,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79400000000000004,"5min":0.878,"15min":0.878},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55900000000000005,"15min":0.56699999999999995},"min":{"1min":0.49399999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72699999999999998,"5min":1.165,"15min":1.165},"last":0.46400000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58699999999999997,"15min":0.59499999999999997},"min":{"1min":0.46200000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.81299999999999994,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.59599999999999997,"15min":0.60599999999999998},"min":{"1min":0.47099999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78000000000000003,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.51300000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58199999999999996,"15min":0.59599999999999997},"min":{"1min":0.44800000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.74199999999999999,"5min":1.657,"15min":1.657},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.47899999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83399999999999996,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.52300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574911,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298188,"kb_used_data":900,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073652,"statfs":{"total":96636764160,"available":96331419648,"internally_reserved":0,"allocated":921600,"data_stored":406732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.51800000000000002,"15min":0.59299999999999997},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.76600000000000001,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":0.443},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.49199999999999999,"15min":0.502},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.47099999999999997}]},{"osd":1,"last update":"Fri Oct 6 11:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.54400000000000004,"15min":0.61799999999999999},"min":{"1min":0.35999999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70899999999999996,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.499},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55300000000000005,"15min":0.621},"min":{"1min":0.33400000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.72399999999999998,"5min":2.7610000000000001,"15min":2.7610000000000001},"last":0.57399999999999995}]},{"osd":2,"last update":"Fri Oct 6 11:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.57699999999999996},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.78200000000000003,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58599999999999997,"15min":0.61799999999999999},"min":{"1min":0.45400000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.77400000000000002,"5min":1.718,"15min":1.718},"last":0.60499999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.57799999999999996,"15min":0.64000000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.753,"5min":2.677,"15min":2.677},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.51600000000000001,"15min":0.52600000000000002},"min":{"1min":0.36799999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.747,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.68200000000000005}]},{"osd":5,"last update":"Fri Oct 6 11:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.47099999999999997,"15min":0.497},"min":{"1min":0.33900000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.77600000000000002,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.52500000000000002,"15min":0.54700000000000004},"min":{"1min":0.35099999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.752}]},{"osd":6,"last update":"Fri Oct 6 11:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.51000000000000001,"15min":0.53400000000000003},"min":{"1min":0.34599999999999997,"5min":0.252,"15min":0.252},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54900000000000004,"15min":0.59099999999999997},"min":{"1min":0.40699999999999997,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.82099999999999995,"5min":1.165,"15min":1.165},"last":0.73199999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.55200000000000005,"15min":0.56200000000000006},"min":{"1min":0.378,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.59099999999999997,"15min":0.61599999999999999},"min":{"1min":0.437,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80800000000000005,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.70799999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574913,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310432,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061408,"statfs":{"total":96636764160,"available":96318881792,"internally_reserved":0,"allocated":876544,"data_stored":391360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.61799999999999999,"15min":0.70799999999999996},"min":{"1min":0.28399999999999997,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.69499999999999995,"5min":5.0490000000000004,"15min":5.0490000000000004},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.57599999999999996,"15min":0.67600000000000005},"min":{"1min":0.28100000000000003,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.64700000000000002,"5min":5.1449999999999996,"15min":5.1449999999999996},"last":0.47099999999999997}]},{"osd":1,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48499999999999999,"15min":0.49099999999999999},"min":{"1min":0.27500000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.75600000000000001,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.379},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52100000000000002,"15min":0.52900000000000003},"min":{"1min":0.30299999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.70999999999999996,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.55500000000000005}]},{"osd":2,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57899999999999996,"15min":0.56699999999999995},"min":{"1min":0.41299999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.74099999999999999,"5min":4.234,"15min":4.234},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56699999999999995,"15min":0.57699999999999996},"min":{"1min":0.40000000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72999999999999998,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.504}]},{"osd":3,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.61499999999999999,"15min":0.72699999999999998},"min":{"1min":0.32600000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.72099999999999997,"5min":5.2169999999999996,"15min":5.2169999999999996},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54900000000000004,"15min":0.55500000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.70199999999999996,"5min":1.008,"15min":1.008},"last":0.439}]},{"osd":4,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52200000000000002,"15min":0.53600000000000003},"min":{"1min":0.32700000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.745,"5min":1.917,"15min":1.917},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53700000000000003,"15min":0.55500000000000005},"min":{"1min":0.34399999999999997,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.68600000000000005,"5min":0.87,"15min":0.87},"last":0.34000000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56999999999999995,"15min":0.58099999999999996},"min":{"1min":0.34100000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.68700000000000006,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.61399999999999999,"15min":0.629},"min":{"1min":0.42199999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.77200000000000002,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":0.42399999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58399999999999996,"15min":0.60699999999999998},"min":{"1min":0.39600000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.70199999999999996,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61499999999999999,"15min":0.628},"min":{"1min":0.38700000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.72999999999999998,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.54000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:10:40.626 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:10:40.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.772+0000 7f462bfff700 1 Processor -- start 2023-10-06T11:10:40.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.772+0000 7f462bfff700 1 -- start start 2023-10-06T11:10:40.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.773+0000 7f462bfff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f462c15a7f0 0x7f462c15cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:40.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.773+0000 7f462bfff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f462c15c630 con 0x7f462c0b2530 2023-10-06T11:10:40.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.773+0000 7f462bfff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f462c15ba20 con 0x7f462c15a420 2023-10-06T11:10:40.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.773+0000 7f462bfff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f462c0ce040 con 0x7f462c15a7f0 2023-10-06T11:10:40.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.773+0000 7f462b7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f462c0b2530 0x7f462c15acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59536/0 (socket says 172.21.15.146:59536) 2023-10-06T11:10:40.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.773+0000 7f462b7fe700 1 -- 172.21.15.146:0/2322679549 learned_addr learned my addr 172.21.15.146:0/2322679549 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:10:40.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.773+0000 7f46227fc700 1 --2- 172.21.15.146:0/2322679549 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f462c15a7f0 0x7f462c15cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:40.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.773+0000 7f462a7fc700 1 -- 172.21.15.146:0/2322679549 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3425323771 0 0) 0x7f462c15c630 con 0x7f462c0b2530 2023-10-06T11:10:40.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.773+0000 7f462a7fc700 1 -- 172.21.15.146:0/2322679549 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4618003570 con 0x7f462c0b2530 2023-10-06T11:10:40.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.774+0000 7f462a7fc700 1 -- 172.21.15.146:0/2322679549 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1136125026 0 0) 0x7f4618003570 con 0x7f462c0b2530 2023-10-06T11:10:40.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.774+0000 7f462a7fc700 1 -- 172.21.15.146:0/2322679549 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f462c15a7f0 msgr2=0x7f462c15cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:40.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.774+0000 7f462a7fc700 1 --2- 172.21.15.146:0/2322679549 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f462c15a7f0 0x7f462c15cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:40.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.774+0000 7f462a7fc700 1 -- 172.21.15.146:0/2322679549 >> v1:172.21.15.151:6789/0 conn(0x7f462c15a420 legacy=0x7f462c0b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:40.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.774+0000 7f462a7fc700 1 -- 172.21.15.146:0/2322679549 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f462c15bd00 con 0x7f462c0b2530 2023-10-06T11:10:40.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.774+0000 7f462a7fc700 1 -- 172.21.15.146:0/2322679549 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f46240017f0 con 0x7f462c0b2530 2023-10-06T11:10:40.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.774+0000 7f462a7fc700 1 -- 172.21.15.146:0/2322679549 >> v1:172.21.15.146:6789/0 conn(0x7f462c0b2530 legacy=0x7f462c15acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:40.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.774+0000 7f462a7fc700 1 --2- 172.21.15.146:0/2322679549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4618003a90 0x7f4618003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:40.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.774+0000 7f462a7fc700 1 --2- 172.21.15.146:0/2322679549 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f462c15a7f0 0x7f4618004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:40.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.774+0000 7f462a7fc700 1 --2- 172.21.15.146:0/2322679549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4618004d50 0x7f46180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:40.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.774+0000 7f462a7fc700 1 -- 172.21.15.146:0/2322679549 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461800bb10 con 0x7f4618003a90 2023-10-06T11:10:40.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.774+0000 7f462a7fc700 1 -- 172.21.15.146:0/2322679549 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461800bc50 con 0x7f4618004d50 2023-10-06T11:10:40.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.774+0000 7f462a7fc700 1 -- 172.21.15.146:0/2322679549 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f461800be10 con 0x7f462c15a7f0 2023-10-06T11:10:40.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.774+0000 7f462affd700 1 --2- 172.21.15.146:0/2322679549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4618003a90 0x7f4618003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:40.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.774+0000 7f46227fc700 1 --2- 172.21.15.146:0/2322679549 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f462c15a7f0 0x7f4618004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:40.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.774+0000 7f462b7fe700 1 --2- 172.21.15.146:0/2322679549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4618004d50 0x7f46180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:40.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.774+0000 7f462affd700 1 -- 172.21.15.146:0/2322679549 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f462c15a7f0 msgr2=0x7f4618004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:40.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.774+0000 7f462affd700 1 --2- 172.21.15.146:0/2322679549 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f462c15a7f0 0x7f4618004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:40.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.774+0000 7f462affd700 1 -- 172.21.15.146:0/2322679549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4618004d50 msgr2=0x7f46180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:40.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.774+0000 7f462affd700 1 --2- 172.21.15.146:0/2322679549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4618004d50 0x7f46180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:40.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.774+0000 7f462affd700 1 -- 172.21.15.146:0/2322679549 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4618003570 con 0x7f4618003a90 2023-10-06T11:10:40.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.774+0000 7f462affd700 1 --2- 172.21.15.146:0/2322679549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4618003a90 0x7f4618003e60 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f461c0019a0 tx=0x7f461c007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8661ff8afe4c561 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:40.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.774+0000 7f462a7fc700 1 -- 172.21.15.146:0/2322679549 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461c00c5d0 con 0x7f4618003a90 2023-10-06T11:10:40.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.774+0000 7f462a7fc700 1 -- 172.21.15.146:0/2322679549 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f461c00c730 con 0x7f4618003a90 2023-10-06T11:10:40.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.774+0000 7f462a7fc700 1 -- 172.21.15.146:0/2322679549 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461c00cad0 con 0x7f4618003a90 2023-10-06T11:10:40.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.775+0000 7f462bfff700 1 -- 172.21.15.146:0/2322679549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4618003a90 msgr2=0x7f4618003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:40.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.775+0000 7f462bfff700 1 --2- 172.21.15.146:0/2322679549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4618003a90 0x7f4618003e60 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f461c0019a0 tx=0x7f461c007d10 comp rx=0 tx=0).stop 2023-10-06T11:10:40.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.775+0000 7f462b7fe700 1 -- 172.21.15.146:0/2322679549 reap_dead start 2023-10-06T11:10:40.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.775+0000 7f462bfff700 1 -- 172.21.15.146:0/2322679549 shutdown_connections 2023-10-06T11:10:40.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.775+0000 7f462bfff700 1 -- 172.21.15.146:0/2322679549 >> 172.21.15.146:0/2322679549 conn(0x7f462c06eba0 msgr2=0x7f462c06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:40.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.775+0000 7f462bfff700 1 -- 172.21.15.146:0/2322679549 shutdown_connections 2023-10-06T11:10:40.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.775+0000 7f462bfff700 1 -- 172.21.15.146:0/2322679549 wait complete. 2023-10-06T11:10:40.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.776+0000 7f462bfff700 1 Processor -- start 2023-10-06T11:10:40.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.776+0000 7f462bfff700 1 -- start start 2023-10-06T11:10:40.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.777+0000 7f462bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f462c13bdc0 0x7f462c150b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:40.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.777+0000 7f462bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f462c13c190 0x7f462c0d06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:40.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.777+0000 7f462bfff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f462c169a50 0x7f462c14f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:40.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.777+0000 7f462bfff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462c169f30 con 0x7f462c13bdc0 2023-10-06T11:10:40.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.777+0000 7f462bfff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462c16a210 con 0x7f462c13c190 2023-10-06T11:10:40.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.777+0000 7f462bfff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f462c16a4f0 con 0x7f462c169a50 2023-10-06T11:10:40.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.777+0000 7f462affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f462c13bdc0 0x7f462c150b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:40.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.777+0000 7f462affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f462c13bdc0 0x7f462c150b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59684/0 (socket says 172.21.15.146:59684) 2023-10-06T11:10:40.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.777+0000 7f462affd700 1 -- 172.21.15.146:0/3626503348 learned_addr learned my addr 172.21.15.146:0/3626503348 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:40.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.777+0000 7f462affd700 1 -- 172.21.15.146:0/3626503348 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f462c169a50 msgr2=0x7f462c14f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:40.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.777+0000 7f462affd700 1 --2- 172.21.15.146:0/3626503348 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f462c169a50 0x7f462c14f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:40.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.777+0000 7f462affd700 1 -- 172.21.15.146:0/3626503348 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f462c13c190 msgr2=0x7f462c0d06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:40.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.777+0000 7f462affd700 1 --2- 172.21.15.146:0/3626503348 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f462c13c190 0x7f462c0d06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:40.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.777+0000 7f462affd700 1 -- 172.21.15.146:0/3626503348 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f462c16a7d0 con 0x7f462c13bdc0 2023-10-06T11:10:40.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.777+0000 7f462affd700 1 --2- 172.21.15.146:0/3626503348 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f462c13bdc0 0x7f462c150b00 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f4618004770 tx=0x7f461c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:40.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.777+0000 7f46237fe700 1 -- 172.21.15.146:0/3626503348 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461c00c5d0 con 0x7f462c13bdc0 2023-10-06T11:10:40.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.778+0000 7f46237fe700 1 -- 172.21.15.146:0/3626503348 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f461c00ce40 con 0x7f462c13bdc0 2023-10-06T11:10:40.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.778+0000 7f462bfff700 1 -- 172.21.15.146:0/3626503348 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f462c0d0c10 con 0x7f462c13bdc0 2023-10-06T11:10:40.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.778+0000 7f46237fe700 1 -- 172.21.15.146:0/3626503348 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461c00cab0 con 0x7f462c13bdc0 2023-10-06T11:10:40.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.778+0000 7f462bfff700 1 -- 172.21.15.146:0/3626503348 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f462c14fc40 con 0x7f462c13bdc0 2023-10-06T11:10:40.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.778+0000 7f462bfff700 1 -- 172.21.15.146:0/3626503348 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f462c14fe60 con 0x7f462c13bdc0 2023-10-06T11:10:40.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.779+0000 7f46237fe700 1 -- 172.21.15.146:0/3626503348 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f461c019030 con 0x7f462c13bdc0 2023-10-06T11:10:40.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.779+0000 7f46237fe700 1 --2- 172.21.15.146:0/3626503348 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f460c066f30 0x7f460c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:40.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.779+0000 7f46237fe700 1 -- 172.21.15.146:0/3626503348 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f461c0858c0 con 0x7f462c13bdc0 2023-10-06T11:10:40.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.779+0000 7f46227fc700 1 --2- 172.21.15.146:0/3626503348 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f460c066f30 0x7f460c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:40.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.780+0000 7f46227fc700 1 --2- 172.21.15.146:0/3626503348 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f460c066f30 0x7f460c0693e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4614006f00 tx=0x7f46140091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:40.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.783+0000 7f46237fe700 1 -- 172.21.15.146:0/3626503348 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f462c14fe60 con 0x7f462c13bdc0 2023-10-06T11:10:40.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.962+0000 7f462bfff700 1 -- 172.21.15.146:0/3626503348 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f462c16a380 con 0x7f460c066f30 2023-10-06T11:10:40.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.970+0000 7f46237fe700 1 -- 172.21.15.146:0/3626503348 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309727 (secure 0 0 0) 0x7f462c16a380 con 0x7f460c066f30 2023-10-06T11:10:40.975 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:10:40.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.974+0000 7f462bfff700 1 -- 172.21.15.146:0/3626503348 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f460c066f30 msgr2=0x7f460c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:40.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.974+0000 7f462bfff700 1 --2- 172.21.15.146:0/3626503348 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f460c066f30 0x7f460c0693e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4614006f00 tx=0x7f46140091a0 comp rx=0 tx=0).stop 2023-10-06T11:10:40.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.974+0000 7f462bfff700 1 -- 172.21.15.146:0/3626503348 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f462c13bdc0 msgr2=0x7f462c150b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:40.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.974+0000 7f462bfff700 1 --2- 172.21.15.146:0/3626503348 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f462c13bdc0 0x7f462c150b00 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f4618004770 tx=0x7f461c015000 comp rx=0 tx=0).stop 2023-10-06T11:10:40.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.974+0000 7f462bfff700 1 -- 172.21.15.146:0/3626503348 shutdown_connections 2023-10-06T11:10:40.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.974+0000 7f462bfff700 1 --2- 172.21.15.146:0/3626503348 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f460c066f30 0x7f460c0693e0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:40.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.974+0000 7f462bfff700 1 --2- 172.21.15.146:0/3626503348 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f462c169a50 0x7f462c14f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:40.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.974+0000 7f462bfff700 1 --2- 172.21.15.146:0/3626503348 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f462c13bdc0 0x7f462c150b00 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:40.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.974+0000 7f462bfff700 1 --2- 172.21.15.146:0/3626503348 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f462c13c190 0x7f462c0d06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:40.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.974+0000 7f462bfff700 1 -- 172.21.15.146:0/3626503348 >> 172.21.15.146:0/3626503348 conn(0x7f462c06eba0 msgr2=0x7f462c0b5430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:40.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.974+0000 7f462bfff700 1 -- 172.21.15.146:0/3626503348 shutdown_connections 2023-10-06T11:10:40.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:40.974+0000 7f462bfff700 1 -- 172.21.15.146:0/3626503348 wait complete. 2023-10-06T11:10:40.979 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:10:40.989 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":219,"stamp":"2023-10-06T11:10:39.203694+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591904,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":171,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2443800,"kb_used_data":8152,"kb_used_omap":0,"kb_used_meta":2435584,"kb_avail":752530920,"statfs":{"total":773094113280,"available":770591662080,"internally_reserved":0,"allocated":8347648,"data_stored":4377152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2494038016},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1536,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.663423"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.552335+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:38:35.257233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.554801+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:22:51.093918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.562062+0000","last_change":"2023-10-06T11:10:36.562062+0000","last_active":"2023-10-06T11:10:36.562062+0000","last_peered":"2023-10-06T11:10:36.562062+0000","last_clean":"2023-10-06T11:10:36.562062+0000","last_became_active":"2023-10-06T11:10:36.561650+0000","last_became_peered":"2023-10-06T11:10:36.561650+0000","last_unstale":"2023-10-06T11:10:36.562062+0000","last_undegraded":"2023-10-06T11:10:36.562062+0000","last_fullsized":"2023-10-06T11:10:36.562062+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:01.339658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.549185+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:09.031116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.553578+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:24.551243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.553611+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:20.836849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.571352+0000","last_change":"2023-10-06T11:10:36.571352+0000","last_active":"2023-10-06T11:10:36.571352+0000","last_peered":"2023-10-06T11:10:36.571352+0000","last_clean":"2023-10-06T11:10:36.571352+0000","last_became_active":"2023-10-06T11:10:36.570697+0000","last_became_peered":"2023-10-06T11:10:36.570697+0000","last_unstale":"2023-10-06T11:10:36.571352+0000","last_undegraded":"2023-10-06T11:10:36.571352+0000","last_fullsized":"2023-10-06T11:10:36.571352+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:03:22.794550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.555782+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:00:33.203307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.564345+0000","last_change":"2023-10-06T11:10:36.564345+0000","last_active":"2023-10-06T11:10:36.564345+0000","last_peered":"2023-10-06T11:10:36.564345+0000","last_clean":"2023-10-06T11:10:36.564345+0000","last_became_active":"2023-10-06T11:10:36.562959+0000","last_became_peered":"2023-10-06T11:10:36.562959+0000","last_unstale":"2023-10-06T11:10:36.564345+0000","last_undegraded":"2023-10-06T11:10:36.564345+0000","last_fullsized":"2023-10-06T11:10:36.564345+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:09.031116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.548825+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:42.231134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.554210+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:55.429899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.548679+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:17:13.424540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.552957+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:39.156883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.553145+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:12:14.376199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.556432+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:55.888185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.552348+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:26:32.606626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.555261+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:09:50.794839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.571620+0000","last_change":"2023-10-06T11:10:36.571620+0000","last_active":"2023-10-06T11:10:36.571620+0000","last_peered":"2023-10-06T11:10:36.571620+0000","last_clean":"2023-10-06T11:10:36.571620+0000","last_became_active":"2023-10-06T11:10:36.571361+0000","last_became_peered":"2023-10-06T11:10:36.571361+0000","last_unstale":"2023-10-06T11:10:36.571620+0000","last_undegraded":"2023-10-06T11:10:36.571620+0000","last_fullsized":"2023-10-06T11:10:36.571620+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:11:53.044428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.552595+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:24:07.541940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.554842+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:01:59.255497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.565345+0000","last_change":"2023-10-06T11:10:36.565345+0000","last_active":"2023-10-06T11:10:36.565345+0000","last_peered":"2023-10-06T11:10:36.565345+0000","last_clean":"2023-10-06T11:10:36.565345+0000","last_became_active":"2023-10-06T11:10:36.564007+0000","last_became_peered":"2023-10-06T11:10:36.564007+0000","last_unstale":"2023-10-06T11:10:36.565345+0000","last_undegraded":"2023-10-06T11:10:36.565345+0000","last_fullsized":"2023-10-06T11:10:36.565345+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:07.338879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.553928+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:30:57.876539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.564288+0000","last_change":"2023-10-06T11:10:36.564288+0000","last_active":"2023-10-06T11:10:36.564288+0000","last_peered":"2023-10-06T11:10:36.564288+0000","last_clean":"2023-10-06T11:10:36.564288+0000","last_became_active":"2023-10-06T11:10:36.563482+0000","last_became_peered":"2023-10-06T11:10:36.563482+0000","last_unstale":"2023-10-06T11:10:36.564288+0000","last_undegraded":"2023-10-06T11:10:36.564288+0000","last_fullsized":"2023-10-06T11:10:36.564288+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:56:23.575265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.554368+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:35.094726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.554089+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:09.293990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.548095+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:49:54.089077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.553169+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:20.836849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.554359+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:57:30.963073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.554210+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:15:56.228848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.553038+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:12:14.376199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.563437+0000","last_change":"2023-10-06T11:10:36.563437+0000","last_active":"2023-10-06T11:10:36.563437+0000","last_peered":"2023-10-06T11:10:36.563437+0000","last_clean":"2023-10-06T11:10:36.563437+0000","last_became_active":"2023-10-06T11:10:36.563170+0000","last_became_peered":"2023-10-06T11:10:36.563170+0000","last_unstale":"2023-10-06T11:10:36.563437+0000","last_undegraded":"2023-10-06T11:10:36.563437+0000","last_fullsized":"2023-10-06T11:10:36.563437+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:26.706783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.551771+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:24:07.541940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.568203+0000","last_change":"2023-10-06T11:10:36.568203+0000","last_active":"2023-10-06T11:10:36.568203+0000","last_peered":"2023-10-06T11:10:36.568203+0000","last_clean":"2023-10-06T11:10:36.568203+0000","last_became_active":"2023-10-06T11:10:36.567772+0000","last_became_peered":"2023-10-06T11:10:36.567772+0000","last_unstale":"2023-10-06T11:10:36.568203+0000","last_undegraded":"2023-10-06T11:10:36.568203+0000","last_fullsized":"2023-10-06T11:10:36.568203+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:14:16.648125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.564448+0000","last_change":"2023-10-06T11:10:35.564448+0000","last_active":"2023-10-06T11:10:35.564448+0000","last_peered":"2023-10-06T11:10:35.564448+0000","last_clean":"2023-10-06T11:10:35.564448+0000","last_became_active":"2023-10-06T11:10:35.564175+0000","last_became_peered":"2023-10-06T11:10:35.564175+0000","last_unstale":"2023-10-06T11:10:35.564448+0000","last_undegraded":"2023-10-06T11:10:35.564448+0000","last_fullsized":"2023-10-06T11:10:35.564448+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:06:11.497822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.551757+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:20.836849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.561010+0000","last_change":"2023-10-06T11:10:35.561010+0000","last_active":"2023-10-06T11:10:35.561010+0000","last_peered":"2023-10-06T11:10:35.561010+0000","last_clean":"2023-10-06T11:10:35.561010+0000","last_became_active":"2023-10-06T11:10:35.560718+0000","last_became_peered":"2023-10-06T11:10:35.560718+0000","last_unstale":"2023-10-06T11:10:35.561010+0000","last_undegraded":"2023-10-06T11:10:35.561010+0000","last_fullsized":"2023-10-06T11:10:35.561010+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:35.057797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.564783+0000","last_change":"2023-10-06T11:10:36.564783+0000","last_active":"2023-10-06T11:10:36.564783+0000","last_peered":"2023-10-06T11:10:36.564783+0000","last_clean":"2023-10-06T11:10:36.564783+0000","last_became_active":"2023-10-06T11:10:36.564112+0000","last_became_peered":"2023-10-06T11:10:36.564112+0000","last_unstale":"2023-10-06T11:10:36.564783+0000","last_undegraded":"2023-10-06T11:10:36.564783+0000","last_fullsized":"2023-10-06T11:10:36.564783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:17:13.424540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.561374+0000","last_change":"2023-10-06T11:10:35.561374+0000","last_active":"2023-10-06T11:10:35.561374+0000","last_peered":"2023-10-06T11:10:35.561374+0000","last_clean":"2023-10-06T11:10:35.561374+0000","last_became_active":"2023-10-06T11:10:35.561034+0000","last_became_peered":"2023-10-06T11:10:35.561034+0000","last_unstale":"2023-10-06T11:10:35.561374+0000","last_undegraded":"2023-10-06T11:10:35.561374+0000","last_fullsized":"2023-10-06T11:10:35.561374+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:54:52.795843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.563943+0000","last_change":"2023-10-06T11:10:36.563943+0000","last_active":"2023-10-06T11:10:36.563943+0000","last_peered":"2023-10-06T11:10:36.563943+0000","last_clean":"2023-10-06T11:10:36.563943+0000","last_became_active":"2023-10-06T11:10:36.563685+0000","last_became_peered":"2023-10-06T11:10:36.563685+0000","last_unstale":"2023-10-06T11:10:36.563943+0000","last_undegraded":"2023-10-06T11:10:36.563943+0000","last_fullsized":"2023-10-06T11:10:36.563943+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:10:01.462268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"74'2","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.576935+0000","last_change":"2023-10-06T11:10:35.558480+0000","last_active":"2023-10-06T11:10:36.576935+0000","last_peered":"2023-10-06T11:10:36.576935+0000","last_clean":"2023-10-06T11:10:36.576935+0000","last_became_active":"2023-10-06T11:10:35.557916+0000","last_became_peered":"2023-10-06T11:10:35.557916+0000","last_unstale":"2023-10-06T11:10:36.576935+0000","last_undegraded":"2023-10-06T11:10:36.576935+0000","last_fullsized":"2023-10-06T11:10:36.576935+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:43.125026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.552197+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:21:08.092457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"74'1","reported_seq":10,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.555583+0000","last_change":"2023-10-06T11:10:35.563076+0000","last_active":"2023-10-06T11:10:36.555583+0000","last_peered":"2023-10-06T11:10:36.555583+0000","last_clean":"2023-10-06T11:10:36.555583+0000","last_became_active":"2023-10-06T11:10:35.561203+0000","last_became_peered":"2023-10-06T11:10:35.561203+0000","last_unstale":"2023-10-06T11:10:36.555583+0000","last_undegraded":"2023-10-06T11:10:36.555583+0000","last_fullsized":"2023-10-06T11:10:36.555583+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:56:40.528482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.551707+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:12:14.376199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.556455+0000","last_change":"2023-10-06T11:10:35.556455+0000","last_active":"2023-10-06T11:10:35.556455+0000","last_peered":"2023-10-06T11:10:35.556455+0000","last_clean":"2023-10-06T11:10:35.556455+0000","last_became_active":"2023-10-06T11:10:35.556167+0000","last_became_peered":"2023-10-06T11:10:35.556167+0000","last_unstale":"2023-10-06T11:10:35.556455+0000","last_undegraded":"2023-10-06T11:10:35.556455+0000","last_fullsized":"2023-10-06T11:10:35.556455+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:25.699995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.566820+0000","last_change":"2023-10-06T11:10:36.566820+0000","last_active":"2023-10-06T11:10:36.566820+0000","last_peered":"2023-10-06T11:10:36.566820+0000","last_clean":"2023-10-06T11:10:36.566820+0000","last_became_active":"2023-10-06T11:10:36.566558+0000","last_became_peered":"2023-10-06T11:10:36.566558+0000","last_unstale":"2023-10-06T11:10:36.566820+0000","last_undegraded":"2023-10-06T11:10:36.566820+0000","last_fullsized":"2023-10-06T11:10:36.566820+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:42.231134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.559140+0000","last_change":"2023-10-06T11:10:35.559140+0000","last_active":"2023-10-06T11:10:35.559140+0000","last_peered":"2023-10-06T11:10:35.559140+0000","last_clean":"2023-10-06T11:10:35.559140+0000","last_became_active":"2023-10-06T11:10:35.558843+0000","last_became_peered":"2023-10-06T11:10:35.558843+0000","last_unstale":"2023-10-06T11:10:35.559140+0000","last_undegraded":"2023-10-06T11:10:35.559140+0000","last_fullsized":"2023-10-06T11:10:35.559140+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:59:57.232416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.571387+0000","last_change":"2023-10-06T11:10:36.571387+0000","last_active":"2023-10-06T11:10:36.571387+0000","last_peered":"2023-10-06T11:10:36.571387+0000","last_clean":"2023-10-06T11:10:36.571387+0000","last_became_active":"2023-10-06T11:10:36.571001+0000","last_became_peered":"2023-10-06T11:10:36.571001+0000","last_unstale":"2023-10-06T11:10:36.571387+0000","last_undegraded":"2023-10-06T11:10:36.571387+0000","last_fullsized":"2023-10-06T11:10:36.571387+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:22:25.424782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.566163+0000","last_change":"2023-10-06T11:10:35.566163+0000","last_active":"2023-10-06T11:10:35.566163+0000","last_peered":"2023-10-06T11:10:35.566163+0000","last_clean":"2023-10-06T11:10:35.566163+0000","last_became_active":"2023-10-06T11:10:35.565869+0000","last_became_peered":"2023-10-06T11:10:35.565869+0000","last_unstale":"2023-10-06T11:10:35.566163+0000","last_undegraded":"2023-10-06T11:10:35.566163+0000","last_fullsized":"2023-10-06T11:10:35.566163+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:20:09.758618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.551700+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:20:30.493152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.561963+0000","last_change":"2023-10-06T11:10:35.561963+0000","last_active":"2023-10-06T11:10:35.561963+0000","last_peered":"2023-10-06T11:10:35.561963+0000","last_clean":"2023-10-06T11:10:35.561963+0000","last_became_active":"2023-10-06T11:10:35.561673+0000","last_became_peered":"2023-10-06T11:10:35.561673+0000","last_unstale":"2023-10-06T11:10:35.561963+0000","last_undegraded":"2023-10-06T11:10:35.561963+0000","last_fullsized":"2023-10-06T11:10:35.561963+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:16:25.755999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.548736+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:24:29.252009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.558239+0000","last_change":"2023-10-06T11:10:35.558239+0000","last_active":"2023-10-06T11:10:35.558239+0000","last_peered":"2023-10-06T11:10:35.558239+0000","last_clean":"2023-10-06T11:10:35.558239+0000","last_became_active":"2023-10-06T11:10:35.557904+0000","last_became_peered":"2023-10-06T11:10:35.557904+0000","last_unstale":"2023-10-06T11:10:35.558239+0000","last_undegraded":"2023-10-06T11:10:35.558239+0000","last_fullsized":"2023-10-06T11:10:35.558239+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:48:30.196153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.552701+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:20:30.493152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.562574+0000","last_change":"2023-10-06T11:10:35.562574+0000","last_active":"2023-10-06T11:10:35.562574+0000","last_peered":"2023-10-06T11:10:35.562574+0000","last_clean":"2023-10-06T11:10:35.562574+0000","last_became_active":"2023-10-06T11:10:35.562340+0000","last_became_peered":"2023-10-06T11:10:35.562340+0000","last_unstale":"2023-10-06T11:10:35.562574+0000","last_undegraded":"2023-10-06T11:10:35.562574+0000","last_fullsized":"2023-10-06T11:10:35.562574+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:04:45.233259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.558905+0000","last_change":"2023-10-06T11:10:36.558905+0000","last_active":"2023-10-06T11:10:36.558905+0000","last_peered":"2023-10-06T11:10:36.558905+0000","last_clean":"2023-10-06T11:10:36.558905+0000","last_became_active":"2023-10-06T11:10:36.558656+0000","last_became_peered":"2023-10-06T11:10:36.558656+0000","last_unstale":"2023-10-06T11:10:36.558905+0000","last_undegraded":"2023-10-06T11:10:36.558905+0000","last_fullsized":"2023-10-06T11:10:36.558905+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:05:23.675313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"74'6","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.577980+0000","last_change":"2023-10-06T11:10:35.565131+0000","last_active":"2023-10-06T11:10:36.577980+0000","last_peered":"2023-10-06T11:10:36.577980+0000","last_clean":"2023-10-06T11:10:36.577980+0000","last_became_active":"2023-10-06T11:10:35.564906+0000","last_became_peered":"2023-10-06T11:10:35.564906+0000","last_unstale":"2023-10-06T11:10:36.577980+0000","last_undegraded":"2023-10-06T11:10:36.577980+0000","last_fullsized":"2023-10-06T11:10:36.577980+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:17:20.645306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.548074+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:56:23.575265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.566952+0000","last_change":"2023-10-06T11:10:35.566952+0000","last_active":"2023-10-06T11:10:35.566952+0000","last_peered":"2023-10-06T11:10:35.566952+0000","last_clean":"2023-10-06T11:10:35.566952+0000","last_became_active":"2023-10-06T11:10:35.566661+0000","last_became_peered":"2023-10-06T11:10:35.566661+0000","last_unstale":"2023-10-06T11:10:35.566952+0000","last_undegraded":"2023-10-06T11:10:35.566952+0000","last_fullsized":"2023-10-06T11:10:35.566952+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:05:22.668525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.566928+0000","last_change":"2023-10-06T11:10:36.566928+0000","last_active":"2023-10-06T11:10:36.566928+0000","last_peered":"2023-10-06T11:10:36.566928+0000","last_clean":"2023-10-06T11:10:36.566928+0000","last_became_active":"2023-10-06T11:10:36.566624+0000","last_became_peered":"2023-10-06T11:10:36.566624+0000","last_unstale":"2023-10-06T11:10:36.566928+0000","last_undegraded":"2023-10-06T11:10:36.566928+0000","last_fullsized":"2023-10-06T11:10:36.566928+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:26.706783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.563787+0000","last_change":"2023-10-06T11:10:35.563787+0000","last_active":"2023-10-06T11:10:35.563787+0000","last_peered":"2023-10-06T11:10:35.563787+0000","last_clean":"2023-10-06T11:10:35.563787+0000","last_became_active":"2023-10-06T11:10:35.563566+0000","last_became_peered":"2023-10-06T11:10:35.563566+0000","last_unstale":"2023-10-06T11:10:35.563787+0000","last_undegraded":"2023-10-06T11:10:35.563787+0000","last_fullsized":"2023-10-06T11:10:35.563787+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:06.332091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.574907+0000","last_change":"2023-10-06T11:10:36.574907+0000","last_active":"2023-10-06T11:10:36.574907+0000","last_peered":"2023-10-06T11:10:36.574907+0000","last_clean":"2023-10-06T11:10:36.574907+0000","last_became_active":"2023-10-06T11:10:36.571648+0000","last_became_peered":"2023-10-06T11:10:36.571648+0000","last_unstale":"2023-10-06T11:10:36.574907+0000","last_undegraded":"2023-10-06T11:10:36.574907+0000","last_fullsized":"2023-10-06T11:10:36.574907+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:05:23.675313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.564482+0000","last_change":"2023-10-06T11:10:35.564482+0000","last_active":"2023-10-06T11:10:35.564482+0000","last_peered":"2023-10-06T11:10:35.564482+0000","last_clean":"2023-10-06T11:10:35.564482+0000","last_became_active":"2023-10-06T11:10:35.564219+0000","last_became_peered":"2023-10-06T11:10:35.564219+0000","last_unstale":"2023-10-06T11:10:35.564482+0000","last_undegraded":"2023-10-06T11:10:35.564482+0000","last_fullsized":"2023-10-06T11:10:35.564482+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:47.836534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.575443+0000","last_change":"2023-10-06T11:10:36.575443+0000","last_active":"2023-10-06T11:10:36.575443+0000","last_peered":"2023-10-06T11:10:36.575443+0000","last_clean":"2023-10-06T11:10:36.575443+0000","last_became_active":"2023-10-06T11:10:36.575101+0000","last_became_peered":"2023-10-06T11:10:36.575101+0000","last_unstale":"2023-10-06T11:10:36.575443+0000","last_undegraded":"2023-10-06T11:10:36.575443+0000","last_fullsized":"2023-10-06T11:10:36.575443+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:48:31.202941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.556135+0000","last_change":"2023-10-06T11:10:35.556135+0000","last_active":"2023-10-06T11:10:35.556135+0000","last_peered":"2023-10-06T11:10:35.556135+0000","last_clean":"2023-10-06T11:10:35.556135+0000","last_became_active":"2023-10-06T11:10:35.555884+0000","last_became_peered":"2023-10-06T11:10:35.555884+0000","last_unstale":"2023-10-06T11:10:35.556135+0000","last_undegraded":"2023-10-06T11:10:35.556135+0000","last_fullsized":"2023-10-06T11:10:35.556135+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:24:06.535152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.566853+0000","last_change":"2023-10-06T11:10:36.566853+0000","last_active":"2023-10-06T11:10:36.566853+0000","last_peered":"2023-10-06T11:10:36.566853+0000","last_clean":"2023-10-06T11:10:36.566853+0000","last_became_active":"2023-10-06T11:10:36.566589+0000","last_became_peered":"2023-10-06T11:10:36.566589+0000","last_unstale":"2023-10-06T11:10:36.566853+0000","last_undegraded":"2023-10-06T11:10:36.566853+0000","last_fullsized":"2023-10-06T11:10:36.566853+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:11:53.044428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.563007+0000","last_change":"2023-10-06T11:10:35.563007+0000","last_active":"2023-10-06T11:10:35.563007+0000","last_peered":"2023-10-06T11:10:35.563007+0000","last_clean":"2023-10-06T11:10:35.563007+0000","last_became_active":"2023-10-06T11:10:35.562469+0000","last_became_peered":"2023-10-06T11:10:35.562469+0000","last_unstale":"2023-10-06T11:10:35.563007+0000","last_undegraded":"2023-10-06T11:10:35.563007+0000","last_fullsized":"2023-10-06T11:10:35.563007+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:00.332870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.575103+0000","last_change":"2023-10-06T11:10:36.575103+0000","last_active":"2023-10-06T11:10:36.575103+0000","last_peered":"2023-10-06T11:10:36.575103+0000","last_clean":"2023-10-06T11:10:36.575103+0000","last_became_active":"2023-10-06T11:10:36.571536+0000","last_became_peered":"2023-10-06T11:10:36.571536+0000","last_unstale":"2023-10-06T11:10:36.575103+0000","last_undegraded":"2023-10-06T11:10:36.575103+0000","last_fullsized":"2023-10-06T11:10:36.575103+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:14:16.648125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.560230+0000","last_change":"2023-10-06T11:10:35.560230+0000","last_active":"2023-10-06T11:10:35.560230+0000","last_peered":"2023-10-06T11:10:35.560230+0000","last_clean":"2023-10-06T11:10:35.560230+0000","last_became_active":"2023-10-06T11:10:35.559955+0000","last_became_peered":"2023-10-06T11:10:35.559955+0000","last_unstale":"2023-10-06T11:10:35.560230+0000","last_undegraded":"2023-10-06T11:10:35.560230+0000","last_fullsized":"2023-10-06T11:10:35.560230+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:58.839836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.564609+0000","last_change":"2023-10-06T11:10:36.564609+0000","last_active":"2023-10-06T11:10:36.564609+0000","last_peered":"2023-10-06T11:10:36.564609+0000","last_clean":"2023-10-06T11:10:36.564609+0000","last_became_active":"2023-10-06T11:10:36.563769+0000","last_became_peered":"2023-10-06T11:10:36.563769+0000","last_unstale":"2023-10-06T11:10:36.564609+0000","last_undegraded":"2023-10-06T11:10:36.564609+0000","last_fullsized":"2023-10-06T11:10:36.564609+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:49:54.089077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.566590+0000","last_change":"2023-10-06T11:10:35.566590+0000","last_active":"2023-10-06T11:10:35.566590+0000","last_peered":"2023-10-06T11:10:35.566590+0000","last_clean":"2023-10-06T11:10:35.566590+0000","last_became_active":"2023-10-06T11:10:35.566333+0000","last_became_peered":"2023-10-06T11:10:35.566333+0000","last_unstale":"2023-10-06T11:10:35.566590+0000","last_undegraded":"2023-10-06T11:10:35.566590+0000","last_fullsized":"2023-10-06T11:10:35.566590+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:53:16.617219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.552115+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:26:32.606626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.561355+0000","last_change":"2023-10-06T11:10:35.561355+0000","last_active":"2023-10-06T11:10:35.561355+0000","last_peered":"2023-10-06T11:10:35.561355+0000","last_clean":"2023-10-06T11:10:35.561355+0000","last_became_active":"2023-10-06T11:10:35.560750+0000","last_became_peered":"2023-10-06T11:10:35.560750+0000","last_unstale":"2023-10-06T11:10:35.561355+0000","last_undegraded":"2023-10-06T11:10:35.561355+0000","last_fullsized":"2023-10-06T11:10:35.561355+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:58.839836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.575237+0000","last_change":"2023-10-06T11:10:36.575237+0000","last_active":"2023-10-06T11:10:36.575237+0000","last_peered":"2023-10-06T11:10:36.575237+0000","last_clean":"2023-10-06T11:10:36.575237+0000","last_became_active":"2023-10-06T11:10:36.574982+0000","last_became_peered":"2023-10-06T11:10:36.574982+0000","last_unstale":"2023-10-06T11:10:36.575237+0000","last_undegraded":"2023-10-06T11:10:36.575237+0000","last_fullsized":"2023-10-06T11:10:36.575237+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:01.339658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.560484+0000","last_change":"2023-10-06T11:10:35.558225+0000","last_active":"2023-10-06T11:10:35.560484+0000","last_peered":"2023-10-06T11:10:35.560484+0000","last_clean":"2023-10-06T11:10:35.560484+0000","last_became_active":"2023-10-06T11:10:35.557900+0000","last_became_peered":"2023-10-06T11:10:35.557900+0000","last_unstale":"2023-10-06T11:10:35.560484+0000","last_undegraded":"2023-10-06T11:10:35.560484+0000","last_fullsized":"2023-10-06T11:10:35.560484+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:35:59.639899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.563208+0000","last_change":"2023-10-06T11:10:36.563208+0000","last_active":"2023-10-06T11:10:36.563208+0000","last_peered":"2023-10-06T11:10:36.563208+0000","last_clean":"2023-10-06T11:10:36.563208+0000","last_became_active":"2023-10-06T11:10:36.562940+0000","last_became_peered":"2023-10-06T11:10:36.562940+0000","last_unstale":"2023-10-06T11:10:36.563208+0000","last_undegraded":"2023-10-06T11:10:36.563208+0000","last_fullsized":"2023-10-06T11:10:36.563208+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:56:41.535270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.561390+0000","last_change":"2023-10-06T11:10:35.561390+0000","last_active":"2023-10-06T11:10:35.561390+0000","last_peered":"2023-10-06T11:10:35.561390+0000","last_clean":"2023-10-06T11:10:35.561390+0000","last_became_active":"2023-10-06T11:10:35.561115+0000","last_became_peered":"2023-10-06T11:10:35.561115+0000","last_unstale":"2023-10-06T11:10:35.561390+0000","last_undegraded":"2023-10-06T11:10:35.561390+0000","last_fullsized":"2023-10-06T11:10:35.561390+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:01.065689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.563759+0000","last_change":"2023-10-06T11:10:36.563759+0000","last_active":"2023-10-06T11:10:36.563759+0000","last_peered":"2023-10-06T11:10:36.563759+0000","last_clean":"2023-10-06T11:10:36.563759+0000","last_became_active":"2023-10-06T11:10:36.563501+0000","last_became_peered":"2023-10-06T11:10:36.563501+0000","last_unstale":"2023-10-06T11:10:36.563759+0000","last_undegraded":"2023-10-06T11:10:36.563759+0000","last_fullsized":"2023-10-06T11:10:36.563759+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:08.343433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.566866+0000","last_change":"2023-10-06T11:10:35.564323+0000","last_active":"2023-10-06T11:10:35.566866+0000","last_peered":"2023-10-06T11:10:35.566866+0000","last_clean":"2023-10-06T11:10:35.566866+0000","last_became_active":"2023-10-06T11:10:35.564037+0000","last_became_peered":"2023-10-06T11:10:35.564037+0000","last_unstale":"2023-10-06T11:10:35.566866+0000","last_undegraded":"2023-10-06T11:10:35.566866+0000","last_fullsized":"2023-10-06T11:10:35.566866+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:28:03.257860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.567132+0000","last_change":"2023-10-06T11:10:36.567132+0000","last_active":"2023-10-06T11:10:36.567132+0000","last_peered":"2023-10-06T11:10:36.567132+0000","last_clean":"2023-10-06T11:10:36.567132+0000","last_became_active":"2023-10-06T11:10:36.566866+0000","last_became_peered":"2023-10-06T11:10:36.566866+0000","last_unstale":"2023-10-06T11:10:36.567132+0000","last_undegraded":"2023-10-06T11:10:36.567132+0000","last_fullsized":"2023-10-06T11:10:36.567132+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:48:31.202941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.562021+0000","last_change":"2023-10-06T11:10:35.552191+0000","last_active":"2023-10-06T11:10:35.562021+0000","last_peered":"2023-10-06T11:10:35.562021+0000","last_clean":"2023-10-06T11:10:35.562021+0000","last_became_active":"2023-10-06T11:10:35.551916+0000","last_became_peered":"2023-10-06T11:10:35.551916+0000","last_unstale":"2023-10-06T11:10:35.562021+0000","last_undegraded":"2023-10-06T11:10:35.562021+0000","last_fullsized":"2023-10-06T11:10:35.562021+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:07:42.227450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.552863+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:26:32.606626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.566516+0000","last_change":"2023-10-06T11:10:35.566516+0000","last_active":"2023-10-06T11:10:35.566516+0000","last_peered":"2023-10-06T11:10:35.566516+0000","last_clean":"2023-10-06T11:10:35.566516+0000","last_became_active":"2023-10-06T11:10:35.566258+0000","last_became_peered":"2023-10-06T11:10:35.566258+0000","last_unstale":"2023-10-06T11:10:35.566516+0000","last_undegraded":"2023-10-06T11:10:35.566516+0000","last_fullsized":"2023-10-06T11:10:35.566516+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:16:46.568672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":63,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.560581+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:10:35.560581+0000","last_peered":"2023-10-06T11:10:35.560581+0000","last_clean":"2023-10-06T11:10:35.560581+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:10:35.560581+0000","last_undegraded":"2023-10-06T11:10:35.560581+0000","last_fullsized":"2023-10-06T11:10:35.560581+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.553024+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:12:36.084850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"74'2","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.567133+0000","last_change":"2023-10-06T11:10:35.565002+0000","last_active":"2023-10-06T11:10:36.567133+0000","last_peered":"2023-10-06T11:10:36.567133+0000","last_clean":"2023-10-06T11:10:36.567133+0000","last_became_active":"2023-10-06T11:10:35.564718+0000","last_became_peered":"2023-10-06T11:10:35.564718+0000","last_unstale":"2023-10-06T11:10:36.567133+0000","last_undegraded":"2023-10-06T11:10:36.567133+0000","last_fullsized":"2023-10-06T11:10:36.567133+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:12:22.762358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":59,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-10-06T11:10:34.543614+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:10:34.543614+0000","last_peered":"2023-10-06T11:10:34.543614+0000","last_clean":"2023-10-06T11:10:34.543614+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:10:34.543614+0000","last_undegraded":"2023-10-06T11:10:34.543614+0000","last_fullsized":"2023-10-06T11:10:34.543614+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.551941+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:24:04.262059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.561062+0000","last_change":"2023-10-06T11:10:35.561062+0000","last_active":"2023-10-06T11:10:35.561062+0000","last_peered":"2023-10-06T11:10:35.561062+0000","last_clean":"2023-10-06T11:10:35.561062+0000","last_became_active":"2023-10-06T11:10:35.560873+0000","last_became_peered":"2023-10-06T11:10:35.560873+0000","last_unstale":"2023-10-06T11:10:35.561062+0000","last_undegraded":"2023-10-06T11:10:35.561062+0000","last_fullsized":"2023-10-06T11:10:35.561062+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:54:52.795843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":57,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.546220+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:10:35.546220+0000","last_peered":"2023-10-06T11:10:35.546220+0000","last_clean":"2023-10-06T11:10:35.546220+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:10:35.546220+0000","last_undegraded":"2023-10-06T11:10:35.546220+0000","last_fullsized":"2023-10-06T11:10:35.546220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":203,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-10-06T11:10:34.546553+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:10:34.546553+0000","last_peered":"2023-10-06T11:10:34.546553+0000","last_clean":"2023-10-06T11:10:34.546553+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:10:34.546553+0000","last_undegraded":"2023-10-06T11:10:34.546553+0000","last_fullsized":"2023-10-06T11:10:34.546553+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.575734+0000","last_change":"2023-10-06T11:10:36.575734+0000","last_active":"2023-10-06T11:10:36.575734+0000","last_peered":"2023-10-06T11:10:36.575734+0000","last_clean":"2023-10-06T11:10:36.575734+0000","last_became_active":"2023-10-06T11:10:36.575475+0000","last_became_peered":"2023-10-06T11:10:36.575475+0000","last_unstale":"2023-10-06T11:10:36.575734+0000","last_undegraded":"2023-10-06T11:10:36.575734+0000","last_fullsized":"2023-10-06T11:10:36.575734+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:08.343433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.560631+0000","last_change":"2023-10-06T11:10:35.560631+0000","last_active":"2023-10-06T11:10:35.560631+0000","last_peered":"2023-10-06T11:10:35.560631+0000","last_clean":"2023-10-06T11:10:35.560631+0000","last_became_active":"2023-10-06T11:10:35.560377+0000","last_became_peered":"2023-10-06T11:10:35.560377+0000","last_unstale":"2023-10-06T11:10:35.560631+0000","last_undegraded":"2023-10-06T11:10:35.560631+0000","last_fullsized":"2023-10-06T11:10:35.560631+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:16:25.755999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":53,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-10-06T11:10:34.547219+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:10:34.547219+0000","last_peered":"2023-10-06T11:10:34.547219+0000","last_clean":"2023-10-06T11:10:34.547219+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:10:34.547219+0000","last_undegraded":"2023-10-06T11:10:34.547219+0000","last_fullsized":"2023-10-06T11:10:34.547219+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.552732+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:20:30.493152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.560592+0000","last_change":"2023-10-06T11:10:35.560592+0000","last_active":"2023-10-06T11:10:35.560592+0000","last_peered":"2023-10-06T11:10:35.560592+0000","last_clean":"2023-10-06T11:10:35.560592+0000","last_became_active":"2023-10-06T11:10:35.560329+0000","last_became_peered":"2023-10-06T11:10:35.560329+0000","last_unstale":"2023-10-06T11:10:35.560592+0000","last_undegraded":"2023-10-06T11:10:35.560592+0000","last_fullsized":"2023-10-06T11:10:35.560592+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:58.839836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":53,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-10-06T11:10:34.546588+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:10:34.546588+0000","last_peered":"2023-10-06T11:10:34.546588+0000","last_clean":"2023-10-06T11:10:34.546588+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:10:34.546588+0000","last_undegraded":"2023-10-06T11:10:34.546588+0000","last_fullsized":"2023-10-06T11:10:34.546588+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.551778+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:06:36.489499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.562699+0000","last_change":"2023-10-06T11:10:35.562699+0000","last_active":"2023-10-06T11:10:35.562699+0000","last_peered":"2023-10-06T11:10:35.562699+0000","last_clean":"2023-10-06T11:10:35.562699+0000","last_became_active":"2023-10-06T11:10:35.562460+0000","last_became_peered":"2023-10-06T11:10:35.562460+0000","last_unstale":"2023-10-06T11:10:35.562699+0000","last_undegraded":"2023-10-06T11:10:35.562699+0000","last_fullsized":"2023-10-06T11:10:35.562699+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:35.057797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":64,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-10-06T11:10:34.542867+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:10:34.542867+0000","last_peered":"2023-10-06T11:10:34.542867+0000","last_clean":"2023-10-06T11:10:34.542867+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:10:34.542867+0000","last_undegraded":"2023-10-06T11:10:34.542867+0000","last_fullsized":"2023-10-06T11:10:34.542867+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.552588+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:38:35.257233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.563502+0000","last_change":"2023-10-06T11:10:35.558406+0000","last_active":"2023-10-06T11:10:35.563502+0000","last_peered":"2023-10-06T11:10:35.563502+0000","last_clean":"2023-10-06T11:10:35.563502+0000","last_became_active":"2023-10-06T11:10:35.558197+0000","last_became_peered":"2023-10-06T11:10:35.558197+0000","last_unstale":"2023-10-06T11:10:35.563502+0000","last_undegraded":"2023-10-06T11:10:35.563502+0000","last_fullsized":"2023-10-06T11:10:35.563502+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:54:06.008551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":58,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.550516+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:10:35.550516+0000","last_peered":"2023-10-06T11:10:35.550516+0000","last_clean":"2023-10-06T11:10:35.550516+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:10:35.550516+0000","last_undegraded":"2023-10-06T11:10:35.550516+0000","last_fullsized":"2023-10-06T11:10:35.550516+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.553478+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:14:01.696915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.565730+0000","last_change":"2023-10-06T11:10:35.565730+0000","last_active":"2023-10-06T11:10:35.565730+0000","last_peered":"2023-10-06T11:10:35.565730+0000","last_clean":"2023-10-06T11:10:35.565730+0000","last_became_active":"2023-10-06T11:10:35.565461+0000","last_became_peered":"2023-10-06T11:10:35.565461+0000","last_unstale":"2023-10-06T11:10:35.565730+0000","last_undegraded":"2023-10-06T11:10:35.565730+0000","last_fullsized":"2023-10-06T11:10:35.565730+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:16:47.518450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":58,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.550793+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:10:35.550793+0000","last_peered":"2023-10-06T11:10:35.550793+0000","last_clean":"2023-10-06T11:10:35.550793+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:10:35.550793+0000","last_undegraded":"2023-10-06T11:10:35.550793+0000","last_fullsized":"2023-10-06T11:10:35.550793+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":1536,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574911,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298736,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073104,"statfs":{"total":96636764160,"available":96330858496,"internally_reserved":0,"allocated":1482752,"data_stored":988344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":0.872,"15min":0.61399999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":15.506,"5min":23.908999999999999,"15min":23.908999999999999},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.70599999999999996,"15min":0.59099999999999997},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":9.3230000000000004,"5min":9.3230000000000004,"15min":9.3230000000000004},"last":0.40100000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.63400000000000001,"15min":0.56899999999999995},"min":{"1min":0.29999999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71399999999999997,"5min":9.2360000000000007,"15min":9.2360000000000007},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.53200000000000003,"15min":0.51400000000000001},"min":{"1min":0.308,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.60399999999999998,"5min":4.327,"15min":4.327},"last":0.57499999999999996}]},{"osd":2,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.5,"15min":0.50800000000000001},"min":{"1min":0.33200000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.63500000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.59599999999999997,"15min":0.55800000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.74299999999999999,"5min":4.7309999999999999,"15min":4.7309999999999999},"last":0.47699999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.52000000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.7609999999999999,"5min":4.3540000000000001,"15min":4.3540000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.67500000000000004,"15min":0.60099999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.125,"5min":9.3879999999999999,"15min":9.3879999999999999},"last":0.61399999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.50800000000000001,"15min":0.47499999999999998},"min":{"1min":0.25,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.66100000000000003,"5min":4.5709999999999997,"15min":4.5709999999999997},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.54600000000000004,"15min":0.53100000000000003},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.71299999999999997,"5min":4.3129999999999997,"15min":4.3129999999999997},"last":0.50700000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.63300000000000001,"15min":0.57799999999999996},"min":{"1min":0.29399999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.84699999999999998,"5min":9.3499999999999996,"15min":9.3499999999999996},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.57499999999999996,"15min":0.56399999999999995},"min":{"1min":0.36099999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.77200000000000002,"5min":4.444,"15min":4.444},"last":0.64500000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.66400000000000003,"15min":0.61899999999999999},"min":{"1min":0.39200000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.81399999999999995,"5min":9.4969999999999999,"15min":9.4969999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.65600000000000003,"15min":0.61799999999999999},"min":{"1min":0.40300000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88200000000000001,"5min":7.2039999999999997,"15min":7.2039999999999997},"last":0.59099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574913,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310464,"kb_used_data":888,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061376,"statfs":{"total":96636764160,"available":96318849024,"internally_reserved":0,"allocated":909312,"data_stored":405275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:42 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48199999999999998,"15min":0.497},"min":{"1min":0.23799999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.64300000000000002,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51500000000000001,"15min":0.53100000000000003},"min":{"1min":0.35899999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.63,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.39800000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:09:42 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.47899999999999998,"15min":0.498},"min":{"1min":0.26400000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.629,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.47499999999999998,"15min":0.496},"min":{"1min":0.379,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.55400000000000005,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.31900000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:09:42 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.53300000000000003,"15min":0.499},"min":{"1min":0.31900000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.65800000000000003,"5min":7.0659999999999998,"15min":7.0659999999999998},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.55700000000000005,"15min":0.52700000000000002},"min":{"1min":0.29899999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.75800000000000001,"5min":7.0819999999999999,"15min":7.0819999999999999},"last":0.44400000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:09:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.504,"15min":0.496},"min":{"1min":0.436,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.65500000000000003,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53100000000000003,"15min":0.53700000000000003},"min":{"1min":0.40000000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.72399999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.50800000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:09:42 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.47599999999999998,"15min":0.503},"min":{"1min":0.30399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.495},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.52400000000000002,"15min":0.56200000000000006},"min":{"1min":0.33100000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69399999999999995,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.42999999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:09:42 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51300000000000001,"15min":0.53500000000000003},"min":{"1min":0.313,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.69299999999999995,"5min":0.75,"15min":0.75},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54800000000000004,"15min":0.58199999999999996},"min":{"1min":0.34499999999999997,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78800000000000003,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.53700000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:09:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55600000000000005,"15min":0.57499999999999996},"min":{"1min":0.377,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71699999999999997,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58299999999999996,"15min":0.60499999999999998},"min":{"1min":0.36699999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.754,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.58399999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574912,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311044,"kb_used_data":1468,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060796,"statfs":{"total":96636764160,"available":96318255104,"internally_reserved":0,"allocated":1503232,"data_stored":995572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.33200000000000002,"15min":0.34200000000000003},"min":{"1min":0.24199999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.215,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.40999999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.34399999999999997,"15min":0.33600000000000002},"min":{"1min":0.23599999999999999,"5min":0.22,"15min":0.22},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.39600000000000002,"15min":0.38900000000000001},"min":{"1min":0.26500000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.38200000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.41399999999999998,"15min":0.41099999999999998},"min":{"1min":0.28299999999999997,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.68999999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.38100000000000001,"15min":0.36899999999999999},"min":{"1min":0.29799999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.33900000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.53000000000000003,"15min":0.50800000000000001},"min":{"1min":0.34399999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55800000000000005,"15min":0.54000000000000004},"min":{"1min":0.45300000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.68999999999999995}]},{"osd":5,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55900000000000005,"15min":0.54900000000000004},"min":{"1min":0.38800000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.56299999999999994,"15min":0.54100000000000004},"min":{"1min":0.40000000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.626}]},{"osd":6,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57199999999999995,"15min":0.56200000000000006},"min":{"1min":0.36899999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.59199999999999997,"15min":0.57399999999999995},"min":{"1min":0.376,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.73199999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.59999999999999998,"15min":0.58999999999999997},"min":{"1min":0.48699999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84299999999999997,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.42899999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.746}]}]},{"osd":0,"up_from":13,"seq":55834574911,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302248,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069592,"statfs":{"total":96636764160,"available":96327262208,"internally_reserved":0,"allocated":884736,"data_stored":396623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":1.9379999999999999,"5min":0.64700000000000002,"15min":0.44},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":36.097999999999999,"5min":36.097999999999999,"15min":36.097999999999999},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.35999999999999999,"15min":0.34699999999999998},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.39300000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":1.9810000000000001,"5min":0.69099999999999995,"15min":0.48299999999999998},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":36.07,"5min":36.07,"15min":36.07},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.40000000000000002,"15min":0.379},"min":{"1min":0.23200000000000001,"5min":0.219,"15min":0.219},"max":{"1min":5.125,"5min":5.125,"15min":5.125},"last":0.35199999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.44,"15min":0.39600000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":8.4130000000000003,"5min":8.4130000000000003,"15min":8.4130000000000003},"last":0.42499999999999999},{"interface":"front","average":{"1min":2.0030000000000001,"5min":0.74399999999999999,"15min":0.54200000000000004},"min":{"1min":0.30199999999999999,"5min":0.252,"15min":0.252},"max":{"1min":35.959000000000003,"5min":35.959000000000003,"15min":35.959000000000003},"last":0.371}]},{"osd":4,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.56799999999999995,"15min":0.56299999999999994},"min":{"1min":0.48199999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.61399999999999999},{"interface":"front","average":{"1min":2.2120000000000002,"5min":0.92700000000000005,"15min":0.72099999999999997},"min":{"1min":0.48999999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":36.005000000000003,"5min":36.005000000000003,"15min":36.005000000000003},"last":0.58899999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.55700000000000005,"15min":0.55400000000000005},"min":{"1min":0.433,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56299999999999994,"15min":0.54900000000000004},"min":{"1min":0.45700000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.64800000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":2.194,"5min":0.91900000000000004,"15min":0.71699999999999997},"min":{"1min":0.47199999999999998,"5min":0.375,"15min":0.375},"max":{"1min":36.037999999999997,"5min":36.037999999999997,"15min":36.037999999999997},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.63900000000000001,"15min":0.61699999999999999},"min":{"1min":0.434,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":4.8810000000000002,"5min":4.8810000000000002,"15min":4.8810000000000002},"last":0.57699999999999996}]},{"osd":7,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60599999999999998,"15min":0.60799999999999998},"min":{"1min":0.41499999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":2.3530000000000002,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.44500000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.56299999999999994}]}]},{"osd":2,"up_from":13,"seq":55834574912,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314536,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94057304,"statfs":{"total":96636764160,"available":96314679296,"internally_reserved":0,"allocated":884736,"data_stored":396623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.307,"15min":0.308},"min":{"1min":0.218,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.39700000000000002,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.375,"15min":0.38300000000000001},"min":{"1min":0.27700000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53300000000000003,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.32200000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36599999999999999,"15min":0.374},"min":{"1min":0.252,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56299999999999994,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.35399999999999998,"15min":0.34799999999999998},"min":{"1min":0.249,"5min":0.217,"15min":0.217},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.33400000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.36699999999999999,"15min":0.372},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.628,"5min":0.629,"15min":0.629},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.35899999999999999,"15min":0.36499999999999999},"min":{"1min":0.26200000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.47699999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.29499999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.36599999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.77500000000000002,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.502},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.42599999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72299999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.64400000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.35999999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.67600000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.623},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55700000000000005,"15min":0.55300000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72999999999999998,"5min":0.87,"15min":0.87},"last":0.49099999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76000000000000001,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57599999999999996,"15min":0.57799999999999996},"min":{"1min":0.39400000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.72199999999999998,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.53600000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56799999999999995,"15min":0.55300000000000005},"min":{"1min":0.40200000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.76600000000000001,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57299999999999995,"15min":0.57099999999999995},"min":{"1min":0.40200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73499999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.42599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574912,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298152,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073688,"statfs":{"total":96636764160,"available":96331456512,"internally_reserved":0,"allocated":884736,"data_stored":396623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.313,"15min":0.32700000000000001},"min":{"1min":0.218,"5min":0.188,"15min":0.188},"max":{"1min":0.47099999999999997,"5min":1.095,"15min":1.095},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.38,"15min":0.40200000000000002},"min":{"1min":0.30399999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.52400000000000002,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.32500000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.313,"15min":0.309},"min":{"1min":0.23200000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.46899999999999997,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.35999999999999999,"15min":0.37},"min":{"1min":0.25900000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.48599999999999999,"5min":1.196,"15min":1.196},"last":0.33800000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.374,"15min":0.39200000000000002},"min":{"1min":0.26500000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.54000000000000004,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.40799999999999997,"15min":0.42199999999999999},"min":{"1min":0.32700000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.55900000000000005,"5min":1.224,"15min":1.224},"last":0.39500000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.55400000000000005,"15min":0.57399999999999995},"min":{"1min":0.41699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69399999999999995,"5min":1.694,"15min":1.694},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.54600000000000004,"15min":0.54800000000000004},"min":{"1min":0.46400000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.496}]},{"osd":5,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.54600000000000004,"15min":0.52800000000000002},"min":{"1min":0.436,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79400000000000004,"5min":0.878,"15min":0.878},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55900000000000005,"15min":0.56699999999999995},"min":{"1min":0.49399999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72699999999999998,"5min":1.165,"15min":1.165},"last":0.46400000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58699999999999997,"15min":0.59499999999999997},"min":{"1min":0.46200000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.81299999999999994,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.59599999999999997,"15min":0.60599999999999998},"min":{"1min":0.47099999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78000000000000003,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.51300000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58199999999999996,"15min":0.59599999999999997},"min":{"1min":0.44800000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.74199999999999999,"5min":1.657,"15min":1.657},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.47899999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83399999999999996,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.52300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574911,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298188,"kb_used_data":900,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073652,"statfs":{"total":96636764160,"available":96331419648,"internally_reserved":0,"allocated":921600,"data_stored":406732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.51800000000000002,"15min":0.59299999999999997},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.76600000000000001,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":0.443},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.49199999999999999,"15min":0.502},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.47099999999999997}]},{"osd":1,"last update":"Fri Oct 6 11:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.54400000000000004,"15min":0.61799999999999999},"min":{"1min":0.35999999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70899999999999996,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.499},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55300000000000005,"15min":0.621},"min":{"1min":0.33400000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.72399999999999998,"5min":2.7610000000000001,"15min":2.7610000000000001},"last":0.57399999999999995}]},{"osd":2,"last update":"Fri Oct 6 11:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.57699999999999996},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.78200000000000003,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58599999999999997,"15min":0.61799999999999999},"min":{"1min":0.45400000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.77400000000000002,"5min":1.718,"15min":1.718},"last":0.60499999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.57799999999999996,"15min":0.64000000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.753,"5min":2.677,"15min":2.677},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.51600000000000001,"15min":0.52600000000000002},"min":{"1min":0.36799999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.747,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.68200000000000005}]},{"osd":5,"last update":"Fri Oct 6 11:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.47099999999999997,"15min":0.497},"min":{"1min":0.33900000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.77600000000000002,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.52500000000000002,"15min":0.54700000000000004},"min":{"1min":0.35099999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.752}]},{"osd":6,"last update":"Fri Oct 6 11:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.51000000000000001,"15min":0.53400000000000003},"min":{"1min":0.34599999999999997,"5min":0.252,"15min":0.252},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54900000000000004,"15min":0.59099999999999997},"min":{"1min":0.40699999999999997,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.82099999999999995,"5min":1.165,"15min":1.165},"last":0.73199999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.55200000000000005,"15min":0.56200000000000006},"min":{"1min":0.378,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.59099999999999997,"15min":0.61599999999999999},"min":{"1min":0.437,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80800000000000005,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.70799999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574913,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310432,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061408,"statfs":{"total":96636764160,"available":96318881792,"internally_reserved":0,"allocated":876544,"data_stored":391360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.61799999999999999,"15min":0.70799999999999996},"min":{"1min":0.28399999999999997,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.69499999999999995,"5min":5.0490000000000004,"15min":5.0490000000000004},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.57599999999999996,"15min":0.67600000000000005},"min":{"1min":0.28100000000000003,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.64700000000000002,"5min":5.1449999999999996,"15min":5.1449999999999996},"last":0.47099999999999997}]},{"osd":1,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48499999999999999,"15min":0.49099999999999999},"min":{"1min":0.27500000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.75600000000000001,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.379},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52100000000000002,"15min":0.52900000000000003},"min":{"1min":0.30299999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.70999999999999996,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.55500000000000005}]},{"osd":2,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57899999999999996,"15min":0.56699999999999995},"min":{"1min":0.41299999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.74099999999999999,"5min":4.234,"15min":4.234},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56699999999999995,"15min":0.57699999999999996},"min":{"1min":0.40000000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72999999999999998,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.504}]},{"osd":3,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.61499999999999999,"15min":0.72699999999999998},"min":{"1min":0.32600000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.72099999999999997,"5min":5.2169999999999996,"15min":5.2169999999999996},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54900000000000004,"15min":0.55500000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.70199999999999996,"5min":1.008,"15min":1.008},"last":0.439}]},{"osd":4,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52200000000000002,"15min":0.53600000000000003},"min":{"1min":0.32700000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.745,"5min":1.917,"15min":1.917},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53700000000000003,"15min":0.55500000000000005},"min":{"1min":0.34399999999999997,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.68600000000000005,"5min":0.87,"15min":0.87},"last":0.34000000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56999999999999995,"15min":0.58099999999999996},"min":{"1min":0.34100000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.68700000000000006,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.61399999999999999,"15min":0.629},"min":{"1min":0.42199999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.77200000000000002,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":0.42399999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58399999999999996,"15min":0.60699999999999998},"min":{"1min":0.39600000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.70199999999999996,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61499999999999999,"15min":0.628},"min":{"1min":0.38700000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.72999999999999998,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.54000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:10:40.996 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:10:41.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.142+0000 7fbdc142b700 1 Processor -- start 2023-10-06T11:10:41.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.142+0000 7fbdc142b700 1 -- start start 2023-10-06T11:10:41.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.143+0000 7fbdc142b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbdbc0ab010 0x7fbdbc157800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:41.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.143+0000 7fbdc142b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbdbc0ca070 0x7fbdbc0cc240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:41.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.143+0000 7fbdc142b700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdbc0ccf20 con 0x7fbdbc157430 2023-10-06T11:10:41.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.143+0000 7fbdc142b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdbc0ca4f0 con 0x7fbdbc0ab010 2023-10-06T11:10:41.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.143+0000 7fbdc142b700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdbc0c3dd0 con 0x7fbdbc0ca070 2023-10-06T11:10:41.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.143+0000 7fbdba7fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbdbc0ab010 0x7fbdbc157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:41.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.143+0000 7fbdba7fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbdbc0ab010 0x7fbdbc157800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59700/0 (socket says 172.21.15.146:59700) 2023-10-06T11:10:41.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.143+0000 7fbdba7fc700 1 -- 172.21.15.146:0/1535486306 learned_addr learned my addr 172.21.15.146:0/1535486306 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:41.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.144+0000 7fbdbb7fe700 1 --2- 172.21.15.146:0/1535486306 >> v2:172.21.15.151:3300/0 conn(0x7fbdbc0ca070 0x7fbdbc0cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:41.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.144+0000 7fbdba7fc700 1 -- 172.21.15.146:0/1535486306 >> v2:172.21.15.151:3300/0 conn(0x7fbdbc0ca070 msgr2=0x7fbdbc0cc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:41.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.144+0000 7fbdba7fc700 1 --2- 172.21.15.146:0/1535486306 >> v2:172.21.15.151:3300/0 conn(0x7fbdbc0ca070 0x7fbdbc0cc240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:41.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.144+0000 7fbdba7fc700 1 -- 172.21.15.146:0/1535486306 >> v1:172.21.15.151:6789/0 conn(0x7fbdbc157430 legacy=0x7fbdbc0ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:41.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.144+0000 7fbdba7fc700 1 -- 172.21.15.146:0/1535486306 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdbc0cd200 con 0x7fbdbc0ab010 2023-10-06T11:10:41.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.144+0000 7fbdba7fc700 1 --2- 172.21.15.146:0/1535486306 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbdbc0ab010 0x7fbdbc157800 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc0ce3f0 tx=0x7fbdb0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc02c5f7c47000 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:41.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.144+0000 7fbdb9ffb700 1 -- 172.21.15.146:0/1535486306 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb000b860 con 0x7fbdbc0ab010 2023-10-06T11:10:41.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.144+0000 7fbdb9ffb700 1 -- 172.21.15.146:0/1535486306 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb000b9c0 con 0x7fbdbc0ab010 2023-10-06T11:10:41.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.144+0000 7fbdb9ffb700 1 -- 172.21.15.146:0/1535486306 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb000bd80 con 0x7fbdbc0ab010 2023-10-06T11:10:41.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.144+0000 7fbdc142b700 1 -- 172.21.15.146:0/1535486306 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbdbc0ab010 msgr2=0x7fbdbc157800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:41.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.144+0000 7fbdc142b700 1 --2- 172.21.15.146:0/1535486306 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbdbc0ab010 0x7fbdbc157800 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc0ce3f0 tx=0x7fbdb0009250 comp rx=0 tx=0).stop 2023-10-06T11:10:41.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.145+0000 7fbdc142b700 1 -- 172.21.15.146:0/1535486306 shutdown_connections 2023-10-06T11:10:41.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.145+0000 7fbdc142b700 1 --2- 172.21.15.146:0/1535486306 >> v2:172.21.15.151:3300/0 conn(0x7fbdbc0ca070 0x7fbdbc0cc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:41.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.145+0000 7fbdc142b700 1 --2- 172.21.15.146:0/1535486306 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbdbc0ab010 0x7fbdbc157800 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:41.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.145+0000 7fbdc142b700 1 -- 172.21.15.146:0/1535486306 >> 172.21.15.146:0/1535486306 conn(0x7fbdbc067c50 msgr2=0x7fbdbc0ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:41.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.145+0000 7fbdc142b700 1 -- 172.21.15.146:0/1535486306 shutdown_connections 2023-10-06T11:10:41.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.145+0000 7fbdc142b700 1 -- 172.21.15.146:0/1535486306 wait complete. 2023-10-06T11:10:41.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.146+0000 7fbdc142b700 1 Processor -- start 2023-10-06T11:10:41.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.146+0000 7fbdc142b700 1 -- start start 2023-10-06T11:10:41.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.147+0000 7fbdc142b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbdbc0ab010 0x7fbdbc0c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:41.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.147+0000 7fbdc142b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbdbc0ca070 0x7fbdbc151dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:41.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.147+0000 7fbdc142b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbdbc157430 0x7fbdbc1682e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:41.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.147+0000 7fbdc142b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc0b32f0 con 0x7fbdbc0ca070 2023-10-06T11:10:41.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.147+0000 7fbdc142b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc0b35d0 con 0x7fbdbc0ab010 2023-10-06T11:10:41.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.147+0000 7fbdc142b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc0b38b0 con 0x7fbdbc157430 2023-10-06T11:10:41.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.147+0000 7fbdba7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbdbc0ca070 0x7fbdbc151dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:41.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.147+0000 7fbdba7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbdbc0ca070 0x7fbdbc151dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:59714/0 (socket says 172.21.15.146:59714) 2023-10-06T11:10:41.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.147+0000 7fbdba7fc700 1 -- 172.21.15.146:0/1368186638 learned_addr learned my addr 172.21.15.146:0/1368186638 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:41.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.147+0000 7fbdbb7fe700 1 --2- 172.21.15.146:0/1368186638 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbdbc157430 0x7fbdbc1682e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:41.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.147+0000 7fbdbaffd700 1 --2- 172.21.15.146:0/1368186638 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbdbc0ab010 0x7fbdbc0c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:41.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.147+0000 7fbdba7fc700 1 -- 172.21.15.146:0/1368186638 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbdbc157430 msgr2=0x7fbdbc1682e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:41.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.147+0000 7fbdba7fc700 1 --2- 172.21.15.146:0/1368186638 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbdbc157430 0x7fbdbc1682e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:41.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.147+0000 7fbdba7fc700 1 -- 172.21.15.146:0/1368186638 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbdbc0ab010 msgr2=0x7fbdbc0c7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:41.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.147+0000 7fbdba7fc700 1 --2- 172.21.15.146:0/1368186638 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbdbc0ab010 0x7fbdbc0c7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:41.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.147+0000 7fbdba7fc700 1 -- 172.21.15.146:0/1368186638 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb00094f0 con 0x7fbdbc0ca070 2023-10-06T11:10:41.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.147+0000 7fbdba7fc700 1 --2- 172.21.15.146:0/1368186638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbdbc0ca070 0x7fbdbc151dd0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc06e410 tx=0x7fbdb0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:41.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.147+0000 7fbda2ffd700 1 -- 172.21.15.146:0/1368186638 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb001f070 con 0x7fbdbc0ca070 2023-10-06T11:10:41.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.147+0000 7fbda2ffd700 1 -- 172.21.15.146:0/1368186638 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb0002f30 con 0x7fbdbc0ca070 2023-10-06T11:10:41.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.147+0000 7fbdc142b700 1 -- 172.21.15.146:0/1368186638 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdbc167de0 con 0x7fbdbc0ca070 2023-10-06T11:10:41.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.147+0000 7fbda2ffd700 1 -- 172.21.15.146:0/1368186638 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb0011d50 con 0x7fbdbc0ca070 2023-10-06T11:10:41.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.147+0000 7fbdc142b700 1 -- 172.21.15.146:0/1368186638 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdbc167a90 con 0x7fbdbc0ca070 2023-10-06T11:10:41.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.148+0000 7fbdc142b700 1 -- 172.21.15.146:0/1368186638 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdbc04c380 con 0x7fbdbc0ca070 2023-10-06T11:10:41.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.149+0000 7fbda2ffd700 1 -- 172.21.15.146:0/1368186638 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbdb0023070 con 0x7fbdbc0ca070 2023-10-06T11:10:41.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.149+0000 7fbda2ffd700 1 --2- 172.21.15.146:0/1368186638 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbda8066f30 0x7fbda80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:41.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.149+0000 7fbda2ffd700 1 -- 172.21.15.146:0/1368186638 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbdb0085a40 con 0x7fbdbc0ca070 2023-10-06T11:10:41.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.149+0000 7fbdbaffd700 1 --2- 172.21.15.146:0/1368186638 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbda8066f30 0x7fbda80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:41.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.150+0000 7fbdbaffd700 1 --2- 172.21.15.146:0/1368186638 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbda8066f30 0x7fbda80693e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbdac007fd0 tx=0x7fbdac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:41.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.153+0000 7fbda2ffd700 1 -- 172.21.15.146:0/1368186638 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbdb0087e60 con 0x7fbdbc0ca070 2023-10-06T11:10:41.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.334+0000 7fbdc142b700 1 -- 172.21.15.146:0/1368186638 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbdbc0b3a70 con 0x7fbda8066f30 2023-10-06T11:10:41.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.343+0000 7fbda2ffd700 1 -- 172.21.15.146:0/1368186638 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309727 (secure 0 0 0) 0x7fbdbc0b3a70 con 0x7fbda8066f30 2023-10-06T11:10:41.348 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:10:41.351 INFO:tasks.ceph.mds.b.smithi151.stderr:2023-10-06T11:10:41.348+0000 7f5f9f756700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T11:10:41.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.346+0000 7fbdc142b700 1 -- 172.21.15.146:0/1368186638 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbda8066f30 msgr2=0x7fbda80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:41.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.346+0000 7fbdc142b700 1 --2- 172.21.15.146:0/1368186638 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbda8066f30 0x7fbda80693e0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbdac007fd0 tx=0x7fbdac009040 comp rx=0 tx=0).stop 2023-10-06T11:10:41.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.346+0000 7fbdc142b700 1 -- 172.21.15.146:0/1368186638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbdbc0ca070 msgr2=0x7fbdbc151dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:41.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.346+0000 7fbdc142b700 1 --2- 172.21.15.146:0/1368186638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbdbc0ca070 0x7fbdbc151dd0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc06e410 tx=0x7fbdb0017000 comp rx=0 tx=0).stop 2023-10-06T11:10:41.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.346+0000 7fbdc142b700 1 -- 172.21.15.146:0/1368186638 shutdown_connections 2023-10-06T11:10:41.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.346+0000 7fbdc142b700 1 --2- 172.21.15.146:0/1368186638 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbda8066f30 0x7fbda80693e0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:41.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.346+0000 7fbdc142b700 1 --2- 172.21.15.146:0/1368186638 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbdbc157430 0x7fbdbc1682e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:41.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.346+0000 7fbdc142b700 1 --2- 172.21.15.146:0/1368186638 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbdbc0ab010 0x7fbdbc0c7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:41.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.346+0000 7fbdc142b700 1 --2- 172.21.15.146:0/1368186638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbdbc0ca070 0x7fbdbc151dd0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:41.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.346+0000 7fbdc142b700 1 -- 172.21.15.146:0/1368186638 >> 172.21.15.146:0/1368186638 conn(0x7fbdbc067c50 msgr2=0x7fbdbc1563c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:41.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.346+0000 7fbdc142b700 1 -- 172.21.15.146:0/1368186638 shutdown_connections 2023-10-06T11:10:41.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.346+0000 7fbdc142b700 1 -- 172.21.15.146:0/1368186638 wait complete. 2023-10-06T11:10:41.352 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:10:41.360 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":220,"stamp":"2023-10-06T11:10:41.204013+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591904,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":171,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2443800,"kb_used_data":8152,"kb_used_omap":0,"kb_used_meta":2435584,"kb_avail":752530920,"statfs":{"total":773094113280,"available":770591662080,"internally_reserved":0,"allocated":8347648,"data_stored":4377152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2494038016},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1536,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000981"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.552335+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:38:35.257233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.554801+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:22:51.093918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.562062+0000","last_change":"2023-10-06T11:10:36.562062+0000","last_active":"2023-10-06T11:10:36.562062+0000","last_peered":"2023-10-06T11:10:36.562062+0000","last_clean":"2023-10-06T11:10:36.562062+0000","last_became_active":"2023-10-06T11:10:36.561650+0000","last_became_peered":"2023-10-06T11:10:36.561650+0000","last_unstale":"2023-10-06T11:10:36.562062+0000","last_undegraded":"2023-10-06T11:10:36.562062+0000","last_fullsized":"2023-10-06T11:10:36.562062+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:01.339658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.549185+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:09.031116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.553578+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:24.551243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.553611+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:20.836849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.571352+0000","last_change":"2023-10-06T11:10:36.571352+0000","last_active":"2023-10-06T11:10:36.571352+0000","last_peered":"2023-10-06T11:10:36.571352+0000","last_clean":"2023-10-06T11:10:36.571352+0000","last_became_active":"2023-10-06T11:10:36.570697+0000","last_became_peered":"2023-10-06T11:10:36.570697+0000","last_unstale":"2023-10-06T11:10:36.571352+0000","last_undegraded":"2023-10-06T11:10:36.571352+0000","last_fullsized":"2023-10-06T11:10:36.571352+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:03:22.794550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.555782+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:00:33.203307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.564345+0000","last_change":"2023-10-06T11:10:36.564345+0000","last_active":"2023-10-06T11:10:36.564345+0000","last_peered":"2023-10-06T11:10:36.564345+0000","last_clean":"2023-10-06T11:10:36.564345+0000","last_became_active":"2023-10-06T11:10:36.562959+0000","last_became_peered":"2023-10-06T11:10:36.562959+0000","last_unstale":"2023-10-06T11:10:36.564345+0000","last_undegraded":"2023-10-06T11:10:36.564345+0000","last_fullsized":"2023-10-06T11:10:36.564345+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:09.031116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.548825+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:42.231134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.554210+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:55.429899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.548679+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:17:13.424540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.552957+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:39.156883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.553145+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:12:14.376199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.556432+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:55.888185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.552348+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:26:32.606626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.555261+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:09:50.794839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.571620+0000","last_change":"2023-10-06T11:10:36.571620+0000","last_active":"2023-10-06T11:10:36.571620+0000","last_peered":"2023-10-06T11:10:36.571620+0000","last_clean":"2023-10-06T11:10:36.571620+0000","last_became_active":"2023-10-06T11:10:36.571361+0000","last_became_peered":"2023-10-06T11:10:36.571361+0000","last_unstale":"2023-10-06T11:10:36.571620+0000","last_undegraded":"2023-10-06T11:10:36.571620+0000","last_fullsized":"2023-10-06T11:10:36.571620+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:11:53.044428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.552595+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:24:07.541940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.554842+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:01:59.255497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.565345+0000","last_change":"2023-10-06T11:10:36.565345+0000","last_active":"2023-10-06T11:10:36.565345+0000","last_peered":"2023-10-06T11:10:36.565345+0000","last_clean":"2023-10-06T11:10:36.565345+0000","last_became_active":"2023-10-06T11:10:36.564007+0000","last_became_peered":"2023-10-06T11:10:36.564007+0000","last_unstale":"2023-10-06T11:10:36.565345+0000","last_undegraded":"2023-10-06T11:10:36.565345+0000","last_fullsized":"2023-10-06T11:10:36.565345+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:07.338879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.553928+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:30:57.876539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.564288+0000","last_change":"2023-10-06T11:10:36.564288+0000","last_active":"2023-10-06T11:10:36.564288+0000","last_peered":"2023-10-06T11:10:36.564288+0000","last_clean":"2023-10-06T11:10:36.564288+0000","last_became_active":"2023-10-06T11:10:36.563482+0000","last_became_peered":"2023-10-06T11:10:36.563482+0000","last_unstale":"2023-10-06T11:10:36.564288+0000","last_undegraded":"2023-10-06T11:10:36.564288+0000","last_fullsized":"2023-10-06T11:10:36.564288+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:56:23.575265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.554368+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:35.094726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.554089+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:09.293990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.548095+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:49:54.089077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.553169+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:20.836849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.554359+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:57:30.963073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.554210+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:15:56.228848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.553038+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:12:14.376199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.563437+0000","last_change":"2023-10-06T11:10:36.563437+0000","last_active":"2023-10-06T11:10:36.563437+0000","last_peered":"2023-10-06T11:10:36.563437+0000","last_clean":"2023-10-06T11:10:36.563437+0000","last_became_active":"2023-10-06T11:10:36.563170+0000","last_became_peered":"2023-10-06T11:10:36.563170+0000","last_unstale":"2023-10-06T11:10:36.563437+0000","last_undegraded":"2023-10-06T11:10:36.563437+0000","last_fullsized":"2023-10-06T11:10:36.563437+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:26.706783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.551771+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:24:07.541940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.568203+0000","last_change":"2023-10-06T11:10:36.568203+0000","last_active":"2023-10-06T11:10:36.568203+0000","last_peered":"2023-10-06T11:10:36.568203+0000","last_clean":"2023-10-06T11:10:36.568203+0000","last_became_active":"2023-10-06T11:10:36.567772+0000","last_became_peered":"2023-10-06T11:10:36.567772+0000","last_unstale":"2023-10-06T11:10:36.568203+0000","last_undegraded":"2023-10-06T11:10:36.568203+0000","last_fullsized":"2023-10-06T11:10:36.568203+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:14:16.648125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.564448+0000","last_change":"2023-10-06T11:10:35.564448+0000","last_active":"2023-10-06T11:10:35.564448+0000","last_peered":"2023-10-06T11:10:35.564448+0000","last_clean":"2023-10-06T11:10:35.564448+0000","last_became_active":"2023-10-06T11:10:35.564175+0000","last_became_peered":"2023-10-06T11:10:35.564175+0000","last_unstale":"2023-10-06T11:10:35.564448+0000","last_undegraded":"2023-10-06T11:10:35.564448+0000","last_fullsized":"2023-10-06T11:10:35.564448+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:06:11.497822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.551757+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:20.836849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.561010+0000","last_change":"2023-10-06T11:10:35.561010+0000","last_active":"2023-10-06T11:10:35.561010+0000","last_peered":"2023-10-06T11:10:35.561010+0000","last_clean":"2023-10-06T11:10:35.561010+0000","last_became_active":"2023-10-06T11:10:35.560718+0000","last_became_peered":"2023-10-06T11:10:35.560718+0000","last_unstale":"2023-10-06T11:10:35.561010+0000","last_undegraded":"2023-10-06T11:10:35.561010+0000","last_fullsized":"2023-10-06T11:10:35.561010+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:35.057797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.564783+0000","last_change":"2023-10-06T11:10:36.564783+0000","last_active":"2023-10-06T11:10:36.564783+0000","last_peered":"2023-10-06T11:10:36.564783+0000","last_clean":"2023-10-06T11:10:36.564783+0000","last_became_active":"2023-10-06T11:10:36.564112+0000","last_became_peered":"2023-10-06T11:10:36.564112+0000","last_unstale":"2023-10-06T11:10:36.564783+0000","last_undegraded":"2023-10-06T11:10:36.564783+0000","last_fullsized":"2023-10-06T11:10:36.564783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:17:13.424540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.561374+0000","last_change":"2023-10-06T11:10:35.561374+0000","last_active":"2023-10-06T11:10:35.561374+0000","last_peered":"2023-10-06T11:10:35.561374+0000","last_clean":"2023-10-06T11:10:35.561374+0000","last_became_active":"2023-10-06T11:10:35.561034+0000","last_became_peered":"2023-10-06T11:10:35.561034+0000","last_unstale":"2023-10-06T11:10:35.561374+0000","last_undegraded":"2023-10-06T11:10:35.561374+0000","last_fullsized":"2023-10-06T11:10:35.561374+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:54:52.795843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.563943+0000","last_change":"2023-10-06T11:10:36.563943+0000","last_active":"2023-10-06T11:10:36.563943+0000","last_peered":"2023-10-06T11:10:36.563943+0000","last_clean":"2023-10-06T11:10:36.563943+0000","last_became_active":"2023-10-06T11:10:36.563685+0000","last_became_peered":"2023-10-06T11:10:36.563685+0000","last_unstale":"2023-10-06T11:10:36.563943+0000","last_undegraded":"2023-10-06T11:10:36.563943+0000","last_fullsized":"2023-10-06T11:10:36.563943+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:10:01.462268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"74'2","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.576935+0000","last_change":"2023-10-06T11:10:35.558480+0000","last_active":"2023-10-06T11:10:36.576935+0000","last_peered":"2023-10-06T11:10:36.576935+0000","last_clean":"2023-10-06T11:10:36.576935+0000","last_became_active":"2023-10-06T11:10:35.557916+0000","last_became_peered":"2023-10-06T11:10:35.557916+0000","last_unstale":"2023-10-06T11:10:36.576935+0000","last_undegraded":"2023-10-06T11:10:36.576935+0000","last_fullsized":"2023-10-06T11:10:36.576935+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:43.125026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.552197+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:21:08.092457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"74'1","reported_seq":10,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.555583+0000","last_change":"2023-10-06T11:10:35.563076+0000","last_active":"2023-10-06T11:10:36.555583+0000","last_peered":"2023-10-06T11:10:36.555583+0000","last_clean":"2023-10-06T11:10:36.555583+0000","last_became_active":"2023-10-06T11:10:35.561203+0000","last_became_peered":"2023-10-06T11:10:35.561203+0000","last_unstale":"2023-10-06T11:10:36.555583+0000","last_undegraded":"2023-10-06T11:10:36.555583+0000","last_fullsized":"2023-10-06T11:10:36.555583+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:56:40.528482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.551707+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:12:14.376199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.556455+0000","last_change":"2023-10-06T11:10:35.556455+0000","last_active":"2023-10-06T11:10:35.556455+0000","last_peered":"2023-10-06T11:10:35.556455+0000","last_clean":"2023-10-06T11:10:35.556455+0000","last_became_active":"2023-10-06T11:10:35.556167+0000","last_became_peered":"2023-10-06T11:10:35.556167+0000","last_unstale":"2023-10-06T11:10:35.556455+0000","last_undegraded":"2023-10-06T11:10:35.556455+0000","last_fullsized":"2023-10-06T11:10:35.556455+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:25.699995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.566820+0000","last_change":"2023-10-06T11:10:36.566820+0000","last_active":"2023-10-06T11:10:36.566820+0000","last_peered":"2023-10-06T11:10:36.566820+0000","last_clean":"2023-10-06T11:10:36.566820+0000","last_became_active":"2023-10-06T11:10:36.566558+0000","last_became_peered":"2023-10-06T11:10:36.566558+0000","last_unstale":"2023-10-06T11:10:36.566820+0000","last_undegraded":"2023-10-06T11:10:36.566820+0000","last_fullsized":"2023-10-06T11:10:36.566820+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:42.231134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.559140+0000","last_change":"2023-10-06T11:10:35.559140+0000","last_active":"2023-10-06T11:10:35.559140+0000","last_peered":"2023-10-06T11:10:35.559140+0000","last_clean":"2023-10-06T11:10:35.559140+0000","last_became_active":"2023-10-06T11:10:35.558843+0000","last_became_peered":"2023-10-06T11:10:35.558843+0000","last_unstale":"2023-10-06T11:10:35.559140+0000","last_undegraded":"2023-10-06T11:10:35.559140+0000","last_fullsized":"2023-10-06T11:10:35.559140+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:59:57.232416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.571387+0000","last_change":"2023-10-06T11:10:36.571387+0000","last_active":"2023-10-06T11:10:36.571387+0000","last_peered":"2023-10-06T11:10:36.571387+0000","last_clean":"2023-10-06T11:10:36.571387+0000","last_became_active":"2023-10-06T11:10:36.571001+0000","last_became_peered":"2023-10-06T11:10:36.571001+0000","last_unstale":"2023-10-06T11:10:36.571387+0000","last_undegraded":"2023-10-06T11:10:36.571387+0000","last_fullsized":"2023-10-06T11:10:36.571387+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:22:25.424782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.566163+0000","last_change":"2023-10-06T11:10:35.566163+0000","last_active":"2023-10-06T11:10:35.566163+0000","last_peered":"2023-10-06T11:10:35.566163+0000","last_clean":"2023-10-06T11:10:35.566163+0000","last_became_active":"2023-10-06T11:10:35.565869+0000","last_became_peered":"2023-10-06T11:10:35.565869+0000","last_unstale":"2023-10-06T11:10:35.566163+0000","last_undegraded":"2023-10-06T11:10:35.566163+0000","last_fullsized":"2023-10-06T11:10:35.566163+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:20:09.758618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.551700+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:20:30.493152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.561963+0000","last_change":"2023-10-06T11:10:35.561963+0000","last_active":"2023-10-06T11:10:35.561963+0000","last_peered":"2023-10-06T11:10:35.561963+0000","last_clean":"2023-10-06T11:10:35.561963+0000","last_became_active":"2023-10-06T11:10:35.561673+0000","last_became_peered":"2023-10-06T11:10:35.561673+0000","last_unstale":"2023-10-06T11:10:35.561963+0000","last_undegraded":"2023-10-06T11:10:35.561963+0000","last_fullsized":"2023-10-06T11:10:35.561963+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:16:25.755999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.548736+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:24:29.252009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.558239+0000","last_change":"2023-10-06T11:10:35.558239+0000","last_active":"2023-10-06T11:10:35.558239+0000","last_peered":"2023-10-06T11:10:35.558239+0000","last_clean":"2023-10-06T11:10:35.558239+0000","last_became_active":"2023-10-06T11:10:35.557904+0000","last_became_peered":"2023-10-06T11:10:35.557904+0000","last_unstale":"2023-10-06T11:10:35.558239+0000","last_undegraded":"2023-10-06T11:10:35.558239+0000","last_fullsized":"2023-10-06T11:10:35.558239+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:48:30.196153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.552701+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:20:30.493152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.562574+0000","last_change":"2023-10-06T11:10:35.562574+0000","last_active":"2023-10-06T11:10:35.562574+0000","last_peered":"2023-10-06T11:10:35.562574+0000","last_clean":"2023-10-06T11:10:35.562574+0000","last_became_active":"2023-10-06T11:10:35.562340+0000","last_became_peered":"2023-10-06T11:10:35.562340+0000","last_unstale":"2023-10-06T11:10:35.562574+0000","last_undegraded":"2023-10-06T11:10:35.562574+0000","last_fullsized":"2023-10-06T11:10:35.562574+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:04:45.233259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.558905+0000","last_change":"2023-10-06T11:10:36.558905+0000","last_active":"2023-10-06T11:10:36.558905+0000","last_peered":"2023-10-06T11:10:36.558905+0000","last_clean":"2023-10-06T11:10:36.558905+0000","last_became_active":"2023-10-06T11:10:36.558656+0000","last_became_peered":"2023-10-06T11:10:36.558656+0000","last_unstale":"2023-10-06T11:10:36.558905+0000","last_undegraded":"2023-10-06T11:10:36.558905+0000","last_fullsized":"2023-10-06T11:10:36.558905+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:05:23.675313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"74'6","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.577980+0000","last_change":"2023-10-06T11:10:35.565131+0000","last_active":"2023-10-06T11:10:36.577980+0000","last_peered":"2023-10-06T11:10:36.577980+0000","last_clean":"2023-10-06T11:10:36.577980+0000","last_became_active":"2023-10-06T11:10:35.564906+0000","last_became_peered":"2023-10-06T11:10:35.564906+0000","last_unstale":"2023-10-06T11:10:36.577980+0000","last_undegraded":"2023-10-06T11:10:36.577980+0000","last_fullsized":"2023-10-06T11:10:36.577980+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:17:20.645306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.548074+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:56:23.575265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.566952+0000","last_change":"2023-10-06T11:10:35.566952+0000","last_active":"2023-10-06T11:10:35.566952+0000","last_peered":"2023-10-06T11:10:35.566952+0000","last_clean":"2023-10-06T11:10:35.566952+0000","last_became_active":"2023-10-06T11:10:35.566661+0000","last_became_peered":"2023-10-06T11:10:35.566661+0000","last_unstale":"2023-10-06T11:10:35.566952+0000","last_undegraded":"2023-10-06T11:10:35.566952+0000","last_fullsized":"2023-10-06T11:10:35.566952+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:05:22.668525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.566928+0000","last_change":"2023-10-06T11:10:36.566928+0000","last_active":"2023-10-06T11:10:36.566928+0000","last_peered":"2023-10-06T11:10:36.566928+0000","last_clean":"2023-10-06T11:10:36.566928+0000","last_became_active":"2023-10-06T11:10:36.566624+0000","last_became_peered":"2023-10-06T11:10:36.566624+0000","last_unstale":"2023-10-06T11:10:36.566928+0000","last_undegraded":"2023-10-06T11:10:36.566928+0000","last_fullsized":"2023-10-06T11:10:36.566928+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:26.706783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.563787+0000","last_change":"2023-10-06T11:10:35.563787+0000","last_active":"2023-10-06T11:10:35.563787+0000","last_peered":"2023-10-06T11:10:35.563787+0000","last_clean":"2023-10-06T11:10:35.563787+0000","last_became_active":"2023-10-06T11:10:35.563566+0000","last_became_peered":"2023-10-06T11:10:35.563566+0000","last_unstale":"2023-10-06T11:10:35.563787+0000","last_undegraded":"2023-10-06T11:10:35.563787+0000","last_fullsized":"2023-10-06T11:10:35.563787+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:06.332091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.574907+0000","last_change":"2023-10-06T11:10:36.574907+0000","last_active":"2023-10-06T11:10:36.574907+0000","last_peered":"2023-10-06T11:10:36.574907+0000","last_clean":"2023-10-06T11:10:36.574907+0000","last_became_active":"2023-10-06T11:10:36.571648+0000","last_became_peered":"2023-10-06T11:10:36.571648+0000","last_unstale":"2023-10-06T11:10:36.574907+0000","last_undegraded":"2023-10-06T11:10:36.574907+0000","last_fullsized":"2023-10-06T11:10:36.574907+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:05:23.675313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.564482+0000","last_change":"2023-10-06T11:10:35.564482+0000","last_active":"2023-10-06T11:10:35.564482+0000","last_peered":"2023-10-06T11:10:35.564482+0000","last_clean":"2023-10-06T11:10:35.564482+0000","last_became_active":"2023-10-06T11:10:35.564219+0000","last_became_peered":"2023-10-06T11:10:35.564219+0000","last_unstale":"2023-10-06T11:10:35.564482+0000","last_undegraded":"2023-10-06T11:10:35.564482+0000","last_fullsized":"2023-10-06T11:10:35.564482+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:47.836534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.575443+0000","last_change":"2023-10-06T11:10:36.575443+0000","last_active":"2023-10-06T11:10:36.575443+0000","last_peered":"2023-10-06T11:10:36.575443+0000","last_clean":"2023-10-06T11:10:36.575443+0000","last_became_active":"2023-10-06T11:10:36.575101+0000","last_became_peered":"2023-10-06T11:10:36.575101+0000","last_unstale":"2023-10-06T11:10:36.575443+0000","last_undegraded":"2023-10-06T11:10:36.575443+0000","last_fullsized":"2023-10-06T11:10:36.575443+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:48:31.202941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.556135+0000","last_change":"2023-10-06T11:10:35.556135+0000","last_active":"2023-10-06T11:10:35.556135+0000","last_peered":"2023-10-06T11:10:35.556135+0000","last_clean":"2023-10-06T11:10:35.556135+0000","last_became_active":"2023-10-06T11:10:35.555884+0000","last_became_peered":"2023-10-06T11:10:35.555884+0000","last_unstale":"2023-10-06T11:10:35.556135+0000","last_undegraded":"2023-10-06T11:10:35.556135+0000","last_fullsized":"2023-10-06T11:10:35.556135+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:24:06.535152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.566853+0000","last_change":"2023-10-06T11:10:36.566853+0000","last_active":"2023-10-06T11:10:36.566853+0000","last_peered":"2023-10-06T11:10:36.566853+0000","last_clean":"2023-10-06T11:10:36.566853+0000","last_became_active":"2023-10-06T11:10:36.566589+0000","last_became_peered":"2023-10-06T11:10:36.566589+0000","last_unstale":"2023-10-06T11:10:36.566853+0000","last_undegraded":"2023-10-06T11:10:36.566853+0000","last_fullsized":"2023-10-06T11:10:36.566853+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:11:53.044428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.563007+0000","last_change":"2023-10-06T11:10:35.563007+0000","last_active":"2023-10-06T11:10:35.563007+0000","last_peered":"2023-10-06T11:10:35.563007+0000","last_clean":"2023-10-06T11:10:35.563007+0000","last_became_active":"2023-10-06T11:10:35.562469+0000","last_became_peered":"2023-10-06T11:10:35.562469+0000","last_unstale":"2023-10-06T11:10:35.563007+0000","last_undegraded":"2023-10-06T11:10:35.563007+0000","last_fullsized":"2023-10-06T11:10:35.563007+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:00.332870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.575103+0000","last_change":"2023-10-06T11:10:36.575103+0000","last_active":"2023-10-06T11:10:36.575103+0000","last_peered":"2023-10-06T11:10:36.575103+0000","last_clean":"2023-10-06T11:10:36.575103+0000","last_became_active":"2023-10-06T11:10:36.571536+0000","last_became_peered":"2023-10-06T11:10:36.571536+0000","last_unstale":"2023-10-06T11:10:36.575103+0000","last_undegraded":"2023-10-06T11:10:36.575103+0000","last_fullsized":"2023-10-06T11:10:36.575103+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:14:16.648125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.560230+0000","last_change":"2023-10-06T11:10:35.560230+0000","last_active":"2023-10-06T11:10:35.560230+0000","last_peered":"2023-10-06T11:10:35.560230+0000","last_clean":"2023-10-06T11:10:35.560230+0000","last_became_active":"2023-10-06T11:10:35.559955+0000","last_became_peered":"2023-10-06T11:10:35.559955+0000","last_unstale":"2023-10-06T11:10:35.560230+0000","last_undegraded":"2023-10-06T11:10:35.560230+0000","last_fullsized":"2023-10-06T11:10:35.560230+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:58.839836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.564609+0000","last_change":"2023-10-06T11:10:36.564609+0000","last_active":"2023-10-06T11:10:36.564609+0000","last_peered":"2023-10-06T11:10:36.564609+0000","last_clean":"2023-10-06T11:10:36.564609+0000","last_became_active":"2023-10-06T11:10:36.563769+0000","last_became_peered":"2023-10-06T11:10:36.563769+0000","last_unstale":"2023-10-06T11:10:36.564609+0000","last_undegraded":"2023-10-06T11:10:36.564609+0000","last_fullsized":"2023-10-06T11:10:36.564609+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:49:54.089077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.566590+0000","last_change":"2023-10-06T11:10:35.566590+0000","last_active":"2023-10-06T11:10:35.566590+0000","last_peered":"2023-10-06T11:10:35.566590+0000","last_clean":"2023-10-06T11:10:35.566590+0000","last_became_active":"2023-10-06T11:10:35.566333+0000","last_became_peered":"2023-10-06T11:10:35.566333+0000","last_unstale":"2023-10-06T11:10:35.566590+0000","last_undegraded":"2023-10-06T11:10:35.566590+0000","last_fullsized":"2023-10-06T11:10:35.566590+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:53:16.617219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.552115+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:26:32.606626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.561355+0000","last_change":"2023-10-06T11:10:35.561355+0000","last_active":"2023-10-06T11:10:35.561355+0000","last_peered":"2023-10-06T11:10:35.561355+0000","last_clean":"2023-10-06T11:10:35.561355+0000","last_became_active":"2023-10-06T11:10:35.560750+0000","last_became_peered":"2023-10-06T11:10:35.560750+0000","last_unstale":"2023-10-06T11:10:35.561355+0000","last_undegraded":"2023-10-06T11:10:35.561355+0000","last_fullsized":"2023-10-06T11:10:35.561355+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:58.839836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.575237+0000","last_change":"2023-10-06T11:10:36.575237+0000","last_active":"2023-10-06T11:10:36.575237+0000","last_peered":"2023-10-06T11:10:36.575237+0000","last_clean":"2023-10-06T11:10:36.575237+0000","last_became_active":"2023-10-06T11:10:36.574982+0000","last_became_peered":"2023-10-06T11:10:36.574982+0000","last_unstale":"2023-10-06T11:10:36.575237+0000","last_undegraded":"2023-10-06T11:10:36.575237+0000","last_fullsized":"2023-10-06T11:10:36.575237+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:01.339658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.560484+0000","last_change":"2023-10-06T11:10:35.558225+0000","last_active":"2023-10-06T11:10:35.560484+0000","last_peered":"2023-10-06T11:10:35.560484+0000","last_clean":"2023-10-06T11:10:35.560484+0000","last_became_active":"2023-10-06T11:10:35.557900+0000","last_became_peered":"2023-10-06T11:10:35.557900+0000","last_unstale":"2023-10-06T11:10:35.560484+0000","last_undegraded":"2023-10-06T11:10:35.560484+0000","last_fullsized":"2023-10-06T11:10:35.560484+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:35:59.639899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.563208+0000","last_change":"2023-10-06T11:10:36.563208+0000","last_active":"2023-10-06T11:10:36.563208+0000","last_peered":"2023-10-06T11:10:36.563208+0000","last_clean":"2023-10-06T11:10:36.563208+0000","last_became_active":"2023-10-06T11:10:36.562940+0000","last_became_peered":"2023-10-06T11:10:36.562940+0000","last_unstale":"2023-10-06T11:10:36.563208+0000","last_undegraded":"2023-10-06T11:10:36.563208+0000","last_fullsized":"2023-10-06T11:10:36.563208+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:56:41.535270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.561390+0000","last_change":"2023-10-06T11:10:35.561390+0000","last_active":"2023-10-06T11:10:35.561390+0000","last_peered":"2023-10-06T11:10:35.561390+0000","last_clean":"2023-10-06T11:10:35.561390+0000","last_became_active":"2023-10-06T11:10:35.561115+0000","last_became_peered":"2023-10-06T11:10:35.561115+0000","last_unstale":"2023-10-06T11:10:35.561390+0000","last_undegraded":"2023-10-06T11:10:35.561390+0000","last_fullsized":"2023-10-06T11:10:35.561390+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:01.065689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.563759+0000","last_change":"2023-10-06T11:10:36.563759+0000","last_active":"2023-10-06T11:10:36.563759+0000","last_peered":"2023-10-06T11:10:36.563759+0000","last_clean":"2023-10-06T11:10:36.563759+0000","last_became_active":"2023-10-06T11:10:36.563501+0000","last_became_peered":"2023-10-06T11:10:36.563501+0000","last_unstale":"2023-10-06T11:10:36.563759+0000","last_undegraded":"2023-10-06T11:10:36.563759+0000","last_fullsized":"2023-10-06T11:10:36.563759+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:08.343433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.566866+0000","last_change":"2023-10-06T11:10:35.564323+0000","last_active":"2023-10-06T11:10:35.566866+0000","last_peered":"2023-10-06T11:10:35.566866+0000","last_clean":"2023-10-06T11:10:35.566866+0000","last_became_active":"2023-10-06T11:10:35.564037+0000","last_became_peered":"2023-10-06T11:10:35.564037+0000","last_unstale":"2023-10-06T11:10:35.566866+0000","last_undegraded":"2023-10-06T11:10:35.566866+0000","last_fullsized":"2023-10-06T11:10:35.566866+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:28:03.257860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.567132+0000","last_change":"2023-10-06T11:10:36.567132+0000","last_active":"2023-10-06T11:10:36.567132+0000","last_peered":"2023-10-06T11:10:36.567132+0000","last_clean":"2023-10-06T11:10:36.567132+0000","last_became_active":"2023-10-06T11:10:36.566866+0000","last_became_peered":"2023-10-06T11:10:36.566866+0000","last_unstale":"2023-10-06T11:10:36.567132+0000","last_undegraded":"2023-10-06T11:10:36.567132+0000","last_fullsized":"2023-10-06T11:10:36.567132+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:48:31.202941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.562021+0000","last_change":"2023-10-06T11:10:35.552191+0000","last_active":"2023-10-06T11:10:35.562021+0000","last_peered":"2023-10-06T11:10:35.562021+0000","last_clean":"2023-10-06T11:10:35.562021+0000","last_became_active":"2023-10-06T11:10:35.551916+0000","last_became_peered":"2023-10-06T11:10:35.551916+0000","last_unstale":"2023-10-06T11:10:35.562021+0000","last_undegraded":"2023-10-06T11:10:35.562021+0000","last_fullsized":"2023-10-06T11:10:35.562021+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:07:42.227450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.552863+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:26:32.606626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.566516+0000","last_change":"2023-10-06T11:10:35.566516+0000","last_active":"2023-10-06T11:10:35.566516+0000","last_peered":"2023-10-06T11:10:35.566516+0000","last_clean":"2023-10-06T11:10:35.566516+0000","last_became_active":"2023-10-06T11:10:35.566258+0000","last_became_peered":"2023-10-06T11:10:35.566258+0000","last_unstale":"2023-10-06T11:10:35.566516+0000","last_undegraded":"2023-10-06T11:10:35.566516+0000","last_fullsized":"2023-10-06T11:10:35.566516+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:16:46.568672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":63,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.560581+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:10:35.560581+0000","last_peered":"2023-10-06T11:10:35.560581+0000","last_clean":"2023-10-06T11:10:35.560581+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:10:35.560581+0000","last_undegraded":"2023-10-06T11:10:35.560581+0000","last_fullsized":"2023-10-06T11:10:35.560581+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.553024+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:12:36.084850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"74'2","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.567133+0000","last_change":"2023-10-06T11:10:35.565002+0000","last_active":"2023-10-06T11:10:36.567133+0000","last_peered":"2023-10-06T11:10:36.567133+0000","last_clean":"2023-10-06T11:10:36.567133+0000","last_became_active":"2023-10-06T11:10:35.564718+0000","last_became_peered":"2023-10-06T11:10:35.564718+0000","last_unstale":"2023-10-06T11:10:36.567133+0000","last_undegraded":"2023-10-06T11:10:36.567133+0000","last_fullsized":"2023-10-06T11:10:36.567133+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:12:22.762358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":59,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-10-06T11:10:34.543614+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:10:34.543614+0000","last_peered":"2023-10-06T11:10:34.543614+0000","last_clean":"2023-10-06T11:10:34.543614+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:10:34.543614+0000","last_undegraded":"2023-10-06T11:10:34.543614+0000","last_fullsized":"2023-10-06T11:10:34.543614+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.551941+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:24:04.262059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.561062+0000","last_change":"2023-10-06T11:10:35.561062+0000","last_active":"2023-10-06T11:10:35.561062+0000","last_peered":"2023-10-06T11:10:35.561062+0000","last_clean":"2023-10-06T11:10:35.561062+0000","last_became_active":"2023-10-06T11:10:35.560873+0000","last_became_peered":"2023-10-06T11:10:35.560873+0000","last_unstale":"2023-10-06T11:10:35.561062+0000","last_undegraded":"2023-10-06T11:10:35.561062+0000","last_fullsized":"2023-10-06T11:10:35.561062+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:54:52.795843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":57,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.546220+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:10:35.546220+0000","last_peered":"2023-10-06T11:10:35.546220+0000","last_clean":"2023-10-06T11:10:35.546220+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:10:35.546220+0000","last_undegraded":"2023-10-06T11:10:35.546220+0000","last_fullsized":"2023-10-06T11:10:35.546220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":203,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-10-06T11:10:34.546553+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:10:34.546553+0000","last_peered":"2023-10-06T11:10:34.546553+0000","last_clean":"2023-10-06T11:10:34.546553+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:10:34.546553+0000","last_undegraded":"2023-10-06T11:10:34.546553+0000","last_fullsized":"2023-10-06T11:10:34.546553+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.575734+0000","last_change":"2023-10-06T11:10:36.575734+0000","last_active":"2023-10-06T11:10:36.575734+0000","last_peered":"2023-10-06T11:10:36.575734+0000","last_clean":"2023-10-06T11:10:36.575734+0000","last_became_active":"2023-10-06T11:10:36.575475+0000","last_became_peered":"2023-10-06T11:10:36.575475+0000","last_unstale":"2023-10-06T11:10:36.575734+0000","last_undegraded":"2023-10-06T11:10:36.575734+0000","last_fullsized":"2023-10-06T11:10:36.575734+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:08.343433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.560631+0000","last_change":"2023-10-06T11:10:35.560631+0000","last_active":"2023-10-06T11:10:35.560631+0000","last_peered":"2023-10-06T11:10:35.560631+0000","last_clean":"2023-10-06T11:10:35.560631+0000","last_became_active":"2023-10-06T11:10:35.560377+0000","last_became_peered":"2023-10-06T11:10:35.560377+0000","last_unstale":"2023-10-06T11:10:35.560631+0000","last_undegraded":"2023-10-06T11:10:35.560631+0000","last_fullsized":"2023-10-06T11:10:35.560631+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:16:25.755999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":53,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-10-06T11:10:34.547219+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:10:34.547219+0000","last_peered":"2023-10-06T11:10:34.547219+0000","last_clean":"2023-10-06T11:10:34.547219+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:10:34.547219+0000","last_undegraded":"2023-10-06T11:10:34.547219+0000","last_fullsized":"2023-10-06T11:10:34.547219+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.552732+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:20:30.493152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.560592+0000","last_change":"2023-10-06T11:10:35.560592+0000","last_active":"2023-10-06T11:10:35.560592+0000","last_peered":"2023-10-06T11:10:35.560592+0000","last_clean":"2023-10-06T11:10:35.560592+0000","last_became_active":"2023-10-06T11:10:35.560329+0000","last_became_peered":"2023-10-06T11:10:35.560329+0000","last_unstale":"2023-10-06T11:10:35.560592+0000","last_undegraded":"2023-10-06T11:10:35.560592+0000","last_fullsized":"2023-10-06T11:10:35.560592+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:58.839836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":53,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-10-06T11:10:34.546588+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:10:34.546588+0000","last_peered":"2023-10-06T11:10:34.546588+0000","last_clean":"2023-10-06T11:10:34.546588+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:10:34.546588+0000","last_undegraded":"2023-10-06T11:10:34.546588+0000","last_fullsized":"2023-10-06T11:10:34.546588+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.551778+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:06:36.489499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.562699+0000","last_change":"2023-10-06T11:10:35.562699+0000","last_active":"2023-10-06T11:10:35.562699+0000","last_peered":"2023-10-06T11:10:35.562699+0000","last_clean":"2023-10-06T11:10:35.562699+0000","last_became_active":"2023-10-06T11:10:35.562460+0000","last_became_peered":"2023-10-06T11:10:35.562460+0000","last_unstale":"2023-10-06T11:10:35.562699+0000","last_undegraded":"2023-10-06T11:10:35.562699+0000","last_fullsized":"2023-10-06T11:10:35.562699+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:35.057797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":64,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-10-06T11:10:34.542867+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:10:34.542867+0000","last_peered":"2023-10-06T11:10:34.542867+0000","last_clean":"2023-10-06T11:10:34.542867+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:10:34.542867+0000","last_undegraded":"2023-10-06T11:10:34.542867+0000","last_fullsized":"2023-10-06T11:10:34.542867+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.552588+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:38:35.257233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.563502+0000","last_change":"2023-10-06T11:10:35.558406+0000","last_active":"2023-10-06T11:10:35.563502+0000","last_peered":"2023-10-06T11:10:35.563502+0000","last_clean":"2023-10-06T11:10:35.563502+0000","last_became_active":"2023-10-06T11:10:35.558197+0000","last_became_peered":"2023-10-06T11:10:35.558197+0000","last_unstale":"2023-10-06T11:10:35.563502+0000","last_undegraded":"2023-10-06T11:10:35.563502+0000","last_fullsized":"2023-10-06T11:10:35.563502+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:54:06.008551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":58,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.550516+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:10:35.550516+0000","last_peered":"2023-10-06T11:10:35.550516+0000","last_clean":"2023-10-06T11:10:35.550516+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:10:35.550516+0000","last_undegraded":"2023-10-06T11:10:35.550516+0000","last_fullsized":"2023-10-06T11:10:35.550516+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.553478+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:14:01.696915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.565730+0000","last_change":"2023-10-06T11:10:35.565730+0000","last_active":"2023-10-06T11:10:35.565730+0000","last_peered":"2023-10-06T11:10:35.565730+0000","last_clean":"2023-10-06T11:10:35.565730+0000","last_became_active":"2023-10-06T11:10:35.565461+0000","last_became_peered":"2023-10-06T11:10:35.565461+0000","last_unstale":"2023-10-06T11:10:35.565730+0000","last_undegraded":"2023-10-06T11:10:35.565730+0000","last_fullsized":"2023-10-06T11:10:35.565730+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:16:47.518450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":58,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.550793+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:10:35.550793+0000","last_peered":"2023-10-06T11:10:35.550793+0000","last_clean":"2023-10-06T11:10:35.550793+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:10:35.550793+0000","last_undegraded":"2023-10-06T11:10:35.550793+0000","last_fullsized":"2023-10-06T11:10:35.550793+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":1536,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574911,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298736,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073104,"statfs":{"total":96636764160,"available":96330858496,"internally_reserved":0,"allocated":1482752,"data_stored":988344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":0.872,"15min":0.61399999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":15.506,"5min":23.908999999999999,"15min":23.908999999999999},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.70599999999999996,"15min":0.59099999999999997},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":9.3230000000000004,"5min":9.3230000000000004,"15min":9.3230000000000004},"last":0.40100000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.63400000000000001,"15min":0.56899999999999995},"min":{"1min":0.29999999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71399999999999997,"5min":9.2360000000000007,"15min":9.2360000000000007},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.53200000000000003,"15min":0.51400000000000001},"min":{"1min":0.308,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.60399999999999998,"5min":4.327,"15min":4.327},"last":0.57499999999999996}]},{"osd":2,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.5,"15min":0.50800000000000001},"min":{"1min":0.33200000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.63500000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.59599999999999997,"15min":0.55800000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.74299999999999999,"5min":4.7309999999999999,"15min":4.7309999999999999},"last":0.47699999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.52000000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.7609999999999999,"5min":4.3540000000000001,"15min":4.3540000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.67500000000000004,"15min":0.60099999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.125,"5min":9.3879999999999999,"15min":9.3879999999999999},"last":0.61399999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.50800000000000001,"15min":0.47499999999999998},"min":{"1min":0.25,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.66100000000000003,"5min":4.5709999999999997,"15min":4.5709999999999997},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.54600000000000004,"15min":0.53100000000000003},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.71299999999999997,"5min":4.3129999999999997,"15min":4.3129999999999997},"last":0.50700000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.63300000000000001,"15min":0.57799999999999996},"min":{"1min":0.29399999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.84699999999999998,"5min":9.3499999999999996,"15min":9.3499999999999996},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.57499999999999996,"15min":0.56399999999999995},"min":{"1min":0.36099999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.77200000000000002,"5min":4.444,"15min":4.444},"last":0.64500000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.66400000000000003,"15min":0.61899999999999999},"min":{"1min":0.39200000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.81399999999999995,"5min":9.4969999999999999,"15min":9.4969999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.65600000000000003,"15min":0.61799999999999999},"min":{"1min":0.40300000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88200000000000001,"5min":7.2039999999999997,"15min":7.2039999999999997},"last":0.59099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574913,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310464,"kb_used_data":888,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061376,"statfs":{"total":96636764160,"available":96318849024,"internally_reserved":0,"allocated":909312,"data_stored":405275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:42 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48199999999999998,"15min":0.497},"min":{"1min":0.23799999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.64300000000000002,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51500000000000001,"15min":0.53100000000000003},"min":{"1min":0.35899999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.63,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.39800000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:09:42 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.47899999999999998,"15min":0.498},"min":{"1min":0.26400000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.629,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.47499999999999998,"15min":0.496},"min":{"1min":0.379,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.55400000000000005,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.31900000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:09:42 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.53300000000000003,"15min":0.499},"min":{"1min":0.31900000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.65800000000000003,"5min":7.0659999999999998,"15min":7.0659999999999998},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.55700000000000005,"15min":0.52700000000000002},"min":{"1min":0.29899999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.75800000000000001,"5min":7.0819999999999999,"15min":7.0819999999999999},"last":0.44400000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:09:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.504,"15min":0.496},"min":{"1min":0.436,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.65500000000000003,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53100000000000003,"15min":0.53700000000000003},"min":{"1min":0.40000000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.72399999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.50800000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:09:42 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.47599999999999998,"15min":0.503},"min":{"1min":0.30399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.495},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.52400000000000002,"15min":0.56200000000000006},"min":{"1min":0.33100000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69399999999999995,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.42999999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:09:42 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51300000000000001,"15min":0.53500000000000003},"min":{"1min":0.313,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.69299999999999995,"5min":0.75,"15min":0.75},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54800000000000004,"15min":0.58199999999999996},"min":{"1min":0.34499999999999997,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78800000000000003,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.53700000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:09:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55600000000000005,"15min":0.57499999999999996},"min":{"1min":0.377,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71699999999999997,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58299999999999996,"15min":0.60499999999999998},"min":{"1min":0.36699999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.754,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.58399999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574912,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311044,"kb_used_data":1468,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060796,"statfs":{"total":96636764160,"available":96318255104,"internally_reserved":0,"allocated":1503232,"data_stored":995572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.33200000000000002,"15min":0.34200000000000003},"min":{"1min":0.24199999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.215,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.40999999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.34399999999999997,"15min":0.33600000000000002},"min":{"1min":0.23599999999999999,"5min":0.22,"15min":0.22},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.39600000000000002,"15min":0.38900000000000001},"min":{"1min":0.26500000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.38200000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.41399999999999998,"15min":0.41099999999999998},"min":{"1min":0.28299999999999997,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.68999999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.38100000000000001,"15min":0.36899999999999999},"min":{"1min":0.29799999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.33900000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.53000000000000003,"15min":0.50800000000000001},"min":{"1min":0.34399999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55800000000000005,"15min":0.54000000000000004},"min":{"1min":0.45300000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.68999999999999995}]},{"osd":5,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55900000000000005,"15min":0.54900000000000004},"min":{"1min":0.38800000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.56299999999999994,"15min":0.54100000000000004},"min":{"1min":0.40000000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.626}]},{"osd":6,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57199999999999995,"15min":0.56200000000000006},"min":{"1min":0.36899999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.59199999999999997,"15min":0.57399999999999995},"min":{"1min":0.376,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.73199999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.59999999999999998,"15min":0.58999999999999997},"min":{"1min":0.48699999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84299999999999997,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.42899999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.746}]}]},{"osd":0,"up_from":13,"seq":55834574911,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302248,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069592,"statfs":{"total":96636764160,"available":96327262208,"internally_reserved":0,"allocated":884736,"data_stored":396623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":1.9379999999999999,"5min":0.64700000000000002,"15min":0.44},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":36.097999999999999,"5min":36.097999999999999,"15min":36.097999999999999},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.35999999999999999,"15min":0.34699999999999998},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.39300000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":1.9810000000000001,"5min":0.69099999999999995,"15min":0.48299999999999998},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":36.07,"5min":36.07,"15min":36.07},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.40000000000000002,"15min":0.379},"min":{"1min":0.23200000000000001,"5min":0.219,"15min":0.219},"max":{"1min":5.125,"5min":5.125,"15min":5.125},"last":0.35199999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.44,"15min":0.39600000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":8.4130000000000003,"5min":8.4130000000000003,"15min":8.4130000000000003},"last":0.42499999999999999},{"interface":"front","average":{"1min":2.0030000000000001,"5min":0.74399999999999999,"15min":0.54200000000000004},"min":{"1min":0.30199999999999999,"5min":0.252,"15min":0.252},"max":{"1min":35.959000000000003,"5min":35.959000000000003,"15min":35.959000000000003},"last":0.371}]},{"osd":4,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.56799999999999995,"15min":0.56299999999999994},"min":{"1min":0.48199999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.61399999999999999},{"interface":"front","average":{"1min":2.2120000000000002,"5min":0.92700000000000005,"15min":0.72099999999999997},"min":{"1min":0.48999999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":36.005000000000003,"5min":36.005000000000003,"15min":36.005000000000003},"last":0.58899999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.55700000000000005,"15min":0.55400000000000005},"min":{"1min":0.433,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56299999999999994,"15min":0.54900000000000004},"min":{"1min":0.45700000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.64800000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":2.194,"5min":0.91900000000000004,"15min":0.71699999999999997},"min":{"1min":0.47199999999999998,"5min":0.375,"15min":0.375},"max":{"1min":36.037999999999997,"5min":36.037999999999997,"15min":36.037999999999997},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.63900000000000001,"15min":0.61699999999999999},"min":{"1min":0.434,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":4.8810000000000002,"5min":4.8810000000000002,"15min":4.8810000000000002},"last":0.57699999999999996}]},{"osd":7,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60599999999999998,"15min":0.60799999999999998},"min":{"1min":0.41499999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":2.3530000000000002,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.44500000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.56299999999999994}]}]},{"osd":2,"up_from":13,"seq":55834574912,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314536,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94057304,"statfs":{"total":96636764160,"available":96314679296,"internally_reserved":0,"allocated":884736,"data_stored":396623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.307,"15min":0.308},"min":{"1min":0.218,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.39700000000000002,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.375,"15min":0.38300000000000001},"min":{"1min":0.27700000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53300000000000003,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.32200000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36599999999999999,"15min":0.374},"min":{"1min":0.252,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56299999999999994,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.35399999999999998,"15min":0.34799999999999998},"min":{"1min":0.249,"5min":0.217,"15min":0.217},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.33400000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.36699999999999999,"15min":0.372},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.628,"5min":0.629,"15min":0.629},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.35899999999999999,"15min":0.36499999999999999},"min":{"1min":0.26200000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.47699999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.29499999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.36599999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.77500000000000002,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.502},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.42599999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72299999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.64400000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.35999999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.67600000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.623},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55700000000000005,"15min":0.55300000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72999999999999998,"5min":0.87,"15min":0.87},"last":0.49099999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76000000000000001,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57599999999999996,"15min":0.57799999999999996},"min":{"1min":0.39400000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.72199999999999998,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.53600000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56799999999999995,"15min":0.55300000000000005},"min":{"1min":0.40200000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.76600000000000001,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57299999999999995,"15min":0.57099999999999995},"min":{"1min":0.40200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73499999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.42599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574912,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298152,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073688,"statfs":{"total":96636764160,"available":96331456512,"internally_reserved":0,"allocated":884736,"data_stored":396623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.313,"15min":0.32700000000000001},"min":{"1min":0.218,"5min":0.188,"15min":0.188},"max":{"1min":0.47099999999999997,"5min":1.095,"15min":1.095},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.38,"15min":0.40200000000000002},"min":{"1min":0.30399999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.52400000000000002,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.32500000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.313,"15min":0.309},"min":{"1min":0.23200000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.46899999999999997,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.35999999999999999,"15min":0.37},"min":{"1min":0.25900000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.48599999999999999,"5min":1.196,"15min":1.196},"last":0.33800000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.374,"15min":0.39200000000000002},"min":{"1min":0.26500000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.54000000000000004,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.40799999999999997,"15min":0.42199999999999999},"min":{"1min":0.32700000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.55900000000000005,"5min":1.224,"15min":1.224},"last":0.39500000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.55400000000000005,"15min":0.57399999999999995},"min":{"1min":0.41699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69399999999999995,"5min":1.694,"15min":1.694},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.54600000000000004,"15min":0.54800000000000004},"min":{"1min":0.46400000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.496}]},{"osd":5,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.54600000000000004,"15min":0.52800000000000002},"min":{"1min":0.436,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79400000000000004,"5min":0.878,"15min":0.878},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55900000000000005,"15min":0.56699999999999995},"min":{"1min":0.49399999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72699999999999998,"5min":1.165,"15min":1.165},"last":0.46400000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58699999999999997,"15min":0.59499999999999997},"min":{"1min":0.46200000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.81299999999999994,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.59599999999999997,"15min":0.60599999999999998},"min":{"1min":0.47099999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78000000000000003,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.51300000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58199999999999996,"15min":0.59599999999999997},"min":{"1min":0.44800000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.74199999999999999,"5min":1.657,"15min":1.657},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.47899999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83399999999999996,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.52300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574911,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298188,"kb_used_data":900,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073652,"statfs":{"total":96636764160,"available":96331419648,"internally_reserved":0,"allocated":921600,"data_stored":406732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.51800000000000002,"15min":0.59299999999999997},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.76600000000000001,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":0.443},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.49199999999999999,"15min":0.502},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.47099999999999997}]},{"osd":1,"last update":"Fri Oct 6 11:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.54400000000000004,"15min":0.61799999999999999},"min":{"1min":0.35999999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70899999999999996,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.499},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55300000000000005,"15min":0.621},"min":{"1min":0.33400000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.72399999999999998,"5min":2.7610000000000001,"15min":2.7610000000000001},"last":0.57399999999999995}]},{"osd":2,"last update":"Fri Oct 6 11:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.57699999999999996},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.78200000000000003,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58599999999999997,"15min":0.61799999999999999},"min":{"1min":0.45400000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.77400000000000002,"5min":1.718,"15min":1.718},"last":0.60499999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.57799999999999996,"15min":0.64000000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.753,"5min":2.677,"15min":2.677},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.51600000000000001,"15min":0.52600000000000002},"min":{"1min":0.36799999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.747,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.68200000000000005}]},{"osd":5,"last update":"Fri Oct 6 11:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.47099999999999997,"15min":0.497},"min":{"1min":0.33900000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.77600000000000002,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.52500000000000002,"15min":0.54700000000000004},"min":{"1min":0.35099999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.752}]},{"osd":6,"last update":"Fri Oct 6 11:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.51000000000000001,"15min":0.53400000000000003},"min":{"1min":0.34599999999999997,"5min":0.252,"15min":0.252},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54900000000000004,"15min":0.59099999999999997},"min":{"1min":0.40699999999999997,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.82099999999999995,"5min":1.165,"15min":1.165},"last":0.73199999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.55200000000000005,"15min":0.56200000000000006},"min":{"1min":0.378,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.59099999999999997,"15min":0.61599999999999999},"min":{"1min":0.437,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80800000000000005,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.70799999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574913,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310432,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061408,"statfs":{"total":96636764160,"available":96318881792,"internally_reserved":0,"allocated":876544,"data_stored":391360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.61799999999999999,"15min":0.70799999999999996},"min":{"1min":0.28399999999999997,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.69499999999999995,"5min":5.0490000000000004,"15min":5.0490000000000004},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.57599999999999996,"15min":0.67600000000000005},"min":{"1min":0.28100000000000003,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.64700000000000002,"5min":5.1449999999999996,"15min":5.1449999999999996},"last":0.47099999999999997}]},{"osd":1,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48499999999999999,"15min":0.49099999999999999},"min":{"1min":0.27500000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.75600000000000001,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.379},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52100000000000002,"15min":0.52900000000000003},"min":{"1min":0.30299999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.70999999999999996,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.55500000000000005}]},{"osd":2,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57899999999999996,"15min":0.56699999999999995},"min":{"1min":0.41299999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.74099999999999999,"5min":4.234,"15min":4.234},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56699999999999995,"15min":0.57699999999999996},"min":{"1min":0.40000000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72999999999999998,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.504}]},{"osd":3,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.61499999999999999,"15min":0.72699999999999998},"min":{"1min":0.32600000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.72099999999999997,"5min":5.2169999999999996,"15min":5.2169999999999996},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54900000000000004,"15min":0.55500000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.70199999999999996,"5min":1.008,"15min":1.008},"last":0.439}]},{"osd":4,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52200000000000002,"15min":0.53600000000000003},"min":{"1min":0.32700000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.745,"5min":1.917,"15min":1.917},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53700000000000003,"15min":0.55500000000000005},"min":{"1min":0.34399999999999997,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.68600000000000005,"5min":0.87,"15min":0.87},"last":0.34000000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56999999999999995,"15min":0.58099999999999996},"min":{"1min":0.34100000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.68700000000000006,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.61399999999999999,"15min":0.629},"min":{"1min":0.42199999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.77200000000000002,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":0.42399999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58399999999999996,"15min":0.60699999999999998},"min":{"1min":0.39600000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.70199999999999996,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61499999999999999,"15min":0.628},"min":{"1min":0.38700000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.72999999999999998,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.54000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:10:41.368 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3f is not active+clean 2023-10-06T11:10:41.368 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:10:35.538922+0000', 'last_change': '2023-10-06T11:10:35.552335+0000', 'last_active': '2023-10-06T11:10:35.538922+0000', 'last_peered': '2023-10-06T11:10:35.538922+0000', 'last_clean': '2023-10-06T11:10:35.538922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:10:35.538922+0000', 'last_undegraded': '2023-10-06T11:10:35.538922+0000', 'last_fullsized': '2023-10-06T11:10:35.538922+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_clean_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:38:35.257233+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T11:10:41.368 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3e is not active+clean 2023-10-06T11:10:41.368 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:10:35.538922+0000', 'last_change': '2023-10-06T11:10:35.554801+0000', 'last_active': '2023-10-06T11:10:35.538922+0000', 'last_peered': '2023-10-06T11:10:35.538922+0000', 'last_clean': '2023-10-06T11:10:35.538922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:10:35.538922+0000', 'last_undegraded': '2023-10-06T11:10:35.538922+0000', 'last_fullsized': '2023-10-06T11:10:35.538922+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_clean_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T21:22:51.093918+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:10:41.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3c is not active+clean 2023-10-06T11:10:41.369 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:10:35.538922+0000', 'last_change': '2023-10-06T11:10:35.549185+0000', 'last_active': '2023-10-06T11:10:35.538922+0000', 'last_peered': '2023-10-06T11:10:35.538922+0000', 'last_clean': '2023-10-06T11:10:35.538922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:10:35.538922+0000', 'last_undegraded': '2023-10-06T11:10:35.538922+0000', 'last_fullsized': '2023-10-06T11:10:35.538922+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_clean_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:32:09.031116+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T11:10:41.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3b is not active+clean 2023-10-06T11:10:41.369 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:10:35.538922+0000', 'last_change': '2023-10-06T11:10:35.553578+0000', 'last_active': '2023-10-06T11:10:35.538922+0000', 'last_peered': '2023-10-06T11:10:35.538922+0000', 'last_clean': '2023-10-06T11:10:35.538922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:10:35.538922+0000', 'last_undegraded': '2023-10-06T11:10:35.538922+0000', 'last_fullsized': '2023-10-06T11:10:35.538922+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_clean_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:45:24.551243+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T11:10:41.369 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3a is not active+clean 2023-10-06T11:10:41.369 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:10:35.538922+0000', 'last_change': '2023-10-06T11:10:35.553611+0000', 'last_active': '2023-10-06T11:10:35.538922+0000', 'last_peered': '2023-10-06T11:10:35.538922+0000', 'last_clean': '2023-10-06T11:10:35.538922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:10:35.538922+0000', 'last_undegraded': '2023-10-06T11:10:35.538922+0000', 'last_fullsized': '2023-10-06T11:10:35.538922+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_clean_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T21:28:20.836849+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T11:10:41.370 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.38 is not active+clean 2023-10-06T11:10:41.370 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:10:35.538922+0000', 'last_change': '2023-10-06T11:10:35.555782+0000', 'last_active': '2023-10-06T11:10:35.538922+0000', 'last_peered': '2023-10-06T11:10:35.538922+0000', 'last_clean': '2023-10-06T11:10:35.538922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:10:35.538922+0000', 'last_undegraded': '2023-10-06T11:10:35.538922+0000', 'last_fullsized': '2023-10-06T11:10:35.538922+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_clean_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T21:00:33.203307+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T11:10:41.370 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.36 is not active+clean 2023-10-06T11:10:41.370 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:10:35.538922+0000', 'last_change': '2023-10-06T11:10:35.548825+0000', 'last_active': '2023-10-06T11:10:35.538922+0000', 'last_peered': '2023-10-06T11:10:35.538922+0000', 'last_clean': '2023-10-06T11:10:35.538922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:10:35.538922+0000', 'last_undegraded': '2023-10-06T11:10:35.538922+0000', 'last_fullsized': '2023-10-06T11:10:35.538922+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_clean_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:19:42.231134+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T11:10:41.370 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.35 is not active+clean 2023-10-06T11:10:41.370 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:10:35.538922+0000', 'last_change': '2023-10-06T11:10:35.554210+0000', 'last_active': '2023-10-06T11:10:35.538922+0000', 'last_peered': '2023-10-06T11:10:35.538922+0000', 'last_clean': '2023-10-06T11:10:35.538922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:10:35.538922+0000', 'last_undegraded': '2023-10-06T11:10:35.538922+0000', 'last_fullsized': '2023-10-06T11:10:35.538922+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_clean_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:44:55.429899+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:10:41.370 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.34 is not active+clean 2023-10-06T11:10:41.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:10:35.538922+0000', 'last_change': '2023-10-06T11:10:35.548679+0000', 'last_active': '2023-10-06T11:10:35.538922+0000', 'last_peered': '2023-10-06T11:10:35.538922+0000', 'last_clean': '2023-10-06T11:10:35.538922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:10:35.538922+0000', 'last_undegraded': '2023-10-06T11:10:35.538922+0000', 'last_fullsized': '2023-10-06T11:10:35.538922+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_clean_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T19:17:13.424540+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T11:10:41.371 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.33 is not active+clean 2023-10-06T11:10:41.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:10:35.538922+0000', 'last_change': '2023-10-06T11:10:35.552957+0000', 'last_active': '2023-10-06T11:10:35.538922+0000', 'last_peered': '2023-10-06T11:10:35.538922+0000', 'last_clean': '2023-10-06T11:10:35.538922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:10:35.538922+0000', 'last_undegraded': '2023-10-06T11:10:35.538922+0000', 'last_fullsized': '2023-10-06T11:10:35.538922+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_clean_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:02:39.156883+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T11:10:41.371 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.32 is not active+clean 2023-10-06T11:10:41.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:10:35.538922+0000', 'last_change': '2023-10-06T11:10:35.553145+0000', 'last_active': '2023-10-06T11:10:35.538922+0000', 'last_peered': '2023-10-06T11:10:35.538922+0000', 'last_clean': '2023-10-06T11:10:35.538922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:10:35.538922+0000', 'last_undegraded': '2023-10-06T11:10:35.538922+0000', 'last_fullsized': '2023-10-06T11:10:35.538922+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_clean_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:12:14.376199+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T11:10:41.373 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.31 is not active+clean 2023-10-06T11:10:41.373 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:10:35.538922+0000', 'last_change': '2023-10-06T11:10:35.556432+0000', 'last_active': '2023-10-06T11:10:35.538922+0000', 'last_peered': '2023-10-06T11:10:35.538922+0000', 'last_clean': '2023-10-06T11:10:35.538922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:10:35.538922+0000', 'last_undegraded': '2023-10-06T11:10:35.538922+0000', 'last_fullsized': '2023-10-06T11:10:35.538922+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_clean_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:58:55.888185+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:10:41.374 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.30 is not active+clean 2023-10-06T11:10:41.374 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:10:35.538922+0000', 'last_change': '2023-10-06T11:10:35.552348+0000', 'last_active': '2023-10-06T11:10:35.538922+0000', 'last_peered': '2023-10-06T11:10:35.538922+0000', 'last_clean': '2023-10-06T11:10:35.538922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:10:35.538922+0000', 'last_undegraded': '2023-10-06T11:10:35.538922+0000', 'last_fullsized': '2023-10-06T11:10:35.538922+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_clean_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T22:26:32.606626+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T11:10:41.374 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2f is not active+clean 2023-10-06T11:10:41.374 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:10:35.538922+0000', 'last_change': '2023-10-06T11:10:35.555261+0000', 'last_active': '2023-10-06T11:10:35.538922+0000', 'last_peered': '2023-10-06T11:10:35.538922+0000', 'last_clean': '2023-10-06T11:10:35.538922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:10:35.538922+0000', 'last_undegraded': '2023-10-06T11:10:35.538922+0000', 'last_fullsized': '2023-10-06T11:10:35.538922+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_clean_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T22:09:50.794839+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T11:10:41.374 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2d is not active+clean 2023-10-06T11:10:41.374 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:10:35.538922+0000', 'last_change': '2023-10-06T11:10:35.552595+0000', 'last_active': '2023-10-06T11:10:35.538922+0000', 'last_peered': '2023-10-06T11:10:35.538922+0000', 'last_clean': '2023-10-06T11:10:35.538922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:10:35.538922+0000', 'last_undegraded': '2023-10-06T11:10:35.538922+0000', 'last_fullsized': '2023-10-06T11:10:35.538922+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_clean_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T18:24:07.541940+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T11:10:41.374 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2c is not active+clean 2023-10-06T11:10:41.375 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:10:35.538922+0000', 'last_change': '2023-10-06T11:10:35.554842+0000', 'last_active': '2023-10-06T11:10:35.538922+0000', 'last_peered': '2023-10-06T11:10:35.538922+0000', 'last_clean': '2023-10-06T11:10:35.538922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:10:35.538922+0000', 'last_undegraded': '2023-10-06T11:10:35.538922+0000', 'last_fullsized': '2023-10-06T11:10:35.538922+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_clean_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T20:01:59.255497+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T11:10:41.375 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2a is not active+clean 2023-10-06T11:10:41.375 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:10:35.538922+0000', 'last_change': '2023-10-06T11:10:35.553928+0000', 'last_active': '2023-10-06T11:10:35.538922+0000', 'last_peered': '2023-10-06T11:10:35.538922+0000', 'last_clean': '2023-10-06T11:10:35.538922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:10:35.538922+0000', 'last_undegraded': '2023-10-06T11:10:35.538922+0000', 'last_fullsized': '2023-10-06T11:10:35.538922+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_clean_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T17:30:57.876539+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T11:10:41.375 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.28 is not active+clean 2023-10-06T11:10:41.375 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:10:35.538922+0000', 'last_change': '2023-10-06T11:10:35.554368+0000', 'last_active': '2023-10-06T11:10:35.538922+0000', 'last_peered': '2023-10-06T11:10:35.538922+0000', 'last_clean': '2023-10-06T11:10:35.538922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:10:35.538922+0000', 'last_undegraded': '2023-10-06T11:10:35.538922+0000', 'last_fullsized': '2023-10-06T11:10:35.538922+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_clean_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:29:35.094726+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:10:41.375 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.27 is not active+clean 2023-10-06T11:10:41.375 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:10:35.538922+0000', 'last_change': '2023-10-06T11:10:35.554089+0000', 'last_active': '2023-10-06T11:10:35.538922+0000', 'last_peered': '2023-10-06T11:10:35.538922+0000', 'last_clean': '2023-10-06T11:10:35.538922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:10:35.538922+0000', 'last_undegraded': '2023-10-06T11:10:35.538922+0000', 'last_fullsized': '2023-10-06T11:10:35.538922+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_clean_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:25:09.293990+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:10:41.376 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.26 is not active+clean 2023-10-06T11:10:41.376 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:10:35.538922+0000', 'last_change': '2023-10-06T11:10:35.548095+0000', 'last_active': '2023-10-06T11:10:35.538922+0000', 'last_peered': '2023-10-06T11:10:35.538922+0000', 'last_clean': '2023-10-06T11:10:35.538922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:10:35.538922+0000', 'last_undegraded': '2023-10-06T11:10:35.538922+0000', 'last_fullsized': '2023-10-06T11:10:35.538922+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_clean_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:49:54.089077+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T11:10:41.376 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.25 is not active+clean 2023-10-06T11:10:41.376 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:10:35.538922+0000', 'last_change': '2023-10-06T11:10:35.553169+0000', 'last_active': '2023-10-06T11:10:35.538922+0000', 'last_peered': '2023-10-06T11:10:35.538922+0000', 'last_clean': '2023-10-06T11:10:35.538922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:10:35.538922+0000', 'last_undegraded': '2023-10-06T11:10:35.538922+0000', 'last_fullsized': '2023-10-06T11:10:35.538922+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_clean_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T21:28:20.836849+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T11:10:41.376 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.24 is not active+clean 2023-10-06T11:10:41.377 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:10:35.538922+0000', 'last_change': '2023-10-06T11:10:35.554359+0000', 'last_active': '2023-10-06T11:10:35.538922+0000', 'last_peered': '2023-10-06T11:10:35.538922+0000', 'last_clean': '2023-10-06T11:10:35.538922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:10:35.538922+0000', 'last_undegraded': '2023-10-06T11:10:35.538922+0000', 'last_fullsized': '2023-10-06T11:10:35.538922+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_clean_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T22:57:30.963073+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T11:10:41.377 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.23 is not active+clean 2023-10-06T11:10:41.377 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:10:35.538922+0000', 'last_change': '2023-10-06T11:10:35.554210+0000', 'last_active': '2023-10-06T11:10:35.538922+0000', 'last_peered': '2023-10-06T11:10:35.538922+0000', 'last_clean': '2023-10-06T11:10:35.538922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:10:35.538922+0000', 'last_undegraded': '2023-10-06T11:10:35.538922+0000', 'last_fullsized': '2023-10-06T11:10:35.538922+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_clean_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:15:56.228848+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:10:41.377 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.22 is not active+clean 2023-10-06T11:10:41.377 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:10:35.538922+0000', 'last_change': '2023-10-06T11:10:35.553038+0000', 'last_active': '2023-10-06T11:10:35.538922+0000', 'last_peered': '2023-10-06T11:10:35.538922+0000', 'last_clean': '2023-10-06T11:10:35.538922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:10:35.538922+0000', 'last_undegraded': '2023-10-06T11:10:35.538922+0000', 'last_fullsized': '2023-10-06T11:10:35.538922+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_clean_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:12:14.376199+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T11:10:41.377 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.20 is not active+clean 2023-10-06T11:10:41.377 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:10:35.538922+0000', 'last_change': '2023-10-06T11:10:35.551771+0000', 'last_active': '2023-10-06T11:10:35.538922+0000', 'last_peered': '2023-10-06T11:10:35.538922+0000', 'last_clean': '2023-10-06T11:10:35.538922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:10:35.538922+0000', 'last_undegraded': '2023-10-06T11:10:35.538922+0000', 'last_fullsized': '2023-10-06T11:10:35.538922+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_clean_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T18:24:07.541940+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T11:10:41.378 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.19 is not active+clean 2023-10-06T11:10:41.378 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:10:35.538922+0000', 'last_change': '2023-10-06T11:10:35.551757+0000', 'last_active': '2023-10-06T11:10:35.538922+0000', 'last_peered': '2023-10-06T11:10:35.538922+0000', 'last_clean': '2023-10-06T11:10:35.538922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:10:35.538922+0000', 'last_undegraded': '2023-10-06T11:10:35.538922+0000', 'last_fullsized': '2023-10-06T11:10:35.538922+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_clean_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T21:28:20.836849+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:10:41.378 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1c is not active+clean 2023-10-06T11:10:41.378 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:10:35.538922+0000', 'last_change': '2023-10-06T11:10:35.552197+0000', 'last_active': '2023-10-06T11:10:35.538922+0000', 'last_peered': '2023-10-06T11:10:35.538922+0000', 'last_clean': '2023-10-06T11:10:35.538922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:10:35.538922+0000', 'last_undegraded': '2023-10-06T11:10:35.538922+0000', 'last_fullsized': '2023-10-06T11:10:35.538922+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_clean_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T20:21:08.092457+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:10:41.378 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1d is not active+clean 2023-10-06T11:10:41.378 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:10:35.538922+0000', 'last_change': '2023-10-06T11:10:35.551707+0000', 'last_active': '2023-10-06T11:10:35.538922+0000', 'last_peered': '2023-10-06T11:10:35.538922+0000', 'last_clean': '2023-10-06T11:10:35.538922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:10:35.538922+0000', 'last_undegraded': '2023-10-06T11:10:35.538922+0000', 'last_fullsized': '2023-10-06T11:10:35.538922+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_clean_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:12:14.376199+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:10:41.378 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.10 is not active+clean 2023-10-06T11:10:41.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:10:35.538922+0000', 'last_change': '2023-10-06T11:10:35.551700+0000', 'last_active': '2023-10-06T11:10:35.538922+0000', 'last_peered': '2023-10-06T11:10:35.538922+0000', 'last_clean': '2023-10-06T11:10:35.538922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:10:35.538922+0000', 'last_undegraded': '2023-10-06T11:10:35.538922+0000', 'last_fullsized': '2023-10-06T11:10:35.538922+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_clean_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T21:20:30.493152+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:10:41.379 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.11 is not active+clean 2023-10-06T11:10:41.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:10:35.538922+0000', 'last_change': '2023-10-06T11:10:35.548736+0000', 'last_active': '2023-10-06T11:10:35.538922+0000', 'last_peered': '2023-10-06T11:10:35.538922+0000', 'last_clean': '2023-10-06T11:10:35.538922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:10:35.538922+0000', 'last_undegraded': '2023-10-06T11:10:35.538922+0000', 'last_fullsized': '2023-10-06T11:10:35.538922+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_clean_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T19:24:29.252009+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T11:10:41.379 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.12 is not active+clean 2023-10-06T11:10:41.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:10:35.538922+0000', 'last_change': '2023-10-06T11:10:35.552701+0000', 'last_active': '2023-10-06T11:10:35.538922+0000', 'last_peered': '2023-10-06T11:10:35.538922+0000', 'last_clean': '2023-10-06T11:10:35.538922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:10:35.538922+0000', 'last_undegraded': '2023-10-06T11:10:35.538922+0000', 'last_fullsized': '2023-10-06T11:10:35.538922+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_clean_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T21:20:30.493152+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T11:10:41.379 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.14 is not active+clean 2023-10-06T11:10:41.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:10:35.538922+0000', 'last_change': '2023-10-06T11:10:35.548074+0000', 'last_active': '2023-10-06T11:10:35.538922+0000', 'last_peered': '2023-10-06T11:10:35.538922+0000', 'last_clean': '2023-10-06T11:10:35.538922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:10:35.538922+0000', 'last_undegraded': '2023-10-06T11:10:35.538922+0000', 'last_fullsized': '2023-10-06T11:10:35.538922+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_clean_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T17:56:23.575265+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T11:10:41.379 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3 is not active+clean 2023-10-06T11:10:41.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:10:35.538922+0000', 'last_change': '2023-10-06T11:10:35.552115+0000', 'last_active': '2023-10-06T11:10:35.538922+0000', 'last_peered': '2023-10-06T11:10:35.538922+0000', 'last_clean': '2023-10-06T11:10:35.538922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:10:35.538922+0000', 'last_undegraded': '2023-10-06T11:10:35.538922+0000', 'last_fullsized': '2023-10-06T11:10:35.538922+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_clean_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T22:26:32.606626+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:10:41.380 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.8 is not active+clean 2023-10-06T11:10:41.380 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:10:35.538922+0000', 'last_change': '2023-10-06T11:10:35.552863+0000', 'last_active': '2023-10-06T11:10:35.538922+0000', 'last_peered': '2023-10-06T11:10:35.538922+0000', 'last_clean': '2023-10-06T11:10:35.538922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:10:35.538922+0000', 'last_undegraded': '2023-10-06T11:10:35.538922+0000', 'last_fullsized': '2023-10-06T11:10:35.538922+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_clean_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T22:26:32.606626+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T11:10:41.380 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.9 is not active+clean 2023-10-06T11:10:41.380 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:10:35.538922+0000', 'last_change': '2023-10-06T11:10:35.553024+0000', 'last_active': '2023-10-06T11:10:35.538922+0000', 'last_peered': '2023-10-06T11:10:35.538922+0000', 'last_clean': '2023-10-06T11:10:35.538922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:10:35.538922+0000', 'last_undegraded': '2023-10-06T11:10:35.538922+0000', 'last_fullsized': '2023-10-06T11:10:35.538922+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_clean_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T22:12:36.084850+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T11:10:41.380 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.e is not active+clean 2023-10-06T11:10:41.380 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:10:35.538922+0000', 'last_change': '2023-10-06T11:10:35.551941+0000', 'last_active': '2023-10-06T11:10:35.538922+0000', 'last_peered': '2023-10-06T11:10:35.538922+0000', 'last_clean': '2023-10-06T11:10:35.538922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:10:35.538922+0000', 'last_undegraded': '2023-10-06T11:10:35.538922+0000', 'last_fullsized': '2023-10-06T11:10:35.538922+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_clean_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T21:24:04.262059+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:10:41.380 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.d is not active+clean 2023-10-06T11:10:41.380 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:10:35.538922+0000', 'last_change': '2023-10-06T11:10:35.552732+0000', 'last_active': '2023-10-06T11:10:35.538922+0000', 'last_peered': '2023-10-06T11:10:35.538922+0000', 'last_clean': '2023-10-06T11:10:35.538922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:10:35.538922+0000', 'last_undegraded': '2023-10-06T11:10:35.538922+0000', 'last_fullsized': '2023-10-06T11:10:35.538922+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_clean_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T21:20:30.493152+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T11:10:41.380 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.c is not active+clean 2023-10-06T11:10:41.381 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:10:35.538922+0000', 'last_change': '2023-10-06T11:10:35.551778+0000', 'last_active': '2023-10-06T11:10:35.538922+0000', 'last_peered': '2023-10-06T11:10:35.538922+0000', 'last_clean': '2023-10-06T11:10:35.538922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:10:35.538922+0000', 'last_undegraded': '2023-10-06T11:10:35.538922+0000', 'last_fullsized': '2023-10-06T11:10:35.538922+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_clean_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T20:06:36.489499+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:10:41.381 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.b is not active+clean 2023-10-06T11:10:41.381 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:10:35.538922+0000', 'last_change': '2023-10-06T11:10:35.552588+0000', 'last_active': '2023-10-06T11:10:35.538922+0000', 'last_peered': '2023-10-06T11:10:35.538922+0000', 'last_clean': '2023-10-06T11:10:35.538922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:10:35.538922+0000', 'last_undegraded': '2023-10-06T11:10:35.538922+0000', 'last_fullsized': '2023-10-06T11:10:35.538922+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_clean_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:38:35.257233+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T11:10:41.381 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.a is not active+clean 2023-10-06T11:10:41.381 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:10:35.538922+0000', 'last_change': '2023-10-06T11:10:35.553478+0000', 'last_active': '2023-10-06T11:10:35.538922+0000', 'last_peered': '2023-10-06T11:10:35.538922+0000', 'last_clean': '2023-10-06T11:10:35.538922+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:10:35.538922+0000', 'last_undegraded': '2023-10-06T11:10:35.538922+0000', 'last_fullsized': '2023-10-06T11:10:35.538922+0000', 'mapping_epoch': 73, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 73, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'last_clean_scrub_stamp': '2023-10-06T11:10:35.538922+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:14:01.696915+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T11:10:41.382 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T11:10:41.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.513+0000 7f5f450a9700 1 Processor -- start 2023-10-06T11:10:41.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.513+0000 7f5f450a9700 1 -- start start 2023-10-06T11:10:41.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.514+0000 7f5f450a9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5f40068ba0 0x7f5f4015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:41.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.514+0000 7f5f450a9700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5f40153e80 0x7f5f400b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:41.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.514+0000 7f5f450a9700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f4015ac30 con 0x7f5f40153ab0 2023-10-06T11:10:41.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.514+0000 7f5f450a9700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f400b4510 con 0x7f5f40068ba0 2023-10-06T11:10:41.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.514+0000 7f5f450a9700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f400b6530 con 0x7f5f40153e80 2023-10-06T11:10:41.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.514+0000 7f5f3659c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5f40068ba0 0x7f5f4015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:41.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.514+0000 7f5f3659c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5f40068ba0 0x7f5f4015a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50978/0 (socket says 172.21.15.146:50978) 2023-10-06T11:10:41.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.514+0000 7f5f3659c700 1 -- 172.21.15.146:0/1897336353 learned_addr learned my addr 172.21.15.146:0/1897336353 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:41.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.514+0000 7f5f3f59e700 1 --2- 172.21.15.146:0/1897336353 >> v2:172.21.15.151:3300/0 conn(0x7f5f40153e80 0x7f5f400b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:41.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.514+0000 7f5f3659c700 1 -- 172.21.15.146:0/1897336353 >> v2:172.21.15.151:3300/0 conn(0x7f5f40153e80 msgr2=0x7f5f400b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:41.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.514+0000 7f5f3659c700 1 --2- 172.21.15.146:0/1897336353 >> v2:172.21.15.151:3300/0 conn(0x7f5f40153e80 0x7f5f400b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:41.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.514+0000 7f5f3659c700 1 -- 172.21.15.146:0/1897336353 >> v1:172.21.15.151:6789/0 conn(0x7f5f40153ab0 legacy=0x7f5f40068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:41.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.514+0000 7f5f3659c700 1 -- 172.21.15.146:0/1897336353 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f400b5c50 con 0x7f5f40068ba0 2023-10-06T11:10:41.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.515+0000 7f5f3659c700 1 --2- 172.21.15.146:0/1897336353 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f40068ba0 0x7f5f4015a6f0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f5f400d12a0 tx=0x7f5f28009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75a1dc625491dce1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:41.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.515+0000 7f5f3e59c700 1 -- 172.21.15.146:0/1897336353 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2800b860 con 0x7f5f40068ba0 2023-10-06T11:10:41.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.515+0000 7f5f3e59c700 1 -- 172.21.15.146:0/1897336353 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2800b9c0 con 0x7f5f40068ba0 2023-10-06T11:10:41.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.515+0000 7f5f3e59c700 1 -- 172.21.15.146:0/1897336353 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2800bd60 con 0x7f5f40068ba0 2023-10-06T11:10:41.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.515+0000 7f5f450a9700 1 -- 172.21.15.146:0/1897336353 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f40068ba0 msgr2=0x7f5f4015a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:41.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.515+0000 7f5f450a9700 1 --2- 172.21.15.146:0/1897336353 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f40068ba0 0x7f5f4015a6f0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f5f400d12a0 tx=0x7f5f28009250 comp rx=0 tx=0).stop 2023-10-06T11:10:41.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.515+0000 7f5f450a9700 1 -- 172.21.15.146:0/1897336353 shutdown_connections 2023-10-06T11:10:41.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.515+0000 7f5f450a9700 1 --2- 172.21.15.146:0/1897336353 >> v2:172.21.15.151:3300/0 conn(0x7f5f40153e80 0x7f5f400b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:41.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.515+0000 7f5f450a9700 1 --2- 172.21.15.146:0/1897336353 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f40068ba0 0x7f5f4015a6f0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:41.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.515+0000 7f5f450a9700 1 -- 172.21.15.146:0/1897336353 >> 172.21.15.146:0/1897336353 conn(0x7f5f4006eba0 msgr2=0x7f5f4006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:41.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.515+0000 7f5f450a9700 1 -- 172.21.15.146:0/1897336353 shutdown_connections 2023-10-06T11:10:41.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.515+0000 7f5f450a9700 1 -- 172.21.15.146:0/1897336353 wait complete. 2023-10-06T11:10:41.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.516+0000 7f5f450a9700 1 Processor -- start 2023-10-06T11:10:41.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.516+0000 7f5f450a9700 1 -- start start 2023-10-06T11:10:41.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.517+0000 7f5f450a9700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f40068ba0 0x7f5f40159520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:41.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.517+0000 7f5f450a9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f40153ab0 0x7f5f400b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:41.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.517+0000 7f5f450a9700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f40153e80 0x7f5f40154300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:41.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.517+0000 7f5f450a9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f400b1560 con 0x7f5f40153ab0 2023-10-06T11:10:41.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.517+0000 7f5f450a9700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f40159a60 con 0x7f5f40153e80 2023-10-06T11:10:41.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.517+0000 7f5f450a9700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f400b0970 con 0x7f5f40068ba0 2023-10-06T11:10:41.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.517+0000 7f5f3659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f40153ab0 0x7f5f400b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:41.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.517+0000 7f5f3659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f40153ab0 0x7f5f400b19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50992/0 (socket says 172.21.15.146:50992) 2023-10-06T11:10:41.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.517+0000 7f5f3659c700 1 -- 172.21.15.146:0/1073998769 learned_addr learned my addr 172.21.15.146:0/1073998769 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:41.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.517+0000 7f5f3f59e700 1 --2- 172.21.15.146:0/1073998769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f40153e80 0x7f5f40154300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:41.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.517+0000 7f5f3ed9d700 1 --2- 172.21.15.146:0/1073998769 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f40068ba0 0x7f5f40159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:41.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.518+0000 7f5f3659c700 1 -- 172.21.15.146:0/1073998769 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f40068ba0 msgr2=0x7f5f40159520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:41.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.518+0000 7f5f3659c700 1 --2- 172.21.15.146:0/1073998769 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f40068ba0 0x7f5f40159520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:41.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.518+0000 7f5f3659c700 1 -- 172.21.15.146:0/1073998769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f40153e80 msgr2=0x7f5f40154300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:41.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.518+0000 7f5f3659c700 1 --2- 172.21.15.146:0/1073998769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f40153e80 0x7f5f40154300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:41.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.518+0000 7f5f3659c700 1 -- 172.21.15.146:0/1073998769 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f280094f0 con 0x7f5f40153ab0 2023-10-06T11:10:41.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.518+0000 7f5f3659c700 1 --2- 172.21.15.146:0/1073998769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f40153ab0 0x7f5f400b19f0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f5f28009290 tx=0x7f5f28017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:41.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.518+0000 7f5f377fe700 1 -- 172.21.15.146:0/1073998769 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f28026450 con 0x7f5f40153ab0 2023-10-06T11:10:41.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.518+0000 7f5f377fe700 1 -- 172.21.15.146:0/1073998769 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f280265b0 con 0x7f5f40153ab0 2023-10-06T11:10:41.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.518+0000 7f5f450a9700 1 -- 172.21.15.146:0/1073998769 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f400b0c30 con 0x7f5f40153ab0 2023-10-06T11:10:41.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.518+0000 7f5f377fe700 1 -- 172.21.15.146:0/1073998769 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f28026970 con 0x7f5f40153ab0 2023-10-06T11:10:41.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.518+0000 7f5f450a9700 1 -- 172.21.15.146:0/1073998769 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f400b11f0 con 0x7f5f40153ab0 2023-10-06T11:10:41.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.519+0000 7f5f450a9700 1 -- 172.21.15.146:0/1073998769 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f4004c380 con 0x7f5f40153ab0 2023-10-06T11:10:41.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.519+0000 7f5f377fe700 1 -- 172.21.15.146:0/1073998769 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5f2801a420 con 0x7f5f40153ab0 2023-10-06T11:10:41.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.520+0000 7f5f377fe700 1 --2- 172.21.15.146:0/1073998769 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5f20066f30 0x7f5f200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:41.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.520+0000 7f5f377fe700 1 -- 172.21.15.146:0/1073998769 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5f280863e0 con 0x7f5f40153ab0 2023-10-06T11:10:41.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.520+0000 7f5f3ed9d700 1 --2- 172.21.15.146:0/1073998769 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5f20066f30 0x7f5f200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:41.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.520+0000 7f5f3ed9d700 1 --2- 172.21.15.146:0/1073998769 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5f20066f30 0x7f5f200693e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5f30003880 tx=0x7f5f30009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:41.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.524+0000 7f5f377fe700 1 -- 172.21.15.146:0/1073998769 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5f28053620 con 0x7f5f40153ab0 2023-10-06T11:10:41.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.790+0000 7f5f450a9700 1 -- 172.21.15.146:0/1073998769 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f5f400b16a0 con 0x7f5f40153ab0 2023-10-06T11:10:41.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.790+0000 7f5f377fe700 1 -- 172.21.15.146:0/1073998769 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1518 (secure 0 0 0) 0x7f5f28056c40 con 0x7f5f40153ab0 2023-10-06T11:10:41.792 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:10:41.792 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":316,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":75,"num_osds":8,"num_up_osds":8,"osd_up_since":1696590336,"num_in_osds":8,"osd_in_since":1696590327,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":65},{"state_name":"creating+peering","count":40}],"num_pgs":105,"num_pools":4,"num_objects":8,"data_bytes":591904,"bytes_used":2502451200,"bytes_avail":770591662080,"bytes_total":773094113280,"inactive_pgs_ratio":0.380952388048172,"write_bytes_sec":511,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":64,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"b","status":"up:active","gid":6786}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":15,"modified":"2023-10-06T11:10:25.201329+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T11:10:41.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.792+0000 7f5f450a9700 1 -- 172.21.15.146:0/1073998769 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5f20066f30 msgr2=0x7f5f200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:41.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.792+0000 7f5f450a9700 1 --2- 172.21.15.146:0/1073998769 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5f20066f30 0x7f5f200693e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f5f30003880 tx=0x7f5f30009040 comp rx=0 tx=0).stop 2023-10-06T11:10:41.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.792+0000 7f5f450a9700 1 -- 172.21.15.146:0/1073998769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f40153ab0 msgr2=0x7f5f400b19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:41.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.792+0000 7f5f450a9700 1 --2- 172.21.15.146:0/1073998769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f40153ab0 0x7f5f400b19f0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f5f28009290 tx=0x7f5f28017000 comp rx=0 tx=0).stop 2023-10-06T11:10:41.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.793+0000 7f5f450a9700 1 -- 172.21.15.146:0/1073998769 shutdown_connections 2023-10-06T11:10:41.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.793+0000 7f5f450a9700 1 --2- 172.21.15.146:0/1073998769 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5f20066f30 0x7f5f200693e0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:41.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.793+0000 7f5f450a9700 1 --2- 172.21.15.146:0/1073998769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f40153e80 0x7f5f40154300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:41.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.793+0000 7f5f450a9700 1 --2- 172.21.15.146:0/1073998769 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f40068ba0 0x7f5f40159520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:41.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.793+0000 7f5f450a9700 1 --2- 172.21.15.146:0/1073998769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5f40153ab0 0x7f5f400b19f0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:41.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.793+0000 7f5f450a9700 1 -- 172.21.15.146:0/1073998769 >> 172.21.15.146:0/1073998769 conn(0x7f5f4006eba0 msgr2=0x7f5f401520f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:41.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.793+0000 7f5f450a9700 1 -- 172.21.15.146:0/1073998769 shutdown_connections 2023-10-06T11:10:41.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.793+0000 7f5f450a9700 1 -- 172.21.15.146:0/1073998769 wait complete. 2023-10-06T11:10:41.806 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-06T11:10:41.806 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:10:41.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.919+0000 7f596cb13700 1 Processor -- start 2023-10-06T11:10:41.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.919+0000 7f596cb13700 1 -- start start 2023-10-06T11:10:41.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.920+0000 7f596cb13700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5968157430 0x7f5968157800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:41.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.920+0000 7f596cb13700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f59680ab010 0x7f59680ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:41.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.920+0000 7f596cb13700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f59680cc240 0x7f59680cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:41.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.920+0000 7f596cb13700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59680c3dd0 con 0x7f59680cc240 2023-10-06T11:10:41.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.920+0000 7f596cb13700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59680cf0b0 con 0x7f59680ab010 2023-10-06T11:10:41.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.920+0000 7f596cb13700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59680ccf20 con 0x7f5968157430 2023-10-06T11:10:41.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.920+0000 7f5966d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f59680cc240 0x7f59680cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:41.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.920+0000 7f5966d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f59680cc240 0x7f59680cc6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50996/0 (socket says 172.21.15.146:50996) 2023-10-06T11:10:41.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.920+0000 7f5966d9d700 1 -- 172.21.15.146:0/3226179494 learned_addr learned my addr 172.21.15.146:0/3226179494 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:41.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.920+0000 7f596659c700 1 --2- 172.21.15.146:0/3226179494 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5968157430 0x7f5968157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:41.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.920+0000 7f595dd9b700 1 --2- 172.21.15.146:0/3226179494 >> v2:172.21.15.151:3300/0 conn(0x7f59680ab010 0x7f59680ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:41.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.920+0000 7f5966d9d700 1 -- 172.21.15.146:0/3226179494 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5968157430 msgr2=0x7f5968157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:41.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.920+0000 7f5966d9d700 1 --2- 172.21.15.146:0/3226179494 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5968157430 0x7f5968157800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:41.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.920+0000 7f5966d9d700 1 -- 172.21.15.146:0/3226179494 >> v2:172.21.15.151:3300/0 conn(0x7f59680ab010 msgr2=0x7f59680ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:41.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.920+0000 7f5966d9d700 1 --2- 172.21.15.146:0/3226179494 >> v2:172.21.15.151:3300/0 conn(0x7f59680ab010 0x7f59680ceb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:41.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.920+0000 7f5966d9d700 1 -- 172.21.15.146:0/3226179494 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59680cd200 con 0x7f59680cc240 2023-10-06T11:10:41.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.921+0000 7f5966d9d700 1 --2- 172.21.15.146:0/3226179494 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59680cc240 0x7f59680cc6c0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f596806fcd0 tx=0x7f5960009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaddfdfd7d27e6d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:41.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.921+0000 7f5965d9b700 1 -- 172.21.15.146:0/3226179494 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596000e070 con 0x7f59680cc240 2023-10-06T11:10:41.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.921+0000 7f5965d9b700 1 -- 172.21.15.146:0/3226179494 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f596000ba50 con 0x7f59680cc240 2023-10-06T11:10:41.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.921+0000 7f5965d9b700 1 -- 172.21.15.146:0/3226179494 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59600092e0 con 0x7f59680cc240 2023-10-06T11:10:41.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.921+0000 7f596cb13700 1 -- 172.21.15.146:0/3226179494 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59680cc240 msgr2=0x7f59680cc6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:41.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.921+0000 7f596cb13700 1 --2- 172.21.15.146:0/3226179494 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59680cc240 0x7f59680cc6c0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f596806fcd0 tx=0x7f5960009840 comp rx=0 tx=0).stop 2023-10-06T11:10:41.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.921+0000 7f596cb13700 1 -- 172.21.15.146:0/3226179494 shutdown_connections 2023-10-06T11:10:41.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.921+0000 7f596cb13700 1 --2- 172.21.15.146:0/3226179494 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f59680cc240 0x7f59680cc6c0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:41.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.921+0000 7f596cb13700 1 --2- 172.21.15.146:0/3226179494 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5968157430 0x7f5968157800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:41.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.921+0000 7f596cb13700 1 --2- 172.21.15.146:0/3226179494 >> v2:172.21.15.151:3300/0 conn(0x7f59680ab010 0x7f59680ceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:41.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.921+0000 7f596cb13700 1 -- 172.21.15.146:0/3226179494 >> 172.21.15.146:0/3226179494 conn(0x7f5968067c50 msgr2=0x7f59680ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:41.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.921+0000 7f596cb13700 1 -- 172.21.15.146:0/3226179494 shutdown_connections 2023-10-06T11:10:41.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.921+0000 7f596cb13700 1 -- 172.21.15.146:0/3226179494 wait complete. 2023-10-06T11:10:41.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.923+0000 7f596cb13700 1 Processor -- start 2023-10-06T11:10:41.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.923+0000 7f596cb13700 1 -- start start 2023-10-06T11:10:41.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.923+0000 7f596cb13700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f59680ab010 0x7f59680b2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:41.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.923+0000 7f596cb13700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59680cc240 0x7f5968151a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:41.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.923+0000 7f596cb13700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5968157430 0x7f59680ad0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:41.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.923+0000 7f596cb13700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596816ae00 con 0x7f5968157430 2023-10-06T11:10:41.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.923+0000 7f596cb13700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f596816bc60 con 0x7f59680cc240 2023-10-06T11:10:41.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.923+0000 7f596cb13700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59680b2780 con 0x7f59680ab010 2023-10-06T11:10:41.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.923+0000 7f5966d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5968157430 0x7f59680ad0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:41.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.923+0000 7f5966d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5968157430 0x7f59680ad0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51004/0 (socket says 172.21.15.146:51004) 2023-10-06T11:10:41.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.923+0000 7f5966d9d700 1 -- 172.21.15.146:0/1002501299 learned_addr learned my addr 172.21.15.146:0/1002501299 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:41.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.923+0000 7f595dd9b700 1 --2- 172.21.15.146:0/1002501299 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59680cc240 0x7f5968151a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:41.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.923+0000 7f596659c700 1 --2- 172.21.15.146:0/1002501299 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f59680ab010 0x7f59680b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:41.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.924+0000 7f5966d9d700 1 -- 172.21.15.146:0/1002501299 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f59680ab010 msgr2=0x7f59680b2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:41.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.924+0000 7f5966d9d700 1 --2- 172.21.15.146:0/1002501299 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f59680ab010 0x7f59680b2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:41.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.924+0000 7f5966d9d700 1 -- 172.21.15.146:0/1002501299 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59680cc240 msgr2=0x7f5968151a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:41.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.924+0000 7f5966d9d700 1 --2- 172.21.15.146:0/1002501299 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59680cc240 0x7f5968151a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:41.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.924+0000 7f5966d9d700 1 -- 172.21.15.146:0/1002501299 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5960009ae0 con 0x7f5968157430 2023-10-06T11:10:41.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.924+0000 7f5966d9d700 1 --2- 172.21.15.146:0/1002501299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5968157430 0x7f59680ad0e0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f5960009fd0 tx=0x7f5960018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:41.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.924+0000 7f595effd700 1 -- 172.21.15.146:0/1002501299 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59600094e0 con 0x7f5968157430 2023-10-06T11:10:41.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.924+0000 7f595effd700 1 -- 172.21.15.146:0/1002501299 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59600032f0 con 0x7f5968157430 2023-10-06T11:10:41.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.924+0000 7f596cb13700 1 -- 172.21.15.146:0/1002501299 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f596816b050 con 0x7f5968157430 2023-10-06T11:10:41.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.924+0000 7f595effd700 1 -- 172.21.15.146:0/1002501299 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5960026460 con 0x7f5968157430 2023-10-06T11:10:41.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.924+0000 7f596cb13700 1 -- 172.21.15.146:0/1002501299 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f596816b610 con 0x7f5968157430 2023-10-06T11:10:41.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.925+0000 7f596cb13700 1 -- 172.21.15.146:0/1002501299 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f596804c380 con 0x7f5968157430 2023-10-06T11:10:41.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.925+0000 7f595effd700 1 -- 172.21.15.146:0/1002501299 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5960003040 con 0x7f5968157430 2023-10-06T11:10:41.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.926+0000 7f595effd700 1 --2- 172.21.15.146:0/1002501299 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5948066f30 0x7f59480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:41.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.926+0000 7f595effd700 1 -- 172.21.15.146:0/1002501299 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5960086510 con 0x7f5968157430 2023-10-06T11:10:41.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.926+0000 7f596659c700 1 --2- 172.21.15.146:0/1002501299 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5948066f30 0x7f59480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:41.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.926+0000 7f596659c700 1 --2- 172.21.15.146:0/1002501299 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5948066f30 0x7f59480693e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f5958006fd0 tx=0x7f5958008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:41.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:41.930+0000 7f595effd700 1 -- 172.21.15.146:0/1002501299 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5960053620 con 0x7f5968157430 2023-10-06T11:10:42.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:42.108+0000 7f596cb13700 1 -- 172.21.15.146:0/1002501299 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f59680ccc00 con 0x7f5948066f30 2023-10-06T11:10:42.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:42.116+0000 7f595effd700 1 -- 172.21.15.146:0/1002501299 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309727 (secure 0 0 0) 0x7f59680ccc00 con 0x7f5948066f30 2023-10-06T11:10:42.121 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:10:42.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:42.119+0000 7f596cb13700 1 -- 172.21.15.146:0/1002501299 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5948066f30 msgr2=0x7f59480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:42.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:42.119+0000 7f596cb13700 1 --2- 172.21.15.146:0/1002501299 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5948066f30 0x7f59480693e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f5958006fd0 tx=0x7f5958008040 comp rx=0 tx=0).stop 2023-10-06T11:10:42.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:42.119+0000 7f596cb13700 1 -- 172.21.15.146:0/1002501299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5968157430 msgr2=0x7f59680ad0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:42.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:42.119+0000 7f596cb13700 1 --2- 172.21.15.146:0/1002501299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5968157430 0x7f59680ad0e0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f5960009fd0 tx=0x7f5960018000 comp rx=0 tx=0).stop 2023-10-06T11:10:42.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:42.119+0000 7f596cb13700 1 -- 172.21.15.146:0/1002501299 shutdown_connections 2023-10-06T11:10:42.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:42.119+0000 7f596cb13700 1 --2- 172.21.15.146:0/1002501299 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5948066f30 0x7f59480693e0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:42.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:42.119+0000 7f596cb13700 1 --2- 172.21.15.146:0/1002501299 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5968157430 0x7f59680ad0e0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:42.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:42.119+0000 7f596cb13700 1 --2- 172.21.15.146:0/1002501299 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f59680ab010 0x7f59680b2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:42.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:42.119+0000 7f596cb13700 1 --2- 172.21.15.146:0/1002501299 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59680cc240 0x7f5968151a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:42.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:42.120+0000 7f596cb13700 1 -- 172.21.15.146:0/1002501299 >> 172.21.15.146:0/1002501299 conn(0x7f5968067c50 msgr2=0x7f5968154040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:42.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:42.120+0000 7f596cb13700 1 -- 172.21.15.146:0/1002501299 shutdown_connections 2023-10-06T11:10:42.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:42.120+0000 7f596cb13700 1 -- 172.21.15.146:0/1002501299 wait complete. 2023-10-06T11:10:42.125 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:10:42.134 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":220,"stamp":"2023-10-06T11:10:41.204013+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591904,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":171,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":100,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2443800,"kb_used_data":8152,"kb_used_omap":0,"kb_used_meta":2435584,"kb_avail":752530920,"statfs":{"total":773094113280,"available":770591662080,"internally_reserved":0,"allocated":8347648,"data_stored":4377152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2494038016},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1536,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000981"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.552335+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:38:35.257233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.554801+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:22:51.093918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.562062+0000","last_change":"2023-10-06T11:10:36.562062+0000","last_active":"2023-10-06T11:10:36.562062+0000","last_peered":"2023-10-06T11:10:36.562062+0000","last_clean":"2023-10-06T11:10:36.562062+0000","last_became_active":"2023-10-06T11:10:36.561650+0000","last_became_peered":"2023-10-06T11:10:36.561650+0000","last_unstale":"2023-10-06T11:10:36.562062+0000","last_undegraded":"2023-10-06T11:10:36.562062+0000","last_fullsized":"2023-10-06T11:10:36.562062+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:01.339658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.549185+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:09.031116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.553578+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:45:24.551243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.553611+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:20.836849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.571352+0000","last_change":"2023-10-06T11:10:36.571352+0000","last_active":"2023-10-06T11:10:36.571352+0000","last_peered":"2023-10-06T11:10:36.571352+0000","last_clean":"2023-10-06T11:10:36.571352+0000","last_became_active":"2023-10-06T11:10:36.570697+0000","last_became_peered":"2023-10-06T11:10:36.570697+0000","last_unstale":"2023-10-06T11:10:36.571352+0000","last_undegraded":"2023-10-06T11:10:36.571352+0000","last_fullsized":"2023-10-06T11:10:36.571352+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:03:22.794550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.555782+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:00:33.203307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.564345+0000","last_change":"2023-10-06T11:10:36.564345+0000","last_active":"2023-10-06T11:10:36.564345+0000","last_peered":"2023-10-06T11:10:36.564345+0000","last_clean":"2023-10-06T11:10:36.564345+0000","last_became_active":"2023-10-06T11:10:36.562959+0000","last_became_peered":"2023-10-06T11:10:36.562959+0000","last_unstale":"2023-10-06T11:10:36.564345+0000","last_undegraded":"2023-10-06T11:10:36.564345+0000","last_fullsized":"2023-10-06T11:10:36.564345+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:09.031116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.548825+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:42.231134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.554210+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:55.429899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.548679+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:17:13.424540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.552957+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:39.156883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.553145+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:12:14.376199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.556432+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:55.888185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.552348+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:26:32.606626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.555261+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:09:50.794839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.571620+0000","last_change":"2023-10-06T11:10:36.571620+0000","last_active":"2023-10-06T11:10:36.571620+0000","last_peered":"2023-10-06T11:10:36.571620+0000","last_clean":"2023-10-06T11:10:36.571620+0000","last_became_active":"2023-10-06T11:10:36.571361+0000","last_became_peered":"2023-10-06T11:10:36.571361+0000","last_unstale":"2023-10-06T11:10:36.571620+0000","last_undegraded":"2023-10-06T11:10:36.571620+0000","last_fullsized":"2023-10-06T11:10:36.571620+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:11:53.044428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.552595+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:24:07.541940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.554842+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:01:59.255497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.565345+0000","last_change":"2023-10-06T11:10:36.565345+0000","last_active":"2023-10-06T11:10:36.565345+0000","last_peered":"2023-10-06T11:10:36.565345+0000","last_clean":"2023-10-06T11:10:36.565345+0000","last_became_active":"2023-10-06T11:10:36.564007+0000","last_became_peered":"2023-10-06T11:10:36.564007+0000","last_unstale":"2023-10-06T11:10:36.565345+0000","last_undegraded":"2023-10-06T11:10:36.565345+0000","last_fullsized":"2023-10-06T11:10:36.565345+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:07.338879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.553928+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:30:57.876539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.564288+0000","last_change":"2023-10-06T11:10:36.564288+0000","last_active":"2023-10-06T11:10:36.564288+0000","last_peered":"2023-10-06T11:10:36.564288+0000","last_clean":"2023-10-06T11:10:36.564288+0000","last_became_active":"2023-10-06T11:10:36.563482+0000","last_became_peered":"2023-10-06T11:10:36.563482+0000","last_unstale":"2023-10-06T11:10:36.564288+0000","last_undegraded":"2023-10-06T11:10:36.564288+0000","last_fullsized":"2023-10-06T11:10:36.564288+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:56:23.575265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.554368+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:35.094726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.554089+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:09.293990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.548095+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:49:54.089077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.553169+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:20.836849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.554359+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:57:30.963073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.554210+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:15:56.228848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.553038+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:12:14.376199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.563437+0000","last_change":"2023-10-06T11:10:36.563437+0000","last_active":"2023-10-06T11:10:36.563437+0000","last_peered":"2023-10-06T11:10:36.563437+0000","last_clean":"2023-10-06T11:10:36.563437+0000","last_became_active":"2023-10-06T11:10:36.563170+0000","last_became_peered":"2023-10-06T11:10:36.563170+0000","last_unstale":"2023-10-06T11:10:36.563437+0000","last_undegraded":"2023-10-06T11:10:36.563437+0000","last_fullsized":"2023-10-06T11:10:36.563437+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:26.706783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.551771+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:24:07.541940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.568203+0000","last_change":"2023-10-06T11:10:36.568203+0000","last_active":"2023-10-06T11:10:36.568203+0000","last_peered":"2023-10-06T11:10:36.568203+0000","last_clean":"2023-10-06T11:10:36.568203+0000","last_became_active":"2023-10-06T11:10:36.567772+0000","last_became_peered":"2023-10-06T11:10:36.567772+0000","last_unstale":"2023-10-06T11:10:36.568203+0000","last_undegraded":"2023-10-06T11:10:36.568203+0000","last_fullsized":"2023-10-06T11:10:36.568203+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:14:16.648125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.564448+0000","last_change":"2023-10-06T11:10:35.564448+0000","last_active":"2023-10-06T11:10:35.564448+0000","last_peered":"2023-10-06T11:10:35.564448+0000","last_clean":"2023-10-06T11:10:35.564448+0000","last_became_active":"2023-10-06T11:10:35.564175+0000","last_became_peered":"2023-10-06T11:10:35.564175+0000","last_unstale":"2023-10-06T11:10:35.564448+0000","last_undegraded":"2023-10-06T11:10:35.564448+0000","last_fullsized":"2023-10-06T11:10:35.564448+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:06:11.497822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.551757+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:20.836849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.561010+0000","last_change":"2023-10-06T11:10:35.561010+0000","last_active":"2023-10-06T11:10:35.561010+0000","last_peered":"2023-10-06T11:10:35.561010+0000","last_clean":"2023-10-06T11:10:35.561010+0000","last_became_active":"2023-10-06T11:10:35.560718+0000","last_became_peered":"2023-10-06T11:10:35.560718+0000","last_unstale":"2023-10-06T11:10:35.561010+0000","last_undegraded":"2023-10-06T11:10:35.561010+0000","last_fullsized":"2023-10-06T11:10:35.561010+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:35.057797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.564783+0000","last_change":"2023-10-06T11:10:36.564783+0000","last_active":"2023-10-06T11:10:36.564783+0000","last_peered":"2023-10-06T11:10:36.564783+0000","last_clean":"2023-10-06T11:10:36.564783+0000","last_became_active":"2023-10-06T11:10:36.564112+0000","last_became_peered":"2023-10-06T11:10:36.564112+0000","last_unstale":"2023-10-06T11:10:36.564783+0000","last_undegraded":"2023-10-06T11:10:36.564783+0000","last_fullsized":"2023-10-06T11:10:36.564783+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:17:13.424540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.561374+0000","last_change":"2023-10-06T11:10:35.561374+0000","last_active":"2023-10-06T11:10:35.561374+0000","last_peered":"2023-10-06T11:10:35.561374+0000","last_clean":"2023-10-06T11:10:35.561374+0000","last_became_active":"2023-10-06T11:10:35.561034+0000","last_became_peered":"2023-10-06T11:10:35.561034+0000","last_unstale":"2023-10-06T11:10:35.561374+0000","last_undegraded":"2023-10-06T11:10:35.561374+0000","last_fullsized":"2023-10-06T11:10:35.561374+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:54:52.795843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.563943+0000","last_change":"2023-10-06T11:10:36.563943+0000","last_active":"2023-10-06T11:10:36.563943+0000","last_peered":"2023-10-06T11:10:36.563943+0000","last_clean":"2023-10-06T11:10:36.563943+0000","last_became_active":"2023-10-06T11:10:36.563685+0000","last_became_peered":"2023-10-06T11:10:36.563685+0000","last_unstale":"2023-10-06T11:10:36.563943+0000","last_undegraded":"2023-10-06T11:10:36.563943+0000","last_fullsized":"2023-10-06T11:10:36.563943+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:10:01.462268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"74'2","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.576935+0000","last_change":"2023-10-06T11:10:35.558480+0000","last_active":"2023-10-06T11:10:36.576935+0000","last_peered":"2023-10-06T11:10:36.576935+0000","last_clean":"2023-10-06T11:10:36.576935+0000","last_became_active":"2023-10-06T11:10:35.557916+0000","last_became_peered":"2023-10-06T11:10:35.557916+0000","last_unstale":"2023-10-06T11:10:36.576935+0000","last_undegraded":"2023-10-06T11:10:36.576935+0000","last_fullsized":"2023-10-06T11:10:36.576935+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:43.125026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.552197+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:21:08.092457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"74'1","reported_seq":10,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.555583+0000","last_change":"2023-10-06T11:10:35.563076+0000","last_active":"2023-10-06T11:10:36.555583+0000","last_peered":"2023-10-06T11:10:36.555583+0000","last_clean":"2023-10-06T11:10:36.555583+0000","last_became_active":"2023-10-06T11:10:35.561203+0000","last_became_peered":"2023-10-06T11:10:35.561203+0000","last_unstale":"2023-10-06T11:10:36.555583+0000","last_undegraded":"2023-10-06T11:10:36.555583+0000","last_fullsized":"2023-10-06T11:10:36.555583+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:56:40.528482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.551707+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:12:14.376199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.556455+0000","last_change":"2023-10-06T11:10:35.556455+0000","last_active":"2023-10-06T11:10:35.556455+0000","last_peered":"2023-10-06T11:10:35.556455+0000","last_clean":"2023-10-06T11:10:35.556455+0000","last_became_active":"2023-10-06T11:10:35.556167+0000","last_became_peered":"2023-10-06T11:10:35.556167+0000","last_unstale":"2023-10-06T11:10:35.556455+0000","last_undegraded":"2023-10-06T11:10:35.556455+0000","last_fullsized":"2023-10-06T11:10:35.556455+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:25.699995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.566820+0000","last_change":"2023-10-06T11:10:36.566820+0000","last_active":"2023-10-06T11:10:36.566820+0000","last_peered":"2023-10-06T11:10:36.566820+0000","last_clean":"2023-10-06T11:10:36.566820+0000","last_became_active":"2023-10-06T11:10:36.566558+0000","last_became_peered":"2023-10-06T11:10:36.566558+0000","last_unstale":"2023-10-06T11:10:36.566820+0000","last_undegraded":"2023-10-06T11:10:36.566820+0000","last_fullsized":"2023-10-06T11:10:36.566820+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:42.231134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.559140+0000","last_change":"2023-10-06T11:10:35.559140+0000","last_active":"2023-10-06T11:10:35.559140+0000","last_peered":"2023-10-06T11:10:35.559140+0000","last_clean":"2023-10-06T11:10:35.559140+0000","last_became_active":"2023-10-06T11:10:35.558843+0000","last_became_peered":"2023-10-06T11:10:35.558843+0000","last_unstale":"2023-10-06T11:10:35.559140+0000","last_undegraded":"2023-10-06T11:10:35.559140+0000","last_fullsized":"2023-10-06T11:10:35.559140+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:59:57.232416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.571387+0000","last_change":"2023-10-06T11:10:36.571387+0000","last_active":"2023-10-06T11:10:36.571387+0000","last_peered":"2023-10-06T11:10:36.571387+0000","last_clean":"2023-10-06T11:10:36.571387+0000","last_became_active":"2023-10-06T11:10:36.571001+0000","last_became_peered":"2023-10-06T11:10:36.571001+0000","last_unstale":"2023-10-06T11:10:36.571387+0000","last_undegraded":"2023-10-06T11:10:36.571387+0000","last_fullsized":"2023-10-06T11:10:36.571387+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:22:25.424782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.566163+0000","last_change":"2023-10-06T11:10:35.566163+0000","last_active":"2023-10-06T11:10:35.566163+0000","last_peered":"2023-10-06T11:10:35.566163+0000","last_clean":"2023-10-06T11:10:35.566163+0000","last_became_active":"2023-10-06T11:10:35.565869+0000","last_became_peered":"2023-10-06T11:10:35.565869+0000","last_unstale":"2023-10-06T11:10:35.566163+0000","last_undegraded":"2023-10-06T11:10:35.566163+0000","last_fullsized":"2023-10-06T11:10:35.566163+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:20:09.758618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.551700+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:20:30.493152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.561963+0000","last_change":"2023-10-06T11:10:35.561963+0000","last_active":"2023-10-06T11:10:35.561963+0000","last_peered":"2023-10-06T11:10:35.561963+0000","last_clean":"2023-10-06T11:10:35.561963+0000","last_became_active":"2023-10-06T11:10:35.561673+0000","last_became_peered":"2023-10-06T11:10:35.561673+0000","last_unstale":"2023-10-06T11:10:35.561963+0000","last_undegraded":"2023-10-06T11:10:35.561963+0000","last_fullsized":"2023-10-06T11:10:35.561963+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:16:25.755999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.548736+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:24:29.252009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.558239+0000","last_change":"2023-10-06T11:10:35.558239+0000","last_active":"2023-10-06T11:10:35.558239+0000","last_peered":"2023-10-06T11:10:35.558239+0000","last_clean":"2023-10-06T11:10:35.558239+0000","last_became_active":"2023-10-06T11:10:35.557904+0000","last_became_peered":"2023-10-06T11:10:35.557904+0000","last_unstale":"2023-10-06T11:10:35.558239+0000","last_undegraded":"2023-10-06T11:10:35.558239+0000","last_fullsized":"2023-10-06T11:10:35.558239+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:48:30.196153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.552701+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:20:30.493152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.562574+0000","last_change":"2023-10-06T11:10:35.562574+0000","last_active":"2023-10-06T11:10:35.562574+0000","last_peered":"2023-10-06T11:10:35.562574+0000","last_clean":"2023-10-06T11:10:35.562574+0000","last_became_active":"2023-10-06T11:10:35.562340+0000","last_became_peered":"2023-10-06T11:10:35.562340+0000","last_unstale":"2023-10-06T11:10:35.562574+0000","last_undegraded":"2023-10-06T11:10:35.562574+0000","last_fullsized":"2023-10-06T11:10:35.562574+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:04:45.233259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.558905+0000","last_change":"2023-10-06T11:10:36.558905+0000","last_active":"2023-10-06T11:10:36.558905+0000","last_peered":"2023-10-06T11:10:36.558905+0000","last_clean":"2023-10-06T11:10:36.558905+0000","last_became_active":"2023-10-06T11:10:36.558656+0000","last_became_peered":"2023-10-06T11:10:36.558656+0000","last_unstale":"2023-10-06T11:10:36.558905+0000","last_undegraded":"2023-10-06T11:10:36.558905+0000","last_fullsized":"2023-10-06T11:10:36.558905+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:05:23.675313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"74'6","reported_seq":15,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.577980+0000","last_change":"2023-10-06T11:10:35.565131+0000","last_active":"2023-10-06T11:10:36.577980+0000","last_peered":"2023-10-06T11:10:36.577980+0000","last_clean":"2023-10-06T11:10:36.577980+0000","last_became_active":"2023-10-06T11:10:35.564906+0000","last_became_peered":"2023-10-06T11:10:35.564906+0000","last_unstale":"2023-10-06T11:10:36.577980+0000","last_undegraded":"2023-10-06T11:10:36.577980+0000","last_fullsized":"2023-10-06T11:10:36.577980+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:17:20.645306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.548074+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:56:23.575265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.566952+0000","last_change":"2023-10-06T11:10:35.566952+0000","last_active":"2023-10-06T11:10:35.566952+0000","last_peered":"2023-10-06T11:10:35.566952+0000","last_clean":"2023-10-06T11:10:35.566952+0000","last_became_active":"2023-10-06T11:10:35.566661+0000","last_became_peered":"2023-10-06T11:10:35.566661+0000","last_unstale":"2023-10-06T11:10:35.566952+0000","last_undegraded":"2023-10-06T11:10:35.566952+0000","last_fullsized":"2023-10-06T11:10:35.566952+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:05:22.668525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.566928+0000","last_change":"2023-10-06T11:10:36.566928+0000","last_active":"2023-10-06T11:10:36.566928+0000","last_peered":"2023-10-06T11:10:36.566928+0000","last_clean":"2023-10-06T11:10:36.566928+0000","last_became_active":"2023-10-06T11:10:36.566624+0000","last_became_peered":"2023-10-06T11:10:36.566624+0000","last_unstale":"2023-10-06T11:10:36.566928+0000","last_undegraded":"2023-10-06T11:10:36.566928+0000","last_fullsized":"2023-10-06T11:10:36.566928+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:26.706783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.563787+0000","last_change":"2023-10-06T11:10:35.563787+0000","last_active":"2023-10-06T11:10:35.563787+0000","last_peered":"2023-10-06T11:10:35.563787+0000","last_clean":"2023-10-06T11:10:35.563787+0000","last_became_active":"2023-10-06T11:10:35.563566+0000","last_became_peered":"2023-10-06T11:10:35.563566+0000","last_unstale":"2023-10-06T11:10:35.563787+0000","last_undegraded":"2023-10-06T11:10:35.563787+0000","last_fullsized":"2023-10-06T11:10:35.563787+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:06.332091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.574907+0000","last_change":"2023-10-06T11:10:36.574907+0000","last_active":"2023-10-06T11:10:36.574907+0000","last_peered":"2023-10-06T11:10:36.574907+0000","last_clean":"2023-10-06T11:10:36.574907+0000","last_became_active":"2023-10-06T11:10:36.571648+0000","last_became_peered":"2023-10-06T11:10:36.571648+0000","last_unstale":"2023-10-06T11:10:36.574907+0000","last_undegraded":"2023-10-06T11:10:36.574907+0000","last_fullsized":"2023-10-06T11:10:36.574907+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:05:23.675313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.564482+0000","last_change":"2023-10-06T11:10:35.564482+0000","last_active":"2023-10-06T11:10:35.564482+0000","last_peered":"2023-10-06T11:10:35.564482+0000","last_clean":"2023-10-06T11:10:35.564482+0000","last_became_active":"2023-10-06T11:10:35.564219+0000","last_became_peered":"2023-10-06T11:10:35.564219+0000","last_unstale":"2023-10-06T11:10:35.564482+0000","last_undegraded":"2023-10-06T11:10:35.564482+0000","last_fullsized":"2023-10-06T11:10:35.564482+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:47.836534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.575443+0000","last_change":"2023-10-06T11:10:36.575443+0000","last_active":"2023-10-06T11:10:36.575443+0000","last_peered":"2023-10-06T11:10:36.575443+0000","last_clean":"2023-10-06T11:10:36.575443+0000","last_became_active":"2023-10-06T11:10:36.575101+0000","last_became_peered":"2023-10-06T11:10:36.575101+0000","last_unstale":"2023-10-06T11:10:36.575443+0000","last_undegraded":"2023-10-06T11:10:36.575443+0000","last_fullsized":"2023-10-06T11:10:36.575443+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:48:31.202941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.556135+0000","last_change":"2023-10-06T11:10:35.556135+0000","last_active":"2023-10-06T11:10:35.556135+0000","last_peered":"2023-10-06T11:10:35.556135+0000","last_clean":"2023-10-06T11:10:35.556135+0000","last_became_active":"2023-10-06T11:10:35.555884+0000","last_became_peered":"2023-10-06T11:10:35.555884+0000","last_unstale":"2023-10-06T11:10:35.556135+0000","last_undegraded":"2023-10-06T11:10:35.556135+0000","last_fullsized":"2023-10-06T11:10:35.556135+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:24:06.535152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.566853+0000","last_change":"2023-10-06T11:10:36.566853+0000","last_active":"2023-10-06T11:10:36.566853+0000","last_peered":"2023-10-06T11:10:36.566853+0000","last_clean":"2023-10-06T11:10:36.566853+0000","last_became_active":"2023-10-06T11:10:36.566589+0000","last_became_peered":"2023-10-06T11:10:36.566589+0000","last_unstale":"2023-10-06T11:10:36.566853+0000","last_undegraded":"2023-10-06T11:10:36.566853+0000","last_fullsized":"2023-10-06T11:10:36.566853+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:11:53.044428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.563007+0000","last_change":"2023-10-06T11:10:35.563007+0000","last_active":"2023-10-06T11:10:35.563007+0000","last_peered":"2023-10-06T11:10:35.563007+0000","last_clean":"2023-10-06T11:10:35.563007+0000","last_became_active":"2023-10-06T11:10:35.562469+0000","last_became_peered":"2023-10-06T11:10:35.562469+0000","last_unstale":"2023-10-06T11:10:35.563007+0000","last_undegraded":"2023-10-06T11:10:35.563007+0000","last_fullsized":"2023-10-06T11:10:35.563007+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:00.332870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.575103+0000","last_change":"2023-10-06T11:10:36.575103+0000","last_active":"2023-10-06T11:10:36.575103+0000","last_peered":"2023-10-06T11:10:36.575103+0000","last_clean":"2023-10-06T11:10:36.575103+0000","last_became_active":"2023-10-06T11:10:36.571536+0000","last_became_peered":"2023-10-06T11:10:36.571536+0000","last_unstale":"2023-10-06T11:10:36.575103+0000","last_undegraded":"2023-10-06T11:10:36.575103+0000","last_fullsized":"2023-10-06T11:10:36.575103+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:14:16.648125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.560230+0000","last_change":"2023-10-06T11:10:35.560230+0000","last_active":"2023-10-06T11:10:35.560230+0000","last_peered":"2023-10-06T11:10:35.560230+0000","last_clean":"2023-10-06T11:10:35.560230+0000","last_became_active":"2023-10-06T11:10:35.559955+0000","last_became_peered":"2023-10-06T11:10:35.559955+0000","last_unstale":"2023-10-06T11:10:35.560230+0000","last_undegraded":"2023-10-06T11:10:35.560230+0000","last_fullsized":"2023-10-06T11:10:35.560230+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:58.839836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.564609+0000","last_change":"2023-10-06T11:10:36.564609+0000","last_active":"2023-10-06T11:10:36.564609+0000","last_peered":"2023-10-06T11:10:36.564609+0000","last_clean":"2023-10-06T11:10:36.564609+0000","last_became_active":"2023-10-06T11:10:36.563769+0000","last_became_peered":"2023-10-06T11:10:36.563769+0000","last_unstale":"2023-10-06T11:10:36.564609+0000","last_undegraded":"2023-10-06T11:10:36.564609+0000","last_fullsized":"2023-10-06T11:10:36.564609+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:49:54.089077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.566590+0000","last_change":"2023-10-06T11:10:35.566590+0000","last_active":"2023-10-06T11:10:35.566590+0000","last_peered":"2023-10-06T11:10:35.566590+0000","last_clean":"2023-10-06T11:10:35.566590+0000","last_became_active":"2023-10-06T11:10:35.566333+0000","last_became_peered":"2023-10-06T11:10:35.566333+0000","last_unstale":"2023-10-06T11:10:35.566590+0000","last_undegraded":"2023-10-06T11:10:35.566590+0000","last_fullsized":"2023-10-06T11:10:35.566590+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:53:16.617219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.552115+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:26:32.606626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.561355+0000","last_change":"2023-10-06T11:10:35.561355+0000","last_active":"2023-10-06T11:10:35.561355+0000","last_peered":"2023-10-06T11:10:35.561355+0000","last_clean":"2023-10-06T11:10:35.561355+0000","last_became_active":"2023-10-06T11:10:35.560750+0000","last_became_peered":"2023-10-06T11:10:35.560750+0000","last_unstale":"2023-10-06T11:10:35.561355+0000","last_undegraded":"2023-10-06T11:10:35.561355+0000","last_fullsized":"2023-10-06T11:10:35.561355+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:58.839836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.575237+0000","last_change":"2023-10-06T11:10:36.575237+0000","last_active":"2023-10-06T11:10:36.575237+0000","last_peered":"2023-10-06T11:10:36.575237+0000","last_clean":"2023-10-06T11:10:36.575237+0000","last_became_active":"2023-10-06T11:10:36.574982+0000","last_became_peered":"2023-10-06T11:10:36.574982+0000","last_unstale":"2023-10-06T11:10:36.575237+0000","last_undegraded":"2023-10-06T11:10:36.575237+0000","last_fullsized":"2023-10-06T11:10:36.575237+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:01.339658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.560484+0000","last_change":"2023-10-06T11:10:35.558225+0000","last_active":"2023-10-06T11:10:35.560484+0000","last_peered":"2023-10-06T11:10:35.560484+0000","last_clean":"2023-10-06T11:10:35.560484+0000","last_became_active":"2023-10-06T11:10:35.557900+0000","last_became_peered":"2023-10-06T11:10:35.557900+0000","last_unstale":"2023-10-06T11:10:35.560484+0000","last_undegraded":"2023-10-06T11:10:35.560484+0000","last_fullsized":"2023-10-06T11:10:35.560484+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:35:59.639899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.563208+0000","last_change":"2023-10-06T11:10:36.563208+0000","last_active":"2023-10-06T11:10:36.563208+0000","last_peered":"2023-10-06T11:10:36.563208+0000","last_clean":"2023-10-06T11:10:36.563208+0000","last_became_active":"2023-10-06T11:10:36.562940+0000","last_became_peered":"2023-10-06T11:10:36.562940+0000","last_unstale":"2023-10-06T11:10:36.563208+0000","last_undegraded":"2023-10-06T11:10:36.563208+0000","last_fullsized":"2023-10-06T11:10:36.563208+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:56:41.535270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.561390+0000","last_change":"2023-10-06T11:10:35.561390+0000","last_active":"2023-10-06T11:10:35.561390+0000","last_peered":"2023-10-06T11:10:35.561390+0000","last_clean":"2023-10-06T11:10:35.561390+0000","last_became_active":"2023-10-06T11:10:35.561115+0000","last_became_peered":"2023-10-06T11:10:35.561115+0000","last_unstale":"2023-10-06T11:10:35.561390+0000","last_undegraded":"2023-10-06T11:10:35.561390+0000","last_fullsized":"2023-10-06T11:10:35.561390+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:01.065689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.563759+0000","last_change":"2023-10-06T11:10:36.563759+0000","last_active":"2023-10-06T11:10:36.563759+0000","last_peered":"2023-10-06T11:10:36.563759+0000","last_clean":"2023-10-06T11:10:36.563759+0000","last_became_active":"2023-10-06T11:10:36.563501+0000","last_became_peered":"2023-10-06T11:10:36.563501+0000","last_unstale":"2023-10-06T11:10:36.563759+0000","last_undegraded":"2023-10-06T11:10:36.563759+0000","last_fullsized":"2023-10-06T11:10:36.563759+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:08.343433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.566866+0000","last_change":"2023-10-06T11:10:35.564323+0000","last_active":"2023-10-06T11:10:35.566866+0000","last_peered":"2023-10-06T11:10:35.566866+0000","last_clean":"2023-10-06T11:10:35.566866+0000","last_became_active":"2023-10-06T11:10:35.564037+0000","last_became_peered":"2023-10-06T11:10:35.564037+0000","last_unstale":"2023-10-06T11:10:35.566866+0000","last_undegraded":"2023-10-06T11:10:35.566866+0000","last_fullsized":"2023-10-06T11:10:35.566866+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:28:03.257860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.567132+0000","last_change":"2023-10-06T11:10:36.567132+0000","last_active":"2023-10-06T11:10:36.567132+0000","last_peered":"2023-10-06T11:10:36.567132+0000","last_clean":"2023-10-06T11:10:36.567132+0000","last_became_active":"2023-10-06T11:10:36.566866+0000","last_became_peered":"2023-10-06T11:10:36.566866+0000","last_unstale":"2023-10-06T11:10:36.567132+0000","last_undegraded":"2023-10-06T11:10:36.567132+0000","last_fullsized":"2023-10-06T11:10:36.567132+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:48:31.202941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.562021+0000","last_change":"2023-10-06T11:10:35.552191+0000","last_active":"2023-10-06T11:10:35.562021+0000","last_peered":"2023-10-06T11:10:35.562021+0000","last_clean":"2023-10-06T11:10:35.562021+0000","last_became_active":"2023-10-06T11:10:35.551916+0000","last_became_peered":"2023-10-06T11:10:35.551916+0000","last_unstale":"2023-10-06T11:10:35.562021+0000","last_undegraded":"2023-10-06T11:10:35.562021+0000","last_fullsized":"2023-10-06T11:10:35.562021+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:07:42.227450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.552863+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:26:32.606626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.566516+0000","last_change":"2023-10-06T11:10:35.566516+0000","last_active":"2023-10-06T11:10:35.566516+0000","last_peered":"2023-10-06T11:10:35.566516+0000","last_clean":"2023-10-06T11:10:35.566516+0000","last_became_active":"2023-10-06T11:10:35.566258+0000","last_became_peered":"2023-10-06T11:10:35.566258+0000","last_unstale":"2023-10-06T11:10:35.566516+0000","last_undegraded":"2023-10-06T11:10:35.566516+0000","last_fullsized":"2023-10-06T11:10:35.566516+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:16:46.568672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":63,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.560581+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:10:35.560581+0000","last_peered":"2023-10-06T11:10:35.560581+0000","last_clean":"2023-10-06T11:10:35.560581+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:10:35.560581+0000","last_undegraded":"2023-10-06T11:10:35.560581+0000","last_fullsized":"2023-10-06T11:10:35.560581+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.553024+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:12:36.084850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"74'2","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.567133+0000","last_change":"2023-10-06T11:10:35.565002+0000","last_active":"2023-10-06T11:10:36.567133+0000","last_peered":"2023-10-06T11:10:36.567133+0000","last_clean":"2023-10-06T11:10:36.567133+0000","last_became_active":"2023-10-06T11:10:35.564718+0000","last_became_peered":"2023-10-06T11:10:35.564718+0000","last_unstale":"2023-10-06T11:10:36.567133+0000","last_undegraded":"2023-10-06T11:10:36.567133+0000","last_fullsized":"2023-10-06T11:10:36.567133+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:12:22.762358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":59,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-10-06T11:10:34.543614+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:10:34.543614+0000","last_peered":"2023-10-06T11:10:34.543614+0000","last_clean":"2023-10-06T11:10:34.543614+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:10:34.543614+0000","last_undegraded":"2023-10-06T11:10:34.543614+0000","last_fullsized":"2023-10-06T11:10:34.543614+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.551941+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:24:04.262059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.561062+0000","last_change":"2023-10-06T11:10:35.561062+0000","last_active":"2023-10-06T11:10:35.561062+0000","last_peered":"2023-10-06T11:10:35.561062+0000","last_clean":"2023-10-06T11:10:35.561062+0000","last_became_active":"2023-10-06T11:10:35.560873+0000","last_became_peered":"2023-10-06T11:10:35.560873+0000","last_unstale":"2023-10-06T11:10:35.561062+0000","last_undegraded":"2023-10-06T11:10:35.561062+0000","last_fullsized":"2023-10-06T11:10:35.561062+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:54:52.795843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":57,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.546220+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:10:35.546220+0000","last_peered":"2023-10-06T11:10:35.546220+0000","last_clean":"2023-10-06T11:10:35.546220+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:10:35.546220+0000","last_undegraded":"2023-10-06T11:10:35.546220+0000","last_fullsized":"2023-10-06T11:10:35.546220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":203,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-10-06T11:10:34.546553+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:10:34.546553+0000","last_peered":"2023-10-06T11:10:34.546553+0000","last_clean":"2023-10-06T11:10:34.546553+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:10:34.546553+0000","last_undegraded":"2023-10-06T11:10:34.546553+0000","last_fullsized":"2023-10-06T11:10:34.546553+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":8,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.575734+0000","last_change":"2023-10-06T11:10:36.575734+0000","last_active":"2023-10-06T11:10:36.575734+0000","last_peered":"2023-10-06T11:10:36.575734+0000","last_clean":"2023-10-06T11:10:36.575734+0000","last_became_active":"2023-10-06T11:10:36.575475+0000","last_became_peered":"2023-10-06T11:10:36.575475+0000","last_unstale":"2023-10-06T11:10:36.575734+0000","last_undegraded":"2023-10-06T11:10:36.575734+0000","last_fullsized":"2023-10-06T11:10:36.575734+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:08.343433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.560631+0000","last_change":"2023-10-06T11:10:35.560631+0000","last_active":"2023-10-06T11:10:35.560631+0000","last_peered":"2023-10-06T11:10:35.560631+0000","last_clean":"2023-10-06T11:10:35.560631+0000","last_became_active":"2023-10-06T11:10:35.560377+0000","last_became_peered":"2023-10-06T11:10:35.560377+0000","last_unstale":"2023-10-06T11:10:35.560631+0000","last_undegraded":"2023-10-06T11:10:35.560631+0000","last_fullsized":"2023-10-06T11:10:35.560631+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:16:25.755999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":53,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-10-06T11:10:34.547219+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:10:34.547219+0000","last_peered":"2023-10-06T11:10:34.547219+0000","last_clean":"2023-10-06T11:10:34.547219+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:10:34.547219+0000","last_undegraded":"2023-10-06T11:10:34.547219+0000","last_fullsized":"2023-10-06T11:10:34.547219+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.552732+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:20:30.493152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.560592+0000","last_change":"2023-10-06T11:10:35.560592+0000","last_active":"2023-10-06T11:10:35.560592+0000","last_peered":"2023-10-06T11:10:35.560592+0000","last_clean":"2023-10-06T11:10:35.560592+0000","last_became_active":"2023-10-06T11:10:35.560329+0000","last_became_peered":"2023-10-06T11:10:35.560329+0000","last_unstale":"2023-10-06T11:10:35.560592+0000","last_undegraded":"2023-10-06T11:10:35.560592+0000","last_fullsized":"2023-10-06T11:10:35.560592+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:58.839836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":53,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-10-06T11:10:34.546588+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:10:34.546588+0000","last_peered":"2023-10-06T11:10:34.546588+0000","last_clean":"2023-10-06T11:10:34.546588+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:10:34.546588+0000","last_undegraded":"2023-10-06T11:10:34.546588+0000","last_fullsized":"2023-10-06T11:10:34.546588+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.551778+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:06:36.489499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.562699+0000","last_change":"2023-10-06T11:10:35.562699+0000","last_active":"2023-10-06T11:10:35.562699+0000","last_peered":"2023-10-06T11:10:35.562699+0000","last_clean":"2023-10-06T11:10:35.562699+0000","last_became_active":"2023-10-06T11:10:35.562460+0000","last_became_peered":"2023-10-06T11:10:35.562460+0000","last_unstale":"2023-10-06T11:10:35.562699+0000","last_undegraded":"2023-10-06T11:10:35.562699+0000","last_fullsized":"2023-10-06T11:10:35.562699+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:35.057797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":64,"reported_epoch":72,"state":"active+clean","last_fresh":"2023-10-06T11:10:34.542867+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:10:34.542867+0000","last_peered":"2023-10-06T11:10:34.542867+0000","last_clean":"2023-10-06T11:10:34.542867+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:10:34.542867+0000","last_undegraded":"2023-10-06T11:10:34.542867+0000","last_fullsized":"2023-10-06T11:10:34.542867+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.552588+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:38:35.257233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.563502+0000","last_change":"2023-10-06T11:10:35.558406+0000","last_active":"2023-10-06T11:10:35.563502+0000","last_peered":"2023-10-06T11:10:35.563502+0000","last_clean":"2023-10-06T11:10:35.563502+0000","last_became_active":"2023-10-06T11:10:35.558197+0000","last_became_peered":"2023-10-06T11:10:35.558197+0000","last_unstale":"2023-10-06T11:10:35.563502+0000","last_undegraded":"2023-10-06T11:10:35.563502+0000","last_fullsized":"2023-10-06T11:10:35.563502+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:54:06.008551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":58,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.550516+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:10:35.550516+0000","last_peered":"2023-10-06T11:10:35.550516+0000","last_clean":"2023-10-06T11:10:35.550516+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:10:35.550516+0000","last_undegraded":"2023-10-06T11:10:35.550516+0000","last_fullsized":"2023-10-06T11:10:35.550516+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:10:35.538922+0000","last_change":"2023-10-06T11:10:35.553478+0000","last_active":"2023-10-06T11:10:35.538922+0000","last_peered":"2023-10-06T11:10:35.538922+0000","last_clean":"2023-10-06T11:10:35.538922+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:10:35.538922+0000","last_undegraded":"2023-10-06T11:10:35.538922+0000","last_fullsized":"2023-10-06T11:10:35.538922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:14:01.696915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":8,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.565730+0000","last_change":"2023-10-06T11:10:35.565730+0000","last_active":"2023-10-06T11:10:35.565730+0000","last_peered":"2023-10-06T11:10:35.565730+0000","last_clean":"2023-10-06T11:10:35.565730+0000","last_became_active":"2023-10-06T11:10:35.565461+0000","last_became_peered":"2023-10-06T11:10:35.565461+0000","last_unstale":"2023-10-06T11:10:35.565730+0000","last_undegraded":"2023-10-06T11:10:35.565730+0000","last_fullsized":"2023-10-06T11:10:35.565730+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:16:47.518450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":58,"reported_epoch":73,"state":"active+clean","last_fresh":"2023-10-06T11:10:35.550793+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:10:35.550793+0000","last_peered":"2023-10-06T11:10:35.550793+0000","last_clean":"2023-10-06T11:10:35.550793+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:10:35.550793+0000","last_undegraded":"2023-10-06T11:10:35.550793+0000","last_fullsized":"2023-10-06T11:10:35.550793+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":1536,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574911,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298736,"kb_used_data":1448,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073104,"statfs":{"total":96636764160,"available":96330858496,"internally_reserved":0,"allocated":1482752,"data_stored":988344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":0.872,"15min":0.61399999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":15.506,"5min":23.908999999999999,"15min":23.908999999999999},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.70599999999999996,"15min":0.59099999999999997},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":9.3230000000000004,"5min":9.3230000000000004,"15min":9.3230000000000004},"last":0.40100000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.63400000000000001,"15min":0.56899999999999995},"min":{"1min":0.29999999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71399999999999997,"5min":9.2360000000000007,"15min":9.2360000000000007},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.53200000000000003,"15min":0.51400000000000001},"min":{"1min":0.308,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.60399999999999998,"5min":4.327,"15min":4.327},"last":0.57499999999999996}]},{"osd":2,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.5,"15min":0.50800000000000001},"min":{"1min":0.33200000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.63500000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.59599999999999997,"15min":0.55800000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.74299999999999999,"5min":4.7309999999999999,"15min":4.7309999999999999},"last":0.47699999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.52000000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.7609999999999999,"5min":4.3540000000000001,"15min":4.3540000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.67500000000000004,"15min":0.60099999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.125,"5min":9.3879999999999999,"15min":9.3879999999999999},"last":0.61399999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.50800000000000001,"15min":0.47499999999999998},"min":{"1min":0.25,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.66100000000000003,"5min":4.5709999999999997,"15min":4.5709999999999997},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.54600000000000004,"15min":0.53100000000000003},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.71299999999999997,"5min":4.3129999999999997,"15min":4.3129999999999997},"last":0.50700000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.63300000000000001,"15min":0.57799999999999996},"min":{"1min":0.29399999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.84699999999999998,"5min":9.3499999999999996,"15min":9.3499999999999996},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.57499999999999996,"15min":0.56399999999999995},"min":{"1min":0.36099999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.77200000000000002,"5min":4.444,"15min":4.444},"last":0.64500000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.66400000000000003,"15min":0.61899999999999999},"min":{"1min":0.39200000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.81399999999999995,"5min":9.4969999999999999,"15min":9.4969999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.65600000000000003,"15min":0.61799999999999999},"min":{"1min":0.40300000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88200000000000001,"5min":7.2039999999999997,"15min":7.2039999999999997},"last":0.59099999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574913,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310464,"kb_used_data":888,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061376,"statfs":{"total":96636764160,"available":96318849024,"internally_reserved":0,"allocated":909312,"data_stored":405275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:42 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48199999999999998,"15min":0.497},"min":{"1min":0.23799999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.64300000000000002,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51500000000000001,"15min":0.53100000000000003},"min":{"1min":0.35899999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.63,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.39800000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:09:42 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.47899999999999998,"15min":0.498},"min":{"1min":0.26400000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.629,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.47499999999999998,"15min":0.496},"min":{"1min":0.379,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.55400000000000005,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.31900000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:09:42 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.53300000000000003,"15min":0.499},"min":{"1min":0.31900000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.65800000000000003,"5min":7.0659999999999998,"15min":7.0659999999999998},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.55700000000000005,"15min":0.52700000000000002},"min":{"1min":0.29899999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.75800000000000001,"5min":7.0819999999999999,"15min":7.0819999999999999},"last":0.44400000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:09:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.504,"15min":0.496},"min":{"1min":0.436,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.65500000000000003,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53100000000000003,"15min":0.53700000000000003},"min":{"1min":0.40000000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.72399999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.50800000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:09:42 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.47599999999999998,"15min":0.503},"min":{"1min":0.30399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.495},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.52400000000000002,"15min":0.56200000000000006},"min":{"1min":0.33100000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69399999999999995,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.42999999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:09:42 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51300000000000001,"15min":0.53500000000000003},"min":{"1min":0.313,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.69299999999999995,"5min":0.75,"15min":0.75},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54800000000000004,"15min":0.58199999999999996},"min":{"1min":0.34499999999999997,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78800000000000003,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.53700000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:09:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55600000000000005,"15min":0.57499999999999996},"min":{"1min":0.377,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71699999999999997,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58299999999999996,"15min":0.60499999999999998},"min":{"1min":0.36699999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.754,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.58399999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574912,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311044,"kb_used_data":1468,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060796,"statfs":{"total":96636764160,"available":96318255104,"internally_reserved":0,"allocated":1503232,"data_stored":995572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.33200000000000002,"15min":0.34200000000000003},"min":{"1min":0.24199999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.215,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.40999999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.34399999999999997,"15min":0.33600000000000002},"min":{"1min":0.23599999999999999,"5min":0.22,"15min":0.22},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.39600000000000002,"15min":0.38900000000000001},"min":{"1min":0.26500000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.38200000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.41399999999999998,"15min":0.41099999999999998},"min":{"1min":0.28299999999999997,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.68999999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.38100000000000001,"15min":0.36899999999999999},"min":{"1min":0.29799999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.33900000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.53000000000000003,"15min":0.50800000000000001},"min":{"1min":0.34399999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55800000000000005,"15min":0.54000000000000004},"min":{"1min":0.45300000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.68999999999999995}]},{"osd":5,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55900000000000005,"15min":0.54900000000000004},"min":{"1min":0.38800000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.56299999999999994,"15min":0.54100000000000004},"min":{"1min":0.40000000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.626}]},{"osd":6,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57199999999999995,"15min":0.56200000000000006},"min":{"1min":0.36899999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.59199999999999997,"15min":0.57399999999999995},"min":{"1min":0.376,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.73199999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.59999999999999998,"15min":0.58999999999999997},"min":{"1min":0.48699999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84299999999999997,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.42899999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.746}]}]},{"osd":0,"up_from":13,"seq":55834574911,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302248,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069592,"statfs":{"total":96636764160,"available":96327262208,"internally_reserved":0,"allocated":884736,"data_stored":396623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":1.9379999999999999,"5min":0.64700000000000002,"15min":0.44},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":36.097999999999999,"5min":36.097999999999999,"15min":36.097999999999999},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.35999999999999999,"15min":0.34699999999999998},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.39300000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":1.9810000000000001,"5min":0.69099999999999995,"15min":0.48299999999999998},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":36.07,"5min":36.07,"15min":36.07},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.40000000000000002,"15min":0.379},"min":{"1min":0.23200000000000001,"5min":0.219,"15min":0.219},"max":{"1min":5.125,"5min":5.125,"15min":5.125},"last":0.35199999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.44,"15min":0.39600000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":8.4130000000000003,"5min":8.4130000000000003,"15min":8.4130000000000003},"last":0.42499999999999999},{"interface":"front","average":{"1min":2.0030000000000001,"5min":0.74399999999999999,"15min":0.54200000000000004},"min":{"1min":0.30199999999999999,"5min":0.252,"15min":0.252},"max":{"1min":35.959000000000003,"5min":35.959000000000003,"15min":35.959000000000003},"last":0.371}]},{"osd":4,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.56799999999999995,"15min":0.56299999999999994},"min":{"1min":0.48199999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.61399999999999999},{"interface":"front","average":{"1min":2.2120000000000002,"5min":0.92700000000000005,"15min":0.72099999999999997},"min":{"1min":0.48999999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":36.005000000000003,"5min":36.005000000000003,"15min":36.005000000000003},"last":0.58899999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.55700000000000005,"15min":0.55400000000000005},"min":{"1min":0.433,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56299999999999994,"15min":0.54900000000000004},"min":{"1min":0.45700000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.64800000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":2.194,"5min":0.91900000000000004,"15min":0.71699999999999997},"min":{"1min":0.47199999999999998,"5min":0.375,"15min":0.375},"max":{"1min":36.037999999999997,"5min":36.037999999999997,"15min":36.037999999999997},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.63900000000000001,"15min":0.61699999999999999},"min":{"1min":0.434,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":4.8810000000000002,"5min":4.8810000000000002,"15min":4.8810000000000002},"last":0.57699999999999996}]},{"osd":7,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60599999999999998,"15min":0.60799999999999998},"min":{"1min":0.41499999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":2.3530000000000002,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.44500000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.56299999999999994}]}]},{"osd":2,"up_from":13,"seq":55834574912,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314536,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94057304,"statfs":{"total":96636764160,"available":96314679296,"internally_reserved":0,"allocated":884736,"data_stored":396623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.307,"15min":0.308},"min":{"1min":0.218,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.39700000000000002,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.375,"15min":0.38300000000000001},"min":{"1min":0.27700000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53300000000000003,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.32200000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36599999999999999,"15min":0.374},"min":{"1min":0.252,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56299999999999994,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.35399999999999998,"15min":0.34799999999999998},"min":{"1min":0.249,"5min":0.217,"15min":0.217},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.33400000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.36699999999999999,"15min":0.372},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.628,"5min":0.629,"15min":0.629},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.35899999999999999,"15min":0.36499999999999999},"min":{"1min":0.26200000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.47699999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.29499999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.36599999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.77500000000000002,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.502},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.42599999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72299999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.64400000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.35999999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.67600000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.623},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55700000000000005,"15min":0.55300000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72999999999999998,"5min":0.87,"15min":0.87},"last":0.49099999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76000000000000001,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57599999999999996,"15min":0.57799999999999996},"min":{"1min":0.39400000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.72199999999999998,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.53600000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56799999999999995,"15min":0.55300000000000005},"min":{"1min":0.40200000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.76600000000000001,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57299999999999995,"15min":0.57099999999999995},"min":{"1min":0.40200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73499999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.42599999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574912,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298152,"kb_used_data":864,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073688,"statfs":{"total":96636764160,"available":96331456512,"internally_reserved":0,"allocated":884736,"data_stored":396623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.313,"15min":0.32700000000000001},"min":{"1min":0.218,"5min":0.188,"15min":0.188},"max":{"1min":0.47099999999999997,"5min":1.095,"15min":1.095},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.38,"15min":0.40200000000000002},"min":{"1min":0.30399999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.52400000000000002,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.32500000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.313,"15min":0.309},"min":{"1min":0.23200000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.46899999999999997,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.35999999999999999,"15min":0.37},"min":{"1min":0.25900000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.48599999999999999,"5min":1.196,"15min":1.196},"last":0.33800000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.374,"15min":0.39200000000000002},"min":{"1min":0.26500000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.54000000000000004,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.40799999999999997,"15min":0.42199999999999999},"min":{"1min":0.32700000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.55900000000000005,"5min":1.224,"15min":1.224},"last":0.39500000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.55400000000000005,"15min":0.57399999999999995},"min":{"1min":0.41699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69399999999999995,"5min":1.694,"15min":1.694},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.54600000000000004,"15min":0.54800000000000004},"min":{"1min":0.46400000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.496}]},{"osd":5,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.54600000000000004,"15min":0.52800000000000002},"min":{"1min":0.436,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79400000000000004,"5min":0.878,"15min":0.878},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55900000000000005,"15min":0.56699999999999995},"min":{"1min":0.49399999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72699999999999998,"5min":1.165,"15min":1.165},"last":0.46400000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58699999999999997,"15min":0.59499999999999997},"min":{"1min":0.46200000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.81299999999999994,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.59599999999999997,"15min":0.60599999999999998},"min":{"1min":0.47099999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78000000000000003,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.51300000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58199999999999996,"15min":0.59599999999999997},"min":{"1min":0.44800000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.74199999999999999,"5min":1.657,"15min":1.657},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.47899999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83399999999999996,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.52300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574911,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298188,"kb_used_data":900,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073652,"statfs":{"total":96636764160,"available":96331419648,"internally_reserved":0,"allocated":921600,"data_stored":406732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.51800000000000002,"15min":0.59299999999999997},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.76600000000000001,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":0.443},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.49199999999999999,"15min":0.502},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.47099999999999997}]},{"osd":1,"last update":"Fri Oct 6 11:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.54400000000000004,"15min":0.61799999999999999},"min":{"1min":0.35999999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70899999999999996,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.499},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55300000000000005,"15min":0.621},"min":{"1min":0.33400000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.72399999999999998,"5min":2.7610000000000001,"15min":2.7610000000000001},"last":0.57399999999999995}]},{"osd":2,"last update":"Fri Oct 6 11:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.57699999999999996},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.78200000000000003,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58599999999999997,"15min":0.61799999999999999},"min":{"1min":0.45400000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.77400000000000002,"5min":1.718,"15min":1.718},"last":0.60499999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.57799999999999996,"15min":0.64000000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.753,"5min":2.677,"15min":2.677},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.51600000000000001,"15min":0.52600000000000002},"min":{"1min":0.36799999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.747,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.68200000000000005}]},{"osd":5,"last update":"Fri Oct 6 11:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.47099999999999997,"15min":0.497},"min":{"1min":0.33900000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.77600000000000002,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.52500000000000002,"15min":0.54700000000000004},"min":{"1min":0.35099999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.752}]},{"osd":6,"last update":"Fri Oct 6 11:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.51000000000000001,"15min":0.53400000000000003},"min":{"1min":0.34599999999999997,"5min":0.252,"15min":0.252},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54900000000000004,"15min":0.59099999999999997},"min":{"1min":0.40699999999999997,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.82099999999999995,"5min":1.165,"15min":1.165},"last":0.73199999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.55200000000000005,"15min":0.56200000000000006},"min":{"1min":0.378,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.59099999999999997,"15min":0.61599999999999999},"min":{"1min":0.437,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80800000000000005,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.70799999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574913,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310432,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061408,"statfs":{"total":96636764160,"available":96318881792,"internally_reserved":0,"allocated":876544,"data_stored":391360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.61799999999999999,"15min":0.70799999999999996},"min":{"1min":0.28399999999999997,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.69499999999999995,"5min":5.0490000000000004,"15min":5.0490000000000004},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.57599999999999996,"15min":0.67600000000000005},"min":{"1min":0.28100000000000003,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.64700000000000002,"5min":5.1449999999999996,"15min":5.1449999999999996},"last":0.47099999999999997}]},{"osd":1,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48499999999999999,"15min":0.49099999999999999},"min":{"1min":0.27500000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.75600000000000001,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.379},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52100000000000002,"15min":0.52900000000000003},"min":{"1min":0.30299999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.70999999999999996,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.55500000000000005}]},{"osd":2,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57899999999999996,"15min":0.56699999999999995},"min":{"1min":0.41299999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.74099999999999999,"5min":4.234,"15min":4.234},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56699999999999995,"15min":0.57699999999999996},"min":{"1min":0.40000000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72999999999999998,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.504}]},{"osd":3,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.61499999999999999,"15min":0.72699999999999998},"min":{"1min":0.32600000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.72099999999999997,"5min":5.2169999999999996,"15min":5.2169999999999996},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54900000000000004,"15min":0.55500000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.70199999999999996,"5min":1.008,"15min":1.008},"last":0.439}]},{"osd":4,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52200000000000002,"15min":0.53600000000000003},"min":{"1min":0.32700000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.745,"5min":1.917,"15min":1.917},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53700000000000003,"15min":0.55500000000000005},"min":{"1min":0.34399999999999997,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.68600000000000005,"5min":0.87,"15min":0.87},"last":0.34000000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56999999999999995,"15min":0.58099999999999996},"min":{"1min":0.34100000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.68700000000000006,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.61399999999999999,"15min":0.629},"min":{"1min":0.42199999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.77200000000000002,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":0.42399999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58399999999999996,"15min":0.60699999999999998},"min":{"1min":0.39600000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.70199999999999996,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61499999999999999,"15min":0.628},"min":{"1min":0.38700000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.72999999999999998,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.54000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:10:45.142 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:10:45.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.269+0000 7f6fc30f5700 1 Processor -- start 2023-10-06T11:10:45.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.269+0000 7f6fc30f5700 1 -- start start 2023-10-06T11:10:45.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.270+0000 7f6fc30f5700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6fbc153ab0 0x7f6fbc15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:45.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.270+0000 7f6fc30f5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6fbc068ba0 0x7f6fbc0b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:45.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.270+0000 7f6fc30f5700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fbc15ac30 con 0x7f6fbc153e80 2023-10-06T11:10:45.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.270+0000 7f6fc30f5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fbc0b4510 con 0x7f6fbc068ba0 2023-10-06T11:10:45.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.270+0000 7f6fc30f5700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fbc0b6530 con 0x7f6fbc153ab0 2023-10-06T11:10:45.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.270+0000 7f6fc1692700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6fbc068ba0 0x7f6fbc0b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:45.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.270+0000 7f6fc1692700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6fbc068ba0 0x7f6fbc0b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51010/0 (socket says 172.21.15.146:51010) 2023-10-06T11:10:45.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.270+0000 7f6fc1692700 1 -- 172.21.15.146:0/1439636682 learned_addr learned my addr 172.21.15.146:0/1439636682 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:45.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.270+0000 7f6fc0e91700 1 --2- 172.21.15.146:0/1439636682 >> v2:172.21.15.151:3300/0 conn(0x7f6fbc153ab0 0x7f6fbc15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:45.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.270+0000 7f6fc1692700 1 -- 172.21.15.146:0/1439636682 >> v2:172.21.15.151:3300/0 conn(0x7f6fbc153ab0 msgr2=0x7f6fbc15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:45.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.270+0000 7f6fc1692700 1 --2- 172.21.15.146:0/1439636682 >> v2:172.21.15.151:3300/0 conn(0x7f6fbc153ab0 0x7f6fbc15a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:45.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.270+0000 7f6fc1692700 1 -- 172.21.15.146:0/1439636682 >> v1:172.21.15.151:6789/0 conn(0x7f6fbc153e80 legacy=0x7f6fbc068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:45.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.270+0000 7f6fc1692700 1 -- 172.21.15.146:0/1439636682 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fbc0b5c50 con 0x7f6fbc068ba0 2023-10-06T11:10:45.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.270+0000 7f6fc1692700 1 --2- 172.21.15.146:0/1439636682 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fbc068ba0 0x7f6fbc0b49a0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc0b5eb0 tx=0x7f6fb4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d44f66978076988f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:45.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.270+0000 7f6fbb7fe700 1 -- 172.21.15.146:0/1439636682 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb400e070 con 0x7f6fbc068ba0 2023-10-06T11:10:45.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.271+0000 7f6fbb7fe700 1 -- 172.21.15.146:0/1439636682 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb400ba50 con 0x7f6fbc068ba0 2023-10-06T11:10:45.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.271+0000 7f6fbb7fe700 1 -- 172.21.15.146:0/1439636682 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb40092e0 con 0x7f6fbc068ba0 2023-10-06T11:10:45.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.271+0000 7f6fc30f5700 1 -- 172.21.15.146:0/1439636682 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fbc068ba0 msgr2=0x7f6fbc0b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:45.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.271+0000 7f6fc30f5700 1 --2- 172.21.15.146:0/1439636682 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fbc068ba0 0x7f6fbc0b49a0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc0b5eb0 tx=0x7f6fb4009840 comp rx=0 tx=0).stop 2023-10-06T11:10:45.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.271+0000 7f6fc30f5700 1 -- 172.21.15.146:0/1439636682 shutdown_connections 2023-10-06T11:10:45.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.271+0000 7f6fc30f5700 1 --2- 172.21.15.146:0/1439636682 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fbc068ba0 0x7f6fbc0b49a0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:45.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.271+0000 7f6fc30f5700 1 --2- 172.21.15.146:0/1439636682 >> v2:172.21.15.151:3300/0 conn(0x7f6fbc153ab0 0x7f6fbc15a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:45.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.271+0000 7f6fc30f5700 1 -- 172.21.15.146:0/1439636682 >> 172.21.15.146:0/1439636682 conn(0x7f6fbc06eba0 msgr2=0x7f6fbc06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:45.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.271+0000 7f6fc30f5700 1 -- 172.21.15.146:0/1439636682 shutdown_connections 2023-10-06T11:10:45.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.271+0000 7f6fc30f5700 1 -- 172.21.15.146:0/1439636682 wait complete. 2023-10-06T11:10:45.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.272+0000 7f6fc30f5700 1 Processor -- start 2023-10-06T11:10:45.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.272+0000 7f6fc30f5700 1 -- start start 2023-10-06T11:10:45.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.273+0000 7f6fc30f5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fbc068ba0 0x7f6fbc0c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:45.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.273+0000 7f6fc30f5700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6fbc153ab0 0x7f6fbc0c58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:45.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.273+0000 7f6fc30f5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fbc153e80 0x7f6fbc159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:45.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.273+0000 7f6fc30f5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fbc159490 con 0x7f6fbc068ba0 2023-10-06T11:10:45.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.273+0000 7f6fc30f5700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fbc158880 con 0x7f6fbc153e80 2023-10-06T11:10:45.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.273+0000 7f6fc30f5700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fbc158b60 con 0x7f6fbc153ab0 2023-10-06T11:10:45.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.273+0000 7f6fc0e91700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fbc068ba0 0x7f6fbc0c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:45.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.273+0000 7f6fc0e91700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fbc068ba0 0x7f6fbc0c53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51022/0 (socket says 172.21.15.146:51022) 2023-10-06T11:10:45.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.273+0000 7f6fc0e91700 1 -- 172.21.15.146:0/3757576992 learned_addr learned my addr 172.21.15.146:0/3757576992 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:45.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.273+0000 7f6fc0e91700 1 -- 172.21.15.146:0/3757576992 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6fbc153ab0 msgr2=0x7f6fbc0c58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:45.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.273+0000 7f6fc0e91700 1 --2- 172.21.15.146:0/3757576992 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6fbc153ab0 0x7f6fbc0c58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:45.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.273+0000 7f6fc0e91700 1 -- 172.21.15.146:0/3757576992 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fbc153e80 msgr2=0x7f6fbc159920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:45.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.273+0000 7f6fc0e91700 1 --2- 172.21.15.146:0/3757576992 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fbc153e80 0x7f6fbc159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:45.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.273+0000 7f6fc0e91700 1 -- 172.21.15.146:0/3757576992 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb4009ae0 con 0x7f6fbc068ba0 2023-10-06T11:10:45.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.274+0000 7f6fc0e91700 1 --2- 172.21.15.146:0/3757576992 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fbc068ba0 0x7f6fbc0c53a0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f6fb000d890 tx=0x7f6fb0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:45.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.274+0000 7f6fb8ff9700 1 -- 172.21.15.146:0/3757576992 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb000b600 con 0x7f6fbc068ba0 2023-10-06T11:10:45.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.274+0000 7f6fb8ff9700 1 -- 172.21.15.146:0/3757576992 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb000b760 con 0x7f6fbc068ba0 2023-10-06T11:10:45.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.274+0000 7f6fc30f5700 1 -- 172.21.15.146:0/3757576992 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fbc158e40 con 0x7f6fbc068ba0 2023-10-06T11:10:45.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.274+0000 7f6fb8ff9700 1 -- 172.21.15.146:0/3757576992 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb000bae0 con 0x7f6fbc068ba0 2023-10-06T11:10:45.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.274+0000 7f6fc30f5700 1 -- 172.21.15.146:0/3757576992 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fbc141860 con 0x7f6fbc068ba0 2023-10-06T11:10:45.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.275+0000 7f6fc30f5700 1 -- 172.21.15.146:0/3757576992 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fbc04c380 con 0x7f6fbc068ba0 2023-10-06T11:10:45.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.275+0000 7f6fb8ff9700 1 -- 172.21.15.146:0/3757576992 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6fb001e460 con 0x7f6fbc068ba0 2023-10-06T11:10:45.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.276+0000 7f6fb8ff9700 1 --2- 172.21.15.146:0/3757576992 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6fa0066f30 0x7f6fa00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:45.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.276+0000 7f6fb8ff9700 1 -- 172.21.15.146:0/3757576992 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6fb0084d40 con 0x7f6fbc068ba0 2023-10-06T11:10:45.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.276+0000 7f6fbbfff700 1 --2- 172.21.15.146:0/3757576992 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6fa0066f30 0x7f6fa00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:45.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.276+0000 7f6fbbfff700 1 --2- 172.21.15.146:0/3757576992 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6fa0066f30 0x7f6fa00693e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc158040 tx=0x7f6fa8007b40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:45.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.280+0000 7f6fb8ff9700 1 -- 172.21.15.146:0/3757576992 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6fb0051e50 con 0x7f6fbc068ba0 2023-10-06T11:10:45.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.462+0000 7f6fc30f5700 1 -- 172.21.15.146:0/3757576992 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6fbc1595d0 con 0x7f6fa0066f30 2023-10-06T11:10:45.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.471+0000 7f6fb8ff9700 1 -- 172.21.15.146:0/3757576992 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311568 (secure 0 0 0) 0x7f6fa8014410 con 0x7f6fa0066f30 2023-10-06T11:10:45.476 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:10:45.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.474+0000 7f6fc30f5700 1 -- 172.21.15.146:0/3757576992 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6fa0066f30 msgr2=0x7f6fa00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:45.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.474+0000 7f6fc30f5700 1 --2- 172.21.15.146:0/3757576992 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6fa0066f30 0x7f6fa00693e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc158040 tx=0x7f6fa8007b40 comp rx=0 tx=0).stop 2023-10-06T11:10:45.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.474+0000 7f6fc30f5700 1 -- 172.21.15.146:0/3757576992 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fbc068ba0 msgr2=0x7f6fbc0c53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:45.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.474+0000 7f6fc30f5700 1 --2- 172.21.15.146:0/3757576992 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fbc068ba0 0x7f6fbc0c53a0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f6fb000d890 tx=0x7f6fb0008040 comp rx=0 tx=0).stop 2023-10-06T11:10:45.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.474+0000 7f6fc30f5700 1 -- 172.21.15.146:0/3757576992 shutdown_connections 2023-10-06T11:10:45.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.474+0000 7f6fc30f5700 1 --2- 172.21.15.146:0/3757576992 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6fa0066f30 0x7f6fa00693e0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:45.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.474+0000 7f6fc30f5700 1 --2- 172.21.15.146:0/3757576992 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fbc153e80 0x7f6fbc159920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:45.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.474+0000 7f6fc30f5700 1 --2- 172.21.15.146:0/3757576992 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6fbc068ba0 0x7f6fbc0c53a0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:45.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.474+0000 7f6fc30f5700 1 --2- 172.21.15.146:0/3757576992 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6fbc153ab0 0x7f6fbc0c58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:45.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.474+0000 7f6fc30f5700 1 -- 172.21.15.146:0/3757576992 >> 172.21.15.146:0/3757576992 conn(0x7f6fbc06eba0 msgr2=0x7f6fbc0d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:45.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.475+0000 7f6fc30f5700 1 -- 172.21.15.146:0/3757576992 shutdown_connections 2023-10-06T11:10:45.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.475+0000 7f6fc30f5700 1 -- 172.21.15.146:0/3757576992 wait complete. 2023-10-06T11:10:45.480 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:10:45.488 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":222,"stamp":"2023-10-06T11:10:45.204899+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":200,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2443992,"kb_used_data":8344,"kb_used_omap":0,"kb_used_meta":2435584,"kb_avail":752530728,"statfs":{"total":773094113280,"available":770591465472,"internally_reserved":0,"allocated":8544256,"data_stored":4473800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2494038016},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.655400"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.576625+0000","last_change":"2023-10-06T11:10:36.571841+0000","last_active":"2023-10-06T11:10:36.576625+0000","last_peered":"2023-10-06T11:10:36.576625+0000","last_clean":"2023-10-06T11:10:36.576625+0000","last_became_active":"2023-10-06T11:10:36.571552+0000","last_became_peered":"2023-10-06T11:10:36.571552+0000","last_unstale":"2023-10-06T11:10:36.576625+0000","last_undegraded":"2023-10-06T11:10:36.576625+0000","last_fullsized":"2023-10-06T11:10:36.576625+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:15:56.228848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.568158+0000","last_change":"2023-10-06T11:10:36.560989+0000","last_active":"2023-10-06T11:10:36.568158+0000","last_peered":"2023-10-06T11:10:36.568158+0000","last_clean":"2023-10-06T11:10:36.568158+0000","last_became_active":"2023-10-06T11:10:36.560530+0000","last_became_peered":"2023-10-06T11:10:36.560530+0000","last_unstale":"2023-10-06T11:10:36.568158+0000","last_undegraded":"2023-10-06T11:10:36.568158+0000","last_fullsized":"2023-10-06T11:10:36.568158+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:42:34.380354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.566020+0000","last_change":"2023-10-06T11:10:36.562062+0000","last_active":"2023-10-06T11:10:36.566020+0000","last_peered":"2023-10-06T11:10:36.566020+0000","last_clean":"2023-10-06T11:10:36.566020+0000","last_became_active":"2023-10-06T11:10:36.561650+0000","last_became_peered":"2023-10-06T11:10:36.561650+0000","last_unstale":"2023-10-06T11:10:36.566020+0000","last_undegraded":"2023-10-06T11:10:36.566020+0000","last_fullsized":"2023-10-06T11:10:36.566020+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:01.339658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.573770+0000","last_change":"2023-10-06T11:10:36.564133+0000","last_active":"2023-10-06T11:10:36.573770+0000","last_peered":"2023-10-06T11:10:36.573770+0000","last_clean":"2023-10-06T11:10:36.573770+0000","last_became_active":"2023-10-06T11:10:36.563864+0000","last_became_peered":"2023-10-06T11:10:36.563864+0000","last_unstale":"2023-10-06T11:10:36.573770+0000","last_undegraded":"2023-10-06T11:10:36.573770+0000","last_fullsized":"2023-10-06T11:10:36.573770+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:36.064585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.573422+0000","last_change":"2023-10-06T11:10:36.568783+0000","last_active":"2023-10-06T11:10:36.573422+0000","last_peered":"2023-10-06T11:10:36.573422+0000","last_clean":"2023-10-06T11:10:36.573422+0000","last_became_active":"2023-10-06T11:10:36.568445+0000","last_became_peered":"2023-10-06T11:10:36.568445+0000","last_unstale":"2023-10-06T11:10:36.573422+0000","last_undegraded":"2023-10-06T11:10:36.573422+0000","last_fullsized":"2023-10-06T11:10:36.573422+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:38.429948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.575657+0000","last_change":"2023-10-06T11:10:36.571197+0000","last_active":"2023-10-06T11:10:36.575657+0000","last_peered":"2023-10-06T11:10:36.575657+0000","last_clean":"2023-10-06T11:10:36.575657+0000","last_became_active":"2023-10-06T11:10:36.570494+0000","last_became_peered":"2023-10-06T11:10:36.570494+0000","last_unstale":"2023-10-06T11:10:36.575657+0000","last_undegraded":"2023-10-06T11:10:36.575657+0000","last_fullsized":"2023-10-06T11:10:36.575657+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:21:08.092457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.576792+0000","last_change":"2023-10-06T11:10:36.571352+0000","last_active":"2023-10-06T11:10:36.576792+0000","last_peered":"2023-10-06T11:10:36.576792+0000","last_clean":"2023-10-06T11:10:36.576792+0000","last_became_active":"2023-10-06T11:10:36.570697+0000","last_became_peered":"2023-10-06T11:10:36.570697+0000","last_unstale":"2023-10-06T11:10:36.576792+0000","last_undegraded":"2023-10-06T11:10:36.576792+0000","last_fullsized":"2023-10-06T11:10:36.576792+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:03:22.794550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.572922+0000","last_change":"2023-10-06T11:10:36.566887+0000","last_active":"2023-10-06T11:10:36.572922+0000","last_peered":"2023-10-06T11:10:36.572922+0000","last_clean":"2023-10-06T11:10:36.572922+0000","last_became_active":"2023-10-06T11:10:36.566591+0000","last_became_peered":"2023-10-06T11:10:36.566591+0000","last_unstale":"2023-10-06T11:10:36.572922+0000","last_undegraded":"2023-10-06T11:10:36.572922+0000","last_fullsized":"2023-10-06T11:10:36.572922+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:48:46.305816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.569032+0000","last_change":"2023-10-06T11:10:36.564345+0000","last_active":"2023-10-06T11:10:36.569032+0000","last_peered":"2023-10-06T11:10:36.569032+0000","last_clean":"2023-10-06T11:10:36.569032+0000","last_became_active":"2023-10-06T11:10:36.562959+0000","last_became_peered":"2023-10-06T11:10:36.562959+0000","last_unstale":"2023-10-06T11:10:36.569032+0000","last_undegraded":"2023-10-06T11:10:36.569032+0000","last_fullsized":"2023-10-06T11:10:36.569032+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:09.031116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.573775+0000","last_change":"2023-10-06T11:10:36.564181+0000","last_active":"2023-10-06T11:10:36.573775+0000","last_peered":"2023-10-06T11:10:36.573775+0000","last_clean":"2023-10-06T11:10:36.573775+0000","last_became_active":"2023-10-06T11:10:36.563872+0000","last_became_peered":"2023-10-06T11:10:36.563872+0000","last_unstale":"2023-10-06T11:10:36.573775+0000","last_undegraded":"2023-10-06T11:10:36.573775+0000","last_fullsized":"2023-10-06T11:10:36.573775+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:07.338879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.568101+0000","last_change":"2023-10-06T11:10:36.560780+0000","last_active":"2023-10-06T11:10:36.568101+0000","last_peered":"2023-10-06T11:10:36.568101+0000","last_clean":"2023-10-06T11:10:36.568101+0000","last_became_active":"2023-10-06T11:10:36.559995+0000","last_became_peered":"2023-10-06T11:10:36.559995+0000","last_unstale":"2023-10-06T11:10:36.568101+0000","last_undegraded":"2023-10-06T11:10:36.568101+0000","last_fullsized":"2023-10-06T11:10:36.568101+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:34:34.906017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.573651+0000","last_change":"2023-10-06T11:10:36.563190+0000","last_active":"2023-10-06T11:10:36.573651+0000","last_peered":"2023-10-06T11:10:36.573651+0000","last_clean":"2023-10-06T11:10:36.573651+0000","last_became_active":"2023-10-06T11:10:36.562908+0000","last_became_peered":"2023-10-06T11:10:36.562908+0000","last_unstale":"2023-10-06T11:10:36.573651+0000","last_undegraded":"2023-10-06T11:10:36.573651+0000","last_fullsized":"2023-10-06T11:10:36.573651+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:16:47.575460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.561994+0000","last_change":"2023-10-06T11:10:36.559870+0000","last_active":"2023-10-06T11:10:36.561994+0000","last_peered":"2023-10-06T11:10:36.561994+0000","last_clean":"2023-10-06T11:10:36.561994+0000","last_became_active":"2023-10-06T11:10:36.559607+0000","last_became_peered":"2023-10-06T11:10:36.559607+0000","last_unstale":"2023-10-06T11:10:36.561994+0000","last_undegraded":"2023-10-06T11:10:36.561994+0000","last_fullsized":"2023-10-06T11:10:36.561994+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:45:49.401723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.575677+0000","last_change":"2023-10-06T11:10:36.571429+0000","last_active":"2023-10-06T11:10:36.575677+0000","last_peered":"2023-10-06T11:10:36.575677+0000","last_clean":"2023-10-06T11:10:36.575677+0000","last_became_active":"2023-10-06T11:10:36.570852+0000","last_became_peered":"2023-10-06T11:10:36.570852+0000","last_unstale":"2023-10-06T11:10:36.575677+0000","last_undegraded":"2023-10-06T11:10:36.575677+0000","last_fullsized":"2023-10-06T11:10:36.575677+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:24:04.262059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.568887+0000","last_change":"2023-10-06T11:10:36.562193+0000","last_active":"2023-10-06T11:10:36.568887+0000","last_peered":"2023-10-06T11:10:36.568887+0000","last_clean":"2023-10-06T11:10:36.568887+0000","last_became_active":"2023-10-06T11:10:36.560919+0000","last_became_peered":"2023-10-06T11:10:36.560919+0000","last_unstale":"2023-10-06T11:10:36.568887+0000","last_undegraded":"2023-10-06T11:10:36.568887+0000","last_fullsized":"2023-10-06T11:10:36.568887+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:59:03.978003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.576335+0000","last_change":"2023-10-06T11:10:36.570828+0000","last_active":"2023-10-06T11:10:36.576335+0000","last_peered":"2023-10-06T11:10:36.576335+0000","last_clean":"2023-10-06T11:10:36.576335+0000","last_became_active":"2023-10-06T11:10:36.568116+0000","last_became_peered":"2023-10-06T11:10:36.568116+0000","last_unstale":"2023-10-06T11:10:36.576335+0000","last_undegraded":"2023-10-06T11:10:36.576335+0000","last_fullsized":"2023-10-06T11:10:36.576335+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:06:36.489499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.568451+0000","last_change":"2023-10-06T11:10:36.563686+0000","last_active":"2023-10-06T11:10:36.568451+0000","last_peered":"2023-10-06T11:10:36.568451+0000","last_clean":"2023-10-06T11:10:36.568451+0000","last_became_active":"2023-10-06T11:10:36.563443+0000","last_became_peered":"2023-10-06T11:10:36.563443+0000","last_unstale":"2023-10-06T11:10:36.568451+0000","last_undegraded":"2023-10-06T11:10:36.568451+0000","last_fullsized":"2023-10-06T11:10:36.568451+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:12:36.419706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.578101+0000","last_change":"2023-10-06T11:10:36.571620+0000","last_active":"2023-10-06T11:10:36.578101+0000","last_peered":"2023-10-06T11:10:36.578101+0000","last_clean":"2023-10-06T11:10:36.578101+0000","last_became_active":"2023-10-06T11:10:36.571361+0000","last_became_peered":"2023-10-06T11:10:36.571361+0000","last_unstale":"2023-10-06T11:10:36.578101+0000","last_undegraded":"2023-10-06T11:10:36.578101+0000","last_fullsized":"2023-10-06T11:10:36.578101+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:11:53.044428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.569653+0000","last_change":"2023-10-06T11:10:36.563878+0000","last_active":"2023-10-06T11:10:36.569653+0000","last_peered":"2023-10-06T11:10:36.569653+0000","last_clean":"2023-10-06T11:10:36.569653+0000","last_became_active":"2023-10-06T11:10:36.563614+0000","last_became_peered":"2023-10-06T11:10:36.563614+0000","last_unstale":"2023-10-06T11:10:36.569653+0000","last_undegraded":"2023-10-06T11:10:36.569653+0000","last_fullsized":"2023-10-06T11:10:36.569653+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:55.429899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.572990+0000","last_change":"2023-10-06T11:10:36.564183+0000","last_active":"2023-10-06T11:10:36.572990+0000","last_peered":"2023-10-06T11:10:36.572990+0000","last_clean":"2023-10-06T11:10:36.572990+0000","last_became_active":"2023-10-06T11:10:36.562786+0000","last_became_peered":"2023-10-06T11:10:36.562786+0000","last_unstale":"2023-10-06T11:10:36.572990+0000","last_undegraded":"2023-10-06T11:10:36.572990+0000","last_fullsized":"2023-10-06T11:10:36.572990+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:56:28.535168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.570507+0000","last_change":"2023-10-06T11:10:36.565345+0000","last_active":"2023-10-06T11:10:36.570507+0000","last_peered":"2023-10-06T11:10:36.570507+0000","last_clean":"2023-10-06T11:10:36.570507+0000","last_became_active":"2023-10-06T11:10:36.564007+0000","last_became_peered":"2023-10-06T11:10:36.564007+0000","last_unstale":"2023-10-06T11:10:36.570507+0000","last_undegraded":"2023-10-06T11:10:36.570507+0000","last_fullsized":"2023-10-06T11:10:36.570507+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:07.338879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.573146+0000","last_change":"2023-10-06T11:10:36.567313+0000","last_active":"2023-10-06T11:10:36.573146+0000","last_peered":"2023-10-06T11:10:36.573146+0000","last_clean":"2023-10-06T11:10:36.573146+0000","last_became_active":"2023-10-06T11:10:36.567062+0000","last_became_peered":"2023-10-06T11:10:36.567062+0000","last_unstale":"2023-10-06T11:10:36.573146+0000","last_undegraded":"2023-10-06T11:10:36.573146+0000","last_fullsized":"2023-10-06T11:10:36.573146+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:00:18.584057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.570069+0000","last_change":"2023-10-06T11:10:36.564288+0000","last_active":"2023-10-06T11:10:36.570069+0000","last_peered":"2023-10-06T11:10:36.570069+0000","last_clean":"2023-10-06T11:10:36.570069+0000","last_became_active":"2023-10-06T11:10:36.563482+0000","last_became_peered":"2023-10-06T11:10:36.563482+0000","last_unstale":"2023-10-06T11:10:36.570069+0000","last_undegraded":"2023-10-06T11:10:36.570069+0000","last_fullsized":"2023-10-06T11:10:36.570069+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:56:23.575265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.561790+0000","last_change":"2023-10-06T11:10:36.559402+0000","last_active":"2023-10-06T11:10:36.561790+0000","last_peered":"2023-10-06T11:10:36.561790+0000","last_clean":"2023-10-06T11:10:36.561790+0000","last_became_active":"2023-10-06T11:10:36.559154+0000","last_became_peered":"2023-10-06T11:10:36.559154+0000","last_unstale":"2023-10-06T11:10:36.561790+0000","last_undegraded":"2023-10-06T11:10:36.561790+0000","last_fullsized":"2023-10-06T11:10:36.561790+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:21:58.766674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.561003+0000","last_change":"2023-10-06T11:10:36.560023+0000","last_active":"2023-10-06T11:10:36.561003+0000","last_peered":"2023-10-06T11:10:36.561003+0000","last_clean":"2023-10-06T11:10:36.561003+0000","last_became_active":"2023-10-06T11:10:36.559767+0000","last_became_peered":"2023-10-06T11:10:36.559767+0000","last_unstale":"2023-10-06T11:10:36.561003+0000","last_undegraded":"2023-10-06T11:10:36.561003+0000","last_fullsized":"2023-10-06T11:10:36.561003+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:32.843328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.573484+0000","last_change":"2023-10-06T11:10:36.561840+0000","last_active":"2023-10-06T11:10:36.573484+0000","last_peered":"2023-10-06T11:10:36.573484+0000","last_clean":"2023-10-06T11:10:36.573484+0000","last_became_active":"2023-10-06T11:10:36.561567+0000","last_became_peered":"2023-10-06T11:10:36.561567+0000","last_unstale":"2023-10-06T11:10:36.573484+0000","last_undegraded":"2023-10-06T11:10:36.573484+0000","last_fullsized":"2023-10-06T11:10:36.573484+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:53:17.624007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.576879+0000","last_change":"2023-10-06T11:10:36.574286+0000","last_active":"2023-10-06T11:10:36.576879+0000","last_peered":"2023-10-06T11:10:36.576879+0000","last_clean":"2023-10-06T11:10:36.576879+0000","last_became_active":"2023-10-06T11:10:36.574019+0000","last_became_peered":"2023-10-06T11:10:36.574019+0000","last_unstale":"2023-10-06T11:10:36.576879+0000","last_undegraded":"2023-10-06T11:10:36.576879+0000","last_fullsized":"2023-10-06T11:10:36.576879+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:24:04.262059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.573013+0000","last_change":"2023-10-06T11:10:36.567171+0000","last_active":"2023-10-06T11:10:36.573013+0000","last_peered":"2023-10-06T11:10:36.573013+0000","last_clean":"2023-10-06T11:10:36.573013+0000","last_became_active":"2023-10-06T11:10:36.566806+0000","last_became_peered":"2023-10-06T11:10:36.566806+0000","last_unstale":"2023-10-06T11:10:36.573013+0000","last_undegraded":"2023-10-06T11:10:36.573013+0000","last_fullsized":"2023-10-06T11:10:36.573013+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:01:34.564347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.569188+0000","last_change":"2023-10-06T11:10:36.563937+0000","last_active":"2023-10-06T11:10:36.569188+0000","last_peered":"2023-10-06T11:10:36.569188+0000","last_clean":"2023-10-06T11:10:36.569188+0000","last_became_active":"2023-10-06T11:10:36.563314+0000","last_became_peered":"2023-10-06T11:10:36.563314+0000","last_unstale":"2023-10-06T11:10:36.569188+0000","last_undegraded":"2023-10-06T11:10:36.569188+0000","last_fullsized":"2023-10-06T11:10:36.569188+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:08:39.130261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.576388+0000","last_change":"2023-10-06T11:10:36.571068+0000","last_active":"2023-10-06T11:10:36.576388+0000","last_peered":"2023-10-06T11:10:36.576388+0000","last_clean":"2023-10-06T11:10:36.576388+0000","last_became_active":"2023-10-06T11:10:36.570730+0000","last_became_peered":"2023-10-06T11:10:36.570730+0000","last_unstale":"2023-10-06T11:10:36.576388+0000","last_undegraded":"2023-10-06T11:10:36.576388+0000","last_fullsized":"2023-10-06T11:10:36.576388+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:09.293990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.566689+0000","last_change":"2023-10-06T11:10:36.563437+0000","last_active":"2023-10-06T11:10:36.566689+0000","last_peered":"2023-10-06T11:10:36.566689+0000","last_clean":"2023-10-06T11:10:36.566689+0000","last_became_active":"2023-10-06T11:10:36.563170+0000","last_became_peered":"2023-10-06T11:10:36.563170+0000","last_unstale":"2023-10-06T11:10:36.566689+0000","last_undegraded":"2023-10-06T11:10:36.566689+0000","last_fullsized":"2023-10-06T11:10:36.566689+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:26.706783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.576596+0000","last_change":"2023-10-06T11:10:36.568408+0000","last_active":"2023-10-06T11:10:36.576596+0000","last_peered":"2023-10-06T11:10:36.576596+0000","last_clean":"2023-10-06T11:10:36.576596+0000","last_became_active":"2023-10-06T11:10:36.567730+0000","last_became_peered":"2023-10-06T11:10:36.567730+0000","last_unstale":"2023-10-06T11:10:36.576596+0000","last_undegraded":"2023-10-06T11:10:36.576596+0000","last_fullsized":"2023-10-06T11:10:36.576596+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:44:55.429899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.577548+0000","last_change":"2023-10-06T11:10:36.568203+0000","last_active":"2023-10-06T11:10:36.577548+0000","last_peered":"2023-10-06T11:10:36.577548+0000","last_clean":"2023-10-06T11:10:36.577548+0000","last_became_active":"2023-10-06T11:10:36.567772+0000","last_became_peered":"2023-10-06T11:10:36.567772+0000","last_unstale":"2023-10-06T11:10:36.577548+0000","last_undegraded":"2023-10-06T11:10:36.577548+0000","last_fullsized":"2023-10-06T11:10:36.577548+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:14:16.648125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"74'4","reported_seq":14,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.578672+0000","last_change":"2023-10-06T11:10:35.564448+0000","last_active":"2023-10-06T11:10:36.578672+0000","last_peered":"2023-10-06T11:10:36.578672+0000","last_clean":"2023-10-06T11:10:36.578672+0000","last_became_active":"2023-10-06T11:10:35.564175+0000","last_became_peered":"2023-10-06T11:10:35.564175+0000","last_unstale":"2023-10-06T11:10:36.578672+0000","last_undegraded":"2023-10-06T11:10:36.578672+0000","last_fullsized":"2023-10-06T11:10:36.578672+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:06:11.497822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.561134+0000","last_change":"2023-10-06T11:10:36.557947+0000","last_active":"2023-10-06T11:10:36.561134+0000","last_peered":"2023-10-06T11:10:36.561134+0000","last_clean":"2023-10-06T11:10:36.561134+0000","last_became_active":"2023-10-06T11:10:36.557680+0000","last_became_peered":"2023-10-06T11:10:36.557680+0000","last_unstale":"2023-10-06T11:10:36.561134+0000","last_undegraded":"2023-10-06T11:10:36.561134+0000","last_fullsized":"2023-10-06T11:10:36.561134+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:08:02.580397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"74'1","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.571071+0000","last_change":"2023-10-06T11:10:35.561010+0000","last_active":"2023-10-06T11:10:36.571071+0000","last_peered":"2023-10-06T11:10:36.571071+0000","last_clean":"2023-10-06T11:10:36.571071+0000","last_became_active":"2023-10-06T11:10:35.560718+0000","last_became_peered":"2023-10-06T11:10:35.560718+0000","last_unstale":"2023-10-06T11:10:36.571071+0000","last_undegraded":"2023-10-06T11:10:36.571071+0000","last_fullsized":"2023-10-06T11:10:36.571071+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:35.057797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.574960+0000","last_change":"2023-10-06T11:10:36.564783+0000","last_active":"2023-10-06T11:10:36.574960+0000","last_peered":"2023-10-06T11:10:36.574960+0000","last_clean":"2023-10-06T11:10:36.574960+0000","last_became_active":"2023-10-06T11:10:36.564112+0000","last_became_peered":"2023-10-06T11:10:36.564112+0000","last_unstale":"2023-10-06T11:10:36.574960+0000","last_undegraded":"2023-10-06T11:10:36.574960+0000","last_fullsized":"2023-10-06T11:10:36.574960+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:17:13.424540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"74'2","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.571646+0000","last_change":"2023-10-06T11:10:35.561374+0000","last_active":"2023-10-06T11:10:36.571646+0000","last_peered":"2023-10-06T11:10:36.571646+0000","last_clean":"2023-10-06T11:10:36.571646+0000","last_became_active":"2023-10-06T11:10:35.561034+0000","last_became_peered":"2023-10-06T11:10:35.561034+0000","last_unstale":"2023-10-06T11:10:36.571646+0000","last_undegraded":"2023-10-06T11:10:36.571646+0000","last_fullsized":"2023-10-06T11:10:36.571646+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:54:52.795843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.568982+0000","last_change":"2023-10-06T11:10:36.563943+0000","last_active":"2023-10-06T11:10:36.568982+0000","last_peered":"2023-10-06T11:10:36.568982+0000","last_clean":"2023-10-06T11:10:36.568982+0000","last_became_active":"2023-10-06T11:10:36.563685+0000","last_became_peered":"2023-10-06T11:10:36.563685+0000","last_unstale":"2023-10-06T11:10:36.568982+0000","last_undegraded":"2023-10-06T11:10:36.568982+0000","last_fullsized":"2023-10-06T11:10:36.568982+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:10:01.462268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"74'2","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.577104+0000","last_change":"2023-10-06T11:10:35.558480+0000","last_active":"2023-10-06T11:10:36.577104+0000","last_peered":"2023-10-06T11:10:36.577104+0000","last_clean":"2023-10-06T11:10:36.577104+0000","last_became_active":"2023-10-06T11:10:35.557916+0000","last_became_peered":"2023-10-06T11:10:35.557916+0000","last_unstale":"2023-10-06T11:10:36.577104+0000","last_undegraded":"2023-10-06T11:10:36.577104+0000","last_fullsized":"2023-10-06T11:10:36.577104+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:43.125026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.566159+0000","last_change":"2023-10-06T11:10:36.560338+0000","last_active":"2023-10-06T11:10:36.566159+0000","last_peered":"2023-10-06T11:10:36.566159+0000","last_clean":"2023-10-06T11:10:36.566159+0000","last_became_active":"2023-10-06T11:10:36.560039+0000","last_became_peered":"2023-10-06T11:10:36.560039+0000","last_unstale":"2023-10-06T11:10:36.566159+0000","last_undegraded":"2023-10-06T11:10:36.566159+0000","last_fullsized":"2023-10-06T11:10:36.566159+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:41:46.063088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"74'1","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.563814+0000","last_change":"2023-10-06T11:10:35.563076+0000","last_active":"2023-10-06T11:10:36.563814+0000","last_peered":"2023-10-06T11:10:36.563814+0000","last_clean":"2023-10-06T11:10:36.563814+0000","last_became_active":"2023-10-06T11:10:35.561203+0000","last_became_peered":"2023-10-06T11:10:35.561203+0000","last_unstale":"2023-10-06T11:10:36.563814+0000","last_undegraded":"2023-10-06T11:10:36.563814+0000","last_fullsized":"2023-10-06T11:10:36.563814+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:56:40.528482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.568911+0000","last_change":"2023-10-06T11:10:36.562461+0000","last_active":"2023-10-06T11:10:36.568911+0000","last_peered":"2023-10-06T11:10:36.568911+0000","last_clean":"2023-10-06T11:10:36.568911+0000","last_became_active":"2023-10-06T11:10:36.559556+0000","last_became_peered":"2023-10-06T11:10:36.559556+0000","last_unstale":"2023-10-06T11:10:36.568911+0000","last_undegraded":"2023-10-06T11:10:36.568911+0000","last_fullsized":"2023-10-06T11:10:36.568911+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:28:10.803191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"74'1","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.577401+0000","last_change":"2023-10-06T11:10:35.556455+0000","last_active":"2023-10-06T11:10:36.577401+0000","last_peered":"2023-10-06T11:10:36.577401+0000","last_clean":"2023-10-06T11:10:36.577401+0000","last_became_active":"2023-10-06T11:10:35.556167+0000","last_became_peered":"2023-10-06T11:10:35.556167+0000","last_unstale":"2023-10-06T11:10:36.577401+0000","last_undegraded":"2023-10-06T11:10:36.577401+0000","last_fullsized":"2023-10-06T11:10:36.577401+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:25.699995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.570384+0000","last_change":"2023-10-06T11:10:36.566820+0000","last_active":"2023-10-06T11:10:36.570384+0000","last_peered":"2023-10-06T11:10:36.570384+0000","last_clean":"2023-10-06T11:10:36.570384+0000","last_became_active":"2023-10-06T11:10:36.566558+0000","last_became_peered":"2023-10-06T11:10:36.566558+0000","last_unstale":"2023-10-06T11:10:36.570384+0000","last_undegraded":"2023-10-06T11:10:36.570384+0000","last_fullsized":"2023-10-06T11:10:36.570384+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:19:42.231134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.548703+0000","last_change":"2023-10-06T11:10:35.559140+0000","last_active":"2023-10-06T11:10:36.548703+0000","last_peered":"2023-10-06T11:10:36.548703+0000","last_clean":"2023-10-06T11:10:36.548703+0000","last_became_active":"2023-10-06T11:10:35.558843+0000","last_became_peered":"2023-10-06T11:10:35.558843+0000","last_unstale":"2023-10-06T11:10:36.548703+0000","last_undegraded":"2023-10-06T11:10:36.548703+0000","last_fullsized":"2023-10-06T11:10:36.548703+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:59:57.232416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.576830+0000","last_change":"2023-10-06T11:10:36.571387+0000","last_active":"2023-10-06T11:10:36.576830+0000","last_peered":"2023-10-06T11:10:36.576830+0000","last_clean":"2023-10-06T11:10:36.576830+0000","last_became_active":"2023-10-06T11:10:36.571001+0000","last_became_peered":"2023-10-06T11:10:36.571001+0000","last_unstale":"2023-10-06T11:10:36.576830+0000","last_undegraded":"2023-10-06T11:10:36.576830+0000","last_fullsized":"2023-10-06T11:10:36.576830+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:22:25.424782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.552536+0000","last_change":"2023-10-06T11:10:35.566163+0000","last_active":"2023-10-06T11:10:36.552536+0000","last_peered":"2023-10-06T11:10:36.552536+0000","last_clean":"2023-10-06T11:10:36.552536+0000","last_became_active":"2023-10-06T11:10:35.565869+0000","last_became_peered":"2023-10-06T11:10:35.565869+0000","last_unstale":"2023-10-06T11:10:36.552536+0000","last_undegraded":"2023-10-06T11:10:36.552536+0000","last_fullsized":"2023-10-06T11:10:36.552536+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:20:09.758618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.569677+0000","last_change":"2023-10-06T11:10:36.565917+0000","last_active":"2023-10-06T11:10:36.569677+0000","last_peered":"2023-10-06T11:10:36.569677+0000","last_clean":"2023-10-06T11:10:36.569677+0000","last_became_active":"2023-10-06T11:10:36.565634+0000","last_became_peered":"2023-10-06T11:10:36.565634+0000","last_unstale":"2023-10-06T11:10:36.569677+0000","last_undegraded":"2023-10-06T11:10:36.569677+0000","last_fullsized":"2023-10-06T11:10:36.569677+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:52.600212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.562200+0000","last_change":"2023-10-06T11:10:35.561963+0000","last_active":"2023-10-06T11:10:36.562200+0000","last_peered":"2023-10-06T11:10:36.562200+0000","last_clean":"2023-10-06T11:10:36.562200+0000","last_became_active":"2023-10-06T11:10:35.561673+0000","last_became_peered":"2023-10-06T11:10:35.561673+0000","last_unstale":"2023-10-06T11:10:36.562200+0000","last_undegraded":"2023-10-06T11:10:36.562200+0000","last_fullsized":"2023-10-06T11:10:36.562200+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:16:25.755999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.573835+0000","last_change":"2023-10-06T11:10:36.564918+0000","last_active":"2023-10-06T11:10:36.573835+0000","last_peered":"2023-10-06T11:10:36.573835+0000","last_clean":"2023-10-06T11:10:36.573835+0000","last_became_active":"2023-10-06T11:10:36.564617+0000","last_became_peered":"2023-10-06T11:10:36.564617+0000","last_unstale":"2023-10-06T11:10:36.573835+0000","last_undegraded":"2023-10-06T11:10:36.573835+0000","last_fullsized":"2023-10-06T11:10:36.573835+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:16:26.762787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.554707+0000","last_change":"2023-10-06T11:10:35.558239+0000","last_active":"2023-10-06T11:10:36.554707+0000","last_peered":"2023-10-06T11:10:36.554707+0000","last_clean":"2023-10-06T11:10:36.554707+0000","last_became_active":"2023-10-06T11:10:35.557904+0000","last_became_peered":"2023-10-06T11:10:35.557904+0000","last_unstale":"2023-10-06T11:10:36.554707+0000","last_undegraded":"2023-10-06T11:10:36.554707+0000","last_fullsized":"2023-10-06T11:10:36.554707+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:48:30.196153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.571313+0000","last_change":"2023-10-06T11:10:36.564449+0000","last_active":"2023-10-06T11:10:36.571313+0000","last_peered":"2023-10-06T11:10:36.571313+0000","last_clean":"2023-10-06T11:10:36.571313+0000","last_became_active":"2023-10-06T11:10:36.564143+0000","last_became_peered":"2023-10-06T11:10:36.564143+0000","last_unstale":"2023-10-06T11:10:36.571313+0000","last_undegraded":"2023-10-06T11:10:36.571313+0000","last_fullsized":"2023-10-06T11:10:36.571313+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:06:36.489499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"74'3","reported_seq":13,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.578416+0000","last_change":"2023-10-06T11:10:35.562574+0000","last_active":"2023-10-06T11:10:36.578416+0000","last_peered":"2023-10-06T11:10:36.578416+0000","last_clean":"2023-10-06T11:10:36.578416+0000","last_became_active":"2023-10-06T11:10:35.562340+0000","last_became_peered":"2023-10-06T11:10:35.562340+0000","last_unstale":"2023-10-06T11:10:36.578416+0000","last_undegraded":"2023-10-06T11:10:36.578416+0000","last_fullsized":"2023-10-06T11:10:36.578416+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:04:45.233259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.562796+0000","last_change":"2023-10-06T11:10:36.558905+0000","last_active":"2023-10-06T11:10:36.562796+0000","last_peered":"2023-10-06T11:10:36.562796+0000","last_clean":"2023-10-06T11:10:36.562796+0000","last_became_active":"2023-10-06T11:10:36.558656+0000","last_became_peered":"2023-10-06T11:10:36.558656+0000","last_unstale":"2023-10-06T11:10:36.562796+0000","last_undegraded":"2023-10-06T11:10:36.562796+0000","last_fullsized":"2023-10-06T11:10:36.562796+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:05:23.675313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"74'6","reported_seq":16,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.579368+0000","last_change":"2023-10-06T11:10:35.565131+0000","last_active":"2023-10-06T11:10:36.579368+0000","last_peered":"2023-10-06T11:10:36.579368+0000","last_clean":"2023-10-06T11:10:36.579368+0000","last_became_active":"2023-10-06T11:10:35.564906+0000","last_became_peered":"2023-10-06T11:10:35.564906+0000","last_unstale":"2023-10-06T11:10:36.579368+0000","last_undegraded":"2023-10-06T11:10:36.579368+0000","last_fullsized":"2023-10-06T11:10:36.579368+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:17:20.645306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.569563+0000","last_change":"2023-10-06T11:10:36.559085+0000","last_active":"2023-10-06T11:10:36.569563+0000","last_peered":"2023-10-06T11:10:36.569563+0000","last_clean":"2023-10-06T11:10:36.569563+0000","last_became_active":"2023-10-06T11:10:36.558805+0000","last_became_peered":"2023-10-06T11:10:36.558805+0000","last_unstale":"2023-10-06T11:10:36.569563+0000","last_undegraded":"2023-10-06T11:10:36.569563+0000","last_fullsized":"2023-10-06T11:10:36.569563+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:10:01.462268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"74'2","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.577946+0000","last_change":"2023-10-06T11:10:35.566952+0000","last_active":"2023-10-06T11:10:36.577946+0000","last_peered":"2023-10-06T11:10:36.577946+0000","last_clean":"2023-10-06T11:10:36.577946+0000","last_became_active":"2023-10-06T11:10:35.566661+0000","last_became_peered":"2023-10-06T11:10:35.566661+0000","last_unstale":"2023-10-06T11:10:36.577946+0000","last_undegraded":"2023-10-06T11:10:36.577946+0000","last_fullsized":"2023-10-06T11:10:36.577946+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:05:22.668525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.576536+0000","last_change":"2023-10-06T11:10:36.566928+0000","last_active":"2023-10-06T11:10:36.576536+0000","last_peered":"2023-10-06T11:10:36.576536+0000","last_clean":"2023-10-06T11:10:36.576536+0000","last_became_active":"2023-10-06T11:10:36.566624+0000","last_became_peered":"2023-10-06T11:10:36.566624+0000","last_unstale":"2023-10-06T11:10:36.576536+0000","last_undegraded":"2023-10-06T11:10:36.576536+0000","last_fullsized":"2023-10-06T11:10:36.576536+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:26.706783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.559827+0000","last_change":"2023-10-06T11:10:35.563787+0000","last_active":"2023-10-06T11:10:36.559827+0000","last_peered":"2023-10-06T11:10:36.559827+0000","last_clean":"2023-10-06T11:10:36.559827+0000","last_became_active":"2023-10-06T11:10:35.563566+0000","last_became_peered":"2023-10-06T11:10:35.563566+0000","last_unstale":"2023-10-06T11:10:36.559827+0000","last_undegraded":"2023-10-06T11:10:36.559827+0000","last_fullsized":"2023-10-06T11:10:36.559827+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:06.332091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.576960+0000","last_change":"2023-10-06T11:10:36.574907+0000","last_active":"2023-10-06T11:10:36.576960+0000","last_peered":"2023-10-06T11:10:36.576960+0000","last_clean":"2023-10-06T11:10:36.576960+0000","last_became_active":"2023-10-06T11:10:36.571648+0000","last_became_peered":"2023-10-06T11:10:36.571648+0000","last_unstale":"2023-10-06T11:10:36.576960+0000","last_undegraded":"2023-10-06T11:10:36.576960+0000","last_fullsized":"2023-10-06T11:10:36.576960+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:05:23.675313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.552497+0000","last_change":"2023-10-06T11:10:35.564482+0000","last_active":"2023-10-06T11:10:36.552497+0000","last_peered":"2023-10-06T11:10:36.552497+0000","last_clean":"2023-10-06T11:10:36.552497+0000","last_became_active":"2023-10-06T11:10:35.564219+0000","last_became_peered":"2023-10-06T11:10:35.564219+0000","last_unstale":"2023-10-06T11:10:36.552497+0000","last_undegraded":"2023-10-06T11:10:36.552497+0000","last_fullsized":"2023-10-06T11:10:36.552497+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:30:47.836534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.577064+0000","last_change":"2023-10-06T11:10:36.575443+0000","last_active":"2023-10-06T11:10:36.577064+0000","last_peered":"2023-10-06T11:10:36.577064+0000","last_clean":"2023-10-06T11:10:36.577064+0000","last_became_active":"2023-10-06T11:10:36.575101+0000","last_became_peered":"2023-10-06T11:10:36.575101+0000","last_unstale":"2023-10-06T11:10:36.577064+0000","last_undegraded":"2023-10-06T11:10:36.577064+0000","last_fullsized":"2023-10-06T11:10:36.577064+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:48:31.202941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"74'8","reported_seq":18,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.572593+0000","last_change":"2023-10-06T11:10:35.556135+0000","last_active":"2023-10-06T11:10:36.572593+0000","last_peered":"2023-10-06T11:10:36.572593+0000","last_clean":"2023-10-06T11:10:36.572593+0000","last_became_active":"2023-10-06T11:10:35.555884+0000","last_became_peered":"2023-10-06T11:10:35.555884+0000","last_unstale":"2023-10-06T11:10:36.572593+0000","last_undegraded":"2023-10-06T11:10:36.572593+0000","last_fullsized":"2023-10-06T11:10:36.572593+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:24:06.535152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.570365+0000","last_change":"2023-10-06T11:10:36.566853+0000","last_active":"2023-10-06T11:10:36.570365+0000","last_peered":"2023-10-06T11:10:36.570365+0000","last_clean":"2023-10-06T11:10:36.570365+0000","last_became_active":"2023-10-06T11:10:36.566589+0000","last_became_peered":"2023-10-06T11:10:36.566589+0000","last_unstale":"2023-10-06T11:10:36.570365+0000","last_undegraded":"2023-10-06T11:10:36.570365+0000","last_fullsized":"2023-10-06T11:10:36.570365+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:11:53.044428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"74'2","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.578092+0000","last_change":"2023-10-06T11:10:35.563007+0000","last_active":"2023-10-06T11:10:36.578092+0000","last_peered":"2023-10-06T11:10:36.578092+0000","last_clean":"2023-10-06T11:10:36.578092+0000","last_became_active":"2023-10-06T11:10:35.562469+0000","last_became_peered":"2023-10-06T11:10:35.562469+0000","last_unstale":"2023-10-06T11:10:36.578092+0000","last_undegraded":"2023-10-06T11:10:36.578092+0000","last_fullsized":"2023-10-06T11:10:36.578092+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:00.332870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.577016+0000","last_change":"2023-10-06T11:10:36.575103+0000","last_active":"2023-10-06T11:10:36.577016+0000","last_peered":"2023-10-06T11:10:36.577016+0000","last_clean":"2023-10-06T11:10:36.577016+0000","last_became_active":"2023-10-06T11:10:36.571536+0000","last_became_peered":"2023-10-06T11:10:36.571536+0000","last_unstale":"2023-10-06T11:10:36.577016+0000","last_undegraded":"2023-10-06T11:10:36.577016+0000","last_fullsized":"2023-10-06T11:10:36.577016+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:14:16.648125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"75'1","reported_seq":11,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-10-06T11:10:38.802648+0000","last_change":"2023-10-06T11:10:35.560230+0000","last_active":"2023-10-06T11:10:38.802648+0000","last_peered":"2023-10-06T11:10:38.802648+0000","last_clean":"2023-10-06T11:10:38.802648+0000","last_became_active":"2023-10-06T11:10:35.559955+0000","last_became_peered":"2023-10-06T11:10:35.559955+0000","last_unstale":"2023-10-06T11:10:38.802648+0000","last_undegraded":"2023-10-06T11:10:38.802648+0000","last_fullsized":"2023-10-06T11:10:38.802648+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:58.839836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.574937+0000","last_change":"2023-10-06T11:10:36.564609+0000","last_active":"2023-10-06T11:10:36.574937+0000","last_peered":"2023-10-06T11:10:36.574937+0000","last_clean":"2023-10-06T11:10:36.574937+0000","last_became_active":"2023-10-06T11:10:36.563769+0000","last_became_peered":"2023-10-06T11:10:36.563769+0000","last_unstale":"2023-10-06T11:10:36.574937+0000","last_undegraded":"2023-10-06T11:10:36.574937+0000","last_fullsized":"2023-10-06T11:10:36.574937+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:49:54.089077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.561809+0000","last_change":"2023-10-06T11:10:35.566590+0000","last_active":"2023-10-06T11:10:36.561809+0000","last_peered":"2023-10-06T11:10:36.561809+0000","last_clean":"2023-10-06T11:10:36.561809+0000","last_became_active":"2023-10-06T11:10:35.566333+0000","last_became_peered":"2023-10-06T11:10:35.566333+0000","last_unstale":"2023-10-06T11:10:36.561809+0000","last_undegraded":"2023-10-06T11:10:36.561809+0000","last_fullsized":"2023-10-06T11:10:36.561809+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:53:16.617219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.569515+0000","last_change":"2023-10-06T11:10:36.567876+0000","last_active":"2023-10-06T11:10:36.569515+0000","last_peered":"2023-10-06T11:10:36.569515+0000","last_clean":"2023-10-06T11:10:36.569515+0000","last_became_active":"2023-10-06T11:10:36.567624+0000","last_became_peered":"2023-10-06T11:10:36.567624+0000","last_unstale":"2023-10-06T11:10:36.569515+0000","last_undegraded":"2023-10-06T11:10:36.569515+0000","last_fullsized":"2023-10-06T11:10:36.569515+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:19:37.338051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.560860+0000","last_change":"2023-10-06T11:10:35.561355+0000","last_active":"2023-10-06T11:10:36.560860+0000","last_peered":"2023-10-06T11:10:36.560860+0000","last_clean":"2023-10-06T11:10:36.560860+0000","last_became_active":"2023-10-06T11:10:35.560750+0000","last_became_peered":"2023-10-06T11:10:35.560750+0000","last_unstale":"2023-10-06T11:10:36.560860+0000","last_undegraded":"2023-10-06T11:10:36.560860+0000","last_fullsized":"2023-10-06T11:10:36.560860+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:58.839836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.577136+0000","last_change":"2023-10-06T11:10:36.575237+0000","last_active":"2023-10-06T11:10:36.577136+0000","last_peered":"2023-10-06T11:10:36.577136+0000","last_clean":"2023-10-06T11:10:36.577136+0000","last_became_active":"2023-10-06T11:10:36.574982+0000","last_became_peered":"2023-10-06T11:10:36.574982+0000","last_unstale":"2023-10-06T11:10:36.577136+0000","last_undegraded":"2023-10-06T11:10:36.577136+0000","last_fullsized":"2023-10-06T11:10:36.577136+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:01.339658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.565298+0000","last_change":"2023-10-06T11:10:35.558225+0000","last_active":"2023-10-06T11:10:36.565298+0000","last_peered":"2023-10-06T11:10:36.565298+0000","last_clean":"2023-10-06T11:10:36.565298+0000","last_became_active":"2023-10-06T11:10:35.557900+0000","last_became_peered":"2023-10-06T11:10:35.557900+0000","last_unstale":"2023-10-06T11:10:36.565298+0000","last_undegraded":"2023-10-06T11:10:36.565298+0000","last_fullsized":"2023-10-06T11:10:36.565298+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:35:59.639899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.567371+0000","last_change":"2023-10-06T11:10:36.563208+0000","last_active":"2023-10-06T11:10:36.567371+0000","last_peered":"2023-10-06T11:10:36.567371+0000","last_clean":"2023-10-06T11:10:36.567371+0000","last_became_active":"2023-10-06T11:10:36.562940+0000","last_became_peered":"2023-10-06T11:10:36.562940+0000","last_unstale":"2023-10-06T11:10:36.567371+0000","last_undegraded":"2023-10-06T11:10:36.567371+0000","last_fullsized":"2023-10-06T11:10:36.567371+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:56:41.535270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.555578+0000","last_change":"2023-10-06T11:10:35.561390+0000","last_active":"2023-10-06T11:10:36.555578+0000","last_peered":"2023-10-06T11:10:36.555578+0000","last_clean":"2023-10-06T11:10:36.555578+0000","last_became_active":"2023-10-06T11:10:35.561115+0000","last_became_peered":"2023-10-06T11:10:35.561115+0000","last_unstale":"2023-10-06T11:10:36.555578+0000","last_undegraded":"2023-10-06T11:10:36.555578+0000","last_fullsized":"2023-10-06T11:10:36.555578+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:01.065689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.567564+0000","last_change":"2023-10-06T11:10:36.563759+0000","last_active":"2023-10-06T11:10:36.567564+0000","last_peered":"2023-10-06T11:10:36.567564+0000","last_clean":"2023-10-06T11:10:36.567564+0000","last_became_active":"2023-10-06T11:10:36.563501+0000","last_became_peered":"2023-10-06T11:10:36.563501+0000","last_unstale":"2023-10-06T11:10:36.567564+0000","last_undegraded":"2023-10-06T11:10:36.567564+0000","last_fullsized":"2023-10-06T11:10:36.567564+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:08.343433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.566526+0000","last_change":"2023-10-06T11:10:35.564323+0000","last_active":"2023-10-06T11:10:36.566526+0000","last_peered":"2023-10-06T11:10:36.566526+0000","last_clean":"2023-10-06T11:10:36.566526+0000","last_became_active":"2023-10-06T11:10:35.564037+0000","last_became_peered":"2023-10-06T11:10:35.564037+0000","last_unstale":"2023-10-06T11:10:36.566526+0000","last_undegraded":"2023-10-06T11:10:36.566526+0000","last_fullsized":"2023-10-06T11:10:36.566526+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:28:03.257860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.574750+0000","last_change":"2023-10-06T11:10:36.567132+0000","last_active":"2023-10-06T11:10:36.574750+0000","last_peered":"2023-10-06T11:10:36.574750+0000","last_clean":"2023-10-06T11:10:36.574750+0000","last_became_active":"2023-10-06T11:10:36.566866+0000","last_became_peered":"2023-10-06T11:10:36.566866+0000","last_unstale":"2023-10-06T11:10:36.574750+0000","last_undegraded":"2023-10-06T11:10:36.574750+0000","last_fullsized":"2023-10-06T11:10:36.574750+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:48:31.202941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.552746+0000","last_change":"2023-10-06T11:10:35.552191+0000","last_active":"2023-10-06T11:10:36.552746+0000","last_peered":"2023-10-06T11:10:36.552746+0000","last_clean":"2023-10-06T11:10:36.552746+0000","last_became_active":"2023-10-06T11:10:35.551916+0000","last_became_peered":"2023-10-06T11:10:35.551916+0000","last_unstale":"2023-10-06T11:10:36.552746+0000","last_undegraded":"2023-10-06T11:10:36.552746+0000","last_fullsized":"2023-10-06T11:10:36.552746+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:07:42.227450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.569711+0000","last_change":"2023-10-06T11:10:36.564192+0000","last_active":"2023-10-06T11:10:36.569711+0000","last_peered":"2023-10-06T11:10:36.569711+0000","last_clean":"2023-10-06T11:10:36.569711+0000","last_became_active":"2023-10-06T11:10:36.563906+0000","last_became_peered":"2023-10-06T11:10:36.563906+0000","last_unstale":"2023-10-06T11:10:36.569711+0000","last_undegraded":"2023-10-06T11:10:36.569711+0000","last_fullsized":"2023-10-06T11:10:36.569711+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:25:09.293990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"74'1","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.570653+0000","last_change":"2023-10-06T11:10:35.566516+0000","last_active":"2023-10-06T11:10:36.570653+0000","last_peered":"2023-10-06T11:10:36.570653+0000","last_clean":"2023-10-06T11:10:36.570653+0000","last_became_active":"2023-10-06T11:10:35.566258+0000","last_became_peered":"2023-10-06T11:10:35.566258+0000","last_unstale":"2023-10-06T11:10:36.570653+0000","last_undegraded":"2023-10-06T11:10:36.570653+0000","last_fullsized":"2023-10-06T11:10:36.570653+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:16:46.568672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":64,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.554187+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:10:36.554187+0000","last_peered":"2023-10-06T11:10:36.554187+0000","last_clean":"2023-10-06T11:10:36.554187+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:10:36.554187+0000","last_undegraded":"2023-10-06T11:10:36.554187+0000","last_fullsized":"2023-10-06T11:10:36.554187+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.573936+0000","last_change":"2023-10-06T11:10:36.571793+0000","last_active":"2023-10-06T11:10:36.573936+0000","last_peered":"2023-10-06T11:10:36.573936+0000","last_clean":"2023-10-06T11:10:36.573936+0000","last_became_active":"2023-10-06T11:10:36.570825+0000","last_became_peered":"2023-10-06T11:10:36.570825+0000","last_unstale":"2023-10-06T11:10:36.573936+0000","last_undegraded":"2023-10-06T11:10:36.573936+0000","last_fullsized":"2023-10-06T11:10:36.573936+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:19:36.820943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"74'2","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.568892+0000","last_change":"2023-10-06T11:10:35.565002+0000","last_active":"2023-10-06T11:10:36.568892+0000","last_peered":"2023-10-06T11:10:36.568892+0000","last_clean":"2023-10-06T11:10:36.568892+0000","last_became_active":"2023-10-06T11:10:35.564718+0000","last_became_peered":"2023-10-06T11:10:35.564718+0000","last_unstale":"2023-10-06T11:10:36.568892+0000","last_undegraded":"2023-10-06T11:10:36.568892+0000","last_fullsized":"2023-10-06T11:10:36.568892+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:12:22.762358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":61,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.555836+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:10:36.555836+0000","last_peered":"2023-10-06T11:10:36.555836+0000","last_clean":"2023-10-06T11:10:36.555836+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:10:36.555836+0000","last_undegraded":"2023-10-06T11:10:36.555836+0000","last_fullsized":"2023-10-06T11:10:36.555836+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.569447+0000","last_change":"2023-10-06T11:10:36.565645+0000","last_active":"2023-10-06T11:10:36.569447+0000","last_peered":"2023-10-06T11:10:36.569447+0000","last_clean":"2023-10-06T11:10:36.569447+0000","last_became_active":"2023-10-06T11:10:36.565407+0000","last_became_peered":"2023-10-06T11:10:36.565407+0000","last_unstale":"2023-10-06T11:10:36.569447+0000","last_undegraded":"2023-10-06T11:10:36.569447+0000","last_fullsized":"2023-10-06T11:10:36.569447+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:47:37.286952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.555136+0000","last_change":"2023-10-06T11:10:35.561062+0000","last_active":"2023-10-06T11:10:36.555136+0000","last_peered":"2023-10-06T11:10:36.555136+0000","last_clean":"2023-10-06T11:10:36.555136+0000","last_became_active":"2023-10-06T11:10:35.560873+0000","last_became_peered":"2023-10-06T11:10:35.560873+0000","last_unstale":"2023-10-06T11:10:36.555136+0000","last_undegraded":"2023-10-06T11:10:36.555136+0000","last_fullsized":"2023-10-06T11:10:36.555136+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:54:52.795843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":58,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.552980+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:10:36.552980+0000","last_peered":"2023-10-06T11:10:36.552980+0000","last_clean":"2023-10-06T11:10:36.552980+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:10:36.552980+0000","last_undegraded":"2023-10-06T11:10:36.552980+0000","last_fullsized":"2023-10-06T11:10:36.552980+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":205,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.560121+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:10:36.560121+0000","last_peered":"2023-10-06T11:10:36.560121+0000","last_clean":"2023-10-06T11:10:36.560121+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:10:36.560121+0000","last_undegraded":"2023-10-06T11:10:36.560121+0000","last_fullsized":"2023-10-06T11:10:36.560121+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.577078+0000","last_change":"2023-10-06T11:10:36.575734+0000","last_active":"2023-10-06T11:10:36.577078+0000","last_peered":"2023-10-06T11:10:36.577078+0000","last_clean":"2023-10-06T11:10:36.577078+0000","last_became_active":"2023-10-06T11:10:36.575475+0000","last_became_peered":"2023-10-06T11:10:36.575475+0000","last_unstale":"2023-10-06T11:10:36.577078+0000","last_undegraded":"2023-10-06T11:10:36.577078+0000","last_fullsized":"2023-10-06T11:10:36.577078+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:29:08.343433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.555340+0000","last_change":"2023-10-06T11:10:35.560631+0000","last_active":"2023-10-06T11:10:36.555340+0000","last_peered":"2023-10-06T11:10:36.555340+0000","last_clean":"2023-10-06T11:10:36.555340+0000","last_became_active":"2023-10-06T11:10:35.560377+0000","last_became_peered":"2023-10-06T11:10:35.560377+0000","last_unstale":"2023-10-06T11:10:36.555340+0000","last_undegraded":"2023-10-06T11:10:36.555340+0000","last_fullsized":"2023-10-06T11:10:36.555340+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:16:25.755999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":55,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.559944+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:10:36.559944+0000","last_peered":"2023-10-06T11:10:36.559944+0000","last_clean":"2023-10-06T11:10:36.559944+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:10:36.559944+0000","last_undegraded":"2023-10-06T11:10:36.559944+0000","last_fullsized":"2023-10-06T11:10:36.559944+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.573903+0000","last_change":"2023-10-06T11:10:36.568248+0000","last_active":"2023-10-06T11:10:36.573903+0000","last_peered":"2023-10-06T11:10:36.573903+0000","last_clean":"2023-10-06T11:10:36.573903+0000","last_became_active":"2023-10-06T11:10:36.567920+0000","last_became_peered":"2023-10-06T11:10:36.567920+0000","last_unstale":"2023-10-06T11:10:36.573903+0000","last_undegraded":"2023-10-06T11:10:36.573903+0000","last_fullsized":"2023-10-06T11:10:36.573903+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:21:08.092457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.556333+0000","last_change":"2023-10-06T11:10:35.560592+0000","last_active":"2023-10-06T11:10:36.556333+0000","last_peered":"2023-10-06T11:10:36.556333+0000","last_clean":"2023-10-06T11:10:36.556333+0000","last_became_active":"2023-10-06T11:10:35.560329+0000","last_became_peered":"2023-10-06T11:10:35.560329+0000","last_unstale":"2023-10-06T11:10:36.556333+0000","last_undegraded":"2023-10-06T11:10:36.556333+0000","last_fullsized":"2023-10-06T11:10:36.556333+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:26:58.839836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":55,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.560200+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:10:36.560200+0000","last_peered":"2023-10-06T11:10:36.560200+0000","last_clean":"2023-10-06T11:10:36.560200+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:10:36.560200+0000","last_undegraded":"2023-10-06T11:10:36.560200+0000","last_fullsized":"2023-10-06T11:10:36.560200+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.561117+0000","last_change":"2023-10-06T11:10:36.558548+0000","last_active":"2023-10-06T11:10:36.561117+0000","last_peered":"2023-10-06T11:10:36.561117+0000","last_clean":"2023-10-06T11:10:36.561117+0000","last_became_active":"2023-10-06T11:10:36.558291+0000","last_became_peered":"2023-10-06T11:10:36.558291+0000","last_unstale":"2023-10-06T11:10:36.561117+0000","last_undegraded":"2023-10-06T11:10:36.561117+0000","last_fullsized":"2023-10-06T11:10:36.561117+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:37:30.485830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"74'2","reported_seq":12,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.564728+0000","last_change":"2023-10-06T11:10:35.562699+0000","last_active":"2023-10-06T11:10:36.564728+0000","last_peered":"2023-10-06T11:10:36.564728+0000","last_clean":"2023-10-06T11:10:36.564728+0000","last_became_active":"2023-10-06T11:10:35.562460+0000","last_became_peered":"2023-10-06T11:10:35.562460+0000","last_unstale":"2023-10-06T11:10:36.564728+0000","last_undegraded":"2023-10-06T11:10:36.564728+0000","last_fullsized":"2023-10-06T11:10:36.564728+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:35.057797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":66,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.554642+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:10:36.554642+0000","last_peered":"2023-10-06T11:10:36.554642+0000","last_clean":"2023-10-06T11:10:36.554642+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:10:36.554642+0000","last_undegraded":"2023-10-06T11:10:36.554642+0000","last_fullsized":"2023-10-06T11:10:36.554642+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.571371+0000","last_change":"2023-10-06T11:10:36.564019+0000","last_active":"2023-10-06T11:10:36.571371+0000","last_peered":"2023-10-06T11:10:36.571371+0000","last_clean":"2023-10-06T11:10:36.571371+0000","last_became_active":"2023-10-06T11:10:36.563744+0000","last_became_peered":"2023-10-06T11:10:36.563744+0000","last_unstale":"2023-10-06T11:10:36.571371+0000","last_undegraded":"2023-10-06T11:10:36.571371+0000","last_fullsized":"2023-10-06T11:10:36.571371+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:15:56.228848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.553065+0000","last_change":"2023-10-06T11:10:35.558406+0000","last_active":"2023-10-06T11:10:36.553065+0000","last_peered":"2023-10-06T11:10:36.553065+0000","last_clean":"2023-10-06T11:10:36.553065+0000","last_became_active":"2023-10-06T11:10:35.558197+0000","last_became_peered":"2023-10-06T11:10:35.558197+0000","last_unstale":"2023-10-06T11:10:36.553065+0000","last_undegraded":"2023-10-06T11:10:36.553065+0000","last_fullsized":"2023-10-06T11:10:36.553065+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:54:06.008551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":59,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.566899+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:10:36.566899+0000","last_peered":"2023-10-06T11:10:36.566899+0000","last_clean":"2023-10-06T11:10:36.566899+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:10:36.566899+0000","last_undegraded":"2023-10-06T11:10:36.566899+0000","last_fullsized":"2023-10-06T11:10:36.566899+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.572723+0000","last_change":"2023-10-06T11:10:36.566671+0000","last_active":"2023-10-06T11:10:36.572723+0000","last_peered":"2023-10-06T11:10:36.572723+0000","last_clean":"2023-10-06T11:10:36.572723+0000","last_became_active":"2023-10-06T11:10:36.566239+0000","last_became_peered":"2023-10-06T11:10:36.566239+0000","last_unstale":"2023-10-06T11:10:36.572723+0000","last_undegraded":"2023-10-06T11:10:36.572723+0000","last_fullsized":"2023-10-06T11:10:36.572723+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:35.538922+0000","last_clean_scrub_stamp":"2023-10-06T11:10:35.538922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:43:02.347085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"74'1","reported_seq":11,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.577849+0000","last_change":"2023-10-06T11:10:35.565730+0000","last_active":"2023-10-06T11:10:36.577849+0000","last_peered":"2023-10-06T11:10:36.577849+0000","last_clean":"2023-10-06T11:10:36.577849+0000","last_became_active":"2023-10-06T11:10:35.565461+0000","last_became_peered":"2023-10-06T11:10:35.565461+0000","last_unstale":"2023-10-06T11:10:36.577849+0000","last_undegraded":"2023-10-06T11:10:36.577849+0000","last_fullsized":"2023-10-06T11:10:36.577849+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:10:34.532134+0000","last_clean_scrub_stamp":"2023-10-06T11:10:34.532134+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:16:47.518450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":59,"reported_epoch":74,"state":"active+clean","last_fresh":"2023-10-06T11:10:36.571251+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:10:36.571251+0000","last_peered":"2023-10-06T11:10:36.571251+0000","last_clean":"2023-10-06T11:10:36.571251+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:10:36.571251+0000","last_undegraded":"2023-10-06T11:10:36.571251+0000","last_fullsized":"2023-10-06T11:10:36.571251+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574912,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298764,"kb_used_data":1476,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073076,"statfs":{"total":96636764160,"available":96330829824,"internally_reserved":0,"allocated":1511424,"data_stored":1002123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":0.872,"15min":0.61399999999999999},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":15.506,"5min":23.908999999999999,"15min":23.908999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.70599999999999996,"15min":0.59099999999999997},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":9.3230000000000004,"5min":9.3230000000000004,"15min":9.3230000000000004},"last":0.38700000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.63400000000000001,"15min":0.56899999999999995},"min":{"1min":0.29999999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71399999999999997,"5min":9.2360000000000007,"15min":9.2360000000000007},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.53200000000000003,"15min":0.51400000000000001},"min":{"1min":0.308,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.60399999999999998,"5min":4.327,"15min":4.327},"last":0.48499999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.5,"15min":0.50800000000000001},"min":{"1min":0.33200000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.63500000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.59599999999999997,"15min":0.55800000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.74299999999999999,"5min":4.7309999999999999,"15min":4.7309999999999999},"last":0.46400000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56999999999999995,"15min":0.52000000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.7609999999999999,"5min":4.3540000000000001,"15min":4.3540000000000001},"last":0.443},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.67500000000000004,"15min":0.60099999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.125,"5min":9.3879999999999999,"15min":9.3879999999999999},"last":0.61899999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.50800000000000001,"15min":0.47499999999999998},"min":{"1min":0.25,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.66100000000000003,"5min":4.5709999999999997,"15min":4.5709999999999997},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.54600000000000004,"15min":0.53100000000000003},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.71299999999999997,"5min":4.3129999999999997,"15min":4.3129999999999997},"last":0.69899999999999995}]},{"osd":5,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.63300000000000001,"15min":0.57799999999999996},"min":{"1min":0.29399999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.84699999999999998,"5min":9.3499999999999996,"15min":9.3499999999999996},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.57499999999999996,"15min":0.56399999999999995},"min":{"1min":0.36099999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.77200000000000002,"5min":4.444,"15min":4.444},"last":0.64000000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.66400000000000003,"15min":0.61899999999999999},"min":{"1min":0.39200000000000002,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.81399999999999995,"5min":9.4969999999999999,"15min":9.4969999999999999},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.65600000000000003,"15min":0.61799999999999999},"min":{"1min":0.40300000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.88200000000000001,"5min":7.2039999999999997,"15min":7.2039999999999997},"last":0.74099999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574914,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310476,"kb_used_data":900,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061364,"statfs":{"total":96636764160,"available":96318836736,"internally_reserved":0,"allocated":921600,"data_stored":411916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:42 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48199999999999998,"15min":0.497},"min":{"1min":0.23799999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.64300000000000002,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.51500000000000001,"15min":0.53100000000000003},"min":{"1min":0.35899999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.63,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.65600000000000003}]},{"osd":1,"last update":"Fri Oct 6 11:09:42 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.47899999999999998,"15min":0.498},"min":{"1min":0.26400000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.629,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.47499999999999998,"15min":0.496},"min":{"1min":0.379,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.55400000000000005,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.55300000000000005}]},{"osd":2,"last update":"Fri Oct 6 11:09:42 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.53300000000000003,"15min":0.499},"min":{"1min":0.31900000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.65800000000000003,"5min":7.0659999999999998,"15min":7.0659999999999998},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.55700000000000005,"15min":0.52700000000000002},"min":{"1min":0.29899999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.75800000000000001,"5min":7.0819999999999999,"15min":7.0819999999999999},"last":0.64500000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:09:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.504,"15min":0.496},"min":{"1min":0.436,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.65500000000000003,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53100000000000003,"15min":0.53700000000000003},"min":{"1min":0.40000000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.72399999999999998,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.53000000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:09:42 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.47599999999999998,"15min":0.503},"min":{"1min":0.30399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.52400000000000002,"15min":0.56200000000000006},"min":{"1min":0.33100000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.69399999999999995,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.59999999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:09:42 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51300000000000001,"15min":0.53500000000000003},"min":{"1min":0.313,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.69299999999999995,"5min":0.75,"15min":0.75},"last":0.627},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54800000000000004,"15min":0.58199999999999996},"min":{"1min":0.34499999999999997,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.78800000000000003,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.56499999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:09:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55600000000000005,"15min":0.57499999999999996},"min":{"1min":0.377,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71699999999999997,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.5},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58299999999999996,"15min":0.60499999999999998},"min":{"1min":0.36699999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.754,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.70299999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311056,"kb_used_data":1480,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060784,"statfs":{"total":96636764160,"available":96318242816,"internally_reserved":0,"allocated":1515520,"data_stored":1002213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.33200000000000002,"15min":0.34200000000000003},"min":{"1min":0.24199999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"min":{"1min":0.215,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.28899999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.34399999999999997,"15min":0.33600000000000002},"min":{"1min":0.23599999999999999,"5min":0.22,"15min":0.22},"max":{"1min":1.351,"5min":1.351,"15min":1.351},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.432,"5min":0.39600000000000002,"15min":0.38900000000000001},"min":{"1min":0.26500000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.42899999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.41399999999999998,"15min":0.41099999999999998},"min":{"1min":0.28299999999999997,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.68999999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.38100000000000001,"15min":0.36899999999999999},"min":{"1min":0.29799999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.39700000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.53000000000000003,"15min":0.50800000000000001},"min":{"1min":0.34399999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55800000000000005,"15min":0.54000000000000004},"min":{"1min":0.45300000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.63200000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55900000000000005,"15min":0.54900000000000004},"min":{"1min":0.38800000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.56299999999999994,"15min":0.54100000000000004},"min":{"1min":0.40000000000000002,"5min":0.37,"15min":0.37},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.60499999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57199999999999995,"15min":0.56200000000000006},"min":{"1min":0.36899999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.59199999999999997,"15min":0.57399999999999995},"min":{"1min":0.376,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.65500000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:09:41 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.59999999999999998,"15min":0.58999999999999997},"min":{"1min":0.48699999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.84299999999999997,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58499999999999996,"15min":0.58099999999999996},"min":{"1min":0.42899999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.66200000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574912,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302272,"kb_used_data":888,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069568,"statfs":{"total":96636764160,"available":96327237632,"internally_reserved":0,"allocated":909312,"data_stored":410380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":1.9379999999999999,"5min":0.64700000000000002,"15min":0.44},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":36.097999999999999,"5min":36.097999999999999,"15min":36.097999999999999},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.35999999999999999,"15min":0.34699999999999998},"min":{"1min":0.182,"5min":0.182,"15min":0.182},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":0.34999999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":1.9810000000000001,"5min":0.69099999999999995,"15min":0.48299999999999998},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":36.07,"5min":36.07,"15min":36.07},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.40000000000000002,"15min":0.379},"min":{"1min":0.23200000000000001,"5min":0.219,"15min":0.219},"max":{"1min":5.125,"5min":5.125,"15min":5.125},"last":0.39800000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.44,"15min":0.39600000000000002},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":8.4130000000000003,"5min":8.4130000000000003,"15min":8.4130000000000003},"last":0.374},{"interface":"front","average":{"1min":2.0030000000000001,"5min":0.74399999999999999,"15min":0.54200000000000004},"min":{"1min":0.30199999999999999,"5min":0.252,"15min":0.252},"max":{"1min":35.959000000000003,"5min":35.959000000000003,"15min":35.959000000000003},"last":0.44400000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.56799999999999995,"15min":0.56299999999999994},"min":{"1min":0.48199999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.52500000000000002},{"interface":"front","average":{"1min":2.2120000000000002,"5min":0.92700000000000005,"15min":0.72099999999999997},"min":{"1min":0.48999999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":36.005000000000003,"5min":36.005000000000003,"15min":36.005000000000003},"last":0.60099999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.55700000000000005,"15min":0.55400000000000005},"min":{"1min":0.433,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.56299999999999994,"15min":0.54900000000000004},"min":{"1min":0.45700000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.56100000000000005}]},{"osd":6,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":2.194,"5min":0.91900000000000004,"15min":0.71699999999999997},"min":{"1min":0.47199999999999998,"5min":0.375,"15min":0.375},"max":{"1min":36.037999999999997,"5min":36.037999999999997,"15min":36.037999999999997},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.63900000000000001,"15min":0.61699999999999999},"min":{"1min":0.434,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":4.8810000000000002,"5min":4.8810000000000002,"15min":4.8810000000000002},"last":0.68100000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60599999999999998,"15min":0.60799999999999998},"min":{"1min":0.41499999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":2.3530000000000002,"5min":2.3530000000000002,"15min":2.3530000000000002},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.44500000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.54500000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574913,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":314572,"kb_used_data":900,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94057268,"statfs":{"total":96636764160,"available":96314642432,"internally_reserved":0,"allocated":921600,"data_stored":411094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.307,"15min":0.308},"min":{"1min":0.218,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.39700000000000002,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.20999999999999999},{"interface":"front","average":{"1min":0.35499999999999998,"5min":0.375,"15min":0.38300000000000001},"min":{"1min":0.27700000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.53300000000000003,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.29899999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36599999999999999,"15min":0.374},"min":{"1min":0.252,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.56299999999999994,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.35399999999999998,"15min":0.34799999999999998},"min":{"1min":0.249,"5min":0.217,"15min":0.217},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.22800000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.36699999999999999,"15min":0.372},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.628,"5min":0.629,"15min":0.629},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.35899999999999999,"15min":0.36499999999999999},"min":{"1min":0.26200000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.47699999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.28000000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.36599999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.77500000000000002,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55500000000000005,"15min":0.55900000000000005},"min":{"1min":0.42599999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.72299999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.53700000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.35999999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.67600000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55700000000000005,"15min":0.55300000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.72999999999999998,"5min":0.87,"15min":0.87},"last":0.54900000000000004}]},{"osd":6,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.58699999999999997,"15min":0.58499999999999996},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.76000000000000001,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.57599999999999996,"15min":0.57799999999999996},"min":{"1min":0.39400000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.72199999999999998,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.52400000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:09:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56799999999999995,"15min":0.55300000000000005},"min":{"1min":0.40200000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.76600000000000001,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.5},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57299999999999995,"15min":0.57099999999999995},"min":{"1min":0.40200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73499999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.44500000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574913,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298180,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073660,"statfs":{"total":96636764160,"available":96331427840,"internally_reserved":0,"allocated":913408,"data_stored":410934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.313,"15min":0.32700000000000001},"min":{"1min":0.218,"5min":0.188,"15min":0.188},"max":{"1min":0.47099999999999997,"5min":1.095,"15min":1.095},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.38,"15min":0.40200000000000002},"min":{"1min":0.30399999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.52400000000000002,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":0.47299999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.313,"15min":0.309},"min":{"1min":0.23200000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.46899999999999997,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.35999999999999999,"15min":0.37},"min":{"1min":0.25900000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.48599999999999999,"5min":1.196,"15min":1.196},"last":0.44}]},{"osd":2,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.374,"15min":0.39200000000000002},"min":{"1min":0.26500000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.54000000000000004,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.40799999999999997,"15min":0.42199999999999999},"min":{"1min":0.32700000000000001,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.55900000000000005,"5min":1.224,"15min":1.224},"last":0.46300000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.55400000000000005,"15min":0.57399999999999995},"min":{"1min":0.41699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.69399999999999995,"5min":1.694,"15min":1.694},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.54600000000000004,"15min":0.54800000000000004},"min":{"1min":0.46400000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.65800000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.54600000000000004,"15min":0.52800000000000002},"min":{"1min":0.436,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.79400000000000004,"5min":0.878,"15min":0.878},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55900000000000005,"15min":0.56699999999999995},"min":{"1min":0.49399999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.72699999999999998,"5min":1.165,"15min":1.165},"last":0.60999999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.58699999999999997,"15min":0.59499999999999997},"min":{"1min":0.46200000000000002,"5min":0.378,"15min":0.378},"max":{"1min":0.81299999999999994,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.621,"5min":0.59599999999999997,"15min":0.60599999999999998},"min":{"1min":0.47099999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78000000000000003,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":0.752}]},{"osd":7,"last update":"Fri Oct 6 11:09:44 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58199999999999996,"15min":0.59599999999999997},"min":{"1min":0.44800000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.74199999999999999,"5min":1.657,"15min":1.657},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.47899999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83399999999999996,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.63600000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574912,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298200,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073640,"statfs":{"total":96636764160,"available":96331407360,"internally_reserved":0,"allocated":933888,"data_stored":413373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.51800000000000002,"15min":0.59299999999999997},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.76600000000000001,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.49199999999999999,"15min":0.502},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.51800000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.54400000000000004,"15min":0.61799999999999999},"min":{"1min":0.35999999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.70899999999999996,"5min":2.8650000000000002,"15min":2.8650000000000002},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55300000000000005,"15min":0.621},"min":{"1min":0.33400000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.72399999999999998,"5min":2.7610000000000001,"15min":2.7610000000000001},"last":0.58699999999999997}]},{"osd":2,"last update":"Fri Oct 6 11:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.57699999999999996},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.78200000000000003,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58599999999999997,"15min":0.61799999999999999},"min":{"1min":0.45400000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.77400000000000002,"5min":1.718,"15min":1.718},"last":0.57399999999999995}]},{"osd":3,"last update":"Fri Oct 6 11:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.57799999999999996,"15min":0.64000000000000001},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.753,"5min":2.677,"15min":2.677},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.51600000000000001,"15min":0.52600000000000002},"min":{"1min":0.36799999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.747,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.53300000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.47099999999999997,"15min":0.497},"min":{"1min":0.33900000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.77600000000000002,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.52500000000000002,"15min":0.54700000000000004},"min":{"1min":0.35099999999999998,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.42399999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.51000000000000001,"15min":0.53400000000000003},"min":{"1min":0.34599999999999997,"5min":0.252,"15min":0.252},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.37},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.54900000000000004,"15min":0.59099999999999997},"min":{"1min":0.40699999999999997,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.82099999999999995,"5min":1.165,"15min":1.165},"last":0.40300000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:09:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.55200000000000005,"15min":0.56200000000000006},"min":{"1min":0.378,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.59099999999999997,"15min":0.61599999999999999},"min":{"1min":0.437,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80800000000000005,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.44700000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574914,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310472,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061368,"statfs":{"total":96636764160,"available":96318840832,"internally_reserved":0,"allocated":917504,"data_stored":411767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.61799999999999999,"15min":0.70799999999999996},"min":{"1min":0.28399999999999997,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.69499999999999995,"5min":5.0490000000000004,"15min":5.0490000000000004},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.57599999999999996,"15min":0.67600000000000005},"min":{"1min":0.28100000000000003,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.64700000000000002,"5min":5.1449999999999996,"15min":5.1449999999999996},"last":0.48899999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.48499999999999999,"15min":0.49099999999999999},"min":{"1min":0.27500000000000002,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.75600000000000001,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.52100000000000002,"15min":0.52900000000000003},"min":{"1min":0.30299999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.70999999999999996,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.42799999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57899999999999996,"15min":0.56699999999999995},"min":{"1min":0.41299999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.74099999999999999,"5min":4.234,"15min":4.234},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56699999999999995,"15min":0.57699999999999996},"min":{"1min":0.40000000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.72999999999999998,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.53200000000000003}]},{"osd":3,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.61499999999999999,"15min":0.72699999999999998},"min":{"1min":0.32600000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.72099999999999997,"5min":5.2169999999999996,"15min":5.2169999999999996},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54900000000000004,"15min":0.55500000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.70199999999999996,"5min":1.008,"15min":1.008},"last":0.501}]},{"osd":4,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.52200000000000002,"15min":0.53600000000000003},"min":{"1min":0.32700000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.745,"5min":1.917,"15min":1.917},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53700000000000003,"15min":0.55500000000000005},"min":{"1min":0.34399999999999997,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.68600000000000005,"5min":0.87,"15min":0.87},"last":0.36299999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.56999999999999995,"15min":0.58099999999999996},"min":{"1min":0.34100000000000003,"5min":0.318,"15min":0.318},"max":{"1min":0.68700000000000006,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.61399999999999999,"15min":0.629},"min":{"1min":0.42199999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.77200000000000002,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":0.51500000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:09:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58399999999999996,"15min":0.60699999999999998},"min":{"1min":0.39600000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.70199999999999996,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61499999999999999,"15min":0.628},"min":{"1min":0.38700000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.72999999999999998,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.39600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:10:45.496 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T11:10:45.496 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T11:10:45.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.649+0000 7f2e92eb5700 1 Processor -- start 2023-10-06T11:10:45.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.649+0000 7f2e92eb5700 1 -- start start 2023-10-06T11:10:45.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.650+0000 7f2e92eb5700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2e8c0b5640 0x7f2e8c15a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:45.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.650+0000 7f2e92eb5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2e8c068780 0x7f2e8c068c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:45.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.650+0000 7f2e92eb5700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e8c0cc130 con 0x7f2e8c0cb090 2023-10-06T11:10:45.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.650+0000 7f2e92eb5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e8c069140 con 0x7f2e8c068780 2023-10-06T11:10:45.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.650+0000 7f2e92eb5700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e8c0cccd0 con 0x7f2e8c0b5640 2023-10-06T11:10:45.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.650+0000 7f2e926b4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2e8c068780 0x7f2e8c068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:45.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.650+0000 7f2e926b4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2e8c068780 0x7f2e8c068c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51036/0 (socket says 172.21.15.146:51036) 2023-10-06T11:10:45.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.650+0000 7f2e926b4700 1 -- 172.21.15.146:0/2433823281 learned_addr learned my addr 172.21.15.146:0/2433823281 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:45.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.650+0000 7f2e91eb3700 1 --2- 172.21.15.146:0/2433823281 >> v2:172.21.15.151:3300/0 conn(0x7f2e8c0b5640 0x7f2e8c15a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:45.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.650+0000 7f2e926b4700 1 -- 172.21.15.146:0/2433823281 >> v2:172.21.15.151:3300/0 conn(0x7f2e8c0b5640 msgr2=0x7f2e8c15a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:45.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.650+0000 7f2e926b4700 1 --2- 172.21.15.146:0/2433823281 >> v2:172.21.15.151:3300/0 conn(0x7f2e8c0b5640 0x7f2e8c15a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:45.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.650+0000 7f2e926b4700 1 -- 172.21.15.146:0/2433823281 >> v1:172.21.15.151:6789/0 conn(0x7f2e8c0cb090 legacy=0x7f2e8c0cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:45.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.650+0000 7f2e926b4700 1 -- 172.21.15.146:0/2433823281 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e8c0b2660 con 0x7f2e8c068780 2023-10-06T11:10:45.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.651+0000 7f2e926b4700 1 --2- 172.21.15.146:0/2433823281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e8c068780 0x7f2e8c068c00 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f2e84009f20 tx=0x7f2e84009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7e641839c18980c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:45.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.651+0000 7f2e90eb1700 1 -- 172.21.15.146:0/2433823281 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8400e070 con 0x7f2e8c068780 2023-10-06T11:10:45.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.651+0000 7f2e90eb1700 1 -- 172.21.15.146:0/2433823281 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8400ba40 con 0x7f2e8c068780 2023-10-06T11:10:45.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.651+0000 7f2e90eb1700 1 -- 172.21.15.146:0/2433823281 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e840092e0 con 0x7f2e8c068780 2023-10-06T11:10:45.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.651+0000 7f2e92eb5700 1 -- 172.21.15.146:0/2433823281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e8c068780 msgr2=0x7f2e8c068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:45.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.651+0000 7f2e92eb5700 1 --2- 172.21.15.146:0/2433823281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e8c068780 0x7f2e8c068c00 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f2e84009f20 tx=0x7f2e84009840 comp rx=0 tx=0).stop 2023-10-06T11:10:45.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.651+0000 7f2e92eb5700 1 -- 172.21.15.146:0/2433823281 shutdown_connections 2023-10-06T11:10:45.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.651+0000 7f2e92eb5700 1 --2- 172.21.15.146:0/2433823281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e8c068780 0x7f2e8c068c00 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:45.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.651+0000 7f2e92eb5700 1 --2- 172.21.15.146:0/2433823281 >> v2:172.21.15.151:3300/0 conn(0x7f2e8c0b5640 0x7f2e8c15a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:45.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.651+0000 7f2e92eb5700 1 -- 172.21.15.146:0/2433823281 >> 172.21.15.146:0/2433823281 conn(0x7f2e8c0703f0 msgr2=0x7f2e8c0707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:45.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.651+0000 7f2e92eb5700 1 -- 172.21.15.146:0/2433823281 shutdown_connections 2023-10-06T11:10:45.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.651+0000 7f2e92eb5700 1 -- 172.21.15.146:0/2433823281 wait complete. 2023-10-06T11:10:45.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.652+0000 7f2e92eb5700 1 Processor -- start 2023-10-06T11:10:45.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.652+0000 7f2e92eb5700 1 -- start start 2023-10-06T11:10:45.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.653+0000 7f2e92eb5700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e8c068780 0x7f2e8c0c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:45.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.653+0000 7f2e92eb5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e8c0b5640 0x7f2e8c0c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:45.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.653+0000 7f2e92eb5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e8c0cb090 0x7f2e8c15ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:45.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.653+0000 7f2e92eb5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c0c71b0 con 0x7f2e8c0cb090 2023-10-06T11:10:45.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.653+0000 7f2e92eb5700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c154000 con 0x7f2e8c0b5640 2023-10-06T11:10:45.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.653+0000 7f2e92eb5700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c0c6ed0 con 0x7f2e8c068780 2023-10-06T11:10:45.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.653+0000 7f2e926b4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e8c0cb090 0x7f2e8c15ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:45.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.653+0000 7f2e926b4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e8c0cb090 0x7f2e8c15ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51040/0 (socket says 172.21.15.146:51040) 2023-10-06T11:10:45.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.653+0000 7f2e926b4700 1 -- 172.21.15.146:0/3924104135 learned_addr learned my addr 172.21.15.146:0/3924104135 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:45.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.653+0000 7f2e926b4700 1 -- 172.21.15.146:0/3924104135 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e8c068780 msgr2=0x7f2e8c0c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:45.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.653+0000 7f2e916b2700 1 --2- 172.21.15.146:0/3924104135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e8c0b5640 0x7f2e8c0c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:45.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.653+0000 7f2e926b4700 1 --2- 172.21.15.146:0/3924104135 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e8c068780 0x7f2e8c0c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:45.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.653+0000 7f2e926b4700 1 -- 172.21.15.146:0/3924104135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e8c0b5640 msgr2=0x7f2e8c0c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:45.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.653+0000 7f2e926b4700 1 --2- 172.21.15.146:0/3924104135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e8c0b5640 0x7f2e8c0c9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:45.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.653+0000 7f2e926b4700 1 -- 172.21.15.146:0/3924104135 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e84009ae0 con 0x7f2e8c0cb090 2023-10-06T11:10:45.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.653+0000 7f2e916b2700 1 --2- 172.21.15.146:0/3924104135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e8c0b5640 0x7f2e8c0c9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:10:45.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.654+0000 7f2e926b4700 1 --2- 172.21.15.146:0/3924104135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e8c0cb090 0x7f2e8c15ee00 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c0694f0 tx=0x7f2e84018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:45.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.654+0000 7f2e81ffb700 1 -- 172.21.15.146:0/3924104135 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e84008e40 con 0x7f2e8c0cb090 2023-10-06T11:10:45.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.654+0000 7f2e81ffb700 1 -- 172.21.15.146:0/3924104135 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e84026460 con 0x7f2e8c0cb090 2023-10-06T11:10:45.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.654+0000 7f2e81ffb700 1 -- 172.21.15.146:0/3924104135 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e84026800 con 0x7f2e8c0cb090 2023-10-06T11:10:45.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.654+0000 7f2e92eb5700 1 -- 172.21.15.146:0/3924104135 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e8c0c9020 con 0x7f2e8c0cb090 2023-10-06T11:10:45.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.654+0000 7f2e92eb5700 1 -- 172.21.15.146:0/3924104135 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e8c0c95e0 con 0x7f2e8c0cb090 2023-10-06T11:10:45.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.655+0000 7f2e92eb5700 1 -- 172.21.15.146:0/3924104135 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e8c0894b0 con 0x7f2e8c0cb090 2023-10-06T11:10:45.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.655+0000 7f2e81ffb700 1 -- 172.21.15.146:0/3924104135 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2e84003040 con 0x7f2e8c0cb090 2023-10-06T11:10:45.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.656+0000 7f2e81ffb700 1 --2- 172.21.15.146:0/3924104135 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2e70066f30 0x7f2e700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:45.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.656+0000 7f2e81ffb700 1 -- 172.21.15.146:0/3924104135 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2e840867d0 con 0x7f2e8c0cb090 2023-10-06T11:10:45.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.656+0000 7f2e91eb3700 1 --2- 172.21.15.146:0/3924104135 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2e70066f30 0x7f2e700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:45.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.656+0000 7f2e91eb3700 1 --2- 172.21.15.146:0/3924104135 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2e70066f30 0x7f2e700693e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2e88009a60 tx=0x7f2e88008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:45.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.660+0000 7f2e81ffb700 1 -- 172.21.15.146:0/3924104135 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2e840538e0 con 0x7f2e8c0cb090 2023-10-06T11:10:45.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.917+0000 7f2e92eb5700 1 -- 172.21.15.146:0/3924104135 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f2e8c04bb40 con 0x7f2e8c0cb090 2023-10-06T11:10:45.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.921+0000 7f2e81ffb700 1 -- 172.21.15.146:0/3924104135 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7f2e84056f00 con 0x7f2e8c0cb090 2023-10-06T11:10:45.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.923+0000 7f2e92eb5700 1 -- 172.21.15.146:0/3924104135 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2e70066f30 msgr2=0x7f2e700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:45.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.923+0000 7f2e92eb5700 1 --2- 172.21.15.146:0/3924104135 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2e70066f30 0x7f2e700693e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f2e88009a60 tx=0x7f2e88008040 comp rx=0 tx=0).stop 2023-10-06T11:10:45.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.923+0000 7f2e92eb5700 1 -- 172.21.15.146:0/3924104135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e8c0cb090 msgr2=0x7f2e8c15ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:45.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.923+0000 7f2e92eb5700 1 --2- 172.21.15.146:0/3924104135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e8c0cb090 0x7f2e8c15ee00 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c0694f0 tx=0x7f2e84018000 comp rx=0 tx=0).stop 2023-10-06T11:10:45.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.923+0000 7f2e92eb5700 1 -- 172.21.15.146:0/3924104135 shutdown_connections 2023-10-06T11:10:45.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.923+0000 7f2e92eb5700 1 --2- 172.21.15.146:0/3924104135 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2e70066f30 0x7f2e700693e0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:45.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.923+0000 7f2e92eb5700 1 --2- 172.21.15.146:0/3924104135 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e8c0cb090 0x7f2e8c15ee00 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:45.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.923+0000 7f2e92eb5700 1 --2- 172.21.15.146:0/3924104135 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e8c068780 0x7f2e8c0c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:45.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.923+0000 7f2e92eb5700 1 --2- 172.21.15.146:0/3924104135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e8c0b5640 0x7f2e8c0c9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:45.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.923+0000 7f2e92eb5700 1 -- 172.21.15.146:0/3924104135 >> 172.21.15.146:0/3924104135 conn(0x7f2e8c0703f0 msgr2=0x7f2e8c15c630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:45.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.923+0000 7f2e92eb5700 1 -- 172.21.15.146:0/3924104135 shutdown_connections 2023-10-06T11:10:45.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:45.923+0000 7f2e92eb5700 1 -- 172.21.15.146:0/3924104135 wait complete. 2023-10-06T11:10:45.926 INFO:teuthology.orchestra.run.smithi146.stderr:updated caps for client.0 2023-10-06T11:10:45.937 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:10:46.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.049+0000 7fb80189a700 1 Processor -- start 2023-10-06T11:10:46.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.049+0000 7fb80189a700 1 -- start start 2023-10-06T11:10:46.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.050+0000 7fb80189a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb7fc153ab0 0x7fb7fc15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:46.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.050+0000 7fb80189a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb7fc153e80 0x7fb7fc068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.050+0000 7fb80189a700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb7fc0689d0 0x7fb7fc15d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.050+0000 7fb80189a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7fc068e50 con 0x7fb7fc153e80 2023-10-06T11:10:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.050+0000 7fb80189a700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7fc15ac30 con 0x7fb7fc0689d0 2023-10-06T11:10:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.050+0000 7fb80189a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc0b4510 con 0x7fb7fc153ab0 2023-10-06T11:10:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.050+0000 7fb7fa7fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb7fc153e80 0x7fb7fc068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.050+0000 7fb7fa7fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb7fc153e80 0x7fb7fc068490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51048/0 (socket says 172.21.15.146:51048) 2023-10-06T11:10:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.050+0000 7fb7fa7fc700 1 -- 172.21.15.146:0/3835802308 learned_addr learned my addr 172.21.15.146:0/3835802308 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.050+0000 7fb7fb7fe700 1 --2- 172.21.15.146:0/3835802308 >> v2:172.21.15.151:3300/0 conn(0x7fb7fc0689d0 0x7fb7fc15d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.050+0000 7fb7faffd700 1 --2- 172.21.15.146:0/3835802308 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb7fc153ab0 0x7fb7fc15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.050+0000 7fb7fa7fc700 1 -- 172.21.15.146:0/3835802308 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb7fc153ab0 msgr2=0x7fb7fc15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:46.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.050+0000 7fb7fa7fc700 1 --2- 172.21.15.146:0/3835802308 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb7fc153ab0 0x7fb7fc15a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.050+0000 7fb7fa7fc700 1 -- 172.21.15.146:0/3835802308 >> v2:172.21.15.151:3300/0 conn(0x7fb7fc0689d0 msgr2=0x7fb7fc15d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.050+0000 7fb7fa7fc700 1 --2- 172.21.15.146:0/3835802308 >> v2:172.21.15.151:3300/0 conn(0x7fb7fc0689d0 0x7fb7fc15d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.050+0000 7fb7fa7fc700 1 -- 172.21.15.146:0/3835802308 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7fc0b6530 con 0x7fb7fc153e80 2023-10-06T11:10:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.050+0000 7fb7fa7fc700 1 --2- 172.21.15.146:0/3835802308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7fc153e80 0x7fb7fc068490 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc089a80 tx=0x7fb7e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5cb257c00ea1182 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.051+0000 7fb7f9ffb700 1 -- 172.21.15.146:0/3835802308 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e400b860 con 0x7fb7fc153e80 2023-10-06T11:10:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.051+0000 7fb7f9ffb700 1 -- 172.21.15.146:0/3835802308 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e400b9c0 con 0x7fb7fc153e80 2023-10-06T11:10:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.051+0000 7fb7f9ffb700 1 -- 172.21.15.146:0/3835802308 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e400bd60 con 0x7fb7fc153e80 2023-10-06T11:10:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.051+0000 7fb80189a700 1 -- 172.21.15.146:0/3835802308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7fc153e80 msgr2=0x7fb7fc068490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.051+0000 7fb80189a700 1 --2- 172.21.15.146:0/3835802308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7fc153e80 0x7fb7fc068490 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc089a80 tx=0x7fb7e4009250 comp rx=0 tx=0).stop 2023-10-06T11:10:46.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.051+0000 7fb80189a700 1 -- 172.21.15.146:0/3835802308 shutdown_connections 2023-10-06T11:10:46.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.051+0000 7fb80189a700 1 --2- 172.21.15.146:0/3835802308 >> v2:172.21.15.151:3300/0 conn(0x7fb7fc0689d0 0x7fb7fc15d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.051+0000 7fb80189a700 1 --2- 172.21.15.146:0/3835802308 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb7fc153ab0 0x7fb7fc15a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.051+0000 7fb80189a700 1 --2- 172.21.15.146:0/3835802308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7fc153e80 0x7fb7fc068490 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.051+0000 7fb80189a700 1 -- 172.21.15.146:0/3835802308 >> 172.21.15.146:0/3835802308 conn(0x7fb7fc06eba0 msgr2=0x7fb7fc06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:46.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.051+0000 7fb80189a700 1 -- 172.21.15.146:0/3835802308 shutdown_connections 2023-10-06T11:10:46.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.051+0000 7fb80189a700 1 -- 172.21.15.146:0/3835802308 wait complete. 2023-10-06T11:10:46.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.052+0000 7fb80189a700 1 Processor -- start 2023-10-06T11:10:46.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.052+0000 7fb80189a700 1 -- start start 2023-10-06T11:10:46.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.053+0000 7fb80189a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7fc0689d0 0x7fb7fc1585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:46.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.053+0000 7fb80189a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7fc153ab0 0x7fb7fc0b1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:46.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.053+0000 7fb80189a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb7fc153e80 0x7fb7fc144cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:46.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.053+0000 7fb80189a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc154320 con 0x7fb7fc0689d0 2023-10-06T11:10:46.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.053+0000 7fb80189a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc155140 con 0x7fb7fc153ab0 2023-10-06T11:10:46.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.053+0000 7fb80189a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7fc154530 con 0x7fb7fc153e80 2023-10-06T11:10:46.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.053+0000 7fb7faffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7fc0689d0 0x7fb7fc1585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:46.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.053+0000 7fb7faffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7fc0689d0 0x7fb7fc1585f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51054/0 (socket says 172.21.15.146:51054) 2023-10-06T11:10:46.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.053+0000 7fb7faffd700 1 -- 172.21.15.146:0/3223659732 learned_addr learned my addr 172.21.15.146:0/3223659732 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:46.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.053+0000 7fb7faffd700 1 -- 172.21.15.146:0/3223659732 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb7fc153e80 msgr2=0x7fb7fc144cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:46.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.053+0000 7fb7faffd700 1 --2- 172.21.15.146:0/3223659732 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb7fc153e80 0x7fb7fc144cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.053+0000 7fb7faffd700 1 -- 172.21.15.146:0/3223659732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7fc153ab0 msgr2=0x7fb7fc0b1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:46.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.053+0000 7fb7fa7fc700 1 --2- 172.21.15.146:0/3223659732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7fc153ab0 0x7fb7fc0b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:46.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.054+0000 7fb7faffd700 1 --2- 172.21.15.146:0/3223659732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7fc153ab0 0x7fb7fc0b1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.054+0000 7fb7faffd700 1 -- 172.21.15.146:0/3223659732 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e40094f0 con 0x7fb7fc0689d0 2023-10-06T11:10:46.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.054+0000 7fb7faffd700 1 --2- 172.21.15.146:0/3223659732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7fc0689d0 0x7fb7fc1585f0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fb7f400c7d0 tx=0x7fb7f4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:46.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.054+0000 7fb7f2ffd700 1 -- 172.21.15.146:0/3223659732 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f4011600 con 0x7fb7fc0689d0 2023-10-06T11:10:46.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.054+0000 7fb7f2ffd700 1 -- 172.21.15.146:0/3223659732 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f4011760 con 0x7fb7fc0689d0 2023-10-06T11:10:46.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.054+0000 7fb80189a700 1 -- 172.21.15.146:0/3223659732 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7fc154810 con 0x7fb7fc0689d0 2023-10-06T11:10:46.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.054+0000 7fb7f2ffd700 1 -- 172.21.15.146:0/3223659732 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f4011b20 con 0x7fb7fc0689d0 2023-10-06T11:10:46.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.054+0000 7fb80189a700 1 -- 172.21.15.146:0/3223659732 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7fc154dd0 con 0x7fb7fc0689d0 2023-10-06T11:10:46.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.055+0000 7fb80189a700 1 -- 172.21.15.146:0/3223659732 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7fc04c380 con 0x7fb7fc0689d0 2023-10-06T11:10:46.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.055+0000 7fb7f2ffd700 1 -- 172.21.15.146:0/3223659732 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb7f40193f0 con 0x7fb7fc0689d0 2023-10-06T11:10:46.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.056+0000 7fb7f2ffd700 1 --2- 172.21.15.146:0/3223659732 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb7dc066f30 0x7fb7dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:46.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.056+0000 7fb7f2ffd700 1 -- 172.21.15.146:0/3223659732 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb7f4084aa0 con 0x7fb7fc0689d0 2023-10-06T11:10:46.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.056+0000 7fb7fa7fc700 1 --2- 172.21.15.146:0/3223659732 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb7dc066f30 0x7fb7dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:46.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.056+0000 7fb7fa7fc700 1 --2- 172.21.15.146:0/3223659732 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb7dc066f30 0x7fb7dc0693e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc1542f0 tx=0x7fb7e4017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:46.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.060+0000 7fb7f2ffd700 1 -- 172.21.15.146:0/3223659732 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb7f4051bb0 con 0x7fb7fc0689d0 2023-10-06T11:10:46.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.286+0000 7fb80189a700 1 -- 172.21.15.146:0/3223659732 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb7fc0b5c50 con 0x7fb7fc0689d0 2023-10-06T11:10:46.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.287+0000 7fb7f2ffd700 1 -- 172.21.15.146:0/3223659732 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+4611 (secure 0 0 0) 0x7fb7f40551d0 con 0x7fb7fc0689d0 2023-10-06T11:10:46.288 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:10:46.289 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":64,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6274,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3700176588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3700176588},{"type":"v1","addr":"172.21.15.151:6834","nonce":3700176588}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6771,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/3753626989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3753626989},{"type":"v1","addr":"172.21.15.146:6836","nonce":3753626989}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6774,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/1712863503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":1712863503},{"type":"v1","addr":"172.21.15.146:6837","nonce":1712863503}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:10:35.928535+0000","modified":"2023-10-06T11:10:39.579368+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6786},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6786":{"gid":6786,"name":"b","rank":0,"incarnation":60,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6835/3649668257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":3649668257},{"type":"v1","addr":"172.21.15.151:6835","nonce":3649668257}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T11:10:46.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.289+0000 7fb80189a700 1 -- 172.21.15.146:0/3223659732 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb7dc066f30 msgr2=0x7fb7dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:46.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.289+0000 7fb80189a700 1 --2- 172.21.15.146:0/3223659732 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb7dc066f30 0x7fb7dc0693e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc1542f0 tx=0x7fb7e4017000 comp rx=0 tx=0).stop 2023-10-06T11:10:46.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.289+0000 7fb80189a700 1 -- 172.21.15.146:0/3223659732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7fc0689d0 msgr2=0x7fb7fc1585f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:46.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.289+0000 7fb80189a700 1 --2- 172.21.15.146:0/3223659732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7fc0689d0 0x7fb7fc1585f0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7fb7f400c7d0 tx=0x7fb7f4008040 comp rx=0 tx=0).stop 2023-10-06T11:10:46.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.289+0000 7fb80189a700 1 -- 172.21.15.146:0/3223659732 shutdown_connections 2023-10-06T11:10:46.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.289+0000 7fb80189a700 1 --2- 172.21.15.146:0/3223659732 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb7dc066f30 0x7fb7dc0693e0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.289+0000 7fb80189a700 1 --2- 172.21.15.146:0/3223659732 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb7fc153e80 0x7fb7fc144cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.289+0000 7fb80189a700 1 --2- 172.21.15.146:0/3223659732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7fc0689d0 0x7fb7fc1585f0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.289+0000 7fb80189a700 1 --2- 172.21.15.146:0/3223659732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7fc153ab0 0x7fb7fc0b1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.289+0000 7fb80189a700 1 -- 172.21.15.146:0/3223659732 >> 172.21.15.146:0/3223659732 conn(0x7fb7fc06eba0 msgr2=0x7fb7fc0d0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:46.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.289+0000 7fb80189a700 1 -- 172.21.15.146:0/3223659732 shutdown_connections 2023-10-06T11:10:46.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.289+0000 7fb80189a700 1 -- 172.21.15.146:0/3223659732 wait complete. 2023-10-06T11:10:46.292 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 64 2023-10-06T11:10:46.705 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 64, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T11:10:35.928535+0000', 'modified': '2023-10-06T11:10:39.579368+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6786}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6786': {'gid': 6786, 'name': 'b', 'rank': 0, 'incarnation': 60, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.151:6835/3649668257', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6833', 'nonce': 3649668257}, {'type': 'v1', 'addr': '172.21.15.151:6835', 'nonce': 3649668257}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T11:10:46.706 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T11:10:46.706 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-06T11:10:46.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.821+0000 7f6387f48700 1 Processor -- start 2023-10-06T11:10:46.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.821+0000 7f6387f48700 1 -- start start 2023-10-06T11:10:46.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.822+0000 7f6387f48700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f638015a160 0x7f63800c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:46.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.822+0000 7f6387f48700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63800ae730 0x7f63800aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:46.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.822+0000 7f6387f48700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f63800ce3d0 0x7f63800ce830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:46.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.822+0000 7f6387f48700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63800ae2a0 con 0x7f63800ce3d0 2023-10-06T11:10:46.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.822+0000 7f6387f48700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f638015a530 con 0x7f638015a160 2023-10-06T11:10:46.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.822+0000 7f6387f48700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63800ad690 con 0x7f63800ae730 2023-10-06T11:10:46.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.822+0000 7f63864e5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f63800ce3d0 0x7f63800ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:46.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.822+0000 7f63864e5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f63800ce3d0 0x7f63800ce830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51066/0 (socket says 172.21.15.146:51066) 2023-10-06T11:10:46.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.822+0000 7f63864e5700 1 -- 172.21.15.146:0/127438528 learned_addr learned my addr 172.21.15.146:0/127438528 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:46.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.822+0000 7f63854e3700 1 --2- 172.21.15.146:0/127438528 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63800ae730 0x7f63800aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:46.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.822+0000 7f63864e5700 1 -- 172.21.15.146:0/127438528 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63800ae730 msgr2=0x7f63800aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:46.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.823+0000 7f63864e5700 1 --2- 172.21.15.146:0/127438528 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63800ae730 0x7f63800aeb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.823+0000 7f6385ce4700 1 --2- 172.21.15.146:0/127438528 >> v2:172.21.15.151:3300/0 conn(0x7f638015a160 0x7f63800c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:46.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.823+0000 7f63864e5700 1 -- 172.21.15.146:0/127438528 >> v2:172.21.15.151:3300/0 conn(0x7f638015a160 msgr2=0x7f63800c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:46.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.823+0000 7f63864e5700 1 --2- 172.21.15.146:0/127438528 >> v2:172.21.15.151:3300/0 conn(0x7f638015a160 0x7f63800c55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.823+0000 7f63864e5700 1 -- 172.21.15.146:0/127438528 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63800ad970 con 0x7f63800ce3d0 2023-10-06T11:10:46.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.823+0000 7f63864e5700 1 --2- 172.21.15.146:0/127438528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63800ce3d0 0x7f63800ce830 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f6380065100 tx=0x7f6378009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5707f7b63c115e20 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:46.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.823+0000 7f6384ce2700 1 -- 172.21.15.146:0/127438528 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637800b860 con 0x7f63800ce3d0 2023-10-06T11:10:46.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.823+0000 7f6384ce2700 1 -- 172.21.15.146:0/127438528 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f637800b9c0 con 0x7f63800ce3d0 2023-10-06T11:10:46.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.823+0000 7f6384ce2700 1 -- 172.21.15.146:0/127438528 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637800bd60 con 0x7f63800ce3d0 2023-10-06T11:10:46.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.823+0000 7f6387f48700 1 -- 172.21.15.146:0/127438528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63800ce3d0 msgr2=0x7f63800ce830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:46.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.823+0000 7f6387f48700 1 --2- 172.21.15.146:0/127438528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63800ce3d0 0x7f63800ce830 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f6380065100 tx=0x7f6378009250 comp rx=0 tx=0).stop 2023-10-06T11:10:46.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.823+0000 7f6387f48700 1 -- 172.21.15.146:0/127438528 shutdown_connections 2023-10-06T11:10:46.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.823+0000 7f6387f48700 1 --2- 172.21.15.146:0/127438528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63800ce3d0 0x7f63800ce830 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.823+0000 7f6387f48700 1 --2- 172.21.15.146:0/127438528 >> v2:172.21.15.151:3300/0 conn(0x7f638015a160 0x7f63800c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.823+0000 7f6387f48700 1 --2- 172.21.15.146:0/127438528 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63800ae730 0x7f63800aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.823+0000 7f6387f48700 1 -- 172.21.15.146:0/127438528 >> 172.21.15.146:0/127438528 conn(0x7f638006f380 msgr2=0x7f63800d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:46.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.824+0000 7f6387f48700 1 -- 172.21.15.146:0/127438528 shutdown_connections 2023-10-06T11:10:46.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.824+0000 7f6387f48700 1 -- 172.21.15.146:0/127438528 wait complete. 2023-10-06T11:10:46.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.825+0000 7f6387f48700 1 Processor -- start 2023-10-06T11:10:46.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.825+0000 7f6387f48700 1 -- start start 2023-10-06T11:10:46.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.825+0000 7f6387f48700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63800ae730 0x7f63800b6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:46.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.825+0000 7f6387f48700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63800ce3d0 0x7f6380153020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:46.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.825+0000 7f6387f48700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f638015a160 0x7f6380153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:46.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.825+0000 7f6387f48700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638013dce0 con 0x7f638015a160 2023-10-06T11:10:46.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.825+0000 7f6387f48700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63800b3f30 con 0x7f63800ce3d0 2023-10-06T11:10:46.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.825+0000 7f6387f48700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63800c9b70 con 0x7f63800ae730 2023-10-06T11:10:46.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.825+0000 7f63864e5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f638015a160 0x7f6380153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:46.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.825+0000 7f63864e5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f638015a160 0x7f6380153560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51068/0 (socket says 172.21.15.146:51068) 2023-10-06T11:10:46.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.825+0000 7f63864e5700 1 -- 172.21.15.146:0/448937612 learned_addr learned my addr 172.21.15.146:0/448937612 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:46.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.826+0000 7f63854e3700 1 --2- 172.21.15.146:0/448937612 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63800ce3d0 0x7f6380153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:46.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.826+0000 7f6385ce4700 1 --2- 172.21.15.146:0/448937612 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63800ae730 0x7f63800b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:46.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.826+0000 7f63864e5700 1 -- 172.21.15.146:0/448937612 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63800ae730 msgr2=0x7f63800b6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:46.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.826+0000 7f63864e5700 1 --2- 172.21.15.146:0/448937612 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63800ae730 0x7f63800b6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.826+0000 7f63864e5700 1 -- 172.21.15.146:0/448937612 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63800ce3d0 msgr2=0x7f6380153020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:46.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.826+0000 7f63864e5700 1 --2- 172.21.15.146:0/448937612 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63800ce3d0 0x7f6380153020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.826+0000 7f63864e5700 1 -- 172.21.15.146:0/448937612 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63780094f0 con 0x7f638015a160 2023-10-06T11:10:46.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.826+0000 7f63854e3700 1 --2- 172.21.15.146:0/448937612 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63800ce3d0 0x7f6380153020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:10:46.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.826+0000 7f63864e5700 1 --2- 172.21.15.146:0/448937612 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f638015a160 0x7f6380153560 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f6380088c60 tx=0x7f6378017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:46.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.826+0000 7f6375ffb700 1 -- 172.21.15.146:0/448937612 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637801a630 con 0x7f638015a160 2023-10-06T11:10:46.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.826+0000 7f6375ffb700 1 -- 172.21.15.146:0/448937612 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f637801a7b0 con 0x7f638015a160 2023-10-06T11:10:46.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.826+0000 7f6387f48700 1 -- 172.21.15.146:0/448937612 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63800c9e50 con 0x7f638015a160 2023-10-06T11:10:46.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.826+0000 7f6375ffb700 1 -- 172.21.15.146:0/448937612 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637801ab70 con 0x7f638015a160 2023-10-06T11:10:46.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.826+0000 7f6387f48700 1 -- 172.21.15.146:0/448937612 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63800b3bc0 con 0x7f638015a160 2023-10-06T11:10:46.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.828+0000 7f6375ffb700 1 -- 172.21.15.146:0/448937612 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f637802d440 con 0x7f638015a160 2023-10-06T11:10:46.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.828+0000 7f6375ffb700 1 --2- 172.21.15.146:0/448937612 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6364066f30 0x7f63640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:46.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.828+0000 7f6375ffb700 1 -- 172.21.15.146:0/448937612 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6378086400 con 0x7f638015a160 2023-10-06T11:10:46.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.828+0000 7f6385ce4700 1 --2- 172.21.15.146:0/448937612 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6364066f30 0x7f63640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:46.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.828+0000 7f6385ce4700 1 --2- 172.21.15.146:0/448937612 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6364066f30 0x7f63640693e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6380088530 tx=0x7f637c007760 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:46.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.830+0000 7f6391240b80 1 Processor -- start 2023-10-06T11:10:46.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.830+0000 7f6391240b80 1 -- start start 2023-10-06T11:10:46.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.830+0000 7f6391240b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f515039a90 0x55f515039e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:46.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.830+0000 7f6391240b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f514ff59a0 0x55f514ff2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:46.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.830+0000 7f6391240b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f514ff3bd0 0x55f514ff2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:46.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.830+0000 7f6391240b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f514f72c80 con 0x55f514ff59a0 2023-10-06T11:10:46.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.830+0000 7f6391240b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f514f49a70 con 0x55f514ff3bd0 2023-10-06T11:10:46.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.830+0000 7f6391240b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f514f47270 con 0x55f515039a90 2023-10-06T11:10:46.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.830+0000 7f63854e3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f514ff59a0 0x55f514ff2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:46.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.830+0000 7f63854e3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f514ff59a0 0x55f514ff2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51082/0 (socket says 172.21.15.146:51082) 2023-10-06T11:10:46.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.830+0000 7f63854e3700 1 -- 172.21.15.146:0/2176536220 learned_addr learned my addr 172.21.15.146:0/2176536220 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:46.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.831+0000 7f6385ce4700 1 --2- 172.21.15.146:0/2176536220 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f515039a90 0x55f515039e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:46.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.831+0000 7f63864e5700 1 --2- 172.21.15.146:0/2176536220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f514ff3bd0 0x55f514ff2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:46.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.831+0000 7f63854e3700 1 -- 172.21.15.146:0/2176536220 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f515039a90 msgr2=0x55f515039e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:46.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.831+0000 7f63854e3700 1 --2- 172.21.15.146:0/2176536220 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f515039a90 0x55f515039e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.831+0000 7f63854e3700 1 -- 172.21.15.146:0/2176536220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f514ff3bd0 msgr2=0x55f514ff2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:46.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.831+0000 7f63854e3700 1 --2- 172.21.15.146:0/2176536220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f514ff3bd0 0x55f514ff2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.831+0000 7f63854e3700 1 -- 172.21.15.146:0/2176536220 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f514ddd270 con 0x55f514ff59a0 2023-10-06T11:10:46.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.831+0000 7f6385ce4700 1 --2- 172.21.15.146:0/2176536220 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f515039a90 0x55f515039e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:10:46.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.831+0000 7f63864e5700 1 --2- 172.21.15.146:0/2176536220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f514ff3bd0 0x55f514ff2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:10:46.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.831+0000 7f63854e3700 1 --2- 172.21.15.146:0/2176536220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f514ff59a0 0x55f514ff2580 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f637000d920 tx=0x7f6370008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc2351b875329d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:46.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.831+0000 7f636affd700 1 -- 172.21.15.146:0/2176536220 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637000dec0 con 0x55f514ff59a0 2023-10-06T11:10:46.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.831+0000 7f636affd700 1 -- 172.21.15.146:0/2176536220 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f637000c030 con 0x55f514ff59a0 2023-10-06T11:10:46.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.831+0000 7f636affd700 1 -- 172.21.15.146:0/2176536220 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637000f8e0 con 0x55f514ff59a0 2023-10-06T11:10:46.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.832+0000 7f6391240b80 1 -- 172.21.15.146:0/2176536220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f514ff59a0 msgr2=0x55f514ff2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:46.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.832+0000 7f6391240b80 1 --2- 172.21.15.146:0/2176536220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f514ff59a0 0x55f514ff2580 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f637000d920 tx=0x7f6370008040 comp rx=0 tx=0).stop 2023-10-06T11:10:46.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.832+0000 7f6391240b80 1 -- 172.21.15.146:0/2176536220 shutdown_connections 2023-10-06T11:10:46.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.832+0000 7f6391240b80 1 --2- 172.21.15.146:0/2176536220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f514ff3bd0 0x55f514ff2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.832+0000 7f6391240b80 1 --2- 172.21.15.146:0/2176536220 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f515039a90 0x55f515039e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.832+0000 7f6391240b80 1 --2- 172.21.15.146:0/2176536220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f514ff59a0 0x55f514ff2580 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.832+0000 7f6391240b80 1 -- 172.21.15.146:0/2176536220 >> 172.21.15.146:0/2176536220 conn(0x55f514ff4070 msgr2=0x55f514ff4440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:46.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.832+0000 7f6391240b80 1 -- 172.21.15.146:0/2176536220 shutdown_connections 2023-10-06T11:10:46.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.832+0000 7f6391240b80 1 -- 172.21.15.146:0/2176536220 wait complete. 2023-10-06T11:10:46.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.832+0000 7f6391240b80 1 -- start start 2023-10-06T11:10:46.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.832+0000 7f6391240b80 1 Processor -- start 2023-10-06T11:10:46.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.833+0000 7f6391240b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f514ff3bd0 0x55f515034a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:46.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.833+0000 7f6391240b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f514ff59a0 0x55f5150369e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:46.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.833+0000 7f6391240b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f515039a90 0x55f514ff2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:46.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.833+0000 7f6391240b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f514f43060 con 0x55f514ff59a0 2023-10-06T11:10:46.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.833+0000 7f6391240b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f514eee890 con 0x55f515039a90 2023-10-06T11:10:46.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.833+0000 7f6391240b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f514f09ea0 con 0x55f514ff3bd0 2023-10-06T11:10:46.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.833+0000 7f6391240b80 10 client.0 _ll_register_callbacks cb 0x55f514ddff30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:10:46.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.833+0000 7f63854e3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f514ff59a0 0x55f5150369e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:46.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.833+0000 7f63854e3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f514ff59a0 0x55f5150369e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51090/0 (socket says 172.21.15.146:51090) 2023-10-06T11:10:46.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.833+0000 7f63854e3700 1 -- 172.21.15.146:0/1058757702 learned_addr learned my addr 172.21.15.146:0/1058757702 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:46.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.834+0000 7f63864e5700 1 --2- 172.21.15.146:0/1058757702 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f515039a90 0x55f514ff2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:46.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.834+0000 7f6385ce4700 1 --2- 172.21.15.146:0/1058757702 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f514ff3bd0 0x55f515034a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:46.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.834+0000 7f63854e3700 1 -- 172.21.15.146:0/1058757702 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f514ff3bd0 msgr2=0x55f515034a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:46.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.834+0000 7f63854e3700 1 --2- 172.21.15.146:0/1058757702 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f514ff3bd0 0x55f515034a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.834+0000 7f63854e3700 1 -- 172.21.15.146:0/1058757702 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f515039a90 msgr2=0x55f514ff2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:46.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.834+0000 7f63854e3700 1 --2- 172.21.15.146:0/1058757702 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f515039a90 0x55f514ff2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.834+0000 7f63854e3700 1 -- 172.21.15.146:0/1058757702 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f637000e040 con 0x55f514ff59a0 2023-10-06T11:10:46.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.834+0000 7f6385ce4700 1 --2- 172.21.15.146:0/1058757702 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f514ff3bd0 0x55f515034a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:10:46.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.834+0000 7f63854e3700 1 --2- 172.21.15.146:0/1058757702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f514ff59a0 0x55f5150369e0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f6370007fd0 tx=0x7f637001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e74f01e1cad0af15 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:46.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.834+0000 7f635ffff700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:10:46.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.834+0000 7f635ffff700 1 -- 172.21.15.146:0/1058757702 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6370014690 con 0x55f514ff59a0 2023-10-06T11:10:46.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.834+0000 7f6391240b80 1 -- 172.21.15.146:0/1058757702 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f514fe7690 con 0x55f514ff59a0 2023-10-06T11:10:46.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.834+0000 7f635ffff700 1 -- 172.21.15.146:0/1058757702 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(75..75 src has 1..75) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6370023070 con 0x55f514ff59a0 2023-10-06T11:10:46.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.834+0000 7f635ffff700 1 -- 172.21.15.146:0/1058757702 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6370014a00 con 0x55f514ff59a0 2023-10-06T11:10:46.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.834+0000 7f6391240b80 10 client.6951 fetch_fsmap learned FSMap version 64 2023-10-06T11:10:46.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.834+0000 7f6391240b80 1 -- 172.21.15.146:0/1058757702 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) v3 -- 0x55f514d7ffe0 con 0x55f514ff59a0 2023-10-06T11:10:46.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.834+0000 7f635ffff700 1 -- 172.21.15.146:0/1058757702 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f514fe7690 con 0x55f514ff59a0 2023-10-06T11:10:46.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.834+0000 7f635ffff700 1 -- 172.21.15.146:0/1058757702 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 64) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f6370014b60 con 0x55f514ff59a0 2023-10-06T11:10:46.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.834+0000 7f6391240b80 10 client.6951 fetch_fsmap finished waiting for FSMap version 64 2023-10-06T11:10:46.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.834+0000 7f6391240b80 10 client.6951 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T11:10:46.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.834+0000 7f6391240b80 20 client.6951 populate_metadata read hostname 'smithi146' 2023-10-06T11:10:46.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.834+0000 7f6391240b80 1 --2- 172.21.15.146:0/1058757702 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x55f51501d150 0x55f51501d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:46.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.834+0000 7f6391240b80 4 client.6951 mds_command: new command op to 6786 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:10:46.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.834+0000 7f6391240b80 1 -- 172.21.15.146:0/1058757702 --> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f514fc45c0 con 0x55f51501d150 2023-10-06T11:10:46.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.835+0000 7f6385ce4700 1 --2- 172.21.15.146:0/1058757702 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x55f51501d150 0x55f51501d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:46.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.835+0000 7f635ffff700 10 client.6951 ms_handle_connect on v2:172.21.15.151:6833/3649668257 2023-10-06T11:10:46.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.835+0000 7f6385ce4700 1 --2- 172.21.15.146:0/1058757702 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x55f51501d150 0x55f51501d520 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca4bf2c15730906e server_cookie=c405851bfcb927a7 in_seq=0 out_seq=0 2023-10-06T11:10:46.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.836+0000 7f635ffff700 1 -- 172.21.15.146:0/1058757702 <== mds.0 v2:172.21.15.151:6833/3649668257 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55f514fc45c0 con 0x55f51501d150 2023-10-06T11:10:46.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.836+0000 7f635ffff700 10 client.6951 handle_command_reply: tid=0 2023-10-06T11:10:46.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.836+0000 7f6391240b80 1 client.6951 shutdown 2023-10-06T11:10:46.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.836+0000 7f6391240b80 1 -- 172.21.15.146:0/1058757702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f514ff59a0 msgr2=0x55f5150369e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:46.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.836+0000 7f6391240b80 1 --2- 172.21.15.146:0/1058757702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f514ff59a0 0x55f5150369e0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f6370007fd0 tx=0x7f637001d000 comp rx=0 tx=0).stop 2023-10-06T11:10:46.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.836+0000 7f6391240b80 1 -- 172.21.15.146:0/1058757702 shutdown_connections 2023-10-06T11:10:46.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.836+0000 7f6391240b80 1 --2- 172.21.15.146:0/1058757702 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f515039a90 0x55f514ff2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.836+0000 7f6391240b80 1 --2- 172.21.15.146:0/1058757702 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x55f51501d150 0x55f51501d520 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.836+0000 7f6391240b80 1 --2- 172.21.15.146:0/1058757702 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f514ff3bd0 0x55f515034a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.836+0000 7f635ffff700 0 client.6951 ms_handle_reset on v2:172.21.15.151:6833/3649668257 2023-10-06T11:10:46.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.836+0000 7f6391240b80 1 --2- 172.21.15.146:0/1058757702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f514ff59a0 0x55f5150369e0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.836+0000 7f6391240b80 1 -- 172.21.15.146:0/1058757702 >> 172.21.15.146:0/1058757702 conn(0x55f514ff4070 msgr2=0x55f514fef760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:46.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.836+0000 7f6391240b80 1 -- 172.21.15.146:0/1058757702 shutdown_connections 2023-10-06T11:10:46.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.836+0000 7f6391240b80 1 -- 172.21.15.146:0/1058757702 wait complete. 2023-10-06T11:10:46.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.836+0000 7f6391240b80 20 client.6951 trim_cache size 0 max 16384 2023-10-06T11:10:46.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.853+0000 7f6391240b80 1 Processor -- start 2023-10-06T11:10:46.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.853+0000 7f6391240b80 1 -- start start 2023-10-06T11:10:46.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.853+0000 7f6391240b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f514ff3bd0 0x55f514ff3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:46.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.853+0000 7f6391240b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f514ff59a0 0x55f514fef7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:46.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.853+0000 7f6391240b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f515039a90 0x55f5150329e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:46.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.853+0000 7f6391240b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f514dc5e30 con 0x55f514ff3bd0 2023-10-06T11:10:46.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.853+0000 7f6391240b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f514fed0c0 con 0x55f515039a90 2023-10-06T11:10:46.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.853+0000 7f6391240b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f51501dae0 con 0x55f514ff59a0 2023-10-06T11:10:46.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.854+0000 7f6385ce4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f514ff3bd0 0x55f514ff3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:46.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.854+0000 7f6385ce4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f514ff3bd0 0x55f514ff3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51096/0 (socket says 172.21.15.146:51096) 2023-10-06T11:10:46.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.854+0000 7f6385ce4700 1 -- 172.21.15.146:0/455488044 learned_addr learned my addr 172.21.15.146:0/455488044 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:46.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.854+0000 7f63864e5700 1 --2- 172.21.15.146:0/455488044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f515039a90 0x55f5150329e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:46.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.854+0000 7f6385ce4700 1 -- 172.21.15.146:0/455488044 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f514ff59a0 msgr2=0x55f514fef7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:46.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.854+0000 7f63854e3700 1 --2- 172.21.15.146:0/455488044 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f514ff59a0 0x55f514fef7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:46.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.854+0000 7f6385ce4700 1 --2- 172.21.15.146:0/455488044 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f514ff59a0 0x55f514fef7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.854+0000 7f6385ce4700 1 -- 172.21.15.146:0/455488044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f515039a90 msgr2=0x55f5150329e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:46.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.854+0000 7f6385ce4700 1 --2- 172.21.15.146:0/455488044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f515039a90 0x55f5150329e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.854+0000 7f6385ce4700 1 -- 172.21.15.146:0/455488044 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f514f11780 con 0x55f514ff3bd0 2023-10-06T11:10:46.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.854+0000 7f63864e5700 1 --2- 172.21.15.146:0/455488044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f515039a90 0x55f5150329e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:10:46.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.854+0000 7f6385ce4700 1 --2- 172.21.15.146:0/455488044 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f514ff3bd0 0x55f514ff3200 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f637c010010 tx=0x7f637c01e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b0526805232fb24 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:46.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.854+0000 7f636b7fe700 1 -- 172.21.15.146:0/455488044 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637c029070 con 0x55f514ff3bd0 2023-10-06T11:10:46.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.854+0000 7f636b7fe700 1 -- 172.21.15.146:0/455488044 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f637c01ae80 con 0x55f514ff3bd0 2023-10-06T11:10:46.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.854+0000 7f636b7fe700 1 -- 172.21.15.146:0/455488044 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637c021040 con 0x55f514ff3bd0 2023-10-06T11:10:46.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.855+0000 7f6391240b80 1 -- 172.21.15.146:0/455488044 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f514ff3bd0 msgr2=0x55f514ff3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:46.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.855+0000 7f6391240b80 1 --2- 172.21.15.146:0/455488044 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f514ff3bd0 0x55f514ff3200 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f637c010010 tx=0x7f637c01e040 comp rx=0 tx=0).stop 2023-10-06T11:10:46.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.855+0000 7f6391240b80 1 -- 172.21.15.146:0/455488044 shutdown_connections 2023-10-06T11:10:46.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.855+0000 7f6391240b80 1 --2- 172.21.15.146:0/455488044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f515039a90 0x55f5150329e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.855+0000 7f6391240b80 1 --2- 172.21.15.146:0/455488044 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f514ff3bd0 0x55f514ff3200 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.855+0000 7f6391240b80 1 --2- 172.21.15.146:0/455488044 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f514ff59a0 0x55f514fef7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.855+0000 7f6391240b80 1 -- 172.21.15.146:0/455488044 >> 172.21.15.146:0/455488044 conn(0x55f514ff4070 msgr2=0x55f51501e020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:46.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.855+0000 7f6391240b80 1 -- 172.21.15.146:0/455488044 shutdown_connections 2023-10-06T11:10:46.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.855+0000 7f6391240b80 1 -- 172.21.15.146:0/455488044 wait complete. 2023-10-06T11:10:46.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.855+0000 7f6391240b80 1 -- start start 2023-10-06T11:10:46.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.855+0000 7f6391240b80 1 Processor -- start 2023-10-06T11:10:46.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.856+0000 7f6391240b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f514ff3bd0 0x55f515091600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:46.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.856+0000 7f6391240b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f514ff59a0 0x55f51501dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:46.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.856+0000 7f6391240b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f515039a90 0x55f51501e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:46.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.856+0000 7f6391240b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f515093750 con 0x55f514ff3bd0 2023-10-06T11:10:46.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.856+0000 7f6391240b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f515019bf0 con 0x55f514ff59a0 2023-10-06T11:10:46.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.856+0000 7f6391240b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f515019e40 con 0x55f515039a90 2023-10-06T11:10:46.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.856+0000 7f6391240b80 10 client.0 _ll_register_callbacks cb 0x55f514ddff30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:10:46.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.856+0000 7f6385ce4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f514ff3bd0 0x55f515091600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:46.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.856+0000 7f6385ce4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f514ff3bd0 0x55f515091600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51102/0 (socket says 172.21.15.146:51102) 2023-10-06T11:10:46.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.856+0000 7f6385ce4700 1 -- 172.21.15.146:0/1426210379 learned_addr learned my addr 172.21.15.146:0/1426210379 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:46.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.856+0000 7f63864e5700 1 --2- 172.21.15.146:0/1426210379 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f515039a90 0x55f51501e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:46.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.856+0000 7f63854e3700 1 --2- 172.21.15.146:0/1426210379 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f514ff59a0 0x55f51501dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:46.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.856+0000 7f6385ce4700 1 -- 172.21.15.146:0/1426210379 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f515039a90 msgr2=0x55f51501e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:46.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.856+0000 7f6385ce4700 1 --2- 172.21.15.146:0/1426210379 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f515039a90 0x55f51501e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.856+0000 7f6385ce4700 1 -- 172.21.15.146:0/1426210379 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f514ff59a0 msgr2=0x55f51501dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:46.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.856+0000 7f6385ce4700 1 --2- 172.21.15.146:0/1426210379 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f514ff59a0 0x55f51501dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.856+0000 7f6385ce4700 1 -- 172.21.15.146:0/1426210379 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f637c01a770 con 0x55f514ff3bd0 2023-10-06T11:10:46.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.857+0000 7f6385ce4700 1 --2- 172.21.15.146:0/1426210379 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f514ff3bd0 0x55f515091600 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f637c010010 tx=0x7f637c024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a657a3ff6e43de2c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:46.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.857+0000 7f635ffff700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:10:46.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.857+0000 7f635ffff700 1 -- 172.21.15.146:0/1426210379 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637c029050 con 0x55f514ff3bd0 2023-10-06T11:10:46.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.857+0000 7f635ffff700 1 -- 172.21.15.146:0/1426210379 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(75..75 src has 1..75) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f637c025750 con 0x55f514ff3bd0 2023-10-06T11:10:46.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.857+0000 7f6391240b80 1 -- 172.21.15.146:0/1426210379 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f637000c030 con 0x55f514ff3bd0 2023-10-06T11:10:46.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.857+0000 7f635ffff700 1 -- 172.21.15.146:0/1426210379 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f637c021040 con 0x55f514ff3bd0 2023-10-06T11:10:46.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.857+0000 7f6391240b80 10 client.6957 fetch_fsmap learned FSMap version 64 2023-10-06T11:10:46.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.857+0000 7f6391240b80 1 -- 172.21.15.146:0/1426210379 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=2+}) v3 -- 0x55f514ef8470 con 0x55f514ff3bd0 2023-10-06T11:10:46.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.857+0000 7f635ffff700 1 -- 172.21.15.146:0/1426210379 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f637000c030 con 0x55f514ff3bd0 2023-10-06T11:10:46.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.857+0000 7f635ffff700 1 -- 172.21.15.146:0/1426210379 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 64) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f637c025b20 con 0x55f514ff3bd0 2023-10-06T11:10:46.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.857+0000 7f6391240b80 10 client.6957 fetch_fsmap finished waiting for FSMap version 64 2023-10-06T11:10:46.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.857+0000 7f6391240b80 10 client.6957 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T11:10:46.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.857+0000 7f6391240b80 20 client.6957 populate_metadata read hostname 'smithi146' 2023-10-06T11:10:46.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.857+0000 7f6391240b80 1 --2- 172.21.15.146:0/1426210379 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x55f514ff45d0 0x55f514ff49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:46.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.857+0000 7f6391240b80 4 client.6957 mds_command: new command op to 6786 tid=0[{"prefix": "status"}] 2023-10-06T11:10:46.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.857+0000 7f6391240b80 1 -- 172.21.15.146:0/1426210379 --> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f514ee5e00 con 0x55f514ff45d0 2023-10-06T11:10:46.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.857+0000 7f63854e3700 1 --2- 172.21.15.146:0/1426210379 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x55f514ff45d0 0x55f514ff49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:46.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.858+0000 7f635ffff700 10 client.6957 ms_handle_connect on v2:172.21.15.151:6833/3649668257 2023-10-06T11:10:46.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.858+0000 7f63854e3700 1 --2- 172.21.15.146:0/1426210379 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x55f514ff45d0 0x55f514ff49a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5227fd8a364e42c2 server_cookie=a4b8439b67de91f4 in_seq=0 out_seq=0 2023-10-06T11:10:46.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.858+0000 7f635ffff700 1 -- 172.21.15.146:0/1426210379 <== mds.0 v2:172.21.15.151:6833/3649668257 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x55f514ee5e00 con 0x55f514ff45d0 2023-10-06T11:10:46.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.858+0000 7f635ffff700 10 client.6957 handle_command_reply: tid=0 2023-10-06T11:10:46.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.858+0000 7f6391240b80 1 client.6957 shutdown 2023-10-06T11:10:46.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.858+0000 7f6391240b80 1 -- 172.21.15.146:0/1426210379 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f514ff3bd0 msgr2=0x55f515091600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:46.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.858+0000 7f6391240b80 1 --2- 172.21.15.146:0/1426210379 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f514ff3bd0 0x55f515091600 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f637c010010 tx=0x7f637c024000 comp rx=0 tx=0).stop 2023-10-06T11:10:46.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.858+0000 7f6391240b80 1 -- 172.21.15.146:0/1426210379 shutdown_connections 2023-10-06T11:10:46.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.858+0000 7f6391240b80 1 --2- 172.21.15.146:0/1426210379 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x55f514ff45d0 0x55f514ff49a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.858+0000 7f6391240b80 1 --2- 172.21.15.146:0/1426210379 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f515039a90 0x55f51501e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.858+0000 7f635ffff700 0 client.6957 ms_handle_reset on v2:172.21.15.151:6833/3649668257 2023-10-06T11:10:46.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.858+0000 7f6391240b80 1 --2- 172.21.15.146:0/1426210379 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f514ff3bd0 0x55f515091600 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.858+0000 7f6391240b80 1 --2- 172.21.15.146:0/1426210379 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f514ff59a0 0x55f51501dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.858+0000 7f6391240b80 1 -- 172.21.15.146:0/1426210379 >> 172.21.15.146:0/1426210379 conn(0x55f514ff4070 msgr2=0x55f515018960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:46.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.858+0000 7f6391240b80 1 -- 172.21.15.146:0/1426210379 shutdown_connections 2023-10-06T11:10:46.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.858+0000 7f6391240b80 1 -- 172.21.15.146:0/1426210379 wait complete. 2023-10-06T11:10:46.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.858+0000 7f6391240b80 20 client.6957 trim_cache size 0 max 16384 2023-10-06T11:10:46.869 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:10:46.869 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1", 2023-10-06T11:10:46.869 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2023-10-06T11:10:46.869 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 6786, 2023-10-06T11:10:46.869 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2023-10-06T11:10:46.869 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2023-10-06T11:10:46.869 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2023-10-06T11:10:46.869 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 10.312831314, 2023-10-06T11:10:46.869 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 64, 2023-10-06T11:10:46.869 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 75, 2023-10-06T11:10:46.869 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 75, 2023-10-06T11:10:46.869 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 16.422071488 2023-10-06T11:10:46.870 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:10:46.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.859+0000 7f6387f48700 1 -- 172.21.15.146:0/448937612 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6364066f30 msgr2=0x7f63640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:46.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.859+0000 7f6387f48700 1 --2- 172.21.15.146:0/448937612 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6364066f30 0x7f63640693e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6380088530 tx=0x7f637c007760 comp rx=0 tx=0).stop 2023-10-06T11:10:46.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.859+0000 7f6387f48700 1 -- 172.21.15.146:0/448937612 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f638015a160 msgr2=0x7f6380153560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:46.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.859+0000 7f6387f48700 1 --2- 172.21.15.146:0/448937612 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f638015a160 0x7f6380153560 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f6380088c60 tx=0x7f6378017000 comp rx=0 tx=0).stop 2023-10-06T11:10:46.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.859+0000 7f6387f48700 1 -- 172.21.15.146:0/448937612 shutdown_connections 2023-10-06T11:10:46.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.859+0000 7f6387f48700 1 --2- 172.21.15.146:0/448937612 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6364066f30 0x7f63640693e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.859+0000 7f6387f48700 1 --2- 172.21.15.146:0/448937612 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f638015a160 0x7f6380153560 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.859+0000 7f6387f48700 1 --2- 172.21.15.146:0/448937612 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63800ae730 0x7f63800b6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.859+0000 7f6387f48700 1 --2- 172.21.15.146:0/448937612 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63800ce3d0 0x7f6380153020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.859+0000 7f6387f48700 1 -- 172.21.15.146:0/448937612 >> 172.21.15.146:0/448937612 conn(0x7f638006f380 msgr2=0x7f6380152380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:46.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.859+0000 7f6387f48700 1 -- 172.21.15.146:0/448937612 shutdown_connections 2023-10-06T11:10:46.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.859+0000 7f6387f48700 1 -- 172.21.15.146:0/448937612 wait complete. 2023-10-06T11:10:46.872 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T11:10:46.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.986+0000 7fac8201f700 1 Processor -- start 2023-10-06T11:10:46.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.986+0000 7fac8201f700 1 -- start start 2023-10-06T11:10:46.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.987+0000 7fac8201f700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fac7c157170 0x7fac7c0ae180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:46.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.987+0000 7fac8201f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac7c06ef30 0x7fac7c06e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:46.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.987+0000 7fac8201f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fac7c15aea0 0x7fac7c15b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:46.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.987+0000 7fac8201f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac7c15b820 con 0x7fac7c15aea0 2023-10-06T11:10:46.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.987+0000 7fac8201f700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac7c0ae9b0 con 0x7fac7c157170 2023-10-06T11:10:46.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.987+0000 7fac8201f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac7c06d340 con 0x7fac7c06ef30 2023-10-06T11:10:46.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.987+0000 7fac8181e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fac7c15aea0 0x7fac7c15b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:46.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.987+0000 7fac8181e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fac7c15aea0 0x7fac7c15b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51118/0 (socket says 172.21.15.146:51118) 2023-10-06T11:10:46.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.987+0000 7fac8181e700 1 -- 172.21.15.146:0/3061352307 learned_addr learned my addr 172.21.15.146:0/3061352307 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:46.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.987+0000 7fac8081c700 1 --2- 172.21.15.146:0/3061352307 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac7c06ef30 0x7fac7c06e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:46.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.987+0000 7fac8101d700 1 --2- 172.21.15.146:0/3061352307 >> v2:172.21.15.151:3300/0 conn(0x7fac7c157170 0x7fac7c0ae180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:46.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.987+0000 7fac8181e700 1 -- 172.21.15.146:0/3061352307 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac7c06ef30 msgr2=0x7fac7c06e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:46.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.987+0000 7fac8181e700 1 --2- 172.21.15.146:0/3061352307 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac7c06ef30 0x7fac7c06e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.987+0000 7fac8181e700 1 -- 172.21.15.146:0/3061352307 >> v2:172.21.15.151:3300/0 conn(0x7fac7c157170 msgr2=0x7fac7c0ae180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:46.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.987+0000 7fac8181e700 1 --2- 172.21.15.146:0/3061352307 >> v2:172.21.15.151:3300/0 conn(0x7fac7c157170 0x7fac7c0ae180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.987+0000 7fac8181e700 1 -- 172.21.15.146:0/3061352307 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac7c06d620 con 0x7fac7c15aea0 2023-10-06T11:10:46.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.987+0000 7fac8181e700 1 --2- 172.21.15.146:0/3061352307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac7c15aea0 0x7fac7c15b2e0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fac7c06d1a0 tx=0x7fac74009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6f146b6b8f08caf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:46.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.988+0000 7fac73fff700 1 -- 172.21.15.146:0/3061352307 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7400e070 con 0x7fac7c15aea0 2023-10-06T11:10:46.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.988+0000 7fac73fff700 1 -- 172.21.15.146:0/3061352307 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac7400ba50 con 0x7fac7c15aea0 2023-10-06T11:10:46.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.988+0000 7fac73fff700 1 -- 172.21.15.146:0/3061352307 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac740092e0 con 0x7fac7c15aea0 2023-10-06T11:10:46.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.988+0000 7fac8201f700 1 -- 172.21.15.146:0/3061352307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac7c15aea0 msgr2=0x7fac7c15b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:46.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.988+0000 7fac8201f700 1 --2- 172.21.15.146:0/3061352307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac7c15aea0 0x7fac7c15b2e0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fac7c06d1a0 tx=0x7fac74009840 comp rx=0 tx=0).stop 2023-10-06T11:10:46.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.988+0000 7fac8201f700 1 -- 172.21.15.146:0/3061352307 shutdown_connections 2023-10-06T11:10:46.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.988+0000 7fac8201f700 1 --2- 172.21.15.146:0/3061352307 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac7c15aea0 0x7fac7c15b2e0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.988+0000 7fac8201f700 1 --2- 172.21.15.146:0/3061352307 >> v2:172.21.15.151:3300/0 conn(0x7fac7c157170 0x7fac7c0ae180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.988+0000 7fac8201f700 1 --2- 172.21.15.146:0/3061352307 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac7c06ef30 0x7fac7c06e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.988+0000 7fac8201f700 1 -- 172.21.15.146:0/3061352307 >> 172.21.15.146:0/3061352307 conn(0x7fac7c067f40 msgr2=0x7fac7c0cbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:46.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.988+0000 7fac8201f700 1 -- 172.21.15.146:0/3061352307 shutdown_connections 2023-10-06T11:10:46.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.988+0000 7fac8201f700 1 -- 172.21.15.146:0/3061352307 wait complete. 2023-10-06T11:10:46.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.989+0000 7fac8201f700 1 Processor -- start 2023-10-06T11:10:46.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.989+0000 7fac8201f700 1 -- start start 2023-10-06T11:10:46.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.990+0000 7fac8201f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac7c06ef30 0x7fac7c154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:46.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.990+0000 7fac8201f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac7c157170 0x7fac7c0b12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:46.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.990+0000 7fac8201f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac7c15aea0 0x7fac7c0b1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:46.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.990+0000 7fac8201f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac7c0a98d0 con 0x7fac7c06ef30 2023-10-06T11:10:46.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.990+0000 7fac8201f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac7c0c7440 con 0x7fac7c15aea0 2023-10-06T11:10:46.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.990+0000 7fac8201f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac7c0c7720 con 0x7fac7c157170 2023-10-06T11:10:46.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.990+0000 7fac8101d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac7c06ef30 0x7fac7c154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:46.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.990+0000 7fac8101d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac7c06ef30 0x7fac7c154730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51134/0 (socket says 172.21.15.146:51134) 2023-10-06T11:10:46.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.990+0000 7fac8101d700 1 -- 172.21.15.146:0/2086462322 learned_addr learned my addr 172.21.15.146:0/2086462322 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:46.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.990+0000 7fac8081c700 1 --2- 172.21.15.146:0/2086462322 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac7c157170 0x7fac7c0b12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:46.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.990+0000 7fac8181e700 1 --2- 172.21.15.146:0/2086462322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac7c15aea0 0x7fac7c0b1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:46.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.991+0000 7fac8101d700 1 -- 172.21.15.146:0/2086462322 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac7c157170 msgr2=0x7fac7c0b12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:46.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.991+0000 7fac8101d700 1 --2- 172.21.15.146:0/2086462322 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac7c157170 0x7fac7c0b12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.991+0000 7fac8101d700 1 -- 172.21.15.146:0/2086462322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac7c15aea0 msgr2=0x7fac7c0b1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:46.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.991+0000 7fac8101d700 1 --2- 172.21.15.146:0/2086462322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac7c15aea0 0x7fac7c0b1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:46.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.991+0000 7fac8101d700 1 -- 172.21.15.146:0/2086462322 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac74009ae0 con 0x7fac7c06ef30 2023-10-06T11:10:46.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.991+0000 7fac8101d700 1 --2- 172.21.15.146:0/2086462322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac7c06ef30 0x7fac7c154730 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fac7800d890 tx=0x7fac78008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:46.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.991+0000 7fac717fa700 1 -- 172.21.15.146:0/2086462322 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7800b600 con 0x7fac7c06ef30 2023-10-06T11:10:46.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.991+0000 7fac717fa700 1 -- 172.21.15.146:0/2086462322 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac7800b760 con 0x7fac7c06ef30 2023-10-06T11:10:47.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.991+0000 7fac8201f700 1 -- 172.21.15.146:0/2086462322 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac7c0a9b20 con 0x7fac7c06ef30 2023-10-06T11:10:47.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.991+0000 7fac717fa700 1 -- 172.21.15.146:0/2086462322 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7800bae0 con 0x7fac7c06ef30 2023-10-06T11:10:47.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.991+0000 7fac8201f700 1 -- 172.21.15.146:0/2086462322 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac7c154c70 con 0x7fac7c06ef30 2023-10-06T11:10:47.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.992+0000 7fac8201f700 1 -- 172.21.15.146:0/2086462322 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac7c0a9fc0 con 0x7fac7c06ef30 2023-10-06T11:10:47.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.992+0000 7fac717fa700 1 -- 172.21.15.146:0/2086462322 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fac7801e460 con 0x7fac7c06ef30 2023-10-06T11:10:47.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.992+0000 7fac717fa700 1 --2- 172.21.15.146:0/2086462322 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fac60066f30 0x7fac600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:47.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.993+0000 7fac717fa700 1 -- 172.21.15.146:0/2086462322 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fac78084d40 con 0x7fac7c06ef30 2023-10-06T11:10:47.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.993+0000 7fac8081c700 1 --2- 172.21.15.146:0/2086462322 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fac60066f30 0x7fac600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:47.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.993+0000 7fac8081c700 1 --2- 172.21.15.146:0/2086462322 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fac60066f30 0x7fac600693e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fac7c0b0990 tx=0x7fac6c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:47.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:46.997+0000 7fac717fa700 1 -- 172.21.15.146:0/2086462322 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fac78051e50 con 0x7fac7c06ef30 2023-10-06T11:10:47.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:47.224+0000 7fac8201f700 1 -- 172.21.15.146:0/2086462322 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fac7c06d900 con 0x7fac7c06ef30 2023-10-06T11:10:47.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:47.224+0000 7fac717fa700 1 -- 172.21.15.146:0/2086462322 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v64) v1 ==== 53+0+73 (secure 0 0 0) 0x7fac78055470 con 0x7fac7c06ef30 2023-10-06T11:10:47.226 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T11:10:47.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:47.226+0000 7fac8201f700 1 -- 172.21.15.146:0/2086462322 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fac60066f30 msgr2=0x7fac600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:47.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:47.226+0000 7fac8201f700 1 --2- 172.21.15.146:0/2086462322 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fac60066f30 0x7fac600693e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fac7c0b0990 tx=0x7fac6c008040 comp rx=0 tx=0).stop 2023-10-06T11:10:47.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:47.226+0000 7fac8201f700 1 -- 172.21.15.146:0/2086462322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac7c06ef30 msgr2=0x7fac7c154730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:47.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:47.226+0000 7fac8201f700 1 --2- 172.21.15.146:0/2086462322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac7c06ef30 0x7fac7c154730 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fac7800d890 tx=0x7fac78008040 comp rx=0 tx=0).stop 2023-10-06T11:10:47.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:47.226+0000 7fac8201f700 1 -- 172.21.15.146:0/2086462322 shutdown_connections 2023-10-06T11:10:47.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:47.226+0000 7fac8201f700 1 --2- 172.21.15.146:0/2086462322 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fac60066f30 0x7fac600693e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:47.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:47.226+0000 7fac8201f700 1 --2- 172.21.15.146:0/2086462322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac7c15aea0 0x7fac7c0b1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:47.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:47.226+0000 7fac8201f700 1 --2- 172.21.15.146:0/2086462322 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fac7c06ef30 0x7fac7c154730 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:47.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:47.226+0000 7fac8201f700 1 --2- 172.21.15.146:0/2086462322 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac7c157170 0x7fac7c0b12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:47.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:47.226+0000 7fac8201f700 1 -- 172.21.15.146:0/2086462322 >> 172.21.15.146:0/2086462322 conn(0x7fac7c067f40 msgr2=0x7fac7c06a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:47.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:47.226+0000 7fac8201f700 1 -- 172.21.15.146:0/2086462322 shutdown_connections 2023-10-06T11:10:47.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:47.226+0000 7fac8201f700 1 -- 172.21.15.146:0/2086462322 wait complete. 2023-10-06T11:10:47.240 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T11:10:47.240 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T11:10:47.240 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2023-10-06T11:10:47.240 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T11:10:47.240 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T11:10:47.240 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T11:10:47.241 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T11:10:47.241 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T11:10:47.241 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:10:47.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:10:47.241 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2023-10-06T11:10:47.261 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:10:47.262 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:10:47.262 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:10:47.262 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:10:47.262 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2023-10-06T11:10:47.262 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:10:47.262 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:10:47.262 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2023-10-06T11:10:47.262 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2023-10-06T11:10:47.263 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:10:47.263 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2023-10-06T11:10:47.263 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2023-10-06T11:10:47.263 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:10:47.263 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2023-10-06T11:10:47.263 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T11:10:47.263 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2023-10-06T11:10:47.263 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T11:10:47.263 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42210sec preferred_lft 42210sec 2023-10-06T11:10:47.263 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link noprefixroute 2023-10-06T11:10:47.263 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:10:47.263 INFO:teuthology.orchestra.run.smithi146.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T11:10:47.264 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0e:4f:33:80:c4:0e brd ff:ff:ff:ff:ff:ff 2023-10-06T11:10:47.264 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T11:10:47.264 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:10:47.264 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3884:6eff:fefc:ffc7/64 scope link 2023-10-06T11:10:47.264 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:10:47.264 INFO:teuthology.orchestra.run.smithi146.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:10:47.264 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0e:4f:33:80:c4:0e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T11:10:47.264 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::c4f:33ff:fe80:c40e/64 scope link 2023-10-06T11:10:47.264 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:10:47.264 INFO:teuthology.orchestra.run.smithi146.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:10:47.264 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 36:96:28:73:57:c4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T11:10:47.264 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3496:28ff:fe73:57c4/64 scope link 2023-10-06T11:10:47.265 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:10:47.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:10:47.265 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T11:10:47.324 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-06T11:10:47.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:10:47.326 DEBUG:teuthology.orchestra.run.smithi146:> route 2023-10-06T11:10:47.382 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2023-10-06T11:10:47.383 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T11:10:47.383 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T11:10:47.383 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T11:10:47.383 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T11:10:47.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:10:47.383 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-10-06T11:10:47.383 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:10:47.383 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T11:10:47.384 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T11:10:47.384 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T11:10:47.384 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:10:47.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:10:47.482 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-10-06T11:10:47.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T11:10:47.496 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T11:10:47.497 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:10:47.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:10:47.497 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2023-10-06T11:10:47.561 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T11:10:47.561 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:10:47.561 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T11:10:47.616 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:10:47.616 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:10:47.616 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:10:47.671 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-06T11:10:47.735 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:10:47.735 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:10:47.799 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:10:47.800 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:10:47.801 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:10:47.801 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-06T11:10:47.855 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T11:10:47.856 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T11:10:47.898 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-06T11:10:47.921 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:10:47.921 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:10:47.980 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:2023-10-06T11:10:47.978+0000 7f7827f69540 -1 init, newargv = 0x555e5bf2de60 newargc=15 2023-10-06T11:10:47.980 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[121412]: starting ceph client 2023-10-06T11:10:47.985 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[121412]: starting fuse 2023-10-06T11:10:47.988 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:10:47.989 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:10:47.989 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:10:47.990 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-06T11:10:48.045 INFO:teuthology.orchestra.run.smithi146.stdout:46 2023-10-06T11:10:48.045 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-06T11:10:48.045 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T11:10:48.045 DEBUG:teuthology.orchestra.run.smithi146:> import glob 2023-10-06T11:10:48.045 DEBUG:teuthology.orchestra.run.smithi146:> import re 2023-10-06T11:10:48.045 DEBUG:teuthology.orchestra.run.smithi146:> import os 2023-10-06T11:10:48.045 DEBUG:teuthology.orchestra.run.smithi146:> import subprocess 2023-10-06T11:10:48.046 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:10:48.046 DEBUG:teuthology.orchestra.run.smithi146:> def _find_admin_socket(client_name): 2023-10-06T11:10:48.046 DEBUG:teuthology.orchestra.run.smithi146:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T11:10:48.046 DEBUG:teuthology.orchestra.run.smithi146:> files = glob.glob(asok_path) 2023-10-06T11:10:48.046 DEBUG:teuthology.orchestra.run.smithi146:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T11:10:48.046 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:10:48.046 DEBUG:teuthology.orchestra.run.smithi146:> # Given a non-glob path, it better be there 2023-10-06T11:10:48.046 DEBUG:teuthology.orchestra.run.smithi146:> if "*" not in asok_path: 2023-10-06T11:10:48.046 DEBUG:teuthology.orchestra.run.smithi146:> assert(len(files) == 1) 2023-10-06T11:10:48.046 DEBUG:teuthology.orchestra.run.smithi146:> return files[0] 2023-10-06T11:10:48.046 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:10:48.046 DEBUG:teuthology.orchestra.run.smithi146:> for f in files: 2023-10-06T11:10:48.046 DEBUG:teuthology.orchestra.run.smithi146:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T11:10:48.047 DEBUG:teuthology.orchestra.run.smithi146:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T11:10:48.047 DEBUG:teuthology.orchestra.run.smithi146:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T11:10:48.047 DEBUG:teuthology.orchestra.run.smithi146:> contents = proc_f.read() 2023-10-06T11:10:48.047 DEBUG:teuthology.orchestra.run.smithi146:> if mountpoint in contents: 2023-10-06T11:10:48.047 DEBUG:teuthology.orchestra.run.smithi146:> return f 2023-10-06T11:10:48.047 DEBUG:teuthology.orchestra.run.smithi146:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T11:10:48.047 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:10:48.047 DEBUG:teuthology.orchestra.run.smithi146:> print(_find_admin_socket("client.0")) 2023-10-06T11:10:48.047 DEBUG:teuthology.orchestra.run.smithi146:> ' 2023-10-06T11:10:48.166 INFO:teuthology.orchestra.run.smithi146.stdout:/var/run/ceph/ceph-client.0.121412.asok 2023-10-06T11:10:48.348 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.121412.asok 2023-10-06T11:10:48.348 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:10:48.348 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.121412.asok status 2023-10-06T11:10:48.499 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:10:48.500 INFO:teuthology.orchestra.run.smithi146.stdout: "metadata": { 2023-10-06T11:10:48.500 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T11:10:48.500 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T11:10:48.500 INFO:teuthology.orchestra.run.smithi146.stdout: "entity_id": "0", 2023-10-06T11:10:48.500 INFO:teuthology.orchestra.run.smithi146.stdout: "hostname": "smithi146", 2023-10-06T11:10:48.500 INFO:teuthology.orchestra.run.smithi146.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T11:10:48.500 INFO:teuthology.orchestra.run.smithi146.stdout: "pid": "121412", 2023-10-06T11:10:48.500 INFO:teuthology.orchestra.run.smithi146.stdout: "root": "/" 2023-10-06T11:10:48.500 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:10:48.500 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_count": 0, 2023-10-06T11:10:48.500 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_pinned_count": 0, 2023-10-06T11:10:48.501 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 6969, 2023-10-06T11:10:48.501 INFO:teuthology.orchestra.run.smithi146.stdout: "inst": { 2023-10-06T11:10:48.501 INFO:teuthology.orchestra.run.smithi146.stdout: "name": { 2023-10-06T11:10:48.501 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "client", 2023-10-06T11:10:48.501 INFO:teuthology.orchestra.run.smithi146.stdout: "num": 6969 2023-10-06T11:10:48.501 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:10:48.501 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-06T11:10:48.501 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-06T11:10:48.501 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:10:48.501 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 3294769692 2023-10-06T11:10:48.501 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:10:48.502 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:10:48.502 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-06T11:10:48.502 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-06T11:10:48.502 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:10:48.502 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 3294769692 2023-10-06T11:10:48.502 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:10:48.502 INFO:teuthology.orchestra.run.smithi146.stdout: "inst_str": "client.6969 192.168.0.1:0/3294769692", 2023-10-06T11:10:48.502 INFO:teuthology.orchestra.run.smithi146.stdout: "addr_str": "192.168.0.1:0/3294769692", 2023-10-06T11:10:48.502 INFO:teuthology.orchestra.run.smithi146.stdout: "inode_count": 1, 2023-10-06T11:10:48.502 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_epoch": 64, 2023-10-06T11:10:48.502 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch": 75, 2023-10-06T11:10:48.503 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch_barrier": 0, 2023-10-06T11:10:48.503 INFO:teuthology.orchestra.run.smithi146.stdout: "blocklisted": false, 2023-10-06T11:10:48.503 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs" 2023-10-06T11:10:48.503 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:10:48.510 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:10:48.510 DEBUG:teuthology.orchestra.run.smithi146:> stat --file-system '--printf=%T 2023-10-06T11:10:48.510 DEBUG:teuthology.orchestra.run.smithi146:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T11:10:48.525 INFO:teuthology.orchestra.run.smithi146.stdout:fuseblk 2023-10-06T11:10:48.526 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T11:10:48.526 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:10:48.526 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:10:48.591 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_new_snaps true --yes-i-really-mean-it 2023-10-06T11:10:48.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.747+0000 7fb024af5700 1 Processor -- start 2023-10-06T11:10:48.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.747+0000 7fb024af5700 1 -- start start 2023-10-06T11:10:48.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.748+0000 7fb024af5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb02015a160 0x7fb0200c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:48.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.748+0000 7fb024af5700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0200ae2a0 con 0x7fb0200cb950 2023-10-06T11:10:48.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.748+0000 7fb024af5700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb02015a530 con 0x7fb0200ae730 2023-10-06T11:10:48.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.748+0000 7fb024af5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0200ad690 con 0x7fb02015a160 2023-10-06T11:10:48.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.748+0000 7fb01e59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb02015a160 0x7fb0200c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:48.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.748+0000 7fb01e59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb02015a160 0x7fb0200c55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51142/0 (socket says 172.21.15.146:51142) 2023-10-06T11:10:48.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.748+0000 7fb01ed9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb0200cb950 0x7fb0200cbd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:34878/0 (socket says 172.21.15.146:34878) 2023-10-06T11:10:48.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.748+0000 7fb01e59c700 1 -- 172.21.15.146:0/71294229 learned_addr learned my addr 172.21.15.146:0/71294229 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:48.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.748+0000 7fb01e59c700 1 -- 172.21.15.146:0/71294229 >> v1:172.21.15.151:6789/0 conn(0x7fb0200ae730 legacy=0x7fb0200aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:10:48.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.748+0000 7fb01e59c700 1 -- 172.21.15.146:0/71294229 >> v1:172.21.15.146:6789/0 conn(0x7fb0200cb950 legacy=0x7fb0200cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:48.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.748+0000 7fb01e59c700 1 -- 172.21.15.146:0/71294229 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0200ad970 con 0x7fb02015a160 2023-10-06T11:10:48.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.748+0000 7fb01e59c700 1 --2- 172.21.15.146:0/71294229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb02015a160 0x7fb0200c55a0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fb010009f70 tx=0x7fb010009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc1ed66328a1b16b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:48.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.748+0000 7fb01d59a700 1 -- 172.21.15.146:0/71294229 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01000e070 con 0x7fb02015a160 2023-10-06T11:10:48.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.748+0000 7fb01d59a700 1 -- 172.21.15.146:0/71294229 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01000ba90 con 0x7fb02015a160 2023-10-06T11:10:48.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.748+0000 7fb01d59a700 1 -- 172.21.15.146:0/71294229 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0100092e0 con 0x7fb02015a160 2023-10-06T11:10:48.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.749+0000 7fb024af5700 1 -- 172.21.15.146:0/71294229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb02015a160 msgr2=0x7fb0200c55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:48.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.749+0000 7fb024af5700 1 --2- 172.21.15.146:0/71294229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb02015a160 0x7fb0200c55a0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fb010009f70 tx=0x7fb010009840 comp rx=0 tx=0).stop 2023-10-06T11:10:48.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.749+0000 7fb024af5700 1 -- 172.21.15.146:0/71294229 shutdown_connections 2023-10-06T11:10:48.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.749+0000 7fb024af5700 1 --2- 172.21.15.146:0/71294229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb02015a160 0x7fb0200c55a0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:48.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.749+0000 7fb024af5700 1 -- 172.21.15.146:0/71294229 >> 172.21.15.146:0/71294229 conn(0x7fb02006f380 msgr2=0x7fb0200d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:48.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.749+0000 7fb024af5700 1 -- 172.21.15.146:0/71294229 shutdown_connections 2023-10-06T11:10:48.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.749+0000 7fb024af5700 1 -- 172.21.15.146:0/71294229 wait complete. 2023-10-06T11:10:48.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.750+0000 7fb024af5700 1 Processor -- start 2023-10-06T11:10:48.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.750+0000 7fb024af5700 1 -- start start 2023-10-06T11:10:48.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.751+0000 7fb024af5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0200ae730 0x7fb020150c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:48.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.751+0000 7fb024af5700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0200cb950 0x7fb0200c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:48.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.751+0000 7fb024af5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb02015a160 0x7fb0200c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:48.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.751+0000 7fb024af5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0200b41e0 con 0x7fb02015a160 2023-10-06T11:10:48.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.751+0000 7fb024af5700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0200b38b0 con 0x7fb0200ae730 2023-10-06T11:10:48.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.751+0000 7fb024af5700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0200b3b90 con 0x7fb0200cb950 2023-10-06T11:10:48.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.751+0000 7fb01ed9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb02015a160 0x7fb0200c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:48.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.751+0000 7fb01ed9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb02015a160 0x7fb0200c8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51148/0 (socket says 172.21.15.146:51148) 2023-10-06T11:10:48.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.751+0000 7fb01ed9d700 1 -- 172.21.15.146:0/2926979074 learned_addr learned my addr 172.21.15.146:0/2926979074 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:10:48.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.751+0000 7fb01e59c700 1 --2- 172.21.15.146:0/2926979074 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0200ae730 0x7fb020150c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:48.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.751+0000 7fb01dd9b700 1 --2- 172.21.15.146:0/2926979074 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0200cb950 0x7fb0200c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:48.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.751+0000 7fb01ed9d700 1 -- 172.21.15.146:0/2926979074 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0200cb950 msgr2=0x7fb0200c7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:48.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.751+0000 7fb01ed9d700 1 --2- 172.21.15.146:0/2926979074 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0200cb950 0x7fb0200c7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:48.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.751+0000 7fb01ed9d700 1 -- 172.21.15.146:0/2926979074 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0200ae730 msgr2=0x7fb020150c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:48.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.751+0000 7fb01ed9d700 1 --2- 172.21.15.146:0/2926979074 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0200ae730 0x7fb020150c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:48.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.751+0000 7fb01ed9d700 1 -- 172.21.15.146:0/2926979074 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb010009ae0 con 0x7fb02015a160 2023-10-06T11:10:48.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.751+0000 7fb01dd9b700 1 --2- 172.21.15.146:0/2926979074 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0200cb950 0x7fb0200c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:10:48.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.751+0000 7fb01ed9d700 1 --2- 172.21.15.146:0/2926979074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb02015a160 0x7fb0200c8270 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fb01800c590 tx=0x7fb018007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:48.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.751+0000 7fb0167fc700 1 -- 172.21.15.146:0/2926979074 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb018005b40 con 0x7fb02015a160 2023-10-06T11:10:48.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.751+0000 7fb0167fc700 1 -- 172.21.15.146:0/2926979074 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb018005cc0 con 0x7fb02015a160 2023-10-06T11:10:48.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.752+0000 7fb024af5700 1 -- 172.21.15.146:0/2926979074 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0200b3e70 con 0x7fb02015a160 2023-10-06T11:10:48.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.752+0000 7fb0167fc700 1 -- 172.21.15.146:0/2926979074 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb018007320 con 0x7fb02015a160 2023-10-06T11:10:48.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.752+0000 7fb024af5700 1 -- 172.21.15.146:0/2926979074 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0200b4670 con 0x7fb02015a160 2023-10-06T11:10:48.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.753+0000 7fb024af5700 1 -- 172.21.15.146:0/2926979074 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb020068390 con 0x7fb02015a160 2023-10-06T11:10:48.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.753+0000 7fb0167fc700 1 -- 172.21.15.146:0/2926979074 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb01801b3b0 con 0x7fb02015a160 2023-10-06T11:10:48.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.753+0000 7fb0167fc700 1 --2- 172.21.15.146:0/2926979074 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb000066f30 0x7fb0000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:10:48.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.753+0000 7fb01e59c700 1 --2- 172.21.15.146:0/2926979074 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb000066f30 0x7fb0000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:10:48.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.753+0000 7fb0167fc700 1 -- 172.21.15.146:0/2926979074 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb018083c30 con 0x7fb02015a160 2023-10-06T11:10:48.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.754+0000 7fb01e59c700 1 --2- 172.21.15.146:0/2926979074 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb000066f30 0x7fb0000693e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb010009880 tx=0x7fb010017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:10:48.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.758+0000 7fb0167fc700 1 -- 172.21.15.146:0/2926979074 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb018050d40 con 0x7fb02015a160 2023-10-06T11:10:48.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:48.984+0000 7fb024af5700 1 -- 172.21.15.146:0/2926979074 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb02004c380 con 0x7fb02015a160 2023-10-06T11:10:49.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:49.612+0000 7fb0167fc700 1 -- 172.21.15.146:0/2926979074 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_new_snaps", "val": "true", "yes_i_really_mean_it": true}]=0 enabled new snapshots v65) v1 ==== 167+0+0 (secure 0 0 0) 0x7fb018017070 con 0x7fb02015a160 2023-10-06T11:10:49.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:49.614+0000 7fb024af5700 1 -- 172.21.15.146:0/2926979074 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb000066f30 msgr2=0x7fb0000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:49.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:49.614+0000 7fb024af5700 1 --2- 172.21.15.146:0/2926979074 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb000066f30 0x7fb0000693e0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb010009880 tx=0x7fb010017000 comp rx=0 tx=0).stop 2023-10-06T11:10:49.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:49.614+0000 7fb024af5700 1 -- 172.21.15.146:0/2926979074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb02015a160 msgr2=0x7fb0200c8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:10:49.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:49.614+0000 7fb024af5700 1 --2- 172.21.15.146:0/2926979074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb02015a160 0x7fb0200c8270 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fb01800c590 tx=0x7fb018007ef0 comp rx=0 tx=0).stop 2023-10-06T11:10:49.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:49.614+0000 7fb024af5700 1 -- 172.21.15.146:0/2926979074 shutdown_connections 2023-10-06T11:10:49.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:49.614+0000 7fb024af5700 1 --2- 172.21.15.146:0/2926979074 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb000066f30 0x7fb0000693e0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:49.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:49.614+0000 7fb024af5700 1 --2- 172.21.15.146:0/2926979074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb02015a160 0x7fb0200c8270 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:49.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:49.614+0000 7fb024af5700 1 --2- 172.21.15.146:0/2926979074 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0200ae730 0x7fb020150c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:49.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:49.614+0000 7fb024af5700 1 --2- 172.21.15.146:0/2926979074 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0200cb950 0x7fb0200c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:10:49.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:49.614+0000 7fb024af5700 1 -- 172.21.15.146:0/2926979074 >> 172.21.15.146:0/2926979074 conn(0x7fb02006f380 msgr2=0x7fb020069e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:10:49.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:49.614+0000 7fb024af5700 1 -- 172.21.15.146:0/2926979074 shutdown_connections 2023-10-06T11:10:49.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:10:49.614+0000 7fb024af5700 1 -- 172.21.15.146:0/2926979074 wait complete. 2023-10-06T11:10:49.618 INFO:teuthology.orchestra.run.smithi146.stderr:enabled new snapshots 2023-10-06T11:10:49.628 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:10:49.628 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir stray_eval_dir) 2023-10-06T11:10:49.651 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T11:10:49.651 DEBUG:teuthology.orchestra.run.smithi146:> import os 2023-10-06T11:10:49.651 DEBUG:teuthology.orchestra.run.smithi146:> import uuid 2023-10-06T11:10:49.651 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:10:49.651 DEBUG:teuthology.orchestra.run.smithi146:> n = 2000 2023-10-06T11:10:49.651 DEBUG:teuthology.orchestra.run.smithi146:> create_hard_links = False 2023-10-06T11:10:49.652 DEBUG:teuthology.orchestra.run.smithi146:> if 3 > 0: 2023-10-06T11:10:49.652 DEBUG:teuthology.orchestra.run.smithi146:> create_hard_links = True 2023-10-06T11:10:49.652 DEBUG:teuthology.orchestra.run.smithi146:> path = "/home/ubuntu/cephtest/mnt.0/stray_eval_dir/file" 2023-10-06T11:10:49.652 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:10:49.652 DEBUG:teuthology.orchestra.run.smithi146:> dpath = os.path.dirname(path) 2023-10-06T11:10:49.652 DEBUG:teuthology.orchestra.run.smithi146:> fnameprefix = os.path.basename(path) 2023-10-06T11:10:49.652 DEBUG:teuthology.orchestra.run.smithi146:> os.makedirs(dpath, exist_ok=True) 2023-10-06T11:10:49.652 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:10:49.652 DEBUG:teuthology.orchestra.run.smithi146:> try: 2023-10-06T11:10:49.652 DEBUG:teuthology.orchestra.run.smithi146:> dirfd = os.open(dpath, os.O_DIRECTORY) 2023-10-06T11:10:49.652 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:10:49.652 DEBUG:teuthology.orchestra.run.smithi146:> for i in range(n): 2023-10-06T11:10:49.652 DEBUG:teuthology.orchestra.run.smithi146:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2023-10-06T11:10:49.652 DEBUG:teuthology.orchestra.run.smithi146:> with open(fpath, '"'"'w'"'"') as f: 2023-10-06T11:10:49.653 DEBUG:teuthology.orchestra.run.smithi146:> f.write(f"{i}") 2023-10-06T11:10:49.653 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2023-10-06T11:10:49.653 DEBUG:teuthology.orchestra.run.smithi146:> f.flush() 2023-10-06T11:10:49.653 DEBUG:teuthology.orchestra.run.smithi146:> os.fsync(f.fileno()) 2023-10-06T11:10:49.653 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2023-10-06T11:10:49.653 DEBUG:teuthology.orchestra.run.smithi146:> os.unlink(fpath) 2023-10-06T11:10:49.653 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2023-10-06T11:10:49.653 DEBUG:teuthology.orchestra.run.smithi146:> os.fsync(dirfd) 2023-10-06T11:10:49.653 DEBUG:teuthology.orchestra.run.smithi146:> if create_hard_links: 2023-10-06T11:10:49.653 DEBUG:teuthology.orchestra.run.smithi146:> for j in range(3): 2023-10-06T11:10:49.653 DEBUG:teuthology.orchestra.run.smithi146:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2023-10-06T11:10:49.653 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2023-10-06T11:10:49.654 DEBUG:teuthology.orchestra.run.smithi146:> os.fsync(dirfd) 2023-10-06T11:10:49.654 DEBUG:teuthology.orchestra.run.smithi146:> finally: 2023-10-06T11:10:49.654 DEBUG:teuthology.orchestra.run.smithi146:> os.close(dirfd) 2023-10-06T11:10:49.654 DEBUG:teuthology.orchestra.run.smithi146:> ' 2023-10-06T11:10:50.569 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:10:50.572 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:11:20.633 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:11:20.636 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:11:22.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:11:22.980 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2023-10-06T11:11:23.035 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:11:23.036 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec find /home/ubuntu/cephtest/mnt.0/stray_eval_dir/ -type f -delete) 2023-10-06T11:11:50.705 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:11:50.708 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:11:58.120 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:11:58.120 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir /home/ubuntu/cephtest/mnt.0/stray_eval_dir/.snap/snap1-stray_eval_dir) 2023-10-06T11:11:58.161 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 perf dump 2023-10-06T11:11:58.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.317+0000 7f227090c700 1 Processor -- start 2023-10-06T11:11:58.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.317+0000 7f227090c700 1 -- start start 2023-10-06T11:11:58.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.318+0000 7f227090c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f226c15a160 0x7f226c0c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.318+0000 7f227090c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f226c0cb950 0x7f226c0cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.318+0000 7f227090c700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f226c0ae2a0 con 0x7f226c0ae730 2023-10-06T11:11:58.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.318+0000 7f227090c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f226c15a530 con 0x7f226c15a160 2023-10-06T11:11:58.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.318+0000 7f227090c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f226c0ad690 con 0x7f226c0cb950 2023-10-06T11:11:58.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.318+0000 7f226a59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f226c15a160 0x7f226c0c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.318+0000 7f226a59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f226c15a160 0x7f226c0c55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52738/0 (socket says 172.21.15.146:52738) 2023-10-06T11:11:58.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.318+0000 7f226a59c700 1 -- 172.21.15.146:0/2889526079 learned_addr learned my addr 172.21.15.146:0/2889526079 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:11:58.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.318+0000 7f226ad9d700 1 --2- 172.21.15.146:0/2889526079 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f226c0cb950 0x7f226c0cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.318+0000 7f226a59c700 1 -- 172.21.15.146:0/2889526079 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f226c0cb950 msgr2=0x7f226c0cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:11:58.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.318+0000 7f226a59c700 1 --2- 172.21.15.146:0/2889526079 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f226c0cb950 0x7f226c0cbdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.318+0000 7f226a59c700 1 -- 172.21.15.146:0/2889526079 >> v1:172.21.15.151:6789/0 conn(0x7f226c0ae730 legacy=0x7f226c0aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:11:58.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.318+0000 7f226a59c700 1 -- 172.21.15.146:0/2889526079 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226c0ad970 con 0x7f226c15a160 2023-10-06T11:11:58.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.318+0000 7f226a59c700 1 --2- 172.21.15.146:0/2889526079 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f226c15a160 0x7f226c0c55a0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f225c009990 tx=0x7f225c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56366313406cfd2b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:11:58.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.318+0000 7f226959a700 1 -- 172.21.15.146:0/2889526079 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225c005c10 con 0x7f226c15a160 2023-10-06T11:11:58.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.318+0000 7f226959a700 1 -- 172.21.15.146:0/2889526079 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225c005d70 con 0x7f226c15a160 2023-10-06T11:11:58.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.319+0000 7f226959a700 1 -- 172.21.15.146:0/2889526079 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225c00b840 con 0x7f226c15a160 2023-10-06T11:11:58.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.319+0000 7f227090c700 1 -- 172.21.15.146:0/2889526079 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f226c15a160 msgr2=0x7f226c0c55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:11:58.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.319+0000 7f227090c700 1 --2- 172.21.15.146:0/2889526079 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f226c15a160 0x7f226c0c55a0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f225c009990 tx=0x7f225c009220 comp rx=0 tx=0).stop 2023-10-06T11:11:58.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.319+0000 7f227090c700 1 -- 172.21.15.146:0/2889526079 shutdown_connections 2023-10-06T11:11:58.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.319+0000 7f227090c700 1 --2- 172.21.15.146:0/2889526079 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f226c0cb950 0x7f226c0cbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.319+0000 7f227090c700 1 --2- 172.21.15.146:0/2889526079 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f226c15a160 0x7f226c0c55a0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.319+0000 7f227090c700 1 -- 172.21.15.146:0/2889526079 >> 172.21.15.146:0/2889526079 conn(0x7f226c06f380 msgr2=0x7f226c0d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:11:58.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.319+0000 7f227090c700 1 -- 172.21.15.146:0/2889526079 shutdown_connections 2023-10-06T11:11:58.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.319+0000 7f227090c700 1 -- 172.21.15.146:0/2889526079 wait complete. 2023-10-06T11:11:58.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.320+0000 7f227090c700 1 Processor -- start 2023-10-06T11:11:58.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.320+0000 7f227090c700 1 -- start start 2023-10-06T11:11:58.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.321+0000 7f227090c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f226c0ae730 0x7f226c0b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.321+0000 7f227090c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f226c0cb950 0x7f226c156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.321+0000 7f227090c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f226c15a160 0x7f226c0c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.321+0000 7f227090c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226c0b5e30 con 0x7f226c15a160 2023-10-06T11:11:58.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.321+0000 7f227090c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f226c0c8880 con 0x7f226c0ae730 2023-10-06T11:11:58.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.321+0000 7f227090c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f226c0c7c70 con 0x7f226c0cb950 2023-10-06T11:11:58.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.321+0000 7f226ad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f226c15a160 0x7f226c0c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.321+0000 7f226ad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f226c15a160 0x7f226c0c8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52754/0 (socket says 172.21.15.146:52754) 2023-10-06T11:11:58.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.321+0000 7f226ad9d700 1 -- 172.21.15.146:0/1292973045 learned_addr learned my addr 172.21.15.146:0/1292973045 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:11:58.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.321+0000 7f226a59c700 1 --2- 172.21.15.146:0/1292973045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f226c0ae730 0x7f226c0b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.321+0000 7f2269d9b700 1 --2- 172.21.15.146:0/1292973045 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f226c0cb950 0x7f226c156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.321+0000 7f226ad9d700 1 -- 172.21.15.146:0/1292973045 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f226c0cb950 msgr2=0x7f226c156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:11:58.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.321+0000 7f226ad9d700 1 --2- 172.21.15.146:0/1292973045 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f226c0cb950 0x7f226c156840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.321+0000 7f226ad9d700 1 -- 172.21.15.146:0/1292973045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f226c0ae730 msgr2=0x7f226c0b58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:11:58.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.321+0000 7f226ad9d700 1 --2- 172.21.15.146:0/1292973045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f226c0ae730 0x7f226c0b58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.321+0000 7f226ad9d700 1 -- 172.21.15.146:0/1292973045 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f225c009480 con 0x7f226c15a160 2023-10-06T11:11:58.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.321+0000 7f2269d9b700 1 --2- 172.21.15.146:0/1292973045 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f226c0cb950 0x7f226c156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:11:58.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.321+0000 7f226ad9d700 1 --2- 172.21.15.146:0/1292973045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f226c15a160 0x7f226c0c8d10 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f226400ceb0 tx=0x7f2264007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:11:58.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.322+0000 7f225a7fc700 1 -- 172.21.15.146:0/1292973045 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2264016430 con 0x7f226c15a160 2023-10-06T11:11:58.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.322+0000 7f225a7fc700 1 -- 172.21.15.146:0/1292973045 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2264016590 con 0x7f226c15a160 2023-10-06T11:11:58.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.322+0000 7f227090c700 1 -- 172.21.15.146:0/1292973045 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f226c0c7f50 con 0x7f226c15a160 2023-10-06T11:11:58.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.322+0000 7f225a7fc700 1 -- 172.21.15.146:0/1292973045 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2264016930 con 0x7f226c15a160 2023-10-06T11:11:58.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.322+0000 7f227090c700 1 -- 172.21.15.146:0/1292973045 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f226c0c8510 con 0x7f226c15a160 2023-10-06T11:11:58.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.323+0000 7f225a7fc700 1 -- 172.21.15.146:0/1292973045 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2264003020 con 0x7f226c15a160 2023-10-06T11:11:58.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.323+0000 7f225a7fc700 1 --2- 172.21.15.146:0/1292973045 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f224c066f30 0x7f224c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.323+0000 7f225a7fc700 1 -- 172.21.15.146:0/1292973045 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2264012070 con 0x7f226c15a160 2023-10-06T11:11:58.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.323+0000 7f226a59c700 1 --2- 172.21.15.146:0/1292973045 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f224c066f30 0x7f224c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.324+0000 7f226a59c700 1 --2- 172.21.15.146:0/1292973045 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f224c066f30 0x7f224c0693e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f225c0030c0 tx=0x7f225c015000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:11:58.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.325+0000 7f2279c04b80 1 Processor -- start 2023-10-06T11:11:58.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.325+0000 7f2279c04b80 1 -- start start 2023-10-06T11:11:58.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.326+0000 7f2279c04b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562226d35ad0 0x562226d35ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.326+0000 7f2279c04b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562226cf19e0 0x562226cee5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.326+0000 7f2279c04b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562226cefc10 0x562226ceeb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.326+0000 7f2279c04b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x562226c6ecc0 con 0x562226d35ad0 2023-10-06T11:11:58.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.326+0000 7f2279c04b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562226c45ab0 con 0x562226cefc10 2023-10-06T11:11:58.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.326+0000 7f2279c04b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x562226c432b0 con 0x562226cf19e0 2023-10-06T11:11:58.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.326+0000 7f226a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562226d35ad0 0x562226d35ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.326+0000 7f226a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562226d35ad0 0x562226d35ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52768/0 (socket says 172.21.15.146:52768) 2023-10-06T11:11:58.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.326+0000 7f226a59c700 1 -- 172.21.15.146:0/4195621587 learned_addr learned my addr 172.21.15.146:0/4195621587 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:11:58.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.326+0000 7f2269d9b700 1 --2- 172.21.15.146:0/4195621587 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562226cf19e0 0x562226cee5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.326+0000 7f226ad9d700 1 --2- 172.21.15.146:0/4195621587 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562226cefc10 0x562226ceeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.327+0000 7f226a59c700 1 -- 172.21.15.146:0/4195621587 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562226cf19e0 msgr2=0x562226cee5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:11:58.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.327+0000 7f226a59c700 1 --2- 172.21.15.146:0/4195621587 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562226cf19e0 0x562226cee5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.327+0000 7f226a59c700 1 -- 172.21.15.146:0/4195621587 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562226cefc10 msgr2=0x562226ceeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:11:58.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.327+0000 7f226a59c700 1 --2- 172.21.15.146:0/4195621587 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562226cefc10 0x562226ceeb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.327+0000 7f226a59c700 1 -- 172.21.15.146:0/4195621587 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562226ad92b0 con 0x562226d35ad0 2023-10-06T11:11:58.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.327+0000 7f226a59c700 1 --2- 172.21.15.146:0/4195621587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562226d35ad0 0x562226d35ea0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f225c00b3c0 tx=0x7f225c020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d65b6c7ebef7d35 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:11:58.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.327+0000 7f224b7fe700 1 -- 172.21.15.146:0/4195621587 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225c00bed0 con 0x562226d35ad0 2023-10-06T11:11:58.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.327+0000 7f224b7fe700 1 -- 172.21.15.146:0/4195621587 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225c01e8d0 con 0x562226d35ad0 2023-10-06T11:11:58.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.327+0000 7f224b7fe700 1 -- 172.21.15.146:0/4195621587 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225c01ec90 con 0x562226d35ad0 2023-10-06T11:11:58.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.328+0000 7f2279c04b80 1 -- 172.21.15.146:0/4195621587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562226d35ad0 msgr2=0x562226d35ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:11:58.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.328+0000 7f2279c04b80 1 --2- 172.21.15.146:0/4195621587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562226d35ad0 0x562226d35ea0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f225c00b3c0 tx=0x7f225c020040 comp rx=0 tx=0).stop 2023-10-06T11:11:58.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.328+0000 7f2279c04b80 1 -- 172.21.15.146:0/4195621587 shutdown_connections 2023-10-06T11:11:58.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.328+0000 7f2279c04b80 1 --2- 172.21.15.146:0/4195621587 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562226cefc10 0x562226ceeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.328+0000 7f2279c04b80 1 --2- 172.21.15.146:0/4195621587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562226d35ad0 0x562226d35ea0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.328+0000 7f2279c04b80 1 --2- 172.21.15.146:0/4195621587 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562226cf19e0 0x562226cee5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.328+0000 7f2279c04b80 1 -- 172.21.15.146:0/4195621587 >> 172.21.15.146:0/4195621587 conn(0x562226cf00b0 msgr2=0x562226cf0480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:11:58.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.328+0000 7f2279c04b80 1 -- 172.21.15.146:0/4195621587 shutdown_connections 2023-10-06T11:11:58.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.328+0000 7f2279c04b80 1 -- 172.21.15.146:0/4195621587 wait complete. 2023-10-06T11:11:58.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.328+0000 7f2279c04b80 1 -- start start 2023-10-06T11:11:58.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.328+0000 7f2279c04b80 1 Processor -- start 2023-10-06T11:11:58.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.329+0000 7f2279c04b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562226cefc10 0x562226d152f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.329+0000 7f2279c04b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562226cf19e0 0x562226d308c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.329+0000 7f2279c04b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562226d35ad0 0x562226cee5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.329+0000 7f2279c04b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x562226c3f0a0 con 0x562226d35ad0 2023-10-06T11:11:58.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.329+0000 7f2279c04b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562226bea8d0 con 0x562226cefc10 2023-10-06T11:11:58.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.329+0000 7f2279c04b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x562226c05ee0 con 0x562226cf19e0 2023-10-06T11:11:58.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.329+0000 7f2279c04b80 10 client.0 _ll_register_callbacks cb 0x562226adbf70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:11:58.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.329+0000 7f226ad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562226d35ad0 0x562226cee5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.329+0000 7f226ad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562226d35ad0 0x562226cee5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52778/0 (socket says 172.21.15.146:52778) 2023-10-06T11:11:58.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.329+0000 7f226ad9d700 1 -- 172.21.15.146:0/2214378502 learned_addr learned my addr 172.21.15.146:0/2214378502 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:11:58.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.329+0000 7f226a59c700 1 --2- 172.21.15.146:0/2214378502 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562226cefc10 0x562226d152f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.329+0000 7f2269d9b700 1 --2- 172.21.15.146:0/2214378502 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562226cf19e0 0x562226d308c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.330+0000 7f226ad9d700 1 -- 172.21.15.146:0/2214378502 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562226cf19e0 msgr2=0x562226d308c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:11:58.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.330+0000 7f226ad9d700 1 --2- 172.21.15.146:0/2214378502 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562226cf19e0 0x562226d308c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.330+0000 7f226ad9d700 1 -- 172.21.15.146:0/2214378502 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562226cefc10 msgr2=0x562226d152f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:11:58.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.330+0000 7f226ad9d700 1 --2- 172.21.15.146:0/2214378502 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562226cefc10 0x562226d152f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.330+0000 7f226ad9d700 1 -- 172.21.15.146:0/2214378502 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f226c0ad970 con 0x562226d35ad0 2023-10-06T11:11:58.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.330+0000 7f226ad9d700 1 --2- 172.21.15.146:0/2214378502 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562226d35ad0 0x562226cee5c0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f22640839a0 tx=0x7f22640838d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40135979ec6251f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:11:58.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.330+0000 7f2248ff9700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:11:58.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.330+0000 7f2248ff9700 1 -- 172.21.15.146:0/2214378502 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2264056400 con 0x562226d35ad0 2023-10-06T11:11:58.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.330+0000 7f2248ff9700 1 -- 172.21.15.146:0/2214378502 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(75..75 src has 1..75) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f22640595d0 con 0x562226d35ad0 2023-10-06T11:11:58.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.330+0000 7f2279c04b80 1 -- 172.21.15.146:0/2214378502 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562226ce36d0 con 0x562226d35ad0 2023-10-06T11:11:58.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.330+0000 7f2248ff9700 1 -- 172.21.15.146:0/2214378502 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f226405d320 con 0x562226d35ad0 2023-10-06T11:11:58.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.330+0000 7f2279c04b80 10 client.6990 fetch_fsmap learned FSMap version 74 2023-10-06T11:11:58.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.330+0000 7f2279c04b80 1 -- 172.21.15.146:0/2214378502 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x562226a7c020 con 0x562226d35ad0 2023-10-06T11:11:58.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.330+0000 7f2248ff9700 1 -- 172.21.15.146:0/2214378502 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2264061020 con 0x562226d35ad0 2023-10-06T11:11:58.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.330+0000 7f2248ff9700 1 -- 172.21.15.146:0/2214378502 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 74) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f2264068bd0 con 0x562226d35ad0 2023-10-06T11:11:58.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.330+0000 7f2279c04b80 10 client.6990 fetch_fsmap finished waiting for FSMap version 74 2023-10-06T11:11:58.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.330+0000 7f2279c04b80 10 client.6990 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.b 2023-10-06T11:11:58.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.330+0000 7f2279c04b80 20 client.6990 populate_metadata read hostname 'smithi146' 2023-10-06T11:11:58.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.330+0000 7f2279c04b80 1 --2- 172.21.15.146:0/2214378502 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x562226d2ca10 0x562226d1a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.330+0000 7f2279c04b80 4 client.6990 mds_command: new command op to 6786 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:11:58.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.330+0000 7f2279c04b80 1 -- 172.21.15.146:0/2214378502 --> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562226cc0600 con 0x562226d2ca10 2023-10-06T11:11:58.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.331+0000 7f226a59c700 1 --2- 172.21.15.146:0/2214378502 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x562226d2ca10 0x562226d1a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.331+0000 7f2248ff9700 10 client.6990 ms_handle_connect on v2:172.21.15.151:6833/3649668257 2023-10-06T11:11:58.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.331+0000 7f226a59c700 1 --2- 172.21.15.146:0/2214378502 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x562226d2ca10 0x562226d1a5a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76ead6ff0be864ef server_cookie=69615d69c8f3b155 in_seq=0 out_seq=0 2023-10-06T11:11:58.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.331+0000 7f2248ff9700 1 -- 172.21.15.146:0/2214378502 <== mds.0 v2:172.21.15.151:6833/3649668257 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x562226cc0600 con 0x562226d2ca10 2023-10-06T11:11:58.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.331+0000 7f2248ff9700 10 client.6990 handle_command_reply: tid=0 2023-10-06T11:11:58.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.331+0000 7f2279c04b80 1 client.6990 shutdown 2023-10-06T11:11:58.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.331+0000 7f2279c04b80 1 -- 172.21.15.146:0/2214378502 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562226d35ad0 msgr2=0x562226cee5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:11:58.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.332+0000 7f2279c04b80 1 --2- 172.21.15.146:0/2214378502 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562226d35ad0 0x562226cee5c0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f22640839a0 tx=0x7f22640838d0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.332+0000 7f2279c04b80 1 -- 172.21.15.146:0/2214378502 shutdown_connections 2023-10-06T11:11:58.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.332+0000 7f2279c04b80 1 --2- 172.21.15.146:0/2214378502 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562226d35ad0 0x562226cee5c0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.332+0000 7f2279c04b80 1 --2- 172.21.15.146:0/2214378502 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562226cefc10 0x562226d152f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.332+0000 7f2279c04b80 1 --2- 172.21.15.146:0/2214378502 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x562226d2ca10 0x562226d1a5a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.332+0000 7f2279c04b80 1 --2- 172.21.15.146:0/2214378502 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562226cf19e0 0x562226d308c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.332+0000 7f2248ff9700 0 client.6990 ms_handle_reset on v2:172.21.15.151:6833/3649668257 2023-10-06T11:11:58.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.332+0000 7f2279c04b80 1 -- 172.21.15.146:0/2214378502 >> 172.21.15.146:0/2214378502 conn(0x562226cf00b0 msgr2=0x562226ceb830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:11:58.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.332+0000 7f2279c04b80 1 -- 172.21.15.146:0/2214378502 shutdown_connections 2023-10-06T11:11:58.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.332+0000 7f2279c04b80 1 -- 172.21.15.146:0/2214378502 wait complete. 2023-10-06T11:11:58.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.332+0000 7f2279c04b80 20 client.6990 trim_cache size 0 max 16384 2023-10-06T11:11:58.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.347+0000 7f2279c04b80 1 Processor -- start 2023-10-06T11:11:58.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.347+0000 7f2279c04b80 1 -- start start 2023-10-06T11:11:58.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.347+0000 7f2279c04b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562226cf00b0 0x562226d17ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.347+0000 7f2279c04b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562226cefc10 0x562226cf0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.347+0000 7f2279c04b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562226cf19e0 0x562226d342c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.347+0000 7f2279c04b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x562226ac1e70 con 0x562226cf00b0 2023-10-06T11:11:58.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.347+0000 7f2279c04b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562226cede80 con 0x562226cf19e0 2023-10-06T11:11:58.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.347+0000 7f2279c04b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x562226cecb50 con 0x562226cefc10 2023-10-06T11:11:58.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.348+0000 7f226a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562226cf00b0 0x562226d17ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.348+0000 7f226a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562226cf00b0 0x562226d17ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52788/0 (socket says 172.21.15.146:52788) 2023-10-06T11:11:58.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.348+0000 7f226a59c700 1 -- 172.21.15.146:0/4196729345 learned_addr learned my addr 172.21.15.146:0/4196729345 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:11:58.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.348+0000 7f226ad9d700 1 --2- 172.21.15.146:0/4196729345 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562226cf19e0 0x562226d342c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.348+0000 7f226a59c700 1 -- 172.21.15.146:0/4196729345 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562226cefc10 msgr2=0x562226cf0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:11:58.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.348+0000 7f226a59c700 1 --2- 172.21.15.146:0/4196729345 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562226cefc10 0x562226cf0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.348+0000 7f226a59c700 1 -- 172.21.15.146:0/4196729345 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562226cf19e0 msgr2=0x562226d342c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:11:58.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.348+0000 7f226a59c700 1 --2- 172.21.15.146:0/4196729345 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562226cf19e0 0x562226d342c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.348+0000 7f226a59c700 1 -- 172.21.15.146:0/4196729345 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562226c0d7c0 con 0x562226cf00b0 2023-10-06T11:11:58.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.348+0000 7f226a59c700 1 --2- 172.21.15.146:0/4196729345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562226cf00b0 0x562226d17ec0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f225c00b3c0 tx=0x7f225c034040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70a1fd74f387de99 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:11:58.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.348+0000 7f224bfff700 1 -- 172.21.15.146:0/4196729345 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225c01ea40 con 0x562226cf00b0 2023-10-06T11:11:58.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.348+0000 7f224bfff700 1 -- 172.21.15.146:0/4196729345 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225c01eba0 con 0x562226cf00b0 2023-10-06T11:11:58.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.348+0000 7f224bfff700 1 -- 172.21.15.146:0/4196729345 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225c01ed30 con 0x562226cf00b0 2023-10-06T11:11:58.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.349+0000 7f2279c04b80 1 -- 172.21.15.146:0/4196729345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562226cf00b0 msgr2=0x562226d17ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:11:58.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.349+0000 7f2279c04b80 1 --2- 172.21.15.146:0/4196729345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562226cf00b0 0x562226d17ec0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f225c00b3c0 tx=0x7f225c034040 comp rx=0 tx=0).stop 2023-10-06T11:11:58.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.349+0000 7f2279c04b80 1 -- 172.21.15.146:0/4196729345 shutdown_connections 2023-10-06T11:11:58.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.349+0000 7f2279c04b80 1 --2- 172.21.15.146:0/4196729345 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562226cf19e0 0x562226d342c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.349+0000 7f2279c04b80 1 --2- 172.21.15.146:0/4196729345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562226cf00b0 0x562226d17ec0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.349+0000 7f2279c04b80 1 --2- 172.21.15.146:0/4196729345 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562226cefc10 0x562226cf0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.349+0000 7f2279c04b80 1 -- 172.21.15.146:0/4196729345 >> 172.21.15.146:0/4196729345 conn(0x562226d33800 msgr2=0x562226d35ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:11:58.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.349+0000 7f2279c04b80 1 -- 172.21.15.146:0/4196729345 shutdown_connections 2023-10-06T11:11:58.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.349+0000 7f2279c04b80 1 -- 172.21.15.146:0/4196729345 wait complete. 2023-10-06T11:11:58.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.349+0000 7f2279c04b80 1 -- start start 2023-10-06T11:11:58.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.349+0000 7f2279c04b80 1 Processor -- start 2023-10-06T11:11:58.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.350+0000 7f2279c04b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562226cefc10 0x562226d471b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.350+0000 7f2279c04b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562226cf00b0 0x562226d8c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.350+0000 7f2279c04b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562226cf19e0 0x562226d8ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.350+0000 7f2279c04b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x562226cf0d90 con 0x562226cefc10 2023-10-06T11:11:58.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.350+0000 7f2279c04b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562226d1e450 con 0x562226cf00b0 2023-10-06T11:11:58.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.350+0000 7f2279c04b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x562226d17fd0 con 0x562226cf19e0 2023-10-06T11:11:58.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.350+0000 7f2279c04b80 10 client.0 _ll_register_callbacks cb 0x562226adbf70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:11:58.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.350+0000 7f226a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562226cefc10 0x562226d471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.350+0000 7f226a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562226cefc10 0x562226d471b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52794/0 (socket says 172.21.15.146:52794) 2023-10-06T11:11:58.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.350+0000 7f226a59c700 1 -- 172.21.15.146:0/1250731451 learned_addr learned my addr 172.21.15.146:0/1250731451 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:11:58.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.350+0000 7f226ad9d700 1 --2- 172.21.15.146:0/1250731451 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562226cf19e0 0x562226d8ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.350+0000 7f2269d9b700 1 --2- 172.21.15.146:0/1250731451 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562226cf00b0 0x562226d8c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.351+0000 7f226a59c700 1 -- 172.21.15.146:0/1250731451 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562226cf19e0 msgr2=0x562226d8ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:11:58.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.351+0000 7f226a59c700 1 --2- 172.21.15.146:0/1250731451 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562226cf19e0 0x562226d8ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.351+0000 7f226a59c700 1 -- 172.21.15.146:0/1250731451 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562226cf00b0 msgr2=0x562226d8c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:11:58.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.351+0000 7f226a59c700 1 --2- 172.21.15.146:0/1250731451 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562226cf00b0 0x562226d8c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.351+0000 7f226a59c700 1 -- 172.21.15.146:0/1250731451 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562226ad92b0 con 0x562226cefc10 2023-10-06T11:11:58.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.351+0000 7f226a59c700 1 --2- 172.21.15.146:0/1250731451 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562226cefc10 0x562226d471b0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f225c00b400 tx=0x7f225c037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dffe90f103c4f090 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:11:58.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.351+0000 7f2248ff9700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:11:58.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.351+0000 7f2248ff9700 1 -- 172.21.15.146:0/1250731451 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f225c0278a0 con 0x562226cefc10 2023-10-06T11:11:58.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.351+0000 7f2248ff9700 1 -- 172.21.15.146:0/1250731451 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(75..75 src has 1..75) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f225c037070 con 0x562226cefc10 2023-10-06T11:11:58.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.351+0000 7f2279c04b80 1 -- 172.21.15.146:0/1250731451 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f225c01e8d0 con 0x562226cefc10 2023-10-06T11:11:58.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.351+0000 7f2248ff9700 1 -- 172.21.15.146:0/1250731451 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f225c027c10 con 0x562226cefc10 2023-10-06T11:11:58.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.351+0000 7f2279c04b80 10 client.6996 fetch_fsmap learned FSMap version 74 2023-10-06T11:11:58.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.351+0000 7f2279c04b80 1 -- 172.21.15.146:0/1250731451 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x562226bf44b0 con 0x562226cefc10 2023-10-06T11:11:58.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.351+0000 7f2248ff9700 1 -- 172.21.15.146:0/1250731451 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f225c01e8d0 con 0x562226cefc10 2023-10-06T11:11:58.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.351+0000 7f2248ff9700 1 -- 172.21.15.146:0/1250731451 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 74) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f225c048450 con 0x562226cefc10 2023-10-06T11:11:58.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.351+0000 7f2279c04b80 10 client.6996 fetch_fsmap finished waiting for FSMap version 74 2023-10-06T11:11:58.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.351+0000 7f2279c04b80 10 client.6996 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.b 2023-10-06T11:11:58.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.351+0000 7f2279c04b80 20 client.6996 populate_metadata read hostname 'smithi146' 2023-10-06T11:11:58.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.351+0000 7f2279c04b80 1 --2- 172.21.15.146:0/1250731451 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x562226d35ad0 0x562226d186b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.351+0000 7f2279c04b80 4 client.6996 mds_command: new command op to 6786 tid=0[{"prefix": "perf dump"}] 2023-10-06T11:11:58.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.351+0000 7f2279c04b80 1 -- 172.21.15.146:0/1250731451 --> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] -- command(tid 0: {"prefix": "perf dump"}) v1 -- 0x562226be1e40 con 0x562226d35ad0 2023-10-06T11:11:58.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.351+0000 7f2269d9b700 1 --2- 172.21.15.146:0/1250731451 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x562226d35ad0 0x562226d186b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.352+0000 7f2248ff9700 10 client.6996 ms_handle_connect on v2:172.21.15.151:6833/3649668257 2023-10-06T11:11:58.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.352+0000 7f2269d9b700 1 --2- 172.21.15.146:0/1250731451 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x562226d35ad0 0x562226d186b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33c3e634356e2113 server_cookie=d620fe17c7932712 in_seq=0 out_seq=0 2023-10-06T11:11:58.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.352+0000 7f2248ff9700 1 -- 172.21.15.146:0/1250731451 <== mds.0 v2:172.21.15.151:6833/3649668257 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17054 (crc 0 0 0) 0x562226be1e40 con 0x562226d35ad0 2023-10-06T11:11:58.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.352+0000 7f2248ff9700 10 client.6996 handle_command_reply: tid=0 2023-10-06T11:11:58.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.352+0000 7f2279c04b80 1 client.6996 shutdown 2023-10-06T11:11:58.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.352+0000 7f2279c04b80 1 -- 172.21.15.146:0/1250731451 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562226cefc10 msgr2=0x562226d471b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:11:58.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.352+0000 7f2279c04b80 1 --2- 172.21.15.146:0/1250731451 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562226cefc10 0x562226d471b0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f225c00b400 tx=0x7f225c037000 comp rx=0 tx=0).stop 2023-10-06T11:11:58.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.352+0000 7f2279c04b80 1 -- 172.21.15.146:0/1250731451 shutdown_connections 2023-10-06T11:11:58.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.352+0000 7f2279c04b80 1 --2- 172.21.15.146:0/1250731451 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x562226d35ad0 0x562226d186b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.352+0000 7f2279c04b80 1 --2- 172.21.15.146:0/1250731451 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562226cf19e0 0x562226d8ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.352+0000 7f2248ff9700 0 client.6996 ms_handle_reset on v2:172.21.15.151:6833/3649668257 2023-10-06T11:11:58.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.352+0000 7f2279c04b80 1 --2- 172.21.15.146:0/1250731451 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562226cefc10 0x562226d471b0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.352+0000 7f2279c04b80 1 --2- 172.21.15.146:0/1250731451 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562226cf00b0 0x562226d8c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.352+0000 7f2279c04b80 1 -- 172.21.15.146:0/1250731451 >> 172.21.15.146:0/1250731451 conn(0x562226d33800 msgr2=0x562226d14070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:11:58.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.352+0000 7f2279c04b80 1 -- 172.21.15.146:0/1250731451 shutdown_connections 2023-10-06T11:11:58.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.353+0000 7f2279c04b80 1 -- 172.21.15.146:0/1250731451 wait complete. 2023-10-06T11:11:58.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.353+0000 7f2279c04b80 20 client.6996 trim_cache size 0 max 16384 2023-10-06T11:11:58.362 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:11:58.362 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-0": { 2023-10-06T11:11:58.362 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 4318, 2023-10-06T11:11:58.362 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 4318, 2023-10-06T11:11:58.362 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 1398589, 2023-10-06T11:11:58.362 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 21888704, 2023-10-06T11:11:58.363 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 9, 2023-10-06T11:11:58.363 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 3, 2023-10-06T11:11:58.363 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 0.259747948, 2023-10-06T11:11:58.363 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 0.113681996, 2023-10-06T11:11:58.363 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 0.045936002, 2023-10-06T11:11:58.363 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.086688050, 2023-10-06T11:11:58.363 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T11:11:58.363 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 4317, 2023-10-06T11:11:58.363 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 3.090327636, 2023-10-06T11:11:58.363 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000715850 2023-10-06T11:11:58.363 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.363 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2023-10-06T11:11:58.364 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 2, 2023-10-06T11:11:58.364 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000162, 2023-10-06T11:11:58.364 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000081 2023-10-06T11:11:58.364 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:11:58.364 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.364 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-1": { 2023-10-06T11:11:58.364 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 35189, 2023-10-06T11:11:58.364 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 61127, 2023-10-06T11:11:58.364 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 11975744, 2023-10-06T11:11:58.364 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 48742507, 2023-10-06T11:11:58.364 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 8, 2023-10-06T11:11:58.364 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 4, 2023-10-06T11:11:58.365 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 2.550030200, 2023-10-06T11:11:58.365 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 1.145260189, 2023-10-06T11:11:58.365 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 1.461105122, 2023-10-06T11:11:58.365 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.141280234, 2023-10-06T11:11:58.365 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T11:11:58.365 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 61126, 2023-10-06T11:11:58.365 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 2.115197814, 2023-10-06T11:11:58.365 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000034603 2023-10-06T11:11:58.365 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.365 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2023-10-06T11:11:58.365 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 88321, 2023-10-06T11:11:58.365 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.011709295, 2023-10-06T11:11:58.366 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000132 2023-10-06T11:11:58.366 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:11:58.366 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.366 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-2": { 2023-10-06T11:11:58.366 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 5457, 2023-10-06T11:11:58.366 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 5443, 2023-10-06T11:11:58.366 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 1588043, 2023-10-06T11:11:58.366 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 43898724, 2023-10-06T11:11:58.366 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 5, 2023-10-06T11:11:58.366 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 4, 2023-10-06T11:11:58.366 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 0.348571895, 2023-10-06T11:11:58.367 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 0.142821999, 2023-10-06T11:11:58.367 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 0.077060999, 2023-10-06T11:11:58.367 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.112263010, 2023-10-06T11:11:58.367 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T11:11:58.367 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 5442, 2023-10-06T11:11:58.367 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 2.314705552, 2023-10-06T11:11:58.367 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000425340 2023-10-06T11:11:58.367 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.367 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2023-10-06T11:11:58.367 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:11:58.367 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:11:58.367 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:11:58.368 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:11:58.368 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.368 INFO:teuthology.orchestra.run.smithi146.stdout: "cct": { 2023-10-06T11:11:58.368 INFO:teuthology.orchestra.run.smithi146.stdout: "total_workers": 1, 2023-10-06T11:11:58.368 INFO:teuthology.orchestra.run.smithi146.stdout: "unhealthy_workers": 0 2023-10-06T11:11:58.368 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.368 INFO:teuthology.orchestra.run.smithi146.stdout: "finisher-MDSRank": { 2023-10-06T11:11:58.368 INFO:teuthology.orchestra.run.smithi146.stdout: "queue_len": 0, 2023-10-06T11:11:58.368 INFO:teuthology.orchestra.run.smithi146.stdout: "complete_latency": { 2023-10-06T11:11:58.368 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 8979, 2023-10-06T11:11:58.368 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 15.148458831, 2023-10-06T11:11:58.368 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.001687098 2023-10-06T11:11:58.369 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:11:58.369 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.369 INFO:teuthology.orchestra.run.smithi146.stdout: "finisher-PurgeQueue": { 2023-10-06T11:11:58.369 INFO:teuthology.orchestra.run.smithi146.stdout: "queue_len": 0, 2023-10-06T11:11:58.369 INFO:teuthology.orchestra.run.smithi146.stdout: "complete_latency": { 2023-10-06T11:11:58.369 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 2000, 2023-10-06T11:11:58.369 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.557508762, 2023-10-06T11:11:58.369 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000278754 2023-10-06T11:11:58.369 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:11:58.369 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.369 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": { 2023-10-06T11:11:58.369 INFO:teuthology.orchestra.run.smithi146.stdout: "request": 30607, 2023-10-06T11:11:58.370 INFO:teuthology.orchestra.run.smithi146.stdout: "reply": 30607, 2023-10-06T11:11:58.370 INFO:teuthology.orchestra.run.smithi146.stdout: "reply_latency": { 2023-10-06T11:11:58.370 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 30607, 2023-10-06T11:11:58.370 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 493.182685634, 2023-10-06T11:11:58.370 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.016113395 2023-10-06T11:11:58.370 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.370 INFO:teuthology.orchestra.run.smithi146.stdout: "slow_reply": 0, 2023-10-06T11:11:58.370 INFO:teuthology.orchestra.run.smithi146.stdout: "forward": 0, 2023-10-06T11:11:58.370 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_fetch": 0, 2023-10-06T11:11:58.370 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_commit": 44, 2023-10-06T11:11:58.370 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_split": 0, 2023-10-06T11:11:58.370 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_merge": 0, 2023-10-06T11:11:58.371 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes": 10011, 2023-10-06T11:11:58.371 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_top": 5859, 2023-10-06T11:11:58.371 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_bottom": 4152, 2023-10-06T11:11:58.371 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_pin_tail": 0, 2023-10-06T11:11:58.371 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_pinned": 1641, 2023-10-06T11:11:58.371 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_expired": 7150, 2023-10-06T11:11:58.371 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_with_caps": 304, 2023-10-06T11:11:58.371 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": 304, 2023-10-06T11:11:58.371 INFO:teuthology.orchestra.run.smithi146.stdout: "subtrees": 2, 2023-10-06T11:11:58.371 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse": 58180, 2023-10-06T11:11:58.371 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_hit": 56079, 2023-10-06T11:11:58.371 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_forward": 0, 2023-10-06T11:11:58.372 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_discover": 0, 2023-10-06T11:11:58.372 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_dir_fetch": 0, 2023-10-06T11:11:58.372 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_remote_ino": 0, 2023-10-06T11:11:58.372 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_lock": 1995, 2023-10-06T11:11:58.372 INFO:teuthology.orchestra.run.smithi146.stdout: "load_cent": 572626, 2023-10-06T11:11:58.372 INFO:teuthology.orchestra.run.smithi146.stdout: "q": 0, 2023-10-06T11:11:58.372 INFO:teuthology.orchestra.run.smithi146.stdout: "exported": 0, 2023-10-06T11:11:58.372 INFO:teuthology.orchestra.run.smithi146.stdout: "exported_inodes": 0, 2023-10-06T11:11:58.372 INFO:teuthology.orchestra.run.smithi146.stdout: "imported": 0, 2023-10-06T11:11:58.372 INFO:teuthology.orchestra.run.smithi146.stdout: "imported_inodes": 0, 2023-10-06T11:11:58.372 INFO:teuthology.orchestra.run.smithi146.stdout: "openino_dir_fetch": 0, 2023-10-06T11:11:58.372 INFO:teuthology.orchestra.run.smithi146.stdout: "openino_backtrace_fetch": 0, 2023-10-06T11:11:58.373 INFO:teuthology.orchestra.run.smithi146.stdout: "openino_peer_discover": 0, 2023-10-06T11:11:58.373 INFO:teuthology.orchestra.run.smithi146.stdout: "root_rfiles": 0, 2023-10-06T11:11:58.373 INFO:teuthology.orchestra.run.smithi146.stdout: "root_rbytes": 0, 2023-10-06T11:11:58.373 INFO:teuthology.orchestra.run.smithi146.stdout: "root_rsnaps": 0, 2023-10-06T11:11:58.373 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_backtrace_fetch": 0, 2023-10-06T11:11:58.373 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_set_tag": 0, 2023-10-06T11:11:58.373 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_backtrace_repaired": 0, 2023-10-06T11:11:58.373 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_inotable_repaired": 0, 2023-10-06T11:11:58.373 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_dir_inodes": 0, 2023-10-06T11:11:58.373 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_dir_base_inodes": 0, 2023-10-06T11:11:58.373 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_dirfrag_rstats": 0, 2023-10-06T11:11:58.373 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_file_inodes": 0, 2023-10-06T11:11:58.374 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_inode_file_caps": 0, 2023-10-06T11:11:58.374 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_revoke": 6140, 2023-10-06T11:11:58.374 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_grant": 6011, 2023-10-06T11:11:58.374 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_trunc": 0, 2023-10-06T11:11:58.374 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-06T11:11:58.374 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-06T11:11:58.374 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_caps": 6139, 2023-10-06T11:11:58.374 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_caps_dirty": 2000, 2023-10-06T11:11:58.374 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_cap_release": 27, 2023-10-06T11:11:58.374 INFO:teuthology.orchestra.run.smithi146.stdout: "process_request_cap_release": 17828 2023-10-06T11:11:58.374 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.375 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_cache": { 2023-10-06T11:11:58.375 INFO:teuthology.orchestra.run.smithi146.stdout: "num_strays": 2000, 2023-10-06T11:11:58.375 INFO:teuthology.orchestra.run.smithi146.stdout: "num_strays_delayed": 223, 2023-10-06T11:11:58.375 INFO:teuthology.orchestra.run.smithi146.stdout: "num_strays_enqueuing": 0, 2023-10-06T11:11:58.375 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_created": 4255, 2023-10-06T11:11:58.375 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_enqueued": 1475, 2023-10-06T11:11:58.375 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_reintegrated": 4577, 2023-10-06T11:11:58.375 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_migrated": 0, 2023-10-06T11:11:58.375 INFO:teuthology.orchestra.run.smithi146.stdout: "num_recovering_processing": 0, 2023-10-06T11:11:58.375 INFO:teuthology.orchestra.run.smithi146.stdout: "num_recovering_enqueued": 0, 2023-10-06T11:11:58.375 INFO:teuthology.orchestra.run.smithi146.stdout: "num_recovering_prioritized": 0, 2023-10-06T11:11:58.376 INFO:teuthology.orchestra.run.smithi146.stdout: "recovery_started": 0, 2023-10-06T11:11:58.376 INFO:teuthology.orchestra.run.smithi146.stdout: "recovery_completed": 0, 2023-10-06T11:11:58.376 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_enqueue_scrub": 0, 2023-10-06T11:11:58.376 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_exportdir": 0, 2023-10-06T11:11:58.376 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_flush": 0, 2023-10-06T11:11:58.376 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_fragmentdir": 0, 2023-10-06T11:11:58.376 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_fragstats": 0, 2023-10-06T11:11:58.376 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_inodestats": 0 2023-10-06T11:11:58.376 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.376 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_log": { 2023-10-06T11:11:58.376 INFO:teuthology.orchestra.run.smithi146.stdout: "evadd": 21794, 2023-10-06T11:11:58.376 INFO:teuthology.orchestra.run.smithi146.stdout: "evex": 18695, 2023-10-06T11:11:58.377 INFO:teuthology.orchestra.run.smithi146.stdout: "evtrm": 17638, 2023-10-06T11:11:58.377 INFO:teuthology.orchestra.run.smithi146.stdout: "ev": 4156, 2023-10-06T11:11:58.377 INFO:teuthology.orchestra.run.smithi146.stdout: "evexg": 0, 2023-10-06T11:11:58.377 INFO:teuthology.orchestra.run.smithi146.stdout: "evexd": 1057, 2023-10-06T11:11:58.377 INFO:teuthology.orchestra.run.smithi146.stdout: "segadd": 26, 2023-10-06T11:11:58.377 INFO:teuthology.orchestra.run.smithi146.stdout: "segex": 22, 2023-10-06T11:11:58.377 INFO:teuthology.orchestra.run.smithi146.stdout: "segtrm": 20, 2023-10-06T11:11:58.377 INFO:teuthology.orchestra.run.smithi146.stdout: "seg": 6, 2023-10-06T11:11:58.377 INFO:teuthology.orchestra.run.smithi146.stdout: "segexg": 0, 2023-10-06T11:11:58.377 INFO:teuthology.orchestra.run.smithi146.stdout: "segexd": 2, 2023-10-06T11:11:58.377 INFO:teuthology.orchestra.run.smithi146.stdout: "expos": 62919509, 2023-10-06T11:11:58.377 INFO:teuthology.orchestra.run.smithi146.stdout: "wrpos": 78351680, 2023-10-06T11:11:58.377 INFO:teuthology.orchestra.run.smithi146.stdout: "rdpos": 0, 2023-10-06T11:11:58.378 INFO:teuthology.orchestra.run.smithi146.stdout: "jlat": { 2023-10-06T11:11:58.378 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 6582, 2023-10-06T11:11:58.378 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 87.364600966, 2023-10-06T11:11:58.378 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.013273260 2023-10-06T11:11:58.378 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.378 INFO:teuthology.orchestra.run.smithi146.stdout: "replayed": 0 2023-10-06T11:11:58.378 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.378 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_mem": { 2023-10-06T11:11:58.378 INFO:teuthology.orchestra.run.smithi146.stdout: "ino": 2014, 2023-10-06T11:11:58.378 INFO:teuthology.orchestra.run.smithi146.stdout: "ino+": 2014, 2023-10-06T11:11:58.379 INFO:teuthology.orchestra.run.smithi146.stdout: "ino-": 0, 2023-10-06T11:11:58.379 INFO:teuthology.orchestra.run.smithi146.stdout: "dir": 13, 2023-10-06T11:11:58.379 INFO:teuthology.orchestra.run.smithi146.stdout: "dir+": 13, 2023-10-06T11:11:58.379 INFO:teuthology.orchestra.run.smithi146.stdout: "dir-": 0, 2023-10-06T11:11:58.379 INFO:teuthology.orchestra.run.smithi146.stdout: "dn": 11047, 2023-10-06T11:11:58.379 INFO:teuthology.orchestra.run.smithi146.stdout: "dn+": 20013, 2023-10-06T11:11:58.379 INFO:teuthology.orchestra.run.smithi146.stdout: "dn-": 8966, 2023-10-06T11:11:58.379 INFO:teuthology.orchestra.run.smithi146.stdout: "cap": 304, 2023-10-06T11:11:58.379 INFO:teuthology.orchestra.run.smithi146.stdout: "cap+": 2002, 2023-10-06T11:11:58.379 INFO:teuthology.orchestra.run.smithi146.stdout: "cap-": 1698, 2023-10-06T11:11:58.379 INFO:teuthology.orchestra.run.smithi146.stdout: "rss": 96620, 2023-10-06T11:11:58.379 INFO:teuthology.orchestra.run.smithi146.stdout: "heap": 207104 2023-10-06T11:11:58.380 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.380 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_server": { 2023-10-06T11:11:58.380 INFO:teuthology.orchestra.run.smithi146.stdout: "dispatch_client_request": 43775, 2023-10-06T11:11:58.380 INFO:teuthology.orchestra.run.smithi146.stdout: "dispatch_server_request": 0, 2023-10-06T11:11:58.380 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_request": 30607, 2023-10-06T11:11:58.380 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_session": 6, 2023-10-06T11:11:58.380 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_peer_request": 0, 2023-10-06T11:11:58.380 INFO:teuthology.orchestra.run.smithi146.stdout: "req_create_latency": { 2023-10-06T11:11:58.380 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 2000, 2023-10-06T11:11:58.380 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 1.433329103, 2023-10-06T11:11:58.380 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000716664 2023-10-06T11:11:58.380 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.381 INFO:teuthology.orchestra.run.smithi146.stdout: "req_getattr_latency": { 2023-10-06T11:11:58.381 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 2005, 2023-10-06T11:11:58.381 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.707210869, 2023-10-06T11:11:58.381 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000352723 2023-10-06T11:11:58.381 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.381 INFO:teuthology.orchestra.run.smithi146.stdout: "req_getfilelock_latency": { 2023-10-06T11:11:58.381 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:11:58.381 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:11:58.381 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:11:58.381 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.381 INFO:teuthology.orchestra.run.smithi146.stdout: "req_link_latency": { 2023-10-06T11:11:58.381 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 6000, 2023-10-06T11:11:58.382 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 10.710688550, 2023-10-06T11:11:58.382 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.001785114 2023-10-06T11:11:58.382 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.382 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookup_latency": { 2023-10-06T11:11:58.382 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 8012, 2023-10-06T11:11:58.382 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 3.683452226, 2023-10-06T11:11:58.382 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000459741 2023-10-06T11:11:58.382 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.382 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookuphash_latency": { 2023-10-06T11:11:58.382 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:11:58.382 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:11:58.382 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:11:58.383 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.383 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupino_latency": { 2023-10-06T11:11:58.383 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:11:58.383 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:11:58.383 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:11:58.383 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.383 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupname_latency": { 2023-10-06T11:11:58.383 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:11:58.383 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:11:58.383 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:11:58.383 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.385 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupparent_latency": { 2023-10-06T11:11:58.385 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:11:58.385 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:11:58.385 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:11:58.385 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.385 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupsnap_latency": { 2023-10-06T11:11:58.385 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 3, 2023-10-06T11:11:58.385 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.006044575, 2023-10-06T11:11:58.386 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.002014858 2023-10-06T11:11:58.386 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.386 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lssnap_latency": { 2023-10-06T11:11:58.386 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:11:58.386 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:11:58.386 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:11:58.386 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.386 INFO:teuthology.orchestra.run.smithi146.stdout: "req_mkdir_latency": { 2023-10-06T11:11:58.386 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1, 2023-10-06T11:11:58.386 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.003083825, 2023-10-06T11:11:58.386 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.003083825 2023-10-06T11:11:58.387 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.387 INFO:teuthology.orchestra.run.smithi146.stdout: "req_mknod_latency": { 2023-10-06T11:11:58.387 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:11:58.387 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:11:58.387 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:11:58.387 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.387 INFO:teuthology.orchestra.run.smithi146.stdout: "req_mksnap_latency": { 2023-10-06T11:11:58.387 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1, 2023-10-06T11:11:58.387 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.004839247, 2023-10-06T11:11:58.387 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.004839247 2023-10-06T11:11:58.387 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.387 INFO:teuthology.orchestra.run.smithi146.stdout: "req_open_latency": { 2023-10-06T11:11:58.388 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:11:58.388 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:11:58.388 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:11:58.388 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.388 INFO:teuthology.orchestra.run.smithi146.stdout: "req_readdir_latency": { 2023-10-06T11:11:58.388 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 6, 2023-10-06T11:11:58.388 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.097046138, 2023-10-06T11:11:58.388 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.016174356 2023-10-06T11:11:58.388 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.388 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rename_latency": { 2023-10-06T11:11:58.388 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 4577, 2023-10-06T11:11:58.388 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 454.633936611, 2023-10-06T11:11:58.389 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.099330115 2023-10-06T11:11:58.389 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.389 INFO:teuthology.orchestra.run.smithi146.stdout: "req_renamesnap_latency": { 2023-10-06T11:11:58.389 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:11:58.389 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:11:58.389 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:11:58.389 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.389 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rmdir_latency": { 2023-10-06T11:11:58.389 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:11:58.389 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:11:58.389 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:11:58.389 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.389 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rmsnap_latency": { 2023-10-06T11:11:58.390 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1, 2023-10-06T11:11:58.390 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.004876004, 2023-10-06T11:11:58.390 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.004876004 2023-10-06T11:11:58.390 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.390 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rmxattr_latency": { 2023-10-06T11:11:58.390 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:11:58.390 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:11:58.390 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:11:58.390 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.390 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setattr_latency": { 2023-10-06T11:11:58.390 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1, 2023-10-06T11:11:58.391 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000295216, 2023-10-06T11:11:58.391 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000295216 2023-10-06T11:11:58.391 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.391 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setdirlayout_latency": { 2023-10-06T11:11:58.391 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:11:58.391 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:11:58.391 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:11:58.391 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.391 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setfilelock_latency": { 2023-10-06T11:11:58.391 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:11:58.391 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:11:58.391 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:11:58.392 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.392 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setlayout_latency": { 2023-10-06T11:11:58.392 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:11:58.392 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:11:58.392 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:11:58.392 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.392 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setxattr_latency": { 2023-10-06T11:11:58.392 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:11:58.392 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:11:58.392 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:11:58.392 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.392 INFO:teuthology.orchestra.run.smithi146.stdout: "req_symlink_latency": { 2023-10-06T11:11:58.393 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:11:58.393 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:11:58.393 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:11:58.393 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.393 INFO:teuthology.orchestra.run.smithi146.stdout: "req_unlink_latency": { 2023-10-06T11:11:58.393 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 8000, 2023-10-06T11:11:58.393 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 21.897883270, 2023-10-06T11:11:58.393 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.002737235 2023-10-06T11:11:58.393 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.393 INFO:teuthology.orchestra.run.smithi146.stdout: "cap_revoke_eviction": 0, 2023-10-06T11:11:58.393 INFO:teuthology.orchestra.run.smithi146.stdout: "cap_acquisition_throttle": 0, 2023-10-06T11:11:58.393 INFO:teuthology.orchestra.run.smithi146.stdout: "req_getvxattr_latency": { 2023-10-06T11:11:58.394 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:11:58.394 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:11:58.394 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:11:58.394 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:11:58.394 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.394 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_sessions": { 2023-10-06T11:11:58.394 INFO:teuthology.orchestra.run.smithi146.stdout: "session_count": 1, 2023-10-06T11:11:58.394 INFO:teuthology.orchestra.run.smithi146.stdout: "session_add": 1, 2023-10-06T11:11:58.394 INFO:teuthology.orchestra.run.smithi146.stdout: "session_remove": 0, 2023-10-06T11:11:58.394 INFO:teuthology.orchestra.run.smithi146.stdout: "sessions_open": 1, 2023-10-06T11:11:58.394 INFO:teuthology.orchestra.run.smithi146.stdout: "sessions_stale": 0, 2023-10-06T11:11:58.394 INFO:teuthology.orchestra.run.smithi146.stdout: "total_load": 18757, 2023-10-06T11:11:58.395 INFO:teuthology.orchestra.run.smithi146.stdout: "average_load": 18757, 2023-10-06T11:11:58.395 INFO:teuthology.orchestra.run.smithi146.stdout: "avg_session_uptime": 67 2023-10-06T11:11:58.395 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.395 INFO:teuthology.orchestra.run.smithi146.stdout: "mempool": { 2023-10-06T11:11:58.395 INFO:teuthology.orchestra.run.smithi146.stdout: "bloom_filter_bytes": 19081, 2023-10-06T11:11:58.395 INFO:teuthology.orchestra.run.smithi146.stdout: "bloom_filter_items": 19081, 2023-10-06T11:11:58.395 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_alloc_bytes": 0, 2023-10-06T11:11:58.395 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_alloc_items": 0, 2023-10-06T11:11:58.395 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_data_bytes": 0, 2023-10-06T11:11:58.395 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_data_items": 0, 2023-10-06T11:11:58.395 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-06T11:11:58.396 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_onode_items": 0, 2023-10-06T11:11:58.396 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-06T11:11:58.396 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_meta_items": 0, 2023-10-06T11:11:58.396 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_other_bytes": 0, 2023-10-06T11:11:58.396 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_other_items": 0, 2023-10-06T11:11:58.396 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_Buffer_bytes": 0, 2023-10-06T11:11:58.396 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_Buffer_items": 0, 2023-10-06T11:11:58.396 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_Extent_bytes": 0, 2023-10-06T11:11:58.396 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_Extent_items": 0, 2023-10-06T11:11:58.396 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_Blob_bytes": 0, 2023-10-06T11:11:58.396 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_Blob_items": 0, 2023-10-06T11:11:58.396 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_SharedBlob_bytes": 0, 2023-10-06T11:11:58.396 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_SharedBlob_items": 0, 2023-10-06T11:11:58.397 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-06T11:11:58.397 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_inline_bl_items": 0, 2023-10-06T11:11:58.397 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_fsck_bytes": 0, 2023-10-06T11:11:58.397 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_fsck_items": 0, 2023-10-06T11:11:58.397 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_txc_bytes": 0, 2023-10-06T11:11:58.397 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_txc_items": 0, 2023-10-06T11:11:58.397 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-06T11:11:58.397 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_deferred_items": 0, 2023-10-06T11:11:58.397 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_bytes": 0, 2023-10-06T11:11:58.397 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_items": 0, 2023-10-06T11:11:58.397 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_bytes": 0, 2023-10-06T11:11:58.398 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_items": 0, 2023-10-06T11:11:58.398 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_reader_bytes": 0, 2023-10-06T11:11:58.398 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_reader_items": 0, 2023-10-06T11:11:58.398 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_writer_bytes": 0, 2023-10-06T11:11:58.398 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_writer_items": 0, 2023-10-06T11:11:58.398 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_anon_bytes": 8280886, 2023-10-06T11:11:58.398 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_anon_items": 2229, 2023-10-06T11:11:58.398 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_meta_bytes": 0, 2023-10-06T11:11:58.398 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_meta_items": 0, 2023-10-06T11:11:58.398 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_bytes": 0, 2023-10-06T11:11:58.398 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_items": 0, 2023-10-06T11:11:58.399 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_mapbl_bytes": 0, 2023-10-06T11:11:58.399 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_mapbl_items": 0, 2023-10-06T11:11:58.399 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_pglog_bytes": 0, 2023-10-06T11:11:58.399 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_pglog_items": 0, 2023-10-06T11:11:58.399 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_bytes": 6104, 2023-10-06T11:11:58.399 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_items": 78, 2023-10-06T11:11:58.399 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_mapping_bytes": 0, 2023-10-06T11:11:58.399 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_mapping_items": 0, 2023-10-06T11:11:58.399 INFO:teuthology.orchestra.run.smithi146.stdout: "pgmap_bytes": 0, 2023-10-06T11:11:58.399 INFO:teuthology.orchestra.run.smithi146.stdout: "pgmap_items": 0, 2023-10-06T11:11:58.399 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_co_bytes": 14983448, 2023-10-06T11:11:58.400 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_co_items": 554586, 2023-10-06T11:11:58.400 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_1_bytes": 0, 2023-10-06T11:11:58.400 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_1_items": 0, 2023-10-06T11:11:58.400 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_2_bytes": 0, 2023-10-06T11:11:58.400 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_2_items": 0 2023-10-06T11:11:58.400 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.400 INFO:teuthology.orchestra.run.smithi146.stdout: "objecter": { 2023-10-06T11:11:58.400 INFO:teuthology.orchestra.run.smithi146.stdout: "op_active": 0, 2023-10-06T11:11:58.400 INFO:teuthology.orchestra.run.smithi146.stdout: "op_laggy": 0, 2023-10-06T11:11:58.400 INFO:teuthology.orchestra.run.smithi146.stdout: "op_send": 12598, 2023-10-06T11:11:58.400 INFO:teuthology.orchestra.run.smithi146.stdout: "op_send_bytes": 83545204, 2023-10-06T11:11:58.400 INFO:teuthology.orchestra.run.smithi146.stdout: "op_resend": 37, 2023-10-06T11:11:58.401 INFO:teuthology.orchestra.run.smithi146.stdout: "op_reply": 12598, 2023-10-06T11:11:58.401 INFO:teuthology.orchestra.run.smithi146.stdout: "oplen_avg": { 2023-10-06T11:11:58.401 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 12598, 2023-10-06T11:11:58.401 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 21188 2023-10-06T11:11:58.401 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.401 INFO:teuthology.orchestra.run.smithi146.stdout: "op": 12598, 2023-10-06T11:11:58.401 INFO:teuthology.orchestra.run.smithi146.stdout: "op_r": 63, 2023-10-06T11:11:58.401 INFO:teuthology.orchestra.run.smithi146.stdout: "op_w": 12535, 2023-10-06T11:11:58.401 INFO:teuthology.orchestra.run.smithi146.stdout: "op_rmw": 0, 2023-10-06T11:11:58.401 INFO:teuthology.orchestra.run.smithi146.stdout: "op_pg": 0, 2023-10-06T11:11:58.401 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_stat": 31, 2023-10-06T11:11:58.401 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_create": 4244, 2023-10-06T11:11:58.402 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_read": 63, 2023-10-06T11:11:58.402 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_write": 6645, 2023-10-06T11:11:58.402 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_writefull": 55, 2023-10-06T11:11:58.402 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_writesame": 0, 2023-10-06T11:11:58.402 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_append": 0, 2023-10-06T11:11:58.402 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_zero": 1475, 2023-10-06T11:11:58.402 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_truncate": 0, 2023-10-06T11:11:58.402 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_delete": 43, 2023-10-06T11:11:58.402 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_mapext": 0, 2023-10-06T11:11:58.402 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_sparse_read": 0, 2023-10-06T11:11:58.402 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_clonerange": 0, 2023-10-06T11:11:58.402 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_getxattr": 0, 2023-10-06T11:11:58.403 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_setxattr": 8488, 2023-10-06T11:11:58.403 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_cmpxattr": 0, 2023-10-06T11:11:58.403 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_rmxattr": 0, 2023-10-06T11:11:58.403 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_resetxattrs": 0, 2023-10-06T11:11:58.403 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_call": 0, 2023-10-06T11:11:58.403 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_watch": 0, 2023-10-06T11:11:58.403 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_notify": 0, 2023-10-06T11:11:58.403 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_src_cmpxattr": 0, 2023-10-06T11:11:58.403 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_pgls": 0, 2023-10-06T11:11:58.403 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_pgls_filter": 0, 2023-10-06T11:11:58.403 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_other": 0, 2023-10-06T11:11:58.403 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_active": 0, 2023-10-06T11:11:58.404 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_send": 0, 2023-10-06T11:11:58.404 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_resend": 0, 2023-10-06T11:11:58.404 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_ping": 0, 2023-10-06T11:11:58.404 INFO:teuthology.orchestra.run.smithi146.stdout: "poolop_active": 0, 2023-10-06T11:11:58.404 INFO:teuthology.orchestra.run.smithi146.stdout: "poolop_send": 0, 2023-10-06T11:11:58.404 INFO:teuthology.orchestra.run.smithi146.stdout: "poolop_resend": 0, 2023-10-06T11:11:58.404 INFO:teuthology.orchestra.run.smithi146.stdout: "poolstat_active": 0, 2023-10-06T11:11:58.404 INFO:teuthology.orchestra.run.smithi146.stdout: "poolstat_send": 0, 2023-10-06T11:11:58.404 INFO:teuthology.orchestra.run.smithi146.stdout: "poolstat_resend": 0, 2023-10-06T11:11:58.404 INFO:teuthology.orchestra.run.smithi146.stdout: "statfs_active": 0, 2023-10-06T11:11:58.404 INFO:teuthology.orchestra.run.smithi146.stdout: "statfs_send": 0, 2023-10-06T11:11:58.404 INFO:teuthology.orchestra.run.smithi146.stdout: "statfs_resend": 0, 2023-10-06T11:11:58.405 INFO:teuthology.orchestra.run.smithi146.stdout: "command_active": 0, 2023-10-06T11:11:58.405 INFO:teuthology.orchestra.run.smithi146.stdout: "command_send": 0, 2023-10-06T11:11:58.405 INFO:teuthology.orchestra.run.smithi146.stdout: "command_resend": 0, 2023-10-06T11:11:58.405 INFO:teuthology.orchestra.run.smithi146.stdout: "map_epoch": 75, 2023-10-06T11:11:58.405 INFO:teuthology.orchestra.run.smithi146.stdout: "map_full": 0, 2023-10-06T11:11:58.405 INFO:teuthology.orchestra.run.smithi146.stdout: "map_inc": 1, 2023-10-06T11:11:58.405 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_sessions": 8, 2023-10-06T11:11:58.405 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_session_open": 8, 2023-10-06T11:11:58.405 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_session_close": 0, 2023-10-06T11:11:58.405 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_laggy": 0, 2023-10-06T11:11:58.405 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_wr": 120, 2023-10-06T11:11:58.405 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_rd": 0, 2023-10-06T11:11:58.406 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_del": 24 2023-10-06T11:11:58.406 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.406 INFO:teuthology.orchestra.run.smithi146.stdout: "oft": { 2023-10-06T11:11:58.406 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_objs": 1, 2023-10-06T11:11:58.406 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_kv_pairs": 0, 2023-10-06T11:11:58.406 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_updates": 0, 2023-10-06T11:11:58.406 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_removes": 0 2023-10-06T11:11:58.406 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.406 INFO:teuthology.orchestra.run.smithi146.stdout: "purge_queue": { 2023-10-06T11:11:58.406 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing_ops": 0, 2023-10-06T11:11:58.406 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing_ops_high_water": 32, 2023-10-06T11:11:58.406 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing": 0, 2023-10-06T11:11:58.406 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing_high_water": 32, 2023-10-06T11:11:58.407 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executed": 1475, 2023-10-06T11:11:58.407 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_item_in_journal": 0 2023-10-06T11:11:58.407 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.407 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-06T11:11:58.407 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2023-10-06T11:11:58.407 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 104857600, 2023-10-06T11:11:58.407 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2023-10-06T11:11:58.407 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 44959, 2023-10-06T11:11:58.407 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 10910484, 2023-10-06T11:11:58.407 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2023-10-06T11:11:58.407 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 44959, 2023-10-06T11:11:58.407 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2023-10-06T11:11:58.407 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2023-10-06T11:11:58.408 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 44959, 2023-10-06T11:11:58.408 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 10910484, 2023-10-06T11:11:58.408 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2023-10-06T11:11:58.408 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:11:58.408 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:11:58.408 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:11:58.408 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:11:58.408 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.408 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-objecter_bytes": { 2023-10-06T11:11:58.408 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2023-10-06T11:11:58.408 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 104857600, 2023-10-06T11:11:58.408 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2023-10-06T11:11:58.409 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 0, 2023-10-06T11:11:58.409 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 0, 2023-10-06T11:11:58.409 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2023-10-06T11:11:58.409 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 0, 2023-10-06T11:11:58.409 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 12598, 2023-10-06T11:11:58.409 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 83705979, 2023-10-06T11:11:58.409 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 12598, 2023-10-06T11:11:58.409 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 83705979, 2023-10-06T11:11:58.409 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2023-10-06T11:11:58.409 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:11:58.409 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:11:58.409 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:11:58.409 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:11:58.410 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.410 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-objecter_ops": { 2023-10-06T11:11:58.410 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2023-10-06T11:11:58.410 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 1024, 2023-10-06T11:11:58.410 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2023-10-06T11:11:58.410 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 0, 2023-10-06T11:11:58.410 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 0, 2023-10-06T11:11:58.410 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2023-10-06T11:11:58.410 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 0, 2023-10-06T11:11:58.410 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 12598, 2023-10-06T11:11:58.411 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 12598, 2023-10-06T11:11:58.411 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 12598, 2023-10-06T11:11:58.411 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 12598, 2023-10-06T11:11:58.411 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2023-10-06T11:11:58.411 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:11:58.411 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:11:58.411 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:11:58.411 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:11:58.411 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.411 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-write_buf_throttle": { 2023-10-06T11:11:58.411 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2023-10-06T11:11:58.411 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 3758096384, 2023-10-06T11:11:58.411 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2023-10-06T11:11:58.412 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 1475, 2023-10-06T11:11:58.412 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 160775, 2023-10-06T11:11:58.412 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2023-10-06T11:11:58.412 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 1475, 2023-10-06T11:11:58.412 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2023-10-06T11:11:58.412 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2023-10-06T11:11:58.412 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 63, 2023-10-06T11:11:58.412 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 160775, 2023-10-06T11:11:58.412 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2023-10-06T11:11:58.412 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:11:58.412 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:11:58.412 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:11:58.413 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:11:58.413 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:11:58.413 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-write_buf_throttle-0x55db6746be00": { 2023-10-06T11:11:58.413 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 84, 2023-10-06T11:11:58.413 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 3758096384, 2023-10-06T11:11:58.413 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2023-10-06T11:11:58.413 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 21794, 2023-10-06T11:11:58.413 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 74157376, 2023-10-06T11:11:58.413 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2023-10-06T11:11:58.413 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 21794, 2023-10-06T11:11:58.413 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2023-10-06T11:11:58.413 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2023-10-06T11:11:58.413 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 6582, 2023-10-06T11:11:58.414 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 74157292, 2023-10-06T11:11:58.414 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2023-10-06T11:11:58.414 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:11:58.414 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:11:58.414 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:11:58.414 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:11:58.414 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:11:58.414 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:11:58.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.353+0000 7f227090c700 1 -- 172.21.15.146:0/1292973045 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f224c066f30 msgr2=0x7f224c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:11:58.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.353+0000 7f227090c700 1 --2- 172.21.15.146:0/1292973045 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f224c066f30 0x7f224c0693e0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f225c0030c0 tx=0x7f225c015000 comp rx=0 tx=0).stop 2023-10-06T11:11:58.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.353+0000 7f227090c700 1 -- 172.21.15.146:0/1292973045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f226c15a160 msgr2=0x7f226c0c8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:11:58.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.353+0000 7f227090c700 1 --2- 172.21.15.146:0/1292973045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f226c15a160 0x7f226c0c8d10 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f226400ceb0 tx=0x7f2264007870 comp rx=0 tx=0).stop 2023-10-06T11:11:58.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.353+0000 7f227090c700 1 -- 172.21.15.146:0/1292973045 shutdown_connections 2023-10-06T11:11:58.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.353+0000 7f227090c700 1 --2- 172.21.15.146:0/1292973045 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f224c066f30 0x7f224c0693e0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.353+0000 7f227090c700 1 --2- 172.21.15.146:0/1292973045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f226c15a160 0x7f226c0c8d10 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.353+0000 7f227090c700 1 --2- 172.21.15.146:0/1292973045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f226c0ae730 0x7f226c0b58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.353+0000 7f227090c700 1 --2- 172.21.15.146:0/1292973045 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f226c0cb950 0x7f226c156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.353+0000 7f227090c700 1 -- 172.21.15.146:0/1292973045 >> 172.21.15.146:0/1292973045 conn(0x7f226c06f380 msgr2=0x7f226c159690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:11:58.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.353+0000 7f227090c700 1 -- 172.21.15.146:0/1292973045 shutdown_connections 2023-10-06T11:11:58.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.353+0000 7f227090c700 1 -- 172.21.15.146:0/1292973045 wait complete. 2023-10-06T11:11:58.417 INFO:tasks.cephfs.test_scrub_checks:num of strays: 2000 2023-10-06T11:11:58.417 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 scrub start '~mdsdir' recursive 2023-10-06T11:11:58.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.534+0000 7fdf18373700 1 Processor -- start 2023-10-06T11:11:58.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.534+0000 7fdf18373700 1 -- start start 2023-10-06T11:11:58.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.535+0000 7fdf18373700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdf101598f0 0x7fdf10159cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.535+0000 7fdf18373700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fdf100ca570 0x7fdf10068480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.535+0000 7fdf18373700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf100a9950 con 0x7fdf100689c0 2023-10-06T11:11:58.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.535+0000 7fdf18373700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf1015a200 con 0x7fdf101598f0 2023-10-06T11:11:58.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.535+0000 7fdf18373700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf10068dd0 con 0x7fdf100ca570 2023-10-06T11:11:58.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.535+0000 7fdf1610f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdf101598f0 0x7fdf10159cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.535+0000 7fdf16910700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fdf100689c0 0x7fdf1015d380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44884/0 (socket says 172.21.15.146:44884) 2023-10-06T11:11:58.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.535+0000 7fdf1610f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdf101598f0 0x7fdf10159cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52802/0 (socket says 172.21.15.146:52802) 2023-10-06T11:11:58.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.535+0000 7fdf16910700 1 -- 172.21.15.146:0/4169033136 learned_addr learned my addr 172.21.15.146:0/4169033136 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:11:58.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.536+0000 7fdf1590e700 1 --2- 172.21.15.146:0/4169033136 >> v2:172.21.15.151:3300/0 conn(0x7fdf100ca570 0x7fdf10068480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.536+0000 7fdf1610f700 1 -- 172.21.15.146:0/4169033136 >> v2:172.21.15.151:3300/0 conn(0x7fdf100ca570 msgr2=0x7fdf10068480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:11:58.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.536+0000 7fdf1610f700 1 --2- 172.21.15.146:0/4169033136 >> v2:172.21.15.151:3300/0 conn(0x7fdf100ca570 0x7fdf10068480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.536+0000 7fdf1610f700 1 -- 172.21.15.146:0/4169033136 >> v1:172.21.15.146:6789/0 conn(0x7fdf100689c0 legacy=0x7fdf1015d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:11:58.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.536+0000 7fdf1610f700 1 -- 172.21.15.146:0/4169033136 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf1015a3e0 con 0x7fdf101598f0 2023-10-06T11:11:58.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.536+0000 7fdf1510d700 1 -- 172.21.15.146:0/4169033136 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1406940870 0 0) 0x7fdf100a9950 con 0x7fdf100689c0 2023-10-06T11:11:58.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.536+0000 7fdf1610f700 1 --2- 172.21.15.146:0/4169033136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf101598f0 0x7fdf10159cc0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fdf100ab8b0 tx=0x7fdf0c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1428630a7e954b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:11:58.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.536+0000 7fdf1510d700 1 -- 172.21.15.146:0/4169033136 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c00e070 con 0x7fdf101598f0 2023-10-06T11:11:58.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.536+0000 7fdf1510d700 1 -- 172.21.15.146:0/4169033136 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf0c00bb60 con 0x7fdf101598f0 2023-10-06T11:11:58.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.536+0000 7fdf1510d700 1 -- 172.21.15.146:0/4169033136 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c012430 con 0x7fdf101598f0 2023-10-06T11:11:58.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.537+0000 7fdf18373700 1 -- 172.21.15.146:0/4169033136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf101598f0 msgr2=0x7fdf10159cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:11:58.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.537+0000 7fdf18373700 1 --2- 172.21.15.146:0/4169033136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf101598f0 0x7fdf10159cc0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fdf100ab8b0 tx=0x7fdf0c009780 comp rx=0 tx=0).stop 2023-10-06T11:11:58.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.537+0000 7fdf18373700 1 -- 172.21.15.146:0/4169033136 shutdown_connections 2023-10-06T11:11:58.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.537+0000 7fdf18373700 1 --2- 172.21.15.146:0/4169033136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf101598f0 0x7fdf10159cc0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.537+0000 7fdf18373700 1 --2- 172.21.15.146:0/4169033136 >> v2:172.21.15.151:3300/0 conn(0x7fdf100ca570 0x7fdf10068480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.537+0000 7fdf18373700 1 -- 172.21.15.146:0/4169033136 >> 172.21.15.146:0/4169033136 conn(0x7fdf100c9f50 msgr2=0x7fdf1006dd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:11:58.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.537+0000 7fdf18373700 1 -- 172.21.15.146:0/4169033136 shutdown_connections 2023-10-06T11:11:58.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.537+0000 7fdf18373700 1 -- 172.21.15.146:0/4169033136 wait complete. 2023-10-06T11:11:58.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.538+0000 7fdf18373700 1 Processor -- start 2023-10-06T11:11:58.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.538+0000 7fdf18373700 1 -- start start 2023-10-06T11:11:58.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.538+0000 7fdf18373700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf100689c0 0x7fdf100c18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.538+0000 7fdf18373700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf100ca570 0x7fdf10151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.538+0000 7fdf18373700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf101598f0 0x7fdf1015c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.538+0000 7fdf18373700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf100b0560 con 0x7fdf100ca570 2023-10-06T11:11:58.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.538+0000 7fdf18373700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf100b27b0 con 0x7fdf101598f0 2023-10-06T11:11:58.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.538+0000 7fdf18373700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf100b1940 con 0x7fdf100689c0 2023-10-06T11:11:58.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.539+0000 7fdf1590e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf100ca570 0x7fdf10151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.539+0000 7fdf1590e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf100ca570 0x7fdf10151ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52804/0 (socket says 172.21.15.146:52804) 2023-10-06T11:11:58.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.539+0000 7fdf1590e700 1 -- 172.21.15.146:0/983202061 learned_addr learned my addr 172.21.15.146:0/983202061 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:11:58.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.539+0000 7fdf16910700 1 --2- 172.21.15.146:0/983202061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf101598f0 0x7fdf1015c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.539+0000 7fdf1610f700 1 --2- 172.21.15.146:0/983202061 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf100689c0 0x7fdf100c18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.539+0000 7fdf1590e700 1 -- 172.21.15.146:0/983202061 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf100689c0 msgr2=0x7fdf100c18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:11:58.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.539+0000 7fdf1590e700 1 --2- 172.21.15.146:0/983202061 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf100689c0 0x7fdf100c18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.539+0000 7fdf1590e700 1 -- 172.21.15.146:0/983202061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf101598f0 msgr2=0x7fdf1015c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:11:58.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.539+0000 7fdf1590e700 1 --2- 172.21.15.146:0/983202061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf101598f0 0x7fdf1015c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.539+0000 7fdf1590e700 1 -- 172.21.15.146:0/983202061 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0c009a20 con 0x7fdf100ca570 2023-10-06T11:11:58.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.539+0000 7fdf1590e700 1 --2- 172.21.15.146:0/983202061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf100ca570 0x7fdf10151ce0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fdf0000e930 tx=0x7fdf000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:11:58.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.539+0000 7fdf067fc700 1 -- 172.21.15.146:0/983202061 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf00013680 con 0x7fdf100ca570 2023-10-06T11:11:58.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.539+0000 7fdf067fc700 1 -- 172.21.15.146:0/983202061 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf000137e0 con 0x7fdf100ca570 2023-10-06T11:11:58.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.539+0000 7fdf067fc700 1 -- 172.21.15.146:0/983202061 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf00013b80 con 0x7fdf100ca570 2023-10-06T11:11:58.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.539+0000 7fdf18373700 1 -- 172.21.15.146:0/983202061 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf100b1be0 con 0x7fdf100ca570 2023-10-06T11:11:58.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.539+0000 7fdf18373700 1 -- 172.21.15.146:0/983202061 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf100b21e0 con 0x7fdf100ca570 2023-10-06T11:11:58.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.540+0000 7fdf067fc700 1 -- 172.21.15.146:0/983202061 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdf0000c3e0 con 0x7fdf100ca570 2023-10-06T11:11:58.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.541+0000 7fdf067fc700 1 --2- 172.21.15.146:0/983202061 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdef4066f30 0x7fdef40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.541+0000 7fdf067fc700 1 -- 172.21.15.146:0/983202061 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdf00084700 con 0x7fdf100ca570 2023-10-06T11:11:58.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.541+0000 7fdf1610f700 1 --2- 172.21.15.146:0/983202061 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdef4066f30 0x7fdef40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.541+0000 7fdf1610f700 1 --2- 172.21.15.146:0/983202061 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdef4066f30 0x7fdef40693e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c009fd0 tx=0x7fdf0c019000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:11:58.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.543+0000 7fdf2166bb80 1 Processor -- start 2023-10-06T11:11:58.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.543+0000 7fdf2166bb80 1 -- start start 2023-10-06T11:11:58.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.544+0000 7fdf2166bb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56260effab50 0x56260effaf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.544+0000 7fdf2166bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56260efb6a60 0x56260efb3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.544+0000 7fdf2166bb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56260efb4c90 0x56260efb3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.544+0000 7fdf2166bb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x56260ef33d40 con 0x56260efb4c90 2023-10-06T11:11:58.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.544+0000 7fdf2166bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56260ef0ab30 con 0x56260efb6a60 2023-10-06T11:11:58.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.544+0000 7fdf2166bb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x56260ef08330 con 0x56260effab50 2023-10-06T11:11:58.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.544+0000 7fdf16910700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56260efb4c90 0x56260efb3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.544+0000 7fdf16910700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56260efb4c90 0x56260efb3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52808/0 (socket says 172.21.15.146:52808) 2023-10-06T11:11:58.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.544+0000 7fdf16910700 1 -- 172.21.15.146:0/4230560447 learned_addr learned my addr 172.21.15.146:0/4230560447 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:11:58.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.544+0000 7fdf1590e700 1 --2- 172.21.15.146:0/4230560447 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56260efb6a60 0x56260efb3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.544+0000 7fdf1610f700 1 --2- 172.21.15.146:0/4230560447 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56260effab50 0x56260effaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.544+0000 7fdf16910700 1 -- 172.21.15.146:0/4230560447 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56260effab50 msgr2=0x56260effaf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:11:58.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.544+0000 7fdf16910700 1 --2- 172.21.15.146:0/4230560447 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56260effab50 0x56260effaf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.544+0000 7fdf16910700 1 -- 172.21.15.146:0/4230560447 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56260efb6a60 msgr2=0x56260efb3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:11:58.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.544+0000 7fdf16910700 1 --2- 172.21.15.146:0/4230560447 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56260efb6a60 0x56260efb3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.544+0000 7fdf16910700 1 -- 172.21.15.146:0/4230560447 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56260ed9e330 con 0x56260efb4c90 2023-10-06T11:11:58.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.544+0000 7fdf16910700 1 --2- 172.21.15.146:0/4230560447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56260efb4c90 0x56260efb3b80 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fdf08007140 tx=0x7fdf08007ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae7121a8d0eff5fa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:11:58.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.544+0000 7fdef37fe700 1 -- 172.21.15.146:0/4230560447 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf08004aa0 con 0x56260efb4c90 2023-10-06T11:11:58.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.544+0000 7fdef37fe700 1 -- 172.21.15.146:0/4230560447 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf080015b0 con 0x56260efb4c90 2023-10-06T11:11:58.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.544+0000 7fdef37fe700 1 -- 172.21.15.146:0/4230560447 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf08001970 con 0x56260efb4c90 2023-10-06T11:11:58.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.545+0000 7fdf2166bb80 1 -- 172.21.15.146:0/4230560447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56260efb4c90 msgr2=0x56260efb3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:11:58.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.545+0000 7fdf2166bb80 1 --2- 172.21.15.146:0/4230560447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56260efb4c90 0x56260efb3b80 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fdf08007140 tx=0x7fdf08007ed0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.545+0000 7fdf2166bb80 1 -- 172.21.15.146:0/4230560447 shutdown_connections 2023-10-06T11:11:58.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.545+0000 7fdf2166bb80 1 --2- 172.21.15.146:0/4230560447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56260efb4c90 0x56260efb3b80 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.545+0000 7fdf2166bb80 1 --2- 172.21.15.146:0/4230560447 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56260effab50 0x56260effaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.545+0000 7fdf2166bb80 1 --2- 172.21.15.146:0/4230560447 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56260efb6a60 0x56260efb3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.545+0000 7fdf2166bb80 1 -- 172.21.15.146:0/4230560447 >> 172.21.15.146:0/4230560447 conn(0x56260efb5130 msgr2=0x56260efb5500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:11:58.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.545+0000 7fdf2166bb80 1 -- 172.21.15.146:0/4230560447 shutdown_connections 2023-10-06T11:11:58.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.545+0000 7fdf2166bb80 1 -- 172.21.15.146:0/4230560447 wait complete. 2023-10-06T11:11:58.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.545+0000 7fdf2166bb80 1 -- start start 2023-10-06T11:11:58.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.546+0000 7fdf2166bb80 1 Processor -- start 2023-10-06T11:11:58.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.546+0000 7fdf2166bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56260efb4c90 0x56260eff7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.546+0000 7fdf2166bb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56260efb6a60 0x56260efd9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.546+0000 7fdf2166bb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56260effab50 0x56260efdbc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.546+0000 7fdf2166bb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x56260ef04120 con 0x56260effab50 2023-10-06T11:11:58.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.547+0000 7fdf2166bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56260eeaf950 con 0x56260efb4c90 2023-10-06T11:11:58.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.547+0000 7fdf2166bb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x56260eecaf60 con 0x56260efb6a60 2023-10-06T11:11:58.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.547+0000 7fdf2166bb80 10 client.0 _ll_register_callbacks cb 0x56260eda0ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:11:58.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.547+0000 7fdf16910700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56260effab50 0x56260efdbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.547+0000 7fdf16910700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56260effab50 0x56260efdbc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52814/0 (socket says 172.21.15.146:52814) 2023-10-06T11:11:58.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.547+0000 7fdf16910700 1 -- 172.21.15.146:0/616153780 learned_addr learned my addr 172.21.15.146:0/616153780 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:11:58.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.547+0000 7fdf1610f700 1 --2- 172.21.15.146:0/616153780 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56260efb4c90 0x56260eff7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.547+0000 7fdf1590e700 1 --2- 172.21.15.146:0/616153780 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56260efb6a60 0x56260efd9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.547+0000 7fdf16910700 1 -- 172.21.15.146:0/616153780 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56260efb6a60 msgr2=0x56260efd9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:11:58.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.547+0000 7fdf16910700 1 --2- 172.21.15.146:0/616153780 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56260efb6a60 0x56260efd9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.547+0000 7fdf16910700 1 -- 172.21.15.146:0/616153780 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56260efb4c90 msgr2=0x56260eff7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:11:58.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.547+0000 7fdf16910700 1 --2- 172.21.15.146:0/616153780 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56260efb4c90 0x56260eff7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.547+0000 7fdf16910700 1 -- 172.21.15.146:0/616153780 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf08004c90 con 0x56260effab50 2023-10-06T11:11:58.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.547+0000 7fdf16910700 1 --2- 172.21.15.146:0/616153780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56260effab50 0x56260efdbc60 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fdf08007910 tx=0x7fdf08018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c29ba54566936d0d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:11:58.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.547+0000 7fdef0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:11:58.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.547+0000 7fdef0ff9700 1 -- 172.21.15.146:0/616153780 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0801e620 con 0x56260effab50 2023-10-06T11:11:58.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.547+0000 7fdef0ff9700 1 -- 172.21.15.146:0/616153780 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(75..75 src has 1..75) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdf0801e780 con 0x56260effab50 2023-10-06T11:11:58.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.547+0000 7fdf2166bb80 1 -- 172.21.15.146:0/616153780 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56260efa8750 con 0x56260effab50 2023-10-06T11:11:58.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.547+0000 7fdef0ff9700 1 -- 172.21.15.146:0/616153780 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf0801eb50 con 0x56260effab50 2023-10-06T11:11:58.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.547+0000 7fdf2166bb80 10 client.7011 fetch_fsmap learned FSMap version 74 2023-10-06T11:11:58.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.547+0000 7fdf2166bb80 1 -- 172.21.15.146:0/616153780 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x56260ed410a0 con 0x56260effab50 2023-10-06T11:11:58.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.547+0000 7fdef0ff9700 1 -- 172.21.15.146:0/616153780 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56260efa8750 con 0x56260effab50 2023-10-06T11:11:58.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.548+0000 7fdef0ff9700 1 -- 172.21.15.146:0/616153780 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 74) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fdf08012070 con 0x56260effab50 2023-10-06T11:11:58.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.548+0000 7fdf2166bb80 10 client.7011 fetch_fsmap finished waiting for FSMap version 74 2023-10-06T11:11:58.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.548+0000 7fdf2166bb80 10 client.7011 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.b 2023-10-06T11:11:58.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.548+0000 7fdf2166bb80 20 client.7011 populate_metadata read hostname 'smithi146' 2023-10-06T11:11:58.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.548+0000 7fdf2166bb80 1 --2- 172.21.15.146:0/616153780 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x56260efe0130 0x56260efe2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.548+0000 7fdf2166bb80 4 client.7011 mds_command: new command op to 6786 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:11:58.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.548+0000 7fdf2166bb80 1 -- 172.21.15.146:0/616153780 --> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56260ef85680 con 0x56260efe0130 2023-10-06T11:11:58.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.548+0000 7fdf1610f700 1 --2- 172.21.15.146:0/616153780 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x56260efe0130 0x56260efe2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.548+0000 7fdef0ff9700 10 client.7011 ms_handle_connect on v2:172.21.15.151:6833/3649668257 2023-10-06T11:11:58.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.548+0000 7fdf1610f700 1 --2- 172.21.15.146:0/616153780 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x56260efe0130 0x56260efe2b20 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d53b3c22f309896 server_cookie=d539e577c32c27e5 in_seq=0 out_seq=0 2023-10-06T11:11:58.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.549+0000 7fdef0ff9700 1 -- 172.21.15.146:0/616153780 <== mds.0 v2:172.21.15.151:6833/3649668257 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x56260ef85680 con 0x56260efe0130 2023-10-06T11:11:58.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.549+0000 7fdef0ff9700 10 client.7011 handle_command_reply: tid=0 2023-10-06T11:11:58.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.549+0000 7fdf2166bb80 1 client.7011 shutdown 2023-10-06T11:11:58.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.549+0000 7fdf2166bb80 1 -- 172.21.15.146:0/616153780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56260effab50 msgr2=0x56260efdbc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:11:58.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.549+0000 7fdf2166bb80 1 --2- 172.21.15.146:0/616153780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56260effab50 0x56260efdbc60 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fdf08007910 tx=0x7fdf08018000 comp rx=0 tx=0).stop 2023-10-06T11:11:58.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.549+0000 7fdf2166bb80 1 -- 172.21.15.146:0/616153780 shutdown_connections 2023-10-06T11:11:58.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.549+0000 7fdf2166bb80 1 --2- 172.21.15.146:0/616153780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56260effab50 0x56260efdbc60 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.549+0000 7fdf2166bb80 1 --2- 172.21.15.146:0/616153780 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56260efb4c90 0x56260eff7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.549+0000 7fdf2166bb80 1 --2- 172.21.15.146:0/616153780 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x56260efe0130 0x56260efe2b20 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.549+0000 7fdf2166bb80 1 --2- 172.21.15.146:0/616153780 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56260efb6a60 0x56260efd9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.549+0000 7fdef0ff9700 0 client.7011 ms_handle_reset on v2:172.21.15.151:6833/3649668257 2023-10-06T11:11:58.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.549+0000 7fdf2166bb80 1 -- 172.21.15.146:0/616153780 >> 172.21.15.146:0/616153780 conn(0x56260efb5130 msgr2=0x56260eff83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:11:58.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.549+0000 7fdf2166bb80 1 -- 172.21.15.146:0/616153780 shutdown_connections 2023-10-06T11:11:58.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.549+0000 7fdf2166bb80 1 -- 172.21.15.146:0/616153780 wait complete. 2023-10-06T11:11:58.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.549+0000 7fdf2166bb80 20 client.7011 trim_cache size 0 max 16384 2023-10-06T11:11:58.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.565+0000 7fdf2166bb80 1 Processor -- start 2023-10-06T11:11:58.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.565+0000 7fdf2166bb80 1 -- start start 2023-10-06T11:11:58.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.566+0000 7fdf2166bb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56260efb4c90 0x56260eff9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.566+0000 7fdf2166bb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56260efb6a60 0x56260f05a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.566+0000 7fdf2166bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56260effab50 0x56260efb08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.566+0000 7fdf2166bb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x56260efdeed0 con 0x56260efb4c90 2023-10-06T11:11:58.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.566+0000 7fdf2166bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56260ed86ef0 con 0x56260effab50 2023-10-06T11:11:58.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.566+0000 7fdf2166bb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x56260ef93190 con 0x56260efb6a60 2023-10-06T11:11:58.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.566+0000 7fdf1610f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56260efb4c90 0x56260eff9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.566+0000 7fdf1610f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56260efb4c90 0x56260eff9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52820/0 (socket says 172.21.15.146:52820) 2023-10-06T11:11:58.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.566+0000 7fdf1610f700 1 -- 172.21.15.146:0/4085661523 learned_addr learned my addr 172.21.15.146:0/4085661523 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:11:58.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.566+0000 7fdf16910700 1 --2- 172.21.15.146:0/4085661523 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56260effab50 0x56260efb08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.566+0000 7fdf1590e700 1 --2- 172.21.15.146:0/4085661523 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56260efb6a60 0x56260f05a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.566+0000 7fdf1610f700 1 -- 172.21.15.146:0/4085661523 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56260efb6a60 msgr2=0x56260f05a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:11:58.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.566+0000 7fdf1610f700 1 --2- 172.21.15.146:0/4085661523 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56260efb6a60 0x56260f05a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.566+0000 7fdf1610f700 1 -- 172.21.15.146:0/4085661523 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56260effab50 msgr2=0x56260efb08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:11:58.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.566+0000 7fdf1610f700 1 --2- 172.21.15.146:0/4085661523 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56260effab50 0x56260efb08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.566+0000 7fdf1610f700 1 -- 172.21.15.146:0/4085661523 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56260efb18e0 con 0x56260efb4c90 2023-10-06T11:11:58.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.566+0000 7fdf1590e700 1 --2- 172.21.15.146:0/4085661523 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56260efb6a60 0x56260f05a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:11:58.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.566+0000 7fdf1610f700 1 --2- 172.21.15.146:0/4085661523 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56260efb4c90 0x56260eff9ef0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c0097c0 tx=0x7fdf0c021040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52ff4ef6a336527c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:11:58.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.566+0000 7fdef3fff700 1 -- 172.21.15.146:0/4085661523 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c02f070 con 0x56260efb4c90 2023-10-06T11:11:58.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.566+0000 7fdef3fff700 1 -- 172.21.15.146:0/4085661523 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf0c030040 con 0x56260efb4c90 2023-10-06T11:11:58.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.566+0000 7fdef3fff700 1 -- 172.21.15.146:0/4085661523 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c01f5d0 con 0x56260efb4c90 2023-10-06T11:11:58.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.567+0000 7fdf2166bb80 1 -- 172.21.15.146:0/4085661523 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56260efb4c90 msgr2=0x56260eff9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:11:58.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.567+0000 7fdf2166bb80 1 --2- 172.21.15.146:0/4085661523 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56260efb4c90 0x56260eff9ef0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c0097c0 tx=0x7fdf0c021040 comp rx=0 tx=0).stop 2023-10-06T11:11:58.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.567+0000 7fdf2166bb80 1 -- 172.21.15.146:0/4085661523 shutdown_connections 2023-10-06T11:11:58.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.567+0000 7fdf2166bb80 1 --2- 172.21.15.146:0/4085661523 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56260effab50 0x56260efb08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.567+0000 7fdf2166bb80 1 --2- 172.21.15.146:0/4085661523 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56260efb4c90 0x56260eff9ef0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.567+0000 7fdf2166bb80 1 --2- 172.21.15.146:0/4085661523 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56260efb6a60 0x56260f05a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.567+0000 7fdf2166bb80 1 -- 172.21.15.146:0/4085661523 >> 172.21.15.146:0/4085661523 conn(0x56260efb5130 msgr2=0x56260eff0320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:11:58.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.567+0000 7fdf2166bb80 1 -- 172.21.15.146:0/4085661523 shutdown_connections 2023-10-06T11:11:58.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.567+0000 7fdf2166bb80 1 -- 172.21.15.146:0/4085661523 wait complete. 2023-10-06T11:11:58.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.567+0000 7fdf2166bb80 1 -- start start 2023-10-06T11:11:58.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.568+0000 7fdf2166bb80 1 Processor -- start 2023-10-06T11:11:58.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.568+0000 7fdf2166bb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56260efb4c90 0x56260f0588c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.568+0000 7fdf2166bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56260efb6a60 0x56260efda590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.568+0000 7fdf2166bb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56260effab50 0x56260efafa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.568+0000 7fdf2166bb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x56260f01c3c0 con 0x56260efb4c90 2023-10-06T11:11:58.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.568+0000 7fdf2166bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56260f059130 con 0x56260efb6a60 2023-10-06T11:11:58.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.568+0000 7fdf2166bb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x56260f060640 con 0x56260effab50 2023-10-06T11:11:58.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.568+0000 7fdf2166bb80 10 client.0 _ll_register_callbacks cb 0x56260eda0ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:11:58.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.568+0000 7fdf1610f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56260efb4c90 0x56260f0588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.569+0000 7fdf1610f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56260efb4c90 0x56260f0588c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52836/0 (socket says 172.21.15.146:52836) 2023-10-06T11:11:58.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.569+0000 7fdf1610f700 1 -- 172.21.15.146:0/3475481785 learned_addr learned my addr 172.21.15.146:0/3475481785 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:11:58.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.569+0000 7fdf1590e700 1 --2- 172.21.15.146:0/3475481785 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56260efb6a60 0x56260efda590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.569+0000 7fdf16910700 1 --2- 172.21.15.146:0/3475481785 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56260effab50 0x56260efafa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.569+0000 7fdf1610f700 1 -- 172.21.15.146:0/3475481785 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56260effab50 msgr2=0x56260efafa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:11:58.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.569+0000 7fdf1610f700 1 --2- 172.21.15.146:0/3475481785 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56260effab50 0x56260efafa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.569+0000 7fdf1610f700 1 -- 172.21.15.146:0/3475481785 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56260efb6a60 msgr2=0x56260efda590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:11:58.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.569+0000 7fdf1610f700 1 --2- 172.21.15.146:0/3475481785 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56260efb6a60 0x56260efda590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.569+0000 7fdf1610f700 1 -- 172.21.15.146:0/3475481785 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf1015a3e0 con 0x56260efb4c90 2023-10-06T11:11:58.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.569+0000 7fdf1610f700 1 --2- 172.21.15.146:0/3475481785 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56260efb4c90 0x56260f0588c0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c013000 tx=0x7fdf0c033000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dab49a37a322ad04 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:11:58.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.569+0000 7fdef0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:11:58.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.569+0000 7fdef0ff9700 1 -- 172.21.15.146:0/3475481785 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c02f050 con 0x56260efb4c90 2023-10-06T11:11:58.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.569+0000 7fdef0ff9700 1 -- 172.21.15.146:0/3475481785 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(75..75 src has 1..75) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdf0c01fca0 con 0x56260efb4c90 2023-10-06T11:11:58.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.569+0000 7fdf2166bb80 1 -- 172.21.15.146:0/3475481785 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdf080015b0 con 0x56260efb4c90 2023-10-06T11:11:58.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.569+0000 7fdef0ff9700 1 -- 172.21.15.146:0/3475481785 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf0c01fe80 con 0x56260efb4c90 2023-10-06T11:11:58.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.569+0000 7fdf2166bb80 10 client.7017 fetch_fsmap learned FSMap version 74 2023-10-06T11:11:58.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.569+0000 7fdf2166bb80 1 -- 172.21.15.146:0/3475481785 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x56260eed2840 con 0x56260efb4c90 2023-10-06T11:11:58.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.569+0000 7fdef0ff9700 1 -- 172.21.15.146:0/3475481785 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf080015b0 con 0x56260efb4c90 2023-10-06T11:11:58.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.569+0000 7fdef0ff9700 1 -- 172.21.15.146:0/3475481785 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 74) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fdf0c0366b0 con 0x56260efb4c90 2023-10-06T11:11:58.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.569+0000 7fdf2166bb80 10 client.7017 fetch_fsmap finished waiting for FSMap version 74 2023-10-06T11:11:58.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.569+0000 7fdf2166bb80 10 client.7017 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.b 2023-10-06T11:11:58.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.569+0000 7fdf2166bb80 20 client.7017 populate_metadata read hostname 'smithi146' 2023-10-06T11:11:58.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.569+0000 7fdf2166bb80 1 --2- 172.21.15.146:0/3475481785 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x56260efdab20 0x56260efaff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.569+0000 7fdf2166bb80 4 client.7017 mds_command: new command op to 6786 tid=0[{"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}] 2023-10-06T11:11:58.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.569+0000 7fdf2166bb80 1 -- 172.21.15.146:0/3475481785 --> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] -- command(tid 0: {"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}) v1 -- 0x56260eea6ec0 con 0x56260efdab20 2023-10-06T11:11:58.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.570+0000 7fdf1590e700 1 --2- 172.21.15.146:0/3475481785 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x56260efdab20 0x56260efaff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.570+0000 7fdef0ff9700 10 client.7017 ms_handle_connect on v2:172.21.15.151:6833/3649668257 2023-10-06T11:11:58.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.570+0000 7fdf1590e700 1 --2- 172.21.15.146:0/3475481785 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x56260efdab20 0x56260efaff60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=662a914350a4f768 server_cookie=b1bbe7c407ed0e28 in_seq=0 out_seq=0 2023-10-06T11:11:58.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.579+0000 7fdef0ff9700 1 -- 172.21.15.146:0/3475481785 <== mds.0 v2:172.21.15.151:6833/3649668257 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x56260eea6ec0 con 0x56260efdab20 2023-10-06T11:11:58.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.579+0000 7fdef0ff9700 10 client.7017 handle_command_reply: tid=0 2023-10-06T11:11:58.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.579+0000 7fdf2166bb80 1 client.7017 shutdown 2023-10-06T11:11:58.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.579+0000 7fdf2166bb80 1 -- 172.21.15.146:0/3475481785 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56260efb4c90 msgr2=0x56260f0588c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:11:58.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.579+0000 7fdf2166bb80 1 --2- 172.21.15.146:0/3475481785 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56260efb4c90 0x56260f0588c0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c013000 tx=0x7fdf0c033000 comp rx=0 tx=0).stop 2023-10-06T11:11:58.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.579+0000 7fdf2166bb80 1 -- 172.21.15.146:0/3475481785 shutdown_connections 2023-10-06T11:11:58.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.579+0000 7fdf2166bb80 1 --2- 172.21.15.146:0/3475481785 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x56260efdab20 0x56260efaff60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.579+0000 7fdf2166bb80 1 --2- 172.21.15.146:0/3475481785 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56260effab50 0x56260efafa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.579+0000 7fdf2166bb80 1 --2- 172.21.15.146:0/3475481785 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56260efb4c90 0x56260f0588c0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.579+0000 7fdf2166bb80 1 --2- 172.21.15.146:0/3475481785 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56260efb6a60 0x56260efda590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.579+0000 7fdef0ff9700 0 client.7017 ms_handle_reset on v2:172.21.15.151:6833/3649668257 2023-10-06T11:11:58.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.579+0000 7fdf2166bb80 1 -- 172.21.15.146:0/3475481785 >> 172.21.15.146:0/3475481785 conn(0x56260efb5130 msgr2=0x56260eff0320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:11:58.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.579+0000 7fdf2166bb80 1 -- 172.21.15.146:0/3475481785 shutdown_connections 2023-10-06T11:11:58.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.579+0000 7fdf2166bb80 1 -- 172.21.15.146:0/3475481785 wait complete. 2023-10-06T11:11:58.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.579+0000 7fdf2166bb80 20 client.7017 trim_cache size 0 max 16384 2023-10-06T11:11:58.583 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:11:58.583 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0, 2023-10-06T11:11:58.583 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_tag": "35beb97e-870e-4796-80ec-000e82917332", 2023-10-06T11:11:58.583 INFO:teuthology.orchestra.run.smithi146.stdout: "mode": "asynchronous" 2023-10-06T11:11:58.583 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:11:58.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.580+0000 7fdf18373700 1 -- 172.21.15.146:0/983202061 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdef4066f30 msgr2=0x7fdef40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:11:58.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.580+0000 7fdf18373700 1 --2- 172.21.15.146:0/983202061 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdef4066f30 0x7fdef40693e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c009fd0 tx=0x7fdf0c019000 comp rx=0 tx=0).stop 2023-10-06T11:11:58.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.580+0000 7fdf18373700 1 -- 172.21.15.146:0/983202061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf100ca570 msgr2=0x7fdf10151ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:11:58.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.580+0000 7fdf18373700 1 --2- 172.21.15.146:0/983202061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf100ca570 0x7fdf10151ce0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fdf0000e930 tx=0x7fdf000091a0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.580+0000 7fdf18373700 1 -- 172.21.15.146:0/983202061 shutdown_connections 2023-10-06T11:11:58.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.580+0000 7fdf18373700 1 --2- 172.21.15.146:0/983202061 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdef4066f30 0x7fdef40693e0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.580+0000 7fdf18373700 1 --2- 172.21.15.146:0/983202061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf101598f0 0x7fdf1015c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.580+0000 7fdf18373700 1 --2- 172.21.15.146:0/983202061 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf100689c0 0x7fdf100c18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.580+0000 7fdf18373700 1 --2- 172.21.15.146:0/983202061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf100ca570 0x7fdf10151ce0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.580+0000 7fdf18373700 1 -- 172.21.15.146:0/983202061 >> 172.21.15.146:0/983202061 conn(0x7fdf100c9f50 msgr2=0x7fdf1015dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:11:58.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.580+0000 7fdf18373700 1 -- 172.21.15.146:0/983202061 shutdown_connections 2023-10-06T11:11:58.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.580+0000 7fdf18373700 1 -- 172.21.15.146:0/983202061 wait complete. 2023-10-06T11:11:58.594 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 scrub status 2023-10-06T11:11:58.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.734+0000 7ff84a51e700 1 Processor -- start 2023-10-06T11:11:58.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.735+0000 7ff84a51e700 1 -- start start 2023-10-06T11:11:58.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.735+0000 7ff84a51e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff844159a90 0x7ff8440ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.735+0000 7ff84a51e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8440aecd0 0x7ff8440af150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.735+0000 7ff84a51e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8440cb870 con 0x7ff8440cdde0 2023-10-06T11:11:58.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.735+0000 7ff84a51e700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8440af690 con 0x7ff844159a90 2023-10-06T11:11:58.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.735+0000 7ff84a51e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8440b07d0 con 0x7ff8440aecd0 2023-10-06T11:11:58.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.736+0000 7ff8437fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff8440cdde0 0x7ff8440b00c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:44896/0 (socket says 172.21.15.146:44896) 2023-10-06T11:11:58.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.736+0000 7ff8437fe700 1 -- 172.21.15.146:0/3771045921 learned_addr learned my addr 172.21.15.146:0/3771045921 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:11:58.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.736+0000 7ff843fff700 1 --2- 172.21.15.146:0/3771045921 >> v2:172.21.15.151:3300/0 conn(0x7ff844159a90 0x7ff8440ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.736+0000 7ff848abb700 1 --2- 172.21.15.146:0/3771045921 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8440aecd0 0x7ff8440af150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.736+0000 7ff842ffd700 1 -- 172.21.15.146:0/3771045921 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1650170997 0 0) 0x7ff8440cb870 con 0x7ff8440cdde0 2023-10-06T11:11:58.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.736+0000 7ff842ffd700 1 -- 172.21.15.146:0/3771045921 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff82c003570 con 0x7ff8440cdde0 2023-10-06T11:11:58.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.736+0000 7ff843fff700 1 -- 172.21.15.146:0/3771045921 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8440aecd0 msgr2=0x7ff8440af150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:11:58.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.736+0000 7ff843fff700 1 --2- 172.21.15.146:0/3771045921 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8440aecd0 0x7ff8440af150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.736+0000 7ff843fff700 1 -- 172.21.15.146:0/3771045921 >> v1:172.21.15.146:6789/0 conn(0x7ff8440cdde0 legacy=0x7ff8440b00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:11:58.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.736+0000 7ff843fff700 1 -- 172.21.15.146:0/3771045921 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8440cac60 con 0x7ff844159a90 2023-10-06T11:11:58.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.736+0000 7ff843fff700 1 --2- 172.21.15.146:0/3771045921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff844159a90 0x7ff8440ca330 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff8340098e0 tx=0x7ff8340091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=845c23d6e8fb72d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:11:58.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.736+0000 7ff842ffd700 1 -- 172.21.15.146:0/3771045921 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff834011630 con 0x7ff844159a90 2023-10-06T11:11:58.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.736+0000 7ff842ffd700 1 -- 172.21.15.146:0/3771045921 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff834011790 con 0x7ff844159a90 2023-10-06T11:11:58.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.736+0000 7ff842ffd700 1 -- 172.21.15.146:0/3771045921 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff834011b10 con 0x7ff844159a90 2023-10-06T11:11:58.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.737+0000 7ff84a51e700 1 -- 172.21.15.146:0/3771045921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff844159a90 msgr2=0x7ff8440ca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:11:58.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.737+0000 7ff84a51e700 1 --2- 172.21.15.146:0/3771045921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff844159a90 0x7ff8440ca330 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff8340098e0 tx=0x7ff8340091a0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.737+0000 7ff84a51e700 1 -- 172.21.15.146:0/3771045921 shutdown_connections 2023-10-06T11:11:58.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.737+0000 7ff84a51e700 1 --2- 172.21.15.146:0/3771045921 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8440aecd0 0x7ff8440af150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.737+0000 7ff84a51e700 1 --2- 172.21.15.146:0/3771045921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff844159a90 0x7ff8440ca330 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.737+0000 7ff84a51e700 1 -- 172.21.15.146:0/3771045921 >> 172.21.15.146:0/3771045921 conn(0x7ff844068580 msgr2=0x7ff844068980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:11:58.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.737+0000 7ff84a51e700 1 -- 172.21.15.146:0/3771045921 shutdown_connections 2023-10-06T11:11:58.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.737+0000 7ff84a51e700 1 -- 172.21.15.146:0/3771045921 wait complete. 2023-10-06T11:11:58.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.739+0000 7ff84a51e700 1 Processor -- start 2023-10-06T11:11:58.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.739+0000 7ff84a51e700 1 -- start start 2023-10-06T11:11:58.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.740+0000 7ff84a51e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8440aecd0 0x7ff844155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.740+0000 7ff84a51e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8440cdde0 0x7ff8441585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.740+0000 7ff84a51e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff844159a90 0x7ff84414be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.740+0000 7ff84a51e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8440a5780 con 0x7ff844159a90 2023-10-06T11:11:58.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.740+0000 7ff84a51e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff84414c3c0 con 0x7ff8440aecd0 2023-10-06T11:11:58.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.740+0000 7ff84a51e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff84416d170 con 0x7ff8440cdde0 2023-10-06T11:11:58.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.740+0000 7ff848abb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff844159a90 0x7ff84414be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.740+0000 7ff843fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8440aecd0 0x7ff844155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.740+0000 7ff8437fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8440cdde0 0x7ff8441585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.740+0000 7ff848abb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff844159a90 0x7ff84414be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52844/0 (socket says 172.21.15.146:52844) 2023-10-06T11:11:58.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.740+0000 7ff843fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8440aecd0 0x7ff844155ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:44388/0 (socket says 172.21.15.146:44388) 2023-10-06T11:11:58.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.740+0000 7ff848abb700 1 -- 172.21.15.146:0/2324021738 learned_addr learned my addr 172.21.15.146:0/2324021738 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:11:58.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.740+0000 7ff8437fe700 1 -- 172.21.15.146:0/2324021738 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8440aecd0 msgr2=0x7ff844155ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:11:58.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.740+0000 7ff8437fe700 1 --2- 172.21.15.146:0/2324021738 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8440aecd0 0x7ff844155ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.740+0000 7ff8437fe700 1 -- 172.21.15.146:0/2324021738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff844159a90 msgr2=0x7ff84414be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:11:58.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.740+0000 7ff8437fe700 1 --2- 172.21.15.146:0/2324021738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff844159a90 0x7ff84414be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.740+0000 7ff8437fe700 1 -- 172.21.15.146:0/2324021738 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff834009420 con 0x7ff8440cdde0 2023-10-06T11:11:58.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.740+0000 7ff8437fe700 1 --2- 172.21.15.146:0/2324021738 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8440cdde0 0x7ff8441585a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff83800c560 tx=0x7ff838007d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:11:58.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.740+0000 7ff82bfff700 1 -- 172.21.15.146:0/2324021738 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff838005b30 con 0x7ff8440cdde0 2023-10-06T11:11:58.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.741+0000 7ff82bfff700 1 -- 172.21.15.146:0/2324021738 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff838005c90 con 0x7ff8440cdde0 2023-10-06T11:11:58.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.741+0000 7ff84a51e700 1 -- 172.21.15.146:0/2324021738 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff84416d450 con 0x7ff8440cdde0 2023-10-06T11:11:58.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.741+0000 7ff82bfff700 1 -- 172.21.15.146:0/2324021738 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff838007320 con 0x7ff8440cdde0 2023-10-06T11:11:58.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.741+0000 7ff84a51e700 1 -- 172.21.15.146:0/2324021738 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff84416da10 con 0x7ff8440cdde0 2023-10-06T11:11:58.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.742+0000 7ff82bfff700 1 -- 172.21.15.146:0/2324021738 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff83801b3b0 con 0x7ff8440cdde0 2023-10-06T11:11:58.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.743+0000 7ff82bfff700 1 --2- 172.21.15.146:0/2324021738 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff830066f30 0x7ff8300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.743+0000 7ff82bfff700 1 -- 172.21.15.146:0/2324021738 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff8380839e0 con 0x7ff8440cdde0 2023-10-06T11:11:58.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.743+0000 7ff843fff700 1 --2- 172.21.15.146:0/2324021738 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff830066f30 0x7ff8300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.743+0000 7ff843fff700 1 --2- 172.21.15.146:0/2324021738 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff830066f30 0x7ff8300693e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff8340091e0 tx=0x7ff834017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:11:58.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.745+0000 7ff853816b80 1 Processor -- start 2023-10-06T11:11:58.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.745+0000 7ff853816b80 1 -- start start 2023-10-06T11:11:58.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.746+0000 7ff853816b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b56c22dae0 0x55b56c22deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.746+0000 7ff853816b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b56c1e99f0 0x55b56c1e65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.746+0000 7ff853816b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b56c1e7c20 0x55b56c1e6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.746+0000 7ff853816b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b56c166cd0 con 0x55b56c22dae0 2023-10-06T11:11:58.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.746+0000 7ff853816b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b56c13dac0 con 0x55b56c1e7c20 2023-10-06T11:11:58.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.746+0000 7ff853816b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b56c13b2c0 con 0x55b56c1e99f0 2023-10-06T11:11:58.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.746+0000 7ff843fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b56c22dae0 0x55b56c22deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.746+0000 7ff843fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b56c22dae0 0x55b56c22deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52856/0 (socket says 172.21.15.146:52856) 2023-10-06T11:11:58.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.746+0000 7ff843fff700 1 -- 172.21.15.146:0/1434868522 learned_addr learned my addr 172.21.15.146:0/1434868522 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:11:58.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.746+0000 7ff8437fe700 1 --2- 172.21.15.146:0/1434868522 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b56c1e99f0 0x55b56c1e65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.746+0000 7ff848abb700 1 --2- 172.21.15.146:0/1434868522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b56c1e7c20 0x55b56c1e6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.746+0000 7ff843fff700 1 -- 172.21.15.146:0/1434868522 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b56c1e99f0 msgr2=0x55b56c1e65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:11:58.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.746+0000 7ff843fff700 1 --2- 172.21.15.146:0/1434868522 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b56c1e99f0 0x55b56c1e65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.746+0000 7ff843fff700 1 -- 172.21.15.146:0/1434868522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b56c1e7c20 msgr2=0x55b56c1e6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:11:58.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.746+0000 7ff843fff700 1 --2- 172.21.15.146:0/1434868522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b56c1e7c20 0x55b56c1e6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.746+0000 7ff843fff700 1 -- 172.21.15.146:0/1434868522 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b56bfd12c0 con 0x55b56c22dae0 2023-10-06T11:11:58.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.746+0000 7ff843fff700 1 --2- 172.21.15.146:0/1434868522 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b56c22dae0 0x55b56c22deb0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7ff834000de0 tx=0x7ff834020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa9ae4b013cee710 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:11:58.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.747+0000 7ff8297fa700 1 -- 172.21.15.146:0/1434868522 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff834020070 con 0x55b56c22dae0 2023-10-06T11:11:58.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.747+0000 7ff8297fa700 1 -- 172.21.15.146:0/1434868522 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83401a910 con 0x55b56c22dae0 2023-10-06T11:11:58.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.747+0000 7ff8297fa700 1 -- 172.21.15.146:0/1434868522 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83401aa80 con 0x55b56c22dae0 2023-10-06T11:11:58.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.747+0000 7ff853816b80 1 -- 172.21.15.146:0/1434868522 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b56c22dae0 msgr2=0x55b56c22deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:11:58.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.747+0000 7ff853816b80 1 --2- 172.21.15.146:0/1434868522 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b56c22dae0 0x55b56c22deb0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7ff834000de0 tx=0x7ff834020000 comp rx=0 tx=0).stop 2023-10-06T11:11:58.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.747+0000 7ff853816b80 1 -- 172.21.15.146:0/1434868522 shutdown_connections 2023-10-06T11:11:58.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.747+0000 7ff853816b80 1 --2- 172.21.15.146:0/1434868522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b56c1e7c20 0x55b56c1e6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.747+0000 7ff853816b80 1 --2- 172.21.15.146:0/1434868522 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b56c22dae0 0x55b56c22deb0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.747+0000 7ff853816b80 1 --2- 172.21.15.146:0/1434868522 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b56c1e99f0 0x55b56c1e65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.747+0000 7ff853816b80 1 -- 172.21.15.146:0/1434868522 >> 172.21.15.146:0/1434868522 conn(0x55b56c1e80c0 msgr2=0x55b56c1e8490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:11:58.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.748+0000 7ff853816b80 1 -- 172.21.15.146:0/1434868522 shutdown_connections 2023-10-06T11:11:58.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.748+0000 7ff853816b80 1 -- 172.21.15.146:0/1434868522 wait complete. 2023-10-06T11:11:58.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.748+0000 7ff853816b80 1 -- start start 2023-10-06T11:11:58.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.748+0000 7ff853816b80 1 Processor -- start 2023-10-06T11:11:58.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.749+0000 7ff853816b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b56c1e7c20 0x55b56c1fc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.749+0000 7ff853816b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b56c1e99f0 0x55b56c212330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.749+0000 7ff853816b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b56c22dae0 0x55b56c212870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.749+0000 7ff853816b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b56c1370b0 con 0x55b56c22dae0 2023-10-06T11:11:58.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.749+0000 7ff853816b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b56c0e28e0 con 0x55b56c1e7c20 2023-10-06T11:11:58.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.749+0000 7ff853816b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b56c0fdef0 con 0x55b56c1e99f0 2023-10-06T11:11:58.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.749+0000 7ff853816b80 10 client.0 _ll_register_callbacks cb 0x55b56bfd3f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:11:58.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.749+0000 7ff848abb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b56c22dae0 0x55b56c212870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.749+0000 7ff8437fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b56c1e99f0 0x55b56c212330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.749+0000 7ff848abb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b56c22dae0 0x55b56c212870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52870/0 (socket says 172.21.15.146:52870) 2023-10-06T11:11:58.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.749+0000 7ff848abb700 1 -- 172.21.15.146:0/3554477888 learned_addr learned my addr 172.21.15.146:0/3554477888 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:11:58.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.749+0000 7ff843fff700 1 --2- 172.21.15.146:0/3554477888 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b56c1e7c20 0x55b56c1fc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.750+0000 7ff8437fe700 1 -- 172.21.15.146:0/3554477888 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b56c1e7c20 msgr2=0x55b56c1fc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:11:58.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.750+0000 7ff8437fe700 1 --2- 172.21.15.146:0/3554477888 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b56c1e7c20 0x55b56c1fc430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.750+0000 7ff8437fe700 1 -- 172.21.15.146:0/3554477888 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b56c22dae0 msgr2=0x55b56c212870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:11:58.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.750+0000 7ff8437fe700 1 --2- 172.21.15.146:0/3554477888 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b56c22dae0 0x55b56c212870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.750+0000 7ff8437fe700 1 -- 172.21.15.146:0/3554477888 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8440cac60 con 0x55b56c1e99f0 2023-10-06T11:11:58.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.750+0000 7ff8437fe700 1 --2- 172.21.15.146:0/3554477888 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b56c1e99f0 0x55b56c212330 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff838081e00 tx=0x7ff838081d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=352eae9ac2d883a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:11:58.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.750+0000 7ff8227fc700 10 client.0 ms_handle_connect on v2:172.21.15.151:3301/0 2023-10-06T11:11:58.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.750+0000 7ff8227fc700 1 -- 172.21.15.146:0/3554477888 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff838057a00 con 0x55b56c1e99f0 2023-10-06T11:11:58.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.750+0000 7ff8227fc700 1 -- 172.21.15.146:0/3554477888 <== mon.2 v2:172.21.15.151:3301/0 2 ==== osd_map(75..75 src has 1..75) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff83805b750 con 0x55b56c1e99f0 2023-10-06T11:11:58.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.750+0000 7ff853816b80 1 -- 172.21.15.146:0/3554477888 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b56c1db6e0 con 0x55b56c1e99f0 2023-10-06T11:11:58.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.750+0000 7ff8227fc700 1 -- 172.21.15.146:0/3554477888 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff838005e00 con 0x55b56c1e99f0 2023-10-06T11:11:58.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.750+0000 7ff853816b80 10 client.5900 fetch_fsmap learned FSMap version 74 2023-10-06T11:11:58.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.750+0000 7ff853816b80 1 -- 172.21.15.146:0/3554477888 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x55b56bf74030 con 0x55b56c1e99f0 2023-10-06T11:11:58.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.751+0000 7ff8227fc700 1 -- 172.21.15.146:0/3554477888 <== mon.2 v2:172.21.15.151:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff838080020 con 0x55b56c1e99f0 2023-10-06T11:11:58.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.751+0000 7ff8227fc700 1 -- 172.21.15.146:0/3554477888 <== mon.2 v2:172.21.15.151:3301/0 5 ==== fsmap(e 74) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff83805b2c0 con 0x55b56c1e99f0 2023-10-06T11:11:58.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.751+0000 7ff853816b80 10 client.5900 fetch_fsmap finished waiting for FSMap version 74 2023-10-06T11:11:58.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.751+0000 7ff853816b80 10 client.5900 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.b 2023-10-06T11:11:58.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.751+0000 7ff853816b80 20 client.5900 populate_metadata read hostname 'smithi146' 2023-10-06T11:11:58.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.751+0000 7ff853816b80 1 --2- 172.21.15.146:0/3554477888 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x55b56c225020 0x55b56c226e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.751+0000 7ff853816b80 4 client.5900 mds_command: new command op to 6786 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:11:58.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.751+0000 7ff853816b80 1 -- 172.21.15.146:0/3554477888 --> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b56c1b8610 con 0x55b56c225020 2023-10-06T11:11:58.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.751+0000 7ff843fff700 1 --2- 172.21.15.146:0/3554477888 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x55b56c225020 0x55b56c226e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.751+0000 7ff8227fc700 10 client.5900 ms_handle_connect on v2:172.21.15.151:6833/3649668257 2023-10-06T11:11:58.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.751+0000 7ff843fff700 1 --2- 172.21.15.146:0/3554477888 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x55b56c225020 0x55b56c226e20 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=788e96acd053d8ea server_cookie=70610749a2c87343 in_seq=0 out_seq=0 2023-10-06T11:11:58.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.752+0000 7ff8227fc700 1 -- 172.21.15.146:0/3554477888 <== mds.0 v2:172.21.15.151:6833/3649668257 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55b56c1b8610 con 0x55b56c225020 2023-10-06T11:11:58.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.752+0000 7ff8227fc700 10 client.5900 handle_command_reply: tid=0 2023-10-06T11:11:58.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.752+0000 7ff853816b80 1 client.5900 shutdown 2023-10-06T11:11:58.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.753+0000 7ff853816b80 1 -- 172.21.15.146:0/3554477888 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b56c1e99f0 msgr2=0x55b56c212330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:11:58.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.753+0000 7ff853816b80 1 --2- 172.21.15.146:0/3554477888 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b56c1e99f0 0x55b56c212330 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff838081e00 tx=0x7ff838081d00 comp rx=0 tx=0).stop 2023-10-06T11:11:58.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.753+0000 7ff853816b80 1 -- 172.21.15.146:0/3554477888 shutdown_connections 2023-10-06T11:11:58.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.753+0000 7ff853816b80 1 --2- 172.21.15.146:0/3554477888 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b56c22dae0 0x55b56c212870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.753+0000 7ff853816b80 1 --2- 172.21.15.146:0/3554477888 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b56c1e7c20 0x55b56c1fc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.753+0000 7ff853816b80 1 --2- 172.21.15.146:0/3554477888 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x55b56c225020 0x55b56c226e20 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.753+0000 7ff853816b80 1 --2- 172.21.15.146:0/3554477888 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b56c1e99f0 0x55b56c212330 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.753+0000 7ff853816b80 1 -- 172.21.15.146:0/3554477888 >> 172.21.15.146:0/3554477888 conn(0x55b56c1e80c0 msgr2=0x55b56c22cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:11:58.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.753+0000 7ff8227fc700 0 client.5900 ms_handle_reset on v2:172.21.15.151:6833/3649668257 2023-10-06T11:11:58.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.753+0000 7ff853816b80 1 -- 172.21.15.146:0/3554477888 shutdown_connections 2023-10-06T11:11:58.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.753+0000 7ff853816b80 1 -- 172.21.15.146:0/3554477888 wait complete. 2023-10-06T11:11:58.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.753+0000 7ff853816b80 20 client.5900 trim_cache size 0 max 16384 2023-10-06T11:11:58.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.772+0000 7ff853816b80 1 Processor -- start 2023-10-06T11:11:58.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.772+0000 7ff853816b80 1 -- start start 2023-10-06T11:11:58.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.773+0000 7ff853816b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b56c1e7c20 0x55b56c1e3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.773+0000 7ff853816b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b56c1e99f0 0x55b56c1e6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.773+0000 7ff853816b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b56c22dae0 0x55b56c1e70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.773+0000 7ff853816b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b56bfb9e80 con 0x55b56c22dae0 2023-10-06T11:11:58.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.773+0000 7ff853816b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b56c1e9780 con 0x55b56c1e7c20 2023-10-06T11:11:58.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.773+0000 7ff853816b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b56c1e1110 con 0x55b56c1e99f0 2023-10-06T11:11:58.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.773+0000 7ff843fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b56c1e7c20 0x55b56c1e3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.773+0000 7ff848abb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b56c22dae0 0x55b56c1e70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.773+0000 7ff8437fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b56c1e99f0 0x55b56c1e6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.773+0000 7ff843fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b56c1e7c20 0x55b56c1e3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:44404/0 (socket says 172.21.15.146:44404) 2023-10-06T11:11:58.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.773+0000 7ff843fff700 1 -- 172.21.15.146:0/3142372878 learned_addr learned my addr 172.21.15.146:0/3142372878 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:11:58.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.773+0000 7ff8437fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b56c1e99f0 0x55b56c1e6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:40444/0 (socket says 172.21.15.146:40444) 2023-10-06T11:11:58.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.773+0000 7ff843fff700 1 -- 172.21.15.146:0/3142372878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b56c1e99f0 msgr2=0x55b56c1e6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:11:58.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.773+0000 7ff843fff700 1 --2- 172.21.15.146:0/3142372878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b56c1e99f0 0x55b56c1e6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.773+0000 7ff843fff700 1 -- 172.21.15.146:0/3142372878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b56c22dae0 msgr2=0x55b56c1e70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:11:58.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.773+0000 7ff843fff700 1 --2- 172.21.15.146:0/3142372878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b56c22dae0 0x55b56c1e70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.773+0000 7ff843fff700 1 -- 172.21.15.146:0/3142372878 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b56c1057d0 con 0x55b56c1e7c20 2023-10-06T11:11:58.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.773+0000 7ff848abb700 1 --2- 172.21.15.146:0/3142372878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b56c22dae0 0x55b56c1e70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:11:58.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.773+0000 7ff8437fe700 1 --2- 172.21.15.146:0/3142372878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b56c1e99f0 0x55b56c1e6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:11:58.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.774+0000 7ff843fff700 1 --2- 172.21.15.146:0/3142372878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b56c1e7c20 0x55b56c1e3cd0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff834029000 tx=0x7ff834014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b039d1cb87148947 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:11:58.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.774+0000 7ff829ffb700 1 -- 172.21.15.146:0/3142372878 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff834037040 con 0x55b56c1e7c20 2023-10-06T11:11:58.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.774+0000 7ff829ffb700 1 -- 172.21.15.146:0/3142372878 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83401ae70 con 0x55b56c1e7c20 2023-10-06T11:11:58.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.774+0000 7ff829ffb700 1 -- 172.21.15.146:0/3142372878 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff834020040 con 0x55b56c1e7c20 2023-10-06T11:11:58.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.774+0000 7ff853816b80 1 -- 172.21.15.146:0/3142372878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b56c1e7c20 msgr2=0x55b56c1e3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:11:58.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.774+0000 7ff853816b80 1 --2- 172.21.15.146:0/3142372878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b56c1e7c20 0x55b56c1e3cd0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ff834029000 tx=0x7ff834014000 comp rx=0 tx=0).stop 2023-10-06T11:11:58.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.775+0000 7ff853816b80 1 -- 172.21.15.146:0/3142372878 shutdown_connections 2023-10-06T11:11:58.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.775+0000 7ff853816b80 1 --2- 172.21.15.146:0/3142372878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b56c22dae0 0x55b56c1e70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.775+0000 7ff853816b80 1 --2- 172.21.15.146:0/3142372878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b56c1e7c20 0x55b56c1e3cd0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.775+0000 7ff853816b80 1 --2- 172.21.15.146:0/3142372878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b56c1e99f0 0x55b56c1e6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.775+0000 7ff853816b80 1 -- 172.21.15.146:0/3142372878 >> 172.21.15.146:0/3142372878 conn(0x55b56c1e80c0 msgr2=0x55b56c227f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:11:58.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.775+0000 7ff853816b80 1 -- 172.21.15.146:0/3142372878 shutdown_connections 2023-10-06T11:11:58.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.775+0000 7ff853816b80 1 -- 172.21.15.146:0/3142372878 wait complete. 2023-10-06T11:11:58.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.775+0000 7ff853816b80 1 -- start start 2023-10-06T11:11:58.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.776+0000 7ff853816b80 1 Processor -- start 2023-10-06T11:11:58.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.776+0000 7ff853816b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b56c1e7c20 0x55b56c20e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.776+0000 7ff853816b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b56c1e99f0 0x55b56c2954a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.777+0000 7ff853816b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b56c22dae0 0x55b56c2959e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.777+0000 7ff853816b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b56c229a40 con 0x55b56c22dae0 2023-10-06T11:11:58.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.777+0000 7ff853816b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b56c23ea50 con 0x55b56c1e99f0 2023-10-06T11:11:58.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.777+0000 7ff853816b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b56c1fb440 con 0x55b56c1e7c20 2023-10-06T11:11:58.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.777+0000 7ff853816b80 10 client.0 _ll_register_callbacks cb 0x55b56bfd3f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:11:58.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.777+0000 7ff843fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b56c1e7c20 0x55b56c20e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.777+0000 7ff8437fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b56c1e99f0 0x55b56c2954a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.777+0000 7ff843fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b56c1e7c20 0x55b56c20e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:40454/0 (socket says 172.21.15.146:40454) 2023-10-06T11:11:58.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.777+0000 7ff843fff700 1 -- 172.21.15.146:0/1865840243 learned_addr learned my addr 172.21.15.146:0/1865840243 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:11:58.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.777+0000 7ff848abb700 1 --2- 172.21.15.146:0/1865840243 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b56c22dae0 0x55b56c2959e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.777+0000 7ff843fff700 1 -- 172.21.15.146:0/1865840243 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b56c1e99f0 msgr2=0x55b56c2954a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:11:58.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.777+0000 7ff843fff700 1 --2- 172.21.15.146:0/1865840243 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b56c1e99f0 0x55b56c2954a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.777+0000 7ff843fff700 1 -- 172.21.15.146:0/1865840243 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b56c22dae0 msgr2=0x55b56c2959e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:11:58.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.777+0000 7ff843fff700 1 --2- 172.21.15.146:0/1865840243 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b56c22dae0 0x55b56c2959e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.777+0000 7ff843fff700 1 -- 172.21.15.146:0/1865840243 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b56bf74030 con 0x55b56c1e7c20 2023-10-06T11:11:58.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.777+0000 7ff8437fe700 1 --2- 172.21.15.146:0/1865840243 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b56c1e99f0 0x55b56c2954a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:11:58.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.777+0000 7ff843fff700 1 --2- 172.21.15.146:0/1865840243 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b56c1e7c20 0x55b56c20e550 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff834034040 tx=0x7ff83403c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cfe258aaeadbd0b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:11:58.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.777+0000 7ff8227fc700 10 client.0 ms_handle_connect on v2:172.21.15.151:3301/0 2023-10-06T11:11:58.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.777+0000 7ff8227fc700 1 -- 172.21.15.146:0/1865840243 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff834037050 con 0x55b56c1e7c20 2023-10-06T11:11:58.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.778+0000 7ff853816b80 1 -- 172.21.15.146:0/1865840243 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff83401a910 con 0x55b56c1e7c20 2023-10-06T11:11:58.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.778+0000 7ff8227fc700 1 -- 172.21.15.146:0/1865840243 <== mon.2 v2:172.21.15.151:3301/0 2 ==== osd_map(75..75 src has 1..75) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff834000c90 con 0x55b56c1e7c20 2023-10-06T11:11:58.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.778+0000 7ff8227fc700 1 -- 172.21.15.146:0/1865840243 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff834020040 con 0x55b56c1e7c20 2023-10-06T11:11:58.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.778+0000 7ff853816b80 10 client.5906 fetch_fsmap learned FSMap version 74 2023-10-06T11:11:58.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.778+0000 7ff853816b80 1 -- 172.21.15.146:0/1865840243 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) v3 -- 0x7ff83c012690 con 0x55b56c1e7c20 2023-10-06T11:11:58.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.778+0000 7ff8227fc700 1 -- 172.21.15.146:0/1865840243 <== mon.2 v2:172.21.15.151:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff83401a910 con 0x55b56c1e7c20 2023-10-06T11:11:58.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.778+0000 7ff8227fc700 1 -- 172.21.15.146:0/1865840243 <== mon.2 v2:172.21.15.151:3301/0 5 ==== fsmap(e 74) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff83403d8b0 con 0x55b56c1e7c20 2023-10-06T11:11:58.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.778+0000 7ff853816b80 10 client.5906 fetch_fsmap finished waiting for FSMap version 74 2023-10-06T11:11:58.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.778+0000 7ff853816b80 10 client.5906 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.b 2023-10-06T11:11:58.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.778+0000 7ff853816b80 20 client.5906 populate_metadata read hostname 'smithi146' 2023-10-06T11:11:58.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.778+0000 7ff853816b80 1 --2- 172.21.15.146:0/1865840243 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x55b56c23f0b0 0x55b56c23f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:11:58.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.778+0000 7ff853816b80 4 client.5906 mds_command: new command op to 6786 tid=0[{"prefix": "scrub status"}] 2023-10-06T11:11:58.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.778+0000 7ff853816b80 1 -- 172.21.15.146:0/1865840243 --> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b56c0d9e50 con 0x55b56c23f0b0 2023-10-06T11:11:58.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.778+0000 7ff8437fe700 1 --2- 172.21.15.146:0/1865840243 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x55b56c23f0b0 0x55b56c23f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:11:58.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.779+0000 7ff8227fc700 10 client.5906 ms_handle_connect on v2:172.21.15.151:6833/3649668257 2023-10-06T11:11:58.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.779+0000 7ff8437fe700 1 --2- 172.21.15.146:0/1865840243 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x55b56c23f0b0 0x55b56c23f480 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=877abe62f8ea0821 server_cookie=ff64475723823de6 in_seq=0 out_seq=0 2023-10-06T11:11:58.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.779+0000 7ff8227fc700 1 -- 172.21.15.146:0/1865840243 <== mds.0 v2:172.21.15.151:6833/3649668257 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55b56c0d9e50 con 0x55b56c23f0b0 2023-10-06T11:11:58.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.779+0000 7ff8227fc700 10 client.5906 handle_command_reply: tid=0 2023-10-06T11:11:58.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.779+0000 7ff853816b80 1 client.5906 shutdown 2023-10-06T11:11:58.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.779+0000 7ff853816b80 1 -- 172.21.15.146:0/1865840243 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b56c1e7c20 msgr2=0x55b56c20e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:11:58.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.779+0000 7ff853816b80 1 --2- 172.21.15.146:0/1865840243 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b56c1e7c20 0x55b56c20e550 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff834034040 tx=0x7ff83403c000 comp rx=0 tx=0).stop 2023-10-06T11:11:58.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.779+0000 7ff853816b80 1 -- 172.21.15.146:0/1865840243 shutdown_connections 2023-10-06T11:11:58.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.779+0000 7ff853816b80 1 --2- 172.21.15.146:0/1865840243 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55b56c22dae0 0x55b56c2959e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.779+0000 7ff853816b80 1 --2- 172.21.15.146:0/1865840243 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x55b56c23f0b0 0x55b56c23f480 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.779+0000 7ff853816b80 1 --2- 172.21.15.146:0/1865840243 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55b56c1e7c20 0x55b56c20e550 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.779+0000 7ff853816b80 1 --2- 172.21.15.146:0/1865840243 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b56c1e99f0 0x55b56c2954a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.779+0000 7ff8227fc700 0 client.5906 ms_handle_reset on v2:172.21.15.151:6833/3649668257 2023-10-06T11:11:58.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.779+0000 7ff853816b80 1 -- 172.21.15.146:0/1865840243 >> 172.21.15.146:0/1865840243 conn(0x55b56c1e80c0 msgr2=0x55b56c22b200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:11:58.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.779+0000 7ff853816b80 1 -- 172.21.15.146:0/1865840243 shutdown_connections 2023-10-06T11:11:58.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.779+0000 7ff853816b80 1 -- 172.21.15.146:0/1865840243 wait complete. 2023-10-06T11:11:58.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.780+0000 7ff853816b80 20 client.5906 trim_cache size 0 max 16384 2023-10-06T11:11:58.789 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:11:58.789 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "scrub active (141 inodes in the stack)", 2023-10-06T11:11:58.789 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": { 2023-10-06T11:11:58.789 INFO:teuthology.orchestra.run.smithi146.stdout: "35beb97e-870e-4796-80ec-000e82917332": { 2023-10-06T11:11:58.789 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "~mds0", 2023-10-06T11:11:58.789 INFO:teuthology.orchestra.run.smithi146.stdout: "tag": "35beb97e-870e-4796-80ec-000e82917332", 2023-10-06T11:11:58.789 INFO:teuthology.orchestra.run.smithi146.stdout: "options": "recursive" 2023-10-06T11:11:58.789 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:11:58.789 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:11:58.789 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:11:58.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.780+0000 7ff84a51e700 1 -- 172.21.15.146:0/2324021738 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff830066f30 msgr2=0x7ff8300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:11:58.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.780+0000 7ff84a51e700 1 --2- 172.21.15.146:0/2324021738 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff830066f30 0x7ff8300693e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff8340091e0 tx=0x7ff834017000 comp rx=0 tx=0).stop 2023-10-06T11:11:58.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.780+0000 7ff84a51e700 1 -- 172.21.15.146:0/2324021738 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8440cdde0 msgr2=0x7ff8441585a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:11:58.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.780+0000 7ff84a51e700 1 --2- 172.21.15.146:0/2324021738 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8440cdde0 0x7ff8441585a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff83800c560 tx=0x7ff838007d10 comp rx=0 tx=0).stop 2023-10-06T11:11:58.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.780+0000 7ff84a51e700 1 -- 172.21.15.146:0/2324021738 shutdown_connections 2023-10-06T11:11:58.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.780+0000 7ff84a51e700 1 --2- 172.21.15.146:0/2324021738 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff830066f30 0x7ff8300693e0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.780+0000 7ff84a51e700 1 --2- 172.21.15.146:0/2324021738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff844159a90 0x7ff84414be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.780+0000 7ff84a51e700 1 --2- 172.21.15.146:0/2324021738 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8440aecd0 0x7ff844155ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.780+0000 7ff84a51e700 1 --2- 172.21.15.146:0/2324021738 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8440cdde0 0x7ff8441585a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:11:58.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.780+0000 7ff84a51e700 1 -- 172.21.15.146:0/2324021738 >> 172.21.15.146:0/2324021738 conn(0x7ff844068580 msgr2=0x7ff8440ace80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:11:58.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.780+0000 7ff84a51e700 1 -- 172.21.15.146:0/2324021738 shutdown_connections 2023-10-06T11:11:58.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:11:58.780+0000 7ff84a51e700 1 -- 172.21.15.146:0/2324021738 wait complete. 2023-10-06T11:11:58.796 INFO:tasks.cephfs.filesystem:scrub status for tag:35beb97e-870e-4796-80ec-000e82917332 - {'path': '~mds0', 'tag': '35beb97e-870e-4796-80ec-000e82917332', 'options': 'recursive'} 2023-10-06T11:12:20.761 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:12:20.764 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:12:28.797 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 scrub status 2023-10-06T11:12:28.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.925+0000 7f74e969e700 1 Processor -- start 2023-10-06T11:12:28.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.925+0000 7f74e969e700 1 -- start start 2023-10-06T11:12:28.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.925+0000 7f74e969e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f74e40cc960 0x7f74e4164c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:28.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.925+0000 7f74e969e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74e40ccd80 con 0x7f74e415a160 2023-10-06T11:12:28.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.925+0000 7f74e969e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74e40ae2a0 con 0x7f74e40ae730 2023-10-06T11:12:28.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.925+0000 7f74e969e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74e415a530 con 0x7f74e40cc960 2023-10-06T11:12:28.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.926+0000 7f74e37fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f74e40cc960 0x7f74e4164c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:28.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.926+0000 7f74e2ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f74e415a160 0x7f74e40c55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55966/0 (socket says 172.21.15.146:55966) 2023-10-06T11:12:28.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.926+0000 7f74e2ffd700 1 -- 172.21.15.146:0/1951173908 learned_addr learned my addr 172.21.15.146:0/1951173908 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:12:28.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.926+0000 7f74e37fe700 1 -- 172.21.15.146:0/1951173908 >> v1:172.21.15.151:6789/0 conn(0x7f74e40ae730 legacy=0x7f74e40aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:28.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.926+0000 7f74e37fe700 1 -- 172.21.15.146:0/1951173908 >> v1:172.21.15.146:6789/0 conn(0x7f74e415a160 legacy=0x7f74e40c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:28.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.926+0000 7f74e37fe700 1 -- 172.21.15.146:0/1951173908 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e40c5cb0 con 0x7f74e40cc960 2023-10-06T11:12:28.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.926+0000 7f74e27fc700 1 -- 172.21.15.146:0/1951173908 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3477695469 0 0) 0x7f74d4001290 con 0x7f74e415a160 2023-10-06T11:12:28.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.926+0000 7f74e37fe700 1 --2- 172.21.15.146:0/1951173908 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74e40cc960 0x7f74e4164c60 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f74dc009e60 tx=0x7f74dc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3afc1a8e0ea3b5b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:28.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.926+0000 7f74e27fc700 1 -- 172.21.15.146:0/1951173908 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74dc00e070 con 0x7f74e40cc960 2023-10-06T11:12:28.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.926+0000 7f74e27fc700 1 -- 172.21.15.146:0/1951173908 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74dc00bc30 con 0x7f74e40cc960 2023-10-06T11:12:28.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.926+0000 7f74e27fc700 1 -- 172.21.15.146:0/1951173908 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74dc012430 con 0x7f74e40cc960 2023-10-06T11:12:28.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.927+0000 7f74e969e700 1 -- 172.21.15.146:0/1951173908 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74e40cc960 msgr2=0x7f74e4164c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:28.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.927+0000 7f74e969e700 1 --2- 172.21.15.146:0/1951173908 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74e40cc960 0x7f74e4164c60 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f74dc009e60 tx=0x7f74dc009780 comp rx=0 tx=0).stop 2023-10-06T11:12:28.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.927+0000 7f74e969e700 1 -- 172.21.15.146:0/1951173908 shutdown_connections 2023-10-06T11:12:28.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.927+0000 7f74e969e700 1 --2- 172.21.15.146:0/1951173908 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74e40cc960 0x7f74e4164c60 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:28.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.927+0000 7f74e969e700 1 -- 172.21.15.146:0/1951173908 >> 172.21.15.146:0/1951173908 conn(0x7f74e406f380 msgr2=0x7f74e40d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:28.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.927+0000 7f74e969e700 1 -- 172.21.15.146:0/1951173908 shutdown_connections 2023-10-06T11:12:28.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.927+0000 7f74e969e700 1 -- 172.21.15.146:0/1951173908 wait complete. 2023-10-06T11:12:28.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.928+0000 7f74e969e700 1 Processor -- start 2023-10-06T11:12:28.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.928+0000 7f74e969e700 1 -- start start 2023-10-06T11:12:28.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.929+0000 7f74e969e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74e40ae730 0x7f74e409de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:28.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.929+0000 7f74e969e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74e40cc960 0x7f74e409a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:28.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.929+0000 7f74e969e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74e415a160 0x7f74e409a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:28.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.929+0000 7f74e969e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e416d920 con 0x7f74e40ae730 2023-10-06T11:12:28.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.929+0000 7f74e969e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e4157850 con 0x7f74e415a160 2023-10-06T11:12:28.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.929+0000 7f74e969e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74e40c9d70 con 0x7f74e40cc960 2023-10-06T11:12:28.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.929+0000 7f74e2ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74e40ae730 0x7f74e409de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:28.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.929+0000 7f74e2ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74e40ae730 0x7f74e409de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32950/0 (socket says 172.21.15.146:32950) 2023-10-06T11:12:28.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.929+0000 7f74e2ffd700 1 -- 172.21.15.146:0/2032583321 learned_addr learned my addr 172.21.15.146:0/2032583321 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:28.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.929+0000 7f74e37fe700 1 --2- 172.21.15.146:0/2032583321 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74e415a160 0x7f74e409a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:28.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.929+0000 7f74da7fc700 1 --2- 172.21.15.146:0/2032583321 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74e40cc960 0x7f74e409a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:28.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.929+0000 7f74e2ffd700 1 -- 172.21.15.146:0/2032583321 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74e40cc960 msgr2=0x7f74e409a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:28.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.929+0000 7f74e2ffd700 1 --2- 172.21.15.146:0/2032583321 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74e40cc960 0x7f74e409a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:28.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.929+0000 7f74e2ffd700 1 -- 172.21.15.146:0/2032583321 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74e415a160 msgr2=0x7f74e409a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:28.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.929+0000 7f74e2ffd700 1 --2- 172.21.15.146:0/2032583321 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74e415a160 0x7f74e409a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:28.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.929+0000 7f74e2ffd700 1 -- 172.21.15.146:0/2032583321 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74dc009a20 con 0x7f74e40ae730 2023-10-06T11:12:28.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.930+0000 7f74e2ffd700 1 --2- 172.21.15.146:0/2032583321 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74e40ae730 0x7f74e409de20 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f74d400c5c0 tx=0x7f74d4007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:28.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.930+0000 7f74db7fe700 1 -- 172.21.15.146:0/2032583321 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d40072e0 con 0x7f74e40ae730 2023-10-06T11:12:28.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.930+0000 7f74db7fe700 1 -- 172.21.15.146:0/2032583321 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d4007480 con 0x7f74e40ae730 2023-10-06T11:12:28.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.930+0000 7f74db7fe700 1 -- 172.21.15.146:0/2032583321 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d40057f0 con 0x7f74e40ae730 2023-10-06T11:12:28.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.930+0000 7f74e969e700 1 -- 172.21.15.146:0/2032583321 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74e40ca050 con 0x7f74e40ae730 2023-10-06T11:12:28.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.930+0000 7f74e969e700 1 -- 172.21.15.146:0/2032583321 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74e409e360 con 0x7f74e40ae730 2023-10-06T11:12:28.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.931+0000 7f74db7fe700 1 -- 172.21.15.146:0/2032583321 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f74d4005ba0 con 0x7f74e40ae730 2023-10-06T11:12:28.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.932+0000 7f74db7fe700 1 --2- 172.21.15.146:0/2032583321 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f74c4067000 0x7f74c40694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:28.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.932+0000 7f74db7fe700 1 -- 172.21.15.146:0/2032583321 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6086+0+0 (secure 0 0 0) 0x7f74d4083740 con 0x7f74e40ae730 2023-10-06T11:12:28.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.932+0000 7f74da7fc700 1 --2- 172.21.15.146:0/2032583321 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f74c4067000 0x7f74c40694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:28.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.932+0000 7f74da7fc700 1 --2- 172.21.15.146:0/2032583321 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f74c4067000 0x7f74c40694b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f74e4067860 tx=0x7f74cc007ec0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:28.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.934+0000 7f74f2996b80 1 Processor -- start 2023-10-06T11:12:28.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.934+0000 7f74f2996b80 1 -- start start 2023-10-06T11:12:28.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.935+0000 7f74f2996b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f62f35eae0 0x55f62f35eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:28.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.935+0000 7f74f2996b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f62f31a9f0 0x55f62f3175d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:28.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.935+0000 7f74f2996b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f62f318c20 0x55f62f317b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:28.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.935+0000 7f74f2996b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f62f297cd0 con 0x55f62f31a9f0 2023-10-06T11:12:28.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.935+0000 7f74f2996b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f62f26eac0 con 0x55f62f318c20 2023-10-06T11:12:28.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.935+0000 7f74f2996b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f62f26c2c0 con 0x55f62f35eae0 2023-10-06T11:12:28.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.935+0000 7f74da7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f62f31a9f0 0x55f62f3175d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:28.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.935+0000 7f74da7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f62f31a9f0 0x55f62f3175d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32962/0 (socket says 172.21.15.146:32962) 2023-10-06T11:12:28.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.935+0000 7f74da7fc700 1 -- 172.21.15.146:0/1894046264 learned_addr learned my addr 172.21.15.146:0/1894046264 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:28.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.935+0000 7f74e2ffd700 1 --2- 172.21.15.146:0/1894046264 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f62f35eae0 0x55f62f35eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:28.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.935+0000 7f74e37fe700 1 --2- 172.21.15.146:0/1894046264 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f62f318c20 0x55f62f317b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:28.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.935+0000 7f74da7fc700 1 -- 172.21.15.146:0/1894046264 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f62f35eae0 msgr2=0x55f62f35eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:28.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.935+0000 7f74da7fc700 1 --2- 172.21.15.146:0/1894046264 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f62f35eae0 0x55f62f35eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:28.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.935+0000 7f74da7fc700 1 -- 172.21.15.146:0/1894046264 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f62f318c20 msgr2=0x55f62f317b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:28.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.935+0000 7f74da7fc700 1 --2- 172.21.15.146:0/1894046264 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f62f318c20 0x55f62f317b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:28.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.935+0000 7f74da7fc700 1 -- 172.21.15.146:0/1894046264 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f62f1022c0 con 0x55f62f31a9f0 2023-10-06T11:12:28.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.935+0000 7f74e37fe700 1 --2- 172.21.15.146:0/1894046264 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f62f318c20 0x55f62f317b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:12:28.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.935+0000 7f74da7fc700 1 --2- 172.21.15.146:0/1894046264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f62f31a9f0 0x55f62f3175d0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f74cc014750 tx=0x7f74cc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4efc6e93818ec8c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:28.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.935+0000 7f74c3fff700 1 -- 172.21.15.146:0/1894046264 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74cc020410 con 0x55f62f31a9f0 2023-10-06T11:12:28.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.936+0000 7f74c3fff700 1 -- 172.21.15.146:0/1894046264 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74cc020570 con 0x55f62f31a9f0 2023-10-06T11:12:28.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.936+0000 7f74c3fff700 1 -- 172.21.15.146:0/1894046264 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74cc020910 con 0x55f62f31a9f0 2023-10-06T11:12:28.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.936+0000 7f74f2996b80 1 -- 172.21.15.146:0/1894046264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f62f31a9f0 msgr2=0x55f62f3175d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:28.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.936+0000 7f74f2996b80 1 --2- 172.21.15.146:0/1894046264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f62f31a9f0 0x55f62f3175d0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f74cc014750 tx=0x7f74cc015000 comp rx=0 tx=0).stop 2023-10-06T11:12:28.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.936+0000 7f74f2996b80 1 -- 172.21.15.146:0/1894046264 shutdown_connections 2023-10-06T11:12:28.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.936+0000 7f74f2996b80 1 --2- 172.21.15.146:0/1894046264 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f62f318c20 0x55f62f317b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:28.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.936+0000 7f74f2996b80 1 --2- 172.21.15.146:0/1894046264 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f62f35eae0 0x55f62f35eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:28.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.936+0000 7f74f2996b80 1 --2- 172.21.15.146:0/1894046264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f62f31a9f0 0x55f62f3175d0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:28.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.936+0000 7f74f2996b80 1 -- 172.21.15.146:0/1894046264 >> 172.21.15.146:0/1894046264 conn(0x55f62f3190c0 msgr2=0x55f62f319490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:28.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.936+0000 7f74f2996b80 1 -- 172.21.15.146:0/1894046264 shutdown_connections 2023-10-06T11:12:28.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.936+0000 7f74f2996b80 1 -- 172.21.15.146:0/1894046264 wait complete. 2023-10-06T11:12:28.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.937+0000 7f74f2996b80 1 -- start start 2023-10-06T11:12:28.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.937+0000 7f74f2996b80 1 Processor -- start 2023-10-06T11:12:28.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.938+0000 7f74f2996b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f62f318c20 0x55f62f3427e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:28.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.938+0000 7f74f2996b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f62f31a9f0 0x55f62f342d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:28.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.938+0000 7f74f2996b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f62f35eae0 0x55f62f33fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:28.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.938+0000 7f74f2996b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f62f2680b0 con 0x55f62f318c20 2023-10-06T11:12:28.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.938+0000 7f74f2996b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f62f2138e0 con 0x55f62f35eae0 2023-10-06T11:12:28.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.938+0000 7f74f2996b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f62f22eef0 con 0x55f62f31a9f0 2023-10-06T11:12:28.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.938+0000 7f74f2996b80 10 client.0 _ll_register_callbacks cb 0x55f62f104f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:12:28.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.938+0000 7f74e2ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f62f318c20 0x55f62f3427e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:28.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.938+0000 7f74e2ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f62f318c20 0x55f62f3427e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32964/0 (socket says 172.21.15.146:32964) 2023-10-06T11:12:28.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.938+0000 7f74e2ffd700 1 -- 172.21.15.146:0/2112145639 learned_addr learned my addr 172.21.15.146:0/2112145639 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:28.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.938+0000 7f74e37fe700 1 --2- 172.21.15.146:0/2112145639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f62f35eae0 0x55f62f33fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:28.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.938+0000 7f74da7fc700 1 --2- 172.21.15.146:0/2112145639 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f62f31a9f0 0x55f62f342d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:28.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.938+0000 7f74e2ffd700 1 -- 172.21.15.146:0/2112145639 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f62f31a9f0 msgr2=0x55f62f342d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:28.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.938+0000 7f74e2ffd700 1 --2- 172.21.15.146:0/2112145639 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f62f31a9f0 0x55f62f342d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:28.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.938+0000 7f74e2ffd700 1 -- 172.21.15.146:0/2112145639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f62f35eae0 msgr2=0x55f62f33fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:28.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.938+0000 7f74e2ffd700 1 --2- 172.21.15.146:0/2112145639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f62f35eae0 0x55f62f33fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:28.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.938+0000 7f74e2ffd700 1 -- 172.21.15.146:0/2112145639 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74e40ae2a0 con 0x55f62f318c20 2023-10-06T11:12:28.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.938+0000 7f74e37fe700 1 --2- 172.21.15.146:0/2112145639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f62f35eae0 0x55f62f33fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:12:28.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.938+0000 7f74e2ffd700 1 --2- 172.21.15.146:0/2112145639 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f62f318c20 0x55f62f3427e0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f74d4081b70 tx=0x7f74d400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb1837be798a6c43 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:28.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.938+0000 7f74c17fa700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:12:28.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.939+0000 7f74c17fa700 1 -- 172.21.15.146:0/2112145639 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d405b570 con 0x55f62f318c20 2023-10-06T11:12:28.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.939+0000 7f74c17fa700 1 -- 172.21.15.146:0/2112145639 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(77..77 src has 1..77) v4 ==== 6086+0+0 (secure 0 0 0) 0x7f74d405b080 con 0x55f62f318c20 2023-10-06T11:12:28.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.939+0000 7f74f2996b80 1 -- 172.21.15.146:0/2112145639 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f62f30c6e0 con 0x55f62f318c20 2023-10-06T11:12:28.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.939+0000 7f74c17fa700 1 -- 172.21.15.146:0/2112145639 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74d4050410 con 0x55f62f318c20 2023-10-06T11:12:28.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.939+0000 7f74f2996b80 10 client.7050 fetch_fsmap learned FSMap version 77 2023-10-06T11:12:28.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.939+0000 7f74f2996b80 1 -- 172.21.15.146:0/2112145639 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) v3 -- 0x55f62f0a5030 con 0x55f62f318c20 2023-10-06T11:12:28.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.939+0000 7f74c17fa700 1 -- 172.21.15.146:0/2112145639 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f62f30c6e0 con 0x55f62f318c20 2023-10-06T11:12:28.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.939+0000 7f74c17fa700 1 -- 172.21.15.146:0/2112145639 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 77) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f74d4050570 con 0x55f62f318c20 2023-10-06T11:12:28.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.939+0000 7f74f2996b80 10 client.7050 fetch_fsmap finished waiting for FSMap version 77 2023-10-06T11:12:28.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.939+0000 7f74f2996b80 10 client.7050 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.b 2023-10-06T11:12:28.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.939+0000 7f74f2996b80 20 client.7050 populate_metadata read hostname 'smithi146' 2023-10-06T11:12:28.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.939+0000 7f74f2996b80 1 --2- 172.21.15.146:0/2112145639 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x55f62f346ba0 0x55f62f3417c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:28.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.939+0000 7f74f2996b80 4 client.7050 mds_command: new command op to 6786 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:12:28.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.939+0000 7f74f2996b80 1 -- 172.21.15.146:0/2112145639 --> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f62f2e9610 con 0x55f62f346ba0 2023-10-06T11:12:28.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.939+0000 7f74da7fc700 1 --2- 172.21.15.146:0/2112145639 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x55f62f346ba0 0x55f62f3417c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:28.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.940+0000 7f74c17fa700 10 client.7050 ms_handle_connect on v2:172.21.15.151:6833/3649668257 2023-10-06T11:12:28.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.940+0000 7f74da7fc700 1 --2- 172.21.15.146:0/2112145639 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x55f62f346ba0 0x55f62f3417c0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6d359345fc01d57 server_cookie=44cd30aa63385c4f in_seq=0 out_seq=0 2023-10-06T11:12:28.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.940+0000 7f74c17fa700 1 -- 172.21.15.146:0/2112145639 <== mds.0 v2:172.21.15.151:6833/3649668257 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55f62f2e9610 con 0x55f62f346ba0 2023-10-06T11:12:28.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.940+0000 7f74c17fa700 10 client.7050 handle_command_reply: tid=0 2023-10-06T11:12:28.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.940+0000 7f74f2996b80 1 client.7050 shutdown 2023-10-06T11:12:28.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.940+0000 7f74f2996b80 1 -- 172.21.15.146:0/2112145639 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f62f318c20 msgr2=0x55f62f3427e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:28.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.940+0000 7f74f2996b80 1 --2- 172.21.15.146:0/2112145639 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f62f318c20 0x55f62f3427e0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f74d4081b70 tx=0x7f74d400cf90 comp rx=0 tx=0).stop 2023-10-06T11:12:28.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.941+0000 7f74f2996b80 1 -- 172.21.15.146:0/2112145639 shutdown_connections 2023-10-06T11:12:28.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.941+0000 7f74f2996b80 1 --2- 172.21.15.146:0/2112145639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f62f35eae0 0x55f62f33fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:28.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.941+0000 7f74f2996b80 1 --2- 172.21.15.146:0/2112145639 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f62f318c20 0x55f62f3427e0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:28.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.941+0000 7f74f2996b80 1 --2- 172.21.15.146:0/2112145639 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x55f62f346ba0 0x55f62f3417c0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:28.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.941+0000 7f74f2996b80 1 --2- 172.21.15.146:0/2112145639 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f62f31a9f0 0x55f62f342d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:28.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.941+0000 7f74c17fa700 0 client.7050 ms_handle_reset on v2:172.21.15.151:6833/3649668257 2023-10-06T11:12:28.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.941+0000 7f74f2996b80 1 -- 172.21.15.146:0/2112145639 >> 172.21.15.146:0/2112145639 conn(0x55f62f3190c0 msgr2=0x55f62f35df80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:28.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.941+0000 7f74f2996b80 1 -- 172.21.15.146:0/2112145639 shutdown_connections 2023-10-06T11:12:28.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.941+0000 7f74f2996b80 1 -- 172.21.15.146:0/2112145639 wait complete. 2023-10-06T11:12:28.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.941+0000 7f74f2996b80 20 client.7050 trim_cache size 0 max 16384 2023-10-06T11:12:28.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.956+0000 7f74f2996b80 1 Processor -- start 2023-10-06T11:12:28.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.957+0000 7f74f2996b80 1 -- start start 2023-10-06T11:12:28.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.957+0000 7f74f2996b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f62f318c20 0x55f62f35d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:28.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.957+0000 7f74f2996b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f62f31a9f0 0x55f62f35d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:28.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.957+0000 7f74f2996b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f62f35eae0 0x55f62f3542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:28.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.957+0000 7f74f2996b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f62f0eae80 con 0x55f62f318c20 2023-10-06T11:12:28.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.957+0000 7f74f2996b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f62f35ad80 con 0x55f62f35eae0 2023-10-06T11:12:28.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.957+0000 7f74f2996b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f62f36da00 con 0x55f62f31a9f0 2023-10-06T11:12:28.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.957+0000 7f74e2ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f62f318c20 0x55f62f35d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:28.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.957+0000 7f74e2ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f62f318c20 0x55f62f35d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32976/0 (socket says 172.21.15.146:32976) 2023-10-06T11:12:28.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.957+0000 7f74e2ffd700 1 -- 172.21.15.146:0/3796258887 learned_addr learned my addr 172.21.15.146:0/3796258887 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:28.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.957+0000 7f74e2ffd700 1 -- 172.21.15.146:0/3796258887 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f62f31a9f0 msgr2=0x55f62f35d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:28.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.958+0000 7f74e2ffd700 1 --2- 172.21.15.146:0/3796258887 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f62f31a9f0 0x55f62f35d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:28.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.958+0000 7f74e2ffd700 1 -- 172.21.15.146:0/3796258887 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f62f35eae0 msgr2=0x55f62f3542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:28.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.958+0000 7f74e2ffd700 1 --2- 172.21.15.146:0/3796258887 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f62f35eae0 0x55f62f3542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:28.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.958+0000 7f74e2ffd700 1 -- 172.21.15.146:0/3796258887 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f62f2367d0 con 0x55f62f318c20 2023-10-06T11:12:28.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.958+0000 7f74e2ffd700 1 --2- 172.21.15.146:0/3796258887 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f62f318c20 0x55f62f35d2d0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f74d40070a0 tx=0x7f74d4083000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ffb379f8c16bfc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:28.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.958+0000 7f74d8ff9700 1 -- 172.21.15.146:0/3796258887 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d405b570 con 0x55f62f318c20 2023-10-06T11:12:28.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.958+0000 7f74d8ff9700 1 -- 172.21.15.146:0/3796258887 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d405b080 con 0x55f62f318c20 2023-10-06T11:12:28.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.958+0000 7f74d8ff9700 1 -- 172.21.15.146:0/3796258887 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d4050410 con 0x55f62f318c20 2023-10-06T11:12:28.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.958+0000 7f74f2996b80 1 -- 172.21.15.146:0/3796258887 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f62f318c20 msgr2=0x55f62f35d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:28.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.958+0000 7f74f2996b80 1 --2- 172.21.15.146:0/3796258887 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f62f318c20 0x55f62f35d2d0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f74d40070a0 tx=0x7f74d4083000 comp rx=0 tx=0).stop 2023-10-06T11:12:28.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.958+0000 7f74f2996b80 1 -- 172.21.15.146:0/3796258887 shutdown_connections 2023-10-06T11:12:28.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.958+0000 7f74f2996b80 1 --2- 172.21.15.146:0/3796258887 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f62f35eae0 0x55f62f3542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:28.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.958+0000 7f74f2996b80 1 --2- 172.21.15.146:0/3796258887 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f62f318c20 0x55f62f35d2d0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:28.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.958+0000 7f74f2996b80 1 --2- 172.21.15.146:0/3796258887 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f62f31a9f0 0x55f62f35d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:28.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.958+0000 7f74f2996b80 1 -- 172.21.15.146:0/3796258887 >> 172.21.15.146:0/3796258887 conn(0x55f62f3190c0 msgr2=0x55f62f35eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:28.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.958+0000 7f74f2996b80 1 -- 172.21.15.146:0/3796258887 shutdown_connections 2023-10-06T11:12:28.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.958+0000 7f74f2996b80 1 -- 172.21.15.146:0/3796258887 wait complete. 2023-10-06T11:12:28.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.959+0000 7f74f2996b80 1 -- start start 2023-10-06T11:12:28.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.959+0000 7f74f2996b80 1 Processor -- start 2023-10-06T11:12:28.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.960+0000 7f74f2996b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f62f318c20 0x55f62f3620b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:28.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.960+0000 7f74f2996b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f62f31a9f0 0x55f62f3625f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:28.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.960+0000 7f74f2996b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f62f35eae0 0x55f62f357a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:28.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.960+0000 7f74f2996b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f62f343c70 con 0x55f62f31a9f0 2023-10-06T11:12:28.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.960+0000 7f74f2996b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f62f343a20 con 0x55f62f35eae0 2023-10-06T11:12:28.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.960+0000 7f74f2996b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f62f377150 con 0x55f62f318c20 2023-10-06T11:12:28.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.960+0000 7f74f2996b80 10 client.0 _ll_register_callbacks cb 0x55f62f104f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:12:28.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.960+0000 7f74da7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f62f31a9f0 0x55f62f3625f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:28.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.960+0000 7f74da7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f62f31a9f0 0x55f62f3625f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32984/0 (socket says 172.21.15.146:32984) 2023-10-06T11:12:28.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.960+0000 7f74da7fc700 1 -- 172.21.15.146:0/3729916514 learned_addr learned my addr 172.21.15.146:0/3729916514 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:28.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.960+0000 7f74e37fe700 1 --2- 172.21.15.146:0/3729916514 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f62f35eae0 0x55f62f357a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:28.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.960+0000 7f74e2ffd700 1 --2- 172.21.15.146:0/3729916514 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f62f318c20 0x55f62f3620b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:28.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.960+0000 7f74da7fc700 1 -- 172.21.15.146:0/3729916514 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f62f318c20 msgr2=0x55f62f3620b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:28.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.960+0000 7f74da7fc700 1 --2- 172.21.15.146:0/3729916514 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f62f318c20 0x55f62f3620b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:28.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.960+0000 7f74da7fc700 1 -- 172.21.15.146:0/3729916514 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f62f35eae0 msgr2=0x55f62f357a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:28.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.960+0000 7f74da7fc700 1 --2- 172.21.15.146:0/3729916514 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f62f35eae0 0x55f62f357a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:28.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.960+0000 7f74da7fc700 1 -- 172.21.15.146:0/3729916514 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f62f0a5030 con 0x55f62f31a9f0 2023-10-06T11:12:28.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.960+0000 7f74da7fc700 1 --2- 172.21.15.146:0/3729916514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f62f31a9f0 0x55f62f3625f0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f74cc020000 tx=0x7f74cc032250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aee8e4dfbc8c27a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:28.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.960+0000 7f74c17fa700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:12:28.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.960+0000 7f74c17fa700 1 -- 172.21.15.146:0/3729916514 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74cc0208f0 con 0x55f62f31a9f0 2023-10-06T11:12:28.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.961+0000 7f74c17fa700 1 -- 172.21.15.146:0/3729916514 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(77..77 src has 1..77) v4 ==== 6086+0+0 (secure 0 0 0) 0x7f74cc01c040 con 0x55f62f31a9f0 2023-10-06T11:12:28.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.961+0000 7f74f2996b80 1 -- 172.21.15.146:0/3729916514 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f74cc020570 con 0x55f62f31a9f0 2023-10-06T11:12:28.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.961+0000 7f74c17fa700 1 -- 172.21.15.146:0/3729916514 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74cc02c610 con 0x55f62f31a9f0 2023-10-06T11:12:28.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.961+0000 7f74f2996b80 10 client.7056 fetch_fsmap learned FSMap version 77 2023-10-06T11:12:28.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.961+0000 7f74f2996b80 1 -- 172.21.15.146:0/3729916514 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) v3 -- 0x55f62f21d4c0 con 0x55f62f31a9f0 2023-10-06T11:12:28.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.961+0000 7f74c17fa700 1 -- 172.21.15.146:0/3729916514 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74cc020570 con 0x55f62f31a9f0 2023-10-06T11:12:28.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.961+0000 7f74c17fa700 1 -- 172.21.15.146:0/3729916514 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 77) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f74cc012070 con 0x55f62f31a9f0 2023-10-06T11:12:28.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.961+0000 7f74f2996b80 10 client.7056 fetch_fsmap finished waiting for FSMap version 77 2023-10-06T11:12:28.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.961+0000 7f74f2996b80 10 client.7056 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.b 2023-10-06T11:12:28.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.961+0000 7f74f2996b80 20 client.7056 populate_metadata read hostname 'smithi146' 2023-10-06T11:12:28.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.961+0000 7f74f2996b80 1 --2- 172.21.15.146:0/3729916514 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x55f62f3c3960 0x55f62f357f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:28.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.961+0000 7f74f2996b80 4 client.7056 mds_command: new command op to 6786 tid=0[{"prefix": "scrub status"}] 2023-10-06T11:12:28.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.961+0000 7f74f2996b80 1 -- 172.21.15.146:0/3729916514 --> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f62f20ae50 con 0x55f62f3c3960 2023-10-06T11:12:28.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.961+0000 7f74e2ffd700 1 --2- 172.21.15.146:0/3729916514 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x55f62f3c3960 0x55f62f357f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:28.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.961+0000 7f74c17fa700 10 client.7056 ms_handle_connect on v2:172.21.15.151:6833/3649668257 2023-10-06T11:12:28.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.961+0000 7f74e2ffd700 1 --2- 172.21.15.146:0/3729916514 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x55f62f3c3960 0x55f62f357f70 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b30e670621098c0 server_cookie=c391665d6f6c86f9 in_seq=0 out_seq=0 2023-10-06T11:12:28.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.962+0000 7f74c17fa700 1 -- 172.21.15.146:0/3729916514 <== mds.0 v2:172.21.15.151:6833/3649668257 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55f62f20ae50 con 0x55f62f3c3960 2023-10-06T11:12:28.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.962+0000 7f74c17fa700 10 client.7056 handle_command_reply: tid=0 2023-10-06T11:12:28.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.962+0000 7f74f2996b80 1 client.7056 shutdown 2023-10-06T11:12:28.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.962+0000 7f74f2996b80 1 -- 172.21.15.146:0/3729916514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f62f31a9f0 msgr2=0x55f62f3625f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:28.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.962+0000 7f74f2996b80 1 --2- 172.21.15.146:0/3729916514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f62f31a9f0 0x55f62f3625f0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f74cc020000 tx=0x7f74cc032250 comp rx=0 tx=0).stop 2023-10-06T11:12:28.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.962+0000 7f74f2996b80 1 -- 172.21.15.146:0/3729916514 shutdown_connections 2023-10-06T11:12:28.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.962+0000 7f74f2996b80 1 --2- 172.21.15.146:0/3729916514 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f62f35eae0 0x55f62f357a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:28.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.962+0000 7f74f2996b80 1 --2- 172.21.15.146:0/3729916514 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x55f62f3c3960 0x55f62f357f70 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:28.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.962+0000 7f74f2996b80 1 --2- 172.21.15.146:0/3729916514 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f62f318c20 0x55f62f3620b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:28.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.962+0000 7f74c17fa700 0 client.7056 ms_handle_reset on v2:172.21.15.151:6833/3649668257 2023-10-06T11:12:28.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.962+0000 7f74f2996b80 1 --2- 172.21.15.146:0/3729916514 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f62f31a9f0 0x55f62f3625f0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:28.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.962+0000 7f74f2996b80 1 -- 172.21.15.146:0/3729916514 >> 172.21.15.146:0/3729916514 conn(0x55f62f3190c0 msgr2=0x55f62f35a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:28.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.962+0000 7f74f2996b80 1 -- 172.21.15.146:0/3729916514 shutdown_connections 2023-10-06T11:12:28.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.962+0000 7f74f2996b80 1 -- 172.21.15.146:0/3729916514 wait complete. 2023-10-06T11:12:28.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.962+0000 7f74f2996b80 20 client.7056 trim_cache size 0 max 16384 2023-10-06T11:12:28.971 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:12:28.971 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "no active scrubs running", 2023-10-06T11:12:28.971 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": {} 2023-10-06T11:12:28.972 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:12:28.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.962+0000 7f74e969e700 1 -- 172.21.15.146:0/2032583321 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f74c4067000 msgr2=0x7f74c40694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:28.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.962+0000 7f74e969e700 1 --2- 172.21.15.146:0/2032583321 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f74c4067000 0x7f74c40694b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f74e4067860 tx=0x7f74cc007ec0 comp rx=0 tx=0).stop 2023-10-06T11:12:28.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.962+0000 7f74e969e700 1 -- 172.21.15.146:0/2032583321 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74e40ae730 msgr2=0x7f74e409de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:28.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.962+0000 7f74e969e700 1 --2- 172.21.15.146:0/2032583321 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74e40ae730 0x7f74e409de20 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f74d400c5c0 tx=0x7f74d4007e80 comp rx=0 tx=0).stop 2023-10-06T11:12:28.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.963+0000 7f74e969e700 1 -- 172.21.15.146:0/2032583321 shutdown_connections 2023-10-06T11:12:28.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.963+0000 7f74e969e700 1 --2- 172.21.15.146:0/2032583321 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f74c4067000 0x7f74c40694b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:28.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.963+0000 7f74e969e700 1 --2- 172.21.15.146:0/2032583321 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74e415a160 0x7f74e409a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:28.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.963+0000 7f74e969e700 1 --2- 172.21.15.146:0/2032583321 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74e40ae730 0x7f74e409de20 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:28.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.963+0000 7f74e969e700 1 --2- 172.21.15.146:0/2032583321 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74e40cc960 0x7f74e409a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:28.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.963+0000 7f74e969e700 1 -- 172.21.15.146:0/2032583321 >> 172.21.15.146:0/2032583321 conn(0x7f74e406f380 msgr2=0x7f74e4159570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:28.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.963+0000 7f74e969e700 1 -- 172.21.15.146:0/2032583321 shutdown_connections 2023-10-06T11:12:28.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:28.963+0000 7f74e969e700 1 -- 172.21.15.146:0/2032583321 wait complete. 2023-10-06T11:12:28.976 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-06T11:12:28.976 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 perf dump 2023-10-06T11:12:29.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.091+0000 7fd766652700 1 Processor -- start 2023-10-06T11:12:29.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.091+0000 7fd766652700 1 -- start start 2023-10-06T11:12:29.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.092+0000 7fd766652700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd7600ae730 0x7fd7600aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:29.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.092+0000 7fd766652700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7600cb950 0x7fd7600cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:29.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.092+0000 7fd766652700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7600ae2a0 con 0x7fd76015a160 2023-10-06T11:12:29.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.092+0000 7fd766652700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd76015a530 con 0x7fd7600ae730 2023-10-06T11:12:29.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.092+0000 7fd766652700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7600c5cb0 con 0x7fd7600cb950 2023-10-06T11:12:29.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.092+0000 7fd75f7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd7600ae730 0x7fd7600aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:29.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.092+0000 7fd75f7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd7600ae730 0x7fd7600aebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:32988/0 (socket says 172.21.15.146:32988) 2023-10-06T11:12:29.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.092+0000 7fd75f7fe700 1 -- 172.21.15.146:0/2955258340 learned_addr learned my addr 172.21.15.146:0/2955258340 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:29.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.092+0000 7fd764bef700 1 --2- 172.21.15.146:0/2955258340 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7600cb950 0x7fd7600cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:29.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.092+0000 7fd75f7fe700 1 -- 172.21.15.146:0/2955258340 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7600cb950 msgr2=0x7fd7600cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:29.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.092+0000 7fd75f7fe700 1 --2- 172.21.15.146:0/2955258340 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7600cb950 0x7fd7600cbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:29.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.092+0000 7fd75f7fe700 1 -- 172.21.15.146:0/2955258340 >> v1:172.21.15.151:6789/0 conn(0x7fd76015a160 legacy=0x7fd7600c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:29.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.092+0000 7fd75f7fe700 1 -- 172.21.15.146:0/2955258340 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7600af0f0 con 0x7fd7600ae730 2023-10-06T11:12:29.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.092+0000 7fd764bef700 1 --2- 172.21.15.146:0/2955258340 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7600cb950 0x7fd7600cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:12:29.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.092+0000 7fd75f7fe700 1 --2- 172.21.15.146:0/2955258340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7600ae730 0x7fd7600aebb0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fd7540099b0 tx=0x7fd754009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db100c7a8909bc1a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:29.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.092+0000 7fd75effd700 1 -- 172.21.15.146:0/2955258340 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75400b820 con 0x7fd7600ae730 2023-10-06T11:12:29.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.092+0000 7fd75effd700 1 -- 172.21.15.146:0/2955258340 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75400b980 con 0x7fd7600ae730 2023-10-06T11:12:29.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.092+0000 7fd75effd700 1 -- 172.21.15.146:0/2955258340 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75400bd20 con 0x7fd7600ae730 2023-10-06T11:12:29.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.093+0000 7fd766652700 1 -- 172.21.15.146:0/2955258340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7600ae730 msgr2=0x7fd7600aebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:29.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.093+0000 7fd766652700 1 --2- 172.21.15.146:0/2955258340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7600ae730 0x7fd7600aebb0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7fd7540099b0 tx=0x7fd754009250 comp rx=0 tx=0).stop 2023-10-06T11:12:29.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.093+0000 7fd766652700 1 -- 172.21.15.146:0/2955258340 shutdown_connections 2023-10-06T11:12:29.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.093+0000 7fd766652700 1 --2- 172.21.15.146:0/2955258340 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7600cb950 0x7fd7600cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:29.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.093+0000 7fd766652700 1 --2- 172.21.15.146:0/2955258340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7600ae730 0x7fd7600aebb0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:29.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.093+0000 7fd766652700 1 -- 172.21.15.146:0/2955258340 >> 172.21.15.146:0/2955258340 conn(0x7fd76006f380 msgr2=0x7fd7600d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:29.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.093+0000 7fd766652700 1 -- 172.21.15.146:0/2955258340 shutdown_connections 2023-10-06T11:12:29.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.093+0000 7fd766652700 1 -- 172.21.15.146:0/2955258340 wait complete. 2023-10-06T11:12:29.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.094+0000 7fd766652700 1 Processor -- start 2023-10-06T11:12:29.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.094+0000 7fd766652700 1 -- start start 2023-10-06T11:12:29.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.095+0000 7fd766652700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7600ae730 0x7fd760156820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:29.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.095+0000 7fd766652700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7600cb950 0x7fd7600ca110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:29.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.095+0000 7fd766652700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd76015a160 0x7fd7600ca650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:29.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.095+0000 7fd766652700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd760156d60 con 0x7fd7600ae730 2023-10-06T11:12:29.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.095+0000 7fd766652700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7600c78b0 con 0x7fd76015a160 2023-10-06T11:12:29.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.095+0000 7fd766652700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7600c86d0 con 0x7fd7600cb950 2023-10-06T11:12:29.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.095+0000 7fd75ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7600ae730 0x7fd760156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:29.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.095+0000 7fd75ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7600ae730 0x7fd760156820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33000/0 (socket says 172.21.15.146:33000) 2023-10-06T11:12:29.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.095+0000 7fd75ffff700 1 -- 172.21.15.146:0/1784943794 learned_addr learned my addr 172.21.15.146:0/1784943794 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:29.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.095+0000 7fd764bef700 1 --2- 172.21.15.146:0/1784943794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd76015a160 0x7fd7600ca650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:29.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.095+0000 7fd75f7fe700 1 --2- 172.21.15.146:0/1784943794 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7600cb950 0x7fd7600ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:29.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.095+0000 7fd75ffff700 1 -- 172.21.15.146:0/1784943794 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7600cb950 msgr2=0x7fd7600ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:29.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.095+0000 7fd75ffff700 1 --2- 172.21.15.146:0/1784943794 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7600cb950 0x7fd7600ca110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:29.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.095+0000 7fd75ffff700 1 -- 172.21.15.146:0/1784943794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd76015a160 msgr2=0x7fd7600ca650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:29.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.095+0000 7fd75ffff700 1 --2- 172.21.15.146:0/1784943794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd76015a160 0x7fd7600ca650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:29.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.096+0000 7fd75ffff700 1 -- 172.21.15.146:0/1784943794 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7540094f0 con 0x7fd7600ae730 2023-10-06T11:12:29.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.096+0000 7fd75ffff700 1 --2- 172.21.15.146:0/1784943794 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7600ae730 0x7fd760156820 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fd75000c5b0 tx=0x7fd7500020e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:29.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.096+0000 7fd747fff700 1 -- 172.21.15.146:0/1784943794 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd750011590 con 0x7fd7600ae730 2023-10-06T11:12:29.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.096+0000 7fd747fff700 1 -- 172.21.15.146:0/1784943794 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7500116f0 con 0x7fd7600ae730 2023-10-06T11:12:29.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.096+0000 7fd766652700 1 -- 172.21.15.146:0/1784943794 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd76016b660 con 0x7fd7600ae730 2023-10-06T11:12:29.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.096+0000 7fd747fff700 1 -- 172.21.15.146:0/1784943794 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd750011a90 con 0x7fd7600ae730 2023-10-06T11:12:29.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.096+0000 7fd766652700 1 -- 172.21.15.146:0/1784943794 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7600c7b40 con 0x7fd7600ae730 2023-10-06T11:12:29.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.097+0000 7fd747fff700 1 -- 172.21.15.146:0/1784943794 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd750012420 con 0x7fd7600ae730 2023-10-06T11:12:29.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.097+0000 7fd747fff700 1 --2- 172.21.15.146:0/1784943794 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd74c066f30 0x7fd74c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:29.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.098+0000 7fd747fff700 1 -- 172.21.15.146:0/1784943794 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6086+0+0 (secure 0 0 0) 0x7fd750084140 con 0x7fd7600ae730 2023-10-06T11:12:29.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.098+0000 7fd75f7fe700 1 --2- 172.21.15.146:0/1784943794 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd74c066f30 0x7fd74c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:29.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.098+0000 7fd75f7fe700 1 --2- 172.21.15.146:0/1784943794 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd74c066f30 0x7fd74c0693e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd7540099b0 tx=0x7fd754016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:29.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.099+0000 7fd76f94ab80 1 Processor -- start 2023-10-06T11:12:29.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.100+0000 7fd76f94ab80 1 -- start start 2023-10-06T11:12:29.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.100+0000 7fd76f94ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623f8bcbad0 0x5623f8bcbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:29.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.100+0000 7fd76f94ab80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5623f8b879e0 0x5623f8b845c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:29.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.100+0000 7fd76f94ab80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5623f8b85c10 0x5623f8b84b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:29.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.100+0000 7fd76f94ab80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623f8b04cc0 con 0x5623f8b85c10 2023-10-06T11:12:29.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.100+0000 7fd76f94ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623f8adbab0 con 0x5623f8bcbad0 2023-10-06T11:12:29.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.100+0000 7fd76f94ab80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5623f8ad92b0 con 0x5623f8b879e0 2023-10-06T11:12:29.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.101+0000 7fd764bef700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5623f8b85c10 0x5623f8b84b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:29.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.101+0000 7fd764bef700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5623f8b85c10 0x5623f8b84b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33010/0 (socket says 172.21.15.146:33010) 2023-10-06T11:12:29.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.101+0000 7fd764bef700 1 -- 172.21.15.146:0/213617412 learned_addr learned my addr 172.21.15.146:0/213617412 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:29.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.101+0000 7fd75ffff700 1 --2- 172.21.15.146:0/213617412 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623f8bcbad0 0x5623f8bcbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:29.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.101+0000 7fd75f7fe700 1 --2- 172.21.15.146:0/213617412 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5623f8b879e0 0x5623f8b845c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:29.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.101+0000 7fd764bef700 1 -- 172.21.15.146:0/213617412 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5623f8b879e0 msgr2=0x5623f8b845c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:29.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.101+0000 7fd764bef700 1 --2- 172.21.15.146:0/213617412 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5623f8b879e0 0x5623f8b845c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:29.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.101+0000 7fd764bef700 1 -- 172.21.15.146:0/213617412 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623f8bcbad0 msgr2=0x5623f8bcbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:29.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.101+0000 7fd764bef700 1 --2- 172.21.15.146:0/213617412 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623f8bcbad0 0x5623f8bcbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:29.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.101+0000 7fd764bef700 1 -- 172.21.15.146:0/213617412 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623f896f2b0 con 0x5623f8b85c10 2023-10-06T11:12:29.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.101+0000 7fd75f7fe700 1 --2- 172.21.15.146:0/213617412 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5623f8b879e0 0x5623f8b845c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:12:29.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.101+0000 7fd764bef700 1 --2- 172.21.15.146:0/213617412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5623f8b85c10 0x5623f8b84b00 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fd75800e580 tx=0x7fd758007af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=207036d6cc804213 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:29.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.101+0000 7fd7457fa700 1 -- 172.21.15.146:0/213617412 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75800c6b0 con 0x5623f8b85c10 2023-10-06T11:12:29.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.101+0000 7fd7457fa700 1 -- 172.21.15.146:0/213617412 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75800c810 con 0x5623f8b85c10 2023-10-06T11:12:29.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.101+0000 7fd7457fa700 1 -- 172.21.15.146:0/213617412 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75800cbb0 con 0x5623f8b85c10 2023-10-06T11:12:29.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.102+0000 7fd76f94ab80 1 -- 172.21.15.146:0/213617412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5623f8b85c10 msgr2=0x5623f8b84b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:29.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.102+0000 7fd76f94ab80 1 --2- 172.21.15.146:0/213617412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5623f8b85c10 0x5623f8b84b00 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fd75800e580 tx=0x7fd758007af0 comp rx=0 tx=0).stop 2023-10-06T11:12:29.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.102+0000 7fd76f94ab80 1 -- 172.21.15.146:0/213617412 shutdown_connections 2023-10-06T11:12:29.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.102+0000 7fd76f94ab80 1 --2- 172.21.15.146:0/213617412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5623f8b85c10 0x5623f8b84b00 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:29.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.102+0000 7fd76f94ab80 1 --2- 172.21.15.146:0/213617412 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623f8bcbad0 0x5623f8bcbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:29.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.102+0000 7fd76f94ab80 1 --2- 172.21.15.146:0/213617412 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5623f8b879e0 0x5623f8b845c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:29.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.102+0000 7fd76f94ab80 1 -- 172.21.15.146:0/213617412 >> 172.21.15.146:0/213617412 conn(0x5623f8b860b0 msgr2=0x5623f8b86480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:29.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.102+0000 7fd76f94ab80 1 -- 172.21.15.146:0/213617412 shutdown_connections 2023-10-06T11:12:29.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.102+0000 7fd76f94ab80 1 -- 172.21.15.146:0/213617412 wait complete. 2023-10-06T11:12:29.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.102+0000 7fd76f94ab80 1 -- start start 2023-10-06T11:12:29.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.102+0000 7fd76f94ab80 1 Processor -- start 2023-10-06T11:12:29.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.103+0000 7fd76f94ab80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5623f8b85c10 0x5623f8bab5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:29.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.103+0000 7fd76f94ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623f8b879e0 0x5623f8bb1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:29.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.103+0000 7fd76f94ab80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5623f8bcbad0 0x5623f8baf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:29.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.103+0000 7fd76f94ab80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623f8ad50a0 con 0x5623f8bcbad0 2023-10-06T11:12:29.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.103+0000 7fd76f94ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623f8a808d0 con 0x5623f8b879e0 2023-10-06T11:12:29.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.103+0000 7fd76f94ab80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5623f8a9bee0 con 0x5623f8b85c10 2023-10-06T11:12:29.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.103+0000 7fd76f94ab80 10 client.0 _ll_register_callbacks cb 0x5623f8971f70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:12:29.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.103+0000 7fd764bef700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5623f8bcbad0 0x5623f8baf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:29.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.103+0000 7fd764bef700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5623f8bcbad0 0x5623f8baf2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33016/0 (socket says 172.21.15.146:33016) 2023-10-06T11:12:29.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.103+0000 7fd764bef700 1 -- 172.21.15.146:0/3575826217 learned_addr learned my addr 172.21.15.146:0/3575826217 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:29.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.103+0000 7fd75ffff700 1 --2- 172.21.15.146:0/3575826217 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5623f8b85c10 0x5623f8bab5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:29.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.103+0000 7fd75f7fe700 1 --2- 172.21.15.146:0/3575826217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623f8b879e0 0x5623f8bb1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:29.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.104+0000 7fd764bef700 1 -- 172.21.15.146:0/3575826217 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5623f8b85c10 msgr2=0x5623f8bab5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:29.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.104+0000 7fd764bef700 1 --2- 172.21.15.146:0/3575826217 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5623f8b85c10 0x5623f8bab5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:29.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.104+0000 7fd764bef700 1 -- 172.21.15.146:0/3575826217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623f8b879e0 msgr2=0x5623f8bb1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:29.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.104+0000 7fd764bef700 1 --2- 172.21.15.146:0/3575826217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623f8b879e0 0x5623f8bb1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:29.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.104+0000 7fd764bef700 1 -- 172.21.15.146:0/3575826217 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd758007db0 con 0x5623f8bcbad0 2023-10-06T11:12:29.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.104+0000 7fd75f7fe700 1 --2- 172.21.15.146:0/3575826217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623f8b879e0 0x5623f8bb1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:12:29.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.104+0000 7fd764bef700 1 --2- 172.21.15.146:0/3575826217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5623f8bcbad0 0x5623f8baf2c0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x5623f8b87f30 tx=0x7fd758019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af7bc0a60d5d632d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:29.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.104+0000 7fd73e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:12:29.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.104+0000 7fd73e7fc700 1 -- 172.21.15.146:0/3575826217 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75800c6b0 con 0x5623f8bcbad0 2023-10-06T11:12:29.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.104+0000 7fd73e7fc700 1 -- 172.21.15.146:0/3575826217 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(77..77 src has 1..77) v4 ==== 6086+0+0 (secure 0 0 0) 0x7fd75800a650 con 0x5623f8bcbad0 2023-10-06T11:12:29.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.104+0000 7fd76f94ab80 1 -- 172.21.15.146:0/3575826217 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5623f8b796d0 con 0x5623f8bcbad0 2023-10-06T11:12:29.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.104+0000 7fd73e7fc700 1 -- 172.21.15.146:0/3575826217 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd75800aa20 con 0x5623f8bcbad0 2023-10-06T11:12:29.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.104+0000 7fd76f94ab80 10 client.7068 fetch_fsmap learned FSMap version 77 2023-10-06T11:12:29.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.104+0000 7fd76f94ab80 1 -- 172.21.15.146:0/3575826217 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) v3 -- 0x5623f8912020 con 0x5623f8bcbad0 2023-10-06T11:12:29.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.104+0000 7fd73e7fc700 1 -- 172.21.15.146:0/3575826217 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5623f8b796d0 con 0x5623f8bcbad0 2023-10-06T11:12:29.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.104+0000 7fd73e7fc700 1 -- 172.21.15.146:0/3575826217 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 77) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd75800ab80 con 0x5623f8bcbad0 2023-10-06T11:12:29.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.104+0000 7fd76f94ab80 10 client.7068 fetch_fsmap finished waiting for FSMap version 77 2023-10-06T11:12:29.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.104+0000 7fd76f94ab80 10 client.7068 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.b 2023-10-06T11:12:29.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.104+0000 7fd76f94ab80 20 client.7068 populate_metadata read hostname 'smithi146' 2023-10-06T11:12:29.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.104+0000 7fd76f94ab80 1 --2- 172.21.15.146:0/3575826217 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x5623f8bb1f70 0x5623f8bacc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:29.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.104+0000 7fd76f94ab80 4 client.7068 mds_command: new command op to 6786 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:12:29.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.104+0000 7fd76f94ab80 1 -- 172.21.15.146:0/3575826217 --> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5623f8b56600 con 0x5623f8bb1f70 2023-10-06T11:12:29.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.104+0000 7fd75ffff700 1 --2- 172.21.15.146:0/3575826217 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x5623f8bb1f70 0x5623f8bacc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:29.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.105+0000 7fd73e7fc700 10 client.7068 ms_handle_connect on v2:172.21.15.151:6833/3649668257 2023-10-06T11:12:29.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.105+0000 7fd75ffff700 1 --2- 172.21.15.146:0/3575826217 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x5623f8bb1f70 0x5623f8bacc80 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60b9d1148bb598e3 server_cookie=badd4fce43d28a0f in_seq=0 out_seq=0 2023-10-06T11:12:29.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.105+0000 7fd73e7fc700 1 -- 172.21.15.146:0/3575826217 <== mds.0 v2:172.21.15.151:6833/3649668257 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5623f8b56600 con 0x5623f8bb1f70 2023-10-06T11:12:29.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.105+0000 7fd73e7fc700 10 client.7068 handle_command_reply: tid=0 2023-10-06T11:12:29.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.105+0000 7fd76f94ab80 1 client.7068 shutdown 2023-10-06T11:12:29.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.105+0000 7fd76f94ab80 1 -- 172.21.15.146:0/3575826217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5623f8bcbad0 msgr2=0x5623f8baf2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:29.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.105+0000 7fd76f94ab80 1 --2- 172.21.15.146:0/3575826217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5623f8bcbad0 0x5623f8baf2c0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x5623f8b87f30 tx=0x7fd758019000 comp rx=0 tx=0).stop 2023-10-06T11:12:29.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.105+0000 7fd76f94ab80 1 -- 172.21.15.146:0/3575826217 shutdown_connections 2023-10-06T11:12:29.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.105+0000 7fd76f94ab80 1 --2- 172.21.15.146:0/3575826217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5623f8bcbad0 0x5623f8baf2c0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:29.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.105+0000 7fd76f94ab80 1 --2- 172.21.15.146:0/3575826217 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x5623f8bb1f70 0x5623f8bacc80 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:29.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.105+0000 7fd76f94ab80 1 --2- 172.21.15.146:0/3575826217 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5623f8b85c10 0x5623f8bab5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:29.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.105+0000 7fd73e7fc700 0 client.7068 ms_handle_reset on v2:172.21.15.151:6833/3649668257 2023-10-06T11:12:29.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.105+0000 7fd76f94ab80 1 --2- 172.21.15.146:0/3575826217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623f8b879e0 0x5623f8bb1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:29.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.105+0000 7fd76f94ab80 1 -- 172.21.15.146:0/3575826217 >> 172.21.15.146:0/3575826217 conn(0x5623f8b860b0 msgr2=0x5623f8b81830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:29.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.106+0000 7fd76f94ab80 1 -- 172.21.15.146:0/3575826217 shutdown_connections 2023-10-06T11:12:29.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.106+0000 7fd76f94ab80 1 -- 172.21.15.146:0/3575826217 wait complete. 2023-10-06T11:12:29.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.106+0000 7fd76f94ab80 20 client.7068 trim_cache size 0 max 16384 2023-10-06T11:12:29.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.121+0000 7fd76f94ab80 1 Processor -- start 2023-10-06T11:12:29.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.121+0000 7fd76f94ab80 1 -- start start 2023-10-06T11:12:29.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.121+0000 7fd76f94ab80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5623f8b85c10 0x5623f8bc9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:29.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.121+0000 7fd76f94ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623f8b879e0 0x5623f8bce080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:29.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.121+0000 7fd76f94ab80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5623f8bcbad0 0x5623f8b80790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:29.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.121+0000 7fd76f94ab80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623f8957e70 con 0x5623f8bcbad0 2023-10-06T11:12:29.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.122+0000 7fd76f94ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623f8b7f100 con 0x5623f8b879e0 2023-10-06T11:12:29.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.122+0000 7fd76f94ab80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5623f8b84040 con 0x5623f8b85c10 2023-10-06T11:12:29.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.122+0000 7fd764bef700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5623f8bcbad0 0x5623f8b80790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:29.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.122+0000 7fd764bef700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5623f8bcbad0 0x5623f8b80790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33028/0 (socket says 172.21.15.146:33028) 2023-10-06T11:12:29.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.122+0000 7fd764bef700 1 -- 172.21.15.146:0/1069604180 learned_addr learned my addr 172.21.15.146:0/1069604180 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:29.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.122+0000 7fd75f7fe700 1 --2- 172.21.15.146:0/1069604180 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623f8b879e0 0x5623f8bce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:29.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.122+0000 7fd764bef700 1 -- 172.21.15.146:0/1069604180 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5623f8b85c10 msgr2=0x5623f8bc9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:29.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.122+0000 7fd75ffff700 1 --2- 172.21.15.146:0/1069604180 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5623f8b85c10 0x5623f8bc9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:29.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.122+0000 7fd764bef700 1 --2- 172.21.15.146:0/1069604180 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5623f8b85c10 0x5623f8bc9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:29.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.122+0000 7fd764bef700 1 -- 172.21.15.146:0/1069604180 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623f8b879e0 msgr2=0x5623f8bce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:29.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.122+0000 7fd764bef700 1 --2- 172.21.15.146:0/1069604180 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623f8b879e0 0x5623f8bce080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:29.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.122+0000 7fd764bef700 1 -- 172.21.15.146:0/1069604180 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623f8aa37c0 con 0x5623f8bcbad0 2023-10-06T11:12:29.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.122+0000 7fd75f7fe700 1 --2- 172.21.15.146:0/1069604180 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623f8b879e0 0x5623f8bce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:12:29.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.122+0000 7fd75ffff700 1 --2- 172.21.15.146:0/1069604180 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5623f8b85c10 0x5623f8bc9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:12:29.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.122+0000 7fd764bef700 1 --2- 172.21.15.146:0/1069604180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5623f8bcbad0 0x5623f8b80790 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fd758010010 tx=0x7fd758020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e2984b0d6e94b88 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:29.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.122+0000 7fd745ffb700 1 -- 172.21.15.146:0/1069604180 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7580299d0 con 0x5623f8bcbad0 2023-10-06T11:12:29.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.122+0000 7fd745ffb700 1 -- 172.21.15.146:0/1069604180 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75800c440 con 0x5623f8bcbad0 2023-10-06T11:12:29.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.122+0000 7fd745ffb700 1 -- 172.21.15.146:0/1069604180 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75800aa20 con 0x5623f8bcbad0 2023-10-06T11:12:29.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.123+0000 7fd76f94ab80 1 -- 172.21.15.146:0/1069604180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5623f8bcbad0 msgr2=0x5623f8b80790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:29.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.123+0000 7fd76f94ab80 1 --2- 172.21.15.146:0/1069604180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5623f8bcbad0 0x5623f8b80790 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fd758010010 tx=0x7fd758020000 comp rx=0 tx=0).stop 2023-10-06T11:12:29.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.123+0000 7fd76f94ab80 1 -- 172.21.15.146:0/1069604180 shutdown_connections 2023-10-06T11:12:29.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.123+0000 7fd76f94ab80 1 --2- 172.21.15.146:0/1069604180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5623f8bcbad0 0x5623f8b80790 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:29.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.123+0000 7fd76f94ab80 1 --2- 172.21.15.146:0/1069604180 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5623f8b85c10 0x5623f8bc9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:29.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.123+0000 7fd76f94ab80 1 --2- 172.21.15.146:0/1069604180 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623f8b879e0 0x5623f8bce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:29.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.123+0000 7fd76f94ab80 1 -- 172.21.15.146:0/1069604180 >> 172.21.15.146:0/1069604180 conn(0x5623f8b860b0 msgr2=0x5623f8bab5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:29.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.123+0000 7fd76f94ab80 1 -- 172.21.15.146:0/1069604180 shutdown_connections 2023-10-06T11:12:29.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.123+0000 7fd76f94ab80 1 -- 172.21.15.146:0/1069604180 wait complete. 2023-10-06T11:12:29.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.123+0000 7fd76f94ab80 1 -- start start 2023-10-06T11:12:29.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.123+0000 7fd76f94ab80 1 Processor -- start 2023-10-06T11:12:29.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.124+0000 7fd76f94ab80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5623f8b85c10 0x5623f8bc7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:29.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.124+0000 7fd76f94ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623f8b879e0 0x5623f8c2cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:29.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.124+0000 7fd76f94ab80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5623f8bcbad0 0x5623f8b800b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:29.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.124+0000 7fd76f94ab80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623f8c307c0 con 0x5623f8b85c10 2023-10-06T11:12:29.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.124+0000 7fd76f94ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623f8bc8510 con 0x5623f8b879e0 2023-10-06T11:12:29.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.124+0000 7fd76f94ab80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5623f8b7f8b0 con 0x5623f8bcbad0 2023-10-06T11:12:29.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.124+0000 7fd76f94ab80 10 client.0 _ll_register_callbacks cb 0x5623f8971f70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:12:29.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.124+0000 7fd75ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5623f8b85c10 0x5623f8bc7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:29.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.124+0000 7fd75ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5623f8b85c10 0x5623f8bc7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33042/0 (socket says 172.21.15.146:33042) 2023-10-06T11:12:29.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.124+0000 7fd75ffff700 1 -- 172.21.15.146:0/3256492277 learned_addr learned my addr 172.21.15.146:0/3256492277 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:29.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.124+0000 7fd75ffff700 1 -- 172.21.15.146:0/3256492277 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5623f8bcbad0 msgr2=0x5623f8b800b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:29.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.124+0000 7fd75ffff700 1 --2- 172.21.15.146:0/3256492277 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5623f8bcbad0 0x5623f8b800b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:29.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.124+0000 7fd75ffff700 1 -- 172.21.15.146:0/3256492277 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623f8b879e0 msgr2=0x5623f8c2cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:29.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.124+0000 7fd75ffff700 1 --2- 172.21.15.146:0/3256492277 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623f8b879e0 0x5623f8c2cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:29.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.125+0000 7fd75ffff700 1 -- 172.21.15.146:0/3256492277 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5623f8912020 con 0x5623f8b85c10 2023-10-06T11:12:29.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.125+0000 7fd75ffff700 1 --2- 172.21.15.146:0/3256492277 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5623f8b85c10 0x5623f8bc7fd0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fd7500513f0 tx=0x7fd750069040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf0c3bdf1c31dd9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:29.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.125+0000 7fd73e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:12:29.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.125+0000 7fd73e7fc700 1 -- 172.21.15.146:0/3256492277 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd750011e80 con 0x5623f8b85c10 2023-10-06T11:12:29.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.125+0000 7fd73e7fc700 1 -- 172.21.15.146:0/3256492277 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(77..77 src has 1..77) v4 ==== 6086+0+0 (secure 0 0 0) 0x7fd750053290 con 0x5623f8b85c10 2023-10-06T11:12:29.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.125+0000 7fd76f94ab80 1 -- 172.21.15.146:0/3256492277 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd75800c810 con 0x5623f8b85c10 2023-10-06T11:12:29.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.125+0000 7fd73e7fc700 1 -- 172.21.15.146:0/3256492277 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd750082170 con 0x5623f8b85c10 2023-10-06T11:12:29.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.125+0000 7fd76f94ab80 10 client.7074 fetch_fsmap learned FSMap version 77 2023-10-06T11:12:29.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.125+0000 7fd76f94ab80 1 -- 172.21.15.146:0/3256492277 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=2+}) v3 -- 0x5623f8a8a4b0 con 0x5623f8b85c10 2023-10-06T11:12:29.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.125+0000 7fd73e7fc700 1 -- 172.21.15.146:0/3256492277 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75800c810 con 0x5623f8b85c10 2023-10-06T11:12:29.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.125+0000 7fd73e7fc700 1 -- 172.21.15.146:0/3256492277 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 77) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd75000f260 con 0x5623f8b85c10 2023-10-06T11:12:29.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.125+0000 7fd76f94ab80 10 client.7074 fetch_fsmap finished waiting for FSMap version 77 2023-10-06T11:12:29.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.125+0000 7fd76f94ab80 10 client.7074 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.b 2023-10-06T11:12:29.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.125+0000 7fd76f94ab80 20 client.7074 populate_metadata read hostname 'smithi146' 2023-10-06T11:12:29.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.125+0000 7fd76f94ab80 1 --2- 172.21.15.146:0/3256492277 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x5623f8b80700 0x5623f8b845c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:29.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.125+0000 7fd76f94ab80 4 client.7074 mds_command: new command op to 6786 tid=0[{"prefix": "perf dump"}] 2023-10-06T11:12:29.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.125+0000 7fd76f94ab80 1 -- 172.21.15.146:0/3256492277 --> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] -- command(tid 0: {"prefix": "perf dump"}) v1 -- 0x5623f8a77e40 con 0x5623f8b80700 2023-10-06T11:12:29.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.125+0000 7fd75f7fe700 1 --2- 172.21.15.146:0/3256492277 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x5623f8b80700 0x5623f8b845c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:29.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.126+0000 7fd73e7fc700 10 client.7074 ms_handle_connect on v2:172.21.15.151:6833/3649668257 2023-10-06T11:12:29.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.126+0000 7fd75f7fe700 1 --2- 172.21.15.146:0/3256492277 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x5623f8b80700 0x5623f8b845c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9dab24322700bb5f server_cookie=23e5b80aed953aa7 in_seq=0 out_seq=0 2023-10-06T11:12:29.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.126+0000 7fd73e7fc700 1 -- 172.21.15.146:0/3256492277 <== mds.0 v2:172.21.15.151:6833/3649668257 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17056 (crc 0 0 0) 0x5623f8a77e40 con 0x5623f8b80700 2023-10-06T11:12:29.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.126+0000 7fd73e7fc700 10 client.7074 handle_command_reply: tid=0 2023-10-06T11:12:29.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.126+0000 7fd76f94ab80 1 client.7074 shutdown 2023-10-06T11:12:29.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.126+0000 7fd76f94ab80 1 -- 172.21.15.146:0/3256492277 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5623f8b85c10 msgr2=0x5623f8bc7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:29.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.126+0000 7fd76f94ab80 1 --2- 172.21.15.146:0/3256492277 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5623f8b85c10 0x5623f8bc7fd0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fd7500513f0 tx=0x7fd750069040 comp rx=0 tx=0).stop 2023-10-06T11:12:29.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.126+0000 7fd76f94ab80 1 -- 172.21.15.146:0/3256492277 shutdown_connections 2023-10-06T11:12:29.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.126+0000 7fd76f94ab80 1 --2- 172.21.15.146:0/3256492277 >> [v2:172.21.15.151:6833/3649668257,v1:172.21.15.151:6835/3649668257] conn(0x5623f8b80700 0x5623f8b845c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:29.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.126+0000 7fd76f94ab80 1 --2- 172.21.15.146:0/3256492277 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5623f8bcbad0 0x5623f8b800b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:29.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.126+0000 7fd73e7fc700 0 client.7074 ms_handle_reset on v2:172.21.15.151:6833/3649668257 2023-10-06T11:12:29.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.126+0000 7fd76f94ab80 1 --2- 172.21.15.146:0/3256492277 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5623f8b85c10 0x5623f8bc7fd0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:29.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.126+0000 7fd76f94ab80 1 --2- 172.21.15.146:0/3256492277 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623f8b879e0 0x5623f8c2cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:29.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.127+0000 7fd76f94ab80 1 -- 172.21.15.146:0/3256492277 >> 172.21.15.146:0/3256492277 conn(0x5623f8b860b0 msgr2=0x5623f8b817d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:29.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.127+0000 7fd76f94ab80 1 -- 172.21.15.146:0/3256492277 shutdown_connections 2023-10-06T11:12:29.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.127+0000 7fd76f94ab80 1 -- 172.21.15.146:0/3256492277 wait complete. 2023-10-06T11:12:29.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.127+0000 7fd76f94ab80 20 client.7074 trim_cache size 0 max 16384 2023-10-06T11:12:29.135 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:12:29.136 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-0": { 2023-10-06T11:12:29.136 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 6092, 2023-10-06T11:12:29.136 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 6092, 2023-10-06T11:12:29.136 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 2152872, 2023-10-06T11:12:29.136 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 23058365, 2023-10-06T11:12:29.136 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 17, 2023-10-06T11:12:29.136 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 6, 2023-10-06T11:12:29.136 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 0.340358686, 2023-10-06T11:12:29.136 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 0.140404131, 2023-10-06T11:12:29.136 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 0.067537772, 2023-10-06T11:12:29.136 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.112987243, 2023-10-06T11:12:29.137 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T11:12:29.137 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 6091, 2023-10-06T11:12:29.137 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 3.261792240, 2023-10-06T11:12:29.137 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000535510 2023-10-06T11:12:29.137 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.137 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2023-10-06T11:12:29.137 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 10, 2023-10-06T11:12:29.137 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000885, 2023-10-06T11:12:29.137 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000088 2023-10-06T11:12:29.137 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:12:29.137 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.137 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-1": { 2023-10-06T11:12:29.137 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 36116, 2023-10-06T11:12:29.138 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 62029, 2023-10-06T11:12:29.138 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 12276048, 2023-10-06T11:12:29.138 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 49094785, 2023-10-06T11:12:29.138 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 8, 2023-10-06T11:12:29.138 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 4, 2023-10-06T11:12:29.138 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 2.600109981, 2023-10-06T11:12:29.138 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 1.163004431, 2023-10-06T11:12:29.138 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 1.474029980, 2023-10-06T11:12:29.138 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.157313681, 2023-10-06T11:12:29.138 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T11:12:29.138 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 62028, 2023-10-06T11:12:29.138 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 2.167725580, 2023-10-06T11:12:29.139 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000034947 2023-10-06T11:12:29.139 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.139 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2023-10-06T11:12:29.139 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 88354, 2023-10-06T11:12:29.139 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.011715004, 2023-10-06T11:12:29.139 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000132 2023-10-06T11:12:29.139 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:12:29.139 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.139 INFO:teuthology.orchestra.run.smithi146.stdout: "AsyncMessenger::Worker-2": { 2023-10-06T11:12:29.139 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_messages": 6874, 2023-10-06T11:12:29.139 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages": 6857, 2023-10-06T11:12:29.139 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_recv_bytes": 2033213, 2023-10-06T11:12:29.139 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_bytes": 45827820, 2023-10-06T11:12:29.140 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_created_connections": 5, 2023-10-06T11:12:29.140 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_active_connections": 4, 2023-10-06T11:12:29.140 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_total_time": 0.416319975, 2023-10-06T11:12:29.140 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_send_time": 0.167930983, 2023-10-06T11:12:29.140 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_recv_time": 0.093483049, 2023-10-06T11:12:29.140 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_running_fast_dispatch_time": 0.133821732, 2023-10-06T11:12:29.140 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T11:12:29.140 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 6856, 2023-10-06T11:12:29.140 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 2.412254519, 2023-10-06T11:12:29.141 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000351845 2023-10-06T11:12:29.141 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.141 INFO:teuthology.orchestra.run.smithi146.stdout: "msgr_handle_ack_lat": { 2023-10-06T11:12:29.141 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:12:29.141 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:12:29.141 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:12:29.141 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:12:29.141 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.141 INFO:teuthology.orchestra.run.smithi146.stdout: "cct": { 2023-10-06T11:12:29.141 INFO:teuthology.orchestra.run.smithi146.stdout: "total_workers": 1, 2023-10-06T11:12:29.141 INFO:teuthology.orchestra.run.smithi146.stdout: "unhealthy_workers": 0 2023-10-06T11:12:29.141 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.142 INFO:teuthology.orchestra.run.smithi146.stdout: "finisher-MDSRank": { 2023-10-06T11:12:29.142 INFO:teuthology.orchestra.run.smithi146.stdout: "queue_len": 0, 2023-10-06T11:12:29.142 INFO:teuthology.orchestra.run.smithi146.stdout: "complete_latency": { 2023-10-06T11:12:29.142 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 10231, 2023-10-06T11:12:29.142 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 15.507321967, 2023-10-06T11:12:29.142 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.001515719 2023-10-06T11:12:29.142 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:12:29.142 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.142 INFO:teuthology.orchestra.run.smithi146.stdout: "finisher-PurgeQueue": { 2023-10-06T11:12:29.142 INFO:teuthology.orchestra.run.smithi146.stdout: "queue_len": 0, 2023-10-06T11:12:29.142 INFO:teuthology.orchestra.run.smithi146.stdout: "complete_latency": { 2023-10-06T11:12:29.142 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 3959, 2023-10-06T11:12:29.142 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.736957845, 2023-10-06T11:12:29.143 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000186147 2023-10-06T11:12:29.143 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:12:29.143 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.143 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": { 2023-10-06T11:12:29.143 INFO:teuthology.orchestra.run.smithi146.stdout: "request": 30607, 2023-10-06T11:12:29.143 INFO:teuthology.orchestra.run.smithi146.stdout: "reply": 30607, 2023-10-06T11:12:29.143 INFO:teuthology.orchestra.run.smithi146.stdout: "reply_latency": { 2023-10-06T11:12:29.143 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 30607, 2023-10-06T11:12:29.143 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 493.182685634, 2023-10-06T11:12:29.143 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.016113395 2023-10-06T11:12:29.143 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.143 INFO:teuthology.orchestra.run.smithi146.stdout: "slow_reply": 0, 2023-10-06T11:12:29.144 INFO:teuthology.orchestra.run.smithi146.stdout: "forward": 0, 2023-10-06T11:12:29.144 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_fetch": 0, 2023-10-06T11:12:29.144 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_commit": 60, 2023-10-06T11:12:29.144 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_split": 0, 2023-10-06T11:12:29.144 INFO:teuthology.orchestra.run.smithi146.stdout: "dir_merge": 0, 2023-10-06T11:12:29.144 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes": 7693, 2023-10-06T11:12:29.144 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_top": 5377, 2023-10-06T11:12:29.144 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_bottom": 2316, 2023-10-06T11:12:29.144 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_pin_tail": 0, 2023-10-06T11:12:29.144 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_pinned": 11, 2023-10-06T11:12:29.144 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_expired": 8000, 2023-10-06T11:12:29.144 INFO:teuthology.orchestra.run.smithi146.stdout: "inodes_with_caps": 2, 2023-10-06T11:12:29.145 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": 2, 2023-10-06T11:12:29.145 INFO:teuthology.orchestra.run.smithi146.stdout: "subtrees": 2, 2023-10-06T11:12:29.145 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse": 58181, 2023-10-06T11:12:29.145 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_hit": 56080, 2023-10-06T11:12:29.145 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_forward": 0, 2023-10-06T11:12:29.145 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_discover": 0, 2023-10-06T11:12:29.145 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_dir_fetch": 0, 2023-10-06T11:12:29.145 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_remote_ino": 0, 2023-10-06T11:12:29.145 INFO:teuthology.orchestra.run.smithi146.stdout: "traverse_lock": 1995, 2023-10-06T11:12:29.145 INFO:teuthology.orchestra.run.smithi146.stdout: "load_cent": 25047, 2023-10-06T11:12:29.145 INFO:teuthology.orchestra.run.smithi146.stdout: "q": 0, 2023-10-06T11:12:29.145 INFO:teuthology.orchestra.run.smithi146.stdout: "exported": 0, 2023-10-06T11:12:29.145 INFO:teuthology.orchestra.run.smithi146.stdout: "exported_inodes": 0, 2023-10-06T11:12:29.146 INFO:teuthology.orchestra.run.smithi146.stdout: "imported": 0, 2023-10-06T11:12:29.146 INFO:teuthology.orchestra.run.smithi146.stdout: "imported_inodes": 0, 2023-10-06T11:12:29.146 INFO:teuthology.orchestra.run.smithi146.stdout: "openino_dir_fetch": 0, 2023-10-06T11:12:29.146 INFO:teuthology.orchestra.run.smithi146.stdout: "openino_backtrace_fetch": 2011, 2023-10-06T11:12:29.146 INFO:teuthology.orchestra.run.smithi146.stdout: "openino_peer_discover": 0, 2023-10-06T11:12:29.146 INFO:teuthology.orchestra.run.smithi146.stdout: "root_rfiles": 0, 2023-10-06T11:12:29.146 INFO:teuthology.orchestra.run.smithi146.stdout: "root_rbytes": 0, 2023-10-06T11:12:29.146 INFO:teuthology.orchestra.run.smithi146.stdout: "root_rsnaps": 0, 2023-10-06T11:12:29.146 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_backtrace_fetch": 2011, 2023-10-06T11:12:29.146 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_set_tag": 0, 2023-10-06T11:12:29.146 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_backtrace_repaired": 0, 2023-10-06T11:12:29.146 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_inotable_repaired": 0, 2023-10-06T11:12:29.147 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_dir_inodes": 11, 2023-10-06T11:12:29.147 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_dir_base_inodes": 1, 2023-10-06T11:12:29.147 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_dirfrag_rstats": 10, 2023-10-06T11:12:29.147 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_file_inodes": 2000, 2023-10-06T11:12:29.147 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_inode_file_caps": 0, 2023-10-06T11:12:29.147 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_revoke": 6140, 2023-10-06T11:12:29.147 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_grant": 6011, 2023-10-06T11:12:29.147 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_trunc": 0, 2023-10-06T11:12:29.147 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-10-06T11:12:29.147 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_cap_op_flush_ack": 0, 2023-10-06T11:12:29.147 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_caps": 6139, 2023-10-06T11:12:29.147 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_caps_dirty": 2000, 2023-10-06T11:12:29.147 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_cap_release": 28, 2023-10-06T11:12:29.148 INFO:teuthology.orchestra.run.smithi146.stdout: "process_request_cap_release": 17828 2023-10-06T11:12:29.148 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.148 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_cache": { 2023-10-06T11:12:29.148 INFO:teuthology.orchestra.run.smithi146.stdout: "num_strays": 0, 2023-10-06T11:12:29.148 INFO:teuthology.orchestra.run.smithi146.stdout: "num_strays_delayed": 0, 2023-10-06T11:12:29.148 INFO:teuthology.orchestra.run.smithi146.stdout: "num_strays_enqueuing": 0, 2023-10-06T11:12:29.148 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_created": 4255, 2023-10-06T11:12:29.148 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_enqueued": 3475, 2023-10-06T11:12:29.148 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_reintegrated": 4577, 2023-10-06T11:12:29.148 INFO:teuthology.orchestra.run.smithi146.stdout: "strays_migrated": 0, 2023-10-06T11:12:29.148 INFO:teuthology.orchestra.run.smithi146.stdout: "num_recovering_processing": 0, 2023-10-06T11:12:29.148 INFO:teuthology.orchestra.run.smithi146.stdout: "num_recovering_enqueued": 0, 2023-10-06T11:12:29.148 INFO:teuthology.orchestra.run.smithi146.stdout: "num_recovering_prioritized": 0, 2023-10-06T11:12:29.149 INFO:teuthology.orchestra.run.smithi146.stdout: "recovery_started": 0, 2023-10-06T11:12:29.149 INFO:teuthology.orchestra.run.smithi146.stdout: "recovery_completed": 0, 2023-10-06T11:12:29.149 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_enqueue_scrub": 1, 2023-10-06T11:12:29.149 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_exportdir": 0, 2023-10-06T11:12:29.149 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_flush": 0, 2023-10-06T11:12:29.149 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_fragmentdir": 0, 2023-10-06T11:12:29.149 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_fragstats": 0, 2023-10-06T11:12:29.149 INFO:teuthology.orchestra.run.smithi146.stdout: "ireq_inodestats": 0 2023-10-06T11:12:29.149 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.149 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_log": { 2023-10-06T11:12:29.149 INFO:teuthology.orchestra.run.smithi146.stdout: "evadd": 23801, 2023-10-06T11:12:29.149 INFO:teuthology.orchestra.run.smithi146.stdout: "evex": 22984, 2023-10-06T11:12:29.149 INFO:teuthology.orchestra.run.smithi146.stdout: "evtrm": 22984, 2023-10-06T11:12:29.150 INFO:teuthology.orchestra.run.smithi146.stdout: "ev": 1841, 2023-10-06T11:12:29.150 INFO:teuthology.orchestra.run.smithi146.stdout: "evexg": 0, 2023-10-06T11:12:29.150 INFO:teuthology.orchestra.run.smithi146.stdout: "evexd": 1024, 2023-10-06T11:12:29.150 INFO:teuthology.orchestra.run.smithi146.stdout: "segadd": 28, 2023-10-06T11:12:29.150 INFO:teuthology.orchestra.run.smithi146.stdout: "segex": 27, 2023-10-06T11:12:29.150 INFO:teuthology.orchestra.run.smithi146.stdout: "segtrm": 27, 2023-10-06T11:12:29.150 INFO:teuthology.orchestra.run.smithi146.stdout: "seg": 2, 2023-10-06T11:12:29.150 INFO:teuthology.orchestra.run.smithi146.stdout: "segexg": 0, 2023-10-06T11:12:29.150 INFO:teuthology.orchestra.run.smithi146.stdout: "segexd": 1, 2023-10-06T11:12:29.150 INFO:teuthology.orchestra.run.smithi146.stdout: "expos": 79072753, 2023-10-06T11:12:29.150 INFO:teuthology.orchestra.run.smithi146.stdout: "wrpos": 79564942, 2023-10-06T11:12:29.150 INFO:teuthology.orchestra.run.smithi146.stdout: "rdpos": 0, 2023-10-06T11:12:29.151 INFO:teuthology.orchestra.run.smithi146.stdout: "jlat": { 2023-10-06T11:12:29.151 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 6586, 2023-10-06T11:12:29.151 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 87.414667866, 2023-10-06T11:12:29.151 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.013272801 2023-10-06T11:12:29.151 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.151 INFO:teuthology.orchestra.run.smithi146.stdout: "replayed": 0 2023-10-06T11:12:29.151 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.151 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_mem": { 2023-10-06T11:12:29.151 INFO:teuthology.orchestra.run.smithi146.stdout: "ino": 14, 2023-10-06T11:12:29.151 INFO:teuthology.orchestra.run.smithi146.stdout: "ino+": 2015, 2023-10-06T11:12:29.151 INFO:teuthology.orchestra.run.smithi146.stdout: "ino-": 2001, 2023-10-06T11:12:29.151 INFO:teuthology.orchestra.run.smithi146.stdout: "dir": 13, 2023-10-06T11:12:29.152 INFO:teuthology.orchestra.run.smithi146.stdout: "dir+": 13, 2023-10-06T11:12:29.152 INFO:teuthology.orchestra.run.smithi146.stdout: "dir-": 0, 2023-10-06T11:12:29.152 INFO:teuthology.orchestra.run.smithi146.stdout: "dn": 8094, 2023-10-06T11:12:29.152 INFO:teuthology.orchestra.run.smithi146.stdout: "dn+": 20013, 2023-10-06T11:12:29.152 INFO:teuthology.orchestra.run.smithi146.stdout: "dn-": 11919, 2023-10-06T11:12:29.152 INFO:teuthology.orchestra.run.smithi146.stdout: "cap": 2, 2023-10-06T11:12:29.152 INFO:teuthology.orchestra.run.smithi146.stdout: "cap+": 2002, 2023-10-06T11:12:29.152 INFO:teuthology.orchestra.run.smithi146.stdout: "cap-": 2000, 2023-10-06T11:12:29.152 INFO:teuthology.orchestra.run.smithi146.stdout: "rss": 82640, 2023-10-06T11:12:29.152 INFO:teuthology.orchestra.run.smithi146.stdout: "heap": 207104 2023-10-06T11:12:29.152 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.152 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_server": { 2023-10-06T11:12:29.152 INFO:teuthology.orchestra.run.smithi146.stdout: "dispatch_client_request": 43775, 2023-10-06T11:12:29.153 INFO:teuthology.orchestra.run.smithi146.stdout: "dispatch_server_request": 0, 2023-10-06T11:12:29.153 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_request": 30607, 2023-10-06T11:12:29.153 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_client_session": 7, 2023-10-06T11:12:29.153 INFO:teuthology.orchestra.run.smithi146.stdout: "handle_peer_request": 0, 2023-10-06T11:12:29.153 INFO:teuthology.orchestra.run.smithi146.stdout: "req_create_latency": { 2023-10-06T11:12:29.153 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 2000, 2023-10-06T11:12:29.153 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 1.433329103, 2023-10-06T11:12:29.153 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000716664 2023-10-06T11:12:29.153 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.153 INFO:teuthology.orchestra.run.smithi146.stdout: "req_getattr_latency": { 2023-10-06T11:12:29.153 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 2005, 2023-10-06T11:12:29.153 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.707210869, 2023-10-06T11:12:29.154 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000352723 2023-10-06T11:12:29.154 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.154 INFO:teuthology.orchestra.run.smithi146.stdout: "req_getfilelock_latency": { 2023-10-06T11:12:29.154 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:12:29.154 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:12:29.154 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:12:29.154 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.154 INFO:teuthology.orchestra.run.smithi146.stdout: "req_link_latency": { 2023-10-06T11:12:29.154 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 6000, 2023-10-06T11:12:29.154 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 10.710688550, 2023-10-06T11:12:29.154 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.001785114 2023-10-06T11:12:29.154 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.154 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookup_latency": { 2023-10-06T11:12:29.155 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 8012, 2023-10-06T11:12:29.155 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 3.683452226, 2023-10-06T11:12:29.155 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000459741 2023-10-06T11:12:29.155 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.155 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookuphash_latency": { 2023-10-06T11:12:29.155 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:12:29.155 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:12:29.155 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:12:29.155 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.155 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupino_latency": { 2023-10-06T11:12:29.155 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:12:29.155 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:12:29.156 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:12:29.156 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.156 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupname_latency": { 2023-10-06T11:12:29.156 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:12:29.156 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:12:29.156 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:12:29.156 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.156 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupparent_latency": { 2023-10-06T11:12:29.156 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:12:29.156 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:12:29.156 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:12:29.156 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.156 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lookupsnap_latency": { 2023-10-06T11:12:29.157 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 3, 2023-10-06T11:12:29.157 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.006044575, 2023-10-06T11:12:29.157 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.002014858 2023-10-06T11:12:29.157 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.157 INFO:teuthology.orchestra.run.smithi146.stdout: "req_lssnap_latency": { 2023-10-06T11:12:29.157 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:12:29.157 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:12:29.157 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:12:29.157 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.157 INFO:teuthology.orchestra.run.smithi146.stdout: "req_mkdir_latency": { 2023-10-06T11:12:29.157 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1, 2023-10-06T11:12:29.157 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.003083825, 2023-10-06T11:12:29.158 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.003083825 2023-10-06T11:12:29.158 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.158 INFO:teuthology.orchestra.run.smithi146.stdout: "req_mknod_latency": { 2023-10-06T11:12:29.158 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:12:29.158 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:12:29.158 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:12:29.158 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.158 INFO:teuthology.orchestra.run.smithi146.stdout: "req_mksnap_latency": { 2023-10-06T11:12:29.158 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1, 2023-10-06T11:12:29.158 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.004839247, 2023-10-06T11:12:29.158 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.004839247 2023-10-06T11:12:29.158 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.158 INFO:teuthology.orchestra.run.smithi146.stdout: "req_open_latency": { 2023-10-06T11:12:29.159 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:12:29.159 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:12:29.159 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:12:29.159 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.159 INFO:teuthology.orchestra.run.smithi146.stdout: "req_readdir_latency": { 2023-10-06T11:12:29.159 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 6, 2023-10-06T11:12:29.159 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.097046138, 2023-10-06T11:12:29.159 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.016174356 2023-10-06T11:12:29.159 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.159 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rename_latency": { 2023-10-06T11:12:29.159 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 4577, 2023-10-06T11:12:29.159 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 454.633936611, 2023-10-06T11:12:29.160 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.099330115 2023-10-06T11:12:29.160 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.160 INFO:teuthology.orchestra.run.smithi146.stdout: "req_renamesnap_latency": { 2023-10-06T11:12:29.160 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:12:29.160 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:12:29.160 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:12:29.160 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.160 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rmdir_latency": { 2023-10-06T11:12:29.160 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:12:29.160 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:12:29.160 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:12:29.160 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.160 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rmsnap_latency": { 2023-10-06T11:12:29.161 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1, 2023-10-06T11:12:29.161 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.004876004, 2023-10-06T11:12:29.161 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.004876004 2023-10-06T11:12:29.161 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.161 INFO:teuthology.orchestra.run.smithi146.stdout: "req_rmxattr_latency": { 2023-10-06T11:12:29.161 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:12:29.161 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:12:29.161 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:12:29.161 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.161 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setattr_latency": { 2023-10-06T11:12:29.161 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 1, 2023-10-06T11:12:29.161 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000295216, 2023-10-06T11:12:29.162 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000295216 2023-10-06T11:12:29.162 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.162 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setdirlayout_latency": { 2023-10-06T11:12:29.162 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:12:29.162 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:12:29.162 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:12:29.162 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.162 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setfilelock_latency": { 2023-10-06T11:12:29.162 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:12:29.162 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:12:29.162 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:12:29.162 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.163 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setlayout_latency": { 2023-10-06T11:12:29.163 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:12:29.163 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:12:29.163 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:12:29.163 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.163 INFO:teuthology.orchestra.run.smithi146.stdout: "req_setxattr_latency": { 2023-10-06T11:12:29.163 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:12:29.163 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:12:29.163 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:12:29.163 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.163 INFO:teuthology.orchestra.run.smithi146.stdout: "req_symlink_latency": { 2023-10-06T11:12:29.163 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:12:29.164 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:12:29.164 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:12:29.164 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.164 INFO:teuthology.orchestra.run.smithi146.stdout: "req_unlink_latency": { 2023-10-06T11:12:29.164 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 8000, 2023-10-06T11:12:29.164 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 21.897883270, 2023-10-06T11:12:29.164 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.002737235 2023-10-06T11:12:29.164 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.164 INFO:teuthology.orchestra.run.smithi146.stdout: "cap_revoke_eviction": 0, 2023-10-06T11:12:29.164 INFO:teuthology.orchestra.run.smithi146.stdout: "cap_acquisition_throttle": 0, 2023-10-06T11:12:29.164 INFO:teuthology.orchestra.run.smithi146.stdout: "req_getvxattr_latency": { 2023-10-06T11:12:29.164 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:12:29.164 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:12:29.165 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:12:29.165 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:12:29.165 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.165 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_sessions": { 2023-10-06T11:12:29.165 INFO:teuthology.orchestra.run.smithi146.stdout: "session_count": 1, 2023-10-06T11:12:29.165 INFO:teuthology.orchestra.run.smithi146.stdout: "session_add": 1, 2023-10-06T11:12:29.165 INFO:teuthology.orchestra.run.smithi146.stdout: "session_remove": 0, 2023-10-06T11:12:29.165 INFO:teuthology.orchestra.run.smithi146.stdout: "sessions_open": 1, 2023-10-06T11:12:29.165 INFO:teuthology.orchestra.run.smithi146.stdout: "sessions_stale": 0, 2023-10-06T11:12:29.165 INFO:teuthology.orchestra.run.smithi146.stdout: "total_load": 18757, 2023-10-06T11:12:29.165 INFO:teuthology.orchestra.run.smithi146.stdout: "average_load": 18757, 2023-10-06T11:12:29.165 INFO:teuthology.orchestra.run.smithi146.stdout: "avg_session_uptime": 97 2023-10-06T11:12:29.165 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.166 INFO:teuthology.orchestra.run.smithi146.stdout: "mempool": { 2023-10-06T11:12:29.166 INFO:teuthology.orchestra.run.smithi146.stdout: "bloom_filter_bytes": 19081, 2023-10-06T11:12:29.166 INFO:teuthology.orchestra.run.smithi146.stdout: "bloom_filter_items": 19081, 2023-10-06T11:12:29.166 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_alloc_bytes": 0, 2023-10-06T11:12:29.166 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_alloc_items": 0, 2023-10-06T11:12:29.166 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_data_bytes": 0, 2023-10-06T11:12:29.166 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_data_items": 0, 2023-10-06T11:12:29.166 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-06T11:12:29.166 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_onode_items": 0, 2023-10-06T11:12:29.166 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-06T11:12:29.166 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_meta_items": 0, 2023-10-06T11:12:29.166 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_other_bytes": 0, 2023-10-06T11:12:29.167 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_cache_other_items": 0, 2023-10-06T11:12:29.167 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_Buffer_bytes": 0, 2023-10-06T11:12:29.167 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_Buffer_items": 0, 2023-10-06T11:12:29.167 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_Extent_bytes": 0, 2023-10-06T11:12:29.167 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_Extent_items": 0, 2023-10-06T11:12:29.167 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_Blob_bytes": 0, 2023-10-06T11:12:29.167 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_Blob_items": 0, 2023-10-06T11:12:29.167 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_SharedBlob_bytes": 0, 2023-10-06T11:12:29.167 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_SharedBlob_items": 0, 2023-10-06T11:12:29.167 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-06T11:12:29.167 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_inline_bl_items": 0, 2023-10-06T11:12:29.167 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_fsck_bytes": 0, 2023-10-06T11:12:29.167 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_fsck_items": 0, 2023-10-06T11:12:29.168 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_txc_bytes": 0, 2023-10-06T11:12:29.168 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_txc_items": 0, 2023-10-06T11:12:29.168 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-06T11:12:29.168 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_deferred_items": 0, 2023-10-06T11:12:29.168 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_bytes": 0, 2023-10-06T11:12:29.168 INFO:teuthology.orchestra.run.smithi146.stdout: "bluestore_writing_items": 0, 2023-10-06T11:12:29.168 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_bytes": 0, 2023-10-06T11:12:29.168 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_items": 0, 2023-10-06T11:12:29.168 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_reader_bytes": 0, 2023-10-06T11:12:29.168 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_reader_items": 0, 2023-10-06T11:12:29.168 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_writer_bytes": 0, 2023-10-06T11:12:29.168 INFO:teuthology.orchestra.run.smithi146.stdout: "bluefs_file_writer_items": 0, 2023-10-06T11:12:29.168 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_anon_bytes": 234566, 2023-10-06T11:12:29.169 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_anon_items": 82, 2023-10-06T11:12:29.169 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_meta_bytes": 0, 2023-10-06T11:12:29.169 INFO:teuthology.orchestra.run.smithi146.stdout: "buffer_meta_items": 0, 2023-10-06T11:12:29.169 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_bytes": 0, 2023-10-06T11:12:29.169 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_items": 0, 2023-10-06T11:12:29.169 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_mapbl_bytes": 0, 2023-10-06T11:12:29.169 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_mapbl_items": 0, 2023-10-06T11:12:29.169 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_pglog_bytes": 0, 2023-10-06T11:12:29.169 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_pglog_items": 0, 2023-10-06T11:12:29.169 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_bytes": 6208, 2023-10-06T11:12:29.169 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_items": 80, 2023-10-06T11:12:29.169 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_mapping_bytes": 0, 2023-10-06T11:12:29.170 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_mapping_items": 0, 2023-10-06T11:12:29.170 INFO:teuthology.orchestra.run.smithi146.stdout: "pgmap_bytes": 0, 2023-10-06T11:12:29.170 INFO:teuthology.orchestra.run.smithi146.stdout: "pgmap_items": 0, 2023-10-06T11:12:29.170 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_co_bytes": 6034321, 2023-10-06T11:12:29.170 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_co_items": 307317, 2023-10-06T11:12:29.170 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_1_bytes": 0, 2023-10-06T11:12:29.170 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_1_items": 0, 2023-10-06T11:12:29.170 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_2_bytes": 0, 2023-10-06T11:12:29.170 INFO:teuthology.orchestra.run.smithi146.stdout: "unittest_2_items": 0 2023-10-06T11:12:29.170 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.170 INFO:teuthology.orchestra.run.smithi146.stdout: "objecter": { 2023-10-06T11:12:29.170 INFO:teuthology.orchestra.run.smithi146.stdout: "op_active": 0, 2023-10-06T11:12:29.170 INFO:teuthology.orchestra.run.smithi146.stdout: "op_laggy": 0, 2023-10-06T11:12:29.171 INFO:teuthology.orchestra.run.smithi146.stdout: "op_send": 16659, 2023-10-06T11:12:29.171 INFO:teuthology.orchestra.run.smithi146.stdout: "op_send_bytes": 85596326, 2023-10-06T11:12:29.171 INFO:teuthology.orchestra.run.smithi146.stdout: "op_resend": 37, 2023-10-06T11:12:29.171 INFO:teuthology.orchestra.run.smithi146.stdout: "op_reply": 16659, 2023-10-06T11:12:29.171 INFO:teuthology.orchestra.run.smithi146.stdout: "oplen_avg": { 2023-10-06T11:12:29.171 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 16659, 2023-10-06T11:12:29.171 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 25288 2023-10-06T11:12:29.171 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.171 INFO:teuthology.orchestra.run.smithi146.stdout: "op": 16659, 2023-10-06T11:12:29.171 INFO:teuthology.orchestra.run.smithi146.stdout: "op_r": 2082, 2023-10-06T11:12:29.171 INFO:teuthology.orchestra.run.smithi146.stdout: "op_w": 14577, 2023-10-06T11:12:29.171 INFO:teuthology.orchestra.run.smithi146.stdout: "op_rmw": 0, 2023-10-06T11:12:29.172 INFO:teuthology.orchestra.run.smithi146.stdout: "op_pg": 0, 2023-10-06T11:12:29.172 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_stat": 47, 2023-10-06T11:12:29.172 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_create": 4244, 2023-10-06T11:12:29.172 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_read": 70, 2023-10-06T11:12:29.172 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_write": 6655, 2023-10-06T11:12:29.172 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_writefull": 65, 2023-10-06T11:12:29.172 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_writesame": 0, 2023-10-06T11:12:29.172 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_append": 0, 2023-10-06T11:12:29.172 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_zero": 1475, 2023-10-06T11:12:29.172 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_truncate": 0, 2023-10-06T11:12:29.172 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_delete": 2046, 2023-10-06T11:12:29.172 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_mapext": 0, 2023-10-06T11:12:29.172 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_sparse_read": 0, 2023-10-06T11:12:29.173 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_clonerange": 0, 2023-10-06T11:12:29.173 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_getxattr": 2012, 2023-10-06T11:12:29.173 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_setxattr": 8488, 2023-10-06T11:12:29.173 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_cmpxattr": 0, 2023-10-06T11:12:29.173 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_rmxattr": 0, 2023-10-06T11:12:29.173 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_resetxattrs": 0, 2023-10-06T11:12:29.173 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_call": 0, 2023-10-06T11:12:29.173 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_watch": 0, 2023-10-06T11:12:29.173 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_notify": 0, 2023-10-06T11:12:29.173 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_src_cmpxattr": 0, 2023-10-06T11:12:29.173 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_pgls": 0, 2023-10-06T11:12:29.173 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_pgls_filter": 0, 2023-10-06T11:12:29.174 INFO:teuthology.orchestra.run.smithi146.stdout: "osdop_other": 0, 2023-10-06T11:12:29.174 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_active": 0, 2023-10-06T11:12:29.174 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_send": 0, 2023-10-06T11:12:29.174 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_resend": 0, 2023-10-06T11:12:29.174 INFO:teuthology.orchestra.run.smithi146.stdout: "linger_ping": 0, 2023-10-06T11:12:29.174 INFO:teuthology.orchestra.run.smithi146.stdout: "poolop_active": 0, 2023-10-06T11:12:29.174 INFO:teuthology.orchestra.run.smithi146.stdout: "poolop_send": 0, 2023-10-06T11:12:29.174 INFO:teuthology.orchestra.run.smithi146.stdout: "poolop_resend": 0, 2023-10-06T11:12:29.174 INFO:teuthology.orchestra.run.smithi146.stdout: "poolstat_active": 0, 2023-10-06T11:12:29.174 INFO:teuthology.orchestra.run.smithi146.stdout: "poolstat_send": 0, 2023-10-06T11:12:29.174 INFO:teuthology.orchestra.run.smithi146.stdout: "poolstat_resend": 0, 2023-10-06T11:12:29.174 INFO:teuthology.orchestra.run.smithi146.stdout: "statfs_active": 0, 2023-10-06T11:12:29.174 INFO:teuthology.orchestra.run.smithi146.stdout: "statfs_send": 0, 2023-10-06T11:12:29.175 INFO:teuthology.orchestra.run.smithi146.stdout: "statfs_resend": 0, 2023-10-06T11:12:29.175 INFO:teuthology.orchestra.run.smithi146.stdout: "command_active": 0, 2023-10-06T11:12:29.175 INFO:teuthology.orchestra.run.smithi146.stdout: "command_send": 0, 2023-10-06T11:12:29.175 INFO:teuthology.orchestra.run.smithi146.stdout: "command_resend": 0, 2023-10-06T11:12:29.175 INFO:teuthology.orchestra.run.smithi146.stdout: "map_epoch": 77, 2023-10-06T11:12:29.175 INFO:teuthology.orchestra.run.smithi146.stdout: "map_full": 0, 2023-10-06T11:12:29.175 INFO:teuthology.orchestra.run.smithi146.stdout: "map_inc": 3, 2023-10-06T11:12:29.175 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_sessions": 8, 2023-10-06T11:12:29.175 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_session_open": 8, 2023-10-06T11:12:29.175 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_session_close": 0, 2023-10-06T11:12:29.175 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_laggy": 0, 2023-10-06T11:12:29.175 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_wr": 146, 2023-10-06T11:12:29.176 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_rd": 0, 2023-10-06T11:12:29.176 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_del": 40 2023-10-06T11:12:29.176 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.176 INFO:teuthology.orchestra.run.smithi146.stdout: "oft": { 2023-10-06T11:12:29.176 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_objs": 1, 2023-10-06T11:12:29.176 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_kv_pairs": 0, 2023-10-06T11:12:29.176 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_updates": 0, 2023-10-06T11:12:29.176 INFO:teuthology.orchestra.run.smithi146.stdout: "omap_total_removes": 0 2023-10-06T11:12:29.176 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.176 INFO:teuthology.orchestra.run.smithi146.stdout: "purge_queue": { 2023-10-06T11:12:29.176 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing_ops": 0, 2023-10-06T11:12:29.176 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing_ops_high_water": 32, 2023-10-06T11:12:29.176 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing": 0, 2023-10-06T11:12:29.177 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executing_high_water": 32, 2023-10-06T11:12:29.177 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_executed": 3475, 2023-10-06T11:12:29.177 INFO:teuthology.orchestra.run.smithi146.stdout: "pq_item_in_journal": 0 2023-10-06T11:12:29.177 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.177 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-10-06T11:12:29.177 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2023-10-06T11:12:29.177 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 104857600, 2023-10-06T11:12:29.177 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2023-10-06T11:12:29.177 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 49077, 2023-10-06T11:12:29.177 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 12038828, 2023-10-06T11:12:29.177 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2023-10-06T11:12:29.177 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 49077, 2023-10-06T11:12:29.178 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2023-10-06T11:12:29.178 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2023-10-06T11:12:29.178 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 49077, 2023-10-06T11:12:29.178 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 12038828, 2023-10-06T11:12:29.178 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2023-10-06T11:12:29.178 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:12:29.178 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:12:29.178 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:12:29.178 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:12:29.178 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.178 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-objecter_bytes": { 2023-10-06T11:12:29.178 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2023-10-06T11:12:29.178 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 104857600, 2023-10-06T11:12:29.179 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2023-10-06T11:12:29.179 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 0, 2023-10-06T11:12:29.179 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 0, 2023-10-06T11:12:29.179 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2023-10-06T11:12:29.179 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 0, 2023-10-06T11:12:29.179 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 16659, 2023-10-06T11:12:29.179 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 85959101, 2023-10-06T11:12:29.179 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 16659, 2023-10-06T11:12:29.179 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 85959101, 2023-10-06T11:12:29.179 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2023-10-06T11:12:29.179 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:12:29.179 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:12:29.180 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:12:29.180 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:12:29.180 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.180 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-objecter_ops": { 2023-10-06T11:12:29.180 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2023-10-06T11:12:29.180 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 1024, 2023-10-06T11:12:29.180 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2023-10-06T11:12:29.180 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 0, 2023-10-06T11:12:29.180 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 0, 2023-10-06T11:12:29.180 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2023-10-06T11:12:29.180 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 0, 2023-10-06T11:12:29.180 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 16659, 2023-10-06T11:12:29.180 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 16659, 2023-10-06T11:12:29.181 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 16659, 2023-10-06T11:12:29.181 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 16659, 2023-10-06T11:12:29.181 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2023-10-06T11:12:29.181 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:12:29.181 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:12:29.181 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:12:29.181 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:12:29.181 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.181 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-write_buf_throttle": { 2023-10-06T11:12:29.181 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2023-10-06T11:12:29.181 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 3758096384, 2023-10-06T11:12:29.181 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2023-10-06T11:12:29.181 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 3475, 2023-10-06T11:12:29.182 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 362775, 2023-10-06T11:12:29.182 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2023-10-06T11:12:29.182 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 3475, 2023-10-06T11:12:29.182 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2023-10-06T11:12:29.182 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2023-10-06T11:12:29.182 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 69, 2023-10-06T11:12:29.182 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 362775, 2023-10-06T11:12:29.182 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2023-10-06T11:12:29.182 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:12:29.182 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:12:29.182 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:12:29.182 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:12:29.182 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:29.183 INFO:teuthology.orchestra.run.smithi146.stdout: "throttle-write_buf_throttle-0x55db6746be00": { 2023-10-06T11:12:29.183 INFO:teuthology.orchestra.run.smithi146.stdout: "val": 0, 2023-10-06T11:12:29.183 INFO:teuthology.orchestra.run.smithi146.stdout: "max": 3758096384, 2023-10-06T11:12:29.183 INFO:teuthology.orchestra.run.smithi146.stdout: "get_started": 0, 2023-10-06T11:12:29.183 INFO:teuthology.orchestra.run.smithi146.stdout: "get": 23801, 2023-10-06T11:12:29.183 INFO:teuthology.orchestra.run.smithi146.stdout: "get_sum": 75370638, 2023-10-06T11:12:29.183 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_fail": 0, 2023-10-06T11:12:29.183 INFO:teuthology.orchestra.run.smithi146.stdout: "get_or_fail_success": 23801, 2023-10-06T11:12:29.183 INFO:teuthology.orchestra.run.smithi146.stdout: "take": 0, 2023-10-06T11:12:29.183 INFO:teuthology.orchestra.run.smithi146.stdout: "take_sum": 0, 2023-10-06T11:12:29.183 INFO:teuthology.orchestra.run.smithi146.stdout: "put": 6586, 2023-10-06T11:12:29.183 INFO:teuthology.orchestra.run.smithi146.stdout: "put_sum": 75370638, 2023-10-06T11:12:29.184 INFO:teuthology.orchestra.run.smithi146.stdout: "wait": { 2023-10-06T11:12:29.184 INFO:teuthology.orchestra.run.smithi146.stdout: "avgcount": 0, 2023-10-06T11:12:29.184 INFO:teuthology.orchestra.run.smithi146.stdout: "sum": 0.000000000, 2023-10-06T11:12:29.184 INFO:teuthology.orchestra.run.smithi146.stdout: "avgtime": 0.000000000 2023-10-06T11:12:29.184 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:12:29.184 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:12:29.184 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:12:29.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.127+0000 7fd766652700 1 -- 172.21.15.146:0/1784943794 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd74c066f30 msgr2=0x7fd74c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:29.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.127+0000 7fd766652700 1 --2- 172.21.15.146:0/1784943794 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd74c066f30 0x7fd74c0693e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd7540099b0 tx=0x7fd754016000 comp rx=0 tx=0).stop 2023-10-06T11:12:29.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.127+0000 7fd766652700 1 -- 172.21.15.146:0/1784943794 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7600ae730 msgr2=0x7fd760156820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:29.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.127+0000 7fd766652700 1 --2- 172.21.15.146:0/1784943794 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7600ae730 0x7fd760156820 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fd75000c5b0 tx=0x7fd7500020e0 comp rx=0 tx=0).stop 2023-10-06T11:12:29.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.127+0000 7fd766652700 1 -- 172.21.15.146:0/1784943794 shutdown_connections 2023-10-06T11:12:29.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.127+0000 7fd766652700 1 --2- 172.21.15.146:0/1784943794 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd74c066f30 0x7fd74c0693e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:29.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.127+0000 7fd766652700 1 --2- 172.21.15.146:0/1784943794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd76015a160 0x7fd7600ca650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:29.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.127+0000 7fd766652700 1 --2- 172.21.15.146:0/1784943794 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd7600ae730 0x7fd760156820 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:29.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.127+0000 7fd766652700 1 --2- 172.21.15.146:0/1784943794 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd7600cb950 0x7fd7600ca110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:29.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.127+0000 7fd766652700 1 -- 172.21.15.146:0/1784943794 >> 172.21.15.146:0/1784943794 conn(0x7fd76006f380 msgr2=0x7fd760159560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:29.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.127+0000 7fd766652700 1 -- 172.21.15.146:0/1784943794 shutdown_connections 2023-10-06T11:12:29.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.127+0000 7fd766652700 1 -- 172.21.15.146:0/1784943794 wait complete. 2023-10-06T11:12:29.187 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T11:12:29.187 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:12:29.226 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:12:29.265 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T11:12:29.265 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi146.front.sepia.ceph.com... 2023-10-06T11:12:29.266 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T11:12:29.266 DEBUG:teuthology.orchestra.run.smithi146:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T11:12:29.298 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[121412]: fuse finished with error 0 and tester_r 0 2023-10-06T11:12:29.302 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-10-06T11:12:29.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:12:29.302 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T11:12:29.469 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-10-06T11:12:29.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:12:29.470 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T11:12:29.487 INFO:teuthology.orchestra.run.smithi151.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-06T11:12:29.488 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:12:29.488 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-10-06T11:12:29.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:12:29.488 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T11:12:29.525 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:12:29.525 INFO:teuthology.orchestra.run.smithi146.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-06T11:12:29.525 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-10-06T11:12:29.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:12:29.526 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T11:12:29.545 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:12:29.546 INFO:teuthology.orchestra.run.smithi151.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-06T11:12:29.546 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:12:29.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.680+0000 7fc9d759e700 1 Processor -- start 2023-10-06T11:12:29.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.680+0000 7fc9d759e700 1 -- start start 2023-10-06T11:12:29.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.681+0000 7fc9d759e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc9d815a7f0 0x7fc9d815cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:29.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.681+0000 7fc9d759e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9d815c630 con 0x7fc9d80b2530 2023-10-06T11:12:29.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.681+0000 7fc9d759e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9d815ba20 con 0x7fc9d815a420 2023-10-06T11:12:29.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.681+0000 7fc9d759e700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9d80ce040 con 0x7fc9d815a7f0 2023-10-06T11:12:29.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.681+0000 7fc9d6d9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc9d80b2530 0x7fc9d815acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55974/0 (socket says 172.21.15.146:55974) 2023-10-06T11:12:29.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.681+0000 7fc9d6d9d700 1 -- 172.21.15.146:0/3840853805 learned_addr learned my addr 172.21.15.146:0/3840853805 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:12:29.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.681+0000 7fc9d5d9b700 1 --2- 172.21.15.146:0/3840853805 >> v2:172.21.15.151:3300/0 conn(0x7fc9d815a7f0 0x7fc9d815cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:29.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.681+0000 7fc9d559a700 1 -- 172.21.15.146:0/3840853805 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4181409825 0 0) 0x7fc9d815c630 con 0x7fc9d80b2530 2023-10-06T11:12:29.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.681+0000 7fc9d559a700 1 -- 172.21.15.146:0/3840853805 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9c4003570 con 0x7fc9d80b2530 2023-10-06T11:12:29.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.681+0000 7fc9d5d9b700 1 -- 172.21.15.146:0/3840853805 >> v1:172.21.15.151:6789/0 conn(0x7fc9d815a420 legacy=0x7fc9d80b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:29.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.681+0000 7fc9d5d9b700 1 -- 172.21.15.146:0/3840853805 >> v1:172.21.15.146:6789/0 conn(0x7fc9d80b2530 legacy=0x7fc9d815acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:29.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.681+0000 7fc9d5d9b700 1 -- 172.21.15.146:0/3840853805 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d815bd00 con 0x7fc9d815a7f0 2023-10-06T11:12:29.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.682+0000 7fc9d5d9b700 1 --2- 172.21.15.146:0/3840853805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9d815a7f0 0x7fc9d815cac0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00098e0 tx=0x7fc9c00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2971f0d6492dcdab server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:29.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.682+0000 7fc9d559a700 1 -- 172.21.15.146:0/3840853805 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c000b640 con 0x7fc9d815a7f0 2023-10-06T11:12:29.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.682+0000 7fc9d559a700 1 -- 172.21.15.146:0/3840853805 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c000b7a0 con 0x7fc9d815a7f0 2023-10-06T11:12:29.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.682+0000 7fc9d559a700 1 -- 172.21.15.146:0/3840853805 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c000bb40 con 0x7fc9d815a7f0 2023-10-06T11:12:29.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.682+0000 7fc9d759e700 1 -- 172.21.15.146:0/3840853805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9d815a7f0 msgr2=0x7fc9d815cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:29.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.682+0000 7fc9d759e700 1 --2- 172.21.15.146:0/3840853805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9d815a7f0 0x7fc9d815cac0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00098e0 tx=0x7fc9c00091a0 comp rx=0 tx=0).stop 2023-10-06T11:12:29.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.682+0000 7fc9d759e700 1 -- 172.21.15.146:0/3840853805 shutdown_connections 2023-10-06T11:12:29.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.682+0000 7fc9d759e700 1 --2- 172.21.15.146:0/3840853805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9d815a7f0 0x7fc9d815cac0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:29.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.682+0000 7fc9d759e700 1 -- 172.21.15.146:0/3840853805 >> 172.21.15.146:0/3840853805 conn(0x7fc9d806eba0 msgr2=0x7fc9d806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:29.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.682+0000 7fc9d759e700 1 -- 172.21.15.146:0/3840853805 shutdown_connections 2023-10-06T11:12:29.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.682+0000 7fc9d759e700 1 -- 172.21.15.146:0/3840853805 wait complete. 2023-10-06T11:12:29.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.683+0000 7fc9d759e700 1 Processor -- start 2023-10-06T11:12:29.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.684+0000 7fc9d759e700 1 -- start start 2023-10-06T11:12:29.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.684+0000 7fc9d759e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9d80b2530 0x7fc9d8147f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:29.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.684+0000 7fc9d759e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9d815a420 0x7fc9d8148950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:29.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.684+0000 7fc9d759e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9d815a7f0 0x7fc9d815d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:29.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.684+0000 7fc9d759e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d8151cf0 con 0x7fc9d815a420 2023-10-06T11:12:29.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.684+0000 7fc9d759e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d81493d0 con 0x7fc9d815a7f0 2023-10-06T11:12:29.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.684+0000 7fc9d759e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d81496b0 con 0x7fc9d80b2530 2023-10-06T11:12:29.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.684+0000 7fc9d5d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9d815a420 0x7fc9d8148950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:29.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.684+0000 7fc9d5d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9d815a420 0x7fc9d8148950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33048/0 (socket says 172.21.15.146:33048) 2023-10-06T11:12:29.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.684+0000 7fc9d5d9b700 1 -- 172.21.15.146:0/1852980790 learned_addr learned my addr 172.21.15.146:0/1852980790 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:29.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.685+0000 7fc9d6d9d700 1 --2- 172.21.15.146:0/1852980790 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9d815a7f0 0x7fc9d815d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:29.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.685+0000 7fc9d5d9b700 1 -- 172.21.15.146:0/1852980790 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9d80b2530 msgr2=0x7fc9d8147f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:29.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.685+0000 7fc9d5d9b700 1 --2- 172.21.15.146:0/1852980790 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9d80b2530 0x7fc9d8147f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:29.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.685+0000 7fc9d5d9b700 1 -- 172.21.15.146:0/1852980790 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9d815a7f0 msgr2=0x7fc9d815d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:29.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.685+0000 7fc9d5d9b700 1 --2- 172.21.15.146:0/1852980790 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9d815a7f0 0x7fc9d815d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:29.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.685+0000 7fc9d5d9b700 1 -- 172.21.15.146:0/1852980790 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c0009420 con 0x7fc9d815a420 2023-10-06T11:12:29.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.685+0000 7fc9d6d9d700 1 --2- 172.21.15.146:0/1852980790 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9d815a7f0 0x7fc9d815d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:12:29.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.685+0000 7fc9d5d9b700 1 --2- 172.21.15.146:0/1852980790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9d815a420 0x7fc9d8148950 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8088e40 tx=0x7fc9c0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:29.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.685+0000 7fc9ce7fc700 1 -- 172.21.15.146:0/1852980790 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c000bb20 con 0x7fc9d815a420 2023-10-06T11:12:29.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.685+0000 7fc9ce7fc700 1 -- 172.21.15.146:0/1852980790 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c0011420 con 0x7fc9d815a420 2023-10-06T11:12:29.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.685+0000 7fc9ce7fc700 1 -- 172.21.15.146:0/1852980790 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c00117a0 con 0x7fc9d815a420 2023-10-06T11:12:29.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.685+0000 7fc9d759e700 1 -- 172.21.15.146:0/1852980790 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9d8149990 con 0x7fc9d815a420 2023-10-06T11:12:29.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.685+0000 7fc9d759e700 1 -- 172.21.15.146:0/1852980790 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9d8148450 con 0x7fc9d815a420 2023-10-06T11:12:29.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.686+0000 7fc9d759e700 1 -- 172.21.15.146:0/1852980790 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9d8151e60 con 0x7fc9d815a420 2023-10-06T11:12:29.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.686+0000 7fc9ce7fc700 1 -- 172.21.15.146:0/1852980790 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc9c0011b50 con 0x7fc9d815a420 2023-10-06T11:12:29.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.687+0000 7fc9ce7fc700 1 --2- 172.21.15.146:0/1852980790 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc9b8066f30 0x7fc9b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:29.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.687+0000 7fc9d659c700 1 --2- 172.21.15.146:0/1852980790 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc9b8066f30 0x7fc9b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:29.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.687+0000 7fc9ce7fc700 1 -- 172.21.15.146:0/1852980790 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6086+0+0 (secure 0 0 0) 0x7fc9c0085db0 con 0x7fc9d815a420 2023-10-06T11:12:29.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.687+0000 7fc9d659c700 1 --2- 172.21.15.146:0/1852980790 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc9b8066f30 0x7fc9b80693e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8001d90 tx=0x7fc9c8007ec0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:29.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.691+0000 7fc9ce7fc700 1 -- 172.21.15.146:0/1852980790 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc9d8151e60 con 0x7fc9d815a420 2023-10-06T11:12:29.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.916+0000 7fc9d759e700 1 -- 172.21.15.146:0/1852980790 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc9d8151e30 con 0x7fc9d815a420 2023-10-06T11:12:29.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.917+0000 7fc9ce7fc700 1 -- 172.21.15.146:0/1852980790 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+4612 (secure 0 0 0) 0x7fc9c0052ea0 con 0x7fc9d815a420 2023-10-06T11:12:29.919 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:12:29.919 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":77,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6274,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3700176588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3700176588},{"type":"v1","addr":"172.21.15.151:6834","nonce":3700176588}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6771,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/3753626989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3753626989},{"type":"v1","addr":"172.21.15.146:6836","nonce":3753626989}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6774,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/1712863503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":1712863503},{"type":"v1","addr":"172.21.15.146:6837","nonce":1712863503}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-10-06T11:10:35.928535+0000","modified":"2023-10-06T11:12:13.377111+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6786},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6786":{"gid":6786,"name":"b","rank":0,"incarnation":60,"state":"up:active","state_seq":27,"addr":"172.21.15.151:6835/3649668257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":3649668257},{"type":"v1","addr":"172.21.15.151:6835","nonce":3649668257}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T11:12:29.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.919+0000 7fc9d759e700 1 -- 172.21.15.146:0/1852980790 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc9b8066f30 msgr2=0x7fc9b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:29.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.919+0000 7fc9d759e700 1 --2- 172.21.15.146:0/1852980790 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc9b8066f30 0x7fc9b80693e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8001d90 tx=0x7fc9c8007ec0 comp rx=0 tx=0).stop 2023-10-06T11:12:29.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.919+0000 7fc9d759e700 1 -- 172.21.15.146:0/1852980790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9d815a420 msgr2=0x7fc9d8148950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:29.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.919+0000 7fc9d759e700 1 --2- 172.21.15.146:0/1852980790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9d815a420 0x7fc9d8148950 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8088e40 tx=0x7fc9c0017000 comp rx=0 tx=0).stop 2023-10-06T11:12:29.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.919+0000 7fc9d759e700 1 -- 172.21.15.146:0/1852980790 shutdown_connections 2023-10-06T11:12:29.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.919+0000 7fc9d759e700 1 --2- 172.21.15.146:0/1852980790 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc9b8066f30 0x7fc9b80693e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:29.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.919+0000 7fc9d759e700 1 --2- 172.21.15.146:0/1852980790 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9d815a7f0 0x7fc9d815d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:29.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.919+0000 7fc9d759e700 1 --2- 172.21.15.146:0/1852980790 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9d80b2530 0x7fc9d8147f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:29.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.919+0000 7fc9d759e700 1 --2- 172.21.15.146:0/1852980790 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9d815a420 0x7fc9d8148950 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:29.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.919+0000 7fc9d759e700 1 -- 172.21.15.146:0/1852980790 >> 172.21.15.146:0/1852980790 conn(0x7fc9d806eba0 msgr2=0x7fc9d81595a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:29.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.919+0000 7fc9d759e700 1 -- 172.21.15.146:0/1852980790 shutdown_connections 2023-10-06T11:12:29.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:29.919+0000 7fc9d759e700 1 -- 172.21.15.146:0/1852980790 wait complete. 2023-10-06T11:12:29.923 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 77 2023-10-06T11:12:29.933 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:12:30.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.046+0000 7fca8e6b6700 1 Processor -- start 2023-10-06T11:12:30.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.046+0000 7fca8e6b6700 1 -- start start 2023-10-06T11:12:30.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.047+0000 7fca8e6b6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fca8815a7f0 0x7fca8815cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:30.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.047+0000 7fca8e6b6700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fca880b2530 0x7fca8815acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:30.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.047+0000 7fca8e6b6700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca8815c630 con 0x7fca8815a420 2023-10-06T11:12:30.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.047+0000 7fca8e6b6700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca880ce040 con 0x7fca8815a7f0 2023-10-06T11:12:30.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.047+0000 7fca8e6b6700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca8815ba20 con 0x7fca880b2530 2023-10-06T11:12:30.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.047+0000 7fca8ceb3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fca8815a7f0 0x7fca8815cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:30.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.047+0000 7fca8ceb3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fca8815a7f0 0x7fca8815cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33058/0 (socket says 172.21.15.146:33058) 2023-10-06T11:12:30.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.047+0000 7fca8ceb3700 1 -- 172.21.15.146:0/1681251096 learned_addr learned my addr 172.21.15.146:0/1681251096 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:30.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.047+0000 7fca8ceb3700 1 -- 172.21.15.146:0/1681251096 >> v2:172.21.15.151:3300/0 conn(0x7fca880b2530 msgr2=0x7fca8815acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:30.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.047+0000 7fca8deb5700 1 --2- 172.21.15.146:0/1681251096 >> v2:172.21.15.151:3300/0 conn(0x7fca880b2530 0x7fca8815acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:30.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.047+0000 7fca8ceb3700 1 --2- 172.21.15.146:0/1681251096 >> v2:172.21.15.151:3300/0 conn(0x7fca880b2530 0x7fca8815acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:30.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.047+0000 7fca8ceb3700 1 -- 172.21.15.146:0/1681251096 >> v1:172.21.15.151:6789/0 conn(0x7fca8815a420 legacy=0x7fca880b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:30.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.047+0000 7fca8ceb3700 1 -- 172.21.15.146:0/1681251096 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca8815bd00 con 0x7fca8815a7f0 2023-10-06T11:12:30.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.047+0000 7fca8deb5700 1 --2- 172.21.15.146:0/1681251096 >> v2:172.21.15.151:3300/0 conn(0x7fca880b2530 0x7fca8815acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:12:30.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.047+0000 7fca8ceb3700 1 --2- 172.21.15.146:0/1681251096 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca8815a7f0 0x7fca8815cac0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fca8815c5a0 tx=0x7fca78009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9166d8e9a8bc90af server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:30.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.048+0000 7fca7ffff700 1 -- 172.21.15.146:0/1681251096 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7800b820 con 0x7fca8815a7f0 2023-10-06T11:12:30.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.048+0000 7fca7ffff700 1 -- 172.21.15.146:0/1681251096 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7800b980 con 0x7fca8815a7f0 2023-10-06T11:12:30.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.048+0000 7fca7ffff700 1 -- 172.21.15.146:0/1681251096 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca7800bd20 con 0x7fca8815a7f0 2023-10-06T11:12:30.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.048+0000 7fca8e6b6700 1 -- 172.21.15.146:0/1681251096 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca8815a7f0 msgr2=0x7fca8815cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:30.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.048+0000 7fca8e6b6700 1 --2- 172.21.15.146:0/1681251096 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca8815a7f0 0x7fca8815cac0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fca8815c5a0 tx=0x7fca78009250 comp rx=0 tx=0).stop 2023-10-06T11:12:30.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.048+0000 7fca8e6b6700 1 -- 172.21.15.146:0/1681251096 shutdown_connections 2023-10-06T11:12:30.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.048+0000 7fca8e6b6700 1 --2- 172.21.15.146:0/1681251096 >> v2:172.21.15.151:3300/0 conn(0x7fca880b2530 0x7fca8815acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:30.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.048+0000 7fca8e6b6700 1 --2- 172.21.15.146:0/1681251096 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca8815a7f0 0x7fca8815cac0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:30.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.048+0000 7fca8e6b6700 1 -- 172.21.15.146:0/1681251096 >> 172.21.15.146:0/1681251096 conn(0x7fca8806eba0 msgr2=0x7fca8806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:30.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.048+0000 7fca8e6b6700 1 -- 172.21.15.146:0/1681251096 shutdown_connections 2023-10-06T11:12:30.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.048+0000 7fca8e6b6700 1 -- 172.21.15.146:0/1681251096 wait complete. 2023-10-06T11:12:30.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.049+0000 7fca8e6b6700 1 Processor -- start 2023-10-06T11:12:30.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.049+0000 7fca8e6b6700 1 -- start start 2023-10-06T11:12:30.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.050+0000 7fca8e6b6700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca880b2530 0x7fca8814d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:30.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.050+0000 7fca8e6b6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca8815a420 0x7fca88153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:30.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.050+0000 7fca8e6b6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca8815a7f0 0x7fca88151c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:30.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.050+0000 7fca8e6b6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8814d790 con 0x7fca8815a7f0 2023-10-06T11:12:30.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.050+0000 7fca8e6b6700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca88150ba0 con 0x7fca880b2530 2023-10-06T11:12:30.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.050+0000 7fca8e6b6700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca88150e80 con 0x7fca8815a420 2023-10-06T11:12:30.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.050+0000 7fca8deb5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca8815a7f0 0x7fca88151c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:30.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.050+0000 7fca8deb5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca8815a7f0 0x7fca88151c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33068/0 (socket says 172.21.15.146:33068) 2023-10-06T11:12:30.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.050+0000 7fca8deb5700 1 -- 172.21.15.146:0/1658231462 learned_addr learned my addr 172.21.15.146:0/1658231462 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:30.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.050+0000 7fca8d6b4700 1 --2- 172.21.15.146:0/1658231462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca880b2530 0x7fca8814d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:30.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.050+0000 7fca8deb5700 1 -- 172.21.15.146:0/1658231462 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca8815a420 msgr2=0x7fca88153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:30.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.050+0000 7fca8deb5700 1 --2- 172.21.15.146:0/1658231462 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca8815a420 0x7fca88153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:30.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.050+0000 7fca8deb5700 1 -- 172.21.15.146:0/1658231462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca880b2530 msgr2=0x7fca8814d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:30.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.050+0000 7fca8deb5700 1 --2- 172.21.15.146:0/1658231462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca880b2530 0x7fca8814d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:30.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.050+0000 7fca8deb5700 1 -- 172.21.15.146:0/1658231462 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca780094f0 con 0x7fca8815a7f0 2023-10-06T11:12:30.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.050+0000 7fca8d6b4700 1 --2- 172.21.15.146:0/1658231462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca880b2530 0x7fca8814d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:12:30.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.051+0000 7fca8deb5700 1 --2- 172.21.15.146:0/1658231462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca8815a7f0 0x7fca88151c40 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fca8000cfc0 tx=0x7fca800078d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:30.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.051+0000 7fca7d7fa700 1 -- 172.21.15.146:0/1658231462 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca80015440 con 0x7fca8815a7f0 2023-10-06T11:12:30.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.051+0000 7fca7d7fa700 1 -- 172.21.15.146:0/1658231462 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca800155a0 con 0x7fca8815a7f0 2023-10-06T11:12:30.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.051+0000 7fca8e6b6700 1 -- 172.21.15.146:0/1658231462 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca88151160 con 0x7fca8815a7f0 2023-10-06T11:12:30.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.051+0000 7fca7d7fa700 1 -- 172.21.15.146:0/1658231462 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca80015960 con 0x7fca8815a7f0 2023-10-06T11:12:30.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.051+0000 7fca8e6b6700 1 -- 172.21.15.146:0/1658231462 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca88151720 con 0x7fca8815a7f0 2023-10-06T11:12:30.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.052+0000 7fca8e6b6700 1 -- 172.21.15.146:0/1658231462 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca88151940 con 0x7fca8815a7f0 2023-10-06T11:12:30.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.052+0000 7fca7d7fa700 1 -- 172.21.15.146:0/1658231462 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fca8000d440 con 0x7fca8815a7f0 2023-10-06T11:12:30.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.053+0000 7fca7d7fa700 1 --2- 172.21.15.146:0/1658231462 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fca6c066f30 0x7fca6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:30.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.053+0000 7fca7d7fa700 1 -- 172.21.15.146:0/1658231462 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6086+0+0 (secure 0 0 0) 0x7fca800853c0 con 0x7fca8815a7f0 2023-10-06T11:12:30.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.053+0000 7fca8d6b4700 1 --2- 172.21.15.146:0/1658231462 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fca6c066f30 0x7fca6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:30.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.053+0000 7fca8d6b4700 1 --2- 172.21.15.146:0/1658231462 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fca6c066f30 0x7fca6c0693e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fca84002880 tx=0x7fca84009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:30.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.057+0000 7fca7d7fa700 1 -- 172.21.15.146:0/1658231462 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca80052410 con 0x7fca8815a7f0 2023-10-06T11:12:30.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.241+0000 7fca8e6b6700 1 -- 172.21.15.146:0/1658231462 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca880afae0 con 0x7fca8815a7f0 2023-10-06T11:12:30.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.242+0000 7fca7d7fa700 1 -- 172.21.15.146:0/1658231462 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+16983 (secure 0 0 0) 0x7fca80055a30 con 0x7fca8815a7f0 2023-10-06T11:12:30.244 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:12:30.244 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":77,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:12:10.356730+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:10:33.590163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-10-06T11:10:34.892777+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":76,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":12,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:12:30.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.244+0000 7fca8e6b6700 1 -- 172.21.15.146:0/1658231462 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fca6c066f30 msgr2=0x7fca6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:30.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.244+0000 7fca8e6b6700 1 --2- 172.21.15.146:0/1658231462 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fca6c066f30 0x7fca6c0693e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fca84002880 tx=0x7fca84009040 comp rx=0 tx=0).stop 2023-10-06T11:12:30.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.244+0000 7fca8e6b6700 1 -- 172.21.15.146:0/1658231462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca8815a7f0 msgr2=0x7fca88151c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:30.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.244+0000 7fca8e6b6700 1 --2- 172.21.15.146:0/1658231462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca8815a7f0 0x7fca88151c40 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fca8000cfc0 tx=0x7fca800078d0 comp rx=0 tx=0).stop 2023-10-06T11:12:30.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.244+0000 7fca8e6b6700 1 -- 172.21.15.146:0/1658231462 shutdown_connections 2023-10-06T11:12:30.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.244+0000 7fca8e6b6700 1 --2- 172.21.15.146:0/1658231462 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fca6c066f30 0x7fca6c0693e0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:30.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.244+0000 7fca8e6b6700 1 --2- 172.21.15.146:0/1658231462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fca8815a7f0 0x7fca88151c40 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:30.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.244+0000 7fca8e6b6700 1 --2- 172.21.15.146:0/1658231462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca880b2530 0x7fca8814d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:30.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.244+0000 7fca8e6b6700 1 --2- 172.21.15.146:0/1658231462 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fca8815a420 0x7fca88153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:30.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.244+0000 7fca8e6b6700 1 -- 172.21.15.146:0/1658231462 >> 172.21.15.146:0/1658231462 conn(0x7fca8806eba0 msgr2=0x7fca8814dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:30.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.244+0000 7fca8e6b6700 1 -- 172.21.15.146:0/1658231462 shutdown_connections 2023-10-06T11:12:30.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.244+0000 7fca8e6b6700 1 -- 172.21.15.146:0/1658231462 wait complete. 2023-10-06T11:12:30.258 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:05:36.687307+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:05:37.171199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T11:10:33.590163+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T11:10:34.892777+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 76, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T11:12:30.259 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:12:30.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.376+0000 7f3dfb309700 1 Processor -- start 2023-10-06T11:12:30.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.376+0000 7f3dfb309700 1 -- start start 2023-10-06T11:12:30.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.377+0000 7f3dfb309700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3df415a160 0x7f3df40c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:30.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.377+0000 7f3dfb309700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3df40ae730 0x7f3df40aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:30.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.377+0000 7f3dfb309700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3df40ae2a0 con 0x7f3df40ce3d0 2023-10-06T11:12:30.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.377+0000 7f3dfb309700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3df415a530 con 0x7f3df415a160 2023-10-06T11:12:30.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.377+0000 7f3dfb309700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df40ad690 con 0x7f3df40ae730 2023-10-06T11:12:30.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.378+0000 7f3df88a4700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3df40ae730 0x7f3df40aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:30.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.378+0000 7f3df90a5700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3df415a160 0x7f3df40c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:30.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.378+0000 7f3df88a4700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3df40ae730 0x7f3df40aeb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:53738/0 (socket says 172.21.15.146:53738) 2023-10-06T11:12:30.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.378+0000 7f3df90a5700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3df415a160 0x7f3df40c55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:34042/0 (socket says 172.21.15.146:34042) 2023-10-06T11:12:30.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.378+0000 7f3df88a4700 1 -- 172.21.15.146:0/402347257 learned_addr learned my addr 172.21.15.146:0/402347257 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:30.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.378+0000 7f3df88a4700 1 -- 172.21.15.146:0/402347257 >> v2:172.21.15.151:3300/0 conn(0x7f3df415a160 msgr2=0x7f3df40c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:30.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.378+0000 7f3df88a4700 1 --2- 172.21.15.146:0/402347257 >> v2:172.21.15.151:3300/0 conn(0x7f3df415a160 0x7f3df40c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:30.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.378+0000 7f3df88a4700 1 -- 172.21.15.146:0/402347257 >> v1:172.21.15.151:6789/0 conn(0x7f3df40ce3d0 legacy=0x7f3df40ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:30.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.378+0000 7f3df88a4700 1 -- 172.21.15.146:0/402347257 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df40ad970 con 0x7f3df40ae730 2023-10-06T11:12:30.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.378+0000 7f3df90a5700 1 --2- 172.21.15.146:0/402347257 >> v2:172.21.15.151:3300/0 conn(0x7f3df415a160 0x7f3df40c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:12:30.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.378+0000 7f3df88a4700 1 --2- 172.21.15.146:0/402347257 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3df40ae730 0x7f3df40aeb80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3de40099b0 tx=0x7f3de4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19727d84f153b333 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:30.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.378+0000 7f3debfff700 1 -- 172.21.15.146:0/402347257 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de4009ea0 con 0x7f3df40ae730 2023-10-06T11:12:30.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.378+0000 7f3debfff700 1 -- 172.21.15.146:0/402347257 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de400b860 con 0x7f3df40ae730 2023-10-06T11:12:30.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.378+0000 7f3debfff700 1 -- 172.21.15.146:0/402347257 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de400bc00 con 0x7f3df40ae730 2023-10-06T11:12:30.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.379+0000 7f3dfb309700 1 -- 172.21.15.146:0/402347257 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3df40ae730 msgr2=0x7f3df40aeb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:30.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.379+0000 7f3dfb309700 1 --2- 172.21.15.146:0/402347257 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3df40ae730 0x7f3df40aeb80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3de40099b0 tx=0x7f3de4009250 comp rx=0 tx=0).stop 2023-10-06T11:12:30.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.379+0000 7f3dfb309700 1 -- 172.21.15.146:0/402347257 shutdown_connections 2023-10-06T11:12:30.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.379+0000 7f3dfb309700 1 --2- 172.21.15.146:0/402347257 >> v2:172.21.15.151:3300/0 conn(0x7f3df415a160 0x7f3df40c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:30.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.379+0000 7f3dfb309700 1 --2- 172.21.15.146:0/402347257 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3df40ae730 0x7f3df40aeb80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:30.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.379+0000 7f3dfb309700 1 -- 172.21.15.146:0/402347257 >> 172.21.15.146:0/402347257 conn(0x7f3df406f380 msgr2=0x7f3df40d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:30.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.379+0000 7f3dfb309700 1 -- 172.21.15.146:0/402347257 shutdown_connections 2023-10-06T11:12:30.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.379+0000 7f3dfb309700 1 -- 172.21.15.146:0/402347257 wait complete. 2023-10-06T11:12:30.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.380+0000 7f3dfb309700 1 Processor -- start 2023-10-06T11:12:30.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.380+0000 7f3dfb309700 1 -- start start 2023-10-06T11:12:30.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.381+0000 7f3dfb309700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3df40ae730 0x7f3df415ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:30.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.381+0000 7f3dfb309700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3df40ce3d0 0x7f3df416a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:30.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.381+0000 7f3dfb309700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3df415a160 0x7f3df415efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:30.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.381+0000 7f3dfb309700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df415fb10 con 0x7f3df415a160 2023-10-06T11:12:30.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.381+0000 7f3dfb309700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df40b3f30 con 0x7f3df40ae730 2023-10-06T11:12:30.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.381+0000 7f3dfb309700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df416a810 con 0x7f3df40ce3d0 2023-10-06T11:12:30.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.381+0000 7f3df98a6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3df415a160 0x7f3df415efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:30.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.381+0000 7f3df98a6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3df415a160 0x7f3df415efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33076/0 (socket says 172.21.15.146:33076) 2023-10-06T11:12:30.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.381+0000 7f3df98a6700 1 -- 172.21.15.146:0/437484557 learned_addr learned my addr 172.21.15.146:0/437484557 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:30.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.381+0000 7f3df90a5700 1 --2- 172.21.15.146:0/437484557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3df40ae730 0x7f3df415ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:30.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.381+0000 7f3df88a4700 1 --2- 172.21.15.146:0/437484557 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3df40ce3d0 0x7f3df416a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:30.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.381+0000 7f3df98a6700 1 -- 172.21.15.146:0/437484557 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3df40ce3d0 msgr2=0x7f3df416a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:30.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.381+0000 7f3df98a6700 1 --2- 172.21.15.146:0/437484557 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3df40ce3d0 0x7f3df416a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:30.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.381+0000 7f3df98a6700 1 -- 172.21.15.146:0/437484557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3df40ae730 msgr2=0x7f3df415ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:30.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.381+0000 7f3df98a6700 1 --2- 172.21.15.146:0/437484557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3df40ae730 0x7f3df415ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:30.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.381+0000 7f3df98a6700 1 -- 172.21.15.146:0/437484557 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df00093c0 con 0x7f3df415a160 2023-10-06T11:12:30.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.382+0000 7f3df98a6700 1 --2- 172.21.15.146:0/437484557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3df415a160 0x7f3df415efa0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f3dec00c910 tx=0x7f3dec001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:30.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.382+0000 7f3de97fa700 1 -- 172.21.15.146:0/437484557 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dec012630 con 0x7f3df415a160 2023-10-06T11:12:30.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.382+0000 7f3de97fa700 1 -- 172.21.15.146:0/437484557 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dec012790 con 0x7f3df415a160 2023-10-06T11:12:30.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.382+0000 7f3dfb309700 1 -- 172.21.15.146:0/437484557 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3de40094f0 con 0x7f3df415a160 2023-10-06T11:12:30.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.382+0000 7f3de97fa700 1 -- 172.21.15.146:0/437484557 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dec012b50 con 0x7f3df415a160 2023-10-06T11:12:30.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.382+0000 7f3dfb309700 1 -- 172.21.15.146:0/437484557 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df40b38e0 con 0x7f3df415a160 2023-10-06T11:12:30.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.383+0000 7f3dfb309700 1 -- 172.21.15.146:0/437484557 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3df4068390 con 0x7f3df415a160 2023-10-06T11:12:30.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.383+0000 7f3de97fa700 1 -- 172.21.15.146:0/437484557 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3dec01a3a0 con 0x7f3df415a160 2023-10-06T11:12:30.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.384+0000 7f3de97fa700 1 --2- 172.21.15.146:0/437484557 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3dd8066f30 0x7f3dd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:30.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.384+0000 7f3df90a5700 1 --2- 172.21.15.146:0/437484557 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3dd8066f30 0x7f3dd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:30.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.384+0000 7f3de97fa700 1 -- 172.21.15.146:0/437484557 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6086+0+0 (secure 0 0 0) 0x7f3dec0848c0 con 0x7f3df415a160 2023-10-06T11:12:30.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.384+0000 7f3df90a5700 1 --2- 172.21.15.146:0/437484557 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3dd8066f30 0x7f3dd80693e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f3df4159bd0 tx=0x7f3df0009120 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:30.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.388+0000 7f3de97fa700 1 -- 172.21.15.146:0/437484557 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3dec055440 con 0x7f3df415a160 2023-10-06T11:12:30.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.571+0000 7f3dfb309700 1 -- 172.21.15.146:0/437484557 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3df40b4070 con 0x7f3df415a160 2023-10-06T11:12:30.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.571+0000 7f3de97fa700 1 -- 172.21.15.146:0/437484557 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v77) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3dec054fd0 con 0x7f3df415a160 2023-10-06T11:12:30.573 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-10-06T11:12:30.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.573+0000 7f3dfb309700 1 -- 172.21.15.146:0/437484557 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3dd8066f30 msgr2=0x7f3dd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:30.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.573+0000 7f3dfb309700 1 --2- 172.21.15.146:0/437484557 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3dd8066f30 0x7f3dd80693e0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f3df4159bd0 tx=0x7f3df0009120 comp rx=0 tx=0).stop 2023-10-06T11:12:30.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.573+0000 7f3dfb309700 1 -- 172.21.15.146:0/437484557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3df415a160 msgr2=0x7f3df415efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:30.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.573+0000 7f3dfb309700 1 --2- 172.21.15.146:0/437484557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3df415a160 0x7f3df415efa0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f3dec00c910 tx=0x7f3dec001710 comp rx=0 tx=0).stop 2023-10-06T11:12:30.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.573+0000 7f3dfb309700 1 -- 172.21.15.146:0/437484557 shutdown_connections 2023-10-06T11:12:30.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.573+0000 7f3dfb309700 1 --2- 172.21.15.146:0/437484557 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3dd8066f30 0x7f3dd80693e0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:30.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.573+0000 7f3dfb309700 1 --2- 172.21.15.146:0/437484557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3df415a160 0x7f3df415efa0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:30.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.573+0000 7f3dfb309700 1 --2- 172.21.15.146:0/437484557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3df40ae730 0x7f3df415ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:30.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.573+0000 7f3dfb309700 1 --2- 172.21.15.146:0/437484557 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3df40ce3d0 0x7f3df416a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:30.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.573+0000 7f3dfb309700 1 -- 172.21.15.146:0/437484557 >> 172.21.15.146:0/437484557 conn(0x7f3df406f380 msgr2=0x7f3df40cf6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:30.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.573+0000 7f3dfb309700 1 -- 172.21.15.146:0/437484557 shutdown_connections 2023-10-06T11:12:30.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.573+0000 7f3dfb309700 1 -- 172.21.15.146:0/437484557 wait complete. 2023-10-06T11:12:30.587 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:12:30.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.704+0000 7fc80ec55700 1 Processor -- start 2023-10-06T11:12:30.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.704+0000 7fc80ec55700 1 -- start start 2023-10-06T11:12:30.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.705+0000 7fc80ec55700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc80806dae0 0x7fc80806b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:30.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.705+0000 7fc80ec55700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc80806bd10 0x7fc808068580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:30.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.705+0000 7fc80ec55700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc80806d090 con 0x7fc8081572f0 2023-10-06T11:12:30.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.705+0000 7fc80ec55700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc80806c190 con 0x7fc80806bd10 2023-10-06T11:12:30.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.705+0000 7fc80ec55700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc80806d650 con 0x7fc80806dae0 2023-10-06T11:12:30.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.705+0000 7fc80d452700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc80806dae0 0x7fc80806b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:30.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.706+0000 7fc80d452700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc80806dae0 0x7fc80806b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:53754/0 (socket says 172.21.15.146:53754) 2023-10-06T11:12:30.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.706+0000 7fc80d452700 1 -- 172.21.15.146:0/1349457149 learned_addr learned my addr 172.21.15.146:0/1349457149 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:30.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.706+0000 7fc80e454700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc80806bd10 0x7fc808068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:30.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.706+0000 7fc80d452700 1 -- 172.21.15.146:0/1349457149 >> v2:172.21.15.151:3300/0 conn(0x7fc80806bd10 msgr2=0x7fc808068580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:30.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.706+0000 7fc80d452700 1 --2- 172.21.15.146:0/1349457149 >> v2:172.21.15.151:3300/0 conn(0x7fc80806bd10 0x7fc808068580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:30.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.706+0000 7fc80d452700 1 -- 172.21.15.146:0/1349457149 >> v1:172.21.15.151:6789/0 conn(0x7fc8081572f0 legacy=0x7fc808159cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:30.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.706+0000 7fc80d452700 1 -- 172.21.15.146:0/1349457149 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc80815a820 con 0x7fc80806dae0 2023-10-06T11:12:30.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.706+0000 7fc80e454700 1 --2- 172.21.15.146:0/1349457149 >> v2:172.21.15.151:3300/0 conn(0x7fc80806bd10 0x7fc808068580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:12:30.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.706+0000 7fc80d452700 1 --2- 172.21.15.146:0/1349457149 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc80806dae0 0x7fc80806b7d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc7f80099b0 tx=0x7fc7f8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5edbaabdd3dffcd2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:30.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.706+0000 7fc80cc51700 1 -- 172.21.15.146:0/1349457149 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f8009ea0 con 0x7fc80806dae0 2023-10-06T11:12:30.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.706+0000 7fc80cc51700 1 -- 172.21.15.146:0/1349457149 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f800b860 con 0x7fc80806dae0 2023-10-06T11:12:30.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.706+0000 7fc80cc51700 1 -- 172.21.15.146:0/1349457149 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f800bc00 con 0x7fc80806dae0 2023-10-06T11:12:30.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.707+0000 7fc80ec55700 1 -- 172.21.15.146:0/1349457149 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc80806dae0 msgr2=0x7fc80806b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:30.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.707+0000 7fc80ec55700 1 --2- 172.21.15.146:0/1349457149 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc80806dae0 0x7fc80806b7d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc7f80099b0 tx=0x7fc7f8009250 comp rx=0 tx=0).stop 2023-10-06T11:12:30.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.707+0000 7fc80ec55700 1 -- 172.21.15.146:0/1349457149 shutdown_connections 2023-10-06T11:12:30.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.707+0000 7fc80ec55700 1 --2- 172.21.15.146:0/1349457149 >> v2:172.21.15.151:3300/0 conn(0x7fc80806bd10 0x7fc808068580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:30.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.707+0000 7fc80ec55700 1 --2- 172.21.15.146:0/1349457149 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc80806dae0 0x7fc80806b7d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:30.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.707+0000 7fc80ec55700 1 -- 172.21.15.146:0/1349457149 >> 172.21.15.146:0/1349457149 conn(0x7fc8080ce450 msgr2=0x7fc8080ce850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:30.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.707+0000 7fc80ec55700 1 -- 172.21.15.146:0/1349457149 shutdown_connections 2023-10-06T11:12:30.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.707+0000 7fc80ec55700 1 -- 172.21.15.146:0/1349457149 wait complete. 2023-10-06T11:12:30.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.708+0000 7fc80ec55700 1 Processor -- start 2023-10-06T11:12:30.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.708+0000 7fc80ec55700 1 -- start start 2023-10-06T11:12:30.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.709+0000 7fc80ec55700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc80806bd10 0x7fc8080b3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:30.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.709+0000 7fc80ec55700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc80806dae0 0x7fc8080c5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:30.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.709+0000 7fc80ec55700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8081572f0 0x7fc8080c59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:30.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.709+0000 7fc80ec55700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8080b2b40 con 0x7fc8081572f0 2023-10-06T11:12:30.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.709+0000 7fc80ec55700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8080b4190 con 0x7fc80806bd10 2023-10-06T11:12:30.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.709+0000 7fc80ec55700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8080b1f30 con 0x7fc80806dae0 2023-10-06T11:12:30.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.709+0000 7fc80e454700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8081572f0 0x7fc8080c59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:30.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.709+0000 7fc80e454700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8081572f0 0x7fc8080c59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33084/0 (socket says 172.21.15.146:33084) 2023-10-06T11:12:30.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.709+0000 7fc80e454700 1 -- 172.21.15.146:0/2748911037 learned_addr learned my addr 172.21.15.146:0/2748911037 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:30.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.709+0000 7fc80dc53700 1 --2- 172.21.15.146:0/2748911037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc80806bd10 0x7fc8080b3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:30.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.709+0000 7fc80d452700 1 --2- 172.21.15.146:0/2748911037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc80806dae0 0x7fc8080c5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:30.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.709+0000 7fc80e454700 1 -- 172.21.15.146:0/2748911037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc80806dae0 msgr2=0x7fc8080c5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:30.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.709+0000 7fc80e454700 1 --2- 172.21.15.146:0/2748911037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc80806dae0 0x7fc8080c5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:30.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.709+0000 7fc80e454700 1 -- 172.21.15.146:0/2748911037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc80806bd10 msgr2=0x7fc8080b3c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:30.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.709+0000 7fc80e454700 1 --2- 172.21.15.146:0/2748911037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc80806bd10 0x7fc8080b3c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:30.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.709+0000 7fc80e454700 1 -- 172.21.15.146:0/2748911037 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc800009a20 con 0x7fc8081572f0 2023-10-06T11:12:30.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.709+0000 7fc80dc53700 1 --2- 172.21.15.146:0/2748911037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc80806bd10 0x7fc8080b3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:12:30.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.709+0000 7fc80e454700 1 --2- 172.21.15.146:0/2748911037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8081572f0 0x7fc8080c59a0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fc800009f50 tx=0x7fc80000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:30.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.709+0000 7fc7fdffb700 1 -- 172.21.15.146:0/2748911037 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80000ccb0 con 0x7fc8081572f0 2023-10-06T11:12:30.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.709+0000 7fc7fdffb700 1 -- 172.21.15.146:0/2748911037 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc80000f040 con 0x7fc8081572f0 2023-10-06T11:12:30.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.709+0000 7fc80ec55700 1 -- 172.21.15.146:0/2748911037 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7f80094f0 con 0x7fc8081572f0 2023-10-06T11:12:30.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.709+0000 7fc7fdffb700 1 -- 172.21.15.146:0/2748911037 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc800014480 con 0x7fc8081572f0 2023-10-06T11:12:30.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.710+0000 7fc80ec55700 1 -- 172.21.15.146:0/2748911037 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8080b24f0 con 0x7fc8081572f0 2023-10-06T11:12:30.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.711+0000 7fc80ec55700 1 -- 172.21.15.146:0/2748911037 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc808169e90 con 0x7fc8081572f0 2023-10-06T11:12:30.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.711+0000 7fc7fdffb700 1 -- 172.21.15.146:0/2748911037 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc800003020 con 0x7fc8081572f0 2023-10-06T11:12:30.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.712+0000 7fc7fdffb700 1 --2- 172.21.15.146:0/2748911037 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc7ec066f30 0x7fc7ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:30.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.712+0000 7fc80dc53700 1 --2- 172.21.15.146:0/2748911037 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc7ec066f30 0x7fc7ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:30.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.712+0000 7fc7fdffb700 1 -- 172.21.15.146:0/2748911037 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6086+0+0 (secure 0 0 0) 0x7fc800085160 con 0x7fc8081572f0 2023-10-06T11:12:30.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.712+0000 7fc80dc53700 1 --2- 172.21.15.146:0/2748911037 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc7ec066f30 0x7fc7ec0693e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc804007fd0 tx=0x7fc804009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:30.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.716+0000 7fc7fdffb700 1 -- 172.21.15.146:0/2748911037 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc8000521b0 con 0x7fc8081572f0 2023-10-06T11:12:30.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.898+0000 7fc80ec55700 1 -- 172.21.15.146:0/2748911037 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc80804bb40 con 0x7fc8081572f0 2023-10-06T11:12:30.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.898+0000 7fc7fdffb700 1 -- 172.21.15.146:0/2748911037 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc8000557d0 con 0x7fc8081572f0 2023-10-06T11:12:30.900 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-10-06T11:12:30.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.900+0000 7fc80ec55700 1 -- 172.21.15.146:0/2748911037 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc7ec066f30 msgr2=0x7fc7ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:30.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.900+0000 7fc80ec55700 1 --2- 172.21.15.146:0/2748911037 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc7ec066f30 0x7fc7ec0693e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fc804007fd0 tx=0x7fc804009040 comp rx=0 tx=0).stop 2023-10-06T11:12:30.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.900+0000 7fc80ec55700 1 -- 172.21.15.146:0/2748911037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8081572f0 msgr2=0x7fc8080c59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:30.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.900+0000 7fc80ec55700 1 --2- 172.21.15.146:0/2748911037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8081572f0 0x7fc8080c59a0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fc800009f50 tx=0x7fc80000b040 comp rx=0 tx=0).stop 2023-10-06T11:12:30.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.900+0000 7fc80ec55700 1 -- 172.21.15.146:0/2748911037 shutdown_connections 2023-10-06T11:12:30.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.900+0000 7fc80ec55700 1 --2- 172.21.15.146:0/2748911037 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc7ec066f30 0x7fc7ec0693e0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:30.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.900+0000 7fc80ec55700 1 --2- 172.21.15.146:0/2748911037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8081572f0 0x7fc8080c59a0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:30.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.900+0000 7fc80ec55700 1 --2- 172.21.15.146:0/2748911037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc80806bd10 0x7fc8080b3c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:30.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.900+0000 7fc80ec55700 1 --2- 172.21.15.146:0/2748911037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc80806dae0 0x7fc8080c5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:30.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.900+0000 7fc80ec55700 1 -- 172.21.15.146:0/2748911037 >> 172.21.15.146:0/2748911037 conn(0x7fc8080ce450 msgr2=0x7fc808068580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:30.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.900+0000 7fc80ec55700 1 -- 172.21.15.146:0/2748911037 shutdown_connections 2023-10-06T11:12:30.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:30.900+0000 7fc80ec55700 1 -- 172.21.15.146:0/2748911037 wait complete. 2023-10-06T11:12:30.914 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T11:12:31.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.030+0000 7f135be44700 1 Processor -- start 2023-10-06T11:12:31.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.031+0000 7f135be44700 1 -- start start 2023-10-06T11:12:31.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.031+0000 7f135be44700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f13540abfe0 0x7f13540add00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:31.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.031+0000 7f135be44700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13540ae550 con 0x7f13540ceb50 2023-10-06T11:12:31.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.031+0000 7f135be44700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13540ae830 con 0x7f13540ac3b0 2023-10-06T11:12:31.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.031+0000 7f135be44700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13540aeb10 con 0x7f13540abfe0 2023-10-06T11:12:31.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.032+0000 7f1359be0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f13540abfe0 0x7f13540add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:31.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.032+0000 7f13593df700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f13540ceb50 0x7f13540af5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55986/0 (socket says 172.21.15.146:55986) 2023-10-06T11:12:31.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.032+0000 7f13593df700 1 -- 172.21.15.146:0/1669754393 learned_addr learned my addr 172.21.15.146:0/1669754393 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:12:31.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.032+0000 7f1359be0700 1 -- 172.21.15.146:0/1669754393 >> v1:172.21.15.151:6789/0 conn(0x7f13540ac3b0 legacy=0x7f13540ac810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:31.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.032+0000 7f1359be0700 1 -- 172.21.15.146:0/1669754393 >> v1:172.21.15.146:6789/0 conn(0x7f13540ceb50 legacy=0x7f13540af5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:31.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.032+0000 7f1358bde700 1 -- 172.21.15.146:0/1669754393 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 369679005 0 0) 0x7f13540ae550 con 0x7f13540ceb50 2023-10-06T11:12:31.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.032+0000 7f1359be0700 1 -- 172.21.15.146:0/1669754393 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13540aedf0 con 0x7f13540abfe0 2023-10-06T11:12:31.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.032+0000 7f1359be0700 1 --2- 172.21.15.146:0/1669754393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13540abfe0 0x7f13540add00 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f13440098e0 tx=0x7f13440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=188e7d06832ad238 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:31.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.032+0000 7f1358bde700 1 -- 172.21.15.146:0/1669754393 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1344009e80 con 0x7f13540abfe0 2023-10-06T11:12:31.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.032+0000 7f1358bde700 1 -- 172.21.15.146:0/1669754393 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f134400b860 con 0x7f13540abfe0 2023-10-06T11:12:31.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.032+0000 7f1358bde700 1 -- 172.21.15.146:0/1669754393 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134400bbe0 con 0x7f13540abfe0 2023-10-06T11:12:31.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.033+0000 7f135be44700 1 -- 172.21.15.146:0/1669754393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13540abfe0 msgr2=0x7f13540add00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:31.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.033+0000 7f135be44700 1 --2- 172.21.15.146:0/1669754393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13540abfe0 0x7f13540add00 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f13440098e0 tx=0x7f13440091a0 comp rx=0 tx=0).stop 2023-10-06T11:12:31.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.033+0000 7f135be44700 1 -- 172.21.15.146:0/1669754393 shutdown_connections 2023-10-06T11:12:31.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.033+0000 7f135be44700 1 --2- 172.21.15.146:0/1669754393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13540abfe0 0x7f13540add00 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:31.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.033+0000 7f135be44700 1 -- 172.21.15.146:0/1669754393 >> 172.21.15.146:0/1669754393 conn(0x7f1354067c50 msgr2=0x7f13540ce440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:31.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.033+0000 7f135be44700 1 -- 172.21.15.146:0/1669754393 shutdown_connections 2023-10-06T11:12:31.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.033+0000 7f135be44700 1 -- 172.21.15.146:0/1669754393 wait complete. 2023-10-06T11:12:31.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.034+0000 7f135be44700 1 Processor -- start 2023-10-06T11:12:31.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.034+0000 7f135be44700 1 -- start start 2023-10-06T11:12:31.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.035+0000 7f135be44700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f13540abfe0 0x7f13541519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:31.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.035+0000 7f135be44700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13540ac3b0 0x7f135415b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:31.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.035+0000 7f135be44700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13540ceb50 0x7f1354167d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:31.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.035+0000 7f135be44700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1354151f20 con 0x7f13540ac3b0 2023-10-06T11:12:31.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.035+0000 7f135be44700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135415a320 con 0x7f13540ceb50 2023-10-06T11:12:31.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.035+0000 7f135be44700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f135415a600 con 0x7f13540abfe0 2023-10-06T11:12:31.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.035+0000 7f13593df700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13540ac3b0 0x7f135415b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:31.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.035+0000 7f13593df700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13540ac3b0 0x7f135415b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33110/0 (socket says 172.21.15.146:33110) 2023-10-06T11:12:31.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.035+0000 7f13593df700 1 -- 172.21.15.146:0/3431950513 learned_addr learned my addr 172.21.15.146:0/3431950513 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:31.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.035+0000 7f1359be0700 1 --2- 172.21.15.146:0/3431950513 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f13540abfe0 0x7f13541519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:31.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.035+0000 7f135a3e1700 1 --2- 172.21.15.146:0/3431950513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13540ceb50 0x7f1354167d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:31.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.035+0000 7f13593df700 1 -- 172.21.15.146:0/3431950513 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f13540abfe0 msgr2=0x7f13541519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:31.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.035+0000 7f13593df700 1 --2- 172.21.15.146:0/3431950513 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f13540abfe0 0x7f13541519e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:31.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.035+0000 7f13593df700 1 -- 172.21.15.146:0/3431950513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13540ceb50 msgr2=0x7f1354167d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:31.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.035+0000 7f13593df700 1 --2- 172.21.15.146:0/3431950513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13540ceb50 0x7f1354167d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:31.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.035+0000 7f13593df700 1 -- 172.21.15.146:0/3431950513 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1344009420 con 0x7f13540ac3b0 2023-10-06T11:12:31.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.035+0000 7f13593df700 1 --2- 172.21.15.146:0/3431950513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13540ac3b0 0x7f135415b3c0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f134800c5b0 tx=0x7f1348001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:31.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.035+0000 7f1351ffb700 1 -- 172.21.15.146:0/3431950513 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1348005b30 con 0x7f13540ac3b0 2023-10-06T11:12:31.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.035+0000 7f1351ffb700 1 -- 172.21.15.146:0/3431950513 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1348005c90 con 0x7f13540ac3b0 2023-10-06T11:12:31.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.035+0000 7f1351ffb700 1 -- 172.21.15.146:0/3431950513 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1348007300 con 0x7f13540ac3b0 2023-10-06T11:12:31.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.035+0000 7f135be44700 1 -- 172.21.15.146:0/3431950513 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f135415a8e0 con 0x7f13540ac3b0 2023-10-06T11:12:31.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.036+0000 7f135be44700 1 -- 172.21.15.146:0/3431950513 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f135415aea0 con 0x7f13540ac3b0 2023-10-06T11:12:31.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.037+0000 7f135be44700 1 -- 172.21.15.146:0/3431950513 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f135404c380 con 0x7f13540ac3b0 2023-10-06T11:12:31.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.037+0000 7f1351ffb700 1 -- 172.21.15.146:0/3431950513 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f134801b3b0 con 0x7f13540ac3b0 2023-10-06T11:12:31.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.037+0000 7f1351ffb700 1 --2- 172.21.15.146:0/3431950513 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1340066f30 0x7f13400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:31.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.037+0000 7f1351ffb700 1 -- 172.21.15.146:0/3431950513 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6086+0+0 (secure 0 0 0) 0x7f1348083ae0 con 0x7f13540ac3b0 2023-10-06T11:12:31.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.037+0000 7f1359be0700 1 --2- 172.21.15.146:0/3431950513 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1340066f30 0x7f13400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:31.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.038+0000 7f1359be0700 1 --2- 172.21.15.146:0/3431950513 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1340066f30 0x7f13400693e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f13440093f0 tx=0x7f1344017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:31.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.042+0000 7f1351ffb700 1 -- 172.21.15.146:0/3431950513 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1348050bd0 con 0x7f13540ac3b0 2023-10-06T11:12:31.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.226+0000 7f135be44700 1 -- 172.21.15.146:0/3431950513 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f13540af0d0 con 0x7f13540ac3b0 2023-10-06T11:12:31.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.226+0000 7f1351ffb700 1 -- 172.21.15.146:0/3431950513 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v77) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1348017020 con 0x7f13540ac3b0 2023-10-06T11:12:31.228 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2023-10-06T11:12:31.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.228+0000 7f135be44700 1 -- 172.21.15.146:0/3431950513 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1340066f30 msgr2=0x7f13400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:31.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.228+0000 7f135be44700 1 --2- 172.21.15.146:0/3431950513 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1340066f30 0x7f13400693e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f13440093f0 tx=0x7f1344017000 comp rx=0 tx=0).stop 2023-10-06T11:12:31.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.228+0000 7f135be44700 1 -- 172.21.15.146:0/3431950513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13540ac3b0 msgr2=0x7f135415b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:31.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.228+0000 7f135be44700 1 --2- 172.21.15.146:0/3431950513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13540ac3b0 0x7f135415b3c0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f134800c5b0 tx=0x7f1348001070 comp rx=0 tx=0).stop 2023-10-06T11:12:31.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.229+0000 7f135be44700 1 -- 172.21.15.146:0/3431950513 shutdown_connections 2023-10-06T11:12:31.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.229+0000 7f135be44700 1 --2- 172.21.15.146:0/3431950513 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1340066f30 0x7f13400693e0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:31.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.229+0000 7f135be44700 1 --2- 172.21.15.146:0/3431950513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13540ceb50 0x7f1354167d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:31.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.229+0000 7f135be44700 1 --2- 172.21.15.146:0/3431950513 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f13540abfe0 0x7f13541519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:31.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.229+0000 7f135be44700 1 --2- 172.21.15.146:0/3431950513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13540ac3b0 0x7f135415b3c0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:31.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.229+0000 7f135be44700 1 -- 172.21.15.146:0/3431950513 >> 172.21.15.146:0/3431950513 conn(0x7f1354067c50 msgr2=0x7f13540ac810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:31.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.229+0000 7f135be44700 1 -- 172.21.15.146:0/3431950513 shutdown_connections 2023-10-06T11:12:31.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.229+0000 7f135be44700 1 -- 172.21.15.146:0/3431950513 wait complete. 2023-10-06T11:12:31.242 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T11:12:31.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.358+0000 7fc73b165700 1 Processor -- start 2023-10-06T11:12:31.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.358+0000 7fc73b165700 1 -- start start 2023-10-06T11:12:31.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.359+0000 7fc73b165700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc73415a160 0x7fc7340c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:31.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.359+0000 7fc73b165700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc7340ae730 0x7fc7340aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:31.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.359+0000 7fc73b165700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc7340ce3d0 0x7fc7340ce830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:31.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.359+0000 7fc73b165700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7340ae2a0 con 0x7fc7340ae730 2023-10-06T11:12:31.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.359+0000 7fc73b165700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc73415a530 con 0x7fc7340ce3d0 2023-10-06T11:12:31.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.359+0000 7fc73b165700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7340ad690 con 0x7fc73415a160 2023-10-06T11:12:31.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.359+0000 7fc72bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc7340ae730 0x7fc7340aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:31.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.359+0000 7fc72bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc7340ae730 0x7fc7340aeb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33164/0 (socket says 172.21.15.146:33164) 2023-10-06T11:12:31.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.359+0000 7fc72bfff700 1 -- 172.21.15.146:0/939611171 learned_addr learned my addr 172.21.15.146:0/939611171 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:31.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.359+0000 7fc739702700 1 --2- 172.21.15.146:0/939611171 >> v2:172.21.15.151:3300/0 conn(0x7fc7340ce3d0 0x7fc7340ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:31.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.359+0000 7fc738f01700 1 --2- 172.21.15.146:0/939611171 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc73415a160 0x7fc7340c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:31.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.359+0000 7fc72bfff700 1 -- 172.21.15.146:0/939611171 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc73415a160 msgr2=0x7fc7340c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:31.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.359+0000 7fc72bfff700 1 --2- 172.21.15.146:0/939611171 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc73415a160 0x7fc7340c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:31.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.360+0000 7fc72bfff700 1 -- 172.21.15.146:0/939611171 >> v2:172.21.15.151:3300/0 conn(0x7fc7340ce3d0 msgr2=0x7fc7340ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:31.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.360+0000 7fc72bfff700 1 --2- 172.21.15.146:0/939611171 >> v2:172.21.15.151:3300/0 conn(0x7fc7340ce3d0 0x7fc7340ce830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:31.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.360+0000 7fc72bfff700 1 -- 172.21.15.146:0/939611171 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7340ad970 con 0x7fc7340ae730 2023-10-06T11:12:31.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.360+0000 7fc72bfff700 1 --2- 172.21.15.146:0/939611171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7340ae730 0x7fc7340aeb80 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fc734089c40 tx=0x7fc724009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=732688d8812c1671 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:31.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.360+0000 7fc72b7fe700 1 -- 172.21.15.146:0/939611171 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc724009e70 con 0x7fc7340ae730 2023-10-06T11:12:31.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.360+0000 7fc72b7fe700 1 -- 172.21.15.146:0/939611171 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72400b860 con 0x7fc7340ae730 2023-10-06T11:12:31.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.360+0000 7fc72b7fe700 1 -- 172.21.15.146:0/939611171 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72400bc00 con 0x7fc7340ae730 2023-10-06T11:12:31.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.360+0000 7fc73b165700 1 -- 172.21.15.146:0/939611171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7340ae730 msgr2=0x7fc7340aeb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:31.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.360+0000 7fc73b165700 1 --2- 172.21.15.146:0/939611171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7340ae730 0x7fc7340aeb80 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fc734089c40 tx=0x7fc724009250 comp rx=0 tx=0).stop 2023-10-06T11:12:31.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.360+0000 7fc73b165700 1 -- 172.21.15.146:0/939611171 shutdown_connections 2023-10-06T11:12:31.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.360+0000 7fc73b165700 1 --2- 172.21.15.146:0/939611171 >> v2:172.21.15.151:3300/0 conn(0x7fc7340ce3d0 0x7fc7340ce830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:31.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.360+0000 7fc73b165700 1 --2- 172.21.15.146:0/939611171 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc73415a160 0x7fc7340c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:31.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.360+0000 7fc73b165700 1 --2- 172.21.15.146:0/939611171 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7340ae730 0x7fc7340aeb80 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:31.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.360+0000 7fc73b165700 1 -- 172.21.15.146:0/939611171 >> 172.21.15.146:0/939611171 conn(0x7fc73406f380 msgr2=0x7fc7340d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:31.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.360+0000 7fc73b165700 1 -- 172.21.15.146:0/939611171 shutdown_connections 2023-10-06T11:12:31.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.360+0000 7fc73b165700 1 -- 172.21.15.146:0/939611171 wait complete. 2023-10-06T11:12:31.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.361+0000 7fc73b165700 1 Processor -- start 2023-10-06T11:12:31.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.362+0000 7fc73b165700 1 -- start start 2023-10-06T11:12:31.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.362+0000 7fc73b165700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7340ae730 0x7fc7340ca360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:31.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.362+0000 7fc73b165700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7340ce3d0 0x7fc734151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:31.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.362+0000 7fc73b165700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc73415a160 0x7fc734151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:31.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.362+0000 7fc73b165700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7340ca8a0 con 0x7fc7340ae730 2023-10-06T11:12:31.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.362+0000 7fc73b165700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7340b3fb0 con 0x7fc73415a160 2023-10-06T11:12:31.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.362+0000 7fc73b165700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7340b5db0 con 0x7fc7340ce3d0 2023-10-06T11:12:31.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.362+0000 7fc738f01700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7340ae730 0x7fc7340ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:31.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.362+0000 7fc738f01700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7340ae730 0x7fc7340ca360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33172/0 (socket says 172.21.15.146:33172) 2023-10-06T11:12:31.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.362+0000 7fc738f01700 1 -- 172.21.15.146:0/1816561024 learned_addr learned my addr 172.21.15.146:0/1816561024 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:31.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.363+0000 7fc739702700 1 --2- 172.21.15.146:0/1816561024 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc73415a160 0x7fc734151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:31.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.363+0000 7fc72bfff700 1 --2- 172.21.15.146:0/1816561024 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7340ce3d0 0x7fc734151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:31.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.363+0000 7fc738f01700 1 -- 172.21.15.146:0/1816561024 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7340ce3d0 msgr2=0x7fc734151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:31.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.363+0000 7fc738f01700 1 --2- 172.21.15.146:0/1816561024 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7340ce3d0 0x7fc734151340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:31.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.363+0000 7fc738f01700 1 -- 172.21.15.146:0/1816561024 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc73415a160 msgr2=0x7fc734151880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:31.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.363+0000 7fc738f01700 1 --2- 172.21.15.146:0/1816561024 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc73415a160 0x7fc734151880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:31.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.363+0000 7fc738f01700 1 -- 172.21.15.146:0/1816561024 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7240094f0 con 0x7fc7340ae730 2023-10-06T11:12:31.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.363+0000 7fc738f01700 1 --2- 172.21.15.146:0/1816561024 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7340ae730 0x7fc7340ca360 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fc73000d840 tx=0x7fc730008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:31.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.363+0000 7fc728ff9700 1 -- 172.21.15.146:0/1816561024 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7300125f0 con 0x7fc7340ae730 2023-10-06T11:12:31.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.363+0000 7fc728ff9700 1 -- 172.21.15.146:0/1816561024 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc730012750 con 0x7fc7340ae730 2023-10-06T11:12:31.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.363+0000 7fc73b165700 1 -- 172.21.15.146:0/1816561024 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7340b6030 con 0x7fc7340ae730 2023-10-06T11:12:31.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.363+0000 7fc728ff9700 1 -- 172.21.15.146:0/1816561024 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc730012b10 con 0x7fc7340ae730 2023-10-06T11:12:31.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.363+0000 7fc73b165700 1 -- 172.21.15.146:0/1816561024 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7340b4200 con 0x7fc7340ae730 2023-10-06T11:12:31.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.364+0000 7fc73b165700 1 -- 172.21.15.146:0/1816561024 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc734069510 con 0x7fc7340ae730 2023-10-06T11:12:31.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.364+0000 7fc728ff9700 1 -- 172.21.15.146:0/1816561024 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc73001e460 con 0x7fc7340ae730 2023-10-06T11:12:31.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.365+0000 7fc728ff9700 1 --2- 172.21.15.146:0/1816561024 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc720066f30 0x7fc7200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:31.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.365+0000 7fc72bfff700 1 --2- 172.21.15.146:0/1816561024 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc720066f30 0x7fc7200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:31.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.365+0000 7fc728ff9700 1 -- 172.21.15.146:0/1816561024 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6086+0+0 (secure 0 0 0) 0x7fc730084c50 con 0x7fc7340ae730 2023-10-06T11:12:31.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.365+0000 7fc72bfff700 1 --2- 172.21.15.146:0/1816561024 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc720066f30 0x7fc7200693e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc734089c40 tx=0x7fc724017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:31.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.369+0000 7fc728ff9700 1 -- 172.21.15.146:0/1816561024 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc73008a020 con 0x7fc7340ae730 2023-10-06T11:12:31.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.554+0000 7fc73b165700 1 -- 172.21.15.146:0/1816561024 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc73404c380 con 0x7fc7340ae730 2023-10-06T11:12:31.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.555+0000 7fc728ff9700 1 -- 172.21.15.146:0/1816561024 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v77) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc730051d40 con 0x7fc7340ae730 2023-10-06T11:12:31.557 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2023-10-06T11:12:31.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.557+0000 7fc73b165700 1 -- 172.21.15.146:0/1816561024 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc720066f30 msgr2=0x7fc7200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:31.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.557+0000 7fc73b165700 1 --2- 172.21.15.146:0/1816561024 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc720066f30 0x7fc7200693e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc734089c40 tx=0x7fc724017000 comp rx=0 tx=0).stop 2023-10-06T11:12:31.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.557+0000 7fc73b165700 1 -- 172.21.15.146:0/1816561024 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7340ae730 msgr2=0x7fc7340ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:31.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.557+0000 7fc73b165700 1 --2- 172.21.15.146:0/1816561024 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7340ae730 0x7fc7340ca360 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fc73000d840 tx=0x7fc730008040 comp rx=0 tx=0).stop 2023-10-06T11:12:31.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.557+0000 7fc73b165700 1 -- 172.21.15.146:0/1816561024 shutdown_connections 2023-10-06T11:12:31.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.557+0000 7fc73b165700 1 --2- 172.21.15.146:0/1816561024 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc720066f30 0x7fc7200693e0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:31.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.557+0000 7fc73b165700 1 --2- 172.21.15.146:0/1816561024 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc73415a160 0x7fc734151880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:31.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.557+0000 7fc73b165700 1 --2- 172.21.15.146:0/1816561024 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7340ae730 0x7fc7340ca360 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:31.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.557+0000 7fc73b165700 1 --2- 172.21.15.146:0/1816561024 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7340ce3d0 0x7fc734151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:31.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.557+0000 7fc73b165700 1 -- 172.21.15.146:0/1816561024 >> 172.21.15.146:0/1816561024 conn(0x7fc73406f380 msgr2=0x7fc7340ccd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:31.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.557+0000 7fc73b165700 1 -- 172.21.15.146:0/1816561024 shutdown_connections 2023-10-06T11:12:31.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.557+0000 7fc73b165700 1 -- 172.21.15.146:0/1816561024 wait complete. 2023-10-06T11:12:31.571 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:12:31.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.685+0000 7f5bf47b8700 1 Processor -- start 2023-10-06T11:12:31.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.685+0000 7f5bf47b8700 1 -- start start 2023-10-06T11:12:31.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.686+0000 7f5bf47b8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5bec153e80 0x7f5bec15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:31.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.686+0000 7f5bf47b8700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bec15ac30 con 0x7f5bec153ab0 2023-10-06T11:12:31.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.686+0000 7f5bf47b8700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bec0b4510 con 0x7f5bec068ba0 2023-10-06T11:12:31.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.686+0000 7f5bf47b8700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bec0b6530 con 0x7f5bec153e80 2023-10-06T11:12:31.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.686+0000 7f5bf2d55700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5bec153e80 0x7f5bec15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:31.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.686+0000 7f5bf2554700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f5bec153ab0 0x7f5bec068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:54026/0 (socket says 172.21.15.146:54026) 2023-10-06T11:12:31.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.686+0000 7f5bf2554700 1 -- 172.21.15.146:0/1548273129 learned_addr learned my addr 172.21.15.146:0/1548273129 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:12:31.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.687+0000 7f5bf2d55700 1 -- 172.21.15.146:0/1548273129 >> v1:172.21.15.151:6789/0 conn(0x7f5bec068ba0 legacy=0x7f5bec0b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:31.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.687+0000 7f5bf2d55700 1 -- 172.21.15.146:0/1548273129 >> v1:172.21.15.146:6789/0 conn(0x7f5bec153ab0 legacy=0x7f5bec068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:31.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.687+0000 7f5bf2d55700 1 -- 172.21.15.146:0/1548273129 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bec0b5c50 con 0x7f5bec153e80 2023-10-06T11:12:31.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.687+0000 7f5bf1552700 1 -- 172.21.15.146:0/1548273129 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2591879062 0 0) 0x7f5be8001490 con 0x7f5bec153ab0 2023-10-06T11:12:31.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.687+0000 7f5bf2d55700 1 --2- 172.21.15.146:0/1548273129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bec153e80 0x7f5bec15a6f0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f5be40098e0 tx=0x7f5be40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f4f9a95e95442 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:31.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.687+0000 7f5bf1552700 1 -- 172.21.15.146:0/1548273129 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be4009e80 con 0x7f5bec153e80 2023-10-06T11:12:31.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.687+0000 7f5bf1552700 1 -- 172.21.15.146:0/1548273129 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be400b860 con 0x7f5bec153e80 2023-10-06T11:12:31.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.687+0000 7f5bf1552700 1 -- 172.21.15.146:0/1548273129 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be400bbe0 con 0x7f5bec153e80 2023-10-06T11:12:31.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.687+0000 7f5bf47b8700 1 -- 172.21.15.146:0/1548273129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bec153e80 msgr2=0x7f5bec15a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:31.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.687+0000 7f5bf47b8700 1 --2- 172.21.15.146:0/1548273129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bec153e80 0x7f5bec15a6f0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f5be40098e0 tx=0x7f5be40091a0 comp rx=0 tx=0).stop 2023-10-06T11:12:31.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.687+0000 7f5bf47b8700 1 -- 172.21.15.146:0/1548273129 shutdown_connections 2023-10-06T11:12:31.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.687+0000 7f5bf47b8700 1 --2- 172.21.15.146:0/1548273129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bec153e80 0x7f5bec15a6f0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:31.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.687+0000 7f5bf47b8700 1 -- 172.21.15.146:0/1548273129 >> 172.21.15.146:0/1548273129 conn(0x7f5bec06eba0 msgr2=0x7f5bec06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:31.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.688+0000 7f5bf47b8700 1 -- 172.21.15.146:0/1548273129 shutdown_connections 2023-10-06T11:12:31.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.688+0000 7f5bf47b8700 1 -- 172.21.15.146:0/1548273129 wait complete. 2023-10-06T11:12:31.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.689+0000 7f5bf47b8700 1 Processor -- start 2023-10-06T11:12:31.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.689+0000 7f5bf47b8700 1 -- start start 2023-10-06T11:12:31.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.689+0000 7f5bf47b8700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5bec068ba0 0x7f5bec151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:31.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.689+0000 7f5bf47b8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bec153ab0 0x7f5bec15c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:31.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.689+0000 7f5bf47b8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5bec153e80 0x7f5bec15c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:31.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.689+0000 7f5bf47b8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec1698b0 con 0x7f5bec153ab0 2023-10-06T11:12:31.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.689+0000 7f5bf47b8700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec1516c0 con 0x7f5bec068ba0 2023-10-06T11:12:31.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.689+0000 7f5bf47b8700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bec169b00 con 0x7f5bec153e80 2023-10-06T11:12:31.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.689+0000 7f5bf1d53700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bec153ab0 0x7f5bec15c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:31.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.689+0000 7f5bf1d53700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bec153ab0 0x7f5bec15c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33178/0 (socket says 172.21.15.146:33178) 2023-10-06T11:12:31.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.689+0000 7f5bf1d53700 1 -- 172.21.15.146:0/3711607493 learned_addr learned my addr 172.21.15.146:0/3711607493 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:31.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.690+0000 7f5bf2554700 1 --2- 172.21.15.146:0/3711607493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5bec068ba0 0x7f5bec151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:31.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.690+0000 7f5bf2d55700 1 --2- 172.21.15.146:0/3711607493 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5bec153e80 0x7f5bec15c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:31.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.690+0000 7f5bf1d53700 1 -- 172.21.15.146:0/3711607493 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5bec153e80 msgr2=0x7f5bec15c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:31.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.690+0000 7f5bf1d53700 1 --2- 172.21.15.146:0/3711607493 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5bec153e80 0x7f5bec15c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:31.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.690+0000 7f5bf1d53700 1 -- 172.21.15.146:0/3711607493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5bec068ba0 msgr2=0x7f5bec151180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:31.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.690+0000 7f5bf1d53700 1 --2- 172.21.15.146:0/3711607493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5bec068ba0 0x7f5bec151180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:31.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.690+0000 7f5bf1d53700 1 -- 172.21.15.146:0/3711607493 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be4009420 con 0x7f5bec153ab0 2023-10-06T11:12:31.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.690+0000 7f5bf1d53700 1 --2- 172.21.15.146:0/3711607493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bec153ab0 0x7f5bec15c230 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc00b5e0 tx=0x7f5bdc0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:31.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.690+0000 7f5be27fc700 1 -- 172.21.15.146:0/3711607493 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc00f510 con 0x7f5bec153ab0 2023-10-06T11:12:31.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.690+0000 7f5be27fc700 1 -- 172.21.15.146:0/3711607493 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bdc00f6b0 con 0x7f5bec153ab0 2023-10-06T11:12:31.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.690+0000 7f5bf47b8700 1 -- 172.21.15.146:0/3711607493 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bec169de0 con 0x7f5bec153ab0 2023-10-06T11:12:31.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.690+0000 7f5be27fc700 1 -- 172.21.15.146:0/3711607493 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc00fa70 con 0x7f5bec153ab0 2023-10-06T11:12:31.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.690+0000 7f5bf47b8700 1 -- 172.21.15.146:0/3711607493 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bec16a3a0 con 0x7f5bec153ab0 2023-10-06T11:12:31.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.691+0000 7f5bf47b8700 1 -- 172.21.15.146:0/3711607493 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bec16a5c0 con 0x7f5bec153ab0 2023-10-06T11:12:31.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.691+0000 7f5be27fc700 1 -- 172.21.15.146:0/3711607493 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5bdc01a400 con 0x7f5bec153ab0 2023-10-06T11:12:31.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.692+0000 7f5be27fc700 1 --2- 172.21.15.146:0/3711607493 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5bd0066f30 0x7f5bd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:31.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.692+0000 7f5be27fc700 1 -- 172.21.15.146:0/3711607493 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6086+0+0 (secure 0 0 0) 0x7f5bdc084130 con 0x7f5bec153ab0 2023-10-06T11:12:31.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.692+0000 7f5bf2554700 1 --2- 172.21.15.146:0/3711607493 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5bd0066f30 0x7f5bd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:31.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.692+0000 7f5bf2554700 1 --2- 172.21.15.146:0/3711607493 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5bd0066f30 0x7f5bd00693e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f5be80072e0 tx=0x7f5be8001a10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:31.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.696+0000 7f5be27fc700 1 -- 172.21.15.146:0/3711607493 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5bdc0512a0 con 0x7f5bec153ab0 2023-10-06T11:12:31.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.919+0000 7f5bf47b8700 1 -- 172.21.15.146:0/3711607493 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5bec04c380 con 0x7f5bec153ab0 2023-10-06T11:12:31.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.919+0000 7f5be27fc700 1 -- 172.21.15.146:0/3711607493 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+4612 (secure 0 0 0) 0x7f5bdc0548c0 con 0x7f5bec153ab0 2023-10-06T11:12:31.921 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:12:31.921 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":77,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6274,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3700176588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3700176588},{"type":"v1","addr":"172.21.15.151:6834","nonce":3700176588}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6771,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/3753626989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3753626989},{"type":"v1","addr":"172.21.15.146:6836","nonce":3753626989}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6774,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/1712863503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":1712863503},{"type":"v1","addr":"172.21.15.146:6837","nonce":1712863503}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-10-06T11:10:35.928535+0000","modified":"2023-10-06T11:12:13.377111+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6786},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6786":{"gid":6786,"name":"b","rank":0,"incarnation":60,"state":"up:active","state_seq":27,"addr":"172.21.15.151:6835/3649668257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":3649668257},{"type":"v1","addr":"172.21.15.151:6835","nonce":3649668257}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T11:12:31.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.921+0000 7f5bf47b8700 1 -- 172.21.15.146:0/3711607493 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5bd0066f30 msgr2=0x7f5bd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:31.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.921+0000 7f5bf47b8700 1 --2- 172.21.15.146:0/3711607493 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5bd0066f30 0x7f5bd00693e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f5be80072e0 tx=0x7f5be8001a10 comp rx=0 tx=0).stop 2023-10-06T11:12:31.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.921+0000 7f5bf47b8700 1 -- 172.21.15.146:0/3711607493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bec153ab0 msgr2=0x7f5bec15c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:31.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.921+0000 7f5bf47b8700 1 --2- 172.21.15.146:0/3711607493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bec153ab0 0x7f5bec15c230 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc00b5e0 tx=0x7f5bdc0090f0 comp rx=0 tx=0).stop 2023-10-06T11:12:31.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.921+0000 7f5bf47b8700 1 -- 172.21.15.146:0/3711607493 shutdown_connections 2023-10-06T11:12:31.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.921+0000 7f5bf47b8700 1 --2- 172.21.15.146:0/3711607493 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5bd0066f30 0x7f5bd00693e0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:31.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.921+0000 7f5bf47b8700 1 --2- 172.21.15.146:0/3711607493 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5bec153e80 0x7f5bec15c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:31.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.921+0000 7f5bf47b8700 1 --2- 172.21.15.146:0/3711607493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5bec068ba0 0x7f5bec151180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:31.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.921+0000 7f5bf47b8700 1 --2- 172.21.15.146:0/3711607493 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bec153ab0 0x7f5bec15c230 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:31.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.921+0000 7f5bf47b8700 1 -- 172.21.15.146:0/3711607493 >> 172.21.15.146:0/3711607493 conn(0x7f5bec06eba0 msgr2=0x7f5bec0ce950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:31.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.921+0000 7f5bf47b8700 1 -- 172.21.15.146:0/3711607493 shutdown_connections 2023-10-06T11:12:31.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:31.921+0000 7f5bf47b8700 1 -- 172.21.15.146:0/3711607493 wait complete. 2023-10-06T11:12:31.925 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 77 2023-10-06T11:12:31.935 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:12:32.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.047+0000 7f99b863f700 1 Processor -- start 2023-10-06T11:12:32.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.047+0000 7f99b863f700 1 -- start start 2023-10-06T11:12:32.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.048+0000 7f99b863f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f99b0068ba0 0x7f99b015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:32.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.048+0000 7f99b863f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99b015ac30 con 0x7f99b0153ab0 2023-10-06T11:12:32.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.048+0000 7f99b863f700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99b00b4510 con 0x7f99b0153e80 2023-10-06T11:12:32.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.048+0000 7f99b863f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b00b6530 con 0x7f99b0068ba0 2023-10-06T11:12:32.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.048+0000 7f99b63db700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f99b0153ab0 0x7f99b0068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:54028/0 (socket says 172.21.15.146:54028) 2023-10-06T11:12:32.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.048+0000 7f99b63db700 1 -- 172.21.15.146:0/3674673769 learned_addr learned my addr 172.21.15.146:0/3674673769 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:12:32.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.048+0000 7f99b5bda700 1 --2- 172.21.15.146:0/3674673769 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f99b0068ba0 0x7f99b015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:32.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.049+0000 7f99b53d9700 1 -- 172.21.15.146:0/3674673769 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 832428362 0 0) 0x7f99ac001490 con 0x7f99b0153ab0 2023-10-06T11:12:32.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.049+0000 7f99b53d9700 1 -- 172.21.15.146:0/3674673769 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f999c003570 con 0x7f99b0153ab0 2023-10-06T11:12:32.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.049+0000 7f99b53d9700 1 -- 172.21.15.146:0/3674673769 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1585240033 0 0) 0x7f99b00b4510 con 0x7f99b0153e80 2023-10-06T11:12:32.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.049+0000 7f99b53d9700 1 -- 172.21.15.146:0/3674673769 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99ac001490 con 0x7f99b0153e80 2023-10-06T11:12:32.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.049+0000 7f99b5bda700 1 -- 172.21.15.146:0/3674673769 >> v1:172.21.15.151:6789/0 conn(0x7f99b0153e80 legacy=0x7f99b00b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:32.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.049+0000 7f99b5bda700 1 -- 172.21.15.146:0/3674673769 >> v1:172.21.15.146:6789/0 conn(0x7f99b0153ab0 legacy=0x7f99b0068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:32.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.049+0000 7f99b5bda700 1 -- 172.21.15.146:0/3674673769 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b00b5c50 con 0x7f99b0068ba0 2023-10-06T11:12:32.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.049+0000 7f99b5bda700 1 --2- 172.21.15.146:0/3674673769 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f99b0068ba0 0x7f99b015a6f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f99a0009910 tx=0x7f99a00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7a425c174c8efe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:32.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.049+0000 7f99b53d9700 1 -- 172.21.15.146:0/3674673769 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a0011630 con 0x7f99b0068ba0 2023-10-06T11:12:32.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.049+0000 7f99b53d9700 1 -- 172.21.15.146:0/3674673769 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a0011790 con 0x7f99b0068ba0 2023-10-06T11:12:32.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.049+0000 7f99b53d9700 1 -- 172.21.15.146:0/3674673769 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a0011b10 con 0x7f99b0068ba0 2023-10-06T11:12:32.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.050+0000 7f99b863f700 1 -- 172.21.15.146:0/3674673769 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f99b0068ba0 msgr2=0x7f99b015a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:32.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.050+0000 7f99b863f700 1 --2- 172.21.15.146:0/3674673769 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f99b0068ba0 0x7f99b015a6f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f99a0009910 tx=0x7f99a00091a0 comp rx=0 tx=0).stop 2023-10-06T11:12:32.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.050+0000 7f99b863f700 1 -- 172.21.15.146:0/3674673769 shutdown_connections 2023-10-06T11:12:32.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.050+0000 7f99b863f700 1 --2- 172.21.15.146:0/3674673769 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f99b0068ba0 0x7f99b015a6f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:32.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.050+0000 7f99b863f700 1 -- 172.21.15.146:0/3674673769 >> 172.21.15.146:0/3674673769 conn(0x7f99b006eba0 msgr2=0x7f99b006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:32.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.050+0000 7f99b863f700 1 -- 172.21.15.146:0/3674673769 shutdown_connections 2023-10-06T11:12:32.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.050+0000 7f99b863f700 1 -- 172.21.15.146:0/3674673769 wait complete. 2023-10-06T11:12:32.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.051+0000 7f99b863f700 1 Processor -- start 2023-10-06T11:12:32.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.051+0000 7f99b863f700 1 -- start start 2023-10-06T11:12:32.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.051+0000 7f99b863f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99b0068ba0 0x7f99b0169720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:32.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.051+0000 7f99b863f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f99b0153ab0 0x7f99b0150920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:32.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.052+0000 7f99b863f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f99b0153e80 0x7f99b0158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:32.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.052+0000 7f99b863f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b0154420 con 0x7f99b0068ba0 2023-10-06T11:12:32.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.052+0000 7f99b863f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b0154c80 con 0x7f99b0153e80 2023-10-06T11:12:32.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.052+0000 7f99b863f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b01598d0 con 0x7f99b0153ab0 2023-10-06T11:12:32.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.052+0000 7f99b63db700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99b0068ba0 0x7f99b0169720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:32.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.052+0000 7f99b63db700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99b0068ba0 0x7f99b0169720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33186/0 (socket says 172.21.15.146:33186) 2023-10-06T11:12:32.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.052+0000 7f99b63db700 1 -- 172.21.15.146:0/4027011933 learned_addr learned my addr 172.21.15.146:0/4027011933 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:32.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.052+0000 7f99b5bda700 1 --2- 172.21.15.146:0/4027011933 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f99b0153ab0 0x7f99b0150920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:32.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.052+0000 7f99b6bdc700 1 --2- 172.21.15.146:0/4027011933 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f99b0153e80 0x7f99b0158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:32.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.052+0000 7f99b63db700 1 -- 172.21.15.146:0/4027011933 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f99b0153ab0 msgr2=0x7f99b0150920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:32.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.052+0000 7f99b63db700 1 --2- 172.21.15.146:0/4027011933 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f99b0153ab0 0x7f99b0150920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:32.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.052+0000 7f99b63db700 1 -- 172.21.15.146:0/4027011933 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f99b0153e80 msgr2=0x7f99b0158dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:32.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.052+0000 7f99b63db700 1 --2- 172.21.15.146:0/4027011933 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f99b0153e80 0x7f99b0158dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:32.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.052+0000 7f99b63db700 1 -- 172.21.15.146:0/4027011933 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a0009420 con 0x7f99b0068ba0 2023-10-06T11:12:32.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.052+0000 7f99b63db700 1 --2- 172.21.15.146:0/4027011933 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99b0068ba0 0x7f99b0169720 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f99ac002140 tx=0x7f99ac001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:32.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.052+0000 7f99a67fc700 1 -- 172.21.15.146:0/4027011933 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac00ab50 con 0x7f99b0068ba0 2023-10-06T11:12:32.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.052+0000 7f99a67fc700 1 -- 172.21.15.146:0/4027011933 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ac00acb0 con 0x7f99b0068ba0 2023-10-06T11:12:32.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.052+0000 7f99b863f700 1 -- 172.21.15.146:0/4027011933 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99b0154630 con 0x7f99b0068ba0 2023-10-06T11:12:32.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.052+0000 7f99a67fc700 1 -- 172.21.15.146:0/4027011933 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac007320 con 0x7f99b0068ba0 2023-10-06T11:12:32.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.052+0000 7f99b863f700 1 -- 172.21.15.146:0/4027011933 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b0150e60 con 0x7f99b0068ba0 2023-10-06T11:12:32.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.053+0000 7f99b863f700 1 -- 172.21.15.146:0/4027011933 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99b004c380 con 0x7f99b0068ba0 2023-10-06T11:12:32.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.054+0000 7f99a67fc700 1 -- 172.21.15.146:0/4027011933 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f99ac007710 con 0x7f99b0068ba0 2023-10-06T11:12:32.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.054+0000 7f99a67fc700 1 --2- 172.21.15.146:0/4027011933 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9994066f30 0x7f99940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:32.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.054+0000 7f99a67fc700 1 -- 172.21.15.146:0/4027011933 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6086+0+0 (secure 0 0 0) 0x7f99ac084af0 con 0x7f99b0068ba0 2023-10-06T11:12:32.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.054+0000 7f99b5bda700 1 --2- 172.21.15.146:0/4027011933 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9994066f30 0x7f99940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:32.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.055+0000 7f99b5bda700 1 --2- 172.21.15.146:0/4027011933 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9994066f30 0x7f99940693e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f99a0009860 tx=0x7f99a0017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:32.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.059+0000 7f99a67fc700 1 -- 172.21.15.146:0/4027011933 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f99ac051be0 con 0x7f99b0068ba0 2023-10-06T11:12:32.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.244+0000 7f99b863f700 1 -- 172.21.15.146:0/4027011933 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99b00b6250 con 0x7f99b0068ba0 2023-10-06T11:12:32.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.245+0000 7f99a67fc700 1 -- 172.21.15.146:0/4027011933 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+16983 (secure 0 0 0) 0x7f99ac055200 con 0x7f99b0068ba0 2023-10-06T11:12:32.247 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:12:32.247 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":77,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:12:10.356730+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:10:33.590163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-10-06T11:10:34.892777+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":76,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":12,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:12:32.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.247+0000 7f99b863f700 1 -- 172.21.15.146:0/4027011933 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9994066f30 msgr2=0x7f99940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:32.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.247+0000 7f99b863f700 1 --2- 172.21.15.146:0/4027011933 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9994066f30 0x7f99940693e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f99a0009860 tx=0x7f99a0017000 comp rx=0 tx=0).stop 2023-10-06T11:12:32.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.247+0000 7f99b863f700 1 -- 172.21.15.146:0/4027011933 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99b0068ba0 msgr2=0x7f99b0169720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:32.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.247+0000 7f99b863f700 1 --2- 172.21.15.146:0/4027011933 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99b0068ba0 0x7f99b0169720 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f99ac002140 tx=0x7f99ac001d40 comp rx=0 tx=0).stop 2023-10-06T11:12:32.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.247+0000 7f99b863f700 1 -- 172.21.15.146:0/4027011933 shutdown_connections 2023-10-06T11:12:32.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.247+0000 7f99b863f700 1 --2- 172.21.15.146:0/4027011933 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9994066f30 0x7f99940693e0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:32.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.247+0000 7f99b863f700 1 --2- 172.21.15.146:0/4027011933 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f99b0153e80 0x7f99b0158dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:32.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.247+0000 7f99b863f700 1 --2- 172.21.15.146:0/4027011933 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f99b0068ba0 0x7f99b0169720 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:32.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.247+0000 7f99b863f700 1 --2- 172.21.15.146:0/4027011933 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f99b0153ab0 0x7f99b0150920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:32.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.247+0000 7f99b863f700 1 -- 172.21.15.146:0/4027011933 >> 172.21.15.146:0/4027011933 conn(0x7f99b006eba0 msgr2=0x7f99b00cee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:32.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.247+0000 7f99b863f700 1 -- 172.21.15.146:0/4027011933 shutdown_connections 2023-10-06T11:12:32.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.247+0000 7f99b863f700 1 -- 172.21.15.146:0/4027011933 wait complete. 2023-10-06T11:12:32.261 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T11:12:32.261 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:12:32.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.375+0000 7ffa39ce4700 1 Processor -- start 2023-10-06T11:12:32.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.375+0000 7ffa39ce4700 1 -- start start 2023-10-06T11:12:32.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.376+0000 7ffa39ce4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffa34140c60 0x7ffa340b0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:32.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.376+0000 7ffa39ce4700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa3406b7f0 0x7ffa3406bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:32.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.376+0000 7ffa39ce4700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa340cc020 con 0x7ffa340b1530 2023-10-06T11:12:32.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.376+0000 7ffa39ce4700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa3406c1b0 con 0x7ffa34140c60 2023-10-06T11:12:32.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.376+0000 7ffa39ce4700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3415bc80 con 0x7ffa3406b7f0 2023-10-06T11:12:32.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.376+0000 7ffa38ce2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffa34140c60 0x7ffa340b0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:32.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.376+0000 7ffa38ce2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffa34140c60 0x7ffa340b0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33200/0 (socket says 172.21.15.146:33200) 2023-10-06T11:12:32.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.376+0000 7ffa38ce2700 1 -- 172.21.15.146:0/1726854832 learned_addr learned my addr 172.21.15.146:0/1726854832 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:32.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.376+0000 7ffa394e3700 1 --2- 172.21.15.146:0/1726854832 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa3406b7f0 0x7ffa3406bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:32.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.376+0000 7ffa38ce2700 1 -- 172.21.15.146:0/1726854832 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa3406b7f0 msgr2=0x7ffa3406bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:32.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.376+0000 7ffa38ce2700 1 --2- 172.21.15.146:0/1726854832 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa3406b7f0 0x7ffa3406bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:32.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.376+0000 7ffa38ce2700 1 -- 172.21.15.146:0/1726854832 >> v1:172.21.15.151:6789/0 conn(0x7ffa340b1530 legacy=0x7ffa340ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:32.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.376+0000 7ffa38ce2700 1 -- 172.21.15.146:0/1726854832 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa340cc270 con 0x7ffa34140c60 2023-10-06T11:12:32.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.377+0000 7ffa38ce2700 1 --2- 172.21.15.146:0/1726854832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa34140c60 0x7ffa340b0ff0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7ffa28009990 tx=0x7ffa28009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b33f2b692394276 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:32.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.377+0000 7ffa337fe700 1 -- 172.21.15.146:0/1726854832 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa28009e80 con 0x7ffa34140c60 2023-10-06T11:12:32.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.377+0000 7ffa337fe700 1 -- 172.21.15.146:0/1726854832 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa28005c10 con 0x7ffa34140c60 2023-10-06T11:12:32.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.377+0000 7ffa337fe700 1 -- 172.21.15.146:0/1726854832 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa2800b650 con 0x7ffa34140c60 2023-10-06T11:12:32.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.377+0000 7ffa39ce4700 1 -- 172.21.15.146:0/1726854832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa34140c60 msgr2=0x7ffa340b0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:32.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.377+0000 7ffa39ce4700 1 --2- 172.21.15.146:0/1726854832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa34140c60 0x7ffa340b0ff0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7ffa28009990 tx=0x7ffa28009220 comp rx=0 tx=0).stop 2023-10-06T11:12:32.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.377+0000 7ffa39ce4700 1 -- 172.21.15.146:0/1726854832 shutdown_connections 2023-10-06T11:12:32.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.377+0000 7ffa39ce4700 1 --2- 172.21.15.146:0/1726854832 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa3406b7f0 0x7ffa3406bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:32.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.377+0000 7ffa39ce4700 1 --2- 172.21.15.146:0/1726854832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa34140c60 0x7ffa340b0ff0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:32.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.377+0000 7ffa39ce4700 1 -- 172.21.15.146:0/1726854832 >> 172.21.15.146:0/1726854832 conn(0x7ffa340ce230 msgr2=0x7ffa340ce630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:32.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.377+0000 7ffa39ce4700 1 -- 172.21.15.146:0/1726854832 shutdown_connections 2023-10-06T11:12:32.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.377+0000 7ffa39ce4700 1 -- 172.21.15.146:0/1726854832 wait complete. 2023-10-06T11:12:32.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.378+0000 7ffa39ce4700 1 Processor -- start 2023-10-06T11:12:32.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.379+0000 7ffa39ce4700 1 -- start start 2023-10-06T11:12:32.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.379+0000 7ffa39ce4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa3406b7f0 0x7ffa340c6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:32.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.379+0000 7ffa39ce4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa340b1530 0x7ffa340c43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:32.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.379+0000 7ffa39ce4700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa34140c60 0x7ffa34137a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:32.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.379+0000 7ffa39ce4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa34135b10 con 0x7ffa340b1530 2023-10-06T11:12:32.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.379+0000 7ffa39ce4700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa341360d0 con 0x7ffa3406b7f0 2023-10-06T11:12:32.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.379+0000 7ffa39ce4700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa3416b910 con 0x7ffa34140c60 2023-10-06T11:12:32.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.379+0000 7ffa33fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa340b1530 0x7ffa340c43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:32.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.380+0000 7ffa33fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa340b1530 0x7ffa340c43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33212/0 (socket says 172.21.15.146:33212) 2023-10-06T11:12:32.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.380+0000 7ffa33fff700 1 -- 172.21.15.146:0/1994632678 learned_addr learned my addr 172.21.15.146:0/1994632678 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:32.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.380+0000 7ffa38ce2700 1 --2- 172.21.15.146:0/1994632678 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa3406b7f0 0x7ffa340c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:32.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.380+0000 7ffa394e3700 1 --2- 172.21.15.146:0/1994632678 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa34140c60 0x7ffa34137a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:32.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.380+0000 7ffa33fff700 1 -- 172.21.15.146:0/1994632678 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa34140c60 msgr2=0x7ffa34137a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:32.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.380+0000 7ffa33fff700 1 --2- 172.21.15.146:0/1994632678 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa34140c60 0x7ffa34137a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:32.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.380+0000 7ffa33fff700 1 -- 172.21.15.146:0/1994632678 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa3406b7f0 msgr2=0x7ffa340c6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:32.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.380+0000 7ffa33fff700 1 --2- 172.21.15.146:0/1994632678 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa3406b7f0 0x7ffa340c6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:32.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.380+0000 7ffa33fff700 1 -- 172.21.15.146:0/1994632678 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa28009480 con 0x7ffa340b1530 2023-10-06T11:12:32.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.380+0000 7ffa33fff700 1 --2- 172.21.15.146:0/1994632678 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa340b1530 0x7ffa340c43a0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7ffa2000c590 tx=0x7ffa2000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:32.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.380+0000 7ffa30ff9700 1 -- 172.21.15.146:0/1994632678 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa20011590 con 0x7ffa340b1530 2023-10-06T11:12:32.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.380+0000 7ffa30ff9700 1 -- 172.21.15.146:0/1994632678 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa200116f0 con 0x7ffa340b1530 2023-10-06T11:12:32.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.380+0000 7ffa39ce4700 1 -- 172.21.15.146:0/1994632678 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa34138600 con 0x7ffa340b1530 2023-10-06T11:12:32.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.380+0000 7ffa30ff9700 1 -- 172.21.15.146:0/1994632678 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa20011ab0 con 0x7ffa340b1530 2023-10-06T11:12:32.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.380+0000 7ffa39ce4700 1 -- 172.21.15.146:0/1994632678 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa34135de0 con 0x7ffa340b1530 2023-10-06T11:12:32.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.381+0000 7ffa39ce4700 1 -- 172.21.15.146:0/1994632678 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa3406e5a0 con 0x7ffa340b1530 2023-10-06T11:12:32.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.381+0000 7ffa30ff9700 1 -- 172.21.15.146:0/1994632678 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffa2001b3b0 con 0x7ffa340b1530 2023-10-06T11:12:32.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.382+0000 7ffa30ff9700 1 --2- 172.21.15.146:0/1994632678 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ffa18066f30 0x7ffa180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:32.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.382+0000 7ffa30ff9700 1 -- 172.21.15.146:0/1994632678 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6086+0+0 (secure 0 0 0) 0x7ffa20083c40 con 0x7ffa340b1530 2023-10-06T11:12:32.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.382+0000 7ffa38ce2700 1 --2- 172.21.15.146:0/1994632678 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ffa18066f30 0x7ffa180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:32.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.382+0000 7ffa38ce2700 1 --2- 172.21.15.146:0/1994632678 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ffa18066f30 0x7ffa180693e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ffa28007fd0 tx=0x7ffa28016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:32.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.386+0000 7ffa30ff9700 1 -- 172.21.15.146:0/1994632678 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffa20050d30 con 0x7ffa340b1530 2023-10-06T11:12:32.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.615+0000 7ffa39ce4700 1 -- 172.21.15.146:0/1994632678 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffa340cc550 con 0x7ffa340b1530 2023-10-06T11:12:32.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.615+0000 7ffa30ff9700 1 -- 172.21.15.146:0/1994632678 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+4612 (secure 0 0 0) 0x7ffa20017070 con 0x7ffa340b1530 2023-10-06T11:12:32.617 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:12:32.617 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":77,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6274,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3700176588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3700176588},{"type":"v1","addr":"172.21.15.151:6834","nonce":3700176588}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6771,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/3753626989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3753626989},{"type":"v1","addr":"172.21.15.146:6836","nonce":3753626989}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6774,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/1712863503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":1712863503},{"type":"v1","addr":"172.21.15.146:6837","nonce":1712863503}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-10-06T11:10:35.928535+0000","modified":"2023-10-06T11:12:13.377111+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6786},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6786":{"gid":6786,"name":"b","rank":0,"incarnation":60,"state":"up:active","state_seq":27,"addr":"172.21.15.151:6835/3649668257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":3649668257},{"type":"v1","addr":"172.21.15.151:6835","nonce":3649668257}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T11:12:32.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.617+0000 7ffa39ce4700 1 -- 172.21.15.146:0/1994632678 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ffa18066f30 msgr2=0x7ffa180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:32.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.617+0000 7ffa39ce4700 1 --2- 172.21.15.146:0/1994632678 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ffa18066f30 0x7ffa180693e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ffa28007fd0 tx=0x7ffa28016000 comp rx=0 tx=0).stop 2023-10-06T11:12:32.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.617+0000 7ffa39ce4700 1 -- 172.21.15.146:0/1994632678 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa340b1530 msgr2=0x7ffa340c43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:32.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.617+0000 7ffa39ce4700 1 --2- 172.21.15.146:0/1994632678 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa340b1530 0x7ffa340c43a0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7ffa2000c590 tx=0x7ffa2000c950 comp rx=0 tx=0).stop 2023-10-06T11:12:32.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.617+0000 7ffa39ce4700 1 -- 172.21.15.146:0/1994632678 shutdown_connections 2023-10-06T11:12:32.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.617+0000 7ffa39ce4700 1 --2- 172.21.15.146:0/1994632678 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ffa18066f30 0x7ffa180693e0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:32.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.617+0000 7ffa39ce4700 1 --2- 172.21.15.146:0/1994632678 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa34140c60 0x7ffa34137a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:32.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.617+0000 7ffa39ce4700 1 --2- 172.21.15.146:0/1994632678 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa3406b7f0 0x7ffa340c6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:32.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.617+0000 7ffa39ce4700 1 --2- 172.21.15.146:0/1994632678 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa340b1530 0x7ffa340c43a0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:32.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.617+0000 7ffa39ce4700 1 -- 172.21.15.146:0/1994632678 >> 172.21.15.146:0/1994632678 conn(0x7ffa340ce230 msgr2=0x7ffa3413efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:32.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.618+0000 7ffa39ce4700 1 -- 172.21.15.146:0/1994632678 shutdown_connections 2023-10-06T11:12:32.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.618+0000 7ffa39ce4700 1 -- 172.21.15.146:0/1994632678 wait complete. 2023-10-06T11:12:32.621 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 77 2023-10-06T11:12:32.632 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:12:32.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.746+0000 7f7fcae89700 1 Processor -- start 2023-10-06T11:12:32.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.746+0000 7f7fcae89700 1 -- start start 2023-10-06T11:12:32.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.746+0000 7f7fcae89700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7fc4153ab0 0x7f7fc415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:32.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.747+0000 7f7fcae89700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7fc4153e80 0x7f7fc4068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:32.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.747+0000 7f7fcae89700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fc415ac30 con 0x7f7fc40689d0 2023-10-06T11:12:32.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.747+0000 7f7fcae89700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fc4068e50 con 0x7f7fc4153e80 2023-10-06T11:12:32.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.747+0000 7f7fcae89700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc40b4510 con 0x7f7fc4153ab0 2023-10-06T11:12:32.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.747+0000 7f7fbbfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7fc4153e80 0x7f7fc4068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:32.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.747+0000 7f7fc9426700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7fc40689d0 0x7f7fc415d270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:54030/0 (socket says 172.21.15.146:54030) 2023-10-06T11:12:32.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.747+0000 7f7fc9426700 1 -- 172.21.15.146:0/1332455412 learned_addr learned my addr 172.21.15.146:0/1332455412 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:12:32.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.747+0000 7f7fc8c25700 1 --2- 172.21.15.146:0/1332455412 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7fc4153ab0 0x7f7fc415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:32.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.747+0000 7f7fbbfff700 1 -- 172.21.15.146:0/1332455412 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7fc4153ab0 msgr2=0x7f7fc415a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:32.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.747+0000 7f7fbbfff700 1 --2- 172.21.15.146:0/1332455412 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7fc4153ab0 0x7f7fc415a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:32.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.747+0000 7f7fbbfff700 1 -- 172.21.15.146:0/1332455412 >> v1:172.21.15.146:6789/0 conn(0x7f7fc40689d0 legacy=0x7f7fc415d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:32.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.747+0000 7f7fbb7fe700 1 -- 172.21.15.146:0/1332455412 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1258426469 0 0) 0x7f7fbc001490 con 0x7f7fc40689d0 2023-10-06T11:12:32.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.747+0000 7f7fbbfff700 1 -- 172.21.15.146:0/1332455412 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc40b6530 con 0x7f7fc4153e80 2023-10-06T11:12:32.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.747+0000 7f7fbbfff700 1 --2- 172.21.15.146:0/1332455412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fc4153e80 0x7f7fc4068490 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f7fb40098e0 tx=0x7f7fb40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4c8796d38199d51 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:32.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.747+0000 7f7fbb7fe700 1 -- 172.21.15.146:0/1332455412 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4009e80 con 0x7f7fc4153e80 2023-10-06T11:12:32.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.747+0000 7f7fbb7fe700 1 -- 172.21.15.146:0/1332455412 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb400b860 con 0x7f7fc4153e80 2023-10-06T11:12:32.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.747+0000 7f7fbb7fe700 1 -- 172.21.15.146:0/1332455412 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb400bbe0 con 0x7f7fc4153e80 2023-10-06T11:12:32.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.748+0000 7f7fcae89700 1 -- 172.21.15.146:0/1332455412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fc4153e80 msgr2=0x7f7fc4068490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:32.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.748+0000 7f7fcae89700 1 --2- 172.21.15.146:0/1332455412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fc4153e80 0x7f7fc4068490 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f7fb40098e0 tx=0x7f7fb40091a0 comp rx=0 tx=0).stop 2023-10-06T11:12:32.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.748+0000 7f7fcae89700 1 -- 172.21.15.146:0/1332455412 shutdown_connections 2023-10-06T11:12:32.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.748+0000 7f7fcae89700 1 --2- 172.21.15.146:0/1332455412 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7fc4153ab0 0x7f7fc415a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:32.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.748+0000 7f7fcae89700 1 --2- 172.21.15.146:0/1332455412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fc4153e80 0x7f7fc4068490 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:32.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.748+0000 7f7fcae89700 1 -- 172.21.15.146:0/1332455412 >> 172.21.15.146:0/1332455412 conn(0x7f7fc406eba0 msgr2=0x7f7fc406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:32.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.748+0000 7f7fcae89700 1 -- 172.21.15.146:0/1332455412 shutdown_connections 2023-10-06T11:12:32.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.748+0000 7f7fcae89700 1 -- 172.21.15.146:0/1332455412 wait complete. 2023-10-06T11:12:32.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.749+0000 7f7fcae89700 1 Processor -- start 2023-10-06T11:12:32.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.749+0000 7f7fcae89700 1 -- start start 2023-10-06T11:12:32.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.750+0000 7f7fcae89700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fc40689d0 0x7f7fc4157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:32.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.750+0000 7f7fcae89700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7fc4153ab0 0x7f7fc4150010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:32.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.750+0000 7f7fcae89700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7fc4153e80 0x7f7fc40b1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:32.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.750+0000 7f7fcae89700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc4154fd0 con 0x7f7fc40689d0 2023-10-06T11:12:32.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.750+0000 7f7fcae89700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc4150550 con 0x7f7fc4153e80 2023-10-06T11:12:32.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.750+0000 7f7fcae89700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc41543c0 con 0x7f7fc4153ab0 2023-10-06T11:12:32.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.750+0000 7f7fc8c25700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fc40689d0 0x7f7fc4157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:32.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.750+0000 7f7fc8c25700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fc40689d0 0x7f7fc4157390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33218/0 (socket says 172.21.15.146:33218) 2023-10-06T11:12:32.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.750+0000 7f7fc8c25700 1 -- 172.21.15.146:0/3351568956 learned_addr learned my addr 172.21.15.146:0/3351568956 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:32.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.750+0000 7f7fc8c25700 1 -- 172.21.15.146:0/3351568956 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7fc4153ab0 msgr2=0x7f7fc4150010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:32.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.750+0000 7f7fc8c25700 1 --2- 172.21.15.146:0/3351568956 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7fc4153ab0 0x7f7fc4150010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:32.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.750+0000 7f7fc8c25700 1 -- 172.21.15.146:0/3351568956 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7fc4153e80 msgr2=0x7f7fc40b1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:32.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.750+0000 7f7fc8c25700 1 --2- 172.21.15.146:0/3351568956 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7fc4153e80 0x7f7fc40b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:32.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.750+0000 7f7fc8c25700 1 -- 172.21.15.146:0/3351568956 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb4009420 con 0x7f7fc40689d0 2023-10-06T11:12:32.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.750+0000 7f7fc8c25700 1 --2- 172.21.15.146:0/3351568956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fc40689d0 0x7f7fc4157390 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f7fc000c7d0 tx=0x7f7fc0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:32.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.751+0000 7f7fb8ff9700 1 -- 172.21.15.146:0/3351568956 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc0011600 con 0x7f7fc40689d0 2023-10-06T11:12:32.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.751+0000 7f7fb8ff9700 1 -- 172.21.15.146:0/3351568956 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc0011760 con 0x7f7fc40689d0 2023-10-06T11:12:32.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.751+0000 7f7fcae89700 1 -- 172.21.15.146:0/3351568956 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fc41546a0 con 0x7f7fc40689d0 2023-10-06T11:12:32.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.751+0000 7f7fb8ff9700 1 -- 172.21.15.146:0/3351568956 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc0011b00 con 0x7f7fc40689d0 2023-10-06T11:12:32.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.751+0000 7f7fcae89700 1 -- 172.21.15.146:0/3351568956 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fc4154c60 con 0x7f7fc40689d0 2023-10-06T11:12:32.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.752+0000 7f7fcae89700 1 -- 172.21.15.146:0/3351568956 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fc404c380 con 0x7f7fc40689d0 2023-10-06T11:12:32.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.752+0000 7f7fb8ff9700 1 -- 172.21.15.146:0/3351568956 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7fc0010350 con 0x7f7fc40689d0 2023-10-06T11:12:32.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.752+0000 7f7fb8ff9700 1 --2- 172.21.15.146:0/3351568956 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7fb0066f30 0x7f7fb00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:32.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.752+0000 7f7fb8ff9700 1 -- 172.21.15.146:0/3351568956 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6086+0+0 (secure 0 0 0) 0x7f7fc0084660 con 0x7f7fc40689d0 2023-10-06T11:12:32.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.752+0000 7f7fbbfff700 1 --2- 172.21.15.146:0/3351568956 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7fb0066f30 0x7f7fb00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:32.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.753+0000 7f7fbbfff700 1 --2- 172.21.15.146:0/3351568956 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7fb0066f30 0x7f7fb00693e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f7fb40098e0 tx=0x7f7fb4017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:32.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.757+0000 7f7fb8ff9700 1 -- 172.21.15.146:0/3351568956 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7fc00551e0 con 0x7f7fc40689d0 2023-10-06T11:12:32.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.979+0000 7f7fcae89700 1 -- 172.21.15.146:0/3351568956 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7fc40b3720 con 0x7f7fc40689d0 2023-10-06T11:12:32.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.980+0000 7f7fb8ff9700 1 -- 172.21.15.146:0/3351568956 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+4612 (secure 0 0 0) 0x7f7fc0054d70 con 0x7f7fc40689d0 2023-10-06T11:12:32.982 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:12:32.982 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":77,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6274,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3700176588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3700176588},{"type":"v1","addr":"172.21.15.151:6834","nonce":3700176588}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6771,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/3753626989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3753626989},{"type":"v1","addr":"172.21.15.146:6836","nonce":3753626989}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6774,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/1712863503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":1712863503},{"type":"v1","addr":"172.21.15.146:6837","nonce":1712863503}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[{"mdsmap":{"epoch":77,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":2,"explicitly_allowed_features":2,"created":"2023-10-06T11:10:35.928535+0000","modified":"2023-10-06T11:12:13.377111+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6786},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6786":{"gid":6786,"name":"b","rank":0,"incarnation":60,"state":"up:active","state_seq":27,"addr":"172.21.15.151:6835/3649668257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":3649668257},{"type":"v1","addr":"172.21.15.151:6835","nonce":3649668257}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-06T11:12:32.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.982+0000 7f7fcae89700 1 -- 172.21.15.146:0/3351568956 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7fb0066f30 msgr2=0x7f7fb00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:32.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.982+0000 7f7fcae89700 1 --2- 172.21.15.146:0/3351568956 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7fb0066f30 0x7f7fb00693e0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f7fb40098e0 tx=0x7f7fb4017000 comp rx=0 tx=0).stop 2023-10-06T11:12:32.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.982+0000 7f7fcae89700 1 -- 172.21.15.146:0/3351568956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fc40689d0 msgr2=0x7f7fc4157390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:32.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.982+0000 7f7fcae89700 1 --2- 172.21.15.146:0/3351568956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fc40689d0 0x7f7fc4157390 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f7fc000c7d0 tx=0x7f7fc0008040 comp rx=0 tx=0).stop 2023-10-06T11:12:32.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.982+0000 7f7fcae89700 1 -- 172.21.15.146:0/3351568956 shutdown_connections 2023-10-06T11:12:32.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.982+0000 7f7fcae89700 1 --2- 172.21.15.146:0/3351568956 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7fb0066f30 0x7f7fb00693e0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:32.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.982+0000 7f7fcae89700 1 --2- 172.21.15.146:0/3351568956 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7fc4153e80 0x7f7fc40b1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:32.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.982+0000 7f7fcae89700 1 --2- 172.21.15.146:0/3351568956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7fc40689d0 0x7f7fc4157390 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:32.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.982+0000 7f7fcae89700 1 --2- 172.21.15.146:0/3351568956 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7fc4153ab0 0x7f7fc4150010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:32.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.982+0000 7f7fcae89700 1 -- 172.21.15.146:0/3351568956 >> 172.21.15.146:0/3351568956 conn(0x7f7fc406eba0 msgr2=0x7f7fc40d0870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:32.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.982+0000 7f7fcae89700 1 -- 172.21.15.146:0/3351568956 shutdown_connections 2023-10-06T11:12:32.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:32.982+0000 7f7fcae89700 1 -- 172.21.15.146:0/3351568956 wait complete. 2023-10-06T11:12:32.986 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 77 2023-10-06T11:12:32.996 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:12:33.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.110+0000 7fccf6d4a700 1 Processor -- start 2023-10-06T11:12:33.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.110+0000 7fccf6d4a700 1 -- start start 2023-10-06T11:12:33.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.111+0000 7fccf6d4a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fccf0068ba0 0x7fccf015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:33.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.111+0000 7fccf6d4a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccf015ac30 con 0x7fccf0153ab0 2023-10-06T11:12:33.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.111+0000 7fccf6d4a700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccf00b4510 con 0x7fccf0153e80 2023-10-06T11:12:33.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.111+0000 7fccf6d4a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccf00b6530 con 0x7fccf0068ba0 2023-10-06T11:12:33.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.111+0000 7fccf4ae6700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fccf0153ab0 0x7fccf0068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:54036/0 (socket says 172.21.15.146:54036) 2023-10-06T11:12:33.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.111+0000 7fccf4ae6700 1 -- 172.21.15.146:0/437974060 learned_addr learned my addr 172.21.15.146:0/437974060 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:12:33.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.111+0000 7fcce7fff700 1 --2- 172.21.15.146:0/437974060 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fccf0068ba0 0x7fccf015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:33.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.112+0000 7fcce77fe700 1 -- 172.21.15.146:0/437974060 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1404612220 0 0) 0x7fccec001490 con 0x7fccf0153ab0 2023-10-06T11:12:33.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.112+0000 7fcce77fe700 1 -- 172.21.15.146:0/437974060 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccd8003570 con 0x7fccf0153ab0 2023-10-06T11:12:33.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.112+0000 7fcce77fe700 1 -- 172.21.15.146:0/437974060 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 329620941 0 0) 0x7fccf00b4510 con 0x7fccf0153e80 2023-10-06T11:12:33.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.112+0000 7fcce77fe700 1 -- 172.21.15.146:0/437974060 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccec001490 con 0x7fccf0153e80 2023-10-06T11:12:33.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.112+0000 7fcce77fe700 1 -- 172.21.15.146:0/437974060 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2650962986 0 0) 0x7fccd8003570 con 0x7fccf0153ab0 2023-10-06T11:12:33.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.112+0000 7fcce77fe700 1 -- 172.21.15.146:0/437974060 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fccf0068ba0 msgr2=0x7fccf015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:33.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.112+0000 7fcce77fe700 1 --2- 172.21.15.146:0/437974060 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fccf0068ba0 0x7fccf015a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:33.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.112+0000 7fcce77fe700 1 -- 172.21.15.146:0/437974060 >> v1:172.21.15.151:6789/0 conn(0x7fccf0153e80 legacy=0x7fccf00b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:33.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.112+0000 7fcce77fe700 1 -- 172.21.15.146:0/437974060 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf00b5c50 con 0x7fccf0153ab0 2023-10-06T11:12:33.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.112+0000 7fcce77fe700 1 -- 172.21.15.146:0/437974060 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fccec001980 con 0x7fccf0153ab0 2023-10-06T11:12:33.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.112+0000 7fcce7fff700 1 --2- 172.21.15.146:0/437974060 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fccf0068ba0 0x7fccf015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:12:33.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.112+0000 7fcce77fe700 1 -- 172.21.15.146:0/437974060 >> v1:172.21.15.146:6789/0 conn(0x7fccf0153ab0 legacy=0x7fccf0068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:33.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.112+0000 7fcce77fe700 1 --2- 172.21.15.146:0/437974060 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccd8003c20 0x7fccd8004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:33.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.112+0000 7fcce77fe700 1 --2- 172.21.15.146:0/437974060 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fccf0068ba0 0x7fccd8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:33.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.112+0000 7fcce77fe700 1 --2- 172.21.15.146:0/437974060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fccd8004d50 0x7fccd80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:33.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.112+0000 7fcce77fe700 1 -- 172.21.15.146:0/437974060 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf00b6530 con 0x7fccd8003c20 2023-10-06T11:12:33.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.112+0000 7fcce77fe700 1 -- 172.21.15.146:0/437974060 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd800bb10 con 0x7fccd8004d50 2023-10-06T11:12:33.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.112+0000 7fcce77fe700 1 -- 172.21.15.146:0/437974060 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd800bcd0 con 0x7fccf0068ba0 2023-10-06T11:12:33.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.112+0000 7fccf4ae6700 1 --2- 172.21.15.146:0/437974060 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccd8003c20 0x7fccd8004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:33.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.112+0000 7fcce7fff700 1 --2- 172.21.15.146:0/437974060 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fccf0068ba0 0x7fccd8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:33.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.112+0000 7fccf52e7700 1 --2- 172.21.15.146:0/437974060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fccd8004d50 0x7fccd80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:33.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.112+0000 7fccf4ae6700 1 -- 172.21.15.146:0/437974060 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fccf0068ba0 msgr2=0x7fccd8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:33.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.112+0000 7fccf4ae6700 1 --2- 172.21.15.146:0/437974060 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fccf0068ba0 0x7fccd8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:33.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.112+0000 7fccf4ae6700 1 -- 172.21.15.146:0/437974060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fccd8004d50 msgr2=0x7fccd80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:33.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.112+0000 7fccf4ae6700 1 --2- 172.21.15.146:0/437974060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fccd8004d50 0x7fccd80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:33.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.112+0000 7fccf4ae6700 1 -- 172.21.15.146:0/437974060 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcce0009420 con 0x7fccd8003c20 2023-10-06T11:12:33.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.112+0000 7fcce7fff700 1 --2- 172.21.15.146:0/437974060 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fccf0068ba0 0x7fccd8004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:12:33.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.112+0000 7fccf52e7700 1 --2- 172.21.15.146:0/437974060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fccd8004d50 0x7fccd80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:12:33.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.113+0000 7fccf4ae6700 1 --2- 172.21.15.146:0/437974060 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccd8003c20 0x7fccd8004010 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fccec00aa80 tx=0x7fccf00b3db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=829b8e2edabb3674 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:33.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.113+0000 7fcce77fe700 1 -- 172.21.15.146:0/437974060 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccec00a410 con 0x7fccd8003c20 2023-10-06T11:12:33.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.113+0000 7fcce77fe700 1 -- 172.21.15.146:0/437974060 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccec00c5d0 con 0x7fccd8003c20 2023-10-06T11:12:33.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.113+0000 7fcce77fe700 1 -- 172.21.15.146:0/437974060 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccec00c970 con 0x7fccd8003c20 2023-10-06T11:12:33.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.113+0000 7fccf6d4a700 1 -- 172.21.15.146:0/437974060 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccd8003c20 msgr2=0x7fccd8004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:33.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.113+0000 7fccf6d4a700 1 --2- 172.21.15.146:0/437974060 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccd8003c20 0x7fccd8004010 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fccec00aa80 tx=0x7fccf00b3db0 comp rx=0 tx=0).stop 2023-10-06T11:12:33.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.113+0000 7fccf52e7700 1 -- 172.21.15.146:0/437974060 reap_dead start 2023-10-06T11:12:33.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.113+0000 7fccf6d4a700 1 -- 172.21.15.146:0/437974060 shutdown_connections 2023-10-06T11:12:33.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.113+0000 7fccf6d4a700 1 -- 172.21.15.146:0/437974060 >> 172.21.15.146:0/437974060 conn(0x7fccf006eba0 msgr2=0x7fccf006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:33.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.113+0000 7fccf6d4a700 1 -- 172.21.15.146:0/437974060 shutdown_connections 2023-10-06T11:12:33.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.113+0000 7fccf6d4a700 1 -- 172.21.15.146:0/437974060 wait complete. 2023-10-06T11:12:33.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.114+0000 7fccf6d4a700 1 Processor -- start 2023-10-06T11:12:33.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.114+0000 7fccf6d4a700 1 -- start start 2023-10-06T11:12:33.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.115+0000 7fccf6d4a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fccd8003c20 0x7fccf0152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:33.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.115+0000 7fccf6d4a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fccf00afec0 0x7fccf00b0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:33.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.115+0000 7fccf6d4a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccf0148210 0x7fccf0148680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:33.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.115+0000 7fccf6d4a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf0149880 con 0x7fccf0148210 2023-10-06T11:12:33.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.115+0000 7fccf6d4a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf0148bc0 con 0x7fccd8003c20 2023-10-06T11:12:33.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.115+0000 7fccf6d4a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccf00b0960 con 0x7fccf00afec0 2023-10-06T11:12:33.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.115+0000 7fccf52e7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccf0148210 0x7fccf0148680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:33.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.115+0000 7fccf52e7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccf0148210 0x7fccf0148680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33232/0 (socket says 172.21.15.146:33232) 2023-10-06T11:12:33.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.115+0000 7fccf52e7700 1 -- 172.21.15.146:0/3023030504 learned_addr learned my addr 172.21.15.146:0/3023030504 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:33.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.115+0000 7fccf4ae6700 1 --2- 172.21.15.146:0/3023030504 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fccd8003c20 0x7fccf0152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:33.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.115+0000 7fcce7fff700 1 --2- 172.21.15.146:0/3023030504 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fccf00afec0 0x7fccf00b0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:33.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.116+0000 7fccf52e7700 1 -- 172.21.15.146:0/3023030504 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fccf00afec0 msgr2=0x7fccf00b0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:33.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.116+0000 7fccf52e7700 1 --2- 172.21.15.146:0/3023030504 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fccf00afec0 0x7fccf00b0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:33.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.116+0000 7fccf52e7700 1 -- 172.21.15.146:0/3023030504 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fccd8003c20 msgr2=0x7fccf0152c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:33.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.116+0000 7fccf52e7700 1 --2- 172.21.15.146:0/3023030504 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fccd8003c20 0x7fccf0152c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:33.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.116+0000 7fccf52e7700 1 -- 172.21.15.146:0/3023030504 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf0149ad0 con 0x7fccf0148210 2023-10-06T11:12:33.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.116+0000 7fccf4ae6700 1 --2- 172.21.15.146:0/3023030504 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fccd8003c20 0x7fccf0152c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:12:33.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.116+0000 7fcce7fff700 1 --2- 172.21.15.146:0/3023030504 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fccf00afec0 0x7fccf00b0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:12:33.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.116+0000 7fccf52e7700 1 --2- 172.21.15.146:0/3023030504 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccf0148210 0x7fccf0148680 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fccf015d1a0 tx=0x7fcce8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:33.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.116+0000 7fcce4ff9700 1 -- 172.21.15.146:0/3023030504 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce8017070 con 0x7fccf0148210 2023-10-06T11:12:33.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.116+0000 7fcce4ff9700 1 -- 172.21.15.146:0/3023030504 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce8006820 con 0x7fccf0148210 2023-10-06T11:12:33.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.116+0000 7fccf6d4a700 1 -- 172.21.15.146:0/3023030504 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccf0149db0 con 0x7fccf0148210 2023-10-06T11:12:33.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.116+0000 7fcce4ff9700 1 -- 172.21.15.146:0/3023030504 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce800b070 con 0x7fccf0148210 2023-10-06T11:12:33.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.116+0000 7fccf6d4a700 1 -- 172.21.15.146:0/3023030504 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccf014cb40 con 0x7fccf0148210 2023-10-06T11:12:33.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.117+0000 7fccf6d4a700 1 -- 172.21.15.146:0/3023030504 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccf014a2d0 con 0x7fccf0148210 2023-10-06T11:12:33.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.117+0000 7fcce4ff9700 1 -- 172.21.15.146:0/3023030504 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcce8007030 con 0x7fccf0148210 2023-10-06T11:12:33.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.117+0000 7fcce4ff9700 1 --2- 172.21.15.146:0/3023030504 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fccdc066f60 0x7fccdc069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:33.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.118+0000 7fcce4ff9700 1 -- 172.21.15.146:0/3023030504 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6086+0+0 (secure 0 0 0) 0x7fcce8084020 con 0x7fccf0148210 2023-10-06T11:12:33.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.118+0000 7fccf4ae6700 1 --2- 172.21.15.146:0/3023030504 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fccdc066f60 0x7fccdc069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:33.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.118+0000 7fccf4ae6700 1 --2- 172.21.15.146:0/3023030504 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fccdc066f60 0x7fccdc069410 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fccec00a0b0 tx=0x7fccec016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:33.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.122+0000 7fcce4ff9700 1 -- 172.21.15.146:0/3023030504 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fccf014a2d0 con 0x7fccf0148210 2023-10-06T11:12:33.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.307+0000 7fccf6d4a700 1 -- 172.21.15.146:0/3023030504 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fccf014a2d0 con 0x7fccf0148210 2023-10-06T11:12:33.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.308+0000 7fcce4ff9700 1 -- 172.21.15.146:0/3023030504 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+16983 (secure 0 0 0) 0x7fccf014a2d0 con 0x7fccf0148210 2023-10-06T11:12:33.310 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:12:33.310 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":77,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:12:10.356730+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:10:33.590163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-10-06T11:10:34.892777+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":3,"snap_epoch":76,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":12,"snaps":[{"begin":2,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:12:33.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.310+0000 7fccf6d4a700 1 -- 172.21.15.146:0/3023030504 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fccdc066f60 msgr2=0x7fccdc069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:33.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.310+0000 7fccf6d4a700 1 --2- 172.21.15.146:0/3023030504 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fccdc066f60 0x7fccdc069410 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fccec00a0b0 tx=0x7fccec016000 comp rx=0 tx=0).stop 2023-10-06T11:12:33.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.310+0000 7fccf6d4a700 1 -- 172.21.15.146:0/3023030504 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccf0148210 msgr2=0x7fccf0148680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:33.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.310+0000 7fccf6d4a700 1 --2- 172.21.15.146:0/3023030504 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccf0148210 0x7fccf0148680 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fccf015d1a0 tx=0x7fcce8009040 comp rx=0 tx=0).stop 2023-10-06T11:12:33.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.310+0000 7fccf6d4a700 1 -- 172.21.15.146:0/3023030504 shutdown_connections 2023-10-06T11:12:33.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.310+0000 7fccf6d4a700 1 --2- 172.21.15.146:0/3023030504 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fccdc066f60 0x7fccdc069410 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:33.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.310+0000 7fccf6d4a700 1 --2- 172.21.15.146:0/3023030504 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fccf0148210 0x7fccf0148680 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:33.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.310+0000 7fccf6d4a700 1 --2- 172.21.15.146:0/3023030504 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fccd8003c20 0x7fccf0152c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:33.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.310+0000 7fccf6d4a700 1 --2- 172.21.15.146:0/3023030504 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fccf00afec0 0x7fccf00b0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:33.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.310+0000 7fccf6d4a700 1 -- 172.21.15.146:0/3023030504 >> 172.21.15.146:0/3023030504 conn(0x7fccf006eba0 msgr2=0x7fccf0148ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:33.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.310+0000 7fccf6d4a700 1 -- 172.21.15.146:0/3023030504 shutdown_connections 2023-10-06T11:12:33.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.310+0000 7fccf6d4a700 1 -- 172.21.15.146:0/3023030504 wait complete. 2023-10-06T11:12:33.324 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T11:12:33.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.441+0000 7f30a38f4700 1 Processor -- start 2023-10-06T11:12:33.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.441+0000 7f30a38f4700 1 -- start start 2023-10-06T11:12:33.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.442+0000 7f30a38f4700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f309c1574b0 0x7f309c0ae470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:33.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.442+0000 7f30a38f4700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f309c157880 0x7f309c0b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:33.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.442+0000 7f30a38f4700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f309c0cbcf0 con 0x7f309c0b1830 2023-10-06T11:12:33.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.442+0000 7f30a38f4700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f309c0b1cd0 con 0x7f309c1574b0 2023-10-06T11:12:33.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.442+0000 7f30a38f4700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f309c0cb170 con 0x7f309c157880 2023-10-06T11:12:33.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.442+0000 7f30a1690700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f309c1574b0 0x7f309c0ae470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:33.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.442+0000 7f30a0e8f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f309c157880 0x7f309c0b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:33.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.442+0000 7f30a1e91700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f309c0b1830 0x7f309c15b220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:57000/0 (socket says 172.21.15.146:57000) 2023-10-06T11:12:33.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.442+0000 7f30a1e91700 1 -- 172.21.15.146:0/1512081088 learned_addr learned my addr 172.21.15.146:0/1512081088 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:12:33.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.442+0000 7f30a1690700 1 -- 172.21.15.146:0/1512081088 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f309c157880 msgr2=0x7f309c0b12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:33.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.442+0000 7f30a1690700 1 --2- 172.21.15.146:0/1512081088 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f309c157880 0x7f309c0b12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:33.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.442+0000 7f30a1690700 1 -- 172.21.15.146:0/1512081088 >> v1:172.21.15.151:6789/0 conn(0x7f309c0b1830 legacy=0x7f309c15b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:33.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.442+0000 7f30a1690700 1 -- 172.21.15.146:0/1512081088 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f309c0cb450 con 0x7f309c1574b0 2023-10-06T11:12:33.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.442+0000 7f3093fff700 1 -- 172.21.15.146:0/1512081088 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2683164393 0 0) 0x7f309c0cbcf0 con 0x7f309c0b1830 2023-10-06T11:12:33.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.442+0000 7f30a0e8f700 1 --2- 172.21.15.146:0/1512081088 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f309c157880 0x7f309c0b12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:12:33.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.443+0000 7f30a1690700 1 --2- 172.21.15.146:0/1512081088 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f309c1574b0 0x7f309c0ae470 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f30980098e0 tx=0x7f30980091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fd50932574b3b0e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:33.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.443+0000 7f3093fff700 1 -- 172.21.15.146:0/1512081088 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309800b640 con 0x7f309c1574b0 2023-10-06T11:12:33.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.443+0000 7f3093fff700 1 -- 172.21.15.146:0/1512081088 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f309800b7a0 con 0x7f309c1574b0 2023-10-06T11:12:33.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.443+0000 7f3093fff700 1 -- 172.21.15.146:0/1512081088 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309800bb40 con 0x7f309c1574b0 2023-10-06T11:12:33.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.443+0000 7f30a38f4700 1 -- 172.21.15.146:0/1512081088 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f309c1574b0 msgr2=0x7f309c0ae470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:33.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.443+0000 7f30a38f4700 1 --2- 172.21.15.146:0/1512081088 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f309c1574b0 0x7f309c0ae470 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f30980098e0 tx=0x7f30980091a0 comp rx=0 tx=0).stop 2023-10-06T11:12:33.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.443+0000 7f30a38f4700 1 -- 172.21.15.146:0/1512081088 shutdown_connections 2023-10-06T11:12:33.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.443+0000 7f30a38f4700 1 --2- 172.21.15.146:0/1512081088 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f309c1574b0 0x7f309c0ae470 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:33.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.443+0000 7f30a38f4700 1 --2- 172.21.15.146:0/1512081088 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f309c157880 0x7f309c0b12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:33.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.443+0000 7f30a38f4700 1 -- 172.21.15.146:0/1512081088 >> 172.21.15.146:0/1512081088 conn(0x7f309c06a070 msgr2=0x7f309c067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:33.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.443+0000 7f30a38f4700 1 -- 172.21.15.146:0/1512081088 shutdown_connections 2023-10-06T11:12:33.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.443+0000 7f30a38f4700 1 -- 172.21.15.146:0/1512081088 wait complete. 2023-10-06T11:12:33.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.444+0000 7f30a38f4700 1 Processor -- start 2023-10-06T11:12:33.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.444+0000 7f30a38f4700 1 -- start start 2023-10-06T11:12:33.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.445+0000 7f30a38f4700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f309c0b1830 0x7f309c168190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:33.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.445+0000 7f30a38f4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f309c1574b0 0x7f309c14b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:33.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.445+0000 7f30a38f4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f309c157880 0x7f309c14ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:33.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.445+0000 7f30a38f4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309c159140 con 0x7f309c1574b0 2023-10-06T11:12:33.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.445+0000 7f30a38f4700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309c1686d0 con 0x7f309c157880 2023-10-06T11:12:33.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.445+0000 7f30a38f4700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f309c14be50 con 0x7f309c0b1830 2023-10-06T11:12:33.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.445+0000 7f30a0e8f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f309c1574b0 0x7f309c14b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:33.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.445+0000 7f30a0e8f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f309c1574b0 0x7f309c14b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33248/0 (socket says 172.21.15.146:33248) 2023-10-06T11:12:33.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.445+0000 7f30a0e8f700 1 -- 172.21.15.146:0/894299005 learned_addr learned my addr 172.21.15.146:0/894299005 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:33.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.446+0000 7f30a1690700 1 --2- 172.21.15.146:0/894299005 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f309c0b1830 0x7f309c168190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:33.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.446+0000 7f30a1e91700 1 --2- 172.21.15.146:0/894299005 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f309c157880 0x7f309c14ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:33.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.446+0000 7f30a0e8f700 1 -- 172.21.15.146:0/894299005 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f309c0b1830 msgr2=0x7f309c168190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:33.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.446+0000 7f30a0e8f700 1 --2- 172.21.15.146:0/894299005 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f309c0b1830 0x7f309c168190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:33.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.446+0000 7f30a0e8f700 1 -- 172.21.15.146:0/894299005 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f309c157880 msgr2=0x7f309c14ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:33.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.446+0000 7f30a0e8f700 1 --2- 172.21.15.146:0/894299005 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f309c157880 0x7f309c14ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:33.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.446+0000 7f30a0e8f700 1 -- 172.21.15.146:0/894299005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f308c009420 con 0x7f309c1574b0 2023-10-06T11:12:33.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.446+0000 7f30a1e91700 1 --2- 172.21.15.146:0/894299005 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f309c157880 0x7f309c14ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:12:33.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.446+0000 7f30a0e8f700 1 --2- 172.21.15.146:0/894299005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f309c1574b0 0x7f309c14b910 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f308c00ec80 tx=0x7f308c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:33.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.446+0000 7f30917fa700 1 -- 172.21.15.146:0/894299005 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308c00c850 con 0x7f309c1574b0 2023-10-06T11:12:33.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.446+0000 7f30917fa700 1 -- 172.21.15.146:0/894299005 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f308c00c9b0 con 0x7f309c1574b0 2023-10-06T11:12:33.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.446+0000 7f30a38f4700 1 -- 172.21.15.146:0/894299005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3098009420 con 0x7f309c1574b0 2023-10-06T11:12:33.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.446+0000 7f30917fa700 1 -- 172.21.15.146:0/894299005 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308c00cd30 con 0x7f309c1574b0 2023-10-06T11:12:33.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.446+0000 7f30a38f4700 1 -- 172.21.15.146:0/894299005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f309c169380 con 0x7f309c1574b0 2023-10-06T11:12:33.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.447+0000 7f30a38f4700 1 -- 172.21.15.146:0/894299005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f309c04c380 con 0x7f309c1574b0 2023-10-06T11:12:33.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.447+0000 7f30917fa700 1 -- 172.21.15.146:0/894299005 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f308c013680 con 0x7f309c1574b0 2023-10-06T11:12:33.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.448+0000 7f30917fa700 1 --2- 172.21.15.146:0/894299005 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3080066f30 0x7f30800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:33.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.448+0000 7f30917fa700 1 -- 172.21.15.146:0/894299005 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6086+0+0 (secure 0 0 0) 0x7f308c084ce0 con 0x7f309c1574b0 2023-10-06T11:12:33.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.448+0000 7f30a1690700 1 --2- 172.21.15.146:0/894299005 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3080066f30 0x7f30800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:33.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.448+0000 7f30a1690700 1 --2- 172.21.15.146:0/894299005 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3080066f30 0x7f30800693e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f30980093f0 tx=0x7f3098017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:33.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.452+0000 7f30917fa700 1 -- 172.21.15.146:0/894299005 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f308c055860 con 0x7f309c1574b0 2023-10-06T11:12:33.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.678+0000 7f30a38f4700 1 -- 172.21.15.146:0/894299005 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f309c153bf0 con 0x7f309c1574b0 2023-10-06T11:12:33.680 INFO:tasks.ceph.mon.a.smithi146.stderr:2023-10-06T11:12:33.679+0000 7f011baa1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T11:12:33.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.683+0000 7f30917fa700 1 -- 172.21.15.146:0/894299005 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v78) v1 ==== 161+0+0 (secure 0 0 0) 0x7f308c017090 con 0x7f309c1574b0 2023-10-06T11:12:33.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.685+0000 7f30a38f4700 1 -- 172.21.15.146:0/894299005 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3080066f30 msgr2=0x7f30800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:33.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.685+0000 7f30a38f4700 1 --2- 172.21.15.146:0/894299005 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3080066f30 0x7f30800693e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f30980093f0 tx=0x7f3098017000 comp rx=0 tx=0).stop 2023-10-06T11:12:33.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.685+0000 7f30a38f4700 1 -- 172.21.15.146:0/894299005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f309c1574b0 msgr2=0x7f309c14b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:33.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.685+0000 7f30a38f4700 1 --2- 172.21.15.146:0/894299005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f309c1574b0 0x7f309c14b910 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f308c00ec80 tx=0x7f308c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:12:33.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.685+0000 7f30a38f4700 1 -- 172.21.15.146:0/894299005 shutdown_connections 2023-10-06T11:12:33.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.685+0000 7f30a38f4700 1 --2- 172.21.15.146:0/894299005 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3080066f30 0x7f30800693e0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:33.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.685+0000 7f30a38f4700 1 --2- 172.21.15.146:0/894299005 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f309c157880 0x7f309c14ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:33.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.685+0000 7f30a38f4700 1 --2- 172.21.15.146:0/894299005 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f309c0b1830 0x7f309c168190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:33.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.685+0000 7f30a38f4700 1 --2- 172.21.15.146:0/894299005 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f309c1574b0 0x7f309c14b910 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:33.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.685+0000 7f30a38f4700 1 -- 172.21.15.146:0/894299005 >> 172.21.15.146:0/894299005 conn(0x7f309c06a070 msgr2=0x7f309c1543f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:33.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.685+0000 7f30a38f4700 1 -- 172.21.15.146:0/894299005 shutdown_connections 2023-10-06T11:12:33.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.685+0000 7f30a38f4700 1 -- 172.21.15.146:0/894299005 wait complete. 2023-10-06T11:12:33.690 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T11:12:33.700 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T11:12:33.722 INFO:tasks.ceph.mds.b.smithi151.stdout:starting mds.b at 2023-10-06T11:12:33.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.818+0000 7f8571c6d700 1 Processor -- start 2023-10-06T11:12:33.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.818+0000 7f8571c6d700 1 -- start start 2023-10-06T11:12:33.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.819+0000 7f8571c6d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f856c159a60 0x7f856c0b11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:33.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.819+0000 7f8571c6d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f856c0cee10 0x7f856c0cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:33.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.819+0000 7f8571c6d700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f856c0cc830 con 0x7f856c0cd200 2023-10-06T11:12:33.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.819+0000 7f8571c6d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f856c0cbf40 con 0x7f856c0cee10 2023-10-06T11:12:33.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.819+0000 7f8571c6d700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f856c0ca490 con 0x7f856c159a60 2023-10-06T11:12:33.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.819+0000 7f856affd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f856c0cee10 0x7f856c0cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:33.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.819+0000 7f856affd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f856c0cee10 0x7f856c0cccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33260/0 (socket says 172.21.15.146:33260) 2023-10-06T11:12:33.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.819+0000 7f856affd700 1 -- 172.21.15.146:0/359554554 learned_addr learned my addr 172.21.15.146:0/359554554 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:33.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.820+0000 7f856b7fe700 1 --2- 172.21.15.146:0/359554554 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f856c159a60 0x7f856c0b11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:33.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.820+0000 7f856affd700 1 -- 172.21.15.146:0/359554554 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f856c159a60 msgr2=0x7f856c0b11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:33.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.820+0000 7f856affd700 1 --2- 172.21.15.146:0/359554554 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f856c159a60 0x7f856c0b11e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:33.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.820+0000 7f856affd700 1 -- 172.21.15.146:0/359554554 >> v1:172.21.15.151:6789/0 conn(0x7f856c0cd200 legacy=0x7f856c068580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:33.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.820+0000 7f856affd700 1 -- 172.21.15.146:0/359554554 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f856c0cf280 con 0x7f856c0cee10 2023-10-06T11:12:33.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.820+0000 7f856affd700 1 --2- 172.21.15.146:0/359554554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f856c0cee10 0x7f856c0cccc0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f85600099b0 tx=0x7f8560009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e419436cdcd5d96 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:33.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.820+0000 7f856a7fc700 1 -- 172.21.15.146:0/359554554 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856000b820 con 0x7f856c0cee10 2023-10-06T11:12:33.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.820+0000 7f856a7fc700 1 -- 172.21.15.146:0/359554554 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856000b980 con 0x7f856c0cee10 2023-10-06T11:12:33.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.820+0000 7f856a7fc700 1 -- 172.21.15.146:0/359554554 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856000bd20 con 0x7f856c0cee10 2023-10-06T11:12:33.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.820+0000 7f8571c6d700 1 -- 172.21.15.146:0/359554554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f856c0cee10 msgr2=0x7f856c0cccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:33.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.820+0000 7f8571c6d700 1 --2- 172.21.15.146:0/359554554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f856c0cee10 0x7f856c0cccc0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f85600099b0 tx=0x7f8560009250 comp rx=0 tx=0).stop 2023-10-06T11:12:33.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.820+0000 7f8571c6d700 1 -- 172.21.15.146:0/359554554 shutdown_connections 2023-10-06T11:12:33.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.820+0000 7f8571c6d700 1 --2- 172.21.15.146:0/359554554 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f856c159a60 0x7f856c0b11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:33.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.820+0000 7f8571c6d700 1 --2- 172.21.15.146:0/359554554 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f856c0cee10 0x7f856c0cccc0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:33.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.820+0000 7f8571c6d700 1 -- 172.21.15.146:0/359554554 >> 172.21.15.146:0/359554554 conn(0x7f856c067c50 msgr2=0x7f856c0ce410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:33.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.820+0000 7f8571c6d700 1 -- 172.21.15.146:0/359554554 shutdown_connections 2023-10-06T11:12:33.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.821+0000 7f8571c6d700 1 -- 172.21.15.146:0/359554554 wait complete. 2023-10-06T11:12:33.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.822+0000 7f8571c6d700 1 Processor -- start 2023-10-06T11:12:33.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.822+0000 7f8571c6d700 1 -- start start 2023-10-06T11:12:33.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.822+0000 7f8571c6d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f856c0cd200 0x7f856c0c27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:33.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.822+0000 7f8571c6d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f856c0cee10 0x7f856c0c2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:33.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.822+0000 7f8571c6d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f856c159a60 0x7f856c16a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:33.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.822+0000 7f8571c6d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856c16b230 con 0x7f856c159a60 2023-10-06T11:12:33.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.822+0000 7f8571c6d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856c16bad0 con 0x7f856c0cd200 2023-10-06T11:12:33.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.822+0000 7f8571c6d700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f856c0c3740 con 0x7f856c0cee10 2023-10-06T11:12:33.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.823+0000 7f856bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f856c159a60 0x7f856c16a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:33.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.823+0000 7f856b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f856c0cd200 0x7f856c0c27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:33.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.823+0000 7f856affd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f856c0cee10 0x7f856c0c2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:33.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.823+0000 7f856bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f856c159a60 0x7f856c16a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33264/0 (socket says 172.21.15.146:33264) 2023-10-06T11:12:33.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.823+0000 7f856bfff700 1 -- 172.21.15.146:0/2288805800 learned_addr learned my addr 172.21.15.146:0/2288805800 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:33.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.823+0000 7f856bfff700 1 -- 172.21.15.146:0/2288805800 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f856c0cee10 msgr2=0x7f856c0c2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:33.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.823+0000 7f856bfff700 1 --2- 172.21.15.146:0/2288805800 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f856c0cee10 0x7f856c0c2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:33.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.823+0000 7f856bfff700 1 -- 172.21.15.146:0/2288805800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f856c0cd200 msgr2=0x7f856c0c27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:33.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.823+0000 7f856bfff700 1 --2- 172.21.15.146:0/2288805800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f856c0cd200 0x7f856c0c27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:33.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.823+0000 7f856bfff700 1 -- 172.21.15.146:0/2288805800 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85600094f0 con 0x7f856c159a60 2023-10-06T11:12:33.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.823+0000 7f856bfff700 1 --2- 172.21.15.146:0/2288805800 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f856c159a60 0x7f856c16a060 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f856400b4e0 tx=0x7f8564006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:33.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.823+0000 7f85537fe700 1 -- 172.21.15.146:0/2288805800 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856400be90 con 0x7f856c159a60 2023-10-06T11:12:33.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.823+0000 7f85537fe700 1 -- 172.21.15.146:0/2288805800 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856400f510 con 0x7f856c159a60 2023-10-06T11:12:33.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.823+0000 7f8571c6d700 1 -- 172.21.15.146:0/2288805800 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f856c16b480 con 0x7f856c159a60 2023-10-06T11:12:33.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.823+0000 7f85537fe700 1 -- 172.21.15.146:0/2288805800 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856400f8d0 con 0x7f856c159a60 2023-10-06T11:12:33.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.823+0000 7f8571c6d700 1 -- 172.21.15.146:0/2288805800 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f856c0c3260 con 0x7f856c159a60 2023-10-06T11:12:33.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.824+0000 7f8571c6d700 1 -- 172.21.15.146:0/2288805800 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f856c16bc40 con 0x7f856c159a60 2023-10-06T11:12:33.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.825+0000 7f85537fe700 1 -- 172.21.15.146:0/2288805800 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f856400fd00 con 0x7f856c159a60 2023-10-06T11:12:33.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.825+0000 7f85537fe700 1 --2- 172.21.15.146:0/2288805800 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8558066f30 0x7f85580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:33.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.825+0000 7f856b7fe700 1 --2- 172.21.15.146:0/2288805800 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8558066f30 0x7f85580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:33.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.825+0000 7f85537fe700 1 -- 172.21.15.146:0/2288805800 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f8564084000 con 0x7f856c159a60 2023-10-06T11:12:33.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.826+0000 7f856b7fe700 1 --2- 172.21.15.146:0/2288805800 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8558066f30 0x7f85580693e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f856c16b1e0 tx=0x7f855c007840 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:33.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:33.829+0000 7f85537fe700 1 -- 172.21.15.146:0/2288805800 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8564051140 con 0x7f856c159a60 2023-10-06T11:12:34.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.054+0000 7f8571c6d700 1 -- 172.21.15.146:0/2288805800 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f856c0c34b0 con 0x7f856c159a60 2023-10-06T11:12:34.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.683+0000 7f85537fe700 1 -- 172.21.15.146:0/2288805800 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v79) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8564054760 con 0x7f856c159a60 2023-10-06T11:12:34.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.685+0000 7f8571c6d700 1 -- 172.21.15.146:0/2288805800 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8558066f30 msgr2=0x7f85580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:34.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.685+0000 7f8571c6d700 1 --2- 172.21.15.146:0/2288805800 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8558066f30 0x7f85580693e0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f856c16b1e0 tx=0x7f855c007840 comp rx=0 tx=0).stop 2023-10-06T11:12:34.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.685+0000 7f8571c6d700 1 -- 172.21.15.146:0/2288805800 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f856c159a60 msgr2=0x7f856c16a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:34.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.685+0000 7f8571c6d700 1 --2- 172.21.15.146:0/2288805800 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f856c159a60 0x7f856c16a060 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f856400b4e0 tx=0x7f8564006f90 comp rx=0 tx=0).stop 2023-10-06T11:12:34.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.686+0000 7f8571c6d700 1 -- 172.21.15.146:0/2288805800 shutdown_connections 2023-10-06T11:12:34.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.686+0000 7f8571c6d700 1 --2- 172.21.15.146:0/2288805800 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8558066f30 0x7f85580693e0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:34.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.686+0000 7f8571c6d700 1 --2- 172.21.15.146:0/2288805800 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f856c159a60 0x7f856c16a060 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:34.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.686+0000 7f8571c6d700 1 --2- 172.21.15.146:0/2288805800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f856c0cd200 0x7f856c0c27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:34.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.686+0000 7f8571c6d700 1 --2- 172.21.15.146:0/2288805800 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f856c0cee10 0x7f856c0c2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:34.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.686+0000 7f8571c6d700 1 -- 172.21.15.146:0/2288805800 >> 172.21.15.146:0/2288805800 conn(0x7f856c067c50 msgr2=0x7f856c0b3850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:34.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.686+0000 7f8571c6d700 1 -- 172.21.15.146:0/2288805800 shutdown_connections 2023-10-06T11:12:34.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.686+0000 7f8571c6d700 1 -- 172.21.15.146:0/2288805800 wait complete. 2023-10-06T11:12:34.700 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T11:12:34.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.817+0000 7f5a50f19700 1 Processor -- start 2023-10-06T11:12:34.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.817+0000 7f5a50f19700 1 -- start start 2023-10-06T11:12:34.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.818+0000 7f5a50f19700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a4c15cc20 0x7f5a4c15d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:34.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.818+0000 7f5a50f19700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5a4c15cff0 0x7f5a4c0d0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:34.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.818+0000 7f5a50f19700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a4c0cf030 con 0x7f5a4c0d0a80 2023-10-06T11:12:34.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.818+0000 7f5a50f19700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a4c15e390 con 0x7f5a4c15cff0 2023-10-06T11:12:34.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.818+0000 7f5a50f19700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c0ced20 con 0x7f5a4c15cc20 2023-10-06T11:12:34.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.818+0000 7f5a49d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5a4c15cff0 0x7f5a4c0d0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:34.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.818+0000 7f5a49d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5a4c15cff0 0x7f5a4c0d0540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33274/0 (socket says 172.21.15.146:33274) 2023-10-06T11:12:34.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.818+0000 7f5a49d9b700 1 -- 172.21.15.146:0/3251662302 learned_addr learned my addr 172.21.15.146:0/3251662302 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:34.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.818+0000 7f5a4a59c700 1 --2- 172.21.15.146:0/3251662302 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a4c15cc20 0x7f5a4c15d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:34.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.818+0000 7f5a49d9b700 1 -- 172.21.15.146:0/3251662302 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a4c15cc20 msgr2=0x7f5a4c15d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:34.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.818+0000 7f5a49d9b700 1 --2- 172.21.15.146:0/3251662302 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a4c15cc20 0x7f5a4c15d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:34.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.818+0000 7f5a49d9b700 1 -- 172.21.15.146:0/3251662302 >> v1:172.21.15.151:6789/0 conn(0x7f5a4c0d0a80 legacy=0x7f5a4c15a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:34.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.818+0000 7f5a49d9b700 1 -- 172.21.15.146:0/3251662302 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a4c0d0ea0 con 0x7f5a4c15cff0 2023-10-06T11:12:34.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.818+0000 7f5a49d9b700 1 --2- 172.21.15.146:0/3251662302 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a4c15cff0 0x7f5a4c0d0540 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f5a400099b0 tx=0x7f5a40009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d527221da3c86028 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:34.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.819+0000 7f5a4959a700 1 -- 172.21.15.146:0/3251662302 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4000b860 con 0x7f5a4c15cff0 2023-10-06T11:12:34.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.819+0000 7f5a4959a700 1 -- 172.21.15.146:0/3251662302 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a4000b9c0 con 0x7f5a4c15cff0 2023-10-06T11:12:34.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.819+0000 7f5a4959a700 1 -- 172.21.15.146:0/3251662302 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4000bd60 con 0x7f5a4c15cff0 2023-10-06T11:12:34.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.819+0000 7f5a50f19700 1 -- 172.21.15.146:0/3251662302 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a4c15cff0 msgr2=0x7f5a4c0d0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:34.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.819+0000 7f5a50f19700 1 --2- 172.21.15.146:0/3251662302 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a4c15cff0 0x7f5a4c0d0540 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f5a400099b0 tx=0x7f5a40009250 comp rx=0 tx=0).stop 2023-10-06T11:12:34.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.819+0000 7f5a50f19700 1 -- 172.21.15.146:0/3251662302 shutdown_connections 2023-10-06T11:12:34.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.819+0000 7f5a50f19700 1 --2- 172.21.15.146:0/3251662302 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a4c15cc20 0x7f5a4c15d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:34.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.819+0000 7f5a50f19700 1 --2- 172.21.15.146:0/3251662302 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a4c15cff0 0x7f5a4c0d0540 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:34.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.819+0000 7f5a50f19700 1 -- 172.21.15.146:0/3251662302 >> 172.21.15.146:0/3251662302 conn(0x7f5a4c06eba0 msgr2=0x7f5a4c06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:34.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.819+0000 7f5a50f19700 1 -- 172.21.15.146:0/3251662302 shutdown_connections 2023-10-06T11:12:34.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.819+0000 7f5a50f19700 1 -- 172.21.15.146:0/3251662302 wait complete. 2023-10-06T11:12:34.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.820+0000 7f5a50f19700 1 Processor -- start 2023-10-06T11:12:34.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.820+0000 7f5a50f19700 1 -- start start 2023-10-06T11:12:34.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.821+0000 7f5a50f19700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a4c0d0a80 0x7f5a4c156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:34.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.821+0000 7f5a50f19700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a4c15cc20 0x7f5a4c0cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:34.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.821+0000 7f5a50f19700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a4c15cff0 0x7f5a4c0b1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:34.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.821+0000 7f5a50f19700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c0c6340 con 0x7f5a4c0d0a80 2023-10-06T11:12:34.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.821+0000 7f5a50f19700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c156770 con 0x7f5a4c15cff0 2023-10-06T11:12:34.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.821+0000 7f5a50f19700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4c0cb7a0 con 0x7f5a4c15cc20 2023-10-06T11:12:34.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.821+0000 7f5a4a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a4c0d0a80 0x7f5a4c156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:34.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.821+0000 7f5a4a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a4c0d0a80 0x7f5a4c156230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33288/0 (socket says 172.21.15.146:33288) 2023-10-06T11:12:34.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.821+0000 7f5a4a59c700 1 -- 172.21.15.146:0/1379384873 learned_addr learned my addr 172.21.15.146:0/1379384873 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:34.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.821+0000 7f5a4a59c700 1 -- 172.21.15.146:0/1379384873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a4c15cc20 msgr2=0x7f5a4c0cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:34.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.821+0000 7f5a4a59c700 1 --2- 172.21.15.146:0/1379384873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a4c15cc20 0x7f5a4c0cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:34.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.821+0000 7f5a4a59c700 1 -- 172.21.15.146:0/1379384873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a4c15cff0 msgr2=0x7f5a4c0b1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:34.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.821+0000 7f5a4a59c700 1 --2- 172.21.15.146:0/1379384873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a4c15cff0 0x7f5a4c0b1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:34.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.821+0000 7f5a4a59c700 1 -- 172.21.15.146:0/1379384873 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a400094f0 con 0x7f5a4c0d0a80 2023-10-06T11:12:34.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.822+0000 7f5a4a59c700 1 --2- 172.21.15.146:0/1379384873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a4c0d0a80 0x7f5a4c156230 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c00d890 tx=0x7f5a3c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:34.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.822+0000 7f5a3a7fc700 1 -- 172.21.15.146:0/1379384873 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c018070 con 0x7f5a4c0d0a80 2023-10-06T11:12:34.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.822+0000 7f5a3a7fc700 1 -- 172.21.15.146:0/1379384873 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3c005a00 con 0x7f5a4c0d0a80 2023-10-06T11:12:34.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.822+0000 7f5a3a7fc700 1 -- 172.21.15.146:0/1379384873 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3c005dc0 con 0x7f5a4c0d0a80 2023-10-06T11:12:34.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.822+0000 7f5a50f19700 1 -- 172.21.15.146:0/1379384873 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a4c0caeb0 con 0x7f5a4c0d0a80 2023-10-06T11:12:34.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.822+0000 7f5a50f19700 1 -- 172.21.15.146:0/1379384873 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a4c0cb150 con 0x7f5a4c0d0a80 2023-10-06T11:12:34.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.823+0000 7f5a50f19700 1 -- 172.21.15.146:0/1379384873 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a4c04c380 con 0x7f5a4c0d0a80 2023-10-06T11:12:34.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.823+0000 7f5a3a7fc700 1 -- 172.21.15.146:0/1379384873 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5a3c00b810 con 0x7f5a4c0d0a80 2023-10-06T11:12:34.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.823+0000 7f5a3a7fc700 1 --2- 172.21.15.146:0/1379384873 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5a2c066f30 0x7f5a2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:34.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.824+0000 7f5a49d9b700 1 --2- 172.21.15.146:0/1379384873 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5a2c066f30 0x7f5a2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:34.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.824+0000 7f5a3a7fc700 1 -- 172.21.15.146:0/1379384873 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f5a3c0848a0 con 0x7f5a4c0d0a80 2023-10-06T11:12:34.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.824+0000 7f5a49d9b700 1 --2- 172.21.15.146:0/1379384873 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5a2c066f30 0x7f5a2c0693e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f5a400099b0 tx=0x7f5a40017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:34.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:34.829+0000 7f5a3a7fc700 1 -- 172.21.15.146:0/1379384873 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a3c051960 con 0x7f5a4c0d0a80 2023-10-06T11:12:35.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.010+0000 7f5a50f19700 1 -- 172.21.15.146:0/1379384873 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5a4c0b3b50 con 0x7f5a4c0d0a80 2023-10-06T11:12:35.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.688+0000 7f5a3a7fc700 1 -- 172.21.15.146:0/1379384873 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v79) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5a3c054f80 con 0x7f5a4c0d0a80 2023-10-06T11:12:35.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.691+0000 7f5a50f19700 1 -- 172.21.15.146:0/1379384873 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5a2c066f30 msgr2=0x7f5a2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:35.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.691+0000 7f5a50f19700 1 --2- 172.21.15.146:0/1379384873 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5a2c066f30 0x7f5a2c0693e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f5a400099b0 tx=0x7f5a40017000 comp rx=0 tx=0).stop 2023-10-06T11:12:35.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.691+0000 7f5a50f19700 1 -- 172.21.15.146:0/1379384873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a4c0d0a80 msgr2=0x7f5a4c156230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:35.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.691+0000 7f5a50f19700 1 --2- 172.21.15.146:0/1379384873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a4c0d0a80 0x7f5a4c156230 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c00d890 tx=0x7f5a3c008040 comp rx=0 tx=0).stop 2023-10-06T11:12:35.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.691+0000 7f5a50f19700 1 -- 172.21.15.146:0/1379384873 shutdown_connections 2023-10-06T11:12:35.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.691+0000 7f5a50f19700 1 --2- 172.21.15.146:0/1379384873 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5a2c066f30 0x7f5a2c0693e0 secure :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f5a400099b0 tx=0x7f5a40017000 comp rx=0 tx=0).stop 2023-10-06T11:12:35.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.691+0000 7f5a50f19700 1 --2- 172.21.15.146:0/1379384873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a4c15cff0 0x7f5a4c0b1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:35.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.691+0000 7f5a50f19700 1 --2- 172.21.15.146:0/1379384873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a4c0d0a80 0x7f5a4c156230 secure :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f5a3c00d890 tx=0x7f5a3c008040 comp rx=0 tx=0).stop 2023-10-06T11:12:35.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.691+0000 7f5a50f19700 1 --2- 172.21.15.146:0/1379384873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a4c15cc20 0x7f5a4c0cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:35.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.691+0000 7f5a50f19700 1 -- 172.21.15.146:0/1379384873 >> 172.21.15.146:0/1379384873 conn(0x7f5a4c06eba0 msgr2=0x7f5a4c156f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:35.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.691+0000 7f5a50f19700 1 -- 172.21.15.146:0/1379384873 shutdown_connections 2023-10-06T11:12:35.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.691+0000 7f5a50f19700 1 -- 172.21.15.146:0/1379384873 wait complete. 2023-10-06T11:12:35.695 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' removed 2023-10-06T11:12:35.706 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T11:12:35.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.824+0000 7f718df35700 1 Processor -- start 2023-10-06T11:12:35.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.824+0000 7f718df35700 1 -- start start 2023-10-06T11:12:35.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.825+0000 7f718df35700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f71880b11e0 0x7f71880cee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:35.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.825+0000 7f718df35700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71880cc830 con 0x7f7188159a60 2023-10-06T11:12:35.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.825+0000 7f718df35700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71880b1650 con 0x7f71880cd3d0 2023-10-06T11:12:35.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.825+0000 7f718df35700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71880cf350 con 0x7f71880b11e0 2023-10-06T11:12:35.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.825+0000 7f71877fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7188159a60 0x7f71880cccc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:54048/0 (socket says 172.21.15.146:54048) 2023-10-06T11:12:35.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.825+0000 7f71877fe700 1 -- 172.21.15.146:0/3464056588 learned_addr learned my addr 172.21.15.146:0/3464056588 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:12:35.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.825+0000 7f717effd700 1 --2- 172.21.15.146:0/3464056588 >> v2:172.21.15.146:3300/0 conn(0x7f71880b11e0 0x7f71880cee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:35.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.825+0000 7f7186ffd700 1 -- 172.21.15.146:0/3464056588 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 342517769 0 0) 0x7f71880cc830 con 0x7f7188159a60 2023-10-06T11:12:35.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.825+0000 7f7186ffd700 1 -- 172.21.15.146:0/3464056588 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7174003570 con 0x7f7188159a60 2023-10-06T11:12:35.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.825+0000 7f717effd700 1 -- 172.21.15.146:0/3464056588 >> v1:172.21.15.151:6789/0 conn(0x7f71880cd3d0 legacy=0x7f71880c9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:35.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.825+0000 7f717effd700 1 -- 172.21.15.146:0/3464056588 >> v1:172.21.15.146:6789/0 conn(0x7f7188159a60 legacy=0x7f71880cccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:35.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.825+0000 7f717effd700 1 -- 172.21.15.146:0/3464056588 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71880cbf40 con 0x7f71880b11e0 2023-10-06T11:12:35.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.825+0000 7f717effd700 1 --2- 172.21.15.146:0/3464056588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71880b11e0 0x7f71880cee10 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f71700098e0 tx=0x7f71700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c770335790b7fadb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:35.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.825+0000 7f7186ffd700 1 -- 172.21.15.146:0/3464056588 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717000b640 con 0x7f71880b11e0 2023-10-06T11:12:35.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.825+0000 7f7186ffd700 1 -- 172.21.15.146:0/3464056588 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f717000b7a0 con 0x7f71880b11e0 2023-10-06T11:12:35.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.825+0000 7f7186ffd700 1 -- 172.21.15.146:0/3464056588 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717000bb20 con 0x7f71880b11e0 2023-10-06T11:12:35.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.826+0000 7f718df35700 1 -- 172.21.15.146:0/3464056588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71880b11e0 msgr2=0x7f71880cee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:35.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.826+0000 7f718df35700 1 --2- 172.21.15.146:0/3464056588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71880b11e0 0x7f71880cee10 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f71700098e0 tx=0x7f71700091a0 comp rx=0 tx=0).stop 2023-10-06T11:12:35.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.826+0000 7f718df35700 1 -- 172.21.15.146:0/3464056588 shutdown_connections 2023-10-06T11:12:35.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.826+0000 7f718df35700 1 --2- 172.21.15.146:0/3464056588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71880b11e0 0x7f71880cee10 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:35.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.826+0000 7f718df35700 1 -- 172.21.15.146:0/3464056588 >> 172.21.15.146:0/3464056588 conn(0x7f7188067c50 msgr2=0x7f71880ce410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:35.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.826+0000 7f718df35700 1 -- 172.21.15.146:0/3464056588 shutdown_connections 2023-10-06T11:12:35.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.826+0000 7f718df35700 1 -- 172.21.15.146:0/3464056588 wait complete. 2023-10-06T11:12:35.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.827+0000 7f718df35700 1 Processor -- start 2023-10-06T11:12:35.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.827+0000 7f718df35700 1 -- start start 2023-10-06T11:12:35.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.828+0000 7f718df35700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71880b11e0 0x7f71880b3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:35.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.828+0000 7f718df35700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71880cd3d0 0x7f7188143170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:35.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.828+0000 7f718df35700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7188159a60 0x7f718815e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:35.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.828+0000 7f718df35700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71881436b0 con 0x7f71880cd3d0 2023-10-06T11:12:35.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.828+0000 7f718df35700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71881439b0 con 0x7f7188159a60 2023-10-06T11:12:35.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.828+0000 7f718df35700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f718815ebe0 con 0x7f71880b11e0 2023-10-06T11:12:35.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.828+0000 7f717effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71880cd3d0 0x7f7188143170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:35.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.828+0000 7f717effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71880cd3d0 0x7f7188143170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33304/0 (socket says 172.21.15.146:33304) 2023-10-06T11:12:35.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.828+0000 7f717effd700 1 -- 172.21.15.146:0/2599107202 learned_addr learned my addr 172.21.15.146:0/2599107202 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:35.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.828+0000 7f7187fff700 1 --2- 172.21.15.146:0/2599107202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7188159a60 0x7f718815e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:35.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.828+0000 7f71877fe700 1 --2- 172.21.15.146:0/2599107202 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71880b11e0 0x7f71880b3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:35.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.828+0000 7f717effd700 1 -- 172.21.15.146:0/2599107202 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71880b11e0 msgr2=0x7f71880b3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:35.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.828+0000 7f717effd700 1 --2- 172.21.15.146:0/2599107202 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71880b11e0 0x7f71880b3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:35.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.828+0000 7f717effd700 1 -- 172.21.15.146:0/2599107202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7188159a60 msgr2=0x7f718815e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:35.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.828+0000 7f717effd700 1 --2- 172.21.15.146:0/2599107202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7188159a60 0x7f718815e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:35.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.828+0000 7f717effd700 1 -- 172.21.15.146:0/2599107202 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7170009420 con 0x7f71880cd3d0 2023-10-06T11:12:35.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.828+0000 7f71877fe700 1 --2- 172.21.15.146:0/2599107202 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71880b11e0 0x7f71880b3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:12:35.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.829+0000 7f717effd700 1 --2- 172.21.15.146:0/2599107202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71880cd3d0 0x7f7188143170 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f71700093f0 tx=0x7f7170017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:35.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.829+0000 7f717ffff700 1 -- 172.21.15.146:0/2599107202 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7170000d10 con 0x7f71880cd3d0 2023-10-06T11:12:35.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.829+0000 7f717ffff700 1 -- 172.21.15.146:0/2599107202 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f717000b910 con 0x7f71880cd3d0 2023-10-06T11:12:35.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.829+0000 7f718df35700 1 -- 172.21.15.146:0/2599107202 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f718815eec0 con 0x7f71880cd3d0 2023-10-06T11:12:35.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.829+0000 7f717ffff700 1 -- 172.21.15.146:0/2599107202 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7170025670 con 0x7f71880cd3d0 2023-10-06T11:12:35.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.829+0000 7f718df35700 1 -- 172.21.15.146:0/2599107202 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f718815f480 con 0x7f71880cd3d0 2023-10-06T11:12:35.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.830+0000 7f718df35700 1 -- 172.21.15.146:0/2599107202 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7188143b40 con 0x7f71880cd3d0 2023-10-06T11:12:35.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.830+0000 7f717ffff700 1 -- 172.21.15.146:0/2599107202 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7170023070 con 0x7f71880cd3d0 2023-10-06T11:12:35.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.830+0000 7f717ffff700 1 --2- 172.21.15.146:0/2599107202 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7168066f30 0x7f71680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:35.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.830+0000 7f717ffff700 1 -- 172.21.15.146:0/2599107202 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f7170085ab0 con 0x7f71880cd3d0 2023-10-06T11:12:35.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.830+0000 7f71877fe700 1 --2- 172.21.15.146:0/2599107202 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7168066f30 0x7f71680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:35.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.831+0000 7f71877fe700 1 --2- 172.21.15.146:0/2599107202 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7168066f30 0x7f71680693e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7178001360 tx=0x7f7178009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:35.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:35.836+0000 7f717ffff700 1 -- 172.21.15.146:0/2599107202 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7170052d20 con 0x7f71880cd3d0 2023-10-06T11:12:36.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.019+0000 7f718df35700 1 -- 172.21.15.146:0/2599107202 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f718804c380 con 0x7f71880cd3d0 2023-10-06T11:12:36.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.695+0000 7f717ffff700 1 -- 172.21.15.146:0/2599107202 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v80) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7170056340 con 0x7f71880cd3d0 2023-10-06T11:12:36.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.699+0000 7f718df35700 1 -- 172.21.15.146:0/2599107202 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7168066f30 msgr2=0x7f71680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:36.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.699+0000 7f718df35700 1 --2- 172.21.15.146:0/2599107202 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7168066f30 0x7f71680693e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7178001360 tx=0x7f7178009040 comp rx=0 tx=0).stop 2023-10-06T11:12:36.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.699+0000 7f718df35700 1 -- 172.21.15.146:0/2599107202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71880cd3d0 msgr2=0x7f7188143170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:36.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.699+0000 7f718df35700 1 --2- 172.21.15.146:0/2599107202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71880cd3d0 0x7f7188143170 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f71700093f0 tx=0x7f7170017000 comp rx=0 tx=0).stop 2023-10-06T11:12:36.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.699+0000 7f718df35700 1 -- 172.21.15.146:0/2599107202 shutdown_connections 2023-10-06T11:12:36.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.699+0000 7f718df35700 1 --2- 172.21.15.146:0/2599107202 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7168066f30 0x7f71680693e0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:36.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.699+0000 7f718df35700 1 --2- 172.21.15.146:0/2599107202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7188159a60 0x7f718815e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:36.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.699+0000 7f718df35700 1 --2- 172.21.15.146:0/2599107202 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71880b11e0 0x7f71880b3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:36.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.699+0000 7f718df35700 1 --2- 172.21.15.146:0/2599107202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71880cd3d0 0x7f7188143170 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:36.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.699+0000 7f718df35700 1 -- 172.21.15.146:0/2599107202 >> 172.21.15.146:0/2599107202 conn(0x7f7188067c50 msgr2=0x7f7188157760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:36.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.699+0000 7f718df35700 1 -- 172.21.15.146:0/2599107202 shutdown_connections 2023-10-06T11:12:36.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.700+0000 7f718df35700 1 -- 172.21.15.146:0/2599107202 wait complete. 2023-10-06T11:12:36.702 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' removed 2023-10-06T11:12:36.716 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T11:12:36.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.833+0000 7fb9e359e700 1 Processor -- start 2023-10-06T11:12:36.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.833+0000 7fb9e359e700 1 -- start start 2023-10-06T11:12:36.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.834+0000 7fb9e359e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb9e40cb090 0x7fb9e40cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:36.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.834+0000 7fb9e359e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb9e4068780 0x7fb9e4068bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:36.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.834+0000 7fb9e359e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e40cc130 con 0x7fb9e40b5640 2023-10-06T11:12:36.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.834+0000 7fb9e359e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e4069100 con 0x7fb9e4068780 2023-10-06T11:12:36.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.834+0000 7fb9e359e700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9e40b2660 con 0x7fb9e40cb090 2023-10-06T11:12:36.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.834+0000 7fb9e2d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb9e4068780 0x7fb9e4068bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:36.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.834+0000 7fb9e2d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb9e4068780 0x7fb9e4068bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33320/0 (socket says 172.21.15.146:33320) 2023-10-06T11:12:36.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.834+0000 7fb9e2d9d700 1 -- 172.21.15.146:0/963572562 learned_addr learned my addr 172.21.15.146:0/963572562 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:36.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.834+0000 7fb9e1d9b700 1 --2- 172.21.15.146:0/963572562 >> v2:172.21.15.151:3300/0 conn(0x7fb9e40cb090 0x7fb9e40cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:36.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.834+0000 7fb9e2d9d700 1 -- 172.21.15.146:0/963572562 >> v2:172.21.15.151:3300/0 conn(0x7fb9e40cb090 msgr2=0x7fb9e40cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:36.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.834+0000 7fb9e2d9d700 1 --2- 172.21.15.146:0/963572562 >> v2:172.21.15.151:3300/0 conn(0x7fb9e40cb090 0x7fb9e40cc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:36.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.834+0000 7fb9e2d9d700 1 -- 172.21.15.146:0/963572562 >> v1:172.21.15.151:6789/0 conn(0x7fb9e40b5640 legacy=0x7fb9e415a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:36.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.834+0000 7fb9e2d9d700 1 -- 172.21.15.146:0/963572562 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e40cb520 con 0x7fb9e4068780 2023-10-06T11:12:36.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.834+0000 7fb9e2d9d700 1 --2- 172.21.15.146:0/963572562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9e4068780 0x7fb9e4068bc0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fb9e40d13d0 tx=0x7fb9d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1db1226339cd3b5f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:36.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.834+0000 7fb9e159a700 1 -- 172.21.15.146:0/963572562 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d400b860 con 0x7fb9e4068780 2023-10-06T11:12:36.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.834+0000 7fb9e159a700 1 -- 172.21.15.146:0/963572562 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d400b9c0 con 0x7fb9e4068780 2023-10-06T11:12:36.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.834+0000 7fb9e159a700 1 -- 172.21.15.146:0/963572562 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d400bd60 con 0x7fb9e4068780 2023-10-06T11:12:36.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.835+0000 7fb9e359e700 1 -- 172.21.15.146:0/963572562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9e4068780 msgr2=0x7fb9e4068bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:36.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.835+0000 7fb9e359e700 1 --2- 172.21.15.146:0/963572562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9e4068780 0x7fb9e4068bc0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7fb9e40d13d0 tx=0x7fb9d4009250 comp rx=0 tx=0).stop 2023-10-06T11:12:36.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.835+0000 7fb9e359e700 1 -- 172.21.15.146:0/963572562 shutdown_connections 2023-10-06T11:12:36.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.835+0000 7fb9e359e700 1 --2- 172.21.15.146:0/963572562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9e4068780 0x7fb9e4068bc0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:36.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.835+0000 7fb9e359e700 1 --2- 172.21.15.146:0/963572562 >> v2:172.21.15.151:3300/0 conn(0x7fb9e40cb090 0x7fb9e40cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:36.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.835+0000 7fb9e359e700 1 -- 172.21.15.146:0/963572562 >> 172.21.15.146:0/963572562 conn(0x7fb9e40703f0 msgr2=0x7fb9e40707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:36.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.835+0000 7fb9e359e700 1 -- 172.21.15.146:0/963572562 shutdown_connections 2023-10-06T11:12:36.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.835+0000 7fb9e359e700 1 -- 172.21.15.146:0/963572562 wait complete. 2023-10-06T11:12:36.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.836+0000 7fb9e359e700 1 Processor -- start 2023-10-06T11:12:36.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.836+0000 7fb9e359e700 1 -- start start 2023-10-06T11:12:36.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.837+0000 7fb9e359e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9e4068780 0x7fb9e40c4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:36.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.837+0000 7fb9e359e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9e40b5640 0x7fb9e415e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:36.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.837+0000 7fb9e359e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9e40cb090 0x7fb9e415b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:36.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.837+0000 7fb9e359e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e40c5620 con 0x7fb9e40b5640 2023-10-06T11:12:36.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.837+0000 7fb9e359e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e415f0d0 con 0x7fb9e40cb090 2023-10-06T11:12:36.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.837+0000 7fb9e359e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e415eb10 con 0x7fb9e4068780 2023-10-06T11:12:36.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.837+0000 7fb9e1d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9e40b5640 0x7fb9e415e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:36.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.837+0000 7fb9e1d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9e40b5640 0x7fb9e415e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33334/0 (socket says 172.21.15.146:33334) 2023-10-06T11:12:36.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.837+0000 7fb9e1d9b700 1 -- 172.21.15.146:0/4083413674 learned_addr learned my addr 172.21.15.146:0/4083413674 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:36.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.837+0000 7fb9e2d9d700 1 --2- 172.21.15.146:0/4083413674 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9e40cb090 0x7fb9e415b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:36.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.837+0000 7fb9e1d9b700 1 -- 172.21.15.146:0/4083413674 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9e4068780 msgr2=0x7fb9e40c4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:36.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.837+0000 7fb9e1d9b700 1 --2- 172.21.15.146:0/4083413674 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9e4068780 0x7fb9e40c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:36.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.837+0000 7fb9e1d9b700 1 -- 172.21.15.146:0/4083413674 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9e40cb090 msgr2=0x7fb9e415b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:36.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.837+0000 7fb9e1d9b700 1 --2- 172.21.15.146:0/4083413674 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9e40cb090 0x7fb9e415b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:36.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.837+0000 7fb9e1d9b700 1 -- 172.21.15.146:0/4083413674 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d40094f0 con 0x7fb9e40b5640 2023-10-06T11:12:36.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.837+0000 7fb9e1d9b700 1 --2- 172.21.15.146:0/4083413674 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9e40b5640 0x7fb9e415e2d0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc00d890 tx=0x7fb9cc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:36.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.837+0000 7fb9da7fc700 1 -- 172.21.15.146:0/4083413674 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc00b600 con 0x7fb9e40b5640 2023-10-06T11:12:36.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.838+0000 7fb9da7fc700 1 -- 172.21.15.146:0/4083413674 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9cc00b760 con 0x7fb9e40b5640 2023-10-06T11:12:36.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.838+0000 7fb9e359e700 1 -- 172.21.15.146:0/4083413674 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9e415edf0 con 0x7fb9e40b5640 2023-10-06T11:12:36.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.838+0000 7fb9da7fc700 1 -- 172.21.15.146:0/4083413674 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc00bae0 con 0x7fb9e40b5640 2023-10-06T11:12:36.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.838+0000 7fb9e359e700 1 -- 172.21.15.146:0/4083413674 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e415e810 con 0x7fb9e40b5640 2023-10-06T11:12:36.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.838+0000 7fb9e359e700 1 -- 172.21.15.146:0/4083413674 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e40b60a0 con 0x7fb9e40b5640 2023-10-06T11:12:36.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.839+0000 7fb9da7fc700 1 -- 172.21.15.146:0/4083413674 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb9cc01e460 con 0x7fb9e40b5640 2023-10-06T11:12:36.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.839+0000 7fb9da7fc700 1 --2- 172.21.15.146:0/4083413674 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb9c4066f30 0x7fb9c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:36.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.839+0000 7fb9e259c700 1 --2- 172.21.15.146:0/4083413674 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb9c4066f30 0x7fb9c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:36.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.839+0000 7fb9da7fc700 1 -- 172.21.15.146:0/4083413674 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fb9cc084a70 con 0x7fb9e40b5640 2023-10-06T11:12:36.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.840+0000 7fb9e259c700 1 --2- 172.21.15.146:0/4083413674 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb9c4066f30 0x7fb9c40693e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb9e40ca950 tx=0x7fb9dc007ec0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:36.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:36.844+0000 7fb9da7fc700 1 -- 172.21.15.146:0/4083413674 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb9cc051e80 con 0x7fb9e40b5640 2023-10-06T11:12:37.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.026+0000 7fb9e359e700 1 -- 172.21.15.146:0/4083413674 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fb9e40c5760 con 0x7fb9e40b5640 2023-10-06T11:12:37.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.029+0000 7fb9da7fc700 1 -- 172.21.15.146:0/4083413674 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb9cc0554a0 con 0x7fb9e40b5640 2023-10-06T11:12:37.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.032+0000 7fb9e359e700 1 -- 172.21.15.146:0/4083413674 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb9c4066f30 msgr2=0x7fb9c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:37.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.032+0000 7fb9e359e700 1 --2- 172.21.15.146:0/4083413674 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb9c4066f30 0x7fb9c40693e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fb9e40ca950 tx=0x7fb9dc007ec0 comp rx=0 tx=0).stop 2023-10-06T11:12:37.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.032+0000 7fb9e359e700 1 -- 172.21.15.146:0/4083413674 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9e40b5640 msgr2=0x7fb9e415e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:37.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.032+0000 7fb9e359e700 1 --2- 172.21.15.146:0/4083413674 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9e40b5640 0x7fb9e415e2d0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc00d890 tx=0x7fb9cc008040 comp rx=0 tx=0).stop 2023-10-06T11:12:37.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.032+0000 7fb9e359e700 1 -- 172.21.15.146:0/4083413674 shutdown_connections 2023-10-06T11:12:37.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.032+0000 7fb9e359e700 1 --2- 172.21.15.146:0/4083413674 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb9c4066f30 0x7fb9c40693e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:37.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.032+0000 7fb9e359e700 1 --2- 172.21.15.146:0/4083413674 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9e40cb090 0x7fb9e415b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:37.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.032+0000 7fb9e359e700 1 --2- 172.21.15.146:0/4083413674 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9e4068780 0x7fb9e40c4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:37.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.032+0000 7fb9e359e700 1 --2- 172.21.15.146:0/4083413674 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9e40b5640 0x7fb9e415e2d0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:37.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.032+0000 7fb9e359e700 1 -- 172.21.15.146:0/4083413674 >> 172.21.15.146:0/4083413674 conn(0x7fb9e40703f0 msgr2=0x7fb9e4153a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:37.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.032+0000 7fb9e359e700 1 -- 172.21.15.146:0/4083413674 shutdown_connections 2023-10-06T11:12:37.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.032+0000 7fb9e359e700 1 -- 172.21.15.146:0/4083413674 wait complete. 2023-10-06T11:12:37.049 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub' 2023-10-06T11:12:37.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.164+0000 7fc6097a6700 1 Processor -- start 2023-10-06T11:12:37.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.164+0000 7fc6097a6700 1 -- start start 2023-10-06T11:12:37.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.165+0000 7fc6097a6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc604153e80 0x7fc60415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:37.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.165+0000 7fc6097a6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc60415ac30 con 0x7fc604068ba0 2023-10-06T11:12:37.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.165+0000 7fc6097a6700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6040b4510 con 0x7fc604153ab0 2023-10-06T11:12:37.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.165+0000 7fc6097a6700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6040b6530 con 0x7fc604153e80 2023-10-06T11:12:37.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.165+0000 7fc5fa7fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc604068ba0 0x7fc6040b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:54056/0 (socket says 172.21.15.146:54056) 2023-10-06T11:12:37.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.165+0000 7fc5fa7fc700 1 -- 172.21.15.146:0/352935220 learned_addr learned my addr 172.21.15.146:0/352935220 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:12:37.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.165+0000 7fc6037fe700 1 --2- 172.21.15.146:0/352935220 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc604153e80 0x7fc60415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:37.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.165+0000 7fc6027fc700 1 -- 172.21.15.146:0/352935220 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 599280389 0 0) 0x7fc5ec001110 con 0x7fc604068ba0 2023-10-06T11:12:37.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.165+0000 7fc6027fc700 1 -- 172.21.15.146:0/352935220 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5f0003570 con 0x7fc604068ba0 2023-10-06T11:12:37.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.166+0000 7fc6027fc700 1 -- 172.21.15.146:0/352935220 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3456048595 0 0) 0x7fc5f0003570 con 0x7fc604068ba0 2023-10-06T11:12:37.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.166+0000 7fc6027fc700 1 -- 172.21.15.146:0/352935220 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc604153e80 msgr2=0x7fc60415a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:37.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.166+0000 7fc6027fc700 1 --2- 172.21.15.146:0/352935220 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc604153e80 0x7fc60415a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:37.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.166+0000 7fc6027fc700 1 -- 172.21.15.146:0/352935220 >> v1:172.21.15.151:6789/0 conn(0x7fc604153ab0 legacy=0x7fc604068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:37.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.166+0000 7fc6027fc700 1 -- 172.21.15.146:0/352935220 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6040b5c50 con 0x7fc604068ba0 2023-10-06T11:12:37.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.166+0000 7fc6027fc700 1 -- 172.21.15.146:0/352935220 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fc5ec001600 con 0x7fc604068ba0 2023-10-06T11:12:37.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.166+0000 7fc6027fc700 1 -- 172.21.15.146:0/352935220 >> v1:172.21.15.146:6789/0 conn(0x7fc604068ba0 legacy=0x7fc6040b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:37.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.166+0000 7fc6027fc700 1 --2- 172.21.15.146:0/352935220 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc604153e80 0x7fc5f0003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:37.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.166+0000 7fc6027fc700 1 --2- 172.21.15.146:0/352935220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5f0004010 0x7fc5f0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:37.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.166+0000 7fc6027fc700 1 --2- 172.21.15.146:0/352935220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5f0004d50 0x7fc5f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:37.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.166+0000 7fc6027fc700 1 -- 172.21.15.146:0/352935220 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6040b6530 con 0x7fc5f0004010 2023-10-06T11:12:37.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.166+0000 7fc6027fc700 1 -- 172.21.15.146:0/352935220 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f000bbf0 con 0x7fc5f0004d50 2023-10-06T11:12:37.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.166+0000 7fc6027fc700 1 -- 172.21.15.146:0/352935220 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5f000bdb0 con 0x7fc604153e80 2023-10-06T11:12:37.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.166+0000 7fc5fa7fc700 1 --2- 172.21.15.146:0/352935220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5f0004010 0x7fc5f0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:37.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.166+0000 7fc602ffd700 1 --2- 172.21.15.146:0/352935220 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc604153e80 0x7fc5f0003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:37.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.166+0000 7fc6037fe700 1 --2- 172.21.15.146:0/352935220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5f0004d50 0x7fc5f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:37.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.166+0000 7fc5fa7fc700 1 -- 172.21.15.146:0/352935220 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc604153e80 msgr2=0x7fc5f0003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:37.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.166+0000 7fc5fa7fc700 1 --2- 172.21.15.146:0/352935220 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc604153e80 0x7fc5f0003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:37.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.166+0000 7fc5fa7fc700 1 -- 172.21.15.146:0/352935220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5f0004d50 msgr2=0x7fc5f00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:37.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.166+0000 7fc5fa7fc700 1 --2- 172.21.15.146:0/352935220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5f0004d50 0x7fc5f00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:37.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.166+0000 7fc5fa7fc700 1 -- 172.21.15.146:0/352935220 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f0003570 con 0x7fc5f0004010 2023-10-06T11:12:37.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.166+0000 7fc5fa7fc700 1 --2- 172.21.15.146:0/352935220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5f0004010 0x7fc5f0004810 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fc604068fa0 tx=0x7fc604159c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9803c581df63b16 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:37.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.167+0000 7fc6027fc700 1 -- 172.21.15.146:0/352935220 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec00cd90 con 0x7fc5f0004010 2023-10-06T11:12:37.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.167+0000 7fc6027fc700 1 -- 172.21.15.146:0/352935220 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5ec005920 con 0x7fc5f0004010 2023-10-06T11:12:37.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.167+0000 7fc6027fc700 1 -- 172.21.15.146:0/352935220 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec005ce0 con 0x7fc5f0004010 2023-10-06T11:12:37.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.167+0000 7fc6097a6700 1 -- 172.21.15.146:0/352935220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5f0004010 msgr2=0x7fc5f0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:37.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.167+0000 7fc6097a6700 1 --2- 172.21.15.146:0/352935220 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5f0004010 0x7fc5f0004810 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fc604068fa0 tx=0x7fc604159c70 comp rx=0 tx=0).stop 2023-10-06T11:12:37.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.167+0000 7fc6037fe700 1 -- 172.21.15.146:0/352935220 reap_dead start 2023-10-06T11:12:37.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.167+0000 7fc6097a6700 1 -- 172.21.15.146:0/352935220 shutdown_connections 2023-10-06T11:12:37.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.167+0000 7fc6097a6700 1 -- 172.21.15.146:0/352935220 >> 172.21.15.146:0/352935220 conn(0x7fc60406eba0 msgr2=0x7fc60406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:37.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.167+0000 7fc6097a6700 1 -- 172.21.15.146:0/352935220 shutdown_connections 2023-10-06T11:12:37.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.167+0000 7fc6097a6700 1 -- 172.21.15.146:0/352935220 wait complete. 2023-10-06T11:12:37.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.168+0000 7fc6097a6700 1 Processor -- start 2023-10-06T11:12:37.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.168+0000 7fc6097a6700 1 -- start start 2023-10-06T11:12:37.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.169+0000 7fc6097a6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5f0004010 0x7fc6040b20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:37.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.169+0000 7fc6097a6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc60416db10 0x7fc604142140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:37.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.169+0000 7fc6097a6700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6040cfd20 0x7fc6040d01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:37.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.169+0000 7fc6097a6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6040d0700 con 0x7fc5f0004010 2023-10-06T11:12:37.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.169+0000 7fc6097a6700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6040b0160 con 0x7fc6040cfd20 2023-10-06T11:12:37.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.169+0000 7fc6097a6700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6040b0440 con 0x7fc60416db10 2023-10-06T11:12:37.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.169+0000 7fc602ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5f0004010 0x7fc6040b20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:37.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.169+0000 7fc602ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5f0004010 0x7fc6040b20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33350/0 (socket says 172.21.15.146:33350) 2023-10-06T11:12:37.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.169+0000 7fc602ffd700 1 -- 172.21.15.146:0/3911914284 learned_addr learned my addr 172.21.15.146:0/3911914284 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:37.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.169+0000 7fc6037fe700 1 --2- 172.21.15.146:0/3911914284 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6040cfd20 0x7fc6040d01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:37.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.169+0000 7fc5fa7fc700 1 --2- 172.21.15.146:0/3911914284 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc60416db10 0x7fc604142140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:37.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.169+0000 7fc602ffd700 1 -- 172.21.15.146:0/3911914284 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc60416db10 msgr2=0x7fc604142140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:37.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.169+0000 7fc602ffd700 1 --2- 172.21.15.146:0/3911914284 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc60416db10 0x7fc604142140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:37.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.169+0000 7fc602ffd700 1 -- 172.21.15.146:0/3911914284 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6040cfd20 msgr2=0x7fc6040d01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:37.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.169+0000 7fc602ffd700 1 --2- 172.21.15.146:0/3911914284 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6040cfd20 0x7fc6040d01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:37.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.170+0000 7fc602ffd700 1 -- 172.21.15.146:0/3911914284 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc604154e20 con 0x7fc5f0004010 2023-10-06T11:12:37.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.170+0000 7fc5fa7fc700 1 --2- 172.21.15.146:0/3911914284 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc60416db10 0x7fc604142140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:12:37.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.170+0000 7fc602ffd700 1 --2- 172.21.15.146:0/3911914284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5f0004010 0x7fc6040b20c0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4002aa0 tx=0x7fc5f4007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:37.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.170+0000 7fc5fb7fe700 1 -- 172.21.15.146:0/3911914284 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f400f850 con 0x7fc5f0004010 2023-10-06T11:12:37.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.170+0000 7fc5fb7fe700 1 -- 172.21.15.146:0/3911914284 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f400f9b0 con 0x7fc5f0004010 2023-10-06T11:12:37.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.170+0000 7fc6097a6700 1 -- 172.21.15.146:0/3911914284 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc604155100 con 0x7fc5f0004010 2023-10-06T11:12:37.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.170+0000 7fc5fb7fe700 1 -- 172.21.15.146:0/3911914284 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f400fd70 con 0x7fc5f0004010 2023-10-06T11:12:37.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.170+0000 7fc6097a6700 1 -- 172.21.15.146:0/3911914284 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc604150a20 con 0x7fc5f0004010 2023-10-06T11:12:37.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.171+0000 7fc6097a6700 1 -- 172.21.15.146:0/3911914284 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc604155340 con 0x7fc5f0004010 2023-10-06T11:12:37.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.172+0000 7fc5fb7fe700 1 -- 172.21.15.146:0/3911914284 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc5f4013600 con 0x7fc5f0004010 2023-10-06T11:12:37.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.172+0000 7fc5fb7fe700 1 --2- 172.21.15.146:0/3911914284 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc5e4066f30 0x7fc5e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:37.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.172+0000 7fc5fb7fe700 1 -- 172.21.15.146:0/3911914284 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fc5f4084dd0 con 0x7fc5f0004010 2023-10-06T11:12:37.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.172+0000 7fc5fa7fc700 1 --2- 172.21.15.146:0/3911914284 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc5e4066f30 0x7fc5e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:37.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.172+0000 7fc5fa7fc700 1 --2- 172.21.15.146:0/3911914284 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc5e4066f30 0x7fc5e40693e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc604154ab0 tx=0x7fc5ec015000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:37.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.176+0000 7fc5fb7fe700 1 -- 172.21.15.146:0/3911914284 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc5f4052260 con 0x7fc5f0004010 2023-10-06T11:12:37.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.433+0000 7fc6097a6700 1 -- 172.21.15.146:0/3911914284 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]} v 0) v1 -- 0x7fc6040b0720 con 0x7fc5f0004010 2023-10-06T11:12:37.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.693+0000 7fc5fb7fe700 1 -- 172.21.15.146:0/3911914284 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubChecks.test_stray_evaluation_with_scrub"]}]=0 v326) v1 ==== 158+0+0 (secure 0 0 0) 0x7fc5f4055880 con 0x7fc5f0004010 2023-10-06T11:12:37.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.696+0000 7fc6097a6700 1 -- 172.21.15.146:0/3911914284 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc5e4066f30 msgr2=0x7fc5e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:37.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.696+0000 7fc6097a6700 1 --2- 172.21.15.146:0/3911914284 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc5e4066f30 0x7fc5e40693e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc604154ab0 tx=0x7fc5ec015000 comp rx=0 tx=0).stop 2023-10-06T11:12:37.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.696+0000 7fc6097a6700 1 -- 172.21.15.146:0/3911914284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5f0004010 msgr2=0x7fc6040b20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:37.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.696+0000 7fc6097a6700 1 --2- 172.21.15.146:0/3911914284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5f0004010 0x7fc6040b20c0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4002aa0 tx=0x7fc5f4007d30 comp rx=0 tx=0).stop 2023-10-06T11:12:37.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.696+0000 7fc6097a6700 1 -- 172.21.15.146:0/3911914284 shutdown_connections 2023-10-06T11:12:37.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.696+0000 7fc6097a6700 1 --2- 172.21.15.146:0/3911914284 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc5e4066f30 0x7fc5e40693e0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:37.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.696+0000 7fc6097a6700 1 --2- 172.21.15.146:0/3911914284 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6040cfd20 0x7fc6040d01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:37.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.696+0000 7fc6097a6700 1 --2- 172.21.15.146:0/3911914284 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc5f0004010 0x7fc6040b20c0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:37.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.696+0000 7fc6097a6700 1 --2- 172.21.15.146:0/3911914284 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc60416db10 0x7fc604142140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:37.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.696+0000 7fc6097a6700 1 -- 172.21.15.146:0/3911914284 >> 172.21.15.146:0/3911914284 conn(0x7fc60406eba0 msgr2=0x7fc604152100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:37.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.696+0000 7fc6097a6700 1 -- 172.21.15.146:0/3911914284 shutdown_connections 2023-10-06T11:12:37.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.696+0000 7fc6097a6700 1 -- 172.21.15.146:0/3911914284 wait complete. 2023-10-06T11:12:37.709 INFO:tasks.cephfs_test_runner:test that scrub can iterate over ~mdsdir and evaluate strays ... ok 2023-10-06T11:12:37.710 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) 2023-10-06T11:12:37.710 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort' 2023-10-06T11:12:37.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.830+0000 7f1830be4700 1 Processor -- start 2023-10-06T11:12:37.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.830+0000 7f1830be4700 1 -- start start 2023-10-06T11:12:37.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.831+0000 7f1830be4700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f182c0aa1e0 0x7f182c15dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:37.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.831+0000 7f1830be4700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f182c15e320 con 0x7f182c159990 2023-10-06T11:12:37.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.831+0000 7f1830be4700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f182c06f090 con 0x7f182c1595c0 2023-10-06T11:12:37.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.831+0000 7f1830be4700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f182c068420 con 0x7f182c0aa1e0 2023-10-06T11:12:37.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.831+0000 7f182ad9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f182c159990 0x7f182c159dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:54064/0 (socket says 172.21.15.146:54064) 2023-10-06T11:12:37.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.831+0000 7f182ad9d700 1 -- 172.21.15.146:0/3180320347 learned_addr learned my addr 172.21.15.146:0/3180320347 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:12:37.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.831+0000 7f1821d9b700 1 --2- 172.21.15.146:0/3180320347 >> v2:172.21.15.151:3300/0 conn(0x7f182c0aa1e0 0x7f182c15dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:37.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.831+0000 7f1829d9b700 1 -- 172.21.15.146:0/3180320347 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1665860971 0 0) 0x7f1824001490 con 0x7f182c159990 2023-10-06T11:12:37.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.831+0000 7f1829d9b700 1 -- 172.21.15.146:0/3180320347 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1818003570 con 0x7f182c159990 2023-10-06T11:12:37.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.832+0000 7f1829d9b700 1 -- 172.21.15.146:0/3180320347 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 592027856 0 0) 0x7f1818003570 con 0x7f182c159990 2023-10-06T11:12:37.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.832+0000 7f1829d9b700 1 -- 172.21.15.146:0/3180320347 >> v2:172.21.15.151:3300/0 conn(0x7f182c0aa1e0 msgr2=0x7f182c15dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:37.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.832+0000 7f1829d9b700 1 --2- 172.21.15.146:0/3180320347 >> v2:172.21.15.151:3300/0 conn(0x7f182c0aa1e0 0x7f182c15dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:37.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.832+0000 7f1829d9b700 1 -- 172.21.15.146:0/3180320347 >> v1:172.21.15.151:6789/0 conn(0x7f182c1595c0 legacy=0x7f182c0a9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:37.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.832+0000 7f1829d9b700 1 -- 172.21.15.146:0/3180320347 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f182c067810 con 0x7f182c159990 2023-10-06T11:12:37.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.832+0000 7f1829d9b700 1 -- 172.21.15.146:0/3180320347 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f1824001980 con 0x7f182c159990 2023-10-06T11:12:37.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.832+0000 7f1829d9b700 1 -- 172.21.15.146:0/3180320347 >> v1:172.21.15.146:6789/0 conn(0x7f182c159990 legacy=0x7f182c159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:37.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.832+0000 7f1829d9b700 1 --2- 172.21.15.146:0/3180320347 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1818003a60 0x7f1818003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:37.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.832+0000 7f1829d9b700 1 --2- 172.21.15.146:0/3180320347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1818004810 0x7f1818004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:37.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.832+0000 7f1829d9b700 1 --2- 172.21.15.146:0/3180320347 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18180051c0 0x7f181800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:37.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.832+0000 7f1829d9b700 1 -- 172.21.15.146:0/3180320347 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182c068420 con 0x7f1818004810 2023-10-06T11:12:37.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.832+0000 7f1829d9b700 1 -- 172.21.15.146:0/3180320347 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181800c160 con 0x7f18180051c0 2023-10-06T11:12:37.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.832+0000 7f1829d9b700 1 -- 172.21.15.146:0/3180320347 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f181800c320 con 0x7f1818003a60 2023-10-06T11:12:37.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.832+0000 7f1821d9b700 1 --2- 172.21.15.146:0/3180320347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1818004810 0x7f1818004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:37.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.832+0000 7f182a59c700 1 --2- 172.21.15.146:0/3180320347 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1818003a60 0x7f1818003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:37.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.832+0000 7f182ad9d700 1 --2- 172.21.15.146:0/3180320347 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18180051c0 0x7f181800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:37.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.832+0000 7f1821d9b700 1 -- 172.21.15.146:0/3180320347 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1818003a60 msgr2=0x7f1818003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:37.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.832+0000 7f1821d9b700 1 --2- 172.21.15.146:0/3180320347 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1818003a60 0x7f1818003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:37.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.832+0000 7f1821d9b700 1 -- 172.21.15.146:0/3180320347 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18180051c0 msgr2=0x7f181800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:37.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.832+0000 7f1821d9b700 1 --2- 172.21.15.146:0/3180320347 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18180051c0 0x7f181800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:37.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.832+0000 7f1821d9b700 1 -- 172.21.15.146:0/3180320347 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1818003570 con 0x7f1818004810 2023-10-06T11:12:37.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.832+0000 7f182a59c700 1 --2- 172.21.15.146:0/3180320347 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1818003a60 0x7f1818003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:12:37.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.832+0000 7f182ad9d700 1 --2- 172.21.15.146:0/3180320347 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18180051c0 0x7f181800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:12:37.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.832+0000 7f182ad9d700 1 -- 172.21.15.146:0/3180320347 reap_dead start 2023-10-06T11:12:37.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.832+0000 7f1821d9b700 1 --2- 172.21.15.146:0/3180320347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1818004810 0x7f1818004c80 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f182c0aa5e0 tx=0x7f18140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bda8267c5e4fa538 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:37.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.832+0000 7f1829d9b700 1 -- 172.21.15.146:0/3180320347 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181400e710 con 0x7f1818004810 2023-10-06T11:12:37.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.832+0000 7f1829d9b700 1 -- 172.21.15.146:0/3180320347 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f181400e870 con 0x7f1818004810 2023-10-06T11:12:37.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.832+0000 7f1829d9b700 1 -- 172.21.15.146:0/3180320347 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181400ec30 con 0x7f1818004810 2023-10-06T11:12:37.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.833+0000 7f1830be4700 1 -- 172.21.15.146:0/3180320347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1818004810 msgr2=0x7f1818004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:37.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.833+0000 7f1830be4700 1 --2- 172.21.15.146:0/3180320347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1818004810 0x7f1818004c80 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f182c0aa5e0 tx=0x7f18140091a0 comp rx=0 tx=0).stop 2023-10-06T11:12:37.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.833+0000 7f1830be4700 1 -- 172.21.15.146:0/3180320347 shutdown_connections 2023-10-06T11:12:37.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.833+0000 7f1830be4700 1 --2- 172.21.15.146:0/3180320347 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1818004810 0x7f1818004c80 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:37.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.833+0000 7f1830be4700 1 -- 172.21.15.146:0/3180320347 >> 172.21.15.146:0/3180320347 conn(0x7f182c0cd530 msgr2=0x7f182c069f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:37.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.833+0000 7f1830be4700 1 -- 172.21.15.146:0/3180320347 shutdown_connections 2023-10-06T11:12:37.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.833+0000 7f1830be4700 1 -- 172.21.15.146:0/3180320347 wait complete. 2023-10-06T11:12:37.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.834+0000 7f1830be4700 1 Processor -- start 2023-10-06T11:12:37.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.834+0000 7f1830be4700 1 -- start start 2023-10-06T11:12:37.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.835+0000 7f1830be4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1818004810 0x7f182c157400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:37.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.835+0000 7f1830be4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f182c06ded0 0x7f182c06e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:37.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.835+0000 7f1830be4700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f182c0c2290 0x7f182c0c2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:37.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.835+0000 7f1830be4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182c16aed0 con 0x7f182c06ded0 2023-10-06T11:12:37.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.835+0000 7f1830be4700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182c0c8390 con 0x7f1818004810 2023-10-06T11:12:37.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.835+0000 7f1830be4700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f182c169f00 con 0x7f182c0c2290 2023-10-06T11:12:37.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.835+0000 7f1821d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f182c06ded0 0x7f182c06e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:37.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.835+0000 7f1821d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f182c06ded0 0x7f182c06e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33380/0 (socket says 172.21.15.146:33380) 2023-10-06T11:12:37.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.835+0000 7f1821d9b700 1 -- 172.21.15.146:0/406126996 learned_addr learned my addr 172.21.15.146:0/406126996 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:37.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.835+0000 7f182a59c700 1 --2- 172.21.15.146:0/406126996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1818004810 0x7f182c157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:37.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.835+0000 7f182ad9d700 1 --2- 172.21.15.146:0/406126996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f182c0c2290 0x7f182c0c2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:37.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.835+0000 7f1821d9b700 1 -- 172.21.15.146:0/406126996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f182c0c2290 msgr2=0x7f182c0c2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:37.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.835+0000 7f1821d9b700 1 --2- 172.21.15.146:0/406126996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f182c0c2290 0x7f182c0c2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:37.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.835+0000 7f1821d9b700 1 -- 172.21.15.146:0/406126996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1818004810 msgr2=0x7f182c157400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:37.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.835+0000 7f1821d9b700 1 --2- 172.21.15.146:0/406126996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1818004810 0x7f182c157400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:37.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.835+0000 7f1821d9b700 1 -- 172.21.15.146:0/406126996 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f182c06e880 con 0x7f182c06ded0 2023-10-06T11:12:37.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.835+0000 7f1821d9b700 1 --2- 172.21.15.146:0/406126996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f182c06ded0 0x7f182c06e340 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f181800c130 tx=0x7f181401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:37.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.836+0000 7f1822ffd700 1 -- 172.21.15.146:0/406126996 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1814022070 con 0x7f182c06ded0 2023-10-06T11:12:37.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.836+0000 7f1822ffd700 1 -- 172.21.15.146:0/406126996 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f181400e9e0 con 0x7f182c06ded0 2023-10-06T11:12:37.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.836+0000 7f1830be4700 1 -- 172.21.15.146:0/406126996 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f182c16aa40 con 0x7f182c06ded0 2023-10-06T11:12:37.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.836+0000 7f1822ffd700 1 -- 172.21.15.146:0/406126996 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1814027470 con 0x7f182c06ded0 2023-10-06T11:12:37.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.836+0000 7f1830be4700 1 -- 172.21.15.146:0/406126996 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f182c0c2c40 con 0x7f182c06ded0 2023-10-06T11:12:37.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.836+0000 7f1830be4700 1 -- 172.21.15.146:0/406126996 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f182c16abd0 con 0x7f182c06ded0 2023-10-06T11:12:37.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.837+0000 7f1822ffd700 1 -- 172.21.15.146:0/406126996 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f181401c450 con 0x7f182c06ded0 2023-10-06T11:12:37.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.837+0000 7f1822ffd700 1 --2- 172.21.15.146:0/406126996 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f180c066f30 0x7f180c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:37.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.837+0000 7f1822ffd700 1 -- 172.21.15.146:0/406126996 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f1814085f50 con 0x7f182c06ded0 2023-10-06T11:12:37.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.837+0000 7f182a59c700 1 --2- 172.21.15.146:0/406126996 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f180c066f30 0x7f180c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:37.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.838+0000 7f182a59c700 1 --2- 172.21.15.146:0/406126996 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f180c066f30 0x7f180c0693e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f181c007bc0 tx=0x7f181c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:37.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:37.842+0000 7f1822ffd700 1 -- 172.21.15.146:0/406126996 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1814053420 con 0x7f182c06ded0 2023-10-06T11:12:38.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.102+0000 7f1830be4700 1 -- 172.21.15.146:0/406126996 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]} v 0) v1 -- 0x7f182c04c380 con 0x7f182c06ded0 2023-10-06T11:12:38.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.695+0000 7f1822ffd700 1 -- 172.21.15.146:0/406126996 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]}]=0 v327) v1 ==== 147+0+0 (secure 0 0 0) 0x7f1814056980 con 0x7f182c06ded0 2023-10-06T11:12:38.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.697+0000 7f1830be4700 1 -- 172.21.15.146:0/406126996 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f180c066f30 msgr2=0x7f180c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:38.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.697+0000 7f1830be4700 1 --2- 172.21.15.146:0/406126996 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f180c066f30 0x7f180c0693e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f181c007bc0 tx=0x7f181c009040 comp rx=0 tx=0).stop 2023-10-06T11:12:38.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.697+0000 7f1830be4700 1 -- 172.21.15.146:0/406126996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f182c06ded0 msgr2=0x7f182c06e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:38.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.697+0000 7f1830be4700 1 --2- 172.21.15.146:0/406126996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f182c06ded0 0x7f182c06e340 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f181800c130 tx=0x7f181401a000 comp rx=0 tx=0).stop 2023-10-06T11:12:38.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.697+0000 7f1830be4700 1 -- 172.21.15.146:0/406126996 shutdown_connections 2023-10-06T11:12:38.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.697+0000 7f1830be4700 1 --2- 172.21.15.146:0/406126996 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f180c066f30 0x7f180c0693e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:38.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.697+0000 7f1830be4700 1 --2- 172.21.15.146:0/406126996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f182c0c2290 0x7f182c0c2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:38.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.697+0000 7f1830be4700 1 --2- 172.21.15.146:0/406126996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1818004810 0x7f182c157400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:38.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.697+0000 7f1830be4700 1 --2- 172.21.15.146:0/406126996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f182c06ded0 0x7f182c06e340 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:38.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.697+0000 7f1830be4700 1 -- 172.21.15.146:0/406126996 >> 172.21.15.146:0/406126996 conn(0x7f182c0cd530 msgr2=0x7f182c0af960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:38.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.697+0000 7f1830be4700 1 -- 172.21.15.146:0/406126996 shutdown_connections 2023-10-06T11:12:38.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.698+0000 7f1830be4700 1 -- 172.21.15.146:0/406126996 wait complete. 2023-10-06T11:12:38.712 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T11:12:38.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.831+0000 7f7e27fff700 1 Processor -- start 2023-10-06T11:12:38.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.831+0000 7f7e27fff700 1 -- start start 2023-10-06T11:12:38.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.832+0000 7f7e27fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7e280b5640 0x7f7e2815a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:38.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.832+0000 7f7e27fff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7e280cb090 0x7f7e280cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:38.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.832+0000 7f7e27fff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e280cc130 con 0x7f7e28068780 2023-10-06T11:12:38.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.832+0000 7f7e27fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e280b2660 con 0x7f7e280b5640 2023-10-06T11:12:38.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.832+0000 7f7e27fff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e2815adb0 con 0x7f7e280cb090 2023-10-06T11:12:38.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.832+0000 7f7e26ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7e280b5640 0x7f7e2815a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:38.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.832+0000 7f7e26ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7e280b5640 0x7f7e2815a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33394/0 (socket says 172.21.15.146:33394) 2023-10-06T11:12:38.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.832+0000 7f7e26ffd700 1 -- 172.21.15.146:0/4022355242 learned_addr learned my addr 172.21.15.146:0/4022355242 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:38.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.832+0000 7f7e26ffd700 1 -- 172.21.15.146:0/4022355242 >> v2:172.21.15.151:3300/0 conn(0x7f7e280cb090 msgr2=0x7f7e280cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:38.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.832+0000 7f7e26ffd700 1 --2- 172.21.15.146:0/4022355242 >> v2:172.21.15.151:3300/0 conn(0x7f7e280cb090 0x7f7e280cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:38.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.832+0000 7f7e26ffd700 1 -- 172.21.15.146:0/4022355242 >> v1:172.21.15.151:6789/0 conn(0x7f7e28068780 legacy=0x7f7e2815b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:38.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.832+0000 7f7e26ffd700 1 -- 172.21.15.146:0/4022355242 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e280cb520 con 0x7f7e280b5640 2023-10-06T11:12:38.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.833+0000 7f7e26ffd700 1 --2- 172.21.15.146:0/4022355242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e280b5640 0x7f7e2815a870 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f7e28159e40 tx=0x7f7e18009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f743e63d3875d60c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:38.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.833+0000 7f7e25ffb700 1 -- 172.21.15.146:0/4022355242 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1800e070 con 0x7f7e280b5640 2023-10-06T11:12:38.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.833+0000 7f7e25ffb700 1 -- 172.21.15.146:0/4022355242 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1800ba10 con 0x7f7e280b5640 2023-10-06T11:12:38.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.833+0000 7f7e25ffb700 1 -- 172.21.15.146:0/4022355242 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e180092e0 con 0x7f7e280b5640 2023-10-06T11:12:38.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.833+0000 7f7e27fff700 1 -- 172.21.15.146:0/4022355242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e280b5640 msgr2=0x7f7e2815a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:38.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.833+0000 7f7e27fff700 1 --2- 172.21.15.146:0/4022355242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e280b5640 0x7f7e2815a870 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f7e28159e40 tx=0x7f7e18009840 comp rx=0 tx=0).stop 2023-10-06T11:12:38.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.833+0000 7f7e27fff700 1 -- 172.21.15.146:0/4022355242 shutdown_connections 2023-10-06T11:12:38.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.833+0000 7f7e27fff700 1 --2- 172.21.15.146:0/4022355242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e280b5640 0x7f7e2815a870 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:38.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.833+0000 7f7e27fff700 1 --2- 172.21.15.146:0/4022355242 >> v2:172.21.15.151:3300/0 conn(0x7f7e280cb090 0x7f7e280cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:38.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.833+0000 7f7e27fff700 1 -- 172.21.15.146:0/4022355242 >> 172.21.15.146:0/4022355242 conn(0x7f7e280703f0 msgr2=0x7f7e280707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:38.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.833+0000 7f7e27fff700 1 -- 172.21.15.146:0/4022355242 shutdown_connections 2023-10-06T11:12:38.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.833+0000 7f7e27fff700 1 -- 172.21.15.146:0/4022355242 wait complete. 2023-10-06T11:12:38.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.834+0000 7f7e27fff700 1 Processor -- start 2023-10-06T11:12:38.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.834+0000 7f7e27fff700 1 -- start start 2023-10-06T11:12:38.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.835+0000 7f7e27fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e28068780 0x7f7e281468b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:38.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.835+0000 7f7e27fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e280b5640 0x7f7e280d02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:38.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.835+0000 7f7e27fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e280cb090 0x7f7e2815df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:38.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.835+0000 7f7e27fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e280cf250 con 0x7f7e28068780 2023-10-06T11:12:38.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.835+0000 7f7e27fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e280ce360 con 0x7f7e280b5640 2023-10-06T11:12:38.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.835+0000 7f7e27fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e280ce640 con 0x7f7e280cb090 2023-10-06T11:12:38.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.835+0000 7f7e26ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e28068780 0x7f7e281468b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:38.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.835+0000 7f7e26ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e28068780 0x7f7e281468b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33398/0 (socket says 172.21.15.146:33398) 2023-10-06T11:12:38.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.835+0000 7f7e26ffd700 1 -- 172.21.15.146:0/1951116639 learned_addr learned my addr 172.21.15.146:0/1951116639 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:38.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.835+0000 7f7e26ffd700 1 -- 172.21.15.146:0/1951116639 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e280cb090 msgr2=0x7f7e2815df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:38.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.836+0000 7f7e26ffd700 1 --2- 172.21.15.146:0/1951116639 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e280cb090 0x7f7e2815df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:38.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.836+0000 7f7e26ffd700 1 -- 172.21.15.146:0/1951116639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e280b5640 msgr2=0x7f7e280d02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:38.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.836+0000 7f7e26ffd700 1 --2- 172.21.15.146:0/1951116639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e280b5640 0x7f7e280d02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:38.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.836+0000 7f7e26ffd700 1 -- 172.21.15.146:0/1951116639 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e18009ae0 con 0x7f7e28068780 2023-10-06T11:12:38.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.836+0000 7f7e26ffd700 1 --2- 172.21.15.146:0/1951116639 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e28068780 0x7f7e281468b0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f7e280694f0 tx=0x7f7e18017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:38.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.836+0000 7f7e1effd700 1 -- 172.21.15.146:0/1951116639 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e180129d0 con 0x7f7e28068780 2023-10-06T11:12:38.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.836+0000 7f7e1effd700 1 -- 172.21.15.146:0/1951116639 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e18012b70 con 0x7f7e28068780 2023-10-06T11:12:38.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.836+0000 7f7e27fff700 1 -- 172.21.15.146:0/1951116639 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e280ce920 con 0x7f7e28068780 2023-10-06T11:12:38.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.836+0000 7f7e1effd700 1 -- 172.21.15.146:0/1951116639 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1801e430 con 0x7f7e28068780 2023-10-06T11:12:38.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.836+0000 7f7e27fff700 1 -- 172.21.15.146:0/1951116639 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e280ceee0 con 0x7f7e28068780 2023-10-06T11:12:38.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.837+0000 7f7e27fff700 1 -- 172.21.15.146:0/1951116639 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e280894b0 con 0x7f7e28068780 2023-10-06T11:12:38.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.837+0000 7f7e1effd700 1 -- 172.21.15.146:0/1951116639 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7e1801e820 con 0x7f7e28068780 2023-10-06T11:12:38.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.838+0000 7f7e1effd700 1 --2- 172.21.15.146:0/1951116639 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7e08066f30 0x7f7e080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:38.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.838+0000 7f7e1effd700 1 -- 172.21.15.146:0/1951116639 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f7e18085df0 con 0x7f7e28068780 2023-10-06T11:12:38.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.838+0000 7f7e267fc700 1 --2- 172.21.15.146:0/1951116639 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7e08066f30 0x7f7e080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:38.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.838+0000 7f7e267fc700 1 --2- 172.21.15.146:0/1951116639 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7e08066f30 0x7f7e080693e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7e10006fd0 tx=0x7f7e10006db0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:38.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:38.842+0000 7f7e1effd700 1 -- 172.21.15.146:0/1951116639 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7e18053160 con 0x7f7e28068780 2023-10-06T11:12:39.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.025+0000 7f7e27fff700 1 -- 172.21.15.146:0/1951116639 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f7e2804bb40 con 0x7f7e28068780 2023-10-06T11:12:39.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.029+0000 7f7e1effd700 1 -- 172.21.15.146:0/1951116639 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7e18056780 con 0x7f7e28068780 2023-10-06T11:12:39.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.031+0000 7f7e27fff700 1 -- 172.21.15.146:0/1951116639 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7e08066f30 msgr2=0x7f7e080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:39.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.031+0000 7f7e27fff700 1 --2- 172.21.15.146:0/1951116639 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7e08066f30 0x7f7e080693e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7e10006fd0 tx=0x7f7e10006db0 comp rx=0 tx=0).stop 2023-10-06T11:12:39.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.031+0000 7f7e27fff700 1 -- 172.21.15.146:0/1951116639 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e28068780 msgr2=0x7f7e281468b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:39.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.031+0000 7f7e27fff700 1 --2- 172.21.15.146:0/1951116639 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e28068780 0x7f7e281468b0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f7e280694f0 tx=0x7f7e18017000 comp rx=0 tx=0).stop 2023-10-06T11:12:39.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.031+0000 7f7e27fff700 1 -- 172.21.15.146:0/1951116639 shutdown_connections 2023-10-06T11:12:39.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.031+0000 7f7e27fff700 1 --2- 172.21.15.146:0/1951116639 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7e08066f30 0x7f7e080693e0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:39.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.031+0000 7f7e27fff700 1 --2- 172.21.15.146:0/1951116639 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e280cb090 0x7f7e2815df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:39.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.031+0000 7f7e27fff700 1 --2- 172.21.15.146:0/1951116639 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e28068780 0x7f7e281468b0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:39.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.031+0000 7f7e27fff700 1 --2- 172.21.15.146:0/1951116639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e280b5640 0x7f7e280d02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:39.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.031+0000 7f7e27fff700 1 -- 172.21.15.146:0/1951116639 >> 172.21.15.146:0/1951116639 conn(0x7f7e280703f0 msgr2=0x7f7e2815c880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:39.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.031+0000 7f7e27fff700 1 -- 172.21.15.146:0/1951116639 shutdown_connections 2023-10-06T11:12:39.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.031+0000 7f7e27fff700 1 -- 172.21.15.146:0/1951116639 wait complete. 2023-10-06T11:12:39.044 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T11:12:39.044 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:12:39.081 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:12:39.125 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T11:12:39.125 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T11:12:39.126 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:12:39.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.240+0000 7f790f787700 1 Processor -- start 2023-10-06T11:12:39.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.240+0000 7f790f787700 1 -- start start 2023-10-06T11:12:39.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.241+0000 7f790f787700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79080b28e0 0x7f79080c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:39.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.241+0000 7f790f787700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f79080c53f0 0x7f79080cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:39.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.241+0000 7f790f787700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f79080b2cb0 0x7f79080cf100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:39.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.241+0000 7f790f787700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79080ad2a0 con 0x7f79080c53f0 2023-10-06T11:12:39.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.241+0000 7f790f787700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7908099ec0 con 0x7f79080b2cb0 2023-10-06T11:12:39.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.241+0000 7f790f787700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79080c7240 con 0x7f79080b28e0 2023-10-06T11:12:39.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.241+0000 7f790cd22700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f79080c53f0 0x7f79080cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:39.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.241+0000 7f790cd22700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f79080c53f0 0x7f79080cebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33412/0 (socket says 172.21.15.146:33412) 2023-10-06T11:12:39.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.241+0000 7f790cd22700 1 -- 172.21.15.146:0/68995690 learned_addr learned my addr 172.21.15.146:0/68995690 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:39.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.241+0000 7f790d523700 1 --2- 172.21.15.146:0/68995690 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79080b28e0 0x7f79080c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:39.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.241+0000 7f790dd24700 1 --2- 172.21.15.146:0/68995690 >> v2:172.21.15.151:3300/0 conn(0x7f79080b2cb0 0x7f79080cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:39.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.241+0000 7f790cd22700 1 -- 172.21.15.146:0/68995690 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79080b28e0 msgr2=0x7f79080c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:39.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.241+0000 7f790cd22700 1 --2- 172.21.15.146:0/68995690 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79080b28e0 0x7f79080c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:39.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.241+0000 7f790cd22700 1 -- 172.21.15.146:0/68995690 >> v2:172.21.15.151:3300/0 conn(0x7f79080b2cb0 msgr2=0x7f79080cf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:39.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.241+0000 7f790cd22700 1 --2- 172.21.15.146:0/68995690 >> v2:172.21.15.151:3300/0 conn(0x7f79080b2cb0 0x7f79080cf100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:39.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.241+0000 7f790cd22700 1 -- 172.21.15.146:0/68995690 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79080c69a0 con 0x7f79080c53f0 2023-10-06T11:12:39.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.241+0000 7f790dd24700 1 --2- 172.21.15.146:0/68995690 >> v2:172.21.15.151:3300/0 conn(0x7f79080b2cb0 0x7f79080cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:12:39.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.241+0000 7f790d523700 1 --2- 172.21.15.146:0/68995690 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79080b28e0 0x7f79080c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:12:39.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.241+0000 7f790cd22700 1 --2- 172.21.15.146:0/68995690 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79080c53f0 0x7f79080cebc0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f790808aea0 tx=0x7f78f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cde27fb76ad73538 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:39.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.242+0000 7f78fffff700 1 -- 172.21.15.146:0/68995690 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f800b860 con 0x7f79080c53f0 2023-10-06T11:12:39.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.242+0000 7f78fffff700 1 -- 172.21.15.146:0/68995690 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f800b9c0 con 0x7f79080c53f0 2023-10-06T11:12:39.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.242+0000 7f78fffff700 1 -- 172.21.15.146:0/68995690 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f800bd60 con 0x7f79080c53f0 2023-10-06T11:12:39.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.242+0000 7f790f787700 1 -- 172.21.15.146:0/68995690 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79080c53f0 msgr2=0x7f79080cebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:39.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.242+0000 7f790f787700 1 --2- 172.21.15.146:0/68995690 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79080c53f0 0x7f79080cebc0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f790808aea0 tx=0x7f78f8009250 comp rx=0 tx=0).stop 2023-10-06T11:12:39.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.242+0000 7f790f787700 1 -- 172.21.15.146:0/68995690 shutdown_connections 2023-10-06T11:12:39.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.242+0000 7f790f787700 1 --2- 172.21.15.146:0/68995690 >> v2:172.21.15.151:3300/0 conn(0x7f79080b2cb0 0x7f79080cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:39.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.242+0000 7f790f787700 1 --2- 172.21.15.146:0/68995690 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79080b28e0 0x7f79080c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:39.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.242+0000 7f790f787700 1 --2- 172.21.15.146:0/68995690 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79080c53f0 0x7f79080cebc0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:39.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.242+0000 7f790f787700 1 -- 172.21.15.146:0/68995690 >> 172.21.15.146:0/68995690 conn(0x7f79080999a0 msgr2=0x7f790806f380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:39.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.242+0000 7f790f787700 1 -- 172.21.15.146:0/68995690 shutdown_connections 2023-10-06T11:12:39.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.242+0000 7f790f787700 1 -- 172.21.15.146:0/68995690 wait complete. 2023-10-06T11:12:39.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.243+0000 7f790f787700 1 Processor -- start 2023-10-06T11:12:39.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.243+0000 7f790f787700 1 -- start start 2023-10-06T11:12:39.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.244+0000 7f790f787700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79080b28e0 0x7f79080c90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:39.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.244+0000 7f790f787700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79080b2cb0 0x7f79080b3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:39.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.244+0000 7f790f787700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79080c53f0 0x7f79080b5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:39.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.244+0000 7f790f787700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79080b37f0 con 0x7f79080c53f0 2023-10-06T11:12:39.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.244+0000 7f790f787700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79080c8c50 con 0x7f79080b2cb0 2023-10-06T11:12:39.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.244+0000 7f790f787700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79080ca1e0 con 0x7f79080b28e0 2023-10-06T11:12:39.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.244+0000 7f790dd24700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79080c53f0 0x7f79080b5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:39.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.244+0000 7f790dd24700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79080c53f0 0x7f79080b5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33420/0 (socket says 172.21.15.146:33420) 2023-10-06T11:12:39.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.244+0000 7f790dd24700 1 -- 172.21.15.146:0/1706158634 learned_addr learned my addr 172.21.15.146:0/1706158634 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:39.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.245+0000 7f790d523700 1 --2- 172.21.15.146:0/1706158634 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79080b28e0 0x7f79080c90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:39.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.245+0000 7f790cd22700 1 --2- 172.21.15.146:0/1706158634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79080b2cb0 0x7f79080b3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:39.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.245+0000 7f790dd24700 1 -- 172.21.15.146:0/1706158634 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79080b28e0 msgr2=0x7f79080c90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:39.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.245+0000 7f790dd24700 1 --2- 172.21.15.146:0/1706158634 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79080b28e0 0x7f79080c90e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:39.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.245+0000 7f790dd24700 1 -- 172.21.15.146:0/1706158634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79080b2cb0 msgr2=0x7f79080b3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:39.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.245+0000 7f790dd24700 1 --2- 172.21.15.146:0/1706158634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79080b2cb0 0x7f79080b3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:39.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.245+0000 7f790dd24700 1 -- 172.21.15.146:0/1706158634 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f80094f0 con 0x7f79080c53f0 2023-10-06T11:12:39.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.245+0000 7f790dd24700 1 --2- 172.21.15.146:0/1706158634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79080c53f0 0x7f79080b5b20 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f790000d0d0 tx=0x7f79000099d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:39.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.245+0000 7f78fd7fa700 1 -- 172.21.15.146:0/1706158634 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790000dd70 con 0x7f79080c53f0 2023-10-06T11:12:39.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.245+0000 7f78fd7fa700 1 -- 172.21.15.146:0/1706158634 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f790000f040 con 0x7f79080c53f0 2023-10-06T11:12:39.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.245+0000 7f790f787700 1 -- 172.21.15.146:0/1706158634 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79080c8600 con 0x7f79080c53f0 2023-10-06T11:12:39.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.245+0000 7f78fd7fa700 1 -- 172.21.15.146:0/1706158634 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7900015670 con 0x7f79080c53f0 2023-10-06T11:12:39.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.245+0000 7f790f787700 1 -- 172.21.15.146:0/1706158634 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79080ca540 con 0x7f79080c53f0 2023-10-06T11:12:39.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.246+0000 7f790f787700 1 -- 172.21.15.146:0/1706158634 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79080c8dc0 con 0x7f79080c53f0 2023-10-06T11:12:39.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.246+0000 7f78fd7fa700 1 -- 172.21.15.146:0/1706158634 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f790001e3b0 con 0x7f79080c53f0 2023-10-06T11:12:39.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.247+0000 7f78fd7fa700 1 --2- 172.21.15.146:0/1706158634 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f78ec066f30 0x7f78ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:39.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.247+0000 7f78fd7fa700 1 -- 172.21.15.146:0/1706158634 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f79000848d0 con 0x7f79080c53f0 2023-10-06T11:12:39.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.247+0000 7f790d523700 1 --2- 172.21.15.146:0/1706158634 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f78ec066f30 0x7f78ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:39.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.247+0000 7f790d523700 1 --2- 172.21.15.146:0/1706158634 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f78ec066f30 0x7f78ec0693e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7904006ea0 tx=0x7f7904008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:39.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.251+0000 7f78fd7fa700 1 -- 172.21.15.146:0/1706158634 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7900051ce0 con 0x7f79080c53f0 2023-10-06T11:12:39.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.477+0000 7f790f787700 1 -- 172.21.15.146:0/1706158634 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f790804c380 con 0x7f79080c53f0 2023-10-06T11:12:39.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.478+0000 7f78fd7fa700 1 -- 172.21.15.146:0/1706158634 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+3541 (secure 0 0 0) 0x7f790001a090 con 0x7f79080c53f0 2023-10-06T11:12:39.479 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:12:39.479 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":79,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5975,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1366537881","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":1366537881},{"type":"v1","addr":"172.21.15.151:6835","nonce":1366537881}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":79},{"gid":6274,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3700176588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3700176588},{"type":"v1","addr":"172.21.15.151:6834","nonce":3700176588}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6771,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/3753626989","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3753626989},{"type":"v1","addr":"172.21.15.146:6836","nonce":3753626989}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59},{"gid":6774,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/1712863503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":1712863503},{"type":"v1","addr":"172.21.15.146:6837","nonce":1712863503}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[]} 2023-10-06T11:12:39.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.480+0000 7f790f787700 1 -- 172.21.15.146:0/1706158634 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f78ec066f30 msgr2=0x7f78ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:39.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.480+0000 7f790f787700 1 --2- 172.21.15.146:0/1706158634 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f78ec066f30 0x7f78ec0693e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7904006ea0 tx=0x7f7904008040 comp rx=0 tx=0).stop 2023-10-06T11:12:39.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.480+0000 7f790f787700 1 -- 172.21.15.146:0/1706158634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79080c53f0 msgr2=0x7f79080b5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:39.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.480+0000 7f790f787700 1 --2- 172.21.15.146:0/1706158634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79080c53f0 0x7f79080b5b20 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f790000d0d0 tx=0x7f79000099d0 comp rx=0 tx=0).stop 2023-10-06T11:12:39.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.480+0000 7f790f787700 1 -- 172.21.15.146:0/1706158634 shutdown_connections 2023-10-06T11:12:39.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.480+0000 7f790f787700 1 --2- 172.21.15.146:0/1706158634 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f78ec066f30 0x7f78ec0693e0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:39.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.480+0000 7f790f787700 1 --2- 172.21.15.146:0/1706158634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f79080c53f0 0x7f79080b5b20 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:39.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.480+0000 7f790f787700 1 --2- 172.21.15.146:0/1706158634 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f79080b28e0 0x7f79080c90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:39.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.480+0000 7f790f787700 1 --2- 172.21.15.146:0/1706158634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79080b2cb0 0x7f79080b3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:39.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.480+0000 7f790f787700 1 -- 172.21.15.146:0/1706158634 >> 172.21.15.146:0/1706158634 conn(0x7f79080999a0 msgr2=0x7f79080cee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:39.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.480+0000 7f790f787700 1 -- 172.21.15.146:0/1706158634 shutdown_connections 2023-10-06T11:12:39.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.480+0000 7f790f787700 1 -- 172.21.15.146:0/1706158634 wait complete. 2023-10-06T11:12:39.482 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 79 2023-10-06T11:12:39.493 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T11:12:39.493 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T11:12:39.493 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T11:12:39.493 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:12:39.494 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T11:12:39.494 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T11:12:39.494 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T11:12:39.494 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:12:39.494 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T11:12:39.494 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T11:12:39.494 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T11:12:39.495 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:12:39.495 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T11:12:39.495 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T11:12:39.495 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T11:12:39.495 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:12:39.502 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T11:12:39.502 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T11:12:39.503 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T11:12:39.503 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T11:12:39.506 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T11:12:39.506 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T11:12:39.507 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T11:12:39.507 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T11:12:39.545 INFO:tasks.ceph.mds.a:Started 2023-10-06T11:12:39.546 DEBUG:teuthology.parallel:result is None 2023-10-06T11:12:39.546 INFO:tasks.ceph.mds.c:Started 2023-10-06T11:12:39.546 DEBUG:teuthology.parallel:result is None 2023-10-06T11:12:39.549 INFO:tasks.ceph.mds.d:Started 2023-10-06T11:12:39.549 DEBUG:teuthology.parallel:result is None 2023-10-06T11:12:39.549 INFO:tasks.ceph.mds.b:Started 2023-10-06T11:12:39.550 DEBUG:teuthology.parallel:result is None 2023-10-06T11:12:39.550 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T11:12:39.619 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2023-10-06T11:12:39.619 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2023-10-06T11:12:39.631 INFO:tasks.ceph.mds.d.smithi151.stdout:starting mds.d at 2023-10-06T11:12:39.632 INFO:tasks.ceph.mds.b.smithi151.stdout:starting mds.b at 2023-10-06T11:12:39.632 INFO:tasks.ceph.mds.d.smithi151.stderr:2023-10-06T11:12:39.630+0000 7fcef7491700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-10-06T11:12:39.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.671+0000 7feeb4c99700 1 Processor -- start 2023-10-06T11:12:39.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.671+0000 7feeb4c99700 1 -- start start 2023-10-06T11:12:39.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.672+0000 7feeb4c99700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7feeb0067a90 0x7feeb00b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:39.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.672+0000 7feeb4c99700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7feeb006e690 0x7feeb006eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:39.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.672+0000 7feeb4c99700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb015e4c0 con 0x7feeb00676c0 2023-10-06T11:12:39.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.672+0000 7feeb4c99700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb006f050 con 0x7feeb006e690 2023-10-06T11:12:39.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.672+0000 7feeb4c99700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb015a840 con 0x7feeb0067a90 2023-10-06T11:12:39.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.672+0000 7feeaed9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7feeb006e690 0x7feeb006eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:39.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.672+0000 7feeaed9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7feeb006e690 0x7feeb006eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33466/0 (socket says 172.21.15.146:33466) 2023-10-06T11:12:39.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.672+0000 7feeaed9d700 1 -- 172.21.15.146:0/2911970149 learned_addr learned my addr 172.21.15.146:0/2911970149 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:39.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.672+0000 7feeae59c700 1 --1- 172.21.15.146:0/2911970149 >> v1:172.21.15.151:6789/0 conn(0x7feeb00676c0 0x7feeb015ddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:57072/0 (socket says 172.21.15.146:57072) 2023-10-06T11:12:39.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.673+0000 7feeadd9b700 1 --2- 172.21.15.146:0/2911970149 >> v2:172.21.15.151:3300/0 conn(0x7feeb0067a90 0x7feeb00b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:39.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.673+0000 7feeaed9d700 1 -- 172.21.15.146:0/2911970149 >> v2:172.21.15.151:3300/0 conn(0x7feeb0067a90 msgr2=0x7feeb00b0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:39.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.673+0000 7feeaed9d700 1 --2- 172.21.15.146:0/2911970149 >> v2:172.21.15.151:3300/0 conn(0x7feeb0067a90 0x7feeb00b0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:39.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.673+0000 7feead59a700 1 -- 172.21.15.146:0/2911970149 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 67472310 0 0) 0x7feeb015e4c0 con 0x7feeb00676c0 2023-10-06T11:12:39.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.673+0000 7feeaed9d700 1 -- 172.21.15.146:0/2911970149 >> v1:172.21.15.151:6789/0 conn(0x7feeb00676c0 legacy=0x7feeb015ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:39.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.673+0000 7feeaed9d700 1 -- 172.21.15.146:0/2911970149 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb015ab20 con 0x7feeb006e690 2023-10-06T11:12:39.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.673+0000 7feeaed9d700 1 --2- 172.21.15.146:0/2911970149 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feeb006e690 0x7feeb006eb10 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7feeb006fc90 tx=0x7feea8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c837181d11472d3e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:39.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.673+0000 7feead59a700 1 -- 172.21.15.146:0/2911970149 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea800e070 con 0x7feeb006e690 2023-10-06T11:12:39.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.673+0000 7feead59a700 1 -- 172.21.15.146:0/2911970149 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea800ba20 con 0x7feeb006e690 2023-10-06T11:12:39.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.673+0000 7feead59a700 1 -- 172.21.15.146:0/2911970149 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea80092e0 con 0x7feeb006e690 2023-10-06T11:12:39.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.674+0000 7feeb4c99700 1 -- 172.21.15.146:0/2911970149 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feeb006e690 msgr2=0x7feeb006eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:39.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.674+0000 7feeb4c99700 1 --2- 172.21.15.146:0/2911970149 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feeb006e690 0x7feeb006eb10 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7feeb006fc90 tx=0x7feea8009840 comp rx=0 tx=0).stop 2023-10-06T11:12:39.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.674+0000 7feeb4c99700 1 -- 172.21.15.146:0/2911970149 shutdown_connections 2023-10-06T11:12:39.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.674+0000 7feeb4c99700 1 --2- 172.21.15.146:0/2911970149 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feeb006e690 0x7feeb006eb10 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:39.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.674+0000 7feeb4c99700 1 --2- 172.21.15.146:0/2911970149 >> v2:172.21.15.151:3300/0 conn(0x7feeb0067a90 0x7feeb00b0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:39.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.674+0000 7feeb4c99700 1 -- 172.21.15.146:0/2911970149 >> 172.21.15.146:0/2911970149 conn(0x7feeb0068580 msgr2=0x7feeb0068980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:39.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.674+0000 7feeb4c99700 1 -- 172.21.15.146:0/2911970149 shutdown_connections 2023-10-06T11:12:39.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.674+0000 7feeb4c99700 1 -- 172.21.15.146:0/2911970149 wait complete. 2023-10-06T11:12:39.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.675+0000 7feeb4c99700 1 Processor -- start 2023-10-06T11:12:39.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.675+0000 7feeb4c99700 1 -- start start 2023-10-06T11:12:39.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.676+0000 7feeb4c99700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feeb00676c0 0x7feeb00acb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:39.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.676+0000 7feeb4c99700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feeb0067a90 0x7feeb01419b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:39.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.676+0000 7feeb4c99700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feeb006e690 0x7feeb00b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:39.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.676+0000 7feeb4c99700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb01425b0 con 0x7feeb0067a90 2023-10-06T11:12:39.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.676+0000 7feeb4c99700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb00aabe0 con 0x7feeb006e690 2023-10-06T11:12:39.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.676+0000 7feeb4c99700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb00adb80 con 0x7feeb00676c0 2023-10-06T11:12:39.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.676+0000 7feeadd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feeb0067a90 0x7feeb01419b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:39.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.676+0000 7feeadd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feeb0067a90 0x7feeb01419b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33472/0 (socket says 172.21.15.146:33472) 2023-10-06T11:12:39.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.676+0000 7feeadd9b700 1 -- 172.21.15.146:0/2386135803 learned_addr learned my addr 172.21.15.146:0/2386135803 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:39.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.676+0000 7feeae59c700 1 --2- 172.21.15.146:0/2386135803 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feeb00676c0 0x7feeb00acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:39.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.676+0000 7feeaed9d700 1 --2- 172.21.15.146:0/2386135803 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feeb006e690 0x7feeb00b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:39.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.676+0000 7feeadd9b700 1 -- 172.21.15.146:0/2386135803 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feeb00676c0 msgr2=0x7feeb00acb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:39.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.676+0000 7feeadd9b700 1 --2- 172.21.15.146:0/2386135803 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feeb00676c0 0x7feeb00acb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:39.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.676+0000 7feeadd9b700 1 -- 172.21.15.146:0/2386135803 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feeb006e690 msgr2=0x7feeb00b00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:39.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.676+0000 7feeadd9b700 1 --2- 172.21.15.146:0/2386135803 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feeb006e690 0x7feeb00b00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:39.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.676+0000 7feeadd9b700 1 -- 172.21.15.146:0/2386135803 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea8009ae0 con 0x7feeb0067a90 2023-10-06T11:12:39.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.676+0000 7feeadd9b700 1 --2- 172.21.15.146:0/2386135803 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feeb0067a90 0x7feeb01419b0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7feea400ec80 tx=0x7feea40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:39.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.676+0000 7fee9e7fc700 1 -- 172.21.15.146:0/2386135803 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea400c850 con 0x7feeb0067a90 2023-10-06T11:12:39.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.676+0000 7fee9e7fc700 1 -- 172.21.15.146:0/2386135803 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea400c9b0 con 0x7feeb0067a90 2023-10-06T11:12:39.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.676+0000 7feeb4c99700 1 -- 172.21.15.146:0/2386135803 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb00ad8a0 con 0x7feeb0067a90 2023-10-06T11:12:39.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.676+0000 7fee9e7fc700 1 -- 172.21.15.146:0/2386135803 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea400cd50 con 0x7feeb0067a90 2023-10-06T11:12:39.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.676+0000 7feeb4c99700 1 -- 172.21.15.146:0/2386135803 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb00aa870 con 0x7feeb0067a90 2023-10-06T11:12:39.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.677+0000 7feeb4c99700 1 -- 172.21.15.146:0/2386135803 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb00aad70 con 0x7feeb0067a90 2023-10-06T11:12:39.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.678+0000 7fee9e7fc700 1 -- 172.21.15.146:0/2386135803 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feea4013680 con 0x7feeb0067a90 2023-10-06T11:12:39.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.678+0000 7fee9e7fc700 1 --2- 172.21.15.146:0/2386135803 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fee90066f30 0x7fee900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:39.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.678+0000 7feeae59c700 1 --2- 172.21.15.146:0/2386135803 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fee90066f30 0x7fee900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:39.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.678+0000 7fee9e7fc700 1 -- 172.21.15.146:0/2386135803 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5292+0+0 (secure 0 0 0) 0x7feea4084610 con 0x7feeb0067a90 2023-10-06T11:12:39.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.679+0000 7feeae59c700 1 --2- 172.21.15.146:0/2386135803 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fee90066f30 0x7fee900693e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7feea0007180 tx=0x7feea0007ef0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:39.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.683+0000 7fee9e7fc700 1 -- 172.21.15.146:0/2386135803 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feea4051a20 con 0x7feeb0067a90 2023-10-06T11:12:39.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:39.885+0000 7feeb4c99700 1 -- 172.21.15.146:0/2386135803 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7feeb004c380 con 0x7feeb0067a90 2023-10-06T11:12:40.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.709+0000 7fee9e7fc700 1 -- 172.21.15.146:0/2386135803 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v85) v1 ==== 97+0+0 (secure 0 0 0) 0x7feea4055040 con 0x7feeb0067a90 2023-10-06T11:12:40.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.712+0000 7feeb4c99700 1 -- 172.21.15.146:0/2386135803 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fee90066f30 msgr2=0x7fee900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:40.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.712+0000 7feeb4c99700 1 --2- 172.21.15.146:0/2386135803 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fee90066f30 0x7fee900693e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7feea0007180 tx=0x7feea0007ef0 comp rx=0 tx=0).stop 2023-10-06T11:12:40.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.712+0000 7feeb4c99700 1 -- 172.21.15.146:0/2386135803 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feeb0067a90 msgr2=0x7feeb01419b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:40.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.712+0000 7feeb4c99700 1 --2- 172.21.15.146:0/2386135803 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feeb0067a90 0x7feeb01419b0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7feea400ec80 tx=0x7feea40091a0 comp rx=0 tx=0).stop 2023-10-06T11:12:40.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.712+0000 7feeb4c99700 1 -- 172.21.15.146:0/2386135803 shutdown_connections 2023-10-06T11:12:40.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.712+0000 7feeb4c99700 1 --2- 172.21.15.146:0/2386135803 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fee90066f30 0x7fee900693e0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:40.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.712+0000 7feeb4c99700 1 --2- 172.21.15.146:0/2386135803 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feeb006e690 0x7feeb00b00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:40.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.712+0000 7feeb4c99700 1 --2- 172.21.15.146:0/2386135803 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feeb00676c0 0x7feeb00acb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:40.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.712+0000 7feeb4c99700 1 --2- 172.21.15.146:0/2386135803 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feeb0067a90 0x7feeb01419b0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:40.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.712+0000 7feeb4c99700 1 -- 172.21.15.146:0/2386135803 >> 172.21.15.146:0/2386135803 conn(0x7feeb0068580 msgr2=0x7feeb015b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:40.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.712+0000 7feeb4c99700 1 -- 172.21.15.146:0/2386135803 shutdown_connections 2023-10-06T11:12:40.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.712+0000 7feeb4c99700 1 -- 172.21.15.146:0/2386135803 wait complete. 2023-10-06T11:12:40.715 INFO:teuthology.orchestra.run.smithi146.stderr: removed all blocklist entries 2023-10-06T11:12:40.729 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T11:12:40.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.849+0000 7ff2e031b700 1 Processor -- start 2023-10-06T11:12:40.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.849+0000 7ff2e031b700 1 -- start start 2023-10-06T11:12:40.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.850+0000 7ff2e031b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff2d8153ab0 0x7ff2d815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:40.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.850+0000 7ff2e031b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2d8068ba0 0x7ff2d80b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:40.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.850+0000 7ff2e031b700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d815ac30 con 0x7ff2d8153e80 2023-10-06T11:12:40.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.850+0000 7ff2e031b700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2d80b4510 con 0x7ff2d8153ab0 2023-10-06T11:12:40.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.850+0000 7ff2e031b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d80b6530 con 0x7ff2d8068ba0 2023-10-06T11:12:40.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.850+0000 7ff2de8b8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2d8068ba0 0x7ff2d80b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:40.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.850+0000 7ff2de0b7700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff2d8153ab0 0x7ff2d815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:40.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.850+0000 7ff2de8b8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2d8068ba0 0x7ff2d80b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:41926/0 (socket says 172.21.15.146:41926) 2023-10-06T11:12:40.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.850+0000 7ff2de0b7700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff2d8153ab0 0x7ff2d815a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:38298/0 (socket says 172.21.15.146:38298) 2023-10-06T11:12:40.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.850+0000 7ff2de8b8700 1 -- 172.21.15.146:0/3831247695 learned_addr learned my addr 172.21.15.146:0/3831247695 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:40.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.850+0000 7ff2dd8b6700 1 --1- 172.21.15.146:0/3831247695 >> v1:172.21.15.151:6789/0 conn(0x7ff2d8153e80 0x7ff2d8068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:57084/0 (socket says 172.21.15.146:57084) 2023-10-06T11:12:40.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.850+0000 7ff2de8b8700 1 -- 172.21.15.146:0/3831247695 >> v2:172.21.15.151:3300/0 conn(0x7ff2d8153ab0 msgr2=0x7ff2d815a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:40.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.850+0000 7ff2de8b8700 1 --2- 172.21.15.146:0/3831247695 >> v2:172.21.15.151:3300/0 conn(0x7ff2d8153ab0 0x7ff2d815a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:40.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.850+0000 7ff2de8b8700 1 -- 172.21.15.146:0/3831247695 >> v1:172.21.15.151:6789/0 conn(0x7ff2d8153e80 legacy=0x7ff2d8068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:40.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.850+0000 7ff2de8b8700 1 -- 172.21.15.146:0/3831247695 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d80b5c50 con 0x7ff2d8068ba0 2023-10-06T11:12:40.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.850+0000 7ff2de0b7700 1 --2- 172.21.15.146:0/3831247695 >> v2:172.21.15.151:3300/0 conn(0x7ff2d8153ab0 0x7ff2d815a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:12:40.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.851+0000 7ff2de8b8700 1 --2- 172.21.15.146:0/3831247695 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2d8068ba0 0x7ff2d80b49a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4009f20 tx=0x7ff2d4009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b0869793e691e02 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:40.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.851+0000 7ff2dd0b5700 1 -- 172.21.15.146:0/3831247695 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d400e070 con 0x7ff2d8068ba0 2023-10-06T11:12:40.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.851+0000 7ff2dd0b5700 1 -- 172.21.15.146:0/3831247695 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d400b9d0 con 0x7ff2d8068ba0 2023-10-06T11:12:40.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.851+0000 7ff2dd0b5700 1 -- 172.21.15.146:0/3831247695 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d40092e0 con 0x7ff2d8068ba0 2023-10-06T11:12:40.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.851+0000 7ff2e031b700 1 -- 172.21.15.146:0/3831247695 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2d8068ba0 msgr2=0x7ff2d80b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:40.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.851+0000 7ff2e031b700 1 --2- 172.21.15.146:0/3831247695 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2d8068ba0 0x7ff2d80b49a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4009f20 tx=0x7ff2d4009840 comp rx=0 tx=0).stop 2023-10-06T11:12:40.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.851+0000 7ff2e031b700 1 -- 172.21.15.146:0/3831247695 shutdown_connections 2023-10-06T11:12:40.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.851+0000 7ff2e031b700 1 --2- 172.21.15.146:0/3831247695 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2d8068ba0 0x7ff2d80b49a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:40.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.851+0000 7ff2e031b700 1 --2- 172.21.15.146:0/3831247695 >> v2:172.21.15.151:3300/0 conn(0x7ff2d8153ab0 0x7ff2d815a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:40.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.851+0000 7ff2e031b700 1 -- 172.21.15.146:0/3831247695 >> 172.21.15.146:0/3831247695 conn(0x7ff2d806eba0 msgr2=0x7ff2d806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:40.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.851+0000 7ff2e031b700 1 -- 172.21.15.146:0/3831247695 shutdown_connections 2023-10-06T11:12:40.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.851+0000 7ff2e031b700 1 -- 172.21.15.146:0/3831247695 wait complete. 2023-10-06T11:12:40.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.852+0000 7ff2e031b700 1 Processor -- start 2023-10-06T11:12:40.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.853+0000 7ff2e031b700 1 -- start start 2023-10-06T11:12:40.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.853+0000 7ff2e031b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2d8068ba0 0x7ff2d8156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:40.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.853+0000 7ff2e031b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2d8153ab0 0x7ff2d813e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:40.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.853+0000 7ff2e031b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2d8153e80 0x7ff2d81697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:40.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.853+0000 7ff2e031b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d815a8c0 con 0x7ff2d8153e80 2023-10-06T11:12:40.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.853+0000 7ff2e031b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d81542a0 con 0x7ff2d8068ba0 2023-10-06T11:12:40.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.853+0000 7ff2e031b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d8154580 con 0x7ff2d8153ab0 2023-10-06T11:12:40.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.853+0000 7ff2de8b8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2d8153e80 0x7ff2d81697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:40.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.853+0000 7ff2de8b8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2d8153e80 0x7ff2d81697e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33480/0 (socket says 172.21.15.146:33480) 2023-10-06T11:12:40.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.853+0000 7ff2de8b8700 1 -- 172.21.15.146:0/2028536280 learned_addr learned my addr 172.21.15.146:0/2028536280 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:40.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.854+0000 7ff2dd8b6700 1 --2- 172.21.15.146:0/2028536280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2d8153ab0 0x7ff2d813e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:40.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.854+0000 7ff2de0b7700 1 --2- 172.21.15.146:0/2028536280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2d8068ba0 0x7ff2d8156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:40.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.854+0000 7ff2de8b8700 1 -- 172.21.15.146:0/2028536280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2d8153ab0 msgr2=0x7ff2d813e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:40.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.854+0000 7ff2de8b8700 1 --2- 172.21.15.146:0/2028536280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2d8153ab0 0x7ff2d813e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:40.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.854+0000 7ff2de8b8700 1 -- 172.21.15.146:0/2028536280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2d8068ba0 msgr2=0x7ff2d8156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:40.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.854+0000 7ff2de8b8700 1 --2- 172.21.15.146:0/2028536280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2d8068ba0 0x7ff2d8156180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:40.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.854+0000 7ff2de8b8700 1 -- 172.21.15.146:0/2028536280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d0009420 con 0x7ff2d8153e80 2023-10-06T11:12:40.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.854+0000 7ff2de0b7700 1 --2- 172.21.15.146:0/2028536280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2d8068ba0 0x7ff2d8156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:12:40.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.854+0000 7ff2dd8b6700 1 --2- 172.21.15.146:0/2028536280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2d8153ab0 0x7ff2d813e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:12:40.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.854+0000 7ff2de8b8700 1 --2- 172.21.15.146:0/2028536280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2d8153e80 0x7ff2d81697e0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7ff2d80b6670 tx=0x7ff2d4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:40.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.854+0000 7ff2ce7fc700 1 -- 172.21.15.146:0/2028536280 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d4008c30 con 0x7ff2d8153e80 2023-10-06T11:12:40.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.854+0000 7ff2ce7fc700 1 -- 172.21.15.146:0/2028536280 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d4008d90 con 0x7ff2d8153e80 2023-10-06T11:12:40.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.854+0000 7ff2e031b700 1 -- 172.21.15.146:0/2028536280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d4009ae0 con 0x7ff2d8153e80 2023-10-06T11:12:40.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.854+0000 7ff2ce7fc700 1 -- 172.21.15.146:0/2028536280 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d40256b0 con 0x7ff2d8153e80 2023-10-06T11:12:40.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.854+0000 7ff2e031b700 1 -- 172.21.15.146:0/2028536280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d816a300 con 0x7ff2d8153e80 2023-10-06T11:12:40.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.855+0000 7ff2e031b700 1 -- 172.21.15.146:0/2028536280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d804c380 con 0x7ff2d8153e80 2023-10-06T11:12:40.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.855+0000 7ff2ce7fc700 1 -- 172.21.15.146:0/2028536280 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff2d4003040 con 0x7ff2d8153e80 2023-10-06T11:12:40.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.856+0000 7ff2ce7fc700 1 --2- 172.21.15.146:0/2028536280 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff2bc066f30 0x7ff2bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:40.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.856+0000 7ff2ce7fc700 1 -- 172.21.15.146:0/2028536280 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5206+0+0 (secure 0 0 0) 0x7ff2d4085fd0 con 0x7ff2d8153e80 2023-10-06T11:12:40.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.856+0000 7ff2de0b7700 1 --2- 172.21.15.146:0/2028536280 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff2bc066f30 0x7ff2bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:40.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.856+0000 7ff2de0b7700 1 --2- 172.21.15.146:0/2028536280 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff2bc066f30 0x7ff2bc0693e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff2d00093f0 tx=0x7ff2d0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:40.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:40.860+0000 7ff2ce7fc700 1 -- 172.21.15.146:0/2028536280 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff2d4053430 con 0x7ff2d8153e80 2023-10-06T11:12:41.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.117+0000 7ff2e031b700 1 -- 172.21.15.146:0/2028536280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff2d80b6250 con 0x7ff2d8153e80 2023-10-06T11:12:41.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.118+0000 7ff2ce7fc700 1 -- 172.21.15.146:0/2028536280 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7ff2d4056a50 con 0x7ff2d8153e80 2023-10-06T11:12:41.119 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:12:41.120 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:12:41.120 INFO:teuthology.orchestra.run.smithi146.stdout: "auth_dump": [ 2023-10-06T11:12:41.120 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:12:41.120 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.a", 2023-10-06T11:12:41.120 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lG4F8DBAAp5A4Dtfzvv8n9ORgkmiP9g==", 2023-10-06T11:12:41.120 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:12:41.120 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:12:41.120 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:12:41.120 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:12:41.120 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:12:41.121 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:12:41.121 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:41.121 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:12:41.121 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.b", 2023-10-06T11:12:41.121 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lDIceGBAA4cr0oGVaXiy5hrruKY5DGw==", 2023-10-06T11:12:41.121 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:12:41.121 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:12:41.121 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:12:41.121 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:12:41.121 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:12:41.121 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:12:41.121 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:41.122 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:12:41.122 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.c", 2023-10-06T11:12:41.122 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lbYA7ExAAAopKjS7+WMUE5fuVQygILQ==", 2023-10-06T11:12:41.122 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:12:41.122 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:12:41.122 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:12:41.122 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:12:41.122 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:12:41.122 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:12:41.122 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:41.122 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:12:41.122 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.d", 2023-10-06T11:12:41.123 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9laygiHxAAasUUn7Wk9EwLa36ggsZtHw==", 2023-10-06T11:12:41.123 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:12:41.123 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:12:41.123 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:12:41.123 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:12:41.123 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:12:41.123 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:12:41.123 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:41.123 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:12:41.123 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.0", 2023-10-06T11:12:41.123 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDX6R9lLGo9NhAAcWJuUeOdEUsdDw84W9nLPw==", 2023-10-06T11:12:41.124 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:12:41.124 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:12:41.124 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:12:41.124 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:12:41.124 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:12:41.124 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:41.124 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:12:41.124 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.1", 2023-10-06T11:12:41.124 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDa6R9lk02gNBAA9YqWT2/Xds20lv0sGtBApg==", 2023-10-06T11:12:41.125 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:12:41.125 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:12:41.125 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:12:41.125 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:12:41.125 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:12:41.125 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:41.125 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:12:41.125 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.2", 2023-10-06T11:12:41.125 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDd6R9lrA6xMxAAmH8r6m2p4Jpa82xfYNcq+g==", 2023-10-06T11:12:41.126 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:12:41.126 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:12:41.126 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:12:41.126 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:12:41.126 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:12:41.126 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:41.126 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:12:41.127 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.3", 2023-10-06T11:12:41.127 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDg6R9ltlHXNBAAvhfI1yjlaWCIE9Xr/4F/PA==", 2023-10-06T11:12:41.127 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:12:41.127 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:12:41.127 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:12:41.127 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:12:41.127 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:12:41.127 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:41.127 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:12:41.127 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.4", 2023-10-06T11:12:41.128 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDm6R9lPUCvMhAAGbUNfpoFi9SvYdelpnL1jA==", 2023-10-06T11:12:41.128 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:12:41.128 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:12:41.128 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:12:41.128 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:12:41.128 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:12:41.128 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:41.128 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:12:41.128 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.5", 2023-10-06T11:12:41.129 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDp6R9lMfrMMBAAUEtnXDNr7+L3dQm4QE9qDw==", 2023-10-06T11:12:41.129 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:12:41.129 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:12:41.129 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:12:41.129 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:12:41.129 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:12:41.129 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:41.129 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:12:41.129 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.6", 2023-10-06T11:12:41.129 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDs6R9lAmSDMBAArPp+6dVt/NyH9is46tL49g==", 2023-10-06T11:12:41.129 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:12:41.130 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:12:41.130 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:12:41.130 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:12:41.130 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:12:41.130 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:41.130 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:12:41.130 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.7", 2023-10-06T11:12:41.130 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDv6R9lnunMLRAA3o5ZtAyYDUoXTzjX9H8FCw==", 2023-10-06T11:12:41.130 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:12:41.130 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:12:41.130 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:12:41.131 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:12:41.131 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:12:41.131 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:41.131 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:12:41.131 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.0", 2023-10-06T11:12:41.131 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lCrPrIhAARrzj2VxVFkzF5L/ifIAqmw==", 2023-10-06T11:12:41.131 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:12:41.131 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:12:41.131 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow r", 2023-10-06T11:12:41.131 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T11:12:41.132 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:12:41.132 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:41.132 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:12:41.132 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.1", 2023-10-06T11:12:41.132 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9l10VSKxAA0HmXejgRRCQ7XpsMB7ljkQ==", 2023-10-06T11:12:41.132 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:12:41.132 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:12:41.132 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2023-10-06T11:12:41.132 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2023-10-06T11:12:41.132 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2023-10-06T11:12:41.132 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:12:41.133 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:41.133 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:12:41.133 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.2", 2023-10-06T11:12:41.133 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lpLpJKBAAF/vLDkBg9/VBqMK4pVVIkg==", 2023-10-06T11:12:41.133 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:12:41.133 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:12:41.133 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2023-10-06T11:12:41.133 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2023-10-06T11:12:41.133 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2023-10-06T11:12:41.134 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:12:41.134 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:41.134 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:12:41.134 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.3", 2023-10-06T11:12:41.134 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9luMqwMBAA4Y4I9hWTk2IqAzYwVQ13Pw==", 2023-10-06T11:12:41.134 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:12:41.134 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:12:41.134 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2023-10-06T11:12:41.135 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2023-10-06T11:12:41.135 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2023-10-06T11:12:41.135 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:12:41.135 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:41.135 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:12:41.135 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.admin", 2023-10-06T11:12:41.135 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDT6R9lSr9qIhAAiNEN9xFWUwFGsB+oUE1cXw==", 2023-10-06T11:12:41.135 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:12:41.135 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2023-10-06T11:12:41.135 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:12:41.136 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:12:41.136 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:12:41.136 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:12:41.136 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:41.136 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:12:41.136 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.x", 2023-10-06T11:12:41.136 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9llLpwCRAA4UH9Uqli2de9HIJR2fZ9xg==", 2023-10-06T11:12:41.136 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:12:41.137 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2023-10-06T11:12:41.137 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2023-10-06T11:12:41.137 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:12:41.137 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:12:41.137 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:41.137 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:12:41.137 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.y", 2023-10-06T11:12:41.138 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDT6R9l2uQxNxAAVSMhKVzbf2vC4opL7YCLdg==", 2023-10-06T11:12:41.138 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:12:41.138 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2023-10-06T11:12:41.138 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2023-10-06T11:12:41.138 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:12:41.138 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:12:41.138 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:12:41.139 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2023-10-06T11:12:41.139 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:12:41.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.119+0000 7ff2e031b700 1 -- 172.21.15.146:0/2028536280 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff2bc066f30 msgr2=0x7ff2bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:41.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.119+0000 7ff2e031b700 1 --2- 172.21.15.146:0/2028536280 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff2bc066f30 0x7ff2bc0693e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff2d00093f0 tx=0x7ff2d0008040 comp rx=0 tx=0).stop 2023-10-06T11:12:41.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.119+0000 7ff2e031b700 1 -- 172.21.15.146:0/2028536280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2d8153e80 msgr2=0x7ff2d81697e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:41.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.119+0000 7ff2e031b700 1 --2- 172.21.15.146:0/2028536280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2d8153e80 0x7ff2d81697e0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7ff2d80b6670 tx=0x7ff2d4018000 comp rx=0 tx=0).stop 2023-10-06T11:12:41.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.120+0000 7ff2e031b700 1 -- 172.21.15.146:0/2028536280 shutdown_connections 2023-10-06T11:12:41.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.120+0000 7ff2e031b700 1 --2- 172.21.15.146:0/2028536280 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff2bc066f30 0x7ff2bc0693e0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:41.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.120+0000 7ff2e031b700 1 --2- 172.21.15.146:0/2028536280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2d8153e80 0x7ff2d81697e0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:41.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.120+0000 7ff2e031b700 1 --2- 172.21.15.146:0/2028536280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2d8068ba0 0x7ff2d8156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:41.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.120+0000 7ff2e031b700 1 --2- 172.21.15.146:0/2028536280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2d8153ab0 0x7ff2d813e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:41.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.120+0000 7ff2e031b700 1 -- 172.21.15.146:0/2028536280 >> 172.21.15.146:0/2028536280 conn(0x7ff2d806eba0 msgr2=0x7ff2d80d0600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:41.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.120+0000 7ff2e031b700 1 -- 172.21.15.146:0/2028536280 shutdown_connections 2023-10-06T11:12:41.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.120+0000 7ff2e031b700 1 -- 172.21.15.146:0/2028536280 wait complete. 2023-10-06T11:12:41.142 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:12:41.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.256+0000 7fdb0cdb3700 1 Processor -- start 2023-10-06T11:12:41.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.256+0000 7fdb0cdb3700 1 -- start start 2023-10-06T11:12:41.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.256+0000 7fdb0cdb3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdb08153ab0 0x7fdb0815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:41.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.256+0000 7fdb0cdb3700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fdb08153e80 0x7fdb08068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:41.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.256+0000 7fdb0cdb3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb0815ac30 con 0x7fdb080689d0 2023-10-06T11:12:41.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.256+0000 7fdb0cdb3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb080b4510 con 0x7fdb08153ab0 2023-10-06T11:12:41.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.256+0000 7fdb0cdb3700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb080b6530 con 0x7fdb08153e80 2023-10-06T11:12:41.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.256+0000 7fdb0659c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdb08153ab0 0x7fdb0815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:41.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.257+0000 7fdb06d9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fdb080689d0 0x7fdb0815d270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:54080/0 (socket says 172.21.15.146:54080) 2023-10-06T11:12:41.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.257+0000 7fdb06d9d700 1 -- 172.21.15.146:0/4014890393 learned_addr learned my addr 172.21.15.146:0/4014890393 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:12:41.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.257+0000 7fdafdd9b700 1 --2- 172.21.15.146:0/4014890393 >> v2:172.21.15.151:3300/0 conn(0x7fdb08153e80 0x7fdb08068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:41.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.257+0000 7fdb0659c700 1 -- 172.21.15.146:0/4014890393 >> v2:172.21.15.151:3300/0 conn(0x7fdb08153e80 msgr2=0x7fdb08068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:41.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.257+0000 7fdb0659c700 1 --2- 172.21.15.146:0/4014890393 >> v2:172.21.15.151:3300/0 conn(0x7fdb08153e80 0x7fdb08068490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:41.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.257+0000 7fdb0659c700 1 -- 172.21.15.146:0/4014890393 >> v1:172.21.15.146:6789/0 conn(0x7fdb080689d0 legacy=0x7fdb0815d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:41.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.257+0000 7fdb0659c700 1 -- 172.21.15.146:0/4014890393 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb08068dd0 con 0x7fdb08153ab0 2023-10-06T11:12:41.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.257+0000 7fdb05d9b700 1 -- 172.21.15.146:0/4014890393 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4265542575 0 0) 0x7fdb00001490 con 0x7fdb080689d0 2023-10-06T11:12:41.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.257+0000 7fdafdd9b700 1 --2- 172.21.15.146:0/4014890393 >> v2:172.21.15.151:3300/0 conn(0x7fdb08153e80 0x7fdb08068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:12:41.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.257+0000 7fdb0659c700 1 --2- 172.21.15.146:0/4014890393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb08153ab0 0x7fdb0815a6f0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fdb08089770 tx=0x7fdaf80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b51bd4f5984f00 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:41.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.257+0000 7fdb05d9b700 1 -- 172.21.15.146:0/4014890393 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf800b6b0 con 0x7fdb08153ab0 2023-10-06T11:12:41.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.257+0000 7fdb05d9b700 1 -- 172.21.15.146:0/4014890393 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf800b810 con 0x7fdb08153ab0 2023-10-06T11:12:41.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.257+0000 7fdb05d9b700 1 -- 172.21.15.146:0/4014890393 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf800bbb0 con 0x7fdb08153ab0 2023-10-06T11:12:41.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.258+0000 7fdb0cdb3700 1 -- 172.21.15.146:0/4014890393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb08153ab0 msgr2=0x7fdb0815a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:41.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.258+0000 7fdb0cdb3700 1 --2- 172.21.15.146:0/4014890393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb08153ab0 0x7fdb0815a6f0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fdb08089770 tx=0x7fdaf80091a0 comp rx=0 tx=0).stop 2023-10-06T11:12:41.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.258+0000 7fdb0cdb3700 1 -- 172.21.15.146:0/4014890393 shutdown_connections 2023-10-06T11:12:41.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.258+0000 7fdb0cdb3700 1 --2- 172.21.15.146:0/4014890393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb08153ab0 0x7fdb0815a6f0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:41.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.258+0000 7fdb0cdb3700 1 --2- 172.21.15.146:0/4014890393 >> v2:172.21.15.151:3300/0 conn(0x7fdb08153e80 0x7fdb08068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:41.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.258+0000 7fdb0cdb3700 1 -- 172.21.15.146:0/4014890393 >> 172.21.15.146:0/4014890393 conn(0x7fdb0806eba0 msgr2=0x7fdb0806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:41.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.258+0000 7fdb0cdb3700 1 -- 172.21.15.146:0/4014890393 shutdown_connections 2023-10-06T11:12:41.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.258+0000 7fdb0cdb3700 1 -- 172.21.15.146:0/4014890393 wait complete. 2023-10-06T11:12:41.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.259+0000 7fdb0cdb3700 1 Processor -- start 2023-10-06T11:12:41.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.259+0000 7fdb0cdb3700 1 -- start start 2023-10-06T11:12:41.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.260+0000 7fdb0cdb3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb080689d0 0x7fdb08155760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:41.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.260+0000 7fdb0cdb3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb08153ab0 0x7fdb08159340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:41.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.260+0000 7fdb0cdb3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb08153e80 0x7fdb081567c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:41.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.260+0000 7fdb0cdb3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb081552d0 con 0x7fdb08153e80 2023-10-06T11:12:41.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.260+0000 7fdb0cdb3700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb081546c0 con 0x7fdb080689d0 2023-10-06T11:12:41.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.260+0000 7fdb0cdb3700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb081549a0 con 0x7fdb08153ab0 2023-10-06T11:12:41.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.260+0000 7fdb06d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb08153e80 0x7fdb081567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:41.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.260+0000 7fdb06d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb08153e80 0x7fdb081567c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33492/0 (socket says 172.21.15.146:33492) 2023-10-06T11:12:41.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.260+0000 7fdb06d9d700 1 -- 172.21.15.146:0/3535678817 learned_addr learned my addr 172.21.15.146:0/3535678817 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:41.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.260+0000 7fdb0659c700 1 --2- 172.21.15.146:0/3535678817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb080689d0 0x7fdb08155760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:41.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.260+0000 7fdafdd9b700 1 --2- 172.21.15.146:0/3535678817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb08153ab0 0x7fdb08159340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:41.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.260+0000 7fdb06d9d700 1 -- 172.21.15.146:0/3535678817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb08153ab0 msgr2=0x7fdb08159340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:41.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.260+0000 7fdb06d9d700 1 --2- 172.21.15.146:0/3535678817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb08153ab0 0x7fdb08159340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:41.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.260+0000 7fdb06d9d700 1 -- 172.21.15.146:0/3535678817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb080689d0 msgr2=0x7fdb08155760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:41.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.260+0000 7fdb06d9d700 1 --2- 172.21.15.146:0/3535678817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb080689d0 0x7fdb08155760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:41.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.260+0000 7fdb06d9d700 1 -- 172.21.15.146:0/3535678817 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf8009420 con 0x7fdb08153e80 2023-10-06T11:12:41.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.260+0000 7fdb06d9d700 1 --2- 172.21.15.146:0/3535678817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb08153e80 0x7fdb081567c0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fdb0000cbf0 tx=0x7fdb000019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:41.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.260+0000 7fdafeffd700 1 -- 172.21.15.146:0/3535678817 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0000a8b0 con 0x7fdb08153e80 2023-10-06T11:12:41.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.260+0000 7fdafeffd700 1 -- 172.21.15.146:0/3535678817 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0000aa10 con 0x7fdb08153e80 2023-10-06T11:12:41.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.260+0000 7fdb0cdb3700 1 -- 172.21.15.146:0/3535678817 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb08154c80 con 0x7fdb08153e80 2023-10-06T11:12:41.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.260+0000 7fdafeffd700 1 -- 172.21.15.146:0/3535678817 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0000add0 con 0x7fdb08153e80 2023-10-06T11:12:41.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.260+0000 7fdb0cdb3700 1 -- 172.21.15.146:0/3535678817 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb081542e0 con 0x7fdb08153e80 2023-10-06T11:12:41.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.261+0000 7fdb0cdb3700 1 -- 172.21.15.146:0/3535678817 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb08155480 con 0x7fdb08153e80 2023-10-06T11:12:41.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.262+0000 7fdafeffd700 1 -- 172.21.15.146:0/3535678817 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdb00007300 con 0x7fdb08153e80 2023-10-06T11:12:41.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.262+0000 7fdafeffd700 1 --2- 172.21.15.146:0/3535678817 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdae8066f30 0x7fdae80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:41.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.262+0000 7fdafeffd700 1 -- 172.21.15.146:0/3535678817 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fdb00084450 con 0x7fdb08153e80 2023-10-06T11:12:41.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.262+0000 7fdb0659c700 1 --2- 172.21.15.146:0/3535678817 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdae8066f30 0x7fdae80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:41.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.263+0000 7fdb0659c700 1 --2- 172.21.15.146:0/3535678817 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdae8066f30 0x7fdae80693e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fdaf80093f0 tx=0x7fdaf8017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:41.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.266+0000 7fdafeffd700 1 -- 172.21.15.146:0/3535678817 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdb08155480 con 0x7fdb08153e80 2023-10-06T11:12:41.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.453+0000 7fdb0cdb3700 1 -- 172.21.15.146:0/3535678817 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb0804c380 con 0x7fdb08153e80 2023-10-06T11:12:41.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.454+0000 7fdafeffd700 1 -- 172.21.15.146:0/3535678817 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+13699 (secure 0 0 0) 0x7fdb00051930 con 0x7fdb08153e80 2023-10-06T11:12:41.456 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:12:41.456 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":85,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:12:40.704209+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:12:41.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.456+0000 7fdb0cdb3700 1 -- 172.21.15.146:0/3535678817 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdae8066f30 msgr2=0x7fdae80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:41.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.456+0000 7fdb0cdb3700 1 --2- 172.21.15.146:0/3535678817 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdae8066f30 0x7fdae80693e0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fdaf80093f0 tx=0x7fdaf8017000 comp rx=0 tx=0).stop 2023-10-06T11:12:41.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.456+0000 7fdb0cdb3700 1 -- 172.21.15.146:0/3535678817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb08153e80 msgr2=0x7fdb081567c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:41.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.456+0000 7fdb0cdb3700 1 --2- 172.21.15.146:0/3535678817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb08153e80 0x7fdb081567c0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fdb0000cbf0 tx=0x7fdb000019b0 comp rx=0 tx=0).stop 2023-10-06T11:12:41.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.456+0000 7fdb0cdb3700 1 -- 172.21.15.146:0/3535678817 shutdown_connections 2023-10-06T11:12:41.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.456+0000 7fdb0cdb3700 1 --2- 172.21.15.146:0/3535678817 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdae8066f30 0x7fdae80693e0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:41.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.456+0000 7fdb0cdb3700 1 --2- 172.21.15.146:0/3535678817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb08153e80 0x7fdb081567c0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:41.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.456+0000 7fdb0cdb3700 1 --2- 172.21.15.146:0/3535678817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb080689d0 0x7fdb08155760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:41.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.456+0000 7fdb0cdb3700 1 --2- 172.21.15.146:0/3535678817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb08153ab0 0x7fdb08159340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:41.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.456+0000 7fdb0cdb3700 1 -- 172.21.15.146:0/3535678817 >> 172.21.15.146:0/3535678817 conn(0x7fdb0806eba0 msgr2=0x7fdb081520f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:41.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.456+0000 7fdb0cdb3700 1 -- 172.21.15.146:0/3535678817 shutdown_connections 2023-10-06T11:12:41.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.456+0000 7fdb0cdb3700 1 -- 172.21.15.146:0/3535678817 wait complete. 2023-10-06T11:12:41.470 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:05:36.687307+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:05:37.171199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T11:12:41.471 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:12:41.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.589+0000 7fdf8cd32700 1 Processor -- start 2023-10-06T11:12:41.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.589+0000 7fdf8cd32700 1 -- start start 2023-10-06T11:12:41.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.590+0000 7fdf8cd32700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fdf8815a160 0x7fdf880c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:41.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.590+0000 7fdf8cd32700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf880cb950 0x7fdf880cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:41.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.590+0000 7fdf8cd32700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf880ae2a0 con 0x7fdf880ae730 2023-10-06T11:12:41.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.590+0000 7fdf8cd32700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf8815a530 con 0x7fdf8815a160 2023-10-06T11:12:41.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.590+0000 7fdf8cd32700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf880ad690 con 0x7fdf880cb950 2023-10-06T11:12:41.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.590+0000 7fdf85d9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fdf880ae730 0x7fdf880aebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:37850/0 (socket says 172.21.15.146:37850) 2023-10-06T11:12:41.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.590+0000 7fdf85d9b700 1 -- 172.21.15.146:0/2330024402 learned_addr learned my addr 172.21.15.146:0/2330024402 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:12:41.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.591+0000 7fdf86d9d700 1 --2- 172.21.15.146:0/2330024402 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf880cb950 0x7fdf880cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:41.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.591+0000 7fdf8659c700 1 --2- 172.21.15.146:0/2330024402 >> v2:172.21.15.151:3300/0 conn(0x7fdf8815a160 0x7fdf880c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:41.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.591+0000 7fdf8559a700 1 -- 172.21.15.146:0/2330024402 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3805393901 0 0) 0x7fdf880ae2a0 con 0x7fdf880ae730 2023-10-06T11:12:41.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.591+0000 7fdf8559a700 1 -- 172.21.15.146:0/2330024402 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf70003570 con 0x7fdf880ae730 2023-10-06T11:12:41.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.591+0000 7fdf86d9d700 1 -- 172.21.15.146:0/2330024402 >> v2:172.21.15.151:3300/0 conn(0x7fdf8815a160 msgr2=0x7fdf880c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:41.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.591+0000 7fdf86d9d700 1 --2- 172.21.15.146:0/2330024402 >> v2:172.21.15.151:3300/0 conn(0x7fdf8815a160 0x7fdf880c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:41.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.591+0000 7fdf86d9d700 1 -- 172.21.15.146:0/2330024402 >> v1:172.21.15.146:6789/0 conn(0x7fdf880ae730 legacy=0x7fdf880aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:41.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.591+0000 7fdf8559a700 1 -- 172.21.15.146:0/2330024402 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1485259669 0 0) 0x7fdf70003570 con 0x7fdf880ae730 2023-10-06T11:12:41.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.591+0000 7fdf86d9d700 1 -- 172.21.15.146:0/2330024402 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf880ad970 con 0x7fdf880cb950 2023-10-06T11:12:41.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.591+0000 7fdf86d9d700 1 --2- 172.21.15.146:0/2330024402 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf880cb950 0x7fdf880cbdb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdf800098e0 tx=0x7fdf800091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c311b1d57120bf26 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:41.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.591+0000 7fdf8559a700 1 -- 172.21.15.146:0/2330024402 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c001470 con 0x7fdf880cb950 2023-10-06T11:12:41.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.591+0000 7fdf8559a700 1 -- 172.21.15.146:0/2330024402 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf80011420 con 0x7fdf880cb950 2023-10-06T11:12:41.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.591+0000 7fdf8559a700 1 -- 172.21.15.146:0/2330024402 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf800117a0 con 0x7fdf880cb950 2023-10-06T11:12:41.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.592+0000 7fdf8cd32700 1 -- 172.21.15.146:0/2330024402 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf880cb950 msgr2=0x7fdf880cbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:41.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.592+0000 7fdf8cd32700 1 --2- 172.21.15.146:0/2330024402 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf880cb950 0x7fdf880cbdb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdf800098e0 tx=0x7fdf800091a0 comp rx=0 tx=0).stop 2023-10-06T11:12:41.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.592+0000 7fdf8cd32700 1 -- 172.21.15.146:0/2330024402 shutdown_connections 2023-10-06T11:12:41.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.592+0000 7fdf8cd32700 1 --2- 172.21.15.146:0/2330024402 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf880cb950 0x7fdf880cbdb0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:41.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.592+0000 7fdf8cd32700 1 --2- 172.21.15.146:0/2330024402 >> v2:172.21.15.151:3300/0 conn(0x7fdf8815a160 0x7fdf880c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:41.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.592+0000 7fdf8cd32700 1 -- 172.21.15.146:0/2330024402 >> 172.21.15.146:0/2330024402 conn(0x7fdf8806f380 msgr2=0x7fdf880d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:41.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.592+0000 7fdf8cd32700 1 -- 172.21.15.146:0/2330024402 shutdown_connections 2023-10-06T11:12:41.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.592+0000 7fdf8cd32700 1 -- 172.21.15.146:0/2330024402 wait complete. 2023-10-06T11:12:41.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.593+0000 7fdf8cd32700 1 Processor -- start 2023-10-06T11:12:41.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.593+0000 7fdf8cd32700 1 -- start start 2023-10-06T11:12:41.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.594+0000 7fdf8cd32700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf880ae730 0x7fdf88068f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:41.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.594+0000 7fdf8cd32700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf880cb950 0x7fdf88158f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:41.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.594+0000 7fdf8cd32700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf8815a160 0x7fdf88154490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:41.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.594+0000 7fdf8cd32700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf88154000 con 0x7fdf880cb950 2023-10-06T11:12:41.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.594+0000 7fdf8cd32700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf881533f0 con 0x7fdf880ae730 2023-10-06T11:12:41.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.594+0000 7fdf8cd32700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf881536d0 con 0x7fdf8815a160 2023-10-06T11:12:41.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.594+0000 7fdf85d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf880cb950 0x7fdf88158f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:41.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.594+0000 7fdf85d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf880cb950 0x7fdf88158f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39080/0 (socket says 172.21.15.146:39080) 2023-10-06T11:12:41.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.594+0000 7fdf85d9b700 1 -- 172.21.15.146:0/2786876065 learned_addr learned my addr 172.21.15.146:0/2786876065 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:41.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.594+0000 7fdf86d9d700 1 --2- 172.21.15.146:0/2786876065 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf8815a160 0x7fdf88154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:41.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.594+0000 7fdf8659c700 1 --2- 172.21.15.146:0/2786876065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf880ae730 0x7fdf88068f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:41.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.594+0000 7fdf85d9b700 1 -- 172.21.15.146:0/2786876065 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf8815a160 msgr2=0x7fdf88154490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:41.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.594+0000 7fdf85d9b700 1 --2- 172.21.15.146:0/2786876065 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf8815a160 0x7fdf88154490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:41.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.594+0000 7fdf85d9b700 1 -- 172.21.15.146:0/2786876065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf880ae730 msgr2=0x7fdf88068f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:41.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.594+0000 7fdf85d9b700 1 --2- 172.21.15.146:0/2786876065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf880ae730 0x7fdf88068f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:41.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.594+0000 7fdf85d9b700 1 -- 172.21.15.146:0/2786876065 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf80009420 con 0x7fdf880cb950 2023-10-06T11:12:41.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.594+0000 7fdf8659c700 1 --2- 172.21.15.146:0/2786876065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf880ae730 0x7fdf88068f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:12:41.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.594+0000 7fdf86d9d700 1 --2- 172.21.15.146:0/2786876065 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf8815a160 0x7fdf88154490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:12:41.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.594+0000 7fdf85d9b700 1 --2- 172.21.15.146:0/2786876065 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf880cb950 0x7fdf88158f30 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c00cb90 tx=0x7fdf7c001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:41.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.594+0000 7fdf767fc700 1 -- 172.21.15.146:0/2786876065 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c007150 con 0x7fdf880cb950 2023-10-06T11:12:41.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.594+0000 7fdf767fc700 1 -- 172.21.15.146:0/2786876065 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf7c0072d0 con 0x7fdf880cb950 2023-10-06T11:12:41.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.594+0000 7fdf8cd32700 1 -- 172.21.15.146:0/2786876065 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf881539b0 con 0x7fdf880cb950 2023-10-06T11:12:41.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.594+0000 7fdf767fc700 1 -- 172.21.15.146:0/2786876065 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c007690 con 0x7fdf880cb950 2023-10-06T11:12:41.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.594+0000 7fdf8cd32700 1 -- 172.21.15.146:0/2786876065 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf88152fb0 con 0x7fdf880cb950 2023-10-06T11:12:41.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.595+0000 7fdf8cd32700 1 -- 172.21.15.146:0/2786876065 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf88068390 con 0x7fdf880cb950 2023-10-06T11:12:41.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.596+0000 7fdf767fc700 1 -- 172.21.15.146:0/2786876065 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdf7c004a40 con 0x7fdf880cb950 2023-10-06T11:12:41.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.596+0000 7fdf767fc700 1 --2- 172.21.15.146:0/2786876065 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdf68066f30 0x7fdf680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:41.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.596+0000 7fdf767fc700 1 -- 172.21.15.146:0/2786876065 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fdf7c083b90 con 0x7fdf880cb950 2023-10-06T11:12:41.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.596+0000 7fdf8659c700 1 --2- 172.21.15.146:0/2786876065 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdf68066f30 0x7fdf680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:41.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.596+0000 7fdf8659c700 1 --2- 172.21.15.146:0/2786876065 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdf68066f30 0x7fdf680693e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fdf880ae4e0 tx=0x7fdf7800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:41.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.600+0000 7fdf767fc700 1 -- 172.21.15.146:0/2786876065 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdf7c051070 con 0x7fdf880cb950 2023-10-06T11:12:41.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.788+0000 7fdf8cd32700 1 -- 172.21.15.146:0/2786876065 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdf88152bc0 con 0x7fdf880cb950 2023-10-06T11:12:41.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.788+0000 7fdf767fc700 1 -- 172.21.15.146:0/2786876065 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v85) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdf7c018020 con 0x7fdf880cb950 2023-10-06T11:12:41.790 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-10-06T11:12:41.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.791+0000 7fdf8cd32700 1 -- 172.21.15.146:0/2786876065 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdf68066f30 msgr2=0x7fdf680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:41.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.791+0000 7fdf8cd32700 1 --2- 172.21.15.146:0/2786876065 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdf68066f30 0x7fdf680693e0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fdf880ae4e0 tx=0x7fdf7800b040 comp rx=0 tx=0).stop 2023-10-06T11:12:41.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.791+0000 7fdf8cd32700 1 -- 172.21.15.146:0/2786876065 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf880cb950 msgr2=0x7fdf88158f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:41.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.791+0000 7fdf8cd32700 1 --2- 172.21.15.146:0/2786876065 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf880cb950 0x7fdf88158f30 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c00cb90 tx=0x7fdf7c001a30 comp rx=0 tx=0).stop 2023-10-06T11:12:41.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.791+0000 7fdf8cd32700 1 -- 172.21.15.146:0/2786876065 shutdown_connections 2023-10-06T11:12:41.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.791+0000 7fdf8cd32700 1 --2- 172.21.15.146:0/2786876065 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdf68066f30 0x7fdf680693e0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:41.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.791+0000 7fdf8cd32700 1 --2- 172.21.15.146:0/2786876065 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf8815a160 0x7fdf88154490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:41.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.791+0000 7fdf8cd32700 1 --2- 172.21.15.146:0/2786876065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf880ae730 0x7fdf88068f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:41.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.791+0000 7fdf8cd32700 1 --2- 172.21.15.146:0/2786876065 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf880cb950 0x7fdf88158f30 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:41.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.791+0000 7fdf8cd32700 1 -- 172.21.15.146:0/2786876065 >> 172.21.15.146:0/2786876065 conn(0x7fdf8806f380 msgr2=0x7fdf880cbe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:41.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.791+0000 7fdf8cd32700 1 -- 172.21.15.146:0/2786876065 shutdown_connections 2023-10-06T11:12:41.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.791+0000 7fdf8cd32700 1 -- 172.21.15.146:0/2786876065 wait complete. 2023-10-06T11:12:41.805 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:12:41.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.921+0000 7f7e8d777700 1 Processor -- start 2023-10-06T11:12:41.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.921+0000 7f7e8d777700 1 -- start start 2023-10-06T11:12:41.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.922+0000 7f7e8d777700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e880ae730 0x7f7e880aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:41.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.922+0000 7f7e8d777700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e880ae2a0 con 0x7f7e8815a160 2023-10-06T11:12:41.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.922+0000 7f7e8d777700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e8815a530 con 0x7f7e880cb950 2023-10-06T11:12:41.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.922+0000 7f7e8d777700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e880c5cb0 con 0x7f7e880ae730 2023-10-06T11:12:41.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.922+0000 7f7e86ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7e8815a160 0x7f7e880c55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:37856/0 (socket says 172.21.15.146:37856) 2023-10-06T11:12:41.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.922+0000 7f7e86ffd700 1 -- 172.21.15.146:0/2287737328 learned_addr learned my addr 172.21.15.146:0/2287737328 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:12:41.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.923+0000 7f7e85ffb700 1 -- 172.21.15.146:0/2287737328 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3198725791 0 0) 0x7f7e880ae2a0 con 0x7f7e8815a160 2023-10-06T11:12:41.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.923+0000 7f7e85ffb700 1 -- 172.21.15.146:0/2287737328 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e70003570 con 0x7f7e8815a160 2023-10-06T11:12:41.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.923+0000 7f7e867fc700 1 --2- 172.21.15.146:0/2287737328 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e880ae730 0x7f7e880aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:41.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.923+0000 7f7e85ffb700 1 -- 172.21.15.146:0/2287737328 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1395948858 0 0) 0x7f7e70003570 con 0x7f7e8815a160 2023-10-06T11:12:41.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.923+0000 7f7e85ffb700 1 -- 172.21.15.146:0/2287737328 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e880ae730 msgr2=0x7f7e880aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:41.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.923+0000 7f7e85ffb700 1 --2- 172.21.15.146:0/2287737328 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e880ae730 0x7f7e880aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:41.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.923+0000 7f7e85ffb700 1 -- 172.21.15.146:0/2287737328 >> v1:172.21.15.151:6789/0 conn(0x7f7e880cb950 legacy=0x7f7e880cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:41.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.923+0000 7f7e85ffb700 1 -- 172.21.15.146:0/2287737328 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e880ad690 con 0x7f7e8815a160 2023-10-06T11:12:41.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.923+0000 7f7e85ffb700 1 -- 172.21.15.146:0/2287737328 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f7e78001970 con 0x7f7e8815a160 2023-10-06T11:12:41.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.923+0000 7f7e85ffb700 1 -- 172.21.15.146:0/2287737328 >> v1:172.21.15.146:6789/0 conn(0x7f7e8815a160 legacy=0x7f7e880c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:41.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.923+0000 7f7e85ffb700 1 --2- 172.21.15.146:0/2287737328 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e70003a90 0x7f7e70003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:41.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.923+0000 7f7e85ffb700 1 --2- 172.21.15.146:0/2287737328 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e880ae730 0x7f7e70004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:41.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.923+0000 7f7e85ffb700 1 --2- 172.21.15.146:0/2287737328 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e70004da0 0x7f7e700051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:41.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.923+0000 7f7e85ffb700 1 -- 172.21.15.146:0/2287737328 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e880c5cb0 con 0x7f7e70003a90 2023-10-06T11:12:41.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.923+0000 7f7e85ffb700 1 -- 172.21.15.146:0/2287737328 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7000bc50 con 0x7f7e70004da0 2023-10-06T11:12:41.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.923+0000 7f7e85ffb700 1 -- 172.21.15.146:0/2287737328 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7000be10 con 0x7f7e880ae730 2023-10-06T11:12:41.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.923+0000 7f7e86ffd700 1 --2- 172.21.15.146:0/2287737328 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e70003a90 0x7f7e70003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:41.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.923+0000 7f7e867fc700 1 --2- 172.21.15.146:0/2287737328 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e880ae730 0x7f7e70004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:41.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.923+0000 7f7e877fe700 1 --2- 172.21.15.146:0/2287737328 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e70004da0 0x7f7e700051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:41.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.923+0000 7f7e86ffd700 1 -- 172.21.15.146:0/2287737328 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e880ae730 msgr2=0x7f7e70004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:41.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.923+0000 7f7e86ffd700 1 --2- 172.21.15.146:0/2287737328 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e880ae730 0x7f7e70004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:41.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.923+0000 7f7e86ffd700 1 -- 172.21.15.146:0/2287737328 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e70004da0 msgr2=0x7f7e700051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:41.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.923+0000 7f7e86ffd700 1 --2- 172.21.15.146:0/2287737328 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e70004da0 0x7f7e700051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:41.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.923+0000 7f7e86ffd700 1 -- 172.21.15.146:0/2287737328 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e70003570 con 0x7f7e70003a90 2023-10-06T11:12:41.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.923+0000 7f7e877fe700 1 --2- 172.21.15.146:0/2287737328 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e70004da0 0x7f7e700051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:12:41.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.923+0000 7f7e86ffd700 1 --2- 172.21.15.146:0/2287737328 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e70003a90 0x7f7e70003ea0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f7e7800c640 tx=0x7f7e78007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a1ce235941c8977 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:41.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.924+0000 7f7e85ffb700 1 -- 172.21.15.146:0/2287737328 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e78005b70 con 0x7f7e70003a90 2023-10-06T11:12:41.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.924+0000 7f7e85ffb700 1 -- 172.21.15.146:0/2287737328 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e78005cf0 con 0x7f7e70003a90 2023-10-06T11:12:41.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.924+0000 7f7e85ffb700 1 -- 172.21.15.146:0/2287737328 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e78007360 con 0x7f7e70003a90 2023-10-06T11:12:41.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.924+0000 7f7e8d777700 1 -- 172.21.15.146:0/2287737328 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e70003a90 msgr2=0x7f7e70003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:41.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.924+0000 7f7e8d777700 1 --2- 172.21.15.146:0/2287737328 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e70003a90 0x7f7e70003ea0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f7e7800c640 tx=0x7f7e78007ca0 comp rx=0 tx=0).stop 2023-10-06T11:12:41.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.924+0000 7f7e877fe700 1 -- 172.21.15.146:0/2287737328 reap_dead start 2023-10-06T11:12:41.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.924+0000 7f7e8d777700 1 -- 172.21.15.146:0/2287737328 shutdown_connections 2023-10-06T11:12:41.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.924+0000 7f7e8d777700 1 -- 172.21.15.146:0/2287737328 >> 172.21.15.146:0/2287737328 conn(0x7f7e8806f380 msgr2=0x7f7e880d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:41.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.924+0000 7f7e8d777700 1 -- 172.21.15.146:0/2287737328 shutdown_connections 2023-10-06T11:12:41.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.924+0000 7f7e8d777700 1 -- 172.21.15.146:0/2287737328 wait complete. 2023-10-06T11:12:41.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.925+0000 7f7e8d777700 1 Processor -- start 2023-10-06T11:12:41.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.925+0000 7f7e8d777700 1 -- start start 2023-10-06T11:12:41.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.926+0000 7f7e8d777700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e70003a90 0x7f7e88145010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:41.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.926+0000 7f7e8d777700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e880c9a10 0x7f7e880c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:41.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.926+0000 7f7e8d777700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e8815f1a0 0x7f7e8815f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:41.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.926+0000 7f7e8d777700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e880c9580 con 0x7f7e8815f1a0 2023-10-06T11:12:41.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.926+0000 7f7e8d777700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e88157a50 con 0x7f7e880c9a10 2023-10-06T11:12:41.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.926+0000 7f7e8d777700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e880c89b0 con 0x7f7e70003a90 2023-10-06T11:12:41.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.926+0000 7f7e877fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e8815f1a0 0x7f7e8815f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:41.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.926+0000 7f7e877fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e8815f1a0 0x7f7e8815f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39100/0 (socket says 172.21.15.146:39100) 2023-10-06T11:12:41.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.926+0000 7f7e877fe700 1 -- 172.21.15.146:0/3289530817 learned_addr learned my addr 172.21.15.146:0/3289530817 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:41.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.926+0000 7f7e86ffd700 1 --2- 172.21.15.146:0/3289530817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e70003a90 0x7f7e88145010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:41.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.926+0000 7f7e867fc700 1 --2- 172.21.15.146:0/3289530817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e880c9a10 0x7f7e880c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:41.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.926+0000 7f7e877fe700 1 -- 172.21.15.146:0/3289530817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e70003a90 msgr2=0x7f7e88145010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:41.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.926+0000 7f7e877fe700 1 --2- 172.21.15.146:0/3289530817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e70003a90 0x7f7e88145010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:41.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.926+0000 7f7e877fe700 1 -- 172.21.15.146:0/3289530817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e880c9a10 msgr2=0x7f7e880c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:41.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.926+0000 7f7e877fe700 1 --2- 172.21.15.146:0/3289530817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e880c9a10 0x7f7e880c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:41.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.926+0000 7f7e877fe700 1 -- 172.21.15.146:0/3289530817 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e880c8c50 con 0x7f7e8815f1a0 2023-10-06T11:12:41.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.927+0000 7f7e867fc700 1 --2- 172.21.15.146:0/3289530817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e880c9a10 0x7f7e880c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:12:41.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.927+0000 7f7e877fe700 1 --2- 172.21.15.146:0/3289530817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e8815f1a0 0x7f7e8815f610 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f7e88088980 tx=0x7f7e80009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:41.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.927+0000 7f7e6effd700 1 -- 172.21.15.146:0/3289530817 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e8000ee60 con 0x7f7e8815f1a0 2023-10-06T11:12:41.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.927+0000 7f7e6effd700 1 -- 172.21.15.146:0/3289530817 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e800114f0 con 0x7f7e8815f1a0 2023-10-06T11:12:41.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.927+0000 7f7e6effd700 1 -- 172.21.15.146:0/3289530817 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e800118b0 con 0x7f7e8815f1a0 2023-10-06T11:12:41.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.927+0000 7f7e8d777700 1 -- 172.21.15.146:0/3289530817 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e880c8f30 con 0x7f7e8815f1a0 2023-10-06T11:12:41.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.927+0000 7f7e8d777700 1 -- 172.21.15.146:0/3289530817 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e880b44d0 con 0x7f7e8815f1a0 2023-10-06T11:12:41.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.928+0000 7f7e8d777700 1 -- 172.21.15.146:0/3289530817 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e88068390 con 0x7f7e8815f1a0 2023-10-06T11:12:41.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.928+0000 7f7e6effd700 1 -- 172.21.15.146:0/3289530817 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7e80011ca0 con 0x7f7e8815f1a0 2023-10-06T11:12:41.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.929+0000 7f7e6effd700 1 --2- 172.21.15.146:0/3289530817 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7e74066f30 0x7f7e740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:41.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.929+0000 7f7e86ffd700 1 --2- 172.21.15.146:0/3289530817 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7e74066f30 0x7f7e740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:41.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.929+0000 7f7e6effd700 1 -- 172.21.15.146:0/3289530817 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f7e80083b10 con 0x7f7e8815f1a0 2023-10-06T11:12:41.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.929+0000 7f7e86ffd700 1 --2- 172.21.15.146:0/3289530817 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7e74066f30 0x7f7e740693e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7e7800c640 tx=0x7f7e78015000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:41.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:41.933+0000 7f7e6effd700 1 -- 172.21.15.146:0/3289530817 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7e80050f70 con 0x7f7e8815f1a0 2023-10-06T11:12:42.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.117+0000 7f7e8d777700 1 -- 172.21.15.146:0/3289530817 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7e8804c380 con 0x7f7e8815f1a0 2023-10-06T11:12:42.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.117+0000 7f7e6effd700 1 -- 172.21.15.146:0/3289530817 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7e80019020 con 0x7f7e8815f1a0 2023-10-06T11:12:42.119 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-10-06T11:12:42.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.119+0000 7f7e8d777700 1 -- 172.21.15.146:0/3289530817 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7e74066f30 msgr2=0x7f7e740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:42.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.119+0000 7f7e8d777700 1 --2- 172.21.15.146:0/3289530817 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7e74066f30 0x7f7e740693e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7e7800c640 tx=0x7f7e78015000 comp rx=0 tx=0).stop 2023-10-06T11:12:42.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.119+0000 7f7e8d777700 1 -- 172.21.15.146:0/3289530817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e8815f1a0 msgr2=0x7f7e8815f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:42.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.119+0000 7f7e8d777700 1 --2- 172.21.15.146:0/3289530817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e8815f1a0 0x7f7e8815f610 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f7e88088980 tx=0x7f7e80009040 comp rx=0 tx=0).stop 2023-10-06T11:12:42.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.119+0000 7f7e8d777700 1 -- 172.21.15.146:0/3289530817 shutdown_connections 2023-10-06T11:12:42.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.119+0000 7f7e8d777700 1 --2- 172.21.15.146:0/3289530817 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7e74066f30 0x7f7e740693e0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:42.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.119+0000 7f7e8d777700 1 --2- 172.21.15.146:0/3289530817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7e8815f1a0 0x7f7e8815f610 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:42.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.119+0000 7f7e8d777700 1 --2- 172.21.15.146:0/3289530817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e70003a90 0x7f7e88145010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:42.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.119+0000 7f7e8d777700 1 --2- 172.21.15.146:0/3289530817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e880c9a10 0x7f7e880c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:42.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.119+0000 7f7e8d777700 1 -- 172.21.15.146:0/3289530817 >> 172.21.15.146:0/3289530817 conn(0x7f7e8806f380 msgr2=0x7f7e881594d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:42.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.119+0000 7f7e8d777700 1 -- 172.21.15.146:0/3289530817 shutdown_connections 2023-10-06T11:12:42.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.119+0000 7f7e8d777700 1 -- 172.21.15.146:0/3289530817 wait complete. 2023-10-06T11:12:42.134 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T11:12:42.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.247+0000 7f1c79995700 1 Processor -- start 2023-10-06T11:12:42.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.247+0000 7f1c79995700 1 -- start start 2023-10-06T11:12:42.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.248+0000 7f1c79995700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c7415a420 0x7f1c7415cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:42.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.248+0000 7f1c79995700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1c7415a7f0 0x7f1c740b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:42.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.248+0000 7f1c79995700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1c740b2360 0x7f1c7415acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:42.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.248+0000 7f1c79995700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c740ce040 con 0x7f1c7415a7f0 2023-10-06T11:12:42.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.248+0000 7f1c79995700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c740b27e0 con 0x7f1c740b2360 2023-10-06T11:12:42.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.248+0000 7f1c79995700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7415c630 con 0x7f1c7415a420 2023-10-06T11:12:42.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.248+0000 7f1c73fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1c7415a7f0 0x7f1c740b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:42.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.248+0000 7f1c73fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1c7415a7f0 0x7f1c740b1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39114/0 (socket says 172.21.15.146:39114) 2023-10-06T11:12:42.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.248+0000 7f1c73fff700 1 -- 172.21.15.146:0/1415620585 learned_addr learned my addr 172.21.15.146:0/1415620585 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:42.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.248+0000 7f1c79194700 1 --2- 172.21.15.146:0/1415620585 >> v2:172.21.15.151:3300/0 conn(0x7f1c740b2360 0x7f1c7415acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:42.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.248+0000 7f1c78993700 1 --2- 172.21.15.146:0/1415620585 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c7415a420 0x7f1c7415cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:42.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.248+0000 7f1c73fff700 1 -- 172.21.15.146:0/1415620585 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c7415a420 msgr2=0x7f1c7415cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:42.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.248+0000 7f1c73fff700 1 --2- 172.21.15.146:0/1415620585 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c7415a420 0x7f1c7415cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:42.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.248+0000 7f1c73fff700 1 -- 172.21.15.146:0/1415620585 >> v2:172.21.15.151:3300/0 conn(0x7f1c740b2360 msgr2=0x7f1c7415acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:42.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.248+0000 7f1c73fff700 1 --2- 172.21.15.146:0/1415620585 >> v2:172.21.15.151:3300/0 conn(0x7f1c740b2360 0x7f1c7415acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:42.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.248+0000 7f1c73fff700 1 -- 172.21.15.146:0/1415620585 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c7415ba20 con 0x7f1c7415a7f0 2023-10-06T11:12:42.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.248+0000 7f1c78993700 1 --2- 172.21.15.146:0/1415620585 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c7415a420 0x7f1c7415cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:12:42.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.248+0000 7f1c73fff700 1 --2- 172.21.15.146:0/1415620585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c7415a7f0 0x7f1c740b1e20 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f1c74089860 tx=0x7f1c64009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dadcc5f03d1eba02 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:42.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.249+0000 7f1c737fe700 1 -- 172.21.15.146:0/1415620585 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6400b820 con 0x7f1c7415a7f0 2023-10-06T11:12:42.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.249+0000 7f1c737fe700 1 -- 172.21.15.146:0/1415620585 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c6400b980 con 0x7f1c7415a7f0 2023-10-06T11:12:42.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.249+0000 7f1c737fe700 1 -- 172.21.15.146:0/1415620585 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6400bd20 con 0x7f1c7415a7f0 2023-10-06T11:12:42.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.249+0000 7f1c79995700 1 -- 172.21.15.146:0/1415620585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c7415a7f0 msgr2=0x7f1c740b1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:42.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.249+0000 7f1c79995700 1 --2- 172.21.15.146:0/1415620585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c7415a7f0 0x7f1c740b1e20 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f1c74089860 tx=0x7f1c64009250 comp rx=0 tx=0).stop 2023-10-06T11:12:42.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.249+0000 7f1c79995700 1 -- 172.21.15.146:0/1415620585 shutdown_connections 2023-10-06T11:12:42.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.249+0000 7f1c79995700 1 --2- 172.21.15.146:0/1415620585 >> v2:172.21.15.151:3300/0 conn(0x7f1c740b2360 0x7f1c7415acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:42.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.249+0000 7f1c79995700 1 --2- 172.21.15.146:0/1415620585 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c7415a420 0x7f1c7415cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:42.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.249+0000 7f1c79995700 1 --2- 172.21.15.146:0/1415620585 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c7415a7f0 0x7f1c740b1e20 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:42.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.249+0000 7f1c79995700 1 -- 172.21.15.146:0/1415620585 >> 172.21.15.146:0/1415620585 conn(0x7f1c7406eba0 msgr2=0x7f1c7406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:42.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.249+0000 7f1c79995700 1 -- 172.21.15.146:0/1415620585 shutdown_connections 2023-10-06T11:12:42.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.249+0000 7f1c79995700 1 -- 172.21.15.146:0/1415620585 wait complete. 2023-10-06T11:12:42.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.250+0000 7f1c79995700 1 Processor -- start 2023-10-06T11:12:42.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.250+0000 7f1c79995700 1 -- start start 2023-10-06T11:12:42.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.251+0000 7f1c79995700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c740b2360 0x7f1c740ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:42.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.251+0000 7f1c79995700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c7415a420 0x7f1c740cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:42.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.251+0000 7f1c79995700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c7415a7f0 0x7f1c7416d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:42.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.251+0000 7f1c79995700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c740c85f0 con 0x7f1c7415a420 2023-10-06T11:12:42.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.251+0000 7f1c79995700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c740c7d00 con 0x7f1c740b2360 2023-10-06T11:12:42.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.251+0000 7f1c79995700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c740a7180 con 0x7f1c7415a7f0 2023-10-06T11:12:42.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.251+0000 7f1c73fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c7415a420 0x7f1c740cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:42.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.251+0000 7f1c73fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c7415a420 0x7f1c740cbe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39128/0 (socket says 172.21.15.146:39128) 2023-10-06T11:12:42.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.251+0000 7f1c73fff700 1 -- 172.21.15.146:0/3657701075 learned_addr learned my addr 172.21.15.146:0/3657701075 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:42.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.252+0000 7f1c78993700 1 --2- 172.21.15.146:0/3657701075 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c740b2360 0x7f1c740ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:42.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.252+0000 7f1c73fff700 1 -- 172.21.15.146:0/3657701075 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c7415a7f0 msgr2=0x7f1c7416d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:42.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.252+0000 7f1c73fff700 1 --2- 172.21.15.146:0/3657701075 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c7415a7f0 0x7f1c7416d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:42.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.252+0000 7f1c73fff700 1 -- 172.21.15.146:0/3657701075 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c740b2360 msgr2=0x7f1c740ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:42.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.252+0000 7f1c73fff700 1 --2- 172.21.15.146:0/3657701075 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c740b2360 0x7f1c740ccb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:42.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.252+0000 7f1c73fff700 1 -- 172.21.15.146:0/3657701075 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c640094f0 con 0x7f1c7415a420 2023-10-06T11:12:42.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.252+0000 7f1c73fff700 1 --2- 172.21.15.146:0/3657701075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c7415a420 0x7f1c740cbe50 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f1c640094c0 tx=0x7f1c64017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:42.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.252+0000 7f1c70ff9700 1 -- 172.21.15.146:0/3657701075 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c64024440 con 0x7f1c7415a420 2023-10-06T11:12:42.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.252+0000 7f1c70ff9700 1 -- 172.21.15.146:0/3657701075 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c640245e0 con 0x7f1c7415a420 2023-10-06T11:12:42.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.252+0000 7f1c79995700 1 -- 172.21.15.146:0/3657701075 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c740cd040 con 0x7f1c7415a420 2023-10-06T11:12:42.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.252+0000 7f1c70ff9700 1 -- 172.21.15.146:0/3657701075 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c640249a0 con 0x7f1c7415a420 2023-10-06T11:12:42.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.252+0000 7f1c79995700 1 -- 172.21.15.146:0/3657701075 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c740c7fa0 con 0x7f1c7415a420 2023-10-06T11:12:42.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.253+0000 7f1c79995700 1 -- 172.21.15.146:0/3657701075 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c740c8760 con 0x7f1c7415a420 2023-10-06T11:12:42.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.253+0000 7f1c70ff9700 1 -- 172.21.15.146:0/3657701075 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1c6401a420 con 0x7f1c7415a420 2023-10-06T11:12:42.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.254+0000 7f1c70ff9700 1 --2- 172.21.15.146:0/3657701075 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1c54066f30 0x7f1c540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:42.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.254+0000 7f1c70ff9700 1 -- 172.21.15.146:0/3657701075 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f1c64086170 con 0x7f1c7415a420 2023-10-06T11:12:42.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.254+0000 7f1c78993700 1 --2- 172.21.15.146:0/3657701075 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1c54066f30 0x7f1c540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:42.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.254+0000 7f1c78993700 1 --2- 172.21.15.146:0/3657701075 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1c54066f30 0x7f1c540693e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c00d560 tx=0x7f1c6c0075a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:42.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.258+0000 7f1c70ff9700 1 -- 172.21.15.146:0/3657701075 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1c64053680 con 0x7f1c7415a420 2023-10-06T11:12:42.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.444+0000 7f1c79995700 1 -- 172.21.15.146:0/3657701075 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1c7415bd00 con 0x7f1c7415a420 2023-10-06T11:12:42.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.444+0000 7f1c70ff9700 1 -- 172.21.15.146:0/3657701075 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v85) v1 ==== 84+0+126 (secure 0 0 0) 0x7f1c64056ca0 con 0x7f1c7415a420 2023-10-06T11:12:42.446 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:12:42.446 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2023-10-06T11:12:42.446 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:12:42.446 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 1, 2023-10-06T11:12:42.446 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": "rbd" 2023-10-06T11:12:42.447 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:42.447 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:12:42.447 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 2, 2023-10-06T11:12:42.447 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": ".mgr" 2023-10-06T11:12:42.447 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:12:42.447 INFO:teuthology.orchestra.run.smithi146.stdout:] 2023-10-06T11:12:42.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.446+0000 7f1c79995700 1 -- 172.21.15.146:0/3657701075 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1c54066f30 msgr2=0x7f1c540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:42.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.446+0000 7f1c79995700 1 --2- 172.21.15.146:0/3657701075 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1c54066f30 0x7f1c540693e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c00d560 tx=0x7f1c6c0075a0 comp rx=0 tx=0).stop 2023-10-06T11:12:42.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.446+0000 7f1c79995700 1 -- 172.21.15.146:0/3657701075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c7415a420 msgr2=0x7f1c740cbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:42.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.446+0000 7f1c79995700 1 --2- 172.21.15.146:0/3657701075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c7415a420 0x7f1c740cbe50 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f1c640094c0 tx=0x7f1c64017000 comp rx=0 tx=0).stop 2023-10-06T11:12:42.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.446+0000 7f1c79995700 1 -- 172.21.15.146:0/3657701075 shutdown_connections 2023-10-06T11:12:42.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.446+0000 7f1c79995700 1 --2- 172.21.15.146:0/3657701075 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1c54066f30 0x7f1c540693e0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:42.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.446+0000 7f1c79995700 1 --2- 172.21.15.146:0/3657701075 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c7415a7f0 0x7f1c7416d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:42.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.446+0000 7f1c79995700 1 --2- 172.21.15.146:0/3657701075 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c740b2360 0x7f1c740ccb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:42.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.446+0000 7f1c79995700 1 --2- 172.21.15.146:0/3657701075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c7415a420 0x7f1c740cbe50 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:42.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.447+0000 7f1c79995700 1 -- 172.21.15.146:0/3657701075 >> 172.21.15.146:0/3657701075 conn(0x7f1c7406eba0 msgr2=0x7f1c7406ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:42.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.447+0000 7f1c79995700 1 -- 172.21.15.146:0/3657701075 shutdown_connections 2023-10-06T11:12:42.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.447+0000 7f1c79995700 1 -- 172.21.15.146:0/3657701075 wait complete. 2023-10-06T11:12:42.460 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T11:12:42.461 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T11:12:42.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.579+0000 7fae454e7700 1 Processor -- start 2023-10-06T11:12:42.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.579+0000 7fae454e7700 1 -- start start 2023-10-06T11:12:42.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.580+0000 7fae454e7700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae4015a160 0x7fae400c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:42.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.580+0000 7fae454e7700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fae400ae730 0x7fae400aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:42.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.580+0000 7fae454e7700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae400ae2a0 con 0x7fae400ce3d0 2023-10-06T11:12:42.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.580+0000 7fae454e7700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae4015a530 con 0x7fae400ae730 2023-10-06T11:12:42.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.580+0000 7fae454e7700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae400ad690 con 0x7fae4015a160 2023-10-06T11:12:42.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.580+0000 7fae367fc700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fae400ae730 0x7fae400aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:42.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.580+0000 7fae3effd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae4015a160 0x7fae400c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:42.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.580+0000 7fae367fc700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fae400ae730 0x7fae400aeb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:42166/0 (socket says 172.21.15.146:42166) 2023-10-06T11:12:42.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.580+0000 7fae367fc700 1 -- 172.21.15.146:0/2109704705 learned_addr learned my addr 172.21.15.146:0/2109704705 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:42.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.580+0000 7fae3f7fe700 1 --1- 172.21.15.146:0/2109704705 >> v1:172.21.15.151:6789/0 conn(0x7fae400ce3d0 0x7fae400ce830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:55482/0 (socket says 172.21.15.146:55482) 2023-10-06T11:12:42.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.581+0000 7fae3effd700 1 -- 172.21.15.146:0/2109704705 >> v2:172.21.15.151:3300/0 conn(0x7fae400ae730 msgr2=0x7fae400aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:42.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.581+0000 7fae3effd700 1 --2- 172.21.15.146:0/2109704705 >> v2:172.21.15.151:3300/0 conn(0x7fae400ae730 0x7fae400aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:42.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.581+0000 7fae3effd700 1 -- 172.21.15.146:0/2109704705 >> v1:172.21.15.151:6789/0 conn(0x7fae400ce3d0 legacy=0x7fae400ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:42.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.581+0000 7fae3effd700 1 -- 172.21.15.146:0/2109704705 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae400ad970 con 0x7fae4015a160 2023-10-06T11:12:42.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.581+0000 7fae367fc700 1 --2- 172.21.15.146:0/2109704705 >> v2:172.21.15.151:3300/0 conn(0x7fae400ae730 0x7fae400aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:12:42.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.581+0000 7fae3effd700 1 --2- 172.21.15.146:0/2109704705 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae4015a160 0x7fae400c55a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fae300098d0 tx=0x7fae30009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c257906efc4419b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:42.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.581+0000 7fae3e7fc700 1 -- 172.21.15.146:0/2109704705 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae30005c10 con 0x7fae4015a160 2023-10-06T11:12:42.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.581+0000 7fae3e7fc700 1 -- 172.21.15.146:0/2109704705 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae30005d70 con 0x7fae4015a160 2023-10-06T11:12:42.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.581+0000 7fae3e7fc700 1 -- 172.21.15.146:0/2109704705 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae30006280 con 0x7fae4015a160 2023-10-06T11:12:42.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.581+0000 7fae454e7700 1 -- 172.21.15.146:0/2109704705 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae4015a160 msgr2=0x7fae400c55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:42.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.581+0000 7fae454e7700 1 --2- 172.21.15.146:0/2109704705 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae4015a160 0x7fae400c55a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fae300098d0 tx=0x7fae30009120 comp rx=0 tx=0).stop 2023-10-06T11:12:42.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.581+0000 7fae454e7700 1 -- 172.21.15.146:0/2109704705 shutdown_connections 2023-10-06T11:12:42.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.581+0000 7fae454e7700 1 --2- 172.21.15.146:0/2109704705 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae4015a160 0x7fae400c55a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:42.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.581+0000 7fae454e7700 1 --2- 172.21.15.146:0/2109704705 >> v2:172.21.15.151:3300/0 conn(0x7fae400ae730 0x7fae400aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:42.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.581+0000 7fae454e7700 1 -- 172.21.15.146:0/2109704705 >> 172.21.15.146:0/2109704705 conn(0x7fae4006f380 msgr2=0x7fae400d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:42.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.581+0000 7fae454e7700 1 -- 172.21.15.146:0/2109704705 shutdown_connections 2023-10-06T11:12:42.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.582+0000 7fae454e7700 1 -- 172.21.15.146:0/2109704705 wait complete. 2023-10-06T11:12:42.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.583+0000 7fae454e7700 1 Processor -- start 2023-10-06T11:12:42.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.583+0000 7fae454e7700 1 -- start start 2023-10-06T11:12:42.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.583+0000 7fae454e7700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae400ae730 0x7fae40156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:42.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.583+0000 7fae454e7700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae400ce3d0 0x7fae400c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:42.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.583+0000 7fae454e7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae4015a160 0x7fae4016a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:42.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.583+0000 7fae454e7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae400b3e80 con 0x7fae4015a160 2023-10-06T11:12:42.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.583+0000 7fae454e7700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4016b860 con 0x7fae400ae730 2023-10-06T11:12:42.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.583+0000 7fae454e7700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae4016b2a0 con 0x7fae400ce3d0 2023-10-06T11:12:42.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.584+0000 7fae3f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae4015a160 0x7fae4016a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:42.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.584+0000 7fae3f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae4015a160 0x7fae4016a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39142/0 (socket says 172.21.15.146:39142) 2023-10-06T11:12:42.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.584+0000 7fae3f7fe700 1 -- 172.21.15.146:0/1818256979 learned_addr learned my addr 172.21.15.146:0/1818256979 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:42.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.584+0000 7fae3effd700 1 --2- 172.21.15.146:0/1818256979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae400ae730 0x7fae40156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:42.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.584+0000 7fae367fc700 1 --2- 172.21.15.146:0/1818256979 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae400ce3d0 0x7fae400c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:42.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.584+0000 7fae3f7fe700 1 -- 172.21.15.146:0/1818256979 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae400ce3d0 msgr2=0x7fae400c8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:42.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.584+0000 7fae3f7fe700 1 --2- 172.21.15.146:0/1818256979 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae400ce3d0 0x7fae400c8af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:42.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.584+0000 7fae3f7fe700 1 -- 172.21.15.146:0/1818256979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae400ae730 msgr2=0x7fae40156ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:42.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.584+0000 7fae3f7fe700 1 --2- 172.21.15.146:0/1818256979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae400ae730 0x7fae40156ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:42.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.584+0000 7fae3f7fe700 1 -- 172.21.15.146:0/1818256979 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae280094f0 con 0x7fae4015a160 2023-10-06T11:12:42.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.584+0000 7fae3f7fe700 1 --2- 172.21.15.146:0/1818256979 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae4015a160 0x7fae4016a8c0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fae3800cd00 tx=0x7fae38001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:42.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.584+0000 7fae377fe700 1 -- 172.21.15.146:0/1818256979 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3800ce60 con 0x7fae4015a160 2023-10-06T11:12:42.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.584+0000 7fae377fe700 1 -- 172.21.15.146:0/1818256979 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae38005df0 con 0x7fae4015a160 2023-10-06T11:12:42.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.584+0000 7fae454e7700 1 -- 172.21.15.146:0/1818256979 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae300093c0 con 0x7fae4015a160 2023-10-06T11:12:42.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.584+0000 7fae377fe700 1 -- 172.21.15.146:0/1818256979 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae3800ab00 con 0x7fae4015a160 2023-10-06T11:12:42.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.584+0000 7fae454e7700 1 -- 172.21.15.146:0/1818256979 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae4016b630 con 0x7fae4015a160 2023-10-06T11:12:42.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.585+0000 7fae454e7700 1 -- 172.21.15.146:0/1818256979 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae400885d0 con 0x7fae4015a160 2023-10-06T11:12:42.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.586+0000 7fae377fe700 1 -- 172.21.15.146:0/1818256979 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fae380070f0 con 0x7fae4015a160 2023-10-06T11:12:42.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.586+0000 7fae377fe700 1 --2- 172.21.15.146:0/1818256979 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fae20066f30 0x7fae200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:42.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.586+0000 7fae377fe700 1 -- 172.21.15.146:0/1818256979 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fae38084330 con 0x7fae4015a160 2023-10-06T11:12:42.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.586+0000 7fae3effd700 1 --2- 172.21.15.146:0/1818256979 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fae20066f30 0x7fae200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:42.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.587+0000 7fae3effd700 1 --2- 172.21.15.146:0/1818256979 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fae20066f30 0x7fae200693e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fae400cabc0 tx=0x7fae30016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:42.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.590+0000 7fae377fe700 1 -- 172.21.15.146:0/1818256979 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fae38051810 con 0x7fae4015a160 2023-10-06T11:12:42.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:42.774+0000 7fae454e7700 1 -- 172.21.15.146:0/1818256979 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fae400adc50 con 0x7fae4015a160 2023-10-06T11:12:43.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.718+0000 7fae377fe700 1 -- 172.21.15.146:0/1818256979 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v86) v1 ==== 138+0+0 (secure 0 0 0) 0x7fae38082e60 con 0x7fae4015a160 2023-10-06T11:12:43.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.722+0000 7fae454e7700 1 -- 172.21.15.146:0/1818256979 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fae20066f30 msgr2=0x7fae200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:43.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.722+0000 7fae454e7700 1 --2- 172.21.15.146:0/1818256979 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fae20066f30 0x7fae200693e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fae400cabc0 tx=0x7fae30016000 comp rx=0 tx=0).stop 2023-10-06T11:12:43.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.722+0000 7fae454e7700 1 -- 172.21.15.146:0/1818256979 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae4015a160 msgr2=0x7fae4016a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:43.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.722+0000 7fae454e7700 1 --2- 172.21.15.146:0/1818256979 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae4015a160 0x7fae4016a8c0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fae3800cd00 tx=0x7fae38001b10 comp rx=0 tx=0).stop 2023-10-06T11:12:43.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.722+0000 7fae454e7700 1 -- 172.21.15.146:0/1818256979 shutdown_connections 2023-10-06T11:12:43.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.722+0000 7fae454e7700 1 --2- 172.21.15.146:0/1818256979 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fae20066f30 0x7fae200693e0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:43.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.722+0000 7fae454e7700 1 --2- 172.21.15.146:0/1818256979 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae4015a160 0x7fae4016a8c0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:43.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.722+0000 7fae454e7700 1 --2- 172.21.15.146:0/1818256979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae400ae730 0x7fae40156ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:43.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.722+0000 7fae454e7700 1 --2- 172.21.15.146:0/1818256979 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae400ce3d0 0x7fae400c8af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:43.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.722+0000 7fae454e7700 1 -- 172.21.15.146:0/1818256979 >> 172.21.15.146:0/1818256979 conn(0x7fae4006f380 msgr2=0x7fae400cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:43.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.723+0000 7fae454e7700 1 -- 172.21.15.146:0/1818256979 shutdown_connections 2023-10-06T11:12:43.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.723+0000 7fae454e7700 1 -- 172.21.15.146:0/1818256979 wait complete. 2023-10-06T11:12:43.729 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' created 2023-10-06T11:12:43.739 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T11:12:43.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.860+0000 7fa9b962d700 1 Processor -- start 2023-10-06T11:12:43.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.860+0000 7fa9b962d700 1 -- start start 2023-10-06T11:12:43.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.861+0000 7fa9b962d700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa9b40b5640 0x7fa9b415a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:43.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.861+0000 7fa9b962d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa9b40cb090 0x7fa9b40cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:43.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.861+0000 7fa9b962d700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9b40cc130 con 0x7fa9b4068780 2023-10-06T11:12:43.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.861+0000 7fa9b962d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9b40b2660 con 0x7fa9b40cb090 2023-10-06T11:12:43.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.861+0000 7fa9b962d700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9b415adb0 con 0x7fa9b40b5640 2023-10-06T11:12:43.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.861+0000 7fa9b37fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa9b40cb090 0x7fa9b40cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:43.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.861+0000 7fa9b37fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa9b40cb090 0x7fa9b40cc5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39158/0 (socket says 172.21.15.146:39158) 2023-10-06T11:12:43.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.861+0000 7fa9b37fe700 1 -- 172.21.15.146:0/3309013391 learned_addr learned my addr 172.21.15.146:0/3309013391 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:43.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.861+0000 7fa9b3fff700 1 --2- 172.21.15.146:0/3309013391 >> v2:172.21.15.151:3300/0 conn(0x7fa9b40b5640 0x7fa9b415a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:43.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.861+0000 7fa9b37fe700 1 -- 172.21.15.146:0/3309013391 >> v2:172.21.15.151:3300/0 conn(0x7fa9b40b5640 msgr2=0x7fa9b415a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:43.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.861+0000 7fa9b37fe700 1 --2- 172.21.15.146:0/3309013391 >> v2:172.21.15.151:3300/0 conn(0x7fa9b40b5640 0x7fa9b415a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:43.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.861+0000 7fa9b37fe700 1 -- 172.21.15.146:0/3309013391 >> v1:172.21.15.151:6789/0 conn(0x7fa9b4068780 legacy=0x7fa9b415b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:43.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.861+0000 7fa9b37fe700 1 -- 172.21.15.146:0/3309013391 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b40cb520 con 0x7fa9b40cb090 2023-10-06T11:12:43.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.861+0000 7fa9b3fff700 1 --2- 172.21.15.146:0/3309013391 >> v2:172.21.15.151:3300/0 conn(0x7fa9b40b5640 0x7fa9b415a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:12:43.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.861+0000 7fa9b37fe700 1 --2- 172.21.15.146:0/3309013391 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9b40cb090 0x7fa9b40cc5c0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fa9b40cddc0 tx=0x7fa9a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7916e8e039cbf6d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:43.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.861+0000 7fa9b2ffd700 1 -- 172.21.15.146:0/3309013391 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a800b820 con 0x7fa9b40cb090 2023-10-06T11:12:43.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.861+0000 7fa9b2ffd700 1 -- 172.21.15.146:0/3309013391 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9a800b980 con 0x7fa9b40cb090 2023-10-06T11:12:43.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.861+0000 7fa9b2ffd700 1 -- 172.21.15.146:0/3309013391 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a800bd20 con 0x7fa9b40cb090 2023-10-06T11:12:43.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.862+0000 7fa9b962d700 1 -- 172.21.15.146:0/3309013391 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9b40cb090 msgr2=0x7fa9b40cc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:43.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.862+0000 7fa9b962d700 1 --2- 172.21.15.146:0/3309013391 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9b40cb090 0x7fa9b40cc5c0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fa9b40cddc0 tx=0x7fa9a8009250 comp rx=0 tx=0).stop 2023-10-06T11:12:43.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.862+0000 7fa9b962d700 1 -- 172.21.15.146:0/3309013391 shutdown_connections 2023-10-06T11:12:43.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.862+0000 7fa9b962d700 1 --2- 172.21.15.146:0/3309013391 >> v2:172.21.15.151:3300/0 conn(0x7fa9b40b5640 0x7fa9b415a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:43.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.862+0000 7fa9b962d700 1 --2- 172.21.15.146:0/3309013391 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9b40cb090 0x7fa9b40cc5c0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:43.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.862+0000 7fa9b962d700 1 -- 172.21.15.146:0/3309013391 >> 172.21.15.146:0/3309013391 conn(0x7fa9b40703f0 msgr2=0x7fa9b40707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:43.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.862+0000 7fa9b962d700 1 -- 172.21.15.146:0/3309013391 shutdown_connections 2023-10-06T11:12:43.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.862+0000 7fa9b962d700 1 -- 172.21.15.146:0/3309013391 wait complete. 2023-10-06T11:12:43.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.863+0000 7fa9b962d700 1 Processor -- start 2023-10-06T11:12:43.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.863+0000 7fa9b962d700 1 -- start start 2023-10-06T11:12:43.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.864+0000 7fa9b962d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9b4068780 0x7fa9b40c47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:43.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.864+0000 7fa9b962d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa9b40b5640 0x7fa9b40c3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:43.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.864+0000 7fa9b962d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9b40cb090 0x7fa9b40cffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:43.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.864+0000 7fa9b962d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b40c3a80 con 0x7fa9b4068780 2023-10-06T11:12:43.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.864+0000 7fa9b962d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b40d0b50 con 0x7fa9b40cb090 2023-10-06T11:12:43.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.864+0000 7fa9b962d700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b40c3cd0 con 0x7fa9b40b5640 2023-10-06T11:12:43.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.864+0000 7fa9b3fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9b4068780 0x7fa9b40c47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:43.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.864+0000 7fa9b3fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9b4068780 0x7fa9b40c47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39170/0 (socket says 172.21.15.146:39170) 2023-10-06T11:12:43.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.864+0000 7fa9b3fff700 1 -- 172.21.15.146:0/3058452267 learned_addr learned my addr 172.21.15.146:0/3058452267 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:43.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.864+0000 7fa9b37fe700 1 --2- 172.21.15.146:0/3058452267 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa9b40b5640 0x7fa9b40c3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:43.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.864+0000 7fa9b3fff700 1 -- 172.21.15.146:0/3058452267 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa9b40b5640 msgr2=0x7fa9b40c3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:43.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.864+0000 7fa9b8e2c700 1 --2- 172.21.15.146:0/3058452267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9b40cb090 0x7fa9b40cffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:43.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.864+0000 7fa9b3fff700 1 --2- 172.21.15.146:0/3058452267 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa9b40b5640 0x7fa9b40c3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:43.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.864+0000 7fa9b3fff700 1 -- 172.21.15.146:0/3058452267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9b40cb090 msgr2=0x7fa9b40cffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:43.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.864+0000 7fa9b3fff700 1 --2- 172.21.15.146:0/3058452267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9b40cb090 0x7fa9b40cffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:43.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.864+0000 7fa9b3fff700 1 -- 172.21.15.146:0/3058452267 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a80094f0 con 0x7fa9b4068780 2023-10-06T11:12:43.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.864+0000 7fa9b3fff700 1 --2- 172.21.15.146:0/3058452267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9b4068780 0x7fa9b40c47b0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fa9a400c830 tx=0x7fa9a4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:43.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.865+0000 7fa99bfff700 1 -- 172.21.15.146:0/3058452267 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a4011600 con 0x7fa9b4068780 2023-10-06T11:12:43.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.865+0000 7fa99bfff700 1 -- 172.21.15.146:0/3058452267 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9a4011760 con 0x7fa9b4068780 2023-10-06T11:12:43.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.865+0000 7fa99bfff700 1 -- 172.21.15.146:0/3058452267 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a4011b20 con 0x7fa9b4068780 2023-10-06T11:12:43.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.865+0000 7fa9b962d700 1 -- 172.21.15.146:0/3058452267 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9b40c3fb0 con 0x7fa9b4068780 2023-10-06T11:12:43.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.865+0000 7fa9b962d700 1 -- 172.21.15.146:0/3058452267 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9b4153140 con 0x7fa9b4068780 2023-10-06T11:12:43.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.865+0000 7fa9b962d700 1 -- 172.21.15.146:0/3058452267 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9b40c44d0 con 0x7fa9b4068780 2023-10-06T11:12:43.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.866+0000 7fa99bfff700 1 -- 172.21.15.146:0/3058452267 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa9a401a450 con 0x7fa9b4068780 2023-10-06T11:12:43.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.866+0000 7fa99bfff700 1 --2- 172.21.15.146:0/3058452267 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa9a0066f30 0x7fa9a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:43.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.866+0000 7fa99bfff700 1 -- 172.21.15.146:0/3058452267 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5576+0+0 (secure 0 0 0) 0x7fa9a4084910 con 0x7fa9b4068780 2023-10-06T11:12:43.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.866+0000 7fa9b37fe700 1 --2- 172.21.15.146:0/3058452267 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa9a0066f30 0x7fa9a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:43.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.867+0000 7fa9b37fe700 1 --2- 172.21.15.146:0/3058452267 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa9a0066f30 0x7fa9a00693e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa9b40cd500 tx=0x7fa9a8016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:43.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:43.871+0000 7fa99bfff700 1 -- 172.21.15.146:0/3058452267 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa9b40c44d0 con 0x7fa9b4068780 2023-10-06T11:12:44.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.053+0000 7fa9b962d700 1 -- 172.21.15.146:0/3058452267 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa9b40c44d0 con 0x7fa9b4068780 2023-10-06T11:12:44.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.721+0000 7fa99bfff700 1 -- 172.21.15.146:0/3058452267 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v87) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa9a40150d0 con 0x7fa9b4068780 2023-10-06T11:12:44.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.727+0000 7fa9b962d700 1 -- 172.21.15.146:0/3058452267 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa9a0066f30 msgr2=0x7fa9a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:44.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.727+0000 7fa9b962d700 1 --2- 172.21.15.146:0/3058452267 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa9a0066f30 0x7fa9a00693e0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa9b40cd500 tx=0x7fa9a8016000 comp rx=0 tx=0).stop 2023-10-06T11:12:44.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.727+0000 7fa9b962d700 1 -- 172.21.15.146:0/3058452267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9b4068780 msgr2=0x7fa9b40c47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:44.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.727+0000 7fa9b962d700 1 --2- 172.21.15.146:0/3058452267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9b4068780 0x7fa9b40c47b0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fa9a400c830 tx=0x7fa9a4008040 comp rx=0 tx=0).stop 2023-10-06T11:12:44.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.730+0000 7fa9b962d700 1 -- 172.21.15.146:0/3058452267 shutdown_connections 2023-10-06T11:12:44.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.730+0000 7fa9b962d700 1 --2- 172.21.15.146:0/3058452267 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa9a0066f30 0x7fa9a00693e0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:44.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.730+0000 7fa9b962d700 1 --2- 172.21.15.146:0/3058452267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9b40cb090 0x7fa9b40cffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:44.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.730+0000 7fa9b962d700 1 --2- 172.21.15.146:0/3058452267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa9b4068780 0x7fa9b40c47b0 secure :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fa9a400c830 tx=0x7fa9a4008040 comp rx=0 tx=0).stop 2023-10-06T11:12:44.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.730+0000 7fa9b962d700 1 --2- 172.21.15.146:0/3058452267 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa9b40b5640 0x7fa9b40c3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:44.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.731+0000 7fa9b962d700 1 -- 172.21.15.146:0/3058452267 >> 172.21.15.146:0/3058452267 conn(0x7fa9b40703f0 msgr2=0x7fa9b4063790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:44.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.735+0000 7fa9b962d700 1 -- 172.21.15.146:0/3058452267 shutdown_connections 2023-10-06T11:12:44.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.735+0000 7fa9b962d700 1 -- 172.21.15.146:0/3058452267 wait complete. 2023-10-06T11:12:44.741 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' created 2023-10-06T11:12:44.753 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T11:12:44.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.869+0000 7f436cf75700 1 Processor -- start 2023-10-06T11:12:44.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.869+0000 7f436cf75700 1 -- start start 2023-10-06T11:12:44.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.870+0000 7f436cf75700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43680cb090 0x7f43680cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:44.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.870+0000 7f436cf75700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4368068780 0x7f4368068be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:44.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.870+0000 7f436cf75700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4368069120 con 0x7f43680b5640 2023-10-06T11:12:44.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.870+0000 7f436cf75700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43680cc130 con 0x7f4368068780 2023-10-06T11:12:44.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.870+0000 7f436cf75700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43680b2660 con 0x7f43680cb090 2023-10-06T11:12:44.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.870+0000 7f43677fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f43680b5640 0x7f436815a870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:37872/0 (socket says 172.21.15.146:37872) 2023-10-06T11:12:44.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.870+0000 7f43677fe700 1 -- 172.21.15.146:0/2734448526 learned_addr learned my addr 172.21.15.146:0/2734448526 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:12:44.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.870+0000 7f43667fc700 1 -- 172.21.15.146:0/2734448526 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2884621193 0 0) 0x7f4358001490 con 0x7f43680b5640 2023-10-06T11:12:44.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.870+0000 7f43667fc700 1 -- 172.21.15.146:0/2734448526 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4350003570 con 0x7f43680b5640 2023-10-06T11:12:44.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.870+0000 7f4366ffd700 1 --2- 172.21.15.146:0/2734448526 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43680cb090 0x7f43680cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:44.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.870+0000 7f4367fff700 1 --2- 172.21.15.146:0/2734448526 >> v2:172.21.15.151:3300/0 conn(0x7f4368068780 0x7f4368068be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:44.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.871+0000 7f43667fc700 1 -- 172.21.15.146:0/2734448526 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2226882062 0 0) 0x7f4350003570 con 0x7f43680b5640 2023-10-06T11:12:44.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.871+0000 7f43667fc700 1 -- 172.21.15.146:0/2734448526 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43680cb090 msgr2=0x7f43680cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:44.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.871+0000 7f43667fc700 1 --2- 172.21.15.146:0/2734448526 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43680cb090 0x7f43680cc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:44.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.871+0000 7f43667fc700 1 -- 172.21.15.146:0/2734448526 >> v2:172.21.15.151:3300/0 conn(0x7f4368068780 msgr2=0x7f4368068be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:44.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.871+0000 7f43667fc700 1 --2- 172.21.15.146:0/2734448526 >> v2:172.21.15.151:3300/0 conn(0x7f4368068780 0x7f4368068be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:44.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.871+0000 7f43667fc700 1 -- 172.21.15.146:0/2734448526 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43680cb520 con 0x7f43680b5640 2023-10-06T11:12:44.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.871+0000 7f43667fc700 1 -- 172.21.15.146:0/2734448526 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f4358001980 con 0x7f43680b5640 2023-10-06T11:12:44.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.871+0000 7f43667fc700 1 -- 172.21.15.146:0/2734448526 >> v1:172.21.15.146:6789/0 conn(0x7f43680b5640 legacy=0x7f436815a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:44.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.871+0000 7f43667fc700 1 --2- 172.21.15.146:0/2734448526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4350003a60 0x7f4350003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:44.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.871+0000 7f43667fc700 1 --2- 172.21.15.146:0/2734448526 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4350004810 0x7f4350004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:44.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.871+0000 7f43667fc700 1 --2- 172.21.15.146:0/2734448526 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43680cb090 0x7f43500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:44.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.871+0000 7f43667fc700 1 -- 172.21.15.146:0/2734448526 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43680cc130 con 0x7f4350003a60 2023-10-06T11:12:44.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.871+0000 7f43667fc700 1 -- 172.21.15.146:0/2734448526 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43680b2660 con 0x7f4350004810 2023-10-06T11:12:44.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.871+0000 7f43667fc700 1 -- 172.21.15.146:0/2734448526 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f435000bb10 con 0x7f43680cb090 2023-10-06T11:12:44.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.871+0000 7f4367fff700 1 --2- 172.21.15.146:0/2734448526 >> v2:172.21.15.151:3300/0 conn(0x7f4368068780 0x7f4368068be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:12:44.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.871+0000 7f43677fe700 1 --2- 172.21.15.146:0/2734448526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4350003a60 0x7f4350003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:44.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.871+0000 7f4366ffd700 1 --2- 172.21.15.146:0/2734448526 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4350004810 0x7f4350004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:44.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.871+0000 7f4367fff700 1 --2- 172.21.15.146:0/2734448526 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43680cb090 0x7f43500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:44.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.871+0000 7f43677fe700 1 -- 172.21.15.146:0/2734448526 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43680cb090 msgr2=0x7f43500051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:44.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.871+0000 7f43677fe700 1 --2- 172.21.15.146:0/2734448526 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43680cb090 0x7f43500051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:44.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.871+0000 7f43677fe700 1 -- 172.21.15.146:0/2734448526 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4350004810 msgr2=0x7f4350004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:44.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.871+0000 7f43677fe700 1 --2- 172.21.15.146:0/2734448526 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4350004810 0x7f4350004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:44.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.871+0000 7f43677fe700 1 -- 172.21.15.146:0/2734448526 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4350003570 con 0x7f4350003a60 2023-10-06T11:12:44.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.871+0000 7f43677fe700 1 --2- 172.21.15.146:0/2734448526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4350003a60 0x7f4350003e70 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f435800ab00 tx=0x7f435800a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7218112c4bc079a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:44.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.871+0000 7f43667fc700 1 -- 172.21.15.146:0/2734448526 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435800a490 con 0x7f4350003a60 2023-10-06T11:12:44.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.872+0000 7f43667fc700 1 -- 172.21.15.146:0/2734448526 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f435800c5d0 con 0x7f4350003a60 2023-10-06T11:12:44.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.872+0000 7f43667fc700 1 -- 172.21.15.146:0/2734448526 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435800c970 con 0x7f4350003a60 2023-10-06T11:12:44.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.872+0000 7f436cf75700 1 -- 172.21.15.146:0/2734448526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4350003a60 msgr2=0x7f4350003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:44.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.872+0000 7f436cf75700 1 --2- 172.21.15.146:0/2734448526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4350003a60 0x7f4350003e70 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f435800ab00 tx=0x7f435800a1a0 comp rx=0 tx=0).stop 2023-10-06T11:12:44.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.872+0000 7f4367fff700 1 -- 172.21.15.146:0/2734448526 reap_dead start 2023-10-06T11:12:44.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.872+0000 7f436cf75700 1 -- 172.21.15.146:0/2734448526 shutdown_connections 2023-10-06T11:12:44.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.872+0000 7f436cf75700 1 -- 172.21.15.146:0/2734448526 >> 172.21.15.146:0/2734448526 conn(0x7f43680703f0 msgr2=0x7f43680707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:44.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.872+0000 7f436cf75700 1 -- 172.21.15.146:0/2734448526 shutdown_connections 2023-10-06T11:12:44.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.872+0000 7f436cf75700 1 -- 172.21.15.146:0/2734448526 wait complete. 2023-10-06T11:12:44.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.873+0000 7f436cf75700 1 Processor -- start 2023-10-06T11:12:44.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.873+0000 7f436cf75700 1 -- start start 2023-10-06T11:12:44.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.874+0000 7f436cf75700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4350003a60 0x7f436814f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:44.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.874+0000 7f436cf75700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43680c9260 0x7f43680c4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:44.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.874+0000 7f436cf75700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43680c5500 0x7f436815bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:44.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.874+0000 7f436cf75700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436815ba30 con 0x7f43680c9260 2023-10-06T11:12:44.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.874+0000 7f436cf75700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436815b120 con 0x7f4350003a60 2023-10-06T11:12:44.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.874+0000 7f436cf75700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f436815b3e0 con 0x7f43680c5500 2023-10-06T11:12:44.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.874+0000 7f4366ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43680c9260 0x7f43680c4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:44.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.874+0000 7f4366ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43680c9260 0x7f43680c4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39192/0 (socket says 172.21.15.146:39192) 2023-10-06T11:12:44.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.874+0000 7f4366ffd700 1 -- 172.21.15.146:0/2630080003 learned_addr learned my addr 172.21.15.146:0/2630080003 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:44.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.874+0000 7f4367fff700 1 --2- 172.21.15.146:0/2630080003 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43680c5500 0x7f436815bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:44.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.874+0000 7f43677fe700 1 --2- 172.21.15.146:0/2630080003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4350003a60 0x7f436814f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:44.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.874+0000 7f4366ffd700 1 -- 172.21.15.146:0/2630080003 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43680c5500 msgr2=0x7f436815bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:44.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.874+0000 7f4366ffd700 1 --2- 172.21.15.146:0/2630080003 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43680c5500 0x7f436815bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:44.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.874+0000 7f4366ffd700 1 -- 172.21.15.146:0/2630080003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4350003a60 msgr2=0x7f436814f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:44.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.874+0000 7f4366ffd700 1 --2- 172.21.15.146:0/2630080003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4350003a60 0x7f436814f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:44.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.874+0000 7f4366ffd700 1 -- 172.21.15.146:0/2630080003 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f436815b6c0 con 0x7f43680c9260 2023-10-06T11:12:44.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.875+0000 7f4366ffd700 1 --2- 172.21.15.146:0/2630080003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43680c9260 0x7f43680c4fc0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f435c011b40 tx=0x7f435c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:44.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.875+0000 7f434f7fe700 1 -- 172.21.15.146:0/2630080003 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435c00f940 con 0x7f43680c9260 2023-10-06T11:12:44.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.875+0000 7f434f7fe700 1 -- 172.21.15.146:0/2630080003 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f435c00faa0 con 0x7f43680c9260 2023-10-06T11:12:44.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.875+0000 7f436cf75700 1 -- 172.21.15.146:0/2630080003 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43680c8880 con 0x7f43680c9260 2023-10-06T11:12:44.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.875+0000 7f434f7fe700 1 -- 172.21.15.146:0/2630080003 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435c00fe20 con 0x7f43680c9260 2023-10-06T11:12:44.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.875+0000 7f436cf75700 1 -- 172.21.15.146:0/2630080003 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f436815c400 con 0x7f43680c9260 2023-10-06T11:12:44.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.876+0000 7f436cf75700 1 -- 172.21.15.146:0/2630080003 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f436815b850 con 0x7f43680c9260 2023-10-06T11:12:44.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.876+0000 7f434f7fe700 1 -- 172.21.15.146:0/2630080003 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f435c014650 con 0x7f43680c9260 2023-10-06T11:12:44.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.877+0000 7f434f7fe700 1 --2- 172.21.15.146:0/2630080003 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4354066f30 0x7f43540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:44.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.877+0000 7f434f7fe700 1 -- 172.21.15.146:0/2630080003 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f435c018030 con 0x7f43680c9260 2023-10-06T11:12:44.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.877+0000 7f43677fe700 1 --2- 172.21.15.146:0/2630080003 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4354066f30 0x7f43540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:44.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.877+0000 7f43677fe700 1 --2- 172.21.15.146:0/2630080003 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4354066f30 0x7f43540693e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f435800a0b0 tx=0x7f4358016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:44.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:44.881+0000 7f434f7fe700 1 -- 172.21.15.146:0/2630080003 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f435c0520f0 con 0x7f43680c9260 2023-10-06T11:12:45.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.105+0000 7f436cf75700 1 -- 172.21.15.146:0/2630080003 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f43680b2d60 con 0x7f43680c9260 2023-10-06T11:12:45.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.736+0000 7f434f7fe700 1 -- 172.21.15.146:0/2630080003 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 13 and data pool 14 v81) v1 ==== 174+0+0 (secure 0 0 0) 0x7f435c055710 con 0x7f43680c9260 2023-10-06T11:12:45.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.739+0000 7f436cf75700 1 -- 172.21.15.146:0/2630080003 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4354066f30 msgr2=0x7f43540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:45.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.739+0000 7f436cf75700 1 --2- 172.21.15.146:0/2630080003 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4354066f30 0x7f43540693e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f435800a0b0 tx=0x7f4358016000 comp rx=0 tx=0).stop 2023-10-06T11:12:45.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.739+0000 7f436cf75700 1 -- 172.21.15.146:0/2630080003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43680c9260 msgr2=0x7f43680c4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:45.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.739+0000 7f436cf75700 1 --2- 172.21.15.146:0/2630080003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43680c9260 0x7f43680c4fc0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f435c011b40 tx=0x7f435c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:12:45.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.739+0000 7f436cf75700 1 -- 172.21.15.146:0/2630080003 shutdown_connections 2023-10-06T11:12:45.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.739+0000 7f436cf75700 1 --2- 172.21.15.146:0/2630080003 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4354066f30 0x7f43540693e0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:45.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.739+0000 7f436cf75700 1 --2- 172.21.15.146:0/2630080003 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43680c5500 0x7f436815bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:45.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.739+0000 7f436cf75700 1 --2- 172.21.15.146:0/2630080003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4350003a60 0x7f436814f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:45.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.739+0000 7f436cf75700 1 --2- 172.21.15.146:0/2630080003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43680c9260 0x7f43680c4fc0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:45.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.739+0000 7f436cf75700 1 -- 172.21.15.146:0/2630080003 >> 172.21.15.146:0/2630080003 conn(0x7f43680703f0 msgr2=0x7f436806ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:45.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.739+0000 7f436cf75700 1 -- 172.21.15.146:0/2630080003 shutdown_connections 2023-10-06T11:12:45.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.739+0000 7f436cf75700 1 -- 172.21.15.146:0/2630080003 wait complete. 2023-10-06T11:12:45.744 INFO:teuthology.orchestra.run.smithi146.stderr:new fs with metadata pool 13 and data pool 14 2023-10-06T11:12:45.755 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:12:45.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.868+0000 7f60b82b2700 1 Processor -- start 2023-10-06T11:12:45.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.868+0000 7f60b82b2700 1 -- start start 2023-10-06T11:12:45.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.869+0000 7f60b82b2700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f60b0153ab0 0x7f60b015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:45.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.869+0000 7f60b82b2700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60b0068ba0 0x7f60b00b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:45.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.869+0000 7f60b82b2700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60b015ac30 con 0x7f60b0153e80 2023-10-06T11:12:45.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.869+0000 7f60b82b2700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60b00b4510 con 0x7f60b0153ab0 2023-10-06T11:12:45.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.869+0000 7f60b82b2700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b00b6530 con 0x7f60b0068ba0 2023-10-06T11:12:45.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.869+0000 7f60b684f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60b0068ba0 0x7f60b00b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:45.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.869+0000 7f60b604e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f60b0153ab0 0x7f60b015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:45.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.869+0000 7f60b584d700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f60b0153e80 0x7f60b0068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:55502/0 (socket says 172.21.15.146:55502) 2023-10-06T11:12:45.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.869+0000 7f60b584d700 1 -- 172.21.15.146:0/964118060 learned_addr learned my addr 172.21.15.146:0/964118060 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:12:45.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.870+0000 7f60b504c700 1 -- 172.21.15.146:0/964118060 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2621179336 0 0) 0x7f60a0001110 con 0x7f60b0153e80 2023-10-06T11:12:45.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.870+0000 7f60b504c700 1 -- 172.21.15.146:0/964118060 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f609c003570 con 0x7f60b0153e80 2023-10-06T11:12:45.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.870+0000 7f60b684f700 1 -- 172.21.15.146:0/964118060 >> v2:172.21.15.151:3300/0 conn(0x7f60b0153ab0 msgr2=0x7f60b015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:45.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.870+0000 7f60b684f700 1 --2- 172.21.15.146:0/964118060 >> v2:172.21.15.151:3300/0 conn(0x7f60b0153ab0 0x7f60b015a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:45.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.870+0000 7f60b684f700 1 -- 172.21.15.146:0/964118060 >> v1:172.21.15.151:6789/0 conn(0x7f60b0153e80 legacy=0x7f60b0068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:45.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.870+0000 7f60b684f700 1 -- 172.21.15.146:0/964118060 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b00b5c50 con 0x7f60b0068ba0 2023-10-06T11:12:45.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.870+0000 7f60b604e700 1 --2- 172.21.15.146:0/964118060 >> v2:172.21.15.151:3300/0 conn(0x7f60b0153ab0 0x7f60b015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:12:45.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.870+0000 7f60b684f700 1 --2- 172.21.15.146:0/964118060 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60b0068ba0 0x7f60b00b49a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f60a8009e60 tx=0x7f60a8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46ae87b0bde3d99e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:45.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.870+0000 7f60b504c700 1 -- 172.21.15.146:0/964118060 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a800e070 con 0x7f60b0068ba0 2023-10-06T11:12:45.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.870+0000 7f60b504c700 1 -- 172.21.15.146:0/964118060 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a800bab0 con 0x7f60b0068ba0 2023-10-06T11:12:45.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.870+0000 7f60b504c700 1 -- 172.21.15.146:0/964118060 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a800be30 con 0x7f60b0068ba0 2023-10-06T11:12:45.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.871+0000 7f60b82b2700 1 -- 172.21.15.146:0/964118060 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60b0068ba0 msgr2=0x7f60b00b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:45.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.871+0000 7f60b82b2700 1 --2- 172.21.15.146:0/964118060 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60b0068ba0 0x7f60b00b49a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f60a8009e60 tx=0x7f60a8009780 comp rx=0 tx=0).stop 2023-10-06T11:12:45.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.871+0000 7f60b82b2700 1 -- 172.21.15.146:0/964118060 shutdown_connections 2023-10-06T11:12:45.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.871+0000 7f60b82b2700 1 --2- 172.21.15.146:0/964118060 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60b0068ba0 0x7f60b00b49a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:45.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.871+0000 7f60b82b2700 1 --2- 172.21.15.146:0/964118060 >> v2:172.21.15.151:3300/0 conn(0x7f60b0153ab0 0x7f60b015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:45.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.871+0000 7f60b82b2700 1 -- 172.21.15.146:0/964118060 >> 172.21.15.146:0/964118060 conn(0x7f60b006eba0 msgr2=0x7f60b006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:45.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.871+0000 7f60b82b2700 1 -- 172.21.15.146:0/964118060 shutdown_connections 2023-10-06T11:12:45.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.871+0000 7f60b82b2700 1 -- 172.21.15.146:0/964118060 wait complete. 2023-10-06T11:12:45.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.872+0000 7f60b82b2700 1 Processor -- start 2023-10-06T11:12:45.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.872+0000 7f60b82b2700 1 -- start start 2023-10-06T11:12:45.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.873+0000 7f60b82b2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60b0068ba0 0x7f60b013e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:45.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.873+0000 7f60b82b2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60b0153ab0 0x7f60b00b15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:45.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.873+0000 7f60b82b2700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60b0153e80 0x7f60b00b1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:45.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.873+0000 7f60b82b2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b0155400 con 0x7f60b0153ab0 2023-10-06T11:12:45.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.873+0000 7f60b82b2700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b01565a0 con 0x7f60b0068ba0 2023-10-06T11:12:45.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.873+0000 7f60b82b2700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b0155120 con 0x7f60b0153e80 2023-10-06T11:12:45.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.873+0000 7f60b584d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60b0153ab0 0x7f60b00b15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:45.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.873+0000 7f60b584d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60b0153ab0 0x7f60b00b15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39194/0 (socket says 172.21.15.146:39194) 2023-10-06T11:12:45.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.873+0000 7f60b584d700 1 -- 172.21.15.146:0/3826549286 learned_addr learned my addr 172.21.15.146:0/3826549286 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:45.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.873+0000 7f60b604e700 1 --2- 172.21.15.146:0/3826549286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60b0068ba0 0x7f60b013e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:45.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.873+0000 7f60b684f700 1 --2- 172.21.15.146:0/3826549286 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60b0153e80 0x7f60b00b1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:45.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.873+0000 7f60b584d700 1 -- 172.21.15.146:0/3826549286 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60b0153e80 msgr2=0x7f60b00b1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:45.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.873+0000 7f60b584d700 1 --2- 172.21.15.146:0/3826549286 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60b0153e80 0x7f60b00b1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:45.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.873+0000 7f60b584d700 1 -- 172.21.15.146:0/3826549286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60b0068ba0 msgr2=0x7f60b013e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:45.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.873+0000 7f60b584d700 1 --2- 172.21.15.146:0/3826549286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60b0068ba0 0x7f60b013e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:45.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.873+0000 7f60b584d700 1 -- 172.21.15.146:0/3826549286 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ac009420 con 0x7f60b0153ab0 2023-10-06T11:12:45.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.873+0000 7f60b604e700 1 --2- 172.21.15.146:0/3826549286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60b0068ba0 0x7f60b013e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:12:45.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.873+0000 7f60b584d700 1 --2- 172.21.15.146:0/3826549286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60b0153ab0 0x7f60b00b15a0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f60a000c7f0 tx=0x7f60a0007c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:45.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.873+0000 7f60a67fc700 1 -- 172.21.15.146:0/3826549286 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a0005b30 con 0x7f60b0153ab0 2023-10-06T11:12:45.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.873+0000 7f60a67fc700 1 -- 172.21.15.146:0/3826549286 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a0005c90 con 0x7f60b0153ab0 2023-10-06T11:12:45.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.873+0000 7f60a67fc700 1 -- 172.21.15.146:0/3826549286 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60a0007320 con 0x7f60b0153ab0 2023-10-06T11:12:45.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.873+0000 7f60b82b2700 1 -- 172.21.15.146:0/3826549286 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60a8009a20 con 0x7f60b0153ab0 2023-10-06T11:12:45.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.874+0000 7f60b82b2700 1 -- 172.21.15.146:0/3826549286 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60b0156230 con 0x7f60b0153ab0 2023-10-06T11:12:45.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.874+0000 7f60b82b2700 1 -- 172.21.15.146:0/3826549286 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60b004c380 con 0x7f60b0153ab0 2023-10-06T11:12:45.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.875+0000 7f60a67fc700 1 -- 172.21.15.146:0/3826549286 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f60a001c440 con 0x7f60b0153ab0 2023-10-06T11:12:45.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.875+0000 7f60a67fc700 1 --2- 172.21.15.146:0/3826549286 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6094066f30 0x7f60940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:45.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.875+0000 7f60a67fc700 1 -- 172.21.15.146:0/3826549286 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f60a00839b0 con 0x7f60b0153ab0 2023-10-06T11:12:45.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.875+0000 7f60b604e700 1 --2- 172.21.15.146:0/3826549286 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6094066f30 0x7f60940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:45.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.876+0000 7f60b604e700 1 --2- 172.21.15.146:0/3826549286 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6094066f30 0x7f60940693e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f60ac0093f0 tx=0x7f60ac008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:45.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:45.880+0000 7f60a67fc700 1 -- 172.21.15.146:0/3826549286 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f60a00545d0 con 0x7f60b0153ab0 2023-10-06T11:12:46.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.062+0000 7f60b82b2700 1 -- 172.21.15.146:0/3826549286 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60b015ac30 con 0x7f60b0153ab0 2023-10-06T11:12:46.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.063+0000 7f60a67fc700 1 -- 172.21.15.146:0/3826549286 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+16930 (secure 0 0 0) 0x7f60b015ac30 con 0x7f60b0153ab0 2023-10-06T11:12:46.065 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:12:46.065 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":88,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:12:45.106828+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:12:42.792405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-10-06T11:12:44.071743+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:12:46.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.065+0000 7f60b82b2700 1 -- 172.21.15.146:0/3826549286 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6094066f30 msgr2=0x7f60940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:46.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.065+0000 7f60b82b2700 1 --2- 172.21.15.146:0/3826549286 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6094066f30 0x7f60940693e0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f60ac0093f0 tx=0x7f60ac008040 comp rx=0 tx=0).stop 2023-10-06T11:12:46.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.065+0000 7f60b82b2700 1 -- 172.21.15.146:0/3826549286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60b0153ab0 msgr2=0x7f60b00b15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:46.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.065+0000 7f60b82b2700 1 --2- 172.21.15.146:0/3826549286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60b0153ab0 0x7f60b00b15a0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f60a000c7f0 tx=0x7f60a0007c30 comp rx=0 tx=0).stop 2023-10-06T11:12:46.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.065+0000 7f60b82b2700 1 -- 172.21.15.146:0/3826549286 shutdown_connections 2023-10-06T11:12:46.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.065+0000 7f60b82b2700 1 --2- 172.21.15.146:0/3826549286 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6094066f30 0x7f60940693e0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:46.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.065+0000 7f60b82b2700 1 --2- 172.21.15.146:0/3826549286 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60b0153e80 0x7f60b00b1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:46.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.065+0000 7f60b82b2700 1 --2- 172.21.15.146:0/3826549286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60b0068ba0 0x7f60b013e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:46.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.065+0000 7f60b82b2700 1 --2- 172.21.15.146:0/3826549286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f60b0153ab0 0x7f60b00b15a0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:46.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.065+0000 7f60b82b2700 1 -- 172.21.15.146:0/3826549286 >> 172.21.15.146:0/3826549286 conn(0x7f60b006eba0 msgr2=0x7f60b0153070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:46.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.065+0000 7f60b82b2700 1 -- 172.21.15.146:0/3826549286 shutdown_connections 2023-10-06T11:12:46.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.065+0000 7f60b82b2700 1 -- 172.21.15.146:0/3826549286 wait complete. 2023-10-06T11:12:46.080 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:12:46.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.192+0000 7febcba7c700 1 Processor -- start 2023-10-06T11:12:46.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.193+0000 7febcba7c700 1 -- start start 2023-10-06T11:12:46.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.193+0000 7febcba7c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7febc4153ab0 0x7febc415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:46.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.193+0000 7febcba7c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febc4153e80 0x7febc4068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:46.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.193+0000 7febcba7c700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febc415ac30 con 0x7febc40689d0 2023-10-06T11:12:46.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.193+0000 7febcba7c700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febc4068e50 con 0x7febc4153ab0 2023-10-06T11:12:46.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.193+0000 7febcba7c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc40b4510 con 0x7febc4153e80 2023-10-06T11:12:46.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.194+0000 7febc9017700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febc4153e80 0x7febc4068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:46.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.194+0000 7febc9818700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7febc4153ab0 0x7febc415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:46.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.194+0000 7febc9017700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febc4153e80 0x7febc4068490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:48708/0 (socket says 172.21.15.146:48708) 2023-10-06T11:12:46.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.194+0000 7febca019700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7febc40689d0 0x7febc415d270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:55518/0 (socket says 172.21.15.146:55518) 2023-10-06T11:12:46.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.194+0000 7febc9017700 1 -- 172.21.15.146:0/1834126668 learned_addr learned my addr 172.21.15.146:0/1834126668 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:46.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.194+0000 7febc9017700 1 -- 172.21.15.146:0/1834126668 >> v2:172.21.15.151:3300/0 conn(0x7febc4153ab0 msgr2=0x7febc415a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:46.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.194+0000 7febc9017700 1 --2- 172.21.15.146:0/1834126668 >> v2:172.21.15.151:3300/0 conn(0x7febc4153ab0 0x7febc415a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:46.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.194+0000 7febc9017700 1 -- 172.21.15.146:0/1834126668 >> v1:172.21.15.151:6789/0 conn(0x7febc40689d0 legacy=0x7febc415d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:46.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.194+0000 7febc9017700 1 -- 172.21.15.146:0/1834126668 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc40b6530 con 0x7febc4153e80 2023-10-06T11:12:46.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.194+0000 7febc9818700 1 --2- 172.21.15.146:0/1834126668 >> v2:172.21.15.151:3300/0 conn(0x7febc4153ab0 0x7febc415a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:12:46.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.194+0000 7febc9017700 1 --2- 172.21.15.146:0/1834126668 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febc4153e80 0x7febc4068490 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7febb40099b0 tx=0x7febb4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd4438695e99be73 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:46.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.194+0000 7febc8816700 1 -- 172.21.15.146:0/1834126668 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb4009ea0 con 0x7febc4153e80 2023-10-06T11:12:46.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.194+0000 7febc8816700 1 -- 172.21.15.146:0/1834126668 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb400b860 con 0x7febc4153e80 2023-10-06T11:12:46.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.194+0000 7febc8816700 1 -- 172.21.15.146:0/1834126668 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb400bc00 con 0x7febc4153e80 2023-10-06T11:12:46.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.195+0000 7febcba7c700 1 -- 172.21.15.146:0/1834126668 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febc4153e80 msgr2=0x7febc4068490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:46.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.195+0000 7febcba7c700 1 --2- 172.21.15.146:0/1834126668 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febc4153e80 0x7febc4068490 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7febb40099b0 tx=0x7febb4009250 comp rx=0 tx=0).stop 2023-10-06T11:12:46.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.195+0000 7febcba7c700 1 -- 172.21.15.146:0/1834126668 shutdown_connections 2023-10-06T11:12:46.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.195+0000 7febcba7c700 1 --2- 172.21.15.146:0/1834126668 >> v2:172.21.15.151:3300/0 conn(0x7febc4153ab0 0x7febc415a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:46.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.195+0000 7febcba7c700 1 --2- 172.21.15.146:0/1834126668 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febc4153e80 0x7febc4068490 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:46.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.195+0000 7febcba7c700 1 -- 172.21.15.146:0/1834126668 >> 172.21.15.146:0/1834126668 conn(0x7febc406eba0 msgr2=0x7febc406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:46.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.195+0000 7febcba7c700 1 -- 172.21.15.146:0/1834126668 shutdown_connections 2023-10-06T11:12:46.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.195+0000 7febcba7c700 1 -- 172.21.15.146:0/1834126668 wait complete. 2023-10-06T11:12:46.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.196+0000 7febcba7c700 1 Processor -- start 2023-10-06T11:12:46.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.196+0000 7febcba7c700 1 -- start start 2023-10-06T11:12:46.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.197+0000 7febcba7c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febc40689d0 0x7febc41547f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:46.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.197+0000 7febcba7c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7febc4153ab0 0x7febc415edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:46.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.197+0000 7febcba7c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febc4153e80 0x7febc4143ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:46.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.197+0000 7febcba7c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc4150720 con 0x7febc40689d0 2023-10-06T11:12:46.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.197+0000 7febcba7c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc4154dd0 con 0x7febc4153ab0 2023-10-06T11:12:46.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.197+0000 7febcba7c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc41550b0 con 0x7febc4153e80 2023-10-06T11:12:46.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.197+0000 7febc9818700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febc40689d0 0x7febc41547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:46.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.197+0000 7febc9818700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febc40689d0 0x7febc41547f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39198/0 (socket says 172.21.15.146:39198) 2023-10-06T11:12:46.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.197+0000 7febc9818700 1 -- 172.21.15.146:0/1388722922 learned_addr learned my addr 172.21.15.146:0/1388722922 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:46.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.197+0000 7febca019700 1 --2- 172.21.15.146:0/1388722922 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febc4153e80 0x7febc4143ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:46.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.197+0000 7febc9017700 1 --2- 172.21.15.146:0/1388722922 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7febc4153ab0 0x7febc415edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:46.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.197+0000 7febc9818700 1 -- 172.21.15.146:0/1388722922 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febc4153e80 msgr2=0x7febc4143ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:46.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.197+0000 7febc9818700 1 --2- 172.21.15.146:0/1388722922 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febc4153e80 0x7febc4143ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:46.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.197+0000 7febc9818700 1 -- 172.21.15.146:0/1388722922 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7febc4153ab0 msgr2=0x7febc415edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:46.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.197+0000 7febc9818700 1 --2- 172.21.15.146:0/1388722922 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7febc4153ab0 0x7febc415edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:46.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.197+0000 7febc9818700 1 -- 172.21.15.146:0/1388722922 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc0009420 con 0x7febc40689d0 2023-10-06T11:12:46.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.197+0000 7febc9818700 1 --2- 172.21.15.146:0/1388722922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febc40689d0 0x7febc41547f0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7febc000ec80 tx=0x7febc00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:46.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.198+0000 7febb9ffb700 1 -- 172.21.15.146:0/1388722922 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc000c850 con 0x7febc40689d0 2023-10-06T11:12:46.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.198+0000 7febb9ffb700 1 -- 172.21.15.146:0/1388722922 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc000c9b0 con 0x7febc40689d0 2023-10-06T11:12:46.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.198+0000 7febcba7c700 1 -- 172.21.15.146:0/1388722922 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febb40094f0 con 0x7febc40689d0 2023-10-06T11:12:46.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.198+0000 7febb9ffb700 1 -- 172.21.15.146:0/1388722922 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc000cd30 con 0x7febc40689d0 2023-10-06T11:12:46.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.198+0000 7febcba7c700 1 -- 172.21.15.146:0/1388722922 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febc4155670 con 0x7febc40689d0 2023-10-06T11:12:46.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.199+0000 7febcba7c700 1 -- 172.21.15.146:0/1388722922 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febc40cc5a0 con 0x7febc40689d0 2023-10-06T11:12:46.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.199+0000 7febb9ffb700 1 -- 172.21.15.146:0/1388722922 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7febc0013680 con 0x7febc40689d0 2023-10-06T11:12:46.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.200+0000 7febb9ffb700 1 --2- 172.21.15.146:0/1388722922 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feba8066f30 0x7feba80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:46.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.200+0000 7febb9ffb700 1 -- 172.21.15.146:0/1388722922 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6058+0+0 (secure 0 0 0) 0x7febc0084a40 con 0x7febc40689d0 2023-10-06T11:12:46.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.200+0000 7febc9017700 1 --2- 172.21.15.146:0/1388722922 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feba8066f30 0x7feba80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:46.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.200+0000 7febc9017700 1 --2- 172.21.15.146:0/1388722922 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feba8066f30 0x7feba80693e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7febc41542f0 tx=0x7febb4017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:46.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.204+0000 7febb9ffb700 1 -- 172.21.15.146:0/1388722922 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7febc0051ab0 con 0x7febc40689d0 2023-10-06T11:12:46.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.389+0000 7febcba7c700 1 -- 172.21.15.146:0/1388722922 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7febc404c380 con 0x7febc40689d0 2023-10-06T11:12:46.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.390+0000 7febb9ffb700 1 -- 172.21.15.146:0/1388722922 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+16917 (secure 0 0 0) 0x7febc00550d0 con 0x7febc40689d0 2023-10-06T11:12:46.392 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:12:46.392 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":89,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:12:46.364872+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:12:42.792405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-10-06T11:12:44.071743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:12:46.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.392+0000 7febcba7c700 1 -- 172.21.15.146:0/1388722922 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feba8066f30 msgr2=0x7feba80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:46.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.392+0000 7febcba7c700 1 --2- 172.21.15.146:0/1388722922 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feba8066f30 0x7feba80693e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7febc41542f0 tx=0x7febb4017000 comp rx=0 tx=0).stop 2023-10-06T11:12:46.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.392+0000 7febcba7c700 1 -- 172.21.15.146:0/1388722922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febc40689d0 msgr2=0x7febc41547f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:46.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.392+0000 7febcba7c700 1 --2- 172.21.15.146:0/1388722922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febc40689d0 0x7febc41547f0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7febc000ec80 tx=0x7febc00091a0 comp rx=0 tx=0).stop 2023-10-06T11:12:46.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.392+0000 7febcba7c700 1 -- 172.21.15.146:0/1388722922 shutdown_connections 2023-10-06T11:12:46.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.392+0000 7febcba7c700 1 --2- 172.21.15.146:0/1388722922 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feba8066f30 0x7feba80693e0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:46.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.392+0000 7febcba7c700 1 --2- 172.21.15.146:0/1388722922 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febc4153e80 0x7febc4143ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:46.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.392+0000 7febcba7c700 1 --2- 172.21.15.146:0/1388722922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febc40689d0 0x7febc41547f0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:46.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.392+0000 7febcba7c700 1 --2- 172.21.15.146:0/1388722922 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7febc4153ab0 0x7febc415edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:46.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.392+0000 7febcba7c700 1 -- 172.21.15.146:0/1388722922 >> 172.21.15.146:0/1388722922 conn(0x7febc406eba0 msgr2=0x7febc40b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:46.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.392+0000 7febcba7c700 1 -- 172.21.15.146:0/1388722922 shutdown_connections 2023-10-06T11:12:46.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.392+0000 7febcba7c700 1 -- 172.21.15.146:0/1388722922 wait complete. 2023-10-06T11:12:46.407 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T11:12:46.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.522+0000 7fb0e5cad700 1 Processor -- start 2023-10-06T11:12:46.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.522+0000 7fb0e5cad700 1 -- start start 2023-10-06T11:12:46.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.523+0000 7fb0e5cad700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb0e0067470 0x7fb0e0067840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:46.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.523+0000 7fb0e5cad700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0e0067d80 con 0x7fb0e00c7d20 2023-10-06T11:12:46.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.523+0000 7fb0e5cad700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0e00cae90 con 0x7fb0e006ef00 2023-10-06T11:12:46.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.523+0000 7fb0e5cad700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0e00cb170 con 0x7fb0e0067470 2023-10-06T11:12:46.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.523+0000 7fb0e54ac700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb0e00c7d20 0x7fb0e00c8120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:37880/0 (socket says 172.21.15.146:37880) 2023-10-06T11:12:46.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.523+0000 7fb0e54ac700 1 -- 172.21.15.146:0/1230117279 learned_addr learned my addr 172.21.15.146:0/1230117279 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:12:46.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.523+0000 7fb0e4cab700 1 --2- 172.21.15.146:0/1230117279 >> v2:172.21.15.151:3300/0 conn(0x7fb0e0067470 0x7fb0e0067840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:46.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.523+0000 7fb0df7fe700 1 -- 172.21.15.146:0/1230117279 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2197144838 0 0) 0x7fb0e0067d80 con 0x7fb0e00c7d20 2023-10-06T11:12:46.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.523+0000 7fb0df7fe700 1 -- 172.21.15.146:0/1230117279 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0d0003570 con 0x7fb0e00c7d20 2023-10-06T11:12:46.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.523+0000 7fb0df7fe700 1 -- 172.21.15.146:0/1230117279 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1266002796 0 0) 0x7fb0e00cae90 con 0x7fb0e006ef00 2023-10-06T11:12:46.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.523+0000 7fb0df7fe700 1 -- 172.21.15.146:0/1230117279 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0e0067d80 con 0x7fb0e006ef00 2023-10-06T11:12:46.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.523+0000 7fb0df7fe700 1 -- 172.21.15.146:0/1230117279 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3063328089 0 0) 0x7fb0d0003570 con 0x7fb0e00c7d20 2023-10-06T11:12:46.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.523+0000 7fb0df7fe700 1 -- 172.21.15.146:0/1230117279 >> v2:172.21.15.151:3300/0 conn(0x7fb0e0067470 msgr2=0x7fb0e0067840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:46.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.523+0000 7fb0df7fe700 1 --2- 172.21.15.146:0/1230117279 >> v2:172.21.15.151:3300/0 conn(0x7fb0e0067470 0x7fb0e0067840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:46.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.523+0000 7fb0df7fe700 1 -- 172.21.15.146:0/1230117279 >> v1:172.21.15.151:6789/0 conn(0x7fb0e006ef00 legacy=0x7fb0e006f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:46.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.523+0000 7fb0df7fe700 1 -- 172.21.15.146:0/1230117279 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e00cb450 con 0x7fb0e00c7d20 2023-10-06T11:12:46.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.523+0000 7fb0df7fe700 1 -- 172.21.15.146:0/1230117279 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fb0d80017f0 con 0x7fb0e00c7d20 2023-10-06T11:12:46.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.523+0000 7fb0e4cab700 1 --2- 172.21.15.146:0/1230117279 >> v2:172.21.15.151:3300/0 conn(0x7fb0e0067470 0x7fb0e0067840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:12:46.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.523+0000 7fb0df7fe700 1 -- 172.21.15.146:0/1230117279 >> v1:172.21.15.146:6789/0 conn(0x7fb0e00c7d20 legacy=0x7fb0e00c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:46.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.523+0000 7fb0df7fe700 1 --2- 172.21.15.146:0/1230117279 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0d0003bf0 0x7fb0d0003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:46.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.523+0000 7fb0df7fe700 1 --2- 172.21.15.146:0/1230117279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0d0004810 0x7fb0d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:46.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.523+0000 7fb0df7fe700 1 --2- 172.21.15.146:0/1230117279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0d00051c0 0x7fb0d000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:46.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.523+0000 7fb0df7fe700 1 -- 172.21.15.146:0/1230117279 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e00cb170 con 0x7fb0d00051c0 2023-10-06T11:12:46.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.523+0000 7fb0df7fe700 1 -- 172.21.15.146:0/1230117279 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d000c0b0 con 0x7fb0d0004810 2023-10-06T11:12:46.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.524+0000 7fb0df7fe700 1 -- 172.21.15.146:0/1230117279 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d000c270 con 0x7fb0d0003bf0 2023-10-06T11:12:46.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.524+0000 7fb0e54ac700 1 --2- 172.21.15.146:0/1230117279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0d00051c0 0x7fb0d000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:46.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.524+0000 7fb0e4cab700 1 --2- 172.21.15.146:0/1230117279 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0d0003bf0 0x7fb0d0003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:46.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.524+0000 7fb0dffff700 1 --2- 172.21.15.146:0/1230117279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0d0004810 0x7fb0d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:46.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.524+0000 7fb0e54ac700 1 -- 172.21.15.146:0/1230117279 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0d0003bf0 msgr2=0x7fb0d0003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:46.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.524+0000 7fb0e54ac700 1 --2- 172.21.15.146:0/1230117279 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0d0003bf0 0x7fb0d0003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:46.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.524+0000 7fb0e54ac700 1 -- 172.21.15.146:0/1230117279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0d0004810 msgr2=0x7fb0d0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:46.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.524+0000 7fb0e54ac700 1 --2- 172.21.15.146:0/1230117279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0d0004810 0x7fb0d0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:46.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.524+0000 7fb0e54ac700 1 -- 172.21.15.146:0/1230117279 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d0003570 con 0x7fb0d00051c0 2023-10-06T11:12:46.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.524+0000 7fb0e54ac700 1 -- 172.21.15.146:0/1230117279 reap_dead start 2023-10-06T11:12:46.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.524+0000 7fb0e54ac700 1 --2- 172.21.15.146:0/1230117279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0d00051c0 0x7fb0d000ba60 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fb0d800a8f0 tx=0x7fb0d8002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c16ed98ba3609bba server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:46.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.524+0000 7fb0df7fe700 1 -- 172.21.15.146:0/1230117279 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d80070d0 con 0x7fb0d00051c0 2023-10-06T11:12:46.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.524+0000 7fb0df7fe700 1 -- 172.21.15.146:0/1230117279 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d8007270 con 0x7fb0d00051c0 2023-10-06T11:12:46.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.524+0000 7fb0df7fe700 1 -- 172.21.15.146:0/1230117279 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d8007630 con 0x7fb0d00051c0 2023-10-06T11:12:46.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.525+0000 7fb0e5cad700 1 -- 172.21.15.146:0/1230117279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0d00051c0 msgr2=0x7fb0d000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:46.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.525+0000 7fb0e5cad700 1 --2- 172.21.15.146:0/1230117279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0d00051c0 0x7fb0d000ba60 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fb0d800a8f0 tx=0x7fb0d8002190 comp rx=0 tx=0).stop 2023-10-06T11:12:46.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.525+0000 7fb0e5cad700 1 -- 172.21.15.146:0/1230117279 shutdown_connections 2023-10-06T11:12:46.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.525+0000 7fb0e5cad700 1 --2- 172.21.15.146:0/1230117279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0d00051c0 0x7fb0d000ba60 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:46.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.525+0000 7fb0e5cad700 1 -- 172.21.15.146:0/1230117279 >> 172.21.15.146:0/1230117279 conn(0x7fb0e0069010 msgr2=0x7fb0e00cd120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:46.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.525+0000 7fb0e5cad700 1 -- 172.21.15.146:0/1230117279 shutdown_connections 2023-10-06T11:12:46.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.525+0000 7fb0e5cad700 1 -- 172.21.15.146:0/1230117279 wait complete. 2023-10-06T11:12:46.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.526+0000 7fb0e5cad700 1 Processor -- start 2023-10-06T11:12:46.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.526+0000 7fb0e5cad700 1 -- start start 2023-10-06T11:12:46.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.527+0000 7fb0e5cad700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0d00051c0 0x7fb0e013e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:46.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.527+0000 7fb0e5cad700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0e016ce50 0x7fb0e00aa280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:46.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.527+0000 7fb0e5cad700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0e00abc80 0x7fb0e00ac0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:46.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.527+0000 7fb0e5cad700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e00ada40 con 0x7fb0e00abc80 2023-10-06T11:12:46.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.527+0000 7fb0e5cad700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e013ef70 con 0x7fb0e016ce50 2023-10-06T11:12:46.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.527+0000 7fb0e5cad700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e016d330 con 0x7fb0d00051c0 2023-10-06T11:12:46.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.527+0000 7fb0e54ac700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0e00abc80 0x7fb0e00ac0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:46.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.527+0000 7fb0e54ac700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0e00abc80 0x7fb0e00ac0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39206/0 (socket says 172.21.15.146:39206) 2023-10-06T11:12:46.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.527+0000 7fb0e54ac700 1 -- 172.21.15.146:0/3537410927 learned_addr learned my addr 172.21.15.146:0/3537410927 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:46.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.527+0000 7fb0e4cab700 1 --2- 172.21.15.146:0/3537410927 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0d00051c0 0x7fb0e013e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:46.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.527+0000 7fb0dffff700 1 --2- 172.21.15.146:0/3537410927 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0e016ce50 0x7fb0e00aa280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:46.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.527+0000 7fb0e54ac700 1 -- 172.21.15.146:0/3537410927 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0d00051c0 msgr2=0x7fb0e013e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:46.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.527+0000 7fb0e54ac700 1 --2- 172.21.15.146:0/3537410927 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0d00051c0 0x7fb0e013e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:46.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.527+0000 7fb0e54ac700 1 -- 172.21.15.146:0/3537410927 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0e016ce50 msgr2=0x7fb0e00aa280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:46.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.527+0000 7fb0e54ac700 1 --2- 172.21.15.146:0/3537410927 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0e016ce50 0x7fb0e00aa280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:46.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.527+0000 7fb0e54ac700 1 -- 172.21.15.146:0/3537410927 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e016d610 con 0x7fb0e00abc80 2023-10-06T11:12:46.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.527+0000 7fb0e54ac700 1 --2- 172.21.15.146:0/3537410927 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0e00abc80 0x7fb0e00ac0f0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fb0d8001480 tx=0x7fb0d8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:46.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.527+0000 7fb0dcff9700 1 -- 172.21.15.146:0/3537410927 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d801e430 con 0x7fb0e00abc80 2023-10-06T11:12:46.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.527+0000 7fb0dcff9700 1 -- 172.21.15.146:0/3537410927 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d801e5b0 con 0x7fb0e00abc80 2023-10-06T11:12:46.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.527+0000 7fb0e5cad700 1 -- 172.21.15.146:0/3537410927 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0e016d8f0 con 0x7fb0e00abc80 2023-10-06T11:12:46.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.527+0000 7fb0dcff9700 1 -- 172.21.15.146:0/3537410927 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d801e970 con 0x7fb0e00abc80 2023-10-06T11:12:46.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.528+0000 7fb0e5cad700 1 -- 172.21.15.146:0/3537410927 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0e00aa7c0 con 0x7fb0e00abc80 2023-10-06T11:12:46.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.528+0000 7fb0e5cad700 1 -- 172.21.15.146:0/3537410927 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0e00adbb0 con 0x7fb0e00abc80 2023-10-06T11:12:46.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.529+0000 7fb0dcff9700 1 -- 172.21.15.146:0/3537410927 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb0d801ed20 con 0x7fb0e00abc80 2023-10-06T11:12:46.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.529+0000 7fb0dcff9700 1 --2- 172.21.15.146:0/3537410927 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb0c4066f60 0x7fb0c4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:46.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.529+0000 7fb0dcff9700 1 -- 172.21.15.146:0/3537410927 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb0d8086e70 con 0x7fb0e00abc80 2023-10-06T11:12:46.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.529+0000 7fb0e4cab700 1 --2- 172.21.15.146:0/3537410927 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb0c4066f60 0x7fb0c4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:46.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.530+0000 7fb0e4cab700 1 --2- 172.21.15.146:0/3537410927 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb0c4066f60 0x7fb0c4069410 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4006f00 tx=0x7fb0d4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:46.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.534+0000 7fb0dcff9700 1 -- 172.21.15.146:0/3537410927 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb0d8053ee0 con 0x7fb0e00abc80 2023-10-06T11:12:46.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:46.760+0000 7fb0e5cad700 1 -- 172.21.15.146:0/3537410927 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb0e00adb80 con 0x7fb0e00abc80 2023-10-06T11:12:47.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.749+0000 7fb0dcff9700 1 -- 172.21.15.146:0/3537410927 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v84) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb0d8057500 con 0x7fb0e00abc80 2023-10-06T11:12:47.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.751+0000 7fb0e5cad700 1 -- 172.21.15.146:0/3537410927 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb0c4066f60 msgr2=0x7fb0c4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:47.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.751+0000 7fb0e5cad700 1 --2- 172.21.15.146:0/3537410927 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb0c4066f60 0x7fb0c4069410 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4006f00 tx=0x7fb0d4008040 comp rx=0 tx=0).stop 2023-10-06T11:12:47.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.751+0000 7fb0e5cad700 1 -- 172.21.15.146:0/3537410927 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0e00abc80 msgr2=0x7fb0e00ac0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:47.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.751+0000 7fb0e5cad700 1 --2- 172.21.15.146:0/3537410927 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0e00abc80 0x7fb0e00ac0f0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7fb0d8001480 tx=0x7fb0d8016000 comp rx=0 tx=0).stop 2023-10-06T11:12:47.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.752+0000 7fb0e5cad700 1 -- 172.21.15.146:0/3537410927 shutdown_connections 2023-10-06T11:12:47.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.752+0000 7fb0e5cad700 1 --2- 172.21.15.146:0/3537410927 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb0c4066f60 0x7fb0c4069410 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:47.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.752+0000 7fb0e5cad700 1 --2- 172.21.15.146:0/3537410927 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0e00abc80 0x7fb0e00ac0f0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:47.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.752+0000 7fb0e5cad700 1 --2- 172.21.15.146:0/3537410927 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0d00051c0 0x7fb0e013e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:47.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.752+0000 7fb0e5cad700 1 --2- 172.21.15.146:0/3537410927 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0e016ce50 0x7fb0e00aa280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:47.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.752+0000 7fb0e5cad700 1 -- 172.21.15.146:0/3537410927 >> 172.21.15.146:0/3537410927 conn(0x7fb0e0069010 msgr2=0x7fb0e00c8dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:47.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.752+0000 7fb0e5cad700 1 -- 172.21.15.146:0/3537410927 shutdown_connections 2023-10-06T11:12:47.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.752+0000 7fb0e5cad700 1 -- 172.21.15.146:0/3537410927 wait complete. 2023-10-06T11:12:47.766 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T11:12:47.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.883+0000 7fe6d54cd700 1 Processor -- start 2023-10-06T11:12:47.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.883+0000 7fe6d54cd700 1 -- start start 2023-10-06T11:12:47.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.883+0000 7fe6d54cd700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe6d0067b80 0x7fe6d0164840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:47.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.883+0000 7fe6d54cd700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6d006ef10 con 0x7fe6d006f3a0 2023-10-06T11:12:47.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.883+0000 7fe6d54cd700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6d00cb8a0 con 0x7fe6d01596e0 2023-10-06T11:12:47.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.883+0000 7fe6d54cd700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6d00cbe50 con 0x7fe6d0067b80 2023-10-06T11:12:47.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.884+0000 7fe6ce7fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe6d006f3a0 0x7fe6d0067470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:37882/0 (socket says 172.21.15.146:37882) 2023-10-06T11:12:47.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.884+0000 7fe6ce7fc700 1 -- 172.21.15.146:0/1045303098 learned_addr learned my addr 172.21.15.146:0/1045303098 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:12:47.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.884+0000 7fe6cf7fe700 1 --2- 172.21.15.146:0/1045303098 >> v2:172.21.15.151:3300/0 conn(0x7fe6d0067b80 0x7fe6d0164840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:47.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.884+0000 7fe6cdffb700 1 -- 172.21.15.146:0/1045303098 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2730275379 0 0) 0x7fe6d006ef10 con 0x7fe6d006f3a0 2023-10-06T11:12:47.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.884+0000 7fe6cdffb700 1 -- 172.21.15.146:0/1045303098 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6b8003570 con 0x7fe6d006f3a0 2023-10-06T11:12:47.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.884+0000 7fe6cdffb700 1 -- 172.21.15.146:0/1045303098 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2827471027 0 0) 0x7fe6d00cb8a0 con 0x7fe6d01596e0 2023-10-06T11:12:47.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.884+0000 7fe6cdffb700 1 -- 172.21.15.146:0/1045303098 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6d006ef10 con 0x7fe6d01596e0 2023-10-06T11:12:47.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.884+0000 7fe6cdffb700 1 -- 172.21.15.146:0/1045303098 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2404766870 0 0) 0x7fe6b8003570 con 0x7fe6d006f3a0 2023-10-06T11:12:47.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.884+0000 7fe6cdffb700 1 -- 172.21.15.146:0/1045303098 >> v2:172.21.15.151:3300/0 conn(0x7fe6d0067b80 msgr2=0x7fe6d0164840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:47.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.884+0000 7fe6cdffb700 1 --2- 172.21.15.146:0/1045303098 >> v2:172.21.15.151:3300/0 conn(0x7fe6d0067b80 0x7fe6d0164840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:47.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.884+0000 7fe6cdffb700 1 -- 172.21.15.146:0/1045303098 >> v1:172.21.15.151:6789/0 conn(0x7fe6d01596e0 legacy=0x7fe6d00cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:47.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.884+0000 7fe6cdffb700 1 -- 172.21.15.146:0/1045303098 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d00cbb70 con 0x7fe6d006f3a0 2023-10-06T11:12:47.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.884+0000 7fe6cdffb700 1 -- 172.21.15.146:0/1045303098 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fe6c4001470 con 0x7fe6d006f3a0 2023-10-06T11:12:47.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.884+0000 7fe6cf7fe700 1 --2- 172.21.15.146:0/1045303098 >> v2:172.21.15.151:3300/0 conn(0x7fe6d0067b80 0x7fe6d0164840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:12:47.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.884+0000 7fe6cdffb700 1 -- 172.21.15.146:0/1045303098 >> v1:172.21.15.146:6789/0 conn(0x7fe6d006f3a0 legacy=0x7fe6d0067470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:47.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.884+0000 7fe6cdffb700 1 --2- 172.21.15.146:0/1045303098 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6b8003bf0 0x7fe6b8003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:47.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.884+0000 7fe6cdffb700 1 --2- 172.21.15.146:0/1045303098 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6b8004810 0x7fe6b8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:47.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.884+0000 7fe6cdffb700 1 --2- 172.21.15.146:0/1045303098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6b80051c0 0x7fe6b800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:47.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.884+0000 7fe6cdffb700 1 -- 172.21.15.146:0/1045303098 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d00cbe50 con 0x7fe6b8003bf0 2023-10-06T11:12:47.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.884+0000 7fe6cdffb700 1 -- 172.21.15.146:0/1045303098 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b800c0b0 con 0x7fe6b80051c0 2023-10-06T11:12:47.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.884+0000 7fe6cdffb700 1 -- 172.21.15.146:0/1045303098 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6b800c270 con 0x7fe6b8004810 2023-10-06T11:12:47.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.884+0000 7fe6ceffd700 1 --2- 172.21.15.146:0/1045303098 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6b8003bf0 0x7fe6b8003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:47.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.884+0000 7fe6cf7fe700 1 --2- 172.21.15.146:0/1045303098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6b80051c0 0x7fe6b800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:47.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.884+0000 7fe6ce7fc700 1 --2- 172.21.15.146:0/1045303098 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6b8004810 0x7fe6b8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:47.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.885+0000 7fe6ceffd700 1 -- 172.21.15.146:0/1045303098 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6b8004810 msgr2=0x7fe6b8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:47.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.885+0000 7fe6ceffd700 1 --2- 172.21.15.146:0/1045303098 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6b8004810 0x7fe6b8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:47.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.885+0000 7fe6ceffd700 1 -- 172.21.15.146:0/1045303098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6b80051c0 msgr2=0x7fe6b800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:47.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.885+0000 7fe6ceffd700 1 --2- 172.21.15.146:0/1045303098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6b80051c0 0x7fe6b800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:47.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.885+0000 7fe6ceffd700 1 -- 172.21.15.146:0/1045303098 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b8003570 con 0x7fe6b8003bf0 2023-10-06T11:12:47.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.885+0000 7fe6cf7fe700 1 -- 172.21.15.146:0/1045303098 reap_dead start 2023-10-06T11:12:47.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.885+0000 7fe6ce7fc700 1 --2- 172.21.15.146:0/1045303098 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6b8004810 0x7fe6b8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:12:47.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.885+0000 7fe6ceffd700 1 --2- 172.21.15.146:0/1045303098 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6b8003bf0 0x7fe6b8003fe0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0001a10 tx=0x7fe6c0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe4db6ebc7157b35 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:47.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.885+0000 7fe6cdffb700 1 -- 172.21.15.146:0/1045303098 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c000c590 con 0x7fe6b8003bf0 2023-10-06T11:12:47.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.885+0000 7fe6cdffb700 1 -- 172.21.15.146:0/1045303098 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c000c6f0 con 0x7fe6b8003bf0 2023-10-06T11:12:47.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.885+0000 7fe6cdffb700 1 -- 172.21.15.146:0/1045303098 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c000ca90 con 0x7fe6b8003bf0 2023-10-06T11:12:47.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.885+0000 7fe6d54cd700 1 -- 172.21.15.146:0/1045303098 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6b8003bf0 msgr2=0x7fe6b8003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:47.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.885+0000 7fe6d54cd700 1 --2- 172.21.15.146:0/1045303098 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6b8003bf0 0x7fe6b8003fe0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0001a10 tx=0x7fe6c0007d30 comp rx=0 tx=0).stop 2023-10-06T11:12:47.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.885+0000 7fe6d54cd700 1 -- 172.21.15.146:0/1045303098 shutdown_connections 2023-10-06T11:12:47.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.885+0000 7fe6d54cd700 1 --2- 172.21.15.146:0/1045303098 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6b8003bf0 0x7fe6b8003fe0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:47.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.885+0000 7fe6d54cd700 1 -- 172.21.15.146:0/1045303098 >> 172.21.15.146:0/1045303098 conn(0x7fe6d0069050 msgr2=0x7fe6d00cd300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:47.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.885+0000 7fe6d54cd700 1 -- 172.21.15.146:0/1045303098 shutdown_connections 2023-10-06T11:12:47.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.885+0000 7fe6d54cd700 1 -- 172.21.15.146:0/1045303098 wait complete. 2023-10-06T11:12:47.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.887+0000 7fe6d54cd700 1 Processor -- start 2023-10-06T11:12:47.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.887+0000 7fe6d54cd700 1 -- start start 2023-10-06T11:12:47.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.887+0000 7fe6d54cd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6b8003bf0 0x7fe6d016a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:47.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.887+0000 7fe6d54cd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6d00b15f0 0x7fe6d00b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:47.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.887+0000 7fe6d54cd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6d00b1a40 0x7fe6d00b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:47.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.887+0000 7fe6d54cd700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d0151f70 con 0x7fe6d00b15f0 2023-10-06T11:12:47.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.887+0000 7fe6d54cd700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d00b0bf0 con 0x7fe6b8003bf0 2023-10-06T11:12:47.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.887+0000 7fe6d54cd700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d00b0ed0 con 0x7fe6d00b1a40 2023-10-06T11:12:47.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.887+0000 7fe6ce7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6d00b15f0 0x7fe6d00b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:47.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.887+0000 7fe6ce7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6d00b15f0 0x7fe6d00b00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39218/0 (socket says 172.21.15.146:39218) 2023-10-06T11:12:47.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.887+0000 7fe6ce7fc700 1 -- 172.21.15.146:0/1384151468 learned_addr learned my addr 172.21.15.146:0/1384151468 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:47.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.888+0000 7fe6ceffd700 1 --2- 172.21.15.146:0/1384151468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6b8003bf0 0x7fe6d016a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:47.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.888+0000 7fe6cf7fe700 1 --2- 172.21.15.146:0/1384151468 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6d00b1a40 0x7fe6d00b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:47.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.888+0000 7fe6ce7fc700 1 -- 172.21.15.146:0/1384151468 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6d00b1a40 msgr2=0x7fe6d00b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:47.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.888+0000 7fe6ce7fc700 1 --2- 172.21.15.146:0/1384151468 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6d00b1a40 0x7fe6d00b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:47.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.888+0000 7fe6ce7fc700 1 -- 172.21.15.146:0/1384151468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6b8003bf0 msgr2=0x7fe6d016a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:47.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.888+0000 7fe6ce7fc700 1 --2- 172.21.15.146:0/1384151468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6b8003bf0 0x7fe6d016a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:47.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.888+0000 7fe6ce7fc700 1 -- 172.21.15.146:0/1384151468 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d0169af0 con 0x7fe6d00b15f0 2023-10-06T11:12:47.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.888+0000 7fe6ce7fc700 1 --2- 172.21.15.146:0/1384151468 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6d00b15f0 0x7fe6d00b00a0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fe6c400e810 tx=0x7fe6c4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:47.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.888+0000 7fe6b6ffd700 1 -- 172.21.15.146:0/1384151468 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c4010520 con 0x7fe6d00b15f0 2023-10-06T11:12:47.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.888+0000 7fe6b6ffd700 1 -- 172.21.15.146:0/1384151468 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c4010680 con 0x7fe6d00b15f0 2023-10-06T11:12:47.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.888+0000 7fe6d54cd700 1 -- 172.21.15.146:0/1384151468 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6d0169dd0 con 0x7fe6d00b15f0 2023-10-06T11:12:47.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.888+0000 7fe6b6ffd700 1 -- 172.21.15.146:0/1384151468 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c4010a20 con 0x7fe6d00b15f0 2023-10-06T11:12:47.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.888+0000 7fe6d54cd700 1 -- 172.21.15.146:0/1384151468 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6d01526d0 con 0x7fe6d00b15f0 2023-10-06T11:12:47.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.889+0000 7fe6d54cd700 1 -- 172.21.15.146:0/1384151468 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6d004c380 con 0x7fe6d00b15f0 2023-10-06T11:12:47.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.889+0000 7fe6b6ffd700 1 -- 172.21.15.146:0/1384151468 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe6c4014480 con 0x7fe6d00b15f0 2023-10-06T11:12:47.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.890+0000 7fe6b6ffd700 1 --2- 172.21.15.146:0/1384151468 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe6bc066f60 0x7fe6bc069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:47.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.890+0000 7fe6b6ffd700 1 -- 172.21.15.146:0/1384151468 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe6c4083e90 con 0x7fe6d00b15f0 2023-10-06T11:12:47.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.890+0000 7fe6ceffd700 1 --2- 172.21.15.146:0/1384151468 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe6bc066f60 0x7fe6bc069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:47.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.890+0000 7fe6ceffd700 1 --2- 172.21.15.146:0/1384151468 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe6bc066f60 0x7fe6bc069410 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0000c00 tx=0x7fe6c0015000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:47.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:47.894+0000 7fe6b6ffd700 1 -- 172.21.15.146:0/1384151468 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe6c404d5a0 con 0x7fe6d00b15f0 2023-10-06T11:12:48.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.121+0000 7fe6d54cd700 1 -- 172.21.15.146:0/1384151468 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe6d0068190 con 0x7fe6d00b15f0 2023-10-06T11:12:48.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.753+0000 7fe6b6ffd700 1 -- 172.21.15.146:0/1384151468 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v85) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe6c4019020 con 0x7fe6d00b15f0 2023-10-06T11:12:48.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.755+0000 7fe6d54cd700 1 -- 172.21.15.146:0/1384151468 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe6bc066f60 msgr2=0x7fe6bc069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:48.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.755+0000 7fe6d54cd700 1 --2- 172.21.15.146:0/1384151468 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe6bc066f60 0x7fe6bc069410 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe6c0000c00 tx=0x7fe6c0015000 comp rx=0 tx=0).stop 2023-10-06T11:12:48.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.755+0000 7fe6d54cd700 1 -- 172.21.15.146:0/1384151468 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6d00b15f0 msgr2=0x7fe6d00b00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:48.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.755+0000 7fe6d54cd700 1 --2- 172.21.15.146:0/1384151468 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6d00b15f0 0x7fe6d00b00a0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fe6c400e810 tx=0x7fe6c4001e70 comp rx=0 tx=0).stop 2023-10-06T11:12:48.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.755+0000 7fe6d54cd700 1 -- 172.21.15.146:0/1384151468 shutdown_connections 2023-10-06T11:12:48.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.755+0000 7fe6d54cd700 1 --2- 172.21.15.146:0/1384151468 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe6bc066f60 0x7fe6bc069410 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:48.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.755+0000 7fe6d54cd700 1 --2- 172.21.15.146:0/1384151468 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6d00b1a40 0x7fe6d00b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:48.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.755+0000 7fe6d54cd700 1 --2- 172.21.15.146:0/1384151468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6b8003bf0 0x7fe6d016a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:48.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.755+0000 7fe6d54cd700 1 --2- 172.21.15.146:0/1384151468 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6d00b15f0 0x7fe6d00b00a0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:48.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.755+0000 7fe6d54cd700 1 -- 172.21.15.146:0/1384151468 >> 172.21.15.146:0/1384151468 conn(0x7fe6d0069050 msgr2=0x7fe6d00c8700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:48.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.755+0000 7fe6d54cd700 1 -- 172.21.15.146:0/1384151468 shutdown_connections 2023-10-06T11:12:48.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.755+0000 7fe6d54cd700 1 -- 172.21.15.146:0/1384151468 wait complete. 2023-10-06T11:12:48.770 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:12:48.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.884+0000 7f4addfbf700 1 Processor -- start 2023-10-06T11:12:48.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.884+0000 7f4addfbf700 1 -- start start 2023-10-06T11:12:48.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.884+0000 7f4addfbf700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4ad80b08d0 0x7f4ad80c3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:48.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.884+0000 7f4addfbf700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ad8068a90 con 0x7f4ad80cef00 2023-10-06T11:12:48.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.884+0000 7f4addfbf700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ad8159fd0 con 0x7f4ad80c4750 2023-10-06T11:12:48.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.884+0000 7f4addfbf700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ad80cdcf0 con 0x7f4ad80b08d0 2023-10-06T11:12:48.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.885+0000 7f4ad7fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4ad80cef00 0x7f4ad8069630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:37898/0 (socket says 172.21.15.146:37898) 2023-10-06T11:12:48.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.885+0000 7f4ad7fff700 1 -- 172.21.15.146:0/1630376262 learned_addr learned my addr 172.21.15.146:0/1630376262 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:12:48.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.885+0000 7f4ad77fe700 1 --2- 172.21.15.146:0/1630376262 >> v2:172.21.15.151:3300/0 conn(0x7f4ad80b08d0 0x7f4ad80c3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:48.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.885+0000 7f4ad67fc700 1 -- 172.21.15.146:0/1630376262 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 567736178 0 0) 0x7f4ad8068a90 con 0x7f4ad80cef00 2023-10-06T11:12:48.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.885+0000 7f4ad67fc700 1 -- 172.21.15.146:0/1630376262 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ac0003570 con 0x7f4ad80cef00 2023-10-06T11:12:48.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.885+0000 7f4ad67fc700 1 -- 172.21.15.146:0/1630376262 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2880247352 0 0) 0x7f4ad8159fd0 con 0x7f4ad80c4750 2023-10-06T11:12:48.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.885+0000 7f4ad67fc700 1 -- 172.21.15.146:0/1630376262 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ad8068a90 con 0x7f4ad80c4750 2023-10-06T11:12:48.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.885+0000 7f4ad67fc700 1 -- 172.21.15.146:0/1630376262 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1670632724 0 0) 0x7f4ac0003570 con 0x7f4ad80cef00 2023-10-06T11:12:48.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.885+0000 7f4ad77fe700 1 -- 172.21.15.146:0/1630376262 >> v1:172.21.15.151:6789/0 conn(0x7f4ad80c4750 legacy=0x7f4ad8068f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:48.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.885+0000 7f4ad77fe700 1 -- 172.21.15.146:0/1630376262 >> v1:172.21.15.146:6789/0 conn(0x7f4ad80cef00 legacy=0x7f4ad8069630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:48.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.885+0000 7f4ad77fe700 1 -- 172.21.15.146:0/1630376262 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad80cdfd0 con 0x7f4ad80b08d0 2023-10-06T11:12:48.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.885+0000 7f4ad77fe700 1 --2- 172.21.15.146:0/1630376262 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ad80b08d0 0x7f4ad80c3250 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8009e60 tx=0x7f4ac8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35f294aaba333511 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:48.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.885+0000 7f4ad67fc700 1 -- 172.21.15.146:0/1630376262 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac800e070 con 0x7f4ad80b08d0 2023-10-06T11:12:48.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.885+0000 7f4ad67fc700 1 -- 172.21.15.146:0/1630376262 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac800b7a0 con 0x7f4ad80b08d0 2023-10-06T11:12:48.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.885+0000 7f4ad67fc700 1 -- 172.21.15.146:0/1630376262 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad0001470 con 0x7f4ad80b08d0 2023-10-06T11:12:48.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.886+0000 7f4addfbf700 1 -- 172.21.15.146:0/1630376262 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ad80b08d0 msgr2=0x7f4ad80c3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:48.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.886+0000 7f4addfbf700 1 --2- 172.21.15.146:0/1630376262 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ad80b08d0 0x7f4ad80c3250 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8009e60 tx=0x7f4ac8009780 comp rx=0 tx=0).stop 2023-10-06T11:12:48.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.886+0000 7f4addfbf700 1 -- 172.21.15.146:0/1630376262 shutdown_connections 2023-10-06T11:12:48.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.886+0000 7f4addfbf700 1 --2- 172.21.15.146:0/1630376262 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ad80b08d0 0x7f4ad80c3250 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:48.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.886+0000 7f4addfbf700 1 -- 172.21.15.146:0/1630376262 >> 172.21.15.146:0/1630376262 conn(0x7f4ad8067c50 msgr2=0x7f4ad80ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:48.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.886+0000 7f4addfbf700 1 -- 172.21.15.146:0/1630376262 shutdown_connections 2023-10-06T11:12:48.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.886+0000 7f4addfbf700 1 -- 172.21.15.146:0/1630376262 wait complete. 2023-10-06T11:12:48.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.887+0000 7f4addfbf700 1 Processor -- start 2023-10-06T11:12:48.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.887+0000 7f4addfbf700 1 -- start start 2023-10-06T11:12:48.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.888+0000 7f4addfbf700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ad80b08d0 0x7f4ad81528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:48.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.888+0000 7f4addfbf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ad80c4750 0x7f4ad80c7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:48.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.888+0000 7f4addfbf700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ad80cef00 0x7f4ad8154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:48.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.888+0000 7f4addfbf700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad80c6510 con 0x7f4ad80c4750 2023-10-06T11:12:48.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.888+0000 7f4addfbf700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad8152e00 con 0x7f4ad80cef00 2023-10-06T11:12:48.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.888+0000 7f4addfbf700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad80c5900 con 0x7f4ad80b08d0 2023-10-06T11:12:48.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.888+0000 7f4ad6ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ad80c4750 0x7f4ad80c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:48.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.888+0000 7f4ad6ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ad80c4750 0x7f4ad80c7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39228/0 (socket says 172.21.15.146:39228) 2023-10-06T11:12:48.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.888+0000 7f4ad6ffd700 1 -- 172.21.15.146:0/3976099439 learned_addr learned my addr 172.21.15.146:0/3976099439 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:48.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.888+0000 7f4ad7fff700 1 --2- 172.21.15.146:0/3976099439 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ad80cef00 0x7f4ad8154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:48.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.888+0000 7f4ad77fe700 1 --2- 172.21.15.146:0/3976099439 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ad80b08d0 0x7f4ad81528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:48.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.888+0000 7f4ad6ffd700 1 -- 172.21.15.146:0/3976099439 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ad80b08d0 msgr2=0x7f4ad81528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:48.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.888+0000 7f4ad6ffd700 1 --2- 172.21.15.146:0/3976099439 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ad80b08d0 0x7f4ad81528c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:48.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.888+0000 7f4ad6ffd700 1 -- 172.21.15.146:0/3976099439 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ad80cef00 msgr2=0x7f4ad8154090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:48.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.888+0000 7f4ad6ffd700 1 --2- 172.21.15.146:0/3976099439 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ad80cef00 0x7f4ad8154090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:48.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.888+0000 7f4ad6ffd700 1 -- 172.21.15.146:0/3976099439 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac8009a20 con 0x7f4ad80c4750 2023-10-06T11:12:48.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.889+0000 7f4ad6ffd700 1 --2- 172.21.15.146:0/3976099439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ad80c4750 0x7f4ad80c7860 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f4acc00c790 tx=0x7f4acc007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:48.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.889+0000 7f4abf7fe700 1 -- 172.21.15.146:0/3976099439 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4acc010510 con 0x7f4ad80c4750 2023-10-06T11:12:48.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.889+0000 7f4abf7fe700 1 -- 172.21.15.146:0/3976099439 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4acc010670 con 0x7f4ad80c4750 2023-10-06T11:12:48.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.889+0000 7f4addfbf700 1 -- 172.21.15.146:0/3976099439 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ad80c5be0 con 0x7f4ad80c4750 2023-10-06T11:12:48.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.889+0000 7f4abf7fe700 1 -- 172.21.15.146:0/3976099439 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4acc010a10 con 0x7f4ad80c4750 2023-10-06T11:12:48.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.889+0000 7f4addfbf700 1 -- 172.21.15.146:0/3976099439 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad80c61a0 con 0x7f4ad80c4750 2023-10-06T11:12:48.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.890+0000 7f4addfbf700 1 -- 172.21.15.146:0/3976099439 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ad804c380 con 0x7f4ad80c4750 2023-10-06T11:12:48.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.890+0000 7f4abf7fe700 1 -- 172.21.15.146:0/3976099439 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4acc01b3b0 con 0x7f4ad80c4750 2023-10-06T11:12:48.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.891+0000 7f4abf7fe700 1 --2- 172.21.15.146:0/3976099439 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4ac4066f30 0x7f4ac40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:48.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.891+0000 7f4ad77fe700 1 --2- 172.21.15.146:0/3976099439 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4ac4066f30 0x7f4ac40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:48.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.891+0000 7f4abf7fe700 1 -- 172.21.15.146:0/3976099439 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4acc083ee0 con 0x7f4ad80c4750 2023-10-06T11:12:48.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.891+0000 7f4ad77fe700 1 --2- 172.21.15.146:0/3976099439 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4ac4066f30 0x7f4ac40693e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f4ac80097c0 tx=0x7f4ac8017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:48.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:48.895+0000 7f4abf7fe700 1 -- 172.21.15.146:0/3976099439 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4acc050ff0 con 0x7f4ad80c4750 2023-10-06T11:12:49.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.124+0000 7f4addfbf700 1 -- 172.21.15.146:0/3976099439 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4ad8068720 con 0x7f4ad80c4750 2023-10-06T11:12:49.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.124+0000 7f4abf7fe700 1 -- 172.21.15.146:0/3976099439 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4608 (secure 0 0 0) 0x7f4acc017020 con 0x7f4ad80c4750 2023-10-06T11:12:49.126 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:12:49.126 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":85,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6619,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/1915786440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1915786440},{"type":"v1","addr":"172.21.15.151:6834","nonce":1915786440}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7212,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2292999516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2292999516},{"type":"v1","addr":"172.21.15.146:6836","nonce":2292999516}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7215,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/905558084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":905558084},{"type":"v1","addr":"172.21.15.146:6837","nonce":905558084}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:12:45.107155+0000","modified":"2023-10-06T11:12:48.746860+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7227},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7227":{"gid":7227,"name":"d","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6835/3868165725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":3868165725},{"type":"v1","addr":"172.21.15.151:6835","nonce":3868165725}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T11:12:49.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.126+0000 7f4addfbf700 1 -- 172.21.15.146:0/3976099439 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4ac4066f30 msgr2=0x7f4ac40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:49.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.126+0000 7f4addfbf700 1 --2- 172.21.15.146:0/3976099439 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4ac4066f30 0x7f4ac40693e0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f4ac80097c0 tx=0x7f4ac8017000 comp rx=0 tx=0).stop 2023-10-06T11:12:49.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.126+0000 7f4addfbf700 1 -- 172.21.15.146:0/3976099439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ad80c4750 msgr2=0x7f4ad80c7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:49.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.126+0000 7f4addfbf700 1 --2- 172.21.15.146:0/3976099439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ad80c4750 0x7f4ad80c7860 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f4acc00c790 tx=0x7f4acc007e10 comp rx=0 tx=0).stop 2023-10-06T11:12:49.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.127+0000 7f4addfbf700 1 -- 172.21.15.146:0/3976099439 shutdown_connections 2023-10-06T11:12:49.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.127+0000 7f4addfbf700 1 --2- 172.21.15.146:0/3976099439 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4ac4066f30 0x7f4ac40693e0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.127+0000 7f4addfbf700 1 --2- 172.21.15.146:0/3976099439 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ad80cef00 0x7f4ad8154090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.127+0000 7f4addfbf700 1 --2- 172.21.15.146:0/3976099439 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ad80b08d0 0x7f4ad81528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.127+0000 7f4addfbf700 1 --2- 172.21.15.146:0/3976099439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4ad80c4750 0x7f4ad80c7860 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.127+0000 7f4addfbf700 1 -- 172.21.15.146:0/3976099439 >> 172.21.15.146:0/3976099439 conn(0x7f4ad8067c50 msgr2=0x7f4ad8155700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:49.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.127+0000 7f4addfbf700 1 -- 172.21.15.146:0/3976099439 shutdown_connections 2023-10-06T11:12:49.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.127+0000 7f4addfbf700 1 -- 172.21.15.146:0/3976099439 wait complete. 2023-10-06T11:12:49.130 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 85 2023-10-06T11:12:49.140 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:12:49.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.254+0000 7f0f0382f700 1 Processor -- start 2023-10-06T11:12:49.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.254+0000 7f0f0382f700 1 -- start start 2023-10-06T11:12:49.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.255+0000 7f0f0382f700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0efc153ab0 0x7f0efc15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:49.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.255+0000 7f0f0382f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0efc068ba0 0x7f0efc0b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:49.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.255+0000 7f0f0382f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0efc15ac30 con 0x7f0efc153e80 2023-10-06T11:12:49.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.255+0000 7f0f0382f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0efc0b4510 con 0x7f0efc068ba0 2023-10-06T11:12:49.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.255+0000 7f0f0382f700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0efc0b6530 con 0x7f0efc153ab0 2023-10-06T11:12:49.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.255+0000 7f0f01dcc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0efc068ba0 0x7f0efc0b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:49.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.255+0000 7f0f00dca700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0efc153e80 0x7f0efc068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:37902/0 (socket says 172.21.15.146:37902) 2023-10-06T11:12:49.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.255+0000 7f0f00dca700 1 -- 172.21.15.146:0/486110336 learned_addr learned my addr 172.21.15.146:0/486110336 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:12:49.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.255+0000 7f0f015cb700 1 --2- 172.21.15.146:0/486110336 >> v2:172.21.15.151:3300/0 conn(0x7f0efc153ab0 0x7f0efc15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:49.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.255+0000 7f0f01dcc700 1 -- 172.21.15.146:0/486110336 >> v2:172.21.15.151:3300/0 conn(0x7f0efc153ab0 msgr2=0x7f0efc15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:49.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.255+0000 7f0f01dcc700 1 --2- 172.21.15.146:0/486110336 >> v2:172.21.15.151:3300/0 conn(0x7f0efc153ab0 0x7f0efc15a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.255+0000 7f0f01dcc700 1 -- 172.21.15.146:0/486110336 >> v1:172.21.15.146:6789/0 conn(0x7f0efc153e80 legacy=0x7f0efc068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:49.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.255+0000 7f0efbfff700 1 -- 172.21.15.146:0/486110336 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4227568405 0 0) 0x7f0ef0001110 con 0x7f0efc153e80 2023-10-06T11:12:49.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.255+0000 7f0f01dcc700 1 -- 172.21.15.146:0/486110336 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0efc0b5c50 con 0x7f0efc068ba0 2023-10-06T11:12:49.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.255+0000 7f0f01dcc700 1 --2- 172.21.15.146:0/486110336 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0efc068ba0 0x7f0efc0b49a0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f0efc0b5eb0 tx=0x7f0eec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=246279df68d50014 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:49.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.255+0000 7f0efbfff700 1 -- 172.21.15.146:0/486110336 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eec011630 con 0x7f0efc068ba0 2023-10-06T11:12:49.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.256+0000 7f0efbfff700 1 -- 172.21.15.146:0/486110336 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eec011790 con 0x7f0efc068ba0 2023-10-06T11:12:49.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.256+0000 7f0efbfff700 1 -- 172.21.15.146:0/486110336 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eec011b30 con 0x7f0efc068ba0 2023-10-06T11:12:49.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.256+0000 7f0f0382f700 1 -- 172.21.15.146:0/486110336 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0efc068ba0 msgr2=0x7f0efc0b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:49.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.256+0000 7f0f0382f700 1 --2- 172.21.15.146:0/486110336 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0efc068ba0 0x7f0efc0b49a0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f0efc0b5eb0 tx=0x7f0eec0091a0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.256+0000 7f0f0382f700 1 -- 172.21.15.146:0/486110336 shutdown_connections 2023-10-06T11:12:49.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.256+0000 7f0f0382f700 1 --2- 172.21.15.146:0/486110336 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0efc068ba0 0x7f0efc0b49a0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.256+0000 7f0f0382f700 1 --2- 172.21.15.146:0/486110336 >> v2:172.21.15.151:3300/0 conn(0x7f0efc153ab0 0x7f0efc15a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.256+0000 7f0f0382f700 1 -- 172.21.15.146:0/486110336 >> 172.21.15.146:0/486110336 conn(0x7f0efc06eba0 msgr2=0x7f0efc06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:49.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.256+0000 7f0f0382f700 1 -- 172.21.15.146:0/486110336 shutdown_connections 2023-10-06T11:12:49.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.256+0000 7f0f0382f700 1 -- 172.21.15.146:0/486110336 wait complete. 2023-10-06T11:12:49.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.257+0000 7f0f0382f700 1 Processor -- start 2023-10-06T11:12:49.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.257+0000 7f0f0382f700 1 -- start start 2023-10-06T11:12:49.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.258+0000 7f0f0382f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0efc068ba0 0x7f0efc14fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:49.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.258+0000 7f0f0382f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0efc153ab0 0x7f0efc0ce950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:49.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.258+0000 7f0f0382f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0efc153e80 0x7f0efc0cee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:49.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.258+0000 7f0f0382f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0efc150340 con 0x7f0efc153ab0 2023-10-06T11:12:49.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.258+0000 7f0f0382f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0efc155250 con 0x7f0efc153e80 2023-10-06T11:12:49.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.258+0000 7f0f0382f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0efc155530 con 0x7f0efc068ba0 2023-10-06T11:12:49.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.258+0000 7f0f00dca700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0efc153ab0 0x7f0efc0ce950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:49.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.258+0000 7f0f00dca700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0efc153ab0 0x7f0efc0ce950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39254/0 (socket says 172.21.15.146:39254) 2023-10-06T11:12:49.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.258+0000 7f0f00dca700 1 -- 172.21.15.146:0/2743602030 learned_addr learned my addr 172.21.15.146:0/2743602030 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:49.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.258+0000 7f0f015cb700 1 --2- 172.21.15.146:0/2743602030 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0efc068ba0 0x7f0efc14fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:49.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.258+0000 7f0f01dcc700 1 --2- 172.21.15.146:0/2743602030 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0efc153e80 0x7f0efc0cee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:49.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.258+0000 7f0f00dca700 1 -- 172.21.15.146:0/2743602030 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0efc068ba0 msgr2=0x7f0efc14fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:49.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.258+0000 7f0f00dca700 1 --2- 172.21.15.146:0/2743602030 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0efc068ba0 0x7f0efc14fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.258+0000 7f0f00dca700 1 -- 172.21.15.146:0/2743602030 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0efc153e80 msgr2=0x7f0efc0cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:49.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.258+0000 7f0f00dca700 1 --2- 172.21.15.146:0/2743602030 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0efc153e80 0x7f0efc0cee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.258+0000 7f0f00dca700 1 -- 172.21.15.146:0/2743602030 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eec009420 con 0x7f0efc153ab0 2023-10-06T11:12:49.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.259+0000 7f0f00dca700 1 --2- 172.21.15.146:0/2743602030 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0efc153ab0 0x7f0efc0ce950 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f0ef000c810 tx=0x7f0ef0007c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:49.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.259+0000 7f0ef97fa700 1 -- 172.21.15.146:0/2743602030 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef0005b30 con 0x7f0efc153ab0 2023-10-06T11:12:49.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.259+0000 7f0ef97fa700 1 -- 172.21.15.146:0/2743602030 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ef0005c90 con 0x7f0efc153ab0 2023-10-06T11:12:49.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.259+0000 7f0f0382f700 1 -- 172.21.15.146:0/2743602030 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0efc155810 con 0x7f0efc153ab0 2023-10-06T11:12:49.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.259+0000 7f0ef97fa700 1 -- 172.21.15.146:0/2743602030 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ef0007300 con 0x7f0efc153ab0 2023-10-06T11:12:49.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.259+0000 7f0f0382f700 1 -- 172.21.15.146:0/2743602030 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0efc158c20 con 0x7f0efc153ab0 2023-10-06T11:12:49.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.260+0000 7f0f0382f700 1 -- 172.21.15.146:0/2743602030 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0efc158a80 con 0x7f0efc153ab0 2023-10-06T11:12:49.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.260+0000 7f0ef97fa700 1 -- 172.21.15.146:0/2743602030 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0ef00076f0 con 0x7f0efc153ab0 2023-10-06T11:12:49.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.261+0000 7f0ef97fa700 1 --2- 172.21.15.146:0/2743602030 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0ee8066f30 0x7f0ee80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:49.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.261+0000 7f0f015cb700 1 --2- 172.21.15.146:0/2743602030 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0ee8066f30 0x7f0ee80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:49.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.261+0000 7f0ef97fa700 1 -- 172.21.15.146:0/2743602030 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0ef0084100 con 0x7f0efc153ab0 2023-10-06T11:12:49.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.261+0000 7f0f015cb700 1 --2- 172.21.15.146:0/2743602030 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0ee8066f30 0x7f0ee80693e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0ef40076a0 tx=0x7f0ef400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:49.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.265+0000 7f0ef97fa700 1 -- 172.21.15.146:0/2743602030 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0efc158a80 con 0x7f0efc153ab0 2023-10-06T11:12:49.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.453+0000 7f0f0382f700 1 -- 172.21.15.146:0/2743602030 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0efc15ac30 con 0x7f0efc153ab0 2023-10-06T11:12:49.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.454+0000 7f0ef97fa700 1 -- 172.21.15.146:0/2743602030 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+16917 (secure 0 0 0) 0x7f0efc15ac30 con 0x7f0efc153ab0 2023-10-06T11:12:49.456 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:12:49.456 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":89,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:12:46.364872+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:12:42.792405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-10-06T11:12:44.071743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:12:49.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.456+0000 7f0f0382f700 1 -- 172.21.15.146:0/2743602030 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0ee8066f30 msgr2=0x7f0ee80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:49.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.456+0000 7f0f0382f700 1 --2- 172.21.15.146:0/2743602030 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0ee8066f30 0x7f0ee80693e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0ef40076a0 tx=0x7f0ef400b040 comp rx=0 tx=0).stop 2023-10-06T11:12:49.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.456+0000 7f0f0382f700 1 -- 172.21.15.146:0/2743602030 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0efc153ab0 msgr2=0x7f0efc0ce950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:49.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.456+0000 7f0f0382f700 1 --2- 172.21.15.146:0/2743602030 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0efc153ab0 0x7f0efc0ce950 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f0ef000c810 tx=0x7f0ef0007c50 comp rx=0 tx=0).stop 2023-10-06T11:12:49.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.456+0000 7f0f0382f700 1 -- 172.21.15.146:0/2743602030 shutdown_connections 2023-10-06T11:12:49.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.456+0000 7f0f0382f700 1 --2- 172.21.15.146:0/2743602030 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0ee8066f30 0x7f0ee80693e0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.456+0000 7f0f0382f700 1 --2- 172.21.15.146:0/2743602030 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0efc153e80 0x7f0efc0cee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.456+0000 7f0f0382f700 1 --2- 172.21.15.146:0/2743602030 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0efc068ba0 0x7f0efc14fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.456+0000 7f0f0382f700 1 --2- 172.21.15.146:0/2743602030 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0efc153ab0 0x7f0efc0ce950 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.456+0000 7f0f0382f700 1 -- 172.21.15.146:0/2743602030 >> 172.21.15.146:0/2743602030 conn(0x7f0efc06eba0 msgr2=0x7f0efc15c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:49.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.456+0000 7f0f0382f700 1 -- 172.21.15.146:0/2743602030 shutdown_connections 2023-10-06T11:12:49.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.456+0000 7f0f0382f700 1 -- 172.21.15.146:0/2743602030 wait complete. 2023-10-06T11:12:49.471 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T11:12:49.471 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:12:49.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.584+0000 7f8e67065700 1 Processor -- start 2023-10-06T11:12:49.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.584+0000 7f8e67065700 1 -- start start 2023-10-06T11:12:49.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.585+0000 7f8e67065700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8e601595c0 0x7f8e6015dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:49.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.585+0000 7f8e67065700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8e6015a9a0 0x7f8e600a9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:49.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.585+0000 7f8e67065700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e6015e320 con 0x7f8e600a9ad0 2023-10-06T11:12:49.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.585+0000 7f8e67065700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e600aa4b0 con 0x7f8e6015a9a0 2023-10-06T11:12:49.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.585+0000 7f8e67065700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e60068420 con 0x7f8e601595c0 2023-10-06T11:12:49.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.586+0000 7f8e65602700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8e6015a9a0 0x7f8e600a9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:49.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.586+0000 7f8e57fff700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f8e600a9ad0 0x7f8e6006e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:55550/0 (socket says 172.21.15.146:55550) 2023-10-06T11:12:49.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.586+0000 7f8e57fff700 1 -- 172.21.15.146:0/44074972 learned_addr learned my addr 172.21.15.146:0/44074972 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:12:49.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.586+0000 7f8e64e01700 1 --2- 172.21.15.146:0/44074972 >> v2:172.21.15.151:3300/0 conn(0x7f8e601595c0 0x7f8e6015dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:49.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.586+0000 7f8e65602700 1 -- 172.21.15.146:0/44074972 >> v2:172.21.15.151:3300/0 conn(0x7f8e601595c0 msgr2=0x7f8e6015dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:49.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.586+0000 7f8e65602700 1 --2- 172.21.15.146:0/44074972 >> v2:172.21.15.151:3300/0 conn(0x7f8e601595c0 0x7f8e6015dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.586+0000 7f8e65602700 1 -- 172.21.15.146:0/44074972 >> v1:172.21.15.151:6789/0 conn(0x7f8e600a9ad0 legacy=0x7f8e6006e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:49.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.586+0000 7f8e65602700 1 -- 172.21.15.146:0/44074972 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e60067810 con 0x7f8e6015a9a0 2023-10-06T11:12:49.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.586+0000 7f8e577fe700 1 -- 172.21.15.146:0/44074972 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3451340385 0 0) 0x7f8e50001110 con 0x7f8e600a9ad0 2023-10-06T11:12:49.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.586+0000 7f8e65602700 1 --2- 172.21.15.146:0/44074972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e6015a9a0 0x7f8e600a9f70 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f8e600697d0 tx=0x7f8e58009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c321a2f29e1e8a3e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:49.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.586+0000 7f8e577fe700 1 -- 172.21.15.146:0/44074972 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5800e070 con 0x7f8e6015a9a0 2023-10-06T11:12:49.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.586+0000 7f8e577fe700 1 -- 172.21.15.146:0/44074972 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e5800bb20 con 0x7f8e6015a9a0 2023-10-06T11:12:49.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.586+0000 7f8e577fe700 1 -- 172.21.15.146:0/44074972 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e58012430 con 0x7f8e6015a9a0 2023-10-06T11:12:49.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.587+0000 7f8e67065700 1 -- 172.21.15.146:0/44074972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e6015a9a0 msgr2=0x7f8e600a9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:49.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.587+0000 7f8e67065700 1 --2- 172.21.15.146:0/44074972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e6015a9a0 0x7f8e600a9f70 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f8e600697d0 tx=0x7f8e58009780 comp rx=0 tx=0).stop 2023-10-06T11:12:49.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.587+0000 7f8e67065700 1 -- 172.21.15.146:0/44074972 shutdown_connections 2023-10-06T11:12:49.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.587+0000 7f8e67065700 1 --2- 172.21.15.146:0/44074972 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e6015a9a0 0x7f8e600a9f70 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.587+0000 7f8e67065700 1 --2- 172.21.15.146:0/44074972 >> v2:172.21.15.151:3300/0 conn(0x7f8e601595c0 0x7f8e6015dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.587+0000 7f8e67065700 1 -- 172.21.15.146:0/44074972 >> 172.21.15.146:0/44074972 conn(0x7f8e600cd530 msgr2=0x7f8e60069f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:49.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.587+0000 7f8e67065700 1 -- 172.21.15.146:0/44074972 shutdown_connections 2023-10-06T11:12:49.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.587+0000 7f8e67065700 1 -- 172.21.15.146:0/44074972 wait complete. 2023-10-06T11:12:49.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.588+0000 7f8e67065700 1 Processor -- start 2023-10-06T11:12:49.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.588+0000 7f8e67065700 1 -- start start 2023-10-06T11:12:49.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.589+0000 7f8e67065700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e600a9ad0 0x7f8e600ac6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:49.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.589+0000 7f8e67065700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e601595c0 0x7f8e6015b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:49.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.589+0000 7f8e67065700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e6015a9a0 0x7f8e600b1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:49.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.589+0000 7f8e67065700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e600abc40 con 0x7f8e600a9ad0 2023-10-06T11:12:49.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.589+0000 7f8e67065700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e600b1ae0 con 0x7f8e6015a9a0 2023-10-06T11:12:49.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.589+0000 7f8e67065700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e600abee0 con 0x7f8e601595c0 2023-10-06T11:12:49.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.589+0000 7f8e64e01700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e600a9ad0 0x7f8e600ac6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:49.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.589+0000 7f8e64e01700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e600a9ad0 0x7f8e600ac6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39262/0 (socket says 172.21.15.146:39262) 2023-10-06T11:12:49.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.589+0000 7f8e64e01700 1 -- 172.21.15.146:0/1804578965 learned_addr learned my addr 172.21.15.146:0/1804578965 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:49.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.589+0000 7f8e57fff700 1 --2- 172.21.15.146:0/1804578965 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e601595c0 0x7f8e6015b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:49.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.589+0000 7f8e65602700 1 --2- 172.21.15.146:0/1804578965 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e6015a9a0 0x7f8e600b1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:49.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.589+0000 7f8e64e01700 1 -- 172.21.15.146:0/1804578965 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e601595c0 msgr2=0x7f8e6015b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:49.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.589+0000 7f8e64e01700 1 --2- 172.21.15.146:0/1804578965 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e601595c0 0x7f8e6015b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.589+0000 7f8e64e01700 1 -- 172.21.15.146:0/1804578965 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e6015a9a0 msgr2=0x7f8e600b1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:49.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.589+0000 7f8e64e01700 1 --2- 172.21.15.146:0/1804578965 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e6015a9a0 0x7f8e600b1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.589+0000 7f8e64e01700 1 -- 172.21.15.146:0/1804578965 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e58009a20 con 0x7f8e600a9ad0 2023-10-06T11:12:49.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.589+0000 7f8e64e01700 1 --2- 172.21.15.146:0/1804578965 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e600a9ad0 0x7f8e600ac6e0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c00ec80 tx=0x7f8e5c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:49.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.589+0000 7f8e54ff9700 1 -- 172.21.15.146:0/1804578965 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5c00c850 con 0x7f8e600a9ad0 2023-10-06T11:12:49.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.590+0000 7f8e54ff9700 1 -- 172.21.15.146:0/1804578965 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e5c00c9b0 con 0x7f8e600a9ad0 2023-10-06T11:12:49.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.590+0000 7f8e67065700 1 -- 172.21.15.146:0/1804578965 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e600ac1c0 con 0x7f8e600a9ad0 2023-10-06T11:12:49.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.590+0000 7f8e54ff9700 1 -- 172.21.15.146:0/1804578965 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e5c00cd50 con 0x7f8e600a9ad0 2023-10-06T11:12:49.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.590+0000 7f8e67065700 1 -- 172.21.15.146:0/1804578965 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e600af050 con 0x7f8e600a9ad0 2023-10-06T11:12:49.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.591+0000 7f8e67065700 1 -- 172.21.15.146:0/1804578965 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e600ac530 con 0x7f8e600a9ad0 2023-10-06T11:12:49.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.591+0000 7f8e54ff9700 1 -- 172.21.15.146:0/1804578965 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8e5c013680 con 0x7f8e600a9ad0 2023-10-06T11:12:49.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.591+0000 7f8e54ff9700 1 --2- 172.21.15.146:0/1804578965 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8e4c066f30 0x7f8e4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:49.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.591+0000 7f8e54ff9700 1 -- 172.21.15.146:0/1804578965 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8e5c084930 con 0x7f8e600a9ad0 2023-10-06T11:12:49.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.591+0000 7f8e57fff700 1 --2- 172.21.15.146:0/1804578965 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8e4c066f30 0x7f8e4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:49.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.592+0000 7f8e57fff700 1 --2- 172.21.15.146:0/1804578965 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8e4c066f30 0x7f8e4c0693e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f8e600cc440 tx=0x7f8e50007f50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:49.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.596+0000 7f8e54ff9700 1 -- 172.21.15.146:0/1804578965 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8e5c051a40 con 0x7f8e600a9ad0 2023-10-06T11:12:49.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.780+0000 7f8e67065700 1 -- 172.21.15.146:0/1804578965 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8e600ac350 con 0x7f8e4c066f30 2023-10-06T11:12:49.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.789+0000 7f8e54ff9700 1 -- 172.21.15.146:0/1804578965 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311305 (secure 0 0 0) 0x7f8e600ac350 con 0x7f8e4c066f30 2023-10-06T11:12:49.794 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:12:49.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.792+0000 7f8e67065700 1 -- 172.21.15.146:0/1804578965 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8e4c066f30 msgr2=0x7f8e4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:49.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.792+0000 7f8e67065700 1 --2- 172.21.15.146:0/1804578965 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8e4c066f30 0x7f8e4c0693e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f8e600cc440 tx=0x7f8e50007f50 comp rx=0 tx=0).stop 2023-10-06T11:12:49.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.792+0000 7f8e67065700 1 -- 172.21.15.146:0/1804578965 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e600a9ad0 msgr2=0x7f8e600ac6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:49.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.792+0000 7f8e67065700 1 --2- 172.21.15.146:0/1804578965 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e600a9ad0 0x7f8e600ac6e0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c00ec80 tx=0x7f8e5c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.792+0000 7f8e67065700 1 -- 172.21.15.146:0/1804578965 shutdown_connections 2023-10-06T11:12:49.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.792+0000 7f8e67065700 1 --2- 172.21.15.146:0/1804578965 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8e4c066f30 0x7f8e4c0693e0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.792+0000 7f8e67065700 1 --2- 172.21.15.146:0/1804578965 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e6015a9a0 0x7f8e600b1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.792+0000 7f8e67065700 1 --2- 172.21.15.146:0/1804578965 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e600a9ad0 0x7f8e600ac6e0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.792+0000 7f8e67065700 1 --2- 172.21.15.146:0/1804578965 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e601595c0 0x7f8e6015b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.792+0000 7f8e67065700 1 -- 172.21.15.146:0/1804578965 >> 172.21.15.146:0/1804578965 conn(0x7f8e600cd530 msgr2=0x7f8e600ca960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:49.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.792+0000 7f8e67065700 1 -- 172.21.15.146:0/1804578965 shutdown_connections 2023-10-06T11:12:49.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.792+0000 7f8e67065700 1 -- 172.21.15.146:0/1804578965 wait complete. 2023-10-06T11:12:49.798 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:12:49.806 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":298,"stamp":"2023-10-06T11:12:49.231401+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":123,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2453484,"kb_used_data":9644,"kb_used_omap":0,"kb_used_meta":2443776,"kb_avail":752521236,"statfs":{"total":773094113280,"available":770581745664,"internally_reserved":0,"allocated":9875456,"data_stored":5110203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2502426624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.512838"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.377848+0000","last_change":"2023-10-06T11:12:45.377848+0000","last_active":"2023-10-06T11:12:45.377848+0000","last_peered":"2023-10-06T11:12:45.377848+0000","last_clean":"2023-10-06T11:12:45.377848+0000","last_became_active":"2023-10-06T11:12:45.377614+0000","last_became_peered":"2023-10-06T11:12:45.377614+0000","last_unstale":"2023-10-06T11:12:45.377848+0000","last_undegraded":"2023-10-06T11:12:45.377848+0000","last_fullsized":"2023-10-06T11:12:45.377848+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:04:46.125741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.380622+0000","last_change":"2023-10-06T11:12:45.380622+0000","last_active":"2023-10-06T11:12:45.380622+0000","last_peered":"2023-10-06T11:12:45.380622+0000","last_clean":"2023-10-06T11:12:45.380622+0000","last_became_active":"2023-10-06T11:12:45.380374+0000","last_became_peered":"2023-10-06T11:12:45.380374+0000","last_unstale":"2023-10-06T11:12:45.380622+0000","last_undegraded":"2023-10-06T11:12:45.380622+0000","last_fullsized":"2023-10-06T11:12:45.380622+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:45:52.056751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.385984+0000","last_change":"2023-10-06T11:12:45.385984+0000","last_active":"2023-10-06T11:12:45.385984+0000","last_peered":"2023-10-06T11:12:45.385984+0000","last_clean":"2023-10-06T11:12:45.385984+0000","last_became_active":"2023-10-06T11:12:45.385729+0000","last_became_peered":"2023-10-06T11:12:45.385729+0000","last_unstale":"2023-10-06T11:12:45.385984+0000","last_undegraded":"2023-10-06T11:12:45.385984+0000","last_fullsized":"2023-10-06T11:12:45.385984+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:46:50.273797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.381555+0000","last_change":"2023-10-06T11:12:45.381555+0000","last_active":"2023-10-06T11:12:45.381555+0000","last_peered":"2023-10-06T11:12:45.381555+0000","last_clean":"2023-10-06T11:12:45.381555+0000","last_became_active":"2023-10-06T11:12:45.380745+0000","last_became_peered":"2023-10-06T11:12:45.380745+0000","last_unstale":"2023-10-06T11:12:45.381555+0000","last_undegraded":"2023-10-06T11:12:45.381555+0000","last_fullsized":"2023-10-06T11:12:45.381555+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:37.207729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.386326+0000","last_change":"2023-10-06T11:12:45.381689+0000","last_active":"2023-10-06T11:12:45.386326+0000","last_peered":"2023-10-06T11:12:45.386326+0000","last_clean":"2023-10-06T11:12:45.386326+0000","last_became_active":"2023-10-06T11:12:45.377464+0000","last_became_peered":"2023-10-06T11:12:45.377464+0000","last_unstale":"2023-10-06T11:12:45.386326+0000","last_undegraded":"2023-10-06T11:12:45.386326+0000","last_fullsized":"2023-10-06T11:12:45.386326+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:48.683661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.385297+0000","last_change":"2023-10-06T11:12:45.385297+0000","last_active":"2023-10-06T11:12:45.385297+0000","last_peered":"2023-10-06T11:12:45.385297+0000","last_clean":"2023-10-06T11:12:45.385297+0000","last_became_active":"2023-10-06T11:12:45.385032+0000","last_became_peered":"2023-10-06T11:12:45.385032+0000","last_unstale":"2023-10-06T11:12:45.385297+0000","last_undegraded":"2023-10-06T11:12:45.385297+0000","last_fullsized":"2023-10-06T11:12:45.385297+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:19.934668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.383296+0000","last_change":"2023-10-06T11:12:45.383296+0000","last_active":"2023-10-06T11:12:45.383296+0000","last_peered":"2023-10-06T11:12:45.383296+0000","last_clean":"2023-10-06T11:12:45.383296+0000","last_became_active":"2023-10-06T11:12:45.382133+0000","last_became_peered":"2023-10-06T11:12:45.382133+0000","last_unstale":"2023-10-06T11:12:45.383296+0000","last_undegraded":"2023-10-06T11:12:45.383296+0000","last_fullsized":"2023-10-06T11:12:45.383296+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:39:28.899272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.375832+0000","last_change":"2023-10-06T11:12:45.375832+0000","last_active":"2023-10-06T11:12:45.375832+0000","last_peered":"2023-10-06T11:12:45.375832+0000","last_clean":"2023-10-06T11:12:45.375832+0000","last_became_active":"2023-10-06T11:12:45.375591+0000","last_became_peered":"2023-10-06T11:12:45.375591+0000","last_unstale":"2023-10-06T11:12:45.375832+0000","last_undegraded":"2023-10-06T11:12:45.375832+0000","last_fullsized":"2023-10-06T11:12:45.375832+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:22.534233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.377844+0000","last_change":"2023-10-06T11:12:45.375092+0000","last_active":"2023-10-06T11:12:45.377844+0000","last_peered":"2023-10-06T11:12:45.377844+0000","last_clean":"2023-10-06T11:12:45.377844+0000","last_became_active":"2023-10-06T11:12:45.374842+0000","last_became_peered":"2023-10-06T11:12:45.374842+0000","last_unstale":"2023-10-06T11:12:45.377844+0000","last_undegraded":"2023-10-06T11:12:45.377844+0000","last_fullsized":"2023-10-06T11:12:45.377844+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:11:29.654911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.377530+0000","last_change":"2023-10-06T11:12:45.377530+0000","last_active":"2023-10-06T11:12:45.377530+0000","last_peered":"2023-10-06T11:12:45.377530+0000","last_clean":"2023-10-06T11:12:45.377530+0000","last_became_active":"2023-10-06T11:12:45.377282+0000","last_became_peered":"2023-10-06T11:12:45.377282+0000","last_unstale":"2023-10-06T11:12:45.377530+0000","last_undegraded":"2023-10-06T11:12:45.377530+0000","last_fullsized":"2023-10-06T11:12:45.377530+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:28:29.062081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.385267+0000","last_change":"2023-10-06T11:12:45.378090+0000","last_active":"2023-10-06T11:12:45.385267+0000","last_peered":"2023-10-06T11:12:45.385267+0000","last_clean":"2023-10-06T11:12:45.385267+0000","last_became_active":"2023-10-06T11:12:45.377510+0000","last_became_peered":"2023-10-06T11:12:45.377510+0000","last_unstale":"2023-10-06T11:12:45.385267+0000","last_undegraded":"2023-10-06T11:12:45.385267+0000","last_fullsized":"2023-10-06T11:12:45.385267+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:46:50.273797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.379974+0000","last_change":"2023-10-06T11:12:45.379974+0000","last_active":"2023-10-06T11:12:45.379974+0000","last_peered":"2023-10-06T11:12:45.379974+0000","last_clean":"2023-10-06T11:12:45.379974+0000","last_became_active":"2023-10-06T11:12:45.379659+0000","last_became_peered":"2023-10-06T11:12:45.379659+0000","last_unstale":"2023-10-06T11:12:45.379974+0000","last_undegraded":"2023-10-06T11:12:45.379974+0000","last_fullsized":"2023-10-06T11:12:45.379974+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:10:08.631431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.381451+0000","last_change":"2023-10-06T11:12:45.381451+0000","last_active":"2023-10-06T11:12:45.381451+0000","last_peered":"2023-10-06T11:12:45.381451+0000","last_clean":"2023-10-06T11:12:45.381451+0000","last_became_active":"2023-10-06T11:12:45.381205+0000","last_became_peered":"2023-10-06T11:12:45.381205+0000","last_unstale":"2023-10-06T11:12:45.381451+0000","last_undegraded":"2023-10-06T11:12:45.381451+0000","last_fullsized":"2023-10-06T11:12:45.381451+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:56:27.029252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.388476+0000","last_change":"2023-10-06T11:12:45.385695+0000","last_active":"2023-10-06T11:12:45.388476+0000","last_peered":"2023-10-06T11:12:45.388476+0000","last_clean":"2023-10-06T11:12:45.388476+0000","last_became_active":"2023-10-06T11:12:45.385402+0000","last_became_peered":"2023-10-06T11:12:45.385402+0000","last_unstale":"2023-10-06T11:12:45.388476+0000","last_undegraded":"2023-10-06T11:12:45.388476+0000","last_fullsized":"2023-10-06T11:12:45.388476+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:14:54.145361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.381323+0000","last_change":"2023-10-06T11:12:45.381323+0000","last_active":"2023-10-06T11:12:45.381323+0000","last_peered":"2023-10-06T11:12:45.381323+0000","last_clean":"2023-10-06T11:12:45.381323+0000","last_became_active":"2023-10-06T11:12:45.381075+0000","last_became_peered":"2023-10-06T11:12:45.381075+0000","last_unstale":"2023-10-06T11:12:45.381323+0000","last_undegraded":"2023-10-06T11:12:45.381323+0000","last_fullsized":"2023-10-06T11:12:45.381323+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:11:23.644136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.383413+0000","last_change":"2023-10-06T11:12:45.383413+0000","last_active":"2023-10-06T11:12:45.383413+0000","last_peered":"2023-10-06T11:12:45.383413+0000","last_clean":"2023-10-06T11:12:45.383413+0000","last_became_active":"2023-10-06T11:12:45.383095+0000","last_became_peered":"2023-10-06T11:12:45.383095+0000","last_unstale":"2023-10-06T11:12:45.383413+0000","last_undegraded":"2023-10-06T11:12:45.383413+0000","last_fullsized":"2023-10-06T11:12:45.383413+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:01:04.116199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.383366+0000","last_change":"2023-10-06T11:12:45.383366+0000","last_active":"2023-10-06T11:12:45.383366+0000","last_peered":"2023-10-06T11:12:45.383366+0000","last_clean":"2023-10-06T11:12:45.383366+0000","last_became_active":"2023-10-06T11:12:45.383060+0000","last_became_peered":"2023-10-06T11:12:45.383060+0000","last_unstale":"2023-10-06T11:12:45.383366+0000","last_undegraded":"2023-10-06T11:12:45.383366+0000","last_fullsized":"2023-10-06T11:12:45.383366+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:46:11.259163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.378325+0000","last_change":"2023-10-06T11:12:45.378325+0000","last_active":"2023-10-06T11:12:45.378325+0000","last_peered":"2023-10-06T11:12:45.378325+0000","last_clean":"2023-10-06T11:12:45.378325+0000","last_became_active":"2023-10-06T11:12:45.377934+0000","last_became_peered":"2023-10-06T11:12:45.377934+0000","last_unstale":"2023-10-06T11:12:45.378325+0000","last_undegraded":"2023-10-06T11:12:45.378325+0000","last_fullsized":"2023-10-06T11:12:45.378325+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:02:00.906976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.386583+0000","last_change":"2023-10-06T11:12:45.382339+0000","last_active":"2023-10-06T11:12:45.386583+0000","last_peered":"2023-10-06T11:12:45.386583+0000","last_clean":"2023-10-06T11:12:45.386583+0000","last_became_active":"2023-10-06T11:12:45.382083+0000","last_became_peered":"2023-10-06T11:12:45.382083+0000","last_unstale":"2023-10-06T11:12:45.386583+0000","last_undegraded":"2023-10-06T11:12:45.386583+0000","last_fullsized":"2023-10-06T11:12:45.386583+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:45:52.056751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.382560+0000","last_change":"2023-10-06T11:12:45.382560+0000","last_active":"2023-10-06T11:12:45.382560+0000","last_peered":"2023-10-06T11:12:45.382560+0000","last_clean":"2023-10-06T11:12:45.382560+0000","last_became_active":"2023-10-06T11:12:45.382317+0000","last_became_peered":"2023-10-06T11:12:45.382317+0000","last_unstale":"2023-10-06T11:12:45.382560+0000","last_undegraded":"2023-10-06T11:12:45.382560+0000","last_fullsized":"2023-10-06T11:12:45.382560+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:05:53.556819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.381528+0000","last_change":"2023-10-06T11:12:45.377462+0000","last_active":"2023-10-06T11:12:45.381528+0000","last_peered":"2023-10-06T11:12:45.381528+0000","last_clean":"2023-10-06T11:12:45.381528+0000","last_became_active":"2023-10-06T11:12:45.377089+0000","last_became_peered":"2023-10-06T11:12:45.377089+0000","last_unstale":"2023-10-06T11:12:45.381528+0000","last_undegraded":"2023-10-06T11:12:45.381528+0000","last_fullsized":"2023-10-06T11:12:45.381528+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:47:57.211917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.388455+0000","last_change":"2023-10-06T11:12:45.385690+0000","last_active":"2023-10-06T11:12:45.388455+0000","last_peered":"2023-10-06T11:12:45.388455+0000","last_clean":"2023-10-06T11:12:45.388455+0000","last_became_active":"2023-10-06T11:12:45.383404+0000","last_became_peered":"2023-10-06T11:12:45.383404+0000","last_unstale":"2023-10-06T11:12:45.388455+0000","last_undegraded":"2023-10-06T11:12:45.388455+0000","last_fullsized":"2023-10-06T11:12:45.388455+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:56:32.853044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.382461+0000","last_change":"2023-10-06T11:12:45.382461+0000","last_active":"2023-10-06T11:12:45.382461+0000","last_peered":"2023-10-06T11:12:45.382461+0000","last_clean":"2023-10-06T11:12:45.382461+0000","last_became_active":"2023-10-06T11:12:45.382213+0000","last_became_peered":"2023-10-06T11:12:45.382213+0000","last_unstale":"2023-10-06T11:12:45.382461+0000","last_undegraded":"2023-10-06T11:12:45.382461+0000","last_fullsized":"2023-10-06T11:12:45.382461+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:12:33.461559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.379772+0000","last_change":"2023-10-06T11:12:45.379772+0000","last_active":"2023-10-06T11:12:45.379772+0000","last_peered":"2023-10-06T11:12:45.379772+0000","last_clean":"2023-10-06T11:12:45.379772+0000","last_became_active":"2023-10-06T11:12:45.379526+0000","last_became_peered":"2023-10-06T11:12:45.379526+0000","last_unstale":"2023-10-06T11:12:45.379772+0000","last_undegraded":"2023-10-06T11:12:45.379772+0000","last_fullsized":"2023-10-06T11:12:45.379772+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:14:54.145361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.377159+0000","last_change":"2023-10-06T11:12:45.377159+0000","last_active":"2023-10-06T11:12:45.377159+0000","last_peered":"2023-10-06T11:12:45.377159+0000","last_clean":"2023-10-06T11:12:45.377159+0000","last_became_active":"2023-10-06T11:12:45.376907+0000","last_became_peered":"2023-10-06T11:12:45.376907+0000","last_unstale":"2023-10-06T11:12:45.377159+0000","last_undegraded":"2023-10-06T11:12:45.377159+0000","last_fullsized":"2023-10-06T11:12:45.377159+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:47:57.211917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.385162+0000","last_change":"2023-10-06T11:12:45.378975+0000","last_active":"2023-10-06T11:12:45.385162+0000","last_peered":"2023-10-06T11:12:45.385162+0000","last_clean":"2023-10-06T11:12:45.385162+0000","last_became_active":"2023-10-06T11:12:45.378560+0000","last_became_peered":"2023-10-06T11:12:45.378560+0000","last_unstale":"2023-10-06T11:12:45.385162+0000","last_undegraded":"2023-10-06T11:12:45.385162+0000","last_fullsized":"2023-10-06T11:12:45.385162+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:10.554975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.377422+0000","last_change":"2023-10-06T11:12:45.377422+0000","last_active":"2023-10-06T11:12:45.377422+0000","last_peered":"2023-10-06T11:12:45.377422+0000","last_clean":"2023-10-06T11:12:45.377422+0000","last_became_active":"2023-10-06T11:12:45.377167+0000","last_became_peered":"2023-10-06T11:12:45.377167+0000","last_unstale":"2023-10-06T11:12:45.377422+0000","last_undegraded":"2023-10-06T11:12:45.377422+0000","last_fullsized":"2023-10-06T11:12:45.377422+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:48:24.389420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.379815+0000","last_change":"2023-10-06T11:12:45.379815+0000","last_active":"2023-10-06T11:12:45.379815+0000","last_peered":"2023-10-06T11:12:45.379815+0000","last_clean":"2023-10-06T11:12:45.379815+0000","last_became_active":"2023-10-06T11:12:45.379560+0000","last_became_peered":"2023-10-06T11:12:45.379560+0000","last_unstale":"2023-10-06T11:12:45.379815+0000","last_undegraded":"2023-10-06T11:12:45.379815+0000","last_fullsized":"2023-10-06T11:12:45.379815+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:29:15.753583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.377697+0000","last_change":"2023-10-06T11:12:45.377697+0000","last_active":"2023-10-06T11:12:45.377697+0000","last_peered":"2023-10-06T11:12:45.377697+0000","last_clean":"2023-10-06T11:12:45.377697+0000","last_became_active":"2023-10-06T11:12:45.377383+0000","last_became_peered":"2023-10-06T11:12:45.377383+0000","last_unstale":"2023-10-06T11:12:45.377697+0000","last_undegraded":"2023-10-06T11:12:45.377697+0000","last_fullsized":"2023-10-06T11:12:45.377697+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:48:59.706211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.386389+0000","last_change":"2023-10-06T11:12:45.383086+0000","last_active":"2023-10-06T11:12:45.386389+0000","last_peered":"2023-10-06T11:12:45.386389+0000","last_clean":"2023-10-06T11:12:45.386389+0000","last_became_active":"2023-10-06T11:12:45.382821+0000","last_became_peered":"2023-10-06T11:12:45.382821+0000","last_unstale":"2023-10-06T11:12:45.386389+0000","last_undegraded":"2023-10-06T11:12:45.386389+0000","last_fullsized":"2023-10-06T11:12:45.386389+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:07:12.170597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.382439+0000","last_change":"2023-10-06T11:12:45.382439+0000","last_active":"2023-10-06T11:12:45.382439+0000","last_peered":"2023-10-06T11:12:45.382439+0000","last_clean":"2023-10-06T11:12:45.382439+0000","last_became_active":"2023-10-06T11:12:45.382155+0000","last_became_peered":"2023-10-06T11:12:45.382155+0000","last_unstale":"2023-10-06T11:12:45.382439+0000","last_undegraded":"2023-10-06T11:12:45.382439+0000","last_fullsized":"2023-10-06T11:12:45.382439+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:48.683661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.384294+0000","last_change":"2023-10-06T11:12:45.384294+0000","last_active":"2023-10-06T11:12:45.384294+0000","last_peered":"2023-10-06T11:12:45.384294+0000","last_clean":"2023-10-06T11:12:45.384294+0000","last_became_active":"2023-10-06T11:12:45.383937+0000","last_became_peered":"2023-10-06T11:12:45.383937+0000","last_unstale":"2023-10-06T11:12:45.384294+0000","last_undegraded":"2023-10-06T11:12:45.384294+0000","last_fullsized":"2023-10-06T11:12:45.384294+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:26:31.889624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.378377+0000","last_change":"2023-10-06T11:12:45.378377+0000","last_active":"2023-10-06T11:12:45.378377+0000","last_peered":"2023-10-06T11:12:45.378377+0000","last_clean":"2023-10-06T11:12:45.378377+0000","last_became_active":"2023-10-06T11:12:45.377831+0000","last_became_peered":"2023-10-06T11:12:45.377831+0000","last_unstale":"2023-10-06T11:12:45.378377+0000","last_undegraded":"2023-10-06T11:12:45.378377+0000","last_fullsized":"2023-10-06T11:12:45.378377+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:52.984415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"88'4","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.744709+0000","last_change":"2023-10-06T11:12:44.739280+0000","last_active":"2023-10-06T11:12:45.744709+0000","last_peered":"2023-10-06T11:12:45.744709+0000","last_clean":"2023-10-06T11:12:45.744709+0000","last_became_active":"2023-10-06T11:12:44.738957+0000","last_became_peered":"2023-10-06T11:12:44.738957+0000","last_unstale":"2023-10-06T11:12:45.744709+0000","last_undegraded":"2023-10-06T11:12:45.744709+0000","last_fullsized":"2023-10-06T11:12:45.744709+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:42:29.457021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.375016+0000","last_change":"2023-10-06T11:12:45.375016+0000","last_active":"2023-10-06T11:12:45.375016+0000","last_peered":"2023-10-06T11:12:45.375016+0000","last_clean":"2023-10-06T11:12:45.375016+0000","last_became_active":"2023-10-06T11:12:45.374774+0000","last_became_peered":"2023-10-06T11:12:45.374774+0000","last_unstale":"2023-10-06T11:12:45.375016+0000","last_undegraded":"2023-10-06T11:12:45.375016+0000","last_fullsized":"2023-10-06T11:12:45.375016+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:15:36.822637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"88'1","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.745736+0000","last_change":"2023-10-06T11:12:44.734452+0000","last_active":"2023-10-06T11:12:45.745736+0000","last_peered":"2023-10-06T11:12:45.745736+0000","last_clean":"2023-10-06T11:12:45.745736+0000","last_became_active":"2023-10-06T11:12:44.733832+0000","last_became_peered":"2023-10-06T11:12:44.733832+0000","last_unstale":"2023-10-06T11:12:45.745736+0000","last_undegraded":"2023-10-06T11:12:45.745736+0000","last_fullsized":"2023-10-06T11:12:45.745736+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:30:39.564524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.382913+0000","last_change":"2023-10-06T11:12:45.382913+0000","last_active":"2023-10-06T11:12:45.382913+0000","last_peered":"2023-10-06T11:12:45.382913+0000","last_clean":"2023-10-06T11:12:45.382913+0000","last_became_active":"2023-10-06T11:12:45.382454+0000","last_became_peered":"2023-10-06T11:12:45.382454+0000","last_unstale":"2023-10-06T11:12:45.382913+0000","last_undegraded":"2023-10-06T11:12:45.382913+0000","last_fullsized":"2023-10-06T11:12:45.382913+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:28:30.436158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"88'2","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.742998+0000","last_change":"2023-10-06T11:12:44.736394+0000","last_active":"2023-10-06T11:12:45.742998+0000","last_peered":"2023-10-06T11:12:45.742998+0000","last_clean":"2023-10-06T11:12:45.742998+0000","last_became_active":"2023-10-06T11:12:44.736081+0000","last_became_peered":"2023-10-06T11:12:44.736081+0000","last_unstale":"2023-10-06T11:12:45.742998+0000","last_undegraded":"2023-10-06T11:12:45.742998+0000","last_fullsized":"2023-10-06T11:12:45.742998+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:45:51.051570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.379131+0000","last_change":"2023-10-06T11:12:45.379131+0000","last_active":"2023-10-06T11:12:45.379131+0000","last_peered":"2023-10-06T11:12:45.379131+0000","last_clean":"2023-10-06T11:12:45.379131+0000","last_became_active":"2023-10-06T11:12:45.378811+0000","last_became_peered":"2023-10-06T11:12:45.378811+0000","last_unstale":"2023-10-06T11:12:45.379131+0000","last_undegraded":"2023-10-06T11:12:45.379131+0000","last_fullsized":"2023-10-06T11:12:45.379131+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:38:12.667163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"88'2","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.742363+0000","last_change":"2023-10-06T11:12:44.740727+0000","last_active":"2023-10-06T11:12:45.742363+0000","last_peered":"2023-10-06T11:12:45.742363+0000","last_clean":"2023-10-06T11:12:45.742363+0000","last_became_active":"2023-10-06T11:12:44.740413+0000","last_became_peered":"2023-10-06T11:12:44.740413+0000","last_unstale":"2023-10-06T11:12:45.742363+0000","last_undegraded":"2023-10-06T11:12:45.742363+0000","last_fullsized":"2023-10-06T11:12:45.742363+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:13:41.742831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.382628+0000","last_change":"2023-10-06T11:12:45.382628+0000","last_active":"2023-10-06T11:12:45.382628+0000","last_peered":"2023-10-06T11:12:45.382628+0000","last_clean":"2023-10-06T11:12:45.382628+0000","last_became_active":"2023-10-06T11:12:45.381778+0000","last_became_peered":"2023-10-06T11:12:45.381778+0000","last_unstale":"2023-10-06T11:12:45.382628+0000","last_undegraded":"2023-10-06T11:12:45.382628+0000","last_fullsized":"2023-10-06T11:12:45.382628+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:05:08.579361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"88'1","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.744093+0000","last_change":"2023-10-06T11:12:44.736388+0000","last_active":"2023-10-06T11:12:45.744093+0000","last_peered":"2023-10-06T11:12:45.744093+0000","last_clean":"2023-10-06T11:12:45.744093+0000","last_became_active":"2023-10-06T11:12:44.736036+0000","last_became_peered":"2023-10-06T11:12:44.736036+0000","last_unstale":"2023-10-06T11:12:45.744093+0000","last_undegraded":"2023-10-06T11:12:45.744093+0000","last_fullsized":"2023-10-06T11:12:45.744093+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:44:37.185822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.379409+0000","last_change":"2023-10-06T11:12:45.379409+0000","last_active":"2023-10-06T11:12:45.379409+0000","last_peered":"2023-10-06T11:12:45.379409+0000","last_clean":"2023-10-06T11:12:45.379409+0000","last_became_active":"2023-10-06T11:12:45.379148+0000","last_became_peered":"2023-10-06T11:12:45.379148+0000","last_unstale":"2023-10-06T11:12:45.379409+0000","last_undegraded":"2023-10-06T11:12:45.379409+0000","last_fullsized":"2023-10-06T11:12:45.379409+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:42:12.213748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"88'1","reported_seq":10,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.373306+0000","last_change":"2023-10-06T11:12:44.738685+0000","last_active":"2023-10-06T11:12:45.373306+0000","last_peered":"2023-10-06T11:12:45.373306+0000","last_clean":"2023-10-06T11:12:45.373306+0000","last_became_active":"2023-10-06T11:12:44.738435+0000","last_became_peered":"2023-10-06T11:12:44.738435+0000","last_unstale":"2023-10-06T11:12:45.373306+0000","last_undegraded":"2023-10-06T11:12:45.373306+0000","last_fullsized":"2023-10-06T11:12:45.373306+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:02:00.915456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.376428+0000","last_change":"2023-10-06T11:12:45.376428+0000","last_active":"2023-10-06T11:12:45.376428+0000","last_peered":"2023-10-06T11:12:45.376428+0000","last_clean":"2023-10-06T11:12:45.376428+0000","last_became_active":"2023-10-06T11:12:45.376179+0000","last_became_peered":"2023-10-06T11:12:45.376179+0000","last_unstale":"2023-10-06T11:12:45.376428+0000","last_undegraded":"2023-10-06T11:12:45.376428+0000","last_fullsized":"2023-10-06T11:12:45.376428+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:17:38.250270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.732125+0000","last_change":"2023-10-06T11:12:44.729546+0000","last_active":"2023-10-06T11:12:44.732125+0000","last_peered":"2023-10-06T11:12:44.732125+0000","last_clean":"2023-10-06T11:12:44.732125+0000","last_became_active":"2023-10-06T11:12:44.729279+0000","last_became_peered":"2023-10-06T11:12:44.729279+0000","last_unstale":"2023-10-06T11:12:44.732125+0000","last_undegraded":"2023-10-06T11:12:44.732125+0000","last_fullsized":"2023-10-06T11:12:44.732125+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:39.003841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.378910+0000","last_change":"2023-10-06T11:12:45.378910+0000","last_active":"2023-10-06T11:12:45.378910+0000","last_peered":"2023-10-06T11:12:45.378910+0000","last_clean":"2023-10-06T11:12:45.378910+0000","last_became_active":"2023-10-06T11:12:45.378657+0000","last_became_peered":"2023-10-06T11:12:45.378657+0000","last_unstale":"2023-10-06T11:12:45.378910+0000","last_undegraded":"2023-10-06T11:12:45.378910+0000","last_fullsized":"2023-10-06T11:12:45.378910+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:15:20.939018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.740268+0000","last_change":"2023-10-06T11:12:44.738125+0000","last_active":"2023-10-06T11:12:44.740268+0000","last_peered":"2023-10-06T11:12:44.740268+0000","last_clean":"2023-10-06T11:12:44.740268+0000","last_became_active":"2023-10-06T11:12:44.737864+0000","last_became_peered":"2023-10-06T11:12:44.737864+0000","last_unstale":"2023-10-06T11:12:44.740268+0000","last_undegraded":"2023-10-06T11:12:44.740268+0000","last_fullsized":"2023-10-06T11:12:44.740268+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:09.549794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.386333+0000","last_change":"2023-10-06T11:12:45.381777+0000","last_active":"2023-10-06T11:12:45.386333+0000","last_peered":"2023-10-06T11:12:45.386333+0000","last_clean":"2023-10-06T11:12:45.386333+0000","last_became_active":"2023-10-06T11:12:45.381432+0000","last_became_peered":"2023-10-06T11:12:45.381432+0000","last_unstale":"2023-10-06T11:12:45.386333+0000","last_undegraded":"2023-10-06T11:12:45.386333+0000","last_fullsized":"2023-10-06T11:12:45.386333+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:30:07.433714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.742972+0000","last_change":"2023-10-06T11:12:44.738793+0000","last_active":"2023-10-06T11:12:44.742972+0000","last_peered":"2023-10-06T11:12:44.742972+0000","last_clean":"2023-10-06T11:12:44.742972+0000","last_became_active":"2023-10-06T11:12:44.738516+0000","last_became_peered":"2023-10-06T11:12:44.738516+0000","last_unstale":"2023-10-06T11:12:44.742972+0000","last_undegraded":"2023-10-06T11:12:44.742972+0000","last_fullsized":"2023-10-06T11:12:44.742972+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:15:30.633176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.380567+0000","last_change":"2023-10-06T11:12:45.380567+0000","last_active":"2023-10-06T11:12:45.380567+0000","last_peered":"2023-10-06T11:12:45.380567+0000","last_clean":"2023-10-06T11:12:45.380567+0000","last_became_active":"2023-10-06T11:12:45.380301+0000","last_became_peered":"2023-10-06T11:12:45.380301+0000","last_unstale":"2023-10-06T11:12:45.380567+0000","last_undegraded":"2023-10-06T11:12:45.380567+0000","last_fullsized":"2023-10-06T11:12:45.380567+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:34:13.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.732036+0000","last_change":"2023-10-06T11:12:44.728003+0000","last_active":"2023-10-06T11:12:44.732036+0000","last_peered":"2023-10-06T11:12:44.732036+0000","last_clean":"2023-10-06T11:12:44.732036+0000","last_became_active":"2023-10-06T11:12:44.727699+0000","last_became_peered":"2023-10-06T11:12:44.727699+0000","last_unstale":"2023-10-06T11:12:44.732036+0000","last_undegraded":"2023-10-06T11:12:44.732036+0000","last_fullsized":"2023-10-06T11:12:44.732036+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:05.307130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.378171+0000","last_change":"2023-10-06T11:12:45.378171+0000","last_active":"2023-10-06T11:12:45.378171+0000","last_peered":"2023-10-06T11:12:45.378171+0000","last_clean":"2023-10-06T11:12:45.378171+0000","last_became_active":"2023-10-06T11:12:45.377655+0000","last_became_peered":"2023-10-06T11:12:45.377655+0000","last_unstale":"2023-10-06T11:12:45.378171+0000","last_undegraded":"2023-10-06T11:12:45.378171+0000","last_fullsized":"2023-10-06T11:12:45.378171+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:30:07.433714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"88'3","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.744610+0000","last_change":"2023-10-06T11:12:44.741108+0000","last_active":"2023-10-06T11:12:45.744610+0000","last_peered":"2023-10-06T11:12:45.744610+0000","last_clean":"2023-10-06T11:12:45.744610+0000","last_became_active":"2023-10-06T11:12:44.740832+0000","last_became_peered":"2023-10-06T11:12:44.740832+0000","last_unstale":"2023-10-06T11:12:45.744610+0000","last_undegraded":"2023-10-06T11:12:45.744610+0000","last_fullsized":"2023-10-06T11:12:45.744610+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:01:45.249446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.379037+0000","last_change":"2023-10-06T11:12:45.379037+0000","last_active":"2023-10-06T11:12:45.379037+0000","last_peered":"2023-10-06T11:12:45.379037+0000","last_clean":"2023-10-06T11:12:45.379037+0000","last_became_active":"2023-10-06T11:12:45.378315+0000","last_became_peered":"2023-10-06T11:12:45.378315+0000","last_unstale":"2023-10-06T11:12:45.379037+0000","last_undegraded":"2023-10-06T11:12:45.379037+0000","last_fullsized":"2023-10-06T11:12:45.379037+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:59:54.773197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"88'6","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.753621+0000","last_change":"2023-10-06T11:12:44.737242+0000","last_active":"2023-10-06T11:12:45.753621+0000","last_peered":"2023-10-06T11:12:45.753621+0000","last_clean":"2023-10-06T11:12:45.753621+0000","last_became_active":"2023-10-06T11:12:44.736966+0000","last_became_peered":"2023-10-06T11:12:44.736966+0000","last_unstale":"2023-10-06T11:12:45.753621+0000","last_undegraded":"2023-10-06T11:12:45.753621+0000","last_fullsized":"2023-10-06T11:12:45.753621+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:28:29.430977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.380314+0000","last_change":"2023-10-06T11:12:45.380314+0000","last_active":"2023-10-06T11:12:45.380314+0000","last_peered":"2023-10-06T11:12:45.380314+0000","last_clean":"2023-10-06T11:12:45.380314+0000","last_became_active":"2023-10-06T11:12:45.380038+0000","last_became_peered":"2023-10-06T11:12:45.380038+0000","last_unstale":"2023-10-06T11:12:45.380314+0000","last_undegraded":"2023-10-06T11:12:45.380314+0000","last_fullsized":"2023-10-06T11:12:45.380314+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:12:33.461559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"88'2","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.743545+0000","last_change":"2023-10-06T11:12:44.731147+0000","last_active":"2023-10-06T11:12:45.743545+0000","last_peered":"2023-10-06T11:12:45.743545+0000","last_clean":"2023-10-06T11:12:45.743545+0000","last_became_active":"2023-10-06T11:12:44.730881+0000","last_became_peered":"2023-10-06T11:12:44.730881+0000","last_unstale":"2023-10-06T11:12:45.743545+0000","last_undegraded":"2023-10-06T11:12:45.743545+0000","last_fullsized":"2023-10-06T11:12:45.743545+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:12:39.760000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.381823+0000","last_change":"2023-10-06T11:12:45.378411+0000","last_active":"2023-10-06T11:12:45.381823+0000","last_peered":"2023-10-06T11:12:45.381823+0000","last_clean":"2023-10-06T11:12:45.381823+0000","last_became_active":"2023-10-06T11:12:45.378098+0000","last_became_peered":"2023-10-06T11:12:45.378098+0000","last_unstale":"2023-10-06T11:12:45.381823+0000","last_undegraded":"2023-10-06T11:12:45.381823+0000","last_fullsized":"2023-10-06T11:12:45.381823+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:12:40.765180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.740373+0000","last_change":"2023-10-06T11:12:44.738068+0000","last_active":"2023-10-06T11:12:44.740373+0000","last_peered":"2023-10-06T11:12:44.740373+0000","last_clean":"2023-10-06T11:12:44.740373+0000","last_became_active":"2023-10-06T11:12:44.737796+0000","last_became_peered":"2023-10-06T11:12:44.737796+0000","last_unstale":"2023-10-06T11:12:44.740373+0000","last_undegraded":"2023-10-06T11:12:44.740373+0000","last_fullsized":"2023-10-06T11:12:44.740373+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:34:12.616568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.379937+0000","last_change":"2023-10-06T11:12:45.379937+0000","last_active":"2023-10-06T11:12:45.379937+0000","last_peered":"2023-10-06T11:12:45.379937+0000","last_clean":"2023-10-06T11:12:45.379937+0000","last_became_active":"2023-10-06T11:12:45.379691+0000","last_became_peered":"2023-10-06T11:12:45.379691+0000","last_unstale":"2023-10-06T11:12:45.379937+0000","last_undegraded":"2023-10-06T11:12:45.379937+0000","last_fullsized":"2023-10-06T11:12:45.379937+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:55:28.236941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.739891+0000","last_change":"2023-10-06T11:12:44.734216+0000","last_active":"2023-10-06T11:12:44.739891+0000","last_peered":"2023-10-06T11:12:44.739891+0000","last_clean":"2023-10-06T11:12:44.739891+0000","last_became_active":"2023-10-06T11:12:44.733807+0000","last_became_peered":"2023-10-06T11:12:44.733807+0000","last_unstale":"2023-10-06T11:12:44.739891+0000","last_undegraded":"2023-10-06T11:12:44.739891+0000","last_fullsized":"2023-10-06T11:12:44.739891+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:40.339470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.374872+0000","last_change":"2023-10-06T11:12:45.374872+0000","last_active":"2023-10-06T11:12:45.374872+0000","last_peered":"2023-10-06T11:12:45.374872+0000","last_clean":"2023-10-06T11:12:45.374872+0000","last_became_active":"2023-10-06T11:12:45.374083+0000","last_became_peered":"2023-10-06T11:12:45.374083+0000","last_unstale":"2023-10-06T11:12:45.374872+0000","last_undegraded":"2023-10-06T11:12:45.374872+0000","last_fullsized":"2023-10-06T11:12:45.374872+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:18:21.205299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"88'8","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.746689+0000","last_change":"2023-10-06T11:12:44.735803+0000","last_active":"2023-10-06T11:12:45.746689+0000","last_peered":"2023-10-06T11:12:45.746689+0000","last_clean":"2023-10-06T11:12:45.746689+0000","last_became_active":"2023-10-06T11:12:44.735553+0000","last_became_peered":"2023-10-06T11:12:44.735553+0000","last_unstale":"2023-10-06T11:12:45.746689+0000","last_undegraded":"2023-10-06T11:12:45.746689+0000","last_fullsized":"2023-10-06T11:12:45.746689+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:49:21.414511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.381015+0000","last_change":"2023-10-06T11:12:45.381015+0000","last_active":"2023-10-06T11:12:45.381015+0000","last_peered":"2023-10-06T11:12:45.381015+0000","last_clean":"2023-10-06T11:12:45.381015+0000","last_became_active":"2023-10-06T11:12:45.380767+0000","last_became_peered":"2023-10-06T11:12:45.380767+0000","last_unstale":"2023-10-06T11:12:45.381015+0000","last_undegraded":"2023-10-06T11:12:45.381015+0000","last_fullsized":"2023-10-06T11:12:45.381015+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:30:40.569704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"88'2","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.745802+0000","last_change":"2023-10-06T11:12:44.736093+0000","last_active":"2023-10-06T11:12:45.745802+0000","last_peered":"2023-10-06T11:12:45.745802+0000","last_clean":"2023-10-06T11:12:45.745802+0000","last_became_active":"2023-10-06T11:12:44.735796+0000","last_became_peered":"2023-10-06T11:12:44.735796+0000","last_unstale":"2023-10-06T11:12:45.745802+0000","last_undegraded":"2023-10-06T11:12:45.745802+0000","last_fullsized":"2023-10-06T11:12:45.745802+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:07:11.165416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.383924+0000","last_change":"2023-10-06T11:12:45.383924+0000","last_active":"2023-10-06T11:12:45.383924+0000","last_peered":"2023-10-06T11:12:45.383924+0000","last_clean":"2023-10-06T11:12:45.383924+0000","last_became_active":"2023-10-06T11:12:45.383627+0000","last_became_peered":"2023-10-06T11:12:45.383627+0000","last_unstale":"2023-10-06T11:12:45.383924+0000","last_undegraded":"2023-10-06T11:12:45.383924+0000","last_fullsized":"2023-10-06T11:12:45.383924+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:33:25.569877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.371668+0000","last_change":"2023-10-06T11:12:44.735018+0000","last_active":"2023-10-06T11:12:45.371668+0000","last_peered":"2023-10-06T11:12:45.371668+0000","last_clean":"2023-10-06T11:12:45.371668+0000","last_became_active":"2023-10-06T11:12:44.734733+0000","last_became_peered":"2023-10-06T11:12:44.734733+0000","last_unstale":"2023-10-06T11:12:45.371668+0000","last_undegraded":"2023-10-06T11:12:45.371668+0000","last_fullsized":"2023-10-06T11:12:45.371668+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:42:11.208568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.375762+0000","last_change":"2023-10-06T11:12:45.375762+0000","last_active":"2023-10-06T11:12:45.375762+0000","last_peered":"2023-10-06T11:12:45.375762+0000","last_clean":"2023-10-06T11:12:45.375762+0000","last_became_active":"2023-10-06T11:12:45.375528+0000","last_became_peered":"2023-10-06T11:12:45.375528+0000","last_unstale":"2023-10-06T11:12:45.375762+0000","last_undegraded":"2023-10-06T11:12:45.375762+0000","last_fullsized":"2023-10-06T11:12:45.375762+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:12:05.703126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.371606+0000","last_change":"2023-10-06T11:12:44.734661+0000","last_active":"2023-10-06T11:12:45.371606+0000","last_peered":"2023-10-06T11:12:45.371606+0000","last_clean":"2023-10-06T11:12:45.371606+0000","last_became_active":"2023-10-06T11:12:44.734382+0000","last_became_peered":"2023-10-06T11:12:44.734382+0000","last_unstale":"2023-10-06T11:12:45.371606+0000","last_undegraded":"2023-10-06T11:12:45.371606+0000","last_fullsized":"2023-10-06T11:12:45.371606+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:12:32.456378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.375964+0000","last_change":"2023-10-06T11:12:45.375964+0000","last_active":"2023-10-06T11:12:45.375964+0000","last_peered":"2023-10-06T11:12:45.375964+0000","last_clean":"2023-10-06T11:12:45.375964+0000","last_became_active":"2023-10-06T11:12:45.375569+0000","last_became_peered":"2023-10-06T11:12:45.375569+0000","last_unstale":"2023-10-06T11:12:45.375964+0000","last_undegraded":"2023-10-06T11:12:45.375964+0000","last_fullsized":"2023-10-06T11:12:45.375964+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:56:32.853044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.738701+0000","last_change":"2023-10-06T11:12:44.736834+0000","last_active":"2023-10-06T11:12:44.738701+0000","last_peered":"2023-10-06T11:12:44.738701+0000","last_clean":"2023-10-06T11:12:44.738701+0000","last_became_active":"2023-10-06T11:12:44.736659+0000","last_became_peered":"2023-10-06T11:12:44.736659+0000","last_unstale":"2023-10-06T11:12:44.738701+0000","last_undegraded":"2023-10-06T11:12:44.738701+0000","last_fullsized":"2023-10-06T11:12:44.738701+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:49:21.414511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.372763+0000","last_change":"2023-10-06T11:12:45.372763+0000","last_active":"2023-10-06T11:12:45.372763+0000","last_peered":"2023-10-06T11:12:45.372763+0000","last_clean":"2023-10-06T11:12:45.372763+0000","last_became_active":"2023-10-06T11:12:45.372513+0000","last_became_peered":"2023-10-06T11:12:45.372513+0000","last_unstale":"2023-10-06T11:12:45.372763+0000","last_undegraded":"2023-10-06T11:12:45.372763+0000","last_fullsized":"2023-10-06T11:12:45.372763+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:05:27.833031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.740320+0000","last_change":"2023-10-06T11:12:44.737345+0000","last_active":"2023-10-06T11:12:44.740320+0000","last_peered":"2023-10-06T11:12:44.740320+0000","last_clean":"2023-10-06T11:12:44.740320+0000","last_became_active":"2023-10-06T11:12:44.737085+0000","last_became_peered":"2023-10-06T11:12:44.737085+0000","last_unstale":"2023-10-06T11:12:44.740320+0000","last_undegraded":"2023-10-06T11:12:44.740320+0000","last_fullsized":"2023-10-06T11:12:44.740320+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:01:48.645594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.382575+0000","last_change":"2023-10-06T11:12:45.382575+0000","last_active":"2023-10-06T11:12:45.382575+0000","last_peered":"2023-10-06T11:12:45.382575+0000","last_clean":"2023-10-06T11:12:45.382575+0000","last_became_active":"2023-10-06T11:12:45.382099+0000","last_became_peered":"2023-10-06T11:12:45.382099+0000","last_unstale":"2023-10-06T11:12:45.382575+0000","last_undegraded":"2023-10-06T11:12:45.382575+0000","last_fullsized":"2023-10-06T11:12:45.382575+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:47:57.211917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.735043+0000","last_change":"2023-10-06T11:12:44.732320+0000","last_active":"2023-10-06T11:12:44.735043+0000","last_peered":"2023-10-06T11:12:44.735043+0000","last_clean":"2023-10-06T11:12:44.735043+0000","last_became_active":"2023-10-06T11:12:44.732082+0000","last_became_peered":"2023-10-06T11:12:44.732082+0000","last_unstale":"2023-10-06T11:12:44.735043+0000","last_undegraded":"2023-10-06T11:12:44.735043+0000","last_fullsized":"2023-10-06T11:12:44.735043+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:36.202548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.385190+0000","last_change":"2023-10-06T11:12:45.385190+0000","last_active":"2023-10-06T11:12:45.385190+0000","last_peered":"2023-10-06T11:12:45.385190+0000","last_clean":"2023-10-06T11:12:45.385190+0000","last_became_active":"2023-10-06T11:12:45.384948+0000","last_became_peered":"2023-10-06T11:12:45.384948+0000","last_unstale":"2023-10-06T11:12:45.385190+0000","last_undegraded":"2023-10-06T11:12:45.385190+0000","last_fullsized":"2023-10-06T11:12:45.385190+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:37:19.471671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.738776+0000","last_change":"2023-10-06T11:12:44.736709+0000","last_active":"2023-10-06T11:12:44.738776+0000","last_peered":"2023-10-06T11:12:44.738776+0000","last_clean":"2023-10-06T11:12:44.738776+0000","last_became_active":"2023-10-06T11:12:44.736469+0000","last_became_peered":"2023-10-06T11:12:44.736469+0000","last_unstale":"2023-10-06T11:12:44.738776+0000","last_undegraded":"2023-10-06T11:12:44.738776+0000","last_fullsized":"2023-10-06T11:12:44.738776+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:02:00.915456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.381548+0000","last_change":"2023-10-06T11:12:45.381548+0000","last_active":"2023-10-06T11:12:45.381548+0000","last_peered":"2023-10-06T11:12:45.381548+0000","last_clean":"2023-10-06T11:12:45.381548+0000","last_became_active":"2023-10-06T11:12:45.381307+0000","last_became_peered":"2023-10-06T11:12:45.381307+0000","last_unstale":"2023-10-06T11:12:45.381548+0000","last_undegraded":"2023-10-06T11:12:45.381548+0000","last_fullsized":"2023-10-06T11:12:45.381548+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:56.936995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.733026+0000","last_change":"2023-10-06T11:12:44.730169+0000","last_active":"2023-10-06T11:12:44.733026+0000","last_peered":"2023-10-06T11:12:44.733026+0000","last_clean":"2023-10-06T11:12:44.733026+0000","last_became_active":"2023-10-06T11:12:44.729878+0000","last_became_peered":"2023-10-06T11:12:44.729878+0000","last_unstale":"2023-10-06T11:12:44.733026+0000","last_undegraded":"2023-10-06T11:12:44.733026+0000","last_fullsized":"2023-10-06T11:12:44.733026+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:47:56.206737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.379078+0000","last_change":"2023-10-06T11:12:45.379078+0000","last_active":"2023-10-06T11:12:45.379078+0000","last_peered":"2023-10-06T11:12:45.379078+0000","last_clean":"2023-10-06T11:12:45.379078+0000","last_became_active":"2023-10-06T11:12:45.378814+0000","last_became_peered":"2023-10-06T11:12:45.378814+0000","last_unstale":"2023-10-06T11:12:45.379078+0000","last_undegraded":"2023-10-06T11:12:45.379078+0000","last_fullsized":"2023-10-06T11:12:45.379078+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:10.554975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.743007+0000","last_change":"2023-10-06T11:12:44.739429+0000","last_active":"2023-10-06T11:12:44.743007+0000","last_peered":"2023-10-06T11:12:44.743007+0000","last_clean":"2023-10-06T11:12:44.743007+0000","last_became_active":"2023-10-06T11:12:44.739161+0000","last_became_peered":"2023-10-06T11:12:44.739161+0000","last_unstale":"2023-10-06T11:12:44.743007+0000","last_undegraded":"2023-10-06T11:12:44.743007+0000","last_fullsized":"2023-10-06T11:12:44.743007+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:05:07.574180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":77,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.371283+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:12:45.371283+0000","last_peered":"2023-10-06T11:12:45.371283+0000","last_clean":"2023-10-06T11:12:45.371283+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:12:45.371283+0000","last_undegraded":"2023-10-06T11:12:45.371283+0000","last_fullsized":"2023-10-06T11:12:45.371283+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.375769+0000","last_change":"2023-10-06T11:12:45.375769+0000","last_active":"2023-10-06T11:12:45.375769+0000","last_peered":"2023-10-06T11:12:45.375769+0000","last_clean":"2023-10-06T11:12:45.375769+0000","last_became_active":"2023-10-06T11:12:45.375518+0000","last_became_peered":"2023-10-06T11:12:45.375518+0000","last_unstale":"2023-10-06T11:12:45.375769+0000","last_undegraded":"2023-10-06T11:12:45.375769+0000","last_fullsized":"2023-10-06T11:12:45.375769+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:32:10.507067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.741307+0000","last_change":"2023-10-06T11:12:44.739160+0000","last_active":"2023-10-06T11:12:44.741307+0000","last_peered":"2023-10-06T11:12:44.741307+0000","last_clean":"2023-10-06T11:12:44.741307+0000","last_became_active":"2023-10-06T11:12:44.738855+0000","last_became_peered":"2023-10-06T11:12:44.738855+0000","last_unstale":"2023-10-06T11:12:44.741307+0000","last_undegraded":"2023-10-06T11:12:44.741307+0000","last_fullsized":"2023-10-06T11:12:44.741307+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:15:40.584966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":71,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.721500+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:12:44.721500+0000","last_peered":"2023-10-06T11:12:44.721500+0000","last_clean":"2023-10-06T11:12:44.721500+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:12:44.721500+0000","last_undegraded":"2023-10-06T11:12:44.721500+0000","last_fullsized":"2023-10-06T11:12:44.721500+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.378534+0000","last_change":"2023-10-06T11:12:45.378534+0000","last_active":"2023-10-06T11:12:45.378534+0000","last_peered":"2023-10-06T11:12:45.378534+0000","last_clean":"2023-10-06T11:12:45.378534+0000","last_became_active":"2023-10-06T11:12:45.378143+0000","last_became_peered":"2023-10-06T11:12:45.378143+0000","last_unstale":"2023-10-06T11:12:45.378534+0000","last_undegraded":"2023-10-06T11:12:45.378534+0000","last_fullsized":"2023-10-06T11:12:45.378534+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:55:21.603977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"88'1","reported_seq":10,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.375460+0000","last_change":"2023-10-06T11:12:44.733900+0000","last_active":"2023-10-06T11:12:45.375460+0000","last_peered":"2023-10-06T11:12:45.375460+0000","last_clean":"2023-10-06T11:12:45.375460+0000","last_became_active":"2023-10-06T11:12:44.733602+0000","last_became_peered":"2023-10-06T11:12:44.733602+0000","last_unstale":"2023-10-06T11:12:45.375460+0000","last_undegraded":"2023-10-06T11:12:45.375460+0000","last_fullsized":"2023-10-06T11:12:45.375460+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:40.339470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":69,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.727077+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:12:44.727077+0000","last_peered":"2023-10-06T11:12:44.727077+0000","last_clean":"2023-10-06T11:12:44.727077+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:12:44.727077+0000","last_undegraded":"2023-10-06T11:12:44.727077+0000","last_fullsized":"2023-10-06T11:12:44.727077+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":215,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.725621+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:12:44.725621+0000","last_peered":"2023-10-06T11:12:44.725621+0000","last_clean":"2023-10-06T11:12:44.725621+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:12:44.725621+0000","last_undegraded":"2023-10-06T11:12:44.725621+0000","last_fullsized":"2023-10-06T11:12:44.725621+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.378626+0000","last_change":"2023-10-06T11:12:45.378626+0000","last_active":"2023-10-06T11:12:45.378626+0000","last_peered":"2023-10-06T11:12:45.378626+0000","last_clean":"2023-10-06T11:12:45.378626+0000","last_became_active":"2023-10-06T11:12:45.378365+0000","last_became_peered":"2023-10-06T11:12:45.378365+0000","last_unstale":"2023-10-06T11:12:45.378626+0000","last_undegraded":"2023-10-06T11:12:45.378626+0000","last_fullsized":"2023-10-06T11:12:45.378626+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:44:38.191003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"88'2","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.743215+0000","last_change":"2023-10-06T11:12:44.735639+0000","last_active":"2023-10-06T11:12:45.743215+0000","last_peered":"2023-10-06T11:12:45.743215+0000","last_clean":"2023-10-06T11:12:45.743215+0000","last_became_active":"2023-10-06T11:12:44.735345+0000","last_became_peered":"2023-10-06T11:12:44.735345+0000","last_unstale":"2023-10-06T11:12:45.743215+0000","last_undegraded":"2023-10-06T11:12:45.743215+0000","last_fullsized":"2023-10-06T11:12:45.743215+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:47.678480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":65,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.724830+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:12:44.724830+0000","last_peered":"2023-10-06T11:12:44.724830+0000","last_clean":"2023-10-06T11:12:44.724830+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:12:44.724830+0000","last_undegraded":"2023-10-06T11:12:44.724830+0000","last_fullsized":"2023-10-06T11:12:44.724830+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.379926+0000","last_change":"2023-10-06T11:12:45.379926+0000","last_active":"2023-10-06T11:12:45.379926+0000","last_peered":"2023-10-06T11:12:45.379926+0000","last_clean":"2023-10-06T11:12:45.379926+0000","last_became_active":"2023-10-06T11:12:45.379639+0000","last_became_peered":"2023-10-06T11:12:45.379639+0000","last_unstale":"2023-10-06T11:12:45.379926+0000","last_undegraded":"2023-10-06T11:12:45.379926+0000","last_fullsized":"2023-10-06T11:12:45.379926+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:01:49.650774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.739929+0000","last_change":"2023-10-06T11:12:44.734537+0000","last_active":"2023-10-06T11:12:44.739929+0000","last_peered":"2023-10-06T11:12:44.739929+0000","last_clean":"2023-10-06T11:12:44.739929+0000","last_became_active":"2023-10-06T11:12:44.733856+0000","last_became_peered":"2023-10-06T11:12:44.733856+0000","last_unstale":"2023-10-06T11:12:44.739929+0000","last_undegraded":"2023-10-06T11:12:44.739929+0000","last_fullsized":"2023-10-06T11:12:44.739929+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:37:27.265823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":65,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.725723+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:12:44.725723+0000","last_peered":"2023-10-06T11:12:44.725723+0000","last_clean":"2023-10-06T11:12:44.725723+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:12:44.725723+0000","last_undegraded":"2023-10-06T11:12:44.725723+0000","last_fullsized":"2023-10-06T11:12:44.725723+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.382447+0000","last_change":"2023-10-06T11:12:45.378808+0000","last_active":"2023-10-06T11:12:45.382447+0000","last_peered":"2023-10-06T11:12:45.382447+0000","last_clean":"2023-10-06T11:12:45.382447+0000","last_became_active":"2023-10-06T11:12:45.378116+0000","last_became_peered":"2023-10-06T11:12:45.378116+0000","last_unstale":"2023-10-06T11:12:45.382447+0000","last_undegraded":"2023-10-06T11:12:45.382447+0000","last_fullsized":"2023-10-06T11:12:45.382447+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:02:00.906976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"88'1","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.746855+0000","last_change":"2023-10-06T11:12:44.731505+0000","last_active":"2023-10-06T11:12:45.746855+0000","last_peered":"2023-10-06T11:12:45.746855+0000","last_clean":"2023-10-06T11:12:45.746855+0000","last_became_active":"2023-10-06T11:12:44.731105+0000","last_became_peered":"2023-10-06T11:12:44.731105+0000","last_unstale":"2023-10-06T11:12:45.746855+0000","last_undegraded":"2023-10-06T11:12:45.746855+0000","last_fullsized":"2023-10-06T11:12:45.746855+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:37:18.466491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":78,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.730694+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:12:44.730694+0000","last_peered":"2023-10-06T11:12:44.730694+0000","last_clean":"2023-10-06T11:12:44.730694+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:12:44.730694+0000","last_undegraded":"2023-10-06T11:12:44.730694+0000","last_fullsized":"2023-10-06T11:12:44.730694+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.380588+0000","last_change":"2023-10-06T11:12:45.380588+0000","last_active":"2023-10-06T11:12:45.380588+0000","last_peered":"2023-10-06T11:12:45.380588+0000","last_clean":"2023-10-06T11:12:45.380588+0000","last_became_active":"2023-10-06T11:12:45.380278+0000","last_became_peered":"2023-10-06T11:12:45.380278+0000","last_unstale":"2023-10-06T11:12:45.380588+0000","last_undegraded":"2023-10-06T11:12:45.380588+0000","last_fullsized":"2023-10-06T11:12:45.380588+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:40.009021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.742710+0000","last_change":"2023-10-06T11:12:44.741749+0000","last_active":"2023-10-06T11:12:44.742710+0000","last_peered":"2023-10-06T11:12:44.742710+0000","last_clean":"2023-10-06T11:12:44.742710+0000","last_became_active":"2023-10-06T11:12:44.741453+0000","last_became_peered":"2023-10-06T11:12:44.741453+0000","last_unstale":"2023-10-06T11:12:44.742710+0000","last_undegraded":"2023-10-06T11:12:44.742710+0000","last_fullsized":"2023-10-06T11:12:44.742710+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:23:25.387257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":70,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.732038+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:12:44.732038+0000","last_peered":"2023-10-06T11:12:44.732038+0000","last_clean":"2023-10-06T11:12:44.732038+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:12:44.732038+0000","last_undegraded":"2023-10-06T11:12:44.732038+0000","last_fullsized":"2023-10-06T11:12:44.732038+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.381359+0000","last_change":"2023-10-06T11:12:45.381359+0000","last_active":"2023-10-06T11:12:45.381359+0000","last_peered":"2023-10-06T11:12:45.381359+0000","last_clean":"2023-10-06T11:12:45.381359+0000","last_became_active":"2023-10-06T11:12:45.381108+0000","last_became_peered":"2023-10-06T11:12:45.381108+0000","last_unstale":"2023-10-06T11:12:45.381359+0000","last_undegraded":"2023-10-06T11:12:45.381359+0000","last_fullsized":"2023-10-06T11:12:45.381359+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:37:15.700388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"88'2","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.742074+0000","last_change":"2023-10-06T11:12:44.733797+0000","last_active":"2023-10-06T11:12:45.742074+0000","last_peered":"2023-10-06T11:12:45.742074+0000","last_clean":"2023-10-06T11:12:45.742074+0000","last_became_active":"2023-10-06T11:12:44.733510+0000","last_became_peered":"2023-10-06T11:12:44.733510+0000","last_unstale":"2023-10-06T11:12:45.742074+0000","last_undegraded":"2023-10-06T11:12:45.742074+0000","last_fullsized":"2023-10-06T11:12:45.742074+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:15:19.933838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":70,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.732039+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:12:44.732039+0000","last_peered":"2023-10-06T11:12:44.732039+0000","last_clean":"2023-10-06T11:12:44.732039+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:12:44.732039+0000","last_undegraded":"2023-10-06T11:12:44.732039+0000","last_fullsized":"2023-10-06T11:12:44.732039+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574937,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311220,"kb_used_data":1644,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060620,"statfs":{"total":96636764160,"available":96318074880,"internally_reserved":0,"allocated":1683456,"data_stored":1081154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.85099999999999998,"15min":0.60699999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.51000000000000001,"5min":23.908999999999999,"15min":23.908999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.67700000000000005,"15min":0.58099999999999996},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.58999999999999997,"5min":9.3230000000000004,"15min":9.3230000000000004},"last":0.63600000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.60499999999999998,"15min":0.55900000000000005},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.57899999999999996,"5min":9.2360000000000007,"15min":9.2360000000000007},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.375,"5min":0.505,"15min":0.505},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.55300000000000005,"5min":4.327,"15min":4.327},"last":0.58499999999999996}]},{"osd":2,"last update":"Fri Oct 6 11:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.47699999999999998,"15min":0.5},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.53500000000000003,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.57099999999999995,"15min":0.55000000000000004},"min":{"1min":0.311,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.53900000000000003,"5min":4.7309999999999999,"15min":4.7309999999999999},"last":0.56499999999999995}]},{"osd":3,"last update":"Fri Oct 6 11:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.56000000000000005,"15min":0.51600000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.67300000000000004,"5min":4.3540000000000001,"15min":4.3540000000000001},"last":0.625},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.64200000000000002,"15min":0.58999999999999997},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.60999999999999999,"5min":9.3879999999999999,"15min":9.3879999999999999},"last":0.61099999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.48799999999999999,"15min":0.46800000000000003},"min":{"1min":0.26000000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.51700000000000002,"5min":4.5709999999999997,"15min":4.5709999999999997},"last":0.377},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.51200000000000001,"15min":0.52000000000000002},"min":{"1min":0.28599999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.47299999999999998,"5min":4.3129999999999997,"15min":4.3129999999999997},"last":0.442}]},{"osd":5,"last update":"Fri Oct 6 11:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.59099999999999997,"15min":0.56399999999999995},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.53700000000000003,"5min":9.3499999999999996,"15min":9.3499999999999996},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.53600000000000003,"15min":0.55100000000000005},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.51800000000000002,"5min":4.444,"15min":4.444},"last":0.42599999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.622,"15min":0.60499999999999998},"min":{"1min":0.32400000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.54000000000000004,"5min":9.4969999999999999,"15min":9.4969999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.623,"15min":0.60699999999999998},"min":{"1min":0.378,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.55900000000000005,"5min":7.2039999999999997,"15min":7.2039999999999997},"last":0.59899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574939,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306552,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065288,"statfs":{"total":96636764160,"available":96322854912,"internally_reserved":0,"allocated":1097728,"data_stored":491489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.46600000000000003,"15min":0.49199999999999999},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.72099999999999997,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.50700000000000001,"15min":0.52800000000000002},"min":{"1min":0.27800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.749,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.51600000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.45200000000000001,"15min":0.48899999999999999},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.64400000000000002,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.46400000000000002,"15min":0.49199999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78900000000000003},"last":0.53900000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.52900000000000003,"15min":0.497},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.753,"5min":7.0659999999999998,"15min":7.0659999999999998},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.53200000000000003,"15min":0.51900000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.57699999999999996,"5min":7.0819999999999999,"15min":7.0819999999999999},"last":0.39200000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.50900000000000001,"15min":0.498},"min":{"1min":0.318,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.83499999999999996,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.51700000000000002,"15min":0.53300000000000003},"min":{"1min":0.316,"5min":0.312,"15min":0.312},"max":{"1min":0.66700000000000004,"5min":0.75800000000000001,"15min":0.83999999999999997},"last":0.48999999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.437,"15min":0.48999999999999999},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.52800000000000002,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.48399999999999999,"15min":0.54800000000000004},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.71299999999999997,"5min":0.81100000000000005,"15min":1.0680000000000001},"last":0.41299999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.48399999999999999,"15min":0.52600000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.54200000000000004,"5min":0.754,"15min":0.754},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.51400000000000001,"15min":0.57099999999999995},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.5}]},{"osd":7,"last update":"Fri Oct 6 11:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.53400000000000003,"15min":0.56799999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.81000000000000005,"5min":0.84899999999999998,"15min":0.98899999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.55000000000000004,"15min":0.59399999999999997},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.59599999999999997,"5min":0.83899999999999997,"15min":0.88400000000000001},"last":0.442}]}]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307120,"kb_used_data":1640,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064720,"statfs":{"total":96636764160,"available":96322273280,"internally_reserved":0,"allocated":1679360,"data_stored":1081168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:11:47 2023","interfaces":[{"interface":"back","average":{"1min":0.27000000000000002,"5min":0.315,"15min":0.33600000000000002},"min":{"1min":0.189,"5min":0.186,"15min":0.186},"max":{"1min":0.42099999999999999,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.30299999999999999,"5min":0.34300000000000003,"15min":0.34499999999999997},"min":{"1min":0.23400000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.60599999999999998,"5min":0.625,"15min":0.625},"last":0.32900000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:11:47 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.33700000000000002,"15min":0.33400000000000002},"min":{"1min":0.223,"5min":0.22,"15min":0.22},"max":{"1min":0.51000000000000001,"5min":1.351,"15min":1.351},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.32400000000000001,"5min":0.38900000000000001,"15min":0.38700000000000001},"min":{"1min":0.22800000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.47899999999999998,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.36599999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:11:47 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.40100000000000002,"15min":0.40699999999999997},"min":{"1min":0.26900000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.496,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.378,"15min":0.36799999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.437,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.27800000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:11:47 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.53500000000000003,"15min":0.50900000000000001},"min":{"1min":0.29499999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.68300000000000005,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.56299999999999994,"15min":0.54200000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77300000000000002,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.46999999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:11:47 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.34000000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.78700000000000003,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.56599999999999995,"15min":0.54200000000000004},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.73999999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.42099999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:11:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.57899999999999996,"15min":0.56499999999999995},"min":{"1min":0.34999999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.83699999999999997,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.59799999999999998,"15min":0.57599999999999996},"min":{"1min":0.38100000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.85199999999999998,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.45100000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:11:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.59799999999999998,"15min":0.58899999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.72399999999999998,"5min":0.89200000000000002,"15min":0.90900000000000003},"last":0.502},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.58299999999999996,"15min":0.57999999999999996},"min":{"1min":0.378,"5min":0.374,"15min":0.374},"max":{"1min":0.72599999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.45900000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574937,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310628,"kb_used_data":1052,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061212,"statfs":{"total":96636764160,"available":96318681088,"internally_reserved":0,"allocated":1077248,"data_stored":489377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:11:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.72699999999999998,"15min":0.46700000000000003},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":8.4239999999999995,"5min":36.097999999999999,"15min":36.097999999999999},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.436,"15min":0.372},"min":{"1min":0.20799999999999999,"5min":0.182,"15min":0.182},"max":{"1min":7.2990000000000004,"5min":7.2990000000000004,"15min":7.2990000000000004},"last":0.40300000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:11:48 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76100000000000001,"15min":0.50700000000000001},"min":{"1min":0.221,"5min":0.217,"15min":0.217},"max":{"1min":8.6080000000000005,"5min":36.07,"15min":36.07},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.46400000000000002,"15min":0.40000000000000002},"min":{"1min":0.23400000000000001,"5min":0.219,"15min":0.219},"max":{"1min":6.7800000000000002,"5min":6.7800000000000002,"15min":6.7800000000000002},"last":0.34399999999999997}]},{"osd":3,"last update":"Fri Oct 6 11:11:48 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.442,"15min":0.39600000000000002},"min":{"1min":0.22500000000000001,"5min":0.223,"15min":0.223},"max":{"1min":1.863,"5min":8.4130000000000003,"15min":8.4130000000000003},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.80600000000000005,"15min":0.56299999999999994},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":8.4570000000000007,"5min":35.959000000000003,"15min":35.959000000000003},"last":0.38100000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:11:48 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":2.427,"5min":2.427,"15min":2.427},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.97499999999999998,"15min":0.73699999999999999},"min":{"1min":0.34399999999999997,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":8.2919999999999998,"5min":36.005000000000003,"15min":36.005000000000003},"last":0.60199999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:11:48 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.61599999999999999,"15min":0.57399999999999995},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":6.6699999999999999,"5min":6.6699999999999999,"15min":6.6699999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.55900000000000005,"15min":0.54700000000000004},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.54800000000000004}]},{"osd":6,"last update":"Fri Oct 6 11:11:48 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.97399999999999998,"15min":0.73499999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":8.2479999999999993,"5min":36.037999999999997,"15min":36.037999999999997},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.68300000000000005,"15min":0.63200000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":6.7110000000000003,"5min":6.7110000000000003,"15min":6.7110000000000003},"last":0.59199999999999997}]},{"osd":7,"last update":"Fri Oct 6 11:11:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.64700000000000002,"15min":0.621},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":6.742,"5min":6.742,"15min":6.742},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.57399999999999995,"15min":0.56299999999999994},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.917,"5min":1.917,"15min":1.917},"last":0.50600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574938,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310628,"kb_used_data":1052,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061212,"statfs":{"total":96636764160,"available":96318681088,"internally_reserved":0,"allocated":1077248,"data_stored":489377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:11:53 2023","interfaces":[{"interface":"back","average":{"1min":0.27800000000000002,"5min":0.313,"15min":0.31},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.46300000000000002,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.375,"15min":0.38300000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51000000000000001,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.38400000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:11:53 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.36599999999999999,"15min":0.374},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.54000000000000004,"5min":0.745,"15min":0.745},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.313,"5min":0.35499999999999998,"15min":0.34899999999999998},"min":{"1min":0.23200000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.44700000000000001,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.32000000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:11:53 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.36199999999999999,"15min":0.37},"min":{"1min":0.23300000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.46100000000000002,"5min":0.629,"15min":0.629},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.35899999999999999,"15min":0.36499999999999999},"min":{"1min":0.255,"5min":0.251,"15min":0.251},"max":{"1min":0.48399999999999999,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.36799999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:11:53 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.51400000000000001,"15min":0.52900000000000003},"min":{"1min":0.313,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.52500000000000002,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.621},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.53100000000000003,"15min":0.55100000000000005},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.623,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.70799999999999996}]},{"osd":5,"last update":"Fri Oct 6 11:11:53 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.53400000000000003,"15min":0.54400000000000004},"min":{"1min":0.33100000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.68600000000000005,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.35799999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.63100000000000001,"5min":0.878,"15min":0.878},"last":0.67500000000000004}]},{"osd":6,"last update":"Fri Oct 6 11:11:53 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.56799999999999995,"15min":0.57899999999999996},"min":{"1min":0.36799999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.58399999999999996,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.55600000000000005,"15min":0.57099999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.57299999999999995,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.77200000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:11:53 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.56599999999999995,"15min":0.55200000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.65800000000000003,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.56599999999999995,"15min":0.56799999999999995},"min":{"1min":0.40000000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.63700000000000001,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.63}]}]},{"osd":3,"up_from":13,"seq":55834574938,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302436,"kb_used_data":1052,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069404,"statfs":{"total":96636764160,"available":96327069696,"internally_reserved":0,"allocated":1077248,"data_stored":489377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:11:53 2023","interfaces":[{"interface":"back","average":{"1min":0.245,"5min":0.29599999999999999,"15min":0.32200000000000001},"min":{"1min":0.183,"5min":0.183,"15min":0.183},"max":{"1min":0.33700000000000002,"5min":0.48799999999999999,"15min":1.095},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.29099999999999998,"5min":0.34799999999999998,"15min":0.39100000000000001},"min":{"1min":0.245,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.437,"5min":0.53900000000000003,"15min":1.7210000000000001},"last":0.38}]},{"osd":1,"last update":"Fri Oct 6 11:11:53 2023","interfaces":[{"interface":"back","average":{"1min":0.27000000000000002,"5min":0.311,"15min":0.308},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.35299999999999998,"5min":0.48199999999999998,"15min":0.65400000000000003},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.28299999999999997,"5min":0.34000000000000002,"15min":0.36399999999999999},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.376,"5min":0.53400000000000003,"15min":1.196},"last":0.34999999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:11:53 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.34799999999999998,"15min":0.38300000000000001},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.48399999999999999,"5min":0.56000000000000005,"15min":1.7729999999999999},"last":0.438},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.38800000000000001,"15min":0.41499999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.42699999999999999,"5min":0.58599999999999997,"15min":1.224},"last":0.46000000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:11:53 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.51200000000000001,"15min":0.56000000000000005},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.621,"5min":0.92500000000000004,"15min":1.694},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.52300000000000002,"15min":0.54000000000000004},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.60099999999999998,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.59399999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:11:53 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.54100000000000004,"15min":0.52600000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68799999999999994,"5min":0.878,"15min":0.878},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.438,"5min":0.53500000000000003,"15min":0.55900000000000005},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.65100000000000002,"5min":0.82199999999999995,"15min":1.165},"last":0.69799999999999995}]},{"osd":6,"last update":"Fri Oct 6 11:11:53 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.55700000000000005,"15min":0.58499999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.67800000000000005,"5min":0.89900000000000002,"15min":1.1359999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.443,"5min":0.56699999999999995,"15min":0.59599999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.58899999999999997,"5min":0.83399999999999996,"15min":1.7470000000000001},"last":0.55700000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:11:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.55400000000000005,"15min":0.58699999999999997},"min":{"1min":0.36799999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.69599999999999995,"5min":0.84799999999999998,"15min":1.657},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.56399999999999995,"15min":0.57199999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.63300000000000001,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.63100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574937,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298364,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073476,"statfs":{"total":96636764160,"available":96331239424,"internally_reserved":0,"allocated":1101824,"data_stored":497531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.438,"15min":0.56599999999999995},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.67600000000000005,"5min":0.76600000000000001,"15min":2.6619999999999999},"last":0.621},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.46600000000000003,"15min":0.49399999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.75600000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.45600000000000002,"15min":0.58799999999999997},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.65200000000000002,"5min":0.70899999999999996,"15min":2.8650000000000002},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.47299999999999998,"15min":0.59499999999999997},"min":{"1min":0.26200000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.57699999999999996,"5min":0.74199999999999999,"15min":2.7610000000000001},"last":0.67000000000000004}]},{"osd":2,"last update":"Fri Oct 6 11:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.47299999999999998,"15min":0.55900000000000005},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.69199999999999995,"5min":0.78200000000000003,"15min":1.6910000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.53500000000000003,"15min":0.60099999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.754,"5min":0.77400000000000002,"15min":1.718},"last":0.69499999999999995}]},{"osd":3,"last update":"Fri Oct 6 11:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.50800000000000001,"15min":0.61599999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":2.677},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.434,"5min":0.499,"15min":0.52000000000000002},"min":{"1min":0.30399999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.73199999999999998,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.60799999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.45400000000000001,"15min":0.49099999999999999},"min":{"1min":0.23499999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.57599999999999996,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.44,"5min":0.501,"15min":0.53900000000000003},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.74199999999999999,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.58199999999999996}]},{"osd":6,"last update":"Fri Oct 6 11:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.48799999999999999,"15min":0.52700000000000002},"min":{"1min":0.30499999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.54600000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.51400000000000001,"15min":0.57899999999999996},"min":{"1min":0.30399999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71699999999999997,"5min":0.86899999999999999,"15min":1.165},"last":0.71399999999999997}]},{"osd":7,"last update":"Fri Oct 6 11:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.54100000000000004,"15min":0.55800000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.60699999999999998,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.55600000000000005,"15min":0.60399999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.70599999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.64500000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574939,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306536,"kb_used_data":1056,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065304,"statfs":{"total":96636764160,"available":96322871296,"internally_reserved":0,"allocated":1081344,"data_stored":490730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.48599999999999999,"15min":0.66400000000000003},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.20499999999999999},"max":{"1min":0.46899999999999997,"5min":2.3860000000000001,"15min":5.0490000000000004},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.45300000000000001,"15min":0.63500000000000001},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.46700000000000003,"5min":1.0680000000000001,"15min":5.1449999999999996},"last":0.497}]},{"osd":1,"last update":"Fri Oct 6 11:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.46700000000000003,"15min":0.48499999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.51900000000000002,"5min":0.93500000000000005,"15min":0.97199999999999998},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.49299999999999999,"15min":0.51900000000000002},"min":{"1min":0.32100000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.51700000000000002,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.65500000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.54900000000000004,"15min":0.55700000000000005},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.54500000000000004,"5min":4.234,"15min":4.234},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.53500000000000003,"15min":0.56699999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.53500000000000003,"5min":0.80700000000000005,"15min":1.0369999999999999},"last":0.67400000000000004}]},{"osd":3,"last update":"Fri Oct 6 11:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.48499999999999999,"15min":0.68300000000000005},"min":{"1min":0.31,"5min":0.29299999999999998,"15min":0.27700000000000002},"max":{"1min":0.53300000000000003,"5min":0.81200000000000006,"15min":5.2169999999999996},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.52500000000000002,"15min":0.54700000000000004},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.66000000000000003,"5min":0.92200000000000004,"15min":1.008},"last":0.57399999999999995}]},{"osd":4,"last update":"Fri Oct 6 11:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.48599999999999999,"15min":0.52400000000000002},"min":{"1min":0.27400000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.67200000000000004,"5min":1.917,"15min":1.917},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.48799999999999999,"15min":0.53800000000000003},"min":{"1min":0.24399999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.56200000000000006,"5min":0.85499999999999998,"15min":0.87},"last":0.59399999999999997}]},{"osd":6,"last update":"Fri Oct 6 11:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.53100000000000003,"15min":0.56799999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.56599999999999995,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":0.624},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.57099999999999995,"15min":0.61499999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.63800000000000001,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":0.74199999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.53400000000000003,"15min":0.58999999999999997},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.59999999999999998,"5min":0.84299999999999997,"15min":0.96499999999999997},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.57699999999999996,"15min":0.61499999999999999},"min":{"1min":0.316,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.64700000000000002,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.71599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:12:49.814 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:12:49.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.960+0000 7fcda1809700 1 Processor -- start 2023-10-06T11:12:49.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.960+0000 7fcda1809700 1 -- start start 2023-10-06T11:12:49.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.961+0000 7fcda1809700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcd9c15a7f0 0x7fcd9c15cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:49.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.961+0000 7fcda1809700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcd9c0b2530 0x7fcd9c15acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:49.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.961+0000 7fcda1809700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd9c15c630 con 0x7fcd9c15a420 2023-10-06T11:12:49.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.961+0000 7fcda1809700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd9c0ce040 con 0x7fcd9c0b2530 2023-10-06T11:12:49.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.961+0000 7fcda1809700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd9c15ba20 con 0x7fcd9c15a7f0 2023-10-06T11:12:49.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.961+0000 7fcda1008700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcd9c0b2530 0x7fcd9c15acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:49.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.961+0000 7fcda1008700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcd9c0b2530 0x7fcd9c15acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39266/0 (socket says 172.21.15.146:39266) 2023-10-06T11:12:49.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.961+0000 7fcda1008700 1 -- 172.21.15.146:0/903785693 learned_addr learned my addr 172.21.15.146:0/903785693 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:49.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.961+0000 7fcd93fff700 1 --2- 172.21.15.146:0/903785693 >> v2:172.21.15.151:3300/0 conn(0x7fcd9c15a7f0 0x7fcd9c15cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:49.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.961+0000 7fcda1008700 1 -- 172.21.15.146:0/903785693 >> v2:172.21.15.151:3300/0 conn(0x7fcd9c15a7f0 msgr2=0x7fcd9c15cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:49.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.961+0000 7fcda1008700 1 --2- 172.21.15.146:0/903785693 >> v2:172.21.15.151:3300/0 conn(0x7fcd9c15a7f0 0x7fcd9c15cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.961+0000 7fcda1008700 1 -- 172.21.15.146:0/903785693 >> v1:172.21.15.151:6789/0 conn(0x7fcd9c15a420 legacy=0x7fcd9c0b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:49.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.961+0000 7fcda1008700 1 -- 172.21.15.146:0/903785693 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd9c15bd00 con 0x7fcd9c0b2530 2023-10-06T11:12:49.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.961+0000 7fcda1008700 1 --2- 172.21.15.146:0/903785693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd9c0b2530 0x7fcd9c15acd0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c0b33c0 tx=0x7fcd94009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd206684dfdb2ec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:49.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.962+0000 7fcd937fe700 1 -- 172.21.15.146:0/903785693 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9400e070 con 0x7fcd9c0b2530 2023-10-06T11:12:49.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.962+0000 7fcd937fe700 1 -- 172.21.15.146:0/903785693 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9400ba10 con 0x7fcd9c0b2530 2023-10-06T11:12:49.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.962+0000 7fcd937fe700 1 -- 172.21.15.146:0/903785693 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd940092e0 con 0x7fcd9c0b2530 2023-10-06T11:12:49.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.962+0000 7fcda1809700 1 -- 172.21.15.146:0/903785693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd9c0b2530 msgr2=0x7fcd9c15acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:49.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.962+0000 7fcda1809700 1 --2- 172.21.15.146:0/903785693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd9c0b2530 0x7fcd9c15acd0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c0b33c0 tx=0x7fcd94009840 comp rx=0 tx=0).stop 2023-10-06T11:12:49.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.962+0000 7fcda1809700 1 -- 172.21.15.146:0/903785693 shutdown_connections 2023-10-06T11:12:49.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.962+0000 7fcda1809700 1 --2- 172.21.15.146:0/903785693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd9c0b2530 0x7fcd9c15acd0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.962+0000 7fcda1809700 1 --2- 172.21.15.146:0/903785693 >> v2:172.21.15.151:3300/0 conn(0x7fcd9c15a7f0 0x7fcd9c15cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.962+0000 7fcda1809700 1 -- 172.21.15.146:0/903785693 >> 172.21.15.146:0/903785693 conn(0x7fcd9c06eba0 msgr2=0x7fcd9c06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:49.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.962+0000 7fcda1809700 1 -- 172.21.15.146:0/903785693 shutdown_connections 2023-10-06T11:12:49.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.962+0000 7fcda1809700 1 -- 172.21.15.146:0/903785693 wait complete. 2023-10-06T11:12:49.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.963+0000 7fcda1809700 1 Processor -- start 2023-10-06T11:12:49.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.963+0000 7fcda1809700 1 -- start start 2023-10-06T11:12:49.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.964+0000 7fcda1809700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd9c0b2530 0x7fcd9c1696a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:49.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.964+0000 7fcda1809700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd9c15a420 0x7fcd9c16d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:49.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.964+0000 7fcda1809700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd9c15a7f0 0x7fcd9c16daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:49.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.964+0000 7fcda1809700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c13a700 con 0x7fcd9c0b2530 2023-10-06T11:12:49.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.964+0000 7fcda1809700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c14aed0 con 0x7fcd9c15a7f0 2023-10-06T11:12:49.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.964+0000 7fcda1809700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c14b1b0 con 0x7fcd9c15a420 2023-10-06T11:12:49.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.964+0000 7fcda0807700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd9c0b2530 0x7fcd9c1696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:49.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.964+0000 7fcda0807700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd9c0b2530 0x7fcd9c1696a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39278/0 (socket says 172.21.15.146:39278) 2023-10-06T11:12:49.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.964+0000 7fcda0807700 1 -- 172.21.15.146:0/4148202260 learned_addr learned my addr 172.21.15.146:0/4148202260 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:49.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.965+0000 7fcd93fff700 1 --2- 172.21.15.146:0/4148202260 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd9c15a420 0x7fcd9c16d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:49.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.965+0000 7fcda1008700 1 --2- 172.21.15.146:0/4148202260 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd9c15a7f0 0x7fcd9c16daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:49.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.965+0000 7fcda0807700 1 -- 172.21.15.146:0/4148202260 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd9c15a420 msgr2=0x7fcd9c16d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:49.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.965+0000 7fcda0807700 1 --2- 172.21.15.146:0/4148202260 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd9c15a420 0x7fcd9c16d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.965+0000 7fcda0807700 1 -- 172.21.15.146:0/4148202260 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd9c15a7f0 msgr2=0x7fcd9c16daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:49.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.965+0000 7fcda0807700 1 --2- 172.21.15.146:0/4148202260 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd9c15a7f0 0x7fcd9c16daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:49.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.965+0000 7fcda0807700 1 -- 172.21.15.146:0/4148202260 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd94009ae0 con 0x7fcd9c0b2530 2023-10-06T11:12:49.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.965+0000 7fcda0807700 1 --2- 172.21.15.146:0/4148202260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd9c0b2530 0x7fcd9c1696a0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fcd9800c5d0 tx=0x7fcd98007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:49.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.965+0000 7fcd90ff9700 1 -- 172.21.15.146:0/4148202260 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd98011590 con 0x7fcd9c0b2530 2023-10-06T11:12:49.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.965+0000 7fcd90ff9700 1 -- 172.21.15.146:0/4148202260 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd98011710 con 0x7fcd9c0b2530 2023-10-06T11:12:49.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.965+0000 7fcda1809700 1 -- 172.21.15.146:0/4148202260 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd9c14b490 con 0x7fcd9c0b2530 2023-10-06T11:12:49.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.965+0000 7fcd90ff9700 1 -- 172.21.15.146:0/4148202260 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd98011ad0 con 0x7fcd9c0b2530 2023-10-06T11:12:49.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.965+0000 7fcda1809700 1 -- 172.21.15.146:0/4148202260 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd9c14ba50 con 0x7fcd9c0b2530 2023-10-06T11:12:49.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.966+0000 7fcda1809700 1 -- 172.21.15.146:0/4148202260 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd9c0afae0 con 0x7fcd9c0b2530 2023-10-06T11:12:49.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.966+0000 7fcd90ff9700 1 -- 172.21.15.146:0/4148202260 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcd9801c460 con 0x7fcd9c0b2530 2023-10-06T11:12:49.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.967+0000 7fcd90ff9700 1 --2- 172.21.15.146:0/4148202260 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcd88066f30 0x7fcd880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:49.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.967+0000 7fcd90ff9700 1 -- 172.21.15.146:0/4148202260 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcd98084490 con 0x7fcd9c0b2530 2023-10-06T11:12:49.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.967+0000 7fcd93fff700 1 --2- 172.21.15.146:0/4148202260 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcd88066f30 0x7fcd880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:49.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.967+0000 7fcd93fff700 1 --2- 172.21.15.146:0/4148202260 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcd88066f30 0x7fcd880693e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c0b2470 tx=0x7fcd8c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:49.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:49.971+0000 7fcd90ff9700 1 -- 172.21.15.146:0/4148202260 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcd980515a0 con 0x7fcd9c0b2530 2023-10-06T11:12:50.035 INFO:tasks.ceph.mds.d.smithi151.stderr:2023-10-06T11:12:50.033+0000 7fcef1485700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T11:12:50.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.151+0000 7fcda1809700 1 -- 172.21.15.146:0/4148202260 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcd9c15bfe0 con 0x7fcd88066f30 2023-10-06T11:12:50.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.160+0000 7fcd90ff9700 1 -- 172.21.15.146:0/4148202260 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311305 (secure 0 0 0) 0x7fcd9c15bfe0 con 0x7fcd88066f30 2023-10-06T11:12:50.165 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:12:50.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.163+0000 7fcda1809700 1 -- 172.21.15.146:0/4148202260 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcd88066f30 msgr2=0x7fcd880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:50.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.163+0000 7fcda1809700 1 --2- 172.21.15.146:0/4148202260 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcd88066f30 0x7fcd880693e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c0b2470 tx=0x7fcd8c008040 comp rx=0 tx=0).stop 2023-10-06T11:12:50.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.163+0000 7fcda1809700 1 -- 172.21.15.146:0/4148202260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd9c0b2530 msgr2=0x7fcd9c1696a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:50.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.163+0000 7fcda1809700 1 --2- 172.21.15.146:0/4148202260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd9c0b2530 0x7fcd9c1696a0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fcd9800c5d0 tx=0x7fcd98007f60 comp rx=0 tx=0).stop 2023-10-06T11:12:50.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.163+0000 7fcda1809700 1 -- 172.21.15.146:0/4148202260 shutdown_connections 2023-10-06T11:12:50.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.163+0000 7fcda1809700 1 --2- 172.21.15.146:0/4148202260 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcd88066f30 0x7fcd880693e0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:50.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.163+0000 7fcda1809700 1 --2- 172.21.15.146:0/4148202260 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd9c15a7f0 0x7fcd9c16daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:50.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.163+0000 7fcda1809700 1 --2- 172.21.15.146:0/4148202260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd9c0b2530 0x7fcd9c1696a0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:50.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.163+0000 7fcda1809700 1 --2- 172.21.15.146:0/4148202260 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd9c15a420 0x7fcd9c16d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:50.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.163+0000 7fcda1809700 1 -- 172.21.15.146:0/4148202260 >> 172.21.15.146:0/4148202260 conn(0x7fcd9c06eba0 msgr2=0x7fcd9c14ec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:50.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.163+0000 7fcda1809700 1 -- 172.21.15.146:0/4148202260 shutdown_connections 2023-10-06T11:12:50.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.163+0000 7fcda1809700 1 -- 172.21.15.146:0/4148202260 wait complete. 2023-10-06T11:12:50.169 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:12:50.178 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":298,"stamp":"2023-10-06T11:12:49.231401+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":123,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2453484,"kb_used_data":9644,"kb_used_omap":0,"kb_used_meta":2443776,"kb_avail":752521236,"statfs":{"total":773094113280,"available":770581745664,"internally_reserved":0,"allocated":9875456,"data_stored":5110203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2502426624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.512838"},"pg_stats":[{"pgid":"14.3f","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.377848+0000","last_change":"2023-10-06T11:12:45.377848+0000","last_active":"2023-10-06T11:12:45.377848+0000","last_peered":"2023-10-06T11:12:45.377848+0000","last_clean":"2023-10-06T11:12:45.377848+0000","last_became_active":"2023-10-06T11:12:45.377614+0000","last_became_peered":"2023-10-06T11:12:45.377614+0000","last_unstale":"2023-10-06T11:12:45.377848+0000","last_undegraded":"2023-10-06T11:12:45.377848+0000","last_fullsized":"2023-10-06T11:12:45.377848+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:04:46.125741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3e","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.380622+0000","last_change":"2023-10-06T11:12:45.380622+0000","last_active":"2023-10-06T11:12:45.380622+0000","last_peered":"2023-10-06T11:12:45.380622+0000","last_clean":"2023-10-06T11:12:45.380622+0000","last_became_active":"2023-10-06T11:12:45.380374+0000","last_became_peered":"2023-10-06T11:12:45.380374+0000","last_unstale":"2023-10-06T11:12:45.380622+0000","last_undegraded":"2023-10-06T11:12:45.380622+0000","last_fullsized":"2023-10-06T11:12:45.380622+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:45:52.056751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3d","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.385984+0000","last_change":"2023-10-06T11:12:45.385984+0000","last_active":"2023-10-06T11:12:45.385984+0000","last_peered":"2023-10-06T11:12:45.385984+0000","last_clean":"2023-10-06T11:12:45.385984+0000","last_became_active":"2023-10-06T11:12:45.385729+0000","last_became_peered":"2023-10-06T11:12:45.385729+0000","last_unstale":"2023-10-06T11:12:45.385984+0000","last_undegraded":"2023-10-06T11:12:45.385984+0000","last_fullsized":"2023-10-06T11:12:45.385984+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:46:50.273797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.3c","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.381555+0000","last_change":"2023-10-06T11:12:45.381555+0000","last_active":"2023-10-06T11:12:45.381555+0000","last_peered":"2023-10-06T11:12:45.381555+0000","last_clean":"2023-10-06T11:12:45.381555+0000","last_became_active":"2023-10-06T11:12:45.380745+0000","last_became_peered":"2023-10-06T11:12:45.380745+0000","last_unstale":"2023-10-06T11:12:45.381555+0000","last_undegraded":"2023-10-06T11:12:45.381555+0000","last_fullsized":"2023-10-06T11:12:45.381555+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:37.207729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.3b","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.386326+0000","last_change":"2023-10-06T11:12:45.381689+0000","last_active":"2023-10-06T11:12:45.386326+0000","last_peered":"2023-10-06T11:12:45.386326+0000","last_clean":"2023-10-06T11:12:45.386326+0000","last_became_active":"2023-10-06T11:12:45.377464+0000","last_became_peered":"2023-10-06T11:12:45.377464+0000","last_unstale":"2023-10-06T11:12:45.386326+0000","last_undegraded":"2023-10-06T11:12:45.386326+0000","last_fullsized":"2023-10-06T11:12:45.386326+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:48.683661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.3a","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.385297+0000","last_change":"2023-10-06T11:12:45.385297+0000","last_active":"2023-10-06T11:12:45.385297+0000","last_peered":"2023-10-06T11:12:45.385297+0000","last_clean":"2023-10-06T11:12:45.385297+0000","last_became_active":"2023-10-06T11:12:45.385032+0000","last_became_peered":"2023-10-06T11:12:45.385032+0000","last_unstale":"2023-10-06T11:12:45.385297+0000","last_undegraded":"2023-10-06T11:12:45.385297+0000","last_fullsized":"2023-10-06T11:12:45.385297+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:19.934668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.39","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.383296+0000","last_change":"2023-10-06T11:12:45.383296+0000","last_active":"2023-10-06T11:12:45.383296+0000","last_peered":"2023-10-06T11:12:45.383296+0000","last_clean":"2023-10-06T11:12:45.383296+0000","last_became_active":"2023-10-06T11:12:45.382133+0000","last_became_peered":"2023-10-06T11:12:45.382133+0000","last_unstale":"2023-10-06T11:12:45.383296+0000","last_undegraded":"2023-10-06T11:12:45.383296+0000","last_fullsized":"2023-10-06T11:12:45.383296+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:39:28.899272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.38","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.375832+0000","last_change":"2023-10-06T11:12:45.375832+0000","last_active":"2023-10-06T11:12:45.375832+0000","last_peered":"2023-10-06T11:12:45.375832+0000","last_clean":"2023-10-06T11:12:45.375832+0000","last_became_active":"2023-10-06T11:12:45.375591+0000","last_became_peered":"2023-10-06T11:12:45.375591+0000","last_unstale":"2023-10-06T11:12:45.375832+0000","last_undegraded":"2023-10-06T11:12:45.375832+0000","last_fullsized":"2023-10-06T11:12:45.375832+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:22.534233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.37","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.377844+0000","last_change":"2023-10-06T11:12:45.375092+0000","last_active":"2023-10-06T11:12:45.377844+0000","last_peered":"2023-10-06T11:12:45.377844+0000","last_clean":"2023-10-06T11:12:45.377844+0000","last_became_active":"2023-10-06T11:12:45.374842+0000","last_became_peered":"2023-10-06T11:12:45.374842+0000","last_unstale":"2023-10-06T11:12:45.377844+0000","last_undegraded":"2023-10-06T11:12:45.377844+0000","last_fullsized":"2023-10-06T11:12:45.377844+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:11:29.654911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.36","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.377530+0000","last_change":"2023-10-06T11:12:45.377530+0000","last_active":"2023-10-06T11:12:45.377530+0000","last_peered":"2023-10-06T11:12:45.377530+0000","last_clean":"2023-10-06T11:12:45.377530+0000","last_became_active":"2023-10-06T11:12:45.377282+0000","last_became_peered":"2023-10-06T11:12:45.377282+0000","last_unstale":"2023-10-06T11:12:45.377530+0000","last_undegraded":"2023-10-06T11:12:45.377530+0000","last_fullsized":"2023-10-06T11:12:45.377530+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:28:29.062081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.35","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.385267+0000","last_change":"2023-10-06T11:12:45.378090+0000","last_active":"2023-10-06T11:12:45.385267+0000","last_peered":"2023-10-06T11:12:45.385267+0000","last_clean":"2023-10-06T11:12:45.385267+0000","last_became_active":"2023-10-06T11:12:45.377510+0000","last_became_peered":"2023-10-06T11:12:45.377510+0000","last_unstale":"2023-10-06T11:12:45.385267+0000","last_undegraded":"2023-10-06T11:12:45.385267+0000","last_fullsized":"2023-10-06T11:12:45.385267+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:46:50.273797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.34","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.379974+0000","last_change":"2023-10-06T11:12:45.379974+0000","last_active":"2023-10-06T11:12:45.379974+0000","last_peered":"2023-10-06T11:12:45.379974+0000","last_clean":"2023-10-06T11:12:45.379974+0000","last_became_active":"2023-10-06T11:12:45.379659+0000","last_became_peered":"2023-10-06T11:12:45.379659+0000","last_unstale":"2023-10-06T11:12:45.379974+0000","last_undegraded":"2023-10-06T11:12:45.379974+0000","last_fullsized":"2023-10-06T11:12:45.379974+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:10:08.631431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.33","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.381451+0000","last_change":"2023-10-06T11:12:45.381451+0000","last_active":"2023-10-06T11:12:45.381451+0000","last_peered":"2023-10-06T11:12:45.381451+0000","last_clean":"2023-10-06T11:12:45.381451+0000","last_became_active":"2023-10-06T11:12:45.381205+0000","last_became_peered":"2023-10-06T11:12:45.381205+0000","last_unstale":"2023-10-06T11:12:45.381451+0000","last_undegraded":"2023-10-06T11:12:45.381451+0000","last_fullsized":"2023-10-06T11:12:45.381451+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:56:27.029252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.32","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.388476+0000","last_change":"2023-10-06T11:12:45.385695+0000","last_active":"2023-10-06T11:12:45.388476+0000","last_peered":"2023-10-06T11:12:45.388476+0000","last_clean":"2023-10-06T11:12:45.388476+0000","last_became_active":"2023-10-06T11:12:45.385402+0000","last_became_peered":"2023-10-06T11:12:45.385402+0000","last_unstale":"2023-10-06T11:12:45.388476+0000","last_undegraded":"2023-10-06T11:12:45.388476+0000","last_fullsized":"2023-10-06T11:12:45.388476+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:14:54.145361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.31","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.381323+0000","last_change":"2023-10-06T11:12:45.381323+0000","last_active":"2023-10-06T11:12:45.381323+0000","last_peered":"2023-10-06T11:12:45.381323+0000","last_clean":"2023-10-06T11:12:45.381323+0000","last_became_active":"2023-10-06T11:12:45.381075+0000","last_became_peered":"2023-10-06T11:12:45.381075+0000","last_unstale":"2023-10-06T11:12:45.381323+0000","last_undegraded":"2023-10-06T11:12:45.381323+0000","last_fullsized":"2023-10-06T11:12:45.381323+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:11:23.644136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.30","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.383413+0000","last_change":"2023-10-06T11:12:45.383413+0000","last_active":"2023-10-06T11:12:45.383413+0000","last_peered":"2023-10-06T11:12:45.383413+0000","last_clean":"2023-10-06T11:12:45.383413+0000","last_became_active":"2023-10-06T11:12:45.383095+0000","last_became_peered":"2023-10-06T11:12:45.383095+0000","last_unstale":"2023-10-06T11:12:45.383413+0000","last_undegraded":"2023-10-06T11:12:45.383413+0000","last_fullsized":"2023-10-06T11:12:45.383413+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:01:04.116199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2f","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.383366+0000","last_change":"2023-10-06T11:12:45.383366+0000","last_active":"2023-10-06T11:12:45.383366+0000","last_peered":"2023-10-06T11:12:45.383366+0000","last_clean":"2023-10-06T11:12:45.383366+0000","last_became_active":"2023-10-06T11:12:45.383060+0000","last_became_peered":"2023-10-06T11:12:45.383060+0000","last_unstale":"2023-10-06T11:12:45.383366+0000","last_undegraded":"2023-10-06T11:12:45.383366+0000","last_fullsized":"2023-10-06T11:12:45.383366+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:46:11.259163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.2e","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.378325+0000","last_change":"2023-10-06T11:12:45.378325+0000","last_active":"2023-10-06T11:12:45.378325+0000","last_peered":"2023-10-06T11:12:45.378325+0000","last_clean":"2023-10-06T11:12:45.378325+0000","last_became_active":"2023-10-06T11:12:45.377934+0000","last_became_peered":"2023-10-06T11:12:45.377934+0000","last_unstale":"2023-10-06T11:12:45.378325+0000","last_undegraded":"2023-10-06T11:12:45.378325+0000","last_fullsized":"2023-10-06T11:12:45.378325+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:02:00.906976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2d","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.386583+0000","last_change":"2023-10-06T11:12:45.382339+0000","last_active":"2023-10-06T11:12:45.386583+0000","last_peered":"2023-10-06T11:12:45.386583+0000","last_clean":"2023-10-06T11:12:45.386583+0000","last_became_active":"2023-10-06T11:12:45.382083+0000","last_became_peered":"2023-10-06T11:12:45.382083+0000","last_unstale":"2023-10-06T11:12:45.386583+0000","last_undegraded":"2023-10-06T11:12:45.386583+0000","last_fullsized":"2023-10-06T11:12:45.386583+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:45:52.056751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2c","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.382560+0000","last_change":"2023-10-06T11:12:45.382560+0000","last_active":"2023-10-06T11:12:45.382560+0000","last_peered":"2023-10-06T11:12:45.382560+0000","last_clean":"2023-10-06T11:12:45.382560+0000","last_became_active":"2023-10-06T11:12:45.382317+0000","last_became_peered":"2023-10-06T11:12:45.382317+0000","last_unstale":"2023-10-06T11:12:45.382560+0000","last_undegraded":"2023-10-06T11:12:45.382560+0000","last_fullsized":"2023-10-06T11:12:45.382560+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:05:53.556819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.2b","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.381528+0000","last_change":"2023-10-06T11:12:45.377462+0000","last_active":"2023-10-06T11:12:45.381528+0000","last_peered":"2023-10-06T11:12:45.381528+0000","last_clean":"2023-10-06T11:12:45.381528+0000","last_became_active":"2023-10-06T11:12:45.377089+0000","last_became_peered":"2023-10-06T11:12:45.377089+0000","last_unstale":"2023-10-06T11:12:45.381528+0000","last_undegraded":"2023-10-06T11:12:45.381528+0000","last_fullsized":"2023-10-06T11:12:45.381528+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:47:57.211917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2a","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.388455+0000","last_change":"2023-10-06T11:12:45.385690+0000","last_active":"2023-10-06T11:12:45.388455+0000","last_peered":"2023-10-06T11:12:45.388455+0000","last_clean":"2023-10-06T11:12:45.388455+0000","last_became_active":"2023-10-06T11:12:45.383404+0000","last_became_peered":"2023-10-06T11:12:45.383404+0000","last_unstale":"2023-10-06T11:12:45.388455+0000","last_undegraded":"2023-10-06T11:12:45.388455+0000","last_fullsized":"2023-10-06T11:12:45.388455+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:56:32.853044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.29","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.382461+0000","last_change":"2023-10-06T11:12:45.382461+0000","last_active":"2023-10-06T11:12:45.382461+0000","last_peered":"2023-10-06T11:12:45.382461+0000","last_clean":"2023-10-06T11:12:45.382461+0000","last_became_active":"2023-10-06T11:12:45.382213+0000","last_became_peered":"2023-10-06T11:12:45.382213+0000","last_unstale":"2023-10-06T11:12:45.382461+0000","last_undegraded":"2023-10-06T11:12:45.382461+0000","last_fullsized":"2023-10-06T11:12:45.382461+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:12:33.461559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.28","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.379772+0000","last_change":"2023-10-06T11:12:45.379772+0000","last_active":"2023-10-06T11:12:45.379772+0000","last_peered":"2023-10-06T11:12:45.379772+0000","last_clean":"2023-10-06T11:12:45.379772+0000","last_became_active":"2023-10-06T11:12:45.379526+0000","last_became_peered":"2023-10-06T11:12:45.379526+0000","last_unstale":"2023-10-06T11:12:45.379772+0000","last_undegraded":"2023-10-06T11:12:45.379772+0000","last_fullsized":"2023-10-06T11:12:45.379772+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:14:54.145361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.27","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.377159+0000","last_change":"2023-10-06T11:12:45.377159+0000","last_active":"2023-10-06T11:12:45.377159+0000","last_peered":"2023-10-06T11:12:45.377159+0000","last_clean":"2023-10-06T11:12:45.377159+0000","last_became_active":"2023-10-06T11:12:45.376907+0000","last_became_peered":"2023-10-06T11:12:45.376907+0000","last_unstale":"2023-10-06T11:12:45.377159+0000","last_undegraded":"2023-10-06T11:12:45.377159+0000","last_fullsized":"2023-10-06T11:12:45.377159+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:47:57.211917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.26","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.385162+0000","last_change":"2023-10-06T11:12:45.378975+0000","last_active":"2023-10-06T11:12:45.385162+0000","last_peered":"2023-10-06T11:12:45.385162+0000","last_clean":"2023-10-06T11:12:45.385162+0000","last_became_active":"2023-10-06T11:12:45.378560+0000","last_became_peered":"2023-10-06T11:12:45.378560+0000","last_unstale":"2023-10-06T11:12:45.385162+0000","last_undegraded":"2023-10-06T11:12:45.385162+0000","last_fullsized":"2023-10-06T11:12:45.385162+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:10.554975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.25","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.377422+0000","last_change":"2023-10-06T11:12:45.377422+0000","last_active":"2023-10-06T11:12:45.377422+0000","last_peered":"2023-10-06T11:12:45.377422+0000","last_clean":"2023-10-06T11:12:45.377422+0000","last_became_active":"2023-10-06T11:12:45.377167+0000","last_became_peered":"2023-10-06T11:12:45.377167+0000","last_unstale":"2023-10-06T11:12:45.377422+0000","last_undegraded":"2023-10-06T11:12:45.377422+0000","last_fullsized":"2023-10-06T11:12:45.377422+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:48:24.389420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.24","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.379815+0000","last_change":"2023-10-06T11:12:45.379815+0000","last_active":"2023-10-06T11:12:45.379815+0000","last_peered":"2023-10-06T11:12:45.379815+0000","last_clean":"2023-10-06T11:12:45.379815+0000","last_became_active":"2023-10-06T11:12:45.379560+0000","last_became_peered":"2023-10-06T11:12:45.379560+0000","last_unstale":"2023-10-06T11:12:45.379815+0000","last_undegraded":"2023-10-06T11:12:45.379815+0000","last_fullsized":"2023-10-06T11:12:45.379815+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:29:15.753583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.23","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.377697+0000","last_change":"2023-10-06T11:12:45.377697+0000","last_active":"2023-10-06T11:12:45.377697+0000","last_peered":"2023-10-06T11:12:45.377697+0000","last_clean":"2023-10-06T11:12:45.377697+0000","last_became_active":"2023-10-06T11:12:45.377383+0000","last_became_peered":"2023-10-06T11:12:45.377383+0000","last_unstale":"2023-10-06T11:12:45.377697+0000","last_undegraded":"2023-10-06T11:12:45.377697+0000","last_fullsized":"2023-10-06T11:12:45.377697+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:48:59.706211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.22","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.386389+0000","last_change":"2023-10-06T11:12:45.383086+0000","last_active":"2023-10-06T11:12:45.386389+0000","last_peered":"2023-10-06T11:12:45.386389+0000","last_clean":"2023-10-06T11:12:45.386389+0000","last_became_active":"2023-10-06T11:12:45.382821+0000","last_became_peered":"2023-10-06T11:12:45.382821+0000","last_unstale":"2023-10-06T11:12:45.386389+0000","last_undegraded":"2023-10-06T11:12:45.386389+0000","last_fullsized":"2023-10-06T11:12:45.386389+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:07:12.170597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.21","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.382439+0000","last_change":"2023-10-06T11:12:45.382439+0000","last_active":"2023-10-06T11:12:45.382439+0000","last_peered":"2023-10-06T11:12:45.382439+0000","last_clean":"2023-10-06T11:12:45.382439+0000","last_became_active":"2023-10-06T11:12:45.382155+0000","last_became_peered":"2023-10-06T11:12:45.382155+0000","last_unstale":"2023-10-06T11:12:45.382439+0000","last_undegraded":"2023-10-06T11:12:45.382439+0000","last_fullsized":"2023-10-06T11:12:45.382439+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:48.683661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.20","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.384294+0000","last_change":"2023-10-06T11:12:45.384294+0000","last_active":"2023-10-06T11:12:45.384294+0000","last_peered":"2023-10-06T11:12:45.384294+0000","last_clean":"2023-10-06T11:12:45.384294+0000","last_became_active":"2023-10-06T11:12:45.383937+0000","last_became_peered":"2023-10-06T11:12:45.383937+0000","last_unstale":"2023-10-06T11:12:45.384294+0000","last_undegraded":"2023-10-06T11:12:45.384294+0000","last_fullsized":"2023-10-06T11:12:45.384294+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:26:31.889624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.378377+0000","last_change":"2023-10-06T11:12:45.378377+0000","last_active":"2023-10-06T11:12:45.378377+0000","last_peered":"2023-10-06T11:12:45.378377+0000","last_clean":"2023-10-06T11:12:45.378377+0000","last_became_active":"2023-10-06T11:12:45.377831+0000","last_became_peered":"2023-10-06T11:12:45.377831+0000","last_unstale":"2023-10-06T11:12:45.378377+0000","last_undegraded":"2023-10-06T11:12:45.378377+0000","last_fullsized":"2023-10-06T11:12:45.378377+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:52.984415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"88'4","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.744709+0000","last_change":"2023-10-06T11:12:44.739280+0000","last_active":"2023-10-06T11:12:45.744709+0000","last_peered":"2023-10-06T11:12:45.744709+0000","last_clean":"2023-10-06T11:12:45.744709+0000","last_became_active":"2023-10-06T11:12:44.738957+0000","last_became_peered":"2023-10-06T11:12:44.738957+0000","last_unstale":"2023-10-06T11:12:45.744709+0000","last_undegraded":"2023-10-06T11:12:45.744709+0000","last_fullsized":"2023-10-06T11:12:45.744709+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:42:29.457021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.375016+0000","last_change":"2023-10-06T11:12:45.375016+0000","last_active":"2023-10-06T11:12:45.375016+0000","last_peered":"2023-10-06T11:12:45.375016+0000","last_clean":"2023-10-06T11:12:45.375016+0000","last_became_active":"2023-10-06T11:12:45.374774+0000","last_became_peered":"2023-10-06T11:12:45.374774+0000","last_unstale":"2023-10-06T11:12:45.375016+0000","last_undegraded":"2023-10-06T11:12:45.375016+0000","last_fullsized":"2023-10-06T11:12:45.375016+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:15:36.822637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"88'1","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.745736+0000","last_change":"2023-10-06T11:12:44.734452+0000","last_active":"2023-10-06T11:12:45.745736+0000","last_peered":"2023-10-06T11:12:45.745736+0000","last_clean":"2023-10-06T11:12:45.745736+0000","last_became_active":"2023-10-06T11:12:44.733832+0000","last_became_peered":"2023-10-06T11:12:44.733832+0000","last_unstale":"2023-10-06T11:12:45.745736+0000","last_undegraded":"2023-10-06T11:12:45.745736+0000","last_fullsized":"2023-10-06T11:12:45.745736+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:30:39.564524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.382913+0000","last_change":"2023-10-06T11:12:45.382913+0000","last_active":"2023-10-06T11:12:45.382913+0000","last_peered":"2023-10-06T11:12:45.382913+0000","last_clean":"2023-10-06T11:12:45.382913+0000","last_became_active":"2023-10-06T11:12:45.382454+0000","last_became_peered":"2023-10-06T11:12:45.382454+0000","last_unstale":"2023-10-06T11:12:45.382913+0000","last_undegraded":"2023-10-06T11:12:45.382913+0000","last_fullsized":"2023-10-06T11:12:45.382913+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:28:30.436158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"88'2","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.742998+0000","last_change":"2023-10-06T11:12:44.736394+0000","last_active":"2023-10-06T11:12:45.742998+0000","last_peered":"2023-10-06T11:12:45.742998+0000","last_clean":"2023-10-06T11:12:45.742998+0000","last_became_active":"2023-10-06T11:12:44.736081+0000","last_became_peered":"2023-10-06T11:12:44.736081+0000","last_unstale":"2023-10-06T11:12:45.742998+0000","last_undegraded":"2023-10-06T11:12:45.742998+0000","last_fullsized":"2023-10-06T11:12:45.742998+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:45:51.051570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.379131+0000","last_change":"2023-10-06T11:12:45.379131+0000","last_active":"2023-10-06T11:12:45.379131+0000","last_peered":"2023-10-06T11:12:45.379131+0000","last_clean":"2023-10-06T11:12:45.379131+0000","last_became_active":"2023-10-06T11:12:45.378811+0000","last_became_peered":"2023-10-06T11:12:45.378811+0000","last_unstale":"2023-10-06T11:12:45.379131+0000","last_undegraded":"2023-10-06T11:12:45.379131+0000","last_fullsized":"2023-10-06T11:12:45.379131+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:38:12.667163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"88'2","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.742363+0000","last_change":"2023-10-06T11:12:44.740727+0000","last_active":"2023-10-06T11:12:45.742363+0000","last_peered":"2023-10-06T11:12:45.742363+0000","last_clean":"2023-10-06T11:12:45.742363+0000","last_became_active":"2023-10-06T11:12:44.740413+0000","last_became_peered":"2023-10-06T11:12:44.740413+0000","last_unstale":"2023-10-06T11:12:45.742363+0000","last_undegraded":"2023-10-06T11:12:45.742363+0000","last_fullsized":"2023-10-06T11:12:45.742363+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:13:41.742831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.382628+0000","last_change":"2023-10-06T11:12:45.382628+0000","last_active":"2023-10-06T11:12:45.382628+0000","last_peered":"2023-10-06T11:12:45.382628+0000","last_clean":"2023-10-06T11:12:45.382628+0000","last_became_active":"2023-10-06T11:12:45.381778+0000","last_became_peered":"2023-10-06T11:12:45.381778+0000","last_unstale":"2023-10-06T11:12:45.382628+0000","last_undegraded":"2023-10-06T11:12:45.382628+0000","last_fullsized":"2023-10-06T11:12:45.382628+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:05:08.579361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"88'1","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.744093+0000","last_change":"2023-10-06T11:12:44.736388+0000","last_active":"2023-10-06T11:12:45.744093+0000","last_peered":"2023-10-06T11:12:45.744093+0000","last_clean":"2023-10-06T11:12:45.744093+0000","last_became_active":"2023-10-06T11:12:44.736036+0000","last_became_peered":"2023-10-06T11:12:44.736036+0000","last_unstale":"2023-10-06T11:12:45.744093+0000","last_undegraded":"2023-10-06T11:12:45.744093+0000","last_fullsized":"2023-10-06T11:12:45.744093+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:44:37.185822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.379409+0000","last_change":"2023-10-06T11:12:45.379409+0000","last_active":"2023-10-06T11:12:45.379409+0000","last_peered":"2023-10-06T11:12:45.379409+0000","last_clean":"2023-10-06T11:12:45.379409+0000","last_became_active":"2023-10-06T11:12:45.379148+0000","last_became_peered":"2023-10-06T11:12:45.379148+0000","last_unstale":"2023-10-06T11:12:45.379409+0000","last_undegraded":"2023-10-06T11:12:45.379409+0000","last_fullsized":"2023-10-06T11:12:45.379409+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:42:12.213748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"88'1","reported_seq":10,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.373306+0000","last_change":"2023-10-06T11:12:44.738685+0000","last_active":"2023-10-06T11:12:45.373306+0000","last_peered":"2023-10-06T11:12:45.373306+0000","last_clean":"2023-10-06T11:12:45.373306+0000","last_became_active":"2023-10-06T11:12:44.738435+0000","last_became_peered":"2023-10-06T11:12:44.738435+0000","last_unstale":"2023-10-06T11:12:45.373306+0000","last_undegraded":"2023-10-06T11:12:45.373306+0000","last_fullsized":"2023-10-06T11:12:45.373306+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:02:00.915456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.376428+0000","last_change":"2023-10-06T11:12:45.376428+0000","last_active":"2023-10-06T11:12:45.376428+0000","last_peered":"2023-10-06T11:12:45.376428+0000","last_clean":"2023-10-06T11:12:45.376428+0000","last_became_active":"2023-10-06T11:12:45.376179+0000","last_became_peered":"2023-10-06T11:12:45.376179+0000","last_unstale":"2023-10-06T11:12:45.376428+0000","last_undegraded":"2023-10-06T11:12:45.376428+0000","last_fullsized":"2023-10-06T11:12:45.376428+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:17:38.250270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.732125+0000","last_change":"2023-10-06T11:12:44.729546+0000","last_active":"2023-10-06T11:12:44.732125+0000","last_peered":"2023-10-06T11:12:44.732125+0000","last_clean":"2023-10-06T11:12:44.732125+0000","last_became_active":"2023-10-06T11:12:44.729279+0000","last_became_peered":"2023-10-06T11:12:44.729279+0000","last_unstale":"2023-10-06T11:12:44.732125+0000","last_undegraded":"2023-10-06T11:12:44.732125+0000","last_fullsized":"2023-10-06T11:12:44.732125+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:39.003841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.378910+0000","last_change":"2023-10-06T11:12:45.378910+0000","last_active":"2023-10-06T11:12:45.378910+0000","last_peered":"2023-10-06T11:12:45.378910+0000","last_clean":"2023-10-06T11:12:45.378910+0000","last_became_active":"2023-10-06T11:12:45.378657+0000","last_became_peered":"2023-10-06T11:12:45.378657+0000","last_unstale":"2023-10-06T11:12:45.378910+0000","last_undegraded":"2023-10-06T11:12:45.378910+0000","last_fullsized":"2023-10-06T11:12:45.378910+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:15:20.939018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.740268+0000","last_change":"2023-10-06T11:12:44.738125+0000","last_active":"2023-10-06T11:12:44.740268+0000","last_peered":"2023-10-06T11:12:44.740268+0000","last_clean":"2023-10-06T11:12:44.740268+0000","last_became_active":"2023-10-06T11:12:44.737864+0000","last_became_peered":"2023-10-06T11:12:44.737864+0000","last_unstale":"2023-10-06T11:12:44.740268+0000","last_undegraded":"2023-10-06T11:12:44.740268+0000","last_fullsized":"2023-10-06T11:12:44.740268+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:09.549794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.386333+0000","last_change":"2023-10-06T11:12:45.381777+0000","last_active":"2023-10-06T11:12:45.386333+0000","last_peered":"2023-10-06T11:12:45.386333+0000","last_clean":"2023-10-06T11:12:45.386333+0000","last_became_active":"2023-10-06T11:12:45.381432+0000","last_became_peered":"2023-10-06T11:12:45.381432+0000","last_unstale":"2023-10-06T11:12:45.386333+0000","last_undegraded":"2023-10-06T11:12:45.386333+0000","last_fullsized":"2023-10-06T11:12:45.386333+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:30:07.433714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.742972+0000","last_change":"2023-10-06T11:12:44.738793+0000","last_active":"2023-10-06T11:12:44.742972+0000","last_peered":"2023-10-06T11:12:44.742972+0000","last_clean":"2023-10-06T11:12:44.742972+0000","last_became_active":"2023-10-06T11:12:44.738516+0000","last_became_peered":"2023-10-06T11:12:44.738516+0000","last_unstale":"2023-10-06T11:12:44.742972+0000","last_undegraded":"2023-10-06T11:12:44.742972+0000","last_fullsized":"2023-10-06T11:12:44.742972+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:15:30.633176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.380567+0000","last_change":"2023-10-06T11:12:45.380567+0000","last_active":"2023-10-06T11:12:45.380567+0000","last_peered":"2023-10-06T11:12:45.380567+0000","last_clean":"2023-10-06T11:12:45.380567+0000","last_became_active":"2023-10-06T11:12:45.380301+0000","last_became_peered":"2023-10-06T11:12:45.380301+0000","last_unstale":"2023-10-06T11:12:45.380567+0000","last_undegraded":"2023-10-06T11:12:45.380567+0000","last_fullsized":"2023-10-06T11:12:45.380567+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:34:13.621749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.732036+0000","last_change":"2023-10-06T11:12:44.728003+0000","last_active":"2023-10-06T11:12:44.732036+0000","last_peered":"2023-10-06T11:12:44.732036+0000","last_clean":"2023-10-06T11:12:44.732036+0000","last_became_active":"2023-10-06T11:12:44.727699+0000","last_became_peered":"2023-10-06T11:12:44.727699+0000","last_unstale":"2023-10-06T11:12:44.732036+0000","last_undegraded":"2023-10-06T11:12:44.732036+0000","last_fullsized":"2023-10-06T11:12:44.732036+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:16:05.307130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.378171+0000","last_change":"2023-10-06T11:12:45.378171+0000","last_active":"2023-10-06T11:12:45.378171+0000","last_peered":"2023-10-06T11:12:45.378171+0000","last_clean":"2023-10-06T11:12:45.378171+0000","last_became_active":"2023-10-06T11:12:45.377655+0000","last_became_peered":"2023-10-06T11:12:45.377655+0000","last_unstale":"2023-10-06T11:12:45.378171+0000","last_undegraded":"2023-10-06T11:12:45.378171+0000","last_fullsized":"2023-10-06T11:12:45.378171+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:30:07.433714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"88'3","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.744610+0000","last_change":"2023-10-06T11:12:44.741108+0000","last_active":"2023-10-06T11:12:45.744610+0000","last_peered":"2023-10-06T11:12:45.744610+0000","last_clean":"2023-10-06T11:12:45.744610+0000","last_became_active":"2023-10-06T11:12:44.740832+0000","last_became_peered":"2023-10-06T11:12:44.740832+0000","last_unstale":"2023-10-06T11:12:45.744610+0000","last_undegraded":"2023-10-06T11:12:45.744610+0000","last_fullsized":"2023-10-06T11:12:45.744610+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:01:45.249446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.379037+0000","last_change":"2023-10-06T11:12:45.379037+0000","last_active":"2023-10-06T11:12:45.379037+0000","last_peered":"2023-10-06T11:12:45.379037+0000","last_clean":"2023-10-06T11:12:45.379037+0000","last_became_active":"2023-10-06T11:12:45.378315+0000","last_became_peered":"2023-10-06T11:12:45.378315+0000","last_unstale":"2023-10-06T11:12:45.379037+0000","last_undegraded":"2023-10-06T11:12:45.379037+0000","last_fullsized":"2023-10-06T11:12:45.379037+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:59:54.773197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"88'6","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.753621+0000","last_change":"2023-10-06T11:12:44.737242+0000","last_active":"2023-10-06T11:12:45.753621+0000","last_peered":"2023-10-06T11:12:45.753621+0000","last_clean":"2023-10-06T11:12:45.753621+0000","last_became_active":"2023-10-06T11:12:44.736966+0000","last_became_peered":"2023-10-06T11:12:44.736966+0000","last_unstale":"2023-10-06T11:12:45.753621+0000","last_undegraded":"2023-10-06T11:12:45.753621+0000","last_fullsized":"2023-10-06T11:12:45.753621+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:28:29.430977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.380314+0000","last_change":"2023-10-06T11:12:45.380314+0000","last_active":"2023-10-06T11:12:45.380314+0000","last_peered":"2023-10-06T11:12:45.380314+0000","last_clean":"2023-10-06T11:12:45.380314+0000","last_became_active":"2023-10-06T11:12:45.380038+0000","last_became_peered":"2023-10-06T11:12:45.380038+0000","last_unstale":"2023-10-06T11:12:45.380314+0000","last_undegraded":"2023-10-06T11:12:45.380314+0000","last_fullsized":"2023-10-06T11:12:45.380314+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:12:33.461559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"88'2","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.743545+0000","last_change":"2023-10-06T11:12:44.731147+0000","last_active":"2023-10-06T11:12:45.743545+0000","last_peered":"2023-10-06T11:12:45.743545+0000","last_clean":"2023-10-06T11:12:45.743545+0000","last_became_active":"2023-10-06T11:12:44.730881+0000","last_became_peered":"2023-10-06T11:12:44.730881+0000","last_unstale":"2023-10-06T11:12:45.743545+0000","last_undegraded":"2023-10-06T11:12:45.743545+0000","last_fullsized":"2023-10-06T11:12:45.743545+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:12:39.760000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.381823+0000","last_change":"2023-10-06T11:12:45.378411+0000","last_active":"2023-10-06T11:12:45.381823+0000","last_peered":"2023-10-06T11:12:45.381823+0000","last_clean":"2023-10-06T11:12:45.381823+0000","last_became_active":"2023-10-06T11:12:45.378098+0000","last_became_peered":"2023-10-06T11:12:45.378098+0000","last_unstale":"2023-10-06T11:12:45.381823+0000","last_undegraded":"2023-10-06T11:12:45.381823+0000","last_fullsized":"2023-10-06T11:12:45.381823+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:12:40.765180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.740373+0000","last_change":"2023-10-06T11:12:44.738068+0000","last_active":"2023-10-06T11:12:44.740373+0000","last_peered":"2023-10-06T11:12:44.740373+0000","last_clean":"2023-10-06T11:12:44.740373+0000","last_became_active":"2023-10-06T11:12:44.737796+0000","last_became_peered":"2023-10-06T11:12:44.737796+0000","last_unstale":"2023-10-06T11:12:44.740373+0000","last_undegraded":"2023-10-06T11:12:44.740373+0000","last_fullsized":"2023-10-06T11:12:44.740373+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:34:12.616568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.379937+0000","last_change":"2023-10-06T11:12:45.379937+0000","last_active":"2023-10-06T11:12:45.379937+0000","last_peered":"2023-10-06T11:12:45.379937+0000","last_clean":"2023-10-06T11:12:45.379937+0000","last_became_active":"2023-10-06T11:12:45.379691+0000","last_became_peered":"2023-10-06T11:12:45.379691+0000","last_unstale":"2023-10-06T11:12:45.379937+0000","last_undegraded":"2023-10-06T11:12:45.379937+0000","last_fullsized":"2023-10-06T11:12:45.379937+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:55:28.236941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.739891+0000","last_change":"2023-10-06T11:12:44.734216+0000","last_active":"2023-10-06T11:12:44.739891+0000","last_peered":"2023-10-06T11:12:44.739891+0000","last_clean":"2023-10-06T11:12:44.739891+0000","last_became_active":"2023-10-06T11:12:44.733807+0000","last_became_peered":"2023-10-06T11:12:44.733807+0000","last_unstale":"2023-10-06T11:12:44.739891+0000","last_undegraded":"2023-10-06T11:12:44.739891+0000","last_fullsized":"2023-10-06T11:12:44.739891+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:40.339470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.374872+0000","last_change":"2023-10-06T11:12:45.374872+0000","last_active":"2023-10-06T11:12:45.374872+0000","last_peered":"2023-10-06T11:12:45.374872+0000","last_clean":"2023-10-06T11:12:45.374872+0000","last_became_active":"2023-10-06T11:12:45.374083+0000","last_became_peered":"2023-10-06T11:12:45.374083+0000","last_unstale":"2023-10-06T11:12:45.374872+0000","last_undegraded":"2023-10-06T11:12:45.374872+0000","last_fullsized":"2023-10-06T11:12:45.374872+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:18:21.205299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"88'8","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.746689+0000","last_change":"2023-10-06T11:12:44.735803+0000","last_active":"2023-10-06T11:12:45.746689+0000","last_peered":"2023-10-06T11:12:45.746689+0000","last_clean":"2023-10-06T11:12:45.746689+0000","last_became_active":"2023-10-06T11:12:44.735553+0000","last_became_peered":"2023-10-06T11:12:44.735553+0000","last_unstale":"2023-10-06T11:12:45.746689+0000","last_undegraded":"2023-10-06T11:12:45.746689+0000","last_fullsized":"2023-10-06T11:12:45.746689+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:49:21.414511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.381015+0000","last_change":"2023-10-06T11:12:45.381015+0000","last_active":"2023-10-06T11:12:45.381015+0000","last_peered":"2023-10-06T11:12:45.381015+0000","last_clean":"2023-10-06T11:12:45.381015+0000","last_became_active":"2023-10-06T11:12:45.380767+0000","last_became_peered":"2023-10-06T11:12:45.380767+0000","last_unstale":"2023-10-06T11:12:45.381015+0000","last_undegraded":"2023-10-06T11:12:45.381015+0000","last_fullsized":"2023-10-06T11:12:45.381015+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:30:40.569704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"88'2","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.745802+0000","last_change":"2023-10-06T11:12:44.736093+0000","last_active":"2023-10-06T11:12:45.745802+0000","last_peered":"2023-10-06T11:12:45.745802+0000","last_clean":"2023-10-06T11:12:45.745802+0000","last_became_active":"2023-10-06T11:12:44.735796+0000","last_became_peered":"2023-10-06T11:12:44.735796+0000","last_unstale":"2023-10-06T11:12:45.745802+0000","last_undegraded":"2023-10-06T11:12:45.745802+0000","last_fullsized":"2023-10-06T11:12:45.745802+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:07:11.165416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.383924+0000","last_change":"2023-10-06T11:12:45.383924+0000","last_active":"2023-10-06T11:12:45.383924+0000","last_peered":"2023-10-06T11:12:45.383924+0000","last_clean":"2023-10-06T11:12:45.383924+0000","last_became_active":"2023-10-06T11:12:45.383627+0000","last_became_peered":"2023-10-06T11:12:45.383627+0000","last_unstale":"2023-10-06T11:12:45.383924+0000","last_undegraded":"2023-10-06T11:12:45.383924+0000","last_fullsized":"2023-10-06T11:12:45.383924+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:33:25.569877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.371668+0000","last_change":"2023-10-06T11:12:44.735018+0000","last_active":"2023-10-06T11:12:45.371668+0000","last_peered":"2023-10-06T11:12:45.371668+0000","last_clean":"2023-10-06T11:12:45.371668+0000","last_became_active":"2023-10-06T11:12:44.734733+0000","last_became_peered":"2023-10-06T11:12:44.734733+0000","last_unstale":"2023-10-06T11:12:45.371668+0000","last_undegraded":"2023-10-06T11:12:45.371668+0000","last_fullsized":"2023-10-06T11:12:45.371668+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:42:11.208568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.375762+0000","last_change":"2023-10-06T11:12:45.375762+0000","last_active":"2023-10-06T11:12:45.375762+0000","last_peered":"2023-10-06T11:12:45.375762+0000","last_clean":"2023-10-06T11:12:45.375762+0000","last_became_active":"2023-10-06T11:12:45.375528+0000","last_became_peered":"2023-10-06T11:12:45.375528+0000","last_unstale":"2023-10-06T11:12:45.375762+0000","last_undegraded":"2023-10-06T11:12:45.375762+0000","last_fullsized":"2023-10-06T11:12:45.375762+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:12:05.703126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.371606+0000","last_change":"2023-10-06T11:12:44.734661+0000","last_active":"2023-10-06T11:12:45.371606+0000","last_peered":"2023-10-06T11:12:45.371606+0000","last_clean":"2023-10-06T11:12:45.371606+0000","last_became_active":"2023-10-06T11:12:44.734382+0000","last_became_peered":"2023-10-06T11:12:44.734382+0000","last_unstale":"2023-10-06T11:12:45.371606+0000","last_undegraded":"2023-10-06T11:12:45.371606+0000","last_fullsized":"2023-10-06T11:12:45.371606+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:12:32.456378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.375964+0000","last_change":"2023-10-06T11:12:45.375964+0000","last_active":"2023-10-06T11:12:45.375964+0000","last_peered":"2023-10-06T11:12:45.375964+0000","last_clean":"2023-10-06T11:12:45.375964+0000","last_became_active":"2023-10-06T11:12:45.375569+0000","last_became_peered":"2023-10-06T11:12:45.375569+0000","last_unstale":"2023-10-06T11:12:45.375964+0000","last_undegraded":"2023-10-06T11:12:45.375964+0000","last_fullsized":"2023-10-06T11:12:45.375964+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:56:32.853044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.738701+0000","last_change":"2023-10-06T11:12:44.736834+0000","last_active":"2023-10-06T11:12:44.738701+0000","last_peered":"2023-10-06T11:12:44.738701+0000","last_clean":"2023-10-06T11:12:44.738701+0000","last_became_active":"2023-10-06T11:12:44.736659+0000","last_became_peered":"2023-10-06T11:12:44.736659+0000","last_unstale":"2023-10-06T11:12:44.738701+0000","last_undegraded":"2023-10-06T11:12:44.738701+0000","last_fullsized":"2023-10-06T11:12:44.738701+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:49:21.414511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.372763+0000","last_change":"2023-10-06T11:12:45.372763+0000","last_active":"2023-10-06T11:12:45.372763+0000","last_peered":"2023-10-06T11:12:45.372763+0000","last_clean":"2023-10-06T11:12:45.372763+0000","last_became_active":"2023-10-06T11:12:45.372513+0000","last_became_peered":"2023-10-06T11:12:45.372513+0000","last_unstale":"2023-10-06T11:12:45.372763+0000","last_undegraded":"2023-10-06T11:12:45.372763+0000","last_fullsized":"2023-10-06T11:12:45.372763+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:05:27.833031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.740320+0000","last_change":"2023-10-06T11:12:44.737345+0000","last_active":"2023-10-06T11:12:44.740320+0000","last_peered":"2023-10-06T11:12:44.740320+0000","last_clean":"2023-10-06T11:12:44.740320+0000","last_became_active":"2023-10-06T11:12:44.737085+0000","last_became_peered":"2023-10-06T11:12:44.737085+0000","last_unstale":"2023-10-06T11:12:44.740320+0000","last_undegraded":"2023-10-06T11:12:44.740320+0000","last_fullsized":"2023-10-06T11:12:44.740320+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:01:48.645594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.382575+0000","last_change":"2023-10-06T11:12:45.382575+0000","last_active":"2023-10-06T11:12:45.382575+0000","last_peered":"2023-10-06T11:12:45.382575+0000","last_clean":"2023-10-06T11:12:45.382575+0000","last_became_active":"2023-10-06T11:12:45.382099+0000","last_became_peered":"2023-10-06T11:12:45.382099+0000","last_unstale":"2023-10-06T11:12:45.382575+0000","last_undegraded":"2023-10-06T11:12:45.382575+0000","last_fullsized":"2023-10-06T11:12:45.382575+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:47:57.211917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.735043+0000","last_change":"2023-10-06T11:12:44.732320+0000","last_active":"2023-10-06T11:12:44.735043+0000","last_peered":"2023-10-06T11:12:44.735043+0000","last_clean":"2023-10-06T11:12:44.735043+0000","last_became_active":"2023-10-06T11:12:44.732082+0000","last_became_peered":"2023-10-06T11:12:44.732082+0000","last_unstale":"2023-10-06T11:12:44.735043+0000","last_undegraded":"2023-10-06T11:12:44.735043+0000","last_fullsized":"2023-10-06T11:12:44.735043+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:36.202548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.385190+0000","last_change":"2023-10-06T11:12:45.385190+0000","last_active":"2023-10-06T11:12:45.385190+0000","last_peered":"2023-10-06T11:12:45.385190+0000","last_clean":"2023-10-06T11:12:45.385190+0000","last_became_active":"2023-10-06T11:12:45.384948+0000","last_became_peered":"2023-10-06T11:12:45.384948+0000","last_unstale":"2023-10-06T11:12:45.385190+0000","last_undegraded":"2023-10-06T11:12:45.385190+0000","last_fullsized":"2023-10-06T11:12:45.385190+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:37:19.471671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.738776+0000","last_change":"2023-10-06T11:12:44.736709+0000","last_active":"2023-10-06T11:12:44.738776+0000","last_peered":"2023-10-06T11:12:44.738776+0000","last_clean":"2023-10-06T11:12:44.738776+0000","last_became_active":"2023-10-06T11:12:44.736469+0000","last_became_peered":"2023-10-06T11:12:44.736469+0000","last_unstale":"2023-10-06T11:12:44.738776+0000","last_undegraded":"2023-10-06T11:12:44.738776+0000","last_fullsized":"2023-10-06T11:12:44.738776+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:02:00.915456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.381548+0000","last_change":"2023-10-06T11:12:45.381548+0000","last_active":"2023-10-06T11:12:45.381548+0000","last_peered":"2023-10-06T11:12:45.381548+0000","last_clean":"2023-10-06T11:12:45.381548+0000","last_became_active":"2023-10-06T11:12:45.381307+0000","last_became_peered":"2023-10-06T11:12:45.381307+0000","last_unstale":"2023-10-06T11:12:45.381548+0000","last_undegraded":"2023-10-06T11:12:45.381548+0000","last_fullsized":"2023-10-06T11:12:45.381548+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:19:56.936995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.733026+0000","last_change":"2023-10-06T11:12:44.730169+0000","last_active":"2023-10-06T11:12:44.733026+0000","last_peered":"2023-10-06T11:12:44.733026+0000","last_clean":"2023-10-06T11:12:44.733026+0000","last_became_active":"2023-10-06T11:12:44.729878+0000","last_became_peered":"2023-10-06T11:12:44.729878+0000","last_unstale":"2023-10-06T11:12:44.733026+0000","last_undegraded":"2023-10-06T11:12:44.733026+0000","last_fullsized":"2023-10-06T11:12:44.733026+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:47:56.206737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.379078+0000","last_change":"2023-10-06T11:12:45.379078+0000","last_active":"2023-10-06T11:12:45.379078+0000","last_peered":"2023-10-06T11:12:45.379078+0000","last_clean":"2023-10-06T11:12:45.379078+0000","last_became_active":"2023-10-06T11:12:45.378814+0000","last_became_peered":"2023-10-06T11:12:45.378814+0000","last_unstale":"2023-10-06T11:12:45.379078+0000","last_undegraded":"2023-10-06T11:12:45.379078+0000","last_fullsized":"2023-10-06T11:12:45.379078+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:10.554975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.743007+0000","last_change":"2023-10-06T11:12:44.739429+0000","last_active":"2023-10-06T11:12:44.743007+0000","last_peered":"2023-10-06T11:12:44.743007+0000","last_clean":"2023-10-06T11:12:44.743007+0000","last_became_active":"2023-10-06T11:12:44.739161+0000","last_became_peered":"2023-10-06T11:12:44.739161+0000","last_unstale":"2023-10-06T11:12:44.743007+0000","last_undegraded":"2023-10-06T11:12:44.743007+0000","last_fullsized":"2023-10-06T11:12:44.743007+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:05:07.574180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":77,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.371283+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:12:45.371283+0000","last_peered":"2023-10-06T11:12:45.371283+0000","last_clean":"2023-10-06T11:12:45.371283+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:12:45.371283+0000","last_undegraded":"2023-10-06T11:12:45.371283+0000","last_fullsized":"2023-10-06T11:12:45.371283+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.375769+0000","last_change":"2023-10-06T11:12:45.375769+0000","last_active":"2023-10-06T11:12:45.375769+0000","last_peered":"2023-10-06T11:12:45.375769+0000","last_clean":"2023-10-06T11:12:45.375769+0000","last_became_active":"2023-10-06T11:12:45.375518+0000","last_became_peered":"2023-10-06T11:12:45.375518+0000","last_unstale":"2023-10-06T11:12:45.375769+0000","last_undegraded":"2023-10-06T11:12:45.375769+0000","last_fullsized":"2023-10-06T11:12:45.375769+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:32:10.507067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.741307+0000","last_change":"2023-10-06T11:12:44.739160+0000","last_active":"2023-10-06T11:12:44.741307+0000","last_peered":"2023-10-06T11:12:44.741307+0000","last_clean":"2023-10-06T11:12:44.741307+0000","last_became_active":"2023-10-06T11:12:44.738855+0000","last_became_peered":"2023-10-06T11:12:44.738855+0000","last_unstale":"2023-10-06T11:12:44.741307+0000","last_undegraded":"2023-10-06T11:12:44.741307+0000","last_fullsized":"2023-10-06T11:12:44.741307+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:15:40.584966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":71,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.721500+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:12:44.721500+0000","last_peered":"2023-10-06T11:12:44.721500+0000","last_clean":"2023-10-06T11:12:44.721500+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:12:44.721500+0000","last_undegraded":"2023-10-06T11:12:44.721500+0000","last_fullsized":"2023-10-06T11:12:44.721500+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.378534+0000","last_change":"2023-10-06T11:12:45.378534+0000","last_active":"2023-10-06T11:12:45.378534+0000","last_peered":"2023-10-06T11:12:45.378534+0000","last_clean":"2023-10-06T11:12:45.378534+0000","last_became_active":"2023-10-06T11:12:45.378143+0000","last_became_peered":"2023-10-06T11:12:45.378143+0000","last_unstale":"2023-10-06T11:12:45.378534+0000","last_undegraded":"2023-10-06T11:12:45.378534+0000","last_fullsized":"2023-10-06T11:12:45.378534+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:55:21.603977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"88'1","reported_seq":10,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.375460+0000","last_change":"2023-10-06T11:12:44.733900+0000","last_active":"2023-10-06T11:12:45.375460+0000","last_peered":"2023-10-06T11:12:45.375460+0000","last_clean":"2023-10-06T11:12:45.375460+0000","last_became_active":"2023-10-06T11:12:44.733602+0000","last_became_peered":"2023-10-06T11:12:44.733602+0000","last_unstale":"2023-10-06T11:12:45.375460+0000","last_undegraded":"2023-10-06T11:12:45.375460+0000","last_fullsized":"2023-10-06T11:12:45.375460+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:17:40.339470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":69,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.727077+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:12:44.727077+0000","last_peered":"2023-10-06T11:12:44.727077+0000","last_clean":"2023-10-06T11:12:44.727077+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:12:44.727077+0000","last_undegraded":"2023-10-06T11:12:44.727077+0000","last_fullsized":"2023-10-06T11:12:44.727077+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":215,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.725621+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:12:44.725621+0000","last_peered":"2023-10-06T11:12:44.725621+0000","last_clean":"2023-10-06T11:12:44.725621+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:12:44.725621+0000","last_undegraded":"2023-10-06T11:12:44.725621+0000","last_fullsized":"2023-10-06T11:12:44.725621+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.378626+0000","last_change":"2023-10-06T11:12:45.378626+0000","last_active":"2023-10-06T11:12:45.378626+0000","last_peered":"2023-10-06T11:12:45.378626+0000","last_clean":"2023-10-06T11:12:45.378626+0000","last_became_active":"2023-10-06T11:12:45.378365+0000","last_became_peered":"2023-10-06T11:12:45.378365+0000","last_unstale":"2023-10-06T11:12:45.378626+0000","last_undegraded":"2023-10-06T11:12:45.378626+0000","last_fullsized":"2023-10-06T11:12:45.378626+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:44:38.191003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"88'2","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.743215+0000","last_change":"2023-10-06T11:12:44.735639+0000","last_active":"2023-10-06T11:12:45.743215+0000","last_peered":"2023-10-06T11:12:45.743215+0000","last_clean":"2023-10-06T11:12:45.743215+0000","last_became_active":"2023-10-06T11:12:44.735345+0000","last_became_peered":"2023-10-06T11:12:44.735345+0000","last_unstale":"2023-10-06T11:12:45.743215+0000","last_undegraded":"2023-10-06T11:12:45.743215+0000","last_fullsized":"2023-10-06T11:12:45.743215+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:47.678480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":65,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.724830+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:12:44.724830+0000","last_peered":"2023-10-06T11:12:44.724830+0000","last_clean":"2023-10-06T11:12:44.724830+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:12:44.724830+0000","last_undegraded":"2023-10-06T11:12:44.724830+0000","last_fullsized":"2023-10-06T11:12:44.724830+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.379926+0000","last_change":"2023-10-06T11:12:45.379926+0000","last_active":"2023-10-06T11:12:45.379926+0000","last_peered":"2023-10-06T11:12:45.379926+0000","last_clean":"2023-10-06T11:12:45.379926+0000","last_became_active":"2023-10-06T11:12:45.379639+0000","last_became_peered":"2023-10-06T11:12:45.379639+0000","last_unstale":"2023-10-06T11:12:45.379926+0000","last_undegraded":"2023-10-06T11:12:45.379926+0000","last_fullsized":"2023-10-06T11:12:45.379926+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:01:49.650774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.739929+0000","last_change":"2023-10-06T11:12:44.734537+0000","last_active":"2023-10-06T11:12:44.739929+0000","last_peered":"2023-10-06T11:12:44.739929+0000","last_clean":"2023-10-06T11:12:44.739929+0000","last_became_active":"2023-10-06T11:12:44.733856+0000","last_became_peered":"2023-10-06T11:12:44.733856+0000","last_unstale":"2023-10-06T11:12:44.739929+0000","last_undegraded":"2023-10-06T11:12:44.739929+0000","last_fullsized":"2023-10-06T11:12:44.739929+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:37:27.265823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":65,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.725723+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:12:44.725723+0000","last_peered":"2023-10-06T11:12:44.725723+0000","last_clean":"2023-10-06T11:12:44.725723+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:12:44.725723+0000","last_undegraded":"2023-10-06T11:12:44.725723+0000","last_fullsized":"2023-10-06T11:12:44.725723+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.382447+0000","last_change":"2023-10-06T11:12:45.378808+0000","last_active":"2023-10-06T11:12:45.382447+0000","last_peered":"2023-10-06T11:12:45.382447+0000","last_clean":"2023-10-06T11:12:45.382447+0000","last_became_active":"2023-10-06T11:12:45.378116+0000","last_became_peered":"2023-10-06T11:12:45.378116+0000","last_unstale":"2023-10-06T11:12:45.382447+0000","last_undegraded":"2023-10-06T11:12:45.382447+0000","last_fullsized":"2023-10-06T11:12:45.382447+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:02:00.906976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"88'1","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.746855+0000","last_change":"2023-10-06T11:12:44.731505+0000","last_active":"2023-10-06T11:12:45.746855+0000","last_peered":"2023-10-06T11:12:45.746855+0000","last_clean":"2023-10-06T11:12:45.746855+0000","last_became_active":"2023-10-06T11:12:44.731105+0000","last_became_peered":"2023-10-06T11:12:44.731105+0000","last_unstale":"2023-10-06T11:12:45.746855+0000","last_undegraded":"2023-10-06T11:12:45.746855+0000","last_fullsized":"2023-10-06T11:12:45.746855+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:37:18.466491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":78,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.730694+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:12:44.730694+0000","last_peered":"2023-10-06T11:12:44.730694+0000","last_clean":"2023-10-06T11:12:44.730694+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:12:44.730694+0000","last_undegraded":"2023-10-06T11:12:44.730694+0000","last_fullsized":"2023-10-06T11:12:44.730694+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.380588+0000","last_change":"2023-10-06T11:12:45.380588+0000","last_active":"2023-10-06T11:12:45.380588+0000","last_peered":"2023-10-06T11:12:45.380588+0000","last_clean":"2023-10-06T11:12:45.380588+0000","last_became_active":"2023-10-06T11:12:45.380278+0000","last_became_peered":"2023-10-06T11:12:45.380278+0000","last_unstale":"2023-10-06T11:12:45.380588+0000","last_undegraded":"2023-10-06T11:12:45.380588+0000","last_fullsized":"2023-10-06T11:12:45.380588+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:58:40.009021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.742710+0000","last_change":"2023-10-06T11:12:44.741749+0000","last_active":"2023-10-06T11:12:44.742710+0000","last_peered":"2023-10-06T11:12:44.742710+0000","last_clean":"2023-10-06T11:12:44.742710+0000","last_became_active":"2023-10-06T11:12:44.741453+0000","last_became_peered":"2023-10-06T11:12:44.741453+0000","last_unstale":"2023-10-06T11:12:44.742710+0000","last_undegraded":"2023-10-06T11:12:44.742710+0000","last_fullsized":"2023-10-06T11:12:44.742710+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:23:25.387257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":70,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.732038+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:12:44.732038+0000","last_peered":"2023-10-06T11:12:44.732038+0000","last_clean":"2023-10-06T11:12:44.732038+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:12:44.732038+0000","last_undegraded":"2023-10-06T11:12:44.732038+0000","last_fullsized":"2023-10-06T11:12:44.732038+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.381359+0000","last_change":"2023-10-06T11:12:45.381359+0000","last_active":"2023-10-06T11:12:45.381359+0000","last_peered":"2023-10-06T11:12:45.381359+0000","last_clean":"2023-10-06T11:12:45.381359+0000","last_became_active":"2023-10-06T11:12:45.381108+0000","last_became_peered":"2023-10-06T11:12:45.381108+0000","last_unstale":"2023-10-06T11:12:45.381359+0000","last_undegraded":"2023-10-06T11:12:45.381359+0000","last_fullsized":"2023-10-06T11:12:45.381359+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:44.717740+0000","last_clean_scrub_stamp":"2023-10-06T11:12:44.717740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:37:15.700388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"88'2","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-06T11:12:45.742074+0000","last_change":"2023-10-06T11:12:44.733797+0000","last_active":"2023-10-06T11:12:45.742074+0000","last_peered":"2023-10-06T11:12:45.742074+0000","last_clean":"2023-10-06T11:12:45.742074+0000","last_became_active":"2023-10-06T11:12:44.733510+0000","last_became_peered":"2023-10-06T11:12:44.733510+0000","last_unstale":"2023-10-06T11:12:45.742074+0000","last_undegraded":"2023-10-06T11:12:45.742074+0000","last_fullsized":"2023-10-06T11:12:45.742074+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:12:43.712560+0000","last_clean_scrub_stamp":"2023-10-06T11:12:43.712560+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:15:19.933838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":70,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-06T11:12:44.732039+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:12:44.732039+0000","last_peered":"2023-10-06T11:12:44.732039+0000","last_clean":"2023-10-06T11:12:44.732039+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:12:44.732039+0000","last_undegraded":"2023-10-06T11:12:44.732039+0000","last_fullsized":"2023-10-06T11:12:44.732039+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574937,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311220,"kb_used_data":1644,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060620,"statfs":{"total":96636764160,"available":96318074880,"internally_reserved":0,"allocated":1683456,"data_stored":1081154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.85099999999999998,"15min":0.60699999999999998},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.51000000000000001,"5min":23.908999999999999,"15min":23.908999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.67700000000000005,"15min":0.58099999999999996},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.58999999999999997,"5min":9.3230000000000004,"15min":9.3230000000000004},"last":0.63600000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.60499999999999998,"15min":0.55900000000000005},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.57899999999999996,"5min":9.2360000000000007,"15min":9.2360000000000007},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.375,"5min":0.505,"15min":0.505},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.55300000000000005,"5min":4.327,"15min":4.327},"last":0.58499999999999996}]},{"osd":2,"last update":"Fri Oct 6 11:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.47699999999999998,"15min":0.5},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.53500000000000003,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.57099999999999995,"15min":0.55000000000000004},"min":{"1min":0.311,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.53900000000000003,"5min":4.7309999999999999,"15min":4.7309999999999999},"last":0.56499999999999995}]},{"osd":3,"last update":"Fri Oct 6 11:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.56000000000000005,"15min":0.51600000000000001},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.67300000000000004,"5min":4.3540000000000001,"15min":4.3540000000000001},"last":0.625},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.64200000000000002,"15min":0.58999999999999997},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.60999999999999999,"5min":9.3879999999999999,"15min":9.3879999999999999},"last":0.61099999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.48799999999999999,"15min":0.46800000000000003},"min":{"1min":0.26000000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.51700000000000002,"5min":4.5709999999999997,"15min":4.5709999999999997},"last":0.377},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.51200000000000001,"15min":0.52000000000000002},"min":{"1min":0.28599999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.47299999999999998,"5min":4.3129999999999997,"15min":4.3129999999999997},"last":0.442}]},{"osd":5,"last update":"Fri Oct 6 11:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.59099999999999997,"15min":0.56399999999999995},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.53700000000000003,"5min":9.3499999999999996,"15min":9.3499999999999996},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.53600000000000003,"15min":0.55100000000000005},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.51800000000000002,"5min":4.444,"15min":4.444},"last":0.42599999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.622,"15min":0.60499999999999998},"min":{"1min":0.32400000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.54000000000000004,"5min":9.4969999999999999,"15min":9.4969999999999999},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.623,"15min":0.60699999999999998},"min":{"1min":0.378,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.55900000000000005,"5min":7.2039999999999997,"15min":7.2039999999999997},"last":0.59899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574939,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306552,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065288,"statfs":{"total":96636764160,"available":96322854912,"internally_reserved":0,"allocated":1097728,"data_stored":491489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.46600000000000003,"15min":0.49199999999999999},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.72099999999999997,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.50700000000000001,"15min":0.52800000000000002},"min":{"1min":0.27800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.749,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.51600000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.45200000000000001,"15min":0.48899999999999999},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.64400000000000002,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.46400000000000002,"15min":0.49199999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78900000000000003},"last":0.53900000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.52900000000000003,"15min":0.497},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.753,"5min":7.0659999999999998,"15min":7.0659999999999998},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.53200000000000003,"15min":0.51900000000000002},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.57699999999999996,"5min":7.0819999999999999,"15min":7.0819999999999999},"last":0.39200000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.50900000000000001,"15min":0.498},"min":{"1min":0.318,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.83499999999999996,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.51700000000000002,"15min":0.53300000000000003},"min":{"1min":0.316,"5min":0.312,"15min":0.312},"max":{"1min":0.66700000000000004,"5min":0.75800000000000001,"15min":0.83999999999999997},"last":0.48999999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.437,"15min":0.48999999999999999},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.52800000000000002,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.48399999999999999,"15min":0.54800000000000004},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.71299999999999997,"5min":0.81100000000000005,"15min":1.0680000000000001},"last":0.41299999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.48399999999999999,"15min":0.52600000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.54200000000000004,"5min":0.754,"15min":0.754},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.51400000000000001,"15min":0.57099999999999995},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.5}]},{"osd":7,"last update":"Fri Oct 6 11:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.53400000000000003,"15min":0.56799999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.81000000000000005,"5min":0.84899999999999998,"15min":0.98899999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.55000000000000004,"15min":0.59399999999999997},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.59599999999999997,"5min":0.83899999999999997,"15min":0.88400000000000001},"last":0.442}]}]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307120,"kb_used_data":1640,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064720,"statfs":{"total":96636764160,"available":96322273280,"internally_reserved":0,"allocated":1679360,"data_stored":1081168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:11:47 2023","interfaces":[{"interface":"back","average":{"1min":0.27000000000000002,"5min":0.315,"15min":0.33600000000000002},"min":{"1min":0.189,"5min":0.186,"15min":0.186},"max":{"1min":0.42099999999999999,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.30299999999999999,"5min":0.34300000000000003,"15min":0.34499999999999997},"min":{"1min":0.23400000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.60599999999999998,"5min":0.625,"15min":0.625},"last":0.32900000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:11:47 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.33700000000000002,"15min":0.33400000000000002},"min":{"1min":0.223,"5min":0.22,"15min":0.22},"max":{"1min":0.51000000000000001,"5min":1.351,"15min":1.351},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.32400000000000001,"5min":0.38900000000000001,"15min":0.38700000000000001},"min":{"1min":0.22800000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.47899999999999998,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.36599999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:11:47 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.40100000000000002,"15min":0.40699999999999997},"min":{"1min":0.26900000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.496,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.33000000000000002,"5min":0.378,"15min":0.36799999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.437,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.27800000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:11:47 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.53500000000000003,"15min":0.50900000000000001},"min":{"1min":0.29499999999999998,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.68300000000000005,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.56299999999999994,"15min":0.54200000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77300000000000002,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.46999999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:11:47 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.56000000000000005,"15min":0.55000000000000004},"min":{"1min":0.34000000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.78700000000000003,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.56599999999999995,"15min":0.54200000000000004},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.73999999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.42099999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:11:47 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.57899999999999996,"15min":0.56499999999999995},"min":{"1min":0.34999999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.83699999999999997,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.59799999999999998,"15min":0.57599999999999996},"min":{"1min":0.38100000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.85199999999999998,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.45100000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:11:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.59799999999999998,"15min":0.58899999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.72399999999999998,"5min":0.89200000000000002,"15min":0.90900000000000003},"last":0.502},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.58299999999999996,"15min":0.57999999999999996},"min":{"1min":0.378,"5min":0.374,"15min":0.374},"max":{"1min":0.72599999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.45900000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574937,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310628,"kb_used_data":1052,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061212,"statfs":{"total":96636764160,"available":96318681088,"internally_reserved":0,"allocated":1077248,"data_stored":489377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:11:48 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.72699999999999998,"15min":0.46700000000000003},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":8.4239999999999995,"5min":36.097999999999999,"15min":36.097999999999999},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.436,"15min":0.372},"min":{"1min":0.20799999999999999,"5min":0.182,"15min":0.182},"max":{"1min":7.2990000000000004,"5min":7.2990000000000004,"15min":7.2990000000000004},"last":0.40300000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:11:48 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76100000000000001,"15min":0.50700000000000001},"min":{"1min":0.221,"5min":0.217,"15min":0.217},"max":{"1min":8.6080000000000005,"5min":36.07,"15min":36.07},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.46400000000000002,"15min":0.40000000000000002},"min":{"1min":0.23400000000000001,"5min":0.219,"15min":0.219},"max":{"1min":6.7800000000000002,"5min":6.7800000000000002,"15min":6.7800000000000002},"last":0.34399999999999997}]},{"osd":3,"last update":"Fri Oct 6 11:11:48 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.442,"15min":0.39600000000000002},"min":{"1min":0.22500000000000001,"5min":0.223,"15min":0.223},"max":{"1min":1.863,"5min":8.4130000000000003,"15min":8.4130000000000003},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.80600000000000005,"15min":0.56299999999999994},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":8.4570000000000007,"5min":35.959000000000003,"15min":35.959000000000003},"last":0.38100000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:11:48 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":2.427,"5min":2.427,"15min":2.427},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.97499999999999998,"15min":0.73699999999999999},"min":{"1min":0.34399999999999997,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":8.2919999999999998,"5min":36.005000000000003,"15min":36.005000000000003},"last":0.60199999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:11:48 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.61599999999999999,"15min":0.57399999999999995},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":6.6699999999999999,"5min":6.6699999999999999,"15min":6.6699999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.55900000000000005,"15min":0.54700000000000004},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.54800000000000004}]},{"osd":6,"last update":"Fri Oct 6 11:11:48 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.97399999999999998,"15min":0.73499999999999999},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":8.2479999999999993,"5min":36.037999999999997,"15min":36.037999999999997},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.68300000000000005,"15min":0.63200000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":6.7110000000000003,"5min":6.7110000000000003,"15min":6.7110000000000003},"last":0.59199999999999997}]},{"osd":7,"last update":"Fri Oct 6 11:11:48 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.64700000000000002,"15min":0.621},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":6.742,"5min":6.742,"15min":6.742},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.57399999999999995,"15min":0.56299999999999994},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.917,"5min":1.917,"15min":1.917},"last":0.50600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574938,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310628,"kb_used_data":1052,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061212,"statfs":{"total":96636764160,"available":96318681088,"internally_reserved":0,"allocated":1077248,"data_stored":489377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:11:53 2023","interfaces":[{"interface":"back","average":{"1min":0.27800000000000002,"5min":0.313,"15min":0.31},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.46300000000000002,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.35199999999999998,"5min":0.375,"15min":0.38300000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51000000000000001,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.38400000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:11:53 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.36599999999999999,"15min":0.374},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.54000000000000004,"5min":0.745,"15min":0.745},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.313,"5min":0.35499999999999998,"15min":0.34899999999999998},"min":{"1min":0.23200000000000001,"5min":0.217,"15min":0.217},"max":{"1min":0.44700000000000001,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.32000000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:11:53 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.36199999999999999,"15min":0.37},"min":{"1min":0.23300000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.46100000000000002,"5min":0.629,"15min":0.629},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.35899999999999999,"15min":0.36499999999999999},"min":{"1min":0.255,"5min":0.251,"15min":0.251},"max":{"1min":0.48399999999999999,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.36799999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:11:53 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.51400000000000001,"15min":0.52900000000000003},"min":{"1min":0.313,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.52500000000000002,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.621},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.53100000000000003,"15min":0.55100000000000005},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.623,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.70799999999999996}]},{"osd":5,"last update":"Fri Oct 6 11:11:53 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.53400000000000003,"15min":0.54400000000000004},"min":{"1min":0.33100000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.68600000000000005,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.35799999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.63100000000000001,"5min":0.878,"15min":0.878},"last":0.67500000000000004}]},{"osd":6,"last update":"Fri Oct 6 11:11:53 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.56799999999999995,"15min":0.57899999999999996},"min":{"1min":0.36799999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.58399999999999996,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.55600000000000005,"15min":0.57099999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.57299999999999995,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.77200000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:11:53 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.56599999999999995,"15min":0.55200000000000005},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.65800000000000003,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.56599999999999995,"15min":0.56799999999999995},"min":{"1min":0.40000000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.63700000000000001,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.63}]}]},{"osd":3,"up_from":13,"seq":55834574938,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302436,"kb_used_data":1052,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069404,"statfs":{"total":96636764160,"available":96327069696,"internally_reserved":0,"allocated":1077248,"data_stored":489377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:11:53 2023","interfaces":[{"interface":"back","average":{"1min":0.245,"5min":0.29599999999999999,"15min":0.32200000000000001},"min":{"1min":0.183,"5min":0.183,"15min":0.183},"max":{"1min":0.33700000000000002,"5min":0.48799999999999999,"15min":1.095},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.29099999999999998,"5min":0.34799999999999998,"15min":0.39100000000000001},"min":{"1min":0.245,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.437,"5min":0.53900000000000003,"15min":1.7210000000000001},"last":0.38}]},{"osd":1,"last update":"Fri Oct 6 11:11:53 2023","interfaces":[{"interface":"back","average":{"1min":0.27000000000000002,"5min":0.311,"15min":0.308},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.35299999999999998,"5min":0.48199999999999998,"15min":0.65400000000000003},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.28299999999999997,"5min":0.34000000000000002,"15min":0.36399999999999999},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.376,"5min":0.53400000000000003,"15min":1.196},"last":0.34999999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:11:53 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.34799999999999998,"15min":0.38300000000000001},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.48399999999999999,"5min":0.56000000000000005,"15min":1.7729999999999999},"last":0.438},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.38800000000000001,"15min":0.41499999999999998},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.42699999999999999,"5min":0.58599999999999997,"15min":1.224},"last":0.46000000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:11:53 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.51200000000000001,"15min":0.56000000000000005},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.621,"5min":0.92500000000000004,"15min":1.694},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.52300000000000002,"15min":0.54000000000000004},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.60099999999999998,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.59399999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:11:53 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.54100000000000004,"15min":0.52600000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68799999999999994,"5min":0.878,"15min":0.878},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.438,"5min":0.53500000000000003,"15min":0.55900000000000005},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.65100000000000002,"5min":0.82199999999999995,"15min":1.165},"last":0.69799999999999995}]},{"osd":6,"last update":"Fri Oct 6 11:11:53 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.55700000000000005,"15min":0.58499999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.67800000000000005,"5min":0.89900000000000002,"15min":1.1359999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.443,"5min":0.56699999999999995,"15min":0.59599999999999997},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.58899999999999997,"5min":0.83399999999999996,"15min":1.7470000000000001},"last":0.55700000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:11:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.55400000000000005,"15min":0.58699999999999997},"min":{"1min":0.36799999999999999,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.69599999999999995,"5min":0.84799999999999998,"15min":1.657},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.56399999999999995,"15min":0.57199999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.63300000000000001,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.63100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574937,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298364,"kb_used_data":1076,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073476,"statfs":{"total":96636764160,"available":96331239424,"internally_reserved":0,"allocated":1101824,"data_stored":497531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.438,"15min":0.56599999999999995},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.67600000000000005,"5min":0.76600000000000001,"15min":2.6619999999999999},"last":0.621},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.46600000000000003,"15min":0.49399999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.75600000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.45600000000000002,"15min":0.58799999999999997},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.65200000000000002,"5min":0.70899999999999996,"15min":2.8650000000000002},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.47299999999999998,"15min":0.59499999999999997},"min":{"1min":0.26200000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.57699999999999996,"5min":0.74199999999999999,"15min":2.7610000000000001},"last":0.67000000000000004}]},{"osd":2,"last update":"Fri Oct 6 11:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.47299999999999998,"15min":0.55900000000000005},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.69199999999999995,"5min":0.78200000000000003,"15min":1.6910000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.53500000000000003,"15min":0.60099999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.754,"5min":0.77400000000000002,"15min":1.718},"last":0.69499999999999995}]},{"osd":3,"last update":"Fri Oct 6 11:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.50800000000000001,"15min":0.61599999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":2.677},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.434,"5min":0.499,"15min":0.52000000000000002},"min":{"1min":0.30399999999999999,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.73199999999999998,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.60799999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.45400000000000001,"15min":0.49099999999999999},"min":{"1min":0.23499999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.57599999999999996,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.44,"5min":0.501,"15min":0.53900000000000003},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.74199999999999999,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.58199999999999996}]},{"osd":6,"last update":"Fri Oct 6 11:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.48799999999999999,"15min":0.52700000000000002},"min":{"1min":0.30499999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.54600000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.46500000000000002,"5min":0.51400000000000001,"15min":0.57899999999999996},"min":{"1min":0.30399999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.71699999999999997,"5min":0.86899999999999999,"15min":1.165},"last":0.71399999999999997}]},{"osd":7,"last update":"Fri Oct 6 11:11:45 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.54100000000000004,"15min":0.55800000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.60699999999999998,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.55600000000000005,"15min":0.60399999999999998},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.70599999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.64500000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574939,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306536,"kb_used_data":1056,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065304,"statfs":{"total":96636764160,"available":96322871296,"internally_reserved":0,"allocated":1081344,"data_stored":490730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.48599999999999999,"15min":0.66400000000000003},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.20499999999999999},"max":{"1min":0.46899999999999997,"5min":2.3860000000000001,"15min":5.0490000000000004},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.45300000000000001,"15min":0.63500000000000001},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.46700000000000003,"5min":1.0680000000000001,"15min":5.1449999999999996},"last":0.497}]},{"osd":1,"last update":"Fri Oct 6 11:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.46700000000000003,"15min":0.48499999999999999},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.51900000000000002,"5min":0.93500000000000005,"15min":0.97199999999999998},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.49299999999999999,"15min":0.51900000000000002},"min":{"1min":0.32100000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.51700000000000002,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.65500000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.54900000000000004,"15min":0.55700000000000005},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.54500000000000004,"5min":4.234,"15min":4.234},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.53500000000000003,"15min":0.56699999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.53500000000000003,"5min":0.80700000000000005,"15min":1.0369999999999999},"last":0.67400000000000004}]},{"osd":3,"last update":"Fri Oct 6 11:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.48499999999999999,"15min":0.68300000000000005},"min":{"1min":0.31,"5min":0.29299999999999998,"15min":0.27700000000000002},"max":{"1min":0.53300000000000003,"5min":0.81200000000000006,"15min":5.2169999999999996},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.52500000000000002,"15min":0.54700000000000004},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.66000000000000003,"5min":0.92200000000000004,"15min":1.008},"last":0.57399999999999995}]},{"osd":4,"last update":"Fri Oct 6 11:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.48599999999999999,"15min":0.52400000000000002},"min":{"1min":0.27400000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.67200000000000004,"5min":1.917,"15min":1.917},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.48799999999999999,"15min":0.53800000000000003},"min":{"1min":0.24399999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.56200000000000006,"5min":0.85499999999999998,"15min":0.87},"last":0.59399999999999997}]},{"osd":6,"last update":"Fri Oct 6 11:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.53100000000000003,"15min":0.56799999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.56599999999999995,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":0.624},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.57099999999999995,"15min":0.61499999999999999},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.63800000000000001,"5min":1.9470000000000001,"15min":1.9470000000000001},"last":0.74199999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:11:51 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.53400000000000003,"15min":0.58999999999999997},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.59999999999999998,"5min":0.84299999999999997,"15min":0.96499999999999997},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.57699999999999996,"15min":0.61499999999999999},"min":{"1min":0.316,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.64700000000000002,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":0.71599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:12:50.184 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T11:12:50.184 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T11:12:50.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.337+0000 7f9fb40c1700 1 Processor -- start 2023-10-06T11:12:50.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.337+0000 7f9fb40c1700 1 -- start start 2023-10-06T11:12:50.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.338+0000 7f9fb40c1700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9fac159f60 0x7f9fac0c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:50.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.338+0000 7f9fb40c1700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9fac0cc760 0x7f9fac0c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:50.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.338+0000 7f9fb40c1700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fac0c5c20 con 0x7f9fac0c7200 2023-10-06T11:12:50.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.338+0000 7f9fb40c1700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fac0b3260 con 0x7f9fac159f60 2023-10-06T11:12:50.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.338+0000 7f9fb40c1700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fac0c5f00 con 0x7f9fac0cc760 2023-10-06T11:12:50.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.338+0000 7f9fb1e5d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9fac159f60 0x7f9fac0c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:50.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.338+0000 7f9fb265e700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f9fac0c7200 0x7f9fac0b35f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:37906/0 (socket says 172.21.15.146:37906) 2023-10-06T11:12:50.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.338+0000 7f9fb265e700 1 -- 172.21.15.146:0/3901446389 learned_addr learned my addr 172.21.15.146:0/3901446389 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:12:50.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.339+0000 7f9fb1e5d700 1 -- 172.21.15.146:0/3901446389 >> v2:172.21.15.151:3300/0 conn(0x7f9fac0cc760 msgr2=0x7f9fac0c6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:50.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.339+0000 7f9fb165c700 1 --2- 172.21.15.146:0/3901446389 >> v2:172.21.15.151:3300/0 conn(0x7f9fac0cc760 0x7f9fac0c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:50.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.339+0000 7f9fb1e5d700 1 --2- 172.21.15.146:0/3901446389 >> v2:172.21.15.151:3300/0 conn(0x7f9fac0cc760 0x7f9fac0c6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:50.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.339+0000 7f9fb0e5b700 1 -- 172.21.15.146:0/3901446389 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2310963520 0 0) 0x7f9fac0c5c20 con 0x7f9fac0c7200 2023-10-06T11:12:50.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.339+0000 7f9fb1e5d700 1 -- 172.21.15.146:0/3901446389 >> v1:172.21.15.146:6789/0 conn(0x7f9fac0c7200 legacy=0x7f9fac0b35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:50.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.339+0000 7f9fb1e5d700 1 -- 172.21.15.146:0/3901446389 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fac0c61e0 con 0x7f9fac159f60 2023-10-06T11:12:50.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.339+0000 7f9fb1e5d700 1 --2- 172.21.15.146:0/3901446389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fac159f60 0x7f9fac0c55d0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f9fac088140 tx=0x7f9fa8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c71eca7850a8aef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:50.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.339+0000 7f9fb0e5b700 1 -- 172.21.15.146:0/3901446389 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa800e070 con 0x7f9fac159f60 2023-10-06T11:12:50.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.339+0000 7f9fb0e5b700 1 -- 172.21.15.146:0/3901446389 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa800bc30 con 0x7f9fac159f60 2023-10-06T11:12:50.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.339+0000 7f9fb0e5b700 1 -- 172.21.15.146:0/3901446389 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa8012430 con 0x7f9fac159f60 2023-10-06T11:12:50.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.340+0000 7f9fb40c1700 1 -- 172.21.15.146:0/3901446389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fac159f60 msgr2=0x7f9fac0c55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:50.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.340+0000 7f9fb40c1700 1 --2- 172.21.15.146:0/3901446389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fac159f60 0x7f9fac0c55d0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f9fac088140 tx=0x7f9fa8009780 comp rx=0 tx=0).stop 2023-10-06T11:12:50.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.340+0000 7f9fb40c1700 1 -- 172.21.15.146:0/3901446389 shutdown_connections 2023-10-06T11:12:50.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.340+0000 7f9fb40c1700 1 --2- 172.21.15.146:0/3901446389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fac159f60 0x7f9fac0c55d0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:50.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.340+0000 7f9fb40c1700 1 --2- 172.21.15.146:0/3901446389 >> v2:172.21.15.151:3300/0 conn(0x7f9fac0cc760 0x7f9fac0c6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:50.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.340+0000 7f9fb40c1700 1 -- 172.21.15.146:0/3901446389 >> 172.21.15.146:0/3901446389 conn(0x7f9fac06f380 msgr2=0x7f9fac0d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:50.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.340+0000 7f9fb40c1700 1 -- 172.21.15.146:0/3901446389 shutdown_connections 2023-10-06T11:12:50.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.340+0000 7f9fb40c1700 1 -- 172.21.15.146:0/3901446389 wait complete. 2023-10-06T11:12:50.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.341+0000 7f9fb40c1700 1 Processor -- start 2023-10-06T11:12:50.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.341+0000 7f9fb40c1700 1 -- start start 2023-10-06T11:12:50.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.341+0000 7f9fb40c1700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9fac0c7200 0x7f9fac069980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:50.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.341+0000 7f9fb40c1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fac0cc760 0x7f9fac156490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:50.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.342+0000 7f9fb40c1700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9fac159f60 0x7f9fac15f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:50.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.342+0000 7f9fb40c1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac0ca750 con 0x7f9fac0cc760 2023-10-06T11:12:50.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.342+0000 7f9fb40c1700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac09e180 con 0x7f9fac159f60 2023-10-06T11:12:50.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.342+0000 7f9fb40c1700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac0c80d0 con 0x7f9fac0c7200 2023-10-06T11:12:50.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.342+0000 7f9fb165c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fac0cc760 0x7f9fac156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:50.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.342+0000 7f9fb165c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fac0cc760 0x7f9fac156490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39294/0 (socket says 172.21.15.146:39294) 2023-10-06T11:12:50.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.342+0000 7f9fb165c700 1 -- 172.21.15.146:0/3168258635 learned_addr learned my addr 172.21.15.146:0/3168258635 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:50.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.342+0000 7f9fb1e5d700 1 --2- 172.21.15.146:0/3168258635 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9fac0c7200 0x7f9fac069980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:50.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.342+0000 7f9fb265e700 1 --2- 172.21.15.146:0/3168258635 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9fac159f60 0x7f9fac15f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:50.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.342+0000 7f9fb165c700 1 -- 172.21.15.146:0/3168258635 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9fac0c7200 msgr2=0x7f9fac069980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:50.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.342+0000 7f9fb165c700 1 --2- 172.21.15.146:0/3168258635 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9fac0c7200 0x7f9fac069980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:50.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.342+0000 7f9fb165c700 1 -- 172.21.15.146:0/3168258635 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9fac159f60 msgr2=0x7f9fac15f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:50.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.342+0000 7f9fb165c700 1 --2- 172.21.15.146:0/3168258635 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9fac159f60 0x7f9fac15f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:50.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.342+0000 7f9fb165c700 1 -- 172.21.15.146:0/3168258635 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa8009a20 con 0x7f9fac0cc760 2023-10-06T11:12:50.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.342+0000 7f9fb165c700 1 --2- 172.21.15.146:0/3168258635 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fac0cc760 0x7f9fac156490 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c00c880 tx=0x7f9f9c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:50.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.342+0000 7f9fa1ffb700 1 -- 172.21.15.146:0/3168258635 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c011600 con 0x7f9fac0cc760 2023-10-06T11:12:50.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.342+0000 7f9fa1ffb700 1 -- 172.21.15.146:0/3168258635 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f9c0117a0 con 0x7f9fac0cc760 2023-10-06T11:12:50.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.342+0000 7f9fb40c1700 1 -- 172.21.15.146:0/3168258635 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fac1569d0 con 0x7f9fac0cc760 2023-10-06T11:12:50.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.342+0000 7f9fa1ffb700 1 -- 172.21.15.146:0/3168258635 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c011b60 con 0x7f9fac0cc760 2023-10-06T11:12:50.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.342+0000 7f9fb40c1700 1 -- 172.21.15.146:0/3168258635 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fac0c7a80 con 0x7f9fac0cc760 2023-10-06T11:12:50.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.343+0000 7f9fb40c1700 1 -- 172.21.15.146:0/3168258635 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fac068390 con 0x7f9fac0cc760 2023-10-06T11:12:50.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.344+0000 7f9fa1ffb700 1 -- 172.21.15.146:0/3168258635 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9f9c018360 con 0x7f9fac0cc760 2023-10-06T11:12:50.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.344+0000 7f9fa1ffb700 1 --2- 172.21.15.146:0/3168258635 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9f90066f30 0x7f9f900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:50.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.344+0000 7f9fb1e5d700 1 --2- 172.21.15.146:0/3168258635 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9f90066f30 0x7f9f900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:50.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.344+0000 7f9fa1ffb700 1 -- 172.21.15.146:0/3168258635 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9f9c0844d0 con 0x7f9fac0cc760 2023-10-06T11:12:50.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.345+0000 7f9fb1e5d700 1 --2- 172.21.15.146:0/3168258635 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9f90066f30 0x7f9f900693e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9fac088140 tx=0x7f9fa8019000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:50.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.349+0000 7f9fa1ffb700 1 -- 172.21.15.146:0/3168258635 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9f9c0515e0 con 0x7f9fac0cc760 2023-10-06T11:12:50.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.610+0000 7f9fb40c1700 1 -- 172.21.15.146:0/3168258635 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f9fac04c3d0 con 0x7f9fac0cc760 2023-10-06T11:12:50.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.614+0000 7f9fa1ffb700 1 -- 172.21.15.146:0/3168258635 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+0 (secure 0 0 0) 0x7f9f9c054c00 con 0x7f9fac0cc760 2023-10-06T11:12:50.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.616+0000 7f9fb40c1700 1 -- 172.21.15.146:0/3168258635 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9f90066f30 msgr2=0x7f9f900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:50.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.616+0000 7f9fb40c1700 1 --2- 172.21.15.146:0/3168258635 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9f90066f30 0x7f9f900693e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f9fac088140 tx=0x7f9fa8019000 comp rx=0 tx=0).stop 2023-10-06T11:12:50.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.616+0000 7f9fb40c1700 1 -- 172.21.15.146:0/3168258635 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fac0cc760 msgr2=0x7f9fac156490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:50.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.616+0000 7f9fb40c1700 1 --2- 172.21.15.146:0/3168258635 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fac0cc760 0x7f9fac156490 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c00c880 tx=0x7f9f9c008040 comp rx=0 tx=0).stop 2023-10-06T11:12:50.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.616+0000 7f9fb40c1700 1 -- 172.21.15.146:0/3168258635 shutdown_connections 2023-10-06T11:12:50.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.616+0000 7f9fb40c1700 1 --2- 172.21.15.146:0/3168258635 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9f90066f30 0x7f9f900693e0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:50.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.616+0000 7f9fb40c1700 1 --2- 172.21.15.146:0/3168258635 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9fac159f60 0x7f9fac15f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:50.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.616+0000 7f9fb40c1700 1 --2- 172.21.15.146:0/3168258635 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9fac0c7200 0x7f9fac069980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:50.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.616+0000 7f9fb40c1700 1 --2- 172.21.15.146:0/3168258635 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fac0cc760 0x7f9fac156490 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:50.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.616+0000 7f9fb40c1700 1 -- 172.21.15.146:0/3168258635 >> 172.21.15.146:0/3168258635 conn(0x7f9fac06f380 msgr2=0x7f9fac0ce0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:50.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.616+0000 7f9fb40c1700 1 -- 172.21.15.146:0/3168258635 shutdown_connections 2023-10-06T11:12:50.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.616+0000 7f9fb40c1700 1 -- 172.21.15.146:0/3168258635 wait complete. 2023-10-06T11:12:50.619 INFO:teuthology.orchestra.run.smithi146.stderr:updated caps for client.0 2023-10-06T11:12:50.630 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:12:50.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.743+0000 7f418875f700 1 Processor -- start 2023-10-06T11:12:50.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.743+0000 7f418875f700 1 -- start start 2023-10-06T11:12:50.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.744+0000 7f418875f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f41800ab010 0x7f4180157800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:50.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.744+0000 7f418875f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41800ccf20 con 0x7f41800ca070 2023-10-06T11:12:50.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.744+0000 7f418875f700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41800cd200 con 0x7f4180157430 2023-10-06T11:12:50.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.744+0000 7f418875f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41800ca4f0 con 0x7f41800ab010 2023-10-06T11:12:50.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.745+0000 7f4185cfa700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f41800ab010 0x7f4180157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:50.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.745+0000 7f4186cfc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f41800ca070 0x7f41800cc240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:37922/0 (socket says 172.21.15.146:37922) 2023-10-06T11:12:50.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.745+0000 7f4186cfc700 1 -- 172.21.15.146:0/1884782456 learned_addr learned my addr 172.21.15.146:0/1884782456 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:12:50.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.745+0000 7f4185cfa700 1 -- 172.21.15.146:0/1884782456 >> v1:172.21.15.151:6789/0 conn(0x7f4180157430 legacy=0x7f41800ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:50.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.745+0000 7f4185cfa700 1 -- 172.21.15.146:0/1884782456 >> v1:172.21.15.146:6789/0 conn(0x7f41800ca070 legacy=0x7f41800cc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:50.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.745+0000 7f4185cfa700 1 -- 172.21.15.146:0/1884782456 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41800cd4e0 con 0x7f41800ab010 2023-10-06T11:12:50.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.745+0000 7f41854f9700 1 -- 172.21.15.146:0/1884782456 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1023500750 0 0) 0x7f41800ccf20 con 0x7f41800ca070 2023-10-06T11:12:50.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.745+0000 7f4185cfa700 1 --2- 172.21.15.146:0/1884782456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41800ab010 0x7f4180157800 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f41700098e0 tx=0x7f41700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e175b0b7e576b4f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:50.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.745+0000 7f41854f9700 1 -- 172.21.15.146:0/1884782456 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4170009e80 con 0x7f41800ab010 2023-10-06T11:12:50.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.745+0000 7f41854f9700 1 -- 172.21.15.146:0/1884782456 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f417000b860 con 0x7f41800ab010 2023-10-06T11:12:50.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.745+0000 7f41854f9700 1 -- 172.21.15.146:0/1884782456 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417000bbe0 con 0x7f41800ab010 2023-10-06T11:12:50.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.746+0000 7f418875f700 1 -- 172.21.15.146:0/1884782456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41800ab010 msgr2=0x7f4180157800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:50.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.746+0000 7f418875f700 1 --2- 172.21.15.146:0/1884782456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41800ab010 0x7f4180157800 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f41700098e0 tx=0x7f41700091a0 comp rx=0 tx=0).stop 2023-10-06T11:12:50.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.746+0000 7f418875f700 1 -- 172.21.15.146:0/1884782456 shutdown_connections 2023-10-06T11:12:50.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.746+0000 7f418875f700 1 --2- 172.21.15.146:0/1884782456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41800ab010 0x7f4180157800 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:50.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.746+0000 7f418875f700 1 -- 172.21.15.146:0/1884782456 >> 172.21.15.146:0/1884782456 conn(0x7f4180067c50 msgr2=0x7f41800ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:50.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.746+0000 7f418875f700 1 -- 172.21.15.146:0/1884782456 shutdown_connections 2023-10-06T11:12:50.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.746+0000 7f418875f700 1 -- 172.21.15.146:0/1884782456 wait complete. 2023-10-06T11:12:50.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.747+0000 7f418875f700 1 Processor -- start 2023-10-06T11:12:50.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.747+0000 7f418875f700 1 -- start start 2023-10-06T11:12:50.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.748+0000 7f418875f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41800ab010 0x7f418006a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:50.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.748+0000 7f418875f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41800ca070 0x7f4180153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:50.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.748+0000 7f418875f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4180157430 0x7f41800c67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:50.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.748+0000 7f418875f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4180069c90 con 0x7f41800ca070 2023-10-06T11:12:50.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.748+0000 7f418875f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4180069080 con 0x7f4180157430 2023-10-06T11:12:50.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.748+0000 7f418875f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4180069360 con 0x7f41800ab010 2023-10-06T11:12:50.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.748+0000 7f4185cfa700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41800ca070 0x7f4180153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:50.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.748+0000 7f4185cfa700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41800ca070 0x7f4180153300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39316/0 (socket says 172.21.15.146:39316) 2023-10-06T11:12:50.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.748+0000 7f4185cfa700 1 -- 172.21.15.146:0/2449224247 learned_addr learned my addr 172.21.15.146:0/2449224247 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:50.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.748+0000 7f4186cfc700 1 --2- 172.21.15.146:0/2449224247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4180157430 0x7f41800c67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:50.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.748+0000 7f41864fb700 1 --2- 172.21.15.146:0/2449224247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41800ab010 0x7f418006a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:50.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.748+0000 7f4185cfa700 1 -- 172.21.15.146:0/2449224247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41800ab010 msgr2=0x7f418006a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:50.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.748+0000 7f4185cfa700 1 --2- 172.21.15.146:0/2449224247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41800ab010 0x7f418006a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:50.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.748+0000 7f4185cfa700 1 -- 172.21.15.146:0/2449224247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4180157430 msgr2=0x7f41800c67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:50.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.748+0000 7f4185cfa700 1 --2- 172.21.15.146:0/2449224247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4180157430 0x7f41800c67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:50.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.748+0000 7f4185cfa700 1 -- 172.21.15.146:0/2449224247 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4170009420 con 0x7f41800ca070 2023-10-06T11:12:50.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.748+0000 7f4185cfa700 1 --2- 172.21.15.146:0/2449224247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41800ca070 0x7f4180153300 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f418006e410 tx=0x7f4170017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:50.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.748+0000 7f41767fc700 1 -- 172.21.15.146:0/2449224247 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417001f070 con 0x7f41800ca070 2023-10-06T11:12:50.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.748+0000 7f41767fc700 1 -- 172.21.15.146:0/2449224247 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4170000bc0 con 0x7f41800ca070 2023-10-06T11:12:50.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.748+0000 7f41767fc700 1 -- 172.21.15.146:0/2449224247 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4170025420 con 0x7f41800ca070 2023-10-06T11:12:50.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.748+0000 7f418875f700 1 -- 172.21.15.146:0/2449224247 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4180069640 con 0x7f41800ca070 2023-10-06T11:12:50.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.748+0000 7f418875f700 1 -- 172.21.15.146:0/2449224247 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4180153840 con 0x7f41800ca070 2023-10-06T11:12:50.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.749+0000 7f418875f700 1 -- 172.21.15.146:0/2449224247 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f418004c380 con 0x7f41800ca070 2023-10-06T11:12:50.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.750+0000 7f41767fc700 1 -- 172.21.15.146:0/2449224247 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4170023070 con 0x7f41800ca070 2023-10-06T11:12:50.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.750+0000 7f41767fc700 1 --2- 172.21.15.146:0/2449224247 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4164066f30 0x7f41640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:50.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.750+0000 7f41767fc700 1 -- 172.21.15.146:0/2449224247 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4170085940 con 0x7f41800ca070 2023-10-06T11:12:50.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.750+0000 7f41864fb700 1 --2- 172.21.15.146:0/2449224247 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4164066f30 0x7f41640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:50.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.750+0000 7f41864fb700 1 --2- 172.21.15.146:0/2449224247 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4164066f30 0x7f41640693e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f41800c8610 tx=0x7f417c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:50.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.754+0000 7f41767fc700 1 -- 172.21.15.146:0/2449224247 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4170052b00 con 0x7f41800ca070 2023-10-06T11:12:50.824 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:12:50.827 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:12:50.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.986+0000 7f418875f700 1 -- 172.21.15.146:0/2449224247 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4180069dd0 con 0x7f41800ca070 2023-10-06T11:12:50.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.986+0000 7f41767fc700 1 -- 172.21.15.146:0/2449224247 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4608 (secure 0 0 0) 0x7f417002a090 con 0x7f41800ca070 2023-10-06T11:12:50.988 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:12:50.988 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":85,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6619,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/1915786440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1915786440},{"type":"v1","addr":"172.21.15.151:6834","nonce":1915786440}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7212,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2292999516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2292999516},{"type":"v1","addr":"172.21.15.146:6836","nonce":2292999516}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7215,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/905558084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":905558084},{"type":"v1","addr":"172.21.15.146:6837","nonce":905558084}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:12:45.107155+0000","modified":"2023-10-06T11:12:48.746860+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7227},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7227":{"gid":7227,"name":"d","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6835/3868165725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":3868165725},{"type":"v1","addr":"172.21.15.151:6835","nonce":3868165725}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T11:12:50.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.989+0000 7f418875f700 1 -- 172.21.15.146:0/2449224247 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4164066f30 msgr2=0x7f41640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:50.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.989+0000 7f418875f700 1 --2- 172.21.15.146:0/2449224247 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4164066f30 0x7f41640693e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f41800c8610 tx=0x7f417c009040 comp rx=0 tx=0).stop 2023-10-06T11:12:50.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.989+0000 7f418875f700 1 -- 172.21.15.146:0/2449224247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41800ca070 msgr2=0x7f4180153300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:50.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.989+0000 7f418875f700 1 --2- 172.21.15.146:0/2449224247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41800ca070 0x7f4180153300 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f418006e410 tx=0x7f4170017000 comp rx=0 tx=0).stop 2023-10-06T11:12:50.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.989+0000 7f418875f700 1 -- 172.21.15.146:0/2449224247 shutdown_connections 2023-10-06T11:12:50.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.989+0000 7f418875f700 1 --2- 172.21.15.146:0/2449224247 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4164066f30 0x7f41640693e0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:50.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.989+0000 7f418875f700 1 --2- 172.21.15.146:0/2449224247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4180157430 0x7f41800c67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:50.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.989+0000 7f418875f700 1 --2- 172.21.15.146:0/2449224247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41800ab010 0x7f418006a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:50.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.989+0000 7f418875f700 1 --2- 172.21.15.146:0/2449224247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f41800ca070 0x7f4180153300 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:50.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.989+0000 7f418875f700 1 -- 172.21.15.146:0/2449224247 >> 172.21.15.146:0/2449224247 conn(0x7f4180067c50 msgr2=0x7f4180153cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:50.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.989+0000 7f418875f700 1 -- 172.21.15.146:0/2449224247 shutdown_connections 2023-10-06T11:12:50.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:50.989+0000 7f418875f700 1 -- 172.21.15.146:0/2449224247 wait complete. 2023-10-06T11:12:50.992 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 85 2023-10-06T11:12:51.405 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 85, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T11:12:45.107155+0000', 'modified': '2023-10-06T11:12:48.746860+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7227}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7227': {'gid': 7227, 'name': 'd', 'rank': 0, 'incarnation': 81, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.151:6835/3868165725', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6833', 'nonce': 3868165725}, {'type': 'v1', 'addr': '172.21.15.151:6835', 'nonce': 3868165725}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T11:12:51.405 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T11:12:51.406 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-06T11:12:51.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.521+0000 7f57f9905700 1 Processor -- start 2023-10-06T11:12:51.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.521+0000 7f57f9905700 1 -- start start 2023-10-06T11:12:51.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.522+0000 7f57f9905700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57f4140d50 0x7f57f40cd960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:51.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.522+0000 7f57f9905700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f57f40c7f10 0x7f57f40c45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:51.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.522+0000 7f57f9905700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57f406f480 con 0x7f57f40cdea0 2023-10-06T11:12:51.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.522+0000 7f57f9905700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57f406e900 con 0x7f57f40c7f10 2023-10-06T11:12:51.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.522+0000 7f57f9905700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57f406ebe0 con 0x7f57f4140d50 2023-10-06T11:12:51.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.523+0000 7f57f2ffd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57f4140d50 0x7f57f40cd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:51.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.523+0000 7f57f37fe700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f57f40c7f10 0x7f57f40c45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:51.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.523+0000 7f57ea7fc700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f57f40cdea0 0x7f57f40c7800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:37426/0 (socket says 172.21.15.146:37426) 2023-10-06T11:12:51.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.523+0000 7f57ea7fc700 1 -- 172.21.15.146:0/1574521352 learned_addr learned my addr 172.21.15.146:0/1574521352 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:12:51.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.523+0000 7f57f27fc700 1 -- 172.21.15.146:0/1574521352 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2240135495 0 0) 0x7f57f406f480 con 0x7f57f40cdea0 2023-10-06T11:12:51.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.523+0000 7f57f27fc700 1 -- 172.21.15.146:0/1574521352 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57e0003570 con 0x7f57f40cdea0 2023-10-06T11:12:51.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.523+0000 7f57f2ffd700 1 -- 172.21.15.146:0/1574521352 >> v2:172.21.15.151:3300/0 conn(0x7f57f40c7f10 msgr2=0x7f57f40c45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:51.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.523+0000 7f57f2ffd700 1 --2- 172.21.15.146:0/1574521352 >> v2:172.21.15.151:3300/0 conn(0x7f57f40c7f10 0x7f57f40c45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.523+0000 7f57f2ffd700 1 -- 172.21.15.146:0/1574521352 >> v1:172.21.15.151:6789/0 conn(0x7f57f40cdea0 legacy=0x7f57f40c7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:51.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.523+0000 7f57f2ffd700 1 -- 172.21.15.146:0/1574521352 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f406eec0 con 0x7f57f4140d50 2023-10-06T11:12:51.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.523+0000 7f57f37fe700 1 --2- 172.21.15.146:0/1574521352 >> v2:172.21.15.151:3300/0 conn(0x7f57f40c7f10 0x7f57f40c45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:12:51.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.523+0000 7f57f2ffd700 1 --2- 172.21.15.146:0/1574521352 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57f4140d50 0x7f57f40cd960 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f57e40098e0 tx=0x7f57e40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cbd83c16934cba0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:51.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.523+0000 7f57f27fc700 1 -- 172.21.15.146:0/1574521352 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e4011630 con 0x7f57f4140d50 2023-10-06T11:12:51.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.523+0000 7f57f27fc700 1 -- 172.21.15.146:0/1574521352 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57e4011790 con 0x7f57f4140d50 2023-10-06T11:12:51.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.523+0000 7f57f27fc700 1 -- 172.21.15.146:0/1574521352 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e4011b30 con 0x7f57f4140d50 2023-10-06T11:12:51.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.524+0000 7f57f9905700 1 -- 172.21.15.146:0/1574521352 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57f4140d50 msgr2=0x7f57f40cd960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:51.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.524+0000 7f57f9905700 1 --2- 172.21.15.146:0/1574521352 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57f4140d50 0x7f57f40cd960 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f57e40098e0 tx=0x7f57e40091a0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.524+0000 7f57f9905700 1 -- 172.21.15.146:0/1574521352 shutdown_connections 2023-10-06T11:12:51.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.524+0000 7f57f9905700 1 --2- 172.21.15.146:0/1574521352 >> v2:172.21.15.151:3300/0 conn(0x7f57f40c7f10 0x7f57f40c45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.524+0000 7f57f9905700 1 --2- 172.21.15.146:0/1574521352 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57f4140d50 0x7f57f40cd960 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.524+0000 7f57f9905700 1 -- 172.21.15.146:0/1574521352 >> 172.21.15.146:0/1574521352 conn(0x7f57f406b040 msgr2=0x7f57f40cd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:51.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.524+0000 7f57f9905700 1 -- 172.21.15.146:0/1574521352 shutdown_connections 2023-10-06T11:12:51.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.524+0000 7f57f9905700 1 -- 172.21.15.146:0/1574521352 wait complete. 2023-10-06T11:12:51.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.525+0000 7f57f9905700 1 Processor -- start 2023-10-06T11:12:51.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.525+0000 7f57f9905700 1 -- start start 2023-10-06T11:12:51.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.526+0000 7f57f9905700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57f40c7f10 0x7f57f4156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:51.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.526+0000 7f57f9905700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57f40cdea0 0x7f57f40c3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:51.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.526+0000 7f57f9905700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57f4140d50 0x7f57f40c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:51.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.526+0000 7f57f9905700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f415a860 con 0x7f57f40cdea0 2023-10-06T11:12:51.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.526+0000 7f57f9905700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57f41571d0 con 0x7f57f40c7f10 2023-10-06T11:12:51.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.526+0000 7f57f9905700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57f40c2e30 con 0x7f57f4140d50 2023-10-06T11:12:51.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.526+0000 7f57ea7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57f40cdea0 0x7f57f40c3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:51.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.526+0000 7f57ea7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57f40cdea0 0x7f57f40c3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52468/0 (socket says 172.21.15.146:52468) 2023-10-06T11:12:51.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.526+0000 7f57ea7fc700 1 -- 172.21.15.146:0/4133618482 learned_addr learned my addr 172.21.15.146:0/4133618482 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:51.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.526+0000 7f57f2ffd700 1 --2- 172.21.15.146:0/4133618482 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57f40c7f10 0x7f57f4156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:51.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.526+0000 7f57f37fe700 1 --2- 172.21.15.146:0/4133618482 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57f4140d50 0x7f57f40c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:51.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.526+0000 7f57ea7fc700 1 -- 172.21.15.146:0/4133618482 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57f4140d50 msgr2=0x7f57f40c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:51.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.526+0000 7f57ea7fc700 1 --2- 172.21.15.146:0/4133618482 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57f4140d50 0x7f57f40c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.526+0000 7f57ea7fc700 1 -- 172.21.15.146:0/4133618482 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57f40c7f10 msgr2=0x7f57f4156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:51.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.526+0000 7f57ea7fc700 1 --2- 172.21.15.146:0/4133618482 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57f40c7f10 0x7f57f4156c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.526+0000 7f57ea7fc700 1 -- 172.21.15.146:0/4133618482 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57ec009a20 con 0x7f57f40cdea0 2023-10-06T11:12:51.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.527+0000 7f57ea7fc700 1 --2- 172.21.15.146:0/4133618482 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57f40cdea0 0x7f57f40c3990 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f57dc00c7f0 tx=0x7f57dc007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:51.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.527+0000 7f57eb7fe700 1 -- 172.21.15.146:0/4133618482 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57dc005c00 con 0x7f57f40cdea0 2023-10-06T11:12:51.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.527+0000 7f57eb7fe700 1 -- 172.21.15.146:0/4133618482 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57dc005d60 con 0x7f57f40cdea0 2023-10-06T11:12:51.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.527+0000 7f57f9905700 1 -- 172.21.15.146:0/4133618482 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57e4009420 con 0x7f57f40cdea0 2023-10-06T11:12:51.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.527+0000 7f57eb7fe700 1 -- 172.21.15.146:0/4133618482 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57dc007300 con 0x7f57f40cdea0 2023-10-06T11:12:51.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.527+0000 7f57f9905700 1 -- 172.21.15.146:0/4133618482 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57f40c22a0 con 0x7f57f40cdea0 2023-10-06T11:12:51.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.528+0000 7f57eb7fe700 1 -- 172.21.15.146:0/4133618482 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f57dc0076b0 con 0x7f57f40cdea0 2023-10-06T11:12:51.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.529+0000 7f57eb7fe700 1 --2- 172.21.15.146:0/4133618482 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f57d4066f30 0x7f57d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:51.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.529+0000 7f57f2ffd700 1 --2- 172.21.15.146:0/4133618482 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f57d4066f30 0x7f57d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:51.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.529+0000 7f57eb7fe700 1 -- 172.21.15.146:0/4133618482 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f57dc083a90 con 0x7f57f40cdea0 2023-10-06T11:12:51.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.529+0000 7f57f2ffd700 1 --2- 172.21.15.146:0/4133618482 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f57d4066f30 0x7f57d40693e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f57e40098e0 tx=0x7f57e4017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:51.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.530+0000 7f5802bfdb80 1 Processor -- start 2023-10-06T11:12:51.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.531+0000 7f5802bfdb80 1 -- start start 2023-10-06T11:12:51.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.531+0000 7f5802bfdb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f973191950 0x55f973191d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:51.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.531+0000 7f5802bfdb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9731dbbc0 0x55f9731ba920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:51.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.531+0000 7f5802bfdb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f9731bae60 0x55f97318d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:51.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.531+0000 7f5802bfdb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f973111c80 con 0x55f9731dbbc0 2023-10-06T11:12:51.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.531+0000 7f5802bfdb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9730e8a70 con 0x55f9731bae60 2023-10-06T11:12:51.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.531+0000 7f5802bfdb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f9730e6270 con 0x55f973191950 2023-10-06T11:12:51.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.531+0000 7f57ea7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9731dbbc0 0x55f9731ba920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:51.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.531+0000 7f57ea7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9731dbbc0 0x55f9731ba920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52470/0 (socket says 172.21.15.146:52470) 2023-10-06T11:12:51.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.531+0000 7f57ea7fc700 1 -- 172.21.15.146:0/3767618767 learned_addr learned my addr 172.21.15.146:0/3767618767 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:51.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.532+0000 7f57f2ffd700 1 --2- 172.21.15.146:0/3767618767 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f973191950 0x55f973191d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:51.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.532+0000 7f57f37fe700 1 --2- 172.21.15.146:0/3767618767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f9731bae60 0x55f97318d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:51.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.532+0000 7f57ea7fc700 1 -- 172.21.15.146:0/3767618767 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f973191950 msgr2=0x55f973191d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:51.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.532+0000 7f57ea7fc700 1 --2- 172.21.15.146:0/3767618767 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f973191950 0x55f973191d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.532+0000 7f57ea7fc700 1 -- 172.21.15.146:0/3767618767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f9731bae60 msgr2=0x55f97318d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:51.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.532+0000 7f57ea7fc700 1 --2- 172.21.15.146:0/3767618767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f9731bae60 0x55f97318d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.532+0000 7f57ea7fc700 1 -- 172.21.15.146:0/3767618767 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f972f7c270 con 0x55f9731dbbc0 2023-10-06T11:12:51.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.532+0000 7f57ea7fc700 1 --2- 172.21.15.146:0/3767618767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9731dbbc0 0x55f9731ba920 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f57dc007ad0 tx=0x7f57dc081db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29d36a55c6872b6a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:51.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.532+0000 7f57d3fff700 1 -- 172.21.15.146:0/3767618767 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57dc054920 con 0x55f9731dbbc0 2023-10-06T11:12:51.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.532+0000 7f57d3fff700 1 -- 172.21.15.146:0/3767618767 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57dc057b70 con 0x55f9731dbbc0 2023-10-06T11:12:51.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.532+0000 7f57d3fff700 1 -- 172.21.15.146:0/3767618767 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57dc05b8c0 con 0x55f9731dbbc0 2023-10-06T11:12:51.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.533+0000 7f5802bfdb80 1 -- 172.21.15.146:0/3767618767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9731dbbc0 msgr2=0x55f9731ba920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:51.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.533+0000 7f5802bfdb80 1 --2- 172.21.15.146:0/3767618767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9731dbbc0 0x55f9731ba920 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f57dc007ad0 tx=0x7f57dc081db0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.533+0000 7f5802bfdb80 1 -- 172.21.15.146:0/3767618767 shutdown_connections 2023-10-06T11:12:51.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.533+0000 7f5802bfdb80 1 --2- 172.21.15.146:0/3767618767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f9731bae60 0x55f97318d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.533+0000 7f5802bfdb80 1 --2- 172.21.15.146:0/3767618767 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f973191950 0x55f973191d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.533+0000 7f5802bfdb80 1 --2- 172.21.15.146:0/3767618767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9731dbbc0 0x55f9731ba920 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.533+0000 7f5802bfdb80 1 -- 172.21.15.146:0/3767618767 >> 172.21.15.146:0/3767618767 conn(0x55f973193270 msgr2=0x55f973193640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:51.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.533+0000 7f5802bfdb80 1 -- 172.21.15.146:0/3767618767 shutdown_connections 2023-10-06T11:12:51.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.533+0000 7f5802bfdb80 1 -- 172.21.15.146:0/3767618767 wait complete. 2023-10-06T11:12:51.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.533+0000 7f5802bfdb80 1 -- start start 2023-10-06T11:12:51.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.533+0000 7f5802bfdb80 1 Processor -- start 2023-10-06T11:12:51.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.534+0000 7f5802bfdb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f973191950 0x55f9731d0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:51.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.534+0000 7f5802bfdb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9731bae60 0x55f9731e8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:51.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.534+0000 7f5802bfdb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f9731dbbc0 0x55f9731e8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:51.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.534+0000 7f5802bfdb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9730e2060 con 0x55f9731bae60 2023-10-06T11:12:51.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.534+0000 7f5802bfdb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f97308d890 con 0x55f973191950 2023-10-06T11:12:51.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.534+0000 7f5802bfdb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f9730a8ea0 con 0x55f9731dbbc0 2023-10-06T11:12:51.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.534+0000 7f5802bfdb80 10 client.0 _ll_register_callbacks cb 0x55f972f7ef30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:12:51.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.534+0000 7f57ea7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9731bae60 0x55f9731e8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:51.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.534+0000 7f57ea7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9731bae60 0x55f9731e8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52484/0 (socket says 172.21.15.146:52484) 2023-10-06T11:12:51.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.534+0000 7f57ea7fc700 1 -- 172.21.15.146:0/2271718953 learned_addr learned my addr 172.21.15.146:0/2271718953 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:51.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.535+0000 7f57f2ffd700 1 --2- 172.21.15.146:0/2271718953 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f973191950 0x55f9731d0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:51.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.535+0000 7f57f37fe700 1 --2- 172.21.15.146:0/2271718953 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f9731dbbc0 0x55f9731e8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:51.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.535+0000 7f57ea7fc700 1 -- 172.21.15.146:0/2271718953 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f9731dbbc0 msgr2=0x55f9731e8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:51.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.535+0000 7f57ea7fc700 1 --2- 172.21.15.146:0/2271718953 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f9731dbbc0 0x55f9731e8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.535+0000 7f57ea7fc700 1 -- 172.21.15.146:0/2271718953 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f973191950 msgr2=0x55f9731d0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:51.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.535+0000 7f57ea7fc700 1 --2- 172.21.15.146:0/2271718953 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f973191950 0x55f9731d0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.535+0000 7f57ea7fc700 1 -- 172.21.15.146:0/2271718953 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57f40c22a0 con 0x55f9731bae60 2023-10-06T11:12:51.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.535+0000 7f57f2ffd700 1 --2- 172.21.15.146:0/2271718953 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f973191950 0x55f9731d0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:12:51.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.535+0000 7f57f37fe700 1 --2- 172.21.15.146:0/2271718953 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f9731dbbc0 0x55f9731e8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:12:51.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.535+0000 7f57ea7fc700 1 --2- 172.21.15.146:0/2271718953 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9731bae60 0x55f9731e8000 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f57dc00c7c0 tx=0x7f57dc06f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32e8393c0c6af6dc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:51.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.535+0000 7f57d17fa700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:12:51.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.535+0000 7f57d17fa700 1 -- 172.21.15.146:0/2271718953 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57dc081070 con 0x55f9731bae60 2023-10-06T11:12:51.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.535+0000 7f57d17fa700 1 -- 172.21.15.146:0/2271718953 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f57dc05b8c0 con 0x55f9731bae60 2023-10-06T11:12:51.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.535+0000 7f5802bfdb80 1 -- 172.21.15.146:0/2271718953 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f973186690 con 0x55f9731bae60 2023-10-06T11:12:51.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.535+0000 7f57d17fa700 1 -- 172.21.15.146:0/2271718953 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57dc007e80 con 0x55f9731bae60 2023-10-06T11:12:51.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.535+0000 7f5802bfdb80 10 client.7350 fetch_fsmap learned FSMap version 85 2023-10-06T11:12:51.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.535+0000 7f5802bfdb80 1 -- 172.21.15.146:0/2271718953 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) v3 -- 0x55f972f1efe0 con 0x55f9731bae60 2023-10-06T11:12:51.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.535+0000 7f57d17fa700 1 -- 172.21.15.146:0/2271718953 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57dc079020 con 0x55f9731bae60 2023-10-06T11:12:51.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.535+0000 7f57d17fa700 1 -- 172.21.15.146:0/2271718953 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 85) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f57dc05b430 con 0x55f9731bae60 2023-10-06T11:12:51.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.535+0000 7f5802bfdb80 10 client.7350 fetch_fsmap finished waiting for FSMap version 85 2023-10-06T11:12:51.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.535+0000 7f5802bfdb80 10 client.7350 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T11:12:51.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.535+0000 7f5802bfdb80 20 client.7350 populate_metadata read hostname 'smithi146' 2023-10-06T11:12:51.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.535+0000 7f5802bfdb80 1 --2- 172.21.15.146:0/2271718953 >> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] conn(0x55f9731d1bd0 0x55f9731d1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:51.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.535+0000 7f5802bfdb80 4 client.7350 mds_command: new command op to 7227 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:12:51.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.535+0000 7f5802bfdb80 1 -- 172.21.15.146:0/2271718953 --> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f9731635c0 con 0x55f9731d1bd0 2023-10-06T11:12:51.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.536+0000 7f57f2ffd700 1 --2- 172.21.15.146:0/2271718953 >> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] conn(0x55f9731d1bd0 0x55f9731d1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:51.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.536+0000 7f57d17fa700 10 client.7350 ms_handle_connect on v2:172.21.15.151:6833/3868165725 2023-10-06T11:12:51.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.536+0000 7f57f2ffd700 1 --2- 172.21.15.146:0/2271718953 >> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] conn(0x55f9731d1bd0 0x55f9731d1fa0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc9d6b19935318c6 server_cookie=a38161ec788508c5 in_seq=0 out_seq=0 2023-10-06T11:12:51.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.537+0000 7f57d17fa700 1 -- 172.21.15.146:0/2271718953 <== mds.0 v2:172.21.15.151:6833/3868165725 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55f9731635c0 con 0x55f9731d1bd0 2023-10-06T11:12:51.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.537+0000 7f57d17fa700 10 client.7350 handle_command_reply: tid=0 2023-10-06T11:12:51.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.537+0000 7f5802bfdb80 1 client.7350 shutdown 2023-10-06T11:12:51.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.537+0000 7f5802bfdb80 1 -- 172.21.15.146:0/2271718953 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9731bae60 msgr2=0x55f9731e8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:51.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.537+0000 7f5802bfdb80 1 --2- 172.21.15.146:0/2271718953 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9731bae60 0x55f9731e8000 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f57dc00c7c0 tx=0x7f57dc06f000 comp rx=0 tx=0).stop 2023-10-06T11:12:51.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.537+0000 7f5802bfdb80 1 -- 172.21.15.146:0/2271718953 shutdown_connections 2023-10-06T11:12:51.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.537+0000 7f5802bfdb80 1 --2- 172.21.15.146:0/2271718953 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f9731dbbc0 0x55f9731e8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.537+0000 7f5802bfdb80 1 --2- 172.21.15.146:0/2271718953 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f973191950 0x55f9731d0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.537+0000 7f5802bfdb80 1 --2- 172.21.15.146:0/2271718953 >> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] conn(0x55f9731d1bd0 0x55f9731d1fa0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.537+0000 7f5802bfdb80 1 --2- 172.21.15.146:0/2271718953 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9731bae60 0x55f9731e8000 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.537+0000 7f57d17fa700 0 client.7350 ms_handle_reset on v2:172.21.15.151:6833/3868165725 2023-10-06T11:12:51.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.537+0000 7f5802bfdb80 1 -- 172.21.15.146:0/2271718953 >> 172.21.15.146:0/2271718953 conn(0x55f973193270 msgr2=0x55f9731d74a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:51.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.537+0000 7f5802bfdb80 1 -- 172.21.15.146:0/2271718953 shutdown_connections 2023-10-06T11:12:51.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.537+0000 7f5802bfdb80 1 -- 172.21.15.146:0/2271718953 wait complete. 2023-10-06T11:12:51.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.537+0000 7f5802bfdb80 20 client.7350 trim_cache size 0 max 16384 2023-10-06T11:12:51.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.554+0000 7f5802bfdb80 1 Processor -- start 2023-10-06T11:12:51.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.554+0000 7f5802bfdb80 1 -- start start 2023-10-06T11:12:51.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.554+0000 7f5802bfdb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f973191950 0x55f9731d58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:51.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.554+0000 7f5802bfdb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f9731bae60 0x55f9731e7d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:51.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.554+0000 7f5802bfdb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f9731dbbc0 0x55f9731e82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:51.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.554+0000 7f5802bfdb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f972f64e30 con 0x55f973191950 2023-10-06T11:12:51.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.554+0000 7f5802bfdb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9731d67a0 con 0x55f9731dbbc0 2023-10-06T11:12:51.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.554+0000 7f5802bfdb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f9731d0ae0 con 0x55f9731bae60 2023-10-06T11:12:51.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.555+0000 7f57f2ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f973191950 0x55f9731d58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:51.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.555+0000 7f57f2ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f973191950 0x55f9731d58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52492/0 (socket says 172.21.15.146:52492) 2023-10-06T11:12:51.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.555+0000 7f57f2ffd700 1 -- 172.21.15.146:0/1664658321 learned_addr learned my addr 172.21.15.146:0/1664658321 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:51.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.555+0000 7f57f2ffd700 1 -- 172.21.15.146:0/1664658321 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f9731bae60 msgr2=0x55f9731e7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:51.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.555+0000 7f57f2ffd700 1 --2- 172.21.15.146:0/1664658321 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f9731bae60 0x55f9731e7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.555+0000 7f57f2ffd700 1 -- 172.21.15.146:0/1664658321 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f9731dbbc0 msgr2=0x55f9731e82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:51.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.555+0000 7f57f2ffd700 1 --2- 172.21.15.146:0/1664658321 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f9731dbbc0 0x55f9731e82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.555+0000 7f57f2ffd700 1 -- 172.21.15.146:0/1664658321 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9730b0780 con 0x55f973191950 2023-10-06T11:12:51.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.555+0000 7f57f2ffd700 1 --2- 172.21.15.146:0/1664658321 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f973191950 0x55f9731d58c0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f57e4006ce0 tx=0x7f57e4029040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=409fae13643d5360 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:51.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.555+0000 7f57e8ff9700 1 -- 172.21.15.146:0/1664658321 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e4021070 con 0x55f973191950 2023-10-06T11:12:51.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.555+0000 7f57e8ff9700 1 -- 172.21.15.146:0/1664658321 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57e402e040 con 0x55f973191950 2023-10-06T11:12:51.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.555+0000 7f57e8ff9700 1 -- 172.21.15.146:0/1664658321 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e401ab10 con 0x55f973191950 2023-10-06T11:12:51.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.556+0000 7f5802bfdb80 1 -- 172.21.15.146:0/1664658321 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f973191950 msgr2=0x55f9731d58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:51.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.556+0000 7f5802bfdb80 1 --2- 172.21.15.146:0/1664658321 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f973191950 0x55f9731d58c0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f57e4006ce0 tx=0x7f57e4029040 comp rx=0 tx=0).stop 2023-10-06T11:12:51.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.556+0000 7f5802bfdb80 1 -- 172.21.15.146:0/1664658321 shutdown_connections 2023-10-06T11:12:51.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.556+0000 7f5802bfdb80 1 --2- 172.21.15.146:0/1664658321 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f9731dbbc0 0x55f9731e82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.556+0000 7f5802bfdb80 1 --2- 172.21.15.146:0/1664658321 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f973191950 0x55f9731d58c0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.556+0000 7f5802bfdb80 1 --2- 172.21.15.146:0/1664658321 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f9731bae60 0x55f9731e7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.556+0000 7f5802bfdb80 1 -- 172.21.15.146:0/1664658321 >> 172.21.15.146:0/1664658321 conn(0x55f973193270 msgr2=0x55f973193640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:51.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.556+0000 7f5802bfdb80 1 -- 172.21.15.146:0/1664658321 shutdown_connections 2023-10-06T11:12:51.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.556+0000 7f5802bfdb80 1 -- 172.21.15.146:0/1664658321 wait complete. 2023-10-06T11:12:51.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.556+0000 7f5802bfdb80 1 -- start start 2023-10-06T11:12:51.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.556+0000 7f5802bfdb80 1 Processor -- start 2023-10-06T11:12:51.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.557+0000 7f5802bfdb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f973191950 0x55f9731b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:51.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.557+0000 7f5802bfdb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f9731bae60 0x55f973226810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:51.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.557+0000 7f5802bfdb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9731dbbc0 0x55f9731ce420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:51.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.557+0000 7f5802bfdb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f97323d770 con 0x55f9731dbbc0 2023-10-06T11:12:51.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.557+0000 7f5802bfdb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9731cf080 con 0x55f973191950 2023-10-06T11:12:51.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.557+0000 7f5802bfdb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f973226d50 con 0x55f9731bae60 2023-10-06T11:12:51.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.557+0000 7f5802bfdb80 10 client.0 _ll_register_callbacks cb 0x55f972f7ef30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:12:51.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.557+0000 7f57f37fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9731dbbc0 0x55f9731ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:51.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.557+0000 7f57f37fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9731dbbc0 0x55f9731ce420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52498/0 (socket says 172.21.15.146:52498) 2023-10-06T11:12:51.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.557+0000 7f57f37fe700 1 -- 172.21.15.146:0/1395366626 learned_addr learned my addr 172.21.15.146:0/1395366626 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:51.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.557+0000 7f57f2ffd700 1 --2- 172.21.15.146:0/1395366626 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f973191950 0x55f9731b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:51.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.557+0000 7f57ea7fc700 1 --2- 172.21.15.146:0/1395366626 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f9731bae60 0x55f973226810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:51.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.557+0000 7f57f37fe700 1 -- 172.21.15.146:0/1395366626 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f9731bae60 msgr2=0x55f973226810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:51.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.557+0000 7f57f37fe700 1 --2- 172.21.15.146:0/1395366626 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f9731bae60 0x55f973226810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.557+0000 7f57f37fe700 1 -- 172.21.15.146:0/1395366626 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f973191950 msgr2=0x55f9731b35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:51.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.557+0000 7f57f37fe700 1 --2- 172.21.15.146:0/1395366626 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f973191950 0x55f9731b35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.557+0000 7f57f37fe700 1 -- 172.21.15.146:0/1395366626 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57f406eec0 con 0x55f9731dbbc0 2023-10-06T11:12:51.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.558+0000 7f57f37fe700 1 --2- 172.21.15.146:0/1395366626 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9731dbbc0 0x55f9731ce420 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f57ec007e90 tx=0x7f57ec00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd7df762bc0501c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:51.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.558+0000 7f57d17fa700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:12:51.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.558+0000 7f57d17fa700 1 -- 172.21.15.146:0/1395366626 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ec00e040 con 0x55f9731dbbc0 2023-10-06T11:12:51.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.558+0000 7f57d17fa700 1 -- 172.21.15.146:0/1395366626 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f57ec002e00 con 0x55f9731dbbc0 2023-10-06T11:12:51.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.558+0000 7f5802bfdb80 1 -- 172.21.15.146:0/1395366626 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f57dc057b70 con 0x55f9731dbbc0 2023-10-06T11:12:51.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.558+0000 7f57d17fa700 1 -- 172.21.15.146:0/1395366626 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57ec017680 con 0x55f9731dbbc0 2023-10-06T11:12:51.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.558+0000 7f5802bfdb80 10 client.7356 fetch_fsmap learned FSMap version 85 2023-10-06T11:12:51.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.558+0000 7f5802bfdb80 1 -- 172.21.15.146:0/1395366626 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) v3 -- 0x55f973097470 con 0x55f9731dbbc0 2023-10-06T11:12:51.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.558+0000 7f57d17fa700 1 -- 172.21.15.146:0/1395366626 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57dc057b70 con 0x55f9731dbbc0 2023-10-06T11:12:51.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.558+0000 7f57d17fa700 1 -- 172.21.15.146:0/1395366626 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 85) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f57ec0177e0 con 0x55f9731dbbc0 2023-10-06T11:12:51.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.558+0000 7f5802bfdb80 10 client.7356 fetch_fsmap finished waiting for FSMap version 85 2023-10-06T11:12:51.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.558+0000 7f5802bfdb80 10 client.7356 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T11:12:51.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.558+0000 7f5802bfdb80 20 client.7356 populate_metadata read hostname 'smithi146' 2023-10-06T11:12:51.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.558+0000 7f5802bfdb80 1 --2- 172.21.15.146:0/1395366626 >> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] conn(0x55f9731da230 0x55f973248d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:51.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.558+0000 7f5802bfdb80 4 client.7356 mds_command: new command op to 7227 tid=0[{"prefix": "status"}] 2023-10-06T11:12:51.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.558+0000 7f5802bfdb80 1 -- 172.21.15.146:0/1395366626 --> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f973084e00 con 0x55f9731da230 2023-10-06T11:12:51.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.558+0000 7f57f2ffd700 1 --2- 172.21.15.146:0/1395366626 >> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] conn(0x55f9731da230 0x55f973248d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:51.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.559+0000 7f57d17fa700 10 client.7356 ms_handle_connect on v2:172.21.15.151:6833/3868165725 2023-10-06T11:12:51.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.559+0000 7f57f2ffd700 1 --2- 172.21.15.146:0/1395366626 >> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] conn(0x55f9731da230 0x55f973248d80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e3561842c556eda server_cookie=fcdb65925c69295a in_seq=0 out_seq=0 2023-10-06T11:12:51.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.559+0000 7f57d17fa700 1 -- 172.21.15.146:0/1395366626 <== mds.0 v2:172.21.15.151:6833/3868165725 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55f973084e00 con 0x55f9731da230 2023-10-06T11:12:51.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.559+0000 7f57d17fa700 10 client.7356 handle_command_reply: tid=0 2023-10-06T11:12:51.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.559+0000 7f5802bfdb80 1 client.7356 shutdown 2023-10-06T11:12:51.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.559+0000 7f5802bfdb80 1 -- 172.21.15.146:0/1395366626 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9731dbbc0 msgr2=0x55f9731ce420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:51.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.559+0000 7f5802bfdb80 1 --2- 172.21.15.146:0/1395366626 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9731dbbc0 0x55f9731ce420 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f57ec007e90 tx=0x7f57ec00b040 comp rx=0 tx=0).stop 2023-10-06T11:12:51.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.559+0000 7f5802bfdb80 1 -- 172.21.15.146:0/1395366626 shutdown_connections 2023-10-06T11:12:51.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.559+0000 7f5802bfdb80 1 --2- 172.21.15.146:0/1395366626 >> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] conn(0x55f9731da230 0x55f973248d80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.559+0000 7f5802bfdb80 1 --2- 172.21.15.146:0/1395366626 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f9731dbbc0 0x55f9731ce420 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.559+0000 7f57d17fa700 0 client.7356 ms_handle_reset on v2:172.21.15.151:6833/3868165725 2023-10-06T11:12:51.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.559+0000 7f5802bfdb80 1 --2- 172.21.15.146:0/1395366626 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f973191950 0x55f9731b35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.559+0000 7f5802bfdb80 1 --2- 172.21.15.146:0/1395366626 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f9731bae60 0x55f973226810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.559+0000 7f5802bfdb80 1 -- 172.21.15.146:0/1395366626 >> 172.21.15.146:0/1395366626 conn(0x55f973193270 msgr2=0x55f9731d58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:51.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.559+0000 7f5802bfdb80 1 -- 172.21.15.146:0/1395366626 shutdown_connections 2023-10-06T11:12:51.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.559+0000 7f5802bfdb80 1 -- 172.21.15.146:0/1395366626 wait complete. 2023-10-06T11:12:51.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.559+0000 7f5802bfdb80 20 client.7356 trim_cache size 0 max 16384 2023-10-06T11:12:51.569 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:12:51.569 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1", 2023-10-06T11:12:51.569 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2023-10-06T11:12:51.569 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 7227, 2023-10-06T11:12:51.569 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2023-10-06T11:12:51.569 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2023-10-06T11:12:51.570 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2023-10-06T11:12:51.570 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 5.8244830009999999, 2023-10-06T11:12:51.570 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 85, 2023-10-06T11:12:51.570 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 89, 2023-10-06T11:12:51.570 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 89, 2023-10-06T11:12:51.570 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 11.927888727999999 2023-10-06T11:12:51.570 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:12:51.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.560+0000 7f57f9905700 1 -- 172.21.15.146:0/4133618482 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f57d4066f30 msgr2=0x7f57d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:51.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.560+0000 7f57f9905700 1 --2- 172.21.15.146:0/4133618482 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f57d4066f30 0x7f57d40693e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f57e40098e0 tx=0x7f57e4017000 comp rx=0 tx=0).stop 2023-10-06T11:12:51.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.560+0000 7f57f9905700 1 -- 172.21.15.146:0/4133618482 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57f40cdea0 msgr2=0x7f57f40c3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:51.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.560+0000 7f57f9905700 1 --2- 172.21.15.146:0/4133618482 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57f40cdea0 0x7f57f40c3990 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f57dc00c7f0 tx=0x7f57dc007dd0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.560+0000 7f57f9905700 1 -- 172.21.15.146:0/4133618482 shutdown_connections 2023-10-06T11:12:51.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.560+0000 7f57f9905700 1 --2- 172.21.15.146:0/4133618482 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f57d4066f30 0x7f57d40693e0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.560+0000 7f57f9905700 1 --2- 172.21.15.146:0/4133618482 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57f4140d50 0x7f57f40c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.560+0000 7f57f9905700 1 --2- 172.21.15.146:0/4133618482 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57f40c7f10 0x7f57f4156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.560+0000 7f57f9905700 1 --2- 172.21.15.146:0/4133618482 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57f40cdea0 0x7f57f40c3990 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.560+0000 7f57f9905700 1 -- 172.21.15.146:0/4133618482 >> 172.21.15.146:0/4133618482 conn(0x7f57f406b040 msgr2=0x7f57f413fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:51.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.560+0000 7f57f9905700 1 -- 172.21.15.146:0/4133618482 shutdown_connections 2023-10-06T11:12:51.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.560+0000 7f57f9905700 1 -- 172.21.15.146:0/4133618482 wait complete. 2023-10-06T11:12:51.574 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T11:12:51.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.688+0000 7efd66cc0700 1 Processor -- start 2023-10-06T11:12:51.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.688+0000 7efd66cc0700 1 -- start start 2023-10-06T11:12:51.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.689+0000 7efd66cc0700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd600b3770 0x7efd600b1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:51.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.689+0000 7efd66cc0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efd6006f780 0x7efd600b1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:51.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.689+0000 7efd66cc0700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd600ae100 con 0x7efd6015cbd0 2023-10-06T11:12:51.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.689+0000 7efd66cc0700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd600d0f10 con 0x7efd6006f780 2023-10-06T11:12:51.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.689+0000 7efd66cc0700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd600d11f0 con 0x7efd600b3770 2023-10-06T11:12:51.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.689+0000 7efd664bf700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efd6006f780 0x7efd600b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:51.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.689+0000 7efd65cbe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7efd6015cbd0 0x7efd600b0870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:51662/0 (socket says 172.21.15.146:51662) 2023-10-06T11:12:51.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.689+0000 7efd65cbe700 1 -- 172.21.15.146:0/2392500678 learned_addr learned my addr 172.21.15.146:0/2392500678 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:12:51.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.689+0000 7efd654bd700 1 --2- 172.21.15.146:0/2392500678 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd600b3770 0x7efd600b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:51.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.689+0000 7efd664bf700 1 -- 172.21.15.146:0/2392500678 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd600b3770 msgr2=0x7efd600b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:12:51.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.689+0000 7efd664bf700 1 --2- 172.21.15.146:0/2392500678 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd600b3770 0x7efd600b1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.689+0000 7efd664bf700 1 -- 172.21.15.146:0/2392500678 >> v1:172.21.15.146:6789/0 conn(0x7efd6015cbd0 legacy=0x7efd600b0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:51.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.689+0000 7efd664bf700 1 -- 172.21.15.146:0/2392500678 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd600ae350 con 0x7efd6006f780 2023-10-06T11:12:51.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.690+0000 7efd664bf700 1 --2- 172.21.15.146:0/2392500678 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd6006f780 0x7efd600b1780 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7efd58009e60 tx=0x7efd58009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c963d3264bf498b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:51.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.690+0000 7efd64cbc700 1 -- 172.21.15.146:0/2392500678 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5800e070 con 0x7efd6006f780 2023-10-06T11:12:51.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.690+0000 7efd64cbc700 1 -- 172.21.15.146:0/2392500678 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5800bc30 con 0x7efd6006f780 2023-10-06T11:12:51.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.690+0000 7efd64cbc700 1 -- 172.21.15.146:0/2392500678 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd58012430 con 0x7efd6006f780 2023-10-06T11:12:51.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.690+0000 7efd66cc0700 1 -- 172.21.15.146:0/2392500678 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd6006f780 msgr2=0x7efd600b1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:51.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.690+0000 7efd66cc0700 1 --2- 172.21.15.146:0/2392500678 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd6006f780 0x7efd600b1780 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7efd58009e60 tx=0x7efd58009780 comp rx=0 tx=0).stop 2023-10-06T11:12:51.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.690+0000 7efd66cc0700 1 -- 172.21.15.146:0/2392500678 shutdown_connections 2023-10-06T11:12:51.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.690+0000 7efd66cc0700 1 --2- 172.21.15.146:0/2392500678 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd6006f780 0x7efd600b1780 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.690+0000 7efd66cc0700 1 --2- 172.21.15.146:0/2392500678 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd600b3770 0x7efd600b1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.690+0000 7efd66cc0700 1 -- 172.21.15.146:0/2392500678 >> 172.21.15.146:0/2392500678 conn(0x7efd6006f380 msgr2=0x7efd600d0660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:51.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.690+0000 7efd66cc0700 1 -- 172.21.15.146:0/2392500678 shutdown_connections 2023-10-06T11:12:51.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.690+0000 7efd66cc0700 1 -- 172.21.15.146:0/2392500678 wait complete. 2023-10-06T11:12:51.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.691+0000 7efd66cc0700 1 Processor -- start 2023-10-06T11:12:51.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.691+0000 7efd66cc0700 1 -- start start 2023-10-06T11:12:51.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.692+0000 7efd66cc0700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd6006f780 0x7efd6014dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:51.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.692+0000 7efd66cc0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd600b3770 0x7efd601462b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:51.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.692+0000 7efd66cc0700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd6015cbd0 0x7efd600b4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:51.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.692+0000 7efd66cc0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd60149090 con 0x7efd600b3770 2023-10-06T11:12:51.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.692+0000 7efd66cc0700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6014e470 con 0x7efd6006f780 2023-10-06T11:12:51.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.692+0000 7efd66cc0700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd600b45a0 con 0x7efd6015cbd0 2023-10-06T11:12:51.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.692+0000 7efd654bd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd600b3770 0x7efd601462b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:51.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.692+0000 7efd654bd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd600b3770 0x7efd601462b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:52512/0 (socket says 172.21.15.146:52512) 2023-10-06T11:12:51.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.692+0000 7efd654bd700 1 -- 172.21.15.146:0/827231057 learned_addr learned my addr 172.21.15.146:0/827231057 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:12:51.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.692+0000 7efd65cbe700 1 --2- 172.21.15.146:0/827231057 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd6006f780 0x7efd6014dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:51.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.692+0000 7efd664bf700 1 --2- 172.21.15.146:0/827231057 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd6015cbd0 0x7efd600b4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:51.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.693+0000 7efd654bd700 1 -- 172.21.15.146:0/827231057 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd6015cbd0 msgr2=0x7efd600b4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:51.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.693+0000 7efd654bd700 1 --2- 172.21.15.146:0/827231057 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd6015cbd0 0x7efd600b4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.693+0000 7efd654bd700 1 -- 172.21.15.146:0/827231057 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd6006f780 msgr2=0x7efd6014dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:51.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.693+0000 7efd654bd700 1 --2- 172.21.15.146:0/827231057 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd6006f780 0x7efd6014dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.693+0000 7efd654bd700 1 -- 172.21.15.146:0/827231057 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd58009a20 con 0x7efd600b3770 2023-10-06T11:12:51.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.693+0000 7efd654bd700 1 --2- 172.21.15.146:0/827231057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd600b3770 0x7efd601462b0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7efd5000d8c0 tx=0x7efd50008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:51.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.693+0000 7efd55ffb700 1 -- 172.21.15.146:0/827231057 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd500125f0 con 0x7efd600b3770 2023-10-06T11:12:51.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.693+0000 7efd55ffb700 1 -- 172.21.15.146:0/827231057 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd50012750 con 0x7efd600b3770 2023-10-06T11:12:51.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.693+0000 7efd66cc0700 1 -- 172.21.15.146:0/827231057 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd600b3c70 con 0x7efd600b3770 2023-10-06T11:12:51.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.693+0000 7efd55ffb700 1 -- 172.21.15.146:0/827231057 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd50012af0 con 0x7efd600b3770 2023-10-06T11:12:51.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.693+0000 7efd66cc0700 1 -- 172.21.15.146:0/827231057 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd600b4230 con 0x7efd600b3770 2023-10-06T11:12:51.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.694+0000 7efd66cc0700 1 -- 172.21.15.146:0/827231057 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd60088170 con 0x7efd600b3770 2023-10-06T11:12:51.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.694+0000 7efd55ffb700 1 -- 172.21.15.146:0/827231057 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efd5001e460 con 0x7efd600b3770 2023-10-06T11:12:51.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.695+0000 7efd55ffb700 1 --2- 172.21.15.146:0/827231057 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7efd44066f30 0x7efd440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:12:51.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.695+0000 7efd55ffb700 1 -- 172.21.15.146:0/827231057 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6058+0+0 (secure 0 0 0) 0x7efd50084c10 con 0x7efd600b3770 2023-10-06T11:12:51.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.695+0000 7efd65cbe700 1 --2- 172.21.15.146:0/827231057 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7efd44066f30 0x7efd440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:12:51.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.695+0000 7efd65cbe700 1 --2- 172.21.15.146:0/827231057 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7efd44066f30 0x7efd440693e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7efd5c001950 tx=0x7efd5c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:12:51.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.699+0000 7efd55ffb700 1 -- 172.21.15.146:0/827231057 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efd50051d20 con 0x7efd600b3770 2023-10-06T11:12:51.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.923+0000 7efd66cc0700 1 -- 172.21.15.146:0/827231057 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7efd600b46e0 con 0x7efd600b3770 2023-10-06T11:12:51.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.924+0000 7efd55ffb700 1 -- 172.21.15.146:0/827231057 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v85) v1 ==== 53+0+73 (secure 0 0 0) 0x7efd50055340 con 0x7efd600b3770 2023-10-06T11:12:51.926 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T11:12:51.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.926+0000 7efd66cc0700 1 -- 172.21.15.146:0/827231057 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7efd44066f30 msgr2=0x7efd440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:51.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.926+0000 7efd66cc0700 1 --2- 172.21.15.146:0/827231057 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7efd44066f30 0x7efd440693e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7efd5c001950 tx=0x7efd5c009040 comp rx=0 tx=0).stop 2023-10-06T11:12:51.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.926+0000 7efd66cc0700 1 -- 172.21.15.146:0/827231057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd600b3770 msgr2=0x7efd601462b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:12:51.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.926+0000 7efd66cc0700 1 --2- 172.21.15.146:0/827231057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd600b3770 0x7efd601462b0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7efd5000d8c0 tx=0x7efd50008040 comp rx=0 tx=0).stop 2023-10-06T11:12:51.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.926+0000 7efd66cc0700 1 -- 172.21.15.146:0/827231057 shutdown_connections 2023-10-06T11:12:51.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.926+0000 7efd66cc0700 1 --2- 172.21.15.146:0/827231057 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7efd44066f30 0x7efd440693e0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.926+0000 7efd66cc0700 1 --2- 172.21.15.146:0/827231057 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efd6015cbd0 0x7efd600b4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.926+0000 7efd66cc0700 1 --2- 172.21.15.146:0/827231057 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd6006f780 0x7efd6014dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.926+0000 7efd66cc0700 1 --2- 172.21.15.146:0/827231057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efd600b3770 0x7efd601462b0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:12:51.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.926+0000 7efd66cc0700 1 -- 172.21.15.146:0/827231057 >> 172.21.15.146:0/827231057 conn(0x7efd6006f380 msgr2=0x7efd6015be30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:12:51.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.926+0000 7efd66cc0700 1 -- 172.21.15.146:0/827231057 shutdown_connections 2023-10-06T11:12:51.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:12:51.926+0000 7efd66cc0700 1 -- 172.21.15.146:0/827231057 wait complete. 2023-10-06T11:12:51.940 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T11:12:51.940 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T11:12:51.940 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2023-10-06T11:12:51.940 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T11:12:51.940 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T11:12:51.940 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T11:12:51.940 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T11:12:51.941 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T11:12:51.941 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:12:51.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:12:51.941 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2023-10-06T11:12:51.957 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:12:51.957 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:12:51.957 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:12:51.957 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:12:51.957 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2023-10-06T11:12:51.957 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:12:51.957 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:12:51.958 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2023-10-06T11:12:51.958 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2023-10-06T11:12:51.958 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:12:51.958 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2023-10-06T11:12:51.958 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2023-10-06T11:12:51.958 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:12:51.958 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2023-10-06T11:12:51.958 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T11:12:51.958 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2023-10-06T11:12:51.958 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T11:12:51.958 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42085sec preferred_lft 42085sec 2023-10-06T11:12:51.958 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link noprefixroute 2023-10-06T11:12:51.959 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:12:51.959 INFO:teuthology.orchestra.run.smithi146.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T11:12:51.959 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0e:4f:33:80:c4:0e brd ff:ff:ff:ff:ff:ff 2023-10-06T11:12:51.959 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T11:12:51.959 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:12:51.959 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3884:6eff:fefc:ffc7/64 scope link 2023-10-06T11:12:51.959 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:12:51.959 INFO:teuthology.orchestra.run.smithi146.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:12:51.959 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0e:4f:33:80:c4:0e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T11:12:51.959 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::c4f:33ff:fe80:c40e/64 scope link 2023-10-06T11:12:51.959 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:12:51.959 INFO:teuthology.orchestra.run.smithi146.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:12:51.960 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 36:96:28:73:57:c4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T11:12:51.960 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3496:28ff:fe73:57c4/64 scope link 2023-10-06T11:12:51.960 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:12:51.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:12:51.960 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T11:12:52.021 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-06T11:12:52.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:12:52.022 DEBUG:teuthology.orchestra.run.smithi146:> route 2023-10-06T11:12:52.078 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2023-10-06T11:12:52.078 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T11:12:52.078 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T11:12:52.078 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T11:12:52.079 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T11:12:52.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:12:52.079 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-10-06T11:12:52.079 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:12:52.079 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T11:12:52.079 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T11:12:52.079 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T11:12:52.079 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:12:52.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:12:52.179 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-10-06T11:12:52.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T11:12:52.193 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T11:12:52.194 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:12:52.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:12:52.194 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2023-10-06T11:12:52.258 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T11:12:52.258 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:12:52.258 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T11:12:52.314 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:12:52.314 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:12:52.314 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:12:52.369 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-06T11:12:52.434 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:12:52.434 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:12:52.498 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:12:52.499 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:12:52.499 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:12:52.500 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-06T11:12:52.554 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T11:12:52.554 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T11:12:52.597 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-06T11:12:52.621 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:12:52.621 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:12:52.678 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:2023-10-06T11:12:52.676+0000 7f899cdee540 -1 init, newargv = 0x5587ee356c10 newargc=15 2023-10-06T11:12:52.678 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[130258]: starting ceph client 2023-10-06T11:12:52.682 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[130258]: starting fuse 2023-10-06T11:12:52.686 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:12:52.687 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:12:52.688 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:12:52.688 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-06T11:12:52.743 INFO:teuthology.orchestra.run.smithi146.stdout:46 2023-10-06T11:12:52.744 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-06T11:12:52.744 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T11:12:52.744 DEBUG:teuthology.orchestra.run.smithi146:> import glob 2023-10-06T11:12:52.744 DEBUG:teuthology.orchestra.run.smithi146:> import re 2023-10-06T11:12:52.744 DEBUG:teuthology.orchestra.run.smithi146:> import os 2023-10-06T11:12:52.744 DEBUG:teuthology.orchestra.run.smithi146:> import subprocess 2023-10-06T11:12:52.744 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:12:52.744 DEBUG:teuthology.orchestra.run.smithi146:> def _find_admin_socket(client_name): 2023-10-06T11:12:52.744 DEBUG:teuthology.orchestra.run.smithi146:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T11:12:52.744 DEBUG:teuthology.orchestra.run.smithi146:> files = glob.glob(asok_path) 2023-10-06T11:12:52.745 DEBUG:teuthology.orchestra.run.smithi146:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T11:12:52.745 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:12:52.745 DEBUG:teuthology.orchestra.run.smithi146:> # Given a non-glob path, it better be there 2023-10-06T11:12:52.745 DEBUG:teuthology.orchestra.run.smithi146:> if "*" not in asok_path: 2023-10-06T11:12:52.745 DEBUG:teuthology.orchestra.run.smithi146:> assert(len(files) == 1) 2023-10-06T11:12:52.745 DEBUG:teuthology.orchestra.run.smithi146:> return files[0] 2023-10-06T11:12:52.745 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:12:52.745 DEBUG:teuthology.orchestra.run.smithi146:> for f in files: 2023-10-06T11:12:52.745 DEBUG:teuthology.orchestra.run.smithi146:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T11:12:52.745 DEBUG:teuthology.orchestra.run.smithi146:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T11:12:52.745 DEBUG:teuthology.orchestra.run.smithi146:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T11:12:52.745 DEBUG:teuthology.orchestra.run.smithi146:> contents = proc_f.read() 2023-10-06T11:12:52.745 DEBUG:teuthology.orchestra.run.smithi146:> if mountpoint in contents: 2023-10-06T11:12:52.746 DEBUG:teuthology.orchestra.run.smithi146:> return f 2023-10-06T11:12:52.746 DEBUG:teuthology.orchestra.run.smithi146:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T11:12:52.746 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:12:52.746 DEBUG:teuthology.orchestra.run.smithi146:> print(_find_admin_socket("client.0")) 2023-10-06T11:12:52.746 DEBUG:teuthology.orchestra.run.smithi146:> ' 2023-10-06T11:12:52.865 INFO:teuthology.orchestra.run.smithi146.stdout:/var/run/ceph/ceph-client.0.130258.asok 2023-10-06T11:12:53.048 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.130258.asok 2023-10-06T11:12:53.048 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:12:53.048 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.130258.asok status 2023-10-06T11:12:53.199 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:12:53.199 INFO:teuthology.orchestra.run.smithi146.stdout: "metadata": { 2023-10-06T11:12:53.199 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T11:12:53.200 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T11:12:53.200 INFO:teuthology.orchestra.run.smithi146.stdout: "entity_id": "0", 2023-10-06T11:12:53.200 INFO:teuthology.orchestra.run.smithi146.stdout: "hostname": "smithi146", 2023-10-06T11:12:53.200 INFO:teuthology.orchestra.run.smithi146.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T11:12:53.200 INFO:teuthology.orchestra.run.smithi146.stdout: "pid": "130258", 2023-10-06T11:12:53.200 INFO:teuthology.orchestra.run.smithi146.stdout: "root": "/" 2023-10-06T11:12:53.200 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:53.200 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_count": 0, 2023-10-06T11:12:53.200 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_pinned_count": 0, 2023-10-06T11:12:53.200 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 7371, 2023-10-06T11:12:53.200 INFO:teuthology.orchestra.run.smithi146.stdout: "inst": { 2023-10-06T11:12:53.201 INFO:teuthology.orchestra.run.smithi146.stdout: "name": { 2023-10-06T11:12:53.201 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "client", 2023-10-06T11:12:53.201 INFO:teuthology.orchestra.run.smithi146.stdout: "num": 7371 2023-10-06T11:12:53.201 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:53.201 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-06T11:12:53.201 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-06T11:12:53.201 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:12:53.201 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 2432128045 2023-10-06T11:12:53.201 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:12:53.201 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:53.201 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-06T11:12:53.201 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-06T11:12:53.201 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:12:53.202 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 2432128045 2023-10-06T11:12:53.202 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:12:53.202 INFO:teuthology.orchestra.run.smithi146.stdout: "inst_str": "client.7371 192.168.0.1:0/2432128045", 2023-10-06T11:12:53.202 INFO:teuthology.orchestra.run.smithi146.stdout: "addr_str": "192.168.0.1:0/2432128045", 2023-10-06T11:12:53.202 INFO:teuthology.orchestra.run.smithi146.stdout: "inode_count": 1, 2023-10-06T11:12:53.202 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_epoch": 85, 2023-10-06T11:12:53.202 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch": 89, 2023-10-06T11:12:53.202 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch_barrier": 0, 2023-10-06T11:12:53.202 INFO:teuthology.orchestra.run.smithi146.stdout: "blocklisted": false, 2023-10-06T11:12:53.202 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs" 2023-10-06T11:12:53.202 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:12:53.209 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:12:53.209 DEBUG:teuthology.orchestra.run.smithi146:> stat --file-system '--printf=%T 2023-10-06T11:12:53.209 DEBUG:teuthology.orchestra.run.smithi146:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T11:12:53.225 INFO:teuthology.orchestra.run.smithi146.stdout:fuseblk 2023-10-06T11:12:53.225 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T11:12:53.226 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:12:53.226 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:12:53.291 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:12:53.291 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:12:53.291 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:12:53.291 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.0 2023-10-06T11:12:53.291 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:12:53.292 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:12:53.292 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:12:53.292 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:12:53.392 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.392 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.392 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118675 s, 88.4 MB/s 2023-10-06T11:12:53.404 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.404 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.404 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00914901 s, 115 MB/s 2023-10-06T11:12:53.419 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.419 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.419 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125163 s, 83.8 MB/s 2023-10-06T11:12:53.430 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.430 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.430 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00916486 s, 114 MB/s 2023-10-06T11:12:53.443 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.443 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.443 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102666 s, 102 MB/s 2023-10-06T11:12:53.456 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.456 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.456 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010394 s, 101 MB/s 2023-10-06T11:12:53.468 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.469 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.469 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106995 s, 98.0 MB/s 2023-10-06T11:12:53.482 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.482 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.482 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109602 s, 95.7 MB/s 2023-10-06T11:12:53.495 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.495 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.495 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109271 s, 96.0 MB/s 2023-10-06T11:12:53.509 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.509 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.509 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112691 s, 93.0 MB/s 2023-10-06T11:12:53.521 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.522 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.522 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104742 s, 100 MB/s 2023-10-06T11:12:53.534 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.534 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.534 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102533 s, 102 MB/s 2023-10-06T11:12:53.546 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.546 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.546 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00980613 s, 107 MB/s 2023-10-06T11:12:53.558 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.558 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.559 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00985938 s, 106 MB/s 2023-10-06T11:12:53.570 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.570 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.571 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00972757 s, 108 MB/s 2023-10-06T11:12:53.582 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.582 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.582 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00953287 s, 110 MB/s 2023-10-06T11:12:53.593 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.593 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.593 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00897215 s, 117 MB/s 2023-10-06T11:12:53.606 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.606 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.606 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107799 s, 97.3 MB/s 2023-10-06T11:12:53.618 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.619 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.619 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104044 s, 101 MB/s 2023-10-06T11:12:53.630 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.630 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.630 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00906697 s, 116 MB/s 2023-10-06T11:12:53.643 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.643 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.644 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112748 s, 93.0 MB/s 2023-10-06T11:12:53.655 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.655 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.655 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00905087 s, 116 MB/s 2023-10-06T11:12:53.668 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.669 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.669 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113815 s, 92.1 MB/s 2023-10-06T11:12:53.680 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.681 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.681 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00976693 s, 107 MB/s 2023-10-06T11:12:53.694 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.694 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.695 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115018 s, 91.2 MB/s 2023-10-06T11:12:53.706 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.706 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.706 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00920341 s, 114 MB/s 2023-10-06T11:12:53.718 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.718 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.718 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00995399 s, 105 MB/s 2023-10-06T11:12:53.731 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.731 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.731 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109225 s, 96.0 MB/s 2023-10-06T11:12:53.743 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.743 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.744 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00957874 s, 109 MB/s 2023-10-06T11:12:53.757 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.757 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.757 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108271 s, 96.8 MB/s 2023-10-06T11:12:53.769 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.769 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.769 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100695 s, 104 MB/s 2023-10-06T11:12:53.781 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.781 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.781 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0099893 s, 105 MB/s 2023-10-06T11:12:53.782 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:12:53.782 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:12:53.783 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:12:53.783 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.1 2023-10-06T11:12:53.783 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:12:53.783 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:12:53.783 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:12:53.783 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:12:53.824 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.825 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.825 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00887755 s, 118 MB/s 2023-10-06T11:12:53.837 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.837 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.837 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106671 s, 98.3 MB/s 2023-10-06T11:12:53.849 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.849 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.849 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00946565 s, 111 MB/s 2023-10-06T11:12:53.861 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.861 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.861 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00998976 s, 105 MB/s 2023-10-06T11:12:53.873 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.873 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.873 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00975803 s, 107 MB/s 2023-10-06T11:12:53.885 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.885 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.885 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00965961 s, 109 MB/s 2023-10-06T11:12:53.896 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.896 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.896 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00899466 s, 117 MB/s 2023-10-06T11:12:53.908 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.908 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.908 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00959549 s, 109 MB/s 2023-10-06T11:12:53.920 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.920 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.920 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00944953 s, 111 MB/s 2023-10-06T11:12:53.932 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.932 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.932 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00963479 s, 109 MB/s 2023-10-06T11:12:53.945 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.945 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.945 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105149 s, 99.7 MB/s 2023-10-06T11:12:53.958 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.958 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.958 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109567 s, 95.7 MB/s 2023-10-06T11:12:53.969 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.970 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.970 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00897922 s, 117 MB/s 2023-10-06T11:12:53.981 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.981 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.981 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0092211 s, 114 MB/s 2023-10-06T11:12:53.994 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:53.994 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:53.994 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00904234 s, 116 MB/s 2023-10-06T11:12:54.004 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.004 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.004 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00896471 s, 117 MB/s 2023-10-06T11:12:54.015 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.015 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.015 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00876556 s, 120 MB/s 2023-10-06T11:12:54.026 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.026 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.026 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00888183 s, 118 MB/s 2023-10-06T11:12:54.041 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.041 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.041 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120247 s, 87.2 MB/s 2023-10-06T11:12:54.053 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.053 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.053 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00951519 s, 110 MB/s 2023-10-06T11:12:54.065 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.065 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.065 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103431 s, 101 MB/s 2023-10-06T11:12:54.077 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.077 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.077 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00936787 s, 112 MB/s 2023-10-06T11:12:54.089 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.089 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.089 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00977193 s, 107 MB/s 2023-10-06T11:12:54.102 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.103 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.103 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011072 s, 94.7 MB/s 2023-10-06T11:12:54.116 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.116 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.116 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107853 s, 97.2 MB/s 2023-10-06T11:12:54.129 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.129 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.129 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108419 s, 96.7 MB/s 2023-10-06T11:12:54.141 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.142 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.142 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00973146 s, 108 MB/s 2023-10-06T11:12:54.152 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.153 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.153 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00934106 s, 112 MB/s 2023-10-06T11:12:54.165 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.166 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.166 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0094895 s, 110 MB/s 2023-10-06T11:12:54.176 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.176 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.176 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00935959 s, 112 MB/s 2023-10-06T11:12:54.188 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.188 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.188 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100055 s, 105 MB/s 2023-10-06T11:12:54.200 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.200 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.200 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00995722 s, 105 MB/s 2023-10-06T11:12:54.201 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:12:54.202 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:12:54.202 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:12:54.202 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.2 2023-10-06T11:12:54.202 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:12:54.202 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:12:54.202 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:12:54.202 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:12:54.285 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.285 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.286 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100521 s, 104 MB/s 2023-10-06T11:12:54.297 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.297 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.297 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00987684 s, 106 MB/s 2023-10-06T11:12:54.308 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.308 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.308 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00904599 s, 116 MB/s 2023-10-06T11:12:54.322 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.322 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.323 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110692 s, 94.7 MB/s 2023-10-06T11:12:54.334 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.334 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.334 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0096845 s, 108 MB/s 2023-10-06T11:12:54.346 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.346 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.346 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00990724 s, 106 MB/s 2023-10-06T11:12:54.358 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.358 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.358 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00965582 s, 109 MB/s 2023-10-06T11:12:54.371 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.371 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.371 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010424 s, 101 MB/s 2023-10-06T11:12:54.385 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.385 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.385 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01067 s, 98.3 MB/s 2023-10-06T11:12:54.396 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.396 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.396 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0094613 s, 111 MB/s 2023-10-06T11:12:54.408 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.408 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.408 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0095899 s, 109 MB/s 2023-10-06T11:12:54.420 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.420 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.421 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105302 s, 99.6 MB/s 2023-10-06T11:12:54.432 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.432 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.432 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00906198 s, 116 MB/s 2023-10-06T11:12:54.445 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.445 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.445 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105816 s, 99.1 MB/s 2023-10-06T11:12:54.456 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.456 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.456 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00877777 s, 119 MB/s 2023-10-06T11:12:54.470 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.471 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.471 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123532 s, 84.9 MB/s 2023-10-06T11:12:54.483 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.483 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.483 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.009735 s, 108 MB/s 2023-10-06T11:12:54.495 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.495 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.495 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00952736 s, 110 MB/s 2023-10-06T11:12:54.508 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.508 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.508 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104841 s, 100 MB/s 2023-10-06T11:12:54.519 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.519 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.520 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00943034 s, 111 MB/s 2023-10-06T11:12:54.531 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.531 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.531 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0096557 s, 109 MB/s 2023-10-06T11:12:54.544 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.544 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.544 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106466 s, 98.5 MB/s 2023-10-06T11:12:54.556 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.557 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.557 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105605 s, 99.3 MB/s 2023-10-06T11:12:54.569 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.569 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.569 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00986287 s, 106 MB/s 2023-10-06T11:12:54.580 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.581 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.581 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00920501 s, 114 MB/s 2023-10-06T11:12:54.591 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.591 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.592 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00880049 s, 119 MB/s 2023-10-06T11:12:54.604 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.604 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.604 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105708 s, 99.2 MB/s 2023-10-06T11:12:54.616 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.616 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.616 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00950056 s, 110 MB/s 2023-10-06T11:12:54.628 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.628 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.628 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100159 s, 105 MB/s 2023-10-06T11:12:54.639 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.639 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.640 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00916689 s, 114 MB/s 2023-10-06T11:12:54.652 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.653 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.653 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104831 s, 100 MB/s 2023-10-06T11:12:54.664 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.664 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.664 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00943855 s, 111 MB/s 2023-10-06T11:12:54.665 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:12:54.665 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:12:54.666 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:12:54.666 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.3 2023-10-06T11:12:54.666 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:12:54.666 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:12:54.666 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:12:54.666 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:12:54.748 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.748 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.748 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0093213 s, 112 MB/s 2023-10-06T11:12:54.759 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.760 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.760 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00957249 s, 110 MB/s 2023-10-06T11:12:54.771 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.771 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.771 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00900564 s, 116 MB/s 2023-10-06T11:12:54.783 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.783 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.783 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00972324 s, 108 MB/s 2023-10-06T11:12:54.796 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.796 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.796 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106279 s, 98.7 MB/s 2023-10-06T11:12:54.808 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.809 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.809 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105583 s, 99.3 MB/s 2023-10-06T11:12:54.821 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.821 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.821 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00983613 s, 107 MB/s 2023-10-06T11:12:54.833 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.833 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.833 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100706 s, 104 MB/s 2023-10-06T11:12:54.845 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.845 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.845 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00943059 s, 111 MB/s 2023-10-06T11:12:54.858 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.858 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.858 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107794 s, 97.3 MB/s 2023-10-06T11:12:54.870 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.870 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.870 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00959227 s, 109 MB/s 2023-10-06T11:12:54.882 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.882 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.882 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00988723 s, 106 MB/s 2023-10-06T11:12:54.893 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.893 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.893 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00887336 s, 118 MB/s 2023-10-06T11:12:54.905 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.905 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.905 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0090449 s, 116 MB/s 2023-10-06T11:12:54.918 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.918 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.918 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105249 s, 99.6 MB/s 2023-10-06T11:12:54.931 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.931 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.931 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010708 s, 97.9 MB/s 2023-10-06T11:12:54.943 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.943 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.944 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00982261 s, 107 MB/s 2023-10-06T11:12:54.957 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.957 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.957 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115832 s, 90.5 MB/s 2023-10-06T11:12:54.968 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.968 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.968 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00891592 s, 118 MB/s 2023-10-06T11:12:54.979 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.980 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.980 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00896137 s, 117 MB/s 2023-10-06T11:12:54.992 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:54.992 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:54.992 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00896169 s, 117 MB/s 2023-10-06T11:12:55.005 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.005 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.005 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108103 s, 97.0 MB/s 2023-10-06T11:12:55.017 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.017 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.017 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00992883 s, 106 MB/s 2023-10-06T11:12:55.029 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.029 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.030 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00982145 s, 107 MB/s 2023-10-06T11:12:55.042 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.042 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.042 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105469 s, 99.4 MB/s 2023-10-06T11:12:55.053 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.054 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.054 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00918294 s, 114 MB/s 2023-10-06T11:12:55.065 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.065 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.065 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0089786 s, 117 MB/s 2023-10-06T11:12:55.077 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.077 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.077 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00964702 s, 109 MB/s 2023-10-06T11:12:55.091 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.091 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.091 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120659 s, 86.9 MB/s 2023-10-06T11:12:55.104 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.104 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.104 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010318 s, 102 MB/s 2023-10-06T11:12:55.115 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.116 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.116 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00922268 s, 114 MB/s 2023-10-06T11:12:55.129 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.129 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.129 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102172 s, 103 MB/s 2023-10-06T11:12:55.129 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:12:55.129 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:12:55.130 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:12:55.130 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.4 2023-10-06T11:12:55.130 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:12:55.130 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:12:55.130 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:12:55.130 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:12:55.212 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.212 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.212 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00980654 s, 107 MB/s 2023-10-06T11:12:55.224 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.224 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.224 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00985224 s, 106 MB/s 2023-10-06T11:12:55.237 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.237 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.237 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105388 s, 99.5 MB/s 2023-10-06T11:12:55.249 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.249 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.249 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00993181 s, 106 MB/s 2023-10-06T11:12:55.263 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.263 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.263 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105657 s, 99.2 MB/s 2023-10-06T11:12:55.275 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.275 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.275 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00973325 s, 108 MB/s 2023-10-06T11:12:55.287 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.288 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.288 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105 s, 99.9 MB/s 2023-10-06T11:12:55.300 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.301 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.301 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104941 s, 99.9 MB/s 2023-10-06T11:12:55.312 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.312 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.312 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00924037 s, 113 MB/s 2023-10-06T11:12:55.323 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.324 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.324 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00911611 s, 115 MB/s 2023-10-06T11:12:55.335 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.336 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.336 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00970257 s, 108 MB/s 2023-10-06T11:12:55.349 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.349 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.349 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107925 s, 97.2 MB/s 2023-10-06T11:12:55.361 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.361 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.362 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00997148 s, 105 MB/s 2023-10-06T11:12:55.374 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.374 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.374 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00929059 s, 113 MB/s 2023-10-06T11:12:55.386 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.386 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.386 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100304 s, 105 MB/s 2023-10-06T11:12:55.398 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.398 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.398 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00930845 s, 113 MB/s 2023-10-06T11:12:55.410 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.410 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.410 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00915591 s, 115 MB/s 2023-10-06T11:12:55.421 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.422 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.422 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00900904 s, 116 MB/s 2023-10-06T11:12:55.433 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.433 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.433 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00920259 s, 114 MB/s 2023-10-06T11:12:55.447 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.447 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.447 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107144 s, 97.9 MB/s 2023-10-06T11:12:55.459 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.459 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.459 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00976586 s, 107 MB/s 2023-10-06T11:12:55.474 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.474 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.474 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125148 s, 83.8 MB/s 2023-10-06T11:12:55.487 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.487 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.487 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0098329 s, 107 MB/s 2023-10-06T11:12:55.499 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.499 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.499 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101457 s, 103 MB/s 2023-10-06T11:12:55.511 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.511 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.511 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00984422 s, 107 MB/s 2023-10-06T11:12:55.524 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.524 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.524 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104431 s, 100 MB/s 2023-10-06T11:12:55.535 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.535 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.535 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00883502 s, 119 MB/s 2023-10-06T11:12:55.546 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.546 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.546 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00891956 s, 118 MB/s 2023-10-06T11:12:55.560 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.560 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.560 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111678 s, 93.9 MB/s 2023-10-06T11:12:55.573 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.573 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.573 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100559 s, 104 MB/s 2023-10-06T11:12:55.585 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.585 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.585 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00964784 s, 109 MB/s 2023-10-06T11:12:55.598 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.598 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.598 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105625 s, 99.3 MB/s 2023-10-06T11:12:55.602 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:12:55.602 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:12:55.602 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:12:55.602 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.5 2023-10-06T11:12:55.602 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:12:55.602 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:12:55.602 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:12:55.602 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:12:55.685 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.685 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.685 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00935889 s, 112 MB/s 2023-10-06T11:12:55.697 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.697 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.697 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00970156 s, 108 MB/s 2023-10-06T11:12:55.709 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.709 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.709 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00982643 s, 107 MB/s 2023-10-06T11:12:55.722 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.722 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.722 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105362 s, 99.5 MB/s 2023-10-06T11:12:55.734 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.734 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.734 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0096124 s, 109 MB/s 2023-10-06T11:12:55.746 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.746 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.746 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102576 s, 102 MB/s 2023-10-06T11:12:55.757 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.757 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.758 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00879365 s, 119 MB/s 2023-10-06T11:12:55.769 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.769 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.770 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100747 s, 104 MB/s 2023-10-06T11:12:55.780 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.780 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.780 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00881923 s, 119 MB/s 2023-10-06T11:12:55.793 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.793 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.793 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010275 s, 102 MB/s 2023-10-06T11:12:55.805 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.806 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.806 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00949447 s, 110 MB/s 2023-10-06T11:12:55.816 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.817 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.817 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00923798 s, 114 MB/s 2023-10-06T11:12:55.828 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.829 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.829 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00971288 s, 108 MB/s 2023-10-06T11:12:55.840 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.840 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.841 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00976111 s, 107 MB/s 2023-10-06T11:12:55.852 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.852 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.853 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0098634 s, 106 MB/s 2023-10-06T11:12:55.863 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.864 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.864 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00884371 s, 119 MB/s 2023-10-06T11:12:55.877 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.877 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.877 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109093 s, 96.1 MB/s 2023-10-06T11:12:55.890 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.890 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.890 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104136 s, 101 MB/s 2023-10-06T11:12:55.901 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.901 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.901 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00865979 s, 121 MB/s 2023-10-06T11:12:55.912 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.912 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.913 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00903052 s, 116 MB/s 2023-10-06T11:12:55.925 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.925 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.925 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100686 s, 104 MB/s 2023-10-06T11:12:55.936 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.937 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.937 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00906054 s, 116 MB/s 2023-10-06T11:12:55.949 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.949 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.949 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0098114 s, 107 MB/s 2023-10-06T11:12:55.961 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.961 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.961 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00983468 s, 107 MB/s 2023-10-06T11:12:55.973 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.973 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.974 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101632 s, 103 MB/s 2023-10-06T11:12:55.985 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.985 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.985 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00956422 s, 110 MB/s 2023-10-06T11:12:55.997 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:55.997 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:55.997 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0099112 s, 106 MB/s 2023-10-06T11:12:56.009 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.009 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.009 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100021 s, 105 MB/s 2023-10-06T11:12:56.022 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.022 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.023 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106634 s, 98.3 MB/s 2023-10-06T11:12:56.035 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.035 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.035 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101824 s, 103 MB/s 2023-10-06T11:12:56.046 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.046 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.046 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00885037 s, 118 MB/s 2023-10-06T11:12:56.058 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.058 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.058 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00879854 s, 119 MB/s 2023-10-06T11:12:56.059 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:12:56.059 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:12:56.059 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:12:56.059 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.6 2023-10-06T11:12:56.059 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:12:56.059 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:12:56.059 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:12:56.060 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:12:56.142 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.143 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.143 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00977408 s, 107 MB/s 2023-10-06T11:12:56.154 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.154 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.154 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0092143 s, 114 MB/s 2023-10-06T11:12:56.165 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.165 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.165 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00877299 s, 120 MB/s 2023-10-06T11:12:56.176 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.177 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.177 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00938978 s, 112 MB/s 2023-10-06T11:12:56.189 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.189 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.189 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101205 s, 104 MB/s 2023-10-06T11:12:56.201 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.201 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.202 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100318 s, 105 MB/s 2023-10-06T11:12:56.214 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.214 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.215 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107664 s, 97.4 MB/s 2023-10-06T11:12:56.227 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.227 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.228 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103684 s, 101 MB/s 2023-10-06T11:12:56.239 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.239 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.240 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00987304 s, 106 MB/s 2023-10-06T11:12:56.250 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.251 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.251 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00857169 s, 122 MB/s 2023-10-06T11:12:56.262 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.262 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.263 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0094794 s, 111 MB/s 2023-10-06T11:12:56.274 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.275 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.275 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101809 s, 103 MB/s 2023-10-06T11:12:56.286 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.286 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.286 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00938468 s, 112 MB/s 2023-10-06T11:12:56.297 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.298 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.298 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00915761 s, 115 MB/s 2023-10-06T11:12:56.309 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.309 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.309 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00956601 s, 110 MB/s 2023-10-06T11:12:56.321 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.321 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.321 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00930351 s, 113 MB/s 2023-10-06T11:12:56.333 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.333 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.333 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100543 s, 104 MB/s 2023-10-06T11:12:56.344 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.344 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.344 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00859557 s, 122 MB/s 2023-10-06T11:12:56.356 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.356 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.356 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00942507 s, 111 MB/s 2023-10-06T11:12:56.366 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.367 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.367 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00849769 s, 123 MB/s 2023-10-06T11:12:56.378 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.378 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.379 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0094091 s, 111 MB/s 2023-10-06T11:12:56.389 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.389 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.390 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0084103 s, 125 MB/s 2023-10-06T11:12:56.401 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.401 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.401 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00911338 s, 115 MB/s 2023-10-06T11:12:56.412 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.412 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.412 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00839482 s, 125 MB/s 2023-10-06T11:12:56.423 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.423 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.423 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0084691 s, 124 MB/s 2023-10-06T11:12:56.435 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.435 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.435 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00926205 s, 113 MB/s 2023-10-06T11:12:56.448 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.448 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.449 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104175 s, 101 MB/s 2023-10-06T11:12:56.460 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.460 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.460 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00915452 s, 115 MB/s 2023-10-06T11:12:56.472 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.472 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.472 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00925215 s, 113 MB/s 2023-10-06T11:12:56.483 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.483 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.483 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00920525 s, 114 MB/s 2023-10-06T11:12:56.494 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.495 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.495 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00855365 s, 123 MB/s 2023-10-06T11:12:56.506 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.507 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.507 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00955411 s, 110 MB/s 2023-10-06T11:12:56.508 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:12:56.508 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:12:56.508 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:12:56.508 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.7 2023-10-06T11:12:56.508 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:12:56.508 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:12:56.508 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:12:56.508 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:12:56.592 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.592 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.592 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100759 s, 104 MB/s 2023-10-06T11:12:56.604 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.604 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.604 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00920264 s, 114 MB/s 2023-10-06T11:12:56.614 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.615 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.615 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00847891 s, 124 MB/s 2023-10-06T11:12:56.626 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.626 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.626 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00868847 s, 121 MB/s 2023-10-06T11:12:56.638 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.638 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.638 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00939536 s, 112 MB/s 2023-10-06T11:12:56.649 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.650 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.650 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0093346 s, 112 MB/s 2023-10-06T11:12:56.661 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.662 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.662 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100901 s, 104 MB/s 2023-10-06T11:12:56.673 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.673 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.673 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00874671 s, 120 MB/s 2023-10-06T11:12:56.684 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.684 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.684 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00829816 s, 126 MB/s 2023-10-06T11:12:56.696 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.696 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.696 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954668 s, 110 MB/s 2023-10-06T11:12:56.707 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.707 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.707 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00910325 s, 115 MB/s 2023-10-06T11:12:56.718 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.719 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.719 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0088596 s, 118 MB/s 2023-10-06T11:12:56.731 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.731 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.731 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102531 s, 102 MB/s 2023-10-06T11:12:56.743 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.743 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.743 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00948309 s, 111 MB/s 2023-10-06T11:12:56.755 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.756 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.756 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102191 s, 103 MB/s 2023-10-06T11:12:56.767 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.767 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.768 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0091694 s, 114 MB/s 2023-10-06T11:12:56.780 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.780 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.780 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00935849 s, 112 MB/s 2023-10-06T11:12:56.791 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.791 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.791 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00847255 s, 124 MB/s 2023-10-06T11:12:56.803 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.804 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.804 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100955 s, 104 MB/s 2023-10-06T11:12:56.816 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.816 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.816 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00959597 s, 109 MB/s 2023-10-06T11:12:56.830 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.830 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.830 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00956865 s, 110 MB/s 2023-10-06T11:12:56.839 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.840 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.840 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00917233 s, 114 MB/s 2023-10-06T11:12:56.852 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.853 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.853 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102622 s, 102 MB/s 2023-10-06T11:12:56.866 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.866 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.866 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106831 s, 98.2 MB/s 2023-10-06T11:12:56.879 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.879 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.879 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103958 s, 101 MB/s 2023-10-06T11:12:56.890 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.890 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.890 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00842968 s, 124 MB/s 2023-10-06T11:12:56.902 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.902 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.902 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00907802 s, 116 MB/s 2023-10-06T11:12:56.914 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.914 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.914 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00994165 s, 105 MB/s 2023-10-06T11:12:56.925 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.925 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.926 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00837318 s, 125 MB/s 2023-10-06T11:12:56.937 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.937 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.937 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00909503 s, 115 MB/s 2023-10-06T11:12:56.948 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.948 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.948 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00842693 s, 124 MB/s 2023-10-06T11:12:56.960 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:56.960 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:56.960 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00923008 s, 114 MB/s 2023-10-06T11:12:56.961 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:12:56.962 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:12:56.962 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:12:56.962 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.8 2023-10-06T11:12:56.962 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:12:56.962 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:12:56.963 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:12:56.963 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:12:57.046 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.046 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.046 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102509 s, 102 MB/s 2023-10-06T11:12:57.059 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.059 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.059 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102372 s, 102 MB/s 2023-10-06T11:12:57.071 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.071 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.072 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00992268 s, 106 MB/s 2023-10-06T11:12:57.083 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.084 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.084 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.009325 s, 112 MB/s 2023-10-06T11:12:57.094 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.095 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.095 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00873322 s, 120 MB/s 2023-10-06T11:12:57.107 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.107 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.108 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101115 s, 104 MB/s 2023-10-06T11:12:57.119 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.119 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.119 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00882414 s, 119 MB/s 2023-10-06T11:12:57.132 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.132 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.132 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100979 s, 104 MB/s 2023-10-06T11:12:57.144 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.144 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.144 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00920641 s, 114 MB/s 2023-10-06T11:12:57.155 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.155 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.155 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00872683 s, 120 MB/s 2023-10-06T11:12:57.168 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.168 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.169 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109585 s, 95.7 MB/s 2023-10-06T11:12:57.180 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.180 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.181 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00939425 s, 112 MB/s 2023-10-06T11:12:57.192 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.192 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.192 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00929056 s, 113 MB/s 2023-10-06T11:12:57.204 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.204 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.204 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00957185 s, 110 MB/s 2023-10-06T11:12:57.216 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.216 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.216 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00963865 s, 109 MB/s 2023-10-06T11:12:57.228 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.229 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.229 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010516 s, 99.7 MB/s 2023-10-06T11:12:57.240 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.241 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.241 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00918957 s, 114 MB/s 2023-10-06T11:12:57.253 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.253 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.253 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00951245 s, 110 MB/s 2023-10-06T11:12:57.265 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.265 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.265 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100268 s, 105 MB/s 2023-10-06T11:12:57.276 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.276 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.276 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00837104 s, 125 MB/s 2023-10-06T11:12:57.288 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.288 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.288 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00966454 s, 108 MB/s 2023-10-06T11:12:57.300 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.300 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.300 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.009557 s, 110 MB/s 2023-10-06T11:12:57.312 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.312 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.312 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00982951 s, 107 MB/s 2023-10-06T11:12:57.324 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.324 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.324 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101534 s, 103 MB/s 2023-10-06T11:12:57.336 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.336 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.336 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00926132 s, 113 MB/s 2023-10-06T11:12:57.348 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.349 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.349 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103078 s, 102 MB/s 2023-10-06T11:12:57.361 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.361 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.361 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102592 s, 102 MB/s 2023-10-06T11:12:57.372 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.373 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.373 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0091679 s, 114 MB/s 2023-10-06T11:12:57.383 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.383 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.384 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00847353 s, 124 MB/s 2023-10-06T11:12:57.396 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.396 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.396 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100817 s, 104 MB/s 2023-10-06T11:12:57.406 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.407 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.407 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00858689 s, 122 MB/s 2023-10-06T11:12:57.418 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.418 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.418 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00862234 s, 122 MB/s 2023-10-06T11:12:57.419 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:12:57.419 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:12:57.419 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:12:57.419 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.9 2023-10-06T11:12:57.419 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:12:57.419 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:12:57.420 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:12:57.420 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:12:57.462 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.462 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.462 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00944467 s, 111 MB/s 2023-10-06T11:12:57.472 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.473 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.473 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00871558 s, 120 MB/s 2023-10-06T11:12:57.483 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.483 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.484 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00859413 s, 122 MB/s 2023-10-06T11:12:57.494 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.495 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.495 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00854473 s, 123 MB/s 2023-10-06T11:12:57.505 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.506 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.506 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00854149 s, 123 MB/s 2023-10-06T11:12:57.518 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.519 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.519 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103402 s, 101 MB/s 2023-10-06T11:12:57.532 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.532 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.532 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111711 s, 93.9 MB/s 2023-10-06T11:12:57.544 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.544 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.544 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00953178 s, 110 MB/s 2023-10-06T11:12:57.556 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.556 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.556 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00924413 s, 113 MB/s 2023-10-06T11:12:57.568 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.568 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.569 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103568 s, 101 MB/s 2023-10-06T11:12:57.581 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.581 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.581 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102129 s, 103 MB/s 2023-10-06T11:12:57.592 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.592 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.592 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00866826 s, 121 MB/s 2023-10-06T11:12:57.604 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.604 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.604 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100182 s, 105 MB/s 2023-10-06T11:12:57.616 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.616 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.616 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00929321 s, 113 MB/s 2023-10-06T11:12:57.627 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.628 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.628 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00943075 s, 111 MB/s 2023-10-06T11:12:57.639 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.640 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.640 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00915713 s, 115 MB/s 2023-10-06T11:12:57.651 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.652 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.652 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101617 s, 103 MB/s 2023-10-06T11:12:57.663 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.663 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.664 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00937713 s, 112 MB/s 2023-10-06T11:12:57.675 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.676 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.676 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00998523 s, 105 MB/s 2023-10-06T11:12:57.695 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.695 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.695 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173645 s, 60.4 MB/s 2023-10-06T11:12:57.707 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.708 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.708 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100275 s, 105 MB/s 2023-10-06T11:12:57.720 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.720 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.720 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101482 s, 103 MB/s 2023-10-06T11:12:57.730 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.731 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.731 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00846165 s, 124 MB/s 2023-10-06T11:12:57.742 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.742 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.742 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00938168 s, 112 MB/s 2023-10-06T11:12:57.754 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.754 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.754 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00884723 s, 119 MB/s 2023-10-06T11:12:57.765 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.765 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.765 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0085059 s, 123 MB/s 2023-10-06T11:12:57.782 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.782 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.782 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0144063 s, 72.8 MB/s 2023-10-06T11:12:57.795 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.795 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.795 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010675 s, 98.2 MB/s 2023-10-06T11:12:57.808 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.808 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.808 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0098728 s, 106 MB/s 2023-10-06T11:12:57.819 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.819 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.819 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00830265 s, 126 MB/s 2023-10-06T11:12:57.831 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.831 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.831 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00981761 s, 107 MB/s 2023-10-06T11:12:57.843 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.844 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.844 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100599 s, 104 MB/s 2023-10-06T11:12:57.845 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:12:57.845 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:12:57.845 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:12:57.845 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.10 2023-10-06T11:12:57.845 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:12:57.845 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:12:57.845 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:12:57.845 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:12:57.929 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.929 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.930 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00995696 s, 105 MB/s 2023-10-06T11:12:57.940 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.940 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.940 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00831648 s, 126 MB/s 2023-10-06T11:12:57.952 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.952 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.952 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00935266 s, 112 MB/s 2023-10-06T11:12:57.964 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.964 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.965 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00984202 s, 107 MB/s 2023-10-06T11:12:57.976 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.976 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.976 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00874395 s, 120 MB/s 2023-10-06T11:12:57.988 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:57.988 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:57.988 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0092825 s, 113 MB/s 2023-10-06T11:12:58.000 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.000 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.000 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00983617 s, 107 MB/s 2023-10-06T11:12:58.013 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.013 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.014 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104345 s, 100 MB/s 2023-10-06T11:12:58.025 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.026 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.026 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00929597 s, 113 MB/s 2023-10-06T11:12:58.037 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.037 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.037 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0089424 s, 117 MB/s 2023-10-06T11:12:58.048 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.048 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.049 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00868956 s, 121 MB/s 2023-10-06T11:12:58.062 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.062 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.062 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106156 s, 98.8 MB/s 2023-10-06T11:12:58.073 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.073 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.073 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00881098 s, 119 MB/s 2023-10-06T11:12:58.085 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.085 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.086 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00942831 s, 111 MB/s 2023-10-06T11:12:58.098 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.098 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.098 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00978 s, 107 MB/s 2023-10-06T11:12:58.109 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.109 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.109 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00867763 s, 121 MB/s 2023-10-06T11:12:58.121 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.121 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.121 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00885627 s, 118 MB/s 2023-10-06T11:12:58.133 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.133 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.133 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00870451 s, 120 MB/s 2023-10-06T11:12:58.145 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.145 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.145 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00979385 s, 107 MB/s 2023-10-06T11:12:58.156 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.156 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.157 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00871751 s, 120 MB/s 2023-10-06T11:12:58.168 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.168 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.168 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00910399 s, 115 MB/s 2023-10-06T11:12:58.182 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.182 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.182 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106981 s, 98.0 MB/s 2023-10-06T11:12:58.194 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.195 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.195 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00910264 s, 115 MB/s 2023-10-06T11:12:58.205 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.205 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.205 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00864491 s, 121 MB/s 2023-10-06T11:12:58.217 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.217 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.217 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00962566 s, 109 MB/s 2023-10-06T11:12:58.229 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.229 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.229 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00922683 s, 114 MB/s 2023-10-06T11:12:58.240 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.240 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.240 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00852212 s, 123 MB/s 2023-10-06T11:12:58.251 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.251 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.251 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00887658 s, 118 MB/s 2023-10-06T11:12:58.266 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.266 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.267 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010857 s, 96.6 MB/s 2023-10-06T11:12:58.277 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.277 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.277 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00968925 s, 108 MB/s 2023-10-06T11:12:58.288 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.288 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.288 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00855572 s, 123 MB/s 2023-10-06T11:12:58.299 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.299 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.299 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00920127 s, 114 MB/s 2023-10-06T11:12:58.300 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:12:58.301 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:12:58.301 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:12:58.301 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.11 2023-10-06T11:12:58.301 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:12:58.301 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:12:58.301 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:12:58.301 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:12:58.345 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.345 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.346 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106386 s, 98.6 MB/s 2023-10-06T11:12:58.357 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.357 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.357 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00876185 s, 120 MB/s 2023-10-06T11:12:58.369 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.369 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.369 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00937246 s, 112 MB/s 2023-10-06T11:12:58.380 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.381 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.381 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00908907 s, 115 MB/s 2023-10-06T11:12:58.393 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.393 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.393 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010311 s, 102 MB/s 2023-10-06T11:12:58.405 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.405 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.405 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00957284 s, 110 MB/s 2023-10-06T11:12:58.416 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.416 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.416 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00855748 s, 123 MB/s 2023-10-06T11:12:58.426 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.427 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.427 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00857308 s, 122 MB/s 2023-10-06T11:12:58.437 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.437 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.438 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00848726 s, 124 MB/s 2023-10-06T11:12:58.450 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.450 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.451 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01039 s, 101 MB/s 2023-10-06T11:12:58.461 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.461 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.461 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00851476 s, 123 MB/s 2023-10-06T11:12:58.473 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.473 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.473 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00929131 s, 113 MB/s 2023-10-06T11:12:58.485 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.485 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.485 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00908297 s, 115 MB/s 2023-10-06T11:12:58.495 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.495 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.496 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00846198 s, 124 MB/s 2023-10-06T11:12:58.506 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.506 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.506 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00852284 s, 123 MB/s 2023-10-06T11:12:58.517 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.517 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.517 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0084388 s, 124 MB/s 2023-10-06T11:12:58.529 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.529 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.529 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00957797 s, 109 MB/s 2023-10-06T11:12:58.540 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.540 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.541 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00915238 s, 115 MB/s 2023-10-06T11:12:58.552 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.552 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.552 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00956185 s, 110 MB/s 2023-10-06T11:12:58.565 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.565 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.565 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00984509 s, 107 MB/s 2023-10-06T11:12:58.576 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.576 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.576 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00900984 s, 116 MB/s 2023-10-06T11:12:58.587 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.587 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.587 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00865508 s, 121 MB/s 2023-10-06T11:12:58.598 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.598 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.598 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00875765 s, 120 MB/s 2023-10-06T11:12:58.610 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.610 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.610 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954044 s, 110 MB/s 2023-10-06T11:12:58.621 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.621 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.621 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00863282 s, 121 MB/s 2023-10-06T11:12:58.633 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.634 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.634 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00972901 s, 108 MB/s 2023-10-06T11:12:58.644 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.645 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.645 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00871316 s, 120 MB/s 2023-10-06T11:12:58.657 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.658 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.658 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104825 s, 100 MB/s 2023-10-06T11:12:58.669 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.669 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.669 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00915072 s, 115 MB/s 2023-10-06T11:12:58.682 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.682 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.682 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00975306 s, 108 MB/s 2023-10-06T11:12:58.695 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.695 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.695 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00940796 s, 111 MB/s 2023-10-06T11:12:58.706 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.706 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.707 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00947116 s, 111 MB/s 2023-10-06T11:12:58.707 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:12:58.708 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:12:58.708 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:12:58.708 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.12 2023-10-06T11:12:58.708 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:12:58.708 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:12:58.708 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:12:58.708 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:12:58.749 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.749 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.749 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00855062 s, 123 MB/s 2023-10-06T11:12:58.759 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.760 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.760 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00839092 s, 125 MB/s 2023-10-06T11:12:58.771 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.771 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.772 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00921996 s, 114 MB/s 2023-10-06T11:12:58.782 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.782 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.782 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0084641 s, 124 MB/s 2023-10-06T11:12:58.793 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.793 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.793 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00850516 s, 123 MB/s 2023-10-06T11:12:58.805 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.805 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.805 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0099731 s, 105 MB/s 2023-10-06T11:12:58.818 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.818 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.818 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101942 s, 103 MB/s 2023-10-06T11:12:58.829 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.829 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.829 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00851206 s, 123 MB/s 2023-10-06T11:12:58.841 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.841 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.841 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00990921 s, 106 MB/s 2023-10-06T11:12:58.852 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.852 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.852 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00847745 s, 124 MB/s 2023-10-06T11:12:58.864 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.864 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.864 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100791 s, 104 MB/s 2023-10-06T11:12:58.876 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.877 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.877 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100893 s, 104 MB/s 2023-10-06T11:12:58.888 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.888 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.889 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00945152 s, 111 MB/s 2023-10-06T11:12:58.900 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.900 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.901 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102398 s, 102 MB/s 2023-10-06T11:12:58.912 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.912 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.912 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00915507 s, 115 MB/s 2023-10-06T11:12:58.924 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.924 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.925 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102337 s, 102 MB/s 2023-10-06T11:12:58.935 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.935 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.935 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00849966 s, 123 MB/s 2023-10-06T11:12:58.947 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.947 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.947 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00919754 s, 114 MB/s 2023-10-06T11:12:58.957 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.958 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.958 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00848424 s, 124 MB/s 2023-10-06T11:12:58.970 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.970 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.970 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101435 s, 103 MB/s 2023-10-06T11:12:58.981 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.982 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.982 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00914645 s, 115 MB/s 2023-10-06T11:12:58.992 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:58.992 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:58.992 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00852107 s, 123 MB/s 2023-10-06T11:12:59.005 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.005 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.005 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010158 s, 103 MB/s 2023-10-06T11:12:59.017 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.017 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.017 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100652 s, 104 MB/s 2023-10-06T11:12:59.028 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.028 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.028 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00839543 s, 125 MB/s 2023-10-06T11:12:59.040 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.040 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.040 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00948547 s, 111 MB/s 2023-10-06T11:12:59.052 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.052 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.053 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100729 s, 104 MB/s 2023-10-06T11:12:59.064 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.064 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.065 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00957838 s, 109 MB/s 2023-10-06T11:12:59.075 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.075 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.075 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00846407 s, 124 MB/s 2023-10-06T11:12:59.086 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.087 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.087 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00948006 s, 111 MB/s 2023-10-06T11:12:59.098 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.098 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.098 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00916943 s, 114 MB/s 2023-10-06T11:12:59.109 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.109 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.110 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00916555 s, 114 MB/s 2023-10-06T11:12:59.111 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:12:59.111 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:12:59.111 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:12:59.111 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.13 2023-10-06T11:12:59.111 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:12:59.111 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:12:59.111 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:12:59.111 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:12:59.193 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.193 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.193 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0097046 s, 108 MB/s 2023-10-06T11:12:59.207 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.207 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.207 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116459 s, 90.0 MB/s 2023-10-06T11:12:59.220 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.220 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.220 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103746 s, 101 MB/s 2023-10-06T11:12:59.231 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.231 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.231 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00907399 s, 116 MB/s 2023-10-06T11:12:59.243 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.243 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.243 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00967557 s, 108 MB/s 2023-10-06T11:12:59.254 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.254 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.254 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00843678 s, 124 MB/s 2023-10-06T11:12:59.266 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.266 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.266 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0096261 s, 109 MB/s 2023-10-06T11:12:59.277 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.277 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.277 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00877084 s, 120 MB/s 2023-10-06T11:12:59.290 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.290 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.290 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106599 s, 98.4 MB/s 2023-10-06T11:12:59.302 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.302 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.302 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00879383 s, 119 MB/s 2023-10-06T11:12:59.313 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.313 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.314 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00988467 s, 106 MB/s 2023-10-06T11:12:59.325 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.325 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.325 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00941274 s, 111 MB/s 2023-10-06T11:12:59.337 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.337 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.337 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0093623 s, 112 MB/s 2023-10-06T11:12:59.349 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.350 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.350 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102521 s, 102 MB/s 2023-10-06T11:12:59.361 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.361 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.361 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00866971 s, 121 MB/s 2023-10-06T11:12:59.374 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.374 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.374 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010429 s, 101 MB/s 2023-10-06T11:12:59.385 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.385 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.385 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00876415 s, 120 MB/s 2023-10-06T11:12:59.396 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.396 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.396 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00851001 s, 123 MB/s 2023-10-06T11:12:59.407 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.407 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.408 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00945159 s, 111 MB/s 2023-10-06T11:12:59.419 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.419 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.419 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00871722 s, 120 MB/s 2023-10-06T11:12:59.430 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.431 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.431 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954975 s, 110 MB/s 2023-10-06T11:12:59.442 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.442 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.442 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00944556 s, 111 MB/s 2023-10-06T11:12:59.454 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.454 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.454 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00945213 s, 111 MB/s 2023-10-06T11:12:59.467 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.467 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.467 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102606 s, 102 MB/s 2023-10-06T11:12:59.480 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.480 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.480 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010094 s, 104 MB/s 2023-10-06T11:12:59.491 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.491 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.491 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00861328 s, 122 MB/s 2023-10-06T11:12:59.502 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.502 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.502 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00881527 s, 119 MB/s 2023-10-06T11:12:59.514 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.514 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.514 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00919971 s, 114 MB/s 2023-10-06T11:12:59.526 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.527 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.527 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104625 s, 100 MB/s 2023-10-06T11:12:59.538 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.538 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.538 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00874487 s, 120 MB/s 2023-10-06T11:12:59.548 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.549 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.549 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00849644 s, 123 MB/s 2023-10-06T11:12:59.561 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.561 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.561 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101324 s, 103 MB/s 2023-10-06T11:12:59.562 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:12:59.562 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:12:59.563 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:12:59.563 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.14 2023-10-06T11:12:59.563 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:12:59.563 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:12:59.563 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:12:59.563 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:12:59.645 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.645 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.645 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00891415 s, 118 MB/s 2023-10-06T11:12:59.658 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.658 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.658 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106889 s, 98.1 MB/s 2023-10-06T11:12:59.669 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.669 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.669 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00904408 s, 116 MB/s 2023-10-06T11:12:59.682 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.682 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.682 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106308 s, 98.6 MB/s 2023-10-06T11:12:59.695 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.696 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.696 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108951 s, 96.2 MB/s 2023-10-06T11:12:59.742 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.742 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.742 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010184 s, 103 MB/s 2023-10-06T11:12:59.753 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.753 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.754 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00916319 s, 114 MB/s 2023-10-06T11:12:59.766 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.766 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.766 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.009989 s, 105 MB/s 2023-10-06T11:12:59.778 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.778 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.778 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00976246 s, 107 MB/s 2023-10-06T11:12:59.789 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.790 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.790 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00923955 s, 113 MB/s 2023-10-06T11:12:59.802 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.802 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.802 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100018 s, 105 MB/s 2023-10-06T11:12:59.813 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.813 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.813 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00869274 s, 121 MB/s 2023-10-06T11:12:59.825 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.825 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.825 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00946445 s, 111 MB/s 2023-10-06T11:12:59.836 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.836 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.836 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00873226 s, 120 MB/s 2023-10-06T11:12:59.848 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.848 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.848 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00928462 s, 113 MB/s 2023-10-06T11:12:59.860 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.861 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.861 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103002 s, 102 MB/s 2023-10-06T11:12:59.873 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.873 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.873 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00992003 s, 106 MB/s 2023-10-06T11:12:59.884 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.884 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.884 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00866525 s, 121 MB/s 2023-10-06T11:12:59.895 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.895 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.895 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00868293 s, 121 MB/s 2023-10-06T11:12:59.911 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.911 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.911 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00875299 s, 120 MB/s 2023-10-06T11:12:59.918 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.918 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.918 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00945225 s, 111 MB/s 2023-10-06T11:12:59.931 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.931 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.931 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103458 s, 101 MB/s 2023-10-06T11:12:59.942 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.942 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.942 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00912037 s, 115 MB/s 2023-10-06T11:12:59.955 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.955 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.956 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105487 s, 99.4 MB/s 2023-10-06T11:12:59.966 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.966 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.967 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0087461 s, 120 MB/s 2023-10-06T11:12:59.980 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.981 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.981 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109427 s, 95.8 MB/s 2023-10-06T11:12:59.992 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:12:59.992 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:12:59.992 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00923299 s, 114 MB/s 2023-10-06T11:13:00.004 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.004 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.004 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100472 s, 104 MB/s 2023-10-06T11:13:00.016 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.017 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.017 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00953671 s, 110 MB/s 2023-10-06T11:13:00.029 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.029 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.030 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106179 s, 98.8 MB/s 2023-10-06T11:13:00.041 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.041 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.041 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00950714 s, 110 MB/s 2023-10-06T11:13:00.053 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.053 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.053 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00941202 s, 111 MB/s 2023-10-06T11:13:00.055 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:00.055 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:00.055 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:00.055 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.15 2023-10-06T11:13:00.055 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:00.055 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:00.055 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:00.055 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:00.137 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.137 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.137 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00932167 s, 112 MB/s 2023-10-06T11:13:00.149 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.149 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.149 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00942199 s, 111 MB/s 2023-10-06T11:13:00.160 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.160 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.160 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00905221 s, 116 MB/s 2023-10-06T11:13:00.172 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.172 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.172 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00960067 s, 109 MB/s 2023-10-06T11:13:00.183 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.184 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.184 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00873327 s, 120 MB/s 2023-10-06T11:13:00.196 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.196 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.196 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00980615 s, 107 MB/s 2023-10-06T11:13:00.207 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.207 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.207 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00882689 s, 119 MB/s 2023-10-06T11:13:00.218 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.218 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.218 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00859752 s, 122 MB/s 2023-10-06T11:13:00.229 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.229 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.229 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00874579 s, 120 MB/s 2023-10-06T11:13:00.240 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.240 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.240 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00854517 s, 123 MB/s 2023-10-06T11:13:00.253 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.253 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.253 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103856 s, 101 MB/s 2023-10-06T11:13:00.265 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.265 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.265 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00968967 s, 108 MB/s 2023-10-06T11:13:00.276 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.276 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.276 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00884398 s, 119 MB/s 2023-10-06T11:13:00.288 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.288 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.288 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00972531 s, 108 MB/s 2023-10-06T11:13:00.299 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.299 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.299 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00894178 s, 117 MB/s 2023-10-06T11:13:00.311 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.311 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.311 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00948262 s, 111 MB/s 2023-10-06T11:13:00.323 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.323 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.323 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00949837 s, 110 MB/s 2023-10-06T11:13:00.335 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.335 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.335 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00946591 s, 111 MB/s 2023-10-06T11:13:00.346 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.346 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.346 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00882801 s, 119 MB/s 2023-10-06T11:13:00.358 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.358 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.358 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00981363 s, 107 MB/s 2023-10-06T11:13:00.369 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.369 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.369 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0089531 s, 117 MB/s 2023-10-06T11:13:00.380 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.380 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.380 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00853041 s, 123 MB/s 2023-10-06T11:13:00.392 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.392 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.392 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00946547 s, 111 MB/s 2023-10-06T11:13:00.405 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.407 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.407 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00964244 s, 109 MB/s 2023-10-06T11:13:00.416 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.416 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.416 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00962726 s, 109 MB/s 2023-10-06T11:13:00.428 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.428 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.428 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101053 s, 104 MB/s 2023-10-06T11:13:00.440 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.440 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.440 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00927189 s, 113 MB/s 2023-10-06T11:13:00.451 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.452 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.452 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00957682 s, 109 MB/s 2023-10-06T11:13:00.464 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.464 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.464 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102986 s, 102 MB/s 2023-10-06T11:13:00.475 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.477 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.477 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00884344 s, 119 MB/s 2023-10-06T11:13:00.487 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.487 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.487 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00857325 s, 122 MB/s 2023-10-06T11:13:00.499 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.499 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.499 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010012 s, 105 MB/s 2023-10-06T11:13:00.500 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:00.500 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:00.500 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:00.501 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.16 2023-10-06T11:13:00.501 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:00.501 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:00.501 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:00.501 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:00.582 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.583 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.583 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00879865 s, 119 MB/s 2023-10-06T11:13:00.595 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.595 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.595 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101134 s, 104 MB/s 2023-10-06T11:13:00.606 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.606 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.606 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00878044 s, 119 MB/s 2023-10-06T11:13:00.618 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.618 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.618 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00942689 s, 111 MB/s 2023-10-06T11:13:00.631 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.631 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.631 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104154 s, 101 MB/s 2023-10-06T11:13:00.642 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.642 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.642 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0088974 s, 118 MB/s 2023-10-06T11:13:00.653 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.654 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.654 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00923801 s, 114 MB/s 2023-10-06T11:13:00.666 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.666 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.666 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00992453 s, 106 MB/s 2023-10-06T11:13:00.678 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.679 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.679 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103538 s, 101 MB/s 2023-10-06T11:13:00.697 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.697 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.697 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0160037 s, 65.5 MB/s 2023-10-06T11:13:00.725 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.725 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.725 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00870394 s, 120 MB/s 2023-10-06T11:13:00.737 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.737 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.738 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00944227 s, 111 MB/s 2023-10-06T11:13:00.748 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.748 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.748 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00864464 s, 121 MB/s 2023-10-06T11:13:00.760 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.760 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.760 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00926905 s, 113 MB/s 2023-10-06T11:13:00.772 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.772 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.772 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00994943 s, 105 MB/s 2023-10-06T11:13:00.785 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.785 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.785 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00992468 s, 106 MB/s 2023-10-06T11:13:00.795 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.795 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.795 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00846185 s, 124 MB/s 2023-10-06T11:13:00.807 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.807 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.808 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00939725 s, 112 MB/s 2023-10-06T11:13:00.818 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.818 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.818 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00848185 s, 124 MB/s 2023-10-06T11:13:00.830 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.830 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.831 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00973241 s, 108 MB/s 2023-10-06T11:13:00.842 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.843 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.843 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101739 s, 103 MB/s 2023-10-06T11:13:00.854 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.855 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.855 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00943432 s, 111 MB/s 2023-10-06T11:13:00.865 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.866 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.866 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00861806 s, 122 MB/s 2023-10-06T11:13:00.877 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.877 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.877 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00887261 s, 118 MB/s 2023-10-06T11:13:00.889 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.889 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.889 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0094743 s, 111 MB/s 2023-10-06T11:13:00.901 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.901 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.901 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0097683 s, 107 MB/s 2023-10-06T11:13:00.913 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.913 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.913 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00937473 s, 112 MB/s 2023-10-06T11:13:00.925 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.925 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.926 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010023 s, 105 MB/s 2023-10-06T11:13:00.937 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.937 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.937 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00971689 s, 108 MB/s 2023-10-06T11:13:00.948 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.948 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.948 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00853053 s, 123 MB/s 2023-10-06T11:13:00.959 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.959 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.959 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00890635 s, 118 MB/s 2023-10-06T11:13:00.971 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:00.972 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:00.972 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00862785 s, 122 MB/s 2023-10-06T11:13:00.972 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:00.972 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:00.973 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:00.973 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.17 2023-10-06T11:13:00.973 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:00.973 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:00.973 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:00.974 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:01.054 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.054 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.054 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00860367 s, 122 MB/s 2023-10-06T11:13:01.064 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.064 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.065 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0086361 s, 121 MB/s 2023-10-06T11:13:01.076 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.076 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.077 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00953854 s, 110 MB/s 2023-10-06T11:13:01.088 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.088 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.089 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00946476 s, 111 MB/s 2023-10-06T11:13:01.100 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.100 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.100 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00956437 s, 110 MB/s 2023-10-06T11:13:01.113 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.113 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.113 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103948 s, 101 MB/s 2023-10-06T11:13:01.124 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.124 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.124 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00853085 s, 123 MB/s 2023-10-06T11:13:01.135 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.135 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.135 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00857999 s, 122 MB/s 2023-10-06T11:13:01.148 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.149 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.149 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101374 s, 103 MB/s 2023-10-06T11:13:01.159 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.159 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.159 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00883707 s, 119 MB/s 2023-10-06T11:13:01.171 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.171 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.171 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00932655 s, 112 MB/s 2023-10-06T11:13:01.182 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.182 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.182 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00876698 s, 120 MB/s 2023-10-06T11:13:01.194 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.194 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.194 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00950979 s, 110 MB/s 2023-10-06T11:13:01.205 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.205 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.206 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00887781 s, 118 MB/s 2023-10-06T11:13:01.216 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.216 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.217 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00875376 s, 120 MB/s 2023-10-06T11:13:01.227 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.227 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.227 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00847436 s, 124 MB/s 2023-10-06T11:13:01.238 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.238 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.238 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00876535 s, 120 MB/s 2023-10-06T11:13:01.250 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.250 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.250 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0086839 s, 121 MB/s 2023-10-06T11:13:01.262 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.262 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.262 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00983555 s, 107 MB/s 2023-10-06T11:13:01.273 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.273 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.273 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00894033 s, 117 MB/s 2023-10-06T11:13:01.285 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.285 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.285 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00903064 s, 116 MB/s 2023-10-06T11:13:01.296 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.296 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.296 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0087482 s, 120 MB/s 2023-10-06T11:13:01.307 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.308 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.308 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00923038 s, 114 MB/s 2023-10-06T11:13:01.318 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.319 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.319 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00903792 s, 116 MB/s 2023-10-06T11:13:01.331 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.331 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.331 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00942742 s, 111 MB/s 2023-10-06T11:13:01.343 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.343 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.343 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00950411 s, 110 MB/s 2023-10-06T11:13:01.354 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.354 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.354 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00881049 s, 119 MB/s 2023-10-06T11:13:01.365 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.366 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.366 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0090876 s, 115 MB/s 2023-10-06T11:13:01.377 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.377 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.377 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00943435 s, 111 MB/s 2023-10-06T11:13:01.389 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.389 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.390 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0097863 s, 107 MB/s 2023-10-06T11:13:01.400 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.401 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.401 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00853473 s, 123 MB/s 2023-10-06T11:13:01.411 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.412 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.412 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00844272 s, 124 MB/s 2023-10-06T11:13:01.413 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:01.413 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:01.413 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:01.413 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.18 2023-10-06T11:13:01.413 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:01.413 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:01.413 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:01.413 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:01.497 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.497 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.497 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104845 s, 100 MB/s 2023-10-06T11:13:01.508 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.508 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.508 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00951688 s, 110 MB/s 2023-10-06T11:13:01.519 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.519 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.519 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00854108 s, 123 MB/s 2023-10-06T11:13:01.530 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.530 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.531 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00872542 s, 120 MB/s 2023-10-06T11:13:01.542 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.542 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.543 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00925325 s, 113 MB/s 2023-10-06T11:13:01.553 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.553 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.553 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00859466 s, 122 MB/s 2023-10-06T11:13:01.564 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.565 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.565 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00934045 s, 112 MB/s 2023-10-06T11:13:01.576 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.576 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.577 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00942135 s, 111 MB/s 2023-10-06T11:13:01.587 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.587 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.587 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00857629 s, 122 MB/s 2023-10-06T11:13:01.599 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.599 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.599 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0095075 s, 110 MB/s 2023-10-06T11:13:01.611 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.611 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.611 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00972978 s, 108 MB/s 2023-10-06T11:13:01.622 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.622 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.622 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.009004 s, 116 MB/s 2023-10-06T11:13:01.635 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.635 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.635 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103433 s, 101 MB/s 2023-10-06T11:13:01.646 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.646 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.646 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00865804 s, 121 MB/s 2023-10-06T11:13:01.657 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.657 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.657 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00871303 s, 120 MB/s 2023-10-06T11:13:01.669 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.669 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.670 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0099157 s, 106 MB/s 2023-10-06T11:13:01.681 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.682 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.682 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00961832 s, 109 MB/s 2023-10-06T11:13:01.694 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.694 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.695 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100171 s, 105 MB/s 2023-10-06T11:13:01.705 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.705 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.705 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00853984 s, 123 MB/s 2023-10-06T11:13:01.737 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.737 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.738 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101928 s, 103 MB/s 2023-10-06T11:13:01.755 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.755 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.755 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0154174 s, 68.0 MB/s 2023-10-06T11:13:01.767 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.768 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.768 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104833 s, 100 MB/s 2023-10-06T11:13:01.780 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.782 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.782 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102608 s, 102 MB/s 2023-10-06T11:13:01.792 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.792 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.792 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00876741 s, 120 MB/s 2023-10-06T11:13:01.803 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.803 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.804 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0086228 s, 122 MB/s 2023-10-06T11:13:01.815 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.815 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.816 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100695 s, 104 MB/s 2023-10-06T11:13:01.826 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.826 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.827 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00878349 s, 119 MB/s 2023-10-06T11:13:01.838 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.839 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.839 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00977573 s, 107 MB/s 2023-10-06T11:13:01.849 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.849 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.849 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00839926 s, 125 MB/s 2023-10-06T11:13:01.862 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.862 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.862 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010544 s, 99.4 MB/s 2023-10-06T11:13:01.874 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.874 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.874 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00944848 s, 111 MB/s 2023-10-06T11:13:01.886 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.886 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.886 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100847 s, 104 MB/s 2023-10-06T11:13:01.887 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:01.888 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:01.888 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:01.888 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.19 2023-10-06T11:13:01.888 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:01.888 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:01.888 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:01.888 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:01.969 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.969 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.970 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00933187 s, 112 MB/s 2023-10-06T11:13:01.980 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.980 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.980 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.008569 s, 122 MB/s 2023-10-06T11:13:01.992 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:01.992 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:01.992 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00990431 s, 106 MB/s 2023-10-06T11:13:02.004 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.004 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.004 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0090919 s, 115 MB/s 2023-10-06T11:13:02.016 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.016 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.017 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104282 s, 101 MB/s 2023-10-06T11:13:02.029 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.029 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.029 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103809 s, 101 MB/s 2023-10-06T11:13:02.041 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.042 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.042 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100802 s, 104 MB/s 2023-10-06T11:13:02.053 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.054 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.054 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00975278 s, 108 MB/s 2023-10-06T11:13:02.066 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.066 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.066 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101515 s, 103 MB/s 2023-10-06T11:13:02.078 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.078 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.078 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00923163 s, 114 MB/s 2023-10-06T11:13:02.089 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.090 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.091 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954547 s, 110 MB/s 2023-10-06T11:13:02.101 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.101 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.101 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00944067 s, 111 MB/s 2023-10-06T11:13:02.114 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.114 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.114 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102827 s, 102 MB/s 2023-10-06T11:13:02.125 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.125 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.125 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00853577 s, 123 MB/s 2023-10-06T11:13:02.137 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.137 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.137 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0094748 s, 111 MB/s 2023-10-06T11:13:02.147 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.147 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.148 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00877309 s, 120 MB/s 2023-10-06T11:13:02.160 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.160 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.160 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102914 s, 102 MB/s 2023-10-06T11:13:02.172 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.173 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.173 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010057 s, 104 MB/s 2023-10-06T11:13:02.184 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.184 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.184 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00939 s, 112 MB/s 2023-10-06T11:13:02.196 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.196 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.196 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100806 s, 104 MB/s 2023-10-06T11:13:02.207 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.208 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.208 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00939068 s, 112 MB/s 2023-10-06T11:13:02.219 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.219 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.219 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00911893 s, 115 MB/s 2023-10-06T11:13:02.230 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.230 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.231 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00927543 s, 113 MB/s 2023-10-06T11:13:02.242 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.243 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.243 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00974604 s, 108 MB/s 2023-10-06T11:13:02.255 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.255 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.255 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101105 s, 104 MB/s 2023-10-06T11:13:02.267 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.267 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.267 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00957054 s, 110 MB/s 2023-10-06T11:13:02.279 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.279 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.279 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00946918 s, 111 MB/s 2023-10-06T11:13:02.292 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.292 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.292 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010508 s, 99.8 MB/s 2023-10-06T11:13:02.304 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.305 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.305 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105447 s, 99.4 MB/s 2023-10-06T11:13:02.316 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.316 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.316 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00940243 s, 112 MB/s 2023-10-06T11:13:02.328 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.328 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.328 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0095943 s, 109 MB/s 2023-10-06T11:13:02.340 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.341 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.341 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101463 s, 103 MB/s 2023-10-06T11:13:02.342 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:02.343 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:02.343 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:02.343 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.20 2023-10-06T11:13:02.343 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:02.343 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:02.344 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:02.344 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:02.425 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.425 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.425 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00948503 s, 111 MB/s 2023-10-06T11:13:02.437 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.437 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.437 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0096495 s, 109 MB/s 2023-10-06T11:13:02.449 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.449 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.449 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00973483 s, 108 MB/s 2023-10-06T11:13:02.460 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.460 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.460 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00865406 s, 121 MB/s 2023-10-06T11:13:02.472 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.472 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.473 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00956447 s, 110 MB/s 2023-10-06T11:13:02.483 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.483 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.483 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00851058 s, 123 MB/s 2023-10-06T11:13:02.495 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.496 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.496 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103115 s, 102 MB/s 2023-10-06T11:13:02.507 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.507 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.507 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00870498 s, 120 MB/s 2023-10-06T11:13:02.518 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.519 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.519 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00920345 s, 114 MB/s 2023-10-06T11:13:02.530 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.530 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.531 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00947322 s, 111 MB/s 2023-10-06T11:13:02.541 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.541 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.541 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00868289 s, 121 MB/s 2023-10-06T11:13:02.554 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.554 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.554 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102616 s, 102 MB/s 2023-10-06T11:13:02.565 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.565 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.565 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00842966 s, 124 MB/s 2023-10-06T11:13:02.576 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.576 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.577 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00942164 s, 111 MB/s 2023-10-06T11:13:02.588 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.589 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.589 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00922773 s, 114 MB/s 2023-10-06T11:13:02.600 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.601 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.601 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100706 s, 104 MB/s 2023-10-06T11:13:02.612 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.612 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.612 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00918539 s, 114 MB/s 2023-10-06T11:13:02.624 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.624 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.624 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00939083 s, 112 MB/s 2023-10-06T11:13:02.636 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.636 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.636 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100461 s, 104 MB/s 2023-10-06T11:13:02.647 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.647 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.647 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00851699 s, 123 MB/s 2023-10-06T11:13:02.659 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.659 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.659 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00955341 s, 110 MB/s 2023-10-06T11:13:02.670 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.670 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.670 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00875424 s, 120 MB/s 2023-10-06T11:13:02.681 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.682 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.682 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00943201 s, 111 MB/s 2023-10-06T11:13:02.693 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.693 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.693 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00949817 s, 110 MB/s 2023-10-06T11:13:02.708 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.709 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.709 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0124586 s, 84.2 MB/s 2023-10-06T11:13:02.739 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.739 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.739 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00878819 s, 119 MB/s 2023-10-06T11:13:02.751 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.751 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.751 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00953482 s, 110 MB/s 2023-10-06T11:13:02.763 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.763 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.763 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00930717 s, 113 MB/s 2023-10-06T11:13:02.775 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.775 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.775 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0098247 s, 107 MB/s 2023-10-06T11:13:02.786 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.786 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.786 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00858499 s, 122 MB/s 2023-10-06T11:13:02.802 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.802 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.802 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.014174 s, 74.0 MB/s 2023-10-06T11:13:02.814 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.814 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.814 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00953087 s, 110 MB/s 2023-10-06T11:13:02.815 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:02.815 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:02.816 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:02.816 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.21 2023-10-06T11:13:02.816 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:02.816 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:02.816 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:02.816 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:02.897 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.898 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.898 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00915114 s, 115 MB/s 2023-10-06T11:13:02.909 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.909 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.909 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00933076 s, 112 MB/s 2023-10-06T11:13:02.920 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.920 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.920 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00864674 s, 121 MB/s 2023-10-06T11:13:02.932 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.932 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.933 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103503 s, 101 MB/s 2023-10-06T11:13:02.944 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.944 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.944 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0094036 s, 112 MB/s 2023-10-06T11:13:02.956 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.956 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.956 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00930405 s, 113 MB/s 2023-10-06T11:13:02.968 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.968 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.968 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00960494 s, 109 MB/s 2023-10-06T11:13:02.979 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.979 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.979 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00925091 s, 113 MB/s 2023-10-06T11:13:02.991 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:02.991 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:02.991 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100723 s, 104 MB/s 2023-10-06T11:13:03.003 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.003 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.003 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00922458 s, 114 MB/s 2023-10-06T11:13:03.016 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.017 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.017 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109187 s, 96.0 MB/s 2023-10-06T11:13:03.028 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.028 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.028 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00907394 s, 116 MB/s 2023-10-06T11:13:03.039 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.040 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.040 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00904574 s, 116 MB/s 2023-10-06T11:13:03.050 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.051 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.051 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00908843 s, 115 MB/s 2023-10-06T11:13:03.061 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.061 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.062 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00859542 s, 122 MB/s 2023-10-06T11:13:03.074 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.074 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.074 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010033 s, 105 MB/s 2023-10-06T11:13:03.086 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.086 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.086 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00947357 s, 111 MB/s 2023-10-06T11:13:03.097 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.097 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.097 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00862416 s, 122 MB/s 2023-10-06T11:13:03.108 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.108 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.108 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00927607 s, 113 MB/s 2023-10-06T11:13:03.121 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.121 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.121 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010153 s, 103 MB/s 2023-10-06T11:13:03.132 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.132 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.133 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00934125 s, 112 MB/s 2023-10-06T11:13:03.144 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.144 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.144 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00911327 s, 115 MB/s 2023-10-06T11:13:03.156 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.156 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.156 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00914284 s, 115 MB/s 2023-10-06T11:13:03.167 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.167 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.167 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00935487 s, 112 MB/s 2023-10-06T11:13:03.179 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.179 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.179 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00904066 s, 116 MB/s 2023-10-06T11:13:03.190 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.191 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.191 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00927131 s, 113 MB/s 2023-10-06T11:13:03.202 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.202 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.202 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00927321 s, 113 MB/s 2023-10-06T11:13:03.215 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.215 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.215 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108662 s, 96.5 MB/s 2023-10-06T11:13:03.226 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.226 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.226 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00880769 s, 119 MB/s 2023-10-06T11:13:03.237 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.238 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.238 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00880303 s, 119 MB/s 2023-10-06T11:13:03.248 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.248 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.248 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00852094 s, 123 MB/s 2023-10-06T11:13:03.259 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.260 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.260 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00854647 s, 123 MB/s 2023-10-06T11:13:03.261 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:03.261 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:03.261 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:03.261 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.22 2023-10-06T11:13:03.262 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:03.262 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:03.262 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:03.262 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:03.343 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.343 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.343 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00936412 s, 112 MB/s 2023-10-06T11:13:03.353 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.354 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.354 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0084543 s, 124 MB/s 2023-10-06T11:13:03.365 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.365 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.365 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00871104 s, 120 MB/s 2023-10-06T11:13:03.376 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.376 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.376 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00919531 s, 114 MB/s 2023-10-06T11:13:03.387 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.387 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.387 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00853676 s, 123 MB/s 2023-10-06T11:13:03.400 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.400 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.400 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010428 s, 101 MB/s 2023-10-06T11:13:03.411 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.411 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.411 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00838124 s, 125 MB/s 2023-10-06T11:13:03.423 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.423 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.423 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00959673 s, 109 MB/s 2023-10-06T11:13:03.435 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.435 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.435 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102446 s, 102 MB/s 2023-10-06T11:13:03.448 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.449 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.449 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105419 s, 99.5 MB/s 2023-10-06T11:13:03.461 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.461 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.461 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100329 s, 105 MB/s 2023-10-06T11:13:03.473 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.473 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.473 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00927948 s, 113 MB/s 2023-10-06T11:13:03.483 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.484 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.484 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00863572 s, 121 MB/s 2023-10-06T11:13:03.497 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.497 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.497 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105061 s, 99.8 MB/s 2023-10-06T11:13:03.508 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.508 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.508 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0084165 s, 125 MB/s 2023-10-06T11:13:03.521 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.521 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.521 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00867558 s, 121 MB/s 2023-10-06T11:13:03.531 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.531 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.531 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00942514 s, 111 MB/s 2023-10-06T11:13:03.543 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.543 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.543 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00960643 s, 109 MB/s 2023-10-06T11:13:03.554 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.554 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.554 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00914872 s, 115 MB/s 2023-10-06T11:13:03.565 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.565 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.565 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00849523 s, 123 MB/s 2023-10-06T11:13:03.576 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.576 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.576 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0082758 s, 127 MB/s 2023-10-06T11:13:03.587 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.587 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.587 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00855901 s, 123 MB/s 2023-10-06T11:13:03.600 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.600 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.600 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103691 s, 101 MB/s 2023-10-06T11:13:03.611 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.612 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.612 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00930132 s, 113 MB/s 2023-10-06T11:13:03.622 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.623 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.623 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00868491 s, 121 MB/s 2023-10-06T11:13:03.634 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.634 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.634 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00874666 s, 120 MB/s 2023-10-06T11:13:03.646 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.646 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.646 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00962297 s, 109 MB/s 2023-10-06T11:13:03.657 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.658 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.658 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00932345 s, 112 MB/s 2023-10-06T11:13:03.669 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.669 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.669 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00869497 s, 121 MB/s 2023-10-06T11:13:03.682 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.682 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.682 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102849 s, 102 MB/s 2023-10-06T11:13:03.693 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.694 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.694 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00942053 s, 111 MB/s 2023-10-06T11:13:03.710 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.710 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.711 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.013553 s, 77.4 MB/s 2023-10-06T11:13:03.711 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:03.711 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:03.711 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:03.712 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.23 2023-10-06T11:13:03.712 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:03.712 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:03.712 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:03.712 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:03.793 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.793 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.793 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00971603 s, 108 MB/s 2023-10-06T11:13:03.806 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.806 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.806 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102319 s, 102 MB/s 2023-10-06T11:13:03.818 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.818 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.818 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00991124 s, 106 MB/s 2023-10-06T11:13:03.829 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.829 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.829 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0085988 s, 122 MB/s 2023-10-06T11:13:03.841 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.841 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.841 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00941761 s, 111 MB/s 2023-10-06T11:13:03.853 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.853 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.853 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102004 s, 103 MB/s 2023-10-06T11:13:03.866 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.866 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.866 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100443 s, 104 MB/s 2023-10-06T11:13:03.878 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.878 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.878 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100433 s, 104 MB/s 2023-10-06T11:13:03.891 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.891 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.891 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00986052 s, 106 MB/s 2023-10-06T11:13:03.903 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.904 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.904 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101651 s, 103 MB/s 2023-10-06T11:13:03.915 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.915 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.915 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00928874 s, 113 MB/s 2023-10-06T11:13:03.926 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.926 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.927 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00870354 s, 120 MB/s 2023-10-06T11:13:03.937 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.937 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.937 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00856731 s, 122 MB/s 2023-10-06T11:13:03.949 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.949 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.949 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00945698 s, 111 MB/s 2023-10-06T11:13:03.960 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.960 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.960 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00904121 s, 116 MB/s 2023-10-06T11:13:03.972 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.972 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.972 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954857 s, 110 MB/s 2023-10-06T11:13:03.983 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.983 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.983 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00840629 s, 125 MB/s 2023-10-06T11:13:03.993 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:03.994 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:03.994 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00848491 s, 124 MB/s 2023-10-06T11:13:04.004 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.005 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.005 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00851651 s, 123 MB/s 2023-10-06T11:13:04.017 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.017 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.017 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00945238 s, 111 MB/s 2023-10-06T11:13:04.027 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.028 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.028 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00828202 s, 127 MB/s 2023-10-06T11:13:04.040 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.040 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.040 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00992476 s, 106 MB/s 2023-10-06T11:13:04.051 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.051 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.051 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00867655 s, 121 MB/s 2023-10-06T11:13:04.063 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.063 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.063 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00994117 s, 105 MB/s 2023-10-06T11:13:04.075 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.075 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.075 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00939408 s, 112 MB/s 2023-10-06T11:13:04.086 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.086 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.086 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00875432 s, 120 MB/s 2023-10-06T11:13:04.099 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.099 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.099 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103488 s, 101 MB/s 2023-10-06T11:13:04.110 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.110 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.110 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00896438 s, 117 MB/s 2023-10-06T11:13:04.122 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.122 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.122 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00958639 s, 109 MB/s 2023-10-06T11:13:04.133 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.133 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.133 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00843073 s, 124 MB/s 2023-10-06T11:13:04.145 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.145 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.145 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954624 s, 110 MB/s 2023-10-06T11:13:04.156 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.156 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.156 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00831517 s, 126 MB/s 2023-10-06T11:13:04.157 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:04.157 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:04.157 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:04.157 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.24 2023-10-06T11:13:04.157 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:04.157 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:04.157 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:04.157 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:04.238 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.238 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.238 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00863334 s, 121 MB/s 2023-10-06T11:13:04.251 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.251 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.251 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105733 s, 99.2 MB/s 2023-10-06T11:13:04.263 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.263 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.264 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00979843 s, 107 MB/s 2023-10-06T11:13:04.275 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.275 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.275 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00926553 s, 113 MB/s 2023-10-06T11:13:04.286 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.286 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.286 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00869138 s, 121 MB/s 2023-10-06T11:13:04.297 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.297 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.297 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0087729 s, 120 MB/s 2023-10-06T11:13:04.310 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.310 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.310 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00993897 s, 106 MB/s 2023-10-06T11:13:04.321 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.321 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.321 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00865239 s, 121 MB/s 2023-10-06T11:13:04.333 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.333 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.333 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00982019 s, 107 MB/s 2023-10-06T11:13:04.344 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.344 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.345 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0093301 s, 112 MB/s 2023-10-06T11:13:04.356 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.356 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.356 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00911958 s, 115 MB/s 2023-10-06T11:13:04.369 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.369 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.369 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102207 s, 103 MB/s 2023-10-06T11:13:04.380 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.381 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.381 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00940785 s, 111 MB/s 2023-10-06T11:13:04.392 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.392 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.392 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00921375 s, 114 MB/s 2023-10-06T11:13:04.404 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.404 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.404 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00936519 s, 112 MB/s 2023-10-06T11:13:04.416 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.416 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.416 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00951659 s, 110 MB/s 2023-10-06T11:13:04.427 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.427 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.427 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0086574 s, 121 MB/s 2023-10-06T11:13:04.439 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.439 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.439 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00955169 s, 110 MB/s 2023-10-06T11:13:04.451 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.452 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.452 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102786 s, 102 MB/s 2023-10-06T11:13:04.462 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.462 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.463 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00875798 s, 120 MB/s 2023-10-06T11:13:04.474 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.475 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.475 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00940723 s, 111 MB/s 2023-10-06T11:13:04.486 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.486 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.486 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00909894 s, 115 MB/s 2023-10-06T11:13:04.497 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.498 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.498 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00945538 s, 111 MB/s 2023-10-06T11:13:04.510 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.510 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.511 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105194 s, 99.7 MB/s 2023-10-06T11:13:04.523 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.523 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.524 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105331 s, 99.6 MB/s 2023-10-06T11:13:04.536 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.536 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.536 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00982692 s, 107 MB/s 2023-10-06T11:13:04.547 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.547 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.547 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00904081 s, 116 MB/s 2023-10-06T11:13:04.558 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.559 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.559 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00870369 s, 120 MB/s 2023-10-06T11:13:04.570 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.570 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.570 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00873981 s, 120 MB/s 2023-10-06T11:13:04.581 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.581 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.581 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00887117 s, 118 MB/s 2023-10-06T11:13:04.592 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.593 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.593 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00950533 s, 110 MB/s 2023-10-06T11:13:04.606 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.606 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.606 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104446 s, 100 MB/s 2023-10-06T11:13:04.607 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:04.607 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:04.607 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:04.607 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.25 2023-10-06T11:13:04.607 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:04.608 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:04.608 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:04.608 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:04.689 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.690 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.690 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00879391 s, 119 MB/s 2023-10-06T11:13:04.702 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.702 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.702 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00985278 s, 106 MB/s 2023-10-06T11:13:04.720 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.721 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.721 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0164474 s, 63.8 MB/s 2023-10-06T11:13:04.773 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.773 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.773 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00957796 s, 109 MB/s 2023-10-06T11:13:04.784 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.784 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.784 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0091982 s, 114 MB/s 2023-10-06T11:13:04.796 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.796 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.796 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00948123 s, 111 MB/s 2023-10-06T11:13:04.809 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.809 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.809 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100551 s, 104 MB/s 2023-10-06T11:13:04.821 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.821 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.821 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00990605 s, 106 MB/s 2023-10-06T11:13:04.832 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.832 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.832 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00912301 s, 115 MB/s 2023-10-06T11:13:04.843 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.843 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.843 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00858315 s, 122 MB/s 2023-10-06T11:13:04.856 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.856 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.856 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101417 s, 103 MB/s 2023-10-06T11:13:04.868 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.868 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.868 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00936816 s, 112 MB/s 2023-10-06T11:13:04.880 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.880 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.880 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00960354 s, 109 MB/s 2023-10-06T11:13:04.893 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.893 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.893 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103293 s, 102 MB/s 2023-10-06T11:13:04.904 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.904 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.904 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00867604 s, 121 MB/s 2023-10-06T11:13:04.917 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.917 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.917 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105911 s, 99.0 MB/s 2023-10-06T11:13:04.929 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.929 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.929 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00948367 s, 111 MB/s 2023-10-06T11:13:04.941 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.941 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.942 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103441 s, 101 MB/s 2023-10-06T11:13:04.952 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.953 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.953 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00864296 s, 121 MB/s 2023-10-06T11:13:04.964 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.964 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.964 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00875525 s, 120 MB/s 2023-10-06T11:13:04.976 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.976 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.976 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00966519 s, 108 MB/s 2023-10-06T11:13:04.987 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.987 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.987 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00870648 s, 120 MB/s 2023-10-06T11:13:04.999 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:04.999 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:04.999 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00956403 s, 110 MB/s 2023-10-06T11:13:05.011 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.012 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.012 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105388 s, 99.5 MB/s 2023-10-06T11:13:05.024 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.024 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.024 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100601 s, 104 MB/s 2023-10-06T11:13:05.036 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.036 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.036 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00991899 s, 106 MB/s 2023-10-06T11:13:05.049 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.049 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.049 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101673 s, 103 MB/s 2023-10-06T11:13:05.061 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.061 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.061 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00939982 s, 112 MB/s 2023-10-06T11:13:05.073 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.073 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.073 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103037 s, 102 MB/s 2023-10-06T11:13:05.084 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.084 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.084 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00850265 s, 123 MB/s 2023-10-06T11:13:05.095 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.095 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.095 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0086503 s, 121 MB/s 2023-10-06T11:13:05.107 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.108 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.108 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00962444 s, 109 MB/s 2023-10-06T11:13:05.108 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:05.108 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:05.108 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:05.108 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.26 2023-10-06T11:13:05.108 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:05.108 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:05.108 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:05.109 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:05.191 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.191 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.191 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00999373 s, 105 MB/s 2023-10-06T11:13:05.203 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.203 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.203 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00957906 s, 109 MB/s 2023-10-06T11:13:05.214 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.214 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.214 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00907834 s, 116 MB/s 2023-10-06T11:13:05.226 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.226 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.226 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00937004 s, 112 MB/s 2023-10-06T11:13:05.238 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.238 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.238 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00974214 s, 108 MB/s 2023-10-06T11:13:05.250 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.250 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.251 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010229 s, 103 MB/s 2023-10-06T11:13:05.264 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.264 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.264 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103657 s, 101 MB/s 2023-10-06T11:13:05.275 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.275 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.275 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00883574 s, 119 MB/s 2023-10-06T11:13:05.287 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.287 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.287 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010056 s, 104 MB/s 2023-10-06T11:13:05.299 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.300 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.300 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00952464 s, 110 MB/s 2023-10-06T11:13:05.310 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.310 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.311 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00883788 s, 119 MB/s 2023-10-06T11:13:05.323 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.323 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.323 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101355 s, 103 MB/s 2023-10-06T11:13:05.336 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.336 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.336 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101035 s, 104 MB/s 2023-10-06T11:13:05.347 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.348 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.348 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00924573 s, 113 MB/s 2023-10-06T11:13:05.358 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.358 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.358 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00870234 s, 120 MB/s 2023-10-06T11:13:05.371 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.371 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.371 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101602 s, 103 MB/s 2023-10-06T11:13:05.381 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.382 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.382 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00861734 s, 122 MB/s 2023-10-06T11:13:05.394 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.395 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.395 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101014 s, 104 MB/s 2023-10-06T11:13:05.407 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.407 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.407 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103068 s, 102 MB/s 2023-10-06T11:13:05.419 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.419 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.419 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00959078 s, 109 MB/s 2023-10-06T11:13:05.431 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.431 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.431 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00999085 s, 105 MB/s 2023-10-06T11:13:05.442 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.442 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.442 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00873197 s, 120 MB/s 2023-10-06T11:13:05.453 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.453 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.453 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00867463 s, 121 MB/s 2023-10-06T11:13:05.465 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.466 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.466 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100429 s, 104 MB/s 2023-10-06T11:13:05.478 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.479 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.479 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102905 s, 102 MB/s 2023-10-06T11:13:05.489 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.490 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.490 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00852868 s, 123 MB/s 2023-10-06T11:13:05.501 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.501 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.501 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00859347 s, 122 MB/s 2023-10-06T11:13:05.511 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.511 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.511 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00833108 s, 126 MB/s 2023-10-06T11:13:05.522 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.522 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.522 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00890432 s, 118 MB/s 2023-10-06T11:13:05.534 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.534 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.535 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00983565 s, 107 MB/s 2023-10-06T11:13:05.547 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.547 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.547 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102302 s, 102 MB/s 2023-10-06T11:13:05.559 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.559 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.559 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00943238 s, 111 MB/s 2023-10-06T11:13:05.560 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:05.560 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:05.560 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:05.560 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.27 2023-10-06T11:13:05.560 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:05.560 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:05.560 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:05.561 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:05.644 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.644 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.644 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104834 s, 100 MB/s 2023-10-06T11:13:05.656 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.656 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.656 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00945005 s, 111 MB/s 2023-10-06T11:13:05.667 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.668 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.668 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00928625 s, 113 MB/s 2023-10-06T11:13:05.679 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.679 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.679 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00933614 s, 112 MB/s 2023-10-06T11:13:05.692 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.692 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.692 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104559 s, 100 MB/s 2023-10-06T11:13:05.703 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.703 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.703 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00879412 s, 119 MB/s 2023-10-06T11:13:05.721 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.721 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.721 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0151667 s, 69.1 MB/s 2023-10-06T11:13:05.752 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.752 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.752 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00869156 s, 121 MB/s 2023-10-06T11:13:05.763 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.763 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.763 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00876141 s, 120 MB/s 2023-10-06T11:13:05.774 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.775 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.775 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00872837 s, 120 MB/s 2023-10-06T11:13:05.786 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.786 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.786 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0094715 s, 111 MB/s 2023-10-06T11:13:05.797 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.797 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.798 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0086721 s, 121 MB/s 2023-10-06T11:13:05.809 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.809 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.809 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00941046 s, 111 MB/s 2023-10-06T11:13:05.822 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.822 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.822 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103049 s, 102 MB/s 2023-10-06T11:13:05.832 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.832 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.833 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00845041 s, 124 MB/s 2023-10-06T11:13:05.844 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.844 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.844 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00933268 s, 112 MB/s 2023-10-06T11:13:05.855 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.855 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.855 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00861838 s, 122 MB/s 2023-10-06T11:13:05.867 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.867 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.867 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00973092 s, 108 MB/s 2023-10-06T11:13:05.880 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.880 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.880 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107539 s, 97.5 MB/s 2023-10-06T11:13:05.891 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.891 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.891 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00847996 s, 124 MB/s 2023-10-06T11:13:05.902 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.902 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.902 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00864522 s, 121 MB/s 2023-10-06T11:13:05.913 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.913 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.913 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00880769 s, 119 MB/s 2023-10-06T11:13:05.926 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.926 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.926 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103242 s, 102 MB/s 2023-10-06T11:13:05.937 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.937 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.937 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00878944 s, 119 MB/s 2023-10-06T11:13:05.949 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.950 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.950 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103236 s, 102 MB/s 2023-10-06T11:13:05.961 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.961 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.961 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00890602 s, 118 MB/s 2023-10-06T11:13:05.973 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.973 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.973 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00940811 s, 111 MB/s 2023-10-06T11:13:05.984 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.984 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.984 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00857912 s, 122 MB/s 2023-10-06T11:13:05.995 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:05.995 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:05.996 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00929459 s, 113 MB/s 2023-10-06T11:13:06.007 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.008 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.009 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00959032 s, 109 MB/s 2023-10-06T11:13:06.019 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.019 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.019 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00904211 s, 116 MB/s 2023-10-06T11:13:06.032 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.032 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.032 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101874 s, 103 MB/s 2023-10-06T11:13:06.033 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:06.033 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:06.033 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:06.034 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.28 2023-10-06T11:13:06.034 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:06.034 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:06.034 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:06.034 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:06.078 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.078 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.078 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104267 s, 101 MB/s 2023-10-06T11:13:06.089 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.089 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.090 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00941615 s, 111 MB/s 2023-10-06T11:13:06.101 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.102 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.102 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100369 s, 104 MB/s 2023-10-06T11:13:06.113 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.113 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.113 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0092104 s, 114 MB/s 2023-10-06T11:13:06.124 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.124 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.124 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00853233 s, 123 MB/s 2023-10-06T11:13:06.135 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.136 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.136 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00915694 s, 115 MB/s 2023-10-06T11:13:06.148 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.148 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.148 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104932 s, 99.9 MB/s 2023-10-06T11:13:06.160 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.161 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.161 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00941398 s, 111 MB/s 2023-10-06T11:13:06.173 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.173 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.173 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103165 s, 102 MB/s 2023-10-06T11:13:06.186 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.186 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.186 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00985427 s, 106 MB/s 2023-10-06T11:13:06.198 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.198 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.198 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00953609 s, 110 MB/s 2023-10-06T11:13:06.211 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.211 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.211 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103175 s, 102 MB/s 2023-10-06T11:13:06.224 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.224 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.224 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104071 s, 101 MB/s 2023-10-06T11:13:06.235 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.235 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.236 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00905573 s, 116 MB/s 2023-10-06T11:13:06.248 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.248 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.248 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101195 s, 104 MB/s 2023-10-06T11:13:06.259 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.259 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.259 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00922358 s, 114 MB/s 2023-10-06T11:13:06.270 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.270 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.270 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00868892 s, 121 MB/s 2023-10-06T11:13:06.283 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.283 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.283 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102017 s, 103 MB/s 2023-10-06T11:13:06.293 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.293 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.294 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00858018 s, 122 MB/s 2023-10-06T11:13:06.305 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.305 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.305 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00935802 s, 112 MB/s 2023-10-06T11:13:06.318 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.318 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.318 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100705 s, 104 MB/s 2023-10-06T11:13:06.329 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.329 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.329 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00885368 s, 118 MB/s 2023-10-06T11:13:06.341 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.342 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.342 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100573 s, 104 MB/s 2023-10-06T11:13:06.353 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.353 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.353 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00938592 s, 112 MB/s 2023-10-06T11:13:06.365 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.365 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.366 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00970814 s, 108 MB/s 2023-10-06T11:13:06.377 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.377 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.377 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00957331 s, 110 MB/s 2023-10-06T11:13:06.388 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.388 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.388 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00836531 s, 125 MB/s 2023-10-06T11:13:06.400 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.401 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.401 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010175 s, 103 MB/s 2023-10-06T11:13:06.411 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.412 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.412 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00868886 s, 121 MB/s 2023-10-06T11:13:06.423 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.424 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.424 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00938944 s, 112 MB/s 2023-10-06T11:13:06.436 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.436 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.436 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00990734 s, 106 MB/s 2023-10-06T11:13:06.447 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.447 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.447 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00924649 s, 113 MB/s 2023-10-06T11:13:06.448 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:06.449 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:06.449 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:06.449 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.29 2023-10-06T11:13:06.449 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:06.449 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:06.449 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:06.449 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:06.531 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.531 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.531 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00940461 s, 111 MB/s 2023-10-06T11:13:06.543 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.543 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.543 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00910429 s, 115 MB/s 2023-10-06T11:13:06.554 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.555 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.555 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00937067 s, 112 MB/s 2023-10-06T11:13:06.566 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.566 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.566 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00946386 s, 111 MB/s 2023-10-06T11:13:06.577 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.577 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.577 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00841136 s, 125 MB/s 2023-10-06T11:13:06.588 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.588 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.588 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00874196 s, 120 MB/s 2023-10-06T11:13:06.599 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.599 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.599 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00860066 s, 122 MB/s 2023-10-06T11:13:06.610 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.610 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.610 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00856884 s, 122 MB/s 2023-10-06T11:13:06.621 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.621 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.622 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00939497 s, 112 MB/s 2023-10-06T11:13:06.634 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.634 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.634 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102955 s, 102 MB/s 2023-10-06T11:13:06.646 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.646 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.646 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00947741 s, 111 MB/s 2023-10-06T11:13:06.659 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.659 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.659 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101101 s, 104 MB/s 2023-10-06T11:13:06.670 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.670 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.670 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00859909 s, 122 MB/s 2023-10-06T11:13:06.681 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.681 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.681 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00841409 s, 125 MB/s 2023-10-06T11:13:06.694 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.694 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.694 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103979 s, 101 MB/s 2023-10-06T11:13:06.705 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.705 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.705 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00854058 s, 123 MB/s 2023-10-06T11:13:06.716 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.716 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.716 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00924368 s, 113 MB/s 2023-10-06T11:13:06.729 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.729 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.729 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103944 s, 101 MB/s 2023-10-06T11:13:06.760 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.760 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.760 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00908936 s, 115 MB/s 2023-10-06T11:13:06.773 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.773 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.773 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101482 s, 103 MB/s 2023-10-06T11:13:06.784 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.784 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.784 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00843891 s, 124 MB/s 2023-10-06T11:13:06.795 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.796 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.796 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00931675 s, 113 MB/s 2023-10-06T11:13:06.808 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.809 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.809 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106674 s, 98.3 MB/s 2023-10-06T11:13:06.819 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.820 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.820 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00851379 s, 123 MB/s 2023-10-06T11:13:06.831 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.831 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.831 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00916286 s, 114 MB/s 2023-10-06T11:13:06.842 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.842 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.842 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00868072 s, 121 MB/s 2023-10-06T11:13:06.855 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.855 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.855 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103396 s, 101 MB/s 2023-10-06T11:13:06.867 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.867 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.867 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101227 s, 104 MB/s 2023-10-06T11:13:06.879 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.879 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.879 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00939939 s, 112 MB/s 2023-10-06T11:13:06.890 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.890 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.890 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0089816 s, 117 MB/s 2023-10-06T11:13:06.901 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.901 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.901 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00856523 s, 122 MB/s 2023-10-06T11:13:06.913 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.914 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.914 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100415 s, 104 MB/s 2023-10-06T11:13:06.915 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:06.915 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:06.915 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:06.915 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.30 2023-10-06T11:13:06.915 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:06.915 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:06.916 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:06.916 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:06.999 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:06.999 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:06.999 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101216 s, 104 MB/s 2023-10-06T11:13:07.011 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.012 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.012 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102844 s, 102 MB/s 2023-10-06T11:13:07.023 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.023 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.024 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0095124 s, 110 MB/s 2023-10-06T11:13:07.034 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.034 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.035 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00859338 s, 122 MB/s 2023-10-06T11:13:07.045 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.046 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.046 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00868914 s, 121 MB/s 2023-10-06T11:13:07.058 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.059 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.059 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102592 s, 102 MB/s 2023-10-06T11:13:07.071 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.071 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.071 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102927 s, 102 MB/s 2023-10-06T11:13:07.084 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.084 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.084 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101412 s, 103 MB/s 2023-10-06T11:13:07.095 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.095 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.095 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00849445 s, 123 MB/s 2023-10-06T11:13:07.106 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.106 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.106 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00898582 s, 117 MB/s 2023-10-06T11:13:07.118 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.118 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.118 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00977695 s, 107 MB/s 2023-10-06T11:13:07.129 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.129 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.129 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00854355 s, 123 MB/s 2023-10-06T11:13:07.142 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.142 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.142 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102623 s, 102 MB/s 2023-10-06T11:13:07.153 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.153 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.153 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00870385 s, 120 MB/s 2023-10-06T11:13:07.165 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.165 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.165 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00944619 s, 111 MB/s 2023-10-06T11:13:07.176 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.176 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.176 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00862059 s, 122 MB/s 2023-10-06T11:13:07.188 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.188 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.188 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00942327 s, 111 MB/s 2023-10-06T11:13:07.198 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.198 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.198 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00844116 s, 124 MB/s 2023-10-06T11:13:07.211 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.211 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.211 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105287 s, 99.6 MB/s 2023-10-06T11:13:07.222 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.222 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.222 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00850644 s, 123 MB/s 2023-10-06T11:13:07.235 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.235 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.235 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010719 s, 97.8 MB/s 2023-10-06T11:13:07.247 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.247 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.247 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00929373 s, 113 MB/s 2023-10-06T11:13:07.258 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.258 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.258 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00859729 s, 122 MB/s 2023-10-06T11:13:07.269 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.269 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.269 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00868426 s, 121 MB/s 2023-10-06T11:13:07.281 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.281 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.281 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00958633 s, 109 MB/s 2023-10-06T11:13:07.292 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.292 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.292 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00854551 s, 123 MB/s 2023-10-06T11:13:07.305 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.305 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.305 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103539 s, 101 MB/s 2023-10-06T11:13:07.317 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.318 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.318 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101313 s, 103 MB/s 2023-10-06T11:13:07.329 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.329 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.329 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00940558 s, 111 MB/s 2023-10-06T11:13:07.340 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.340 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.340 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00861432 s, 122 MB/s 2023-10-06T11:13:07.351 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.351 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.351 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00850421 s, 123 MB/s 2023-10-06T11:13:07.362 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.363 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.363 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00940963 s, 111 MB/s 2023-10-06T11:13:07.364 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:07.364 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:07.364 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:07.364 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.31 2023-10-06T11:13:07.364 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:07.364 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:07.364 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:07.364 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:07.446 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.446 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.446 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00878709 s, 119 MB/s 2023-10-06T11:13:07.458 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.458 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.458 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010219 s, 103 MB/s 2023-10-06T11:13:07.469 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.469 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.470 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00859115 s, 122 MB/s 2023-10-06T11:13:07.480 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.480 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.481 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00854517 s, 123 MB/s 2023-10-06T11:13:07.491 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.491 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.492 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00862868 s, 122 MB/s 2023-10-06T11:13:07.505 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.505 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.505 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103161 s, 102 MB/s 2023-10-06T11:13:07.517 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.517 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.517 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00994803 s, 105 MB/s 2023-10-06T11:13:07.529 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.529 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.529 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102604 s, 102 MB/s 2023-10-06T11:13:07.541 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.541 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.541 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00911288 s, 115 MB/s 2023-10-06T11:13:07.553 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.553 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.553 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00962454 s, 109 MB/s 2023-10-06T11:13:07.564 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.564 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.564 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00936914 s, 112 MB/s 2023-10-06T11:13:07.576 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.576 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.576 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00933757 s, 112 MB/s 2023-10-06T11:13:07.587 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.587 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.587 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00926099 s, 113 MB/s 2023-10-06T11:13:07.600 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.600 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.600 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101195 s, 104 MB/s 2023-10-06T11:13:07.611 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.611 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.611 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00924798 s, 113 MB/s 2023-10-06T11:13:07.624 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.624 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.624 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00993641 s, 106 MB/s 2023-10-06T11:13:07.635 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.635 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.636 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0093275 s, 112 MB/s 2023-10-06T11:13:07.647 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.647 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.647 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00937914 s, 112 MB/s 2023-10-06T11:13:07.660 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.660 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.660 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104447 s, 100 MB/s 2023-10-06T11:13:07.672 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.672 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.672 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00967021 s, 108 MB/s 2023-10-06T11:13:07.683 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.683 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.683 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00850541 s, 123 MB/s 2023-10-06T11:13:07.694 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.694 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.694 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00901218 s, 116 MB/s 2023-10-06T11:13:07.706 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.706 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.707 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00990591 s, 106 MB/s 2023-10-06T11:13:07.719 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.719 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.719 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010179 s, 103 MB/s 2023-10-06T11:13:07.733 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.734 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.734 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121166 s, 86.5 MB/s 2023-10-06T11:13:07.764 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.764 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.764 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0084695 s, 124 MB/s 2023-10-06T11:13:07.774 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.774 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.774 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0084244 s, 124 MB/s 2023-10-06T11:13:07.786 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.786 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.786 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00934704 s, 112 MB/s 2023-10-06T11:13:07.797 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.798 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.798 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00924162 s, 113 MB/s 2023-10-06T11:13:07.809 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.809 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.810 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00916589 s, 114 MB/s 2023-10-06T11:13:07.821 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.821 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.821 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00922332 s, 114 MB/s 2023-10-06T11:13:07.832 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:07.832 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:07.833 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00955881 s, 110 MB/s 2023-10-06T11:13:07.834 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 scrub start /scrub_control_test_path recursive 2023-10-06T11:13:07.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.991+0000 7f1813150700 1 Processor -- start 2023-10-06T11:13:07.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.991+0000 7f1813150700 1 -- start start 2023-10-06T11:13:07.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.992+0000 7f1813150700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f180c0ae730 0x7f180c0aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:07.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.992+0000 7f1813150700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f180c0cb950 0x7f180c0cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:07.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.992+0000 7f1813150700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f180c0ae2a0 con 0x7f180c15a160 2023-10-06T11:13:07.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.992+0000 7f1813150700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f180c15a530 con 0x7f180c0ae730 2023-10-06T11:13:07.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.992+0000 7f1813150700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f180c0c5cb0 con 0x7f180c0cb950 2023-10-06T11:13:07.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.992+0000 7f1810eec700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f180c15a160 0x7f180c0c55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52544/0 (socket says 172.21.15.146:52544) 2023-10-06T11:13:07.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.992+0000 7f1810eec700 1 -- 172.21.15.146:0/4196285987 learned_addr learned my addr 172.21.15.146:0/4196285987 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:13:07.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.992+0000 7f1803fff700 1 --2- 172.21.15.146:0/4196285987 >> v2:172.21.15.151:3300/0 conn(0x7f180c0ae730 0x7f180c0aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:07.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.992+0000 7f18037fe700 1 -- 172.21.15.146:0/4196285987 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4095152867 0 0) 0x7f180c0ae2a0 con 0x7f180c15a160 2023-10-06T11:13:07.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.992+0000 7f18116ed700 1 --2- 172.21.15.146:0/4196285987 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f180c0cb950 0x7f180c0cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:07.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.992+0000 7f18037fe700 1 -- 172.21.15.146:0/4196285987 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17f4003570 con 0x7f180c15a160 2023-10-06T11:13:07.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.992+0000 7f18037fe700 1 -- 172.21.15.146:0/4196285987 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3524114353 0 0) 0x7f17f4003570 con 0x7f180c15a160 2023-10-06T11:13:07.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.992+0000 7f18037fe700 1 -- 172.21.15.146:0/4196285987 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f180c0cb950 msgr2=0x7f180c0cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:07.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.992+0000 7f18037fe700 1 --2- 172.21.15.146:0/4196285987 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f180c0cb950 0x7f180c0cbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:07.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.992+0000 7f18037fe700 1 -- 172.21.15.146:0/4196285987 >> v2:172.21.15.151:3300/0 conn(0x7f180c0ae730 msgr2=0x7f180c0aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:07.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.992+0000 7f18037fe700 1 --2- 172.21.15.146:0/4196285987 >> v2:172.21.15.151:3300/0 conn(0x7f180c0ae730 0x7f180c0aebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:07.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.992+0000 7f18037fe700 1 -- 172.21.15.146:0/4196285987 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f180c0af0f0 con 0x7f180c15a160 2023-10-06T11:13:07.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.992+0000 7f18037fe700 1 -- 172.21.15.146:0/4196285987 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f1808001970 con 0x7f180c15a160 2023-10-06T11:13:07.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.993+0000 7f18037fe700 1 -- 172.21.15.146:0/4196285987 >> v1:172.21.15.146:6789/0 conn(0x7f180c15a160 legacy=0x7f180c0c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:07.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.993+0000 7f18037fe700 1 --2- 172.21.15.146:0/4196285987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17f4003a60 0x7f17f4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:07.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.993+0000 7f18037fe700 1 --2- 172.21.15.146:0/4196285987 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f180c0cb950 0x7f17f4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:07.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.993+0000 7f18037fe700 1 --2- 172.21.15.146:0/4196285987 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17f4004d50 0x7f17f40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:07.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.993+0000 7f18037fe700 1 -- 172.21.15.146:0/4196285987 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180c15a530 con 0x7f17f4003a60 2023-10-06T11:13:07.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.993+0000 7f18037fe700 1 -- 172.21.15.146:0/4196285987 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180c0c5cb0 con 0x7f17f4004d50 2023-10-06T11:13:07.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.993+0000 7f18037fe700 1 -- 172.21.15.146:0/4196285987 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f400ba60 con 0x7f180c0cb950 2023-10-06T11:13:07.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.993+0000 7f1810eec700 1 --2- 172.21.15.146:0/4196285987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17f4003a60 0x7f17f4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:07.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.993+0000 7f1803fff700 1 --2- 172.21.15.146:0/4196285987 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f180c0cb950 0x7f17f4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:07.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.993+0000 7f18116ed700 1 --2- 172.21.15.146:0/4196285987 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17f4004d50 0x7f17f40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:07.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.993+0000 7f1810eec700 1 -- 172.21.15.146:0/4196285987 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f180c0cb950 msgr2=0x7f17f4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:07.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.993+0000 7f1810eec700 1 --2- 172.21.15.146:0/4196285987 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f180c0cb950 0x7f17f4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:07.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.993+0000 7f1810eec700 1 -- 172.21.15.146:0/4196285987 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17f4004d50 msgr2=0x7f17f40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:07.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.993+0000 7f1810eec700 1 --2- 172.21.15.146:0/4196285987 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17f4004d50 0x7f17f40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:07.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.993+0000 7f1810eec700 1 -- 172.21.15.146:0/4196285987 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f4003570 con 0x7f17f4003a60 2023-10-06T11:13:07.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.993+0000 7f1810eec700 1 --2- 172.21.15.146:0/4196285987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17f4003a60 0x7f17f4003e70 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f180800c6b0 tx=0x7f1808007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac5221dfd71835f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:07.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.993+0000 7f18037fe700 1 -- 172.21.15.146:0/4196285987 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1808005b70 con 0x7f17f4003a60 2023-10-06T11:13:07.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.993+0000 7f18037fe700 1 -- 172.21.15.146:0/4196285987 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1808005cf0 con 0x7f17f4003a60 2023-10-06T11:13:08.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.993+0000 7f18037fe700 1 -- 172.21.15.146:0/4196285987 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1808007360 con 0x7f17f4003a60 2023-10-06T11:13:08.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.994+0000 7f1813150700 1 -- 172.21.15.146:0/4196285987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17f4003a60 msgr2=0x7f17f4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:08.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.994+0000 7f1813150700 1 --2- 172.21.15.146:0/4196285987 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17f4003a60 0x7f17f4003e70 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f180800c6b0 tx=0x7f1808007ca0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.994+0000 7f18116ed700 1 -- 172.21.15.146:0/4196285987 reap_dead start 2023-10-06T11:13:08.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.994+0000 7f1813150700 1 -- 172.21.15.146:0/4196285987 shutdown_connections 2023-10-06T11:13:08.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.994+0000 7f1813150700 1 -- 172.21.15.146:0/4196285987 >> 172.21.15.146:0/4196285987 conn(0x7f180c06f380 msgr2=0x7f180c0d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:08.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.994+0000 7f1813150700 1 -- 172.21.15.146:0/4196285987 shutdown_connections 2023-10-06T11:13:08.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.994+0000 7f1813150700 1 -- 172.21.15.146:0/4196285987 wait complete. 2023-10-06T11:13:08.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.995+0000 7f1813150700 1 Processor -- start 2023-10-06T11:13:08.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.995+0000 7f1813150700 1 -- start start 2023-10-06T11:13:08.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.996+0000 7f1813150700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17f4003a60 0x7f180c0afce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.996+0000 7f1813150700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f180c0b5410 0x7f180c157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.996+0000 7f1813150700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f180c0b11b0 0x7f180c0b1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.996+0000 7f1813150700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180c0b1b60 con 0x7f180c0b11b0 2023-10-06T11:13:08.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.996+0000 7f1813150700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f180c0c8310 con 0x7f17f4003a60 2023-10-06T11:13:08.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.996+0000 7f1813150700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f180c0b0360 con 0x7f180c0b5410 2023-10-06T11:13:08.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.996+0000 7f18116ed700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f180c0b11b0 0x7f180c0b1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.996+0000 7f18116ed700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f180c0b11b0 0x7f180c0b1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50814/0 (socket says 172.21.15.146:50814) 2023-10-06T11:13:08.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.996+0000 7f18116ed700 1 -- 172.21.15.146:0/348695828 learned_addr learned my addr 172.21.15.146:0/348695828 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:08.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.996+0000 7f1810eec700 1 --2- 172.21.15.146:0/348695828 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17f4003a60 0x7f180c0afce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.996+0000 7f1803fff700 1 --2- 172.21.15.146:0/348695828 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f180c0b5410 0x7f180c157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.996+0000 7f18116ed700 1 -- 172.21.15.146:0/348695828 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f180c0b5410 msgr2=0x7f180c157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:08.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.996+0000 7f18116ed700 1 --2- 172.21.15.146:0/348695828 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f180c0b5410 0x7f180c157600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.996+0000 7f18116ed700 1 -- 172.21.15.146:0/348695828 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17f4003a60 msgr2=0x7f180c0afce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:08.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.996+0000 7f18116ed700 1 --2- 172.21.15.146:0/348695828 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17f4003a60 0x7f180c0afce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.996+0000 7f18116ed700 1 -- 172.21.15.146:0/348695828 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f180c0b0640 con 0x7f180c0b11b0 2023-10-06T11:13:08.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.996+0000 7f1803fff700 1 --2- 172.21.15.146:0/348695828 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f180c0b5410 0x7f180c157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:08.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.996+0000 7f18116ed700 1 --2- 172.21.15.146:0/348695828 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f180c0b11b0 0x7f180c0b1620 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f180c089c40 tx=0x7f18040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:08.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.997+0000 7f1800ff9700 1 -- 172.21.15.146:0/348695828 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180400f910 con 0x7f180c0b11b0 2023-10-06T11:13:08.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.997+0000 7f1800ff9700 1 -- 172.21.15.146:0/348695828 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f180400fa70 con 0x7f180c0b11b0 2023-10-06T11:13:08.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.997+0000 7f1813150700 1 -- 172.21.15.146:0/348695828 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f180c0b0920 con 0x7f180c0b11b0 2023-10-06T11:13:08.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.997+0000 7f1800ff9700 1 -- 172.21.15.146:0/348695828 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180400fe10 con 0x7f180c0b11b0 2023-10-06T11:13:08.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.997+0000 7f1813150700 1 -- 172.21.15.146:0/348695828 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f180c157b40 con 0x7f180c0b11b0 2023-10-06T11:13:08.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.998+0000 7f1800ff9700 1 -- 172.21.15.146:0/348695828 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1804014650 con 0x7f180c0b11b0 2023-10-06T11:13:08.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.998+0000 7f1800ff9700 1 --2- 172.21.15.146:0/348695828 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f17f8066f30 0x7f17f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.998+0000 7f1800ff9700 1 -- 172.21.15.146:0/348695828 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1804084cb0 con 0x7f180c0b11b0 2023-10-06T11:13:08.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.998+0000 7f1810eec700 1 --2- 172.21.15.146:0/348695828 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f17f8066f30 0x7f17f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:07.999+0000 7f1810eec700 1 --2- 172.21.15.146:0/348695828 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f17f8066f30 0x7f17f80693e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f180800c6b0 tx=0x7f1808015000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:08.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.000+0000 7f181c448b80 1 Processor -- start 2023-10-06T11:13:08.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.000+0000 7f181c448b80 1 -- start start 2023-10-06T11:13:08.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.001+0000 7f181c448b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c77fbcb90 0x559c77fb2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.001+0000 7f181c448b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559c77f76cd0 0x559c77fbc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.001+0000 7f181c448b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559c77fbcf60 0x559c77f718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.001+0000 7f181c448b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c77ef5d80 con 0x559c77fbcb90 2023-10-06T11:13:08.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.001+0000 7f181c448b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c77eccb70 con 0x559c77fbcf60 2023-10-06T11:13:08.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.001+0000 7f181c448b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x559c77eca370 con 0x559c77f76cd0 2023-10-06T11:13:08.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.001+0000 7f1810eec700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c77fbcb90 0x559c77fb2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.001+0000 7f1810eec700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c77fbcb90 0x559c77fb2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50820/0 (socket says 172.21.15.146:50820) 2023-10-06T11:13:08.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.001+0000 7f1810eec700 1 -- 172.21.15.146:0/2083325889 learned_addr learned my addr 172.21.15.146:0/2083325889 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:08.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.001+0000 7f1803fff700 1 --2- 172.21.15.146:0/2083325889 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559c77f76cd0 0x559c77fbc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.001+0000 7f18116ed700 1 --2- 172.21.15.146:0/2083325889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559c77fbcf60 0x559c77f718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.001+0000 7f1810eec700 1 -- 172.21.15.146:0/2083325889 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559c77f76cd0 msgr2=0x559c77fbc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:08.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.001+0000 7f1810eec700 1 --2- 172.21.15.146:0/2083325889 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559c77f76cd0 0x559c77fbc3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.001+0000 7f1810eec700 1 -- 172.21.15.146:0/2083325889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559c77fbcf60 msgr2=0x559c77f718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:08.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.001+0000 7f1810eec700 1 --2- 172.21.15.146:0/2083325889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559c77fbcf60 0x559c77f718d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.001+0000 7f1810eec700 1 -- 172.21.15.146:0/2083325889 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c77d60370 con 0x559c77fbcb90 2023-10-06T11:13:08.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.001+0000 7f1810eec700 1 --2- 172.21.15.146:0/2083325889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c77fbcb90 0x559c77fb2e10 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f1808007fd0 tx=0x7f1808022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69632532b2b34c71 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:08.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.002+0000 7f17f1ffb700 1 -- 172.21.15.146:0/2083325889 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1808000fb0 con 0x559c77fbcb90 2023-10-06T11:13:08.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.002+0000 7f17f1ffb700 1 -- 172.21.15.146:0/2083325889 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1808001930 con 0x559c77fbcb90 2023-10-06T11:13:08.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.002+0000 7f17f1ffb700 1 -- 172.21.15.146:0/2083325889 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1808001aa0 con 0x559c77fbcb90 2023-10-06T11:13:08.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.002+0000 7f181c448b80 1 -- 172.21.15.146:0/2083325889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c77fbcb90 msgr2=0x559c77fb2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:08.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.002+0000 7f181c448b80 1 --2- 172.21.15.146:0/2083325889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c77fbcb90 0x559c77fb2e10 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f1808007fd0 tx=0x7f1808022000 comp rx=0 tx=0).stop 2023-10-06T11:13:08.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.002+0000 7f181c448b80 1 -- 172.21.15.146:0/2083325889 shutdown_connections 2023-10-06T11:13:08.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.002+0000 7f181c448b80 1 --2- 172.21.15.146:0/2083325889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559c77fbcf60 0x559c77f718d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.002+0000 7f181c448b80 1 --2- 172.21.15.146:0/2083325889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c77fbcb90 0x559c77fb2e10 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.002+0000 7f181c448b80 1 --2- 172.21.15.146:0/2083325889 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559c77f76cd0 0x559c77fbc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.002+0000 7f181c448b80 1 -- 172.21.15.146:0/2083325889 >> 172.21.15.146:0/2083325889 conn(0x559c77f77170 msgr2=0x559c77f77540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:08.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.002+0000 7f181c448b80 1 -- 172.21.15.146:0/2083325889 shutdown_connections 2023-10-06T11:13:08.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.002+0000 7f181c448b80 1 -- 172.21.15.146:0/2083325889 wait complete. 2023-10-06T11:13:08.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.003+0000 7f181c448b80 1 -- start start 2023-10-06T11:13:08.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.003+0000 7f181c448b80 1 Processor -- start 2023-10-06T11:13:08.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.004+0000 7f181c448b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559c77f76cd0 0x559c77fd4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.004+0000 7f181c448b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c77fbcb90 0x559c77f717e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.004+0000 7f181c448b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559c77fbcf60 0x559c77f71d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.004+0000 7f181c448b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c77ec6160 con 0x559c77fbcb90 2023-10-06T11:13:08.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.004+0000 7f181c448b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c77e71990 con 0x559c77fbcf60 2023-10-06T11:13:08.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.004+0000 7f181c448b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x559c77e8cfa0 con 0x559c77f76cd0 2023-10-06T11:13:08.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.004+0000 7f181c448b80 10 client.0 _ll_register_callbacks cb 0x559c77d63030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:13:08.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.004+0000 7f1803fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c77fbcb90 0x559c77f717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.004+0000 7f1803fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c77fbcb90 0x559c77f717e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50824/0 (socket says 172.21.15.146:50824) 2023-10-06T11:13:08.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.004+0000 7f1803fff700 1 -- 172.21.15.146:0/2852466159 learned_addr learned my addr 172.21.15.146:0/2852466159 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:08.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.004+0000 7f18116ed700 1 --2- 172.21.15.146:0/2852466159 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559c77fbcf60 0x559c77f71d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.004+0000 7f1810eec700 1 --2- 172.21.15.146:0/2852466159 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559c77f76cd0 0x559c77fd4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.004+0000 7f1803fff700 1 -- 172.21.15.146:0/2852466159 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559c77f76cd0 msgr2=0x559c77fd4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:08.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.004+0000 7f1803fff700 1 --2- 172.21.15.146:0/2852466159 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559c77f76cd0 0x559c77fd4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.004+0000 7f1803fff700 1 -- 172.21.15.146:0/2852466159 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559c77fbcf60 msgr2=0x559c77f71d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:08.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.004+0000 7f1803fff700 1 --2- 172.21.15.146:0/2852466159 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559c77fbcf60 0x559c77f71d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.004+0000 7f1803fff700 1 -- 172.21.15.146:0/2852466159 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1808018030 con 0x559c77fbcb90 2023-10-06T11:13:08.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.004+0000 7f1810eec700 1 --2- 172.21.15.146:0/2852466159 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559c77f76cd0 0x559c77fd4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:08.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.004+0000 7f1803fff700 1 --2- 172.21.15.146:0/2852466159 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c77fbcb90 0x559c77f717e0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f17fc014720 tx=0x7f17fc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7b67a3a1b4e601c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:08.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.004+0000 7f17eaffd700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:13:08.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.004+0000 7f17eaffd700 1 -- 172.21.15.146:0/2852466159 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17fc016710 con 0x559c77fbcb90 2023-10-06T11:13:08.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.004+0000 7f17eaffd700 1 -- 172.21.15.146:0/2852466159 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f17fc01a070 con 0x559c77fbcb90 2023-10-06T11:13:08.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.004+0000 7f181c448b80 1 -- 172.21.15.146:0/2852466159 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559c77f6a790 con 0x559c77fbcb90 2023-10-06T11:13:08.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.005+0000 7f17eaffd700 1 -- 172.21.15.146:0/2852466159 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17fc016a80 con 0x559c77fbcb90 2023-10-06T11:13:08.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.005+0000 7f181c448b80 10 client.7383 fetch_fsmap learned FSMap version 85 2023-10-06T11:13:08.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.005+0000 7f181c448b80 1 -- 172.21.15.146:0/2852466159 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) v3 -- 0x559c77d030e0 con 0x559c77fbcb90 2023-10-06T11:13:08.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.005+0000 7f17eaffd700 1 -- 172.21.15.146:0/2852466159 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559c77f6a790 con 0x559c77fbcb90 2023-10-06T11:13:08.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.005+0000 7f17eaffd700 1 -- 172.21.15.146:0/2852466159 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 85) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f17fc011070 con 0x559c77fbcb90 2023-10-06T11:13:08.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.005+0000 7f181c448b80 10 client.7383 fetch_fsmap finished waiting for FSMap version 85 2023-10-06T11:13:08.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.005+0000 7f181c448b80 10 client.7383 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.d 2023-10-06T11:13:08.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.005+0000 7f181c448b80 20 client.7383 populate_metadata read hostname 'smithi146' 2023-10-06T11:13:08.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.005+0000 7f181c448b80 1 --2- 172.21.15.146:0/2852466159 >> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] conn(0x559c77fb8110 0x559c77fd5770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.005+0000 7f181c448b80 4 client.7383 mds_command: new command op to 7227 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:13:08.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.005+0000 7f181c448b80 1 -- 172.21.15.146:0/2852466159 --> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559c77f476c0 con 0x559c77fb8110 2023-10-06T11:13:08.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.005+0000 7f1810eec700 1 --2- 172.21.15.146:0/2852466159 >> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] conn(0x559c77fb8110 0x559c77fd5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.006+0000 7f17eaffd700 10 client.7383 ms_handle_connect on v2:172.21.15.151:6833/3868165725 2023-10-06T11:13:08.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.006+0000 7f1810eec700 1 --2- 172.21.15.146:0/2852466159 >> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] conn(0x559c77fb8110 0x559c77fd5770 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba8ebbdef7683803 server_cookie=9c31aa3010746f48 in_seq=0 out_seq=0 2023-10-06T11:13:08.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.006+0000 7f17eaffd700 1 -- 172.21.15.146:0/2852466159 <== mds.0 v2:172.21.15.151:6833/3868165725 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x559c77f476c0 con 0x559c77fb8110 2023-10-06T11:13:08.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.006+0000 7f17eaffd700 10 client.7383 handle_command_reply: tid=0 2023-10-06T11:13:08.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.006+0000 7f181c448b80 1 client.7383 shutdown 2023-10-06T11:13:08.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.006+0000 7f181c448b80 1 -- 172.21.15.146:0/2852466159 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c77fbcb90 msgr2=0x559c77f717e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:08.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.006+0000 7f181c448b80 1 --2- 172.21.15.146:0/2852466159 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c77fbcb90 0x559c77f717e0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f17fc014720 tx=0x7f17fc008040 comp rx=0 tx=0).stop 2023-10-06T11:13:08.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.006+0000 7f181c448b80 1 -- 172.21.15.146:0/2852466159 shutdown_connections 2023-10-06T11:13:08.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.006+0000 7f181c448b80 1 --2- 172.21.15.146:0/2852466159 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559c77fbcf60 0x559c77f71d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.006+0000 7f181c448b80 1 --2- 172.21.15.146:0/2852466159 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559c77f76cd0 0x559c77fd4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.006+0000 7f181c448b80 1 --2- 172.21.15.146:0/2852466159 >> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] conn(0x559c77fb8110 0x559c77fd5770 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.006+0000 7f181c448b80 1 --2- 172.21.15.146:0/2852466159 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c77fbcb90 0x559c77f717e0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.006+0000 7f17eaffd700 0 client.7383 ms_handle_reset on v2:172.21.15.151:6833/3868165725 2023-10-06T11:13:08.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.006+0000 7f181c448b80 1 -- 172.21.15.146:0/2852466159 >> 172.21.15.146:0/2852466159 conn(0x559c77f77170 msgr2=0x559c77f70840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:08.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.006+0000 7f181c448b80 1 -- 172.21.15.146:0/2852466159 shutdown_connections 2023-10-06T11:13:08.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.006+0000 7f181c448b80 1 -- 172.21.15.146:0/2852466159 wait complete. 2023-10-06T11:13:08.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.007+0000 7f181c448b80 20 client.7383 trim_cache size 0 max 16384 2023-10-06T11:13:08.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.022+0000 7f181c448b80 1 Processor -- start 2023-10-06T11:13:08.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.022+0000 7f181c448b80 1 -- start start 2023-10-06T11:13:08.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.023+0000 7f181c448b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559c77f77170 0x559c77fd4110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.023+0000 7f181c448b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559c77f76cd0 0x559c77fa5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.023+0000 7f181c448b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c77fbcb90 0x559c77fd4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.023+0000 7f181c448b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c77d48f30 con 0x559c77fbcb90 2023-10-06T11:13:08.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.023+0000 7f181c448b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c77fd4650 con 0x559c77f76cd0 2023-10-06T11:13:08.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.023+0000 7f181c448b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x559c77f70450 con 0x559c77f77170 2023-10-06T11:13:08.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.023+0000 7f18116ed700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c77fbcb90 0x559c77fd4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.023+0000 7f18116ed700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c77fbcb90 0x559c77fd4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50836/0 (socket says 172.21.15.146:50836) 2023-10-06T11:13:08.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.023+0000 7f18116ed700 1 -- 172.21.15.146:0/1835686023 learned_addr learned my addr 172.21.15.146:0/1835686023 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:08.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.024+0000 7f18116ed700 1 -- 172.21.15.146:0/1835686023 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559c77f77170 msgr2=0x559c77fd4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:08.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.024+0000 7f18116ed700 1 --2- 172.21.15.146:0/1835686023 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559c77f77170 0x559c77fd4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.024+0000 7f18116ed700 1 -- 172.21.15.146:0/1835686023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559c77f76cd0 msgr2=0x559c77fa5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:08.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.024+0000 7f18116ed700 1 --2- 172.21.15.146:0/1835686023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559c77f76cd0 0x559c77fa5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.024+0000 7f18116ed700 1 -- 172.21.15.146:0/1835686023 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c77e94880 con 0x559c77fbcb90 2023-10-06T11:13:08.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.024+0000 7f18116ed700 1 --2- 172.21.15.146:0/1835686023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c77fbcb90 0x559c77fd4b10 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f1804001eb0 tx=0x7f1804058040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16b5354d4aa869d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:08.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.024+0000 7f17f27fc700 1 -- 172.21.15.146:0/1835686023 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1804081070 con 0x559c77fbcb90 2023-10-06T11:13:08.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.024+0000 7f17f27fc700 1 -- 172.21.15.146:0/1835686023 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1804055b00 con 0x559c77fbcb90 2023-10-06T11:13:08.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.024+0000 7f17f27fc700 1 -- 172.21.15.146:0/1835686023 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1804056280 con 0x559c77fbcb90 2023-10-06T11:13:08.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.024+0000 7f181c448b80 1 -- 172.21.15.146:0/1835686023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c77fbcb90 msgr2=0x559c77fd4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:08.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.024+0000 7f181c448b80 1 --2- 172.21.15.146:0/1835686023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c77fbcb90 0x559c77fd4b10 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f1804001eb0 tx=0x7f1804058040 comp rx=0 tx=0).stop 2023-10-06T11:13:08.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.024+0000 7f181c448b80 1 -- 172.21.15.146:0/1835686023 shutdown_connections 2023-10-06T11:13:08.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.024+0000 7f181c448b80 1 --2- 172.21.15.146:0/1835686023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c77fbcb90 0x559c77fd4b10 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.024+0000 7f181c448b80 1 --2- 172.21.15.146:0/1835686023 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559c77f77170 0x559c77fd4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.024+0000 7f181c448b80 1 --2- 172.21.15.146:0/1835686023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559c77f76cd0 0x559c77fa5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.024+0000 7f181c448b80 1 -- 172.21.15.146:0/1835686023 >> 172.21.15.146:0/1835686023 conn(0x559c77fba460 msgr2=0x559c77fd5750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:08.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.024+0000 7f181c448b80 1 -- 172.21.15.146:0/1835686023 shutdown_connections 2023-10-06T11:13:08.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.024+0000 7f181c448b80 1 -- 172.21.15.146:0/1835686023 wait complete. 2023-10-06T11:13:08.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.025+0000 7f181c448b80 1 -- start start 2023-10-06T11:13:08.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.025+0000 7f181c448b80 1 Processor -- start 2023-10-06T11:13:08.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.026+0000 7f181c448b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c77f76cd0 0x559c7802bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.026+0000 7f181c448b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559c77f77170 0x559c77f99120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.026+0000 7f181c448b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559c77fbcb90 0x559c77fb0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.026+0000 7f181c448b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c77f71dd0 con 0x559c77f76cd0 2023-10-06T11:13:08.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.026+0000 7f181c448b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c77fb1a80 con 0x559c77fbcb90 2023-10-06T11:13:08.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.026+0000 7f181c448b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x559c77fd4dc0 con 0x559c77f77170 2023-10-06T11:13:08.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.026+0000 7f181c448b80 10 client.0 _ll_register_callbacks cb 0x559c77d63030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:13:08.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.026+0000 7f1810eec700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c77f76cd0 0x559c7802bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.026+0000 7f1810eec700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c77f76cd0 0x559c7802bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50842/0 (socket says 172.21.15.146:50842) 2023-10-06T11:13:08.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.026+0000 7f1810eec700 1 -- 172.21.15.146:0/793285015 learned_addr learned my addr 172.21.15.146:0/793285015 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:08.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.026+0000 7f18116ed700 1 --2- 172.21.15.146:0/793285015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559c77fbcb90 0x559c77fb0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.026+0000 7f1803fff700 1 --2- 172.21.15.146:0/793285015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559c77f77170 0x559c77f99120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.026+0000 7f1810eec700 1 -- 172.21.15.146:0/793285015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559c77f77170 msgr2=0x559c77f99120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:08.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.026+0000 7f1810eec700 1 --2- 172.21.15.146:0/793285015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559c77f77170 0x559c77f99120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.026+0000 7f1810eec700 1 -- 172.21.15.146:0/793285015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559c77fbcb90 msgr2=0x559c77fb0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:08.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.026+0000 7f1810eec700 1 --2- 172.21.15.146:0/793285015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559c77fbcb90 0x559c77fb0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.026+0000 7f1810eec700 1 -- 172.21.15.146:0/793285015 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f180c157b40 con 0x559c77f76cd0 2023-10-06T11:13:08.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.026+0000 7f1810eec700 1 --2- 172.21.15.146:0/793285015 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c77f76cd0 0x559c7802bdf0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f180802e000 tx=0x7f1808040250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efad4df9f7034040 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:08.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.026+0000 7f17eaffd700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:13:08.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.026+0000 7f17eaffd700 1 -- 172.21.15.146:0/793285015 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1808001aa0 con 0x559c77f76cd0 2023-10-06T11:13:08.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.026+0000 7f17eaffd700 1 -- 172.21.15.146:0/793285015 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1808027070 con 0x559c77f76cd0 2023-10-06T11:13:08.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.026+0000 7f181c448b80 1 -- 172.21.15.146:0/793285015 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1808001930 con 0x559c77f76cd0 2023-10-06T11:13:08.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.027+0000 7f17eaffd700 1 -- 172.21.15.146:0/793285015 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1808005e60 con 0x559c77f76cd0 2023-10-06T11:13:08.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.027+0000 7f181c448b80 10 client.7389 fetch_fsmap learned FSMap version 85 2023-10-06T11:13:08.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.027+0000 7f181c448b80 1 -- 172.21.15.146:0/793285015 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) v3 -- 0x559c77e7b570 con 0x559c77f76cd0 2023-10-06T11:13:08.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.027+0000 7f17eaffd700 1 -- 172.21.15.146:0/793285015 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1808001930 con 0x559c77f76cd0 2023-10-06T11:13:08.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.027+0000 7f17eaffd700 1 -- 172.21.15.146:0/793285015 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 85) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1808022480 con 0x559c77f76cd0 2023-10-06T11:13:08.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.027+0000 7f181c448b80 10 client.7389 fetch_fsmap finished waiting for FSMap version 85 2023-10-06T11:13:08.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.027+0000 7f181c448b80 10 client.7389 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.d 2023-10-06T11:13:08.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.027+0000 7f181c448b80 20 client.7389 populate_metadata read hostname 'smithi146' 2023-10-06T11:13:08.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.027+0000 7f181c448b80 1 --2- 172.21.15.146:0/793285015 >> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] conn(0x559c77fbcf60 0x559c77f759e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.027+0000 7f181c448b80 4 client.7389 mds_command: new command op to 7227 tid=0[{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2023-10-06T11:13:08.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.027+0000 7f181c448b80 1 -- 172.21.15.146:0/793285015 --> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) v1 -- 0x559c77e68f00 con 0x559c77fbcf60 2023-10-06T11:13:08.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.027+0000 7f1803fff700 1 --2- 172.21.15.146:0/793285015 >> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] conn(0x559c77fbcf60 0x559c77f759e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.027+0000 7f17eaffd700 10 client.7389 ms_handle_connect on v2:172.21.15.151:6833/3868165725 2023-10-06T11:13:08.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.027+0000 7f1803fff700 1 --2- 172.21.15.146:0/793285015 >> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] conn(0x559c77fbcf60 0x559c77f759e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7ddc3d7e155925a server_cookie=e5a597a19e7936e1 in_seq=0 out_seq=0 2023-10-06T11:13:08.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.030+0000 7f17eaffd700 1 -- 172.21.15.146:0/793285015 <== mds.0 v2:172.21.15.151:6833/3868165725 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x559c77e68f00 con 0x559c77fbcf60 2023-10-06T11:13:08.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.030+0000 7f17eaffd700 10 client.7389 handle_command_reply: tid=0 2023-10-06T11:13:08.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.030+0000 7f181c448b80 1 client.7389 shutdown 2023-10-06T11:13:08.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.030+0000 7f181c448b80 1 -- 172.21.15.146:0/793285015 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c77f76cd0 msgr2=0x559c7802bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:08.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.030+0000 7f181c448b80 1 --2- 172.21.15.146:0/793285015 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c77f76cd0 0x559c7802bdf0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f180802e000 tx=0x7f1808040250 comp rx=0 tx=0).stop 2023-10-06T11:13:08.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.030+0000 7f181c448b80 1 -- 172.21.15.146:0/793285015 shutdown_connections 2023-10-06T11:13:08.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.030+0000 7f181c448b80 1 --2- 172.21.15.146:0/793285015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559c77fbcb90 0x559c77fb0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.030+0000 7f181c448b80 1 --2- 172.21.15.146:0/793285015 >> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] conn(0x559c77fbcf60 0x559c77f759e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.030+0000 7f181c448b80 1 --2- 172.21.15.146:0/793285015 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x559c77f76cd0 0x559c7802bdf0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.030+0000 7f17eaffd700 0 client.7389 ms_handle_reset on v2:172.21.15.151:6833/3868165725 2023-10-06T11:13:08.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.030+0000 7f181c448b80 1 --2- 172.21.15.146:0/793285015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x559c77f77170 0x559c77f99120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.030+0000 7f181c448b80 1 -- 172.21.15.146:0/793285015 >> 172.21.15.146:0/793285015 conn(0x559c77fba460 msgr2=0x559c77fa5430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:08.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.030+0000 7f181c448b80 1 -- 172.21.15.146:0/793285015 shutdown_connections 2023-10-06T11:13:08.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.030+0000 7f181c448b80 1 -- 172.21.15.146:0/793285015 wait complete. 2023-10-06T11:13:08.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.031+0000 7f181c448b80 20 client.7389 trim_cache size 0 max 16384 2023-10-06T11:13:08.037 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:13:08.037 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0, 2023-10-06T11:13:08.037 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_tag": "2269f58a-6ef6-4174-9add-ca8b30aea407", 2023-10-06T11:13:08.037 INFO:teuthology.orchestra.run.smithi146.stdout: "mode": "asynchronous" 2023-10-06T11:13:08.037 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:13:08.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.031+0000 7f1813150700 1 -- 172.21.15.146:0/348695828 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f17f8066f30 msgr2=0x7f17f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:08.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.031+0000 7f1813150700 1 --2- 172.21.15.146:0/348695828 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f17f8066f30 0x7f17f80693e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f180800c6b0 tx=0x7f1808015000 comp rx=0 tx=0).stop 2023-10-06T11:13:08.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.031+0000 7f1813150700 1 -- 172.21.15.146:0/348695828 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f180c0b11b0 msgr2=0x7f180c0b1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:08.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.031+0000 7f1813150700 1 --2- 172.21.15.146:0/348695828 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f180c0b11b0 0x7f180c0b1620 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f180c089c40 tx=0x7f18040091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.031+0000 7f1813150700 1 -- 172.21.15.146:0/348695828 shutdown_connections 2023-10-06T11:13:08.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.031+0000 7f1813150700 1 --2- 172.21.15.146:0/348695828 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f17f8066f30 0x7f17f80693e0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.031+0000 7f1813150700 1 --2- 172.21.15.146:0/348695828 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f180c0b11b0 0x7f180c0b1620 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.031+0000 7f1813150700 1 --2- 172.21.15.146:0/348695828 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17f4003a60 0x7f180c0afce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.031+0000 7f1813150700 1 --2- 172.21.15.146:0/348695828 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f180c0b5410 0x7f180c157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.031+0000 7f1813150700 1 -- 172.21.15.146:0/348695828 >> 172.21.15.146:0/348695828 conn(0x7f180c06f380 msgr2=0x7f180c159500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:08.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.031+0000 7f1813150700 1 -- 172.21.15.146:0/348695828 shutdown_connections 2023-10-06T11:13:08.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.031+0000 7f1813150700 1 -- 172.21.15.146:0/348695828 wait complete. 2023-10-06T11:13:08.045 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 scrub abort 2023-10-06T11:13:08.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.171+0000 7fd9ccd50700 1 Processor -- start 2023-10-06T11:13:08.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.171+0000 7fd9ccd50700 1 -- start start 2023-10-06T11:13:08.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.172+0000 7fd9ccd50700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd9c815d710 0x7fd9c80ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.172+0000 7fd9ccd50700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd9c815dae0 0x7fd9c80b04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.172+0000 7fd9ccd50700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9c80b0010 con 0x7fd9c80aef20 2023-10-06T11:13:08.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.172+0000 7fd9ccd50700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9c815e340 con 0x7fd9c815dae0 2023-10-06T11:13:08.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.172+0000 7fd9ccd50700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c80cf090 con 0x7fd9c815d710 2023-10-06T11:13:08.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.172+0000 7fd9c6d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd9c815dae0 0x7fd9c80b04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.172+0000 7fd9c5d9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd9c80aef20 0x7fd9c8068580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52556/0 (socket says 172.21.15.146:52556) 2023-10-06T11:13:08.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.172+0000 7fd9c5d9b700 1 -- 172.21.15.146:0/3312859413 learned_addr learned my addr 172.21.15.146:0/3312859413 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:13:08.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.172+0000 7fd9c659c700 1 --2- 172.21.15.146:0/3312859413 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd9c815d710 0x7fd9c80ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.172+0000 7fd9c6d9d700 1 -- 172.21.15.146:0/3312859413 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd9c815d710 msgr2=0x7fd9c80ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:08.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.172+0000 7fd9c6d9d700 1 --2- 172.21.15.146:0/3312859413 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd9c815d710 0x7fd9c80ceb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.172+0000 7fd9c6d9d700 1 -- 172.21.15.146:0/3312859413 >> v1:172.21.15.146:6789/0 conn(0x7fd9c80aef20 legacy=0x7fd9c8068580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:08.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.172+0000 7fd9c559a700 1 -- 172.21.15.146:0/3312859413 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1300304094 0 0) 0x7fd9c80b0010 con 0x7fd9c80aef20 2023-10-06T11:13:08.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.172+0000 7fd9c6d9d700 1 -- 172.21.15.146:0/3312859413 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c80af400 con 0x7fd9c815dae0 2023-10-06T11:13:08.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.173+0000 7fd9c6d9d700 1 --2- 172.21.15.146:0/3312859413 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9c815dae0 0x7fd9c80b04a0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8009e60 tx=0x7fd9b8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=524124bf1ca3b72e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:08.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.173+0000 7fd9c559a700 1 -- 172.21.15.146:0/3312859413 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b800e070 con 0x7fd9c815dae0 2023-10-06T11:13:08.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.173+0000 7fd9c559a700 1 -- 172.21.15.146:0/3312859413 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b800bc30 con 0x7fd9c815dae0 2023-10-06T11:13:08.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.173+0000 7fd9c559a700 1 -- 172.21.15.146:0/3312859413 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b8012430 con 0x7fd9c815dae0 2023-10-06T11:13:08.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.173+0000 7fd9ccd50700 1 -- 172.21.15.146:0/3312859413 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9c815dae0 msgr2=0x7fd9c80b04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:08.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.173+0000 7fd9ccd50700 1 --2- 172.21.15.146:0/3312859413 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9c815dae0 0x7fd9c80b04a0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8009e60 tx=0x7fd9b8009780 comp rx=0 tx=0).stop 2023-10-06T11:13:08.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.173+0000 7fd9ccd50700 1 -- 172.21.15.146:0/3312859413 shutdown_connections 2023-10-06T11:13:08.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.173+0000 7fd9ccd50700 1 --2- 172.21.15.146:0/3312859413 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9c815dae0 0x7fd9c80b04a0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.173+0000 7fd9ccd50700 1 --2- 172.21.15.146:0/3312859413 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd9c815d710 0x7fd9c80ceb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.173+0000 7fd9ccd50700 1 -- 172.21.15.146:0/3312859413 >> 172.21.15.146:0/3312859413 conn(0x7fd9c8067c50 msgr2=0x7fd9c80ce440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:08.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.173+0000 7fd9ccd50700 1 -- 172.21.15.146:0/3312859413 shutdown_connections 2023-10-06T11:13:08.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.173+0000 7fd9ccd50700 1 -- 172.21.15.146:0/3312859413 wait complete. 2023-10-06T11:13:08.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.174+0000 7fd9ccd50700 1 Processor -- start 2023-10-06T11:13:08.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.174+0000 7fd9ccd50700 1 -- start start 2023-10-06T11:13:08.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.175+0000 7fd9ccd50700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd9c80aef20 0x7fd9c80c8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.175+0000 7fd9ccd50700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9c815d710 0x7fd9c80abfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.175+0000 7fd9ccd50700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9c815dae0 0x7fd9c814cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.175+0000 7fd9ccd50700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c80c9e50 con 0x7fd9c815dae0 2023-10-06T11:13:08.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.175+0000 7fd9ccd50700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c80c9240 con 0x7fd9c815d710 2023-10-06T11:13:08.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.175+0000 7fd9ccd50700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c80c9520 con 0x7fd9c80aef20 2023-10-06T11:13:08.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.175+0000 7fd9c6d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9c815dae0 0x7fd9c814cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.175+0000 7fd9c6d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9c815dae0 0x7fd9c814cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50858/0 (socket says 172.21.15.146:50858) 2023-10-06T11:13:08.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.175+0000 7fd9c6d9d700 1 -- 172.21.15.146:0/3940750836 learned_addr learned my addr 172.21.15.146:0/3940750836 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:08.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.176+0000 7fd9c6d9d700 1 -- 172.21.15.146:0/3940750836 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd9c80aef20 msgr2=0x7fd9c80c8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:08.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.176+0000 7fd9c6d9d700 1 --2- 172.21.15.146:0/3940750836 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd9c80aef20 0x7fd9c80c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.176+0000 7fd9c6d9d700 1 -- 172.21.15.146:0/3940750836 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9c815d710 msgr2=0x7fd9c80abfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:08.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.176+0000 7fd9c6d9d700 1 --2- 172.21.15.146:0/3940750836 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9c815d710 0x7fd9c80abfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.176+0000 7fd9c6d9d700 1 -- 172.21.15.146:0/3940750836 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b8009a20 con 0x7fd9c815dae0 2023-10-06T11:13:08.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.176+0000 7fd9c6d9d700 1 --2- 172.21.15.146:0/3940750836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9c815dae0 0x7fd9c814cba0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8013000 tx=0x7fd9b8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:08.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.176+0000 7fd9be7fc700 1 -- 172.21.15.146:0/3940750836 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b801e630 con 0x7fd9c815dae0 2023-10-06T11:13:08.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.176+0000 7fd9be7fc700 1 -- 172.21.15.146:0/3940750836 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b801e7b0 con 0x7fd9c815dae0 2023-10-06T11:13:08.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.176+0000 7fd9ccd50700 1 -- 172.21.15.146:0/3940750836 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9c80c9800 con 0x7fd9c815dae0 2023-10-06T11:13:08.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.176+0000 7fd9be7fc700 1 -- 172.21.15.146:0/3940750836 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b801eb70 con 0x7fd9c815dae0 2023-10-06T11:13:08.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.176+0000 7fd9ccd50700 1 -- 172.21.15.146:0/3940750836 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9c80c8e50 con 0x7fd9c815dae0 2023-10-06T11:13:08.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.177+0000 7fd9be7fc700 1 -- 172.21.15.146:0/3940750836 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd9b8024070 con 0x7fd9c815dae0 2023-10-06T11:13:08.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.177+0000 7fd9be7fc700 1 --2- 172.21.15.146:0/3940750836 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd9a8066f30 0x7fd9a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.178+0000 7fd9be7fc700 1 -- 172.21.15.146:0/3940750836 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd9b8087060 con 0x7fd9c815dae0 2023-10-06T11:13:08.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.178+0000 7fd9c659c700 1 --2- 172.21.15.146:0/3940750836 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd9a8066f30 0x7fd9a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.178+0000 7fd9c659c700 1 --2- 172.21.15.146:0/3940750836 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd9a8066f30 0x7fd9a80693e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0007970 tx=0x7fd9c0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:08.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.180+0000 7fd9d6048b80 1 Processor -- start 2023-10-06T11:13:08.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.180+0000 7fd9d6048b80 1 -- start start 2023-10-06T11:13:08.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.180+0000 7fd9d6048b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557da5157ad0 0x557da5157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.180+0000 7fd9d6048b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557da51139e0 0x557da51105c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.180+0000 7fd9d6048b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557da5111c10 0x557da5110b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.180+0000 7fd9d6048b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x557da5090cc0 con 0x557da51139e0 2023-10-06T11:13:08.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.180+0000 7fd9d6048b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557da5067ab0 con 0x557da5157ad0 2023-10-06T11:13:08.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.180+0000 7fd9d6048b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x557da50652b0 con 0x557da5111c10 2023-10-06T11:13:08.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.180+0000 7fd9c5d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557da51139e0 0x557da51105c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.180+0000 7fd9c5d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557da51139e0 0x557da51105c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50870/0 (socket says 172.21.15.146:50870) 2023-10-06T11:13:08.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.180+0000 7fd9c5d9b700 1 -- 172.21.15.146:0/515954666 learned_addr learned my addr 172.21.15.146:0/515954666 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:08.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.181+0000 7fd9c659c700 1 --2- 172.21.15.146:0/515954666 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557da5157ad0 0x557da5157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.181+0000 7fd9c6d9d700 1 --2- 172.21.15.146:0/515954666 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557da5111c10 0x557da5110b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.181+0000 7fd9c5d9b700 1 -- 172.21.15.146:0/515954666 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557da5111c10 msgr2=0x557da5110b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:08.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.181+0000 7fd9c5d9b700 1 --2- 172.21.15.146:0/515954666 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557da5111c10 0x557da5110b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.181+0000 7fd9c5d9b700 1 -- 172.21.15.146:0/515954666 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557da5157ad0 msgr2=0x557da5157ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:08.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.181+0000 7fd9c5d9b700 1 --2- 172.21.15.146:0/515954666 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557da5157ad0 0x557da5157ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.181+0000 7fd9c5d9b700 1 -- 172.21.15.146:0/515954666 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557da4efb2b0 con 0x557da51139e0 2023-10-06T11:13:08.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.181+0000 7fd9c5d9b700 1 --2- 172.21.15.146:0/515954666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557da51139e0 0x557da51105c0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fd9b00016f0 tx=0x7fd9b0007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f6577c8ffa0dcf5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:08.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.181+0000 7fd9a77fe700 1 -- 172.21.15.146:0/515954666 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b0005b30 con 0x557da51139e0 2023-10-06T11:13:08.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.181+0000 7fd9a77fe700 1 -- 172.21.15.146:0/515954666 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b0005c90 con 0x557da51139e0 2023-10-06T11:13:08.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.181+0000 7fd9a77fe700 1 -- 172.21.15.146:0/515954666 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b0007320 con 0x557da51139e0 2023-10-06T11:13:08.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.182+0000 7fd9d6048b80 1 -- 172.21.15.146:0/515954666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557da51139e0 msgr2=0x557da51105c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:08.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.182+0000 7fd9d6048b80 1 --2- 172.21.15.146:0/515954666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557da51139e0 0x557da51105c0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fd9b00016f0 tx=0x7fd9b0007d10 comp rx=0 tx=0).stop 2023-10-06T11:13:08.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.182+0000 7fd9d6048b80 1 -- 172.21.15.146:0/515954666 shutdown_connections 2023-10-06T11:13:08.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.182+0000 7fd9d6048b80 1 --2- 172.21.15.146:0/515954666 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557da5111c10 0x557da5110b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.182+0000 7fd9d6048b80 1 --2- 172.21.15.146:0/515954666 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557da5157ad0 0x557da5157ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.182+0000 7fd9d6048b80 1 --2- 172.21.15.146:0/515954666 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557da51139e0 0x557da51105c0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.182+0000 7fd9d6048b80 1 -- 172.21.15.146:0/515954666 >> 172.21.15.146:0/515954666 conn(0x557da51120b0 msgr2=0x557da5112480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:08.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.182+0000 7fd9d6048b80 1 -- 172.21.15.146:0/515954666 shutdown_connections 2023-10-06T11:13:08.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.182+0000 7fd9d6048b80 1 -- 172.21.15.146:0/515954666 wait complete. 2023-10-06T11:13:08.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.182+0000 7fd9d6048b80 1 -- start start 2023-10-06T11:13:08.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.182+0000 7fd9d6048b80 1 Processor -- start 2023-10-06T11:13:08.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.183+0000 7fd9d6048b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557da5111c10 0x557da51351b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.183+0000 7fd9d6048b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557da51139e0 0x557da5153480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.183+0000 7fd9d6048b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557da5157ad0 0x557da51104c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.183+0000 7fd9d6048b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x557da50610a0 con 0x557da51139e0 2023-10-06T11:13:08.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.183+0000 7fd9d6048b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557da500c8d0 con 0x557da5111c10 2023-10-06T11:13:08.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.183+0000 7fd9d6048b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x557da5027ee0 con 0x557da5157ad0 2023-10-06T11:13:08.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.183+0000 7fd9d6048b80 10 client.0 _ll_register_callbacks cb 0x557da4efdf70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:13:08.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.183+0000 7fd9c5d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557da51139e0 0x557da5153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.183+0000 7fd9c659c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557da5111c10 0x557da51351b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.183+0000 7fd9c5d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557da51139e0 0x557da5153480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50886/0 (socket says 172.21.15.146:50886) 2023-10-06T11:13:08.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.183+0000 7fd9c5d9b700 1 -- 172.21.15.146:0/2381053398 learned_addr learned my addr 172.21.15.146:0/2381053398 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:08.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.183+0000 7fd9c6d9d700 1 --2- 172.21.15.146:0/2381053398 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557da5157ad0 0x557da51104c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.184+0000 7fd9c659c700 1 -- 172.21.15.146:0/2381053398 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557da5157ad0 msgr2=0x557da51104c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:08.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.184+0000 7fd9c659c700 1 --2- 172.21.15.146:0/2381053398 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557da5157ad0 0x557da51104c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.184+0000 7fd9c659c700 1 -- 172.21.15.146:0/2381053398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557da51139e0 msgr2=0x557da5153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:08.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.184+0000 7fd9c659c700 1 --2- 172.21.15.146:0/2381053398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557da51139e0 0x557da5153480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.184+0000 7fd9c659c700 1 -- 172.21.15.146:0/2381053398 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b00012b0 con 0x557da5111c10 2023-10-06T11:13:08.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.184+0000 7fd9c5d9b700 1 --2- 172.21.15.146:0/2381053398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557da51139e0 0x557da5153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:13:08.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.184+0000 7fd9c659c700 1 --2- 172.21.15.146:0/2381053398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557da5111c10 0x557da51351b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0007250 tx=0x7fd9c0013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a63f059e4e1a3163 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:08.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.184+0000 7fd9a4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-10-06T11:13:08.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.184+0000 7fd9a4ff9700 1 -- 172.21.15.146:0/2381053398 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c0006e00 con 0x557da5111c10 2023-10-06T11:13:08.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.184+0000 7fd9a4ff9700 1 -- 172.21.15.146:0/2381053398 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd9c0013df0 con 0x557da5111c10 2023-10-06T11:13:08.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.184+0000 7fd9d6048b80 1 -- 172.21.15.146:0/2381053398 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557da51056d0 con 0x557da5111c10 2023-10-06T11:13:08.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.184+0000 7fd9a4ff9700 1 -- 172.21.15.146:0/2381053398 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd9c001f600 con 0x557da5111c10 2023-10-06T11:13:08.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.184+0000 7fd9d6048b80 10 client.6781 fetch_fsmap learned FSMap version 85 2023-10-06T11:13:08.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.184+0000 7fd9d6048b80 1 -- 172.21.15.146:0/2381053398 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) v3 -- 0x557da4e9e020 con 0x557da5111c10 2023-10-06T11:13:08.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.184+0000 7fd9a4ff9700 1 -- 172.21.15.146:0/2381053398 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557da51056d0 con 0x557da5111c10 2023-10-06T11:13:08.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.184+0000 7fd9a4ff9700 1 -- 172.21.15.146:0/2381053398 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 85) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd9c001e070 con 0x557da5111c10 2023-10-06T11:13:08.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.185+0000 7fd9d6048b80 10 client.6781 fetch_fsmap finished waiting for FSMap version 85 2023-10-06T11:13:08.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.185+0000 7fd9d6048b80 10 client.6781 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.d 2023-10-06T11:13:08.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.185+0000 7fd9d6048b80 20 client.6781 populate_metadata read hostname 'smithi146' 2023-10-06T11:13:08.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.185+0000 7fd9d6048b80 1 --2- 172.21.15.146:0/2381053398 >> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] conn(0x557da515a570 0x557da513a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.185+0000 7fd9d6048b80 4 client.6781 mds_command: new command op to 7227 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:13:08.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.185+0000 7fd9d6048b80 1 -- 172.21.15.146:0/2381053398 --> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557da50e2600 con 0x557da515a570 2023-10-06T11:13:08.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.185+0000 7fd9c5d9b700 1 --2- 172.21.15.146:0/2381053398 >> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] conn(0x557da515a570 0x557da513a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.185+0000 7fd9a4ff9700 10 client.6781 ms_handle_connect on v2:172.21.15.151:6833/3868165725 2023-10-06T11:13:08.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.185+0000 7fd9c5d9b700 1 --2- 172.21.15.146:0/2381053398 >> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] conn(0x557da515a570 0x557da513a6b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6572c9e1107e2e58 server_cookie=58d85770634939c0 in_seq=0 out_seq=0 2023-10-06T11:13:08.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.186+0000 7fd9a4ff9700 1 -- 172.21.15.146:0/2381053398 <== mds.0 v2:172.21.15.151:6833/3868165725 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x557da50e2600 con 0x557da515a570 2023-10-06T11:13:08.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.186+0000 7fd9a4ff9700 10 client.6781 handle_command_reply: tid=0 2023-10-06T11:13:08.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.186+0000 7fd9d6048b80 1 client.6781 shutdown 2023-10-06T11:13:08.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.186+0000 7fd9d6048b80 1 -- 172.21.15.146:0/2381053398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557da5111c10 msgr2=0x557da51351b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:08.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.186+0000 7fd9d6048b80 1 --2- 172.21.15.146:0/2381053398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557da5111c10 0x557da51351b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0007250 tx=0x7fd9c0013000 comp rx=0 tx=0).stop 2023-10-06T11:13:08.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.186+0000 7fd9d6048b80 1 -- 172.21.15.146:0/2381053398 shutdown_connections 2023-10-06T11:13:08.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.186+0000 7fd9d6048b80 1 --2- 172.21.15.146:0/2381053398 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557da5157ad0 0x557da51104c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.186+0000 7fd9d6048b80 1 --2- 172.21.15.146:0/2381053398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557da5111c10 0x557da51351b0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.186+0000 7fd9d6048b80 1 --2- 172.21.15.146:0/2381053398 >> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] conn(0x557da515a570 0x557da513a6b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.186+0000 7fd9d6048b80 1 --2- 172.21.15.146:0/2381053398 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557da51139e0 0x557da5153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.186+0000 7fd9a4ff9700 0 client.6781 ms_handle_reset on v2:172.21.15.151:6833/3868165725 2023-10-06T11:13:08.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.186+0000 7fd9d6048b80 1 -- 172.21.15.146:0/2381053398 >> 172.21.15.146:0/2381053398 conn(0x557da51120b0 msgr2=0x557da51555a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:08.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.186+0000 7fd9d6048b80 1 -- 172.21.15.146:0/2381053398 shutdown_connections 2023-10-06T11:13:08.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.186+0000 7fd9d6048b80 1 -- 172.21.15.146:0/2381053398 wait complete. 2023-10-06T11:13:08.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.186+0000 7fd9d6048b80 20 client.6781 trim_cache size 0 max 16384 2023-10-06T11:13:08.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.202+0000 7fd9d6048b80 1 Processor -- start 2023-10-06T11:13:08.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.202+0000 7fd9d6048b80 1 -- start start 2023-10-06T11:13:08.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.202+0000 7fd9d6048b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557da5111c10 0x557da5139c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.202+0000 7fd9d6048b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557da51139e0 0x557da5112480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.202+0000 7fd9d6048b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557da5157ad0 0x557da513ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.203+0000 7fd9d6048b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x557da4ee3e70 con 0x557da51139e0 2023-10-06T11:13:08.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.203+0000 7fd9d6048b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557da513d0f0 con 0x557da5157ad0 2023-10-06T11:13:08.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.203+0000 7fd9d6048b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x557da50f0070 con 0x557da5111c10 2023-10-06T11:13:08.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.203+0000 7fd9c5d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557da51139e0 0x557da5112480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.203+0000 7fd9c5d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557da51139e0 0x557da5112480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50896/0 (socket says 172.21.15.146:50896) 2023-10-06T11:13:08.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.203+0000 7fd9c5d9b700 1 -- 172.21.15.146:0/1689457223 learned_addr learned my addr 172.21.15.146:0/1689457223 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:08.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.203+0000 7fd9c659c700 1 --2- 172.21.15.146:0/1689457223 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557da5111c10 0x557da5139c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.203+0000 7fd9c6d9d700 1 --2- 172.21.15.146:0/1689457223 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557da5157ad0 0x557da513ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.203+0000 7fd9c5d9b700 1 -- 172.21.15.146:0/1689457223 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557da5111c10 msgr2=0x557da5139c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:08.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.203+0000 7fd9c5d9b700 1 --2- 172.21.15.146:0/1689457223 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557da5111c10 0x557da5139c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.203+0000 7fd9c5d9b700 1 -- 172.21.15.146:0/1689457223 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557da5157ad0 msgr2=0x557da513ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:08.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.203+0000 7fd9c5d9b700 1 --2- 172.21.15.146:0/1689457223 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557da5157ad0 0x557da513ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.203+0000 7fd9c5d9b700 1 -- 172.21.15.146:0/1689457223 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557da502f7c0 con 0x557da51139e0 2023-10-06T11:13:08.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.203+0000 7fd9c5d9b700 1 --2- 172.21.15.146:0/1689457223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557da51139e0 0x557da5112480 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0011000 tx=0x7fd9b0026250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b524ffa7cb87a590 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:08.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.203+0000 7fd9a7fff700 1 -- 172.21.15.146:0/1689457223 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b00073e0 con 0x557da51139e0 2023-10-06T11:13:08.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.203+0000 7fd9a7fff700 1 -- 172.21.15.146:0/1689457223 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9b0007750 con 0x557da51139e0 2023-10-06T11:13:08.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.203+0000 7fd9a7fff700 1 -- 172.21.15.146:0/1689457223 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9b001e400 con 0x557da51139e0 2023-10-06T11:13:08.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.204+0000 7fd9d6048b80 1 -- 172.21.15.146:0/1689457223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557da51139e0 msgr2=0x557da5112480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:08.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.204+0000 7fd9d6048b80 1 --2- 172.21.15.146:0/1689457223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557da51139e0 0x557da5112480 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fd9b0011000 tx=0x7fd9b0026250 comp rx=0 tx=0).stop 2023-10-06T11:13:08.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.204+0000 7fd9d6048b80 1 -- 172.21.15.146:0/1689457223 shutdown_connections 2023-10-06T11:13:08.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.204+0000 7fd9d6048b80 1 --2- 172.21.15.146:0/1689457223 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557da5157ad0 0x557da513ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.204+0000 7fd9d6048b80 1 --2- 172.21.15.146:0/1689457223 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557da5111c10 0x557da5139c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.204+0000 7fd9d6048b80 1 --2- 172.21.15.146:0/1689457223 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557da51139e0 0x557da5112480 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.204+0000 7fd9d6048b80 1 -- 172.21.15.146:0/1689457223 >> 172.21.15.146:0/1689457223 conn(0x557da51120b0 msgr2=0x557da510cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:08.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.204+0000 7fd9d6048b80 1 -- 172.21.15.146:0/1689457223 shutdown_connections 2023-10-06T11:13:08.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.204+0000 7fd9d6048b80 1 -- 172.21.15.146:0/1689457223 wait complete. 2023-10-06T11:13:08.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.204+0000 7fd9d6048b80 1 -- start start 2023-10-06T11:13:08.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.204+0000 7fd9d6048b80 1 Processor -- start 2023-10-06T11:13:08.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.205+0000 7fd9d6048b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557da5111c10 0x557da51b6810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.205+0000 7fd9d6048b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557da51139e0 0x557da5155540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.205+0000 7fd9d6048b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557da5157ad0 0x557da5155a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.205+0000 7fd9d6048b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x557da51382d0 con 0x557da5111c10 2023-10-06T11:13:08.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.205+0000 7fd9d6048b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557da513bff0 con 0x557da5157ad0 2023-10-06T11:13:08.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.205+0000 7fd9d6048b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x557da513c480 con 0x557da51139e0 2023-10-06T11:13:08.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.205+0000 7fd9d6048b80 10 client.0 _ll_register_callbacks cb 0x557da4efdf70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:13:08.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.205+0000 7fd9c659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557da5111c10 0x557da51b6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.205+0000 7fd9c659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557da5111c10 0x557da51b6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50908/0 (socket says 172.21.15.146:50908) 2023-10-06T11:13:08.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.205+0000 7fd9c659c700 1 -- 172.21.15.146:0/769251508 learned_addr learned my addr 172.21.15.146:0/769251508 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:08.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.206+0000 7fd9c6d9d700 1 --2- 172.21.15.146:0/769251508 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557da5157ad0 0x557da5155a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.206+0000 7fd9c5d9b700 1 --2- 172.21.15.146:0/769251508 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557da51139e0 0x557da5155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.206+0000 7fd9c659c700 1 -- 172.21.15.146:0/769251508 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557da51139e0 msgr2=0x557da5155540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:08.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.206+0000 7fd9c659c700 1 --2- 172.21.15.146:0/769251508 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557da51139e0 0x557da5155540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.206+0000 7fd9c659c700 1 -- 172.21.15.146:0/769251508 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557da5157ad0 msgr2=0x557da5155a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:08.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.206+0000 7fd9c659c700 1 --2- 172.21.15.146:0/769251508 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557da5157ad0 0x557da5155a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.206+0000 7fd9c659c700 1 -- 172.21.15.146:0/769251508 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557da4efb2b0 con 0x557da5111c10 2023-10-06T11:13:08.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.206+0000 7fd9c6d9d700 1 --2- 172.21.15.146:0/769251508 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557da5157ad0 0x557da5155a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:08.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.206+0000 7fd9c5d9b700 1 --2- 172.21.15.146:0/769251508 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557da51139e0 0x557da5155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:08.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.206+0000 7fd9c659c700 1 --2- 172.21.15.146:0/769251508 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557da5111c10 0x557da51b6810 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0007250 tx=0x7fd9c0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42db8b21aba9a75c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:08.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.206+0000 7fd9a4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:13:08.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.206+0000 7fd9a4ff9700 1 -- 172.21.15.146:0/769251508 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c0036070 con 0x557da5111c10 2023-10-06T11:13:08.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.206+0000 7fd9a4ff9700 1 -- 172.21.15.146:0/769251508 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd9c0000c30 con 0x557da5111c10 2023-10-06T11:13:08.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.206+0000 7fd9d6048b80 1 -- 172.21.15.146:0/769251508 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557da5155120 con 0x557da5111c10 2023-10-06T11:13:08.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.206+0000 7fd9a4ff9700 1 -- 172.21.15.146:0/769251508 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd9c001f600 con 0x557da5111c10 2023-10-06T11:13:08.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.206+0000 7fd9d6048b80 10 client.7410 fetch_fsmap learned FSMap version 85 2023-10-06T11:13:08.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.206+0000 7fd9d6048b80 1 -- 172.21.15.146:0/769251508 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) v3 -- 0x557da50164b0 con 0x557da5111c10 2023-10-06T11:13:08.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.206+0000 7fd9a4ff9700 1 -- 172.21.15.146:0/769251508 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557da5155120 con 0x557da5111c10 2023-10-06T11:13:08.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.206+0000 7fd9a4ff9700 1 -- 172.21.15.146:0/769251508 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 85) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd9c0030b70 con 0x557da5111c10 2023-10-06T11:13:08.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.206+0000 7fd9d6048b80 10 client.7410 fetch_fsmap finished waiting for FSMap version 85 2023-10-06T11:13:08.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.206+0000 7fd9d6048b80 10 client.7410 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.d 2023-10-06T11:13:08.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.206+0000 7fd9d6048b80 20 client.7410 populate_metadata read hostname 'smithi146' 2023-10-06T11:13:08.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.206+0000 7fd9d6048b80 1 --2- 172.21.15.146:0/769251508 >> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] conn(0x557da51bd100 0x557da51371c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.206+0000 7fd9d6048b80 4 client.7410 mds_command: new command op to 7227 tid=0[{"prefix": "scrub abort"}] 2023-10-06T11:13:08.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.206+0000 7fd9d6048b80 1 -- 172.21.15.146:0/769251508 --> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] -- command(tid 0: {"prefix": "scrub abort"}) v1 -- 0x7fd9b0005c90 con 0x557da51bd100 2023-10-06T11:13:08.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.207+0000 7fd9c5d9b700 1 --2- 172.21.15.146:0/769251508 >> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] conn(0x557da51bd100 0x557da51371c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.207+0000 7fd9c5d9b700 1 --2- 172.21.15.146:0/769251508 >> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] conn(0x557da51bd100 0x557da51371c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ffbcd07b8b4cf2f server_cookie=9a9f324628c10607 in_seq=0 out_seq=0 2023-10-06T11:13:08.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.207+0000 7fd9a4ff9700 10 client.7410 ms_handle_connect on v2:172.21.15.151:6833/3868165725 2023-10-06T11:13:08.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.207+0000 7fd9a4ff9700 1 -- 172.21.15.146:0/769251508 <== mds.0 v2:172.21.15.151:6833/3868165725 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x7fd9b0005c90 con 0x557da51bd100 2023-10-06T11:13:08.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.207+0000 7fd9a4ff9700 10 client.7410 handle_command_reply: tid=0 2023-10-06T11:13:08.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.207+0000 7fd9d6048b80 1 client.7410 shutdown 2023-10-06T11:13:08.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.207+0000 7fd9d6048b80 1 -- 172.21.15.146:0/769251508 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557da5111c10 msgr2=0x557da51b6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:08.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.207+0000 7fd9d6048b80 1 --2- 172.21.15.146:0/769251508 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557da5111c10 0x557da51b6810 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0007250 tx=0x7fd9c0016000 comp rx=0 tx=0).stop 2023-10-06T11:13:08.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.207+0000 7fd9d6048b80 1 -- 172.21.15.146:0/769251508 shutdown_connections 2023-10-06T11:13:08.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.207+0000 7fd9d6048b80 1 --2- 172.21.15.146:0/769251508 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557da5157ad0 0x557da5155a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.207+0000 7fd9d6048b80 1 --2- 172.21.15.146:0/769251508 >> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] conn(0x557da51bd100 0x557da51371c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.207+0000 7fd9d6048b80 1 --2- 172.21.15.146:0/769251508 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557da5111c10 0x557da51b6810 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.207+0000 7fd9d6048b80 1 --2- 172.21.15.146:0/769251508 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557da51139e0 0x557da5155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.207+0000 7fd9a4ff9700 0 client.7410 ms_handle_reset on v2:172.21.15.151:6833/3868165725 2023-10-06T11:13:08.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.207+0000 7fd9d6048b80 1 -- 172.21.15.146:0/769251508 >> 172.21.15.146:0/769251508 conn(0x557da51120b0 msgr2=0x557da513aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:08.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.207+0000 7fd9d6048b80 1 -- 172.21.15.146:0/769251508 shutdown_connections 2023-10-06T11:13:08.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.207+0000 7fd9d6048b80 1 -- 172.21.15.146:0/769251508 wait complete. 2023-10-06T11:13:08.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.208+0000 7fd9d6048b80 20 client.7410 trim_cache size 0 max 16384 2023-10-06T11:13:08.217 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:13:08.217 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0 2023-10-06T11:13:08.217 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:13:08.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.208+0000 7fd9ccd50700 1 -- 172.21.15.146:0/3940750836 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd9a8066f30 msgr2=0x7fd9a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:08.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.208+0000 7fd9ccd50700 1 --2- 172.21.15.146:0/3940750836 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd9a8066f30 0x7fd9a80693e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0007970 tx=0x7fd9c0008040 comp rx=0 tx=0).stop 2023-10-06T11:13:08.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.208+0000 7fd9ccd50700 1 -- 172.21.15.146:0/3940750836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9c815dae0 msgr2=0x7fd9c814cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:08.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.208+0000 7fd9ccd50700 1 --2- 172.21.15.146:0/3940750836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9c815dae0 0x7fd9c814cba0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fd9b8013000 tx=0x7fd9b8019000 comp rx=0 tx=0).stop 2023-10-06T11:13:08.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.208+0000 7fd9ccd50700 1 -- 172.21.15.146:0/3940750836 shutdown_connections 2023-10-06T11:13:08.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.208+0000 7fd9ccd50700 1 --2- 172.21.15.146:0/3940750836 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd9a8066f30 0x7fd9a80693e0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.208+0000 7fd9ccd50700 1 --2- 172.21.15.146:0/3940750836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9c815dae0 0x7fd9c814cba0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.208+0000 7fd9ccd50700 1 --2- 172.21.15.146:0/3940750836 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd9c80aef20 0x7fd9c80c8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.208+0000 7fd9ccd50700 1 --2- 172.21.15.146:0/3940750836 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9c815d710 0x7fd9c80abfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.208+0000 7fd9ccd50700 1 -- 172.21.15.146:0/3940750836 >> 172.21.15.146:0/3940750836 conn(0x7fd9c8067c50 msgr2=0x7fd9c81545f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:08.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.208+0000 7fd9ccd50700 1 -- 172.21.15.146:0/3940750836 shutdown_connections 2023-10-06T11:13:08.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.208+0000 7fd9ccd50700 1 -- 172.21.15.146:0/3940750836 wait complete. 2023-10-06T11:13:08.221 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 scrub status 2023-10-06T11:13:08.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.335+0000 7f7ce19b5700 1 Processor -- start 2023-10-06T11:13:08.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.335+0000 7f7ce19b5700 1 -- start start 2023-10-06T11:13:08.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.336+0000 7f7ce19b5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7cdc159f40 0x7f7cdc15d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.336+0000 7f7ce19b5700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7cdc0c7810 0x7f7cdc15dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.336+0000 7f7ce19b5700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cdc0d1670 con 0x7f7cdc15e420 2023-10-06T11:13:08.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.336+0000 7f7ce19b5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cdc0cc4b0 con 0x7f7cdc159f40 2023-10-06T11:13:08.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.336+0000 7f7ce19b5700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cdc15a310 con 0x7f7cdc0c7810 2023-10-06T11:13:08.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.336+0000 7f7cdaffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7cdc159f40 0x7f7cdc15d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.336+0000 7f7cdb7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7cdc15e420 0x7f7cdc0cf300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52562/0 (socket says 172.21.15.146:52562) 2023-10-06T11:13:08.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.336+0000 7f7cdb7fe700 1 -- 172.21.15.146:0/3394876947 learned_addr learned my addr 172.21.15.146:0/3394876947 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:13:08.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.337+0000 7f7cda7fc700 1 --2- 172.21.15.146:0/3394876947 >> v2:172.21.15.151:3300/0 conn(0x7f7cdc0c7810 0x7f7cdc15dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.337+0000 7f7cdaffd700 1 -- 172.21.15.146:0/3394876947 >> v2:172.21.15.151:3300/0 conn(0x7f7cdc0c7810 msgr2=0x7f7cdc15dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:08.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.337+0000 7f7cdaffd700 1 --2- 172.21.15.146:0/3394876947 >> v2:172.21.15.151:3300/0 conn(0x7f7cdc0c7810 0x7f7cdc15dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.337+0000 7f7cdaffd700 1 -- 172.21.15.146:0/3394876947 >> v1:172.21.15.146:6789/0 conn(0x7f7cdc15e420 legacy=0x7f7cdc0cf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:08.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.337+0000 7f7cdaffd700 1 -- 172.21.15.146:0/3394876947 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cdc0cee70 con 0x7f7cdc159f40 2023-10-06T11:13:08.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.337+0000 7f7cd9ffb700 1 -- 172.21.15.146:0/3394876947 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1353793944 0 0) 0x7f7cdc0d1670 con 0x7f7cdc15e420 2023-10-06T11:13:08.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.337+0000 7f7cda7fc700 1 --2- 172.21.15.146:0/3394876947 >> v2:172.21.15.151:3300/0 conn(0x7f7cdc0c7810 0x7f7cdc15dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:08.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.337+0000 7f7cdaffd700 1 --2- 172.21.15.146:0/3394876947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cdc159f40 0x7f7cdc15d9a0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc08aa90 tx=0x7f7ccc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf0bb94359347ce1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:08.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.337+0000 7f7cd9ffb700 1 -- 172.21.15.146:0/3394876947 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc00e070 con 0x7f7cdc159f40 2023-10-06T11:13:08.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.337+0000 7f7cd9ffb700 1 -- 172.21.15.146:0/3394876947 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ccc00bbf0 con 0x7f7cdc159f40 2023-10-06T11:13:08.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.337+0000 7f7cd9ffb700 1 -- 172.21.15.146:0/3394876947 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc012430 con 0x7f7cdc159f40 2023-10-06T11:13:08.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.337+0000 7f7ce19b5700 1 -- 172.21.15.146:0/3394876947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cdc159f40 msgr2=0x7f7cdc15d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:08.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.337+0000 7f7ce19b5700 1 --2- 172.21.15.146:0/3394876947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cdc159f40 0x7f7cdc15d9a0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc08aa90 tx=0x7f7ccc009780 comp rx=0 tx=0).stop 2023-10-06T11:13:08.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.338+0000 7f7ce19b5700 1 -- 172.21.15.146:0/3394876947 shutdown_connections 2023-10-06T11:13:08.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.338+0000 7f7ce19b5700 1 --2- 172.21.15.146:0/3394876947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cdc159f40 0x7f7cdc15d9a0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.338+0000 7f7ce19b5700 1 --2- 172.21.15.146:0/3394876947 >> v2:172.21.15.151:3300/0 conn(0x7f7cdc0c7810 0x7f7cdc15dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.338+0000 7f7ce19b5700 1 -- 172.21.15.146:0/3394876947 >> 172.21.15.146:0/3394876947 conn(0x7f7cdc06f380 msgr2=0x7f7cdc0d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:08.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.338+0000 7f7ce19b5700 1 -- 172.21.15.146:0/3394876947 shutdown_connections 2023-10-06T11:13:08.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.338+0000 7f7ce19b5700 1 -- 172.21.15.146:0/3394876947 wait complete. 2023-10-06T11:13:08.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.339+0000 7f7ce19b5700 1 Processor -- start 2023-10-06T11:13:08.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.339+0000 7f7ce19b5700 1 -- start start 2023-10-06T11:13:08.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.340+0000 7f7ce19b5700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7cdc0c7810 0x7f7cdc0caef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.340+0000 7f7ce19b5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cdc159f40 0x7f7cdc0c8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.340+0000 7f7ce19b5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cdc15e420 0x7f7cdc157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.340+0000 7f7ce19b5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cdc0c9b70 con 0x7f7cdc15e420 2023-10-06T11:13:08.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.340+0000 7f7ce19b5700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cdc0c8f60 con 0x7f7cdc159f40 2023-10-06T11:13:08.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.340+0000 7f7ce19b5700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cdc0c9240 con 0x7f7cdc0c7810 2023-10-06T11:13:08.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.340+0000 7f7cdb7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cdc15e420 0x7f7cdc157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.340+0000 7f7cdb7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cdc15e420 0x7f7cdc157d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50928/0 (socket says 172.21.15.146:50928) 2023-10-06T11:13:08.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.340+0000 7f7cdb7fe700 1 -- 172.21.15.146:0/2182586231 learned_addr learned my addr 172.21.15.146:0/2182586231 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:08.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.340+0000 7f7cda7fc700 1 --2- 172.21.15.146:0/2182586231 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cdc159f40 0x7f7cdc0c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.340+0000 7f7cdaffd700 1 --2- 172.21.15.146:0/2182586231 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7cdc0c7810 0x7f7cdc0caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.340+0000 7f7cdb7fe700 1 -- 172.21.15.146:0/2182586231 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7cdc0c7810 msgr2=0x7f7cdc0caef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:08.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.340+0000 7f7cdb7fe700 1 --2- 172.21.15.146:0/2182586231 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7cdc0c7810 0x7f7cdc0caef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.340+0000 7f7cdb7fe700 1 -- 172.21.15.146:0/2182586231 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cdc159f40 msgr2=0x7f7cdc0c8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:08.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.340+0000 7f7cdb7fe700 1 --2- 172.21.15.146:0/2182586231 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cdc159f40 0x7f7cdc0c8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.340+0000 7f7cdb7fe700 1 -- 172.21.15.146:0/2182586231 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ccc009a20 con 0x7f7cdc15e420 2023-10-06T11:13:08.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.340+0000 7f7cdb7fe700 1 --2- 172.21.15.146:0/2182586231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cdc15e420 0x7f7cdc157d40 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f7cd400c530 tx=0x7f7cd4007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:08.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.340+0000 7f7cc2ffd700 1 -- 172.21.15.146:0/2182586231 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd4005b30 con 0x7f7cdc15e420 2023-10-06T11:13:08.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.340+0000 7f7cc2ffd700 1 -- 172.21.15.146:0/2182586231 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd4005c90 con 0x7f7cdc15e420 2023-10-06T11:13:08.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.340+0000 7f7cc2ffd700 1 -- 172.21.15.146:0/2182586231 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd4007320 con 0x7f7cdc15e420 2023-10-06T11:13:08.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.340+0000 7f7ce19b5700 1 -- 172.21.15.146:0/2182586231 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cdc0c9520 con 0x7f7cdc15e420 2023-10-06T11:13:08.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.340+0000 7f7ce19b5700 1 -- 172.21.15.146:0/2182586231 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cdc0ca000 con 0x7f7cdc15e420 2023-10-06T11:13:08.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.342+0000 7f7cc2ffd700 1 -- 172.21.15.146:0/2182586231 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7cd401b3b0 con 0x7f7cdc15e420 2023-10-06T11:13:08.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.342+0000 7f7cc2ffd700 1 --2- 172.21.15.146:0/2182586231 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7cc8066f30 0x7f7cc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.342+0000 7f7cc2ffd700 1 -- 172.21.15.146:0/2182586231 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7cd4083a10 con 0x7f7cdc15e420 2023-10-06T11:13:08.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.342+0000 7f7cdaffd700 1 --2- 172.21.15.146:0/2182586231 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7cc8066f30 0x7f7cc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.342+0000 7f7cdaffd700 1 --2- 172.21.15.146:0/2182586231 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7cc8066f30 0x7f7cc80693e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc0097c0 tx=0x7f7ccc017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:08.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.344+0000 7f7ceacadb80 1 Processor -- start 2023-10-06T11:13:08.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.344+0000 7f7ceacadb80 1 -- start start 2023-10-06T11:13:08.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.345+0000 7f7ceacadb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630cef00ae0 0x5630cef00eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.345+0000 7f7ceacadb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630ceebc9f0 0x5630ceeb95d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.345+0000 7f7ceacadb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5630ceebac20 0x5630ceeb9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.345+0000 7f7ceacadb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630cee39cd0 con 0x5630cef00ae0 2023-10-06T11:13:08.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.345+0000 7f7ceacadb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630cee10ac0 con 0x5630ceebc9f0 2023-10-06T11:13:08.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.345+0000 7f7ceacadb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5630cee0e2c0 con 0x5630ceebac20 2023-10-06T11:13:08.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.345+0000 7f7cdaffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630cef00ae0 0x5630cef00eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.345+0000 7f7cdaffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630cef00ae0 0x5630cef00eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50930/0 (socket says 172.21.15.146:50930) 2023-10-06T11:13:08.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.345+0000 7f7cdaffd700 1 -- 172.21.15.146:0/2068718203 learned_addr learned my addr 172.21.15.146:0/2068718203 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:08.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.345+0000 7f7cda7fc700 1 --2- 172.21.15.146:0/2068718203 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630ceebc9f0 0x5630ceeb95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.345+0000 7f7cdaffd700 1 -- 172.21.15.146:0/2068718203 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5630ceebac20 msgr2=0x5630ceeb9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:08.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.345+0000 7f7cdaffd700 1 --2- 172.21.15.146:0/2068718203 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5630ceebac20 0x5630ceeb9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.345+0000 7f7cdaffd700 1 -- 172.21.15.146:0/2068718203 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630ceebc9f0 msgr2=0x5630ceeb95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:08.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.345+0000 7f7cdaffd700 1 --2- 172.21.15.146:0/2068718203 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630ceebc9f0 0x5630ceeb95d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.345+0000 7f7cdaffd700 1 -- 172.21.15.146:0/2068718203 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630ceca42c0 con 0x5630cef00ae0 2023-10-06T11:13:08.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.345+0000 7f7cdaffd700 1 --2- 172.21.15.146:0/2068718203 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630cef00ae0 0x5630cef00eb0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc0011c0 tx=0x7f7ccc021040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=811b18cdaf88a3e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:08.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.345+0000 7f7cbbfff700 1 -- 172.21.15.146:0/2068718203 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc01f4b0 con 0x5630cef00ae0 2023-10-06T11:13:08.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.346+0000 7f7cbbfff700 1 -- 172.21.15.146:0/2068718203 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ccc01f630 con 0x5630cef00ae0 2023-10-06T11:13:08.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.346+0000 7f7cbbfff700 1 -- 172.21.15.146:0/2068718203 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc01f9f0 con 0x5630cef00ae0 2023-10-06T11:13:08.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.346+0000 7f7ceacadb80 1 -- 172.21.15.146:0/2068718203 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630cef00ae0 msgr2=0x5630cef00eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:08.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.346+0000 7f7ceacadb80 1 --2- 172.21.15.146:0/2068718203 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630cef00ae0 0x5630cef00eb0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc0011c0 tx=0x7f7ccc021040 comp rx=0 tx=0).stop 2023-10-06T11:13:08.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.346+0000 7f7ceacadb80 1 -- 172.21.15.146:0/2068718203 shutdown_connections 2023-10-06T11:13:08.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.346+0000 7f7ceacadb80 1 --2- 172.21.15.146:0/2068718203 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5630ceebac20 0x5630ceeb9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.346+0000 7f7ceacadb80 1 --2- 172.21.15.146:0/2068718203 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630cef00ae0 0x5630cef00eb0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.346+0000 7f7ceacadb80 1 --2- 172.21.15.146:0/2068718203 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630ceebc9f0 0x5630ceeb95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.346+0000 7f7ceacadb80 1 -- 172.21.15.146:0/2068718203 >> 172.21.15.146:0/2068718203 conn(0x5630ceebb0c0 msgr2=0x5630ceebb490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:08.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.346+0000 7f7ceacadb80 1 -- 172.21.15.146:0/2068718203 shutdown_connections 2023-10-06T11:13:08.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.346+0000 7f7ceacadb80 1 -- 172.21.15.146:0/2068718203 wait complete. 2023-10-06T11:13:08.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.347+0000 7f7ceacadb80 1 -- start start 2023-10-06T11:13:08.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.347+0000 7f7ceacadb80 1 Processor -- start 2023-10-06T11:13:08.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.348+0000 7f7ceacadb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5630ceebac20 0x5630ceefb930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.348+0000 7f7ceacadb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630ceebc9f0 0x5630ceee0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.348+0000 7f7ceacadb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630cef00ae0 0x5630ceee4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.348+0000 7f7ceacadb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630cee0a0b0 con 0x5630cef00ae0 2023-10-06T11:13:08.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.348+0000 7f7ceacadb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630cedb58e0 con 0x5630ceebc9f0 2023-10-06T11:13:08.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.348+0000 7f7ceacadb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5630cedd0ef0 con 0x5630ceebac20 2023-10-06T11:13:08.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.348+0000 7f7ceacadb80 10 client.0 _ll_register_callbacks cb 0x5630ceca6f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:13:08.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.348+0000 7f7cdb7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630cef00ae0 0x5630ceee4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.348+0000 7f7cdb7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630cef00ae0 0x5630ceee4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50946/0 (socket says 172.21.15.146:50946) 2023-10-06T11:13:08.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.348+0000 7f7cdb7fe700 1 -- 172.21.15.146:0/1712262826 learned_addr learned my addr 172.21.15.146:0/1712262826 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:08.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.348+0000 7f7cda7fc700 1 --2- 172.21.15.146:0/1712262826 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630ceebc9f0 0x5630ceee0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.348+0000 7f7cdaffd700 1 --2- 172.21.15.146:0/1712262826 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5630ceebac20 0x5630ceefb930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.348+0000 7f7cdb7fe700 1 -- 172.21.15.146:0/1712262826 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5630ceebac20 msgr2=0x5630ceefb930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:08.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.348+0000 7f7cdb7fe700 1 --2- 172.21.15.146:0/1712262826 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5630ceebac20 0x5630ceefb930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.348+0000 7f7cdb7fe700 1 -- 172.21.15.146:0/1712262826 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630ceebc9f0 msgr2=0x5630ceee0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:08.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.348+0000 7f7cdb7fe700 1 --2- 172.21.15.146:0/1712262826 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630ceebc9f0 0x5630ceee0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.348+0000 7f7cdb7fe700 1 -- 172.21.15.146:0/1712262826 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cdc0cee70 con 0x5630cef00ae0 2023-10-06T11:13:08.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.348+0000 7f7cdb7fe700 1 --2- 172.21.15.146:0/1712262826 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630cef00ae0 0x5630ceee4180 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4081e80 tx=0x7f7cd4081d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7698fdd8925be72 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:08.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.348+0000 7f7cb97fa700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:13:08.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.348+0000 7f7cb97fa700 1 -- 172.21.15.146:0/1712262826 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd406a020 con 0x5630cef00ae0 2023-10-06T11:13:08.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.348+0000 7f7ceacadb80 1 -- 172.21.15.146:0/1712262826 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5630ceeae6e0 con 0x5630cef00ae0 2023-10-06T11:13:08.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.349+0000 7f7cb97fa700 1 -- 172.21.15.146:0/1712262826 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7cd40547e0 con 0x5630cef00ae0 2023-10-06T11:13:08.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.349+0000 7f7cb97fa700 1 -- 172.21.15.146:0/1712262826 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7cd4057a30 con 0x5630cef00ae0 2023-10-06T11:13:08.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.349+0000 7f7ceacadb80 10 client.7425 fetch_fsmap learned FSMap version 85 2023-10-06T11:13:08.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.349+0000 7f7ceacadb80 1 -- 172.21.15.146:0/1712262826 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) v3 -- 0x5630cec47030 con 0x5630cef00ae0 2023-10-06T11:13:08.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.349+0000 7f7cb97fa700 1 -- 172.21.15.146:0/1712262826 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5630ceeae6e0 con 0x5630cef00ae0 2023-10-06T11:13:08.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.349+0000 7f7cb97fa700 1 -- 172.21.15.146:0/1712262826 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 85) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f7cd40702b0 con 0x5630cef00ae0 2023-10-06T11:13:08.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.349+0000 7f7ceacadb80 10 client.7425 fetch_fsmap finished waiting for FSMap version 85 2023-10-06T11:13:08.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.349+0000 7f7ceacadb80 10 client.7425 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.d 2023-10-06T11:13:08.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.349+0000 7f7ceacadb80 20 client.7425 populate_metadata read hostname 'smithi146' 2023-10-06T11:13:08.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.349+0000 7f7ceacadb80 1 --2- 172.21.15.146:0/1712262826 >> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] conn(0x5630ceee46c0 0x5630ceee1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.349+0000 7f7ceacadb80 4 client.7425 mds_command: new command op to 7227 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:13:08.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.349+0000 7f7ceacadb80 1 -- 172.21.15.146:0/1712262826 --> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5630cee8b610 con 0x5630ceee46c0 2023-10-06T11:13:08.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.349+0000 7f7cdaffd700 1 --2- 172.21.15.146:0/1712262826 >> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] conn(0x5630ceee46c0 0x5630ceee1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.349+0000 7f7cb97fa700 10 client.7425 ms_handle_connect on v2:172.21.15.151:6833/3868165725 2023-10-06T11:13:08.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.349+0000 7f7cdaffd700 1 --2- 172.21.15.146:0/1712262826 >> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] conn(0x5630ceee46c0 0x5630ceee1c90 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d5c31950a07f09d server_cookie=ae769ed32192a223 in_seq=0 out_seq=0 2023-10-06T11:13:08.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.350+0000 7f7cb97fa700 1 -- 172.21.15.146:0/1712262826 <== mds.0 v2:172.21.15.151:6833/3868165725 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5630cee8b610 con 0x5630ceee46c0 2023-10-06T11:13:08.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.350+0000 7f7cb97fa700 10 client.7425 handle_command_reply: tid=0 2023-10-06T11:13:08.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.350+0000 7f7ceacadb80 1 client.7425 shutdown 2023-10-06T11:13:08.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.350+0000 7f7ceacadb80 1 -- 172.21.15.146:0/1712262826 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630cef00ae0 msgr2=0x5630ceee4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:08.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.350+0000 7f7ceacadb80 1 --2- 172.21.15.146:0/1712262826 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630cef00ae0 0x5630ceee4180 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4081e80 tx=0x7f7cd4081d30 comp rx=0 tx=0).stop 2023-10-06T11:13:08.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.350+0000 7f7ceacadb80 1 -- 172.21.15.146:0/1712262826 shutdown_connections 2023-10-06T11:13:08.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.350+0000 7f7ceacadb80 1 --2- 172.21.15.146:0/1712262826 >> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] conn(0x5630ceee46c0 0x5630ceee1c90 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.350+0000 7f7ceacadb80 1 --2- 172.21.15.146:0/1712262826 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630cef00ae0 0x5630ceee4180 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.350+0000 7f7cb97fa700 0 client.7425 ms_handle_reset on v2:172.21.15.151:6833/3868165725 2023-10-06T11:13:08.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.350+0000 7f7ceacadb80 1 --2- 172.21.15.146:0/1712262826 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5630ceebac20 0x5630ceefb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.350+0000 7f7ceacadb80 1 --2- 172.21.15.146:0/1712262826 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630ceebc9f0 0x5630ceee0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.350+0000 7f7ceacadb80 1 -- 172.21.15.146:0/1712262826 >> 172.21.15.146:0/1712262826 conn(0x5630ceebb0c0 msgr2=0x5630ceeffec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:08.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.350+0000 7f7ceacadb80 1 -- 172.21.15.146:0/1712262826 shutdown_connections 2023-10-06T11:13:08.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.350+0000 7f7ceacadb80 1 -- 172.21.15.146:0/1712262826 wait complete. 2023-10-06T11:13:08.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.350+0000 7f7ceacadb80 20 client.7425 trim_cache size 0 max 16384 2023-10-06T11:13:08.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.366+0000 7f7ceacadb80 1 Processor -- start 2023-10-06T11:13:08.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.366+0000 7f7ceacadb80 1 -- start start 2023-10-06T11:13:08.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.367+0000 7f7ceacadb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5630ceebac20 0x5630ceefb810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.367+0000 7f7ceacadb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630ceebc9f0 0x5630ceefa640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.367+0000 7f7ceacadb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630ceee46c0 0x5630ceeb6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.367+0000 7f7ceacadb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630cec8ce80 con 0x5630ceebc9f0 2023-10-06T11:13:08.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.367+0000 7f7ceacadb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630ceeb4bd0 con 0x5630ceee46c0 2023-10-06T11:13:08.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.367+0000 7f7ceacadb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5630ceee5200 con 0x5630ceebac20 2023-10-06T11:13:08.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.367+0000 7f7cda7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630ceebc9f0 0x5630ceefa640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.367+0000 7f7cda7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630ceebc9f0 0x5630ceefa640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50962/0 (socket says 172.21.15.146:50962) 2023-10-06T11:13:08.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.367+0000 7f7cda7fc700 1 -- 172.21.15.146:0/71019139 learned_addr learned my addr 172.21.15.146:0/71019139 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:08.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.367+0000 7f7cdaffd700 1 --2- 172.21.15.146:0/71019139 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5630ceebac20 0x5630ceefb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.367+0000 7f7cdb7fe700 1 --2- 172.21.15.146:0/71019139 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630ceee46c0 0x5630ceeb6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.367+0000 7f7cda7fc700 1 -- 172.21.15.146:0/71019139 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5630ceebac20 msgr2=0x5630ceefb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:08.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.367+0000 7f7cda7fc700 1 --2- 172.21.15.146:0/71019139 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5630ceebac20 0x5630ceefb810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.367+0000 7f7cda7fc700 1 -- 172.21.15.146:0/71019139 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630ceee46c0 msgr2=0x5630ceeb6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:08.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.367+0000 7f7cda7fc700 1 --2- 172.21.15.146:0/71019139 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630ceee46c0 0x5630ceeb6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.367+0000 7f7cda7fc700 1 -- 172.21.15.146:0/71019139 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630cedd87d0 con 0x5630ceebc9f0 2023-10-06T11:13:08.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.367+0000 7f7cdaffd700 1 --2- 172.21.15.146:0/71019139 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5630ceebac20 0x5630ceefb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:08.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.367+0000 7f7cdb7fe700 1 --2- 172.21.15.146:0/71019139 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630ceee46c0 0x5630ceeb6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:08.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.367+0000 7f7cda7fc700 1 --2- 172.21.15.146:0/71019139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630ceebc9f0 0x5630ceefa640 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0009a90 tx=0x7f7cd0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dbd001e2fb3bf9a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:08.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.367+0000 7f7cc0ff9700 1 -- 172.21.15.146:0/71019139 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd0015910 con 0x5630ceebc9f0 2023-10-06T11:13:08.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.367+0000 7f7cc0ff9700 1 -- 172.21.15.146:0/71019139 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd000c070 con 0x5630ceebc9f0 2023-10-06T11:13:08.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.367+0000 7f7cc0ff9700 1 -- 172.21.15.146:0/71019139 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd0015cc0 con 0x5630ceebc9f0 2023-10-06T11:13:08.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.368+0000 7f7ceacadb80 1 -- 172.21.15.146:0/71019139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630ceebc9f0 msgr2=0x5630ceefa640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:08.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.368+0000 7f7ceacadb80 1 --2- 172.21.15.146:0/71019139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630ceebc9f0 0x5630ceefa640 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0009a90 tx=0x7f7cd0008040 comp rx=0 tx=0).stop 2023-10-06T11:13:08.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.368+0000 7f7ceacadb80 1 -- 172.21.15.146:0/71019139 shutdown_connections 2023-10-06T11:13:08.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.368+0000 7f7ceacadb80 1 --2- 172.21.15.146:0/71019139 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630ceee46c0 0x5630ceeb6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.368+0000 7f7ceacadb80 1 --2- 172.21.15.146:0/71019139 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5630ceebac20 0x5630ceefb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.368+0000 7f7ceacadb80 1 --2- 172.21.15.146:0/71019139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630ceebc9f0 0x5630ceefa640 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.368+0000 7f7ceacadb80 1 -- 172.21.15.146:0/71019139 >> 172.21.15.146:0/71019139 conn(0x5630ceebb0c0 msgr2=0x5630ceefffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:08.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.368+0000 7f7ceacadb80 1 -- 172.21.15.146:0/71019139 shutdown_connections 2023-10-06T11:13:08.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.368+0000 7f7ceacadb80 1 -- 172.21.15.146:0/71019139 wait complete. 2023-10-06T11:13:08.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.369+0000 7f7ceacadb80 1 -- start start 2023-10-06T11:13:08.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.369+0000 7f7ceacadb80 1 Processor -- start 2023-10-06T11:13:08.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.370+0000 7f7ceacadb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5630ceebac20 0x5630cef65370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.370+0000 7f7ceacadb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630ceebc9f0 0x5630ceeb95d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.370+0000 7f7ceacadb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630ceee46c0 0x5630ceeb9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.370+0000 7f7ceacadb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630cef04ad0 con 0x5630ceee46c0 2023-10-06T11:13:08.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.370+0000 7f7ceacadb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630cef07640 con 0x5630ceebc9f0 2023-10-06T11:13:08.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.370+0000 7f7ceacadb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5630cef04360 con 0x5630ceebac20 2023-10-06T11:13:08.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.370+0000 7f7ceacadb80 10 client.0 _ll_register_callbacks cb 0x5630ceca6f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:13:08.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.370+0000 7f7cdb7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630ceee46c0 0x5630ceeb9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.370+0000 7f7cdb7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630ceee46c0 0x5630ceeb9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:50978/0 (socket says 172.21.15.146:50978) 2023-10-06T11:13:08.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.370+0000 7f7cdb7fe700 1 -- 172.21.15.146:0/3496279996 learned_addr learned my addr 172.21.15.146:0/3496279996 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:08.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.370+0000 7f7cda7fc700 1 --2- 172.21.15.146:0/3496279996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630ceebc9f0 0x5630ceeb95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.370+0000 7f7cdaffd700 1 --2- 172.21.15.146:0/3496279996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5630ceebac20 0x5630cef65370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.370+0000 7f7cdb7fe700 1 -- 172.21.15.146:0/3496279996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5630ceebac20 msgr2=0x5630cef65370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:08.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.370+0000 7f7cdb7fe700 1 --2- 172.21.15.146:0/3496279996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5630ceebac20 0x5630cef65370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.370+0000 7f7cdb7fe700 1 -- 172.21.15.146:0/3496279996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630ceebc9f0 msgr2=0x5630ceeb95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:08.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.370+0000 7f7cdb7fe700 1 --2- 172.21.15.146:0/3496279996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630ceebc9f0 0x5630ceeb95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.370+0000 7f7cdb7fe700 1 -- 172.21.15.146:0/3496279996 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cd000e040 con 0x5630ceee46c0 2023-10-06T11:13:08.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.370+0000 7f7cdb7fe700 1 --2- 172.21.15.146:0/3496279996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630ceee46c0 0x5630ceeb9b10 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4051200 tx=0x7f7cd4069000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaacfe98dc4c9f7d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:08.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.370+0000 7f7cb97fa700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:13:08.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.370+0000 7f7cb97fa700 1 -- 172.21.15.146:0/3496279996 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd406a040 con 0x5630ceee46c0 2023-10-06T11:13:08.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.370+0000 7f7cb97fa700 1 -- 172.21.15.146:0/3496279996 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7cd40547e0 con 0x5630ceee46c0 2023-10-06T11:13:08.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.370+0000 7f7ceacadb80 1 -- 172.21.15.146:0/3496279996 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7ccc01f630 con 0x5630ceee46c0 2023-10-06T11:13:08.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.370+0000 7f7cb97fa700 1 -- 172.21.15.146:0/3496279996 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7cd4054ee0 con 0x5630ceee46c0 2023-10-06T11:13:08.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.370+0000 7f7ceacadb80 10 client.7431 fetch_fsmap learned FSMap version 85 2023-10-06T11:13:08.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.370+0000 7f7ceacadb80 1 -- 172.21.15.146:0/3496279996 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) v3 -- 0x5630cedbf4c0 con 0x5630ceee46c0 2023-10-06T11:13:08.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.370+0000 7f7cb97fa700 1 -- 172.21.15.146:0/3496279996 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ccc01f630 con 0x5630ceee46c0 2023-10-06T11:13:08.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.371+0000 7f7cb97fa700 1 -- 172.21.15.146:0/3496279996 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 85) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f7cd40702b0 con 0x5630ceee46c0 2023-10-06T11:13:08.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.371+0000 7f7ceacadb80 10 client.7431 fetch_fsmap finished waiting for FSMap version 85 2023-10-06T11:13:08.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.371+0000 7f7ceacadb80 10 client.7431 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.d 2023-10-06T11:13:08.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.371+0000 7f7ceacadb80 20 client.7431 populate_metadata read hostname 'smithi146' 2023-10-06T11:13:08.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.371+0000 7f7ceacadb80 1 --2- 172.21.15.146:0/3496279996 >> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] conn(0x5630cef00ae0 0x5630ceef62b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:08.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.371+0000 7f7ceacadb80 4 client.7431 mds_command: new command op to 7227 tid=0[{"prefix": "scrub status"}] 2023-10-06T11:13:08.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.371+0000 7f7ceacadb80 1 -- 172.21.15.146:0/3496279996 --> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5630cedace50 con 0x5630cef00ae0 2023-10-06T11:13:08.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.371+0000 7f7cdaffd700 1 --2- 172.21.15.146:0/3496279996 >> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] conn(0x5630cef00ae0 0x5630ceef62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:08.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.371+0000 7f7cb97fa700 10 client.7431 ms_handle_connect on v2:172.21.15.151:6833/3868165725 2023-10-06T11:13:08.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.371+0000 7f7cdaffd700 1 --2- 172.21.15.146:0/3496279996 >> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] conn(0x5630cef00ae0 0x5630ceef62b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2d425d5a0b1e46d server_cookie=c4c96888f2b9acf2 in_seq=0 out_seq=0 2023-10-06T11:13:08.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.371+0000 7f7cb97fa700 1 -- 172.21.15.146:0/3496279996 <== mds.0 v2:172.21.15.151:6833/3868165725 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+276 (crc 0 0 0) 0x5630cedace50 con 0x5630cef00ae0 2023-10-06T11:13:08.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.371+0000 7f7cb97fa700 10 client.7431 handle_command_reply: tid=0 2023-10-06T11:13:08.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.371+0000 7f7ceacadb80 1 client.7431 shutdown 2023-10-06T11:13:08.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.371+0000 7f7ceacadb80 1 -- 172.21.15.146:0/3496279996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630ceee46c0 msgr2=0x5630ceeb9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:08.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.371+0000 7f7ceacadb80 1 --2- 172.21.15.146:0/3496279996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630ceee46c0 0x5630ceeb9b10 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4051200 tx=0x7f7cd4069000 comp rx=0 tx=0).stop 2023-10-06T11:13:08.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.371+0000 7f7ceacadb80 1 -- 172.21.15.146:0/3496279996 shutdown_connections 2023-10-06T11:13:08.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.371+0000 7f7ceacadb80 1 --2- 172.21.15.146:0/3496279996 >> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] conn(0x5630cef00ae0 0x5630ceef62b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.371+0000 7f7ceacadb80 1 --2- 172.21.15.146:0/3496279996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5630ceee46c0 0x5630ceeb9b10 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.371+0000 7f7cb97fa700 0 client.7431 ms_handle_reset on v2:172.21.15.151:6833/3868165725 2023-10-06T11:13:08.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.371+0000 7f7ceacadb80 1 --2- 172.21.15.146:0/3496279996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5630ceebac20 0x5630cef65370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.371+0000 7f7ceacadb80 1 --2- 172.21.15.146:0/3496279996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630ceebc9f0 0x5630ceeb95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.371+0000 7f7ceacadb80 1 -- 172.21.15.146:0/3496279996 >> 172.21.15.146:0/3496279996 conn(0x5630ceebb0c0 msgr2=0x5630ceeb6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:08.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.372+0000 7f7ceacadb80 1 -- 172.21.15.146:0/3496279996 shutdown_connections 2023-10-06T11:13:08.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.372+0000 7f7ceacadb80 1 -- 172.21.15.146:0/3496279996 wait complete. 2023-10-06T11:13:08.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.372+0000 7f7ceacadb80 20 client.7431 trim_cache size 0 max 16384 2023-10-06T11:13:08.382 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:13:08.382 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-06T11:13:08.382 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": { 2023-10-06T11:13:08.382 INFO:teuthology.orchestra.run.smithi146.stdout: "2269f58a-6ef6-4174-9add-ca8b30aea407": { 2023-10-06T11:13:08.382 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_control_test_path", 2023-10-06T11:13:08.382 INFO:teuthology.orchestra.run.smithi146.stdout: "tag": "2269f58a-6ef6-4174-9add-ca8b30aea407", 2023-10-06T11:13:08.382 INFO:teuthology.orchestra.run.smithi146.stdout: "options": "recursive" 2023-10-06T11:13:08.382 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:13:08.382 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:13:08.383 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:13:08.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.372+0000 7f7ce19b5700 1 -- 172.21.15.146:0/2182586231 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7cc8066f30 msgr2=0x7f7cc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:08.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.372+0000 7f7ce19b5700 1 --2- 172.21.15.146:0/2182586231 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7cc8066f30 0x7f7cc80693e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc0097c0 tx=0x7f7ccc017000 comp rx=0 tx=0).stop 2023-10-06T11:13:08.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.372+0000 7f7ce19b5700 1 -- 172.21.15.146:0/2182586231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cdc15e420 msgr2=0x7f7cdc157d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:08.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.372+0000 7f7ce19b5700 1 --2- 172.21.15.146:0/2182586231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cdc15e420 0x7f7cdc157d40 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f7cd400c530 tx=0x7f7cd4007f90 comp rx=0 tx=0).stop 2023-10-06T11:13:08.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.372+0000 7f7ce19b5700 1 -- 172.21.15.146:0/2182586231 shutdown_connections 2023-10-06T11:13:08.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.372+0000 7f7ce19b5700 1 --2- 172.21.15.146:0/2182586231 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7cc8066f30 0x7f7cc80693e0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.372+0000 7f7ce19b5700 1 --2- 172.21.15.146:0/2182586231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cdc15e420 0x7f7cdc157d40 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.372+0000 7f7ce19b5700 1 --2- 172.21.15.146:0/2182586231 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7cdc0c7810 0x7f7cdc0caef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.372+0000 7f7ce19b5700 1 --2- 172.21.15.146:0/2182586231 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cdc159f40 0x7f7cdc0c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:08.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.372+0000 7f7ce19b5700 1 -- 172.21.15.146:0/2182586231 >> 172.21.15.146:0/2182586231 conn(0x7f7cdc06f380 msgr2=0x7f7cdc158fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:08.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.372+0000 7f7ce19b5700 1 -- 172.21.15.146:0/2182586231 shutdown_connections 2023-10-06T11:13:08.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:08.372+0000 7f7ce19b5700 1 -- 172.21.15.146:0/2182586231 wait complete. 2023-10-06T11:13:13.387 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.6:0 scrub status 2023-10-06T11:13:13.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.514+0000 7fee1c209700 1 Processor -- start 2023-10-06T11:13:13.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.514+0000 7fee1c209700 1 -- start start 2023-10-06T11:13:13.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.515+0000 7fee1c209700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fee140ae730 0x7fee140aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:13.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.515+0000 7fee1c209700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fee140cb950 0x7fee140cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:13.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.515+0000 7fee1c209700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee140ae2a0 con 0x7fee1415a160 2023-10-06T11:13:13.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.515+0000 7fee1c209700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee1415a530 con 0x7fee140ae730 2023-10-06T11:13:13.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.515+0000 7fee1c209700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee140c5cb0 con 0x7fee140cb950 2023-10-06T11:13:13.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.515+0000 7fee197a4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fee140ae730 0x7fee140aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:13.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.515+0000 7fee197a4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fee140ae730 0x7fee140aebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56760/0 (socket says 172.21.15.146:56760) 2023-10-06T11:13:13.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.515+0000 7fee19fa5700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fee1415a160 0x7fee140c55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:54650/0 (socket says 172.21.15.146:54650) 2023-10-06T11:13:13.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.515+0000 7fee197a4700 1 -- 172.21.15.146:0/2087420235 learned_addr learned my addr 172.21.15.146:0/2087420235 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:13.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.515+0000 7fee197a4700 1 -- 172.21.15.146:0/2087420235 >> v2:172.21.15.151:3300/0 conn(0x7fee140cb950 msgr2=0x7fee140cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:13.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.515+0000 7fee1a7a6700 1 --2- 172.21.15.146:0/2087420235 >> v2:172.21.15.151:3300/0 conn(0x7fee140cb950 0x7fee140cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:13.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.516+0000 7fee197a4700 1 --2- 172.21.15.146:0/2087420235 >> v2:172.21.15.151:3300/0 conn(0x7fee140cb950 0x7fee140cbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.516+0000 7fee197a4700 1 -- 172.21.15.146:0/2087420235 >> v1:172.21.15.146:6789/0 conn(0x7fee1415a160 legacy=0x7fee140c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:13.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.516+0000 7fee18fa3700 1 -- 172.21.15.146:0/2087420235 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3014209246 0 0) 0x7fee140ae2a0 con 0x7fee1415a160 2023-10-06T11:13:13.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.516+0000 7fee197a4700 1 -- 172.21.15.146:0/2087420235 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee140af0f0 con 0x7fee140ae730 2023-10-06T11:13:13.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.516+0000 7fee1a7a6700 1 --2- 172.21.15.146:0/2087420235 >> v2:172.21.15.151:3300/0 conn(0x7fee140cb950 0x7fee140cbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:13.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.516+0000 7fee197a4700 1 --2- 172.21.15.146:0/2087420235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee140ae730 0x7fee140aebb0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fee1408b000 tx=0x7fee04009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c971e66203d41d73 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:13.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.516+0000 7fee18fa3700 1 -- 172.21.15.146:0/2087420235 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0400b860 con 0x7fee140ae730 2023-10-06T11:13:13.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.516+0000 7fee18fa3700 1 -- 172.21.15.146:0/2087420235 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee0400b9c0 con 0x7fee140ae730 2023-10-06T11:13:13.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.516+0000 7fee18fa3700 1 -- 172.21.15.146:0/2087420235 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0400bd60 con 0x7fee140ae730 2023-10-06T11:13:13.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.516+0000 7fee1c209700 1 -- 172.21.15.146:0/2087420235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee140ae730 msgr2=0x7fee140aebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:13.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.516+0000 7fee1c209700 1 --2- 172.21.15.146:0/2087420235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee140ae730 0x7fee140aebb0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fee1408b000 tx=0x7fee04009250 comp rx=0 tx=0).stop 2023-10-06T11:13:13.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.516+0000 7fee1c209700 1 -- 172.21.15.146:0/2087420235 shutdown_connections 2023-10-06T11:13:13.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.516+0000 7fee1c209700 1 --2- 172.21.15.146:0/2087420235 >> v2:172.21.15.151:3300/0 conn(0x7fee140cb950 0x7fee140cbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.516+0000 7fee1c209700 1 --2- 172.21.15.146:0/2087420235 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee140ae730 0x7fee140aebb0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.516+0000 7fee1c209700 1 -- 172.21.15.146:0/2087420235 >> 172.21.15.146:0/2087420235 conn(0x7fee1406f380 msgr2=0x7fee140d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:13.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.517+0000 7fee1c209700 1 -- 172.21.15.146:0/2087420235 shutdown_connections 2023-10-06T11:13:13.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.517+0000 7fee1c209700 1 -- 172.21.15.146:0/2087420235 wait complete. 2023-10-06T11:13:13.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.518+0000 7fee1c209700 1 Processor -- start 2023-10-06T11:13:13.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.518+0000 7fee1c209700 1 -- start start 2023-10-06T11:13:13.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.518+0000 7fee1c209700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee140ae730 0x7fee1415e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:13.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.518+0000 7fee1c209700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee140cb950 0x7fee1416e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:13.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.518+0000 7fee1c209700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee1415a160 0x7fee140ca210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:13.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.518+0000 7fee1c209700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1415f470 con 0x7fee1415a160 2023-10-06T11:13:13.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.518+0000 7fee1c209700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1416ec40 con 0x7fee140ae730 2023-10-06T11:13:13.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.518+0000 7fee1c209700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee1415e860 con 0x7fee140cb950 2023-10-06T11:13:13.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.518+0000 7fee1a7a6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee1415a160 0x7fee140ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:13.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.518+0000 7fee1a7a6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee1415a160 0x7fee140ca210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56772/0 (socket says 172.21.15.146:56772) 2023-10-06T11:13:13.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.518+0000 7fee1a7a6700 1 -- 172.21.15.146:0/1385411423 learned_addr learned my addr 172.21.15.146:0/1385411423 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:13.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.519+0000 7fee19fa5700 1 --2- 172.21.15.146:0/1385411423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee140ae730 0x7fee1415e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:13.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.519+0000 7fee197a4700 1 --2- 172.21.15.146:0/1385411423 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee140cb950 0x7fee1416e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:13.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.519+0000 7fee1a7a6700 1 -- 172.21.15.146:0/1385411423 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee140cb950 msgr2=0x7fee1416e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:13.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.519+0000 7fee1a7a6700 1 --2- 172.21.15.146:0/1385411423 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee140cb950 0x7fee1416e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.519+0000 7fee1a7a6700 1 -- 172.21.15.146:0/1385411423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee140ae730 msgr2=0x7fee1415e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:13.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.519+0000 7fee1a7a6700 1 --2- 172.21.15.146:0/1385411423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee140ae730 0x7fee1415e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.519+0000 7fee1a7a6700 1 -- 172.21.15.146:0/1385411423 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee040094f0 con 0x7fee1415a160 2023-10-06T11:13:13.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.519+0000 7fee1a7a6700 1 --2- 172.21.15.146:0/1385411423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee1415a160 0x7fee140ca210 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fee0c00a380 tx=0x7fee0c007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:13.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.519+0000 7fee09ffb700 1 -- 172.21.15.146:0/1385411423 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0c015440 con 0x7fee1415a160 2023-10-06T11:13:13.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.519+0000 7fee09ffb700 1 -- 172.21.15.146:0/1385411423 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee0c0155a0 con 0x7fee1415a160 2023-10-06T11:13:13.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.519+0000 7fee09ffb700 1 -- 172.21.15.146:0/1385411423 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0c015960 con 0x7fee1415a160 2023-10-06T11:13:13.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.519+0000 7fee1c209700 1 -- 172.21.15.146:0/1385411423 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee1415eb40 con 0x7fee1415a160 2023-10-06T11:13:13.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.519+0000 7fee1c209700 1 -- 172.21.15.146:0/1385411423 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee1415f100 con 0x7fee1415a160 2023-10-06T11:13:13.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.520+0000 7fee09ffb700 1 -- 172.21.15.146:0/1385411423 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fee0c00d440 con 0x7fee1415a160 2023-10-06T11:13:13.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.521+0000 7fee09ffb700 1 --2- 172.21.15.146:0/1385411423 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fedf8066f30 0x7fedf80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:13.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.521+0000 7fee09ffb700 1 -- 172.21.15.146:0/1385411423 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fee0c085190 con 0x7fee1415a160 2023-10-06T11:13:13.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.521+0000 7fee19fa5700 1 --2- 172.21.15.146:0/1385411423 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fedf8066f30 0x7fedf80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:13.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.521+0000 7fee19fa5700 1 --2- 172.21.15.146:0/1385411423 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fedf8066f30 0x7fedf80693e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fee10002970 tx=0x7fee10009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:13.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.523+0000 7fee25501b80 1 Processor -- start 2023-10-06T11:13:13.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.523+0000 7fee25501b80 1 -- start start 2023-10-06T11:13:13.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.524+0000 7fee25501b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56361dbd7ae0 0x56361dbd7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:13.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.524+0000 7fee25501b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56361db939f0 0x56361db905d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:13.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.524+0000 7fee25501b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56361db91c20 0x56361db90b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:13.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.524+0000 7fee25501b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x56361db10cd0 con 0x56361db91c20 2023-10-06T11:13:13.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.524+0000 7fee25501b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56361dae7ac0 con 0x56361db939f0 2023-10-06T11:13:13.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.524+0000 7fee25501b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x56361dae52c0 con 0x56361dbd7ae0 2023-10-06T11:13:13.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.524+0000 7fee1a7a6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56361db91c20 0x56361db90b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:13.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.524+0000 7fee1a7a6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56361db91c20 0x56361db90b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56788/0 (socket says 172.21.15.146:56788) 2023-10-06T11:13:13.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.524+0000 7fee1a7a6700 1 -- 172.21.15.146:0/496148303 learned_addr learned my addr 172.21.15.146:0/496148303 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:13.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.524+0000 7fee197a4700 1 --2- 172.21.15.146:0/496148303 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56361db939f0 0x56361db905d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:13.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.524+0000 7fee19fa5700 1 --2- 172.21.15.146:0/496148303 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56361dbd7ae0 0x56361dbd7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:13.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.524+0000 7fee1a7a6700 1 -- 172.21.15.146:0/496148303 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56361dbd7ae0 msgr2=0x56361dbd7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:13.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.524+0000 7fee1a7a6700 1 --2- 172.21.15.146:0/496148303 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56361dbd7ae0 0x56361dbd7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.524+0000 7fee1a7a6700 1 -- 172.21.15.146:0/496148303 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56361db939f0 msgr2=0x56361db905d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:13.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.524+0000 7fee1a7a6700 1 --2- 172.21.15.146:0/496148303 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56361db939f0 0x56361db905d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.524+0000 7fee1a7a6700 1 -- 172.21.15.146:0/496148303 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56361d97b2c0 con 0x56361db91c20 2023-10-06T11:13:13.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.524+0000 7fee197a4700 1 --2- 172.21.15.146:0/496148303 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56361db939f0 0x56361db905d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:13:13.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.524+0000 7fee1a7a6700 1 --2- 172.21.15.146:0/496148303 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56361db91c20 0x56361db90b10 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fee0c083580 tx=0x7fee0c0834b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed1dab25b92b6eb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:13.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.524+0000 7fedf6ffd700 1 -- 172.21.15.146:0/496148303 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0c055d30 con 0x56361db91c20 2023-10-06T11:13:13.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.524+0000 7fedf6ffd700 1 -- 172.21.15.146:0/496148303 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee0c055f60 con 0x56361db91c20 2023-10-06T11:13:13.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.525+0000 7fedf6ffd700 1 -- 172.21.15.146:0/496148303 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0c0591b0 con 0x56361db91c20 2023-10-06T11:13:13.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.525+0000 7fee25501b80 1 -- 172.21.15.146:0/496148303 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56361db91c20 msgr2=0x56361db90b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:13.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.525+0000 7fee25501b80 1 --2- 172.21.15.146:0/496148303 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56361db91c20 0x56361db90b10 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fee0c083580 tx=0x7fee0c0834b0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.525+0000 7fee25501b80 1 -- 172.21.15.146:0/496148303 shutdown_connections 2023-10-06T11:13:13.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.525+0000 7fee25501b80 1 --2- 172.21.15.146:0/496148303 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56361db91c20 0x56361db90b10 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.525+0000 7fee25501b80 1 --2- 172.21.15.146:0/496148303 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56361dbd7ae0 0x56361dbd7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.525+0000 7fee25501b80 1 --2- 172.21.15.146:0/496148303 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56361db939f0 0x56361db905d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.525+0000 7fee25501b80 1 -- 172.21.15.146:0/496148303 >> 172.21.15.146:0/496148303 conn(0x56361db920c0 msgr2=0x56361db92490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:13.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.525+0000 7fee25501b80 1 -- 172.21.15.146:0/496148303 shutdown_connections 2023-10-06T11:13:13.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.525+0000 7fee25501b80 1 -- 172.21.15.146:0/496148303 wait complete. 2023-10-06T11:13:13.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.526+0000 7fee25501b80 1 -- start start 2023-10-06T11:13:13.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.526+0000 7fee25501b80 1 Processor -- start 2023-10-06T11:13:13.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.527+0000 7fee25501b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56361db91c20 0x56361dbc0670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:13.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.527+0000 7fee25501b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56361db939f0 0x56361db908e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:13.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.527+0000 7fee25501b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56361dbd7ae0 0x56361db90e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:13.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.527+0000 7fee25501b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x56361dae10b0 con 0x56361db939f0 2023-10-06T11:13:13.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.527+0000 7fee25501b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56361da8c8e0 con 0x56361db91c20 2023-10-06T11:13:13.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.527+0000 7fee25501b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x56361daa7ef0 con 0x56361dbd7ae0 2023-10-06T11:13:13.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.527+0000 7fee25501b80 10 client.0 _ll_register_callbacks cb 0x56361d97df80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:13:13.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.527+0000 7fee197a4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56361db939f0 0x56361db908e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:13.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.527+0000 7fee197a4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56361db939f0 0x56361db908e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56798/0 (socket says 172.21.15.146:56798) 2023-10-06T11:13:13.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.527+0000 7fee197a4700 1 -- 172.21.15.146:0/3841377414 learned_addr learned my addr 172.21.15.146:0/3841377414 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:13.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.527+0000 7fee19fa5700 1 --2- 172.21.15.146:0/3841377414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56361db91c20 0x56361dbc0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:13.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.527+0000 7fee1a7a6700 1 --2- 172.21.15.146:0/3841377414 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56361dbd7ae0 0x56361db90e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:13.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.527+0000 7fee197a4700 1 -- 172.21.15.146:0/3841377414 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56361dbd7ae0 msgr2=0x56361db90e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:13.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.527+0000 7fee197a4700 1 --2- 172.21.15.146:0/3841377414 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56361dbd7ae0 0x56361db90e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.527+0000 7fee197a4700 1 -- 172.21.15.146:0/3841377414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56361db91c20 msgr2=0x56361dbc0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:13.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.527+0000 7fee197a4700 1 --2- 172.21.15.146:0/3841377414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56361db91c20 0x56361dbc0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.527+0000 7fee197a4700 1 -- 172.21.15.146:0/3841377414 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee140af0f0 con 0x56361db939f0 2023-10-06T11:13:13.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.527+0000 7fee197a4700 1 --2- 172.21.15.146:0/3841377414 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56361db939f0 0x56361db908e0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fee0400b3c0 tx=0x7fee04017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6557e448453a8502 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:13.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.527+0000 7fedeffff700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:13:13.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.528+0000 7fedeffff700 1 -- 172.21.15.146:0/3841377414 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee04021050 con 0x56361db939f0 2023-10-06T11:13:13.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.528+0000 7fedeffff700 1 -- 172.21.15.146:0/3841377414 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fee04011630 con 0x56361db939f0 2023-10-06T11:13:13.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.528+0000 7fee25501b80 1 -- 172.21.15.146:0/3841377414 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56361db856e0 con 0x56361db939f0 2023-10-06T11:13:13.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.528+0000 7fedeffff700 1 -- 172.21.15.146:0/3841377414 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee04011a00 con 0x56361db939f0 2023-10-06T11:13:13.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.528+0000 7fee25501b80 10 client.7446 fetch_fsmap learned FSMap version 85 2023-10-06T11:13:13.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.528+0000 7fee25501b80 1 -- 172.21.15.146:0/3841377414 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) v3 -- 0x7fee1415f100 con 0x56361db939f0 2023-10-06T11:13:13.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.528+0000 7fedeffff700 1 -- 172.21.15.146:0/3841377414 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56361db856e0 con 0x56361db939f0 2023-10-06T11:13:13.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.528+0000 7fedeffff700 1 -- 172.21.15.146:0/3841377414 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 85) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fee04011b60 con 0x56361db939f0 2023-10-06T11:13:13.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.528+0000 7fee25501b80 10 client.7446 fetch_fsmap finished waiting for FSMap version 85 2023-10-06T11:13:13.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.528+0000 7fee25501b80 10 client.7446 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.d 2023-10-06T11:13:13.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.528+0000 7fee25501b80 20 client.7446 populate_metadata read hostname 'smithi146' 2023-10-06T11:13:13.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.528+0000 7fee25501b80 1 --2- 172.21.15.146:0/3841377414 >> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] conn(0x56361dbea860 0x56361dbeac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:13.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.528+0000 7fee25501b80 4 client.7446 mds_command: new command op to 7227 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:13:13.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.528+0000 7fee25501b80 1 -- 172.21.15.146:0/3841377414 --> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56361db62610 con 0x56361dbea860 2023-10-06T11:13:13.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.528+0000 7fee19fa5700 1 --2- 172.21.15.146:0/3841377414 >> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] conn(0x56361dbea860 0x56361dbeac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:13.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.529+0000 7fedeffff700 10 client.7446 ms_handle_connect on v2:172.21.15.151:6833/3868165725 2023-10-06T11:13:13.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.529+0000 7fee19fa5700 1 --2- 172.21.15.146:0/3841377414 >> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] conn(0x56361dbea860 0x56361dbeac60 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b8c9b246a09ea8e server_cookie=332c78780c80f27a in_seq=0 out_seq=0 2023-10-06T11:13:13.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.529+0000 7fedeffff700 1 -- 172.21.15.146:0/3841377414 <== mds.0 v2:172.21.15.151:6833/3868165725 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x56361db62610 con 0x56361dbea860 2023-10-06T11:13:13.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.529+0000 7fedeffff700 10 client.7446 handle_command_reply: tid=0 2023-10-06T11:13:13.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.529+0000 7fee25501b80 1 client.7446 shutdown 2023-10-06T11:13:13.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.529+0000 7fee25501b80 1 -- 172.21.15.146:0/3841377414 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56361db939f0 msgr2=0x56361db908e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:13.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.529+0000 7fee25501b80 1 --2- 172.21.15.146:0/3841377414 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56361db939f0 0x56361db908e0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fee0400b3c0 tx=0x7fee04017000 comp rx=0 tx=0).stop 2023-10-06T11:13:13.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.529+0000 7fee25501b80 1 -- 172.21.15.146:0/3841377414 shutdown_connections 2023-10-06T11:13:13.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.529+0000 7fee25501b80 1 --2- 172.21.15.146:0/3841377414 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56361dbd7ae0 0x56361db90e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.529+0000 7fee25501b80 1 --2- 172.21.15.146:0/3841377414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56361db91c20 0x56361dbc0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.529+0000 7fee25501b80 1 --2- 172.21.15.146:0/3841377414 >> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] conn(0x56361dbea860 0x56361dbeac60 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.529+0000 7fee25501b80 1 --2- 172.21.15.146:0/3841377414 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56361db939f0 0x56361db908e0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.529+0000 7fedeffff700 0 client.7446 ms_handle_reset on v2:172.21.15.151:6833/3868165725 2023-10-06T11:13:13.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.529+0000 7fee25501b80 1 -- 172.21.15.146:0/3841377414 >> 172.21.15.146:0/3841377414 conn(0x56361db920c0 msgr2=0x56361db8cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:13.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.530+0000 7fee25501b80 1 -- 172.21.15.146:0/3841377414 shutdown_connections 2023-10-06T11:13:13.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.530+0000 7fee25501b80 1 -- 172.21.15.146:0/3841377414 wait complete. 2023-10-06T11:13:13.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.530+0000 7fee25501b80 20 client.7446 trim_cache size 0 max 16384 2023-10-06T11:13:13.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.546+0000 7fee25501b80 1 Processor -- start 2023-10-06T11:13:13.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.546+0000 7fee25501b80 1 -- start start 2023-10-06T11:13:13.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.546+0000 7fee25501b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56361db91c20 0x56361db8cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:13.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.546+0000 7fee25501b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56361db939f0 0x56361dbb8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:13.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.546+0000 7fee25501b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56361dbd7ae0 0x56361dbb87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:13.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.546+0000 7fee25501b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x56361d963e80 con 0x56361db939f0 2023-10-06T11:13:13.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.546+0000 7fee25501b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56361dbc0f00 con 0x56361dbd7ae0 2023-10-06T11:13:13.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.546+0000 7fee25501b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x56361db8e800 con 0x56361db91c20 2023-10-06T11:13:13.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.546+0000 7fee197a4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56361db939f0 0x56361dbb8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:13.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.546+0000 7fee197a4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56361db939f0 0x56361dbb8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56800/0 (socket says 172.21.15.146:56800) 2023-10-06T11:13:13.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.546+0000 7fee197a4700 1 -- 172.21.15.146:0/3292846124 learned_addr learned my addr 172.21.15.146:0/3292846124 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:13.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.547+0000 7fee197a4700 1 -- 172.21.15.146:0/3292846124 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56361db91c20 msgr2=0x56361db8cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:13.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.547+0000 7fee197a4700 1 --2- 172.21.15.146:0/3292846124 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56361db91c20 0x56361db8cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.547+0000 7fee197a4700 1 -- 172.21.15.146:0/3292846124 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56361dbd7ae0 msgr2=0x56361dbb87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:13.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.547+0000 7fee197a4700 1 --2- 172.21.15.146:0/3292846124 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56361dbd7ae0 0x56361dbb87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.547+0000 7fee197a4700 1 -- 172.21.15.146:0/3292846124 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56361d91e030 con 0x56361db939f0 2023-10-06T11:13:13.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.547+0000 7fee197a4700 1 --2- 172.21.15.146:0/3292846124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56361db939f0 0x56361dbb8260 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fee0400b990 tx=0x7fee0401e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daf466a3db2f087d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:13.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.547+0000 7fedf77fe700 1 -- 172.21.15.146:0/3292846124 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee04021070 con 0x56361db939f0 2023-10-06T11:13:13.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.547+0000 7fedf77fe700 1 -- 172.21.15.146:0/3292846124 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee04022040 con 0x56361db939f0 2023-10-06T11:13:13.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.547+0000 7fedf77fe700 1 -- 172.21.15.146:0/3292846124 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0400b650 con 0x56361db939f0 2023-10-06T11:13:13.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.547+0000 7fee25501b80 1 -- 172.21.15.146:0/3292846124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56361db939f0 msgr2=0x56361dbb8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:13.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.547+0000 7fee25501b80 1 --2- 172.21.15.146:0/3292846124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56361db939f0 0x56361dbb8260 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fee0400b990 tx=0x7fee0401e070 comp rx=0 tx=0).stop 2023-10-06T11:13:13.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.547+0000 7fee25501b80 1 -- 172.21.15.146:0/3292846124 shutdown_connections 2023-10-06T11:13:13.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.547+0000 7fee25501b80 1 --2- 172.21.15.146:0/3292846124 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56361dbd7ae0 0x56361dbb87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.547+0000 7fee25501b80 1 --2- 172.21.15.146:0/3292846124 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56361db91c20 0x56361db8cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.547+0000 7fee25501b80 1 --2- 172.21.15.146:0/3292846124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56361db939f0 0x56361dbb8260 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.547+0000 7fee25501b80 1 -- 172.21.15.146:0/3292846124 >> 172.21.15.146:0/3292846124 conn(0x56361db920c0 msgr2=0x56361dbd62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:13.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.548+0000 7fee25501b80 1 -- 172.21.15.146:0/3292846124 shutdown_connections 2023-10-06T11:13:13.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.548+0000 7fee25501b80 1 -- 172.21.15.146:0/3292846124 wait complete. 2023-10-06T11:13:13.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.548+0000 7fee25501b80 1 -- start start 2023-10-06T11:13:13.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.548+0000 7fee25501b80 1 Processor -- start 2023-10-06T11:13:13.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.549+0000 7fee25501b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56361db91c20 0x56361dc3c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:13.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.549+0000 7fee25501b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56361db939f0 0x56361dc3cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:13.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.549+0000 7fee25501b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56361dbd7ae0 0x56361dbd25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:13.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.549+0000 7fee25501b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x56361dbdd540 con 0x56361db91c20 2023-10-06T11:13:13.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.549+0000 7fee25501b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56361db8c440 con 0x56361dbd7ae0 2023-10-06T11:13:13.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.549+0000 7fee25501b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x56361db8bdf0 con 0x56361db939f0 2023-10-06T11:13:13.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.549+0000 7fee25501b80 10 client.0 _ll_register_callbacks cb 0x56361d97df80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:13:13.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.549+0000 7fee19fa5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56361db91c20 0x56361dc3c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:13.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.549+0000 7fee19fa5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56361db91c20 0x56361dc3c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56804/0 (socket says 172.21.15.146:56804) 2023-10-06T11:13:13.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.549+0000 7fee19fa5700 1 -- 172.21.15.146:0/422775897 learned_addr learned my addr 172.21.15.146:0/422775897 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:13.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.549+0000 7fee1a7a6700 1 --2- 172.21.15.146:0/422775897 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56361dbd7ae0 0x56361dbd25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:13.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.549+0000 7fee197a4700 1 --2- 172.21.15.146:0/422775897 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56361db939f0 0x56361dc3cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:13.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.549+0000 7fee19fa5700 1 -- 172.21.15.146:0/422775897 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56361db939f0 msgr2=0x56361dc3cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:13.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.549+0000 7fee19fa5700 1 --2- 172.21.15.146:0/422775897 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56361db939f0 0x56361dc3cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.549+0000 7fee19fa5700 1 -- 172.21.15.146:0/422775897 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56361dbd7ae0 msgr2=0x56361dbd25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:13.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.549+0000 7fee19fa5700 1 --2- 172.21.15.146:0/422775897 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56361dbd7ae0 0x56361dbd25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.549+0000 7fee19fa5700 1 -- 172.21.15.146:0/422775897 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee1415f100 con 0x56361db91c20 2023-10-06T11:13:13.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.550+0000 7fee19fa5700 1 --2- 172.21.15.146:0/422775897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56361db91c20 0x56361dc3c850 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fee10002790 tx=0x7fee10024040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeeaa81123d80886 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:13.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.550+0000 7fedeffff700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:13:13.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.550+0000 7fedeffff700 1 -- 172.21.15.146:0/422775897 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee10027040 con 0x56361db91c20 2023-10-06T11:13:13.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.550+0000 7fedeffff700 1 -- 172.21.15.146:0/422775897 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fee1001b040 con 0x56361db91c20 2023-10-06T11:13:13.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.550+0000 7fee25501b80 1 -- 172.21.15.146:0/422775897 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fee0c055f60 con 0x56361db91c20 2023-10-06T11:13:13.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.550+0000 7fedeffff700 1 -- 172.21.15.146:0/422775897 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee1000f650 con 0x56361db91c20 2023-10-06T11:13:13.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.550+0000 7fee25501b80 10 client.7452 fetch_fsmap learned FSMap version 85 2023-10-06T11:13:13.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.550+0000 7fee25501b80 1 -- 172.21.15.146:0/422775897 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) v3 -- 0x56361daaf7d0 con 0x56361db91c20 2023-10-06T11:13:13.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.550+0000 7fedeffff700 1 -- 172.21.15.146:0/422775897 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee0c055f60 con 0x56361db91c20 2023-10-06T11:13:13.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.550+0000 7fedeffff700 1 -- 172.21.15.146:0/422775897 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 85) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fee10015870 con 0x56361db91c20 2023-10-06T11:13:13.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.550+0000 7fee25501b80 10 client.7452 fetch_fsmap finished waiting for FSMap version 85 2023-10-06T11:13:13.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.550+0000 7fee25501b80 10 client.7452 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.d 2023-10-06T11:13:13.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.550+0000 7fee25501b80 20 client.7452 populate_metadata read hostname 'smithi146' 2023-10-06T11:13:13.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.550+0000 7fee25501b80 1 --2- 172.21.15.146:0/422775897 >> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] conn(0x56361dbd2ba0 0x56361dbdae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:13.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.550+0000 7fee25501b80 4 client.7452 mds_command: new command op to 7227 tid=0[{"prefix": "scrub status"}] 2023-10-06T11:13:13.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.550+0000 7fee25501b80 1 -- 172.21.15.146:0/422775897 --> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56361da83e50 con 0x56361dbd2ba0 2023-10-06T11:13:13.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.550+0000 7fee197a4700 1 --2- 172.21.15.146:0/422775897 >> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] conn(0x56361dbd2ba0 0x56361dbdae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:13.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.551+0000 7fedeffff700 10 client.7452 ms_handle_connect on v2:172.21.15.151:6833/3868165725 2023-10-06T11:13:13.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.551+0000 7fee197a4700 1 --2- 172.21.15.146:0/422775897 >> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] conn(0x56361dbd2ba0 0x56361dbdae70 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45eacbfddc42fe17 server_cookie=26cd3399b8b921f8 in_seq=0 out_seq=0 2023-10-06T11:13:13.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.551+0000 7fedeffff700 1 -- 172.21.15.146:0/422775897 <== mds.0 v2:172.21.15.151:6833/3868165725 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x56361da83e50 con 0x56361dbd2ba0 2023-10-06T11:13:13.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.551+0000 7fedeffff700 10 client.7452 handle_command_reply: tid=0 2023-10-06T11:13:13.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.551+0000 7fee25501b80 1 client.7452 shutdown 2023-10-06T11:13:13.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.551+0000 7fee25501b80 1 -- 172.21.15.146:0/422775897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56361db91c20 msgr2=0x56361dc3c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:13.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.551+0000 7fee25501b80 1 --2- 172.21.15.146:0/422775897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56361db91c20 0x56361dc3c850 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fee10002790 tx=0x7fee10024040 comp rx=0 tx=0).stop 2023-10-06T11:13:13.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.551+0000 7fee25501b80 1 -- 172.21.15.146:0/422775897 shutdown_connections 2023-10-06T11:13:13.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.551+0000 7fee25501b80 1 --2- 172.21.15.146:0/422775897 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56361dbd7ae0 0x56361dbd25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.551+0000 7fee25501b80 1 --2- 172.21.15.146:0/422775897 >> [v2:172.21.15.151:6833/3868165725,v1:172.21.15.151:6835/3868165725] conn(0x56361dbd2ba0 0x56361dbdae70 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.551+0000 7fee25501b80 1 --2- 172.21.15.146:0/422775897 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56361db91c20 0x56361dc3c850 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.551+0000 7fedeffff700 0 client.7452 ms_handle_reset on v2:172.21.15.151:6833/3868165725 2023-10-06T11:13:13.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.551+0000 7fee25501b80 1 --2- 172.21.15.146:0/422775897 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56361db939f0 0x56361dc3cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.551+0000 7fee25501b80 1 -- 172.21.15.146:0/422775897 >> 172.21.15.146:0/422775897 conn(0x56361db920c0 msgr2=0x56361dbd5350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:13.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.551+0000 7fee25501b80 1 -- 172.21.15.146:0/422775897 shutdown_connections 2023-10-06T11:13:13.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.551+0000 7fee25501b80 1 -- 172.21.15.146:0/422775897 wait complete. 2023-10-06T11:13:13.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.551+0000 7fee25501b80 20 client.7452 trim_cache size 0 max 16384 2023-10-06T11:13:13.560 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:13:13.560 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "no active scrubs running", 2023-10-06T11:13:13.560 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": {} 2023-10-06T11:13:13.560 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:13:13.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.551+0000 7fee1c209700 1 -- 172.21.15.146:0/1385411423 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fedf8066f30 msgr2=0x7fedf80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:13.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.552+0000 7fee1c209700 1 --2- 172.21.15.146:0/1385411423 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fedf8066f30 0x7fedf80693e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fee10002970 tx=0x7fee10009040 comp rx=0 tx=0).stop 2023-10-06T11:13:13.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.552+0000 7fee1c209700 1 -- 172.21.15.146:0/1385411423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee1415a160 msgr2=0x7fee140ca210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:13.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.552+0000 7fee1c209700 1 --2- 172.21.15.146:0/1385411423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee1415a160 0x7fee140ca210 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fee0c00a380 tx=0x7fee0c007900 comp rx=0 tx=0).stop 2023-10-06T11:13:13.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.552+0000 7fee1c209700 1 -- 172.21.15.146:0/1385411423 shutdown_connections 2023-10-06T11:13:13.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.552+0000 7fee1c209700 1 --2- 172.21.15.146:0/1385411423 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fedf8066f30 0x7fedf80693e0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.552+0000 7fee1c209700 1 --2- 172.21.15.146:0/1385411423 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fee1415a160 0x7fee140ca210 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.552+0000 7fee1c209700 1 --2- 172.21.15.146:0/1385411423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee140ae730 0x7fee1415e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.552+0000 7fee1c209700 1 --2- 172.21.15.146:0/1385411423 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee140cb950 0x7fee1416e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.552+0000 7fee1c209700 1 -- 172.21.15.146:0/1385411423 >> 172.21.15.146:0/1385411423 conn(0x7fee1406f380 msgr2=0x7fee14069c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:13.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.552+0000 7fee1c209700 1 -- 172.21.15.146:0/1385411423 shutdown_connections 2023-10-06T11:13:13.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.552+0000 7fee1c209700 1 -- 172.21.15.146:0/1385411423 wait complete. 2023-10-06T11:13:13.565 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-06T11:13:13.565 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:13:13.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.677+0000 7f0743fff700 1 Processor -- start 2023-10-06T11:13:13.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.677+0000 7f0743fff700 1 -- start start 2023-10-06T11:13:13.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.678+0000 7f0743fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f074415a420 0x7f074415cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:13.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.678+0000 7f0743fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f07440b2530 0x7f074415acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:13.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.678+0000 7f0743fff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f074415c630 con 0x7f074415a7f0 2023-10-06T11:13:13.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.678+0000 7f0743fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07440ce040 con 0x7f07440b2530 2023-10-06T11:13:13.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.678+0000 7f0743fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074415ba20 con 0x7f074415a420 2023-10-06T11:13:13.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.678+0000 7f07437fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f07440b2530 0x7f074415acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:13.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.678+0000 7f07437fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f07440b2530 0x7f074415acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56814/0 (socket says 172.21.15.146:56814) 2023-10-06T11:13:13.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.678+0000 7f07437fe700 1 -- 172.21.15.146:0/4204457520 learned_addr learned my addr 172.21.15.146:0/4204457520 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:13.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.678+0000 7f0742ffd700 1 --2- 172.21.15.146:0/4204457520 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f074415a420 0x7f074415cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:13.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.678+0000 7f07437fe700 1 -- 172.21.15.146:0/4204457520 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f074415a420 msgr2=0x7f074415cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:13.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.678+0000 7f07437fe700 1 --2- 172.21.15.146:0/4204457520 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f074415a420 0x7f074415cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.678+0000 7f07437fe700 1 -- 172.21.15.146:0/4204457520 >> v1:172.21.15.151:6789/0 conn(0x7f074415a7f0 legacy=0x7f07440b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:13.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.678+0000 7f07437fe700 1 -- 172.21.15.146:0/4204457520 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074415bd00 con 0x7f07440b2530 2023-10-06T11:13:13.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.679+0000 7f07437fe700 1 --2- 172.21.15.146:0/4204457520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07440b2530 0x7f074415acd0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f073c0099b0 tx=0x7f073c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c66591a4d2e6a30b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:13.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.679+0000 7f0741ffb700 1 -- 172.21.15.146:0/4204457520 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c009ea0 con 0x7f07440b2530 2023-10-06T11:13:13.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.679+0000 7f0741ffb700 1 -- 172.21.15.146:0/4204457520 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f073c00b860 con 0x7f07440b2530 2023-10-06T11:13:13.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.679+0000 7f0741ffb700 1 -- 172.21.15.146:0/4204457520 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073c00bc00 con 0x7f07440b2530 2023-10-06T11:13:13.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.679+0000 7f0743fff700 1 -- 172.21.15.146:0/4204457520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07440b2530 msgr2=0x7f074415acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:13.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.679+0000 7f0743fff700 1 --2- 172.21.15.146:0/4204457520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07440b2530 0x7f074415acd0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f073c0099b0 tx=0x7f073c009250 comp rx=0 tx=0).stop 2023-10-06T11:13:13.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.679+0000 7f0743fff700 1 -- 172.21.15.146:0/4204457520 shutdown_connections 2023-10-06T11:13:13.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.679+0000 7f0743fff700 1 --2- 172.21.15.146:0/4204457520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07440b2530 0x7f074415acd0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.679+0000 7f0743fff700 1 --2- 172.21.15.146:0/4204457520 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f074415a420 0x7f074415cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.679+0000 7f0743fff700 1 -- 172.21.15.146:0/4204457520 >> 172.21.15.146:0/4204457520 conn(0x7f074406eba0 msgr2=0x7f074406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:13.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.679+0000 7f0743fff700 1 -- 172.21.15.146:0/4204457520 shutdown_connections 2023-10-06T11:13:13.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.679+0000 7f0743fff700 1 -- 172.21.15.146:0/4204457520 wait complete. 2023-10-06T11:13:13.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.681+0000 7f0743fff700 1 Processor -- start 2023-10-06T11:13:13.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.681+0000 7f0743fff700 1 -- start start 2023-10-06T11:13:13.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.681+0000 7f0743fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07440b2530 0x7f0744146f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:13.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.681+0000 7f0743fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f074415a420 0x7f0744151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:13.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.681+0000 7f0743fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f074415a7f0 0x7f074414ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:13.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.681+0000 7f0743fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074414c590 con 0x7f07440b2530 2023-10-06T11:13:13.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.681+0000 7f0743fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074414bc60 con 0x7f074415a7f0 2023-10-06T11:13:13.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.681+0000 7f0743fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074414bf40 con 0x7f074415a420 2023-10-06T11:13:13.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.681+0000 7f0742ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07440b2530 0x7f0744146f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:13.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.681+0000 7f0742ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07440b2530 0x7f0744146f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56826/0 (socket says 172.21.15.146:56826) 2023-10-06T11:13:13.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.681+0000 7f0742ffd700 1 -- 172.21.15.146:0/2185815286 learned_addr learned my addr 172.21.15.146:0/2185815286 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:13.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.682+0000 7f07437fe700 1 --2- 172.21.15.146:0/2185815286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f074415a7f0 0x7f074414ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:13.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.682+0000 7f07427fc700 1 --2- 172.21.15.146:0/2185815286 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f074415a420 0x7f0744151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:13.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.682+0000 7f0742ffd700 1 -- 172.21.15.146:0/2185815286 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f074415a420 msgr2=0x7f0744151af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:13.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.682+0000 7f0742ffd700 1 --2- 172.21.15.146:0/2185815286 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f074415a420 0x7f0744151af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.682+0000 7f0742ffd700 1 -- 172.21.15.146:0/2185815286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f074415a7f0 msgr2=0x7f074414ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:13.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.682+0000 7f0742ffd700 1 --2- 172.21.15.146:0/2185815286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f074415a7f0 0x7f074414ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.682+0000 7f0742ffd700 1 -- 172.21.15.146:0/2185815286 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f073c0094f0 con 0x7f07440b2530 2023-10-06T11:13:13.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.682+0000 7f0742ffd700 1 --2- 172.21.15.146:0/2185815286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07440b2530 0x7f0744146f50 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f0734009ef0 tx=0x7f073400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:13.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.682+0000 7f073affd700 1 -- 172.21.15.146:0/2185815286 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073400cb70 con 0x7f07440b2530 2023-10-06T11:13:13.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.682+0000 7f073affd700 1 -- 172.21.15.146:0/2185815286 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f073400f040 con 0x7f07440b2530 2023-10-06T11:13:13.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.682+0000 7f0743fff700 1 -- 172.21.15.146:0/2185815286 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f074414c220 con 0x7f07440b2530 2023-10-06T11:13:13.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.682+0000 7f073affd700 1 -- 172.21.15.146:0/2185815286 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0734014480 con 0x7f07440b2530 2023-10-06T11:13:13.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.682+0000 7f0743fff700 1 -- 172.21.15.146:0/2185815286 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f074414b910 con 0x7f07440b2530 2023-10-06T11:13:13.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.683+0000 7f0743fff700 1 -- 172.21.15.146:0/2185815286 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07440afae0 con 0x7f07440b2530 2023-10-06T11:13:13.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.683+0000 7f073affd700 1 -- 172.21.15.146:0/2185815286 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f07340147f0 con 0x7f07440b2530 2023-10-06T11:13:13.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.684+0000 7f073affd700 1 --2- 172.21.15.146:0/2185815286 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0724066f30 0x7f07240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:13.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.684+0000 7f073affd700 1 -- 172.21.15.146:0/2185815286 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0734084ff0 con 0x7f07440b2530 2023-10-06T11:13:13.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.684+0000 7f07427fc700 1 --2- 172.21.15.146:0/2185815286 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0724066f30 0x7f07240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:13.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.684+0000 7f07427fc700 1 --2- 172.21.15.146:0/2185815286 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0724066f30 0x7f07240693e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f07440b6160 tx=0x7f072c007ec0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:13.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.688+0000 7f073affd700 1 -- 172.21.15.146:0/2185815286 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0734052100 con 0x7f07440b2530 2023-10-06T11:13:13.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.914+0000 7f0743fff700 1 -- 172.21.15.146:0/2185815286 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f074415bfe0 con 0x7f07440b2530 2023-10-06T11:13:13.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.914+0000 7f073affd700 1 -- 172.21.15.146:0/2185815286 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4608 (secure 0 0 0) 0x7f0734055720 con 0x7f07440b2530 2023-10-06T11:13:13.916 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:13:13.916 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":85,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6619,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/1915786440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1915786440},{"type":"v1","addr":"172.21.15.151:6834","nonce":1915786440}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7212,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2292999516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2292999516},{"type":"v1","addr":"172.21.15.146:6836","nonce":2292999516}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7215,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/905558084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":905558084},{"type":"v1","addr":"172.21.15.146:6837","nonce":905558084}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:12:45.107155+0000","modified":"2023-10-06T11:12:48.746860+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7227},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7227":{"gid":7227,"name":"d","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6835/3868165725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":3868165725},{"type":"v1","addr":"172.21.15.151:6835","nonce":3868165725}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T11:13:13.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.916+0000 7f0743fff700 1 -- 172.21.15.146:0/2185815286 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0724066f30 msgr2=0x7f07240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:13.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.916+0000 7f0743fff700 1 --2- 172.21.15.146:0/2185815286 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0724066f30 0x7f07240693e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f07440b6160 tx=0x7f072c007ec0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.916+0000 7f0743fff700 1 -- 172.21.15.146:0/2185815286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07440b2530 msgr2=0x7f0744146f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:13.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.916+0000 7f0743fff700 1 --2- 172.21.15.146:0/2185815286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07440b2530 0x7f0744146f50 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f0734009ef0 tx=0x7f073400b040 comp rx=0 tx=0).stop 2023-10-06T11:13:13.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.916+0000 7f0743fff700 1 -- 172.21.15.146:0/2185815286 shutdown_connections 2023-10-06T11:13:13.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.916+0000 7f0743fff700 1 --2- 172.21.15.146:0/2185815286 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0724066f30 0x7f07240693e0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.916+0000 7f0743fff700 1 --2- 172.21.15.146:0/2185815286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f074415a7f0 0x7f074414ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.916+0000 7f0743fff700 1 --2- 172.21.15.146:0/2185815286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f07440b2530 0x7f0744146f50 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.916+0000 7f0743fff700 1 --2- 172.21.15.146:0/2185815286 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f074415a420 0x7f0744151af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:13.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.916+0000 7f0743fff700 1 -- 172.21.15.146:0/2185815286 >> 172.21.15.146:0/2185815286 conn(0x7f074406eba0 msgr2=0x7f07440d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:13.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.916+0000 7f0743fff700 1 -- 172.21.15.146:0/2185815286 shutdown_connections 2023-10-06T11:13:13.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:13.916+0000 7f0743fff700 1 -- 172.21.15.146:0/2185815286 wait complete. 2023-10-06T11:13:13.920 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 85 2023-10-06T11:13:13.930 DEBUG:tasks.cephfs.test_scrub_checks:current active=['d'] 2023-10-06T11:13:13.930 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T11:13:14.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.041+0000 7fdcc3b12700 1 Processor -- start 2023-10-06T11:13:14.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.041+0000 7fdcc3b12700 1 -- start start 2023-10-06T11:13:14.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.042+0000 7fdcc3b12700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdcbc153ab0 0x7fdcbc15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:14.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.042+0000 7fdcc3b12700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fdcbc153e80 0x7fdcbc068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:14.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.042+0000 7fdcc3b12700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcbc15ac30 con 0x7fdcbc0689d0 2023-10-06T11:13:14.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.042+0000 7fdcc3b12700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcbc0b4510 con 0x7fdcbc153ab0 2023-10-06T11:13:14.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.042+0000 7fdcc3b12700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcbc0b6530 con 0x7fdcbc153e80 2023-10-06T11:13:14.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.042+0000 7fdcc18ae700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdcbc153ab0 0x7fdcbc15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:14.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.042+0000 7fdcc20af700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fdcbc0689d0 0x7fdcbc15d270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:54662/0 (socket says 172.21.15.146:54662) 2023-10-06T11:13:14.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.042+0000 7fdcc20af700 1 -- 172.21.15.146:0/4003251040 learned_addr learned my addr 172.21.15.146:0/4003251040 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:13:14.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.042+0000 7fdcc10ad700 1 --2- 172.21.15.146:0/4003251040 >> v2:172.21.15.151:3300/0 conn(0x7fdcbc153e80 0x7fdcbc068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:14.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.042+0000 7fdcc18ae700 1 -- 172.21.15.146:0/4003251040 >> v2:172.21.15.151:3300/0 conn(0x7fdcbc153e80 msgr2=0x7fdcbc068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:14.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.042+0000 7fdcc18ae700 1 --2- 172.21.15.146:0/4003251040 >> v2:172.21.15.151:3300/0 conn(0x7fdcbc153e80 0x7fdcbc068490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:14.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.042+0000 7fdcc18ae700 1 -- 172.21.15.146:0/4003251040 >> v1:172.21.15.146:6789/0 conn(0x7fdcbc0689d0 legacy=0x7fdcbc15d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:14.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.042+0000 7fdcc08ac700 1 -- 172.21.15.146:0/4003251040 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4195316664 0 0) 0x7fdcac001110 con 0x7fdcbc0689d0 2023-10-06T11:13:14.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.042+0000 7fdcc18ae700 1 -- 172.21.15.146:0/4003251040 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcbc068dd0 con 0x7fdcbc153ab0 2023-10-06T11:13:14.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.042+0000 7fdcc18ae700 1 --2- 172.21.15.146:0/4003251040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcbc153ab0 0x7fdcbc15a6f0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc089770 tx=0x7fdcb4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e602ffd305caaa10 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:14.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.042+0000 7fdcc08ac700 1 -- 172.21.15.146:0/4003251040 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb400e070 con 0x7fdcbc153ab0 2023-10-06T11:13:14.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.042+0000 7fdcc08ac700 1 -- 172.21.15.146:0/4003251040 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb400bb60 con 0x7fdcbc153ab0 2023-10-06T11:13:14.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.042+0000 7fdcc08ac700 1 -- 172.21.15.146:0/4003251040 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb4012430 con 0x7fdcbc153ab0 2023-10-06T11:13:14.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.043+0000 7fdcc3b12700 1 -- 172.21.15.146:0/4003251040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcbc153ab0 msgr2=0x7fdcbc15a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:14.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.043+0000 7fdcc3b12700 1 --2- 172.21.15.146:0/4003251040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcbc153ab0 0x7fdcbc15a6f0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc089770 tx=0x7fdcb4009780 comp rx=0 tx=0).stop 2023-10-06T11:13:14.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.043+0000 7fdcc3b12700 1 -- 172.21.15.146:0/4003251040 shutdown_connections 2023-10-06T11:13:14.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.043+0000 7fdcc3b12700 1 --2- 172.21.15.146:0/4003251040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcbc153ab0 0x7fdcbc15a6f0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:14.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.043+0000 7fdcc3b12700 1 --2- 172.21.15.146:0/4003251040 >> v2:172.21.15.151:3300/0 conn(0x7fdcbc153e80 0x7fdcbc068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:14.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.043+0000 7fdcc3b12700 1 -- 172.21.15.146:0/4003251040 >> 172.21.15.146:0/4003251040 conn(0x7fdcbc06eba0 msgr2=0x7fdcbc06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:14.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.043+0000 7fdcc3b12700 1 -- 172.21.15.146:0/4003251040 shutdown_connections 2023-10-06T11:13:14.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.043+0000 7fdcc3b12700 1 -- 172.21.15.146:0/4003251040 wait complete. 2023-10-06T11:13:14.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.044+0000 7fdcc3b12700 1 Processor -- start 2023-10-06T11:13:14.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.044+0000 7fdcc3b12700 1 -- start start 2023-10-06T11:13:14.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.045+0000 7fdcc3b12700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdcbc0689d0 0x7fdcbc16e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:14.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.045+0000 7fdcc3b12700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcbc153ab0 0x7fdcbc158f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:14.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.045+0000 7fdcc3b12700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdcbc153e80 0x7fdcbc150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:14.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.045+0000 7fdcc3b12700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcbc1546a0 con 0x7fdcbc153ab0 2023-10-06T11:13:14.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.045+0000 7fdcc3b12700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcbc16e790 con 0x7fdcbc153e80 2023-10-06T11:13:14.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.045+0000 7fdcc3b12700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcbc156400 con 0x7fdcbc0689d0 2023-10-06T11:13:14.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.045+0000 7fdcc10ad700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcbc153ab0 0x7fdcbc158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:14.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.045+0000 7fdcc10ad700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcbc153ab0 0x7fdcbc158f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56840/0 (socket says 172.21.15.146:56840) 2023-10-06T11:13:14.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.045+0000 7fdcc10ad700 1 -- 172.21.15.146:0/1754744746 learned_addr learned my addr 172.21.15.146:0/1754744746 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:14.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.045+0000 7fdcc18ae700 1 --2- 172.21.15.146:0/1754744746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdcbc0689d0 0x7fdcbc16e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:14.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.045+0000 7fdcc20af700 1 --2- 172.21.15.146:0/1754744746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdcbc153e80 0x7fdcbc150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:14.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.045+0000 7fdcc10ad700 1 -- 172.21.15.146:0/1754744746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdcbc0689d0 msgr2=0x7fdcbc16e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:14.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.045+0000 7fdcc10ad700 1 --2- 172.21.15.146:0/1754744746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdcbc0689d0 0x7fdcbc16e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:14.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.045+0000 7fdcc10ad700 1 -- 172.21.15.146:0/1754744746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdcbc153e80 msgr2=0x7fdcbc150a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:14.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.045+0000 7fdcc10ad700 1 --2- 172.21.15.146:0/1754744746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdcbc153e80 0x7fdcbc150a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:14.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.045+0000 7fdcc10ad700 1 -- 172.21.15.146:0/1754744746 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb4009a20 con 0x7fdcbc153ab0 2023-10-06T11:13:14.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.045+0000 7fdcc10ad700 1 --2- 172.21.15.146:0/1754744746 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcbc153ab0 0x7fdcbc158f70 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fdcb000ec80 tx=0x7fdcb00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:14.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.045+0000 7fdcb9ffb700 1 -- 172.21.15.146:0/1754744746 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb000c7f0 con 0x7fdcbc153ab0 2023-10-06T11:13:14.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.045+0000 7fdcb9ffb700 1 -- 172.21.15.146:0/1754744746 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb000c950 con 0x7fdcbc153ab0 2023-10-06T11:13:14.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.045+0000 7fdcc3b12700 1 -- 172.21.15.146:0/1754744746 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcbc155000 con 0x7fdcbc153ab0 2023-10-06T11:13:14.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.045+0000 7fdcb9ffb700 1 -- 172.21.15.146:0/1754744746 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb000ccf0 con 0x7fdcbc153ab0 2023-10-06T11:13:14.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.046+0000 7fdcc3b12700 1 -- 172.21.15.146:0/1754744746 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcbc155390 con 0x7fdcbc153ab0 2023-10-06T11:13:14.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.047+0000 7fdcc3b12700 1 -- 172.21.15.146:0/1754744746 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcbc1565b0 con 0x7fdcbc153ab0 2023-10-06T11:13:14.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.047+0000 7fdcb9ffb700 1 -- 172.21.15.146:0/1754744746 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdcb0013680 con 0x7fdcbc153ab0 2023-10-06T11:13:14.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.047+0000 7fdcb9ffb700 1 --2- 172.21.15.146:0/1754744746 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdca8066f30 0x7fdca80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:14.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.047+0000 7fdcb9ffb700 1 -- 172.21.15.146:0/1754744746 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdcb0084820 con 0x7fdcbc153ab0 2023-10-06T11:13:14.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.047+0000 7fdcc18ae700 1 --2- 172.21.15.146:0/1754744746 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdca8066f30 0x7fdca80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:14.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.048+0000 7fdcc18ae700 1 --2- 172.21.15.146:0/1754744746 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdca8066f30 0x7fdca80693e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fdcb40099f0 tx=0x7fdcb4019000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:14.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.052+0000 7fdcb9ffb700 1 -- 172.21.15.146:0/1754744746 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdcbc1565b0 con 0x7fdcbc153ab0 2023-10-06T11:13:14.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.312+0000 7fdcc3b12700 1 -- 172.21.15.146:0/1754744746 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fdcbc1559c0 con 0x7fdcbc153ab0 2023-10-06T11:13:14.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.312+0000 7fdcb9ffb700 1 -- 172.21.15.146:0/1754744746 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1030 (secure 0 0 0) 0x7fdcb0051930 con 0x7fdcbc153ab0 2023-10-06T11:13:14.314 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:13:14.315 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":468,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":89,"num_osds":8,"num_up_osds":8,"osd_up_since":1696590336,"num_in_osds":8,"osd_in_since":1696590327,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":1071,"data_bytes":1077952251,"bytes_used":4671389696,"bytes_avail":768422723584,"bytes_total":773094113280,"write_bytes_sec":68553989,"read_op_per_sec":0,"write_op_per_sec":189},"fsmap":{"epoch":85,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"d","status":"up:active","gid":7227}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":17,"modified":"2023-10-06T11:11:43.216871+0000","services":{}},"progress_events":{}} 2023-10-06T11:13:14.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.315+0000 7fdcc3b12700 1 -- 172.21.15.146:0/1754744746 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdca8066f30 msgr2=0x7fdca80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:14.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.315+0000 7fdcc3b12700 1 --2- 172.21.15.146:0/1754744746 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdca8066f30 0x7fdca80693e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fdcb40099f0 tx=0x7fdcb4019000 comp rx=0 tx=0).stop 2023-10-06T11:13:14.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.315+0000 7fdcc3b12700 1 -- 172.21.15.146:0/1754744746 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcbc153ab0 msgr2=0x7fdcbc158f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:14.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.315+0000 7fdcc3b12700 1 --2- 172.21.15.146:0/1754744746 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcbc153ab0 0x7fdcbc158f70 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fdcb000ec80 tx=0x7fdcb00091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:14.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.315+0000 7fdcc3b12700 1 -- 172.21.15.146:0/1754744746 shutdown_connections 2023-10-06T11:13:14.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.315+0000 7fdcc3b12700 1 --2- 172.21.15.146:0/1754744746 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdca8066f30 0x7fdca80693e0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:14.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.315+0000 7fdcc3b12700 1 --2- 172.21.15.146:0/1754744746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdcbc153e80 0x7fdcbc150a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:14.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.315+0000 7fdcc3b12700 1 --2- 172.21.15.146:0/1754744746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdcbc0689d0 0x7fdcbc16e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:14.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.315+0000 7fdcc3b12700 1 --2- 172.21.15.146:0/1754744746 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdcbc153ab0 0x7fdcbc158f70 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:14.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.315+0000 7fdcc3b12700 1 -- 172.21.15.146:0/1754744746 >> 172.21.15.146:0/1754744746 conn(0x7fdcbc06eba0 msgr2=0x7fdcbc15add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:14.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.315+0000 7fdcc3b12700 1 -- 172.21.15.146:0/1754744746 shutdown_connections 2023-10-06T11:13:14.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.315+0000 7fdcc3b12700 1 -- 172.21.15.146:0/1754744746 wait complete. 2023-10-06T11:13:14.328 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T11:13:14.328 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:13:14.364 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:13:14.403 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T11:13:14.403 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi146.front.sepia.ceph.com... 2023-10-06T11:13:14.403 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T11:13:14.403 DEBUG:teuthology.orchestra.run.smithi146:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T11:13:14.441 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[130258]: fuse finished with error 0 and tester_r 0 2023-10-06T11:13:14.507 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-10-06T11:13:14.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:14.507 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T11:13:14.680 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-10-06T11:13:14.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:14.681 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T11:13:14.695 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:13:14.696 INFO:teuthology.orchestra.run.smithi151.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-06T11:13:14.696 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-10-06T11:13:14.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:14.696 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T11:13:14.735 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:13:14.736 INFO:teuthology.orchestra.run.smithi146.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-06T11:13:14.736 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-10-06T11:13:14.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:14.737 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T11:13:14.752 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:13:14.753 INFO:teuthology.orchestra.run.smithi151.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-06T11:13:14.753 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:13:14.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.890+0000 7fd91a408700 1 Processor -- start 2023-10-06T11:13:14.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.890+0000 7fd91a408700 1 -- start start 2023-10-06T11:13:14.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.891+0000 7fd91a408700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd91415a420 0x7fd91415cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:14.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.891+0000 7fd91a408700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd91415a7f0 0x7fd9140b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:14.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.891+0000 7fd91a408700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd9140b2360 0x7fd91415acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:14.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.891+0000 7fd91a408700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9140ce040 con 0x7fd9140b2360 2023-10-06T11:13:14.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.891+0000 7fd91a408700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9140b27e0 con 0x7fd91415a7f0 2023-10-06T11:13:14.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.891+0000 7fd91a408700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd91415c630 con 0x7fd91415a420 2023-10-06T11:13:14.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.891+0000 7fd919c07700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd9140b2360 0x7fd91415acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:14.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.891+0000 7fd919c07700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd9140b2360 0x7fd91415acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56848/0 (socket says 172.21.15.146:56848) 2023-10-06T11:13:14.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.891+0000 7fd919c07700 1 -- 172.21.15.146:0/3549171059 learned_addr learned my addr 172.21.15.146:0/3549171059 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:14.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.891+0000 7fd918c05700 1 --2- 172.21.15.146:0/3549171059 >> v2:172.21.15.151:3300/0 conn(0x7fd91415a7f0 0x7fd9140b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:14.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.891+0000 7fd919406700 1 --2- 172.21.15.146:0/3549171059 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd91415a420 0x7fd91415cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:14.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.891+0000 7fd919c07700 1 -- 172.21.15.146:0/3549171059 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd91415a420 msgr2=0x7fd91415cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:14.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.891+0000 7fd919c07700 1 --2- 172.21.15.146:0/3549171059 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd91415a420 0x7fd91415cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:14.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.891+0000 7fd919c07700 1 -- 172.21.15.146:0/3549171059 >> v2:172.21.15.151:3300/0 conn(0x7fd91415a7f0 msgr2=0x7fd9140b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:14.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.891+0000 7fd919c07700 1 --2- 172.21.15.146:0/3549171059 >> v2:172.21.15.151:3300/0 conn(0x7fd91415a7f0 0x7fd9140b1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:14.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.891+0000 7fd919c07700 1 -- 172.21.15.146:0/3549171059 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd91415ba20 con 0x7fd9140b2360 2023-10-06T11:13:14.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.891+0000 7fd919c07700 1 --2- 172.21.15.146:0/3549171059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9140b2360 0x7fd91415acd0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fd9140d14f0 tx=0x7fd90c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f7d1024f96bf86c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:14.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.892+0000 7fd90bfff700 1 -- 172.21.15.146:0/3549171059 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c00b820 con 0x7fd9140b2360 2023-10-06T11:13:14.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.892+0000 7fd90bfff700 1 -- 172.21.15.146:0/3549171059 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90c00b980 con 0x7fd9140b2360 2023-10-06T11:13:14.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.892+0000 7fd90bfff700 1 -- 172.21.15.146:0/3549171059 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c00bd20 con 0x7fd9140b2360 2023-10-06T11:13:14.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.892+0000 7fd91a408700 1 -- 172.21.15.146:0/3549171059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9140b2360 msgr2=0x7fd91415acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:14.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.892+0000 7fd91a408700 1 --2- 172.21.15.146:0/3549171059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9140b2360 0x7fd91415acd0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fd9140d14f0 tx=0x7fd90c009250 comp rx=0 tx=0).stop 2023-10-06T11:13:14.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.892+0000 7fd91a408700 1 -- 172.21.15.146:0/3549171059 shutdown_connections 2023-10-06T11:13:14.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.892+0000 7fd91a408700 1 --2- 172.21.15.146:0/3549171059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9140b2360 0x7fd91415acd0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:14.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.892+0000 7fd91a408700 1 --2- 172.21.15.146:0/3549171059 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd91415a420 0x7fd91415cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:14.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.892+0000 7fd91a408700 1 --2- 172.21.15.146:0/3549171059 >> v2:172.21.15.151:3300/0 conn(0x7fd91415a7f0 0x7fd9140b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:14.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.892+0000 7fd91a408700 1 -- 172.21.15.146:0/3549171059 >> 172.21.15.146:0/3549171059 conn(0x7fd91406eba0 msgr2=0x7fd91406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:14.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.892+0000 7fd91a408700 1 -- 172.21.15.146:0/3549171059 shutdown_connections 2023-10-06T11:13:14.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.892+0000 7fd91a408700 1 -- 172.21.15.146:0/3549171059 wait complete. 2023-10-06T11:13:14.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.893+0000 7fd91a408700 1 Processor -- start 2023-10-06T11:13:14.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.893+0000 7fd91a408700 1 -- start start 2023-10-06T11:13:14.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.894+0000 7fd91a408700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9140b2360 0x7fd91413d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:14.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.894+0000 7fd91a408700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd91415a420 0x7fd91415ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:14.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.894+0000 7fd91a408700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd91415a7f0 0x7fd9141695d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:14.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.894+0000 7fd91a408700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91415f0f0 con 0x7fd91415a7f0 2023-10-06T11:13:14.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.894+0000 7fd91a408700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91416ca00 con 0x7fd9140b2360 2023-10-06T11:13:14.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.894+0000 7fd91a408700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd91415f2e0 con 0x7fd91415a420 2023-10-06T11:13:14.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.894+0000 7fd919c07700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd91415a7f0 0x7fd9141695d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:14.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.894+0000 7fd919c07700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd91415a7f0 0x7fd9141695d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56856/0 (socket says 172.21.15.146:56856) 2023-10-06T11:13:14.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.894+0000 7fd919c07700 1 -- 172.21.15.146:0/535418667 learned_addr learned my addr 172.21.15.146:0/535418667 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:14.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.894+0000 7fd919406700 1 --2- 172.21.15.146:0/535418667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9140b2360 0x7fd91413d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:14.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.895+0000 7fd918c05700 1 --2- 172.21.15.146:0/535418667 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd91415a420 0x7fd91415ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:14.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.895+0000 7fd919c07700 1 -- 172.21.15.146:0/535418667 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd91415a420 msgr2=0x7fd91415ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:14.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.895+0000 7fd919c07700 1 --2- 172.21.15.146:0/535418667 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd91415a420 0x7fd91415ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:14.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.895+0000 7fd919c07700 1 -- 172.21.15.146:0/535418667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9140b2360 msgr2=0x7fd91413d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:14.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.895+0000 7fd919c07700 1 --2- 172.21.15.146:0/535418667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9140b2360 0x7fd91413d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:14.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.895+0000 7fd919c07700 1 -- 172.21.15.146:0/535418667 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd90c0094f0 con 0x7fd91415a7f0 2023-10-06T11:13:14.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.895+0000 7fd919c07700 1 --2- 172.21.15.146:0/535418667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd91415a7f0 0x7fd9141695d0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fd90c009290 tx=0x7fd90c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:14.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.895+0000 7fd9097fa700 1 -- 172.21.15.146:0/535418667 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c00b820 con 0x7fd91415a7f0 2023-10-06T11:13:14.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.895+0000 7fd9097fa700 1 -- 172.21.15.146:0/535418667 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90c01a630 con 0x7fd91415a7f0 2023-10-06T11:13:14.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.895+0000 7fd91a408700 1 -- 172.21.15.146:0/535418667 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd91415f5c0 con 0x7fd91415a7f0 2023-10-06T11:13:14.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.895+0000 7fd9097fa700 1 -- 172.21.15.146:0/535418667 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c011ea0 con 0x7fd91415a7f0 2023-10-06T11:13:14.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.895+0000 7fd91a408700 1 -- 172.21.15.146:0/535418667 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd91415fb80 con 0x7fd91415a7f0 2023-10-06T11:13:14.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.896+0000 7fd91a408700 1 -- 172.21.15.146:0/535418667 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9140afae0 con 0x7fd91415a7f0 2023-10-06T11:13:14.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.896+0000 7fd9097fa700 1 -- 172.21.15.146:0/535418667 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd90c01aca0 con 0x7fd91415a7f0 2023-10-06T11:13:14.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.897+0000 7fd9097fa700 1 --2- 172.21.15.146:0/535418667 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd8f8066f30 0x7fd8f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:14.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.897+0000 7fd9097fa700 1 -- 172.21.15.146:0/535418667 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd90c086160 con 0x7fd91415a7f0 2023-10-06T11:13:14.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.897+0000 7fd919406700 1 --2- 172.21.15.146:0/535418667 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd8f8066f30 0x7fd8f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:14.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.897+0000 7fd919406700 1 --2- 172.21.15.146:0/535418667 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd8f8066f30 0x7fd8f80693e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd9140b5670 tx=0x7fd910009850 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:14.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:14.901+0000 7fd9097fa700 1 -- 172.21.15.146:0/535418667 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd90c053270 con 0x7fd91415a7f0 2023-10-06T11:13:15.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.129+0000 7fd91a408700 1 -- 172.21.15.146:0/535418667 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd91415bd00 con 0x7fd91415a7f0 2023-10-06T11:13:15.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.129+0000 7fd9097fa700 1 -- 172.21.15.146:0/535418667 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4608 (secure 0 0 0) 0x7fd90c056890 con 0x7fd91415a7f0 2023-10-06T11:13:15.131 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:13:15.132 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":85,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6619,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/1915786440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1915786440},{"type":"v1","addr":"172.21.15.151:6834","nonce":1915786440}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7212,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2292999516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2292999516},{"type":"v1","addr":"172.21.15.146:6836","nonce":2292999516}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7215,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/905558084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":905558084},{"type":"v1","addr":"172.21.15.146:6837","nonce":905558084}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:12:45.107155+0000","modified":"2023-10-06T11:12:48.746860+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7227},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7227":{"gid":7227,"name":"d","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6835/3868165725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":3868165725},{"type":"v1","addr":"172.21.15.151:6835","nonce":3868165725}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T11:13:15.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.131+0000 7fd91a408700 1 -- 172.21.15.146:0/535418667 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd8f8066f30 msgr2=0x7fd8f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:15.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.131+0000 7fd91a408700 1 --2- 172.21.15.146:0/535418667 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd8f8066f30 0x7fd8f80693e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd9140b5670 tx=0x7fd910009850 comp rx=0 tx=0).stop 2023-10-06T11:13:15.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.131+0000 7fd91a408700 1 -- 172.21.15.146:0/535418667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd91415a7f0 msgr2=0x7fd9141695d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:15.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.131+0000 7fd91a408700 1 --2- 172.21.15.146:0/535418667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd91415a7f0 0x7fd9141695d0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fd90c009290 tx=0x7fd90c017000 comp rx=0 tx=0).stop 2023-10-06T11:13:15.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.131+0000 7fd91a408700 1 -- 172.21.15.146:0/535418667 shutdown_connections 2023-10-06T11:13:15.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.131+0000 7fd91a408700 1 --2- 172.21.15.146:0/535418667 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd8f8066f30 0x7fd8f80693e0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:15.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.131+0000 7fd91a408700 1 --2- 172.21.15.146:0/535418667 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd91415a7f0 0x7fd9141695d0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:15.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.131+0000 7fd91a408700 1 --2- 172.21.15.146:0/535418667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9140b2360 0x7fd91413d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:15.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.131+0000 7fd91a408700 1 --2- 172.21.15.146:0/535418667 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd91415a420 0x7fd91415ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:15.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.131+0000 7fd91a408700 1 -- 172.21.15.146:0/535418667 >> 172.21.15.146:0/535418667 conn(0x7fd91406eba0 msgr2=0x7fd9140afcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:15.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.132+0000 7fd91a408700 1 -- 172.21.15.146:0/535418667 shutdown_connections 2023-10-06T11:13:15.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.132+0000 7fd91a408700 1 -- 172.21.15.146:0/535418667 wait complete. 2023-10-06T11:13:15.135 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 85 2023-10-06T11:13:15.146 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:13:15.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.259+0000 7f5883c05700 1 Processor -- start 2023-10-06T11:13:15.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.259+0000 7f5883c05700 1 -- start start 2023-10-06T11:13:15.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.260+0000 7f5883c05700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f587c153ab0 0x7f587c15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:15.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.260+0000 7f5883c05700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f587c068ba0 0x7f587c0b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:15.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.260+0000 7f5883c05700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f587c15ac30 con 0x7f587c153e80 2023-10-06T11:13:15.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.260+0000 7f5883c05700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f587c0b4510 con 0x7f587c153ab0 2023-10-06T11:13:15.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.260+0000 7f5883c05700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587c0b6530 con 0x7f587c068ba0 2023-10-06T11:13:15.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.260+0000 7f58811a0700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f587c153e80 0x7f587c068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:54674/0 (socket says 172.21.15.146:54674) 2023-10-06T11:13:15.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.260+0000 7f58811a0700 1 -- 172.21.15.146:0/917724793 learned_addr learned my addr 172.21.15.146:0/917724793 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:13:15.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.260+0000 7f58819a1700 1 --2- 172.21.15.146:0/917724793 >> v2:172.21.15.151:3300/0 conn(0x7f587c153ab0 0x7f587c15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:15.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.260+0000 7f58821a2700 1 --2- 172.21.15.146:0/917724793 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f587c068ba0 0x7f587c0b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:15.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.260+0000 7f588099f700 1 -- 172.21.15.146:0/917724793 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1786159679 0 0) 0x7f586c001110 con 0x7f587c153e80 2023-10-06T11:13:15.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.261+0000 7f588099f700 1 -- 172.21.15.146:0/917724793 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5868003570 con 0x7f587c153e80 2023-10-06T11:13:15.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.261+0000 7f588099f700 1 -- 172.21.15.146:0/917724793 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2648789565 0 0) 0x7f5868003570 con 0x7f587c153e80 2023-10-06T11:13:15.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.261+0000 7f588099f700 1 -- 172.21.15.146:0/917724793 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f587c068ba0 msgr2=0x7f587c0b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:15.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.261+0000 7f588099f700 1 --2- 172.21.15.146:0/917724793 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f587c068ba0 0x7f587c0b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:15.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.261+0000 7f588099f700 1 -- 172.21.15.146:0/917724793 >> v2:172.21.15.151:3300/0 conn(0x7f587c153ab0 msgr2=0x7f587c15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:15.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.261+0000 7f588099f700 1 --2- 172.21.15.146:0/917724793 >> v2:172.21.15.151:3300/0 conn(0x7f587c153ab0 0x7f587c15a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:15.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.261+0000 7f588099f700 1 -- 172.21.15.146:0/917724793 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f587c0b5c50 con 0x7f587c153e80 2023-10-06T11:13:15.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.261+0000 7f588099f700 1 -- 172.21.15.146:0/917724793 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f586c001600 con 0x7f587c153e80 2023-10-06T11:13:15.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.261+0000 7f588099f700 1 -- 172.21.15.146:0/917724793 >> v1:172.21.15.146:6789/0 conn(0x7f587c153e80 legacy=0x7f587c068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:15.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.261+0000 7f588099f700 1 --2- 172.21.15.146:0/917724793 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f587c068ba0 0x7f5868003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:15.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.261+0000 7f588099f700 1 --2- 172.21.15.146:0/917724793 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5868003fe0 0x7f5868004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:15.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.261+0000 7f588099f700 1 --2- 172.21.15.146:0/917724793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5868004d50 0x7f58680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:15.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.261+0000 7f588099f700 1 -- 172.21.15.146:0/917724793 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c0b4510 con 0x7f5868004d50 2023-10-06T11:13:15.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.261+0000 7f588099f700 1 -- 172.21.15.146:0/917724793 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c0b6530 con 0x7f5868003fe0 2023-10-06T11:13:15.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.261+0000 7f588099f700 1 -- 172.21.15.146:0/917724793 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f586800bb40 con 0x7f587c068ba0 2023-10-06T11:13:15.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.261+0000 7f58821a2700 1 --2- 172.21.15.146:0/917724793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5868004d50 0x7f58680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:15.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.261+0000 7f58811a0700 1 --2- 172.21.15.146:0/917724793 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5868003fe0 0x7f5868004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:15.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.261+0000 7f58819a1700 1 --2- 172.21.15.146:0/917724793 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f587c068ba0 0x7f5868003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:15.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.261+0000 7f58821a2700 1 -- 172.21.15.146:0/917724793 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f587c068ba0 msgr2=0x7f5868003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:15.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.261+0000 7f58821a2700 1 --2- 172.21.15.146:0/917724793 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f587c068ba0 0x7f5868003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:15.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.261+0000 7f58821a2700 1 -- 172.21.15.146:0/917724793 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5868003fe0 msgr2=0x7f5868004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:15.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.261+0000 7f58821a2700 1 --2- 172.21.15.146:0/917724793 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5868003fe0 0x7f5868004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:15.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.261+0000 7f58821a2700 1 -- 172.21.15.146:0/917724793 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5868003570 con 0x7f5868004d50 2023-10-06T11:13:15.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.261+0000 7f58821a2700 1 --2- 172.21.15.146:0/917724793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5868004d50 0x7f58680051c0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f587c068fa0 tx=0x7f5874009730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aca0d9aa35e9cf0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:15.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.261+0000 7f588099f700 1 -- 172.21.15.146:0/917724793 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5874009a40 con 0x7f5868004d50 2023-10-06T11:13:15.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.261+0000 7f588099f700 1 -- 172.21.15.146:0/917724793 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5874007c90 con 0x7f5868004d50 2023-10-06T11:13:15.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.261+0000 7f588099f700 1 -- 172.21.15.146:0/917724793 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5874014690 con 0x7f5868004d50 2023-10-06T11:13:15.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.262+0000 7f5883c05700 1 -- 172.21.15.146:0/917724793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5868004d50 msgr2=0x7f58680051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:15.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.262+0000 7f5883c05700 1 --2- 172.21.15.146:0/917724793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5868004d50 0x7f58680051c0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f587c068fa0 tx=0x7f5874009730 comp rx=0 tx=0).stop 2023-10-06T11:13:15.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.262+0000 7f58821a2700 1 -- 172.21.15.146:0/917724793 reap_dead start 2023-10-06T11:13:15.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.262+0000 7f5883c05700 1 -- 172.21.15.146:0/917724793 shutdown_connections 2023-10-06T11:13:15.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.262+0000 7f5883c05700 1 -- 172.21.15.146:0/917724793 >> 172.21.15.146:0/917724793 conn(0x7f587c06eba0 msgr2=0x7f587c06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:15.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.262+0000 7f5883c05700 1 -- 172.21.15.146:0/917724793 shutdown_connections 2023-10-06T11:13:15.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.262+0000 7f5883c05700 1 -- 172.21.15.146:0/917724793 wait complete. 2023-10-06T11:13:15.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.263+0000 7f5883c05700 1 Processor -- start 2023-10-06T11:13:15.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.263+0000 7f5883c05700 1 -- start start 2023-10-06T11:13:15.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.264+0000 7f5883c05700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f587c169ec0 0x7f587c0b25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:15.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.264+0000 7f5883c05700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f587c0b1320 0x7f587c16a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:15.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.264+0000 7f5883c05700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f587c16a7d0 0x7f587c14c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:15.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.264+0000 7f5883c05700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c0b0e90 con 0x7f587c0b1320 2023-10-06T11:13:15.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.264+0000 7f5883c05700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c148880 con 0x7f587c169ec0 2023-10-06T11:13:15.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.264+0000 7f5883c05700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587c0b0280 con 0x7f587c16a7d0 2023-10-06T11:13:15.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.264+0000 7f58811a0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f587c0b1320 0x7f587c16a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:15.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.264+0000 7f58811a0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f587c0b1320 0x7f587c16a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56874/0 (socket says 172.21.15.146:56874) 2023-10-06T11:13:15.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.264+0000 7f58811a0700 1 -- 172.21.15.146:0/3500740040 learned_addr learned my addr 172.21.15.146:0/3500740040 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:15.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.264+0000 7f58819a1700 1 --2- 172.21.15.146:0/3500740040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f587c169ec0 0x7f587c0b25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:15.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.264+0000 7f58821a2700 1 --2- 172.21.15.146:0/3500740040 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f587c16a7d0 0x7f587c14c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:15.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.264+0000 7f58811a0700 1 -- 172.21.15.146:0/3500740040 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f587c16a7d0 msgr2=0x7f587c14c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:15.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.264+0000 7f58811a0700 1 --2- 172.21.15.146:0/3500740040 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f587c16a7d0 0x7f587c14c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:15.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.264+0000 7f58811a0700 1 -- 172.21.15.146:0/3500740040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f587c169ec0 msgr2=0x7f587c0b25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:15.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.264+0000 7f58811a0700 1 --2- 172.21.15.146:0/3500740040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f587c169ec0 0x7f587c0b25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:15.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.264+0000 7f58811a0700 1 -- 172.21.15.146:0/3500740040 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f587c0b0560 con 0x7f587c0b1320 2023-10-06T11:13:15.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.264+0000 7f58819a1700 1 --2- 172.21.15.146:0/3500740040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f587c169ec0 0x7f587c0b25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:15.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.264+0000 7f58811a0700 1 --2- 172.21.15.146:0/3500740040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f587c0b1320 0x7f587c16a290 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f586c001050 tx=0x7f586c007a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:15.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.264+0000 7f5871ffb700 1 -- 172.21.15.146:0/3500740040 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586c00f9a0 con 0x7f587c0b1320 2023-10-06T11:13:15.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.264+0000 7f5871ffb700 1 -- 172.21.15.146:0/3500740040 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586c00fb20 con 0x7f587c0b1320 2023-10-06T11:13:15.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.264+0000 7f5883c05700 1 -- 172.21.15.146:0/3500740040 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f587c0b0840 con 0x7f587c0b1320 2023-10-06T11:13:15.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.265+0000 7f5871ffb700 1 -- 172.21.15.146:0/3500740040 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586c00fee0 con 0x7f587c0b1320 2023-10-06T11:13:15.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.265+0000 7f5883c05700 1 -- 172.21.15.146:0/3500740040 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f587c0b2af0 con 0x7f587c0b1320 2023-10-06T11:13:15.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.266+0000 7f5883c05700 1 -- 172.21.15.146:0/3500740040 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f587c0b0ce0 con 0x7f587c0b1320 2023-10-06T11:13:15.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.266+0000 7f5871ffb700 1 -- 172.21.15.146:0/3500740040 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f586c013600 con 0x7f587c0b1320 2023-10-06T11:13:15.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.267+0000 7f5871ffb700 1 --2- 172.21.15.146:0/3500740040 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5860066f30 0x7f58600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:15.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.267+0000 7f5871ffb700 1 -- 172.21.15.146:0/3500740040 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f586c084890 con 0x7f587c0b1320 2023-10-06T11:13:15.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.267+0000 7f58819a1700 1 --2- 172.21.15.146:0/3500740040 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5860066f30 0x7f58600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:15.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.267+0000 7f58819a1700 1 --2- 172.21.15.146:0/3500740040 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5860066f30 0x7f58600693e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f5878006f00 tx=0x7f5878008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:15.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.271+0000 7f5871ffb700 1 -- 172.21.15.146:0/3500740040 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f586c0519a0 con 0x7f587c0b1320 2023-10-06T11:13:15.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.457+0000 7f5883c05700 1 -- 172.21.15.146:0/3500740040 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f587c15ac30 con 0x7f587c0b1320 2023-10-06T11:13:15.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.458+0000 7f5871ffb700 1 -- 172.21.15.146:0/3500740040 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+16917 (secure 0 0 0) 0x7f587c15ac30 con 0x7f587c0b1320 2023-10-06T11:13:15.460 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:13:15.460 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":89,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:12:46.364872+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:12:42.792405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-10-06T11:12:44.071743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:13:15.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.461+0000 7f5883c05700 1 -- 172.21.15.146:0/3500740040 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5860066f30 msgr2=0x7f58600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:15.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.461+0000 7f5883c05700 1 --2- 172.21.15.146:0/3500740040 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5860066f30 0x7f58600693e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f5878006f00 tx=0x7f5878008040 comp rx=0 tx=0).stop 2023-10-06T11:13:15.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.461+0000 7f5883c05700 1 -- 172.21.15.146:0/3500740040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f587c0b1320 msgr2=0x7f587c16a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:15.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.461+0000 7f5883c05700 1 --2- 172.21.15.146:0/3500740040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f587c0b1320 0x7f587c16a290 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f586c001050 tx=0x7f586c007a80 comp rx=0 tx=0).stop 2023-10-06T11:13:15.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.461+0000 7f5883c05700 1 -- 172.21.15.146:0/3500740040 shutdown_connections 2023-10-06T11:13:15.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.461+0000 7f5883c05700 1 --2- 172.21.15.146:0/3500740040 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5860066f30 0x7f58600693e0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:15.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.461+0000 7f5883c05700 1 --2- 172.21.15.146:0/3500740040 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f587c16a7d0 0x7f587c14c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:15.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.461+0000 7f5883c05700 1 --2- 172.21.15.146:0/3500740040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f587c169ec0 0x7f587c0b25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:15.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.461+0000 7f5883c05700 1 --2- 172.21.15.146:0/3500740040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f587c0b1320 0x7f587c16a290 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:15.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.461+0000 7f5883c05700 1 -- 172.21.15.146:0/3500740040 >> 172.21.15.146:0/3500740040 conn(0x7f587c06eba0 msgr2=0x7f587c1531d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:15.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.461+0000 7f5883c05700 1 -- 172.21.15.146:0/3500740040 shutdown_connections 2023-10-06T11:13:15.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.461+0000 7f5883c05700 1 -- 172.21.15.146:0/3500740040 wait complete. 2023-10-06T11:13:15.475 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:05:36.687307+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:05:37.171199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T11:12:42.792405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T11:12:44.071743+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T11:13:15.476 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:13:15.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.592+0000 7f4a36960700 1 Processor -- start 2023-10-06T11:13:15.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.592+0000 7f4a36960700 1 -- start start 2023-10-06T11:13:15.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.593+0000 7f4a36960700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4a3015a160 0x7f4a300c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:15.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.593+0000 7f4a36960700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4a300ae730 0x7f4a300aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:15.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.593+0000 7f4a36960700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a300ae2a0 con 0x7f4a300ce3d0 2023-10-06T11:13:15.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.593+0000 7f4a36960700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a3015a530 con 0x7f4a300ae730 2023-10-06T11:13:15.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.593+0000 7f4a36960700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a300af0f0 con 0x7f4a3015a160 2023-10-06T11:13:15.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.593+0000 7f4a2f7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4a300ae730 0x7f4a300aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:15.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.593+0000 7f4a34efd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4a300ce3d0 0x7f4a300ce7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:54680/0 (socket says 172.21.15.146:54680) 2023-10-06T11:13:15.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.593+0000 7f4a34efd700 1 -- 172.21.15.146:0/4207186872 learned_addr learned my addr 172.21.15.146:0/4207186872 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:13:15.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.593+0000 7f4a2ffff700 1 --2- 172.21.15.146:0/4207186872 >> v2:172.21.15.151:3300/0 conn(0x7f4a3015a160 0x7f4a300c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:15.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.593+0000 7f4a2f7fe700 1 -- 172.21.15.146:0/4207186872 >> v2:172.21.15.151:3300/0 conn(0x7f4a3015a160 msgr2=0x7f4a300c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:15.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.593+0000 7f4a2f7fe700 1 --2- 172.21.15.146:0/4207186872 >> v2:172.21.15.151:3300/0 conn(0x7f4a3015a160 0x7f4a300c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:15.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.593+0000 7f4a2f7fe700 1 -- 172.21.15.146:0/4207186872 >> v1:172.21.15.146:6789/0 conn(0x7f4a300ce3d0 legacy=0x7f4a300ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:15.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.593+0000 7f4a2f7fe700 1 -- 172.21.15.146:0/4207186872 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a300ad690 con 0x7f4a300ae730 2023-10-06T11:13:15.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.593+0000 7f4a2effd700 1 -- 172.21.15.146:0/4207186872 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1332936176 0 0) 0x7f4a300ae2a0 con 0x7f4a300ce3d0 2023-10-06T11:13:15.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.593+0000 7f4a2f7fe700 1 --2- 172.21.15.146:0/4207186872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a300ae730 0x7f4a300aebb0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f4a30065100 tx=0x7f4a240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ca374c7ac02db50 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:15.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.594+0000 7f4a2effd700 1 -- 172.21.15.146:0/4207186872 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2400b6b0 con 0x7f4a300ae730 2023-10-06T11:13:15.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.594+0000 7f4a2effd700 1 -- 172.21.15.146:0/4207186872 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a2400b810 con 0x7f4a300ae730 2023-10-06T11:13:15.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.594+0000 7f4a2effd700 1 -- 172.21.15.146:0/4207186872 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2400bbb0 con 0x7f4a300ae730 2023-10-06T11:13:15.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.594+0000 7f4a36960700 1 -- 172.21.15.146:0/4207186872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a300ae730 msgr2=0x7f4a300aebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:15.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.594+0000 7f4a36960700 1 --2- 172.21.15.146:0/4207186872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a300ae730 0x7f4a300aebb0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f4a30065100 tx=0x7f4a240091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:15.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.594+0000 7f4a36960700 1 -- 172.21.15.146:0/4207186872 shutdown_connections 2023-10-06T11:13:15.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.594+0000 7f4a36960700 1 --2- 172.21.15.146:0/4207186872 >> v2:172.21.15.151:3300/0 conn(0x7f4a3015a160 0x7f4a300c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:15.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.594+0000 7f4a36960700 1 --2- 172.21.15.146:0/4207186872 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a300ae730 0x7f4a300aebb0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:15.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.594+0000 7f4a36960700 1 -- 172.21.15.146:0/4207186872 >> 172.21.15.146:0/4207186872 conn(0x7f4a3006f380 msgr2=0x7f4a300d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:15.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.594+0000 7f4a36960700 1 -- 172.21.15.146:0/4207186872 shutdown_connections 2023-10-06T11:13:15.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.594+0000 7f4a36960700 1 -- 172.21.15.146:0/4207186872 wait complete. 2023-10-06T11:13:15.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.595+0000 7f4a36960700 1 Processor -- start 2023-10-06T11:13:15.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.595+0000 7f4a36960700 1 -- start start 2023-10-06T11:13:15.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.596+0000 7f4a36960700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4a300ae730 0x7f4a300c5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:15.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.596+0000 7f4a36960700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a300ce3d0 0x7f4a300696d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:15.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.596+0000 7f4a36960700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a3015a160 0x7f4a300c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:15.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.596+0000 7f4a36960700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a300b5040 con 0x7f4a3015a160 2023-10-06T11:13:15.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.596+0000 7f4a36960700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a300b5320 con 0x7f4a300ce3d0 2023-10-06T11:13:15.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.596+0000 7f4a36960700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a300b5600 con 0x7f4a300ae730 2023-10-06T11:13:15.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.596+0000 7f4a34efd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a3015a160 0x7f4a300c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:15.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.596+0000 7f4a34efd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a3015a160 0x7f4a300c7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56898/0 (socket says 172.21.15.146:56898) 2023-10-06T11:13:15.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.596+0000 7f4a34efd700 1 -- 172.21.15.146:0/1327561903 learned_addr learned my addr 172.21.15.146:0/1327561903 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:15.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.597+0000 7f4a2f7fe700 1 --2- 172.21.15.146:0/1327561903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a300ce3d0 0x7f4a300696d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:15.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.597+0000 7f4a2ffff700 1 --2- 172.21.15.146:0/1327561903 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4a300ae730 0x7f4a300c5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:15.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.597+0000 7f4a34efd700 1 -- 172.21.15.146:0/1327561903 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4a300ae730 msgr2=0x7f4a300c5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:15.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.597+0000 7f4a34efd700 1 --2- 172.21.15.146:0/1327561903 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4a300ae730 0x7f4a300c5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:15.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.597+0000 7f4a34efd700 1 -- 172.21.15.146:0/1327561903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a300ce3d0 msgr2=0x7f4a300696d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:15.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.597+0000 7f4a34efd700 1 --2- 172.21.15.146:0/1327561903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a300ce3d0 0x7f4a300696d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:15.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.597+0000 7f4a34efd700 1 -- 172.21.15.146:0/1327561903 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a24009420 con 0x7f4a3015a160 2023-10-06T11:13:15.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.597+0000 7f4a2f7fe700 1 --2- 172.21.15.146:0/1327561903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a300ce3d0 0x7f4a300696d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:15.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.597+0000 7f4a34efd700 1 --2- 172.21.15.146:0/1327561903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a3015a160 0x7f4a300c7f80 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f4a2800cc90 tx=0x7f4a28001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:15.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.597+0000 7f4a17fff700 1 -- 172.21.15.146:0/1327561903 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2800cea0 con 0x7f4a3015a160 2023-10-06T11:13:15.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.597+0000 7f4a17fff700 1 -- 172.21.15.146:0/1327561903 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a2800ab70 con 0x7f4a3015a160 2023-10-06T11:13:15.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.597+0000 7f4a17fff700 1 -- 172.21.15.146:0/1327561903 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a280070f0 con 0x7f4a3015a160 2023-10-06T11:13:15.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.597+0000 7f4a36960700 1 -- 172.21.15.146:0/1327561903 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a300b4c60 con 0x7f4a3015a160 2023-10-06T11:13:15.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.597+0000 7f4a36960700 1 -- 172.21.15.146:0/1327561903 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a300c66b0 con 0x7f4a3015a160 2023-10-06T11:13:15.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.598+0000 7f4a36960700 1 -- 172.21.15.146:0/1327561903 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a300b5b20 con 0x7f4a3015a160 2023-10-06T11:13:15.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.598+0000 7f4a17fff700 1 -- 172.21.15.146:0/1327561903 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4a280074a0 con 0x7f4a3015a160 2023-10-06T11:13:15.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.599+0000 7f4a17fff700 1 --2- 172.21.15.146:0/1327561903 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4a1c066f30 0x7f4a1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:15.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.599+0000 7f4a17fff700 1 -- 172.21.15.146:0/1327561903 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4a28084b10 con 0x7f4a3015a160 2023-10-06T11:13:15.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.599+0000 7f4a2ffff700 1 --2- 172.21.15.146:0/1327561903 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4a1c066f30 0x7f4a1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:15.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.599+0000 7f4a2ffff700 1 --2- 172.21.15.146:0/1327561903 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4a1c066f30 0x7f4a1c0693e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f4a20006aa0 tx=0x7f4a20008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:15.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.603+0000 7f4a17fff700 1 -- 172.21.15.146:0/1327561903 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4a300b5b20 con 0x7f4a3015a160 2023-10-06T11:13:15.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.788+0000 7f4a36960700 1 -- 172.21.15.146:0/1327561903 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4a300b5b20 con 0x7f4a3015a160 2023-10-06T11:13:15.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.788+0000 7f4a17fff700 1 -- 172.21.15.146:0/1327561903 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v89) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4a300b5b20 con 0x7f4a3015a160 2023-10-06T11:13:15.790 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-10-06T11:13:15.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.790+0000 7f4a36960700 1 -- 172.21.15.146:0/1327561903 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4a1c066f30 msgr2=0x7f4a1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:15.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.790+0000 7f4a36960700 1 --2- 172.21.15.146:0/1327561903 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4a1c066f30 0x7f4a1c0693e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f4a20006aa0 tx=0x7f4a20008040 comp rx=0 tx=0).stop 2023-10-06T11:13:15.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.790+0000 7f4a36960700 1 -- 172.21.15.146:0/1327561903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a3015a160 msgr2=0x7f4a300c7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:15.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.790+0000 7f4a36960700 1 --2- 172.21.15.146:0/1327561903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a3015a160 0x7f4a300c7f80 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f4a2800cc90 tx=0x7f4a28001a80 comp rx=0 tx=0).stop 2023-10-06T11:13:15.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.790+0000 7f4a36960700 1 -- 172.21.15.146:0/1327561903 shutdown_connections 2023-10-06T11:13:15.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.790+0000 7f4a36960700 1 --2- 172.21.15.146:0/1327561903 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4a1c066f30 0x7f4a1c0693e0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:15.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.790+0000 7f4a36960700 1 --2- 172.21.15.146:0/1327561903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a3015a160 0x7f4a300c7f80 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:15.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.790+0000 7f4a36960700 1 --2- 172.21.15.146:0/1327561903 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4a300ae730 0x7f4a300c5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:15.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.790+0000 7f4a36960700 1 --2- 172.21.15.146:0/1327561903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a300ce3d0 0x7f4a300696d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:15.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.790+0000 7f4a36960700 1 -- 172.21.15.146:0/1327561903 >> 172.21.15.146:0/1327561903 conn(0x7f4a3006f380 msgr2=0x7f4a300cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:15.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.790+0000 7f4a36960700 1 -- 172.21.15.146:0/1327561903 shutdown_connections 2023-10-06T11:13:15.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.790+0000 7f4a36960700 1 -- 172.21.15.146:0/1327561903 wait complete. 2023-10-06T11:13:15.804 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:13:15.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.920+0000 7faaf89e0700 1 Processor -- start 2023-10-06T11:13:15.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.920+0000 7faaf89e0700 1 -- start start 2023-10-06T11:13:15.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.921+0000 7faaf89e0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faaf40ac3b0 0x7faaf40ac810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:15.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.921+0000 7faaf89e0700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaf40ae550 con 0x7faaf40abfe0 2023-10-06T11:13:15.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.921+0000 7faaf89e0700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaf40ae830 con 0x7faaf40ceb50 2023-10-06T11:13:15.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.921+0000 7faaf89e0700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaf40aeb10 con 0x7faaf40ac3b0 2023-10-06T11:13:15.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.921+0000 7faaf2d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faaf40ac3b0 0x7faaf40ac810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:15.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.921+0000 7faaf259c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7faaf40abfe0 0x7faaf40add00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:54684/0 (socket says 172.21.15.146:54684) 2023-10-06T11:13:15.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.921+0000 7faaf259c700 1 -- 172.21.15.146:0/4060505024 learned_addr learned my addr 172.21.15.146:0/4060505024 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:13:15.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.922+0000 7faaf2d9d700 1 -- 172.21.15.146:0/4060505024 >> v1:172.21.15.151:6789/0 conn(0x7faaf40ceb50 legacy=0x7faaf40af5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:15.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.922+0000 7faaf2d9d700 1 -- 172.21.15.146:0/4060505024 >> v1:172.21.15.146:6789/0 conn(0x7faaf40abfe0 legacy=0x7faaf40add00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:15.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.922+0000 7faaf1d9b700 1 -- 172.21.15.146:0/4060505024 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2699665753 0 0) 0x7faaf40ae550 con 0x7faaf40abfe0 2023-10-06T11:13:15.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.922+0000 7faaf2d9d700 1 -- 172.21.15.146:0/4060505024 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf40aedf0 con 0x7faaf40ac3b0 2023-10-06T11:13:15.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.922+0000 7faaf2d9d700 1 --2- 172.21.15.146:0/4060505024 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaf40ac3b0 0x7faaf40ac810 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7faaec009e60 tx=0x7faaec009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ad9dbf2de879c7f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:15.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.922+0000 7faaf1d9b700 1 -- 172.21.15.146:0/4060505024 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaec00e070 con 0x7faaf40ac3b0 2023-10-06T11:13:15.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.922+0000 7faaf1d9b700 1 -- 172.21.15.146:0/4060505024 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaec00bc30 con 0x7faaf40ac3b0 2023-10-06T11:13:15.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.922+0000 7faaf1d9b700 1 -- 172.21.15.146:0/4060505024 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaec012430 con 0x7faaf40ac3b0 2023-10-06T11:13:15.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.922+0000 7faaf89e0700 1 -- 172.21.15.146:0/4060505024 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaf40ac3b0 msgr2=0x7faaf40ac810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:15.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.922+0000 7faaf89e0700 1 --2- 172.21.15.146:0/4060505024 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaf40ac3b0 0x7faaf40ac810 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7faaec009e60 tx=0x7faaec009780 comp rx=0 tx=0).stop 2023-10-06T11:13:15.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.922+0000 7faaf89e0700 1 -- 172.21.15.146:0/4060505024 shutdown_connections 2023-10-06T11:13:15.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.922+0000 7faaf89e0700 1 --2- 172.21.15.146:0/4060505024 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaf40ac3b0 0x7faaf40ac810 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:15.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.922+0000 7faaf89e0700 1 -- 172.21.15.146:0/4060505024 >> 172.21.15.146:0/4060505024 conn(0x7faaf4067c50 msgr2=0x7faaf40ce440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:15.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.922+0000 7faaf89e0700 1 -- 172.21.15.146:0/4060505024 shutdown_connections 2023-10-06T11:13:15.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.922+0000 7faaf89e0700 1 -- 172.21.15.146:0/4060505024 wait complete. 2023-10-06T11:13:15.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.924+0000 7faaf89e0700 1 Processor -- start 2023-10-06T11:13:15.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.924+0000 7faaf89e0700 1 -- start start 2023-10-06T11:13:15.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.924+0000 7faaf89e0700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faaf40abfe0 0x7faaf413fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:15.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.924+0000 7faaf89e0700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faaf40ac3b0 0x7faaf4159d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:15.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.924+0000 7faaf89e0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaf40ceb50 0x7faaf415a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:15.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.924+0000 7faaf89e0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf4140420 con 0x7faaf40ceb50 2023-10-06T11:13:15.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.924+0000 7faaf89e0700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaf41519e0 con 0x7faaf40abfe0 2023-10-06T11:13:15.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.924+0000 7faaf89e0700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf40b2e80 con 0x7faaf40ac3b0 2023-10-06T11:13:15.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.924+0000 7faaf2d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaf40ceb50 0x7faaf415a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:15.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.924+0000 7faaf2d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaf40ceb50 0x7faaf415a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56926/0 (socket says 172.21.15.146:56926) 2023-10-06T11:13:15.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.924+0000 7faaf2d9d700 1 -- 172.21.15.146:0/588999513 learned_addr learned my addr 172.21.15.146:0/588999513 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:15.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.925+0000 7faaf259c700 1 --2- 172.21.15.146:0/588999513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faaf40abfe0 0x7faaf413fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:15.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.925+0000 7faae9d9b700 1 --2- 172.21.15.146:0/588999513 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faaf40ac3b0 0x7faaf4159d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:15.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.925+0000 7faaf2d9d700 1 -- 172.21.15.146:0/588999513 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faaf40ac3b0 msgr2=0x7faaf4159d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:15.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.925+0000 7faaf2d9d700 1 --2- 172.21.15.146:0/588999513 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faaf40ac3b0 0x7faaf4159d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:15.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.925+0000 7faaf2d9d700 1 -- 172.21.15.146:0/588999513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faaf40abfe0 msgr2=0x7faaf413fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:15.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.925+0000 7faaf2d9d700 1 --2- 172.21.15.146:0/588999513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faaf40abfe0 0x7faaf413fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:15.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.925+0000 7faaf2d9d700 1 -- 172.21.15.146:0/588999513 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaec009a20 con 0x7faaf40ceb50 2023-10-06T11:13:15.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.925+0000 7faaf259c700 1 --2- 172.21.15.146:0/588999513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faaf40abfe0 0x7faaf413fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:15.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.925+0000 7faae9d9b700 1 --2- 172.21.15.146:0/588999513 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faaf40ac3b0 0x7faaf4159d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:15.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.925+0000 7faaf2d9d700 1 --2- 172.21.15.146:0/588999513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaf40ceb50 0x7faaf415a990 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7faaf406e8e0 tx=0x7faaec019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:15.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.925+0000 7faaeaffd700 1 -- 172.21.15.146:0/588999513 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaec01b630 con 0x7faaf40ceb50 2023-10-06T11:13:15.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.925+0000 7faaeaffd700 1 -- 172.21.15.146:0/588999513 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaec01b7b0 con 0x7faaf40ceb50 2023-10-06T11:13:15.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.925+0000 7faaeaffd700 1 -- 172.21.15.146:0/588999513 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaec01bb70 con 0x7faaf40ceb50 2023-10-06T11:13:15.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.925+0000 7faaf89e0700 1 -- 172.21.15.146:0/588999513 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaf40b3160 con 0x7faaf40ceb50 2023-10-06T11:13:15.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.925+0000 7faaf89e0700 1 -- 172.21.15.146:0/588999513 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaf40b3720 con 0x7faaf40ceb50 2023-10-06T11:13:15.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.926+0000 7faaf89e0700 1 -- 172.21.15.146:0/588999513 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaf404c380 con 0x7faaf40ceb50 2023-10-06T11:13:15.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.926+0000 7faaeaffd700 1 -- 172.21.15.146:0/588999513 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faaec01c400 con 0x7faaf40ceb50 2023-10-06T11:13:15.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.927+0000 7faaeaffd700 1 --2- 172.21.15.146:0/588999513 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faad4066f30 0x7faad40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:15.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.927+0000 7faaeaffd700 1 -- 172.21.15.146:0/588999513 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6058+0+0 (secure 0 0 0) 0x7faaec0866e0 con 0x7faaf40ceb50 2023-10-06T11:13:15.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.927+0000 7faaf259c700 1 --2- 172.21.15.146:0/588999513 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faad4066f30 0x7faad40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:15.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.927+0000 7faaf259c700 1 --2- 172.21.15.146:0/588999513 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faad4066f30 0x7faad40693e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7faae4007fd0 tx=0x7faae4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:15.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:15.931+0000 7faaeaffd700 1 -- 172.21.15.146:0/588999513 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faaec0537f0 con 0x7faaf40ceb50 2023-10-06T11:13:16.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.113+0000 7faaf89e0700 1 -- 172.21.15.146:0/588999513 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faaf406e9b0 con 0x7faaf40ceb50 2023-10-06T11:13:16.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.113+0000 7faaeaffd700 1 -- 172.21.15.146:0/588999513 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7faaec02a020 con 0x7faaf40ceb50 2023-10-06T11:13:16.115 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-10-06T11:13:16.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.115+0000 7faaf89e0700 1 -- 172.21.15.146:0/588999513 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faad4066f30 msgr2=0x7faad40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:16.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.115+0000 7faaf89e0700 1 --2- 172.21.15.146:0/588999513 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faad4066f30 0x7faad40693e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7faae4007fd0 tx=0x7faae4009040 comp rx=0 tx=0).stop 2023-10-06T11:13:16.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.115+0000 7faaf89e0700 1 -- 172.21.15.146:0/588999513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaf40ceb50 msgr2=0x7faaf415a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:16.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.115+0000 7faaf89e0700 1 --2- 172.21.15.146:0/588999513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaf40ceb50 0x7faaf415a990 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7faaf406e8e0 tx=0x7faaec019000 comp rx=0 tx=0).stop 2023-10-06T11:13:16.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.115+0000 7faaf89e0700 1 -- 172.21.15.146:0/588999513 shutdown_connections 2023-10-06T11:13:16.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.115+0000 7faaf89e0700 1 --2- 172.21.15.146:0/588999513 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faad4066f30 0x7faad40693e0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:16.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.115+0000 7faaf89e0700 1 --2- 172.21.15.146:0/588999513 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaf40ceb50 0x7faaf415a990 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:16.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.115+0000 7faaf89e0700 1 --2- 172.21.15.146:0/588999513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faaf40abfe0 0x7faaf413fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:16.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.115+0000 7faaf89e0700 1 --2- 172.21.15.146:0/588999513 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faaf40ac3b0 0x7faaf4159d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:16.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.115+0000 7faaf89e0700 1 -- 172.21.15.146:0/588999513 >> 172.21.15.146:0/588999513 conn(0x7faaf4067c50 msgr2=0x7faaf4151180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:16.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.116+0000 7faaf89e0700 1 -- 172.21.15.146:0/588999513 shutdown_connections 2023-10-06T11:13:16.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.116+0000 7faaf89e0700 1 -- 172.21.15.146:0/588999513 wait complete. 2023-10-06T11:13:16.130 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T11:13:16.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.246+0000 7f8ed29e0700 1 Processor -- start 2023-10-06T11:13:16.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.246+0000 7f8ed29e0700 1 -- start start 2023-10-06T11:13:16.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.247+0000 7f8ed29e0700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8ecc159a90 0x7f8ecc0ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:16.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.247+0000 7f8ed29e0700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ecc0cb870 con 0x7f8ecc0cdde0 2023-10-06T11:13:16.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.247+0000 7f8ed29e0700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ecc0b07d0 con 0x7f8ecc0aecd0 2023-10-06T11:13:16.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.247+0000 7f8ed29e0700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ecc0cac60 con 0x7f8ecc159a90 2023-10-06T11:13:16.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.247+0000 7f8ecb7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8ecc0cdde0 0x7f8ecc0b00c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:54688/0 (socket says 172.21.15.146:54688) 2023-10-06T11:13:16.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.248+0000 7f8ecb7fe700 1 -- 172.21.15.146:0/3928876310 learned_addr learned my addr 172.21.15.146:0/3928876310 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:13:16.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.248+0000 7f8ecbfff700 1 --2- 172.21.15.146:0/3928876310 >> v2:172.21.15.151:3300/0 conn(0x7f8ecc159a90 0x7f8ecc0ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:16.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.248+0000 7f8ecaffd700 1 -- 172.21.15.146:0/3928876310 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3431270987 0 0) 0x7f8ecc0cb870 con 0x7f8ecc0cdde0 2023-10-06T11:13:16.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.248+0000 7f8ecaffd700 1 -- 172.21.15.146:0/3928876310 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8eb4003570 con 0x7f8ecc0cdde0 2023-10-06T11:13:16.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.248+0000 7f8ecaffd700 1 -- 172.21.15.146:0/3928876310 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2686542635 0 0) 0x7f8eb4003570 con 0x7f8ecc0cdde0 2023-10-06T11:13:16.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.248+0000 7f8ecaffd700 1 -- 172.21.15.146:0/3928876310 >> v2:172.21.15.151:3300/0 conn(0x7f8ecc159a90 msgr2=0x7f8ecc0ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:16.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.248+0000 7f8ecaffd700 1 --2- 172.21.15.146:0/3928876310 >> v2:172.21.15.151:3300/0 conn(0x7f8ecc159a90 0x7f8ecc0ca330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:16.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.248+0000 7f8ecaffd700 1 -- 172.21.15.146:0/3928876310 >> v1:172.21.15.151:6789/0 conn(0x7f8ecc0aecd0 legacy=0x7f8ecc0cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:16.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.248+0000 7f8ecaffd700 1 -- 172.21.15.146:0/3928876310 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ecc0caf40 con 0x7f8ecc0cdde0 2023-10-06T11:13:16.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.248+0000 7f8ecaffd700 1 -- 172.21.15.146:0/3928876310 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f8ec0001470 con 0x7f8ecc0cdde0 2023-10-06T11:13:16.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.248+0000 7f8ecaffd700 1 -- 172.21.15.146:0/3928876310 >> v1:172.21.15.146:6789/0 conn(0x7f8ecc0cdde0 legacy=0x7f8ecc0b00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:16.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.248+0000 7f8ecaffd700 1 --2- 172.21.15.146:0/3928876310 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8eb4003a60 0x7f8eb4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:16.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.248+0000 7f8ecaffd700 1 --2- 172.21.15.146:0/3928876310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8eb4004810 0x7f8eb4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:16.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.248+0000 7f8ecaffd700 1 --2- 172.21.15.146:0/3928876310 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8eb40051c0 0x7f8eb400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:16.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.248+0000 7f8ecaffd700 1 -- 172.21.15.146:0/3928876310 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc0cac60 con 0x7f8eb40051c0 2023-10-06T11:13:16.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.248+0000 7f8ecaffd700 1 -- 172.21.15.146:0/3928876310 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb400c160 con 0x7f8eb4004810 2023-10-06T11:13:16.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.248+0000 7f8ecaffd700 1 -- 172.21.15.146:0/3928876310 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb400c320 con 0x7f8eb4003a60 2023-10-06T11:13:16.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.248+0000 7f8ed0f7d700 1 --2- 172.21.15.146:0/3928876310 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8eb40051c0 0x7f8eb400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:16.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.248+0000 7f8ecb7fe700 1 --2- 172.21.15.146:0/3928876310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8eb4004810 0x7f8eb4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:16.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.248+0000 7f8ecbfff700 1 --2- 172.21.15.146:0/3928876310 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8eb4003a60 0x7f8eb4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:16.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.249+0000 7f8ed0f7d700 1 -- 172.21.15.146:0/3928876310 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8eb4003a60 msgr2=0x7f8eb4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:16.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.249+0000 7f8ed0f7d700 1 --2- 172.21.15.146:0/3928876310 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8eb4003a60 0x7f8eb4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:16.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.249+0000 7f8ed0f7d700 1 -- 172.21.15.146:0/3928876310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8eb4004810 msgr2=0x7f8eb4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:16.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.249+0000 7f8ed0f7d700 1 --2- 172.21.15.146:0/3928876310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8eb4004810 0x7f8eb4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:16.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.249+0000 7f8ed0f7d700 1 -- 172.21.15.146:0/3928876310 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb4003570 con 0x7f8eb40051c0 2023-10-06T11:13:16.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.249+0000 7f8ed0f7d700 1 -- 172.21.15.146:0/3928876310 reap_dead start 2023-10-06T11:13:16.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.249+0000 7f8ed0f7d700 1 --2- 172.21.15.146:0/3928876310 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8eb40051c0 0x7f8eb400ba60 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4001fc0 tx=0x7f8ec4001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=495dcf083613560 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:16.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.249+0000 7f8ecaffd700 1 -- 172.21.15.146:0/3928876310 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec4001950 con 0x7f8eb40051c0 2023-10-06T11:13:16.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.249+0000 7f8ecaffd700 1 -- 172.21.15.146:0/3928876310 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec400c8b0 con 0x7f8eb40051c0 2023-10-06T11:13:16.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.249+0000 7f8ecaffd700 1 -- 172.21.15.146:0/3928876310 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec400cc90 con 0x7f8eb40051c0 2023-10-06T11:13:16.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.249+0000 7f8ed29e0700 1 -- 172.21.15.146:0/3928876310 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8eb40051c0 msgr2=0x7f8eb400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:16.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.249+0000 7f8ed29e0700 1 --2- 172.21.15.146:0/3928876310 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8eb40051c0 0x7f8eb400ba60 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4001fc0 tx=0x7f8ec4001640 comp rx=0 tx=0).stop 2023-10-06T11:13:16.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.249+0000 7f8ed29e0700 1 -- 172.21.15.146:0/3928876310 shutdown_connections 2023-10-06T11:13:16.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.249+0000 7f8ed29e0700 1 --2- 172.21.15.146:0/3928876310 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8eb40051c0 0x7f8eb400ba60 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:16.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.249+0000 7f8ed29e0700 1 -- 172.21.15.146:0/3928876310 >> 172.21.15.146:0/3928876310 conn(0x7f8ecc068580 msgr2=0x7f8ecc068980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:16.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.249+0000 7f8ed29e0700 1 -- 172.21.15.146:0/3928876310 shutdown_connections 2023-10-06T11:13:16.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.249+0000 7f8ed29e0700 1 -- 172.21.15.146:0/3928876310 wait complete. 2023-10-06T11:13:16.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.250+0000 7f8ed29e0700 1 Processor -- start 2023-10-06T11:13:16.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.251+0000 7f8ed29e0700 1 -- start start 2023-10-06T11:13:16.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.251+0000 7f8ed29e0700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8eb40051c0 0x7f8ecc0a9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:16.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.251+0000 7f8ed29e0700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ecc0aaa80 0x7f8ecc158f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:16.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.251+0000 7f8ed29e0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ecc0c3010 0x7f8ecc0c3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:16.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.251+0000 7f8ed29e0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc167a10 con 0x7f8ecc0c3010 2023-10-06T11:13:16.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.251+0000 7f8ed29e0700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc0c3980 con 0x7f8ecc0aaa80 2023-10-06T11:13:16.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.251+0000 7f8ed29e0700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ecc0a9740 con 0x7f8eb40051c0 2023-10-06T11:13:16.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.251+0000 7f8ed0f7d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ecc0c3010 0x7f8ecc0c3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:16.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.251+0000 7f8ed0f7d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ecc0c3010 0x7f8ecc0c3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56938/0 (socket says 172.21.15.146:56938) 2023-10-06T11:13:16.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.252+0000 7f8ecb7fe700 1 --2- 172.21.15.146:0/1041840926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ecc0aaa80 0x7f8ecc158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:16.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.252+0000 7f8ed0f7d700 1 -- 172.21.15.146:0/1041840926 learned_addr learned my addr 172.21.15.146:0/1041840926 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:16.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.252+0000 7f8ecbfff700 1 --2- 172.21.15.146:0/1041840926 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8eb40051c0 0x7f8ecc0a9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:16.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.252+0000 7f8ed0f7d700 1 -- 172.21.15.146:0/1041840926 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8eb40051c0 msgr2=0x7f8ecc0a9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:16.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.252+0000 7f8ed0f7d700 1 --2- 172.21.15.146:0/1041840926 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8eb40051c0 0x7f8ecc0a9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:16.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.252+0000 7f8ed0f7d700 1 -- 172.21.15.146:0/1041840926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ecc0aaa80 msgr2=0x7f8ecc158f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:16.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.252+0000 7f8ed0f7d700 1 --2- 172.21.15.146:0/1041840926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ecc0aaa80 0x7f8ecc158f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:16.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.252+0000 7f8ed0f7d700 1 -- 172.21.15.146:0/1041840926 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ecc0a99c0 con 0x7f8ecc0c3010 2023-10-06T11:13:16.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.252+0000 7f8ed0f7d700 1 --2- 172.21.15.146:0/1041840926 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ecc0c3010 0x7f8ecc0c3440 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4012c50 tx=0x7f8ec4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:16.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.252+0000 7f8eb3fff700 1 -- 172.21.15.146:0/1041840926 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec4001950 con 0x7f8ecc0c3010 2023-10-06T11:13:16.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.252+0000 7f8eb3fff700 1 -- 172.21.15.146:0/1041840926 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec400c6d0 con 0x7f8ecc0c3010 2023-10-06T11:13:16.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.252+0000 7f8ed29e0700 1 -- 172.21.15.146:0/1041840926 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ecc0a9ca0 con 0x7f8ecc0c3010 2023-10-06T11:13:16.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.252+0000 7f8eb3fff700 1 -- 172.21.15.146:0/1041840926 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec401e850 con 0x7f8ecc0c3010 2023-10-06T11:13:16.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.252+0000 7f8ed29e0700 1 -- 172.21.15.146:0/1041840926 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ecc1594b0 con 0x7f8ecc0c3010 2023-10-06T11:13:16.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.253+0000 7f8ed29e0700 1 -- 172.21.15.146:0/1041840926 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ecc0aa1c0 con 0x7f8ecc0c3010 2023-10-06T11:13:16.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.254+0000 7f8eb3fff700 1 -- 172.21.15.146:0/1041840926 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ec401ec40 con 0x7f8ecc0c3010 2023-10-06T11:13:16.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.254+0000 7f8eb3fff700 1 --2- 172.21.15.146:0/1041840926 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8eb8066f30 0x7f8eb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:16.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.254+0000 7f8eb3fff700 1 -- 172.21.15.146:0/1041840926 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8ec40860c0 con 0x7f8ecc0c3010 2023-10-06T11:13:16.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.254+0000 7f8ecbfff700 1 --2- 172.21.15.146:0/1041840926 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8eb8066f30 0x7f8eb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:16.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.254+0000 7f8ecbfff700 1 --2- 172.21.15.146:0/1041840926 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8eb8066f30 0x7f8eb80693e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc006f00 tx=0x7f8ebc0091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:16.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.258+0000 7f8eb3fff700 1 -- 172.21.15.146:0/1041840926 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ecc0aa1c0 con 0x7f8ecc0c3010 2023-10-06T11:13:16.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.441+0000 7f8ed29e0700 1 -- 172.21.15.146:0/1041840926 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8ecc167bc0 con 0x7f8ecc0c3010 2023-10-06T11:13:16.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.442+0000 7f8eb3fff700 1 -- 172.21.15.146:0/1041840926 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8ecc167bc0 con 0x7f8ecc0c3010 2023-10-06T11:13:16.444 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2023-10-06T11:13:16.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.444+0000 7f8ed29e0700 1 -- 172.21.15.146:0/1041840926 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8eb8066f30 msgr2=0x7f8eb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:16.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.444+0000 7f8ed29e0700 1 --2- 172.21.15.146:0/1041840926 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8eb8066f30 0x7f8eb80693e0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc006f00 tx=0x7f8ebc0091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:16.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.444+0000 7f8ed29e0700 1 -- 172.21.15.146:0/1041840926 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ecc0c3010 msgr2=0x7f8ecc0c3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:16.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.444+0000 7f8ed29e0700 1 --2- 172.21.15.146:0/1041840926 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ecc0c3010 0x7f8ecc0c3440 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f8ec4012c50 tx=0x7f8ec4015000 comp rx=0 tx=0).stop 2023-10-06T11:13:16.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.444+0000 7f8ed29e0700 1 -- 172.21.15.146:0/1041840926 shutdown_connections 2023-10-06T11:13:16.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.444+0000 7f8ed29e0700 1 --2- 172.21.15.146:0/1041840926 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8eb8066f30 0x7f8eb80693e0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:16.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.444+0000 7f8ed29e0700 1 --2- 172.21.15.146:0/1041840926 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ecc0c3010 0x7f8ecc0c3440 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:16.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.444+0000 7f8ed29e0700 1 --2- 172.21.15.146:0/1041840926 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8eb40051c0 0x7f8ecc0a9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:16.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.444+0000 7f8ed29e0700 1 --2- 172.21.15.146:0/1041840926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ecc0aaa80 0x7f8ecc158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:16.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.444+0000 7f8ed29e0700 1 -- 172.21.15.146:0/1041840926 >> 172.21.15.146:0/1041840926 conn(0x7f8ecc068580 msgr2=0x7f8ecc15bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:16.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.444+0000 7f8ed29e0700 1 -- 172.21.15.146:0/1041840926 shutdown_connections 2023-10-06T11:13:16.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.444+0000 7f8ed29e0700 1 -- 172.21.15.146:0/1041840926 wait complete. 2023-10-06T11:13:16.458 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T11:13:16.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.574+0000 7fbcdc3da700 1 Processor -- start 2023-10-06T11:13:16.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.574+0000 7fbcdc3da700 1 -- start start 2023-10-06T11:13:16.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.575+0000 7fbcdc3da700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbcd40adbd0 0x7fbcd4156160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:16.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.575+0000 7fbcdc3da700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbcd41566a0 0x7fbcd40adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:16.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.575+0000 7fbcdc3da700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbcd40ae4e0 0x7fbcd4157e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:16.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.575+0000 7fbcdc3da700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcd41579f0 con 0x7fbcd40adbd0 2023-10-06T11:13:16.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.575+0000 7fbcdc3da700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcd4156b10 con 0x7fbcd41566a0 2023-10-06T11:13:16.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.575+0000 7fbcdc3da700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd4156de0 con 0x7fbcd40ae4e0 2023-10-06T11:13:16.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.575+0000 7fbcda176700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbcd40adbd0 0x7fbcd4156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:16.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.575+0000 7fbcda176700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbcd40adbd0 0x7fbcd4156160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56944/0 (socket says 172.21.15.146:56944) 2023-10-06T11:13:16.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.575+0000 7fbcda176700 1 -- 172.21.15.146:0/2210188088 learned_addr learned my addr 172.21.15.146:0/2210188088 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:16.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.576+0000 7fbcda176700 1 -- 172.21.15.146:0/2210188088 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbcd40ae4e0 msgr2=0x7fbcd4157e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:16.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.576+0000 7fbcda176700 1 --2- 172.21.15.146:0/2210188088 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbcd40ae4e0 0x7fbcd4157e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:16.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.576+0000 7fbcda176700 1 -- 172.21.15.146:0/2210188088 >> v2:172.21.15.151:3300/0 conn(0x7fbcd41566a0 msgr2=0x7fbcd40adfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:16.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.576+0000 7fbcd9975700 1 --2- 172.21.15.146:0/2210188088 >> v2:172.21.15.151:3300/0 conn(0x7fbcd41566a0 0x7fbcd40adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:16.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.576+0000 7fbcda176700 1 --2- 172.21.15.146:0/2210188088 >> v2:172.21.15.151:3300/0 conn(0x7fbcd41566a0 0x7fbcd40adfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:16.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.576+0000 7fbcda176700 1 -- 172.21.15.146:0/2210188088 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd41570c0 con 0x7fbcd40adbd0 2023-10-06T11:13:16.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.576+0000 7fbcda176700 1 --2- 172.21.15.146:0/2210188088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcd40adbd0 0x7fbcd4156160 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fbcd40c89b0 tx=0x7fbcc4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9df9022a1656590 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:16.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.576+0000 7fbcd9174700 1 -- 172.21.15.146:0/2210188088 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc400b860 con 0x7fbcd40adbd0 2023-10-06T11:13:16.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.576+0000 7fbcd9174700 1 -- 172.21.15.146:0/2210188088 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc400b9c0 con 0x7fbcd40adbd0 2023-10-06T11:13:16.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.576+0000 7fbcd9174700 1 -- 172.21.15.146:0/2210188088 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc400bd60 con 0x7fbcd40adbd0 2023-10-06T11:13:16.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.576+0000 7fbcdc3da700 1 -- 172.21.15.146:0/2210188088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcd40adbd0 msgr2=0x7fbcd4156160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:16.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.576+0000 7fbcdc3da700 1 --2- 172.21.15.146:0/2210188088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcd40adbd0 0x7fbcd4156160 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fbcd40c89b0 tx=0x7fbcc4009250 comp rx=0 tx=0).stop 2023-10-06T11:13:16.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.577+0000 7fbcdc3da700 1 -- 172.21.15.146:0/2210188088 shutdown_connections 2023-10-06T11:13:16.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.577+0000 7fbcdc3da700 1 --2- 172.21.15.146:0/2210188088 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbcd40ae4e0 0x7fbcd4157e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:16.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.577+0000 7fbcdc3da700 1 --2- 172.21.15.146:0/2210188088 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcd40adbd0 0x7fbcd4156160 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:16.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.577+0000 7fbcdc3da700 1 --2- 172.21.15.146:0/2210188088 >> v2:172.21.15.151:3300/0 conn(0x7fbcd41566a0 0x7fbcd40adfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:16.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.577+0000 7fbcdc3da700 1 -- 172.21.15.146:0/2210188088 >> 172.21.15.146:0/2210188088 conn(0x7fbcd406a070 msgr2=0x7fbcd4067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:16.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.577+0000 7fbcdc3da700 1 -- 172.21.15.146:0/2210188088 shutdown_connections 2023-10-06T11:13:16.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.577+0000 7fbcdc3da700 1 -- 172.21.15.146:0/2210188088 wait complete. 2023-10-06T11:13:16.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.578+0000 7fbcdc3da700 1 Processor -- start 2023-10-06T11:13:16.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.578+0000 7fbcdc3da700 1 -- start start 2023-10-06T11:13:16.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.578+0000 7fbcdc3da700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbcd40adbd0 0x7fbcd414f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:16.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.578+0000 7fbcdc3da700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbcd40ae4e0 0x7fbcd40ca450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:16.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.578+0000 7fbcdc3da700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcd41566a0 0x7fbcd4166930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:16.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.578+0000 7fbcdc3da700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd40cae80 con 0x7fbcd41566a0 2023-10-06T11:13:16.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.578+0000 7fbcdc3da700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd40cb120 con 0x7fbcd40adbd0 2023-10-06T11:13:16.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.578+0000 7fbcdc3da700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd40cb400 con 0x7fbcd40ae4e0 2023-10-06T11:13:16.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.579+0000 7fbcda977700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcd41566a0 0x7fbcd4166930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:16.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.579+0000 7fbcda977700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcd41566a0 0x7fbcd4166930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56946/0 (socket says 172.21.15.146:56946) 2023-10-06T11:13:16.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.579+0000 7fbcda977700 1 -- 172.21.15.146:0/2170643442 learned_addr learned my addr 172.21.15.146:0/2170643442 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:16.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.579+0000 7fbcd9975700 1 --2- 172.21.15.146:0/2170643442 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbcd40ae4e0 0x7fbcd40ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:16.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.579+0000 7fbcda176700 1 --2- 172.21.15.146:0/2170643442 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbcd40adbd0 0x7fbcd414f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:16.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.579+0000 7fbcda977700 1 -- 172.21.15.146:0/2170643442 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbcd40ae4e0 msgr2=0x7fbcd40ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:16.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.579+0000 7fbcda977700 1 --2- 172.21.15.146:0/2170643442 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbcd40ae4e0 0x7fbcd40ca450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:16.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.579+0000 7fbcda977700 1 -- 172.21.15.146:0/2170643442 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbcd40adbd0 msgr2=0x7fbcd414f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:16.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.579+0000 7fbcda977700 1 --2- 172.21.15.146:0/2170643442 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbcd40adbd0 0x7fbcd414f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:16.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.579+0000 7fbcda977700 1 -- 172.21.15.146:0/2170643442 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc40094f0 con 0x7fbcd41566a0 2023-10-06T11:13:16.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.579+0000 7fbcd9975700 1 --2- 172.21.15.146:0/2170643442 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbcd40ae4e0 0x7fbcd40ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:16.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.579+0000 7fbcda176700 1 --2- 172.21.15.146:0/2170643442 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbcd40adbd0 0x7fbcd414f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:16.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.579+0000 7fbcda977700 1 --2- 172.21.15.146:0/2170643442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcd41566a0 0x7fbcd4166930 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fbccc00bc30 tx=0x7fbccc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:16.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.579+0000 7fbcd27fc700 1 -- 172.21.15.146:0/2170643442 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbccc0092e0 con 0x7fbcd41566a0 2023-10-06T11:13:16.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.579+0000 7fbcd27fc700 1 -- 172.21.15.146:0/2170643442 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbccc00c7a0 con 0x7fbcd41566a0 2023-10-06T11:13:16.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.579+0000 7fbcd27fc700 1 -- 172.21.15.146:0/2170643442 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbccc00cb80 con 0x7fbcd41566a0 2023-10-06T11:13:16.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.579+0000 7fbcdc3da700 1 -- 172.21.15.146:0/2170643442 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcd40cb6e0 con 0x7fbcd41566a0 2023-10-06T11:13:16.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.579+0000 7fbcdc3da700 1 -- 172.21.15.146:0/2170643442 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcd414fe20 con 0x7fbcd41566a0 2023-10-06T11:13:16.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.580+0000 7fbcdc3da700 1 -- 172.21.15.146:0/2170643442 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcd40cbc00 con 0x7fbcd41566a0 2023-10-06T11:13:16.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.580+0000 7fbcd27fc700 1 -- 172.21.15.146:0/2170643442 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbccc012070 con 0x7fbcd41566a0 2023-10-06T11:13:16.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.581+0000 7fbcd27fc700 1 --2- 172.21.15.146:0/2170643442 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbcc0066f30 0x7fbcc00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:16.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.581+0000 7fbcd27fc700 1 -- 172.21.15.146:0/2170643442 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbccc084330 con 0x7fbcd41566a0 2023-10-06T11:13:16.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.581+0000 7fbcda176700 1 --2- 172.21.15.146:0/2170643442 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbcc0066f30 0x7fbcc00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:16.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.581+0000 7fbcda176700 1 --2- 172.21.15.146:0/2170643442 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbcc0066f30 0x7fbcc00693e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fbcd40c89b0 tx=0x7fbcc4018000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:16.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.585+0000 7fbcd27fc700 1 -- 172.21.15.146:0/2170643442 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbcd40cbc00 con 0x7fbcd41566a0 2023-10-06T11:13:16.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.770+0000 7fbcdc3da700 1 -- 172.21.15.146:0/2170643442 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbcd40cbc00 con 0x7fbcd41566a0 2023-10-06T11:13:16.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.770+0000 7fbcd27fc700 1 -- 172.21.15.146:0/2170643442 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbcd40cbc00 con 0x7fbcd41566a0 2023-10-06T11:13:16.772 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2023-10-06T11:13:16.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.772+0000 7fbcdc3da700 1 -- 172.21.15.146:0/2170643442 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbcc0066f30 msgr2=0x7fbcc00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:16.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.772+0000 7fbcdc3da700 1 --2- 172.21.15.146:0/2170643442 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbcc0066f30 0x7fbcc00693e0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fbcd40c89b0 tx=0x7fbcc4018000 comp rx=0 tx=0).stop 2023-10-06T11:13:16.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.772+0000 7fbcdc3da700 1 -- 172.21.15.146:0/2170643442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcd41566a0 msgr2=0x7fbcd4166930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:16.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.772+0000 7fbcdc3da700 1 --2- 172.21.15.146:0/2170643442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcd41566a0 0x7fbcd4166930 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fbccc00bc30 tx=0x7fbccc009840 comp rx=0 tx=0).stop 2023-10-06T11:13:16.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.772+0000 7fbcdc3da700 1 -- 172.21.15.146:0/2170643442 shutdown_connections 2023-10-06T11:13:16.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.772+0000 7fbcdc3da700 1 --2- 172.21.15.146:0/2170643442 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbcc0066f30 0x7fbcc00693e0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:16.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.772+0000 7fbcdc3da700 1 --2- 172.21.15.146:0/2170643442 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcd41566a0 0x7fbcd4166930 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:16.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.772+0000 7fbcdc3da700 1 --2- 172.21.15.146:0/2170643442 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbcd40adbd0 0x7fbcd414f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:16.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.772+0000 7fbcdc3da700 1 --2- 172.21.15.146:0/2170643442 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbcd40ae4e0 0x7fbcd40ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:16.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.772+0000 7fbcdc3da700 1 -- 172.21.15.146:0/2170643442 >> 172.21.15.146:0/2170643442 conn(0x7fbcd406a070 msgr2=0x7fbcd41518f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:16.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.772+0000 7fbcdc3da700 1 -- 172.21.15.146:0/2170643442 shutdown_connections 2023-10-06T11:13:16.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.772+0000 7fbcdc3da700 1 -- 172.21.15.146:0/2170643442 wait complete. 2023-10-06T11:13:16.787 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:13:16.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.899+0000 7f0821651700 1 Processor -- start 2023-10-06T11:13:16.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.899+0000 7f0821651700 1 -- start start 2023-10-06T11:13:16.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.900+0000 7f0821651700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f081c15a420 0x7f081c15cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:16.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.900+0000 7f0821651700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f081c15a7f0 0x7f081c0b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:16.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.900+0000 7f0821651700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f081c15c630 con 0x7f081c0b2360 2023-10-06T11:13:16.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.900+0000 7f0821651700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f081c0ce040 con 0x7f081c15a7f0 2023-10-06T11:13:16.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.900+0000 7f0821651700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f081c0b2780 con 0x7f081c15a420 2023-10-06T11:13:16.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.900+0000 7f081b7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f081c15a7f0 0x7f081c0b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:16.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.900+0000 7f0820e50700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f081c0b2360 0x7f081c15acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:54700/0 (socket says 172.21.15.146:54700) 2023-10-06T11:13:16.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.900+0000 7f0820e50700 1 -- 172.21.15.146:0/646761665 learned_addr learned my addr 172.21.15.146:0/646761665 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:13:16.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.900+0000 7f081bfff700 1 --2- 172.21.15.146:0/646761665 >> v2:172.21.15.151:3300/0 conn(0x7f081c15a420 0x7f081c15cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:16.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.900+0000 7f081b7fe700 1 -- 172.21.15.146:0/646761665 >> v2:172.21.15.151:3300/0 conn(0x7f081c15a420 msgr2=0x7f081c15cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:16.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.900+0000 7f081b7fe700 1 --2- 172.21.15.146:0/646761665 >> v2:172.21.15.151:3300/0 conn(0x7f081c15a420 0x7f081c15cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:16.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.900+0000 7f081b7fe700 1 -- 172.21.15.146:0/646761665 >> v1:172.21.15.146:6789/0 conn(0x7f081c0b2360 legacy=0x7f081c15acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:16.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.900+0000 7f081b7fe700 1 -- 172.21.15.146:0/646761665 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f081c15ba20 con 0x7f081c15a7f0 2023-10-06T11:13:16.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.900+0000 7f081bfff700 1 --2- 172.21.15.146:0/646761665 >> v2:172.21.15.151:3300/0 conn(0x7f081c15a420 0x7f081c15cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:16.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.900+0000 7f081affd700 1 -- 172.21.15.146:0/646761665 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1384193032 0 0) 0x7f081c15c630 con 0x7f081c0b2360 2023-10-06T11:13:16.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.900+0000 7f081b7fe700 1 --2- 172.21.15.146:0/646761665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f081c15a7f0 0x7f081c0b1e20 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f081c0d1460 tx=0x7f08100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcb6000a2ea4314c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:16.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.901+0000 7f081affd700 1 -- 172.21.15.146:0/646761665 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081000b6b0 con 0x7f081c15a7f0 2023-10-06T11:13:16.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.901+0000 7f081affd700 1 -- 172.21.15.146:0/646761665 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081000b810 con 0x7f081c15a7f0 2023-10-06T11:13:16.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.901+0000 7f081affd700 1 -- 172.21.15.146:0/646761665 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081000bbb0 con 0x7f081c15a7f0 2023-10-06T11:13:16.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.901+0000 7f0821651700 1 -- 172.21.15.146:0/646761665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f081c15a7f0 msgr2=0x7f081c0b1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:16.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.901+0000 7f0821651700 1 --2- 172.21.15.146:0/646761665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f081c15a7f0 0x7f081c0b1e20 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f081c0d1460 tx=0x7f08100091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:16.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.901+0000 7f0821651700 1 -- 172.21.15.146:0/646761665 shutdown_connections 2023-10-06T11:13:16.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.901+0000 7f0821651700 1 --2- 172.21.15.146:0/646761665 >> v2:172.21.15.151:3300/0 conn(0x7f081c15a420 0x7f081c15cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:16.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.901+0000 7f0821651700 1 --2- 172.21.15.146:0/646761665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f081c15a7f0 0x7f081c0b1e20 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:16.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.901+0000 7f0821651700 1 -- 172.21.15.146:0/646761665 >> 172.21.15.146:0/646761665 conn(0x7f081c06eba0 msgr2=0x7f081c06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:16.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.901+0000 7f0821651700 1 -- 172.21.15.146:0/646761665 shutdown_connections 2023-10-06T11:13:16.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.901+0000 7f0821651700 1 -- 172.21.15.146:0/646761665 wait complete. 2023-10-06T11:13:16.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.902+0000 7f0821651700 1 Processor -- start 2023-10-06T11:13:16.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.902+0000 7f0821651700 1 -- start start 2023-10-06T11:13:16.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.903+0000 7f0821651700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f081c0b2360 0x7f081c14fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:16.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.903+0000 7f0821651700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f081c15a420 0x7f081c16c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:16.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.903+0000 7f0821651700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f081c15a7f0 0x7f081c16cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:16.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.903+0000 7f0821651700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f081c16d0e0 con 0x7f081c15a7f0 2023-10-06T11:13:16.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.903+0000 7f0821651700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f081c16abb0 con 0x7f081c15a420 2023-10-06T11:13:16.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.903+0000 7f0821651700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f081c151d00 con 0x7f081c0b2360 2023-10-06T11:13:16.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.903+0000 7f0820e50700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f081c15a7f0 0x7f081c16cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:16.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.903+0000 7f0820e50700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f081c15a7f0 0x7f081c16cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56956/0 (socket says 172.21.15.146:56956) 2023-10-06T11:13:16.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.903+0000 7f0820e50700 1 -- 172.21.15.146:0/2096983186 learned_addr learned my addr 172.21.15.146:0/2096983186 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:16.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.903+0000 7f081b7fe700 1 --2- 172.21.15.146:0/2096983186 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f081c15a420 0x7f081c16c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:16.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.903+0000 7f081bfff700 1 --2- 172.21.15.146:0/2096983186 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f081c0b2360 0x7f081c14fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:16.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.903+0000 7f0820e50700 1 -- 172.21.15.146:0/2096983186 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f081c0b2360 msgr2=0x7f081c14fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:16.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.903+0000 7f0820e50700 1 --2- 172.21.15.146:0/2096983186 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f081c0b2360 0x7f081c14fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:16.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.904+0000 7f0820e50700 1 -- 172.21.15.146:0/2096983186 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f081c15a420 msgr2=0x7f081c16c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:16.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.904+0000 7f0820e50700 1 --2- 172.21.15.146:0/2096983186 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f081c15a420 0x7f081c16c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:16.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.904+0000 7f0820e50700 1 -- 172.21.15.146:0/2096983186 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0810009420 con 0x7f081c15a7f0 2023-10-06T11:13:16.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.904+0000 7f0820e50700 1 --2- 172.21.15.146:0/2096983186 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f081c15a7f0 0x7f081c16cba0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f081400cc10 tx=0x7f0814001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:16.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.904+0000 7f0803fff700 1 -- 172.21.15.146:0/2096983186 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081400a930 con 0x7f081c15a7f0 2023-10-06T11:13:16.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.904+0000 7f0803fff700 1 -- 172.21.15.146:0/2096983186 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081400aab0 con 0x7f081c15a7f0 2023-10-06T11:13:16.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.904+0000 7f0803fff700 1 -- 172.21.15.146:0/2096983186 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f081400ae70 con 0x7f081c15a7f0 2023-10-06T11:13:16.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.904+0000 7f0821651700 1 -- 172.21.15.146:0/2096983186 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f081c152040 con 0x7f081c15a7f0 2023-10-06T11:13:16.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.904+0000 7f0821651700 1 -- 172.21.15.146:0/2096983186 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f081c150220 con 0x7f081c15a7f0 2023-10-06T11:13:16.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.905+0000 7f0821651700 1 -- 172.21.15.146:0/2096983186 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f081c1504a0 con 0x7f081c15a7f0 2023-10-06T11:13:16.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.905+0000 7f0803fff700 1 -- 172.21.15.146:0/2096983186 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0814007300 con 0x7f081c15a7f0 2023-10-06T11:13:16.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.905+0000 7f0803fff700 1 --2- 172.21.15.146:0/2096983186 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0808066f30 0x7f08080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:16.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.906+0000 7f0803fff700 1 -- 172.21.15.146:0/2096983186 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0814084a80 con 0x7f081c15a7f0 2023-10-06T11:13:16.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.906+0000 7f081bfff700 1 --2- 172.21.15.146:0/2096983186 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0808066f30 0x7f08080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:16.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.906+0000 7f081bfff700 1 --2- 172.21.15.146:0/2096983186 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0808066f30 0x7f08080693e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f080c00ac00 tx=0x7f080c006f90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:16.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:16.910+0000 7f0803fff700 1 -- 172.21.15.146:0/2096983186 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0814051c10 con 0x7f081c15a7f0 2023-10-06T11:13:17.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.135+0000 7f0821651700 1 -- 172.21.15.146:0/2096983186 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f081c0afae0 con 0x7f081c15a7f0 2023-10-06T11:13:17.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.135+0000 7f0803fff700 1 -- 172.21.15.146:0/2096983186 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4608 (secure 0 0 0) 0x7f0814055230 con 0x7f081c15a7f0 2023-10-06T11:13:17.137 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:13:17.137 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":85,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6619,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/1915786440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1915786440},{"type":"v1","addr":"172.21.15.151:6834","nonce":1915786440}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7212,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2292999516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2292999516},{"type":"v1","addr":"172.21.15.146:6836","nonce":2292999516}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7215,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/905558084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":905558084},{"type":"v1","addr":"172.21.15.146:6837","nonce":905558084}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:12:45.107155+0000","modified":"2023-10-06T11:12:48.746860+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7227},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7227":{"gid":7227,"name":"d","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6835/3868165725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":3868165725},{"type":"v1","addr":"172.21.15.151:6835","nonce":3868165725}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T11:13:17.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.137+0000 7f0821651700 1 -- 172.21.15.146:0/2096983186 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0808066f30 msgr2=0x7f08080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:17.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.137+0000 7f0821651700 1 --2- 172.21.15.146:0/2096983186 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0808066f30 0x7f08080693e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f080c00ac00 tx=0x7f080c006f90 comp rx=0 tx=0).stop 2023-10-06T11:13:17.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.137+0000 7f0821651700 1 -- 172.21.15.146:0/2096983186 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f081c15a7f0 msgr2=0x7f081c16cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:17.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.137+0000 7f0821651700 1 --2- 172.21.15.146:0/2096983186 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f081c15a7f0 0x7f081c16cba0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f081400cc10 tx=0x7f0814001970 comp rx=0 tx=0).stop 2023-10-06T11:13:17.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.138+0000 7f0821651700 1 -- 172.21.15.146:0/2096983186 shutdown_connections 2023-10-06T11:13:17.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.138+0000 7f0821651700 1 --2- 172.21.15.146:0/2096983186 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0808066f30 0x7f08080693e0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:17.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.138+0000 7f0821651700 1 --2- 172.21.15.146:0/2096983186 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f081c15a7f0 0x7f081c16cba0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:17.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.138+0000 7f0821651700 1 --2- 172.21.15.146:0/2096983186 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f081c0b2360 0x7f081c14fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:17.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.138+0000 7f0821651700 1 --2- 172.21.15.146:0/2096983186 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f081c15a420 0x7f081c16c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:17.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.138+0000 7f0821651700 1 -- 172.21.15.146:0/2096983186 >> 172.21.15.146:0/2096983186 conn(0x7f081c06eba0 msgr2=0x7f081c0b5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:17.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.138+0000 7f0821651700 1 -- 172.21.15.146:0/2096983186 shutdown_connections 2023-10-06T11:13:17.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.138+0000 7f0821651700 1 -- 172.21.15.146:0/2096983186 wait complete. 2023-10-06T11:13:17.141 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 85 2023-10-06T11:13:17.154 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:13:17.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.267+0000 7fd848e8c700 1 Processor -- start 2023-10-06T11:13:17.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.267+0000 7fd848e8c700 1 -- start start 2023-10-06T11:13:17.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.268+0000 7fd848e8c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd844153ab0 0x7fd84415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:17.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.268+0000 7fd848e8c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd844153e80 0x7fd844068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:17.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.268+0000 7fd848e8c700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd84415ac30 con 0x7fd8440689d0 2023-10-06T11:13:17.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.268+0000 7fd848e8c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8440b4510 con 0x7fd844153ab0 2023-10-06T11:13:17.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.268+0000 7fd848e8c700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8440b6530 con 0x7fd844153e80 2023-10-06T11:13:17.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.268+0000 7fd84259c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd844153ab0 0x7fd84415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:17.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.268+0000 7fd84259c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd844153ab0 0x7fd84415a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56958/0 (socket says 172.21.15.146:56958) 2023-10-06T11:13:17.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.268+0000 7fd84259c700 1 -- 172.21.15.146:0/3305524229 learned_addr learned my addr 172.21.15.146:0/3305524229 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:17.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.268+0000 7fd84259c700 1 -- 172.21.15.146:0/3305524229 >> v2:172.21.15.151:3300/0 conn(0x7fd844153e80 msgr2=0x7fd844068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:17.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.268+0000 7fd839d9b700 1 --2- 172.21.15.146:0/3305524229 >> v2:172.21.15.151:3300/0 conn(0x7fd844153e80 0x7fd844068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:17.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.269+0000 7fd84259c700 1 --2- 172.21.15.146:0/3305524229 >> v2:172.21.15.151:3300/0 conn(0x7fd844153e80 0x7fd844068490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:17.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.269+0000 7fd84259c700 1 -- 172.21.15.146:0/3305524229 >> v1:172.21.15.151:6789/0 conn(0x7fd8440689d0 legacy=0x7fd84415d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:17.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.269+0000 7fd84259c700 1 -- 172.21.15.146:0/3305524229 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd844068dd0 con 0x7fd844153ab0 2023-10-06T11:13:17.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.269+0000 7fd839d9b700 1 --2- 172.21.15.146:0/3305524229 >> v2:172.21.15.151:3300/0 conn(0x7fd844153e80 0x7fd844068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:17.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.269+0000 7fd84259c700 1 --2- 172.21.15.146:0/3305524229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd844153ab0 0x7fd84415a6f0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fd844089770 tx=0x7fd834009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=900388f3701c9027 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:17.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.269+0000 7fd841d9b700 1 -- 172.21.15.146:0/3305524229 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83400b820 con 0x7fd844153ab0 2023-10-06T11:13:17.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.269+0000 7fd841d9b700 1 -- 172.21.15.146:0/3305524229 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83400b980 con 0x7fd844153ab0 2023-10-06T11:13:17.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.269+0000 7fd841d9b700 1 -- 172.21.15.146:0/3305524229 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83400bd20 con 0x7fd844153ab0 2023-10-06T11:13:17.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.269+0000 7fd848e8c700 1 -- 172.21.15.146:0/3305524229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd844153ab0 msgr2=0x7fd84415a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:17.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.269+0000 7fd848e8c700 1 --2- 172.21.15.146:0/3305524229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd844153ab0 0x7fd84415a6f0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fd844089770 tx=0x7fd834009250 comp rx=0 tx=0).stop 2023-10-06T11:13:17.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.269+0000 7fd848e8c700 1 -- 172.21.15.146:0/3305524229 shutdown_connections 2023-10-06T11:13:17.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.269+0000 7fd848e8c700 1 --2- 172.21.15.146:0/3305524229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd844153ab0 0x7fd84415a6f0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:17.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.269+0000 7fd848e8c700 1 --2- 172.21.15.146:0/3305524229 >> v2:172.21.15.151:3300/0 conn(0x7fd844153e80 0x7fd844068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:17.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.269+0000 7fd848e8c700 1 -- 172.21.15.146:0/3305524229 >> 172.21.15.146:0/3305524229 conn(0x7fd84406eba0 msgr2=0x7fd84406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:17.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.269+0000 7fd848e8c700 1 -- 172.21.15.146:0/3305524229 shutdown_connections 2023-10-06T11:13:17.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.269+0000 7fd848e8c700 1 -- 172.21.15.146:0/3305524229 wait complete. 2023-10-06T11:13:17.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.271+0000 7fd848e8c700 1 Processor -- start 2023-10-06T11:13:17.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.271+0000 7fd848e8c700 1 -- start start 2023-10-06T11:13:17.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.271+0000 7fd848e8c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8440689d0 0x7fd844159690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:17.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.271+0000 7fd848e8c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd844153ab0 0x7fd844154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:17.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.271+0000 7fd848e8c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd844153e80 0x7fd844157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:17.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.271+0000 7fd848e8c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd844155ee0 con 0x7fd8440689d0 2023-10-06T11:13:17.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.271+0000 7fd848e8c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd844156a60 con 0x7fd844153ab0 2023-10-06T11:13:17.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.271+0000 7fd848e8c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd844155080 con 0x7fd844153e80 2023-10-06T11:13:17.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.272+0000 7fd84259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8440689d0 0x7fd844159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:17.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.272+0000 7fd84259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8440689d0 0x7fd844159690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56968/0 (socket says 172.21.15.146:56968) 2023-10-06T11:13:17.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.272+0000 7fd84259c700 1 -- 172.21.15.146:0/3791114492 learned_addr learned my addr 172.21.15.146:0/3791114492 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:17.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.272+0000 7fd839d9b700 1 --2- 172.21.15.146:0/3791114492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd844153ab0 0x7fd844154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:17.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.272+0000 7fd842d9d700 1 --2- 172.21.15.146:0/3791114492 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd844153e80 0x7fd844157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:17.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.272+0000 7fd84259c700 1 -- 172.21.15.146:0/3791114492 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd844153e80 msgr2=0x7fd844157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:17.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.272+0000 7fd84259c700 1 --2- 172.21.15.146:0/3791114492 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd844153e80 0x7fd844157420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:17.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.272+0000 7fd84259c700 1 -- 172.21.15.146:0/3791114492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd844153ab0 msgr2=0x7fd844154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:17.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.272+0000 7fd84259c700 1 --2- 172.21.15.146:0/3791114492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd844153ab0 0x7fd844154b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:17.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.272+0000 7fd84259c700 1 -- 172.21.15.146:0/3791114492 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8340094f0 con 0x7fd8440689d0 2023-10-06T11:13:17.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.272+0000 7fd84259c700 1 --2- 172.21.15.146:0/3791114492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8440689d0 0x7fd844159690 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fd8340030c0 tx=0x7fd834016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:17.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.272+0000 7fd83affd700 1 -- 172.21.15.146:0/3791114492 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd834011e60 con 0x7fd8440689d0 2023-10-06T11:13:17.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.272+0000 7fd83affd700 1 -- 172.21.15.146:0/3791114492 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd834020070 con 0x7fd8440689d0 2023-10-06T11:13:17.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.272+0000 7fd848e8c700 1 -- 172.21.15.146:0/3791114492 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd844156130 con 0x7fd8440689d0 2023-10-06T11:13:17.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.272+0000 7fd83affd700 1 -- 172.21.15.146:0/3791114492 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83401b6a0 con 0x7fd8440689d0 2023-10-06T11:13:17.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.272+0000 7fd848e8c700 1 -- 172.21.15.146:0/3791114492 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8441566f0 con 0x7fd8440689d0 2023-10-06T11:13:17.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.273+0000 7fd848e8c700 1 -- 172.21.15.146:0/3791114492 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd84404c380 con 0x7fd8440689d0 2023-10-06T11:13:17.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.274+0000 7fd83affd700 1 -- 172.21.15.146:0/3791114492 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd834022030 con 0x7fd8440689d0 2023-10-06T11:13:17.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.274+0000 7fd83affd700 1 --2- 172.21.15.146:0/3791114492 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd824066f30 0x7fd8240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:17.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.274+0000 7fd839d9b700 1 --2- 172.21.15.146:0/3791114492 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd824066f30 0x7fd8240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:17.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.274+0000 7fd83affd700 1 -- 172.21.15.146:0/3791114492 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd834086500 con 0x7fd8440689d0 2023-10-06T11:13:17.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.275+0000 7fd839d9b700 1 --2- 172.21.15.146:0/3791114492 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd824066f30 0x7fd8240693e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd8441548b0 tx=0x7fd82c006f90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:17.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.279+0000 7fd83affd700 1 -- 172.21.15.146:0/3791114492 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd8340536c0 con 0x7fd8440689d0 2023-10-06T11:13:17.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.469+0000 7fd848e8c700 1 -- 172.21.15.146:0/3791114492 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd84415ac30 con 0x7fd8440689d0 2023-10-06T11:13:17.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.470+0000 7fd83affd700 1 -- 172.21.15.146:0/3791114492 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+16917 (secure 0 0 0) 0x7fd84415ac30 con 0x7fd8440689d0 2023-10-06T11:13:17.472 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:13:17.472 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":89,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:12:46.364872+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:12:42.792405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-10-06T11:12:44.071743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:13:17.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.472+0000 7fd848e8c700 1 -- 172.21.15.146:0/3791114492 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd824066f30 msgr2=0x7fd8240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:17.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.472+0000 7fd848e8c700 1 --2- 172.21.15.146:0/3791114492 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd824066f30 0x7fd8240693e0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd8441548b0 tx=0x7fd82c006f90 comp rx=0 tx=0).stop 2023-10-06T11:13:17.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.472+0000 7fd848e8c700 1 -- 172.21.15.146:0/3791114492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8440689d0 msgr2=0x7fd844159690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:17.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.472+0000 7fd848e8c700 1 --2- 172.21.15.146:0/3791114492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8440689d0 0x7fd844159690 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fd8340030c0 tx=0x7fd834016000 comp rx=0 tx=0).stop 2023-10-06T11:13:17.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.472+0000 7fd848e8c700 1 -- 172.21.15.146:0/3791114492 shutdown_connections 2023-10-06T11:13:17.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.472+0000 7fd848e8c700 1 --2- 172.21.15.146:0/3791114492 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd824066f30 0x7fd8240693e0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:17.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.472+0000 7fd848e8c700 1 --2- 172.21.15.146:0/3791114492 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd844153e80 0x7fd844157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:17.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.472+0000 7fd848e8c700 1 --2- 172.21.15.146:0/3791114492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd8440689d0 0x7fd844159690 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:17.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.472+0000 7fd848e8c700 1 --2- 172.21.15.146:0/3791114492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd844153ab0 0x7fd844154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:17.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.472+0000 7fd848e8c700 1 -- 172.21.15.146:0/3791114492 >> 172.21.15.146:0/3791114492 conn(0x7fd84406eba0 msgr2=0x7fd84415add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:17.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.472+0000 7fd848e8c700 1 -- 172.21.15.146:0/3791114492 shutdown_connections 2023-10-06T11:13:17.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.472+0000 7fd848e8c700 1 -- 172.21.15.146:0/3791114492 wait complete. 2023-10-06T11:13:17.486 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T11:13:17.486 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:13:17.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.599+0000 7fb7aab9a700 1 Processor -- start 2023-10-06T11:13:17.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.599+0000 7fb7aab9a700 1 -- start start 2023-10-06T11:13:17.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.600+0000 7fb7aab9a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb7a4142d10 0x7fb7a40b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:17.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.600+0000 7fb7aab9a700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb7a40b1510 0x7fb7a40ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:17.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.600+0000 7fb7aab9a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb7a40ce6e0 0x7fb7a406b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:17.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.600+0000 7fb7aab9a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7a40b1d30 con 0x7fb7a4142d10 2023-10-06T11:13:17.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.600+0000 7fb7aab9a700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7a40ceb60 con 0x7fb7a40b1510 2023-10-06T11:13:17.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.600+0000 7fb7aab9a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a415d040 con 0x7fb7a40ce6e0 2023-10-06T11:13:17.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.600+0000 7fb7a9b98700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb7a4142d10 0x7fb7a40b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:17.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.600+0000 7fb7a9b98700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb7a4142d10 0x7fb7a40b0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56984/0 (socket says 172.21.15.146:56984) 2023-10-06T11:13:17.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.600+0000 7fb7a9b98700 1 -- 172.21.15.146:0/4127045922 learned_addr learned my addr 172.21.15.146:0/4127045922 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:17.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.600+0000 7fb7a9397700 1 --2- 172.21.15.146:0/4127045922 >> v2:172.21.15.151:3300/0 conn(0x7fb7a40b1510 0x7fb7a40ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:17.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.600+0000 7fb7a9b98700 1 -- 172.21.15.146:0/4127045922 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb7a40ce6e0 msgr2=0x7fb7a406b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:17.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.600+0000 7fb7a9b98700 1 --2- 172.21.15.146:0/4127045922 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb7a40ce6e0 0x7fb7a406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:17.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.600+0000 7fb7a9b98700 1 -- 172.21.15.146:0/4127045922 >> v2:172.21.15.151:3300/0 conn(0x7fb7a40b1510 msgr2=0x7fb7a40ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:17.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.600+0000 7fb7a9b98700 1 --2- 172.21.15.146:0/4127045922 >> v2:172.21.15.151:3300/0 conn(0x7fb7a40b1510 0x7fb7a40ce1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:17.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.600+0000 7fb7a9b98700 1 -- 172.21.15.146:0/4127045922 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a40b1a50 con 0x7fb7a4142d10 2023-10-06T11:13:17.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.601+0000 7fb7a9b98700 1 --2- 172.21.15.146:0/4127045922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7a4142d10 0x7fb7a40b0fd0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4071520 tx=0x7fb794009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=865272358448b94a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:17.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.601+0000 7fb7a8b96700 1 -- 172.21.15.146:0/4127045922 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79400e070 con 0x7fb7a4142d10 2023-10-06T11:13:17.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.601+0000 7fb7a8b96700 1 -- 172.21.15.146:0/4127045922 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb79400ba40 con 0x7fb7a4142d10 2023-10-06T11:13:17.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.601+0000 7fb7a8b96700 1 -- 172.21.15.146:0/4127045922 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7940092e0 con 0x7fb7a4142d10 2023-10-06T11:13:17.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.601+0000 7fb7aab9a700 1 -- 172.21.15.146:0/4127045922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7a4142d10 msgr2=0x7fb7a40b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:17.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.601+0000 7fb7aab9a700 1 --2- 172.21.15.146:0/4127045922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7a4142d10 0x7fb7a40b0fd0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fb7a4071520 tx=0x7fb794009840 comp rx=0 tx=0).stop 2023-10-06T11:13:17.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.601+0000 7fb7aab9a700 1 -- 172.21.15.146:0/4127045922 shutdown_connections 2023-10-06T11:13:17.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.601+0000 7fb7aab9a700 1 --2- 172.21.15.146:0/4127045922 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb7a40ce6e0 0x7fb7a406b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:17.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.601+0000 7fb7aab9a700 1 --2- 172.21.15.146:0/4127045922 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7a4142d10 0x7fb7a40b0fd0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:17.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.601+0000 7fb7aab9a700 1 --2- 172.21.15.146:0/4127045922 >> v2:172.21.15.151:3300/0 conn(0x7fb7a40b1510 0x7fb7a40ce1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:17.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.601+0000 7fb7aab9a700 1 -- 172.21.15.146:0/4127045922 >> 172.21.15.146:0/4127045922 conn(0x7fb7a4067470 msgr2=0x7fb7a4067870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:17.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.601+0000 7fb7aab9a700 1 -- 172.21.15.146:0/4127045922 shutdown_connections 2023-10-06T11:13:17.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.601+0000 7fb7aab9a700 1 -- 172.21.15.146:0/4127045922 wait complete. 2023-10-06T11:13:17.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.602+0000 7fb7aab9a700 1 Processor -- start 2023-10-06T11:13:17.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.602+0000 7fb7aab9a700 1 -- start start 2023-10-06T11:13:17.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.603+0000 7fb7aab9a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7a40b1510 0x7fb7a413cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:17.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.603+0000 7fb7aab9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7a40ce6e0 0x7fb7a40c9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:17.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.603+0000 7fb7aab9a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb7a4142d10 0x7fb7a40c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:17.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.603+0000 7fb7aab9a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a40b0330 con 0x7fb7a40b1510 2023-10-06T11:13:17.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.603+0000 7fb7aab9a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a40af720 con 0x7fb7a40ce6e0 2023-10-06T11:13:17.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.603+0000 7fb7aab9a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a40afa00 con 0x7fb7a4142d10 2023-10-06T11:13:17.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.603+0000 7fb7a9b98700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7a40b1510 0x7fb7a413cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:17.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.603+0000 7fb7a9b98700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7a40b1510 0x7fb7a413cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56986/0 (socket says 172.21.15.146:56986) 2023-10-06T11:13:17.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.603+0000 7fb7a9b98700 1 -- 172.21.15.146:0/3257352200 learned_addr learned my addr 172.21.15.146:0/3257352200 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:17.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.603+0000 7fb7a9b98700 1 -- 172.21.15.146:0/3257352200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb7a4142d10 msgr2=0x7fb7a40c9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:17.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.603+0000 7fb7a9b98700 1 --2- 172.21.15.146:0/3257352200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb7a4142d10 0x7fb7a40c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:17.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.603+0000 7fb7a9b98700 1 -- 172.21.15.146:0/3257352200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7a40ce6e0 msgr2=0x7fb7a40c9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:17.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.603+0000 7fb7a9b98700 1 --2- 172.21.15.146:0/3257352200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7a40ce6e0 0x7fb7a40c9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:17.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.603+0000 7fb7a9b98700 1 -- 172.21.15.146:0/3257352200 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb794009ae0 con 0x7fb7a40b1510 2023-10-06T11:13:17.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.604+0000 7fb7a9b98700 1 --2- 172.21.15.146:0/3257352200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7a40b1510 0x7fb7a413cf50 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fb794009430 tx=0x7fb794018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:17.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.604+0000 7fb7a1ffb700 1 -- 172.21.15.146:0/3257352200 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb794008ac0 con 0x7fb7a40b1510 2023-10-06T11:13:17.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.604+0000 7fb7a1ffb700 1 -- 172.21.15.146:0/3257352200 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb794008c80 con 0x7fb7a40b1510 2023-10-06T11:13:17.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.604+0000 7fb7aab9a700 1 -- 172.21.15.146:0/3257352200 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7a40afce0 con 0x7fb7a40b1510 2023-10-06T11:13:17.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.604+0000 7fb7a1ffb700 1 -- 172.21.15.146:0/3257352200 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb79401c410 con 0x7fb7a40b1510 2023-10-06T11:13:17.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.604+0000 7fb7aab9a700 1 -- 172.21.15.146:0/3257352200 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7a413d490 con 0x7fb7a40b1510 2023-10-06T11:13:17.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.605+0000 7fb7aab9a700 1 -- 172.21.15.146:0/3257352200 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7a406e230 con 0x7fb7a40b1510 2023-10-06T11:13:17.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.605+0000 7fb7a1ffb700 1 -- 172.21.15.146:0/3257352200 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb794003040 con 0x7fb7a40b1510 2023-10-06T11:13:17.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.606+0000 7fb7a1ffb700 1 --2- 172.21.15.146:0/3257352200 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb790066f30 0x7fb7900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:17.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.606+0000 7fb7a1ffb700 1 -- 172.21.15.146:0/3257352200 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb794085de0 con 0x7fb7a40b1510 2023-10-06T11:13:17.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.606+0000 7fb7a9397700 1 --2- 172.21.15.146:0/3257352200 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb790066f30 0x7fb7900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:17.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.606+0000 7fb7a9397700 1 --2- 172.21.15.146:0/3257352200 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb790066f30 0x7fb7900693e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb7a416d150 tx=0x7fb798008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:17.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.610+0000 7fb7a1ffb700 1 -- 172.21.15.146:0/3257352200 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb794052ef0 con 0x7fb7a40b1510 2023-10-06T11:13:17.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.835+0000 7fb7aab9a700 1 -- 172.21.15.146:0/3257352200 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb7a415d290 con 0x7fb7a40b1510 2023-10-06T11:13:17.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.836+0000 7fb7a1ffb700 1 -- 172.21.15.146:0/3257352200 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4608 (secure 0 0 0) 0x7fb794056510 con 0x7fb7a40b1510 2023-10-06T11:13:17.838 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:13:17.838 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":85,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6619,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/1915786440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1915786440},{"type":"v1","addr":"172.21.15.151:6834","nonce":1915786440}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7212,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2292999516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2292999516},{"type":"v1","addr":"172.21.15.146:6836","nonce":2292999516}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7215,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/905558084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":905558084},{"type":"v1","addr":"172.21.15.146:6837","nonce":905558084}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:12:45.107155+0000","modified":"2023-10-06T11:12:48.746860+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7227},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7227":{"gid":7227,"name":"d","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6835/3868165725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":3868165725},{"type":"v1","addr":"172.21.15.151:6835","nonce":3868165725}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T11:13:17.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.838+0000 7fb7aab9a700 1 -- 172.21.15.146:0/3257352200 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb790066f30 msgr2=0x7fb7900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:17.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.838+0000 7fb7aab9a700 1 --2- 172.21.15.146:0/3257352200 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb790066f30 0x7fb7900693e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb7a416d150 tx=0x7fb798008040 comp rx=0 tx=0).stop 2023-10-06T11:13:17.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.838+0000 7fb7aab9a700 1 -- 172.21.15.146:0/3257352200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7a40b1510 msgr2=0x7fb7a413cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:17.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.838+0000 7fb7aab9a700 1 --2- 172.21.15.146:0/3257352200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7a40b1510 0x7fb7a413cf50 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fb794009430 tx=0x7fb794018000 comp rx=0 tx=0).stop 2023-10-06T11:13:17.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.838+0000 7fb7aab9a700 1 -- 172.21.15.146:0/3257352200 shutdown_connections 2023-10-06T11:13:17.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.838+0000 7fb7aab9a700 1 --2- 172.21.15.146:0/3257352200 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb790066f30 0x7fb7900693e0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:17.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.838+0000 7fb7aab9a700 1 --2- 172.21.15.146:0/3257352200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb7a4142d10 0x7fb7a40c9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:17.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.838+0000 7fb7aab9a700 1 --2- 172.21.15.146:0/3257352200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7a40b1510 0x7fb7a413cf50 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:17.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.838+0000 7fb7aab9a700 1 --2- 172.21.15.146:0/3257352200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7a40ce6e0 0x7fb7a40c9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:17.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.838+0000 7fb7aab9a700 1 -- 172.21.15.146:0/3257352200 >> 172.21.15.146:0/3257352200 conn(0x7fb7a4067470 msgr2=0x7fb7a415a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:17.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.838+0000 7fb7aab9a700 1 -- 172.21.15.146:0/3257352200 shutdown_connections 2023-10-06T11:13:17.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.838+0000 7fb7aab9a700 1 -- 172.21.15.146:0/3257352200 wait complete. 2023-10-06T11:13:17.842 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 85 2023-10-06T11:13:17.852 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:13:17.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.965+0000 7ff4c9a53700 1 Processor -- start 2023-10-06T11:13:17.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.965+0000 7ff4c9a53700 1 -- start start 2023-10-06T11:13:17.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.966+0000 7ff4c9a53700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff4c40c8520 0x7ff4c4155d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:17.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.966+0000 7ff4c9a53700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4c406be70 0x7ff4c4156280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:17.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.966+0000 7ff4c9a53700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4c41567c0 con 0x7ff4c406baa0 2023-10-06T11:13:17.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.966+0000 7ff4c9a53700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4c40c96a0 con 0x7ff4c40c8520 2023-10-06T11:13:17.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.966+0000 7ff4c9a53700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c406f800 con 0x7ff4c406be70 2023-10-06T11:13:17.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.966+0000 7ff4c2ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff4c406baa0 0x7ff4c406f0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:54702/0 (socket says 172.21.15.146:54702) 2023-10-06T11:13:17.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.966+0000 7ff4c2ffd700 1 -- 172.21.15.146:0/2326516366 learned_addr learned my addr 172.21.15.146:0/2326516366 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:13:17.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.966+0000 7ff4ba7fc700 1 --2- 172.21.15.146:0/2326516366 >> v2:172.21.15.151:3300/0 conn(0x7ff4c40c8520 0x7ff4c4155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:17.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.966+0000 7ff4c27fc700 1 -- 172.21.15.146:0/2326516366 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 592234269 0 0) 0x7ff4b4001110 con 0x7ff4c406baa0 2023-10-06T11:13:17.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.966+0000 7ff4c27fc700 1 -- 172.21.15.146:0/2326516366 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4b0003570 con 0x7ff4c406baa0 2023-10-06T11:13:17.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.966+0000 7ff4c37fe700 1 --2- 172.21.15.146:0/2326516366 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4c406be70 0x7ff4c4156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:17.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.967+0000 7ff4c27fc700 1 -- 172.21.15.146:0/2326516366 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2379135975 0 0) 0x7ff4b0003570 con 0x7ff4c406baa0 2023-10-06T11:13:17.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.967+0000 7ff4c27fc700 1 -- 172.21.15.146:0/2326516366 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4c406be70 msgr2=0x7ff4c4156280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:17.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.967+0000 7ff4c27fc700 1 --2- 172.21.15.146:0/2326516366 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4c406be70 0x7ff4c4156280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:17.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.967+0000 7ff4c27fc700 1 -- 172.21.15.146:0/2326516366 >> v2:172.21.15.151:3300/0 conn(0x7ff4c40c8520 msgr2=0x7ff4c4155d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:17.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.967+0000 7ff4c27fc700 1 --2- 172.21.15.146:0/2326516366 >> v2:172.21.15.151:3300/0 conn(0x7ff4c40c8520 0x7ff4c4155d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:17.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.967+0000 7ff4c27fc700 1 -- 172.21.15.146:0/2326516366 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c40c8a90 con 0x7ff4c406baa0 2023-10-06T11:13:17.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.967+0000 7ff4c27fc700 1 -- 172.21.15.146:0/2326516366 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7ff4b4001600 con 0x7ff4c406baa0 2023-10-06T11:13:17.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.967+0000 7ff4c27fc700 1 -- 172.21.15.146:0/2326516366 >> v1:172.21.15.146:6789/0 conn(0x7ff4c406baa0 legacy=0x7ff4c406f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:17.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.967+0000 7ff4c27fc700 1 --2- 172.21.15.146:0/2326516366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4b0003a60 0x7ff4b0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:17.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.967+0000 7ff4c27fc700 1 --2- 172.21.15.146:0/2326516366 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4c406be70 0x7ff4b0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:17.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.967+0000 7ff4c27fc700 1 --2- 172.21.15.146:0/2326516366 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4b0004d50 0x7ff4b00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:17.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.967+0000 7ff4c27fc700 1 -- 172.21.15.146:0/2326516366 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c40c96a0 con 0x7ff4b0003a60 2023-10-06T11:13:17.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.967+0000 7ff4c27fc700 1 -- 172.21.15.146:0/2326516366 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c406f800 con 0x7ff4b0004d50 2023-10-06T11:13:17.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.967+0000 7ff4c27fc700 1 -- 172.21.15.146:0/2326516366 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b000ba60 con 0x7ff4c406be70 2023-10-06T11:13:17.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.967+0000 7ff4c2ffd700 1 --2- 172.21.15.146:0/2326516366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4b0003a60 0x7ff4b0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:17.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.967+0000 7ff4ba7fc700 1 --2- 172.21.15.146:0/2326516366 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4c406be70 0x7ff4b0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:17.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.967+0000 7ff4c37fe700 1 --2- 172.21.15.146:0/2326516366 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4b0004d50 0x7ff4b00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:17.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.967+0000 7ff4c2ffd700 1 -- 172.21.15.146:0/2326516366 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4c406be70 msgr2=0x7ff4b0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:17.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.967+0000 7ff4c2ffd700 1 --2- 172.21.15.146:0/2326516366 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4c406be70 0x7ff4b0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:17.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.967+0000 7ff4c2ffd700 1 -- 172.21.15.146:0/2326516366 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4b0004d50 msgr2=0x7ff4b00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:17.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.967+0000 7ff4c2ffd700 1 --2- 172.21.15.146:0/2326516366 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4b0004d50 0x7ff4b00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:17.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.967+0000 7ff4c2ffd700 1 -- 172.21.15.146:0/2326516366 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b0003570 con 0x7ff4b0003a60 2023-10-06T11:13:17.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.967+0000 7ff4c2ffd700 1 --2- 172.21.15.146:0/2326516366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4b0003a60 0x7ff4b0003e70 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7ff4b400c5f0 tx=0x7ff4c40c9610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=206c1c90b1ded7d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:17.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.967+0000 7ff4c27fc700 1 -- 172.21.15.146:0/2326516366 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b400cd90 con 0x7ff4b0003a60 2023-10-06T11:13:17.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.968+0000 7ff4c27fc700 1 -- 172.21.15.146:0/2326516366 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b4005920 con 0x7ff4b0003a60 2023-10-06T11:13:17.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.968+0000 7ff4c27fc700 1 -- 172.21.15.146:0/2326516366 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4005ce0 con 0x7ff4b0003a60 2023-10-06T11:13:17.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.968+0000 7ff4c9a53700 1 -- 172.21.15.146:0/2326516366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4b0003a60 msgr2=0x7ff4b0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:17.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.968+0000 7ff4c9a53700 1 --2- 172.21.15.146:0/2326516366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4b0003a60 0x7ff4b0003e70 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7ff4b400c5f0 tx=0x7ff4c40c9610 comp rx=0 tx=0).stop 2023-10-06T11:13:17.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.968+0000 7ff4c37fe700 1 -- 172.21.15.146:0/2326516366 reap_dead start 2023-10-06T11:13:17.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.968+0000 7ff4c9a53700 1 -- 172.21.15.146:0/2326516366 shutdown_connections 2023-10-06T11:13:17.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.968+0000 7ff4c9a53700 1 -- 172.21.15.146:0/2326516366 >> 172.21.15.146:0/2326516366 conn(0x7ff4c406b040 msgr2=0x7ff4c40cd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:17.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.968+0000 7ff4c9a53700 1 -- 172.21.15.146:0/2326516366 shutdown_connections 2023-10-06T11:13:17.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.968+0000 7ff4c9a53700 1 -- 172.21.15.146:0/2326516366 wait complete. 2023-10-06T11:13:17.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.969+0000 7ff4c9a53700 1 Processor -- start 2023-10-06T11:13:17.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.969+0000 7ff4c9a53700 1 -- start start 2023-10-06T11:13:17.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.970+0000 7ff4c9a53700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4b0003a60 0x7ff4c41592f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:17.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.970+0000 7ff4c9a53700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4c40b1860 0x7ff4c40c4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:17.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.970+0000 7ff4c9a53700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4c40cc090 0x7ff4c40cc530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:17.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.970+0000 7ff4c9a53700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c40cca70 con 0x7ff4b0003a60 2023-10-06T11:13:17.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.970+0000 7ff4c9a53700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c40b2de0 con 0x7ff4c40cc090 2023-10-06T11:13:17.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.970+0000 7ff4c9a53700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c40b2950 con 0x7ff4c40b1860 2023-10-06T11:13:17.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.970+0000 7ff4c2ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4b0003a60 0x7ff4c41592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:17.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.970+0000 7ff4c2ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4b0003a60 0x7ff4c41592f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57004/0 (socket says 172.21.15.146:57004) 2023-10-06T11:13:17.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.970+0000 7ff4c2ffd700 1 -- 172.21.15.146:0/1647967421 learned_addr learned my addr 172.21.15.146:0/1647967421 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:17.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.970+0000 7ff4c37fe700 1 --2- 172.21.15.146:0/1647967421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4c40cc090 0x7ff4c40cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:17.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.970+0000 7ff4ba7fc700 1 --2- 172.21.15.146:0/1647967421 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4c40b1860 0x7ff4c40c4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:17.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.970+0000 7ff4c2ffd700 1 -- 172.21.15.146:0/1647967421 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4c40b1860 msgr2=0x7ff4c40c4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:17.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.970+0000 7ff4c2ffd700 1 --2- 172.21.15.146:0/1647967421 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4c40b1860 0x7ff4c40c4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:17.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.970+0000 7ff4c2ffd700 1 -- 172.21.15.146:0/1647967421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4c40cc090 msgr2=0x7ff4c40cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:17.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.970+0000 7ff4c2ffd700 1 --2- 172.21.15.146:0/1647967421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4c40cc090 0x7ff4c40cc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:17.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.970+0000 7ff4c2ffd700 1 -- 172.21.15.146:0/1647967421 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c40c47b0 con 0x7ff4b0003a60 2023-10-06T11:13:17.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.970+0000 7ff4ba7fc700 1 --2- 172.21.15.146:0/1647967421 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4c40b1860 0x7ff4c40c4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:17.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.971+0000 7ff4c2ffd700 1 --2- 172.21.15.146:0/1647967421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4b0003a60 0x7ff4c41592f0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4007ac0 tx=0x7ff4b4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:17.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.971+0000 7ff4bb7fe700 1 -- 172.21.15.146:0/1647967421 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b40015c0 con 0x7ff4b0003a60 2023-10-06T11:13:17.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.971+0000 7ff4bb7fe700 1 -- 172.21.15.146:0/1647967421 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b40072e0 con 0x7ff4b0003a60 2023-10-06T11:13:17.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.971+0000 7ff4bb7fe700 1 -- 172.21.15.146:0/1647967421 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b40076a0 con 0x7ff4b0003a60 2023-10-06T11:13:17.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.971+0000 7ff4c9a53700 1 -- 172.21.15.146:0/1647967421 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c40c7080 con 0x7ff4b0003a60 2023-10-06T11:13:17.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.971+0000 7ff4c9a53700 1 -- 172.21.15.146:0/1647967421 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c40b2020 con 0x7ff4b0003a60 2023-10-06T11:13:17.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.972+0000 7ff4c9a53700 1 -- 172.21.15.146:0/1647967421 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4c404bb40 con 0x7ff4b0003a60 2023-10-06T11:13:17.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.972+0000 7ff4bb7fe700 1 -- 172.21.15.146:0/1647967421 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff4b4019030 con 0x7ff4b0003a60 2023-10-06T11:13:17.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.972+0000 7ff4bb7fe700 1 --2- 172.21.15.146:0/1647967421 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff4a4066f30 0x7ff4a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:17.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.973+0000 7ff4bb7fe700 1 -- 172.21.15.146:0/1647967421 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff4b4085a40 con 0x7ff4b0003a60 2023-10-06T11:13:17.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.973+0000 7ff4ba7fc700 1 --2- 172.21.15.146:0/1647967421 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff4a4066f30 0x7ff4a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:17.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.973+0000 7ff4ba7fc700 1 --2- 172.21.15.146:0/1647967421 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff4a4066f30 0x7ff4a40693e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac00b6a0 tx=0x7ff4ac00b430 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:17.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:17.977+0000 7ff4bb7fe700 1 -- 172.21.15.146:0/1647967421 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff4b4087e60 con 0x7ff4b0003a60 2023-10-06T11:13:18.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.203+0000 7ff4c9a53700 1 -- 172.21.15.146:0/1647967421 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4c41567c0 con 0x7ff4b0003a60 2023-10-06T11:13:18.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.203+0000 7ff4bb7fe700 1 -- 172.21.15.146:0/1647967421 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4608 (secure 0 0 0) 0x7ff4c41567c0 con 0x7ff4b0003a60 2023-10-06T11:13:18.205 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:13:18.206 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":85,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6619,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/1915786440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1915786440},{"type":"v1","addr":"172.21.15.151:6834","nonce":1915786440}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7212,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2292999516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2292999516},{"type":"v1","addr":"172.21.15.146:6836","nonce":2292999516}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7215,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/905558084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":905558084},{"type":"v1","addr":"172.21.15.146:6837","nonce":905558084}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:12:45.107155+0000","modified":"2023-10-06T11:12:48.746860+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7227},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7227":{"gid":7227,"name":"d","rank":0,"incarnation":81,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6835/3868165725","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":3868165725},{"type":"v1","addr":"172.21.15.151:6835","nonce":3868165725}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-06T11:13:18.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.206+0000 7ff4c9a53700 1 -- 172.21.15.146:0/1647967421 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff4a4066f30 msgr2=0x7ff4a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:18.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.206+0000 7ff4c9a53700 1 --2- 172.21.15.146:0/1647967421 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff4a4066f30 0x7ff4a40693e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac00b6a0 tx=0x7ff4ac00b430 comp rx=0 tx=0).stop 2023-10-06T11:13:18.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.206+0000 7ff4c9a53700 1 -- 172.21.15.146:0/1647967421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4b0003a60 msgr2=0x7ff4c41592f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:18.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.206+0000 7ff4c9a53700 1 --2- 172.21.15.146:0/1647967421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4b0003a60 0x7ff4c41592f0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4007ac0 tx=0x7ff4b4015000 comp rx=0 tx=0).stop 2023-10-06T11:13:18.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.206+0000 7ff4c9a53700 1 -- 172.21.15.146:0/1647967421 shutdown_connections 2023-10-06T11:13:18.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.206+0000 7ff4c9a53700 1 --2- 172.21.15.146:0/1647967421 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff4a4066f30 0x7ff4a40693e0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.206+0000 7ff4c9a53700 1 --2- 172.21.15.146:0/1647967421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4c40cc090 0x7ff4c40cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.206+0000 7ff4c9a53700 1 --2- 172.21.15.146:0/1647967421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4b0003a60 0x7ff4c41592f0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.206+0000 7ff4c9a53700 1 --2- 172.21.15.146:0/1647967421 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4c40b1860 0x7ff4c40c4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.206+0000 7ff4c9a53700 1 -- 172.21.15.146:0/1647967421 >> 172.21.15.146:0/1647967421 conn(0x7ff4c406b040 msgr2=0x7ff4c40c2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:18.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.206+0000 7ff4c9a53700 1 -- 172.21.15.146:0/1647967421 shutdown_connections 2023-10-06T11:13:18.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.206+0000 7ff4c9a53700 1 -- 172.21.15.146:0/1647967421 wait complete. 2023-10-06T11:13:18.210 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 85 2023-10-06T11:13:18.220 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:13:18.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.332+0000 7fd6a9d47700 1 Processor -- start 2023-10-06T11:13:18.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.332+0000 7fd6a9d47700 1 -- start start 2023-10-06T11:13:18.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.333+0000 7fd6a9d47700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd6a415a7f0 0x7fd6a415cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:18.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.333+0000 7fd6a9d47700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6a40b2530 0x7fd6a415acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:18.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.333+0000 7fd6a9d47700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6a415c630 con 0x7fd6a415a420 2023-10-06T11:13:18.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.333+0000 7fd6a9d47700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6a40ce040 con 0x7fd6a415a7f0 2023-10-06T11:13:18.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.333+0000 7fd6a9d47700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a415ba20 con 0x7fd6a40b2530 2023-10-06T11:13:18.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.333+0000 7fd6a3fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd6a415a7f0 0x7fd6a415cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:18.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.333+0000 7fd6a8d45700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd6a415a420 0x7fd6a40b1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:54710/0 (socket says 172.21.15.146:54710) 2023-10-06T11:13:18.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.333+0000 7fd6a8d45700 1 -- 172.21.15.146:0/3012266176 learned_addr learned my addr 172.21.15.146:0/3012266176 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:13:18.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.333+0000 7fd6a9546700 1 --2- 172.21.15.146:0/3012266176 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6a40b2530 0x7fd6a415acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:18.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.333+0000 7fd6a3fff700 1 -- 172.21.15.146:0/3012266176 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6a40b2530 msgr2=0x7fd6a415acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:18.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.333+0000 7fd6a3fff700 1 --2- 172.21.15.146:0/3012266176 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6a40b2530 0x7fd6a415acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.333+0000 7fd6a3fff700 1 -- 172.21.15.146:0/3012266176 >> v1:172.21.15.146:6789/0 conn(0x7fd6a415a420 legacy=0x7fd6a40b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:18.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.333+0000 7fd6a3fff700 1 -- 172.21.15.146:0/3012266176 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a415bd00 con 0x7fd6a415a7f0 2023-10-06T11:13:18.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.333+0000 7fd6a37fe700 1 -- 172.21.15.146:0/3012266176 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1779294454 0 0) 0x7fd6a415c630 con 0x7fd6a415a420 2023-10-06T11:13:18.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.333+0000 7fd6a9546700 1 --2- 172.21.15.146:0/3012266176 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6a40b2530 0x7fd6a415acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:18.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.333+0000 7fd6a3fff700 1 --2- 172.21.15.146:0/3012266176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6a415a7f0 0x7fd6a415cac0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fd6940098e0 tx=0x7fd6940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40538995578e4ca6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:18.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.334+0000 7fd6a37fe700 1 -- 172.21.15.146:0/3012266176 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd694009e80 con 0x7fd6a415a7f0 2023-10-06T11:13:18.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.334+0000 7fd6a37fe700 1 -- 172.21.15.146:0/3012266176 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd69400b860 con 0x7fd6a415a7f0 2023-10-06T11:13:18.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.334+0000 7fd6a37fe700 1 -- 172.21.15.146:0/3012266176 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69400bbe0 con 0x7fd6a415a7f0 2023-10-06T11:13:18.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.334+0000 7fd6a9d47700 1 -- 172.21.15.146:0/3012266176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6a415a7f0 msgr2=0x7fd6a415cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:18.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.334+0000 7fd6a9d47700 1 --2- 172.21.15.146:0/3012266176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6a415a7f0 0x7fd6a415cac0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fd6940098e0 tx=0x7fd6940091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.334+0000 7fd6a9d47700 1 -- 172.21.15.146:0/3012266176 shutdown_connections 2023-10-06T11:13:18.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.334+0000 7fd6a9d47700 1 --2- 172.21.15.146:0/3012266176 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6a40b2530 0x7fd6a415acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.334+0000 7fd6a9d47700 1 --2- 172.21.15.146:0/3012266176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6a415a7f0 0x7fd6a415cac0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.334+0000 7fd6a9d47700 1 -- 172.21.15.146:0/3012266176 >> 172.21.15.146:0/3012266176 conn(0x7fd6a406eba0 msgr2=0x7fd6a406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:18.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.334+0000 7fd6a9d47700 1 -- 172.21.15.146:0/3012266176 shutdown_connections 2023-10-06T11:13:18.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.334+0000 7fd6a9d47700 1 -- 172.21.15.146:0/3012266176 wait complete. 2023-10-06T11:13:18.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.335+0000 7fd6a9d47700 1 Processor -- start 2023-10-06T11:13:18.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.336+0000 7fd6a9d47700 1 -- start start 2023-10-06T11:13:18.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.336+0000 7fd6a9d47700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6a40b2530 0x7fd6a413ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:18.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.336+0000 7fd6a9d47700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6a415a420 0x7fd6a414e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:18.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.336+0000 7fd6a9d47700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6a415a7f0 0x7fd6a414e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:18.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.336+0000 7fd6a9d47700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a4155af0 con 0x7fd6a40b2530 2023-10-06T11:13:18.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.336+0000 7fd6a9d47700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a4154ee0 con 0x7fd6a415a7f0 2023-10-06T11:13:18.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.336+0000 7fd6a9d47700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6a41551c0 con 0x7fd6a415a420 2023-10-06T11:13:18.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.336+0000 7fd6a8d45700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6a40b2530 0x7fd6a413ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:18.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.336+0000 7fd6a8d45700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6a40b2530 0x7fd6a413ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57020/0 (socket says 172.21.15.146:57020) 2023-10-06T11:13:18.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.336+0000 7fd6a8d45700 1 -- 172.21.15.146:0/304990193 learned_addr learned my addr 172.21.15.146:0/304990193 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:18.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.337+0000 7fd6a3fff700 1 --2- 172.21.15.146:0/304990193 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6a415a420 0x7fd6a414e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:18.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.337+0000 7fd6a9546700 1 --2- 172.21.15.146:0/304990193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6a415a7f0 0x7fd6a414e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:18.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.337+0000 7fd6a8d45700 1 -- 172.21.15.146:0/304990193 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6a415a420 msgr2=0x7fd6a414e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:18.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.337+0000 7fd6a8d45700 1 --2- 172.21.15.146:0/304990193 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6a415a420 0x7fd6a414e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.337+0000 7fd6a8d45700 1 -- 172.21.15.146:0/304990193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6a415a7f0 msgr2=0x7fd6a414e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:18.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.337+0000 7fd6a8d45700 1 --2- 172.21.15.146:0/304990193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6a415a7f0 0x7fd6a414e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.337+0000 7fd6a8d45700 1 -- 172.21.15.146:0/304990193 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd694009420 con 0x7fd6a40b2530 2023-10-06T11:13:18.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.337+0000 7fd6a9546700 1 --2- 172.21.15.146:0/304990193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6a415a7f0 0x7fd6a414e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:18.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.337+0000 7fd6a8d45700 1 --2- 172.21.15.146:0/304990193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6a40b2530 0x7fd6a413ed30 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fd69c00cd80 tx=0x7fd69c001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:18.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.337+0000 7fd6a0ff9700 1 -- 172.21.15.146:0/304990193 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69c00ab10 con 0x7fd6a40b2530 2023-10-06T11:13:18.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.337+0000 7fd6a0ff9700 1 -- 172.21.15.146:0/304990193 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd69c00ac70 con 0x7fd6a40b2530 2023-10-06T11:13:18.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.337+0000 7fd6a9d47700 1 -- 172.21.15.146:0/304990193 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6a41554a0 con 0x7fd6a40b2530 2023-10-06T11:13:18.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.337+0000 7fd6a0ff9700 1 -- 172.21.15.146:0/304990193 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69c0070f0 con 0x7fd6a40b2530 2023-10-06T11:13:18.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.337+0000 7fd6a9d47700 1 -- 172.21.15.146:0/304990193 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6a413f270 con 0x7fd6a40b2530 2023-10-06T11:13:18.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.338+0000 7fd6a9d47700 1 -- 172.21.15.146:0/304990193 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6a40afae0 con 0x7fd6a40b2530 2023-10-06T11:13:18.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.338+0000 7fd6a0ff9700 1 -- 172.21.15.146:0/304990193 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd69c0074e0 con 0x7fd6a40b2530 2023-10-06T11:13:18.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.339+0000 7fd6a0ff9700 1 --2- 172.21.15.146:0/304990193 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd684066f30 0x7fd6840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:18.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.339+0000 7fd6a0ff9700 1 -- 172.21.15.146:0/304990193 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd69c084c60 con 0x7fd6a40b2530 2023-10-06T11:13:18.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.339+0000 7fd6a3fff700 1 --2- 172.21.15.146:0/304990193 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd684066f30 0x7fd6840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:18.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.339+0000 7fd6a3fff700 1 --2- 172.21.15.146:0/304990193 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd684066f30 0x7fd6840693e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd6940091e0 tx=0x7fd694017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:18.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.343+0000 7fd6a0ff9700 1 -- 172.21.15.146:0/304990193 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd69c051d50 con 0x7fd6a40b2530 2023-10-06T11:13:18.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.528+0000 7fd6a9d47700 1 -- 172.21.15.146:0/304990193 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6a415bfe0 con 0x7fd6a40b2530 2023-10-06T11:13:18.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.529+0000 7fd6a0ff9700 1 -- 172.21.15.146:0/304990193 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+16917 (secure 0 0 0) 0x7fd69c055370 con 0x7fd6a40b2530 2023-10-06T11:13:18.531 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:13:18.532 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":89,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:12:46.364872+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:12:42.792405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2023-10-06T11:12:44.071743+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:13:18.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.531+0000 7fd6a9d47700 1 -- 172.21.15.146:0/304990193 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd684066f30 msgr2=0x7fd6840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:18.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.531+0000 7fd6a9d47700 1 --2- 172.21.15.146:0/304990193 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd684066f30 0x7fd6840693e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fd6940091e0 tx=0x7fd694017000 comp rx=0 tx=0).stop 2023-10-06T11:13:18.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.531+0000 7fd6a9d47700 1 -- 172.21.15.146:0/304990193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6a40b2530 msgr2=0x7fd6a413ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:18.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.531+0000 7fd6a9d47700 1 --2- 172.21.15.146:0/304990193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6a40b2530 0x7fd6a413ed30 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fd69c00cd80 tx=0x7fd69c001ae0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.531+0000 7fd6a9d47700 1 -- 172.21.15.146:0/304990193 shutdown_connections 2023-10-06T11:13:18.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.531+0000 7fd6a9d47700 1 --2- 172.21.15.146:0/304990193 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd684066f30 0x7fd6840693e0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.531+0000 7fd6a9d47700 1 --2- 172.21.15.146:0/304990193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6a415a7f0 0x7fd6a414e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.531+0000 7fd6a9d47700 1 --2- 172.21.15.146:0/304990193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6a40b2530 0x7fd6a413ed30 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.531+0000 7fd6a9d47700 1 --2- 172.21.15.146:0/304990193 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6a415a420 0x7fd6a414e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.531+0000 7fd6a9d47700 1 -- 172.21.15.146:0/304990193 >> 172.21.15.146:0/304990193 conn(0x7fd6a406eba0 msgr2=0x7fd6a414d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:18.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.531+0000 7fd6a9d47700 1 -- 172.21.15.146:0/304990193 shutdown_connections 2023-10-06T11:13:18.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.531+0000 7fd6a9d47700 1 -- 172.21.15.146:0/304990193 wait complete. 2023-10-06T11:13:18.546 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T11:13:18.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.662+0000 7fc07fe5c700 1 Processor -- start 2023-10-06T11:13:18.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.662+0000 7fc07fe5c700 1 -- start start 2023-10-06T11:13:18.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.663+0000 7fc07fe5c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc07815a160 0x7fc0780c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:18.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.663+0000 7fc07fe5c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc0780cb950 0x7fc0780cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:18.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.663+0000 7fc07fe5c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0780ae2a0 con 0x7fc0780ae730 2023-10-06T11:13:18.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.663+0000 7fc07fe5c700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc07815a530 con 0x7fc0780cb950 2023-10-06T11:13:18.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.663+0000 7fc07fe5c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0780ad690 con 0x7fc07815a160 2023-10-06T11:13:18.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.663+0000 7fc07d3f7700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc0780ae730 0x7fc0780aeb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:54726/0 (socket says 172.21.15.146:54726) 2023-10-06T11:13:18.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.663+0000 7fc07d3f7700 1 -- 172.21.15.146:0/2147381297 learned_addr learned my addr 172.21.15.146:0/2147381297 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:13:18.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.664+0000 7fc07dbf8700 1 --2- 172.21.15.146:0/2147381297 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc07815a160 0x7fc0780c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:18.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.664+0000 7fc07e3f9700 1 --2- 172.21.15.146:0/2147381297 >> v2:172.21.15.151:3300/0 conn(0x7fc0780cb950 0x7fc0780cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:18.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.664+0000 7fc07cbf6700 1 -- 172.21.15.146:0/2147381297 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 50947362 0 0) 0x7fc0780ae2a0 con 0x7fc0780ae730 2023-10-06T11:13:18.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.664+0000 7fc07cbf6700 1 -- 172.21.15.146:0/2147381297 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc064003570 con 0x7fc0780ae730 2023-10-06T11:13:18.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.664+0000 7fc07cbf6700 1 -- 172.21.15.146:0/2147381297 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2440393864 0 0) 0x7fc064003570 con 0x7fc0780ae730 2023-10-06T11:13:18.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.664+0000 7fc07cbf6700 1 -- 172.21.15.146:0/2147381297 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc07815a160 msgr2=0x7fc0780c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:18.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.664+0000 7fc07cbf6700 1 --2- 172.21.15.146:0/2147381297 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc07815a160 0x7fc0780c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.664+0000 7fc07cbf6700 1 -- 172.21.15.146:0/2147381297 >> v2:172.21.15.151:3300/0 conn(0x7fc0780cb950 msgr2=0x7fc0780cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:18.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.664+0000 7fc07cbf6700 1 --2- 172.21.15.146:0/2147381297 >> v2:172.21.15.151:3300/0 conn(0x7fc0780cb950 0x7fc0780cbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.664+0000 7fc07cbf6700 1 -- 172.21.15.146:0/2147381297 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0780ad970 con 0x7fc0780ae730 2023-10-06T11:13:18.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.664+0000 7fc07cbf6700 1 -- 172.21.15.146:0/2147381297 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fc068001470 con 0x7fc0780ae730 2023-10-06T11:13:18.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.664+0000 7fc07cbf6700 1 -- 172.21.15.146:0/2147381297 >> v1:172.21.15.146:6789/0 conn(0x7fc0780ae730 legacy=0x7fc0780aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:18.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.664+0000 7fc07cbf6700 1 --2- 172.21.15.146:0/2147381297 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc064003a60 0x7fc064003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:18.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.664+0000 7fc07cbf6700 1 --2- 172.21.15.146:0/2147381297 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc07815a160 0x7fc064004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:18.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.664+0000 7fc07cbf6700 1 --2- 172.21.15.146:0/2147381297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc064004d50 0x7fc0640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:18.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.664+0000 7fc07cbf6700 1 -- 172.21.15.146:0/2147381297 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07815a530 con 0x7fc064003a60 2023-10-06T11:13:18.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.664+0000 7fc07cbf6700 1 -- 172.21.15.146:0/2147381297 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0780ad690 con 0x7fc064004d50 2023-10-06T11:13:18.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.664+0000 7fc07cbf6700 1 -- 172.21.15.146:0/2147381297 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc06400ba60 con 0x7fc07815a160 2023-10-06T11:13:18.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.664+0000 7fc07dbf8700 1 --2- 172.21.15.146:0/2147381297 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc064003a60 0x7fc064003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:18.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.664+0000 7fc07d3f7700 1 --2- 172.21.15.146:0/2147381297 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc07815a160 0x7fc064004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:18.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.664+0000 7fc07e3f9700 1 --2- 172.21.15.146:0/2147381297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc064004d50 0x7fc0640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:18.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.664+0000 7fc07dbf8700 1 -- 172.21.15.146:0/2147381297 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc07815a160 msgr2=0x7fc064004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:18.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.664+0000 7fc07dbf8700 1 --2- 172.21.15.146:0/2147381297 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc07815a160 0x7fc064004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.664+0000 7fc07dbf8700 1 -- 172.21.15.146:0/2147381297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc064004d50 msgr2=0x7fc0640051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:18.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.664+0000 7fc07dbf8700 1 --2- 172.21.15.146:0/2147381297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc064004d50 0x7fc0640051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.664+0000 7fc07dbf8700 1 -- 172.21.15.146:0/2147381297 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc064003570 con 0x7fc064003a60 2023-10-06T11:13:18.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.664+0000 7fc07d3f7700 1 --2- 172.21.15.146:0/2147381297 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc07815a160 0x7fc064004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:18.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.664+0000 7fc07e3f9700 1 --2- 172.21.15.146:0/2147381297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc064004d50 0x7fc0640051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:18.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.664+0000 7fc07dbf8700 1 --2- 172.21.15.146:0/2147381297 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc064003a60 0x7fc064003e70 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fc074009bf0 tx=0x7fc074009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df5070c936fb2c4d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:18.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.665+0000 7fc07cbf6700 1 -- 172.21.15.146:0/2147381297 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc074005a00 con 0x7fc064003a60 2023-10-06T11:13:18.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.665+0000 7fc07cbf6700 1 -- 172.21.15.146:0/2147381297 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc074005b60 con 0x7fc064003a60 2023-10-06T11:13:18.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.665+0000 7fc07cbf6700 1 -- 172.21.15.146:0/2147381297 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07400e6b0 con 0x7fc064003a60 2023-10-06T11:13:18.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.665+0000 7fc07fe5c700 1 -- 172.21.15.146:0/2147381297 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc064003a60 msgr2=0x7fc064003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:18.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.665+0000 7fc07fe5c700 1 --2- 172.21.15.146:0/2147381297 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc064003a60 0x7fc064003e70 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fc074009bf0 tx=0x7fc074009120 comp rx=0 tx=0).stop 2023-10-06T11:13:18.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.665+0000 7fc07e3f9700 1 -- 172.21.15.146:0/2147381297 reap_dead start 2023-10-06T11:13:18.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.665+0000 7fc07fe5c700 1 -- 172.21.15.146:0/2147381297 shutdown_connections 2023-10-06T11:13:18.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.665+0000 7fc07fe5c700 1 -- 172.21.15.146:0/2147381297 >> 172.21.15.146:0/2147381297 conn(0x7fc07806f380 msgr2=0x7fc0780d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:18.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.665+0000 7fc07fe5c700 1 -- 172.21.15.146:0/2147381297 shutdown_connections 2023-10-06T11:13:18.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.665+0000 7fc07fe5c700 1 -- 172.21.15.146:0/2147381297 wait complete. 2023-10-06T11:13:18.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.666+0000 7fc07fe5c700 1 Processor -- start 2023-10-06T11:13:18.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.666+0000 7fc07fe5c700 1 -- start start 2023-10-06T11:13:18.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.667+0000 7fc07fe5c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc064003a60 0x7fc0780b0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:18.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.667+0000 7fc07fe5c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0780b0c60 0x7fc0780b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:18.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.667+0000 7fc07fe5c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc07816b160 0x7fc0780b1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:18.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.667+0000 7fc07fe5c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0780af780 con 0x7fc0780b0c60 2023-10-06T11:13:18.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.667+0000 7fc07fe5c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0780b6300 con 0x7fc07816b160 2023-10-06T11:13:18.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.667+0000 7fc07fe5c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0780affc0 con 0x7fc064003a60 2023-10-06T11:13:18.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.667+0000 7fc07d3f7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0780b0c60 0x7fc0780b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:18.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.667+0000 7fc07d3f7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0780b0c60 0x7fc0780b4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57052/0 (socket says 172.21.15.146:57052) 2023-10-06T11:13:18.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.667+0000 7fc07d3f7700 1 -- 172.21.15.146:0/2757503641 learned_addr learned my addr 172.21.15.146:0/2757503641 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:18.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.667+0000 7fc07e3f9700 1 --2- 172.21.15.146:0/2757503641 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc07816b160 0x7fc0780b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:18.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.667+0000 7fc07dbf8700 1 --2- 172.21.15.146:0/2757503641 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc064003a60 0x7fc0780b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:18.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.667+0000 7fc07d3f7700 1 -- 172.21.15.146:0/2757503641 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc064003a60 msgr2=0x7fc0780b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:18.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.667+0000 7fc07d3f7700 1 --2- 172.21.15.146:0/2757503641 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc064003a60 0x7fc0780b0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.667+0000 7fc07d3f7700 1 -- 172.21.15.146:0/2757503641 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc07816b160 msgr2=0x7fc0780b1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:18.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.667+0000 7fc07d3f7700 1 --2- 172.21.15.146:0/2757503641 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc07816b160 0x7fc0780b1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.667+0000 7fc07d3f7700 1 -- 172.21.15.146:0/2757503641 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0780b1160 con 0x7fc0780b0c60 2023-10-06T11:13:18.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.667+0000 7fc07e3f9700 1 --2- 172.21.15.146:0/2757503641 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc07816b160 0x7fc0780b1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:18.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.667+0000 7fc07dbf8700 1 --2- 172.21.15.146:0/2757503641 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc064003a60 0x7fc0780b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:18.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.667+0000 7fc07d3f7700 1 --2- 172.21.15.146:0/2757503641 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0780b0c60 0x7fc0780b4b30 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fc068001ed0 tx=0x7fc068001570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:18.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.668+0000 7fc06dffb700 1 -- 172.21.15.146:0/2757503641 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06800c7b0 con 0x7fc0780b0c60 2023-10-06T11:13:18.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.668+0000 7fc06dffb700 1 -- 172.21.15.146:0/2757503641 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06800c910 con 0x7fc0780b0c60 2023-10-06T11:13:18.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.668+0000 7fc07fe5c700 1 -- 172.21.15.146:0/2757503641 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0780af970 con 0x7fc0780b0c60 2023-10-06T11:13:18.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.668+0000 7fc06dffb700 1 -- 172.21.15.146:0/2757503641 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06800cc90 con 0x7fc0780b0c60 2023-10-06T11:13:18.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.668+0000 7fc07fe5c700 1 -- 172.21.15.146:0/2757503641 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc07816b5e0 con 0x7fc0780b0c60 2023-10-06T11:13:18.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.669+0000 7fc07fe5c700 1 -- 172.21.15.146:0/2757503641 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0780afe10 con 0x7fc0780b0c60 2023-10-06T11:13:18.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.669+0000 7fc06dffb700 1 -- 172.21.15.146:0/2757503641 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc06801d460 con 0x7fc0780b0c60 2023-10-06T11:13:18.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.669+0000 7fc06dffb700 1 --2- 172.21.15.146:0/2757503641 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc05c066f30 0x7fc05c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:18.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.670+0000 7fc06dffb700 1 -- 172.21.15.146:0/2757503641 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc068084730 con 0x7fc0780b0c60 2023-10-06T11:13:18.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.670+0000 7fc07dbf8700 1 --2- 172.21.15.146:0/2757503641 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc05c066f30 0x7fc05c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:18.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.670+0000 7fc07dbf8700 1 --2- 172.21.15.146:0/2757503641 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc05c066f30 0x7fc05c0693e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc074009160 tx=0x7fc074019000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:18.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.674+0000 7fc06dffb700 1 -- 172.21.15.146:0/2757503641 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc068051840 con 0x7fc0780b0c60 2023-10-06T11:13:18.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.900+0000 7fc07fe5c700 1 -- 172.21.15.146:0/2757503641 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc0780d1520 con 0x7fc0780b0c60 2023-10-06T11:13:18.902 INFO:tasks.ceph.mon.a.smithi146.stderr:2023-10-06T11:13:18.900+0000 7f011baa1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T11:13:18.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.907+0000 7fc06dffb700 1 -- 172.21.15.146:0/2757503641 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v86) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc068054e60 con 0x7fc0780b0c60 2023-10-06T11:13:18.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.909+0000 7fc07fe5c700 1 -- 172.21.15.146:0/2757503641 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc05c066f30 msgr2=0x7fc05c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:18.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.909+0000 7fc07fe5c700 1 --2- 172.21.15.146:0/2757503641 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc05c066f30 0x7fc05c0693e0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc074009160 tx=0x7fc074019000 comp rx=0 tx=0).stop 2023-10-06T11:13:18.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.909+0000 7fc07fe5c700 1 -- 172.21.15.146:0/2757503641 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0780b0c60 msgr2=0x7fc0780b4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:18.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.909+0000 7fc07fe5c700 1 --2- 172.21.15.146:0/2757503641 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0780b0c60 0x7fc0780b4b30 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fc068001ed0 tx=0x7fc068001570 comp rx=0 tx=0).stop 2023-10-06T11:13:18.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.909+0000 7fc07fe5c700 1 -- 172.21.15.146:0/2757503641 shutdown_connections 2023-10-06T11:13:18.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.909+0000 7fc07fe5c700 1 --2- 172.21.15.146:0/2757503641 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc05c066f30 0x7fc05c0693e0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.909+0000 7fc07fe5c700 1 --2- 172.21.15.146:0/2757503641 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc07816b160 0x7fc0780b1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.909+0000 7fc07fe5c700 1 --2- 172.21.15.146:0/2757503641 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc064003a60 0x7fc0780b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.909+0000 7fc07fe5c700 1 --2- 172.21.15.146:0/2757503641 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0780b0c60 0x7fc0780b4b30 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:18.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.909+0000 7fc07fe5c700 1 -- 172.21.15.146:0/2757503641 >> 172.21.15.146:0/2757503641 conn(0x7fc07806f380 msgr2=0x7fc078159570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:18.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.909+0000 7fc07fe5c700 1 -- 172.21.15.146:0/2757503641 shutdown_connections 2023-10-06T11:13:18.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:18.909+0000 7fc07fe5c700 1 -- 172.21.15.146:0/2757503641 wait complete. 2023-10-06T11:13:18.913 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T11:13:18.923 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T11:13:18.943 INFO:tasks.ceph.mds.d.smithi151.stdout:starting mds.d at 2023-10-06T11:13:19.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.042+0000 7fed5ffff700 1 Processor -- start 2023-10-06T11:13:19.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.042+0000 7fed5ffff700 1 -- start start 2023-10-06T11:13:19.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.043+0000 7fed5ffff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fed60142b00 0x7fed600c8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:19.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.043+0000 7fed5ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fed6006bd60 0x7fed6006cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:19.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.043+0000 7fed5ffff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed600c8db0 con 0x7fed60142ed0 2023-10-06T11:13:19.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.043+0000 7fed5ffff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed6006d8d0 con 0x7fed6006bd60 2023-10-06T11:13:19.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.043+0000 7fed5ffff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed60068720 con 0x7fed60142b00 2023-10-06T11:13:19.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.043+0000 7fed5f7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fed6006bd60 0x7fed6006cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:19.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.043+0000 7fed567fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fed60142ed0 0x7fed6006b650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:54742/0 (socket says 172.21.15.146:54742) 2023-10-06T11:13:19.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.043+0000 7fed567fc700 1 -- 172.21.15.146:0/778602354 learned_addr learned my addr 172.21.15.146:0/778602354 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:13:19.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.043+0000 7fed5effd700 1 --2- 172.21.15.146:0/778602354 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fed60142b00 0x7fed600c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:19.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.044+0000 7fed5f7fe700 1 -- 172.21.15.146:0/778602354 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fed60142b00 msgr2=0x7fed600c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:19.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.044+0000 7fed5f7fe700 1 --2- 172.21.15.146:0/778602354 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fed60142b00 0x7fed600c8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:19.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.044+0000 7fed5e7fc700 1 -- 172.21.15.146:0/778602354 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2296535883 0 0) 0x7fed600c8db0 con 0x7fed60142ed0 2023-10-06T11:13:19.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.044+0000 7fed5f7fe700 1 -- 172.21.15.146:0/778602354 >> v1:172.21.15.146:6789/0 conn(0x7fed60142ed0 legacy=0x7fed6006b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:19.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.044+0000 7fed5f7fe700 1 -- 172.21.15.146:0/778602354 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed60068a00 con 0x7fed6006bd60 2023-10-06T11:13:19.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.044+0000 7fed5effd700 1 --2- 172.21.15.146:0/778602354 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fed60142b00 0x7fed600c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:19.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.044+0000 7fed5f7fe700 1 --2- 172.21.15.146:0/778602354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed6006bd60 0x7fed6006cba0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fed58009e60 tx=0x7fed58009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ff4a3830c6507f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:19.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.044+0000 7fed5e7fc700 1 -- 172.21.15.146:0/778602354 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5800e070 con 0x7fed6006bd60 2023-10-06T11:13:19.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.044+0000 7fed5e7fc700 1 -- 172.21.15.146:0/778602354 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed5800bc30 con 0x7fed6006bd60 2023-10-06T11:13:19.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.044+0000 7fed5e7fc700 1 -- 172.21.15.146:0/778602354 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed58012430 con 0x7fed6006bd60 2023-10-06T11:13:19.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.044+0000 7fed5ffff700 1 -- 172.21.15.146:0/778602354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed6006bd60 msgr2=0x7fed6006cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:19.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.044+0000 7fed5ffff700 1 --2- 172.21.15.146:0/778602354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed6006bd60 0x7fed6006cba0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fed58009e60 tx=0x7fed58009780 comp rx=0 tx=0).stop 2023-10-06T11:13:19.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.044+0000 7fed5ffff700 1 -- 172.21.15.146:0/778602354 shutdown_connections 2023-10-06T11:13:19.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.044+0000 7fed5ffff700 1 --2- 172.21.15.146:0/778602354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed6006bd60 0x7fed6006cba0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:19.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.044+0000 7fed5ffff700 1 --2- 172.21.15.146:0/778602354 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fed60142b00 0x7fed600c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:19.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.044+0000 7fed5ffff700 1 -- 172.21.15.146:0/778602354 >> 172.21.15.146:0/778602354 conn(0x7fed600ce230 msgr2=0x7fed600ce630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:19.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.044+0000 7fed5ffff700 1 -- 172.21.15.146:0/778602354 shutdown_connections 2023-10-06T11:13:19.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.044+0000 7fed5ffff700 1 -- 172.21.15.146:0/778602354 wait complete. 2023-10-06T11:13:19.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.046+0000 7fed5ffff700 1 Processor -- start 2023-10-06T11:13:19.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.046+0000 7fed5ffff700 1 -- start start 2023-10-06T11:13:19.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.046+0000 7fed5ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed6006bd60 0x7fed600c52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:19.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.046+0000 7fed5ffff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fed60142b00 0x7fed60158d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:19.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.046+0000 7fed5ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed60142ed0 0x7fed6015c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:19.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.046+0000 7fed5ffff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed60169910 con 0x7fed60142ed0 2023-10-06T11:13:19.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.046+0000 7fed5ffff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed6016d310 con 0x7fed6006bd60 2023-10-06T11:13:19.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.046+0000 7fed5ffff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed6016d5f0 con 0x7fed60142b00 2023-10-06T11:13:19.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.047+0000 7fed5f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed60142ed0 0x7fed6015c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:19.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.047+0000 7fed5f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed60142ed0 0x7fed6015c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57068/0 (socket says 172.21.15.146:57068) 2023-10-06T11:13:19.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.047+0000 7fed5f7fe700 1 -- 172.21.15.146:0/1670645014 learned_addr learned my addr 172.21.15.146:0/1670645014 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:19.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.047+0000 7fed567fc700 1 --2- 172.21.15.146:0/1670645014 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fed60142b00 0x7fed60158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:19.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.047+0000 7fed5effd700 1 --2- 172.21.15.146:0/1670645014 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed6006bd60 0x7fed600c52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:19.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.047+0000 7fed5f7fe700 1 -- 172.21.15.146:0/1670645014 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fed60142b00 msgr2=0x7fed60158d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:19.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.047+0000 7fed5f7fe700 1 --2- 172.21.15.146:0/1670645014 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fed60142b00 0x7fed60158d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:19.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.047+0000 7fed5f7fe700 1 -- 172.21.15.146:0/1670645014 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed6006bd60 msgr2=0x7fed600c52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:19.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.047+0000 7fed5f7fe700 1 --2- 172.21.15.146:0/1670645014 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed6006bd60 0x7fed600c52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:19.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.047+0000 7fed5f7fe700 1 -- 172.21.15.146:0/1670645014 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed58009a20 con 0x7fed60142ed0 2023-10-06T11:13:19.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.047+0000 7fed5f7fe700 1 --2- 172.21.15.146:0/1670645014 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed60142ed0 0x7fed6015c5f0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fed58013000 tx=0x7fed58019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:19.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.047+0000 7fed577fe700 1 -- 172.21.15.146:0/1670645014 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed58027470 con 0x7fed60142ed0 2023-10-06T11:13:19.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.047+0000 7fed577fe700 1 -- 172.21.15.146:0/1670645014 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed580275d0 con 0x7fed60142ed0 2023-10-06T11:13:19.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.047+0000 7fed5ffff700 1 -- 172.21.15.146:0/1670645014 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed6016d8d0 con 0x7fed60142ed0 2023-10-06T11:13:19.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.047+0000 7fed577fe700 1 -- 172.21.15.146:0/1670645014 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed58027950 con 0x7fed60142ed0 2023-10-06T11:13:19.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.047+0000 7fed5ffff700 1 -- 172.21.15.146:0/1670645014 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed600c5820 con 0x7fed60142ed0 2023-10-06T11:13:19.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.048+0000 7fed5ffff700 1 -- 172.21.15.146:0/1670645014 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed6006eb80 con 0x7fed60142ed0 2023-10-06T11:13:19.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.049+0000 7fed577fe700 1 -- 172.21.15.146:0/1670645014 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fed58024070 con 0x7fed60142ed0 2023-10-06T11:13:19.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.049+0000 7fed577fe700 1 --2- 172.21.15.146:0/1670645014 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fed40066f30 0x7fed400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:19.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.049+0000 7fed5effd700 1 --2- 172.21.15.146:0/1670645014 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fed40066f30 0x7fed400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:19.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.049+0000 7fed577fe700 1 -- 172.21.15.146:0/1670645014 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fed58086d20 con 0x7fed60142ed0 2023-10-06T11:13:19.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.050+0000 7fed5effd700 1 --2- 172.21.15.146:0/1670645014 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fed40066f30 0x7fed400693e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fed50006f00 tx=0x7fed50008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:19.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.054+0000 7fed577fe700 1 -- 172.21.15.146:0/1670645014 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fed58053de0 con 0x7fed60142ed0 2023-10-06T11:13:19.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.281+0000 7fed5ffff700 1 -- 172.21.15.146:0/1670645014 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fed60068ce0 con 0x7fed60142ed0 2023-10-06T11:13:19.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.909+0000 7fed577fe700 1 -- 172.21.15.146:0/1670645014 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v87) v1 ==== 104+0+0 (secure 0 0 0) 0x7fed58057400 con 0x7fed60142ed0 2023-10-06T11:13:19.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.911+0000 7fed5ffff700 1 -- 172.21.15.146:0/1670645014 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fed40066f30 msgr2=0x7fed400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:19.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.911+0000 7fed5ffff700 1 --2- 172.21.15.146:0/1670645014 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fed40066f30 0x7fed400693e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fed50006f00 tx=0x7fed50008040 comp rx=0 tx=0).stop 2023-10-06T11:13:19.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.911+0000 7fed5ffff700 1 -- 172.21.15.146:0/1670645014 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed60142ed0 msgr2=0x7fed6015c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:19.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.911+0000 7fed5ffff700 1 --2- 172.21.15.146:0/1670645014 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed60142ed0 0x7fed6015c5f0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fed58013000 tx=0x7fed58019000 comp rx=0 tx=0).stop 2023-10-06T11:13:19.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.911+0000 7fed5ffff700 1 -- 172.21.15.146:0/1670645014 shutdown_connections 2023-10-06T11:13:19.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.911+0000 7fed5ffff700 1 --2- 172.21.15.146:0/1670645014 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fed40066f30 0x7fed400693e0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:19.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.911+0000 7fed5ffff700 1 --2- 172.21.15.146:0/1670645014 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fed60142ed0 0x7fed6015c5f0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:19.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.911+0000 7fed5ffff700 1 --2- 172.21.15.146:0/1670645014 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed6006bd60 0x7fed600c52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:19.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.911+0000 7fed5ffff700 1 --2- 172.21.15.146:0/1670645014 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fed60142b00 0x7fed60158d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:19.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.911+0000 7fed5ffff700 1 -- 172.21.15.146:0/1670645014 >> 172.21.15.146:0/1670645014 conn(0x7fed600ce230 msgr2=0x7fed600c30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:19.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.911+0000 7fed5ffff700 1 -- 172.21.15.146:0/1670645014 shutdown_connections 2023-10-06T11:13:19.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:19.911+0000 7fed5ffff700 1 -- 172.21.15.146:0/1670645014 wait complete. 2023-10-06T11:13:19.926 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T11:13:20.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.042+0000 7f18689cb700 1 Processor -- start 2023-10-06T11:13:20.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.042+0000 7f18689cb700 1 -- start start 2023-10-06T11:13:20.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.043+0000 7f18689cb700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18640cc960 0x7f1864164c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:20.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.043+0000 7f18689cb700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18640ae2a0 con 0x7f186415a160 2023-10-06T11:13:20.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.043+0000 7f18689cb700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f186415a530 con 0x7f18640ae730 2023-10-06T11:13:20.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.043+0000 7f18689cb700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18640ccdc0 con 0x7f18640cc960 2023-10-06T11:13:20.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.043+0000 7f186259c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f186415a160 0x7f18640c55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:54752/0 (socket says 172.21.15.146:54752) 2023-10-06T11:13:20.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.043+0000 7f186259c700 1 -- 172.21.15.146:0/705960483 learned_addr learned my addr 172.21.15.146:0/705960483 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:13:20.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.043+0000 7f1861d9b700 1 -- 172.21.15.146:0/705960483 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 509258509 0 0) 0x7f18640ae2a0 con 0x7f186415a160 2023-10-06T11:13:20.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.043+0000 7f1861d9b700 1 -- 172.21.15.146:0/705960483 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1850003570 con 0x7f186415a160 2023-10-06T11:13:20.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.044+0000 7f1862d9d700 1 --2- 172.21.15.146:0/705960483 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18640cc960 0x7f1864164c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:20.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.044+0000 7f1861d9b700 1 -- 172.21.15.146:0/705960483 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3256087376 0 0) 0x7f1850003570 con 0x7f186415a160 2023-10-06T11:13:20.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.044+0000 7f1861d9b700 1 -- 172.21.15.146:0/705960483 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18640cc960 msgr2=0x7f1864164c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:20.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.044+0000 7f1861d9b700 1 --2- 172.21.15.146:0/705960483 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18640cc960 0x7f1864164c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.044+0000 7f1861d9b700 1 -- 172.21.15.146:0/705960483 >> v1:172.21.15.151:6789/0 conn(0x7f18640ae730 legacy=0x7f18640aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:20.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.044+0000 7f1861d9b700 1 -- 172.21.15.146:0/705960483 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18640c5cb0 con 0x7f186415a160 2023-10-06T11:13:20.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.044+0000 7f1861d9b700 1 -- 172.21.15.146:0/705960483 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f18540015f0 con 0x7f186415a160 2023-10-06T11:13:20.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.044+0000 7f1861d9b700 1 -- 172.21.15.146:0/705960483 >> v1:172.21.15.146:6789/0 conn(0x7f186415a160 legacy=0x7f18640c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:20.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.044+0000 7f1861d9b700 1 --2- 172.21.15.146:0/705960483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1850003a90 0x7f1850003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:20.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.044+0000 7f1861d9b700 1 --2- 172.21.15.146:0/705960483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1850004810 0x7f1850004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:20.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.044+0000 7f1861d9b700 1 --2- 172.21.15.146:0/705960483 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18640cc960 0x7f1850005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:20.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.044+0000 7f1861d9b700 1 -- 172.21.15.146:0/705960483 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18640ccdc0 con 0x7f1850003a90 2023-10-06T11:13:20.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.044+0000 7f1861d9b700 1 -- 172.21.15.146:0/705960483 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185000bc20 con 0x7f1850004810 2023-10-06T11:13:20.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.044+0000 7f1861d9b700 1 -- 172.21.15.146:0/705960483 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185000bde0 con 0x7f18640cc960 2023-10-06T11:13:20.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.044+0000 7f186259c700 1 --2- 172.21.15.146:0/705960483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1850003a90 0x7f1850003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:20.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.044+0000 7f1862d9d700 1 --2- 172.21.15.146:0/705960483 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18640cc960 0x7f1850005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:20.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.044+0000 7f1859d9b700 1 --2- 172.21.15.146:0/705960483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1850004810 0x7f1850004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:20.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.044+0000 7f186259c700 1 -- 172.21.15.146:0/705960483 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18640cc960 msgr2=0x7f1850005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:20.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.044+0000 7f186259c700 1 --2- 172.21.15.146:0/705960483 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18640cc960 0x7f1850005290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.044+0000 7f186259c700 1 -- 172.21.15.146:0/705960483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1850004810 msgr2=0x7f1850004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:20.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.044+0000 7f186259c700 1 --2- 172.21.15.146:0/705960483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1850004810 0x7f1850004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.044+0000 7f186259c700 1 -- 172.21.15.146:0/705960483 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1850003570 con 0x7f1850003a90 2023-10-06T11:13:20.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.044+0000 7f1859d9b700 1 --2- 172.21.15.146:0/705960483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1850004810 0x7f1850004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:20.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.044+0000 7f186259c700 1 --2- 172.21.15.146:0/705960483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1850003a90 0x7f1850003ea0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f185400c390 tx=0x7f1854007920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e1691bf9f1d7d25 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:20.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.044+0000 7f1861d9b700 1 -- 172.21.15.146:0/705960483 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185400cc60 con 0x7f1850003a90 2023-10-06T11:13:20.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.044+0000 7f1861d9b700 1 -- 172.21.15.146:0/705960483 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185400cde0 con 0x7f1850003a90 2023-10-06T11:13:20.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.044+0000 7f1861d9b700 1 -- 172.21.15.146:0/705960483 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1854007320 con 0x7f1850003a90 2023-10-06T11:13:20.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.045+0000 7f18689cb700 1 -- 172.21.15.146:0/705960483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1850003a90 msgr2=0x7f1850003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:20.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.045+0000 7f18689cb700 1 --2- 172.21.15.146:0/705960483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1850003a90 0x7f1850003ea0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f185400c390 tx=0x7f1854007920 comp rx=0 tx=0).stop 2023-10-06T11:13:20.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.045+0000 7f1862d9d700 1 -- 172.21.15.146:0/705960483 reap_dead start 2023-10-06T11:13:20.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.045+0000 7f18689cb700 1 -- 172.21.15.146:0/705960483 shutdown_connections 2023-10-06T11:13:20.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.045+0000 7f18689cb700 1 -- 172.21.15.146:0/705960483 >> 172.21.15.146:0/705960483 conn(0x7f186406f380 msgr2=0x7f18640d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:20.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.045+0000 7f18689cb700 1 -- 172.21.15.146:0/705960483 shutdown_connections 2023-10-06T11:13:20.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.045+0000 7f18689cb700 1 -- 172.21.15.146:0/705960483 wait complete. 2023-10-06T11:13:20.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.046+0000 7f18689cb700 1 Processor -- start 2023-10-06T11:13:20.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.046+0000 7f18689cb700 1 -- start start 2023-10-06T11:13:20.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.047+0000 7f18689cb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1850003a90 0x7f18640c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:20.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.047+0000 7f18689cb700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f186415f8a0 0x7f186414c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:20.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.047+0000 7f18689cb700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f186415b6e0 0x7f186415bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:20.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.047+0000 7f18689cb700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18640caa20 con 0x7f1850003a90 2023-10-06T11:13:20.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.047+0000 7f18689cb700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186415c060 con 0x7f186415b6e0 2023-10-06T11:13:20.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.047+0000 7f18689cb700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18640ca740 con 0x7f186415f8a0 2023-10-06T11:13:20.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.047+0000 7f186259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1850003a90 0x7f18640c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:20.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.047+0000 7f186259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1850003a90 0x7f18640c9df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57092/0 (socket says 172.21.15.146:57092) 2023-10-06T11:13:20.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.047+0000 7f186259c700 1 -- 172.21.15.146:0/3657090858 learned_addr learned my addr 172.21.15.146:0/3657090858 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:20.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.047+0000 7f1859d9b700 1 --2- 172.21.15.146:0/3657090858 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f186415f8a0 0x7f186414c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:20.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.047+0000 7f1862d9d700 1 --2- 172.21.15.146:0/3657090858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f186415b6e0 0x7f186415bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:20.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.047+0000 7f186259c700 1 -- 172.21.15.146:0/3657090858 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f186415f8a0 msgr2=0x7f186414c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:20.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.047+0000 7f186259c700 1 --2- 172.21.15.146:0/3657090858 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f186415f8a0 0x7f186414c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.047+0000 7f186259c700 1 -- 172.21.15.146:0/3657090858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f186415b6e0 msgr2=0x7f186415bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:20.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.047+0000 7f186259c700 1 --2- 172.21.15.146:0/3657090858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f186415b6e0 0x7f186415bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.047+0000 7f186259c700 1 -- 172.21.15.146:0/3657090858 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f186415d740 con 0x7f1850003a90 2023-10-06T11:13:20.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.047+0000 7f1862d9d700 1 --2- 172.21.15.146:0/3657090858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f186415b6e0 0x7f186415bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:20.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.047+0000 7f1859d9b700 1 --2- 172.21.15.146:0/3657090858 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f186415f8a0 0x7f186414c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:20.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.047+0000 7f186259c700 1 --2- 172.21.15.146:0/3657090858 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1850003a90 0x7f18640c9df0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f1854000ef0 tx=0x7f1854015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:20.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.048+0000 7f185affd700 1 -- 172.21.15.146:0/3657090858 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185400c9b0 con 0x7f1850003a90 2023-10-06T11:13:20.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.048+0000 7f185affd700 1 -- 172.21.15.146:0/3657090858 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18540072e0 con 0x7f1850003a90 2023-10-06T11:13:20.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.048+0000 7f18689cb700 1 -- 172.21.15.146:0/3657090858 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f186415da20 con 0x7f1850003a90 2023-10-06T11:13:20.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.048+0000 7f185affd700 1 -- 172.21.15.146:0/3657090858 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1854005a40 con 0x7f1850003a90 2023-10-06T11:13:20.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.048+0000 7f18689cb700 1 -- 172.21.15.146:0/3657090858 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f186415e220 con 0x7f1850003a90 2023-10-06T11:13:20.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.049+0000 7f18689cb700 1 -- 172.21.15.146:0/3657090858 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f186415df40 con 0x7f1850003a90 2023-10-06T11:13:20.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.049+0000 7f185affd700 1 -- 172.21.15.146:0/3657090858 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1854019030 con 0x7f1850003a90 2023-10-06T11:13:20.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.049+0000 7f185affd700 1 --2- 172.21.15.146:0/3657090858 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1844066f30 0x7f18440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:20.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.049+0000 7f185affd700 1 -- 172.21.15.146:0/3657090858 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f18540859d0 con 0x7f1850003a90 2023-10-06T11:13:20.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.049+0000 7f1859d9b700 1 --2- 172.21.15.146:0/3657090858 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1844066f30 0x7f18440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:20.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.050+0000 7f1859d9b700 1 --2- 172.21.15.146:0/3657090858 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1844066f30 0x7f18440693e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f184c007a80 tx=0x7f184c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:20.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.054+0000 7f185affd700 1 -- 172.21.15.146:0/3657090858 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f186415df40 con 0x7f1850003a90 2023-10-06T11:13:20.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.238+0000 7f18689cb700 1 -- 172.21.15.146:0/3657090858 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f18640caa20 con 0x7f1850003a90 2023-10-06T11:13:20.881 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:13:20.884 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:13:20.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.911+0000 7f185affd700 1 -- 172.21.15.146:0/3657090858 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v91) v1 ==== 181+0+0 (secure 0 0 0) 0x7f18540565a0 con 0x7f1850003a90 2023-10-06T11:13:20.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.914+0000 7f18689cb700 1 -- 172.21.15.146:0/3657090858 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1844066f30 msgr2=0x7f18440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:20.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.914+0000 7f18689cb700 1 --2- 172.21.15.146:0/3657090858 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1844066f30 0x7f18440693e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f184c007a80 tx=0x7f184c009040 comp rx=0 tx=0).stop 2023-10-06T11:13:20.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.915+0000 7f18689cb700 1 -- 172.21.15.146:0/3657090858 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1850003a90 msgr2=0x7f18640c9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:20.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.915+0000 7f18689cb700 1 --2- 172.21.15.146:0/3657090858 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1850003a90 0x7f18640c9df0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f1854000ef0 tx=0x7f1854015000 comp rx=0 tx=0).stop 2023-10-06T11:13:20.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.915+0000 7f18689cb700 1 -- 172.21.15.146:0/3657090858 shutdown_connections 2023-10-06T11:13:20.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.915+0000 7f18689cb700 1 --2- 172.21.15.146:0/3657090858 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1844066f30 0x7f18440693e0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.915+0000 7f18689cb700 1 --2- 172.21.15.146:0/3657090858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f186415b6e0 0x7f186415bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.915+0000 7f18689cb700 1 --2- 172.21.15.146:0/3657090858 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1850003a90 0x7f18640c9df0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.915+0000 7f18689cb700 1 --2- 172.21.15.146:0/3657090858 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f186415f8a0 0x7f186414c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:20.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.915+0000 7f18689cb700 1 -- 172.21.15.146:0/3657090858 >> 172.21.15.146:0/3657090858 conn(0x7f186406f380 msgr2=0x7f18640685e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:20.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.915+0000 7f18689cb700 1 -- 172.21.15.146:0/3657090858 shutdown_connections 2023-10-06T11:13:20.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:20.915+0000 7f18689cb700 1 -- 172.21.15.146:0/3657090858 wait complete. 2023-10-06T11:13:20.918 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' removed 2023-10-06T11:13:20.929 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T11:13:21.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.108+0000 7f4d67fff700 1 Processor -- start 2023-10-06T11:13:21.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.108+0000 7f4d67fff700 1 -- start start 2023-10-06T11:13:21.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.109+0000 7f4d67fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d68068780 0x7f4d68068b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:21.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.109+0000 7f4d67fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d680cc130 con 0x7f4d680b5640 2023-10-06T11:13:21.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.109+0000 7f4d67fff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d680cccd0 con 0x7f4d680cb090 2023-10-06T11:13:21.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.109+0000 7f4d67fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d680b2660 con 0x7f4d68068780 2023-10-06T11:13:21.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.109+0000 7f4d66ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4d680b5640 0x7f4d6815a870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:54768/0 (socket says 172.21.15.146:54768) 2023-10-06T11:13:21.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.109+0000 7f4d66ffd700 1 -- 172.21.15.146:0/2499130776 learned_addr learned my addr 172.21.15.146:0/2499130776 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:13:21.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.109+0000 7f4d677fe700 1 --2- 172.21.15.146:0/2499130776 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d68068780 0x7f4d68068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:21.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.109+0000 7f4d65ffb700 1 -- 172.21.15.146:0/2499130776 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1204613971 0 0) 0x7f4d680cc130 con 0x7f4d680b5640 2023-10-06T11:13:21.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.109+0000 7f4d65ffb700 1 -- 172.21.15.146:0/2499130776 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d50003570 con 0x7f4d680b5640 2023-10-06T11:13:21.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.109+0000 7f4d65ffb700 1 -- 172.21.15.146:0/2499130776 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3232390562 0 0) 0x7f4d680cccd0 con 0x7f4d680cb090 2023-10-06T11:13:21.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.109+0000 7f4d65ffb700 1 -- 172.21.15.146:0/2499130776 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d680cc130 con 0x7f4d680cb090 2023-10-06T11:13:21.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.109+0000 7f4d65ffb700 1 -- 172.21.15.146:0/2499130776 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1638929367 0 0) 0x7f4d50003570 con 0x7f4d680b5640 2023-10-06T11:13:21.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.109+0000 7f4d65ffb700 1 -- 172.21.15.146:0/2499130776 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d68068780 msgr2=0x7f4d68068b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:21.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.109+0000 7f4d65ffb700 1 --2- 172.21.15.146:0/2499130776 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d68068780 0x7f4d68068b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:21.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.109+0000 7f4d65ffb700 1 -- 172.21.15.146:0/2499130776 >> v1:172.21.15.151:6789/0 conn(0x7f4d680cb090 legacy=0x7f4d680cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:21.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.109+0000 7f4d65ffb700 1 -- 172.21.15.146:0/2499130776 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d680690d0 con 0x7f4d680b5640 2023-10-06T11:13:21.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.109+0000 7f4d65ffb700 1 -- 172.21.15.146:0/2499130776 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f4d60001470 con 0x7f4d680b5640 2023-10-06T11:13:21.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.109+0000 7f4d65ffb700 1 -- 172.21.15.146:0/2499130776 >> v1:172.21.15.146:6789/0 conn(0x7f4d680b5640 legacy=0x7f4d6815a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:21.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.109+0000 7f4d65ffb700 1 --2- 172.21.15.146:0/2499130776 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d68068780 0x7f4d50003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:21.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.109+0000 7f4d65ffb700 1 --2- 172.21.15.146:0/2499130776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d500041d0 0x7f4d50004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:21.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.109+0000 7f4d65ffb700 1 --2- 172.21.15.146:0/2499130776 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d50004d50 0x7f4d500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:21.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.109+0000 7f4d65ffb700 1 -- 172.21.15.146:0/2499130776 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d680b2660 con 0x7f4d500041d0 2023-10-06T11:13:21.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.109+0000 7f4d65ffb700 1 -- 172.21.15.146:0/2499130776 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5000bbf0 con 0x7f4d50004d50 2023-10-06T11:13:21.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.109+0000 7f4d65ffb700 1 -- 172.21.15.146:0/2499130776 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5000bdb0 con 0x7f4d68068780 2023-10-06T11:13:21.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.110+0000 7f4d66ffd700 1 --2- 172.21.15.146:0/2499130776 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d68068780 0x7f4d50003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:21.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.110+0000 7f4d667fc700 1 --2- 172.21.15.146:0/2499130776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d500041d0 0x7f4d50004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:21.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.110+0000 7f4d677fe700 1 --2- 172.21.15.146:0/2499130776 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d50004d50 0x7f4d500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:21.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.110+0000 7f4d66ffd700 1 -- 172.21.15.146:0/2499130776 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d50004d50 msgr2=0x7f4d500051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:21.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.110+0000 7f4d66ffd700 1 --2- 172.21.15.146:0/2499130776 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d50004d50 0x7f4d500051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:21.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.110+0000 7f4d66ffd700 1 -- 172.21.15.146:0/2499130776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d500041d0 msgr2=0x7f4d50004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:21.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.110+0000 7f4d66ffd700 1 --2- 172.21.15.146:0/2499130776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d500041d0 0x7f4d50004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:21.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.110+0000 7f4d66ffd700 1 -- 172.21.15.146:0/2499130776 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d50003570 con 0x7f4d68068780 2023-10-06T11:13:21.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.110+0000 7f4d667fc700 1 --2- 172.21.15.146:0/2499130776 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d500041d0 0x7f4d50004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:13:21.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.110+0000 7f4d66ffd700 1 --2- 172.21.15.146:0/2499130776 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d68068780 0x7f4d50003c20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4d6000c210 tx=0x7f4d60001d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54ab9cafcacab853 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:21.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.110+0000 7f4d65ffb700 1 -- 172.21.15.146:0/2499130776 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6000cc10 con 0x7f4d68068780 2023-10-06T11:13:21.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.110+0000 7f4d65ffb700 1 -- 172.21.15.146:0/2499130776 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d6000cd70 con 0x7f4d68068780 2023-10-06T11:13:21.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.110+0000 7f4d65ffb700 1 -- 172.21.15.146:0/2499130776 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d60005b70 con 0x7f4d68068780 2023-10-06T11:13:21.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.111+0000 7f4d67fff700 1 -- 172.21.15.146:0/2499130776 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d68068780 msgr2=0x7f4d50003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:21.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.111+0000 7f4d67fff700 1 --2- 172.21.15.146:0/2499130776 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d68068780 0x7f4d50003c20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4d6000c210 tx=0x7f4d60001d40 comp rx=0 tx=0).stop 2023-10-06T11:13:21.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.111+0000 7f4d677fe700 1 -- 172.21.15.146:0/2499130776 reap_dead start 2023-10-06T11:13:21.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.111+0000 7f4d67fff700 1 -- 172.21.15.146:0/2499130776 shutdown_connections 2023-10-06T11:13:21.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.111+0000 7f4d67fff700 1 -- 172.21.15.146:0/2499130776 >> 172.21.15.146:0/2499130776 conn(0x7f4d680703f0 msgr2=0x7f4d680707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:21.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.111+0000 7f4d67fff700 1 -- 172.21.15.146:0/2499130776 shutdown_connections 2023-10-06T11:13:21.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.111+0000 7f4d67fff700 1 -- 172.21.15.146:0/2499130776 wait complete. 2023-10-06T11:13:21.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.112+0000 7f4d67fff700 1 Processor -- start 2023-10-06T11:13:21.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.112+0000 7f4d67fff700 1 -- start start 2023-10-06T11:13:21.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.113+0000 7f4d67fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d68068780 0x7f4d680c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:21.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.113+0000 7f4d67fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d680c4450 0x7f4d680c2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:21.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.113+0000 7f4d67fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d680b3ab0 0x7f4d680b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:21.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.113+0000 7f4d67fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d680b4490 con 0x7f4d680c4450 2023-10-06T11:13:21.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.113+0000 7f4d67fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d680c3a80 con 0x7f4d680b3ab0 2023-10-06T11:13:21.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.113+0000 7f4d67fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d680c3d60 con 0x7f4d68068780 2023-10-06T11:13:21.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.113+0000 7f4d667fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d680c4450 0x7f4d680c2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:21.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.113+0000 7f4d667fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d680c4450 0x7f4d680c2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57112/0 (socket says 172.21.15.146:57112) 2023-10-06T11:13:21.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.113+0000 7f4d667fc700 1 -- 172.21.15.146:0/1397904903 learned_addr learned my addr 172.21.15.146:0/1397904903 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:21.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.113+0000 7f4d677fe700 1 --2- 172.21.15.146:0/1397904903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d680b3ab0 0x7f4d680b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:21.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.113+0000 7f4d66ffd700 1 --2- 172.21.15.146:0/1397904903 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d68068780 0x7f4d680c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:21.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.113+0000 7f4d667fc700 1 -- 172.21.15.146:0/1397904903 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d68068780 msgr2=0x7f4d680c6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:21.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.113+0000 7f4d667fc700 1 --2- 172.21.15.146:0/1397904903 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d68068780 0x7f4d680c6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:21.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.113+0000 7f4d667fc700 1 -- 172.21.15.146:0/1397904903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d680b3ab0 msgr2=0x7f4d680b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:21.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.113+0000 7f4d667fc700 1 --2- 172.21.15.146:0/1397904903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d680b3ab0 0x7f4d680b3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:21.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.113+0000 7f4d667fc700 1 -- 172.21.15.146:0/1397904903 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d680c4040 con 0x7f4d680c4450 2023-10-06T11:13:21.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.113+0000 7f4d667fc700 1 --2- 172.21.15.146:0/1397904903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d680c4450 0x7f4d680c2f80 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c00fc00 tx=0x7f4d5c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:21.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.114+0000 7f4d4effd700 1 -- 172.21.15.146:0/1397904903 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c002770 con 0x7f4d680c4450 2023-10-06T11:13:21.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.114+0000 7f4d4effd700 1 -- 172.21.15.146:0/1397904903 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d5c006820 con 0x7f4d680c4450 2023-10-06T11:13:21.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.114+0000 7f4d67fff700 1 -- 172.21.15.146:0/1397904903 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d68150a30 con 0x7f4d680c4450 2023-10-06T11:13:21.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.114+0000 7f4d4effd700 1 -- 172.21.15.146:0/1397904903 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d5c006be0 con 0x7f4d680c4450 2023-10-06T11:13:21.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.114+0000 7f4d67fff700 1 -- 172.21.15.146:0/1397904903 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d680c34c0 con 0x7f4d680c4450 2023-10-06T11:13:21.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.115+0000 7f4d67fff700 1 -- 172.21.15.146:0/1397904903 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d68150890 con 0x7f4d680c4450 2023-10-06T11:13:21.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.115+0000 7f4d4effd700 1 -- 172.21.15.146:0/1397904903 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4d5c007020 con 0x7f4d680c4450 2023-10-06T11:13:21.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.115+0000 7f4d4effd700 1 --2- 172.21.15.146:0/1397904903 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4d54066f30 0x7f4d540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:21.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.116+0000 7f4d66ffd700 1 --2- 172.21.15.146:0/1397904903 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4d54066f30 0x7f4d540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:21.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.116+0000 7f4d4effd700 1 -- 172.21.15.146:0/1397904903 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f4d5c0843f0 con 0x7f4d680c4450 2023-10-06T11:13:21.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.116+0000 7f4d66ffd700 1 --2- 172.21.15.146:0/1397904903 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4d54066f30 0x7f4d540693e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4d60007ec0 tx=0x7f4d60015000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:21.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.120+0000 7f4d4effd700 1 -- 172.21.15.146:0/1397904903 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4d68150890 con 0x7f4d680c4450 2023-10-06T11:13:21.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.303+0000 7f4d67fff700 1 -- 172.21.15.146:0/1397904903 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4d68150890 con 0x7f4d680c4450 2023-10-06T11:13:21.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.917+0000 7f4d4effd700 1 -- 172.21.15.146:0/1397904903 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v92) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4d68150890 con 0x7f4d680c4450 2023-10-06T11:13:21.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.922+0000 7f4d67fff700 1 -- 172.21.15.146:0/1397904903 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4d54066f30 msgr2=0x7f4d540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:21.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.923+0000 7f4d67fff700 1 --2- 172.21.15.146:0/1397904903 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4d54066f30 0x7f4d540693e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f4d60007ec0 tx=0x7f4d60015000 comp rx=0 tx=0).stop 2023-10-06T11:13:21.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.923+0000 7f4d67fff700 1 -- 172.21.15.146:0/1397904903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d680c4450 msgr2=0x7f4d680c2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:21.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.923+0000 7f4d67fff700 1 --2- 172.21.15.146:0/1397904903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d680c4450 0x7f4d680c2f80 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c00fc00 tx=0x7f4d5c007d30 comp rx=0 tx=0).stop 2023-10-06T11:13:21.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.924+0000 7f4d67fff700 1 -- 172.21.15.146:0/1397904903 shutdown_connections 2023-10-06T11:13:21.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.924+0000 7f4d67fff700 1 --2- 172.21.15.146:0/1397904903 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4d54066f30 0x7f4d540693e0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:21.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.924+0000 7f4d67fff700 1 --2- 172.21.15.146:0/1397904903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d680b3ab0 0x7f4d680b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:21.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.924+0000 7f4d67fff700 1 --2- 172.21.15.146:0/1397904903 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4d68068780 0x7f4d680c6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:21.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.924+0000 7f4d67fff700 1 --2- 172.21.15.146:0/1397904903 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4d680c4450 0x7f4d680c2f80 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:21.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.924+0000 7f4d67fff700 1 -- 172.21.15.146:0/1397904903 >> 172.21.15.146:0/1397904903 conn(0x7f4d680703f0 msgr2=0x7f4d6815fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:21.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.925+0000 7f4d67fff700 1 -- 172.21.15.146:0/1397904903 shutdown_connections 2023-10-06T11:13:21.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:21.928+0000 7f4d67fff700 1 -- 172.21.15.146:0/1397904903 wait complete. 2023-10-06T11:13:21.939 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' removed 2023-10-06T11:13:21.961 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T11:13:22.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.102+0000 7fcc561a7700 1 Processor -- start 2023-10-06T11:13:22.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.102+0000 7fcc561a7700 1 -- start start 2023-10-06T11:13:22.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.103+0000 7fcc561a7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcc50159a90 0x7fcc500ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:22.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.103+0000 7fcc561a7700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc500cb870 con 0x7fcc500cdde0 2023-10-06T11:13:22.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.103+0000 7fcc561a7700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc500b07d0 con 0x7fcc500aecd0 2023-10-06T11:13:22.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.103+0000 7fcc561a7700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc500cac60 con 0x7fcc50159a90 2023-10-06T11:13:22.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.103+0000 7fcc4f7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcc50159a90 0x7fcc500ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:22.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.103+0000 7fcc4effd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fcc500cdde0 0x7fcc500b00c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:32810/0 (socket says 172.21.15.146:32810) 2023-10-06T11:13:22.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.103+0000 7fcc4effd700 1 -- 172.21.15.146:0/3799039375 learned_addr learned my addr 172.21.15.146:0/3799039375 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:13:22.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.103+0000 7fcc4f7fe700 1 -- 172.21.15.146:0/3799039375 >> v1:172.21.15.151:6789/0 conn(0x7fcc500aecd0 legacy=0x7fcc500cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:22.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.103+0000 7fcc4f7fe700 1 -- 172.21.15.146:0/3799039375 >> v1:172.21.15.146:6789/0 conn(0x7fcc500cdde0 legacy=0x7fcc500b00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:22.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.103+0000 7fcc4e7fc700 1 -- 172.21.15.146:0/3799039375 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1036490197 0 0) 0x7fcc500cb870 con 0x7fcc500cdde0 2023-10-06T11:13:22.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.103+0000 7fcc4f7fe700 1 -- 172.21.15.146:0/3799039375 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc500caf40 con 0x7fcc50159a90 2023-10-06T11:13:22.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.103+0000 7fcc4f7fe700 1 --2- 172.21.15.146:0/3799039375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc50159a90 0x7fcc500ca330 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fcc40009e60 tx=0x7fcc40009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34b9bea34a3f7f25 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:22.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.104+0000 7fcc4e7fc700 1 -- 172.21.15.146:0/3799039375 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4000e070 con 0x7fcc50159a90 2023-10-06T11:13:22.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.104+0000 7fcc4e7fc700 1 -- 172.21.15.146:0/3799039375 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc4000bc30 con 0x7fcc50159a90 2023-10-06T11:13:22.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.104+0000 7fcc4e7fc700 1 -- 172.21.15.146:0/3799039375 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc40012430 con 0x7fcc50159a90 2023-10-06T11:13:22.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.104+0000 7fcc561a7700 1 -- 172.21.15.146:0/3799039375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc50159a90 msgr2=0x7fcc500ca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:22.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.104+0000 7fcc561a7700 1 --2- 172.21.15.146:0/3799039375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc50159a90 0x7fcc500ca330 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fcc40009e60 tx=0x7fcc40009780 comp rx=0 tx=0).stop 2023-10-06T11:13:22.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.104+0000 7fcc561a7700 1 -- 172.21.15.146:0/3799039375 shutdown_connections 2023-10-06T11:13:22.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.104+0000 7fcc561a7700 1 --2- 172.21.15.146:0/3799039375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc50159a90 0x7fcc500ca330 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:22.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.104+0000 7fcc561a7700 1 -- 172.21.15.146:0/3799039375 >> 172.21.15.146:0/3799039375 conn(0x7fcc50068580 msgr2=0x7fcc50068980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:22.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.104+0000 7fcc561a7700 1 -- 172.21.15.146:0/3799039375 shutdown_connections 2023-10-06T11:13:22.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.104+0000 7fcc561a7700 1 -- 172.21.15.146:0/3799039375 wait complete. 2023-10-06T11:13:22.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.105+0000 7fcc561a7700 1 Processor -- start 2023-10-06T11:13:22.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.105+0000 7fcc561a7700 1 -- start start 2023-10-06T11:13:22.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.106+0000 7fcc561a7700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc500aecd0 0x7fcc5014f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:22.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.106+0000 7fcc561a7700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc500cdde0 0x7fcc501557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:22.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.106+0000 7fcc561a7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc50159a90 0x7fcc50155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:22.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.106+0000 7fcc561a7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc50152ab0 con 0x7fcc50159a90 2023-10-06T11:13:22.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.106+0000 7fcc561a7700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc50169e00 con 0x7fcc500aecd0 2023-10-06T11:13:22.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.106+0000 7fcc561a7700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5016a0e0 con 0x7fcc500cdde0 2023-10-06T11:13:22.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.106+0000 7fcc4ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc50159a90 0x7fcc50155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:22.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.106+0000 7fcc4ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc50159a90 0x7fcc50155ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47064/0 (socket says 172.21.15.146:47064) 2023-10-06T11:13:22.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.106+0000 7fcc4ffff700 1 -- 172.21.15.146:0/1956848935 learned_addr learned my addr 172.21.15.146:0/1956848935 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:22.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.106+0000 7fcc4f7fe700 1 --2- 172.21.15.146:0/1956848935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc500aecd0 0x7fcc5014f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:22.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.106+0000 7fcc4effd700 1 --2- 172.21.15.146:0/1956848935 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc500cdde0 0x7fcc501557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:22.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.107+0000 7fcc4ffff700 1 -- 172.21.15.146:0/1956848935 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc500cdde0 msgr2=0x7fcc501557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:22.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.107+0000 7fcc4ffff700 1 --2- 172.21.15.146:0/1956848935 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc500cdde0 0x7fcc501557a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:22.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.107+0000 7fcc4ffff700 1 -- 172.21.15.146:0/1956848935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc500aecd0 msgr2=0x7fcc5014f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:22.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.107+0000 7fcc4ffff700 1 --2- 172.21.15.146:0/1956848935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc500aecd0 0x7fcc5014f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:22.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.107+0000 7fcc4ffff700 1 -- 172.21.15.146:0/1956848935 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc40009a20 con 0x7fcc50159a90 2023-10-06T11:13:22.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.107+0000 7fcc4ffff700 1 --2- 172.21.15.146:0/1956848935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc50159a90 0x7fcc50155ce0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fcc4800c4c0 tx=0x7fcc48007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:22.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.107+0000 7fcc377fe700 1 -- 172.21.15.146:0/1956848935 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc4800ce70 con 0x7fcc50159a90 2023-10-06T11:13:22.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.107+0000 7fcc377fe700 1 -- 172.21.15.146:0/1956848935 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc48011590 con 0x7fcc50159a90 2023-10-06T11:13:22.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.107+0000 7fcc377fe700 1 -- 172.21.15.146:0/1956848935 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc48011970 con 0x7fcc50159a90 2023-10-06T11:13:22.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.107+0000 7fcc561a7700 1 -- 172.21.15.146:0/1956848935 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc5016a3c0 con 0x7fcc50159a90 2023-10-06T11:13:22.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.107+0000 7fcc561a7700 1 -- 172.21.15.146:0/1956848935 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc5016a8e0 con 0x7fcc50159a90 2023-10-06T11:13:22.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.108+0000 7fcc561a7700 1 -- 172.21.15.146:0/1956848935 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc50152bf0 con 0x7fcc50159a90 2023-10-06T11:13:22.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.108+0000 7fcc377fe700 1 -- 172.21.15.146:0/1956848935 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcc48011ce0 con 0x7fcc50159a90 2023-10-06T11:13:22.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.109+0000 7fcc377fe700 1 --2- 172.21.15.146:0/1956848935 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcc3c066f30 0x7fcc3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:22.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.109+0000 7fcc377fe700 1 -- 172.21.15.146:0/1956848935 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fcc48083670 con 0x7fcc50159a90 2023-10-06T11:13:22.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.109+0000 7fcc4f7fe700 1 --2- 172.21.15.146:0/1956848935 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcc3c066f30 0x7fcc3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:22.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.109+0000 7fcc4f7fe700 1 --2- 172.21.15.146:0/1956848935 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcc3c066f30 0x7fcc3c0693e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fcc40009e60 tx=0x7fcc40019000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:22.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.113+0000 7fcc377fe700 1 -- 172.21.15.146:0/1956848935 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcc48050a80 con 0x7fcc50159a90 2023-10-06T11:13:22.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.298+0000 7fcc561a7700 1 -- 172.21.15.146:0/1956848935 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fcc5004c380 con 0x7fcc50159a90 2023-10-06T11:13:22.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.302+0000 7fcc377fe700 1 -- 172.21.15.146:0/1956848935 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcc480540a0 con 0x7fcc50159a90 2023-10-06T11:13:22.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.304+0000 7fcc561a7700 1 -- 172.21.15.146:0/1956848935 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcc3c066f30 msgr2=0x7fcc3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:22.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.304+0000 7fcc561a7700 1 --2- 172.21.15.146:0/1956848935 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcc3c066f30 0x7fcc3c0693e0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fcc40009e60 tx=0x7fcc40019000 comp rx=0 tx=0).stop 2023-10-06T11:13:22.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.304+0000 7fcc561a7700 1 -- 172.21.15.146:0/1956848935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc50159a90 msgr2=0x7fcc50155ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:22.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.304+0000 7fcc561a7700 1 --2- 172.21.15.146:0/1956848935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc50159a90 0x7fcc50155ce0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fcc4800c4c0 tx=0x7fcc48007f50 comp rx=0 tx=0).stop 2023-10-06T11:13:22.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.304+0000 7fcc561a7700 1 -- 172.21.15.146:0/1956848935 shutdown_connections 2023-10-06T11:13:22.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.304+0000 7fcc561a7700 1 --2- 172.21.15.146:0/1956848935 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcc3c066f30 0x7fcc3c0693e0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:22.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.304+0000 7fcc561a7700 1 --2- 172.21.15.146:0/1956848935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcc50159a90 0x7fcc50155ce0 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:22.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.304+0000 7fcc561a7700 1 --2- 172.21.15.146:0/1956848935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc500aecd0 0x7fcc5014f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:22.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.304+0000 7fcc561a7700 1 --2- 172.21.15.146:0/1956848935 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc500cdde0 0x7fcc501557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:22.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.304+0000 7fcc561a7700 1 -- 172.21.15.146:0/1956848935 >> 172.21.15.146:0/1956848935 conn(0x7fcc50068580 msgr2=0x7fcc50063a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:22.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.304+0000 7fcc561a7700 1 -- 172.21.15.146:0/1956848935 shutdown_connections 2023-10-06T11:13:22.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.304+0000 7fcc561a7700 1 -- 172.21.15.146:0/1956848935 wait complete. 2023-10-06T11:13:22.318 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort' 2023-10-06T11:13:22.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.432+0000 7f6f6aaac700 1 Processor -- start 2023-10-06T11:13:22.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.433+0000 7f6f6aaac700 1 -- start start 2023-10-06T11:13:22.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.433+0000 7f6f6aaac700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6f640c8390 0x7f6f64159df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:22.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.433+0000 7f6f6aaac700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6f6415a330 0x7f6f640caf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:22.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.433+0000 7f6f6aaac700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f6415a770 con 0x7f6f64156230 2023-10-06T11:13:22.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.433+0000 7f6f6aaac700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f640c8830 con 0x7f6f640c8390 2023-10-06T11:13:22.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.433+0000 7f6f6aaac700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f640c8a30 con 0x7f6f6415a330 2023-10-06T11:13:22.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.434+0000 7f6f692a9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6f640c8390 0x7f6f64159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:22.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.434+0000 7f6f692a9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6f640c8390 0x7f6f64159df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47078/0 (socket says 172.21.15.146:47078) 2023-10-06T11:13:22.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.434+0000 7f6f692a9700 1 -- 172.21.15.146:0/2893828280 learned_addr learned my addr 172.21.15.146:0/2893828280 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:22.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.434+0000 7f6f6a2ab700 1 --2- 172.21.15.146:0/2893828280 >> v2:172.21.15.151:3300/0 conn(0x7f6f6415a330 0x7f6f640caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:22.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.434+0000 7f6f692a9700 1 -- 172.21.15.146:0/2893828280 >> v2:172.21.15.151:3300/0 conn(0x7f6f6415a330 msgr2=0x7f6f640caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:22.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.434+0000 7f6f692a9700 1 --2- 172.21.15.146:0/2893828280 >> v2:172.21.15.151:3300/0 conn(0x7f6f6415a330 0x7f6f640caf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:22.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.434+0000 7f6f692a9700 1 -- 172.21.15.146:0/2893828280 >> v1:172.21.15.151:6789/0 conn(0x7f6f64156230 legacy=0x7f6f6406ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:22.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.434+0000 7f6f692a9700 1 -- 172.21.15.146:0/2893828280 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f640c8d10 con 0x7f6f640c8390 2023-10-06T11:13:22.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.434+0000 7f6f6a2ab700 1 --2- 172.21.15.146:0/2893828280 >> v2:172.21.15.151:3300/0 conn(0x7f6f6415a330 0x7f6f640caf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:22.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.434+0000 7f6f692a9700 1 --2- 172.21.15.146:0/2893828280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f640c8390 0x7f6f64159df0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f6f6406a030 tx=0x7f6f54009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cad6e49c991d8b4a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:22.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.434+0000 7f6f68aa8700 1 -- 172.21.15.146:0/2893828280 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5400b820 con 0x7f6f640c8390 2023-10-06T11:13:22.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.434+0000 7f6f68aa8700 1 -- 172.21.15.146:0/2893828280 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5400b980 con 0x7f6f640c8390 2023-10-06T11:13:22.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.434+0000 7f6f68aa8700 1 -- 172.21.15.146:0/2893828280 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5400bd20 con 0x7f6f640c8390 2023-10-06T11:13:22.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.435+0000 7f6f6aaac700 1 -- 172.21.15.146:0/2893828280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f640c8390 msgr2=0x7f6f64159df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:22.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.435+0000 7f6f6aaac700 1 --2- 172.21.15.146:0/2893828280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f640c8390 0x7f6f64159df0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f6f6406a030 tx=0x7f6f54009250 comp rx=0 tx=0).stop 2023-10-06T11:13:22.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.435+0000 7f6f6aaac700 1 -- 172.21.15.146:0/2893828280 shutdown_connections 2023-10-06T11:13:22.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.435+0000 7f6f6aaac700 1 --2- 172.21.15.146:0/2893828280 >> v2:172.21.15.151:3300/0 conn(0x7f6f6415a330 0x7f6f640caf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:22.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.435+0000 7f6f6aaac700 1 --2- 172.21.15.146:0/2893828280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f640c8390 0x7f6f64159df0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:22.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.435+0000 7f6f6aaac700 1 -- 172.21.15.146:0/2893828280 >> 172.21.15.146:0/2893828280 conn(0x7f6f64069010 msgr2=0x7f6f640cd120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:22.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.435+0000 7f6f6aaac700 1 -- 172.21.15.146:0/2893828280 shutdown_connections 2023-10-06T11:13:22.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.435+0000 7f6f6aaac700 1 -- 172.21.15.146:0/2893828280 wait complete. 2023-10-06T11:13:22.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.436+0000 7f6f6aaac700 1 Processor -- start 2023-10-06T11:13:22.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.436+0000 7f6f6aaac700 1 -- start start 2023-10-06T11:13:22.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.437+0000 7f6f6aaac700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f640c8390 0x7f6f64150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:22.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.437+0000 7f6f6aaac700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f64156230 0x7f6f640cac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:22.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.437+0000 7f6f6aaac700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f6415a330 0x7f6f640cb140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:22.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.437+0000 7f6f6aaac700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f640a9d10 con 0x7f6f6415a330 2023-10-06T11:13:22.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.437+0000 7f6f6aaac700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f640aab70 con 0x7f6f64156230 2023-10-06T11:13:22.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.437+0000 7f6f6aaac700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f640a9f60 con 0x7f6f640c8390 2023-10-06T11:13:22.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.437+0000 7f6f6a2ab700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f6415a330 0x7f6f640cb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:22.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.437+0000 7f6f6a2ab700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f6415a330 0x7f6f640cb140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47086/0 (socket says 172.21.15.146:47086) 2023-10-06T11:13:22.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.437+0000 7f6f6a2ab700 1 -- 172.21.15.146:0/709626549 learned_addr learned my addr 172.21.15.146:0/709626549 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:22.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.437+0000 7f6f692a9700 1 --2- 172.21.15.146:0/709626549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f64156230 0x7f6f640cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:22.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.437+0000 7f6f69aaa700 1 --2- 172.21.15.146:0/709626549 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f640c8390 0x7f6f64150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:22.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.437+0000 7f6f6a2ab700 1 -- 172.21.15.146:0/709626549 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f640c8390 msgr2=0x7f6f64150b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:22.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.437+0000 7f6f6a2ab700 1 --2- 172.21.15.146:0/709626549 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f640c8390 0x7f6f64150b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:22.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.437+0000 7f6f6a2ab700 1 -- 172.21.15.146:0/709626549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f64156230 msgr2=0x7f6f640cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:22.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.437+0000 7f6f6a2ab700 1 --2- 172.21.15.146:0/709626549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f64156230 0x7f6f640cac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:22.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.437+0000 7f6f6a2ab700 1 -- 172.21.15.146:0/709626549 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f540094f0 con 0x7f6f6415a330 2023-10-06T11:13:22.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.437+0000 7f6f6a2ab700 1 --2- 172.21.15.146:0/709626549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f6415a330 0x7f6f640cb140 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c00a380 tx=0x7f6f5c007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:22.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.437+0000 7f6f59ffb700 1 -- 172.21.15.146:0/709626549 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c015440 con 0x7f6f6415a330 2023-10-06T11:13:22.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.437+0000 7f6f59ffb700 1 -- 172.21.15.146:0/709626549 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5c0155a0 con 0x7f6f6415a330 2023-10-06T11:13:22.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.437+0000 7f6f59ffb700 1 -- 172.21.15.146:0/709626549 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5c015960 con 0x7f6f6415a330 2023-10-06T11:13:22.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.437+0000 7f6f6aaac700 1 -- 172.21.15.146:0/709626549 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f640aa240 con 0x7f6f6415a330 2023-10-06T11:13:22.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.438+0000 7f6f6aaac700 1 -- 172.21.15.146:0/709626549 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f640aa800 con 0x7f6f6415a330 2023-10-06T11:13:22.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.439+0000 7f6f6aaac700 1 -- 172.21.15.146:0/709626549 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f640aace0 con 0x7f6f6415a330 2023-10-06T11:13:22.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.439+0000 7f6f59ffb700 1 -- 172.21.15.146:0/709626549 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6f5c00d440 con 0x7f6f6415a330 2023-10-06T11:13:22.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.439+0000 7f6f59ffb700 1 --2- 172.21.15.146:0/709626549 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6f48066f30 0x7f6f480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:22.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.439+0000 7f6f69aaa700 1 --2- 172.21.15.146:0/709626549 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6f48066f30 0x7f6f480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:22.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.439+0000 7f6f59ffb700 1 -- 172.21.15.146:0/709626549 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f6f5c084e90 con 0x7f6f6415a330 2023-10-06T11:13:22.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.440+0000 7f6f69aaa700 1 --2- 172.21.15.146:0/709626549 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6f48066f30 0x7f6f480693e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f6f60003a30 tx=0x7f6f60007ea0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:22.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.443+0000 7f6f59ffb700 1 -- 172.21.15.146:0/709626549 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f5c0522a0 con 0x7f6f6415a330 2023-10-06T11:13:22.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.698+0000 7f6f6aaac700 1 -- 172.21.15.146:0/709626549 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]} v 0) v1 -- 0x7f6f6404bb40 con 0x7f6f6415a330 2023-10-06T11:13:22.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.918+0000 7f6f59ffb700 1 -- 172.21.15.146:0/709626549 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_abort"]}]=0 v360) v1 ==== 144+0+0 (secure 0 0 0) 0x7f6f5c01a0d0 con 0x7f6f6415a330 2023-10-06T11:13:22.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.920+0000 7f6f6aaac700 1 -- 172.21.15.146:0/709626549 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6f48066f30 msgr2=0x7f6f480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:22.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.920+0000 7f6f6aaac700 1 --2- 172.21.15.146:0/709626549 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6f48066f30 0x7f6f480693e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f6f60003a30 tx=0x7f6f60007ea0 comp rx=0 tx=0).stop 2023-10-06T11:13:22.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.920+0000 7f6f6aaac700 1 -- 172.21.15.146:0/709626549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f6415a330 msgr2=0x7f6f640cb140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:22.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.920+0000 7f6f6aaac700 1 --2- 172.21.15.146:0/709626549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f6415a330 0x7f6f640cb140 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c00a380 tx=0x7f6f5c007900 comp rx=0 tx=0).stop 2023-10-06T11:13:22.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.920+0000 7f6f6aaac700 1 -- 172.21.15.146:0/709626549 shutdown_connections 2023-10-06T11:13:22.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.920+0000 7f6f6aaac700 1 --2- 172.21.15.146:0/709626549 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6f48066f30 0x7f6f480693e0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:22.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.920+0000 7f6f6aaac700 1 --2- 172.21.15.146:0/709626549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f6415a330 0x7f6f640cb140 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:22.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.920+0000 7f6f6aaac700 1 --2- 172.21.15.146:0/709626549 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f640c8390 0x7f6f64150b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:22.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.920+0000 7f6f6aaac700 1 --2- 172.21.15.146:0/709626549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f64156230 0x7f6f640cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:22.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.920+0000 7f6f6aaac700 1 -- 172.21.15.146:0/709626549 >> 172.21.15.146:0/709626549 conn(0x7f6f64069010 msgr2=0x7f6f640c2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:22.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.920+0000 7f6f6aaac700 1 -- 172.21.15.146:0/709626549 shutdown_connections 2023-10-06T11:13:22.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:22.920+0000 7f6f6aaac700 1 -- 172.21.15.146:0/709626549 wait complete. 2023-10-06T11:13:22.934 INFO:tasks.cephfs_test_runner:test_scrub_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2023-10-06T11:13:22.934 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_pause_and_resume (tasks.cephfs.test_scrub_checks.TestScrubControls) 2023-10-06T11:13:22.934 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume' 2023-10-06T11:13:23.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.047+0000 7fc975494700 1 Processor -- start 2023-10-06T11:13:23.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.047+0000 7fc975494700 1 -- start start 2023-10-06T11:13:23.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.048+0000 7fc975494700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc970157430 0x7fc970157800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:23.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.048+0000 7fc975494700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc9700ca070 0x7fc9700cc240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:23.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.048+0000 7fc975494700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9700ccf20 con 0x7fc9700ab010 2023-10-06T11:13:23.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.048+0000 7fc975494700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9700ca4f0 con 0x7fc970157430 2023-10-06T11:13:23.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.048+0000 7fc975494700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9700c3dd0 con 0x7fc9700ca070 2023-10-06T11:13:23.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.048+0000 7fc96effd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc970157430 0x7fc970157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:23.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.048+0000 7fc96effd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc970157430 0x7fc970157800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47100/0 (socket says 172.21.15.146:47100) 2023-10-06T11:13:23.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.048+0000 7fc96effd700 1 -- 172.21.15.146:0/1475233040 learned_addr learned my addr 172.21.15.146:0/1475233040 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:23.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.049+0000 7fc96effd700 1 -- 172.21.15.146:0/1475233040 >> v2:172.21.15.151:3300/0 conn(0x7fc9700ca070 msgr2=0x7fc9700cc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:23.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.049+0000 7fc96f7fe700 1 --2- 172.21.15.146:0/1475233040 >> v2:172.21.15.151:3300/0 conn(0x7fc9700ca070 0x7fc9700cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:23.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.049+0000 7fc96effd700 1 --2- 172.21.15.146:0/1475233040 >> v2:172.21.15.151:3300/0 conn(0x7fc9700ca070 0x7fc9700cc240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:23.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.049+0000 7fc96effd700 1 -- 172.21.15.146:0/1475233040 >> v1:172.21.15.151:6789/0 conn(0x7fc9700ab010 legacy=0x7fc9700ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:23.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.049+0000 7fc96effd700 1 -- 172.21.15.146:0/1475233040 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9700cd200 con 0x7fc970157430 2023-10-06T11:13:23.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.049+0000 7fc96f7fe700 1 --2- 172.21.15.146:0/1475233040 >> v2:172.21.15.151:3300/0 conn(0x7fc9700ca070 0x7fc9700cc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:23.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.049+0000 7fc96effd700 1 --2- 172.21.15.146:0/1475233040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc970157430 0x7fc970157800 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fc9700ce3f0 tx=0x7fc960009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=245fb9767f93e85d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:23.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.049+0000 7fc96dffb700 1 -- 172.21.15.146:0/1475233040 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96000e070 con 0x7fc970157430 2023-10-06T11:13:23.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.049+0000 7fc96dffb700 1 -- 172.21.15.146:0/1475233040 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96000ba10 con 0x7fc970157430 2023-10-06T11:13:23.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.049+0000 7fc96dffb700 1 -- 172.21.15.146:0/1475233040 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9600092e0 con 0x7fc970157430 2023-10-06T11:13:23.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.049+0000 7fc975494700 1 -- 172.21.15.146:0/1475233040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc970157430 msgr2=0x7fc970157800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:23.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.049+0000 7fc975494700 1 --2- 172.21.15.146:0/1475233040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc970157430 0x7fc970157800 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fc9700ce3f0 tx=0x7fc960009840 comp rx=0 tx=0).stop 2023-10-06T11:13:23.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.049+0000 7fc975494700 1 -- 172.21.15.146:0/1475233040 shutdown_connections 2023-10-06T11:13:23.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.049+0000 7fc975494700 1 --2- 172.21.15.146:0/1475233040 >> v2:172.21.15.151:3300/0 conn(0x7fc9700ca070 0x7fc9700cc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:23.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.049+0000 7fc975494700 1 --2- 172.21.15.146:0/1475233040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc970157430 0x7fc970157800 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:23.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.049+0000 7fc975494700 1 -- 172.21.15.146:0/1475233040 >> 172.21.15.146:0/1475233040 conn(0x7fc970067c50 msgr2=0x7fc9700ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:23.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.049+0000 7fc975494700 1 -- 172.21.15.146:0/1475233040 shutdown_connections 2023-10-06T11:13:23.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.049+0000 7fc975494700 1 -- 172.21.15.146:0/1475233040 wait complete. 2023-10-06T11:13:23.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.051+0000 7fc975494700 1 Processor -- start 2023-10-06T11:13:23.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.051+0000 7fc975494700 1 -- start start 2023-10-06T11:13:23.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.051+0000 7fc975494700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9700ab010 0x7fc970158bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:23.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.051+0000 7fc975494700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9700ca070 0x7fc970068f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:23.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.051+0000 7fc975494700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc970157430 0x7fc9700ac7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:23.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.051+0000 7fc975494700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc970158740 con 0x7fc970157430 2023-10-06T11:13:23.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.051+0000 7fc975494700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97006a4c0 con 0x7fc9700ca070 2023-10-06T11:13:23.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.051+0000 7fc975494700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc970157b30 con 0x7fc9700ab010 2023-10-06T11:13:23.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.052+0000 7fc96f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc970157430 0x7fc9700ac7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:23.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.052+0000 7fc96f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc970157430 0x7fc9700ac7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47108/0 (socket says 172.21.15.146:47108) 2023-10-06T11:13:23.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.052+0000 7fc96f7fe700 1 -- 172.21.15.146:0/2127614490 learned_addr learned my addr 172.21.15.146:0/2127614490 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:23.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.052+0000 7fc96effd700 1 --2- 172.21.15.146:0/2127614490 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9700ab010 0x7fc970158bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:23.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.052+0000 7fc96e7fc700 1 --2- 172.21.15.146:0/2127614490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9700ca070 0x7fc970068f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:23.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.052+0000 7fc96f7fe700 1 -- 172.21.15.146:0/2127614490 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9700ab010 msgr2=0x7fc970158bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:23.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.052+0000 7fc96f7fe700 1 --2- 172.21.15.146:0/2127614490 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9700ab010 0x7fc970158bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:23.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.052+0000 7fc96f7fe700 1 -- 172.21.15.146:0/2127614490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9700ca070 msgr2=0x7fc970068f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:23.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.052+0000 7fc96f7fe700 1 --2- 172.21.15.146:0/2127614490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9700ca070 0x7fc970068f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:23.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.052+0000 7fc96f7fe700 1 -- 172.21.15.146:0/2127614490 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc960009ae0 con 0x7fc970157430 2023-10-06T11:13:23.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.052+0000 7fc96e7fc700 1 --2- 172.21.15.146:0/2127614490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9700ca070 0x7fc970068f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:23.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.052+0000 7fc96f7fe700 1 --2- 172.21.15.146:0/2127614490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc970157430 0x7fc9700ac7f0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fc96800c8b0 tx=0x7fc968008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:23.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.052+0000 7fc966ffd700 1 -- 172.21.15.146:0/2127614490 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc968011600 con 0x7fc970157430 2023-10-06T11:13:23.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.052+0000 7fc966ffd700 1 -- 172.21.15.146:0/2127614490 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9680117a0 con 0x7fc970157430 2023-10-06T11:13:23.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.052+0000 7fc966ffd700 1 -- 172.21.15.146:0/2127614490 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc968011b60 con 0x7fc970157430 2023-10-06T11:13:23.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.052+0000 7fc975494700 1 -- 172.21.15.146:0/2127614490 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc970157e10 con 0x7fc970157430 2023-10-06T11:13:23.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.052+0000 7fc975494700 1 -- 172.21.15.146:0/2127614490 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9701583d0 con 0x7fc970157430 2023-10-06T11:13:23.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.053+0000 7fc975494700 1 -- 172.21.15.146:0/2127614490 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc97004c380 con 0x7fc970157430 2023-10-06T11:13:23.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.054+0000 7fc966ffd700 1 -- 172.21.15.146:0/2127614490 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc9680193b0 con 0x7fc970157430 2023-10-06T11:13:23.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.054+0000 7fc966ffd700 1 --2- 172.21.15.146:0/2127614490 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc950066f60 0x7fc950069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:23.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.054+0000 7fc966ffd700 1 -- 172.21.15.146:0/2127614490 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fc968084400 con 0x7fc970157430 2023-10-06T11:13:23.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.054+0000 7fc96effd700 1 --2- 172.21.15.146:0/2127614490 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc950066f60 0x7fc950069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:23.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.055+0000 7fc96effd700 1 --2- 172.21.15.146:0/2127614490 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc950066f60 0x7fc950069410 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc960009ab0 tx=0x7fc960017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:23.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.058+0000 7fc966ffd700 1 -- 172.21.15.146:0/2127614490 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc9680552a0 con 0x7fc970157430 2023-10-06T11:13:23.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.322+0000 7fc975494700 1 -- 172.21.15.146:0/2127614490 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]} v 0) v1 -- 0x7fc9700cd4e0 con 0x7fc970157430 2023-10-06T11:13:23.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.924+0000 7fc966ffd700 1 -- 172.21.15.146:0/2127614490 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]}]=0 v361) v1 ==== 158+0+0 (secure 0 0 0) 0x7fc968054e30 con 0x7fc970157430 2023-10-06T11:13:23.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.927+0000 7fc975494700 1 -- 172.21.15.146:0/2127614490 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc950066f60 msgr2=0x7fc950069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:23.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.927+0000 7fc975494700 1 --2- 172.21.15.146:0/2127614490 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc950066f60 0x7fc950069410 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc960009ab0 tx=0x7fc960017000 comp rx=0 tx=0).stop 2023-10-06T11:13:23.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.927+0000 7fc975494700 1 -- 172.21.15.146:0/2127614490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc970157430 msgr2=0x7fc9700ac7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:23.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.927+0000 7fc975494700 1 --2- 172.21.15.146:0/2127614490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc970157430 0x7fc9700ac7f0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fc96800c8b0 tx=0x7fc968008040 comp rx=0 tx=0).stop 2023-10-06T11:13:23.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.927+0000 7fc975494700 1 -- 172.21.15.146:0/2127614490 shutdown_connections 2023-10-06T11:13:23.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.927+0000 7fc975494700 1 --2- 172.21.15.146:0/2127614490 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc950066f60 0x7fc950069410 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:23.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.927+0000 7fc975494700 1 --2- 172.21.15.146:0/2127614490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc970157430 0x7fc9700ac7f0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:23.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.927+0000 7fc975494700 1 --2- 172.21.15.146:0/2127614490 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9700ab010 0x7fc970158bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:23.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.927+0000 7fc975494700 1 --2- 172.21.15.146:0/2127614490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9700ca070 0x7fc970068f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:23.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.927+0000 7fc975494700 1 -- 172.21.15.146:0/2127614490 >> 172.21.15.146:0/2127614490 conn(0x7fc970067c50 msgr2=0x7fc9700cb680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:23.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.927+0000 7fc975494700 1 -- 172.21.15.146:0/2127614490 shutdown_connections 2023-10-06T11:13:23.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:23.927+0000 7fc975494700 1 -- 172.21.15.146:0/2127614490 wait complete. 2023-10-06T11:13:23.942 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T11:13:24.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.061+0000 7f27f5238700 1 Processor -- start 2023-10-06T11:13:24.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.061+0000 7f27f5238700 1 -- start start 2023-10-06T11:13:24.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.062+0000 7f27f5238700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27f015a160 0x7f27f00c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:24.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.062+0000 7f27f5238700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f00ae2a0 con 0x7f27f00ae730 2023-10-06T11:13:24.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.062+0000 7f27f5238700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27f015a530 con 0x7f27f00cb950 2023-10-06T11:13:24.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.062+0000 7f27f5238700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f00ad690 con 0x7f27f015a160 2023-10-06T11:13:24.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.062+0000 7f27e7fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f27f00ae730 0x7f27f00aeb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:32816/0 (socket says 172.21.15.146:32816) 2023-10-06T11:13:24.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.062+0000 7f27e7fff700 1 -- 172.21.15.146:0/3262187187 learned_addr learned my addr 172.21.15.146:0/3262187187 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:13:24.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.062+0000 7f27eed9d700 1 --2- 172.21.15.146:0/3262187187 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27f015a160 0x7f27f00c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:24.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.062+0000 7f27ee59c700 1 -- 172.21.15.146:0/3262187187 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3543028184 0 0) 0x7f27f00ae2a0 con 0x7f27f00ae730 2023-10-06T11:13:24.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.062+0000 7f27ee59c700 1 -- 172.21.15.146:0/3262187187 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27dc003570 con 0x7f27f00ae730 2023-10-06T11:13:24.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.062+0000 7f27ee59c700 1 -- 172.21.15.146:0/3262187187 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1503916229 0 0) 0x7f27dc003570 con 0x7f27f00ae730 2023-10-06T11:13:24.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.062+0000 7f27ee59c700 1 -- 172.21.15.146:0/3262187187 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27f015a160 msgr2=0x7f27f00c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:24.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.062+0000 7f27ee59c700 1 --2- 172.21.15.146:0/3262187187 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27f015a160 0x7f27f00c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:24.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.062+0000 7f27ee59c700 1 -- 172.21.15.146:0/3262187187 >> v1:172.21.15.151:6789/0 conn(0x7f27f00cb950 legacy=0x7f27f00cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:24.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.062+0000 7f27ee59c700 1 -- 172.21.15.146:0/3262187187 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f00ad970 con 0x7f27f00ae730 2023-10-06T11:13:24.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.062+0000 7f27ee59c700 1 -- 172.21.15.146:0/3262187187 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f27d8001470 con 0x7f27f00ae730 2023-10-06T11:13:24.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.062+0000 7f27ee59c700 1 -- 172.21.15.146:0/3262187187 >> v1:172.21.15.146:6789/0 conn(0x7f27f00ae730 legacy=0x7f27f00aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:24.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.062+0000 7f27ee59c700 1 --2- 172.21.15.146:0/3262187187 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27dc003a90 0x7f27dc003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:24.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.062+0000 7f27ee59c700 1 --2- 172.21.15.146:0/3262187187 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27f015a160 0x7f27dc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:24.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.062+0000 7f27ee59c700 1 --2- 172.21.15.146:0/3262187187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27dc004d50 0x7f27dc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:24.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.062+0000 7f27ee59c700 1 -- 172.21.15.146:0/3262187187 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f00ad690 con 0x7f27dc004d50 2023-10-06T11:13:24.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.062+0000 7f27ee59c700 1 -- 172.21.15.146:0/3262187187 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27dc00bb70 con 0x7f27dc003a90 2023-10-06T11:13:24.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.062+0000 7f27ee59c700 1 -- 172.21.15.146:0/3262187187 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27dc00bd30 con 0x7f27f015a160 2023-10-06T11:13:24.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.063+0000 7f27eed9d700 1 --2- 172.21.15.146:0/3262187187 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27dc003a90 0x7f27dc003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:24.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.062+0000 7f27ef59e700 1 --2- 172.21.15.146:0/3262187187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27dc004d50 0x7f27dc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:24.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.063+0000 7f27e7fff700 1 --2- 172.21.15.146:0/3262187187 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27f015a160 0x7f27dc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:24.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.063+0000 7f27ef59e700 1 -- 172.21.15.146:0/3262187187 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27f015a160 msgr2=0x7f27dc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:24.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.063+0000 7f27ef59e700 1 --2- 172.21.15.146:0/3262187187 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27f015a160 0x7f27dc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:24.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.063+0000 7f27ef59e700 1 -- 172.21.15.146:0/3262187187 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27dc003a90 msgr2=0x7f27dc003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:24.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.063+0000 7f27ef59e700 1 --2- 172.21.15.146:0/3262187187 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27dc003a90 0x7f27dc003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:24.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.063+0000 7f27ef59e700 1 -- 172.21.15.146:0/3262187187 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27dc003570 con 0x7f27dc004d50 2023-10-06T11:13:24.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.063+0000 7f27ef59e700 1 --2- 172.21.15.146:0/3262187187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27dc004d50 0x7f27dc0051c0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f27e8001fc0 tx=0x7f27e8001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a46a6a54fb2ef169 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:24.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.063+0000 7f27ee59c700 1 -- 172.21.15.146:0/3262187187 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e8001950 con 0x7f27dc004d50 2023-10-06T11:13:24.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.063+0000 7f27ee59c700 1 -- 172.21.15.146:0/3262187187 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e800c8b0 con 0x7f27dc004d50 2023-10-06T11:13:24.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.063+0000 7f27ee59c700 1 -- 172.21.15.146:0/3262187187 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e800cc50 con 0x7f27dc004d50 2023-10-06T11:13:24.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.064+0000 7f27f5238700 1 -- 172.21.15.146:0/3262187187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27dc004d50 msgr2=0x7f27dc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:24.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.064+0000 7f27f5238700 1 --2- 172.21.15.146:0/3262187187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27dc004d50 0x7f27dc0051c0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f27e8001fc0 tx=0x7f27e8001640 comp rx=0 tx=0).stop 2023-10-06T11:13:24.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.064+0000 7f27ef59e700 1 -- 172.21.15.146:0/3262187187 reap_dead start 2023-10-06T11:13:24.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.064+0000 7f27f5238700 1 -- 172.21.15.146:0/3262187187 shutdown_connections 2023-10-06T11:13:24.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.064+0000 7f27f5238700 1 -- 172.21.15.146:0/3262187187 >> 172.21.15.146:0/3262187187 conn(0x7f27f006f380 msgr2=0x7f27f00d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:24.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.064+0000 7f27f5238700 1 -- 172.21.15.146:0/3262187187 shutdown_connections 2023-10-06T11:13:24.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.064+0000 7f27f5238700 1 -- 172.21.15.146:0/3262187187 wait complete. 2023-10-06T11:13:24.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.065+0000 7f27f5238700 1 Processor -- start 2023-10-06T11:13:24.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.065+0000 7f27f5238700 1 -- start start 2023-10-06T11:13:24.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.065+0000 7f27f5238700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27f014b3a0 0x7f27f00b4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:24.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.066+0000 7f27f5238700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27f00b4ba0 0x7f27f00cd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:24.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.066+0000 7f27f5238700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27f014b770 0x7f27f00cd930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:24.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.066+0000 7f27f5238700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f00b5c80 con 0x7f27f00b4ba0 2023-10-06T11:13:24.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.066+0000 7f27f5238700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f00b5070 con 0x7f27f014b3a0 2023-10-06T11:13:24.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.066+0000 7f27f5238700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f00b5350 con 0x7f27f014b770 2023-10-06T11:13:24.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.066+0000 7f27e7fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27f00b4ba0 0x7f27f00cd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:24.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.066+0000 7f27e7fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27f00b4ba0 0x7f27f00cd3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47126/0 (socket says 172.21.15.146:47126) 2023-10-06T11:13:24.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.066+0000 7f27e7fff700 1 -- 172.21.15.146:0/4257243461 learned_addr learned my addr 172.21.15.146:0/4257243461 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:24.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.066+0000 7f27ef59e700 1 --2- 172.21.15.146:0/4257243461 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27f014b770 0x7f27f00cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:24.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.066+0000 7f27eed9d700 1 --2- 172.21.15.146:0/4257243461 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27f014b3a0 0x7f27f00b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:24.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.066+0000 7f27e7fff700 1 -- 172.21.15.146:0/4257243461 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27f014b770 msgr2=0x7f27f00cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:24.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.066+0000 7f27e7fff700 1 --2- 172.21.15.146:0/4257243461 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27f014b770 0x7f27f00cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:24.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.066+0000 7f27e7fff700 1 -- 172.21.15.146:0/4257243461 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27f014b3a0 msgr2=0x7f27f00b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:24.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.066+0000 7f27e7fff700 1 --2- 172.21.15.146:0/4257243461 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27f014b3a0 0x7f27f00b4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:24.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.066+0000 7f27e7fff700 1 -- 172.21.15.146:0/4257243461 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f00b5630 con 0x7f27f00b4ba0 2023-10-06T11:13:24.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.066+0000 7f27eed9d700 1 --2- 172.21.15.146:0/4257243461 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27f014b3a0 0x7f27f00b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:24.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.066+0000 7f27e7fff700 1 --2- 172.21.15.146:0/4257243461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27f00b4ba0 0x7f27f00cd3f0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f27d8007390 tx=0x7f27d8001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:24.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.066+0000 7f27e6ffd700 1 -- 172.21.15.146:0/4257243461 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d8018030 con 0x7f27f00b4ba0 2023-10-06T11:13:24.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.066+0000 7f27e6ffd700 1 -- 172.21.15.146:0/4257243461 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d8007820 con 0x7f27f00b4ba0 2023-10-06T11:13:24.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.066+0000 7f27e6ffd700 1 -- 172.21.15.146:0/4257243461 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d800fac0 con 0x7f27f00b4ba0 2023-10-06T11:13:24.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.066+0000 7f27f5238700 1 -- 172.21.15.146:0/4257243461 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f00b5910 con 0x7f27f00b4ba0 2023-10-06T11:13:24.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.066+0000 7f27f5238700 1 -- 172.21.15.146:0/4257243461 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f00b6110 con 0x7f27f00b4ba0 2023-10-06T11:13:24.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.067+0000 7f27f5238700 1 -- 172.21.15.146:0/4257243461 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27f0068390 con 0x7f27f00b4ba0 2023-10-06T11:13:24.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.068+0000 7f27e6ffd700 1 -- 172.21.15.146:0/4257243461 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f27d801b070 con 0x7f27f00b4ba0 2023-10-06T11:13:24.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.068+0000 7f27e6ffd700 1 --2- 172.21.15.146:0/4257243461 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f27d0066f60 0x7f27d0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:24.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.068+0000 7f27e6ffd700 1 -- 172.21.15.146:0/4257243461 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f27d8019070 con 0x7f27f00b4ba0 2023-10-06T11:13:24.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.068+0000 7f27eed9d700 1 --2- 172.21.15.146:0/4257243461 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f27d0066f60 0x7f27d0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:24.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.069+0000 7f27eed9d700 1 --2- 172.21.15.146:0/4257243461 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f27d0066f60 0x7f27d0069410 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f27e0006ea0 tx=0x7f27e0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:24.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.072+0000 7f27e6ffd700 1 -- 172.21.15.146:0/4257243461 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f27d8051650 con 0x7f27f00b4ba0 2023-10-06T11:13:24.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.256+0000 7f27f5238700 1 -- 172.21.15.146:0/4257243461 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f27f004c380 con 0x7f27f00b4ba0 2023-10-06T11:13:24.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.259+0000 7f27e6ffd700 1 -- 172.21.15.146:0/4257243461 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7f27d8054c70 con 0x7f27f00b4ba0 2023-10-06T11:13:24.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.262+0000 7f27f5238700 1 -- 172.21.15.146:0/4257243461 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f27d0066f60 msgr2=0x7f27d0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:24.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.262+0000 7f27f5238700 1 --2- 172.21.15.146:0/4257243461 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f27d0066f60 0x7f27d0069410 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f27e0006ea0 tx=0x7f27e0008040 comp rx=0 tx=0).stop 2023-10-06T11:13:24.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.262+0000 7f27f5238700 1 -- 172.21.15.146:0/4257243461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27f00b4ba0 msgr2=0x7f27f00cd3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:24.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.262+0000 7f27f5238700 1 --2- 172.21.15.146:0/4257243461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27f00b4ba0 0x7f27f00cd3f0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f27d8007390 tx=0x7f27d8001e50 comp rx=0 tx=0).stop 2023-10-06T11:13:24.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.262+0000 7f27f5238700 1 -- 172.21.15.146:0/4257243461 shutdown_connections 2023-10-06T11:13:24.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.262+0000 7f27f5238700 1 --2- 172.21.15.146:0/4257243461 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f27d0066f60 0x7f27d0069410 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:24.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.262+0000 7f27f5238700 1 --2- 172.21.15.146:0/4257243461 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f27f014b770 0x7f27f00cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:24.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.262+0000 7f27f5238700 1 --2- 172.21.15.146:0/4257243461 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27f014b3a0 0x7f27f00b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:24.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.262+0000 7f27f5238700 1 --2- 172.21.15.146:0/4257243461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f27f00b4ba0 0x7f27f00cd3f0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:24.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.262+0000 7f27f5238700 1 -- 172.21.15.146:0/4257243461 >> 172.21.15.146:0/4257243461 conn(0x7f27f006f380 msgr2=0x7f27f01594e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:24.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.262+0000 7f27f5238700 1 -- 172.21.15.146:0/4257243461 shutdown_connections 2023-10-06T11:13:24.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.262+0000 7f27f5238700 1 -- 172.21.15.146:0/4257243461 wait complete. 2023-10-06T11:13:24.276 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T11:13:24.276 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:13:24.321 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:13:24.366 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T11:13:24.366 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T11:13:24.367 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:13:24.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.479+0000 7ffaa93ee700 1 Processor -- start 2023-10-06T11:13:24.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.480+0000 7ffaa93ee700 1 -- start start 2023-10-06T11:13:24.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.480+0000 7ffaa93ee700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffaa4153ab0 0x7ffaa415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:24.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.480+0000 7ffaa93ee700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ffaa4153e80 0x7ffaa4068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:24.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.480+0000 7ffaa93ee700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaa415ac30 con 0x7ffaa40689d0 2023-10-06T11:13:24.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.480+0000 7ffaa93ee700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaa40b4510 con 0x7ffaa4153ab0 2023-10-06T11:13:24.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.480+0000 7ffaa93ee700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaa40b6530 con 0x7ffaa4153e80 2023-10-06T11:13:24.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.480+0000 7ffaa2ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffaa4153ab0 0x7ffaa415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:24.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.481+0000 7ffaa2ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffaa4153ab0 0x7ffaa415a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47140/0 (socket says 172.21.15.146:47140) 2023-10-06T11:13:24.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.481+0000 7ffaa2ffd700 1 -- 172.21.15.146:0/131128946 learned_addr learned my addr 172.21.15.146:0/131128946 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:24.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.481+0000 7ffaa2ffd700 1 -- 172.21.15.146:0/131128946 >> v2:172.21.15.151:3300/0 conn(0x7ffaa4153e80 msgr2=0x7ffaa4068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:24.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.481+0000 7ffaa2ffd700 1 --2- 172.21.15.146:0/131128946 >> v2:172.21.15.151:3300/0 conn(0x7ffaa4153e80 0x7ffaa4068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:24.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.481+0000 7ffaa2ffd700 1 -- 172.21.15.146:0/131128946 >> v1:172.21.15.151:6789/0 conn(0x7ffaa40689d0 legacy=0x7ffaa415d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:24.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.481+0000 7ffaa2ffd700 1 -- 172.21.15.146:0/131128946 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa4068dd0 con 0x7ffaa4153ab0 2023-10-06T11:13:24.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.481+0000 7ffaa2ffd700 1 --2- 172.21.15.146:0/131128946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffaa4153ab0 0x7ffaa415a6f0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4089770 tx=0x7ffa94009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57088fe60a1daa5b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:24.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.481+0000 7ffaa27fc700 1 -- 172.21.15.146:0/131128946 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9400b820 con 0x7ffaa4153ab0 2023-10-06T11:13:24.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.481+0000 7ffaa27fc700 1 -- 172.21.15.146:0/131128946 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9400b980 con 0x7ffaa4153ab0 2023-10-06T11:13:24.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.481+0000 7ffaa27fc700 1 -- 172.21.15.146:0/131128946 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9400bd20 con 0x7ffaa4153ab0 2023-10-06T11:13:24.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.482+0000 7ffaa93ee700 1 -- 172.21.15.146:0/131128946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffaa4153ab0 msgr2=0x7ffaa415a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:24.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.482+0000 7ffaa93ee700 1 --2- 172.21.15.146:0/131128946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffaa4153ab0 0x7ffaa415a6f0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7ffaa4089770 tx=0x7ffa94009250 comp rx=0 tx=0).stop 2023-10-06T11:13:24.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.482+0000 7ffaa93ee700 1 -- 172.21.15.146:0/131128946 shutdown_connections 2023-10-06T11:13:24.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.482+0000 7ffaa93ee700 1 --2- 172.21.15.146:0/131128946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffaa4153ab0 0x7ffaa415a6f0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:24.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.482+0000 7ffaa93ee700 1 --2- 172.21.15.146:0/131128946 >> v2:172.21.15.151:3300/0 conn(0x7ffaa4153e80 0x7ffaa4068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:24.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.482+0000 7ffaa93ee700 1 -- 172.21.15.146:0/131128946 >> 172.21.15.146:0/131128946 conn(0x7ffaa406eba0 msgr2=0x7ffaa406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:24.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.482+0000 7ffaa93ee700 1 -- 172.21.15.146:0/131128946 shutdown_connections 2023-10-06T11:13:24.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.482+0000 7ffaa93ee700 1 -- 172.21.15.146:0/131128946 wait complete. 2023-10-06T11:13:24.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.483+0000 7ffaa93ee700 1 Processor -- start 2023-10-06T11:13:24.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.483+0000 7ffaa93ee700 1 -- start start 2023-10-06T11:13:24.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.484+0000 7ffaa93ee700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffaa40689d0 0x7ffaa40b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:24.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.484+0000 7ffaa93ee700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffaa4153ab0 0x7ffaa41500c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:24.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.484+0000 7ffaa93ee700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffaa4153e80 0x7ffaa41587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:24.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.484+0000 7ffaa93ee700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa40afec0 con 0x7ffaa40689d0 2023-10-06T11:13:24.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.484+0000 7ffaa93ee700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa40b01a0 con 0x7ffaa4153e80 2023-10-06T11:13:24.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.484+0000 7ffaa93ee700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa4159020 con 0x7ffaa4153ab0 2023-10-06T11:13:24.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.484+0000 7ffaa2ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffaa40689d0 0x7ffaa40b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:24.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.484+0000 7ffaa2ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffaa40689d0 0x7ffaa40b22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47144/0 (socket says 172.21.15.146:47144) 2023-10-06T11:13:24.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.484+0000 7ffaa2ffd700 1 -- 172.21.15.146:0/1580160984 learned_addr learned my addr 172.21.15.146:0/1580160984 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:24.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.484+0000 7ffaa37fe700 1 --2- 172.21.15.146:0/1580160984 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffaa4153e80 0x7ffaa41587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:24.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.484+0000 7ffa9a7fc700 1 --2- 172.21.15.146:0/1580160984 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffaa4153ab0 0x7ffaa41500c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:24.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.484+0000 7ffaa2ffd700 1 -- 172.21.15.146:0/1580160984 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffaa4153ab0 msgr2=0x7ffaa41500c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:24.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.484+0000 7ffaa2ffd700 1 --2- 172.21.15.146:0/1580160984 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffaa4153ab0 0x7ffaa41500c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:24.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.484+0000 7ffaa2ffd700 1 -- 172.21.15.146:0/1580160984 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffaa4153e80 msgr2=0x7ffaa41587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:24.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.484+0000 7ffaa2ffd700 1 --2- 172.21.15.146:0/1580160984 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffaa4153e80 0x7ffaa41587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:24.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.484+0000 7ffaa2ffd700 1 -- 172.21.15.146:0/1580160984 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa940094f0 con 0x7ffaa40689d0 2023-10-06T11:13:24.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.484+0000 7ffa9a7fc700 1 --2- 172.21.15.146:0/1580160984 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffaa4153ab0 0x7ffaa41500c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:24.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.484+0000 7ffaa37fe700 1 --2- 172.21.15.146:0/1580160984 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffaa4153e80 0x7ffaa41587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:24.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.484+0000 7ffaa2ffd700 1 --2- 172.21.15.146:0/1580160984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffaa40689d0 0x7ffaa40b22e0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7ffa940090b0 tx=0x7ffa94016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:24.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.484+0000 7ffa9b7fe700 1 -- 172.21.15.146:0/1580160984 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa94026480 con 0x7ffaa40689d0 2023-10-06T11:13:24.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.484+0000 7ffa9b7fe700 1 -- 172.21.15.146:0/1580160984 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9401f070 con 0x7ffaa40689d0 2023-10-06T11:13:24.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.484+0000 7ffaa93ee700 1 -- 172.21.15.146:0/1580160984 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa4159300 con 0x7ffaa40689d0 2023-10-06T11:13:24.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.484+0000 7ffa9b7fe700 1 -- 172.21.15.146:0/1580160984 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa94026830 con 0x7ffaa40689d0 2023-10-06T11:13:24.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.484+0000 7ffaa93ee700 1 -- 172.21.15.146:0/1580160984 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa4158d10 con 0x7ffaa40689d0 2023-10-06T11:13:24.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.485+0000 7ffaa93ee700 1 -- 172.21.15.146:0/1580160984 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaa404c380 con 0x7ffaa40689d0 2023-10-06T11:13:24.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.486+0000 7ffa9b7fe700 1 -- 172.21.15.146:0/1580160984 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffa9401a440 con 0x7ffaa40689d0 2023-10-06T11:13:24.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.486+0000 7ffa9b7fe700 1 --2- 172.21.15.146:0/1580160984 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ffa84066f30 0x7ffa840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:24.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.486+0000 7ffa9a7fc700 1 --2- 172.21.15.146:0/1580160984 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ffa84066f30 0x7ffa840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:24.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.486+0000 7ffa9b7fe700 1 -- 172.21.15.146:0/1580160984 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5292+0+0 (secure 0 0 0) 0x7ffa94021070 con 0x7ffaa40689d0 2023-10-06T11:13:24.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.487+0000 7ffa9a7fc700 1 --2- 172.21.15.146:0/1580160984 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ffa84066f30 0x7ffa840693e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7ffaa40cd2d0 tx=0x7ffa8c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:24.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.491+0000 7ffa9b7fe700 1 -- 172.21.15.146:0/1580160984 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffa94053cc0 con 0x7ffaa40689d0 2023-10-06T11:13:24.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.715+0000 7ffaa93ee700 1 -- 172.21.15.146:0/1580160984 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffaa415ac30 con 0x7ffaa40689d0 2023-10-06T11:13:24.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.716+0000 7ffa9b7fe700 1 -- 172.21.15.146:0/1580160984 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) v1 ==== 94+0+3538 (secure 0 0 0) 0x7ffaa415ac30 con 0x7ffaa40689d0 2023-10-06T11:13:24.718 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:13:24.718 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":87,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6191,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1148450968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":1148450968},{"type":"v1","addr":"172.21.15.151:6835","nonce":1148450968}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":6619,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/1915786440","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1915786440},{"type":"v1","addr":"172.21.15.151:6834","nonce":1915786440}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7212,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2292999516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2292999516},{"type":"v1","addr":"172.21.15.146:6836","nonce":2292999516}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80},{"gid":7215,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/905558084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":905558084},{"type":"v1","addr":"172.21.15.146:6837","nonce":905558084}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[]} 2023-10-06T11:13:24.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.718+0000 7ffaa93ee700 1 -- 172.21.15.146:0/1580160984 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ffa84066f30 msgr2=0x7ffa840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:24.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.718+0000 7ffaa93ee700 1 --2- 172.21.15.146:0/1580160984 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ffa84066f30 0x7ffa840693e0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7ffaa40cd2d0 tx=0x7ffa8c008040 comp rx=0 tx=0).stop 2023-10-06T11:13:24.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.718+0000 7ffaa93ee700 1 -- 172.21.15.146:0/1580160984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffaa40689d0 msgr2=0x7ffaa40b22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:24.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.718+0000 7ffaa93ee700 1 --2- 172.21.15.146:0/1580160984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffaa40689d0 0x7ffaa40b22e0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7ffa940090b0 tx=0x7ffa94016000 comp rx=0 tx=0).stop 2023-10-06T11:13:24.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.718+0000 7ffaa93ee700 1 -- 172.21.15.146:0/1580160984 shutdown_connections 2023-10-06T11:13:24.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.718+0000 7ffaa93ee700 1 --2- 172.21.15.146:0/1580160984 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ffa84066f30 0x7ffa840693e0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:24.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.718+0000 7ffaa93ee700 1 --2- 172.21.15.146:0/1580160984 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffaa4153e80 0x7ffaa41587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:24.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.718+0000 7ffaa93ee700 1 --2- 172.21.15.146:0/1580160984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffaa40689d0 0x7ffaa40b22e0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:24.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.718+0000 7ffaa93ee700 1 --2- 172.21.15.146:0/1580160984 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffaa4153ab0 0x7ffaa41500c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:24.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.718+0000 7ffaa93ee700 1 -- 172.21.15.146:0/1580160984 >> 172.21.15.146:0/1580160984 conn(0x7ffaa406eba0 msgr2=0x7ffaa415add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:24.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.718+0000 7ffaa93ee700 1 -- 172.21.15.146:0/1580160984 shutdown_connections 2023-10-06T11:13:24.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.718+0000 7ffaa93ee700 1 -- 172.21.15.146:0/1580160984 wait complete. 2023-10-06T11:13:24.721 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 87 2023-10-06T11:13:24.732 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T11:13:24.732 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T11:13:24.733 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T11:13:24.733 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:13:24.733 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T11:13:24.733 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T11:13:24.733 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T11:13:24.733 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:13:24.733 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T11:13:24.733 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T11:13:24.734 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T11:13:24.734 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:13:24.734 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T11:13:24.734 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T11:13:24.734 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T11:13:24.734 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:13:24.741 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T11:13:24.741 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T11:13:24.742 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T11:13:24.742 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T11:13:24.743 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T11:13:24.743 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T11:13:24.744 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T11:13:24.744 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T11:13:24.784 INFO:tasks.ceph.mds.a:Started 2023-10-06T11:13:24.784 DEBUG:teuthology.parallel:result is None 2023-10-06T11:13:24.785 INFO:tasks.ceph.mds.c:Started 2023-10-06T11:13:24.786 DEBUG:teuthology.parallel:result is None 2023-10-06T11:13:24.787 INFO:tasks.ceph.mds.b:Started 2023-10-06T11:13:24.787 DEBUG:teuthology.parallel:result is None 2023-10-06T11:13:24.788 INFO:tasks.ceph.mds.d:Started 2023-10-06T11:13:24.788 DEBUG:teuthology.parallel:result is None 2023-10-06T11:13:24.788 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T11:13:24.857 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2023-10-06T11:13:24.858 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2023-10-06T11:13:24.863 INFO:tasks.ceph.mds.b.smithi151.stdout:starting mds.b at 2023-10-06T11:13:24.863 INFO:tasks.ceph.mds.d.smithi151.stdout:starting mds.d at 2023-10-06T11:13:24.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.909+0000 7f86af2df700 1 Processor -- start 2023-10-06T11:13:24.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.909+0000 7f86af2df700 1 -- start start 2023-10-06T11:13:24.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.910+0000 7f86af2df700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86a815cff0 0x7f86a815d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:24.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.910+0000 7f86af2df700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f86a80d0c50 0x7f86a815a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:24.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.910+0000 7f86af2df700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86a80cf030 con 0x7f86a815cc20 2023-10-06T11:13:24.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.910+0000 7f86af2df700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86a815e390 con 0x7f86a80d0c50 2023-10-06T11:13:24.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.910+0000 7f86af2df700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a80ced20 con 0x7f86a815cff0 2023-10-06T11:13:24.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.910+0000 7f86ad87c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f86a80d0c50 0x7f86a815a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:24.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.910+0000 7f86ad87c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f86a80d0c50 0x7f86a815a890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47176/0 (socket says 172.21.15.146:47176) 2023-10-06T11:13:24.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.910+0000 7f86ad87c700 1 -- 172.21.15.146:0/2459655644 learned_addr learned my addr 172.21.15.146:0/2459655644 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:24.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.910+0000 7f86ac87a700 1 --2- 172.21.15.146:0/2459655644 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86a815cff0 0x7f86a815d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:24.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.910+0000 7f86ad87c700 1 -- 172.21.15.146:0/2459655644 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86a815cff0 msgr2=0x7f86a815d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:24.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.910+0000 7f86ad87c700 1 --2- 172.21.15.146:0/2459655644 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86a815cff0 0x7f86a815d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:24.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.910+0000 7f86ad87c700 1 -- 172.21.15.146:0/2459655644 >> v1:172.21.15.151:6789/0 conn(0x7f86a815cc20 legacy=0x7f86a80d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:24.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.910+0000 7f86ad87c700 1 -- 172.21.15.146:0/2459655644 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a815daf0 con 0x7f86a80d0c50 2023-10-06T11:13:24.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.910+0000 7f86ad87c700 1 --2- 172.21.15.146:0/2459655644 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86a80d0c50 0x7f86a815a890 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f86a0009f20 tx=0x7f86a0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=416c9af4fcb17387 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:24.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.911+0000 7f869ffff700 1 -- 172.21.15.146:0/2459655644 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a000e070 con 0x7f86a80d0c50 2023-10-06T11:13:24.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.911+0000 7f869ffff700 1 -- 172.21.15.146:0/2459655644 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86a000b9d0 con 0x7f86a80d0c50 2023-10-06T11:13:24.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.911+0000 7f869ffff700 1 -- 172.21.15.146:0/2459655644 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a00092e0 con 0x7f86a80d0c50 2023-10-06T11:13:24.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.911+0000 7f86af2df700 1 -- 172.21.15.146:0/2459655644 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86a80d0c50 msgr2=0x7f86a815a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:24.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.911+0000 7f86af2df700 1 --2- 172.21.15.146:0/2459655644 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86a80d0c50 0x7f86a815a890 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f86a0009f20 tx=0x7f86a0009840 comp rx=0 tx=0).stop 2023-10-06T11:13:24.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.911+0000 7f86af2df700 1 -- 172.21.15.146:0/2459655644 shutdown_connections 2023-10-06T11:13:24.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.911+0000 7f86af2df700 1 --2- 172.21.15.146:0/2459655644 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86a80d0c50 0x7f86a815a890 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:24.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.911+0000 7f86af2df700 1 --2- 172.21.15.146:0/2459655644 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86a815cff0 0x7f86a815d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:24.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.911+0000 7f86af2df700 1 -- 172.21.15.146:0/2459655644 >> 172.21.15.146:0/2459655644 conn(0x7f86a806eba0 msgr2=0x7f86a806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:24.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.911+0000 7f86af2df700 1 -- 172.21.15.146:0/2459655644 shutdown_connections 2023-10-06T11:13:24.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.911+0000 7f86af2df700 1 -- 172.21.15.146:0/2459655644 wait complete. 2023-10-06T11:13:24.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.912+0000 7f86af2df700 1 Processor -- start 2023-10-06T11:13:24.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.912+0000 7f86af2df700 1 -- start start 2023-10-06T11:13:24.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.913+0000 7f86af2df700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86a80d0c50 0x7f86a80cb160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:24.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.913+0000 7f86af2df700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86a815cc20 0x7f86a80cb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:24.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.913+0000 7f86af2df700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86a815cff0 0x7f86a80b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:24.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.913+0000 7f86af2df700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a8158330 con 0x7f86a80d0c50 2023-10-06T11:13:24.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.913+0000 7f86af2df700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a81454f0 con 0x7f86a815cff0 2023-10-06T11:13:24.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.913+0000 7f86af2df700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a80cbbe0 con 0x7f86a815cc20 2023-10-06T11:13:24.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.913+0000 7f86ad07b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86a80d0c50 0x7f86a80cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:24.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.913+0000 7f86ad07b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86a80d0c50 0x7f86a80cb160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47190/0 (socket says 172.21.15.146:47190) 2023-10-06T11:13:24.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.913+0000 7f86ad07b700 1 -- 172.21.15.146:0/180849685 learned_addr learned my addr 172.21.15.146:0/180849685 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:24.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.913+0000 7f86ac87a700 1 --2- 172.21.15.146:0/180849685 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86a815cc20 0x7f86a80cb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:24.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.913+0000 7f86ad87c700 1 --2- 172.21.15.146:0/180849685 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86a815cff0 0x7f86a80b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:24.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.914+0000 7f86ad07b700 1 -- 172.21.15.146:0/180849685 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86a815cc20 msgr2=0x7f86a80cb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:24.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.914+0000 7f86ad07b700 1 --2- 172.21.15.146:0/180849685 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86a815cc20 0x7f86a80cb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:24.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.914+0000 7f86ad07b700 1 -- 172.21.15.146:0/180849685 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86a815cff0 msgr2=0x7f86a80b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:24.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.914+0000 7f86ad07b700 1 --2- 172.21.15.146:0/180849685 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86a815cff0 0x7f86a80b0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:24.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.914+0000 7f86ad07b700 1 -- 172.21.15.146:0/180849685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a0009ae0 con 0x7f86a80d0c50 2023-10-06T11:13:24.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.914+0000 7f86ad87c700 1 --2- 172.21.15.146:0/180849685 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86a815cff0 0x7f86a80b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:24.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.914+0000 7f86ad07b700 1 --2- 172.21.15.146:0/180849685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86a80d0c50 0x7f86a80cb160 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f86a400c7c0 tx=0x7f86a4007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:24.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.914+0000 7f869d7fa700 1 -- 172.21.15.146:0/180849685 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a4011590 con 0x7f86a80d0c50 2023-10-06T11:13:24.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.914+0000 7f869d7fa700 1 -- 172.21.15.146:0/180849685 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86a4011710 con 0x7f86a80d0c50 2023-10-06T11:13:24.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.914+0000 7f86af2df700 1 -- 172.21.15.146:0/180849685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86a80cc170 con 0x7f86a80d0c50 2023-10-06T11:13:24.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.914+0000 7f869d7fa700 1 -- 172.21.15.146:0/180849685 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a4011ad0 con 0x7f86a80d0c50 2023-10-06T11:13:24.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.914+0000 7f86af2df700 1 -- 172.21.15.146:0/180849685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86a8144ea0 con 0x7f86a80d0c50 2023-10-06T11:13:24.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.915+0000 7f86af2df700 1 -- 172.21.15.146:0/180849685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86a804c380 con 0x7f86a80d0c50 2023-10-06T11:13:24.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.916+0000 7f869d7fa700 1 -- 172.21.15.146:0/180849685 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f86a401b3b0 con 0x7f86a80d0c50 2023-10-06T11:13:24.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.916+0000 7f869d7fa700 1 --2- 172.21.15.146:0/180849685 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f868c066f30 0x7f868c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:24.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.916+0000 7f869d7fa700 1 -- 172.21.15.146:0/180849685 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f86a4083c70 con 0x7f86a80d0c50 2023-10-06T11:13:24.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.916+0000 7f86ac87a700 1 --2- 172.21.15.146:0/180849685 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f868c066f30 0x7f868c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:24.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.917+0000 7f86ac87a700 1 --2- 172.21.15.146:0/180849685 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f868c066f30 0x7f868c0693e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f86a8158570 tx=0x7f8698008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:24.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:24.920+0000 7f869d7fa700 1 -- 172.21.15.146:0/180849685 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f86a40511b0 con 0x7f86a80d0c50 2023-10-06T11:13:25.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:25.117+0000 7f86af2df700 1 -- 172.21.15.146:0/180849685 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f86a80cd630 con 0x7f86a80d0c50 2023-10-06T11:13:25.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:25.946+0000 7f869d7fa700 1 -- 172.21.15.146:0/180849685 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v97) v1 ==== 97+0+0 (secure 0 0 0) 0x7f86a4017080 con 0x7f86a80d0c50 2023-10-06T11:13:25.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:25.949+0000 7f86af2df700 1 -- 172.21.15.146:0/180849685 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f868c066f30 msgr2=0x7f868c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:25.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:25.949+0000 7f86af2df700 1 --2- 172.21.15.146:0/180849685 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f868c066f30 0x7f868c0693e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f86a8158570 tx=0x7f8698008040 comp rx=0 tx=0).stop 2023-10-06T11:13:25.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:25.949+0000 7f86af2df700 1 -- 172.21.15.146:0/180849685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86a80d0c50 msgr2=0x7f86a80cb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:25.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:25.949+0000 7f86af2df700 1 --2- 172.21.15.146:0/180849685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86a80d0c50 0x7f86a80cb160 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f86a400c7c0 tx=0x7f86a4007f70 comp rx=0 tx=0).stop 2023-10-06T11:13:25.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:25.949+0000 7f86af2df700 1 -- 172.21.15.146:0/180849685 shutdown_connections 2023-10-06T11:13:25.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:25.949+0000 7f86af2df700 1 --2- 172.21.15.146:0/180849685 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f868c066f30 0x7f868c0693e0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:25.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:25.949+0000 7f86af2df700 1 --2- 172.21.15.146:0/180849685 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86a815cff0 0x7f86a80b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:25.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:25.949+0000 7f86af2df700 1 --2- 172.21.15.146:0/180849685 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86a80d0c50 0x7f86a80cb160 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:25.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:25.949+0000 7f86af2df700 1 --2- 172.21.15.146:0/180849685 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86a815cc20 0x7f86a80cb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:25.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:25.949+0000 7f86af2df700 1 -- 172.21.15.146:0/180849685 >> 172.21.15.146:0/180849685 conn(0x7f86a806eba0 msgr2=0x7f86a806ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:25.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:25.949+0000 7f86af2df700 1 -- 172.21.15.146:0/180849685 shutdown_connections 2023-10-06T11:13:25.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:25.949+0000 7f86af2df700 1 -- 172.21.15.146:0/180849685 wait complete. 2023-10-06T11:13:25.952 INFO:teuthology.orchestra.run.smithi146.stderr: removed all blocklist entries 2023-10-06T11:13:25.966 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T11:13:26.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.084+0000 7f7590d03700 1 Processor -- start 2023-10-06T11:13:26.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.084+0000 7f7590d03700 1 -- start start 2023-10-06T11:13:26.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.085+0000 7f7590d03700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f758c0ced80 0x7f758c0c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:26.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.085+0000 7f7590d03700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f758c0c3910 0x7f758c0cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:26.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.085+0000 7f7590d03700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f758c0cf210 con 0x7f758c0b0c00 2023-10-06T11:13:26.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.085+0000 7f7590d03700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f758c0682f0 con 0x7f758c0ced80 2023-10-06T11:13:26.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.085+0000 7f7590d03700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f758c068580 con 0x7f758c0c3910 2023-10-06T11:13:26.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.085+0000 7f7581d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f758c0ced80 0x7f758c0c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:26.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.085+0000 7f7581d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f758c0ced80 0x7f758c0c8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47202/0 (socket says 172.21.15.146:47202) 2023-10-06T11:13:26.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.085+0000 7f7581d9b700 1 -- 172.21.15.146:0/3296721129 learned_addr learned my addr 172.21.15.146:0/3296721129 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:26.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.086+0000 7f758ad9d700 1 --2- 172.21.15.146:0/3296721129 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f758c0c3910 0x7f758c0cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:26.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.086+0000 7f7581d9b700 1 -- 172.21.15.146:0/3296721129 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f758c0c3910 msgr2=0x7f758c0cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:26.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.086+0000 7f7581d9b700 1 --2- 172.21.15.146:0/3296721129 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f758c0c3910 0x7f758c0cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.086+0000 7f7581d9b700 1 -- 172.21.15.146:0/3296721129 >> v1:172.21.15.151:6789/0 conn(0x7f758c0b0c00 legacy=0x7f758c0c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:26.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.086+0000 7f7581d9b700 1 -- 172.21.15.146:0/3296721129 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f758c068790 con 0x7f758c0ced80 2023-10-06T11:13:26.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.086+0000 7f7581d9b700 1 --2- 172.21.15.146:0/3296721129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f758c0ced80 0x7f758c0c8aa0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f75740099b0 tx=0x7f7574009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea29e8db225f721 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:26.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.086+0000 7f7589d9b700 1 -- 172.21.15.146:0/3296721129 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757400b8f0 con 0x7f758c0ced80 2023-10-06T11:13:26.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.086+0000 7f7589d9b700 1 -- 172.21.15.146:0/3296721129 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757400ba50 con 0x7f758c0ced80 2023-10-06T11:13:26.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.086+0000 7f7589d9b700 1 -- 172.21.15.146:0/3296721129 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757400bdf0 con 0x7f758c0ced80 2023-10-06T11:13:26.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.086+0000 7f7590d03700 1 -- 172.21.15.146:0/3296721129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f758c0ced80 msgr2=0x7f758c0c8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:26.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.086+0000 7f7590d03700 1 --2- 172.21.15.146:0/3296721129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f758c0ced80 0x7f758c0c8aa0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f75740099b0 tx=0x7f7574009250 comp rx=0 tx=0).stop 2023-10-06T11:13:26.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.086+0000 7f7590d03700 1 -- 172.21.15.146:0/3296721129 shutdown_connections 2023-10-06T11:13:26.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.086+0000 7f7590d03700 1 --2- 172.21.15.146:0/3296721129 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f758c0c3910 0x7f758c0cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.086+0000 7f7590d03700 1 --2- 172.21.15.146:0/3296721129 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f758c0ced80 0x7f758c0c8aa0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.086+0000 7f7590d03700 1 -- 172.21.15.146:0/3296721129 >> 172.21.15.146:0/3296721129 conn(0x7f758c067c50 msgr2=0x7f758c0ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:26.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.086+0000 7f7590d03700 1 -- 172.21.15.146:0/3296721129 shutdown_connections 2023-10-06T11:13:26.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.087+0000 7f7590d03700 1 -- 172.21.15.146:0/3296721129 wait complete. 2023-10-06T11:13:26.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.088+0000 7f7590d03700 1 Processor -- start 2023-10-06T11:13:26.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.088+0000 7f7590d03700 1 -- start start 2023-10-06T11:13:26.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.088+0000 7f7590d03700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f758c0b0c00 0x7f758c16a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:26.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.088+0000 7f7590d03700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f758c0c3910 0x7f758c0c5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:26.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.089+0000 7f7590d03700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f758c0ced80 0x7f758c155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:26.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.089+0000 7f7590d03700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f758c16d250 con 0x7f758c0c3910 2023-10-06T11:13:26.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.089+0000 7f7590d03700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f758c0c8520 con 0x7f758c0ced80 2023-10-06T11:13:26.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.089+0000 7f7590d03700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f758c16ada0 con 0x7f758c0b0c00 2023-10-06T11:13:26.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.089+0000 7f7581d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f758c0c3910 0x7f758c0c5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:26.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.089+0000 7f7581d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f758c0c3910 0x7f758c0c5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47208/0 (socket says 172.21.15.146:47208) 2023-10-06T11:13:26.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.089+0000 7f7581d9b700 1 -- 172.21.15.146:0/1761744315 learned_addr learned my addr 172.21.15.146:0/1761744315 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:26.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.089+0000 7f758a59c700 1 --2- 172.21.15.146:0/1761744315 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f758c0b0c00 0x7f758c16a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:26.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.089+0000 7f758ad9d700 1 --2- 172.21.15.146:0/1761744315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f758c0ced80 0x7f758c155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:26.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.089+0000 7f7581d9b700 1 -- 172.21.15.146:0/1761744315 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f758c0b0c00 msgr2=0x7f758c16a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:26.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.089+0000 7f7581d9b700 1 --2- 172.21.15.146:0/1761744315 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f758c0b0c00 0x7f758c16a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.089+0000 7f7581d9b700 1 -- 172.21.15.146:0/1761744315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f758c0ced80 msgr2=0x7f758c155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:26.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.089+0000 7f7581d9b700 1 --2- 172.21.15.146:0/1761744315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f758c0ced80 0x7f758c155be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.089+0000 7f7581d9b700 1 -- 172.21.15.146:0/1761744315 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75740094f0 con 0x7f758c0c3910 2023-10-06T11:13:26.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.089+0000 7f7581d9b700 1 --2- 172.21.15.146:0/1761744315 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f758c0c3910 0x7f758c0c5760 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f758c06f240 tx=0x7f7574017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:26.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.089+0000 7f7582ffd700 1 -- 172.21.15.146:0/1761744315 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7574011e40 con 0x7f758c0c3910 2023-10-06T11:13:26.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.089+0000 7f7582ffd700 1 -- 172.21.15.146:0/1761744315 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7574024440 con 0x7f758c0c3910 2023-10-06T11:13:26.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.089+0000 7f7590d03700 1 -- 172.21.15.146:0/1761744315 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f758c06cce0 con 0x7f758c0c3910 2023-10-06T11:13:26.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.089+0000 7f7582ffd700 1 -- 172.21.15.146:0/1761744315 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7574024800 con 0x7f758c0c3910 2023-10-06T11:13:26.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.089+0000 7f7590d03700 1 -- 172.21.15.146:0/1761744315 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f758c0c7bf0 con 0x7f758c0c3910 2023-10-06T11:13:26.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.090+0000 7f7590d03700 1 -- 172.21.15.146:0/1761744315 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f758c04c380 con 0x7f758c0c3910 2023-10-06T11:13:26.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.091+0000 7f7582ffd700 1 -- 172.21.15.146:0/1761744315 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f757401a420 con 0x7f758c0c3910 2023-10-06T11:13:26.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.091+0000 7f7582ffd700 1 --2- 172.21.15.146:0/1761744315 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f756c066f30 0x7f756c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:26.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.091+0000 7f7582ffd700 1 -- 172.21.15.146:0/1761744315 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f7574086160 con 0x7f758c0c3910 2023-10-06T11:13:26.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.091+0000 7f758a59c700 1 --2- 172.21.15.146:0/1761744315 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f756c066f30 0x7f756c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:26.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.091+0000 7f758a59c700 1 --2- 172.21.15.146:0/1761744315 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f756c066f30 0x7f756c0693e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f758c06d610 tx=0x7f757c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:26.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.095+0000 7f7582ffd700 1 -- 172.21.15.146:0/1761744315 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f75740535c0 con 0x7f758c0c3910 2023-10-06T11:13:26.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.353+0000 7f7590d03700 1 -- 172.21.15.146:0/1761744315 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f758c0c8ed0 con 0x7f758c0c3910 2023-10-06T11:13:26.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.353+0000 7f7582ffd700 1 -- 172.21.15.146:0/1761744315 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f7574056be0 con 0x7f758c0c3910 2023-10-06T11:13:26.355 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:13:26.356 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:13:26.356 INFO:teuthology.orchestra.run.smithi146.stdout: "auth_dump": [ 2023-10-06T11:13:26.356 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:13:26.356 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.a", 2023-10-06T11:13:26.356 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lG4F8DBAAp5A4Dtfzvv8n9ORgkmiP9g==", 2023-10-06T11:13:26.356 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:13:26.356 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:13:26.356 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:13:26.356 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:13:26.357 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:13:26.357 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:13:26.357 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:13:26.357 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:13:26.357 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.b", 2023-10-06T11:13:26.357 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lDIceGBAA4cr0oGVaXiy5hrruKY5DGw==", 2023-10-06T11:13:26.357 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:13:26.357 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:13:26.357 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:13:26.357 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:13:26.358 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:13:26.358 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:13:26.358 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:13:26.358 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:13:26.358 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.c", 2023-10-06T11:13:26.358 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lbYA7ExAAAopKjS7+WMUE5fuVQygILQ==", 2023-10-06T11:13:26.358 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:13:26.358 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:13:26.358 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:13:26.358 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:13:26.359 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:13:26.359 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:13:26.359 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:13:26.359 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:13:26.359 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.d", 2023-10-06T11:13:26.359 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9laygiHxAAasUUn7Wk9EwLa36ggsZtHw==", 2023-10-06T11:13:26.360 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:13:26.360 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:13:26.360 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:13:26.360 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:13:26.360 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:13:26.360 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:13:26.361 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:13:26.361 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:13:26.361 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.0", 2023-10-06T11:13:26.361 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDX6R9lLGo9NhAAcWJuUeOdEUsdDw84W9nLPw==", 2023-10-06T11:13:26.361 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:13:26.361 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:13:26.361 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:13:26.361 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:13:26.361 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:13:26.361 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:13:26.362 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:13:26.362 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.1", 2023-10-06T11:13:26.362 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDa6R9lk02gNBAA9YqWT2/Xds20lv0sGtBApg==", 2023-10-06T11:13:26.362 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:13:26.362 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:13:26.362 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:13:26.362 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:13:26.362 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:13:26.362 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:13:26.362 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:13:26.363 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.2", 2023-10-06T11:13:26.363 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDd6R9lrA6xMxAAmH8r6m2p4Jpa82xfYNcq+g==", 2023-10-06T11:13:26.363 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:13:26.363 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:13:26.363 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:13:26.363 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:13:26.363 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:13:26.363 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:13:26.363 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:13:26.363 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.3", 2023-10-06T11:13:26.363 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDg6R9ltlHXNBAAvhfI1yjlaWCIE9Xr/4F/PA==", 2023-10-06T11:13:26.364 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:13:26.364 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:13:26.364 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:13:26.364 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:13:26.364 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:13:26.364 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:13:26.364 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:13:26.364 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.4", 2023-10-06T11:13:26.364 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDm6R9lPUCvMhAAGbUNfpoFi9SvYdelpnL1jA==", 2023-10-06T11:13:26.364 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:13:26.364 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:13:26.365 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:13:26.365 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:13:26.365 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:13:26.365 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:13:26.365 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:13:26.365 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.5", 2023-10-06T11:13:26.366 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDp6R9lMfrMMBAAUEtnXDNr7+L3dQm4QE9qDw==", 2023-10-06T11:13:26.366 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:13:26.366 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:13:26.366 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:13:26.366 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:13:26.366 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:13:26.366 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:13:26.366 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:13:26.366 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.6", 2023-10-06T11:13:26.366 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDs6R9lAmSDMBAArPp+6dVt/NyH9is46tL49g==", 2023-10-06T11:13:26.367 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:13:26.367 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:13:26.367 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:13:26.367 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:13:26.367 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:13:26.367 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:13:26.367 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:13:26.367 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.7", 2023-10-06T11:13:26.367 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDv6R9lnunMLRAA3o5ZtAyYDUoXTzjX9H8FCw==", 2023-10-06T11:13:26.367 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:13:26.367 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:13:26.368 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:13:26.368 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:13:26.368 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:13:26.368 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:13:26.368 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:13:26.368 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.0", 2023-10-06T11:13:26.368 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lCrPrIhAARrzj2VxVFkzF5L/ifIAqmw==", 2023-10-06T11:13:26.368 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:13:26.368 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:13:26.368 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow r", 2023-10-06T11:13:26.369 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T11:13:26.369 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:13:26.369 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:13:26.369 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:13:26.369 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.1", 2023-10-06T11:13:26.369 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9l10VSKxAA0HmXejgRRCQ7XpsMB7ljkQ==", 2023-10-06T11:13:26.369 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:13:26.369 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:13:26.370 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2023-10-06T11:13:26.370 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2023-10-06T11:13:26.370 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2023-10-06T11:13:26.370 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:13:26.370 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:13:26.370 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:13:26.371 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.2", 2023-10-06T11:13:26.371 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lpLpJKBAAF/vLDkBg9/VBqMK4pVVIkg==", 2023-10-06T11:13:26.371 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:13:26.371 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:13:26.371 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2023-10-06T11:13:26.371 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2023-10-06T11:13:26.372 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2023-10-06T11:13:26.372 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:13:26.372 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:13:26.372 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:13:26.372 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.3", 2023-10-06T11:13:26.372 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9luMqwMBAA4Y4I9hWTk2IqAzYwVQ13Pw==", 2023-10-06T11:13:26.373 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:13:26.373 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:13:26.373 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2023-10-06T11:13:26.373 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2023-10-06T11:13:26.373 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2023-10-06T11:13:26.374 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:13:26.374 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:13:26.375 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:13:26.375 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.admin", 2023-10-06T11:13:26.375 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDT6R9lSr9qIhAAiNEN9xFWUwFGsB+oUE1cXw==", 2023-10-06T11:13:26.375 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:13:26.375 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2023-10-06T11:13:26.375 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:13:26.375 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:13:26.375 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:13:26.376 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:13:26.378 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:13:26.378 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:13:26.378 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.x", 2023-10-06T11:13:26.378 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9llLpwCRAA4UH9Uqli2de9HIJR2fZ9xg==", 2023-10-06T11:13:26.378 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:13:26.379 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2023-10-06T11:13:26.379 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2023-10-06T11:13:26.379 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:13:26.379 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:13:26.379 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:13:26.379 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:13:26.379 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.y", 2023-10-06T11:13:26.379 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDT6R9l2uQxNxAAVSMhKVzbf2vC4opL7YCLdg==", 2023-10-06T11:13:26.379 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:13:26.379 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2023-10-06T11:13:26.380 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2023-10-06T11:13:26.380 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:13:26.380 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:13:26.380 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:13:26.380 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2023-10-06T11:13:26.380 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:13:26.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.356+0000 7f7590d03700 1 -- 172.21.15.146:0/1761744315 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f756c066f30 msgr2=0x7f756c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:26.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.356+0000 7f7590d03700 1 --2- 172.21.15.146:0/1761744315 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f756c066f30 0x7f756c0693e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f758c06d610 tx=0x7f757c009040 comp rx=0 tx=0).stop 2023-10-06T11:13:26.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.356+0000 7f7590d03700 1 -- 172.21.15.146:0/1761744315 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f758c0c3910 msgr2=0x7f758c0c5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:26.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.356+0000 7f7590d03700 1 --2- 172.21.15.146:0/1761744315 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f758c0c3910 0x7f758c0c5760 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f758c06f240 tx=0x7f7574017000 comp rx=0 tx=0).stop 2023-10-06T11:13:26.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.356+0000 7f7590d03700 1 -- 172.21.15.146:0/1761744315 shutdown_connections 2023-10-06T11:13:26.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.356+0000 7f7590d03700 1 --2- 172.21.15.146:0/1761744315 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f756c066f30 0x7f756c0693e0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.356+0000 7f7590d03700 1 --2- 172.21.15.146:0/1761744315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f758c0ced80 0x7f758c155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.356+0000 7f7590d03700 1 --2- 172.21.15.146:0/1761744315 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f758c0b0c00 0x7f758c16a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.356+0000 7f7590d03700 1 --2- 172.21.15.146:0/1761744315 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f758c0c3910 0x7f758c0c5760 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.356+0000 7f7590d03700 1 -- 172.21.15.146:0/1761744315 >> 172.21.15.146:0/1761744315 conn(0x7f758c067c50 msgr2=0x7f758c159220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:26.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.356+0000 7f7590d03700 1 -- 172.21.15.146:0/1761744315 shutdown_connections 2023-10-06T11:13:26.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.356+0000 7f7590d03700 1 -- 172.21.15.146:0/1761744315 wait complete. 2023-10-06T11:13:26.383 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:13:26.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.497+0000 7f2c421a4700 1 Processor -- start 2023-10-06T11:13:26.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.497+0000 7f2c421a4700 1 -- start start 2023-10-06T11:13:26.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.497+0000 7f2c421a4700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2c3c06f090 0x7f2c3c06f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:26.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.497+0000 7f2c421a4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2c3c0b1a40 0x7f2c3c0aff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:26.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.497+0000 7f2c421a4700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c3c0b1e90 con 0x7f2c3c06e640 2023-10-06T11:13:26.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.497+0000 7f2c421a4700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c3c1562b0 con 0x7f2c3c0b1a40 2023-10-06T11:13:26.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.497+0000 7f2c421a4700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c3c0ac720 con 0x7f2c3c06f090 2023-10-06T11:13:26.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.498+0000 7f2c32ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2c3c0b1a40 0x7f2c3c0aff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:26.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.498+0000 7f2c32ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2c3c0b1a40 0x7f2c3c0aff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47218/0 (socket says 172.21.15.146:47218) 2023-10-06T11:13:26.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.498+0000 7f2c32ffd700 1 -- 172.21.15.146:0/2137144866 learned_addr learned my addr 172.21.15.146:0/2137144866 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:26.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.498+0000 7f2c32ffd700 1 -- 172.21.15.146:0/2137144866 >> v2:172.21.15.151:3300/0 conn(0x7f2c3c06f090 msgr2=0x7f2c3c06f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:26.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.498+0000 7f2c3b7fe700 1 --2- 172.21.15.146:0/2137144866 >> v2:172.21.15.151:3300/0 conn(0x7f2c3c06f090 0x7f2c3c06f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:26.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.498+0000 7f2c32ffd700 1 --2- 172.21.15.146:0/2137144866 >> v2:172.21.15.151:3300/0 conn(0x7f2c3c06f090 0x7f2c3c06f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.498+0000 7f2c32ffd700 1 -- 172.21.15.146:0/2137144866 >> v1:172.21.15.151:6789/0 conn(0x7f2c3c06e640 legacy=0x7f2c3c0a66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:26.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.498+0000 7f2c32ffd700 1 -- 172.21.15.146:0/2137144866 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c3c0ae660 con 0x7f2c3c0b1a40 2023-10-06T11:13:26.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.498+0000 7f2c32ffd700 1 --2- 172.21.15.146:0/2137144866 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c3c0b1a40 0x7f2c3c0aff00 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c06d1c0 tx=0x7f2c24009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27b20f0b172ba632 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:26.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.498+0000 7f2c3affd700 1 -- 172.21.15.146:0/2137144866 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2400b820 con 0x7f2c3c0b1a40 2023-10-06T11:13:26.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.498+0000 7f2c3affd700 1 -- 172.21.15.146:0/2137144866 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c2400b980 con 0x7f2c3c0b1a40 2023-10-06T11:13:26.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.498+0000 7f2c3affd700 1 -- 172.21.15.146:0/2137144866 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2400bd20 con 0x7f2c3c0b1a40 2023-10-06T11:13:26.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.499+0000 7f2c421a4700 1 -- 172.21.15.146:0/2137144866 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c3c0b1a40 msgr2=0x7f2c3c0aff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:26.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.499+0000 7f2c421a4700 1 --2- 172.21.15.146:0/2137144866 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c3c0b1a40 0x7f2c3c0aff00 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c06d1c0 tx=0x7f2c24009250 comp rx=0 tx=0).stop 2023-10-06T11:13:26.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.499+0000 7f2c421a4700 1 -- 172.21.15.146:0/2137144866 shutdown_connections 2023-10-06T11:13:26.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.499+0000 7f2c421a4700 1 --2- 172.21.15.146:0/2137144866 >> v2:172.21.15.151:3300/0 conn(0x7f2c3c06f090 0x7f2c3c06f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.499+0000 7f2c421a4700 1 --2- 172.21.15.146:0/2137144866 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c3c0b1a40 0x7f2c3c0aff00 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.499+0000 7f2c421a4700 1 -- 172.21.15.146:0/2137144866 >> 172.21.15.146:0/2137144866 conn(0x7f2c3c0cc260 msgr2=0x7f2c3c0cc660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:26.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.499+0000 7f2c421a4700 1 -- 172.21.15.146:0/2137144866 shutdown_connections 2023-10-06T11:13:26.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.499+0000 7f2c421a4700 1 -- 172.21.15.146:0/2137144866 wait complete. 2023-10-06T11:13:26.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.500+0000 7f2c421a4700 1 Processor -- start 2023-10-06T11:13:26.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.500+0000 7f2c421a4700 1 -- start start 2023-10-06T11:13:26.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.501+0000 7f2c421a4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c3c06e640 0x7f2c3c0cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:26.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.501+0000 7f2c421a4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c3c06f090 0x7f2c3c14e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:26.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.501+0000 7f2c421a4700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c3c0b1a40 0x7f2c3c158980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:26.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.501+0000 7f2c421a4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c1584f0 con 0x7f2c3c06e640 2023-10-06T11:13:26.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.501+0000 7f2c421a4700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c1578e0 con 0x7f2c3c06f090 2023-10-06T11:13:26.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.501+0000 7f2c421a4700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3c157bc0 con 0x7f2c3c0b1a40 2023-10-06T11:13:26.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.501+0000 7f2c3b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c3c06e640 0x7f2c3c0cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:26.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.501+0000 7f2c3b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c3c06e640 0x7f2c3c0cb2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47228/0 (socket says 172.21.15.146:47228) 2023-10-06T11:13:26.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.501+0000 7f2c3b7fe700 1 -- 172.21.15.146:0/3736047255 learned_addr learned my addr 172.21.15.146:0/3736047255 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:26.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.501+0000 7f2c32ffd700 1 --2- 172.21.15.146:0/3736047255 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c3c06f090 0x7f2c3c14e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:26.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.501+0000 7f2c3bfff700 1 --2- 172.21.15.146:0/3736047255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c3c0b1a40 0x7f2c3c158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:26.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.501+0000 7f2c3b7fe700 1 -- 172.21.15.146:0/3736047255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c3c0b1a40 msgr2=0x7f2c3c158980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:26.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.501+0000 7f2c3b7fe700 1 --2- 172.21.15.146:0/3736047255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c3c0b1a40 0x7f2c3c158980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.501+0000 7f2c3b7fe700 1 -- 172.21.15.146:0/3736047255 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c3c06f090 msgr2=0x7f2c3c14e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:26.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.501+0000 7f2c3b7fe700 1 --2- 172.21.15.146:0/3736047255 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c3c06f090 0x7f2c3c14e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.501+0000 7f2c3b7fe700 1 -- 172.21.15.146:0/3736047255 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c240094f0 con 0x7f2c3c06e640 2023-10-06T11:13:26.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.501+0000 7f2c3bfff700 1 --2- 172.21.15.146:0/3736047255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c3c0b1a40 0x7f2c3c158980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:26.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.501+0000 7f2c3b7fe700 1 --2- 172.21.15.146:0/3736047255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c3c06e640 0x7f2c3c0cb2b0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c00c7d0 tx=0x7f2c2c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:26.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.501+0000 7f2c33fff700 1 -- 172.21.15.146:0/3736047255 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c011600 con 0x7f2c3c06e640 2023-10-06T11:13:26.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.501+0000 7f2c33fff700 1 -- 172.21.15.146:0/3736047255 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c2c011760 con 0x7f2c3c06e640 2023-10-06T11:13:26.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.501+0000 7f2c421a4700 1 -- 172.21.15.146:0/3736047255 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c3c157ea0 con 0x7f2c3c06e640 2023-10-06T11:13:26.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.501+0000 7f2c33fff700 1 -- 172.21.15.146:0/3736047255 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c2c011b20 con 0x7f2c3c06e640 2023-10-06T11:13:26.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.501+0000 7f2c421a4700 1 -- 172.21.15.146:0/3736047255 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c3c0cb7f0 con 0x7f2c3c06e640 2023-10-06T11:13:26.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.502+0000 7f2c421a4700 1 -- 172.21.15.146:0/3736047255 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c3c04c380 con 0x7f2c3c06e640 2023-10-06T11:13:26.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.503+0000 7f2c33fff700 1 -- 172.21.15.146:0/3736047255 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2c2c018350 con 0x7f2c3c06e640 2023-10-06T11:13:26.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.503+0000 7f2c33fff700 1 --2- 172.21.15.146:0/3736047255 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2c1c066f30 0x7f2c1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:26.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.503+0000 7f2c33fff700 1 -- 172.21.15.146:0/3736047255 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f2c2c084250 con 0x7f2c3c06e640 2023-10-06T11:13:26.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.503+0000 7f2c32ffd700 1 --2- 172.21.15.146:0/3736047255 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2c1c066f30 0x7f2c1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:26.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.504+0000 7f2c32ffd700 1 --2- 172.21.15.146:0/3736047255 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2c1c066f30 0x7f2c1c0693e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c06d1c0 tx=0x7f2c24016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:26.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.507+0000 7f2c33fff700 1 -- 172.21.15.146:0/3736047255 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2c2c0516b0 con 0x7f2c3c06e640 2023-10-06T11:13:26.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.692+0000 7f2c421a4700 1 -- 172.21.15.146:0/3736047255 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c3c1587d0 con 0x7f2c3c06e640 2023-10-06T11:13:26.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.693+0000 7f2c33fff700 1 -- 172.21.15.146:0/3736047255 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+13699 (secure 0 0 0) 0x7f2c2c054cd0 con 0x7f2c3c06e640 2023-10-06T11:13:26.695 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:13:26.695 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":97,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:13:25.941768+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:13:26.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.695+0000 7f2c421a4700 1 -- 172.21.15.146:0/3736047255 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2c1c066f30 msgr2=0x7f2c1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:26.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.695+0000 7f2c421a4700 1 --2- 172.21.15.146:0/3736047255 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2c1c066f30 0x7f2c1c0693e0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c06d1c0 tx=0x7f2c24016000 comp rx=0 tx=0).stop 2023-10-06T11:13:26.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.695+0000 7f2c421a4700 1 -- 172.21.15.146:0/3736047255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c3c06e640 msgr2=0x7f2c3c0cb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:26.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.695+0000 7f2c421a4700 1 --2- 172.21.15.146:0/3736047255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c3c06e640 0x7f2c3c0cb2b0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f2c2c00c7d0 tx=0x7f2c2c008040 comp rx=0 tx=0).stop 2023-10-06T11:13:26.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.695+0000 7f2c421a4700 1 -- 172.21.15.146:0/3736047255 shutdown_connections 2023-10-06T11:13:26.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.695+0000 7f2c421a4700 1 --2- 172.21.15.146:0/3736047255 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2c1c066f30 0x7f2c1c0693e0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.695+0000 7f2c421a4700 1 --2- 172.21.15.146:0/3736047255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2c3c0b1a40 0x7f2c3c158980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.695+0000 7f2c421a4700 1 --2- 172.21.15.146:0/3736047255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2c3c06e640 0x7f2c3c0cb2b0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.695+0000 7f2c421a4700 1 --2- 172.21.15.146:0/3736047255 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c3c06f090 0x7f2c3c14e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.695+0000 7f2c421a4700 1 -- 172.21.15.146:0/3736047255 >> 172.21.15.146:0/3736047255 conn(0x7f2c3c0cc260 msgr2=0x7f2c3c069a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:26.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.695+0000 7f2c421a4700 1 -- 172.21.15.146:0/3736047255 shutdown_connections 2023-10-06T11:13:26.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.695+0000 7f2c421a4700 1 -- 172.21.15.146:0/3736047255 wait complete. 2023-10-06T11:13:26.709 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:05:36.687307+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:05:37.171199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T11:13:26.710 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:13:26.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.826+0000 7f7ace1de700 1 Processor -- start 2023-10-06T11:13:26.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.826+0000 7f7ace1de700 1 -- start start 2023-10-06T11:13:26.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.827+0000 7f7ace1de700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7ac80adbd0 0x7f7ac8156160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:26.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.827+0000 7f7ace1de700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7ac81566a0 0x7f7ac80adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:26.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.827+0000 7f7ace1de700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ac81579f0 con 0x7f7ac80ae4e0 2023-10-06T11:13:26.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.827+0000 7f7ace1de700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ac8068290 con 0x7f7ac81566a0 2023-10-06T11:13:26.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.827+0000 7f7ace1de700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ac8156b10 con 0x7f7ac80adbd0 2023-10-06T11:13:26.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.827+0000 7f7ac6ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7ac81566a0 0x7f7ac80adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:26.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.827+0000 7f7ac7fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7ac80ae4e0 0x7f7ac8067b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:32826/0 (socket says 172.21.15.146:32826) 2023-10-06T11:13:26.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.827+0000 7f7ac7fff700 1 -- 172.21.15.146:0/3167798139 learned_addr learned my addr 172.21.15.146:0/3167798139 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:13:26.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.828+0000 7f7ac77fe700 1 --2- 172.21.15.146:0/3167798139 >> v2:172.21.15.151:3300/0 conn(0x7f7ac80adbd0 0x7f7ac8156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:26.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.828+0000 7f7ac6ffd700 1 -- 172.21.15.146:0/3167798139 >> v2:172.21.15.151:3300/0 conn(0x7f7ac80adbd0 msgr2=0x7f7ac8156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:26.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.828+0000 7f7ac6ffd700 1 --2- 172.21.15.146:0/3167798139 >> v2:172.21.15.151:3300/0 conn(0x7f7ac80adbd0 0x7f7ac8156160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.828+0000 7f7ac6ffd700 1 -- 172.21.15.146:0/3167798139 >> v1:172.21.15.146:6789/0 conn(0x7f7ac80ae4e0 legacy=0x7f7ac8067b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:26.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.828+0000 7f7ac6ffd700 1 -- 172.21.15.146:0/3167798139 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac8156de0 con 0x7f7ac81566a0 2023-10-06T11:13:26.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.828+0000 7f7ac67fc700 1 -- 172.21.15.146:0/3167798139 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 184496499 0 0) 0x7f7ac81579f0 con 0x7f7ac80ae4e0 2023-10-06T11:13:26.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.828+0000 7f7ac6ffd700 1 --2- 172.21.15.146:0/3167798139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ac81566a0 0x7f7ac80adfa0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f7ac80719b0 tx=0x7f7abc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=989ef550f57dc482 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:26.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.828+0000 7f7ac67fc700 1 -- 172.21.15.146:0/3167798139 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7abc011630 con 0x7f7ac81566a0 2023-10-06T11:13:26.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.828+0000 7f7ac67fc700 1 -- 172.21.15.146:0/3167798139 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7abc011790 con 0x7f7ac81566a0 2023-10-06T11:13:26.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.828+0000 7f7ac67fc700 1 -- 172.21.15.146:0/3167798139 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7abc011b30 con 0x7f7ac81566a0 2023-10-06T11:13:26.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.828+0000 7f7ace1de700 1 -- 172.21.15.146:0/3167798139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ac81566a0 msgr2=0x7f7ac80adfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:26.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.828+0000 7f7ace1de700 1 --2- 172.21.15.146:0/3167798139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ac81566a0 0x7f7ac80adfa0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f7ac80719b0 tx=0x7f7abc0091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.828+0000 7f7ace1de700 1 -- 172.21.15.146:0/3167798139 shutdown_connections 2023-10-06T11:13:26.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.828+0000 7f7ace1de700 1 --2- 172.21.15.146:0/3167798139 >> v2:172.21.15.151:3300/0 conn(0x7f7ac80adbd0 0x7f7ac8156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.828+0000 7f7ace1de700 1 --2- 172.21.15.146:0/3167798139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ac81566a0 0x7f7ac80adfa0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.829+0000 7f7ace1de700 1 -- 172.21.15.146:0/3167798139 >> 172.21.15.146:0/3167798139 conn(0x7f7ac806a070 msgr2=0x7f7ac8067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:26.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.829+0000 7f7ace1de700 1 -- 172.21.15.146:0/3167798139 shutdown_connections 2023-10-06T11:13:26.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.829+0000 7f7ace1de700 1 -- 172.21.15.146:0/3167798139 wait complete. 2023-10-06T11:13:26.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.830+0000 7f7ace1de700 1 Processor -- start 2023-10-06T11:13:26.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.830+0000 7f7ace1de700 1 -- start start 2023-10-06T11:13:26.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.830+0000 7f7ace1de700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ac80adbd0 0x7f7ac8169300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:26.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.830+0000 7f7ace1de700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ac80ae4e0 0x7f7ac81467f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:26.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.831+0000 7f7ace1de700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ac81566a0 0x7f7ac81528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:26.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.831+0000 7f7ace1de700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac8149ab0 con 0x7f7ac80adbd0 2023-10-06T11:13:26.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.831+0000 7f7ace1de700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac8169840 con 0x7f7ac81566a0 2023-10-06T11:13:26.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.831+0000 7f7ace1de700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ac815a240 con 0x7f7ac80ae4e0 2023-10-06T11:13:26.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.831+0000 7f7ac77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ac80adbd0 0x7f7ac8169300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:26.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.831+0000 7f7ac77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ac80adbd0 0x7f7ac8169300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47256/0 (socket says 172.21.15.146:47256) 2023-10-06T11:13:26.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.831+0000 7f7ac77fe700 1 -- 172.21.15.146:0/2483056126 learned_addr learned my addr 172.21.15.146:0/2483056126 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:26.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.831+0000 7f7ac6ffd700 1 --2- 172.21.15.146:0/2483056126 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ac80ae4e0 0x7f7ac81467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:26.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.831+0000 7f7ac7fff700 1 --2- 172.21.15.146:0/2483056126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ac81566a0 0x7f7ac81528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:26.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.831+0000 7f7ac77fe700 1 -- 172.21.15.146:0/2483056126 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ac80ae4e0 msgr2=0x7f7ac81467f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:26.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.831+0000 7f7ac77fe700 1 --2- 172.21.15.146:0/2483056126 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ac80ae4e0 0x7f7ac81467f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.831+0000 7f7ac77fe700 1 -- 172.21.15.146:0/2483056126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ac81566a0 msgr2=0x7f7ac81528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:26.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.831+0000 7f7ac77fe700 1 --2- 172.21.15.146:0/2483056126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ac81566a0 0x7f7ac81528c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:26.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.831+0000 7f7ac77fe700 1 -- 172.21.15.146:0/2483056126 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7abc009420 con 0x7f7ac80adbd0 2023-10-06T11:13:26.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.831+0000 7f7ac7fff700 1 --2- 172.21.15.146:0/2483056126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ac81566a0 0x7f7ac81528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:26.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.831+0000 7f7ac77fe700 1 --2- 172.21.15.146:0/2483056126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ac80adbd0 0x7f7ac8169300 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8009ef0 tx=0x7f7ab800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:26.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.831+0000 7f7aaf7fe700 1 -- 172.21.15.146:0/2483056126 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab800cc20 con 0x7f7ac80adbd0 2023-10-06T11:13:26.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.831+0000 7f7aaf7fe700 1 -- 172.21.15.146:0/2483056126 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab800f040 con 0x7f7ac80adbd0 2023-10-06T11:13:26.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.831+0000 7f7ace1de700 1 -- 172.21.15.146:0/2483056126 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ac8149180 con 0x7f7ac80adbd0 2023-10-06T11:13:26.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.831+0000 7f7aaf7fe700 1 -- 172.21.15.146:0/2483056126 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab8014480 con 0x7f7ac80adbd0 2023-10-06T11:13:26.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.831+0000 7f7ace1de700 1 -- 172.21.15.146:0/2483056126 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ac8149740 con 0x7f7ac80adbd0 2023-10-06T11:13:26.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.832+0000 7f7ace1de700 1 -- 172.21.15.146:0/2483056126 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ac804c380 con 0x7f7ac80adbd0 2023-10-06T11:13:26.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.833+0000 7f7aaf7fe700 1 -- 172.21.15.146:0/2483056126 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7ab80147f0 con 0x7f7ac80adbd0 2023-10-06T11:13:26.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.833+0000 7f7aaf7fe700 1 --2- 172.21.15.146:0/2483056126 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7ab4066f30 0x7f7ab40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:26.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.833+0000 7f7aaf7fe700 1 -- 172.21.15.146:0/2483056126 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f7ab8084d80 con 0x7f7ac80adbd0 2023-10-06T11:13:26.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.833+0000 7f7ac6ffd700 1 --2- 172.21.15.146:0/2483056126 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7ab4066f30 0x7f7ab40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:26.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.833+0000 7f7ac6ffd700 1 --2- 172.21.15.146:0/2483056126 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7ab4066f30 0x7f7ab40693e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f7abc0093f0 tx=0x7f7abc017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:26.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:26.837+0000 7f7aaf7fe700 1 -- 172.21.15.146:0/2483056126 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7ab80521e0 con 0x7f7ac80adbd0 2023-10-06T11:13:27.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.021+0000 7f7ace1de700 1 -- 172.21.15.146:0/2483056126 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7ac8149d90 con 0x7f7ac80adbd0 2023-10-06T11:13:27.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.021+0000 7f7aaf7fe700 1 -- 172.21.15.146:0/2483056126 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v97) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7ab8055800 con 0x7f7ac80adbd0 2023-10-06T11:13:27.023 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-10-06T11:13:27.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.023+0000 7f7ace1de700 1 -- 172.21.15.146:0/2483056126 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7ab4066f30 msgr2=0x7f7ab40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:27.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.024+0000 7f7ace1de700 1 --2- 172.21.15.146:0/2483056126 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7ab4066f30 0x7f7ab40693e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f7abc0093f0 tx=0x7f7abc017000 comp rx=0 tx=0).stop 2023-10-06T11:13:27.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.024+0000 7f7ace1de700 1 -- 172.21.15.146:0/2483056126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ac80adbd0 msgr2=0x7f7ac8169300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:27.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.024+0000 7f7ace1de700 1 --2- 172.21.15.146:0/2483056126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ac80adbd0 0x7f7ac8169300 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8009ef0 tx=0x7f7ab800b040 comp rx=0 tx=0).stop 2023-10-06T11:13:27.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.024+0000 7f7ace1de700 1 -- 172.21.15.146:0/2483056126 shutdown_connections 2023-10-06T11:13:27.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.024+0000 7f7ace1de700 1 --2- 172.21.15.146:0/2483056126 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7ab4066f30 0x7f7ab40693e0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.024+0000 7f7ace1de700 1 --2- 172.21.15.146:0/2483056126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ac81566a0 0x7f7ac81528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.024+0000 7f7ace1de700 1 --2- 172.21.15.146:0/2483056126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ac80adbd0 0x7f7ac8169300 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.024+0000 7f7ace1de700 1 --2- 172.21.15.146:0/2483056126 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ac80ae4e0 0x7f7ac81467f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.024+0000 7f7ace1de700 1 -- 172.21.15.146:0/2483056126 >> 172.21.15.146:0/2483056126 conn(0x7f7ac806a070 msgr2=0x7f7ac81486a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:27.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.024+0000 7f7ace1de700 1 -- 172.21.15.146:0/2483056126 shutdown_connections 2023-10-06T11:13:27.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.024+0000 7f7ace1de700 1 -- 172.21.15.146:0/2483056126 wait complete. 2023-10-06T11:13:27.038 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:13:27.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.153+0000 7f549d1b7700 1 Processor -- start 2023-10-06T11:13:27.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.153+0000 7f549d1b7700 1 -- start start 2023-10-06T11:13:27.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.154+0000 7f549d1b7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f549815a160 0x7f54980c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:27.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.154+0000 7f549d1b7700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54980ae730 0x7f54980aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:27.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.154+0000 7f549d1b7700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f54980ce3d0 0x7f54980ce830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:27.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.154+0000 7f549d1b7700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54980ae2a0 con 0x7f549815a160 2023-10-06T11:13:27.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.154+0000 7f549d1b7700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f549815a530 con 0x7f54980ce3d0 2023-10-06T11:13:27.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.154+0000 7f549d1b7700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54980ad690 con 0x7f54980ae730 2023-10-06T11:13:27.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.154+0000 7f5496d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f549815a160 0x7f54980c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:27.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.154+0000 7f5496d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f549815a160 0x7f54980c55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47258/0 (socket says 172.21.15.146:47258) 2023-10-06T11:13:27.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.154+0000 7f5496d9d700 1 -- 172.21.15.146:0/2741005855 learned_addr learned my addr 172.21.15.146:0/2741005855 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:27.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.154+0000 7f549759e700 1 --2- 172.21.15.146:0/2741005855 >> v2:172.21.15.151:3300/0 conn(0x7f54980ce3d0 0x7f54980ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:27.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.154+0000 7f548e59c700 1 --2- 172.21.15.146:0/2741005855 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54980ae730 0x7f54980aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:27.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.154+0000 7f5496d9d700 1 -- 172.21.15.146:0/2741005855 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54980ae730 msgr2=0x7f54980aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:27.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.154+0000 7f5496d9d700 1 --2- 172.21.15.146:0/2741005855 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54980ae730 0x7f54980aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.154+0000 7f5496d9d700 1 -- 172.21.15.146:0/2741005855 >> v2:172.21.15.151:3300/0 conn(0x7f54980ce3d0 msgr2=0x7f54980ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:27.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.154+0000 7f5496d9d700 1 --2- 172.21.15.146:0/2741005855 >> v2:172.21.15.151:3300/0 conn(0x7f54980ce3d0 0x7f54980ce830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.154+0000 7f5496d9d700 1 -- 172.21.15.146:0/2741005855 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54980ad970 con 0x7f549815a160 2023-10-06T11:13:27.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.154+0000 7f548e59c700 1 --2- 172.21.15.146:0/2741005855 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54980ae730 0x7f54980aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:27.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.155+0000 7f5496d9d700 1 --2- 172.21.15.146:0/2741005855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f549815a160 0x7f54980c55a0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f5498089c40 tx=0x7f5488009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a1486d26aef0987 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:27.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.155+0000 7f549659c700 1 -- 172.21.15.146:0/2741005855 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5488005c10 con 0x7f549815a160 2023-10-06T11:13:27.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.155+0000 7f549659c700 1 -- 172.21.15.146:0/2741005855 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5488005d70 con 0x7f549815a160 2023-10-06T11:13:27.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.155+0000 7f549659c700 1 -- 172.21.15.146:0/2741005855 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5488006260 con 0x7f549815a160 2023-10-06T11:13:27.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.155+0000 7f549d1b7700 1 -- 172.21.15.146:0/2741005855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f549815a160 msgr2=0x7f54980c55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:27.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.155+0000 7f549d1b7700 1 --2- 172.21.15.146:0/2741005855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f549815a160 0x7f54980c55a0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f5498089c40 tx=0x7f5488009220 comp rx=0 tx=0).stop 2023-10-06T11:13:27.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.155+0000 7f549d1b7700 1 -- 172.21.15.146:0/2741005855 shutdown_connections 2023-10-06T11:13:27.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.155+0000 7f549d1b7700 1 --2- 172.21.15.146:0/2741005855 >> v2:172.21.15.151:3300/0 conn(0x7f54980ce3d0 0x7f54980ce830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.155+0000 7f549d1b7700 1 --2- 172.21.15.146:0/2741005855 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f549815a160 0x7f54980c55a0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.155+0000 7f549d1b7700 1 --2- 172.21.15.146:0/2741005855 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54980ae730 0x7f54980aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.155+0000 7f549d1b7700 1 -- 172.21.15.146:0/2741005855 >> 172.21.15.146:0/2741005855 conn(0x7f549806f380 msgr2=0x7f54980d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:27.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.155+0000 7f549d1b7700 1 -- 172.21.15.146:0/2741005855 shutdown_connections 2023-10-06T11:13:27.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.155+0000 7f549d1b7700 1 -- 172.21.15.146:0/2741005855 wait complete. 2023-10-06T11:13:27.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.157+0000 7f549d1b7700 1 Processor -- start 2023-10-06T11:13:27.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.157+0000 7f549d1b7700 1 -- start start 2023-10-06T11:13:27.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.157+0000 7f549d1b7700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54980ae730 0x7f54980ca230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:27.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.157+0000 7f549d1b7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54980ce3d0 0x7f549815c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:27.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.157+0000 7f549d1b7700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f549815a160 0x7f54980c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:27.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.157+0000 7f549d1b7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54980b4520 con 0x7f54980ce3d0 2023-10-06T11:13:27.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.157+0000 7f549d1b7700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549815f9f0 con 0x7f54980ae730 2023-10-06T11:13:27.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.157+0000 7f549d1b7700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f549815f430 con 0x7f549815a160 2023-10-06T11:13:27.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.157+0000 7f548e59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54980ce3d0 0x7f549815c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:27.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.157+0000 7f548e59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54980ce3d0 0x7f549815c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47264/0 (socket says 172.21.15.146:47264) 2023-10-06T11:13:27.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.157+0000 7f548e59c700 1 -- 172.21.15.146:0/2016340187 learned_addr learned my addr 172.21.15.146:0/2016340187 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:27.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.158+0000 7f5496d9d700 1 --2- 172.21.15.146:0/2016340187 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54980ae730 0x7f54980ca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:27.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.158+0000 7f549759e700 1 --2- 172.21.15.146:0/2016340187 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f549815a160 0x7f54980c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:27.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.158+0000 7f548e59c700 1 -- 172.21.15.146:0/2016340187 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f549815a160 msgr2=0x7f54980c7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:27.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.158+0000 7f548e59c700 1 --2- 172.21.15.146:0/2016340187 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f549815a160 0x7f54980c7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.158+0000 7f548e59c700 1 -- 172.21.15.146:0/2016340187 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54980ae730 msgr2=0x7f54980ca230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:27.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.158+0000 7f548e59c700 1 --2- 172.21.15.146:0/2016340187 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54980ae730 0x7f54980ca230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.158+0000 7f548e59c700 1 -- 172.21.15.146:0/2016340187 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5488009480 con 0x7f54980ce3d0 2023-10-06T11:13:27.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.158+0000 7f5496d9d700 1 --2- 172.21.15.146:0/2016340187 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54980ae730 0x7f54980ca230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:27.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.158+0000 7f548e59c700 1 --2- 172.21.15.146:0/2016340187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54980ce3d0 0x7f549815c770 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f548000d860 tx=0x7f5480008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:27.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.158+0000 7f548f7fe700 1 -- 172.21.15.146:0/2016340187 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54800125f0 con 0x7f54980ce3d0 2023-10-06T11:13:27.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.158+0000 7f548f7fe700 1 -- 172.21.15.146:0/2016340187 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5480012750 con 0x7f54980ce3d0 2023-10-06T11:13:27.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.158+0000 7f549d1b7700 1 -- 172.21.15.146:0/2016340187 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f549815f710 con 0x7f54980ce3d0 2023-10-06T11:13:27.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.158+0000 7f548f7fe700 1 -- 172.21.15.146:0/2016340187 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5480012ad0 con 0x7f54980ce3d0 2023-10-06T11:13:27.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.158+0000 7f549d1b7700 1 -- 172.21.15.146:0/2016340187 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54980c7f80 con 0x7f54980ce3d0 2023-10-06T11:13:27.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.159+0000 7f549d1b7700 1 -- 172.21.15.146:0/2016340187 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5498068390 con 0x7f54980ce3d0 2023-10-06T11:13:27.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.159+0000 7f548f7fe700 1 -- 172.21.15.146:0/2016340187 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5480014430 con 0x7f54980ce3d0 2023-10-06T11:13:27.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.160+0000 7f548f7fe700 1 --2- 172.21.15.146:0/2016340187 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5478066f30 0x7f54780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:27.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.160+0000 7f5496d9d700 1 --2- 172.21.15.146:0/2016340187 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5478066f30 0x7f54780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:27.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.160+0000 7f548f7fe700 1 -- 172.21.15.146:0/2016340187 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f5480084790 con 0x7f54980ce3d0 2023-10-06T11:13:27.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.160+0000 7f5496d9d700 1 --2- 172.21.15.146:0/2016340187 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5478066f30 0x7f54780693e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f5488009260 tx=0x7f5488016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:27.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.164+0000 7f548f7fe700 1 -- 172.21.15.146:0/2016340187 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5480055680 con 0x7f54980ce3d0 2023-10-06T11:13:27.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.349+0000 7f549d1b7700 1 -- 172.21.15.146:0/2016340187 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f549804c380 con 0x7f54980ce3d0 2023-10-06T11:13:27.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.350+0000 7f548f7fe700 1 -- 172.21.15.146:0/2016340187 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v97) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5480055210 con 0x7f54980ce3d0 2023-10-06T11:13:27.352 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-10-06T11:13:27.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.352+0000 7f549d1b7700 1 -- 172.21.15.146:0/2016340187 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5478066f30 msgr2=0x7f54780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:27.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.352+0000 7f549d1b7700 1 --2- 172.21.15.146:0/2016340187 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5478066f30 0x7f54780693e0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f5488009260 tx=0x7f5488016000 comp rx=0 tx=0).stop 2023-10-06T11:13:27.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.352+0000 7f549d1b7700 1 -- 172.21.15.146:0/2016340187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54980ce3d0 msgr2=0x7f549815c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:27.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.352+0000 7f549d1b7700 1 --2- 172.21.15.146:0/2016340187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54980ce3d0 0x7f549815c770 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f548000d860 tx=0x7f5480008040 comp rx=0 tx=0).stop 2023-10-06T11:13:27.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.352+0000 7f549d1b7700 1 -- 172.21.15.146:0/2016340187 shutdown_connections 2023-10-06T11:13:27.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.352+0000 7f549d1b7700 1 --2- 172.21.15.146:0/2016340187 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5478066f30 0x7f54780693e0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.352+0000 7f549d1b7700 1 --2- 172.21.15.146:0/2016340187 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f549815a160 0x7f54980c7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.352+0000 7f549d1b7700 1 --2- 172.21.15.146:0/2016340187 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54980ae730 0x7f54980ca230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.352+0000 7f549d1b7700 1 --2- 172.21.15.146:0/2016340187 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f54980ce3d0 0x7f549815c770 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.352+0000 7f549d1b7700 1 -- 172.21.15.146:0/2016340187 >> 172.21.15.146:0/2016340187 conn(0x7f549806f380 msgr2=0x7f54980c6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:27.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.352+0000 7f549d1b7700 1 -- 172.21.15.146:0/2016340187 shutdown_connections 2023-10-06T11:13:27.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.352+0000 7f549d1b7700 1 -- 172.21.15.146:0/2016340187 wait complete. 2023-10-06T11:13:27.366 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T11:13:27.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.479+0000 7faaa5cc3700 1 Processor -- start 2023-10-06T11:13:27.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.479+0000 7faaa5cc3700 1 -- start start 2023-10-06T11:13:27.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.479+0000 7faaa5cc3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faaa0153ab0 0x7faaa015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:27.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.480+0000 7faaa5cc3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faaa0153e80 0x7faaa0068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:27.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.480+0000 7faaa5cc3700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7faaa00689d0 0x7faaa015d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:27.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.480+0000 7faaa5cc3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaa0068e50 con 0x7faaa0153e80 2023-10-06T11:13:27.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.480+0000 7faaa5cc3700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaa015ac30 con 0x7faaa00689d0 2023-10-06T11:13:27.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.480+0000 7faaa5cc3700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa00b4510 con 0x7faaa0153ab0 2023-10-06T11:13:27.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.480+0000 7faa9effd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faaa0153e80 0x7faaa0068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:27.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.480+0000 7faa9effd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faaa0153e80 0x7faaa0068490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47280/0 (socket says 172.21.15.146:47280) 2023-10-06T11:13:27.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.480+0000 7faa9effd700 1 -- 172.21.15.146:0/4202784732 learned_addr learned my addr 172.21.15.146:0/4202784732 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:27.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.480+0000 7faa9ffff700 1 --2- 172.21.15.146:0/4202784732 >> v2:172.21.15.151:3300/0 conn(0x7faaa00689d0 0x7faaa015d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:27.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.480+0000 7faa9f7fe700 1 --2- 172.21.15.146:0/4202784732 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faaa0153ab0 0x7faaa015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:27.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.480+0000 7faa9effd700 1 -- 172.21.15.146:0/4202784732 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faaa0153ab0 msgr2=0x7faaa015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:27.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.480+0000 7faa9effd700 1 --2- 172.21.15.146:0/4202784732 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faaa0153ab0 0x7faaa015a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.480+0000 7faa9effd700 1 -- 172.21.15.146:0/4202784732 >> v2:172.21.15.151:3300/0 conn(0x7faaa00689d0 msgr2=0x7faaa015d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:27.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.480+0000 7faa9effd700 1 --2- 172.21.15.146:0/4202784732 >> v2:172.21.15.151:3300/0 conn(0x7faaa00689d0 0x7faaa015d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.480+0000 7faa9effd700 1 -- 172.21.15.146:0/4202784732 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa00b6530 con 0x7faaa0153e80 2023-10-06T11:13:27.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.480+0000 7faa9effd700 1 --2- 172.21.15.146:0/4202784732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaa0153e80 0x7faaa0068490 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7faaa0089a80 tx=0x7faa94009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eef8bc285c662f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:27.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.480+0000 7faa9e7fc700 1 -- 172.21.15.146:0/4202784732 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9400b640 con 0x7faaa0153e80 2023-10-06T11:13:27.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.480+0000 7faa9e7fc700 1 -- 172.21.15.146:0/4202784732 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa9400b7a0 con 0x7faaa0153e80 2023-10-06T11:13:27.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.480+0000 7faa9e7fc700 1 -- 172.21.15.146:0/4202784732 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9400bb60 con 0x7faaa0153e80 2023-10-06T11:13:27.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.481+0000 7faaa5cc3700 1 -- 172.21.15.146:0/4202784732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaa0153e80 msgr2=0x7faaa0068490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:27.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.481+0000 7faaa5cc3700 1 --2- 172.21.15.146:0/4202784732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaa0153e80 0x7faaa0068490 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7faaa0089a80 tx=0x7faa94009250 comp rx=0 tx=0).stop 2023-10-06T11:13:27.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.481+0000 7faaa5cc3700 1 -- 172.21.15.146:0/4202784732 shutdown_connections 2023-10-06T11:13:27.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.481+0000 7faaa5cc3700 1 --2- 172.21.15.146:0/4202784732 >> v2:172.21.15.151:3300/0 conn(0x7faaa00689d0 0x7faaa015d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.481+0000 7faaa5cc3700 1 --2- 172.21.15.146:0/4202784732 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faaa0153ab0 0x7faaa015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.481+0000 7faaa5cc3700 1 --2- 172.21.15.146:0/4202784732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaa0153e80 0x7faaa0068490 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.481+0000 7faaa5cc3700 1 -- 172.21.15.146:0/4202784732 >> 172.21.15.146:0/4202784732 conn(0x7faaa006eba0 msgr2=0x7faaa006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:27.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.481+0000 7faaa5cc3700 1 -- 172.21.15.146:0/4202784732 shutdown_connections 2023-10-06T11:13:27.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.481+0000 7faaa5cc3700 1 -- 172.21.15.146:0/4202784732 wait complete. 2023-10-06T11:13:27.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.482+0000 7faaa5cc3700 1 Processor -- start 2023-10-06T11:13:27.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.482+0000 7faaa5cc3700 1 -- start start 2023-10-06T11:13:27.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.483+0000 7faaa5cc3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaa00689d0 0x7faaa01585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:27.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.483+0000 7faaa5cc3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faaa0153ab0 0x7faaa00b1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:27.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.483+0000 7faaa5cc3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faaa0153e80 0x7faaa0144cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:27.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.483+0000 7faaa5cc3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa0154320 con 0x7faaa00689d0 2023-10-06T11:13:27.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.483+0000 7faaa5cc3700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa0155140 con 0x7faaa0153ab0 2023-10-06T11:13:27.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.483+0000 7faaa5cc3700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa0154530 con 0x7faaa0153e80 2023-10-06T11:13:27.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.483+0000 7faa9f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaa00689d0 0x7faaa01585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:27.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.483+0000 7faa9f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaa00689d0 0x7faaa01585f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47282/0 (socket says 172.21.15.146:47282) 2023-10-06T11:13:27.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.483+0000 7faa9f7fe700 1 -- 172.21.15.146:0/1013531768 learned_addr learned my addr 172.21.15.146:0/1013531768 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:27.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.483+0000 7faa9effd700 1 --2- 172.21.15.146:0/1013531768 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faaa0153ab0 0x7faaa00b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:27.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.483+0000 7faa9ffff700 1 --2- 172.21.15.146:0/1013531768 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faaa0153e80 0x7faaa0144cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:27.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.483+0000 7faa9f7fe700 1 -- 172.21.15.146:0/1013531768 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faaa0153e80 msgr2=0x7faaa0144cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:27.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.483+0000 7faa9f7fe700 1 --2- 172.21.15.146:0/1013531768 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faaa0153e80 0x7faaa0144cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.483+0000 7faa9f7fe700 1 -- 172.21.15.146:0/1013531768 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faaa0153ab0 msgr2=0x7faaa00b1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:27.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.483+0000 7faa9f7fe700 1 --2- 172.21.15.146:0/1013531768 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faaa0153ab0 0x7faaa00b1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.483+0000 7faa9f7fe700 1 -- 172.21.15.146:0/1013531768 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa940094f0 con 0x7faaa00689d0 2023-10-06T11:13:27.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.483+0000 7faa9effd700 1 --2- 172.21.15.146:0/1013531768 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faaa0153ab0 0x7faaa00b1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:27.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.483+0000 7faa9f7fe700 1 --2- 172.21.15.146:0/1013531768 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaa00689d0 0x7faaa01585f0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7faa90009ef0 tx=0x7faa9000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:27.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.484+0000 7faa877fe700 1 -- 172.21.15.146:0/1013531768 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9000cc50 con 0x7faaa00689d0 2023-10-06T11:13:27.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.484+0000 7faa877fe700 1 -- 172.21.15.146:0/1013531768 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa9000f040 con 0x7faaa00689d0 2023-10-06T11:13:27.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.484+0000 7faa877fe700 1 -- 172.21.15.146:0/1013531768 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa90014480 con 0x7faaa00689d0 2023-10-06T11:13:27.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.484+0000 7faaa5cc3700 1 -- 172.21.15.146:0/1013531768 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaa0154810 con 0x7faaa00689d0 2023-10-06T11:13:27.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.484+0000 7faaa5cc3700 1 -- 172.21.15.146:0/1013531768 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa0154dd0 con 0x7faaa00689d0 2023-10-06T11:13:27.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.484+0000 7faaa5cc3700 1 -- 172.21.15.146:0/1013531768 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaa004c380 con 0x7faaa00689d0 2023-10-06T11:13:27.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.485+0000 7faa877fe700 1 -- 172.21.15.146:0/1013531768 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faa900147f0 con 0x7faaa00689d0 2023-10-06T11:13:27.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.485+0000 7faa877fe700 1 --2- 172.21.15.146:0/1013531768 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faa8c066f30 0x7faa8c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:27.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.485+0000 7faa877fe700 1 -- 172.21.15.146:0/1013531768 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5206+0+0 (secure 0 0 0) 0x7faa90084df0 con 0x7faaa00689d0 2023-10-06T11:13:27.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.485+0000 7faa9effd700 1 --2- 172.21.15.146:0/1013531768 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faa8c066f30 0x7faa8c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:27.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.486+0000 7faa9effd700 1 --2- 172.21.15.146:0/1013531768 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faa8c066f30 0x7faa8c0693e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7faaa01542f0 tx=0x7faa94017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:27.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.490+0000 7faa877fe700 1 -- 172.21.15.146:0/1013531768 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faa90052250 con 0x7faaa00689d0 2023-10-06T11:13:27.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.676+0000 7faaa5cc3700 1 -- 172.21.15.146:0/1013531768 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7faaa00b5c50 con 0x7faaa00689d0 2023-10-06T11:13:27.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.676+0000 7faa877fe700 1 -- 172.21.15.146:0/1013531768 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v97) v1 ==== 84+0+126 (secure 0 0 0) 0x7faa90055870 con 0x7faaa00689d0 2023-10-06T11:13:27.678 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:13:27.679 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2023-10-06T11:13:27.679 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:13:27.679 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 1, 2023-10-06T11:13:27.679 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": "rbd" 2023-10-06T11:13:27.679 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:13:27.679 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:13:27.679 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 2, 2023-10-06T11:13:27.679 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": ".mgr" 2023-10-06T11:13:27.679 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:13:27.679 INFO:teuthology.orchestra.run.smithi146.stdout:] 2023-10-06T11:13:27.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.679+0000 7faaa5cc3700 1 -- 172.21.15.146:0/1013531768 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faa8c066f30 msgr2=0x7faa8c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:27.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.679+0000 7faaa5cc3700 1 --2- 172.21.15.146:0/1013531768 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faa8c066f30 0x7faa8c0693e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7faaa01542f0 tx=0x7faa94017000 comp rx=0 tx=0).stop 2023-10-06T11:13:27.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.679+0000 7faaa5cc3700 1 -- 172.21.15.146:0/1013531768 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaa00689d0 msgr2=0x7faaa01585f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:27.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.679+0000 7faaa5cc3700 1 --2- 172.21.15.146:0/1013531768 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaa00689d0 0x7faaa01585f0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7faa90009ef0 tx=0x7faa9000b040 comp rx=0 tx=0).stop 2023-10-06T11:13:27.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.679+0000 7faaa5cc3700 1 -- 172.21.15.146:0/1013531768 shutdown_connections 2023-10-06T11:13:27.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.679+0000 7faaa5cc3700 1 --2- 172.21.15.146:0/1013531768 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faa8c066f30 0x7faa8c0693e0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.679+0000 7faaa5cc3700 1 --2- 172.21.15.146:0/1013531768 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faaa0153e80 0x7faaa0144cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.679+0000 7faaa5cc3700 1 --2- 172.21.15.146:0/1013531768 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faaa00689d0 0x7faaa01585f0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.679+0000 7faaa5cc3700 1 --2- 172.21.15.146:0/1013531768 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faaa0153ab0 0x7faaa00b1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.679+0000 7faaa5cc3700 1 -- 172.21.15.146:0/1013531768 >> 172.21.15.146:0/1013531768 conn(0x7faaa006eba0 msgr2=0x7faaa00d0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:27.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.679+0000 7faaa5cc3700 1 -- 172.21.15.146:0/1013531768 shutdown_connections 2023-10-06T11:13:27.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.679+0000 7faaa5cc3700 1 -- 172.21.15.146:0/1013531768 wait complete. 2023-10-06T11:13:27.693 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T11:13:27.693 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T11:13:27.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.809+0000 7f454b59e700 1 Processor -- start 2023-10-06T11:13:27.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.809+0000 7f454b59e700 1 -- start start 2023-10-06T11:13:27.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.810+0000 7f454b59e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f454c0cb090 0x7f454c0cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:27.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.810+0000 7f454b59e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f454c068780 0x7f454c068bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:27.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.810+0000 7f454b59e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f454c0cc130 con 0x7f454c0b5640 2023-10-06T11:13:27.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.810+0000 7f454b59e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f454c069100 con 0x7f454c0cb090 2023-10-06T11:13:27.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.810+0000 7f454b59e700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f454c0b2660 con 0x7f454c068780 2023-10-06T11:13:27.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.810+0000 7f4541d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f454c0cb090 0x7f454c0cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:27.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.810+0000 7f454a59c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f454c0b5640 0x7f454c15a870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:32834/0 (socket says 172.21.15.146:32834) 2023-10-06T11:13:27.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.810+0000 7f454a59c700 1 -- 172.21.15.146:0/3348769133 learned_addr learned my addr 172.21.15.146:0/3348769133 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:13:27.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.810+0000 7f454ad9d700 1 --2- 172.21.15.146:0/3348769133 >> v2:172.21.15.151:3300/0 conn(0x7f454c068780 0x7f454c068bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:27.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.810+0000 7f4541d9b700 1 -- 172.21.15.146:0/3348769133 >> v2:172.21.15.151:3300/0 conn(0x7f454c068780 msgr2=0x7f454c068bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:27.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.810+0000 7f4541d9b700 1 --2- 172.21.15.146:0/3348769133 >> v2:172.21.15.151:3300/0 conn(0x7f454c068780 0x7f454c068bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.810+0000 7f4541d9b700 1 -- 172.21.15.146:0/3348769133 >> v1:172.21.15.146:6789/0 conn(0x7f454c0b5640 legacy=0x7f454c15a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:27.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.810+0000 7f4541d9b700 1 -- 172.21.15.146:0/3348769133 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f454c0cb520 con 0x7f454c0cb090 2023-10-06T11:13:27.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.810+0000 7f4549d9b700 1 -- 172.21.15.146:0/3348769133 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 843569017 0 0) 0x7f454c0cc130 con 0x7f454c0b5640 2023-10-06T11:13:27.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.811+0000 7f4541d9b700 1 --2- 172.21.15.146:0/3348769133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f454c0cb090 0x7f454c0cc5c0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f454c159e40 tx=0x7f45340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3cabe5d5807f734 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:27.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.811+0000 7f4549d9b700 1 -- 172.21.15.146:0/3348769133 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4534011630 con 0x7f454c0cb090 2023-10-06T11:13:27.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.811+0000 7f4549d9b700 1 -- 172.21.15.146:0/3348769133 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4534011790 con 0x7f454c0cb090 2023-10-06T11:13:27.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.811+0000 7f4549d9b700 1 -- 172.21.15.146:0/3348769133 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4534011b30 con 0x7f454c0cb090 2023-10-06T11:13:27.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.811+0000 7f454b59e700 1 -- 172.21.15.146:0/3348769133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f454c0cb090 msgr2=0x7f454c0cc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:27.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.811+0000 7f454b59e700 1 --2- 172.21.15.146:0/3348769133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f454c0cb090 0x7f454c0cc5c0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f454c159e40 tx=0x7f45340091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.811+0000 7f454b59e700 1 -- 172.21.15.146:0/3348769133 shutdown_connections 2023-10-06T11:13:27.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.811+0000 7f454b59e700 1 --2- 172.21.15.146:0/3348769133 >> v2:172.21.15.151:3300/0 conn(0x7f454c068780 0x7f454c068bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.811+0000 7f454b59e700 1 --2- 172.21.15.146:0/3348769133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f454c0cb090 0x7f454c0cc5c0 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.811+0000 7f454b59e700 1 -- 172.21.15.146:0/3348769133 >> 172.21.15.146:0/3348769133 conn(0x7f454c0703f0 msgr2=0x7f454c0707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:27.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.811+0000 7f454b59e700 1 -- 172.21.15.146:0/3348769133 shutdown_connections 2023-10-06T11:13:27.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.811+0000 7f454b59e700 1 -- 172.21.15.146:0/3348769133 wait complete. 2023-10-06T11:13:27.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.812+0000 7f454b59e700 1 Processor -- start 2023-10-06T11:13:27.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.813+0000 7f454b59e700 1 -- start start 2023-10-06T11:13:27.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.813+0000 7f454b59e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f454c068780 0x7f454c15d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:27.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.813+0000 7f454b59e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f454c0b5640 0x7f454c153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:27.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.813+0000 7f454b59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f454c0cb090 0x7f454c0c6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:27.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.813+0000 7f454b59e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454c154080 con 0x7f454c0cb090 2023-10-06T11:13:27.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.813+0000 7f454b59e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454c15d990 con 0x7f454c068780 2023-10-06T11:13:27.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.813+0000 7f454b59e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f454c15dc70 con 0x7f454c0b5640 2023-10-06T11:13:27.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.813+0000 7f454ad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f454c0cb090 0x7f454c0c6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:27.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.813+0000 7f454ad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f454c0cb090 0x7f454c0c6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47302/0 (socket says 172.21.15.146:47302) 2023-10-06T11:13:27.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.813+0000 7f454ad9d700 1 -- 172.21.15.146:0/2402545793 learned_addr learned my addr 172.21.15.146:0/2402545793 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:27.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.813+0000 7f454a59c700 1 --2- 172.21.15.146:0/2402545793 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f454c068780 0x7f454c15d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:27.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.813+0000 7f4541d9b700 1 --2- 172.21.15.146:0/2402545793 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f454c0b5640 0x7f454c153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:27.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.814+0000 7f454ad9d700 1 -- 172.21.15.146:0/2402545793 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f454c0b5640 msgr2=0x7f454c153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:27.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.814+0000 7f454ad9d700 1 --2- 172.21.15.146:0/2402545793 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f454c0b5640 0x7f454c153b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.814+0000 7f454ad9d700 1 -- 172.21.15.146:0/2402545793 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f454c068780 msgr2=0x7f454c15d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:27.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.814+0000 7f454ad9d700 1 --2- 172.21.15.146:0/2402545793 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f454c068780 0x7f454c15d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:27.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.814+0000 7f454ad9d700 1 -- 172.21.15.146:0/2402545793 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4534009420 con 0x7f454c0cb090 2023-10-06T11:13:27.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.814+0000 7f4541d9b700 1 --2- 172.21.15.146:0/2402545793 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f454c0b5640 0x7f454c153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:27.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.814+0000 7f454ad9d700 1 --2- 172.21.15.146:0/2402545793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f454c0cb090 0x7f454c0c6b70 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f4544009df0 tx=0x7f454400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:27.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.814+0000 7f4542ffd700 1 -- 172.21.15.146:0/2402545793 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454400cb50 con 0x7f454c0cb090 2023-10-06T11:13:27.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.814+0000 7f4542ffd700 1 -- 172.21.15.146:0/2402545793 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f454400f040 con 0x7f454c0cb090 2023-10-06T11:13:27.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.814+0000 7f454b59e700 1 -- 172.21.15.146:0/2402545793 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f454c15df50 con 0x7f454c0cb090 2023-10-06T11:13:27.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.814+0000 7f4542ffd700 1 -- 172.21.15.146:0/2402545793 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4544014480 con 0x7f454c0cb090 2023-10-06T11:13:27.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.814+0000 7f454b59e700 1 -- 172.21.15.146:0/2402545793 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f454c0c70b0 con 0x7f454c0cb090 2023-10-06T11:13:27.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.815+0000 7f454b59e700 1 -- 172.21.15.146:0/2402545793 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f454c0894b0 con 0x7f454c0cb090 2023-10-06T11:13:27.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.815+0000 7f4542ffd700 1 -- 172.21.15.146:0/2402545793 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4544014830 con 0x7f454c0cb090 2023-10-06T11:13:27.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.816+0000 7f4542ffd700 1 --2- 172.21.15.146:0/2402545793 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f452c066f30 0x7f452c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:27.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.816+0000 7f4542ffd700 1 -- 172.21.15.146:0/2402545793 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f4544084c50 con 0x7f454c0cb090 2023-10-06T11:13:27.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.816+0000 7f454a59c700 1 --2- 172.21.15.146:0/2402545793 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f452c066f30 0x7f452c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:27.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.816+0000 7f454a59c700 1 --2- 172.21.15.146:0/2402545793 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f452c066f30 0x7f452c0693e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f453c007fd0 tx=0x7f453c007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:27.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:27.820+0000 7f4542ffd700 1 -- 172.21.15.146:0/2402545793 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f454408a020 con 0x7f454c0cb090 2023-10-06T11:13:28.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:28.009+0000 7f454b59e700 1 -- 172.21.15.146:0/2402545793 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f454c04bb40 con 0x7f454c0cb090 2023-10-06T11:13:28.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:28.956+0000 7f4542ffd700 1 -- 172.21.15.146:0/2402545793 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v98) v1 ==== 138+0+0 (secure 0 0 0) 0x7f45440520b0 con 0x7f454c0cb090 2023-10-06T11:13:28.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:28.960+0000 7f454b59e700 1 -- 172.21.15.146:0/2402545793 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f452c066f30 msgr2=0x7f452c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:28.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:28.960+0000 7f454b59e700 1 --2- 172.21.15.146:0/2402545793 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f452c066f30 0x7f452c0693e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f453c007fd0 tx=0x7f453c007d30 comp rx=0 tx=0).stop 2023-10-06T11:13:28.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:28.960+0000 7f454b59e700 1 -- 172.21.15.146:0/2402545793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f454c0cb090 msgr2=0x7f454c0c6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:28.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:28.960+0000 7f454b59e700 1 --2- 172.21.15.146:0/2402545793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f454c0cb090 0x7f454c0c6b70 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f4544009df0 tx=0x7f454400b040 comp rx=0 tx=0).stop 2023-10-06T11:13:28.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:28.960+0000 7f454b59e700 1 -- 172.21.15.146:0/2402545793 shutdown_connections 2023-10-06T11:13:28.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:28.960+0000 7f454b59e700 1 --2- 172.21.15.146:0/2402545793 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f452c066f30 0x7f452c0693e0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:28.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:28.960+0000 7f454b59e700 1 --2- 172.21.15.146:0/2402545793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f454c0cb090 0x7f454c0c6b70 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:28.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:28.960+0000 7f454b59e700 1 --2- 172.21.15.146:0/2402545793 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f454c068780 0x7f454c15d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:28.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:28.960+0000 7f454b59e700 1 --2- 172.21.15.146:0/2402545793 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f454c0b5640 0x7f454c153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:28.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:28.960+0000 7f454b59e700 1 -- 172.21.15.146:0/2402545793 >> 172.21.15.146:0/2402545793 conn(0x7f454c0703f0 msgr2=0x7f454c15b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:28.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:28.960+0000 7f454b59e700 1 -- 172.21.15.146:0/2402545793 shutdown_connections 2023-10-06T11:13:28.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:28.960+0000 7f454b59e700 1 -- 172.21.15.146:0/2402545793 wait complete. 2023-10-06T11:13:28.963 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' created 2023-10-06T11:13:28.977 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T11:13:29.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.097+0000 7f8f3dad8700 1 Processor -- start 2023-10-06T11:13:29.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.097+0000 7f8f3dad8700 1 -- start start 2023-10-06T11:13:29.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.098+0000 7f8f3dad8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f3806c810 0x7f8f38159de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.098+0000 7f8f3dad8700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8f3806bb60 0x7f8f3815d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.098+0000 7f8f3dad8700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f3815d510 con 0x7f8f3806cbe0 2023-10-06T11:13:29.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.098+0000 7f8f3dad8700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f3815a430 con 0x7f8f3806bb60 2023-10-06T11:13:29.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.098+0000 7f8f3dad8700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3815a710 con 0x7f8f3806c810 2023-10-06T11:13:29.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.098+0000 7f8f37fff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8f3806bb60 0x7f8f3815d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.098+0000 7f8f377fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f3806c810 0x7f8f38159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.099+0000 7f8f37fff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8f3806bb60 0x7f8f3815d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:48832/0 (socket says 172.21.15.146:48832) 2023-10-06T11:13:29.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.099+0000 7f8f377fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f3806c810 0x7f8f38159de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:59216/0 (socket says 172.21.15.146:59216) 2023-10-06T11:13:29.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.099+0000 7f8f37fff700 1 -- 172.21.15.146:0/1450851288 learned_addr learned my addr 172.21.15.146:0/1450851288 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:29.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.099+0000 7f8f377fe700 1 -- 172.21.15.146:0/1450851288 >> v2:172.21.15.151:3300/0 conn(0x7f8f3806bb60 msgr2=0x7f8f3815d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:29.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.099+0000 7f8f377fe700 1 --2- 172.21.15.146:0/1450851288 >> v2:172.21.15.151:3300/0 conn(0x7f8f3806bb60 0x7f8f3815d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.099+0000 7f8f377fe700 1 -- 172.21.15.146:0/1450851288 >> v1:172.21.15.151:6789/0 conn(0x7f8f3806cbe0 legacy=0x7f8f380b0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.099+0000 7f8f377fe700 1 -- 172.21.15.146:0/1450851288 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f3815a9f0 con 0x7f8f3806c810 2023-10-06T11:13:29.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.099+0000 7f8f37fff700 1 --2- 172.21.15.146:0/1450851288 >> v2:172.21.15.151:3300/0 conn(0x7f8f3806bb60 0x7f8f3815d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:13:29.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.099+0000 7f8f377fe700 1 --2- 172.21.15.146:0/1450851288 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f3806c810 0x7f8f38159de0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8f280098e0 tx=0x7f8f280091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ed7f00b6a42adb5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.099+0000 7f8f367fc700 1 -- 172.21.15.146:0/1450851288 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2800b640 con 0x7f8f3806c810 2023-10-06T11:13:29.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.099+0000 7f8f367fc700 1 -- 172.21.15.146:0/1450851288 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2800b7a0 con 0x7f8f3806c810 2023-10-06T11:13:29.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.099+0000 7f8f367fc700 1 -- 172.21.15.146:0/1450851288 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2800bb40 con 0x7f8f3806c810 2023-10-06T11:13:29.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.100+0000 7f8f3dad8700 1 -- 172.21.15.146:0/1450851288 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f3806c810 msgr2=0x7f8f38159de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.100+0000 7f8f3dad8700 1 --2- 172.21.15.146:0/1450851288 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f3806c810 0x7f8f38159de0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8f280098e0 tx=0x7f8f280091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.100+0000 7f8f3dad8700 1 -- 172.21.15.146:0/1450851288 shutdown_connections 2023-10-06T11:13:29.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.100+0000 7f8f3dad8700 1 --2- 172.21.15.146:0/1450851288 >> v2:172.21.15.151:3300/0 conn(0x7f8f3806bb60 0x7f8f3815d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.100+0000 7f8f3dad8700 1 --2- 172.21.15.146:0/1450851288 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f3806c810 0x7f8f38159de0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.100+0000 7f8f3dad8700 1 -- 172.21.15.146:0/1450851288 >> 172.21.15.146:0/1450851288 conn(0x7f8f3806b020 msgr2=0x7f8f380aec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:29.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.100+0000 7f8f3dad8700 1 -- 172.21.15.146:0/1450851288 shutdown_connections 2023-10-06T11:13:29.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.100+0000 7f8f3dad8700 1 -- 172.21.15.146:0/1450851288 wait complete. 2023-10-06T11:13:29.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.101+0000 7f8f3dad8700 1 Processor -- start 2023-10-06T11:13:29.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.101+0000 7f8f3dad8700 1 -- start start 2023-10-06T11:13:29.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.102+0000 7f8f3dad8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f3806bb60 0x7f8f381555d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.102+0000 7f8f3dad8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f3806c810 0x7f8f380cbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.102+0000 7f8f3dad8700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f3806cbe0 0x7f8f380cc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.102+0000 7f8f3dad8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f380aa900 con 0x7f8f3806c810 2023-10-06T11:13:29.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.102+0000 7f8f3dad8700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f380aabe0 con 0x7f8f3806cbe0 2023-10-06T11:13:29.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.102+0000 7f8f3dad8700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f380aaec0 con 0x7f8f3806bb60 2023-10-06T11:13:29.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.102+0000 7f8f36ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f3806c810 0x7f8f380cbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.102+0000 7f8f36ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f3806c810 0x7f8f380cbad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47318/0 (socket says 172.21.15.146:47318) 2023-10-06T11:13:29.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.102+0000 7f8f36ffd700 1 -- 172.21.15.146:0/795139594 learned_addr learned my addr 172.21.15.146:0/795139594 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:29.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.102+0000 7f8f377fe700 1 --2- 172.21.15.146:0/795139594 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f3806bb60 0x7f8f381555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.102+0000 7f8f37fff700 1 --2- 172.21.15.146:0/795139594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f3806cbe0 0x7f8f380cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.102+0000 7f8f36ffd700 1 -- 172.21.15.146:0/795139594 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f3806bb60 msgr2=0x7f8f381555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.102+0000 7f8f36ffd700 1 --2- 172.21.15.146:0/795139594 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f3806bb60 0x7f8f381555d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.102+0000 7f8f36ffd700 1 -- 172.21.15.146:0/795139594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f3806cbe0 msgr2=0x7f8f380cc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.102+0000 7f8f36ffd700 1 --2- 172.21.15.146:0/795139594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f3806cbe0 0x7f8f380cc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.102+0000 7f8f36ffd700 1 -- 172.21.15.146:0/795139594 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f30009ae0 con 0x7f8f3806c810 2023-10-06T11:13:29.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.103+0000 7f8f36ffd700 1 --2- 172.21.15.146:0/795139594 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f3806c810 0x7f8f380cbad0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c00c4e0 tx=0x7f8f2c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.103+0000 7f8f1f7fe700 1 -- 172.21.15.146:0/795139594 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c011590 con 0x7f8f3806c810 2023-10-06T11:13:29.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.103+0000 7f8f1f7fe700 1 -- 172.21.15.146:0/795139594 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2c011710 con 0x7f8f3806c810 2023-10-06T11:13:29.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.103+0000 7f8f3dad8700 1 -- 172.21.15.146:0/795139594 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f28009420 con 0x7f8f3806c810 2023-10-06T11:13:29.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.103+0000 7f8f1f7fe700 1 -- 172.21.15.146:0/795139594 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c011ad0 con 0x7f8f3806c810 2023-10-06T11:13:29.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.103+0000 7f8f3dad8700 1 -- 172.21.15.146:0/795139594 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f3815e8b0 con 0x7f8f3806c810 2023-10-06T11:13:29.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.104+0000 7f8f3dad8700 1 -- 172.21.15.146:0/795139594 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f3804c380 con 0x7f8f3806c810 2023-10-06T11:13:29.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.104+0000 7f8f1f7fe700 1 -- 172.21.15.146:0/795139594 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8f2c01b3b0 con 0x7f8f3806c810 2023-10-06T11:13:29.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.105+0000 7f8f1f7fe700 1 --2- 172.21.15.146:0/795139594 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8f24066f30 0x7f8f240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:29.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.105+0000 7f8f1f7fe700 1 -- 172.21.15.146:0/795139594 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f8f2c0838b0 con 0x7f8f3806c810 2023-10-06T11:13:29.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.105+0000 7f8f377fe700 1 --2- 172.21.15.146:0/795139594 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8f24066f30 0x7f8f240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:29.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.105+0000 7f8f377fe700 1 --2- 172.21.15.146:0/795139594 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8f24066f30 0x7f8f240693e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f8f280093f0 tx=0x7f8f28017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:29.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.109+0000 7f8f1f7fe700 1 -- 172.21.15.146:0/795139594 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8f2c050ba0 con 0x7f8f3806c810 2023-10-06T11:13:29.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.292+0000 7f8f3dad8700 1 -- 172.21.15.146:0/795139594 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f8f380682c0 con 0x7f8f3806c810 2023-10-06T11:13:29.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.962+0000 7f8f1f7fe700 1 -- 172.21.15.146:0/795139594 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v99) v1 ==== 170+0+0 (secure 0 0 0) 0x7f8f2c017070 con 0x7f8f3806c810 2023-10-06T11:13:29.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.968+0000 7f8f3dad8700 1 -- 172.21.15.146:0/795139594 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8f24066f30 msgr2=0x7f8f240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.968+0000 7f8f3dad8700 1 --2- 172.21.15.146:0/795139594 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8f24066f30 0x7f8f240693e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f8f280093f0 tx=0x7f8f28017000 comp rx=0 tx=0).stop 2023-10-06T11:13:29.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.968+0000 7f8f3dad8700 1 -- 172.21.15.146:0/795139594 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f3806c810 msgr2=0x7f8f380cbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:29.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.968+0000 7f8f3dad8700 1 --2- 172.21.15.146:0/795139594 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f3806c810 0x7f8f380cbad0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c00c4e0 tx=0x7f8f2c00c7f0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.968+0000 7f8f3dad8700 1 -- 172.21.15.146:0/795139594 shutdown_connections 2023-10-06T11:13:29.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.968+0000 7f8f3dad8700 1 --2- 172.21.15.146:0/795139594 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8f24066f30 0x7f8f240693e0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.968+0000 7f8f3dad8700 1 --2- 172.21.15.146:0/795139594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f3806cbe0 0x7f8f380cc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.968+0000 7f8f3dad8700 1 --2- 172.21.15.146:0/795139594 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f3806bb60 0x7f8f381555d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.968+0000 7f8f3dad8700 1 --2- 172.21.15.146:0/795139594 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f3806c810 0x7f8f380cbad0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:29.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.968+0000 7f8f3dad8700 1 -- 172.21.15.146:0/795139594 >> 172.21.15.146:0/795139594 conn(0x7f8f3806b020 msgr2=0x7f8f3815c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:29.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.969+0000 7f8f3dad8700 1 -- 172.21.15.146:0/795139594 shutdown_connections 2023-10-06T11:13:29.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:29.969+0000 7f8f3dad8700 1 -- 172.21.15.146:0/795139594 wait complete. 2023-10-06T11:13:29.978 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' created 2023-10-06T11:13:29.990 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T11:13:30.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.106+0000 7f159ed48700 1 Processor -- start 2023-10-06T11:13:30.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.106+0000 7f159ed48700 1 -- start start 2023-10-06T11:13:30.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.107+0000 7f159ed48700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1598157880 0x7f15980b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:30.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.107+0000 7f159ed48700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f15980b1830 0x7f1598157f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:30.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.107+0000 7f159ed48700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15980aeb80 con 0x7f15981574b0 2023-10-06T11:13:30.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.107+0000 7f159ed48700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15980b1cd0 con 0x7f15980b1830 2023-10-06T11:13:30.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.107+0000 7f159ed48700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15980cbcf0 con 0x7f1598157880 2023-10-06T11:13:30.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.107+0000 7f159d2e5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f15980b1830 0x7f1598157f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:30.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.107+0000 7f159d2e5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f15980b1830 0x7f1598157f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47332/0 (socket says 172.21.15.146:47332) 2023-10-06T11:13:30.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.107+0000 7f159d2e5700 1 -- 172.21.15.146:0/241361604 learned_addr learned my addr 172.21.15.146:0/241361604 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:30.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.108+0000 7f158ffff700 1 --2- 172.21.15.146:0/241361604 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1598157880 0x7f15980b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:30.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.108+0000 7f159d2e5700 1 -- 172.21.15.146:0/241361604 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1598157880 msgr2=0x7f15980b12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:30.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.108+0000 7f159d2e5700 1 --2- 172.21.15.146:0/241361604 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1598157880 0x7f15980b12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:30.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.108+0000 7f159d2e5700 1 -- 172.21.15.146:0/241361604 >> v1:172.21.15.151:6789/0 conn(0x7f15981574b0 legacy=0x7f15980ae470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:30.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.108+0000 7f159d2e5700 1 -- 172.21.15.146:0/241361604 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15980cb170 con 0x7f15980b1830 2023-10-06T11:13:30.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.108+0000 7f158ffff700 1 --2- 172.21.15.146:0/241361604 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1598157880 0x7f15980b12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:30.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.108+0000 7f159d2e5700 1 --2- 172.21.15.146:0/241361604 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15980b1830 0x7f1598157f70 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f1590009f20 tx=0x7f1590009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=999b1f99480517fa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:30.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.108+0000 7f158f7fe700 1 -- 172.21.15.146:0/241361604 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f159000e070 con 0x7f15980b1830 2023-10-06T11:13:30.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.108+0000 7f158f7fe700 1 -- 172.21.15.146:0/241361604 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f159000ba40 con 0x7f15980b1830 2023-10-06T11:13:30.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.108+0000 7f158f7fe700 1 -- 172.21.15.146:0/241361604 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15900092e0 con 0x7f15980b1830 2023-10-06T11:13:30.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.108+0000 7f159ed48700 1 -- 172.21.15.146:0/241361604 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15980b1830 msgr2=0x7f1598157f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:30.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.108+0000 7f159ed48700 1 --2- 172.21.15.146:0/241361604 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15980b1830 0x7f1598157f70 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f1590009f20 tx=0x7f1590009840 comp rx=0 tx=0).stop 2023-10-06T11:13:30.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.109+0000 7f159ed48700 1 -- 172.21.15.146:0/241361604 shutdown_connections 2023-10-06T11:13:30.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.109+0000 7f159ed48700 1 --2- 172.21.15.146:0/241361604 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15980b1830 0x7f1598157f70 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:30.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.109+0000 7f159ed48700 1 --2- 172.21.15.146:0/241361604 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1598157880 0x7f15980b12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:30.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.109+0000 7f159ed48700 1 -- 172.21.15.146:0/241361604 >> 172.21.15.146:0/241361604 conn(0x7f159806a070 msgr2=0x7f1598067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:30.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.109+0000 7f159ed48700 1 -- 172.21.15.146:0/241361604 shutdown_connections 2023-10-06T11:13:30.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.109+0000 7f159ed48700 1 -- 172.21.15.146:0/241361604 wait complete. 2023-10-06T11:13:30.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.110+0000 7f159ed48700 1 Processor -- start 2023-10-06T11:13:30.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.110+0000 7f159ed48700 1 -- start start 2023-10-06T11:13:30.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.111+0000 7f159ed48700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f15980b1830 0x7f1598153630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:30.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.111+0000 7f159ed48700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15981574b0 0x7f1598159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:30.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.111+0000 7f159ed48700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1598157880 0x7f1598151520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:30.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.111+0000 7f159ed48700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1598154200 con 0x7f15981574b0 2023-10-06T11:13:30.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.111+0000 7f159ed48700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15981581d0 con 0x7f15980b1830 2023-10-06T11:13:30.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.111+0000 7f159ed48700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f159815a4e0 con 0x7f1598157880 2023-10-06T11:13:30.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.111+0000 7f158ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15981574b0 0x7f1598159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:30.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.111+0000 7f158ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15981574b0 0x7f1598159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47336/0 (socket says 172.21.15.146:47336) 2023-10-06T11:13:30.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.111+0000 7f158ffff700 1 -- 172.21.15.146:0/3549312867 learned_addr learned my addr 172.21.15.146:0/3549312867 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:30.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.111+0000 7f159d2e5700 1 --2- 172.21.15.146:0/3549312867 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1598157880 0x7f1598151520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:30.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.111+0000 7f159cae4700 1 --2- 172.21.15.146:0/3549312867 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f15980b1830 0x7f1598153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:30.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.111+0000 7f158ffff700 1 -- 172.21.15.146:0/3549312867 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1598157880 msgr2=0x7f1598151520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:30.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.111+0000 7f158ffff700 1 --2- 172.21.15.146:0/3549312867 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1598157880 0x7f1598151520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:30.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.111+0000 7f158ffff700 1 -- 172.21.15.146:0/3549312867 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f15980b1830 msgr2=0x7f1598153630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:30.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.111+0000 7f158ffff700 1 --2- 172.21.15.146:0/3549312867 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f15980b1830 0x7f1598153630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:30.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.111+0000 7f158ffff700 1 -- 172.21.15.146:0/3549312867 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1590009ae0 con 0x7f15981574b0 2023-10-06T11:13:30.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.111+0000 7f158ffff700 1 --2- 172.21.15.146:0/3549312867 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15981574b0 0x7f1598159fa0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f158800c880 tx=0x7f1588008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:30.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.111+0000 7f158cff9700 1 -- 172.21.15.146:0/3549312867 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1588011600 con 0x7f15981574b0 2023-10-06T11:13:30.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.111+0000 7f158cff9700 1 -- 172.21.15.146:0/3549312867 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1588011760 con 0x7f15981574b0 2023-10-06T11:13:30.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.111+0000 7f159ed48700 1 -- 172.21.15.146:0/3549312867 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1598167950 con 0x7f15981574b0 2023-10-06T11:13:30.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.111+0000 7f158cff9700 1 -- 172.21.15.146:0/3549312867 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1588011b00 con 0x7f15981574b0 2023-10-06T11:13:30.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.111+0000 7f159ed48700 1 -- 172.21.15.146:0/3549312867 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1598153f20 con 0x7f15981574b0 2023-10-06T11:13:30.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.112+0000 7f159ed48700 1 -- 172.21.15.146:0/3549312867 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1598158380 con 0x7f15981574b0 2023-10-06T11:13:30.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.113+0000 7f158cff9700 1 -- 172.21.15.146:0/3549312867 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1588018350 con 0x7f15981574b0 2023-10-06T11:13:30.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.113+0000 7f158cff9700 1 --2- 172.21.15.146:0/3549312867 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1584066f30 0x7f15840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:30.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.113+0000 7f158cff9700 1 -- 172.21.15.146:0/3549312867 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f1588084480 con 0x7f15981574b0 2023-10-06T11:13:30.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.113+0000 7f159cae4700 1 --2- 172.21.15.146:0/3549312867 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1584066f30 0x7f15840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:30.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.113+0000 7f159cae4700 1 --2- 172.21.15.146:0/3549312867 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1584066f30 0x7f15840693e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1598155c30 tx=0x7f1594007ea0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:30.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.117+0000 7f158cff9700 1 -- 172.21.15.146:0/3549312867 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1598158380 con 0x7f15981574b0 2023-10-06T11:13:30.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.344+0000 7f159ed48700 1 -- 172.21.15.146:0/3549312867 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f1598158340 con 0x7f15981574b0 2023-10-06T11:13:30.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.963+0000 7f158cff9700 1 -- 172.21.15.146:0/3549312867 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 15 and data pool 16 v89) v1 ==== 174+0+0 (secure 0 0 0) 0x7f1588054df0 con 0x7f15981574b0 2023-10-06T11:13:30.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.968+0000 7f159ed48700 1 -- 172.21.15.146:0/3549312867 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1584066f30 msgr2=0x7f15840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:30.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.968+0000 7f159ed48700 1 --2- 172.21.15.146:0/3549312867 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1584066f30 0x7f15840693e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1598155c30 tx=0x7f1594007ea0 comp rx=0 tx=0).stop 2023-10-06T11:13:30.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.968+0000 7f159ed48700 1 -- 172.21.15.146:0/3549312867 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15981574b0 msgr2=0x7f1598159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:30.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.968+0000 7f159ed48700 1 --2- 172.21.15.146:0/3549312867 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15981574b0 0x7f1598159fa0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f158800c880 tx=0x7f1588008040 comp rx=0 tx=0).stop 2023-10-06T11:13:30.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.968+0000 7f159ed48700 1 -- 172.21.15.146:0/3549312867 shutdown_connections 2023-10-06T11:13:30.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.968+0000 7f159ed48700 1 --2- 172.21.15.146:0/3549312867 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1584066f30 0x7f15840693e0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:30.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.968+0000 7f159ed48700 1 --2- 172.21.15.146:0/3549312867 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1598157880 0x7f1598151520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:30.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.968+0000 7f159ed48700 1 --2- 172.21.15.146:0/3549312867 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f15980b1830 0x7f1598153630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:30.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.969+0000 7f159ed48700 1 --2- 172.21.15.146:0/3549312867 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15981574b0 0x7f1598159fa0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:30.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.969+0000 7f159ed48700 1 -- 172.21.15.146:0/3549312867 >> 172.21.15.146:0/3549312867 conn(0x7f159806a070 msgr2=0x7f1598154de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:30.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.969+0000 7f159ed48700 1 -- 172.21.15.146:0/3549312867 shutdown_connections 2023-10-06T11:13:30.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:30.969+0000 7f159ed48700 1 -- 172.21.15.146:0/3549312867 wait complete. 2023-10-06T11:13:30.972 INFO:teuthology.orchestra.run.smithi146.stderr:new fs with metadata pool 15 and data pool 16 2023-10-06T11:13:30.985 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:13:31.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.098+0000 7f0705761700 1 Processor -- start 2023-10-06T11:13:31.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.098+0000 7f0705761700 1 -- start start 2023-10-06T11:13:31.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.099+0000 7f0705761700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f07000b0bd0 0x7f07000b1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.099+0000 7f0705761700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0700067470 0x7f07000678d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.099+0000 7f0705761700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0700067e10 con 0x7f0700153e00 2023-10-06T11:13:31.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.099+0000 7f0705761700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f070015a270 con 0x7f07000b0bd0 2023-10-06T11:13:31.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.099+0000 7f0705761700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f070015a550 con 0x7f0700067470 2023-10-06T11:13:31.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.099+0000 7f06feffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0700153e00 0x7f070006b960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:32844/0 (socket says 172.21.15.146:32844) 2023-10-06T11:13:31.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.099+0000 7f06feffd700 1 -- 172.21.15.146:0/51883793 learned_addr learned my addr 172.21.15.146:0/51883793 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:13:31.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.099+0000 7f06fe7fc700 1 --2- 172.21.15.146:0/51883793 >> v2:172.21.15.151:3300/0 conn(0x7f07000b0bd0 0x7f07000b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.099+0000 7f06ff7fe700 1 --2- 172.21.15.146:0/51883793 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0700067470 0x7f07000678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.100+0000 7f06fdffb700 1 -- 172.21.15.146:0/51883793 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1498144048 0 0) 0x7f06f8001110 con 0x7f0700153e00 2023-10-06T11:13:31.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.100+0000 7f06fdffb700 1 -- 172.21.15.146:0/51883793 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06e8003570 con 0x7f0700153e00 2023-10-06T11:13:31.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.100+0000 7f06fdffb700 1 -- 172.21.15.146:0/51883793 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4254073459 0 0) 0x7f06e8003570 con 0x7f0700153e00 2023-10-06T11:13:31.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.100+0000 7f06fdffb700 1 -- 172.21.15.146:0/51883793 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0700067470 msgr2=0x7f07000678d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:31.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.100+0000 7f06fdffb700 1 --2- 172.21.15.146:0/51883793 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0700067470 0x7f07000678d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.100+0000 7f06fdffb700 1 -- 172.21.15.146:0/51883793 >> v2:172.21.15.151:3300/0 conn(0x7f07000b0bd0 msgr2=0x7f07000b1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:31.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.100+0000 7f06fdffb700 1 --2- 172.21.15.146:0/51883793 >> v2:172.21.15.151:3300/0 conn(0x7f07000b0bd0 0x7f07000b1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.100+0000 7f06fdffb700 1 -- 172.21.15.146:0/51883793 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f070015a830 con 0x7f0700153e00 2023-10-06T11:13:31.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.100+0000 7f06fdffb700 1 -- 172.21.15.146:0/51883793 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f06f8001600 con 0x7f0700153e00 2023-10-06T11:13:31.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.100+0000 7f06fdffb700 1 -- 172.21.15.146:0/51883793 >> v1:172.21.15.146:6789/0 conn(0x7f0700153e00 legacy=0x7f070006b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.100+0000 7f06fdffb700 1 --2- 172.21.15.146:0/51883793 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06e8003a60 0x7f06e8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.100+0000 7f06fdffb700 1 --2- 172.21.15.146:0/51883793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06e8004810 0x7f06e8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.100+0000 7f06fdffb700 1 --2- 172.21.15.146:0/51883793 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06e80051c0 0x7f06e800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.100+0000 7f06fdffb700 1 -- 172.21.15.146:0/51883793 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f070015a270 con 0x7f06e8004810 2023-10-06T11:13:31.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.100+0000 7f06fdffb700 1 -- 172.21.15.146:0/51883793 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f070015a550 con 0x7f06e80051c0 2023-10-06T11:13:31.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.100+0000 7f06fdffb700 1 -- 172.21.15.146:0/51883793 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e800bfa0 con 0x7f06e8003a60 2023-10-06T11:13:31.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.100+0000 7f06ff7fe700 1 --2- 172.21.15.146:0/51883793 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0700067470 0x7f07000678d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:13:31.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.100+0000 7f06fe7fc700 1 --2- 172.21.15.146:0/51883793 >> v2:172.21.15.151:3300/0 conn(0x7f07000b0bd0 0x7f07000b1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:13:31.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.100+0000 7f06fe7fc700 1 --2- 172.21.15.146:0/51883793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06e8004810 0x7f06e8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.100+0000 7f06feffd700 1 --2- 172.21.15.146:0/51883793 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06e8003a60 0x7f06e8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.100+0000 7f06ff7fe700 1 --2- 172.21.15.146:0/51883793 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06e80051c0 0x7f06e800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.100+0000 7f06fe7fc700 1 -- 172.21.15.146:0/51883793 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06e8003a60 msgr2=0x7f06e8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:31.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.100+0000 7f06fe7fc700 1 --2- 172.21.15.146:0/51883793 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06e8003a60 0x7f06e8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.100+0000 7f06fe7fc700 1 -- 172.21.15.146:0/51883793 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06e80051c0 msgr2=0x7f06e800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:31.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.100+0000 7f06fe7fc700 1 --2- 172.21.15.146:0/51883793 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06e80051c0 0x7f06e800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.100+0000 7f06fe7fc700 1 -- 172.21.15.146:0/51883793 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e8003570 con 0x7f06e8004810 2023-10-06T11:13:31.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.100+0000 7f06fe7fc700 1 --2- 172.21.15.146:0/51883793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06e8004810 0x7f06e8004c80 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f06f4009dd0 tx=0x7f06f4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1feeae3b5e27321b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:31.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.101+0000 7f06fdffb700 1 -- 172.21.15.146:0/51883793 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f4009730 con 0x7f06e8004810 2023-10-06T11:13:31.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.101+0000 7f06fdffb700 1 -- 172.21.15.146:0/51883793 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f400e8c0 con 0x7f06e8004810 2023-10-06T11:13:31.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.101+0000 7f06fdffb700 1 -- 172.21.15.146:0/51883793 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f400ec60 con 0x7f06e8004810 2023-10-06T11:13:31.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.101+0000 7f0705761700 1 -- 172.21.15.146:0/51883793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06e8004810 msgr2=0x7f06e8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.101+0000 7f0705761700 1 --2- 172.21.15.146:0/51883793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06e8004810 0x7f06e8004c80 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f06f4009dd0 tx=0x7f06f4009120 comp rx=0 tx=0).stop 2023-10-06T11:13:31.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.101+0000 7f06ff7fe700 1 -- 172.21.15.146:0/51883793 reap_dead start 2023-10-06T11:13:31.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.101+0000 7f0705761700 1 -- 172.21.15.146:0/51883793 shutdown_connections 2023-10-06T11:13:31.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.101+0000 7f0705761700 1 -- 172.21.15.146:0/51883793 >> 172.21.15.146:0/51883793 conn(0x7f070006b060 msgr2=0x7f07000aecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:31.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.101+0000 7f0705761700 1 -- 172.21.15.146:0/51883793 shutdown_connections 2023-10-06T11:13:31.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.101+0000 7f0705761700 1 -- 172.21.15.146:0/51883793 wait complete. 2023-10-06T11:13:31.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.102+0000 7f0705761700 1 Processor -- start 2023-10-06T11:13:31.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.102+0000 7f0705761700 1 -- start start 2023-10-06T11:13:31.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.103+0000 7f0705761700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06e8004810 0x7f07000cb160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.103+0000 7f0705761700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0700152d80 0x7f070015e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.103+0000 7f0705761700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f070015e750 0x7f070015f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.103+0000 7f0705761700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07000cacd0 con 0x7f0700152d80 2023-10-06T11:13:31.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.103+0000 7f0705761700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07000ca0c0 con 0x7f06e8004810 2023-10-06T11:13:31.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.103+0000 7f0705761700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07000ca3a0 con 0x7f070015e750 2023-10-06T11:13:31.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.103+0000 7f06fe7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0700152d80 0x7f070015e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.103+0000 7f06fe7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0700152d80 0x7f070015e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47344/0 (socket says 172.21.15.146:47344) 2023-10-06T11:13:31.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.103+0000 7f06fe7fc700 1 -- 172.21.15.146:0/3420583859 learned_addr learned my addr 172.21.15.146:0/3420583859 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:31.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.104+0000 7f06fe7fc700 1 -- 172.21.15.146:0/3420583859 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f070015e750 msgr2=0x7f070015f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.104+0000 7f06fe7fc700 1 --2- 172.21.15.146:0/3420583859 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f070015e750 0x7f070015f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.104+0000 7f06fe7fc700 1 -- 172.21.15.146:0/3420583859 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06e8004810 msgr2=0x7f07000cb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.104+0000 7f06fe7fc700 1 --2- 172.21.15.146:0/3420583859 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06e8004810 0x7f07000cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.104+0000 7f06fe7fc700 1 -- 172.21.15.146:0/3420583859 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07000ca680 con 0x7f0700152d80 2023-10-06T11:13:31.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.104+0000 7f06fe7fc700 1 --2- 172.21.15.146:0/3420583859 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0700152d80 0x7f070015e210 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f06e8004750 tx=0x7f06f4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:31.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.104+0000 7f06e6ffd700 1 -- 172.21.15.146:0/3420583859 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f400ec40 con 0x7f0700152d80 2023-10-06T11:13:31.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.104+0000 7f06e6ffd700 1 -- 172.21.15.146:0/3420583859 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f4026440 con 0x7f0700152d80 2023-10-06T11:13:31.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.104+0000 7f0705761700 1 -- 172.21.15.146:0/3420583859 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07000ca960 con 0x7f0700152d80 2023-10-06T11:13:31.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.104+0000 7f06e6ffd700 1 -- 172.21.15.146:0/3420583859 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f40267c0 con 0x7f0700152d80 2023-10-06T11:13:31.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.104+0000 7f0705761700 1 -- 172.21.15.146:0/3420583859 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07000c9d00 con 0x7f0700152d80 2023-10-06T11:13:31.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.105+0000 7f0705761700 1 -- 172.21.15.146:0/3420583859 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f070004c380 con 0x7f0700152d80 2023-10-06T11:13:31.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.105+0000 7f06e6ffd700 1 -- 172.21.15.146:0/3420583859 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f06f401b3f0 con 0x7f0700152d80 2023-10-06T11:13:31.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.106+0000 7f06e6ffd700 1 --2- 172.21.15.146:0/3420583859 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f06ec066f60 0x7f06ec069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.106+0000 7f06e6ffd700 1 -- 172.21.15.146:0/3420583859 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f06f4086230 con 0x7f0700152d80 2023-10-06T11:13:31.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.106+0000 7f06feffd700 1 --2- 172.21.15.146:0/3420583859 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f06ec066f60 0x7f06ec069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.106+0000 7f06feffd700 1 --2- 172.21.15.146:0/3420583859 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f06ec066f60 0x7f06ec069410 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f06f8000e10 tx=0x7f06f8007a80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:31.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.110+0000 7f06e6ffd700 1 -- 172.21.15.146:0/3420583859 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f06f4053350 con 0x7f0700152d80 2023-10-06T11:13:31.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.301+0000 7f0705761700 1 -- 172.21.15.146:0/3420583859 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f07000b1d80 con 0x7f0700152d80 2023-10-06T11:13:31.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.301+0000 7f06e6ffd700 1 -- 172.21.15.146:0/3420583859 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+16933 (secure 0 0 0) 0x7f06f4056970 con 0x7f0700152d80 2023-10-06T11:13:31.304 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:13:31.304 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":100,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:13:30.345474+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:13:28.028009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-10-06T11:13:29.311107+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:13:31.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.304+0000 7f0705761700 1 -- 172.21.15.146:0/3420583859 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f06ec066f60 msgr2=0x7f06ec069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.304+0000 7f0705761700 1 --2- 172.21.15.146:0/3420583859 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f06ec066f60 0x7f06ec069410 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f06f8000e10 tx=0x7f06f8007a80 comp rx=0 tx=0).stop 2023-10-06T11:13:31.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.304+0000 7f0705761700 1 -- 172.21.15.146:0/3420583859 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0700152d80 msgr2=0x7f070015e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.304+0000 7f0705761700 1 --2- 172.21.15.146:0/3420583859 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0700152d80 0x7f070015e210 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f06e8004750 tx=0x7f06f4019000 comp rx=0 tx=0).stop 2023-10-06T11:13:31.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.304+0000 7f0705761700 1 -- 172.21.15.146:0/3420583859 shutdown_connections 2023-10-06T11:13:31.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.304+0000 7f0705761700 1 --2- 172.21.15.146:0/3420583859 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f06ec066f60 0x7f06ec069410 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.304+0000 7f0705761700 1 --2- 172.21.15.146:0/3420583859 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f070015e750 0x7f070015f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.304+0000 7f0705761700 1 --2- 172.21.15.146:0/3420583859 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06e8004810 0x7f07000cb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.304+0000 7f0705761700 1 --2- 172.21.15.146:0/3420583859 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0700152d80 0x7f070015e210 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.304+0000 7f0705761700 1 -- 172.21.15.146:0/3420583859 >> 172.21.15.146:0/3420583859 conn(0x7f070006b060 msgr2=0x7f070006c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:31.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.304+0000 7f0705761700 1 -- 172.21.15.146:0/3420583859 shutdown_connections 2023-10-06T11:13:31.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.304+0000 7f0705761700 1 -- 172.21.15.146:0/3420583859 wait complete. 2023-10-06T11:13:31.318 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:13:31.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.433+0000 7f24ddf5f700 1 Processor -- start 2023-10-06T11:13:31.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.433+0000 7f24ddf5f700 1 -- start start 2023-10-06T11:13:31.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.433+0000 7f24ddf5f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f24d8153ab0 0x7f24d815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.433+0000 7f24ddf5f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24d815ac30 con 0x7f24d8068ba0 2023-10-06T11:13:31.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.433+0000 7f24ddf5f700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24d80b4510 con 0x7f24d8153e80 2023-10-06T11:13:31.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.433+0000 7f24ddf5f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24d80b6530 con 0x7f24d8153ab0 2023-10-06T11:13:31.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.434+0000 7f24d77fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f24d8153ab0 0x7f24d815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.434+0000 7f24d7fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f24d8068ba0 0x7f24d80b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35918/0 (socket says 172.21.15.146:35918) 2023-10-06T11:13:31.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.434+0000 7f24d7fff700 1 -- 172.21.15.146:0/2154152488 learned_addr learned my addr 172.21.15.146:0/2154152488 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:13:31.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.434+0000 7f24d77fe700 1 -- 172.21.15.146:0/2154152488 >> v1:172.21.15.151:6789/0 conn(0x7f24d8153e80 legacy=0x7f24d8068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:31.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.434+0000 7f24d77fe700 1 -- 172.21.15.146:0/2154152488 >> v1:172.21.15.146:6789/0 conn(0x7f24d8068ba0 legacy=0x7f24d80b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.434+0000 7f24d77fe700 1 -- 172.21.15.146:0/2154152488 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d80b5c50 con 0x7f24d8153ab0 2023-10-06T11:13:31.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.434+0000 7f24d67fc700 1 -- 172.21.15.146:0/2154152488 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3263148356 0 0) 0x7f24d0001490 con 0x7f24d8068ba0 2023-10-06T11:13:31.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.434+0000 7f24d77fe700 1 --2- 172.21.15.146:0/2154152488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24d8153ab0 0x7f24d815a6f0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f24c80098e0 tx=0x7f24c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ce28d7f47e584a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:31.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.434+0000 7f24d67fc700 1 -- 172.21.15.146:0/2154152488 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c8009e80 con 0x7f24d8153ab0 2023-10-06T11:13:31.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.434+0000 7f24d67fc700 1 -- 172.21.15.146:0/2154152488 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c800b820 con 0x7f24d8153ab0 2023-10-06T11:13:31.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.434+0000 7f24d67fc700 1 -- 172.21.15.146:0/2154152488 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c800bba0 con 0x7f24d8153ab0 2023-10-06T11:13:31.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.435+0000 7f24ddf5f700 1 -- 172.21.15.146:0/2154152488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24d8153ab0 msgr2=0x7f24d815a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.435+0000 7f24ddf5f700 1 --2- 172.21.15.146:0/2154152488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24d8153ab0 0x7f24d815a6f0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f24c80098e0 tx=0x7f24c80091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.435+0000 7f24ddf5f700 1 -- 172.21.15.146:0/2154152488 shutdown_connections 2023-10-06T11:13:31.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.435+0000 7f24ddf5f700 1 --2- 172.21.15.146:0/2154152488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24d8153ab0 0x7f24d815a6f0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.435+0000 7f24ddf5f700 1 -- 172.21.15.146:0/2154152488 >> 172.21.15.146:0/2154152488 conn(0x7f24d806eba0 msgr2=0x7f24d806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:31.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.435+0000 7f24ddf5f700 1 -- 172.21.15.146:0/2154152488 shutdown_connections 2023-10-06T11:13:31.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.435+0000 7f24ddf5f700 1 -- 172.21.15.146:0/2154152488 wait complete. 2023-10-06T11:13:31.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.436+0000 7f24ddf5f700 1 Processor -- start 2023-10-06T11:13:31.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.436+0000 7f24ddf5f700 1 -- start start 2023-10-06T11:13:31.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.437+0000 7f24ddf5f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24d8068ba0 0x7f24d80afec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.437+0000 7f24ddf5f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24d8153ab0 0x7f24d8140fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.437+0000 7f24ddf5f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f24d8153e80 0x7f24d8158e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.437+0000 7f24ddf5f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d80b29b0 con 0x7f24d8153ab0 2023-10-06T11:13:31.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.437+0000 7f24ddf5f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24d81599a0 con 0x7f24d8068ba0 2023-10-06T11:13:31.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.437+0000 7f24ddf5f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24d81542e0 con 0x7f24d8153e80 2023-10-06T11:13:31.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.437+0000 7f24d6ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24d8153ab0 0x7f24d8140fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.437+0000 7f24d6ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24d8153ab0 0x7f24d8140fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33526/0 (socket says 172.21.15.146:33526) 2023-10-06T11:13:31.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.437+0000 7f24d6ffd700 1 -- 172.21.15.146:0/946640656 learned_addr learned my addr 172.21.15.146:0/946640656 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:31.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.437+0000 7f24d77fe700 1 --2- 172.21.15.146:0/946640656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24d8068ba0 0x7f24d80afec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.442 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.437+0000 7f24d7fff700 1 --2- 172.21.15.146:0/946640656 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f24d8153e80 0x7f24d8158e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.437+0000 7f24d6ffd700 1 -- 172.21.15.146:0/946640656 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f24d8153e80 msgr2=0x7f24d8158e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.437+0000 7f24d6ffd700 1 --2- 172.21.15.146:0/946640656 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f24d8153e80 0x7f24d8158e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.437+0000 7f24d6ffd700 1 -- 172.21.15.146:0/946640656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24d8068ba0 msgr2=0x7f24d80afec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.437+0000 7f24d6ffd700 1 --2- 172.21.15.146:0/946640656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24d8068ba0 0x7f24d80afec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.437+0000 7f24d6ffd700 1 -- 172.21.15.146:0/946640656 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c8009420 con 0x7f24d8153ab0 2023-10-06T11:13:31.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.437+0000 7f24d77fe700 1 --2- 172.21.15.146:0/946640656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24d8068ba0 0x7f24d80afec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:31.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.437+0000 7f24d6ffd700 1 --2- 172.21.15.146:0/946640656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24d8153ab0 0x7f24d8140fa0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f24c000c5d0 tx=0x7f24c0007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:31.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.438+0000 7f24cf7fe700 1 -- 172.21.15.146:0/946640656 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c0011590 con 0x7f24d8153ab0 2023-10-06T11:13:31.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.438+0000 7f24cf7fe700 1 -- 172.21.15.146:0/946640656 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24c0011710 con 0x7f24d8153ab0 2023-10-06T11:13:31.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.438+0000 7f24ddf5f700 1 -- 172.21.15.146:0/946640656 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24d81545c0 con 0x7f24d8153ab0 2023-10-06T11:13:31.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.438+0000 7f24cf7fe700 1 -- 172.21.15.146:0/946640656 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24c0011ad0 con 0x7f24d8153ab0 2023-10-06T11:13:31.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.438+0000 7f24ddf5f700 1 -- 172.21.15.146:0/946640656 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24d8154b80 con 0x7f24d8153ab0 2023-10-06T11:13:31.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.439+0000 7f24ddf5f700 1 -- 172.21.15.146:0/946640656 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24d8154da0 con 0x7f24d8153ab0 2023-10-06T11:13:31.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.439+0000 7f24cf7fe700 1 -- 172.21.15.146:0/946640656 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f24c001c460 con 0x7f24d8153ab0 2023-10-06T11:13:31.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.439+0000 7f24cf7fe700 1 --2- 172.21.15.146:0/946640656 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f24b8066f30 0x7f24b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.439+0000 7f24cf7fe700 1 -- 172.21.15.146:0/946640656 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f24c00843f0 con 0x7f24d8153ab0 2023-10-06T11:13:31.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.439+0000 7f24d77fe700 1 --2- 172.21.15.146:0/946640656 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f24b8066f30 0x7f24b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.440+0000 7f24d77fe700 1 --2- 172.21.15.146:0/946640656 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f24b8066f30 0x7f24b80693e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f24c80030c0 tx=0x7f24c8016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:31.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.444+0000 7f24cf7fe700 1 -- 172.21.15.146:0/946640656 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f24c0051500 con 0x7f24d8153ab0 2023-10-06T11:13:31.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.627+0000 7f24ddf5f700 1 -- 172.21.15.146:0/946640656 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f24d804c380 con 0x7f24d8153ab0 2023-10-06T11:13:31.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.628+0000 7f24cf7fe700 1 -- 172.21.15.146:0/946640656 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+16920 (secure 0 0 0) 0x7f24c0054b20 con 0x7f24d8153ab0 2023-10-06T11:13:31.629 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:13:31.630 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":101,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:13:31.372487+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:13:28.028009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-10-06T11:13:29.311107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:13:31.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.630+0000 7f24ddf5f700 1 -- 172.21.15.146:0/946640656 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f24b8066f30 msgr2=0x7f24b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.630+0000 7f24ddf5f700 1 --2- 172.21.15.146:0/946640656 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f24b8066f30 0x7f24b80693e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f24c80030c0 tx=0x7f24c8016000 comp rx=0 tx=0).stop 2023-10-06T11:13:31.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.630+0000 7f24ddf5f700 1 -- 172.21.15.146:0/946640656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24d8153ab0 msgr2=0x7f24d8140fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.630+0000 7f24ddf5f700 1 --2- 172.21.15.146:0/946640656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24d8153ab0 0x7f24d8140fa0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f24c000c5d0 tx=0x7f24c0007f60 comp rx=0 tx=0).stop 2023-10-06T11:13:31.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.630+0000 7f24ddf5f700 1 -- 172.21.15.146:0/946640656 shutdown_connections 2023-10-06T11:13:31.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.630+0000 7f24ddf5f700 1 --2- 172.21.15.146:0/946640656 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f24b8066f30 0x7f24b80693e0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.630+0000 7f24ddf5f700 1 --2- 172.21.15.146:0/946640656 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f24d8153e80 0x7f24d8158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.630+0000 7f24ddf5f700 1 --2- 172.21.15.146:0/946640656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24d8068ba0 0x7f24d80afec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.630+0000 7f24ddf5f700 1 --2- 172.21.15.146:0/946640656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24d8153ab0 0x7f24d8140fa0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.630+0000 7f24ddf5f700 1 -- 172.21.15.146:0/946640656 >> 172.21.15.146:0/946640656 conn(0x7f24d806eba0 msgr2=0x7f24d8152080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:31.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.630+0000 7f24ddf5f700 1 -- 172.21.15.146:0/946640656 shutdown_connections 2023-10-06T11:13:31.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.630+0000 7f24ddf5f700 1 -- 172.21.15.146:0/946640656 wait complete. 2023-10-06T11:13:31.644 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T11:13:31.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.760+0000 7f8e3e356700 1 Processor -- start 2023-10-06T11:13:31.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.760+0000 7f8e3e356700 1 -- start start 2023-10-06T11:13:31.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.761+0000 7f8e3e356700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8e3815a160 0x7f8e380c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.761+0000 7f8e3e356700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e380ae730 0x7f8e380aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.761+0000 7f8e3e356700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8e380ce3d0 0x7f8e380ce830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.761+0000 7f8e3e356700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e380ae2a0 con 0x7f8e3815a160 2023-10-06T11:13:31.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.761+0000 7f8e3e356700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e3815a530 con 0x7f8e380ce3d0 2023-10-06T11:13:31.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.761+0000 7f8e3e356700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e380ad690 con 0x7f8e380ae730 2023-10-06T11:13:31.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.761+0000 7f8e37fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8e3815a160 0x7f8e380c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.761+0000 7f8e37fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8e3815a160 0x7f8e380c55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33530/0 (socket says 172.21.15.146:33530) 2023-10-06T11:13:31.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.761+0000 7f8e37fff700 1 -- 172.21.15.146:0/2351755037 learned_addr learned my addr 172.21.15.146:0/2351755037 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:31.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.762+0000 7f8e377fe700 1 --2- 172.21.15.146:0/2351755037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e380ae730 0x7f8e380aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.762+0000 7f8e3c8f3700 1 --2- 172.21.15.146:0/2351755037 >> v2:172.21.15.151:3300/0 conn(0x7f8e380ce3d0 0x7f8e380ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.762+0000 7f8e37fff700 1 -- 172.21.15.146:0/2351755037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e380ae730 msgr2=0x7f8e380aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:31.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.762+0000 7f8e37fff700 1 --2- 172.21.15.146:0/2351755037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e380ae730 0x7f8e380aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.762+0000 7f8e37fff700 1 -- 172.21.15.146:0/2351755037 >> v2:172.21.15.151:3300/0 conn(0x7f8e380ce3d0 msgr2=0x7f8e380ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:31.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.762+0000 7f8e37fff700 1 --2- 172.21.15.146:0/2351755037 >> v2:172.21.15.151:3300/0 conn(0x7f8e380ce3d0 0x7f8e380ce830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.762+0000 7f8e37fff700 1 -- 172.21.15.146:0/2351755037 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e380ad970 con 0x7f8e3815a160 2023-10-06T11:13:31.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.762+0000 7f8e37fff700 1 --2- 172.21.15.146:0/2351755037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e3815a160 0x7f8e380c55a0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f8e38089c40 tx=0x7f8e28009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3a92a4cff8f6d54 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:31.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.762+0000 7f8e36ffd700 1 -- 172.21.15.146:0/2351755037 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e28005c10 con 0x7f8e3815a160 2023-10-06T11:13:31.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.762+0000 7f8e36ffd700 1 -- 172.21.15.146:0/2351755037 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e28005d70 con 0x7f8e3815a160 2023-10-06T11:13:31.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.762+0000 7f8e36ffd700 1 -- 172.21.15.146:0/2351755037 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2800b880 con 0x7f8e3815a160 2023-10-06T11:13:31.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.762+0000 7f8e3e356700 1 -- 172.21.15.146:0/2351755037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e3815a160 msgr2=0x7f8e380c55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.762+0000 7f8e3e356700 1 --2- 172.21.15.146:0/2351755037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e3815a160 0x7f8e380c55a0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f8e38089c40 tx=0x7f8e28009220 comp rx=0 tx=0).stop 2023-10-06T11:13:31.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.762+0000 7f8e3e356700 1 -- 172.21.15.146:0/2351755037 shutdown_connections 2023-10-06T11:13:31.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.762+0000 7f8e3e356700 1 --2- 172.21.15.146:0/2351755037 >> v2:172.21.15.151:3300/0 conn(0x7f8e380ce3d0 0x7f8e380ce830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.762+0000 7f8e3e356700 1 --2- 172.21.15.146:0/2351755037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e3815a160 0x7f8e380c55a0 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.762+0000 7f8e3e356700 1 --2- 172.21.15.146:0/2351755037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e380ae730 0x7f8e380aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.762+0000 7f8e3e356700 1 -- 172.21.15.146:0/2351755037 >> 172.21.15.146:0/2351755037 conn(0x7f8e3806f380 msgr2=0x7f8e380d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:31.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.762+0000 7f8e3e356700 1 -- 172.21.15.146:0/2351755037 shutdown_connections 2023-10-06T11:13:31.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.762+0000 7f8e3e356700 1 -- 172.21.15.146:0/2351755037 wait complete. 2023-10-06T11:13:31.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.764+0000 7f8e3e356700 1 Processor -- start 2023-10-06T11:13:31.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.764+0000 7f8e3e356700 1 -- start start 2023-10-06T11:13:31.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.764+0000 7f8e3e356700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e380ae730 0x7f8e380b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.764+0000 7f8e3e356700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e380ce3d0 0x7f8e3815e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.764+0000 7f8e3e356700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e3815a160 0x7f8e380b5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.764+0000 7f8e3e356700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e380b5870 con 0x7f8e380ce3d0 2023-10-06T11:13:31.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.765+0000 7f8e3e356700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e380b3b80 con 0x7f8e3815a160 2023-10-06T11:13:31.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.765+0000 7f8e3e356700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e380b3e60 con 0x7f8e380ae730 2023-10-06T11:13:31.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.765+0000 7f8e377fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e380ce3d0 0x7f8e3815e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.765+0000 7f8e377fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e380ce3d0 0x7f8e3815e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33540/0 (socket says 172.21.15.146:33540) 2023-10-06T11:13:31.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.765+0000 7f8e377fe700 1 -- 172.21.15.146:0/310351645 learned_addr learned my addr 172.21.15.146:0/310351645 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:31.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.765+0000 7f8e37fff700 1 --2- 172.21.15.146:0/310351645 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e380ae730 0x7f8e380b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.765+0000 7f8e3c8f3700 1 --2- 172.21.15.146:0/310351645 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e3815a160 0x7f8e380b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.765+0000 7f8e377fe700 1 -- 172.21.15.146:0/310351645 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e380ae730 msgr2=0x7f8e380b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.765+0000 7f8e377fe700 1 --2- 172.21.15.146:0/310351645 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e380ae730 0x7f8e380b35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.765+0000 7f8e377fe700 1 -- 172.21.15.146:0/310351645 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e3815a160 msgr2=0x7f8e380b5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:31.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.765+0000 7f8e377fe700 1 --2- 172.21.15.146:0/310351645 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e3815a160 0x7f8e380b5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:31.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.765+0000 7f8e377fe700 1 -- 172.21.15.146:0/310351645 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e28009480 con 0x7f8e380ce3d0 2023-10-06T11:13:31.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.765+0000 7f8e377fe700 1 --2- 172.21.15.146:0/310351645 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e380ce3d0 0x7f8e3815e420 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c00d860 tx=0x7f8e2c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:31.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.765+0000 7f8e1ffff700 1 -- 172.21.15.146:0/310351645 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c0125f0 con 0x7f8e380ce3d0 2023-10-06T11:13:31.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.765+0000 7f8e1ffff700 1 -- 172.21.15.146:0/310351645 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2c012750 con 0x7f8e380ce3d0 2023-10-06T11:13:31.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.765+0000 7f8e3e356700 1 -- 172.21.15.146:0/310351645 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e380b4140 con 0x7f8e380ce3d0 2023-10-06T11:13:31.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.765+0000 7f8e1ffff700 1 -- 172.21.15.146:0/310351645 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c012b10 con 0x7f8e380ce3d0 2023-10-06T11:13:31.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.765+0000 7f8e3e356700 1 -- 172.21.15.146:0/310351645 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e3814ff50 con 0x7f8e380ce3d0 2023-10-06T11:13:31.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.766+0000 7f8e3e356700 1 -- 172.21.15.146:0/310351645 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e38068390 con 0x7f8e380ce3d0 2023-10-06T11:13:31.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.766+0000 7f8e1ffff700 1 -- 172.21.15.146:0/310351645 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8e2c01e460 con 0x7f8e380ce3d0 2023-10-06T11:13:31.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.767+0000 7f8e1ffff700 1 --2- 172.21.15.146:0/310351645 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8e24066f30 0x7f8e240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:31.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.767+0000 7f8e1ffff700 1 -- 172.21.15.146:0/310351645 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8e2c084b80 con 0x7f8e380ce3d0 2023-10-06T11:13:31.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.767+0000 7f8e37fff700 1 --2- 172.21.15.146:0/310351645 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8e24066f30 0x7f8e240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:31.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.767+0000 7f8e37fff700 1 --2- 172.21.15.146:0/310351645 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8e24066f30 0x7f8e240693e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f8e28009260 tx=0x7f8e28016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:31.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:31.771+0000 7f8e1ffff700 1 -- 172.21.15.146:0/310351645 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8e2c055720 con 0x7f8e380ce3d0 2023-10-06T11:13:32.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:32.000+0000 7f8e3e356700 1 -- 172.21.15.146:0/310351645 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8e3804c380 con 0x7f8e380ce3d0 2023-10-06T11:13:32.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:32.984+0000 7f8e1ffff700 1 -- 172.21.15.146:0/310351645 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v92) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8e2c0552b0 con 0x7f8e380ce3d0 2023-10-06T11:13:32.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:32.987+0000 7f8e3e356700 1 -- 172.21.15.146:0/310351645 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8e24066f30 msgr2=0x7f8e240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:32.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:32.987+0000 7f8e3e356700 1 --2- 172.21.15.146:0/310351645 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8e24066f30 0x7f8e240693e0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f8e28009260 tx=0x7f8e28016000 comp rx=0 tx=0).stop 2023-10-06T11:13:32.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:32.987+0000 7f8e3e356700 1 -- 172.21.15.146:0/310351645 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e380ce3d0 msgr2=0x7f8e3815e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:32.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:32.987+0000 7f8e3e356700 1 --2- 172.21.15.146:0/310351645 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e380ce3d0 0x7f8e3815e420 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c00d860 tx=0x7f8e2c008040 comp rx=0 tx=0).stop 2023-10-06T11:13:32.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:32.987+0000 7f8e3e356700 1 -- 172.21.15.146:0/310351645 shutdown_connections 2023-10-06T11:13:32.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:32.987+0000 7f8e3e356700 1 --2- 172.21.15.146:0/310351645 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8e24066f30 0x7f8e240693e0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:32.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:32.987+0000 7f8e3e356700 1 --2- 172.21.15.146:0/310351645 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e3815a160 0x7f8e380b5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:32.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:32.987+0000 7f8e3e356700 1 --2- 172.21.15.146:0/310351645 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e380ae730 0x7f8e380b35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:32.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:32.987+0000 7f8e3e356700 1 --2- 172.21.15.146:0/310351645 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e380ce3d0 0x7f8e3815e420 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:32.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:32.987+0000 7f8e3e356700 1 -- 172.21.15.146:0/310351645 >> 172.21.15.146:0/310351645 conn(0x7f8e3806f380 msgr2=0x7f8e380cdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:32.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:32.987+0000 7f8e3e356700 1 -- 172.21.15.146:0/310351645 shutdown_connections 2023-10-06T11:13:32.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:32.987+0000 7f8e3e356700 1 -- 172.21.15.146:0/310351645 wait complete. 2023-10-06T11:13:33.002 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T11:13:33.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.119+0000 7f0ec58da700 1 Processor -- start 2023-10-06T11:13:33.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.119+0000 7f0ec58da700 1 -- start start 2023-10-06T11:13:33.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.120+0000 7f0ec58da700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0ec00b5640 0x7f0ec015a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:33.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.120+0000 7f0ec58da700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ec00cb090 0x7f0ec00cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:33.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.120+0000 7f0ec58da700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0ec0068780 0x7f0ec0068bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:33.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.120+0000 7f0ec58da700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ec00cc130 con 0x7f0ec0068780 2023-10-06T11:13:33.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.120+0000 7f0ec58da700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ec00b2660 con 0x7f0ec00b5640 2023-10-06T11:13:33.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.120+0000 7f0ec58da700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec00690f0 con 0x7f0ec00cb090 2023-10-06T11:13:33.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.120+0000 7f0ec50d9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0ec0068780 0x7f0ec0068bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:33.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.120+0000 7f0ec50d9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0ec0068780 0x7f0ec0068bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33544/0 (socket says 172.21.15.146:33544) 2023-10-06T11:13:33.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.120+0000 7f0ec50d9700 1 -- 172.21.15.146:0/1468650390 learned_addr learned my addr 172.21.15.146:0/1468650390 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:33.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.120+0000 7f0ec48d8700 1 --2- 172.21.15.146:0/1468650390 >> v2:172.21.15.151:3300/0 conn(0x7f0ec00b5640 0x7f0ec015a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:33.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.120+0000 7f0ebffff700 1 --2- 172.21.15.146:0/1468650390 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ec00cb090 0x7f0ec00cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:33.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.120+0000 7f0ec50d9700 1 -- 172.21.15.146:0/1468650390 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ec00cb090 msgr2=0x7f0ec00cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:33.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.120+0000 7f0ec50d9700 1 --2- 172.21.15.146:0/1468650390 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ec00cb090 0x7f0ec00cc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:33.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.120+0000 7f0ec50d9700 1 -- 172.21.15.146:0/1468650390 >> v2:172.21.15.151:3300/0 conn(0x7f0ec00b5640 msgr2=0x7f0ec015a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:33.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.120+0000 7f0ec50d9700 1 --2- 172.21.15.146:0/1468650390 >> v2:172.21.15.151:3300/0 conn(0x7f0ec00b5640 0x7f0ec015a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:33.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.120+0000 7f0ec50d9700 1 -- 172.21.15.146:0/1468650390 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec015adb0 con 0x7f0ec0068780 2023-10-06T11:13:33.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.121+0000 7f0ec50d9700 1 --2- 172.21.15.146:0/1468650390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ec0068780 0x7f0ec0068bb0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f0ec00cddc0 tx=0x7f0ea8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0a7c2c4e92ce4ef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:33.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.121+0000 7f0ebf7fe700 1 -- 172.21.15.146:0/1468650390 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea800b860 con 0x7f0ec0068780 2023-10-06T11:13:33.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.121+0000 7f0ebf7fe700 1 -- 172.21.15.146:0/1468650390 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea800b9c0 con 0x7f0ec0068780 2023-10-06T11:13:33.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.121+0000 7f0ebf7fe700 1 -- 172.21.15.146:0/1468650390 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea800bd60 con 0x7f0ec0068780 2023-10-06T11:13:33.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.121+0000 7f0ec58da700 1 -- 172.21.15.146:0/1468650390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ec0068780 msgr2=0x7f0ec0068bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:33.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.121+0000 7f0ec58da700 1 --2- 172.21.15.146:0/1468650390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ec0068780 0x7f0ec0068bb0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f0ec00cddc0 tx=0x7f0ea8009250 comp rx=0 tx=0).stop 2023-10-06T11:13:33.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.121+0000 7f0ec58da700 1 -- 172.21.15.146:0/1468650390 shutdown_connections 2023-10-06T11:13:33.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.121+0000 7f0ec58da700 1 --2- 172.21.15.146:0/1468650390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ec0068780 0x7f0ec0068bb0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:33.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.121+0000 7f0ec58da700 1 --2- 172.21.15.146:0/1468650390 >> v2:172.21.15.151:3300/0 conn(0x7f0ec00b5640 0x7f0ec015a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:33.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.121+0000 7f0ec58da700 1 --2- 172.21.15.146:0/1468650390 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ec00cb090 0x7f0ec00cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:33.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.121+0000 7f0ec58da700 1 -- 172.21.15.146:0/1468650390 >> 172.21.15.146:0/1468650390 conn(0x7f0ec00703f0 msgr2=0x7f0ec00707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:33.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.121+0000 7f0ec58da700 1 -- 172.21.15.146:0/1468650390 shutdown_connections 2023-10-06T11:13:33.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.121+0000 7f0ec58da700 1 -- 172.21.15.146:0/1468650390 wait complete. 2023-10-06T11:13:33.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.122+0000 7f0ec58da700 1 Processor -- start 2023-10-06T11:13:33.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.123+0000 7f0ec58da700 1 -- start start 2023-10-06T11:13:33.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.123+0000 7f0ec58da700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ec0068780 0x7f0ec0150e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:33.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.123+0000 7f0ec58da700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ec00b5640 0x7f0ec015b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:33.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.123+0000 7f0ec58da700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ec00cb090 0x7f0ec00b4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:33.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.123+0000 7f0ec58da700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec00c4830 con 0x7f0ec00cb090 2023-10-06T11:13:33.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.123+0000 7f0ec58da700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec00c3c20 con 0x7f0ec0068780 2023-10-06T11:13:33.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.123+0000 7f0ec58da700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec00c3f00 con 0x7f0ec00b5640 2023-10-06T11:13:33.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.123+0000 7f0ec50d9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ec00cb090 0x7f0ec00b4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:33.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.123+0000 7f0ec50d9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ec00cb090 0x7f0ec00b4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33550/0 (socket says 172.21.15.146:33550) 2023-10-06T11:13:33.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.123+0000 7f0ec50d9700 1 -- 172.21.15.146:0/3948307499 learned_addr learned my addr 172.21.15.146:0/3948307499 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:33.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.124+0000 7f0ebffff700 1 --2- 172.21.15.146:0/3948307499 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ec00b5640 0x7f0ec015b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:33.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.124+0000 7f0ec48d8700 1 --2- 172.21.15.146:0/3948307499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ec0068780 0x7f0ec0150e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:33.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.124+0000 7f0ec50d9700 1 -- 172.21.15.146:0/3948307499 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ec00b5640 msgr2=0x7f0ec015b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:33.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.124+0000 7f0ec50d9700 1 --2- 172.21.15.146:0/3948307499 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ec00b5640 0x7f0ec015b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:33.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.124+0000 7f0ec50d9700 1 -- 172.21.15.146:0/3948307499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ec0068780 msgr2=0x7f0ec0150e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:33.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.124+0000 7f0ec50d9700 1 --2- 172.21.15.146:0/3948307499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ec0068780 0x7f0ec0150e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:33.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.124+0000 7f0ec50d9700 1 -- 172.21.15.146:0/3948307499 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea80094f0 con 0x7f0ec00cb090 2023-10-06T11:13:33.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.124+0000 7f0ec50d9700 1 --2- 172.21.15.146:0/3948307499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ec00cb090 0x7f0ec00b4810 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f0ec00694f0 tx=0x7f0ea8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:33.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.124+0000 7f0ebcff9700 1 -- 172.21.15.146:0/3948307499 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea801a630 con 0x7f0ec00cb090 2023-10-06T11:13:33.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.124+0000 7f0ebcff9700 1 -- 172.21.15.146:0/3948307499 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea801a7b0 con 0x7f0ec00cb090 2023-10-06T11:13:33.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.124+0000 7f0ec58da700 1 -- 172.21.15.146:0/3948307499 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ec00c41e0 con 0x7f0ec00cb090 2023-10-06T11:13:33.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.124+0000 7f0ebcff9700 1 -- 172.21.15.146:0/3948307499 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea801ab70 con 0x7f0ec00cb090 2023-10-06T11:13:33.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.124+0000 7f0ec58da700 1 -- 172.21.15.146:0/3948307499 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ec0151380 con 0x7f0ec00cb090 2023-10-06T11:13:33.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.125+0000 7f0ec58da700 1 -- 172.21.15.146:0/3948307499 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ec00c49e0 con 0x7f0ec00cb090 2023-10-06T11:13:33.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.126+0000 7f0ebcff9700 1 -- 172.21.15.146:0/3948307499 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0ea802d440 con 0x7f0ec00cb090 2023-10-06T11:13:33.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.126+0000 7f0ebcff9700 1 --2- 172.21.15.146:0/3948307499 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0ea0066f30 0x7f0ea00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:33.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.126+0000 7f0ebcff9700 1 -- 172.21.15.146:0/3948307499 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0ea80863d0 con 0x7f0ec00cb090 2023-10-06T11:13:33.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.126+0000 7f0ec48d8700 1 --2- 172.21.15.146:0/3948307499 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0ea0066f30 0x7f0ea00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:33.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.126+0000 7f0ec48d8700 1 --2- 172.21.15.146:0/3948307499 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0ea0066f30 0x7f0ea00693e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8006fd0 tx=0x7f0eb8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:33.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.130+0000 7f0ebcff9700 1 -- 172.21.15.146:0/3948307499 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0ec00c49e0 con 0x7f0ec00cb090 2023-10-06T11:13:33.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.359+0000 7f0ec58da700 1 -- 172.21.15.146:0/3948307499 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f0ec00c4970 con 0x7f0ec00cb090 2023-10-06T11:13:33.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.992+0000 7f0ebcff9700 1 -- 172.21.15.146:0/3948307499 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v93) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0ea80534e0 con 0x7f0ec00cb090 2023-10-06T11:13:33.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.994+0000 7f0ec58da700 1 -- 172.21.15.146:0/3948307499 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0ea0066f30 msgr2=0x7f0ea00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:33.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.994+0000 7f0ec58da700 1 --2- 172.21.15.146:0/3948307499 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0ea0066f30 0x7f0ea00693e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8006fd0 tx=0x7f0eb8008040 comp rx=0 tx=0).stop 2023-10-06T11:13:33.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.994+0000 7f0ec58da700 1 -- 172.21.15.146:0/3948307499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ec00cb090 msgr2=0x7f0ec00b4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:33.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.994+0000 7f0ec58da700 1 --2- 172.21.15.146:0/3948307499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ec00cb090 0x7f0ec00b4810 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f0ec00694f0 tx=0x7f0ea8017000 comp rx=0 tx=0).stop 2023-10-06T11:13:33.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.994+0000 7f0ec58da700 1 -- 172.21.15.146:0/3948307499 shutdown_connections 2023-10-06T11:13:33.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.994+0000 7f0ec58da700 1 --2- 172.21.15.146:0/3948307499 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0ea0066f30 0x7f0ea00693e0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:33.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.994+0000 7f0ec58da700 1 --2- 172.21.15.146:0/3948307499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ec00cb090 0x7f0ec00b4810 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:33.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.994+0000 7f0ec58da700 1 --2- 172.21.15.146:0/3948307499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ec0068780 0x7f0ec0150e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:33.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.994+0000 7f0ec58da700 1 --2- 172.21.15.146:0/3948307499 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ec00b5640 0x7f0ec015b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:33.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.994+0000 7f0ec58da700 1 -- 172.21.15.146:0/3948307499 >> 172.21.15.146:0/3948307499 conn(0x7f0ec00703f0 msgr2=0x7f0ec0153660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:33.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.995+0000 7f0ec58da700 1 -- 172.21.15.146:0/3948307499 shutdown_connections 2023-10-06T11:13:33.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:33.995+0000 7f0ec58da700 1 -- 172.21.15.146:0/3948307499 wait complete. 2023-10-06T11:13:34.009 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:13:34.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.123+0000 7fcf360d3700 1 Processor -- start 2023-10-06T11:13:34.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.124+0000 7fcf360d3700 1 -- start start 2023-10-06T11:13:34.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.124+0000 7fcf360d3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf300cbe30 0x7fcf300cc280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:34.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.124+0000 7fcf360d3700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcf30159c20 0x7fcf3015a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:34.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.124+0000 7fcf360d3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf3006c5a0 con 0x7fcf3013c390 2023-10-06T11:13:34.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.124+0000 7fcf360d3700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf3006b6b0 con 0x7fcf30159c20 2023-10-06T11:13:34.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.124+0000 7fcf360d3700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3006b990 con 0x7fcf300cbe30 2023-10-06T11:13:34.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.125+0000 7fcf350d1700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fcf3013c390 0x7fcf3015da70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35934/0 (socket says 172.21.15.146:35934) 2023-10-06T11:13:34.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.125+0000 7fcf350d1700 1 -- 172.21.15.146:0/3442652772 learned_addr learned my addr 172.21.15.146:0/3442652772 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:13:34.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.125+0000 7fcf348d0700 1 --2- 172.21.15.146:0/3442652772 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf300cbe30 0x7fcf300cc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:34.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.125+0000 7fcf27fff700 1 -- 172.21.15.146:0/3442652772 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1651434472 0 0) 0x7fcf3006c5a0 con 0x7fcf3013c390 2023-10-06T11:13:34.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.125+0000 7fcf358d2700 1 --2- 172.21.15.146:0/3442652772 >> v2:172.21.15.151:3300/0 conn(0x7fcf30159c20 0x7fcf3015a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:34.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.125+0000 7fcf27fff700 1 -- 172.21.15.146:0/3442652772 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf1c003570 con 0x7fcf3013c390 2023-10-06T11:13:34.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.125+0000 7fcf27fff700 1 -- 172.21.15.146:0/3442652772 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 606523071 0 0) 0x7fcf1c003570 con 0x7fcf3013c390 2023-10-06T11:13:34.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.125+0000 7fcf27fff700 1 -- 172.21.15.146:0/3442652772 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf300cbe30 msgr2=0x7fcf300cc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:34.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.125+0000 7fcf27fff700 1 --2- 172.21.15.146:0/3442652772 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf300cbe30 0x7fcf300cc280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.125+0000 7fcf27fff700 1 -- 172.21.15.146:0/3442652772 >> v2:172.21.15.151:3300/0 conn(0x7fcf30159c20 msgr2=0x7fcf3015a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:34.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.125+0000 7fcf27fff700 1 --2- 172.21.15.146:0/3442652772 >> v2:172.21.15.151:3300/0 conn(0x7fcf30159c20 0x7fcf3015a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.125+0000 7fcf27fff700 1 -- 172.21.15.146:0/3442652772 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf3006bc70 con 0x7fcf3013c390 2023-10-06T11:13:34.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.125+0000 7fcf27fff700 1 -- 172.21.15.146:0/3442652772 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fcf2c0015f0 con 0x7fcf3013c390 2023-10-06T11:13:34.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.125+0000 7fcf27fff700 1 -- 172.21.15.146:0/3442652772 >> v1:172.21.15.146:6789/0 conn(0x7fcf3013c390 legacy=0x7fcf3015da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:34.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.125+0000 7fcf27fff700 1 --2- 172.21.15.146:0/3442652772 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf300cbe30 0x7fcf1c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:34.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.125+0000 7fcf27fff700 1 --2- 172.21.15.146:0/3442652772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf1c003fe0 0x7fcf1c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:34.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.125+0000 7fcf27fff700 1 --2- 172.21.15.146:0/3442652772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf1c004d50 0x7fcf1c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:34.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.125+0000 7fcf27fff700 1 -- 172.21.15.146:0/3442652772 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3006b6b0 con 0x7fcf1c004d50 2023-10-06T11:13:34.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.125+0000 7fcf27fff700 1 -- 172.21.15.146:0/3442652772 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3006b990 con 0x7fcf1c003fe0 2023-10-06T11:13:34.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.125+0000 7fcf27fff700 1 -- 172.21.15.146:0/3442652772 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c00ba90 con 0x7fcf300cbe30 2023-10-06T11:13:34.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.125+0000 7fcf358d2700 1 --2- 172.21.15.146:0/3442652772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf1c004d50 0x7fcf1c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:34.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.125+0000 7fcf350d1700 1 --2- 172.21.15.146:0/3442652772 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf300cbe30 0x7fcf1c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:34.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.125+0000 7fcf348d0700 1 --2- 172.21.15.146:0/3442652772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf1c003fe0 0x7fcf1c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:34.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.126+0000 7fcf358d2700 1 -- 172.21.15.146:0/3442652772 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf300cbe30 msgr2=0x7fcf1c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:34.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.126+0000 7fcf358d2700 1 --2- 172.21.15.146:0/3442652772 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf300cbe30 0x7fcf1c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.126+0000 7fcf358d2700 1 -- 172.21.15.146:0/3442652772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf1c003fe0 msgr2=0x7fcf1c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:34.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.126+0000 7fcf358d2700 1 --2- 172.21.15.146:0/3442652772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf1c003fe0 0x7fcf1c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.126+0000 7fcf358d2700 1 -- 172.21.15.146:0/3442652772 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1c003570 con 0x7fcf1c004d50 2023-10-06T11:13:34.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.126+0000 7fcf358d2700 1 --2- 172.21.15.146:0/3442652772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf1c004d50 0x7fcf1c0051c0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fcf2800e210 tx=0x7fcf2800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5537098d4bcd8969 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:34.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.126+0000 7fcf27fff700 1 -- 172.21.15.146:0/3442652772 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2800ea60 con 0x7fcf1c004d50 2023-10-06T11:13:34.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.126+0000 7fcf27fff700 1 -- 172.21.15.146:0/3442652772 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf2800f040 con 0x7fcf1c004d50 2023-10-06T11:13:34.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.126+0000 7fcf27fff700 1 -- 172.21.15.146:0/3442652772 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2800ee10 con 0x7fcf1c004d50 2023-10-06T11:13:34.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.126+0000 7fcf360d3700 1 -- 172.21.15.146:0/3442652772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf1c004d50 msgr2=0x7fcf1c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:34.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.126+0000 7fcf360d3700 1 --2- 172.21.15.146:0/3442652772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf1c004d50 0x7fcf1c0051c0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fcf2800e210 tx=0x7fcf2800b040 comp rx=0 tx=0).stop 2023-10-06T11:13:34.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.126+0000 7fcf358d2700 1 -- 172.21.15.146:0/3442652772 reap_dead start 2023-10-06T11:13:34.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.126+0000 7fcf360d3700 1 -- 172.21.15.146:0/3442652772 shutdown_connections 2023-10-06T11:13:34.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.126+0000 7fcf360d3700 1 -- 172.21.15.146:0/3442652772 >> 172.21.15.146:0/3442652772 conn(0x7fcf300ce260 msgr2=0x7fcf300ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:34.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.126+0000 7fcf360d3700 1 -- 172.21.15.146:0/3442652772 shutdown_connections 2023-10-06T11:13:34.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.126+0000 7fcf360d3700 1 -- 172.21.15.146:0/3442652772 wait complete. 2023-10-06T11:13:34.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.128+0000 7fcf360d3700 1 Processor -- start 2023-10-06T11:13:34.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.128+0000 7fcf360d3700 1 -- start start 2023-10-06T11:13:34.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.128+0000 7fcf360d3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf30155b70 0x7fcf30155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:34.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.128+0000 7fcf360d3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf30139f40 0x7fcf3016cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:34.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.128+0000 7fcf360d3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf3016d510 0x7fcf3016d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:34.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.128+0000 7fcf360d3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf300b0a10 con 0x7fcf30155b70 2023-10-06T11:13:34.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.128+0000 7fcf360d3700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf30156610 con 0x7fcf30139f40 2023-10-06T11:13:34.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.128+0000 7fcf360d3700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf301568f0 con 0x7fcf3016d510 2023-10-06T11:13:34.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.129+0000 7fcf350d1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf30155b70 0x7fcf30155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:34.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.129+0000 7fcf350d1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf30155b70 0x7fcf30155f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33564/0 (socket says 172.21.15.146:33564) 2023-10-06T11:13:34.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.129+0000 7fcf350d1700 1 -- 172.21.15.146:0/985807376 learned_addr learned my addr 172.21.15.146:0/985807376 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:34.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.129+0000 7fcf348d0700 1 --2- 172.21.15.146:0/985807376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf30139f40 0x7fcf3016cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:34.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.129+0000 7fcf358d2700 1 --2- 172.21.15.146:0/985807376 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf3016d510 0x7fcf3016d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:34.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.129+0000 7fcf350d1700 1 -- 172.21.15.146:0/985807376 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf3016d510 msgr2=0x7fcf3016d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:34.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.129+0000 7fcf350d1700 1 --2- 172.21.15.146:0/985807376 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf3016d510 0x7fcf3016d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.129+0000 7fcf350d1700 1 -- 172.21.15.146:0/985807376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf30139f40 msgr2=0x7fcf3016cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:34.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.129+0000 7fcf350d1700 1 --2- 172.21.15.146:0/985807376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf30139f40 0x7fcf3016cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.129+0000 7fcf350d1700 1 -- 172.21.15.146:0/985807376 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf30156bd0 con 0x7fcf30155b70 2023-10-06T11:13:34.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.129+0000 7fcf358d2700 1 --2- 172.21.15.146:0/985807376 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf3016d510 0x7fcf3016d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:34.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.129+0000 7fcf350d1700 1 --2- 172.21.15.146:0/985807376 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf30155b70 0x7fcf30155f40 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c00fc00 tx=0x7fcf2c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:34.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.129+0000 7fcf257fa700 1 -- 172.21.15.146:0/985807376 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c0073b0 con 0x7fcf30155b70 2023-10-06T11:13:34.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.129+0000 7fcf257fa700 1 -- 172.21.15.146:0/985807376 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf2c007510 con 0x7fcf30155b70 2023-10-06T11:13:34.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.129+0000 7fcf360d3700 1 -- 172.21.15.146:0/985807376 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf30156eb0 con 0x7fcf30155b70 2023-10-06T11:13:34.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.129+0000 7fcf257fa700 1 -- 172.21.15.146:0/985807376 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c005a40 con 0x7fcf30155b70 2023-10-06T11:13:34.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.129+0000 7fcf360d3700 1 -- 172.21.15.146:0/985807376 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf301699d0 con 0x7fcf30155b70 2023-10-06T11:13:34.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.130+0000 7fcf360d3700 1 -- 172.21.15.146:0/985807376 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf3006e510 con 0x7fcf30155b70 2023-10-06T11:13:34.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.130+0000 7fcf257fa700 1 -- 172.21.15.146:0/985807376 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcf2c00d710 con 0x7fcf30155b70 2023-10-06T11:13:34.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.131+0000 7fcf257fa700 1 --2- 172.21.15.146:0/985807376 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcf14066f30 0x7fcf140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:34.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.131+0000 7fcf257fa700 1 -- 172.21.15.146:0/985807376 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcf2c084990 con 0x7fcf30155b70 2023-10-06T11:13:34.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.131+0000 7fcf348d0700 1 --2- 172.21.15.146:0/985807376 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcf14066f30 0x7fcf140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:34.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.131+0000 7fcf348d0700 1 --2- 172.21.15.146:0/985807376 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcf14066f30 0x7fcf140693e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fcf301502e0 tx=0x7fcf200091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:34.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.135+0000 7fcf257fa700 1 -- 172.21.15.146:0/985807376 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcf2c051aa0 con 0x7fcf30155b70 2023-10-06T11:13:34.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.361+0000 7fcf360d3700 1 -- 172.21.15.146:0/985807376 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf3006bf50 con 0x7fcf30155b70 2023-10-06T11:13:34.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.361+0000 7fcf257fa700 1 -- 172.21.15.146:0/985807376 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4605 (secure 0 0 0) 0x7fcf2c084070 con 0x7fcf30155b70 2023-10-06T11:13:34.364 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:13:34.364 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":93,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/2159562091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2159562091},{"type":"v1","addr":"172.21.15.151:6834","nonce":2159562091}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6242,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/603782012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":603782012},{"type":"v1","addr":"172.21.15.151:6835","nonce":603782012}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6916,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3416056259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3416056259},{"type":"v1","addr":"172.21.15.146:6837","nonce":3416056259}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:13:30.345795+0000","modified":"2023-10-06T11:13:33.984549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7620":{"gid":7620,"name":"c","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/785131800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":785131800},{"type":"v1","addr":"172.21.15.146:6835","nonce":785131800}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T11:13:34.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.363+0000 7fcf360d3700 1 -- 172.21.15.146:0/985807376 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcf14066f30 msgr2=0x7fcf140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:34.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.363+0000 7fcf360d3700 1 --2- 172.21.15.146:0/985807376 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcf14066f30 0x7fcf140693e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fcf301502e0 tx=0x7fcf200091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.363+0000 7fcf360d3700 1 -- 172.21.15.146:0/985807376 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf30155b70 msgr2=0x7fcf30155f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:34.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.363+0000 7fcf360d3700 1 --2- 172.21.15.146:0/985807376 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf30155b70 0x7fcf30155f40 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c00fc00 tx=0x7fcf2c009040 comp rx=0 tx=0).stop 2023-10-06T11:13:34.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.363+0000 7fcf360d3700 1 -- 172.21.15.146:0/985807376 shutdown_connections 2023-10-06T11:13:34.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.363+0000 7fcf360d3700 1 --2- 172.21.15.146:0/985807376 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcf14066f30 0x7fcf140693e0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.363+0000 7fcf360d3700 1 --2- 172.21.15.146:0/985807376 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf3016d510 0x7fcf3016d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.363+0000 7fcf360d3700 1 --2- 172.21.15.146:0/985807376 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf30155b70 0x7fcf30155f40 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.363+0000 7fcf360d3700 1 --2- 172.21.15.146:0/985807376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf30139f40 0x7fcf3016cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.363+0000 7fcf360d3700 1 -- 172.21.15.146:0/985807376 >> 172.21.15.146:0/985807376 conn(0x7fcf300ce260 msgr2=0x7fcf300c3950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:34.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.363+0000 7fcf360d3700 1 -- 172.21.15.146:0/985807376 shutdown_connections 2023-10-06T11:13:34.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.363+0000 7fcf360d3700 1 -- 172.21.15.146:0/985807376 wait complete. 2023-10-06T11:13:34.367 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 93 2023-10-06T11:13:34.378 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:13:34.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.490+0000 7eff214a3700 1 Processor -- start 2023-10-06T11:13:34.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.490+0000 7eff214a3700 1 -- start start 2023-10-06T11:13:34.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.491+0000 7eff214a3700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7eff1c0c97c0 0x7eff1c15aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:34.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.491+0000 7eff214a3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7eff1c0ca330 0x7eff1c06e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:34.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.491+0000 7eff214a3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7eff1c0ca7d0 0x7eff1c06ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:34.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.491+0000 7eff214a3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff1c0b00c0 con 0x7eff1c0ca7d0 2023-10-06T11:13:34.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.491+0000 7eff214a3700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff1c0afc30 con 0x7eff1c0c97c0 2023-10-06T11:13:34.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.491+0000 7eff214a3700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c1569b0 con 0x7eff1c0ca330 2023-10-06T11:13:34.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.491+0000 7eff1b7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7eff1c0ca7d0 0x7eff1c06ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:34.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.491+0000 7eff1b7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7eff1c0ca7d0 0x7eff1c06ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33566/0 (socket says 172.21.15.146:33566) 2023-10-06T11:13:34.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.491+0000 7eff1b7fe700 1 -- 172.21.15.146:0/3817112292 learned_addr learned my addr 172.21.15.146:0/3817112292 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:34.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.492+0000 7eff127fc700 1 --2- 172.21.15.146:0/3817112292 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7eff1c0ca330 0x7eff1c06e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:34.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.492+0000 7eff1affd700 1 --2- 172.21.15.146:0/3817112292 >> v2:172.21.15.151:3300/0 conn(0x7eff1c0c97c0 0x7eff1c15aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:34.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.492+0000 7eff1b7fe700 1 -- 172.21.15.146:0/3817112292 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7eff1c0ca330 msgr2=0x7eff1c06e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:34.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.492+0000 7eff1b7fe700 1 --2- 172.21.15.146:0/3817112292 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7eff1c0ca330 0x7eff1c06e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.492+0000 7eff1b7fe700 1 -- 172.21.15.146:0/3817112292 >> v2:172.21.15.151:3300/0 conn(0x7eff1c0c97c0 msgr2=0x7eff1c15aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:34.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.492+0000 7eff1b7fe700 1 --2- 172.21.15.146:0/3817112292 >> v2:172.21.15.151:3300/0 conn(0x7eff1c0c97c0 0x7eff1c15aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.492+0000 7eff1b7fe700 1 -- 172.21.15.146:0/3817112292 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1c0b1c60 con 0x7eff1c0ca7d0 2023-10-06T11:13:34.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.492+0000 7eff127fc700 1 --2- 172.21.15.146:0/3817112292 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7eff1c0ca330 0x7eff1c06e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:34.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.492+0000 7eff1affd700 1 --2- 172.21.15.146:0/3817112292 >> v2:172.21.15.151:3300/0 conn(0x7eff1c0c97c0 0x7eff1c15aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:34.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.492+0000 7eff1b7fe700 1 --2- 172.21.15.146:0/3817112292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff1c0ca7d0 0x7eff1c06ead0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7eff1c071990 tx=0x7eff14009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e450218b005d757 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:34.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.492+0000 7eff1a7fc700 1 -- 172.21.15.146:0/3817112292 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1400e070 con 0x7eff1c0ca7d0 2023-10-06T11:13:34.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.492+0000 7eff1a7fc700 1 -- 172.21.15.146:0/3817112292 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1400ba50 con 0x7eff1c0ca7d0 2023-10-06T11:13:34.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.492+0000 7eff1a7fc700 1 -- 172.21.15.146:0/3817112292 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff140092e0 con 0x7eff1c0ca7d0 2023-10-06T11:13:34.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.493+0000 7eff214a3700 1 -- 172.21.15.146:0/3817112292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff1c0ca7d0 msgr2=0x7eff1c06ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:34.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.493+0000 7eff214a3700 1 --2- 172.21.15.146:0/3817112292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff1c0ca7d0 0x7eff1c06ead0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7eff1c071990 tx=0x7eff14009840 comp rx=0 tx=0).stop 2023-10-06T11:13:34.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.493+0000 7eff214a3700 1 -- 172.21.15.146:0/3817112292 shutdown_connections 2023-10-06T11:13:34.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.493+0000 7eff214a3700 1 --2- 172.21.15.146:0/3817112292 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff1c0ca7d0 0x7eff1c06ead0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.493+0000 7eff214a3700 1 --2- 172.21.15.146:0/3817112292 >> v2:172.21.15.151:3300/0 conn(0x7eff1c0c97c0 0x7eff1c15aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.493+0000 7eff214a3700 1 --2- 172.21.15.146:0/3817112292 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7eff1c0ca330 0x7eff1c06e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.493+0000 7eff214a3700 1 -- 172.21.15.146:0/3817112292 >> 172.21.15.146:0/3817112292 conn(0x7eff1c06b060 msgr2=0x7eff1c0aecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:34.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.493+0000 7eff214a3700 1 -- 172.21.15.146:0/3817112292 shutdown_connections 2023-10-06T11:13:34.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.493+0000 7eff214a3700 1 -- 172.21.15.146:0/3817112292 wait complete. 2023-10-06T11:13:34.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.494+0000 7eff214a3700 1 Processor -- start 2023-10-06T11:13:34.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.494+0000 7eff214a3700 1 -- start start 2023-10-06T11:13:34.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.495+0000 7eff214a3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7eff1c0c97c0 0x7eff1c148e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:34.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.495+0000 7eff214a3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7eff1c0ca330 0x7eff1c150b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:34.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.495+0000 7eff214a3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff1c0c8b90 0x7eff1c152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:34.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.495+0000 7eff214a3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c0c6ab0 con 0x7eff1c0c8b90 2023-10-06T11:13:34.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.495+0000 7eff214a3700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c1533c0 con 0x7eff1c0c97c0 2023-10-06T11:13:34.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.495+0000 7eff214a3700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c1536a0 con 0x7eff1c0ca330 2023-10-06T11:13:34.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.495+0000 7eff1b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff1c0c8b90 0x7eff1c152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:34.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.495+0000 7eff1b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff1c0c8b90 0x7eff1c152650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33570/0 (socket says 172.21.15.146:33570) 2023-10-06T11:13:34.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.495+0000 7eff1b7fe700 1 -- 172.21.15.146:0/2590808414 learned_addr learned my addr 172.21.15.146:0/2590808414 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:34.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.495+0000 7eff1affd700 1 --2- 172.21.15.146:0/2590808414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7eff1c0c97c0 0x7eff1c148e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:34.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.495+0000 7eff1b7fe700 1 -- 172.21.15.146:0/2590808414 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7eff1c0ca330 msgr2=0x7eff1c150b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:34.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.495+0000 7eff127fc700 1 --2- 172.21.15.146:0/2590808414 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7eff1c0ca330 0x7eff1c150b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:34.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.495+0000 7eff1b7fe700 1 --2- 172.21.15.146:0/2590808414 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7eff1c0ca330 0x7eff1c150b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.495+0000 7eff1b7fe700 1 -- 172.21.15.146:0/2590808414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7eff1c0c97c0 msgr2=0x7eff1c148e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:34.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.495+0000 7eff1b7fe700 1 --2- 172.21.15.146:0/2590808414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7eff1c0c97c0 0x7eff1c148e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.495+0000 7eff1b7fe700 1 -- 172.21.15.146:0/2590808414 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff14009ae0 con 0x7eff1c0c8b90 2023-10-06T11:13:34.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.495+0000 7eff1affd700 1 --2- 172.21.15.146:0/2590808414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7eff1c0c97c0 0x7eff1c148e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:34.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.495+0000 7eff127fc700 1 --2- 172.21.15.146:0/2590808414 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7eff1c0ca330 0x7eff1c150b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:34.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.495+0000 7eff1b7fe700 1 --2- 172.21.15.146:0/2590808414 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff1c0c8b90 0x7eff1c152650 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7eff1c06e100 tx=0x7eff14018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:34.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.495+0000 7eff137fe700 1 -- 172.21.15.146:0/2590808414 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff140032f0 con 0x7eff1c0c8b90 2023-10-06T11:13:34.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.495+0000 7eff137fe700 1 -- 172.21.15.146:0/2590808414 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff14008e80 con 0x7eff1c0c8b90 2023-10-06T11:13:34.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.495+0000 7eff214a3700 1 -- 172.21.15.146:0/2590808414 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff1c153980 con 0x7eff1c0c8b90 2023-10-06T11:13:34.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.495+0000 7eff137fe700 1 -- 172.21.15.146:0/2590808414 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1401c640 con 0x7eff1c0c8b90 2023-10-06T11:13:34.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.495+0000 7eff214a3700 1 -- 172.21.15.146:0/2590808414 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff1c1493c0 con 0x7eff1c0c8b90 2023-10-06T11:13:34.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.496+0000 7eff214a3700 1 -- 172.21.15.146:0/2590808414 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff1c0c6c20 con 0x7eff1c0c8b90 2023-10-06T11:13:34.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.497+0000 7eff137fe700 1 -- 172.21.15.146:0/2590808414 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7eff14003040 con 0x7eff1c0c8b90 2023-10-06T11:13:34.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.497+0000 7eff137fe700 1 --2- 172.21.15.146:0/2590808414 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7efefc066f30 0x7efefc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:34.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.497+0000 7eff137fe700 1 -- 172.21.15.146:0/2590808414 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7eff140860a0 con 0x7eff1c0c8b90 2023-10-06T11:13:34.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.497+0000 7eff1affd700 1 --2- 172.21.15.146:0/2590808414 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7efefc066f30 0x7efefc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:34.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.498+0000 7eff1affd700 1 --2- 172.21.15.146:0/2590808414 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7efefc066f30 0x7efefc0693e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7eff0c008a80 tx=0x7eff0c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:34.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.501+0000 7eff137fe700 1 -- 172.21.15.146:0/2590808414 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff140531b0 con 0x7eff1c0c8b90 2023-10-06T11:13:34.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.686+0000 7eff214a3700 1 -- 172.21.15.146:0/2590808414 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff1c159e90 con 0x7eff1c0c8b90 2023-10-06T11:13:34.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.687+0000 7eff137fe700 1 -- 172.21.15.146:0/2590808414 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+16920 (secure 0 0 0) 0x7eff140567d0 con 0x7eff1c0c8b90 2023-10-06T11:13:34.689 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:13:34.689 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":101,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:13:31.372487+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:13:28.028009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-10-06T11:13:29.311107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:13:34.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.689+0000 7eff214a3700 1 -- 172.21.15.146:0/2590808414 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7efefc066f30 msgr2=0x7efefc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:34.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.689+0000 7eff214a3700 1 --2- 172.21.15.146:0/2590808414 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7efefc066f30 0x7efefc0693e0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7eff0c008a80 tx=0x7eff0c008040 comp rx=0 tx=0).stop 2023-10-06T11:13:34.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.689+0000 7eff214a3700 1 -- 172.21.15.146:0/2590808414 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff1c0c8b90 msgr2=0x7eff1c152650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:34.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.689+0000 7eff214a3700 1 --2- 172.21.15.146:0/2590808414 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff1c0c8b90 0x7eff1c152650 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7eff1c06e100 tx=0x7eff14018000 comp rx=0 tx=0).stop 2023-10-06T11:13:34.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.689+0000 7eff214a3700 1 -- 172.21.15.146:0/2590808414 shutdown_connections 2023-10-06T11:13:34.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.689+0000 7eff214a3700 1 --2- 172.21.15.146:0/2590808414 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7efefc066f30 0x7efefc0693e0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.689+0000 7eff214a3700 1 --2- 172.21.15.146:0/2590808414 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7eff1c0c8b90 0x7eff1c152650 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.689+0000 7eff214a3700 1 --2- 172.21.15.146:0/2590808414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7eff1c0c97c0 0x7eff1c148e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.689+0000 7eff214a3700 1 --2- 172.21.15.146:0/2590808414 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7eff1c0ca330 0x7eff1c150b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.689+0000 7eff214a3700 1 -- 172.21.15.146:0/2590808414 >> 172.21.15.146:0/2590808414 conn(0x7eff1c06b060 msgr2=0x7eff1c067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:34.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.689+0000 7eff214a3700 1 -- 172.21.15.146:0/2590808414 shutdown_connections 2023-10-06T11:13:34.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.690+0000 7eff214a3700 1 -- 172.21.15.146:0/2590808414 wait complete. 2023-10-06T11:13:34.704 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T11:13:34.704 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:13:34.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.817+0000 7f447bcc5700 1 Processor -- start 2023-10-06T11:13:34.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.817+0000 7f447bcc5700 1 -- start start 2023-10-06T11:13:34.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.818+0000 7f447bcc5700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44740c4750 0x7f44740cd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:34.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.818+0000 7f447bcc5700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4474068a90 con 0x7f44740b08d0 2023-10-06T11:13:34.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.818+0000 7f447bcc5700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4474159fd0 con 0x7f44740c3960 2023-10-06T11:13:34.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.818+0000 7f447bcc5700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44740cdcf0 con 0x7f44740c4750 2023-10-06T11:13:34.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.818+0000 7f4479a61700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f44740b08d0 0x7f44740c3250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35940/0 (socket says 172.21.15.146:35940) 2023-10-06T11:13:34.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.818+0000 7f4479a61700 1 -- 172.21.15.146:0/849070494 learned_addr learned my addr 172.21.15.146:0/849070494 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:13:34.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.819+0000 7f447a262700 1 --2- 172.21.15.146:0/849070494 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44740c4750 0x7f44740cd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:34.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.819+0000 7f4478a5f700 1 -- 172.21.15.146:0/849070494 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3513639264 0 0) 0x7f4474068a90 con 0x7f44740b08d0 2023-10-06T11:13:34.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.819+0000 7f4478a5f700 1 -- 172.21.15.146:0/849070494 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4460003570 con 0x7f44740b08d0 2023-10-06T11:13:34.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.819+0000 7f4478a5f700 1 -- 172.21.15.146:0/849070494 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1940537275 0 0) 0x7f4474159fd0 con 0x7f44740c3960 2023-10-06T11:13:34.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.819+0000 7f4478a5f700 1 -- 172.21.15.146:0/849070494 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4474068a90 con 0x7f44740c3960 2023-10-06T11:13:34.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.819+0000 7f4478a5f700 1 -- 172.21.15.146:0/849070494 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 577869546 0 0) 0x7f4460003570 con 0x7f44740b08d0 2023-10-06T11:13:34.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.819+0000 7f447a262700 1 -- 172.21.15.146:0/849070494 >> v1:172.21.15.151:6789/0 conn(0x7f44740c3960 legacy=0x7f44740cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:34.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.819+0000 7f447a262700 1 -- 172.21.15.146:0/849070494 >> v1:172.21.15.146:6789/0 conn(0x7f44740b08d0 legacy=0x7f44740c3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:34.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.819+0000 7f447a262700 1 -- 172.21.15.146:0/849070494 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44740cdfd0 con 0x7f44740c4750 2023-10-06T11:13:34.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.819+0000 7f447a262700 1 --2- 172.21.15.146:0/849070494 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44740c4750 0x7f44740cd0a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f446c009910 tx=0x7f446c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2a681c1d88a8c85 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:34.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.819+0000 7f4478a5f700 1 -- 172.21.15.146:0/849070494 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44700017f0 con 0x7f44740c4750 2023-10-06T11:13:34.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.819+0000 7f4478a5f700 1 -- 172.21.15.146:0/849070494 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f446c011420 con 0x7f44740c4750 2023-10-06T11:13:34.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.819+0000 7f4478a5f700 1 -- 172.21.15.146:0/849070494 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446c0117c0 con 0x7f44740c4750 2023-10-06T11:13:34.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.820+0000 7f447bcc5700 1 -- 172.21.15.146:0/849070494 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44740c4750 msgr2=0x7f44740cd0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:34.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.820+0000 7f447bcc5700 1 --2- 172.21.15.146:0/849070494 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44740c4750 0x7f44740cd0a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f446c009910 tx=0x7f446c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.820+0000 7f447bcc5700 1 -- 172.21.15.146:0/849070494 shutdown_connections 2023-10-06T11:13:34.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.820+0000 7f447bcc5700 1 --2- 172.21.15.146:0/849070494 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44740c4750 0x7f44740cd0a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.820+0000 7f447bcc5700 1 -- 172.21.15.146:0/849070494 >> 172.21.15.146:0/849070494 conn(0x7f4474067c50 msgr2=0x7f44740ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:34.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.820+0000 7f447bcc5700 1 -- 172.21.15.146:0/849070494 shutdown_connections 2023-10-06T11:13:34.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.820+0000 7f447bcc5700 1 -- 172.21.15.146:0/849070494 wait complete. 2023-10-06T11:13:34.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.821+0000 7f447bcc5700 1 Processor -- start 2023-10-06T11:13:34.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.821+0000 7f447bcc5700 1 -- start start 2023-10-06T11:13:34.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.822+0000 7f447bcc5700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44740b08d0 0x7f4474157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:34.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.822+0000 7f447bcc5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44740c3960 0x7f447415c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:34.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.822+0000 7f447bcc5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44740c4750 0x7f447415c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:34.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.822+0000 7f447bcc5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4474160870 con 0x7f44740c4750 2023-10-06T11:13:34.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.822+0000 7f447bcc5700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44740b3f50 con 0x7f44740c3960 2023-10-06T11:13:34.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.822+0000 7f447bcc5700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44740b1710 con 0x7f44740b08d0 2023-10-06T11:13:34.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.822+0000 7f447a262700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44740c4750 0x7f447415c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:34.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.822+0000 7f447a262700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44740c4750 0x7f447415c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33578/0 (socket says 172.21.15.146:33578) 2023-10-06T11:13:34.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.822+0000 7f447a262700 1 -- 172.21.15.146:0/1972141746 learned_addr learned my addr 172.21.15.146:0/1972141746 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:34.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.822+0000 7f4479a61700 1 --2- 172.21.15.146:0/1972141746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44740b08d0 0x7f4474157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:34.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.822+0000 7f4479260700 1 --2- 172.21.15.146:0/1972141746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44740c3960 0x7f447415c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:34.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.822+0000 7f447a262700 1 -- 172.21.15.146:0/1972141746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44740b08d0 msgr2=0x7f4474157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:34.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.822+0000 7f447a262700 1 --2- 172.21.15.146:0/1972141746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44740b08d0 0x7f4474157da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.822+0000 7f447a262700 1 -- 172.21.15.146:0/1972141746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44740c3960 msgr2=0x7f447415c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:34.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.822+0000 7f447a262700 1 --2- 172.21.15.146:0/1972141746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44740c3960 0x7f447415c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:34.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.822+0000 7f447a262700 1 -- 172.21.15.146:0/1972141746 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f446c009420 con 0x7f44740c4750 2023-10-06T11:13:34.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.822+0000 7f447a262700 1 --2- 172.21.15.146:0/1972141746 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44740c4750 0x7f447415c900 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f446c009860 tx=0x7f446c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:34.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.822+0000 7f4469ffb700 1 -- 172.21.15.146:0/1972141746 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446c01cc90 con 0x7f44740c4750 2023-10-06T11:13:34.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.822+0000 7f4469ffb700 1 -- 172.21.15.146:0/1972141746 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f446c01ce10 con 0x7f44740c4750 2023-10-06T11:13:34.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.822+0000 7f4469ffb700 1 -- 172.21.15.146:0/1972141746 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446c01a6a0 con 0x7f44740c4750 2023-10-06T11:13:34.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.822+0000 7f447bcc5700 1 -- 172.21.15.146:0/1972141746 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44741582e0 con 0x7f44740c4750 2023-10-06T11:13:34.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.823+0000 7f447bcc5700 1 -- 172.21.15.146:0/1972141746 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44740b3c70 con 0x7f44740c4750 2023-10-06T11:13:34.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.824+0000 7f447bcc5700 1 -- 172.21.15.146:0/1972141746 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f447404c380 con 0x7f44740c4750 2023-10-06T11:13:34.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.824+0000 7f4469ffb700 1 -- 172.21.15.146:0/1972141746 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f446c01aad0 con 0x7f44740c4750 2023-10-06T11:13:34.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.824+0000 7f4469ffb700 1 --2- 172.21.15.146:0/1972141746 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4458066f30 0x7f44580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:34.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.825+0000 7f4479a61700 1 --2- 172.21.15.146:0/1972141746 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4458066f30 0x7f44580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:34.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.825+0000 7f4469ffb700 1 -- 172.21.15.146:0/1972141746 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f446c086460 con 0x7f44740c4750 2023-10-06T11:13:34.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.825+0000 7f4479a61700 1 --2- 172.21.15.146:0/1972141746 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4458066f30 0x7f44580693e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f4470007fd0 tx=0x7f44700019a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:34.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:34.829+0000 7f4469ffb700 1 -- 172.21.15.146:0/1972141746 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f446c0534d0 con 0x7f44740c4750 2023-10-06T11:13:35.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.008+0000 7f447bcc5700 1 -- 172.21.15.146:0/1972141746 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f44740ca8f0 con 0x7f4458066f30 2023-10-06T11:13:35.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.016+0000 7f4469ffb700 1 -- 172.21.15.146:0/1972141746 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311506 (secure 0 0 0) 0x7f44740ca8f0 con 0x7f4458066f30 2023-10-06T11:13:35.023 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:13:35.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.020+0000 7f447bcc5700 1 -- 172.21.15.146:0/1972141746 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4458066f30 msgr2=0x7f44580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:35.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.020+0000 7f447bcc5700 1 --2- 172.21.15.146:0/1972141746 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4458066f30 0x7f44580693e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f4470007fd0 tx=0x7f44700019a0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.020+0000 7f447bcc5700 1 -- 172.21.15.146:0/1972141746 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44740c4750 msgr2=0x7f447415c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:35.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.020+0000 7f447bcc5700 1 --2- 172.21.15.146:0/1972141746 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44740c4750 0x7f447415c900 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f446c009860 tx=0x7f446c016000 comp rx=0 tx=0).stop 2023-10-06T11:13:35.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.020+0000 7f447bcc5700 1 -- 172.21.15.146:0/1972141746 shutdown_connections 2023-10-06T11:13:35.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.020+0000 7f447bcc5700 1 --2- 172.21.15.146:0/1972141746 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4458066f30 0x7f44580693e0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.020+0000 7f447bcc5700 1 --2- 172.21.15.146:0/1972141746 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f44740c4750 0x7f447415c900 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.020+0000 7f447bcc5700 1 --2- 172.21.15.146:0/1972141746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44740b08d0 0x7f4474157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.020+0000 7f447bcc5700 1 --2- 172.21.15.146:0/1972141746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44740c3960 0x7f447415c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.020+0000 7f447bcc5700 1 -- 172.21.15.146:0/1972141746 >> 172.21.15.146:0/1972141746 conn(0x7f4474067c50 msgr2=0x7f44740caf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:35.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.020+0000 7f447bcc5700 1 -- 172.21.15.146:0/1972141746 shutdown_connections 2023-10-06T11:13:35.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.020+0000 7f447bcc5700 1 -- 172.21.15.146:0/1972141746 wait complete. 2023-10-06T11:13:35.026 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:13:35.034 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":332,"stamp":"2023-10-06T11:13:33.240362+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":110,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2442420,"kb_used_data":10868,"kb_used_omap":0,"kb_used_meta":2431488,"kb_avail":752532300,"statfs":{"total":773094113280,"available":770593075200,"internally_reserved":0,"allocated":11128832,"data_stored":5698094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2489843712},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.283296"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.391468+0000","last_change":"2023-10-06T11:13:30.391468+0000","last_active":"2023-10-06T11:13:30.391468+0000","last_peered":"2023-10-06T11:13:30.391468+0000","last_clean":"2023-10-06T11:13:30.391468+0000","last_became_active":"2023-10-06T11:13:30.390997+0000","last_became_peered":"2023-10-06T11:13:30.390997+0000","last_unstale":"2023-10-06T11:13:30.391468+0000","last_undegraded":"2023-10-06T11:13:30.391468+0000","last_fullsized":"2023-10-06T11:13:30.391468+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:55:56.708602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.390078+0000","last_change":"2023-10-06T11:13:30.390078+0000","last_active":"2023-10-06T11:13:30.390078+0000","last_peered":"2023-10-06T11:13:30.390078+0000","last_clean":"2023-10-06T11:13:30.390078+0000","last_became_active":"2023-10-06T11:13:30.389801+0000","last_became_peered":"2023-10-06T11:13:30.389801+0000","last_unstale":"2023-10-06T11:13:30.390078+0000","last_undegraded":"2023-10-06T11:13:30.390078+0000","last_fullsized":"2023-10-06T11:13:30.390078+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:34:14.300690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.393936+0000","last_change":"2023-10-06T11:13:30.393936+0000","last_active":"2023-10-06T11:13:30.393936+0000","last_peered":"2023-10-06T11:13:30.393936+0000","last_clean":"2023-10-06T11:13:30.393936+0000","last_became_active":"2023-10-06T11:13:30.393687+0000","last_became_peered":"2023-10-06T11:13:30.393687+0000","last_unstale":"2023-10-06T11:13:30.393936+0000","last_undegraded":"2023-10-06T11:13:30.393936+0000","last_fullsized":"2023-10-06T11:13:30.393936+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:48:58.606251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.387420+0000","last_change":"2023-10-06T11:13:30.387420+0000","last_active":"2023-10-06T11:13:30.387420+0000","last_peered":"2023-10-06T11:13:30.387420+0000","last_clean":"2023-10-06T11:13:30.387420+0000","last_became_active":"2023-10-06T11:13:30.386100+0000","last_became_peered":"2023-10-06T11:13:30.386100+0000","last_unstale":"2023-10-06T11:13:30.387420+0000","last_undegraded":"2023-10-06T11:13:30.387420+0000","last_fullsized":"2023-10-06T11:13:30.387420+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:04:49.205484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.395475+0000","last_change":"2023-10-06T11:13:30.393872+0000","last_active":"2023-10-06T11:13:30.395475+0000","last_peered":"2023-10-06T11:13:30.395475+0000","last_clean":"2023-10-06T11:13:30.395475+0000","last_became_active":"2023-10-06T11:13:30.393328+0000","last_became_peered":"2023-10-06T11:13:30.393328+0000","last_unstale":"2023-10-06T11:13:30.395475+0000","last_undegraded":"2023-10-06T11:13:30.395475+0000","last_fullsized":"2023-10-06T11:13:30.395475+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:37.202804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.392367+0000","last_change":"2023-10-06T11:13:30.392367+0000","last_active":"2023-10-06T11:13:30.392367+0000","last_peered":"2023-10-06T11:13:30.392367+0000","last_clean":"2023-10-06T11:13:30.392367+0000","last_became_active":"2023-10-06T11:13:30.392056+0000","last_became_peered":"2023-10-06T11:13:30.392056+0000","last_unstale":"2023-10-06T11:13:30.392367+0000","last_undegraded":"2023-10-06T11:13:30.392367+0000","last_fullsized":"2023-10-06T11:13:30.392367+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:18.313520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.394522+0000","last_change":"2023-10-06T11:13:30.394522+0000","last_active":"2023-10-06T11:13:30.394522+0000","last_peered":"2023-10-06T11:13:30.394522+0000","last_clean":"2023-10-06T11:13:30.394522+0000","last_became_active":"2023-10-06T11:13:30.394235+0000","last_became_peered":"2023-10-06T11:13:30.394235+0000","last_unstale":"2023-10-06T11:13:30.394522+0000","last_undegraded":"2023-10-06T11:13:30.394522+0000","last_fullsized":"2023-10-06T11:13:30.394522+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:01:06.220157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.385783+0000","last_change":"2023-10-06T11:13:30.385783+0000","last_active":"2023-10-06T11:13:30.385783+0000","last_peered":"2023-10-06T11:13:30.385783+0000","last_clean":"2023-10-06T11:13:30.385783+0000","last_became_active":"2023-10-06T11:13:30.384960+0000","last_became_peered":"2023-10-06T11:13:30.384960+0000","last_unstale":"2023-10-06T11:13:30.385783+0000","last_undegraded":"2023-10-06T11:13:30.385783+0000","last_fullsized":"2023-10-06T11:13:30.385783+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:01:49.355080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.390675+0000","last_change":"2023-10-06T11:13:30.390675+0000","last_active":"2023-10-06T11:13:30.390675+0000","last_peered":"2023-10-06T11:13:30.390675+0000","last_clean":"2023-10-06T11:13:30.390675+0000","last_became_active":"2023-10-06T11:13:30.390416+0000","last_became_peered":"2023-10-06T11:13:30.390416+0000","last_unstale":"2023-10-06T11:13:30.390675+0000","last_undegraded":"2023-10-06T11:13:30.390675+0000","last_fullsized":"2023-10-06T11:13:30.390675+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:08.791515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.395409+0000","last_change":"2023-10-06T11:13:30.393721+0000","last_active":"2023-10-06T11:13:30.395409+0000","last_peered":"2023-10-06T11:13:30.395409+0000","last_clean":"2023-10-06T11:13:30.395409+0000","last_became_active":"2023-10-06T11:13:30.393469+0000","last_became_peered":"2023-10-06T11:13:30.393469+0000","last_unstale":"2023-10-06T11:13:30.395409+0000","last_undegraded":"2023-10-06T11:13:30.395409+0000","last_fullsized":"2023-10-06T11:13:30.395409+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:27:12.928906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.395770+0000","last_change":"2023-10-06T11:13:30.395770+0000","last_active":"2023-10-06T11:13:30.395770+0000","last_peered":"2023-10-06T11:13:30.395770+0000","last_clean":"2023-10-06T11:13:30.395770+0000","last_became_active":"2023-10-06T11:13:30.395514+0000","last_became_peered":"2023-10-06T11:13:30.395514+0000","last_unstale":"2023-10-06T11:13:30.395770+0000","last_undegraded":"2023-10-06T11:13:30.395770+0000","last_fullsized":"2023-10-06T11:13:30.395770+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:31:18.045782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.392422+0000","last_change":"2023-10-06T11:13:30.387352+0000","last_active":"2023-10-06T11:13:30.392422+0000","last_peered":"2023-10-06T11:13:30.392422+0000","last_clean":"2023-10-06T11:13:30.392422+0000","last_became_active":"2023-10-06T11:13:30.386941+0000","last_became_peered":"2023-10-06T11:13:30.386941+0000","last_unstale":"2023-10-06T11:13:30.392422+0000","last_undegraded":"2023-10-06T11:13:30.392422+0000","last_fullsized":"2023-10-06T11:13:30.392422+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:22.764379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.383568+0000","last_change":"2023-10-06T11:13:30.383568+0000","last_active":"2023-10-06T11:13:30.383568+0000","last_peered":"2023-10-06T11:13:30.383568+0000","last_clean":"2023-10-06T11:13:30.383568+0000","last_became_active":"2023-10-06T11:13:30.383274+0000","last_became_peered":"2023-10-06T11:13:30.383274+0000","last_unstale":"2023-10-06T11:13:30.383568+0000","last_undegraded":"2023-10-06T11:13:30.383568+0000","last_fullsized":"2023-10-06T11:13:30.383568+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:57:05.858686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.393892+0000","last_change":"2023-10-06T11:13:30.393892+0000","last_active":"2023-10-06T11:13:30.393892+0000","last_peered":"2023-10-06T11:13:30.393892+0000","last_clean":"2023-10-06T11:13:30.393892+0000","last_became_active":"2023-10-06T11:13:30.392621+0000","last_became_peered":"2023-10-06T11:13:30.392621+0000","last_unstale":"2023-10-06T11:13:30.393892+0000","last_undegraded":"2023-10-06T11:13:30.393892+0000","last_fullsized":"2023-10-06T11:13:30.393892+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:07:50.934263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.396797+0000","last_change":"2023-10-06T11:13:30.396797+0000","last_active":"2023-10-06T11:13:30.396797+0000","last_peered":"2023-10-06T11:13:30.396797+0000","last_clean":"2023-10-06T11:13:30.396797+0000","last_became_active":"2023-10-06T11:13:30.396545+0000","last_became_peered":"2023-10-06T11:13:30.396545+0000","last_unstale":"2023-10-06T11:13:30.396797+0000","last_undegraded":"2023-10-06T11:13:30.396797+0000","last_fullsized":"2023-10-06T11:13:30.396797+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:04:49.205484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.393400+0000","last_change":"2023-10-06T11:13:30.393400+0000","last_active":"2023-10-06T11:13:30.393400+0000","last_peered":"2023-10-06T11:13:30.393400+0000","last_clean":"2023-10-06T11:13:30.393400+0000","last_became_active":"2023-10-06T11:13:30.393010+0000","last_became_peered":"2023-10-06T11:13:30.393010+0000","last_unstale":"2023-10-06T11:13:30.393400+0000","last_undegraded":"2023-10-06T11:13:30.393400+0000","last_fullsized":"2023-10-06T11:13:30.393400+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:28:28.429635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.395636+0000","last_change":"2023-10-06T11:13:30.395636+0000","last_active":"2023-10-06T11:13:30.395636+0000","last_peered":"2023-10-06T11:13:30.395636+0000","last_clean":"2023-10-06T11:13:30.395636+0000","last_became_active":"2023-10-06T11:13:30.395318+0000","last_became_peered":"2023-10-06T11:13:30.395318+0000","last_unstale":"2023-10-06T11:13:30.395636+0000","last_undegraded":"2023-10-06T11:13:30.395636+0000","last_fullsized":"2023-10-06T11:13:30.395636+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:39.911708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.391882+0000","last_change":"2023-10-06T11:13:30.391882+0000","last_active":"2023-10-06T11:13:30.391882+0000","last_peered":"2023-10-06T11:13:30.391882+0000","last_clean":"2023-10-06T11:13:30.391882+0000","last_became_active":"2023-10-06T11:13:30.391628+0000","last_became_peered":"2023-10-06T11:13:30.391628+0000","last_unstale":"2023-10-06T11:13:30.391882+0000","last_undegraded":"2023-10-06T11:13:30.391882+0000","last_fullsized":"2023-10-06T11:13:30.391882+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:38:53.530447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.394726+0000","last_change":"2023-10-06T11:13:30.394726+0000","last_active":"2023-10-06T11:13:30.394726+0000","last_peered":"2023-10-06T11:13:30.394726+0000","last_clean":"2023-10-06T11:13:30.394726+0000","last_became_active":"2023-10-06T11:13:30.394312+0000","last_became_peered":"2023-10-06T11:13:30.394312+0000","last_unstale":"2023-10-06T11:13:30.394726+0000","last_undegraded":"2023-10-06T11:13:30.394726+0000","last_fullsized":"2023-10-06T11:13:30.394726+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:50.606291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.397973+0000","last_change":"2023-10-06T11:13:30.392741+0000","last_active":"2023-10-06T11:13:30.397973+0000","last_peered":"2023-10-06T11:13:30.397973+0000","last_clean":"2023-10-06T11:13:30.397973+0000","last_became_active":"2023-10-06T11:13:30.392161+0000","last_became_peered":"2023-10-06T11:13:30.392161+0000","last_unstale":"2023-10-06T11:13:30.397973+0000","last_undegraded":"2023-10-06T11:13:30.397973+0000","last_fullsized":"2023-10-06T11:13:30.397973+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:00.386689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.390059+0000","last_change":"2023-10-06T11:13:30.390059+0000","last_active":"2023-10-06T11:13:30.390059+0000","last_peered":"2023-10-06T11:13:30.390059+0000","last_clean":"2023-10-06T11:13:30.390059+0000","last_became_active":"2023-10-06T11:13:30.389818+0000","last_became_peered":"2023-10-06T11:13:30.389818+0000","last_unstale":"2023-10-06T11:13:30.390059+0000","last_undegraded":"2023-10-06T11:13:30.390059+0000","last_fullsized":"2023-10-06T11:13:30.390059+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:20:42.175876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.389122+0000","last_change":"2023-10-06T11:13:30.386827+0000","last_active":"2023-10-06T11:13:30.389122+0000","last_peered":"2023-10-06T11:13:30.389122+0000","last_clean":"2023-10-06T11:13:30.389122+0000","last_became_active":"2023-10-06T11:13:30.386585+0000","last_became_peered":"2023-10-06T11:13:30.386585+0000","last_unstale":"2023-10-06T11:13:30.389122+0000","last_undegraded":"2023-10-06T11:13:30.389122+0000","last_fullsized":"2023-10-06T11:13:30.389122+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:18.313520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.393000+0000","last_change":"2023-10-06T11:13:30.393000+0000","last_active":"2023-10-06T11:13:30.393000+0000","last_peered":"2023-10-06T11:13:30.393000+0000","last_clean":"2023-10-06T11:13:30.393000+0000","last_became_active":"2023-10-06T11:13:30.392757+0000","last_became_peered":"2023-10-06T11:13:30.392757+0000","last_unstale":"2023-10-06T11:13:30.393000+0000","last_undegraded":"2023-10-06T11:13:30.393000+0000","last_fullsized":"2023-10-06T11:13:30.393000+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:44:42.843573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.388611+0000","last_change":"2023-10-06T11:13:30.386863+0000","last_active":"2023-10-06T11:13:30.388611+0000","last_peered":"2023-10-06T11:13:30.388611+0000","last_clean":"2023-10-06T11:13:30.388611+0000","last_became_active":"2023-10-06T11:13:30.386638+0000","last_became_peered":"2023-10-06T11:13:30.386638+0000","last_unstale":"2023-10-06T11:13:30.388611+0000","last_undegraded":"2023-10-06T11:13:30.388611+0000","last_fullsized":"2023-10-06T11:13:30.388611+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:38:53.530447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.392442+0000","last_change":"2023-10-06T11:13:30.387984+0000","last_active":"2023-10-06T11:13:30.392442+0000","last_peered":"2023-10-06T11:13:30.392442+0000","last_clean":"2023-10-06T11:13:30.392442+0000","last_became_active":"2023-10-06T11:13:30.387644+0000","last_became_peered":"2023-10-06T11:13:30.387644+0000","last_unstale":"2023-10-06T11:13:30.392442+0000","last_undegraded":"2023-10-06T11:13:30.392442+0000","last_fullsized":"2023-10-06T11:13:30.392442+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:41:11.032151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.393195+0000","last_change":"2023-10-06T11:13:30.391699+0000","last_active":"2023-10-06T11:13:30.393195+0000","last_peered":"2023-10-06T11:13:30.393195+0000","last_clean":"2023-10-06T11:13:30.393195+0000","last_became_active":"2023-10-06T11:13:30.391427+0000","last_became_peered":"2023-10-06T11:13:30.391427+0000","last_unstale":"2023-10-06T11:13:30.393195+0000","last_undegraded":"2023-10-06T11:13:30.393195+0000","last_fullsized":"2023-10-06T11:13:30.393195+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:50.761241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.389054+0000","last_change":"2023-10-06T11:13:30.389054+0000","last_active":"2023-10-06T11:13:30.389054+0000","last_peered":"2023-10-06T11:13:30.389054+0000","last_clean":"2023-10-06T11:13:30.389054+0000","last_became_active":"2023-10-06T11:13:30.388735+0000","last_became_peered":"2023-10-06T11:13:30.388735+0000","last_unstale":"2023-10-06T11:13:30.389054+0000","last_undegraded":"2023-10-06T11:13:30.389054+0000","last_fullsized":"2023-10-06T11:13:30.389054+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:27:12.928906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.396639+0000","last_change":"2023-10-06T11:13:30.396639+0000","last_active":"2023-10-06T11:13:30.396639+0000","last_peered":"2023-10-06T11:13:30.396639+0000","last_clean":"2023-10-06T11:13:30.396639+0000","last_became_active":"2023-10-06T11:13:30.396389+0000","last_became_peered":"2023-10-06T11:13:30.396389+0000","last_unstale":"2023-10-06T11:13:30.396639+0000","last_undegraded":"2023-10-06T11:13:30.396639+0000","last_fullsized":"2023-10-06T11:13:30.396639+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:37.202804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.385321+0000","last_change":"2023-10-06T11:13:30.385321+0000","last_active":"2023-10-06T11:13:30.385321+0000","last_peered":"2023-10-06T11:13:30.385321+0000","last_clean":"2023-10-06T11:13:30.385321+0000","last_became_active":"2023-10-06T11:13:30.384692+0000","last_became_peered":"2023-10-06T11:13:30.384692+0000","last_unstale":"2023-10-06T11:13:30.385321+0000","last_undegraded":"2023-10-06T11:13:30.385321+0000","last_fullsized":"2023-10-06T11:13:30.385321+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:38.223295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.393102+0000","last_change":"2023-10-06T11:13:30.388061+0000","last_active":"2023-10-06T11:13:30.393102+0000","last_peered":"2023-10-06T11:13:30.393102+0000","last_clean":"2023-10-06T11:13:30.393102+0000","last_became_active":"2023-10-06T11:13:30.387764+0000","last_became_peered":"2023-10-06T11:13:30.387764+0000","last_unstale":"2023-10-06T11:13:30.393102+0000","last_undegraded":"2023-10-06T11:13:30.393102+0000","last_fullsized":"2023-10-06T11:13:30.393102+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:28:28.429635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.393921+0000","last_change":"2023-10-06T11:13:30.393921+0000","last_active":"2023-10-06T11:13:30.393921+0000","last_peered":"2023-10-06T11:13:30.393921+0000","last_clean":"2023-10-06T11:13:30.393921+0000","last_became_active":"2023-10-06T11:13:30.393605+0000","last_became_peered":"2023-10-06T11:13:30.393605+0000","last_unstale":"2023-10-06T11:13:30.393921+0000","last_undegraded":"2023-10-06T11:13:30.393921+0000","last_fullsized":"2023-10-06T11:13:30.393921+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:52.524213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.380606+0000","last_change":"2023-10-06T11:13:30.380606+0000","last_active":"2023-10-06T11:13:30.380606+0000","last_peered":"2023-10-06T11:13:30.380606+0000","last_clean":"2023-10-06T11:13:30.380606+0000","last_became_active":"2023-10-06T11:13:30.380310+0000","last_became_peered":"2023-10-06T11:13:30.380310+0000","last_unstale":"2023-10-06T11:13:30.380606+0000","last_undegraded":"2023-10-06T11:13:30.380606+0000","last_fullsized":"2023-10-06T11:13:30.380606+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:12:50.942007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.391965+0000","last_change":"2023-10-06T11:13:30.391965+0000","last_active":"2023-10-06T11:13:30.391965+0000","last_peered":"2023-10-06T11:13:30.391965+0000","last_clean":"2023-10-06T11:13:30.391965+0000","last_became_active":"2023-10-06T11:13:30.390874+0000","last_became_peered":"2023-10-06T11:13:30.390874+0000","last_unstale":"2023-10-06T11:13:30.391965+0000","last_undegraded":"2023-10-06T11:13:30.391965+0000","last_fullsized":"2023-10-06T11:13:30.391965+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:06:29.231196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"100'4","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.975610+0000","last_change":"2023-10-06T11:13:29.981547+0000","last_active":"2023-10-06T11:13:30.975610+0000","last_peered":"2023-10-06T11:13:30.975610+0000","last_clean":"2023-10-06T11:13:30.975610+0000","last_became_active":"2023-10-06T11:13:29.981348+0000","last_became_peered":"2023-10-06T11:13:29.981348+0000","last_unstale":"2023-10-06T11:13:30.975610+0000","last_undegraded":"2023-10-06T11:13:30.975610+0000","last_fullsized":"2023-10-06T11:13:30.975610+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:07.786862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.387242+0000","last_change":"2023-10-06T11:13:30.387242+0000","last_active":"2023-10-06T11:13:30.387242+0000","last_peered":"2023-10-06T11:13:30.387242+0000","last_clean":"2023-10-06T11:13:30.387242+0000","last_became_active":"2023-10-06T11:13:30.387004+0000","last_became_peered":"2023-10-06T11:13:30.387004+0000","last_unstale":"2023-10-06T11:13:30.387242+0000","last_undegraded":"2023-10-06T11:13:30.387242+0000","last_fullsized":"2023-10-06T11:13:30.387242+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:46:56.498044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"100'1","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.375243+0000","last_change":"2023-10-06T11:13:29.977079+0000","last_active":"2023-10-06T11:13:30.375243+0000","last_peered":"2023-10-06T11:13:30.375243+0000","last_clean":"2023-10-06T11:13:30.375243+0000","last_became_active":"2023-10-06T11:13:29.976831+0000","last_became_peered":"2023-10-06T11:13:29.976831+0000","last_unstale":"2023-10-06T11:13:30.375243+0000","last_undegraded":"2023-10-06T11:13:30.375243+0000","last_fullsized":"2023-10-06T11:13:30.375243+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:37.266561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.393122+0000","last_change":"2023-10-06T11:13:30.389576+0000","last_active":"2023-10-06T11:13:30.393122+0000","last_peered":"2023-10-06T11:13:30.393122+0000","last_clean":"2023-10-06T11:13:30.393122+0000","last_became_active":"2023-10-06T11:13:30.389249+0000","last_became_peered":"2023-10-06T11:13:30.389249+0000","last_unstale":"2023-10-06T11:13:30.393122+0000","last_undegraded":"2023-10-06T11:13:30.393122+0000","last_fullsized":"2023-10-06T11:13:30.393122+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:29.316716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"100'2","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.974996+0000","last_change":"2023-10-06T11:13:29.971520+0000","last_active":"2023-10-06T11:13:30.974996+0000","last_peered":"2023-10-06T11:13:30.974996+0000","last_clean":"2023-10-06T11:13:30.974996+0000","last_became_active":"2023-10-06T11:13:29.971202+0000","last_became_peered":"2023-10-06T11:13:29.971202+0000","last_unstale":"2023-10-06T11:13:30.974996+0000","last_undegraded":"2023-10-06T11:13:30.974996+0000","last_fullsized":"2023-10-06T11:13:30.974996+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:20:04.640293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.386724+0000","last_change":"2023-10-06T11:13:30.386724+0000","last_active":"2023-10-06T11:13:30.386724+0000","last_peered":"2023-10-06T11:13:30.386724+0000","last_clean":"2023-10-06T11:13:30.386724+0000","last_became_active":"2023-10-06T11:13:30.386150+0000","last_became_peered":"2023-10-06T11:13:30.386150+0000","last_unstale":"2023-10-06T11:13:30.386724+0000","last_undegraded":"2023-10-06T11:13:30.386724+0000","last_fullsized":"2023-10-06T11:13:30.386724+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:38:53.530447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"100'2","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.969909+0000","last_change":"2023-10-06T11:13:29.979678+0000","last_active":"2023-10-06T11:13:30.969909+0000","last_peered":"2023-10-06T11:13:30.969909+0000","last_clean":"2023-10-06T11:13:30.969909+0000","last_became_active":"2023-10-06T11:13:29.979430+0000","last_became_peered":"2023-10-06T11:13:29.979430+0000","last_unstale":"2023-10-06T11:13:30.969909+0000","last_undegraded":"2023-10-06T11:13:30.969909+0000","last_fullsized":"2023-10-06T11:13:30.969909+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:04.233981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.388898+0000","last_change":"2023-10-06T11:13:30.388898+0000","last_active":"2023-10-06T11:13:30.388898+0000","last_peered":"2023-10-06T11:13:30.388898+0000","last_clean":"2023-10-06T11:13:30.388898+0000","last_became_active":"2023-10-06T11:13:30.388635+0000","last_became_peered":"2023-10-06T11:13:30.388635+0000","last_unstale":"2023-10-06T11:13:30.388898+0000","last_undegraded":"2023-10-06T11:13:30.388898+0000","last_fullsized":"2023-10-06T11:13:30.388898+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:39:21.876088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"100'1","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.389056+0000","last_change":"2023-10-06T11:13:29.980674+0000","last_active":"2023-10-06T11:13:30.389056+0000","last_peered":"2023-10-06T11:13:30.389056+0000","last_clean":"2023-10-06T11:13:30.389056+0000","last_became_active":"2023-10-06T11:13:29.980391+0000","last_became_peered":"2023-10-06T11:13:29.980391+0000","last_unstale":"2023-10-06T11:13:30.389056+0000","last_undegraded":"2023-10-06T11:13:30.389056+0000","last_fullsized":"2023-10-06T11:13:30.389056+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:27:11.924253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.394863+0000","last_change":"2023-10-06T11:13:30.394863+0000","last_active":"2023-10-06T11:13:30.394863+0000","last_peered":"2023-10-06T11:13:30.394863+0000","last_clean":"2023-10-06T11:13:30.394863+0000","last_became_active":"2023-10-06T11:13:30.394653+0000","last_became_peered":"2023-10-06T11:13:30.394653+0000","last_unstale":"2023-10-06T11:13:30.394863+0000","last_undegraded":"2023-10-06T11:13:30.394863+0000","last_fullsized":"2023-10-06T11:13:30.394863+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:50:44.226066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"100'1","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.377944+0000","last_change":"2023-10-06T11:13:29.971477+0000","last_active":"2023-10-06T11:13:30.377944+0000","last_peered":"2023-10-06T11:13:30.377944+0000","last_clean":"2023-10-06T11:13:30.377944+0000","last_became_active":"2023-10-06T11:13:29.971206+0000","last_became_peered":"2023-10-06T11:13:29.971206+0000","last_unstale":"2023-10-06T11:13:30.377944+0000","last_undegraded":"2023-10-06T11:13:30.377944+0000","last_fullsized":"2023-10-06T11:13:30.377944+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:29:58.778143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.395751+0000","last_change":"2023-10-06T11:13:30.395751+0000","last_active":"2023-10-06T11:13:30.395751+0000","last_peered":"2023-10-06T11:13:30.395751+0000","last_clean":"2023-10-06T11:13:30.395751+0000","last_became_active":"2023-10-06T11:13:30.395524+0000","last_became_peered":"2023-10-06T11:13:30.395524+0000","last_unstale":"2023-10-06T11:13:30.395751+0000","last_undegraded":"2023-10-06T11:13:30.395751+0000","last_fullsized":"2023-10-06T11:13:30.395751+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:07:40.842113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.379762+0000","last_change":"2023-10-06T11:13:29.972713+0000","last_active":"2023-10-06T11:13:30.379762+0000","last_peered":"2023-10-06T11:13:30.379762+0000","last_clean":"2023-10-06T11:13:30.379762+0000","last_became_active":"2023-10-06T11:13:29.972454+0000","last_became_peered":"2023-10-06T11:13:29.972454+0000","last_unstale":"2023-10-06T11:13:30.379762+0000","last_undegraded":"2023-10-06T11:13:30.379762+0000","last_fullsized":"2023-10-06T11:13:30.379762+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:21:22.568319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.389141+0000","last_change":"2023-10-06T11:13:30.389141+0000","last_active":"2023-10-06T11:13:30.389141+0000","last_peered":"2023-10-06T11:13:30.389141+0000","last_clean":"2023-10-06T11:13:30.389141+0000","last_became_active":"2023-10-06T11:13:30.388890+0000","last_became_peered":"2023-10-06T11:13:30.388890+0000","last_unstale":"2023-10-06T11:13:30.389141+0000","last_undegraded":"2023-10-06T11:13:30.389141+0000","last_fullsized":"2023-10-06T11:13:30.389141+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:07:50.934263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T11:13:29.973980+0000","last_change":"2023-10-06T11:13:29.971882+0000","last_active":"2023-10-06T11:13:29.973980+0000","last_peered":"2023-10-06T11:13:29.973980+0000","last_clean":"2023-10-06T11:13:29.973980+0000","last_became_active":"2023-10-06T11:13:29.971628+0000","last_became_peered":"2023-10-06T11:13:29.971628+0000","last_unstale":"2023-10-06T11:13:29.973980+0000","last_undegraded":"2023-10-06T11:13:29.973980+0000","last_fullsized":"2023-10-06T11:13:29.973980+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:38:52.525794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.394481+0000","last_change":"2023-10-06T11:13:30.394481+0000","last_active":"2023-10-06T11:13:30.394481+0000","last_peered":"2023-10-06T11:13:30.394481+0000","last_clean":"2023-10-06T11:13:30.394481+0000","last_became_active":"2023-10-06T11:13:30.394225+0000","last_became_peered":"2023-10-06T11:13:30.394225+0000","last_unstale":"2023-10-06T11:13:30.394481+0000","last_undegraded":"2023-10-06T11:13:30.394481+0000","last_fullsized":"2023-10-06T11:13:30.394481+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:24.786989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.380417+0000","last_change":"2023-10-06T11:13:29.970304+0000","last_active":"2023-10-06T11:13:30.380417+0000","last_peered":"2023-10-06T11:13:30.380417+0000","last_clean":"2023-10-06T11:13:30.380417+0000","last_became_active":"2023-10-06T11:13:29.970040+0000","last_became_peered":"2023-10-06T11:13:29.970040+0000","last_unstale":"2023-10-06T11:13:30.380417+0000","last_undegraded":"2023-10-06T11:13:30.380417+0000","last_fullsized":"2023-10-06T11:13:30.380417+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:31:17.041129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.392732+0000","last_change":"2023-10-06T11:13:30.390112+0000","last_active":"2023-10-06T11:13:30.392732+0000","last_peered":"2023-10-06T11:13:30.392732+0000","last_clean":"2023-10-06T11:13:30.392732+0000","last_became_active":"2023-10-06T11:13:30.389788+0000","last_became_peered":"2023-10-06T11:13:30.389788+0000","last_unstale":"2023-10-06T11:13:30.392732+0000","last_undegraded":"2023-10-06T11:13:30.392732+0000","last_fullsized":"2023-10-06T11:13:30.392732+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:39:24.374688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T11:13:29.975270+0000","last_change":"2023-10-06T11:13:29.974426+0000","last_active":"2023-10-06T11:13:29.975270+0000","last_peered":"2023-10-06T11:13:29.975270+0000","last_clean":"2023-10-06T11:13:29.975270+0000","last_became_active":"2023-10-06T11:13:29.974187+0000","last_became_peered":"2023-10-06T11:13:29.974187+0000","last_unstale":"2023-10-06T11:13:29.975270+0000","last_undegraded":"2023-10-06T11:13:29.975270+0000","last_fullsized":"2023-10-06T11:13:29.975270+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:08:27.498099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.386019+0000","last_change":"2023-10-06T11:13:30.386019+0000","last_active":"2023-10-06T11:13:30.386019+0000","last_peered":"2023-10-06T11:13:30.386019+0000","last_clean":"2023-10-06T11:13:30.386019+0000","last_became_active":"2023-10-06T11:13:30.385761+0000","last_became_peered":"2023-10-06T11:13:30.385761+0000","last_unstale":"2023-10-06T11:13:30.386019+0000","last_undegraded":"2023-10-06T11:13:30.386019+0000","last_fullsized":"2023-10-06T11:13:30.386019+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:35:05.173549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"100'3","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.971252+0000","last_change":"2023-10-06T11:13:29.975914+0000","last_active":"2023-10-06T11:13:30.971252+0000","last_peered":"2023-10-06T11:13:30.971252+0000","last_clean":"2023-10-06T11:13:30.971252+0000","last_became_active":"2023-10-06T11:13:29.975634+0000","last_became_peered":"2023-10-06T11:13:29.975634+0000","last_unstale":"2023-10-06T11:13:30.971252+0000","last_undegraded":"2023-10-06T11:13:30.971252+0000","last_fullsized":"2023-10-06T11:13:30.971252+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:31:17.041129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.392445+0000","last_change":"2023-10-06T11:13:30.389971+0000","last_active":"2023-10-06T11:13:30.392445+0000","last_peered":"2023-10-06T11:13:30.392445+0000","last_clean":"2023-10-06T11:13:30.392445+0000","last_became_active":"2023-10-06T11:13:30.389711+0000","last_became_peered":"2023-10-06T11:13:30.389711+0000","last_unstale":"2023-10-06T11:13:30.392445+0000","last_undegraded":"2023-10-06T11:13:30.392445+0000","last_fullsized":"2023-10-06T11:13:30.392445+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:08.791515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"100'6","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.973899+0000","last_change":"2023-10-06T11:13:29.975995+0000","last_active":"2023-10-06T11:13:30.973899+0000","last_peered":"2023-10-06T11:13:30.973899+0000","last_clean":"2023-10-06T11:13:30.973899+0000","last_became_active":"2023-10-06T11:13:29.975749+0000","last_became_peered":"2023-10-06T11:13:29.975749+0000","last_unstale":"2023-10-06T11:13:30.973899+0000","last_undegraded":"2023-10-06T11:13:30.973899+0000","last_fullsized":"2023-10-06T11:13:30.973899+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:38:56.281344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.387677+0000","last_change":"2023-10-06T11:13:30.387677+0000","last_active":"2023-10-06T11:13:30.387677+0000","last_peered":"2023-10-06T11:13:30.387677+0000","last_clean":"2023-10-06T11:13:30.387677+0000","last_became_active":"2023-10-06T11:13:30.387391+0000","last_became_peered":"2023-10-06T11:13:30.387391+0000","last_unstale":"2023-10-06T11:13:30.387677+0000","last_undegraded":"2023-10-06T11:13:30.387677+0000","last_fullsized":"2023-10-06T11:13:30.387677+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:20:05.644946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"100'2","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.970922+0000","last_change":"2023-10-06T11:13:29.978962+0000","last_active":"2023-10-06T11:13:30.970922+0000","last_peered":"2023-10-06T11:13:30.970922+0000","last_clean":"2023-10-06T11:13:30.970922+0000","last_became_active":"2023-10-06T11:13:29.978670+0000","last_became_peered":"2023-10-06T11:13:29.978670+0000","last_unstale":"2023-10-06T11:13:30.970922+0000","last_undegraded":"2023-10-06T11:13:30.970922+0000","last_fullsized":"2023-10-06T11:13:30.970922+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:33.781187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.390696+0000","last_change":"2023-10-06T11:13:30.390696+0000","last_active":"2023-10-06T11:13:30.390696+0000","last_peered":"2023-10-06T11:13:30.390696+0000","last_clean":"2023-10-06T11:13:30.390696+0000","last_became_active":"2023-10-06T11:13:30.390442+0000","last_became_peered":"2023-10-06T11:13:30.390442+0000","last_unstale":"2023-10-06T11:13:30.390696+0000","last_undegraded":"2023-10-06T11:13:30.390696+0000","last_fullsized":"2023-10-06T11:13:30.390696+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:27:12.928906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T11:13:29.975616+0000","last_change":"2023-10-06T11:13:29.974657+0000","last_active":"2023-10-06T11:13:29.975616+0000","last_peered":"2023-10-06T11:13:29.975616+0000","last_clean":"2023-10-06T11:13:29.975616+0000","last_became_active":"2023-10-06T11:13:29.974411+0000","last_became_peered":"2023-10-06T11:13:29.974411+0000","last_unstale":"2023-10-06T11:13:29.975616+0000","last_undegraded":"2023-10-06T11:13:29.975616+0000","last_fullsized":"2023-10-06T11:13:29.975616+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:39:23.370035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.384575+0000","last_change":"2023-10-06T11:13:30.384575+0000","last_active":"2023-10-06T11:13:30.384575+0000","last_peered":"2023-10-06T11:13:30.384575+0000","last_clean":"2023-10-06T11:13:30.384575+0000","last_became_active":"2023-10-06T11:13:30.384318+0000","last_became_peered":"2023-10-06T11:13:30.384318+0000","last_unstale":"2023-10-06T11:13:30.384575+0000","last_undegraded":"2023-10-06T11:13:30.384575+0000","last_fullsized":"2023-10-06T11:13:30.384575+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:32:55.745948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T11:13:29.981476+0000","last_change":"2023-10-06T11:13:29.979005+0000","last_active":"2023-10-06T11:13:29.981476+0000","last_peered":"2023-10-06T11:13:29.981476+0000","last_clean":"2023-10-06T11:13:29.981476+0000","last_became_active":"2023-10-06T11:13:29.978503+0000","last_became_peered":"2023-10-06T11:13:29.978503+0000","last_unstale":"2023-10-06T11:13:29.981476+0000","last_undegraded":"2023-10-06T11:13:29.981476+0000","last_fullsized":"2023-10-06T11:13:29.981476+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:02:33.885002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.395688+0000","last_change":"2023-10-06T11:13:30.395688+0000","last_active":"2023-10-06T11:13:30.395688+0000","last_peered":"2023-10-06T11:13:30.395688+0000","last_clean":"2023-10-06T11:13:30.395688+0000","last_became_active":"2023-10-06T11:13:30.395220+0000","last_became_peered":"2023-10-06T11:13:30.395220+0000","last_unstale":"2023-10-06T11:13:30.395688+0000","last_undegraded":"2023-10-06T11:13:30.395688+0000","last_fullsized":"2023-10-06T11:13:30.395688+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:18.575761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"100'8","reported_seq":18,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.976268+0000","last_change":"2023-10-06T11:13:29.969015+0000","last_active":"2023-10-06T11:13:30.976268+0000","last_peered":"2023-10-06T11:13:30.976268+0000","last_clean":"2023-10-06T11:13:30.976268+0000","last_became_active":"2023-10-06T11:13:29.968750+0000","last_became_peered":"2023-10-06T11:13:29.968750+0000","last_unstale":"2023-10-06T11:13:30.976268+0000","last_undegraded":"2023-10-06T11:13:30.976268+0000","last_fullsized":"2023-10-06T11:13:30.976268+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:42:15.474932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.391193+0000","last_change":"2023-10-06T11:13:30.391193+0000","last_active":"2023-10-06T11:13:30.391193+0000","last_peered":"2023-10-06T11:13:30.391193+0000","last_clean":"2023-10-06T11:13:30.391193+0000","last_became_active":"2023-10-06T11:13:30.390807+0000","last_became_peered":"2023-10-06T11:13:30.390807+0000","last_unstale":"2023-10-06T11:13:30.391193+0000","last_undegraded":"2023-10-06T11:13:30.391193+0000","last_fullsized":"2023-10-06T11:13:30.391193+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:35:22.038954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"100'2","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.970721+0000","last_change":"2023-10-06T11:13:29.982189+0000","last_active":"2023-10-06T11:13:30.970721+0000","last_peered":"2023-10-06T11:13:30.970721+0000","last_clean":"2023-10-06T11:13:30.970721+0000","last_became_active":"2023-10-06T11:13:29.981937+0000","last_became_peered":"2023-10-06T11:13:29.981937+0000","last_unstale":"2023-10-06T11:13:30.970721+0000","last_undegraded":"2023-10-06T11:13:30.970721+0000","last_fullsized":"2023-10-06T11:13:30.970721+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:45:31.082868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.392473+0000","last_change":"2023-10-06T11:13:30.386290+0000","last_active":"2023-10-06T11:13:30.392473+0000","last_peered":"2023-10-06T11:13:30.392473+0000","last_clean":"2023-10-06T11:13:30.392473+0000","last_became_active":"2023-10-06T11:13:30.386028+0000","last_became_peered":"2023-10-06T11:13:30.386028+0000","last_unstale":"2023-10-06T11:13:30.392473+0000","last_undegraded":"2023-10-06T11:13:30.392473+0000","last_fullsized":"2023-10-06T11:13:30.392473+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:36:24.487477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T11:13:29.977820+0000","last_change":"2023-10-06T11:13:29.977065+0000","last_active":"2023-10-06T11:13:29.977820+0000","last_peered":"2023-10-06T11:13:29.977820+0000","last_clean":"2023-10-06T11:13:29.977820+0000","last_became_active":"2023-10-06T11:13:29.976808+0000","last_became_peered":"2023-10-06T11:13:29.976808+0000","last_unstale":"2023-10-06T11:13:29.977820+0000","last_undegraded":"2023-10-06T11:13:29.977820+0000","last_fullsized":"2023-10-06T11:13:29.977820+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:12:56.805175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.394614+0000","last_change":"2023-10-06T11:13:30.394614+0000","last_active":"2023-10-06T11:13:30.394614+0000","last_peered":"2023-10-06T11:13:30.394614+0000","last_clean":"2023-10-06T11:13:30.394614+0000","last_became_active":"2023-10-06T11:13:30.394300+0000","last_became_peered":"2023-10-06T11:13:30.394300+0000","last_unstale":"2023-10-06T11:13:30.394614+0000","last_undegraded":"2023-10-06T11:13:30.394614+0000","last_fullsized":"2023-10-06T11:13:30.394614+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:28:28.429635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T11:13:29.980347+0000","last_change":"2023-10-06T11:13:29.979602+0000","last_active":"2023-10-06T11:13:29.980347+0000","last_peered":"2023-10-06T11:13:29.980347+0000","last_clean":"2023-10-06T11:13:29.980347+0000","last_became_active":"2023-10-06T11:13:29.979358+0000","last_became_peered":"2023-10-06T11:13:29.979358+0000","last_unstale":"2023-10-06T11:13:29.980347+0000","last_undegraded":"2023-10-06T11:13:29.980347+0000","last_fullsized":"2023-10-06T11:13:29.980347+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:34:49.944576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.392223+0000","last_change":"2023-10-06T11:13:30.392223+0000","last_active":"2023-10-06T11:13:30.392223+0000","last_peered":"2023-10-06T11:13:30.392223+0000","last_clean":"2023-10-06T11:13:30.392223+0000","last_became_active":"2023-10-06T11:13:30.391968+0000","last_became_peered":"2023-10-06T11:13:30.391968+0000","last_unstale":"2023-10-06T11:13:30.392223+0000","last_undegraded":"2023-10-06T11:13:30.392223+0000","last_fullsized":"2023-10-06T11:13:30.392223+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:39:24.374688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.384543+0000","last_change":"2023-10-06T11:13:29.981012+0000","last_active":"2023-10-06T11:13:30.384543+0000","last_peered":"2023-10-06T11:13:30.384543+0000","last_clean":"2023-10-06T11:13:30.384543+0000","last_became_active":"2023-10-06T11:13:29.980208+0000","last_became_peered":"2023-10-06T11:13:29.980208+0000","last_unstale":"2023-10-06T11:13:30.384543+0000","last_undegraded":"2023-10-06T11:13:30.384543+0000","last_fullsized":"2023-10-06T11:13:30.384543+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:14:45.004498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.386757+0000","last_change":"2023-10-06T11:13:30.386757+0000","last_active":"2023-10-06T11:13:30.386757+0000","last_peered":"2023-10-06T11:13:30.386757+0000","last_clean":"2023-10-06T11:13:30.386757+0000","last_became_active":"2023-10-06T11:13:30.386524+0000","last_became_peered":"2023-10-06T11:13:30.386524+0000","last_unstale":"2023-10-06T11:13:30.386757+0000","last_undegraded":"2023-10-06T11:13:30.386757+0000","last_fullsized":"2023-10-06T11:13:30.386757+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:00.939269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.379633+0000","last_change":"2023-10-06T11:13:29.981452+0000","last_active":"2023-10-06T11:13:30.379633+0000","last_peered":"2023-10-06T11:13:30.379633+0000","last_clean":"2023-10-06T11:13:30.379633+0000","last_became_active":"2023-10-06T11:13:29.981190+0000","last_became_peered":"2023-10-06T11:13:29.981190+0000","last_unstale":"2023-10-06T11:13:30.379633+0000","last_undegraded":"2023-10-06T11:13:30.379633+0000","last_fullsized":"2023-10-06T11:13:30.379633+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:31:17.318289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.384180+0000","last_change":"2023-10-06T11:13:30.384180+0000","last_active":"2023-10-06T11:13:30.384180+0000","last_peered":"2023-10-06T11:13:30.384180+0000","last_clean":"2023-10-06T11:13:30.384180+0000","last_became_active":"2023-10-06T11:13:30.383868+0000","last_became_peered":"2023-10-06T11:13:30.383868+0000","last_unstale":"2023-10-06T11:13:30.384180+0000","last_undegraded":"2023-10-06T11:13:30.384180+0000","last_fullsized":"2023-10-06T11:13:30.384180+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:38:57.906044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T11:13:29.981544+0000","last_change":"2023-10-06T11:13:29.979165+0000","last_active":"2023-10-06T11:13:29.981544+0000","last_peered":"2023-10-06T11:13:29.981544+0000","last_clean":"2023-10-06T11:13:29.981544+0000","last_became_active":"2023-10-06T11:13:29.978670+0000","last_became_peered":"2023-10-06T11:13:29.978670+0000","last_unstale":"2023-10-06T11:13:29.981544+0000","last_undegraded":"2023-10-06T11:13:29.981544+0000","last_fullsized":"2023-10-06T11:13:29.981544+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:40:13.133499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.395557+0000","last_change":"2023-10-06T11:13:30.395557+0000","last_active":"2023-10-06T11:13:30.395557+0000","last_peered":"2023-10-06T11:13:30.395557+0000","last_clean":"2023-10-06T11:13:30.395557+0000","last_became_active":"2023-10-06T11:13:30.394505+0000","last_became_peered":"2023-10-06T11:13:30.394505+0000","last_unstale":"2023-10-06T11:13:30.395557+0000","last_undegraded":"2023-10-06T11:13:30.395557+0000","last_fullsized":"2023-10-06T11:13:30.395557+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:57:05.858686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T11:13:29.980152+0000","last_change":"2023-10-06T11:13:29.978773+0000","last_active":"2023-10-06T11:13:29.980152+0000","last_peered":"2023-10-06T11:13:29.980152+0000","last_clean":"2023-10-06T11:13:29.980152+0000","last_became_active":"2023-10-06T11:13:29.978548+0000","last_became_peered":"2023-10-06T11:13:29.978548+0000","last_unstale":"2023-10-06T11:13:29.980152+0000","last_undegraded":"2023-10-06T11:13:29.980152+0000","last_fullsized":"2023-10-06T11:13:29.980152+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:43.648882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.387478+0000","last_change":"2023-10-06T11:13:30.387478+0000","last_active":"2023-10-06T11:13:30.387478+0000","last_peered":"2023-10-06T11:13:30.387478+0000","last_clean":"2023-10-06T11:13:30.387478+0000","last_became_active":"2023-10-06T11:13:30.387057+0000","last_became_peered":"2023-10-06T11:13:30.387057+0000","last_unstale":"2023-10-06T11:13:30.387478+0000","last_undegraded":"2023-10-06T11:13:30.387478+0000","last_fullsized":"2023-10-06T11:13:30.387478+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:08.791515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T11:13:29.981677+0000","last_change":"2023-10-06T11:13:29.978432+0000","last_active":"2023-10-06T11:13:29.981677+0000","last_peered":"2023-10-06T11:13:29.981677+0000","last_clean":"2023-10-06T11:13:29.981677+0000","last_became_active":"2023-10-06T11:13:29.978151+0000","last_became_peered":"2023-10-06T11:13:29.978151+0000","last_unstale":"2023-10-06T11:13:29.981677+0000","last_undegraded":"2023-10-06T11:13:29.981677+0000","last_fullsized":"2023-10-06T11:13:29.981677+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:29:14.670385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.390735+0000","last_change":"2023-10-06T11:13:30.390735+0000","last_active":"2023-10-06T11:13:30.390735+0000","last_peered":"2023-10-06T11:13:30.390735+0000","last_clean":"2023-10-06T11:13:30.390735+0000","last_became_active":"2023-10-06T11:13:30.390441+0000","last_became_peered":"2023-10-06T11:13:30.390441+0000","last_unstale":"2023-10-06T11:13:30.390735+0000","last_undegraded":"2023-10-06T11:13:30.390735+0000","last_fullsized":"2023-10-06T11:13:30.390735+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:36:54.963150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"100'2","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.970979+0000","last_change":"2023-10-06T11:13:29.975739+0000","last_active":"2023-10-06T11:13:30.970979+0000","last_peered":"2023-10-06T11:13:30.970979+0000","last_clean":"2023-10-06T11:13:30.970979+0000","last_became_active":"2023-10-06T11:13:29.975424+0000","last_became_peered":"2023-10-06T11:13:29.975424+0000","last_unstale":"2023-10-06T11:13:30.970979+0000","last_undegraded":"2023-10-06T11:13:30.970979+0000","last_fullsized":"2023-10-06T11:13:30.970979+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:49:43.940438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":88,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.379921+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:13:30.379921+0000","last_peered":"2023-10-06T11:13:30.379921+0000","last_clean":"2023-10-06T11:13:30.379921+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:13:30.379921+0000","last_undegraded":"2023-10-06T11:13:30.379921+0000","last_fullsized":"2023-10-06T11:13:30.379921+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.390891+0000","last_change":"2023-10-06T11:13:30.390891+0000","last_active":"2023-10-06T11:13:30.390891+0000","last_peered":"2023-10-06T11:13:30.390891+0000","last_clean":"2023-10-06T11:13:30.390891+0000","last_became_active":"2023-10-06T11:13:30.390646+0000","last_became_peered":"2023-10-06T11:13:30.390646+0000","last_unstale":"2023-10-06T11:13:30.390891+0000","last_undegraded":"2023-10-06T11:13:30.390891+0000","last_fullsized":"2023-10-06T11:13:30.390891+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:09:13.887600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T11:13:29.981695+0000","last_change":"2023-10-06T11:13:29.980961+0000","last_active":"2023-10-06T11:13:29.981695+0000","last_peered":"2023-10-06T11:13:29.981695+0000","last_clean":"2023-10-06T11:13:29.981695+0000","last_became_active":"2023-10-06T11:13:29.980716+0000","last_became_peered":"2023-10-06T11:13:29.980716+0000","last_unstale":"2023-10-06T11:13:29.981695+0000","last_undegraded":"2023-10-06T11:13:29.981695+0000","last_fullsized":"2023-10-06T11:13:29.981695+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:21:38.532006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":80,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T11:13:29.962434+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:13:29.962434+0000","last_peered":"2023-10-06T11:13:29.962434+0000","last_clean":"2023-10-06T11:13:29.962434+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:13:29.962434+0000","last_undegraded":"2023-10-06T11:13:29.962434+0000","last_fullsized":"2023-10-06T11:13:29.962434+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.392295+0000","last_change":"2023-10-06T11:13:30.392295+0000","last_active":"2023-10-06T11:13:30.392295+0000","last_peered":"2023-10-06T11:13:30.392295+0000","last_clean":"2023-10-06T11:13:30.392295+0000","last_became_active":"2023-10-06T11:13:30.391975+0000","last_became_peered":"2023-10-06T11:13:30.391975+0000","last_unstale":"2023-10-06T11:13:30.392295+0000","last_undegraded":"2023-10-06T11:13:30.392295+0000","last_fullsized":"2023-10-06T11:13:30.392295+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:34:53.315325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"100'1","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.388618+0000","last_change":"2023-10-06T11:13:29.976755+0000","last_active":"2023-10-06T11:13:30.388618+0000","last_peered":"2023-10-06T11:13:30.388618+0000","last_clean":"2023-10-06T11:13:30.388618+0000","last_became_active":"2023-10-06T11:13:29.976456+0000","last_became_peered":"2023-10-06T11:13:29.976456+0000","last_unstale":"2023-10-06T11:13:30.388618+0000","last_undegraded":"2023-10-06T11:13:30.388618+0000","last_fullsized":"2023-10-06T11:13:30.388618+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:20:04.640293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":80,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.384797+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:13:30.384797+0000","last_peered":"2023-10-06T11:13:30.384797+0000","last_clean":"2023-10-06T11:13:30.384797+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:13:30.384797+0000","last_undegraded":"2023-10-06T11:13:30.384797+0000","last_fullsized":"2023-10-06T11:13:30.384797+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":224,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T11:13:29.970910+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:13:29.970910+0000","last_peered":"2023-10-06T11:13:29.970910+0000","last_clean":"2023-10-06T11:13:29.970910+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:13:29.970910+0000","last_undegraded":"2023-10-06T11:13:29.970910+0000","last_fullsized":"2023-10-06T11:13:29.970910+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.391724+0000","last_change":"2023-10-06T11:13:30.387268+0000","last_active":"2023-10-06T11:13:30.391724+0000","last_peered":"2023-10-06T11:13:30.391724+0000","last_clean":"2023-10-06T11:13:30.391724+0000","last_became_active":"2023-10-06T11:13:30.387073+0000","last_became_peered":"2023-10-06T11:13:30.387073+0000","last_unstale":"2023-10-06T11:13:30.391724+0000","last_undegraded":"2023-10-06T11:13:30.391724+0000","last_fullsized":"2023-10-06T11:13:30.391724+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:07:40.842113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T11:13:29.980088+0000","last_change":"2023-10-06T11:13:29.978821+0000","last_active":"2023-10-06T11:13:29.980088+0000","last_peered":"2023-10-06T11:13:29.980088+0000","last_clean":"2023-10-06T11:13:29.980088+0000","last_became_active":"2023-10-06T11:13:29.978592+0000","last_became_peered":"2023-10-06T11:13:29.978592+0000","last_unstale":"2023-10-06T11:13:29.980088+0000","last_undegraded":"2023-10-06T11:13:29.980088+0000","last_fullsized":"2023-10-06T11:13:29.980088+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:37:10.667423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":74,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T11:13:29.970853+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:13:29.970853+0000","last_peered":"2023-10-06T11:13:29.970853+0000","last_clean":"2023-10-06T11:13:29.970853+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:13:29.970853+0000","last_undegraded":"2023-10-06T11:13:29.970853+0000","last_fullsized":"2023-10-06T11:13:29.970853+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.388398+0000","last_change":"2023-10-06T11:13:30.388398+0000","last_active":"2023-10-06T11:13:30.388398+0000","last_peered":"2023-10-06T11:13:30.388398+0000","last_clean":"2023-10-06T11:13:30.388398+0000","last_became_active":"2023-10-06T11:13:30.386541+0000","last_became_peered":"2023-10-06T11:13:30.386541+0000","last_unstale":"2023-10-06T11:13:30.388398+0000","last_undegraded":"2023-10-06T11:13:30.388398+0000","last_fullsized":"2023-10-06T11:13:30.388398+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:42:16.479585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"100'2","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.973793+0000","last_change":"2023-10-06T11:13:29.979820+0000","last_active":"2023-10-06T11:13:30.973793+0000","last_peered":"2023-10-06T11:13:30.973793+0000","last_clean":"2023-10-06T11:13:30.973793+0000","last_became_active":"2023-10-06T11:13:29.979591+0000","last_became_peered":"2023-10-06T11:13:29.979591+0000","last_unstale":"2023-10-06T11:13:30.973793+0000","last_undegraded":"2023-10-06T11:13:30.973793+0000","last_fullsized":"2023-10-06T11:13:30.973793+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:37:44.776593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":74,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T11:13:29.971000+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:13:29.971000+0000","last_peered":"2023-10-06T11:13:29.971000+0000","last_clean":"2023-10-06T11:13:29.971000+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:13:29.971000+0000","last_undegraded":"2023-10-06T11:13:29.971000+0000","last_fullsized":"2023-10-06T11:13:29.971000+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.388438+0000","last_change":"2023-10-06T11:13:30.388438+0000","last_active":"2023-10-06T11:13:30.388438+0000","last_peered":"2023-10-06T11:13:30.388438+0000","last_clean":"2023-10-06T11:13:30.388438+0000","last_became_active":"2023-10-06T11:13:30.388235+0000","last_became_peered":"2023-10-06T11:13:30.388235+0000","last_unstale":"2023-10-06T11:13:30.388438+0000","last_undegraded":"2023-10-06T11:13:30.388438+0000","last_fullsized":"2023-10-06T11:13:30.388438+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:56:06.842858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"100'1","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.387287+0000","last_change":"2023-10-06T11:13:29.978748+0000","last_active":"2023-10-06T11:13:30.387287+0000","last_peered":"2023-10-06T11:13:30.387287+0000","last_clean":"2023-10-06T11:13:30.387287+0000","last_became_active":"2023-10-06T11:13:29.978467+0000","last_became_peered":"2023-10-06T11:13:29.978467+0000","last_unstale":"2023-10-06T11:13:30.387287+0000","last_undegraded":"2023-10-06T11:13:30.387287+0000","last_fullsized":"2023-10-06T11:13:30.387287+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:27:02.067978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":90,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T11:13:29.965821+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:13:29.965821+0000","last_peered":"2023-10-06T11:13:29.965821+0000","last_clean":"2023-10-06T11:13:29.965821+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:13:29.965821+0000","last_undegraded":"2023-10-06T11:13:29.965821+0000","last_fullsized":"2023-10-06T11:13:29.965821+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.384151+0000","last_change":"2023-10-06T11:13:30.384151+0000","last_active":"2023-10-06T11:13:30.384151+0000","last_peered":"2023-10-06T11:13:30.384151+0000","last_clean":"2023-10-06T11:13:30.384151+0000","last_became_active":"2023-10-06T11:13:30.383904+0000","last_became_peered":"2023-10-06T11:13:30.383904+0000","last_unstale":"2023-10-06T11:13:30.384151+0000","last_undegraded":"2023-10-06T11:13:30.384151+0000","last_fullsized":"2023-10-06T11:13:30.384151+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:27:17.128505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T11:13:29.983063+0000","last_change":"2023-10-06T11:13:29.982448+0000","last_active":"2023-10-06T11:13:29.983063+0000","last_peered":"2023-10-06T11:13:29.983063+0000","last_clean":"2023-10-06T11:13:29.983063+0000","last_became_active":"2023-10-06T11:13:29.981491+0000","last_became_peered":"2023-10-06T11:13:29.981491+0000","last_unstale":"2023-10-06T11:13:29.983063+0000","last_undegraded":"2023-10-06T11:13:29.983063+0000","last_fullsized":"2023-10-06T11:13:29.983063+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:52:20.161716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":80,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T11:13:29.977904+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:13:29.977904+0000","last_peered":"2023-10-06T11:13:29.977904+0000","last_clean":"2023-10-06T11:13:29.977904+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:13:29.977904+0000","last_undegraded":"2023-10-06T11:13:29.977904+0000","last_fullsized":"2023-10-06T11:13:29.977904+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.394495+0000","last_change":"2023-10-06T11:13:30.394495+0000","last_active":"2023-10-06T11:13:30.394495+0000","last_peered":"2023-10-06T11:13:30.394495+0000","last_clean":"2023-10-06T11:13:30.394495+0000","last_became_active":"2023-10-06T11:13:30.394244+0000","last_became_peered":"2023-10-06T11:13:30.394244+0000","last_unstale":"2023-10-06T11:13:30.394495+0000","last_undegraded":"2023-10-06T11:13:30.394495+0000","last_fullsized":"2023-10-06T11:13:30.394495+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:36:24.487477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T11:13:29.980925+0000","last_change":"2023-10-06T11:13:29.979177+0000","last_active":"2023-10-06T11:13:29.980925+0000","last_peered":"2023-10-06T11:13:29.980925+0000","last_clean":"2023-10-06T11:13:29.980925+0000","last_became_active":"2023-10-06T11:13:29.978951+0000","last_became_peered":"2023-10-06T11:13:29.978951+0000","last_unstale":"2023-10-06T11:13:29.980925+0000","last_undegraded":"2023-10-06T11:13:29.980925+0000","last_fullsized":"2023-10-06T11:13:29.980925+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:31:27.255104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":80,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T11:13:29.977634+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:13:29.977634+0000","last_peered":"2023-10-06T11:13:29.977634+0000","last_clean":"2023-10-06T11:13:29.977634+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:13:29.977634+0000","last_undegraded":"2023-10-06T11:13:29.977634+0000","last_fullsized":"2023-10-06T11:13:29.977634+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574946,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311364,"kb_used_data":1788,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060476,"statfs":{"total":96636764160,"available":96317927424,"internally_reserved":0,"allocated":1830912,"data_stored":1153705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.88100000000000001,"15min":0.60999999999999999},"min":{"1min":0.371,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.77800000000000002,"5min":23.908999999999999,"15min":23.908999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.69799999999999995,"15min":0.58099999999999996},"min":{"1min":0.27700000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.69799999999999995,"5min":9.3230000000000004,"15min":9.3230000000000004},"last":0.53500000000000003}]},{"osd":1,"last update":"Fri Oct 6 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.61599999999999999,"15min":0.55700000000000005},"min":{"1min":0.30299999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.71799999999999997,"5min":9.2360000000000007,"15min":9.2360000000000007},"last":0.624},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52800000000000002,"15min":0.50700000000000001},"min":{"1min":0.36599999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.78900000000000003,"5min":4.327,"15min":4.327},"last":0.45900000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.50600000000000001,"15min":0.503},"min":{"1min":0.33000000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.77200000000000002,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.435},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.58999999999999997,"15min":0.55000000000000004},"min":{"1min":0.31,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.76400000000000001,"5min":4.7309999999999999,"15min":4.7309999999999999},"last":0.58399999999999996}]},{"osd":3,"last update":"Fri Oct 6 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57899999999999996,"15min":0.52000000000000002},"min":{"1min":0.42799999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.75,"5min":4.3540000000000001,"15min":4.3540000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.65900000000000003,"15min":0.58999999999999997},"min":{"1min":0.36599999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.74299999999999999,"5min":9.3879999999999999,"15min":9.3879999999999999},"last":0.49099999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.50700000000000001,"15min":0.47099999999999997},"min":{"1min":0.32400000000000001,"5min":0.25,"15min":0.24399999999999999},"max":{"1min":0.65300000000000002,"5min":4.5709999999999997,"15min":4.5709999999999997},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52600000000000002,"15min":0.52100000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.73399999999999999,"5min":4.3129999999999997,"15min":4.3129999999999997},"last":0.55300000000000005}]},{"osd":5,"last update":"Fri Oct 6 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.60299999999999998,"15min":0.56299999999999994},"min":{"1min":0.33600000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.72099999999999997,"5min":9.3499999999999996,"15min":9.3499999999999996},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54800000000000004,"15min":0.54900000000000004},"min":{"1min":0.378,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.83399999999999996,"5min":4.444,"15min":4.444},"last":0.51900000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.64200000000000002,"15min":0.60299999999999998},"min":{"1min":0.42799999999999999,"5min":0.32400000000000001,"15min":0.29199999999999998},"max":{"1min":0.754,"5min":9.4969999999999999,"15min":9.4969999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.64000000000000001,"15min":0.60799999999999998},"min":{"1min":0.40600000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80800000000000005,"5min":7.2039999999999997,"15min":7.2039999999999997},"last":0.47999999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574948,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306704,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065136,"statfs":{"total":96636764160,"available":96322699264,"internally_reserved":0,"allocated":1253376,"data_stored":564096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:12:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.49299999999999999,"15min":0.49199999999999999},"min":{"1min":0.28399999999999997,"5min":0.187,"15min":0.187},"max":{"1min":0.71999999999999997,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.53100000000000003,"15min":0.53000000000000003},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.78600000000000003,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.56200000000000006}]},{"osd":1,"last update":"Fri Oct 6 11:12:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.48099999999999998,"15min":0.49099999999999999},"min":{"1min":0.26800000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.54300000000000004,"15min":0.51200000000000001},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":5.2670000000000003,"5min":5.2670000000000003,"15min":5.2670000000000003},"last":0.52800000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:12:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.54800000000000004,"15min":0.498},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.753,"5min":7.0659999999999998,"15min":7.0659999999999998},"last":0.443},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55400000000000005,"15min":0.52000000000000002},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.0069999999999999,"5min":7.0819999999999999,"15min":7.0819999999999999},"last":0.51500000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:12:48 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.52100000000000002,"15min":0.499},"min":{"1min":0.317,"5min":0.317,"15min":0.25800000000000001},"max":{"1min":0.69499999999999995,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53600000000000003,"15min":0.53300000000000003},"min":{"1min":0.33700000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.83999999999999997},"last":0.5}]},{"osd":4,"last update":"Fri Oct 6 11:12:48 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.45200000000000001,"15min":0.48799999999999999},"min":{"1min":0.313,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.502,"15min":0.54500000000000004},"min":{"1min":0.34599999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.75800000000000001,"5min":0.81100000000000005,"15min":1.0680000000000001},"last":0.40899999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:12:48 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.497,"15min":0.52200000000000002},"min":{"1min":0.34599999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.747,"5min":0.754,"15min":0.754},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.54000000000000004,"15min":0.56899999999999995},"min":{"1min":0.36199999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.94799999999999995,"5min":1.034,"15min":1.034},"last":0.47699999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:12:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.55500000000000005,"15min":0.56699999999999995},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.80100000000000005,"5min":0.84899999999999998,"15min":0.98899999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57099999999999995,"15min":0.59199999999999997},"min":{"1min":0.442,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.79100000000000004,"5min":0.83899999999999997,"15min":0.88400000000000001},"last":0.53800000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574947,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307284,"kb_used_data":1804,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064556,"statfs":{"total":96636764160,"available":96322105344,"internally_reserved":0,"allocated":1847296,"data_stored":1160380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.32000000000000001,"15min":0.33300000000000002},"min":{"1min":0.20899999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.41099999999999998,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.34899999999999998,"15min":0.34399999999999997},"min":{"1min":0.22500000000000001,"5min":0.215,"15min":0.19700000000000001},"max":{"1min":0.436,"5min":0.625,"15min":0.625},"last":0.32000000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.33800000000000002,"15min":0.33400000000000002},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.49199999999999999,"5min":1.351,"15min":1.351},"last":0.248},{"interface":"front","average":{"1min":0.38,"5min":0.39600000000000002,"15min":0.38600000000000001},"min":{"1min":0.26100000000000001,"5min":0.22800000000000001,"15min":0.20999999999999999},"max":{"1min":0.56999999999999995,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.30499999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.40300000000000002,"15min":0.40600000000000003},"min":{"1min":0.27500000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.51700000000000002,"5min":0.68999999999999995,"15min":0.72399999999999998},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.379,"5min":0.38100000000000001,"15min":0.36899999999999999},"min":{"1min":0.246,"5min":0.217,"15min":0.217},"max":{"1min":0.52800000000000002,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.23400000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.53500000000000003,"15min":0.51000000000000001},"min":{"1min":0.29799999999999999,"5min":0.29499999999999998,"15min":0.28199999999999997},"max":{"1min":0.751,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.442},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56999999999999995,"15min":0.54300000000000004},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.74399999999999999,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.39900000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56899999999999995,"15min":0.55000000000000004},"min":{"1min":0.36099999999999999,"5min":0.34000000000000002,"15min":0.33500000000000002},"max":{"1min":0.77700000000000002,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56599999999999995,"15min":0.54200000000000004},"min":{"1min":0.39200000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.76400000000000001,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.41299999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58999999999999997,"15min":0.56599999999999995},"min":{"1min":0.38300000000000001,"5min":0.34999999999999998,"15min":0.315},"max":{"1min":0.81999999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.60399999999999998,"15min":0.57699999999999996},"min":{"1min":0.44900000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.79300000000000004,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.379}]},{"osd":7,"last update":"Fri Oct 6 11:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.60899999999999999,"15min":0.58899999999999997},"min":{"1min":0.42999999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.90900000000000003},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59199999999999997,"15min":0.58099999999999996},"min":{"1min":0.44600000000000001,"5min":0.378,"15min":0.374},"max":{"1min":0.79500000000000004,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.38900000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574946,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298492,"kb_used_data":1204,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073348,"statfs":{"total":96636764160,"available":96331108352,"internally_reserved":0,"allocated":1232896,"data_stored":561984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.745,"15min":0.46999999999999997},"min":{"1min":0.20499999999999999,"5min":0.184,"15min":0.184},"max":{"1min":0.64900000000000002,"5min":36.097999999999999,"15min":36.097999999999999},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.45700000000000002,"15min":0.378},"min":{"1min":0.26200000000000001,"5min":0.182,"15min":0.182},"max":{"1min":0.70699999999999996,"5min":7.2990000000000004,"15min":7.2990000000000004},"last":0.41699999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.77700000000000002,"15min":0.51000000000000001},"min":{"1min":0.308,"5min":0.217,"15min":0.217},"max":{"1min":0.82599999999999996,"5min":36.07,"15min":36.07},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.48499999999999999,"15min":0.40500000000000003},"min":{"1min":0.25600000000000001,"5min":0.23200000000000001,"15min":0.219},"max":{"1min":0.60399999999999998,"5min":6.7800000000000002,"15min":6.7800000000000002},"last":0.46100000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.45300000000000001,"15min":0.40000000000000002},"min":{"1min":0.28399999999999997,"5min":0.223,"15min":0.223},"max":{"1min":0.64100000000000001,"5min":8.4130000000000003,"15min":8.4130000000000003},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.81399999999999995,"15min":0.56399999999999995},"min":{"1min":0.29499999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.626,"5min":35.959000000000003,"15min":35.959000000000003},"last":0.377}]},{"osd":4,"last update":"Fri Oct 6 11:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57399999999999995,"15min":0.56299999999999994},"min":{"1min":0.38400000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.88,"5min":2.427,"15min":2.427},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.98699999999999999,"15min":0.73699999999999999},"min":{"1min":0.41899999999999998,"5min":0.34399999999999997,"15min":0.29299999999999998},"max":{"1min":0.91700000000000004,"5min":36.005000000000003,"15min":36.005000000000003},"last":0.40600000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63600000000000001,"15min":0.57699999999999996},"min":{"1min":0.45100000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.99399999999999999,"5min":6.6699999999999999,"15min":6.6699999999999999},"last":0.622},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57399999999999995,"15min":0.55100000000000005},"min":{"1min":0.38400000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.88500000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.39900000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.98899999999999999,"15min":0.73599999999999999},"min":{"1min":0.39700000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.94599999999999995,"5min":36.037999999999997,"15min":36.037999999999997},"last":0.504},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.70599999999999996,"15min":0.63600000000000001},"min":{"1min":0.47999999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93700000000000006,"5min":6.7110000000000003,"15min":6.7110000000000003},"last":0.65700000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.66600000000000004,"15min":0.623},"min":{"1min":0.40999999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.90200000000000002,"5min":6.742,"15min":6.742},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.629,"5min":0.59199999999999997,"15min":0.56799999999999995},"min":{"1min":0.42199999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.92600000000000005,"5min":1.917,"15min":1.917},"last":0.45300000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574947,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310780,"kb_used_data":1204,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061060,"statfs":{"total":96636764160,"available":96318525440,"internally_reserved":0,"allocated":1232896,"data_stored":561984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.317,"15min":0.311},"min":{"1min":0.23499999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.39100000000000001,"5min":0.56699999999999995,"15min":0.57499999999999996},"last":0.308},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.38900000000000001,"15min":0.38500000000000001},"min":{"1min":0.29299999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.55600000000000005,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.39900000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.38,"15min":0.375},"min":{"1min":0.27500000000000002,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.52200000000000002,"5min":0.745,"15min":0.745},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36099999999999999,"15min":0.34999999999999998},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.52900000000000003,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.371}]},{"osd":3,"last update":"Fri Oct 6 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.375,"15min":0.371},"min":{"1min":0.29699999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.57699999999999996,"5min":0.629,"15min":0.629},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36199999999999999,"15min":0.36499999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.49099999999999999,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.41299999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.53400000000000003,"15min":0.53100000000000003},"min":{"1min":0.35599999999999998,"5min":0.313,"15min":0.30299999999999999},"max":{"1min":0.80400000000000005,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54100000000000004,"15min":0.55200000000000005},"min":{"1min":0.28299999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.71099999999999997,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.72499999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.54500000000000004,"15min":0.54600000000000004},"min":{"1min":0.38300000000000001,"5min":0.33100000000000002,"15min":0.32400000000000001},"max":{"1min":0.80400000000000005,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.57099999999999995,"15min":0.55500000000000005},"min":{"1min":0.44800000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.872,"5min":0.878,"15min":0.878},"last":0.69099999999999995}]},{"osd":6,"last update":"Fri Oct 6 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.40300000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.84599999999999997,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.42799999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.83499999999999996,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.63900000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58199999999999996,"15min":0.55700000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.58499999999999996,"15min":0.57099999999999995},"min":{"1min":0.38800000000000001,"5min":0.38600000000000001,"15min":0.38200000000000001},"max":{"1min":0.89600000000000002,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.65800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574947,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302592,"kb_used_data":1208,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069248,"statfs":{"total":96636764160,"available":96326909952,"internally_reserved":0,"allocated":1236992,"data_stored":562538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.318,"15min":0.32300000000000001},"min":{"1min":0.19600000000000001,"5min":0.183,"15min":0.183},"max":{"1min":0.48099999999999998,"5min":0.48799999999999999,"15min":1.095},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.376,"5min":0.35699999999999998,"15min":0.38800000000000001},"min":{"1min":0.27000000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.50900000000000001,"5min":0.53900000000000003,"15min":1.7210000000000001},"last":0.27900000000000003}]},{"osd":1,"last update":"Fri Oct 6 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.32000000000000001,"15min":0.31},"min":{"1min":0.251,"5min":0.217,"15min":0.217},"max":{"1min":0.45700000000000002,"5min":0.48199999999999998,"15min":0.65400000000000003},"last":0.247},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34499999999999997,"15min":0.36199999999999999},"min":{"1min":0.23400000000000001,"5min":0.188,"15min":0.188},"max":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":1.196},"last":0.29999999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.36099999999999999,"15min":0.38200000000000001},"min":{"1min":0.23400000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":1.7729999999999999},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.41499999999999998},"min":{"1min":0.32600000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.57399999999999995,"5min":0.58599999999999997,"15min":1.224},"last":0.35899999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53000000000000003,"15min":0.55800000000000005},"min":{"1min":0.33800000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.77600000000000002,"5min":0.92500000000000004,"15min":1.694},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.53700000000000003,"15min":0.53900000000000003},"min":{"1min":0.36799999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.72399999999999998,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.437}]},{"osd":5,"last update":"Fri Oct 6 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55600000000000005,"15min":0.52800000000000002},"min":{"1min":0.34399999999999997,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.79000000000000004,"5min":0.878,"15min":0.878},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55300000000000005,"15min":0.55900000000000005},"min":{"1min":0.40000000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.69799999999999995,"5min":0.82199999999999995,"15min":1.165},"last":0.52000000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56899999999999995,"15min":0.58299999999999996},"min":{"1min":0.38,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.69499999999999995,"5min":0.89900000000000002,"15min":1.1359999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57899999999999996,"15min":0.59399999999999997},"min":{"1min":0.38800000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80300000000000005,"5min":0.83399999999999996,"15min":1.7470000000000001},"last":0.57199999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56699999999999995,"15min":0.58499999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35599999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":1.657},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57699999999999996,"15min":0.57199999999999995},"min":{"1min":0.439,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76300000000000001,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.49099999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574946,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298516,"kb_used_data":1228,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073324,"statfs":{"total":96636764160,"available":96331083776,"internally_reserved":0,"allocated":1257472,"data_stored":570070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:12:49 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.46400000000000002,"15min":0.55700000000000005},"min":{"1min":0.20799999999999999,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":2.6619999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.496,"15min":0.497},"min":{"1min":0.27300000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.68799999999999994}]},{"osd":1,"last update":"Fri Oct 6 11:12:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.47599999999999998,"15min":0.57899999999999996},"min":{"1min":0.26200000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.752,"5min":0.752,"15min":2.8650000000000002},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.48899999999999999,"15min":0.58499999999999996},"min":{"1min":0.28699999999999998,"5min":0.26200000000000001,"15min":0.25800000000000001},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":2.7610000000000001},"last":0.71099999999999997}]},{"osd":2,"last update":"Fri Oct 6 11:12:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.49199999999999999,"15min":0.55500000000000005},"min":{"1min":0.29799999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.76000000000000001,"5min":0.78200000000000003,"15min":1.6910000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.55700000000000005,"15min":0.59899999999999998},"min":{"1min":0.31,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":1.718},"last":0.74299999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:12:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.53000000000000003,"15min":0.60999999999999999},"min":{"1min":0.32500000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.79000000000000004,"5min":0.83099999999999996,"15min":2.677},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.52200000000000002,"15min":0.52300000000000002},"min":{"1min":0.374,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.61499999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:12:49 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.47299999999999998,"15min":0.48999999999999999},"min":{"1min":0.314,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51700000000000002,"15min":0.53700000000000003},"min":{"1min":0.34699999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.505}]},{"osd":6,"last update":"Fri Oct 6 11:12:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.51300000000000001,"15min":0.52700000000000002},"min":{"1min":0.39700000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.53800000000000003,"15min":0.57699999999999996},"min":{"1min":0.40300000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.85799999999999998,"5min":0.86899999999999999,"15min":1.165},"last":0.54200000000000004}]},{"osd":7,"last update":"Fri Oct 6 11:12:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.56899999999999995,"15min":0.56100000000000005},"min":{"1min":0.39000000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.57999999999999996,"15min":0.60299999999999998},"min":{"1min":0.433,"5min":0.317,"15min":0.317},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.67100000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574948,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306688,"kb_used_data":1208,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065152,"statfs":{"total":96636764160,"available":96322715648,"internally_reserved":0,"allocated":1236992,"data_stored":563337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:12:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.47999999999999998,"15min":0.65000000000000002},"min":{"1min":0.23499999999999999,"5min":0.23100000000000001,"15min":0.20499999999999999},"max":{"1min":0.70899999999999996,"5min":0.72599999999999998,"15min":5.0490000000000004},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.46899999999999997,"15min":0.624},"min":{"1min":0.36499999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":5.1449999999999996},"last":0.61899999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:12:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.48299999999999998,"15min":0.48899999999999999},"min":{"1min":0.33700000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.97199999999999998},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.499,"15min":0.52000000000000002},"min":{"1min":0.28100000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68999999999999995,"5min":0.70999999999999996,"15min":1.8799999999999999},"last":0.56699999999999995}]},{"osd":2,"last update":"Fri Oct 6 11:12:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.53200000000000003,"15min":0.55900000000000005},"min":{"1min":0.33000000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.79800000000000004,"5min":0.81799999999999995,"15min":4.234},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.55000000000000004,"15min":0.56899999999999995},"min":{"1min":0.38300000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":1.0369999999999999},"last":0.60599999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:12:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.50800000000000001,"15min":0.67000000000000004},"min":{"1min":0.41399999999999998,"5min":0.29299999999999998,"15min":0.27700000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":5.2169999999999996},"last":0.505},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.53600000000000003,"15min":0.54800000000000004},"min":{"1min":0.32600000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.751,"5min":0.83399999999999996,"15min":1.008},"last":0.54500000000000004}]},{"osd":4,"last update":"Fri Oct 6 11:12:52 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.48099999999999998,"15min":0.52100000000000002},"min":{"1min":0.30199999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.70399999999999996,"5min":0.871,"15min":1.917},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.499,"5min":0.48799999999999999,"15min":0.53400000000000003},"min":{"1min":0.34999999999999998,"5min":0.24399999999999999,"15min":0.23899999999999999},"max":{"1min":0.64700000000000002,"5min":0.85499999999999998,"15min":0.87},"last":0.67100000000000004}]},{"osd":6,"last update":"Fri Oct 6 11:12:52 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.51400000000000001,"15min":0.56299999999999994},"min":{"1min":0.372,"5min":0.316,"15min":0.316},"max":{"1min":0.68899999999999995,"5min":0.89500000000000002,"15min":2.0139999999999998},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.56599999999999995,"15min":0.61199999999999999},"min":{"1min":0.39700000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.82899999999999996,"5min":0.92300000000000004,"15min":1.9470000000000001},"last":0.751}]},{"osd":7,"last update":"Fri Oct 6 11:12:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.54000000000000004,"15min":0.58699999999999997},"min":{"1min":0.41099999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.79500000000000004,"5min":0.84299999999999997,"15min":0.96499999999999997},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57099999999999995,"15min":0.61199999999999999},"min":{"1min":0.42199999999999999,"5min":0.316,"15min":0.28799999999999998},"max":{"1min":0.72599999999999998,"5min":0.93899999999999995,"15min":1.4119999999999999},"last":0.76300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:13:35.041 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:13:35.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.189+0000 7f2aca32d700 1 Processor -- start 2023-10-06T11:13:35.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.189+0000 7f2aca32d700 1 -- start start 2023-10-06T11:13:35.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.190+0000 7f2aca32d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2ac4153ab0 0x7f2ac415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:35.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.190+0000 7f2aca32d700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2ac4153e80 0x7f2ac4068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:35.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.190+0000 7f2aca32d700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ac415ac30 con 0x7f2ac40689d0 2023-10-06T11:13:35.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.190+0000 7f2aca32d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ac40b4510 con 0x7f2ac4153ab0 2023-10-06T11:13:35.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.190+0000 7f2aca32d700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ac40b6530 con 0x7f2ac4153e80 2023-10-06T11:13:35.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.190+0000 7f2ac3fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2ac4153ab0 0x7f2ac415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:35.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.190+0000 7f2ac3fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2ac4153ab0 0x7f2ac415a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33580/0 (socket says 172.21.15.146:33580) 2023-10-06T11:13:35.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.190+0000 7f2ac3fff700 1 -- 172.21.15.146:0/1025761202 learned_addr learned my addr 172.21.15.146:0/1025761202 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:35.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.190+0000 7f2ac3fff700 1 -- 172.21.15.146:0/1025761202 >> v2:172.21.15.151:3300/0 conn(0x7f2ac4153e80 msgr2=0x7f2ac4068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:35.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.190+0000 7f2ac3fff700 1 --2- 172.21.15.146:0/1025761202 >> v2:172.21.15.151:3300/0 conn(0x7f2ac4153e80 0x7f2ac4068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.190+0000 7f2ac3fff700 1 -- 172.21.15.146:0/1025761202 >> v1:172.21.15.151:6789/0 conn(0x7f2ac40689d0 legacy=0x7f2ac415d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:35.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.190+0000 7f2ac3fff700 1 -- 172.21.15.146:0/1025761202 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac4068dd0 con 0x7f2ac4153ab0 2023-10-06T11:13:35.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.190+0000 7f2ac3fff700 1 --2- 172.21.15.146:0/1025761202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ac4153ab0 0x7f2ac415a6f0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4089770 tx=0x7f2ab8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=533d23d6d904bd21 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:35.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.190+0000 7f2ac2ffd700 1 -- 172.21.15.146:0/1025761202 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab800b820 con 0x7f2ac4153ab0 2023-10-06T11:13:35.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.190+0000 7f2ac2ffd700 1 -- 172.21.15.146:0/1025761202 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab800b980 con 0x7f2ac4153ab0 2023-10-06T11:13:35.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.190+0000 7f2ac2ffd700 1 -- 172.21.15.146:0/1025761202 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab800bd20 con 0x7f2ac4153ab0 2023-10-06T11:13:35.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.191+0000 7f2aca32d700 1 -- 172.21.15.146:0/1025761202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ac4153ab0 msgr2=0x7f2ac415a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:35.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.191+0000 7f2aca32d700 1 --2- 172.21.15.146:0/1025761202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ac4153ab0 0x7f2ac415a6f0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4089770 tx=0x7f2ab8009250 comp rx=0 tx=0).stop 2023-10-06T11:13:35.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.191+0000 7f2aca32d700 1 -- 172.21.15.146:0/1025761202 shutdown_connections 2023-10-06T11:13:35.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.191+0000 7f2aca32d700 1 --2- 172.21.15.146:0/1025761202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ac4153ab0 0x7f2ac415a6f0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.191+0000 7f2aca32d700 1 --2- 172.21.15.146:0/1025761202 >> v2:172.21.15.151:3300/0 conn(0x7f2ac4153e80 0x7f2ac4068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.191+0000 7f2aca32d700 1 -- 172.21.15.146:0/1025761202 >> 172.21.15.146:0/1025761202 conn(0x7f2ac406eba0 msgr2=0x7f2ac406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:35.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.191+0000 7f2aca32d700 1 -- 172.21.15.146:0/1025761202 shutdown_connections 2023-10-06T11:13:35.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.191+0000 7f2aca32d700 1 -- 172.21.15.146:0/1025761202 wait complete. 2023-10-06T11:13:35.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.192+0000 7f2aca32d700 1 Processor -- start 2023-10-06T11:13:35.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.192+0000 7f2aca32d700 1 -- start start 2023-10-06T11:13:35.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.193+0000 7f2aca32d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ac40689d0 0x7f2ac41431d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:35.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.193+0000 7f2aca32d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ac4153ab0 0x7f2ac40d05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:35.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.193+0000 7f2aca32d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ac4153e80 0x7f2ac40cec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:35.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.193+0000 7f2aca32d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac40d0b20 con 0x7f2ac4153ab0 2023-10-06T11:13:35.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.193+0000 7f2aca32d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac4152880 con 0x7f2ac40689d0 2023-10-06T11:13:35.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.193+0000 7f2aca32d700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac4156b40 con 0x7f2ac4153e80 2023-10-06T11:13:35.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.193+0000 7f2ac37fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ac4153ab0 0x7f2ac40d05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:35.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.193+0000 7f2ac37fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ac4153ab0 0x7f2ac40d05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33584/0 (socket says 172.21.15.146:33584) 2023-10-06T11:13:35.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.193+0000 7f2ac37fe700 1 -- 172.21.15.146:0/2669617039 learned_addr learned my addr 172.21.15.146:0/2669617039 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:35.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.193+0000 7f2ac3fff700 1 --2- 172.21.15.146:0/2669617039 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ac40689d0 0x7f2ac41431d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:35.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.193+0000 7f2ac88ca700 1 --2- 172.21.15.146:0/2669617039 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ac4153e80 0x7f2ac40cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:35.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.193+0000 7f2ac37fe700 1 -- 172.21.15.146:0/2669617039 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ac4153e80 msgr2=0x7f2ac40cec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:35.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.193+0000 7f2ac37fe700 1 --2- 172.21.15.146:0/2669617039 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ac4153e80 0x7f2ac40cec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.193+0000 7f2ac37fe700 1 -- 172.21.15.146:0/2669617039 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ac40689d0 msgr2=0x7f2ac41431d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:35.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.193+0000 7f2ac37fe700 1 --2- 172.21.15.146:0/2669617039 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ac40689d0 0x7f2ac41431d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.193+0000 7f2ac37fe700 1 -- 172.21.15.146:0/2669617039 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab80094f0 con 0x7f2ac4153ab0 2023-10-06T11:13:35.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.193+0000 7f2ac88ca700 1 --2- 172.21.15.146:0/2669617039 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ac4153e80 0x7f2ac40cec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:35.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.193+0000 7f2ac37fe700 1 --2- 172.21.15.146:0/2669617039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ac4153ab0 0x7f2ac40d05e0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f2ab400b810 tx=0x7f2ab4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:35.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.194+0000 7f2aabfff700 1 -- 172.21.15.146:0/2669617039 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab400f5f0 con 0x7f2ac4153ab0 2023-10-06T11:13:35.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.194+0000 7f2aabfff700 1 -- 172.21.15.146:0/2669617039 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ab400f770 con 0x7f2ac4153ab0 2023-10-06T11:13:35.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.194+0000 7f2aca32d700 1 -- 172.21.15.146:0/2669617039 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ac4156e20 con 0x7f2ac4153ab0 2023-10-06T11:13:35.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.194+0000 7f2aabfff700 1 -- 172.21.15.146:0/2669617039 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ab400fb30 con 0x7f2ac4153ab0 2023-10-06T11:13:35.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.194+0000 7f2aca32d700 1 -- 172.21.15.146:0/2669617039 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ac41573e0 con 0x7f2ac4153ab0 2023-10-06T11:13:35.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.194+0000 7f2aca32d700 1 -- 172.21.15.146:0/2669617039 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ac404c380 con 0x7f2ac4153ab0 2023-10-06T11:13:35.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.195+0000 7f2aabfff700 1 -- 172.21.15.146:0/2669617039 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2ab4010480 con 0x7f2ac4153ab0 2023-10-06T11:13:35.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.195+0000 7f2aabfff700 1 --2- 172.21.15.146:0/2669617039 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2ab0066f30 0x7f2ab00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:35.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.195+0000 7f2aabfff700 1 -- 172.21.15.146:0/2669617039 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2ab40845d0 con 0x7f2ac4153ab0 2023-10-06T11:13:35.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.195+0000 7f2ac3fff700 1 --2- 172.21.15.146:0/2669617039 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2ab0066f30 0x7f2ab00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:35.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.196+0000 7f2ac3fff700 1 --2- 172.21.15.146:0/2669617039 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2ab0066f30 0x7f2ab00693e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4089770 tx=0x7f2ab8016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:35.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.200+0000 7f2aabfff700 1 -- 172.21.15.146:0/2669617039 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ab4051760 con 0x7f2ac4153ab0 2023-10-06T11:13:35.265 INFO:tasks.ceph.mds.c.smithi146.stderr:2023-10-06T11:13:35.264+0000 7f945a8b6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T11:13:35.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.381+0000 7f2aca32d700 1 -- 172.21.15.146:0/2669617039 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2ac4068f60 con 0x7f2ab0066f30 2023-10-06T11:13:35.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.389+0000 7f2aabfff700 1 -- 172.21.15.146:0/2669617039 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311506 (secure 0 0 0) 0x7f2ac4068f60 con 0x7f2ab0066f30 2023-10-06T11:13:35.394 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:13:35.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.392+0000 7f2aca32d700 1 -- 172.21.15.146:0/2669617039 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2ab0066f30 msgr2=0x7f2ab00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:35.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.392+0000 7f2aca32d700 1 --2- 172.21.15.146:0/2669617039 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2ab0066f30 0x7f2ab00693e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4089770 tx=0x7f2ab8016000 comp rx=0 tx=0).stop 2023-10-06T11:13:35.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.392+0000 7f2aca32d700 1 -- 172.21.15.146:0/2669617039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ac4153ab0 msgr2=0x7f2ac40d05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:35.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.392+0000 7f2aca32d700 1 --2- 172.21.15.146:0/2669617039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ac4153ab0 0x7f2ac40d05e0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f2ab400b810 tx=0x7f2ab4009250 comp rx=0 tx=0).stop 2023-10-06T11:13:35.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.392+0000 7f2aca32d700 1 -- 172.21.15.146:0/2669617039 shutdown_connections 2023-10-06T11:13:35.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.392+0000 7f2aca32d700 1 --2- 172.21.15.146:0/2669617039 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2ab0066f30 0x7f2ab00693e0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.392+0000 7f2aca32d700 1 --2- 172.21.15.146:0/2669617039 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ac4153e80 0x7f2ac40cec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.392+0000 7f2aca32d700 1 --2- 172.21.15.146:0/2669617039 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ac40689d0 0x7f2ac41431d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.392+0000 7f2aca32d700 1 --2- 172.21.15.146:0/2669617039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ac4153ab0 0x7f2ac40d05e0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.392+0000 7f2aca32d700 1 -- 172.21.15.146:0/2669617039 >> 172.21.15.146:0/2669617039 conn(0x7f2ac406eba0 msgr2=0x7f2ac415c730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:35.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.393+0000 7f2aca32d700 1 -- 172.21.15.146:0/2669617039 shutdown_connections 2023-10-06T11:13:35.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.393+0000 7f2aca32d700 1 -- 172.21.15.146:0/2669617039 wait complete. 2023-10-06T11:13:35.398 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:13:35.407 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":333,"stamp":"2023-10-06T11:13:35.240742+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":110,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2442420,"kb_used_data":10868,"kb_used_omap":0,"kb_used_meta":2431488,"kb_avail":752532300,"statfs":{"total":773094113280,"available":770593075200,"internally_reserved":0,"allocated":11128832,"data_stored":5698094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2489843712},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001021"},"pg_stats":[{"pgid":"16.3f","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.391468+0000","last_change":"2023-10-06T11:13:30.391468+0000","last_active":"2023-10-06T11:13:30.391468+0000","last_peered":"2023-10-06T11:13:30.391468+0000","last_clean":"2023-10-06T11:13:30.391468+0000","last_became_active":"2023-10-06T11:13:30.390997+0000","last_became_peered":"2023-10-06T11:13:30.390997+0000","last_unstale":"2023-10-06T11:13:30.391468+0000","last_undegraded":"2023-10-06T11:13:30.391468+0000","last_fullsized":"2023-10-06T11:13:30.391468+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:55:56.708602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3e","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.390078+0000","last_change":"2023-10-06T11:13:30.390078+0000","last_active":"2023-10-06T11:13:30.390078+0000","last_peered":"2023-10-06T11:13:30.390078+0000","last_clean":"2023-10-06T11:13:30.390078+0000","last_became_active":"2023-10-06T11:13:30.389801+0000","last_became_peered":"2023-10-06T11:13:30.389801+0000","last_unstale":"2023-10-06T11:13:30.390078+0000","last_undegraded":"2023-10-06T11:13:30.390078+0000","last_fullsized":"2023-10-06T11:13:30.390078+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:34:14.300690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.3d","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.393936+0000","last_change":"2023-10-06T11:13:30.393936+0000","last_active":"2023-10-06T11:13:30.393936+0000","last_peered":"2023-10-06T11:13:30.393936+0000","last_clean":"2023-10-06T11:13:30.393936+0000","last_became_active":"2023-10-06T11:13:30.393687+0000","last_became_peered":"2023-10-06T11:13:30.393687+0000","last_unstale":"2023-10-06T11:13:30.393936+0000","last_undegraded":"2023-10-06T11:13:30.393936+0000","last_fullsized":"2023-10-06T11:13:30.393936+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:48:58.606251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.3c","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.387420+0000","last_change":"2023-10-06T11:13:30.387420+0000","last_active":"2023-10-06T11:13:30.387420+0000","last_peered":"2023-10-06T11:13:30.387420+0000","last_clean":"2023-10-06T11:13:30.387420+0000","last_became_active":"2023-10-06T11:13:30.386100+0000","last_became_peered":"2023-10-06T11:13:30.386100+0000","last_unstale":"2023-10-06T11:13:30.387420+0000","last_undegraded":"2023-10-06T11:13:30.387420+0000","last_fullsized":"2023-10-06T11:13:30.387420+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:04:49.205484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.3b","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.395475+0000","last_change":"2023-10-06T11:13:30.393872+0000","last_active":"2023-10-06T11:13:30.395475+0000","last_peered":"2023-10-06T11:13:30.395475+0000","last_clean":"2023-10-06T11:13:30.395475+0000","last_became_active":"2023-10-06T11:13:30.393328+0000","last_became_peered":"2023-10-06T11:13:30.393328+0000","last_unstale":"2023-10-06T11:13:30.395475+0000","last_undegraded":"2023-10-06T11:13:30.395475+0000","last_fullsized":"2023-10-06T11:13:30.395475+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:37.202804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3a","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.392367+0000","last_change":"2023-10-06T11:13:30.392367+0000","last_active":"2023-10-06T11:13:30.392367+0000","last_peered":"2023-10-06T11:13:30.392367+0000","last_clean":"2023-10-06T11:13:30.392367+0000","last_became_active":"2023-10-06T11:13:30.392056+0000","last_became_peered":"2023-10-06T11:13:30.392056+0000","last_unstale":"2023-10-06T11:13:30.392367+0000","last_undegraded":"2023-10-06T11:13:30.392367+0000","last_fullsized":"2023-10-06T11:13:30.392367+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:18.313520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.39","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.394522+0000","last_change":"2023-10-06T11:13:30.394522+0000","last_active":"2023-10-06T11:13:30.394522+0000","last_peered":"2023-10-06T11:13:30.394522+0000","last_clean":"2023-10-06T11:13:30.394522+0000","last_became_active":"2023-10-06T11:13:30.394235+0000","last_became_peered":"2023-10-06T11:13:30.394235+0000","last_unstale":"2023-10-06T11:13:30.394522+0000","last_undegraded":"2023-10-06T11:13:30.394522+0000","last_fullsized":"2023-10-06T11:13:30.394522+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:01:06.220157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.38","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.385783+0000","last_change":"2023-10-06T11:13:30.385783+0000","last_active":"2023-10-06T11:13:30.385783+0000","last_peered":"2023-10-06T11:13:30.385783+0000","last_clean":"2023-10-06T11:13:30.385783+0000","last_became_active":"2023-10-06T11:13:30.384960+0000","last_became_peered":"2023-10-06T11:13:30.384960+0000","last_unstale":"2023-10-06T11:13:30.385783+0000","last_undegraded":"2023-10-06T11:13:30.385783+0000","last_fullsized":"2023-10-06T11:13:30.385783+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:01:49.355080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.37","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.390675+0000","last_change":"2023-10-06T11:13:30.390675+0000","last_active":"2023-10-06T11:13:30.390675+0000","last_peered":"2023-10-06T11:13:30.390675+0000","last_clean":"2023-10-06T11:13:30.390675+0000","last_became_active":"2023-10-06T11:13:30.390416+0000","last_became_peered":"2023-10-06T11:13:30.390416+0000","last_unstale":"2023-10-06T11:13:30.390675+0000","last_undegraded":"2023-10-06T11:13:30.390675+0000","last_fullsized":"2023-10-06T11:13:30.390675+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:08.791515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.36","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.395409+0000","last_change":"2023-10-06T11:13:30.393721+0000","last_active":"2023-10-06T11:13:30.395409+0000","last_peered":"2023-10-06T11:13:30.395409+0000","last_clean":"2023-10-06T11:13:30.395409+0000","last_became_active":"2023-10-06T11:13:30.393469+0000","last_became_peered":"2023-10-06T11:13:30.393469+0000","last_unstale":"2023-10-06T11:13:30.395409+0000","last_undegraded":"2023-10-06T11:13:30.395409+0000","last_fullsized":"2023-10-06T11:13:30.395409+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:27:12.928906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.35","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.395770+0000","last_change":"2023-10-06T11:13:30.395770+0000","last_active":"2023-10-06T11:13:30.395770+0000","last_peered":"2023-10-06T11:13:30.395770+0000","last_clean":"2023-10-06T11:13:30.395770+0000","last_became_active":"2023-10-06T11:13:30.395514+0000","last_became_peered":"2023-10-06T11:13:30.395514+0000","last_unstale":"2023-10-06T11:13:30.395770+0000","last_undegraded":"2023-10-06T11:13:30.395770+0000","last_fullsized":"2023-10-06T11:13:30.395770+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:31:18.045782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.34","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.392422+0000","last_change":"2023-10-06T11:13:30.387352+0000","last_active":"2023-10-06T11:13:30.392422+0000","last_peered":"2023-10-06T11:13:30.392422+0000","last_clean":"2023-10-06T11:13:30.392422+0000","last_became_active":"2023-10-06T11:13:30.386941+0000","last_became_peered":"2023-10-06T11:13:30.386941+0000","last_unstale":"2023-10-06T11:13:30.392422+0000","last_undegraded":"2023-10-06T11:13:30.392422+0000","last_fullsized":"2023-10-06T11:13:30.392422+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:42:22.764379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.33","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.383568+0000","last_change":"2023-10-06T11:13:30.383568+0000","last_active":"2023-10-06T11:13:30.383568+0000","last_peered":"2023-10-06T11:13:30.383568+0000","last_clean":"2023-10-06T11:13:30.383568+0000","last_became_active":"2023-10-06T11:13:30.383274+0000","last_became_peered":"2023-10-06T11:13:30.383274+0000","last_unstale":"2023-10-06T11:13:30.383568+0000","last_undegraded":"2023-10-06T11:13:30.383568+0000","last_fullsized":"2023-10-06T11:13:30.383568+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:57:05.858686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.32","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.393892+0000","last_change":"2023-10-06T11:13:30.393892+0000","last_active":"2023-10-06T11:13:30.393892+0000","last_peered":"2023-10-06T11:13:30.393892+0000","last_clean":"2023-10-06T11:13:30.393892+0000","last_became_active":"2023-10-06T11:13:30.392621+0000","last_became_peered":"2023-10-06T11:13:30.392621+0000","last_unstale":"2023-10-06T11:13:30.393892+0000","last_undegraded":"2023-10-06T11:13:30.393892+0000","last_fullsized":"2023-10-06T11:13:30.393892+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:07:50.934263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.31","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.396797+0000","last_change":"2023-10-06T11:13:30.396797+0000","last_active":"2023-10-06T11:13:30.396797+0000","last_peered":"2023-10-06T11:13:30.396797+0000","last_clean":"2023-10-06T11:13:30.396797+0000","last_became_active":"2023-10-06T11:13:30.396545+0000","last_became_peered":"2023-10-06T11:13:30.396545+0000","last_unstale":"2023-10-06T11:13:30.396797+0000","last_undegraded":"2023-10-06T11:13:30.396797+0000","last_fullsized":"2023-10-06T11:13:30.396797+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:04:49.205484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.30","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.393400+0000","last_change":"2023-10-06T11:13:30.393400+0000","last_active":"2023-10-06T11:13:30.393400+0000","last_peered":"2023-10-06T11:13:30.393400+0000","last_clean":"2023-10-06T11:13:30.393400+0000","last_became_active":"2023-10-06T11:13:30.393010+0000","last_became_peered":"2023-10-06T11:13:30.393010+0000","last_unstale":"2023-10-06T11:13:30.393400+0000","last_undegraded":"2023-10-06T11:13:30.393400+0000","last_fullsized":"2023-10-06T11:13:30.393400+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:28:28.429635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.2f","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.395636+0000","last_change":"2023-10-06T11:13:30.395636+0000","last_active":"2023-10-06T11:13:30.395636+0000","last_peered":"2023-10-06T11:13:30.395636+0000","last_clean":"2023-10-06T11:13:30.395636+0000","last_became_active":"2023-10-06T11:13:30.395318+0000","last_became_peered":"2023-10-06T11:13:30.395318+0000","last_unstale":"2023-10-06T11:13:30.395636+0000","last_undegraded":"2023-10-06T11:13:30.395636+0000","last_fullsized":"2023-10-06T11:13:30.395636+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:39.911708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2e","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.391882+0000","last_change":"2023-10-06T11:13:30.391882+0000","last_active":"2023-10-06T11:13:30.391882+0000","last_peered":"2023-10-06T11:13:30.391882+0000","last_clean":"2023-10-06T11:13:30.391882+0000","last_became_active":"2023-10-06T11:13:30.391628+0000","last_became_peered":"2023-10-06T11:13:30.391628+0000","last_unstale":"2023-10-06T11:13:30.391882+0000","last_undegraded":"2023-10-06T11:13:30.391882+0000","last_fullsized":"2023-10-06T11:13:30.391882+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:38:53.530447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.2d","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.394726+0000","last_change":"2023-10-06T11:13:30.394726+0000","last_active":"2023-10-06T11:13:30.394726+0000","last_peered":"2023-10-06T11:13:30.394726+0000","last_clean":"2023-10-06T11:13:30.394726+0000","last_became_active":"2023-10-06T11:13:30.394312+0000","last_became_peered":"2023-10-06T11:13:30.394312+0000","last_unstale":"2023-10-06T11:13:30.394726+0000","last_undegraded":"2023-10-06T11:13:30.394726+0000","last_fullsized":"2023-10-06T11:13:30.394726+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:50.606291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2c","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.397973+0000","last_change":"2023-10-06T11:13:30.392741+0000","last_active":"2023-10-06T11:13:30.397973+0000","last_peered":"2023-10-06T11:13:30.397973+0000","last_clean":"2023-10-06T11:13:30.397973+0000","last_became_active":"2023-10-06T11:13:30.392161+0000","last_became_peered":"2023-10-06T11:13:30.392161+0000","last_unstale":"2023-10-06T11:13:30.397973+0000","last_undegraded":"2023-10-06T11:13:30.397973+0000","last_fullsized":"2023-10-06T11:13:30.397973+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:17:00.386689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2b","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.390059+0000","last_change":"2023-10-06T11:13:30.390059+0000","last_active":"2023-10-06T11:13:30.390059+0000","last_peered":"2023-10-06T11:13:30.390059+0000","last_clean":"2023-10-06T11:13:30.390059+0000","last_became_active":"2023-10-06T11:13:30.389818+0000","last_became_peered":"2023-10-06T11:13:30.389818+0000","last_unstale":"2023-10-06T11:13:30.390059+0000","last_undegraded":"2023-10-06T11:13:30.390059+0000","last_fullsized":"2023-10-06T11:13:30.390059+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:20:42.175876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2a","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.389122+0000","last_change":"2023-10-06T11:13:30.386827+0000","last_active":"2023-10-06T11:13:30.389122+0000","last_peered":"2023-10-06T11:13:30.389122+0000","last_clean":"2023-10-06T11:13:30.389122+0000","last_became_active":"2023-10-06T11:13:30.386585+0000","last_became_peered":"2023-10-06T11:13:30.386585+0000","last_unstale":"2023-10-06T11:13:30.389122+0000","last_undegraded":"2023-10-06T11:13:30.389122+0000","last_fullsized":"2023-10-06T11:13:30.389122+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:18.313520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.29","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.393000+0000","last_change":"2023-10-06T11:13:30.393000+0000","last_active":"2023-10-06T11:13:30.393000+0000","last_peered":"2023-10-06T11:13:30.393000+0000","last_clean":"2023-10-06T11:13:30.393000+0000","last_became_active":"2023-10-06T11:13:30.392757+0000","last_became_peered":"2023-10-06T11:13:30.392757+0000","last_unstale":"2023-10-06T11:13:30.393000+0000","last_undegraded":"2023-10-06T11:13:30.393000+0000","last_fullsized":"2023-10-06T11:13:30.393000+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:44:42.843573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.28","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.388611+0000","last_change":"2023-10-06T11:13:30.386863+0000","last_active":"2023-10-06T11:13:30.388611+0000","last_peered":"2023-10-06T11:13:30.388611+0000","last_clean":"2023-10-06T11:13:30.388611+0000","last_became_active":"2023-10-06T11:13:30.386638+0000","last_became_peered":"2023-10-06T11:13:30.386638+0000","last_unstale":"2023-10-06T11:13:30.388611+0000","last_undegraded":"2023-10-06T11:13:30.388611+0000","last_fullsized":"2023-10-06T11:13:30.388611+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:38:53.530447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.27","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.392442+0000","last_change":"2023-10-06T11:13:30.387984+0000","last_active":"2023-10-06T11:13:30.392442+0000","last_peered":"2023-10-06T11:13:30.392442+0000","last_clean":"2023-10-06T11:13:30.392442+0000","last_became_active":"2023-10-06T11:13:30.387644+0000","last_became_peered":"2023-10-06T11:13:30.387644+0000","last_unstale":"2023-10-06T11:13:30.392442+0000","last_undegraded":"2023-10-06T11:13:30.392442+0000","last_fullsized":"2023-10-06T11:13:30.392442+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:41:11.032151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.26","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.393195+0000","last_change":"2023-10-06T11:13:30.391699+0000","last_active":"2023-10-06T11:13:30.393195+0000","last_peered":"2023-10-06T11:13:30.393195+0000","last_clean":"2023-10-06T11:13:30.393195+0000","last_became_active":"2023-10-06T11:13:30.391427+0000","last_became_peered":"2023-10-06T11:13:30.391427+0000","last_unstale":"2023-10-06T11:13:30.393195+0000","last_undegraded":"2023-10-06T11:13:30.393195+0000","last_fullsized":"2023-10-06T11:13:30.393195+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:50.761241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.25","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.389054+0000","last_change":"2023-10-06T11:13:30.389054+0000","last_active":"2023-10-06T11:13:30.389054+0000","last_peered":"2023-10-06T11:13:30.389054+0000","last_clean":"2023-10-06T11:13:30.389054+0000","last_became_active":"2023-10-06T11:13:30.388735+0000","last_became_peered":"2023-10-06T11:13:30.388735+0000","last_unstale":"2023-10-06T11:13:30.389054+0000","last_undegraded":"2023-10-06T11:13:30.389054+0000","last_fullsized":"2023-10-06T11:13:30.389054+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:27:12.928906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.24","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.396639+0000","last_change":"2023-10-06T11:13:30.396639+0000","last_active":"2023-10-06T11:13:30.396639+0000","last_peered":"2023-10-06T11:13:30.396639+0000","last_clean":"2023-10-06T11:13:30.396639+0000","last_became_active":"2023-10-06T11:13:30.396389+0000","last_became_peered":"2023-10-06T11:13:30.396389+0000","last_unstale":"2023-10-06T11:13:30.396639+0000","last_undegraded":"2023-10-06T11:13:30.396639+0000","last_fullsized":"2023-10-06T11:13:30.396639+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:37.202804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.23","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.385321+0000","last_change":"2023-10-06T11:13:30.385321+0000","last_active":"2023-10-06T11:13:30.385321+0000","last_peered":"2023-10-06T11:13:30.385321+0000","last_clean":"2023-10-06T11:13:30.385321+0000","last_became_active":"2023-10-06T11:13:30.384692+0000","last_became_peered":"2023-10-06T11:13:30.384692+0000","last_unstale":"2023-10-06T11:13:30.385321+0000","last_undegraded":"2023-10-06T11:13:30.385321+0000","last_fullsized":"2023-10-06T11:13:30.385321+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:20:38.223295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.22","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.393102+0000","last_change":"2023-10-06T11:13:30.388061+0000","last_active":"2023-10-06T11:13:30.393102+0000","last_peered":"2023-10-06T11:13:30.393102+0000","last_clean":"2023-10-06T11:13:30.393102+0000","last_became_active":"2023-10-06T11:13:30.387764+0000","last_became_peered":"2023-10-06T11:13:30.387764+0000","last_unstale":"2023-10-06T11:13:30.393102+0000","last_undegraded":"2023-10-06T11:13:30.393102+0000","last_fullsized":"2023-10-06T11:13:30.393102+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:28:28.429635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.21","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.393921+0000","last_change":"2023-10-06T11:13:30.393921+0000","last_active":"2023-10-06T11:13:30.393921+0000","last_peered":"2023-10-06T11:13:30.393921+0000","last_clean":"2023-10-06T11:13:30.393921+0000","last_became_active":"2023-10-06T11:13:30.393605+0000","last_became_peered":"2023-10-06T11:13:30.393605+0000","last_unstale":"2023-10-06T11:13:30.393921+0000","last_undegraded":"2023-10-06T11:13:30.393921+0000","last_fullsized":"2023-10-06T11:13:30.393921+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:52.524213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.20","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.380606+0000","last_change":"2023-10-06T11:13:30.380606+0000","last_active":"2023-10-06T11:13:30.380606+0000","last_peered":"2023-10-06T11:13:30.380606+0000","last_clean":"2023-10-06T11:13:30.380606+0000","last_became_active":"2023-10-06T11:13:30.380310+0000","last_became_peered":"2023-10-06T11:13:30.380310+0000","last_unstale":"2023-10-06T11:13:30.380606+0000","last_undegraded":"2023-10-06T11:13:30.380606+0000","last_fullsized":"2023-10-06T11:13:30.380606+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:12:50.942007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.391965+0000","last_change":"2023-10-06T11:13:30.391965+0000","last_active":"2023-10-06T11:13:30.391965+0000","last_peered":"2023-10-06T11:13:30.391965+0000","last_clean":"2023-10-06T11:13:30.391965+0000","last_became_active":"2023-10-06T11:13:30.390874+0000","last_became_peered":"2023-10-06T11:13:30.390874+0000","last_unstale":"2023-10-06T11:13:30.391965+0000","last_undegraded":"2023-10-06T11:13:30.391965+0000","last_fullsized":"2023-10-06T11:13:30.391965+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:06:29.231196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"100'4","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.975610+0000","last_change":"2023-10-06T11:13:29.981547+0000","last_active":"2023-10-06T11:13:30.975610+0000","last_peered":"2023-10-06T11:13:30.975610+0000","last_clean":"2023-10-06T11:13:30.975610+0000","last_became_active":"2023-10-06T11:13:29.981348+0000","last_became_peered":"2023-10-06T11:13:29.981348+0000","last_unstale":"2023-10-06T11:13:30.975610+0000","last_undegraded":"2023-10-06T11:13:30.975610+0000","last_fullsized":"2023-10-06T11:13:30.975610+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:07.786862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.387242+0000","last_change":"2023-10-06T11:13:30.387242+0000","last_active":"2023-10-06T11:13:30.387242+0000","last_peered":"2023-10-06T11:13:30.387242+0000","last_clean":"2023-10-06T11:13:30.387242+0000","last_became_active":"2023-10-06T11:13:30.387004+0000","last_became_peered":"2023-10-06T11:13:30.387004+0000","last_unstale":"2023-10-06T11:13:30.387242+0000","last_undegraded":"2023-10-06T11:13:30.387242+0000","last_fullsized":"2023-10-06T11:13:30.387242+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:46:56.498044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.1e","version":"100'1","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.375243+0000","last_change":"2023-10-06T11:13:29.977079+0000","last_active":"2023-10-06T11:13:30.375243+0000","last_peered":"2023-10-06T11:13:30.375243+0000","last_clean":"2023-10-06T11:13:30.375243+0000","last_became_active":"2023-10-06T11:13:29.976831+0000","last_became_peered":"2023-10-06T11:13:29.976831+0000","last_unstale":"2023-10-06T11:13:30.375243+0000","last_undegraded":"2023-10-06T11:13:30.375243+0000","last_fullsized":"2023-10-06T11:13:30.375243+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:23:37.266561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.393122+0000","last_change":"2023-10-06T11:13:30.389576+0000","last_active":"2023-10-06T11:13:30.393122+0000","last_peered":"2023-10-06T11:13:30.393122+0000","last_clean":"2023-10-06T11:13:30.393122+0000","last_became_active":"2023-10-06T11:13:30.389249+0000","last_became_peered":"2023-10-06T11:13:30.389249+0000","last_unstale":"2023-10-06T11:13:30.393122+0000","last_undegraded":"2023-10-06T11:13:30.393122+0000","last_fullsized":"2023-10-06T11:13:30.393122+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:17:29.316716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"100'2","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.974996+0000","last_change":"2023-10-06T11:13:29.971520+0000","last_active":"2023-10-06T11:13:30.974996+0000","last_peered":"2023-10-06T11:13:30.974996+0000","last_clean":"2023-10-06T11:13:30.974996+0000","last_became_active":"2023-10-06T11:13:29.971202+0000","last_became_peered":"2023-10-06T11:13:29.971202+0000","last_unstale":"2023-10-06T11:13:30.974996+0000","last_undegraded":"2023-10-06T11:13:30.974996+0000","last_fullsized":"2023-10-06T11:13:30.974996+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:20:04.640293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.386724+0000","last_change":"2023-10-06T11:13:30.386724+0000","last_active":"2023-10-06T11:13:30.386724+0000","last_peered":"2023-10-06T11:13:30.386724+0000","last_clean":"2023-10-06T11:13:30.386724+0000","last_became_active":"2023-10-06T11:13:30.386150+0000","last_became_peered":"2023-10-06T11:13:30.386150+0000","last_unstale":"2023-10-06T11:13:30.386724+0000","last_undegraded":"2023-10-06T11:13:30.386724+0000","last_fullsized":"2023-10-06T11:13:30.386724+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:38:53.530447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.1c","version":"100'2","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.969909+0000","last_change":"2023-10-06T11:13:29.979678+0000","last_active":"2023-10-06T11:13:30.969909+0000","last_peered":"2023-10-06T11:13:30.969909+0000","last_clean":"2023-10-06T11:13:30.969909+0000","last_became_active":"2023-10-06T11:13:29.979430+0000","last_became_peered":"2023-10-06T11:13:29.979430+0000","last_unstale":"2023-10-06T11:13:30.969909+0000","last_undegraded":"2023-10-06T11:13:30.969909+0000","last_fullsized":"2023-10-06T11:13:30.969909+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:04.233981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.388898+0000","last_change":"2023-10-06T11:13:30.388898+0000","last_active":"2023-10-06T11:13:30.388898+0000","last_peered":"2023-10-06T11:13:30.388898+0000","last_clean":"2023-10-06T11:13:30.388898+0000","last_became_active":"2023-10-06T11:13:30.388635+0000","last_became_peered":"2023-10-06T11:13:30.388635+0000","last_unstale":"2023-10-06T11:13:30.388898+0000","last_undegraded":"2023-10-06T11:13:30.388898+0000","last_fullsized":"2023-10-06T11:13:30.388898+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:39:21.876088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1b","version":"100'1","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.389056+0000","last_change":"2023-10-06T11:13:29.980674+0000","last_active":"2023-10-06T11:13:30.389056+0000","last_peered":"2023-10-06T11:13:30.389056+0000","last_clean":"2023-10-06T11:13:30.389056+0000","last_became_active":"2023-10-06T11:13:29.980391+0000","last_became_peered":"2023-10-06T11:13:29.980391+0000","last_unstale":"2023-10-06T11:13:30.389056+0000","last_undegraded":"2023-10-06T11:13:30.389056+0000","last_fullsized":"2023-10-06T11:13:30.389056+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:27:11.924253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.394863+0000","last_change":"2023-10-06T11:13:30.394863+0000","last_active":"2023-10-06T11:13:30.394863+0000","last_peered":"2023-10-06T11:13:30.394863+0000","last_clean":"2023-10-06T11:13:30.394863+0000","last_became_active":"2023-10-06T11:13:30.394653+0000","last_became_peered":"2023-10-06T11:13:30.394653+0000","last_unstale":"2023-10-06T11:13:30.394863+0000","last_undegraded":"2023-10-06T11:13:30.394863+0000","last_fullsized":"2023-10-06T11:13:30.394863+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:50:44.226066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"100'1","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.377944+0000","last_change":"2023-10-06T11:13:29.971477+0000","last_active":"2023-10-06T11:13:30.377944+0000","last_peered":"2023-10-06T11:13:30.377944+0000","last_clean":"2023-10-06T11:13:30.377944+0000","last_became_active":"2023-10-06T11:13:29.971206+0000","last_became_peered":"2023-10-06T11:13:29.971206+0000","last_unstale":"2023-10-06T11:13:30.377944+0000","last_undegraded":"2023-10-06T11:13:30.377944+0000","last_fullsized":"2023-10-06T11:13:30.377944+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:29:58.778143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.395751+0000","last_change":"2023-10-06T11:13:30.395751+0000","last_active":"2023-10-06T11:13:30.395751+0000","last_peered":"2023-10-06T11:13:30.395751+0000","last_clean":"2023-10-06T11:13:30.395751+0000","last_became_active":"2023-10-06T11:13:30.395524+0000","last_became_peered":"2023-10-06T11:13:30.395524+0000","last_unstale":"2023-10-06T11:13:30.395751+0000","last_undegraded":"2023-10-06T11:13:30.395751+0000","last_fullsized":"2023-10-06T11:13:30.395751+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:07:40.842113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.379762+0000","last_change":"2023-10-06T11:13:29.972713+0000","last_active":"2023-10-06T11:13:30.379762+0000","last_peered":"2023-10-06T11:13:30.379762+0000","last_clean":"2023-10-06T11:13:30.379762+0000","last_became_active":"2023-10-06T11:13:29.972454+0000","last_became_peered":"2023-10-06T11:13:29.972454+0000","last_unstale":"2023-10-06T11:13:30.379762+0000","last_undegraded":"2023-10-06T11:13:30.379762+0000","last_fullsized":"2023-10-06T11:13:30.379762+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:21:22.568319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.389141+0000","last_change":"2023-10-06T11:13:30.389141+0000","last_active":"2023-10-06T11:13:30.389141+0000","last_peered":"2023-10-06T11:13:30.389141+0000","last_clean":"2023-10-06T11:13:30.389141+0000","last_became_active":"2023-10-06T11:13:30.388890+0000","last_became_peered":"2023-10-06T11:13:30.388890+0000","last_unstale":"2023-10-06T11:13:30.389141+0000","last_undegraded":"2023-10-06T11:13:30.389141+0000","last_fullsized":"2023-10-06T11:13:30.389141+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:07:50.934263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T11:13:29.973980+0000","last_change":"2023-10-06T11:13:29.971882+0000","last_active":"2023-10-06T11:13:29.973980+0000","last_peered":"2023-10-06T11:13:29.973980+0000","last_clean":"2023-10-06T11:13:29.973980+0000","last_became_active":"2023-10-06T11:13:29.971628+0000","last_became_peered":"2023-10-06T11:13:29.971628+0000","last_unstale":"2023-10-06T11:13:29.973980+0000","last_undegraded":"2023-10-06T11:13:29.973980+0000","last_fullsized":"2023-10-06T11:13:29.973980+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:38:52.525794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.394481+0000","last_change":"2023-10-06T11:13:30.394481+0000","last_active":"2023-10-06T11:13:30.394481+0000","last_peered":"2023-10-06T11:13:30.394481+0000","last_clean":"2023-10-06T11:13:30.394481+0000","last_became_active":"2023-10-06T11:13:30.394225+0000","last_became_peered":"2023-10-06T11:13:30.394225+0000","last_unstale":"2023-10-06T11:13:30.394481+0000","last_undegraded":"2023-10-06T11:13:30.394481+0000","last_fullsized":"2023-10-06T11:13:30.394481+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:24.786989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.380417+0000","last_change":"2023-10-06T11:13:29.970304+0000","last_active":"2023-10-06T11:13:30.380417+0000","last_peered":"2023-10-06T11:13:30.380417+0000","last_clean":"2023-10-06T11:13:30.380417+0000","last_became_active":"2023-10-06T11:13:29.970040+0000","last_became_peered":"2023-10-06T11:13:29.970040+0000","last_unstale":"2023-10-06T11:13:30.380417+0000","last_undegraded":"2023-10-06T11:13:30.380417+0000","last_fullsized":"2023-10-06T11:13:30.380417+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:31:17.041129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.392732+0000","last_change":"2023-10-06T11:13:30.390112+0000","last_active":"2023-10-06T11:13:30.392732+0000","last_peered":"2023-10-06T11:13:30.392732+0000","last_clean":"2023-10-06T11:13:30.392732+0000","last_became_active":"2023-10-06T11:13:30.389788+0000","last_became_peered":"2023-10-06T11:13:30.389788+0000","last_unstale":"2023-10-06T11:13:30.392732+0000","last_undegraded":"2023-10-06T11:13:30.392732+0000","last_fullsized":"2023-10-06T11:13:30.392732+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:39:24.374688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T11:13:29.975270+0000","last_change":"2023-10-06T11:13:29.974426+0000","last_active":"2023-10-06T11:13:29.975270+0000","last_peered":"2023-10-06T11:13:29.975270+0000","last_clean":"2023-10-06T11:13:29.975270+0000","last_became_active":"2023-10-06T11:13:29.974187+0000","last_became_peered":"2023-10-06T11:13:29.974187+0000","last_unstale":"2023-10-06T11:13:29.975270+0000","last_undegraded":"2023-10-06T11:13:29.975270+0000","last_fullsized":"2023-10-06T11:13:29.975270+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:08:27.498099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.386019+0000","last_change":"2023-10-06T11:13:30.386019+0000","last_active":"2023-10-06T11:13:30.386019+0000","last_peered":"2023-10-06T11:13:30.386019+0000","last_clean":"2023-10-06T11:13:30.386019+0000","last_became_active":"2023-10-06T11:13:30.385761+0000","last_became_peered":"2023-10-06T11:13:30.385761+0000","last_unstale":"2023-10-06T11:13:30.386019+0000","last_undegraded":"2023-10-06T11:13:30.386019+0000","last_fullsized":"2023-10-06T11:13:30.386019+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:35:05.173549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.15","version":"100'3","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.971252+0000","last_change":"2023-10-06T11:13:29.975914+0000","last_active":"2023-10-06T11:13:30.971252+0000","last_peered":"2023-10-06T11:13:30.971252+0000","last_clean":"2023-10-06T11:13:30.971252+0000","last_became_active":"2023-10-06T11:13:29.975634+0000","last_became_peered":"2023-10-06T11:13:29.975634+0000","last_unstale":"2023-10-06T11:13:30.971252+0000","last_undegraded":"2023-10-06T11:13:30.971252+0000","last_fullsized":"2023-10-06T11:13:30.971252+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:31:17.041129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.392445+0000","last_change":"2023-10-06T11:13:30.389971+0000","last_active":"2023-10-06T11:13:30.392445+0000","last_peered":"2023-10-06T11:13:30.392445+0000","last_clean":"2023-10-06T11:13:30.392445+0000","last_became_active":"2023-10-06T11:13:30.389711+0000","last_became_peered":"2023-10-06T11:13:30.389711+0000","last_unstale":"2023-10-06T11:13:30.392445+0000","last_undegraded":"2023-10-06T11:13:30.392445+0000","last_fullsized":"2023-10-06T11:13:30.392445+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:08.791515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"100'6","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.973899+0000","last_change":"2023-10-06T11:13:29.975995+0000","last_active":"2023-10-06T11:13:30.973899+0000","last_peered":"2023-10-06T11:13:30.973899+0000","last_clean":"2023-10-06T11:13:30.973899+0000","last_became_active":"2023-10-06T11:13:29.975749+0000","last_became_peered":"2023-10-06T11:13:29.975749+0000","last_unstale":"2023-10-06T11:13:30.973899+0000","last_undegraded":"2023-10-06T11:13:30.973899+0000","last_fullsized":"2023-10-06T11:13:30.973899+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:38:56.281344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.387677+0000","last_change":"2023-10-06T11:13:30.387677+0000","last_active":"2023-10-06T11:13:30.387677+0000","last_peered":"2023-10-06T11:13:30.387677+0000","last_clean":"2023-10-06T11:13:30.387677+0000","last_became_active":"2023-10-06T11:13:30.387391+0000","last_became_peered":"2023-10-06T11:13:30.387391+0000","last_unstale":"2023-10-06T11:13:30.387677+0000","last_undegraded":"2023-10-06T11:13:30.387677+0000","last_fullsized":"2023-10-06T11:13:30.387677+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:20:05.644946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"100'2","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.970922+0000","last_change":"2023-10-06T11:13:29.978962+0000","last_active":"2023-10-06T11:13:30.970922+0000","last_peered":"2023-10-06T11:13:30.970922+0000","last_clean":"2023-10-06T11:13:30.970922+0000","last_became_active":"2023-10-06T11:13:29.978670+0000","last_became_peered":"2023-10-06T11:13:29.978670+0000","last_unstale":"2023-10-06T11:13:30.970922+0000","last_undegraded":"2023-10-06T11:13:30.970922+0000","last_fullsized":"2023-10-06T11:13:30.970922+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:54:33.781187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.390696+0000","last_change":"2023-10-06T11:13:30.390696+0000","last_active":"2023-10-06T11:13:30.390696+0000","last_peered":"2023-10-06T11:13:30.390696+0000","last_clean":"2023-10-06T11:13:30.390696+0000","last_became_active":"2023-10-06T11:13:30.390442+0000","last_became_peered":"2023-10-06T11:13:30.390442+0000","last_unstale":"2023-10-06T11:13:30.390696+0000","last_undegraded":"2023-10-06T11:13:30.390696+0000","last_fullsized":"2023-10-06T11:13:30.390696+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:27:12.928906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T11:13:29.975616+0000","last_change":"2023-10-06T11:13:29.974657+0000","last_active":"2023-10-06T11:13:29.975616+0000","last_peered":"2023-10-06T11:13:29.975616+0000","last_clean":"2023-10-06T11:13:29.975616+0000","last_became_active":"2023-10-06T11:13:29.974411+0000","last_became_peered":"2023-10-06T11:13:29.974411+0000","last_unstale":"2023-10-06T11:13:29.975616+0000","last_undegraded":"2023-10-06T11:13:29.975616+0000","last_fullsized":"2023-10-06T11:13:29.975616+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:39:23.370035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.384575+0000","last_change":"2023-10-06T11:13:30.384575+0000","last_active":"2023-10-06T11:13:30.384575+0000","last_peered":"2023-10-06T11:13:30.384575+0000","last_clean":"2023-10-06T11:13:30.384575+0000","last_became_active":"2023-10-06T11:13:30.384318+0000","last_became_peered":"2023-10-06T11:13:30.384318+0000","last_unstale":"2023-10-06T11:13:30.384575+0000","last_undegraded":"2023-10-06T11:13:30.384575+0000","last_fullsized":"2023-10-06T11:13:30.384575+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:32:55.745948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T11:13:29.981476+0000","last_change":"2023-10-06T11:13:29.979005+0000","last_active":"2023-10-06T11:13:29.981476+0000","last_peered":"2023-10-06T11:13:29.981476+0000","last_clean":"2023-10-06T11:13:29.981476+0000","last_became_active":"2023-10-06T11:13:29.978503+0000","last_became_peered":"2023-10-06T11:13:29.978503+0000","last_unstale":"2023-10-06T11:13:29.981476+0000","last_undegraded":"2023-10-06T11:13:29.981476+0000","last_fullsized":"2023-10-06T11:13:29.981476+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:02:33.885002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.395688+0000","last_change":"2023-10-06T11:13:30.395688+0000","last_active":"2023-10-06T11:13:30.395688+0000","last_peered":"2023-10-06T11:13:30.395688+0000","last_clean":"2023-10-06T11:13:30.395688+0000","last_became_active":"2023-10-06T11:13:30.395220+0000","last_became_peered":"2023-10-06T11:13:30.395220+0000","last_unstale":"2023-10-06T11:13:30.395688+0000","last_undegraded":"2023-10-06T11:13:30.395688+0000","last_fullsized":"2023-10-06T11:13:30.395688+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:18.575761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.10","version":"100'8","reported_seq":18,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.976268+0000","last_change":"2023-10-06T11:13:29.969015+0000","last_active":"2023-10-06T11:13:30.976268+0000","last_peered":"2023-10-06T11:13:30.976268+0000","last_clean":"2023-10-06T11:13:30.976268+0000","last_became_active":"2023-10-06T11:13:29.968750+0000","last_became_peered":"2023-10-06T11:13:29.968750+0000","last_unstale":"2023-10-06T11:13:30.976268+0000","last_undegraded":"2023-10-06T11:13:30.976268+0000","last_fullsized":"2023-10-06T11:13:30.976268+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:42:15.474932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.391193+0000","last_change":"2023-10-06T11:13:30.391193+0000","last_active":"2023-10-06T11:13:30.391193+0000","last_peered":"2023-10-06T11:13:30.391193+0000","last_clean":"2023-10-06T11:13:30.391193+0000","last_became_active":"2023-10-06T11:13:30.390807+0000","last_became_peered":"2023-10-06T11:13:30.390807+0000","last_unstale":"2023-10-06T11:13:30.391193+0000","last_undegraded":"2023-10-06T11:13:30.391193+0000","last_fullsized":"2023-10-06T11:13:30.391193+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:35:22.038954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.7","version":"100'2","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.970721+0000","last_change":"2023-10-06T11:13:29.982189+0000","last_active":"2023-10-06T11:13:30.970721+0000","last_peered":"2023-10-06T11:13:30.970721+0000","last_clean":"2023-10-06T11:13:30.970721+0000","last_became_active":"2023-10-06T11:13:29.981937+0000","last_became_peered":"2023-10-06T11:13:29.981937+0000","last_unstale":"2023-10-06T11:13:30.970721+0000","last_undegraded":"2023-10-06T11:13:30.970721+0000","last_fullsized":"2023-10-06T11:13:30.970721+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:45:31.082868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.392473+0000","last_change":"2023-10-06T11:13:30.386290+0000","last_active":"2023-10-06T11:13:30.392473+0000","last_peered":"2023-10-06T11:13:30.392473+0000","last_clean":"2023-10-06T11:13:30.392473+0000","last_became_active":"2023-10-06T11:13:30.386028+0000","last_became_peered":"2023-10-06T11:13:30.386028+0000","last_unstale":"2023-10-06T11:13:30.392473+0000","last_undegraded":"2023-10-06T11:13:30.392473+0000","last_fullsized":"2023-10-06T11:13:30.392473+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:36:24.487477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T11:13:29.977820+0000","last_change":"2023-10-06T11:13:29.977065+0000","last_active":"2023-10-06T11:13:29.977820+0000","last_peered":"2023-10-06T11:13:29.977820+0000","last_clean":"2023-10-06T11:13:29.977820+0000","last_became_active":"2023-10-06T11:13:29.976808+0000","last_became_peered":"2023-10-06T11:13:29.976808+0000","last_unstale":"2023-10-06T11:13:29.977820+0000","last_undegraded":"2023-10-06T11:13:29.977820+0000","last_fullsized":"2023-10-06T11:13:29.977820+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:12:56.805175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.394614+0000","last_change":"2023-10-06T11:13:30.394614+0000","last_active":"2023-10-06T11:13:30.394614+0000","last_peered":"2023-10-06T11:13:30.394614+0000","last_clean":"2023-10-06T11:13:30.394614+0000","last_became_active":"2023-10-06T11:13:30.394300+0000","last_became_peered":"2023-10-06T11:13:30.394300+0000","last_unstale":"2023-10-06T11:13:30.394614+0000","last_undegraded":"2023-10-06T11:13:30.394614+0000","last_fullsized":"2023-10-06T11:13:30.394614+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:28:28.429635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T11:13:29.980347+0000","last_change":"2023-10-06T11:13:29.979602+0000","last_active":"2023-10-06T11:13:29.980347+0000","last_peered":"2023-10-06T11:13:29.980347+0000","last_clean":"2023-10-06T11:13:29.980347+0000","last_became_active":"2023-10-06T11:13:29.979358+0000","last_became_peered":"2023-10-06T11:13:29.979358+0000","last_unstale":"2023-10-06T11:13:29.980347+0000","last_undegraded":"2023-10-06T11:13:29.980347+0000","last_fullsized":"2023-10-06T11:13:29.980347+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:34:49.944576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.392223+0000","last_change":"2023-10-06T11:13:30.392223+0000","last_active":"2023-10-06T11:13:30.392223+0000","last_peered":"2023-10-06T11:13:30.392223+0000","last_clean":"2023-10-06T11:13:30.392223+0000","last_became_active":"2023-10-06T11:13:30.391968+0000","last_became_peered":"2023-10-06T11:13:30.391968+0000","last_unstale":"2023-10-06T11:13:30.392223+0000","last_undegraded":"2023-10-06T11:13:30.392223+0000","last_fullsized":"2023-10-06T11:13:30.392223+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:39:24.374688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.384543+0000","last_change":"2023-10-06T11:13:29.981012+0000","last_active":"2023-10-06T11:13:30.384543+0000","last_peered":"2023-10-06T11:13:30.384543+0000","last_clean":"2023-10-06T11:13:30.384543+0000","last_became_active":"2023-10-06T11:13:29.980208+0000","last_became_peered":"2023-10-06T11:13:29.980208+0000","last_unstale":"2023-10-06T11:13:30.384543+0000","last_undegraded":"2023-10-06T11:13:30.384543+0000","last_fullsized":"2023-10-06T11:13:30.384543+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:14:45.004498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.386757+0000","last_change":"2023-10-06T11:13:30.386757+0000","last_active":"2023-10-06T11:13:30.386757+0000","last_peered":"2023-10-06T11:13:30.386757+0000","last_clean":"2023-10-06T11:13:30.386757+0000","last_became_active":"2023-10-06T11:13:30.386524+0000","last_became_peered":"2023-10-06T11:13:30.386524+0000","last_unstale":"2023-10-06T11:13:30.386757+0000","last_undegraded":"2023-10-06T11:13:30.386757+0000","last_fullsized":"2023-10-06T11:13:30.386757+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:38:00.939269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.379633+0000","last_change":"2023-10-06T11:13:29.981452+0000","last_active":"2023-10-06T11:13:30.379633+0000","last_peered":"2023-10-06T11:13:30.379633+0000","last_clean":"2023-10-06T11:13:30.379633+0000","last_became_active":"2023-10-06T11:13:29.981190+0000","last_became_peered":"2023-10-06T11:13:29.981190+0000","last_unstale":"2023-10-06T11:13:30.379633+0000","last_undegraded":"2023-10-06T11:13:30.379633+0000","last_fullsized":"2023-10-06T11:13:30.379633+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:31:17.318289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.384180+0000","last_change":"2023-10-06T11:13:30.384180+0000","last_active":"2023-10-06T11:13:30.384180+0000","last_peered":"2023-10-06T11:13:30.384180+0000","last_clean":"2023-10-06T11:13:30.384180+0000","last_became_active":"2023-10-06T11:13:30.383868+0000","last_became_peered":"2023-10-06T11:13:30.383868+0000","last_unstale":"2023-10-06T11:13:30.384180+0000","last_undegraded":"2023-10-06T11:13:30.384180+0000","last_fullsized":"2023-10-06T11:13:30.384180+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:38:57.906044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T11:13:29.981544+0000","last_change":"2023-10-06T11:13:29.979165+0000","last_active":"2023-10-06T11:13:29.981544+0000","last_peered":"2023-10-06T11:13:29.981544+0000","last_clean":"2023-10-06T11:13:29.981544+0000","last_became_active":"2023-10-06T11:13:29.978670+0000","last_became_peered":"2023-10-06T11:13:29.978670+0000","last_unstale":"2023-10-06T11:13:29.981544+0000","last_undegraded":"2023-10-06T11:13:29.981544+0000","last_fullsized":"2023-10-06T11:13:29.981544+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:40:13.133499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.395557+0000","last_change":"2023-10-06T11:13:30.395557+0000","last_active":"2023-10-06T11:13:30.395557+0000","last_peered":"2023-10-06T11:13:30.395557+0000","last_clean":"2023-10-06T11:13:30.395557+0000","last_became_active":"2023-10-06T11:13:30.394505+0000","last_became_peered":"2023-10-06T11:13:30.394505+0000","last_unstale":"2023-10-06T11:13:30.395557+0000","last_undegraded":"2023-10-06T11:13:30.395557+0000","last_fullsized":"2023-10-06T11:13:30.395557+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:57:05.858686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T11:13:29.980152+0000","last_change":"2023-10-06T11:13:29.978773+0000","last_active":"2023-10-06T11:13:29.980152+0000","last_peered":"2023-10-06T11:13:29.980152+0000","last_clean":"2023-10-06T11:13:29.980152+0000","last_became_active":"2023-10-06T11:13:29.978548+0000","last_became_peered":"2023-10-06T11:13:29.978548+0000","last_unstale":"2023-10-06T11:13:29.980152+0000","last_undegraded":"2023-10-06T11:13:29.980152+0000","last_fullsized":"2023-10-06T11:13:29.980152+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:25:43.648882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.387478+0000","last_change":"2023-10-06T11:13:30.387478+0000","last_active":"2023-10-06T11:13:30.387478+0000","last_peered":"2023-10-06T11:13:30.387478+0000","last_clean":"2023-10-06T11:13:30.387478+0000","last_became_active":"2023-10-06T11:13:30.387057+0000","last_became_peered":"2023-10-06T11:13:30.387057+0000","last_unstale":"2023-10-06T11:13:30.387478+0000","last_undegraded":"2023-10-06T11:13:30.387478+0000","last_fullsized":"2023-10-06T11:13:30.387478+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:33:08.791515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T11:13:29.981677+0000","last_change":"2023-10-06T11:13:29.978432+0000","last_active":"2023-10-06T11:13:29.981677+0000","last_peered":"2023-10-06T11:13:29.981677+0000","last_clean":"2023-10-06T11:13:29.981677+0000","last_became_active":"2023-10-06T11:13:29.978151+0000","last_became_peered":"2023-10-06T11:13:29.978151+0000","last_unstale":"2023-10-06T11:13:29.981677+0000","last_undegraded":"2023-10-06T11:13:29.981677+0000","last_fullsized":"2023-10-06T11:13:29.981677+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:29:14.670385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.390735+0000","last_change":"2023-10-06T11:13:30.390735+0000","last_active":"2023-10-06T11:13:30.390735+0000","last_peered":"2023-10-06T11:13:30.390735+0000","last_clean":"2023-10-06T11:13:30.390735+0000","last_became_active":"2023-10-06T11:13:30.390441+0000","last_became_peered":"2023-10-06T11:13:30.390441+0000","last_unstale":"2023-10-06T11:13:30.390735+0000","last_undegraded":"2023-10-06T11:13:30.390735+0000","last_fullsized":"2023-10-06T11:13:30.390735+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:36:54.963150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"100'2","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.970979+0000","last_change":"2023-10-06T11:13:29.975739+0000","last_active":"2023-10-06T11:13:30.970979+0000","last_peered":"2023-10-06T11:13:30.970979+0000","last_clean":"2023-10-06T11:13:30.970979+0000","last_became_active":"2023-10-06T11:13:29.975424+0000","last_became_peered":"2023-10-06T11:13:29.975424+0000","last_unstale":"2023-10-06T11:13:30.970979+0000","last_undegraded":"2023-10-06T11:13:30.970979+0000","last_fullsized":"2023-10-06T11:13:30.970979+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:49:43.940438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":88,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.379921+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:13:30.379921+0000","last_peered":"2023-10-06T11:13:30.379921+0000","last_clean":"2023-10-06T11:13:30.379921+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:13:30.379921+0000","last_undegraded":"2023-10-06T11:13:30.379921+0000","last_fullsized":"2023-10-06T11:13:30.379921+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.390891+0000","last_change":"2023-10-06T11:13:30.390891+0000","last_active":"2023-10-06T11:13:30.390891+0000","last_peered":"2023-10-06T11:13:30.390891+0000","last_clean":"2023-10-06T11:13:30.390891+0000","last_became_active":"2023-10-06T11:13:30.390646+0000","last_became_peered":"2023-10-06T11:13:30.390646+0000","last_unstale":"2023-10-06T11:13:30.390891+0000","last_undegraded":"2023-10-06T11:13:30.390891+0000","last_fullsized":"2023-10-06T11:13:30.390891+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:09:13.887600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T11:13:29.981695+0000","last_change":"2023-10-06T11:13:29.980961+0000","last_active":"2023-10-06T11:13:29.981695+0000","last_peered":"2023-10-06T11:13:29.981695+0000","last_clean":"2023-10-06T11:13:29.981695+0000","last_became_active":"2023-10-06T11:13:29.980716+0000","last_became_peered":"2023-10-06T11:13:29.980716+0000","last_unstale":"2023-10-06T11:13:29.981695+0000","last_undegraded":"2023-10-06T11:13:29.981695+0000","last_fullsized":"2023-10-06T11:13:29.981695+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:21:38.532006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":80,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T11:13:29.962434+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:13:29.962434+0000","last_peered":"2023-10-06T11:13:29.962434+0000","last_clean":"2023-10-06T11:13:29.962434+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:13:29.962434+0000","last_undegraded":"2023-10-06T11:13:29.962434+0000","last_fullsized":"2023-10-06T11:13:29.962434+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.392295+0000","last_change":"2023-10-06T11:13:30.392295+0000","last_active":"2023-10-06T11:13:30.392295+0000","last_peered":"2023-10-06T11:13:30.392295+0000","last_clean":"2023-10-06T11:13:30.392295+0000","last_became_active":"2023-10-06T11:13:30.391975+0000","last_became_peered":"2023-10-06T11:13:30.391975+0000","last_unstale":"2023-10-06T11:13:30.392295+0000","last_undegraded":"2023-10-06T11:13:30.392295+0000","last_fullsized":"2023-10-06T11:13:30.392295+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:34:53.315325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"100'1","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.388618+0000","last_change":"2023-10-06T11:13:29.976755+0000","last_active":"2023-10-06T11:13:30.388618+0000","last_peered":"2023-10-06T11:13:30.388618+0000","last_clean":"2023-10-06T11:13:30.388618+0000","last_became_active":"2023-10-06T11:13:29.976456+0000","last_became_peered":"2023-10-06T11:13:29.976456+0000","last_unstale":"2023-10-06T11:13:30.388618+0000","last_undegraded":"2023-10-06T11:13:30.388618+0000","last_fullsized":"2023-10-06T11:13:30.388618+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:20:04.640293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":80,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.384797+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:13:30.384797+0000","last_peered":"2023-10-06T11:13:30.384797+0000","last_clean":"2023-10-06T11:13:30.384797+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:13:30.384797+0000","last_undegraded":"2023-10-06T11:13:30.384797+0000","last_fullsized":"2023-10-06T11:13:30.384797+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":224,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T11:13:29.970910+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:13:29.970910+0000","last_peered":"2023-10-06T11:13:29.970910+0000","last_clean":"2023-10-06T11:13:29.970910+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:13:29.970910+0000","last_undegraded":"2023-10-06T11:13:29.970910+0000","last_fullsized":"2023-10-06T11:13:29.970910+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.391724+0000","last_change":"2023-10-06T11:13:30.387268+0000","last_active":"2023-10-06T11:13:30.391724+0000","last_peered":"2023-10-06T11:13:30.391724+0000","last_clean":"2023-10-06T11:13:30.391724+0000","last_became_active":"2023-10-06T11:13:30.387073+0000","last_became_peered":"2023-10-06T11:13:30.387073+0000","last_unstale":"2023-10-06T11:13:30.391724+0000","last_undegraded":"2023-10-06T11:13:30.391724+0000","last_fullsized":"2023-10-06T11:13:30.391724+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:07:40.842113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T11:13:29.980088+0000","last_change":"2023-10-06T11:13:29.978821+0000","last_active":"2023-10-06T11:13:29.980088+0000","last_peered":"2023-10-06T11:13:29.980088+0000","last_clean":"2023-10-06T11:13:29.980088+0000","last_became_active":"2023-10-06T11:13:29.978592+0000","last_became_peered":"2023-10-06T11:13:29.978592+0000","last_unstale":"2023-10-06T11:13:29.980088+0000","last_undegraded":"2023-10-06T11:13:29.980088+0000","last_fullsized":"2023-10-06T11:13:29.980088+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:37:10.667423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":74,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T11:13:29.970853+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:13:29.970853+0000","last_peered":"2023-10-06T11:13:29.970853+0000","last_clean":"2023-10-06T11:13:29.970853+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:13:29.970853+0000","last_undegraded":"2023-10-06T11:13:29.970853+0000","last_fullsized":"2023-10-06T11:13:29.970853+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.388398+0000","last_change":"2023-10-06T11:13:30.388398+0000","last_active":"2023-10-06T11:13:30.388398+0000","last_peered":"2023-10-06T11:13:30.388398+0000","last_clean":"2023-10-06T11:13:30.388398+0000","last_became_active":"2023-10-06T11:13:30.386541+0000","last_became_peered":"2023-10-06T11:13:30.386541+0000","last_unstale":"2023-10-06T11:13:30.388398+0000","last_undegraded":"2023-10-06T11:13:30.388398+0000","last_fullsized":"2023-10-06T11:13:30.388398+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:42:16.479585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.e","version":"100'2","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.973793+0000","last_change":"2023-10-06T11:13:29.979820+0000","last_active":"2023-10-06T11:13:30.973793+0000","last_peered":"2023-10-06T11:13:30.973793+0000","last_clean":"2023-10-06T11:13:30.973793+0000","last_became_active":"2023-10-06T11:13:29.979591+0000","last_became_peered":"2023-10-06T11:13:29.979591+0000","last_unstale":"2023-10-06T11:13:30.973793+0000","last_undegraded":"2023-10-06T11:13:30.973793+0000","last_fullsized":"2023-10-06T11:13:30.973793+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:37:44.776593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":74,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T11:13:29.971000+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:13:29.971000+0000","last_peered":"2023-10-06T11:13:29.971000+0000","last_clean":"2023-10-06T11:13:29.971000+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:13:29.971000+0000","last_undegraded":"2023-10-06T11:13:29.971000+0000","last_fullsized":"2023-10-06T11:13:29.971000+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.388438+0000","last_change":"2023-10-06T11:13:30.388438+0000","last_active":"2023-10-06T11:13:30.388438+0000","last_peered":"2023-10-06T11:13:30.388438+0000","last_clean":"2023-10-06T11:13:30.388438+0000","last_became_active":"2023-10-06T11:13:30.388235+0000","last_became_peered":"2023-10-06T11:13:30.388235+0000","last_unstale":"2023-10-06T11:13:30.388438+0000","last_undegraded":"2023-10-06T11:13:30.388438+0000","last_fullsized":"2023-10-06T11:13:30.388438+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:56:06.842858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.f","version":"100'1","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.387287+0000","last_change":"2023-10-06T11:13:29.978748+0000","last_active":"2023-10-06T11:13:30.387287+0000","last_peered":"2023-10-06T11:13:30.387287+0000","last_clean":"2023-10-06T11:13:30.387287+0000","last_became_active":"2023-10-06T11:13:29.978467+0000","last_became_peered":"2023-10-06T11:13:29.978467+0000","last_unstale":"2023-10-06T11:13:30.387287+0000","last_undegraded":"2023-10-06T11:13:30.387287+0000","last_fullsized":"2023-10-06T11:13:30.387287+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:27:02.067978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":90,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T11:13:29.965821+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:13:29.965821+0000","last_peered":"2023-10-06T11:13:29.965821+0000","last_clean":"2023-10-06T11:13:29.965821+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:13:29.965821+0000","last_undegraded":"2023-10-06T11:13:29.965821+0000","last_fullsized":"2023-10-06T11:13:29.965821+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.384151+0000","last_change":"2023-10-06T11:13:30.384151+0000","last_active":"2023-10-06T11:13:30.384151+0000","last_peered":"2023-10-06T11:13:30.384151+0000","last_clean":"2023-10-06T11:13:30.384151+0000","last_became_active":"2023-10-06T11:13:30.383904+0000","last_became_peered":"2023-10-06T11:13:30.383904+0000","last_unstale":"2023-10-06T11:13:30.384151+0000","last_undegraded":"2023-10-06T11:13:30.384151+0000","last_fullsized":"2023-10-06T11:13:30.384151+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:27:17.128505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T11:13:29.983063+0000","last_change":"2023-10-06T11:13:29.982448+0000","last_active":"2023-10-06T11:13:29.983063+0000","last_peered":"2023-10-06T11:13:29.983063+0000","last_clean":"2023-10-06T11:13:29.983063+0000","last_became_active":"2023-10-06T11:13:29.981491+0000","last_became_peered":"2023-10-06T11:13:29.981491+0000","last_unstale":"2023-10-06T11:13:29.983063+0000","last_undegraded":"2023-10-06T11:13:29.983063+0000","last_fullsized":"2023-10-06T11:13:29.983063+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:52:20.161716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":80,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T11:13:29.977904+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:13:29.977904+0000","last_peered":"2023-10-06T11:13:29.977904+0000","last_clean":"2023-10-06T11:13:29.977904+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:13:29.977904+0000","last_undegraded":"2023-10-06T11:13:29.977904+0000","last_fullsized":"2023-10-06T11:13:29.977904+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":8,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-06T11:13:30.394495+0000","last_change":"2023-10-06T11:13:30.394495+0000","last_active":"2023-10-06T11:13:30.394495+0000","last_peered":"2023-10-06T11:13:30.394495+0000","last_clean":"2023-10-06T11:13:30.394495+0000","last_became_active":"2023-10-06T11:13:30.394244+0000","last_became_peered":"2023-10-06T11:13:30.394244+0000","last_unstale":"2023-10-06T11:13:30.394495+0000","last_undegraded":"2023-10-06T11:13:30.394495+0000","last_fullsized":"2023-10-06T11:13:30.394495+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:29.956621+0000","last_clean_scrub_stamp":"2023-10-06T11:13:29.956621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:36:24.487477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T11:13:29.980925+0000","last_change":"2023-10-06T11:13:29.979177+0000","last_active":"2023-10-06T11:13:29.980925+0000","last_peered":"2023-10-06T11:13:29.980925+0000","last_clean":"2023-10-06T11:13:29.980925+0000","last_became_active":"2023-10-06T11:13:29.978951+0000","last_became_peered":"2023-10-06T11:13:29.978951+0000","last_unstale":"2023-10-06T11:13:29.980925+0000","last_undegraded":"2023-10-06T11:13:29.980925+0000","last_fullsized":"2023-10-06T11:13:29.980925+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:13:28.951968+0000","last_clean_scrub_stamp":"2023-10-06T11:13:28.951968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:31:27.255104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":80,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-06T11:13:29.977634+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:13:29.977634+0000","last_peered":"2023-10-06T11:13:29.977634+0000","last_clean":"2023-10-06T11:13:29.977634+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:13:29.977634+0000","last_undegraded":"2023-10-06T11:13:29.977634+0000","last_fullsized":"2023-10-06T11:13:29.977634+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":16,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574946,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311364,"kb_used_data":1788,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060476,"statfs":{"total":96636764160,"available":96317927424,"internally_reserved":0,"allocated":1830912,"data_stored":1153705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.88100000000000001,"15min":0.60999999999999999},"min":{"1min":0.371,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.77800000000000002,"5min":23.908999999999999,"15min":23.908999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.69799999999999995,"15min":0.58099999999999996},"min":{"1min":0.27700000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.69799999999999995,"5min":9.3230000000000004,"15min":9.3230000000000004},"last":0.53500000000000003}]},{"osd":1,"last update":"Fri Oct 6 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.61599999999999999,"15min":0.55700000000000005},"min":{"1min":0.30299999999999999,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.71799999999999997,"5min":9.2360000000000007,"15min":9.2360000000000007},"last":0.624},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52800000000000002,"15min":0.50700000000000001},"min":{"1min":0.36599999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.78900000000000003,"5min":4.327,"15min":4.327},"last":0.45900000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.50600000000000001,"15min":0.503},"min":{"1min":0.33000000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.77200000000000002,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.435},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.58999999999999997,"15min":0.55000000000000004},"min":{"1min":0.31,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.76400000000000001,"5min":4.7309999999999999,"15min":4.7309999999999999},"last":0.58399999999999996}]},{"osd":3,"last update":"Fri Oct 6 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57899999999999996,"15min":0.52000000000000002},"min":{"1min":0.42799999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.75,"5min":4.3540000000000001,"15min":4.3540000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.65900000000000003,"15min":0.58999999999999997},"min":{"1min":0.36599999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.74299999999999999,"5min":9.3879999999999999,"15min":9.3879999999999999},"last":0.49099999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.50700000000000001,"15min":0.47099999999999997},"min":{"1min":0.32400000000000001,"5min":0.25,"15min":0.24399999999999999},"max":{"1min":0.65300000000000002,"5min":4.5709999999999997,"15min":4.5709999999999997},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.52600000000000002,"15min":0.52100000000000002},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.73399999999999999,"5min":4.3129999999999997,"15min":4.3129999999999997},"last":0.55300000000000005}]},{"osd":5,"last update":"Fri Oct 6 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.60299999999999998,"15min":0.56299999999999994},"min":{"1min":0.33600000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.72099999999999997,"5min":9.3499999999999996,"15min":9.3499999999999996},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.54800000000000004,"15min":0.54900000000000004},"min":{"1min":0.378,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.83399999999999996,"5min":4.444,"15min":4.444},"last":0.51900000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.64200000000000002,"15min":0.60299999999999998},"min":{"1min":0.42799999999999999,"5min":0.32400000000000001,"15min":0.29199999999999998},"max":{"1min":0.754,"5min":9.4969999999999999,"15min":9.4969999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.64000000000000001,"15min":0.60799999999999998},"min":{"1min":0.40600000000000003,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.80800000000000005,"5min":7.2039999999999997,"15min":7.2039999999999997},"last":0.47999999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574948,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306704,"kb_used_data":1224,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065136,"statfs":{"total":96636764160,"available":96322699264,"internally_reserved":0,"allocated":1253376,"data_stored":564096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:12:48 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.49299999999999999,"15min":0.49199999999999999},"min":{"1min":0.28399999999999997,"5min":0.187,"15min":0.187},"max":{"1min":0.71999999999999997,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.53100000000000003,"15min":0.53000000000000003},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.78600000000000003,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.56200000000000006}]},{"osd":1,"last update":"Fri Oct 6 11:12:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.48099999999999998,"15min":0.49099999999999999},"min":{"1min":0.26800000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.54300000000000004,"15min":0.51200000000000001},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":5.2670000000000003,"5min":5.2670000000000003,"15min":5.2670000000000003},"last":0.52800000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:12:48 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.54800000000000004,"15min":0.498},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.753,"5min":7.0659999999999998,"15min":7.0659999999999998},"last":0.443},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.55400000000000005,"15min":0.52000000000000002},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":1.0069999999999999,"5min":7.0819999999999999,"15min":7.0819999999999999},"last":0.51500000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:12:48 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.52100000000000002,"15min":0.499},"min":{"1min":0.317,"5min":0.317,"15min":0.25800000000000001},"max":{"1min":0.69499999999999995,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53600000000000003,"15min":0.53300000000000003},"min":{"1min":0.33700000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.83999999999999997},"last":0.5}]},{"osd":4,"last update":"Fri Oct 6 11:12:48 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.45200000000000001,"15min":0.48799999999999999},"min":{"1min":0.313,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.502,"15min":0.54500000000000004},"min":{"1min":0.34599999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.75800000000000001,"5min":0.81100000000000005,"15min":1.0680000000000001},"last":0.40899999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:12:48 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.497,"15min":0.52200000000000002},"min":{"1min":0.34599999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.747,"5min":0.754,"15min":0.754},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.54000000000000004,"15min":0.56899999999999995},"min":{"1min":0.36199999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.94799999999999995,"5min":1.034,"15min":1.034},"last":0.47699999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:12:48 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.55500000000000005,"15min":0.56699999999999995},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.80100000000000005,"5min":0.84899999999999998,"15min":0.98899999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57099999999999995,"15min":0.59199999999999997},"min":{"1min":0.442,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.79100000000000004,"5min":0.83899999999999997,"15min":0.88400000000000001},"last":0.53800000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574947,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307284,"kb_used_data":1804,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064556,"statfs":{"total":96636764160,"available":96322105344,"internally_reserved":0,"allocated":1847296,"data_stored":1160380,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.32000000000000001,"15min":0.33300000000000002},"min":{"1min":0.20899999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.41099999999999998,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.34899999999999998,"15min":0.34399999999999997},"min":{"1min":0.22500000000000001,"5min":0.215,"15min":0.19700000000000001},"max":{"1min":0.436,"5min":0.625,"15min":0.625},"last":0.32000000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.33800000000000002,"15min":0.33400000000000002},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.49199999999999999,"5min":1.351,"15min":1.351},"last":0.248},{"interface":"front","average":{"1min":0.38,"5min":0.39600000000000002,"15min":0.38600000000000001},"min":{"1min":0.26100000000000001,"5min":0.22800000000000001,"15min":0.20999999999999999},"max":{"1min":0.56999999999999995,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.30499999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.40300000000000002,"15min":0.40600000000000003},"min":{"1min":0.27500000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.51700000000000002,"5min":0.68999999999999995,"15min":0.72399999999999998},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.379,"5min":0.38100000000000001,"15min":0.36899999999999999},"min":{"1min":0.246,"5min":0.217,"15min":0.217},"max":{"1min":0.52800000000000002,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.23400000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.53500000000000003,"15min":0.51000000000000001},"min":{"1min":0.29799999999999999,"5min":0.29499999999999998,"15min":0.28199999999999997},"max":{"1min":0.751,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.442},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56999999999999995,"15min":0.54300000000000004},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.74399999999999999,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.39900000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56899999999999995,"15min":0.55000000000000004},"min":{"1min":0.36099999999999999,"5min":0.34000000000000002,"15min":0.33500000000000002},"max":{"1min":0.77700000000000002,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56599999999999995,"15min":0.54200000000000004},"min":{"1min":0.39200000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.76400000000000001,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.41299999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58999999999999997,"15min":0.56599999999999995},"min":{"1min":0.38300000000000001,"5min":0.34999999999999998,"15min":0.315},"max":{"1min":0.81999999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.60399999999999998,"15min":0.57699999999999996},"min":{"1min":0.44900000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.79300000000000004,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.379}]},{"osd":7,"last update":"Fri Oct 6 11:12:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.60899999999999999,"15min":0.58899999999999997},"min":{"1min":0.42999999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.90900000000000003},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59199999999999997,"15min":0.58099999999999996},"min":{"1min":0.44600000000000001,"5min":0.378,"15min":0.374},"max":{"1min":0.79500000000000004,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.38900000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574946,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298492,"kb_used_data":1204,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073348,"statfs":{"total":96636764160,"available":96331108352,"internally_reserved":0,"allocated":1232896,"data_stored":561984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.745,"15min":0.46999999999999997},"min":{"1min":0.20499999999999999,"5min":0.184,"15min":0.184},"max":{"1min":0.64900000000000002,"5min":36.097999999999999,"15min":36.097999999999999},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.45700000000000002,"15min":0.378},"min":{"1min":0.26200000000000001,"5min":0.182,"15min":0.182},"max":{"1min":0.70699999999999996,"5min":7.2990000000000004,"15min":7.2990000000000004},"last":0.41699999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.77700000000000002,"15min":0.51000000000000001},"min":{"1min":0.308,"5min":0.217,"15min":0.217},"max":{"1min":0.82599999999999996,"5min":36.07,"15min":36.07},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.48499999999999999,"15min":0.40500000000000003},"min":{"1min":0.25600000000000001,"5min":0.23200000000000001,"15min":0.219},"max":{"1min":0.60399999999999998,"5min":6.7800000000000002,"15min":6.7800000000000002},"last":0.46100000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.45300000000000001,"15min":0.40000000000000002},"min":{"1min":0.28399999999999997,"5min":0.223,"15min":0.223},"max":{"1min":0.64100000000000001,"5min":8.4130000000000003,"15min":8.4130000000000003},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.81399999999999995,"15min":0.56399999999999995},"min":{"1min":0.29499999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.626,"5min":35.959000000000003,"15min":35.959000000000003},"last":0.377}]},{"osd":4,"last update":"Fri Oct 6 11:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.57399999999999995,"15min":0.56299999999999994},"min":{"1min":0.38400000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.88,"5min":2.427,"15min":2.427},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.98699999999999999,"15min":0.73699999999999999},"min":{"1min":0.41899999999999998,"5min":0.34399999999999997,"15min":0.29299999999999998},"max":{"1min":0.91700000000000004,"5min":36.005000000000003,"15min":36.005000000000003},"last":0.40600000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.63600000000000001,"15min":0.57699999999999996},"min":{"1min":0.45100000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.99399999999999999,"5min":6.6699999999999999,"15min":6.6699999999999999},"last":0.622},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57399999999999995,"15min":0.55100000000000005},"min":{"1min":0.38400000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.88500000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.39900000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.98899999999999999,"15min":0.73599999999999999},"min":{"1min":0.39700000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.94599999999999995,"5min":36.037999999999997,"15min":36.037999999999997},"last":0.504},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.70599999999999996,"15min":0.63600000000000001},"min":{"1min":0.47999999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93700000000000006,"5min":6.7110000000000003,"15min":6.7110000000000003},"last":0.65700000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:12:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.66600000000000004,"15min":0.623},"min":{"1min":0.40999999999999998,"5min":0.371,"15min":0.371},"max":{"1min":0.90200000000000002,"5min":6.742,"15min":6.742},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.629,"5min":0.59199999999999997,"15min":0.56799999999999995},"min":{"1min":0.42199999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.92600000000000005,"5min":1.917,"15min":1.917},"last":0.45300000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574947,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310780,"kb_used_data":1204,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94061060,"statfs":{"total":96636764160,"available":96318525440,"internally_reserved":0,"allocated":1232896,"data_stored":561984,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.317,"15min":0.311},"min":{"1min":0.23499999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.39100000000000001,"5min":0.56699999999999995,"15min":0.57499999999999996},"last":0.308},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.38900000000000001,"15min":0.38500000000000001},"min":{"1min":0.29299999999999998,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.55600000000000005,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.39900000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.38,"15min":0.375},"min":{"1min":0.27500000000000002,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.52200000000000002,"5min":0.745,"15min":0.745},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36099999999999999,"15min":0.34999999999999998},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.52900000000000003,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.371}]},{"osd":3,"last update":"Fri Oct 6 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.375,"15min":0.371},"min":{"1min":0.29699999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.57699999999999996,"5min":0.629,"15min":0.629},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36199999999999999,"15min":0.36499999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.49099999999999999,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.41299999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.53400000000000003,"15min":0.53100000000000003},"min":{"1min":0.35599999999999998,"5min":0.313,"15min":0.30299999999999999},"max":{"1min":0.80400000000000005,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54100000000000004,"15min":0.55200000000000005},"min":{"1min":0.28299999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.71099999999999997,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.72499999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.54500000000000004,"15min":0.54600000000000004},"min":{"1min":0.38300000000000001,"5min":0.33100000000000002,"15min":0.32400000000000001},"max":{"1min":0.80400000000000005,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.57099999999999995,"15min":0.55500000000000005},"min":{"1min":0.44800000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.872,"5min":0.878,"15min":0.878},"last":0.69099999999999995}]},{"osd":6,"last update":"Fri Oct 6 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.40300000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.84599999999999997,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.42799999999999999,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.83499999999999996,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.63900000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58199999999999996,"15min":0.55700000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.58499999999999996,"15min":0.57099999999999995},"min":{"1min":0.38800000000000001,"5min":0.38600000000000001,"15min":0.38200000000000001},"max":{"1min":0.89600000000000002,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.65800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574947,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302592,"kb_used_data":1208,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069248,"statfs":{"total":96636764160,"available":96326909952,"internally_reserved":0,"allocated":1236992,"data_stored":562538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.318,"15min":0.32300000000000001},"min":{"1min":0.19600000000000001,"5min":0.183,"15min":0.183},"max":{"1min":0.48099999999999998,"5min":0.48799999999999999,"15min":1.095},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.376,"5min":0.35699999999999998,"15min":0.38800000000000001},"min":{"1min":0.27000000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.50900000000000001,"5min":0.53900000000000003,"15min":1.7210000000000001},"last":0.27900000000000003}]},{"osd":1,"last update":"Fri Oct 6 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.32000000000000001,"15min":0.31},"min":{"1min":0.251,"5min":0.217,"15min":0.217},"max":{"1min":0.45700000000000002,"5min":0.48199999999999998,"15min":0.65400000000000003},"last":0.247},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34499999999999997,"15min":0.36199999999999999},"min":{"1min":0.23400000000000001,"5min":0.188,"15min":0.188},"max":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":1.196},"last":0.29999999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.36099999999999999,"15min":0.38200000000000001},"min":{"1min":0.23400000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":1.7729999999999999},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.42399999999999999,"5min":0.40100000000000002,"15min":0.41499999999999998},"min":{"1min":0.32600000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.57399999999999995,"5min":0.58599999999999997,"15min":1.224},"last":0.35899999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53000000000000003,"15min":0.55800000000000005},"min":{"1min":0.33800000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.77600000000000002,"5min":0.92500000000000004,"15min":1.694},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.53700000000000003,"15min":0.53900000000000003},"min":{"1min":0.36799999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.72399999999999998,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.437}]},{"osd":5,"last update":"Fri Oct 6 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55600000000000005,"15min":0.52800000000000002},"min":{"1min":0.34399999999999997,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.79000000000000004,"5min":0.878,"15min":0.878},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55300000000000005,"15min":0.55900000000000005},"min":{"1min":0.40000000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.69799999999999995,"5min":0.82199999999999995,"15min":1.165},"last":0.52000000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56899999999999995,"15min":0.58299999999999996},"min":{"1min":0.38,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.69499999999999995,"5min":0.89900000000000002,"15min":1.1359999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57899999999999996,"15min":0.59399999999999997},"min":{"1min":0.38800000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80300000000000005,"5min":0.83399999999999996,"15min":1.7470000000000001},"last":0.57199999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:12:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56699999999999995,"15min":0.58499999999999996},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35599999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":1.657},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57699999999999996,"15min":0.57199999999999995},"min":{"1min":0.439,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.76300000000000001,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.49099999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574946,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298516,"kb_used_data":1228,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073324,"statfs":{"total":96636764160,"available":96331083776,"internally_reserved":0,"allocated":1257472,"data_stored":570070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:12:49 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.46400000000000002,"15min":0.55700000000000005},"min":{"1min":0.20799999999999999,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":2.6619999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.496,"15min":0.497},"min":{"1min":0.27300000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.68799999999999994}]},{"osd":1,"last update":"Fri Oct 6 11:12:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.47599999999999998,"15min":0.57899999999999996},"min":{"1min":0.26200000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.752,"5min":0.752,"15min":2.8650000000000002},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.48899999999999999,"15min":0.58499999999999996},"min":{"1min":0.28699999999999998,"5min":0.26200000000000001,"15min":0.25800000000000001},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":2.7610000000000001},"last":0.71099999999999997}]},{"osd":2,"last update":"Fri Oct 6 11:12:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.49199999999999999,"15min":0.55500000000000005},"min":{"1min":0.29799999999999999,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.76000000000000001,"5min":0.78200000000000003,"15min":1.6910000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.55700000000000005,"15min":0.59899999999999998},"min":{"1min":0.31,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":1.718},"last":0.74299999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:12:49 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.53000000000000003,"15min":0.60999999999999999},"min":{"1min":0.32500000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.79000000000000004,"5min":0.83099999999999996,"15min":2.677},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.52200000000000002,"15min":0.52300000000000002},"min":{"1min":0.374,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.61499999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:12:49 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.47299999999999998,"15min":0.48999999999999999},"min":{"1min":0.314,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51700000000000002,"15min":0.53700000000000003},"min":{"1min":0.34699999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.505}]},{"osd":6,"last update":"Fri Oct 6 11:12:49 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.51300000000000001,"15min":0.52700000000000002},"min":{"1min":0.39700000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.53800000000000003,"15min":0.57699999999999996},"min":{"1min":0.40300000000000002,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.85799999999999998,"5min":0.86899999999999999,"15min":1.165},"last":0.54200000000000004}]},{"osd":7,"last update":"Fri Oct 6 11:12:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.56899999999999995,"15min":0.56100000000000005},"min":{"1min":0.39000000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.57999999999999996,"15min":0.60299999999999998},"min":{"1min":0.433,"5min":0.317,"15min":0.317},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.67100000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574948,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306688,"kb_used_data":1208,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94065152,"statfs":{"total":96636764160,"available":96322715648,"internally_reserved":0,"allocated":1236992,"data_stored":563337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:12:52 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.47999999999999998,"15min":0.65000000000000002},"min":{"1min":0.23499999999999999,"5min":0.23100000000000001,"15min":0.20499999999999999},"max":{"1min":0.70899999999999996,"5min":0.72599999999999998,"15min":5.0490000000000004},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.46899999999999997,"15min":0.624},"min":{"1min":0.36499999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":5.1449999999999996},"last":0.61899999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:12:52 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.48299999999999998,"15min":0.48899999999999999},"min":{"1min":0.33700000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.97199999999999998},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.499,"15min":0.52000000000000002},"min":{"1min":0.28100000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.68999999999999995,"5min":0.70999999999999996,"15min":1.8799999999999999},"last":0.56699999999999995}]},{"osd":2,"last update":"Fri Oct 6 11:12:52 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.53200000000000003,"15min":0.55900000000000005},"min":{"1min":0.33000000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.79800000000000004,"5min":0.81799999999999995,"15min":4.234},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.55000000000000004,"15min":0.56899999999999995},"min":{"1min":0.38300000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":1.0369999999999999},"last":0.60599999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:12:52 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.50800000000000001,"15min":0.67000000000000004},"min":{"1min":0.41399999999999998,"5min":0.29299999999999998,"15min":0.27700000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":5.2169999999999996},"last":0.505},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.53600000000000003,"15min":0.54800000000000004},"min":{"1min":0.32600000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.751,"5min":0.83399999999999996,"15min":1.008},"last":0.54500000000000004}]},{"osd":4,"last update":"Fri Oct 6 11:12:52 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.48099999999999998,"15min":0.52100000000000002},"min":{"1min":0.30199999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.70399999999999996,"5min":0.871,"15min":1.917},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.499,"5min":0.48799999999999999,"15min":0.53400000000000003},"min":{"1min":0.34999999999999998,"5min":0.24399999999999999,"15min":0.23899999999999999},"max":{"1min":0.64700000000000002,"5min":0.85499999999999998,"15min":0.87},"last":0.67100000000000004}]},{"osd":6,"last update":"Fri Oct 6 11:12:52 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.51400000000000001,"15min":0.56299999999999994},"min":{"1min":0.372,"5min":0.316,"15min":0.316},"max":{"1min":0.68899999999999995,"5min":0.89500000000000002,"15min":2.0139999999999998},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.56599999999999995,"15min":0.61199999999999999},"min":{"1min":0.39700000000000002,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.82899999999999996,"5min":0.92300000000000004,"15min":1.9470000000000001},"last":0.751}]},{"osd":7,"last update":"Fri Oct 6 11:12:52 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.54000000000000004,"15min":0.58699999999999997},"min":{"1min":0.41099999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.79500000000000004,"5min":0.84299999999999997,"15min":0.96499999999999997},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57099999999999995,"15min":0.61199999999999999},"min":{"1min":0.42199999999999999,"5min":0.316,"15min":0.28799999999999998},"max":{"1min":0.72599999999999998,"5min":0.93899999999999995,"15min":1.4119999999999999},"last":0.76300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:13:35.414 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T11:13:35.414 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T11:13:35.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.566+0000 7f92c8937700 1 Processor -- start 2023-10-06T11:13:35.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.566+0000 7f92c8937700 1 -- start start 2023-10-06T11:13:35.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.567+0000 7f92c8937700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f92c4159880 0x7f92c40b2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:35.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.567+0000 7f92c8937700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f92c4159c50 0x7f92c40b0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:35.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.567+0000 7f92c8937700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92c406f7d0 con 0x7f92c406e670 2023-10-06T11:13:35.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.567+0000 7f92c8937700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c406ebc0 con 0x7f92c4159c50 2023-10-06T11:13:35.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.567+0000 7f92c8937700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c406eea0 con 0x7f92c4159880 2023-10-06T11:13:35.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.567+0000 7f92b9d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f92c4159c50 0x7f92c40b0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:35.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.567+0000 7f92b9d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f92c4159c50 0x7f92c40b0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33592/0 (socket says 172.21.15.146:33592) 2023-10-06T11:13:35.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.567+0000 7f92c2d9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f92c406e670 0x7f92c415d570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35950/0 (socket says 172.21.15.146:35950) 2023-10-06T11:13:35.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.567+0000 7f92b9d9b700 1 -- 172.21.15.146:0/2268785192 learned_addr learned my addr 172.21.15.146:0/2268785192 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:35.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.567+0000 7f92c259c700 1 --2- 172.21.15.146:0/2268785192 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f92c4159880 0x7f92c40b2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:35.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.568+0000 7f92b9d9b700 1 -- 172.21.15.146:0/2268785192 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f92c4159880 msgr2=0x7f92c40b2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:35.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.568+0000 7f92b9d9b700 1 --2- 172.21.15.146:0/2268785192 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f92c4159880 0x7f92c40b2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.568+0000 7f92b9d9b700 1 -- 172.21.15.146:0/2268785192 >> v1:172.21.15.146:6789/0 conn(0x7f92c406e670 legacy=0x7f92c415d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:35.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.568+0000 7f92b9d9b700 1 -- 172.21.15.146:0/2268785192 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c406f180 con 0x7f92c4159c50 2023-10-06T11:13:35.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.568+0000 7f92c1d9b700 1 -- 172.21.15.146:0/2268785192 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1124535147 0 0) 0x7f92c406f7d0 con 0x7f92c406e670 2023-10-06T11:13:35.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.568+0000 7f92b9d9b700 1 --2- 172.21.15.146:0/2268785192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92c4159c50 0x7f92c40b0a80 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f92ac0099b0 tx=0x7f92ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c3036dc322b83e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:35.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.568+0000 7f92c1d9b700 1 -- 172.21.15.146:0/2268785192 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ac00b860 con 0x7f92c4159c50 2023-10-06T11:13:35.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.568+0000 7f92c1d9b700 1 -- 172.21.15.146:0/2268785192 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92ac00b9c0 con 0x7f92c4159c50 2023-10-06T11:13:35.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.568+0000 7f92c1d9b700 1 -- 172.21.15.146:0/2268785192 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ac00bd60 con 0x7f92c4159c50 2023-10-06T11:13:35.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.568+0000 7f92c8937700 1 -- 172.21.15.146:0/2268785192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92c4159c50 msgr2=0x7f92c40b0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:35.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.568+0000 7f92c8937700 1 --2- 172.21.15.146:0/2268785192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92c4159c50 0x7f92c40b0a80 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f92ac0099b0 tx=0x7f92ac009250 comp rx=0 tx=0).stop 2023-10-06T11:13:35.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.568+0000 7f92c8937700 1 -- 172.21.15.146:0/2268785192 shutdown_connections 2023-10-06T11:13:35.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.568+0000 7f92c8937700 1 --2- 172.21.15.146:0/2268785192 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f92c4159880 0x7f92c40b2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.568+0000 7f92c8937700 1 --2- 172.21.15.146:0/2268785192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92c4159c50 0x7f92c40b0a80 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.568+0000 7f92c8937700 1 -- 172.21.15.146:0/2268785192 >> 172.21.15.146:0/2268785192 conn(0x7f92c4069050 msgr2=0x7f92c406a710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:35.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.568+0000 7f92c8937700 1 -- 172.21.15.146:0/2268785192 shutdown_connections 2023-10-06T11:13:35.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.568+0000 7f92c8937700 1 -- 172.21.15.146:0/2268785192 wait complete. 2023-10-06T11:13:35.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.570+0000 7f92c8937700 1 Processor -- start 2023-10-06T11:13:35.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.570+0000 7f92c8937700 1 -- start start 2023-10-06T11:13:35.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.570+0000 7f92c8937700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92c406e670 0x7f92c415adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:35.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.570+0000 7f92c8937700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f92c4159880 0x7f92c4141c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:35.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.570+0000 7f92c8937700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92c4159c50 0x7f92c4150000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:35.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.570+0000 7f92c8937700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c415b300 con 0x7f92c406e670 2023-10-06T11:13:35.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.570+0000 7f92c8937700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c4152520 con 0x7f92c4159c50 2023-10-06T11:13:35.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.570+0000 7f92c8937700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c40aa7f0 con 0x7f92c4159880 2023-10-06T11:13:35.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.571+0000 7f92c259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92c406e670 0x7f92c415adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:35.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.571+0000 7f92c259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92c406e670 0x7f92c415adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33608/0 (socket says 172.21.15.146:33608) 2023-10-06T11:13:35.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.571+0000 7f92c259c700 1 -- 172.21.15.146:0/937220062 learned_addr learned my addr 172.21.15.146:0/937220062 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:35.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.571+0000 7f92b9d9b700 1 --2- 172.21.15.146:0/937220062 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f92c4159880 0x7f92c4141c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:35.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.571+0000 7f92c2d9d700 1 --2- 172.21.15.146:0/937220062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92c4159c50 0x7f92c4150000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:35.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.571+0000 7f92c259c700 1 -- 172.21.15.146:0/937220062 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f92c4159880 msgr2=0x7f92c4141c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:35.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.571+0000 7f92c259c700 1 --2- 172.21.15.146:0/937220062 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f92c4159880 0x7f92c4141c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.571+0000 7f92c259c700 1 -- 172.21.15.146:0/937220062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92c4159c50 msgr2=0x7f92c4150000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:35.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.571+0000 7f92c259c700 1 --2- 172.21.15.146:0/937220062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92c4159c50 0x7f92c4150000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.571+0000 7f92c259c700 1 -- 172.21.15.146:0/937220062 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ac0094f0 con 0x7f92c406e670 2023-10-06T11:13:35.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.571+0000 7f92c259c700 1 --2- 172.21.15.146:0/937220062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92c406e670 0x7f92c415adc0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f92b400d890 tx=0x7f92b4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:35.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.571+0000 7f92baffd700 1 -- 172.21.15.146:0/937220062 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b40125f0 con 0x7f92c406e670 2023-10-06T11:13:35.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.571+0000 7f92baffd700 1 -- 172.21.15.146:0/937220062 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b4012770 con 0x7f92c406e670 2023-10-06T11:13:35.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.571+0000 7f92c8937700 1 -- 172.21.15.146:0/937220062 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92c40aaad0 con 0x7f92c406e670 2023-10-06T11:13:35.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.571+0000 7f92baffd700 1 -- 172.21.15.146:0/937220062 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b4012b30 con 0x7f92c406e670 2023-10-06T11:13:35.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.571+0000 7f92c8937700 1 -- 172.21.15.146:0/937220062 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92c40ab090 con 0x7f92c406e670 2023-10-06T11:13:35.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.572+0000 7f92c8937700 1 -- 172.21.15.146:0/937220062 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92c404c380 con 0x7f92c406e670 2023-10-06T11:13:35.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.572+0000 7f92baffd700 1 -- 172.21.15.146:0/937220062 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f92b401e460 con 0x7f92c406e670 2023-10-06T11:13:35.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.573+0000 7f92baffd700 1 --2- 172.21.15.146:0/937220062 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f92a4066f30 0x7f92a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:35.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.573+0000 7f92baffd700 1 -- 172.21.15.146:0/937220062 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f92b4084d00 con 0x7f92c406e670 2023-10-06T11:13:35.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.573+0000 7f92b9d9b700 1 --2- 172.21.15.146:0/937220062 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f92a4066f30 0x7f92a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:35.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.573+0000 7f92b9d9b700 1 --2- 172.21.15.146:0/937220062 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f92a4066f30 0x7f92a40693e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f92ac0099b0 tx=0x7f92ac017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:35.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.577+0000 7f92baffd700 1 -- 172.21.15.146:0/937220062 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f92b4051d70 con 0x7f92c406e670 2023-10-06T11:13:35.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.836+0000 7f92c8937700 1 -- 172.21.15.146:0/937220062 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f92c406ae20 con 0x7f92c406e670 2023-10-06T11:13:35.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.840+0000 7f92baffd700 1 -- 172.21.15.146:0/937220062 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+0 (secure 0 0 0) 0x7f92b4055390 con 0x7f92c406e670 2023-10-06T11:13:35.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.842+0000 7f92c8937700 1 -- 172.21.15.146:0/937220062 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f92a4066f30 msgr2=0x7f92a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:35.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.842+0000 7f92c8937700 1 --2- 172.21.15.146:0/937220062 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f92a4066f30 0x7f92a40693e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f92ac0099b0 tx=0x7f92ac017000 comp rx=0 tx=0).stop 2023-10-06T11:13:35.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.842+0000 7f92c8937700 1 -- 172.21.15.146:0/937220062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92c406e670 msgr2=0x7f92c415adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:35.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.842+0000 7f92c8937700 1 --2- 172.21.15.146:0/937220062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92c406e670 0x7f92c415adc0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f92b400d890 tx=0x7f92b4008040 comp rx=0 tx=0).stop 2023-10-06T11:13:35.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.842+0000 7f92c8937700 1 -- 172.21.15.146:0/937220062 shutdown_connections 2023-10-06T11:13:35.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.842+0000 7f92c8937700 1 --2- 172.21.15.146:0/937220062 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f92a4066f30 0x7f92a40693e0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.842+0000 7f92c8937700 1 --2- 172.21.15.146:0/937220062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92c4159c50 0x7f92c4150000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.842+0000 7f92c8937700 1 --2- 172.21.15.146:0/937220062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f92c406e670 0x7f92c415adc0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.842+0000 7f92c8937700 1 --2- 172.21.15.146:0/937220062 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f92c4159880 0x7f92c4141c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.842+0000 7f92c8937700 1 -- 172.21.15.146:0/937220062 >> 172.21.15.146:0/937220062 conn(0x7f92c4069050 msgr2=0x7f92c40b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:35.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.842+0000 7f92c8937700 1 -- 172.21.15.146:0/937220062 shutdown_connections 2023-10-06T11:13:35.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.842+0000 7f92c8937700 1 -- 172.21.15.146:0/937220062 wait complete. 2023-10-06T11:13:35.847 INFO:teuthology.orchestra.run.smithi146.stderr:updated caps for client.0 2023-10-06T11:13:35.857 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:13:35.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.971+0000 7f8cd0a37700 1 Processor -- start 2023-10-06T11:13:35.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.971+0000 7f8cd0a37700 1 -- start start 2023-10-06T11:13:35.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.972+0000 7f8cd0a37700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8ccc068ba0 0x7f8ccc15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:35.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.972+0000 7f8cd0a37700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ccc153e80 0x7f8ccc0b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:35.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.972+0000 7f8cd0a37700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ccc15ac30 con 0x7f8ccc153ab0 2023-10-06T11:13:35.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.972+0000 7f8cd0a37700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ccc0b4510 con 0x7f8ccc068ba0 2023-10-06T11:13:35.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.972+0000 7f8cd0a37700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc0b6530 con 0x7f8ccc153e80 2023-10-06T11:13:35.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.972+0000 7f8cc3fff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8ccc068ba0 0x7f8ccc15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:35.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.972+0000 7f8ccad9d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ccc153e80 0x7f8ccc0b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:35.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.972+0000 7f8cca59c700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f8ccc153ab0 0x7f8ccc068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:48634/0 (socket says 172.21.15.146:48634) 2023-10-06T11:13:35.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.972+0000 7f8cca59c700 1 -- 172.21.15.146:0/969631497 learned_addr learned my addr 172.21.15.146:0/969631497 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:13:35.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.972+0000 7f8cc9d9b700 1 -- 172.21.15.146:0/969631497 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2951476270 0 0) 0x7f8cbc001110 con 0x7f8ccc153ab0 2023-10-06T11:13:35.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.972+0000 7f8cc9d9b700 1 -- 172.21.15.146:0/969631497 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cb8003570 con 0x7f8ccc153ab0 2023-10-06T11:13:35.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.972+0000 7f8cc3fff700 1 -- 172.21.15.146:0/969631497 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ccc153e80 msgr2=0x7f8ccc0b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:35.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.972+0000 7f8cc3fff700 1 --2- 172.21.15.146:0/969631497 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ccc153e80 0x7f8ccc0b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.972+0000 7f8cc3fff700 1 -- 172.21.15.146:0/969631497 >> v1:172.21.15.151:6789/0 conn(0x7f8ccc153ab0 legacy=0x7f8ccc068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:35.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.972+0000 7f8cc3fff700 1 -- 172.21.15.146:0/969631497 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ccc0b5c50 con 0x7f8ccc068ba0 2023-10-06T11:13:35.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.972+0000 7f8ccad9d700 1 --2- 172.21.15.146:0/969631497 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ccc153e80 0x7f8ccc0b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:13:35.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.972+0000 7f8cc3fff700 1 --2- 172.21.15.146:0/969631497 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ccc068ba0 0x7f8ccc15a6f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8cb40098e0 tx=0x7f8cb40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51f56758c4d3c565 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:35.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.973+0000 7f8cc9d9b700 1 -- 172.21.15.146:0/969631497 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb4011630 con 0x7f8ccc068ba0 2023-10-06T11:13:35.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.973+0000 7f8cc9d9b700 1 -- 172.21.15.146:0/969631497 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb4011790 con 0x7f8ccc068ba0 2023-10-06T11:13:35.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.973+0000 7f8cc9d9b700 1 -- 172.21.15.146:0/969631497 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb4011b10 con 0x7f8ccc068ba0 2023-10-06T11:13:35.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.973+0000 7f8cd0a37700 1 -- 172.21.15.146:0/969631497 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ccc068ba0 msgr2=0x7f8ccc15a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:35.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.973+0000 7f8cd0a37700 1 --2- 172.21.15.146:0/969631497 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ccc068ba0 0x7f8ccc15a6f0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f8cb40098e0 tx=0x7f8cb40091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.973+0000 7f8cd0a37700 1 -- 172.21.15.146:0/969631497 shutdown_connections 2023-10-06T11:13:35.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.973+0000 7f8cd0a37700 1 --2- 172.21.15.146:0/969631497 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ccc153e80 0x7f8ccc0b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.973+0000 7f8cd0a37700 1 --2- 172.21.15.146:0/969631497 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ccc068ba0 0x7f8ccc15a6f0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.973+0000 7f8cd0a37700 1 -- 172.21.15.146:0/969631497 >> 172.21.15.146:0/969631497 conn(0x7f8ccc06eba0 msgr2=0x7f8ccc06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:35.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.973+0000 7f8cd0a37700 1 -- 172.21.15.146:0/969631497 shutdown_connections 2023-10-06T11:13:35.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.973+0000 7f8cd0a37700 1 -- 172.21.15.146:0/969631497 wait complete. 2023-10-06T11:13:35.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.974+0000 7f8cd0a37700 1 Processor -- start 2023-10-06T11:13:35.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.974+0000 7f8cd0a37700 1 -- start start 2023-10-06T11:13:35.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.975+0000 7f8cd0a37700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ccc068ba0 0x7f8ccc0b0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:35.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.975+0000 7f8cd0a37700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ccc153ab0 0x7f8ccc14fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:35.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.975+0000 7f8cd0a37700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ccc153e80 0x7f8ccc154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:35.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.975+0000 7f8cd0a37700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc158e20 con 0x7f8ccc068ba0 2023-10-06T11:13:35.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.975+0000 7f8cd0a37700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc0b1290 con 0x7f8ccc153e80 2023-10-06T11:13:35.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.975+0000 7f8cd0a37700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ccc0b1570 con 0x7f8ccc153ab0 2023-10-06T11:13:35.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.975+0000 7f8cca59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ccc068ba0 0x7f8ccc0b0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:35.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.975+0000 7f8cca59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ccc068ba0 0x7f8ccc0b0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33624/0 (socket says 172.21.15.146:33624) 2023-10-06T11:13:35.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.975+0000 7f8cca59c700 1 -- 172.21.15.146:0/1982365314 learned_addr learned my addr 172.21.15.146:0/1982365314 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:35.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.975+0000 7f8cc3fff700 1 --2- 172.21.15.146:0/1982365314 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ccc153ab0 0x7f8ccc14fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:35.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.975+0000 7f8ccad9d700 1 --2- 172.21.15.146:0/1982365314 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ccc153e80 0x7f8ccc154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:35.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.975+0000 7f8cca59c700 1 -- 172.21.15.146:0/1982365314 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ccc153ab0 msgr2=0x7f8ccc14fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:35.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.975+0000 7f8cca59c700 1 --2- 172.21.15.146:0/1982365314 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ccc153ab0 0x7f8ccc14fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.975+0000 7f8cca59c700 1 -- 172.21.15.146:0/1982365314 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ccc153e80 msgr2=0x7f8ccc154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:35.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.975+0000 7f8cca59c700 1 --2- 172.21.15.146:0/1982365314 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ccc153e80 0x7f8ccc154850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:35.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.975+0000 7f8cca59c700 1 -- 172.21.15.146:0/1982365314 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc4009a20 con 0x7f8ccc068ba0 2023-10-06T11:13:35.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.975+0000 7f8cc3fff700 1 --2- 172.21.15.146:0/1982365314 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ccc153ab0 0x7f8ccc14fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:35.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.975+0000 7f8ccad9d700 1 --2- 172.21.15.146:0/1982365314 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ccc153e80 0x7f8ccc154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:35.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.976+0000 7f8cca59c700 1 --2- 172.21.15.146:0/1982365314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ccc068ba0 0x7f8ccc0b0b90 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc00c7c0 tx=0x7f8cbc007c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:35.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.976+0000 7f8cc27fc700 1 -- 172.21.15.146:0/1982365314 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc005b30 con 0x7f8ccc068ba0 2023-10-06T11:13:35.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.976+0000 7f8cc27fc700 1 -- 172.21.15.146:0/1982365314 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cbc005c90 con 0x7f8ccc068ba0 2023-10-06T11:13:35.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.976+0000 7f8cd0a37700 1 -- 172.21.15.146:0/1982365314 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cb4009420 con 0x7f8ccc068ba0 2023-10-06T11:13:35.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.976+0000 7f8cc27fc700 1 -- 172.21.15.146:0/1982365314 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cbc007320 con 0x7f8ccc068ba0 2023-10-06T11:13:35.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.976+0000 7f8cd0a37700 1 -- 172.21.15.146:0/1982365314 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ccc0b1b30 con 0x7f8ccc068ba0 2023-10-06T11:13:35.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.977+0000 7f8cd0a37700 1 -- 172.21.15.146:0/1982365314 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ccc158bf0 con 0x7f8ccc068ba0 2023-10-06T11:13:35.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.977+0000 7f8cc27fc700 1 -- 172.21.15.146:0/1982365314 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8cbc0113a0 con 0x7f8ccc068ba0 2023-10-06T11:13:35.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.977+0000 7f8cc27fc700 1 --2- 172.21.15.146:0/1982365314 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8cac066f30 0x7f8cac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:35.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.977+0000 7f8cc27fc700 1 -- 172.21.15.146:0/1982365314 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8cbc0839b0 con 0x7f8ccc068ba0 2023-10-06T11:13:35.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.977+0000 7f8cc3fff700 1 --2- 172.21.15.146:0/1982365314 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8cac066f30 0x7f8cac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:35.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.978+0000 7f8cc3fff700 1 --2- 172.21.15.146:0/1982365314 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8cac066f30 0x7f8cac0693e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc068fa0 tx=0x7f8cb4017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:35.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:35.982+0000 7f8cc27fc700 1 -- 172.21.15.146:0/1982365314 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8cbc0545d0 con 0x7f8ccc068ba0 2023-10-06T11:13:36.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.210+0000 7f8cd0a37700 1 -- 172.21.15.146:0/1982365314 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ccc15ac30 con 0x7f8ccc068ba0 2023-10-06T11:13:36.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.211+0000 7f8cc27fc700 1 -- 172.21.15.146:0/1982365314 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f8ccc15ac30 con 0x7f8ccc068ba0 2023-10-06T11:13:36.214 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:13:36.214 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":93,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/2159562091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2159562091},{"type":"v1","addr":"172.21.15.151:6834","nonce":2159562091}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6242,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/603782012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":603782012},{"type":"v1","addr":"172.21.15.151:6835","nonce":603782012}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6916,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3416056259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3416056259},{"type":"v1","addr":"172.21.15.146:6837","nonce":3416056259}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:13:30.345795+0000","modified":"2023-10-06T11:13:33.984549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7620":{"gid":7620,"name":"c","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/785131800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":785131800},{"type":"v1","addr":"172.21.15.146:6835","nonce":785131800}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T11:13:36.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.213+0000 7f8cd0a37700 1 -- 172.21.15.146:0/1982365314 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8cac066f30 msgr2=0x7f8cac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:36.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.213+0000 7f8cd0a37700 1 --2- 172.21.15.146:0/1982365314 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8cac066f30 0x7f8cac0693e0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc068fa0 tx=0x7f8cb4017000 comp rx=0 tx=0).stop 2023-10-06T11:13:36.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.213+0000 7f8cd0a37700 1 -- 172.21.15.146:0/1982365314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ccc068ba0 msgr2=0x7f8ccc0b0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:36.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.213+0000 7f8cd0a37700 1 --2- 172.21.15.146:0/1982365314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ccc068ba0 0x7f8ccc0b0b90 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc00c7c0 tx=0x7f8cbc007c30 comp rx=0 tx=0).stop 2023-10-06T11:13:36.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.213+0000 7f8cd0a37700 1 -- 172.21.15.146:0/1982365314 shutdown_connections 2023-10-06T11:13:36.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.213+0000 7f8cd0a37700 1 --2- 172.21.15.146:0/1982365314 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8cac066f30 0x7f8cac0693e0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.213+0000 7f8cd0a37700 1 --2- 172.21.15.146:0/1982365314 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ccc153e80 0x7f8ccc154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.213+0000 7f8cd0a37700 1 --2- 172.21.15.146:0/1982365314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ccc068ba0 0x7f8ccc0b0b90 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.213+0000 7f8cd0a37700 1 --2- 172.21.15.146:0/1982365314 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ccc153ab0 0x7f8ccc14fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.213+0000 7f8cd0a37700 1 -- 172.21.15.146:0/1982365314 >> 172.21.15.146:0/1982365314 conn(0x7f8ccc06eba0 msgr2=0x7f8ccc151db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:36.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.213+0000 7f8cd0a37700 1 -- 172.21.15.146:0/1982365314 shutdown_connections 2023-10-06T11:13:36.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.213+0000 7f8cd0a37700 1 -- 172.21.15.146:0/1982365314 wait complete. 2023-10-06T11:13:36.216 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 93 2023-10-06T11:13:36.630 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 93, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T11:13:30.345795+0000', 'modified': '2023-10-06T11:13:33.984549+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7620}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7620': {'gid': 7620, 'name': 'c', 'rank': 0, 'incarnation': 89, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.146:6835/785131800', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6834', 'nonce': 785131800}, {'type': 'v1', 'addr': '172.21.15.146:6835', 'nonce': 785131800}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T11:13:36.630 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T11:13:36.631 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T11:13:36.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.746+0000 7f18a6435700 1 Processor -- start 2023-10-06T11:13:36.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.746+0000 7f18a6435700 1 -- start start 2023-10-06T11:13:36.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.747+0000 7f18a6435700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18a00cc960 0x7f18a0164c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:36.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.747+0000 7f18a6435700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18a00ae2a0 con 0x7f18a00ae730 2023-10-06T11:13:36.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.747+0000 7f18a6435700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18a015a530 con 0x7f18a015a160 2023-10-06T11:13:36.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.747+0000 7f18a6435700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a00ccdc0 con 0x7f18a00cc960 2023-10-06T11:13:36.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.747+0000 7f189f7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f18a00ae730 0x7f18a00aebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35960/0 (socket says 172.21.15.146:35960) 2023-10-06T11:13:36.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.747+0000 7f189f7fe700 1 -- 172.21.15.146:0/1287736706 learned_addr learned my addr 172.21.15.146:0/1287736706 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:13:36.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.747+0000 7f18a49d2700 1 --2- 172.21.15.146:0/1287736706 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18a00cc960 0x7f18a0164c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:36.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.747+0000 7f189effd700 1 -- 172.21.15.146:0/1287736706 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4275274812 0 0) 0x7f18a00ae2a0 con 0x7f18a00ae730 2023-10-06T11:13:36.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.747+0000 7f189effd700 1 -- 172.21.15.146:0/1287736706 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1888003570 con 0x7f18a00ae730 2023-10-06T11:13:36.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.747+0000 7f189effd700 1 -- 172.21.15.146:0/1287736706 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1912192607 0 0) 0x7f18a015a530 con 0x7f18a015a160 2023-10-06T11:13:36.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.747+0000 7f189effd700 1 -- 172.21.15.146:0/1287736706 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18a00ae2a0 con 0x7f18a015a160 2023-10-06T11:13:36.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.747+0000 7f189effd700 1 -- 172.21.15.146:0/1287736706 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3042641015 0 0) 0x7f1888003570 con 0x7f18a00ae730 2023-10-06T11:13:36.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.747+0000 7f18a49d2700 1 -- 172.21.15.146:0/1287736706 >> v1:172.21.15.151:6789/0 conn(0x7f18a015a160 legacy=0x7f18a00c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:36.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.747+0000 7f18a49d2700 1 -- 172.21.15.146:0/1287736706 >> v1:172.21.15.146:6789/0 conn(0x7f18a00ae730 legacy=0x7f18a00aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:36.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.747+0000 7f18a49d2700 1 -- 172.21.15.146:0/1287736706 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a00c5cb0 con 0x7f18a00cc960 2023-10-06T11:13:36.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.748+0000 7f18a49d2700 1 --2- 172.21.15.146:0/1287736706 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18a00cc960 0x7f18a0164c60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1898009e90 tx=0x7f1898009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ee640430172a6c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:36.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.748+0000 7f189effd700 1 -- 172.21.15.146:0/1287736706 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189800e070 con 0x7f18a00cc960 2023-10-06T11:13:36.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.748+0000 7f189effd700 1 -- 172.21.15.146:0/1287736706 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189800b870 con 0x7f18a00cc960 2023-10-06T11:13:36.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.748+0000 7f189effd700 1 -- 172.21.15.146:0/1287736706 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1894001470 con 0x7f18a00cc960 2023-10-06T11:13:36.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.748+0000 7f18a6435700 1 -- 172.21.15.146:0/1287736706 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18a00cc960 msgr2=0x7f18a0164c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:36.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.748+0000 7f18a6435700 1 --2- 172.21.15.146:0/1287736706 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18a00cc960 0x7f18a0164c60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1898009e90 tx=0x7f1898009780 comp rx=0 tx=0).stop 2023-10-06T11:13:36.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.748+0000 7f18a6435700 1 -- 172.21.15.146:0/1287736706 shutdown_connections 2023-10-06T11:13:36.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.748+0000 7f18a6435700 1 --2- 172.21.15.146:0/1287736706 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18a00cc960 0x7f18a0164c60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.748+0000 7f18a6435700 1 -- 172.21.15.146:0/1287736706 >> 172.21.15.146:0/1287736706 conn(0x7f18a006f380 msgr2=0x7f18a00d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:36.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.748+0000 7f18a6435700 1 -- 172.21.15.146:0/1287736706 shutdown_connections 2023-10-06T11:13:36.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.748+0000 7f18a6435700 1 -- 172.21.15.146:0/1287736706 wait complete. 2023-10-06T11:13:36.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.750+0000 7f18a6435700 1 Processor -- start 2023-10-06T11:13:36.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.750+0000 7f18a6435700 1 -- start start 2023-10-06T11:13:36.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.751+0000 7f18a6435700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18a00ae730 0x7f18a00ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:36.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.751+0000 7f18a6435700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18a00cc960 0x7f18a0156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:36.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.751+0000 7f18a6435700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18a015a160 0x7f18a009bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:36.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.751+0000 7f18a6435700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a016dcf0 con 0x7f18a015a160 2023-10-06T11:13:36.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.751+0000 7f18a6435700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a009e230 con 0x7f18a00cc960 2023-10-06T11:13:36.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.751+0000 7f18a6435700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a016d6a0 con 0x7f18a00ae730 2023-10-06T11:13:36.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.751+0000 7f18a49d2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18a015a160 0x7f18a009bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:36.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.751+0000 7f18a49d2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18a015a160 0x7f18a009bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33634/0 (socket says 172.21.15.146:33634) 2023-10-06T11:13:36.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.751+0000 7f18a49d2700 1 -- 172.21.15.146:0/227351613 learned_addr learned my addr 172.21.15.146:0/227351613 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:36.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.751+0000 7f189f7fe700 1 --2- 172.21.15.146:0/227351613 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18a00cc960 0x7f18a0156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:36.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.751+0000 7f189ffff700 1 --2- 172.21.15.146:0/227351613 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18a00ae730 0x7f18a00ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:36.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.751+0000 7f18a49d2700 1 -- 172.21.15.146:0/227351613 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18a00ae730 msgr2=0x7f18a00ca5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:36.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.751+0000 7f18a49d2700 1 --2- 172.21.15.146:0/227351613 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18a00ae730 0x7f18a00ca5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.751+0000 7f18a49d2700 1 -- 172.21.15.146:0/227351613 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18a00cc960 msgr2=0x7f18a0156930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:36.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.751+0000 7f18a49d2700 1 --2- 172.21.15.146:0/227351613 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18a00cc960 0x7f18a0156930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.751+0000 7f18a49d2700 1 -- 172.21.15.146:0/227351613 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1898009a20 con 0x7f18a015a160 2023-10-06T11:13:36.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.751+0000 7f18a49d2700 1 --2- 172.21.15.146:0/227351613 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18a015a160 0x7f18a009bb70 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f1898009de0 tx=0x7f1898017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:36.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.751+0000 7f1887fff700 1 -- 172.21.15.146:0/227351613 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1898012d80 con 0x7f18a015a160 2023-10-06T11:13:36.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.751+0000 7f1887fff700 1 -- 172.21.15.146:0/227351613 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189801e450 con 0x7f18a015a160 2023-10-06T11:13:36.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.751+0000 7f18a6435700 1 -- 172.21.15.146:0/227351613 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18a016d980 con 0x7f18a015a160 2023-10-06T11:13:36.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.751+0000 7f1887fff700 1 -- 172.21.15.146:0/227351613 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189801e810 con 0x7f18a015a160 2023-10-06T11:13:36.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.751+0000 7f18a6435700 1 -- 172.21.15.146:0/227351613 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18a009dde0 con 0x7f18a015a160 2023-10-06T11:13:36.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.753+0000 7f1887fff700 1 -- 172.21.15.146:0/227351613 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f189801ec40 con 0x7f18a015a160 2023-10-06T11:13:36.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.753+0000 7f1887fff700 1 --2- 172.21.15.146:0/227351613 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f188c066f30 0x7f188c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:36.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.753+0000 7f1887fff700 1 -- 172.21.15.146:0/227351613 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1898086670 con 0x7f18a015a160 2023-10-06T11:13:36.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.753+0000 7f189ffff700 1 --2- 172.21.15.146:0/227351613 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f188c066f30 0x7f188c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:36.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.754+0000 7f189ffff700 1 --2- 172.21.15.146:0/227351613 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f188c066f30 0x7f188c0693e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1890003820 tx=0x7f1890009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:36.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.755+0000 7f18af72db80 1 Processor -- start 2023-10-06T11:13:36.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.755+0000 7f18af72db80 1 -- start start 2023-10-06T11:13:36.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.756+0000 7f18af72db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f922c8fa90 0x55f922c8fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:36.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.756+0000 7f18af72db80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f922c4b9a0 0x55f922c48580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:36.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.756+0000 7f18af72db80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f922c49bd0 0x55f922c48ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:36.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.756+0000 7f18af72db80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f922bc8c80 con 0x55f922c49bd0 2023-10-06T11:13:36.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.756+0000 7f18af72db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f922b9fa70 con 0x55f922c8fa90 2023-10-06T11:13:36.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.756+0000 7f18af72db80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f922b9d270 con 0x55f922c4b9a0 2023-10-06T11:13:36.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.756+0000 7f18a49d2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f922c49bd0 0x55f922c48ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:36.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.756+0000 7f18a49d2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f922c49bd0 0x55f922c48ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33636/0 (socket says 172.21.15.146:33636) 2023-10-06T11:13:36.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.756+0000 7f18a49d2700 1 -- 172.21.15.146:0/4050237306 learned_addr learned my addr 172.21.15.146:0/4050237306 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:36.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.756+0000 7f189ffff700 1 --2- 172.21.15.146:0/4050237306 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f922c8fa90 0x55f922c8fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:36.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.756+0000 7f189f7fe700 1 --2- 172.21.15.146:0/4050237306 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f922c4b9a0 0x55f922c48580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:36.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.756+0000 7f18a49d2700 1 -- 172.21.15.146:0/4050237306 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f922c4b9a0 msgr2=0x55f922c48580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:36.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.756+0000 7f18a49d2700 1 --2- 172.21.15.146:0/4050237306 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f922c4b9a0 0x55f922c48580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.756+0000 7f18a49d2700 1 -- 172.21.15.146:0/4050237306 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f922c8fa90 msgr2=0x55f922c8fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:36.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.756+0000 7f18a49d2700 1 --2- 172.21.15.146:0/4050237306 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f922c8fa90 0x55f922c8fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.756+0000 7f18a49d2700 1 -- 172.21.15.146:0/4050237306 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f922a33270 con 0x55f922c49bd0 2023-10-06T11:13:36.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.756+0000 7f189f7fe700 1 --2- 172.21.15.146:0/4050237306 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f922c4b9a0 0x55f922c48580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:36.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.757+0000 7f18a49d2700 1 --2- 172.21.15.146:0/4050237306 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f922c49bd0 0x55f922c48ac0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f1898084a60 tx=0x7f1898084990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed3bdfd1b6daac89 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:36.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.757+0000 7f18857fa700 1 -- 172.21.15.146:0/4050237306 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189800e070 con 0x55f922c49bd0 2023-10-06T11:13:36.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.757+0000 7f18857fa700 1 -- 172.21.15.146:0/4050237306 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1898057ba0 con 0x55f922c49bd0 2023-10-06T11:13:36.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.757+0000 7f18857fa700 1 -- 172.21.15.146:0/4050237306 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1898057440 con 0x55f922c49bd0 2023-10-06T11:13:36.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.757+0000 7f18af72db80 1 -- 172.21.15.146:0/4050237306 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f922c49bd0 msgr2=0x55f922c48ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:36.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.757+0000 7f18af72db80 1 --2- 172.21.15.146:0/4050237306 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f922c49bd0 0x55f922c48ac0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f1898084a60 tx=0x7f1898084990 comp rx=0 tx=0).stop 2023-10-06T11:13:36.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.757+0000 7f18af72db80 1 -- 172.21.15.146:0/4050237306 shutdown_connections 2023-10-06T11:13:36.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.757+0000 7f18af72db80 1 --2- 172.21.15.146:0/4050237306 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f922c49bd0 0x55f922c48ac0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.757+0000 7f18af72db80 1 --2- 172.21.15.146:0/4050237306 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f922c8fa90 0x55f922c8fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.757+0000 7f18af72db80 1 --2- 172.21.15.146:0/4050237306 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f922c4b9a0 0x55f922c48580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.758+0000 7f18af72db80 1 -- 172.21.15.146:0/4050237306 >> 172.21.15.146:0/4050237306 conn(0x55f922c4a070 msgr2=0x55f922c4a440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:36.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.758+0000 7f18af72db80 1 -- 172.21.15.146:0/4050237306 shutdown_connections 2023-10-06T11:13:36.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.758+0000 7f18af72db80 1 -- 172.21.15.146:0/4050237306 wait complete. 2023-10-06T11:13:36.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.758+0000 7f18af72db80 1 -- start start 2023-10-06T11:13:36.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.758+0000 7f18af72db80 1 Processor -- start 2023-10-06T11:13:36.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.759+0000 7f18af72db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f922c49bd0 0x55f922c74f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:36.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.759+0000 7f18af72db80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f922c4b9a0 0x55f922c6f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:36.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.759+0000 7f18af72db80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f922c8fa90 0x55f922c43740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:36.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.759+0000 7f18af72db80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f922b99060 con 0x55f922c4b9a0 2023-10-06T11:13:36.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.759+0000 7f18af72db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f922b44890 con 0x55f922c49bd0 2023-10-06T11:13:36.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.759+0000 7f18af72db80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f922b5fea0 con 0x55f922c8fa90 2023-10-06T11:13:36.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.759+0000 7f18af72db80 10 client.0 _ll_register_callbacks cb 0x55f922a35f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:13:36.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.759+0000 7f189f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f922c4b9a0 0x55f922c6f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:36.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.759+0000 7f189f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f922c4b9a0 0x55f922c6f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33650/0 (socket says 172.21.15.146:33650) 2023-10-06T11:13:36.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.759+0000 7f189f7fe700 1 -- 172.21.15.146:0/1400064888 learned_addr learned my addr 172.21.15.146:0/1400064888 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:36.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.759+0000 7f189ffff700 1 --2- 172.21.15.146:0/1400064888 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f922c49bd0 0x55f922c74f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:36.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.759+0000 7f18a49d2700 1 --2- 172.21.15.146:0/1400064888 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f922c8fa90 0x55f922c43740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:36.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.759+0000 7f189f7fe700 1 -- 172.21.15.146:0/1400064888 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f922c8fa90 msgr2=0x55f922c43740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:36.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.759+0000 7f189f7fe700 1 --2- 172.21.15.146:0/1400064888 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f922c8fa90 0x55f922c43740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.759+0000 7f189f7fe700 1 -- 172.21.15.146:0/1400064888 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f922c49bd0 msgr2=0x55f922c74f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:36.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.759+0000 7f189f7fe700 1 --2- 172.21.15.146:0/1400064888 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f922c49bd0 0x55f922c74f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.759+0000 7f189f7fe700 1 -- 172.21.15.146:0/1400064888 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18a009dde0 con 0x55f922c4b9a0 2023-10-06T11:13:36.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.759+0000 7f18a49d2700 1 --2- 172.21.15.146:0/1400064888 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f922c8fa90 0x55f922c43740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:36.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.760+0000 7f189f7fe700 1 --2- 172.21.15.146:0/1400064888 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f922c4b9a0 0x55f922c6f330 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f1894010560 tx=0x7f1894009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c76f36d78f5c1c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:36.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.760+0000 7f187e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:13:36.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.760+0000 7f187e7fc700 1 -- 172.21.15.146:0/1400064888 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1894010ec0 con 0x55f922c4b9a0 2023-10-06T11:13:36.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.760+0000 7f187e7fc700 1 -- 172.21.15.146:0/1400064888 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1894013570 con 0x55f922c4b9a0 2023-10-06T11:13:36.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.760+0000 7f18af72db80 1 -- 172.21.15.146:0/1400064888 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f922c1a5c0 con 0x55f922c4b9a0 2023-10-06T11:13:36.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.760+0000 7f187e7fc700 1 -- 172.21.15.146:0/1400064888 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1894001c70 con 0x55f922c4b9a0 2023-10-06T11:13:36.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.760+0000 7f18af72db80 10 client.7773 fetch_fsmap learned FSMap version 93 2023-10-06T11:13:36.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.760+0000 7f18af72db80 1 -- 172.21.15.146:0/1400064888 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x55f9229d5fe0 con 0x55f922c4b9a0 2023-10-06T11:13:36.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.760+0000 7f187e7fc700 1 -- 172.21.15.146:0/1400064888 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f922c1a5c0 con 0x55f922c4b9a0 2023-10-06T11:13:36.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.760+0000 7f187e7fc700 1 -- 172.21.15.146:0/1400064888 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 93) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1894013940 con 0x55f922c4b9a0 2023-10-06T11:13:36.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.760+0000 7f18af72db80 10 client.7773 fetch_fsmap finished waiting for FSMap version 93 2023-10-06T11:13:36.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.760+0000 7f18af72db80 10 client.7773 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T11:13:36.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.760+0000 7f18af72db80 20 client.7773 populate_metadata read hostname 'smithi146' 2023-10-06T11:13:36.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.760+0000 7f18af72db80 1 --2- 172.21.15.146:0/1400064888 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x55f922c730f0 0x55f922c734c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:36.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.760+0000 7f18af72db80 4 client.7773 mds_command: new command op to 7620 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:13:36.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.760+0000 7f18af72db80 1 -- 172.21.15.146:0/1400064888 --> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f922b3be00 con 0x55f922c730f0 2023-10-06T11:13:36.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.760+0000 7f189ffff700 1 --2- 172.21.15.146:0/1400064888 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x55f922c730f0 0x55f922c734c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:36.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.760+0000 7f187e7fc700 10 client.7773 ms_handle_connect on v2:172.21.15.146:6834/785131800 2023-10-06T11:13:36.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.760+0000 7f189ffff700 1 --2- 172.21.15.146:0/1400064888 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x55f922c730f0 0x55f922c734c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f59d16bee2101e49 server_cookie=ac00c9bf9f7a0d7a in_seq=0 out_seq=0 2023-10-06T11:13:36.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.761+0000 7f187e7fc700 1 -- 172.21.15.146:0/1400064888 <== mds.0 v2:172.21.15.146:6834/785131800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55f922b3be00 con 0x55f922c730f0 2023-10-06T11:13:36.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.761+0000 7f187e7fc700 10 client.7773 handle_command_reply: tid=0 2023-10-06T11:13:36.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.761+0000 7f18af72db80 1 client.7773 shutdown 2023-10-06T11:13:36.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.761+0000 7f18af72db80 1 -- 172.21.15.146:0/1400064888 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f922c4b9a0 msgr2=0x55f922c6f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:36.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.761+0000 7f18af72db80 1 --2- 172.21.15.146:0/1400064888 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f922c4b9a0 0x55f922c6f330 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f1894010560 tx=0x7f1894009040 comp rx=0 tx=0).stop 2023-10-06T11:13:36.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.761+0000 7f18af72db80 1 -- 172.21.15.146:0/1400064888 shutdown_connections 2023-10-06T11:13:36.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.761+0000 7f18af72db80 1 --2- 172.21.15.146:0/1400064888 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x55f922c730f0 0x55f922c734c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.761+0000 7f18af72db80 1 --2- 172.21.15.146:0/1400064888 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f922c8fa90 0x55f922c43740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.761+0000 7f18af72db80 1 --2- 172.21.15.146:0/1400064888 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f922c49bd0 0x55f922c74f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.761+0000 7f187e7fc700 0 client.7773 ms_handle_reset on v2:172.21.15.146:6834/785131800 2023-10-06T11:13:36.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.761+0000 7f18af72db80 1 --2- 172.21.15.146:0/1400064888 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f922c4b9a0 0x55f922c6f330 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.761+0000 7f18af72db80 1 -- 172.21.15.146:0/1400064888 >> 172.21.15.146:0/1400064888 conn(0x55f922c4a070 msgr2=0x55f922c45760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:36.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.761+0000 7f18af72db80 1 -- 172.21.15.146:0/1400064888 shutdown_connections 2023-10-06T11:13:36.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.761+0000 7f18af72db80 1 -- 172.21.15.146:0/1400064888 wait complete. 2023-10-06T11:13:36.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.761+0000 7f18af72db80 20 client.7773 trim_cache size 0 max 16384 2023-10-06T11:13:36.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.778+0000 7f18af72db80 1 Processor -- start 2023-10-06T11:13:36.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.778+0000 7f18af72db80 1 -- start start 2023-10-06T11:13:36.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.779+0000 7f18af72db80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f922c49bd0 0x55f922c44560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:36.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.779+0000 7f18af72db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f922c4b9a0 0x55f922c45800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:36.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.779+0000 7f18af72db80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f922c8fa90 0x55f922c4a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:36.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.779+0000 7f18af72db80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f922a1be30 con 0x55f922c49bd0 2023-10-06T11:13:36.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.779+0000 7f18af72db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f922ca1e10 con 0x55f922c4b9a0 2023-10-06T11:13:36.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.779+0000 7f18af72db80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f922c4b2b0 con 0x55f922c8fa90 2023-10-06T11:13:36.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.779+0000 7f189ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f922c49bd0 0x55f922c44560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:36.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.779+0000 7f189ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f922c49bd0 0x55f922c44560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33656/0 (socket says 172.21.15.146:33656) 2023-10-06T11:13:36.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.779+0000 7f189ffff700 1 -- 172.21.15.146:0/2684066242 learned_addr learned my addr 172.21.15.146:0/2684066242 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:36.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.779+0000 7f189ffff700 1 -- 172.21.15.146:0/2684066242 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f922c8fa90 msgr2=0x55f922c4a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:36.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.779+0000 7f189ffff700 1 --2- 172.21.15.146:0/2684066242 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f922c8fa90 0x55f922c4a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.779+0000 7f189ffff700 1 -- 172.21.15.146:0/2684066242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f922c4b9a0 msgr2=0x55f922c45800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:36.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.779+0000 7f189ffff700 1 --2- 172.21.15.146:0/2684066242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f922c4b9a0 0x55f922c45800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.779+0000 7f189ffff700 1 -- 172.21.15.146:0/2684066242 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f922b67780 con 0x55f922c49bd0 2023-10-06T11:13:36.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.779+0000 7f189ffff700 1 --2- 172.21.15.146:0/2684066242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f922c49bd0 0x55f922c44560 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x55f922c496d0 tx=0x7f1890013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=647fa2a8dd22ed89 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:36.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.780+0000 7f1885ffb700 1 -- 172.21.15.146:0/2684066242 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1890006870 con 0x55f922c49bd0 2023-10-06T11:13:36.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.780+0000 7f1885ffb700 1 -- 172.21.15.146:0/2684066242 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18900069d0 con 0x55f922c49bd0 2023-10-06T11:13:36.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.780+0000 7f1885ffb700 1 -- 172.21.15.146:0/2684066242 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1890006d70 con 0x55f922c49bd0 2023-10-06T11:13:36.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.780+0000 7f18af72db80 1 -- 172.21.15.146:0/2684066242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f922c49bd0 msgr2=0x55f922c44560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:36.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.780+0000 7f18af72db80 1 --2- 172.21.15.146:0/2684066242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f922c49bd0 0x55f922c44560 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x55f922c496d0 tx=0x7f1890013000 comp rx=0 tx=0).stop 2023-10-06T11:13:36.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.780+0000 7f18af72db80 1 -- 172.21.15.146:0/2684066242 shutdown_connections 2023-10-06T11:13:36.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.780+0000 7f18af72db80 1 --2- 172.21.15.146:0/2684066242 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f922c8fa90 0x55f922c4a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.780+0000 7f18af72db80 1 --2- 172.21.15.146:0/2684066242 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f922c49bd0 0x55f922c44560 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.780+0000 7f18af72db80 1 --2- 172.21.15.146:0/2684066242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f922c4b9a0 0x55f922c45800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.780+0000 7f18af72db80 1 -- 172.21.15.146:0/2684066242 >> 172.21.15.146:0/2684066242 conn(0x55f922c4a070 msgr2=0x55f922c74db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:36.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.780+0000 7f18af72db80 1 -- 172.21.15.146:0/2684066242 shutdown_connections 2023-10-06T11:13:36.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.780+0000 7f18af72db80 1 -- 172.21.15.146:0/2684066242 wait complete. 2023-10-06T11:13:36.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.781+0000 7f18af72db80 1 -- start start 2023-10-06T11:13:36.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.781+0000 7f18af72db80 1 Processor -- start 2023-10-06T11:13:36.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.781+0000 7f18af72db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f922c49bd0 0x55f922c85260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:36.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.782+0000 7f18af72db80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f922c4b9a0 0x55f922c8d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:36.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.782+0000 7f18af72db80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f922c8fa90 0x55f922c6f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:36.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.782+0000 7f18af72db80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f922c857a0 con 0x55f922c8fa90 2023-10-06T11:13:36.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.782+0000 7f18af72db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f922c85bd0 con 0x55f922c49bd0 2023-10-06T11:13:36.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.782+0000 7f18af72db80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f922c70320 con 0x55f922c4b9a0 2023-10-06T11:13:36.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.782+0000 7f18af72db80 10 client.0 _ll_register_callbacks cb 0x55f922a35f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:13:36.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.782+0000 7f18a49d2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f922c8fa90 0x55f922c6f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:36.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.782+0000 7f18a49d2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f922c8fa90 0x55f922c6f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33658/0 (socket says 172.21.15.146:33658) 2023-10-06T11:13:36.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.782+0000 7f18a49d2700 1 -- 172.21.15.146:0/1605280 learned_addr learned my addr 172.21.15.146:0/1605280 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:36.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.782+0000 7f189ffff700 1 --2- 172.21.15.146:0/1605280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f922c49bd0 0x55f922c85260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:36.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.782+0000 7f189f7fe700 1 --2- 172.21.15.146:0/1605280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f922c4b9a0 0x55f922c8d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:36.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.782+0000 7f18a49d2700 1 -- 172.21.15.146:0/1605280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f922c4b9a0 msgr2=0x55f922c8d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:36.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.782+0000 7f18a49d2700 1 --2- 172.21.15.146:0/1605280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f922c4b9a0 0x55f922c8d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.782+0000 7f18a49d2700 1 -- 172.21.15.146:0/1605280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f922c49bd0 msgr2=0x55f922c85260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:36.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.782+0000 7f18a49d2700 1 --2- 172.21.15.146:0/1605280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f922c49bd0 0x55f922c85260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.782+0000 7f18a49d2700 1 -- 172.21.15.146:0/1605280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f189000f040 con 0x55f922c8fa90 2023-10-06T11:13:36.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.782+0000 7f189f7fe700 1 --2- 172.21.15.146:0/1605280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f922c4b9a0 0x55f922c8d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:36.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.782+0000 7f18a49d2700 1 --2- 172.21.15.146:0/1605280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f922c8fa90 0x55f922c6f8d0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f18980097c0 tx=0x7f1898028000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52a6605887667e75 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:36.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.782+0000 7f187e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:13:36.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.782+0000 7f187e7fc700 1 -- 172.21.15.146:0/1605280 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189805a690 con 0x55f922c8fa90 2023-10-06T11:13:36.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.782+0000 7f187e7fc700 1 -- 172.21.15.146:0/1605280 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f189805e3e0 con 0x55f922c8fa90 2023-10-06T11:13:36.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.782+0000 7f18af72db80 1 -- 172.21.15.146:0/1605280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f922c3d690 con 0x55f922c8fa90 2023-10-06T11:13:36.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.782+0000 7f187e7fc700 1 -- 172.21.15.146:0/1605280 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1898057440 con 0x55f922c8fa90 2023-10-06T11:13:36.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.782+0000 7f18af72db80 10 client.7779 fetch_fsmap learned FSMap version 93 2023-10-06T11:13:36.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.782+0000 7f18af72db80 1 -- 172.21.15.146:0/1605280 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x55f922b4e470 con 0x55f922c8fa90 2023-10-06T11:13:36.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.783+0000 7f187e7fc700 1 -- 172.21.15.146:0/1605280 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f922c3d690 con 0x55f922c8fa90 2023-10-06T11:13:36.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.783+0000 7f187e7fc700 1 -- 172.21.15.146:0/1605280 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 93) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f189805df50 con 0x55f922c8fa90 2023-10-06T11:13:36.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.783+0000 7f18af72db80 10 client.7779 fetch_fsmap finished waiting for FSMap version 93 2023-10-06T11:13:36.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.783+0000 7f18af72db80 10 client.7779 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T11:13:36.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.783+0000 7f18af72db80 20 client.7779 populate_metadata read hostname 'smithi146' 2023-10-06T11:13:36.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.783+0000 7f18af72db80 1 --2- 172.21.15.146:0/1605280 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x55f922c4a440 0x55f922c4a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:36.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.783+0000 7f18af72db80 4 client.7779 mds_command: new command op to 7620 tid=0[{"prefix": "status"}] 2023-10-06T11:13:36.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.783+0000 7f18af72db80 1 -- 172.21.15.146:0/1605280 --> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f922b3bb20 con 0x55f922c4a440 2023-10-06T11:13:36.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.783+0000 7f189ffff700 1 --2- 172.21.15.146:0/1605280 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x55f922c4a440 0x55f922c4a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:36.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.783+0000 7f187e7fc700 10 client.7779 ms_handle_connect on v2:172.21.15.146:6834/785131800 2023-10-06T11:13:36.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.783+0000 7f189ffff700 1 --2- 172.21.15.146:0/1605280 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x55f922c4a440 0x55f922c4a810 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c8bfe2583855855 server_cookie=60f2496d019dac32 in_seq=0 out_seq=0 2023-10-06T11:13:36.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.783+0000 7f187e7fc700 1 -- 172.21.15.146:0/1605280 <== mds.0 v2:172.21.15.146:6834/785131800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55f922b3bb20 con 0x55f922c4a440 2023-10-06T11:13:36.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.783+0000 7f187e7fc700 10 client.7779 handle_command_reply: tid=0 2023-10-06T11:13:36.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.783+0000 7f18af72db80 1 client.7779 shutdown 2023-10-06T11:13:36.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.783+0000 7f18af72db80 1 -- 172.21.15.146:0/1605280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f922c8fa90 msgr2=0x55f922c6f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:36.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.783+0000 7f18af72db80 1 --2- 172.21.15.146:0/1605280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f922c8fa90 0x55f922c6f8d0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f18980097c0 tx=0x7f1898028000 comp rx=0 tx=0).stop 2023-10-06T11:13:36.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.783+0000 7f18af72db80 1 -- 172.21.15.146:0/1605280 shutdown_connections 2023-10-06T11:13:36.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.783+0000 7f18af72db80 1 --2- 172.21.15.146:0/1605280 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x55f922c4a440 0x55f922c4a810 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.783+0000 7f18af72db80 1 --2- 172.21.15.146:0/1605280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f922c8fa90 0x55f922c6f8d0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.783+0000 7f18af72db80 1 --2- 172.21.15.146:0/1605280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f922c49bd0 0x55f922c85260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.783+0000 7f187e7fc700 0 client.7779 ms_handle_reset on v2:172.21.15.146:6834/785131800 2023-10-06T11:13:36.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.783+0000 7f18af72db80 1 --2- 172.21.15.146:0/1605280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f922c4b9a0 0x55f922c8d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.783+0000 7f18af72db80 1 -- 172.21.15.146:0/1605280 >> 172.21.15.146:0/1605280 conn(0x55f922c4a070 msgr2=0x55f922c74d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:36.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.784+0000 7f18af72db80 1 -- 172.21.15.146:0/1605280 shutdown_connections 2023-10-06T11:13:36.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.784+0000 7f18af72db80 1 -- 172.21.15.146:0/1605280 wait complete. 2023-10-06T11:13:36.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.784+0000 7f18af72db80 20 client.7779 trim_cache size 0 max 16384 2023-10-06T11:13:36.793 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:13:36.793 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1", 2023-10-06T11:13:36.793 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2023-10-06T11:13:36.793 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 7620, 2023-10-06T11:13:36.793 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2023-10-06T11:13:36.793 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2023-10-06T11:13:36.794 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2023-10-06T11:13:36.794 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 5.8221859619999998, 2023-10-06T11:13:36.794 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 93, 2023-10-06T11:13:36.794 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 101, 2023-10-06T11:13:36.794 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 101, 2023-10-06T11:13:36.794 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 11.926257079999999 2023-10-06T11:13:36.794 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:13:36.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.784+0000 7f18a6435700 1 -- 172.21.15.146:0/227351613 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f188c066f30 msgr2=0x7f188c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:36.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.784+0000 7f18a6435700 1 --2- 172.21.15.146:0/227351613 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f188c066f30 0x7f188c0693e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1890003820 tx=0x7f1890009040 comp rx=0 tx=0).stop 2023-10-06T11:13:36.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.784+0000 7f18a6435700 1 -- 172.21.15.146:0/227351613 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18a015a160 msgr2=0x7f18a009bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:36.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.784+0000 7f18a6435700 1 --2- 172.21.15.146:0/227351613 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18a015a160 0x7f18a009bb70 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f1898009de0 tx=0x7f1898017000 comp rx=0 tx=0).stop 2023-10-06T11:13:36.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.784+0000 7f18a6435700 1 -- 172.21.15.146:0/227351613 shutdown_connections 2023-10-06T11:13:36.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.784+0000 7f18a6435700 1 --2- 172.21.15.146:0/227351613 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f188c066f30 0x7f188c0693e0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.784+0000 7f18a6435700 1 --2- 172.21.15.146:0/227351613 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18a015a160 0x7f18a009bb70 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.784+0000 7f18a6435700 1 --2- 172.21.15.146:0/227351613 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18a00ae730 0x7f18a00ca5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.784+0000 7f18a6435700 1 --2- 172.21.15.146:0/227351613 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18a00cc960 0x7f18a0156930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.784+0000 7f18a6435700 1 -- 172.21.15.146:0/227351613 >> 172.21.15.146:0/227351613 conn(0x7f18a006f380 msgr2=0x7f18a0069be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:36.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.784+0000 7f18a6435700 1 -- 172.21.15.146:0/227351613 shutdown_connections 2023-10-06T11:13:36.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.784+0000 7f18a6435700 1 -- 172.21.15.146:0/227351613 wait complete. 2023-10-06T11:13:36.798 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T11:13:36.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.912+0000 7ff2d8f9e700 1 Processor -- start 2023-10-06T11:13:36.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.912+0000 7ff2d8f9e700 1 -- start start 2023-10-06T11:13:36.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.913+0000 7ff2d8f9e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2d4156230 0x7ff2d40c8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:36.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.913+0000 7ff2d8f9e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff2d406ae20 0x7ff2d4159df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:36.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.913+0000 7ff2d8f9e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff2d415a330 0x7ff2d406e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:36.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.913+0000 7ff2d8f9e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2d415a7b0 con 0x7ff2d415a330 2023-10-06T11:13:36.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.913+0000 7ff2d8f9e700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2d40c8a30 con 0x7ff2d406ae20 2023-10-06T11:13:36.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.913+0000 7ff2d8f9e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d40c8d10 con 0x7ff2d4156230 2023-10-06T11:13:36.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.913+0000 7ff2d3fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff2d415a330 0x7ff2d406e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:36.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.913+0000 7ff2d3fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff2d415a330 0x7ff2d406e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33660/0 (socket says 172.21.15.146:33660) 2023-10-06T11:13:36.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.913+0000 7ff2d3fff700 1 -- 172.21.15.146:0/1035901496 learned_addr learned my addr 172.21.15.146:0/1035901496 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:36.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.913+0000 7ff2d2ffd700 1 --2- 172.21.15.146:0/1035901496 >> v2:172.21.15.151:3300/0 conn(0x7ff2d406ae20 0x7ff2d4159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:36.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.913+0000 7ff2d37fe700 1 --2- 172.21.15.146:0/1035901496 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2d4156230 0x7ff2d40c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:36.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.913+0000 7ff2d3fff700 1 -- 172.21.15.146:0/1035901496 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2d4156230 msgr2=0x7ff2d40c8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:36.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.913+0000 7ff2d3fff700 1 --2- 172.21.15.146:0/1035901496 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2d4156230 0x7ff2d40c8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.913+0000 7ff2d3fff700 1 -- 172.21.15.146:0/1035901496 >> v2:172.21.15.151:3300/0 conn(0x7ff2d406ae20 msgr2=0x7ff2d4159df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:36.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.913+0000 7ff2d3fff700 1 --2- 172.21.15.146:0/1035901496 >> v2:172.21.15.151:3300/0 conn(0x7ff2d406ae20 0x7ff2d4159df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.913+0000 7ff2d3fff700 1 -- 172.21.15.146:0/1035901496 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d40c8ff0 con 0x7ff2d415a330 2023-10-06T11:13:36.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.913+0000 7ff2d37fe700 1 --2- 172.21.15.146:0/1035901496 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2d4156230 0x7ff2d40c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:36.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.913+0000 7ff2d2ffd700 1 --2- 172.21.15.146:0/1035901496 >> v2:172.21.15.151:3300/0 conn(0x7ff2d406ae20 0x7ff2d4159df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:36.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.914+0000 7ff2d3fff700 1 --2- 172.21.15.146:0/1035901496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2d415a330 0x7ff2d406e4b0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7ff2d406d900 tx=0x7ff2cc00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c022f5a96dd3d36c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:36.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.914+0000 7ff2d27fc700 1 -- 172.21.15.146:0/1035901496 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc00dc50 con 0x7ff2d415a330 2023-10-06T11:13:36.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.914+0000 7ff2d27fc700 1 -- 172.21.15.146:0/1035901496 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2cc00ddb0 con 0x7ff2d415a330 2023-10-06T11:13:36.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.914+0000 7ff2d27fc700 1 -- 172.21.15.146:0/1035901496 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc0196d0 con 0x7ff2d415a330 2023-10-06T11:13:36.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.914+0000 7ff2d8f9e700 1 -- 172.21.15.146:0/1035901496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2d415a330 msgr2=0x7ff2d406e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:36.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.914+0000 7ff2d8f9e700 1 --2- 172.21.15.146:0/1035901496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2d415a330 0x7ff2d406e4b0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7ff2d406d900 tx=0x7ff2cc00b4f0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.914+0000 7ff2d8f9e700 1 -- 172.21.15.146:0/1035901496 shutdown_connections 2023-10-06T11:13:36.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.914+0000 7ff2d8f9e700 1 --2- 172.21.15.146:0/1035901496 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2d415a330 0x7ff2d406e4b0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.914+0000 7ff2d8f9e700 1 --2- 172.21.15.146:0/1035901496 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2d4156230 0x7ff2d40c8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.914+0000 7ff2d8f9e700 1 --2- 172.21.15.146:0/1035901496 >> v2:172.21.15.151:3300/0 conn(0x7ff2d406ae20 0x7ff2d4159df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.914+0000 7ff2d8f9e700 1 -- 172.21.15.146:0/1035901496 >> 172.21.15.146:0/1035901496 conn(0x7ff2d4069010 msgr2=0x7ff2d40cd120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:36.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.914+0000 7ff2d8f9e700 1 -- 172.21.15.146:0/1035901496 shutdown_connections 2023-10-06T11:13:36.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.914+0000 7ff2d8f9e700 1 -- 172.21.15.146:0/1035901496 wait complete. 2023-10-06T11:13:36.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.915+0000 7ff2d8f9e700 1 Processor -- start 2023-10-06T11:13:36.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.916+0000 7ff2d8f9e700 1 -- start start 2023-10-06T11:13:36.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.916+0000 7ff2d8f9e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2d406ae20 0x7ff2d40c41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:36.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.916+0000 7ff2d8f9e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2d4156230 0x7ff2d40af130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:36.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.916+0000 7ff2d8f9e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2d415a330 0x7ff2d40b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:36.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.916+0000 7ff2d8f9e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d40b1c10 con 0x7ff2d415a330 2023-10-06T11:13:36.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.916+0000 7ff2d8f9e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d40b1000 con 0x7ff2d4156230 2023-10-06T11:13:36.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.916+0000 7ff2d8f9e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d40b12e0 con 0x7ff2d406ae20 2023-10-06T11:13:36.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.916+0000 7ff2d3fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2d415a330 0x7ff2d40b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:36.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.916+0000 7ff2d3fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2d415a330 0x7ff2d40b20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33672/0 (socket says 172.21.15.146:33672) 2023-10-06T11:13:36.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.916+0000 7ff2d3fff700 1 -- 172.21.15.146:0/2439941458 learned_addr learned my addr 172.21.15.146:0/2439941458 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:36.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.917+0000 7ff2d37fe700 1 --2- 172.21.15.146:0/2439941458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2d406ae20 0x7ff2d40c41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:36.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.917+0000 7ff2d2ffd700 1 --2- 172.21.15.146:0/2439941458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2d4156230 0x7ff2d40af130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:36.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.917+0000 7ff2d3fff700 1 -- 172.21.15.146:0/2439941458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2d406ae20 msgr2=0x7ff2d40c41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:36.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.917+0000 7ff2d3fff700 1 --2- 172.21.15.146:0/2439941458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2d406ae20 0x7ff2d40c41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.917+0000 7ff2d3fff700 1 -- 172.21.15.146:0/2439941458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2d4156230 msgr2=0x7ff2d40af130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:36.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.917+0000 7ff2d3fff700 1 --2- 172.21.15.146:0/2439941458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2d4156230 0x7ff2d40af130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:36.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.917+0000 7ff2d3fff700 1 -- 172.21.15.146:0/2439941458 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2cc00b790 con 0x7ff2d415a330 2023-10-06T11:13:36.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.917+0000 7ff2d2ffd700 1 --2- 172.21.15.146:0/2439941458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2d4156230 0x7ff2d40af130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:36.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.917+0000 7ff2d3fff700 1 --2- 172.21.15.146:0/2439941458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2d415a330 0x7ff2d40b20a0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc00b760 tx=0x7ff2cc01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:36.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.917+0000 7ff2bb7fe700 1 -- 172.21.15.146:0/2439941458 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc00dc50 con 0x7ff2d415a330 2023-10-06T11:13:36.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.917+0000 7ff2d8f9e700 1 -- 172.21.15.146:0/2439941458 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d40b15c0 con 0x7ff2d415a330 2023-10-06T11:13:36.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.917+0000 7ff2bb7fe700 1 -- 172.21.15.146:0/2439941458 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2cc01ae50 con 0x7ff2d415a330 2023-10-06T11:13:36.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.917+0000 7ff2bb7fe700 1 -- 172.21.15.146:0/2439941458 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc010c60 con 0x7ff2d415a330 2023-10-06T11:13:36.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.917+0000 7ff2d8f9e700 1 -- 172.21.15.146:0/2439941458 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d40c4710 con 0x7ff2d415a330 2023-10-06T11:13:36.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.918+0000 7ff2d8f9e700 1 -- 172.21.15.146:0/2439941458 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d40b1dc0 con 0x7ff2d415a330 2023-10-06T11:13:36.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.918+0000 7ff2bb7fe700 1 -- 172.21.15.146:0/2439941458 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff2cc022030 con 0x7ff2d415a330 2023-10-06T11:13:36.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.919+0000 7ff2bb7fe700 1 --2- 172.21.15.146:0/2439941458 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff2c0066f30 0x7ff2c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:36.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.919+0000 7ff2bb7fe700 1 -- 172.21.15.146:0/2439941458 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff2cc014070 con 0x7ff2d415a330 2023-10-06T11:13:36.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.919+0000 7ff2d37fe700 1 --2- 172.21.15.146:0/2439941458 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff2c0066f30 0x7ff2c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:36.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.919+0000 7ff2d37fe700 1 --2- 172.21.15.146:0/2439941458 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff2c0066f30 0x7ff2c00693e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7ff2c400d6e0 tx=0x7ff2c4007850 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:36.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:36.923+0000 7ff2bb7fe700 1 -- 172.21.15.146:0/2439941458 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff2d40b1dc0 con 0x7ff2d415a330 2023-10-06T11:13:37.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:37.151+0000 7ff2d8f9e700 1 -- 172.21.15.146:0/2439941458 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff2d40b1dc0 con 0x7ff2d415a330 2023-10-06T11:13:37.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:37.151+0000 7ff2bb7fe700 1 -- 172.21.15.146:0/2439941458 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v93) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff2d40b1dc0 con 0x7ff2d415a330 2023-10-06T11:13:37.153 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T11:13:37.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:37.153+0000 7ff2d8f9e700 1 -- 172.21.15.146:0/2439941458 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff2c0066f30 msgr2=0x7ff2c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:37.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:37.153+0000 7ff2d8f9e700 1 --2- 172.21.15.146:0/2439941458 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff2c0066f30 0x7ff2c00693e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7ff2c400d6e0 tx=0x7ff2c4007850 comp rx=0 tx=0).stop 2023-10-06T11:13:37.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:37.153+0000 7ff2d8f9e700 1 -- 172.21.15.146:0/2439941458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2d415a330 msgr2=0x7ff2d40b20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:37.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:37.153+0000 7ff2d8f9e700 1 --2- 172.21.15.146:0/2439941458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2d415a330 0x7ff2d40b20a0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc00b760 tx=0x7ff2cc01b000 comp rx=0 tx=0).stop 2023-10-06T11:13:37.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:37.153+0000 7ff2d8f9e700 1 -- 172.21.15.146:0/2439941458 shutdown_connections 2023-10-06T11:13:37.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:37.153+0000 7ff2d8f9e700 1 --2- 172.21.15.146:0/2439941458 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff2c0066f30 0x7ff2c00693e0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:37.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:37.153+0000 7ff2d8f9e700 1 --2- 172.21.15.146:0/2439941458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff2d415a330 0x7ff2d40b20a0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:37.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:37.153+0000 7ff2d8f9e700 1 --2- 172.21.15.146:0/2439941458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2d406ae20 0x7ff2d40c41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:37.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:37.153+0000 7ff2d8f9e700 1 --2- 172.21.15.146:0/2439941458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2d4156230 0x7ff2d40af130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:37.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:37.153+0000 7ff2d8f9e700 1 -- 172.21.15.146:0/2439941458 >> 172.21.15.146:0/2439941458 conn(0x7ff2d4069010 msgr2=0x7ff2d4154190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:37.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:37.153+0000 7ff2d8f9e700 1 -- 172.21.15.146:0/2439941458 shutdown_connections 2023-10-06T11:13:37.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:37.153+0000 7ff2d8f9e700 1 -- 172.21.15.146:0/2439941458 wait complete. 2023-10-06T11:13:37.167 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T11:13:37.168 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T11:13:37.168 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2023-10-06T11:13:37.168 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T11:13:37.168 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T11:13:37.168 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T11:13:37.168 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T11:13:37.168 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T11:13:37.168 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:13:37.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:37.169 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2023-10-06T11:13:37.185 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:13:37.185 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:13:37.185 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:13:37.186 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:13:37.186 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2023-10-06T11:13:37.186 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:13:37.186 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:13:37.186 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2023-10-06T11:13:37.186 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2023-10-06T11:13:37.186 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:13:37.186 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2023-10-06T11:13:37.186 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2023-10-06T11:13:37.186 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:13:37.186 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2023-10-06T11:13:37.187 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T11:13:37.187 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2023-10-06T11:13:37.187 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T11:13:37.187 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 42040sec preferred_lft 42040sec 2023-10-06T11:13:37.187 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link noprefixroute 2023-10-06T11:13:37.187 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:13:37.187 INFO:teuthology.orchestra.run.smithi146.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T11:13:37.187 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0e:4f:33:80:c4:0e brd ff:ff:ff:ff:ff:ff 2023-10-06T11:13:37.187 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T11:13:37.187 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:13:37.187 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3884:6eff:fefc:ffc7/64 scope link 2023-10-06T11:13:37.187 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:13:37.188 INFO:teuthology.orchestra.run.smithi146.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:13:37.188 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0e:4f:33:80:c4:0e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T11:13:37.188 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::c4f:33ff:fe80:c40e/64 scope link 2023-10-06T11:13:37.188 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:13:37.188 INFO:teuthology.orchestra.run.smithi146.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:13:37.188 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 36:96:28:73:57:c4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T11:13:37.188 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3496:28ff:fe73:57c4/64 scope link 2023-10-06T11:13:37.188 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:13:37.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:37.189 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T11:13:37.249 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-06T11:13:37.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:37.251 DEBUG:teuthology.orchestra.run.smithi146:> route 2023-10-06T11:13:37.306 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2023-10-06T11:13:37.307 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T11:13:37.307 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T11:13:37.307 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T11:13:37.307 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T11:13:37.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:37.307 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-10-06T11:13:37.307 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:37.307 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T11:13:37.307 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T11:13:37.308 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T11:13:37.308 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:37.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:37.407 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-10-06T11:13:37.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T11:13:37.422 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T11:13:37.423 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:13:37.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:13:37.423 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2023-10-06T11:13:37.487 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T11:13:37.487 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:13:37.488 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T11:13:37.542 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:13:37.543 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:13:37.543 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:13:37.597 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-06T11:13:37.661 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:13:37.661 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:13:37.725 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:13:37.726 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:13:37.727 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:37.727 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-06T11:13:37.782 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T11:13:37.782 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T11:13:37.825 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-06T11:13:37.849 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:13:37.849 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:13:37.905 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:2023-10-06T11:13:37.903+0000 7f38692be540 -1 init, newargv = 0x558e908dcca0 newargc=15 2023-10-06T11:13:37.905 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[134946]: starting ceph client 2023-10-06T11:13:37.909 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[134946]: starting fuse 2023-10-06T11:13:37.914 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:13:37.915 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:13:37.915 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:37.916 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-06T11:13:37.970 INFO:teuthology.orchestra.run.smithi146.stdout:46 2023-10-06T11:13:37.971 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-06T11:13:37.971 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T11:13:37.971 DEBUG:teuthology.orchestra.run.smithi146:> import glob 2023-10-06T11:13:37.971 DEBUG:teuthology.orchestra.run.smithi146:> import re 2023-10-06T11:13:37.971 DEBUG:teuthology.orchestra.run.smithi146:> import os 2023-10-06T11:13:37.971 DEBUG:teuthology.orchestra.run.smithi146:> import subprocess 2023-10-06T11:13:37.971 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:13:37.972 DEBUG:teuthology.orchestra.run.smithi146:> def _find_admin_socket(client_name): 2023-10-06T11:13:37.972 DEBUG:teuthology.orchestra.run.smithi146:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T11:13:37.972 DEBUG:teuthology.orchestra.run.smithi146:> files = glob.glob(asok_path) 2023-10-06T11:13:37.972 DEBUG:teuthology.orchestra.run.smithi146:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T11:13:37.972 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:13:37.972 DEBUG:teuthology.orchestra.run.smithi146:> # Given a non-glob path, it better be there 2023-10-06T11:13:37.972 DEBUG:teuthology.orchestra.run.smithi146:> if "*" not in asok_path: 2023-10-06T11:13:37.972 DEBUG:teuthology.orchestra.run.smithi146:> assert(len(files) == 1) 2023-10-06T11:13:37.972 DEBUG:teuthology.orchestra.run.smithi146:> return files[0] 2023-10-06T11:13:37.972 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:13:37.972 DEBUG:teuthology.orchestra.run.smithi146:> for f in files: 2023-10-06T11:13:37.972 DEBUG:teuthology.orchestra.run.smithi146:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T11:13:37.972 DEBUG:teuthology.orchestra.run.smithi146:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T11:13:37.973 DEBUG:teuthology.orchestra.run.smithi146:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T11:13:37.973 DEBUG:teuthology.orchestra.run.smithi146:> contents = proc_f.read() 2023-10-06T11:13:37.973 DEBUG:teuthology.orchestra.run.smithi146:> if mountpoint in contents: 2023-10-06T11:13:37.973 DEBUG:teuthology.orchestra.run.smithi146:> return f 2023-10-06T11:13:37.973 DEBUG:teuthology.orchestra.run.smithi146:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T11:13:37.973 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:13:37.973 DEBUG:teuthology.orchestra.run.smithi146:> print(_find_admin_socket("client.0")) 2023-10-06T11:13:37.973 DEBUG:teuthology.orchestra.run.smithi146:> ' 2023-10-06T11:13:38.092 INFO:teuthology.orchestra.run.smithi146.stdout:/var/run/ceph/ceph-client.0.134946.asok 2023-10-06T11:13:38.274 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.134946.asok 2023-10-06T11:13:38.274 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:38.275 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.134946.asok status 2023-10-06T11:13:38.428 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:13:38.428 INFO:teuthology.orchestra.run.smithi146.stdout: "metadata": { 2023-10-06T11:13:38.428 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T11:13:38.428 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T11:13:38.429 INFO:teuthology.orchestra.run.smithi146.stdout: "entity_id": "0", 2023-10-06T11:13:38.429 INFO:teuthology.orchestra.run.smithi146.stdout: "hostname": "smithi146", 2023-10-06T11:13:38.429 INFO:teuthology.orchestra.run.smithi146.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T11:13:38.429 INFO:teuthology.orchestra.run.smithi146.stdout: "pid": "134946", 2023-10-06T11:13:38.429 INFO:teuthology.orchestra.run.smithi146.stdout: "root": "/" 2023-10-06T11:13:38.429 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:13:38.429 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_count": 0, 2023-10-06T11:13:38.429 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_pinned_count": 0, 2023-10-06T11:13:38.429 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 7791, 2023-10-06T11:13:38.429 INFO:teuthology.orchestra.run.smithi146.stdout: "inst": { 2023-10-06T11:13:38.429 INFO:teuthology.orchestra.run.smithi146.stdout: "name": { 2023-10-06T11:13:38.429 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "client", 2023-10-06T11:13:38.430 INFO:teuthology.orchestra.run.smithi146.stdout: "num": 7791 2023-10-06T11:13:38.430 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:13:38.430 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-06T11:13:38.430 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-06T11:13:38.430 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:13:38.430 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 259141725 2023-10-06T11:13:38.430 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:13:38.430 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:13:38.430 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-06T11:13:38.430 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-06T11:13:38.431 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:13:38.431 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 259141725 2023-10-06T11:13:38.431 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:13:38.431 INFO:teuthology.orchestra.run.smithi146.stdout: "inst_str": "client.7791 192.168.0.1:0/259141725", 2023-10-06T11:13:38.431 INFO:teuthology.orchestra.run.smithi146.stdout: "addr_str": "192.168.0.1:0/259141725", 2023-10-06T11:13:38.431 INFO:teuthology.orchestra.run.smithi146.stdout: "inode_count": 1, 2023-10-06T11:13:38.431 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_epoch": 93, 2023-10-06T11:13:38.431 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch": 101, 2023-10-06T11:13:38.431 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch_barrier": 0, 2023-10-06T11:13:38.431 INFO:teuthology.orchestra.run.smithi146.stdout: "blocklisted": false, 2023-10-06T11:13:38.431 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs" 2023-10-06T11:13:38.432 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:13:38.439 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:38.439 DEBUG:teuthology.orchestra.run.smithi146:> stat --file-system '--printf=%T 2023-10-06T11:13:38.439 DEBUG:teuthology.orchestra.run.smithi146:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T11:13:38.455 INFO:teuthology.orchestra.run.smithi146.stdout:fuseblk 2023-10-06T11:13:38.455 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T11:13:38.456 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:38.456 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:13:38.521 INFO:tasks.cephfs.test_scrub_checks:mountpoint: /home/ubuntu/cephtest/mnt.0 2023-10-06T11:13:38.521 INFO:tasks.cephfs.test_scrub_checks:client_path: /home/ubuntu/cephtest/mnt.0/scrub_control_test_path 2023-10-06T11:13:38.521 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:38.521 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:38.522 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:38.522 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.0 2023-10-06T11:13:38.522 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:38.522 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:38.522 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:38.522 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:38.621 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:38.621 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:38.621 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0135731 s, 77.3 MB/s 2023-10-06T11:13:38.634 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:38.634 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:38.634 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010714 s, 97.9 MB/s 2023-10-06T11:13:38.649 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:38.649 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:38.649 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0128187 s, 81.8 MB/s 2023-10-06T11:13:38.661 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:38.661 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:38.662 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0099153 s, 106 MB/s 2023-10-06T11:13:38.673 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:38.673 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:38.673 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0097574 s, 107 MB/s 2023-10-06T11:13:38.686 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:38.686 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:38.686 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104324 s, 101 MB/s 2023-10-06T11:13:38.702 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:38.702 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:38.702 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140962 s, 74.4 MB/s 2023-10-06T11:13:38.714 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:38.714 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:38.714 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00988817 s, 106 MB/s 2023-10-06T11:13:38.727 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:38.727 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:38.727 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105337 s, 99.5 MB/s 2023-10-06T11:13:38.740 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:38.740 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:38.740 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109466 s, 95.8 MB/s 2023-10-06T11:13:38.753 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:38.754 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:38.754 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115146 s, 91.1 MB/s 2023-10-06T11:13:38.764 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:38.765 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:38.765 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00878966 s, 119 MB/s 2023-10-06T11:13:38.776 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:38.776 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:38.776 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00907909 s, 115 MB/s 2023-10-06T11:13:38.789 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:38.789 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:38.789 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109296 s, 95.9 MB/s 2023-10-06T11:13:38.802 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:38.802 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:38.802 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105322 s, 99.6 MB/s 2023-10-06T11:13:38.814 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:38.814 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:38.814 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00993876 s, 106 MB/s 2023-10-06T11:13:38.826 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:38.826 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:38.826 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00997422 s, 105 MB/s 2023-10-06T11:13:38.838 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:38.838 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:38.838 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00966018 s, 109 MB/s 2023-10-06T11:13:38.851 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:38.851 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:38.851 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106864 s, 98.1 MB/s 2023-10-06T11:13:38.863 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:38.864 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:38.864 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104627 s, 100 MB/s 2023-10-06T11:13:38.875 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:38.876 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:38.876 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100795 s, 104 MB/s 2023-10-06T11:13:38.888 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:38.888 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:38.888 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101095 s, 104 MB/s 2023-10-06T11:13:38.901 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:38.901 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:38.902 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011228 s, 93.4 MB/s 2023-10-06T11:13:38.912 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:38.912 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:38.912 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00909249 s, 115 MB/s 2023-10-06T11:13:38.924 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:38.924 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:38.924 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00884 s, 119 MB/s 2023-10-06T11:13:38.935 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:38.935 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:38.935 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00931506 s, 113 MB/s 2023-10-06T11:13:38.948 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:38.948 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:38.948 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010253 s, 102 MB/s 2023-10-06T11:13:38.958 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:38.958 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:38.959 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00912687 s, 115 MB/s 2023-10-06T11:13:38.970 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:38.970 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:38.971 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00966819 s, 108 MB/s 2023-10-06T11:13:38.982 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:38.982 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:38.983 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0099432 s, 105 MB/s 2023-10-06T11:13:38.995 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:38.996 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:38.996 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111131 s, 94.4 MB/s 2023-10-06T11:13:39.006 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.007 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.007 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.008839 s, 119 MB/s 2023-10-06T11:13:39.008 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:39.008 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:39.008 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:39.008 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.1 2023-10-06T11:13:39.008 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:39.008 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:39.008 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:39.008 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:39.049 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.050 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.050 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00888678 s, 118 MB/s 2023-10-06T11:13:39.061 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.061 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.062 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00994443 s, 105 MB/s 2023-10-06T11:13:39.073 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.074 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.074 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00977426 s, 107 MB/s 2023-10-06T11:13:39.086 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.086 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.086 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103553 s, 101 MB/s 2023-10-06T11:13:39.098 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.099 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.099 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102204 s, 103 MB/s 2023-10-06T11:13:39.111 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.111 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.111 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108253 s, 96.9 MB/s 2023-10-06T11:13:39.124 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.124 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.124 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105724 s, 99.2 MB/s 2023-10-06T11:13:39.136 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.136 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.137 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010628 s, 98.7 MB/s 2023-10-06T11:13:39.147 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.147 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.148 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00872927 s, 120 MB/s 2023-10-06T11:13:39.158 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.158 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.158 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00880124 s, 119 MB/s 2023-10-06T11:13:39.169 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.170 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.170 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00895675 s, 117 MB/s 2023-10-06T11:13:39.183 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.184 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.184 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112868 s, 92.9 MB/s 2023-10-06T11:13:39.196 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.197 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.197 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105666 s, 99.2 MB/s 2023-10-06T11:13:39.207 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.207 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.208 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00918812 s, 114 MB/s 2023-10-06T11:13:39.218 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.218 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.218 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00868429 s, 121 MB/s 2023-10-06T11:13:39.231 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.231 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.231 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107816 s, 97.3 MB/s 2023-10-06T11:13:39.244 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.244 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.244 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104911 s, 99.9 MB/s 2023-10-06T11:13:39.256 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.256 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.256 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102349 s, 102 MB/s 2023-10-06T11:13:39.268 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.269 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.269 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104025 s, 101 MB/s 2023-10-06T11:13:39.279 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.279 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.280 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00886008 s, 118 MB/s 2023-10-06T11:13:39.293 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.293 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.293 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00993424 s, 106 MB/s 2023-10-06T11:13:39.304 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.304 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.304 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100045 s, 105 MB/s 2023-10-06T11:13:39.316 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.317 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.317 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00989569 s, 106 MB/s 2023-10-06T11:13:39.328 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.328 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.328 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00986985 s, 106 MB/s 2023-10-06T11:13:39.341 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.341 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.341 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00993212 s, 106 MB/s 2023-10-06T11:13:39.351 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.351 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.352 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00893667 s, 117 MB/s 2023-10-06T11:13:39.364 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.364 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.364 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102267 s, 103 MB/s 2023-10-06T11:13:39.375 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.375 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.375 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00920616 s, 114 MB/s 2023-10-06T11:13:39.386 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.386 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.387 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00903406 s, 116 MB/s 2023-10-06T11:13:39.399 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.399 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.399 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104882 s, 100 MB/s 2023-10-06T11:13:39.412 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.412 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.412 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104006 s, 101 MB/s 2023-10-06T11:13:39.422 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.423 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.423 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00879062 s, 119 MB/s 2023-10-06T11:13:39.424 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:39.424 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:39.424 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:39.424 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.2 2023-10-06T11:13:39.424 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:39.424 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:39.424 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:39.424 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:39.507 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.507 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.507 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107989 s, 97.1 MB/s 2023-10-06T11:13:39.518 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.518 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.519 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0098185 s, 107 MB/s 2023-10-06T11:13:39.530 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.530 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.531 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102059 s, 103 MB/s 2023-10-06T11:13:39.541 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.542 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.542 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00882253 s, 119 MB/s 2023-10-06T11:13:39.553 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.554 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.554 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00967389 s, 108 MB/s 2023-10-06T11:13:39.566 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.566 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.566 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103046 s, 102 MB/s 2023-10-06T11:13:39.577 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.577 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.577 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00883173 s, 119 MB/s 2023-10-06T11:13:39.588 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.588 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.588 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00880023 s, 119 MB/s 2023-10-06T11:13:39.601 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.601 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.601 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105854 s, 99.1 MB/s 2023-10-06T11:13:39.613 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.613 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.613 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00977414 s, 107 MB/s 2023-10-06T11:13:39.626 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.626 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.626 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106416 s, 98.5 MB/s 2023-10-06T11:13:39.639 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.639 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.639 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101096 s, 104 MB/s 2023-10-06T11:13:39.652 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.652 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.652 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107759 s, 97.3 MB/s 2023-10-06T11:13:39.665 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.665 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.665 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100416 s, 104 MB/s 2023-10-06T11:13:39.676 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.676 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.676 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00883587 s, 119 MB/s 2023-10-06T11:13:39.688 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.688 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.688 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00961879 s, 109 MB/s 2023-10-06T11:13:39.701 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.701 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.701 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00992114 s, 106 MB/s 2023-10-06T11:13:39.713 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.713 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.713 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00988901 s, 106 MB/s 2023-10-06T11:13:39.725 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.726 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.726 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00986774 s, 106 MB/s 2023-10-06T11:13:39.738 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.738 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.738 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00970734 s, 108 MB/s 2023-10-06T11:13:39.750 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.750 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.751 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101313 s, 103 MB/s 2023-10-06T11:13:39.762 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.762 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.762 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00889569 s, 118 MB/s 2023-10-06T11:13:39.774 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.775 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.775 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100669 s, 104 MB/s 2023-10-06T11:13:39.787 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.787 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.787 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100931 s, 104 MB/s 2023-10-06T11:13:39.799 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.800 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.800 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104794 s, 100 MB/s 2023-10-06T11:13:39.812 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.812 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.812 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010196 s, 103 MB/s 2023-10-06T11:13:39.825 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.825 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.825 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105588 s, 99.3 MB/s 2023-10-06T11:13:39.836 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.836 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.837 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00865882 s, 121 MB/s 2023-10-06T11:13:39.849 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.849 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.849 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00979053 s, 107 MB/s 2023-10-06T11:13:39.861 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.861 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.861 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00979253 s, 107 MB/s 2023-10-06T11:13:39.874 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.874 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.874 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101135 s, 104 MB/s 2023-10-06T11:13:39.886 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.886 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.886 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00932232 s, 112 MB/s 2023-10-06T11:13:39.887 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:39.888 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:39.888 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:39.888 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.3 2023-10-06T11:13:39.888 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:39.888 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:39.888 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:39.888 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:39.969 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.969 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.970 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00926927 s, 113 MB/s 2023-10-06T11:13:39.981 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.981 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.981 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00982682 s, 107 MB/s 2023-10-06T11:13:39.994 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:39.994 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:39.994 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103215 s, 102 MB/s 2023-10-06T11:13:40.007 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.007 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.007 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109717 s, 95.6 MB/s 2023-10-06T11:13:40.019 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.019 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.019 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00982871 s, 107 MB/s 2023-10-06T11:13:40.031 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.031 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.032 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101725 s, 103 MB/s 2023-10-06T11:13:40.044 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.044 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.044 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107283 s, 97.7 MB/s 2023-10-06T11:13:40.055 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.056 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.056 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00909225 s, 115 MB/s 2023-10-06T11:13:40.068 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.068 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.068 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102564 s, 102 MB/s 2023-10-06T11:13:40.080 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.080 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.080 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100184 s, 105 MB/s 2023-10-06T11:13:40.093 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.093 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.093 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105731 s, 99.2 MB/s 2023-10-06T11:13:40.105 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.105 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.105 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00982527 s, 107 MB/s 2023-10-06T11:13:40.118 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.118 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.118 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101624 s, 103 MB/s 2023-10-06T11:13:40.130 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.130 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.130 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100578 s, 104 MB/s 2023-10-06T11:13:40.143 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.143 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.143 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108003 s, 97.1 MB/s 2023-10-06T11:13:40.155 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.155 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.156 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100083 s, 105 MB/s 2023-10-06T11:13:40.168 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.168 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.169 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109316 s, 95.9 MB/s 2023-10-06T11:13:40.182 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.182 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.182 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117399 s, 89.3 MB/s 2023-10-06T11:13:40.194 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.195 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.195 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100447 s, 104 MB/s 2023-10-06T11:13:40.207 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.207 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.207 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101532 s, 103 MB/s 2023-10-06T11:13:40.219 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.219 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.219 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00959273 s, 109 MB/s 2023-10-06T11:13:40.231 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.231 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.232 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00997695 s, 105 MB/s 2023-10-06T11:13:40.243 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.243 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.243 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00944253 s, 111 MB/s 2023-10-06T11:13:40.254 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.254 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.254 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00917212 s, 114 MB/s 2023-10-06T11:13:40.267 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.267 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.267 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104541 s, 100 MB/s 2023-10-06T11:13:40.279 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.279 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.280 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102187 s, 103 MB/s 2023-10-06T11:13:40.291 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.291 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.291 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00919605 s, 114 MB/s 2023-10-06T11:13:40.301 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.302 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.302 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00870083 s, 121 MB/s 2023-10-06T11:13:40.314 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.314 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.314 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102896 s, 102 MB/s 2023-10-06T11:13:40.327 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.327 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.327 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109023 s, 96.2 MB/s 2023-10-06T11:13:40.340 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.340 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.340 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106147 s, 98.8 MB/s 2023-10-06T11:13:40.353 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.353 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.353 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010867 s, 96.5 MB/s 2023-10-06T11:13:40.354 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:40.354 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:40.354 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:40.354 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.4 2023-10-06T11:13:40.354 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:40.355 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:40.355 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:40.355 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:40.437 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.438 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.438 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01036 s, 101 MB/s 2023-10-06T11:13:40.450 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.450 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.450 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00998693 s, 105 MB/s 2023-10-06T11:13:40.461 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.461 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.462 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00982659 s, 107 MB/s 2023-10-06T11:13:40.474 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.474 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.474 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102715 s, 102 MB/s 2023-10-06T11:13:40.485 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.485 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.486 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00916184 s, 114 MB/s 2023-10-06T11:13:40.498 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.498 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.498 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00994177 s, 105 MB/s 2023-10-06T11:13:40.510 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.510 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.510 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104795 s, 100 MB/s 2023-10-06T11:13:40.524 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.524 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.524 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110978 s, 94.5 MB/s 2023-10-06T11:13:40.536 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.536 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.536 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101245 s, 104 MB/s 2023-10-06T11:13:40.548 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.548 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.548 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00981432 s, 107 MB/s 2023-10-06T11:13:40.559 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.559 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.560 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00916556 s, 114 MB/s 2023-10-06T11:13:40.572 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.572 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.572 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00995548 s, 105 MB/s 2023-10-06T11:13:40.584 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.584 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.584 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101278 s, 104 MB/s 2023-10-06T11:13:40.596 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.596 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.596 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0098664 s, 106 MB/s 2023-10-06T11:13:40.609 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.609 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.609 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109112 s, 96.1 MB/s 2023-10-06T11:13:40.622 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.622 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.622 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101976 s, 103 MB/s 2023-10-06T11:13:40.634 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.634 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.634 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00992997 s, 106 MB/s 2023-10-06T11:13:40.647 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.647 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.647 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103904 s, 101 MB/s 2023-10-06T11:13:40.658 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.658 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.658 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00909184 s, 115 MB/s 2023-10-06T11:13:40.670 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.670 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.670 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00991185 s, 106 MB/s 2023-10-06T11:13:40.682 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.682 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.682 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100118 s, 105 MB/s 2023-10-06T11:13:40.694 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.694 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.694 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0091162 s, 115 MB/s 2023-10-06T11:13:40.705 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.705 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.705 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00901602 s, 116 MB/s 2023-10-06T11:13:40.718 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.718 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.718 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107556 s, 97.5 MB/s 2023-10-06T11:13:40.731 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.731 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.731 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105944 s, 99.0 MB/s 2023-10-06T11:13:40.742 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.742 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.742 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00903512 s, 116 MB/s 2023-10-06T11:13:40.754 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.755 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.755 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101929 s, 103 MB/s 2023-10-06T11:13:40.767 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.767 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.767 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103527 s, 101 MB/s 2023-10-06T11:13:40.780 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.780 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.780 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105239 s, 99.6 MB/s 2023-10-06T11:13:40.792 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.792 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.792 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100485 s, 104 MB/s 2023-10-06T11:13:40.804 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.804 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.804 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00989822 s, 106 MB/s 2023-10-06T11:13:40.817 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.817 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.817 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105794 s, 99.1 MB/s 2023-10-06T11:13:40.818 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:40.818 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:40.818 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:40.819 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.5 2023-10-06T11:13:40.819 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:40.819 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:40.819 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:40.819 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:40.900 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.900 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.900 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00877737 s, 119 MB/s 2023-10-06T11:13:40.912 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.913 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.913 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102306 s, 102 MB/s 2023-10-06T11:13:40.925 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.925 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.925 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00994592 s, 105 MB/s 2023-10-06T11:13:40.936 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.936 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.936 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00890697 s, 118 MB/s 2023-10-06T11:13:40.948 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.948 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.949 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104285 s, 101 MB/s 2023-10-06T11:13:40.960 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.960 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.961 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00973674 s, 108 MB/s 2023-10-06T11:13:40.972 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.972 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.972 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00963125 s, 109 MB/s 2023-10-06T11:13:40.983 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.984 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.984 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00881254 s, 119 MB/s 2023-10-06T11:13:40.996 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:40.996 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:40.996 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105118 s, 99.8 MB/s 2023-10-06T11:13:41.008 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.009 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.009 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102362 s, 102 MB/s 2023-10-06T11:13:41.019 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.020 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.020 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00864068 s, 121 MB/s 2023-10-06T11:13:41.031 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.031 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.032 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.009129 s, 115 MB/s 2023-10-06T11:13:41.043 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.043 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.043 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101067 s, 104 MB/s 2023-10-06T11:13:41.056 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.056 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.056 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010554 s, 99.4 MB/s 2023-10-06T11:13:41.068 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.068 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.068 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010149 s, 103 MB/s 2023-10-06T11:13:41.081 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.081 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.081 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103778 s, 101 MB/s 2023-10-06T11:13:41.093 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.094 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.094 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105306 s, 99.6 MB/s 2023-10-06T11:13:41.106 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.106 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.107 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106229 s, 98.7 MB/s 2023-10-06T11:13:41.118 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.119 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.119 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0099649 s, 105 MB/s 2023-10-06T11:13:41.131 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.131 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.131 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101868 s, 103 MB/s 2023-10-06T11:13:41.144 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.144 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.144 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104696 s, 100 MB/s 2023-10-06T11:13:41.155 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.155 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.155 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00882929 s, 119 MB/s 2023-10-06T11:13:41.168 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.168 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.168 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109897 s, 95.4 MB/s 2023-10-06T11:13:41.181 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.181 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.181 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101348 s, 103 MB/s 2023-10-06T11:13:41.193 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.193 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.193 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102929 s, 102 MB/s 2023-10-06T11:13:41.204 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.204 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.204 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00901775 s, 116 MB/s 2023-10-06T11:13:41.217 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.217 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.217 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00999397 s, 105 MB/s 2023-10-06T11:13:41.230 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.230 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.230 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011106 s, 94.4 MB/s 2023-10-06T11:13:41.242 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.242 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.242 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00966906 s, 108 MB/s 2023-10-06T11:13:41.255 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.255 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.256 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111605 s, 94.0 MB/s 2023-10-06T11:13:41.268 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.268 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.268 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100373 s, 104 MB/s 2023-10-06T11:13:41.281 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.281 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.281 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010581 s, 99.1 MB/s 2023-10-06T11:13:41.282 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:41.282 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:41.282 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:41.282 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.6 2023-10-06T11:13:41.282 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:41.282 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:41.282 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:41.283 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:41.366 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.366 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.366 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104581 s, 100 MB/s 2023-10-06T11:13:41.378 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.378 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.378 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00991379 s, 106 MB/s 2023-10-06T11:13:41.391 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.391 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.391 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106381 s, 98.6 MB/s 2023-10-06T11:13:41.404 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.404 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.404 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108412 s, 96.7 MB/s 2023-10-06T11:13:41.416 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.416 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.416 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0097985 s, 107 MB/s 2023-10-06T11:13:41.428 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.428 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.429 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102201 s, 103 MB/s 2023-10-06T11:13:41.441 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.441 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.441 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104942 s, 99.9 MB/s 2023-10-06T11:13:41.453 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.453 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.453 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00983578 s, 107 MB/s 2023-10-06T11:13:41.466 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.466 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.466 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109607 s, 95.7 MB/s 2023-10-06T11:13:41.477 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.477 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.477 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00884338 s, 119 MB/s 2023-10-06T11:13:41.490 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.490 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.490 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104878 s, 100 MB/s 2023-10-06T11:13:41.502 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.549 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.549 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104763 s, 100 MB/s 2023-10-06T11:13:41.550 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.550 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.550 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010161 s, 103 MB/s 2023-10-06T11:13:41.550 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.550 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.550 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00861647 s, 122 MB/s 2023-10-06T11:13:41.550 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.550 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.550 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00921526 s, 114 MB/s 2023-10-06T11:13:41.551 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.551 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.551 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00972552 s, 108 MB/s 2023-10-06T11:13:41.562 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.562 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.562 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105506 s, 99.4 MB/s 2023-10-06T11:13:41.574 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.574 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.574 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00973031 s, 108 MB/s 2023-10-06T11:13:41.586 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.586 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.586 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102616 s, 102 MB/s 2023-10-06T11:13:41.597 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.597 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.597 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0087308 s, 120 MB/s 2023-10-06T11:13:41.609 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.610 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.610 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00955981 s, 110 MB/s 2023-10-06T11:13:41.620 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.620 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.620 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00862603 s, 122 MB/s 2023-10-06T11:13:41.633 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.633 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.633 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010528 s, 99.6 MB/s 2023-10-06T11:13:41.645 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.645 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.645 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100341 s, 105 MB/s 2023-10-06T11:13:41.658 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.658 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.658 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103759 s, 101 MB/s 2023-10-06T11:13:41.671 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.671 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.671 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104092 s, 101 MB/s 2023-10-06T11:13:41.683 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.683 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.683 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103005 s, 102 MB/s 2023-10-06T11:13:41.696 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.697 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.697 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110763 s, 94.7 MB/s 2023-10-06T11:13:41.709 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.709 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.709 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103837 s, 101 MB/s 2023-10-06T11:13:41.721 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.721 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.721 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100281 s, 105 MB/s 2023-10-06T11:13:41.733 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.733 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.733 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00992643 s, 106 MB/s 2023-10-06T11:13:41.746 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.746 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.746 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101959 s, 103 MB/s 2023-10-06T11:13:41.747 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:41.747 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:41.747 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:41.747 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.7 2023-10-06T11:13:41.747 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:41.747 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:41.747 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:41.747 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:41.829 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.829 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.829 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00888758 s, 118 MB/s 2023-10-06T11:13:41.841 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.841 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.841 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100341 s, 105 MB/s 2023-10-06T11:13:41.853 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.853 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.853 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00996819 s, 105 MB/s 2023-10-06T11:13:41.865 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.865 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.865 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00991311 s, 106 MB/s 2023-10-06T11:13:41.877 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.878 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.878 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102376 s, 102 MB/s 2023-10-06T11:13:41.888 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.889 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.889 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00869859 s, 121 MB/s 2023-10-06T11:13:41.901 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.901 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.901 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104281 s, 101 MB/s 2023-10-06T11:13:41.913 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.913 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.913 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00924175 s, 113 MB/s 2023-10-06T11:13:41.925 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.925 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.925 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00999126 s, 105 MB/s 2023-10-06T11:13:41.937 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.937 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.937 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101467 s, 103 MB/s 2023-10-06T11:13:41.950 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.950 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.950 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105031 s, 99.8 MB/s 2023-10-06T11:13:41.961 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.962 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.962 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00955663 s, 110 MB/s 2023-10-06T11:13:41.973 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.974 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.974 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00968133 s, 108 MB/s 2023-10-06T11:13:41.985 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.985 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.985 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00882839 s, 119 MB/s 2023-10-06T11:13:41.997 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:41.997 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:41.997 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00996548 s, 105 MB/s 2023-10-06T11:13:42.008 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.008 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.008 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00888242 s, 118 MB/s 2023-10-06T11:13:42.020 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.020 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.020 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00965508 s, 109 MB/s 2023-10-06T11:13:42.032 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.032 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.032 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00977018 s, 107 MB/s 2023-10-06T11:13:42.043 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.043 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.043 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00875905 s, 120 MB/s 2023-10-06T11:13:42.055 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.055 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.055 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100595 s, 104 MB/s 2023-10-06T11:13:42.068 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.068 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.068 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103491 s, 101 MB/s 2023-10-06T11:13:42.080 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.081 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.081 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103196 s, 102 MB/s 2023-10-06T11:13:42.092 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.092 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.092 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0094938 s, 110 MB/s 2023-10-06T11:13:42.105 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.105 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.105 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104548 s, 100 MB/s 2023-10-06T11:13:42.116 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.116 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.116 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00862555 s, 122 MB/s 2023-10-06T11:13:42.126 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.126 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.126 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00845863 s, 124 MB/s 2023-10-06T11:13:42.137 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.137 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.138 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00866459 s, 121 MB/s 2023-10-06T11:13:42.149 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.149 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.150 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00971621 s, 108 MB/s 2023-10-06T11:13:42.161 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.161 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.161 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00944825 s, 111 MB/s 2023-10-06T11:13:42.172 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.172 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.172 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00845058 s, 124 MB/s 2023-10-06T11:13:42.183 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.183 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.183 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00920991 s, 114 MB/s 2023-10-06T11:13:42.196 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.196 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.196 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00983525 s, 107 MB/s 2023-10-06T11:13:42.196 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:42.197 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:42.197 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:42.197 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.8 2023-10-06T11:13:42.197 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:42.197 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:42.197 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:42.197 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:42.280 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.280 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.280 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105486 s, 99.4 MB/s 2023-10-06T11:13:42.291 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.291 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.291 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00915017 s, 115 MB/s 2023-10-06T11:13:42.303 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.303 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.303 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954224 s, 110 MB/s 2023-10-06T11:13:42.314 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.315 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.315 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00960173 s, 109 MB/s 2023-10-06T11:13:42.326 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.326 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.327 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00956071 s, 110 MB/s 2023-10-06T11:13:42.338 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.338 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.338 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00951488 s, 110 MB/s 2023-10-06T11:13:42.350 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.350 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.350 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00935445 s, 112 MB/s 2023-10-06T11:13:42.360 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.361 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.361 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00896197 s, 117 MB/s 2023-10-06T11:13:42.372 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.372 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.372 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00929236 s, 113 MB/s 2023-10-06T11:13:42.384 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.385 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.385 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00972746 s, 108 MB/s 2023-10-06T11:13:42.395 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.396 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.396 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00951991 s, 110 MB/s 2023-10-06T11:13:42.409 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.409 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.409 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010527 s, 99.6 MB/s 2023-10-06T11:13:42.419 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.420 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.420 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00877863 s, 119 MB/s 2023-10-06T11:13:42.431 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.431 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.431 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0095052 s, 110 MB/s 2023-10-06T11:13:42.442 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.442 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.442 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00849061 s, 123 MB/s 2023-10-06T11:13:42.454 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.454 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.454 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00939981 s, 112 MB/s 2023-10-06T11:13:42.466 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.466 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.466 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101865 s, 103 MB/s 2023-10-06T11:13:42.478 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.479 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.479 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104311 s, 101 MB/s 2023-10-06T11:13:42.490 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.491 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.491 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00949488 s, 110 MB/s 2023-10-06T11:13:42.503 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.503 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.503 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101654 s, 103 MB/s 2023-10-06T11:13:42.516 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.516 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.516 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106048 s, 98.9 MB/s 2023-10-06T11:13:42.527 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.527 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.527 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00882018 s, 119 MB/s 2023-10-06T11:13:42.539 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.539 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.539 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00971511 s, 108 MB/s 2023-10-06T11:13:42.550 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.551 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.551 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00957873 s, 109 MB/s 2023-10-06T11:13:42.562 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.562 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.562 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0095335 s, 110 MB/s 2023-10-06T11:13:42.575 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.575 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.575 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102376 s, 102 MB/s 2023-10-06T11:13:42.587 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.587 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.587 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00998042 s, 105 MB/s 2023-10-06T11:13:42.599 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.599 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.599 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00983766 s, 107 MB/s 2023-10-06T11:13:42.610 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.611 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.611 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00931787 s, 113 MB/s 2023-10-06T11:13:42.622 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.622 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.622 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00888418 s, 118 MB/s 2023-10-06T11:13:42.634 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.635 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.635 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104123 s, 101 MB/s 2023-10-06T11:13:42.646 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.646 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.647 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00958773 s, 109 MB/s 2023-10-06T11:13:42.648 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:42.648 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:42.648 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:42.649 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.9 2023-10-06T11:13:42.649 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:42.649 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:42.649 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:42.649 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:42.732 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.732 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.732 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102063 s, 103 MB/s 2023-10-06T11:13:42.744 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.744 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.744 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00957072 s, 110 MB/s 2023-10-06T11:13:42.755 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.755 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.755 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954475 s, 110 MB/s 2023-10-06T11:13:42.767 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.767 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.767 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00962263 s, 109 MB/s 2023-10-06T11:13:42.780 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.780 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.780 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010196 s, 103 MB/s 2023-10-06T11:13:42.791 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.791 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.791 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00951488 s, 110 MB/s 2023-10-06T11:13:42.803 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.803 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.804 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00966346 s, 109 MB/s 2023-10-06T11:13:42.815 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.815 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.815 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00995811 s, 105 MB/s 2023-10-06T11:13:42.828 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.828 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.828 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105069 s, 99.8 MB/s 2023-10-06T11:13:42.840 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.840 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.840 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00976818 s, 107 MB/s 2023-10-06T11:13:42.852 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.852 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.852 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102626 s, 102 MB/s 2023-10-06T11:13:42.863 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.863 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.863 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00874296 s, 120 MB/s 2023-10-06T11:13:42.875 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.875 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.875 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00959875 s, 109 MB/s 2023-10-06T11:13:42.887 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.887 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.887 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00946395 s, 111 MB/s 2023-10-06T11:13:42.898 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.898 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.899 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00933346 s, 112 MB/s 2023-10-06T11:13:42.910 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.910 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.910 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00965619 s, 109 MB/s 2023-10-06T11:13:42.922 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.922 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.922 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00968974 s, 108 MB/s 2023-10-06T11:13:42.935 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.935 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.935 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102522 s, 102 MB/s 2023-10-06T11:13:42.946 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.947 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.947 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0097076 s, 108 MB/s 2023-10-06T11:13:42.957 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.957 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.957 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00838626 s, 125 MB/s 2023-10-06T11:13:42.969 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.970 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.970 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00980345 s, 107 MB/s 2023-10-06T11:13:42.981 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.981 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.981 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00977752 s, 107 MB/s 2023-10-06T11:13:42.992 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:42.992 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:42.992 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00844429 s, 124 MB/s 2023-10-06T11:13:43.004 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.004 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.004 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00965726 s, 109 MB/s 2023-10-06T11:13:43.017 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.017 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.017 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103542 s, 101 MB/s 2023-10-06T11:13:43.029 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.029 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.029 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00963341 s, 109 MB/s 2023-10-06T11:13:43.040 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.040 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.040 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00925379 s, 113 MB/s 2023-10-06T11:13:43.051 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.051 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.052 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00944627 s, 111 MB/s 2023-10-06T11:13:43.064 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.064 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.064 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00995 s, 105 MB/s 2023-10-06T11:13:43.075 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.075 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.075 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00920818 s, 114 MB/s 2023-10-06T11:13:43.087 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.087 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.087 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0096431 s, 109 MB/s 2023-10-06T11:13:43.099 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.100 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.100 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104255 s, 101 MB/s 2023-10-06T11:13:43.101 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:43.101 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:43.101 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:43.101 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.10 2023-10-06T11:13:43.101 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:43.102 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:43.102 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:43.102 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:43.183 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.183 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.183 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0086414 s, 121 MB/s 2023-10-06T11:13:43.195 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.195 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.195 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00979588 s, 107 MB/s 2023-10-06T11:13:43.207 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.207 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.207 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00995957 s, 105 MB/s 2023-10-06T11:13:43.219 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.219 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.219 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00980834 s, 107 MB/s 2023-10-06T11:13:43.232 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.232 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.232 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103775 s, 101 MB/s 2023-10-06T11:13:43.242 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.243 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.243 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00873472 s, 120 MB/s 2023-10-06T11:13:43.254 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.254 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.254 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00884336 s, 119 MB/s 2023-10-06T11:13:43.266 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.266 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.266 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00964861 s, 109 MB/s 2023-10-06T11:13:43.278 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.278 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.279 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103902 s, 101 MB/s 2023-10-06T11:13:43.291 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.291 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.291 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102315 s, 102 MB/s 2023-10-06T11:13:43.303 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.303 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.303 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00952477 s, 110 MB/s 2023-10-06T11:13:43.313 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.314 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.314 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00869325 s, 121 MB/s 2023-10-06T11:13:43.326 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.327 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.327 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108072 s, 97.0 MB/s 2023-10-06T11:13:43.339 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.339 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.339 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100671 s, 104 MB/s 2023-10-06T11:13:43.351 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.351 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.352 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102999 s, 102 MB/s 2023-10-06T11:13:43.364 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.364 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.364 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105407 s, 99.5 MB/s 2023-10-06T11:13:43.376 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.377 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.377 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102586 s, 102 MB/s 2023-10-06T11:13:43.392 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.392 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.392 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126668 s, 82.8 MB/s 2023-10-06T11:13:43.404 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.404 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.404 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103161 s, 102 MB/s 2023-10-06T11:13:43.415 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.415 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.415 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00881346 s, 119 MB/s 2023-10-06T11:13:43.428 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.428 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.428 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105519 s, 99.4 MB/s 2023-10-06T11:13:43.440 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.440 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.440 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00980809 s, 107 MB/s 2023-10-06T11:13:43.451 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.451 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.451 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0086408 s, 121 MB/s 2023-10-06T11:13:43.462 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.462 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.462 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00868477 s, 121 MB/s 2023-10-06T11:13:43.475 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.476 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.476 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111357 s, 94.2 MB/s 2023-10-06T11:13:43.487 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.488 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.488 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00982954 s, 107 MB/s 2023-10-06T11:13:43.499 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.499 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.499 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00961542 s, 109 MB/s 2023-10-06T11:13:43.510 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.510 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.510 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0088423 s, 119 MB/s 2023-10-06T11:13:43.522 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.522 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.522 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0096434 s, 109 MB/s 2023-10-06T11:13:43.534 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.534 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.534 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101561 s, 103 MB/s 2023-10-06T11:13:43.546 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.546 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.546 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00972404 s, 108 MB/s 2023-10-06T11:13:43.559 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.559 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.559 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104085 s, 101 MB/s 2023-10-06T11:13:43.560 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:43.560 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:43.560 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:43.560 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.11 2023-10-06T11:13:43.561 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:43.561 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:43.561 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:43.561 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:43.643 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.643 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.644 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102055 s, 103 MB/s 2023-10-06T11:13:43.654 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.654 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.654 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00872447 s, 120 MB/s 2023-10-06T11:13:43.665 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.665 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.665 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00873956 s, 120 MB/s 2023-10-06T11:13:43.678 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.678 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.678 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105878 s, 99.0 MB/s 2023-10-06T11:13:43.691 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.691 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.691 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010523 s, 99.6 MB/s 2023-10-06T11:13:43.703 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.703 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.703 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102944 s, 102 MB/s 2023-10-06T11:13:43.716 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.716 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.716 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010542 s, 99.5 MB/s 2023-10-06T11:13:43.728 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.728 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.728 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00972297 s, 108 MB/s 2023-10-06T11:13:43.740 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.740 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.740 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00968008 s, 108 MB/s 2023-10-06T11:13:43.752 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.752 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.753 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103537 s, 101 MB/s 2023-10-06T11:13:43.765 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.765 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.765 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105997 s, 98.9 MB/s 2023-10-06T11:13:43.778 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.778 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.778 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01013 s, 104 MB/s 2023-10-06T11:13:43.789 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.789 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.789 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00875671 s, 120 MB/s 2023-10-06T11:13:43.799 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.800 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.800 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00852502 s, 123 MB/s 2023-10-06T11:13:43.811 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.811 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.811 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00941174 s, 111 MB/s 2023-10-06T11:13:43.823 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.823 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.823 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00967719 s, 108 MB/s 2023-10-06T11:13:43.835 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.835 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.835 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100835 s, 104 MB/s 2023-10-06T11:13:43.847 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.847 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.847 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00971286 s, 108 MB/s 2023-10-06T11:13:43.859 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.859 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.859 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.009372 s, 112 MB/s 2023-10-06T11:13:43.870 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.870 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.871 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0094479 s, 111 MB/s 2023-10-06T11:13:43.882 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.882 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.882 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00931936 s, 113 MB/s 2023-10-06T11:13:43.894 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.894 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.894 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00961519 s, 109 MB/s 2023-10-06T11:13:43.906 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.906 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.906 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00984402 s, 107 MB/s 2023-10-06T11:13:43.919 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.919 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.919 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111384 s, 94.1 MB/s 2023-10-06T11:13:43.932 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.932 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.932 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103481 s, 101 MB/s 2023-10-06T11:13:43.944 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.944 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.944 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100069 s, 105 MB/s 2023-10-06T11:13:43.956 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.956 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.956 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0099155 s, 106 MB/s 2023-10-06T11:13:43.968 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.968 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.968 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00975716 s, 107 MB/s 2023-10-06T11:13:43.980 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.980 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.981 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100066 s, 105 MB/s 2023-10-06T11:13:43.993 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:43.993 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:43.993 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105102 s, 99.8 MB/s 2023-10-06T11:13:44.005 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.005 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.005 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0088426 s, 119 MB/s 2023-10-06T11:13:44.016 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.016 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.017 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00998284 s, 105 MB/s 2023-10-06T11:13:44.018 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:44.018 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:44.018 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:44.018 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.12 2023-10-06T11:13:44.018 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:44.018 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:44.018 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:44.018 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:44.101 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.101 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.101 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00982923 s, 107 MB/s 2023-10-06T11:13:44.113 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.113 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.113 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010118 s, 104 MB/s 2023-10-06T11:13:44.124 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.124 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.124 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00865372 s, 121 MB/s 2023-10-06T11:13:44.137 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.137 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.137 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103551 s, 101 MB/s 2023-10-06T11:13:44.149 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.149 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.149 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00980992 s, 107 MB/s 2023-10-06T11:13:44.161 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.162 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.162 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104054 s, 101 MB/s 2023-10-06T11:13:44.173 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.173 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.173 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00889129 s, 118 MB/s 2023-10-06T11:13:44.183 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.184 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.184 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0085758 s, 122 MB/s 2023-10-06T11:13:44.196 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.196 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.196 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100076 s, 105 MB/s 2023-10-06T11:13:44.208 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.209 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.209 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010433 s, 101 MB/s 2023-10-06T11:13:44.221 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.221 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.221 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102793 s, 102 MB/s 2023-10-06T11:13:44.234 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.234 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.234 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101028 s, 104 MB/s 2023-10-06T11:13:44.244 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.245 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.245 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00913578 s, 115 MB/s 2023-10-06T11:13:44.257 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.257 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.257 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00986117 s, 106 MB/s 2023-10-06T11:13:44.269 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.269 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.269 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102634 s, 102 MB/s 2023-10-06T11:13:44.280 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.280 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.280 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00853174 s, 123 MB/s 2023-10-06T11:13:44.292 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.292 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.293 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101063 s, 104 MB/s 2023-10-06T11:13:44.304 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.305 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.305 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00978967 s, 107 MB/s 2023-10-06T11:13:44.316 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.316 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.316 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00969874 s, 108 MB/s 2023-10-06T11:13:44.328 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.328 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.328 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00967591 s, 108 MB/s 2023-10-06T11:13:44.339 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.340 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.340 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00912282 s, 115 MB/s 2023-10-06T11:13:44.351 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.351 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.351 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00959732 s, 109 MB/s 2023-10-06T11:13:44.363 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.364 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.364 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100987 s, 104 MB/s 2023-10-06T11:13:44.376 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.376 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.376 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103206 s, 102 MB/s 2023-10-06T11:13:44.388 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.388 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.388 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00968543 s, 108 MB/s 2023-10-06T11:13:44.401 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.401 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.401 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102679 s, 102 MB/s 2023-10-06T11:13:44.412 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.412 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.412 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00868463 s, 121 MB/s 2023-10-06T11:13:44.423 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.423 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.424 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00953039 s, 110 MB/s 2023-10-06T11:13:44.434 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.434 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.434 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00858398 s, 122 MB/s 2023-10-06T11:13:44.446 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.447 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.447 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00989669 s, 106 MB/s 2023-10-06T11:13:44.459 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.459 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.459 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00998519 s, 105 MB/s 2023-10-06T11:13:44.469 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.470 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.470 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00851631 s, 123 MB/s 2023-10-06T11:13:44.471 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:44.471 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:44.471 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:44.471 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.13 2023-10-06T11:13:44.471 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:44.471 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:44.471 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:44.471 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:44.554 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.554 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.554 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00995711 s, 105 MB/s 2023-10-06T11:13:44.566 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.566 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.566 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00978166 s, 107 MB/s 2023-10-06T11:13:44.577 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.577 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.578 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0093717 s, 112 MB/s 2023-10-06T11:13:44.589 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.589 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.590 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00966841 s, 108 MB/s 2023-10-06T11:13:44.600 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.600 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.600 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00827069 s, 127 MB/s 2023-10-06T11:13:44.612 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.612 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.613 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104086 s, 101 MB/s 2023-10-06T11:13:44.624 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.624 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.624 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0095104 s, 110 MB/s 2023-10-06T11:13:44.636 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.636 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.636 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00948366 s, 111 MB/s 2023-10-06T11:13:44.647 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.647 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.647 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00933629 s, 112 MB/s 2023-10-06T11:13:44.658 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.658 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.658 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00871668 s, 120 MB/s 2023-10-06T11:13:44.669 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.669 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.669 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00836256 s, 125 MB/s 2023-10-06T11:13:44.679 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.679 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.680 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00835697 s, 125 MB/s 2023-10-06T11:13:44.691 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.691 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.691 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00977313 s, 107 MB/s 2023-10-06T11:13:44.704 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.704 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.704 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010149 s, 103 MB/s 2023-10-06T11:13:44.715 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.715 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.716 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00949402 s, 110 MB/s 2023-10-06T11:13:44.728 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.728 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.728 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103252 s, 102 MB/s 2023-10-06T11:13:44.740 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.740 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.740 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00976801 s, 107 MB/s 2023-10-06T11:13:44.752 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.752 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.752 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00975508 s, 107 MB/s 2023-10-06T11:13:44.763 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.763 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.764 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0092803 s, 113 MB/s 2023-10-06T11:13:44.776 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.776 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.776 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100659 s, 104 MB/s 2023-10-06T11:13:44.788 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.788 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.788 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100625 s, 104 MB/s 2023-10-06T11:13:44.800 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.800 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.800 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00953283 s, 110 MB/s 2023-10-06T11:13:44.812 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.812 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.812 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00984557 s, 107 MB/s 2023-10-06T11:13:44.823 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.824 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.824 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00965954 s, 109 MB/s 2023-10-06T11:13:44.836 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.836 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.836 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101626 s, 103 MB/s 2023-10-06T11:13:44.848 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.848 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.848 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00963571 s, 109 MB/s 2023-10-06T11:13:44.860 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.860 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.860 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100314 s, 105 MB/s 2023-10-06T11:13:44.874 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.874 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.874 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105493 s, 99.4 MB/s 2023-10-06T11:13:44.889 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.889 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.889 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0115751 s, 90.6 MB/s 2023-10-06T11:13:44.902 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.902 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.902 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107097 s, 97.9 MB/s 2023-10-06T11:13:44.918 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.918 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.918 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0134268 s, 78.1 MB/s 2023-10-06T11:13:44.972 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:44.972 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:44.972 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00995394 s, 105 MB/s 2023-10-06T11:13:44.973 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:44.973 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:44.974 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:44.974 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.14 2023-10-06T11:13:44.974 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:44.974 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:44.974 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:44.974 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:45.055 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.056 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.056 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00985023 s, 106 MB/s 2023-10-06T11:13:45.066 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.066 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.066 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00838458 s, 125 MB/s 2023-10-06T11:13:45.078 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.078 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.078 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00977462 s, 107 MB/s 2023-10-06T11:13:45.090 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.090 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.091 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101235 s, 104 MB/s 2023-10-06T11:13:45.103 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.103 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.103 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102309 s, 102 MB/s 2023-10-06T11:13:45.114 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.115 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.115 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00958821 s, 109 MB/s 2023-10-06T11:13:45.126 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.126 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.126 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0094864 s, 111 MB/s 2023-10-06T11:13:45.138 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.138 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.138 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00981427 s, 107 MB/s 2023-10-06T11:13:45.150 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.150 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.150 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0095629 s, 110 MB/s 2023-10-06T11:13:45.162 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.162 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.162 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0095642 s, 110 MB/s 2023-10-06T11:13:45.174 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.175 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.175 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101687 s, 103 MB/s 2023-10-06T11:13:45.186 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.187 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.187 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0095944 s, 109 MB/s 2023-10-06T11:13:45.198 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.198 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.198 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00988315 s, 106 MB/s 2023-10-06T11:13:45.209 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.210 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.210 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00943979 s, 111 MB/s 2023-10-06T11:13:45.222 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.222 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.222 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00997885 s, 105 MB/s 2023-10-06T11:13:45.234 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.234 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.234 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00969345 s, 108 MB/s 2023-10-06T11:13:45.246 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.247 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.247 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102615 s, 102 MB/s 2023-10-06T11:13:45.259 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.259 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.260 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106046 s, 98.9 MB/s 2023-10-06T11:13:45.271 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.272 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.272 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0097221 s, 108 MB/s 2023-10-06T11:13:45.283 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.283 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.283 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00969472 s, 108 MB/s 2023-10-06T11:13:45.294 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.294 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.295 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954 s, 110 MB/s 2023-10-06T11:13:45.307 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.307 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.307 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010078 s, 104 MB/s 2023-10-06T11:13:45.317 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.317 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.318 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00845983 s, 124 MB/s 2023-10-06T11:13:45.329 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.329 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.329 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0096202 s, 109 MB/s 2023-10-06T11:13:45.341 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.341 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.341 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00952019 s, 110 MB/s 2023-10-06T11:13:45.352 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.352 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.352 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00932934 s, 112 MB/s 2023-10-06T11:13:45.364 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.364 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.364 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00976149 s, 107 MB/s 2023-10-06T11:13:45.376 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.376 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.376 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0094213 s, 111 MB/s 2023-10-06T11:13:45.388 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.388 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.388 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00980235 s, 107 MB/s 2023-10-06T11:13:45.399 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.400 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.400 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00935364 s, 112 MB/s 2023-10-06T11:13:45.411 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.412 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.412 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00966167 s, 109 MB/s 2023-10-06T11:13:45.424 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.424 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.424 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100937 s, 104 MB/s 2023-10-06T11:13:45.425 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:45.425 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:45.425 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:45.425 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.15 2023-10-06T11:13:45.425 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:45.425 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:45.425 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:45.426 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:45.507 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.507 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.507 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00856446 s, 122 MB/s 2023-10-06T11:13:45.519 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.519 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.519 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101786 s, 103 MB/s 2023-10-06T11:13:45.531 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.531 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.531 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00983568 s, 107 MB/s 2023-10-06T11:13:45.543 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.543 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.543 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100244 s, 105 MB/s 2023-10-06T11:13:45.554 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.554 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.554 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00835051 s, 126 MB/s 2023-10-06T11:13:45.565 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.566 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.566 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00941245 s, 111 MB/s 2023-10-06T11:13:45.577 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.577 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.577 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00970918 s, 108 MB/s 2023-10-06T11:13:45.589 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.589 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.589 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00969961 s, 108 MB/s 2023-10-06T11:13:45.601 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.601 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.601 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00946074 s, 111 MB/s 2023-10-06T11:13:45.613 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.613 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.613 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00993903 s, 106 MB/s 2023-10-06T11:13:45.626 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.626 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.626 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105313 s, 99.6 MB/s 2023-10-06T11:13:45.638 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.638 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.638 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100813 s, 104 MB/s 2023-10-06T11:13:45.650 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.651 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.651 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102712 s, 102 MB/s 2023-10-06T11:13:45.662 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.662 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.662 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00965037 s, 109 MB/s 2023-10-06T11:13:45.673 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.673 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.674 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00883948 s, 119 MB/s 2023-10-06T11:13:45.684 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.684 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.685 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00881923 s, 119 MB/s 2023-10-06T11:13:45.696 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.696 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.697 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00956524 s, 110 MB/s 2023-10-06T11:13:45.708 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.708 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.708 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00957963 s, 109 MB/s 2023-10-06T11:13:45.719 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.719 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.719 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00868352 s, 121 MB/s 2023-10-06T11:13:45.732 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.732 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.732 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104101 s, 101 MB/s 2023-10-06T11:13:45.744 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.744 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.744 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105027 s, 99.8 MB/s 2023-10-06T11:13:45.755 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.755 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.755 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00846432 s, 124 MB/s 2023-10-06T11:13:45.767 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.767 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.767 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00966027 s, 109 MB/s 2023-10-06T11:13:45.778 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.778 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.778 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00878357 s, 119 MB/s 2023-10-06T11:13:45.790 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.790 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.790 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0096501 s, 109 MB/s 2023-10-06T11:13:45.801 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.802 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.802 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0097136 s, 108 MB/s 2023-10-06T11:13:45.813 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.813 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.814 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0095569 s, 110 MB/s 2023-10-06T11:13:45.826 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.826 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.826 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00968404 s, 108 MB/s 2023-10-06T11:13:45.837 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.838 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.838 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100112 s, 105 MB/s 2023-10-06T11:13:45.850 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.850 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.850 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00963889 s, 109 MB/s 2023-10-06T11:13:45.862 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.862 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.862 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100397 s, 104 MB/s 2023-10-06T11:13:45.874 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.874 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.874 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00971219 s, 108 MB/s 2023-10-06T11:13:45.875 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:45.875 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:45.875 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:45.876 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.16 2023-10-06T11:13:45.876 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:45.876 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:45.876 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:45.876 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:45.960 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.960 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.960 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00987701 s, 106 MB/s 2023-10-06T11:13:45.971 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.971 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.971 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00985622 s, 106 MB/s 2023-10-06T11:13:45.983 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.983 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.984 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00986273 s, 106 MB/s 2023-10-06T11:13:45.996 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:45.996 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:45.996 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103751 s, 101 MB/s 2023-10-06T11:13:46.008 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.008 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.008 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00976147 s, 107 MB/s 2023-10-06T11:13:46.020 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.020 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.020 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00961725 s, 109 MB/s 2023-10-06T11:13:46.032 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.032 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.032 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101613 s, 103 MB/s 2023-10-06T11:13:46.044 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.044 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.044 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954407 s, 110 MB/s 2023-10-06T11:13:46.058 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.058 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.058 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00955596 s, 110 MB/s 2023-10-06T11:13:46.068 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.068 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.068 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101382 s, 103 MB/s 2023-10-06T11:13:46.080 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.080 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.080 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00958351 s, 109 MB/s 2023-10-06T11:13:46.090 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.090 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.091 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00844514 s, 124 MB/s 2023-10-06T11:13:46.103 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.103 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.103 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103745 s, 101 MB/s 2023-10-06T11:13:46.115 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.115 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.115 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100147 s, 105 MB/s 2023-10-06T11:13:46.127 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.127 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.128 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010204 s, 103 MB/s 2023-10-06T11:13:46.139 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.139 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.140 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00964212 s, 109 MB/s 2023-10-06T11:13:46.151 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.151 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.151 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00928714 s, 113 MB/s 2023-10-06T11:13:46.163 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.163 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.163 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00939208 s, 112 MB/s 2023-10-06T11:13:46.173 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.174 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.174 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00877439 s, 120 MB/s 2023-10-06T11:13:46.185 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.185 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.185 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0087961 s, 119 MB/s 2023-10-06T11:13:46.197 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.197 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.197 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00976023 s, 107 MB/s 2023-10-06T11:13:46.209 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.209 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.209 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102214 s, 103 MB/s 2023-10-06T11:13:46.221 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.221 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.221 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954663 s, 110 MB/s 2023-10-06T11:13:46.233 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.233 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.233 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00988421 s, 106 MB/s 2023-10-06T11:13:46.245 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.245 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.245 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00937901 s, 112 MB/s 2023-10-06T11:13:46.257 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.257 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.257 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954286 s, 110 MB/s 2023-10-06T11:13:46.268 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.268 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.269 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00968279 s, 108 MB/s 2023-10-06T11:13:46.280 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.280 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.281 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00964873 s, 109 MB/s 2023-10-06T11:13:46.291 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.291 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.291 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00901756 s, 116 MB/s 2023-10-06T11:13:46.303 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.303 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.303 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00933552 s, 112 MB/s 2023-10-06T11:13:46.314 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.314 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.314 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00878235 s, 119 MB/s 2023-10-06T11:13:46.326 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.326 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.326 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00973272 s, 108 MB/s 2023-10-06T11:13:46.328 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:46.328 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:46.328 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:46.328 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.17 2023-10-06T11:13:46.328 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:46.329 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:46.329 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:46.329 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:46.410 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.410 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.411 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00862587 s, 122 MB/s 2023-10-06T11:13:46.420 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.421 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.421 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00857901 s, 122 MB/s 2023-10-06T11:13:46.433 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.433 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.433 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104014 s, 101 MB/s 2023-10-06T11:13:46.445 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.445 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.445 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00940252 s, 112 MB/s 2023-10-06T11:13:46.456 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.456 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.456 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0088866 s, 118 MB/s 2023-10-06T11:13:46.469 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.469 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.470 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00864997 s, 121 MB/s 2023-10-06T11:13:46.479 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.479 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.479 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101035 s, 104 MB/s 2023-10-06T11:13:46.491 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.491 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.491 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00952217 s, 110 MB/s 2023-10-06T11:13:46.503 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.503 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.504 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102723 s, 102 MB/s 2023-10-06T11:13:46.515 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.515 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.515 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00928551 s, 113 MB/s 2023-10-06T11:13:46.527 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.527 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.527 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0095419 s, 110 MB/s 2023-10-06T11:13:46.538 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.538 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.539 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00926371 s, 113 MB/s 2023-10-06T11:13:46.551 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.551 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.551 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103539 s, 101 MB/s 2023-10-06T11:13:46.562 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.562 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.562 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00929526 s, 113 MB/s 2023-10-06T11:13:46.574 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.574 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.574 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00976481 s, 107 MB/s 2023-10-06T11:13:46.586 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.586 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.586 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0092876 s, 113 MB/s 2023-10-06T11:13:46.596 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.597 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.597 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00852599 s, 123 MB/s 2023-10-06T11:13:46.609 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.609 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.610 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106 s, 98.9 MB/s 2023-10-06T11:13:46.620 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.621 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.621 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00867267 s, 121 MB/s 2023-10-06T11:13:46.632 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.633 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.633 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00964223 s, 109 MB/s 2023-10-06T11:13:46.643 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.643 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.643 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00867893 s, 121 MB/s 2023-10-06T11:13:46.656 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.656 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.656 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101507 s, 103 MB/s 2023-10-06T11:13:46.666 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.666 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.666 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0085377 s, 123 MB/s 2023-10-06T11:13:46.677 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.677 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.677 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0086005 s, 122 MB/s 2023-10-06T11:13:46.688 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.688 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.688 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00865345 s, 121 MB/s 2023-10-06T11:13:46.700 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.700 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.700 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00988946 s, 106 MB/s 2023-10-06T11:13:46.711 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.711 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.711 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00863425 s, 121 MB/s 2023-10-06T11:13:46.722 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.723 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.723 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00951025 s, 110 MB/s 2023-10-06T11:13:46.734 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.734 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.734 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0091405 s, 115 MB/s 2023-10-06T11:13:46.745 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.746 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.746 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00937889 s, 112 MB/s 2023-10-06T11:13:46.757 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.757 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.757 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00956603 s, 110 MB/s 2023-10-06T11:13:46.769 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.769 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.769 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0093868 s, 112 MB/s 2023-10-06T11:13:46.770 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:46.770 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:46.770 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:46.770 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.18 2023-10-06T11:13:46.770 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:46.770 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:46.770 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:46.770 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:46.853 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.853 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.853 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00949243 s, 110 MB/s 2023-10-06T11:13:46.864 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.865 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.865 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00955669 s, 110 MB/s 2023-10-06T11:13:46.877 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.877 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.877 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101921 s, 103 MB/s 2023-10-06T11:13:46.889 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.889 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.889 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100594 s, 104 MB/s 2023-10-06T11:13:46.901 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.901 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.901 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00966669 s, 108 MB/s 2023-10-06T11:13:46.913 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.914 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.914 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101504 s, 103 MB/s 2023-10-06T11:13:46.928 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.928 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.928 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120237 s, 87.2 MB/s 2023-10-06T11:13:46.962 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.962 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.963 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00916192 s, 114 MB/s 2023-10-06T11:13:46.974 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.975 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.975 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00989034 s, 106 MB/s 2023-10-06T11:13:46.986 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.986 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.986 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00938734 s, 112 MB/s 2023-10-06T11:13:46.997 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:46.998 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:46.998 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00833887 s, 126 MB/s 2023-10-06T11:13:47.009 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.010 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.011 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00992428 s, 106 MB/s 2023-10-06T11:13:47.022 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.022 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.022 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00997213 s, 105 MB/s 2023-10-06T11:13:47.034 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.035 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.035 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100906 s, 104 MB/s 2023-10-06T11:13:47.047 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.047 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.047 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00974989 s, 108 MB/s 2023-10-06T11:13:47.059 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.059 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.059 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00972024 s, 108 MB/s 2023-10-06T11:13:47.070 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.070 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.070 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00882271 s, 119 MB/s 2023-10-06T11:13:47.083 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.083 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.083 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102542 s, 102 MB/s 2023-10-06T11:13:47.096 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.096 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.096 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100389 s, 104 MB/s 2023-10-06T11:13:47.108 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.108 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.108 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00980831 s, 107 MB/s 2023-10-06T11:13:47.119 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.119 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.119 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00843757 s, 124 MB/s 2023-10-06T11:13:47.131 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.131 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.132 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00984895 s, 106 MB/s 2023-10-06T11:13:47.143 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.143 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.144 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954201 s, 110 MB/s 2023-10-06T11:13:47.156 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.156 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.156 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00976234 s, 107 MB/s 2023-10-06T11:13:47.168 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.169 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.169 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103532 s, 101 MB/s 2023-10-06T11:13:47.181 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.181 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.181 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00996757 s, 105 MB/s 2023-10-06T11:13:47.192 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.193 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.193 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0089839 s, 117 MB/s 2023-10-06T11:13:47.205 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.205 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.205 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00964856 s, 109 MB/s 2023-10-06T11:13:47.217 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.217 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.217 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00946066 s, 111 MB/s 2023-10-06T11:13:47.229 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.229 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.229 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00981727 s, 107 MB/s 2023-10-06T11:13:47.241 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.241 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.241 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00963579 s, 109 MB/s 2023-10-06T11:13:47.253 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.254 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.254 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00973316 s, 108 MB/s 2023-10-06T11:13:47.255 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:47.255 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:47.255 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:47.255 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.19 2023-10-06T11:13:47.255 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:47.255 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:47.255 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:47.255 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:47.339 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.339 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.339 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00999301 s, 105 MB/s 2023-10-06T11:13:47.351 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.351 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.351 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0094417 s, 111 MB/s 2023-10-06T11:13:47.363 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.363 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.363 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00964037 s, 109 MB/s 2023-10-06T11:13:47.376 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.376 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.376 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102362 s, 102 MB/s 2023-10-06T11:13:47.388 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.388 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.388 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00976516 s, 107 MB/s 2023-10-06T11:13:47.400 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.400 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.400 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954366 s, 110 MB/s 2023-10-06T11:13:47.412 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.413 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.413 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100809 s, 104 MB/s 2023-10-06T11:13:47.425 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.425 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.425 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101442 s, 103 MB/s 2023-10-06T11:13:47.437 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.437 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.437 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00922049 s, 114 MB/s 2023-10-06T11:13:47.449 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.449 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.449 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00957237 s, 110 MB/s 2023-10-06T11:13:47.461 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.461 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.461 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00957302 s, 110 MB/s 2023-10-06T11:13:47.473 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.473 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.473 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00962454 s, 109 MB/s 2023-10-06T11:13:47.484 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.484 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.484 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0083795 s, 125 MB/s 2023-10-06T11:13:47.495 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.495 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.495 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00850825 s, 123 MB/s 2023-10-06T11:13:47.506 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.506 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.506 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00857179 s, 122 MB/s 2023-10-06T11:13:47.519 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.519 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.519 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101535 s, 103 MB/s 2023-10-06T11:13:47.531 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.531 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.531 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00936596 s, 112 MB/s 2023-10-06T11:13:47.543 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.544 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.544 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104372 s, 100 MB/s 2023-10-06T11:13:47.556 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.556 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.556 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102245 s, 103 MB/s 2023-10-06T11:13:47.569 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.569 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.569 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100381 s, 104 MB/s 2023-10-06T11:13:47.580 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.580 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.580 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00836981 s, 125 MB/s 2023-10-06T11:13:47.591 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.591 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.592 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00915176 s, 115 MB/s 2023-10-06T11:13:47.604 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.604 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.605 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103472 s, 101 MB/s 2023-10-06T11:13:47.617 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.617 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.617 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103744 s, 101 MB/s 2023-10-06T11:13:47.630 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.630 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.630 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102931 s, 102 MB/s 2023-10-06T11:13:47.641 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.641 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.641 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00845447 s, 124 MB/s 2023-10-06T11:13:47.654 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.654 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.654 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101392 s, 103 MB/s 2023-10-06T11:13:47.666 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.666 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.666 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00928401 s, 113 MB/s 2023-10-06T11:13:47.678 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.679 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.679 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101828 s, 103 MB/s 2023-10-06T11:13:47.691 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.691 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.691 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010164 s, 103 MB/s 2023-10-06T11:13:47.703 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.703 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.703 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00951361 s, 110 MB/s 2023-10-06T11:13:47.715 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.715 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.715 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00974776 s, 108 MB/s 2023-10-06T11:13:47.716 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:47.716 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:47.716 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:47.716 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.20 2023-10-06T11:13:47.717 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:47.717 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:47.717 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:47.717 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:47.799 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.799 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.799 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00870288 s, 120 MB/s 2023-10-06T11:13:47.810 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.810 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.810 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00863197 s, 121 MB/s 2023-10-06T11:13:47.822 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.822 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.822 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00947176 s, 111 MB/s 2023-10-06T11:13:47.834 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.834 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.834 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00972296 s, 108 MB/s 2023-10-06T11:13:47.847 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.847 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.847 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102438 s, 102 MB/s 2023-10-06T11:13:47.859 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.859 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.859 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00979199 s, 107 MB/s 2023-10-06T11:13:47.871 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.872 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.872 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00972757 s, 108 MB/s 2023-10-06T11:13:47.883 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.884 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.884 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00955068 s, 110 MB/s 2023-10-06T11:13:47.904 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.904 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.904 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0175424 s, 59.8 MB/s 2023-10-06T11:13:47.915 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.916 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.916 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00929115 s, 113 MB/s 2023-10-06T11:13:47.928 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.928 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.928 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00955946 s, 110 MB/s 2023-10-06T11:13:47.969 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.970 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.970 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00961872 s, 109 MB/s 2023-10-06T11:13:47.981 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.982 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.982 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00971211 s, 108 MB/s 2023-10-06T11:13:47.992 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:47.992 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:47.993 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00852372 s, 123 MB/s 2023-10-06T11:13:48.004 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.005 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.005 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00998525 s, 105 MB/s 2023-10-06T11:13:48.016 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.016 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.017 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00990906 s, 106 MB/s 2023-10-06T11:13:48.028 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.028 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.028 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00904326 s, 116 MB/s 2023-10-06T11:13:48.040 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.040 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.040 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100867 s, 104 MB/s 2023-10-06T11:13:48.051 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.052 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.052 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00887075 s, 118 MB/s 2023-10-06T11:13:48.062 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.062 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.063 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00853958 s, 123 MB/s 2023-10-06T11:13:48.075 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.075 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.075 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103686 s, 101 MB/s 2023-10-06T11:13:48.087 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.087 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.087 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00987836 s, 106 MB/s 2023-10-06T11:13:48.100 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.100 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.100 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106292 s, 98.7 MB/s 2023-10-06T11:13:48.112 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.112 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.112 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00993568 s, 106 MB/s 2023-10-06T11:13:48.123 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.123 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.123 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00864496 s, 121 MB/s 2023-10-06T11:13:48.134 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.135 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.135 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00953829 s, 110 MB/s 2023-10-06T11:13:48.145 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.146 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.146 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0084898 s, 124 MB/s 2023-10-06T11:13:48.157 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.157 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.158 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00955803 s, 110 MB/s 2023-10-06T11:13:48.169 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.169 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.169 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00950777 s, 110 MB/s 2023-10-06T11:13:48.182 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.182 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.182 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102038 s, 103 MB/s 2023-10-06T11:13:48.194 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.194 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.194 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00985738 s, 106 MB/s 2023-10-06T11:13:48.204 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.205 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.205 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00850747 s, 123 MB/s 2023-10-06T11:13:48.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:48.206 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:48.206 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:48.206 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.21 2023-10-06T11:13:48.206 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:48.206 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:48.206 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:48.206 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:48.288 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.288 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.288 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0096696 s, 108 MB/s 2023-10-06T11:13:48.300 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.300 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.301 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100525 s, 104 MB/s 2023-10-06T11:13:48.311 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.312 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.312 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00887249 s, 118 MB/s 2023-10-06T11:13:48.324 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.324 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.324 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00981701 s, 107 MB/s 2023-10-06T11:13:48.334 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.334 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.335 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00866698 s, 121 MB/s 2023-10-06T11:13:48.347 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.347 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.347 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103182 s, 102 MB/s 2023-10-06T11:13:48.359 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.359 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.360 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010076 s, 104 MB/s 2023-10-06T11:13:48.372 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.372 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.372 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104832 s, 100 MB/s 2023-10-06T11:13:48.385 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.385 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.385 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104807 s, 100 MB/s 2023-10-06T11:13:48.397 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.397 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.397 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0097515 s, 108 MB/s 2023-10-06T11:13:48.409 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.410 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.410 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105448 s, 99.4 MB/s 2023-10-06T11:13:48.421 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.422 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.422 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0095343 s, 110 MB/s 2023-10-06T11:13:48.433 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.433 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.433 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00914309 s, 115 MB/s 2023-10-06T11:13:48.445 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.445 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.445 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00968301 s, 108 MB/s 2023-10-06T11:13:48.457 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.457 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.457 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0097711 s, 107 MB/s 2023-10-06T11:13:48.469 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.469 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.469 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010136 s, 103 MB/s 2023-10-06T11:13:48.481 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.481 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.482 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100114 s, 105 MB/s 2023-10-06T11:13:48.494 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.494 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.494 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010599 s, 98.9 MB/s 2023-10-06T11:13:48.506 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.506 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.506 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00973943 s, 108 MB/s 2023-10-06T11:13:48.518 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.518 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.518 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00960902 s, 109 MB/s 2023-10-06T11:13:48.529 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.529 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.529 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00869601 s, 121 MB/s 2023-10-06T11:13:48.541 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.542 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.542 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103868 s, 101 MB/s 2023-10-06T11:13:48.554 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.554 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.554 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00984469 s, 107 MB/s 2023-10-06T11:13:48.565 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.565 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.565 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00925434 s, 113 MB/s 2023-10-06T11:13:48.577 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.577 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.577 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00967246 s, 108 MB/s 2023-10-06T11:13:48.588 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.589 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.589 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00938356 s, 112 MB/s 2023-10-06T11:13:48.599 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.599 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.599 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00857832 s, 122 MB/s 2023-10-06T11:13:48.611 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.612 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.612 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0096347 s, 109 MB/s 2023-10-06T11:13:48.624 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.624 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.624 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103922 s, 101 MB/s 2023-10-06T11:13:48.636 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.636 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.636 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00982781 s, 107 MB/s 2023-10-06T11:13:48.647 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.647 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.647 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00873088 s, 120 MB/s 2023-10-06T11:13:48.659 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.659 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.659 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00959525 s, 109 MB/s 2023-10-06T11:13:48.660 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:48.660 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:48.660 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:48.660 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.22 2023-10-06T11:13:48.660 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:48.661 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:48.661 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:48.661 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:48.743 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.743 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.743 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102 s, 103 MB/s 2023-10-06T11:13:48.755 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.755 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.755 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00961941 s, 109 MB/s 2023-10-06T11:13:48.766 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.766 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.766 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00846265 s, 124 MB/s 2023-10-06T11:13:48.778 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.779 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.779 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010059 s, 104 MB/s 2023-10-06T11:13:48.789 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.789 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.789 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00862344 s, 122 MB/s 2023-10-06T11:13:48.800 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.800 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.800 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00869577 s, 121 MB/s 2023-10-06T11:13:48.812 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.812 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.812 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00990429 s, 106 MB/s 2023-10-06T11:13:48.824 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.824 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.824 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00981533 s, 107 MB/s 2023-10-06T11:13:48.837 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.838 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.838 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109525 s, 95.7 MB/s 2023-10-06T11:13:48.848 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.848 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.848 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00854028 s, 123 MB/s 2023-10-06T11:13:48.861 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.862 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.862 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102817 s, 102 MB/s 2023-10-06T11:13:48.873 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.873 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.873 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00982319 s, 107 MB/s 2023-10-06T11:13:48.885 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.885 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.885 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00957323 s, 110 MB/s 2023-10-06T11:13:48.897 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.898 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.898 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101192 s, 104 MB/s 2023-10-06T11:13:48.908 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.909 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.909 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00849068 s, 123 MB/s 2023-10-06T11:13:48.921 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.922 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.922 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101017 s, 104 MB/s 2023-10-06T11:13:48.932 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.932 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.933 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00860497 s, 122 MB/s 2023-10-06T11:13:48.989 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:48.989 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:48.989 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00964722 s, 109 MB/s 2023-10-06T11:13:49.001 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.001 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.001 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100516 s, 104 MB/s 2023-10-06T11:13:49.013 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.013 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.013 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00973655 s, 108 MB/s 2023-10-06T11:13:49.024 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.024 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.025 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00961348 s, 109 MB/s 2023-10-06T11:13:49.037 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.037 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.037 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00996334 s, 105 MB/s 2023-10-06T11:13:49.048 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.049 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.049 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00959699 s, 109 MB/s 2023-10-06T11:13:49.059 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.059 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.059 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00851977 s, 123 MB/s 2023-10-06T11:13:49.071 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.072 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.072 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101499 s, 103 MB/s 2023-10-06T11:13:49.083 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.083 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.083 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00958682 s, 109 MB/s 2023-10-06T11:13:49.095 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.095 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.095 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00946409 s, 111 MB/s 2023-10-06T11:13:49.106 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.107 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.107 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00908157 s, 115 MB/s 2023-10-06T11:13:49.118 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.119 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.119 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0097198 s, 108 MB/s 2023-10-06T11:13:49.129 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.129 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.130 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00870334 s, 120 MB/s 2023-10-06T11:13:49.142 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.142 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.142 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104367 s, 100 MB/s 2023-10-06T11:13:49.154 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.154 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.154 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00983717 s, 107 MB/s 2023-10-06T11:13:49.155 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:49.155 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:49.155 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:49.155 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.23 2023-10-06T11:13:49.156 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:49.156 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:49.156 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:49.156 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:49.239 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.239 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.239 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105569 s, 99.3 MB/s 2023-10-06T11:13:49.251 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.251 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.251 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100224 s, 105 MB/s 2023-10-06T11:13:49.262 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.262 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.262 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00865943 s, 121 MB/s 2023-10-06T11:13:49.274 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.274 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.274 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100751 s, 104 MB/s 2023-10-06T11:13:49.286 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.286 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.286 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100116 s, 105 MB/s 2023-10-06T11:13:49.299 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.299 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.299 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102064 s, 103 MB/s 2023-10-06T11:13:49.311 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.311 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.311 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101009 s, 104 MB/s 2023-10-06T11:13:49.323 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.323 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.323 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00957191 s, 110 MB/s 2023-10-06T11:13:49.335 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.335 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.335 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00978296 s, 107 MB/s 2023-10-06T11:13:49.347 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.347 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.347 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103774 s, 101 MB/s 2023-10-06T11:13:49.359 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.359 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.359 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00947017 s, 111 MB/s 2023-10-06T11:13:49.370 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.370 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.370 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00864952 s, 121 MB/s 2023-10-06T11:13:49.382 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.383 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.383 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102755 s, 102 MB/s 2023-10-06T11:13:49.393 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.394 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.394 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00877008 s, 120 MB/s 2023-10-06T11:13:49.406 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.406 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.406 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.009589 s, 109 MB/s 2023-10-06T11:13:49.419 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.419 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.419 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106518 s, 98.4 MB/s 2023-10-06T11:13:49.431 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.431 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.431 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00979472 s, 107 MB/s 2023-10-06T11:13:49.443 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.443 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.443 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100692 s, 104 MB/s 2023-10-06T11:13:49.455 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.456 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.456 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100991 s, 104 MB/s 2023-10-06T11:13:49.468 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.468 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.468 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101156 s, 104 MB/s 2023-10-06T11:13:49.480 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.480 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.480 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103072 s, 102 MB/s 2023-10-06T11:13:49.492 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.492 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.492 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00962913 s, 109 MB/s 2023-10-06T11:13:49.503 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.503 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.503 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00876859 s, 120 MB/s 2023-10-06T11:13:49.515 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.515 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.515 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00999426 s, 105 MB/s 2023-10-06T11:13:49.527 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.527 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.528 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00976576 s, 107 MB/s 2023-10-06T11:13:49.540 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.540 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.540 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100251 s, 105 MB/s 2023-10-06T11:13:49.552 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.552 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.552 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102292 s, 103 MB/s 2023-10-06T11:13:49.564 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.564 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.564 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954839 s, 110 MB/s 2023-10-06T11:13:49.576 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.576 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.576 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00990928 s, 106 MB/s 2023-10-06T11:13:49.587 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.587 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.587 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00919762 s, 114 MB/s 2023-10-06T11:13:49.598 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.598 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.598 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0084115 s, 125 MB/s 2023-10-06T11:13:49.608 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.608 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.609 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00837267 s, 125 MB/s 2023-10-06T11:13:49.609 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:49.610 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:49.610 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:49.610 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.24 2023-10-06T11:13:49.610 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:49.610 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:49.610 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:49.610 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:49.692 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.693 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.693 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102476 s, 102 MB/s 2023-10-06T11:13:49.704 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.704 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.705 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00979093 s, 107 MB/s 2023-10-06T11:13:49.717 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.717 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.717 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105785 s, 99.1 MB/s 2023-10-06T11:13:49.729 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.729 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.729 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00992914 s, 106 MB/s 2023-10-06T11:13:49.739 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.740 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.740 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00826839 s, 127 MB/s 2023-10-06T11:13:49.752 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.752 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.752 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00998104 s, 105 MB/s 2023-10-06T11:13:49.765 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.765 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.766 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100401 s, 104 MB/s 2023-10-06T11:13:49.776 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.776 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.776 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00952105 s, 110 MB/s 2023-10-06T11:13:49.787 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.788 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.788 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0095058 s, 110 MB/s 2023-10-06T11:13:49.799 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.799 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.799 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00857996 s, 122 MB/s 2023-10-06T11:13:49.810 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.810 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.810 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0091992 s, 114 MB/s 2023-10-06T11:13:49.822 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.823 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.823 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102599 s, 102 MB/s 2023-10-06T11:13:49.834 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.834 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.834 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00961598 s, 109 MB/s 2023-10-06T11:13:49.846 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.846 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.847 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00994932 s, 105 MB/s 2023-10-06T11:13:49.859 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.859 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.859 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102554 s, 102 MB/s 2023-10-06T11:13:49.872 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.873 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.873 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114305 s, 91.7 MB/s 2023-10-06T11:13:49.884 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.884 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.884 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00918201 s, 114 MB/s 2023-10-06T11:13:49.896 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.897 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.897 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00978028 s, 107 MB/s 2023-10-06T11:13:49.909 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.909 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.909 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00992983 s, 106 MB/s 2023-10-06T11:13:49.922 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.922 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.922 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00971043 s, 108 MB/s 2023-10-06T11:13:49.934 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.934 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.934 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00997782 s, 105 MB/s 2023-10-06T11:13:49.951 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.952 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.952 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148536 s, 70.6 MB/s 2023-10-06T11:13:49.998 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:49.999 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:49.999 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00970167 s, 108 MB/s 2023-10-06T11:13:50.010 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.010 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.010 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0095486 s, 110 MB/s 2023-10-06T11:13:50.021 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.021 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.021 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00882588 s, 119 MB/s 2023-10-06T11:13:50.034 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.034 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.035 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107317 s, 97.7 MB/s 2023-10-06T11:13:50.048 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.048 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.048 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010185 s, 103 MB/s 2023-10-06T11:13:50.060 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.060 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.060 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00999117 s, 105 MB/s 2023-10-06T11:13:50.072 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.072 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.072 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00941199 s, 111 MB/s 2023-10-06T11:13:50.084 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.084 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.084 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00993607 s, 106 MB/s 2023-10-06T11:13:50.096 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.096 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.096 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00981198 s, 107 MB/s 2023-10-06T11:13:50.106 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.107 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.107 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00851849 s, 123 MB/s 2023-10-06T11:13:50.108 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:50.108 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:50.108 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:50.108 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.25 2023-10-06T11:13:50.108 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:50.108 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:50.108 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:50.108 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:50.189 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.189 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.189 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00847197 s, 124 MB/s 2023-10-06T11:13:50.199 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.199 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.199 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00854978 s, 123 MB/s 2023-10-06T11:13:50.212 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.212 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.212 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103474 s, 101 MB/s 2023-10-06T11:13:50.225 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.225 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.225 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010585 s, 99.1 MB/s 2023-10-06T11:13:50.237 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.237 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.237 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00985645 s, 106 MB/s 2023-10-06T11:13:50.249 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.250 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.250 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101812 s, 103 MB/s 2023-10-06T11:13:50.260 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.260 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.261 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00873595 s, 120 MB/s 2023-10-06T11:13:50.272 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.272 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.272 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00966568 s, 108 MB/s 2023-10-06T11:13:50.284 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.284 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.284 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00977417 s, 107 MB/s 2023-10-06T11:13:50.296 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.296 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.296 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00959602 s, 109 MB/s 2023-10-06T11:13:50.308 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.308 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.308 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0095562 s, 110 MB/s 2023-10-06T11:13:50.319 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.320 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.320 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00964485 s, 109 MB/s 2023-10-06T11:13:50.330 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.330 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.331 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00864281 s, 121 MB/s 2023-10-06T11:13:50.341 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.341 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.341 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00877721 s, 119 MB/s 2023-10-06T11:13:50.353 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.354 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.354 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00988006 s, 106 MB/s 2023-10-06T11:13:50.365 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.365 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.365 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00946496 s, 111 MB/s 2023-10-06T11:13:50.379 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.379 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.379 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00987414 s, 106 MB/s 2023-10-06T11:13:50.389 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.389 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.389 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00942761 s, 111 MB/s 2023-10-06T11:13:50.401 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.401 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.402 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103001 s, 102 MB/s 2023-10-06T11:13:50.414 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.414 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.414 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100495 s, 104 MB/s 2023-10-06T11:13:50.424 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.424 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.424 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00836493 s, 125 MB/s 2023-10-06T11:13:50.436 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.436 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.436 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00934134 s, 112 MB/s 2023-10-06T11:13:50.446 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.446 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.447 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00842554 s, 124 MB/s 2023-10-06T11:13:50.459 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.459 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.459 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101361 s, 103 MB/s 2023-10-06T11:13:50.469 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.469 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.470 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0084223 s, 124 MB/s 2023-10-06T11:13:50.481 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.481 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.481 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00940568 s, 111 MB/s 2023-10-06T11:13:50.494 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.494 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.494 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102432 s, 102 MB/s 2023-10-06T11:13:50.506 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.506 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.506 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102657 s, 102 MB/s 2023-10-06T11:13:50.518 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.518 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.518 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00946123 s, 111 MB/s 2023-10-06T11:13:50.530 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.530 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.530 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00995446 s, 105 MB/s 2023-10-06T11:13:50.541 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.541 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.541 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00875114 s, 120 MB/s 2023-10-06T11:13:50.553 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.553 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.553 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00926632 s, 113 MB/s 2023-10-06T11:13:50.554 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:50.555 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:50.555 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:50.555 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.26 2023-10-06T11:13:50.555 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:50.555 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:50.555 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:50.556 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:50.636 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.636 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.637 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00948265 s, 111 MB/s 2023-10-06T11:13:50.648 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.648 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.648 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00955797 s, 110 MB/s 2023-10-06T11:13:50.660 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.660 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.660 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102287 s, 103 MB/s 2023-10-06T11:13:50.673 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.673 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.673 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100927 s, 104 MB/s 2023-10-06T11:13:50.684 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.684 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.684 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00943523 s, 111 MB/s 2023-10-06T11:13:50.696 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.697 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.697 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100677 s, 104 MB/s 2023-10-06T11:13:50.708 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.708 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.709 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00948106 s, 111 MB/s 2023-10-06T11:13:50.720 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.721 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.721 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100398 s, 104 MB/s 2023-10-06T11:13:50.731 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.731 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.731 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00863626 s, 121 MB/s 2023-10-06T11:13:50.742 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.742 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.742 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00845053 s, 124 MB/s 2023-10-06T11:13:50.752 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.752 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.753 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00841348 s, 125 MB/s 2023-10-06T11:13:50.765 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.765 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.765 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101875 s, 103 MB/s 2023-10-06T11:13:50.777 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.777 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.777 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00937987 s, 112 MB/s 2023-10-06T11:13:50.789 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.789 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.789 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010035 s, 104 MB/s 2023-10-06T11:13:50.801 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.801 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.802 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103106 s, 102 MB/s 2023-10-06T11:13:50.813 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.813 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.813 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00937443 s, 112 MB/s 2023-10-06T11:13:50.825 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.825 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.825 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00961542 s, 109 MB/s 2023-10-06T11:13:50.837 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.837 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.837 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00957149 s, 110 MB/s 2023-10-06T11:13:50.850 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.850 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.850 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104857 s, 100 MB/s 2023-10-06T11:13:50.860 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.860 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.861 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00866715 s, 121 MB/s 2023-10-06T11:13:50.872 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.872 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.873 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00955921 s, 110 MB/s 2023-10-06T11:13:50.885 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.886 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.886 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106485 s, 98.5 MB/s 2023-10-06T11:13:50.897 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.897 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.897 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00925769 s, 113 MB/s 2023-10-06T11:13:50.909 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.909 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.909 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103124 s, 102 MB/s 2023-10-06T11:13:50.920 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.920 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.920 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00862658 s, 122 MB/s 2023-10-06T11:13:50.932 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.932 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.932 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0094269 s, 111 MB/s 2023-10-06T11:13:50.943 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.943 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.944 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00935953 s, 112 MB/s 2023-10-06T11:13:50.949 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:13:50.951 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:13:50.960 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.960 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.961 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149065 s, 70.3 MB/s 2023-10-06T11:13:50.992 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:50.992 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:50.993 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0098966 s, 106 MB/s 2023-10-06T11:13:51.005 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.005 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.005 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103293 s, 102 MB/s 2023-10-06T11:13:51.017 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.017 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.017 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00932225 s, 112 MB/s 2023-10-06T11:13:51.029 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.029 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.029 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00966289 s, 109 MB/s 2023-10-06T11:13:51.030 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:51.030 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:51.030 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:51.030 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.27 2023-10-06T11:13:51.030 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:51.031 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:51.031 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:51.031 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:51.113 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.114 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.114 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00942702 s, 111 MB/s 2023-10-06T11:13:51.126 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.126 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.126 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00979091 s, 107 MB/s 2023-10-06T11:13:51.138 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.139 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.139 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102487 s, 102 MB/s 2023-10-06T11:13:51.150 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.150 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.150 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00927959 s, 113 MB/s 2023-10-06T11:13:51.162 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.162 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.162 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00888373 s, 118 MB/s 2023-10-06T11:13:51.173 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.173 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.173 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00839576 s, 125 MB/s 2023-10-06T11:13:51.184 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.185 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.185 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00929545 s, 113 MB/s 2023-10-06T11:13:51.196 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.197 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.197 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0093139 s, 113 MB/s 2023-10-06T11:13:51.209 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.209 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.210 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100004 s, 105 MB/s 2023-10-06T11:13:51.220 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.221 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.221 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00874868 s, 120 MB/s 2023-10-06T11:13:51.231 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.231 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.231 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00844524 s, 124 MB/s 2023-10-06T11:13:51.243 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.243 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.244 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00935575 s, 112 MB/s 2023-10-06T11:13:51.254 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.254 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.255 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00877767 s, 119 MB/s 2023-10-06T11:13:51.267 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.267 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.267 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00999831 s, 105 MB/s 2023-10-06T11:13:51.279 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.279 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.279 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00946661 s, 111 MB/s 2023-10-06T11:13:51.291 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.291 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.291 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00971243 s, 108 MB/s 2023-10-06T11:13:51.303 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.303 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.303 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00935672 s, 112 MB/s 2023-10-06T11:13:51.315 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.315 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.315 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00961491 s, 109 MB/s 2023-10-06T11:13:51.327 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.327 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.327 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00914757 s, 115 MB/s 2023-10-06T11:13:51.339 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.339 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.339 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00948792 s, 111 MB/s 2023-10-06T11:13:51.351 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.351 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.351 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00988728 s, 106 MB/s 2023-10-06T11:13:51.363 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.363 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.363 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00940666 s, 111 MB/s 2023-10-06T11:13:51.375 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.375 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.375 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00937842 s, 112 MB/s 2023-10-06T11:13:51.387 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.387 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.387 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.009432 s, 111 MB/s 2023-10-06T11:13:51.399 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.399 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.399 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00967437 s, 108 MB/s 2023-10-06T11:13:51.412 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.412 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.412 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00998583 s, 105 MB/s 2023-10-06T11:13:51.423 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.423 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.423 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00884375 s, 119 MB/s 2023-10-06T11:13:51.434 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.434 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.434 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00859346 s, 122 MB/s 2023-10-06T11:13:51.446 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.446 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.446 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00931866 s, 113 MB/s 2023-10-06T11:13:51.458 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.458 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.458 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00903795 s, 116 MB/s 2023-10-06T11:13:51.470 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.470 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.470 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00929596 s, 113 MB/s 2023-10-06T11:13:51.481 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.482 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.482 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00920519 s, 114 MB/s 2023-10-06T11:13:51.483 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:51.483 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:51.483 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:51.483 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.28 2023-10-06T11:13:51.483 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:51.483 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:51.483 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:51.483 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:51.566 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.566 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.567 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0087523 s, 120 MB/s 2023-10-06T11:13:51.579 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.579 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.579 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010406 s, 101 MB/s 2023-10-06T11:13:51.592 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.592 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.592 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103877 s, 101 MB/s 2023-10-06T11:13:51.604 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.604 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.604 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00924206 s, 113 MB/s 2023-10-06T11:13:51.616 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.616 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.616 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00930933 s, 113 MB/s 2023-10-06T11:13:51.627 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.628 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.628 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00912284 s, 115 MB/s 2023-10-06T11:13:51.640 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.640 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.640 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00969261 s, 108 MB/s 2023-10-06T11:13:51.650 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.651 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.651 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00857102 s, 122 MB/s 2023-10-06T11:13:51.662 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.663 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.663 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00941028 s, 111 MB/s 2023-10-06T11:13:51.674 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.675 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.675 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00941386 s, 111 MB/s 2023-10-06T11:13:51.687 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.687 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.687 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0098383 s, 107 MB/s 2023-10-06T11:13:51.699 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.699 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.699 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00947751 s, 111 MB/s 2023-10-06T11:13:51.711 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.711 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.711 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00988286 s, 106 MB/s 2023-10-06T11:13:51.722 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.723 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.723 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00876664 s, 120 MB/s 2023-10-06T11:13:51.736 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.736 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.736 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00940989 s, 111 MB/s 2023-10-06T11:13:51.745 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.745 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.745 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00861228 s, 122 MB/s 2023-10-06T11:13:51.758 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.758 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.758 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00971036 s, 108 MB/s 2023-10-06T11:13:51.770 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.770 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.770 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00994236 s, 105 MB/s 2023-10-06T11:13:51.782 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.782 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.782 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.009487 s, 111 MB/s 2023-10-06T11:13:51.794 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.794 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.794 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00952567 s, 110 MB/s 2023-10-06T11:13:51.807 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.807 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.807 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101415 s, 103 MB/s 2023-10-06T11:13:51.818 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.818 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.818 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00863736 s, 121 MB/s 2023-10-06T11:13:51.831 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.831 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.831 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0096621 s, 109 MB/s 2023-10-06T11:13:51.843 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.843 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.843 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101339 s, 103 MB/s 2023-10-06T11:13:51.854 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.854 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.854 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00870002 s, 121 MB/s 2023-10-06T11:13:51.865 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.865 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.866 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00855596 s, 123 MB/s 2023-10-06T11:13:51.877 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.877 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.878 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00990332 s, 106 MB/s 2023-10-06T11:13:51.889 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.889 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.889 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00929464 s, 113 MB/s 2023-10-06T11:13:51.901 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.901 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.901 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00982206 s, 107 MB/s 2023-10-06T11:13:51.912 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.913 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.913 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00953715 s, 110 MB/s 2023-10-06T11:13:51.923 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.923 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.924 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00867924 s, 121 MB/s 2023-10-06T11:13:51.934 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:51.935 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:51.936 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00864494 s, 121 MB/s 2023-10-06T11:13:51.937 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:51.937 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:51.937 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:51.937 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.29 2023-10-06T11:13:51.937 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:51.938 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:51.938 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:51.938 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:52.019 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.019 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.019 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00959174 s, 109 MB/s 2023-10-06T11:13:52.031 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.031 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.031 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0095405 s, 110 MB/s 2023-10-06T11:13:52.043 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.043 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.043 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100584 s, 104 MB/s 2023-10-06T11:13:52.055 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.055 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.055 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101029 s, 104 MB/s 2023-10-06T11:13:52.068 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.068 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.068 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105487 s, 99.4 MB/s 2023-10-06T11:13:52.080 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.080 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.080 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00986914 s, 106 MB/s 2023-10-06T11:13:52.091 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.091 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.092 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00927351 s, 113 MB/s 2023-10-06T11:13:52.103 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.103 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.104 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.009647 s, 109 MB/s 2023-10-06T11:13:52.115 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.115 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.115 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00978584 s, 107 MB/s 2023-10-06T11:13:52.127 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.127 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.127 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00943377 s, 111 MB/s 2023-10-06T11:13:52.137 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.138 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.138 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0083773 s, 125 MB/s 2023-10-06T11:13:52.149 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.149 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.149 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954114 s, 110 MB/s 2023-10-06T11:13:52.161 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.161 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.162 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100593 s, 104 MB/s 2023-10-06T11:13:52.174 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.174 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.174 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101011 s, 104 MB/s 2023-10-06T11:13:52.186 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.186 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.186 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100987 s, 104 MB/s 2023-10-06T11:13:52.197 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.197 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.197 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00832008 s, 126 MB/s 2023-10-06T11:13:52.208 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.208 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.209 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00932975 s, 112 MB/s 2023-10-06T11:13:52.220 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.220 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.220 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00960702 s, 109 MB/s 2023-10-06T11:13:52.232 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.232 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.232 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0095669 s, 110 MB/s 2023-10-06T11:13:52.244 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.244 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.244 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00934604 s, 112 MB/s 2023-10-06T11:13:52.256 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.256 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.256 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0097316 s, 108 MB/s 2023-10-06T11:13:52.267 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.267 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.267 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00858828 s, 122 MB/s 2023-10-06T11:13:52.278 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.278 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.278 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0091485 s, 115 MB/s 2023-10-06T11:13:52.289 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.290 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.290 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00902862 s, 116 MB/s 2023-10-06T11:13:52.300 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.300 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.300 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00858362 s, 122 MB/s 2023-10-06T11:13:52.312 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.312 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.313 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100367 s, 104 MB/s 2023-10-06T11:13:52.323 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.323 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.323 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0084079 s, 125 MB/s 2023-10-06T11:13:52.334 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.334 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.335 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00913751 s, 115 MB/s 2023-10-06T11:13:52.347 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.347 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.347 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100765 s, 104 MB/s 2023-10-06T11:13:52.359 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.359 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.359 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00962448 s, 109 MB/s 2023-10-06T11:13:52.370 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.370 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.371 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00936337 s, 112 MB/s 2023-10-06T11:13:52.381 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.381 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.381 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00841297 s, 125 MB/s 2023-10-06T11:13:52.382 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:52.382 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:52.382 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:52.382 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.30 2023-10-06T11:13:52.382 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:52.382 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:52.383 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:52.383 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:52.466 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.466 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.467 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108173 s, 96.9 MB/s 2023-10-06T11:13:52.479 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.479 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.479 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102943 s, 102 MB/s 2023-10-06T11:13:52.490 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.490 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.491 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00917828 s, 114 MB/s 2023-10-06T11:13:52.501 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.501 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.501 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00874188 s, 120 MB/s 2023-10-06T11:13:52.512 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.513 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.513 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0091481 s, 115 MB/s 2023-10-06T11:13:52.524 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.524 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.524 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00917094 s, 114 MB/s 2023-10-06T11:13:52.534 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.534 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.535 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00855346 s, 123 MB/s 2023-10-06T11:13:52.547 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.548 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.548 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107208 s, 97.8 MB/s 2023-10-06T11:13:52.559 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.559 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.559 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00930295 s, 113 MB/s 2023-10-06T11:13:52.571 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.571 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.571 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100407 s, 104 MB/s 2023-10-06T11:13:52.583 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.583 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.583 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00928869 s, 113 MB/s 2023-10-06T11:13:52.594 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.594 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.594 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00914631 s, 115 MB/s 2023-10-06T11:13:52.606 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.606 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.606 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00992005 s, 106 MB/s 2023-10-06T11:13:52.617 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.617 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.617 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.009085 s, 115 MB/s 2023-10-06T11:13:52.628 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.628 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.628 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00836432 s, 125 MB/s 2023-10-06T11:13:52.640 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.641 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.641 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010209 s, 103 MB/s 2023-10-06T11:13:52.651 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.651 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.652 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00853329 s, 123 MB/s 2023-10-06T11:13:52.663 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.663 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.663 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00937955 s, 112 MB/s 2023-10-06T11:13:52.675 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.676 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.676 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00963116 s, 109 MB/s 2023-10-06T11:13:52.687 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.687 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.687 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100882 s, 104 MB/s 2023-10-06T11:13:52.699 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.699 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.699 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0093741 s, 112 MB/s 2023-10-06T11:13:52.710 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.711 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.711 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00957901 s, 109 MB/s 2023-10-06T11:13:52.722 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.722 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.722 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00928934 s, 113 MB/s 2023-10-06T11:13:52.734 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.734 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.734 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00948295 s, 111 MB/s 2023-10-06T11:13:52.746 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.746 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.746 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0096524 s, 109 MB/s 2023-10-06T11:13:52.757 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.757 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.757 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00908498 s, 115 MB/s 2023-10-06T11:13:52.769 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.769 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.770 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102898 s, 102 MB/s 2023-10-06T11:13:52.781 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.781 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.781 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00936905 s, 112 MB/s 2023-10-06T11:13:52.793 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.793 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.793 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00935078 s, 112 MB/s 2023-10-06T11:13:52.805 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.805 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.805 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102021 s, 103 MB/s 2023-10-06T11:13:52.815 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.816 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.816 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00848181 s, 124 MB/s 2023-10-06T11:13:52.827 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.827 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.827 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00877179 s, 120 MB/s 2023-10-06T11:13:52.828 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:13:52.828 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:13:52.828 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:13:52.828 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.31 2023-10-06T11:13:52.828 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:13:52.828 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:13:52.828 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:13:52.828 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:13:52.870 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.870 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.870 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00934989 s, 112 MB/s 2023-10-06T11:13:52.882 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.882 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.882 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100613 s, 104 MB/s 2023-10-06T11:13:52.893 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.894 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.894 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00937777 s, 112 MB/s 2023-10-06T11:13:52.906 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.906 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.906 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00987709 s, 106 MB/s 2023-10-06T11:13:52.916 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.916 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.916 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00852176 s, 123 MB/s 2023-10-06T11:13:52.927 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.927 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.927 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00850281 s, 123 MB/s 2023-10-06T11:13:52.938 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.939 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.939 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00915642 s, 115 MB/s 2023-10-06T11:13:52.951 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.951 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.951 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010465 s, 100 MB/s 2023-10-06T11:13:52.964 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.964 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.964 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105415 s, 99.5 MB/s 2023-10-06T11:13:52.998 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:52.999 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:52.999 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00916667 s, 114 MB/s 2023-10-06T11:13:53.009 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:53.010 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:53.010 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00905786 s, 116 MB/s 2023-10-06T11:13:53.020 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:53.021 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:53.021 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.008664 s, 121 MB/s 2023-10-06T11:13:53.032 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:53.032 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:53.032 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00920949 s, 114 MB/s 2023-10-06T11:13:53.043 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:53.043 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:53.043 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0086321 s, 121 MB/s 2023-10-06T11:13:53.054 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:53.054 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:53.054 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00905839 s, 116 MB/s 2023-10-06T11:13:53.065 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:53.066 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:53.066 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00936144 s, 112 MB/s 2023-10-06T11:13:53.076 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:53.077 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:53.077 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00872182 s, 120 MB/s 2023-10-06T11:13:53.087 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:53.087 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:53.088 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00867229 s, 121 MB/s 2023-10-06T11:13:53.099 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:53.099 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:53.099 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00945956 s, 111 MB/s 2023-10-06T11:13:53.110 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:53.110 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:53.110 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00872687 s, 120 MB/s 2023-10-06T11:13:53.122 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:53.122 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:53.122 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00959325 s, 109 MB/s 2023-10-06T11:13:53.133 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:53.133 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:53.133 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00913525 s, 115 MB/s 2023-10-06T11:13:53.145 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:53.145 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:53.146 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100534 s, 104 MB/s 2023-10-06T11:13:53.156 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:53.156 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:53.157 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00851419 s, 123 MB/s 2023-10-06T11:13:53.169 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:53.169 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:53.169 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101314 s, 103 MB/s 2023-10-06T11:13:53.181 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:53.181 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:53.181 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010186 s, 103 MB/s 2023-10-06T11:13:53.192 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:53.193 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:53.193 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00926774 s, 113 MB/s 2023-10-06T11:13:53.204 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:53.204 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:53.204 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00932043 s, 113 MB/s 2023-10-06T11:13:53.216 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:53.217 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:53.217 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102457 s, 102 MB/s 2023-10-06T11:13:53.227 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:53.227 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:53.228 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00854719 s, 123 MB/s 2023-10-06T11:13:53.239 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:53.239 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:53.239 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0091536 s, 115 MB/s 2023-10-06T11:13:53.249 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:13:53.250 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:13:53.250 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00839006 s, 125 MB/s 2023-10-06T11:13:53.253 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 scrub start /scrub_control_test_path recursive 2023-10-06T11:13:53.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.408+0000 7fb84b148700 1 Processor -- start 2023-10-06T11:13:53.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.408+0000 7fb84b148700 1 -- start start 2023-10-06T11:13:53.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.409+0000 7fb84b148700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb84415a160 0x7fb8440c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.409+0000 7fb84b148700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb8440ae730 0x7fb8440aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.409+0000 7fb84b148700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8440ce3d0 0x7fb8440ce810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.409+0000 7fb84b148700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8440ae2a0 con 0x7fb84415a160 2023-10-06T11:13:53.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.409+0000 7fb84b148700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb84415a530 con 0x7fb8440ae730 2023-10-06T11:13:53.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.409+0000 7fb84b148700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8440af0f0 con 0x7fb8440ce3d0 2023-10-06T11:13:53.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.409+0000 7fb848ee4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb84415a160 0x7fb8440c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.409+0000 7fb848ee4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb84415a160 0x7fb8440c55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46954/0 (socket says 172.21.15.146:46954) 2023-10-06T11:13:53.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.409+0000 7fb848ee4700 1 -- 172.21.15.146:0/2179262360 learned_addr learned my addr 172.21.15.146:0/2179262360 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:53.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.409+0000 7fb8496e5700 1 --2- 172.21.15.146:0/2179262360 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8440ce3d0 0x7fb8440ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.409+0000 7fb843fff700 1 --2- 172.21.15.146:0/2179262360 >> v2:172.21.15.151:3300/0 conn(0x7fb8440ae730 0x7fb8440aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.409+0000 7fb848ee4700 1 -- 172.21.15.146:0/2179262360 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8440ce3d0 msgr2=0x7fb8440ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:53.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.409+0000 7fb848ee4700 1 --2- 172.21.15.146:0/2179262360 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8440ce3d0 0x7fb8440ce810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.409+0000 7fb848ee4700 1 -- 172.21.15.146:0/2179262360 >> v2:172.21.15.151:3300/0 conn(0x7fb8440ae730 msgr2=0x7fb8440aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:53.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.409+0000 7fb848ee4700 1 --2- 172.21.15.146:0/2179262360 >> v2:172.21.15.151:3300/0 conn(0x7fb8440ae730 0x7fb8440aebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.409+0000 7fb848ee4700 1 -- 172.21.15.146:0/2179262360 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8440ad690 con 0x7fb84415a160 2023-10-06T11:13:53.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.409+0000 7fb848ee4700 1 --2- 172.21.15.146:0/2179262360 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb84415a160 0x7fb8440c55a0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fb8440d16e0 tx=0x7fb83c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44ff58e11c4c2169 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:53.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.409+0000 7fb8437fe700 1 -- 172.21.15.146:0/2179262360 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c00e070 con 0x7fb84415a160 2023-10-06T11:13:53.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.409+0000 7fb8437fe700 1 -- 172.21.15.146:0/2179262360 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83c00b970 con 0x7fb84415a160 2023-10-06T11:13:53.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.409+0000 7fb8437fe700 1 -- 172.21.15.146:0/2179262360 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c0092e0 con 0x7fb84415a160 2023-10-06T11:13:53.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.410+0000 7fb84b148700 1 -- 172.21.15.146:0/2179262360 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb84415a160 msgr2=0x7fb8440c55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.410+0000 7fb84b148700 1 --2- 172.21.15.146:0/2179262360 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb84415a160 0x7fb8440c55a0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fb8440d16e0 tx=0x7fb83c009840 comp rx=0 tx=0).stop 2023-10-06T11:13:53.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.410+0000 7fb84b148700 1 -- 172.21.15.146:0/2179262360 shutdown_connections 2023-10-06T11:13:53.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.410+0000 7fb84b148700 1 --2- 172.21.15.146:0/2179262360 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8440ce3d0 0x7fb8440ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.410+0000 7fb84b148700 1 --2- 172.21.15.146:0/2179262360 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb84415a160 0x7fb8440c55a0 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.410+0000 7fb84b148700 1 --2- 172.21.15.146:0/2179262360 >> v2:172.21.15.151:3300/0 conn(0x7fb8440ae730 0x7fb8440aebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.410+0000 7fb84b148700 1 -- 172.21.15.146:0/2179262360 >> 172.21.15.146:0/2179262360 conn(0x7fb84406f380 msgr2=0x7fb8440d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:53.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.410+0000 7fb84b148700 1 -- 172.21.15.146:0/2179262360 shutdown_connections 2023-10-06T11:13:53.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.410+0000 7fb84b148700 1 -- 172.21.15.146:0/2179262360 wait complete. 2023-10-06T11:13:53.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.411+0000 7fb84b148700 1 Processor -- start 2023-10-06T11:13:53.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.411+0000 7fb84b148700 1 -- start start 2023-10-06T11:13:53.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.412+0000 7fb84b148700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb8440ae730 0x7fb84415dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.412+0000 7fb84b148700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8440ce3d0 0x7fb8440687a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.412+0000 7fb84b148700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb84415a160 0x7fb844157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.412+0000 7fb84b148700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84415f1b0 con 0x7fb84415a160 2023-10-06T11:13:53.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.412+0000 7fb84b148700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84415e5a0 con 0x7fb8440ae730 2023-10-06T11:13:53.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.412+0000 7fb84b148700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb84415e880 con 0x7fb8440ce3d0 2023-10-06T11:13:53.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.412+0000 7fb8496e5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb84415a160 0x7fb844157450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.418 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.412+0000 7fb8496e5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb84415a160 0x7fb844157450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46964/0 (socket says 172.21.15.146:46964) 2023-10-06T11:13:53.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.412+0000 7fb8496e5700 1 -- 172.21.15.146:0/732782976 learned_addr learned my addr 172.21.15.146:0/732782976 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:53.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.412+0000 7fb848ee4700 1 --2- 172.21.15.146:0/732782976 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb8440ae730 0x7fb84415dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.412+0000 7fb843fff700 1 --2- 172.21.15.146:0/732782976 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8440ce3d0 0x7fb8440687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.412+0000 7fb8496e5700 1 -- 172.21.15.146:0/732782976 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8440ce3d0 msgr2=0x7fb8440687a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.412+0000 7fb8496e5700 1 --2- 172.21.15.146:0/732782976 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8440ce3d0 0x7fb8440687a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.412+0000 7fb8496e5700 1 -- 172.21.15.146:0/732782976 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb8440ae730 msgr2=0x7fb84415dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.412+0000 7fb8496e5700 1 --2- 172.21.15.146:0/732782976 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb8440ae730 0x7fb84415dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.412+0000 7fb8496e5700 1 -- 172.21.15.146:0/732782976 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb83c009ae0 con 0x7fb84415a160 2023-10-06T11:13:53.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.413+0000 7fb8496e5700 1 --2- 172.21.15.146:0/732782976 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb84415a160 0x7fb844157450 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fb83400e8d0 tx=0x7fb8340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:53.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.413+0000 7fb840ff9700 1 -- 172.21.15.146:0/732782976 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83400ee70 con 0x7fb84415a160 2023-10-06T11:13:53.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.413+0000 7fb840ff9700 1 -- 172.21.15.146:0/732782976 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83400c850 con 0x7fb84415a160 2023-10-06T11:13:53.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.413+0000 7fb84b148700 1 -- 172.21.15.146:0/732782976 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb84415eb60 con 0x7fb84415a160 2023-10-06T11:13:53.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.413+0000 7fb840ff9700 1 -- 172.21.15.146:0/732782976 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83400cc50 con 0x7fb84415a160 2023-10-06T11:13:53.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.413+0000 7fb84b148700 1 -- 172.21.15.146:0/732782976 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb84415e190 con 0x7fb84415a160 2023-10-06T11:13:53.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.414+0000 7fb840ff9700 1 -- 172.21.15.146:0/732782976 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb834013680 con 0x7fb84415a160 2023-10-06T11:13:53.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.415+0000 7fb840ff9700 1 --2- 172.21.15.146:0/732782976 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb824066f30 0x7fb8240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.415+0000 7fb848ee4700 1 --2- 172.21.15.146:0/732782976 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb824066f30 0x7fb8240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.415+0000 7fb840ff9700 1 -- 172.21.15.146:0/732782976 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb834084850 con 0x7fb84415a160 2023-10-06T11:13:53.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.415+0000 7fb848ee4700 1 --2- 172.21.15.146:0/732782976 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb824066f30 0x7fb8240693e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fb83c009fd0 tx=0x7fb83c018000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:53.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.417+0000 7fb854440b80 1 Processor -- start 2023-10-06T11:13:53.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.417+0000 7fb854440b80 1 -- start start 2023-10-06T11:13:53.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.417+0000 7fb854440b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ff0657b90 0x561ff0657f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.417+0000 7fb854440b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ff0613aa0 0x561ff0610680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.417+0000 7fb854440b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ff0611cd0 0x561ff0610bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.417+0000 7fb854440b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ff0590d80 con 0x561ff0613aa0 2023-10-06T11:13:53.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.417+0000 7fb854440b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ff0567b70 con 0x561ff0657b90 2023-10-06T11:13:53.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.417+0000 7fb854440b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ff0565370 con 0x561ff0611cd0 2023-10-06T11:13:53.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.417+0000 7fb843fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ff0613aa0 0x561ff0610680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.417+0000 7fb843fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ff0613aa0 0x561ff0610680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46974/0 (socket says 172.21.15.146:46974) 2023-10-06T11:13:53.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.418+0000 7fb843fff700 1 -- 172.21.15.146:0/2788241464 learned_addr learned my addr 172.21.15.146:0/2788241464 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:53.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.418+0000 7fb8496e5700 1 --2- 172.21.15.146:0/2788241464 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ff0611cd0 0x561ff0610bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.418+0000 7fb848ee4700 1 --2- 172.21.15.146:0/2788241464 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ff0657b90 0x561ff0657f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.418+0000 7fb843fff700 1 -- 172.21.15.146:0/2788241464 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ff0611cd0 msgr2=0x561ff0610bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:53.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.418+0000 7fb843fff700 1 --2- 172.21.15.146:0/2788241464 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ff0611cd0 0x561ff0610bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.418+0000 7fb843fff700 1 -- 172.21.15.146:0/2788241464 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ff0657b90 msgr2=0x561ff0657f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:53.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.418+0000 7fb843fff700 1 --2- 172.21.15.146:0/2788241464 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ff0657b90 0x561ff0657f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.418+0000 7fb843fff700 1 -- 172.21.15.146:0/2788241464 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ff03fb370 con 0x561ff0613aa0 2023-10-06T11:13:53.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.418+0000 7fb8496e5700 1 --2- 172.21.15.146:0/2788241464 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ff0611cd0 0x561ff0610bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:53.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.418+0000 7fb848ee4700 1 --2- 172.21.15.146:0/2788241464 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ff0657b90 0x561ff0657f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:53.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.418+0000 7fb843fff700 1 --2- 172.21.15.146:0/2788241464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ff0613aa0 0x561ff0610680 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fb82c009b70 tx=0x7fb82c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77526e672c54a30f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:53.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.418+0000 7fb839ffb700 1 -- 172.21.15.146:0/2788241464 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82c011880 con 0x561ff0613aa0 2023-10-06T11:13:53.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.418+0000 7fb839ffb700 1 -- 172.21.15.146:0/2788241464 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb82c0119e0 con 0x561ff0613aa0 2023-10-06T11:13:53.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.418+0000 7fb839ffb700 1 -- 172.21.15.146:0/2788241464 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82c011d60 con 0x561ff0613aa0 2023-10-06T11:13:53.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.419+0000 7fb854440b80 1 -- 172.21.15.146:0/2788241464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ff0613aa0 msgr2=0x561ff0610680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.419+0000 7fb854440b80 1 --2- 172.21.15.146:0/2788241464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ff0613aa0 0x561ff0610680 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fb82c009b70 tx=0x7fb82c008040 comp rx=0 tx=0).stop 2023-10-06T11:13:53.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.419+0000 7fb854440b80 1 -- 172.21.15.146:0/2788241464 shutdown_connections 2023-10-06T11:13:53.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.419+0000 7fb854440b80 1 --2- 172.21.15.146:0/2788241464 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ff0611cd0 0x561ff0610bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.419+0000 7fb854440b80 1 --2- 172.21.15.146:0/2788241464 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ff0657b90 0x561ff0657f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.419+0000 7fb854440b80 1 --2- 172.21.15.146:0/2788241464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ff0613aa0 0x561ff0610680 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.419+0000 7fb854440b80 1 -- 172.21.15.146:0/2788241464 >> 172.21.15.146:0/2788241464 conn(0x561ff0612170 msgr2=0x561ff0612540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:53.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.419+0000 7fb854440b80 1 -- 172.21.15.146:0/2788241464 shutdown_connections 2023-10-06T11:13:53.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.419+0000 7fb854440b80 1 -- 172.21.15.146:0/2788241464 wait complete. 2023-10-06T11:13:53.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.419+0000 7fb854440b80 1 -- start start 2023-10-06T11:13:53.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.419+0000 7fb854440b80 1 Processor -- start 2023-10-06T11:13:53.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.420+0000 7fb854440b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ff0611cd0 0x561ff063e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.420+0000 7fb854440b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ff0613aa0 0x561ff063c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.420+0000 7fb854440b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ff0657b90 0x561ff063cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.420+0000 7fb854440b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ff0561160 con 0x561ff0613aa0 2023-10-06T11:13:53.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.420+0000 7fb854440b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ff050c990 con 0x561ff0657b90 2023-10-06T11:13:53.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.420+0000 7fb854440b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ff0527fa0 con 0x561ff0611cd0 2023-10-06T11:13:53.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.420+0000 7fb854440b80 10 client.0 _ll_register_callbacks cb 0x561ff03fe030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:13:53.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.420+0000 7fb843fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ff0613aa0 0x561ff063c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.420+0000 7fb843fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ff0613aa0 0x561ff063c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46986/0 (socket says 172.21.15.146:46986) 2023-10-06T11:13:53.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.420+0000 7fb843fff700 1 -- 172.21.15.146:0/2688779441 learned_addr learned my addr 172.21.15.146:0/2688779441 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:53.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.420+0000 7fb8496e5700 1 --2- 172.21.15.146:0/2688779441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ff0657b90 0x561ff063cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.420+0000 7fb848ee4700 1 --2- 172.21.15.146:0/2688779441 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ff0611cd0 0x561ff063e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.421+0000 7fb843fff700 1 -- 172.21.15.146:0/2688779441 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ff0611cd0 msgr2=0x561ff063e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:53.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.421+0000 7fb843fff700 1 --2- 172.21.15.146:0/2688779441 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ff0611cd0 0x561ff063e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.421+0000 7fb843fff700 1 -- 172.21.15.146:0/2688779441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ff0657b90 msgr2=0x561ff063cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:53.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.421+0000 7fb843fff700 1 --2- 172.21.15.146:0/2688779441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ff0657b90 0x561ff063cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.421+0000 7fb843fff700 1 -- 172.21.15.146:0/2688779441 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb82c0097f0 con 0x561ff0613aa0 2023-10-06T11:13:53.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.421+0000 7fb843fff700 1 --2- 172.21.15.146:0/2688779441 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ff0613aa0 0x561ff063c9c0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x561ff0613ff0 tx=0x7fb82c01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ef4662682eca2a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:53.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.421+0000 7fb822ffd700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:13:53.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.421+0000 7fb822ffd700 1 -- 172.21.15.146:0/2688779441 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb82c009680 con 0x561ff0613aa0 2023-10-06T11:13:53.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.421+0000 7fb822ffd700 1 -- 172.21.15.146:0/2688779441 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb82c015880 con 0x561ff0613aa0 2023-10-06T11:13:53.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.421+0000 7fb854440b80 1 -- 172.21.15.146:0/2688779441 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561ff0605790 con 0x561ff0613aa0 2023-10-06T11:13:53.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.421+0000 7fb822ffd700 1 -- 172.21.15.146:0/2688779441 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb82c015c50 con 0x561ff0613aa0 2023-10-06T11:13:53.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.421+0000 7fb854440b80 10 client.7803 fetch_fsmap learned FSMap version 93 2023-10-06T11:13:53.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.421+0000 7fb854440b80 1 -- 172.21.15.146:0/2688779441 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x561ff039e0e0 con 0x561ff0613aa0 2023-10-06T11:13:53.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.421+0000 7fb822ffd700 1 -- 172.21.15.146:0/2688779441 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561ff0605790 con 0x561ff0613aa0 2023-10-06T11:13:53.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.421+0000 7fb822ffd700 1 -- 172.21.15.146:0/2688779441 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 93) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb82c01e450 con 0x561ff0613aa0 2023-10-06T11:13:53.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.421+0000 7fb854440b80 10 client.7803 fetch_fsmap finished waiting for FSMap version 93 2023-10-06T11:13:53.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.421+0000 7fb854440b80 10 client.7803 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2023-10-06T11:13:53.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.421+0000 7fb854440b80 20 client.7803 populate_metadata read hostname 'smithi146' 2023-10-06T11:13:53.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.421+0000 7fb854440b80 1 --2- 172.21.15.146:0/2688779441 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x561ff0651f80 0x561ff0653c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.421+0000 7fb854440b80 4 client.7803 mds_command: new command op to 7620 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:13:53.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.421+0000 7fb854440b80 1 -- 172.21.15.146:0/2688779441 --> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561ff05e26c0 con 0x561ff0651f80 2023-10-06T11:13:53.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.422+0000 7fb848ee4700 1 --2- 172.21.15.146:0/2688779441 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x561ff0651f80 0x561ff0653c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.422+0000 7fb822ffd700 10 client.7803 ms_handle_connect on v2:172.21.15.146:6834/785131800 2023-10-06T11:13:53.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.422+0000 7fb848ee4700 1 --2- 172.21.15.146:0/2688779441 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x561ff0651f80 0x561ff0653c90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=119c4cb0126c8e97 server_cookie=b84d92ab787cf250 in_seq=0 out_seq=0 2023-10-06T11:13:53.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.422+0000 7fb822ffd700 1 -- 172.21.15.146:0/2688779441 <== mds.0 v2:172.21.15.146:6834/785131800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x561ff05e26c0 con 0x561ff0651f80 2023-10-06T11:13:53.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.422+0000 7fb822ffd700 10 client.7803 handle_command_reply: tid=0 2023-10-06T11:13:53.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.422+0000 7fb854440b80 1 client.7803 shutdown 2023-10-06T11:13:53.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.423+0000 7fb854440b80 1 -- 172.21.15.146:0/2688779441 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ff0613aa0 msgr2=0x561ff063c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.423+0000 7fb854440b80 1 --2- 172.21.15.146:0/2688779441 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ff0613aa0 0x561ff063c9c0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x561ff0613ff0 tx=0x7fb82c01c000 comp rx=0 tx=0).stop 2023-10-06T11:13:53.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.423+0000 7fb854440b80 1 -- 172.21.15.146:0/2688779441 shutdown_connections 2023-10-06T11:13:53.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.423+0000 7fb854440b80 1 --2- 172.21.15.146:0/2688779441 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x561ff0651f80 0x561ff0653c90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.423+0000 7fb854440b80 1 --2- 172.21.15.146:0/2688779441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ff0657b90 0x561ff063cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.423+0000 7fb854440b80 1 --2- 172.21.15.146:0/2688779441 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ff0611cd0 0x561ff063e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.423+0000 7fb822ffd700 0 client.7803 ms_handle_reset on v2:172.21.15.146:6834/785131800 2023-10-06T11:13:53.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.423+0000 7fb854440b80 1 --2- 172.21.15.146:0/2688779441 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ff0613aa0 0x561ff063c9c0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.423+0000 7fb854440b80 1 -- 172.21.15.146:0/2688779441 >> 172.21.15.146:0/2688779441 conn(0x561ff0612170 msgr2=0x561ff0655620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:53.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.423+0000 7fb854440b80 1 -- 172.21.15.146:0/2688779441 shutdown_connections 2023-10-06T11:13:53.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.423+0000 7fb854440b80 1 -- 172.21.15.146:0/2688779441 wait complete. 2023-10-06T11:13:53.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.423+0000 7fb854440b80 20 client.7803 trim_cache size 0 max 16384 2023-10-06T11:13:53.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.439+0000 7fb854440b80 1 Processor -- start 2023-10-06T11:13:53.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.439+0000 7fb854440b80 1 -- start start 2023-10-06T11:13:53.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.439+0000 7fb854440b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ff0611cd0 0x561ff063e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.439+0000 7fb854440b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ff0613aa0 0x561ff060cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.439+0000 7fb854440b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ff0657b90 0x561ff0654500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.439+0000 7fb854440b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ff03e3f30 con 0x561ff0657b90 2023-10-06T11:13:53.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.439+0000 7fb854440b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ff063e920 con 0x561ff0611cd0 2023-10-06T11:13:53.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.439+0000 7fb854440b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ff06101d0 con 0x561ff0613aa0 2023-10-06T11:13:53.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.439+0000 7fb8496e5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ff0657b90 0x561ff0654500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.439+0000 7fb8496e5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ff0657b90 0x561ff0654500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46990/0 (socket says 172.21.15.146:46990) 2023-10-06T11:13:53.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.439+0000 7fb8496e5700 1 -- 172.21.15.146:0/1730367268 learned_addr learned my addr 172.21.15.146:0/1730367268 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:53.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.440+0000 7fb848ee4700 1 --2- 172.21.15.146:0/1730367268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ff0611cd0 0x561ff063e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.440+0000 7fb843fff700 1 --2- 172.21.15.146:0/1730367268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ff0613aa0 0x561ff060cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.440+0000 7fb8496e5700 1 -- 172.21.15.146:0/1730367268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ff0613aa0 msgr2=0x561ff060cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:53.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.440+0000 7fb8496e5700 1 --2- 172.21.15.146:0/1730367268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ff0613aa0 0x561ff060cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.440+0000 7fb8496e5700 1 -- 172.21.15.146:0/1730367268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ff0611cd0 msgr2=0x561ff063e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:53.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.440+0000 7fb8496e5700 1 --2- 172.21.15.146:0/1730367268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ff0611cd0 0x561ff063e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.440+0000 7fb8496e5700 1 -- 172.21.15.146:0/1730367268 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ff052f880 con 0x561ff0657b90 2023-10-06T11:13:53.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.440+0000 7fb8496e5700 1 --2- 172.21.15.146:0/1730367268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ff0657b90 0x561ff0654500 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fb834082be0 tx=0x7fb834015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8df4f286e0eb8d2e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:53.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.440+0000 7fb83a7fc700 1 -- 172.21.15.146:0/1730367268 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb834058890 con 0x561ff0657b90 2023-10-06T11:13:53.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.440+0000 7fb83a7fc700 1 -- 172.21.15.146:0/1730367268 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83405c560 con 0x561ff0657b90 2023-10-06T11:13:53.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.440+0000 7fb83a7fc700 1 -- 172.21.15.146:0/1730367268 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb834053960 con 0x561ff0657b90 2023-10-06T11:13:53.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.440+0000 7fb854440b80 1 -- 172.21.15.146:0/1730367268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ff0657b90 msgr2=0x561ff0654500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.440+0000 7fb854440b80 1 --2- 172.21.15.146:0/1730367268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ff0657b90 0x561ff0654500 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fb834082be0 tx=0x7fb834015040 comp rx=0 tx=0).stop 2023-10-06T11:13:53.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.440+0000 7fb854440b80 1 -- 172.21.15.146:0/1730367268 shutdown_connections 2023-10-06T11:13:53.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.440+0000 7fb854440b80 1 --2- 172.21.15.146:0/1730367268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ff0657b90 0x561ff0654500 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.440+0000 7fb854440b80 1 --2- 172.21.15.146:0/1730367268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ff0611cd0 0x561ff063e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.441+0000 7fb854440b80 1 --2- 172.21.15.146:0/1730367268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ff0613aa0 0x561ff060cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.441+0000 7fb854440b80 1 -- 172.21.15.146:0/1730367268 >> 172.21.15.146:0/1730367268 conn(0x561ff0612170 msgr2=0x561ff0612bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:53.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.441+0000 7fb854440b80 1 -- 172.21.15.146:0/1730367268 shutdown_connections 2023-10-06T11:13:53.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.441+0000 7fb854440b80 1 -- 172.21.15.146:0/1730367268 wait complete. 2023-10-06T11:13:53.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.441+0000 7fb854440b80 1 -- start start 2023-10-06T11:13:53.445 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.441+0000 7fb854440b80 1 Processor -- start 2023-10-06T11:13:53.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.442+0000 7fb854440b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ff0611cd0 0x561ff06bce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.442+0000 7fb854440b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ff0613aa0 0x561ff063fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.442+0000 7fb854440b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ff0657b90 0x561ff0640190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.442+0000 7fb854440b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ff06570a0 con 0x561ff0611cd0 2023-10-06T11:13:53.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.442+0000 7fb854440b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ff06706b0 con 0x561ff0657b90 2023-10-06T11:13:53.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.442+0000 7fb854440b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ff0675760 con 0x561ff0613aa0 2023-10-06T11:13:53.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.442+0000 7fb854440b80 10 client.0 _ll_register_callbacks cb 0x561ff03fe030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:13:53.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.442+0000 7fb848ee4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ff0611cd0 0x561ff06bce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.442+0000 7fb848ee4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ff0611cd0 0x561ff06bce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47004/0 (socket says 172.21.15.146:47004) 2023-10-06T11:13:53.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.442+0000 7fb848ee4700 1 -- 172.21.15.146:0/3739243346 learned_addr learned my addr 172.21.15.146:0/3739243346 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:53.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.442+0000 7fb843fff700 1 --2- 172.21.15.146:0/3739243346 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ff0613aa0 0x561ff063fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.442+0000 7fb8496e5700 1 --2- 172.21.15.146:0/3739243346 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ff0657b90 0x561ff0640190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.442+0000 7fb848ee4700 1 -- 172.21.15.146:0/3739243346 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ff0613aa0 msgr2=0x561ff063fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:53.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.442+0000 7fb848ee4700 1 --2- 172.21.15.146:0/3739243346 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ff0613aa0 0x561ff063fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.442+0000 7fb848ee4700 1 -- 172.21.15.146:0/3739243346 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ff0657b90 msgr2=0x561ff0640190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:53.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.442+0000 7fb848ee4700 1 --2- 172.21.15.146:0/3739243346 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ff0657b90 0x561ff0640190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.442+0000 7fb848ee4700 1 -- 172.21.15.146:0/3739243346 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb84415e190 con 0x561ff0611cd0 2023-10-06T11:13:53.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.443+0000 7fb848ee4700 1 --2- 172.21.15.146:0/3739243346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ff0611cd0 0x561ff06bce20 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fb83c012000 tx=0x7fb83c020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f07c726b32899cbe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:53.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.443+0000 7fb822ffd700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:13:53.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.443+0000 7fb822ffd700 1 -- 172.21.15.146:0/3739243346 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c03b070 con 0x561ff0611cd0 2023-10-06T11:13:53.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.443+0000 7fb822ffd700 1 -- 172.21.15.146:0/3739243346 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb83c024070 con 0x561ff0611cd0 2023-10-06T11:13:53.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.443+0000 7fb854440b80 1 -- 172.21.15.146:0/3739243346 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb82c0119e0 con 0x561ff0611cd0 2023-10-06T11:13:53.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.443+0000 7fb822ffd700 1 -- 172.21.15.146:0/3739243346 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb83c030040 con 0x561ff0611cd0 2023-10-06T11:13:53.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.443+0000 7fb854440b80 10 client.7809 fetch_fsmap learned FSMap version 93 2023-10-06T11:13:53.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.443+0000 7fb854440b80 1 -- 172.21.15.146:0/3739243346 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x561ff0516570 con 0x561ff0611cd0 2023-10-06T11:13:53.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.443+0000 7fb822ffd700 1 -- 172.21.15.146:0/3739243346 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb82c0119e0 con 0x561ff0611cd0 2023-10-06T11:13:53.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.443+0000 7fb822ffd700 1 -- 172.21.15.146:0/3739243346 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 93) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb83c036b40 con 0x561ff0611cd0 2023-10-06T11:13:53.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.443+0000 7fb854440b80 10 client.7809 fetch_fsmap finished waiting for FSMap version 93 2023-10-06T11:13:53.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.443+0000 7fb854440b80 10 client.7809 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2023-10-06T11:13:53.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.443+0000 7fb854440b80 20 client.7809 populate_metadata read hostname 'smithi146' 2023-10-06T11:13:53.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.443+0000 7fb854440b80 1 --2- 172.21.15.146:0/3739243346 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x561ff06551d0 0x561ff0650ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.443+0000 7fb854440b80 4 client.7809 mds_command: new command op to 7620 tid=0[{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2023-10-06T11:13:53.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.443+0000 7fb854440b80 1 -- 172.21.15.146:0/3739243346 --> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) v1 -- 0x561ff0503f00 con 0x561ff06551d0 2023-10-06T11:13:53.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.443+0000 7fb843fff700 1 --2- 172.21.15.146:0/3739243346 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x561ff06551d0 0x561ff0650ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.443+0000 7fb843fff700 1 --2- 172.21.15.146:0/3739243346 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x561ff06551d0 0x561ff0650ae0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd74a70e1537d748 server_cookie=f0666901e55a6b0 in_seq=0 out_seq=0 2023-10-06T11:13:53.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.443+0000 7fb822ffd700 10 client.7809 ms_handle_connect on v2:172.21.15.146:6834/785131800 2023-10-06T11:13:53.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.446+0000 7fb822ffd700 1 -- 172.21.15.146:0/3739243346 <== mds.0 v2:172.21.15.146:6834/785131800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x561ff0503f00 con 0x561ff06551d0 2023-10-06T11:13:53.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.446+0000 7fb822ffd700 10 client.7809 handle_command_reply: tid=0 2023-10-06T11:13:53.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.446+0000 7fb854440b80 1 client.7809 shutdown 2023-10-06T11:13:53.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.447+0000 7fb854440b80 1 -- 172.21.15.146:0/3739243346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ff0611cd0 msgr2=0x561ff06bce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.447+0000 7fb854440b80 1 --2- 172.21.15.146:0/3739243346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ff0611cd0 0x561ff06bce20 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fb83c012000 tx=0x7fb83c020040 comp rx=0 tx=0).stop 2023-10-06T11:13:53.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.447+0000 7fb854440b80 1 -- 172.21.15.146:0/3739243346 shutdown_connections 2023-10-06T11:13:53.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.447+0000 7fb854440b80 1 --2- 172.21.15.146:0/3739243346 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x561ff06551d0 0x561ff0650ae0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.447+0000 7fb854440b80 1 --2- 172.21.15.146:0/3739243346 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ff0657b90 0x561ff0640190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.447+0000 7fb854440b80 1 --2- 172.21.15.146:0/3739243346 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ff0611cd0 0x561ff06bce20 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.447+0000 7fb854440b80 1 --2- 172.21.15.146:0/3739243346 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ff0613aa0 0x561ff063fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.447+0000 7fb854440b80 1 -- 172.21.15.146:0/3739243346 >> 172.21.15.146:0/3739243346 conn(0x561ff0612170 msgr2=0x561ff0654500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:53.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.447+0000 7fb822ffd700 0 client.7809 ms_handle_reset on v2:172.21.15.146:6834/785131800 2023-10-06T11:13:53.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.447+0000 7fb854440b80 1 -- 172.21.15.146:0/3739243346 shutdown_connections 2023-10-06T11:13:53.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.447+0000 7fb854440b80 1 -- 172.21.15.146:0/3739243346 wait complete. 2023-10-06T11:13:53.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.447+0000 7fb854440b80 20 client.7809 trim_cache size 0 max 16384 2023-10-06T11:13:53.455 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:13:53.455 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0, 2023-10-06T11:13:53.455 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_tag": "1f07e8ed-6b61-43b7-ad47-a57a4cdf0def", 2023-10-06T11:13:53.455 INFO:teuthology.orchestra.run.smithi146.stdout: "mode": "asynchronous" 2023-10-06T11:13:53.455 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:13:53.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.447+0000 7fb84b148700 1 -- 172.21.15.146:0/732782976 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb824066f30 msgr2=0x7fb8240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.447+0000 7fb84b148700 1 --2- 172.21.15.146:0/732782976 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb824066f30 0x7fb8240693e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fb83c009fd0 tx=0x7fb83c018000 comp rx=0 tx=0).stop 2023-10-06T11:13:53.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.447+0000 7fb84b148700 1 -- 172.21.15.146:0/732782976 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb84415a160 msgr2=0x7fb844157450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.447+0000 7fb84b148700 1 --2- 172.21.15.146:0/732782976 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb84415a160 0x7fb844157450 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fb83400e8d0 tx=0x7fb8340091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.447+0000 7fb84b148700 1 -- 172.21.15.146:0/732782976 shutdown_connections 2023-10-06T11:13:53.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.447+0000 7fb84b148700 1 --2- 172.21.15.146:0/732782976 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb824066f30 0x7fb8240693e0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.447+0000 7fb84b148700 1 --2- 172.21.15.146:0/732782976 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb84415a160 0x7fb844157450 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.448+0000 7fb84b148700 1 --2- 172.21.15.146:0/732782976 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb8440ae730 0x7fb84415dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.448+0000 7fb84b148700 1 --2- 172.21.15.146:0/732782976 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8440ce3d0 0x7fb8440687a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.448+0000 7fb84b148700 1 -- 172.21.15.146:0/732782976 >> 172.21.15.146:0/732782976 conn(0x7fb84406f380 msgr2=0x7fb844159690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:53.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.448+0000 7fb84b148700 1 -- 172.21.15.146:0/732782976 shutdown_connections 2023-10-06T11:13:53.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.448+0000 7fb84b148700 1 -- 172.21.15.146:0/732782976 wait complete. 2023-10-06T11:13:53.463 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 scrub pause 2023-10-06T11:13:53.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.598+0000 7f30a878b700 1 Processor -- start 2023-10-06T11:13:53.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.598+0000 7f30a878b700 1 -- start start 2023-10-06T11:13:53.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.599+0000 7f30a878b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f30a00ae730 0x7f30a00aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.599+0000 7f30a878b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30a00cb950 0x7f30a00cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.599+0000 7f30a878b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30a00ae2a0 con 0x7f30a015a160 2023-10-06T11:13:53.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.599+0000 7f30a878b700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30a015a530 con 0x7f30a00ae730 2023-10-06T11:13:53.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.599+0000 7f30a878b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a00c5cb0 con 0x7f30a00cb950 2023-10-06T11:13:53.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.599+0000 7f30a6527700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f30a015a160 0x7f30a00c55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:37656/0 (socket says 172.21.15.146:37656) 2023-10-06T11:13:53.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.599+0000 7f30a6527700 1 -- 172.21.15.146:0/2285816698 learned_addr learned my addr 172.21.15.146:0/2285816698 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:13:53.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.599+0000 7f30a6d28700 1 --2- 172.21.15.146:0/2285816698 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30a00cb950 0x7f30a00cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.599+0000 7f30a5d26700 1 --2- 172.21.15.146:0/2285816698 >> v2:172.21.15.151:3300/0 conn(0x7f30a00ae730 0x7f30a00aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.599+0000 7f30a5525700 1 -- 172.21.15.146:0/2285816698 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 333233112 0 0) 0x7f30a00ae2a0 con 0x7f30a015a160 2023-10-06T11:13:53.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.599+0000 7f30a5525700 1 -- 172.21.15.146:0/2285816698 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f308c003570 con 0x7f30a015a160 2023-10-06T11:13:53.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.600+0000 7f30a5525700 1 -- 172.21.15.146:0/2285816698 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3444727452 0 0) 0x7f308c003570 con 0x7f30a015a160 2023-10-06T11:13:53.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.600+0000 7f30a5525700 1 -- 172.21.15.146:0/2285816698 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30a00cb950 msgr2=0x7f30a00cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:53.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.600+0000 7f30a5525700 1 --2- 172.21.15.146:0/2285816698 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30a00cb950 0x7f30a00cbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.600+0000 7f30a5525700 1 -- 172.21.15.146:0/2285816698 >> v2:172.21.15.151:3300/0 conn(0x7f30a00ae730 msgr2=0x7f30a00aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:53.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.600+0000 7f30a5525700 1 --2- 172.21.15.146:0/2285816698 >> v2:172.21.15.151:3300/0 conn(0x7f30a00ae730 0x7f30a00aebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.600+0000 7f30a5525700 1 -- 172.21.15.146:0/2285816698 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a00af0f0 con 0x7f30a015a160 2023-10-06T11:13:53.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.600+0000 7f30a5525700 1 -- 172.21.15.146:0/2285816698 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f309c0015f0 con 0x7f30a015a160 2023-10-06T11:13:53.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.600+0000 7f30a5525700 1 -- 172.21.15.146:0/2285816698 >> v1:172.21.15.146:6789/0 conn(0x7f30a015a160 legacy=0x7f30a00c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.600+0000 7f30a5525700 1 --2- 172.21.15.146:0/2285816698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f308c003a60 0x7f308c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.600+0000 7f30a5525700 1 --2- 172.21.15.146:0/2285816698 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f308c004810 0x7f308c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.600+0000 7f30a5525700 1 --2- 172.21.15.146:0/2285816698 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f308c0051c0 0x7f308c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.600+0000 7f30a5525700 1 -- 172.21.15.146:0/2285816698 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a015a530 con 0x7f308c004810 2023-10-06T11:13:53.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.600+0000 7f30a5525700 1 -- 172.21.15.146:0/2285816698 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a00c5cb0 con 0x7f308c003a60 2023-10-06T11:13:53.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.600+0000 7f30a5525700 1 -- 172.21.15.146:0/2285816698 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f308c00bfa0 con 0x7f308c0051c0 2023-10-06T11:13:53.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.600+0000 7f30a6d28700 1 --2- 172.21.15.146:0/2285816698 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30a00cb950 0x7f30a00cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:13:53.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.600+0000 7f30a5d26700 1 --2- 172.21.15.146:0/2285816698 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f308c004810 0x7f308c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.600+0000 7f30a6527700 1 --2- 172.21.15.146:0/2285816698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f308c003a60 0x7f308c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.600+0000 7f30a6d28700 1 --2- 172.21.15.146:0/2285816698 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f308c0051c0 0x7f308c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.600+0000 7f30a5d26700 1 -- 172.21.15.146:0/2285816698 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f308c0051c0 msgr2=0x7f308c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:53.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.600+0000 7f30a5d26700 1 --2- 172.21.15.146:0/2285816698 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f308c0051c0 0x7f308c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.600+0000 7f30a5d26700 1 -- 172.21.15.146:0/2285816698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f308c003a60 msgr2=0x7f308c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:53.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.600+0000 7f30a5d26700 1 --2- 172.21.15.146:0/2285816698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f308c003a60 0x7f308c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.600+0000 7f30a5d26700 1 -- 172.21.15.146:0/2285816698 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f308c003570 con 0x7f308c004810 2023-10-06T11:13:53.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.600+0000 7f30a5d26700 1 --2- 172.21.15.146:0/2285816698 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f308c004810 0x7f308c004c80 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f3090009c00 tx=0x7f30900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3f4e8cab7ed9f67 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:53.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.600+0000 7f30a5525700 1 -- 172.21.15.146:0/2285816698 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309000e710 con 0x7f308c004810 2023-10-06T11:13:53.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.600+0000 7f30a5525700 1 -- 172.21.15.146:0/2285816698 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f309000e870 con 0x7f308c004810 2023-10-06T11:13:53.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.600+0000 7f30a5525700 1 -- 172.21.15.146:0/2285816698 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309000ec30 con 0x7f308c004810 2023-10-06T11:13:53.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.601+0000 7f30a878b700 1 -- 172.21.15.146:0/2285816698 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f308c004810 msgr2=0x7f308c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.601+0000 7f30a878b700 1 --2- 172.21.15.146:0/2285816698 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f308c004810 0x7f308c004c80 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f3090009c00 tx=0x7f30900091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.601+0000 7f30a6d28700 1 -- 172.21.15.146:0/2285816698 reap_dead start 2023-10-06T11:13:53.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.601+0000 7f30a878b700 1 -- 172.21.15.146:0/2285816698 shutdown_connections 2023-10-06T11:13:53.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.601+0000 7f30a878b700 1 -- 172.21.15.146:0/2285816698 >> 172.21.15.146:0/2285816698 conn(0x7f30a006f380 msgr2=0x7f30a00d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:53.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.601+0000 7f30a878b700 1 -- 172.21.15.146:0/2285816698 shutdown_connections 2023-10-06T11:13:53.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.601+0000 7f30a878b700 1 -- 172.21.15.146:0/2285816698 wait complete. 2023-10-06T11:13:53.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.602+0000 7f30a878b700 1 Processor -- start 2023-10-06T11:13:53.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.602+0000 7f30a878b700 1 -- start start 2023-10-06T11:13:53.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.603+0000 7f30a878b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f308c004810 0x7f30a00af300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.603+0000 7f30a878b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30a00af840 0x7f30a016b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.603+0000 7f30a878b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30a016ba30 0x7f30a0156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.603+0000 7f30a878b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a0155c20 con 0x7f30a00af840 2023-10-06T11:13:53.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.603+0000 7f30a878b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a01567a0 con 0x7f308c004810 2023-10-06T11:13:53.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.603+0000 7f30a878b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a0155e70 con 0x7f30a016ba30 2023-10-06T11:13:53.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.603+0000 7f30a5d26700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30a00af840 0x7f30a016b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.603+0000 7f30a5d26700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30a00af840 0x7f30a016b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47020/0 (socket says 172.21.15.146:47020) 2023-10-06T11:13:53.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.603+0000 7f30a5d26700 1 -- 172.21.15.146:0/1491848410 learned_addr learned my addr 172.21.15.146:0/1491848410 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:53.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.603+0000 7f30a6d28700 1 --2- 172.21.15.146:0/1491848410 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30a016ba30 0x7f30a0156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.603+0000 7f30a6527700 1 --2- 172.21.15.146:0/1491848410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f308c004810 0x7f30a00af300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.603+0000 7f30a5d26700 1 -- 172.21.15.146:0/1491848410 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30a016ba30 msgr2=0x7f30a0156c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.603+0000 7f30a5d26700 1 --2- 172.21.15.146:0/1491848410 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30a016ba30 0x7f30a0156c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.603+0000 7f30a5d26700 1 -- 172.21.15.146:0/1491848410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f308c004810 msgr2=0x7f30a00af300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.603+0000 7f30a5d26700 1 --2- 172.21.15.146:0/1491848410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f308c004810 0x7f30a00af300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.603+0000 7f30a5d26700 1 -- 172.21.15.146:0/1491848410 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a0156150 con 0x7f30a00af840 2023-10-06T11:13:53.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.603+0000 7f30a5d26700 1 --2- 172.21.15.146:0/1491848410 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30a00af840 0x7f30a016b4f0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f308c0046c0 tx=0x7f309001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:53.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.603+0000 7f30967fc700 1 -- 172.21.15.146:0/1491848410 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3090022070 con 0x7f30a00af840 2023-10-06T11:13:53.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.604+0000 7f30967fc700 1 -- 172.21.15.146:0/1491848410 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f309000e9e0 con 0x7f30a00af840 2023-10-06T11:13:53.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.604+0000 7f30a878b700 1 -- 172.21.15.146:0/1491848410 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30a0156430 con 0x7f30a00af840 2023-10-06T11:13:53.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.604+0000 7f30967fc700 1 -- 172.21.15.146:0/1491848410 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309000e710 con 0x7f30a00af840 2023-10-06T11:13:53.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.604+0000 7f30a878b700 1 -- 172.21.15.146:0/1491848410 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30a00b21a0 con 0x7f30a00af840 2023-10-06T11:13:53.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.605+0000 7f30967fc700 1 -- 172.21.15.146:0/1491848410 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f309001c660 con 0x7f30a00af840 2023-10-06T11:13:53.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.605+0000 7f30967fc700 1 --2- 172.21.15.146:0/1491848410 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3084066f30 0x7f30840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.605+0000 7f30967fc700 1 -- 172.21.15.146:0/1491848410 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3090085f50 con 0x7f30a00af840 2023-10-06T11:13:53.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.605+0000 7f30a6527700 1 --2- 172.21.15.146:0/1491848410 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3084066f30 0x7f30840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.606+0000 7f30a6527700 1 --2- 172.21.15.146:0/1491848410 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3084066f30 0x7f30840693e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f309c0011d0 tx=0x7f309c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:53.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.607+0000 7f30b1a83b80 1 Processor -- start 2023-10-06T11:13:53.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.608+0000 7f30b1a83b80 1 -- start start 2023-10-06T11:13:53.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.608+0000 7f30b1a83b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562636637ad0 0x562636637ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.608+0000 7f30b1a83b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5626365f39e0 0x5626365f05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.608+0000 7f30b1a83b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5626365f1c10 0x5626365f0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.608+0000 7f30b1a83b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x562636570cc0 con 0x5626365f1c10 2023-10-06T11:13:53.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.608+0000 7f30b1a83b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562636547ab0 con 0x5626365f39e0 2023-10-06T11:13:53.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.608+0000 7f30b1a83b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5626365452b0 con 0x562636637ad0 2023-10-06T11:13:53.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.608+0000 7f30a6d28700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5626365f1c10 0x5626365f0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.608+0000 7f30a6d28700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5626365f1c10 0x5626365f0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47036/0 (socket says 172.21.15.146:47036) 2023-10-06T11:13:53.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.608+0000 7f30a6d28700 1 -- 172.21.15.146:0/2395820260 learned_addr learned my addr 172.21.15.146:0/2395820260 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:53.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.609+0000 7f30a6527700 1 --2- 172.21.15.146:0/2395820260 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562636637ad0 0x562636637ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.609+0000 7f30a5d26700 1 --2- 172.21.15.146:0/2395820260 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5626365f39e0 0x5626365f05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.609+0000 7f30a6d28700 1 -- 172.21.15.146:0/2395820260 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562636637ad0 msgr2=0x562636637ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:53.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.609+0000 7f30a6d28700 1 --2- 172.21.15.146:0/2395820260 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562636637ad0 0x562636637ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.609+0000 7f30a6d28700 1 -- 172.21.15.146:0/2395820260 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5626365f39e0 msgr2=0x5626365f05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:53.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.609+0000 7f30a6d28700 1 --2- 172.21.15.146:0/2395820260 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5626365f39e0 0x5626365f05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.609+0000 7f30a6d28700 1 -- 172.21.15.146:0/2395820260 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5626363db2b0 con 0x5626365f1c10 2023-10-06T11:13:53.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.609+0000 7f30a6d28700 1 --2- 172.21.15.146:0/2395820260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5626365f1c10 0x5626365f0b00 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f30a00cbd20 tx=0x7f309800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4763464f6fae514e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:53.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.609+0000 7f30837fe700 1 -- 172.21.15.146:0/2395820260 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309800e040 con 0x5626365f1c10 2023-10-06T11:13:53.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.609+0000 7f30837fe700 1 -- 172.21.15.146:0/2395820260 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f309800f040 con 0x5626365f1c10 2023-10-06T11:13:53.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.609+0000 7f30837fe700 1 -- 172.21.15.146:0/2395820260 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309801e630 con 0x5626365f1c10 2023-10-06T11:13:53.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.610+0000 7f30b1a83b80 1 -- 172.21.15.146:0/2395820260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5626365f1c10 msgr2=0x5626365f0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.610+0000 7f30b1a83b80 1 --2- 172.21.15.146:0/2395820260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5626365f1c10 0x5626365f0b00 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f30a00cbd20 tx=0x7f309800b040 comp rx=0 tx=0).stop 2023-10-06T11:13:53.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.610+0000 7f30b1a83b80 1 -- 172.21.15.146:0/2395820260 shutdown_connections 2023-10-06T11:13:53.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.610+0000 7f30b1a83b80 1 --2- 172.21.15.146:0/2395820260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5626365f1c10 0x5626365f0b00 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.610+0000 7f30b1a83b80 1 --2- 172.21.15.146:0/2395820260 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562636637ad0 0x562636637ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.610+0000 7f30b1a83b80 1 --2- 172.21.15.146:0/2395820260 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5626365f39e0 0x5626365f05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.610+0000 7f30b1a83b80 1 -- 172.21.15.146:0/2395820260 >> 172.21.15.146:0/2395820260 conn(0x5626365f20b0 msgr2=0x5626365f2480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:53.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.610+0000 7f30b1a83b80 1 -- 172.21.15.146:0/2395820260 shutdown_connections 2023-10-06T11:13:53.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.610+0000 7f30b1a83b80 1 -- 172.21.15.146:0/2395820260 wait complete. 2023-10-06T11:13:53.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.610+0000 7f30b1a83b80 1 -- start start 2023-10-06T11:13:53.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.610+0000 7f30b1a83b80 1 Processor -- start 2023-10-06T11:13:53.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.611+0000 7f30b1a83b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5626365f1c10 0x562636632920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.611+0000 7f30b1a83b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5626365f39e0 0x5626365f05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.611+0000 7f30b1a83b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562636637ad0 0x5626365f0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.611+0000 7f30b1a83b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626365410a0 con 0x562636637ad0 2023-10-06T11:13:53.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.611+0000 7f30b1a83b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626364ec8d0 con 0x5626365f39e0 2023-10-06T11:13:53.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.611+0000 7f30b1a83b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x562636507ee0 con 0x5626365f1c10 2023-10-06T11:13:53.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.611+0000 7f30b1a83b80 10 client.0 _ll_register_callbacks cb 0x5626363ddf70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:13:53.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.611+0000 7f30a6d28700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562636637ad0 0x5626365f0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.611+0000 7f30a6d28700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562636637ad0 0x5626365f0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47050/0 (socket says 172.21.15.146:47050) 2023-10-06T11:13:53.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.611+0000 7f30a6d28700 1 -- 172.21.15.146:0/3241533195 learned_addr learned my addr 172.21.15.146:0/3241533195 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:53.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.611+0000 7f30a5d26700 1 --2- 172.21.15.146:0/3241533195 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5626365f39e0 0x5626365f05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.611+0000 7f30a6527700 1 --2- 172.21.15.146:0/3241533195 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5626365f1c10 0x562636632920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.612+0000 7f30a6d28700 1 -- 172.21.15.146:0/3241533195 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5626365f1c10 msgr2=0x562636632920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:53.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.612+0000 7f30a6d28700 1 --2- 172.21.15.146:0/3241533195 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5626365f1c10 0x562636632920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.612+0000 7f30a6d28700 1 -- 172.21.15.146:0/3241533195 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5626365f39e0 msgr2=0x5626365f05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:53.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.612+0000 7f30a6d28700 1 --2- 172.21.15.146:0/3241533195 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5626365f39e0 0x5626365f05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.612+0000 7f30a6d28700 1 -- 172.21.15.146:0/3241533195 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3098009a20 con 0x562636637ad0 2023-10-06T11:13:53.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.612+0000 7f30a6d28700 1 --2- 172.21.15.146:0/3241533195 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562636637ad0 0x5626365f0b00 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f3098009fd0 tx=0x7f3098020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a5692c84a2418a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:53.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.612+0000 7f3080ff9700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:13:53.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.612+0000 7f3080ff9700 1 -- 172.21.15.146:0/3241533195 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309800e070 con 0x562636637ad0 2023-10-06T11:13:53.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.612+0000 7f3080ff9700 1 -- 172.21.15.146:0/3241533195 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f309801a070 con 0x562636637ad0 2023-10-06T11:13:53.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.612+0000 7f30b1a83b80 1 -- 172.21.15.146:0/3241533195 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5626365e56d0 con 0x562636637ad0 2023-10-06T11:13:53.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.612+0000 7f3080ff9700 1 -- 172.21.15.146:0/3241533195 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3098027480 con 0x562636637ad0 2023-10-06T11:13:53.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.612+0000 7f30b1a83b80 10 client.7821 fetch_fsmap learned FSMap version 93 2023-10-06T11:13:53.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.612+0000 7f30b1a83b80 1 -- 172.21.15.146:0/3241533195 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x56263637e020 con 0x562636637ad0 2023-10-06T11:13:53.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.612+0000 7f3080ff9700 1 -- 172.21.15.146:0/3241533195 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5626365e56d0 con 0x562636637ad0 2023-10-06T11:13:53.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.612+0000 7f3080ff9700 1 -- 172.21.15.146:0/3241533195 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 93) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3098016400 con 0x562636637ad0 2023-10-06T11:13:53.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.612+0000 7f30b1a83b80 10 client.7821 fetch_fsmap finished waiting for FSMap version 93 2023-10-06T11:13:53.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.612+0000 7f30b1a83b80 10 client.7821 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2023-10-06T11:13:53.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.612+0000 7f30b1a83b80 20 client.7821 populate_metadata read hostname 'smithi146' 2023-10-06T11:13:53.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.612+0000 7f30b1a83b80 1 --2- 172.21.15.146:0/3241533195 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x562636633690 0x562636633bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.612+0000 7f30b1a83b80 4 client.7821 mds_command: new command op to 7620 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:13:53.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.612+0000 7f30b1a83b80 1 -- 172.21.15.146:0/3241533195 --> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5626365c2600 con 0x562636633690 2023-10-06T11:13:53.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.612+0000 7f30a6527700 1 --2- 172.21.15.146:0/3241533195 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x562636633690 0x562636633bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.613+0000 7f3080ff9700 10 client.7821 ms_handle_connect on v2:172.21.15.146:6834/785131800 2023-10-06T11:13:53.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.613+0000 7f30a6527700 1 --2- 172.21.15.146:0/3241533195 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x562636633690 0x562636633bf0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f70ba1a95d1a470a server_cookie=95fbe2d4bfe4f5f6 in_seq=0 out_seq=0 2023-10-06T11:13:53.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.613+0000 7f3080ff9700 1 -- 172.21.15.146:0/3241533195 <== mds.0 v2:172.21.15.146:6834/785131800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5626365c2600 con 0x562636633690 2023-10-06T11:13:53.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.613+0000 7f3080ff9700 10 client.7821 handle_command_reply: tid=0 2023-10-06T11:13:53.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.613+0000 7f30b1a83b80 1 client.7821 shutdown 2023-10-06T11:13:53.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.613+0000 7f30b1a83b80 1 -- 172.21.15.146:0/3241533195 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562636637ad0 msgr2=0x5626365f0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.613+0000 7f30b1a83b80 1 --2- 172.21.15.146:0/3241533195 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562636637ad0 0x5626365f0b00 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f3098009fd0 tx=0x7f3098020000 comp rx=0 tx=0).stop 2023-10-06T11:13:53.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.613+0000 7f30b1a83b80 1 -- 172.21.15.146:0/3241533195 shutdown_connections 2023-10-06T11:13:53.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.613+0000 7f30b1a83b80 1 --2- 172.21.15.146:0/3241533195 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x562636633690 0x562636633bf0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.613+0000 7f30b1a83b80 1 --2- 172.21.15.146:0/3241533195 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562636637ad0 0x5626365f0b00 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.613+0000 7f3080ff9700 0 client.7821 ms_handle_reset on v2:172.21.15.146:6834/785131800 2023-10-06T11:13:53.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.613+0000 7f30b1a83b80 1 --2- 172.21.15.146:0/3241533195 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5626365f1c10 0x562636632920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.613+0000 7f30b1a83b80 1 --2- 172.21.15.146:0/3241533195 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5626365f39e0 0x5626365f05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.613+0000 7f30b1a83b80 1 -- 172.21.15.146:0/3241533195 >> 172.21.15.146:0/3241533195 conn(0x5626365f20b0 msgr2=0x5626365ed670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:53.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.613+0000 7f30b1a83b80 1 -- 172.21.15.146:0/3241533195 shutdown_connections 2023-10-06T11:13:53.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.613+0000 7f30b1a83b80 1 -- 172.21.15.146:0/3241533195 wait complete. 2023-10-06T11:13:53.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.614+0000 7f30b1a83b80 20 client.7821 trim_cache size 0 max 16384 2023-10-06T11:13:53.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.629+0000 7f30b1a83b80 1 Processor -- start 2023-10-06T11:13:53.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.629+0000 7f30b1a83b80 1 -- start start 2023-10-06T11:13:53.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.630+0000 7f30b1a83b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5626365f1c10 0x5626365f2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.630+0000 7f30b1a83b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5626365f39e0 0x5626365ed700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.630+0000 7f30b1a83b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562636637ad0 0x5626365f0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.630+0000 7f30b1a83b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626363c3e70 con 0x5626365f1c10 2023-10-06T11:13:53.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.630+0000 7f30b1a83b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626365ec330 con 0x562636637ad0 2023-10-06T11:13:53.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.630+0000 7f30b1a83b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5626365eb390 con 0x5626365f39e0 2023-10-06T11:13:53.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.630+0000 7f30a6527700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5626365f1c10 0x5626365f2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.630+0000 7f30a6527700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5626365f1c10 0x5626365f2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47058/0 (socket says 172.21.15.146:47058) 2023-10-06T11:13:53.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.630+0000 7f30a6527700 1 -- 172.21.15.146:0/3712859834 learned_addr learned my addr 172.21.15.146:0/3712859834 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:53.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.630+0000 7f30a5d26700 1 --2- 172.21.15.146:0/3712859834 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5626365f39e0 0x5626365ed700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.630+0000 7f30a6d28700 1 --2- 172.21.15.146:0/3712859834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562636637ad0 0x5626365f0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.630+0000 7f30a6527700 1 -- 172.21.15.146:0/3712859834 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5626365f39e0 msgr2=0x5626365ed700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:53.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.630+0000 7f30a6527700 1 --2- 172.21.15.146:0/3712859834 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5626365f39e0 0x5626365ed700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.630+0000 7f30a6527700 1 -- 172.21.15.146:0/3712859834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562636637ad0 msgr2=0x5626365f0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:53.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.630+0000 7f30a6527700 1 --2- 172.21.15.146:0/3712859834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562636637ad0 0x5626365f0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.630+0000 7f30a6527700 1 -- 172.21.15.146:0/3712859834 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56263650f7c0 con 0x5626365f1c10 2023-10-06T11:13:53.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.630+0000 7f30a5d26700 1 --2- 172.21.15.146:0/3712859834 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5626365f39e0 0x5626365ed700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:53.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.630+0000 7f30a6527700 1 --2- 172.21.15.146:0/3712859834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5626365f1c10 0x5626365f2bf0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f309c000ef0 tx=0x7f309c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afd77a2b17d012fd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:53.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.630+0000 7f3083fff700 1 -- 172.21.15.146:0/3712859834 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309c015c30 con 0x5626365f1c10 2023-10-06T11:13:53.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.630+0000 7f3083fff700 1 -- 172.21.15.146:0/3712859834 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f309c015d90 con 0x5626365f1c10 2023-10-06T11:13:53.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.630+0000 7f3083fff700 1 -- 172.21.15.146:0/3712859834 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309c006a10 con 0x5626365f1c10 2023-10-06T11:13:53.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.631+0000 7f30b1a83b80 1 -- 172.21.15.146:0/3712859834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5626365f1c10 msgr2=0x5626365f2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.631+0000 7f30b1a83b80 1 --2- 172.21.15.146:0/3712859834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5626365f1c10 0x5626365f2bf0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f309c000ef0 tx=0x7f309c018000 comp rx=0 tx=0).stop 2023-10-06T11:13:53.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.631+0000 7f30b1a83b80 1 -- 172.21.15.146:0/3712859834 shutdown_connections 2023-10-06T11:13:53.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.631+0000 7f30b1a83b80 1 --2- 172.21.15.146:0/3712859834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562636637ad0 0x5626365f0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.631+0000 7f30b1a83b80 1 --2- 172.21.15.146:0/3712859834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5626365f1c10 0x5626365f2bf0 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.631+0000 7f30b1a83b80 1 --2- 172.21.15.146:0/3712859834 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5626365f39e0 0x5626365ed700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.631+0000 7f30b1a83b80 1 -- 172.21.15.146:0/3712859834 >> 172.21.15.146:0/3712859834 conn(0x5626365f20b0 msgr2=0x5626366464f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:53.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.631+0000 7f30b1a83b80 1 -- 172.21.15.146:0/3712859834 shutdown_connections 2023-10-06T11:13:53.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.631+0000 7f30b1a83b80 1 -- 172.21.15.146:0/3712859834 wait complete. 2023-10-06T11:13:53.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.632+0000 7f30b1a83b80 1 -- start start 2023-10-06T11:13:53.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.632+0000 7f30b1a83b80 1 Processor -- start 2023-10-06T11:13:53.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.632+0000 7f30b1a83b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5626365f1c10 0x56263669e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.632+0000 7f30b1a83b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5626365f39e0 0x5626365ecf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.633+0000 7f30b1a83b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562636637ad0 0x5626365f0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.633+0000 7f30b1a83b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x562636633b50 con 0x562636637ad0 2023-10-06T11:13:53.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.633+0000 7f30b1a83b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626365ed470 con 0x5626365f1c10 2023-10-06T11:13:53.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.633+0000 7f30b1a83b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x562636634970 con 0x5626365f39e0 2023-10-06T11:13:53.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.633+0000 7f30b1a83b80 10 client.0 _ll_register_callbacks cb 0x5626363ddf70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:13:53.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.633+0000 7f30a6d28700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562636637ad0 0x5626365f0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.633+0000 7f30a6d28700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562636637ad0 0x5626365f0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47060/0 (socket says 172.21.15.146:47060) 2023-10-06T11:13:53.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.633+0000 7f30a6d28700 1 -- 172.21.15.146:0/1995902532 learned_addr learned my addr 172.21.15.146:0/1995902532 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:53.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.633+0000 7f30a6527700 1 --2- 172.21.15.146:0/1995902532 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5626365f1c10 0x56263669e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.633+0000 7f30a5d26700 1 --2- 172.21.15.146:0/1995902532 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5626365f39e0 0x5626365ecf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.633+0000 7f30a6d28700 1 -- 172.21.15.146:0/1995902532 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5626365f39e0 msgr2=0x5626365ecf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:53.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.633+0000 7f30a6d28700 1 --2- 172.21.15.146:0/1995902532 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5626365f39e0 0x5626365ecf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.633+0000 7f30a6d28700 1 -- 172.21.15.146:0/1995902532 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5626365f1c10 msgr2=0x56263669e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:53.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.633+0000 7f30a6d28700 1 --2- 172.21.15.146:0/1995902532 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5626365f1c10 0x56263669e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.633+0000 7f30a6d28700 1 -- 172.21.15.146:0/1995902532 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30a00af0f0 con 0x562636637ad0 2023-10-06T11:13:53.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.633+0000 7f30a5d26700 1 --2- 172.21.15.146:0/1995902532 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5626365f39e0 0x5626365ecf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:53.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.633+0000 7f30a6d28700 1 --2- 172.21.15.146:0/1995902532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562636637ad0 0x5626365f0790 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f3098007140 tx=0x7f3098025000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa37edb752d217b0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:53.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.633+0000 7f3080ff9700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:13:53.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.633+0000 7f3080ff9700 1 -- 172.21.15.146:0/1995902532 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309800e040 con 0x562636637ad0 2023-10-06T11:13:53.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.633+0000 7f3080ff9700 1 -- 172.21.15.146:0/1995902532 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3098016870 con 0x562636637ad0 2023-10-06T11:13:53.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.633+0000 7f30b1a83b80 1 -- 172.21.15.146:0/1995902532 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f309800f040 con 0x562636637ad0 2023-10-06T11:13:53.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.633+0000 7f3080ff9700 1 -- 172.21.15.146:0/1995902532 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3098016ab0 con 0x562636637ad0 2023-10-06T11:13:53.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.633+0000 7f30b1a83b80 10 client.7827 fetch_fsmap learned FSMap version 93 2023-10-06T11:13:53.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.633+0000 7f30b1a83b80 1 -- 172.21.15.146:0/1995902532 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x5626364f64b0 con 0x562636637ad0 2023-10-06T11:13:53.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.634+0000 7f3080ff9700 1 -- 172.21.15.146:0/1995902532 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f309800f040 con 0x562636637ad0 2023-10-06T11:13:53.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.634+0000 7f3080ff9700 1 -- 172.21.15.146:0/1995902532 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 93) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3098027480 con 0x562636637ad0 2023-10-06T11:13:53.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.634+0000 7f30b1a83b80 10 client.7827 fetch_fsmap finished waiting for FSMap version 93 2023-10-06T11:13:53.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.634+0000 7f30b1a83b80 10 client.7827 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2023-10-06T11:13:53.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.634+0000 7f30b1a83b80 20 client.7827 populate_metadata read hostname 'smithi146' 2023-10-06T11:13:53.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.634+0000 7f30b1a83b80 1 --2- 172.21.15.146:0/1995902532 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x562636697010 0x5626365f0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.634+0000 7f30b1a83b80 4 client.7827 mds_command: new command op to 7620 tid=0[{"prefix": "scrub pause"}] 2023-10-06T11:13:53.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.634+0000 7f30b1a83b80 1 -- 172.21.15.146:0/1995902532 --> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] -- command(tid 0: {"prefix": "scrub pause"}) v1 -- 0x5626364e3e40 con 0x562636697010 2023-10-06T11:13:53.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.634+0000 7f30a6527700 1 --2- 172.21.15.146:0/1995902532 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x562636697010 0x5626365f0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.634+0000 7f3080ff9700 10 client.7827 ms_handle_connect on v2:172.21.15.146:6834/785131800 2023-10-06T11:13:53.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.634+0000 7f30a6527700 1 --2- 172.21.15.146:0/1995902532 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x562636697010 0x5626365f0cd0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45fe0817b993abaf server_cookie=2904624d9992c046 in_seq=0 out_seq=0 2023-10-06T11:13:53.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.634+0000 7f3080ff9700 1 -- 172.21.15.146:0/1995902532 <== mds.0 v2:172.21.15.146:6834/785131800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x5626364e3e40 con 0x562636697010 2023-10-06T11:13:53.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.634+0000 7f3080ff9700 10 client.7827 handle_command_reply: tid=0 2023-10-06T11:13:53.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.634+0000 7f30b1a83b80 1 client.7827 shutdown 2023-10-06T11:13:53.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.634+0000 7f30b1a83b80 1 -- 172.21.15.146:0/1995902532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562636637ad0 msgr2=0x5626365f0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.634+0000 7f30b1a83b80 1 --2- 172.21.15.146:0/1995902532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562636637ad0 0x5626365f0790 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f3098007140 tx=0x7f3098025000 comp rx=0 tx=0).stop 2023-10-06T11:13:53.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.635+0000 7f30b1a83b80 1 -- 172.21.15.146:0/1995902532 shutdown_connections 2023-10-06T11:13:53.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.635+0000 7f30b1a83b80 1 --2- 172.21.15.146:0/1995902532 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x562636697010 0x5626365f0cd0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.635+0000 7f30b1a83b80 1 --2- 172.21.15.146:0/1995902532 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562636637ad0 0x5626365f0790 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.635+0000 7f30b1a83b80 1 --2- 172.21.15.146:0/1995902532 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5626365f1c10 0x56263669e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.635+0000 7f3080ff9700 0 client.7827 ms_handle_reset on v2:172.21.15.146:6834/785131800 2023-10-06T11:13:53.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.635+0000 7f30b1a83b80 1 --2- 172.21.15.146:0/1995902532 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5626365f39e0 0x5626365ecf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.635+0000 7f30b1a83b80 1 -- 172.21.15.146:0/1995902532 >> 172.21.15.146:0/1995902532 conn(0x5626365f20b0 msgr2=0x56263661bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:53.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.635+0000 7f30b1a83b80 1 -- 172.21.15.146:0/1995902532 shutdown_connections 2023-10-06T11:13:53.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.635+0000 7f30b1a83b80 1 -- 172.21.15.146:0/1995902532 wait complete. 2023-10-06T11:13:53.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.635+0000 7f30b1a83b80 20 client.7827 trim_cache size 0 max 16384 2023-10-06T11:13:53.645 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:13:53.645 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0 2023-10-06T11:13:53.645 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:13:53.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.635+0000 7f30a878b700 1 -- 172.21.15.146:0/1491848410 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3084066f30 msgr2=0x7f30840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.635+0000 7f30a878b700 1 --2- 172.21.15.146:0/1491848410 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3084066f30 0x7f30840693e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f309c0011d0 tx=0x7f309c009040 comp rx=0 tx=0).stop 2023-10-06T11:13:53.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.635+0000 7f30a878b700 1 -- 172.21.15.146:0/1491848410 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30a00af840 msgr2=0x7f30a016b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.635+0000 7f30a878b700 1 --2- 172.21.15.146:0/1491848410 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30a00af840 0x7f30a016b4f0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f308c0046c0 tx=0x7f309001a000 comp rx=0 tx=0).stop 2023-10-06T11:13:53.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.635+0000 7f30a878b700 1 -- 172.21.15.146:0/1491848410 shutdown_connections 2023-10-06T11:13:53.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.635+0000 7f30a878b700 1 --2- 172.21.15.146:0/1491848410 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3084066f30 0x7f30840693e0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.635+0000 7f30a878b700 1 --2- 172.21.15.146:0/1491848410 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30a016ba30 0x7f30a0156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.635+0000 7f30a878b700 1 --2- 172.21.15.146:0/1491848410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f308c004810 0x7f30a00af300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.635+0000 7f30a878b700 1 --2- 172.21.15.146:0/1491848410 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30a00af840 0x7f30a016b4f0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.635+0000 7f30a878b700 1 -- 172.21.15.146:0/1491848410 >> 172.21.15.146:0/1491848410 conn(0x7f30a006f380 msgr2=0x7f30a0069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:53.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.635+0000 7f30a878b700 1 -- 172.21.15.146:0/1491848410 shutdown_connections 2023-10-06T11:13:53.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.635+0000 7f30a878b700 1 -- 172.21.15.146:0/1491848410 wait complete. 2023-10-06T11:13:53.649 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 scrub status 2023-10-06T11:13:53.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.763+0000 7f823181b700 1 Processor -- start 2023-10-06T11:13:53.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.763+0000 7f823181b700 1 -- start start 2023-10-06T11:13:53.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.764+0000 7f823181b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f822c0b5640 0x7f822c15a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.764+0000 7f823181b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f822c068780 0x7f822c068b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.764+0000 7f823181b700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f822c0cc130 con 0x7f822c0cb090 2023-10-06T11:13:53.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.764+0000 7f823181b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f822c0cccd0 con 0x7f822c068780 2023-10-06T11:13:53.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.764+0000 7f823181b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f822c0b2660 con 0x7f822c0b5640 2023-10-06T11:13:53.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.764+0000 7f823101a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f822c068780 0x7f822c068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.764+0000 7f823101a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f822c068780 0x7f822c068b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47076/0 (socket says 172.21.15.146:47076) 2023-10-06T11:13:53.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.764+0000 7f823101a700 1 -- 172.21.15.146:0/4139582833 learned_addr learned my addr 172.21.15.146:0/4139582833 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:53.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.764+0000 7f8230819700 1 --2- 172.21.15.146:0/4139582833 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f822c0b5640 0x7f822c15a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.764+0000 7f823101a700 1 -- 172.21.15.146:0/4139582833 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f822c0b5640 msgr2=0x7f822c15a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:53.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.764+0000 7f823101a700 1 --2- 172.21.15.146:0/4139582833 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f822c0b5640 0x7f822c15a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.764+0000 7f823101a700 1 -- 172.21.15.146:0/4139582833 >> v1:172.21.15.151:6789/0 conn(0x7f822c0cb090 legacy=0x7f822c0cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.764+0000 7f823101a700 1 -- 172.21.15.146:0/4139582833 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f822c15adb0 con 0x7f822c068780 2023-10-06T11:13:53.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.764+0000 7f823101a700 1 --2- 172.21.15.146:0/4139582833 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f822c068780 0x7f822c068b90 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f8224009f20 tx=0x7f8224009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acc5c517a508bdb4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:53.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.765+0000 7f822b7fe700 1 -- 172.21.15.146:0/4139582833 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822400e070 con 0x7f822c068780 2023-10-06T11:13:53.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.765+0000 7f822b7fe700 1 -- 172.21.15.146:0/4139582833 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f822400b9d0 con 0x7f822c068780 2023-10-06T11:13:53.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.765+0000 7f822b7fe700 1 -- 172.21.15.146:0/4139582833 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82240092e0 con 0x7f822c068780 2023-10-06T11:13:53.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.765+0000 7f823181b700 1 -- 172.21.15.146:0/4139582833 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f822c068780 msgr2=0x7f822c068b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.765+0000 7f823181b700 1 --2- 172.21.15.146:0/4139582833 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f822c068780 0x7f822c068b90 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f8224009f20 tx=0x7f8224009840 comp rx=0 tx=0).stop 2023-10-06T11:13:53.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.765+0000 7f823181b700 1 -- 172.21.15.146:0/4139582833 shutdown_connections 2023-10-06T11:13:53.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.765+0000 7f823181b700 1 --2- 172.21.15.146:0/4139582833 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f822c068780 0x7f822c068b90 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.765+0000 7f823181b700 1 --2- 172.21.15.146:0/4139582833 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f822c0b5640 0x7f822c15a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.765+0000 7f823181b700 1 -- 172.21.15.146:0/4139582833 >> 172.21.15.146:0/4139582833 conn(0x7f822c0703f0 msgr2=0x7f822c0707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:53.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.765+0000 7f823181b700 1 -- 172.21.15.146:0/4139582833 shutdown_connections 2023-10-06T11:13:53.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.765+0000 7f823181b700 1 -- 172.21.15.146:0/4139582833 wait complete. 2023-10-06T11:13:53.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.766+0000 7f823181b700 1 Processor -- start 2023-10-06T11:13:53.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.766+0000 7f823181b700 1 -- start start 2023-10-06T11:13:53.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.767+0000 7f823181b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f822c068780 0x7f822c0c8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.767+0000 7f823181b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f822c0b5640 0x7f822c0c9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.767+0000 7f823181b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f822c0cb090 0x7f822c16a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.767+0000 7f823181b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822c16b1d0 con 0x7f822c0cb090 2023-10-06T11:13:53.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.767+0000 7f823181b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822c16b790 con 0x7f822c0b5640 2023-10-06T11:13:53.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.767+0000 7f823181b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f822c0c9910 con 0x7f822c068780 2023-10-06T11:13:53.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.767+0000 7f823101a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f822c0cb090 0x7f822c16a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.767+0000 7f823101a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f822c0cb090 0x7f822c16a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47080/0 (socket says 172.21.15.146:47080) 2023-10-06T11:13:53.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.767+0000 7f823101a700 1 -- 172.21.15.146:0/2608611873 learned_addr learned my addr 172.21.15.146:0/2608611873 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:53.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.767+0000 7f8230819700 1 --2- 172.21.15.146:0/2608611873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f822c068780 0x7f822c0c8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.767+0000 7f822bfff700 1 --2- 172.21.15.146:0/2608611873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f822c0b5640 0x7f822c0c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.768+0000 7f823101a700 1 -- 172.21.15.146:0/2608611873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f822c068780 msgr2=0x7f822c0c8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.768+0000 7f823101a700 1 --2- 172.21.15.146:0/2608611873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f822c068780 0x7f822c0c8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.768+0000 7f823101a700 1 -- 172.21.15.146:0/2608611873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f822c0b5640 msgr2=0x7f822c0c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.768+0000 7f823101a700 1 --2- 172.21.15.146:0/2608611873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f822c0b5640 0x7f822c0c9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.768+0000 7f823101a700 1 -- 172.21.15.146:0/2608611873 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8224009ae0 con 0x7f822c0cb090 2023-10-06T11:13:53.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.768+0000 7f823101a700 1 --2- 172.21.15.146:0/2608611873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f822c0cb090 0x7f822c16a000 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f822c0694f0 tx=0x7f8224018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:53.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.768+0000 7f8228ff9700 1 -- 172.21.15.146:0/2608611873 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82240094e0 con 0x7f822c0cb090 2023-10-06T11:13:53.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.768+0000 7f8228ff9700 1 -- 172.21.15.146:0/2608611873 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8224008b10 con 0x7f822c0cb090 2023-10-06T11:13:53.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.768+0000 7f823181b700 1 -- 172.21.15.146:0/2608611873 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f822c0c9bf0 con 0x7f822c0cb090 2023-10-06T11:13:53.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.768+0000 7f8228ff9700 1 -- 172.21.15.146:0/2608611873 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8224026460 con 0x7f822c0cb090 2023-10-06T11:13:53.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.768+0000 7f823181b700 1 -- 172.21.15.146:0/2608611873 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f822c154710 con 0x7f822c0cb090 2023-10-06T11:13:53.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.769+0000 7f8228ff9700 1 -- 172.21.15.146:0/2608611873 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8224003040 con 0x7f822c0cb090 2023-10-06T11:13:53.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.770+0000 7f8228ff9700 1 --2- 172.21.15.146:0/2608611873 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8210066f30 0x7f82100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.770+0000 7f8228ff9700 1 -- 172.21.15.146:0/2608611873 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f82240864f0 con 0x7f822c0cb090 2023-10-06T11:13:53.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.770+0000 7f8230819700 1 --2- 172.21.15.146:0/2608611873 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8210066f30 0x7f82100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.770+0000 7f8230819700 1 --2- 172.21.15.146:0/2608611873 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8210066f30 0x7f82100693e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f822c153330 tx=0x7f82200091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:53.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.771+0000 7f823bd75b80 1 Processor -- start 2023-10-06T11:13:53.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.771+0000 7f823bd75b80 1 -- start start 2023-10-06T11:13:53.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.772+0000 7f823bd75b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562ccbc229a0 0x562ccbc22d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.772+0000 7f823bd75b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ccbc6cc10 0x562ccbc4b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.772+0000 7f823bd75b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ccbc4beb0 0x562ccbc1e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.772+0000 7f823bd75b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ccbba2cd0 con 0x562ccbc4beb0 2023-10-06T11:13:53.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.772+0000 7f823bd75b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ccbb79ac0 con 0x562ccbc6cc10 2023-10-06T11:13:53.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.772+0000 7f823bd75b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x562ccbb772c0 con 0x562ccbc229a0 2023-10-06T11:13:53.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.772+0000 7f823101a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ccbc4beb0 0x562ccbc1e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.772+0000 7f823101a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ccbc4beb0 0x562ccbc1e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47084/0 (socket says 172.21.15.146:47084) 2023-10-06T11:13:53.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.772+0000 7f823101a700 1 -- 172.21.15.146:0/4143243296 learned_addr learned my addr 172.21.15.146:0/4143243296 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:53.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.772+0000 7f8230819700 1 --2- 172.21.15.146:0/4143243296 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562ccbc229a0 0x562ccbc22d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.772+0000 7f822bfff700 1 --2- 172.21.15.146:0/4143243296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ccbc6cc10 0x562ccbc4b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.773+0000 7f823101a700 1 -- 172.21.15.146:0/4143243296 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562ccbc229a0 msgr2=0x562ccbc22d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:53.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.773+0000 7f823101a700 1 --2- 172.21.15.146:0/4143243296 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562ccbc229a0 0x562ccbc22d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.773+0000 7f823101a700 1 -- 172.21.15.146:0/4143243296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ccbc6cc10 msgr2=0x562ccbc4b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:53.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.773+0000 7f823101a700 1 --2- 172.21.15.146:0/4143243296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ccbc6cc10 0x562ccbc4b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.773+0000 7f823101a700 1 -- 172.21.15.146:0/4143243296 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562ccba0d2c0 con 0x562ccbc4beb0 2023-10-06T11:13:53.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.773+0000 7f8230819700 1 --2- 172.21.15.146:0/4143243296 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562ccbc229a0 0x562ccbc22d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:53.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.773+0000 7f822bfff700 1 --2- 172.21.15.146:0/4143243296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ccbc6cc10 0x562ccbc4b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:53.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.773+0000 7f823101a700 1 --2- 172.21.15.146:0/4143243296 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ccbc4beb0 0x562ccbc1e9e0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f82240094b0 tx=0x7f8224084810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=926a425cb2aee5f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:53.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.773+0000 7f8215ffb700 1 -- 172.21.15.146:0/4143243296 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822400e070 con 0x562ccbc4beb0 2023-10-06T11:13:53.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.773+0000 7f8215ffb700 1 -- 172.21.15.146:0/4143243296 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f822405a510 con 0x562ccbc4beb0 2023-10-06T11:13:53.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.773+0000 7f8215ffb700 1 -- 172.21.15.146:0/4143243296 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822405e260 con 0x562ccbc4beb0 2023-10-06T11:13:53.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.773+0000 7f823bd75b80 1 -- 172.21.15.146:0/4143243296 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ccbc4beb0 msgr2=0x562ccbc1e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.773+0000 7f823bd75b80 1 --2- 172.21.15.146:0/4143243296 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ccbc4beb0 0x562ccbc1e9e0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f82240094b0 tx=0x7f8224084810 comp rx=0 tx=0).stop 2023-10-06T11:13:53.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.773+0000 7f823bd75b80 1 -- 172.21.15.146:0/4143243296 shutdown_connections 2023-10-06T11:13:53.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.773+0000 7f823bd75b80 1 --2- 172.21.15.146:0/4143243296 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ccbc4beb0 0x562ccbc1e9e0 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.773+0000 7f823bd75b80 1 --2- 172.21.15.146:0/4143243296 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562ccbc229a0 0x562ccbc22d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.773+0000 7f823bd75b80 1 --2- 172.21.15.146:0/4143243296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ccbc6cc10 0x562ccbc4b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.773+0000 7f823bd75b80 1 -- 172.21.15.146:0/4143243296 >> 172.21.15.146:0/4143243296 conn(0x562ccbc242c0 msgr2=0x562ccbc24690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:53.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.773+0000 7f823bd75b80 1 -- 172.21.15.146:0/4143243296 shutdown_connections 2023-10-06T11:13:53.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.773+0000 7f823bd75b80 1 -- 172.21.15.146:0/4143243296 wait complete. 2023-10-06T11:13:53.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.774+0000 7f823bd75b80 1 -- start start 2023-10-06T11:13:53.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.774+0000 7f823bd75b80 1 Processor -- start 2023-10-06T11:13:53.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.775+0000 7f823bd75b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562ccbc229a0 0x562ccbc78dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.775+0000 7f823bd75b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ccbc4beb0 0x562ccbc79fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.775+0000 7f823bd75b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ccbc6cc10 0x562ccbc63710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.775+0000 7f823bd75b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ccbb730b0 con 0x562ccbc4beb0 2023-10-06T11:13:53.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.775+0000 7f823bd75b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ccbb1e8e0 con 0x562ccbc6cc10 2023-10-06T11:13:53.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.775+0000 7f823bd75b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x562ccbb39ef0 con 0x562ccbc229a0 2023-10-06T11:13:53.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.775+0000 7f823bd75b80 10 client.0 _ll_register_callbacks cb 0x562ccba0ff80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:13:53.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.775+0000 7f822bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ccbc4beb0 0x562ccbc79fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.775+0000 7f822bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ccbc4beb0 0x562ccbc79fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47098/0 (socket says 172.21.15.146:47098) 2023-10-06T11:13:53.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.775+0000 7f822bfff700 1 -- 172.21.15.146:0/156464573 learned_addr learned my addr 172.21.15.146:0/156464573 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:53.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.775+0000 7f8230819700 1 --2- 172.21.15.146:0/156464573 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562ccbc229a0 0x562ccbc78dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.775+0000 7f823101a700 1 --2- 172.21.15.146:0/156464573 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ccbc6cc10 0x562ccbc63710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.775+0000 7f822bfff700 1 -- 172.21.15.146:0/156464573 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562ccbc229a0 msgr2=0x562ccbc78dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:53.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.775+0000 7f822bfff700 1 --2- 172.21.15.146:0/156464573 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562ccbc229a0 0x562ccbc78dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.775+0000 7f822bfff700 1 -- 172.21.15.146:0/156464573 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ccbc6cc10 msgr2=0x562ccbc63710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:53.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.775+0000 7f822bfff700 1 --2- 172.21.15.146:0/156464573 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ccbc6cc10 0x562ccbc63710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.776+0000 7f822bfff700 1 -- 172.21.15.146:0/156464573 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f822c154710 con 0x562ccbc4beb0 2023-10-06T11:13:53.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.776+0000 7f823101a700 1 --2- 172.21.15.146:0/156464573 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ccbc6cc10 0x562ccbc63710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:13:53.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.776+0000 7f822bfff700 1 --2- 172.21.15.146:0/156464573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ccbc4beb0 0x562ccbc79fa0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f8218011580 tx=0x7f8218009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36b42074fcadfc3b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:53.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.776+0000 7f820affd700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:13:53.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.776+0000 7f820affd700 1 -- 172.21.15.146:0/156464573 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8218015470 con 0x562ccbc4beb0 2023-10-06T11:13:53.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.776+0000 7f820affd700 1 -- 172.21.15.146:0/156464573 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f82180155d0 con 0x562ccbc4beb0 2023-10-06T11:13:53.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.776+0000 7f823bd75b80 1 -- 172.21.15.146:0/156464573 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562ccbc176e0 con 0x562ccbc4beb0 2023-10-06T11:13:53.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.776+0000 7f820affd700 1 -- 172.21.15.146:0/156464573 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82180159e0 con 0x562ccbc4beb0 2023-10-06T11:13:53.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.776+0000 7f823bd75b80 10 client.7839 fetch_fsmap learned FSMap version 93 2023-10-06T11:13:53.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.776+0000 7f823bd75b80 1 -- 172.21.15.146:0/156464573 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x562ccb9b0030 con 0x562ccbc4beb0 2023-10-06T11:13:53.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.776+0000 7f820affd700 1 -- 172.21.15.146:0/156464573 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562ccbc176e0 con 0x562ccbc4beb0 2023-10-06T11:13:53.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.776+0000 7f820affd700 1 -- 172.21.15.146:0/156464573 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 93) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f8218015b40 con 0x562ccbc4beb0 2023-10-06T11:13:53.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.776+0000 7f823bd75b80 10 client.7839 fetch_fsmap finished waiting for FSMap version 93 2023-10-06T11:13:53.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.776+0000 7f823bd75b80 10 client.7839 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2023-10-06T11:13:53.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.776+0000 7f823bd75b80 20 client.7839 populate_metadata read hostname 'smithi146' 2023-10-06T11:13:53.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.776+0000 7f823bd75b80 1 --2- 172.21.15.146:0/156464573 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x562ccbc63c50 0x562ccbc4a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.776+0000 7f823bd75b80 4 client.7839 mds_command: new command op to 7620 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:13:53.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.776+0000 7f823bd75b80 1 -- 172.21.15.146:0/156464573 --> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562ccbbf4610 con 0x562ccbc63c50 2023-10-06T11:13:53.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.776+0000 7f8230819700 1 --2- 172.21.15.146:0/156464573 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x562ccbc63c50 0x562ccbc4a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.777+0000 7f820affd700 10 client.7839 ms_handle_connect on v2:172.21.15.146:6834/785131800 2023-10-06T11:13:53.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.777+0000 7f8230819700 1 --2- 172.21.15.146:0/156464573 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x562ccbc63c50 0x562ccbc4a550 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffbec2238a8062e0 server_cookie=3760cc110a686c04 in_seq=0 out_seq=0 2023-10-06T11:13:53.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.777+0000 7f820affd700 1 -- 172.21.15.146:0/156464573 <== mds.0 v2:172.21.15.146:6834/785131800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x562ccbbf4610 con 0x562ccbc63c50 2023-10-06T11:13:53.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.777+0000 7f820affd700 10 client.7839 handle_command_reply: tid=0 2023-10-06T11:13:53.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.777+0000 7f823bd75b80 1 client.7839 shutdown 2023-10-06T11:13:53.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.777+0000 7f823bd75b80 1 -- 172.21.15.146:0/156464573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ccbc4beb0 msgr2=0x562ccbc79fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.777+0000 7f823bd75b80 1 --2- 172.21.15.146:0/156464573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ccbc4beb0 0x562ccbc79fa0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f8218011580 tx=0x7f8218009040 comp rx=0 tx=0).stop 2023-10-06T11:13:53.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.777+0000 7f823bd75b80 1 -- 172.21.15.146:0/156464573 shutdown_connections 2023-10-06T11:13:53.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.777+0000 7f823bd75b80 1 --2- 172.21.15.146:0/156464573 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x562ccbc63c50 0x562ccbc4a550 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.777+0000 7f823bd75b80 1 --2- 172.21.15.146:0/156464573 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ccbc6cc10 0x562ccbc63710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.777+0000 7f823bd75b80 1 --2- 172.21.15.146:0/156464573 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562ccbc229a0 0x562ccbc78dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.777+0000 7f820affd700 0 client.7839 ms_handle_reset on v2:172.21.15.146:6834/785131800 2023-10-06T11:13:53.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.777+0000 7f823bd75b80 1 --2- 172.21.15.146:0/156464573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ccbc4beb0 0x562ccbc79fa0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.777+0000 7f823bd75b80 1 -- 172.21.15.146:0/156464573 >> 172.21.15.146:0/156464573 conn(0x562ccbc242c0 msgr2=0x562ccbc684f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:53.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.777+0000 7f823bd75b80 1 -- 172.21.15.146:0/156464573 shutdown_connections 2023-10-06T11:13:53.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.777+0000 7f823bd75b80 1 -- 172.21.15.146:0/156464573 wait complete. 2023-10-06T11:13:53.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.778+0000 7f823bd75b80 20 client.7839 trim_cache size 0 max 16384 2023-10-06T11:13:53.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.793+0000 7f823bd75b80 1 Processor -- start 2023-10-06T11:13:53.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.793+0000 7f823bd75b80 1 -- start start 2023-10-06T11:13:53.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.794+0000 7f823bd75b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ccbc229a0 0x562ccbc78fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.794+0000 7f823bd75b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562ccbc4beb0 0x562ccbc617a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.794+0000 7f823bd75b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ccbc6cc10 0x562ccbc82840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.794+0000 7f823bd75b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ccb9f5e80 con 0x562ccbc6cc10 2023-10-06T11:13:53.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.794+0000 7f823bd75b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ccbc02120 con 0x562ccbc229a0 2023-10-06T11:13:53.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.794+0000 7f823bd75b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x562ccbc238c0 con 0x562ccbc4beb0 2023-10-06T11:13:53.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.794+0000 7f823101a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ccbc6cc10 0x562ccbc82840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.794+0000 7f823101a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ccbc6cc10 0x562ccbc82840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47102/0 (socket says 172.21.15.146:47102) 2023-10-06T11:13:53.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.794+0000 7f823101a700 1 -- 172.21.15.146:0/1154745077 learned_addr learned my addr 172.21.15.146:0/1154745077 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:53.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.794+0000 7f8230819700 1 --2- 172.21.15.146:0/1154745077 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ccbc229a0 0x562ccbc78fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.794+0000 7f822bfff700 1 --2- 172.21.15.146:0/1154745077 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562ccbc4beb0 0x562ccbc617a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.794+0000 7f823101a700 1 -- 172.21.15.146:0/1154745077 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562ccbc4beb0 msgr2=0x562ccbc617a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:53.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.794+0000 7f823101a700 1 --2- 172.21.15.146:0/1154745077 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562ccbc4beb0 0x562ccbc617a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.794+0000 7f823101a700 1 -- 172.21.15.146:0/1154745077 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ccbc229a0 msgr2=0x562ccbc78fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:53.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.794+0000 7f823101a700 1 --2- 172.21.15.146:0/1154745077 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ccbc229a0 0x562ccbc78fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.794+0000 7f823101a700 1 -- 172.21.15.146:0/1154745077 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562ccbb417d0 con 0x562ccbc6cc10 2023-10-06T11:13:53.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.794+0000 7f8230819700 1 --2- 172.21.15.146:0/1154745077 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ccbc229a0 0x562ccbc78fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:53.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.794+0000 7f822bfff700 1 --2- 172.21.15.146:0/1154745077 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562ccbc4beb0 0x562ccbc617a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:53.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.794+0000 7f823101a700 1 --2- 172.21.15.146:0/1154745077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ccbc6cc10 0x562ccbc82840 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f8224057250 tx=0x7f822406d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92e6ef34232b2342 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:53.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.795+0000 7f82167fc700 1 -- 172.21.15.146:0/1154745077 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8224072050 con 0x562ccbc6cc10 2023-10-06T11:13:53.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.795+0000 7f82167fc700 1 -- 172.21.15.146:0/1154745077 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f822405e260 con 0x562ccbc6cc10 2023-10-06T11:13:53.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.795+0000 7f82167fc700 1 -- 172.21.15.146:0/1154745077 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8224008ed0 con 0x562ccbc6cc10 2023-10-06T11:13:53.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.795+0000 7f823bd75b80 1 -- 172.21.15.146:0/1154745077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ccbc6cc10 msgr2=0x562ccbc82840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.795+0000 7f823bd75b80 1 --2- 172.21.15.146:0/1154745077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ccbc6cc10 0x562ccbc82840 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f8224057250 tx=0x7f822406d000 comp rx=0 tx=0).stop 2023-10-06T11:13:53.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.795+0000 7f823bd75b80 1 -- 172.21.15.146:0/1154745077 shutdown_connections 2023-10-06T11:13:53.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.795+0000 7f823bd75b80 1 --2- 172.21.15.146:0/1154745077 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ccbc6cc10 0x562ccbc82840 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.795+0000 7f823bd75b80 1 --2- 172.21.15.146:0/1154745077 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ccbc229a0 0x562ccbc78fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.795+0000 7f823bd75b80 1 --2- 172.21.15.146:0/1154745077 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562ccbc4beb0 0x562ccbc617a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.795+0000 7f823bd75b80 1 -- 172.21.15.146:0/1154745077 >> 172.21.15.146:0/1154745077 conn(0x562ccbc242c0 msgr2=0x562ccbc191f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:53.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.795+0000 7f823bd75b80 1 -- 172.21.15.146:0/1154745077 shutdown_connections 2023-10-06T11:13:53.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.795+0000 7f823bd75b80 1 -- 172.21.15.146:0/1154745077 wait complete. 2023-10-06T11:13:53.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.796+0000 7f823bd75b80 1 -- start start 2023-10-06T11:13:53.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.796+0000 7f823bd75b80 1 Processor -- start 2023-10-06T11:13:53.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.797+0000 7f823bd75b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562ccbc229a0 0x562ccbc5f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.797+0000 7f823bd75b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ccbc4beb0 0x562ccbcc81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.797+0000 7f823bd75b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ccbc6cc10 0x562ccbc4a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.797+0000 7f823bd75b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ccbc82840 con 0x562ccbc6cc10 2023-10-06T11:13:53.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.797+0000 7f823bd75b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ccbc5fa40 con 0x562ccbc4beb0 2023-10-06T11:13:53.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.797+0000 7f823bd75b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x562ccbc19530 con 0x562ccbc229a0 2023-10-06T11:13:53.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.797+0000 7f823bd75b80 10 client.0 _ll_register_callbacks cb 0x562ccba0ff80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:13:53.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.797+0000 7f823101a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ccbc6cc10 0x562ccbc4a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.797+0000 7f823101a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ccbc6cc10 0x562ccbc4a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47116/0 (socket says 172.21.15.146:47116) 2023-10-06T11:13:53.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.797+0000 7f823101a700 1 -- 172.21.15.146:0/866853746 learned_addr learned my addr 172.21.15.146:0/866853746 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:53.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.797+0000 7f8230819700 1 --2- 172.21.15.146:0/866853746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562ccbc229a0 0x562ccbc5f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.797+0000 7f822bfff700 1 --2- 172.21.15.146:0/866853746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ccbc4beb0 0x562ccbcc81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.797+0000 7f823101a700 1 -- 172.21.15.146:0/866853746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562ccbc229a0 msgr2=0x562ccbc5f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:53.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.797+0000 7f823101a700 1 --2- 172.21.15.146:0/866853746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562ccbc229a0 0x562ccbc5f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.797+0000 7f823101a700 1 -- 172.21.15.146:0/866853746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ccbc4beb0 msgr2=0x562ccbcc81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:53.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.797+0000 7f823101a700 1 --2- 172.21.15.146:0/866853746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ccbc4beb0 0x562ccbcc81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.797+0000 7f823101a700 1 -- 172.21.15.146:0/866853746 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562ccba0d2c0 con 0x562ccbc6cc10 2023-10-06T11:13:53.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.797+0000 7f822bfff700 1 --2- 172.21.15.146:0/866853746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ccbc4beb0 0x562ccbcc81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:53.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.797+0000 7f823101a700 1 --2- 172.21.15.146:0/866853746 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ccbc6cc10 0x562ccbc4a550 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f822400b610 tx=0x7f8224082000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39978898b0b4859a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:53.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.797+0000 7f820affd700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:13:53.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.797+0000 7f820affd700 1 -- 172.21.15.146:0/866853746 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8224072050 con 0x562ccbc6cc10 2023-10-06T11:13:53.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.797+0000 7f820affd700 1 -- 172.21.15.146:0/866853746 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8224008ed0 con 0x562ccbc6cc10 2023-10-06T11:13:53.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.797+0000 7f823bd75b80 1 -- 172.21.15.146:0/866853746 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f822405a510 con 0x562ccbc6cc10 2023-10-06T11:13:53.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.797+0000 7f820affd700 1 -- 172.21.15.146:0/866853746 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82240860c0 con 0x562ccbc6cc10 2023-10-06T11:13:53.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.797+0000 7f823bd75b80 10 client.7845 fetch_fsmap learned FSMap version 93 2023-10-06T11:13:53.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.797+0000 7f823bd75b80 1 -- 172.21.15.146:0/866853746 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x562ccbb284c0 con 0x562ccbc6cc10 2023-10-06T11:13:53.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.798+0000 7f820affd700 1 -- 172.21.15.146:0/866853746 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f822405a510 con 0x562ccbc6cc10 2023-10-06T11:13:53.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.798+0000 7f820affd700 1 -- 172.21.15.146:0/866853746 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 93) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f822405ddd0 con 0x562ccbc6cc10 2023-10-06T11:13:53.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.798+0000 7f823bd75b80 10 client.7845 fetch_fsmap finished waiting for FSMap version 93 2023-10-06T11:13:53.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.798+0000 7f823bd75b80 10 client.7845 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2023-10-06T11:13:53.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.798+0000 7f823bd75b80 20 client.7845 populate_metadata read hostname 'smithi146' 2023-10-06T11:13:53.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.798+0000 7f823bd75b80 1 --2- 172.21.15.146:0/866853746 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x562ccbc69f10 0x562ccbc78f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.798+0000 7f823bd75b80 4 client.7845 mds_command: new command op to 7620 tid=0[{"prefix": "scrub status"}] 2023-10-06T11:13:53.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.798+0000 7f823bd75b80 1 -- 172.21.15.146:0/866853746 --> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562ccbb15e50 con 0x562ccbc69f10 2023-10-06T11:13:53.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.798+0000 7f8230819700 1 --2- 172.21.15.146:0/866853746 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x562ccbc69f10 0x562ccbc78f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.798+0000 7f820affd700 10 client.7845 ms_handle_connect on v2:172.21.15.146:6834/785131800 2023-10-06T11:13:53.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.798+0000 7f8230819700 1 --2- 172.21.15.146:0/866853746 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x562ccbc69f10 0x562ccbc78f40 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=100f04e0d3d6de2a server_cookie=44df237917a87938 in_seq=0 out_seq=0 2023-10-06T11:13:53.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.798+0000 7f820affd700 1 -- 172.21.15.146:0/866853746 <== mds.0 v2:172.21.15.146:6834/785131800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+276 (crc 0 0 0) 0x562ccbb15e50 con 0x562ccbc69f10 2023-10-06T11:13:53.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.798+0000 7f820affd700 10 client.7845 handle_command_reply: tid=0 2023-10-06T11:13:53.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.798+0000 7f823bd75b80 1 client.7845 shutdown 2023-10-06T11:13:53.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.798+0000 7f823bd75b80 1 -- 172.21.15.146:0/866853746 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ccbc6cc10 msgr2=0x562ccbc4a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.798+0000 7f823bd75b80 1 --2- 172.21.15.146:0/866853746 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ccbc6cc10 0x562ccbc4a550 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f822400b610 tx=0x7f8224082000 comp rx=0 tx=0).stop 2023-10-06T11:13:53.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.798+0000 7f823bd75b80 1 -- 172.21.15.146:0/866853746 shutdown_connections 2023-10-06T11:13:53.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.798+0000 7f823bd75b80 1 --2- 172.21.15.146:0/866853746 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x562ccbc69f10 0x562ccbc78f40 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.798+0000 7f823bd75b80 1 --2- 172.21.15.146:0/866853746 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562ccbc6cc10 0x562ccbc4a550 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.798+0000 7f820affd700 0 client.7845 ms_handle_reset on v2:172.21.15.146:6834/785131800 2023-10-06T11:13:53.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.798+0000 7f823bd75b80 1 --2- 172.21.15.146:0/866853746 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562ccbc229a0 0x562ccbc5f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.798+0000 7f823bd75b80 1 --2- 172.21.15.146:0/866853746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ccbc4beb0 0x562ccbcc81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.798+0000 7f823bd75b80 1 -- 172.21.15.146:0/866853746 >> 172.21.15.146:0/866853746 conn(0x562ccbc242c0 msgr2=0x562ccbc23820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:53.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.799+0000 7f823bd75b80 1 -- 172.21.15.146:0/866853746 shutdown_connections 2023-10-06T11:13:53.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.799+0000 7f823bd75b80 1 -- 172.21.15.146:0/866853746 wait complete. 2023-10-06T11:13:53.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.799+0000 7f823bd75b80 20 client.7845 trim_cache size 0 max 16384 2023-10-06T11:13:53.813 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:13:53.813 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "PAUSED (0 inodes in the stack)", 2023-10-06T11:13:53.813 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": { 2023-10-06T11:13:53.813 INFO:teuthology.orchestra.run.smithi146.stdout: "1f07e8ed-6b61-43b7-ad47-a57a4cdf0def": { 2023-10-06T11:13:53.814 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_control_test_path", 2023-10-06T11:13:53.814 INFO:teuthology.orchestra.run.smithi146.stdout: "tag": "1f07e8ed-6b61-43b7-ad47-a57a4cdf0def", 2023-10-06T11:13:53.814 INFO:teuthology.orchestra.run.smithi146.stdout: "options": "recursive" 2023-10-06T11:13:53.814 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:13:53.814 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:13:53.814 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:13:53.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.799+0000 7f823181b700 1 -- 172.21.15.146:0/2608611873 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8210066f30 msgr2=0x7f82100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.799+0000 7f823181b700 1 --2- 172.21.15.146:0/2608611873 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8210066f30 0x7f82100693e0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f822c153330 tx=0x7f82200091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.799+0000 7f823181b700 1 -- 172.21.15.146:0/2608611873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f822c0cb090 msgr2=0x7f822c16a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.799+0000 7f823181b700 1 --2- 172.21.15.146:0/2608611873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f822c0cb090 0x7f822c16a000 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f822c0694f0 tx=0x7f8224018000 comp rx=0 tx=0).stop 2023-10-06T11:13:53.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.799+0000 7f823181b700 1 -- 172.21.15.146:0/2608611873 shutdown_connections 2023-10-06T11:13:53.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.799+0000 7f823181b700 1 --2- 172.21.15.146:0/2608611873 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8210066f30 0x7f82100693e0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.799+0000 7f823181b700 1 --2- 172.21.15.146:0/2608611873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f822c0cb090 0x7f822c16a000 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.799+0000 7f823181b700 1 --2- 172.21.15.146:0/2608611873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f822c068780 0x7f822c0c8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.799+0000 7f823181b700 1 --2- 172.21.15.146:0/2608611873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f822c0b5640 0x7f822c0c9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.799+0000 7f823181b700 1 -- 172.21.15.146:0/2608611873 >> 172.21.15.146:0/2608611873 conn(0x7f822c0703f0 msgr2=0x7f822c1539f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:53.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.799+0000 7f823181b700 1 -- 172.21.15.146:0/2608611873 shutdown_connections 2023-10-06T11:13:53.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.799+0000 7f823181b700 1 -- 172.21.15.146:0/2608611873 wait complete. 2023-10-06T11:13:53.817 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:13:53.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.929+0000 7f4771488700 1 Processor -- start 2023-10-06T11:13:53.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.929+0000 7f4771488700 1 -- start start 2023-10-06T11:13:53.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.930+0000 7f4771488700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f476c0b0c00 0x7f476c0c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.930+0000 7f4771488700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f476c0ced80 0x7f476c0c3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.930+0000 7f4771488700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f476c0cf210 con 0x7f476c0c3740 2023-10-06T11:13:53.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.930+0000 7f4771488700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f476c0682f0 con 0x7f476c0b0c00 2023-10-06T11:13:53.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.930+0000 7f4771488700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f476c068580 con 0x7f476c0ced80 2023-10-06T11:13:53.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.930+0000 7f476b7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f476c0c3740 0x7f476c069270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:37660/0 (socket says 172.21.15.146:37660) 2023-10-06T11:13:53.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.931+0000 7f476b7fe700 1 -- 172.21.15.146:0/914981982 learned_addr learned my addr 172.21.15.146:0/914981982 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:13:53.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.931+0000 7f47627fc700 1 --2- 172.21.15.146:0/914981982 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f476c0ced80 0x7f476c0c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.931+0000 7f476affd700 1 --2- 172.21.15.146:0/914981982 >> v2:172.21.15.151:3300/0 conn(0x7f476c0b0c00 0x7f476c0c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.931+0000 7f476a7fc700 1 -- 172.21.15.146:0/914981982 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2091029677 0 0) 0x7f476c0cf210 con 0x7f476c0c3740 2023-10-06T11:13:53.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.931+0000 7f476a7fc700 1 -- 172.21.15.146:0/914981982 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4758003570 con 0x7f476c0c3740 2023-10-06T11:13:53.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.931+0000 7f476a7fc700 1 -- 172.21.15.146:0/914981982 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2327283585 0 0) 0x7f4758003570 con 0x7f476c0c3740 2023-10-06T11:13:53.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.931+0000 7f476affd700 1 -- 172.21.15.146:0/914981982 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f476c0ced80 msgr2=0x7f476c0c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:53.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.931+0000 7f476affd700 1 --2- 172.21.15.146:0/914981982 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f476c0ced80 0x7f476c0c3200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.931+0000 7f476affd700 1 -- 172.21.15.146:0/914981982 >> v1:172.21.15.146:6789/0 conn(0x7f476c0c3740 legacy=0x7f476c069270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.931+0000 7f476affd700 1 -- 172.21.15.146:0/914981982 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f476c068790 con 0x7f476c0b0c00 2023-10-06T11:13:53.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.931+0000 7f47627fc700 1 --2- 172.21.15.146:0/914981982 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f476c0ced80 0x7f476c0c3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:13:53.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.931+0000 7f476affd700 1 --2- 172.21.15.146:0/914981982 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f476c0b0c00 0x7f476c0c8aa0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f475c0098e0 tx=0x7f475c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f545be8416aa6be1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:53.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.931+0000 7f476a7fc700 1 -- 172.21.15.146:0/914981982 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47640017f0 con 0x7f476c0b0c00 2023-10-06T11:13:53.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.931+0000 7f476a7fc700 1 -- 172.21.15.146:0/914981982 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475c011420 con 0x7f476c0b0c00 2023-10-06T11:13:53.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.931+0000 7f476a7fc700 1 -- 172.21.15.146:0/914981982 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c0117c0 con 0x7f476c0b0c00 2023-10-06T11:13:53.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.932+0000 7f4771488700 1 -- 172.21.15.146:0/914981982 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f476c0b0c00 msgr2=0x7f476c0c8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.932+0000 7f4771488700 1 --2- 172.21.15.146:0/914981982 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f476c0b0c00 0x7f476c0c8aa0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f475c0098e0 tx=0x7f475c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.932+0000 7f4771488700 1 -- 172.21.15.146:0/914981982 shutdown_connections 2023-10-06T11:13:53.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.932+0000 7f4771488700 1 --2- 172.21.15.146:0/914981982 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f476c0b0c00 0x7f476c0c8aa0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.932+0000 7f4771488700 1 --2- 172.21.15.146:0/914981982 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f476c0ced80 0x7f476c0c3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.932+0000 7f4771488700 1 -- 172.21.15.146:0/914981982 >> 172.21.15.146:0/914981982 conn(0x7f476c067c50 msgr2=0x7f476c0ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:53.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.932+0000 7f4771488700 1 -- 172.21.15.146:0/914981982 shutdown_connections 2023-10-06T11:13:53.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.932+0000 7f4771488700 1 -- 172.21.15.146:0/914981982 wait complete. 2023-10-06T11:13:53.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.933+0000 7f4771488700 1 Processor -- start 2023-10-06T11:13:53.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.933+0000 7f4771488700 1 -- start start 2023-10-06T11:13:53.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.934+0000 7f4771488700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f476c0b0c00 0x7f476c169eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.934+0000 7f4771488700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f476c0c3740 0x7f476c09a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.934+0000 7f4771488700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f476c0ced80 0x7f476c09a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.934+0000 7f4771488700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476c09ba90 con 0x7f476c0c3740 2023-10-06T11:13:53.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.934+0000 7f4771488700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476c16a3f0 con 0x7f476c0ced80 2023-10-06T11:13:53.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.934+0000 7f4771488700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f476c09ae80 con 0x7f476c0b0c00 2023-10-06T11:13:53.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.934+0000 7f47627fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f476c0c3740 0x7f476c09a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.934+0000 7f47627fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f476c0c3740 0x7f476c09a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47132/0 (socket says 172.21.15.146:47132) 2023-10-06T11:13:53.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.934+0000 7f47627fc700 1 -- 172.21.15.146:0/1719166851 learned_addr learned my addr 172.21.15.146:0/1719166851 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:53.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.934+0000 7f476affd700 1 --2- 172.21.15.146:0/1719166851 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f476c0b0c00 0x7f476c169eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.934+0000 7f476b7fe700 1 --2- 172.21.15.146:0/1719166851 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f476c0ced80 0x7f476c09a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.934+0000 7f47627fc700 1 -- 172.21.15.146:0/1719166851 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f476c0b0c00 msgr2=0x7f476c169eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.934+0000 7f47627fc700 1 --2- 172.21.15.146:0/1719166851 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f476c0b0c00 0x7f476c169eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.934+0000 7f47627fc700 1 -- 172.21.15.146:0/1719166851 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f476c0ced80 msgr2=0x7f476c09a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:53.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.934+0000 7f47627fc700 1 --2- 172.21.15.146:0/1719166851 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f476c0ced80 0x7f476c09a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:53.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.934+0000 7f47627fc700 1 -- 172.21.15.146:0/1719166851 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4754009420 con 0x7f476c0c3740 2023-10-06T11:13:53.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.934+0000 7f47627fc700 1 --2- 172.21.15.146:0/1719166851 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f476c0c3740 0x7f476c09a2e0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f475400ec80 tx=0x7f47540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:53.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.935+0000 7f47637fe700 1 -- 172.21.15.146:0/1719166851 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475400c920 con 0x7f476c0c3740 2023-10-06T11:13:53.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.935+0000 7f47637fe700 1 -- 172.21.15.146:0/1719166851 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475400ca80 con 0x7f476c0c3740 2023-10-06T11:13:53.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.935+0000 7f4771488700 1 -- 172.21.15.146:0/1719166851 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f475c009420 con 0x7f476c0c3740 2023-10-06T11:13:53.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.935+0000 7f47637fe700 1 -- 172.21.15.146:0/1719166851 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475400ce00 con 0x7f476c0c3740 2023-10-06T11:13:53.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.935+0000 7f4771488700 1 -- 172.21.15.146:0/1719166851 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f476c09b440 con 0x7f476c0c3740 2023-10-06T11:13:53.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.936+0000 7f4771488700 1 -- 172.21.15.146:0/1719166851 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f476c04c380 con 0x7f476c0c3740 2023-10-06T11:13:53.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.936+0000 7f47637fe700 1 -- 172.21.15.146:0/1719166851 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4754013680 con 0x7f476c0c3740 2023-10-06T11:13:53.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.937+0000 7f47637fe700 1 --2- 172.21.15.146:0/1719166851 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f474c066f30 0x7f474c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:53.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.937+0000 7f476affd700 1 --2- 172.21.15.146:0/1719166851 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f474c066f30 0x7f474c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:53.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.937+0000 7f47637fe700 1 -- 172.21.15.146:0/1719166851 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4754084d50 con 0x7f476c0c3740 2023-10-06T11:13:53.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.937+0000 7f476affd700 1 --2- 172.21.15.146:0/1719166851 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f474c066f30 0x7f474c0693e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f475c0093f0 tx=0x7f475c016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:53.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:53.941+0000 7f47637fe700 1 -- 172.21.15.146:0/1719166851 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4754088030 con 0x7f476c0c3740 2023-10-06T11:13:54.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.173+0000 7f4771488700 1 -- 172.21.15.146:0/1719166851 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f476c09bbd0 con 0x7f476c0c3740 2023-10-06T11:13:54.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.173+0000 7f47637fe700 1 -- 172.21.15.146:0/1719166851 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f476c09bbd0 con 0x7f476c0c3740 2023-10-06T11:13:54.175 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:13:54.175 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":93,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/2159562091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2159562091},{"type":"v1","addr":"172.21.15.151:6834","nonce":2159562091}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6242,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/603782012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":603782012},{"type":"v1","addr":"172.21.15.151:6835","nonce":603782012}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6916,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3416056259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3416056259},{"type":"v1","addr":"172.21.15.146:6837","nonce":3416056259}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:13:30.345795+0000","modified":"2023-10-06T11:13:33.984549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7620":{"gid":7620,"name":"c","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/785131800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":785131800},{"type":"v1","addr":"172.21.15.146:6835","nonce":785131800}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T11:13:54.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.175+0000 7f4771488700 1 -- 172.21.15.146:0/1719166851 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f474c066f30 msgr2=0x7f474c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:54.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.175+0000 7f4771488700 1 --2- 172.21.15.146:0/1719166851 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f474c066f30 0x7f474c0693e0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f475c0093f0 tx=0x7f475c016000 comp rx=0 tx=0).stop 2023-10-06T11:13:54.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.175+0000 7f4771488700 1 -- 172.21.15.146:0/1719166851 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f476c0c3740 msgr2=0x7f476c09a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:54.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.175+0000 7f4771488700 1 --2- 172.21.15.146:0/1719166851 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f476c0c3740 0x7f476c09a2e0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f475400ec80 tx=0x7f47540091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:54.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.175+0000 7f4771488700 1 -- 172.21.15.146:0/1719166851 shutdown_connections 2023-10-06T11:13:54.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.175+0000 7f4771488700 1 --2- 172.21.15.146:0/1719166851 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f474c066f30 0x7f474c0693e0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:54.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.175+0000 7f4771488700 1 --2- 172.21.15.146:0/1719166851 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f476c0ced80 0x7f476c09a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:54.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.175+0000 7f4771488700 1 --2- 172.21.15.146:0/1719166851 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f476c0b0c00 0x7f476c169eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:54.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.175+0000 7f4771488700 1 --2- 172.21.15.146:0/1719166851 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f476c0c3740 0x7f476c09a2e0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:54.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.175+0000 7f4771488700 1 -- 172.21.15.146:0/1719166851 >> 172.21.15.146:0/1719166851 conn(0x7f476c067c50 msgr2=0x7f476c0ccdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:54.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.175+0000 7f4771488700 1 -- 172.21.15.146:0/1719166851 shutdown_connections 2023-10-06T11:13:54.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.175+0000 7f4771488700 1 -- 172.21.15.146:0/1719166851 wait complete. 2023-10-06T11:13:54.179 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 93 2023-10-06T11:13:54.189 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2023-10-06T11:13:54.190 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T11:13:54.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.301+0000 7fc7da803700 1 Processor -- start 2023-10-06T11:13:54.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.301+0000 7fc7da803700 1 -- start start 2023-10-06T11:13:54.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.302+0000 7fc7da803700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc7d415a420 0x7fc7d415cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:54.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.302+0000 7fc7da803700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7d415a7f0 0x7fc7d40b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:54.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.302+0000 7fc7da803700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7d415c630 con 0x7fc7d40b2360 2023-10-06T11:13:54.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.302+0000 7fc7da803700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7d40ce040 con 0x7fc7d415a420 2023-10-06T11:13:54.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.302+0000 7fc7da803700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d40b27e0 con 0x7fc7d415a7f0 2023-10-06T11:13:54.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.303+0000 7fc7d9801700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc7d415a420 0x7fc7d415cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:54.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.303+0000 7fc7d9801700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc7d415a420 0x7fc7d415cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47136/0 (socket says 172.21.15.146:47136) 2023-10-06T11:13:54.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.303+0000 7fc7d9801700 1 -- 172.21.15.146:0/2474683821 learned_addr learned my addr 172.21.15.146:0/2474683821 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:54.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.303+0000 7fc7d9000700 1 --2- 172.21.15.146:0/2474683821 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7d415a7f0 0x7fc7d40b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:54.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.303+0000 7fc7d9801700 1 -- 172.21.15.146:0/2474683821 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7d415a7f0 msgr2=0x7fc7d40b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:54.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.303+0000 7fc7d9801700 1 --2- 172.21.15.146:0/2474683821 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7d415a7f0 0x7fc7d40b1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:54.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.303+0000 7fc7d9801700 1 -- 172.21.15.146:0/2474683821 >> v1:172.21.15.151:6789/0 conn(0x7fc7d40b2360 legacy=0x7fc7d415acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:54.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.303+0000 7fc7d9801700 1 -- 172.21.15.146:0/2474683821 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d415ba20 con 0x7fc7d415a420 2023-10-06T11:13:54.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.303+0000 7fc7d9801700 1 --2- 172.21.15.146:0/2474683821 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7d415a420 0x7fc7d415cac0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0009f50 tx=0x7fc7d0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f0b40d63ba0e48 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:54.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.303+0000 7fc7cbfff700 1 -- 172.21.15.146:0/2474683821 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d000e070 con 0x7fc7d415a420 2023-10-06T11:13:54.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.303+0000 7fc7cbfff700 1 -- 172.21.15.146:0/2474683821 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7d000b9c0 con 0x7fc7d415a420 2023-10-06T11:13:54.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.303+0000 7fc7cbfff700 1 -- 172.21.15.146:0/2474683821 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d00092e0 con 0x7fc7d415a420 2023-10-06T11:13:54.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.304+0000 7fc7da803700 1 -- 172.21.15.146:0/2474683821 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7d415a420 msgr2=0x7fc7d415cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:54.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.304+0000 7fc7da803700 1 --2- 172.21.15.146:0/2474683821 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7d415a420 0x7fc7d415cac0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0009f50 tx=0x7fc7d0009840 comp rx=0 tx=0).stop 2023-10-06T11:13:54.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.304+0000 7fc7da803700 1 -- 172.21.15.146:0/2474683821 shutdown_connections 2023-10-06T11:13:54.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.304+0000 7fc7da803700 1 --2- 172.21.15.146:0/2474683821 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7d415a420 0x7fc7d415cac0 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:54.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.304+0000 7fc7da803700 1 --2- 172.21.15.146:0/2474683821 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7d415a7f0 0x7fc7d40b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:54.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.304+0000 7fc7da803700 1 -- 172.21.15.146:0/2474683821 >> 172.21.15.146:0/2474683821 conn(0x7fc7d406eba0 msgr2=0x7fc7d406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:54.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.304+0000 7fc7da803700 1 -- 172.21.15.146:0/2474683821 shutdown_connections 2023-10-06T11:13:54.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.304+0000 7fc7da803700 1 -- 172.21.15.146:0/2474683821 wait complete. 2023-10-06T11:13:54.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.305+0000 7fc7da803700 1 Processor -- start 2023-10-06T11:13:54.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.305+0000 7fc7da803700 1 -- start start 2023-10-06T11:13:54.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.306+0000 7fc7da803700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7d40b2360 0x7fc7d414ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:54.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.306+0000 7fc7da803700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7d415a420 0x7fc7d4147ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:54.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.306+0000 7fc7da803700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7d415a7f0 0x7fc7d4148000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:54.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.306+0000 7fc7da803700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d41466b0 con 0x7fc7d415a420 2023-10-06T11:13:54.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.306+0000 7fc7da803700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d414a600 con 0x7fc7d40b2360 2023-10-06T11:13:54.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.306+0000 7fc7da803700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d4153cf0 con 0x7fc7d415a7f0 2023-10-06T11:13:54.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.306+0000 7fc7d9000700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7d415a420 0x7fc7d4147ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:54.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.306+0000 7fc7d9000700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7d415a420 0x7fc7d4147ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47152/0 (socket says 172.21.15.146:47152) 2023-10-06T11:13:54.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.306+0000 7fc7d9000700 1 -- 172.21.15.146:0/3405656509 learned_addr learned my addr 172.21.15.146:0/3405656509 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:54.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.306+0000 7fc7d9801700 1 --2- 172.21.15.146:0/3405656509 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7d40b2360 0x7fc7d414ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:54.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.306+0000 7fc7da002700 1 --2- 172.21.15.146:0/3405656509 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7d415a7f0 0x7fc7d4148000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:54.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.306+0000 7fc7d9000700 1 -- 172.21.15.146:0/3405656509 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7d415a7f0 msgr2=0x7fc7d4148000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:54.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.306+0000 7fc7d9000700 1 --2- 172.21.15.146:0/3405656509 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7d415a7f0 0x7fc7d4148000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:54.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.306+0000 7fc7d9000700 1 -- 172.21.15.146:0/3405656509 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7d40b2360 msgr2=0x7fc7d414ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:54.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.306+0000 7fc7d9000700 1 --2- 172.21.15.146:0/3405656509 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7d40b2360 0x7fc7d414ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:54.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.306+0000 7fc7d9000700 1 -- 172.21.15.146:0/3405656509 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d0009ae0 con 0x7fc7d415a420 2023-10-06T11:13:54.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.307+0000 7fc7d9000700 1 --2- 172.21.15.146:0/3405656509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7d415a420 0x7fc7d4147ac0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7fc7c400e900 tx=0x7fc7c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:54.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.307+0000 7fc7c97fa700 1 -- 172.21.15.146:0/3405656509 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c4013680 con 0x7fc7d415a420 2023-10-06T11:13:54.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.307+0000 7fc7c97fa700 1 -- 172.21.15.146:0/3405656509 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c40137e0 con 0x7fc7d415a420 2023-10-06T11:13:54.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.307+0000 7fc7c97fa700 1 -- 172.21.15.146:0/3405656509 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c4013ba0 con 0x7fc7d415a420 2023-10-06T11:13:54.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.307+0000 7fc7da803700 1 -- 172.21.15.146:0/3405656509 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7d414a850 con 0x7fc7d415a420 2023-10-06T11:13:54.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.307+0000 7fc7da803700 1 -- 172.21.15.146:0/3405656509 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7d414ae10 con 0x7fc7d415a420 2023-10-06T11:13:54.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.308+0000 7fc7da803700 1 -- 172.21.15.146:0/3405656509 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7d40afae0 con 0x7fc7d415a420 2023-10-06T11:13:54.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.308+0000 7fc7c97fa700 1 -- 172.21.15.146:0/3405656509 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc7c401c450 con 0x7fc7d415a420 2023-10-06T11:13:54.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.308+0000 7fc7c97fa700 1 --2- 172.21.15.146:0/3405656509 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc7b8066f30 0x7fc7b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:54.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.308+0000 7fc7c97fa700 1 -- 172.21.15.146:0/3405656509 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc7c4084710 con 0x7fc7d415a420 2023-10-06T11:13:54.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.309+0000 7fc7d9801700 1 --2- 172.21.15.146:0/3405656509 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc7b8066f30 0x7fc7b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:54.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.309+0000 7fc7d9801700 1 --2- 172.21.15.146:0/3405656509 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc7b8066f30 0x7fc7b80693e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0009ea0 tx=0x7fc7d0018000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:54.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.313+0000 7fc7c97fa700 1 -- 172.21.15.146:0/3405656509 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc7c4051820 con 0x7fc7d415a420 2023-10-06T11:13:54.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.574+0000 7fc7da803700 1 -- 172.21.15.146:0/3405656509 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fc7d415bd00 con 0x7fc7d415a420 2023-10-06T11:13:54.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.575+0000 7fc7c97fa700 1 -- 172.21.15.146:0/3405656509 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1447 (secure 0 0 0) 0x7fc7c4054e40 con 0x7fc7d415a420 2023-10-06T11:13:54.576 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:13:54.577 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":509,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":101,"num_osds":8,"num_up_osds":8,"osd_up_since":1696590336,"num_in_osds":8,"osd_in_since":1696590327,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":936,"data_bytes":959207412,"bytes_used":4354408448,"bytes_avail":768739704832,"bytes_total":773094113280,"write_bytes_sec":79874155,"read_op_per_sec":0,"write_op_per_sec":77},"fsmap":{"epoch":93,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":7620}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":18,"modified":"2023-10-06T11:13:19.237978+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T11:13:54.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.576+0000 7fc7da803700 1 -- 172.21.15.146:0/3405656509 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc7b8066f30 msgr2=0x7fc7b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:54.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.576+0000 7fc7da803700 1 --2- 172.21.15.146:0/3405656509 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc7b8066f30 0x7fc7b80693e0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0009ea0 tx=0x7fc7d0018000 comp rx=0 tx=0).stop 2023-10-06T11:13:54.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.576+0000 7fc7da803700 1 -- 172.21.15.146:0/3405656509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7d415a420 msgr2=0x7fc7d4147ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:54.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.576+0000 7fc7da803700 1 --2- 172.21.15.146:0/3405656509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7d415a420 0x7fc7d4147ac0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7fc7c400e900 tx=0x7fc7c40091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:54.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.576+0000 7fc7da803700 1 -- 172.21.15.146:0/3405656509 shutdown_connections 2023-10-06T11:13:54.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.576+0000 7fc7da803700 1 --2- 172.21.15.146:0/3405656509 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc7b8066f30 0x7fc7b80693e0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:54.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.576+0000 7fc7da803700 1 --2- 172.21.15.146:0/3405656509 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7d415a7f0 0x7fc7d4148000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:54.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.576+0000 7fc7da803700 1 --2- 172.21.15.146:0/3405656509 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7d40b2360 0x7fc7d414ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:54.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.577+0000 7fc7da803700 1 --2- 172.21.15.146:0/3405656509 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7d415a420 0x7fc7d4147ac0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:54.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.577+0000 7fc7da803700 1 -- 172.21.15.146:0/3405656509 >> 172.21.15.146:0/3405656509 conn(0x7fc7d406eba0 msgr2=0x7fc7d40b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:54.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.577+0000 7fc7da803700 1 -- 172.21.15.146:0/3405656509 shutdown_connections 2023-10-06T11:13:54.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:54.577+0000 7fc7da803700 1 -- 172.21.15.146:0/3405656509 wait complete. 2023-10-06T11:13:54.590 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2023-10-06T11:13:55.591 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:13:55.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.705+0000 7f9d9f46d700 1 Processor -- start 2023-10-06T11:13:55.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.705+0000 7f9d9f46d700 1 -- start start 2023-10-06T11:13:55.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.706+0000 7f9d9f46d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9d9815a420 0x7f9d9815cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:55.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.706+0000 7f9d9f46d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d980b2530 0x7f9d9815acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:55.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.706+0000 7f9d9f46d700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d9815c630 con 0x7f9d9815a7f0 2023-10-06T11:13:55.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.706+0000 7f9d9f46d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d980ce040 con 0x7f9d9815a420 2023-10-06T11:13:55.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.706+0000 7f9d9f46d700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9815ba20 con 0x7f9d980b2530 2023-10-06T11:13:55.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.706+0000 7f9d9e46b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9d9815a420 0x7f9d9815cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:55.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.706+0000 7f9d9e46b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9d9815a420 0x7f9d9815cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47160/0 (socket says 172.21.15.146:47160) 2023-10-06T11:13:55.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.706+0000 7f9d9e46b700 1 -- 172.21.15.146:0/1798957467 learned_addr learned my addr 172.21.15.146:0/1798957467 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:55.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.706+0000 7f9d9ec6c700 1 --2- 172.21.15.146:0/1798957467 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d980b2530 0x7f9d9815acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:55.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.706+0000 7f9d9e46b700 1 -- 172.21.15.146:0/1798957467 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d980b2530 msgr2=0x7f9d9815acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:55.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.706+0000 7f9d9e46b700 1 --2- 172.21.15.146:0/1798957467 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d980b2530 0x7f9d9815acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:55.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.706+0000 7f9d9e46b700 1 -- 172.21.15.146:0/1798957467 >> v1:172.21.15.151:6789/0 conn(0x7f9d9815a7f0 legacy=0x7f9d980b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:55.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.706+0000 7f9d9e46b700 1 -- 172.21.15.146:0/1798957467 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d9815bd00 con 0x7f9d9815a420 2023-10-06T11:13:55.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.706+0000 7f9d9e46b700 1 --2- 172.21.15.146:0/1798957467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d9815a420 0x7f9d9815cac0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f9d940099b0 tx=0x7f9d94009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a87caa6a7f56cbc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:55.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.707+0000 7f9d9d469700 1 -- 172.21.15.146:0/1798957467 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9400b860 con 0x7f9d9815a420 2023-10-06T11:13:55.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.707+0000 7f9d9d469700 1 -- 172.21.15.146:0/1798957467 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d9400b9c0 con 0x7f9d9815a420 2023-10-06T11:13:55.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.707+0000 7f9d9d469700 1 -- 172.21.15.146:0/1798957467 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9400bd60 con 0x7f9d9815a420 2023-10-06T11:13:55.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.707+0000 7f9d9f46d700 1 -- 172.21.15.146:0/1798957467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d9815a420 msgr2=0x7f9d9815cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:55.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.707+0000 7f9d9f46d700 1 --2- 172.21.15.146:0/1798957467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d9815a420 0x7f9d9815cac0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f9d940099b0 tx=0x7f9d94009250 comp rx=0 tx=0).stop 2023-10-06T11:13:55.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.707+0000 7f9d9f46d700 1 -- 172.21.15.146:0/1798957467 shutdown_connections 2023-10-06T11:13:55.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.707+0000 7f9d9f46d700 1 --2- 172.21.15.146:0/1798957467 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d980b2530 0x7f9d9815acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:55.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.707+0000 7f9d9f46d700 1 --2- 172.21.15.146:0/1798957467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d9815a420 0x7f9d9815cac0 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:55.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.707+0000 7f9d9f46d700 1 -- 172.21.15.146:0/1798957467 >> 172.21.15.146:0/1798957467 conn(0x7f9d9806eba0 msgr2=0x7f9d9806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:55.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.707+0000 7f9d9f46d700 1 -- 172.21.15.146:0/1798957467 shutdown_connections 2023-10-06T11:13:55.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.707+0000 7f9d9f46d700 1 -- 172.21.15.146:0/1798957467 wait complete. 2023-10-06T11:13:55.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.708+0000 7f9d9f46d700 1 Processor -- start 2023-10-06T11:13:55.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.708+0000 7f9d9f46d700 1 -- start start 2023-10-06T11:13:55.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.709+0000 7f9d9f46d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d980b2530 0x7f9d980b4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:55.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.709+0000 7f9d9f46d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d9815a420 0x7f9d98136c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:55.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.709+0000 7f9d9f46d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d9815a7f0 0x7f9d981371d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:55.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.709+0000 7f9d9f46d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d981378e0 con 0x7f9d9815a7f0 2023-10-06T11:13:55.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.709+0000 7f9d9f46d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d98138460 con 0x7f9d9815a420 2023-10-06T11:13:55.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.709+0000 7f9d9f46d700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d98137b30 con 0x7f9d980b2530 2023-10-06T11:13:55.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.709+0000 7f9d9ec6c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d9815a7f0 0x7f9d981371d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:55.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.709+0000 7f9d9ec6c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d9815a7f0 0x7f9d981371d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47170/0 (socket says 172.21.15.146:47170) 2023-10-06T11:13:55.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.709+0000 7f9d9ec6c700 1 -- 172.21.15.146:0/4113569036 learned_addr learned my addr 172.21.15.146:0/4113569036 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:55.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.709+0000 7f9d9dc6a700 1 --2- 172.21.15.146:0/4113569036 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d9815a420 0x7f9d98136c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:55.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.709+0000 7f9d9e46b700 1 --2- 172.21.15.146:0/4113569036 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d980b2530 0x7f9d980b4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:55.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.709+0000 7f9d9ec6c700 1 -- 172.21.15.146:0/4113569036 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d980b2530 msgr2=0x7f9d980b4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:55.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.709+0000 7f9d9ec6c700 1 --2- 172.21.15.146:0/4113569036 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d980b2530 0x7f9d980b4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:55.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.709+0000 7f9d9ec6c700 1 -- 172.21.15.146:0/4113569036 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d9815a420 msgr2=0x7f9d98136c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:55.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.709+0000 7f9d9ec6c700 1 --2- 172.21.15.146:0/4113569036 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d9815a420 0x7f9d98136c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:55.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.709+0000 7f9d9ec6c700 1 -- 172.21.15.146:0/4113569036 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d940094f0 con 0x7f9d9815a7f0 2023-10-06T11:13:55.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.710+0000 7f9d9ec6c700 1 --2- 172.21.15.146:0/4113569036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d9815a7f0 0x7f9d981371d0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f9d90007f20 tx=0x7f9d900098a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:55.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.710+0000 7f9d8e7fc700 1 -- 172.21.15.146:0/4113569036 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9000eb90 con 0x7f9d9815a7f0 2023-10-06T11:13:55.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.710+0000 7f9d8e7fc700 1 -- 172.21.15.146:0/4113569036 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d9000ecf0 con 0x7f9d9815a7f0 2023-10-06T11:13:55.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.710+0000 7f9d9f46d700 1 -- 172.21.15.146:0/4113569036 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d98137e10 con 0x7f9d9815a7f0 2023-10-06T11:13:55.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.710+0000 7f9d8e7fc700 1 -- 172.21.15.146:0/4113569036 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d90014670 con 0x7f9d9815a7f0 2023-10-06T11:13:55.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.710+0000 7f9d9f46d700 1 -- 172.21.15.146:0/4113569036 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d980b5530 con 0x7f9d9815a7f0 2023-10-06T11:13:55.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.711+0000 7f9d9f46d700 1 -- 172.21.15.146:0/4113569036 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d981385d0 con 0x7f9d9815a7f0 2023-10-06T11:13:55.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.711+0000 7f9d8e7fc700 1 -- 172.21.15.146:0/4113569036 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9d90014a60 con 0x7f9d9815a7f0 2023-10-06T11:13:55.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.712+0000 7f9d8e7fc700 1 --2- 172.21.15.146:0/4113569036 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9d7c066f30 0x7f9d7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:55.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.712+0000 7f9d9e46b700 1 --2- 172.21.15.146:0/4113569036 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9d7c066f30 0x7f9d7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:55.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.712+0000 7f9d8e7fc700 1 -- 172.21.15.146:0/4113569036 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9d90084c00 con 0x7f9d9815a7f0 2023-10-06T11:13:55.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.712+0000 7f9d9e46b700 1 --2- 172.21.15.146:0/4113569036 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9d7c066f30 0x7f9d7c0693e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f9d940099b0 tx=0x7f9d94017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:55.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.716+0000 7f9d8e7fc700 1 -- 172.21.15.146:0/4113569036 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9d9008b080 con 0x7f9d9815a7f0 2023-10-06T11:13:55.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.938+0000 7f9d9f46d700 1 -- 172.21.15.146:0/4113569036 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d980afae0 con 0x7f9d9815a7f0 2023-10-06T11:13:55.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.939+0000 7f9d8e7fc700 1 -- 172.21.15.146:0/4113569036 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f9d900557a0 con 0x7f9d9815a7f0 2023-10-06T11:13:55.941 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:13:55.941 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":93,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/2159562091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2159562091},{"type":"v1","addr":"172.21.15.151:6834","nonce":2159562091}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6242,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/603782012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":603782012},{"type":"v1","addr":"172.21.15.151:6835","nonce":603782012}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6916,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3416056259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3416056259},{"type":"v1","addr":"172.21.15.146:6837","nonce":3416056259}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:13:30.345795+0000","modified":"2023-10-06T11:13:33.984549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7620":{"gid":7620,"name":"c","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/785131800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":785131800},{"type":"v1","addr":"172.21.15.146:6835","nonce":785131800}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T11:13:55.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.941+0000 7f9d9f46d700 1 -- 172.21.15.146:0/4113569036 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9d7c066f30 msgr2=0x7f9d7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:55.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.941+0000 7f9d9f46d700 1 --2- 172.21.15.146:0/4113569036 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9d7c066f30 0x7f9d7c0693e0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f9d940099b0 tx=0x7f9d94017000 comp rx=0 tx=0).stop 2023-10-06T11:13:55.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.941+0000 7f9d9f46d700 1 -- 172.21.15.146:0/4113569036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d9815a7f0 msgr2=0x7f9d981371d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:55.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.941+0000 7f9d9f46d700 1 --2- 172.21.15.146:0/4113569036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d9815a7f0 0x7f9d981371d0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f9d90007f20 tx=0x7f9d900098a0 comp rx=0 tx=0).stop 2023-10-06T11:13:55.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.941+0000 7f9d9f46d700 1 -- 172.21.15.146:0/4113569036 shutdown_connections 2023-10-06T11:13:55.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.941+0000 7f9d9f46d700 1 --2- 172.21.15.146:0/4113569036 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9d7c066f30 0x7f9d7c0693e0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:55.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.941+0000 7f9d9f46d700 1 --2- 172.21.15.146:0/4113569036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9d9815a7f0 0x7f9d981371d0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:55.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.941+0000 7f9d9f46d700 1 --2- 172.21.15.146:0/4113569036 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d980b2530 0x7f9d980b4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:55.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.941+0000 7f9d9f46d700 1 --2- 172.21.15.146:0/4113569036 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d9815a420 0x7f9d98136c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:55.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.941+0000 7f9d9f46d700 1 -- 172.21.15.146:0/4113569036 >> 172.21.15.146:0/4113569036 conn(0x7f9d9806eba0 msgr2=0x7f9d9806ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:55.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.941+0000 7f9d9f46d700 1 -- 172.21.15.146:0/4113569036 shutdown_connections 2023-10-06T11:13:55.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:55.941+0000 7f9d9f46d700 1 -- 172.21.15.146:0/4113569036 wait complete. 2023-10-06T11:13:55.944 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 93 2023-10-06T11:13:55.954 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2023-10-06T11:13:55.955 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T11:13:56.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.069+0000 7f16f1707700 1 Processor -- start 2023-10-06T11:13:56.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.069+0000 7f16f1707700 1 -- start start 2023-10-06T11:13:56.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.069+0000 7f16f1707700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f16ec0ab010 0x7f16ec157800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:56.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.069+0000 7f16f1707700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16ec0ccf20 con 0x7f16ec0ca070 2023-10-06T11:13:56.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.070+0000 7f16f1707700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16ec0cd200 con 0x7f16ec157430 2023-10-06T11:13:56.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.070+0000 7f16f1707700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16ec0ca4f0 con 0x7f16ec0ab010 2023-10-06T11:13:56.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.070+0000 7f16e3fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f16ec0ab010 0x7f16ec157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:56.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.070+0000 7f16eaffd700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f16ec157430 0x7f16ec0ceb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:55604/0 (socket says 172.21.15.146:55604) 2023-10-06T11:13:56.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.070+0000 7f16eaffd700 1 -- 172.21.15.146:0/1648135231 learned_addr learned my addr 172.21.15.146:0/1648135231 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:13:56.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.070+0000 7f16eb7fe700 1 --1- 172.21.15.146:0/1648135231 >> v1:172.21.15.146:6789/0 conn(0x7f16ec0ca070 0x7f16ec0cc240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:37672/0 (socket says 172.21.15.146:37672) 2023-10-06T11:13:56.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.070+0000 7f16e3fff700 1 -- 172.21.15.146:0/1648135231 >> v1:172.21.15.151:6789/0 conn(0x7f16ec157430 legacy=0x7f16ec0ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:56.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.070+0000 7f16e3fff700 1 -- 172.21.15.146:0/1648135231 >> v1:172.21.15.146:6789/0 conn(0x7f16ec0ca070 legacy=0x7f16ec0cc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:56.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.070+0000 7f16ea7fc700 1 -- 172.21.15.146:0/1648135231 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2874492237 0 0) 0x7f16ec0cd200 con 0x7f16ec157430 2023-10-06T11:13:56.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.070+0000 7f16e3fff700 1 -- 172.21.15.146:0/1648135231 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ec0cd4e0 con 0x7f16ec0ab010 2023-10-06T11:13:56.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.070+0000 7f16e3fff700 1 --2- 172.21.15.146:0/1648135231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16ec0ab010 0x7f16ec157800 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f16d40098e0 tx=0x7f16d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bfdcede383b6f3f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:56.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.070+0000 7f16ea7fc700 1 -- 172.21.15.146:0/1648135231 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d4009e80 con 0x7f16ec0ab010 2023-10-06T11:13:56.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.070+0000 7f16ea7fc700 1 -- 172.21.15.146:0/1648135231 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d400b860 con 0x7f16ec0ab010 2023-10-06T11:13:56.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.070+0000 7f16ea7fc700 1 -- 172.21.15.146:0/1648135231 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d400bbe0 con 0x7f16ec0ab010 2023-10-06T11:13:56.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.071+0000 7f16f1707700 1 -- 172.21.15.146:0/1648135231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16ec0ab010 msgr2=0x7f16ec157800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:56.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.071+0000 7f16f1707700 1 --2- 172.21.15.146:0/1648135231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16ec0ab010 0x7f16ec157800 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f16d40098e0 tx=0x7f16d40091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:56.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.071+0000 7f16f1707700 1 -- 172.21.15.146:0/1648135231 shutdown_connections 2023-10-06T11:13:56.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.071+0000 7f16f1707700 1 --2- 172.21.15.146:0/1648135231 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16ec0ab010 0x7f16ec157800 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:56.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.071+0000 7f16f1707700 1 -- 172.21.15.146:0/1648135231 >> 172.21.15.146:0/1648135231 conn(0x7f16ec067c50 msgr2=0x7f16ec0ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:56.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.071+0000 7f16f1707700 1 -- 172.21.15.146:0/1648135231 shutdown_connections 2023-10-06T11:13:56.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.071+0000 7f16f1707700 1 -- 172.21.15.146:0/1648135231 wait complete. 2023-10-06T11:13:56.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.072+0000 7f16f1707700 1 Processor -- start 2023-10-06T11:13:56.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.072+0000 7f16f1707700 1 -- start start 2023-10-06T11:13:56.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.073+0000 7f16f1707700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16ec0ab010 0x7f16ec14d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:56.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.073+0000 7f16f1707700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16ec0ca070 0x7f16ec15c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:56.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.073+0000 7f16f1707700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16ec157430 0x7f16ec15d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:56.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.073+0000 7f16f1707700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec158780 con 0x7f16ec0ca070 2023-10-06T11:13:56.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.073+0000 7f16f1707700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec14da90 con 0x7f16ec0ab010 2023-10-06T11:13:56.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.073+0000 7f16f1707700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16ec157b70 con 0x7f16ec157430 2023-10-06T11:13:56.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.073+0000 7f16e3fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16ec0ca070 0x7f16ec15c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:56.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.073+0000 7f16e3fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16ec0ca070 0x7f16ec15c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47184/0 (socket says 172.21.15.146:47184) 2023-10-06T11:13:56.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.073+0000 7f16e3fff700 1 -- 172.21.15.146:0/4190821352 learned_addr learned my addr 172.21.15.146:0/4190821352 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:56.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.073+0000 7f16eaffd700 1 --2- 172.21.15.146:0/4190821352 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16ec0ab010 0x7f16ec14d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:56.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.073+0000 7f16eb7fe700 1 --2- 172.21.15.146:0/4190821352 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16ec157430 0x7f16ec15d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:56.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.073+0000 7f16e3fff700 1 -- 172.21.15.146:0/4190821352 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16ec157430 msgr2=0x7f16ec15d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:56.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.073+0000 7f16e3fff700 1 --2- 172.21.15.146:0/4190821352 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16ec157430 0x7f16ec15d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:56.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.073+0000 7f16e3fff700 1 -- 172.21.15.146:0/4190821352 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16ec0ab010 msgr2=0x7f16ec14d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:56.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.073+0000 7f16e3fff700 1 --2- 172.21.15.146:0/4190821352 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16ec0ab010 0x7f16ec14d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:56.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.073+0000 7f16e3fff700 1 -- 172.21.15.146:0/4190821352 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d4009420 con 0x7f16ec0ca070 2023-10-06T11:13:56.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.073+0000 7f16eaffd700 1 --2- 172.21.15.146:0/4190821352 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16ec0ab010 0x7f16ec14d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:56.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.073+0000 7f16e3fff700 1 --2- 172.21.15.146:0/4190821352 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16ec0ca070 0x7f16ec15c6c0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f16ec06e410 tx=0x7f16d4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:56.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.074+0000 7f16e2ffd700 1 -- 172.21.15.146:0/4190821352 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d401f070 con 0x7f16ec0ca070 2023-10-06T11:13:56.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.074+0000 7f16e2ffd700 1 -- 172.21.15.146:0/4190821352 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d4000c90 con 0x7f16ec0ca070 2023-10-06T11:13:56.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.074+0000 7f16e2ffd700 1 -- 172.21.15.146:0/4190821352 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d4025420 con 0x7f16ec0ca070 2023-10-06T11:13:56.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.074+0000 7f16f1707700 1 -- 172.21.15.146:0/4190821352 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16ec157e50 con 0x7f16ec0ca070 2023-10-06T11:13:56.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.074+0000 7f16f1707700 1 -- 172.21.15.146:0/4190821352 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16ec158410 con 0x7f16ec0ca070 2023-10-06T11:13:56.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.074+0000 7f16f1707700 1 -- 172.21.15.146:0/4190821352 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16ec04c380 con 0x7f16ec0ca070 2023-10-06T11:13:56.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.075+0000 7f16e2ffd700 1 -- 172.21.15.146:0/4190821352 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f16d4023070 con 0x7f16ec0ca070 2023-10-06T11:13:56.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.075+0000 7f16e2ffd700 1 --2- 172.21.15.146:0/4190821352 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f16cc066f30 0x7f16cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:56.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.075+0000 7f16e2ffd700 1 -- 172.21.15.146:0/4190821352 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f16d4085bb0 con 0x7f16ec0ca070 2023-10-06T11:13:56.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.075+0000 7f16eaffd700 1 --2- 172.21.15.146:0/4190821352 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f16cc066f30 0x7f16cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:56.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.076+0000 7f16eaffd700 1 --2- 172.21.15.146:0/4190821352 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f16cc066f30 0x7f16cc0693e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f16dc001890 tx=0x7f16dc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:56.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.080+0000 7f16e2ffd700 1 -- 172.21.15.146:0/4190821352 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f16d4052d00 con 0x7f16ec0ca070 2023-10-06T11:13:56.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.337+0000 7f16f1707700 1 -- 172.21.15.146:0/4190821352 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f16ec1585a0 con 0x7f16ec0ca070 2023-10-06T11:13:56.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.338+0000 7f16e2ffd700 1 -- 172.21.15.146:0/4190821352 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1447 (secure 0 0 0) 0x7f16d40155c0 con 0x7f16ec0ca070 2023-10-06T11:13:56.340 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:13:56.340 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":510,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":101,"num_osds":8,"num_up_osds":8,"osd_up_since":1696590336,"num_in_osds":8,"osd_in_since":1696590327,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":936,"data_bytes":959207412,"bytes_used":4354408448,"bytes_avail":768739704832,"bytes_total":773094113280,"write_bytes_sec":60461499,"read_op_per_sec":0,"write_op_per_sec":58},"fsmap":{"epoch":93,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":7620}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":18,"modified":"2023-10-06T11:13:19.237978+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T11:13:56.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.340+0000 7f16f1707700 1 -- 172.21.15.146:0/4190821352 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f16cc066f30 msgr2=0x7f16cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:56.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.340+0000 7f16f1707700 1 --2- 172.21.15.146:0/4190821352 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f16cc066f30 0x7f16cc0693e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f16dc001890 tx=0x7f16dc009040 comp rx=0 tx=0).stop 2023-10-06T11:13:56.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.340+0000 7f16f1707700 1 -- 172.21.15.146:0/4190821352 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16ec0ca070 msgr2=0x7f16ec15c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:56.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.340+0000 7f16f1707700 1 --2- 172.21.15.146:0/4190821352 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16ec0ca070 0x7f16ec15c6c0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f16ec06e410 tx=0x7f16d4017000 comp rx=0 tx=0).stop 2023-10-06T11:13:56.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.340+0000 7f16f1707700 1 -- 172.21.15.146:0/4190821352 shutdown_connections 2023-10-06T11:13:56.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.340+0000 7f16f1707700 1 --2- 172.21.15.146:0/4190821352 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f16cc066f30 0x7f16cc0693e0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:56.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.340+0000 7f16f1707700 1 --2- 172.21.15.146:0/4190821352 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f16ec157430 0x7f16ec15d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:56.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.340+0000 7f16f1707700 1 --2- 172.21.15.146:0/4190821352 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16ec0ab010 0x7f16ec14d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:56.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.340+0000 7f16f1707700 1 --2- 172.21.15.146:0/4190821352 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f16ec0ca070 0x7f16ec15c6c0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:56.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.340+0000 7f16f1707700 1 -- 172.21.15.146:0/4190821352 >> 172.21.15.146:0/4190821352 conn(0x7f16ec067c50 msgr2=0x7f16ec0ce420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:56.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.340+0000 7f16f1707700 1 -- 172.21.15.146:0/4190821352 shutdown_connections 2023-10-06T11:13:56.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:56.340+0000 7f16f1707700 1 -- 172.21.15.146:0/4190821352 wait complete. 2023-10-06T11:13:56.353 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2023-10-06T11:13:57.354 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:13:57.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.472+0000 7f356f98f700 1 Processor -- start 2023-10-06T11:13:57.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.472+0000 7f356f98f700 1 -- start start 2023-10-06T11:13:57.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.473+0000 7f356f98f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3568153ab0 0x7f356815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:57.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.473+0000 7f356f98f700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3568153e80 0x7f3568068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:57.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.473+0000 7f356f98f700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f356815ac30 con 0x7f35680689d0 2023-10-06T11:13:57.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.473+0000 7f356f98f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35680b4510 con 0x7f3568153ab0 2023-10-06T11:13:57.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.473+0000 7f356f98f700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35680b6530 con 0x7f3568153e80 2023-10-06T11:13:57.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.473+0000 7f356d72b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3568153ab0 0x7f356815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:57.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.473+0000 7f356d72b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3568153ab0 0x7f356815a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47196/0 (socket says 172.21.15.146:47196) 2023-10-06T11:13:57.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.473+0000 7f356d72b700 1 -- 172.21.15.146:0/409451862 learned_addr learned my addr 172.21.15.146:0/409451862 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:57.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.473+0000 7f356cf2a700 1 --2- 172.21.15.146:0/409451862 >> v2:172.21.15.151:3300/0 conn(0x7f3568153e80 0x7f3568068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:57.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.473+0000 7f356d72b700 1 -- 172.21.15.146:0/409451862 >> v2:172.21.15.151:3300/0 conn(0x7f3568153e80 msgr2=0x7f3568068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:57.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.473+0000 7f356d72b700 1 --2- 172.21.15.146:0/409451862 >> v2:172.21.15.151:3300/0 conn(0x7f3568153e80 0x7f3568068490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:57.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.473+0000 7f356d72b700 1 -- 172.21.15.146:0/409451862 >> v1:172.21.15.151:6789/0 conn(0x7f35680689d0 legacy=0x7f356815d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:57.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.473+0000 7f356d72b700 1 -- 172.21.15.146:0/409451862 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3568068dd0 con 0x7f3568153ab0 2023-10-06T11:13:57.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.473+0000 7f356cf2a700 1 --2- 172.21.15.146:0/409451862 >> v2:172.21.15.151:3300/0 conn(0x7f3568153e80 0x7f3568068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:57.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.473+0000 7f356d72b700 1 --2- 172.21.15.146:0/409451862 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3568153ab0 0x7f356815a6f0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f3568089770 tx=0x7f3564009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ff22deb898327c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:57.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.473+0000 7f355ffff700 1 -- 172.21.15.146:0/409451862 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356400b820 con 0x7f3568153ab0 2023-10-06T11:13:57.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.474+0000 7f355ffff700 1 -- 172.21.15.146:0/409451862 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356400b980 con 0x7f3568153ab0 2023-10-06T11:13:57.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.474+0000 7f355ffff700 1 -- 172.21.15.146:0/409451862 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356400bd20 con 0x7f3568153ab0 2023-10-06T11:13:57.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.474+0000 7f356f98f700 1 -- 172.21.15.146:0/409451862 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3568153ab0 msgr2=0x7f356815a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:57.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.474+0000 7f356f98f700 1 --2- 172.21.15.146:0/409451862 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3568153ab0 0x7f356815a6f0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f3568089770 tx=0x7f3564009250 comp rx=0 tx=0).stop 2023-10-06T11:13:57.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.474+0000 7f356f98f700 1 -- 172.21.15.146:0/409451862 shutdown_connections 2023-10-06T11:13:57.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.474+0000 7f356f98f700 1 --2- 172.21.15.146:0/409451862 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3568153ab0 0x7f356815a6f0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:57.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.474+0000 7f356f98f700 1 --2- 172.21.15.146:0/409451862 >> v2:172.21.15.151:3300/0 conn(0x7f3568153e80 0x7f3568068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:57.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.474+0000 7f356f98f700 1 -- 172.21.15.146:0/409451862 >> 172.21.15.146:0/409451862 conn(0x7f356806eba0 msgr2=0x7f356806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:57.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.474+0000 7f356f98f700 1 -- 172.21.15.146:0/409451862 shutdown_connections 2023-10-06T11:13:57.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.474+0000 7f356f98f700 1 -- 172.21.15.146:0/409451862 wait complete. 2023-10-06T11:13:57.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.475+0000 7f356f98f700 1 Processor -- start 2023-10-06T11:13:57.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.475+0000 7f356f98f700 1 -- start start 2023-10-06T11:13:57.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.476+0000 7f356f98f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35680689d0 0x7f3568159690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:57.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.476+0000 7f356f98f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3568153ab0 0x7f3568154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:57.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.476+0000 7f356f98f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3568153e80 0x7f3568157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:57.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.476+0000 7f356f98f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3568155ee0 con 0x7f35680689d0 2023-10-06T11:13:57.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.476+0000 7f356f98f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3568156a60 con 0x7f3568153ab0 2023-10-06T11:13:57.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.476+0000 7f356f98f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3568155080 con 0x7f3568153e80 2023-10-06T11:13:57.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.476+0000 7f356d72b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35680689d0 0x7f3568159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:57.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.476+0000 7f356d72b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35680689d0 0x7f3568159690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47210/0 (socket says 172.21.15.146:47210) 2023-10-06T11:13:57.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.476+0000 7f356d72b700 1 -- 172.21.15.146:0/3384937504 learned_addr learned my addr 172.21.15.146:0/3384937504 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:57.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.476+0000 7f356cf2a700 1 --2- 172.21.15.146:0/3384937504 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3568153ab0 0x7f3568154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:57.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.476+0000 7f356d72b700 1 -- 172.21.15.146:0/3384937504 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3568153e80 msgr2=0x7f3568157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:57.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.476+0000 7f356d72b700 1 --2- 172.21.15.146:0/3384937504 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3568153e80 0x7f3568157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:57.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.476+0000 7f356d72b700 1 -- 172.21.15.146:0/3384937504 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3568153ab0 msgr2=0x7f3568154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:57.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.476+0000 7f356d72b700 1 --2- 172.21.15.146:0/3384937504 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3568153ab0 0x7f3568154b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:57.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.476+0000 7f356d72b700 1 -- 172.21.15.146:0/3384937504 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35640094f0 con 0x7f35680689d0 2023-10-06T11:13:57.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.476+0000 7f356cf2a700 1 --2- 172.21.15.146:0/3384937504 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3568153ab0 0x7f3568154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:57.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.477+0000 7f356d72b700 1 --2- 172.21.15.146:0/3384937504 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35680689d0 0x7f3568159690 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f35640030c0 tx=0x7f3564016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:57.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.477+0000 7f355d7fa700 1 -- 172.21.15.146:0/3384937504 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3564011e60 con 0x7f35680689d0 2023-10-06T11:13:57.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.477+0000 7f355d7fa700 1 -- 172.21.15.146:0/3384937504 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3564020070 con 0x7f35680689d0 2023-10-06T11:13:57.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.477+0000 7f356f98f700 1 -- 172.21.15.146:0/3384937504 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3568156130 con 0x7f35680689d0 2023-10-06T11:13:57.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.477+0000 7f355d7fa700 1 -- 172.21.15.146:0/3384937504 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356401b6a0 con 0x7f35680689d0 2023-10-06T11:13:57.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.477+0000 7f356f98f700 1 -- 172.21.15.146:0/3384937504 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35681566f0 con 0x7f35680689d0 2023-10-06T11:13:57.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.478+0000 7f356f98f700 1 -- 172.21.15.146:0/3384937504 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f356804c380 con 0x7f35680689d0 2023-10-06T11:13:57.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.478+0000 7f355d7fa700 1 -- 172.21.15.146:0/3384937504 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3564022030 con 0x7f35680689d0 2023-10-06T11:13:57.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.479+0000 7f355d7fa700 1 --2- 172.21.15.146:0/3384937504 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f354c066f30 0x7f354c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:57.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.479+0000 7f356cf2a700 1 --2- 172.21.15.146:0/3384937504 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f354c066f30 0x7f354c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:57.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.479+0000 7f355d7fa700 1 -- 172.21.15.146:0/3384937504 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f35640864d0 con 0x7f35680689d0 2023-10-06T11:13:57.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.479+0000 7f356cf2a700 1 --2- 172.21.15.146:0/3384937504 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f354c066f30 0x7f354c0693e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f35681548b0 tx=0x7f3558008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:57.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.483+0000 7f355d7fa700 1 -- 172.21.15.146:0/3384937504 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f35640535e0 con 0x7f35680689d0 2023-10-06T11:13:57.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.708+0000 7f356f98f700 1 -- 172.21.15.146:0/3384937504 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f356815ac30 con 0x7f35680689d0 2023-10-06T11:13:57.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.709+0000 7f355d7fa700 1 -- 172.21.15.146:0/3384937504 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f356815ac30 con 0x7f35680689d0 2023-10-06T11:13:57.711 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:13:57.711 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":93,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/2159562091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2159562091},{"type":"v1","addr":"172.21.15.151:6834","nonce":2159562091}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6242,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/603782012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":603782012},{"type":"v1","addr":"172.21.15.151:6835","nonce":603782012}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6916,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3416056259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3416056259},{"type":"v1","addr":"172.21.15.146:6837","nonce":3416056259}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:13:30.345795+0000","modified":"2023-10-06T11:13:33.984549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7620":{"gid":7620,"name":"c","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/785131800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":785131800},{"type":"v1","addr":"172.21.15.146:6835","nonce":785131800}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T11:13:57.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.711+0000 7f356f98f700 1 -- 172.21.15.146:0/3384937504 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f354c066f30 msgr2=0x7f354c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:57.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.711+0000 7f356f98f700 1 --2- 172.21.15.146:0/3384937504 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f354c066f30 0x7f354c0693e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f35681548b0 tx=0x7f3558008040 comp rx=0 tx=0).stop 2023-10-06T11:13:57.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.711+0000 7f356f98f700 1 -- 172.21.15.146:0/3384937504 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35680689d0 msgr2=0x7f3568159690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:57.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.711+0000 7f356f98f700 1 --2- 172.21.15.146:0/3384937504 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35680689d0 0x7f3568159690 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f35640030c0 tx=0x7f3564016000 comp rx=0 tx=0).stop 2023-10-06T11:13:57.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.711+0000 7f356f98f700 1 -- 172.21.15.146:0/3384937504 shutdown_connections 2023-10-06T11:13:57.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.711+0000 7f356f98f700 1 --2- 172.21.15.146:0/3384937504 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f354c066f30 0x7f354c0693e0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:57.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.711+0000 7f356f98f700 1 --2- 172.21.15.146:0/3384937504 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3568153e80 0x7f3568157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:57.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.711+0000 7f356f98f700 1 --2- 172.21.15.146:0/3384937504 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f35680689d0 0x7f3568159690 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:57.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.711+0000 7f356f98f700 1 --2- 172.21.15.146:0/3384937504 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3568153ab0 0x7f3568154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:57.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.711+0000 7f356f98f700 1 -- 172.21.15.146:0/3384937504 >> 172.21.15.146:0/3384937504 conn(0x7f356806eba0 msgr2=0x7f356815add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:57.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.711+0000 7f356f98f700 1 -- 172.21.15.146:0/3384937504 shutdown_connections 2023-10-06T11:13:57.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.711+0000 7f356f98f700 1 -- 172.21.15.146:0/3384937504 wait complete. 2023-10-06T11:13:57.714 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 93 2023-10-06T11:13:57.725 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2023-10-06T11:13:57.725 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T11:13:57.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.836+0000 7f3dfffff700 1 Processor -- start 2023-10-06T11:13:57.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.836+0000 7f3dfffff700 1 -- start start 2023-10-06T11:13:57.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.837+0000 7f3dfffff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3e0015a7f0 0x7f3e0015cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:57.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.837+0000 7f3dfffff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e0015c630 con 0x7f3e000b2530 2023-10-06T11:13:57.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.837+0000 7f3dfffff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e0015ba20 con 0x7f3e0015a420 2023-10-06T11:13:57.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.837+0000 7f3dfffff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e000ce040 con 0x7f3e0015a7f0 2023-10-06T11:13:57.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.837+0000 7f3dff7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3e000b2530 0x7f3e0015acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:37674/0 (socket says 172.21.15.146:37674) 2023-10-06T11:13:57.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.837+0000 7f3dff7fe700 1 -- 172.21.15.146:0/1254748475 learned_addr learned my addr 172.21.15.146:0/1254748475 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:13:57.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.837+0000 7f3dfdffb700 1 -- 172.21.15.146:0/1254748475 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2330387935 0 0) 0x7f3e0015c630 con 0x7f3e000b2530 2023-10-06T11:13:57.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.837+0000 7f3dfdffb700 1 -- 172.21.15.146:0/1254748475 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dec003570 con 0x7f3e000b2530 2023-10-06T11:13:57.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.837+0000 7f3dfe7fc700 1 --2- 172.21.15.146:0/1254748475 >> v2:172.21.15.151:3300/0 conn(0x7f3e0015a7f0 0x7f3e0015cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:57.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.838+0000 7f3dfdffb700 1 -- 172.21.15.146:0/1254748475 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 868974903 0 0) 0x7f3dec003570 con 0x7f3e000b2530 2023-10-06T11:13:57.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.838+0000 7f3dfdffb700 1 -- 172.21.15.146:0/1254748475 >> v2:172.21.15.151:3300/0 conn(0x7f3e0015a7f0 msgr2=0x7f3e0015cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:57.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.838+0000 7f3dfdffb700 1 --2- 172.21.15.146:0/1254748475 >> v2:172.21.15.151:3300/0 conn(0x7f3e0015a7f0 0x7f3e0015cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:57.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.838+0000 7f3dfdffb700 1 -- 172.21.15.146:0/1254748475 >> v1:172.21.15.151:6789/0 conn(0x7f3e0015a420 legacy=0x7f3e000b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:57.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.838+0000 7f3dfdffb700 1 -- 172.21.15.146:0/1254748475 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e0015bd00 con 0x7f3e000b2530 2023-10-06T11:13:57.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.838+0000 7f3dfdffb700 1 -- 172.21.15.146:0/1254748475 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f3df8001470 con 0x7f3e000b2530 2023-10-06T11:13:57.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.838+0000 7f3dfdffb700 1 -- 172.21.15.146:0/1254748475 >> v1:172.21.15.146:6789/0 conn(0x7f3e000b2530 legacy=0x7f3e0015acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:57.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.838+0000 7f3dfdffb700 1 --2- 172.21.15.146:0/1254748475 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dec003a60 0x7f3dec003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:57.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.838+0000 7f3dfdffb700 1 --2- 172.21.15.146:0/1254748475 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3dec004810 0x7f3dec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:57.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.838+0000 7f3dfdffb700 1 --2- 172.21.15.146:0/1254748475 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3dec0051c0 0x7f3dec00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:57.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.838+0000 7f3dfdffb700 1 -- 172.21.15.146:0/1254748475 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec00c0a0 con 0x7f3dec003a60 2023-10-06T11:13:57.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.838+0000 7f3dfdffb700 1 -- 172.21.15.146:0/1254748475 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec00c210 con 0x7f3dec004810 2023-10-06T11:13:57.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.838+0000 7f3dfdffb700 1 -- 172.21.15.146:0/1254748475 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec00c3d0 con 0x7f3dec0051c0 2023-10-06T11:13:57.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.838+0000 7f3dfeffd700 1 --2- 172.21.15.146:0/1254748475 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dec003a60 0x7f3dec003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:57.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.838+0000 7f3dfe7fc700 1 --2- 172.21.15.146:0/1254748475 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3dec004810 0x7f3dec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:57.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.838+0000 7f3dff7fe700 1 --2- 172.21.15.146:0/1254748475 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3dec0051c0 0x7f3dec00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:57.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.838+0000 7f3dfeffd700 1 -- 172.21.15.146:0/1254748475 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3dec0051c0 msgr2=0x7f3dec00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:57.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.838+0000 7f3dfeffd700 1 --2- 172.21.15.146:0/1254748475 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3dec0051c0 0x7f3dec00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:57.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.838+0000 7f3dfeffd700 1 -- 172.21.15.146:0/1254748475 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3dec004810 msgr2=0x7f3dec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:57.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.838+0000 7f3dfeffd700 1 --2- 172.21.15.146:0/1254748475 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3dec004810 0x7f3dec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:57.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.838+0000 7f3dfeffd700 1 -- 172.21.15.146:0/1254748475 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dec003570 con 0x7f3dec003a60 2023-10-06T11:13:57.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.838+0000 7f3dff7fe700 1 --2- 172.21.15.146:0/1254748475 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3dec0051c0 0x7f3dec00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:57.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.838+0000 7f3dff7fe700 1 -- 172.21.15.146:0/1254748475 reap_dead start 2023-10-06T11:13:57.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.838+0000 7f3dfeffd700 1 --2- 172.21.15.146:0/1254748475 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dec003a60 0x7f3dec003e70 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f3df0001fc0 tx=0x7f3df0001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21d1354254bad110 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:57.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.838+0000 7f3dfdffb700 1 -- 172.21.15.146:0/1254748475 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df0001950 con 0x7f3dec003a60 2023-10-06T11:13:57.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.838+0000 7f3dfdffb700 1 -- 172.21.15.146:0/1254748475 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df000c8b0 con 0x7f3dec003a60 2023-10-06T11:13:57.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.838+0000 7f3dfdffb700 1 -- 172.21.15.146:0/1254748475 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df000cc50 con 0x7f3dec003a60 2023-10-06T11:13:57.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.839+0000 7f3dfffff700 1 -- 172.21.15.146:0/1254748475 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dec003a60 msgr2=0x7f3dec003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:57.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.839+0000 7f3dfffff700 1 --2- 172.21.15.146:0/1254748475 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dec003a60 0x7f3dec003e70 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f3df0001fc0 tx=0x7f3df0001640 comp rx=0 tx=0).stop 2023-10-06T11:13:57.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.839+0000 7f3dfffff700 1 -- 172.21.15.146:0/1254748475 shutdown_connections 2023-10-06T11:13:57.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.839+0000 7f3dfffff700 1 --2- 172.21.15.146:0/1254748475 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dec003a60 0x7f3dec003e70 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:57.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.839+0000 7f3dfffff700 1 -- 172.21.15.146:0/1254748475 >> 172.21.15.146:0/1254748475 conn(0x7f3e0006eba0 msgr2=0x7f3e0006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:57.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.839+0000 7f3dfffff700 1 -- 172.21.15.146:0/1254748475 shutdown_connections 2023-10-06T11:13:57.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.839+0000 7f3dfffff700 1 -- 172.21.15.146:0/1254748475 wait complete. 2023-10-06T11:13:57.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.840+0000 7f3dfffff700 1 Processor -- start 2023-10-06T11:13:57.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.840+0000 7f3dfffff700 1 -- start start 2023-10-06T11:13:57.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.841+0000 7f3dfffff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3dec003a60 0x7f3e00143840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:57.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.841+0000 7f3dfffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e00143d80 0x7f3e000b1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:57.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.841+0000 7f3dfffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e000d0550 0x7f3e000b1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:57.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.841+0000 7f3dfffff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e00153740 con 0x7f3e00143d80 2023-10-06T11:13:57.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.841+0000 7f3dfffff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e00151ca0 con 0x7f3e000d0550 2023-10-06T11:13:57.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.841+0000 7f3dfffff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e00144410 con 0x7f3dec003a60 2023-10-06T11:13:57.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.841+0000 7f3dfe7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e00143d80 0x7f3e000b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:57.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.841+0000 7f3dfe7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e00143d80 0x7f3e000b1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47238/0 (socket says 172.21.15.146:47238) 2023-10-06T11:13:57.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.841+0000 7f3dfe7fc700 1 -- 172.21.15.146:0/890009686 learned_addr learned my addr 172.21.15.146:0/890009686 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:57.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.841+0000 7f3dff7fe700 1 --2- 172.21.15.146:0/890009686 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e000d0550 0x7f3e000b1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:57.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.841+0000 7f3dfeffd700 1 --2- 172.21.15.146:0/890009686 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3dec003a60 0x7f3e00143840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:57.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.841+0000 7f3dfe7fc700 1 -- 172.21.15.146:0/890009686 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3dec003a60 msgr2=0x7f3e00143840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:57.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.841+0000 7f3dfe7fc700 1 --2- 172.21.15.146:0/890009686 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3dec003a60 0x7f3e00143840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:57.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.841+0000 7f3dfe7fc700 1 -- 172.21.15.146:0/890009686 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e000d0550 msgr2=0x7f3e000b1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:57.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.841+0000 7f3dfe7fc700 1 --2- 172.21.15.146:0/890009686 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e000d0550 0x7f3e000b1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:57.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.841+0000 7f3dfe7fc700 1 -- 172.21.15.146:0/890009686 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e00151090 con 0x7f3e00143d80 2023-10-06T11:13:57.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.841+0000 7f3dfeffd700 1 --2- 172.21.15.146:0/890009686 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3dec003a60 0x7f3e00143840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:57.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.841+0000 7f3dfe7fc700 1 --2- 172.21.15.146:0/890009686 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e00143d80 0x7f3e000b1790 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f3de8011a10 tx=0x7f3de80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:57.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.842+0000 7f3df6ffd700 1 -- 172.21.15.146:0/890009686 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de800f940 con 0x7f3e00143d80 2023-10-06T11:13:57.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.842+0000 7f3df6ffd700 1 -- 172.21.15.146:0/890009686 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de800faa0 con 0x7f3e00143d80 2023-10-06T11:13:57.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.842+0000 7f3dfffff700 1 -- 172.21.15.146:0/890009686 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e00151370 con 0x7f3e00143d80 2023-10-06T11:13:57.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.842+0000 7f3df6ffd700 1 -- 172.21.15.146:0/890009686 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de800fe20 con 0x7f3e00143d80 2023-10-06T11:13:57.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.842+0000 7f3dfffff700 1 -- 172.21.15.146:0/890009686 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e00151930 con 0x7f3e00143d80 2023-10-06T11:13:57.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.843+0000 7f3dfffff700 1 -- 172.21.15.146:0/890009686 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e00151e30 con 0x7f3e00143d80 2023-10-06T11:13:57.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.843+0000 7f3df6ffd700 1 -- 172.21.15.146:0/890009686 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3de8014650 con 0x7f3e00143d80 2023-10-06T11:13:57.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.843+0000 7f3df6ffd700 1 --2- 172.21.15.146:0/890009686 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3de0066f30 0x7f3de00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:57.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.844+0000 7f3df6ffd700 1 -- 172.21.15.146:0/890009686 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3de8018030 con 0x7f3e00143d80 2023-10-06T11:13:57.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.844+0000 7f3dfeffd700 1 --2- 172.21.15.146:0/890009686 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3de0066f30 0x7f3de00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:57.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.844+0000 7f3dfeffd700 1 --2- 172.21.15.146:0/890009686 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3de0066f30 0x7f3de00693e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f3e000cfbe0 tx=0x7f3df0015000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:57.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:57.848+0000 7f3df6ffd700 1 -- 172.21.15.146:0/890009686 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3de8052140 con 0x7f3e00143d80 2023-10-06T11:13:58.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.112+0000 7f3dfffff700 1 -- 172.21.15.146:0/890009686 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f3e000b02b0 con 0x7f3e00143d80 2023-10-06T11:13:58.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.113+0000 7f3df6ffd700 1 -- 172.21.15.146:0/890009686 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1602 (secure 0 0 0) 0x7f3de8022660 con 0x7f3e00143d80 2023-10-06T11:13:58.115 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:13:58.115 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":512,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":101,"num_osds":8,"num_up_osds":8,"osd_up_since":1696590336,"num_in_osds":8,"osd_in_since":1696590327,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":1035,"data_bytes":1045190644,"bytes_used":4581130240,"bytes_avail":768512983040,"bytes_total":773094113280,"write_bytes_sec":67652505,"read_op_per_sec":0,"write_op_per_sec":141},"fsmap":{"epoch":93,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":7620}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":19,"modified":"2023-10-06T11:13:57.245589+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T11:13:58.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.115+0000 7f3dfffff700 1 -- 172.21.15.146:0/890009686 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3de0066f30 msgr2=0x7f3de00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.115+0000 7f3dfffff700 1 --2- 172.21.15.146:0/890009686 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3de0066f30 0x7f3de00693e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f3e000cfbe0 tx=0x7f3df0015000 comp rx=0 tx=0).stop 2023-10-06T11:13:58.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.115+0000 7f3dfffff700 1 -- 172.21.15.146:0/890009686 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e00143d80 msgr2=0x7f3e000b1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.115+0000 7f3dfffff700 1 --2- 172.21.15.146:0/890009686 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e00143d80 0x7f3e000b1790 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f3de8011a10 tx=0x7f3de80091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.115+0000 7f3dfffff700 1 -- 172.21.15.146:0/890009686 shutdown_connections 2023-10-06T11:13:58.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.115+0000 7f3dfffff700 1 --2- 172.21.15.146:0/890009686 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3de0066f30 0x7f3de00693e0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.115+0000 7f3dfffff700 1 --2- 172.21.15.146:0/890009686 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e000d0550 0x7f3e000b1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.115+0000 7f3dfffff700 1 --2- 172.21.15.146:0/890009686 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3dec003a60 0x7f3e00143840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.115+0000 7f3dfffff700 1 --2- 172.21.15.146:0/890009686 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3e00143d80 0x7f3e000b1790 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.115+0000 7f3dfffff700 1 -- 172.21.15.146:0/890009686 >> 172.21.15.146:0/890009686 conn(0x7f3e0006eba0 msgr2=0x7f3e00144780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:58.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.115+0000 7f3dfffff700 1 -- 172.21.15.146:0/890009686 shutdown_connections 2023-10-06T11:13:58.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.115+0000 7f3dfffff700 1 -- 172.21.15.146:0/890009686 wait complete. 2023-10-06T11:13:58.128 INFO:tasks.cephfs.filesystem.ceph_manager:{'c': 'paused'} 2023-10-06T11:13:58.129 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 scrub resume 2023-10-06T11:13:58.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.243+0000 7fbcf1cb0700 1 Processor -- start 2023-10-06T11:13:58.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.244+0000 7fbcf1cb0700 1 -- start start 2023-10-06T11:13:58.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.244+0000 7fbcf1cb0700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbcec0b2620 0x7fbcec06e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.244+0000 7fbcf1cb0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbcec1571d0 0x7fbcec157630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.244+0000 7fbcf1cb0700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcec0cb3c0 con 0x7fbcec0b29f0 2023-10-06T11:13:58.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.244+0000 7fbcf1cb0700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcec06fa70 con 0x7fbcec1571d0 2023-10-06T11:13:58.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.244+0000 7fbcf1cb0700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcec157b70 con 0x7fbcec0b2620 2023-10-06T11:13:58.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.244+0000 7fbcebfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbcec1571d0 0x7fbcec157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.245+0000 7fbcebfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbcec1571d0 0x7fbcec157630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47246/0 (socket says 172.21.15.146:47246) 2023-10-06T11:13:58.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.245+0000 7fbcebfff700 1 -- 172.21.15.146:0/2940252524 learned_addr learned my addr 172.21.15.146:0/2940252524 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:58.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.245+0000 7fbceb7fe700 1 --2- 172.21.15.146:0/2940252524 >> v2:172.21.15.151:3300/0 conn(0x7fbcec0b2620 0x7fbcec06e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.245+0000 7fbcebfff700 1 -- 172.21.15.146:0/2940252524 >> v2:172.21.15.151:3300/0 conn(0x7fbcec0b2620 msgr2=0x7fbcec06e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:58.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.245+0000 7fbcebfff700 1 --2- 172.21.15.146:0/2940252524 >> v2:172.21.15.151:3300/0 conn(0x7fbcec0b2620 0x7fbcec06e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.245+0000 7fbcebfff700 1 -- 172.21.15.146:0/2940252524 >> v1:172.21.15.151:6789/0 conn(0x7fbcec0b29f0 legacy=0x7fbcec15bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.245+0000 7fbcebfff700 1 -- 172.21.15.146:0/2940252524 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcec06eef0 con 0x7fbcec1571d0 2023-10-06T11:13:58.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.245+0000 7fbcebfff700 1 --2- 172.21.15.146:0/2940252524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcec1571d0 0x7fbcec157630 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fbcec0ce410 tx=0x7fbce4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2153a8d971f8f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:58.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.245+0000 7fbcea7fc700 1 -- 172.21.15.146:0/2940252524 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce4009e70 con 0x7fbcec1571d0 2023-10-06T11:13:58.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.245+0000 7fbcea7fc700 1 -- 172.21.15.146:0/2940252524 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce400b860 con 0x7fbcec1571d0 2023-10-06T11:13:58.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.245+0000 7fbcea7fc700 1 -- 172.21.15.146:0/2940252524 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce400bc00 con 0x7fbcec1571d0 2023-10-06T11:13:58.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.246+0000 7fbcf1cb0700 1 -- 172.21.15.146:0/2940252524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcec1571d0 msgr2=0x7fbcec157630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.246+0000 7fbcf1cb0700 1 --2- 172.21.15.146:0/2940252524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcec1571d0 0x7fbcec157630 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fbcec0ce410 tx=0x7fbce4009250 comp rx=0 tx=0).stop 2023-10-06T11:13:58.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.246+0000 7fbcf1cb0700 1 -- 172.21.15.146:0/2940252524 shutdown_connections 2023-10-06T11:13:58.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.246+0000 7fbcf1cb0700 1 --2- 172.21.15.146:0/2940252524 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcec1571d0 0x7fbcec157630 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.246+0000 7fbcf1cb0700 1 --2- 172.21.15.146:0/2940252524 >> v2:172.21.15.151:3300/0 conn(0x7fbcec0b2620 0x7fbcec06e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.246+0000 7fbcf1cb0700 1 -- 172.21.15.146:0/2940252524 >> 172.21.15.146:0/2940252524 conn(0x7fbcec068580 msgr2=0x7fbcec068980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:58.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.246+0000 7fbcf1cb0700 1 -- 172.21.15.146:0/2940252524 shutdown_connections 2023-10-06T11:13:58.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.246+0000 7fbcf1cb0700 1 -- 172.21.15.146:0/2940252524 wait complete. 2023-10-06T11:13:58.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.247+0000 7fbcf1cb0700 1 Processor -- start 2023-10-06T11:13:58.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.247+0000 7fbcf1cb0700 1 -- start start 2023-10-06T11:13:58.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.248+0000 7fbcf1cb0700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbcec0b2620 0x7fbcec0c2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.248+0000 7fbcf1cb0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcec0b29f0 0x7fbcec15a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.248+0000 7fbcf1cb0700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbcec1571d0 0x7fbcec158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.248+0000 7fbcf1cb0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcec1592a0 con 0x7fbcec0b29f0 2023-10-06T11:13:58.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.248+0000 7fbcf1cb0700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcec15a0e0 con 0x7fbcec1571d0 2023-10-06T11:13:58.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.248+0000 7fbcf1cb0700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcec1594d0 con 0x7fbcec0b2620 2023-10-06T11:13:58.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.248+0000 7fbceaffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcec0b29f0 0x7fbcec15a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.248+0000 7fbceaffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcec0b29f0 0x7fbcec15a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47254/0 (socket says 172.21.15.146:47254) 2023-10-06T11:13:58.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.248+0000 7fbceaffd700 1 -- 172.21.15.146:0/3097836241 learned_addr learned my addr 172.21.15.146:0/3097836241 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:58.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.248+0000 7fbceb7fe700 1 --2- 172.21.15.146:0/3097836241 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbcec0b2620 0x7fbcec0c2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.248+0000 7fbcebfff700 1 --2- 172.21.15.146:0/3097836241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbcec1571d0 0x7fbcec158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.248+0000 7fbceaffd700 1 -- 172.21.15.146:0/3097836241 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbcec0b2620 msgr2=0x7fbcec0c2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.248+0000 7fbceaffd700 1 --2- 172.21.15.146:0/3097836241 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbcec0b2620 0x7fbcec0c2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.248+0000 7fbceaffd700 1 -- 172.21.15.146:0/3097836241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbcec1571d0 msgr2=0x7fbcec158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.248+0000 7fbceaffd700 1 --2- 172.21.15.146:0/3097836241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbcec1571d0 0x7fbcec158d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.248+0000 7fbceaffd700 1 -- 172.21.15.146:0/3097836241 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce40094f0 con 0x7fbcec0b29f0 2023-10-06T11:13:58.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.248+0000 7fbceaffd700 1 --2- 172.21.15.146:0/3097836241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcec0b29f0 0x7fbcec15a570 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fbce000c590 tx=0x7fbce000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:58.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.248+0000 7fbcd37fe700 1 -- 172.21.15.146:0/3097836241 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce0011590 con 0x7fbcec0b29f0 2023-10-06T11:13:58.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.248+0000 7fbcd37fe700 1 -- 172.21.15.146:0/3097836241 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce0011710 con 0x7fbcec0b29f0 2023-10-06T11:13:58.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.248+0000 7fbcf1cb0700 1 -- 172.21.15.146:0/3097836241 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcec1597b0 con 0x7fbcec0b29f0 2023-10-06T11:13:58.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.248+0000 7fbcd37fe700 1 -- 172.21.15.146:0/3097836241 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce0011ad0 con 0x7fbcec0b29f0 2023-10-06T11:13:58.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.248+0000 7fbcf1cb0700 1 -- 172.21.15.146:0/3097836241 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcec159d70 con 0x7fbcec0b29f0 2023-10-06T11:13:58.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.250+0000 7fbcd37fe700 1 -- 172.21.15.146:0/3097836241 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbce001b3b0 con 0x7fbcec0b29f0 2023-10-06T11:13:58.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.251+0000 7fbcd37fe700 1 --2- 172.21.15.146:0/3097836241 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbcd8066f30 0x7fbcd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.251+0000 7fbcd37fe700 1 -- 172.21.15.146:0/3097836241 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbce0083b60 con 0x7fbcec0b29f0 2023-10-06T11:13:58.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.251+0000 7fbceb7fe700 1 --2- 172.21.15.146:0/3097836241 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbcd8066f30 0x7fbcd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.251+0000 7fbceb7fe700 1 --2- 172.21.15.146:0/3097836241 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbcd8066f30 0x7fbcd80693e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc00f570 tx=0x7fbcdc00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:58.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.252+0000 7fbcfafa8b80 1 Processor -- start 2023-10-06T11:13:58.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.252+0000 7fbcfafa8b80 1 -- start start 2023-10-06T11:13:58.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.253+0000 7fbcfafa8b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d6a6a5ae0 0x558d6a6a5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.253+0000 7fbcfafa8b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558d6a6619f0 0x558d6a65e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.253+0000 7fbcfafa8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d6a65fc20 0x558d6a65eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.253+0000 7fbcfafa8b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d6a5decd0 con 0x558d6a6a5ae0 2023-10-06T11:13:58.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.253+0000 7fbcfafa8b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d6a5b5ac0 con 0x558d6a65fc20 2023-10-06T11:13:58.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.253+0000 7fbcfafa8b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x558d6a5b32c0 con 0x558d6a6619f0 2023-10-06T11:13:58.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.253+0000 7fbceb7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d6a6a5ae0 0x558d6a6a5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.253+0000 7fbceb7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d6a6a5ae0 0x558d6a6a5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47266/0 (socket says 172.21.15.146:47266) 2023-10-06T11:13:58.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.253+0000 7fbceb7fe700 1 -- 172.21.15.146:0/3768506486 learned_addr learned my addr 172.21.15.146:0/3768506486 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:58.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.253+0000 7fbcebfff700 1 --2- 172.21.15.146:0/3768506486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d6a65fc20 0x558d6a65eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.253+0000 7fbceaffd700 1 --2- 172.21.15.146:0/3768506486 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558d6a6619f0 0x558d6a65e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.254+0000 7fbceb7fe700 1 -- 172.21.15.146:0/3768506486 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558d6a6619f0 msgr2=0x558d6a65e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:58.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.254+0000 7fbceb7fe700 1 --2- 172.21.15.146:0/3768506486 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558d6a6619f0 0x558d6a65e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.254+0000 7fbceb7fe700 1 -- 172.21.15.146:0/3768506486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d6a65fc20 msgr2=0x558d6a65eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:58.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.254+0000 7fbceb7fe700 1 --2- 172.21.15.146:0/3768506486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d6a65fc20 0x558d6a65eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.254+0000 7fbceb7fe700 1 -- 172.21.15.146:0/3768506486 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d6a4492c0 con 0x558d6a6a5ae0 2023-10-06T11:13:58.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.254+0000 7fbcebfff700 1 --2- 172.21.15.146:0/3768506486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d6a65fc20 0x558d6a65eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:58.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.254+0000 7fbceb7fe700 1 --2- 172.21.15.146:0/3768506486 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d6a6a5ae0 0x558d6a6a5eb0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc017770 tx=0x7fbcdc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a70294ac98f1684 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:58.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.254+0000 7fbcd0ff9700 1 -- 172.21.15.146:0/3768506486 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc026070 con 0x558d6a6a5ae0 2023-10-06T11:13:58.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.254+0000 7fbcd0ff9700 1 -- 172.21.15.146:0/3768506486 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcdc00f040 con 0x558d6a6a5ae0 2023-10-06T11:13:58.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.254+0000 7fbcd0ff9700 1 -- 172.21.15.146:0/3768506486 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcdc01c040 con 0x558d6a6a5ae0 2023-10-06T11:13:58.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.254+0000 7fbcfafa8b80 1 -- 172.21.15.146:0/3768506486 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d6a6a5ae0 msgr2=0x558d6a6a5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.254+0000 7fbcfafa8b80 1 --2- 172.21.15.146:0/3768506486 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d6a6a5ae0 0x558d6a6a5eb0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc017770 tx=0x7fbcdc019000 comp rx=0 tx=0).stop 2023-10-06T11:13:58.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.255+0000 7fbcfafa8b80 1 -- 172.21.15.146:0/3768506486 shutdown_connections 2023-10-06T11:13:58.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.255+0000 7fbcfafa8b80 1 --2- 172.21.15.146:0/3768506486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d6a65fc20 0x558d6a65eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.255+0000 7fbcfafa8b80 1 --2- 172.21.15.146:0/3768506486 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d6a6a5ae0 0x558d6a6a5eb0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.255+0000 7fbcfafa8b80 1 --2- 172.21.15.146:0/3768506486 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558d6a6619f0 0x558d6a65e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.255+0000 7fbcfafa8b80 1 -- 172.21.15.146:0/3768506486 >> 172.21.15.146:0/3768506486 conn(0x558d6a6600c0 msgr2=0x558d6a660490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:58.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.255+0000 7fbcfafa8b80 1 -- 172.21.15.146:0/3768506486 shutdown_connections 2023-10-06T11:13:58.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.255+0000 7fbcfafa8b80 1 -- 172.21.15.146:0/3768506486 wait complete. 2023-10-06T11:13:58.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.255+0000 7fbcfafa8b80 1 -- start start 2023-10-06T11:13:58.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.255+0000 7fbcfafa8b80 1 Processor -- start 2023-10-06T11:13:58.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.256+0000 7fbcfafa8b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558d6a65fc20 0x558d6a686f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.256+0000 7fbcfafa8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d6a6619f0 0x558d6a684e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.256+0000 7fbcfafa8b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d6a6a5ae0 0x558d6a685340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.256+0000 7fbcfafa8b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d6a5af0b0 con 0x558d6a6a5ae0 2023-10-06T11:13:58.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.256+0000 7fbcfafa8b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d6a55a8e0 con 0x558d6a6619f0 2023-10-06T11:13:58.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.256+0000 7fbcfafa8b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x558d6a575ef0 con 0x558d6a65fc20 2023-10-06T11:13:58.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.256+0000 7fbcfafa8b80 10 client.0 _ll_register_callbacks cb 0x558d6a44bf80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:13:58.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.256+0000 7fbcebfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d6a6a5ae0 0x558d6a685340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.256+0000 7fbcebfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d6a6a5ae0 0x558d6a685340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47268/0 (socket says 172.21.15.146:47268) 2023-10-06T11:13:58.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.256+0000 7fbcebfff700 1 -- 172.21.15.146:0/459610126 learned_addr learned my addr 172.21.15.146:0/459610126 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:58.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.256+0000 7fbceaffd700 1 --2- 172.21.15.146:0/459610126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d6a6619f0 0x558d6a684e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.256+0000 7fbceb7fe700 1 --2- 172.21.15.146:0/459610126 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558d6a65fc20 0x558d6a686f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.256+0000 7fbcebfff700 1 -- 172.21.15.146:0/459610126 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558d6a65fc20 msgr2=0x558d6a686f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:58.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.256+0000 7fbcebfff700 1 --2- 172.21.15.146:0/459610126 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558d6a65fc20 0x558d6a686f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.256+0000 7fbcebfff700 1 -- 172.21.15.146:0/459610126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d6a6619f0 msgr2=0x558d6a684e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:58.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.256+0000 7fbcebfff700 1 --2- 172.21.15.146:0/459610126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d6a6619f0 0x558d6a684e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.256+0000 7fbcebfff700 1 -- 172.21.15.146:0/459610126 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcdc017440 con 0x558d6a6a5ae0 2023-10-06T11:13:58.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.257+0000 7fbcebfff700 1 --2- 172.21.15.146:0/459610126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d6a6a5ae0 0x558d6a685340 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fbcec069e70 tx=0x7fbce4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31e4da2f07cdd510 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:58.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.257+0000 7fbcc9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:13:58.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.257+0000 7fbcc9ffb700 1 -- 172.21.15.146:0/459610126 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce401a640 con 0x558d6a6a5ae0 2023-10-06T11:13:58.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.257+0000 7fbcc9ffb700 1 -- 172.21.15.146:0/459610126 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbce401a7a0 con 0x558d6a6a5ae0 2023-10-06T11:13:58.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.257+0000 7fbcfafa8b80 1 -- 172.21.15.146:0/459610126 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558d6a6536e0 con 0x558d6a6a5ae0 2023-10-06T11:13:58.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.257+0000 7fbcc9ffb700 1 -- 172.21.15.146:0/459610126 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbce401ab70 con 0x558d6a6a5ae0 2023-10-06T11:13:58.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.257+0000 7fbcfafa8b80 10 client.7896 fetch_fsmap learned FSMap version 93 2023-10-06T11:13:58.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.257+0000 7fbcfafa8b80 1 -- 172.21.15.146:0/459610126 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x558d6a3ec030 con 0x558d6a6a5ae0 2023-10-06T11:13:58.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.257+0000 7fbcc9ffb700 1 -- 172.21.15.146:0/459610126 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558d6a6536e0 con 0x558d6a6a5ae0 2023-10-06T11:13:58.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.257+0000 7fbcc9ffb700 1 -- 172.21.15.146:0/459610126 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 93) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fbce401acd0 con 0x558d6a6a5ae0 2023-10-06T11:13:58.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.257+0000 7fbcfafa8b80 10 client.7896 fetch_fsmap finished waiting for FSMap version 93 2023-10-06T11:13:58.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.257+0000 7fbcfafa8b80 10 client.7896 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2023-10-06T11:13:58.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.257+0000 7fbcfafa8b80 20 client.7896 populate_metadata read hostname 'smithi146' 2023-10-06T11:13:58.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.257+0000 7fbcfafa8b80 1 --2- 172.21.15.146:0/459610126 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x558d6a69ca20 0x558d6a6a1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.257+0000 7fbcfafa8b80 4 client.7896 mds_command: new command op to 7620 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:13:58.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.257+0000 7fbcfafa8b80 1 -- 172.21.15.146:0/459610126 --> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558d6a630610 con 0x558d6a69ca20 2023-10-06T11:13:58.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.257+0000 7fbceb7fe700 1 --2- 172.21.15.146:0/459610126 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x558d6a69ca20 0x558d6a6a1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.258+0000 7fbcc9ffb700 10 client.7896 ms_handle_connect on v2:172.21.15.146:6834/785131800 2023-10-06T11:13:58.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.258+0000 7fbceb7fe700 1 --2- 172.21.15.146:0/459610126 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x558d6a69ca20 0x558d6a6a1c40 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=776c5b19f7f26642 server_cookie=3df2e5e333daa11b in_seq=0 out_seq=0 2023-10-06T11:13:58.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.258+0000 7fbcc9ffb700 1 -- 172.21.15.146:0/459610126 <== mds.0 v2:172.21.15.146:6834/785131800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x558d6a630610 con 0x558d6a69ca20 2023-10-06T11:13:58.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.258+0000 7fbcc9ffb700 10 client.7896 handle_command_reply: tid=0 2023-10-06T11:13:58.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.258+0000 7fbcfafa8b80 1 client.7896 shutdown 2023-10-06T11:13:58.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.258+0000 7fbcfafa8b80 1 -- 172.21.15.146:0/459610126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d6a6a5ae0 msgr2=0x558d6a685340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.258+0000 7fbcfafa8b80 1 --2- 172.21.15.146:0/459610126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d6a6a5ae0 0x558d6a685340 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fbcec069e70 tx=0x7fbce4017000 comp rx=0 tx=0).stop 2023-10-06T11:13:58.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.258+0000 7fbcfafa8b80 1 -- 172.21.15.146:0/459610126 shutdown_connections 2023-10-06T11:13:58.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.258+0000 7fbcfafa8b80 1 --2- 172.21.15.146:0/459610126 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x558d6a69ca20 0x558d6a6a1c40 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.258+0000 7fbcfafa8b80 1 --2- 172.21.15.146:0/459610126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d6a6a5ae0 0x558d6a685340 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.258+0000 7fbcfafa8b80 1 --2- 172.21.15.146:0/459610126 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558d6a65fc20 0x558d6a686f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.258+0000 7fbcc9ffb700 0 client.7896 ms_handle_reset on v2:172.21.15.146:6834/785131800 2023-10-06T11:13:58.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.258+0000 7fbcfafa8b80 1 --2- 172.21.15.146:0/459610126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d6a6619f0 0x558d6a684e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.258+0000 7fbcfafa8b80 1 -- 172.21.15.146:0/459610126 >> 172.21.15.146:0/459610126 conn(0x558d6a6600c0 msgr2=0x558d6a65b710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:58.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.258+0000 7fbcfafa8b80 1 -- 172.21.15.146:0/459610126 shutdown_connections 2023-10-06T11:13:58.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.258+0000 7fbcfafa8b80 1 -- 172.21.15.146:0/459610126 wait complete. 2023-10-06T11:13:58.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.258+0000 7fbcfafa8b80 20 client.7896 trim_cache size 0 max 16384 2023-10-06T11:13:58.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.274+0000 7fbcfafa8b80 1 Processor -- start 2023-10-06T11:13:58.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.274+0000 7fbcfafa8b80 1 -- start start 2023-10-06T11:13:58.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.275+0000 7fbcfafa8b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558d6a65fc20 0x558d6a684bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.275+0000 7fbcfafa8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d6a6619f0 0x558d6a6a0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.275+0000 7fbcfafa8b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d6a6a5ae0 0x558d6a6a3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.275+0000 7fbcfafa8b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d6a431e80 con 0x558d6a6a5ae0 2023-10-06T11:13:58.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.275+0000 7fbcfafa8b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d6a6b4530 con 0x558d6a6619f0 2023-10-06T11:13:58.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.275+0000 7fbcfafa8b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x558d6a65c060 con 0x558d6a65fc20 2023-10-06T11:13:58.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.275+0000 7fbcebfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d6a6a5ae0 0x558d6a6a3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.275+0000 7fbcebfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d6a6a5ae0 0x558d6a6a3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47284/0 (socket says 172.21.15.146:47284) 2023-10-06T11:13:58.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.275+0000 7fbcebfff700 1 -- 172.21.15.146:0/3759682375 learned_addr learned my addr 172.21.15.146:0/3759682375 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:58.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.275+0000 7fbceaffd700 1 --2- 172.21.15.146:0/3759682375 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d6a6619f0 0x558d6a6a0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.275+0000 7fbcebfff700 1 -- 172.21.15.146:0/3759682375 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558d6a65fc20 msgr2=0x558d6a684bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:58.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.275+0000 7fbcebfff700 1 --2- 172.21.15.146:0/3759682375 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558d6a65fc20 0x558d6a684bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.275+0000 7fbcebfff700 1 -- 172.21.15.146:0/3759682375 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d6a6619f0 msgr2=0x558d6a6a0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:58.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.275+0000 7fbcebfff700 1 --2- 172.21.15.146:0/3759682375 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d6a6619f0 0x558d6a6a0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.275+0000 7fbcebfff700 1 -- 172.21.15.146:0/3759682375 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d6a57d7d0 con 0x558d6a6a5ae0 2023-10-06T11:13:58.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.275+0000 7fbcebfff700 1 --2- 172.21.15.146:0/3759682375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d6a6a5ae0 0x558d6a6a3320 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fbce400b3c0 tx=0x7fbce4024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb8b358472a419f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:58.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.275+0000 7fbcd17fa700 1 -- 172.21.15.146:0/3759682375 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce400bd50 con 0x558d6a6a5ae0 2023-10-06T11:13:58.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.275+0000 7fbcd17fa700 1 -- 172.21.15.146:0/3759682375 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce4023040 con 0x558d6a6a5ae0 2023-10-06T11:13:58.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.275+0000 7fbcd17fa700 1 -- 172.21.15.146:0/3759682375 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce401ab70 con 0x558d6a6a5ae0 2023-10-06T11:13:58.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.276+0000 7fbcfafa8b80 1 -- 172.21.15.146:0/3759682375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d6a6a5ae0 msgr2=0x558d6a6a3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.276+0000 7fbcfafa8b80 1 --2- 172.21.15.146:0/3759682375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d6a6a5ae0 0x558d6a6a3320 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fbce400b3c0 tx=0x7fbce4024000 comp rx=0 tx=0).stop 2023-10-06T11:13:58.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.276+0000 7fbcfafa8b80 1 -- 172.21.15.146:0/3759682375 shutdown_connections 2023-10-06T11:13:58.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.276+0000 7fbcfafa8b80 1 --2- 172.21.15.146:0/3759682375 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d6a6a5ae0 0x558d6a6a3320 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.276+0000 7fbcfafa8b80 1 --2- 172.21.15.146:0/3759682375 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558d6a65fc20 0x558d6a684bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.276+0000 7fbcfafa8b80 1 --2- 172.21.15.146:0/3759682375 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d6a6619f0 0x558d6a6a0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.276+0000 7fbcfafa8b80 1 -- 172.21.15.146:0/3759682375 >> 172.21.15.146:0/3759682375 conn(0x558d6a6600c0 msgr2=0x558d6a6a5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:58.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.276+0000 7fbcfafa8b80 1 -- 172.21.15.146:0/3759682375 shutdown_connections 2023-10-06T11:13:58.280 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.276+0000 7fbcfafa8b80 1 -- 172.21.15.146:0/3759682375 wait complete. 2023-10-06T11:13:58.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.277+0000 7fbcfafa8b80 1 -- start start 2023-10-06T11:13:58.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.277+0000 7fbcfafa8b80 1 Processor -- start 2023-10-06T11:13:58.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.277+0000 7fbcfafa8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d6a65fc20 0x558d6a69efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.277+0000 7fbcfafa8b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d6a6619f0 0x558d6a69f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.277+0000 7fbcfafa8b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558d6a6a5ae0 0x558d6a68d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.277+0000 7fbcfafa8b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d6a69b7c0 con 0x558d6a6619f0 2023-10-06T11:13:58.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.277+0000 7fbcfafa8b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d6a69fe00 con 0x558d6a65fc20 2023-10-06T11:13:58.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.277+0000 7fbcfafa8b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x558d6a69b450 con 0x558d6a6a5ae0 2023-10-06T11:13:58.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.277+0000 7fbcfafa8b80 10 client.0 _ll_register_callbacks cb 0x558d6a44bf80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:13:58.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.278+0000 7fbceaffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d6a6619f0 0x558d6a69f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.278+0000 7fbceaffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d6a6619f0 0x558d6a69f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47292/0 (socket says 172.21.15.146:47292) 2023-10-06T11:13:58.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.278+0000 7fbceaffd700 1 -- 172.21.15.146:0/1938645015 learned_addr learned my addr 172.21.15.146:0/1938645015 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:58.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.278+0000 7fbceb7fe700 1 --2- 172.21.15.146:0/1938645015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d6a65fc20 0x558d6a69efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.278+0000 7fbcebfff700 1 --2- 172.21.15.146:0/1938645015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558d6a6a5ae0 0x558d6a68d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.278+0000 7fbceaffd700 1 -- 172.21.15.146:0/1938645015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558d6a6a5ae0 msgr2=0x558d6a68d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:58.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.278+0000 7fbceaffd700 1 --2- 172.21.15.146:0/1938645015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558d6a6a5ae0 0x558d6a68d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.278+0000 7fbceaffd700 1 -- 172.21.15.146:0/1938645015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d6a65fc20 msgr2=0x558d6a69efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:58.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.278+0000 7fbceaffd700 1 --2- 172.21.15.146:0/1938645015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d6a65fc20 0x558d6a69efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.278+0000 7fbceaffd700 1 -- 172.21.15.146:0/1938645015 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558d6a3ec030 con 0x558d6a6619f0 2023-10-06T11:13:58.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.278+0000 7fbceb7fe700 1 --2- 172.21.15.146:0/1938645015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d6a65fc20 0x558d6a69efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:58.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.278+0000 7fbcebfff700 1 --2- 172.21.15.146:0/1938645015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558d6a6a5ae0 0x558d6a68d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:58.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.278+0000 7fbceaffd700 1 --2- 172.21.15.146:0/1938645015 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d6a6619f0 0x558d6a69f4f0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fbce0081f10 tx=0x7fbce0057040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb22eb7e169ced47 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:58.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.278+0000 7fbcc9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:13:58.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.278+0000 7fbcc9ffb700 1 -- 172.21.15.146:0/1938645015 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce006e070 con 0x558d6a6619f0 2023-10-06T11:13:58.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.278+0000 7fbcc9ffb700 1 -- 172.21.15.146:0/1938645015 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbce0011e80 con 0x558d6a6619f0 2023-10-06T11:13:58.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.278+0000 7fbcfafa8b80 1 -- 172.21.15.146:0/1938645015 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbcdc00f040 con 0x558d6a6619f0 2023-10-06T11:13:58.286 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.278+0000 7fbcc9ffb700 1 -- 172.21.15.146:0/1938645015 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbce00543d0 con 0x558d6a6619f0 2023-10-06T11:13:58.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.278+0000 7fbcfafa8b80 10 client.7902 fetch_fsmap learned FSMap version 93 2023-10-06T11:13:58.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.278+0000 7fbcfafa8b80 1 -- 172.21.15.146:0/1938645015 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x558d6a5644c0 con 0x558d6a6619f0 2023-10-06T11:13:58.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.278+0000 7fbcc9ffb700 1 -- 172.21.15.146:0/1938645015 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcdc00f040 con 0x558d6a6619f0 2023-10-06T11:13:58.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.278+0000 7fbcc9ffb700 1 -- 172.21.15.146:0/1938645015 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 93) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fbce0053d80 con 0x558d6a6619f0 2023-10-06T11:13:58.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.278+0000 7fbcfafa8b80 10 client.7902 fetch_fsmap finished waiting for FSMap version 93 2023-10-06T11:13:58.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.278+0000 7fbcfafa8b80 10 client.7902 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2023-10-06T11:13:58.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.278+0000 7fbcfafa8b80 20 client.7902 populate_metadata read hostname 'smithi146' 2023-10-06T11:13:58.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.278+0000 7fbcfafa8b80 1 --2- 172.21.15.146:0/1938645015 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x558d6a69c400 0x558d6a709ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.278+0000 7fbcfafa8b80 4 client.7902 mds_command: new command op to 7620 tid=0[{"prefix": "scrub resume"}] 2023-10-06T11:13:58.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.278+0000 7fbcfafa8b80 1 -- 172.21.15.146:0/1938645015 --> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] -- command(tid 0: {"prefix": "scrub resume"}) v1 -- 0x558d6a551e50 con 0x558d6a69c400 2023-10-06T11:13:58.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.279+0000 7fbceb7fe700 1 --2- 172.21.15.146:0/1938645015 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x558d6a69c400 0x558d6a709ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.279+0000 7fbcc9ffb700 10 client.7902 ms_handle_connect on v2:172.21.15.146:6834/785131800 2023-10-06T11:13:58.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.279+0000 7fbceb7fe700 1 --2- 172.21.15.146:0/1938645015 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x558d6a69c400 0x558d6a709ff0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c3c1710e92cbc87 server_cookie=6a80f605472d61ef in_seq=0 out_seq=0 2023-10-06T11:13:58.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.279+0000 7fbcc9ffb700 1 -- 172.21.15.146:0/1938645015 <== mds.0 v2:172.21.15.146:6834/785131800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x558d6a551e50 con 0x558d6a69c400 2023-10-06T11:13:58.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.279+0000 7fbcc9ffb700 10 client.7902 handle_command_reply: tid=0 2023-10-06T11:13:58.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.279+0000 7fbcfafa8b80 1 client.7902 shutdown 2023-10-06T11:13:58.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.279+0000 7fbcfafa8b80 1 -- 172.21.15.146:0/1938645015 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d6a6619f0 msgr2=0x558d6a69f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.279+0000 7fbcfafa8b80 1 --2- 172.21.15.146:0/1938645015 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d6a6619f0 0x558d6a69f4f0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fbce0081f10 tx=0x7fbce0057040 comp rx=0 tx=0).stop 2023-10-06T11:13:58.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.279+0000 7fbcfafa8b80 1 -- 172.21.15.146:0/1938645015 shutdown_connections 2023-10-06T11:13:58.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.279+0000 7fbcfafa8b80 1 --2- 172.21.15.146:0/1938645015 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x558d6a69c400 0x558d6a709ff0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.279+0000 7fbcfafa8b80 1 --2- 172.21.15.146:0/1938645015 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x558d6a6a5ae0 0x558d6a68d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.279+0000 7fbcfafa8b80 1 --2- 172.21.15.146:0/1938645015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d6a65fc20 0x558d6a69efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.279+0000 7fbcfafa8b80 1 --2- 172.21.15.146:0/1938645015 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x558d6a6619f0 0x558d6a69f4f0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.279+0000 7fbcc9ffb700 0 client.7902 ms_handle_reset on v2:172.21.15.146:6834/785131800 2023-10-06T11:13:58.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.279+0000 7fbcfafa8b80 1 -- 172.21.15.146:0/1938645015 >> 172.21.15.146:0/1938645015 conn(0x558d6a6600c0 msgr2=0x558d6a6a38d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:58.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.279+0000 7fbcfafa8b80 1 -- 172.21.15.146:0/1938645015 shutdown_connections 2023-10-06T11:13:58.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.279+0000 7fbcfafa8b80 1 -- 172.21.15.146:0/1938645015 wait complete. 2023-10-06T11:13:58.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.279+0000 7fbcfafa8b80 20 client.7902 trim_cache size 0 max 16384 2023-10-06T11:13:58.289 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:13:58.289 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0 2023-10-06T11:13:58.289 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:13:58.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.280+0000 7fbcf1cb0700 1 -- 172.21.15.146:0/3097836241 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbcd8066f30 msgr2=0x7fbcd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.280+0000 7fbcf1cb0700 1 --2- 172.21.15.146:0/3097836241 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbcd8066f30 0x7fbcd80693e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc00f570 tx=0x7fbcdc00b040 comp rx=0 tx=0).stop 2023-10-06T11:13:58.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.280+0000 7fbcf1cb0700 1 -- 172.21.15.146:0/3097836241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcec0b29f0 msgr2=0x7fbcec15a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.280+0000 7fbcf1cb0700 1 --2- 172.21.15.146:0/3097836241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcec0b29f0 0x7fbcec15a570 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fbce000c590 tx=0x7fbce000c8a0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.280+0000 7fbcf1cb0700 1 -- 172.21.15.146:0/3097836241 shutdown_connections 2023-10-06T11:13:58.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.280+0000 7fbcf1cb0700 1 --2- 172.21.15.146:0/3097836241 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbcd8066f30 0x7fbcd80693e0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.280+0000 7fbcf1cb0700 1 --2- 172.21.15.146:0/3097836241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbcec1571d0 0x7fbcec158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.280+0000 7fbcf1cb0700 1 --2- 172.21.15.146:0/3097836241 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbcec0b2620 0x7fbcec0c2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.280+0000 7fbcf1cb0700 1 --2- 172.21.15.146:0/3097836241 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcec0b29f0 0x7fbcec15a570 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.280+0000 7fbcf1cb0700 1 -- 172.21.15.146:0/3097836241 >> 172.21.15.146:0/3097836241 conn(0x7fbcec068580 msgr2=0x7fbcec153c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:58.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.280+0000 7fbcf1cb0700 1 -- 172.21.15.146:0/3097836241 shutdown_connections 2023-10-06T11:13:58.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.280+0000 7fbcf1cb0700 1 -- 172.21.15.146:0/3097836241 wait complete. 2023-10-06T11:13:58.293 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.7:0 scrub status 2023-10-06T11:13:58.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.408+0000 7fa17ad94700 1 Processor -- start 2023-10-06T11:13:58.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.408+0000 7fa17ad94700 1 -- start start 2023-10-06T11:13:58.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.409+0000 7fa17ad94700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa17415d710 0x7fa1740ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.409+0000 7fa17ad94700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa1740aef20 0x7fa174068580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.409+0000 7fa17ad94700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1740b0010 con 0x7fa174068ac0 2023-10-06T11:13:58.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.409+0000 7fa17ad94700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa17415e340 con 0x7fa17415d710 2023-10-06T11:13:58.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.409+0000 7fa17ad94700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1740cf090 con 0x7fa1740aef20 2023-10-06T11:13:58.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.409+0000 7fa178b30700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa17415d710 0x7fa1740ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.409+0000 7fa178b30700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa17415d710 0x7fa1740ceb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47304/0 (socket says 172.21.15.146:47304) 2023-10-06T11:13:58.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.409+0000 7fa178b30700 1 -- 172.21.15.146:0/348545052 learned_addr learned my addr 172.21.15.146:0/348545052 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:58.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.409+0000 7fa173fff700 1 --2- 172.21.15.146:0/348545052 >> v2:172.21.15.151:3300/0 conn(0x7fa1740aef20 0x7fa174068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.409+0000 7fa178b30700 1 -- 172.21.15.146:0/348545052 >> v2:172.21.15.151:3300/0 conn(0x7fa1740aef20 msgr2=0x7fa174068580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:58.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.409+0000 7fa178b30700 1 --2- 172.21.15.146:0/348545052 >> v2:172.21.15.151:3300/0 conn(0x7fa1740aef20 0x7fa174068580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.409+0000 7fa178b30700 1 -- 172.21.15.146:0/348545052 >> v1:172.21.15.151:6789/0 conn(0x7fa174068ac0 legacy=0x7fa1740b04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.409+0000 7fa178b30700 1 -- 172.21.15.146:0/348545052 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1740af400 con 0x7fa17415d710 2023-10-06T11:13:58.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.409+0000 7fa178b30700 1 --2- 172.21.15.146:0/348545052 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa17415d710 0x7fa1740ceb50 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fa1740ce410 tx=0x7fa168009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c924328d2a582291 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:58.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.410+0000 7fa1737fe700 1 -- 172.21.15.146:0/348545052 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa168009e70 con 0x7fa17415d710 2023-10-06T11:13:58.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.410+0000 7fa1737fe700 1 -- 172.21.15.146:0/348545052 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa16800b860 con 0x7fa17415d710 2023-10-06T11:13:58.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.410+0000 7fa1737fe700 1 -- 172.21.15.146:0/348545052 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16800bc00 con 0x7fa17415d710 2023-10-06T11:13:58.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.410+0000 7fa17ad94700 1 -- 172.21.15.146:0/348545052 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa17415d710 msgr2=0x7fa1740ceb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.410+0000 7fa17ad94700 1 --2- 172.21.15.146:0/348545052 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa17415d710 0x7fa1740ceb50 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fa1740ce410 tx=0x7fa168009250 comp rx=0 tx=0).stop 2023-10-06T11:13:58.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.410+0000 7fa17ad94700 1 -- 172.21.15.146:0/348545052 shutdown_connections 2023-10-06T11:13:58.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.410+0000 7fa17ad94700 1 --2- 172.21.15.146:0/348545052 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa17415d710 0x7fa1740ceb50 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.410+0000 7fa17ad94700 1 --2- 172.21.15.146:0/348545052 >> v2:172.21.15.151:3300/0 conn(0x7fa1740aef20 0x7fa174068580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.410+0000 7fa17ad94700 1 -- 172.21.15.146:0/348545052 >> 172.21.15.146:0/348545052 conn(0x7fa174067c50 msgr2=0x7fa1740ce440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:58.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.410+0000 7fa17ad94700 1 -- 172.21.15.146:0/348545052 shutdown_connections 2023-10-06T11:13:58.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.410+0000 7fa17ad94700 1 -- 172.21.15.146:0/348545052 wait complete. 2023-10-06T11:13:58.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.411+0000 7fa17ad94700 1 Processor -- start 2023-10-06T11:13:58.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.412+0000 7fa17ad94700 1 -- start start 2023-10-06T11:13:58.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.412+0000 7fa17ad94700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa174068ac0 0x7fa1740b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.412+0000 7fa17ad94700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1740aef20 0x7fa1740cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.412+0000 7fa17ad94700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa17415d710 0x7fa174147000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.412+0000 7fa17ad94700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1740b11e0 con 0x7fa1740aef20 2023-10-06T11:13:58.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.412+0000 7fa17ad94700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1740b17a0 con 0x7fa17415d710 2023-10-06T11:13:58.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.412+0000 7fa17ad94700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1740cb830 con 0x7fa174068ac0 2023-10-06T11:13:58.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.412+0000 7fa173fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1740aef20 0x7fa1740cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.412+0000 7fa173fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1740aef20 0x7fa1740cb2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47320/0 (socket says 172.21.15.146:47320) 2023-10-06T11:13:58.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.412+0000 7fa173fff700 1 -- 172.21.15.146:0/3827487336 learned_addr learned my addr 172.21.15.146:0/3827487336 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:58.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.412+0000 7fa178b30700 1 --2- 172.21.15.146:0/3827487336 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa174068ac0 0x7fa1740b3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.412+0000 7fa179331700 1 --2- 172.21.15.146:0/3827487336 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa17415d710 0x7fa174147000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.413+0000 7fa173fff700 1 -- 172.21.15.146:0/3827487336 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa174068ac0 msgr2=0x7fa1740b3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.413+0000 7fa173fff700 1 --2- 172.21.15.146:0/3827487336 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa174068ac0 0x7fa1740b3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.413+0000 7fa173fff700 1 -- 172.21.15.146:0/3827487336 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa17415d710 msgr2=0x7fa174147000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.413+0000 7fa173fff700 1 --2- 172.21.15.146:0/3827487336 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa17415d710 0x7fa174147000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.413+0000 7fa173fff700 1 -- 172.21.15.146:0/3827487336 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1680094f0 con 0x7fa1740aef20 2023-10-06T11:13:58.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.413+0000 7fa173fff700 1 --2- 172.21.15.146:0/3827487336 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1740aef20 0x7fa1740cb2f0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fa16000ec50 tx=0x7fa1600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:58.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.413+0000 7fa170ff9700 1 -- 172.21.15.146:0/3827487336 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa160009690 con 0x7fa1740aef20 2023-10-06T11:13:58.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.413+0000 7fa170ff9700 1 -- 172.21.15.146:0/3827487336 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa16000c850 con 0x7fa1740aef20 2023-10-06T11:13:58.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.413+0000 7fa170ff9700 1 -- 172.21.15.146:0/3827487336 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16000cbf0 con 0x7fa1740aef20 2023-10-06T11:13:58.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.413+0000 7fa17ad94700 1 -- 172.21.15.146:0/3827487336 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1740cbb00 con 0x7fa1740aef20 2023-10-06T11:13:58.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.413+0000 7fa17ad94700 1 -- 172.21.15.146:0/3827487336 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1740b1430 con 0x7fa1740aef20 2023-10-06T11:13:58.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.415+0000 7fa170ff9700 1 -- 172.21.15.146:0/3827487336 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa160013470 con 0x7fa1740aef20 2023-10-06T11:13:58.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.415+0000 7fa170ff9700 1 --2- 172.21.15.146:0/3827487336 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa158066f30 0x7fa1580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.415+0000 7fa170ff9700 1 -- 172.21.15.146:0/3827487336 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa160084870 con 0x7fa1740aef20 2023-10-06T11:13:58.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.415+0000 7fa178b30700 1 --2- 172.21.15.146:0/3827487336 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa158066f30 0x7fa1580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.415+0000 7fa178b30700 1 --2- 172.21.15.146:0/3827487336 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa158066f30 0x7fa1580693e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fa1740ce410 tx=0x7fa168017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:58.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.417+0000 7fa18408cb80 1 Processor -- start 2023-10-06T11:13:58.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.417+0000 7fa18408cb80 1 -- start start 2023-10-06T11:13:58.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.417+0000 7fa18408cb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e734eaae0 0x556e734eaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.417+0000 7fa18408cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556e734a69f0 0x556e734a35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.417+0000 7fa18408cb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556e734a4c20 0x556e734a3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.417+0000 7fa18408cb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e73423cd0 con 0x556e734eaae0 2023-10-06T11:13:58.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.417+0000 7fa18408cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e733faac0 con 0x556e734a69f0 2023-10-06T11:13:58.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.418+0000 7fa18408cb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x556e733f82c0 con 0x556e734a4c20 2023-10-06T11:13:58.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.418+0000 7fa178b30700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e734eaae0 0x556e734eaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.418+0000 7fa178b30700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e734eaae0 0x556e734eaeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47330/0 (socket says 172.21.15.146:47330) 2023-10-06T11:13:58.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.418+0000 7fa178b30700 1 -- 172.21.15.146:0/2855227905 learned_addr learned my addr 172.21.15.146:0/2855227905 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:58.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.418+0000 7fa178b30700 1 -- 172.21.15.146:0/2855227905 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556e734a4c20 msgr2=0x556e734a3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:58.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.418+0000 7fa178b30700 1 --2- 172.21.15.146:0/2855227905 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556e734a4c20 0x556e734a3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.418+0000 7fa178b30700 1 -- 172.21.15.146:0/2855227905 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556e734a69f0 msgr2=0x556e734a35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:58.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.418+0000 7fa178b30700 1 --2- 172.21.15.146:0/2855227905 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556e734a69f0 0x556e734a35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.418+0000 7fa178b30700 1 -- 172.21.15.146:0/2855227905 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e7328e2c0 con 0x556e734eaae0 2023-10-06T11:13:58.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.418+0000 7fa178b30700 1 --2- 172.21.15.146:0/2855227905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e734eaae0 0x556e734eaeb0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fa16800b3c0 tx=0x7fa168021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=defa8126a483bf7c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:58.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.418+0000 7fa15dffb700 1 -- 172.21.15.146:0/2855227905 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16802d070 con 0x556e734eaae0 2023-10-06T11:13:58.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.418+0000 7fa15dffb700 1 -- 172.21.15.146:0/2855227905 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa16800bbe0 con 0x556e734eaae0 2023-10-06T11:13:58.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.418+0000 7fa15dffb700 1 -- 172.21.15.146:0/2855227905 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa168021070 con 0x556e734eaae0 2023-10-06T11:13:58.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.419+0000 7fa18408cb80 1 -- 172.21.15.146:0/2855227905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e734eaae0 msgr2=0x556e734eaeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.419+0000 7fa18408cb80 1 --2- 172.21.15.146:0/2855227905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e734eaae0 0x556e734eaeb0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fa16800b3c0 tx=0x7fa168021000 comp rx=0 tx=0).stop 2023-10-06T11:13:58.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.419+0000 7fa18408cb80 1 -- 172.21.15.146:0/2855227905 shutdown_connections 2023-10-06T11:13:58.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.419+0000 7fa18408cb80 1 --2- 172.21.15.146:0/2855227905 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556e734a4c20 0x556e734a3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.419+0000 7fa18408cb80 1 --2- 172.21.15.146:0/2855227905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e734eaae0 0x556e734eaeb0 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.419+0000 7fa18408cb80 1 --2- 172.21.15.146:0/2855227905 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556e734a69f0 0x556e734a35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.419+0000 7fa18408cb80 1 -- 172.21.15.146:0/2855227905 >> 172.21.15.146:0/2855227905 conn(0x556e734a50c0 msgr2=0x556e734a5490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:58.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.419+0000 7fa18408cb80 1 -- 172.21.15.146:0/2855227905 shutdown_connections 2023-10-06T11:13:58.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.419+0000 7fa18408cb80 1 -- 172.21.15.146:0/2855227905 wait complete. 2023-10-06T11:13:58.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.419+0000 7fa18408cb80 1 -- start start 2023-10-06T11:13:58.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.420+0000 7fa18408cb80 1 Processor -- start 2023-10-06T11:13:58.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.420+0000 7fa18408cb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556e734a4c20 0x556e734d02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.420+0000 7fa18408cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556e734a69f0 0x556e734e3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.420+0000 7fa18408cb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e734eaae0 0x556e734f9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.420+0000 7fa18408cb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e733f40b0 con 0x556e734eaae0 2023-10-06T11:13:58.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.420+0000 7fa18408cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e7339f8e0 con 0x556e734a69f0 2023-10-06T11:13:58.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.420+0000 7fa18408cb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x556e733baef0 con 0x556e734a4c20 2023-10-06T11:13:58.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.420+0000 7fa18408cb80 10 client.0 _ll_register_callbacks cb 0x556e73290f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:13:58.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.420+0000 7fa179331700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e734eaae0 0x556e734f9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.420+0000 7fa179331700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e734eaae0 0x556e734f9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47334/0 (socket says 172.21.15.146:47334) 2023-10-06T11:13:58.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.420+0000 7fa179331700 1 -- 172.21.15.146:0/1784470351 learned_addr learned my addr 172.21.15.146:0/1784470351 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:58.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.421+0000 7fa173fff700 1 --2- 172.21.15.146:0/1784470351 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556e734a69f0 0x556e734e3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.421+0000 7fa178b30700 1 --2- 172.21.15.146:0/1784470351 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556e734a4c20 0x556e734d02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.421+0000 7fa179331700 1 -- 172.21.15.146:0/1784470351 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556e734a4c20 msgr2=0x556e734d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:58.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.421+0000 7fa179331700 1 --2- 172.21.15.146:0/1784470351 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556e734a4c20 0x556e734d02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.421+0000 7fa179331700 1 -- 172.21.15.146:0/1784470351 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556e734a69f0 msgr2=0x556e734e3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:58.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.421+0000 7fa179331700 1 --2- 172.21.15.146:0/1784470351 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556e734a69f0 0x556e734e3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.421+0000 7fa179331700 1 -- 172.21.15.146:0/1784470351 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1740af400 con 0x556e734eaae0 2023-10-06T11:13:58.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.421+0000 7fa173fff700 1 --2- 172.21.15.146:0/1784470351 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556e734a69f0 0x556e734e3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:58.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.421+0000 7fa178b30700 1 --2- 172.21.15.146:0/1784470351 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556e734a4c20 0x556e734d02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:13:58.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.421+0000 7fa179331700 1 --2- 172.21.15.146:0/1784470351 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e734eaae0 0x556e734f9900 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fa16c00e7f0 tx=0x7fa16c001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74f651485acd58ad server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:58.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.421+0000 7fa152ffd700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:13:58.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.421+0000 7fa152ffd700 1 -- 172.21.15.146:0/1784470351 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16c0135f0 con 0x556e734eaae0 2023-10-06T11:13:58.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.421+0000 7fa152ffd700 1 -- 172.21.15.146:0/1784470351 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa16c013750 con 0x556e734eaae0 2023-10-06T11:13:58.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.421+0000 7fa18408cb80 1 -- 172.21.15.146:0/1784470351 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556e73475610 con 0x556e734eaae0 2023-10-06T11:13:58.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.421+0000 7fa152ffd700 1 -- 172.21.15.146:0/1784470351 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa16c013b20 con 0x556e734eaae0 2023-10-06T11:13:58.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.421+0000 7fa18408cb80 10 client.7914 fetch_fsmap learned FSMap version 93 2023-10-06T11:13:58.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.421+0000 7fa18408cb80 1 -- 172.21.15.146:0/1784470351 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x556e73231030 con 0x556e734eaae0 2023-10-06T11:13:58.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.421+0000 7fa152ffd700 1 -- 172.21.15.146:0/1784470351 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556e73475610 con 0x556e734eaae0 2023-10-06T11:13:58.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.421+0000 7fa152ffd700 1 -- 172.21.15.146:0/1784470351 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 93) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa16c013c80 con 0x556e734eaae0 2023-10-06T11:13:58.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.421+0000 7fa18408cb80 10 client.7914 fetch_fsmap finished waiting for FSMap version 93 2023-10-06T11:13:58.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.421+0000 7fa18408cb80 10 client.7914 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2023-10-06T11:13:58.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.421+0000 7fa18408cb80 20 client.7914 populate_metadata read hostname 'smithi146' 2023-10-06T11:13:58.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.421+0000 7fa18408cb80 1 --2- 172.21.15.146:0/1784470351 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x556e73504070 0x556e73506450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.421+0000 7fa18408cb80 4 client.7914 mds_command: new command op to 7620 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:13:58.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.421+0000 7fa18408cb80 1 -- 172.21.15.146:0/1784470351 --> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556e73396e50 con 0x556e73504070 2023-10-06T11:13:58.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.422+0000 7fa178b30700 1 --2- 172.21.15.146:0/1784470351 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x556e73504070 0x556e73506450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.422+0000 7fa152ffd700 10 client.7914 ms_handle_connect on v2:172.21.15.146:6834/785131800 2023-10-06T11:13:58.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.422+0000 7fa178b30700 1 --2- 172.21.15.146:0/1784470351 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x556e73504070 0x556e73506450 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1010e66ccaccb4a4 server_cookie=ec73a30c05e00a25 in_seq=0 out_seq=0 2023-10-06T11:13:58.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.422+0000 7fa152ffd700 1 -- 172.21.15.146:0/1784470351 <== mds.0 v2:172.21.15.146:6834/785131800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x556e73396e50 con 0x556e73504070 2023-10-06T11:13:58.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.422+0000 7fa152ffd700 10 client.7914 handle_command_reply: tid=0 2023-10-06T11:13:58.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.422+0000 7fa18408cb80 1 client.7914 shutdown 2023-10-06T11:13:58.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.422+0000 7fa18408cb80 1 -- 172.21.15.146:0/1784470351 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e734eaae0 msgr2=0x556e734f9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.422+0000 7fa18408cb80 1 --2- 172.21.15.146:0/1784470351 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e734eaae0 0x556e734f9900 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fa16c00e7f0 tx=0x7fa16c001690 comp rx=0 tx=0).stop 2023-10-06T11:13:58.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.422+0000 7fa18408cb80 1 -- 172.21.15.146:0/1784470351 shutdown_connections 2023-10-06T11:13:58.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.422+0000 7fa18408cb80 1 --2- 172.21.15.146:0/1784470351 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x556e73504070 0x556e73506450 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.422+0000 7fa18408cb80 1 --2- 172.21.15.146:0/1784470351 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e734eaae0 0x556e734f9900 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.422+0000 7fa152ffd700 0 client.7914 ms_handle_reset on v2:172.21.15.146:6834/785131800 2023-10-06T11:13:58.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.422+0000 7fa18408cb80 1 --2- 172.21.15.146:0/1784470351 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556e734a4c20 0x556e734d02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.422+0000 7fa18408cb80 1 --2- 172.21.15.146:0/1784470351 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556e734a69f0 0x556e734e3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.422+0000 7fa18408cb80 1 -- 172.21.15.146:0/1784470351 >> 172.21.15.146:0/1784470351 conn(0x556e734a50c0 msgr2=0x556e734e9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:58.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.423+0000 7fa18408cb80 1 -- 172.21.15.146:0/1784470351 shutdown_connections 2023-10-06T11:13:58.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.423+0000 7fa18408cb80 1 -- 172.21.15.146:0/1784470351 wait complete. 2023-10-06T11:13:58.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.423+0000 7fa18408cb80 20 client.7914 trim_cache size 0 max 16384 2023-10-06T11:13:58.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.438+0000 7fa18408cb80 1 Processor -- start 2023-10-06T11:13:58.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.438+0000 7fa18408cb80 1 -- start start 2023-10-06T11:13:58.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.439+0000 7fa18408cb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556e734a4c20 0x556e73506450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.439+0000 7fa18408cb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e734a69f0 0x556e734e84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.439+0000 7fa18408cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556e734eaae0 0x556e7349e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.439+0000 7fa18408cb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e73276e80 con 0x556e734a69f0 2023-10-06T11:13:58.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.439+0000 7fa18408cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e734a0400 con 0x556e734eaae0 2023-10-06T11:13:58.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.439+0000 7fa18408cb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x556e73498510 con 0x556e734a4c20 2023-10-06T11:13:58.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.439+0000 7fa173fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e734a69f0 0x556e734e84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.439+0000 7fa173fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e734a69f0 0x556e734e84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47348/0 (socket says 172.21.15.146:47348) 2023-10-06T11:13:58.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.439+0000 7fa173fff700 1 -- 172.21.15.146:0/2583810431 learned_addr learned my addr 172.21.15.146:0/2583810431 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:58.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.439+0000 7fa179331700 1 --2- 172.21.15.146:0/2583810431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556e734eaae0 0x556e7349e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.439+0000 7fa173fff700 1 -- 172.21.15.146:0/2583810431 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556e734a4c20 msgr2=0x556e73506450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:58.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.439+0000 7fa178b30700 1 --2- 172.21.15.146:0/2583810431 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556e734a4c20 0x556e73506450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.440+0000 7fa173fff700 1 --2- 172.21.15.146:0/2583810431 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556e734a4c20 0x556e73506450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.440+0000 7fa173fff700 1 -- 172.21.15.146:0/2583810431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556e734eaae0 msgr2=0x556e7349e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:58.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.440+0000 7fa173fff700 1 --2- 172.21.15.146:0/2583810431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556e734eaae0 0x556e7349e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.440+0000 7fa173fff700 1 -- 172.21.15.146:0/2583810431 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e733c27d0 con 0x556e734a69f0 2023-10-06T11:13:58.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.440+0000 7fa179331700 1 --2- 172.21.15.146:0/2583810431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556e734eaae0 0x556e7349e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:58.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.440+0000 7fa178b30700 1 --2- 172.21.15.146:0/2583810431 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556e734a4c20 0x556e73506450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:58.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.440+0000 7fa173fff700 1 --2- 172.21.15.146:0/2583810431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e734a69f0 0x556e734e84f0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fa16000c430 tx=0x7fa160082b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4083c3bb9340cf79 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:58.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.440+0000 7fa15e7fc700 1 -- 172.21.15.146:0/2583810431 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa160055640 con 0x556e734a69f0 2023-10-06T11:13:58.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.440+0000 7fa15e7fc700 1 -- 172.21.15.146:0/2583810431 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa160067e90 con 0x556e734a69f0 2023-10-06T11:13:58.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.440+0000 7fa15e7fc700 1 -- 172.21.15.146:0/2583810431 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa160058890 con 0x556e734a69f0 2023-10-06T11:13:58.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.440+0000 7fa18408cb80 1 -- 172.21.15.146:0/2583810431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e734a69f0 msgr2=0x556e734e84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.440+0000 7fa18408cb80 1 --2- 172.21.15.146:0/2583810431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e734a69f0 0x556e734e84f0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fa16000c430 tx=0x7fa160082b90 comp rx=0 tx=0).stop 2023-10-06T11:13:58.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.440+0000 7fa18408cb80 1 -- 172.21.15.146:0/2583810431 shutdown_connections 2023-10-06T11:13:58.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.440+0000 7fa18408cb80 1 --2- 172.21.15.146:0/2583810431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556e734eaae0 0x556e7349e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.440+0000 7fa18408cb80 1 --2- 172.21.15.146:0/2583810431 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556e734a4c20 0x556e73506450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.440+0000 7fa18408cb80 1 --2- 172.21.15.146:0/2583810431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e734a69f0 0x556e734e84f0 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.440+0000 7fa18408cb80 1 -- 172.21.15.146:0/2583810431 >> 172.21.15.146:0/2583810431 conn(0x556e734a50c0 msgr2=0x556e734e92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:58.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.440+0000 7fa18408cb80 1 -- 172.21.15.146:0/2583810431 shutdown_connections 2023-10-06T11:13:58.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.440+0000 7fa18408cb80 1 -- 172.21.15.146:0/2583810431 wait complete. 2023-10-06T11:13:58.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.441+0000 7fa18408cb80 1 -- start start 2023-10-06T11:13:58.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.441+0000 7fa18408cb80 1 Processor -- start 2023-10-06T11:13:58.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.442+0000 7fa18408cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556e734a4c20 0x556e734e5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.442+0000 7fa18408cb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e734a69f0 0x556e735385c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.442+0000 7fa18408cb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556e734eaae0 0x556e73538b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.442+0000 7fa18408cb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e734f9aa0 con 0x556e734a69f0 2023-10-06T11:13:58.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.442+0000 7fa18408cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e73550cc0 con 0x556e734a4c20 2023-10-06T11:13:58.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.442+0000 7fa18408cb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x556e734f8bd0 con 0x556e734eaae0 2023-10-06T11:13:58.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.442+0000 7fa18408cb80 10 client.0 _ll_register_callbacks cb 0x556e73290f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:13:58.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.442+0000 7fa173fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e734a69f0 0x556e735385c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.442+0000 7fa173fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e734a69f0 0x556e735385c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47362/0 (socket says 172.21.15.146:47362) 2023-10-06T11:13:58.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.442+0000 7fa173fff700 1 -- 172.21.15.146:0/266315578 learned_addr learned my addr 172.21.15.146:0/266315578 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:58.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.442+0000 7fa179331700 1 --2- 172.21.15.146:0/266315578 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556e734eaae0 0x556e73538b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.442+0000 7fa178b30700 1 --2- 172.21.15.146:0/266315578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556e734a4c20 0x556e734e5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.442+0000 7fa173fff700 1 -- 172.21.15.146:0/266315578 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556e734eaae0 msgr2=0x556e73538b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:58.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.442+0000 7fa173fff700 1 --2- 172.21.15.146:0/266315578 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556e734eaae0 0x556e73538b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.442+0000 7fa173fff700 1 -- 172.21.15.146:0/266315578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556e734a4c20 msgr2=0x556e734e5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:58.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.442+0000 7fa173fff700 1 --2- 172.21.15.146:0/266315578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556e734a4c20 0x556e734e5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.442+0000 7fa173fff700 1 -- 172.21.15.146:0/266315578 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1740b1430 con 0x556e734a69f0 2023-10-06T11:13:58.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.442+0000 7fa173fff700 1 --2- 172.21.15.146:0/266315578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e734a69f0 0x556e735385c0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fa160055340 tx=0x7fa16006c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba31924a30333537 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:58.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.442+0000 7fa152ffd700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:13:58.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.442+0000 7fa152ffd700 1 -- 172.21.15.146:0/266315578 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16005c660 con 0x556e734a69f0 2023-10-06T11:13:58.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.443+0000 7fa152ffd700 1 -- 172.21.15.146:0/266315578 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa160055640 con 0x556e734a69f0 2023-10-06T11:13:58.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.443+0000 7fa18408cb80 1 -- 172.21.15.146:0/266315578 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556e734986e0 con 0x556e734a69f0 2023-10-06T11:13:58.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.443+0000 7fa152ffd700 1 -- 172.21.15.146:0/266315578 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa160058890 con 0x556e734a69f0 2023-10-06T11:13:58.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.443+0000 7fa18408cb80 10 client.7920 fetch_fsmap learned FSMap version 93 2023-10-06T11:13:58.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.443+0000 7fa18408cb80 1 -- 172.21.15.146:0/266315578 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x556e733a94c0 con 0x556e734a69f0 2023-10-06T11:13:58.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.443+0000 7fa152ffd700 1 -- 172.21.15.146:0/266315578 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556e734986e0 con 0x556e734a69f0 2023-10-06T11:13:58.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.443+0000 7fa152ffd700 1 -- 172.21.15.146:0/266315578 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 93) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa16005c150 con 0x556e734a69f0 2023-10-06T11:13:58.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.443+0000 7fa18408cb80 10 client.7920 fetch_fsmap finished waiting for FSMap version 93 2023-10-06T11:13:58.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.443+0000 7fa18408cb80 10 client.7920 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.c 2023-10-06T11:13:58.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.443+0000 7fa18408cb80 20 client.7920 populate_metadata read hostname 'smithi146' 2023-10-06T11:13:58.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.443+0000 7fa18408cb80 1 --2- 172.21.15.146:0/266315578 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x556e734a5650 0x556e734e02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.443+0000 7fa18408cb80 4 client.7920 mds_command: new command op to 7620 tid=0[{"prefix": "scrub status"}] 2023-10-06T11:13:58.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.443+0000 7fa18408cb80 1 -- 172.21.15.146:0/266315578 --> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x556e73396b70 con 0x556e734a5650 2023-10-06T11:13:58.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.443+0000 7fa178b30700 1 --2- 172.21.15.146:0/266315578 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x556e734a5650 0x556e734e02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.443+0000 7fa152ffd700 10 client.7920 ms_handle_connect on v2:172.21.15.146:6834/785131800 2023-10-06T11:13:58.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.443+0000 7fa178b30700 1 --2- 172.21.15.146:0/266315578 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x556e734a5650 0x556e734e02b0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac59515586730131 server_cookie=73c182bffbd9ca7b in_seq=0 out_seq=0 2023-10-06T11:13:58.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.444+0000 7fa152ffd700 1 -- 172.21.15.146:0/266315578 <== mds.0 v2:172.21.15.146:6834/785131800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x556e73396b70 con 0x556e734a5650 2023-10-06T11:13:58.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.444+0000 7fa152ffd700 10 client.7920 handle_command_reply: tid=0 2023-10-06T11:13:58.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.444+0000 7fa18408cb80 1 client.7920 shutdown 2023-10-06T11:13:58.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.444+0000 7fa18408cb80 1 -- 172.21.15.146:0/266315578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e734a69f0 msgr2=0x556e735385c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.444+0000 7fa18408cb80 1 --2- 172.21.15.146:0/266315578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e734a69f0 0x556e735385c0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fa160055340 tx=0x7fa16006c000 comp rx=0 tx=0).stop 2023-10-06T11:13:58.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.444+0000 7fa18408cb80 1 -- 172.21.15.146:0/266315578 shutdown_connections 2023-10-06T11:13:58.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.444+0000 7fa18408cb80 1 --2- 172.21.15.146:0/266315578 >> [v2:172.21.15.146:6834/785131800,v1:172.21.15.146:6835/785131800] conn(0x556e734a5650 0x556e734e02b0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.444+0000 7fa18408cb80 1 --2- 172.21.15.146:0/266315578 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556e734eaae0 0x556e73538b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.444+0000 7fa18408cb80 1 --2- 172.21.15.146:0/266315578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556e734a4c20 0x556e734e5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.444+0000 7fa152ffd700 0 client.7920 ms_handle_reset on v2:172.21.15.146:6834/785131800 2023-10-06T11:13:58.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.444+0000 7fa18408cb80 1 --2- 172.21.15.146:0/266315578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556e734a69f0 0x556e735385c0 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.444+0000 7fa18408cb80 1 -- 172.21.15.146:0/266315578 >> 172.21.15.146:0/266315578 conn(0x556e734a50c0 msgr2=0x556e734e24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:58.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.444+0000 7fa18408cb80 1 -- 172.21.15.146:0/266315578 shutdown_connections 2023-10-06T11:13:58.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.444+0000 7fa18408cb80 1 -- 172.21.15.146:0/266315578 wait complete. 2023-10-06T11:13:58.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.444+0000 7fa18408cb80 20 client.7920 trim_cache size 0 max 16384 2023-10-06T11:13:58.454 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:13:58.454 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "no active scrubs running", 2023-10-06T11:13:58.454 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": {} 2023-10-06T11:13:58.454 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:13:58.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.444+0000 7fa17ad94700 1 -- 172.21.15.146:0/3827487336 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa158066f30 msgr2=0x7fa1580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.444+0000 7fa17ad94700 1 --2- 172.21.15.146:0/3827487336 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa158066f30 0x7fa1580693e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fa1740ce410 tx=0x7fa168017000 comp rx=0 tx=0).stop 2023-10-06T11:13:58.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.444+0000 7fa17ad94700 1 -- 172.21.15.146:0/3827487336 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1740aef20 msgr2=0x7fa1740cb2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.444+0000 7fa17ad94700 1 --2- 172.21.15.146:0/3827487336 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1740aef20 0x7fa1740cb2f0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fa16000ec50 tx=0x7fa1600091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.444+0000 7fa17ad94700 1 -- 172.21.15.146:0/3827487336 shutdown_connections 2023-10-06T11:13:58.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.444+0000 7fa17ad94700 1 --2- 172.21.15.146:0/3827487336 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa158066f30 0x7fa1580693e0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.444+0000 7fa17ad94700 1 --2- 172.21.15.146:0/3827487336 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa17415d710 0x7fa174147000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.445+0000 7fa17ad94700 1 --2- 172.21.15.146:0/3827487336 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa174068ac0 0x7fa1740b3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.445+0000 7fa17ad94700 1 --2- 172.21.15.146:0/3827487336 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1740aef20 0x7fa1740cb2f0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.445+0000 7fa17ad94700 1 -- 172.21.15.146:0/3827487336 >> 172.21.15.146:0/3827487336 conn(0x7fa174067c50 msgr2=0x7fa174152de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:58.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.445+0000 7fa17ad94700 1 -- 172.21.15.146:0/3827487336 shutdown_connections 2023-10-06T11:13:58.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.445+0000 7fa17ad94700 1 -- 172.21.15.146:0/3827487336 wait complete. 2023-10-06T11:13:58.458 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:13:58.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.570+0000 7fcac894a700 1 Processor -- start 2023-10-06T11:13:58.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.570+0000 7fcac894a700 1 -- start start 2023-10-06T11:13:58.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.571+0000 7fcac894a700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcac415a7f0 0x7fcac415cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.571+0000 7fcac894a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcac40b2530 0x7fcac415acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.571+0000 7fcac894a700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcac415c630 con 0x7fcac415a420 2023-10-06T11:13:58.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.571+0000 7fcac894a700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcac40ce040 con 0x7fcac415a7f0 2023-10-06T11:13:58.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.571+0000 7fcac894a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac415ba20 con 0x7fcac40b2530 2023-10-06T11:13:58.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.571+0000 7fcac2ffd700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcac415a7f0 0x7fcac415cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.571+0000 7fcac3fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcac40b2530 0x7fcac415acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.571+0000 7fcac37fe700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fcac415a420 0x7fcac40b1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:55636/0 (socket says 172.21.15.146:55636) 2023-10-06T11:13:58.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.571+0000 7fcac37fe700 1 -- 172.21.15.146:0/2420720262 learned_addr learned my addr 172.21.15.146:0/2420720262 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:13:58.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.571+0000 7fcac2ffd700 1 -- 172.21.15.146:0/2420720262 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcac40b2530 msgr2=0x7fcac415acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:13:58.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.571+0000 7fcac2ffd700 1 --2- 172.21.15.146:0/2420720262 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcac40b2530 0x7fcac415acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.571+0000 7fcac2ffd700 1 -- 172.21.15.146:0/2420720262 >> v1:172.21.15.151:6789/0 conn(0x7fcac415a420 legacy=0x7fcac40b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.571+0000 7fcac2ffd700 1 -- 172.21.15.146:0/2420720262 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac415bd00 con 0x7fcac415a7f0 2023-10-06T11:13:58.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.571+0000 7fcac27fc700 1 -- 172.21.15.146:0/2420720262 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1046657164 0 0) 0x7fcac415c630 con 0x7fcac415a420 2023-10-06T11:13:58.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.571+0000 7fcac3fff700 1 --2- 172.21.15.146:0/2420720262 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcac40b2530 0x7fcac415acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:13:58.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.572+0000 7fcac2ffd700 1 --2- 172.21.15.146:0/2420720262 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcac415a7f0 0x7fcac415cac0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fcaac0098e0 tx=0x7fcaac0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd59270f1ac5ac85 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:58.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.572+0000 7fcac27fc700 1 -- 172.21.15.146:0/2420720262 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaac00b640 con 0x7fcac415a7f0 2023-10-06T11:13:58.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.572+0000 7fcac27fc700 1 -- 172.21.15.146:0/2420720262 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaac00b7a0 con 0x7fcac415a7f0 2023-10-06T11:13:58.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.572+0000 7fcac27fc700 1 -- 172.21.15.146:0/2420720262 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaac00bb40 con 0x7fcac415a7f0 2023-10-06T11:13:58.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.572+0000 7fcac894a700 1 -- 172.21.15.146:0/2420720262 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcac415a7f0 msgr2=0x7fcac415cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.572+0000 7fcac894a700 1 --2- 172.21.15.146:0/2420720262 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcac415a7f0 0x7fcac415cac0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fcaac0098e0 tx=0x7fcaac0091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.572+0000 7fcac894a700 1 -- 172.21.15.146:0/2420720262 shutdown_connections 2023-10-06T11:13:58.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.572+0000 7fcac894a700 1 --2- 172.21.15.146:0/2420720262 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcac40b2530 0x7fcac415acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.572+0000 7fcac894a700 1 --2- 172.21.15.146:0/2420720262 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcac415a7f0 0x7fcac415cac0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.572+0000 7fcac894a700 1 -- 172.21.15.146:0/2420720262 >> 172.21.15.146:0/2420720262 conn(0x7fcac406eba0 msgr2=0x7fcac406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:58.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.572+0000 7fcac894a700 1 -- 172.21.15.146:0/2420720262 shutdown_connections 2023-10-06T11:13:58.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.572+0000 7fcac894a700 1 -- 172.21.15.146:0/2420720262 wait complete. 2023-10-06T11:13:58.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.573+0000 7fcac894a700 1 Processor -- start 2023-10-06T11:13:58.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.574+0000 7fcac894a700 1 -- start start 2023-10-06T11:13:58.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.574+0000 7fcac894a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcac40b2530 0x7fcac4153030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.574+0000 7fcac894a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcac415a420 0x7fcac4150b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.574+0000 7fcac894a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcac415a7f0 0x7fcac4151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.574+0000 7fcac894a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac4152360 con 0x7fcac415a7f0 2023-10-06T11:13:58.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.574+0000 7fcac894a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac41516e0 con 0x7fcac415a420 2023-10-06T11:13:58.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.574+0000 7fcac894a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac41519c0 con 0x7fcac40b2530 2023-10-06T11:13:58.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.574+0000 7fcac3fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcac415a7f0 0x7fcac4151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.574+0000 7fcac3fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcac415a7f0 0x7fcac4151040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47376/0 (socket says 172.21.15.146:47376) 2023-10-06T11:13:58.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.574+0000 7fcac3fff700 1 -- 172.21.15.146:0/160333608 learned_addr learned my addr 172.21.15.146:0/160333608 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:58.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.575+0000 7fcac2ffd700 1 --2- 172.21.15.146:0/160333608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcac415a420 0x7fcac4150b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.575+0000 7fcac37fe700 1 --2- 172.21.15.146:0/160333608 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcac40b2530 0x7fcac4153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.575+0000 7fcac3fff700 1 -- 172.21.15.146:0/160333608 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcac40b2530 msgr2=0x7fcac4153030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.575+0000 7fcac3fff700 1 --2- 172.21.15.146:0/160333608 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcac40b2530 0x7fcac4153030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.575+0000 7fcac3fff700 1 -- 172.21.15.146:0/160333608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcac415a420 msgr2=0x7fcac4150b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.575+0000 7fcac3fff700 1 --2- 172.21.15.146:0/160333608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcac415a420 0x7fcac4150b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.575+0000 7fcac3fff700 1 -- 172.21.15.146:0/160333608 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcabc009420 con 0x7fcac415a7f0 2023-10-06T11:13:58.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.575+0000 7fcac3fff700 1 --2- 172.21.15.146:0/160333608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcac415a7f0 0x7fcac4151040 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fcabc00ea70 tx=0x7fcabc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:58.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.575+0000 7fcabb7fe700 1 -- 172.21.15.146:0/160333608 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcabc00eeb0 con 0x7fcac415a7f0 2023-10-06T11:13:58.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.575+0000 7fcac894a700 1 -- 172.21.15.146:0/160333608 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaac009420 con 0x7fcac415a7f0 2023-10-06T11:13:58.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.575+0000 7fcabb7fe700 1 -- 172.21.15.146:0/160333608 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcabc00c850 con 0x7fcac415a7f0 2023-10-06T11:13:58.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.575+0000 7fcabb7fe700 1 -- 172.21.15.146:0/160333608 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcabc00cc30 con 0x7fcac415a7f0 2023-10-06T11:13:58.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.575+0000 7fcac894a700 1 -- 172.21.15.146:0/160333608 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac4151f80 con 0x7fcac415a7f0 2023-10-06T11:13:58.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.576+0000 7fcac894a700 1 -- 172.21.15.146:0/160333608 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcac40afae0 con 0x7fcac415a7f0 2023-10-06T11:13:58.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.576+0000 7fcabb7fe700 1 -- 172.21.15.146:0/160333608 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcabc013470 con 0x7fcac415a7f0 2023-10-06T11:13:58.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.577+0000 7fcabb7fe700 1 --2- 172.21.15.146:0/160333608 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcaa4066f30 0x7fcaa40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.577+0000 7fcabb7fe700 1 -- 172.21.15.146:0/160333608 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcabc084970 con 0x7fcac415a7f0 2023-10-06T11:13:58.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.577+0000 7fcac37fe700 1 --2- 172.21.15.146:0/160333608 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcaa4066f30 0x7fcaa40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.577+0000 7fcac37fe700 1 --2- 172.21.15.146:0/160333608 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcaa4066f30 0x7fcaa40693e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fcab4002250 tx=0x7fcab4001a20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:58.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.581+0000 7fcabb7fe700 1 -- 172.21.15.146:0/160333608 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcabc051a80 con 0x7fcac415a7f0 2023-10-06T11:13:58.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.805+0000 7fcac894a700 1 -- 172.21.15.146:0/160333608 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcac415bfe0 con 0x7fcac415a7f0 2023-10-06T11:13:58.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.806+0000 7fcabb7fe700 1 -- 172.21.15.146:0/160333608 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4605 (secure 0 0 0) 0x7fcabc017090 con 0x7fcac415a7f0 2023-10-06T11:13:58.808 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:13:58.808 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":93,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/2159562091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2159562091},{"type":"v1","addr":"172.21.15.151:6834","nonce":2159562091}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6242,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/603782012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":603782012},{"type":"v1","addr":"172.21.15.151:6835","nonce":603782012}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6916,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3416056259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3416056259},{"type":"v1","addr":"172.21.15.146:6837","nonce":3416056259}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:13:30.345795+0000","modified":"2023-10-06T11:13:33.984549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7620":{"gid":7620,"name":"c","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/785131800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":785131800},{"type":"v1","addr":"172.21.15.146:6835","nonce":785131800}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T11:13:58.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.808+0000 7fcac894a700 1 -- 172.21.15.146:0/160333608 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcaa4066f30 msgr2=0x7fcaa40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.808+0000 7fcac894a700 1 --2- 172.21.15.146:0/160333608 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcaa4066f30 0x7fcaa40693e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fcab4002250 tx=0x7fcab4001a20 comp rx=0 tx=0).stop 2023-10-06T11:13:58.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.808+0000 7fcac894a700 1 -- 172.21.15.146:0/160333608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcac415a7f0 msgr2=0x7fcac4151040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.808+0000 7fcac894a700 1 --2- 172.21.15.146:0/160333608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcac415a7f0 0x7fcac4151040 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fcabc00ea70 tx=0x7fcabc0091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.808+0000 7fcac894a700 1 -- 172.21.15.146:0/160333608 shutdown_connections 2023-10-06T11:13:58.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.808+0000 7fcac894a700 1 --2- 172.21.15.146:0/160333608 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcaa4066f30 0x7fcaa40693e0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.808+0000 7fcac894a700 1 --2- 172.21.15.146:0/160333608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcac415a7f0 0x7fcac4151040 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.808+0000 7fcac894a700 1 --2- 172.21.15.146:0/160333608 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcac40b2530 0x7fcac4153030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.808+0000 7fcac894a700 1 --2- 172.21.15.146:0/160333608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcac415a420 0x7fcac4150b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.808+0000 7fcac894a700 1 -- 172.21.15.146:0/160333608 >> 172.21.15.146:0/160333608 conn(0x7fcac406eba0 msgr2=0x7fcac40afcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:58.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.808+0000 7fcac894a700 1 -- 172.21.15.146:0/160333608 shutdown_connections 2023-10-06T11:13:58.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.808+0000 7fcac894a700 1 -- 172.21.15.146:0/160333608 wait complete. 2023-10-06T11:13:58.811 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 93 2023-10-06T11:13:58.822 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2023-10-06T11:13:58.822 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T11:13:58.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.933+0000 7f9dcbfff700 1 Processor -- start 2023-10-06T11:13:58.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.933+0000 7f9dcbfff700 1 -- start start 2023-10-06T11:13:58.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.934+0000 7f9dcbfff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9dcc15a420 0x7f9dcc15cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.934+0000 7f9dcbfff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dcc15c630 con 0x7f9dcc0b2530 2023-10-06T11:13:58.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.934+0000 7f9dcbfff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dcc15ba20 con 0x7f9dcc15a7f0 2023-10-06T11:13:58.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.934+0000 7f9dcbfff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dcc0ce040 con 0x7f9dcc15a420 2023-10-06T11:13:58.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.934+0000 7f9dcb7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f9dcc0b2530 0x7f9dcc15acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:37682/0 (socket says 172.21.15.146:37682) 2023-10-06T11:13:58.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.934+0000 7f9dcb7fe700 1 -- 172.21.15.146:0/1270043492 learned_addr learned my addr 172.21.15.146:0/1270043492 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:13:58.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.934+0000 7f9dcaffd700 1 --2- 172.21.15.146:0/1270043492 >> v2:172.21.15.151:3300/0 conn(0x7f9dcc15a420 0x7f9dcc15cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.934+0000 7f9dca7fc700 1 -- 172.21.15.146:0/1270043492 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3361429257 0 0) 0x7f9dcc15c630 con 0x7f9dcc0b2530 2023-10-06T11:13:58.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.934+0000 7f9dca7fc700 1 -- 172.21.15.146:0/1270043492 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9db8003570 con 0x7f9dcc0b2530 2023-10-06T11:13:58.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.935+0000 7f9dca7fc700 1 -- 172.21.15.146:0/1270043492 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1489261315 0 0) 0x7f9dcc15ba20 con 0x7f9dcc15a7f0 2023-10-06T11:13:58.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.935+0000 7f9dca7fc700 1 -- 172.21.15.146:0/1270043492 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9dcc15c630 con 0x7f9dcc15a7f0 2023-10-06T11:13:58.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.935+0000 7f9dcaffd700 1 -- 172.21.15.146:0/1270043492 >> v1:172.21.15.151:6789/0 conn(0x7f9dcc15a7f0 legacy=0x7f9dcc0b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.935+0000 7f9dcaffd700 1 -- 172.21.15.146:0/1270043492 >> v1:172.21.15.146:6789/0 conn(0x7f9dcc0b2530 legacy=0x7f9dcc15acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.935+0000 7f9dcaffd700 1 -- 172.21.15.146:0/1270043492 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dcc15bd00 con 0x7f9dcc15a420 2023-10-06T11:13:58.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.935+0000 7f9dcaffd700 1 --2- 172.21.15.146:0/1270043492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9dcc15a420 0x7f9dcc15cac0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc0098e0 tx=0x7f9dbc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e93ded031c32cd40 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:58.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.935+0000 7f9dca7fc700 1 -- 172.21.15.146:0/1270043492 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc011630 con 0x7f9dcc15a420 2023-10-06T11:13:58.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.935+0000 7f9dca7fc700 1 -- 172.21.15.146:0/1270043492 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dbc011790 con 0x7f9dcc15a420 2023-10-06T11:13:58.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.935+0000 7f9dca7fc700 1 -- 172.21.15.146:0/1270043492 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc011b30 con 0x7f9dcc15a420 2023-10-06T11:13:58.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.935+0000 7f9dcbfff700 1 -- 172.21.15.146:0/1270043492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9dcc15a420 msgr2=0x7f9dcc15cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.935+0000 7f9dcbfff700 1 --2- 172.21.15.146:0/1270043492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9dcc15a420 0x7f9dcc15cac0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc0098e0 tx=0x7f9dbc0091a0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.935+0000 7f9dcbfff700 1 -- 172.21.15.146:0/1270043492 shutdown_connections 2023-10-06T11:13:58.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.935+0000 7f9dcbfff700 1 --2- 172.21.15.146:0/1270043492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9dcc15a420 0x7f9dcc15cac0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.935+0000 7f9dcbfff700 1 -- 172.21.15.146:0/1270043492 >> 172.21.15.146:0/1270043492 conn(0x7f9dcc06eba0 msgr2=0x7f9dcc06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:58.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.936+0000 7f9dcbfff700 1 -- 172.21.15.146:0/1270043492 shutdown_connections 2023-10-06T11:13:58.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.936+0000 7f9dcbfff700 1 -- 172.21.15.146:0/1270043492 wait complete. 2023-10-06T11:13:58.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.937+0000 7f9dcbfff700 1 Processor -- start 2023-10-06T11:13:58.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.937+0000 7f9dcbfff700 1 -- start start 2023-10-06T11:13:58.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.937+0000 7f9dcbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dcc0b2530 0x7f9dcc0b5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.937+0000 7f9dcbfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9dcc15a420 0x7f9dcc1474b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.937+0000 7f9dcbfff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9dcc15a7f0 0x7f9dcc0aff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.937+0000 7f9dcbfff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc148e00 con 0x7f9dcc0b2530 2023-10-06T11:13:58.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.937+0000 7f9dcbfff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc152880 con 0x7f9dcc15a420 2023-10-06T11:13:58.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.937+0000 7f9dcbfff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dcc0b4b30 con 0x7f9dcc15a7f0 2023-10-06T11:13:58.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.938+0000 7f9dcaffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dcc0b2530 0x7f9dcc0b5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.938+0000 7f9dcaffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dcc0b2530 0x7f9dcc0b5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47386/0 (socket says 172.21.15.146:47386) 2023-10-06T11:13:58.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.938+0000 7f9dcaffd700 1 -- 172.21.15.146:0/3093950933 learned_addr learned my addr 172.21.15.146:0/3093950933 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:13:58.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.938+0000 7f9dc27fc700 1 --2- 172.21.15.146:0/3093950933 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9dcc15a420 0x7f9dcc1474b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.938+0000 7f9dcb7fe700 1 --2- 172.21.15.146:0/3093950933 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9dcc15a7f0 0x7f9dcc0aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.938+0000 7f9dcaffd700 1 -- 172.21.15.146:0/3093950933 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9dcc15a7f0 msgr2=0x7f9dcc0aff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.938+0000 7f9dcaffd700 1 --2- 172.21.15.146:0/3093950933 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9dcc15a7f0 0x7f9dcc0aff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.938+0000 7f9dcaffd700 1 -- 172.21.15.146:0/3093950933 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9dcc15a420 msgr2=0x7f9dcc1474b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:58.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.938+0000 7f9dcaffd700 1 --2- 172.21.15.146:0/3093950933 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9dcc15a420 0x7f9dcc1474b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:58.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.938+0000 7f9dcaffd700 1 -- 172.21.15.146:0/3093950933 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dbc009420 con 0x7f9dcc0b2530 2023-10-06T11:13:58.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.938+0000 7f9dcb7fe700 1 --2- 172.21.15.146:0/3093950933 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9dcc15a7f0 0x7f9dcc0aff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:13:58.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.938+0000 7f9dcaffd700 1 --2- 172.21.15.146:0/3093950933 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dcc0b2530 0x7f9dcc0b5850 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc088e40 tx=0x7f9dbc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:58.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.938+0000 7f9dc37fe700 1 -- 172.21.15.146:0/3093950933 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc011b10 con 0x7f9dcc0b2530 2023-10-06T11:13:58.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.938+0000 7f9dcbfff700 1 -- 172.21.15.146:0/3093950933 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dcc152230 con 0x7f9dcc0b2530 2023-10-06T11:13:58.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.938+0000 7f9dc37fe700 1 -- 172.21.15.146:0/3093950933 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dbc000cc0 con 0x7f9dcc0b2530 2023-10-06T11:13:58.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.938+0000 7f9dc37fe700 1 -- 172.21.15.146:0/3093950933 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc01a680 con 0x7f9dcc0b2530 2023-10-06T11:13:58.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.938+0000 7f9dcbfff700 1 -- 172.21.15.146:0/3093950933 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dcc151f00 con 0x7f9dcc0b2530 2023-10-06T11:13:58.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.939+0000 7f9dcbfff700 1 -- 172.21.15.146:0/3093950933 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dcc0afae0 con 0x7f9dcc0b2530 2023-10-06T11:13:58.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.940+0000 7f9dc37fe700 1 -- 172.21.15.146:0/3093950933 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9dbc01a9f0 con 0x7f9dcc0b2530 2023-10-06T11:13:58.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.940+0000 7f9dc37fe700 1 --2- 172.21.15.146:0/3093950933 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9dac066f30 0x7f9dac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:13:58.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.940+0000 7f9dc37fe700 1 -- 172.21.15.146:0/3093950933 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9dbc086380 con 0x7f9dcc0b2530 2023-10-06T11:13:58.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.940+0000 7f9dc27fc700 1 --2- 172.21.15.146:0/3093950933 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9dac066f30 0x7f9dac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:13:58.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.941+0000 7f9dc27fc700 1 --2- 172.21.15.146:0/3093950933 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9dac066f30 0x7f9dac0693e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc0b0d90 tx=0x7f9db4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:13:58.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:58.944+0000 7f9dc37fe700 1 -- 172.21.15.146:0/3093950933 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9dbc053490 con 0x7f9dcc0b2530 2023-10-06T11:13:59.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:59.202+0000 7f9dcbfff700 1 -- 172.21.15.146:0/3093950933 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f9dcc15bfe0 con 0x7f9dcc0b2530 2023-10-06T11:13:59.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:59.203+0000 7f9dc37fe700 1 -- 172.21.15.146:0/3093950933 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1602 (secure 0 0 0) 0x7f9dbc056ab0 con 0x7f9dcc0b2530 2023-10-06T11:13:59.205 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:13:59.205 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":513,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":101,"num_osds":8,"num_up_osds":8,"osd_up_since":1696590336,"num_in_osds":8,"osd_in_since":1696590327,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":1035,"data_bytes":1045190644,"bytes_used":4581130240,"bytes_avail":768512983040,"bytes_total":773094113280,"write_bytes_sec":67652505,"read_op_per_sec":0,"write_op_per_sec":141},"fsmap":{"epoch":93,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":7620}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":19,"modified":"2023-10-06T11:13:57.245589+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T11:13:59.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:59.205+0000 7f9dcbfff700 1 -- 172.21.15.146:0/3093950933 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9dac066f30 msgr2=0x7f9dac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:59.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:59.205+0000 7f9dcbfff700 1 --2- 172.21.15.146:0/3093950933 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9dac066f30 0x7f9dac0693e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc0b0d90 tx=0x7f9db4009040 comp rx=0 tx=0).stop 2023-10-06T11:13:59.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:59.205+0000 7f9dcbfff700 1 -- 172.21.15.146:0/3093950933 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dcc0b2530 msgr2=0x7f9dcc0b5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:13:59.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:59.205+0000 7f9dcbfff700 1 --2- 172.21.15.146:0/3093950933 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dcc0b2530 0x7f9dcc0b5850 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc088e40 tx=0x7f9dbc017000 comp rx=0 tx=0).stop 2023-10-06T11:13:59.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:59.205+0000 7f9dcbfff700 1 -- 172.21.15.146:0/3093950933 shutdown_connections 2023-10-06T11:13:59.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:59.205+0000 7f9dcbfff700 1 --2- 172.21.15.146:0/3093950933 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9dac066f30 0x7f9dac0693e0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:59.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:59.205+0000 7f9dcbfff700 1 --2- 172.21.15.146:0/3093950933 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9dcc15a7f0 0x7f9dcc0aff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:59.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:59.205+0000 7f9dcbfff700 1 --2- 172.21.15.146:0/3093950933 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dcc0b2530 0x7f9dcc0b5850 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:59.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:59.205+0000 7f9dcbfff700 1 --2- 172.21.15.146:0/3093950933 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9dcc15a420 0x7f9dcc1474b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:13:59.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:59.205+0000 7f9dcbfff700 1 -- 172.21.15.146:0/3093950933 >> 172.21.15.146:0/3093950933 conn(0x7f9dcc06eba0 msgr2=0x7f9dcc14e9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:13:59.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:59.205+0000 7f9dcbfff700 1 -- 172.21.15.146:0/3093950933 shutdown_connections 2023-10-06T11:13:59.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:13:59.205+0000 7f9dcbfff700 1 -- 172.21.15.146:0/3093950933 wait complete. 2023-10-06T11:13:59.219 INFO:tasks.cephfs.filesystem.ceph_manager:{'c': 'paused'} 2023-10-06T11:14:00.221 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:14:00.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.334+0000 7f8d85bb1700 1 Processor -- start 2023-10-06T11:14:00.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.334+0000 7f8d85bb1700 1 -- start start 2023-10-06T11:14:00.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.335+0000 7f8d85bb1700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d80159720 0x7f8d8006efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:00.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.335+0000 7f8d85bb1700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8d800a7f30 0x7f8d80067470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:00.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.335+0000 7f8d85bb1700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d8006eb10 con 0x7f8d800679b0 2023-10-06T11:14:00.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.335+0000 7f8d85bb1700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d80067dd0 con 0x7f8d800a7f30 2023-10-06T11:14:00.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.335+0000 7f8d85bb1700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8006e7e0 con 0x7f8d80159720 2023-10-06T11:14:00.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.335+0000 7f8d7ffff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8d800679b0 0x7f8d800aea60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:37694/0 (socket says 172.21.15.146:37694) 2023-10-06T11:14:00.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.335+0000 7f8d7ffff700 1 -- 172.21.15.146:0/3786896318 learned_addr learned my addr 172.21.15.146:0/3786896318 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:14:00.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.336+0000 7f8d7effd700 1 --2- 172.21.15.146:0/3786896318 >> v2:172.21.15.151:3300/0 conn(0x7f8d800a7f30 0x7f8d80067470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:00.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.336+0000 7f8d7f7fe700 1 --2- 172.21.15.146:0/3786896318 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d80159720 0x7f8d8006efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:00.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.336+0000 7f8d7e7fc700 1 -- 172.21.15.146:0/3786896318 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3790124931 0 0) 0x7f8d8006eb10 con 0x7f8d800679b0 2023-10-06T11:14:00.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.336+0000 7f8d7e7fc700 1 -- 172.21.15.146:0/3786896318 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d68003570 con 0x7f8d800679b0 2023-10-06T11:14:00.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.336+0000 7f8d7f7fe700 1 -- 172.21.15.146:0/3786896318 >> v2:172.21.15.151:3300/0 conn(0x7f8d800a7f30 msgr2=0x7f8d80067470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:00.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.336+0000 7f8d7f7fe700 1 --2- 172.21.15.146:0/3786896318 >> v2:172.21.15.151:3300/0 conn(0x7f8d800a7f30 0x7f8d80067470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:00.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.336+0000 7f8d7f7fe700 1 -- 172.21.15.146:0/3786896318 >> v1:172.21.15.146:6789/0 conn(0x7f8d800679b0 legacy=0x7f8d800aea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:00.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.336+0000 7f8d7f7fe700 1 -- 172.21.15.146:0/3786896318 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d8015a860 con 0x7f8d80159720 2023-10-06T11:14:00.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.336+0000 7f8d7effd700 1 --2- 172.21.15.146:0/3786896318 >> v2:172.21.15.151:3300/0 conn(0x7f8d800a7f30 0x7f8d80067470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:14:00.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.336+0000 7f8d7f7fe700 1 --2- 172.21.15.146:0/3786896318 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d80159720 0x7f8d8006efa0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8d700098e0 tx=0x7f8d700091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e59dc3659a9b2981 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:00.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.336+0000 7f8d7e7fc700 1 -- 172.21.15.146:0/3786896318 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d70011630 con 0x7f8d80159720 2023-10-06T11:14:00.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.336+0000 7f8d7e7fc700 1 -- 172.21.15.146:0/3786896318 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d70011790 con 0x7f8d80159720 2023-10-06T11:14:00.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.336+0000 7f8d7e7fc700 1 -- 172.21.15.146:0/3786896318 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d70011b10 con 0x7f8d80159720 2023-10-06T11:14:00.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.337+0000 7f8d85bb1700 1 -- 172.21.15.146:0/3786896318 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d80159720 msgr2=0x7f8d8006efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:00.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.337+0000 7f8d85bb1700 1 --2- 172.21.15.146:0/3786896318 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d80159720 0x7f8d8006efa0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8d700098e0 tx=0x7f8d700091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:00.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.337+0000 7f8d85bb1700 1 -- 172.21.15.146:0/3786896318 shutdown_connections 2023-10-06T11:14:00.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.337+0000 7f8d85bb1700 1 --2- 172.21.15.146:0/3786896318 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d80159720 0x7f8d8006efa0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:00.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.337+0000 7f8d85bb1700 1 --2- 172.21.15.146:0/3786896318 >> v2:172.21.15.151:3300/0 conn(0x7f8d800a7f30 0x7f8d80067470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:00.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.337+0000 7f8d85bb1700 1 -- 172.21.15.146:0/3786896318 >> 172.21.15.146:0/3786896318 conn(0x7f8d80068580 msgr2=0x7f8d80068980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:00.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.337+0000 7f8d85bb1700 1 -- 172.21.15.146:0/3786896318 shutdown_connections 2023-10-06T11:14:00.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.337+0000 7f8d85bb1700 1 -- 172.21.15.146:0/3786896318 wait complete. 2023-10-06T11:14:00.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.338+0000 7f8d85bb1700 1 Processor -- start 2023-10-06T11:14:00.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.338+0000 7f8d85bb1700 1 -- start start 2023-10-06T11:14:00.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.339+0000 7f8d85bb1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d800679b0 0x7f8d80158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:00.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.339+0000 7f8d85bb1700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d800a7f30 0x7f8d80099500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:00.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.339+0000 7f8d85bb1700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d80159720 0x7f8d800cac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:00.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.339+0000 7f8d85bb1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8015c180 con 0x7f8d800679b0 2023-10-06T11:14:00.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.339+0000 7f8d85bb1700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d80098060 con 0x7f8d800a7f30 2023-10-06T11:14:00.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.339+0000 7f8d85bb1700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d80097d80 con 0x7f8d80159720 2023-10-06T11:14:00.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.339+0000 7f8d7f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d800679b0 0x7f8d80158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:00.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.339+0000 7f8d7f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d800679b0 0x7f8d80158ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47388/0 (socket says 172.21.15.146:47388) 2023-10-06T11:14:00.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.339+0000 7f8d7f7fe700 1 -- 172.21.15.146:0/316743474 learned_addr learned my addr 172.21.15.146:0/316743474 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:00.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.339+0000 7f8d7ffff700 1 --2- 172.21.15.146:0/316743474 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d80159720 0x7f8d800cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:00.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.339+0000 7f8d7effd700 1 --2- 172.21.15.146:0/316743474 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d800a7f30 0x7f8d80099500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:00.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.339+0000 7f8d7f7fe700 1 -- 172.21.15.146:0/316743474 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d80159720 msgr2=0x7f8d800cac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:00.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.339+0000 7f8d7f7fe700 1 --2- 172.21.15.146:0/316743474 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d80159720 0x7f8d800cac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:00.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.339+0000 7f8d7f7fe700 1 -- 172.21.15.146:0/316743474 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d800a7f30 msgr2=0x7f8d80099500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:00.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.339+0000 7f8d7f7fe700 1 --2- 172.21.15.146:0/316743474 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d800a7f30 0x7f8d80099500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:00.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.339+0000 7f8d7f7fe700 1 -- 172.21.15.146:0/316743474 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d74009420 con 0x7f8d800679b0 2023-10-06T11:14:00.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.339+0000 7f8d7effd700 1 --2- 172.21.15.146:0/316743474 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d800a7f30 0x7f8d80099500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:00.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.339+0000 7f8d7ffff700 1 --2- 172.21.15.146:0/316743474 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d80159720 0x7f8d800cac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:00.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.339+0000 7f8d7f7fe700 1 --2- 172.21.15.146:0/316743474 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d800679b0 0x7f8d80158ae0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f8d8015e600 tx=0x7f8d70017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:00.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.339+0000 7f8d677fe700 1 -- 172.21.15.146:0/316743474 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d70011b10 con 0x7f8d800679b0 2023-10-06T11:14:00.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.339+0000 7f8d677fe700 1 -- 172.21.15.146:0/316743474 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d70000cc0 con 0x7f8d800679b0 2023-10-06T11:14:00.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.339+0000 7f8d677fe700 1 -- 172.21.15.146:0/316743474 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7001a680 con 0x7f8d800679b0 2023-10-06T11:14:00.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.339+0000 7f8d85bb1700 1 -- 172.21.15.146:0/316743474 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d70009420 con 0x7f8d800679b0 2023-10-06T11:14:00.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.340+0000 7f8d85bb1700 1 -- 172.21.15.146:0/316743474 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d8015c700 con 0x7f8d800679b0 2023-10-06T11:14:00.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.340+0000 7f8d85bb1700 1 -- 172.21.15.146:0/316743474 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d8015bfe0 con 0x7f8d800679b0 2023-10-06T11:14:00.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.341+0000 7f8d677fe700 1 -- 172.21.15.146:0/316743474 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8d7001aa70 con 0x7f8d800679b0 2023-10-06T11:14:00.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.341+0000 7f8d677fe700 1 --2- 172.21.15.146:0/316743474 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8d6c066f30 0x7f8d6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:00.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.341+0000 7f8d7effd700 1 --2- 172.21.15.146:0/316743474 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8d6c066f30 0x7f8d6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:00.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.341+0000 7f8d677fe700 1 -- 172.21.15.146:0/316743474 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8d70086340 con 0x7f8d800679b0 2023-10-06T11:14:00.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.342+0000 7f8d7effd700 1 --2- 172.21.15.146:0/316743474 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8d6c066f30 0x7f8d6c0693e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f8d740093f0 tx=0x7f8d74008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:00.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.346+0000 7f8d677fe700 1 -- 172.21.15.146:0/316743474 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8d8015bfe0 con 0x7f8d800679b0 2023-10-06T11:14:00.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.570+0000 7f8d85bb1700 1 -- 172.21.15.146:0/316743474 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d8015bfe0 con 0x7f8d800679b0 2023-10-06T11:14:00.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.571+0000 7f8d677fe700 1 -- 172.21.15.146:0/316743474 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f8d8015bfe0 con 0x7f8d800679b0 2023-10-06T11:14:00.573 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:00.573 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":93,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/2159562091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2159562091},{"type":"v1","addr":"172.21.15.151:6834","nonce":2159562091}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6242,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/603782012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":603782012},{"type":"v1","addr":"172.21.15.151:6835","nonce":603782012}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6916,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3416056259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3416056259},{"type":"v1","addr":"172.21.15.146:6837","nonce":3416056259}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:13:30.345795+0000","modified":"2023-10-06T11:13:33.984549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7620":{"gid":7620,"name":"c","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/785131800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":785131800},{"type":"v1","addr":"172.21.15.146:6835","nonce":785131800}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T11:14:00.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.573+0000 7f8d85bb1700 1 -- 172.21.15.146:0/316743474 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8d6c066f30 msgr2=0x7f8d6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:00.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.573+0000 7f8d85bb1700 1 --2- 172.21.15.146:0/316743474 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8d6c066f30 0x7f8d6c0693e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f8d740093f0 tx=0x7f8d74008040 comp rx=0 tx=0).stop 2023-10-06T11:14:00.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.573+0000 7f8d85bb1700 1 -- 172.21.15.146:0/316743474 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d800679b0 msgr2=0x7f8d80158ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:00.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.573+0000 7f8d85bb1700 1 --2- 172.21.15.146:0/316743474 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d800679b0 0x7f8d80158ae0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f8d8015e600 tx=0x7f8d70017000 comp rx=0 tx=0).stop 2023-10-06T11:14:00.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.573+0000 7f8d85bb1700 1 -- 172.21.15.146:0/316743474 shutdown_connections 2023-10-06T11:14:00.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.573+0000 7f8d85bb1700 1 --2- 172.21.15.146:0/316743474 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8d6c066f30 0x7f8d6c0693e0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:00.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.573+0000 7f8d85bb1700 1 --2- 172.21.15.146:0/316743474 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d80159720 0x7f8d800cac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:00.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.573+0000 7f8d85bb1700 1 --2- 172.21.15.146:0/316743474 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d800679b0 0x7f8d80158ae0 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:00.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.573+0000 7f8d85bb1700 1 --2- 172.21.15.146:0/316743474 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d800a7f30 0x7f8d80099500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:00.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.573+0000 7f8d85bb1700 1 -- 172.21.15.146:0/316743474 >> 172.21.15.146:0/316743474 conn(0x7f8d80068580 msgr2=0x7f8d8006a710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:00.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.573+0000 7f8d85bb1700 1 -- 172.21.15.146:0/316743474 shutdown_connections 2023-10-06T11:14:00.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.573+0000 7f8d85bb1700 1 -- 172.21.15.146:0/316743474 wait complete. 2023-10-06T11:14:00.576 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 93 2023-10-06T11:14:00.586 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2023-10-06T11:14:00.587 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T11:14:00.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.698+0000 7ff21790d700 1 Processor -- start 2023-10-06T11:14:00.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.698+0000 7ff21790d700 1 -- start start 2023-10-06T11:14:00.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.699+0000 7ff21790d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff210068ba0 0x7ff21015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:00.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.699+0000 7ff21790d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff21015ac30 con 0x7ff210153ab0 2023-10-06T11:14:00.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.699+0000 7ff21790d700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2100b4510 con 0x7ff210153e80 2023-10-06T11:14:00.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.699+0000 7ff21790d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2100b6530 con 0x7ff210068ba0 2023-10-06T11:14:00.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.699+0000 7ff2156a9700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff210153ab0 0x7ff210068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:37702/0 (socket says 172.21.15.146:37702) 2023-10-06T11:14:00.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.699+0000 7ff2156a9700 1 -- 172.21.15.146:0/1449158508 learned_addr learned my addr 172.21.15.146:0/1449158508 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:14:00.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.699+0000 7ff214ea8700 1 --2- 172.21.15.146:0/1449158508 >> v2:172.21.15.146:3300/0 conn(0x7ff210068ba0 0x7ff21015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:00.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.700+0000 7ff207fff700 1 -- 172.21.15.146:0/1449158508 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1415404139 0 0) 0x7ff20c001110 con 0x7ff210153ab0 2023-10-06T11:14:00.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.700+0000 7ff207fff700 1 -- 172.21.15.146:0/1449158508 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1fc003570 con 0x7ff210153ab0 2023-10-06T11:14:00.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.700+0000 7ff214ea8700 1 -- 172.21.15.146:0/1449158508 >> v1:172.21.15.151:6789/0 conn(0x7ff210153e80 legacy=0x7ff2100b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:00.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.700+0000 7ff214ea8700 1 -- 172.21.15.146:0/1449158508 >> v1:172.21.15.146:6789/0 conn(0x7ff210153ab0 legacy=0x7ff210068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:00.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.700+0000 7ff214ea8700 1 -- 172.21.15.146:0/1449158508 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2100b5c50 con 0x7ff210068ba0 2023-10-06T11:14:00.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.700+0000 7ff214ea8700 1 --2- 172.21.15.146:0/1449158508 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff210068ba0 0x7ff21015a6f0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7ff2000098e0 tx=0x7ff2000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b27b507131d1d7ee server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:00.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.700+0000 7ff207fff700 1 -- 172.21.15.146:0/1449158508 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20000b640 con 0x7ff210068ba0 2023-10-06T11:14:00.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.700+0000 7ff207fff700 1 -- 172.21.15.146:0/1449158508 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20000b7a0 con 0x7ff210068ba0 2023-10-06T11:14:00.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.700+0000 7ff207fff700 1 -- 172.21.15.146:0/1449158508 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20000bb40 con 0x7ff210068ba0 2023-10-06T11:14:00.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.700+0000 7ff21790d700 1 -- 172.21.15.146:0/1449158508 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff210068ba0 msgr2=0x7ff21015a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:00.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.700+0000 7ff21790d700 1 --2- 172.21.15.146:0/1449158508 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff210068ba0 0x7ff21015a6f0 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7ff2000098e0 tx=0x7ff2000091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:00.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.701+0000 7ff21790d700 1 -- 172.21.15.146:0/1449158508 shutdown_connections 2023-10-06T11:14:00.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.701+0000 7ff21790d700 1 --2- 172.21.15.146:0/1449158508 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff210068ba0 0x7ff21015a6f0 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:00.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.701+0000 7ff21790d700 1 -- 172.21.15.146:0/1449158508 >> 172.21.15.146:0/1449158508 conn(0x7ff21006eba0 msgr2=0x7ff21006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:00.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.701+0000 7ff21790d700 1 -- 172.21.15.146:0/1449158508 shutdown_connections 2023-10-06T11:14:00.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.701+0000 7ff21790d700 1 -- 172.21.15.146:0/1449158508 wait complete. 2023-10-06T11:14:00.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.702+0000 7ff21790d700 1 Processor -- start 2023-10-06T11:14:00.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.702+0000 7ff21790d700 1 -- start start 2023-10-06T11:14:00.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.703+0000 7ff21790d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff210068ba0 0x7ff210157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:00.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.703+0000 7ff21790d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff210153ab0 0x7ff2100c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:00.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.703+0000 7ff21790d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff210153e80 0x7ff210157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:00.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.703+0000 7ff21790d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff210159280 con 0x7ff210068ba0 2023-10-06T11:14:00.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.703+0000 7ff21790d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2100c6550 con 0x7ff210153ab0 2023-10-06T11:14:00.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.703+0000 7ff21790d700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff210158df0 con 0x7ff210153e80 2023-10-06T11:14:00.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.703+0000 7ff2156a9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff210068ba0 0x7ff210157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:00.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.703+0000 7ff2156a9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff210068ba0 0x7ff210157250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47410/0 (socket says 172.21.15.146:47410) 2023-10-06T11:14:00.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.703+0000 7ff2156a9700 1 -- 172.21.15.146:0/3898502536 learned_addr learned my addr 172.21.15.146:0/3898502536 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:00.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.703+0000 7ff215eaa700 1 --2- 172.21.15.146:0/3898502536 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff210153e80 0x7ff210157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:00.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.703+0000 7ff214ea8700 1 --2- 172.21.15.146:0/3898502536 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff210153ab0 0x7ff2100c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:00.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.703+0000 7ff2156a9700 1 -- 172.21.15.146:0/3898502536 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff210153e80 msgr2=0x7ff210157b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:00.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.703+0000 7ff2156a9700 1 --2- 172.21.15.146:0/3898502536 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff210153e80 0x7ff210157b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:00.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.703+0000 7ff2156a9700 1 -- 172.21.15.146:0/3898502536 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff210153ab0 msgr2=0x7ff2100c5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:00.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.703+0000 7ff2156a9700 1 --2- 172.21.15.146:0/3898502536 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff210153ab0 0x7ff2100c5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:00.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.703+0000 7ff2156a9700 1 -- 172.21.15.146:0/3898502536 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff200009420 con 0x7ff210068ba0 2023-10-06T11:14:00.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.703+0000 7ff214ea8700 1 --2- 172.21.15.146:0/3898502536 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff210153ab0 0x7ff2100c5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:00.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.703+0000 7ff2156a9700 1 --2- 172.21.15.146:0/3898502536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff210068ba0 0x7ff210157250 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7ff20c00c7c0 tx=0x7ff20c007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:00.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.703+0000 7ff2057fa700 1 -- 172.21.15.146:0/3898502536 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c005b30 con 0x7ff210068ba0 2023-10-06T11:14:00.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.703+0000 7ff2057fa700 1 -- 172.21.15.146:0/3898502536 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20c005c90 con 0x7ff210068ba0 2023-10-06T11:14:00.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.703+0000 7ff2057fa700 1 -- 172.21.15.146:0/3898502536 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c007320 con 0x7ff210068ba0 2023-10-06T11:14:00.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.703+0000 7ff21790d700 1 -- 172.21.15.146:0/3898502536 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2100c62d0 con 0x7ff210068ba0 2023-10-06T11:14:00.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.703+0000 7ff21790d700 1 -- 172.21.15.146:0/3898502536 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff210158a80 con 0x7ff210068ba0 2023-10-06T11:14:00.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.704+0000 7ff21790d700 1 -- 172.21.15.146:0/3898502536 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff21004c380 con 0x7ff210068ba0 2023-10-06T11:14:00.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.705+0000 7ff2057fa700 1 -- 172.21.15.146:0/3898502536 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff20c01b3b0 con 0x7ff210068ba0 2023-10-06T11:14:00.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.705+0000 7ff2057fa700 1 --2- 172.21.15.146:0/3898502536 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff1f4066f60 0x7ff1f4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:00.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.705+0000 7ff2057fa700 1 -- 172.21.15.146:0/3898502536 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff20c083ab0 con 0x7ff210068ba0 2023-10-06T11:14:00.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.705+0000 7ff214ea8700 1 --2- 172.21.15.146:0/3898502536 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff1f4066f60 0x7ff1f4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:00.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.706+0000 7ff214ea8700 1 --2- 172.21.15.146:0/3898502536 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff1f4066f60 0x7ff1f4069410 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff210068fa0 tx=0x7ff200017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:00.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.709+0000 7ff2057fa700 1 -- 172.21.15.146:0/3898502536 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff20c050bc0 con 0x7ff210068ba0 2023-10-06T11:14:00.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.971+0000 7ff21790d700 1 -- 172.21.15.146:0/3898502536 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7ff21015ac30 con 0x7ff210068ba0 2023-10-06T11:14:00.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.971+0000 7ff2057fa700 1 -- 172.21.15.146:0/3898502536 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1602 (secure 0 0 0) 0x7ff21015ac30 con 0x7ff210068ba0 2023-10-06T11:14:00.973 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:00.973 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":515,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":101,"num_osds":8,"num_up_osds":8,"osd_up_since":1696590336,"num_in_osds":8,"osd_in_since":1696590327,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":1071,"data_bytes":1077926949,"bytes_used":4668391424,"bytes_avail":768425721856,"bytes_total":773094113280,"write_bytes_sec":51339531,"read_op_per_sec":0,"write_op_per_sec":173},"fsmap":{"epoch":93,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":7620}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":19,"modified":"2023-10-06T11:13:57.245589+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T11:14:00.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.973+0000 7ff21790d700 1 -- 172.21.15.146:0/3898502536 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff1f4066f60 msgr2=0x7ff1f4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:00.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.973+0000 7ff21790d700 1 --2- 172.21.15.146:0/3898502536 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff1f4066f60 0x7ff1f4069410 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff210068fa0 tx=0x7ff200017000 comp rx=0 tx=0).stop 2023-10-06T11:14:00.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.973+0000 7ff21790d700 1 -- 172.21.15.146:0/3898502536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff210068ba0 msgr2=0x7ff210157250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:00.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.973+0000 7ff21790d700 1 --2- 172.21.15.146:0/3898502536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff210068ba0 0x7ff210157250 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7ff20c00c7c0 tx=0x7ff20c007c70 comp rx=0 tx=0).stop 2023-10-06T11:14:00.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.974+0000 7ff21790d700 1 -- 172.21.15.146:0/3898502536 shutdown_connections 2023-10-06T11:14:00.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.974+0000 7ff21790d700 1 --2- 172.21.15.146:0/3898502536 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff1f4066f60 0x7ff1f4069410 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:00.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.974+0000 7ff21790d700 1 --2- 172.21.15.146:0/3898502536 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff210153e80 0x7ff210157b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:00.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.974+0000 7ff21790d700 1 --2- 172.21.15.146:0/3898502536 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff210068ba0 0x7ff210157250 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:00.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.974+0000 7ff21790d700 1 --2- 172.21.15.146:0/3898502536 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff210153ab0 0x7ff2100c5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:00.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.974+0000 7ff21790d700 1 -- 172.21.15.146:0/3898502536 >> 172.21.15.146:0/3898502536 conn(0x7ff21006eba0 msgr2=0x7ff21015add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:00.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.974+0000 7ff21790d700 1 -- 172.21.15.146:0/3898502536 shutdown_connections 2023-10-06T11:14:00.977 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:00.974+0000 7ff21790d700 1 -- 172.21.15.146:0/3898502536 wait complete. 2023-10-06T11:14:00.987 INFO:tasks.cephfs.filesystem.ceph_manager:{'c': 'paused'} 2023-10-06T11:14:01.988 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:14:02.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.105+0000 7f58d18ae700 1 Processor -- start 2023-10-06T11:14:02.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.105+0000 7f58d18ae700 1 -- start start 2023-10-06T11:14:02.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.106+0000 7f58d18ae700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58cc153ab0 0x7f58cc15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:02.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.106+0000 7f58d18ae700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58cc15ac30 con 0x7f58cc068ba0 2023-10-06T11:14:02.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.106+0000 7f58d18ae700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58cc0b4510 con 0x7f58cc153e80 2023-10-06T11:14:02.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.106+0000 7f58d18ae700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58cc0b6530 con 0x7f58cc153ab0 2023-10-06T11:14:02.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.106+0000 7f58cb7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f58cc068ba0 0x7f58cc0b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33828/0 (socket says 172.21.15.146:33828) 2023-10-06T11:14:02.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.106+0000 7f58cb7fe700 1 -- 172.21.15.146:0/3776938769 learned_addr learned my addr 172.21.15.146:0/3776938769 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:14:02.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.106+0000 7f58caffd700 1 --2- 172.21.15.146:0/3776938769 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58cc153ab0 0x7f58cc15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:02.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.106+0000 7f58ca7fc700 1 -- 172.21.15.146:0/3776938769 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3259985228 0 0) 0x7f58c4001490 con 0x7f58cc068ba0 2023-10-06T11:14:02.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.107+0000 7f58ca7fc700 1 -- 172.21.15.146:0/3776938769 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58b8003570 con 0x7f58cc068ba0 2023-10-06T11:14:02.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.107+0000 7f58ca7fc700 1 -- 172.21.15.146:0/3776938769 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2607135129 0 0) 0x7f58cc0b4510 con 0x7f58cc153e80 2023-10-06T11:14:02.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.107+0000 7f58ca7fc700 1 -- 172.21.15.146:0/3776938769 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58c4001490 con 0x7f58cc153e80 2023-10-06T11:14:02.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.107+0000 7f58ca7fc700 1 -- 172.21.15.146:0/3776938769 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2827864746 0 0) 0x7f58b8003570 con 0x7f58cc068ba0 2023-10-06T11:14:02.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.107+0000 7f58ca7fc700 1 -- 172.21.15.146:0/3776938769 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58cc153ab0 msgr2=0x7f58cc15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:02.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.107+0000 7f58ca7fc700 1 --2- 172.21.15.146:0/3776938769 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58cc153ab0 0x7f58cc15a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:02.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.107+0000 7f58ca7fc700 1 -- 172.21.15.146:0/3776938769 >> v1:172.21.15.151:6789/0 conn(0x7f58cc153e80 legacy=0x7f58cc068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:02.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.107+0000 7f58ca7fc700 1 -- 172.21.15.146:0/3776938769 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58cc0b5c50 con 0x7f58cc068ba0 2023-10-06T11:14:02.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.107+0000 7f58ca7fc700 1 -- 172.21.15.146:0/3776938769 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f58c4001980 con 0x7f58cc068ba0 2023-10-06T11:14:02.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.107+0000 7f58ca7fc700 1 -- 172.21.15.146:0/3776938769 >> v1:172.21.15.146:6789/0 conn(0x7f58cc068ba0 legacy=0x7f58cc0b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:02.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.107+0000 7f58ca7fc700 1 --2- 172.21.15.146:0/3776938769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58b8003c20 0x7f58b8004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:02.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.107+0000 7f58ca7fc700 1 --2- 172.21.15.146:0/3776938769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58b8004810 0x7f58b8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:02.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.107+0000 7f58ca7fc700 1 --2- 172.21.15.146:0/3776938769 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58cc153ab0 0x7f58b8005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:02.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.107+0000 7f58ca7fc700 1 -- 172.21.15.146:0/3776938769 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58cc0b6530 con 0x7f58b8004810 2023-10-06T11:14:02.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.107+0000 7f58ca7fc700 1 -- 172.21.15.146:0/3776938769 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b800bbf0 con 0x7f58b8003c20 2023-10-06T11:14:02.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.107+0000 7f58ca7fc700 1 -- 172.21.15.146:0/3776938769 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58b800bdb0 con 0x7f58cc153ab0 2023-10-06T11:14:02.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.107+0000 7f58c27fc700 1 --2- 172.21.15.146:0/3776938769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58b8004810 0x7f58b8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:02.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.107+0000 7f58caffd700 1 --2- 172.21.15.146:0/3776938769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58b8003c20 0x7f58b8004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:02.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.107+0000 7f58cb7fe700 1 --2- 172.21.15.146:0/3776938769 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58cc153ab0 0x7f58b8005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:02.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.107+0000 7f58c27fc700 1 -- 172.21.15.146:0/3776938769 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58cc153ab0 msgr2=0x7f58b8005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:02.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.107+0000 7f58c27fc700 1 --2- 172.21.15.146:0/3776938769 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58cc153ab0 0x7f58b8005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:02.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.107+0000 7f58c27fc700 1 -- 172.21.15.146:0/3776938769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58b8003c20 msgr2=0x7f58b8004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:02.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.107+0000 7f58c27fc700 1 --2- 172.21.15.146:0/3776938769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58b8003c20 0x7f58b8004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:02.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.107+0000 7f58c27fc700 1 -- 172.21.15.146:0/3776938769 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b8003570 con 0x7f58b8004810 2023-10-06T11:14:02.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.107+0000 7f58c27fc700 1 --2- 172.21.15.146:0/3776938769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58b8004810 0x7f58b8004c80 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f58b40019e0 tx=0x7f58b4007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=594a72e0684f7895 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:02.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.108+0000 7f58ca7fc700 1 -- 172.21.15.146:0/3776938769 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b400c5d0 con 0x7f58b8004810 2023-10-06T11:14:02.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.108+0000 7f58ca7fc700 1 -- 172.21.15.146:0/3776938769 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b400c730 con 0x7f58b8004810 2023-10-06T11:14:02.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.108+0000 7f58ca7fc700 1 -- 172.21.15.146:0/3776938769 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b400cad0 con 0x7f58b8004810 2023-10-06T11:14:02.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.108+0000 7f58d18ae700 1 -- 172.21.15.146:0/3776938769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58b8004810 msgr2=0x7f58b8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:02.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.108+0000 7f58d18ae700 1 --2- 172.21.15.146:0/3776938769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58b8004810 0x7f58b8004c80 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f58b40019e0 tx=0x7f58b4007d30 comp rx=0 tx=0).stop 2023-10-06T11:14:02.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.108+0000 7f58cb7fe700 1 -- 172.21.15.146:0/3776938769 reap_dead start 2023-10-06T11:14:02.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.108+0000 7f58d18ae700 1 -- 172.21.15.146:0/3776938769 shutdown_connections 2023-10-06T11:14:02.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.108+0000 7f58d18ae700 1 -- 172.21.15.146:0/3776938769 >> 172.21.15.146:0/3776938769 conn(0x7f58cc06eba0 msgr2=0x7f58cc06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:02.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.108+0000 7f58d18ae700 1 -- 172.21.15.146:0/3776938769 shutdown_connections 2023-10-06T11:14:02.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.108+0000 7f58d18ae700 1 -- 172.21.15.146:0/3776938769 wait complete. 2023-10-06T11:14:02.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.109+0000 7f58d18ae700 1 Processor -- start 2023-10-06T11:14:02.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.109+0000 7f58d18ae700 1 -- start start 2023-10-06T11:14:02.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.110+0000 7f58d18ae700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58b8004810 0x7f58cc1409a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:02.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.110+0000 7f58d18ae700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58cc16ddb0 0x7f58cc159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:02.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.110+0000 7f58d18ae700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58cc16d0e0 0x7f58cc16d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:02.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.110+0000 7f58d18ae700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58cc16daa0 con 0x7f58cc16ddb0 2023-10-06T11:14:02.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.110+0000 7f58d18ae700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58cc157560 con 0x7f58cc16d0e0 2023-10-06T11:14:02.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.110+0000 7f58d18ae700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58cc156950 con 0x7f58b8004810 2023-10-06T11:14:02.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.110+0000 7f58c27fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58cc16ddb0 0x7f58cc159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:02.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.110+0000 7f58c27fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58cc16ddb0 0x7f58cc159230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34878/0 (socket says 172.21.15.146:34878) 2023-10-06T11:14:02.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.110+0000 7f58c27fc700 1 -- 172.21.15.146:0/3089661803 learned_addr learned my addr 172.21.15.146:0/3089661803 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:02.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.110+0000 7f58caffd700 1 --2- 172.21.15.146:0/3089661803 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58b8004810 0x7f58cc1409a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:02.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.110+0000 7f58cb7fe700 1 --2- 172.21.15.146:0/3089661803 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58cc16d0e0 0x7f58cc16d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:02.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.110+0000 7f58c27fc700 1 -- 172.21.15.146:0/3089661803 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58b8004810 msgr2=0x7f58cc1409a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:02.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.110+0000 7f58c27fc700 1 --2- 172.21.15.146:0/3089661803 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58b8004810 0x7f58cc1409a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:02.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.110+0000 7f58c27fc700 1 -- 172.21.15.146:0/3089661803 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58cc16d0e0 msgr2=0x7f58cc16d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:02.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.110+0000 7f58c27fc700 1 --2- 172.21.15.146:0/3089661803 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58cc16d0e0 0x7f58cc16d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:02.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.110+0000 7f58c27fc700 1 -- 172.21.15.146:0/3089661803 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58cc156c30 con 0x7f58cc16ddb0 2023-10-06T11:14:02.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.111+0000 7f58c27fc700 1 --2- 172.21.15.146:0/3089661803 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58cc16ddb0 0x7f58cc159230 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f58b4012f00 tx=0x7f58b4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:02.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.111+0000 7f58c37fe700 1 -- 172.21.15.146:0/3089661803 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b400cab0 con 0x7f58cc16ddb0 2023-10-06T11:14:02.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.111+0000 7f58c37fe700 1 -- 172.21.15.146:0/3089661803 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b4001360 con 0x7f58cc16ddb0 2023-10-06T11:14:02.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.111+0000 7f58d18ae700 1 -- 172.21.15.146:0/3089661803 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58cc156f10 con 0x7f58cc16ddb0 2023-10-06T11:14:02.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.111+0000 7f58c37fe700 1 -- 172.21.15.146:0/3089661803 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b4006a70 con 0x7f58cc16ddb0 2023-10-06T11:14:02.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.111+0000 7f58d18ae700 1 -- 172.21.15.146:0/3089661803 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58cc140ee0 con 0x7f58cc16ddb0 2023-10-06T11:14:02.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.112+0000 7f58d18ae700 1 -- 172.21.15.146:0/3089661803 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58cc1576f0 con 0x7f58cc16ddb0 2023-10-06T11:14:02.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.112+0000 7f58c37fe700 1 -- 172.21.15.146:0/3089661803 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f58b4019070 con 0x7f58cc16ddb0 2023-10-06T11:14:02.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.112+0000 7f58c37fe700 1 --2- 172.21.15.146:0/3089661803 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f58ac066f30 0x7f58ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:02.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.112+0000 7f58c37fe700 1 -- 172.21.15.146:0/3089661803 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f58b4085bd0 con 0x7f58cc16ddb0 2023-10-06T11:14:02.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.113+0000 7f58caffd700 1 --2- 172.21.15.146:0/3089661803 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f58ac066f30 0x7f58ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:02.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.113+0000 7f58caffd700 1 --2- 172.21.15.146:0/3089661803 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f58ac066f30 0x7f58ac0693e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f58bc006dc0 tx=0x7f58bc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:02.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.117+0000 7f58c37fe700 1 -- 172.21.15.146:0/3089661803 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f58b4052ce0 con 0x7f58cc16ddb0 2023-10-06T11:14:02.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.344+0000 7f58d18ae700 1 -- 172.21.15.146:0/3089661803 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58cc04c380 con 0x7f58cc16ddb0 2023-10-06T11:14:02.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.345+0000 7f58c37fe700 1 -- 172.21.15.146:0/3089661803 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f58b4017090 con 0x7f58cc16ddb0 2023-10-06T11:14:02.346 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:02.347 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":93,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/2159562091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2159562091},{"type":"v1","addr":"172.21.15.151:6834","nonce":2159562091}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6242,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/603782012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":603782012},{"type":"v1","addr":"172.21.15.151:6835","nonce":603782012}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6916,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3416056259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3416056259},{"type":"v1","addr":"172.21.15.146:6837","nonce":3416056259}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:13:30.345795+0000","modified":"2023-10-06T11:13:33.984549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7620":{"gid":7620,"name":"c","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/785131800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":785131800},{"type":"v1","addr":"172.21.15.146:6835","nonce":785131800}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T11:14:02.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.347+0000 7f58d18ae700 1 -- 172.21.15.146:0/3089661803 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f58ac066f30 msgr2=0x7f58ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:02.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.347+0000 7f58d18ae700 1 --2- 172.21.15.146:0/3089661803 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f58ac066f30 0x7f58ac0693e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f58bc006dc0 tx=0x7f58bc008040 comp rx=0 tx=0).stop 2023-10-06T11:14:02.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.347+0000 7f58d18ae700 1 -- 172.21.15.146:0/3089661803 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58cc16ddb0 msgr2=0x7f58cc159230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:02.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.347+0000 7f58d18ae700 1 --2- 172.21.15.146:0/3089661803 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58cc16ddb0 0x7f58cc159230 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f58b4012f00 tx=0x7f58b4015000 comp rx=0 tx=0).stop 2023-10-06T11:14:02.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.347+0000 7f58d18ae700 1 -- 172.21.15.146:0/3089661803 shutdown_connections 2023-10-06T11:14:02.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.347+0000 7f58d18ae700 1 --2- 172.21.15.146:0/3089661803 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f58ac066f30 0x7f58ac0693e0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:02.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.347+0000 7f58d18ae700 1 --2- 172.21.15.146:0/3089661803 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58cc16d0e0 0x7f58cc16d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:02.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.347+0000 7f58d18ae700 1 --2- 172.21.15.146:0/3089661803 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58b8004810 0x7f58cc1409a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:02.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.347+0000 7f58d18ae700 1 --2- 172.21.15.146:0/3089661803 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f58cc16ddb0 0x7f58cc159230 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:02.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.347+0000 7f58d18ae700 1 -- 172.21.15.146:0/3089661803 >> 172.21.15.146:0/3089661803 conn(0x7f58cc06eba0 msgr2=0x7f58cc152530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:02.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.347+0000 7f58d18ae700 1 -- 172.21.15.146:0/3089661803 shutdown_connections 2023-10-06T11:14:02.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.347+0000 7f58d18ae700 1 -- 172.21.15.146:0/3089661803 wait complete. 2023-10-06T11:14:02.350 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 93 2023-10-06T11:14:02.361 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2023-10-06T11:14:02.361 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T11:14:02.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.475+0000 7fd316292700 1 Processor -- start 2023-10-06T11:14:02.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.475+0000 7fd316292700 1 -- start start 2023-10-06T11:14:02.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.475+0000 7fd316292700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd310068ba0 0x7fd31015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:02.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.475+0000 7fd316292700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd31015ac30 con 0x7fd310153ab0 2023-10-06T11:14:02.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.475+0000 7fd316292700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3100b4510 con 0x7fd310153e80 2023-10-06T11:14:02.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.475+0000 7fd316292700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3100b6530 con 0x7fd310068ba0 2023-10-06T11:14:02.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.476+0000 7fd30ffff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd310153ab0 0x7fd310068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33838/0 (socket says 172.21.15.146:33838) 2023-10-06T11:14:02.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.476+0000 7fd30ffff700 1 -- 172.21.15.146:0/3573918700 learned_addr learned my addr 172.21.15.146:0/3573918700 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:14:02.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.476+0000 7fd30f7fe700 1 --2- 172.21.15.146:0/3573918700 >> v2:172.21.15.151:3300/0 conn(0x7fd310068ba0 0x7fd31015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:02.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.476+0000 7fd30effd700 1 -- 172.21.15.146:0/3573918700 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3185944493 0 0) 0x7fd304001110 con 0x7fd310153ab0 2023-10-06T11:14:02.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.476+0000 7fd30effd700 1 -- 172.21.15.146:0/3573918700 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2f8003570 con 0x7fd310153ab0 2023-10-06T11:14:02.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.476+0000 7fd30effd700 1 -- 172.21.15.146:0/3573918700 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 97344974 0 0) 0x7fd2f8003570 con 0x7fd310153ab0 2023-10-06T11:14:02.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.476+0000 7fd30effd700 1 -- 172.21.15.146:0/3573918700 >> v2:172.21.15.151:3300/0 conn(0x7fd310068ba0 msgr2=0x7fd31015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:02.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.476+0000 7fd30effd700 1 --2- 172.21.15.146:0/3573918700 >> v2:172.21.15.151:3300/0 conn(0x7fd310068ba0 0x7fd31015a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:02.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.476+0000 7fd30effd700 1 -- 172.21.15.146:0/3573918700 >> v1:172.21.15.151:6789/0 conn(0x7fd310153e80 legacy=0x7fd3100b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:02.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.476+0000 7fd30effd700 1 -- 172.21.15.146:0/3573918700 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3100b5c50 con 0x7fd310153ab0 2023-10-06T11:14:02.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.476+0000 7fd30effd700 1 -- 172.21.15.146:0/3573918700 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fd304001600 con 0x7fd310153ab0 2023-10-06T11:14:02.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.476+0000 7fd30effd700 1 -- 172.21.15.146:0/3573918700 >> v1:172.21.15.146:6789/0 conn(0x7fd310153ab0 legacy=0x7fd310068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:02.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.476+0000 7fd30effd700 1 --2- 172.21.15.146:0/3573918700 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2f8003a60 0x7fd2f8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:02.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.476+0000 7fd30effd700 1 --2- 172.21.15.146:0/3573918700 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2f8004810 0x7fd2f8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:02.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.476+0000 7fd30effd700 1 --2- 172.21.15.146:0/3573918700 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2f80051c0 0x7fd2f800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:02.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.476+0000 7fd30effd700 1 -- 172.21.15.146:0/3573918700 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3100b6530 con 0x7fd2f8004810 2023-10-06T11:14:02.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.476+0000 7fd30effd700 1 -- 172.21.15.146:0/3573918700 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f800c050 con 0x7fd2f80051c0 2023-10-06T11:14:02.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.476+0000 7fd30effd700 1 -- 172.21.15.146:0/3573918700 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f800c210 con 0x7fd2f8003a60 2023-10-06T11:14:02.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.476+0000 7fd30f7fe700 1 --2- 172.21.15.146:0/3573918700 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2f8004810 0x7fd2f8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:02.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.476+0000 7fd30ffff700 1 --2- 172.21.15.146:0/3573918700 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2f8003a60 0x7fd2f8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:02.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.476+0000 7fd31482f700 1 --2- 172.21.15.146:0/3573918700 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2f80051c0 0x7fd2f800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:02.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.477+0000 7fd30f7fe700 1 -- 172.21.15.146:0/3573918700 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2f8003a60 msgr2=0x7fd2f8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:02.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.477+0000 7fd30f7fe700 1 --2- 172.21.15.146:0/3573918700 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2f8003a60 0x7fd2f8003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:02.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.477+0000 7fd30f7fe700 1 -- 172.21.15.146:0/3573918700 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2f80051c0 msgr2=0x7fd2f800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:02.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.477+0000 7fd30f7fe700 1 --2- 172.21.15.146:0/3573918700 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2f80051c0 0x7fd2f800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:02.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.477+0000 7fd30f7fe700 1 -- 172.21.15.146:0/3573918700 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f8003570 con 0x7fd2f8004810 2023-10-06T11:14:02.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.477+0000 7fd31482f700 1 --2- 172.21.15.146:0/3573918700 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2f80051c0 0x7fd2f800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:02.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.477+0000 7fd31482f700 1 -- 172.21.15.146:0/3573918700 reap_dead start 2023-10-06T11:14:02.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.477+0000 7fd30f7fe700 1 --2- 172.21.15.146:0/3573918700 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2f8004810 0x7fd2f8004c80 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fd310068fa0 tx=0x7fd3000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc2f18ebc3004 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:02.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.477+0000 7fd30effd700 1 -- 172.21.15.146:0/3573918700 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30000e710 con 0x7fd2f8004810 2023-10-06T11:14:02.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.477+0000 7fd30effd700 1 -- 172.21.15.146:0/3573918700 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd30000e870 con 0x7fd2f8004810 2023-10-06T11:14:02.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.477+0000 7fd30effd700 1 -- 172.21.15.146:0/3573918700 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30000ec30 con 0x7fd2f8004810 2023-10-06T11:14:02.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.477+0000 7fd316292700 1 -- 172.21.15.146:0/3573918700 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2f8004810 msgr2=0x7fd2f8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:02.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.477+0000 7fd316292700 1 --2- 172.21.15.146:0/3573918700 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2f8004810 0x7fd2f8004c80 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fd310068fa0 tx=0x7fd3000091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:02.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.477+0000 7fd316292700 1 -- 172.21.15.146:0/3573918700 shutdown_connections 2023-10-06T11:14:02.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.477+0000 7fd316292700 1 --2- 172.21.15.146:0/3573918700 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2f8004810 0x7fd2f8004c80 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:02.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.477+0000 7fd316292700 1 -- 172.21.15.146:0/3573918700 >> 172.21.15.146:0/3573918700 conn(0x7fd31006eba0 msgr2=0x7fd31006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:02.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.477+0000 7fd316292700 1 -- 172.21.15.146:0/3573918700 shutdown_connections 2023-10-06T11:14:02.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.477+0000 7fd316292700 1 -- 172.21.15.146:0/3573918700 wait complete. 2023-10-06T11:14:02.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.478+0000 7fd316292700 1 Processor -- start 2023-10-06T11:14:02.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.479+0000 7fd316292700 1 -- start start 2023-10-06T11:14:02.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.479+0000 7fd316292700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2f8004810 0x7fd3101594b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:02.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.479+0000 7fd316292700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd31015e340 0x7fd31015e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:02.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.479+0000 7fd316292700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd310150660 0x7fd310150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:02.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.479+0000 7fd316292700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31015ecf0 con 0x7fd2f8004810 2023-10-06T11:14:02.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.479+0000 7fd316292700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3100b06c0 con 0x7fd31015e340 2023-10-06T11:14:02.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.479+0000 7fd316292700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3100b09a0 con 0x7fd310150660 2023-10-06T11:14:02.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.479+0000 7fd30ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2f8004810 0x7fd3101594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:02.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.480+0000 7fd30ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2f8004810 0x7fd3101594b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34886/0 (socket says 172.21.15.146:34886) 2023-10-06T11:14:02.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.480+0000 7fd30ffff700 1 -- 172.21.15.146:0/631280455 learned_addr learned my addr 172.21.15.146:0/631280455 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:02.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.480+0000 7fd30f7fe700 1 --2- 172.21.15.146:0/631280455 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd31015e340 0x7fd31015e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:02.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.480+0000 7fd31482f700 1 --2- 172.21.15.146:0/631280455 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd310150660 0x7fd310150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:02.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.480+0000 7fd30ffff700 1 -- 172.21.15.146:0/631280455 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd310150660 msgr2=0x7fd310150ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:02.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.480+0000 7fd30ffff700 1 --2- 172.21.15.146:0/631280455 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd310150660 0x7fd310150ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:02.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.480+0000 7fd30ffff700 1 -- 172.21.15.146:0/631280455 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd31015e340 msgr2=0x7fd31015e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:02.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.480+0000 7fd30ffff700 1 --2- 172.21.15.146:0/631280455 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd31015e340 0x7fd31015e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:02.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.480+0000 7fd30ffff700 1 -- 172.21.15.146:0/631280455 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3100b0c80 con 0x7fd2f8004810 2023-10-06T11:14:02.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.480+0000 7fd30ffff700 1 --2- 172.21.15.146:0/631280455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2f8004810 0x7fd3101594b0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fd304007410 tx=0x7fd3100b4480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:02.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.480+0000 7fd2f7fff700 1 -- 172.21.15.146:0/631280455 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30400f8d0 con 0x7fd2f8004810 2023-10-06T11:14:02.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.480+0000 7fd2f7fff700 1 -- 172.21.15.146:0/631280455 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd30400fa30 con 0x7fd2f8004810 2023-10-06T11:14:02.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.480+0000 7fd316292700 1 -- 172.21.15.146:0/631280455 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3100b0f60 con 0x7fd2f8004810 2023-10-06T11:14:02.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.480+0000 7fd2f7fff700 1 -- 172.21.15.146:0/631280455 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30400fdd0 con 0x7fd2f8004810 2023-10-06T11:14:02.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.480+0000 7fd316292700 1 -- 172.21.15.146:0/631280455 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3101599f0 con 0x7fd2f8004810 2023-10-06T11:14:02.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.481+0000 7fd316292700 1 -- 172.21.15.146:0/631280455 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3100b1480 con 0x7fd2f8004810 2023-10-06T11:14:02.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.482+0000 7fd2f7fff700 1 -- 172.21.15.146:0/631280455 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd304013600 con 0x7fd2f8004810 2023-10-06T11:14:02.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.482+0000 7fd2f7fff700 1 --2- 172.21.15.146:0/631280455 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd2fc066f30 0x7fd2fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:02.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.482+0000 7fd2f7fff700 1 -- 172.21.15.146:0/631280455 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd3040847c0 con 0x7fd2f8004810 2023-10-06T11:14:02.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.482+0000 7fd30f7fe700 1 --2- 172.21.15.146:0/631280455 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd2fc066f30 0x7fd2fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:02.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.482+0000 7fd30f7fe700 1 --2- 172.21.15.146:0/631280455 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd2fc066f30 0x7fd2fc0693e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fd3000091e0 tx=0x7fd30001a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:02.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.486+0000 7fd2f7fff700 1 -- 172.21.15.146:0/631280455 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd3100b1480 con 0x7fd2f8004810 2023-10-06T11:14:02.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.745+0000 7fd316292700 1 -- 172.21.15.146:0/631280455 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd31015ac30 con 0x7fd2f8004810 2023-10-06T11:14:02.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.745+0000 7fd2f7fff700 1 -- 172.21.15.146:0/631280455 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1579 (secure 0 0 0) 0x7fd31015ac30 con 0x7fd2f8004810 2023-10-06T11:14:02.747 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:02.748 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":517,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":101,"num_osds":8,"num_up_osds":8,"osd_up_since":1696590336,"num_in_osds":8,"osd_in_since":1696590327,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":1071,"data_bytes":1077926949,"bytes_used":4668391424,"bytes_avail":768425721856,"bytes_total":773094113280,"write_bytes_sec":40168405,"read_op_per_sec":0,"write_op_per_sec":162},"fsmap":{"epoch":93,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":7620}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":20,"modified":"2023-10-06T11:14:01.246582+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T11:14:02.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.747+0000 7fd316292700 1 -- 172.21.15.146:0/631280455 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd2fc066f30 msgr2=0x7fd2fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:02.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.747+0000 7fd316292700 1 --2- 172.21.15.146:0/631280455 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd2fc066f30 0x7fd2fc0693e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fd3000091e0 tx=0x7fd30001a000 comp rx=0 tx=0).stop 2023-10-06T11:14:02.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.747+0000 7fd316292700 1 -- 172.21.15.146:0/631280455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2f8004810 msgr2=0x7fd3101594b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:02.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.747+0000 7fd316292700 1 --2- 172.21.15.146:0/631280455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2f8004810 0x7fd3101594b0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fd304007410 tx=0x7fd3100b4480 comp rx=0 tx=0).stop 2023-10-06T11:14:02.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.747+0000 7fd316292700 1 -- 172.21.15.146:0/631280455 shutdown_connections 2023-10-06T11:14:02.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.747+0000 7fd316292700 1 --2- 172.21.15.146:0/631280455 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd2fc066f30 0x7fd2fc0693e0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:02.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.747+0000 7fd316292700 1 --2- 172.21.15.146:0/631280455 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd310150660 0x7fd310150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:02.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.747+0000 7fd316292700 1 --2- 172.21.15.146:0/631280455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2f8004810 0x7fd3101594b0 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:02.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.747+0000 7fd316292700 1 --2- 172.21.15.146:0/631280455 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd31015e340 0x7fd31015e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:02.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.747+0000 7fd316292700 1 -- 172.21.15.146:0/631280455 >> 172.21.15.146:0/631280455 conn(0x7fd31006eba0 msgr2=0x7fd3100ce940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:02.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.747+0000 7fd316292700 1 -- 172.21.15.146:0/631280455 shutdown_connections 2023-10-06T11:14:02.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:02.747+0000 7fd316292700 1 -- 172.21.15.146:0/631280455 wait complete. 2023-10-06T11:14:02.761 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2023-10-06T11:14:02.761 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T11:14:02.761 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:14:02.797 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:14:02.843 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T11:14:02.844 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi146.front.sepia.ceph.com... 2023-10-06T11:14:02.844 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T11:14:02.844 DEBUG:teuthology.orchestra.run.smithi146:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T11:14:02.876 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[134946]: fuse finished with error 0 and tester_r 0 2023-10-06T11:14:02.954 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-10-06T11:14:02.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:02.954 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T11:14:03.121 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-10-06T11:14:03.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:03.121 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T11:14:03.137 INFO:teuthology.orchestra.run.smithi151.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-06T11:14:03.137 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:14:03.138 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-10-06T11:14:03.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:03.138 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T11:14:03.177 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:14:03.177 INFO:teuthology.orchestra.run.smithi146.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-06T11:14:03.177 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-10-06T11:14:03.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:03.178 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T11:14:03.194 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:14:03.194 INFO:teuthology.orchestra.run.smithi151.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-06T11:14:03.194 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:14:03.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.331+0000 7f1219b32700 1 Processor -- start 2023-10-06T11:14:03.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.331+0000 7f1219b32700 1 -- start start 2023-10-06T11:14:03.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.332+0000 7f1219b32700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1214068ba0 0x7f121415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:03.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.332+0000 7f1219b32700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1214153e80 0x7f12140b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:03.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.332+0000 7f1219b32700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f121415ac30 con 0x7f1214153ab0 2023-10-06T11:14:03.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.332+0000 7f1219b32700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12140b4510 con 0x7f1214068ba0 2023-10-06T11:14:03.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.332+0000 7f1219b32700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12140b6530 con 0x7f1214153e80 2023-10-06T11:14:03.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.332+0000 7f1212ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1214068ba0 0x7f121415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:03.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.332+0000 7f12137fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f1214153ab0 0x7f1214068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33852/0 (socket says 172.21.15.146:33852) 2023-10-06T11:14:03.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.332+0000 7f12137fe700 1 -- 172.21.15.146:0/398666439 learned_addr learned my addr 172.21.15.146:0/398666439 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:14:03.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.332+0000 7f1212ffd700 1 -- 172.21.15.146:0/398666439 >> v2:172.21.15.151:3300/0 conn(0x7f1214153e80 msgr2=0x7f12140b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:03.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.332+0000 7f1213fff700 1 --2- 172.21.15.146:0/398666439 >> v2:172.21.15.151:3300/0 conn(0x7f1214153e80 0x7f12140b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:03.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.332+0000 7f12127fc700 1 -- 172.21.15.146:0/398666439 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3988416998 0 0) 0x7f1204001490 con 0x7f1214153ab0 2023-10-06T11:14:03.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.333+0000 7f1212ffd700 1 --2- 172.21.15.146:0/398666439 >> v2:172.21.15.151:3300/0 conn(0x7f1214153e80 0x7f12140b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:03.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.333+0000 7f1212ffd700 1 -- 172.21.15.146:0/398666439 >> v1:172.21.15.146:6789/0 conn(0x7f1214153ab0 legacy=0x7f1214068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:03.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.333+0000 7f1212ffd700 1 -- 172.21.15.146:0/398666439 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12140b5c50 con 0x7f1214068ba0 2023-10-06T11:14:03.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.333+0000 7f1213fff700 1 --2- 172.21.15.146:0/398666439 >> v2:172.21.15.151:3300/0 conn(0x7f1214153e80 0x7f12140b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:03.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.333+0000 7f1212ffd700 1 --2- 172.21.15.146:0/398666439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1214068ba0 0x7f121415a6f0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f12140d12a0 tx=0x7f11fc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd90dbd8ec62675d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:03.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.333+0000 7f12127fc700 1 -- 172.21.15.146:0/398666439 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc00b6b0 con 0x7f1214068ba0 2023-10-06T11:14:03.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.333+0000 7f12127fc700 1 -- 172.21.15.146:0/398666439 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11fc00b810 con 0x7f1214068ba0 2023-10-06T11:14:03.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.333+0000 7f12127fc700 1 -- 172.21.15.146:0/398666439 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc00bbb0 con 0x7f1214068ba0 2023-10-06T11:14:03.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.333+0000 7f1219b32700 1 -- 172.21.15.146:0/398666439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1214068ba0 msgr2=0x7f121415a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:03.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.333+0000 7f1219b32700 1 --2- 172.21.15.146:0/398666439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1214068ba0 0x7f121415a6f0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f12140d12a0 tx=0x7f11fc0091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:03.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.333+0000 7f1219b32700 1 -- 172.21.15.146:0/398666439 shutdown_connections 2023-10-06T11:14:03.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.333+0000 7f1219b32700 1 --2- 172.21.15.146:0/398666439 >> v2:172.21.15.151:3300/0 conn(0x7f1214153e80 0x7f12140b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:03.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.333+0000 7f1219b32700 1 --2- 172.21.15.146:0/398666439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1214068ba0 0x7f121415a6f0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:03.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.333+0000 7f1219b32700 1 -- 172.21.15.146:0/398666439 >> 172.21.15.146:0/398666439 conn(0x7f121406eba0 msgr2=0x7f121406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:03.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.333+0000 7f1219b32700 1 -- 172.21.15.146:0/398666439 shutdown_connections 2023-10-06T11:14:03.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.333+0000 7f1219b32700 1 -- 172.21.15.146:0/398666439 wait complete. 2023-10-06T11:14:03.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.335+0000 7f1219b32700 1 Processor -- start 2023-10-06T11:14:03.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.335+0000 7f1219b32700 1 -- start start 2023-10-06T11:14:03.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.335+0000 7f1219b32700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1214068ba0 0x7f1214169a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:03.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.335+0000 7f1219b32700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1214153ab0 0x7f121416d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:03.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.335+0000 7f1219b32700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1214153e80 0x7f1214140bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:03.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.335+0000 7f1219b32700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f121416ad50 con 0x7f1214153ab0 2023-10-06T11:14:03.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.335+0000 7f1219b32700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12141410f0 con 0x7f1214068ba0 2023-10-06T11:14:03.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.335+0000 7f1219b32700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f121416a0e0 con 0x7f1214153e80 2023-10-06T11:14:03.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.335+0000 7f1212ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1214153ab0 0x7f121416d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:03.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.335+0000 7f1212ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1214153ab0 0x7f121416d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34902/0 (socket says 172.21.15.146:34902) 2023-10-06T11:14:03.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.335+0000 7f1212ffd700 1 -- 172.21.15.146:0/667684780 learned_addr learned my addr 172.21.15.146:0/667684780 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:03.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.336+0000 7f12137fe700 1 --2- 172.21.15.146:0/667684780 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1214068ba0 0x7f1214169a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:03.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.336+0000 7f1212ffd700 1 -- 172.21.15.146:0/667684780 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1214153e80 msgr2=0x7f1214140bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:03.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.336+0000 7f1213fff700 1 --2- 172.21.15.146:0/667684780 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1214153e80 0x7f1214140bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:03.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.336+0000 7f1212ffd700 1 --2- 172.21.15.146:0/667684780 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1214153e80 0x7f1214140bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:03.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.336+0000 7f1212ffd700 1 -- 172.21.15.146:0/667684780 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1214068ba0 msgr2=0x7f1214169a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:03.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.336+0000 7f1212ffd700 1 --2- 172.21.15.146:0/667684780 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1214068ba0 0x7f1214169a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:03.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.336+0000 7f1212ffd700 1 -- 172.21.15.146:0/667684780 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11fc009420 con 0x7f1214153ab0 2023-10-06T11:14:03.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.336+0000 7f1212ffd700 1 --2- 172.21.15.146:0/667684780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1214153ab0 0x7f121416d9d0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f11fc013000 tx=0x7f11fc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:03.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.336+0000 7f120b7fe700 1 -- 172.21.15.146:0/667684780 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc011420 con 0x7f1214153ab0 2023-10-06T11:14:03.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.336+0000 7f120b7fe700 1 -- 172.21.15.146:0/667684780 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11fc011580 con 0x7f1214153ab0 2023-10-06T11:14:03.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.336+0000 7f1219b32700 1 -- 172.21.15.146:0/667684780 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f121416a3c0 con 0x7f1214153ab0 2023-10-06T11:14:03.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.336+0000 7f120b7fe700 1 -- 172.21.15.146:0/667684780 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc011920 con 0x7f1214153ab0 2023-10-06T11:14:03.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.336+0000 7f1219b32700 1 -- 172.21.15.146:0/667684780 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f121416a980 con 0x7f1214153ab0 2023-10-06T11:14:03.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.337+0000 7f1219b32700 1 -- 172.21.15.146:0/667684780 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f121416aec0 con 0x7f1214153ab0 2023-10-06T11:14:03.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.337+0000 7f120b7fe700 1 -- 172.21.15.146:0/667684780 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f11fc011d10 con 0x7f1214153ab0 2023-10-06T11:14:03.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.338+0000 7f120b7fe700 1 --2- 172.21.15.146:0/667684780 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f11f4066f30 0x7f11f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:03.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.338+0000 7f120b7fe700 1 -- 172.21.15.146:0/667684780 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f11fc0862a0 con 0x7f1214153ab0 2023-10-06T11:14:03.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.338+0000 7f12137fe700 1 --2- 172.21.15.146:0/667684780 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f11f4066f30 0x7f11f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:03.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.338+0000 7f12137fe700 1 --2- 172.21.15.146:0/667684780 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f11f4066f30 0x7f11f40693e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f12140b59d0 tx=0x7f1204009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:03.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.342+0000 7f120b7fe700 1 -- 172.21.15.146:0/667684780 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f121416aec0 con 0x7f1214153ab0 2023-10-06T11:14:03.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.569+0000 7f1219b32700 1 -- 172.21.15.146:0/667684780 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f121416ae90 con 0x7f1214153ab0 2023-10-06T11:14:03.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.570+0000 7f120b7fe700 1 -- 172.21.15.146:0/667684780 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f11fc053430 con 0x7f1214153ab0 2023-10-06T11:14:03.572 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:03.572 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":93,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/2159562091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2159562091},{"type":"v1","addr":"172.21.15.151:6834","nonce":2159562091}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6242,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/603782012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":603782012},{"type":"v1","addr":"172.21.15.151:6835","nonce":603782012}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6916,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3416056259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3416056259},{"type":"v1","addr":"172.21.15.146:6837","nonce":3416056259}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:13:30.345795+0000","modified":"2023-10-06T11:13:33.984549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7620":{"gid":7620,"name":"c","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/785131800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":785131800},{"type":"v1","addr":"172.21.15.146:6835","nonce":785131800}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T11:14:03.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.572+0000 7f1219b32700 1 -- 172.21.15.146:0/667684780 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f11f4066f30 msgr2=0x7f11f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:03.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.572+0000 7f1219b32700 1 --2- 172.21.15.146:0/667684780 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f11f4066f30 0x7f11f40693e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f12140b59d0 tx=0x7f1204009040 comp rx=0 tx=0).stop 2023-10-06T11:14:03.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.572+0000 7f1219b32700 1 -- 172.21.15.146:0/667684780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1214153ab0 msgr2=0x7f121416d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:03.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.572+0000 7f1219b32700 1 --2- 172.21.15.146:0/667684780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1214153ab0 0x7f121416d9d0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f11fc013000 tx=0x7f11fc017000 comp rx=0 tx=0).stop 2023-10-06T11:14:03.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.572+0000 7f1219b32700 1 -- 172.21.15.146:0/667684780 shutdown_connections 2023-10-06T11:14:03.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.572+0000 7f1219b32700 1 --2- 172.21.15.146:0/667684780 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f11f4066f30 0x7f11f40693e0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:03.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.572+0000 7f1219b32700 1 --2- 172.21.15.146:0/667684780 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1214153e80 0x7f1214140bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:03.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.572+0000 7f1219b32700 1 --2- 172.21.15.146:0/667684780 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1214068ba0 0x7f1214169a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:03.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.572+0000 7f1219b32700 1 --2- 172.21.15.146:0/667684780 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1214153ab0 0x7f121416d9d0 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:03.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.572+0000 7f1219b32700 1 -- 172.21.15.146:0/667684780 >> 172.21.15.146:0/667684780 conn(0x7f121406eba0 msgr2=0x7f12141522b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:03.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.572+0000 7f1219b32700 1 -- 172.21.15.146:0/667684780 shutdown_connections 2023-10-06T11:14:03.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.572+0000 7f1219b32700 1 -- 172.21.15.146:0/667684780 wait complete. 2023-10-06T11:14:03.575 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 93 2023-10-06T11:14:03.586 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:14:03.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.699+0000 7f5450418700 1 Processor -- start 2023-10-06T11:14:03.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.699+0000 7f5450418700 1 -- start start 2023-10-06T11:14:03.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.700+0000 7f5450418700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54480ced80 0x7f54480c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:03.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.700+0000 7f5450418700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54480cf210 con 0x7f54480b0c00 2023-10-06T11:14:03.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.700+0000 7f5450418700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5448068790 con 0x7f54480c3910 2023-10-06T11:14:03.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.700+0000 7f5450418700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54480682f0 con 0x7f54480ced80 2023-10-06T11:14:03.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.700+0000 7f544e1b4700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f54480b0c00 0x7f54480c3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33862/0 (socket says 172.21.15.146:33862) 2023-10-06T11:14:03.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.701+0000 7f544e1b4700 1 -- 172.21.15.146:0/1126583458 learned_addr learned my addr 172.21.15.146:0/1126583458 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:14:03.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.701+0000 7f544d9b3700 1 --2- 172.21.15.146:0/1126583458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54480ced80 0x7f54480c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:03.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.701+0000 7f544d1b2700 1 -- 172.21.15.146:0/1126583458 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 88269252 0 0) 0x7f54480cf210 con 0x7f54480b0c00 2023-10-06T11:14:03.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.701+0000 7f544d1b2700 1 -- 172.21.15.146:0/1126583458 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5434003570 con 0x7f54480b0c00 2023-10-06T11:14:03.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.701+0000 7f544d1b2700 1 -- 172.21.15.146:0/1126583458 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3096576949 0 0) 0x7f5448068790 con 0x7f54480c3910 2023-10-06T11:14:03.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.701+0000 7f544d1b2700 1 -- 172.21.15.146:0/1126583458 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54480cf210 con 0x7f54480c3910 2023-10-06T11:14:03.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.701+0000 7f544d1b2700 1 -- 172.21.15.146:0/1126583458 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4251673323 0 0) 0x7f5434003570 con 0x7f54480b0c00 2023-10-06T11:14:03.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.701+0000 7f544d1b2700 1 -- 172.21.15.146:0/1126583458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54480ced80 msgr2=0x7f54480c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:03.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.701+0000 7f544d1b2700 1 --2- 172.21.15.146:0/1126583458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54480ced80 0x7f54480c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:03.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.701+0000 7f544d1b2700 1 -- 172.21.15.146:0/1126583458 >> v1:172.21.15.151:6789/0 conn(0x7f54480c3910 legacy=0x7f54480cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:03.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.701+0000 7f544d1b2700 1 -- 172.21.15.146:0/1126583458 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5448068a70 con 0x7f54480b0c00 2023-10-06T11:14:03.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.701+0000 7f544d1b2700 1 -- 172.21.15.146:0/1126583458 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f54440017f0 con 0x7f54480b0c00 2023-10-06T11:14:03.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.701+0000 7f544d1b2700 1 -- 172.21.15.146:0/1126583458 >> v1:172.21.15.146:6789/0 conn(0x7f54480b0c00 legacy=0x7f54480c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:03.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.701+0000 7f544d1b2700 1 --2- 172.21.15.146:0/1126583458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5434003c20 0x7f5434004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:03.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.701+0000 7f544d1b2700 1 --2- 172.21.15.146:0/1126583458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54480ced80 0x7f5434004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:03.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.701+0000 7f544d1b2700 1 --2- 172.21.15.146:0/1126583458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5434004d50 0x7f54340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:03.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.701+0000 7f544d1b2700 1 -- 172.21.15.146:0/1126583458 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54480682f0 con 0x7f5434004d50 2023-10-06T11:14:03.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.701+0000 7f544d1b2700 1 -- 172.21.15.146:0/1126583458 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543400bb40 con 0x7f5434003c20 2023-10-06T11:14:03.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.701+0000 7f544d1b2700 1 -- 172.21.15.146:0/1126583458 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f543400bd00 con 0x7f54480ced80 2023-10-06T11:14:03.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.701+0000 7f544e9b5700 1 --2- 172.21.15.146:0/1126583458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5434004d50 0x7f54340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:03.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.701+0000 7f544e1b4700 1 --2- 172.21.15.146:0/1126583458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5434003c20 0x7f5434004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:03.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.701+0000 7f544d9b3700 1 --2- 172.21.15.146:0/1126583458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54480ced80 0x7f5434004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:03.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.702+0000 7f544e9b5700 1 -- 172.21.15.146:0/1126583458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54480ced80 msgr2=0x7f5434004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:03.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.702+0000 7f544e9b5700 1 --2- 172.21.15.146:0/1126583458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54480ced80 0x7f5434004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:03.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.702+0000 7f544e9b5700 1 -- 172.21.15.146:0/1126583458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5434003c20 msgr2=0x7f5434004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:03.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.702+0000 7f544e9b5700 1 --2- 172.21.15.146:0/1126583458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5434003c20 0x7f5434004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:03.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.702+0000 7f544e9b5700 1 -- 172.21.15.146:0/1126583458 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5434003570 con 0x7f5434004d50 2023-10-06T11:14:03.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.702+0000 7f544e9b5700 1 --2- 172.21.15.146:0/1126583458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5434004d50 0x7f54340051c0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f54480c3d10 tx=0x7f5440007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3d388cc3a29fcdb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:03.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.702+0000 7f544d1b2700 1 -- 172.21.15.146:0/1126583458 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544000c5a0 con 0x7f5434004d50 2023-10-06T11:14:03.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.702+0000 7f544d1b2700 1 -- 172.21.15.146:0/1126583458 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544000c700 con 0x7f5434004d50 2023-10-06T11:14:03.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.702+0000 7f544d1b2700 1 -- 172.21.15.146:0/1126583458 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544000caa0 con 0x7f5434004d50 2023-10-06T11:14:03.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.702+0000 7f5450418700 1 -- 172.21.15.146:0/1126583458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5434004d50 msgr2=0x7f54340051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:03.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.702+0000 7f5450418700 1 --2- 172.21.15.146:0/1126583458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5434004d50 0x7f54340051c0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f54480c3d10 tx=0x7f5440007d30 comp rx=0 tx=0).stop 2023-10-06T11:14:03.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.702+0000 7f544e9b5700 1 -- 172.21.15.146:0/1126583458 reap_dead start 2023-10-06T11:14:03.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.702+0000 7f5450418700 1 -- 172.21.15.146:0/1126583458 shutdown_connections 2023-10-06T11:14:03.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.702+0000 7f5450418700 1 -- 172.21.15.146:0/1126583458 >> 172.21.15.146:0/1126583458 conn(0x7f5448067c50 msgr2=0x7f54480ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:03.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.702+0000 7f5450418700 1 -- 172.21.15.146:0/1126583458 shutdown_connections 2023-10-06T11:14:03.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.703+0000 7f5450418700 1 -- 172.21.15.146:0/1126583458 wait complete. 2023-10-06T11:14:03.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.704+0000 7f5450418700 1 Processor -- start 2023-10-06T11:14:03.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.704+0000 7f5450418700 1 -- start start 2023-10-06T11:14:03.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.704+0000 7f5450418700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5434004d50 0x7f544815bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:03.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.704+0000 7f5450418700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54480b1200 0x7f5448157b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:03.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.704+0000 7f5450418700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5448158090 0x7f544816a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:03.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.704+0000 7f5450418700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5448155eb0 con 0x7f5448158090 2023-10-06T11:14:03.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.704+0000 7f5450418700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5448158500 con 0x7f54480b1200 2023-10-06T11:14:03.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.704+0000 7f5450418700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54480b2ef0 con 0x7f5434004d50 2023-10-06T11:14:03.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.704+0000 7f544e9b5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5448158090 0x7f544816a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:03.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.704+0000 7f544e9b5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5448158090 0x7f544816a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34914/0 (socket says 172.21.15.146:34914) 2023-10-06T11:14:03.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.704+0000 7f544e9b5700 1 -- 172.21.15.146:0/2160538983 learned_addr learned my addr 172.21.15.146:0/2160538983 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:03.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.704+0000 7f544d9b3700 1 --2- 172.21.15.146:0/2160538983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54480b1200 0x7f5448157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:03.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.704+0000 7f544e1b4700 1 --2- 172.21.15.146:0/2160538983 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5434004d50 0x7f544815bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:03.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.705+0000 7f544e9b5700 1 -- 172.21.15.146:0/2160538983 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5434004d50 msgr2=0x7f544815bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:03.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.705+0000 7f544e9b5700 1 --2- 172.21.15.146:0/2160538983 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5434004d50 0x7f544815bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:03.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.705+0000 7f544e9b5700 1 -- 172.21.15.146:0/2160538983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54480b1200 msgr2=0x7f5448157b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:03.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.705+0000 7f544e9b5700 1 --2- 172.21.15.146:0/2160538983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54480b1200 0x7f5448157b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:03.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.705+0000 7f544e9b5700 1 -- 172.21.15.146:0/2160538983 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54480b21f0 con 0x7f5448158090 2023-10-06T11:14:03.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.705+0000 7f544e9b5700 1 --2- 172.21.15.146:0/2160538983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5448158090 0x7f544816a040 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f5448088c30 tx=0x7f5440015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:03.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.705+0000 7f543e7fc700 1 -- 172.21.15.146:0/2160538983 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5440023070 con 0x7f5448158090 2023-10-06T11:14:03.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.705+0000 7f543e7fc700 1 -- 172.21.15.146:0/2160538983 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5440001360 con 0x7f5448158090 2023-10-06T11:14:03.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.705+0000 7f543e7fc700 1 -- 172.21.15.146:0/2160538983 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544000c5a0 con 0x7f5448158090 2023-10-06T11:14:03.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.705+0000 7f5450418700 1 -- 172.21.15.146:0/2160538983 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54480b1950 con 0x7f5448158090 2023-10-06T11:14:03.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.705+0000 7f5450418700 1 -- 172.21.15.146:0/2160538983 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54480b1f10 con 0x7f5448158090 2023-10-06T11:14:03.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.706+0000 7f5450418700 1 -- 172.21.15.146:0/2160538983 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54480b3080 con 0x7f5448158090 2023-10-06T11:14:03.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.706+0000 7f543e7fc700 1 -- 172.21.15.146:0/2160538983 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5440019070 con 0x7f5448158090 2023-10-06T11:14:03.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.707+0000 7f543e7fc700 1 --2- 172.21.15.146:0/2160538983 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f542c066f30 0x7f542c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:03.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.707+0000 7f543e7fc700 1 -- 172.21.15.146:0/2160538983 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5440085050 con 0x7f5448158090 2023-10-06T11:14:03.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.707+0000 7f544e1b4700 1 --2- 172.21.15.146:0/2160538983 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f542c066f30 0x7f542c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:03.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.707+0000 7f544e1b4700 1 --2- 172.21.15.146:0/2160538983 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f542c066f30 0x7f542c0693e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f544400a0e0 tx=0x7f5444002170 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:03.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.711+0000 7f543e7fc700 1 -- 172.21.15.146:0/2160538983 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5440052160 con 0x7f5448158090 2023-10-06T11:14:03.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.895+0000 7f5450418700 1 -- 172.21.15.146:0/2160538983 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f544804c380 con 0x7f5448158090 2023-10-06T11:14:03.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.896+0000 7f543e7fc700 1 -- 172.21.15.146:0/2160538983 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+16920 (secure 0 0 0) 0x7f5440055780 con 0x7f5448158090 2023-10-06T11:14:03.898 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:03.898 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":101,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:13:31.372487+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:13:28.028009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-10-06T11:13:29.311107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:14:03.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.898+0000 7f5450418700 1 -- 172.21.15.146:0/2160538983 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f542c066f30 msgr2=0x7f542c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:03.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.898+0000 7f5450418700 1 --2- 172.21.15.146:0/2160538983 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f542c066f30 0x7f542c0693e0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f544400a0e0 tx=0x7f5444002170 comp rx=0 tx=0).stop 2023-10-06T11:14:03.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.898+0000 7f5450418700 1 -- 172.21.15.146:0/2160538983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5448158090 msgr2=0x7f544816a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:03.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.898+0000 7f5450418700 1 --2- 172.21.15.146:0/2160538983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5448158090 0x7f544816a040 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f5448088c30 tx=0x7f5440015000 comp rx=0 tx=0).stop 2023-10-06T11:14:03.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.898+0000 7f5450418700 1 -- 172.21.15.146:0/2160538983 shutdown_connections 2023-10-06T11:14:03.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.898+0000 7f5450418700 1 --2- 172.21.15.146:0/2160538983 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f542c066f30 0x7f542c0693e0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:03.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.898+0000 7f5450418700 1 --2- 172.21.15.146:0/2160538983 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5448158090 0x7f544816a040 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:03.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.898+0000 7f5450418700 1 --2- 172.21.15.146:0/2160538983 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5434004d50 0x7f544815bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:03.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.898+0000 7f5450418700 1 --2- 172.21.15.146:0/2160538983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54480b1200 0x7f5448157b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:03.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.898+0000 7f5450418700 1 -- 172.21.15.146:0/2160538983 >> 172.21.15.146:0/2160538983 conn(0x7f5448067c50 msgr2=0x7f5448158ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:03.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.898+0000 7f5450418700 1 -- 172.21.15.146:0/2160538983 shutdown_connections 2023-10-06T11:14:03.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:03.898+0000 7f5450418700 1 -- 172.21.15.146:0/2160538983 wait complete. 2023-10-06T11:14:03.913 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:05:36.687307+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:05:37.171199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T11:13:28.028009+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '100', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T11:13:29.311107+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T11:14:03.913 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:14:04.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.029+0000 7fb490607700 1 Processor -- start 2023-10-06T11:14:04.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.029+0000 7fb490607700 1 -- start start 2023-10-06T11:14:04.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.030+0000 7fb490607700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb4880cc960 0x7fb488164c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:04.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.030+0000 7fb490607700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4880ccd80 con 0x7fb4880ae730 2023-10-06T11:14:04.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.030+0000 7fb490607700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4880ae2a0 con 0x7fb48815a160 2023-10-06T11:14:04.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.030+0000 7fb490607700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb48815a530 con 0x7fb4880cc960 2023-10-06T11:14:04.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.030+0000 7fb48dba2700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb4880ae730 0x7fb4880aebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33874/0 (socket says 172.21.15.146:33874) 2023-10-06T11:14:04.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.030+0000 7fb48dba2700 1 -- 172.21.15.146:0/2265163213 learned_addr learned my addr 172.21.15.146:0/2265163213 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:14:04.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.031+0000 7fb48eba4700 1 --2- 172.21.15.146:0/2265163213 >> v2:172.21.15.151:3300/0 conn(0x7fb4880cc960 0x7fb488164c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:04.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.031+0000 7fb48d3a1700 1 -- 172.21.15.146:0/2265163213 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3107936543 0 0) 0x7fb478001110 con 0x7fb4880ae730 2023-10-06T11:14:04.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.031+0000 7fb48d3a1700 1 -- 172.21.15.146:0/2265163213 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb474003570 con 0x7fb4880ae730 2023-10-06T11:14:04.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.031+0000 7fb48d3a1700 1 -- 172.21.15.146:0/2265163213 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4275449623 0 0) 0x7fb474003570 con 0x7fb4880ae730 2023-10-06T11:14:04.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.031+0000 7fb48d3a1700 1 -- 172.21.15.146:0/2265163213 >> v2:172.21.15.151:3300/0 conn(0x7fb4880cc960 msgr2=0x7fb488164c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:04.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.031+0000 7fb48d3a1700 1 --2- 172.21.15.146:0/2265163213 >> v2:172.21.15.151:3300/0 conn(0x7fb4880cc960 0x7fb488164c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:04.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.031+0000 7fb48d3a1700 1 -- 172.21.15.146:0/2265163213 >> v1:172.21.15.151:6789/0 conn(0x7fb48815a160 legacy=0x7fb4880c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:04.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.031+0000 7fb48d3a1700 1 -- 172.21.15.146:0/2265163213 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4880c5cb0 con 0x7fb4880ae730 2023-10-06T11:14:04.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.031+0000 7fb48d3a1700 1 -- 172.21.15.146:0/2265163213 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fb478001600 con 0x7fb4880ae730 2023-10-06T11:14:04.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.031+0000 7fb48d3a1700 1 -- 172.21.15.146:0/2265163213 >> v1:172.21.15.146:6789/0 conn(0x7fb4880ae730 legacy=0x7fb4880aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:04.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.031+0000 7fb48d3a1700 1 --2- 172.21.15.146:0/2265163213 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb474003a60 0x7fb474003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:04.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.031+0000 7fb48d3a1700 1 --2- 172.21.15.146:0/2265163213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb474004810 0x7fb474004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:04.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.031+0000 7fb48d3a1700 1 --2- 172.21.15.146:0/2265163213 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4740051c0 0x7fb47400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:04.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.031+0000 7fb48d3a1700 1 -- 172.21.15.146:0/2265163213 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb48815a530 con 0x7fb474003a60 2023-10-06T11:14:04.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.031+0000 7fb48d3a1700 1 -- 172.21.15.146:0/2265163213 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47400c050 con 0x7fb474004810 2023-10-06T11:14:04.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.031+0000 7fb48d3a1700 1 -- 172.21.15.146:0/2265163213 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb47400c210 con 0x7fb4740051c0 2023-10-06T11:14:04.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.031+0000 7fb48e3a3700 1 --2- 172.21.15.146:0/2265163213 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb474003a60 0x7fb474003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:04.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.031+0000 7fb48dba2700 1 --2- 172.21.15.146:0/2265163213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb474004810 0x7fb474004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:04.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.031+0000 7fb48eba4700 1 --2- 172.21.15.146:0/2265163213 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4740051c0 0x7fb47400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:04.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.031+0000 7fb48e3a3700 1 -- 172.21.15.146:0/2265163213 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4740051c0 msgr2=0x7fb47400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:04.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.031+0000 7fb48e3a3700 1 --2- 172.21.15.146:0/2265163213 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4740051c0 0x7fb47400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:04.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.031+0000 7fb48e3a3700 1 -- 172.21.15.146:0/2265163213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb474004810 msgr2=0x7fb474004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:04.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.031+0000 7fb48e3a3700 1 --2- 172.21.15.146:0/2265163213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb474004810 0x7fb474004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:04.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.031+0000 7fb48e3a3700 1 -- 172.21.15.146:0/2265163213 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb474003570 con 0x7fb474003a60 2023-10-06T11:14:04.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.031+0000 7fb48eba4700 1 --2- 172.21.15.146:0/2265163213 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4740051c0 0x7fb47400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:04.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.032+0000 7fb48eba4700 1 -- 172.21.15.146:0/2265163213 reap_dead start 2023-10-06T11:14:04.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.032+0000 7fb48e3a3700 1 --2- 172.21.15.146:0/2265163213 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb474003a60 0x7fb474003e30 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fb48400c320 tx=0x7fb484001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93a104c111fc85c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:04.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.032+0000 7fb48d3a1700 1 -- 172.21.15.146:0/2265163213 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb484001e20 con 0x7fb474003a60 2023-10-06T11:14:04.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.032+0000 7fb48d3a1700 1 -- 172.21.15.146:0/2265163213 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb48400cc50 con 0x7fb474003a60 2023-10-06T11:14:04.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.032+0000 7fb48d3a1700 1 -- 172.21.15.146:0/2265163213 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb484012420 con 0x7fb474003a60 2023-10-06T11:14:04.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.032+0000 7fb490607700 1 -- 172.21.15.146:0/2265163213 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb474003a60 msgr2=0x7fb474003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:04.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.032+0000 7fb490607700 1 --2- 172.21.15.146:0/2265163213 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb474003a60 0x7fb474003e30 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fb48400c320 tx=0x7fb484001b10 comp rx=0 tx=0).stop 2023-10-06T11:14:04.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.032+0000 7fb490607700 1 -- 172.21.15.146:0/2265163213 shutdown_connections 2023-10-06T11:14:04.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.032+0000 7fb490607700 1 --2- 172.21.15.146:0/2265163213 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb474003a60 0x7fb474003e30 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:04.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.032+0000 7fb490607700 1 -- 172.21.15.146:0/2265163213 >> 172.21.15.146:0/2265163213 conn(0x7fb48806f380 msgr2=0x7fb4880d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:04.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.032+0000 7fb490607700 1 -- 172.21.15.146:0/2265163213 shutdown_connections 2023-10-06T11:14:04.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.032+0000 7fb490607700 1 -- 172.21.15.146:0/2265163213 wait complete. 2023-10-06T11:14:04.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.033+0000 7fb490607700 1 Processor -- start 2023-10-06T11:14:04.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.034+0000 7fb490607700 1 -- start start 2023-10-06T11:14:04.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.034+0000 7fb490607700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb474003a60 0x7fb4880b1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:04.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.034+0000 7fb490607700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4880b5b10 0x7fb48816b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:04.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.034+0000 7fb490607700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb48814e240 0x7fb4880af300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:04.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.034+0000 7fb490607700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4880b5f80 con 0x7fb4880b5b10 2023-10-06T11:14:04.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.034+0000 7fb490607700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4880b6210 con 0x7fb48814e240 2023-10-06T11:14:04.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.034+0000 7fb490607700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4880b0a50 con 0x7fb474003a60 2023-10-06T11:14:04.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.034+0000 7fb48dba2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4880b5b10 0x7fb48816b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:04.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.034+0000 7fb48dba2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4880b5b10 0x7fb48816b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34932/0 (socket says 172.21.15.146:34932) 2023-10-06T11:14:04.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.034+0000 7fb48dba2700 1 -- 172.21.15.146:0/3875622086 learned_addr learned my addr 172.21.15.146:0/3875622086 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:04.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.035+0000 7fb48eba4700 1 --2- 172.21.15.146:0/3875622086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb48814e240 0x7fb4880af300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:04.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.035+0000 7fb48e3a3700 1 --2- 172.21.15.146:0/3875622086 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb474003a60 0x7fb4880b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:04.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.035+0000 7fb48dba2700 1 -- 172.21.15.146:0/3875622086 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb474003a60 msgr2=0x7fb4880b1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:04.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.035+0000 7fb48dba2700 1 --2- 172.21.15.146:0/3875622086 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb474003a60 0x7fb4880b1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:04.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.035+0000 7fb48dba2700 1 -- 172.21.15.146:0/3875622086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb48814e240 msgr2=0x7fb4880af300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:04.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.035+0000 7fb48dba2700 1 --2- 172.21.15.146:0/3875622086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb48814e240 0x7fb4880af300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:04.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.035+0000 7fb48dba2700 1 -- 172.21.15.146:0/3875622086 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4880b0d30 con 0x7fb4880b5b10 2023-10-06T11:14:04.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.035+0000 7fb48e3a3700 1 --2- 172.21.15.146:0/3875622086 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb474003a60 0x7fb4880b1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:04.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.035+0000 7fb48dba2700 1 --2- 172.21.15.146:0/3875622086 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4880b5b10 0x7fb48816b040 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fb478007390 tx=0x7fb478007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:04.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.035+0000 7fb47e7fc700 1 -- 172.21.15.146:0/3875622086 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47800f870 con 0x7fb4880b5b10 2023-10-06T11:14:04.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.035+0000 7fb47e7fc700 1 -- 172.21.15.146:0/3875622086 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb47800f9f0 con 0x7fb4880b5b10 2023-10-06T11:14:04.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.035+0000 7fb490607700 1 -- 172.21.15.146:0/3875622086 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4880b1010 con 0x7fb4880b5b10 2023-10-06T11:14:04.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.035+0000 7fb47e7fc700 1 -- 172.21.15.146:0/3875622086 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47800fdb0 con 0x7fb4880b5b10 2023-10-06T11:14:04.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.035+0000 7fb490607700 1 -- 172.21.15.146:0/3875622086 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4880af840 con 0x7fb4880b5b10 2023-10-06T11:14:04.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.036+0000 7fb490607700 1 -- 172.21.15.146:0/3875622086 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4880b08b0 con 0x7fb4880b5b10 2023-10-06T11:14:04.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.036+0000 7fb47e7fc700 1 -- 172.21.15.146:0/3875622086 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb478013600 con 0x7fb4880b5b10 2023-10-06T11:14:04.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.037+0000 7fb47e7fc700 1 --2- 172.21.15.146:0/3875622086 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb46c066f30 0x7fb46c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:04.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.037+0000 7fb48e3a3700 1 --2- 172.21.15.146:0/3875622086 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb46c066f30 0x7fb46c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:04.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.037+0000 7fb47e7fc700 1 -- 172.21.15.146:0/3875622086 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb478084720 con 0x7fb4880b5b10 2023-10-06T11:14:04.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.037+0000 7fb48e3a3700 1 --2- 172.21.15.146:0/3875622086 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb46c066f30 0x7fb46c0693e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fb4840013a0 tx=0x7fb484016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:04.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.041+0000 7fb47e7fc700 1 -- 172.21.15.146:0/3875622086 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb4880b08b0 con 0x7fb4880b5b10 2023-10-06T11:14:04.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.226+0000 7fb490607700 1 -- 172.21.15.146:0/3875622086 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb4880ccd80 con 0x7fb4880b5b10 2023-10-06T11:14:04.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.227+0000 7fb47e7fc700 1 -- 172.21.15.146:0/3875622086 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v101) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb4880ccd80 con 0x7fb4880b5b10 2023-10-06T11:14:04.229 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-10-06T11:14:04.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.229+0000 7fb490607700 1 -- 172.21.15.146:0/3875622086 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb46c066f30 msgr2=0x7fb46c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:04.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.229+0000 7fb490607700 1 --2- 172.21.15.146:0/3875622086 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb46c066f30 0x7fb46c0693e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fb4840013a0 tx=0x7fb484016000 comp rx=0 tx=0).stop 2023-10-06T11:14:04.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.229+0000 7fb490607700 1 -- 172.21.15.146:0/3875622086 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4880b5b10 msgr2=0x7fb48816b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:04.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.229+0000 7fb490607700 1 --2- 172.21.15.146:0/3875622086 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4880b5b10 0x7fb48816b040 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fb478007390 tx=0x7fb478007a50 comp rx=0 tx=0).stop 2023-10-06T11:14:04.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.229+0000 7fb490607700 1 -- 172.21.15.146:0/3875622086 shutdown_connections 2023-10-06T11:14:04.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.229+0000 7fb490607700 1 --2- 172.21.15.146:0/3875622086 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb46c066f30 0x7fb46c0693e0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:04.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.229+0000 7fb490607700 1 --2- 172.21.15.146:0/3875622086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb48814e240 0x7fb4880af300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:04.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.229+0000 7fb490607700 1 --2- 172.21.15.146:0/3875622086 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb474003a60 0x7fb4880b1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:04.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.229+0000 7fb490607700 1 --2- 172.21.15.146:0/3875622086 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4880b5b10 0x7fb48816b040 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:04.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.229+0000 7fb490607700 1 -- 172.21.15.146:0/3875622086 >> 172.21.15.146:0/3875622086 conn(0x7fb48806f380 msgr2=0x7fb4880ccf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:04.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.229+0000 7fb490607700 1 -- 172.21.15.146:0/3875622086 shutdown_connections 2023-10-06T11:14:04.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.229+0000 7fb490607700 1 -- 172.21.15.146:0/3875622086 wait complete. 2023-10-06T11:14:04.243 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:14:04.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.360+0000 7fc3d5601700 1 Processor -- start 2023-10-06T11:14:04.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.360+0000 7fc3d5601700 1 -- start start 2023-10-06T11:14:04.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.360+0000 7fc3d5601700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3d01594d0 0x7fc3d00b0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:04.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.360+0000 7fc3d5601700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc3d01598a0 0x7fc3d006ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:04.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.360+0000 7fc3d5601700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc3d006bf90 0x7fc3d006eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:04.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.360+0000 7fc3d5601700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3d00ac200 con 0x7fc3d006bf90 2023-10-06T11:14:04.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.360+0000 7fc3d5601700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3d00aca10 con 0x7fc3d01598a0 2023-10-06T11:14:04.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.360+0000 7fc3d5601700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d00ac450 con 0x7fc3d01594d0 2023-10-06T11:14:04.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.361+0000 7fc3cf7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc3d006bf90 0x7fc3d006eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:04.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.361+0000 7fc3cf7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc3d006bf90 0x7fc3d006eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34938/0 (socket says 172.21.15.146:34938) 2023-10-06T11:14:04.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.361+0000 7fc3cf7fe700 1 -- 172.21.15.146:0/3905398739 learned_addr learned my addr 172.21.15.146:0/3905398739 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:04.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.361+0000 7fc3ce7fc700 1 --2- 172.21.15.146:0/3905398739 >> v2:172.21.15.151:3300/0 conn(0x7fc3d01598a0 0x7fc3d006ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:04.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.361+0000 7fc3ceffd700 1 --2- 172.21.15.146:0/3905398739 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3d01594d0 0x7fc3d00b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:04.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.361+0000 7fc3cf7fe700 1 -- 172.21.15.146:0/3905398739 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3d01594d0 msgr2=0x7fc3d00b0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:04.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.361+0000 7fc3cf7fe700 1 --2- 172.21.15.146:0/3905398739 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3d01594d0 0x7fc3d00b0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:04.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.361+0000 7fc3cf7fe700 1 -- 172.21.15.146:0/3905398739 >> v2:172.21.15.151:3300/0 conn(0x7fc3d01598a0 msgr2=0x7fc3d006ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:04.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.361+0000 7fc3cf7fe700 1 --2- 172.21.15.146:0/3905398739 >> v2:172.21.15.151:3300/0 conn(0x7fc3d01598a0 0x7fc3d006ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:04.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.361+0000 7fc3cf7fe700 1 -- 172.21.15.146:0/3905398739 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d00ac730 con 0x7fc3d006bf90 2023-10-06T11:14:04.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.361+0000 7fc3ceffd700 1 --2- 172.21.15.146:0/3905398739 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3d01594d0 0x7fc3d00b0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:04.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.361+0000 7fc3cf7fe700 1 --2- 172.21.15.146:0/3905398739 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3d006bf90 0x7fc3d006eb10 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fc3d006dc10 tx=0x7fc3c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16c2d73d48770947 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:04.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.361+0000 7fc3cdffb700 1 -- 172.21.15.146:0/3905398739 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c0009e70 con 0x7fc3d006bf90 2023-10-06T11:14:04.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.361+0000 7fc3cdffb700 1 -- 172.21.15.146:0/3905398739 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c000b860 con 0x7fc3d006bf90 2023-10-06T11:14:04.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.361+0000 7fc3cdffb700 1 -- 172.21.15.146:0/3905398739 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c000bc00 con 0x7fc3d006bf90 2023-10-06T11:14:04.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.362+0000 7fc3d5601700 1 -- 172.21.15.146:0/3905398739 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3d006bf90 msgr2=0x7fc3d006eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:04.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.362+0000 7fc3d5601700 1 --2- 172.21.15.146:0/3905398739 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3d006bf90 0x7fc3d006eb10 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fc3d006dc10 tx=0x7fc3c0009250 comp rx=0 tx=0).stop 2023-10-06T11:14:04.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.362+0000 7fc3d5601700 1 -- 172.21.15.146:0/3905398739 shutdown_connections 2023-10-06T11:14:04.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.362+0000 7fc3d5601700 1 --2- 172.21.15.146:0/3905398739 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3d006bf90 0x7fc3d006eb10 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:04.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.362+0000 7fc3d5601700 1 --2- 172.21.15.146:0/3905398739 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3d01594d0 0x7fc3d00b0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:04.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.362+0000 7fc3d5601700 1 --2- 172.21.15.146:0/3905398739 >> v2:172.21.15.151:3300/0 conn(0x7fc3d01598a0 0x7fc3d006ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:04.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.362+0000 7fc3d5601700 1 -- 172.21.15.146:0/3905398739 >> 172.21.15.146:0/3905398739 conn(0x7fc3d006af60 msgr2=0x7fc3d00aebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:04.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.362+0000 7fc3d5601700 1 -- 172.21.15.146:0/3905398739 shutdown_connections 2023-10-06T11:14:04.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.362+0000 7fc3d5601700 1 -- 172.21.15.146:0/3905398739 wait complete. 2023-10-06T11:14:04.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.363+0000 7fc3d5601700 1 Processor -- start 2023-10-06T11:14:04.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.363+0000 7fc3d5601700 1 -- start start 2023-10-06T11:14:04.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.364+0000 7fc3d5601700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3d006bf90 0x7fc3d01586c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:04.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.364+0000 7fc3d5601700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3d01594d0 0x7fc3d014af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:04.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.364+0000 7fc3d5601700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3d01598a0 0x7fc3d00c3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:04.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.364+0000 7fc3d5601700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d00af9b0 con 0x7fc3d01594d0 2023-10-06T11:14:04.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.364+0000 7fc3d5601700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d00af520 con 0x7fc3d006bf90 2023-10-06T11:14:04.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.364+0000 7fc3d5601700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d00ae910 con 0x7fc3d01598a0 2023-10-06T11:14:04.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.364+0000 7fc3ce7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3d01594d0 0x7fc3d014af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:04.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.364+0000 7fc3ce7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3d01594d0 0x7fc3d014af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34954/0 (socket says 172.21.15.146:34954) 2023-10-06T11:14:04.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.364+0000 7fc3ce7fc700 1 -- 172.21.15.146:0/3038490960 learned_addr learned my addr 172.21.15.146:0/3038490960 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:04.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.364+0000 7fc3ceffd700 1 --2- 172.21.15.146:0/3038490960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3d006bf90 0x7fc3d01586c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:04.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.364+0000 7fc3cf7fe700 1 --2- 172.21.15.146:0/3038490960 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3d01598a0 0x7fc3d00c3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:04.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.364+0000 7fc3ce7fc700 1 -- 172.21.15.146:0/3038490960 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3d01598a0 msgr2=0x7fc3d00c3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:04.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.364+0000 7fc3ce7fc700 1 --2- 172.21.15.146:0/3038490960 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3d01598a0 0x7fc3d00c3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:04.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.364+0000 7fc3ce7fc700 1 -- 172.21.15.146:0/3038490960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3d006bf90 msgr2=0x7fc3d01586c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:04.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.364+0000 7fc3ce7fc700 1 --2- 172.21.15.146:0/3038490960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3d006bf90 0x7fc3d01586c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:04.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.364+0000 7fc3ce7fc700 1 -- 172.21.15.146:0/3038490960 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c00094f0 con 0x7fc3d01594d0 2023-10-06T11:14:04.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.364+0000 7fc3ce7fc700 1 --2- 172.21.15.146:0/3038490960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3d01594d0 0x7fc3d014af60 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fc3c400e960 tx=0x7fc3c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:04.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.364+0000 7fc3b6ffd700 1 -- 172.21.15.146:0/3038490960 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c4013680 con 0x7fc3d01594d0 2023-10-06T11:14:04.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.364+0000 7fc3b6ffd700 1 -- 172.21.15.146:0/3038490960 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3c40137e0 con 0x7fc3d01594d0 2023-10-06T11:14:04.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.364+0000 7fc3d5601700 1 -- 172.21.15.146:0/3038490960 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3d00aebf0 con 0x7fc3d01594d0 2023-10-06T11:14:04.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.365+0000 7fc3b6ffd700 1 -- 172.21.15.146:0/3038490960 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c4013b80 con 0x7fc3d01594d0 2023-10-06T11:14:04.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.365+0000 7fc3d5601700 1 -- 172.21.15.146:0/3038490960 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3d00af1b0 con 0x7fc3d01594d0 2023-10-06T11:14:04.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.365+0000 7fc3d5601700 1 -- 172.21.15.146:0/3038490960 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3d00af6b0 con 0x7fc3d01594d0 2023-10-06T11:14:04.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.366+0000 7fc3b6ffd700 1 -- 172.21.15.146:0/3038490960 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc3c40123d0 con 0x7fc3d01594d0 2023-10-06T11:14:04.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.366+0000 7fc3b6ffd700 1 --2- 172.21.15.146:0/3038490960 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc3bc066f30 0x7fc3bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:04.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.366+0000 7fc3b6ffd700 1 -- 172.21.15.146:0/3038490960 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc3c4084710 con 0x7fc3d01594d0 2023-10-06T11:14:04.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.366+0000 7fc3ceffd700 1 --2- 172.21.15.146:0/3038490960 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc3bc066f30 0x7fc3bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:04.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.367+0000 7fc3ceffd700 1 --2- 172.21.15.146:0/3038490960 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc3bc066f30 0x7fc3bc0693e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8007740 tx=0x7fc3c80099d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:04.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.371+0000 7fc3b6ffd700 1 -- 172.21.15.146:0/3038490960 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc3c4051820 con 0x7fc3d01594d0 2023-10-06T11:14:04.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.555+0000 7fc3d5601700 1 -- 172.21.15.146:0/3038490960 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc3d006d1b0 con 0x7fc3d01594d0 2023-10-06T11:14:04.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.555+0000 7fc3b6ffd700 1 -- 172.21.15.146:0/3038490960 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v101) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc3c4054e40 con 0x7fc3d01594d0 2023-10-06T11:14:04.557 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-10-06T11:14:04.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.558+0000 7fc3d5601700 1 -- 172.21.15.146:0/3038490960 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc3bc066f30 msgr2=0x7fc3bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:04.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.558+0000 7fc3d5601700 1 --2- 172.21.15.146:0/3038490960 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc3bc066f30 0x7fc3bc0693e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc3c8007740 tx=0x7fc3c80099d0 comp rx=0 tx=0).stop 2023-10-06T11:14:04.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.558+0000 7fc3d5601700 1 -- 172.21.15.146:0/3038490960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3d01594d0 msgr2=0x7fc3d014af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:04.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.558+0000 7fc3d5601700 1 --2- 172.21.15.146:0/3038490960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3d01594d0 0x7fc3d014af60 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fc3c400e960 tx=0x7fc3c40091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:04.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.558+0000 7fc3d5601700 1 -- 172.21.15.146:0/3038490960 shutdown_connections 2023-10-06T11:14:04.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.558+0000 7fc3d5601700 1 --2- 172.21.15.146:0/3038490960 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc3bc066f30 0x7fc3bc0693e0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:04.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.558+0000 7fc3d5601700 1 --2- 172.21.15.146:0/3038490960 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3d01598a0 0x7fc3d00c3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:04.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.558+0000 7fc3d5601700 1 --2- 172.21.15.146:0/3038490960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3d006bf90 0x7fc3d01586c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:04.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.558+0000 7fc3d5601700 1 --2- 172.21.15.146:0/3038490960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3d01594d0 0x7fc3d014af60 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:04.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.558+0000 7fc3d5601700 1 -- 172.21.15.146:0/3038490960 >> 172.21.15.146:0/3038490960 conn(0x7fc3d006af60 msgr2=0x7fc3d01577e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:04.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.558+0000 7fc3d5601700 1 -- 172.21.15.146:0/3038490960 shutdown_connections 2023-10-06T11:14:04.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.558+0000 7fc3d5601700 1 -- 172.21.15.146:0/3038490960 wait complete. 2023-10-06T11:14:04.572 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T11:14:04.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.687+0000 7fa5fc406700 1 Processor -- start 2023-10-06T11:14:04.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.687+0000 7fa5fc406700 1 -- start start 2023-10-06T11:14:04.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.688+0000 7fa5fc406700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa5f40ae730 0x7fa5f40aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:04.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.688+0000 7fa5fc406700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5f40cb950 0x7fa5f40cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:04.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.688+0000 7fa5fc406700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5f40ae2a0 con 0x7fa5f415a160 2023-10-06T11:14:04.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.688+0000 7fa5fc406700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5f415a530 con 0x7fa5f40ae730 2023-10-06T11:14:04.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.688+0000 7fa5fc406700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f40c5cb0 con 0x7fa5f40cb950 2023-10-06T11:14:04.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.688+0000 7fa5f99a1700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa5f40ae730 0x7fa5f40aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:04.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.688+0000 7fa5fa9a3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5f40cb950 0x7fa5f40cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:04.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.688+0000 7fa5fa1a2700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fa5f415a160 0x7fa5f40c55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:41826/0 (socket says 172.21.15.146:41826) 2023-10-06T11:14:04.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.689+0000 7fa5fa1a2700 1 -- 172.21.15.146:0/2966103314 learned_addr learned my addr 172.21.15.146:0/2966103314 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:14:04.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.689+0000 7fa5f99a1700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa5f40ae730 0x7fa5f40aebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:43484/0 (socket says 172.21.15.146:43484) 2023-10-06T11:14:04.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.689+0000 7fa5fa9a3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5f40cb950 0x7fa5f40cbd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:42212/0 (socket says 172.21.15.146:42212) 2023-10-06T11:14:04.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.689+0000 7fa5f99a1700 1 -- 172.21.15.146:0/2966103314 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5f40cb950 msgr2=0x7fa5f40cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:04.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.689+0000 7fa5f99a1700 1 --2- 172.21.15.146:0/2966103314 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5f40cb950 0x7fa5f40cbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:04.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.689+0000 7fa5f99a1700 1 -- 172.21.15.146:0/2966103314 >> v1:172.21.15.151:6789/0 conn(0x7fa5f415a160 legacy=0x7fa5f40c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:04.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.689+0000 7fa5f99a1700 1 -- 172.21.15.146:0/2966103314 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f40af0f0 con 0x7fa5f40ae730 2023-10-06T11:14:04.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.689+0000 7fa5fa9a3700 1 --2- 172.21.15.146:0/2966103314 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5f40cb950 0x7fa5f40cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:14:04.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.689+0000 7fa5f99a1700 1 --2- 172.21.15.146:0/2966103314 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5f40ae730 0x7fa5f40aebb0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa5e40098e0 tx=0x7fa5e40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fe015f36202553c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:04.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.689+0000 7fa5f91a0700 1 -- 172.21.15.146:0/2966103314 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e400b640 con 0x7fa5f40ae730 2023-10-06T11:14:04.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.689+0000 7fa5f91a0700 1 -- 172.21.15.146:0/2966103314 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e400b7a0 con 0x7fa5f40ae730 2023-10-06T11:14:04.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.689+0000 7fa5f91a0700 1 -- 172.21.15.146:0/2966103314 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e400bb40 con 0x7fa5f40ae730 2023-10-06T11:14:04.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.690+0000 7fa5fc406700 1 -- 172.21.15.146:0/2966103314 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5f40ae730 msgr2=0x7fa5f40aebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:04.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.690+0000 7fa5fc406700 1 --2- 172.21.15.146:0/2966103314 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5f40ae730 0x7fa5f40aebb0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa5e40098e0 tx=0x7fa5e40091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:04.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.690+0000 7fa5fc406700 1 -- 172.21.15.146:0/2966103314 shutdown_connections 2023-10-06T11:14:04.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.690+0000 7fa5fc406700 1 --2- 172.21.15.146:0/2966103314 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5f40cb950 0x7fa5f40cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:04.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.690+0000 7fa5fc406700 1 --2- 172.21.15.146:0/2966103314 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5f40ae730 0x7fa5f40aebb0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:04.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.690+0000 7fa5fc406700 1 -- 172.21.15.146:0/2966103314 >> 172.21.15.146:0/2966103314 conn(0x7fa5f406f380 msgr2=0x7fa5f40d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:04.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.690+0000 7fa5fc406700 1 -- 172.21.15.146:0/2966103314 shutdown_connections 2023-10-06T11:14:04.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.690+0000 7fa5fc406700 1 -- 172.21.15.146:0/2966103314 wait complete. 2023-10-06T11:14:04.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.691+0000 7fa5fc406700 1 Processor -- start 2023-10-06T11:14:04.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.691+0000 7fa5fc406700 1 -- start start 2023-10-06T11:14:04.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.692+0000 7fa5fc406700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5f40ae730 0x7fa5f40c7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:04.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.692+0000 7fa5fc406700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5f40cb950 0x7fa5f416dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:04.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.692+0000 7fa5fc406700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5f415a160 0x7fa5f4157340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:04.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.692+0000 7fa5fc406700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f40c7ea0 con 0x7fa5f40ae730 2023-10-06T11:14:04.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.692+0000 7fa5fc406700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f40b3e70 con 0x7fa5f415a160 2023-10-06T11:14:04.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.692+0000 7fa5fc406700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5f40b3860 con 0x7fa5f40cb950 2023-10-06T11:14:04.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.692+0000 7fa5fa1a2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5f40ae730 0x7fa5f40c7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:04.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.692+0000 7fa5fa1a2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5f40ae730 0x7fa5f40c7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34968/0 (socket says 172.21.15.146:34968) 2023-10-06T11:14:04.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.692+0000 7fa5fa1a2700 1 -- 172.21.15.146:0/2467546022 learned_addr learned my addr 172.21.15.146:0/2467546022 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:04.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.692+0000 7fa5fa9a3700 1 --2- 172.21.15.146:0/2467546022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5f415a160 0x7fa5f4157340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:04.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.692+0000 7fa5f99a1700 1 --2- 172.21.15.146:0/2467546022 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5f40cb950 0x7fa5f416dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:04.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.692+0000 7fa5fa1a2700 1 -- 172.21.15.146:0/2467546022 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5f40cb950 msgr2=0x7fa5f416dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:04.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.692+0000 7fa5fa1a2700 1 --2- 172.21.15.146:0/2467546022 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5f40cb950 0x7fa5f416dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:04.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.692+0000 7fa5fa1a2700 1 -- 172.21.15.146:0/2467546022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5f415a160 msgr2=0x7fa5f4157340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:04.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.692+0000 7fa5fa1a2700 1 --2- 172.21.15.146:0/2467546022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5f415a160 0x7fa5f4157340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:04.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.692+0000 7fa5fa1a2700 1 -- 172.21.15.146:0/2467546022 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ec009420 con 0x7fa5f40ae730 2023-10-06T11:14:04.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.692+0000 7fa5fa1a2700 1 --2- 172.21.15.146:0/2467546022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5f40ae730 0x7fa5f40c7960 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fa5f000cc70 tx=0x7fa5f0001ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:04.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.692+0000 7fa5ea7fc700 1 -- 172.21.15.146:0/2467546022 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f000a870 con 0x7fa5f40ae730 2023-10-06T11:14:04.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.692+0000 7fa5ea7fc700 1 -- 172.21.15.146:0/2467546022 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f000a9f0 con 0x7fa5f40ae730 2023-10-06T11:14:04.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.692+0000 7fa5fc406700 1 -- 172.21.15.146:0/2467546022 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5e4009420 con 0x7fa5f40ae730 2023-10-06T11:14:04.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.692+0000 7fa5ea7fc700 1 -- 172.21.15.146:0/2467546022 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f000adb0 con 0x7fa5f40ae730 2023-10-06T11:14:04.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.692+0000 7fa5fc406700 1 -- 172.21.15.146:0/2467546022 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5f40ca8e0 con 0x7fa5f40ae730 2023-10-06T11:14:04.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.693+0000 7fa5fc406700 1 -- 172.21.15.146:0/2467546022 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5f4068390 con 0x7fa5f40ae730 2023-10-06T11:14:04.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.694+0000 7fa5ea7fc700 1 -- 172.21.15.146:0/2467546022 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa5f0012610 con 0x7fa5f40ae730 2023-10-06T11:14:04.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.694+0000 7fa5ea7fc700 1 --2- 172.21.15.146:0/2467546022 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa5d8066f30 0x7fa5d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:04.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.694+0000 7fa5ea7fc700 1 -- 172.21.15.146:0/2467546022 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa5f0084840 con 0x7fa5f40ae730 2023-10-06T11:14:04.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.694+0000 7fa5f99a1700 1 --2- 172.21.15.146:0/2467546022 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa5d8066f30 0x7fa5d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:04.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.694+0000 7fa5f99a1700 1 --2- 172.21.15.146:0/2467546022 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa5d8066f30 0x7fa5d80693e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fa5e40093f0 tx=0x7fa5e4017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:04.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.698+0000 7fa5ea7fc700 1 -- 172.21.15.146:0/2467546022 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa5f00519d0 con 0x7fa5f40ae730 2023-10-06T11:14:04.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.890+0000 7fa5fc406700 1 -- 172.21.15.146:0/2467546022 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa5f40ad690 con 0x7fa5f40ae730 2023-10-06T11:14:04.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.892+0000 7fa5ea7fc700 1 -- 172.21.15.146:0/2467546022 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v101) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa5f0054ff0 con 0x7fa5f40ae730 2023-10-06T11:14:04.899 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2023-10-06T11:14:04.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.905+0000 7fa5fc406700 1 -- 172.21.15.146:0/2467546022 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa5d8066f30 msgr2=0x7fa5d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:04.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.905+0000 7fa5fc406700 1 --2- 172.21.15.146:0/2467546022 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa5d8066f30 0x7fa5d80693e0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fa5e40093f0 tx=0x7fa5e4017000 comp rx=0 tx=0).stop 2023-10-06T11:14:04.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.905+0000 7fa5fc406700 1 -- 172.21.15.146:0/2467546022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5f40ae730 msgr2=0x7fa5f40c7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:04.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.905+0000 7fa5fc406700 1 --2- 172.21.15.146:0/2467546022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5f40ae730 0x7fa5f40c7960 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fa5f000cc70 tx=0x7fa5f0001ac0 comp rx=0 tx=0).stop 2023-10-06T11:14:04.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.906+0000 7fa5fc406700 1 -- 172.21.15.146:0/2467546022 shutdown_connections 2023-10-06T11:14:04.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.906+0000 7fa5fc406700 1 --2- 172.21.15.146:0/2467546022 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa5d8066f30 0x7fa5d80693e0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:04.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.906+0000 7fa5fc406700 1 --2- 172.21.15.146:0/2467546022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5f415a160 0x7fa5f4157340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:04.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.906+0000 7fa5fc406700 1 --2- 172.21.15.146:0/2467546022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5f40ae730 0x7fa5f40c7960 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:04.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.906+0000 7fa5fc406700 1 --2- 172.21.15.146:0/2467546022 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5f40cb950 0x7fa5f416dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:04.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.906+0000 7fa5fc406700 1 -- 172.21.15.146:0/2467546022 >> 172.21.15.146:0/2467546022 conn(0x7fa5f406f380 msgr2=0x7fa5f4159560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:04.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.909+0000 7fa5fc406700 1 -- 172.21.15.146:0/2467546022 shutdown_connections 2023-10-06T11:14:04.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:04.909+0000 7fa5fc406700 1 -- 172.21.15.146:0/2467546022 wait complete. 2023-10-06T11:14:04.931 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T11:14:05.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.047+0000 7f917d72e700 1 Processor -- start 2023-10-06T11:14:05.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.047+0000 7f917d72e700 1 -- start start 2023-10-06T11:14:05.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.048+0000 7f917d72e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f91780676c0 0x7f91780b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:05.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.048+0000 7f917d72e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9178067a90 0x7f917815ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:05.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.048+0000 7f917d72e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f917815a840 con 0x7f917806e690 2023-10-06T11:14:05.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.048+0000 7f917d72e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f917815ab20 con 0x7f9178067a90 2023-10-06T11:14:05.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.048+0000 7f917d72e700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f917815ae00 con 0x7f91780676c0 2023-10-06T11:14:05.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.048+0000 7f916e7fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9178067a90 0x7f917815ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:05.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.048+0000 7f91777fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f917806e690 0x7f917806eb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33882/0 (socket says 172.21.15.146:33882) 2023-10-06T11:14:05.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.048+0000 7f916e7fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9178067a90 0x7f917815ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34974/0 (socket says 172.21.15.146:34974) 2023-10-06T11:14:05.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.048+0000 7f91777fe700 1 -- 172.21.15.146:0/2415320368 learned_addr learned my addr 172.21.15.146:0/2415320368 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:14:05.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.048+0000 7f9176ffd700 1 --2- 172.21.15.146:0/2415320368 >> v2:172.21.15.151:3300/0 conn(0x7f91780676c0 0x7f91780b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:05.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.049+0000 7f916e7fc700 1 -- 172.21.15.146:0/2415320368 >> v2:172.21.15.151:3300/0 conn(0x7f91780676c0 msgr2=0x7f91780b0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:05.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.049+0000 7f916e7fc700 1 --2- 172.21.15.146:0/2415320368 >> v2:172.21.15.151:3300/0 conn(0x7f91780676c0 0x7f91780b0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:05.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.049+0000 7f916e7fc700 1 -- 172.21.15.146:0/2415320368 >> v1:172.21.15.146:6789/0 conn(0x7f917806e690 legacy=0x7f917806eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:05.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.049+0000 7f916e7fc700 1 -- 172.21.15.146:0/2415320368 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f917815d5b0 con 0x7f9178067a90 2023-10-06T11:14:05.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.049+0000 7f91767fc700 1 -- 172.21.15.146:0/2415320368 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2975812123 0 0) 0x7f917815a840 con 0x7f917806e690 2023-10-06T11:14:05.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.049+0000 7f916e7fc700 1 --2- 172.21.15.146:0/2415320368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9178067a90 0x7f917815ddb0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f917806fcc0 tx=0x7f91600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=655cdcddd1dee0be server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:05.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.049+0000 7f91767fc700 1 -- 172.21.15.146:0/2415320368 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916000b6b0 con 0x7f9178067a90 2023-10-06T11:14:05.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.049+0000 7f91767fc700 1 -- 172.21.15.146:0/2415320368 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916000b810 con 0x7f9178067a90 2023-10-06T11:14:05.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.049+0000 7f91767fc700 1 -- 172.21.15.146:0/2415320368 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916000bbb0 con 0x7f9178067a90 2023-10-06T11:14:05.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.049+0000 7f917d72e700 1 -- 172.21.15.146:0/2415320368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9178067a90 msgr2=0x7f917815ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:05.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.049+0000 7f917d72e700 1 --2- 172.21.15.146:0/2415320368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9178067a90 0x7f917815ddb0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f917806fcc0 tx=0x7f91600091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:05.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.049+0000 7f917d72e700 1 -- 172.21.15.146:0/2415320368 shutdown_connections 2023-10-06T11:14:05.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.049+0000 7f917d72e700 1 --2- 172.21.15.146:0/2415320368 >> v2:172.21.15.151:3300/0 conn(0x7f91780676c0 0x7f91780b0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:05.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.049+0000 7f917d72e700 1 --2- 172.21.15.146:0/2415320368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9178067a90 0x7f917815ddb0 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:05.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.049+0000 7f917d72e700 1 -- 172.21.15.146:0/2415320368 >> 172.21.15.146:0/2415320368 conn(0x7f9178068580 msgr2=0x7f9178068980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:05.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.050+0000 7f917d72e700 1 -- 172.21.15.146:0/2415320368 shutdown_connections 2023-10-06T11:14:05.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.050+0000 7f917d72e700 1 -- 172.21.15.146:0/2415320368 wait complete. 2023-10-06T11:14:05.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.051+0000 7f917d72e700 1 Processor -- start 2023-10-06T11:14:05.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.051+0000 7f917d72e700 1 -- start start 2023-10-06T11:14:05.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.051+0000 7f917d72e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91780676c0 0x7f917815c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:05.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.051+0000 7f917d72e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9178067a90 0x7f91780adad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:05.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.051+0000 7f917d72e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f917806e690 0x7f91780abb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:05.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.051+0000 7f917d72e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91780ccdc0 con 0x7f91780676c0 2023-10-06T11:14:05.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.051+0000 7f917d72e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91780acb00 con 0x7f9178067a90 2023-10-06T11:14:05.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.051+0000 7f917d72e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91780acd10 con 0x7f917806e690 2023-10-06T11:14:05.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.052+0000 7f9176ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91780676c0 0x7f917815c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:05.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.052+0000 7f9176ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91780676c0 0x7f917815c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34982/0 (socket says 172.21.15.146:34982) 2023-10-06T11:14:05.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.052+0000 7f9176ffd700 1 -- 172.21.15.146:0/4151505444 learned_addr learned my addr 172.21.15.146:0/4151505444 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:05.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.052+0000 7f916e7fc700 1 --2- 172.21.15.146:0/4151505444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9178067a90 0x7f91780adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:05.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.052+0000 7f91777fe700 1 --2- 172.21.15.146:0/4151505444 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f917806e690 0x7f91780abb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:05.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.052+0000 7f9176ffd700 1 -- 172.21.15.146:0/4151505444 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f917806e690 msgr2=0x7f91780abb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:05.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.052+0000 7f9176ffd700 1 --2- 172.21.15.146:0/4151505444 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f917806e690 0x7f91780abb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:05.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.052+0000 7f9176ffd700 1 -- 172.21.15.146:0/4151505444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9178067a90 msgr2=0x7f91780adad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:05.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.052+0000 7f9176ffd700 1 --2- 172.21.15.146:0/4151505444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9178067a90 0x7f91780adad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:05.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.052+0000 7f9176ffd700 1 -- 172.21.15.146:0/4151505444 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9160009420 con 0x7f91780676c0 2023-10-06T11:14:05.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.052+0000 7f91777fe700 1 --2- 172.21.15.146:0/4151505444 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f917806e690 0x7f91780abb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:05.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.052+0000 7f9176ffd700 1 --2- 172.21.15.146:0/4151505444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91780676c0 0x7f917815c710 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f916800d860 tx=0x7f9168008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:05.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.052+0000 7f916f7fe700 1 -- 172.21.15.146:0/4151505444 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91680125f0 con 0x7f91780676c0 2023-10-06T11:14:05.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.052+0000 7f916f7fe700 1 -- 172.21.15.146:0/4151505444 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9168012750 con 0x7f91780676c0 2023-10-06T11:14:05.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.052+0000 7f917d72e700 1 -- 172.21.15.146:0/4151505444 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91780acff0 con 0x7f91780676c0 2023-10-06T11:14:05.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.052+0000 7f916f7fe700 1 -- 172.21.15.146:0/4151505444 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9168012b10 con 0x7f91780676c0 2023-10-06T11:14:05.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.052+0000 7f917d72e700 1 -- 172.21.15.146:0/4151505444 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91780ad630 con 0x7f91780676c0 2023-10-06T11:14:05.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.053+0000 7f917d72e700 1 -- 172.21.15.146:0/4151505444 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91780ad920 con 0x7f91780676c0 2023-10-06T11:14:05.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.054+0000 7f916f7fe700 1 -- 172.21.15.146:0/4151505444 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f916801e460 con 0x7f91780676c0 2023-10-06T11:14:05.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.054+0000 7f916f7fe700 1 --2- 172.21.15.146:0/4151505444 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9158066f30 0x7f91580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:05.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.054+0000 7f916f7fe700 1 -- 172.21.15.146:0/4151505444 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9168084bd0 con 0x7f91780676c0 2023-10-06T11:14:05.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.054+0000 7f916e7fc700 1 --2- 172.21.15.146:0/4151505444 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9158066f30 0x7f91580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:05.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.054+0000 7f916e7fc700 1 --2- 172.21.15.146:0/4151505444 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9158066f30 0x7f91580693e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f91600093f0 tx=0x7f9160017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:05.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.058+0000 7f916f7fe700 1 -- 172.21.15.146:0/4151505444 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9168051ce0 con 0x7f91780676c0 2023-10-06T11:14:05.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.239+0000 7f917d72e700 1 -- 172.21.15.146:0/4151505444 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f917804c380 con 0x7f91780676c0 2023-10-06T11:14:05.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.239+0000 7f916f7fe700 1 -- 172.21.15.146:0/4151505444 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v101) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9168055300 con 0x7f91780676c0 2023-10-06T11:14:05.241 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2023-10-06T11:14:05.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.241+0000 7f917d72e700 1 -- 172.21.15.146:0/4151505444 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9158066f30 msgr2=0x7f91580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:05.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.241+0000 7f917d72e700 1 --2- 172.21.15.146:0/4151505444 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9158066f30 0x7f91580693e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f91600093f0 tx=0x7f9160017000 comp rx=0 tx=0).stop 2023-10-06T11:14:05.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.241+0000 7f917d72e700 1 -- 172.21.15.146:0/4151505444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91780676c0 msgr2=0x7f917815c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:05.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.241+0000 7f917d72e700 1 --2- 172.21.15.146:0/4151505444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91780676c0 0x7f917815c710 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f916800d860 tx=0x7f9168008040 comp rx=0 tx=0).stop 2023-10-06T11:14:05.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.241+0000 7f917d72e700 1 -- 172.21.15.146:0/4151505444 shutdown_connections 2023-10-06T11:14:05.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.241+0000 7f917d72e700 1 --2- 172.21.15.146:0/4151505444 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9158066f30 0x7f91580693e0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:05.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.241+0000 7f917d72e700 1 --2- 172.21.15.146:0/4151505444 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f917806e690 0x7f91780abb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:05.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.241+0000 7f917d72e700 1 --2- 172.21.15.146:0/4151505444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f91780676c0 0x7f917815c710 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:05.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.241+0000 7f917d72e700 1 --2- 172.21.15.146:0/4151505444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9178067a90 0x7f91780adad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:05.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.241+0000 7f917d72e700 1 -- 172.21.15.146:0/4151505444 >> 172.21.15.146:0/4151505444 conn(0x7f9178068580 msgr2=0x7f9178153900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:05.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.241+0000 7f917d72e700 1 -- 172.21.15.146:0/4151505444 shutdown_connections 2023-10-06T11:14:05.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.241+0000 7f917d72e700 1 -- 172.21.15.146:0/4151505444 wait complete. 2023-10-06T11:14:05.256 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:14:05.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.369+0000 7f0d08493700 1 Processor -- start 2023-10-06T11:14:05.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.369+0000 7f0d08493700 1 -- start start 2023-10-06T11:14:05.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.370+0000 7f0d08493700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d00153ab0 0x7f0d0015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:05.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.370+0000 7f0d08493700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0d00153e80 0x7f0d00068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:05.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.370+0000 7f0d08493700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0d000689d0 0x7f0d0015d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:05.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.370+0000 7f0d08493700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d00068e50 con 0x7f0d00153e80 2023-10-06T11:14:05.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.370+0000 7f0d08493700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d0015ac30 con 0x7f0d000689d0 2023-10-06T11:14:05.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.370+0000 7f0d08493700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d000b4510 con 0x7f0d00153ab0 2023-10-06T11:14:05.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.370+0000 7f0d05a2e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0d00153e80 0x7f0d00068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:05.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.370+0000 7f0d05a2e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0d00153e80 0x7f0d00068490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34984/0 (socket says 172.21.15.146:34984) 2023-10-06T11:14:05.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.370+0000 7f0d05a2e700 1 -- 172.21.15.146:0/515749836 learned_addr learned my addr 172.21.15.146:0/515749836 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:05.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.370+0000 7f0d06a30700 1 --2- 172.21.15.146:0/515749836 >> v2:172.21.15.151:3300/0 conn(0x7f0d000689d0 0x7f0d0015d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:05.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.370+0000 7f0d0622f700 1 --2- 172.21.15.146:0/515749836 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d00153ab0 0x7f0d0015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:05.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.370+0000 7f0d05a2e700 1 -- 172.21.15.146:0/515749836 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d00153ab0 msgr2=0x7f0d0015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:05.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.370+0000 7f0d05a2e700 1 --2- 172.21.15.146:0/515749836 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d00153ab0 0x7f0d0015a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:05.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.370+0000 7f0d05a2e700 1 -- 172.21.15.146:0/515749836 >> v2:172.21.15.151:3300/0 conn(0x7f0d000689d0 msgr2=0x7f0d0015d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:05.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.370+0000 7f0d05a2e700 1 --2- 172.21.15.146:0/515749836 >> v2:172.21.15.151:3300/0 conn(0x7f0d000689d0 0x7f0d0015d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:05.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.370+0000 7f0d05a2e700 1 -- 172.21.15.146:0/515749836 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d000b6530 con 0x7f0d00153e80 2023-10-06T11:14:05.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.370+0000 7f0d05a2e700 1 --2- 172.21.15.146:0/515749836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d00153e80 0x7f0d00068490 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f0d00089a80 tx=0x7f0cf0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50f4c8e4a9911e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:05.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.370+0000 7f0d0522d700 1 -- 172.21.15.146:0/515749836 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf000b640 con 0x7f0d00153e80 2023-10-06T11:14:05.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.371+0000 7f0d0522d700 1 -- 172.21.15.146:0/515749836 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf000b7a0 con 0x7f0d00153e80 2023-10-06T11:14:05.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.371+0000 7f0d0522d700 1 -- 172.21.15.146:0/515749836 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf000bb60 con 0x7f0d00153e80 2023-10-06T11:14:05.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.371+0000 7f0d08493700 1 -- 172.21.15.146:0/515749836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d00153e80 msgr2=0x7f0d00068490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:05.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.371+0000 7f0d08493700 1 --2- 172.21.15.146:0/515749836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d00153e80 0x7f0d00068490 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f0d00089a80 tx=0x7f0cf0009250 comp rx=0 tx=0).stop 2023-10-06T11:14:05.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.371+0000 7f0d08493700 1 -- 172.21.15.146:0/515749836 shutdown_connections 2023-10-06T11:14:05.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.371+0000 7f0d08493700 1 --2- 172.21.15.146:0/515749836 >> v2:172.21.15.151:3300/0 conn(0x7f0d000689d0 0x7f0d0015d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:05.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.371+0000 7f0d08493700 1 --2- 172.21.15.146:0/515749836 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d00153ab0 0x7f0d0015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:05.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.371+0000 7f0d08493700 1 --2- 172.21.15.146:0/515749836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d00153e80 0x7f0d00068490 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:05.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.371+0000 7f0d08493700 1 -- 172.21.15.146:0/515749836 >> 172.21.15.146:0/515749836 conn(0x7f0d0006eba0 msgr2=0x7f0d0006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:05.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.371+0000 7f0d08493700 1 -- 172.21.15.146:0/515749836 shutdown_connections 2023-10-06T11:14:05.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.371+0000 7f0d08493700 1 -- 172.21.15.146:0/515749836 wait complete. 2023-10-06T11:14:05.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.372+0000 7f0d08493700 1 Processor -- start 2023-10-06T11:14:05.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.372+0000 7f0d08493700 1 -- start start 2023-10-06T11:14:05.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.373+0000 7f0d08493700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d000689d0 0x7f0d001585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:05.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.373+0000 7f0d08493700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d00153ab0 0x7f0d000b1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:05.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.373+0000 7f0d08493700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d00153e80 0x7f0d00144cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:05.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.373+0000 7f0d08493700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d00154320 con 0x7f0d000689d0 2023-10-06T11:14:05.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.373+0000 7f0d08493700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d00155140 con 0x7f0d00153ab0 2023-10-06T11:14:05.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.373+0000 7f0d08493700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d00154530 con 0x7f0d00153e80 2023-10-06T11:14:05.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.373+0000 7f0d0622f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d000689d0 0x7f0d001585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:05.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.373+0000 7f0d0622f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d000689d0 0x7f0d001585f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:34994/0 (socket says 172.21.15.146:34994) 2023-10-06T11:14:05.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.373+0000 7f0d0622f700 1 -- 172.21.15.146:0/3106898437 learned_addr learned my addr 172.21.15.146:0/3106898437 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:05.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.374+0000 7f0d0622f700 1 -- 172.21.15.146:0/3106898437 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d00153e80 msgr2=0x7f0d00144cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:05.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.374+0000 7f0d0622f700 1 --2- 172.21.15.146:0/3106898437 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d00153e80 0x7f0d00144cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:05.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.374+0000 7f0d0622f700 1 -- 172.21.15.146:0/3106898437 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d00153ab0 msgr2=0x7f0d000b1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:05.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.374+0000 7f0d0622f700 1 --2- 172.21.15.146:0/3106898437 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d00153ab0 0x7f0d000b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:05.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.374+0000 7f0d0622f700 1 -- 172.21.15.146:0/3106898437 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf00094f0 con 0x7f0d000689d0 2023-10-06T11:14:05.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.374+0000 7f0d0622f700 1 --2- 172.21.15.146:0/3106898437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d000689d0 0x7f0d001585f0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc009ef0 tx=0x7f0cfc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:05.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.374+0000 7f0cf67fc700 1 -- 172.21.15.146:0/3106898437 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc00cc50 con 0x7f0d000689d0 2023-10-06T11:14:05.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.374+0000 7f0cf67fc700 1 -- 172.21.15.146:0/3106898437 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cfc00f040 con 0x7f0d000689d0 2023-10-06T11:14:05.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.374+0000 7f0d08493700 1 -- 172.21.15.146:0/3106898437 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d00154810 con 0x7f0d000689d0 2023-10-06T11:14:05.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.374+0000 7f0cf67fc700 1 -- 172.21.15.146:0/3106898437 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cfc014480 con 0x7f0d000689d0 2023-10-06T11:14:05.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.374+0000 7f0d08493700 1 -- 172.21.15.146:0/3106898437 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d00154dd0 con 0x7f0d000689d0 2023-10-06T11:14:05.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.375+0000 7f0d08493700 1 -- 172.21.15.146:0/3106898437 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d0004c380 con 0x7f0d000689d0 2023-10-06T11:14:05.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.375+0000 7f0cf67fc700 1 -- 172.21.15.146:0/3106898437 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0cfc0147f0 con 0x7f0d000689d0 2023-10-06T11:14:05.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.375+0000 7f0cf67fc700 1 --2- 172.21.15.146:0/3106898437 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0ce4066f30 0x7f0ce40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:05.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.376+0000 7f0cf67fc700 1 -- 172.21.15.146:0/3106898437 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0cfc0850d0 con 0x7f0d000689d0 2023-10-06T11:14:05.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.376+0000 7f0d05a2e700 1 --2- 172.21.15.146:0/3106898437 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0ce4066f30 0x7f0ce40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:05.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.376+0000 7f0d05a2e700 1 --2- 172.21.15.146:0/3106898437 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0ce4066f30 0x7f0ce40693e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f0d001542f0 tx=0x7f0cf0017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:05.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.380+0000 7f0cf67fc700 1 -- 172.21.15.146:0/3106898437 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0cfc0521e0 con 0x7f0d000689d0 2023-10-06T11:14:05.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.608+0000 7f0d08493700 1 -- 172.21.15.146:0/3106898437 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d000b5c50 con 0x7f0d000689d0 2023-10-06T11:14:05.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.608+0000 7f0cf67fc700 1 -- 172.21.15.146:0/3106898437 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f0cfc055800 con 0x7f0d000689d0 2023-10-06T11:14:05.610 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:05.610 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":93,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/2159562091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2159562091},{"type":"v1","addr":"172.21.15.151:6834","nonce":2159562091}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6242,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/603782012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":603782012},{"type":"v1","addr":"172.21.15.151:6835","nonce":603782012}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6916,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3416056259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3416056259},{"type":"v1","addr":"172.21.15.146:6837","nonce":3416056259}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:13:30.345795+0000","modified":"2023-10-06T11:13:33.984549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7620":{"gid":7620,"name":"c","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/785131800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":785131800},{"type":"v1","addr":"172.21.15.146:6835","nonce":785131800}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T11:14:05.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.610+0000 7f0d08493700 1 -- 172.21.15.146:0/3106898437 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0ce4066f30 msgr2=0x7f0ce40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:05.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.610+0000 7f0d08493700 1 --2- 172.21.15.146:0/3106898437 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0ce4066f30 0x7f0ce40693e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f0d001542f0 tx=0x7f0cf0017000 comp rx=0 tx=0).stop 2023-10-06T11:14:05.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.610+0000 7f0d08493700 1 -- 172.21.15.146:0/3106898437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d000689d0 msgr2=0x7f0d001585f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:05.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.610+0000 7f0d08493700 1 --2- 172.21.15.146:0/3106898437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d000689d0 0x7f0d001585f0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f0cfc009ef0 tx=0x7f0cfc00b040 comp rx=0 tx=0).stop 2023-10-06T11:14:05.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.610+0000 7f0d08493700 1 -- 172.21.15.146:0/3106898437 shutdown_connections 2023-10-06T11:14:05.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.610+0000 7f0d08493700 1 --2- 172.21.15.146:0/3106898437 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0ce4066f30 0x7f0ce40693e0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:05.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.610+0000 7f0d08493700 1 --2- 172.21.15.146:0/3106898437 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0d00153e80 0x7f0d00144cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:05.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.610+0000 7f0d08493700 1 --2- 172.21.15.146:0/3106898437 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0d000689d0 0x7f0d001585f0 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:05.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.610+0000 7f0d08493700 1 --2- 172.21.15.146:0/3106898437 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d00153ab0 0x7f0d000b1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:05.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.610+0000 7f0d08493700 1 -- 172.21.15.146:0/3106898437 >> 172.21.15.146:0/3106898437 conn(0x7f0d0006eba0 msgr2=0x7f0d000d0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:05.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.610+0000 7f0d08493700 1 -- 172.21.15.146:0/3106898437 shutdown_connections 2023-10-06T11:14:05.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.610+0000 7f0d08493700 1 -- 172.21.15.146:0/3106898437 wait complete. 2023-10-06T11:14:05.614 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 93 2023-10-06T11:14:05.624 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:14:05.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.740+0000 7f3c37845700 1 Processor -- start 2023-10-06T11:14:05.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.740+0000 7f3c37845700 1 -- start start 2023-10-06T11:14:05.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.741+0000 7f3c37845700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3c30068ba0 0x7f3c3015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:05.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.741+0000 7f3c37845700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3c30153e80 0x7f3c300b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:05.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.741+0000 7f3c37845700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c3015ac30 con 0x7f3c30153ab0 2023-10-06T11:14:05.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.741+0000 7f3c37845700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c300b4510 con 0x7f3c30153e80 2023-10-06T11:14:05.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.741+0000 7f3c37845700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c300b6530 con 0x7f3c30068ba0 2023-10-06T11:14:05.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.741+0000 7f3c35de2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3c30153e80 0x7f3c300b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:05.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.741+0000 7f3c35de2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3c30153e80 0x7f3c300b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35002/0 (socket says 172.21.15.146:35002) 2023-10-06T11:14:05.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.741+0000 7f3c35de2700 1 -- 172.21.15.146:0/3099575965 learned_addr learned my addr 172.21.15.146:0/3099575965 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:05.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.741+0000 7f3c34de0700 1 --2- 172.21.15.146:0/3099575965 >> v2:172.21.15.151:3300/0 conn(0x7f3c30068ba0 0x7f3c3015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:05.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.741+0000 7f3c35de2700 1 -- 172.21.15.146:0/3099575965 >> v2:172.21.15.151:3300/0 conn(0x7f3c30068ba0 msgr2=0x7f3c3015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:05.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.741+0000 7f3c35de2700 1 --2- 172.21.15.146:0/3099575965 >> v2:172.21.15.151:3300/0 conn(0x7f3c30068ba0 0x7f3c3015a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:05.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.741+0000 7f3c35de2700 1 -- 172.21.15.146:0/3099575965 >> v1:172.21.15.151:6789/0 conn(0x7f3c30153ab0 legacy=0x7f3c30068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:05.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.741+0000 7f3c35de2700 1 -- 172.21.15.146:0/3099575965 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c300b5c50 con 0x7f3c30153e80 2023-10-06T11:14:05.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.741+0000 7f3c34de0700 1 --2- 172.21.15.146:0/3099575965 >> v2:172.21.15.151:3300/0 conn(0x7f3c30068ba0 0x7f3c3015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:05.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.741+0000 7f3c35de2700 1 --2- 172.21.15.146:0/3099575965 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c30153e80 0x7f3c300b49a0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f3c30089770 tx=0x7f3c20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3ea722e3a5d74 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:05.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.741+0000 7f3c2ffff700 1 -- 172.21.15.146:0/3099575965 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2000b820 con 0x7f3c30153e80 2023-10-06T11:14:05.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.741+0000 7f3c2ffff700 1 -- 172.21.15.146:0/3099575965 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c2000b980 con 0x7f3c30153e80 2023-10-06T11:14:05.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.741+0000 7f3c2ffff700 1 -- 172.21.15.146:0/3099575965 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2000bd20 con 0x7f3c30153e80 2023-10-06T11:14:05.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.742+0000 7f3c37845700 1 -- 172.21.15.146:0/3099575965 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c30153e80 msgr2=0x7f3c300b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:05.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.742+0000 7f3c37845700 1 --2- 172.21.15.146:0/3099575965 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c30153e80 0x7f3c300b49a0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f3c30089770 tx=0x7f3c20009250 comp rx=0 tx=0).stop 2023-10-06T11:14:05.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.742+0000 7f3c37845700 1 -- 172.21.15.146:0/3099575965 shutdown_connections 2023-10-06T11:14:05.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.742+0000 7f3c37845700 1 --2- 172.21.15.146:0/3099575965 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c30153e80 0x7f3c300b49a0 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:05.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.742+0000 7f3c37845700 1 --2- 172.21.15.146:0/3099575965 >> v2:172.21.15.151:3300/0 conn(0x7f3c30068ba0 0x7f3c3015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:05.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.742+0000 7f3c37845700 1 -- 172.21.15.146:0/3099575965 >> 172.21.15.146:0/3099575965 conn(0x7f3c3006eba0 msgr2=0x7f3c3006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:05.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.742+0000 7f3c37845700 1 -- 172.21.15.146:0/3099575965 shutdown_connections 2023-10-06T11:14:05.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.742+0000 7f3c37845700 1 -- 172.21.15.146:0/3099575965 wait complete. 2023-10-06T11:14:05.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.743+0000 7f3c37845700 1 Processor -- start 2023-10-06T11:14:05.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.743+0000 7f3c37845700 1 -- start start 2023-10-06T11:14:05.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.744+0000 7f3c37845700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c30068ba0 0x7f3c3013e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:05.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.744+0000 7f3c37845700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c30153ab0 0x7f3c300b2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:05.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.744+0000 7f3c37845700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3c30153e80 0x7f3c300cef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:05.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.744+0000 7f3c37845700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3016d930 con 0x7f3c30068ba0 2023-10-06T11:14:05.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.744+0000 7f3c37845700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3013e870 con 0x7f3c30153ab0 2023-10-06T11:14:05.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.744+0000 7f3c37845700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3016ccb0 con 0x7f3c30153e80 2023-10-06T11:14:05.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.744+0000 7f3c355e1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c30068ba0 0x7f3c3013e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:05.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.744+0000 7f3c355e1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c30068ba0 0x7f3c3013e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35010/0 (socket says 172.21.15.146:35010) 2023-10-06T11:14:05.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.744+0000 7f3c355e1700 1 -- 172.21.15.146:0/1314519579 learned_addr learned my addr 172.21.15.146:0/1314519579 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:05.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.744+0000 7f3c34de0700 1 --2- 172.21.15.146:0/1314519579 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c30153ab0 0x7f3c300b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:05.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.744+0000 7f3c35de2700 1 --2- 172.21.15.146:0/1314519579 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3c30153e80 0x7f3c300cef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:05.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.745+0000 7f3c355e1700 1 -- 172.21.15.146:0/1314519579 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3c30153e80 msgr2=0x7f3c300cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:05.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.745+0000 7f3c355e1700 1 --2- 172.21.15.146:0/1314519579 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3c30153e80 0x7f3c300cef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:05.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.745+0000 7f3c355e1700 1 -- 172.21.15.146:0/1314519579 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c30153ab0 msgr2=0x7f3c300b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:05.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.745+0000 7f3c355e1700 1 --2- 172.21.15.146:0/1314519579 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c30153ab0 0x7f3c300b2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:05.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.745+0000 7f3c355e1700 1 -- 172.21.15.146:0/1314519579 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c200094f0 con 0x7f3c30068ba0 2023-10-06T11:14:05.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.745+0000 7f3c355e1700 1 --2- 172.21.15.146:0/1314519579 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c30068ba0 0x7f3c3013e330 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f3c2800c950 tx=0x7f3c28002760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:05.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.745+0000 7f3c2d7fa700 1 -- 172.21.15.146:0/1314519579 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c28012630 con 0x7f3c30068ba0 2023-10-06T11:14:05.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.745+0000 7f3c2d7fa700 1 -- 172.21.15.146:0/1314519579 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c28012790 con 0x7f3c30068ba0 2023-10-06T11:14:05.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.745+0000 7f3c37845700 1 -- 172.21.15.146:0/1314519579 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c3016cf90 con 0x7f3c30068ba0 2023-10-06T11:14:05.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.745+0000 7f3c2d7fa700 1 -- 172.21.15.146:0/1314519579 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c28012b50 con 0x7f3c30068ba0 2023-10-06T11:14:05.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.745+0000 7f3c37845700 1 -- 172.21.15.146:0/1314519579 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c3016d550 con 0x7f3c30068ba0 2023-10-06T11:14:05.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.746+0000 7f3c37845700 1 -- 172.21.15.146:0/1314519579 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c3004c380 con 0x7f3c30068ba0 2023-10-06T11:14:05.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.746+0000 7f3c2d7fa700 1 -- 172.21.15.146:0/1314519579 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3c2801b400 con 0x7f3c30068ba0 2023-10-06T11:14:05.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.747+0000 7f3c2d7fa700 1 --2- 172.21.15.146:0/1314519579 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3c1c066f30 0x7f3c1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:05.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.747+0000 7f3c34de0700 1 --2- 172.21.15.146:0/1314519579 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3c1c066f30 0x7f3c1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:05.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.747+0000 7f3c2d7fa700 1 -- 172.21.15.146:0/1314519579 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3c28084ae0 con 0x7f3c30068ba0 2023-10-06T11:14:05.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.747+0000 7f3c34de0700 1 --2- 172.21.15.146:0/1314519579 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3c1c066f30 0x7f3c1c0693e0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f3c30159320 tx=0x7f3c24008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:05.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.751+0000 7f3c2d7fa700 1 -- 172.21.15.146:0/1314519579 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3c28051bf0 con 0x7f3c30068ba0 2023-10-06T11:14:05.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.940+0000 7f3c37845700 1 -- 172.21.15.146:0/1314519579 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c300b6250 con 0x7f3c30068ba0 2023-10-06T11:14:05.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.941+0000 7f3c2d7fa700 1 -- 172.21.15.146:0/1314519579 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+16920 (secure 0 0 0) 0x7f3c28016090 con 0x7f3c30068ba0 2023-10-06T11:14:05.943 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:05.943 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":101,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:13:31.372487+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:13:28.028009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-10-06T11:13:29.311107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:14:05.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.943+0000 7f3c37845700 1 -- 172.21.15.146:0/1314519579 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3c1c066f30 msgr2=0x7f3c1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:05.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.943+0000 7f3c37845700 1 --2- 172.21.15.146:0/1314519579 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3c1c066f30 0x7f3c1c0693e0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f3c30159320 tx=0x7f3c24008040 comp rx=0 tx=0).stop 2023-10-06T11:14:05.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.943+0000 7f3c37845700 1 -- 172.21.15.146:0/1314519579 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c30068ba0 msgr2=0x7f3c3013e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:05.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.943+0000 7f3c37845700 1 --2- 172.21.15.146:0/1314519579 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c30068ba0 0x7f3c3013e330 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f3c2800c950 tx=0x7f3c28002760 comp rx=0 tx=0).stop 2023-10-06T11:14:05.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.943+0000 7f3c37845700 1 -- 172.21.15.146:0/1314519579 shutdown_connections 2023-10-06T11:14:05.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.943+0000 7f3c37845700 1 --2- 172.21.15.146:0/1314519579 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3c1c066f30 0x7f3c1c0693e0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:05.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.943+0000 7f3c37845700 1 --2- 172.21.15.146:0/1314519579 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3c30153e80 0x7f3c300cef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:05.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.943+0000 7f3c37845700 1 --2- 172.21.15.146:0/1314519579 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3c30068ba0 0x7f3c3013e330 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:05.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.943+0000 7f3c37845700 1 --2- 172.21.15.146:0/1314519579 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c30153ab0 0x7f3c300b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:05.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.943+0000 7f3c37845700 1 -- 172.21.15.146:0/1314519579 >> 172.21.15.146:0/1314519579 conn(0x7f3c3006eba0 msgr2=0x7f3c3015add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:05.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.943+0000 7f3c37845700 1 -- 172.21.15.146:0/1314519579 shutdown_connections 2023-10-06T11:14:05.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:05.943+0000 7f3c37845700 1 -- 172.21.15.146:0/1314519579 wait complete. 2023-10-06T11:14:05.958 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T11:14:05.958 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:14:06.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.072+0000 7f8bbed54700 1 Processor -- start 2023-10-06T11:14:06.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.072+0000 7f8bbed54700 1 -- start start 2023-10-06T11:14:06.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.073+0000 7f8bbed54700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8bb8153ab0 0x7f8bb815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:06.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.073+0000 7f8bbed54700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8bb8153e80 0x7f8bb8068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:06.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.073+0000 7f8bbed54700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bb815ac30 con 0x7f8bb80689d0 2023-10-06T11:14:06.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.073+0000 7f8bbed54700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bb8068e50 con 0x7f8bb8153e80 2023-10-06T11:14:06.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.073+0000 7f8bbed54700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb80b4510 con 0x7f8bb8153ab0 2023-10-06T11:14:06.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.073+0000 7f8bbd2f1700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8bb80689d0 0x7f8bb815d270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33890/0 (socket says 172.21.15.146:33890) 2023-10-06T11:14:06.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.073+0000 7f8bbd2f1700 1 -- 172.21.15.146:0/1556308066 learned_addr learned my addr 172.21.15.146:0/1556308066 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:14:06.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.073+0000 7f8bb7fff700 1 --2- 172.21.15.146:0/1556308066 >> v2:172.21.15.151:3300/0 conn(0x7f8bb8153e80 0x7f8bb8068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:06.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.073+0000 7f8bbcaf0700 1 --2- 172.21.15.146:0/1556308066 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8bb8153ab0 0x7f8bb815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:06.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.073+0000 7f8bb77fe700 1 -- 172.21.15.146:0/1556308066 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1609058975 0 0) 0x7f8bb0001490 con 0x7f8bb80689d0 2023-10-06T11:14:06.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.073+0000 7f8bb77fe700 1 -- 172.21.15.146:0/1556308066 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ba8003570 con 0x7f8bb80689d0 2023-10-06T11:14:06.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.074+0000 7f8bb77fe700 1 -- 172.21.15.146:0/1556308066 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3762958970 0 0) 0x7f8ba8003570 con 0x7f8bb80689d0 2023-10-06T11:14:06.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.074+0000 7f8bb77fe700 1 -- 172.21.15.146:0/1556308066 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8bb8153ab0 msgr2=0x7f8bb815a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:06.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.074+0000 7f8bb77fe700 1 --2- 172.21.15.146:0/1556308066 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8bb8153ab0 0x7f8bb815a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:06.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.074+0000 7f8bb77fe700 1 -- 172.21.15.146:0/1556308066 >> v2:172.21.15.151:3300/0 conn(0x7f8bb8153e80 msgr2=0x7f8bb8068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:06.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.074+0000 7f8bb77fe700 1 --2- 172.21.15.146:0/1556308066 >> v2:172.21.15.151:3300/0 conn(0x7f8bb8153e80 0x7f8bb8068490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:06.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.074+0000 7f8bb77fe700 1 -- 172.21.15.146:0/1556308066 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb80b6530 con 0x7f8bb80689d0 2023-10-06T11:14:06.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.074+0000 7f8bb77fe700 1 -- 172.21.15.146:0/1556308066 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f8bb0001980 con 0x7f8bb80689d0 2023-10-06T11:14:06.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.074+0000 7f8bb77fe700 1 -- 172.21.15.146:0/1556308066 >> v1:172.21.15.146:6789/0 conn(0x7f8bb80689d0 legacy=0x7f8bb815d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:06.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.074+0000 7f8bb77fe700 1 --2- 172.21.15.146:0/1556308066 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ba8003a60 0x7f8ba8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:06.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.074+0000 7f8bb77fe700 1 --2- 172.21.15.146:0/1556308066 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8bb8153ab0 0x7f8ba8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:06.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.074+0000 7f8bb77fe700 1 --2- 172.21.15.146:0/1556308066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ba8004d50 0x7f8ba80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:06.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.074+0000 7f8bb77fe700 1 -- 172.21.15.146:0/1556308066 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb8068e50 con 0x7f8ba8003a60 2023-10-06T11:14:06.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.074+0000 7f8bb77fe700 1 -- 172.21.15.146:0/1556308066 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb80b4510 con 0x7f8ba8004d50 2023-10-06T11:14:06.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.074+0000 7f8bb77fe700 1 -- 172.21.15.146:0/1556308066 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ba800ba60 con 0x7f8bb8153ab0 2023-10-06T11:14:06.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.074+0000 7f8bb7fff700 1 --2- 172.21.15.146:0/1556308066 >> v2:172.21.15.151:3300/0 conn(0x7f8bb8153e80 0x7f8bb8068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:14:06.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.074+0000 7f8bbcaf0700 1 --2- 172.21.15.146:0/1556308066 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ba8003a60 0x7f8ba8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:06.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.074+0000 7f8bbd2f1700 1 --2- 172.21.15.146:0/1556308066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ba8004d50 0x7f8ba80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:06.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.074+0000 7f8bb7fff700 1 --2- 172.21.15.146:0/1556308066 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8bb8153ab0 0x7f8ba8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:06.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.074+0000 7f8bbcaf0700 1 -- 172.21.15.146:0/1556308066 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8bb8153ab0 msgr2=0x7f8ba8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:06.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.074+0000 7f8bbcaf0700 1 --2- 172.21.15.146:0/1556308066 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8bb8153ab0 0x7f8ba8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:06.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.074+0000 7f8bbcaf0700 1 -- 172.21.15.146:0/1556308066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ba8004d50 msgr2=0x7f8ba80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:06.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.074+0000 7f8bbcaf0700 1 --2- 172.21.15.146:0/1556308066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ba8004d50 0x7f8ba80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:06.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.074+0000 7f8bbcaf0700 1 -- 172.21.15.146:0/1556308066 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ba8003570 con 0x7f8ba8003a60 2023-10-06T11:14:06.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.074+0000 7f8bbd2f1700 1 --2- 172.21.15.146:0/1556308066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ba8004d50 0x7f8ba80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:06.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.074+0000 7f8bbcaf0700 1 --2- 172.21.15.146:0/1556308066 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ba8003a60 0x7f8ba8003e70 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f8bac009c00 tx=0x7f8bac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d210ade941e0377 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:06.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.074+0000 7f8bb77fe700 1 -- 172.21.15.146:0/1556308066 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac00e6b0 con 0x7f8ba8003a60 2023-10-06T11:14:06.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.074+0000 7f8bb77fe700 1 -- 172.21.15.146:0/1556308066 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bac00e810 con 0x7f8ba8003a60 2023-10-06T11:14:06.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.074+0000 7f8bb77fe700 1 -- 172.21.15.146:0/1556308066 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bac00ebd0 con 0x7f8ba8003a60 2023-10-06T11:14:06.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.075+0000 7f8bbed54700 1 -- 172.21.15.146:0/1556308066 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ba8003a60 msgr2=0x7f8ba8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:06.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.075+0000 7f8bbed54700 1 --2- 172.21.15.146:0/1556308066 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ba8003a60 0x7f8ba8003e70 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f8bac009c00 tx=0x7f8bac0091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:06.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.075+0000 7f8bbd2f1700 1 -- 172.21.15.146:0/1556308066 reap_dead start 2023-10-06T11:14:06.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.075+0000 7f8bbed54700 1 -- 172.21.15.146:0/1556308066 shutdown_connections 2023-10-06T11:14:06.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.075+0000 7f8bbed54700 1 -- 172.21.15.146:0/1556308066 >> 172.21.15.146:0/1556308066 conn(0x7f8bb806eba0 msgr2=0x7f8bb806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:06.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.075+0000 7f8bbed54700 1 -- 172.21.15.146:0/1556308066 shutdown_connections 2023-10-06T11:14:06.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.075+0000 7f8bbed54700 1 -- 172.21.15.146:0/1556308066 wait complete. 2023-10-06T11:14:06.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.076+0000 7f8bbed54700 1 Processor -- start 2023-10-06T11:14:06.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.076+0000 7f8bbed54700 1 -- start start 2023-10-06T11:14:06.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.077+0000 7f8bbed54700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ba8003a60 0x7f8bb813e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:06.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.077+0000 7f8bbed54700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8bb8151740 0x7f8bb80b0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:06.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.077+0000 7f8bbed54700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bb813f950 0x7f8bb80b13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:06.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.077+0000 7f8bbed54700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb8140a40 con 0x7f8bb813f950 2023-10-06T11:14:06.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.077+0000 7f8bbed54700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb813ec70 con 0x7f8bb8151740 2023-10-06T11:14:06.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.077+0000 7f8bbed54700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb813fe30 con 0x7f8ba8003a60 2023-10-06T11:14:06.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.077+0000 7f8bbd2f1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bb813f950 0x7f8bb80b13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:06.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.077+0000 7f8bbd2f1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bb813f950 0x7f8bb80b13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35024/0 (socket says 172.21.15.146:35024) 2023-10-06T11:14:06.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.077+0000 7f8bbd2f1700 1 -- 172.21.15.146:0/666963767 learned_addr learned my addr 172.21.15.146:0/666963767 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:06.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.077+0000 7f8bb7fff700 1 --2- 172.21.15.146:0/666963767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8bb8151740 0x7f8bb80b0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:06.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.077+0000 7f8bbcaf0700 1 --2- 172.21.15.146:0/666963767 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ba8003a60 0x7f8bb813e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:06.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.078+0000 7f8bbd2f1700 1 -- 172.21.15.146:0/666963767 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ba8003a60 msgr2=0x7f8bb813e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:06.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.078+0000 7f8bbd2f1700 1 --2- 172.21.15.146:0/666963767 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ba8003a60 0x7f8bb813e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:06.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.078+0000 7f8bbd2f1700 1 -- 172.21.15.146:0/666963767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8bb8151740 msgr2=0x7f8bb80b0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:06.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.078+0000 7f8bbd2f1700 1 --2- 172.21.15.146:0/666963767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8bb8151740 0x7f8bb80b0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:06.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.078+0000 7f8bbd2f1700 1 -- 172.21.15.146:0/666963767 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb8140110 con 0x7f8bb813f950 2023-10-06T11:14:06.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.078+0000 7f8bbd2f1700 1 --2- 172.21.15.146:0/666963767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bb813f950 0x7f8bb80b13d0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0000f80 tx=0x7f8bb8159c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:06.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.078+0000 7f8bb4ff9700 1 -- 172.21.15.146:0/666963767 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb000eb60 con 0x7f8bb813f950 2023-10-06T11:14:06.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.078+0000 7f8bb4ff9700 1 -- 172.21.15.146:0/666963767 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb000ece0 con 0x7f8bb813f950 2023-10-06T11:14:06.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.078+0000 7f8bbed54700 1 -- 172.21.15.146:0/666963767 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb81403f0 con 0x7f8bb813f950 2023-10-06T11:14:06.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.078+0000 7f8bb4ff9700 1 -- 172.21.15.146:0/666963767 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb0013670 con 0x7f8bb813f950 2023-10-06T11:14:06.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.078+0000 7f8bbed54700 1 -- 172.21.15.146:0/666963767 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb8142490 con 0x7f8bb813f950 2023-10-06T11:14:06.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.079+0000 7f8bbed54700 1 -- 172.21.15.146:0/666963767 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bb8140bf0 con 0x7f8bb813f950 2023-10-06T11:14:06.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.079+0000 7f8bb4ff9700 1 -- 172.21.15.146:0/666963767 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8bb0013aa0 con 0x7f8bb813f950 2023-10-06T11:14:06.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.079+0000 7f8bb4ff9700 1 --2- 172.21.15.146:0/666963767 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8b9c066f30 0x7f8b9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:06.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.080+0000 7f8bb4ff9700 1 -- 172.21.15.146:0/666963767 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8bb0084940 con 0x7f8bb813f950 2023-10-06T11:14:06.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.080+0000 7f8bbcaf0700 1 --2- 172.21.15.146:0/666963767 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8b9c066f30 0x7f8b9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:06.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.080+0000 7f8bbcaf0700 1 --2- 172.21.15.146:0/666963767 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8b9c066f30 0x7f8b9c0693e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f8bac0091e0 tx=0x7f8bac01a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:06.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.084+0000 7f8bb4ff9700 1 -- 172.21.15.146:0/666963767 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8bb8140bf0 con 0x7f8bb813f950 2023-10-06T11:14:06.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.310+0000 7f8bbed54700 1 -- 172.21.15.146:0/666963767 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8bb804c380 con 0x7f8bb813f950 2023-10-06T11:14:06.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.311+0000 7f8bb4ff9700 1 -- 172.21.15.146:0/666963767 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f8bb0051b10 con 0x7f8bb813f950 2023-10-06T11:14:06.313 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:06.313 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":93,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/2159562091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2159562091},{"type":"v1","addr":"172.21.15.151:6834","nonce":2159562091}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6242,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/603782012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":603782012},{"type":"v1","addr":"172.21.15.151:6835","nonce":603782012}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6916,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3416056259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3416056259},{"type":"v1","addr":"172.21.15.146:6837","nonce":3416056259}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:13:30.345795+0000","modified":"2023-10-06T11:13:33.984549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7620":{"gid":7620,"name":"c","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/785131800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":785131800},{"type":"v1","addr":"172.21.15.146:6835","nonce":785131800}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T11:14:06.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.313+0000 7f8bbed54700 1 -- 172.21.15.146:0/666963767 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8b9c066f30 msgr2=0x7f8b9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:06.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.313+0000 7f8bbed54700 1 --2- 172.21.15.146:0/666963767 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8b9c066f30 0x7f8b9c0693e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f8bac0091e0 tx=0x7f8bac01a000 comp rx=0 tx=0).stop 2023-10-06T11:14:06.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.313+0000 7f8bbed54700 1 -- 172.21.15.146:0/666963767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bb813f950 msgr2=0x7f8bb80b13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:06.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.313+0000 7f8bbed54700 1 --2- 172.21.15.146:0/666963767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bb813f950 0x7f8bb80b13d0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0000f80 tx=0x7f8bb8159c70 comp rx=0 tx=0).stop 2023-10-06T11:14:06.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.313+0000 7f8bbed54700 1 -- 172.21.15.146:0/666963767 shutdown_connections 2023-10-06T11:14:06.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.313+0000 7f8bbed54700 1 --2- 172.21.15.146:0/666963767 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8b9c066f30 0x7f8b9c0693e0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:06.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.313+0000 7f8bbed54700 1 --2- 172.21.15.146:0/666963767 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8bb813f950 0x7f8bb80b13d0 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:06.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.313+0000 7f8bbed54700 1 --2- 172.21.15.146:0/666963767 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ba8003a60 0x7f8bb813e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:06.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.313+0000 7f8bbed54700 1 --2- 172.21.15.146:0/666963767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8bb8151740 0x7f8bb80b0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:06.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.313+0000 7f8bbed54700 1 -- 172.21.15.146:0/666963767 >> 172.21.15.146:0/666963767 conn(0x7f8bb806eba0 msgr2=0x7f8bb815c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:06.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.313+0000 7f8bbed54700 1 -- 172.21.15.146:0/666963767 shutdown_connections 2023-10-06T11:14:06.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.313+0000 7f8bbed54700 1 -- 172.21.15.146:0/666963767 wait complete. 2023-10-06T11:14:06.316 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 93 2023-10-06T11:14:06.327 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:14:06.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.441+0000 7f04d0fbd700 1 Processor -- start 2023-10-06T11:14:06.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.441+0000 7f04d0fbd700 1 -- start start 2023-10-06T11:14:06.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.442+0000 7f04d0fbd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04cc155800 0x7f04cc068480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:06.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.442+0000 7f04d0fbd700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f04cc155bd0 0x7f04cc0689c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:06.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.442+0000 7f04d0fbd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f04cc0c7180 0x7f04cc0c7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:06.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.442+0000 7f04d0fbd700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04cc06a8e0 con 0x7f04cc0c7180 2023-10-06T11:14:06.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.442+0000 7f04d0fbd700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04cc0c7ed0 con 0x7f04cc155bd0 2023-10-06T11:14:06.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.442+0000 7f04d0fbd700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc0c81b0 con 0x7f04cc155800 2023-10-06T11:14:06.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.442+0000 7f04cbfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f04cc0c7180 0x7f04cc0c7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:06.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.442+0000 7f04cbfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f04cc0c7180 0x7f04cc0c7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35030/0 (socket says 172.21.15.146:35030) 2023-10-06T11:14:06.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.442+0000 7f04cbfff700 1 -- 172.21.15.146:0/3334065019 learned_addr learned my addr 172.21.15.146:0/3334065019 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:06.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.442+0000 7f04cb7fe700 1 --2- 172.21.15.146:0/3334065019 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04cc155800 0x7f04cc068480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:06.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.442+0000 7f04caffd700 1 --2- 172.21.15.146:0/3334065019 >> v2:172.21.15.151:3300/0 conn(0x7f04cc155bd0 0x7f04cc0689c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:06.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.442+0000 7f04cbfff700 1 -- 172.21.15.146:0/3334065019 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04cc155800 msgr2=0x7f04cc068480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:06.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.442+0000 7f04cbfff700 1 --2- 172.21.15.146:0/3334065019 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04cc155800 0x7f04cc068480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:06.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.442+0000 7f04cbfff700 1 -- 172.21.15.146:0/3334065019 >> v2:172.21.15.151:3300/0 conn(0x7f04cc155bd0 msgr2=0x7f04cc0689c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:06.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.442+0000 7f04cbfff700 1 --2- 172.21.15.146:0/3334065019 >> v2:172.21.15.151:3300/0 conn(0x7f04cc155bd0 0x7f04cc0689c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:06.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.442+0000 7f04cbfff700 1 -- 172.21.15.146:0/3334065019 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04cc0c8490 con 0x7f04cc0c7180 2023-10-06T11:14:06.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.442+0000 7f04cbfff700 1 --2- 172.21.15.146:0/3334065019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04cc0c7180 0x7f04cc0c7600 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f04cc06d4f0 tx=0x7f04c400ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c38f33204e918055 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:06.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.443+0000 7f04ca7fc700 1 -- 172.21.15.146:0/3334065019 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c4010070 con 0x7f04cc0c7180 2023-10-06T11:14:06.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.443+0000 7f04ca7fc700 1 -- 172.21.15.146:0/3334065019 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c400dd30 con 0x7f04cc0c7180 2023-10-06T11:14:06.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.443+0000 7f04ca7fc700 1 -- 172.21.15.146:0/3334065019 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c400dea0 con 0x7f04cc0c7180 2023-10-06T11:14:06.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.443+0000 7f04d0fbd700 1 -- 172.21.15.146:0/3334065019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04cc0c7180 msgr2=0x7f04cc0c7600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:06.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.443+0000 7f04d0fbd700 1 --2- 172.21.15.146:0/3334065019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04cc0c7180 0x7f04cc0c7600 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f04cc06d4f0 tx=0x7f04c400ba50 comp rx=0 tx=0).stop 2023-10-06T11:14:06.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.443+0000 7f04d0fbd700 1 -- 172.21.15.146:0/3334065019 shutdown_connections 2023-10-06T11:14:06.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.443+0000 7f04d0fbd700 1 --2- 172.21.15.146:0/3334065019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04cc0c7180 0x7f04cc0c7600 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:06.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.443+0000 7f04d0fbd700 1 --2- 172.21.15.146:0/3334065019 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04cc155800 0x7f04cc068480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:06.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.443+0000 7f04d0fbd700 1 --2- 172.21.15.146:0/3334065019 >> v2:172.21.15.151:3300/0 conn(0x7f04cc155bd0 0x7f04cc0689c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:06.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.443+0000 7f04d0fbd700 1 -- 172.21.15.146:0/3334065019 >> 172.21.15.146:0/3334065019 conn(0x7f04cc0c9de0 msgr2=0x7f04cc06dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:06.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.443+0000 7f04d0fbd700 1 -- 172.21.15.146:0/3334065019 shutdown_connections 2023-10-06T11:14:06.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.443+0000 7f04d0fbd700 1 -- 172.21.15.146:0/3334065019 wait complete. 2023-10-06T11:14:06.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.444+0000 7f04d0fbd700 1 Processor -- start 2023-10-06T11:14:06.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.444+0000 7f04d0fbd700 1 -- start start 2023-10-06T11:14:06.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.445+0000 7f04d0fbd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04cc0c7180 0x7f04cc1361d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:06.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.445+0000 7f04d0fbd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04cc155800 0x7f04cc0ace40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:06.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.445+0000 7f04d0fbd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04cc155bd0 0x7f04cc0ad380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:06.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.445+0000 7f04d0fbd700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc0ae5c0 con 0x7f04cc155bd0 2023-10-06T11:14:06.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.445+0000 7f04d0fbd700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc153cd0 con 0x7f04cc155800 2023-10-06T11:14:06.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.445+0000 7f04d0fbd700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc0ad9b0 con 0x7f04cc0c7180 2023-10-06T11:14:06.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.445+0000 7f04cbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04cc155bd0 0x7f04cc0ad380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:06.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.445+0000 7f04cbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04cc155bd0 0x7f04cc0ad380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35040/0 (socket says 172.21.15.146:35040) 2023-10-06T11:14:06.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.445+0000 7f04cbfff700 1 -- 172.21.15.146:0/1361222484 learned_addr learned my addr 172.21.15.146:0/1361222484 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:06.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.445+0000 7f04caffd700 1 --2- 172.21.15.146:0/1361222484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04cc155800 0x7f04cc0ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:06.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.445+0000 7f04cb7fe700 1 --2- 172.21.15.146:0/1361222484 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04cc0c7180 0x7f04cc1361d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:06.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.446+0000 7f04cbfff700 1 -- 172.21.15.146:0/1361222484 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04cc0c7180 msgr2=0x7f04cc1361d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:06.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.446+0000 7f04cbfff700 1 --2- 172.21.15.146:0/1361222484 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04cc0c7180 0x7f04cc1361d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:06.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.446+0000 7f04cbfff700 1 -- 172.21.15.146:0/1361222484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04cc155800 msgr2=0x7f04cc0ace40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:06.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.446+0000 7f04cbfff700 1 --2- 172.21.15.146:0/1361222484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04cc155800 0x7f04cc0ace40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:06.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.446+0000 7f04cbfff700 1 -- 172.21.15.146:0/1361222484 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c400bcf0 con 0x7f04cc155bd0 2023-10-06T11:14:06.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.446+0000 7f04cb7fe700 1 --2- 172.21.15.146:0/1361222484 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04cc0c7180 0x7f04cc1361d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:06.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.446+0000 7f04cbfff700 1 --2- 172.21.15.146:0/1361222484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04cc155bd0 0x7f04cc0ad380 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f04cc06d8a0 tx=0x7f04c401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:06.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.446+0000 7f04b37fe700 1 -- 172.21.15.146:0/1361222484 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c400dea0 con 0x7f04cc155bd0 2023-10-06T11:14:06.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.446+0000 7f04b37fe700 1 -- 172.21.15.146:0/1361222484 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c400ac00 con 0x7f04cc155bd0 2023-10-06T11:14:06.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.446+0000 7f04d0fbd700 1 -- 172.21.15.146:0/1361222484 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04cc0adc90 con 0x7f04cc155bd0 2023-10-06T11:14:06.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.446+0000 7f04b37fe700 1 -- 172.21.15.146:0/1361222484 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c401e400 con 0x7f04cc155bd0 2023-10-06T11:14:06.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.446+0000 7f04d0fbd700 1 -- 172.21.15.146:0/1361222484 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04cc0ae250 con 0x7f04cc155bd0 2023-10-06T11:14:06.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.447+0000 7f04d0fbd700 1 -- 172.21.15.146:0/1361222484 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04cc06cb40 con 0x7f04cc155bd0 2023-10-06T11:14:06.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.447+0000 7f04b37fe700 1 -- 172.21.15.146:0/1361222484 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f04c4003040 con 0x7f04cc155bd0 2023-10-06T11:14:06.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.448+0000 7f04b37fe700 1 --2- 172.21.15.146:0/1361222484 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f04b8066f30 0x7f04b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:06.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.448+0000 7f04b37fe700 1 -- 172.21.15.146:0/1361222484 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f04c4086220 con 0x7f04cc155bd0 2023-10-06T11:14:06.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.448+0000 7f04cb7fe700 1 --2- 172.21.15.146:0/1361222484 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f04b8066f30 0x7f04b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:06.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.448+0000 7f04cb7fe700 1 --2- 172.21.15.146:0/1361222484 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f04b8066f30 0x7f04b80693e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f04bc010d90 tx=0x7f04bc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:06.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.452+0000 7f04b37fe700 1 -- 172.21.15.146:0/1361222484 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f04c4053330 con 0x7f04cc155bd0 2023-10-06T11:14:06.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.674+0000 7f04d0fbd700 1 -- 172.21.15.146:0/1361222484 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f04cc04bb40 con 0x7f04cc155bd0 2023-10-06T11:14:06.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.675+0000 7f04b37fe700 1 -- 172.21.15.146:0/1361222484 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4605 (secure 0 0 0) 0x7f04c4056950 con 0x7f04cc155bd0 2023-10-06T11:14:06.677 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:06.677 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":93,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/2159562091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2159562091},{"type":"v1","addr":"172.21.15.151:6834","nonce":2159562091}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6242,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/603782012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":603782012},{"type":"v1","addr":"172.21.15.151:6835","nonce":603782012}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6916,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3416056259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3416056259},{"type":"v1","addr":"172.21.15.146:6837","nonce":3416056259}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:13:30.345795+0000","modified":"2023-10-06T11:13:33.984549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7620},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7620":{"gid":7620,"name":"c","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6835/785131800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":785131800},{"type":"v1","addr":"172.21.15.146:6835","nonce":785131800}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-06T11:14:06.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.677+0000 7f04d0fbd700 1 -- 172.21.15.146:0/1361222484 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f04b8066f30 msgr2=0x7f04b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:06.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.677+0000 7f04d0fbd700 1 --2- 172.21.15.146:0/1361222484 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f04b8066f30 0x7f04b80693e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f04bc010d90 tx=0x7f04bc008040 comp rx=0 tx=0).stop 2023-10-06T11:14:06.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.677+0000 7f04d0fbd700 1 -- 172.21.15.146:0/1361222484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04cc155bd0 msgr2=0x7f04cc0ad380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:06.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.677+0000 7f04d0fbd700 1 --2- 172.21.15.146:0/1361222484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04cc155bd0 0x7f04cc0ad380 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f04cc06d8a0 tx=0x7f04c401a000 comp rx=0 tx=0).stop 2023-10-06T11:14:06.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.677+0000 7f04d0fbd700 1 -- 172.21.15.146:0/1361222484 shutdown_connections 2023-10-06T11:14:06.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.677+0000 7f04d0fbd700 1 --2- 172.21.15.146:0/1361222484 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f04b8066f30 0x7f04b80693e0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:06.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.677+0000 7f04d0fbd700 1 --2- 172.21.15.146:0/1361222484 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f04cc155bd0 0x7f04cc0ad380 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:06.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.677+0000 7f04d0fbd700 1 --2- 172.21.15.146:0/1361222484 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04cc0c7180 0x7f04cc1361d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:06.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.677+0000 7f04d0fbd700 1 --2- 172.21.15.146:0/1361222484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04cc155800 0x7f04cc0ace40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:06.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.677+0000 7f04d0fbd700 1 -- 172.21.15.146:0/1361222484 >> 172.21.15.146:0/1361222484 conn(0x7f04cc0c9de0 msgr2=0x7f04cc06bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:06.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.677+0000 7f04d0fbd700 1 -- 172.21.15.146:0/1361222484 shutdown_connections 2023-10-06T11:14:06.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.677+0000 7f04d0fbd700 1 -- 172.21.15.146:0/1361222484 wait complete. 2023-10-06T11:14:06.680 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 93 2023-10-06T11:14:06.691 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:14:06.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.803+0000 7fd939d1f700 1 Processor -- start 2023-10-06T11:14:06.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.803+0000 7fd939d1f700 1 -- start start 2023-10-06T11:14:06.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.804+0000 7fd939d1f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd9340ab010 0x7fd934157800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:06.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.804+0000 7fd939d1f700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd9340ca070 0x7fd9340cc240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:06.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.804+0000 7fd939d1f700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9340ccf20 con 0x7fd934157430 2023-10-06T11:14:06.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.804+0000 7fd939d1f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9340ca4f0 con 0x7fd9340ab010 2023-10-06T11:14:06.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.804+0000 7fd939d1f700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9340c3dd0 con 0x7fd9340ca070 2023-10-06T11:14:06.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.804+0000 7fd932ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd9340ab010 0x7fd934157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:06.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.804+0000 7fd932ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd9340ab010 0x7fd934157800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35046/0 (socket says 172.21.15.146:35046) 2023-10-06T11:14:06.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.804+0000 7fd932ffd700 1 -- 172.21.15.146:0/1822314915 learned_addr learned my addr 172.21.15.146:0/1822314915 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:06.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.805+0000 7fd933fff700 1 --2- 172.21.15.146:0/1822314915 >> v2:172.21.15.151:3300/0 conn(0x7fd9340ca070 0x7fd9340cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:06.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.805+0000 7fd932ffd700 1 -- 172.21.15.146:0/1822314915 >> v2:172.21.15.151:3300/0 conn(0x7fd9340ca070 msgr2=0x7fd9340cc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:06.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.805+0000 7fd932ffd700 1 --2- 172.21.15.146:0/1822314915 >> v2:172.21.15.151:3300/0 conn(0x7fd9340ca070 0x7fd9340cc240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:06.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.805+0000 7fd932ffd700 1 -- 172.21.15.146:0/1822314915 >> v1:172.21.15.151:6789/0 conn(0x7fd934157430 legacy=0x7fd9340ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:06.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.805+0000 7fd932ffd700 1 -- 172.21.15.146:0/1822314915 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9340cd200 con 0x7fd9340ab010 2023-10-06T11:14:06.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.805+0000 7fd932ffd700 1 --2- 172.21.15.146:0/1822314915 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9340ab010 0x7fd934157800 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fd9340ce3f0 tx=0x7fd928009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d323750c2d2e06d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:06.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.805+0000 7fd9327fc700 1 -- 172.21.15.146:0/1822314915 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92800b860 con 0x7fd9340ab010 2023-10-06T11:14:06.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.805+0000 7fd9327fc700 1 -- 172.21.15.146:0/1822314915 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd92800b9c0 con 0x7fd9340ab010 2023-10-06T11:14:06.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.805+0000 7fd9327fc700 1 -- 172.21.15.146:0/1822314915 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92800bd80 con 0x7fd9340ab010 2023-10-06T11:14:06.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.806+0000 7fd939d1f700 1 -- 172.21.15.146:0/1822314915 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9340ab010 msgr2=0x7fd934157800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:06.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.806+0000 7fd939d1f700 1 --2- 172.21.15.146:0/1822314915 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9340ab010 0x7fd934157800 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fd9340ce3f0 tx=0x7fd928009250 comp rx=0 tx=0).stop 2023-10-06T11:14:06.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.806+0000 7fd939d1f700 1 -- 172.21.15.146:0/1822314915 shutdown_connections 2023-10-06T11:14:06.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.806+0000 7fd939d1f700 1 --2- 172.21.15.146:0/1822314915 >> v2:172.21.15.151:3300/0 conn(0x7fd9340ca070 0x7fd9340cc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:06.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.806+0000 7fd939d1f700 1 --2- 172.21.15.146:0/1822314915 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9340ab010 0x7fd934157800 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:06.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.806+0000 7fd939d1f700 1 -- 172.21.15.146:0/1822314915 >> 172.21.15.146:0/1822314915 conn(0x7fd934067c50 msgr2=0x7fd9340ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:06.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.806+0000 7fd939d1f700 1 -- 172.21.15.146:0/1822314915 shutdown_connections 2023-10-06T11:14:06.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.806+0000 7fd939d1f700 1 -- 172.21.15.146:0/1822314915 wait complete. 2023-10-06T11:14:06.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.807+0000 7fd939d1f700 1 Processor -- start 2023-10-06T11:14:06.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.807+0000 7fd939d1f700 1 -- start start 2023-10-06T11:14:06.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.808+0000 7fd939d1f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9340ab010 0x7fd9340c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:06.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.808+0000 7fd939d1f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9340ca070 0x7fd934151dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:06.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.808+0000 7fd939d1f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd934157430 0x7fd9341682e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:06.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.808+0000 7fd939d1f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9340b32f0 con 0x7fd9340ab010 2023-10-06T11:14:06.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.808+0000 7fd939d1f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9340b35d0 con 0x7fd9340ca070 2023-10-06T11:14:06.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.808+0000 7fd939d1f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9340b38b0 con 0x7fd934157430 2023-10-06T11:14:06.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.808+0000 7fd9337fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9340ab010 0x7fd9340c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:06.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.808+0000 7fd9337fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9340ab010 0x7fd9340c7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35050/0 (socket says 172.21.15.146:35050) 2023-10-06T11:14:06.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.808+0000 7fd9337fe700 1 -- 172.21.15.146:0/2004324599 learned_addr learned my addr 172.21.15.146:0/2004324599 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:06.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.808+0000 7fd932ffd700 1 --2- 172.21.15.146:0/2004324599 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9340ca070 0x7fd934151dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:06.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.808+0000 7fd933fff700 1 --2- 172.21.15.146:0/2004324599 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd934157430 0x7fd9341682e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:06.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.808+0000 7fd9337fe700 1 -- 172.21.15.146:0/2004324599 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd934157430 msgr2=0x7fd9341682e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:06.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.808+0000 7fd9337fe700 1 --2- 172.21.15.146:0/2004324599 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd934157430 0x7fd9341682e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:06.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.808+0000 7fd9337fe700 1 -- 172.21.15.146:0/2004324599 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9340ca070 msgr2=0x7fd934151dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:06.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.808+0000 7fd9337fe700 1 --2- 172.21.15.146:0/2004324599 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9340ca070 0x7fd934151dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:06.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.808+0000 7fd9337fe700 1 -- 172.21.15.146:0/2004324599 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9280094f0 con 0x7fd9340ab010 2023-10-06T11:14:06.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.808+0000 7fd9337fe700 1 --2- 172.21.15.146:0/2004324599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9340ab010 0x7fd9340c7db0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fd92400c8e0 tx=0x7fd924001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:06.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.808+0000 7fd91b7fe700 1 -- 172.21.15.146:0/2004324599 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd924012630 con 0x7fd9340ab010 2023-10-06T11:14:06.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.808+0000 7fd91b7fe700 1 -- 172.21.15.146:0/2004324599 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9240127b0 con 0x7fd9340ab010 2023-10-06T11:14:06.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.808+0000 7fd939d1f700 1 -- 172.21.15.146:0/2004324599 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd934167de0 con 0x7fd9340ab010 2023-10-06T11:14:06.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.808+0000 7fd91b7fe700 1 -- 172.21.15.146:0/2004324599 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd924012b70 con 0x7fd9340ab010 2023-10-06T11:14:06.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.808+0000 7fd939d1f700 1 -- 172.21.15.146:0/2004324599 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd934167a90 con 0x7fd9340ab010 2023-10-06T11:14:06.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.809+0000 7fd939d1f700 1 -- 172.21.15.146:0/2004324599 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd934168150 con 0x7fd9340ab010 2023-10-06T11:14:06.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.810+0000 7fd91b7fe700 1 -- 172.21.15.146:0/2004324599 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd924003030 con 0x7fd9340ab010 2023-10-06T11:14:06.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.810+0000 7fd91b7fe700 1 --2- 172.21.15.146:0/2004324599 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd920066f30 0x7fd9200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:06.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.810+0000 7fd91b7fe700 1 -- 172.21.15.146:0/2004324599 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd9240845a0 con 0x7fd9340ab010 2023-10-06T11:14:06.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.810+0000 7fd932ffd700 1 --2- 172.21.15.146:0/2004324599 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd920066f30 0x7fd9200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:06.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.811+0000 7fd932ffd700 1 --2- 172.21.15.146:0/2004324599 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd920066f30 0x7fd9200693e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fd9340ce3f0 tx=0x7fd928017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:06.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.814+0000 7fd91b7fe700 1 -- 172.21.15.146:0/2004324599 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd924055140 con 0x7fd9340ab010 2023-10-06T11:14:07.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.999+0000 7fd939d1f700 1 -- 172.21.15.146:0/2004324599 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd93404c380 con 0x7fd9340ab010 2023-10-06T11:14:07.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:06.999+0000 7fd91b7fe700 1 -- 172.21.15.146:0/2004324599 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+16920 (secure 0 0 0) 0x7fd924054cd0 con 0x7fd9340ab010 2023-10-06T11:14:07.001 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:07.002 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":101,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:13:31.372487+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:13:28.028009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2023-10-06T11:13:29.311107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:14:07.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.002+0000 7fd939d1f700 1 -- 172.21.15.146:0/2004324599 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd920066f30 msgr2=0x7fd9200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:07.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.002+0000 7fd939d1f700 1 --2- 172.21.15.146:0/2004324599 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd920066f30 0x7fd9200693e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fd9340ce3f0 tx=0x7fd928017000 comp rx=0 tx=0).stop 2023-10-06T11:14:07.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.002+0000 7fd939d1f700 1 -- 172.21.15.146:0/2004324599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9340ab010 msgr2=0x7fd9340c7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:07.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.002+0000 7fd939d1f700 1 --2- 172.21.15.146:0/2004324599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9340ab010 0x7fd9340c7db0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fd92400c8e0 tx=0x7fd924001710 comp rx=0 tx=0).stop 2023-10-06T11:14:07.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.002+0000 7fd939d1f700 1 -- 172.21.15.146:0/2004324599 shutdown_connections 2023-10-06T11:14:07.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.002+0000 7fd939d1f700 1 --2- 172.21.15.146:0/2004324599 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd920066f30 0x7fd9200693e0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:07.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.002+0000 7fd939d1f700 1 --2- 172.21.15.146:0/2004324599 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd934157430 0x7fd9341682e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:07.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.002+0000 7fd939d1f700 1 --2- 172.21.15.146:0/2004324599 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd9340ab010 0x7fd9340c7db0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:07.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.002+0000 7fd939d1f700 1 --2- 172.21.15.146:0/2004324599 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9340ca070 0x7fd934151dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:07.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.002+0000 7fd939d1f700 1 -- 172.21.15.146:0/2004324599 >> 172.21.15.146:0/2004324599 conn(0x7fd934067c50 msgr2=0x7fd9341563c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:07.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.002+0000 7fd939d1f700 1 -- 172.21.15.146:0/2004324599 shutdown_connections 2023-10-06T11:14:07.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.002+0000 7fd939d1f700 1 -- 172.21.15.146:0/2004324599 wait complete. 2023-10-06T11:14:07.016 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T11:14:07.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.130+0000 7fe637271700 1 Processor -- start 2023-10-06T11:14:07.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.130+0000 7fe637271700 1 -- start start 2023-10-06T11:14:07.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.131+0000 7fe637271700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6300ae730 0x7fe6300aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:07.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.131+0000 7fe637271700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe6300cb950 0x7fe6300cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:07.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.131+0000 7fe637271700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6300ae2a0 con 0x7fe63015a160 2023-10-06T11:14:07.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.131+0000 7fe637271700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe63015a530 con 0x7fe6300cb950 2023-10-06T11:14:07.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.131+0000 7fe637271700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6300c5cb0 con 0x7fe6300ae730 2023-10-06T11:14:07.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.131+0000 7fe63580e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe6300cb950 0x7fe6300cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:07.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.131+0000 7fe63500d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe63015a160 0x7fe6300c55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33892/0 (socket says 172.21.15.146:33892) 2023-10-06T11:14:07.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.131+0000 7fe63500d700 1 -- 172.21.15.146:0/1482510132 learned_addr learned my addr 172.21.15.146:0/1482510132 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:14:07.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.131+0000 7fe63480c700 1 --2- 172.21.15.146:0/1482510132 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6300ae730 0x7fe6300aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:07.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.132+0000 7fe627fff700 1 -- 172.21.15.146:0/1482510132 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 240983831 0 0) 0x7fe6300ae2a0 con 0x7fe63015a160 2023-10-06T11:14:07.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.132+0000 7fe627fff700 1 -- 172.21.15.146:0/1482510132 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe61c003570 con 0x7fe63015a160 2023-10-06T11:14:07.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.132+0000 7fe63580e700 1 -- 172.21.15.146:0/1482510132 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6300ae730 msgr2=0x7fe6300aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:07.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.132+0000 7fe63580e700 1 --2- 172.21.15.146:0/1482510132 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6300ae730 0x7fe6300aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:07.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.132+0000 7fe63580e700 1 -- 172.21.15.146:0/1482510132 >> v1:172.21.15.146:6789/0 conn(0x7fe63015a160 legacy=0x7fe6300c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:07.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.132+0000 7fe63580e700 1 -- 172.21.15.146:0/1482510132 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6300ad690 con 0x7fe6300cb950 2023-10-06T11:14:07.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.132+0000 7fe63580e700 1 --2- 172.21.15.146:0/1482510132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6300cb950 0x7fe6300cbdb0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fe6280098e0 tx=0x7fe6280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ff8d873b4b26064 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:07.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.132+0000 7fe627fff700 1 -- 172.21.15.146:0/1482510132 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe628011630 con 0x7fe6300cb950 2023-10-06T11:14:07.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.132+0000 7fe627fff700 1 -- 172.21.15.146:0/1482510132 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe628011790 con 0x7fe6300cb950 2023-10-06T11:14:07.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.132+0000 7fe627fff700 1 -- 172.21.15.146:0/1482510132 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe628011b30 con 0x7fe6300cb950 2023-10-06T11:14:07.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.132+0000 7fe637271700 1 -- 172.21.15.146:0/1482510132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6300cb950 msgr2=0x7fe6300cbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:07.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.132+0000 7fe637271700 1 --2- 172.21.15.146:0/1482510132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6300cb950 0x7fe6300cbdb0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fe6280098e0 tx=0x7fe6280091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:07.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.132+0000 7fe637271700 1 -- 172.21.15.146:0/1482510132 shutdown_connections 2023-10-06T11:14:07.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.132+0000 7fe637271700 1 --2- 172.21.15.146:0/1482510132 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6300cb950 0x7fe6300cbdb0 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:07.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.132+0000 7fe637271700 1 --2- 172.21.15.146:0/1482510132 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6300ae730 0x7fe6300aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:07.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.132+0000 7fe637271700 1 -- 172.21.15.146:0/1482510132 >> 172.21.15.146:0/1482510132 conn(0x7fe63006f380 msgr2=0x7fe6300d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:07.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.133+0000 7fe637271700 1 -- 172.21.15.146:0/1482510132 shutdown_connections 2023-10-06T11:14:07.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.133+0000 7fe637271700 1 -- 172.21.15.146:0/1482510132 wait complete. 2023-10-06T11:14:07.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.134+0000 7fe637271700 1 Processor -- start 2023-10-06T11:14:07.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.134+0000 7fe637271700 1 -- start start 2023-10-06T11:14:07.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.135+0000 7fe637271700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6300ae730 0x7fe6300aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:07.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.135+0000 7fe637271700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6300cb950 0x7fe6301576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:07.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.135+0000 7fe637271700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe63015a160 0x7fe63014b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:07.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.135+0000 7fe637271700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6300b2b40 con 0x7fe6300cb950 2023-10-06T11:14:07.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.135+0000 7fe637271700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6300af1d0 con 0x7fe6300ae730 2023-10-06T11:14:07.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.135+0000 7fe637271700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6300af4b0 con 0x7fe63015a160 2023-10-06T11:14:07.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.135+0000 7fe63480c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6300cb950 0x7fe6301576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:07.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.135+0000 7fe63480c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6300cb950 0x7fe6301576f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35060/0 (socket says 172.21.15.146:35060) 2023-10-06T11:14:07.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.135+0000 7fe63480c700 1 -- 172.21.15.146:0/3035745825 learned_addr learned my addr 172.21.15.146:0/3035745825 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:07.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.135+0000 7fe63580e700 1 --2- 172.21.15.146:0/3035745825 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe63015a160 0x7fe63014b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:07.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.135+0000 7fe63500d700 1 --2- 172.21.15.146:0/3035745825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6300ae730 0x7fe6300aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:07.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.135+0000 7fe63480c700 1 -- 172.21.15.146:0/3035745825 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe63015a160 msgr2=0x7fe63014b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:07.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.135+0000 7fe63480c700 1 --2- 172.21.15.146:0/3035745825 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe63015a160 0x7fe63014b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:07.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.135+0000 7fe63480c700 1 -- 172.21.15.146:0/3035745825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6300ae730 msgr2=0x7fe6300aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:07.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.135+0000 7fe63480c700 1 --2- 172.21.15.146:0/3035745825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6300ae730 0x7fe6300aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:07.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.135+0000 7fe63480c700 1 -- 172.21.15.146:0/3035745825 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe628009420 con 0x7fe6300cb950 2023-10-06T11:14:07.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.135+0000 7fe63480c700 1 --2- 172.21.15.146:0/3035745825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6300cb950 0x7fe6301576f0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fe62000e930 tx=0x7fe6200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:07.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.135+0000 7fe6257fa700 1 -- 172.21.15.146:0/3035745825 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe620013680 con 0x7fe6300cb950 2023-10-06T11:14:07.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.135+0000 7fe6257fa700 1 -- 172.21.15.146:0/3035745825 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6200137e0 con 0x7fe6300cb950 2023-10-06T11:14:07.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.135+0000 7fe637271700 1 -- 172.21.15.146:0/3035745825 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6300af790 con 0x7fe6300cb950 2023-10-06T11:14:07.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.135+0000 7fe6257fa700 1 -- 172.21.15.146:0/3035745825 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe620013b80 con 0x7fe6300cb950 2023-10-06T11:14:07.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.135+0000 7fe637271700 1 -- 172.21.15.146:0/3035745825 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6300afd50 con 0x7fe6300cb950 2023-10-06T11:14:07.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.136+0000 7fe637271700 1 -- 172.21.15.146:0/3035745825 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe630068390 con 0x7fe6300cb950 2023-10-06T11:14:07.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.137+0000 7fe6257fa700 1 -- 172.21.15.146:0/3035745825 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe62000c3e0 con 0x7fe6300cb950 2023-10-06T11:14:07.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.137+0000 7fe6257fa700 1 --2- 172.21.15.146:0/3035745825 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe614066f30 0x7fe6140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:07.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.137+0000 7fe6257fa700 1 -- 172.21.15.146:0/3035745825 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe620084740 con 0x7fe6300cb950 2023-10-06T11:14:07.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.137+0000 7fe63500d700 1 --2- 172.21.15.146:0/3035745825 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe614066f30 0x7fe6140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:07.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.137+0000 7fe63500d700 1 --2- 172.21.15.146:0/3035745825 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe614066f30 0x7fe6140693e0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe62c007fd0 tx=0x7fe62c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:07.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.141+0000 7fe6257fa700 1 -- 172.21.15.146:0/3035745825 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe620051850 con 0x7fe6300cb950 2023-10-06T11:14:07.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.366+0000 7fe637271700 1 -- 172.21.15.146:0/3035745825 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe6300c7890 con 0x7fe6300cb950 2023-10-06T11:14:07.368 INFO:tasks.ceph.mon.a.smithi146.stderr:2023-10-06T11:14:07.367+0000 7f011baa1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T11:14:07.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.371+0000 7fe6257fa700 1 -- 172.21.15.146:0/3035745825 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v94) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe620054e70 con 0x7fe6300cb950 2023-10-06T11:14:07.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.374+0000 7fe637271700 1 -- 172.21.15.146:0/3035745825 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe614066f30 msgr2=0x7fe6140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:07.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.374+0000 7fe637271700 1 --2- 172.21.15.146:0/3035745825 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe614066f30 0x7fe6140693e0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe62c007fd0 tx=0x7fe62c009040 comp rx=0 tx=0).stop 2023-10-06T11:14:07.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.374+0000 7fe637271700 1 -- 172.21.15.146:0/3035745825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6300cb950 msgr2=0x7fe6301576f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:07.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.374+0000 7fe637271700 1 --2- 172.21.15.146:0/3035745825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6300cb950 0x7fe6301576f0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fe62000e930 tx=0x7fe6200091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:07.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.374+0000 7fe637271700 1 -- 172.21.15.146:0/3035745825 shutdown_connections 2023-10-06T11:14:07.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.374+0000 7fe637271700 1 --2- 172.21.15.146:0/3035745825 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe614066f30 0x7fe6140693e0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:07.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.374+0000 7fe637271700 1 --2- 172.21.15.146:0/3035745825 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe63015a160 0x7fe63014b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:07.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.374+0000 7fe637271700 1 --2- 172.21.15.146:0/3035745825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6300ae730 0x7fe6300aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:07.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.374+0000 7fe637271700 1 --2- 172.21.15.146:0/3035745825 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6300cb950 0x7fe6301576f0 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:07.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.374+0000 7fe637271700 1 -- 172.21.15.146:0/3035745825 >> 172.21.15.146:0/3035745825 conn(0x7fe63006f380 msgr2=0x7fe630159370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:07.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.374+0000 7fe637271700 1 -- 172.21.15.146:0/3035745825 shutdown_connections 2023-10-06T11:14:07.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.374+0000 7fe637271700 1 -- 172.21.15.146:0/3035745825 wait complete. 2023-10-06T11:14:07.378 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T11:14:07.392 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T11:14:07.414 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2023-10-06T11:14:07.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.509+0000 7f89363d0700 1 Processor -- start 2023-10-06T11:14:07.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.510+0000 7f89363d0700 1 -- start start 2023-10-06T11:14:07.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.510+0000 7f89363d0700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f893015cc20 0x7f893015d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:07.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.510+0000 7f89363d0700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89300d0c50 0x7f893015a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:07.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.510+0000 7f89363d0700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89300cf030 con 0x7f893015cff0 2023-10-06T11:14:07.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.510+0000 7f89363d0700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f893015e390 con 0x7f893015cc20 2023-10-06T11:14:07.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.510+0000 7f89363d0700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89300ced20 con 0x7f89300d0c50 2023-10-06T11:14:07.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.511+0000 7f892f7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f893015cff0 0x7f89300d0540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33902/0 (socket says 172.21.15.146:33902) 2023-10-06T11:14:07.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.511+0000 7f892f7fe700 1 -- 172.21.15.146:0/1057579281 learned_addr learned my addr 172.21.15.146:0/1057579281 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:14:07.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.511+0000 7f892ffff700 1 --2- 172.21.15.146:0/1057579281 >> v2:172.21.15.151:3300/0 conn(0x7f893015cc20 0x7f893015d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:07.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.511+0000 7f893496d700 1 --2- 172.21.15.146:0/1057579281 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89300d0c50 0x7f893015a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:07.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.511+0000 7f892effd700 1 -- 172.21.15.146:0/1057579281 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2855886253 0 0) 0x7f89300cf030 con 0x7f893015cff0 2023-10-06T11:14:07.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.511+0000 7f892effd700 1 -- 172.21.15.146:0/1057579281 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8918003570 con 0x7f893015cff0 2023-10-06T11:14:07.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.511+0000 7f892effd700 1 -- 172.21.15.146:0/1057579281 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2883108209 0 0) 0x7f8918003570 con 0x7f893015cff0 2023-10-06T11:14:07.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.511+0000 7f892effd700 1 -- 172.21.15.146:0/1057579281 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89300d0c50 msgr2=0x7f893015a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:07.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.511+0000 7f892effd700 1 --2- 172.21.15.146:0/1057579281 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89300d0c50 0x7f893015a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:07.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.511+0000 7f892effd700 1 -- 172.21.15.146:0/1057579281 >> v2:172.21.15.151:3300/0 conn(0x7f893015cc20 msgr2=0x7f893015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:07.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.511+0000 7f892effd700 1 --2- 172.21.15.146:0/1057579281 >> v2:172.21.15.151:3300/0 conn(0x7f893015cc20 0x7f893015d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:07.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.511+0000 7f892effd700 1 -- 172.21.15.146:0/1057579281 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f893015daf0 con 0x7f893015cff0 2023-10-06T11:14:07.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.511+0000 7f892effd700 1 -- 172.21.15.146:0/1057579281 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f8924001470 con 0x7f893015cff0 2023-10-06T11:14:07.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.511+0000 7f892effd700 1 -- 172.21.15.146:0/1057579281 >> v1:172.21.15.146:6789/0 conn(0x7f893015cff0 legacy=0x7f89300d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:07.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.511+0000 7f892effd700 1 --2- 172.21.15.146:0/1057579281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8918003a60 0x7f8918003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:07.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.511+0000 7f892effd700 1 --2- 172.21.15.146:0/1057579281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8918004810 0x7f8918004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:07.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.511+0000 7f892effd700 1 --2- 172.21.15.146:0/1057579281 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89300d0c50 0x7f89180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:07.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.511+0000 7f892effd700 1 -- 172.21.15.146:0/1057579281 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893015e390 con 0x7f8918003a60 2023-10-06T11:14:07.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.511+0000 7f892effd700 1 -- 172.21.15.146:0/1057579281 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89300ced20 con 0x7f8918004810 2023-10-06T11:14:07.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.511+0000 7f892effd700 1 -- 172.21.15.146:0/1057579281 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f891800ba60 con 0x7f89300d0c50 2023-10-06T11:14:07.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.511+0000 7f892ffff700 1 --2- 172.21.15.146:0/1057579281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8918003a60 0x7f8918003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:07.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.511+0000 7f892f7fe700 1 --2- 172.21.15.146:0/1057579281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8918004810 0x7f8918004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:07.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.511+0000 7f893496d700 1 --2- 172.21.15.146:0/1057579281 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89300d0c50 0x7f89180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:07.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.512+0000 7f892ffff700 1 -- 172.21.15.146:0/1057579281 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89300d0c50 msgr2=0x7f89180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:07.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.512+0000 7f892ffff700 1 --2- 172.21.15.146:0/1057579281 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89300d0c50 0x7f89180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:07.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.512+0000 7f892ffff700 1 -- 172.21.15.146:0/1057579281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8918004810 msgr2=0x7f8918004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:07.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.512+0000 7f892ffff700 1 --2- 172.21.15.146:0/1057579281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8918004810 0x7f8918004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:07.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.512+0000 7f892ffff700 1 -- 172.21.15.146:0/1057579281 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8918003570 con 0x7f8918003a60 2023-10-06T11:14:07.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.512+0000 7f892f7fe700 1 --2- 172.21.15.146:0/1057579281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8918004810 0x7f8918004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:07.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.512+0000 7f892ffff700 1 --2- 172.21.15.146:0/1057579281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8918003a60 0x7f8918003e70 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f8920009c20 tx=0x7f8920009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6ae87769dc89aec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:07.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.512+0000 7f892effd700 1 -- 172.21.15.146:0/1057579281 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8920005a00 con 0x7f8918003a60 2023-10-06T11:14:07.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.512+0000 7f892effd700 1 -- 172.21.15.146:0/1057579281 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8920005b60 con 0x7f8918003a60 2023-10-06T11:14:07.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.512+0000 7f892effd700 1 -- 172.21.15.146:0/1057579281 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892000e710 con 0x7f8918003a60 2023-10-06T11:14:07.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.512+0000 7f89363d0700 1 -- 172.21.15.146:0/1057579281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8918003a60 msgr2=0x7f8918003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:07.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.512+0000 7f89363d0700 1 --2- 172.21.15.146:0/1057579281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8918003a60 0x7f8918003e70 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f8920009c20 tx=0x7f8920009120 comp rx=0 tx=0).stop 2023-10-06T11:14:07.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.512+0000 7f893496d700 1 -- 172.21.15.146:0/1057579281 reap_dead start 2023-10-06T11:14:07.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.512+0000 7f89363d0700 1 -- 172.21.15.146:0/1057579281 shutdown_connections 2023-10-06T11:14:07.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.512+0000 7f89363d0700 1 -- 172.21.15.146:0/1057579281 >> 172.21.15.146:0/1057579281 conn(0x7f893006eba0 msgr2=0x7f893006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:07.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.512+0000 7f89363d0700 1 -- 172.21.15.146:0/1057579281 shutdown_connections 2023-10-06T11:14:07.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.512+0000 7f89363d0700 1 -- 172.21.15.146:0/1057579281 wait complete. 2023-10-06T11:14:07.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.514+0000 7f89363d0700 1 Processor -- start 2023-10-06T11:14:07.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.514+0000 7f89363d0700 1 -- start start 2023-10-06T11:14:07.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.514+0000 7f89363d0700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8918003a60 0x7f8930150c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:07.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.514+0000 7f89363d0700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8930158a60 0x7f8930158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:07.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.514+0000 7f89363d0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89300b0ee0 0x7f89300b1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:07.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.514+0000 7f89363d0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89301593f0 con 0x7f89300b0ee0 2023-10-06T11:14:07.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.514+0000 7f89363d0700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8930169eb0 con 0x7f8930158a60 2023-10-06T11:14:07.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.514+0000 7f89363d0700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f893016a170 con 0x7f8918003a60 2023-10-06T11:14:07.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.515+0000 7f893496d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89300b0ee0 0x7f89300b1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:07.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.515+0000 7f893496d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89300b0ee0 0x7f89300b1360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35094/0 (socket says 172.21.15.146:35094) 2023-10-06T11:14:07.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.515+0000 7f893496d700 1 -- 172.21.15.146:0/1692908772 learned_addr learned my addr 172.21.15.146:0/1692908772 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:07.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.515+0000 7f892ffff700 1 --2- 172.21.15.146:0/1692908772 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8918003a60 0x7f8930150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:07.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.515+0000 7f892f7fe700 1 --2- 172.21.15.146:0/1692908772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8930158a60 0x7f8930158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:07.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.515+0000 7f893496d700 1 -- 172.21.15.146:0/1692908772 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8918003a60 msgr2=0x7f8930150c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:07.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.515+0000 7f893496d700 1 --2- 172.21.15.146:0/1692908772 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8918003a60 0x7f8930150c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:07.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.515+0000 7f893496d700 1 -- 172.21.15.146:0/1692908772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8930158a60 msgr2=0x7f8930158eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:07.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.515+0000 7f893496d700 1 --2- 172.21.15.146:0/1692908772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8930158a60 0x7f8930158eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:07.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.515+0000 7f893496d700 1 -- 172.21.15.146:0/1692908772 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f893016a450 con 0x7f89300b0ee0 2023-10-06T11:14:07.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.515+0000 7f893496d700 1 --2- 172.21.15.146:0/1692908772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89300b0ee0 0x7f89300b1360 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f89280094d0 tx=0x7f892800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:07.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.515+0000 7f8917fff700 1 -- 172.21.15.146:0/1692908772 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892800e040 con 0x7f89300b0ee0 2023-10-06T11:14:07.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.515+0000 7f8917fff700 1 -- 172.21.15.146:0/1692908772 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892800f040 con 0x7f89300b0ee0 2023-10-06T11:14:07.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.515+0000 7f89363d0700 1 -- 172.21.15.146:0/1692908772 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f893016a730 con 0x7f89300b0ee0 2023-10-06T11:14:07.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.515+0000 7f8917fff700 1 -- 172.21.15.146:0/1692908772 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892800fd70 con 0x7f89300b0ee0 2023-10-06T11:14:07.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.515+0000 7f89363d0700 1 -- 172.21.15.146:0/1692908772 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8930151150 con 0x7f89300b0ee0 2023-10-06T11:14:07.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.516+0000 7f89363d0700 1 -- 172.21.15.146:0/1692908772 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f893016ac50 con 0x7f89300b0ee0 2023-10-06T11:14:07.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.516+0000 7f8917fff700 1 -- 172.21.15.146:0/1692908772 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8928015640 con 0x7f89300b0ee0 2023-10-06T11:14:07.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.517+0000 7f8917fff700 1 --2- 172.21.15.146:0/1692908772 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f891c066f30 0x7f891c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:07.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.517+0000 7f8917fff700 1 -- 172.21.15.146:0/1692908772 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f8928084fa0 con 0x7f89300b0ee0 2023-10-06T11:14:07.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.517+0000 7f892ffff700 1 --2- 172.21.15.146:0/1692908772 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f891c066f30 0x7f891c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:07.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.517+0000 7f892ffff700 1 --2- 172.21.15.146:0/1692908772 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f891c066f30 0x7f891c0693e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f8920009160 tx=0x7f8920019000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:07.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.521+0000 7f8917fff700 1 -- 172.21.15.146:0/1692908772 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f89280b65a0 con 0x7f89300b0ee0 2023-10-06T11:14:07.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:07.746+0000 7f89363d0700 1 -- 172.21.15.146:0/1692908772 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f893004c380 con 0x7f89300b0ee0 2023-10-06T11:14:08.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.372+0000 7f8917fff700 1 -- 172.21.15.146:0/1692908772 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v95) v1 ==== 104+0+0 (secure 0 0 0) 0x7f893016ac50 con 0x7f89300b0ee0 2023-10-06T11:14:08.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.375+0000 7f89363d0700 1 -- 172.21.15.146:0/1692908772 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f891c066f30 msgr2=0x7f891c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:08.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.375+0000 7f89363d0700 1 --2- 172.21.15.146:0/1692908772 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f891c066f30 0x7f891c0693e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f8920009160 tx=0x7f8920019000 comp rx=0 tx=0).stop 2023-10-06T11:14:08.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.375+0000 7f89363d0700 1 -- 172.21.15.146:0/1692908772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89300b0ee0 msgr2=0x7f89300b1360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:08.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.375+0000 7f89363d0700 1 --2- 172.21.15.146:0/1692908772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89300b0ee0 0x7f89300b1360 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f89280094d0 tx=0x7f892800b040 comp rx=0 tx=0).stop 2023-10-06T11:14:08.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.375+0000 7f89363d0700 1 -- 172.21.15.146:0/1692908772 shutdown_connections 2023-10-06T11:14:08.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.375+0000 7f89363d0700 1 --2- 172.21.15.146:0/1692908772 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f891c066f30 0x7f891c0693e0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:08.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.375+0000 7f89363d0700 1 --2- 172.21.15.146:0/1692908772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f89300b0ee0 0x7f89300b1360 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:08.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.375+0000 7f89363d0700 1 --2- 172.21.15.146:0/1692908772 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8918003a60 0x7f8930150c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:08.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.375+0000 7f89363d0700 1 --2- 172.21.15.146:0/1692908772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8930158a60 0x7f8930158eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:08.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.375+0000 7f89363d0700 1 -- 172.21.15.146:0/1692908772 >> 172.21.15.146:0/1692908772 conn(0x7f893006eba0 msgr2=0x7f8930157540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:08.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.375+0000 7f89363d0700 1 -- 172.21.15.146:0/1692908772 shutdown_connections 2023-10-06T11:14:08.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.375+0000 7f89363d0700 1 -- 172.21.15.146:0/1692908772 wait complete. 2023-10-06T11:14:08.390 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T11:14:08.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.551+0000 7f385c2b7700 1 Processor -- start 2023-10-06T11:14:08.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.551+0000 7f385c2b7700 1 -- start start 2023-10-06T11:14:08.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.552+0000 7f385c2b7700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f385415cc20 0x7f385415d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:08.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.552+0000 7f385c2b7700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f38540d0c50 0x7f385415a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:08.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.552+0000 7f385c2b7700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38540cf030 con 0x7f385415cff0 2023-10-06T11:14:08.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.552+0000 7f385c2b7700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f385415e390 con 0x7f38540d0c50 2023-10-06T11:14:08.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.552+0000 7f385c2b7700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38540ced20 con 0x7f385415cc20 2023-10-06T11:14:08.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.552+0000 7f385a053700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f385415cc20 0x7f385415d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:08.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.552+0000 7f385a854700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f38540d0c50 0x7f385415a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:08.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.552+0000 7f3859852700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f385415cff0 0x7f38540d0540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:41856/0 (socket says 172.21.15.146:41856) 2023-10-06T11:14:08.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.552+0000 7f385a053700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f385415cc20 0x7f385415d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:42382/0 (socket says 172.21.15.146:42382) 2023-10-06T11:14:08.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.552+0000 7f3859852700 1 -- 172.21.15.146:0/3541142790 learned_addr learned my addr 172.21.15.146:0/3541142790 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:14:08.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.553+0000 7f385a053700 1 -- 172.21.15.146:0/3541142790 >> v2:172.21.15.151:3300/0 conn(0x7f38540d0c50 msgr2=0x7f385415a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:08.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.553+0000 7f385a053700 1 --2- 172.21.15.146:0/3541142790 >> v2:172.21.15.151:3300/0 conn(0x7f38540d0c50 0x7f385415a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:08.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.553+0000 7f385a053700 1 -- 172.21.15.146:0/3541142790 >> v1:172.21.15.151:6789/0 conn(0x7f385415cff0 legacy=0x7f38540d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:08.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.553+0000 7f385a053700 1 -- 172.21.15.146:0/3541142790 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f385415daf0 con 0x7f385415cc20 2023-10-06T11:14:08.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.553+0000 7f385a854700 1 --2- 172.21.15.146:0/3541142790 >> v2:172.21.15.151:3300/0 conn(0x7f38540d0c50 0x7f385415a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:14:08.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.553+0000 7f385a053700 1 --2- 172.21.15.146:0/3541142790 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f385415cc20 0x7f385415d460 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f38500098d0 tx=0x7f3850009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32b165676e2bfdb7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:08.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.553+0000 7f3859051700 1 -- 172.21.15.146:0/3541142790 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3850005c10 con 0x7f385415cc20 2023-10-06T11:14:08.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.553+0000 7f3859051700 1 -- 172.21.15.146:0/3541142790 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3850005d70 con 0x7f385415cc20 2023-10-06T11:14:08.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.553+0000 7f3859051700 1 -- 172.21.15.146:0/3541142790 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3850006280 con 0x7f385415cc20 2023-10-06T11:14:08.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.554+0000 7f385c2b7700 1 -- 172.21.15.146:0/3541142790 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f385415cc20 msgr2=0x7f385415d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:08.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.554+0000 7f385c2b7700 1 --2- 172.21.15.146:0/3541142790 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f385415cc20 0x7f385415d460 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f38500098d0 tx=0x7f3850009120 comp rx=0 tx=0).stop 2023-10-06T11:14:08.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.554+0000 7f385c2b7700 1 -- 172.21.15.146:0/3541142790 shutdown_connections 2023-10-06T11:14:08.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.554+0000 7f385c2b7700 1 --2- 172.21.15.146:0/3541142790 >> v2:172.21.15.151:3300/0 conn(0x7f38540d0c50 0x7f385415a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:08.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.554+0000 7f385c2b7700 1 --2- 172.21.15.146:0/3541142790 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f385415cc20 0x7f385415d460 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:08.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.554+0000 7f385c2b7700 1 -- 172.21.15.146:0/3541142790 >> 172.21.15.146:0/3541142790 conn(0x7f385406eba0 msgr2=0x7f385406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:08.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.554+0000 7f385c2b7700 1 -- 172.21.15.146:0/3541142790 shutdown_connections 2023-10-06T11:14:08.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.554+0000 7f385c2b7700 1 -- 172.21.15.146:0/3541142790 wait complete. 2023-10-06T11:14:08.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.555+0000 7f385c2b7700 1 Processor -- start 2023-10-06T11:14:08.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.555+0000 7f385c2b7700 1 -- start start 2023-10-06T11:14:08.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.556+0000 7f385c2b7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38540d0c50 0x7f3854142080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:08.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.556+0000 7f385c2b7700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f385415cc20 0x7f38540b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:08.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.556+0000 7f385c2b7700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f385415cff0 0x7f38540cf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:08.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.556+0000 7f385c2b7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3854150a40 con 0x7f38540d0c50 2023-10-06T11:14:08.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.556+0000 7f385c2b7700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38541425c0 con 0x7f385415cff0 2023-10-06T11:14:08.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.556+0000 7f385c2b7700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f385416d400 con 0x7f385415cc20 2023-10-06T11:14:08.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.556+0000 7f385a053700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38540d0c50 0x7f3854142080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:08.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.556+0000 7f385a053700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38540d0c50 0x7f3854142080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35102/0 (socket says 172.21.15.146:35102) 2023-10-06T11:14:08.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.556+0000 7f385a053700 1 -- 172.21.15.146:0/3145871010 learned_addr learned my addr 172.21.15.146:0/3145871010 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:08.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.556+0000 7f385a854700 1 --2- 172.21.15.146:0/3145871010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f385415cff0 0x7f38540cf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:08.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.556+0000 7f3859852700 1 --2- 172.21.15.146:0/3145871010 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f385415cc20 0x7f38540b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:08.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.556+0000 7f385a053700 1 -- 172.21.15.146:0/3145871010 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f385415cc20 msgr2=0x7f38540b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:08.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.556+0000 7f385a053700 1 --2- 172.21.15.146:0/3145871010 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f385415cc20 0x7f38540b14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:08.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.556+0000 7f385a053700 1 -- 172.21.15.146:0/3145871010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f385415cff0 msgr2=0x7f38540cf4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:08.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.556+0000 7f385a053700 1 --2- 172.21.15.146:0/3145871010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f385415cff0 0x7f38540cf4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:08.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.556+0000 7f385a053700 1 -- 172.21.15.146:0/3145871010 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f384c009a20 con 0x7f38540d0c50 2023-10-06T11:14:08.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.556+0000 7f385a053700 1 --2- 172.21.15.146:0/3145871010 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38540d0c50 0x7f3854142080 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f3850006210 tx=0x7f3850016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:08.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.556+0000 7f384a7fc700 1 -- 172.21.15.146:0/3145871010 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385001d780 con 0x7f38540d0c50 2023-10-06T11:14:08.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.556+0000 7f384a7fc700 1 -- 172.21.15.146:0/3145871010 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f385001d8e0 con 0x7f38540d0c50 2023-10-06T11:14:08.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.556+0000 7f384a7fc700 1 -- 172.21.15.146:0/3145871010 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385001dc80 con 0x7f38540d0c50 2023-10-06T11:14:08.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.556+0000 7f385c2b7700 1 -- 172.21.15.146:0/3145871010 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38500093c0 con 0x7f38540d0c50 2023-10-06T11:14:08.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.557+0000 7f385c2b7700 1 -- 172.21.15.146:0/3145871010 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3854153630 con 0x7f38540d0c50 2023-10-06T11:14:08.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.557+0000 7f385c2b7700 1 -- 172.21.15.146:0/3145871010 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f385404c380 con 0x7f38540d0c50 2023-10-06T11:14:08.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.558+0000 7f384a7fc700 1 -- 172.21.15.146:0/3145871010 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f385001b480 con 0x7f38540d0c50 2023-10-06T11:14:08.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.558+0000 7f384a7fc700 1 --2- 172.21.15.146:0/3145871010 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3838066f30 0x7f38380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:08.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.558+0000 7f384a7fc700 1 -- 172.21.15.146:0/3145871010 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f38500862f0 con 0x7f38540d0c50 2023-10-06T11:14:08.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.558+0000 7f3859852700 1 --2- 172.21.15.146:0/3145871010 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3838066f30 0x7f38380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:08.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.559+0000 7f3859852700 1 --2- 172.21.15.146:0/3145871010 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3838066f30 0x7f38380693e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3854145c00 tx=0x7f3844009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:08.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.562+0000 7f384a7fc700 1 -- 172.21.15.146:0/3145871010 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3850053470 con 0x7f38540d0c50 2023-10-06T11:14:08.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:08.750+0000 7f385c2b7700 1 -- 172.21.15.146:0/3145871010 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f38540b3b50 con 0x7f38540d0c50 2023-10-06T11:14:09.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.450+0000 7f384a7fc700 1 -- 172.21.15.146:0/3145871010 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v103) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3850056a90 con 0x7f38540d0c50 2023-10-06T11:14:09.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.453+0000 7f385c2b7700 1 -- 172.21.15.146:0/3145871010 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3838066f30 msgr2=0x7f38380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:09.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.453+0000 7f385c2b7700 1 --2- 172.21.15.146:0/3145871010 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3838066f30 0x7f38380693e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3854145c00 tx=0x7f3844009040 comp rx=0 tx=0).stop 2023-10-06T11:14:09.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.453+0000 7f385c2b7700 1 -- 172.21.15.146:0/3145871010 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38540d0c50 msgr2=0x7f3854142080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:09.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.453+0000 7f385c2b7700 1 --2- 172.21.15.146:0/3145871010 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38540d0c50 0x7f3854142080 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f3850006210 tx=0x7f3850016000 comp rx=0 tx=0).stop 2023-10-06T11:14:09.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.453+0000 7f385c2b7700 1 -- 172.21.15.146:0/3145871010 shutdown_connections 2023-10-06T11:14:09.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.453+0000 7f385c2b7700 1 --2- 172.21.15.146:0/3145871010 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3838066f30 0x7f38380693e0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:09.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.453+0000 7f385c2b7700 1 --2- 172.21.15.146:0/3145871010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f385415cff0 0x7f38540cf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:09.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.453+0000 7f385c2b7700 1 --2- 172.21.15.146:0/3145871010 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38540d0c50 0x7f3854142080 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:09.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.453+0000 7f385c2b7700 1 --2- 172.21.15.146:0/3145871010 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f385415cc20 0x7f38540b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:09.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.453+0000 7f385c2b7700 1 -- 172.21.15.146:0/3145871010 >> 172.21.15.146:0/3145871010 conn(0x7f385406eba0 msgr2=0x7f38540b5e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:09.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.453+0000 7f385c2b7700 1 -- 172.21.15.146:0/3145871010 shutdown_connections 2023-10-06T11:14:09.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.453+0000 7f385c2b7700 1 -- 172.21.15.146:0/3145871010 wait complete. 2023-10-06T11:14:09.456 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' removed 2023-10-06T11:14:09.468 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T11:14:09.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.585+0000 7f889dafd700 1 Processor -- start 2023-10-06T11:14:09.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.585+0000 7f889dafd700 1 -- start start 2023-10-06T11:14:09.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.586+0000 7f889dafd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88980cb090 0x7f88980cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:09.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.586+0000 7f889dafd700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88980cc130 con 0x7f88980b5640 2023-10-06T11:14:09.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.586+0000 7f889dafd700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88980b2660 con 0x7f8898068780 2023-10-06T11:14:09.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.586+0000 7f889dafd700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88980cb520 con 0x7f88980cb090 2023-10-06T11:14:09.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.586+0000 7f889cafb700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f88980b5640 0x7f889815a870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33912/0 (socket says 172.21.15.146:33912) 2023-10-06T11:14:09.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.586+0000 7f889cafb700 1 -- 172.21.15.146:0/990563011 learned_addr learned my addr 172.21.15.146:0/990563011 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:14:09.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.586+0000 7f8897fff700 1 --2- 172.21.15.146:0/990563011 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88980cb090 0x7f88980cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:09.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.586+0000 7f88977fe700 1 -- 172.21.15.146:0/990563011 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 554553046 0 0) 0x7f88980cc130 con 0x7f88980b5640 2023-10-06T11:14:09.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.587+0000 7f88977fe700 1 -- 172.21.15.146:0/990563011 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8880003570 con 0x7f88980b5640 2023-10-06T11:14:09.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.587+0000 7f88977fe700 1 -- 172.21.15.146:0/990563011 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 194283616 0 0) 0x7f88980b2660 con 0x7f8898068780 2023-10-06T11:14:09.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.587+0000 7f88977fe700 1 -- 172.21.15.146:0/990563011 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88980cc130 con 0x7f8898068780 2023-10-06T11:14:09.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.587+0000 7f88977fe700 1 -- 172.21.15.146:0/990563011 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3076198933 0 0) 0x7f8880003570 con 0x7f88980b5640 2023-10-06T11:14:09.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.587+0000 7f88977fe700 1 -- 172.21.15.146:0/990563011 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88980cb090 msgr2=0x7f88980cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:09.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.587+0000 7f88977fe700 1 --2- 172.21.15.146:0/990563011 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88980cb090 0x7f88980cc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:09.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.587+0000 7f88977fe700 1 -- 172.21.15.146:0/990563011 >> v1:172.21.15.151:6789/0 conn(0x7f8898068780 legacy=0x7f889815b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:09.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.587+0000 7f88977fe700 1 -- 172.21.15.146:0/990563011 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88980cb800 con 0x7f88980b5640 2023-10-06T11:14:09.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.587+0000 7f88977fe700 1 -- 172.21.15.146:0/990563011 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f8888001470 con 0x7f88980b5640 2023-10-06T11:14:09.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.587+0000 7f88977fe700 1 -- 172.21.15.146:0/990563011 >> v1:172.21.15.146:6789/0 conn(0x7f88980b5640 legacy=0x7f889815a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:09.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.587+0000 7f88977fe700 1 --2- 172.21.15.146:0/990563011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8880003c20 0x7f8880004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:09.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.587+0000 7f88977fe700 1 --2- 172.21.15.146:0/990563011 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88980cb090 0x7f8880004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:09.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.587+0000 7f88977fe700 1 --2- 172.21.15.146:0/990563011 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8880004d50 0x7f88800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:09.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.587+0000 7f88977fe700 1 -- 172.21.15.146:0/990563011 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88980cb520 con 0x7f8880003c20 2023-10-06T11:14:09.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.587+0000 7f88977fe700 1 -- 172.21.15.146:0/990563011 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888000bb70 con 0x7f8880004d50 2023-10-06T11:14:09.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.587+0000 7f88977fe700 1 -- 172.21.15.146:0/990563011 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f888000bd30 con 0x7f88980cb090 2023-10-06T11:14:09.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.587+0000 7f889cafb700 1 --2- 172.21.15.146:0/990563011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8880003c20 0x7f8880004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:09.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.587+0000 7f8897fff700 1 --2- 172.21.15.146:0/990563011 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88980cb090 0x7f8880004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:09.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.587+0000 7f889d2fc700 1 --2- 172.21.15.146:0/990563011 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8880004d50 0x7f88800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:09.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.587+0000 7f889cafb700 1 -- 172.21.15.146:0/990563011 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88980cb090 msgr2=0x7f8880004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:09.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.587+0000 7f889cafb700 1 --2- 172.21.15.146:0/990563011 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88980cb090 0x7f8880004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:09.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.587+0000 7f889cafb700 1 -- 172.21.15.146:0/990563011 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8880004d50 msgr2=0x7f88800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:09.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.587+0000 7f889cafb700 1 --2- 172.21.15.146:0/990563011 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8880004d50 0x7f88800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:09.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.587+0000 7f889cafb700 1 -- 172.21.15.146:0/990563011 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8880003570 con 0x7f8880003c20 2023-10-06T11:14:09.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.587+0000 7f889d2fc700 1 --2- 172.21.15.146:0/990563011 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8880004d50 0x7f88800051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:09.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.587+0000 7f889cafb700 1 --2- 172.21.15.146:0/990563011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8880003c20 0x7f8880004010 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f888800c2d0 tx=0x7f8888001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8b2b4753603c9a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:09.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.587+0000 7f88977fe700 1 -- 172.21.15.146:0/990563011 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888800cba0 con 0x7f8880003c20 2023-10-06T11:14:09.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.587+0000 7f88977fe700 1 -- 172.21.15.146:0/990563011 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888800cd00 con 0x7f8880003c20 2023-10-06T11:14:09.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.588+0000 7f88977fe700 1 -- 172.21.15.146:0/990563011 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8888005b70 con 0x7f8880003c20 2023-10-06T11:14:09.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.588+0000 7f889dafd700 1 -- 172.21.15.146:0/990563011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8880003c20 msgr2=0x7f8880004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:09.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.588+0000 7f889dafd700 1 --2- 172.21.15.146:0/990563011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8880003c20 0x7f8880004010 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f888800c2d0 tx=0x7f8888001e10 comp rx=0 tx=0).stop 2023-10-06T11:14:09.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.588+0000 7f889d2fc700 1 -- 172.21.15.146:0/990563011 reap_dead start 2023-10-06T11:14:09.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.588+0000 7f889dafd700 1 -- 172.21.15.146:0/990563011 shutdown_connections 2023-10-06T11:14:09.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.588+0000 7f889dafd700 1 -- 172.21.15.146:0/990563011 >> 172.21.15.146:0/990563011 conn(0x7f88980703f0 msgr2=0x7f88980707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:09.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.588+0000 7f889dafd700 1 -- 172.21.15.146:0/990563011 shutdown_connections 2023-10-06T11:14:09.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.588+0000 7f889dafd700 1 -- 172.21.15.146:0/990563011 wait complete. 2023-10-06T11:14:09.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.589+0000 7f889dafd700 1 Processor -- start 2023-10-06T11:14:09.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.589+0000 7f889dafd700 1 -- start start 2023-10-06T11:14:09.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.590+0000 7f889dafd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8880003c20 0x7f8898151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:09.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.590+0000 7f889dafd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88980c6730 0x7f88980d03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:09.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.590+0000 7f889dafd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88980c6ba0 0x7f88980d08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:09.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.590+0000 7f889dafd700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8898152030 con 0x7f8880003c20 2023-10-06T11:14:09.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.590+0000 7f889dafd700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88980c70f0 con 0x7f88980c6730 2023-10-06T11:14:09.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.590+0000 7f889dafd700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88980c3b20 con 0x7f88980c6ba0 2023-10-06T11:14:09.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.590+0000 7f889cafb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8880003c20 0x7f8898151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:09.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.590+0000 7f889cafb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8880003c20 0x7f8898151af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35120/0 (socket says 172.21.15.146:35120) 2023-10-06T11:14:09.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.590+0000 7f889cafb700 1 -- 172.21.15.146:0/2846558126 learned_addr learned my addr 172.21.15.146:0/2846558126 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:09.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.590+0000 7f889d2fc700 1 --2- 172.21.15.146:0/2846558126 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88980c6ba0 0x7f88980d08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:09.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.590+0000 7f8897fff700 1 --2- 172.21.15.146:0/2846558126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88980c6730 0x7f88980d03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:09.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.590+0000 7f889cafb700 1 -- 172.21.15.146:0/2846558126 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88980c6ba0 msgr2=0x7f88980d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:09.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.590+0000 7f889cafb700 1 --2- 172.21.15.146:0/2846558126 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88980c6ba0 0x7f88980d08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:09.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.590+0000 7f889cafb700 1 -- 172.21.15.146:0/2846558126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88980c6730 msgr2=0x7f88980d03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:09.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.590+0000 7f889cafb700 1 --2- 172.21.15.146:0/2846558126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88980c6730 0x7f88980d03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:09.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.590+0000 7f889cafb700 1 -- 172.21.15.146:0/2846558126 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88980c3e00 con 0x7f8880003c20 2023-10-06T11:14:09.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.590+0000 7f8897fff700 1 --2- 172.21.15.146:0/2846558126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88980c6730 0x7f88980d03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:09.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.590+0000 7f889d2fc700 1 --2- 172.21.15.146:0/2846558126 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88980c6ba0 0x7f88980d08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:09.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.591+0000 7f889cafb700 1 --2- 172.21.15.146:0/2846558126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8880003c20 0x7f8898151af0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f8888007c90 tx=0x7f8888015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:09.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.591+0000 7f8894ff9700 1 -- 172.21.15.146:0/2846558126 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88880070d0 con 0x7f8880003c20 2023-10-06T11:14:09.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.591+0000 7f8894ff9700 1 -- 172.21.15.146:0/2846558126 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8888007230 con 0x7f8880003c20 2023-10-06T11:14:09.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.591+0000 7f889dafd700 1 -- 172.21.15.146:0/2846558126 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8898152030 con 0x7f8880003c20 2023-10-06T11:14:09.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.591+0000 7f8894ff9700 1 -- 172.21.15.146:0/2846558126 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88880075f0 con 0x7f8880003c20 2023-10-06T11:14:09.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.591+0000 7f889dafd700 1 -- 172.21.15.146:0/2846558126 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88980c43c0 con 0x7f8880003c20 2023-10-06T11:14:09.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.592+0000 7f889dafd700 1 -- 172.21.15.146:0/2846558126 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88980c4730 con 0x7f8880003c20 2023-10-06T11:14:09.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.592+0000 7f8894ff9700 1 -- 172.21.15.146:0/2846558126 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8888019030 con 0x7f8880003c20 2023-10-06T11:14:09.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.592+0000 7f8894ff9700 1 --2- 172.21.15.146:0/2846558126 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8884066f30 0x7f88840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:09.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.593+0000 7f8894ff9700 1 -- 172.21.15.146:0/2846558126 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f8888085c80 con 0x7f8880003c20 2023-10-06T11:14:09.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.593+0000 7f8897fff700 1 --2- 172.21.15.146:0/2846558126 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8884066f30 0x7f88840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:09.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.593+0000 7f8897fff700 1 --2- 172.21.15.146:0/2846558126 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8884066f30 0x7f88840693e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f8898152ff0 tx=0x7f888c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:09.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.597+0000 7f8894ff9700 1 -- 172.21.15.146:0/2846558126 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8888052ef0 con 0x7f8880003c20 2023-10-06T11:14:09.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:09.787+0000 7f889dafd700 1 -- 172.21.15.146:0/2846558126 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f88980c4550 con 0x7f8880003c20 2023-10-06T11:14:10.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.453+0000 7f8894ff9700 1 -- 172.21.15.146:0/2846558126 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v104) v1 ==== 169+0+0 (secure 0 0 0) 0x7f888801ae60 con 0x7f8880003c20 2023-10-06T11:14:10.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.457+0000 7f889dafd700 1 -- 172.21.15.146:0/2846558126 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8884066f30 msgr2=0x7f88840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:10.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.457+0000 7f889dafd700 1 --2- 172.21.15.146:0/2846558126 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8884066f30 0x7f88840693e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f8898152ff0 tx=0x7f888c008040 comp rx=0 tx=0).stop 2023-10-06T11:14:10.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.457+0000 7f889dafd700 1 -- 172.21.15.146:0/2846558126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8880003c20 msgr2=0x7f8898151af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:10.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.457+0000 7f889dafd700 1 --2- 172.21.15.146:0/2846558126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8880003c20 0x7f8898151af0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f8888007c90 tx=0x7f8888015000 comp rx=0 tx=0).stop 2023-10-06T11:14:10.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.457+0000 7f889dafd700 1 -- 172.21.15.146:0/2846558126 shutdown_connections 2023-10-06T11:14:10.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.457+0000 7f889dafd700 1 --2- 172.21.15.146:0/2846558126 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8884066f30 0x7f88840693e0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:10.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.457+0000 7f889dafd700 1 --2- 172.21.15.146:0/2846558126 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88980c6ba0 0x7f88980d08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:10.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.457+0000 7f889dafd700 1 --2- 172.21.15.146:0/2846558126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8880003c20 0x7f8898151af0 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:10.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.457+0000 7f889dafd700 1 --2- 172.21.15.146:0/2846558126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88980c6730 0x7f88980d03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:10.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.457+0000 7f889dafd700 1 -- 172.21.15.146:0/2846558126 >> 172.21.15.146:0/2846558126 conn(0x7f88980703f0 msgr2=0x7f88980b3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:10.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.458+0000 7f889dafd700 1 -- 172.21.15.146:0/2846558126 shutdown_connections 2023-10-06T11:14:10.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.458+0000 7f889dafd700 1 -- 172.21.15.146:0/2846558126 wait complete. 2023-10-06T11:14:10.460 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' removed 2023-10-06T11:14:10.478 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T11:14:10.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.594+0000 7f3fe6c18700 1 Processor -- start 2023-10-06T11:14:10.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.594+0000 7f3fe6c18700 1 -- start start 2023-10-06T11:14:10.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.595+0000 7f3fe6c18700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fe014c6f0 0x7f3fe006ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:10.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.595+0000 7f3fe6c18700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3fe014cac0 0x7f3fe00c1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:10.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.595+0000 7f3fe6c18700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3fe00c1b90 0x7f3fe00cace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:10.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.595+0000 7f3fe6c18700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe0156cf0 con 0x7f3fe00c1b90 2023-10-06T11:14:10.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.595+0000 7f3fe6c18700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe00c1f60 con 0x7f3fe014cac0 2023-10-06T11:14:10.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.595+0000 7f3fe6c18700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe0156070 con 0x7f3fe014c6f0 2023-10-06T11:14:10.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.595+0000 7f3fe6417700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3fe00c1b90 0x7f3fe00cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:10.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.595+0000 7f3fe6417700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3fe00c1b90 0x7f3fe00cace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35134/0 (socket says 172.21.15.146:35134) 2023-10-06T11:14:10.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.595+0000 7f3fe6417700 1 -- 172.21.15.146:0/290714168 learned_addr learned my addr 172.21.15.146:0/290714168 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:10.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.596+0000 7f3fe5c16700 1 --2- 172.21.15.146:0/290714168 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fe014c6f0 0x7f3fe006ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:10.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.596+0000 7f3fe5415700 1 --2- 172.21.15.146:0/290714168 >> v2:172.21.15.151:3300/0 conn(0x7f3fe014cac0 0x7f3fe00c1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:10.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.596+0000 7f3fe6417700 1 -- 172.21.15.146:0/290714168 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fe014c6f0 msgr2=0x7f3fe006ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:10.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.596+0000 7f3fe6417700 1 --2- 172.21.15.146:0/290714168 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fe014c6f0 0x7f3fe006ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:10.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.596+0000 7f3fe6417700 1 -- 172.21.15.146:0/290714168 >> v2:172.21.15.151:3300/0 conn(0x7f3fe014cac0 msgr2=0x7f3fe00c1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:10.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.596+0000 7f3fe6417700 1 --2- 172.21.15.146:0/290714168 >> v2:172.21.15.151:3300/0 conn(0x7f3fe014cac0 0x7f3fe00c1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:10.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.596+0000 7f3fe6417700 1 -- 172.21.15.146:0/290714168 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe0156350 con 0x7f3fe00c1b90 2023-10-06T11:14:10.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.596+0000 7f3fe5c16700 1 --2- 172.21.15.146:0/290714168 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fe014c6f0 0x7f3fe006ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:10.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.596+0000 7f3fe5415700 1 --2- 172.21.15.146:0/290714168 >> v2:172.21.15.151:3300/0 conn(0x7f3fe014cac0 0x7f3fe00c1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:10.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.596+0000 7f3fe6417700 1 --2- 172.21.15.146:0/290714168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fe00c1b90 0x7f3fe00cace0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0068d50 tx=0x7f3fd0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf6f3acc614109e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:10.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.596+0000 7f3fe4c14700 1 -- 172.21.15.146:0/290714168 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd000b860 con 0x7f3fe00c1b90 2023-10-06T11:14:10.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.596+0000 7f3fe4c14700 1 -- 172.21.15.146:0/290714168 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd000b9c0 con 0x7f3fe00c1b90 2023-10-06T11:14:10.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.596+0000 7f3fe4c14700 1 -- 172.21.15.146:0/290714168 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd000bd60 con 0x7f3fe00c1b90 2023-10-06T11:14:10.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.596+0000 7f3fe6c18700 1 -- 172.21.15.146:0/290714168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fe00c1b90 msgr2=0x7f3fe00cace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:10.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.596+0000 7f3fe6c18700 1 --2- 172.21.15.146:0/290714168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fe00c1b90 0x7f3fe00cace0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0068d50 tx=0x7f3fd0009250 comp rx=0 tx=0).stop 2023-10-06T11:14:10.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.597+0000 7f3fe6c18700 1 -- 172.21.15.146:0/290714168 shutdown_connections 2023-10-06T11:14:10.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.597+0000 7f3fe6c18700 1 --2- 172.21.15.146:0/290714168 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fe00c1b90 0x7f3fe00cace0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:10.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.597+0000 7f3fe6c18700 1 --2- 172.21.15.146:0/290714168 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fe014c6f0 0x7f3fe006ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:10.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.597+0000 7f3fe6c18700 1 --2- 172.21.15.146:0/290714168 >> v2:172.21.15.151:3300/0 conn(0x7f3fe014cac0 0x7f3fe00c1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:10.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.597+0000 7f3fe6c18700 1 -- 172.21.15.146:0/290714168 >> 172.21.15.146:0/290714168 conn(0x7f3fe00cc020 msgr2=0x7f3fe00cc420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:10.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.597+0000 7f3fe6c18700 1 -- 172.21.15.146:0/290714168 shutdown_connections 2023-10-06T11:14:10.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.597+0000 7f3fe6c18700 1 -- 172.21.15.146:0/290714168 wait complete. 2023-10-06T11:14:10.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.598+0000 7f3fe6c18700 1 Processor -- start 2023-10-06T11:14:10.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.598+0000 7f3fe6c18700 1 -- start start 2023-10-06T11:14:10.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.598+0000 7f3fe6c18700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fe00c1b90 0x7f3fe014cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:10.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.598+0000 7f3fe6c18700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fe014c6f0 0x7f3fe0141d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:10.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.598+0000 7f3fe6c18700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fe014cac0 0x7f3fe0156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:10.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.598+0000 7f3fe6c18700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe00af670 con 0x7f3fe014cac0 2023-10-06T11:14:10.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.598+0000 7f3fe6c18700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe014fb00 con 0x7f3fe00c1b90 2023-10-06T11:14:10.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.598+0000 7f3fe6c18700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe014fde0 con 0x7f3fe014c6f0 2023-10-06T11:14:10.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.599+0000 7f3fe6417700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fe014cac0 0x7f3fe0156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:10.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.599+0000 7f3fe6417700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fe014cac0 0x7f3fe0156fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35146/0 (socket says 172.21.15.146:35146) 2023-10-06T11:14:10.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.599+0000 7f3fe5c16700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fe00c1b90 0x7f3fe014cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:10.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.599+0000 7f3fe6417700 1 -- 172.21.15.146:0/385271345 learned_addr learned my addr 172.21.15.146:0/385271345 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:10.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.599+0000 7f3fe5415700 1 --2- 172.21.15.146:0/385271345 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fe014c6f0 0x7f3fe0141d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:10.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.599+0000 7f3fe6417700 1 -- 172.21.15.146:0/385271345 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fe014c6f0 msgr2=0x7f3fe0141d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:10.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.599+0000 7f3fe6417700 1 --2- 172.21.15.146:0/385271345 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fe014c6f0 0x7f3fe0141d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:10.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.599+0000 7f3fe6417700 1 -- 172.21.15.146:0/385271345 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fe00c1b90 msgr2=0x7f3fe014cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:10.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.599+0000 7f3fe6417700 1 --2- 172.21.15.146:0/385271345 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fe00c1b90 0x7f3fe014cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:10.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.599+0000 7f3fe6417700 1 -- 172.21.15.146:0/385271345 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd00094f0 con 0x7f3fe014cac0 2023-10-06T11:14:10.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.599+0000 7f3fe6417700 1 --2- 172.21.15.146:0/385271345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fe014cac0 0x7f3fe0156fe0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0068d80 tx=0x7f3fd0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:10.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.599+0000 7f3fddffb700 1 -- 172.21.15.146:0/385271345 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd0011ea0 con 0x7f3fe014cac0 2023-10-06T11:14:10.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.599+0000 7f3fddffb700 1 -- 172.21.15.146:0/385271345 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd001a630 con 0x7f3fe014cac0 2023-10-06T11:14:10.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.599+0000 7f3fddffb700 1 -- 172.21.15.146:0/385271345 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd001aa10 con 0x7f3fe014cac0 2023-10-06T11:14:10.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.599+0000 7f3fe6c18700 1 -- 172.21.15.146:0/385271345 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe00af020 con 0x7f3fe014cac0 2023-10-06T11:14:10.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.599+0000 7f3fe6c18700 1 -- 172.21.15.146:0/385271345 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe01422a0 con 0x7f3fe014cac0 2023-10-06T11:14:10.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.600+0000 7f3fe6c18700 1 -- 172.21.15.146:0/385271345 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fe00af4c0 con 0x7f3fe014cac0 2023-10-06T11:14:10.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.601+0000 7f3fddffb700 1 -- 172.21.15.146:0/385271345 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3fd002d440 con 0x7f3fe014cac0 2023-10-06T11:14:10.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.601+0000 7f3fddffb700 1 --2- 172.21.15.146:0/385271345 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3fcc066f30 0x7f3fcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:10.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.601+0000 7f3fddffb700 1 -- 172.21.15.146:0/385271345 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f3fd0085ed0 con 0x7f3fe014cac0 2023-10-06T11:14:10.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.601+0000 7f3fe5c16700 1 --2- 172.21.15.146:0/385271345 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3fcc066f30 0x7f3fcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:10.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.602+0000 7f3fe5c16700 1 --2- 172.21.15.146:0/385271345 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3fcc066f30 0x7f3fcc0693e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3fd800f600 tx=0x7f3fd8007720 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:10.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.605+0000 7f3fddffb700 1 -- 172.21.15.146:0/385271345 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3fd00532e0 con 0x7f3fe014cac0 2023-10-06T11:14:10.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.789+0000 7f3fe6c18700 1 -- 172.21.15.146:0/385271345 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f3fe00af7b0 con 0x7f3fe014cac0 2023-10-06T11:14:10.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.793+0000 7f3fddffb700 1 -- 172.21.15.146:0/385271345 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3fd0006d70 con 0x7f3fe014cac0 2023-10-06T11:14:10.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.795+0000 7f3fe6c18700 1 -- 172.21.15.146:0/385271345 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3fcc066f30 msgr2=0x7f3fcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:10.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.795+0000 7f3fe6c18700 1 --2- 172.21.15.146:0/385271345 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3fcc066f30 0x7f3fcc0693e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3fd800f600 tx=0x7f3fd8007720 comp rx=0 tx=0).stop 2023-10-06T11:14:10.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.795+0000 7f3fe6c18700 1 -- 172.21.15.146:0/385271345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fe014cac0 msgr2=0x7f3fe0156fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:10.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.795+0000 7f3fe6c18700 1 --2- 172.21.15.146:0/385271345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fe014cac0 0x7f3fe0156fe0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0068d80 tx=0x7f3fd0017000 comp rx=0 tx=0).stop 2023-10-06T11:14:10.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.795+0000 7f3fe6c18700 1 -- 172.21.15.146:0/385271345 shutdown_connections 2023-10-06T11:14:10.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.795+0000 7f3fe6c18700 1 --2- 172.21.15.146:0/385271345 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3fcc066f30 0x7f3fcc0693e0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:10.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.795+0000 7f3fe6c18700 1 --2- 172.21.15.146:0/385271345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3fe014cac0 0x7f3fe0156fe0 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:10.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.795+0000 7f3fe6c18700 1 --2- 172.21.15.146:0/385271345 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fe00c1b90 0x7f3fe014cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:10.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.795+0000 7f3fe6c18700 1 --2- 172.21.15.146:0/385271345 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fe014c6f0 0x7f3fe0141d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:10.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.795+0000 7f3fe6c18700 1 -- 172.21.15.146:0/385271345 >> 172.21.15.146:0/385271345 conn(0x7f3fe00cc020 msgr2=0x7f3fe01462b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:10.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.795+0000 7f3fe6c18700 1 -- 172.21.15.146:0/385271345 shutdown_connections 2023-10-06T11:14:10.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.795+0000 7f3fe6c18700 1 -- 172.21.15.146:0/385271345 wait complete. 2023-10-06T11:14:10.810 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume' 2023-10-06T11:14:10.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.923+0000 7f20bdb5a700 1 Processor -- start 2023-10-06T11:14:10.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.923+0000 7f20bdb5a700 1 -- start start 2023-10-06T11:14:10.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.924+0000 7f20bdb5a700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f20b815a420 0x7f20b815cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:10.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.924+0000 7f20bdb5a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f20b815a7f0 0x7f20b80b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:10.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.924+0000 7f20bdb5a700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20b815c630 con 0x7f20b80b2360 2023-10-06T11:14:10.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.924+0000 7f20bdb5a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20b80ce040 con 0x7f20b815a7f0 2023-10-06T11:14:10.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.924+0000 7f20bdb5a700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20b80b2780 con 0x7f20b815a420 2023-10-06T11:14:10.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.924+0000 7f20affff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f20b815a7f0 0x7f20b80b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:10.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.924+0000 7f20affff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f20b815a7f0 0x7f20b80b1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35160/0 (socket says 172.21.15.146:35160) 2023-10-06T11:14:10.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.924+0000 7f20affff700 1 -- 172.21.15.146:0/2524789660 learned_addr learned my addr 172.21.15.146:0/2524789660 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:10.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.924+0000 7f20bcb58700 1 --2- 172.21.15.146:0/2524789660 >> v2:172.21.15.151:3300/0 conn(0x7f20b815a420 0x7f20b815cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:10.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.925+0000 7f20affff700 1 -- 172.21.15.146:0/2524789660 >> v2:172.21.15.151:3300/0 conn(0x7f20b815a420 msgr2=0x7f20b815cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:10.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.925+0000 7f20affff700 1 --2- 172.21.15.146:0/2524789660 >> v2:172.21.15.151:3300/0 conn(0x7f20b815a420 0x7f20b815cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:10.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.925+0000 7f20affff700 1 -- 172.21.15.146:0/2524789660 >> v1:172.21.15.151:6789/0 conn(0x7f20b80b2360 legacy=0x7f20b815acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:10.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.925+0000 7f20af7fe700 1 -- 172.21.15.146:0/2524789660 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 188610710 0 0) 0x7f20b815c630 con 0x7f20b80b2360 2023-10-06T11:14:10.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.925+0000 7f20affff700 1 -- 172.21.15.146:0/2524789660 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b815ba20 con 0x7f20b815a7f0 2023-10-06T11:14:10.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.925+0000 7f20affff700 1 --2- 172.21.15.146:0/2524789660 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20b815a7f0 0x7f20b80b1e20 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f20b80d1460 tx=0x7f20a8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=830b8a29c90b7e75 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:10.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.925+0000 7f20af7fe700 1 -- 172.21.15.146:0/2524789660 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a8009e70 con 0x7f20b815a7f0 2023-10-06T11:14:10.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.925+0000 7f20af7fe700 1 -- 172.21.15.146:0/2524789660 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a800b860 con 0x7f20b815a7f0 2023-10-06T11:14:10.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.925+0000 7f20af7fe700 1 -- 172.21.15.146:0/2524789660 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a800bc00 con 0x7f20b815a7f0 2023-10-06T11:14:10.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.925+0000 7f20bdb5a700 1 -- 172.21.15.146:0/2524789660 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20b815a7f0 msgr2=0x7f20b80b1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:10.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.925+0000 7f20bdb5a700 1 --2- 172.21.15.146:0/2524789660 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20b815a7f0 0x7f20b80b1e20 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f20b80d1460 tx=0x7f20a8009250 comp rx=0 tx=0).stop 2023-10-06T11:14:10.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.925+0000 7f20bdb5a700 1 -- 172.21.15.146:0/2524789660 shutdown_connections 2023-10-06T11:14:10.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.925+0000 7f20bdb5a700 1 --2- 172.21.15.146:0/2524789660 >> v2:172.21.15.151:3300/0 conn(0x7f20b815a420 0x7f20b815cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:10.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.925+0000 7f20bdb5a700 1 --2- 172.21.15.146:0/2524789660 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20b815a7f0 0x7f20b80b1e20 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:10.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.925+0000 7f20bdb5a700 1 -- 172.21.15.146:0/2524789660 >> 172.21.15.146:0/2524789660 conn(0x7f20b806eba0 msgr2=0x7f20b806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:10.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.925+0000 7f20bdb5a700 1 -- 172.21.15.146:0/2524789660 shutdown_connections 2023-10-06T11:14:10.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.925+0000 7f20bdb5a700 1 -- 172.21.15.146:0/2524789660 wait complete. 2023-10-06T11:14:10.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.927+0000 7f20bdb5a700 1 Processor -- start 2023-10-06T11:14:10.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.927+0000 7f20bdb5a700 1 -- start start 2023-10-06T11:14:10.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.927+0000 7f20bdb5a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20b80b2360 0x7f20b8152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:10.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.927+0000 7f20bdb5a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20b815a420 0x7f20b814f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:10.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.927+0000 7f20bdb5a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20b815a7f0 0x7f20b814fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:10.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.927+0000 7f20bdb5a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b816aac0 con 0x7f20b815a420 2023-10-06T11:14:10.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.927+0000 7f20bdb5a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b816d0f0 con 0x7f20b80b2360 2023-10-06T11:14:10.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.927+0000 7f20bdb5a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b816dc70 con 0x7f20b815a7f0 2023-10-06T11:14:10.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.928+0000 7f20affff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20b815a420 0x7f20b814f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:10.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.928+0000 7f20affff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20b815a420 0x7f20b814f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35168/0 (socket says 172.21.15.146:35168) 2023-10-06T11:14:10.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.928+0000 7f20affff700 1 -- 172.21.15.146:0/2067887540 learned_addr learned my addr 172.21.15.146:0/2067887540 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:10.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.928+0000 7f20bcb58700 1 --2- 172.21.15.146:0/2067887540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20b80b2360 0x7f20b8152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:10.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.928+0000 7f20bd359700 1 --2- 172.21.15.146:0/2067887540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20b815a7f0 0x7f20b814fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:10.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.928+0000 7f20bcb58700 1 -- 172.21.15.146:0/2067887540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20b815a7f0 msgr2=0x7f20b814fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:10.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.928+0000 7f20bcb58700 1 --2- 172.21.15.146:0/2067887540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20b815a7f0 0x7f20b814fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:10.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.928+0000 7f20bcb58700 1 -- 172.21.15.146:0/2067887540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20b815a420 msgr2=0x7f20b814f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:10.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.928+0000 7f20bcb58700 1 --2- 172.21.15.146:0/2067887540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20b815a420 0x7f20b814f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:10.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.928+0000 7f20bcb58700 1 -- 172.21.15.146:0/2067887540 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a80094f0 con 0x7f20b80b2360 2023-10-06T11:14:10.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.928+0000 7f20affff700 1 --2- 172.21.15.146:0/2067887540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20b815a420 0x7f20b814f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:14:10.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.928+0000 7f20bcb58700 1 --2- 172.21.15.146:0/2067887540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20b80b2360 0x7f20b8152d30 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f20b4009f50 tx=0x7f20b400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:10.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.928+0000 7f20acff9700 1 -- 172.21.15.146:0/2067887540 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b400cb50 con 0x7f20b80b2360 2023-10-06T11:14:10.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.928+0000 7f20acff9700 1 -- 172.21.15.146:0/2067887540 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20b400f040 con 0x7f20b80b2360 2023-10-06T11:14:10.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.928+0000 7f20bdb5a700 1 -- 172.21.15.146:0/2067887540 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20b816d340 con 0x7f20b80b2360 2023-10-06T11:14:10.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.928+0000 7f20acff9700 1 -- 172.21.15.146:0/2067887540 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20b400cee0 con 0x7f20b80b2360 2023-10-06T11:14:10.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.928+0000 7f20bdb5a700 1 -- 172.21.15.146:0/2067887540 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20b816d900 con 0x7f20b80b2360 2023-10-06T11:14:10.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.929+0000 7f20bdb5a700 1 -- 172.21.15.146:0/2067887540 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20b80afae0 con 0x7f20b80b2360 2023-10-06T11:14:10.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.929+0000 7f20acff9700 1 -- 172.21.15.146:0/2067887540 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f20b4014690 con 0x7f20b80b2360 2023-10-06T11:14:10.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.930+0000 7f20acff9700 1 --2- 172.21.15.146:0/2067887540 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f20a4066f30 0x7f20a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:10.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.930+0000 7f20acff9700 1 -- 172.21.15.146:0/2067887540 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f20b4084f80 con 0x7f20b80b2360 2023-10-06T11:14:10.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.930+0000 7f20affff700 1 --2- 172.21.15.146:0/2067887540 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f20a4066f30 0x7f20a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:10.935 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.930+0000 7f20affff700 1 --2- 172.21.15.146:0/2067887540 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f20a4066f30 0x7f20a40693e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f20b80b2140 tx=0x7f20a8017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:10.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:10.934+0000 7f20acff9700 1 -- 172.21.15.146:0/2067887540 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f20b4052390 con 0x7f20b80b2360 2023-10-06T11:14:11.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.222+0000 7f20bdb5a700 1 -- 172.21.15.146:0/2067887540 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]} v 0) v1 -- 0x7f20b815bd00 con 0x7f20b80b2360 2023-10-06T11:14:11.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.463+0000 7f20acff9700 1 -- 172.21.15.146:0/2067887540 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume"]}]=0 v399) v1 ==== 155+0+0 (secure 0 0 0) 0x7f20b40559b0 con 0x7f20b80b2360 2023-10-06T11:14:11.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.465+0000 7f20bdb5a700 1 -- 172.21.15.146:0/2067887540 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f20a4066f30 msgr2=0x7f20a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:11.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.465+0000 7f20bdb5a700 1 --2- 172.21.15.146:0/2067887540 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f20a4066f30 0x7f20a40693e0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f20b80b2140 tx=0x7f20a8017000 comp rx=0 tx=0).stop 2023-10-06T11:14:11.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.465+0000 7f20bdb5a700 1 -- 172.21.15.146:0/2067887540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20b80b2360 msgr2=0x7f20b8152d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:11.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.465+0000 7f20bdb5a700 1 --2- 172.21.15.146:0/2067887540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20b80b2360 0x7f20b8152d30 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f20b4009f50 tx=0x7f20b400b040 comp rx=0 tx=0).stop 2023-10-06T11:14:11.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.465+0000 7f20bdb5a700 1 -- 172.21.15.146:0/2067887540 shutdown_connections 2023-10-06T11:14:11.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.465+0000 7f20bdb5a700 1 --2- 172.21.15.146:0/2067887540 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f20a4066f30 0x7f20a40693e0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:11.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.465+0000 7f20bdb5a700 1 --2- 172.21.15.146:0/2067887540 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f20b815a7f0 0x7f20b814fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:11.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.465+0000 7f20bdb5a700 1 --2- 172.21.15.146:0/2067887540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20b80b2360 0x7f20b8152d30 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:11.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.465+0000 7f20bdb5a700 1 --2- 172.21.15.146:0/2067887540 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f20b815a420 0x7f20b814f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:11.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.465+0000 7f20bdb5a700 1 -- 172.21.15.146:0/2067887540 >> 172.21.15.146:0/2067887540 conn(0x7f20b806eba0 msgr2=0x7f20b80b5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:11.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.465+0000 7f20bdb5a700 1 -- 172.21.15.146:0/2067887540 shutdown_connections 2023-10-06T11:14:11.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.465+0000 7f20bdb5a700 1 -- 172.21.15.146:0/2067887540 wait complete. 2023-10-06T11:14:11.480 INFO:tasks.cephfs_test_runner:test_scrub_pause_and_resume (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2023-10-06T11:14:11.480 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_pause_and_resume_with_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) 2023-10-06T11:14:11.480 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort' 2023-10-06T11:14:11.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.594+0000 7fc64f0f4700 1 Processor -- start 2023-10-06T11:14:11.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.594+0000 7fc64f0f4700 1 -- start start 2023-10-06T11:14:11.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.594+0000 7fc64f0f4700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc6480c97c0 0x7fc64815aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:11.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.594+0000 7fc64f0f4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc6480ca330 0x7fc64806e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:11.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.594+0000 7fc64f0f4700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6480b00c0 con 0x7fc6480ca7d0 2023-10-06T11:14:11.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.594+0000 7fc64f0f4700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6480afc30 con 0x7fc6480ca330 2023-10-06T11:14:11.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.594+0000 7fc64f0f4700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6481569b0 con 0x7fc6480c97c0 2023-10-06T11:14:11.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.595+0000 7fc63ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc6480ca330 0x7fc64806e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:11.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.595+0000 7fc64d691700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc6480ca7d0 0x7fc6480b0830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38644/0 (socket says 172.21.15.146:38644) 2023-10-06T11:14:11.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.595+0000 7fc64d691700 1 -- 172.21.15.146:0/2048412455 learned_addr learned my addr 172.21.15.146:0/2048412455 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:14:11.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.595+0000 7fc64ce90700 1 --2- 172.21.15.146:0/2048412455 >> v2:172.21.15.151:3300/0 conn(0x7fc6480c97c0 0x7fc64815aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:11.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.595+0000 7fc63ffff700 1 -- 172.21.15.146:0/2048412455 >> v2:172.21.15.151:3300/0 conn(0x7fc6480c97c0 msgr2=0x7fc64815aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:11.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.595+0000 7fc63ffff700 1 --2- 172.21.15.146:0/2048412455 >> v2:172.21.15.151:3300/0 conn(0x7fc6480c97c0 0x7fc64815aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:11.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.595+0000 7fc63ffff700 1 -- 172.21.15.146:0/2048412455 >> v1:172.21.15.146:6789/0 conn(0x7fc6480ca7d0 legacy=0x7fc6480b0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:11.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.595+0000 7fc63ffff700 1 -- 172.21.15.146:0/2048412455 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6480b1c60 con 0x7fc6480ca330 2023-10-06T11:14:11.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.595+0000 7fc63f7fe700 1 -- 172.21.15.146:0/2048412455 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4096245422 0 0) 0x7fc6480b00c0 con 0x7fc6480ca7d0 2023-10-06T11:14:11.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.595+0000 7fc64ce90700 1 --2- 172.21.15.146:0/2048412455 >> v2:172.21.15.151:3300/0 conn(0x7fc6480c97c0 0x7fc64815aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:11.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.595+0000 7fc63ffff700 1 --2- 172.21.15.146:0/2048412455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6480ca330 0x7fc64806e590 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fc648071990 tx=0x7fc638009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea0ea2f525bb9f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:11.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.595+0000 7fc63f7fe700 1 -- 172.21.15.146:0/2048412455 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc638005c10 con 0x7fc6480ca330 2023-10-06T11:14:11.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.595+0000 7fc63f7fe700 1 -- 172.21.15.146:0/2048412455 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc638005d70 con 0x7fc6480ca330 2023-10-06T11:14:11.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.595+0000 7fc63f7fe700 1 -- 172.21.15.146:0/2048412455 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc638006280 con 0x7fc6480ca330 2023-10-06T11:14:11.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.596+0000 7fc64f0f4700 1 -- 172.21.15.146:0/2048412455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6480ca330 msgr2=0x7fc64806e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:11.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.596+0000 7fc64f0f4700 1 --2- 172.21.15.146:0/2048412455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6480ca330 0x7fc64806e590 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fc648071990 tx=0x7fc638009120 comp rx=0 tx=0).stop 2023-10-06T11:14:11.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.596+0000 7fc64f0f4700 1 -- 172.21.15.146:0/2048412455 shutdown_connections 2023-10-06T11:14:11.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.596+0000 7fc64f0f4700 1 --2- 172.21.15.146:0/2048412455 >> v2:172.21.15.151:3300/0 conn(0x7fc6480c97c0 0x7fc64815aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:11.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.596+0000 7fc64f0f4700 1 --2- 172.21.15.146:0/2048412455 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6480ca330 0x7fc64806e590 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:11.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.596+0000 7fc64f0f4700 1 -- 172.21.15.146:0/2048412455 >> 172.21.15.146:0/2048412455 conn(0x7fc64806b060 msgr2=0x7fc6480aecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:11.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.596+0000 7fc64f0f4700 1 -- 172.21.15.146:0/2048412455 shutdown_connections 2023-10-06T11:14:11.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.596+0000 7fc64f0f4700 1 -- 172.21.15.146:0/2048412455 wait complete. 2023-10-06T11:14:11.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.597+0000 7fc64f0f4700 1 Processor -- start 2023-10-06T11:14:11.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.597+0000 7fc64f0f4700 1 -- start start 2023-10-06T11:14:11.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.598+0000 7fc64f0f4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6480c97c0 0x7fc648149d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:11.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.598+0000 7fc64f0f4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6480ca330 0x7fc6480acf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:11.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.598+0000 7fc64f0f4700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc648150b90 0x7fc64814bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:11.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.598+0000 7fc64f0f4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64814a410 con 0x7fc6480c97c0 2023-10-06T11:14:11.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.598+0000 7fc64f0f4700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64814a6f0 con 0x7fc6480ca330 2023-10-06T11:14:11.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.598+0000 7fc64f0f4700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc64814a9d0 con 0x7fc648150b90 2023-10-06T11:14:11.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.598+0000 7fc64ce90700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6480c97c0 0x7fc648149d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:11.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.598+0000 7fc64ce90700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6480c97c0 0x7fc648149d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35172/0 (socket says 172.21.15.146:35172) 2023-10-06T11:14:11.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.598+0000 7fc64ce90700 1 -- 172.21.15.146:0/1534407506 learned_addr learned my addr 172.21.15.146:0/1534407506 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:11.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.598+0000 7fc63ffff700 1 --2- 172.21.15.146:0/1534407506 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6480ca330 0x7fc6480acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:11.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.598+0000 7fc64d691700 1 --2- 172.21.15.146:0/1534407506 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc648150b90 0x7fc64814bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:11.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.598+0000 7fc64ce90700 1 -- 172.21.15.146:0/1534407506 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc648150b90 msgr2=0x7fc64814bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:11.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.598+0000 7fc64ce90700 1 --2- 172.21.15.146:0/1534407506 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc648150b90 0x7fc64814bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:11.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.598+0000 7fc64ce90700 1 -- 172.21.15.146:0/1534407506 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6480ca330 msgr2=0x7fc6480acf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:11.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.598+0000 7fc64ce90700 1 --2- 172.21.15.146:0/1534407506 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6480ca330 0x7fc6480acf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:11.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.598+0000 7fc64ce90700 1 -- 172.21.15.146:0/1534407506 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6380093c0 con 0x7fc6480c97c0 2023-10-06T11:14:11.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.598+0000 7fc64ce90700 1 --2- 172.21.15.146:0/1534407506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6480c97c0 0x7fc648149d10 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fc64400e8d0 tx=0x7fc644008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:11.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.598+0000 7fc63cff9700 1 -- 172.21.15.146:0/1534407506 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc644013410 con 0x7fc6480c97c0 2023-10-06T11:14:11.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.598+0000 7fc63cff9700 1 -- 172.21.15.146:0/1534407506 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc644013570 con 0x7fc6480c97c0 2023-10-06T11:14:11.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.598+0000 7fc64f0f4700 1 -- 172.21.15.146:0/1534407506 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc64814acb0 con 0x7fc6480c97c0 2023-10-06T11:14:11.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.598+0000 7fc63cff9700 1 -- 172.21.15.146:0/1534407506 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc644013910 con 0x7fc6480c97c0 2023-10-06T11:14:11.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.598+0000 7fc64f0f4700 1 -- 172.21.15.146:0/1534407506 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6480ad450 con 0x7fc6480c97c0 2023-10-06T11:14:11.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.599+0000 7fc64f0f4700 1 -- 172.21.15.146:0/1534407506 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc64814d610 con 0x7fc6480c97c0 2023-10-06T11:14:11.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.600+0000 7fc63cff9700 1 -- 172.21.15.146:0/1534407506 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc644013d00 con 0x7fc6480c97c0 2023-10-06T11:14:11.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.600+0000 7fc63cff9700 1 --2- 172.21.15.146:0/1534407506 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc634066f30 0x7fc6340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:11.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.600+0000 7fc63cff9700 1 -- 172.21.15.146:0/1534407506 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fc6440840b0 con 0x7fc6480c97c0 2023-10-06T11:14:11.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.600+0000 7fc63ffff700 1 --2- 172.21.15.146:0/1534407506 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc634066f30 0x7fc6340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:11.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.601+0000 7fc63ffff700 1 --2- 172.21.15.146:0/1534407506 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc634066f30 0x7fc6340693e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc638009390 tx=0x7fc638016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:11.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.605+0000 7fc63cff9700 1 -- 172.21.15.146:0/1534407506 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc6440514c0 con 0x7fc6480c97c0 2023-10-06T11:14:11.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:11.865+0000 7fc64f0f4700 1 -- 172.21.15.146:0/1534407506 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]} v 0) v1 -- 0x7fc6480af340 con 0x7fc6480c97c0 2023-10-06T11:14:12.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.462+0000 7fc63cff9700 1 -- 172.21.15.146:0/1534407506 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]}]=0 v400) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc644054ae0 con 0x7fc6480c97c0 2023-10-06T11:14:12.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.465+0000 7fc64f0f4700 1 -- 172.21.15.146:0/1534407506 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc634066f30 msgr2=0x7fc6340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:12.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.465+0000 7fc64f0f4700 1 --2- 172.21.15.146:0/1534407506 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc634066f30 0x7fc6340693e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fc638009390 tx=0x7fc638016000 comp rx=0 tx=0).stop 2023-10-06T11:14:12.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.465+0000 7fc64f0f4700 1 -- 172.21.15.146:0/1534407506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6480c97c0 msgr2=0x7fc648149d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:12.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.465+0000 7fc64f0f4700 1 --2- 172.21.15.146:0/1534407506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6480c97c0 0x7fc648149d10 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fc64400e8d0 tx=0x7fc644008040 comp rx=0 tx=0).stop 2023-10-06T11:14:12.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.465+0000 7fc64f0f4700 1 -- 172.21.15.146:0/1534407506 shutdown_connections 2023-10-06T11:14:12.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.465+0000 7fc64f0f4700 1 --2- 172.21.15.146:0/1534407506 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc634066f30 0x7fc6340693e0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:12.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.465+0000 7fc64f0f4700 1 --2- 172.21.15.146:0/1534407506 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc648150b90 0x7fc64814bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:12.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.465+0000 7fc64f0f4700 1 --2- 172.21.15.146:0/1534407506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6480c97c0 0x7fc648149d10 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:12.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.465+0000 7fc64f0f4700 1 --2- 172.21.15.146:0/1534407506 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6480ca330 0x7fc6480acf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:12.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.465+0000 7fc64f0f4700 1 -- 172.21.15.146:0/1534407506 >> 172.21.15.146:0/1534407506 conn(0x7fc64806b060 msgr2=0x7fc64806e590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:12.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.465+0000 7fc64f0f4700 1 -- 172.21.15.146:0/1534407506 shutdown_connections 2023-10-06T11:14:12.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.465+0000 7fc64f0f4700 1 -- 172.21.15.146:0/1534407506 wait complete. 2023-10-06T11:14:12.483 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T11:14:12.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.605+0000 7fdf3e31b700 1 Processor -- start 2023-10-06T11:14:12.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.605+0000 7fdf3e31b700 1 -- start start 2023-10-06T11:14:12.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.606+0000 7fdf3e31b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdf3816a5c0 0x7fdf38169a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:12.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.606+0000 7fdf3e31b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf381695d0 con 0x7fdf380b1e70 2023-10-06T11:14:12.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.606+0000 7fdf3e31b700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf38168a00 con 0x7fdf3816a990 2023-10-06T11:14:12.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.606+0000 7fdf3e31b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf380aeb60 con 0x7fdf3816a5c0 2023-10-06T11:14:12.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.606+0000 7fdf3c8b8700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fdf380b1e70 0x7fdf38167cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38660/0 (socket says 172.21.15.146:38660) 2023-10-06T11:14:12.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.606+0000 7fdf37fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdf3816a5c0 0x7fdf38169a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:12.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.606+0000 7fdf3c8b8700 1 -- 172.21.15.146:0/1395446238 learned_addr learned my addr 172.21.15.146:0/1395446238 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:14:12.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.607+0000 7fdf36ffd700 1 -- 172.21.15.146:0/1395446238 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 84746175 0 0) 0x7fdf381695d0 con 0x7fdf380b1e70 2023-10-06T11:14:12.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.632+0000 7fdf36ffd700 1 -- 172.21.15.146:0/1395446238 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf20003550 con 0x7fdf380b1e70 2023-10-06T11:14:12.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.632+0000 7fdf36ffd700 1 -- 172.21.15.146:0/1395446238 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2172909772 0 0) 0x7fdf38168a00 con 0x7fdf3816a990 2023-10-06T11:14:12.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.632+0000 7fdf36ffd700 1 -- 172.21.15.146:0/1395446238 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf381695d0 con 0x7fdf3816a990 2023-10-06T11:14:12.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.632+0000 7fdf37fff700 1 -- 172.21.15.146:0/1395446238 >> v1:172.21.15.151:6789/0 conn(0x7fdf3816a990 legacy=0x7fdf380b1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:12.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.632+0000 7fdf37fff700 1 -- 172.21.15.146:0/1395446238 >> v1:172.21.15.146:6789/0 conn(0x7fdf380b1e70 legacy=0x7fdf38167cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:12.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.632+0000 7fdf37fff700 1 -- 172.21.15.146:0/1395446238 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf38168ca0 con 0x7fdf3816a5c0 2023-10-06T11:14:12.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.632+0000 7fdf37fff700 1 --2- 172.21.15.146:0/1395446238 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf3816a5c0 0x7fdf38169a60 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7fdf28009a20 tx=0x7fdf280090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b99724b37d7b41f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:12.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.632+0000 7fdf36ffd700 1 -- 172.21.15.146:0/1395446238 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2800b650 con 0x7fdf3816a5c0 2023-10-06T11:14:12.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.632+0000 7fdf36ffd700 1 -- 172.21.15.146:0/1395446238 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2800b7b0 con 0x7fdf3816a5c0 2023-10-06T11:14:12.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.632+0000 7fdf36ffd700 1 -- 172.21.15.146:0/1395446238 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2800bb70 con 0x7fdf3816a5c0 2023-10-06T11:14:12.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.633+0000 7fdf3e31b700 1 -- 172.21.15.146:0/1395446238 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf3816a5c0 msgr2=0x7fdf38169a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:12.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.633+0000 7fdf3e31b700 1 --2- 172.21.15.146:0/1395446238 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf3816a5c0 0x7fdf38169a60 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7fdf28009a20 tx=0x7fdf280090f0 comp rx=0 tx=0).stop 2023-10-06T11:14:12.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.633+0000 7fdf3e31b700 1 -- 172.21.15.146:0/1395446238 shutdown_connections 2023-10-06T11:14:12.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.633+0000 7fdf3e31b700 1 --2- 172.21.15.146:0/1395446238 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf3816a5c0 0x7fdf38169a60 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:12.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.633+0000 7fdf3e31b700 1 -- 172.21.15.146:0/1395446238 >> 172.21.15.146:0/1395446238 conn(0x7fdf38067f40 msgr2=0x7fdf380cc1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:12.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.633+0000 7fdf3e31b700 1 -- 172.21.15.146:0/1395446238 shutdown_connections 2023-10-06T11:14:12.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.633+0000 7fdf3e31b700 1 -- 172.21.15.146:0/1395446238 wait complete. 2023-10-06T11:14:12.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.634+0000 7fdf3e31b700 1 Processor -- start 2023-10-06T11:14:12.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.634+0000 7fdf3e31b700 1 -- start start 2023-10-06T11:14:12.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.635+0000 7fdf3e31b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf380b1e70 0x7fdf38087460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:12.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.635+0000 7fdf3e31b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf3816a5c0 0x7fdf380aa0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:12.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.635+0000 7fdf3e31b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf3816a990 0x7fdf380aa600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:12.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.635+0000 7fdf3e31b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf38176ca0 con 0x7fdf380b1e70 2023-10-06T11:14:12.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.635+0000 7fdf3e31b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf38176f80 con 0x7fdf3816a5c0 2023-10-06T11:14:12.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.635+0000 7fdf3e31b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf38177260 con 0x7fdf3816a990 2023-10-06T11:14:12.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.635+0000 7fdf37fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf380b1e70 0x7fdf38087460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:12.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.635+0000 7fdf37fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf380b1e70 0x7fdf38087460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35184/0 (socket says 172.21.15.146:35184) 2023-10-06T11:14:12.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.635+0000 7fdf37fff700 1 -- 172.21.15.146:0/2105821960 learned_addr learned my addr 172.21.15.146:0/2105821960 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:12.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.635+0000 7fdf377fe700 1 --2- 172.21.15.146:0/2105821960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf3816a5c0 0x7fdf380aa0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:12.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.635+0000 7fdf37fff700 1 -- 172.21.15.146:0/2105821960 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf3816a990 msgr2=0x7fdf380aa600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:12.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.635+0000 7fdf37fff700 1 --2- 172.21.15.146:0/2105821960 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf3816a990 0x7fdf380aa600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:12.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.635+0000 7fdf37fff700 1 -- 172.21.15.146:0/2105821960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf3816a5c0 msgr2=0x7fdf380aa0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:12.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.635+0000 7fdf37fff700 1 --2- 172.21.15.146:0/2105821960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf3816a5c0 0x7fdf380aa0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:12.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.635+0000 7fdf37fff700 1 -- 172.21.15.146:0/2105821960 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf28009560 con 0x7fdf380b1e70 2023-10-06T11:14:12.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.635+0000 7fdf377fe700 1 --2- 172.21.15.146:0/2105821960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf3816a5c0 0x7fdf380aa0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:12.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.635+0000 7fdf37fff700 1 --2- 172.21.15.146:0/2105821960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf380b1e70 0x7fdf38087460 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fdf28009320 tx=0x7fdf28017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:12.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.635+0000 7fdf1ffff700 1 -- 172.21.15.146:0/2105821960 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2801e070 con 0x7fdf380b1e70 2023-10-06T11:14:12.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.635+0000 7fdf1ffff700 1 -- 172.21.15.146:0/2105821960 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf28000cc0 con 0x7fdf380b1e70 2023-10-06T11:14:12.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.635+0000 7fdf3e31b700 1 -- 172.21.15.146:0/2105821960 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf38177540 con 0x7fdf380b1e70 2023-10-06T11:14:12.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.635+0000 7fdf1ffff700 1 -- 172.21.15.146:0/2105821960 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf28010690 con 0x7fdf380b1e70 2023-10-06T11:14:12.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.636+0000 7fdf3e31b700 1 -- 172.21.15.146:0/2105821960 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf38176990 con 0x7fdf380b1e70 2023-10-06T11:14:12.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.636+0000 7fdf3e31b700 1 -- 172.21.15.146:0/2105821960 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf3804c380 con 0x7fdf380b1e70 2023-10-06T11:14:12.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.637+0000 7fdf1ffff700 1 -- 172.21.15.146:0/2105821960 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdf28010ac0 con 0x7fdf380b1e70 2023-10-06T11:14:12.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.637+0000 7fdf1ffff700 1 --2- 172.21.15.146:0/2105821960 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdf24066f30 0x7fdf240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:12.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.637+0000 7fdf1ffff700 1 -- 172.21.15.146:0/2105821960 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fdf280857a0 con 0x7fdf380b1e70 2023-10-06T11:14:12.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.637+0000 7fdf377fe700 1 --2- 172.21.15.146:0/2105821960 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdf24066f30 0x7fdf240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:12.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.638+0000 7fdf377fe700 1 --2- 172.21.15.146:0/2105821960 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdf24066f30 0x7fdf240693e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c007fd0 tx=0x7fdf2c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:12.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.642+0000 7fdf1ffff700 1 -- 172.21.15.146:0/2105821960 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdf28052b10 con 0x7fdf380b1e70 2023-10-06T11:14:12.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.825+0000 7fdf3e31b700 1 -- 172.21.15.146:0/2105821960 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fdf38168f80 con 0x7fdf380b1e70 2023-10-06T11:14:12.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.831+0000 7fdf1ffff700 1 -- 172.21.15.146:0/2105821960 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdf2800bb30 con 0x7fdf380b1e70 2023-10-06T11:14:12.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.833+0000 7fdf3e31b700 1 -- 172.21.15.146:0/2105821960 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdf24066f30 msgr2=0x7fdf240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:12.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.834+0000 7fdf3e31b700 1 --2- 172.21.15.146:0/2105821960 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdf24066f30 0x7fdf240693e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c007fd0 tx=0x7fdf2c009040 comp rx=0 tx=0).stop 2023-10-06T11:14:12.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.834+0000 7fdf3e31b700 1 -- 172.21.15.146:0/2105821960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf380b1e70 msgr2=0x7fdf38087460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:12.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.834+0000 7fdf3e31b700 1 --2- 172.21.15.146:0/2105821960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf380b1e70 0x7fdf38087460 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fdf28009320 tx=0x7fdf28017000 comp rx=0 tx=0).stop 2023-10-06T11:14:12.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.834+0000 7fdf3e31b700 1 -- 172.21.15.146:0/2105821960 shutdown_connections 2023-10-06T11:14:12.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.834+0000 7fdf3e31b700 1 --2- 172.21.15.146:0/2105821960 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdf24066f30 0x7fdf240693e0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:12.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.834+0000 7fdf3e31b700 1 --2- 172.21.15.146:0/2105821960 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdf3816a990 0x7fdf380aa600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:12.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.834+0000 7fdf3e31b700 1 --2- 172.21.15.146:0/2105821960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdf380b1e70 0x7fdf38087460 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:12.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.834+0000 7fdf3e31b700 1 --2- 172.21.15.146:0/2105821960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf3816a5c0 0x7fdf380aa0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:12.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.834+0000 7fdf3e31b700 1 -- 172.21.15.146:0/2105821960 >> 172.21.15.146:0/2105821960 conn(0x7fdf38067f40 msgr2=0x7fdf38160b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:12.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.834+0000 7fdf3e31b700 1 -- 172.21.15.146:0/2105821960 shutdown_connections 2023-10-06T11:14:12.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:12.834+0000 7fdf3e31b700 1 -- 172.21.15.146:0/2105821960 wait complete. 2023-10-06T11:14:12.848 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T11:14:12.848 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:14:12.893 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:14:12.937 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T11:14:12.937 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T11:14:12.938 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:14:13.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.051+0000 7f1bae4c2700 1 Processor -- start 2023-10-06T11:14:13.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.051+0000 7f1bae4c2700 1 -- start start 2023-10-06T11:14:13.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.052+0000 7f1bae4c2700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1ba8157430 0x7f1ba8157800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:13.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.052+0000 7f1bae4c2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1ba80ab010 0x7f1ba80ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:13.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.052+0000 7f1bae4c2700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ba80cc240 0x7f1ba80cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:13.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.052+0000 7f1bae4c2700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ba80c3dd0 con 0x7f1ba80ab010 2023-10-06T11:14:13.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.052+0000 7f1bae4c2700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ba80cf0b0 con 0x7f1ba8157430 2023-10-06T11:14:13.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.052+0000 7f1bae4c2700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba80ccf20 con 0x7f1ba80cc240 2023-10-06T11:14:13.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.052+0000 7f1ba77fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1ba80ab010 0x7f1ba80ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:13.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.052+0000 7f1ba77fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1ba80ab010 0x7f1ba80ceb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35186/0 (socket says 172.21.15.146:35186) 2023-10-06T11:14:13.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.052+0000 7f1ba77fe700 1 -- 172.21.15.146:0/1634570553 learned_addr learned my addr 172.21.15.146:0/1634570553 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:13.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.053+0000 7f1ba7fff700 1 --2- 172.21.15.146:0/1634570553 >> v2:172.21.15.151:3300/0 conn(0x7f1ba8157430 0x7f1ba8157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:13.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.053+0000 7f1baca5f700 1 --2- 172.21.15.146:0/1634570553 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ba80cc240 0x7f1ba80cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:13.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.053+0000 7f1ba77fe700 1 -- 172.21.15.146:0/1634570553 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ba80cc240 msgr2=0x7f1ba80cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:13.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.053+0000 7f1ba77fe700 1 --2- 172.21.15.146:0/1634570553 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ba80cc240 0x7f1ba80cc6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:13.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.053+0000 7f1ba77fe700 1 -- 172.21.15.146:0/1634570553 >> v2:172.21.15.151:3300/0 conn(0x7f1ba8157430 msgr2=0x7f1ba8157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:13.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.053+0000 7f1ba77fe700 1 --2- 172.21.15.146:0/1634570553 >> v2:172.21.15.151:3300/0 conn(0x7f1ba8157430 0x7f1ba8157800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:13.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.053+0000 7f1ba77fe700 1 -- 172.21.15.146:0/1634570553 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba80cd200 con 0x7f1ba80ab010 2023-10-06T11:14:13.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.053+0000 7f1ba77fe700 1 --2- 172.21.15.146:0/1634570553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ba80ab010 0x7f1ba80ceb70 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f1ba806eec0 tx=0x7f1b9c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc81e43d955ad48a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:13.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.053+0000 7f1ba6ffd700 1 -- 172.21.15.146:0/1634570553 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c00b860 con 0x7f1ba80ab010 2023-10-06T11:14:13.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.053+0000 7f1ba6ffd700 1 -- 172.21.15.146:0/1634570553 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b9c00b9c0 con 0x7f1ba80ab010 2023-10-06T11:14:13.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.053+0000 7f1ba6ffd700 1 -- 172.21.15.146:0/1634570553 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c00bd80 con 0x7f1ba80ab010 2023-10-06T11:14:13.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.054+0000 7f1bae4c2700 1 -- 172.21.15.146:0/1634570553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ba80ab010 msgr2=0x7f1ba80ceb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:13.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.054+0000 7f1bae4c2700 1 --2- 172.21.15.146:0/1634570553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ba80ab010 0x7f1ba80ceb70 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f1ba806eec0 tx=0x7f1b9c009250 comp rx=0 tx=0).stop 2023-10-06T11:14:13.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.054+0000 7f1bae4c2700 1 -- 172.21.15.146:0/1634570553 shutdown_connections 2023-10-06T11:14:13.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.054+0000 7f1bae4c2700 1 --2- 172.21.15.146:0/1634570553 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ba80cc240 0x7f1ba80cc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:13.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.054+0000 7f1bae4c2700 1 --2- 172.21.15.146:0/1634570553 >> v2:172.21.15.151:3300/0 conn(0x7f1ba8157430 0x7f1ba8157800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:13.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.054+0000 7f1bae4c2700 1 --2- 172.21.15.146:0/1634570553 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ba80ab010 0x7f1ba80ceb70 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:13.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.054+0000 7f1bae4c2700 1 -- 172.21.15.146:0/1634570553 >> 172.21.15.146:0/1634570553 conn(0x7f1ba8067c50 msgr2=0x7f1ba80ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:13.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.054+0000 7f1bae4c2700 1 -- 172.21.15.146:0/1634570553 shutdown_connections 2023-10-06T11:14:13.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.054+0000 7f1bae4c2700 1 -- 172.21.15.146:0/1634570553 wait complete. 2023-10-06T11:14:13.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.055+0000 7f1bae4c2700 1 Processor -- start 2023-10-06T11:14:13.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.055+0000 7f1bae4c2700 1 -- start start 2023-10-06T11:14:13.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.056+0000 7f1bae4c2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ba80ab010 0x7f1ba8145e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:13.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.056+0000 7f1bae4c2700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ba80cc240 0x7f1ba80abf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:13.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.056+0000 7f1bae4c2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ba8157430 0x7f1ba80ac440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:13.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.056+0000 7f1bae4c2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba8153a50 con 0x7f1ba8157430 2023-10-06T11:14:13.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.056+0000 7f1bae4c2700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba815c8f0 con 0x7f1ba80ab010 2023-10-06T11:14:13.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.056+0000 7f1bae4c2700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba815bce0 con 0x7f1ba80cc240 2023-10-06T11:14:13.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.056+0000 7f1baca5f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ba8157430 0x7f1ba80ac440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:13.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.056+0000 7f1baca5f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ba8157430 0x7f1ba80ac440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35198/0 (socket says 172.21.15.146:35198) 2023-10-06T11:14:13.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.056+0000 7f1ba77fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ba80cc240 0x7f1ba80abf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:13.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.056+0000 7f1ba7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ba80ab010 0x7f1ba8145e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:13.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.056+0000 7f1baca5f700 1 -- 172.21.15.146:0/130655879 learned_addr learned my addr 172.21.15.146:0/130655879 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:13.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.056+0000 7f1baca5f700 1 -- 172.21.15.146:0/130655879 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ba80cc240 msgr2=0x7f1ba80abf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:13.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.056+0000 7f1baca5f700 1 --2- 172.21.15.146:0/130655879 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ba80cc240 0x7f1ba80abf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:13.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.056+0000 7f1baca5f700 1 -- 172.21.15.146:0/130655879 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ba80ab010 msgr2=0x7f1ba8145e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:13.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.056+0000 7f1baca5f700 1 --2- 172.21.15.146:0/130655879 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ba80ab010 0x7f1ba8145e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:13.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.056+0000 7f1baca5f700 1 -- 172.21.15.146:0/130655879 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b9c0094f0 con 0x7f1ba8157430 2023-10-06T11:14:13.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.056+0000 7f1baca5f700 1 --2- 172.21.15.146:0/130655879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ba8157430 0x7f1ba80ac440 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0009fa0 tx=0x7f1ba0009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:13.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.056+0000 7f1b8ffff700 1 -- 172.21.15.146:0/130655879 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba000ebc0 con 0x7f1ba8157430 2023-10-06T11:14:13.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.056+0000 7f1b8ffff700 1 -- 172.21.15.146:0/130655879 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ba000ed20 con 0x7f1ba8157430 2023-10-06T11:14:13.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.056+0000 7f1bae4c2700 1 -- 172.21.15.146:0/130655879 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ba815bfc0 con 0x7f1ba8157430 2023-10-06T11:14:13.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.057+0000 7f1b8ffff700 1 -- 172.21.15.146:0/130655879 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba0014670 con 0x7f1ba8157430 2023-10-06T11:14:13.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.057+0000 7f1bae4c2700 1 -- 172.21.15.146:0/130655879 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ba815c580 con 0x7f1ba8157430 2023-10-06T11:14:13.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.057+0000 7f1bae4c2700 1 -- 172.21.15.146:0/130655879 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ba80ad840 con 0x7f1ba8157430 2023-10-06T11:14:13.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.058+0000 7f1b8ffff700 1 -- 172.21.15.146:0/130655879 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1ba00149e0 con 0x7f1ba8157430 2023-10-06T11:14:13.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.058+0000 7f1b8ffff700 1 --2- 172.21.15.146:0/130655879 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1b94066f30 0x7f1b940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:13.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.058+0000 7f1b8ffff700 1 -- 172.21.15.146:0/130655879 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f1ba00849f0 con 0x7f1ba8157430 2023-10-06T11:14:13.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.058+0000 7f1ba7fff700 1 --2- 172.21.15.146:0/130655879 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1b94066f30 0x7f1b940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:13.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.059+0000 7f1ba7fff700 1 --2- 172.21.15.146:0/130655879 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1b94066f30 0x7f1b940693e0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f1b98006fd0 tx=0x7f1b98008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:13.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.063+0000 7f1b8ffff700 1 -- 172.21.15.146:0/130655879 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1ba0051e00 con 0x7f1ba8157430 2023-10-06T11:14:13.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.287+0000 7f1bae4c2700 1 -- 172.21.15.146:0/130655879 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ba804c380 con 0x7f1ba8157430 2023-10-06T11:14:13.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.288+0000 7f1b8ffff700 1 -- 172.21.15.146:0/130655879 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+3538 (secure 0 0 0) 0x7f1ba0055420 con 0x7f1ba8157430 2023-10-06T11:14:13.290 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:13.290 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":95,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6239,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/2159562091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2159562091},{"type":"v1","addr":"172.21.15.151:6834","nonce":2159562091}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6242,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/603782012","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":603782012},{"type":"v1","addr":"172.21.15.151:6835","nonce":603782012}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6916,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3416056259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":3416056259},{"type":"v1","addr":"172.21.15.146:6837","nonce":3416056259}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":8037,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2899853034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2899853034},{"type":"v1","addr":"172.21.15.146:6835","nonce":2899853034}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":95}],"filesystems":[]} 2023-10-06T11:14:13.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.290+0000 7f1bae4c2700 1 -- 172.21.15.146:0/130655879 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1b94066f30 msgr2=0x7f1b940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:13.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.290+0000 7f1bae4c2700 1 --2- 172.21.15.146:0/130655879 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1b94066f30 0x7f1b940693e0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f1b98006fd0 tx=0x7f1b98008040 comp rx=0 tx=0).stop 2023-10-06T11:14:13.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.290+0000 7f1bae4c2700 1 -- 172.21.15.146:0/130655879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ba8157430 msgr2=0x7f1ba80ac440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:13.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.290+0000 7f1bae4c2700 1 --2- 172.21.15.146:0/130655879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ba8157430 0x7f1ba80ac440 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0009fa0 tx=0x7f1ba0009900 comp rx=0 tx=0).stop 2023-10-06T11:14:13.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.290+0000 7f1bae4c2700 1 -- 172.21.15.146:0/130655879 shutdown_connections 2023-10-06T11:14:13.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.290+0000 7f1bae4c2700 1 --2- 172.21.15.146:0/130655879 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1b94066f30 0x7f1b940693e0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:13.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.290+0000 7f1bae4c2700 1 --2- 172.21.15.146:0/130655879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1ba8157430 0x7f1ba80ac440 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:13.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.290+0000 7f1bae4c2700 1 --2- 172.21.15.146:0/130655879 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ba80ab010 0x7f1ba8145e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:13.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.290+0000 7f1bae4c2700 1 --2- 172.21.15.146:0/130655879 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1ba80cc240 0x7f1ba80abf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:13.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.290+0000 7f1bae4c2700 1 -- 172.21.15.146:0/130655879 >> 172.21.15.146:0/130655879 conn(0x7f1ba8067c50 msgr2=0x7f1ba815d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:13.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.290+0000 7f1bae4c2700 1 -- 172.21.15.146:0/130655879 shutdown_connections 2023-10-06T11:14:13.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.291+0000 7f1bae4c2700 1 -- 172.21.15.146:0/130655879 wait complete. 2023-10-06T11:14:13.294 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 95 2023-10-06T11:14:13.305 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T11:14:13.305 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T11:14:13.306 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T11:14:13.306 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:14:13.306 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T11:14:13.306 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T11:14:13.306 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T11:14:13.307 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:14:13.307 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T11:14:13.307 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T11:14:13.307 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T11:14:13.307 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:14:13.307 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T11:14:13.308 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T11:14:13.308 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T11:14:13.308 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:14:13.315 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T11:14:13.315 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T11:14:13.316 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T11:14:13.316 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T11:14:13.318 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T11:14:13.318 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T11:14:13.319 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T11:14:13.319 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T11:14:13.358 INFO:tasks.ceph.mds.a:Started 2023-10-06T11:14:13.358 DEBUG:teuthology.parallel:result is None 2023-10-06T11:14:13.359 INFO:tasks.ceph.mds.c:Started 2023-10-06T11:14:13.359 DEBUG:teuthology.parallel:result is None 2023-10-06T11:14:13.361 INFO:tasks.ceph.mds.b:Started 2023-10-06T11:14:13.361 DEBUG:teuthology.parallel:result is None 2023-10-06T11:14:13.362 INFO:tasks.ceph.mds.d:Started 2023-10-06T11:14:13.362 DEBUG:teuthology.parallel:result is None 2023-10-06T11:14:13.362 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T11:14:13.431 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2023-10-06T11:14:13.432 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2023-10-06T11:14:13.446 INFO:tasks.ceph.mds.d.smithi151.stdout:starting mds.d at 2023-10-06T11:14:13.446 INFO:tasks.ceph.mds.b.smithi151.stdout:starting mds.b at 2023-10-06T11:14:13.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.483+0000 7f293d8ea700 1 Processor -- start 2023-10-06T11:14:13.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.484+0000 7f293d8ea700 1 -- start start 2023-10-06T11:14:13.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.484+0000 7f293d8ea700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f29380b2620 0x7f293806e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:13.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.484+0000 7f293d8ea700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f29381571d0 0x7f2938157630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:13.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.484+0000 7f293d8ea700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29380cb3c0 con 0x7f29380b29f0 2023-10-06T11:14:13.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.484+0000 7f293d8ea700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f293806fa70 con 0x7f29381571d0 2023-10-06T11:14:13.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.484+0000 7f293d8ea700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2938157b70 con 0x7f29380b2620 2023-10-06T11:14:13.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.485+0000 7f29377fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f29381571d0 0x7f2938157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:13.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.485+0000 7f29377fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f29381571d0 0x7f2938157630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35226/0 (socket says 172.21.15.146:35226) 2023-10-06T11:14:13.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.485+0000 7f29377fe700 1 -- 172.21.15.146:0/1228473997 learned_addr learned my addr 172.21.15.146:0/1228473997 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:13.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.485+0000 7f2936ffd700 1 --2- 172.21.15.146:0/1228473997 >> v2:172.21.15.151:3300/0 conn(0x7f29380b2620 0x7f293806e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:13.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.485+0000 7f29377fe700 1 -- 172.21.15.146:0/1228473997 >> v2:172.21.15.151:3300/0 conn(0x7f29380b2620 msgr2=0x7f293806e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:13.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.485+0000 7f29377fe700 1 --2- 172.21.15.146:0/1228473997 >> v2:172.21.15.151:3300/0 conn(0x7f29380b2620 0x7f293806e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:13.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.485+0000 7f29377fe700 1 -- 172.21.15.146:0/1228473997 >> v1:172.21.15.151:6789/0 conn(0x7f29380b29f0 legacy=0x7f293815bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:13.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.485+0000 7f29377fe700 1 -- 172.21.15.146:0/1228473997 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f293806eef0 con 0x7f29381571d0 2023-10-06T11:14:13.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.485+0000 7f29377fe700 1 --2- 172.21.15.146:0/1228473997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29381571d0 0x7f2938157630 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f29380ce410 tx=0x7f2930009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f77ef8f3856f65 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:13.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.485+0000 7f2935ffb700 1 -- 172.21.15.146:0/1228473997 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293000e070 con 0x7f29381571d0 2023-10-06T11:14:13.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.485+0000 7f2935ffb700 1 -- 172.21.15.146:0/1228473997 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293000ba20 con 0x7f29381571d0 2023-10-06T11:14:13.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.485+0000 7f2935ffb700 1 -- 172.21.15.146:0/1228473997 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29300092e0 con 0x7f29381571d0 2023-10-06T11:14:13.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.486+0000 7f293d8ea700 1 -- 172.21.15.146:0/1228473997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29381571d0 msgr2=0x7f2938157630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:13.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.486+0000 7f293d8ea700 1 --2- 172.21.15.146:0/1228473997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29381571d0 0x7f2938157630 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f29380ce410 tx=0x7f2930009840 comp rx=0 tx=0).stop 2023-10-06T11:14:13.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.486+0000 7f293d8ea700 1 -- 172.21.15.146:0/1228473997 shutdown_connections 2023-10-06T11:14:13.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.486+0000 7f293d8ea700 1 --2- 172.21.15.146:0/1228473997 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29381571d0 0x7f2938157630 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:13.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.486+0000 7f293d8ea700 1 --2- 172.21.15.146:0/1228473997 >> v2:172.21.15.151:3300/0 conn(0x7f29380b2620 0x7f293806e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:13.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.486+0000 7f293d8ea700 1 -- 172.21.15.146:0/1228473997 >> 172.21.15.146:0/1228473997 conn(0x7f2938068580 msgr2=0x7f2938068980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:13.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.486+0000 7f293d8ea700 1 -- 172.21.15.146:0/1228473997 shutdown_connections 2023-10-06T11:14:13.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.486+0000 7f293d8ea700 1 -- 172.21.15.146:0/1228473997 wait complete. 2023-10-06T11:14:13.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.487+0000 7f293d8ea700 1 Processor -- start 2023-10-06T11:14:13.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.487+0000 7f293d8ea700 1 -- start start 2023-10-06T11:14:13.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.488+0000 7f293d8ea700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29380b2620 0x7f29380c2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:13.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.488+0000 7f293d8ea700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29380b29f0 0x7f293815a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:13.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.488+0000 7f293d8ea700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29381571d0 0x7f2938158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:13.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.488+0000 7f293d8ea700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29381592a0 con 0x7f29380b29f0 2023-10-06T11:14:13.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.488+0000 7f293d8ea700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f293815a0e0 con 0x7f29381571d0 2023-10-06T11:14:13.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.488+0000 7f293d8ea700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29381594d0 con 0x7f29380b2620 2023-10-06T11:14:13.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.488+0000 7f29367fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29380b29f0 0x7f293815a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:13.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.488+0000 7f2936ffd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29380b2620 0x7f29380c2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:13.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.488+0000 7f29377fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29381571d0 0x7f2938158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:13.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.488+0000 7f29367fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29380b29f0 0x7f293815a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35238/0 (socket says 172.21.15.146:35238) 2023-10-06T11:14:13.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.488+0000 7f29367fc700 1 -- 172.21.15.146:0/3817739202 learned_addr learned my addr 172.21.15.146:0/3817739202 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:13.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.488+0000 7f29367fc700 1 -- 172.21.15.146:0/3817739202 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29380b2620 msgr2=0x7f29380c2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:13.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.488+0000 7f29367fc700 1 --2- 172.21.15.146:0/3817739202 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29380b2620 0x7f29380c2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:13.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.488+0000 7f29367fc700 1 -- 172.21.15.146:0/3817739202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29381571d0 msgr2=0x7f2938158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:13.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.488+0000 7f29367fc700 1 --2- 172.21.15.146:0/3817739202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29381571d0 0x7f2938158d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:13.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.488+0000 7f29367fc700 1 -- 172.21.15.146:0/3817739202 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2930009ae0 con 0x7f29380b29f0 2023-10-06T11:14:13.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.488+0000 7f29377fe700 1 --2- 172.21.15.146:0/3817739202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29381571d0 0x7f2938158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:14:13.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.489+0000 7f29367fc700 1 --2- 172.21.15.146:0/3817739202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29380b29f0 0x7f293815a570 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f292c00c590 tx=0x7f292c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:13.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.489+0000 7f291effd700 1 -- 172.21.15.146:0/3817739202 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292c011590 con 0x7f29380b29f0 2023-10-06T11:14:13.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.489+0000 7f291effd700 1 -- 172.21.15.146:0/3817739202 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f292c011710 con 0x7f29380b29f0 2023-10-06T11:14:13.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.489+0000 7f293d8ea700 1 -- 172.21.15.146:0/3817739202 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29381597b0 con 0x7f29380b29f0 2023-10-06T11:14:13.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.489+0000 7f291effd700 1 -- 172.21.15.146:0/3817739202 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292c011ad0 con 0x7f29380b29f0 2023-10-06T11:14:13.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.489+0000 7f293d8ea700 1 -- 172.21.15.146:0/3817739202 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2938159d70 con 0x7f29380b29f0 2023-10-06T11:14:13.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.490+0000 7f293d8ea700 1 -- 172.21.15.146:0/3817739202 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f293815a290 con 0x7f29380b29f0 2023-10-06T11:14:13.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.490+0000 7f291effd700 1 -- 172.21.15.146:0/3817739202 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f292c01b3b0 con 0x7f29380b29f0 2023-10-06T11:14:13.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.490+0000 7f291effd700 1 --2- 172.21.15.146:0/3817739202 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2924066f30 0x7f29240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:13.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.491+0000 7f291effd700 1 -- 172.21.15.146:0/3817739202 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f292c0837c0 con 0x7f29380b29f0 2023-10-06T11:14:13.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.491+0000 7f2936ffd700 1 --2- 172.21.15.146:0/3817739202 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2924066f30 0x7f29240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:13.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.491+0000 7f2936ffd700 1 --2- 172.21.15.146:0/3817739202 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2924066f30 0x7f29240693e0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2928009db0 tx=0x7f29280091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:13.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.495+0000 7f291effd700 1 -- 172.21.15.146:0/3817739202 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f293815a290 con 0x7f29380b29f0 2023-10-06T11:14:13.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:13.695+0000 7f293d8ea700 1 -- 172.21.15.146:0/3817739202 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f293815a250 con 0x7f29380b29f0 2023-10-06T11:14:14.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.486+0000 7f291effd700 1 -- 172.21.15.146:0/3817739202 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v109) v1 ==== 97+0+0 (secure 0 0 0) 0x7f292c017020 con 0x7f29380b29f0 2023-10-06T11:14:14.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.489+0000 7f293d8ea700 1 -- 172.21.15.146:0/3817739202 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2924066f30 msgr2=0x7f29240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:14.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.489+0000 7f293d8ea700 1 --2- 172.21.15.146:0/3817739202 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2924066f30 0x7f29240693e0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2928009db0 tx=0x7f29280091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:14.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.489+0000 7f293d8ea700 1 -- 172.21.15.146:0/3817739202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29380b29f0 msgr2=0x7f293815a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:14.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.489+0000 7f293d8ea700 1 --2- 172.21.15.146:0/3817739202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29380b29f0 0x7f293815a570 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f292c00c590 tx=0x7f292c00c8a0 comp rx=0 tx=0).stop 2023-10-06T11:14:14.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.489+0000 7f293d8ea700 1 -- 172.21.15.146:0/3817739202 shutdown_connections 2023-10-06T11:14:14.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.489+0000 7f293d8ea700 1 --2- 172.21.15.146:0/3817739202 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2924066f30 0x7f29240693e0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:14.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.489+0000 7f293d8ea700 1 --2- 172.21.15.146:0/3817739202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29381571d0 0x7f2938158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:14.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.489+0000 7f293d8ea700 1 --2- 172.21.15.146:0/3817739202 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29380b2620 0x7f29380c2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:14.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.489+0000 7f293d8ea700 1 --2- 172.21.15.146:0/3817739202 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f29380b29f0 0x7f293815a570 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:14.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.489+0000 7f293d8ea700 1 -- 172.21.15.146:0/3817739202 >> 172.21.15.146:0/3817739202 conn(0x7f2938068580 msgr2=0x7f2938153c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:14.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.489+0000 7f293d8ea700 1 -- 172.21.15.146:0/3817739202 shutdown_connections 2023-10-06T11:14:14.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.489+0000 7f293d8ea700 1 -- 172.21.15.146:0/3817739202 wait complete. 2023-10-06T11:14:14.492 INFO:teuthology.orchestra.run.smithi146.stderr: removed all blocklist entries 2023-10-06T11:14:14.503 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T11:14:14.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.616+0000 7f6f46729700 1 Processor -- start 2023-10-06T11:14:14.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.616+0000 7f6f46729700 1 -- start start 2023-10-06T11:14:14.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.617+0000 7f6f46729700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6f40156230 0x7f6f400c8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:14.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.617+0000 7f6f46729700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f4015a500 0x7f6f400caf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:14.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.617+0000 7f6f46729700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f400c8a30 con 0x7f6f4006ae20 2023-10-06T11:14:14.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.617+0000 7f6f46729700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f400c8d10 con 0x7f6f40156230 2023-10-06T11:14:14.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.617+0000 7f6f46729700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f400c8ff0 con 0x7f6f4015a500 2023-10-06T11:14:14.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.617+0000 7f6f45727700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6f40156230 0x7f6f400c8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:14.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.617+0000 7f6f45f28700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f4015a500 0x7f6f400caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:14.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.617+0000 7f6f44f26700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f6f4006ae20 0x7f6f40159df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:53484/0 (socket says 172.21.15.146:53484) 2023-10-06T11:14:14.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.617+0000 7f6f44f26700 1 -- 172.21.15.146:0/4249456369 learned_addr learned my addr 172.21.15.146:0/4249456369 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:14:14.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.617+0000 7f6f45727700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6f40156230 0x7f6f400c8390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:40668/0 (socket says 172.21.15.146:40668) 2023-10-06T11:14:14.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.618+0000 7f6f45727700 1 -- 172.21.15.146:0/4249456369 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f4015a500 msgr2=0x7f6f400caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:14.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.618+0000 7f6f45727700 1 --2- 172.21.15.146:0/4249456369 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f4015a500 0x7f6f400caf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:14.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.618+0000 7f6f45727700 1 -- 172.21.15.146:0/4249456369 >> v1:172.21.15.151:6789/0 conn(0x7f6f4006ae20 legacy=0x7f6f40159df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:14.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.618+0000 7f6f45727700 1 -- 172.21.15.146:0/4249456369 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f400c92d0 con 0x7f6f40156230 2023-10-06T11:14:14.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.618+0000 7f6f45f28700 1 --2- 172.21.15.146:0/4249456369 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f4015a500 0x7f6f400caf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:14:14.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.618+0000 7f6f45727700 1 --2- 172.21.15.146:0/4249456369 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f40156230 0x7f6f400c8390 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c0098e0 tx=0x7f6f3c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26c1bd8257faf8a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:14.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.618+0000 7f6f37fff700 1 -- 172.21.15.146:0/4249456369 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c00b640 con 0x7f6f40156230 2023-10-06T11:14:14.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.618+0000 7f6f37fff700 1 -- 172.21.15.146:0/4249456369 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f3c00b7a0 con 0x7f6f40156230 2023-10-06T11:14:14.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.618+0000 7f6f37fff700 1 -- 172.21.15.146:0/4249456369 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c00bb40 con 0x7f6f40156230 2023-10-06T11:14:14.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.619+0000 7f6f46729700 1 -- 172.21.15.146:0/4249456369 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f40156230 msgr2=0x7f6f400c8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:14.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.619+0000 7f6f46729700 1 --2- 172.21.15.146:0/4249456369 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f40156230 0x7f6f400c8390 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c0098e0 tx=0x7f6f3c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:14.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.619+0000 7f6f46729700 1 -- 172.21.15.146:0/4249456369 shutdown_connections 2023-10-06T11:14:14.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.619+0000 7f6f46729700 1 --2- 172.21.15.146:0/4249456369 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f4015a500 0x7f6f400caf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:14.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.619+0000 7f6f46729700 1 --2- 172.21.15.146:0/4249456369 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f40156230 0x7f6f400c8390 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:14.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.619+0000 7f6f46729700 1 -- 172.21.15.146:0/4249456369 >> 172.21.15.146:0/4249456369 conn(0x7f6f40069010 msgr2=0x7f6f400cd120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:14.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.619+0000 7f6f46729700 1 -- 172.21.15.146:0/4249456369 shutdown_connections 2023-10-06T11:14:14.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.619+0000 7f6f46729700 1 -- 172.21.15.146:0/4249456369 wait complete. 2023-10-06T11:14:14.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.620+0000 7f6f46729700 1 Processor -- start 2023-10-06T11:14:14.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.620+0000 7f6f46729700 1 -- start start 2023-10-06T11:14:14.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.621+0000 7f6f46729700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f4006ae20 0x7f6f40166310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:14.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.621+0000 7f6f46729700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f40156230 0x7f6f400b1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:14.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.621+0000 7f6f46729700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f4015a500 0x7f6f400ae600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:14.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.621+0000 7f6f46729700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f400ad740 con 0x7f6f4015a500 2023-10-06T11:14:14.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.621+0000 7f6f46729700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f40166850 con 0x7f6f4006ae20 2023-10-06T11:14:14.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.621+0000 7f6f46729700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f400b1e50 con 0x7f6f40156230 2023-10-06T11:14:14.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.621+0000 7f6f45f28700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f4015a500 0x7f6f400ae600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:14.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.621+0000 7f6f45f28700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f4015a500 0x7f6f400ae600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35250/0 (socket says 172.21.15.146:35250) 2023-10-06T11:14:14.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.621+0000 7f6f45f28700 1 -- 172.21.15.146:0/3632257660 learned_addr learned my addr 172.21.15.146:0/3632257660 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:14.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.621+0000 7f6f45727700 1 --2- 172.21.15.146:0/3632257660 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f4006ae20 0x7f6f40166310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:14.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.621+0000 7f6f44f26700 1 --2- 172.21.15.146:0/3632257660 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f40156230 0x7f6f400b1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:14.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.621+0000 7f6f45f28700 1 -- 172.21.15.146:0/3632257660 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f40156230 msgr2=0x7f6f400b1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:14.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.621+0000 7f6f45f28700 1 --2- 172.21.15.146:0/3632257660 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f40156230 0x7f6f400b1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:14.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.621+0000 7f6f45f28700 1 -- 172.21.15.146:0/3632257660 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f4006ae20 msgr2=0x7f6f40166310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:14.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.621+0000 7f6f45f28700 1 --2- 172.21.15.146:0/3632257660 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f4006ae20 0x7f6f40166310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:14.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.621+0000 7f6f45f28700 1 -- 172.21.15.146:0/3632257660 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f3800bc30 con 0x7f6f4015a500 2023-10-06T11:14:14.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.622+0000 7f6f45f28700 1 --2- 172.21.15.146:0/3632257660 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f4015a500 0x7f6f400ae600 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f6f3800e1c0 tx=0x7f6f3800d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:14.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.622+0000 7f6f357fa700 1 -- 172.21.15.146:0/3632257660 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3800b2e0 con 0x7f6f4015a500 2023-10-06T11:14:14.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.622+0000 7f6f357fa700 1 -- 172.21.15.146:0/3632257660 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f38011040 con 0x7f6f4015a500 2023-10-06T11:14:14.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.622+0000 7f6f46729700 1 -- 172.21.15.146:0/3632257660 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f3c009420 con 0x7f6f4015a500 2023-10-06T11:14:14.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.622+0000 7f6f357fa700 1 -- 172.21.15.146:0/3632257660 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3800ece0 con 0x7f6f4015a500 2023-10-06T11:14:14.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.622+0000 7f6f46729700 1 -- 172.21.15.146:0/3632257660 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f400ace10 con 0x7f6f4015a500 2023-10-06T11:14:14.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.623+0000 7f6f46729700 1 -- 172.21.15.146:0/3632257660 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f400ad8b0 con 0x7f6f4015a500 2023-10-06T11:14:14.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.623+0000 7f6f357fa700 1 -- 172.21.15.146:0/3632257660 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6f38009760 con 0x7f6f4015a500 2023-10-06T11:14:14.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.623+0000 7f6f357fa700 1 --2- 172.21.15.146:0/3632257660 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6f24066f30 0x7f6f240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:14.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.623+0000 7f6f357fa700 1 -- 172.21.15.146:0/3632257660 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f6f38086a10 con 0x7f6f4015a500 2023-10-06T11:14:14.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.624+0000 7f6f45727700 1 --2- 172.21.15.146:0/3632257660 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6f24066f30 0x7f6f240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:14.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.624+0000 7f6f45727700 1 --2- 172.21.15.146:0/3632257660 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6f24066f30 0x7f6f240693e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c0093f0 tx=0x7f6f3c017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:14.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.628+0000 7f6f357fa700 1 -- 172.21.15.146:0/3632257660 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f38053e70 con 0x7f6f4015a500 2023-10-06T11:14:14.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.883+0000 7f6f46729700 1 -- 172.21.15.146:0/3632257660 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f6f400c95b0 con 0x7f6f4015a500 2023-10-06T11:14:14.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.884+0000 7f6f357fa700 1 -- 172.21.15.146:0/3632257660 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f6f38057490 con 0x7f6f4015a500 2023-10-06T11:14:14.886 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:14.886 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:14:14.886 INFO:teuthology.orchestra.run.smithi146.stdout: "auth_dump": [ 2023-10-06T11:14:14.886 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:14:14.886 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.a", 2023-10-06T11:14:14.886 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lG4F8DBAAp5A4Dtfzvv8n9ORgkmiP9g==", 2023-10-06T11:14:14.886 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:14:14.887 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:14:14.887 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:14:14.887 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:14:14.887 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:14:14.887 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:14:14.887 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:14:14.887 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:14:14.887 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.b", 2023-10-06T11:14:14.888 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lDIceGBAA4cr0oGVaXiy5hrruKY5DGw==", 2023-10-06T11:14:14.888 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:14:14.888 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:14:14.888 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:14:14.888 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:14:14.888 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:14:14.889 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:14:14.889 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:14:14.889 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:14:14.889 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.c", 2023-10-06T11:14:14.889 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lbYA7ExAAAopKjS7+WMUE5fuVQygILQ==", 2023-10-06T11:14:14.889 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:14:14.889 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:14:14.890 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:14:14.890 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:14:14.890 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:14:14.890 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:14:14.890 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:14:14.890 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:14:14.890 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.d", 2023-10-06T11:14:14.890 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9laygiHxAAasUUn7Wk9EwLa36ggsZtHw==", 2023-10-06T11:14:14.890 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:14:14.890 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:14:14.890 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:14:14.890 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:14:14.891 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:14:14.891 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:14:14.891 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:14:14.891 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:14:14.891 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.0", 2023-10-06T11:14:14.891 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDX6R9lLGo9NhAAcWJuUeOdEUsdDw84W9nLPw==", 2023-10-06T11:14:14.891 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:14:14.891 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:14:14.891 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:14:14.891 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:14:14.892 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:14:14.892 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:14:14.892 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:14:14.892 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.1", 2023-10-06T11:14:14.892 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDa6R9lk02gNBAA9YqWT2/Xds20lv0sGtBApg==", 2023-10-06T11:14:14.892 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:14:14.892 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:14:14.892 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:14:14.892 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:14:14.893 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:14:14.893 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:14:14.893 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:14:14.893 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.2", 2023-10-06T11:14:14.893 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDd6R9lrA6xMxAAmH8r6m2p4Jpa82xfYNcq+g==", 2023-10-06T11:14:14.893 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:14:14.893 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:14:14.893 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:14:14.893 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:14:14.893 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:14:14.893 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:14:14.893 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:14:14.893 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.3", 2023-10-06T11:14:14.894 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDg6R9ltlHXNBAAvhfI1yjlaWCIE9Xr/4F/PA==", 2023-10-06T11:14:14.894 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:14:14.894 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:14:14.894 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:14:14.894 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:14:14.894 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:14:14.894 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:14:14.894 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:14:14.894 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.4", 2023-10-06T11:14:14.894 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDm6R9lPUCvMhAAGbUNfpoFi9SvYdelpnL1jA==", 2023-10-06T11:14:14.894 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:14:14.894 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:14:14.895 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:14:14.895 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:14:14.895 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:14:14.895 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:14:14.895 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:14:14.895 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.5", 2023-10-06T11:14:14.895 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDp6R9lMfrMMBAAUEtnXDNr7+L3dQm4QE9qDw==", 2023-10-06T11:14:14.895 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:14:14.895 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:14:14.895 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:14:14.895 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:14:14.895 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:14:14.896 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:14:14.896 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:14:14.896 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.6", 2023-10-06T11:14:14.896 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDs6R9lAmSDMBAArPp+6dVt/NyH9is46tL49g==", 2023-10-06T11:14:14.896 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:14:14.896 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:14:14.896 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:14:14.896 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:14:14.896 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:14:14.896 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:14:14.896 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:14:14.896 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.7", 2023-10-06T11:14:14.896 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDv6R9lnunMLRAA3o5ZtAyYDUoXTzjX9H8FCw==", 2023-10-06T11:14:14.897 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:14:14.897 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:14:14.897 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:14:14.897 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:14:14.897 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:14:14.897 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:14:14.897 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:14:14.897 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.0", 2023-10-06T11:14:14.897 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lCrPrIhAARrzj2VxVFkzF5L/ifIAqmw==", 2023-10-06T11:14:14.897 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:14:14.897 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:14:14.897 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow r", 2023-10-06T11:14:14.898 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T11:14:14.898 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:14:14.898 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:14:14.898 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:14:14.898 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.1", 2023-10-06T11:14:14.898 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9l10VSKxAA0HmXejgRRCQ7XpsMB7ljkQ==", 2023-10-06T11:14:14.898 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:14:14.898 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:14:14.898 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2023-10-06T11:14:14.899 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2023-10-06T11:14:14.899 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2023-10-06T11:14:14.899 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:14:14.899 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:14:14.899 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:14:14.899 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.2", 2023-10-06T11:14:14.899 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lpLpJKBAAF/vLDkBg9/VBqMK4pVVIkg==", 2023-10-06T11:14:14.899 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:14:14.899 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:14:14.900 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2023-10-06T11:14:14.900 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2023-10-06T11:14:14.900 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2023-10-06T11:14:14.900 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:14:14.900 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:14:14.900 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:14:14.900 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.3", 2023-10-06T11:14:14.900 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9luMqwMBAA4Y4I9hWTk2IqAzYwVQ13Pw==", 2023-10-06T11:14:14.900 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:14:14.900 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:14:14.900 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2023-10-06T11:14:14.900 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2023-10-06T11:14:14.901 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2023-10-06T11:14:14.901 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:14:14.901 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:14:14.901 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:14:14.901 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.admin", 2023-10-06T11:14:14.901 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDT6R9lSr9qIhAAiNEN9xFWUwFGsB+oUE1cXw==", 2023-10-06T11:14:14.901 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:14:14.901 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2023-10-06T11:14:14.901 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:14:14.901 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:14:14.901 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:14:14.902 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:14:14.902 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:14:14.902 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:14:14.902 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.x", 2023-10-06T11:14:14.902 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9llLpwCRAA4UH9Uqli2de9HIJR2fZ9xg==", 2023-10-06T11:14:14.902 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:14:14.902 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2023-10-06T11:14:14.902 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2023-10-06T11:14:14.902 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:14:14.902 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:14:14.903 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:14:14.903 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:14:14.903 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.y", 2023-10-06T11:14:14.903 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDT6R9l2uQxNxAAVSMhKVzbf2vC4opL7YCLdg==", 2023-10-06T11:14:14.903 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:14:14.903 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2023-10-06T11:14:14.903 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2023-10-06T11:14:14.903 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:14:14.903 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:14:14.903 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:14:14.903 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2023-10-06T11:14:14.903 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:14:14.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.886+0000 7f6f46729700 1 -- 172.21.15.146:0/3632257660 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6f24066f30 msgr2=0x7f6f240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:14.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.886+0000 7f6f46729700 1 --2- 172.21.15.146:0/3632257660 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6f24066f30 0x7f6f240693e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c0093f0 tx=0x7f6f3c017000 comp rx=0 tx=0).stop 2023-10-06T11:14:14.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.886+0000 7f6f46729700 1 -- 172.21.15.146:0/3632257660 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f4015a500 msgr2=0x7f6f400ae600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:14.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.886+0000 7f6f46729700 1 --2- 172.21.15.146:0/3632257660 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f4015a500 0x7f6f400ae600 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f6f3800e1c0 tx=0x7f6f3800d040 comp rx=0 tx=0).stop 2023-10-06T11:14:14.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.886+0000 7f6f46729700 1 -- 172.21.15.146:0/3632257660 shutdown_connections 2023-10-06T11:14:14.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.886+0000 7f6f46729700 1 --2- 172.21.15.146:0/3632257660 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6f24066f30 0x7f6f240693e0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:14.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.886+0000 7f6f46729700 1 --2- 172.21.15.146:0/3632257660 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6f4015a500 0x7f6f400ae600 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:14.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.886+0000 7f6f46729700 1 --2- 172.21.15.146:0/3632257660 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f4006ae20 0x7f6f40166310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:14.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.886+0000 7f6f46729700 1 --2- 172.21.15.146:0/3632257660 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f40156230 0x7f6f400b1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:14.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.886+0000 7f6f46729700 1 -- 172.21.15.146:0/3632257660 >> 172.21.15.146:0/3632257660 conn(0x7f6f40069010 msgr2=0x7f6f400c1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:14.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.886+0000 7f6f46729700 1 -- 172.21.15.146:0/3632257660 shutdown_connections 2023-10-06T11:14:14.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:14.886+0000 7f6f46729700 1 -- 172.21.15.146:0/3632257660 wait complete. 2023-10-06T11:14:14.906 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:14:15.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.019+0000 7f8391661700 1 Processor -- start 2023-10-06T11:14:15.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.019+0000 7f8391661700 1 -- start start 2023-10-06T11:14:15.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.020+0000 7f8391661700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f838c06e420 0x7f838c0aefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:15.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.020+0000 7f8391661700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f838c156050 0x7f838c0af8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:15.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.020+0000 7f8391661700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f838c0af520 con 0x7f838c155c80 2023-10-06T11:14:15.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.020+0000 7f8391661700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f838c0ad370 con 0x7f838c06e420 2023-10-06T11:14:15.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.020+0000 7f8391661700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f838c15a8a0 con 0x7f838c156050 2023-10-06T11:14:15.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.020+0000 7f83827fc700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f838c06e420 0x7f838c0aefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:15.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.020+0000 7f838b7fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f838c156050 0x7f838c0af8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:15.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.021+0000 7f83827fc700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f838c06e420 0x7f838c0aefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:40684/0 (socket says 172.21.15.146:40684) 2023-10-06T11:14:15.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.021+0000 7f83827fc700 1 -- 172.21.15.146:0/2749568138 learned_addr learned my addr 172.21.15.146:0/2749568138 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:15.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.021+0000 7f838affd700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f838c155c80 0x7f838c06dd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:53486/0 (socket says 172.21.15.146:53486) 2023-10-06T11:14:15.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.021+0000 7f83827fc700 1 -- 172.21.15.146:0/2749568138 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f838c156050 msgr2=0x7f838c0af8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:15.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.021+0000 7f83827fc700 1 --2- 172.21.15.146:0/2749568138 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f838c156050 0x7f838c0af8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.021+0000 7f83827fc700 1 -- 172.21.15.146:0/2749568138 >> v1:172.21.15.151:6789/0 conn(0x7f838c155c80 legacy=0x7f838c06dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:15.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.021+0000 7f83827fc700 1 -- 172.21.15.146:0/2749568138 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f838c0aca40 con 0x7f838c06e420 2023-10-06T11:14:15.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.021+0000 7f838b7fe700 1 --2- 172.21.15.146:0/2749568138 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f838c156050 0x7f838c0af8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:14:15.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.021+0000 7f83827fc700 1 --2- 172.21.15.146:0/2749568138 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f838c06e420 0x7f838c0aefe0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f83740099b0 tx=0x7f8374009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ef7fc5d59d4338a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:15.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.021+0000 7f838a7fc700 1 -- 172.21.15.146:0/2749568138 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8374009ea0 con 0x7f838c06e420 2023-10-06T11:14:15.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.021+0000 7f838a7fc700 1 -- 172.21.15.146:0/2749568138 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837400b860 con 0x7f838c06e420 2023-10-06T11:14:15.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.021+0000 7f838a7fc700 1 -- 172.21.15.146:0/2749568138 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837400bc00 con 0x7f838c06e420 2023-10-06T11:14:15.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.022+0000 7f8391661700 1 -- 172.21.15.146:0/2749568138 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f838c06e420 msgr2=0x7f838c0aefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:15.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.022+0000 7f8391661700 1 --2- 172.21.15.146:0/2749568138 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f838c06e420 0x7f838c0aefe0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f83740099b0 tx=0x7f8374009250 comp rx=0 tx=0).stop 2023-10-06T11:14:15.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.022+0000 7f8391661700 1 -- 172.21.15.146:0/2749568138 shutdown_connections 2023-10-06T11:14:15.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.022+0000 7f8391661700 1 --2- 172.21.15.146:0/2749568138 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f838c156050 0x7f838c0af8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.022+0000 7f8391661700 1 --2- 172.21.15.146:0/2749568138 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f838c06e420 0x7f838c0aefe0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.022+0000 7f8391661700 1 -- 172.21.15.146:0/2749568138 >> 172.21.15.146:0/2749568138 conn(0x7f838c0cd530 msgr2=0x7f838c069f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:15.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.022+0000 7f8391661700 1 -- 172.21.15.146:0/2749568138 shutdown_connections 2023-10-06T11:14:15.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.022+0000 7f8391661700 1 -- 172.21.15.146:0/2749568138 wait complete. 2023-10-06T11:14:15.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.023+0000 7f8391661700 1 Processor -- start 2023-10-06T11:14:15.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.023+0000 7f8391661700 1 -- start start 2023-10-06T11:14:15.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.024+0000 7f8391661700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f838c06e420 0x7f838c14f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:15.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.024+0000 7f8391661700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f838c155c80 0x7f838c154220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:15.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.024+0000 7f8391661700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f838c156050 0x7f838c154760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:15.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.024+0000 7f8391661700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838c14fc90 con 0x7f838c06e420 2023-10-06T11:14:15.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.024+0000 7f8391661700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838c0abf40 con 0x7f838c155c80 2023-10-06T11:14:15.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.024+0000 7f8391661700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f838c0ac220 con 0x7f838c156050 2023-10-06T11:14:15.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.024+0000 7f838affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f838c06e420 0x7f838c14f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:15.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.024+0000 7f838affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f838c06e420 0x7f838c14f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35254/0 (socket says 172.21.15.146:35254) 2023-10-06T11:14:15.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.024+0000 7f838affd700 1 -- 172.21.15.146:0/546823130 learned_addr learned my addr 172.21.15.146:0/546823130 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:15.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.024+0000 7f83827fc700 1 --2- 172.21.15.146:0/546823130 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f838c155c80 0x7f838c154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:15.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.024+0000 7f838b7fe700 1 --2- 172.21.15.146:0/546823130 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f838c156050 0x7f838c154760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:15.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.024+0000 7f838affd700 1 -- 172.21.15.146:0/546823130 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f838c156050 msgr2=0x7f838c154760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:15.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.024+0000 7f838affd700 1 --2- 172.21.15.146:0/546823130 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f838c156050 0x7f838c154760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.024+0000 7f838affd700 1 -- 172.21.15.146:0/546823130 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f838c155c80 msgr2=0x7f838c154220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:15.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.024+0000 7f838affd700 1 --2- 172.21.15.146:0/546823130 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f838c155c80 0x7f838c154220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.024+0000 7f838affd700 1 -- 172.21.15.146:0/546823130 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8384009a20 con 0x7f838c06e420 2023-10-06T11:14:15.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.024+0000 7f838affd700 1 --2- 172.21.15.146:0/546823130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f838c06e420 0x7f838c14f750 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f837c00c7c0 tx=0x7f837c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:15.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.024+0000 7f83837fe700 1 -- 172.21.15.146:0/546823130 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c005a70 con 0x7f838c06e420 2023-10-06T11:14:15.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.025+0000 7f83837fe700 1 -- 172.21.15.146:0/546823130 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837c005bd0 con 0x7f838c06e420 2023-10-06T11:14:15.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.025+0000 7f83837fe700 1 -- 172.21.15.146:0/546823130 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c0070d0 con 0x7f838c06e420 2023-10-06T11:14:15.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.025+0000 7f8391661700 1 -- 172.21.15.146:0/546823130 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83740094f0 con 0x7f838c06e420 2023-10-06T11:14:15.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.025+0000 7f8391661700 1 -- 172.21.15.146:0/546823130 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f838c0a68f0 con 0x7f838c06e420 2023-10-06T11:14:15.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.025+0000 7f8391661700 1 -- 172.21.15.146:0/546823130 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f838c04c380 con 0x7f838c06e420 2023-10-06T11:14:15.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.026+0000 7f83837fe700 1 -- 172.21.15.146:0/546823130 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f837c007480 con 0x7f838c06e420 2023-10-06T11:14:15.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.026+0000 7f83837fe700 1 --2- 172.21.15.146:0/546823130 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f836c066f30 0x7f836c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:15.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.026+0000 7f83837fe700 1 -- 172.21.15.146:0/546823130 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f837c083600 con 0x7f838c06e420 2023-10-06T11:14:15.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.026+0000 7f83827fc700 1 --2- 172.21.15.146:0/546823130 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f836c066f30 0x7f836c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:15.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.027+0000 7f83827fc700 1 --2- 172.21.15.146:0/546823130 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f836c066f30 0x7f836c0693e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f83740099b0 tx=0x7f8374017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:15.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.030+0000 7f83837fe700 1 -- 172.21.15.146:0/546823130 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f837c050b20 con 0x7f838c06e420 2023-10-06T11:14:15.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.217+0000 7f8391661700 1 -- 172.21.15.146:0/546823130 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f838c0af520 con 0x7f838c06e420 2023-10-06T11:14:15.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.218+0000 7f83837fe700 1 -- 172.21.15.146:0/546823130 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+13700 (secure 0 0 0) 0x7f838c0af520 con 0x7f838c06e420 2023-10-06T11:14:15.220 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:15.220 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":109,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:14:14.484582+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:14:15.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.220+0000 7f8391661700 1 -- 172.21.15.146:0/546823130 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f836c066f30 msgr2=0x7f836c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:15.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.220+0000 7f8391661700 1 --2- 172.21.15.146:0/546823130 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f836c066f30 0x7f836c0693e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f83740099b0 tx=0x7f8374017000 comp rx=0 tx=0).stop 2023-10-06T11:14:15.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.220+0000 7f8391661700 1 -- 172.21.15.146:0/546823130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f838c06e420 msgr2=0x7f838c14f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:15.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.220+0000 7f8391661700 1 --2- 172.21.15.146:0/546823130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f838c06e420 0x7f838c14f750 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f837c00c7c0 tx=0x7f837c007f70 comp rx=0 tx=0).stop 2023-10-06T11:14:15.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.220+0000 7f8391661700 1 -- 172.21.15.146:0/546823130 shutdown_connections 2023-10-06T11:14:15.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.220+0000 7f8391661700 1 --2- 172.21.15.146:0/546823130 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f836c066f30 0x7f836c0693e0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.220+0000 7f8391661700 1 --2- 172.21.15.146:0/546823130 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f838c156050 0x7f838c154760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.220+0000 7f8391661700 1 --2- 172.21.15.146:0/546823130 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f838c06e420 0x7f838c14f750 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.220+0000 7f8391661700 1 --2- 172.21.15.146:0/546823130 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f838c155c80 0x7f838c154220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.220+0000 7f8391661700 1 -- 172.21.15.146:0/546823130 >> 172.21.15.146:0/546823130 conn(0x7f838c0cd530 msgr2=0x7f838c0c94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:15.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.220+0000 7f8391661700 1 -- 172.21.15.146:0/546823130 shutdown_connections 2023-10-06T11:14:15.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.220+0000 7f8391661700 1 -- 172.21.15.146:0/546823130 wait complete. 2023-10-06T11:14:15.235 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:05:36.687307+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:05:37.171199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T11:14:15.235 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:14:15.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.353+0000 7fcde68f1700 1 Processor -- start 2023-10-06T11:14:15.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.353+0000 7fcde68f1700 1 -- start start 2023-10-06T11:14:15.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.354+0000 7fcde68f1700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcde00ae730 0x7fcde00aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:15.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.354+0000 7fcde68f1700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcde00ae2a0 con 0x7fcde015a160 2023-10-06T11:14:15.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.354+0000 7fcde68f1700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcde015a530 con 0x7fcde00cb950 2023-10-06T11:14:15.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.354+0000 7fcde68f1700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcde00c5cb0 con 0x7fcde00ae730 2023-10-06T11:14:15.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.354+0000 7fcddf7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcde00ae730 0x7fcde00aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:15.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.354+0000 7fcddf7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcde00ae730 0x7fcde00aebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35256/0 (socket says 172.21.15.146:35256) 2023-10-06T11:14:15.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.354+0000 7fcddf7fe700 1 -- 172.21.15.146:0/706083416 learned_addr learned my addr 172.21.15.146:0/706083416 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:15.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.354+0000 7fcddffff700 1 --1- 172.21.15.146:0/706083416 >> v1:172.21.15.146:6789/0 conn(0x7fcde015a160 0x7fcde00c55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38692/0 (socket says 172.21.15.146:38692) 2023-10-06T11:14:15.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.355+0000 7fcddf7fe700 1 -- 172.21.15.146:0/706083416 >> v1:172.21.15.151:6789/0 conn(0x7fcde00cb950 legacy=0x7fcde00cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:15.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.355+0000 7fcddf7fe700 1 -- 172.21.15.146:0/706083416 >> v1:172.21.15.146:6789/0 conn(0x7fcde015a160 legacy=0x7fcde00c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:15.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.355+0000 7fcddf7fe700 1 -- 172.21.15.146:0/706083416 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde00af0f0 con 0x7fcde00ae730 2023-10-06T11:14:15.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.355+0000 7fcddf7fe700 1 --2- 172.21.15.146:0/706083416 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcde00ae730 0x7fcde00aebb0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fcdd40099b0 tx=0x7fcdd4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b5669521ee10da3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:15.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.355+0000 7fcddeffd700 1 -- 172.21.15.146:0/706083416 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd400b820 con 0x7fcde00ae730 2023-10-06T11:14:15.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.355+0000 7fcddeffd700 1 -- 172.21.15.146:0/706083416 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd400b980 con 0x7fcde00ae730 2023-10-06T11:14:15.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.355+0000 7fcddeffd700 1 -- 172.21.15.146:0/706083416 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd400bd20 con 0x7fcde00ae730 2023-10-06T11:14:15.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.355+0000 7fcde68f1700 1 -- 172.21.15.146:0/706083416 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcde00ae730 msgr2=0x7fcde00aebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:15.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.355+0000 7fcde68f1700 1 --2- 172.21.15.146:0/706083416 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcde00ae730 0x7fcde00aebb0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fcdd40099b0 tx=0x7fcdd4009250 comp rx=0 tx=0).stop 2023-10-06T11:14:15.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.355+0000 7fcde68f1700 1 -- 172.21.15.146:0/706083416 shutdown_connections 2023-10-06T11:14:15.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.355+0000 7fcde68f1700 1 --2- 172.21.15.146:0/706083416 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcde00ae730 0x7fcde00aebb0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.355+0000 7fcde68f1700 1 -- 172.21.15.146:0/706083416 >> 172.21.15.146:0/706083416 conn(0x7fcde006f380 msgr2=0x7fcde00d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:15.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.356+0000 7fcde68f1700 1 -- 172.21.15.146:0/706083416 shutdown_connections 2023-10-06T11:14:15.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.356+0000 7fcde68f1700 1 -- 172.21.15.146:0/706083416 wait complete. 2023-10-06T11:14:15.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.357+0000 7fcde68f1700 1 Processor -- start 2023-10-06T11:14:15.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.357+0000 7fcde68f1700 1 -- start start 2023-10-06T11:14:15.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.357+0000 7fcde68f1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcde00ae730 0x7fcde01575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:15.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.357+0000 7fcde68f1700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcde00cb950 0x7fcde015db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:15.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.358+0000 7fcde68f1700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcde015a160 0x7fcde015e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:15.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.358+0000 7fcde68f1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde015e6c0 con 0x7fcde00ae730 2023-10-06T11:14:15.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.358+0000 7fcde68f1700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde015e9a0 con 0x7fcde015a160 2023-10-06T11:14:15.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.358+0000 7fcde68f1700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcde015ec80 con 0x7fcde00cb950 2023-10-06T11:14:15.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.358+0000 7fcddffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcde00ae730 0x7fcde01575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:15.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.358+0000 7fcddffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcde00ae730 0x7fcde01575a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35268/0 (socket says 172.21.15.146:35268) 2023-10-06T11:14:15.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.358+0000 7fcddffff700 1 -- 172.21.15.146:0/998097085 learned_addr learned my addr 172.21.15.146:0/998097085 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:15.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.358+0000 7fcddffff700 1 -- 172.21.15.146:0/998097085 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcde00cb950 msgr2=0x7fcde015db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:15.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.358+0000 7fcddffff700 1 --2- 172.21.15.146:0/998097085 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcde00cb950 0x7fcde015db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.358+0000 7fcddffff700 1 -- 172.21.15.146:0/998097085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcde015a160 msgr2=0x7fcde015e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:15.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.358+0000 7fcddffff700 1 --2- 172.21.15.146:0/998097085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcde015a160 0x7fcde015e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.358+0000 7fcddffff700 1 -- 172.21.15.146:0/998097085 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd40094f0 con 0x7fcde00ae730 2023-10-06T11:14:15.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.358+0000 7fcddffff700 1 --2- 172.21.15.146:0/998097085 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcde00ae730 0x7fcde01575a0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fcdd000c560 tx=0x7fcdd0007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:15.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.358+0000 7fcdc7fff700 1 -- 172.21.15.146:0/998097085 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd00072e0 con 0x7fcde00ae730 2023-10-06T11:14:15.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.358+0000 7fcdc7fff700 1 -- 172.21.15.146:0/998097085 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd0007440 con 0x7fcde00ae730 2023-10-06T11:14:15.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.358+0000 7fcde68f1700 1 -- 172.21.15.146:0/998097085 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcde015ef60 con 0x7fcde00ae730 2023-10-06T11:14:15.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.358+0000 7fcdc7fff700 1 -- 172.21.15.146:0/998097085 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd00057f0 con 0x7fcde00ae730 2023-10-06T11:14:15.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.358+0000 7fcde68f1700 1 -- 172.21.15.146:0/998097085 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcde0157ae0 con 0x7fcde00ae730 2023-10-06T11:14:15.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.359+0000 7fcde68f1700 1 -- 172.21.15.146:0/998097085 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcde0068390 con 0x7fcde00ae730 2023-10-06T11:14:15.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.359+0000 7fcdc7fff700 1 -- 172.21.15.146:0/998097085 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcdd0005ba0 con 0x7fcde00ae730 2023-10-06T11:14:15.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.360+0000 7fcdc7fff700 1 --2- 172.21.15.146:0/998097085 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcdcc066f30 0x7fcdcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:15.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.360+0000 7fcdc7fff700 1 -- 172.21.15.146:0/998097085 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fcdd00838f0 con 0x7fcde00ae730 2023-10-06T11:14:15.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.360+0000 7fcddf7fe700 1 --2- 172.21.15.146:0/998097085 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcdcc066f30 0x7fcdcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:15.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.360+0000 7fcddf7fe700 1 --2- 172.21.15.146:0/998097085 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcdcc066f30 0x7fcdcc0693e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fcdd40099b0 tx=0x7fcdd4016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:15.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.364+0000 7fcdc7fff700 1 -- 172.21.15.146:0/998097085 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcdd0050cb0 con 0x7fcde00ae730 2023-10-06T11:14:15.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.551+0000 7fcde68f1700 1 -- 172.21.15.146:0/998097085 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcde004c380 con 0x7fcde00ae730 2023-10-06T11:14:15.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.551+0000 7fcdc7fff700 1 -- 172.21.15.146:0/998097085 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v109) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcdd0017020 con 0x7fcde00ae730 2023-10-06T11:14:15.553 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-10-06T11:14:15.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.553+0000 7fcde68f1700 1 -- 172.21.15.146:0/998097085 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcdcc066f30 msgr2=0x7fcdcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:15.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.553+0000 7fcde68f1700 1 --2- 172.21.15.146:0/998097085 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcdcc066f30 0x7fcdcc0693e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fcdd40099b0 tx=0x7fcdd4016000 comp rx=0 tx=0).stop 2023-10-06T11:14:15.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.553+0000 7fcde68f1700 1 -- 172.21.15.146:0/998097085 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcde00ae730 msgr2=0x7fcde01575a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:15.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.553+0000 7fcde68f1700 1 --2- 172.21.15.146:0/998097085 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcde00ae730 0x7fcde01575a0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fcdd000c560 tx=0x7fcdd0007f00 comp rx=0 tx=0).stop 2023-10-06T11:14:15.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.553+0000 7fcde68f1700 1 -- 172.21.15.146:0/998097085 shutdown_connections 2023-10-06T11:14:15.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.553+0000 7fcde68f1700 1 --2- 172.21.15.146:0/998097085 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcdcc066f30 0x7fcdcc0693e0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.553+0000 7fcde68f1700 1 --2- 172.21.15.146:0/998097085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcde015a160 0x7fcde015e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.553+0000 7fcde68f1700 1 --2- 172.21.15.146:0/998097085 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcde00ae730 0x7fcde01575a0 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.553+0000 7fcde68f1700 1 --2- 172.21.15.146:0/998097085 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcde00cb950 0x7fcde015db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.553+0000 7fcde68f1700 1 -- 172.21.15.146:0/998097085 >> 172.21.15.146:0/998097085 conn(0x7fcde006f380 msgr2=0x7fcde00ce330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:15.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.553+0000 7fcde68f1700 1 -- 172.21.15.146:0/998097085 shutdown_connections 2023-10-06T11:14:15.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.553+0000 7fcde68f1700 1 -- 172.21.15.146:0/998097085 wait complete. 2023-10-06T11:14:15.567 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:14:15.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.684+0000 7f3be4021700 1 Processor -- start 2023-10-06T11:14:15.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.684+0000 7f3be4021700 1 -- start start 2023-10-06T11:14:15.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.685+0000 7f3be4021700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3bdc15cff0 0x7f3bdc15d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:15.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.685+0000 7f3be4021700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3bdc0d0c50 0x7f3bdc15a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:15.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.685+0000 7f3be4021700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bdc0cf030 con 0x7f3bdc15cc20 2023-10-06T11:14:15.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.685+0000 7f3be4021700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bdc15e390 con 0x7f3bdc15cff0 2023-10-06T11:14:15.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.685+0000 7f3be4021700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc0ced20 con 0x7f3bdc0d0c50 2023-10-06T11:14:15.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.685+0000 7f3be1dbd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3bdc15cc20 0x7f3bdc0d0540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38706/0 (socket says 172.21.15.146:38706) 2023-10-06T11:14:15.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.685+0000 7f3be1dbd700 1 -- 172.21.15.146:0/1083760482 learned_addr learned my addr 172.21.15.146:0/1083760482 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:14:15.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.685+0000 7f3be25be700 1 --2- 172.21.15.146:0/1083760482 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3bdc0d0c50 0x7f3bdc15a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:15.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.685+0000 7f3be15bc700 1 --2- 172.21.15.146:0/1083760482 >> v2:172.21.15.151:3300/0 conn(0x7f3bdc15cff0 0x7f3bdc15d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:15.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.685+0000 7f3be0dbb700 1 -- 172.21.15.146:0/1083760482 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 271104514 0 0) 0x7f3bdc0cf030 con 0x7f3bdc15cc20 2023-10-06T11:14:15.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.685+0000 7f3be0dbb700 1 -- 172.21.15.146:0/1083760482 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bc8003570 con 0x7f3bdc15cc20 2023-10-06T11:14:15.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.685+0000 7f3be0dbb700 1 -- 172.21.15.146:0/1083760482 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3636507316 0 0) 0x7f3bc8003570 con 0x7f3bdc15cc20 2023-10-06T11:14:15.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.685+0000 7f3be0dbb700 1 -- 172.21.15.146:0/1083760482 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3bdc0d0c50 msgr2=0x7f3bdc15a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:15.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.685+0000 7f3be0dbb700 1 --2- 172.21.15.146:0/1083760482 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3bdc0d0c50 0x7f3bdc15a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.685+0000 7f3be0dbb700 1 -- 172.21.15.146:0/1083760482 >> v2:172.21.15.151:3300/0 conn(0x7f3bdc15cff0 msgr2=0x7f3bdc15d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:15.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.685+0000 7f3be0dbb700 1 --2- 172.21.15.146:0/1083760482 >> v2:172.21.15.151:3300/0 conn(0x7f3bdc15cff0 0x7f3bdc15d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.685+0000 7f3be0dbb700 1 -- 172.21.15.146:0/1083760482 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bdc15daf0 con 0x7f3bdc15cc20 2023-10-06T11:14:15.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.685+0000 7f3be0dbb700 1 -- 172.21.15.146:0/1083760482 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f3bd80015f0 con 0x7f3bdc15cc20 2023-10-06T11:14:15.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.685+0000 7f3be0dbb700 1 -- 172.21.15.146:0/1083760482 >> v1:172.21.15.146:6789/0 conn(0x7f3bdc15cc20 legacy=0x7f3bdc0d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:15.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.685+0000 7f3be0dbb700 1 --2- 172.21.15.146:0/1083760482 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3bc8003a60 0x7f3bc8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:15.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.686+0000 7f3be0dbb700 1 --2- 172.21.15.146:0/1083760482 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3bdc0d0c50 0x7f3bc8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:15.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.686+0000 7f3be0dbb700 1 --2- 172.21.15.146:0/1083760482 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bc8004d50 0x7f3bc80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:15.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.686+0000 7f3be0dbb700 1 -- 172.21.15.146:0/1083760482 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc15e390 con 0x7f3bc8004d50 2023-10-06T11:14:15.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.686+0000 7f3be0dbb700 1 -- 172.21.15.146:0/1083760482 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc0ced20 con 0x7f3bc8003a60 2023-10-06T11:14:15.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.686+0000 7f3be0dbb700 1 -- 172.21.15.146:0/1083760482 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc800ba60 con 0x7f3bdc0d0c50 2023-10-06T11:14:15.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.686+0000 7f3be25be700 1 --2- 172.21.15.146:0/1083760482 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bc8004d50 0x7f3bc80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:15.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.686+0000 7f3be1dbd700 1 --2- 172.21.15.146:0/1083760482 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3bc8003a60 0x7f3bc8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:15.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.686+0000 7f3be15bc700 1 --2- 172.21.15.146:0/1083760482 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3bdc0d0c50 0x7f3bc8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:15.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.686+0000 7f3be25be700 1 -- 172.21.15.146:0/1083760482 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3bdc0d0c50 msgr2=0x7f3bc8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:15.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.686+0000 7f3be25be700 1 --2- 172.21.15.146:0/1083760482 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3bdc0d0c50 0x7f3bc8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.686+0000 7f3be25be700 1 -- 172.21.15.146:0/1083760482 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3bc8003a60 msgr2=0x7f3bc8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:15.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.686+0000 7f3be25be700 1 --2- 172.21.15.146:0/1083760482 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3bc8003a60 0x7f3bc8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.686+0000 7f3be25be700 1 -- 172.21.15.146:0/1083760482 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc8003570 con 0x7f3bc8004d50 2023-10-06T11:14:15.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.686+0000 7f3be25be700 1 --2- 172.21.15.146:0/1083760482 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bc8004d50 0x7f3bc80051c0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc0d1050 tx=0x7f3bd400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9de9f5625e724f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:15.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.686+0000 7f3be0dbb700 1 -- 172.21.15.146:0/1083760482 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd400ea30 con 0x7f3bc8004d50 2023-10-06T11:14:15.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.686+0000 7f3be0dbb700 1 -- 172.21.15.146:0/1083760482 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd400f040 con 0x7f3bc8004d50 2023-10-06T11:14:15.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.686+0000 7f3be0dbb700 1 -- 172.21.15.146:0/1083760482 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd400ede0 con 0x7f3bc8004d50 2023-10-06T11:14:15.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.687+0000 7f3be4021700 1 -- 172.21.15.146:0/1083760482 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bc8004d50 msgr2=0x7f3bc80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:15.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.687+0000 7f3be4021700 1 --2- 172.21.15.146:0/1083760482 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bc8004d50 0x7f3bc80051c0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc0d1050 tx=0x7f3bd400b040 comp rx=0 tx=0).stop 2023-10-06T11:14:15.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.687+0000 7f3be25be700 1 -- 172.21.15.146:0/1083760482 reap_dead start 2023-10-06T11:14:15.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.687+0000 7f3be4021700 1 -- 172.21.15.146:0/1083760482 shutdown_connections 2023-10-06T11:14:15.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.687+0000 7f3be4021700 1 -- 172.21.15.146:0/1083760482 >> 172.21.15.146:0/1083760482 conn(0x7f3bdc06eba0 msgr2=0x7f3bdc06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:15.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.687+0000 7f3be4021700 1 -- 172.21.15.146:0/1083760482 shutdown_connections 2023-10-06T11:14:15.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.687+0000 7f3be4021700 1 -- 172.21.15.146:0/1083760482 wait complete. 2023-10-06T11:14:15.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.688+0000 7f3be4021700 1 Processor -- start 2023-10-06T11:14:15.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.688+0000 7f3be4021700 1 -- start start 2023-10-06T11:14:15.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.689+0000 7f3be4021700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bdc143fa0 0x7f3bdc15a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:15.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.689+0000 7f3be4021700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3bdc144370 0x7f3bdc15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:15.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.689+0000 7f3be4021700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3bdc0c6930 0x7f3bdc0c6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:15.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.689+0000 7f3be4021700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc0c8290 con 0x7f3bdc143fa0 2023-10-06T11:14:15.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.689+0000 7f3be4021700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc0c7680 con 0x7f3bdc144370 2023-10-06T11:14:15.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.689+0000 7f3be4021700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bdc0c7960 con 0x7f3bdc0c6930 2023-10-06T11:14:15.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.689+0000 7f3be1dbd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bdc143fa0 0x7f3bdc15a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:15.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.689+0000 7f3be1dbd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bdc143fa0 0x7f3bdc15a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35278/0 (socket says 172.21.15.146:35278) 2023-10-06T11:14:15.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.689+0000 7f3be1dbd700 1 -- 172.21.15.146:0/919658138 learned_addr learned my addr 172.21.15.146:0/919658138 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:15.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.689+0000 7f3be15bc700 1 --2- 172.21.15.146:0/919658138 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3bdc144370 0x7f3bdc15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:15.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.689+0000 7f3be25be700 1 --2- 172.21.15.146:0/919658138 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3bdc0c6930 0x7f3bdc0c6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:15.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.689+0000 7f3be1dbd700 1 -- 172.21.15.146:0/919658138 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3bdc0c6930 msgr2=0x7f3bdc0c6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:15.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.689+0000 7f3be1dbd700 1 --2- 172.21.15.146:0/919658138 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3bdc0c6930 0x7f3bdc0c6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.689+0000 7f3be1dbd700 1 -- 172.21.15.146:0/919658138 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3bdc144370 msgr2=0x7f3bdc15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:15.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.689+0000 7f3be1dbd700 1 --2- 172.21.15.146:0/919658138 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3bdc144370 0x7f3bdc15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.689+0000 7f3be1dbd700 1 -- 172.21.15.146:0/919658138 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bdc0c7c40 con 0x7f3bdc143fa0 2023-10-06T11:14:15.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.689+0000 7f3be1dbd700 1 --2- 172.21.15.146:0/919658138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bdc143fa0 0x7f3bdc15a690 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f3bd800fc30 tx=0x7f3bd8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:15.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.689+0000 7f3bd1ffb700 1 -- 172.21.15.146:0/919658138 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd80073b0 con 0x7f3bdc143fa0 2023-10-06T11:14:15.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.689+0000 7f3bd1ffb700 1 -- 172.21.15.146:0/919658138 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bd8007550 con 0x7f3bdc143fa0 2023-10-06T11:14:15.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.689+0000 7f3be4021700 1 -- 172.21.15.146:0/919658138 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bdc0c7f20 con 0x7f3bdc143fa0 2023-10-06T11:14:15.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.689+0000 7f3bd1ffb700 1 -- 172.21.15.146:0/919658138 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bd8005a40 con 0x7f3bdc143fa0 2023-10-06T11:14:15.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.690+0000 7f3be4021700 1 -- 172.21.15.146:0/919658138 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bdc0b0c40 con 0x7f3bdc143fa0 2023-10-06T11:14:15.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.691+0000 7f3be4021700 1 -- 172.21.15.146:0/919658138 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bdc04c380 con 0x7f3bdc143fa0 2023-10-06T11:14:15.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.691+0000 7f3bd1ffb700 1 -- 172.21.15.146:0/919658138 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3bd800d5e0 con 0x7f3bdc143fa0 2023-10-06T11:14:15.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.691+0000 7f3bd1ffb700 1 --2- 172.21.15.146:0/919658138 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3bc0066f30 0x7f3bc00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:15.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.691+0000 7f3bd1ffb700 1 -- 172.21.15.146:0/919658138 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f3bd80846d0 con 0x7f3bdc143fa0 2023-10-06T11:14:15.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.691+0000 7f3be15bc700 1 --2- 172.21.15.146:0/919658138 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3bc0066f30 0x7f3bc00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:15.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.691+0000 7f3be15bc700 1 --2- 172.21.15.146:0/919658138 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3bc0066f30 0x7f3bc00693e0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc0c5420 tx=0x7f3bcc0091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:15.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.695+0000 7f3bd1ffb700 1 -- 172.21.15.146:0/919658138 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3bd8051b30 con 0x7f3bdc143fa0 2023-10-06T11:14:15.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.875+0000 7f3be4021700 1 -- 172.21.15.146:0/919658138 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3bdc0b3b50 con 0x7f3bdc143fa0 2023-10-06T11:14:15.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.876+0000 7f3bd1ffb700 1 -- 172.21.15.146:0/919658138 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v109) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3bd8055150 con 0x7f3bdc143fa0 2023-10-06T11:14:15.878 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-10-06T11:14:15.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.878+0000 7f3be4021700 1 -- 172.21.15.146:0/919658138 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3bc0066f30 msgr2=0x7f3bc00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:15.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.878+0000 7f3be4021700 1 --2- 172.21.15.146:0/919658138 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3bc0066f30 0x7f3bc00693e0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc0c5420 tx=0x7f3bcc0091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.878+0000 7f3be4021700 1 -- 172.21.15.146:0/919658138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bdc143fa0 msgr2=0x7f3bdc15a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:15.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.878+0000 7f3be4021700 1 --2- 172.21.15.146:0/919658138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bdc143fa0 0x7f3bdc15a690 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f3bd800fc30 tx=0x7f3bd8009040 comp rx=0 tx=0).stop 2023-10-06T11:14:15.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.878+0000 7f3be4021700 1 -- 172.21.15.146:0/919658138 shutdown_connections 2023-10-06T11:14:15.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.878+0000 7f3be4021700 1 --2- 172.21.15.146:0/919658138 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3bc0066f30 0x7f3bc00693e0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.878+0000 7f3be4021700 1 --2- 172.21.15.146:0/919658138 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3bdc0c6930 0x7f3bdc0c6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.878+0000 7f3be4021700 1 --2- 172.21.15.146:0/919658138 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3bdc143fa0 0x7f3bdc15a690 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.878+0000 7f3be4021700 1 --2- 172.21.15.146:0/919658138 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3bdc144370 0x7f3bdc15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:15.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.878+0000 7f3be4021700 1 -- 172.21.15.146:0/919658138 >> 172.21.15.146:0/919658138 conn(0x7f3bdc06eba0 msgr2=0x7f3bdc06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:15.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.878+0000 7f3be4021700 1 -- 172.21.15.146:0/919658138 shutdown_connections 2023-10-06T11:14:15.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:15.878+0000 7f3be4021700 1 -- 172.21.15.146:0/919658138 wait complete. 2023-10-06T11:14:15.892 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T11:14:16.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.006+0000 7f493bfff700 1 Processor -- start 2023-10-06T11:14:16.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.006+0000 7f493bfff700 1 -- start start 2023-10-06T11:14:16.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.007+0000 7f493bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f493c15a7f0 0x7f493c15cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:16.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.007+0000 7f493bfff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f493c0b2530 0x7f493c15acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:16.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.007+0000 7f493bfff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f493c15c630 con 0x7f493c15a420 2023-10-06T11:14:16.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.007+0000 7f493bfff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f493c0ce040 con 0x7f493c15a7f0 2023-10-06T11:14:16.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.007+0000 7f493bfff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f493c15ba20 con 0x7f493c0b2530 2023-10-06T11:14:16.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.007+0000 7f493affd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f493c15a420 0x7f493c0b1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38718/0 (socket says 172.21.15.146:38718) 2023-10-06T11:14:16.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.007+0000 7f493affd700 1 -- 172.21.15.146:0/1077211999 learned_addr learned my addr 172.21.15.146:0/1077211999 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:14:16.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.007+0000 7f49327fc700 1 --2- 172.21.15.146:0/1077211999 >> v2:172.21.15.146:3300/0 conn(0x7f493c15a7f0 0x7f493c15cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:16.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.007+0000 7f493b7fe700 1 --2- 172.21.15.146:0/1077211999 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f493c0b2530 0x7f493c15acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:16.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.007+0000 7f49327fc700 1 -- 172.21.15.146:0/1077211999 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f493c0b2530 msgr2=0x7f493c15acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:16.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.007+0000 7f49327fc700 1 --2- 172.21.15.146:0/1077211999 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f493c0b2530 0x7f493c15acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:16.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.007+0000 7f49327fc700 1 -- 172.21.15.146:0/1077211999 >> v1:172.21.15.146:6789/0 conn(0x7f493c15a420 legacy=0x7f493c0b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:16.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.007+0000 7f49327fc700 1 -- 172.21.15.146:0/1077211999 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f493c15bd00 con 0x7f493c15a7f0 2023-10-06T11:14:16.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.008+0000 7f49327fc700 1 --2- 172.21.15.146:0/1077211999 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f493c15a7f0 0x7f493c15cac0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f49240098e0 tx=0x7f49240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fa35d3eddf1ebf8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:16.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.008+0000 7f493a7fc700 1 -- 172.21.15.146:0/1077211999 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4924009e80 con 0x7f493c15a7f0 2023-10-06T11:14:16.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.008+0000 7f493a7fc700 1 -- 172.21.15.146:0/1077211999 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492400b860 con 0x7f493c15a7f0 2023-10-06T11:14:16.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.008+0000 7f493a7fc700 1 -- 172.21.15.146:0/1077211999 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492400bbe0 con 0x7f493c15a7f0 2023-10-06T11:14:16.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.008+0000 7f493bfff700 1 -- 172.21.15.146:0/1077211999 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f493c15a7f0 msgr2=0x7f493c15cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:16.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.008+0000 7f493bfff700 1 --2- 172.21.15.146:0/1077211999 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f493c15a7f0 0x7f493c15cac0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f49240098e0 tx=0x7f49240091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:16.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.008+0000 7f493bfff700 1 -- 172.21.15.146:0/1077211999 shutdown_connections 2023-10-06T11:14:16.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.008+0000 7f493bfff700 1 --2- 172.21.15.146:0/1077211999 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f493c0b2530 0x7f493c15acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:16.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.008+0000 7f493bfff700 1 --2- 172.21.15.146:0/1077211999 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f493c15a7f0 0x7f493c15cac0 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:16.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.008+0000 7f493bfff700 1 -- 172.21.15.146:0/1077211999 >> 172.21.15.146:0/1077211999 conn(0x7f493c06eba0 msgr2=0x7f493c06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:16.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.008+0000 7f493bfff700 1 -- 172.21.15.146:0/1077211999 shutdown_connections 2023-10-06T11:14:16.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.008+0000 7f493bfff700 1 -- 172.21.15.146:0/1077211999 wait complete. 2023-10-06T11:14:16.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.009+0000 7f493bfff700 1 Processor -- start 2023-10-06T11:14:16.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.010+0000 7f493bfff700 1 -- start start 2023-10-06T11:14:16.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.010+0000 7f493bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f493c0b2530 0x7f493c14b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:16.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.010+0000 7f493bfff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f493c15a420 0x7f493c147dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:16.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.010+0000 7f493bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f493c15a7f0 0x7f493c148a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:16.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.010+0000 7f493bfff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493c14b450 con 0x7f493c15a7f0 2023-10-06T11:14:16.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.010+0000 7f493bfff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493c14a840 con 0x7f493c0b2530 2023-10-06T11:14:16.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.010+0000 7f493bfff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f493c14ab20 con 0x7f493c15a420 2023-10-06T11:14:16.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.010+0000 7f493b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f493c15a7f0 0x7f493c148a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:16.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.010+0000 7f493b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f493c15a7f0 0x7f493c148a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35306/0 (socket says 172.21.15.146:35306) 2023-10-06T11:14:16.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.010+0000 7f493b7fe700 1 -- 172.21.15.146:0/2143782036 learned_addr learned my addr 172.21.15.146:0/2143782036 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:16.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.011+0000 7f49327fc700 1 --2- 172.21.15.146:0/2143782036 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f493c15a420 0x7f493c147dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:16.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.011+0000 7f493affd700 1 --2- 172.21.15.146:0/2143782036 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f493c0b2530 0x7f493c14b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:16.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.011+0000 7f493b7fe700 1 -- 172.21.15.146:0/2143782036 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f493c15a420 msgr2=0x7f493c147dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:16.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.011+0000 7f493b7fe700 1 --2- 172.21.15.146:0/2143782036 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f493c15a420 0x7f493c147dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:16.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.011+0000 7f493b7fe700 1 -- 172.21.15.146:0/2143782036 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f493c0b2530 msgr2=0x7f493c14b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:16.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.011+0000 7f493b7fe700 1 --2- 172.21.15.146:0/2143782036 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f493c0b2530 0x7f493c14b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:16.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.011+0000 7f493b7fe700 1 -- 172.21.15.146:0/2143782036 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4924009420 con 0x7f493c15a7f0 2023-10-06T11:14:16.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.011+0000 7f493b7fe700 1 --2- 172.21.15.146:0/2143782036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f493c15a7f0 0x7f493c148a10 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f4934007f20 tx=0x7f49340098a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:16.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.011+0000 7f49337fe700 1 -- 172.21.15.146:0/2143782036 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493400eca0 con 0x7f493c15a7f0 2023-10-06T11:14:16.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.011+0000 7f49337fe700 1 -- 172.21.15.146:0/2143782036 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493400ee20 con 0x7f493c15a7f0 2023-10-06T11:14:16.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.011+0000 7f493bfff700 1 -- 172.21.15.146:0/2143782036 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f493c14ae00 con 0x7f493c15a7f0 2023-10-06T11:14:16.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.011+0000 7f49337fe700 1 -- 172.21.15.146:0/2143782036 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4934014670 con 0x7f493c15a7f0 2023-10-06T11:14:16.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.011+0000 7f493bfff700 1 -- 172.21.15.146:0/2143782036 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f493c148310 con 0x7f493c15a7f0 2023-10-06T11:14:16.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.012+0000 7f493bfff700 1 -- 172.21.15.146:0/2143782036 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f493c14b600 con 0x7f493c15a7f0 2023-10-06T11:14:16.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.012+0000 7f49337fe700 1 -- 172.21.15.146:0/2143782036 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4934014a60 con 0x7f493c15a7f0 2023-10-06T11:14:16.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.013+0000 7f49337fe700 1 --2- 172.21.15.146:0/2143782036 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f491c066f30 0x7f491c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:16.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.013+0000 7f49337fe700 1 -- 172.21.15.146:0/2143782036 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f4934084aa0 con 0x7f493c15a7f0 2023-10-06T11:14:16.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.013+0000 7f493affd700 1 --2- 172.21.15.146:0/2143782036 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f491c066f30 0x7f491c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:16.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.013+0000 7f493affd700 1 --2- 172.21.15.146:0/2143782036 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f491c066f30 0x7f491c0693e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f492c007fd0 tx=0x7f492c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:16.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.017+0000 7f49337fe700 1 -- 172.21.15.146:0/2143782036 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4934051f00 con 0x7f493c15a7f0 2023-10-06T11:14:16.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.205+0000 7f493bfff700 1 -- 172.21.15.146:0/2143782036 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f493c0afae0 con 0x7f493c15a7f0 2023-10-06T11:14:16.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.206+0000 7f49337fe700 1 -- 172.21.15.146:0/2143782036 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v109) v1 ==== 84+0+126 (secure 0 0 0) 0x7f4934055520 con 0x7f493c15a7f0 2023-10-06T11:14:16.207 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:16.208 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2023-10-06T11:14:16.208 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:14:16.208 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 1, 2023-10-06T11:14:16.208 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": "rbd" 2023-10-06T11:14:16.208 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:14:16.208 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:14:16.208 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 2, 2023-10-06T11:14:16.208 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": ".mgr" 2023-10-06T11:14:16.208 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:14:16.208 INFO:teuthology.orchestra.run.smithi146.stdout:] 2023-10-06T11:14:16.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.207+0000 7f493bfff700 1 -- 172.21.15.146:0/2143782036 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f491c066f30 msgr2=0x7f491c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:16.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.207+0000 7f493bfff700 1 --2- 172.21.15.146:0/2143782036 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f491c066f30 0x7f491c0693e0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f492c007fd0 tx=0x7f492c009040 comp rx=0 tx=0).stop 2023-10-06T11:14:16.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.207+0000 7f493bfff700 1 -- 172.21.15.146:0/2143782036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f493c15a7f0 msgr2=0x7f493c148a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:16.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.207+0000 7f493bfff700 1 --2- 172.21.15.146:0/2143782036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f493c15a7f0 0x7f493c148a10 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f4934007f20 tx=0x7f49340098a0 comp rx=0 tx=0).stop 2023-10-06T11:14:16.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.208+0000 7f493bfff700 1 -- 172.21.15.146:0/2143782036 shutdown_connections 2023-10-06T11:14:16.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.208+0000 7f493bfff700 1 --2- 172.21.15.146:0/2143782036 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f491c066f30 0x7f491c0693e0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:16.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.208+0000 7f493bfff700 1 --2- 172.21.15.146:0/2143782036 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f493c15a7f0 0x7f493c148a10 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:16.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.208+0000 7f493bfff700 1 --2- 172.21.15.146:0/2143782036 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f493c0b2530 0x7f493c14b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:16.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.208+0000 7f493bfff700 1 --2- 172.21.15.146:0/2143782036 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f493c15a420 0x7f493c147dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:16.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.208+0000 7f493bfff700 1 -- 172.21.15.146:0/2143782036 >> 172.21.15.146:0/2143782036 conn(0x7f493c06eba0 msgr2=0x7f493c0b0460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:16.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.208+0000 7f493bfff700 1 -- 172.21.15.146:0/2143782036 shutdown_connections 2023-10-06T11:14:16.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.208+0000 7f493bfff700 1 -- 172.21.15.146:0/2143782036 wait complete. 2023-10-06T11:14:16.222 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T11:14:16.223 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T11:14:16.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.339+0000 7efea2177700 1 Processor -- start 2023-10-06T11:14:16.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.339+0000 7efea2177700 1 -- start start 2023-10-06T11:14:16.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.340+0000 7efea2177700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7efe9c15a160 0x7efe9c0c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:16.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.340+0000 7efea2177700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efe9c0ae730 0x7efe9c0aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:16.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.340+0000 7efea2177700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe9c0ae2a0 con 0x7efe9c0ce3d0 2023-10-06T11:14:16.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.340+0000 7efea2177700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe9c15a530 con 0x7efe9c0ae730 2023-10-06T11:14:16.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.340+0000 7efea2177700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe9c0af0f0 con 0x7efe9c15a160 2023-10-06T11:14:16.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.340+0000 7efe9affd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efe9c0ae730 0x7efe9c0aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:16.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.340+0000 7efe9affd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efe9c0ae730 0x7efe9c0aebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35320/0 (socket says 172.21.15.146:35320) 2023-10-06T11:14:16.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.340+0000 7efe9affd700 1 -- 172.21.15.146:0/220573057 learned_addr learned my addr 172.21.15.146:0/220573057 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:16.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.340+0000 7efe9bfff700 1 --1- 172.21.15.146:0/220573057 >> v1:172.21.15.146:6789/0 conn(0x7efe9c0ce3d0 0x7efe9c0ce7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38732/0 (socket says 172.21.15.146:38732) 2023-10-06T11:14:16.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.340+0000 7efe9b7fe700 1 --2- 172.21.15.146:0/220573057 >> v2:172.21.15.151:3300/0 conn(0x7efe9c15a160 0x7efe9c0c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:16.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.341+0000 7efe9affd700 1 -- 172.21.15.146:0/220573057 >> v2:172.21.15.151:3300/0 conn(0x7efe9c15a160 msgr2=0x7efe9c0c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:16.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.341+0000 7efe9affd700 1 --2- 172.21.15.146:0/220573057 >> v2:172.21.15.151:3300/0 conn(0x7efe9c15a160 0x7efe9c0c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:16.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.341+0000 7efe9affd700 1 -- 172.21.15.146:0/220573057 >> v1:172.21.15.146:6789/0 conn(0x7efe9c0ce3d0 legacy=0x7efe9c0ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:16.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.341+0000 7efe9affd700 1 -- 172.21.15.146:0/220573057 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe9c0ad690 con 0x7efe9c0ae730 2023-10-06T11:14:16.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.341+0000 7efe9affd700 1 --2- 172.21.15.146:0/220573057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe9c0ae730 0x7efe9c0aebb0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7efe9c065100 tx=0x7efe90009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80e6d273e06c3fa6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:16.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.341+0000 7efe9a7fc700 1 -- 172.21.15.146:0/220573057 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe90009e70 con 0x7efe9c0ae730 2023-10-06T11:14:16.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.341+0000 7efe9a7fc700 1 -- 172.21.15.146:0/220573057 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe9000b860 con 0x7efe9c0ae730 2023-10-06T11:14:16.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.341+0000 7efe9a7fc700 1 -- 172.21.15.146:0/220573057 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe9000bc00 con 0x7efe9c0ae730 2023-10-06T11:14:16.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.341+0000 7efea2177700 1 -- 172.21.15.146:0/220573057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe9c0ae730 msgr2=0x7efe9c0aebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:16.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.341+0000 7efea2177700 1 --2- 172.21.15.146:0/220573057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe9c0ae730 0x7efe9c0aebb0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7efe9c065100 tx=0x7efe90009250 comp rx=0 tx=0).stop 2023-10-06T11:14:16.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.341+0000 7efea2177700 1 -- 172.21.15.146:0/220573057 shutdown_connections 2023-10-06T11:14:16.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.341+0000 7efea2177700 1 --2- 172.21.15.146:0/220573057 >> v2:172.21.15.151:3300/0 conn(0x7efe9c15a160 0x7efe9c0c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:16.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.341+0000 7efea2177700 1 --2- 172.21.15.146:0/220573057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe9c0ae730 0x7efe9c0aebb0 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:16.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.341+0000 7efea2177700 1 -- 172.21.15.146:0/220573057 >> 172.21.15.146:0/220573057 conn(0x7efe9c06f380 msgr2=0x7efe9c0d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:16.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.342+0000 7efea2177700 1 -- 172.21.15.146:0/220573057 shutdown_connections 2023-10-06T11:14:16.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.342+0000 7efea2177700 1 -- 172.21.15.146:0/220573057 wait complete. 2023-10-06T11:14:16.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.343+0000 7efea2177700 1 Processor -- start 2023-10-06T11:14:16.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.343+0000 7efea2177700 1 -- start start 2023-10-06T11:14:16.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.343+0000 7efea2177700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe9c0ae730 0x7efe9c15f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:16.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.343+0000 7efea2177700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe9c0ce3d0 0x7efe9c15d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:16.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.343+0000 7efea2177700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe9c15a160 0x7efe9c15d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:16.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.343+0000 7efea2177700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c15dc50 con 0x7efe9c15a160 2023-10-06T11:14:16.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.343+0000 7efea2177700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c16aa00 con 0x7efe9c0ce3d0 2023-10-06T11:14:16.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.343+0000 7efea2177700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c16ace0 con 0x7efe9c0ae730 2023-10-06T11:14:16.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.344+0000 7efe9bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe9c15a160 0x7efe9c15d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:16.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.344+0000 7efe9bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe9c15a160 0x7efe9c15d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35328/0 (socket says 172.21.15.146:35328) 2023-10-06T11:14:16.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.344+0000 7efe9bfff700 1 -- 172.21.15.146:0/51543526 learned_addr learned my addr 172.21.15.146:0/51543526 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:16.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.344+0000 7efe9b7fe700 1 --2- 172.21.15.146:0/51543526 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe9c0ae730 0x7efe9c15f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:16.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.344+0000 7efe9affd700 1 --2- 172.21.15.146:0/51543526 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe9c0ce3d0 0x7efe9c15d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:16.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.344+0000 7efe9bfff700 1 -- 172.21.15.146:0/51543526 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe9c0ae730 msgr2=0x7efe9c15f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:16.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.344+0000 7efe9bfff700 1 --2- 172.21.15.146:0/51543526 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe9c0ae730 0x7efe9c15f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:16.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.344+0000 7efe9bfff700 1 -- 172.21.15.146:0/51543526 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe9c0ce3d0 msgr2=0x7efe9c15d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:16.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.344+0000 7efe9bfff700 1 --2- 172.21.15.146:0/51543526 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe9c0ce3d0 0x7efe9c15d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:16.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.344+0000 7efe9bfff700 1 -- 172.21.15.146:0/51543526 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe900094f0 con 0x7efe9c15a160 2023-10-06T11:14:16.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.344+0000 7efe9bfff700 1 --2- 172.21.15.146:0/51543526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe9c15a160 0x7efe9c15d710 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7efe9400c590 tx=0x7efe94007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:16.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.344+0000 7efe837fe700 1 -- 172.21.15.146:0/51543526 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe94005a70 con 0x7efe9c15a160 2023-10-06T11:14:16.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.344+0000 7efe837fe700 1 -- 172.21.15.146:0/51543526 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe94005bf0 con 0x7efe9c15a160 2023-10-06T11:14:16.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.344+0000 7efea2177700 1 -- 172.21.15.146:0/51543526 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe9c16afc0 con 0x7efe9c15a160 2023-10-06T11:14:16.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.344+0000 7efe837fe700 1 -- 172.21.15.146:0/51543526 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe940070d0 con 0x7efe9c15a160 2023-10-06T11:14:16.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.344+0000 7efea2177700 1 -- 172.21.15.146:0/51543526 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe9c0c8880 con 0x7efe9c15a160 2023-10-06T11:14:16.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.345+0000 7efea2177700 1 -- 172.21.15.146:0/51543526 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe9c0b4d50 con 0x7efe9c15a160 2023-10-06T11:14:16.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.346+0000 7efe837fe700 1 -- 172.21.15.146:0/51543526 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efe940074c0 con 0x7efe9c15a160 2023-10-06T11:14:16.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.346+0000 7efe837fe700 1 --2- 172.21.15.146:0/51543526 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7efe88066f30 0x7efe880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:16.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.346+0000 7efe837fe700 1 -- 172.21.15.146:0/51543526 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5206+0+0 (secure 0 0 0) 0x7efe940837e0 con 0x7efe9c15a160 2023-10-06T11:14:16.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.346+0000 7efe9b7fe700 1 --2- 172.21.15.146:0/51543526 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7efe88066f30 0x7efe880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:16.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.346+0000 7efe9b7fe700 1 --2- 172.21.15.146:0/51543526 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7efe88066f30 0x7efe880693e0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7efe8c0094d0 tx=0x7efe8c00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:16.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.350+0000 7efe837fe700 1 -- 172.21.15.146:0/51543526 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efe9c0b4d50 con 0x7efe9c15a160 2023-10-06T11:14:16.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:16.535+0000 7efea2177700 1 -- 172.21.15.146:0/51543526 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7efe9c0b4d50 con 0x7efe9c15a160 2023-10-06T11:14:17.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.496+0000 7efe837fe700 1 -- 172.21.15.146:0/51543526 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v110) v1 ==== 138+0+0 (secure 0 0 0) 0x7efe9c0b4d50 con 0x7efe9c15a160 2023-10-06T11:14:17.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.503+0000 7efea2177700 1 -- 172.21.15.146:0/51543526 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7efe88066f30 msgr2=0x7efe880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:17.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.503+0000 7efea2177700 1 --2- 172.21.15.146:0/51543526 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7efe88066f30 0x7efe880693e0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7efe8c0094d0 tx=0x7efe8c00b040 comp rx=0 tx=0).stop 2023-10-06T11:14:17.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.503+0000 7efea2177700 1 -- 172.21.15.146:0/51543526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe9c15a160 msgr2=0x7efe9c15d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:17.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.503+0000 7efea2177700 1 --2- 172.21.15.146:0/51543526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe9c15a160 0x7efe9c15d710 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7efe9400c590 tx=0x7efe94007ef0 comp rx=0 tx=0).stop 2023-10-06T11:14:17.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.504+0000 7efea2177700 1 -- 172.21.15.146:0/51543526 shutdown_connections 2023-10-06T11:14:17.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.504+0000 7efea2177700 1 --2- 172.21.15.146:0/51543526 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7efe88066f30 0x7efe880693e0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:17.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.504+0000 7efea2177700 1 --2- 172.21.15.146:0/51543526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efe9c15a160 0x7efe9c15d710 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:17.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.504+0000 7efea2177700 1 --2- 172.21.15.146:0/51543526 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe9c0ae730 0x7efe9c15f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:17.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.504+0000 7efea2177700 1 --2- 172.21.15.146:0/51543526 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe9c0ce3d0 0x7efe9c15d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:17.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.504+0000 7efea2177700 1 -- 172.21.15.146:0/51543526 >> 172.21.15.146:0/51543526 conn(0x7efe9c06f380 msgr2=0x7efe9c0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:17.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.504+0000 7efea2177700 1 -- 172.21.15.146:0/51543526 shutdown_connections 2023-10-06T11:14:17.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.504+0000 7efea2177700 1 -- 172.21.15.146:0/51543526 wait complete. 2023-10-06T11:14:17.507 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' created 2023-10-06T11:14:17.520 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T11:14:17.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.647+0000 7f70e1e26700 1 Processor -- start 2023-10-06T11:14:17.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.647+0000 7f70e1e26700 1 -- start start 2023-10-06T11:14:17.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.647+0000 7f70e1e26700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f70dc1596b0 0x7f70dc15a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:17.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.647+0000 7f70e1e26700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70dc0cebf0 0x7f70dc0ad250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:17.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.647+0000 7f70e1e26700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f70dc0ad790 0x7f70dc0697a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:17.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.647+0000 7f70e1e26700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70dc15aec0 con 0x7f70dc1596b0 2023-10-06T11:14:17.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.647+0000 7f70e1e26700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70dc0acdc0 con 0x7f70dc0ad790 2023-10-06T11:14:17.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.647+0000 7f70e1e26700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70dc0ac1b0 con 0x7f70dc0cebf0 2023-10-06T11:14:17.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.648+0000 7f70db7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f70dc1596b0 0x7f70dc15a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:17.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.648+0000 7f70db7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f70dc1596b0 0x7f70dc15a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35340/0 (socket says 172.21.15.146:35340) 2023-10-06T11:14:17.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.648+0000 7f70db7fe700 1 -- 172.21.15.146:0/3718170217 learned_addr learned my addr 172.21.15.146:0/3718170217 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:17.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.648+0000 7f70dbfff700 1 --2- 172.21.15.146:0/3718170217 >> v2:172.21.15.151:3300/0 conn(0x7f70dc0ad790 0x7f70dc0697a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:17.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.648+0000 7f70daffd700 1 --2- 172.21.15.146:0/3718170217 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70dc0cebf0 0x7f70dc0ad250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:17.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.648+0000 7f70db7fe700 1 -- 172.21.15.146:0/3718170217 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70dc0cebf0 msgr2=0x7f70dc0ad250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:17.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.648+0000 7f70db7fe700 1 --2- 172.21.15.146:0/3718170217 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70dc0cebf0 0x7f70dc0ad250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:17.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.648+0000 7f70db7fe700 1 -- 172.21.15.146:0/3718170217 >> v2:172.21.15.151:3300/0 conn(0x7f70dc0ad790 msgr2=0x7f70dc0697a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:17.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.648+0000 7f70db7fe700 1 --2- 172.21.15.146:0/3718170217 >> v2:172.21.15.151:3300/0 conn(0x7f70dc0ad790 0x7f70dc0697a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:17.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.648+0000 7f70db7fe700 1 -- 172.21.15.146:0/3718170217 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70dc0ac490 con 0x7f70dc1596b0 2023-10-06T11:14:17.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.648+0000 7f70db7fe700 1 --2- 172.21.15.146:0/3718170217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70dc1596b0 0x7f70dc15a980 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f70dc0acd30 tx=0x7f70d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e523f489228a87c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:17.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.648+0000 7f70da7fc700 1 -- 172.21.15.146:0/3718170217 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d0009e70 con 0x7f70dc1596b0 2023-10-06T11:14:17.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.648+0000 7f70da7fc700 1 -- 172.21.15.146:0/3718170217 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d000b860 con 0x7f70dc1596b0 2023-10-06T11:14:17.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.648+0000 7f70da7fc700 1 -- 172.21.15.146:0/3718170217 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d000bc00 con 0x7f70dc1596b0 2023-10-06T11:14:17.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.649+0000 7f70e1e26700 1 -- 172.21.15.146:0/3718170217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70dc1596b0 msgr2=0x7f70dc15a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:17.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.649+0000 7f70e1e26700 1 --2- 172.21.15.146:0/3718170217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70dc1596b0 0x7f70dc15a980 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f70dc0acd30 tx=0x7f70d0009250 comp rx=0 tx=0).stop 2023-10-06T11:14:17.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.649+0000 7f70e1e26700 1 -- 172.21.15.146:0/3718170217 shutdown_connections 2023-10-06T11:14:17.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.649+0000 7f70e1e26700 1 --2- 172.21.15.146:0/3718170217 >> v2:172.21.15.151:3300/0 conn(0x7f70dc0ad790 0x7f70dc0697a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:17.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.649+0000 7f70e1e26700 1 --2- 172.21.15.146:0/3718170217 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70dc1596b0 0x7f70dc15a980 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:17.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.649+0000 7f70e1e26700 1 --2- 172.21.15.146:0/3718170217 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70dc0cebf0 0x7f70dc0ad250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:17.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.649+0000 7f70e1e26700 1 -- 172.21.15.146:0/3718170217 >> 172.21.15.146:0/3718170217 conn(0x7f70dc067c50 msgr2=0x7f70dc0ce470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:17.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.649+0000 7f70e1e26700 1 -- 172.21.15.146:0/3718170217 shutdown_connections 2023-10-06T11:14:17.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.649+0000 7f70e1e26700 1 -- 172.21.15.146:0/3718170217 wait complete. 2023-10-06T11:14:17.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.650+0000 7f70e1e26700 1 Processor -- start 2023-10-06T11:14:17.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.650+0000 7f70e1e26700 1 -- start start 2023-10-06T11:14:17.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.651+0000 7f70e1e26700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70dc0ad790 0x7f70dc09a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:17.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.651+0000 7f70e1e26700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70dc0cebf0 0x7f70dc0687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:17.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.651+0000 7f70e1e26700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70dc1596b0 0x7f70dc153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:17.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.651+0000 7f70e1e26700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70dc155420 con 0x7f70dc1596b0 2023-10-06T11:14:17.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.651+0000 7f70e1e26700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70dc09af20 con 0x7f70dc0ad790 2023-10-06T11:14:17.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.651+0000 7f70e1e26700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70dc09b200 con 0x7f70dc0cebf0 2023-10-06T11:14:17.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.651+0000 7f70dbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70dc1596b0 0x7f70dc153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:17.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.651+0000 7f70dbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70dc1596b0 0x7f70dc153f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35344/0 (socket says 172.21.15.146:35344) 2023-10-06T11:14:17.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.651+0000 7f70dbfff700 1 -- 172.21.15.146:0/603552365 learned_addr learned my addr 172.21.15.146:0/603552365 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:17.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.651+0000 7f70db7fe700 1 --2- 172.21.15.146:0/603552365 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70dc0ad790 0x7f70dc09a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:17.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.651+0000 7f70daffd700 1 --2- 172.21.15.146:0/603552365 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70dc0cebf0 0x7f70dc0687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:17.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.651+0000 7f70dbfff700 1 -- 172.21.15.146:0/603552365 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70dc0cebf0 msgr2=0x7f70dc0687d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:17.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.651+0000 7f70dbfff700 1 --2- 172.21.15.146:0/603552365 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70dc0cebf0 0x7f70dc0687d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:17.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.651+0000 7f70dbfff700 1 -- 172.21.15.146:0/603552365 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70dc0ad790 msgr2=0x7f70dc09a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:17.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.651+0000 7f70dbfff700 1 --2- 172.21.15.146:0/603552365 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70dc0ad790 0x7f70dc09a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:17.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.651+0000 7f70dbfff700 1 -- 172.21.15.146:0/603552365 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d00094f0 con 0x7f70dc1596b0 2023-10-06T11:14:17.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.652+0000 7f70dbfff700 1 --2- 172.21.15.146:0/603552365 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70dc1596b0 0x7f70dc153f10 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f70d4009ef0 tx=0x7f70d400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:17.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.652+0000 7f70c37fe700 1 -- 172.21.15.146:0/603552365 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d400cb70 con 0x7f70dc1596b0 2023-10-06T11:14:17.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.652+0000 7f70c37fe700 1 -- 172.21.15.146:0/603552365 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d400f040 con 0x7f70dc1596b0 2023-10-06T11:14:17.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.652+0000 7f70e1e26700 1 -- 172.21.15.146:0/603552365 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70dc0981a0 con 0x7f70dc1596b0 2023-10-06T11:14:17.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.652+0000 7f70c37fe700 1 -- 172.21.15.146:0/603552365 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d4014480 con 0x7f70dc1596b0 2023-10-06T11:14:17.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.652+0000 7f70e1e26700 1 -- 172.21.15.146:0/603552365 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70dc09b4e0 con 0x7f70dc1596b0 2023-10-06T11:14:17.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.653+0000 7f70e1e26700 1 -- 172.21.15.146:0/603552365 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70dc04c380 con 0x7f70dc1596b0 2023-10-06T11:14:17.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.653+0000 7f70c37fe700 1 -- 172.21.15.146:0/603552365 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f70d40147f0 con 0x7f70dc1596b0 2023-10-06T11:14:17.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.654+0000 7f70c37fe700 1 --2- 172.21.15.146:0/603552365 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f70c8066f30 0x7f70c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:17.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.654+0000 7f70c37fe700 1 -- 172.21.15.146:0/603552365 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f70d40850f0 con 0x7f70dc1596b0 2023-10-06T11:14:17.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.654+0000 7f70db7fe700 1 --2- 172.21.15.146:0/603552365 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f70c8066f30 0x7f70c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:17.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.654+0000 7f70db7fe700 1 --2- 172.21.15.146:0/603552365 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f70c8066f30 0x7f70c80693e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f70dc0acd30 tx=0x7f70d0017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:17.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.658+0000 7f70c37fe700 1 -- 172.21.15.146:0/603552365 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f70d40523e0 con 0x7f70dc1596b0 2023-10-06T11:14:17.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:17.840+0000 7f70e1e26700 1 -- 172.21.15.146:0/603552365 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f70dc0ac770 con 0x7f70dc1596b0 2023-10-06T11:14:18.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.500+0000 7f70c37fe700 1 -- 172.21.15.146:0/603552365 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v111) v1 ==== 170+0+0 (secure 0 0 0) 0x7f70d4055a00 con 0x7f70dc1596b0 2023-10-06T11:14:18.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.503+0000 7f70e1e26700 1 -- 172.21.15.146:0/603552365 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f70c8066f30 msgr2=0x7f70c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:18.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.503+0000 7f70e1e26700 1 --2- 172.21.15.146:0/603552365 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f70c8066f30 0x7f70c80693e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f70dc0acd30 tx=0x7f70d0017000 comp rx=0 tx=0).stop 2023-10-06T11:14:18.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.503+0000 7f70e1e26700 1 -- 172.21.15.146:0/603552365 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70dc1596b0 msgr2=0x7f70dc153f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:18.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.503+0000 7f70e1e26700 1 --2- 172.21.15.146:0/603552365 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70dc1596b0 0x7f70dc153f10 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f70d4009ef0 tx=0x7f70d400b040 comp rx=0 tx=0).stop 2023-10-06T11:14:18.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.509+0000 7f70e1e26700 1 -- 172.21.15.146:0/603552365 shutdown_connections 2023-10-06T11:14:18.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.510+0000 7f70e1e26700 1 --2- 172.21.15.146:0/603552365 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f70c8066f30 0x7f70c80693e0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:18.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.510+0000 7f70e1e26700 1 --2- 172.21.15.146:0/603552365 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f70dc1596b0 0x7f70dc153f10 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:18.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.510+0000 7f70e1e26700 1 --2- 172.21.15.146:0/603552365 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70dc0ad790 0x7f70dc09a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:18.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.510+0000 7f70e1e26700 1 --2- 172.21.15.146:0/603552365 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f70dc0cebf0 0x7f70dc0687d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:18.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.510+0000 7f70e1e26700 1 -- 172.21.15.146:0/603552365 >> 172.21.15.146:0/603552365 conn(0x7f70dc067c50 msgr2=0x7f70dc06cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:18.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.511+0000 7f70e1e26700 1 -- 172.21.15.146:0/603552365 shutdown_connections 2023-10-06T11:14:18.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.515+0000 7f70e1e26700 1 -- 172.21.15.146:0/603552365 wait complete. 2023-10-06T11:14:18.520 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' created 2023-10-06T11:14:18.533 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T11:14:18.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.649+0000 7f14b0066700 1 Processor -- start 2023-10-06T11:14:18.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.650+0000 7f14b0066700 1 -- start start 2023-10-06T11:14:18.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.650+0000 7f14b0066700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14a815a9c0 0x7f14a8069850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:18.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.650+0000 7f14b0066700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f14a815ae10 0x7f14a8069d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:18.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.650+0000 7f14b0066700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14a80aff10 con 0x7f14a8159b80 2023-10-06T11:14:18.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.650+0000 7f14b0066700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14a80cee40 con 0x7f14a815ae10 2023-10-06T11:14:18.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.650+0000 7f14b0066700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a80af090 con 0x7f14a815a9c0 2023-10-06T11:14:18.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.651+0000 7f14ae603700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f14a815ae10 0x7f14a8069d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:18.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.651+0000 7f14ae603700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f14a815ae10 0x7f14a8069d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35356/0 (socket says 172.21.15.146:35356) 2023-10-06T11:14:18.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.651+0000 7f14ae603700 1 -- 172.21.15.146:0/3886022280 learned_addr learned my addr 172.21.15.146:0/3886022280 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:18.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.651+0000 7f14ad601700 1 --2- 172.21.15.146:0/3886022280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14a815a9c0 0x7f14a8069850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:18.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.651+0000 7f14ae603700 1 -- 172.21.15.146:0/3886022280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14a815a9c0 msgr2=0x7f14a8069850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:18.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.651+0000 7f14ace00700 1 -- 172.21.15.146:0/3886022280 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1341124810 0 0) 0x7f14a80aff10 con 0x7f14a8159b80 2023-10-06T11:14:18.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.651+0000 7f14ae603700 1 --2- 172.21.15.146:0/3886022280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14a815a9c0 0x7f14a8069850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:18.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.651+0000 7f14ae603700 1 -- 172.21.15.146:0/3886022280 >> v1:172.21.15.151:6789/0 conn(0x7f14a8159b80 legacy=0x7f14a80abfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:18.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.651+0000 7f14ae603700 1 -- 172.21.15.146:0/3886022280 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a80ac6b0 con 0x7f14a815ae10 2023-10-06T11:14:18.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.651+0000 7f14ae603700 1 --2- 172.21.15.146:0/3886022280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14a815ae10 0x7f14a8069d90 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f14a00099b0 tx=0x7f14a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a29c6a050b79653 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:18.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.651+0000 7f14ace00700 1 -- 172.21.15.146:0/3886022280 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a0009ea0 con 0x7f14a815ae10 2023-10-06T11:14:18.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.652+0000 7f14ace00700 1 -- 172.21.15.146:0/3886022280 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a000b8f0 con 0x7f14a815ae10 2023-10-06T11:14:18.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.652+0000 7f14ace00700 1 -- 172.21.15.146:0/3886022280 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a000bc90 con 0x7f14a815ae10 2023-10-06T11:14:18.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.652+0000 7f14b0066700 1 -- 172.21.15.146:0/3886022280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14a815ae10 msgr2=0x7f14a8069d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:18.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.652+0000 7f14b0066700 1 --2- 172.21.15.146:0/3886022280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14a815ae10 0x7f14a8069d90 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f14a00099b0 tx=0x7f14a0009250 comp rx=0 tx=0).stop 2023-10-06T11:14:18.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.652+0000 7f14b0066700 1 -- 172.21.15.146:0/3886022280 shutdown_connections 2023-10-06T11:14:18.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.652+0000 7f14b0066700 1 --2- 172.21.15.146:0/3886022280 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14a815ae10 0x7f14a8069d90 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:18.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.652+0000 7f14b0066700 1 --2- 172.21.15.146:0/3886022280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14a815a9c0 0x7f14a8069850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:18.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.652+0000 7f14b0066700 1 -- 172.21.15.146:0/3886022280 >> 172.21.15.146:0/3886022280 conn(0x7f14a8067c50 msgr2=0x7f14a80ce400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:18.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.652+0000 7f14b0066700 1 -- 172.21.15.146:0/3886022280 shutdown_connections 2023-10-06T11:14:18.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.652+0000 7f14b0066700 1 -- 172.21.15.146:0/3886022280 wait complete. 2023-10-06T11:14:18.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.653+0000 7f14b0066700 1 Processor -- start 2023-10-06T11:14:18.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.653+0000 7f14b0066700 1 -- start start 2023-10-06T11:14:18.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.654+0000 7f14b0066700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14a8159b80 0x7f14a8155e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:18.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.654+0000 7f14b0066700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14a815a9c0 0x7f14a80b26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:18.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.654+0000 7f14b0066700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14a815ae10 0x7f14a80b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:18.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.654+0000 7f14b0066700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a81563a0 con 0x7f14a815ae10 2023-10-06T11:14:18.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.654+0000 7f14b0066700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a816cb70 con 0x7f14a8159b80 2023-10-06T11:14:18.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.654+0000 7f14b0066700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a816ce50 con 0x7f14a815a9c0 2023-10-06T11:14:18.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.654+0000 7f14ae603700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14a815ae10 0x7f14a80b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:18.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.654+0000 7f14ae603700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14a815ae10 0x7f14a80b2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35368/0 (socket says 172.21.15.146:35368) 2023-10-06T11:14:18.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.654+0000 7f14ae603700 1 -- 172.21.15.146:0/1293639412 learned_addr learned my addr 172.21.15.146:0/1293639412 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:18.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.654+0000 7f14ade02700 1 --2- 172.21.15.146:0/1293639412 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14a8159b80 0x7f14a8155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:18.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.655+0000 7f14ad601700 1 --2- 172.21.15.146:0/1293639412 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14a815a9c0 0x7f14a80b26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:18.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.655+0000 7f14ae603700 1 -- 172.21.15.146:0/1293639412 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14a815a9c0 msgr2=0x7f14a80b26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:18.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.655+0000 7f14ae603700 1 --2- 172.21.15.146:0/1293639412 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14a815a9c0 0x7f14a80b26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:18.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.655+0000 7f14ae603700 1 -- 172.21.15.146:0/1293639412 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14a8159b80 msgr2=0x7f14a8155e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:18.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.655+0000 7f14ae603700 1 --2- 172.21.15.146:0/1293639412 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14a8159b80 0x7f14a8155e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:18.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.655+0000 7f14ae603700 1 -- 172.21.15.146:0/1293639412 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a00094f0 con 0x7f14a815ae10 2023-10-06T11:14:18.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.655+0000 7f14ad601700 1 --2- 172.21.15.146:0/1293639412 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14a815a9c0 0x7f14a80b26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:18.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.655+0000 7f14ae603700 1 --2- 172.21.15.146:0/1293639412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14a815ae10 0x7f14a80b2c00 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f14a0006fd0 tx=0x7f14a0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:18.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.655+0000 7f149dffb700 1 -- 172.21.15.146:0/1293639412 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a0025420 con 0x7f14a815ae10 2023-10-06T11:14:18.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.655+0000 7f149dffb700 1 -- 172.21.15.146:0/1293639412 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a0025580 con 0x7f14a815ae10 2023-10-06T11:14:18.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.655+0000 7f14b0066700 1 -- 172.21.15.146:0/1293639412 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14a816d130 con 0x7f14a815ae10 2023-10-06T11:14:18.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.655+0000 7f149dffb700 1 -- 172.21.15.146:0/1293639412 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a0025920 con 0x7f14a815ae10 2023-10-06T11:14:18.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.655+0000 7f14b0066700 1 -- 172.21.15.146:0/1293639412 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14a816d6f0 con 0x7f14a815ae10 2023-10-06T11:14:18.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.656+0000 7f14b0066700 1 -- 172.21.15.146:0/1293639412 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14a816d8e0 con 0x7f14a815ae10 2023-10-06T11:14:18.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.657+0000 7f149dffb700 1 -- 172.21.15.146:0/1293639412 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f14a0023070 con 0x7f14a815ae10 2023-10-06T11:14:18.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.657+0000 7f149dffb700 1 --2- 172.21.15.146:0/1293639412 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f148c066f30 0x7f148c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:18.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.657+0000 7f149dffb700 1 -- 172.21.15.146:0/1293639412 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f14a0086180 con 0x7f14a815ae10 2023-10-06T11:14:18.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.657+0000 7f14ade02700 1 --2- 172.21.15.146:0/1293639412 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f148c066f30 0x7f148c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:18.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.657+0000 7f14ade02700 1 --2- 172.21.15.146:0/1293639412 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f148c066f30 0x7f148c0693e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f14a4001560 tx=0x7f14a4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:18.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.662+0000 7f149dffb700 1 -- 172.21.15.146:0/1293639412 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f14a00532f0 con 0x7f14a815ae10 2023-10-06T11:14:18.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:18.890+0000 7f14b0066700 1 -- 172.21.15.146:0/1293639412 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f14a804c380 con 0x7f14a815ae10 2023-10-06T11:14:19.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.521+0000 7f149dffb700 1 -- 172.21.15.146:0/1293639412 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v97) v1 ==== 174+0+0 (secure 0 0 0) 0x7f14a0056910 con 0x7f14a815ae10 2023-10-06T11:14:19.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.530+0000 7f14b0066700 1 -- 172.21.15.146:0/1293639412 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f148c066f30 msgr2=0x7f148c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:19.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.530+0000 7f14b0066700 1 --2- 172.21.15.146:0/1293639412 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f148c066f30 0x7f148c0693e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f14a4001560 tx=0x7f14a4009040 comp rx=0 tx=0).stop 2023-10-06T11:14:19.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.530+0000 7f14b0066700 1 -- 172.21.15.146:0/1293639412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14a815ae10 msgr2=0x7f14a80b2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:19.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.530+0000 7f14b0066700 1 --2- 172.21.15.146:0/1293639412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14a815ae10 0x7f14a80b2c00 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f14a0006fd0 tx=0x7f14a0017000 comp rx=0 tx=0).stop 2023-10-06T11:14:19.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.530+0000 7f14b0066700 1 -- 172.21.15.146:0/1293639412 shutdown_connections 2023-10-06T11:14:19.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.530+0000 7f14b0066700 1 --2- 172.21.15.146:0/1293639412 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f148c066f30 0x7f148c0693e0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:19.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.530+0000 7f14b0066700 1 --2- 172.21.15.146:0/1293639412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14a815ae10 0x7f14a80b2c00 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:19.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.530+0000 7f14b0066700 1 --2- 172.21.15.146:0/1293639412 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14a8159b80 0x7f14a8155e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:19.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.530+0000 7f14b0066700 1 --2- 172.21.15.146:0/1293639412 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14a815a9c0 0x7f14a80b26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:19.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.530+0000 7f14b0066700 1 -- 172.21.15.146:0/1293639412 >> 172.21.15.146:0/1293639412 conn(0x7f14a8067c50 msgr2=0x7f14a80b03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:19.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.530+0000 7f14b0066700 1 -- 172.21.15.146:0/1293639412 shutdown_connections 2023-10-06T11:14:19.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.530+0000 7f14b0066700 1 -- 172.21.15.146:0/1293639412 wait complete. 2023-10-06T11:14:19.539 INFO:teuthology.orchestra.run.smithi146.stderr:new fs with metadata pool 17 and data pool 18 2023-10-06T11:14:19.553 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:14:19.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.669+0000 7f629589c700 1 Processor -- start 2023-10-06T11:14:19.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.669+0000 7f629589c700 1 -- start start 2023-10-06T11:14:19.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.670+0000 7f629589c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6290153ab0 0x7f629015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:19.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.670+0000 7f629589c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6290068ba0 0x7f62900b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:19.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.670+0000 7f629589c700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f629015ac30 con 0x7f6290153e80 2023-10-06T11:14:19.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.670+0000 7f629589c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62900b4510 con 0x7f6290153ab0 2023-10-06T11:14:19.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.670+0000 7f629589c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62900b6530 con 0x7f6290068ba0 2023-10-06T11:14:19.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.670+0000 7f628effd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6290153ab0 0x7f629015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:19.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.670+0000 7f628effd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6290153ab0 0x7f629015a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35372/0 (socket says 172.21.15.146:35372) 2023-10-06T11:14:19.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.670+0000 7f628effd700 1 -- 172.21.15.146:0/144823504 learned_addr learned my addr 172.21.15.146:0/144823504 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:19.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.670+0000 7f628f7fe700 1 --2- 172.21.15.146:0/144823504 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6290068ba0 0x7f62900b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:19.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.670+0000 7f628effd700 1 -- 172.21.15.146:0/144823504 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6290068ba0 msgr2=0x7f62900b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:19.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.670+0000 7f628effd700 1 --2- 172.21.15.146:0/144823504 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6290068ba0 0x7f62900b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:19.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.670+0000 7f628effd700 1 -- 172.21.15.146:0/144823504 >> v1:172.21.15.151:6789/0 conn(0x7f6290153e80 legacy=0x7f6290068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:19.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.670+0000 7f628effd700 1 -- 172.21.15.146:0/144823504 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62900b5c50 con 0x7f6290153ab0 2023-10-06T11:14:19.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.670+0000 7f628f7fe700 1 --2- 172.21.15.146:0/144823504 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6290068ba0 0x7f62900b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:19.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.670+0000 7f628effd700 1 --2- 172.21.15.146:0/144823504 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6290153ab0 0x7f629015a6f0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f62800099b0 tx=0x7f6280009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28bf12710dabd4c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:19.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.671+0000 7f628e7fc700 1 -- 172.21.15.146:0/144823504 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628000b860 con 0x7f6290153ab0 2023-10-06T11:14:19.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.671+0000 7f628e7fc700 1 -- 172.21.15.146:0/144823504 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628000b9c0 con 0x7f6290153ab0 2023-10-06T11:14:19.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.671+0000 7f628e7fc700 1 -- 172.21.15.146:0/144823504 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f628000bd60 con 0x7f6290153ab0 2023-10-06T11:14:19.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.671+0000 7f629589c700 1 -- 172.21.15.146:0/144823504 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6290153ab0 msgr2=0x7f629015a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:19.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.671+0000 7f629589c700 1 --2- 172.21.15.146:0/144823504 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6290153ab0 0x7f629015a6f0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f62800099b0 tx=0x7f6280009250 comp rx=0 tx=0).stop 2023-10-06T11:14:19.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.671+0000 7f629589c700 1 -- 172.21.15.146:0/144823504 shutdown_connections 2023-10-06T11:14:19.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.671+0000 7f629589c700 1 --2- 172.21.15.146:0/144823504 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6290068ba0 0x7f62900b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:19.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.671+0000 7f629589c700 1 --2- 172.21.15.146:0/144823504 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6290153ab0 0x7f629015a6f0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:19.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.671+0000 7f629589c700 1 -- 172.21.15.146:0/144823504 >> 172.21.15.146:0/144823504 conn(0x7f629006eba0 msgr2=0x7f629006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:19.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.671+0000 7f629589c700 1 -- 172.21.15.146:0/144823504 shutdown_connections 2023-10-06T11:14:19.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.671+0000 7f629589c700 1 -- 172.21.15.146:0/144823504 wait complete. 2023-10-06T11:14:19.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.672+0000 7f629589c700 1 Processor -- start 2023-10-06T11:14:19.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.672+0000 7f629589c700 1 -- start start 2023-10-06T11:14:19.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.673+0000 7f629589c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6290068ba0 0x7f6290159190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:19.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.673+0000 7f629589c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6290153ab0 0x7f6290156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:19.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.673+0000 7f629589c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6290153e80 0x7f629015e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:19.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.673+0000 7f629589c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6290157280 con 0x7f6290153ab0 2023-10-06T11:14:19.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.673+0000 7f629589c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6290157560 con 0x7f6290153e80 2023-10-06T11:14:19.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.673+0000 7f629589c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6290157840 con 0x7f6290068ba0 2023-10-06T11:14:19.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.673+0000 7f62867fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6290153ab0 0x7f6290156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:19.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.673+0000 7f62867fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6290153ab0 0x7f6290156a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35382/0 (socket says 172.21.15.146:35382) 2023-10-06T11:14:19.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.673+0000 7f62867fc700 1 -- 172.21.15.146:0/4059008333 learned_addr learned my addr 172.21.15.146:0/4059008333 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:19.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.673+0000 7f628effd700 1 --2- 172.21.15.146:0/4059008333 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6290068ba0 0x7f6290159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:19.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.673+0000 7f628f7fe700 1 --2- 172.21.15.146:0/4059008333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6290153e80 0x7f629015e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:19.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.674+0000 7f62867fc700 1 -- 172.21.15.146:0/4059008333 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6290068ba0 msgr2=0x7f6290159190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:19.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.674+0000 7f62867fc700 1 --2- 172.21.15.146:0/4059008333 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6290068ba0 0x7f6290159190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:19.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.674+0000 7f62867fc700 1 -- 172.21.15.146:0/4059008333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6290153e80 msgr2=0x7f629015e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:19.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.674+0000 7f62867fc700 1 --2- 172.21.15.146:0/4059008333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6290153e80 0x7f629015e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:19.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.674+0000 7f62867fc700 1 -- 172.21.15.146:0/4059008333 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62800094f0 con 0x7f6290153ab0 2023-10-06T11:14:19.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.674+0000 7f62867fc700 1 --2- 172.21.15.146:0/4059008333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6290153ab0 0x7f6290156a30 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f627800c790 tx=0x7f6278007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:19.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.674+0000 7f62877fe700 1 -- 172.21.15.146:0/4059008333 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6278011590 con 0x7f6290153ab0 2023-10-06T11:14:19.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.674+0000 7f62877fe700 1 -- 172.21.15.146:0/4059008333 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6278011710 con 0x7f6290153ab0 2023-10-06T11:14:19.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.674+0000 7f629589c700 1 -- 172.21.15.146:0/4059008333 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6290157b20 con 0x7f6290153ab0 2023-10-06T11:14:19.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.674+0000 7f62877fe700 1 -- 172.21.15.146:0/4059008333 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6278011ad0 con 0x7f6290153ab0 2023-10-06T11:14:19.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.674+0000 7f629589c700 1 -- 172.21.15.146:0/4059008333 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6290156f70 con 0x7f6290153ab0 2023-10-06T11:14:19.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.675+0000 7f629589c700 1 -- 172.21.15.146:0/4059008333 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f629004c380 con 0x7f6290153ab0 2023-10-06T11:14:19.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.675+0000 7f62877fe700 1 -- 172.21.15.146:0/4059008333 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f627801b3b0 con 0x7f6290153ab0 2023-10-06T11:14:19.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.676+0000 7f62877fe700 1 --2- 172.21.15.146:0/4059008333 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6270066f30 0x7f62700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:19.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.676+0000 7f628effd700 1 --2- 172.21.15.146:0/4059008333 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6270066f30 0x7f62700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:19.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.676+0000 7f62877fe700 1 -- 172.21.15.146:0/4059008333 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6278083860 con 0x7f6290153ab0 2023-10-06T11:14:19.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.676+0000 7f628effd700 1 --2- 172.21.15.146:0/4059008333 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6270066f30 0x7f62700693e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f62800099b0 tx=0x7f6280017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:19.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.680+0000 7f62877fe700 1 -- 172.21.15.146:0/4059008333 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6278050970 con 0x7f6290153ab0 2023-10-06T11:14:19.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.862+0000 7f629589c700 1 -- 172.21.15.146:0/4059008333 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f629015ac30 con 0x7f6290153ab0 2023-10-06T11:14:19.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.863+0000 7f62877fe700 1 -- 172.21.15.146:0/4059008333 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+16941 (secure 0 0 0) 0x7f629015ac30 con 0x7f6290153ab0 2023-10-06T11:14:19.865 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:19.865 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":112,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:14:18.891630+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:14:16.553437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-10-06T11:14:17.858670+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:14:19.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.865+0000 7f629589c700 1 -- 172.21.15.146:0/4059008333 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6270066f30 msgr2=0x7f62700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:19.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.865+0000 7f629589c700 1 --2- 172.21.15.146:0/4059008333 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6270066f30 0x7f62700693e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f62800099b0 tx=0x7f6280017000 comp rx=0 tx=0).stop 2023-10-06T11:14:19.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.865+0000 7f629589c700 1 -- 172.21.15.146:0/4059008333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6290153ab0 msgr2=0x7f6290156a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:19.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.865+0000 7f629589c700 1 --2- 172.21.15.146:0/4059008333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6290153ab0 0x7f6290156a30 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f627800c790 tx=0x7f6278007f40 comp rx=0 tx=0).stop 2023-10-06T11:14:19.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.866+0000 7f629589c700 1 -- 172.21.15.146:0/4059008333 shutdown_connections 2023-10-06T11:14:19.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.866+0000 7f629589c700 1 --2- 172.21.15.146:0/4059008333 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6270066f30 0x7f62700693e0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:19.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.866+0000 7f629589c700 1 --2- 172.21.15.146:0/4059008333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6290153e80 0x7f629015e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:19.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.866+0000 7f629589c700 1 --2- 172.21.15.146:0/4059008333 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6290068ba0 0x7f6290159190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:19.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.866+0000 7f629589c700 1 --2- 172.21.15.146:0/4059008333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6290153ab0 0x7f6290156a30 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:19.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.866+0000 7f629589c700 1 -- 172.21.15.146:0/4059008333 >> 172.21.15.146:0/4059008333 conn(0x7f629006eba0 msgr2=0x7f62900d0140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:19.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.866+0000 7f629589c700 1 -- 172.21.15.146:0/4059008333 shutdown_connections 2023-10-06T11:14:19.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.866+0000 7f629589c700 1 -- 172.21.15.146:0/4059008333 wait complete. 2023-10-06T11:14:19.880 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:14:19.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.993+0000 7f0be3909700 1 Processor -- start 2023-10-06T11:14:19.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.993+0000 7f0be3909700 1 -- start start 2023-10-06T11:14:19.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.994+0000 7f0be3909700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0bdc153ab0 0x7f0bdc15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:19.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.994+0000 7f0be3909700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bdc153e80 0x7f0bdc068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:19.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.994+0000 7f0be3909700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0bdc0689d0 0x7f0bdc15d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:19.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.994+0000 7f0be3909700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bdc068e50 con 0x7f0bdc0689d0 2023-10-06T11:14:19.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.994+0000 7f0be3909700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bdc15ac30 con 0x7f0bdc153ab0 2023-10-06T11:14:19.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.994+0000 7f0be3909700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc0b4510 con 0x7f0bdc153e80 2023-10-06T11:14:19.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.994+0000 7f0be1ea6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0bdc0689d0 0x7f0bdc15d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:19.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.994+0000 7f0be1ea6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0bdc0689d0 0x7f0bdc15d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35390/0 (socket says 172.21.15.146:35390) 2023-10-06T11:14:19.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.994+0000 7f0be1ea6700 1 -- 172.21.15.146:0/1320691851 learned_addr learned my addr 172.21.15.146:0/1320691851 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:19.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.994+0000 7f0be16a5700 1 --2- 172.21.15.146:0/1320691851 >> v2:172.21.15.151:3300/0 conn(0x7f0bdc153ab0 0x7f0bdc15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:19.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.995+0000 7f0be0ea4700 1 --2- 172.21.15.146:0/1320691851 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bdc153e80 0x7f0bdc068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:19.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.995+0000 7f0be1ea6700 1 -- 172.21.15.146:0/1320691851 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bdc153e80 msgr2=0x7f0bdc068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:19.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.995+0000 7f0be1ea6700 1 --2- 172.21.15.146:0/1320691851 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bdc153e80 0x7f0bdc068490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:19.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.995+0000 7f0be1ea6700 1 -- 172.21.15.146:0/1320691851 >> v2:172.21.15.151:3300/0 conn(0x7f0bdc153ab0 msgr2=0x7f0bdc15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:19.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.995+0000 7f0be1ea6700 1 --2- 172.21.15.146:0/1320691851 >> v2:172.21.15.151:3300/0 conn(0x7f0bdc153ab0 0x7f0bdc15a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:19.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.995+0000 7f0be1ea6700 1 -- 172.21.15.146:0/1320691851 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bdc0b6530 con 0x7f0bdc0689d0 2023-10-06T11:14:19.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.995+0000 7f0be16a5700 1 --2- 172.21.15.146:0/1320691851 >> v2:172.21.15.151:3300/0 conn(0x7f0bdc153ab0 0x7f0bdc15a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:19.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.995+0000 7f0be1ea6700 1 --2- 172.21.15.146:0/1320691851 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bdc0689d0 0x7f0bdc15d270 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc0b5eb0 tx=0x7f0bd4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=949ca2269c42f69c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:19.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.995+0000 7f0bd3fff700 1 -- 172.21.15.146:0/1320691851 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd400e070 con 0x7f0bdc0689d0 2023-10-06T11:14:19.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.995+0000 7f0bd3fff700 1 -- 172.21.15.146:0/1320691851 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd400ba50 con 0x7f0bdc0689d0 2023-10-06T11:14:20.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.995+0000 7f0bd3fff700 1 -- 172.21.15.146:0/1320691851 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd40092e0 con 0x7f0bdc0689d0 2023-10-06T11:14:20.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.995+0000 7f0be3909700 1 -- 172.21.15.146:0/1320691851 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bdc0689d0 msgr2=0x7f0bdc15d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:20.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.995+0000 7f0be3909700 1 --2- 172.21.15.146:0/1320691851 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bdc0689d0 0x7f0bdc15d270 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc0b5eb0 tx=0x7f0bd4009840 comp rx=0 tx=0).stop 2023-10-06T11:14:20.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.995+0000 7f0be3909700 1 -- 172.21.15.146:0/1320691851 shutdown_connections 2023-10-06T11:14:20.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.995+0000 7f0be3909700 1 --2- 172.21.15.146:0/1320691851 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bdc0689d0 0x7f0bdc15d270 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:20.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.995+0000 7f0be3909700 1 --2- 172.21.15.146:0/1320691851 >> v2:172.21.15.151:3300/0 conn(0x7f0bdc153ab0 0x7f0bdc15a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:20.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.995+0000 7f0be3909700 1 --2- 172.21.15.146:0/1320691851 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bdc153e80 0x7f0bdc068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:20.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.995+0000 7f0be3909700 1 -- 172.21.15.146:0/1320691851 >> 172.21.15.146:0/1320691851 conn(0x7f0bdc06eba0 msgr2=0x7f0bdc06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:20.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.995+0000 7f0be3909700 1 -- 172.21.15.146:0/1320691851 shutdown_connections 2023-10-06T11:14:20.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.996+0000 7f0be3909700 1 -- 172.21.15.146:0/1320691851 wait complete. 2023-10-06T11:14:20.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.997+0000 7f0be3909700 1 Processor -- start 2023-10-06T11:14:20.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.997+0000 7f0be3909700 1 -- start start 2023-10-06T11:14:20.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.997+0000 7f0be3909700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bdc0689d0 0x7f0bdc14cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:20.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.997+0000 7f0be3909700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bdc153ab0 0x7f0bdc16d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:20.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.997+0000 7f0be3909700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bdc153e80 0x7f0bdc14c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:20.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.997+0000 7f0be3909700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc16de60 con 0x7f0bdc0689d0 2023-10-06T11:14:20.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.997+0000 7f0be3909700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc14dde0 con 0x7f0bdc153e80 2023-10-06T11:14:20.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.997+0000 7f0be3909700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc14d1d0 con 0x7f0bdc153ab0 2023-10-06T11:14:20.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.998+0000 7f0be16a5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bdc0689d0 0x7f0bdc14cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:20.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.998+0000 7f0be16a5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bdc0689d0 0x7f0bdc14cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35392/0 (socket says 172.21.15.146:35392) 2023-10-06T11:14:20.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.998+0000 7f0be16a5700 1 -- 172.21.15.146:0/2231571806 learned_addr learned my addr 172.21.15.146:0/2231571806 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:20.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.998+0000 7f0be1ea6700 1 --2- 172.21.15.146:0/2231571806 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bdc153e80 0x7f0bdc14c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:20.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.998+0000 7f0be0ea4700 1 --2- 172.21.15.146:0/2231571806 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bdc153ab0 0x7f0bdc16d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:20.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.998+0000 7f0be16a5700 1 -- 172.21.15.146:0/2231571806 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bdc153ab0 msgr2=0x7f0bdc16d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:20.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.998+0000 7f0be16a5700 1 --2- 172.21.15.146:0/2231571806 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bdc153ab0 0x7f0bdc16d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:20.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.998+0000 7f0be16a5700 1 -- 172.21.15.146:0/2231571806 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bdc153e80 msgr2=0x7f0bdc14c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:20.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.998+0000 7f0be16a5700 1 --2- 172.21.15.146:0/2231571806 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bdc153e80 0x7f0bdc14c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:20.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.998+0000 7f0be16a5700 1 -- 172.21.15.146:0/2231571806 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd4009ae0 con 0x7f0bdc0689d0 2023-10-06T11:14:20.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.998+0000 7f0be1ea6700 1 --2- 172.21.15.146:0/2231571806 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bdc153e80 0x7f0bdc14c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:20.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.998+0000 7f0be16a5700 1 --2- 172.21.15.146:0/2231571806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bdc0689d0 0x7f0bdc14cb40 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f0bd800c830 tx=0x7f0bd8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:20.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.998+0000 7f0bd17fa700 1 -- 172.21.15.146:0/2231571806 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd8011600 con 0x7f0bdc0689d0 2023-10-06T11:14:20.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.998+0000 7f0bd17fa700 1 -- 172.21.15.146:0/2231571806 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd8011760 con 0x7f0bdc0689d0 2023-10-06T11:14:20.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.998+0000 7f0bd17fa700 1 -- 172.21.15.146:0/2231571806 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd8011b20 con 0x7f0bdc0689d0 2023-10-06T11:14:20.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.998+0000 7f0be3909700 1 -- 172.21.15.146:0/2231571806 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bdc14d4b0 con 0x7f0bdc0689d0 2023-10-06T11:14:20.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.998+0000 7f0be3909700 1 -- 172.21.15.146:0/2231571806 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bdc14da70 con 0x7f0bdc0689d0 2023-10-06T11:14:20.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:19.999+0000 7f0be3909700 1 -- 172.21.15.146:0/2231571806 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bdc0af460 con 0x7f0bdc0689d0 2023-10-06T11:14:20.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.000+0000 7f0bd17fa700 1 -- 172.21.15.146:0/2231571806 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0bd800a3e0 con 0x7f0bdc0689d0 2023-10-06T11:14:20.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.000+0000 7f0bd17fa700 1 --2- 172.21.15.146:0/2231571806 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0bc0066f30 0x7f0bc00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:20.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.000+0000 7f0bd17fa700 1 -- 172.21.15.146:0/2231571806 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0bd8084780 con 0x7f0bdc0689d0 2023-10-06T11:14:20.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.000+0000 7f0be0ea4700 1 --2- 172.21.15.146:0/2231571806 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0bc0066f30 0x7f0bc00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:20.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.000+0000 7f0be0ea4700 1 --2- 172.21.15.146:0/2231571806 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0bc0066f30 0x7f0bc00693e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc0cd9b0 tx=0x7f0bcc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:20.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.004+0000 7f0bd17fa700 1 -- 172.21.15.146:0/2231571806 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0bd8051890 con 0x7f0bdc0689d0 2023-10-06T11:14:20.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.188+0000 7f0be3909700 1 -- 172.21.15.146:0/2231571806 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0bdc04c380 con 0x7f0bdc0689d0 2023-10-06T11:14:20.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.189+0000 7f0bd17fa700 1 -- 172.21.15.146:0/2231571806 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+16941 (secure 0 0 0) 0x7f0bd8054eb0 con 0x7f0bdc0689d0 2023-10-06T11:14:20.191 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:20.191 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":112,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:14:18.891630+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:14:16.553437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-10-06T11:14:17.858670+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:14:20.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.191+0000 7f0be3909700 1 -- 172.21.15.146:0/2231571806 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0bc0066f30 msgr2=0x7f0bc00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:20.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.191+0000 7f0be3909700 1 --2- 172.21.15.146:0/2231571806 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0bc0066f30 0x7f0bc00693e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc0cd9b0 tx=0x7f0bcc008040 comp rx=0 tx=0).stop 2023-10-06T11:14:20.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.191+0000 7f0be3909700 1 -- 172.21.15.146:0/2231571806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bdc0689d0 msgr2=0x7f0bdc14cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:20.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.191+0000 7f0be3909700 1 --2- 172.21.15.146:0/2231571806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bdc0689d0 0x7f0bdc14cb40 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f0bd800c830 tx=0x7f0bd8008040 comp rx=0 tx=0).stop 2023-10-06T11:14:20.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.191+0000 7f0be3909700 1 -- 172.21.15.146:0/2231571806 shutdown_connections 2023-10-06T11:14:20.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.191+0000 7f0be3909700 1 --2- 172.21.15.146:0/2231571806 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0bc0066f30 0x7f0bc00693e0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:20.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.191+0000 7f0be3909700 1 --2- 172.21.15.146:0/2231571806 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bdc153e80 0x7f0bdc14c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:20.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.191+0000 7f0be3909700 1 --2- 172.21.15.146:0/2231571806 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0bdc0689d0 0x7f0bdc14cb40 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:20.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.191+0000 7f0be3909700 1 --2- 172.21.15.146:0/2231571806 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0bdc153ab0 0x7f0bdc16d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:20.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.191+0000 7f0be3909700 1 -- 172.21.15.146:0/2231571806 >> 172.21.15.146:0/2231571806 conn(0x7f0bdc06eba0 msgr2=0x7f0bdc152520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:20.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.192+0000 7f0be3909700 1 -- 172.21.15.146:0/2231571806 shutdown_connections 2023-10-06T11:14:20.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.192+0000 7f0be3909700 1 -- 172.21.15.146:0/2231571806 wait complete. 2023-10-06T11:14:20.206 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T11:14:20.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.322+0000 7fcf659fe700 1 Processor -- start 2023-10-06T11:14:20.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.322+0000 7fcf659fe700 1 -- start start 2023-10-06T11:14:20.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.323+0000 7fcf659fe700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcf6015a160 0x7fcf600c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:20.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.323+0000 7fcf659fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf600cb950 0x7fcf600cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:20.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.323+0000 7fcf659fe700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf600ae2a0 con 0x7fcf600ae730 2023-10-06T11:14:20.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.323+0000 7fcf659fe700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf6015a530 con 0x7fcf6015a160 2023-10-06T11:14:20.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.323+0000 7fcf659fe700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf600ad690 con 0x7fcf600cb950 2023-10-06T11:14:20.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.323+0000 7fcf567fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fcf600ae730 0x7fcf600aebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:38740/0 (socket says 172.21.15.146:38740) 2023-10-06T11:14:20.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.323+0000 7fcf567fc700 1 -- 172.21.15.146:0/2766771003 learned_addr learned my addr 172.21.15.146:0/2766771003 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:14:20.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.323+0000 7fcf5effd700 1 --2- 172.21.15.146:0/2766771003 >> v2:172.21.15.151:3300/0 conn(0x7fcf6015a160 0x7fcf600c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:20.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.323+0000 7fcf5f7fe700 1 --2- 172.21.15.146:0/2766771003 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf600cb950 0x7fcf600cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:20.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.323+0000 7fcf5e7fc700 1 -- 172.21.15.146:0/2766771003 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2630844618 0 0) 0x7fcf600ae2a0 con 0x7fcf600ae730 2023-10-06T11:14:20.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.323+0000 7fcf5e7fc700 1 -- 172.21.15.146:0/2766771003 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf4c003570 con 0x7fcf600ae730 2023-10-06T11:14:20.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.324+0000 7fcf5e7fc700 1 -- 172.21.15.146:0/2766771003 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2010058559 0 0) 0x7fcf4c003570 con 0x7fcf600ae730 2023-10-06T11:14:20.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.324+0000 7fcf5effd700 1 -- 172.21.15.146:0/2766771003 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf600cb950 msgr2=0x7fcf600cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:20.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.324+0000 7fcf5effd700 1 --2- 172.21.15.146:0/2766771003 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf600cb950 0x7fcf600cbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:20.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.324+0000 7fcf5effd700 1 -- 172.21.15.146:0/2766771003 >> v1:172.21.15.146:6789/0 conn(0x7fcf600ae730 legacy=0x7fcf600aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:20.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.324+0000 7fcf5effd700 1 -- 172.21.15.146:0/2766771003 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf600ad970 con 0x7fcf6015a160 2023-10-06T11:14:20.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.324+0000 7fcf5f7fe700 1 --2- 172.21.15.146:0/2766771003 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf600cb950 0x7fcf600cbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:14:20.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.324+0000 7fcf5effd700 1 --2- 172.21.15.146:0/2766771003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf6015a160 0x7fcf600c55a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fcf500098d0 tx=0x7fcf50009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0e5c22dd4cac001 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:20.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.324+0000 7fcf5e7fc700 1 -- 172.21.15.146:0/2766771003 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf48001470 con 0x7fcf6015a160 2023-10-06T11:14:20.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.324+0000 7fcf5e7fc700 1 -- 172.21.15.146:0/2766771003 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf50011420 con 0x7fcf6015a160 2023-10-06T11:14:20.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.324+0000 7fcf5e7fc700 1 -- 172.21.15.146:0/2766771003 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf500117c0 con 0x7fcf6015a160 2023-10-06T11:14:20.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.325+0000 7fcf659fe700 1 -- 172.21.15.146:0/2766771003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf6015a160 msgr2=0x7fcf600c55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:20.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.325+0000 7fcf659fe700 1 --2- 172.21.15.146:0/2766771003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf6015a160 0x7fcf600c55a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fcf500098d0 tx=0x7fcf50009120 comp rx=0 tx=0).stop 2023-10-06T11:14:20.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.325+0000 7fcf659fe700 1 -- 172.21.15.146:0/2766771003 shutdown_connections 2023-10-06T11:14:20.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.325+0000 7fcf659fe700 1 --2- 172.21.15.146:0/2766771003 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf600cb950 0x7fcf600cbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:20.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.325+0000 7fcf659fe700 1 --2- 172.21.15.146:0/2766771003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf6015a160 0x7fcf600c55a0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:20.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.325+0000 7fcf659fe700 1 -- 172.21.15.146:0/2766771003 >> 172.21.15.146:0/2766771003 conn(0x7fcf6006f380 msgr2=0x7fcf600d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:20.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.325+0000 7fcf659fe700 1 -- 172.21.15.146:0/2766771003 shutdown_connections 2023-10-06T11:14:20.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.325+0000 7fcf659fe700 1 -- 172.21.15.146:0/2766771003 wait complete. 2023-10-06T11:14:20.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.326+0000 7fcf659fe700 1 Processor -- start 2023-10-06T11:14:20.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.326+0000 7fcf659fe700 1 -- start start 2023-10-06T11:14:20.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.327+0000 7fcf659fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf600ae730 0x7fcf60160060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:20.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.327+0000 7fcf659fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf600cb950 0x7fcf600c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:20.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.327+0000 7fcf659fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf6015a160 0x7fcf6015d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:20.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.327+0000 7fcf659fe700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf600c96d0 con 0x7fcf600ae730 2023-10-06T11:14:20.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.327+0000 7fcf659fe700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf600c8b00 con 0x7fcf600cb950 2023-10-06T11:14:20.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.327+0000 7fcf659fe700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf600c8da0 con 0x7fcf6015a160 2023-10-06T11:14:20.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.327+0000 7fcf5effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf600ae730 0x7fcf60160060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:20.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.327+0000 7fcf5effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf600ae730 0x7fcf60160060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35400/0 (socket says 172.21.15.146:35400) 2023-10-06T11:14:20.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.327+0000 7fcf5effd700 1 -- 172.21.15.146:0/1300595610 learned_addr learned my addr 172.21.15.146:0/1300595610 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:20.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.327+0000 7fcf567fc700 1 --2- 172.21.15.146:0/1300595610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf600cb950 0x7fcf600c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:20.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.327+0000 7fcf5f7fe700 1 --2- 172.21.15.146:0/1300595610 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf6015a160 0x7fcf6015d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:20.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.327+0000 7fcf5effd700 1 -- 172.21.15.146:0/1300595610 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf6015a160 msgr2=0x7fcf6015d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:20.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.327+0000 7fcf5effd700 1 --2- 172.21.15.146:0/1300595610 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf6015a160 0x7fcf6015d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:20.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.327+0000 7fcf5effd700 1 -- 172.21.15.146:0/1300595610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf600cb950 msgr2=0x7fcf600c9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:20.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.327+0000 7fcf5effd700 1 --2- 172.21.15.146:0/1300595610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf600cb950 0x7fcf600c9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:20.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.327+0000 7fcf5effd700 1 -- 172.21.15.146:0/1300595610 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf58009a20 con 0x7fcf600ae730 2023-10-06T11:14:20.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.327+0000 7fcf567fc700 1 --2- 172.21.15.146:0/1300595610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf600cb950 0x7fcf600c9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:20.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.327+0000 7fcf5effd700 1 --2- 172.21.15.146:0/1300595610 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf600ae730 0x7fcf60160060 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fcf500030c0 tx=0x7fcf50016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:20.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.327+0000 7fcf577fe700 1 -- 172.21.15.146:0/1300595610 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5001cc90 con 0x7fcf600ae730 2023-10-06T11:14:20.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.327+0000 7fcf577fe700 1 -- 172.21.15.146:0/1300595610 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5001cdf0 con 0x7fcf600ae730 2023-10-06T11:14:20.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.327+0000 7fcf659fe700 1 -- 172.21.15.146:0/1300595610 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf500093c0 con 0x7fcf600ae730 2023-10-06T11:14:20.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.327+0000 7fcf577fe700 1 -- 172.21.15.146:0/1300595610 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5001a6a0 con 0x7fcf600ae730 2023-10-06T11:14:20.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.327+0000 7fcf659fe700 1 -- 172.21.15.146:0/1300595610 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf600c9360 con 0x7fcf600ae730 2023-10-06T11:14:20.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.328+0000 7fcf659fe700 1 -- 172.21.15.146:0/1300595610 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf60068390 con 0x7fcf600ae730 2023-10-06T11:14:20.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.329+0000 7fcf577fe700 1 -- 172.21.15.146:0/1300595610 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcf5001aa50 con 0x7fcf600ae730 2023-10-06T11:14:20.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.329+0000 7fcf577fe700 1 --2- 172.21.15.146:0/1300595610 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcf40066f60 0x7fcf40069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:20.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.329+0000 7fcf577fe700 1 -- 172.21.15.146:0/1300595610 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcf50086340 con 0x7fcf600ae730 2023-10-06T11:14:20.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.329+0000 7fcf567fc700 1 --2- 172.21.15.146:0/1300595610 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcf40066f60 0x7fcf40069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:20.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.329+0000 7fcf567fc700 1 --2- 172.21.15.146:0/1300595610 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcf40066f60 0x7fcf40069410 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fcf48001620 tx=0x7fcf48000bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:20.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.333+0000 7fcf577fe700 1 -- 172.21.15.146:0/1300595610 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcf50053450 con 0x7fcf600ae730 2023-10-06T11:14:20.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:20.562+0000 7fcf659fe700 1 -- 172.21.15.146:0/1300595610 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fcf600c99b0 con 0x7fcf600ae730 2023-10-06T11:14:21.024 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:14:21.027 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:14:21.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.532+0000 7fcf577fe700 1 -- 172.21.15.146:0/1300595610 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v99) v1 ==== 118+0+0 (secure 0 0 0) 0x7fcf50056a70 con 0x7fcf600ae730 2023-10-06T11:14:21.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.535+0000 7fcf659fe700 1 -- 172.21.15.146:0/1300595610 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcf40066f60 msgr2=0x7fcf40069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:21.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.535+0000 7fcf659fe700 1 --2- 172.21.15.146:0/1300595610 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcf40066f60 0x7fcf40069410 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fcf48001620 tx=0x7fcf48000bc0 comp rx=0 tx=0).stop 2023-10-06T11:14:21.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.535+0000 7fcf659fe700 1 -- 172.21.15.146:0/1300595610 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf600ae730 msgr2=0x7fcf60160060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:21.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.535+0000 7fcf659fe700 1 --2- 172.21.15.146:0/1300595610 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf600ae730 0x7fcf60160060 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fcf500030c0 tx=0x7fcf50016000 comp rx=0 tx=0).stop 2023-10-06T11:14:21.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.535+0000 7fcf659fe700 1 -- 172.21.15.146:0/1300595610 shutdown_connections 2023-10-06T11:14:21.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.535+0000 7fcf659fe700 1 --2- 172.21.15.146:0/1300595610 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcf40066f60 0x7fcf40069410 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:21.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.535+0000 7fcf659fe700 1 --2- 172.21.15.146:0/1300595610 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf6015a160 0x7fcf6015d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:21.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.535+0000 7fcf659fe700 1 --2- 172.21.15.146:0/1300595610 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcf600ae730 0x7fcf60160060 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:21.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.535+0000 7fcf659fe700 1 --2- 172.21.15.146:0/1300595610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf600cb950 0x7fcf600c9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:21.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.535+0000 7fcf659fe700 1 -- 172.21.15.146:0/1300595610 >> 172.21.15.146:0/1300595610 conn(0x7fcf6006f380 msgr2=0x7fcf600c55a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:21.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.535+0000 7fcf659fe700 1 -- 172.21.15.146:0/1300595610 shutdown_connections 2023-10-06T11:14:21.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.535+0000 7fcf659fe700 1 -- 172.21.15.146:0/1300595610 wait complete. 2023-10-06T11:14:21.553 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T11:14:21.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.676+0000 7fc98b59e700 1 Processor -- start 2023-10-06T11:14:21.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.676+0000 7fc98b59e700 1 -- start start 2023-10-06T11:14:21.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.677+0000 7fc98b59e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc98c0b5640 0x7fc98c15a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:21.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.677+0000 7fc98b59e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc98c0cb090 0x7fc98c0cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:21.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.677+0000 7fc98b59e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc98c0cc130 con 0x7fc98c068780 2023-10-06T11:14:21.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.677+0000 7fc98b59e700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc98c0b2660 con 0x7fc98c0b5640 2023-10-06T11:14:21.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.677+0000 7fc98b59e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c15adb0 con 0x7fc98c0cb090 2023-10-06T11:14:21.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.677+0000 7fc98a59c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc98c0b5640 0x7fc98c15a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:21.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.677+0000 7fc989d9b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc98c0cb090 0x7fc98c0cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:21.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.677+0000 7fc989d9b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc98c0cb090 0x7fc98c0cc5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:37510/0 (socket says 172.21.15.146:37510) 2023-10-06T11:14:21.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.677+0000 7fc98ad9d700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fc98c068780 0x7fc98c068bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:59078/0 (socket says 172.21.15.146:59078) 2023-10-06T11:14:21.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.677+0000 7fc98a59c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc98c0b5640 0x7fc98c15a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:47270/0 (socket says 172.21.15.146:47270) 2023-10-06T11:14:21.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.677+0000 7fc989d9b700 1 -- 172.21.15.146:0/1806681452 learned_addr learned my addr 172.21.15.146:0/1806681452 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:21.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.678+0000 7fc989d9b700 1 -- 172.21.15.146:0/1806681452 >> v2:172.21.15.151:3300/0 conn(0x7fc98c0b5640 msgr2=0x7fc98c15a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:21.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.678+0000 7fc989d9b700 1 --2- 172.21.15.146:0/1806681452 >> v2:172.21.15.151:3300/0 conn(0x7fc98c0b5640 0x7fc98c15a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:21.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.678+0000 7fc989d9b700 1 -- 172.21.15.146:0/1806681452 >> v1:172.21.15.151:6789/0 conn(0x7fc98c068780 legacy=0x7fc98c068bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:21.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.678+0000 7fc98959a700 1 -- 172.21.15.146:0/1806681452 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1304067497 0 0) 0x7fc98c0cc130 con 0x7fc98c068780 2023-10-06T11:14:21.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.678+0000 7fc989d9b700 1 -- 172.21.15.146:0/1806681452 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc98c0cb520 con 0x7fc98c0cb090 2023-10-06T11:14:21.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.678+0000 7fc98a59c700 1 --2- 172.21.15.146:0/1806681452 >> v2:172.21.15.151:3300/0 conn(0x7fc98c0b5640 0x7fc98c15a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:14:21.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.678+0000 7fc989d9b700 1 --2- 172.21.15.146:0/1806681452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc98c0cb090 0x7fc98c0cc5c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc9800099b0 tx=0x7fc980009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=985d94fc6e4cae52 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:21.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.678+0000 7fc98959a700 1 -- 172.21.15.146:0/1806681452 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc980009ea0 con 0x7fc98c0cb090 2023-10-06T11:14:21.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.678+0000 7fc98959a700 1 -- 172.21.15.146:0/1806681452 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc98000b860 con 0x7fc98c0cb090 2023-10-06T11:14:21.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.678+0000 7fc98959a700 1 -- 172.21.15.146:0/1806681452 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98000bc00 con 0x7fc98c0cb090 2023-10-06T11:14:21.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.679+0000 7fc98b59e700 1 -- 172.21.15.146:0/1806681452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc98c0cb090 msgr2=0x7fc98c0cc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:21.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.679+0000 7fc98b59e700 1 --2- 172.21.15.146:0/1806681452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc98c0cb090 0x7fc98c0cc5c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc9800099b0 tx=0x7fc980009250 comp rx=0 tx=0).stop 2023-10-06T11:14:21.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.679+0000 7fc98b59e700 1 -- 172.21.15.146:0/1806681452 shutdown_connections 2023-10-06T11:14:21.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.679+0000 7fc98b59e700 1 --2- 172.21.15.146:0/1806681452 >> v2:172.21.15.151:3300/0 conn(0x7fc98c0b5640 0x7fc98c15a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:21.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.679+0000 7fc98b59e700 1 --2- 172.21.15.146:0/1806681452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc98c0cb090 0x7fc98c0cc5c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:21.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.679+0000 7fc98b59e700 1 -- 172.21.15.146:0/1806681452 >> 172.21.15.146:0/1806681452 conn(0x7fc98c0703f0 msgr2=0x7fc98c0707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:21.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.679+0000 7fc98b59e700 1 -- 172.21.15.146:0/1806681452 shutdown_connections 2023-10-06T11:14:21.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.679+0000 7fc98b59e700 1 -- 172.21.15.146:0/1806681452 wait complete. 2023-10-06T11:14:21.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.680+0000 7fc98b59e700 1 Processor -- start 2023-10-06T11:14:21.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.680+0000 7fc98b59e700 1 -- start start 2023-10-06T11:14:21.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.681+0000 7fc98b59e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc98c068780 0x7fc98c15e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:21.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.681+0000 7fc98b59e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc98c0b5640 0x7fc98c15b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:21.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.681+0000 7fc98b59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc98c0cb090 0x7fc98c16da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:21.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.681+0000 7fc98b59e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c15eca0 con 0x7fc98c0cb090 2023-10-06T11:14:21.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.681+0000 7fc98b59e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c0c4580 con 0x7fc98c068780 2023-10-06T11:14:21.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.681+0000 7fc98b59e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c0c4860 con 0x7fc98c0b5640 2023-10-06T11:14:21.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.681+0000 7fc98ad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc98c0cb090 0x7fc98c16da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:21.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.681+0000 7fc98ad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc98c0cb090 0x7fc98c16da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53610/0 (socket says 172.21.15.146:53610) 2023-10-06T11:14:21.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.681+0000 7fc98ad9d700 1 -- 172.21.15.146:0/2332590813 learned_addr learned my addr 172.21.15.146:0/2332590813 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:21.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.681+0000 7fc98a59c700 1 --2- 172.21.15.146:0/2332590813 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc98c068780 0x7fc98c15e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:21.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.681+0000 7fc989d9b700 1 --2- 172.21.15.146:0/2332590813 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc98c0b5640 0x7fc98c15b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:21.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.681+0000 7fc98ad9d700 1 -- 172.21.15.146:0/2332590813 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc98c0b5640 msgr2=0x7fc98c15b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:21.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.681+0000 7fc98ad9d700 1 --2- 172.21.15.146:0/2332590813 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc98c0b5640 0x7fc98c15b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:21.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.681+0000 7fc98ad9d700 1 -- 172.21.15.146:0/2332590813 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc98c068780 msgr2=0x7fc98c15e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:21.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.681+0000 7fc98ad9d700 1 --2- 172.21.15.146:0/2332590813 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc98c068780 0x7fc98c15e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:21.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.681+0000 7fc98ad9d700 1 -- 172.21.15.146:0/2332590813 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc97c009a20 con 0x7fc98c0cb090 2023-10-06T11:14:21.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.681+0000 7fc98a59c700 1 --2- 172.21.15.146:0/2332590813 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc98c068780 0x7fc98c15e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:14:21.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.681+0000 7fc98ad9d700 1 --2- 172.21.15.146:0/2332590813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc98c0cb090 0x7fc98c16da90 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fc98400c4e0 tx=0x7fc984007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:21.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.681+0000 7fc97a7fc700 1 -- 172.21.15.146:0/2332590813 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98400ce90 con 0x7fc98c0cb090 2023-10-06T11:14:21.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.681+0000 7fc97a7fc700 1 -- 172.21.15.146:0/2332590813 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc984005a70 con 0x7fc98c0cb090 2023-10-06T11:14:21.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.681+0000 7fc98b59e700 1 -- 172.21.15.146:0/2332590813 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9800094f0 con 0x7fc98c0cb090 2023-10-06T11:14:21.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.681+0000 7fc97a7fc700 1 -- 172.21.15.146:0/2332590813 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc984005e30 con 0x7fc98c0cb090 2023-10-06T11:14:21.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.681+0000 7fc98b59e700 1 -- 172.21.15.146:0/2332590813 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc98c16d290 con 0x7fc98c0cb090 2023-10-06T11:14:21.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.682+0000 7fc98b59e700 1 -- 172.21.15.146:0/2332590813 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc98c0cba40 con 0x7fc98c0cb090 2023-10-06T11:14:21.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.683+0000 7fc97a7fc700 1 -- 172.21.15.146:0/2332590813 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc9840072e0 con 0x7fc98c0cb090 2023-10-06T11:14:21.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.683+0000 7fc97a7fc700 1 --2- 172.21.15.146:0/2332590813 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc96c066f30 0x7fc96c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:21.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.683+0000 7fc97a7fc700 1 -- 172.21.15.146:0/2332590813 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc984083a10 con 0x7fc98c0cb090 2023-10-06T11:14:21.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.683+0000 7fc98a59c700 1 --2- 172.21.15.146:0/2332590813 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc96c066f30 0x7fc96c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:21.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.684+0000 7fc98a59c700 1 --2- 172.21.15.146:0/2332590813 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc96c066f30 0x7fc96c0693e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fc97c00eae0 tx=0x7fc97c00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:21.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.688+0000 7fc97a7fc700 1 -- 172.21.15.146:0/2332590813 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc984050b20 con 0x7fc98c0cb090 2023-10-06T11:14:21.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:21.915+0000 7fc98b59e700 1 -- 172.21.15.146:0/2332590813 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc98c04bb40 con 0x7fc98c0cb090 2023-10-06T11:14:22.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.538+0000 7fc97a7fc700 1 -- 172.21.15.146:0/2332590813 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v100) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc984017020 con 0x7fc98c0cb090 2023-10-06T11:14:22.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.540+0000 7fc98b59e700 1 -- 172.21.15.146:0/2332590813 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc96c066f30 msgr2=0x7fc96c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:22.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.540+0000 7fc98b59e700 1 --2- 172.21.15.146:0/2332590813 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc96c066f30 0x7fc96c0693e0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fc97c00eae0 tx=0x7fc97c00b040 comp rx=0 tx=0).stop 2023-10-06T11:14:22.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.540+0000 7fc98b59e700 1 -- 172.21.15.146:0/2332590813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc98c0cb090 msgr2=0x7fc98c16da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:22.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.540+0000 7fc98b59e700 1 --2- 172.21.15.146:0/2332590813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc98c0cb090 0x7fc98c16da90 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fc98400c4e0 tx=0x7fc984007f40 comp rx=0 tx=0).stop 2023-10-06T11:14:22.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.541+0000 7fc98b59e700 1 -- 172.21.15.146:0/2332590813 shutdown_connections 2023-10-06T11:14:22.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.541+0000 7fc98b59e700 1 --2- 172.21.15.146:0/2332590813 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc96c066f30 0x7fc96c0693e0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:22.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.541+0000 7fc98b59e700 1 --2- 172.21.15.146:0/2332590813 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc98c0cb090 0x7fc98c16da90 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:22.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.541+0000 7fc98b59e700 1 --2- 172.21.15.146:0/2332590813 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc98c068780 0x7fc98c15e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:22.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.541+0000 7fc98b59e700 1 --2- 172.21.15.146:0/2332590813 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc98c0b5640 0x7fc98c15b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:22.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.541+0000 7fc98b59e700 1 -- 172.21.15.146:0/2332590813 >> 172.21.15.146:0/2332590813 conn(0x7fc98c0703f0 msgr2=0x7fc98c1537f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:22.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.541+0000 7fc98b59e700 1 -- 172.21.15.146:0/2332590813 shutdown_connections 2023-10-06T11:14:22.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.541+0000 7fc98b59e700 1 -- 172.21.15.146:0/2332590813 wait complete. 2023-10-06T11:14:22.555 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:14:22.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.669+0000 7fb4296dd700 1 Processor -- start 2023-10-06T11:14:22.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.669+0000 7fb4296dd700 1 -- start start 2023-10-06T11:14:22.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.669+0000 7fb4296dd700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb424153e80 0x7fb42415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:22.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.669+0000 7fb4296dd700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb42415ac30 con 0x7fb424153ab0 2023-10-06T11:14:22.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.669+0000 7fb4296dd700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4240b4510 con 0x7fb424068ba0 2023-10-06T11:14:22.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.669+0000 7fb4296dd700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4240b6530 con 0x7fb424153e80 2023-10-06T11:14:22.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.670+0000 7fb422ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb424153ab0 0x7fb424068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:37082/0 (socket says 172.21.15.146:37082) 2023-10-06T11:14:22.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.670+0000 7fb422ffd700 1 -- 172.21.15.146:0/3151915794 learned_addr learned my addr 172.21.15.146:0/3151915794 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:14:22.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.670+0000 7fb4237fe700 1 --2- 172.21.15.146:0/3151915794 >> v2:172.21.15.151:3300/0 conn(0x7fb424153e80 0x7fb42415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:22.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.670+0000 7fb421ffb700 1 -- 172.21.15.146:0/3151915794 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2646905591 0 0) 0x7fb41c001490 con 0x7fb424153ab0 2023-10-06T11:14:22.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.670+0000 7fb421ffb700 1 -- 172.21.15.146:0/3151915794 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb410003570 con 0x7fb424153ab0 2023-10-06T11:14:22.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.670+0000 7fb4237fe700 1 -- 172.21.15.146:0/3151915794 >> v1:172.21.15.151:6789/0 conn(0x7fb424068ba0 legacy=0x7fb4240b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:22.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.670+0000 7fb4237fe700 1 -- 172.21.15.146:0/3151915794 >> v1:172.21.15.146:6789/0 conn(0x7fb424153ab0 legacy=0x7fb424068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:22.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.670+0000 7fb421ffb700 1 -- 172.21.15.146:0/3151915794 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1118349184 0 0) 0x7fb4240b4510 con 0x7fb424068ba0 2023-10-06T11:14:22.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.670+0000 7fb4237fe700 1 -- 172.21.15.146:0/3151915794 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4240b5c50 con 0x7fb424153e80 2023-10-06T11:14:22.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.670+0000 7fb4237fe700 1 --2- 172.21.15.146:0/3151915794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb424153e80 0x7fb42415a6f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb4140098e0 tx=0x7fb4140091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9f7145910d92eda server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:22.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.670+0000 7fb421ffb700 1 -- 172.21.15.146:0/3151915794 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41400b640 con 0x7fb424153e80 2023-10-06T11:14:22.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.670+0000 7fb421ffb700 1 -- 172.21.15.146:0/3151915794 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb41400b7a0 con 0x7fb424153e80 2023-10-06T11:14:22.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.670+0000 7fb421ffb700 1 -- 172.21.15.146:0/3151915794 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41400bb40 con 0x7fb424153e80 2023-10-06T11:14:22.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.671+0000 7fb4296dd700 1 -- 172.21.15.146:0/3151915794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb424153e80 msgr2=0x7fb42415a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:22.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.671+0000 7fb4296dd700 1 --2- 172.21.15.146:0/3151915794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb424153e80 0x7fb42415a6f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fb4140098e0 tx=0x7fb4140091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:22.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.671+0000 7fb4296dd700 1 -- 172.21.15.146:0/3151915794 shutdown_connections 2023-10-06T11:14:22.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.671+0000 7fb4296dd700 1 --2- 172.21.15.146:0/3151915794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb424153e80 0x7fb42415a6f0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:22.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.671+0000 7fb4296dd700 1 -- 172.21.15.146:0/3151915794 >> 172.21.15.146:0/3151915794 conn(0x7fb42406eba0 msgr2=0x7fb42406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:22.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.671+0000 7fb4296dd700 1 -- 172.21.15.146:0/3151915794 shutdown_connections 2023-10-06T11:14:22.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.671+0000 7fb4296dd700 1 -- 172.21.15.146:0/3151915794 wait complete. 2023-10-06T11:14:22.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.672+0000 7fb4296dd700 1 Processor -- start 2023-10-06T11:14:22.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.672+0000 7fb4296dd700 1 -- start start 2023-10-06T11:14:22.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.673+0000 7fb4296dd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb424068ba0 0x7fb4241481c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:22.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.673+0000 7fb4296dd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb424153ab0 0x7fb4240d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:22.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.673+0000 7fb4296dd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb424153e80 0x7fb42414b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:22.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.673+0000 7fb4296dd700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb424148700 con 0x7fb424153e80 2023-10-06T11:14:22.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.673+0000 7fb4296dd700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb42414c200 con 0x7fb424153ab0 2023-10-06T11:14:22.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.673+0000 7fb4296dd700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb42414c4e0 con 0x7fb424068ba0 2023-10-06T11:14:22.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.673+0000 7fb4237fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb424153e80 0x7fb42414b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:22.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.673+0000 7fb4237fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb424153e80 0x7fb42414b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53616/0 (socket says 172.21.15.146:53616) 2023-10-06T11:14:22.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.673+0000 7fb4237fe700 1 -- 172.21.15.146:0/3223224263 learned_addr learned my addr 172.21.15.146:0/3223224263 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:22.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.673+0000 7fb4227fc700 1 --2- 172.21.15.146:0/3223224263 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb424153ab0 0x7fb4240d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:22.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.673+0000 7fb4237fe700 1 -- 172.21.15.146:0/3223224263 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb424068ba0 msgr2=0x7fb4241481c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:22.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.673+0000 7fb422ffd700 1 --2- 172.21.15.146:0/3223224263 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb424068ba0 0x7fb4241481c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:22.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.673+0000 7fb4237fe700 1 --2- 172.21.15.146:0/3223224263 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb424068ba0 0x7fb4241481c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:22.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.673+0000 7fb4237fe700 1 -- 172.21.15.146:0/3223224263 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb424153ab0 msgr2=0x7fb4240d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:22.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.673+0000 7fb4237fe700 1 --2- 172.21.15.146:0/3223224263 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb424153ab0 0x7fb4240d07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:22.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.673+0000 7fb4237fe700 1 -- 172.21.15.146:0/3223224263 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb414009420 con 0x7fb424153e80 2023-10-06T11:14:22.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.673+0000 7fb4227fc700 1 --2- 172.21.15.146:0/3223224263 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb424153ab0 0x7fb4240d07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:22.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.673+0000 7fb422ffd700 1 --2- 172.21.15.146:0/3223224263 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb424068ba0 0x7fb4241481c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:22.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.674+0000 7fb4237fe700 1 --2- 172.21.15.146:0/3223224263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb424153e80 0x7fb42414b2a0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fb424089010 tx=0x7fb414017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:22.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.674+0000 7fb41affd700 1 -- 172.21.15.146:0/3223224263 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41401f070 con 0x7fb424153e80 2023-10-06T11:14:22.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.674+0000 7fb41affd700 1 -- 172.21.15.146:0/3223224263 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb41400b910 con 0x7fb424153e80 2023-10-06T11:14:22.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.674+0000 7fb41affd700 1 -- 172.21.15.146:0/3223224263 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb414025420 con 0x7fb424153e80 2023-10-06T11:14:22.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.674+0000 7fb4296dd700 1 -- 172.21.15.146:0/3223224263 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb42414c7c0 con 0x7fb424153e80 2023-10-06T11:14:22.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.674+0000 7fb4296dd700 1 -- 172.21.15.146:0/3223224263 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb42414be90 con 0x7fb424153e80 2023-10-06T11:14:22.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.675+0000 7fb4296dd700 1 -- 172.21.15.146:0/3223224263 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb42414cdf0 con 0x7fb424153e80 2023-10-06T11:14:22.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.675+0000 7fb41affd700 1 -- 172.21.15.146:0/3223224263 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb414023070 con 0x7fb424153e80 2023-10-06T11:14:22.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.675+0000 7fb41affd700 1 --2- 172.21.15.146:0/3223224263 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb404066f30 0x7fb4040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:22.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.675+0000 7fb41affd700 1 -- 172.21.15.146:0/3223224263 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb414085d70 con 0x7fb424153e80 2023-10-06T11:14:22.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.675+0000 7fb422ffd700 1 --2- 172.21.15.146:0/3223224263 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb404066f30 0x7fb4040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:22.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.676+0000 7fb422ffd700 1 --2- 172.21.15.146:0/3223224263 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb404066f30 0x7fb4040693e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fb41c0015f0 tx=0x7fb41c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:22.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.680+0000 7fb41affd700 1 -- 172.21.15.146:0/3223224263 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb414052e80 con 0x7fb424153e80 2023-10-06T11:14:22.908 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.907+0000 7fb4296dd700 1 -- 172.21.15.146:0/3223224263 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb42404c380 con 0x7fb424153e80 2023-10-06T11:14:22.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.907+0000 7fb41affd700 1 -- 172.21.15.146:0/3223224263 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) v1 ==== 95+0+4610 (secure 0 0 0) 0x7fb414015090 con 0x7fb424153e80 2023-10-06T11:14:22.909 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:22.909 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":100,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6560,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/2109567995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2109567995},{"type":"v1","addr":"172.21.15.151:6834","nonce":2109567995}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":6563,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1783565134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":1783565134},{"type":"v1","addr":"172.21.15.151:6835","nonce":1783565134}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7327,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/1323749517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1323749517},{"type":"v1","addr":"172.21.15.146:6836","nonce":1323749517}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:14:18.891938+0000","modified":"2023-10-06T11:14:22.531674+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8103":{"gid":8103,"name":"c","rank":0,"incarnation":97,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/409226151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":409226151},{"type":"v1","addr":"172.21.15.146:6837","nonce":409226151}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-06T11:14:22.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.909+0000 7fb4296dd700 1 -- 172.21.15.146:0/3223224263 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb404066f30 msgr2=0x7fb4040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:22.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.909+0000 7fb4296dd700 1 --2- 172.21.15.146:0/3223224263 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb404066f30 0x7fb4040693e0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fb41c0015f0 tx=0x7fb41c009040 comp rx=0 tx=0).stop 2023-10-06T11:14:22.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.909+0000 7fb4296dd700 1 -- 172.21.15.146:0/3223224263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb424153e80 msgr2=0x7fb42414b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:22.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.909+0000 7fb4296dd700 1 --2- 172.21.15.146:0/3223224263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb424153e80 0x7fb42414b2a0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fb424089010 tx=0x7fb414017000 comp rx=0 tx=0).stop 2023-10-06T11:14:22.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.909+0000 7fb4296dd700 1 -- 172.21.15.146:0/3223224263 shutdown_connections 2023-10-06T11:14:22.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.909+0000 7fb4296dd700 1 --2- 172.21.15.146:0/3223224263 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb404066f30 0x7fb4040693e0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:22.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.909+0000 7fb4296dd700 1 --2- 172.21.15.146:0/3223224263 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb424153e80 0x7fb42414b2a0 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:22.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.909+0000 7fb4296dd700 1 --2- 172.21.15.146:0/3223224263 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb424068ba0 0x7fb4241481c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:22.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.909+0000 7fb4296dd700 1 --2- 172.21.15.146:0/3223224263 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb424153ab0 0x7fb4240d07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:22.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.909+0000 7fb4296dd700 1 -- 172.21.15.146:0/3223224263 >> 172.21.15.146:0/3223224263 conn(0x7fb42406eba0 msgr2=0x7fb42415c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:22.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.910+0000 7fb4296dd700 1 -- 172.21.15.146:0/3223224263 shutdown_connections 2023-10-06T11:14:22.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:22.910+0000 7fb4296dd700 1 -- 172.21.15.146:0/3223224263 wait complete. 2023-10-06T11:14:22.913 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 100 2023-10-06T11:14:22.923 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:14:23.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.037+0000 7f8eaa2b8700 1 Processor -- start 2023-10-06T11:14:23.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.037+0000 7f8eaa2b8700 1 -- start start 2023-10-06T11:14:23.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.038+0000 7f8eaa2b8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8ea4068ba0 0x7f8ea415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:23.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.038+0000 7f8eaa2b8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ea4153e80 0x7f8ea40b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:23.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.038+0000 7f8eaa2b8700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea415ac30 con 0x7f8ea4153ab0 2023-10-06T11:14:23.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.038+0000 7f8eaa2b8700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea40b4510 con 0x7f8ea4068ba0 2023-10-06T11:14:23.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.038+0000 7f8eaa2b8700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea40b6530 con 0x7f8ea4153e80 2023-10-06T11:14:23.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.038+0000 7f8ea37fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8ea4068ba0 0x7f8ea415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:23.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.038+0000 7f8ea37fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8ea4068ba0 0x7f8ea415a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53632/0 (socket says 172.21.15.146:53632) 2023-10-06T11:14:23.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.038+0000 7f8ea37fe700 1 -- 172.21.15.146:0/1273801145 learned_addr learned my addr 172.21.15.146:0/1273801145 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:23.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.038+0000 7f8ea3fff700 1 --1- 172.21.15.146:0/1273801145 >> v1:172.21.15.146:6789/0 conn(0x7f8ea4153ab0 0x7f8ea4068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:37096/0 (socket says 172.21.15.146:37096) 2023-10-06T11:14:23.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.039+0000 7f8ea8855700 1 --2- 172.21.15.146:0/1273801145 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ea4153e80 0x7f8ea40b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:23.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.039+0000 7f8ea37fe700 1 -- 172.21.15.146:0/1273801145 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ea4153e80 msgr2=0x7f8ea40b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:23.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.039+0000 7f8ea37fe700 1 --2- 172.21.15.146:0/1273801145 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ea4153e80 0x7f8ea40b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.039+0000 7f8ea37fe700 1 -- 172.21.15.146:0/1273801145 >> v1:172.21.15.146:6789/0 conn(0x7f8ea4153ab0 legacy=0x7f8ea4068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:23.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.039+0000 7f8ea37fe700 1 -- 172.21.15.146:0/1273801145 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea40b5c50 con 0x7f8ea4068ba0 2023-10-06T11:14:23.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.039+0000 7f8ea8855700 1 --2- 172.21.15.146:0/1273801145 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ea4153e80 0x7f8ea40b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:23.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.039+0000 7f8ea37fe700 1 --2- 172.21.15.146:0/1273801145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ea4068ba0 0x7f8ea415a6f0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f8e980099b0 tx=0x7f8e98009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f06a99900b704c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:23.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.039+0000 7f8ea2ffd700 1 -- 172.21.15.146:0/1273801145 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9800b860 con 0x7f8ea4068ba0 2023-10-06T11:14:23.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.039+0000 7f8ea2ffd700 1 -- 172.21.15.146:0/1273801145 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9800b9c0 con 0x7f8ea4068ba0 2023-10-06T11:14:23.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.039+0000 7f8ea2ffd700 1 -- 172.21.15.146:0/1273801145 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9800bd60 con 0x7f8ea4068ba0 2023-10-06T11:14:23.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.039+0000 7f8eaa2b8700 1 -- 172.21.15.146:0/1273801145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ea4068ba0 msgr2=0x7f8ea415a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:23.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.039+0000 7f8eaa2b8700 1 --2- 172.21.15.146:0/1273801145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ea4068ba0 0x7f8ea415a6f0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f8e980099b0 tx=0x7f8e98009250 comp rx=0 tx=0).stop 2023-10-06T11:14:23.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.039+0000 7f8eaa2b8700 1 -- 172.21.15.146:0/1273801145 shutdown_connections 2023-10-06T11:14:23.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.039+0000 7f8eaa2b8700 1 --2- 172.21.15.146:0/1273801145 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ea4153e80 0x7f8ea40b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.039+0000 7f8eaa2b8700 1 --2- 172.21.15.146:0/1273801145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ea4068ba0 0x7f8ea415a6f0 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.039+0000 7f8eaa2b8700 1 -- 172.21.15.146:0/1273801145 >> 172.21.15.146:0/1273801145 conn(0x7f8ea406eba0 msgr2=0x7f8ea406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:23.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.039+0000 7f8eaa2b8700 1 -- 172.21.15.146:0/1273801145 shutdown_connections 2023-10-06T11:14:23.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.040+0000 7f8eaa2b8700 1 -- 172.21.15.146:0/1273801145 wait complete. 2023-10-06T11:14:23.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.041+0000 7f8eaa2b8700 1 Processor -- start 2023-10-06T11:14:23.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.041+0000 7f8eaa2b8700 1 -- start start 2023-10-06T11:14:23.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.041+0000 7f8eaa2b8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ea4068ba0 0x7f8ea4142870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:23.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.041+0000 7f8eaa2b8700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ea4153ab0 0x7f8ea415a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:23.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.041+0000 7f8eaa2b8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ea4153e80 0x7f8ea4141f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:23.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.042+0000 7f8eaa2b8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea41517f0 con 0x7f8ea4068ba0 2023-10-06T11:14:23.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.042+0000 7f8eaa2b8700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea4156af0 con 0x7f8ea4153ab0 2023-10-06T11:14:23.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.042+0000 7f8eaa2b8700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea4155ee0 con 0x7f8ea4153e80 2023-10-06T11:14:23.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.042+0000 7f8ea3fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ea4068ba0 0x7f8ea4142870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:23.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.042+0000 7f8ea3fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ea4068ba0 0x7f8ea4142870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53636/0 (socket says 172.21.15.146:53636) 2023-10-06T11:14:23.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.042+0000 7f8ea3fff700 1 -- 172.21.15.146:0/3664542591 learned_addr learned my addr 172.21.15.146:0/3664542591 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:23.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.042+0000 7f8ea37fe700 1 --2- 172.21.15.146:0/3664542591 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ea4153ab0 0x7f8ea415a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:23.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.042+0000 7f8ea8855700 1 --2- 172.21.15.146:0/3664542591 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ea4153e80 0x7f8ea4141f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:23.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.042+0000 7f8ea3fff700 1 -- 172.21.15.146:0/3664542591 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ea4153e80 msgr2=0x7f8ea4141f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:23.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.042+0000 7f8ea3fff700 1 --2- 172.21.15.146:0/3664542591 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ea4153e80 0x7f8ea4141f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.042+0000 7f8ea3fff700 1 -- 172.21.15.146:0/3664542591 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ea4153ab0 msgr2=0x7f8ea415a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:23.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.042+0000 7f8ea3fff700 1 --2- 172.21.15.146:0/3664542591 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ea4153ab0 0x7f8ea415a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.042+0000 7f8ea3fff700 1 -- 172.21.15.146:0/3664542591 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e980094f0 con 0x7f8ea4068ba0 2023-10-06T11:14:23.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.042+0000 7f8ea8855700 1 --2- 172.21.15.146:0/3664542591 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ea4153e80 0x7f8ea4141f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:23.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.042+0000 7f8ea3fff700 1 --2- 172.21.15.146:0/3664542591 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ea4068ba0 0x7f8ea4142870 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f8e9400c7c0 tx=0x7f8e94007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:23.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.042+0000 7f8e8bfff700 1 -- 172.21.15.146:0/3664542591 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e94005a70 con 0x7f8ea4068ba0 2023-10-06T11:14:23.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.042+0000 7f8e8bfff700 1 -- 172.21.15.146:0/3664542591 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e94005bf0 con 0x7f8ea4068ba0 2023-10-06T11:14:23.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.042+0000 7f8eaa2b8700 1 -- 172.21.15.146:0/3664542591 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea41561c0 con 0x7f8ea4068ba0 2023-10-06T11:14:23.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.042+0000 7f8e8bfff700 1 -- 172.21.15.146:0/3664542591 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e940070d0 con 0x7f8ea4068ba0 2023-10-06T11:14:23.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.042+0000 7f8eaa2b8700 1 -- 172.21.15.146:0/3664542591 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea4156780 con 0x7f8ea4068ba0 2023-10-06T11:14:23.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.043+0000 7f8eaa2b8700 1 -- 172.21.15.146:0/3664542591 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ea404c380 con 0x7f8ea4068ba0 2023-10-06T11:14:23.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.044+0000 7f8e8bfff700 1 -- 172.21.15.146:0/3664542591 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8e94007440 con 0x7f8ea4068ba0 2023-10-06T11:14:23.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.044+0000 7f8e8bfff700 1 --2- 172.21.15.146:0/3664542591 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8e90066f30 0x7f8e900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:23.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.044+0000 7f8e8bfff700 1 -- 172.21.15.146:0/3664542591 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8e94083990 con 0x7f8ea4068ba0 2023-10-06T11:14:23.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.044+0000 7f8ea37fe700 1 --2- 172.21.15.146:0/3664542591 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8e90066f30 0x7f8e900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:23.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.044+0000 7f8ea37fe700 1 --2- 172.21.15.146:0/3664542591 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8e90066f30 0x7f8e900693e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f8e980099b0 tx=0x7f8e98017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:23.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.048+0000 7f8e8bfff700 1 -- 172.21.15.146:0/3664542591 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8e94050aa0 con 0x7f8ea4068ba0 2023-10-06T11:14:23.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.235+0000 7f8eaa2b8700 1 -- 172.21.15.146:0/3664542591 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ea415ac30 con 0x7f8ea4068ba0 2023-10-06T11:14:23.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.236+0000 7f8e8bfff700 1 -- 172.21.15.146:0/3664542591 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+16928 (secure 0 0 0) 0x7f8ea415ac30 con 0x7f8ea4068ba0 2023-10-06T11:14:23.238 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:23.238 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":113,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:14:20.515985+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:14:16.553437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-10-06T11:14:17.858670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:14:23.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.238+0000 7f8eaa2b8700 1 -- 172.21.15.146:0/3664542591 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8e90066f30 msgr2=0x7f8e900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:23.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.238+0000 7f8eaa2b8700 1 --2- 172.21.15.146:0/3664542591 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8e90066f30 0x7f8e900693e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f8e980099b0 tx=0x7f8e98017000 comp rx=0 tx=0).stop 2023-10-06T11:14:23.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.238+0000 7f8eaa2b8700 1 -- 172.21.15.146:0/3664542591 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ea4068ba0 msgr2=0x7f8ea4142870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:23.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.238+0000 7f8eaa2b8700 1 --2- 172.21.15.146:0/3664542591 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ea4068ba0 0x7f8ea4142870 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f8e9400c7c0 tx=0x7f8e94007f70 comp rx=0 tx=0).stop 2023-10-06T11:14:23.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.238+0000 7f8eaa2b8700 1 -- 172.21.15.146:0/3664542591 shutdown_connections 2023-10-06T11:14:23.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.238+0000 7f8eaa2b8700 1 --2- 172.21.15.146:0/3664542591 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8e90066f30 0x7f8e900693e0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.238+0000 7f8eaa2b8700 1 --2- 172.21.15.146:0/3664542591 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ea4153e80 0x7f8ea4141f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.238+0000 7f8eaa2b8700 1 --2- 172.21.15.146:0/3664542591 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ea4068ba0 0x7f8ea4142870 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.238+0000 7f8eaa2b8700 1 --2- 172.21.15.146:0/3664542591 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ea4153ab0 0x7f8ea415a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.238+0000 7f8eaa2b8700 1 -- 172.21.15.146:0/3664542591 >> 172.21.15.146:0/3664542591 conn(0x7f8ea406eba0 msgr2=0x7f8ea4151ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:23.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.238+0000 7f8eaa2b8700 1 -- 172.21.15.146:0/3664542591 shutdown_connections 2023-10-06T11:14:23.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.238+0000 7f8eaa2b8700 1 -- 172.21.15.146:0/3664542591 wait complete. 2023-10-06T11:14:23.252 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T11:14:23.253 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:14:23.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.366+0000 7f9863891700 1 Processor -- start 2023-10-06T11:14:23.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.367+0000 7f9863891700 1 -- start start 2023-10-06T11:14:23.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.367+0000 7f9863891700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f985c0c3960 0x7f985c0cc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:23.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.367+0000 7f9863891700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f985c068a90 con 0x7f985c0c4750 2023-10-06T11:14:23.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.367+0000 7f9863891700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f985c159fd0 con 0x7f985c0b08d0 2023-10-06T11:14:23.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.367+0000 7f9863891700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f985c0cdcf0 con 0x7f985c0c3960 2023-10-06T11:14:23.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.368+0000 7f9860e2c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f985c0c3960 0x7f985c0cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:23.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.368+0000 7f9860e2c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f985c0c3960 0x7f985c0cc990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53646/0 (socket says 172.21.15.146:53646) 2023-10-06T11:14:23.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.368+0000 7f9860e2c700 1 -- 172.21.15.146:0/3477292382 learned_addr learned my addr 172.21.15.146:0/3477292382 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:23.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.368+0000 7f9860e2c700 1 -- 172.21.15.146:0/3477292382 >> v1:172.21.15.151:6789/0 conn(0x7f985c0b08d0 legacy=0x7f985c0c3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:23.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.368+0000 7f9860e2c700 1 -- 172.21.15.146:0/3477292382 >> v1:172.21.15.146:6789/0 conn(0x7f985c0c4750 legacy=0x7f985c0cced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:23.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.368+0000 7f9853fff700 1 -- 172.21.15.146:0/3477292382 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1571771794 0 0) 0x7f985c159fd0 con 0x7f985c0b08d0 2023-10-06T11:14:23.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.368+0000 7f9860e2c700 1 -- 172.21.15.146:0/3477292382 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f985c0cdfd0 con 0x7f985c0c3960 2023-10-06T11:14:23.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.368+0000 7f9860e2c700 1 --2- 172.21.15.146:0/3477292382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f985c0c3960 0x7f985c0cc990 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f984c0099b0 tx=0x7f984c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=506914b403f9711c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:23.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.368+0000 7f9853fff700 1 -- 172.21.15.146:0/3477292382 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984c00b860 con 0x7f985c0c3960 2023-10-06T11:14:23.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.368+0000 7f9853fff700 1 -- 172.21.15.146:0/3477292382 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f984c00b9c0 con 0x7f985c0c3960 2023-10-06T11:14:23.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.368+0000 7f9853fff700 1 -- 172.21.15.146:0/3477292382 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984c00bd60 con 0x7f985c0c3960 2023-10-06T11:14:23.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.369+0000 7f9863891700 1 -- 172.21.15.146:0/3477292382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f985c0c3960 msgr2=0x7f985c0cc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:23.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.369+0000 7f9863891700 1 --2- 172.21.15.146:0/3477292382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f985c0c3960 0x7f985c0cc990 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f984c0099b0 tx=0x7f984c009250 comp rx=0 tx=0).stop 2023-10-06T11:14:23.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.369+0000 7f9863891700 1 -- 172.21.15.146:0/3477292382 shutdown_connections 2023-10-06T11:14:23.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.369+0000 7f9863891700 1 --2- 172.21.15.146:0/3477292382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f985c0c3960 0x7f985c0cc990 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.369+0000 7f9863891700 1 -- 172.21.15.146:0/3477292382 >> 172.21.15.146:0/3477292382 conn(0x7f985c067c50 msgr2=0x7f985c0ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:23.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.369+0000 7f9863891700 1 -- 172.21.15.146:0/3477292382 shutdown_connections 2023-10-06T11:14:23.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.369+0000 7f9863891700 1 -- 172.21.15.146:0/3477292382 wait complete. 2023-10-06T11:14:23.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.370+0000 7f9863891700 1 Processor -- start 2023-10-06T11:14:23.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.370+0000 7f9863891700 1 -- start start 2023-10-06T11:14:23.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.371+0000 7f9863891700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f985c0b08d0 0x7f985c15c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:23.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.371+0000 7f9863891700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f985c0c3960 0x7f985c0c8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:23.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.371+0000 7f9863891700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f985c0c4750 0x7f985c15abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:23.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.371+0000 7f9863891700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985c15c2a0 con 0x7f985c0c3960 2023-10-06T11:14:23.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.371+0000 7f9863891700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985c15b690 con 0x7f985c0c4750 2023-10-06T11:14:23.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.371+0000 7f9863891700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f985c15b970 con 0x7f985c0b08d0 2023-10-06T11:14:23.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.371+0000 7f9860e2c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f985c0c3960 0x7f985c0c8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:23.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.371+0000 7f9860e2c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f985c0c3960 0x7f985c0c8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53648/0 (socket says 172.21.15.146:53648) 2023-10-06T11:14:23.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.371+0000 7f9860e2c700 1 -- 172.21.15.146:0/3661135467 learned_addr learned my addr 172.21.15.146:0/3661135467 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:23.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.371+0000 7f986162d700 1 --2- 172.21.15.146:0/3661135467 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f985c0b08d0 0x7f985c15c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:23.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.371+0000 7f9861e2e700 1 --2- 172.21.15.146:0/3661135467 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f985c0c4750 0x7f985c15abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:23.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.371+0000 7f9860e2c700 1 -- 172.21.15.146:0/3661135467 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f985c0b08d0 msgr2=0x7f985c15c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:23.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.371+0000 7f9860e2c700 1 --2- 172.21.15.146:0/3661135467 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f985c0b08d0 0x7f985c15c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.371+0000 7f9860e2c700 1 -- 172.21.15.146:0/3661135467 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f985c0c4750 msgr2=0x7f985c15abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:23.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.371+0000 7f9860e2c700 1 --2- 172.21.15.146:0/3661135467 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f985c0c4750 0x7f985c15abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.371+0000 7f9860e2c700 1 -- 172.21.15.146:0/3661135467 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f984c0094f0 con 0x7f985c0c3960 2023-10-06T11:14:23.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.371+0000 7f9860e2c700 1 --2- 172.21.15.146:0/3661135467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f985c0c3960 0x7f985c0c8ee0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f984c006f50 tx=0x7f984c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:23.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.371+0000 7f98517fa700 1 -- 172.21.15.146:0/3661135467 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984c01f070 con 0x7f985c0c3960 2023-10-06T11:14:23.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.372+0000 7f98517fa700 1 -- 172.21.15.146:0/3661135467 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f984c011d10 con 0x7f985c0c3960 2023-10-06T11:14:23.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.372+0000 7f9863891700 1 -- 172.21.15.146:0/3661135467 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f985c15bc50 con 0x7f985c0c3960 2023-10-06T11:14:23.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.372+0000 7f98517fa700 1 -- 172.21.15.146:0/3661135467 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984c025650 con 0x7f985c0c3960 2023-10-06T11:14:23.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.372+0000 7f9863891700 1 -- 172.21.15.146:0/3661135467 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f985c15cc70 con 0x7f985c0c3960 2023-10-06T11:14:23.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.373+0000 7f9863891700 1 -- 172.21.15.146:0/3661135467 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f985c15c410 con 0x7f985c0c3960 2023-10-06T11:14:23.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.373+0000 7f98517fa700 1 -- 172.21.15.146:0/3661135467 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f984c023070 con 0x7f985c0c3960 2023-10-06T11:14:23.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.373+0000 7f98517fa700 1 --2- 172.21.15.146:0/3661135467 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9840066f30 0x7f98400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:23.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.373+0000 7f98517fa700 1 -- 172.21.15.146:0/3661135467 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f984c085ce0 con 0x7f985c0c3960 2023-10-06T11:14:23.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.373+0000 7f986162d700 1 --2- 172.21.15.146:0/3661135467 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9840066f30 0x7f98400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:23.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.374+0000 7f986162d700 1 --2- 172.21.15.146:0/3661135467 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9840066f30 0x7f98400693e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f9858003820 tx=0x7f9858009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:23.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.378+0000 7f98517fa700 1 -- 172.21.15.146:0/3661135467 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f984c052df0 con 0x7f985c0c3960 2023-10-06T11:14:23.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.560+0000 7f9863891700 1 -- 172.21.15.146:0/3661135467 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f985c04c380 con 0x7f9840066f30 2023-10-06T11:14:23.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.568+0000 7f98517fa700 1 -- 172.21.15.146:0/3661135467 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311846 (secure 0 0 0) 0x7f985c04c380 con 0x7f9840066f30 2023-10-06T11:14:23.574 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:23.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.572+0000 7f9863891700 1 -- 172.21.15.146:0/3661135467 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9840066f30 msgr2=0x7f98400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:23.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.572+0000 7f9863891700 1 --2- 172.21.15.146:0/3661135467 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9840066f30 0x7f98400693e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f9858003820 tx=0x7f9858009040 comp rx=0 tx=0).stop 2023-10-06T11:14:23.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.572+0000 7f9863891700 1 -- 172.21.15.146:0/3661135467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f985c0c3960 msgr2=0x7f985c0c8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:23.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.572+0000 7f9863891700 1 --2- 172.21.15.146:0/3661135467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f985c0c3960 0x7f985c0c8ee0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f984c006f50 tx=0x7f984c017000 comp rx=0 tx=0).stop 2023-10-06T11:14:23.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.572+0000 7f9863891700 1 -- 172.21.15.146:0/3661135467 shutdown_connections 2023-10-06T11:14:23.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.572+0000 7f9863891700 1 --2- 172.21.15.146:0/3661135467 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9840066f30 0x7f98400693e0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.572+0000 7f9863891700 1 --2- 172.21.15.146:0/3661135467 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f985c0c4750 0x7f985c15abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.572+0000 7f9863891700 1 --2- 172.21.15.146:0/3661135467 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f985c0b08d0 0x7f985c15c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.572+0000 7f9863891700 1 --2- 172.21.15.146:0/3661135467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f985c0c3960 0x7f985c0c8ee0 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.572+0000 7f9863891700 1 -- 172.21.15.146:0/3661135467 >> 172.21.15.146:0/3661135467 conn(0x7f985c067c50 msgr2=0x7f985c0ca0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:23.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.572+0000 7f9863891700 1 -- 172.21.15.146:0/3661135467 shutdown_connections 2023-10-06T11:14:23.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.572+0000 7f9863891700 1 -- 172.21.15.146:0/3661135467 wait complete. 2023-10-06T11:14:23.578 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:14:23.586 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":369,"stamp":"2023-10-06T11:14:23.251037+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":143,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2455988,"kb_used_data":12148,"kb_used_omap":0,"kb_used_meta":2443776,"kb_avail":752518732,"statfs":{"total":773094113280,"available":770579181568,"internally_reserved":0,"allocated":12439552,"data_stored":6300693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2502426624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.754502"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.527743+0000","last_change":"2023-10-06T11:14:19.520476+0000","last_active":"2023-10-06T11:14:19.527743+0000","last_peered":"2023-10-06T11:14:19.527743+0000","last_clean":"2023-10-06T11:14:19.527743+0000","last_became_active":"2023-10-06T11:14:19.520205+0000","last_became_peered":"2023-10-06T11:14:19.520205+0000","last_unstale":"2023-10-06T11:14:19.527743+0000","last_undegraded":"2023-10-06T11:14:19.527743+0000","last_fullsized":"2023-10-06T11:14:19.527743+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:26.347568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.532811+0000","last_change":"2023-10-06T11:14:19.532348+0000","last_active":"2023-10-06T11:14:19.532811+0000","last_peered":"2023-10-06T11:14:19.532811+0000","last_clean":"2023-10-06T11:14:19.532811+0000","last_became_active":"2023-10-06T11:14:19.532012+0000","last_became_peered":"2023-10-06T11:14:19.532012+0000","last_unstale":"2023-10-06T11:14:19.532811+0000","last_undegraded":"2023-10-06T11:14:19.532811+0000","last_fullsized":"2023-10-06T11:14:19.532811+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:26.347568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.532698+0000","last_change":"2023-10-06T11:14:19.528088+0000","last_active":"2023-10-06T11:14:19.532698+0000","last_peered":"2023-10-06T11:14:19.532698+0000","last_clean":"2023-10-06T11:14:19.532698+0000","last_became_active":"2023-10-06T11:14:19.527793+0000","last_became_peered":"2023-10-06T11:14:19.527793+0000","last_unstale":"2023-10-06T11:14:19.532698+0000","last_undegraded":"2023-10-06T11:14:19.532698+0000","last_fullsized":"2023-10-06T11:14:19.532698+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:19:52.809562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":8,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.529107+0000","last_change":"2023-10-06T11:14:19.529107+0000","last_active":"2023-10-06T11:14:19.529107+0000","last_peered":"2023-10-06T11:14:19.529107+0000","last_clean":"2023-10-06T11:14:19.529107+0000","last_became_active":"2023-10-06T11:14:19.528656+0000","last_became_peered":"2023-10-06T11:14:19.528656+0000","last_unstale":"2023-10-06T11:14:19.529107+0000","last_undegraded":"2023-10-06T11:14:19.529107+0000","last_fullsized":"2023-10-06T11:14:19.529107+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:28:18.675296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.531122+0000","last_change":"2023-10-06T11:14:19.526066+0000","last_active":"2023-10-06T11:14:19.531122+0000","last_peered":"2023-10-06T11:14:19.531122+0000","last_clean":"2023-10-06T11:14:19.531122+0000","last_became_active":"2023-10-06T11:14:19.525795+0000","last_became_peered":"2023-10-06T11:14:19.525795+0000","last_unstale":"2023-10-06T11:14:19.531122+0000","last_undegraded":"2023-10-06T11:14:19.531122+0000","last_fullsized":"2023-10-06T11:14:19.531122+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:15:01.598973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":8,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.525388+0000","last_change":"2023-10-06T11:14:19.525388+0000","last_active":"2023-10-06T11:14:19.525388+0000","last_peered":"2023-10-06T11:14:19.525388+0000","last_clean":"2023-10-06T11:14:19.525388+0000","last_became_active":"2023-10-06T11:14:19.525115+0000","last_became_peered":"2023-10-06T11:14:19.525115+0000","last_unstale":"2023-10-06T11:14:19.525388+0000","last_undegraded":"2023-10-06T11:14:19.525388+0000","last_fullsized":"2023-10-06T11:14:19.525388+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:34.724814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":8,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.528773+0000","last_change":"2023-10-06T11:14:19.528773+0000","last_active":"2023-10-06T11:14:19.528773+0000","last_peered":"2023-10-06T11:14:19.528773+0000","last_clean":"2023-10-06T11:14:19.528773+0000","last_became_active":"2023-10-06T11:14:19.528226+0000","last_became_peered":"2023-10-06T11:14:19.528226+0000","last_unstale":"2023-10-06T11:14:19.528773+0000","last_undegraded":"2023-10-06T11:14:19.528773+0000","last_fullsized":"2023-10-06T11:14:19.528773+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:37:51.065364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.532407+0000","last_change":"2023-10-06T11:14:19.530354+0000","last_active":"2023-10-06T11:14:19.532407+0000","last_peered":"2023-10-06T11:14:19.532407+0000","last_clean":"2023-10-06T11:14:19.532407+0000","last_became_active":"2023-10-06T11:14:19.530032+0000","last_became_peered":"2023-10-06T11:14:19.530032+0000","last_unstale":"2023-10-06T11:14:19.532407+0000","last_undegraded":"2023-10-06T11:14:19.532407+0000","last_fullsized":"2023-10-06T11:14:19.532407+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:06:57.398555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":8,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.532883+0000","last_change":"2023-10-06T11:14:19.532883+0000","last_active":"2023-10-06T11:14:19.532883+0000","last_peered":"2023-10-06T11:14:19.532883+0000","last_clean":"2023-10-06T11:14:19.532883+0000","last_became_active":"2023-10-06T11:14:19.532603+0000","last_became_peered":"2023-10-06T11:14:19.532603+0000","last_unstale":"2023-10-06T11:14:19.532883+0000","last_undegraded":"2023-10-06T11:14:19.532883+0000","last_fullsized":"2023-10-06T11:14:19.532883+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:06:31.661698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.532559+0000","last_change":"2023-10-06T11:14:19.527285+0000","last_active":"2023-10-06T11:14:19.532559+0000","last_peered":"2023-10-06T11:14:19.532559+0000","last_clean":"2023-10-06T11:14:19.532559+0000","last_became_active":"2023-10-06T11:14:19.526994+0000","last_became_peered":"2023-10-06T11:14:19.526994+0000","last_unstale":"2023-10-06T11:14:19.532559+0000","last_undegraded":"2023-10-06T11:14:19.532559+0000","last_fullsized":"2023-10-06T11:14:19.532559+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:42:26.291704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.527928+0000","last_change":"2023-10-06T11:14:19.524151+0000","last_active":"2023-10-06T11:14:19.527928+0000","last_peered":"2023-10-06T11:14:19.527928+0000","last_clean":"2023-10-06T11:14:19.527928+0000","last_became_active":"2023-10-06T11:14:19.523866+0000","last_became_peered":"2023-10-06T11:14:19.523866+0000","last_unstale":"2023-10-06T11:14:19.527928+0000","last_undegraded":"2023-10-06T11:14:19.527928+0000","last_fullsized":"2023-10-06T11:14:19.527928+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:32:43.816552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":8,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.529942+0000","last_change":"2023-10-06T11:14:19.529942+0000","last_active":"2023-10-06T11:14:19.529942+0000","last_peered":"2023-10-06T11:14:19.529942+0000","last_clean":"2023-10-06T11:14:19.529942+0000","last_became_active":"2023-10-06T11:14:19.529301+0000","last_became_peered":"2023-10-06T11:14:19.529301+0000","last_unstale":"2023-10-06T11:14:19.529942+0000","last_undegraded":"2023-10-06T11:14:19.529942+0000","last_fullsized":"2023-10-06T11:14:19.529942+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:38:30.754949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.531681+0000","last_change":"2023-10-06T11:14:19.522176+0000","last_active":"2023-10-06T11:14:19.531681+0000","last_peered":"2023-10-06T11:14:19.531681+0000","last_clean":"2023-10-06T11:14:19.531681+0000","last_became_active":"2023-10-06T11:14:19.521700+0000","last_became_peered":"2023-10-06T11:14:19.521700+0000","last_unstale":"2023-10-06T11:14:19.531681+0000","last_undegraded":"2023-10-06T11:14:19.531681+0000","last_fullsized":"2023-10-06T11:14:19.531681+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:24:53.043665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.532979+0000","last_change":"2023-10-06T11:14:19.530044+0000","last_active":"2023-10-06T11:14:19.532979+0000","last_peered":"2023-10-06T11:14:19.532979+0000","last_clean":"2023-10-06T11:14:19.532979+0000","last_became_active":"2023-10-06T11:14:19.529403+0000","last_became_peered":"2023-10-06T11:14:19.529403+0000","last_unstale":"2023-10-06T11:14:19.532979+0000","last_undegraded":"2023-10-06T11:14:19.532979+0000","last_fullsized":"2023-10-06T11:14:19.532979+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:49:42.929918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.528047+0000","last_change":"2023-10-06T11:14:19.524300+0000","last_active":"2023-10-06T11:14:19.528047+0000","last_peered":"2023-10-06T11:14:19.528047+0000","last_clean":"2023-10-06T11:14:19.528047+0000","last_became_active":"2023-10-06T11:14:19.524005+0000","last_became_peered":"2023-10-06T11:14:19.524005+0000","last_unstale":"2023-10-06T11:14:19.528047+0000","last_undegraded":"2023-10-06T11:14:19.528047+0000","last_fullsized":"2023-10-06T11:14:19.528047+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:58:45.856421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":8,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.526085+0000","last_change":"2023-10-06T11:14:19.526085+0000","last_active":"2023-10-06T11:14:19.526085+0000","last_peered":"2023-10-06T11:14:19.526085+0000","last_clean":"2023-10-06T11:14:19.526085+0000","last_became_active":"2023-10-06T11:14:19.525777+0000","last_became_peered":"2023-10-06T11:14:19.525777+0000","last_unstale":"2023-10-06T11:14:19.526085+0000","last_undegraded":"2023-10-06T11:14:19.526085+0000","last_fullsized":"2023-10-06T11:14:19.526085+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:15:24.397193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.532403+0000","last_change":"2023-10-06T11:14:19.531279+0000","last_active":"2023-10-06T11:14:19.532403+0000","last_peered":"2023-10-06T11:14:19.532403+0000","last_clean":"2023-10-06T11:14:19.532403+0000","last_became_active":"2023-10-06T11:14:19.530993+0000","last_became_peered":"2023-10-06T11:14:19.530993+0000","last_unstale":"2023-10-06T11:14:19.532403+0000","last_undegraded":"2023-10-06T11:14:19.532403+0000","last_fullsized":"2023-10-06T11:14:19.532403+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:52:25.323760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.532231+0000","last_change":"2023-10-06T11:14:19.528332+0000","last_active":"2023-10-06T11:14:19.532231+0000","last_peered":"2023-10-06T11:14:19.532231+0000","last_clean":"2023-10-06T11:14:19.532231+0000","last_became_active":"2023-10-06T11:14:19.527895+0000","last_became_peered":"2023-10-06T11:14:19.527895+0000","last_unstale":"2023-10-06T11:14:19.532231+0000","last_undegraded":"2023-10-06T11:14:19.532231+0000","last_fullsized":"2023-10-06T11:14:19.532231+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:32:43.816552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.530371+0000","last_change":"2023-10-06T11:14:19.528482+0000","last_active":"2023-10-06T11:14:19.530371+0000","last_peered":"2023-10-06T11:14:19.530371+0000","last_clean":"2023-10-06T11:14:19.530371+0000","last_became_active":"2023-10-06T11:14:19.527376+0000","last_became_peered":"2023-10-06T11:14:19.527376+0000","last_unstale":"2023-10-06T11:14:19.530371+0000","last_undegraded":"2023-10-06T11:14:19.530371+0000","last_fullsized":"2023-10-06T11:14:19.530371+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:21:12.436828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.532610+0000","last_change":"2023-10-06T11:14:19.525242+0000","last_active":"2023-10-06T11:14:19.532610+0000","last_peered":"2023-10-06T11:14:19.532610+0000","last_clean":"2023-10-06T11:14:19.532610+0000","last_became_active":"2023-10-06T11:14:19.524965+0000","last_became_peered":"2023-10-06T11:14:19.524965+0000","last_unstale":"2023-10-06T11:14:19.532610+0000","last_undegraded":"2023-10-06T11:14:19.532610+0000","last_fullsized":"2023-10-06T11:14:19.532610+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:11:40.740294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":8,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.533908+0000","last_change":"2023-10-06T11:14:19.533908+0000","last_active":"2023-10-06T11:14:19.533908+0000","last_peered":"2023-10-06T11:14:19.533908+0000","last_clean":"2023-10-06T11:14:19.533908+0000","last_became_active":"2023-10-06T11:14:19.533475+0000","last_became_peered":"2023-10-06T11:14:19.533475+0000","last_unstale":"2023-10-06T11:14:19.533908+0000","last_undegraded":"2023-10-06T11:14:19.533908+0000","last_fullsized":"2023-10-06T11:14:19.533908+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:58:45.856421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.532413+0000","last_change":"2023-10-06T11:14:19.528331+0000","last_active":"2023-10-06T11:14:19.532413+0000","last_peered":"2023-10-06T11:14:19.532413+0000","last_clean":"2023-10-06T11:14:19.532413+0000","last_became_active":"2023-10-06T11:14:19.528033+0000","last_became_peered":"2023-10-06T11:14:19.528033+0000","last_unstale":"2023-10-06T11:14:19.532413+0000","last_undegraded":"2023-10-06T11:14:19.532413+0000","last_fullsized":"2023-10-06T11:14:19.532413+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:19:18.637586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":8,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.534688+0000","last_change":"2023-10-06T11:14:19.534688+0000","last_active":"2023-10-06T11:14:19.534688+0000","last_peered":"2023-10-06T11:14:19.534688+0000","last_clean":"2023-10-06T11:14:19.534688+0000","last_became_active":"2023-10-06T11:14:19.534390+0000","last_became_peered":"2023-10-06T11:14:19.534390+0000","last_unstale":"2023-10-06T11:14:19.534688+0000","last_undegraded":"2023-10-06T11:14:19.534688+0000","last_fullsized":"2023-10-06T11:14:19.534688+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:19:18.637586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.530390+0000","last_change":"2023-10-06T11:14:19.525690+0000","last_active":"2023-10-06T11:14:19.530390+0000","last_peered":"2023-10-06T11:14:19.530390+0000","last_clean":"2023-10-06T11:14:19.530390+0000","last_became_active":"2023-10-06T11:14:19.525323+0000","last_became_peered":"2023-10-06T11:14:19.525323+0000","last_unstale":"2023-10-06T11:14:19.530390+0000","last_undegraded":"2023-10-06T11:14:19.530390+0000","last_fullsized":"2023-10-06T11:14:19.530390+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:59.263674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.530164+0000","last_change":"2023-10-06T11:14:19.521772+0000","last_active":"2023-10-06T11:14:19.530164+0000","last_peered":"2023-10-06T11:14:19.530164+0000","last_clean":"2023-10-06T11:14:19.530164+0000","last_became_active":"2023-10-06T11:14:19.521483+0000","last_became_peered":"2023-10-06T11:14:19.521483+0000","last_unstale":"2023-10-06T11:14:19.530164+0000","last_undegraded":"2023-10-06T11:14:19.530164+0000","last_fullsized":"2023-10-06T11:14:19.530164+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:34:38.614024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.530727+0000","last_change":"2023-10-06T11:14:19.520854+0000","last_active":"2023-10-06T11:14:19.530727+0000","last_peered":"2023-10-06T11:14:19.530727+0000","last_clean":"2023-10-06T11:14:19.530727+0000","last_became_active":"2023-10-06T11:14:19.520615+0000","last_became_peered":"2023-10-06T11:14:19.520615+0000","last_unstale":"2023-10-06T11:14:19.530727+0000","last_undegraded":"2023-10-06T11:14:19.530727+0000","last_fullsized":"2023-10-06T11:14:19.530727+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:40:43.819263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.530352+0000","last_change":"2023-10-06T11:14:19.527756+0000","last_active":"2023-10-06T11:14:19.530352+0000","last_peered":"2023-10-06T11:14:19.530352+0000","last_clean":"2023-10-06T11:14:19.530352+0000","last_became_active":"2023-10-06T11:14:19.527310+0000","last_became_peered":"2023-10-06T11:14:19.527310+0000","last_unstale":"2023-10-06T11:14:19.530352+0000","last_undegraded":"2023-10-06T11:14:19.530352+0000","last_fullsized":"2023-10-06T11:14:19.530352+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:35:44.957885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":8,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.530149+0000","last_change":"2023-10-06T11:14:19.530149+0000","last_active":"2023-10-06T11:14:19.530149+0000","last_peered":"2023-10-06T11:14:19.530149+0000","last_clean":"2023-10-06T11:14:19.530149+0000","last_became_active":"2023-10-06T11:14:19.529661+0000","last_became_peered":"2023-10-06T11:14:19.529661+0000","last_unstale":"2023-10-06T11:14:19.530149+0000","last_undegraded":"2023-10-06T11:14:19.530149+0000","last_fullsized":"2023-10-06T11:14:19.530149+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:42:12.981733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.523113+0000","last_change":"2023-10-06T11:14:19.520171+0000","last_active":"2023-10-06T11:14:19.523113+0000","last_peered":"2023-10-06T11:14:19.523113+0000","last_clean":"2023-10-06T11:14:19.523113+0000","last_became_active":"2023-10-06T11:14:19.519897+0000","last_became_peered":"2023-10-06T11:14:19.519897+0000","last_unstale":"2023-10-06T11:14:19.523113+0000","last_undegraded":"2023-10-06T11:14:19.523113+0000","last_fullsized":"2023-10-06T11:14:19.523113+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:06:03.066755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.529202+0000","last_change":"2023-10-06T11:14:19.519947+0000","last_active":"2023-10-06T11:14:19.529202+0000","last_peered":"2023-10-06T11:14:19.529202+0000","last_clean":"2023-10-06T11:14:19.529202+0000","last_became_active":"2023-10-06T11:14:19.519688+0000","last_became_peered":"2023-10-06T11:14:19.519688+0000","last_unstale":"2023-10-06T11:14:19.529202+0000","last_undegraded":"2023-10-06T11:14:19.529202+0000","last_fullsized":"2023-10-06T11:14:19.529202+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:21:02.106612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.528702+0000","last_change":"2023-10-06T11:14:19.519862+0000","last_active":"2023-10-06T11:14:19.528702+0000","last_peered":"2023-10-06T11:14:19.528702+0000","last_clean":"2023-10-06T11:14:19.528702+0000","last_became_active":"2023-10-06T11:14:19.519577+0000","last_became_peered":"2023-10-06T11:14:19.519577+0000","last_unstale":"2023-10-06T11:14:19.528702+0000","last_undegraded":"2023-10-06T11:14:19.528702+0000","last_fullsized":"2023-10-06T11:14:19.528702+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:35.487190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.530370+0000","last_change":"2023-10-06T11:14:19.525530+0000","last_active":"2023-10-06T11:14:19.530370+0000","last_peered":"2023-10-06T11:14:19.530370+0000","last_clean":"2023-10-06T11:14:19.530370+0000","last_became_active":"2023-10-06T11:14:19.525001+0000","last_became_peered":"2023-10-06T11:14:19.525001+0000","last_unstale":"2023-10-06T11:14:19.530370+0000","last_undegraded":"2023-10-06T11:14:19.530370+0000","last_fullsized":"2023-10-06T11:14:19.530370+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:24:53.043665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.532666+0000","last_change":"2023-10-06T11:14:19.526616+0000","last_active":"2023-10-06T11:14:19.532666+0000","last_peered":"2023-10-06T11:14:19.532666+0000","last_clean":"2023-10-06T11:14:19.532666+0000","last_became_active":"2023-10-06T11:14:19.526396+0000","last_became_peered":"2023-10-06T11:14:19.526396+0000","last_unstale":"2023-10-06T11:14:19.532666+0000","last_undegraded":"2023-10-06T11:14:19.532666+0000","last_fullsized":"2023-10-06T11:14:19.532666+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:59:09.964394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"112'4","reported_seq":14,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.541546+0000","last_change":"2023-10-06T11:14:18.515953+0000","last_active":"2023-10-06T11:14:19.541546+0000","last_peered":"2023-10-06T11:14:19.541546+0000","last_clean":"2023-10-06T11:14:19.541546+0000","last_became_active":"2023-10-06T11:14:18.515686+0000","last_became_peered":"2023-10-06T11:14:18.515686+0000","last_unstale":"2023-10-06T11:14:19.541546+0000","last_undegraded":"2023-10-06T11:14:19.541546+0000","last_fullsized":"2023-10-06T11:14:19.541546+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:37:28.317271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":8,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.524628+0000","last_change":"2023-10-06T11:14:19.524628+0000","last_active":"2023-10-06T11:14:19.524628+0000","last_peered":"2023-10-06T11:14:19.524628+0000","last_clean":"2023-10-06T11:14:19.524628+0000","last_became_active":"2023-10-06T11:14:19.524368+0000","last_became_peered":"2023-10-06T11:14:19.524368+0000","last_unstale":"2023-10-06T11:14:19.524628+0000","last_undegraded":"2023-10-06T11:14:19.524628+0000","last_fullsized":"2023-10-06T11:14:19.524628+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:35:56.912741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.539512+0000","last_change":"2023-10-06T11:14:18.515934+0000","last_active":"2023-10-06T11:14:19.539512+0000","last_peered":"2023-10-06T11:14:19.539512+0000","last_clean":"2023-10-06T11:14:19.539512+0000","last_became_active":"2023-10-06T11:14:18.515726+0000","last_became_peered":"2023-10-06T11:14:18.515726+0000","last_unstale":"2023-10-06T11:14:19.539512+0000","last_undegraded":"2023-10-06T11:14:19.539512+0000","last_fullsized":"2023-10-06T11:14:19.539512+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:41:54.619961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.530279+0000","last_change":"2023-10-06T11:14:19.524330+0000","last_active":"2023-10-06T11:14:19.530279+0000","last_peered":"2023-10-06T11:14:19.530279+0000","last_clean":"2023-10-06T11:14:19.530279+0000","last_became_active":"2023-10-06T11:14:19.521549+0000","last_became_peered":"2023-10-06T11:14:19.521549+0000","last_unstale":"2023-10-06T11:14:19.530279+0000","last_undegraded":"2023-10-06T11:14:19.530279+0000","last_fullsized":"2023-10-06T11:14:19.530279+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:02.550142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"112'2","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.538089+0000","last_change":"2023-10-06T11:14:18.515908+0000","last_active":"2023-10-06T11:14:19.538089+0000","last_peered":"2023-10-06T11:14:19.538089+0000","last_clean":"2023-10-06T11:14:19.538089+0000","last_became_active":"2023-10-06T11:14:18.513935+0000","last_became_peered":"2023-10-06T11:14:18.513935+0000","last_unstale":"2023-10-06T11:14:19.538089+0000","last_undegraded":"2023-10-06T11:14:19.538089+0000","last_fullsized":"2023-10-06T11:14:19.538089+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:52:24.318913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":8,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.533308+0000","last_change":"2023-10-06T11:14:19.533308+0000","last_active":"2023-10-06T11:14:19.533308+0000","last_peered":"2023-10-06T11:14:19.533308+0000","last_clean":"2023-10-06T11:14:19.533308+0000","last_became_active":"2023-10-06T11:14:19.532977+0000","last_became_peered":"2023-10-06T11:14:19.532977+0000","last_unstale":"2023-10-06T11:14:19.533308+0000","last_undegraded":"2023-10-06T11:14:19.533308+0000","last_fullsized":"2023-10-06T11:14:19.533308+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:26:00.807380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.540924+0000","last_change":"2023-10-06T11:14:18.520396+0000","last_active":"2023-10-06T11:14:19.540924+0000","last_peered":"2023-10-06T11:14:19.540924+0000","last_clean":"2023-10-06T11:14:19.540924+0000","last_became_active":"2023-10-06T11:14:18.520153+0000","last_became_peered":"2023-10-06T11:14:18.520153+0000","last_unstale":"2023-10-06T11:14:19.540924+0000","last_undegraded":"2023-10-06T11:14:19.540924+0000","last_fullsized":"2023-10-06T11:14:19.540924+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:05:56.563889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.532027+0000","last_change":"2023-10-06T11:14:19.523021+0000","last_active":"2023-10-06T11:14:19.532027+0000","last_peered":"2023-10-06T11:14:19.532027+0000","last_clean":"2023-10-06T11:14:19.532027+0000","last_became_active":"2023-10-06T11:14:19.522770+0000","last_became_peered":"2023-10-06T11:14:19.522770+0000","last_unstale":"2023-10-06T11:14:19.532027+0000","last_undegraded":"2023-10-06T11:14:19.532027+0000","last_fullsized":"2023-10-06T11:14:19.532027+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:34:38.614024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.539457+0000","last_change":"2023-10-06T11:14:18.515188+0000","last_active":"2023-10-06T11:14:19.539457+0000","last_peered":"2023-10-06T11:14:19.539457+0000","last_clean":"2023-10-06T11:14:19.539457+0000","last_became_active":"2023-10-06T11:14:18.514906+0000","last_became_peered":"2023-10-06T11:14:18.514906+0000","last_unstale":"2023-10-06T11:14:19.539457+0000","last_undegraded":"2023-10-06T11:14:19.539457+0000","last_fullsized":"2023-10-06T11:14:19.539457+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:01.545295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.528071+0000","last_change":"2023-10-06T11:14:19.524793+0000","last_active":"2023-10-06T11:14:19.528071+0000","last_peered":"2023-10-06T11:14:19.528071+0000","last_clean":"2023-10-06T11:14:19.528071+0000","last_became_active":"2023-10-06T11:14:19.524543+0000","last_became_peered":"2023-10-06T11:14:19.524543+0000","last_unstale":"2023-10-06T11:14:19.528071+0000","last_undegraded":"2023-10-06T11:14:19.528071+0000","last_fullsized":"2023-10-06T11:14:19.528071+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:50:18.583592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"112'1","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.518014+0000","last_change":"2023-10-06T11:14:18.519198+0000","last_active":"2023-10-06T11:14:19.518014+0000","last_peered":"2023-10-06T11:14:19.518014+0000","last_clean":"2023-10-06T11:14:19.518014+0000","last_became_active":"2023-10-06T11:14:18.518919+0000","last_became_peered":"2023-10-06T11:14:18.518919+0000","last_unstale":"2023-10-06T11:14:19.518014+0000","last_undegraded":"2023-10-06T11:14:19.518014+0000","last_fullsized":"2023-10-06T11:14:19.518014+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:03:28.990972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.529222+0000","last_change":"2023-10-06T11:14:19.522997+0000","last_active":"2023-10-06T11:14:19.529222+0000","last_peered":"2023-10-06T11:14:19.529222+0000","last_clean":"2023-10-06T11:14:19.529222+0000","last_became_active":"2023-10-06T11:14:19.522714+0000","last_became_peered":"2023-10-06T11:14:19.522714+0000","last_unstale":"2023-10-06T11:14:19.529222+0000","last_undegraded":"2023-10-06T11:14:19.529222+0000","last_fullsized":"2023-10-06T11:14:19.529222+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:44.278065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.512500+0000","last_change":"2023-10-06T11:14:18.510999+0000","last_active":"2023-10-06T11:14:19.512500+0000","last_peered":"2023-10-06T11:14:19.512500+0000","last_clean":"2023-10-06T11:14:19.512500+0000","last_became_active":"2023-10-06T11:14:18.510526+0000","last_became_peered":"2023-10-06T11:14:18.510526+0000","last_unstale":"2023-10-06T11:14:19.512500+0000","last_undegraded":"2023-10-06T11:14:19.512500+0000","last_fullsized":"2023-10-06T11:14:19.512500+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:48:15.451175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.532403+0000","last_change":"2023-10-06T11:14:19.528313+0000","last_active":"2023-10-06T11:14:19.532403+0000","last_peered":"2023-10-06T11:14:19.532403+0000","last_clean":"2023-10-06T11:14:19.532403+0000","last_became_active":"2023-10-06T11:14:19.528016+0000","last_became_peered":"2023-10-06T11:14:19.528016+0000","last_unstale":"2023-10-06T11:14:19.532403+0000","last_undegraded":"2023-10-06T11:14:19.532403+0000","last_fullsized":"2023-10-06T11:14:19.532403+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:59.263674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.517655+0000","last_change":"2023-10-06T11:14:18.514702+0000","last_active":"2023-10-06T11:14:18.517655+0000","last_peered":"2023-10-06T11:14:18.517655+0000","last_clean":"2023-10-06T11:14:18.517655+0000","last_became_active":"2023-10-06T11:14:18.514361+0000","last_became_peered":"2023-10-06T11:14:18.514361+0000","last_unstale":"2023-10-06T11:14:18.517655+0000","last_undegraded":"2023-10-06T11:14:18.517655+0000","last_fullsized":"2023-10-06T11:14:18.517655+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:21:01.150494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.530241+0000","last_change":"2023-10-06T11:14:19.524085+0000","last_active":"2023-10-06T11:14:19.530241+0000","last_peered":"2023-10-06T11:14:19.530241+0000","last_clean":"2023-10-06T11:14:19.530241+0000","last_became_active":"2023-10-06T11:14:19.523862+0000","last_became_peered":"2023-10-06T11:14:19.523862+0000","last_unstale":"2023-10-06T11:14:19.530241+0000","last_undegraded":"2023-10-06T11:14:19.530241+0000","last_fullsized":"2023-10-06T11:14:19.530241+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:08:52.437418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.539936+0000","last_change":"2023-10-06T11:14:18.516352+0000","last_active":"2023-10-06T11:14:19.539936+0000","last_peered":"2023-10-06T11:14:19.539936+0000","last_clean":"2023-10-06T11:14:19.539936+0000","last_became_active":"2023-10-06T11:14:18.515857+0000","last_became_peered":"2023-10-06T11:14:18.515857+0000","last_unstale":"2023-10-06T11:14:19.539936+0000","last_undegraded":"2023-10-06T11:14:19.539936+0000","last_fullsized":"2023-10-06T11:14:19.539936+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:37:28.317271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.525319+0000","last_change":"2023-10-06T11:14:19.517577+0000","last_active":"2023-10-06T11:14:19.525319+0000","last_peered":"2023-10-06T11:14:19.525319+0000","last_clean":"2023-10-06T11:14:19.525319+0000","last_became_active":"2023-10-06T11:14:19.517229+0000","last_became_peered":"2023-10-06T11:14:19.517229+0000","last_unstale":"2023-10-06T11:14:19.525319+0000","last_undegraded":"2023-10-06T11:14:19.525319+0000","last_fullsized":"2023-10-06T11:14:19.525319+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:59.014923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.545409+0000","last_change":"2023-10-06T11:14:18.514704+0000","last_active":"2023-10-06T11:14:19.545409+0000","last_peered":"2023-10-06T11:14:19.545409+0000","last_clean":"2023-10-06T11:14:19.545409+0000","last_became_active":"2023-10-06T11:14:18.514414+0000","last_became_peered":"2023-10-06T11:14:18.514414+0000","last_unstale":"2023-10-06T11:14:19.545409+0000","last_undegraded":"2023-10-06T11:14:19.545409+0000","last_fullsized":"2023-10-06T11:14:19.545409+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:20:21.032556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":8,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.527322+0000","last_change":"2023-10-06T11:14:19.527322+0000","last_active":"2023-10-06T11:14:19.527322+0000","last_peered":"2023-10-06T11:14:19.527322+0000","last_clean":"2023-10-06T11:14:19.527322+0000","last_became_active":"2023-10-06T11:14:19.527057+0000","last_became_peered":"2023-10-06T11:14:19.527057+0000","last_unstale":"2023-10-06T11:14:19.527322+0000","last_undegraded":"2023-10-06T11:14:19.527322+0000","last_fullsized":"2023-10-06T11:14:19.527322+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:59:05.726507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"112'1","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.521929+0000","last_change":"2023-10-06T11:14:18.517594+0000","last_active":"2023-10-06T11:14:19.521929+0000","last_peered":"2023-10-06T11:14:19.521929+0000","last_clean":"2023-10-06T11:14:19.521929+0000","last_became_active":"2023-10-06T11:14:18.517189+0000","last_became_peered":"2023-10-06T11:14:18.517189+0000","last_unstale":"2023-10-06T11:14:19.521929+0000","last_undegraded":"2023-10-06T11:14:19.521929+0000","last_fullsized":"2023-10-06T11:14:19.521929+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:42:25.286857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.530562+0000","last_change":"2023-10-06T11:14:19.527010+0000","last_active":"2023-10-06T11:14:19.530562+0000","last_peered":"2023-10-06T11:14:19.530562+0000","last_clean":"2023-10-06T11:14:19.530562+0000","last_became_active":"2023-10-06T11:14:19.526744+0000","last_became_peered":"2023-10-06T11:14:19.526744+0000","last_unstale":"2023-10-06T11:14:19.530562+0000","last_undegraded":"2023-10-06T11:14:19.530562+0000","last_fullsized":"2023-10-06T11:14:19.530562+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:20:35.278867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.519795+0000","last_change":"2023-10-06T11:14:18.519497+0000","last_active":"2023-10-06T11:14:18.519795+0000","last_peered":"2023-10-06T11:14:18.519795+0000","last_clean":"2023-10-06T11:14:18.519795+0000","last_became_active":"2023-10-06T11:14:18.519225+0000","last_became_peered":"2023-10-06T11:14:18.519225+0000","last_unstale":"2023-10-06T11:14:18.519795+0000","last_undegraded":"2023-10-06T11:14:18.519795+0000","last_fullsized":"2023-10-06T11:14:18.519795+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:34:37.609177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":8,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.527137+0000","last_change":"2023-10-06T11:14:19.527137+0000","last_active":"2023-10-06T11:14:19.527137+0000","last_peered":"2023-10-06T11:14:19.527137+0000","last_clean":"2023-10-06T11:14:19.527137+0000","last_became_active":"2023-10-06T11:14:19.526130+0000","last_became_peered":"2023-10-06T11:14:19.526130+0000","last_unstale":"2023-10-06T11:14:19.527137+0000","last_undegraded":"2023-10-06T11:14:19.527137+0000","last_fullsized":"2023-10-06T11:14:19.527137+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:23:56.709317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"112'2","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.542156+0000","last_change":"2023-10-06T11:14:18.516535+0000","last_active":"2023-10-06T11:14:19.542156+0000","last_peered":"2023-10-06T11:14:19.542156+0000","last_clean":"2023-10-06T11:14:19.542156+0000","last_became_active":"2023-10-06T11:14:18.516262+0000","last_became_peered":"2023-10-06T11:14:18.516262+0000","last_unstale":"2023-10-06T11:14:19.542156+0000","last_undegraded":"2023-10-06T11:14:19.542156+0000","last_fullsized":"2023-10-06T11:14:19.542156+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:40:30.069343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.529651+0000","last_change":"2023-10-06T11:14:19.520392+0000","last_active":"2023-10-06T11:14:19.529651+0000","last_peered":"2023-10-06T11:14:19.529651+0000","last_clean":"2023-10-06T11:14:19.529651+0000","last_became_active":"2023-10-06T11:14:19.519418+0000","last_became_peered":"2023-10-06T11:14:19.519418+0000","last_unstale":"2023-10-06T11:14:19.529651+0000","last_undegraded":"2023-10-06T11:14:19.529651+0000","last_fullsized":"2023-10-06T11:14:19.529651+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:00:03.457618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.517729+0000","last_change":"2023-10-06T11:14:18.514490+0000","last_active":"2023-10-06T11:14:18.517729+0000","last_peered":"2023-10-06T11:14:18.517729+0000","last_clean":"2023-10-06T11:14:18.517729+0000","last_became_active":"2023-10-06T11:14:18.514261+0000","last_became_peered":"2023-10-06T11:14:18.514261+0000","last_unstale":"2023-10-06T11:14:18.517729+0000","last_undegraded":"2023-10-06T11:14:18.517729+0000","last_fullsized":"2023-10-06T11:14:18.517729+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:45:36.667717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.535642+0000","last_change":"2023-10-06T11:14:19.532839+0000","last_active":"2023-10-06T11:14:19.535642+0000","last_peered":"2023-10-06T11:14:19.535642+0000","last_clean":"2023-10-06T11:14:19.535642+0000","last_became_active":"2023-10-06T11:14:19.529762+0000","last_became_peered":"2023-10-06T11:14:19.529762+0000","last_unstale":"2023-10-06T11:14:19.535642+0000","last_undegraded":"2023-10-06T11:14:19.535642+0000","last_fullsized":"2023-10-06T11:14:19.535642+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:15:01.598973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.511773+0000","last_change":"2023-10-06T11:14:18.517688+0000","last_active":"2023-10-06T11:14:19.511773+0000","last_peered":"2023-10-06T11:14:19.511773+0000","last_clean":"2023-10-06T11:14:19.511773+0000","last_became_active":"2023-10-06T11:14:18.517457+0000","last_became_peered":"2023-10-06T11:14:18.517457+0000","last_unstale":"2023-10-06T11:14:19.511773+0000","last_undegraded":"2023-10-06T11:14:19.511773+0000","last_fullsized":"2023-10-06T11:14:19.511773+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:58.258827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.530399+0000","last_change":"2023-10-06T11:14:19.524881+0000","last_active":"2023-10-06T11:14:19.530399+0000","last_peered":"2023-10-06T11:14:19.530399+0000","last_clean":"2023-10-06T11:14:19.530399+0000","last_became_active":"2023-10-06T11:14:19.524584+0000","last_became_peered":"2023-10-06T11:14:19.524584+0000","last_unstale":"2023-10-06T11:14:19.530399+0000","last_undegraded":"2023-10-06T11:14:19.530399+0000","last_fullsized":"2023-10-06T11:14:19.530399+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:49.548292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.518314+0000","last_change":"2023-10-06T11:14:18.516647+0000","last_active":"2023-10-06T11:14:18.518314+0000","last_peered":"2023-10-06T11:14:18.518314+0000","last_clean":"2023-10-06T11:14:18.518314+0000","last_became_active":"2023-10-06T11:14:18.516262+0000","last_became_peered":"2023-10-06T11:14:18.516262+0000","last_unstale":"2023-10-06T11:14:18.518314+0000","last_undegraded":"2023-10-06T11:14:18.518314+0000","last_fullsized":"2023-10-06T11:14:18.518314+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:59:08.959547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":8,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.529163+0000","last_change":"2023-10-06T11:14:19.529163+0000","last_active":"2023-10-06T11:14:19.529163+0000","last_peered":"2023-10-06T11:14:19.529163+0000","last_clean":"2023-10-06T11:14:19.529163+0000","last_became_active":"2023-10-06T11:14:19.528510+0000","last_became_peered":"2023-10-06T11:14:19.528510+0000","last_unstale":"2023-10-06T11:14:19.529163+0000","last_undegraded":"2023-10-06T11:14:19.529163+0000","last_fullsized":"2023-10-06T11:14:19.529163+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:39.292478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"112'2","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.542167+0000","last_change":"2023-10-06T11:14:18.512348+0000","last_active":"2023-10-06T11:14:19.542167+0000","last_peered":"2023-10-06T11:14:19.542167+0000","last_clean":"2023-10-06T11:14:19.542167+0000","last_became_active":"2023-10-06T11:14:18.512069+0000","last_became_peered":"2023-10-06T11:14:18.512069+0000","last_unstale":"2023-10-06T11:14:19.542167+0000","last_undegraded":"2023-10-06T11:14:19.542167+0000","last_fullsized":"2023-10-06T11:14:19.542167+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:06:04.223773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.532281+0000","last_change":"2023-10-06T11:14:19.526978+0000","last_active":"2023-10-06T11:14:19.532281+0000","last_peered":"2023-10-06T11:14:19.532281+0000","last_clean":"2023-10-06T11:14:19.532281+0000","last_became_active":"2023-10-06T11:14:19.526719+0000","last_became_peered":"2023-10-06T11:14:19.526719+0000","last_unstale":"2023-10-06T11:14:19.532281+0000","last_undegraded":"2023-10-06T11:14:19.532281+0000","last_fullsized":"2023-10-06T11:14:19.532281+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:45:37.672564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.519593+0000","last_change":"2023-10-06T11:14:18.514476+0000","last_active":"2023-10-06T11:14:19.519593+0000","last_peered":"2023-10-06T11:14:19.519593+0000","last_clean":"2023-10-06T11:14:19.519593+0000","last_became_active":"2023-10-06T11:14:18.514192+0000","last_became_peered":"2023-10-06T11:14:18.514192+0000","last_unstale":"2023-10-06T11:14:19.519593+0000","last_undegraded":"2023-10-06T11:14:19.519593+0000","last_fullsized":"2023-10-06T11:14:19.519593+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:08:57.830671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":8,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.529153+0000","last_change":"2023-10-06T11:14:19.529153+0000","last_active":"2023-10-06T11:14:19.529153+0000","last_peered":"2023-10-06T11:14:19.529153+0000","last_clean":"2023-10-06T11:14:19.529153+0000","last_became_active":"2023-10-06T11:14:19.528897+0000","last_became_peered":"2023-10-06T11:14:19.528897+0000","last_unstale":"2023-10-06T11:14:19.529153+0000","last_undegraded":"2023-10-06T11:14:19.529153+0000","last_fullsized":"2023-10-06T11:14:19.529153+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:53:37.936318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.518605+0000","last_change":"2023-10-06T11:14:18.511882+0000","last_active":"2023-10-06T11:14:19.518605+0000","last_peered":"2023-10-06T11:14:19.518605+0000","last_clean":"2023-10-06T11:14:19.518605+0000","last_became_active":"2023-10-06T11:14:18.511611+0000","last_became_peered":"2023-10-06T11:14:18.511611+0000","last_unstale":"2023-10-06T11:14:19.518605+0000","last_undegraded":"2023-10-06T11:14:19.518605+0000","last_fullsized":"2023-10-06T11:14:19.518605+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:19:25.411147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.533711+0000","last_change":"2023-10-06T11:14:19.531539+0000","last_active":"2023-10-06T11:14:19.533711+0000","last_peered":"2023-10-06T11:14:19.533711+0000","last_clean":"2023-10-06T11:14:19.533711+0000","last_became_active":"2023-10-06T11:14:19.531287+0000","last_became_peered":"2023-10-06T11:14:19.531287+0000","last_unstale":"2023-10-06T11:14:19.533711+0000","last_undegraded":"2023-10-06T11:14:19.533711+0000","last_fullsized":"2023-10-06T11:14:19.533711+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:42.292257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.518894+0000","last_change":"2023-10-06T11:14:18.516195+0000","last_active":"2023-10-06T11:14:18.518894+0000","last_peered":"2023-10-06T11:14:18.518894+0000","last_clean":"2023-10-06T11:14:18.518894+0000","last_became_active":"2023-10-06T11:14:18.515950+0000","last_became_peered":"2023-10-06T11:14:18.515950+0000","last_unstale":"2023-10-06T11:14:18.518894+0000","last_undegraded":"2023-10-06T11:14:18.518894+0000","last_fullsized":"2023-10-06T11:14:18.518894+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:21:36.863223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":8,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.525879+0000","last_change":"2023-10-06T11:14:19.525879+0000","last_active":"2023-10-06T11:14:19.525879+0000","last_peered":"2023-10-06T11:14:19.525879+0000","last_clean":"2023-10-06T11:14:19.525879+0000","last_became_active":"2023-10-06T11:14:19.525607+0000","last_became_peered":"2023-10-06T11:14:19.525607+0000","last_unstale":"2023-10-06T11:14:19.525879+0000","last_undegraded":"2023-10-06T11:14:19.525879+0000","last_fullsized":"2023-10-06T11:14:19.525879+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:03.212957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.513717+0000","last_change":"2023-10-06T11:14:18.512746+0000","last_active":"2023-10-06T11:14:19.513717+0000","last_peered":"2023-10-06T11:14:19.513717+0000","last_clean":"2023-10-06T11:14:19.513717+0000","last_became_active":"2023-10-06T11:14:18.512031+0000","last_became_peered":"2023-10-06T11:14:18.512031+0000","last_unstale":"2023-10-06T11:14:19.513717+0000","last_undegraded":"2023-10-06T11:14:19.513717+0000","last_fullsized":"2023-10-06T11:14:19.513717+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:47:07.809091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.532613+0000","last_change":"2023-10-06T11:14:19.528146+0000","last_active":"2023-10-06T11:14:19.532613+0000","last_peered":"2023-10-06T11:14:19.532613+0000","last_clean":"2023-10-06T11:14:19.532613+0000","last_became_active":"2023-10-06T11:14:19.527779+0000","last_became_peered":"2023-10-06T11:14:19.527779+0000","last_unstale":"2023-10-06T11:14:19.532613+0000","last_undegraded":"2023-10-06T11:14:19.532613+0000","last_fullsized":"2023-10-06T11:14:19.532613+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:28:18.675296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.514483+0000","last_change":"2023-10-06T11:14:18.506358+0000","last_active":"2023-10-06T11:14:19.514483+0000","last_peered":"2023-10-06T11:14:19.514483+0000","last_clean":"2023-10-06T11:14:19.514483+0000","last_became_active":"2023-10-06T11:14:18.505791+0000","last_became_peered":"2023-10-06T11:14:18.505791+0000","last_unstale":"2023-10-06T11:14:19.514483+0000","last_undegraded":"2023-10-06T11:14:19.514483+0000","last_fullsized":"2023-10-06T11:14:19.514483+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:34.482343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":8,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.528687+0000","last_change":"2023-10-06T11:14:19.528687+0000","last_active":"2023-10-06T11:14:19.528687+0000","last_peered":"2023-10-06T11:14:19.528687+0000","last_clean":"2023-10-06T11:14:19.528687+0000","last_became_active":"2023-10-06T11:14:19.528395+0000","last_became_peered":"2023-10-06T11:14:19.528395+0000","last_unstale":"2023-10-06T11:14:19.528687+0000","last_undegraded":"2023-10-06T11:14:19.528687+0000","last_fullsized":"2023-10-06T11:14:19.528687+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:59.014923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.517743+0000","last_change":"2023-10-06T11:14:18.516015+0000","last_active":"2023-10-06T11:14:18.517743+0000","last_peered":"2023-10-06T11:14:18.517743+0000","last_clean":"2023-10-06T11:14:18.517743+0000","last_became_active":"2023-10-06T11:14:18.515755+0000","last_became_peered":"2023-10-06T11:14:18.515755+0000","last_unstale":"2023-10-06T11:14:18.517743+0000","last_undegraded":"2023-10-06T11:14:18.517743+0000","last_fullsized":"2023-10-06T11:14:18.517743+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:25:06.077268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.532380+0000","last_change":"2023-10-06T11:14:19.526637+0000","last_active":"2023-10-06T11:14:19.532380+0000","last_peered":"2023-10-06T11:14:19.532380+0000","last_clean":"2023-10-06T11:14:19.532380+0000","last_became_active":"2023-10-06T11:14:19.526285+0000","last_became_peered":"2023-10-06T11:14:19.526285+0000","last_unstale":"2023-10-06T11:14:19.532380+0000","last_undegraded":"2023-10-06T11:14:19.532380+0000","last_fullsized":"2023-10-06T11:14:19.532380+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:20:35.278867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.518332+0000","last_change":"2023-10-06T11:14:18.516817+0000","last_active":"2023-10-06T11:14:18.518332+0000","last_peered":"2023-10-06T11:14:18.518332+0000","last_clean":"2023-10-06T11:14:18.518332+0000","last_became_active":"2023-10-06T11:14:18.516554+0000","last_became_peered":"2023-10-06T11:14:18.516554+0000","last_unstale":"2023-10-06T11:14:18.518332+0000","last_undegraded":"2023-10-06T11:14:18.518332+0000","last_fullsized":"2023-10-06T11:14:18.518332+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:20:34.274020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.537677+0000","last_change":"2023-10-06T11:14:19.532326+0000","last_active":"2023-10-06T11:14:19.537677+0000","last_peered":"2023-10-06T11:14:19.537677+0000","last_clean":"2023-10-06T11:14:19.537677+0000","last_became_active":"2023-10-06T11:14:19.528604+0000","last_became_peered":"2023-10-06T11:14:19.528604+0000","last_unstale":"2023-10-06T11:14:19.537677+0000","last_undegraded":"2023-10-06T11:14:19.537677+0000","last_fullsized":"2023-10-06T11:14:19.537677+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:50:18.583592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"112'3","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.541466+0000","last_change":"2023-10-06T11:14:18.514344+0000","last_active":"2023-10-06T11:14:19.541466+0000","last_peered":"2023-10-06T11:14:19.541466+0000","last_clean":"2023-10-06T11:14:19.541466+0000","last_became_active":"2023-10-06T11:14:18.513998+0000","last_became_peered":"2023-10-06T11:14:18.513998+0000","last_unstale":"2023-10-06T11:14:19.541466+0000","last_undegraded":"2023-10-06T11:14:19.541466+0000","last_fullsized":"2023-10-06T11:14:19.541466+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:08:57.830671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":100,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.512528+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:14:19.512528+0000","last_peered":"2023-10-06T11:14:19.512528+0000","last_clean":"2023-10-06T11:14:19.512528+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:14:19.512528+0000","last_undegraded":"2023-10-06T11:14:19.512528+0000","last_fullsized":"2023-10-06T11:14:19.512528+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.529795+0000","last_change":"2023-10-06T11:14:19.520394+0000","last_active":"2023-10-06T11:14:19.529795+0000","last_peered":"2023-10-06T11:14:19.529795+0000","last_clean":"2023-10-06T11:14:19.529795+0000","last_became_active":"2023-10-06T11:14:19.519621+0000","last_became_peered":"2023-10-06T11:14:19.519621+0000","last_unstale":"2023-10-06T11:14:19.529795+0000","last_undegraded":"2023-10-06T11:14:19.529795+0000","last_fullsized":"2023-10-06T11:14:19.529795+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:47:08.813938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"112'6","reported_seq":16,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.545315+0000","last_change":"2023-10-06T11:14:18.504949+0000","last_active":"2023-10-06T11:14:19.545315+0000","last_peered":"2023-10-06T11:14:19.545315+0000","last_clean":"2023-10-06T11:14:19.545315+0000","last_became_active":"2023-10-06T11:14:18.504692+0000","last_became_peered":"2023-10-06T11:14:18.504692+0000","last_unstale":"2023-10-06T11:14:19.545315+0000","last_undegraded":"2023-10-06T11:14:19.545315+0000","last_fullsized":"2023-10-06T11:14:19.545315+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:24:52.038818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":91,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.511360+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:14:19.511360+0000","last_peered":"2023-10-06T11:14:19.511360+0000","last_clean":"2023-10-06T11:14:19.511360+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:14:19.511360+0000","last_undegraded":"2023-10-06T11:14:19.511360+0000","last_fullsized":"2023-10-06T11:14:19.511360+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.526315+0000","last_change":"2023-10-06T11:14:19.525058+0000","last_active":"2023-10-06T11:14:19.526315+0000","last_peered":"2023-10-06T11:14:19.526315+0000","last_clean":"2023-10-06T11:14:19.526315+0000","last_became_active":"2023-10-06T11:14:19.524770+0000","last_became_peered":"2023-10-06T11:14:19.524770+0000","last_unstale":"2023-10-06T11:14:19.526315+0000","last_undegraded":"2023-10-06T11:14:19.526315+0000","last_fullsized":"2023-10-06T11:14:19.526315+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:45:37.672564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.543943+0000","last_change":"2023-10-06T11:14:18.514474+0000","last_active":"2023-10-06T11:14:19.543943+0000","last_peered":"2023-10-06T11:14:19.543943+0000","last_clean":"2023-10-06T11:14:19.543943+0000","last_became_active":"2023-10-06T11:14:18.514228+0000","last_became_peered":"2023-10-06T11:14:18.514228+0000","last_unstale":"2023-10-06T11:14:19.543943+0000","last_undegraded":"2023-10-06T11:14:19.543943+0000","last_fullsized":"2023-10-06T11:14:19.543943+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:34:37.609177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":89,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.518928+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:14:19.518928+0000","last_peered":"2023-10-06T11:14:19.518928+0000","last_clean":"2023-10-06T11:14:19.518928+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:14:19.518928+0000","last_undegraded":"2023-10-06T11:14:19.518928+0000","last_fullsized":"2023-10-06T11:14:19.518928+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":233,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.510965+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:14:18.510965+0000","last_peered":"2023-10-06T11:14:18.510965+0000","last_clean":"2023-10-06T11:14:18.510965+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:14:18.510965+0000","last_undegraded":"2023-10-06T11:14:18.510965+0000","last_fullsized":"2023-10-06T11:14:18.510965+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.532069+0000","last_change":"2023-10-06T11:14:19.524592+0000","last_active":"2023-10-06T11:14:19.532069+0000","last_peered":"2023-10-06T11:14:19.532069+0000","last_clean":"2023-10-06T11:14:19.532069+0000","last_became_active":"2023-10-06T11:14:19.524335+0000","last_became_peered":"2023-10-06T11:14:19.524335+0000","last_unstale":"2023-10-06T11:14:19.532069+0000","last_undegraded":"2023-10-06T11:14:19.532069+0000","last_fullsized":"2023-10-06T11:14:19.532069+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:21:12.436828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.511622+0000","last_change":"2023-10-06T11:14:18.515686+0000","last_active":"2023-10-06T11:14:19.511622+0000","last_peered":"2023-10-06T11:14:19.511622+0000","last_clean":"2023-10-06T11:14:19.511622+0000","last_became_active":"2023-10-06T11:14:18.515482+0000","last_became_peered":"2023-10-06T11:14:18.515482+0000","last_unstale":"2023-10-06T11:14:19.511622+0000","last_undegraded":"2023-10-06T11:14:19.511622+0000","last_fullsized":"2023-10-06T11:14:19.511622+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:20:34.274020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":83,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.510224+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:14:18.510224+0000","last_peered":"2023-10-06T11:14:18.510224+0000","last_clean":"2023-10-06T11:14:18.510224+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:14:18.510224+0000","last_undegraded":"2023-10-06T11:14:18.510224+0000","last_fullsized":"2023-10-06T11:14:18.510224+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":8,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.533731+0000","last_change":"2023-10-06T11:14:19.533731+0000","last_active":"2023-10-06T11:14:19.533731+0000","last_peered":"2023-10-06T11:14:19.533731+0000","last_clean":"2023-10-06T11:14:19.533731+0000","last_became_active":"2023-10-06T11:14:19.533083+0000","last_became_peered":"2023-10-06T11:14:19.533083+0000","last_unstale":"2023-10-06T11:14:19.533731+0000","last_undegraded":"2023-10-06T11:14:19.533731+0000","last_fullsized":"2023-10-06T11:14:19.533731+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:29:42.487946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"112'8","reported_seq":18,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.544115+0000","last_change":"2023-10-06T11:14:18.515017+0000","last_active":"2023-10-06T11:14:19.544115+0000","last_peered":"2023-10-06T11:14:19.544115+0000","last_clean":"2023-10-06T11:14:19.544115+0000","last_became_active":"2023-10-06T11:14:18.514748+0000","last_became_peered":"2023-10-06T11:14:18.514748+0000","last_unstale":"2023-10-06T11:14:19.544115+0000","last_undegraded":"2023-10-06T11:14:19.544115+0000","last_fullsized":"2023-10-06T11:14:19.544115+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:48.543445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":83,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.511062+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:14:18.511062+0000","last_peered":"2023-10-06T11:14:18.511062+0000","last_clean":"2023-10-06T11:14:18.511062+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:14:18.511062+0000","last_undegraded":"2023-10-06T11:14:18.511062+0000","last_fullsized":"2023-10-06T11:14:18.511062+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.533626+0000","last_change":"2023-10-06T11:14:19.528090+0000","last_active":"2023-10-06T11:14:19.533626+0000","last_peered":"2023-10-06T11:14:19.533626+0000","last_clean":"2023-10-06T11:14:19.533626+0000","last_became_active":"2023-10-06T11:14:19.527835+0000","last_became_peered":"2023-10-06T11:14:19.527835+0000","last_unstale":"2023-10-06T11:14:19.533626+0000","last_undegraded":"2023-10-06T11:14:19.533626+0000","last_fullsized":"2023-10-06T11:14:19.533626+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:08.535899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.511383+0000","last_change":"2023-10-06T11:14:18.512989+0000","last_active":"2023-10-06T11:14:19.511383+0000","last_peered":"2023-10-06T11:14:19.511383+0000","last_clean":"2023-10-06T11:14:19.511383+0000","last_became_active":"2023-10-06T11:14:18.512689+0000","last_became_peered":"2023-10-06T11:14:18.512689+0000","last_unstale":"2023-10-06T11:14:19.511383+0000","last_undegraded":"2023-10-06T11:14:19.511383+0000","last_fullsized":"2023-10-06T11:14:19.511383+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:47:07.809091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":103,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.512583+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:14:19.512583+0000","last_peered":"2023-10-06T11:14:19.512583+0000","last_clean":"2023-10-06T11:14:19.512583+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:14:19.512583+0000","last_undegraded":"2023-10-06T11:14:19.512583+0000","last_fullsized":"2023-10-06T11:14:19.512583+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.532184+0000","last_change":"2023-10-06T11:14:19.528209+0000","last_active":"2023-10-06T11:14:19.532184+0000","last_peered":"2023-10-06T11:14:19.532184+0000","last_clean":"2023-10-06T11:14:19.532184+0000","last_became_active":"2023-10-06T11:14:19.527990+0000","last_became_peered":"2023-10-06T11:14:19.527990+0000","last_unstale":"2023-10-06T11:14:19.532184+0000","last_undegraded":"2023-10-06T11:14:19.532184+0000","last_fullsized":"2023-10-06T11:14:19.532184+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:26:10.256818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.513801+0000","last_change":"2023-10-06T11:14:18.512620+0000","last_active":"2023-10-06T11:14:19.513801+0000","last_peered":"2023-10-06T11:14:19.513801+0000","last_clean":"2023-10-06T11:14:19.513801+0000","last_became_active":"2023-10-06T11:14:18.512352+0000","last_became_peered":"2023-10-06T11:14:18.512352+0000","last_unstale":"2023-10-06T11:14:19.513801+0000","last_undegraded":"2023-10-06T11:14:19.513801+0000","last_fullsized":"2023-10-06T11:14:19.513801+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:53.640644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":90,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.519678+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:14:19.519678+0000","last_peered":"2023-10-06T11:14:19.519678+0000","last_clean":"2023-10-06T11:14:19.519678+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:14:19.519678+0000","last_undegraded":"2023-10-06T11:14:19.519678+0000","last_fullsized":"2023-10-06T11:14:19.519678+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.526212+0000","last_change":"2023-10-06T11:14:19.524154+0000","last_active":"2023-10-06T11:14:19.526212+0000","last_peered":"2023-10-06T11:14:19.526212+0000","last_clean":"2023-10-06T11:14:19.526212+0000","last_became_active":"2023-10-06T11:14:19.523918+0000","last_became_peered":"2023-10-06T11:14:19.523918+0000","last_unstale":"2023-10-06T11:14:19.526212+0000","last_undegraded":"2023-10-06T11:14:19.526212+0000","last_fullsized":"2023-10-06T11:14:19.526212+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:59:20.354495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.519794+0000","last_change":"2023-10-06T11:14:18.516440+0000","last_active":"2023-10-06T11:14:19.519794+0000","last_peered":"2023-10-06T11:14:19.519794+0000","last_clean":"2023-10-06T11:14:19.519794+0000","last_became_active":"2023-10-06T11:14:18.516161+0000","last_became_peered":"2023-10-06T11:14:18.516161+0000","last_unstale":"2023-10-06T11:14:19.519794+0000","last_undegraded":"2023-10-06T11:14:19.519794+0000","last_fullsized":"2023-10-06T11:14:19.519794+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:53.640644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":90,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.519871+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:14:19.519871+0000","last_peered":"2023-10-06T11:14:19.519871+0000","last_clean":"2023-10-06T11:14:19.519871+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:14:19.519871+0000","last_undegraded":"2023-10-06T11:14:19.519871+0000","last_fullsized":"2023-10-06T11:14:19.519871+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574956,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315628,"kb_used_data":1956,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94056212,"statfs":{"total":96636764160,"available":96313561088,"internally_reserved":0,"allocated":2002944,"data_stored":1227060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.64800000000000002,"15min":0.624},"min":{"1min":0.27600000000000002,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":4.407,"5min":15.506,"15min":23.908999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.57199999999999995,"15min":0.57799999999999996},"min":{"1min":0.35199999999999998,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.60199999999999998,"5min":9.3230000000000004,"15min":9.3230000000000004},"last":0.32700000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.51100000000000001,"15min":0.56200000000000006},"min":{"1min":0.28399999999999997,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":2.4689999999999999,"5min":2.4689999999999999,"15min":9.2360000000000007},"last":0.373},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47199999999999998,"15min":0.505},"min":{"1min":0.36099999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.67700000000000005,"5min":0.78900000000000003,"15min":4.327},"last":0.41699999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.53500000000000003,"15min":0.51700000000000002},"min":{"1min":0.374,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":4.3120000000000003,"5min":4.3120000000000003,"15min":4.3120000000000003},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.54300000000000004,"15min":0.56000000000000005},"min":{"1min":0.32000000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":3.0600000000000001,"5min":3.0600000000000001,"15min":4.7309999999999999},"last":0.439}]},{"osd":3,"last update":"Fri Oct 6 11:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.56499999999999995,"15min":0.53800000000000003},"min":{"1min":0.34000000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":4.5190000000000001,"5min":4.5190000000000001,"15min":4.5190000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.55900000000000005,"15min":0.59799999999999998},"min":{"1min":0.374,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":3.0070000000000001,"5min":3.0070000000000001,"15min":9.3879999999999999},"last":0.51600000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.502,"15min":0.48899999999999999},"min":{"1min":0.29799999999999999,"5min":0.25,"15min":0.24399999999999999},"max":{"1min":4.6639999999999997,"5min":4.6639999999999997,"15min":4.6639999999999997},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.52900000000000003,"15min":0.53700000000000003},"min":{"1min":0.315,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":4.3689999999999998,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":0.69199999999999995}]},{"osd":5,"last update":"Fri Oct 6 11:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.495,"15min":0.56200000000000006},"min":{"1min":0.34100000000000003,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.745,"5min":0.84699999999999998,"15min":9.3499999999999996},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.502,"15min":0.54800000000000004},"min":{"1min":0.33300000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.77200000000000002,"5min":0.83399999999999996,"15min":4.444},"last":0.46200000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.53700000000000003,"15min":0.60199999999999998},"min":{"1min":0.40799999999999997,"5min":0.32400000000000001,"15min":0.29199999999999998},"max":{"1min":0.81299999999999994,"5min":0.81399999999999995,"15min":9.4969999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.60599999999999998,"15min":0.622},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":4.4669999999999996,"5min":4.4669999999999996,"15min":7.2039999999999997},"last":0.66200000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574958,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310948,"kb_used_data":1372,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060892,"statfs":{"total":96636764160,"available":96318353408,"internally_reserved":0,"allocated":1404928,"data_stored":641786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.48099999999999998,"15min":0.48899999999999999},"min":{"1min":0.247,"5min":0.187,"15min":0.187},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53100000000000003,"15min":0.53000000000000003},"min":{"1min":0.41999999999999998,"5min":0.254,"15min":0.254},"max":{"1min":0.71199999999999997,"5min":0.78600000000000003,"15min":0.79000000000000004},"last":0.47799999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.47099999999999997,"15min":0.48699999999999999},"min":{"1min":0.30399999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.64800000000000002,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.495},{"interface":"front","average":{"1min":0.498,"5min":0.54400000000000004,"15min":0.51200000000000001},"min":{"1min":0.34000000000000002,"5min":0.216,"15min":0.216},"max":{"1min":0.80500000000000005,"5min":5.2670000000000003,"15min":5.2670000000000003},"last":0.51700000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47999999999999998,"15min":0.498},"min":{"1min":0.29099999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.72799999999999998,"5min":0.83999999999999997,"15min":7.0659999999999998},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.48499999999999999,"15min":0.52000000000000002},"min":{"1min":0.32200000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.78600000000000003,"5min":1.0069999999999999,"15min":7.0819999999999999},"last":0.53000000000000003}]},{"osd":3,"last update":"Fri Oct 6 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51800000000000002,"15min":0.502},"min":{"1min":0.32600000000000001,"5min":0.317,"15min":0.25800000000000001},"max":{"1min":0.753,"5min":0.83499999999999996,"15min":0.85699999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52900000000000003,"15min":0.53200000000000003},"min":{"1min":0.39900000000000002,"5min":0.316,"15min":0.312},"max":{"1min":0.70899999999999996,"5min":0.77000000000000002,"15min":0.83999999999999997},"last":0.46400000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.45400000000000001,"15min":0.48599999999999999},"min":{"1min":0.30099999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.76000000000000001,"5min":0.88,"15min":0.88},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.50900000000000001,"15min":0.54400000000000004},"min":{"1min":0.34499999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":1.0680000000000001},"last":0.39700000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.497,"15min":0.52200000000000002},"min":{"1min":0.32000000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53600000000000003,"15min":0.56599999999999995},"min":{"1min":0.36599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.80300000000000005,"5min":1.034,"15min":1.034},"last":0.56000000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.42899999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.82799999999999996,"5min":0.84899999999999998,"15min":0.98899999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56399999999999995,"15min":0.58999999999999997},"min":{"1min":0.36399999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.88400000000000001},"last":0.50600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574957,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307424,"kb_used_data":1944,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064416,"statfs":{"total":96636764160,"available":96321961984,"internally_reserved":0,"allocated":1990656,"data_stored":1226334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:13:55 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":0.46100000000000002,"15min":0.38},"min":{"1min":0.216,"5min":0.186,"15min":0.186},"max":{"1min":13.393000000000001,"5min":13.393000000000001,"15min":13.393000000000001},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.46400000000000002,"15min":0.38300000000000001},"min":{"1min":0.24299999999999999,"5min":0.215,"15min":0.19700000000000001},"max":{"1min":11.462,"5min":11.462,"15min":11.462},"last":0.29499999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.41299999999999998,"15min":0.36099999999999999},"min":{"1min":0.222,"5min":0.216,"15min":0.216},"max":{"1min":8.0470000000000006,"5min":8.0470000000000006,"15min":8.0470000000000006},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.441,"15min":0.40400000000000003},"min":{"1min":0.26300000000000001,"5min":0.22800000000000001,"15min":0.20999999999999999},"max":{"1min":4.8630000000000004,"5min":4.8630000000000004,"15min":4.8630000000000004},"last":0.36199999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.45200000000000001,"15min":0.42399999999999999},"min":{"1min":0.25700000000000001,"5min":0.252,"15min":0.252},"max":{"1min":4.8029999999999999,"5min":4.8029999999999999,"15min":4.8029999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.437,"15min":0.39100000000000001},"min":{"1min":0.23400000000000001,"5min":0.217,"15min":0.217},"max":{"1min":5.8700000000000001,"5min":5.8700000000000001,"15min":5.8700000000000001},"last":0.374}]},{"osd":4,"last update":"Fri Oct 6 11:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53000000000000003,"15min":0.51400000000000001},"min":{"1min":0.376,"5min":0.29499999999999998,"15min":0.28199999999999997},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.61699999999999999,"15min":0.56499999999999995},"min":{"1min":0.39900000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":4.7699999999999996,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.45700000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.60399999999999998,"15min":0.56699999999999995},"min":{"1min":0.42199999999999999,"5min":0.34000000000000002,"15min":0.33500000000000002},"max":{"1min":3.4390000000000001,"5min":3.4390000000000001,"15min":3.4390000000000001},"last":0.496},{"interface":"front","average":{"1min":1.1479999999999999,"5min":0.67300000000000004,"15min":0.58299999999999996},"min":{"1min":0.41299999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":9.3829999999999991,"5min":9.3829999999999991,"15min":9.3829999999999991},"last":0.42799999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.627,"15min":0.58399999999999996},"min":{"1min":0.46600000000000003,"5min":0.34999999999999998,"15min":0.315},"max":{"1min":3.4750000000000001,"5min":3.4750000000000001,"15min":3.4750000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.625,"15min":0.58899999999999997},"min":{"1min":0.379,"5min":0.376,"15min":0.36699999999999999},"max":{"1min":3.9180000000000001,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.48899999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.65400000000000003,"15min":0.60999999999999999},"min":{"1min":0.436,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":4.7290000000000001,"5min":4.7290000000000001,"15min":4.7290000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.61799999999999999,"15min":0.59299999999999997},"min":{"1min":0.38900000000000001,"5min":0.378,"15min":0.374},"max":{"1min":2.4500000000000002,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.54400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574956,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298648,"kb_used_data":1360,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073192,"statfs":{"total":96636764160,"available":96330948608,"internally_reserved":0,"allocated":1392640,"data_stored":634613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.74099999999999999,"15min":0.46800000000000003},"min":{"1min":0.23699999999999999,"5min":0.184,"15min":0.184},"max":{"1min":0.45000000000000001,"5min":36.097999999999999,"15min":36.097999999999999},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.45200000000000001,"15min":0.378},"min":{"1min":0.23400000000000001,"5min":0.182,"15min":0.182},"max":{"1min":0.439,"5min":7.2990000000000004,"15min":7.2990000000000004},"last":0.30499999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.77300000000000002,"15min":0.50800000000000001},"min":{"1min":0.251,"5min":0.217,"15min":0.217},"max":{"1min":0.48499999999999999,"5min":36.07,"15min":36.07},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.48299999999999998,"15min":0.40400000000000003},"min":{"1min":0.27800000000000002,"5min":0.23200000000000001,"15min":0.219},"max":{"1min":0.55500000000000005,"5min":6.7800000000000002,"15min":6.7800000000000002},"last":0.33700000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.44500000000000001,"15min":0.39700000000000002},"min":{"1min":0.26700000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.502,"5min":8.4130000000000003,"15min":8.4130000000000003},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.80800000000000005,"15min":0.56000000000000005},"min":{"1min":0.29699999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.48099999999999998,"5min":35.959000000000003,"15min":35.959000000000003},"last":0.35199999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56599999999999995,"15min":0.56200000000000006},"min":{"1min":0.33800000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.78200000000000003,"5min":2.427,"15min":2.427},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.97899999999999998,"15min":0.73499999999999999},"min":{"1min":0.374,"5min":0.34399999999999997,"15min":0.29299999999999998},"max":{"1min":0.75700000000000001,"5min":36.005000000000003,"15min":36.005000000000003},"last":0.71299999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.63600000000000001,"15min":0.57799999999999996},"min":{"1min":0.40100000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.752,"5min":6.6699999999999999,"15min":6.6699999999999999},"last":0.626},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56100000000000005,"15min":0.55100000000000005},"min":{"1min":0.39500000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.71799999999999997,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.70199999999999996}]},{"osd":6,"last update":"Fri Oct 6 11:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.98399999999999999,"15min":0.73399999999999999},"min":{"1min":0.41199999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.77400000000000002,"5min":36.037999999999997,"15min":36.037999999999997},"last":0.749},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.69899999999999995,"15min":0.63500000000000001},"min":{"1min":0.40999999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79800000000000004,"5min":6.7110000000000003,"15min":6.7110000000000003},"last":0.59599999999999997}]},{"osd":7,"last update":"Fri Oct 6 11:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.66200000000000003,"15min":0.623},"min":{"1min":0.45100000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.81999999999999995,"5min":6.742,"15min":6.742},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58999999999999997,"15min":0.56799999999999995},"min":{"1min":0.44,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71199999999999997,"5min":1.917,"15min":1.917},"last":0.61799999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574957,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310944,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060896,"statfs":{"total":96636764160,"available":96318357504,"internally_reserved":0,"allocated":1400832,"data_stored":641232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.28499999999999998,"5min":0.309,"15min":0.309},"min":{"1min":0.214,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.39300000000000002,"5min":0.56699999999999995,"15min":0.57499999999999996},"last":0.318},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.38100000000000001,"15min":0.38300000000000001},"min":{"1min":0.25,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.46400000000000002,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.38}]},{"osd":1,"last update":"Fri Oct 6 11:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.377,"15min":0.374},"min":{"1min":0.23599999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.57499999999999996,"5min":0.745,"15min":0.745},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.35199999999999998,"15min":0.35099999999999998},"min":{"1min":0.253,"5min":0.216,"15min":0.216},"max":{"1min":0.51600000000000001,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.26700000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.36199999999999999,"15min":0.36899999999999999},"min":{"1min":0.23699999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.495,"5min":0.628,"15min":0.629},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.376,"5min":0.36299999999999999,"15min":0.36499999999999999},"min":{"1min":0.254,"5min":0.251,"15min":0.251},"max":{"1min":0.46600000000000003,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.33100000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51700000000000002,"15min":0.52900000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30299999999999999},"max":{"1min":0.61599999999999999,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53600000000000003,"15min":0.55100000000000005},"min":{"1min":0.28199999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.72499999999999998,"5min":0.80400000000000005,"15min":0.84899999999999998},"last":0.45300000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53400000000000003,"15min":0.54500000000000004},"min":{"1min":0.35799999999999998,"5min":0.33100000000000002,"15min":0.32400000000000001},"max":{"1min":0.68799999999999994,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.498},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56399999999999995,"15min":0.55600000000000005},"min":{"1min":0.41299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73499999999999999,"5min":0.878,"15min":0.878},"last":0.52400000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58099999999999996,"15min":0.58299999999999996},"min":{"1min":0.38200000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.79500000000000004,"5min":0.85199999999999998,"15min":0.86299999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56699999999999995,"15min":0.57499999999999996},"min":{"1min":0.41299999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.68000000000000005,"5min":0.878,"15min":0.88600000000000001},"last":0.57199999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56899999999999995,"15min":0.55800000000000005},"min":{"1min":0.39500000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.63400000000000001,"5min":1.139,"15min":1.139},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.44,"5min":0.38800000000000001,"15min":0.38200000000000001},"max":{"1min":0.72899999999999998,"5min":0.89600000000000002,"15min":0.90500000000000003},"last":0.56100000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574957,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302768,"kb_used_data":1384,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069072,"statfs":{"total":96636764160,"available":96326729728,"internally_reserved":0,"allocated":1417216,"data_stored":642802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.314,"15min":0.32100000000000001},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":1.095},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.35099999999999998,"15min":0.38400000000000001},"min":{"1min":0.27800000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.495,"5min":0.53900000000000003,"15min":1.7210000000000001},"last":0.39400000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.30099999999999999,"5min":0.309,"15min":0.31},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.46100000000000002,"5min":0.48199999999999998,"15min":0.65400000000000003},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.33800000000000002,"15min":0.35999999999999999},"min":{"1min":0.254,"5min":0.188,"15min":0.188},"max":{"1min":0.49099999999999999,"5min":0.53400000000000003,"15min":1.196},"last":0.40899999999999997}]},{"osd":2,"last update":"Fri Oct 6 11:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.35299999999999998,"15min":0.378},"min":{"1min":0.26400000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.48999999999999999,"5min":0.73499999999999999,"15min":1.7729999999999999},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39500000000000002,"15min":0.41299999999999998},"min":{"1min":0.32200000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.52600000000000002,"5min":0.58599999999999997,"15min":1.224},"last":0.47499999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51800000000000002,"15min":0.55300000000000005},"min":{"1min":0.371,"5min":0.311,"15min":0.311},"max":{"1min":0.68100000000000005,"5min":0.77600000000000002,"15min":1.694},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53200000000000003,"15min":0.53900000000000003},"min":{"1min":0.379,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.80700000000000005,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.82399999999999995}]},{"osd":5,"last update":"Fri Oct 6 11:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54400000000000004,"15min":0.53000000000000003},"min":{"1min":0.40000000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.70299999999999996,"5min":0.86199999999999999,"15min":0.878},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.54900000000000004,"15min":0.55900000000000005},"min":{"1min":0.47299999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72999999999999998,"5min":0.75800000000000001,"15min":1.165},"last":0.746}]},{"osd":6,"last update":"Fri Oct 6 11:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56200000000000006,"15min":0.58199999999999996},"min":{"1min":0.443,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.77900000000000003,"5min":0.85099999999999998,"15min":1.1359999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56899999999999995,"15min":0.59099999999999997},"min":{"1min":0.41999999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":1.7470000000000001},"last":0.79700000000000004}]},{"osd":7,"last update":"Fri Oct 6 11:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56000000000000005,"15min":0.58199999999999996},"min":{"1min":0.39100000000000001,"5min":0.35699999999999998,"15min":0.35599999999999998},"max":{"1min":0.79000000000000004,"5min":0.85399999999999998,"15min":1.657},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.45700000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80500000000000005,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.75900000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574956,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302768,"kb_used_data":1384,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069072,"statfs":{"total":96636764160,"available":96326729728,"internally_reserved":0,"allocated":1417216,"data_stored":644121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:13:51 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45800000000000002,"15min":0.54500000000000004},"min":{"1min":0.29999999999999999,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.64000000000000001,"5min":0.77100000000000002,"15min":2.6619999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.498,"15min":0.496},"min":{"1min":0.30199999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.77400000000000002,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.35999999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:13:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47399999999999998,"15min":0.56799999999999995},"min":{"1min":0.29599999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.66900000000000004,"5min":0.752,"15min":2.8650000000000002},"last":0.44},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.48699999999999999,"15min":0.57299999999999995},"min":{"1min":0.28599999999999998,"5min":0.26200000000000001,"15min":0.25800000000000001},"max":{"1min":0.71099999999999997,"5min":0.85899999999999999,"15min":2.7610000000000001},"last":0.53200000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:13:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.502,"15min":0.54900000000000004},"min":{"1min":0.35199999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.73199999999999998,"5min":0.78200000000000003,"15min":1.6910000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55700000000000005,"15min":0.59299999999999997},"min":{"1min":0.33100000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.74299999999999999,"5min":0.93899999999999995,"15min":1.718},"last":0.54900000000000004}]},{"osd":3,"last update":"Fri Oct 6 11:13:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52800000000000002,"15min":0.59999999999999998},"min":{"1min":0.32000000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.76700000000000002,"5min":0.83099999999999996,"15min":2.677},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.52200000000000002,"15min":0.52100000000000002},"min":{"1min":0.34100000000000003,"5min":0.30399999999999999,"15min":0.27500000000000002},"max":{"1min":0.72599999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.505}]},{"osd":5,"last update":"Fri Oct 6 11:13:51 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48199999999999998,"15min":0.48799999999999999},"min":{"1min":0.28499999999999998,"5min":0.23499999999999999,"15min":0.23200000000000001},"max":{"1min":0.72799999999999998,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.51900000000000002,"15min":0.53300000000000003},"min":{"1min":0.28899999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.73799999999999999,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.58899999999999997}]},{"osd":6,"last update":"Fri Oct 6 11:13:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51900000000000002,"15min":0.52500000000000002},"min":{"1min":0.37,"5min":0.30499999999999999,"15min":0.252},"max":{"1min":0.76300000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54500000000000004,"15min":0.57199999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.29799999999999999},"max":{"1min":0.79300000000000004,"5min":0.85799999999999998,"15min":1.165},"last":0.57099999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:13:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57099999999999995,"15min":0.56100000000000005},"min":{"1min":0.34200000000000003,"5min":0.313,"15min":0.313},"max":{"1min":0.82399999999999995,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58099999999999996,"15min":0.59999999999999998},"min":{"1min":0.34100000000000003,"5min":0.317,"15min":0.317},"max":{"1min":0.80800000000000005,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.57899999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574958,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306860,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064980,"statfs":{"total":96636764160,"available":96322539520,"internally_reserved":0,"allocated":1413120,"data_stored":642745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.46700000000000003,"15min":0.629},"min":{"1min":0.23300000000000001,"5min":0.23100000000000001,"15min":0.20499999999999999},"max":{"1min":0.65600000000000003,"5min":0.72599999999999998,"15min":5.0490000000000004},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.46000000000000002,"15min":0.60399999999999998},"min":{"1min":0.26400000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.61899999999999999,"5min":0.78100000000000003,"15min":5.1449999999999996},"last":0.33500000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.47199999999999998,"15min":0.48499999999999999},"min":{"1min":0.25700000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.64200000000000002,"5min":0.81399999999999995,"15min":0.97199999999999998},"last":0.434},{"interface":"front","average":{"1min":0.44,"5min":0.48499999999999999,"15min":0.51400000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.66000000000000003,"5min":0.70999999999999996,"15min":1.8799999999999999},"last":0.46100000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.52200000000000002,"15min":0.55400000000000005},"min":{"1min":0.313,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.72499999999999998,"5min":0.79800000000000004,"15min":4.234},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.53600000000000003,"15min":0.56200000000000006},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.66800000000000004,"5min":0.81000000000000005,"15min":1.0369999999999999},"last":0.48599999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.49299999999999999,"15min":0.64700000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.27700000000000002},"max":{"1min":0.64000000000000001,"5min":0.82299999999999995,"15min":5.2169999999999996},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.52100000000000002,"15min":0.54300000000000004},"min":{"1min":0.29999999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.622,"5min":0.82699999999999996,"15min":1.008},"last":0.54400000000000004}]},{"osd":4,"last update":"Fri Oct 6 11:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.48399999999999999,"15min":0.51800000000000002},"min":{"1min":0.30599999999999999,"5min":0.27400000000000002,"15min":0.23999999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":1.917},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.48699999999999999,"15min":0.52900000000000003},"min":{"1min":0.311,"5min":0.24399999999999999,"15min":0.23899999999999999},"max":{"1min":0.69199999999999995,"5min":0.71899999999999997,"15min":0.87},"last":0.44600000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.50600000000000001,"15min":0.55700000000000005},"min":{"1min":0.33300000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.69599999999999995,"5min":0.77100000000000002,"15min":2.0139999999999998},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56299999999999994,"15min":0.60799999999999998},"min":{"1min":0.42299999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.79400000000000004,"5min":0.82899999999999996,"15min":1.9470000000000001},"last":0.56999999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53600000000000003,"15min":0.58099999999999996},"min":{"1min":0.36399999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.96499999999999997},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56499999999999995,"15min":0.60699999999999998},"min":{"1min":0.40100000000000002,"5min":0.316,"15min":0.28799999999999998},"max":{"1min":0.77300000000000002,"5min":0.79900000000000004,"15min":1.4119999999999999},"last":0.628}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:14:23.635 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:14:23.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.748+0000 7fe325f38700 1 Processor -- start 2023-10-06T11:14:23.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.748+0000 7fe325f38700 1 -- start start 2023-10-06T11:14:23.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.749+0000 7fe325f38700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe32015a7f0 0x7fe32015cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:23.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.749+0000 7fe325f38700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe3200b2530 0x7fe32015acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:23.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.749+0000 7fe325f38700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe32015c630 con 0x7fe32015a420 2023-10-06T11:14:23.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.749+0000 7fe325f38700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3200ce040 con 0x7fe3200b2530 2023-10-06T11:14:23.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.749+0000 7fe325f38700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe32015ba20 con 0x7fe32015a7f0 2023-10-06T11:14:23.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.749+0000 7fe325737700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe3200b2530 0x7fe32015acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:23.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.749+0000 7fe325737700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe3200b2530 0x7fe32015acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53652/0 (socket says 172.21.15.146:53652) 2023-10-06T11:14:23.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.749+0000 7fe325737700 1 -- 172.21.15.146:0/1307044323 learned_addr learned my addr 172.21.15.146:0/1307044323 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:23.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.749+0000 7fe317fff700 1 --2- 172.21.15.146:0/1307044323 >> v2:172.21.15.151:3300/0 conn(0x7fe32015a7f0 0x7fe32015cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:23.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.749+0000 7fe325737700 1 -- 172.21.15.146:0/1307044323 >> v2:172.21.15.151:3300/0 conn(0x7fe32015a7f0 msgr2=0x7fe32015cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:23.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.749+0000 7fe325737700 1 --2- 172.21.15.146:0/1307044323 >> v2:172.21.15.151:3300/0 conn(0x7fe32015a7f0 0x7fe32015cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.749+0000 7fe325737700 1 -- 172.21.15.146:0/1307044323 >> v1:172.21.15.151:6789/0 conn(0x7fe32015a420 legacy=0x7fe3200b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:23.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.749+0000 7fe325737700 1 -- 172.21.15.146:0/1307044323 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe32015bd00 con 0x7fe3200b2530 2023-10-06T11:14:23.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.750+0000 7fe325737700 1 --2- 172.21.15.146:0/1307044323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3200b2530 0x7fe32015acd0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fe3200b33c0 tx=0x7fe318009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e28319108fc8b9e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:23.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.750+0000 7fe3177fe700 1 -- 172.21.15.146:0/1307044323 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31800e070 con 0x7fe3200b2530 2023-10-06T11:14:23.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.750+0000 7fe3177fe700 1 -- 172.21.15.146:0/1307044323 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe31800ba50 con 0x7fe3200b2530 2023-10-06T11:14:23.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.750+0000 7fe3177fe700 1 -- 172.21.15.146:0/1307044323 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3180092e0 con 0x7fe3200b2530 2023-10-06T11:14:23.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.750+0000 7fe325f38700 1 -- 172.21.15.146:0/1307044323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3200b2530 msgr2=0x7fe32015acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:23.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.750+0000 7fe325f38700 1 --2- 172.21.15.146:0/1307044323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3200b2530 0x7fe32015acd0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fe3200b33c0 tx=0x7fe318009840 comp rx=0 tx=0).stop 2023-10-06T11:14:23.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.750+0000 7fe325f38700 1 -- 172.21.15.146:0/1307044323 shutdown_connections 2023-10-06T11:14:23.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.750+0000 7fe325f38700 1 --2- 172.21.15.146:0/1307044323 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe3200b2530 0x7fe32015acd0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.750+0000 7fe325f38700 1 --2- 172.21.15.146:0/1307044323 >> v2:172.21.15.151:3300/0 conn(0x7fe32015a7f0 0x7fe32015cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.750+0000 7fe325f38700 1 -- 172.21.15.146:0/1307044323 >> 172.21.15.146:0/1307044323 conn(0x7fe32006eba0 msgr2=0x7fe32006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:23.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.750+0000 7fe325f38700 1 -- 172.21.15.146:0/1307044323 shutdown_connections 2023-10-06T11:14:23.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.750+0000 7fe325f38700 1 -- 172.21.15.146:0/1307044323 wait complete. 2023-10-06T11:14:23.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.751+0000 7fe325f38700 1 Processor -- start 2023-10-06T11:14:23.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.752+0000 7fe325f38700 1 -- start start 2023-10-06T11:14:23.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.752+0000 7fe325f38700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3200b2530 0x7fe320159b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:23.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.752+0000 7fe325f38700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe32015a420 0x7fe32016abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:23.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.752+0000 7fe325f38700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe32015a7f0 0x7fe32014ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:23.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.752+0000 7fe325f38700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe320152440 con 0x7fe32015a420 2023-10-06T11:14:23.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.752+0000 7fe325f38700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32016a1d0 con 0x7fe3200b2530 2023-10-06T11:14:23.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.752+0000 7fe325f38700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe32016a4b0 con 0x7fe32015a7f0 2023-10-06T11:14:23.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.752+0000 7fe317fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe32015a420 0x7fe32016abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:23.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.752+0000 7fe317fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe32015a420 0x7fe32016abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53668/0 (socket says 172.21.15.146:53668) 2023-10-06T11:14:23.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.752+0000 7fe317fff700 1 -- 172.21.15.146:0/2679095070 learned_addr learned my addr 172.21.15.146:0/2679095070 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:23.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.753+0000 7fe325737700 1 --2- 172.21.15.146:0/2679095070 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe32015a7f0 0x7fe32014ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:23.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.753+0000 7fe324f36700 1 --2- 172.21.15.146:0/2679095070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3200b2530 0x7fe320159b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:23.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.753+0000 7fe317fff700 1 -- 172.21.15.146:0/2679095070 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe32015a7f0 msgr2=0x7fe32014ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:23.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.753+0000 7fe317fff700 1 --2- 172.21.15.146:0/2679095070 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe32015a7f0 0x7fe32014ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.753+0000 7fe317fff700 1 -- 172.21.15.146:0/2679095070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3200b2530 msgr2=0x7fe320159b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:23.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.753+0000 7fe317fff700 1 --2- 172.21.15.146:0/2679095070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3200b2530 0x7fe320159b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.753+0000 7fe317fff700 1 -- 172.21.15.146:0/2679095070 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe318009ae0 con 0x7fe32015a420 2023-10-06T11:14:23.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.753+0000 7fe317fff700 1 --2- 172.21.15.146:0/2679095070 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe32015a420 0x7fe32016abe0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fe31000d860 tx=0x7fe310008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:23.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.753+0000 7fe314ff9700 1 -- 172.21.15.146:0/2679095070 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3100125f0 con 0x7fe32015a420 2023-10-06T11:14:23.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.753+0000 7fe314ff9700 1 -- 172.21.15.146:0/2679095070 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe310012750 con 0x7fe32015a420 2023-10-06T11:14:23.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.753+0000 7fe325f38700 1 -- 172.21.15.146:0/2679095070 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe32016a790 con 0x7fe32015a420 2023-10-06T11:14:23.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.753+0000 7fe314ff9700 1 -- 172.21.15.146:0/2679095070 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe310012b10 con 0x7fe32015a420 2023-10-06T11:14:23.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.753+0000 7fe325f38700 1 -- 172.21.15.146:0/2679095070 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe320169c50 con 0x7fe32015a420 2023-10-06T11:14:23.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.754+0000 7fe325f38700 1 -- 172.21.15.146:0/2679095070 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe320152210 con 0x7fe32015a420 2023-10-06T11:14:23.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.754+0000 7fe314ff9700 1 -- 172.21.15.146:0/2679095070 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe31001e460 con 0x7fe32015a420 2023-10-06T11:14:23.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.755+0000 7fe314ff9700 1 --2- 172.21.15.146:0/2679095070 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe30c066f30 0x7fe30c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:23.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.755+0000 7fe314ff9700 1 -- 172.21.15.146:0/2679095070 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe310084bc0 con 0x7fe32015a420 2023-10-06T11:14:23.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.755+0000 7fe324f36700 1 --2- 172.21.15.146:0/2679095070 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe30c066f30 0x7fe30c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:23.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.755+0000 7fe324f36700 1 --2- 172.21.15.146:0/2679095070 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe30c066f30 0x7fe30c0693e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fe3200cdd20 tx=0x7fe31c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:23.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.759+0000 7fe314ff9700 1 -- 172.21.15.146:0/2679095070 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe310051cd0 con 0x7fe32015a420 2023-10-06T11:14:23.842 INFO:tasks.ceph.mds.c.smithi146.stderr:2023-10-06T11:14:23.840+0000 7f04e072b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T11:14:23.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.938+0000 7fe325f38700 1 -- 172.21.15.146:0/2679095070 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe32016a980 con 0x7fe30c066f30 2023-10-06T11:14:23.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.946+0000 7fe314ff9700 1 -- 172.21.15.146:0/2679095070 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311846 (secure 0 0 0) 0x7fe32016a980 con 0x7fe30c066f30 2023-10-06T11:14:23.952 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:23.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.950+0000 7fe325f38700 1 -- 172.21.15.146:0/2679095070 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe30c066f30 msgr2=0x7fe30c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:23.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.950+0000 7fe325f38700 1 --2- 172.21.15.146:0/2679095070 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe30c066f30 0x7fe30c0693e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fe3200cdd20 tx=0x7fe31c009040 comp rx=0 tx=0).stop 2023-10-06T11:14:23.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.950+0000 7fe325f38700 1 -- 172.21.15.146:0/2679095070 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe32015a420 msgr2=0x7fe32016abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:23.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.950+0000 7fe325f38700 1 --2- 172.21.15.146:0/2679095070 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe32015a420 0x7fe32016abe0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7fe31000d860 tx=0x7fe310008040 comp rx=0 tx=0).stop 2023-10-06T11:14:23.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.950+0000 7fe325f38700 1 -- 172.21.15.146:0/2679095070 shutdown_connections 2023-10-06T11:14:23.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.950+0000 7fe325f38700 1 --2- 172.21.15.146:0/2679095070 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe30c066f30 0x7fe30c0693e0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.950+0000 7fe325f38700 1 --2- 172.21.15.146:0/2679095070 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe32015a7f0 0x7fe32014ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.950+0000 7fe325f38700 1 --2- 172.21.15.146:0/2679095070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3200b2530 0x7fe320159b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.950+0000 7fe325f38700 1 --2- 172.21.15.146:0/2679095070 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe32015a420 0x7fe32016abe0 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:23.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.950+0000 7fe325f38700 1 -- 172.21.15.146:0/2679095070 >> 172.21.15.146:0/2679095070 conn(0x7fe32006eba0 msgr2=0x7fe32013f1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:23.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.950+0000 7fe325f38700 1 -- 172.21.15.146:0/2679095070 shutdown_connections 2023-10-06T11:14:23.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:23.950+0000 7fe325f38700 1 -- 172.21.15.146:0/2679095070 wait complete. 2023-10-06T11:14:23.955 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:14:23.964 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":369,"stamp":"2023-10-06T11:14:23.251037+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":143,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2455988,"kb_used_data":12148,"kb_used_omap":0,"kb_used_meta":2443776,"kb_avail":752518732,"statfs":{"total":773094113280,"available":770579181568,"internally_reserved":0,"allocated":12439552,"data_stored":6300693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2502426624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.754502"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.527743+0000","last_change":"2023-10-06T11:14:19.520476+0000","last_active":"2023-10-06T11:14:19.527743+0000","last_peered":"2023-10-06T11:14:19.527743+0000","last_clean":"2023-10-06T11:14:19.527743+0000","last_became_active":"2023-10-06T11:14:19.520205+0000","last_became_peered":"2023-10-06T11:14:19.520205+0000","last_unstale":"2023-10-06T11:14:19.527743+0000","last_undegraded":"2023-10-06T11:14:19.527743+0000","last_fullsized":"2023-10-06T11:14:19.527743+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:26.347568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.532811+0000","last_change":"2023-10-06T11:14:19.532348+0000","last_active":"2023-10-06T11:14:19.532811+0000","last_peered":"2023-10-06T11:14:19.532811+0000","last_clean":"2023-10-06T11:14:19.532811+0000","last_became_active":"2023-10-06T11:14:19.532012+0000","last_became_peered":"2023-10-06T11:14:19.532012+0000","last_unstale":"2023-10-06T11:14:19.532811+0000","last_undegraded":"2023-10-06T11:14:19.532811+0000","last_fullsized":"2023-10-06T11:14:19.532811+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:26.347568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.532698+0000","last_change":"2023-10-06T11:14:19.528088+0000","last_active":"2023-10-06T11:14:19.532698+0000","last_peered":"2023-10-06T11:14:19.532698+0000","last_clean":"2023-10-06T11:14:19.532698+0000","last_became_active":"2023-10-06T11:14:19.527793+0000","last_became_peered":"2023-10-06T11:14:19.527793+0000","last_unstale":"2023-10-06T11:14:19.532698+0000","last_undegraded":"2023-10-06T11:14:19.532698+0000","last_fullsized":"2023-10-06T11:14:19.532698+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:19:52.809562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":8,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.529107+0000","last_change":"2023-10-06T11:14:19.529107+0000","last_active":"2023-10-06T11:14:19.529107+0000","last_peered":"2023-10-06T11:14:19.529107+0000","last_clean":"2023-10-06T11:14:19.529107+0000","last_became_active":"2023-10-06T11:14:19.528656+0000","last_became_peered":"2023-10-06T11:14:19.528656+0000","last_unstale":"2023-10-06T11:14:19.529107+0000","last_undegraded":"2023-10-06T11:14:19.529107+0000","last_fullsized":"2023-10-06T11:14:19.529107+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:28:18.675296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.531122+0000","last_change":"2023-10-06T11:14:19.526066+0000","last_active":"2023-10-06T11:14:19.531122+0000","last_peered":"2023-10-06T11:14:19.531122+0000","last_clean":"2023-10-06T11:14:19.531122+0000","last_became_active":"2023-10-06T11:14:19.525795+0000","last_became_peered":"2023-10-06T11:14:19.525795+0000","last_unstale":"2023-10-06T11:14:19.531122+0000","last_undegraded":"2023-10-06T11:14:19.531122+0000","last_fullsized":"2023-10-06T11:14:19.531122+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:15:01.598973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":8,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.525388+0000","last_change":"2023-10-06T11:14:19.525388+0000","last_active":"2023-10-06T11:14:19.525388+0000","last_peered":"2023-10-06T11:14:19.525388+0000","last_clean":"2023-10-06T11:14:19.525388+0000","last_became_active":"2023-10-06T11:14:19.525115+0000","last_became_peered":"2023-10-06T11:14:19.525115+0000","last_unstale":"2023-10-06T11:14:19.525388+0000","last_undegraded":"2023-10-06T11:14:19.525388+0000","last_fullsized":"2023-10-06T11:14:19.525388+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:34.724814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":8,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.528773+0000","last_change":"2023-10-06T11:14:19.528773+0000","last_active":"2023-10-06T11:14:19.528773+0000","last_peered":"2023-10-06T11:14:19.528773+0000","last_clean":"2023-10-06T11:14:19.528773+0000","last_became_active":"2023-10-06T11:14:19.528226+0000","last_became_peered":"2023-10-06T11:14:19.528226+0000","last_unstale":"2023-10-06T11:14:19.528773+0000","last_undegraded":"2023-10-06T11:14:19.528773+0000","last_fullsized":"2023-10-06T11:14:19.528773+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:37:51.065364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.532407+0000","last_change":"2023-10-06T11:14:19.530354+0000","last_active":"2023-10-06T11:14:19.532407+0000","last_peered":"2023-10-06T11:14:19.532407+0000","last_clean":"2023-10-06T11:14:19.532407+0000","last_became_active":"2023-10-06T11:14:19.530032+0000","last_became_peered":"2023-10-06T11:14:19.530032+0000","last_unstale":"2023-10-06T11:14:19.532407+0000","last_undegraded":"2023-10-06T11:14:19.532407+0000","last_fullsized":"2023-10-06T11:14:19.532407+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:06:57.398555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":8,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.532883+0000","last_change":"2023-10-06T11:14:19.532883+0000","last_active":"2023-10-06T11:14:19.532883+0000","last_peered":"2023-10-06T11:14:19.532883+0000","last_clean":"2023-10-06T11:14:19.532883+0000","last_became_active":"2023-10-06T11:14:19.532603+0000","last_became_peered":"2023-10-06T11:14:19.532603+0000","last_unstale":"2023-10-06T11:14:19.532883+0000","last_undegraded":"2023-10-06T11:14:19.532883+0000","last_fullsized":"2023-10-06T11:14:19.532883+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:06:31.661698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.532559+0000","last_change":"2023-10-06T11:14:19.527285+0000","last_active":"2023-10-06T11:14:19.532559+0000","last_peered":"2023-10-06T11:14:19.532559+0000","last_clean":"2023-10-06T11:14:19.532559+0000","last_became_active":"2023-10-06T11:14:19.526994+0000","last_became_peered":"2023-10-06T11:14:19.526994+0000","last_unstale":"2023-10-06T11:14:19.532559+0000","last_undegraded":"2023-10-06T11:14:19.532559+0000","last_fullsized":"2023-10-06T11:14:19.532559+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:42:26.291704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.527928+0000","last_change":"2023-10-06T11:14:19.524151+0000","last_active":"2023-10-06T11:14:19.527928+0000","last_peered":"2023-10-06T11:14:19.527928+0000","last_clean":"2023-10-06T11:14:19.527928+0000","last_became_active":"2023-10-06T11:14:19.523866+0000","last_became_peered":"2023-10-06T11:14:19.523866+0000","last_unstale":"2023-10-06T11:14:19.527928+0000","last_undegraded":"2023-10-06T11:14:19.527928+0000","last_fullsized":"2023-10-06T11:14:19.527928+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:32:43.816552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":8,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.529942+0000","last_change":"2023-10-06T11:14:19.529942+0000","last_active":"2023-10-06T11:14:19.529942+0000","last_peered":"2023-10-06T11:14:19.529942+0000","last_clean":"2023-10-06T11:14:19.529942+0000","last_became_active":"2023-10-06T11:14:19.529301+0000","last_became_peered":"2023-10-06T11:14:19.529301+0000","last_unstale":"2023-10-06T11:14:19.529942+0000","last_undegraded":"2023-10-06T11:14:19.529942+0000","last_fullsized":"2023-10-06T11:14:19.529942+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:38:30.754949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.531681+0000","last_change":"2023-10-06T11:14:19.522176+0000","last_active":"2023-10-06T11:14:19.531681+0000","last_peered":"2023-10-06T11:14:19.531681+0000","last_clean":"2023-10-06T11:14:19.531681+0000","last_became_active":"2023-10-06T11:14:19.521700+0000","last_became_peered":"2023-10-06T11:14:19.521700+0000","last_unstale":"2023-10-06T11:14:19.531681+0000","last_undegraded":"2023-10-06T11:14:19.531681+0000","last_fullsized":"2023-10-06T11:14:19.531681+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:24:53.043665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.532979+0000","last_change":"2023-10-06T11:14:19.530044+0000","last_active":"2023-10-06T11:14:19.532979+0000","last_peered":"2023-10-06T11:14:19.532979+0000","last_clean":"2023-10-06T11:14:19.532979+0000","last_became_active":"2023-10-06T11:14:19.529403+0000","last_became_peered":"2023-10-06T11:14:19.529403+0000","last_unstale":"2023-10-06T11:14:19.532979+0000","last_undegraded":"2023-10-06T11:14:19.532979+0000","last_fullsized":"2023-10-06T11:14:19.532979+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:49:42.929918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.528047+0000","last_change":"2023-10-06T11:14:19.524300+0000","last_active":"2023-10-06T11:14:19.528047+0000","last_peered":"2023-10-06T11:14:19.528047+0000","last_clean":"2023-10-06T11:14:19.528047+0000","last_became_active":"2023-10-06T11:14:19.524005+0000","last_became_peered":"2023-10-06T11:14:19.524005+0000","last_unstale":"2023-10-06T11:14:19.528047+0000","last_undegraded":"2023-10-06T11:14:19.528047+0000","last_fullsized":"2023-10-06T11:14:19.528047+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:58:45.856421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":8,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.526085+0000","last_change":"2023-10-06T11:14:19.526085+0000","last_active":"2023-10-06T11:14:19.526085+0000","last_peered":"2023-10-06T11:14:19.526085+0000","last_clean":"2023-10-06T11:14:19.526085+0000","last_became_active":"2023-10-06T11:14:19.525777+0000","last_became_peered":"2023-10-06T11:14:19.525777+0000","last_unstale":"2023-10-06T11:14:19.526085+0000","last_undegraded":"2023-10-06T11:14:19.526085+0000","last_fullsized":"2023-10-06T11:14:19.526085+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:15:24.397193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.532403+0000","last_change":"2023-10-06T11:14:19.531279+0000","last_active":"2023-10-06T11:14:19.532403+0000","last_peered":"2023-10-06T11:14:19.532403+0000","last_clean":"2023-10-06T11:14:19.532403+0000","last_became_active":"2023-10-06T11:14:19.530993+0000","last_became_peered":"2023-10-06T11:14:19.530993+0000","last_unstale":"2023-10-06T11:14:19.532403+0000","last_undegraded":"2023-10-06T11:14:19.532403+0000","last_fullsized":"2023-10-06T11:14:19.532403+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:52:25.323760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.532231+0000","last_change":"2023-10-06T11:14:19.528332+0000","last_active":"2023-10-06T11:14:19.532231+0000","last_peered":"2023-10-06T11:14:19.532231+0000","last_clean":"2023-10-06T11:14:19.532231+0000","last_became_active":"2023-10-06T11:14:19.527895+0000","last_became_peered":"2023-10-06T11:14:19.527895+0000","last_unstale":"2023-10-06T11:14:19.532231+0000","last_undegraded":"2023-10-06T11:14:19.532231+0000","last_fullsized":"2023-10-06T11:14:19.532231+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:32:43.816552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.530371+0000","last_change":"2023-10-06T11:14:19.528482+0000","last_active":"2023-10-06T11:14:19.530371+0000","last_peered":"2023-10-06T11:14:19.530371+0000","last_clean":"2023-10-06T11:14:19.530371+0000","last_became_active":"2023-10-06T11:14:19.527376+0000","last_became_peered":"2023-10-06T11:14:19.527376+0000","last_unstale":"2023-10-06T11:14:19.530371+0000","last_undegraded":"2023-10-06T11:14:19.530371+0000","last_fullsized":"2023-10-06T11:14:19.530371+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:21:12.436828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.532610+0000","last_change":"2023-10-06T11:14:19.525242+0000","last_active":"2023-10-06T11:14:19.532610+0000","last_peered":"2023-10-06T11:14:19.532610+0000","last_clean":"2023-10-06T11:14:19.532610+0000","last_became_active":"2023-10-06T11:14:19.524965+0000","last_became_peered":"2023-10-06T11:14:19.524965+0000","last_unstale":"2023-10-06T11:14:19.532610+0000","last_undegraded":"2023-10-06T11:14:19.532610+0000","last_fullsized":"2023-10-06T11:14:19.532610+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:11:40.740294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":8,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.533908+0000","last_change":"2023-10-06T11:14:19.533908+0000","last_active":"2023-10-06T11:14:19.533908+0000","last_peered":"2023-10-06T11:14:19.533908+0000","last_clean":"2023-10-06T11:14:19.533908+0000","last_became_active":"2023-10-06T11:14:19.533475+0000","last_became_peered":"2023-10-06T11:14:19.533475+0000","last_unstale":"2023-10-06T11:14:19.533908+0000","last_undegraded":"2023-10-06T11:14:19.533908+0000","last_fullsized":"2023-10-06T11:14:19.533908+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:58:45.856421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.532413+0000","last_change":"2023-10-06T11:14:19.528331+0000","last_active":"2023-10-06T11:14:19.532413+0000","last_peered":"2023-10-06T11:14:19.532413+0000","last_clean":"2023-10-06T11:14:19.532413+0000","last_became_active":"2023-10-06T11:14:19.528033+0000","last_became_peered":"2023-10-06T11:14:19.528033+0000","last_unstale":"2023-10-06T11:14:19.532413+0000","last_undegraded":"2023-10-06T11:14:19.532413+0000","last_fullsized":"2023-10-06T11:14:19.532413+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:19:18.637586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":8,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.534688+0000","last_change":"2023-10-06T11:14:19.534688+0000","last_active":"2023-10-06T11:14:19.534688+0000","last_peered":"2023-10-06T11:14:19.534688+0000","last_clean":"2023-10-06T11:14:19.534688+0000","last_became_active":"2023-10-06T11:14:19.534390+0000","last_became_peered":"2023-10-06T11:14:19.534390+0000","last_unstale":"2023-10-06T11:14:19.534688+0000","last_undegraded":"2023-10-06T11:14:19.534688+0000","last_fullsized":"2023-10-06T11:14:19.534688+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:19:18.637586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.530390+0000","last_change":"2023-10-06T11:14:19.525690+0000","last_active":"2023-10-06T11:14:19.530390+0000","last_peered":"2023-10-06T11:14:19.530390+0000","last_clean":"2023-10-06T11:14:19.530390+0000","last_became_active":"2023-10-06T11:14:19.525323+0000","last_became_peered":"2023-10-06T11:14:19.525323+0000","last_unstale":"2023-10-06T11:14:19.530390+0000","last_undegraded":"2023-10-06T11:14:19.530390+0000","last_fullsized":"2023-10-06T11:14:19.530390+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:59.263674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.530164+0000","last_change":"2023-10-06T11:14:19.521772+0000","last_active":"2023-10-06T11:14:19.530164+0000","last_peered":"2023-10-06T11:14:19.530164+0000","last_clean":"2023-10-06T11:14:19.530164+0000","last_became_active":"2023-10-06T11:14:19.521483+0000","last_became_peered":"2023-10-06T11:14:19.521483+0000","last_unstale":"2023-10-06T11:14:19.530164+0000","last_undegraded":"2023-10-06T11:14:19.530164+0000","last_fullsized":"2023-10-06T11:14:19.530164+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:34:38.614024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.530727+0000","last_change":"2023-10-06T11:14:19.520854+0000","last_active":"2023-10-06T11:14:19.530727+0000","last_peered":"2023-10-06T11:14:19.530727+0000","last_clean":"2023-10-06T11:14:19.530727+0000","last_became_active":"2023-10-06T11:14:19.520615+0000","last_became_peered":"2023-10-06T11:14:19.520615+0000","last_unstale":"2023-10-06T11:14:19.530727+0000","last_undegraded":"2023-10-06T11:14:19.530727+0000","last_fullsized":"2023-10-06T11:14:19.530727+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:40:43.819263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.530352+0000","last_change":"2023-10-06T11:14:19.527756+0000","last_active":"2023-10-06T11:14:19.530352+0000","last_peered":"2023-10-06T11:14:19.530352+0000","last_clean":"2023-10-06T11:14:19.530352+0000","last_became_active":"2023-10-06T11:14:19.527310+0000","last_became_peered":"2023-10-06T11:14:19.527310+0000","last_unstale":"2023-10-06T11:14:19.530352+0000","last_undegraded":"2023-10-06T11:14:19.530352+0000","last_fullsized":"2023-10-06T11:14:19.530352+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:35:44.957885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":8,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.530149+0000","last_change":"2023-10-06T11:14:19.530149+0000","last_active":"2023-10-06T11:14:19.530149+0000","last_peered":"2023-10-06T11:14:19.530149+0000","last_clean":"2023-10-06T11:14:19.530149+0000","last_became_active":"2023-10-06T11:14:19.529661+0000","last_became_peered":"2023-10-06T11:14:19.529661+0000","last_unstale":"2023-10-06T11:14:19.530149+0000","last_undegraded":"2023-10-06T11:14:19.530149+0000","last_fullsized":"2023-10-06T11:14:19.530149+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:42:12.981733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.523113+0000","last_change":"2023-10-06T11:14:19.520171+0000","last_active":"2023-10-06T11:14:19.523113+0000","last_peered":"2023-10-06T11:14:19.523113+0000","last_clean":"2023-10-06T11:14:19.523113+0000","last_became_active":"2023-10-06T11:14:19.519897+0000","last_became_peered":"2023-10-06T11:14:19.519897+0000","last_unstale":"2023-10-06T11:14:19.523113+0000","last_undegraded":"2023-10-06T11:14:19.523113+0000","last_fullsized":"2023-10-06T11:14:19.523113+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:06:03.066755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.529202+0000","last_change":"2023-10-06T11:14:19.519947+0000","last_active":"2023-10-06T11:14:19.529202+0000","last_peered":"2023-10-06T11:14:19.529202+0000","last_clean":"2023-10-06T11:14:19.529202+0000","last_became_active":"2023-10-06T11:14:19.519688+0000","last_became_peered":"2023-10-06T11:14:19.519688+0000","last_unstale":"2023-10-06T11:14:19.529202+0000","last_undegraded":"2023-10-06T11:14:19.529202+0000","last_fullsized":"2023-10-06T11:14:19.529202+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:21:02.106612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.528702+0000","last_change":"2023-10-06T11:14:19.519862+0000","last_active":"2023-10-06T11:14:19.528702+0000","last_peered":"2023-10-06T11:14:19.528702+0000","last_clean":"2023-10-06T11:14:19.528702+0000","last_became_active":"2023-10-06T11:14:19.519577+0000","last_became_peered":"2023-10-06T11:14:19.519577+0000","last_unstale":"2023-10-06T11:14:19.528702+0000","last_undegraded":"2023-10-06T11:14:19.528702+0000","last_fullsized":"2023-10-06T11:14:19.528702+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:35.487190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.530370+0000","last_change":"2023-10-06T11:14:19.525530+0000","last_active":"2023-10-06T11:14:19.530370+0000","last_peered":"2023-10-06T11:14:19.530370+0000","last_clean":"2023-10-06T11:14:19.530370+0000","last_became_active":"2023-10-06T11:14:19.525001+0000","last_became_peered":"2023-10-06T11:14:19.525001+0000","last_unstale":"2023-10-06T11:14:19.530370+0000","last_undegraded":"2023-10-06T11:14:19.530370+0000","last_fullsized":"2023-10-06T11:14:19.530370+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:24:53.043665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.532666+0000","last_change":"2023-10-06T11:14:19.526616+0000","last_active":"2023-10-06T11:14:19.532666+0000","last_peered":"2023-10-06T11:14:19.532666+0000","last_clean":"2023-10-06T11:14:19.532666+0000","last_became_active":"2023-10-06T11:14:19.526396+0000","last_became_peered":"2023-10-06T11:14:19.526396+0000","last_unstale":"2023-10-06T11:14:19.532666+0000","last_undegraded":"2023-10-06T11:14:19.532666+0000","last_fullsized":"2023-10-06T11:14:19.532666+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:59:09.964394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"112'4","reported_seq":14,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.541546+0000","last_change":"2023-10-06T11:14:18.515953+0000","last_active":"2023-10-06T11:14:19.541546+0000","last_peered":"2023-10-06T11:14:19.541546+0000","last_clean":"2023-10-06T11:14:19.541546+0000","last_became_active":"2023-10-06T11:14:18.515686+0000","last_became_peered":"2023-10-06T11:14:18.515686+0000","last_unstale":"2023-10-06T11:14:19.541546+0000","last_undegraded":"2023-10-06T11:14:19.541546+0000","last_fullsized":"2023-10-06T11:14:19.541546+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:37:28.317271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":8,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.524628+0000","last_change":"2023-10-06T11:14:19.524628+0000","last_active":"2023-10-06T11:14:19.524628+0000","last_peered":"2023-10-06T11:14:19.524628+0000","last_clean":"2023-10-06T11:14:19.524628+0000","last_became_active":"2023-10-06T11:14:19.524368+0000","last_became_peered":"2023-10-06T11:14:19.524368+0000","last_unstale":"2023-10-06T11:14:19.524628+0000","last_undegraded":"2023-10-06T11:14:19.524628+0000","last_fullsized":"2023-10-06T11:14:19.524628+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:35:56.912741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.539512+0000","last_change":"2023-10-06T11:14:18.515934+0000","last_active":"2023-10-06T11:14:19.539512+0000","last_peered":"2023-10-06T11:14:19.539512+0000","last_clean":"2023-10-06T11:14:19.539512+0000","last_became_active":"2023-10-06T11:14:18.515726+0000","last_became_peered":"2023-10-06T11:14:18.515726+0000","last_unstale":"2023-10-06T11:14:19.539512+0000","last_undegraded":"2023-10-06T11:14:19.539512+0000","last_fullsized":"2023-10-06T11:14:19.539512+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:41:54.619961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.530279+0000","last_change":"2023-10-06T11:14:19.524330+0000","last_active":"2023-10-06T11:14:19.530279+0000","last_peered":"2023-10-06T11:14:19.530279+0000","last_clean":"2023-10-06T11:14:19.530279+0000","last_became_active":"2023-10-06T11:14:19.521549+0000","last_became_peered":"2023-10-06T11:14:19.521549+0000","last_unstale":"2023-10-06T11:14:19.530279+0000","last_undegraded":"2023-10-06T11:14:19.530279+0000","last_fullsized":"2023-10-06T11:14:19.530279+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:02.550142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"112'2","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.538089+0000","last_change":"2023-10-06T11:14:18.515908+0000","last_active":"2023-10-06T11:14:19.538089+0000","last_peered":"2023-10-06T11:14:19.538089+0000","last_clean":"2023-10-06T11:14:19.538089+0000","last_became_active":"2023-10-06T11:14:18.513935+0000","last_became_peered":"2023-10-06T11:14:18.513935+0000","last_unstale":"2023-10-06T11:14:19.538089+0000","last_undegraded":"2023-10-06T11:14:19.538089+0000","last_fullsized":"2023-10-06T11:14:19.538089+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:52:24.318913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":8,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.533308+0000","last_change":"2023-10-06T11:14:19.533308+0000","last_active":"2023-10-06T11:14:19.533308+0000","last_peered":"2023-10-06T11:14:19.533308+0000","last_clean":"2023-10-06T11:14:19.533308+0000","last_became_active":"2023-10-06T11:14:19.532977+0000","last_became_peered":"2023-10-06T11:14:19.532977+0000","last_unstale":"2023-10-06T11:14:19.533308+0000","last_undegraded":"2023-10-06T11:14:19.533308+0000","last_fullsized":"2023-10-06T11:14:19.533308+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:26:00.807380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.540924+0000","last_change":"2023-10-06T11:14:18.520396+0000","last_active":"2023-10-06T11:14:19.540924+0000","last_peered":"2023-10-06T11:14:19.540924+0000","last_clean":"2023-10-06T11:14:19.540924+0000","last_became_active":"2023-10-06T11:14:18.520153+0000","last_became_peered":"2023-10-06T11:14:18.520153+0000","last_unstale":"2023-10-06T11:14:19.540924+0000","last_undegraded":"2023-10-06T11:14:19.540924+0000","last_fullsized":"2023-10-06T11:14:19.540924+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:05:56.563889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.532027+0000","last_change":"2023-10-06T11:14:19.523021+0000","last_active":"2023-10-06T11:14:19.532027+0000","last_peered":"2023-10-06T11:14:19.532027+0000","last_clean":"2023-10-06T11:14:19.532027+0000","last_became_active":"2023-10-06T11:14:19.522770+0000","last_became_peered":"2023-10-06T11:14:19.522770+0000","last_unstale":"2023-10-06T11:14:19.532027+0000","last_undegraded":"2023-10-06T11:14:19.532027+0000","last_fullsized":"2023-10-06T11:14:19.532027+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:34:38.614024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.539457+0000","last_change":"2023-10-06T11:14:18.515188+0000","last_active":"2023-10-06T11:14:19.539457+0000","last_peered":"2023-10-06T11:14:19.539457+0000","last_clean":"2023-10-06T11:14:19.539457+0000","last_became_active":"2023-10-06T11:14:18.514906+0000","last_became_peered":"2023-10-06T11:14:18.514906+0000","last_unstale":"2023-10-06T11:14:19.539457+0000","last_undegraded":"2023-10-06T11:14:19.539457+0000","last_fullsized":"2023-10-06T11:14:19.539457+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:01.545295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.528071+0000","last_change":"2023-10-06T11:14:19.524793+0000","last_active":"2023-10-06T11:14:19.528071+0000","last_peered":"2023-10-06T11:14:19.528071+0000","last_clean":"2023-10-06T11:14:19.528071+0000","last_became_active":"2023-10-06T11:14:19.524543+0000","last_became_peered":"2023-10-06T11:14:19.524543+0000","last_unstale":"2023-10-06T11:14:19.528071+0000","last_undegraded":"2023-10-06T11:14:19.528071+0000","last_fullsized":"2023-10-06T11:14:19.528071+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:50:18.583592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"112'1","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.518014+0000","last_change":"2023-10-06T11:14:18.519198+0000","last_active":"2023-10-06T11:14:19.518014+0000","last_peered":"2023-10-06T11:14:19.518014+0000","last_clean":"2023-10-06T11:14:19.518014+0000","last_became_active":"2023-10-06T11:14:18.518919+0000","last_became_peered":"2023-10-06T11:14:18.518919+0000","last_unstale":"2023-10-06T11:14:19.518014+0000","last_undegraded":"2023-10-06T11:14:19.518014+0000","last_fullsized":"2023-10-06T11:14:19.518014+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:03:28.990972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.529222+0000","last_change":"2023-10-06T11:14:19.522997+0000","last_active":"2023-10-06T11:14:19.529222+0000","last_peered":"2023-10-06T11:14:19.529222+0000","last_clean":"2023-10-06T11:14:19.529222+0000","last_became_active":"2023-10-06T11:14:19.522714+0000","last_became_peered":"2023-10-06T11:14:19.522714+0000","last_unstale":"2023-10-06T11:14:19.529222+0000","last_undegraded":"2023-10-06T11:14:19.529222+0000","last_fullsized":"2023-10-06T11:14:19.529222+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:04:44.278065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.512500+0000","last_change":"2023-10-06T11:14:18.510999+0000","last_active":"2023-10-06T11:14:19.512500+0000","last_peered":"2023-10-06T11:14:19.512500+0000","last_clean":"2023-10-06T11:14:19.512500+0000","last_became_active":"2023-10-06T11:14:18.510526+0000","last_became_peered":"2023-10-06T11:14:18.510526+0000","last_unstale":"2023-10-06T11:14:19.512500+0000","last_undegraded":"2023-10-06T11:14:19.512500+0000","last_fullsized":"2023-10-06T11:14:19.512500+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:48:15.451175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.532403+0000","last_change":"2023-10-06T11:14:19.528313+0000","last_active":"2023-10-06T11:14:19.532403+0000","last_peered":"2023-10-06T11:14:19.532403+0000","last_clean":"2023-10-06T11:14:19.532403+0000","last_became_active":"2023-10-06T11:14:19.528016+0000","last_became_peered":"2023-10-06T11:14:19.528016+0000","last_unstale":"2023-10-06T11:14:19.532403+0000","last_undegraded":"2023-10-06T11:14:19.532403+0000","last_fullsized":"2023-10-06T11:14:19.532403+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:59.263674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.517655+0000","last_change":"2023-10-06T11:14:18.514702+0000","last_active":"2023-10-06T11:14:18.517655+0000","last_peered":"2023-10-06T11:14:18.517655+0000","last_clean":"2023-10-06T11:14:18.517655+0000","last_became_active":"2023-10-06T11:14:18.514361+0000","last_became_peered":"2023-10-06T11:14:18.514361+0000","last_unstale":"2023-10-06T11:14:18.517655+0000","last_undegraded":"2023-10-06T11:14:18.517655+0000","last_fullsized":"2023-10-06T11:14:18.517655+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:21:01.150494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.530241+0000","last_change":"2023-10-06T11:14:19.524085+0000","last_active":"2023-10-06T11:14:19.530241+0000","last_peered":"2023-10-06T11:14:19.530241+0000","last_clean":"2023-10-06T11:14:19.530241+0000","last_became_active":"2023-10-06T11:14:19.523862+0000","last_became_peered":"2023-10-06T11:14:19.523862+0000","last_unstale":"2023-10-06T11:14:19.530241+0000","last_undegraded":"2023-10-06T11:14:19.530241+0000","last_fullsized":"2023-10-06T11:14:19.530241+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:08:52.437418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.539936+0000","last_change":"2023-10-06T11:14:18.516352+0000","last_active":"2023-10-06T11:14:19.539936+0000","last_peered":"2023-10-06T11:14:19.539936+0000","last_clean":"2023-10-06T11:14:19.539936+0000","last_became_active":"2023-10-06T11:14:18.515857+0000","last_became_peered":"2023-10-06T11:14:18.515857+0000","last_unstale":"2023-10-06T11:14:19.539936+0000","last_undegraded":"2023-10-06T11:14:19.539936+0000","last_fullsized":"2023-10-06T11:14:19.539936+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:37:28.317271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.525319+0000","last_change":"2023-10-06T11:14:19.517577+0000","last_active":"2023-10-06T11:14:19.525319+0000","last_peered":"2023-10-06T11:14:19.525319+0000","last_clean":"2023-10-06T11:14:19.525319+0000","last_became_active":"2023-10-06T11:14:19.517229+0000","last_became_peered":"2023-10-06T11:14:19.517229+0000","last_unstale":"2023-10-06T11:14:19.525319+0000","last_undegraded":"2023-10-06T11:14:19.525319+0000","last_fullsized":"2023-10-06T11:14:19.525319+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:59.014923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.545409+0000","last_change":"2023-10-06T11:14:18.514704+0000","last_active":"2023-10-06T11:14:19.545409+0000","last_peered":"2023-10-06T11:14:19.545409+0000","last_clean":"2023-10-06T11:14:19.545409+0000","last_became_active":"2023-10-06T11:14:18.514414+0000","last_became_peered":"2023-10-06T11:14:18.514414+0000","last_unstale":"2023-10-06T11:14:19.545409+0000","last_undegraded":"2023-10-06T11:14:19.545409+0000","last_fullsized":"2023-10-06T11:14:19.545409+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:20:21.032556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":8,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.527322+0000","last_change":"2023-10-06T11:14:19.527322+0000","last_active":"2023-10-06T11:14:19.527322+0000","last_peered":"2023-10-06T11:14:19.527322+0000","last_clean":"2023-10-06T11:14:19.527322+0000","last_became_active":"2023-10-06T11:14:19.527057+0000","last_became_peered":"2023-10-06T11:14:19.527057+0000","last_unstale":"2023-10-06T11:14:19.527322+0000","last_undegraded":"2023-10-06T11:14:19.527322+0000","last_fullsized":"2023-10-06T11:14:19.527322+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:59:05.726507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"112'1","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.521929+0000","last_change":"2023-10-06T11:14:18.517594+0000","last_active":"2023-10-06T11:14:19.521929+0000","last_peered":"2023-10-06T11:14:19.521929+0000","last_clean":"2023-10-06T11:14:19.521929+0000","last_became_active":"2023-10-06T11:14:18.517189+0000","last_became_peered":"2023-10-06T11:14:18.517189+0000","last_unstale":"2023-10-06T11:14:19.521929+0000","last_undegraded":"2023-10-06T11:14:19.521929+0000","last_fullsized":"2023-10-06T11:14:19.521929+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:42:25.286857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.530562+0000","last_change":"2023-10-06T11:14:19.527010+0000","last_active":"2023-10-06T11:14:19.530562+0000","last_peered":"2023-10-06T11:14:19.530562+0000","last_clean":"2023-10-06T11:14:19.530562+0000","last_became_active":"2023-10-06T11:14:19.526744+0000","last_became_peered":"2023-10-06T11:14:19.526744+0000","last_unstale":"2023-10-06T11:14:19.530562+0000","last_undegraded":"2023-10-06T11:14:19.530562+0000","last_fullsized":"2023-10-06T11:14:19.530562+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:20:35.278867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.519795+0000","last_change":"2023-10-06T11:14:18.519497+0000","last_active":"2023-10-06T11:14:18.519795+0000","last_peered":"2023-10-06T11:14:18.519795+0000","last_clean":"2023-10-06T11:14:18.519795+0000","last_became_active":"2023-10-06T11:14:18.519225+0000","last_became_peered":"2023-10-06T11:14:18.519225+0000","last_unstale":"2023-10-06T11:14:18.519795+0000","last_undegraded":"2023-10-06T11:14:18.519795+0000","last_fullsized":"2023-10-06T11:14:18.519795+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:34:37.609177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":8,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.527137+0000","last_change":"2023-10-06T11:14:19.527137+0000","last_active":"2023-10-06T11:14:19.527137+0000","last_peered":"2023-10-06T11:14:19.527137+0000","last_clean":"2023-10-06T11:14:19.527137+0000","last_became_active":"2023-10-06T11:14:19.526130+0000","last_became_peered":"2023-10-06T11:14:19.526130+0000","last_unstale":"2023-10-06T11:14:19.527137+0000","last_undegraded":"2023-10-06T11:14:19.527137+0000","last_fullsized":"2023-10-06T11:14:19.527137+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:23:56.709317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"112'2","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.542156+0000","last_change":"2023-10-06T11:14:18.516535+0000","last_active":"2023-10-06T11:14:19.542156+0000","last_peered":"2023-10-06T11:14:19.542156+0000","last_clean":"2023-10-06T11:14:19.542156+0000","last_became_active":"2023-10-06T11:14:18.516262+0000","last_became_peered":"2023-10-06T11:14:18.516262+0000","last_unstale":"2023-10-06T11:14:19.542156+0000","last_undegraded":"2023-10-06T11:14:19.542156+0000","last_fullsized":"2023-10-06T11:14:19.542156+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:40:30.069343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.529651+0000","last_change":"2023-10-06T11:14:19.520392+0000","last_active":"2023-10-06T11:14:19.529651+0000","last_peered":"2023-10-06T11:14:19.529651+0000","last_clean":"2023-10-06T11:14:19.529651+0000","last_became_active":"2023-10-06T11:14:19.519418+0000","last_became_peered":"2023-10-06T11:14:19.519418+0000","last_unstale":"2023-10-06T11:14:19.529651+0000","last_undegraded":"2023-10-06T11:14:19.529651+0000","last_fullsized":"2023-10-06T11:14:19.529651+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:00:03.457618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.517729+0000","last_change":"2023-10-06T11:14:18.514490+0000","last_active":"2023-10-06T11:14:18.517729+0000","last_peered":"2023-10-06T11:14:18.517729+0000","last_clean":"2023-10-06T11:14:18.517729+0000","last_became_active":"2023-10-06T11:14:18.514261+0000","last_became_peered":"2023-10-06T11:14:18.514261+0000","last_unstale":"2023-10-06T11:14:18.517729+0000","last_undegraded":"2023-10-06T11:14:18.517729+0000","last_fullsized":"2023-10-06T11:14:18.517729+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:45:36.667717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.535642+0000","last_change":"2023-10-06T11:14:19.532839+0000","last_active":"2023-10-06T11:14:19.535642+0000","last_peered":"2023-10-06T11:14:19.535642+0000","last_clean":"2023-10-06T11:14:19.535642+0000","last_became_active":"2023-10-06T11:14:19.529762+0000","last_became_peered":"2023-10-06T11:14:19.529762+0000","last_unstale":"2023-10-06T11:14:19.535642+0000","last_undegraded":"2023-10-06T11:14:19.535642+0000","last_fullsized":"2023-10-06T11:14:19.535642+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:15:01.598973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.511773+0000","last_change":"2023-10-06T11:14:18.517688+0000","last_active":"2023-10-06T11:14:19.511773+0000","last_peered":"2023-10-06T11:14:19.511773+0000","last_clean":"2023-10-06T11:14:19.511773+0000","last_became_active":"2023-10-06T11:14:18.517457+0000","last_became_peered":"2023-10-06T11:14:18.517457+0000","last_unstale":"2023-10-06T11:14:19.511773+0000","last_undegraded":"2023-10-06T11:14:19.511773+0000","last_fullsized":"2023-10-06T11:14:19.511773+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:58.258827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.530399+0000","last_change":"2023-10-06T11:14:19.524881+0000","last_active":"2023-10-06T11:14:19.530399+0000","last_peered":"2023-10-06T11:14:19.530399+0000","last_clean":"2023-10-06T11:14:19.530399+0000","last_became_active":"2023-10-06T11:14:19.524584+0000","last_became_peered":"2023-10-06T11:14:19.524584+0000","last_unstale":"2023-10-06T11:14:19.530399+0000","last_undegraded":"2023-10-06T11:14:19.530399+0000","last_fullsized":"2023-10-06T11:14:19.530399+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:49.548292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.518314+0000","last_change":"2023-10-06T11:14:18.516647+0000","last_active":"2023-10-06T11:14:18.518314+0000","last_peered":"2023-10-06T11:14:18.518314+0000","last_clean":"2023-10-06T11:14:18.518314+0000","last_became_active":"2023-10-06T11:14:18.516262+0000","last_became_peered":"2023-10-06T11:14:18.516262+0000","last_unstale":"2023-10-06T11:14:18.518314+0000","last_undegraded":"2023-10-06T11:14:18.518314+0000","last_fullsized":"2023-10-06T11:14:18.518314+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:59:08.959547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":8,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.529163+0000","last_change":"2023-10-06T11:14:19.529163+0000","last_active":"2023-10-06T11:14:19.529163+0000","last_peered":"2023-10-06T11:14:19.529163+0000","last_clean":"2023-10-06T11:14:19.529163+0000","last_became_active":"2023-10-06T11:14:19.528510+0000","last_became_peered":"2023-10-06T11:14:19.528510+0000","last_unstale":"2023-10-06T11:14:19.529163+0000","last_undegraded":"2023-10-06T11:14:19.529163+0000","last_fullsized":"2023-10-06T11:14:19.529163+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:19:39.292478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"112'2","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.542167+0000","last_change":"2023-10-06T11:14:18.512348+0000","last_active":"2023-10-06T11:14:19.542167+0000","last_peered":"2023-10-06T11:14:19.542167+0000","last_clean":"2023-10-06T11:14:19.542167+0000","last_became_active":"2023-10-06T11:14:18.512069+0000","last_became_peered":"2023-10-06T11:14:18.512069+0000","last_unstale":"2023-10-06T11:14:19.542167+0000","last_undegraded":"2023-10-06T11:14:19.542167+0000","last_fullsized":"2023-10-06T11:14:19.542167+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:06:04.223773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.532281+0000","last_change":"2023-10-06T11:14:19.526978+0000","last_active":"2023-10-06T11:14:19.532281+0000","last_peered":"2023-10-06T11:14:19.532281+0000","last_clean":"2023-10-06T11:14:19.532281+0000","last_became_active":"2023-10-06T11:14:19.526719+0000","last_became_peered":"2023-10-06T11:14:19.526719+0000","last_unstale":"2023-10-06T11:14:19.532281+0000","last_undegraded":"2023-10-06T11:14:19.532281+0000","last_fullsized":"2023-10-06T11:14:19.532281+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:45:37.672564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.519593+0000","last_change":"2023-10-06T11:14:18.514476+0000","last_active":"2023-10-06T11:14:19.519593+0000","last_peered":"2023-10-06T11:14:19.519593+0000","last_clean":"2023-10-06T11:14:19.519593+0000","last_became_active":"2023-10-06T11:14:18.514192+0000","last_became_peered":"2023-10-06T11:14:18.514192+0000","last_unstale":"2023-10-06T11:14:19.519593+0000","last_undegraded":"2023-10-06T11:14:19.519593+0000","last_fullsized":"2023-10-06T11:14:19.519593+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:08:57.830671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":8,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.529153+0000","last_change":"2023-10-06T11:14:19.529153+0000","last_active":"2023-10-06T11:14:19.529153+0000","last_peered":"2023-10-06T11:14:19.529153+0000","last_clean":"2023-10-06T11:14:19.529153+0000","last_became_active":"2023-10-06T11:14:19.528897+0000","last_became_peered":"2023-10-06T11:14:19.528897+0000","last_unstale":"2023-10-06T11:14:19.529153+0000","last_undegraded":"2023-10-06T11:14:19.529153+0000","last_fullsized":"2023-10-06T11:14:19.529153+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:53:37.936318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.518605+0000","last_change":"2023-10-06T11:14:18.511882+0000","last_active":"2023-10-06T11:14:19.518605+0000","last_peered":"2023-10-06T11:14:19.518605+0000","last_clean":"2023-10-06T11:14:19.518605+0000","last_became_active":"2023-10-06T11:14:18.511611+0000","last_became_peered":"2023-10-06T11:14:18.511611+0000","last_unstale":"2023-10-06T11:14:19.518605+0000","last_undegraded":"2023-10-06T11:14:19.518605+0000","last_fullsized":"2023-10-06T11:14:19.518605+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:19:25.411147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.533711+0000","last_change":"2023-10-06T11:14:19.531539+0000","last_active":"2023-10-06T11:14:19.533711+0000","last_peered":"2023-10-06T11:14:19.533711+0000","last_clean":"2023-10-06T11:14:19.533711+0000","last_became_active":"2023-10-06T11:14:19.531287+0000","last_became_peered":"2023-10-06T11:14:19.531287+0000","last_unstale":"2023-10-06T11:14:19.533711+0000","last_undegraded":"2023-10-06T11:14:19.533711+0000","last_fullsized":"2023-10-06T11:14:19.533711+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:55:42.292257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.518894+0000","last_change":"2023-10-06T11:14:18.516195+0000","last_active":"2023-10-06T11:14:18.518894+0000","last_peered":"2023-10-06T11:14:18.518894+0000","last_clean":"2023-10-06T11:14:18.518894+0000","last_became_active":"2023-10-06T11:14:18.515950+0000","last_became_peered":"2023-10-06T11:14:18.515950+0000","last_unstale":"2023-10-06T11:14:18.518894+0000","last_undegraded":"2023-10-06T11:14:18.518894+0000","last_fullsized":"2023-10-06T11:14:18.518894+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:21:36.863223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":8,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.525879+0000","last_change":"2023-10-06T11:14:19.525879+0000","last_active":"2023-10-06T11:14:19.525879+0000","last_peered":"2023-10-06T11:14:19.525879+0000","last_clean":"2023-10-06T11:14:19.525879+0000","last_became_active":"2023-10-06T11:14:19.525607+0000","last_became_peered":"2023-10-06T11:14:19.525607+0000","last_unstale":"2023-10-06T11:14:19.525879+0000","last_undegraded":"2023-10-06T11:14:19.525879+0000","last_fullsized":"2023-10-06T11:14:19.525879+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:22:03.212957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.513717+0000","last_change":"2023-10-06T11:14:18.512746+0000","last_active":"2023-10-06T11:14:19.513717+0000","last_peered":"2023-10-06T11:14:19.513717+0000","last_clean":"2023-10-06T11:14:19.513717+0000","last_became_active":"2023-10-06T11:14:18.512031+0000","last_became_peered":"2023-10-06T11:14:18.512031+0000","last_unstale":"2023-10-06T11:14:19.513717+0000","last_undegraded":"2023-10-06T11:14:19.513717+0000","last_fullsized":"2023-10-06T11:14:19.513717+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:47:07.809091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.532613+0000","last_change":"2023-10-06T11:14:19.528146+0000","last_active":"2023-10-06T11:14:19.532613+0000","last_peered":"2023-10-06T11:14:19.532613+0000","last_clean":"2023-10-06T11:14:19.532613+0000","last_became_active":"2023-10-06T11:14:19.527779+0000","last_became_peered":"2023-10-06T11:14:19.527779+0000","last_unstale":"2023-10-06T11:14:19.532613+0000","last_undegraded":"2023-10-06T11:14:19.532613+0000","last_fullsized":"2023-10-06T11:14:19.532613+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:28:18.675296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.514483+0000","last_change":"2023-10-06T11:14:18.506358+0000","last_active":"2023-10-06T11:14:19.514483+0000","last_peered":"2023-10-06T11:14:19.514483+0000","last_clean":"2023-10-06T11:14:19.514483+0000","last_became_active":"2023-10-06T11:14:18.505791+0000","last_became_peered":"2023-10-06T11:14:18.505791+0000","last_unstale":"2023-10-06T11:14:19.514483+0000","last_undegraded":"2023-10-06T11:14:19.514483+0000","last_fullsized":"2023-10-06T11:14:19.514483+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:58:34.482343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":8,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.528687+0000","last_change":"2023-10-06T11:14:19.528687+0000","last_active":"2023-10-06T11:14:19.528687+0000","last_peered":"2023-10-06T11:14:19.528687+0000","last_clean":"2023-10-06T11:14:19.528687+0000","last_became_active":"2023-10-06T11:14:19.528395+0000","last_became_peered":"2023-10-06T11:14:19.528395+0000","last_unstale":"2023-10-06T11:14:19.528687+0000","last_undegraded":"2023-10-06T11:14:19.528687+0000","last_fullsized":"2023-10-06T11:14:19.528687+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:22:59.014923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.517743+0000","last_change":"2023-10-06T11:14:18.516015+0000","last_active":"2023-10-06T11:14:18.517743+0000","last_peered":"2023-10-06T11:14:18.517743+0000","last_clean":"2023-10-06T11:14:18.517743+0000","last_became_active":"2023-10-06T11:14:18.515755+0000","last_became_peered":"2023-10-06T11:14:18.515755+0000","last_unstale":"2023-10-06T11:14:18.517743+0000","last_undegraded":"2023-10-06T11:14:18.517743+0000","last_fullsized":"2023-10-06T11:14:18.517743+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:25:06.077268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.532380+0000","last_change":"2023-10-06T11:14:19.526637+0000","last_active":"2023-10-06T11:14:19.532380+0000","last_peered":"2023-10-06T11:14:19.532380+0000","last_clean":"2023-10-06T11:14:19.532380+0000","last_became_active":"2023-10-06T11:14:19.526285+0000","last_became_peered":"2023-10-06T11:14:19.526285+0000","last_unstale":"2023-10-06T11:14:19.532380+0000","last_undegraded":"2023-10-06T11:14:19.532380+0000","last_fullsized":"2023-10-06T11:14:19.532380+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:20:35.278867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.518332+0000","last_change":"2023-10-06T11:14:18.516817+0000","last_active":"2023-10-06T11:14:18.518332+0000","last_peered":"2023-10-06T11:14:18.518332+0000","last_clean":"2023-10-06T11:14:18.518332+0000","last_became_active":"2023-10-06T11:14:18.516554+0000","last_became_peered":"2023-10-06T11:14:18.516554+0000","last_unstale":"2023-10-06T11:14:18.518332+0000","last_undegraded":"2023-10-06T11:14:18.518332+0000","last_fullsized":"2023-10-06T11:14:18.518332+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:20:34.274020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.537677+0000","last_change":"2023-10-06T11:14:19.532326+0000","last_active":"2023-10-06T11:14:19.537677+0000","last_peered":"2023-10-06T11:14:19.537677+0000","last_clean":"2023-10-06T11:14:19.537677+0000","last_became_active":"2023-10-06T11:14:19.528604+0000","last_became_peered":"2023-10-06T11:14:19.528604+0000","last_unstale":"2023-10-06T11:14:19.537677+0000","last_undegraded":"2023-10-06T11:14:19.537677+0000","last_fullsized":"2023-10-06T11:14:19.537677+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:50:18.583592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"112'3","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.541466+0000","last_change":"2023-10-06T11:14:18.514344+0000","last_active":"2023-10-06T11:14:19.541466+0000","last_peered":"2023-10-06T11:14:19.541466+0000","last_clean":"2023-10-06T11:14:19.541466+0000","last_became_active":"2023-10-06T11:14:18.513998+0000","last_became_peered":"2023-10-06T11:14:18.513998+0000","last_unstale":"2023-10-06T11:14:19.541466+0000","last_undegraded":"2023-10-06T11:14:19.541466+0000","last_fullsized":"2023-10-06T11:14:19.541466+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:08:57.830671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":100,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.512528+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:14:19.512528+0000","last_peered":"2023-10-06T11:14:19.512528+0000","last_clean":"2023-10-06T11:14:19.512528+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:14:19.512528+0000","last_undegraded":"2023-10-06T11:14:19.512528+0000","last_fullsized":"2023-10-06T11:14:19.512528+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.529795+0000","last_change":"2023-10-06T11:14:19.520394+0000","last_active":"2023-10-06T11:14:19.529795+0000","last_peered":"2023-10-06T11:14:19.529795+0000","last_clean":"2023-10-06T11:14:19.529795+0000","last_became_active":"2023-10-06T11:14:19.519621+0000","last_became_peered":"2023-10-06T11:14:19.519621+0000","last_unstale":"2023-10-06T11:14:19.529795+0000","last_undegraded":"2023-10-06T11:14:19.529795+0000","last_fullsized":"2023-10-06T11:14:19.529795+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:47:08.813938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"112'6","reported_seq":16,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.545315+0000","last_change":"2023-10-06T11:14:18.504949+0000","last_active":"2023-10-06T11:14:19.545315+0000","last_peered":"2023-10-06T11:14:19.545315+0000","last_clean":"2023-10-06T11:14:19.545315+0000","last_became_active":"2023-10-06T11:14:18.504692+0000","last_became_peered":"2023-10-06T11:14:18.504692+0000","last_unstale":"2023-10-06T11:14:19.545315+0000","last_undegraded":"2023-10-06T11:14:19.545315+0000","last_fullsized":"2023-10-06T11:14:19.545315+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:24:52.038818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":91,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.511360+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:14:19.511360+0000","last_peered":"2023-10-06T11:14:19.511360+0000","last_clean":"2023-10-06T11:14:19.511360+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:14:19.511360+0000","last_undegraded":"2023-10-06T11:14:19.511360+0000","last_fullsized":"2023-10-06T11:14:19.511360+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.526315+0000","last_change":"2023-10-06T11:14:19.525058+0000","last_active":"2023-10-06T11:14:19.526315+0000","last_peered":"2023-10-06T11:14:19.526315+0000","last_clean":"2023-10-06T11:14:19.526315+0000","last_became_active":"2023-10-06T11:14:19.524770+0000","last_became_peered":"2023-10-06T11:14:19.524770+0000","last_unstale":"2023-10-06T11:14:19.526315+0000","last_undegraded":"2023-10-06T11:14:19.526315+0000","last_fullsized":"2023-10-06T11:14:19.526315+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:45:37.672564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.543943+0000","last_change":"2023-10-06T11:14:18.514474+0000","last_active":"2023-10-06T11:14:19.543943+0000","last_peered":"2023-10-06T11:14:19.543943+0000","last_clean":"2023-10-06T11:14:19.543943+0000","last_became_active":"2023-10-06T11:14:18.514228+0000","last_became_peered":"2023-10-06T11:14:18.514228+0000","last_unstale":"2023-10-06T11:14:19.543943+0000","last_undegraded":"2023-10-06T11:14:19.543943+0000","last_fullsized":"2023-10-06T11:14:19.543943+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:34:37.609177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":89,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.518928+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:14:19.518928+0000","last_peered":"2023-10-06T11:14:19.518928+0000","last_clean":"2023-10-06T11:14:19.518928+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:14:19.518928+0000","last_undegraded":"2023-10-06T11:14:19.518928+0000","last_fullsized":"2023-10-06T11:14:19.518928+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":233,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.510965+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:14:18.510965+0000","last_peered":"2023-10-06T11:14:18.510965+0000","last_clean":"2023-10-06T11:14:18.510965+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:14:18.510965+0000","last_undegraded":"2023-10-06T11:14:18.510965+0000","last_fullsized":"2023-10-06T11:14:18.510965+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.532069+0000","last_change":"2023-10-06T11:14:19.524592+0000","last_active":"2023-10-06T11:14:19.532069+0000","last_peered":"2023-10-06T11:14:19.532069+0000","last_clean":"2023-10-06T11:14:19.532069+0000","last_became_active":"2023-10-06T11:14:19.524335+0000","last_became_peered":"2023-10-06T11:14:19.524335+0000","last_unstale":"2023-10-06T11:14:19.532069+0000","last_undegraded":"2023-10-06T11:14:19.532069+0000","last_fullsized":"2023-10-06T11:14:19.532069+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:21:12.436828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.511622+0000","last_change":"2023-10-06T11:14:18.515686+0000","last_active":"2023-10-06T11:14:19.511622+0000","last_peered":"2023-10-06T11:14:19.511622+0000","last_clean":"2023-10-06T11:14:19.511622+0000","last_became_active":"2023-10-06T11:14:18.515482+0000","last_became_peered":"2023-10-06T11:14:18.515482+0000","last_unstale":"2023-10-06T11:14:19.511622+0000","last_undegraded":"2023-10-06T11:14:19.511622+0000","last_fullsized":"2023-10-06T11:14:19.511622+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:20:34.274020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":83,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.510224+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:14:18.510224+0000","last_peered":"2023-10-06T11:14:18.510224+0000","last_clean":"2023-10-06T11:14:18.510224+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:14:18.510224+0000","last_undegraded":"2023-10-06T11:14:18.510224+0000","last_fullsized":"2023-10-06T11:14:18.510224+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":8,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.533731+0000","last_change":"2023-10-06T11:14:19.533731+0000","last_active":"2023-10-06T11:14:19.533731+0000","last_peered":"2023-10-06T11:14:19.533731+0000","last_clean":"2023-10-06T11:14:19.533731+0000","last_became_active":"2023-10-06T11:14:19.533083+0000","last_became_peered":"2023-10-06T11:14:19.533083+0000","last_unstale":"2023-10-06T11:14:19.533731+0000","last_undegraded":"2023-10-06T11:14:19.533731+0000","last_fullsized":"2023-10-06T11:14:19.533731+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:29:42.487946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"112'8","reported_seq":18,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.544115+0000","last_change":"2023-10-06T11:14:18.515017+0000","last_active":"2023-10-06T11:14:19.544115+0000","last_peered":"2023-10-06T11:14:19.544115+0000","last_clean":"2023-10-06T11:14:19.544115+0000","last_became_active":"2023-10-06T11:14:18.514748+0000","last_became_peered":"2023-10-06T11:14:18.514748+0000","last_unstale":"2023-10-06T11:14:19.544115+0000","last_undegraded":"2023-10-06T11:14:19.544115+0000","last_fullsized":"2023-10-06T11:14:19.544115+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:48.543445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":83,"reported_epoch":111,"state":"active+clean","last_fresh":"2023-10-06T11:14:18.511062+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:14:18.511062+0000","last_peered":"2023-10-06T11:14:18.511062+0000","last_clean":"2023-10-06T11:14:18.511062+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:14:18.511062+0000","last_undegraded":"2023-10-06T11:14:18.511062+0000","last_fullsized":"2023-10-06T11:14:18.511062+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.533626+0000","last_change":"2023-10-06T11:14:19.528090+0000","last_active":"2023-10-06T11:14:19.533626+0000","last_peered":"2023-10-06T11:14:19.533626+0000","last_clean":"2023-10-06T11:14:19.533626+0000","last_became_active":"2023-10-06T11:14:19.527835+0000","last_became_peered":"2023-10-06T11:14:19.527835+0000","last_unstale":"2023-10-06T11:14:19.533626+0000","last_undegraded":"2023-10-06T11:14:19.533626+0000","last_fullsized":"2023-10-06T11:14:19.533626+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:43:08.535899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.511383+0000","last_change":"2023-10-06T11:14:18.512989+0000","last_active":"2023-10-06T11:14:19.511383+0000","last_peered":"2023-10-06T11:14:19.511383+0000","last_clean":"2023-10-06T11:14:19.511383+0000","last_became_active":"2023-10-06T11:14:18.512689+0000","last_became_peered":"2023-10-06T11:14:18.512689+0000","last_unstale":"2023-10-06T11:14:19.511383+0000","last_undegraded":"2023-10-06T11:14:19.511383+0000","last_fullsized":"2023-10-06T11:14:19.511383+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:47:07.809091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":103,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.512583+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:14:19.512583+0000","last_peered":"2023-10-06T11:14:19.512583+0000","last_clean":"2023-10-06T11:14:19.512583+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:14:19.512583+0000","last_undegraded":"2023-10-06T11:14:19.512583+0000","last_fullsized":"2023-10-06T11:14:19.512583+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.532184+0000","last_change":"2023-10-06T11:14:19.528209+0000","last_active":"2023-10-06T11:14:19.532184+0000","last_peered":"2023-10-06T11:14:19.532184+0000","last_clean":"2023-10-06T11:14:19.532184+0000","last_became_active":"2023-10-06T11:14:19.527990+0000","last_became_peered":"2023-10-06T11:14:19.527990+0000","last_unstale":"2023-10-06T11:14:19.532184+0000","last_undegraded":"2023-10-06T11:14:19.532184+0000","last_fullsized":"2023-10-06T11:14:19.532184+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:26:10.256818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.513801+0000","last_change":"2023-10-06T11:14:18.512620+0000","last_active":"2023-10-06T11:14:19.513801+0000","last_peered":"2023-10-06T11:14:19.513801+0000","last_clean":"2023-10-06T11:14:19.513801+0000","last_became_active":"2023-10-06T11:14:18.512352+0000","last_became_peered":"2023-10-06T11:14:18.512352+0000","last_unstale":"2023-10-06T11:14:19.513801+0000","last_undegraded":"2023-10-06T11:14:19.513801+0000","last_fullsized":"2023-10-06T11:14:19.513801+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:53.640644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":90,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.519678+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:14:19.519678+0000","last_peered":"2023-10-06T11:14:19.519678+0000","last_clean":"2023-10-06T11:14:19.519678+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:14:19.519678+0000","last_undegraded":"2023-10-06T11:14:19.519678+0000","last_fullsized":"2023-10-06T11:14:19.519678+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.526212+0000","last_change":"2023-10-06T11:14:19.524154+0000","last_active":"2023-10-06T11:14:19.526212+0000","last_peered":"2023-10-06T11:14:19.526212+0000","last_clean":"2023-10-06T11:14:19.526212+0000","last_became_active":"2023-10-06T11:14:19.523918+0000","last_became_peered":"2023-10-06T11:14:19.523918+0000","last_unstale":"2023-10-06T11:14:19.526212+0000","last_undegraded":"2023-10-06T11:14:19.526212+0000","last_fullsized":"2023-10-06T11:14:19.526212+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:18.495871+0000","last_clean_scrub_stamp":"2023-10-06T11:14:18.495871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:59:20.354495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.519794+0000","last_change":"2023-10-06T11:14:18.516440+0000","last_active":"2023-10-06T11:14:19.519794+0000","last_peered":"2023-10-06T11:14:19.519794+0000","last_clean":"2023-10-06T11:14:19.519794+0000","last_became_active":"2023-10-06T11:14:18.516161+0000","last_became_peered":"2023-10-06T11:14:18.516161+0000","last_unstale":"2023-10-06T11:14:19.519794+0000","last_undegraded":"2023-10-06T11:14:19.519794+0000","last_fullsized":"2023-10-06T11:14:19.519794+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:14:17.491024+0000","last_clean_scrub_stamp":"2023-10-06T11:14:17.491024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:03:53.640644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":90,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-06T11:14:19.519871+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:14:19.519871+0000","last_peered":"2023-10-06T11:14:19.519871+0000","last_clean":"2023-10-06T11:14:19.519871+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:14:19.519871+0000","last_undegraded":"2023-10-06T11:14:19.519871+0000","last_fullsized":"2023-10-06T11:14:19.519871+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574956,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315628,"kb_used_data":1956,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94056212,"statfs":{"total":96636764160,"available":96313561088,"internally_reserved":0,"allocated":2002944,"data_stored":1227060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.64800000000000002,"15min":0.624},"min":{"1min":0.27600000000000002,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":4.407,"5min":15.506,"15min":23.908999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.57199999999999995,"15min":0.57799999999999996},"min":{"1min":0.35199999999999998,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.60199999999999998,"5min":9.3230000000000004,"15min":9.3230000000000004},"last":0.32700000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.51100000000000001,"15min":0.56200000000000006},"min":{"1min":0.28399999999999997,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":2.4689999999999999,"5min":2.4689999999999999,"15min":9.2360000000000007},"last":0.373},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47199999999999998,"15min":0.505},"min":{"1min":0.36099999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.67700000000000005,"5min":0.78900000000000003,"15min":4.327},"last":0.41699999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.53500000000000003,"15min":0.51700000000000002},"min":{"1min":0.374,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":4.3120000000000003,"5min":4.3120000000000003,"15min":4.3120000000000003},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.54300000000000004,"15min":0.56000000000000005},"min":{"1min":0.32000000000000001,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":3.0600000000000001,"5min":3.0600000000000001,"15min":4.7309999999999999},"last":0.439}]},{"osd":3,"last update":"Fri Oct 6 11:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.56499999999999995,"15min":0.53800000000000003},"min":{"1min":0.34000000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":4.5190000000000001,"5min":4.5190000000000001,"15min":4.5190000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.55900000000000005,"15min":0.59799999999999998},"min":{"1min":0.374,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":3.0070000000000001,"5min":3.0070000000000001,"15min":9.3879999999999999},"last":0.51600000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.502,"15min":0.48899999999999999},"min":{"1min":0.29799999999999999,"5min":0.25,"15min":0.24399999999999999},"max":{"1min":4.6639999999999997,"5min":4.6639999999999997,"15min":4.6639999999999997},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.52900000000000003,"15min":0.53700000000000003},"min":{"1min":0.315,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":4.3689999999999998,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":0.69199999999999995}]},{"osd":5,"last update":"Fri Oct 6 11:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.495,"15min":0.56200000000000006},"min":{"1min":0.34100000000000003,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.745,"5min":0.84699999999999998,"15min":9.3499999999999996},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.502,"15min":0.54800000000000004},"min":{"1min":0.33300000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.77200000000000002,"5min":0.83399999999999996,"15min":4.444},"last":0.46200000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.53700000000000003,"15min":0.60199999999999998},"min":{"1min":0.40799999999999997,"5min":0.32400000000000001,"15min":0.29199999999999998},"max":{"1min":0.81299999999999994,"5min":0.81399999999999995,"15min":9.4969999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.60599999999999998,"15min":0.622},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":4.4669999999999996,"5min":4.4669999999999996,"15min":7.2039999999999997},"last":0.66200000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574958,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310948,"kb_used_data":1372,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060892,"statfs":{"total":96636764160,"available":96318353408,"internally_reserved":0,"allocated":1404928,"data_stored":641786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.48099999999999998,"15min":0.48899999999999999},"min":{"1min":0.247,"5min":0.187,"15min":0.187},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.53100000000000003,"15min":0.53000000000000003},"min":{"1min":0.41999999999999998,"5min":0.254,"15min":0.254},"max":{"1min":0.71199999999999997,"5min":0.78600000000000003,"15min":0.79000000000000004},"last":0.47799999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.45100000000000001,"5min":0.47099999999999997,"15min":0.48699999999999999},"min":{"1min":0.30399999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.64800000000000002,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.495},{"interface":"front","average":{"1min":0.498,"5min":0.54400000000000004,"15min":0.51200000000000001},"min":{"1min":0.34000000000000002,"5min":0.216,"15min":0.216},"max":{"1min":0.80500000000000005,"5min":5.2670000000000003,"15min":5.2670000000000003},"last":0.51700000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47999999999999998,"15min":0.498},"min":{"1min":0.29099999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.72799999999999998,"5min":0.83999999999999997,"15min":7.0659999999999998},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.48499999999999999,"15min":0.52000000000000002},"min":{"1min":0.32200000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.78600000000000003,"5min":1.0069999999999999,"15min":7.0819999999999999},"last":0.53000000000000003}]},{"osd":3,"last update":"Fri Oct 6 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51800000000000002,"15min":0.502},"min":{"1min":0.32600000000000001,"5min":0.317,"15min":0.25800000000000001},"max":{"1min":0.753,"5min":0.83499999999999996,"15min":0.85699999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52900000000000003,"15min":0.53200000000000003},"min":{"1min":0.39900000000000002,"5min":0.316,"15min":0.312},"max":{"1min":0.70899999999999996,"5min":0.77000000000000002,"15min":0.83999999999999997},"last":0.46400000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.45400000000000001,"15min":0.48599999999999999},"min":{"1min":0.30099999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.76000000000000001,"5min":0.88,"15min":0.88},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.50900000000000001,"15min":0.54400000000000004},"min":{"1min":0.34499999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":1.0680000000000001},"last":0.39700000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.497,"15min":0.52200000000000002},"min":{"1min":0.32000000000000001,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.53600000000000003,"15min":0.56599999999999995},"min":{"1min":0.36599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.80300000000000005,"5min":1.034,"15min":1.034},"last":0.56000000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:13:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.56100000000000005,"15min":0.56899999999999995},"min":{"1min":0.42899999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.82799999999999996,"5min":0.84899999999999998,"15min":0.98899999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56399999999999995,"15min":0.58999999999999997},"min":{"1min":0.36399999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.88400000000000001},"last":0.50600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574957,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307424,"kb_used_data":1944,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064416,"statfs":{"total":96636764160,"available":96321961984,"internally_reserved":0,"allocated":1990656,"data_stored":1226334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:13:55 2023","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":0.46100000000000002,"15min":0.38},"min":{"1min":0.216,"5min":0.186,"15min":0.186},"max":{"1min":13.393000000000001,"5min":13.393000000000001,"15min":13.393000000000001},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.46400000000000002,"15min":0.38300000000000001},"min":{"1min":0.24299999999999999,"5min":0.215,"15min":0.19700000000000001},"max":{"1min":11.462,"5min":11.462,"15min":11.462},"last":0.29499999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.41299999999999998,"15min":0.36099999999999999},"min":{"1min":0.222,"5min":0.216,"15min":0.216},"max":{"1min":8.0470000000000006,"5min":8.0470000000000006,"15min":8.0470000000000006},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.441,"15min":0.40400000000000003},"min":{"1min":0.26300000000000001,"5min":0.22800000000000001,"15min":0.20999999999999999},"max":{"1min":4.8630000000000004,"5min":4.8630000000000004,"15min":4.8630000000000004},"last":0.36199999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.45200000000000001,"15min":0.42399999999999999},"min":{"1min":0.25700000000000001,"5min":0.252,"15min":0.252},"max":{"1min":4.8029999999999999,"5min":4.8029999999999999,"15min":4.8029999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.437,"15min":0.39100000000000001},"min":{"1min":0.23400000000000001,"5min":0.217,"15min":0.217},"max":{"1min":5.8700000000000001,"5min":5.8700000000000001,"15min":5.8700000000000001},"last":0.374}]},{"osd":4,"last update":"Fri Oct 6 11:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.53000000000000003,"15min":0.51400000000000001},"min":{"1min":0.376,"5min":0.29499999999999998,"15min":0.28199999999999997},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.61699999999999999,"15min":0.56499999999999995},"min":{"1min":0.39900000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":4.7699999999999996,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.45700000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.60399999999999998,"15min":0.56699999999999995},"min":{"1min":0.42199999999999999,"5min":0.34000000000000002,"15min":0.33500000000000002},"max":{"1min":3.4390000000000001,"5min":3.4390000000000001,"15min":3.4390000000000001},"last":0.496},{"interface":"front","average":{"1min":1.1479999999999999,"5min":0.67300000000000004,"15min":0.58299999999999996},"min":{"1min":0.41299999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":9.3829999999999991,"5min":9.3829999999999991,"15min":9.3829999999999991},"last":0.42799999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.627,"15min":0.58399999999999996},"min":{"1min":0.46600000000000003,"5min":0.34999999999999998,"15min":0.315},"max":{"1min":3.4750000000000001,"5min":3.4750000000000001,"15min":3.4750000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.625,"15min":0.58899999999999997},"min":{"1min":0.379,"5min":0.376,"15min":0.36699999999999999},"max":{"1min":3.9180000000000001,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.48899999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:13:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.65400000000000003,"15min":0.60999999999999999},"min":{"1min":0.436,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":4.7290000000000001,"5min":4.7290000000000001,"15min":4.7290000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.61799999999999999,"15min":0.59299999999999997},"min":{"1min":0.38900000000000001,"5min":0.378,"15min":0.374},"max":{"1min":2.4500000000000002,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.54400000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574956,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298648,"kb_used_data":1360,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073192,"statfs":{"total":96636764160,"available":96330948608,"internally_reserved":0,"allocated":1392640,"data_stored":634613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.30599999999999999,"5min":0.74099999999999999,"15min":0.46800000000000003},"min":{"1min":0.23699999999999999,"5min":0.184,"15min":0.184},"max":{"1min":0.45000000000000001,"5min":36.097999999999999,"15min":36.097999999999999},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.45200000000000001,"15min":0.378},"min":{"1min":0.23400000000000001,"5min":0.182,"15min":0.182},"max":{"1min":0.439,"5min":7.2990000000000004,"15min":7.2990000000000004},"last":0.30499999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.33900000000000002,"5min":0.77300000000000002,"15min":0.50800000000000001},"min":{"1min":0.251,"5min":0.217,"15min":0.217},"max":{"1min":0.48499999999999999,"5min":36.07,"15min":36.07},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.48299999999999998,"15min":0.40400000000000003},"min":{"1min":0.27800000000000002,"5min":0.23200000000000001,"15min":0.219},"max":{"1min":0.55500000000000005,"5min":6.7800000000000002,"15min":6.7800000000000002},"last":0.33700000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.44500000000000001,"15min":0.39700000000000002},"min":{"1min":0.26700000000000002,"5min":0.223,"15min":0.223},"max":{"1min":0.502,"5min":8.4130000000000003,"15min":8.4130000000000003},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.80800000000000005,"15min":0.56000000000000005},"min":{"1min":0.29699999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.48099999999999998,"5min":35.959000000000003,"15min":35.959000000000003},"last":0.35199999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56599999999999995,"15min":0.56200000000000006},"min":{"1min":0.33800000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.78200000000000003,"5min":2.427,"15min":2.427},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.97899999999999998,"15min":0.73499999999999999},"min":{"1min":0.374,"5min":0.34399999999999997,"15min":0.29299999999999998},"max":{"1min":0.75700000000000001,"5min":36.005000000000003,"15min":36.005000000000003},"last":0.71299999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.63600000000000001,"15min":0.57799999999999996},"min":{"1min":0.40100000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.752,"5min":6.6699999999999999,"15min":6.6699999999999999},"last":0.626},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.56100000000000005,"15min":0.55100000000000005},"min":{"1min":0.39500000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.71799999999999997,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.70199999999999996}]},{"osd":6,"last update":"Fri Oct 6 11:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.98399999999999999,"15min":0.73399999999999999},"min":{"1min":0.41199999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.77400000000000002,"5min":36.037999999999997,"15min":36.037999999999997},"last":0.749},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.69899999999999995,"15min":0.63500000000000001},"min":{"1min":0.40999999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79800000000000004,"5min":6.7110000000000003,"15min":6.7110000000000003},"last":0.59599999999999997}]},{"osd":7,"last update":"Fri Oct 6 11:13:56 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.66200000000000003,"15min":0.623},"min":{"1min":0.45100000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.81999999999999995,"5min":6.742,"15min":6.742},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58999999999999997,"15min":0.56799999999999995},"min":{"1min":0.44,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71199999999999997,"5min":1.917,"15min":1.917},"last":0.61799999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574957,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":310944,"kb_used_data":1368,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060896,"statfs":{"total":96636764160,"available":96318357504,"internally_reserved":0,"allocated":1400832,"data_stored":641232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.28499999999999998,"5min":0.309,"15min":0.309},"min":{"1min":0.214,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.39300000000000002,"5min":0.56699999999999995,"15min":0.57499999999999996},"last":0.318},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.38100000000000001,"15min":0.38300000000000001},"min":{"1min":0.25,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.46400000000000002,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.38}]},{"osd":1,"last update":"Fri Oct 6 11:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.377,"15min":0.374},"min":{"1min":0.23599999999999999,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.57499999999999996,"5min":0.745,"15min":0.745},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.35199999999999998,"15min":0.35099999999999998},"min":{"1min":0.253,"5min":0.216,"15min":0.216},"max":{"1min":0.51600000000000001,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.26700000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.36199999999999999,"15min":0.36899999999999999},"min":{"1min":0.23699999999999999,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.495,"5min":0.628,"15min":0.629},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.376,"5min":0.36299999999999999,"15min":0.36499999999999999},"min":{"1min":0.254,"5min":0.251,"15min":0.251},"max":{"1min":0.46600000000000003,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.33100000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51700000000000002,"15min":0.52900000000000003},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30299999999999999},"max":{"1min":0.61599999999999999,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53600000000000003,"15min":0.55100000000000005},"min":{"1min":0.28199999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.72499999999999998,"5min":0.80400000000000005,"15min":0.84899999999999998},"last":0.45300000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53400000000000003,"15min":0.54500000000000004},"min":{"1min":0.35799999999999998,"5min":0.33100000000000002,"15min":0.32400000000000001},"max":{"1min":0.68799999999999994,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.498},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56399999999999995,"15min":0.55600000000000005},"min":{"1min":0.41299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.73499999999999999,"5min":0.878,"15min":0.878},"last":0.52400000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58099999999999996,"15min":0.58299999999999996},"min":{"1min":0.38200000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.79500000000000004,"5min":0.85199999999999998,"15min":0.86299999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.56699999999999995,"15min":0.57499999999999996},"min":{"1min":0.41299999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.68000000000000005,"5min":0.878,"15min":0.88600000000000001},"last":0.57199999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.56899999999999995,"15min":0.55800000000000005},"min":{"1min":0.39500000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.63400000000000001,"5min":1.139,"15min":1.139},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.44,"5min":0.38800000000000001,"15min":0.38200000000000001},"max":{"1min":0.72899999999999998,"5min":0.89600000000000002,"15min":0.90500000000000003},"last":0.56100000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574957,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302768,"kb_used_data":1384,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069072,"statfs":{"total":96636764160,"available":96326729728,"internally_reserved":0,"allocated":1417216,"data_stored":642802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.314,"15min":0.32100000000000001},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":1.095},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.35099999999999998,"15min":0.38400000000000001},"min":{"1min":0.27800000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.495,"5min":0.53900000000000003,"15min":1.7210000000000001},"last":0.39400000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.30099999999999999,"5min":0.309,"15min":0.31},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.46100000000000002,"5min":0.48199999999999998,"15min":0.65400000000000003},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.33800000000000002,"15min":0.35999999999999999},"min":{"1min":0.254,"5min":0.188,"15min":0.188},"max":{"1min":0.49099999999999999,"5min":0.53400000000000003,"15min":1.196},"last":0.40899999999999997}]},{"osd":2,"last update":"Fri Oct 6 11:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.35299999999999998,"15min":0.378},"min":{"1min":0.26400000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.48999999999999999,"5min":0.73499999999999999,"15min":1.7729999999999999},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.39500000000000002,"15min":0.41299999999999998},"min":{"1min":0.32200000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.52600000000000002,"5min":0.58599999999999997,"15min":1.224},"last":0.47499999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51800000000000002,"15min":0.55300000000000005},"min":{"1min":0.371,"5min":0.311,"15min":0.311},"max":{"1min":0.68100000000000005,"5min":0.77600000000000002,"15min":1.694},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53200000000000003,"15min":0.53900000000000003},"min":{"1min":0.379,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.80700000000000005,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.82399999999999995}]},{"osd":5,"last update":"Fri Oct 6 11:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54400000000000004,"15min":0.53000000000000003},"min":{"1min":0.40000000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.70299999999999996,"5min":0.86199999999999999,"15min":0.878},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.54900000000000004,"15min":0.55900000000000005},"min":{"1min":0.47299999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.72999999999999998,"5min":0.75800000000000001,"15min":1.165},"last":0.746}]},{"osd":6,"last update":"Fri Oct 6 11:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56200000000000006,"15min":0.58199999999999996},"min":{"1min":0.443,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.77900000000000003,"5min":0.85099999999999998,"15min":1.1359999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56899999999999995,"15min":0.59099999999999997},"min":{"1min":0.41999999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":1.7470000000000001},"last":0.79700000000000004}]},{"osd":7,"last update":"Fri Oct 6 11:13:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.56000000000000005,"15min":0.58199999999999996},"min":{"1min":0.39100000000000001,"5min":0.35699999999999998,"15min":0.35599999999999998},"max":{"1min":0.79000000000000004,"5min":0.85399999999999998,"15min":1.657},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57199999999999995,"15min":0.57299999999999995},"min":{"1min":0.45700000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80500000000000005,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.75900000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574956,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302768,"kb_used_data":1384,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069072,"statfs":{"total":96636764160,"available":96326729728,"internally_reserved":0,"allocated":1417216,"data_stored":644121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:13:51 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45800000000000002,"15min":0.54500000000000004},"min":{"1min":0.29999999999999999,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.64000000000000001,"5min":0.77100000000000002,"15min":2.6619999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.498,"15min":0.496},"min":{"1min":0.30199999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.77400000000000002,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.35999999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:13:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47399999999999998,"15min":0.56799999999999995},"min":{"1min":0.29599999999999999,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.66900000000000004,"5min":0.752,"15min":2.8650000000000002},"last":0.44},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.48699999999999999,"15min":0.57299999999999995},"min":{"1min":0.28599999999999998,"5min":0.26200000000000001,"15min":0.25800000000000001},"max":{"1min":0.71099999999999997,"5min":0.85899999999999999,"15min":2.7610000000000001},"last":0.53200000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:13:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.502,"15min":0.54900000000000004},"min":{"1min":0.35199999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.73199999999999998,"5min":0.78200000000000003,"15min":1.6910000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55700000000000005,"15min":0.59299999999999997},"min":{"1min":0.33100000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.74299999999999999,"5min":0.93899999999999995,"15min":1.718},"last":0.54900000000000004}]},{"osd":3,"last update":"Fri Oct 6 11:13:51 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52800000000000002,"15min":0.59999999999999998},"min":{"1min":0.32000000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.76700000000000002,"5min":0.83099999999999996,"15min":2.677},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.52200000000000002,"15min":0.52100000000000002},"min":{"1min":0.34100000000000003,"5min":0.30399999999999999,"15min":0.27500000000000002},"max":{"1min":0.72599999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.505}]},{"osd":5,"last update":"Fri Oct 6 11:13:51 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48199999999999998,"15min":0.48799999999999999},"min":{"1min":0.28499999999999998,"5min":0.23499999999999999,"15min":0.23200000000000001},"max":{"1min":0.72799999999999998,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.51900000000000002,"15min":0.53300000000000003},"min":{"1min":0.28899999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.73799999999999999,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.58899999999999997}]},{"osd":6,"last update":"Fri Oct 6 11:13:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51900000000000002,"15min":0.52500000000000002},"min":{"1min":0.37,"5min":0.30499999999999999,"15min":0.252},"max":{"1min":0.76300000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54500000000000004,"15min":0.57199999999999995},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.29799999999999999},"max":{"1min":0.79300000000000004,"5min":0.85799999999999998,"15min":1.165},"last":0.57099999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:13:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57099999999999995,"15min":0.56100000000000005},"min":{"1min":0.34200000000000003,"5min":0.313,"15min":0.313},"max":{"1min":0.82399999999999995,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58099999999999996,"15min":0.59999999999999998},"min":{"1min":0.34100000000000003,"5min":0.317,"15min":0.317},"max":{"1min":0.80800000000000005,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.57899999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574958,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306860,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064980,"statfs":{"total":96636764160,"available":96322539520,"internally_reserved":0,"allocated":1413120,"data_stored":642745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.46700000000000003,"15min":0.629},"min":{"1min":0.23300000000000001,"5min":0.23100000000000001,"15min":0.20499999999999999},"max":{"1min":0.65600000000000003,"5min":0.72599999999999998,"15min":5.0490000000000004},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.42499999999999999,"5min":0.46000000000000002,"15min":0.60399999999999998},"min":{"1min":0.26400000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.61899999999999999,"5min":0.78100000000000003,"15min":5.1449999999999996},"last":0.33500000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.47199999999999998,"15min":0.48499999999999999},"min":{"1min":0.25700000000000001,"5min":0.25,"15min":0.25},"max":{"1min":0.64200000000000002,"5min":0.81399999999999995,"15min":0.97199999999999998},"last":0.434},{"interface":"front","average":{"1min":0.44,"5min":0.48499999999999999,"15min":0.51400000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.66000000000000003,"5min":0.70999999999999996,"15min":1.8799999999999999},"last":0.46100000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.52200000000000002,"15min":0.55400000000000005},"min":{"1min":0.313,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.72499999999999998,"5min":0.79800000000000004,"15min":4.234},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.53600000000000003,"15min":0.56200000000000006},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.66800000000000004,"5min":0.81000000000000005,"15min":1.0369999999999999},"last":0.48599999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.49299999999999999,"15min":0.64700000000000002},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.27700000000000002},"max":{"1min":0.64000000000000001,"5min":0.82299999999999995,"15min":5.2169999999999996},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.52100000000000002,"15min":0.54300000000000004},"min":{"1min":0.29999999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.622,"5min":0.82699999999999996,"15min":1.008},"last":0.54400000000000004}]},{"osd":4,"last update":"Fri Oct 6 11:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.48399999999999999,"15min":0.51800000000000002},"min":{"1min":0.30599999999999999,"5min":0.27400000000000002,"15min":0.23999999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":1.917},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.48699999999999999,"15min":0.52900000000000003},"min":{"1min":0.311,"5min":0.24399999999999999,"15min":0.23899999999999999},"max":{"1min":0.69199999999999995,"5min":0.71899999999999997,"15min":0.87},"last":0.44600000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.50600000000000001,"15min":0.55700000000000005},"min":{"1min":0.33300000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.69599999999999995,"5min":0.77100000000000002,"15min":2.0139999999999998},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.56299999999999994,"15min":0.60799999999999998},"min":{"1min":0.42299999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.79400000000000004,"5min":0.82899999999999996,"15min":1.9470000000000001},"last":0.56999999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:13:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53600000000000003,"15min":0.58099999999999996},"min":{"1min":0.36399999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.96499999999999997},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56499999999999995,"15min":0.60699999999999998},"min":{"1min":0.40100000000000002,"5min":0.316,"15min":0.28799999999999998},"max":{"1min":0.77300000000000002,"5min":0.79900000000000004,"15min":1.4119999999999999},"last":0.628}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:14:23.971 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T11:14:23.971 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T11:14:24.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.125+0000 7fdb38ea7700 1 Processor -- start 2023-10-06T11:14:24.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.125+0000 7fdb38ea7700 1 -- start start 2023-10-06T11:14:24.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.126+0000 7fdb38ea7700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb34159770 0x7fdb340aaf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:24.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.126+0000 7fdb38ea7700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fdb34068b90 0x7fdb340c7000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:24.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.126+0000 7fdb38ea7700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb340aaa90 con 0x7fdb340ab460 2023-10-06T11:14:24.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.126+0000 7fdb38ea7700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb3406f010 con 0x7fdb34068b90 2023-10-06T11:14:24.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.126+0000 7fdb38ea7700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb340a9e80 con 0x7fdb34159770 2023-10-06T11:14:24.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.127+0000 7fdb32d9d700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fdb34068b90 0x7fdb340c7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:24.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.127+0000 7fdb3259c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb34159770 0x7fdb340aaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:24.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.127+0000 7fdb29d9b700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fdb340ab460 0x7fdb34068480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:59112/0 (socket says 172.21.15.146:59112) 2023-10-06T11:14:24.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.127+0000 7fdb29d9b700 1 -- 172.21.15.146:0/2887287902 learned_addr learned my addr 172.21.15.146:0/2887287902 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:14:24.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.127+0000 7fdb32d9d700 1 -- 172.21.15.146:0/2887287902 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb34159770 msgr2=0x7fdb340aaf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:24.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.127+0000 7fdb32d9d700 1 --2- 172.21.15.146:0/2887287902 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb34159770 0x7fdb340aaf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.127+0000 7fdb32d9d700 1 -- 172.21.15.146:0/2887287902 >> v1:172.21.15.151:6789/0 conn(0x7fdb340ab460 legacy=0x7fdb34068480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:24.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.127+0000 7fdb32d9d700 1 -- 172.21.15.146:0/2887287902 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb340aa160 con 0x7fdb34068b90 2023-10-06T11:14:24.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.127+0000 7fdb31d9b700 1 -- 172.21.15.146:0/2887287902 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 633990817 0 0) 0x7fdb340aaa90 con 0x7fdb340ab460 2023-10-06T11:14:24.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.127+0000 7fdb32d9d700 1 --2- 172.21.15.146:0/2887287902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb34068b90 0x7fdb340c7000 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c009e60 tx=0x7fdb2c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=617448bdacd7ab7c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:24.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.127+0000 7fdb31d9b700 1 -- 172.21.15.146:0/2887287902 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c00e070 con 0x7fdb34068b90 2023-10-06T11:14:24.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.127+0000 7fdb31d9b700 1 -- 172.21.15.146:0/2887287902 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2c00bb60 con 0x7fdb34068b90 2023-10-06T11:14:24.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.127+0000 7fdb31d9b700 1 -- 172.21.15.146:0/2887287902 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c012430 con 0x7fdb34068b90 2023-10-06T11:14:24.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.128+0000 7fdb38ea7700 1 -- 172.21.15.146:0/2887287902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb34068b90 msgr2=0x7fdb340c7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:24.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.128+0000 7fdb38ea7700 1 --2- 172.21.15.146:0/2887287902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb34068b90 0x7fdb340c7000 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c009e60 tx=0x7fdb2c009780 comp rx=0 tx=0).stop 2023-10-06T11:14:24.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.128+0000 7fdb38ea7700 1 -- 172.21.15.146:0/2887287902 shutdown_connections 2023-10-06T11:14:24.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.128+0000 7fdb38ea7700 1 --2- 172.21.15.146:0/2887287902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb34068b90 0x7fdb340c7000 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.128+0000 7fdb38ea7700 1 --2- 172.21.15.146:0/2887287902 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb34159770 0x7fdb340aaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.128+0000 7fdb38ea7700 1 -- 172.21.15.146:0/2887287902 >> 172.21.15.146:0/2887287902 conn(0x7fdb340c9fa0 msgr2=0x7fdb3406dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:24.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.128+0000 7fdb38ea7700 1 -- 172.21.15.146:0/2887287902 shutdown_connections 2023-10-06T11:14:24.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.128+0000 7fdb38ea7700 1 -- 172.21.15.146:0/2887287902 wait complete. 2023-10-06T11:14:24.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.129+0000 7fdb38ea7700 1 Processor -- start 2023-10-06T11:14:24.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.129+0000 7fdb38ea7700 1 -- start start 2023-10-06T11:14:24.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.130+0000 7fdb38ea7700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb34068b90 0x7fdb34155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:24.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.130+0000 7fdb38ea7700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb340ab460 0x7fdb34154e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:24.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.130+0000 7fdb38ea7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb34159770 0x7fdb340b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:24.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.130+0000 7fdb38ea7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb340afd60 con 0x7fdb34159770 2023-10-06T11:14:24.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.130+0000 7fdb38ea7700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb341553d0 con 0x7fdb340ab460 2023-10-06T11:14:24.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.130+0000 7fdb38ea7700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb340b21e0 con 0x7fdb34068b90 2023-10-06T11:14:24.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.130+0000 7fdb32d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb34159770 0x7fdb340b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:24.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.130+0000 7fdb32d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb34159770 0x7fdb340b01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53676/0 (socket says 172.21.15.146:53676) 2023-10-06T11:14:24.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.130+0000 7fdb32d9d700 1 -- 172.21.15.146:0/1210786221 learned_addr learned my addr 172.21.15.146:0/1210786221 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:24.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.130+0000 7fdb29d9b700 1 --2- 172.21.15.146:0/1210786221 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb340ab460 0x7fdb34154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:24.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.130+0000 7fdb3259c700 1 --2- 172.21.15.146:0/1210786221 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb34068b90 0x7fdb34155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:24.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.130+0000 7fdb32d9d700 1 -- 172.21.15.146:0/1210786221 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb34068b90 msgr2=0x7fdb34155610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:24.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.130+0000 7fdb32d9d700 1 --2- 172.21.15.146:0/1210786221 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb34068b90 0x7fdb34155610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.130+0000 7fdb32d9d700 1 -- 172.21.15.146:0/1210786221 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb340ab460 msgr2=0x7fdb34154e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:24.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.130+0000 7fdb32d9d700 1 --2- 172.21.15.146:0/1210786221 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb340ab460 0x7fdb34154e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.130+0000 7fdb32d9d700 1 -- 172.21.15.146:0/1210786221 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb2c009a20 con 0x7fdb34159770 2023-10-06T11:14:24.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.130+0000 7fdb32d9d700 1 --2- 172.21.15.146:0/1210786221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb34159770 0x7fdb340b01f0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c013000 tx=0x7fdb2c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:24.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.131+0000 7fdb2affd700 1 -- 172.21.15.146:0/1210786221 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c012ea0 con 0x7fdb34159770 2023-10-06T11:14:24.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.131+0000 7fdb2affd700 1 -- 172.21.15.146:0/1210786221 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb2c027470 con 0x7fdb34159770 2023-10-06T11:14:24.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.131+0000 7fdb38ea7700 1 -- 172.21.15.146:0/1210786221 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb340b24c0 con 0x7fdb34159770 2023-10-06T11:14:24.135 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.131+0000 7fdb2affd700 1 -- 172.21.15.146:0/1210786221 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb2c027830 con 0x7fdb34159770 2023-10-06T11:14:24.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.131+0000 7fdb38ea7700 1 -- 172.21.15.146:0/1210786221 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb340af9f0 con 0x7fdb34159770 2023-10-06T11:14:24.136 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.132+0000 7fdb38ea7700 1 -- 172.21.15.146:0/1210786221 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb340aff10 con 0x7fdb34159770 2023-10-06T11:14:24.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.132+0000 7fdb2affd700 1 -- 172.21.15.146:0/1210786221 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdb2c024070 con 0x7fdb34159770 2023-10-06T11:14:24.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.132+0000 7fdb2affd700 1 --2- 172.21.15.146:0/1210786221 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdb14066f30 0x7fdb140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:24.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.132+0000 7fdb2affd700 1 -- 172.21.15.146:0/1210786221 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdb2c086e30 con 0x7fdb34159770 2023-10-06T11:14:24.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.133+0000 7fdb3259c700 1 --2- 172.21.15.146:0/1210786221 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdb14066f30 0x7fdb140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:24.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.133+0000 7fdb3259c700 1 --2- 172.21.15.146:0/1210786221 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdb14066f30 0x7fdb140693e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fdb24009d10 tx=0x7fdb240091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:24.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.137+0000 7fdb2affd700 1 -- 172.21.15.146:0/1210786221 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdb340aff10 con 0x7fdb34159770 2023-10-06T11:14:24.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.398+0000 7fdb38ea7700 1 -- 172.21.15.146:0/1210786221 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fdb3404c380 con 0x7fdb34159770 2023-10-06T11:14:24.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.402+0000 7fdb2affd700 1 -- 172.21.15.146:0/1210786221 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+0 (secure 0 0 0) 0x7fdb2c0579d0 con 0x7fdb34159770 2023-10-06T11:14:24.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.404+0000 7fdb38ea7700 1 -- 172.21.15.146:0/1210786221 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdb14066f30 msgr2=0x7fdb140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:24.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.404+0000 7fdb38ea7700 1 --2- 172.21.15.146:0/1210786221 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdb14066f30 0x7fdb140693e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fdb24009d10 tx=0x7fdb240091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.404+0000 7fdb38ea7700 1 -- 172.21.15.146:0/1210786221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb34159770 msgr2=0x7fdb340b01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:24.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.404+0000 7fdb38ea7700 1 --2- 172.21.15.146:0/1210786221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb34159770 0x7fdb340b01f0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fdb2c013000 tx=0x7fdb2c019000 comp rx=0 tx=0).stop 2023-10-06T11:14:24.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.404+0000 7fdb38ea7700 1 -- 172.21.15.146:0/1210786221 shutdown_connections 2023-10-06T11:14:24.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.404+0000 7fdb38ea7700 1 --2- 172.21.15.146:0/1210786221 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdb14066f30 0x7fdb140693e0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.404+0000 7fdb38ea7700 1 --2- 172.21.15.146:0/1210786221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb34159770 0x7fdb340b01f0 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.404+0000 7fdb38ea7700 1 --2- 172.21.15.146:0/1210786221 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb34068b90 0x7fdb34155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.404+0000 7fdb38ea7700 1 --2- 172.21.15.146:0/1210786221 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb340ab460 0x7fdb34154e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.404+0000 7fdb38ea7700 1 -- 172.21.15.146:0/1210786221 >> 172.21.15.146:0/1210786221 conn(0x7fdb340c9fa0 msgr2=0x7fdb340c8120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:24.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.404+0000 7fdb38ea7700 1 -- 172.21.15.146:0/1210786221 shutdown_connections 2023-10-06T11:14:24.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.404+0000 7fdb38ea7700 1 -- 172.21.15.146:0/1210786221 wait complete. 2023-10-06T11:14:24.407 INFO:teuthology.orchestra.run.smithi146.stderr:updated caps for client.0 2023-10-06T11:14:24.418 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:14:24.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.531+0000 7f053c214700 1 Processor -- start 2023-10-06T11:14:24.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.531+0000 7f053c214700 1 -- start start 2023-10-06T11:14:24.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.532+0000 7f053c214700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0534068ba0 0x7f053415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:24.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.532+0000 7f053c214700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0534153e80 0x7f05340b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:24.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.532+0000 7f053c214700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f053415ac30 con 0x7f0534153ab0 2023-10-06T11:14:24.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.532+0000 7f053c214700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05340b4510 con 0x7f0534068ba0 2023-10-06T11:14:24.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.532+0000 7f053c214700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05340b6530 con 0x7f0534153e80 2023-10-06T11:14:24.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.532+0000 7f05397af700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0534068ba0 0x7f053415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:24.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.532+0000 7f05397af700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0534068ba0 0x7f053415a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53678/0 (socket says 172.21.15.146:53678) 2023-10-06T11:14:24.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.532+0000 7f05397af700 1 -- 172.21.15.146:0/1633445272 learned_addr learned my addr 172.21.15.146:0/1633445272 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:24.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.533+0000 7f053a7b1700 1 --2- 172.21.15.146:0/1633445272 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0534153e80 0x7f05340b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:24.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.533+0000 7f05397af700 1 -- 172.21.15.146:0/1633445272 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0534153e80 msgr2=0x7f05340b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:24.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.533+0000 7f05397af700 1 --2- 172.21.15.146:0/1633445272 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0534153e80 0x7f05340b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.533+0000 7f05397af700 1 -- 172.21.15.146:0/1633445272 >> v1:172.21.15.151:6789/0 conn(0x7f0534153ab0 legacy=0x7f0534068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:24.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.533+0000 7f05397af700 1 -- 172.21.15.146:0/1633445272 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05340b5c50 con 0x7f0534068ba0 2023-10-06T11:14:24.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.533+0000 7f05397af700 1 --2- 172.21.15.146:0/1633445272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0534068ba0 0x7f053415a6f0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f05240099b0 tx=0x7f0524009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8341477458a8fb7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:24.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.533+0000 7f0538fae700 1 -- 172.21.15.146:0/1633445272 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052400b820 con 0x7f0534068ba0 2023-10-06T11:14:24.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.533+0000 7f0538fae700 1 -- 172.21.15.146:0/1633445272 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052400b980 con 0x7f0534068ba0 2023-10-06T11:14:24.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.533+0000 7f0538fae700 1 -- 172.21.15.146:0/1633445272 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052400bd20 con 0x7f0534068ba0 2023-10-06T11:14:24.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.533+0000 7f053c214700 1 -- 172.21.15.146:0/1633445272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0534068ba0 msgr2=0x7f053415a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:24.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.533+0000 7f053c214700 1 --2- 172.21.15.146:0/1633445272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0534068ba0 0x7f053415a6f0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f05240099b0 tx=0x7f0524009250 comp rx=0 tx=0).stop 2023-10-06T11:14:24.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.533+0000 7f053c214700 1 -- 172.21.15.146:0/1633445272 shutdown_connections 2023-10-06T11:14:24.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.533+0000 7f053c214700 1 --2- 172.21.15.146:0/1633445272 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0534153e80 0x7f05340b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.533+0000 7f053c214700 1 --2- 172.21.15.146:0/1633445272 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0534068ba0 0x7f053415a6f0 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.533+0000 7f053c214700 1 -- 172.21.15.146:0/1633445272 >> 172.21.15.146:0/1633445272 conn(0x7f053406eba0 msgr2=0x7f053406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:24.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.534+0000 7f053c214700 1 -- 172.21.15.146:0/1633445272 shutdown_connections 2023-10-06T11:14:24.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.534+0000 7f053c214700 1 -- 172.21.15.146:0/1633445272 wait complete. 2023-10-06T11:14:24.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.535+0000 7f053c214700 1 Processor -- start 2023-10-06T11:14:24.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.535+0000 7f053c214700 1 -- start start 2023-10-06T11:14:24.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.535+0000 7f053c214700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0534068ba0 0x7f053414a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:24.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.535+0000 7f053c214700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0534153ab0 0x7f053414da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:24.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.535+0000 7f053c214700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0534153e80 0x7f053414ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:24.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.535+0000 7f053c214700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053414aad0 con 0x7f0534153ab0 2023-10-06T11:14:24.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.535+0000 7f053c214700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053414bc00 con 0x7f0534153e80 2023-10-06T11:14:24.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.535+0000 7f053c214700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f053414bee0 con 0x7f0534068ba0 2023-10-06T11:14:24.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.535+0000 7f05397af700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0534153ab0 0x7f053414da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:24.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.535+0000 7f05397af700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0534153ab0 0x7f053414da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53682/0 (socket says 172.21.15.146:53682) 2023-10-06T11:14:24.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.535+0000 7f05397af700 1 -- 172.21.15.146:0/605393617 learned_addr learned my addr 172.21.15.146:0/605393617 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:24.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.536+0000 7f053a7b1700 1 --2- 172.21.15.146:0/605393617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0534153e80 0x7f053414ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:24.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.536+0000 7f0539fb0700 1 --2- 172.21.15.146:0/605393617 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0534068ba0 0x7f053414a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:24.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.536+0000 7f05397af700 1 -- 172.21.15.146:0/605393617 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0534068ba0 msgr2=0x7f053414a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:24.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.536+0000 7f05397af700 1 --2- 172.21.15.146:0/605393617 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0534068ba0 0x7f053414a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.536+0000 7f05397af700 1 -- 172.21.15.146:0/605393617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0534153e80 msgr2=0x7f053414ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:24.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.536+0000 7f05397af700 1 --2- 172.21.15.146:0/605393617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0534153e80 0x7f053414ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.536+0000 7f05397af700 1 -- 172.21.15.146:0/605393617 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05240094f0 con 0x7f0534153ab0 2023-10-06T11:14:24.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.536+0000 7f05397af700 1 --2- 172.21.15.146:0/605393617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0534153ab0 0x7f053414da30 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f0524009290 tx=0x7f0524016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:24.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.536+0000 7f0529ffb700 1 -- 172.21.15.146:0/605393617 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0524011c10 con 0x7f0534153ab0 2023-10-06T11:14:24.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.536+0000 7f0529ffb700 1 -- 172.21.15.146:0/605393617 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0524020070 con 0x7f0534153ab0 2023-10-06T11:14:24.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.536+0000 7f053c214700 1 -- 172.21.15.146:0/605393617 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f053414c1c0 con 0x7f0534153ab0 2023-10-06T11:14:24.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.536+0000 7f0529ffb700 1 -- 172.21.15.146:0/605393617 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052401b450 con 0x7f0534153ab0 2023-10-06T11:14:24.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.536+0000 7f053c214700 1 -- 172.21.15.146:0/605393617 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05340b1650 con 0x7f0534153ab0 2023-10-06T11:14:24.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.537+0000 7f053c214700 1 -- 172.21.15.146:0/605393617 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05340b1840 con 0x7f0534153ab0 2023-10-06T11:14:24.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.538+0000 7f0529ffb700 1 -- 172.21.15.146:0/605393617 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0524022030 con 0x7f0534153ab0 2023-10-06T11:14:24.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.538+0000 7f0529ffb700 1 --2- 172.21.15.146:0/605393617 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0518066f30 0x7f05180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:24.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.538+0000 7f0529ffb700 1 -- 172.21.15.146:0/605393617 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0524086280 con 0x7f0534153ab0 2023-10-06T11:14:24.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.538+0000 7f0539fb0700 1 --2- 172.21.15.146:0/605393617 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0518066f30 0x7f05180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:24.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.539+0000 7f0539fb0700 1 --2- 172.21.15.146:0/605393617 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0518066f30 0x7f05180693e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0530003a30 tx=0x7f0530007ea0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:24.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.542+0000 7f0529ffb700 1 -- 172.21.15.146:0/605393617 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0524053390 con 0x7f0534153ab0 2023-10-06T11:14:24.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.770+0000 7f053c214700 1 -- 172.21.15.146:0/605393617 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f053415ac30 con 0x7f0534153ab0 2023-10-06T11:14:24.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.771+0000 7f0529ffb700 1 -- 172.21.15.146:0/605393617 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) v1 ==== 95+0+4610 (secure 0 0 0) 0x7f053415ac30 con 0x7f0534153ab0 2023-10-06T11:14:24.773 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:24.773 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":100,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6560,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/2109567995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2109567995},{"type":"v1","addr":"172.21.15.151:6834","nonce":2109567995}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":6563,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1783565134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":1783565134},{"type":"v1","addr":"172.21.15.151:6835","nonce":1783565134}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7327,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/1323749517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1323749517},{"type":"v1","addr":"172.21.15.146:6836","nonce":1323749517}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:14:18.891938+0000","modified":"2023-10-06T11:14:22.531674+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8103":{"gid":8103,"name":"c","rank":0,"incarnation":97,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/409226151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":409226151},{"type":"v1","addr":"172.21.15.146:6837","nonce":409226151}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-06T11:14:24.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.773+0000 7f053c214700 1 -- 172.21.15.146:0/605393617 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0518066f30 msgr2=0x7f05180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:24.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.773+0000 7f053c214700 1 --2- 172.21.15.146:0/605393617 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0518066f30 0x7f05180693e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f0530003a30 tx=0x7f0530007ea0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.773+0000 7f053c214700 1 -- 172.21.15.146:0/605393617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0534153ab0 msgr2=0x7f053414da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:24.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.773+0000 7f053c214700 1 --2- 172.21.15.146:0/605393617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0534153ab0 0x7f053414da30 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f0524009290 tx=0x7f0524016000 comp rx=0 tx=0).stop 2023-10-06T11:14:24.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.773+0000 7f053c214700 1 -- 172.21.15.146:0/605393617 shutdown_connections 2023-10-06T11:14:24.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.773+0000 7f053c214700 1 --2- 172.21.15.146:0/605393617 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0518066f30 0x7f05180693e0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.773+0000 7f053c214700 1 --2- 172.21.15.146:0/605393617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0534153e80 0x7f053414ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.773+0000 7f053c214700 1 --2- 172.21.15.146:0/605393617 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0534068ba0 0x7f053414a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.773+0000 7f053c214700 1 --2- 172.21.15.146:0/605393617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0534153ab0 0x7f053414da30 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:24.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.773+0000 7f053c214700 1 -- 172.21.15.146:0/605393617 >> 172.21.15.146:0/605393617 conn(0x7f053406eba0 msgr2=0x7f0534151d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:24.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.773+0000 7f053c214700 1 -- 172.21.15.146:0/605393617 shutdown_connections 2023-10-06T11:14:24.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:24.773+0000 7f053c214700 1 -- 172.21.15.146:0/605393617 wait complete. 2023-10-06T11:14:24.776 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 100 2023-10-06T11:14:25.189 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 100, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T11:14:18.891938+0000', 'modified': '2023-10-06T11:14:22.531674+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8103}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8103': {'gid': 8103, 'name': 'c', 'rank': 0, 'incarnation': 97, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.146:6837/409226151', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6835', 'nonce': 409226151}, {'type': 'v1', 'addr': '172.21.15.146:6837', 'nonce': 409226151}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T11:14:25.189 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T11:14:25.189 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T11:14:25.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.305+0000 7fb4751a8700 1 Processor -- start 2023-10-06T11:14:25.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.305+0000 7fb4751a8700 1 -- start start 2023-10-06T11:14:25.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.306+0000 7fb4751a8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb47015a160 0x7fb4700c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:25.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.306+0000 7fb4751a8700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb4700ae730 0x7fb4700aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:25.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.306+0000 7fb4751a8700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4700ae2a0 con 0x7fb4700ce3d0 2023-10-06T11:14:25.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.306+0000 7fb4751a8700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb47015a530 con 0x7fb47015a160 2023-10-06T11:14:25.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.306+0000 7fb4751a8700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4700af0f0 con 0x7fb4700ae730 2023-10-06T11:14:25.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.306+0000 7fb46ed9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb47015a160 0x7fb4700c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:25.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.306+0000 7fb46ed9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb47015a160 0x7fb4700c55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53694/0 (socket says 172.21.15.146:53694) 2023-10-06T11:14:25.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.306+0000 7fb46ed9d700 1 -- 172.21.15.146:0/48637584 learned_addr learned my addr 172.21.15.146:0/48637584 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:25.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.306+0000 7fb46f59e700 1 --1- 172.21.15.146:0/48637584 >> v1:172.21.15.146:6789/0 conn(0x7fb4700ce3d0 0x7fb4700ce7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:37126/0 (socket says 172.21.15.146:37126) 2023-10-06T11:14:25.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.307+0000 7fb46659c700 1 --2- 172.21.15.146:0/48637584 >> v2:172.21.15.151:3300/0 conn(0x7fb4700ae730 0x7fb4700aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:25.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.307+0000 7fb46ed9d700 1 -- 172.21.15.146:0/48637584 >> v2:172.21.15.151:3300/0 conn(0x7fb4700ae730 msgr2=0x7fb4700aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:25.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.307+0000 7fb46ed9d700 1 --2- 172.21.15.146:0/48637584 >> v2:172.21.15.151:3300/0 conn(0x7fb4700ae730 0x7fb4700aebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.307+0000 7fb46ed9d700 1 -- 172.21.15.146:0/48637584 >> v1:172.21.15.146:6789/0 conn(0x7fb4700ce3d0 legacy=0x7fb4700ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:25.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.307+0000 7fb46ed9d700 1 -- 172.21.15.146:0/48637584 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4700ad690 con 0x7fb47015a160 2023-10-06T11:14:25.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.307+0000 7fb46ed9d700 1 --2- 172.21.15.146:0/48637584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb47015a160 0x7fb4700c55a0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fb4700d16e0 tx=0x7fb460009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed7e1dc32fb3291c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:25.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.307+0000 7fb46e59c700 1 -- 172.21.15.146:0/48637584 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb460005c10 con 0x7fb47015a160 2023-10-06T11:14:25.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.307+0000 7fb46e59c700 1 -- 172.21.15.146:0/48637584 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb460005d70 con 0x7fb47015a160 2023-10-06T11:14:25.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.307+0000 7fb46e59c700 1 -- 172.21.15.146:0/48637584 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46000b880 con 0x7fb47015a160 2023-10-06T11:14:25.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.307+0000 7fb4751a8700 1 -- 172.21.15.146:0/48637584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb47015a160 msgr2=0x7fb4700c55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:25.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.307+0000 7fb4751a8700 1 --2- 172.21.15.146:0/48637584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb47015a160 0x7fb4700c55a0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fb4700d16e0 tx=0x7fb460009220 comp rx=0 tx=0).stop 2023-10-06T11:14:25.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.307+0000 7fb4751a8700 1 -- 172.21.15.146:0/48637584 shutdown_connections 2023-10-06T11:14:25.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.307+0000 7fb4751a8700 1 --2- 172.21.15.146:0/48637584 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb47015a160 0x7fb4700c55a0 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.307+0000 7fb4751a8700 1 --2- 172.21.15.146:0/48637584 >> v2:172.21.15.151:3300/0 conn(0x7fb4700ae730 0x7fb4700aebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.307+0000 7fb4751a8700 1 -- 172.21.15.146:0/48637584 >> 172.21.15.146:0/48637584 conn(0x7fb47006f380 msgr2=0x7fb4700d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:25.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.307+0000 7fb4751a8700 1 -- 172.21.15.146:0/48637584 shutdown_connections 2023-10-06T11:14:25.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.307+0000 7fb4751a8700 1 -- 172.21.15.146:0/48637584 wait complete. 2023-10-06T11:14:25.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.309+0000 7fb4751a8700 1 Processor -- start 2023-10-06T11:14:25.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.309+0000 7fb4751a8700 1 -- start start 2023-10-06T11:14:25.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.309+0000 7fb4751a8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4700ae730 0x7fb4700b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:25.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.309+0000 7fb4751a8700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4700ce3d0 0x7fb4700b44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:25.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.309+0000 7fb4751a8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb47015a160 0x7fb4700c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:25.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.309+0000 7fb4751a8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4700b4e00 con 0x7fb47015a160 2023-10-06T11:14:25.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.309+0000 7fb4751a8700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47015db50 con 0x7fb4700ce3d0 2023-10-06T11:14:25.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.309+0000 7fb4751a8700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb47015e3b0 con 0x7fb4700ae730 2023-10-06T11:14:25.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.309+0000 7fb46f59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb47015a160 0x7fb4700c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:25.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.309+0000 7fb46f59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb47015a160 0x7fb4700c8d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53704/0 (socket says 172.21.15.146:53704) 2023-10-06T11:14:25.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.309+0000 7fb46f59e700 1 -- 172.21.15.146:0/3713675875 learned_addr learned my addr 172.21.15.146:0/3713675875 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:25.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.310+0000 7fb46f59e700 1 -- 172.21.15.146:0/3713675875 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4700ae730 msgr2=0x7fb4700b3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:25.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.310+0000 7fb46f59e700 1 --2- 172.21.15.146:0/3713675875 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4700ae730 0x7fb4700b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.310+0000 7fb46f59e700 1 -- 172.21.15.146:0/3713675875 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4700ce3d0 msgr2=0x7fb4700b44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:25.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.310+0000 7fb46f59e700 1 --2- 172.21.15.146:0/3713675875 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4700ce3d0 0x7fb4700b44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.310+0000 7fb46f59e700 1 -- 172.21.15.146:0/3713675875 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb460009480 con 0x7fb47015a160 2023-10-06T11:14:25.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.310+0000 7fb46f59e700 1 --2- 172.21.15.146:0/3713675875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb47015a160 0x7fb4700c8d00 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fb46800cd00 tx=0x7fb468001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:25.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.310+0000 7fb4677fe700 1 -- 172.21.15.146:0/3713675875 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb468005df0 con 0x7fb47015a160 2023-10-06T11:14:25.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.310+0000 7fb4677fe700 1 -- 172.21.15.146:0/3713675875 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46800a960 con 0x7fb47015a160 2023-10-06T11:14:25.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.310+0000 7fb4751a8700 1 -- 172.21.15.146:0/3713675875 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4700b4b20 con 0x7fb47015a160 2023-10-06T11:14:25.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.310+0000 7fb4677fe700 1 -- 172.21.15.146:0/3713675875 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46800ad00 con 0x7fb47015a160 2023-10-06T11:14:25.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.310+0000 7fb4751a8700 1 -- 172.21.15.146:0/3713675875 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb47015e040 con 0x7fb47015a160 2023-10-06T11:14:25.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.311+0000 7fb4677fe700 1 -- 172.21.15.146:0/3713675875 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb468007300 con 0x7fb47015a160 2023-10-06T11:14:25.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.312+0000 7fb4677fe700 1 --2- 172.21.15.146:0/3713675875 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb450066f30 0x7fb4500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:25.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.312+0000 7fb4677fe700 1 -- 172.21.15.146:0/3713675875 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb4680847a0 con 0x7fb47015a160 2023-10-06T11:14:25.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.312+0000 7fb46ed9d700 1 --2- 172.21.15.146:0/3713675875 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb450066f30 0x7fb4500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:25.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.312+0000 7fb46ed9d700 1 --2- 172.21.15.146:0/3713675875 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb450066f30 0x7fb4500693e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fb4700c9950 tx=0x7fb460016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:25.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.314+0000 7fb47e4a0b80 1 Processor -- start 2023-10-06T11:14:25.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.314+0000 7fb47e4a0b80 1 -- start start 2023-10-06T11:14:25.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.315+0000 7fb47e4a0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ac50d3a90 0x561ac50d3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:25.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.315+0000 7fb47e4a0b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ac508f9a0 0x561ac508c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:25.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.315+0000 7fb47e4a0b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ac508dbd0 0x561ac508cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:25.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.315+0000 7fb47e4a0b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ac500cc80 con 0x561ac508dbd0 2023-10-06T11:14:25.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.315+0000 7fb47e4a0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ac4fe3a70 con 0x561ac50d3a90 2023-10-06T11:14:25.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.315+0000 7fb47e4a0b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ac4fe1270 con 0x561ac508f9a0 2023-10-06T11:14:25.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.315+0000 7fb46f59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ac508dbd0 0x561ac508cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:25.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.315+0000 7fb46f59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ac508dbd0 0x561ac508cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53716/0 (socket says 172.21.15.146:53716) 2023-10-06T11:14:25.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.315+0000 7fb46f59e700 1 -- 172.21.15.146:0/1828371949 learned_addr learned my addr 172.21.15.146:0/1828371949 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:25.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.315+0000 7fb46ed9d700 1 --2- 172.21.15.146:0/1828371949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ac50d3a90 0x561ac50d3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:25.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.315+0000 7fb46f59e700 1 -- 172.21.15.146:0/1828371949 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ac508f9a0 msgr2=0x561ac508c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:25.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.315+0000 7fb46f59e700 1 --2- 172.21.15.146:0/1828371949 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ac508f9a0 0x561ac508c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.315+0000 7fb46f59e700 1 -- 172.21.15.146:0/1828371949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ac50d3a90 msgr2=0x561ac50d3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:25.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.315+0000 7fb46f59e700 1 --2- 172.21.15.146:0/1828371949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ac50d3a90 0x561ac50d3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.315+0000 7fb46f59e700 1 -- 172.21.15.146:0/1828371949 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ac4e77270 con 0x561ac508dbd0 2023-10-06T11:14:25.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.315+0000 7fb46ed9d700 1 --2- 172.21.15.146:0/1828371949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ac50d3a90 0x561ac50d3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:25.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.315+0000 7fb46f59e700 1 --2- 172.21.15.146:0/1828371949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ac508dbd0 0x561ac508cac0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fb468082b60 tx=0x7fb468082ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0b5f2b70fcf8688 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:25.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.315+0000 7fb44ffff700 1 -- 172.21.15.146:0/1828371949 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4680555f0 con 0x561ac508dbd0 2023-10-06T11:14:25.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.315+0000 7fb44ffff700 1 -- 172.21.15.146:0/1828371949 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb468058840 con 0x561ac508dbd0 2023-10-06T11:14:25.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.315+0000 7fb44ffff700 1 -- 172.21.15.146:0/1828371949 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46805c590 con 0x561ac508dbd0 2023-10-06T11:14:25.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.316+0000 7fb47e4a0b80 1 -- 172.21.15.146:0/1828371949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ac508dbd0 msgr2=0x561ac508cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:25.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.316+0000 7fb47e4a0b80 1 --2- 172.21.15.146:0/1828371949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ac508dbd0 0x561ac508cac0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fb468082b60 tx=0x7fb468082ac0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.316+0000 7fb47e4a0b80 1 -- 172.21.15.146:0/1828371949 shutdown_connections 2023-10-06T11:14:25.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.316+0000 7fb47e4a0b80 1 --2- 172.21.15.146:0/1828371949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ac508dbd0 0x561ac508cac0 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.316+0000 7fb47e4a0b80 1 --2- 172.21.15.146:0/1828371949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ac50d3a90 0x561ac50d3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.316+0000 7fb47e4a0b80 1 --2- 172.21.15.146:0/1828371949 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ac508f9a0 0x561ac508c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.316+0000 7fb47e4a0b80 1 -- 172.21.15.146:0/1828371949 >> 172.21.15.146:0/1828371949 conn(0x561ac508e070 msgr2=0x561ac508e440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:25.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.316+0000 7fb47e4a0b80 1 -- 172.21.15.146:0/1828371949 shutdown_connections 2023-10-06T11:14:25.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.316+0000 7fb47e4a0b80 1 -- 172.21.15.146:0/1828371949 wait complete. 2023-10-06T11:14:25.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.317+0000 7fb47e4a0b80 1 -- start start 2023-10-06T11:14:25.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.317+0000 7fb47e4a0b80 1 Processor -- start 2023-10-06T11:14:25.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.318+0000 7fb47e4a0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ac508dbd0 0x561ac50b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:25.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.318+0000 7fb47e4a0b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ac508f9a0 0x561ac50ce880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:25.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.318+0000 7fb47e4a0b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ac50d3a90 0x561ac508c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:25.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.318+0000 7fb47e4a0b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ac4fdd060 con 0x561ac50d3a90 2023-10-06T11:14:25.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.318+0000 7fb47e4a0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ac4f88890 con 0x561ac508dbd0 2023-10-06T11:14:25.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.318+0000 7fb47e4a0b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ac4fa3ea0 con 0x561ac508f9a0 2023-10-06T11:14:25.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.318+0000 7fb47e4a0b80 10 client.0 _ll_register_callbacks cb 0x561ac4e79f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:14:25.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.318+0000 7fb46f59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ac50d3a90 0x561ac508c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:25.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.318+0000 7fb46f59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ac50d3a90 0x561ac508c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53722/0 (socket says 172.21.15.146:53722) 2023-10-06T11:14:25.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.318+0000 7fb46f59e700 1 -- 172.21.15.146:0/2277304701 learned_addr learned my addr 172.21.15.146:0/2277304701 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:25.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.318+0000 7fb46f59e700 1 -- 172.21.15.146:0/2277304701 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ac508f9a0 msgr2=0x561ac50ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:25.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.318+0000 7fb46f59e700 1 --2- 172.21.15.146:0/2277304701 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ac508f9a0 0x561ac50ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.318+0000 7fb46f59e700 1 -- 172.21.15.146:0/2277304701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ac508dbd0 msgr2=0x561ac50b32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:25.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.318+0000 7fb46f59e700 1 --2- 172.21.15.146:0/2277304701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ac508dbd0 0x561ac50b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.318+0000 7fb46f59e700 1 -- 172.21.15.146:0/2277304701 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb47015e040 con 0x561ac50d3a90 2023-10-06T11:14:25.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.318+0000 7fb46f59e700 1 --2- 172.21.15.146:0/2277304701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ac50d3a90 0x561ac508c580 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fb468001dc0 tx=0x7fb46806a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe78fdf278f056c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:25.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.318+0000 7fb44d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:14:25.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.319+0000 7fb44d7fa700 1 -- 172.21.15.146:0/2277304701 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46805c590 con 0x561ac50d3a90 2023-10-06T11:14:25.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.319+0000 7fb44d7fa700 1 -- 172.21.15.146:0/2277304701 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb468067e40 con 0x561ac50d3a90 2023-10-06T11:14:25.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.319+0000 7fb47e4a0b80 1 -- 172.21.15.146:0/2277304701 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561ac5081690 con 0x561ac50d3a90 2023-10-06T11:14:25.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.319+0000 7fb44d7fa700 1 -- 172.21.15.146:0/2277304701 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb46805c100 con 0x561ac50d3a90 2023-10-06T11:14:25.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.319+0000 7fb47e4a0b80 10 client.8247 fetch_fsmap learned FSMap version 100 2023-10-06T11:14:25.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.319+0000 7fb47e4a0b80 1 -- 172.21.15.146:0/2277304701 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) v3 -- 0x561ac4e19fe0 con 0x561ac50d3a90 2023-10-06T11:14:25.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.319+0000 7fb44d7fa700 1 -- 172.21.15.146:0/2277304701 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561ac5081690 con 0x561ac50d3a90 2023-10-06T11:14:25.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.319+0000 7fb44d7fa700 1 -- 172.21.15.146:0/2277304701 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 100) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb468004bb0 con 0x561ac50d3a90 2023-10-06T11:14:25.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.319+0000 7fb47e4a0b80 10 client.8247 fetch_fsmap finished waiting for FSMap version 100 2023-10-06T11:14:25.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.319+0000 7fb47e4a0b80 10 client.8247 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T11:14:25.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.319+0000 7fb47e4a0b80 20 client.8247 populate_metadata read hostname 'smithi146' 2023-10-06T11:14:25.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.319+0000 7fb47e4a0b80 1 --2- 172.21.15.146:0/2277304701 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x561ac50b6980 0x561ac50b6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:25.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.319+0000 7fb47e4a0b80 4 client.8247 mds_command: new command op to 8103 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:14:25.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.319+0000 7fb47e4a0b80 1 -- 172.21.15.146:0/2277304701 --> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561ac505e5c0 con 0x561ac50b6980 2023-10-06T11:14:25.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.319+0000 7fb46ed9d700 1 --2- 172.21.15.146:0/2277304701 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x561ac50b6980 0x561ac50b6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:25.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.319+0000 7fb44d7fa700 10 client.8247 ms_handle_connect on v2:172.21.15.146:6835/409226151 2023-10-06T11:14:25.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.320+0000 7fb46ed9d700 1 --2- 172.21.15.146:0/2277304701 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x561ac50b6980 0x561ac50b6d50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=353d31e5b439d865 server_cookie=9e5b9687248347a6 in_seq=0 out_seq=0 2023-10-06T11:14:25.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.320+0000 7fb44d7fa700 1 -- 172.21.15.146:0/2277304701 <== mds.0 v2:172.21.15.146:6835/409226151 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x561ac505e5c0 con 0x561ac50b6980 2023-10-06T11:14:25.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.320+0000 7fb44d7fa700 10 client.8247 handle_command_reply: tid=0 2023-10-06T11:14:25.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.320+0000 7fb47e4a0b80 1 client.8247 shutdown 2023-10-06T11:14:25.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.320+0000 7fb47e4a0b80 1 -- 172.21.15.146:0/2277304701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ac50d3a90 msgr2=0x561ac508c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:25.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.320+0000 7fb47e4a0b80 1 --2- 172.21.15.146:0/2277304701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ac50d3a90 0x561ac508c580 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fb468001dc0 tx=0x7fb46806a000 comp rx=0 tx=0).stop 2023-10-06T11:14:25.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.320+0000 7fb47e4a0b80 1 -- 172.21.15.146:0/2277304701 shutdown_connections 2023-10-06T11:14:25.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.320+0000 7fb47e4a0b80 1 --2- 172.21.15.146:0/2277304701 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x561ac50b6980 0x561ac50b6d50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.320+0000 7fb47e4a0b80 1 --2- 172.21.15.146:0/2277304701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ac50d3a90 0x561ac508c580 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.320+0000 7fb47e4a0b80 1 --2- 172.21.15.146:0/2277304701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ac508dbd0 0x561ac50b32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.320+0000 7fb47e4a0b80 1 --2- 172.21.15.146:0/2277304701 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ac508f9a0 0x561ac50ce880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.320+0000 7fb44d7fa700 0 client.8247 ms_handle_reset on v2:172.21.15.146:6835/409226151 2023-10-06T11:14:25.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.320+0000 7fb47e4a0b80 1 -- 172.21.15.146:0/2277304701 >> 172.21.15.146:0/2277304701 conn(0x561ac508e070 msgr2=0x561ac50897f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:25.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.320+0000 7fb47e4a0b80 1 -- 172.21.15.146:0/2277304701 shutdown_connections 2023-10-06T11:14:25.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.320+0000 7fb47e4a0b80 1 -- 172.21.15.146:0/2277304701 wait complete. 2023-10-06T11:14:25.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.320+0000 7fb47e4a0b80 20 client.8247 trim_cache size 0 max 16384 2023-10-06T11:14:25.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.337+0000 7fb47e4a0b80 1 Processor -- start 2023-10-06T11:14:25.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.337+0000 7fb47e4a0b80 1 -- start start 2023-10-06T11:14:25.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.338+0000 7fb47e4a0b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ac508dbd0 0x561ac5089bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:25.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.338+0000 7fb47e4a0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ac508f9a0 0x561ac50b6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:25.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.338+0000 7fb47e4a0b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ac50d3a90 0x561ac50b7290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:25.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.338+0000 7fb47e4a0b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ac4e5fe30 con 0x561ac50d3a90 2023-10-06T11:14:25.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.338+0000 7fb47e4a0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ac50d3040 con 0x561ac508f9a0 2023-10-06T11:14:25.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.338+0000 7fb47e4a0b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ac5085180 con 0x561ac508dbd0 2023-10-06T11:14:25.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.338+0000 7fb46f59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ac50d3a90 0x561ac50b7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:25.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.338+0000 7fb46f59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ac50d3a90 0x561ac50b7290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53738/0 (socket says 172.21.15.146:53738) 2023-10-06T11:14:25.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.338+0000 7fb46f59e700 1 -- 172.21.15.146:0/2294699765 learned_addr learned my addr 172.21.15.146:0/2294699765 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:25.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.338+0000 7fb46f59e700 1 -- 172.21.15.146:0/2294699765 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ac508dbd0 msgr2=0x561ac5089bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:25.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.338+0000 7fb46f59e700 1 --2- 172.21.15.146:0/2294699765 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ac508dbd0 0x561ac5089bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.338+0000 7fb46f59e700 1 -- 172.21.15.146:0/2294699765 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ac508f9a0 msgr2=0x561ac50b6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:25.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.338+0000 7fb46f59e700 1 --2- 172.21.15.146:0/2294699765 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ac508f9a0 0x561ac50b6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.338+0000 7fb46f59e700 1 -- 172.21.15.146:0/2294699765 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb47015d720 con 0x561ac50d3a90 2023-10-06T11:14:25.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.339+0000 7fb46f59e700 1 --2- 172.21.15.146:0/2294699765 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ac50d3a90 0x561ac50b7290 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fb468055c50 tx=0x7fb468082070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a89257029cd62853 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:25.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.339+0000 7fb464d99700 1 -- 172.21.15.146:0/2294699765 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46805c350 con 0x561ac50d3a90 2023-10-06T11:14:25.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.339+0000 7fb464d99700 1 -- 172.21.15.146:0/2294699765 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb46805c590 con 0x561ac50d3a90 2023-10-06T11:14:25.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.339+0000 7fb464d99700 1 -- 172.21.15.146:0/2294699765 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb46805c100 con 0x561ac50d3a90 2023-10-06T11:14:25.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.339+0000 7fb47e4a0b80 1 -- 172.21.15.146:0/2294699765 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ac50d3a90 msgr2=0x561ac50b7290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:25.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.339+0000 7fb47e4a0b80 1 --2- 172.21.15.146:0/2294699765 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ac50d3a90 0x561ac50b7290 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fb468055c50 tx=0x7fb468082070 comp rx=0 tx=0).stop 2023-10-06T11:14:25.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.339+0000 7fb47e4a0b80 1 -- 172.21.15.146:0/2294699765 shutdown_connections 2023-10-06T11:14:25.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.339+0000 7fb47e4a0b80 1 --2- 172.21.15.146:0/2294699765 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ac50d3a90 0x561ac50b7290 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.339+0000 7fb47e4a0b80 1 --2- 172.21.15.146:0/2294699765 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ac508dbd0 0x561ac5089bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.339+0000 7fb47e4a0b80 1 --2- 172.21.15.146:0/2294699765 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ac508f9a0 0x561ac50b6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.339+0000 7fb47e4a0b80 1 -- 172.21.15.146:0/2294699765 >> 172.21.15.146:0/2294699765 conn(0x561ac508e070 msgr2=0x561ac50d3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:25.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.339+0000 7fb47e4a0b80 1 -- 172.21.15.146:0/2294699765 shutdown_connections 2023-10-06T11:14:25.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.339+0000 7fb47e4a0b80 1 -- 172.21.15.146:0/2294699765 wait complete. 2023-10-06T11:14:25.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.340+0000 7fb47e4a0b80 1 -- start start 2023-10-06T11:14:25.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.340+0000 7fb47e4a0b80 1 Processor -- start 2023-10-06T11:14:25.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.341+0000 7fb47e4a0b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ac508dbd0 0x561ac5138280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:25.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.341+0000 7fb47e4a0b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ac508f9a0 0x561ac51387c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:25.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.341+0000 7fb47e4a0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ac50d3a90 0x561ac50e4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:25.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.341+0000 7fb47e4a0b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ac50b8be0 con 0x561ac508f9a0 2023-10-06T11:14:25.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.341+0000 7fb47e4a0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ac5139050 con 0x561ac50d3a90 2023-10-06T11:14:25.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.341+0000 7fb47e4a0b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ac50ce120 con 0x561ac508dbd0 2023-10-06T11:14:25.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.341+0000 7fb47e4a0b80 10 client.0 _ll_register_callbacks cb 0x561ac4e79f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:14:25.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.341+0000 7fb46659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ac508f9a0 0x561ac51387c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:25.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.341+0000 7fb46659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ac508f9a0 0x561ac51387c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53754/0 (socket says 172.21.15.146:53754) 2023-10-06T11:14:25.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.341+0000 7fb46659c700 1 -- 172.21.15.146:0/65847431 learned_addr learned my addr 172.21.15.146:0/65847431 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:25.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.341+0000 7fb46f59e700 1 --2- 172.21.15.146:0/65847431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ac50d3a90 0x561ac50e4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:25.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.341+0000 7fb46ed9d700 1 --2- 172.21.15.146:0/65847431 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ac508dbd0 0x561ac5138280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:25.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.341+0000 7fb46659c700 1 -- 172.21.15.146:0/65847431 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ac508dbd0 msgr2=0x561ac5138280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:25.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.341+0000 7fb46659c700 1 --2- 172.21.15.146:0/65847431 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ac508dbd0 0x561ac5138280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.341+0000 7fb46659c700 1 -- 172.21.15.146:0/65847431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ac50d3a90 msgr2=0x561ac50e4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:25.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.341+0000 7fb46659c700 1 --2- 172.21.15.146:0/65847431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ac50d3a90 0x561ac50e4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.341+0000 7fb46659c700 1 -- 172.21.15.146:0/65847431 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561ac4e19fe0 con 0x561ac508f9a0 2023-10-06T11:14:25.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.341+0000 7fb46ed9d700 1 --2- 172.21.15.146:0/65847431 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ac508dbd0 0x561ac5138280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:25.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.341+0000 7fb46659c700 1 --2- 172.21.15.146:0/65847431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ac508f9a0 0x561ac51387c0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7fb47015fc40 tx=0x7fb458008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4219423b0832a074 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:25.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.341+0000 7fb44d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:14:25.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.341+0000 7fb44d7fa700 1 -- 172.21.15.146:0/65847431 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb458018070 con 0x561ac508f9a0 2023-10-06T11:14:25.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.341+0000 7fb44d7fa700 1 -- 172.21.15.146:0/65847431 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb45800dd20 con 0x561ac508f9a0 2023-10-06T11:14:25.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.341+0000 7fb47e4a0b80 1 -- 172.21.15.146:0/65847431 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb468058840 con 0x561ac508f9a0 2023-10-06T11:14:25.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.341+0000 7fb44d7fa700 1 -- 172.21.15.146:0/65847431 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb45800dee0 con 0x561ac508f9a0 2023-10-06T11:14:25.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.341+0000 7fb47e4a0b80 10 client.8253 fetch_fsmap learned FSMap version 100 2023-10-06T11:14:25.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.341+0000 7fb47e4a0b80 1 -- 172.21.15.146:0/65847431 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) v3 -- 0x561ac4fab780 con 0x561ac508f9a0 2023-10-06T11:14:25.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.342+0000 7fb44d7fa700 1 -- 172.21.15.146:0/65847431 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb468058840 con 0x561ac508f9a0 2023-10-06T11:14:25.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.342+0000 7fb44d7fa700 1 -- 172.21.15.146:0/65847431 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 100) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb45801b020 con 0x561ac508f9a0 2023-10-06T11:14:25.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.342+0000 7fb47e4a0b80 10 client.8253 fetch_fsmap finished waiting for FSMap version 100 2023-10-06T11:14:25.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.342+0000 7fb47e4a0b80 10 client.8253 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T11:14:25.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.342+0000 7fb47e4a0b80 20 client.8253 populate_metadata read hostname 'smithi146' 2023-10-06T11:14:25.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.342+0000 7fb47e4a0b80 1 --2- 172.21.15.146:0/65847431 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x561ac50cf7c0 0x561ac50ec120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:25.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.342+0000 7fb47e4a0b80 4 client.8253 mds_command: new command op to 8103 tid=0[{"prefix": "status"}] 2023-10-06T11:14:25.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.342+0000 7fb47e4a0b80 1 -- 172.21.15.146:0/65847431 --> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561ac4f7fe00 con 0x561ac50cf7c0 2023-10-06T11:14:25.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.342+0000 7fb46ed9d700 1 --2- 172.21.15.146:0/65847431 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x561ac50cf7c0 0x561ac50ec120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:25.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.342+0000 7fb44d7fa700 10 client.8253 ms_handle_connect on v2:172.21.15.146:6835/409226151 2023-10-06T11:14:25.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.342+0000 7fb46ed9d700 1 --2- 172.21.15.146:0/65847431 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x561ac50cf7c0 0x561ac50ec120 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2c1cb96d736e9cb server_cookie=f9cced7d92c7b125 in_seq=0 out_seq=0 2023-10-06T11:14:25.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.342+0000 7fb44d7fa700 1 -- 172.21.15.146:0/65847431 <== mds.0 v2:172.21.15.146:6835/409226151 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x561ac4f7fe00 con 0x561ac50cf7c0 2023-10-06T11:14:25.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.342+0000 7fb44d7fa700 10 client.8253 handle_command_reply: tid=0 2023-10-06T11:14:25.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.342+0000 7fb47e4a0b80 1 client.8253 shutdown 2023-10-06T11:14:25.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.342+0000 7fb47e4a0b80 1 -- 172.21.15.146:0/65847431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ac508f9a0 msgr2=0x561ac51387c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:25.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.342+0000 7fb47e4a0b80 1 --2- 172.21.15.146:0/65847431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ac508f9a0 0x561ac51387c0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7fb47015fc40 tx=0x7fb458008040 comp rx=0 tx=0).stop 2023-10-06T11:14:25.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.343+0000 7fb47e4a0b80 1 -- 172.21.15.146:0/65847431 shutdown_connections 2023-10-06T11:14:25.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.343+0000 7fb47e4a0b80 1 --2- 172.21.15.146:0/65847431 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x561ac50cf7c0 0x561ac50ec120 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.343+0000 7fb47e4a0b80 1 --2- 172.21.15.146:0/65847431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ac50d3a90 0x561ac50e4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.343+0000 7fb44d7fa700 0 client.8253 ms_handle_reset on v2:172.21.15.146:6835/409226151 2023-10-06T11:14:25.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.343+0000 7fb47e4a0b80 1 --2- 172.21.15.146:0/65847431 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x561ac508dbd0 0x561ac5138280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.343+0000 7fb47e4a0b80 1 --2- 172.21.15.146:0/65847431 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x561ac508f9a0 0x561ac51387c0 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.343+0000 7fb47e4a0b80 1 -- 172.21.15.146:0/65847431 >> 172.21.15.146:0/65847431 conn(0x561ac508e070 msgr2=0x561ac50b6d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:25.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.343+0000 7fb47e4a0b80 1 -- 172.21.15.146:0/65847431 shutdown_connections 2023-10-06T11:14:25.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.343+0000 7fb47e4a0b80 1 -- 172.21.15.146:0/65847431 wait complete. 2023-10-06T11:14:25.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.343+0000 7fb47e4a0b80 20 client.8253 trim_cache size 0 max 16384 2023-10-06T11:14:25.355 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:14:25.355 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1", 2023-10-06T11:14:25.355 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2023-10-06T11:14:25.355 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 8103, 2023-10-06T11:14:25.356 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2023-10-06T11:14:25.356 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2023-10-06T11:14:25.356 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2023-10-06T11:14:25.356 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 5.8272877310000002, 2023-10-06T11:14:25.356 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 100, 2023-10-06T11:14:25.356 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 113, 2023-10-06T11:14:25.356 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 113, 2023-10-06T11:14:25.356 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 11.911016902 2023-10-06T11:14:25.356 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:14:25.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.343+0000 7fb4751a8700 1 -- 172.21.15.146:0/3713675875 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb450066f30 msgr2=0x7fb4500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:25.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.343+0000 7fb4751a8700 1 --2- 172.21.15.146:0/3713675875 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb450066f30 0x7fb4500693e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fb4700c9950 tx=0x7fb460016000 comp rx=0 tx=0).stop 2023-10-06T11:14:25.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.343+0000 7fb4751a8700 1 -- 172.21.15.146:0/3713675875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb47015a160 msgr2=0x7fb4700c8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:25.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.343+0000 7fb4751a8700 1 --2- 172.21.15.146:0/3713675875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb47015a160 0x7fb4700c8d00 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fb46800cd00 tx=0x7fb468001b10 comp rx=0 tx=0).stop 2023-10-06T11:14:25.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.343+0000 7fb4751a8700 1 -- 172.21.15.146:0/3713675875 shutdown_connections 2023-10-06T11:14:25.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.343+0000 7fb4751a8700 1 --2- 172.21.15.146:0/3713675875 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb450066f30 0x7fb4500693e0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.343+0000 7fb4751a8700 1 --2- 172.21.15.146:0/3713675875 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb47015a160 0x7fb4700c8d00 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.343+0000 7fb4751a8700 1 --2- 172.21.15.146:0/3713675875 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4700ae730 0x7fb4700b3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.343+0000 7fb4751a8700 1 --2- 172.21.15.146:0/3713675875 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4700ce3d0 0x7fb4700b44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.343+0000 7fb4751a8700 1 -- 172.21.15.146:0/3713675875 >> 172.21.15.146:0/3713675875 conn(0x7fb47006f380 msgr2=0x7fb4700cbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:25.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.343+0000 7fb4751a8700 1 -- 172.21.15.146:0/3713675875 shutdown_connections 2023-10-06T11:14:25.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.343+0000 7fb4751a8700 1 -- 172.21.15.146:0/3713675875 wait complete. 2023-10-06T11:14:25.359 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T11:14:25.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.473+0000 7f4db3fff700 1 Processor -- start 2023-10-06T11:14:25.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.473+0000 7f4db3fff700 1 -- start start 2023-10-06T11:14:25.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.474+0000 7f4db3fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4db415a7f0 0x7f4db415cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:25.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.474+0000 7f4db3fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4db415c630 con 0x7f4db40b2530 2023-10-06T11:14:25.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.474+0000 7f4db3fff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4db415ba20 con 0x7f4db415a420 2023-10-06T11:14:25.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.474+0000 7f4db3fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4db40ce040 con 0x7f4db415a7f0 2023-10-06T11:14:25.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.474+0000 7f4daa7fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4db415a7f0 0x7f4db415cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:25.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.474+0000 7f4daa7fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4db415a7f0 0x7f4db415cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53766/0 (socket says 172.21.15.146:53766) 2023-10-06T11:14:25.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.474+0000 7f4daa7fc700 1 -- 172.21.15.146:0/3791290465 learned_addr learned my addr 172.21.15.146:0/3791290465 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:25.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.474+0000 7f4db37fe700 1 --1- 172.21.15.146:0/3791290465 >> v1:172.21.15.146:6789/0 conn(0x7f4db40b2530 0x7f4db415acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:37140/0 (socket says 172.21.15.146:37140) 2023-10-06T11:14:25.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.474+0000 7f4daa7fc700 1 -- 172.21.15.146:0/3791290465 >> v1:172.21.15.151:6789/0 conn(0x7f4db415a420 legacy=0x7f4db40b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:25.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.474+0000 7f4daa7fc700 1 -- 172.21.15.146:0/3791290465 >> v1:172.21.15.146:6789/0 conn(0x7f4db40b2530 legacy=0x7f4db415acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:25.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.474+0000 7f4daa7fc700 1 -- 172.21.15.146:0/3791290465 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db415bd00 con 0x7f4db415a7f0 2023-10-06T11:14:25.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.475+0000 7f4daa7fc700 1 --2- 172.21.15.146:0/3791290465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4db415a7f0 0x7f4db415cac0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c0099b0 tx=0x7f4d9c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d5666f4f1a9e409 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:25.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.475+0000 7f4db27fc700 1 -- 172.21.15.146:0/3791290465 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c00b860 con 0x7f4db415a7f0 2023-10-06T11:14:25.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.475+0000 7f4db27fc700 1 -- 172.21.15.146:0/3791290465 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d9c00b9c0 con 0x7f4db415a7f0 2023-10-06T11:14:25.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.475+0000 7f4db27fc700 1 -- 172.21.15.146:0/3791290465 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c00bd60 con 0x7f4db415a7f0 2023-10-06T11:14:25.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.475+0000 7f4db3fff700 1 -- 172.21.15.146:0/3791290465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4db415a7f0 msgr2=0x7f4db415cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:25.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.475+0000 7f4db3fff700 1 --2- 172.21.15.146:0/3791290465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4db415a7f0 0x7f4db415cac0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c0099b0 tx=0x7f4d9c009250 comp rx=0 tx=0).stop 2023-10-06T11:14:25.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.475+0000 7f4db3fff700 1 -- 172.21.15.146:0/3791290465 shutdown_connections 2023-10-06T11:14:25.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.475+0000 7f4db3fff700 1 --2- 172.21.15.146:0/3791290465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4db415a7f0 0x7f4db415cac0 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.475+0000 7f4db3fff700 1 -- 172.21.15.146:0/3791290465 >> 172.21.15.146:0/3791290465 conn(0x7f4db406eba0 msgr2=0x7f4db406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:25.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.475+0000 7f4db3fff700 1 -- 172.21.15.146:0/3791290465 shutdown_connections 2023-10-06T11:14:25.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.475+0000 7f4db3fff700 1 -- 172.21.15.146:0/3791290465 wait complete. 2023-10-06T11:14:25.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.476+0000 7f4db3fff700 1 Processor -- start 2023-10-06T11:14:25.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.476+0000 7f4db3fff700 1 -- start start 2023-10-06T11:14:25.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.477+0000 7f4db3fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4db40b2530 0x7f4db41565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:25.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.477+0000 7f4db3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4db415a420 0x7f4db416d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:25.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.477+0000 7f4db3fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4db415a7f0 0x7f4db416deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:25.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.477+0000 7f4db3fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db413c930 con 0x7f4db40b2530 2023-10-06T11:14:25.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.477+0000 7f4db3fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db41526c0 con 0x7f4db415a420 2023-10-06T11:14:25.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.477+0000 7f4db3fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db4158170 con 0x7f4db415a7f0 2023-10-06T11:14:25.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.477+0000 7f4db2ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4db40b2530 0x7f4db41565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:25.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.477+0000 7f4db2ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4db40b2530 0x7f4db41565e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:53770/0 (socket says 172.21.15.146:53770) 2023-10-06T11:14:25.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.477+0000 7f4db2ffd700 1 -- 172.21.15.146:0/15467286 learned_addr learned my addr 172.21.15.146:0/15467286 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:25.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.478+0000 7f4daa7fc700 1 --2- 172.21.15.146:0/15467286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4db415a420 0x7f4db416d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:25.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.478+0000 7f4db2ffd700 1 -- 172.21.15.146:0/15467286 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4db415a7f0 msgr2=0x7f4db416deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:25.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.478+0000 7f4db2ffd700 1 --2- 172.21.15.146:0/15467286 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4db415a7f0 0x7f4db416deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.478+0000 7f4db2ffd700 1 -- 172.21.15.146:0/15467286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4db415a420 msgr2=0x7f4db416d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:25.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.478+0000 7f4db2ffd700 1 --2- 172.21.15.146:0/15467286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4db415a420 0x7f4db416d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.478+0000 7f4db2ffd700 1 -- 172.21.15.146:0/15467286 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d9c0094f0 con 0x7f4db40b2530 2023-10-06T11:14:25.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.478+0000 7f4db2ffd700 1 --2- 172.21.15.146:0/15467286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4db40b2530 0x7f4db41565e0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f4da400c5c0 tx=0x7f4da400c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:25.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.478+0000 7f4dab7fe700 1 -- 172.21.15.146:0/15467286 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da4011590 con 0x7f4db40b2530 2023-10-06T11:14:25.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.478+0000 7f4dab7fe700 1 -- 172.21.15.146:0/15467286 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da4011710 con 0x7f4db40b2530 2023-10-06T11:14:25.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.478+0000 7f4db3fff700 1 -- 172.21.15.146:0/15467286 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4db416e870 con 0x7f4db40b2530 2023-10-06T11:14:25.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.478+0000 7f4dab7fe700 1 -- 172.21.15.146:0/15467286 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da4011ad0 con 0x7f4db40b2530 2023-10-06T11:14:25.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.478+0000 7f4db3fff700 1 -- 172.21.15.146:0/15467286 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4db41523e0 con 0x7f4db40b2530 2023-10-06T11:14:25.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.479+0000 7f4db3fff700 1 -- 172.21.15.146:0/15467286 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4db40afae0 con 0x7f4db40b2530 2023-10-06T11:14:25.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.479+0000 7f4dab7fe700 1 -- 172.21.15.146:0/15467286 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4da401b3b0 con 0x7f4db40b2530 2023-10-06T11:14:25.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.480+0000 7f4dab7fe700 1 --2- 172.21.15.146:0/15467286 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4d94066f30 0x7f4d940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:25.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.480+0000 7f4dab7fe700 1 -- 172.21.15.146:0/15467286 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4da4083ac0 con 0x7f4db40b2530 2023-10-06T11:14:25.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.480+0000 7f4daa7fc700 1 --2- 172.21.15.146:0/15467286 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4d94066f30 0x7f4d940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:25.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.480+0000 7f4daa7fc700 1 --2- 172.21.15.146:0/15467286 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4d94066f30 0x7f4d940693e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c0099b0 tx=0x7f4d9c017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:25.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.484+0000 7f4dab7fe700 1 -- 172.21.15.146:0/15467286 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4da4050bd0 con 0x7f4db40b2530 2023-10-06T11:14:25.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.712+0000 7f4db3fff700 1 -- 172.21.15.146:0/15467286 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4db416e870 con 0x7f4db40b2530 2023-10-06T11:14:25.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.713+0000 7f4dab7fe700 1 -- 172.21.15.146:0/15467286 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v100) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4db416e870 con 0x7f4db40b2530 2023-10-06T11:14:25.715 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T11:14:25.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.715+0000 7f4db3fff700 1 -- 172.21.15.146:0/15467286 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4d94066f30 msgr2=0x7f4d940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:25.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.715+0000 7f4db3fff700 1 --2- 172.21.15.146:0/15467286 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4d94066f30 0x7f4d940693e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c0099b0 tx=0x7f4d9c017000 comp rx=0 tx=0).stop 2023-10-06T11:14:25.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.715+0000 7f4db3fff700 1 -- 172.21.15.146:0/15467286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4db40b2530 msgr2=0x7f4db41565e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:25.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.715+0000 7f4db3fff700 1 --2- 172.21.15.146:0/15467286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4db40b2530 0x7f4db41565e0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f4da400c5c0 tx=0x7f4da400c980 comp rx=0 tx=0).stop 2023-10-06T11:14:25.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.715+0000 7f4db3fff700 1 -- 172.21.15.146:0/15467286 shutdown_connections 2023-10-06T11:14:25.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.715+0000 7f4db3fff700 1 --2- 172.21.15.146:0/15467286 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4d94066f30 0x7f4d940693e0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.715+0000 7f4db3fff700 1 --2- 172.21.15.146:0/15467286 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4db415a7f0 0x7f4db416deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.715+0000 7f4db3fff700 1 --2- 172.21.15.146:0/15467286 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4db40b2530 0x7f4db41565e0 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.715+0000 7f4db3fff700 1 --2- 172.21.15.146:0/15467286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4db415a420 0x7f4db416d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:25.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.715+0000 7f4db3fff700 1 -- 172.21.15.146:0/15467286 >> 172.21.15.146:0/15467286 conn(0x7f4db406eba0 msgr2=0x7f4db406ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:25.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.715+0000 7f4db3fff700 1 -- 172.21.15.146:0/15467286 shutdown_connections 2023-10-06T11:14:25.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:25.715+0000 7f4db3fff700 1 -- 172.21.15.146:0/15467286 wait complete. 2023-10-06T11:14:25.729 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T11:14:25.729 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T11:14:25.729 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2023-10-06T11:14:25.729 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T11:14:25.729 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T11:14:25.730 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T11:14:25.730 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T11:14:25.730 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T11:14:25.730 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:14:25.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:25.731 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2023-10-06T11:14:25.745 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:14:25.746 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:14:25.746 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:14:25.746 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:14:25.746 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2023-10-06T11:14:25.746 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:14:25.746 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:14:25.746 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2023-10-06T11:14:25.746 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2023-10-06T11:14:25.746 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:14:25.747 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2023-10-06T11:14:25.747 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2023-10-06T11:14:25.747 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:14:25.747 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2023-10-06T11:14:25.747 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T11:14:25.747 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2023-10-06T11:14:25.747 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T11:14:25.748 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 41991sec preferred_lft 41991sec 2023-10-06T11:14:25.748 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link noprefixroute 2023-10-06T11:14:25.748 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:14:25.748 INFO:teuthology.orchestra.run.smithi146.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T11:14:25.748 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0e:4f:33:80:c4:0e brd ff:ff:ff:ff:ff:ff 2023-10-06T11:14:25.748 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T11:14:25.748 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:14:25.748 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3884:6eff:fefc:ffc7/64 scope link 2023-10-06T11:14:25.748 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:14:25.748 INFO:teuthology.orchestra.run.smithi146.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:14:25.748 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0e:4f:33:80:c4:0e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T11:14:25.748 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::c4f:33ff:fe80:c40e/64 scope link 2023-10-06T11:14:25.748 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:14:25.749 INFO:teuthology.orchestra.run.smithi146.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:14:25.749 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 36:96:28:73:57:c4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T11:14:25.749 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3496:28ff:fe73:57c4/64 scope link 2023-10-06T11:14:25.749 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:14:25.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:25.749 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T11:14:25.809 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-06T11:14:25.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:25.811 DEBUG:teuthology.orchestra.run.smithi146:> route 2023-10-06T11:14:25.868 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2023-10-06T11:14:25.868 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T11:14:25.868 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T11:14:25.869 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T11:14:25.869 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T11:14:25.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:25.869 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-10-06T11:14:25.869 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:14:25.869 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T11:14:25.869 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T11:14:25.869 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T11:14:25.869 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:14:25.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:25.968 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-10-06T11:14:25.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T11:14:25.982 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T11:14:25.983 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:14:25.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:25.983 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2023-10-06T11:14:26.047 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T11:14:26.047 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:14:26.048 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T11:14:26.102 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:14:26.102 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:14:26.102 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:14:26.157 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-06T11:14:26.221 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:14:26.221 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:14:26.285 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:14:26.286 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:14:26.287 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:14:26.287 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-06T11:14:26.342 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T11:14:26.343 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T11:14:26.385 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-06T11:14:26.409 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:14:26.409 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:14:26.467 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:2023-10-06T11:14:26.465+0000 7f079d58d540 -1 init, newargv = 0x557eb90a4990 newargc=15 2023-10-06T11:14:26.467 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[140154]: starting ceph client 2023-10-06T11:14:26.471 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[140154]: starting fuse 2023-10-06T11:14:26.476 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:14:26.477 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:14:26.478 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:14:26.478 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-06T11:14:26.533 INFO:teuthology.orchestra.run.smithi146.stdout:46 2023-10-06T11:14:26.533 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-06T11:14:26.533 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T11:14:26.533 DEBUG:teuthology.orchestra.run.smithi146:> import glob 2023-10-06T11:14:26.534 DEBUG:teuthology.orchestra.run.smithi146:> import re 2023-10-06T11:14:26.534 DEBUG:teuthology.orchestra.run.smithi146:> import os 2023-10-06T11:14:26.534 DEBUG:teuthology.orchestra.run.smithi146:> import subprocess 2023-10-06T11:14:26.534 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:14:26.534 DEBUG:teuthology.orchestra.run.smithi146:> def _find_admin_socket(client_name): 2023-10-06T11:14:26.534 DEBUG:teuthology.orchestra.run.smithi146:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T11:14:26.534 DEBUG:teuthology.orchestra.run.smithi146:> files = glob.glob(asok_path) 2023-10-06T11:14:26.534 DEBUG:teuthology.orchestra.run.smithi146:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T11:14:26.534 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:14:26.534 DEBUG:teuthology.orchestra.run.smithi146:> # Given a non-glob path, it better be there 2023-10-06T11:14:26.534 DEBUG:teuthology.orchestra.run.smithi146:> if "*" not in asok_path: 2023-10-06T11:14:26.534 DEBUG:teuthology.orchestra.run.smithi146:> assert(len(files) == 1) 2023-10-06T11:14:26.534 DEBUG:teuthology.orchestra.run.smithi146:> return files[0] 2023-10-06T11:14:26.535 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:14:26.535 DEBUG:teuthology.orchestra.run.smithi146:> for f in files: 2023-10-06T11:14:26.535 DEBUG:teuthology.orchestra.run.smithi146:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T11:14:26.535 DEBUG:teuthology.orchestra.run.smithi146:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T11:14:26.535 DEBUG:teuthology.orchestra.run.smithi146:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T11:14:26.535 DEBUG:teuthology.orchestra.run.smithi146:> contents = proc_f.read() 2023-10-06T11:14:26.535 DEBUG:teuthology.orchestra.run.smithi146:> if mountpoint in contents: 2023-10-06T11:14:26.535 DEBUG:teuthology.orchestra.run.smithi146:> return f 2023-10-06T11:14:26.535 DEBUG:teuthology.orchestra.run.smithi146:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T11:14:26.535 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:14:26.535 DEBUG:teuthology.orchestra.run.smithi146:> print(_find_admin_socket("client.0")) 2023-10-06T11:14:26.535 DEBUG:teuthology.orchestra.run.smithi146:> ' 2023-10-06T11:14:26.655 INFO:teuthology.orchestra.run.smithi146.stdout:/var/run/ceph/ceph-client.0.140154.asok 2023-10-06T11:14:26.837 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.140154.asok 2023-10-06T11:14:26.837 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:14:26.837 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.140154.asok status 2023-10-06T11:14:26.986 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:14:26.987 INFO:teuthology.orchestra.run.smithi146.stdout: "metadata": { 2023-10-06T11:14:26.987 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T11:14:26.987 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T11:14:26.987 INFO:teuthology.orchestra.run.smithi146.stdout: "entity_id": "0", 2023-10-06T11:14:26.987 INFO:teuthology.orchestra.run.smithi146.stdout: "hostname": "smithi146", 2023-10-06T11:14:26.987 INFO:teuthology.orchestra.run.smithi146.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T11:14:26.987 INFO:teuthology.orchestra.run.smithi146.stdout: "pid": "140154", 2023-10-06T11:14:26.987 INFO:teuthology.orchestra.run.smithi146.stdout: "root": "/" 2023-10-06T11:14:26.987 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:14:26.987 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_count": 0, 2023-10-06T11:14:26.987 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_pinned_count": 0, 2023-10-06T11:14:26.987 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 8271, 2023-10-06T11:14:26.988 INFO:teuthology.orchestra.run.smithi146.stdout: "inst": { 2023-10-06T11:14:26.988 INFO:teuthology.orchestra.run.smithi146.stdout: "name": { 2023-10-06T11:14:26.988 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "client", 2023-10-06T11:14:26.988 INFO:teuthology.orchestra.run.smithi146.stdout: "num": 8271 2023-10-06T11:14:26.988 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:14:26.988 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-06T11:14:26.988 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-06T11:14:26.988 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:14:26.988 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 928628516 2023-10-06T11:14:26.988 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:14:26.988 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:14:26.988 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-06T11:14:26.989 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-06T11:14:26.989 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:14:26.989 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 928628516 2023-10-06T11:14:26.989 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:14:26.989 INFO:teuthology.orchestra.run.smithi146.stdout: "inst_str": "client.8271 192.168.0.1:0/928628516", 2023-10-06T11:14:26.989 INFO:teuthology.orchestra.run.smithi146.stdout: "addr_str": "192.168.0.1:0/928628516", 2023-10-06T11:14:26.989 INFO:teuthology.orchestra.run.smithi146.stdout: "inode_count": 1, 2023-10-06T11:14:26.989 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_epoch": 100, 2023-10-06T11:14:26.989 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch": 113, 2023-10-06T11:14:26.989 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch_barrier": 0, 2023-10-06T11:14:26.989 INFO:teuthology.orchestra.run.smithi146.stdout: "blocklisted": false, 2023-10-06T11:14:26.989 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs" 2023-10-06T11:14:26.990 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:14:26.996 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:14:26.996 DEBUG:teuthology.orchestra.run.smithi146:> stat --file-system '--printf=%T 2023-10-06T11:14:26.997 DEBUG:teuthology.orchestra.run.smithi146:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T11:14:27.012 INFO:teuthology.orchestra.run.smithi146.stdout:fuseblk 2023-10-06T11:14:27.012 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T11:14:27.012 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:14:27.012 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:14:27.077 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:14:27.077 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:14:27.077 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:14:27.077 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.0 2023-10-06T11:14:27.078 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:14:27.078 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:14:27.078 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:14:27.078 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:14:27.176 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.176 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.176 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0127908 s, 82.0 MB/s 2023-10-06T11:14:27.188 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.188 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.188 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100746 s, 104 MB/s 2023-10-06T11:14:27.204 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.204 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.204 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0125303 s, 83.7 MB/s 2023-10-06T11:14:27.214 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.214 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.214 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00888391 s, 118 MB/s 2023-10-06T11:14:27.228 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.228 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.228 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0114 s, 92.0 MB/s 2023-10-06T11:14:27.242 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.242 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.243 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011916 s, 88.0 MB/s 2023-10-06T11:14:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132164 s, 79.3 MB/s 2023-10-06T11:14:27.273 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.274 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.274 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0126352 s, 83.0 MB/s 2023-10-06T11:14:27.286 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.286 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.286 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106576 s, 98.4 MB/s 2023-10-06T11:14:27.298 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.298 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.298 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00914699 s, 115 MB/s 2023-10-06T11:14:27.311 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.311 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.311 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103573 s, 101 MB/s 2023-10-06T11:14:27.324 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.324 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.324 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103304 s, 102 MB/s 2023-10-06T11:14:27.336 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.336 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.336 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101356 s, 103 MB/s 2023-10-06T11:14:27.349 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.349 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.349 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106687 s, 98.3 MB/s 2023-10-06T11:14:27.361 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.362 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.362 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00981616 s, 107 MB/s 2023-10-06T11:14:27.375 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.375 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.375 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107494 s, 97.5 MB/s 2023-10-06T11:14:27.388 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.388 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.388 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106425 s, 98.5 MB/s 2023-10-06T11:14:27.401 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.401 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.401 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101851 s, 103 MB/s 2023-10-06T11:14:27.413 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.413 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.414 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100802 s, 104 MB/s 2023-10-06T11:14:27.425 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.425 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.425 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00888853 s, 118 MB/s 2023-10-06T11:14:27.438 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.438 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.439 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111167 s, 94.3 MB/s 2023-10-06T11:14:27.451 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.451 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.451 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102623 s, 102 MB/s 2023-10-06T11:14:27.464 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.464 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.464 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104828 s, 100 MB/s 2023-10-06T11:14:27.478 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.478 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.478 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108327 s, 96.8 MB/s 2023-10-06T11:14:27.490 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.490 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.490 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101185 s, 104 MB/s 2023-10-06T11:14:27.503 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.503 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.503 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109376 s, 95.9 MB/s 2023-10-06T11:14:27.516 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.516 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.516 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105146 s, 99.7 MB/s 2023-10-06T11:14:27.529 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.529 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.529 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108462 s, 96.7 MB/s 2023-10-06T11:14:27.542 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.542 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.542 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107869 s, 97.2 MB/s 2023-10-06T11:14:27.555 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.555 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.555 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106193 s, 98.7 MB/s 2023-10-06T11:14:27.568 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.568 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.568 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110433 s, 95.0 MB/s 2023-10-06T11:14:27.580 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.581 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.581 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102566 s, 102 MB/s 2023-10-06T11:14:27.582 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:14:27.582 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:14:27.582 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:14:27.582 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.1 2023-10-06T11:14:27.582 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:14:27.582 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:14:27.582 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:14:27.582 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:14:27.625 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.625 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.625 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104332 s, 101 MB/s 2023-10-06T11:14:27.638 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.638 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.638 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107684 s, 97.4 MB/s 2023-10-06T11:14:27.650 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.650 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.650 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00985917 s, 106 MB/s 2023-10-06T11:14:27.662 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.662 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.662 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00999995 s, 105 MB/s 2023-10-06T11:14:27.674 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.674 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.674 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00942626 s, 111 MB/s 2023-10-06T11:14:27.686 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.686 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.686 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104815 s, 100 MB/s 2023-10-06T11:14:27.697 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.698 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.698 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00896093 s, 117 MB/s 2023-10-06T11:14:27.711 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.711 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.711 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105207 s, 99.7 MB/s 2023-10-06T11:14:27.722 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.723 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.723 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00975929 s, 107 MB/s 2023-10-06T11:14:27.733 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.733 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.734 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00887919 s, 118 MB/s 2023-10-06T11:14:27.746 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.746 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.746 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010083 s, 104 MB/s 2023-10-06T11:14:27.758 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.758 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.758 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100985 s, 104 MB/s 2023-10-06T11:14:27.769 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.769 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.770 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00896324 s, 117 MB/s 2023-10-06T11:14:27.781 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.781 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.781 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00977377 s, 107 MB/s 2023-10-06T11:14:27.794 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.794 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.794 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104497 s, 100 MB/s 2023-10-06T11:14:27.805 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.805 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.805 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00883588 s, 119 MB/s 2023-10-06T11:14:27.816 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.816 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.816 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00882226 s, 119 MB/s 2023-10-06T11:14:27.828 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.828 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.829 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100147 s, 105 MB/s 2023-10-06T11:14:27.840 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.840 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.841 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00970534 s, 108 MB/s 2023-10-06T11:14:27.853 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.853 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.854 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108301 s, 96.8 MB/s 2023-10-06T11:14:27.866 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.866 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.866 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103073 s, 102 MB/s 2023-10-06T11:14:27.877 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.877 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.877 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00888002 s, 118 MB/s 2023-10-06T11:14:27.889 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.889 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.890 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010299 s, 102 MB/s 2023-10-06T11:14:27.901 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.901 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.902 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00968428 s, 108 MB/s 2023-10-06T11:14:27.913 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.913 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.914 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00968088 s, 108 MB/s 2023-10-06T11:14:27.925 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.925 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.925 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00973931 s, 108 MB/s 2023-10-06T11:14:27.937 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.937 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.937 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00952145 s, 110 MB/s 2023-10-06T11:14:27.950 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.950 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.950 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106429 s, 98.5 MB/s 2023-10-06T11:14:27.961 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.962 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.962 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00969456 s, 108 MB/s 2023-10-06T11:14:27.973 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.973 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.973 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954057 s, 110 MB/s 2023-10-06T11:14:27.985 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.985 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.986 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00984996 s, 106 MB/s 2023-10-06T11:14:27.997 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:27.997 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:27.997 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00974425 s, 108 MB/s 2023-10-06T11:14:27.998 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:14:27.998 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:14:27.999 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:14:27.999 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.2 2023-10-06T11:14:27.999 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:14:27.999 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:14:27.999 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:14:27.999 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:14:28.082 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.082 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.082 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109911 s, 95.4 MB/s 2023-10-06T11:14:28.095 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.095 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.095 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107546 s, 97.5 MB/s 2023-10-06T11:14:28.107 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.107 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.107 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00952707 s, 110 MB/s 2023-10-06T11:14:28.119 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.120 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.120 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00984338 s, 107 MB/s 2023-10-06T11:14:28.132 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.132 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.132 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105489 s, 99.4 MB/s 2023-10-06T11:14:28.144 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.144 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.144 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00985772 s, 106 MB/s 2023-10-06T11:14:28.157 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.157 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.157 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112275 s, 93.4 MB/s 2023-10-06T11:14:28.169 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.170 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.170 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00994483 s, 105 MB/s 2023-10-06T11:14:28.181 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.181 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.181 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00880952 s, 119 MB/s 2023-10-06T11:14:28.194 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.194 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.194 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110473 s, 94.9 MB/s 2023-10-06T11:14:28.206 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.206 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.206 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00975171 s, 108 MB/s 2023-10-06T11:14:28.218 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.218 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.218 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00984563 s, 107 MB/s 2023-10-06T11:14:28.229 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.229 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.230 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00913712 s, 115 MB/s 2023-10-06T11:14:28.243 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.243 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.243 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011219 s, 93.5 MB/s 2023-10-06T11:14:28.255 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.255 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.255 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00961162 s, 109 MB/s 2023-10-06T11:14:28.268 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.268 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.268 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108509 s, 96.6 MB/s 2023-10-06T11:14:28.280 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.280 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.280 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00995393 s, 105 MB/s 2023-10-06T11:14:28.292 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.292 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.293 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00992632 s, 106 MB/s 2023-10-06T11:14:28.305 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.305 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.305 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105321 s, 99.6 MB/s 2023-10-06T11:14:28.317 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.318 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.318 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100727 s, 104 MB/s 2023-10-06T11:14:28.329 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.329 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.330 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00953095 s, 110 MB/s 2023-10-06T11:14:28.341 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.341 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.341 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00938704 s, 112 MB/s 2023-10-06T11:14:28.354 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.354 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.354 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105149 s, 99.7 MB/s 2023-10-06T11:14:28.366 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.366 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.366 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954909 s, 110 MB/s 2023-10-06T11:14:28.378 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.378 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.378 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00944208 s, 111 MB/s 2023-10-06T11:14:28.390 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.390 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.391 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00972395 s, 108 MB/s 2023-10-06T11:14:28.402 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.402 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.403 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00969457 s, 108 MB/s 2023-10-06T11:14:28.416 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.416 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.416 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107674 s, 97.4 MB/s 2023-10-06T11:14:28.428 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.428 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.428 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00970576 s, 108 MB/s 2023-10-06T11:14:28.440 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.441 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.441 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00993004 s, 106 MB/s 2023-10-06T11:14:28.454 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.455 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.455 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112478 s, 93.2 MB/s 2023-10-06T11:14:28.469 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.469 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.470 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0122019 s, 85.9 MB/s 2023-10-06T11:14:28.471 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:14:28.471 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:14:28.471 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:14:28.471 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.3 2023-10-06T11:14:28.471 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:14:28.471 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:14:28.471 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:14:28.472 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:14:28.555 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.556 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.556 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110322 s, 95.0 MB/s 2023-10-06T11:14:28.568 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.568 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.568 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105276 s, 99.6 MB/s 2023-10-06T11:14:28.580 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.580 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.580 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00983134 s, 107 MB/s 2023-10-06T11:14:28.592 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.592 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.592 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00973734 s, 108 MB/s 2023-10-06T11:14:28.604 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.604 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.604 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00970731 s, 108 MB/s 2023-10-06T11:14:28.615 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.615 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.616 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00934298 s, 112 MB/s 2023-10-06T11:14:28.628 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.628 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.628 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010132 s, 103 MB/s 2023-10-06T11:14:28.639 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.639 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.639 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00888728 s, 118 MB/s 2023-10-06T11:14:28.651 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.651 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.651 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0098776 s, 106 MB/s 2023-10-06T11:14:28.663 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.663 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.663 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00969409 s, 108 MB/s 2023-10-06T11:14:28.675 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.676 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.676 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103286 s, 102 MB/s 2023-10-06T11:14:28.687 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.687 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.687 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00943244 s, 111 MB/s 2023-10-06T11:14:28.698 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.698 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.698 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00876928 s, 120 MB/s 2023-10-06T11:14:28.709 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.709 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.709 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00889584 s, 118 MB/s 2023-10-06T11:14:28.721 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.721 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.721 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00972928 s, 108 MB/s 2023-10-06T11:14:28.734 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.734 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.734 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103724 s, 101 MB/s 2023-10-06T11:14:28.745 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.745 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.746 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0095958 s, 109 MB/s 2023-10-06T11:14:28.756 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.757 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.757 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00891657 s, 118 MB/s 2023-10-06T11:14:28.768 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.769 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.769 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00970678 s, 108 MB/s 2023-10-06T11:14:28.780 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.780 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.780 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00947736 s, 111 MB/s 2023-10-06T11:14:28.793 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.793 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.793 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106817 s, 98.2 MB/s 2023-10-06T11:14:28.804 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.805 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.805 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00911462 s, 115 MB/s 2023-10-06T11:14:28.818 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.818 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.818 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108512 s, 96.6 MB/s 2023-10-06T11:14:28.829 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.829 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.829 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00894621 s, 117 MB/s 2023-10-06T11:14:28.841 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.841 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.841 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00994903 s, 105 MB/s 2023-10-06T11:14:28.853 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.853 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.853 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00955039 s, 110 MB/s 2023-10-06T11:14:28.865 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.865 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.865 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00973143 s, 108 MB/s 2023-10-06T11:14:28.877 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.877 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.877 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100467 s, 104 MB/s 2023-10-06T11:14:28.888 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.889 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.889 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00905045 s, 116 MB/s 2023-10-06T11:14:28.900 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.901 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.901 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00975233 s, 108 MB/s 2023-10-06T11:14:28.912 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.912 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.912 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00945486 s, 111 MB/s 2023-10-06T11:14:28.924 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.924 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.925 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00982121 s, 107 MB/s 2023-10-06T11:14:28.926 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:14:28.926 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:14:28.926 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:14:28.926 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.4 2023-10-06T11:14:28.926 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:14:28.926 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:14:28.926 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:14:28.926 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:14:28.969 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.969 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.970 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00972952 s, 108 MB/s 2023-10-06T11:14:28.980 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.981 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.981 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00957079 s, 110 MB/s 2023-10-06T11:14:28.993 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:28.993 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:28.993 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103333 s, 101 MB/s 2023-10-06T11:14:29.006 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.006 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.006 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108034 s, 97.1 MB/s 2023-10-06T11:14:29.019 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.019 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.019 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105778 s, 99.1 MB/s 2023-10-06T11:14:29.031 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.031 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.031 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00974117 s, 108 MB/s 2023-10-06T11:14:29.043 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.043 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.043 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104057 s, 101 MB/s 2023-10-06T11:14:29.055 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.056 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.056 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00985902 s, 106 MB/s 2023-10-06T11:14:29.067 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.067 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.067 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00972965 s, 108 MB/s 2023-10-06T11:14:29.079 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.079 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.079 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00983849 s, 107 MB/s 2023-10-06T11:14:29.091 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.091 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.091 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00955739 s, 110 MB/s 2023-10-06T11:14:29.102 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.102 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.102 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00891171 s, 118 MB/s 2023-10-06T11:14:29.114 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.114 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.114 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00946412 s, 111 MB/s 2023-10-06T11:14:29.126 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.126 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.127 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00991441 s, 106 MB/s 2023-10-06T11:14:29.138 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.138 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.138 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00979295 s, 107 MB/s 2023-10-06T11:14:29.150 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.150 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.150 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00980095 s, 107 MB/s 2023-10-06T11:14:29.161 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.162 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.162 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00932203 s, 112 MB/s 2023-10-06T11:14:29.173 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.173 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.173 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00891625 s, 118 MB/s 2023-10-06T11:14:29.183 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.184 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.184 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00915962 s, 114 MB/s 2023-10-06T11:14:29.197 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.197 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.197 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107467 s, 97.6 MB/s 2023-10-06T11:14:29.209 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.209 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.209 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00976029 s, 107 MB/s 2023-10-06T11:14:29.220 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.221 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.221 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00942031 s, 111 MB/s 2023-10-06T11:14:29.232 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.233 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.233 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00961392 s, 109 MB/s 2023-10-06T11:14:29.245 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.245 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.245 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100377 s, 104 MB/s 2023-10-06T11:14:29.257 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.257 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.257 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00984165 s, 107 MB/s 2023-10-06T11:14:29.268 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.269 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.269 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00946479 s, 111 MB/s 2023-10-06T11:14:29.280 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.280 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.280 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00899282 s, 117 MB/s 2023-10-06T11:14:29.291 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.291 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.291 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00918891 s, 114 MB/s 2023-10-06T11:14:29.304 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.304 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.304 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109031 s, 96.2 MB/s 2023-10-06T11:14:29.317 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.317 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.317 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102804 s, 102 MB/s 2023-10-06T11:14:29.330 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.330 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.331 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104235 s, 101 MB/s 2023-10-06T11:14:29.341 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.342 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.342 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00948715 s, 111 MB/s 2023-10-06T11:14:29.343 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:14:29.343 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:14:29.343 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:14:29.343 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.5 2023-10-06T11:14:29.343 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:14:29.344 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:14:29.344 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:14:29.344 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:14:29.426 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.426 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.426 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00971587 s, 108 MB/s 2023-10-06T11:14:29.438 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.438 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.438 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00977235 s, 107 MB/s 2023-10-06T11:14:29.451 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.451 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.451 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105079 s, 99.8 MB/s 2023-10-06T11:14:29.463 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.463 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.463 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00982789 s, 107 MB/s 2023-10-06T11:14:29.476 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.476 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.476 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108974 s, 96.2 MB/s 2023-10-06T11:14:29.488 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.488 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.488 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00989468 s, 106 MB/s 2023-10-06T11:14:29.500 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.500 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.500 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00986789 s, 106 MB/s 2023-10-06T11:14:29.511 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.511 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.511 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00883863 s, 119 MB/s 2023-10-06T11:14:29.523 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.524 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.524 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00998178 s, 105 MB/s 2023-10-06T11:14:29.536 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.536 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.536 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00992324 s, 106 MB/s 2023-10-06T11:14:29.549 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.549 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.549 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104702 s, 100 MB/s 2023-10-06T11:14:29.560 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.561 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.561 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00989722 s, 106 MB/s 2023-10-06T11:14:29.573 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.573 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.573 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104475 s, 100 MB/s 2023-10-06T11:14:29.585 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.585 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.585 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00973029 s, 108 MB/s 2023-10-06T11:14:29.597 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.598 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.598 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100701 s, 104 MB/s 2023-10-06T11:14:29.609 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.609 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.609 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00908776 s, 115 MB/s 2023-10-06T11:14:29.620 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.621 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.621 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954893 s, 110 MB/s 2023-10-06T11:14:29.632 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.633 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.633 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00961384 s, 109 MB/s 2023-10-06T11:14:29.644 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.644 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.645 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00969193 s, 108 MB/s 2023-10-06T11:14:29.656 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.656 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.657 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00995466 s, 105 MB/s 2023-10-06T11:14:29.668 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.669 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.669 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00979981 s, 107 MB/s 2023-10-06T11:14:29.681 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.682 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.682 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00941929 s, 111 MB/s 2023-10-06T11:14:29.693 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.693 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.693 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010501 s, 99.9 MB/s 2023-10-06T11:14:29.704 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.705 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.705 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00960045 s, 109 MB/s 2023-10-06T11:14:29.717 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.717 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.717 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105082 s, 99.8 MB/s 2023-10-06T11:14:29.730 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.730 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.731 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106112 s, 98.8 MB/s 2023-10-06T11:14:29.742 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.743 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.743 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00999379 s, 105 MB/s 2023-10-06T11:14:29.756 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.756 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.756 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105471 s, 99.4 MB/s 2023-10-06T11:14:29.767 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.767 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.767 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00983039 s, 107 MB/s 2023-10-06T11:14:29.778 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.778 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.779 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00912555 s, 115 MB/s 2023-10-06T11:14:29.790 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.790 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.790 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00961729 s, 109 MB/s 2023-10-06T11:14:29.802 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.802 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.802 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00971111 s, 108 MB/s 2023-10-06T11:14:29.803 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:14:29.804 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:14:29.804 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:14:29.804 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.6 2023-10-06T11:14:29.804 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:14:29.804 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:14:29.804 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:14:29.804 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:14:29.886 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.887 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.887 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103307 s, 102 MB/s 2023-10-06T11:14:29.898 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.898 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.898 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00895824 s, 117 MB/s 2023-10-06T11:14:29.910 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.910 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.910 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00974725 s, 108 MB/s 2023-10-06T11:14:29.921 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.921 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.922 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00931506 s, 113 MB/s 2023-10-06T11:14:29.933 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.934 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.934 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0097382 s, 108 MB/s 2023-10-06T11:14:29.945 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.945 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.945 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00958664 s, 109 MB/s 2023-10-06T11:14:29.959 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.960 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.960 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00931728 s, 113 MB/s 2023-10-06T11:14:29.968 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.968 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.968 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00927152 s, 113 MB/s 2023-10-06T11:14:29.981 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.981 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.981 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105235 s, 99.6 MB/s 2023-10-06T11:14:29.993 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:29.993 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:29.993 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103639 s, 101 MB/s 2023-10-06T11:14:30.006 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.006 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.006 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101335 s, 103 MB/s 2023-10-06T11:14:30.017 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.018 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.018 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00938487 s, 112 MB/s 2023-10-06T11:14:30.029 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.029 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.030 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00981899 s, 107 MB/s 2023-10-06T11:14:30.040 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.041 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.041 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00900401 s, 116 MB/s 2023-10-06T11:14:30.051 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.051 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.051 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00838151 s, 125 MB/s 2023-10-06T11:14:30.062 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.063 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.063 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00924812 s, 113 MB/s 2023-10-06T11:14:30.074 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.074 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.074 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00912912 s, 115 MB/s 2023-10-06T11:14:30.085 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.086 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.086 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00936173 s, 112 MB/s 2023-10-06T11:14:30.098 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.098 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.098 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00996635 s, 105 MB/s 2023-10-06T11:14:30.110 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.110 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.110 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00919688 s, 114 MB/s 2023-10-06T11:14:30.121 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.121 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.121 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00940925 s, 111 MB/s 2023-10-06T11:14:30.133 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.134 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.134 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103825 s, 101 MB/s 2023-10-06T11:14:30.146 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.146 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.146 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102612 s, 102 MB/s 2023-10-06T11:14:30.157 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.157 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.157 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00873377 s, 120 MB/s 2023-10-06T11:14:30.168 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.169 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.169 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00920294 s, 114 MB/s 2023-10-06T11:14:30.180 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.180 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.180 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00955067 s, 110 MB/s 2023-10-06T11:14:30.192 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.192 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.193 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00932423 s, 112 MB/s 2023-10-06T11:14:30.203 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.203 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.203 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00875151 s, 120 MB/s 2023-10-06T11:14:30.214 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.214 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.214 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00927075 s, 113 MB/s 2023-10-06T11:14:30.226 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.226 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.227 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00987135 s, 106 MB/s 2023-10-06T11:14:30.238 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.238 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.238 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00926269 s, 113 MB/s 2023-10-06T11:14:30.250 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.250 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.250 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00946693 s, 111 MB/s 2023-10-06T11:14:30.251 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:14:30.251 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:14:30.251 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:14:30.251 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.7 2023-10-06T11:14:30.251 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:14:30.251 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:14:30.251 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:14:30.251 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:14:30.333 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.334 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.334 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00942209 s, 111 MB/s 2023-10-06T11:14:30.346 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.346 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.346 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102145 s, 103 MB/s 2023-10-06T11:14:30.357 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.357 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.357 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00924206 s, 113 MB/s 2023-10-06T11:14:30.369 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.369 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.369 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00914926 s, 115 MB/s 2023-10-06T11:14:30.381 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.381 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.381 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00968045 s, 108 MB/s 2023-10-06T11:14:30.393 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.393 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.393 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104443 s, 100 MB/s 2023-10-06T11:14:30.404 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.405 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.405 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00919461 s, 114 MB/s 2023-10-06T11:14:30.416 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.416 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.416 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00886394 s, 118 MB/s 2023-10-06T11:14:30.427 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.427 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.427 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0090735 s, 116 MB/s 2023-10-06T11:14:30.439 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.439 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.439 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00997595 s, 105 MB/s 2023-10-06T11:14:30.450 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.451 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.451 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0092647 s, 113 MB/s 2023-10-06T11:14:30.462 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.462 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.462 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00943099 s, 111 MB/s 2023-10-06T11:14:30.474 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.474 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.475 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100173 s, 105 MB/s 2023-10-06T11:14:30.487 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.487 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.487 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103273 s, 102 MB/s 2023-10-06T11:14:30.498 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.498 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.498 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00922032 s, 114 MB/s 2023-10-06T11:14:30.510 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.511 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.511 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102055 s, 103 MB/s 2023-10-06T11:14:30.522 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.522 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.522 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00923842 s, 114 MB/s 2023-10-06T11:14:30.533 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.533 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.533 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0084451 s, 124 MB/s 2023-10-06T11:14:30.544 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.545 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.545 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00963284 s, 109 MB/s 2023-10-06T11:14:30.556 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.556 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.556 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00906723 s, 116 MB/s 2023-10-06T11:14:30.569 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.569 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.569 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00865967 s, 121 MB/s 2023-10-06T11:14:30.579 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.579 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.579 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00994184 s, 105 MB/s 2023-10-06T11:14:30.591 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.591 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.591 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100329 s, 105 MB/s 2023-10-06T11:14:30.603 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.603 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.604 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101582 s, 103 MB/s 2023-10-06T11:14:30.615 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.615 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.615 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00908761 s, 115 MB/s 2023-10-06T11:14:30.627 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.627 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.627 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101303 s, 104 MB/s 2023-10-06T11:14:30.639 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.639 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.639 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00913409 s, 115 MB/s 2023-10-06T11:14:30.650 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.650 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.650 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00937977 s, 112 MB/s 2023-10-06T11:14:30.661 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.661 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.661 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0090526 s, 116 MB/s 2023-10-06T11:14:30.674 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.674 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.674 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100245 s, 105 MB/s 2023-10-06T11:14:30.684 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.684 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.684 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00870935 s, 120 MB/s 2023-10-06T11:14:30.697 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.697 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.697 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100968 s, 104 MB/s 2023-10-06T11:14:30.698 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:14:30.698 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:14:30.698 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:14:30.698 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.8 2023-10-06T11:14:30.698 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:14:30.698 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:14:30.699 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:14:30.699 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:14:30.782 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.783 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.783 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101764 s, 103 MB/s 2023-10-06T11:14:30.794 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.794 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.794 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00938746 s, 112 MB/s 2023-10-06T11:14:30.807 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.807 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.807 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010674 s, 98.2 MB/s 2023-10-06T11:14:30.818 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.819 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.819 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00939412 s, 112 MB/s 2023-10-06T11:14:30.830 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.830 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.830 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00930119 s, 113 MB/s 2023-10-06T11:14:30.841 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.841 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.841 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00880738 s, 119 MB/s 2023-10-06T11:14:30.852 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.852 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.853 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00883879 s, 119 MB/s 2023-10-06T11:14:30.864 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.864 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.864 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.009406 s, 111 MB/s 2023-10-06T11:14:30.876 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.876 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.876 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00957302 s, 110 MB/s 2023-10-06T11:14:30.887 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.887 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.887 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00901493 s, 116 MB/s 2023-10-06T11:14:30.900 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.900 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.900 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105831 s, 99.1 MB/s 2023-10-06T11:14:30.912 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.912 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.912 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101515 s, 103 MB/s 2023-10-06T11:14:30.923 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.923 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.923 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00877051 s, 120 MB/s 2023-10-06T11:14:30.936 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.936 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.936 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104112 s, 101 MB/s 2023-10-06T11:14:30.948 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.949 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.949 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102231 s, 103 MB/s 2023-10-06T11:14:30.960 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.960 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.960 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0093246 s, 112 MB/s 2023-10-06T11:14:30.971 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.971 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.971 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0086396 s, 121 MB/s 2023-10-06T11:14:30.985 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.986 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.986 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106717 s, 98.3 MB/s 2023-10-06T11:14:30.996 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:30.996 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:30.996 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00963968 s, 109 MB/s 2023-10-06T11:14:31.007 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.007 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.007 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00932404 s, 112 MB/s 2023-10-06T11:14:31.018 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.018 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.018 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00862047 s, 122 MB/s 2023-10-06T11:14:31.030 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.030 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.030 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00948999 s, 110 MB/s 2023-10-06T11:14:31.041 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.041 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.042 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00921512 s, 114 MB/s 2023-10-06T11:14:31.053 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.053 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.053 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00934955 s, 112 MB/s 2023-10-06T11:14:31.064 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.064 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.065 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00944491 s, 111 MB/s 2023-10-06T11:14:31.077 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.077 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.077 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103742 s, 101 MB/s 2023-10-06T11:14:31.090 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.090 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.090 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101762 s, 103 MB/s 2023-10-06T11:14:31.102 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.102 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.102 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00950386 s, 110 MB/s 2023-10-06T11:14:31.113 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.113 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.113 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00987312 s, 106 MB/s 2023-10-06T11:14:31.125 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.125 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.125 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00952574 s, 110 MB/s 2023-10-06T11:14:31.137 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.137 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.137 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.009675 s, 108 MB/s 2023-10-06T11:14:31.149 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.150 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.150 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00946872 s, 111 MB/s 2023-10-06T11:14:31.151 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:14:31.151 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:14:31.151 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:14:31.151 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.9 2023-10-06T11:14:31.151 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:14:31.151 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:14:31.151 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:14:31.151 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:14:31.233 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.233 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.234 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00997523 s, 105 MB/s 2023-10-06T11:14:31.244 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.245 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.245 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0091239 s, 115 MB/s 2023-10-06T11:14:31.256 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.256 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.256 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00933519 s, 112 MB/s 2023-10-06T11:14:31.267 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.267 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.267 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00855686 s, 123 MB/s 2023-10-06T11:14:31.278 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.278 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.279 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00926727 s, 113 MB/s 2023-10-06T11:14:31.291 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.291 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.291 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101294 s, 104 MB/s 2023-10-06T11:14:31.302 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.302 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.302 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00906814 s, 116 MB/s 2023-10-06T11:14:31.314 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.315 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.315 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100932 s, 104 MB/s 2023-10-06T11:14:31.326 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.326 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.326 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00894017 s, 117 MB/s 2023-10-06T11:14:31.338 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.338 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.338 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00960842 s, 109 MB/s 2023-10-06T11:14:31.350 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.350 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.351 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103212 s, 102 MB/s 2023-10-06T11:14:31.362 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.362 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.363 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00910321 s, 115 MB/s 2023-10-06T11:14:31.374 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.375 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.375 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101349 s, 103 MB/s 2023-10-06T11:14:31.386 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.386 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.386 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00927851 s, 113 MB/s 2023-10-06T11:14:31.398 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.398 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.398 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00895275 s, 117 MB/s 2023-10-06T11:14:31.409 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.410 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.410 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00995036 s, 105 MB/s 2023-10-06T11:14:31.422 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.422 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.422 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00945692 s, 111 MB/s 2023-10-06T11:14:31.433 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.433 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.433 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100384 s, 104 MB/s 2023-10-06T11:14:31.445 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.445 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.445 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100236 s, 105 MB/s 2023-10-06T11:14:31.458 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.458 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.458 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102703 s, 102 MB/s 2023-10-06T11:14:31.470 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.470 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.470 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00963788 s, 109 MB/s 2023-10-06T11:14:31.483 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.483 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.483 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00929814 s, 113 MB/s 2023-10-06T11:14:31.495 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.495 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.495 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102406 s, 102 MB/s 2023-10-06T11:14:31.507 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.507 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.507 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00998207 s, 105 MB/s 2023-10-06T11:14:31.518 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.518 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.518 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00858976 s, 122 MB/s 2023-10-06T11:14:31.530 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.530 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.530 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0094214 s, 111 MB/s 2023-10-06T11:14:31.541 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.541 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.542 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00915442 s, 115 MB/s 2023-10-06T11:14:31.553 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.553 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.553 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00956381 s, 110 MB/s 2023-10-06T11:14:31.563 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.564 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.564 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00871844 s, 120 MB/s 2023-10-06T11:14:31.575 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.575 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.575 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00916876 s, 114 MB/s 2023-10-06T11:14:31.587 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.587 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.587 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00941411 s, 111 MB/s 2023-10-06T11:14:31.599 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.599 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.599 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00917718 s, 114 MB/s 2023-10-06T11:14:31.600 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:14:31.600 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:14:31.600 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:14:31.600 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.10 2023-10-06T11:14:31.600 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:14:31.600 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:14:31.600 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:14:31.600 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:14:31.683 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.683 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.683 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104308 s, 101 MB/s 2023-10-06T11:14:31.693 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.693 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.693 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00840535 s, 125 MB/s 2023-10-06T11:14:31.705 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.705 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.705 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00942424 s, 111 MB/s 2023-10-06T11:14:31.716 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.717 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.717 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00933701 s, 112 MB/s 2023-10-06T11:14:31.727 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.728 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.728 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00895611 s, 117 MB/s 2023-10-06T11:14:31.739 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.739 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.739 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00862401 s, 122 MB/s 2023-10-06T11:14:31.752 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.752 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.752 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104767 s, 100 MB/s 2023-10-06T11:14:31.764 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.764 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.764 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103172 s, 102 MB/s 2023-10-06T11:14:31.776 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.776 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.776 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00964593 s, 109 MB/s 2023-10-06T11:14:31.787 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.787 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.787 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00886517 s, 118 MB/s 2023-10-06T11:14:31.798 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.798 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.798 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00874557 s, 120 MB/s 2023-10-06T11:14:31.810 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.810 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.810 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00940253 s, 112 MB/s 2023-10-06T11:14:31.821 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.821 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.821 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00927251 s, 113 MB/s 2023-10-06T11:14:31.834 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.834 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.834 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103815 s, 101 MB/s 2023-10-06T11:14:31.846 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.847 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.847 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100937 s, 104 MB/s 2023-10-06T11:14:31.858 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.858 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.859 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00959889 s, 109 MB/s 2023-10-06T11:14:31.869 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.869 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.869 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.008741 s, 120 MB/s 2023-10-06T11:14:31.881 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.881 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.881 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00952512 s, 110 MB/s 2023-10-06T11:14:31.893 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.893 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.893 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100963 s, 104 MB/s 2023-10-06T11:14:31.905 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.905 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.905 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00944536 s, 111 MB/s 2023-10-06T11:14:31.916 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.916 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.916 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00949876 s, 110 MB/s 2023-10-06T11:14:31.929 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.929 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.929 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100156 s, 105 MB/s 2023-10-06T11:14:31.941 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.941 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.941 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104014 s, 101 MB/s 2023-10-06T11:14:31.953 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.953 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.953 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00941007 s, 111 MB/s 2023-10-06T11:14:31.966 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.966 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.966 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010483 s, 100 MB/s 2023-10-06T11:14:31.977 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.977 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.977 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0093617 s, 112 MB/s 2023-10-06T11:14:31.989 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:31.989 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:31.989 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00948001 s, 111 MB/s 2023-10-06T11:14:32.001 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.001 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.001 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954216 s, 110 MB/s 2023-10-06T11:14:32.012 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.012 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.013 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00933862 s, 112 MB/s 2023-10-06T11:14:32.025 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.025 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.025 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00997357 s, 105 MB/s 2023-10-06T11:14:32.036 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.036 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.036 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00925707 s, 113 MB/s 2023-10-06T11:14:32.048 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.049 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.049 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102147 s, 103 MB/s 2023-10-06T11:14:32.050 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:14:32.050 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:14:32.050 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:14:32.050 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.11 2023-10-06T11:14:32.050 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:14:32.050 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:14:32.050 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:14:32.050 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:14:32.133 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.133 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.133 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954418 s, 110 MB/s 2023-10-06T11:14:32.144 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.144 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.144 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00893111 s, 117 MB/s 2023-10-06T11:14:32.155 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.156 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.156 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00931144 s, 113 MB/s 2023-10-06T11:14:32.167 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.168 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.168 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01001 s, 105 MB/s 2023-10-06T11:14:32.180 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.180 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.180 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00984602 s, 106 MB/s 2023-10-06T11:14:32.191 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.192 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.192 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00946948 s, 111 MB/s 2023-10-06T11:14:32.203 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.203 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.204 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00946971 s, 111 MB/s 2023-10-06T11:14:32.215 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.215 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.215 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00919813 s, 114 MB/s 2023-10-06T11:14:32.227 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.227 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.227 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00957806 s, 109 MB/s 2023-10-06T11:14:32.239 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.239 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.239 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00942389 s, 111 MB/s 2023-10-06T11:14:32.250 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.250 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.250 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00849562 s, 123 MB/s 2023-10-06T11:14:32.262 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.263 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.263 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0099815 s, 105 MB/s 2023-10-06T11:14:32.274 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.274 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.274 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00903298 s, 116 MB/s 2023-10-06T11:14:32.286 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.286 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.286 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00939765 s, 112 MB/s 2023-10-06T11:14:32.298 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.298 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.298 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00922729 s, 114 MB/s 2023-10-06T11:14:32.310 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.310 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.310 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00926616 s, 113 MB/s 2023-10-06T11:14:32.322 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.323 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.323 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102562 s, 102 MB/s 2023-10-06T11:14:32.334 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.334 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.335 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0094036 s, 112 MB/s 2023-10-06T11:14:32.346 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.346 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.346 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00914148 s, 115 MB/s 2023-10-06T11:14:32.358 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.358 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.358 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00948922 s, 111 MB/s 2023-10-06T11:14:32.370 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.370 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.370 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00905832 s, 116 MB/s 2023-10-06T11:14:32.382 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.382 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.382 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00950355 s, 110 MB/s 2023-10-06T11:14:32.394 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.394 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.394 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00936517 s, 112 MB/s 2023-10-06T11:14:32.405 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.406 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.406 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00926945 s, 113 MB/s 2023-10-06T11:14:32.418 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.418 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.418 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00975682 s, 107 MB/s 2023-10-06T11:14:32.434 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.435 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.435 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138977 s, 75.4 MB/s 2023-10-06T11:14:32.446 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.446 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.446 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00901623 s, 116 MB/s 2023-10-06T11:14:32.458 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.459 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.459 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100803 s, 104 MB/s 2023-10-06T11:14:32.471 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.471 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.471 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100986 s, 104 MB/s 2023-10-06T11:14:32.490 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.490 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.491 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00870254 s, 120 MB/s 2023-10-06T11:14:32.503 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.503 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.503 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102579 s, 102 MB/s 2023-10-06T11:14:32.515 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.515 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.515 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100406 s, 104 MB/s 2023-10-06T11:14:32.516 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:14:32.516 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:14:32.516 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:14:32.517 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.12 2023-10-06T11:14:32.517 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:14:32.517 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:14:32.517 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:14:32.517 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:14:32.598 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.598 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.599 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00923762 s, 114 MB/s 2023-10-06T11:14:32.610 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.610 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.610 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00932509 s, 112 MB/s 2023-10-06T11:14:32.623 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.623 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.623 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100143 s, 105 MB/s 2023-10-06T11:14:32.634 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.634 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.634 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0086603 s, 121 MB/s 2023-10-06T11:14:32.646 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.646 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.646 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00963296 s, 109 MB/s 2023-10-06T11:14:32.658 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.658 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.658 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00953923 s, 110 MB/s 2023-10-06T11:14:32.670 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.670 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.670 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00924715 s, 113 MB/s 2023-10-06T11:14:32.681 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.681 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.681 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00839225 s, 125 MB/s 2023-10-06T11:14:32.692 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.692 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.692 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00866524 s, 121 MB/s 2023-10-06T11:14:32.704 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.704 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.704 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00939173 s, 112 MB/s 2023-10-06T11:14:32.716 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.717 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.717 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010237 s, 102 MB/s 2023-10-06T11:14:32.729 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.729 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.729 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101948 s, 103 MB/s 2023-10-06T11:14:32.743 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.743 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.743 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107078 s, 97.9 MB/s 2023-10-06T11:14:32.754 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.754 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.755 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00917539 s, 114 MB/s 2023-10-06T11:14:32.766 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.766 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.766 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.009165 s, 114 MB/s 2023-10-06T11:14:32.778 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.778 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.778 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00934237 s, 112 MB/s 2023-10-06T11:14:32.789 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.789 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.789 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00860886 s, 122 MB/s 2023-10-06T11:14:32.801 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.801 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.801 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00940516 s, 111 MB/s 2023-10-06T11:14:32.812 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.812 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.812 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00903887 s, 116 MB/s 2023-10-06T11:14:32.826 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.826 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.826 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00991684 s, 106 MB/s 2023-10-06T11:14:32.837 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.837 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.837 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0093003 s, 113 MB/s 2023-10-06T11:14:32.848 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.848 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.848 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00869643 s, 121 MB/s 2023-10-06T11:14:32.860 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.860 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.860 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00968078 s, 108 MB/s 2023-10-06T11:14:32.872 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.872 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.872 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00961028 s, 109 MB/s 2023-10-06T11:14:32.884 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.884 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.884 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00919007 s, 114 MB/s 2023-10-06T11:14:32.895 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.895 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.895 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0086645 s, 121 MB/s 2023-10-06T11:14:32.907 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.907 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.907 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00935537 s, 112 MB/s 2023-10-06T11:14:32.920 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.920 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.920 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00962326 s, 109 MB/s 2023-10-06T11:14:32.930 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.930 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.930 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00860313 s, 122 MB/s 2023-10-06T11:14:32.942 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.942 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.942 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00925089 s, 113 MB/s 2023-10-06T11:14:32.953 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.954 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.954 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00908244 s, 115 MB/s 2023-10-06T11:14:32.965 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:32.965 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:32.965 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0091461 s, 115 MB/s 2023-10-06T11:14:32.966 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:14:32.966 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:14:32.966 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:14:32.966 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.13 2023-10-06T11:14:32.967 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:14:32.967 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:14:32.967 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:14:32.967 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:14:33.050 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.050 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.050 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00998834 s, 105 MB/s 2023-10-06T11:14:33.060 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.060 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.060 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00832804 s, 126 MB/s 2023-10-06T11:14:33.072 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.072 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.073 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00946658 s, 111 MB/s 2023-10-06T11:14:33.084 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.084 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.084 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00922097 s, 114 MB/s 2023-10-06T11:14:33.096 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.096 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.096 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100166 s, 105 MB/s 2023-10-06T11:14:33.107 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.108 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.108 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00868728 s, 121 MB/s 2023-10-06T11:14:33.120 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.120 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.120 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00972021 s, 108 MB/s 2023-10-06T11:14:33.132 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.132 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.132 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00937661 s, 112 MB/s 2023-10-06T11:14:33.142 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.143 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.143 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0085198 s, 123 MB/s 2023-10-06T11:14:33.154 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.155 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.155 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00925081 s, 113 MB/s 2023-10-06T11:14:33.165 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.166 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.166 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00877594 s, 119 MB/s 2023-10-06T11:14:33.177 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.178 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.178 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0093961 s, 112 MB/s 2023-10-06T11:14:33.189 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.189 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.190 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00927351 s, 113 MB/s 2023-10-06T11:14:33.201 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.201 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.201 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00950287 s, 110 MB/s 2023-10-06T11:14:33.213 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.213 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.213 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00921297 s, 114 MB/s 2023-10-06T11:14:33.224 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.225 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.225 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00921363 s, 114 MB/s 2023-10-06T11:14:33.236 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.236 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.237 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00928255 s, 113 MB/s 2023-10-06T11:14:33.248 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.248 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.248 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00917431 s, 114 MB/s 2023-10-06T11:14:33.260 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.260 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.260 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00965671 s, 109 MB/s 2023-10-06T11:14:33.271 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.271 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.271 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00844837 s, 124 MB/s 2023-10-06T11:14:33.283 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.283 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.283 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00929278 s, 113 MB/s 2023-10-06T11:14:33.296 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.296 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.296 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102565 s, 102 MB/s 2023-10-06T11:14:33.307 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.308 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.308 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00920274 s, 114 MB/s 2023-10-06T11:14:33.319 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.319 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.320 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00918906 s, 114 MB/s 2023-10-06T11:14:33.331 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.331 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.331 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00913689 s, 115 MB/s 2023-10-06T11:14:33.343 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.343 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.343 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0093537 s, 112 MB/s 2023-10-06T11:14:33.354 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.354 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.354 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0086541 s, 121 MB/s 2023-10-06T11:14:33.367 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.367 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.367 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010007 s, 105 MB/s 2023-10-06T11:14:33.380 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.380 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.380 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102838 s, 102 MB/s 2023-10-06T11:14:33.392 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.392 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.393 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102589 s, 102 MB/s 2023-10-06T11:14:33.404 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.404 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.404 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0091602 s, 114 MB/s 2023-10-06T11:14:33.417 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.417 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.417 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101868 s, 103 MB/s 2023-10-06T11:14:33.418 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:14:33.418 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:14:33.418 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:14:33.418 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.14 2023-10-06T11:14:33.418 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:14:33.419 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:14:33.419 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:14:33.419 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:14:33.597 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.598 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.598 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0093952 s, 112 MB/s 2023-10-06T11:14:33.609 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.609 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.609 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0094666 s, 111 MB/s 2023-10-06T11:14:33.621 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.621 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.621 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00951211 s, 110 MB/s 2023-10-06T11:14:33.632 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.632 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.632 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00914931 s, 115 MB/s 2023-10-06T11:14:33.645 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.645 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.645 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103422 s, 101 MB/s 2023-10-06T11:14:33.657 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.657 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.657 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00910335 s, 115 MB/s 2023-10-06T11:14:33.667 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.667 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.667 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00879125 s, 119 MB/s 2023-10-06T11:14:33.679 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.680 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.680 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00962053 s, 109 MB/s 2023-10-06T11:14:33.690 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.690 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.690 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00905411 s, 116 MB/s 2023-10-06T11:14:33.702 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.702 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.702 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00997174 s, 105 MB/s 2023-10-06T11:14:33.714 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.714 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.714 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100316 s, 105 MB/s 2023-10-06T11:14:33.726 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.726 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.726 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00911796 s, 115 MB/s 2023-10-06T11:14:33.738 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.738 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.738 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010126 s, 104 MB/s 2023-10-06T11:14:33.749 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.750 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.750 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00923826 s, 114 MB/s 2023-10-06T11:14:33.761 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.761 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.761 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100848 s, 104 MB/s 2023-10-06T11:14:33.773 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.773 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.773 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00926169 s, 113 MB/s 2023-10-06T11:14:33.784 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.784 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.784 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00907919 s, 115 MB/s 2023-10-06T11:14:33.795 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.795 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.795 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00856416 s, 122 MB/s 2023-10-06T11:14:33.806 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.806 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.806 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00895959 s, 117 MB/s 2023-10-06T11:14:33.818 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.818 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.818 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00952167 s, 110 MB/s 2023-10-06T11:14:33.830 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.830 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.830 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00988018 s, 106 MB/s 2023-10-06T11:14:33.841 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.842 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.842 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00947111 s, 111 MB/s 2023-10-06T11:14:33.854 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.854 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.854 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103254 s, 102 MB/s 2023-10-06T11:14:33.867 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.867 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.867 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104157 s, 101 MB/s 2023-10-06T11:14:33.878 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.878 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.878 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00906192 s, 116 MB/s 2023-10-06T11:14:33.889 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.889 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.889 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00867815 s, 121 MB/s 2023-10-06T11:14:33.900 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.901 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.901 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00916735 s, 114 MB/s 2023-10-06T11:14:33.913 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.913 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.913 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00997894 s, 105 MB/s 2023-10-06T11:14:33.924 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.924 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.924 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00908385 s, 115 MB/s 2023-10-06T11:14:33.935 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.935 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.935 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00859068 s, 122 MB/s 2023-10-06T11:14:33.947 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.947 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.947 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100737 s, 104 MB/s 2023-10-06T11:14:33.959 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:33.959 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:33.959 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00850817 s, 123 MB/s 2023-10-06T11:14:33.960 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:14:33.960 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:14:33.960 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:14:33.960 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.15 2023-10-06T11:14:33.960 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:14:33.960 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:14:33.960 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:14:33.961 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:14:34.003 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.003 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.003 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0095103 s, 110 MB/s 2023-10-06T11:14:34.014 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.014 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.014 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00935956 s, 112 MB/s 2023-10-06T11:14:34.026 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.026 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.026 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00923706 s, 114 MB/s 2023-10-06T11:14:34.038 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.038 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.039 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103758 s, 101 MB/s 2023-10-06T11:14:34.050 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.050 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.051 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00994141 s, 105 MB/s 2023-10-06T11:14:34.062 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.062 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.063 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00949358 s, 110 MB/s 2023-10-06T11:14:34.074 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.074 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.074 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00940529 s, 111 MB/s 2023-10-06T11:14:34.085 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.085 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.085 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00914059 s, 115 MB/s 2023-10-06T11:14:34.096 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.097 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.097 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00948729 s, 111 MB/s 2023-10-06T11:14:34.108 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.108 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.108 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00908612 s, 115 MB/s 2023-10-06T11:14:34.120 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.120 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.120 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101162 s, 104 MB/s 2023-10-06T11:14:34.131 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.132 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.132 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00910447 s, 115 MB/s 2023-10-06T11:14:34.142 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.142 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.142 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00841156 s, 125 MB/s 2023-10-06T11:14:34.154 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.154 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.154 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00935429 s, 112 MB/s 2023-10-06T11:14:34.166 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.166 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.166 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100295 s, 105 MB/s 2023-10-06T11:14:34.178 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.178 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.178 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100704 s, 104 MB/s 2023-10-06T11:14:34.190 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.190 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.190 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00929859 s, 113 MB/s 2023-10-06T11:14:34.201 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.201 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.201 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0090714 s, 116 MB/s 2023-10-06T11:14:34.213 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.214 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.214 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103167 s, 102 MB/s 2023-10-06T11:14:34.226 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.226 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.226 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101301 s, 104 MB/s 2023-10-06T11:14:34.238 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.238 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.238 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00956318 s, 110 MB/s 2023-10-06T11:14:34.249 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.249 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.249 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0091577 s, 115 MB/s 2023-10-06T11:14:34.260 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.261 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.261 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00905439 s, 116 MB/s 2023-10-06T11:14:34.271 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.271 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.272 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00856991 s, 122 MB/s 2023-10-06T11:14:34.283 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.283 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.283 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00942005 s, 111 MB/s 2023-10-06T11:14:34.296 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.296 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.296 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104124 s, 101 MB/s 2023-10-06T11:14:34.308 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.308 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.308 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100095 s, 105 MB/s 2023-10-06T11:14:34.319 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.319 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.320 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00921552 s, 114 MB/s 2023-10-06T11:14:34.331 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.331 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.331 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00931102 s, 113 MB/s 2023-10-06T11:14:34.341 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.342 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.342 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00860109 s, 122 MB/s 2023-10-06T11:14:34.353 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.353 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.353 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00864252 s, 121 MB/s 2023-10-06T11:14:34.365 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.365 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.365 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103106 s, 102 MB/s 2023-10-06T11:14:34.366 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:14:34.367 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:14:34.367 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:14:34.367 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.16 2023-10-06T11:14:34.367 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:14:34.367 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:14:34.367 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:14:34.367 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:14:34.450 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.450 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.450 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00956817 s, 110 MB/s 2023-10-06T11:14:34.465 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.466 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.466 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00934285 s, 112 MB/s 2023-10-06T11:14:34.472 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.472 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.472 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00872447 s, 120 MB/s 2023-10-06T11:14:34.492 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.492 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.493 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0177898 s, 58.9 MB/s 2023-10-06T11:14:34.519 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.520 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.520 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00988126 s, 106 MB/s 2023-10-06T11:14:34.531 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.531 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.531 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00895674 s, 117 MB/s 2023-10-06T11:14:34.542 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.542 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.542 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00885144 s, 118 MB/s 2023-10-06T11:14:34.554 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.554 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.554 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00980638 s, 107 MB/s 2023-10-06T11:14:34.565 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.565 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.565 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00939281 s, 112 MB/s 2023-10-06T11:14:34.576 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.577 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.577 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0088372 s, 119 MB/s 2023-10-06T11:14:34.588 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.588 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.588 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0094996 s, 110 MB/s 2023-10-06T11:14:34.601 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.601 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.601 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104602 s, 100 MB/s 2023-10-06T11:14:34.612 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.612 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.612 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.009146 s, 115 MB/s 2023-10-06T11:14:34.625 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.625 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.625 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102239 s, 103 MB/s 2023-10-06T11:14:34.637 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.637 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.637 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102642 s, 102 MB/s 2023-10-06T11:14:34.649 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.649 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.649 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100112 s, 105 MB/s 2023-10-06T11:14:34.660 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.661 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.661 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00897187 s, 117 MB/s 2023-10-06T11:14:34.672 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.674 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.674 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00915666 s, 115 MB/s 2023-10-06T11:14:34.682 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.683 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.683 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0085696 s, 122 MB/s 2023-10-06T11:14:34.694 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.694 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.694 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00926485 s, 113 MB/s 2023-10-06T11:14:34.705 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.706 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.706 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00939634 s, 112 MB/s 2023-10-06T11:14:34.718 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.718 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.718 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00989137 s, 106 MB/s 2023-10-06T11:14:34.728 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.728 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.728 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00844143 s, 124 MB/s 2023-10-06T11:14:34.740 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.740 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.740 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00935028 s, 112 MB/s 2023-10-06T11:14:34.752 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.752 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.752 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00998248 s, 105 MB/s 2023-10-06T11:14:34.763 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.764 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.764 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00913028 s, 115 MB/s 2023-10-06T11:14:34.775 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.775 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.776 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0098752 s, 106 MB/s 2023-10-06T11:14:34.786 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.786 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.786 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0084557 s, 124 MB/s 2023-10-06T11:14:34.798 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.798 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.798 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100535 s, 104 MB/s 2023-10-06T11:14:34.809 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.809 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.809 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00848849 s, 124 MB/s 2023-10-06T11:14:34.820 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.820 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.820 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0092087 s, 114 MB/s 2023-10-06T11:14:34.832 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.832 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.832 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00960561 s, 109 MB/s 2023-10-06T11:14:34.833 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:14:34.833 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:14:34.833 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:14:34.833 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.17 2023-10-06T11:14:34.834 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:14:34.834 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:14:34.834 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:14:34.834 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:14:34.915 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.915 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.915 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00917457 s, 114 MB/s 2023-10-06T11:14:34.926 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.926 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.927 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00894779 s, 117 MB/s 2023-10-06T11:14:34.937 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.937 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.937 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00851138 s, 123 MB/s 2023-10-06T11:14:34.949 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.949 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.950 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00997117 s, 105 MB/s 2023-10-06T11:14:34.960 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.961 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.961 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00927694 s, 113 MB/s 2023-10-06T11:14:34.972 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.972 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.972 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00910126 s, 115 MB/s 2023-10-06T11:14:34.983 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.983 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.983 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00858453 s, 122 MB/s 2023-10-06T11:14:34.994 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:34.994 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:34.995 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00929082 s, 113 MB/s 2023-10-06T11:14:35.006 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.006 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.007 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00995355 s, 105 MB/s 2023-10-06T11:14:35.018 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.018 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.018 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00937091 s, 112 MB/s 2023-10-06T11:14:35.034 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.034 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.034 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141778 s, 74.0 MB/s 2023-10-06T11:14:35.045 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.046 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.046 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00901351 s, 116 MB/s 2023-10-06T11:14:35.057 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.057 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.057 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954044 s, 110 MB/s 2023-10-06T11:14:35.068 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.069 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.069 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00946612 s, 111 MB/s 2023-10-06T11:14:35.080 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.080 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.080 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00925368 s, 113 MB/s 2023-10-06T11:14:35.092 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.092 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.092 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00960461 s, 109 MB/s 2023-10-06T11:14:35.103 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.104 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.104 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00937176 s, 112 MB/s 2023-10-06T11:14:35.115 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.115 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.115 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00889543 s, 118 MB/s 2023-10-06T11:14:35.126 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.126 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.126 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00875519 s, 120 MB/s 2023-10-06T11:14:35.138 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.138 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.138 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00966097 s, 109 MB/s 2023-10-06T11:14:35.150 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.150 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.150 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100748 s, 104 MB/s 2023-10-06T11:14:35.161 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.161 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.161 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00867096 s, 121 MB/s 2023-10-06T11:14:35.173 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.173 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.173 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101643 s, 103 MB/s 2023-10-06T11:14:35.185 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.185 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.185 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00941125 s, 111 MB/s 2023-10-06T11:14:35.197 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.197 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.197 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00967548 s, 108 MB/s 2023-10-06T11:14:35.209 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.209 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.209 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101304 s, 104 MB/s 2023-10-06T11:14:35.221 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.221 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.221 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00932741 s, 112 MB/s 2023-10-06T11:14:35.233 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.233 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.233 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00958526 s, 109 MB/s 2023-10-06T11:14:35.245 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.245 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.245 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102782 s, 102 MB/s 2023-10-06T11:14:35.256 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.257 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.257 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00910463 s, 115 MB/s 2023-10-06T11:14:35.268 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.268 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.268 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00959033 s, 109 MB/s 2023-10-06T11:14:35.280 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.281 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.281 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00969468 s, 108 MB/s 2023-10-06T11:14:35.281 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:14:35.281 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:14:35.281 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:14:35.281 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.18 2023-10-06T11:14:35.282 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:14:35.282 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:14:35.282 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:14:35.282 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:14:35.364 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.364 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.364 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101951 s, 103 MB/s 2023-10-06T11:14:35.375 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.376 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.376 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0093403 s, 112 MB/s 2023-10-06T11:14:35.387 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.388 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.388 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00949909 s, 110 MB/s 2023-10-06T11:14:35.398 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.398 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.398 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00876052 s, 120 MB/s 2023-10-06T11:14:35.411 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.411 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.411 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104982 s, 99.9 MB/s 2023-10-06T11:14:35.422 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.422 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.423 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0093217 s, 112 MB/s 2023-10-06T11:14:35.435 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.435 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.435 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104318 s, 101 MB/s 2023-10-06T11:14:35.447 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.447 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.447 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00945598 s, 111 MB/s 2023-10-06T11:14:35.458 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.458 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.458 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00884 s, 119 MB/s 2023-10-06T11:14:35.469 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.469 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.469 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00938988 s, 112 MB/s 2023-10-06T11:14:35.482 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.482 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.482 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103517 s, 101 MB/s 2023-10-06T11:14:35.496 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.496 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.496 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111884 s, 93.7 MB/s 2023-10-06T11:14:35.530 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.531 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.531 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101133 s, 104 MB/s 2023-10-06T11:14:35.542 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.542 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.542 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00920206 s, 114 MB/s 2023-10-06T11:14:35.553 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.553 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.553 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00867861 s, 121 MB/s 2023-10-06T11:14:35.564 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.564 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.564 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00919868 s, 114 MB/s 2023-10-06T11:14:35.577 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.577 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.577 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010751 s, 97.5 MB/s 2023-10-06T11:14:35.589 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.589 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.589 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00916735 s, 114 MB/s 2023-10-06T11:14:35.599 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.599 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.600 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00872386 s, 120 MB/s 2023-10-06T11:14:35.611 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.611 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.611 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00937114 s, 112 MB/s 2023-10-06T11:14:35.622 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.623 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.623 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00909969 s, 115 MB/s 2023-10-06T11:14:35.634 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.635 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.635 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00997415 s, 105 MB/s 2023-10-06T11:14:35.646 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.646 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.646 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00934717 s, 112 MB/s 2023-10-06T11:14:35.657 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.657 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.657 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00856541 s, 122 MB/s 2023-10-06T11:14:35.669 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.669 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.669 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00945609 s, 111 MB/s 2023-10-06T11:14:35.681 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.681 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.681 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010196 s, 103 MB/s 2023-10-06T11:14:35.693 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.693 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.693 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00924157 s, 113 MB/s 2023-10-06T11:14:35.704 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.704 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.704 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00942844 s, 111 MB/s 2023-10-06T11:14:35.716 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.716 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.716 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00912301 s, 115 MB/s 2023-10-06T11:14:35.728 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.728 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.728 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101318 s, 103 MB/s 2023-10-06T11:14:35.740 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.740 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.740 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00937418 s, 112 MB/s 2023-10-06T11:14:35.750 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.750 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.751 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00859787 s, 122 MB/s 2023-10-06T11:14:35.751 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:14:35.752 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:14:35.752 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:14:35.752 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.19 2023-10-06T11:14:35.752 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:14:35.752 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:14:35.752 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:14:35.752 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:14:35.834 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.834 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.835 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101821 s, 103 MB/s 2023-10-06T11:14:35.845 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.846 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.846 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00908988 s, 115 MB/s 2023-10-06T11:14:35.857 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.857 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.857 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00947676 s, 111 MB/s 2023-10-06T11:14:35.870 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.870 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.870 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103845 s, 101 MB/s 2023-10-06T11:14:35.881 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.881 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.881 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00868328 s, 121 MB/s 2023-10-06T11:14:35.893 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.894 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.894 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103515 s, 101 MB/s 2023-10-06T11:14:35.905 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.906 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.906 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102254 s, 103 MB/s 2023-10-06T11:14:35.918 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.919 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.919 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100341 s, 105 MB/s 2023-10-06T11:14:35.929 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.929 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.929 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00871424 s, 120 MB/s 2023-10-06T11:14:35.940 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.941 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.941 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00927501 s, 113 MB/s 2023-10-06T11:14:35.952 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.952 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.952 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00944248 s, 111 MB/s 2023-10-06T11:14:35.964 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.964 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.965 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101685 s, 103 MB/s 2023-10-06T11:14:35.976 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.976 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.976 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00933013 s, 112 MB/s 2023-10-06T11:14:35.988 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:35.988 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:35.988 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00949037 s, 110 MB/s 2023-10-06T11:14:36.000 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.000 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.000 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102575 s, 102 MB/s 2023-10-06T11:14:36.012 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.012 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.012 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.009493 s, 110 MB/s 2023-10-06T11:14:36.024 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.024 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.024 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00978503 s, 107 MB/s 2023-10-06T11:14:36.037 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.037 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.037 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101197 s, 104 MB/s 2023-10-06T11:14:36.047 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.047 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.047 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0089122 s, 118 MB/s 2023-10-06T11:14:36.059 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.059 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.059 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954007 s, 110 MB/s 2023-10-06T11:14:36.070 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.070 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.070 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00850288 s, 123 MB/s 2023-10-06T11:14:36.082 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.082 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.082 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00962664 s, 109 MB/s 2023-10-06T11:14:36.093 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.094 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.094 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00952634 s, 110 MB/s 2023-10-06T11:14:36.105 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.105 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.105 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00931355 s, 113 MB/s 2023-10-06T11:14:36.117 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.118 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.118 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102051 s, 103 MB/s 2023-10-06T11:14:36.128 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.128 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.128 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00859682 s, 122 MB/s 2023-10-06T11:14:36.140 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.140 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.140 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00922917 s, 114 MB/s 2023-10-06T11:14:36.151 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.151 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.151 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00927152 s, 113 MB/s 2023-10-06T11:14:36.163 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.163 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.163 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0093294 s, 112 MB/s 2023-10-06T11:14:36.174 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.174 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.174 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00927249 s, 113 MB/s 2023-10-06T11:14:36.185 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.186 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.186 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00916786 s, 114 MB/s 2023-10-06T11:14:36.197 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.197 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.197 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00920094 s, 114 MB/s 2023-10-06T11:14:36.198 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:14:36.198 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:14:36.198 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:14:36.198 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.20 2023-10-06T11:14:36.198 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:14:36.198 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:14:36.199 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:14:36.199 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:14:36.281 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.281 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.281 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00949065 s, 110 MB/s 2023-10-06T11:14:36.293 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.293 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.293 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010182 s, 103 MB/s 2023-10-06T11:14:36.305 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.305 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.305 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00952053 s, 110 MB/s 2023-10-06T11:14:36.316 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.316 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.316 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00908436 s, 115 MB/s 2023-10-06T11:14:36.329 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.330 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.330 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100691 s, 104 MB/s 2023-10-06T11:14:36.340 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.340 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.340 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00926482 s, 113 MB/s 2023-10-06T11:14:36.351 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.352 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.352 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954985 s, 110 MB/s 2023-10-06T11:14:36.363 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.363 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.363 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00921074 s, 114 MB/s 2023-10-06T11:14:36.374 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.375 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.375 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00943861 s, 111 MB/s 2023-10-06T11:14:36.387 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.387 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.387 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100947 s, 104 MB/s 2023-10-06T11:14:36.398 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.398 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.398 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0085752 s, 122 MB/s 2023-10-06T11:14:36.409 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.409 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.409 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0087536 s, 120 MB/s 2023-10-06T11:14:36.420 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.420 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.420 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0091664 s, 114 MB/s 2023-10-06T11:14:36.432 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.432 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.432 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00953235 s, 110 MB/s 2023-10-06T11:14:36.444 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.444 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.444 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0094573 s, 111 MB/s 2023-10-06T11:14:36.456 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.456 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.456 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100728 s, 104 MB/s 2023-10-06T11:14:36.467 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.468 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.468 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0093146 s, 113 MB/s 2023-10-06T11:14:36.480 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.480 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.480 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00987737 s, 106 MB/s 2023-10-06T11:14:36.491 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.491 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.491 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00892392 s, 118 MB/s 2023-10-06T11:14:36.530 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.530 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.530 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00956446 s, 110 MB/s 2023-10-06T11:14:36.542 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.543 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.543 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100837 s, 104 MB/s 2023-10-06T11:14:36.554 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.555 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.555 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00958448 s, 109 MB/s 2023-10-06T11:14:36.566 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.567 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.567 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100466 s, 104 MB/s 2023-10-06T11:14:36.578 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.579 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.579 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00962476 s, 109 MB/s 2023-10-06T11:14:36.591 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.591 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.591 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101956 s, 103 MB/s 2023-10-06T11:14:36.603 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.603 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.603 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00926138 s, 113 MB/s 2023-10-06T11:14:36.614 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.614 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.614 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00878617 s, 119 MB/s 2023-10-06T11:14:36.625 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.626 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.626 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00929242 s, 113 MB/s 2023-10-06T11:14:36.638 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.638 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.638 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00996721 s, 105 MB/s 2023-10-06T11:14:36.650 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.650 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.650 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00945861 s, 111 MB/s 2023-10-06T11:14:36.661 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.662 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.662 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00960688 s, 109 MB/s 2023-10-06T11:14:36.673 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.673 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.673 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00928266 s, 113 MB/s 2023-10-06T11:14:36.674 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:14:36.674 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:14:36.674 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:14:36.674 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.21 2023-10-06T11:14:36.674 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:14:36.674 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:14:36.674 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:14:36.675 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:14:36.757 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.757 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.757 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00933118 s, 112 MB/s 2023-10-06T11:14:36.768 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.768 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.768 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00933867 s, 112 MB/s 2023-10-06T11:14:36.780 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.781 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.781 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100646 s, 104 MB/s 2023-10-06T11:14:36.791 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.791 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.791 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00860943 s, 122 MB/s 2023-10-06T11:14:36.804 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.804 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.804 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100513 s, 104 MB/s 2023-10-06T11:14:36.815 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.816 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.816 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0093737 s, 112 MB/s 2023-10-06T11:14:36.828 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.828 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.828 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101842 s, 103 MB/s 2023-10-06T11:14:36.840 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.840 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.840 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00992209 s, 106 MB/s 2023-10-06T11:14:36.852 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.852 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.852 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00937756 s, 112 MB/s 2023-10-06T11:14:36.864 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.864 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.864 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101271 s, 104 MB/s 2023-10-06T11:14:36.876 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.877 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.877 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103279 s, 102 MB/s 2023-10-06T11:14:36.888 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.888 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.888 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00927629 s, 113 MB/s 2023-10-06T11:14:36.900 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.900 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.900 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00911128 s, 115 MB/s 2023-10-06T11:14:36.911 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.911 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.911 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00943059 s, 111 MB/s 2023-10-06T11:14:36.922 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.922 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.923 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00913059 s, 115 MB/s 2023-10-06T11:14:36.934 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.934 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.934 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00943331 s, 111 MB/s 2023-10-06T11:14:36.946 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.946 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.946 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00946381 s, 111 MB/s 2023-10-06T11:14:36.958 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.958 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.958 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00870114 s, 121 MB/s 2023-10-06T11:14:36.968 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.969 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.969 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00938736 s, 112 MB/s 2023-10-06T11:14:36.981 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.981 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.981 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010343 s, 101 MB/s 2023-10-06T11:14:36.993 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:36.994 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:36.994 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101731 s, 103 MB/s 2023-10-06T11:14:37.006 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.006 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.006 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104597 s, 100 MB/s 2023-10-06T11:14:37.018 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.018 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.018 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00908029 s, 115 MB/s 2023-10-06T11:14:37.029 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.029 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.029 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00935861 s, 112 MB/s 2023-10-06T11:14:37.041 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.041 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.041 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00967525 s, 108 MB/s 2023-10-06T11:14:37.052 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.052 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.052 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00913752 s, 115 MB/s 2023-10-06T11:14:37.063 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.064 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.064 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00900585 s, 116 MB/s 2023-10-06T11:14:37.076 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.076 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.076 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00996664 s, 105 MB/s 2023-10-06T11:14:37.088 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.088 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.088 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101236 s, 104 MB/s 2023-10-06T11:14:37.100 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.100 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.100 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0094122 s, 111 MB/s 2023-10-06T11:14:37.111 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.111 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.111 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.009252 s, 113 MB/s 2023-10-06T11:14:37.123 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.123 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.123 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00964557 s, 109 MB/s 2023-10-06T11:14:37.124 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:14:37.124 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:14:37.124 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:14:37.124 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.22 2023-10-06T11:14:37.124 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:14:37.125 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:14:37.125 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:14:37.125 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:14:37.207 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.207 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.207 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102174 s, 103 MB/s 2023-10-06T11:14:37.219 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.219 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.219 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954865 s, 110 MB/s 2023-10-06T11:14:37.230 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.230 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.230 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00906268 s, 116 MB/s 2023-10-06T11:14:37.242 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.243 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.243 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101268 s, 104 MB/s 2023-10-06T11:14:37.253 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.253 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.254 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0085844 s, 122 MB/s 2023-10-06T11:14:37.265 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.265 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.265 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00930473 s, 113 MB/s 2023-10-06T11:14:37.276 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.276 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.276 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00900326 s, 116 MB/s 2023-10-06T11:14:37.289 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.289 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.289 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00995481 s, 105 MB/s 2023-10-06T11:14:37.300 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.300 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.300 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00910855 s, 115 MB/s 2023-10-06T11:14:37.312 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.312 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.312 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00979295 s, 107 MB/s 2023-10-06T11:14:37.324 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.324 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.324 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.009795 s, 107 MB/s 2023-10-06T11:14:37.336 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.336 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.336 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0095834 s, 109 MB/s 2023-10-06T11:14:37.347 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.347 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.347 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00925615 s, 113 MB/s 2023-10-06T11:14:37.358 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.359 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.359 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00915321 s, 115 MB/s 2023-10-06T11:14:37.370 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.370 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.370 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00927898 s, 113 MB/s 2023-10-06T11:14:37.382 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.382 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.382 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00947345 s, 111 MB/s 2023-10-06T11:14:37.393 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.394 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.394 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00941459 s, 111 MB/s 2023-10-06T11:14:37.405 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.405 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.405 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0092995 s, 113 MB/s 2023-10-06T11:14:37.418 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.418 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.418 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010183 s, 103 MB/s 2023-10-06T11:14:37.429 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.429 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.430 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00940164 s, 112 MB/s 2023-10-06T11:14:37.441 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.441 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.441 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00952136 s, 110 MB/s 2023-10-06T11:14:37.452 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.452 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.452 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00855969 s, 123 MB/s 2023-10-06T11:14:37.464 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.464 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.464 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00937775 s, 112 MB/s 2023-10-06T11:14:37.476 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.476 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.476 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102298 s, 103 MB/s 2023-10-06T11:14:37.487 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.487 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.487 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00864683 s, 121 MB/s 2023-10-06T11:14:37.500 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.500 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.500 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106855 s, 98.1 MB/s 2023-10-06T11:14:37.536 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.536 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.536 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00946508 s, 111 MB/s 2023-10-06T11:14:37.548 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.548 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.548 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00979314 s, 107 MB/s 2023-10-06T11:14:37.561 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.561 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.562 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00960517 s, 109 MB/s 2023-10-06T11:14:37.571 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.572 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.572 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00965127 s, 109 MB/s 2023-10-06T11:14:37.583 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.583 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.583 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00920827 s, 114 MB/s 2023-10-06T11:14:37.594 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.595 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.595 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00852167 s, 123 MB/s 2023-10-06T11:14:37.595 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:14:37.595 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:14:37.595 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:14:37.595 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.23 2023-10-06T11:14:37.595 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:14:37.595 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:14:37.596 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:14:37.596 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:14:37.676 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.676 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.676 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00857902 s, 122 MB/s 2023-10-06T11:14:37.688 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.689 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.689 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102796 s, 102 MB/s 2023-10-06T11:14:37.701 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.701 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.701 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103077 s, 102 MB/s 2023-10-06T11:14:37.713 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.713 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.713 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00935377 s, 112 MB/s 2023-10-06T11:14:37.724 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.724 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.724 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00925362 s, 113 MB/s 2023-10-06T11:14:37.735 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.736 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.736 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00925252 s, 113 MB/s 2023-10-06T11:14:37.747 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.748 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.748 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00998762 s, 105 MB/s 2023-10-06T11:14:37.759 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.759 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.759 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00921703 s, 114 MB/s 2023-10-06T11:14:37.772 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.772 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.772 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010186 s, 103 MB/s 2023-10-06T11:14:37.783 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.783 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.783 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00937261 s, 112 MB/s 2023-10-06T11:14:37.795 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.795 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.795 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00942953 s, 111 MB/s 2023-10-06T11:14:37.806 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.806 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.806 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00874868 s, 120 MB/s 2023-10-06T11:14:37.818 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.818 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.818 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00965355 s, 109 MB/s 2023-10-06T11:14:37.830 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.911 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.911 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102386 s, 102 MB/s 2023-10-06T11:14:37.912 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.912 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.913 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101047 s, 104 MB/s 2023-10-06T11:14:37.913 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.913 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.913 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00985832 s, 106 MB/s 2023-10-06T11:14:37.913 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.913 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.913 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00929911 s, 113 MB/s 2023-10-06T11:14:37.913 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.913 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.913 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00927996 s, 113 MB/s 2023-10-06T11:14:37.913 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.913 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.914 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00911304 s, 115 MB/s 2023-10-06T11:14:37.914 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.914 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.914 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00940401 s, 112 MB/s 2023-10-06T11:14:37.914 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.914 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.914 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00875419 s, 120 MB/s 2023-10-06T11:14:37.923 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.923 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.923 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00870921 s, 120 MB/s 2023-10-06T11:14:37.933 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.934 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.934 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00858294 s, 122 MB/s 2023-10-06T11:14:37.945 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.945 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.945 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00915655 s, 115 MB/s 2023-10-06T11:14:37.957 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.957 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.957 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00961002 s, 109 MB/s 2023-10-06T11:14:37.968 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.969 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.969 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00951631 s, 110 MB/s 2023-10-06T11:14:37.982 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.982 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.982 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105076 s, 99.8 MB/s 2023-10-06T11:14:37.993 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:37.993 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:37.993 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00925573 s, 113 MB/s 2023-10-06T11:14:38.005 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.005 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.005 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00953364 s, 110 MB/s 2023-10-06T11:14:38.017 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.017 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.017 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00969682 s, 108 MB/s 2023-10-06T11:14:38.029 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.029 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.029 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102276 s, 103 MB/s 2023-10-06T11:14:38.041 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.041 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.041 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954459 s, 110 MB/s 2023-10-06T11:14:38.042 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:14:38.042 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:14:38.042 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:14:38.043 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.24 2023-10-06T11:14:38.043 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:14:38.043 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:14:38.043 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:14:38.043 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:14:38.125 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.125 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.125 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00942933 s, 111 MB/s 2023-10-06T11:14:38.137 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.137 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.138 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102467 s, 102 MB/s 2023-10-06T11:14:38.150 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.150 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.150 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107239 s, 97.8 MB/s 2023-10-06T11:14:38.162 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.162 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.162 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00953374 s, 110 MB/s 2023-10-06T11:14:38.174 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.174 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.174 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0087446 s, 120 MB/s 2023-10-06T11:14:38.184 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.184 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.185 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00914422 s, 115 MB/s 2023-10-06T11:14:38.195 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.196 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.196 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00898746 s, 117 MB/s 2023-10-06T11:14:38.207 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.207 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.207 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00892117 s, 118 MB/s 2023-10-06T11:14:38.218 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.219 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.219 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0095936 s, 109 MB/s 2023-10-06T11:14:38.231 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.231 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.231 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00999087 s, 105 MB/s 2023-10-06T11:14:38.242 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.242 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.242 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00918201 s, 114 MB/s 2023-10-06T11:14:38.255 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.255 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.255 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100222 s, 105 MB/s 2023-10-06T11:14:38.266 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.266 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.266 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00928768 s, 113 MB/s 2023-10-06T11:14:38.277 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.277 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.278 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0092263 s, 114 MB/s 2023-10-06T11:14:38.290 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.290 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.290 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101901 s, 103 MB/s 2023-10-06T11:14:38.302 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.302 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.302 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100756 s, 104 MB/s 2023-10-06T11:14:38.313 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.313 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.313 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00870569 s, 120 MB/s 2023-10-06T11:14:38.325 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.325 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.325 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00960453 s, 109 MB/s 2023-10-06T11:14:38.336 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.337 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.337 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00942878 s, 111 MB/s 2023-10-06T11:14:38.348 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.348 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.348 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.008971 s, 117 MB/s 2023-10-06T11:14:38.359 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.359 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.360 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00937669 s, 112 MB/s 2023-10-06T11:14:38.372 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.372 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.372 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102355 s, 102 MB/s 2023-10-06T11:14:38.384 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.384 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.384 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00956301 s, 110 MB/s 2023-10-06T11:14:38.396 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.396 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.396 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00948525 s, 111 MB/s 2023-10-06T11:14:38.407 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.408 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.408 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00947342 s, 111 MB/s 2023-10-06T11:14:38.420 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.420 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.420 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104986 s, 99.9 MB/s 2023-10-06T11:14:38.431 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.431 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.431 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00857973 s, 122 MB/s 2023-10-06T11:14:38.443 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.443 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.443 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00998839 s, 105 MB/s 2023-10-06T11:14:38.457 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.457 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.457 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010398 s, 101 MB/s 2023-10-06T11:14:38.469 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.469 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.470 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103239 s, 102 MB/s 2023-10-06T11:14:38.483 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.483 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.483 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111261 s, 94.2 MB/s 2023-10-06T11:14:38.496 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.496 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.496 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00992187 s, 106 MB/s 2023-10-06T11:14:38.497 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:14:38.498 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:14:38.498 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:14:38.498 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.25 2023-10-06T11:14:38.498 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:14:38.498 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:14:38.498 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:14:38.498 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:14:38.582 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.582 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.582 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010581 s, 99.1 MB/s 2023-10-06T11:14:38.596 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.596 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.597 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111894 s, 93.7 MB/s 2023-10-06T11:14:38.609 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.610 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.610 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113512 s, 92.4 MB/s 2023-10-06T11:14:38.625 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.625 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.625 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0123478 s, 84.9 MB/s 2023-10-06T11:14:38.636 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.636 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.636 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00903274 s, 116 MB/s 2023-10-06T11:14:38.648 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.648 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.649 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102548 s, 102 MB/s 2023-10-06T11:14:38.660 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.661 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.661 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00986897 s, 106 MB/s 2023-10-06T11:14:38.672 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.672 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.672 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00943926 s, 111 MB/s 2023-10-06T11:14:38.684 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.684 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.684 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00983598 s, 107 MB/s 2023-10-06T11:14:38.696 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.696 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.696 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00952612 s, 110 MB/s 2023-10-06T11:14:38.708 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.708 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.708 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00994979 s, 105 MB/s 2023-10-06T11:14:38.719 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.720 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.720 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0093749 s, 112 MB/s 2023-10-06T11:14:38.732 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.732 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.732 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102837 s, 102 MB/s 2023-10-06T11:14:38.744 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.744 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.744 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00941073 s, 111 MB/s 2023-10-06T11:14:38.754 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.754 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.754 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00828619 s, 127 MB/s 2023-10-06T11:14:38.767 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.767 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.767 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102301 s, 102 MB/s 2023-10-06T11:14:38.779 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.779 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.779 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00990106 s, 106 MB/s 2023-10-06T11:14:38.791 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.791 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.791 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00938791 s, 112 MB/s 2023-10-06T11:14:38.802 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.803 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.803 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00944335 s, 111 MB/s 2023-10-06T11:14:38.813 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.813 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.813 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00901772 s, 116 MB/s 2023-10-06T11:14:38.825 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.826 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.826 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00951456 s, 110 MB/s 2023-10-06T11:14:38.837 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.837 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.837 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00959821 s, 109 MB/s 2023-10-06T11:14:38.848 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.848 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.848 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0086384 s, 121 MB/s 2023-10-06T11:14:38.860 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.860 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.860 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00999696 s, 105 MB/s 2023-10-06T11:14:38.872 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.872 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.872 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00929646 s, 113 MB/s 2023-10-06T11:14:38.883 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.883 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.883 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0095266 s, 110 MB/s 2023-10-06T11:14:38.895 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.895 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.895 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00980721 s, 107 MB/s 2023-10-06T11:14:38.907 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.907 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.908 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101441 s, 103 MB/s 2023-10-06T11:14:38.920 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.920 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.920 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101873 s, 103 MB/s 2023-10-06T11:14:38.931 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.931 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.931 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00883766 s, 119 MB/s 2023-10-06T11:14:38.943 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.944 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.944 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00999025 s, 105 MB/s 2023-10-06T11:14:38.956 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:38.956 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:38.956 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100942 s, 104 MB/s 2023-10-06T11:14:38.957 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:14:38.957 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:14:38.957 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:14:38.957 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.26 2023-10-06T11:14:38.957 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:14:38.957 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:14:38.957 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:14:38.958 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:14:38.998 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.001 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.001 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00868997 s, 121 MB/s 2023-10-06T11:14:39.010 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.010 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.010 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954104 s, 110 MB/s 2023-10-06T11:14:39.021 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.021 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.021 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00863057 s, 121 MB/s 2023-10-06T11:14:39.033 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.034 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.034 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101337 s, 103 MB/s 2023-10-06T11:14:39.046 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.046 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.046 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00995526 s, 105 MB/s 2023-10-06T11:14:39.058 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.058 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.058 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101095 s, 104 MB/s 2023-10-06T11:14:39.070 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.070 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.070 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00962694 s, 109 MB/s 2023-10-06T11:14:39.082 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.082 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.082 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00967486 s, 108 MB/s 2023-10-06T11:14:39.093 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.094 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.094 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954813 s, 110 MB/s 2023-10-06T11:14:39.106 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.106 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.106 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102335 s, 102 MB/s 2023-10-06T11:14:39.119 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.119 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.119 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010448 s, 100 MB/s 2023-10-06T11:14:39.131 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.131 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.131 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101436 s, 103 MB/s 2023-10-06T11:14:39.143 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.144 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.144 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101569 s, 103 MB/s 2023-10-06T11:14:39.155 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.155 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.156 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00955176 s, 110 MB/s 2023-10-06T11:14:39.166 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.166 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.166 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00849716 s, 123 MB/s 2023-10-06T11:14:39.179 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.179 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.179 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103184 s, 102 MB/s 2023-10-06T11:14:39.191 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.191 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.191 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00965207 s, 109 MB/s 2023-10-06T11:14:39.202 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.202 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.202 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00883037 s, 119 MB/s 2023-10-06T11:14:39.214 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.214 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.214 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00946646 s, 111 MB/s 2023-10-06T11:14:39.225 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.225 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.225 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00866495 s, 121 MB/s 2023-10-06T11:14:39.236 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.236 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.237 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00930051 s, 113 MB/s 2023-10-06T11:14:39.248 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.248 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.248 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00931315 s, 113 MB/s 2023-10-06T11:14:39.259 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.260 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.260 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00932081 s, 112 MB/s 2023-10-06T11:14:39.271 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.271 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.271 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00935622 s, 112 MB/s 2023-10-06T11:14:39.282 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.282 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.283 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00940428 s, 111 MB/s 2023-10-06T11:14:39.294 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.294 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.294 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00946398 s, 111 MB/s 2023-10-06T11:14:39.306 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.306 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.306 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00946709 s, 111 MB/s 2023-10-06T11:14:39.317 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.318 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.318 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00932485 s, 112 MB/s 2023-10-06T11:14:39.329 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.329 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.329 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00932518 s, 112 MB/s 2023-10-06T11:14:39.341 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.341 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.342 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010033 s, 105 MB/s 2023-10-06T11:14:39.354 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.354 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.354 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101077 s, 104 MB/s 2023-10-06T11:14:39.365 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.366 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.366 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00957747 s, 109 MB/s 2023-10-06T11:14:39.367 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:14:39.367 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:14:39.367 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:14:39.367 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.27 2023-10-06T11:14:39.367 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:14:39.367 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:14:39.367 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:14:39.367 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:14:39.451 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.451 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.451 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103339 s, 101 MB/s 2023-10-06T11:14:39.462 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.462 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.462 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0093025 s, 113 MB/s 2023-10-06T11:14:39.473 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.473 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.474 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00912423 s, 115 MB/s 2023-10-06T11:14:39.485 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.485 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.485 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0094064 s, 111 MB/s 2023-10-06T11:14:39.497 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.498 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.498 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100647 s, 104 MB/s 2023-10-06T11:14:39.520 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.520 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.520 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0196884 s, 53.3 MB/s 2023-10-06T11:14:39.552 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.552 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.552 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00949052 s, 110 MB/s 2023-10-06T11:14:39.564 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.564 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.564 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00975531 s, 107 MB/s 2023-10-06T11:14:39.575 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.575 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.576 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00933651 s, 112 MB/s 2023-10-06T11:14:39.588 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.588 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.588 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010164 s, 103 MB/s 2023-10-06T11:14:39.599 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.599 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.600 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00933259 s, 112 MB/s 2023-10-06T11:14:39.611 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.611 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.612 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0095968 s, 109 MB/s 2023-10-06T11:14:39.624 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.624 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.624 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101835 s, 103 MB/s 2023-10-06T11:14:39.635 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.635 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.635 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00870297 s, 120 MB/s 2023-10-06T11:14:39.646 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.646 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.646 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00933244 s, 112 MB/s 2023-10-06T11:14:39.658 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.658 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.658 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00936052 s, 112 MB/s 2023-10-06T11:14:39.669 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.669 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.669 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00869066 s, 121 MB/s 2023-10-06T11:14:39.681 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.681 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.681 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00995749 s, 105 MB/s 2023-10-06T11:14:39.692 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.692 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.692 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00928386 s, 113 MB/s 2023-10-06T11:14:39.703 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.704 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.704 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00908944 s, 115 MB/s 2023-10-06T11:14:39.714 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.714 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.714 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00855427 s, 123 MB/s 2023-10-06T11:14:39.725 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.725 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.726 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00907264 s, 116 MB/s 2023-10-06T11:14:39.736 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.736 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.736 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00846175 s, 124 MB/s 2023-10-06T11:14:39.748 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.748 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.748 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00951343 s, 110 MB/s 2023-10-06T11:14:39.759 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.759 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.759 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00912147 s, 115 MB/s 2023-10-06T11:14:39.770 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.770 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.770 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00835204 s, 126 MB/s 2023-10-06T11:14:39.781 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.781 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.781 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00919713 s, 114 MB/s 2023-10-06T11:14:39.793 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.793 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.793 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101142 s, 104 MB/s 2023-10-06T11:14:39.805 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.805 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.805 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00920076 s, 114 MB/s 2023-10-06T11:14:39.817 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.817 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.817 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00998973 s, 105 MB/s 2023-10-06T11:14:39.828 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.828 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.829 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00925062 s, 113 MB/s 2023-10-06T11:14:39.841 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.841 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.841 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0099829 s, 105 MB/s 2023-10-06T11:14:39.842 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:14:39.842 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:14:39.842 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:14:39.842 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.28 2023-10-06T11:14:39.842 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:14:39.842 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:14:39.843 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:14:39.843 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:14:39.925 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.925 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.925 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00922849 s, 114 MB/s 2023-10-06T11:14:39.937 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.937 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.937 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102817 s, 102 MB/s 2023-10-06T11:14:39.949 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.949 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.949 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100438 s, 104 MB/s 2023-10-06T11:14:39.960 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.960 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.961 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00911658 s, 115 MB/s 2023-10-06T11:14:39.971 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.972 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.972 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00915661 s, 115 MB/s 2023-10-06T11:14:39.983 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.983 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.983 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00908104 s, 115 MB/s 2023-10-06T11:14:39.994 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:39.994 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:39.995 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00919182 s, 114 MB/s 2023-10-06T11:14:40.007 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.007 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.007 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101151 s, 104 MB/s 2023-10-06T11:14:40.018 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.019 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.019 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00946244 s, 111 MB/s 2023-10-06T11:14:40.030 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.030 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.030 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00905799 s, 116 MB/s 2023-10-06T11:14:40.041 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.041 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.041 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00919214 s, 114 MB/s 2023-10-06T11:14:40.053 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.053 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.053 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00915484 s, 115 MB/s 2023-10-06T11:14:40.063 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.064 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.064 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00855072 s, 123 MB/s 2023-10-06T11:14:40.074 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.074 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.074 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0084394 s, 124 MB/s 2023-10-06T11:14:40.085 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.085 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.085 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00843385 s, 124 MB/s 2023-10-06T11:14:40.096 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.096 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.096 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00872923 s, 120 MB/s 2023-10-06T11:14:40.107 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.107 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.107 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00867038 s, 121 MB/s 2023-10-06T11:14:40.119 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.119 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.120 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102037 s, 103 MB/s 2023-10-06T11:14:40.130 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.131 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.131 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00909591 s, 115 MB/s 2023-10-06T11:14:40.143 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.143 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.143 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101655 s, 103 MB/s 2023-10-06T11:14:40.155 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.155 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.155 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00987683 s, 106 MB/s 2023-10-06T11:14:40.167 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.167 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.168 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100671 s, 104 MB/s 2023-10-06T11:14:40.180 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.180 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.180 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100207 s, 105 MB/s 2023-10-06T11:14:40.191 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.191 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.191 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00908706 s, 115 MB/s 2023-10-06T11:14:40.203 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.203 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.204 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101169 s, 104 MB/s 2023-10-06T11:14:40.215 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.216 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.216 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00977813 s, 107 MB/s 2023-10-06T11:14:40.227 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.227 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.227 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00927369 s, 113 MB/s 2023-10-06T11:14:40.239 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.239 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.239 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0094451 s, 111 MB/s 2023-10-06T11:14:40.250 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.250 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.250 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00927331 s, 113 MB/s 2023-10-06T11:14:40.262 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.262 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.263 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00994529 s, 105 MB/s 2023-10-06T11:14:40.274 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.274 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.274 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00931901 s, 113 MB/s 2023-10-06T11:14:40.285 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.285 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.285 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0090968 s, 115 MB/s 2023-10-06T11:14:40.286 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:14:40.287 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:14:40.287 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:14:40.287 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.29 2023-10-06T11:14:40.287 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:14:40.287 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:14:40.287 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:14:40.287 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:14:40.369 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.369 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.370 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100254 s, 105 MB/s 2023-10-06T11:14:40.380 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.381 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.381 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00916747 s, 114 MB/s 2023-10-06T11:14:40.393 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.393 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.393 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010343 s, 101 MB/s 2023-10-06T11:14:40.404 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.404 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.404 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00856426 s, 122 MB/s 2023-10-06T11:14:40.415 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.416 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.416 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00923979 s, 113 MB/s 2023-10-06T11:14:40.426 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.427 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.427 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00872996 s, 120 MB/s 2023-10-06T11:14:40.437 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.438 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.438 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00861077 s, 122 MB/s 2023-10-06T11:14:40.450 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.450 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.450 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00978858 s, 107 MB/s 2023-10-06T11:14:40.461 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.461 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.461 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00922004 s, 114 MB/s 2023-10-06T11:14:40.472 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.472 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.472 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00898541 s, 117 MB/s 2023-10-06T11:14:40.484 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.484 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.484 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00935914 s, 112 MB/s 2023-10-06T11:14:40.494 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.495 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.495 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00847383 s, 124 MB/s 2023-10-06T11:14:40.506 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.506 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.506 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.008761 s, 120 MB/s 2023-10-06T11:14:40.520 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.520 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.520 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0120045 s, 87.3 MB/s 2023-10-06T11:14:40.556 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.556 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.556 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00934996 s, 112 MB/s 2023-10-06T11:14:40.567 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.568 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.568 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00947662 s, 111 MB/s 2023-10-06T11:14:40.580 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.580 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.580 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0099708 s, 105 MB/s 2023-10-06T11:14:40.592 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.592 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.592 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00936106 s, 112 MB/s 2023-10-06T11:14:40.603 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.603 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.603 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00947155 s, 111 MB/s 2023-10-06T11:14:40.615 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.616 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.616 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102229 s, 103 MB/s 2023-10-06T11:14:40.627 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.627 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.627 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00870517 s, 120 MB/s 2023-10-06T11:14:40.638 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.638 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.639 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00945108 s, 111 MB/s 2023-10-06T11:14:40.650 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.650 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.650 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00951563 s, 110 MB/s 2023-10-06T11:14:40.662 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.662 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.662 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00947527 s, 111 MB/s 2023-10-06T11:14:40.674 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.674 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.674 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010249 s, 102 MB/s 2023-10-06T11:14:40.686 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.686 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.686 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00952 s, 110 MB/s 2023-10-06T11:14:40.697 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.698 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.698 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00935008 s, 112 MB/s 2023-10-06T11:14:40.709 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.710 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.710 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00956853 s, 110 MB/s 2023-10-06T11:14:40.722 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.722 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.722 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00998199 s, 105 MB/s 2023-10-06T11:14:40.733 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.733 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.733 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00929834 s, 113 MB/s 2023-10-06T11:14:40.745 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.745 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.745 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00941918 s, 111 MB/s 2023-10-06T11:14:40.756 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.757 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.757 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00951979 s, 110 MB/s 2023-10-06T11:14:40.758 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:14:40.758 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:14:40.758 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:14:40.758 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.30 2023-10-06T11:14:40.758 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:14:40.758 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:14:40.758 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:14:40.758 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:14:40.840 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.840 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.840 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00947751 s, 111 MB/s 2023-10-06T11:14:40.851 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.851 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.851 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00926412 s, 113 MB/s 2023-10-06T11:14:40.863 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.863 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.864 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101347 s, 103 MB/s 2023-10-06T11:14:40.875 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.875 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.875 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00936833 s, 112 MB/s 2023-10-06T11:14:40.886 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.886 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.887 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0092437 s, 113 MB/s 2023-10-06T11:14:40.898 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.898 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.899 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0093747 s, 112 MB/s 2023-10-06T11:14:40.910 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.910 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.911 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00970758 s, 108 MB/s 2023-10-06T11:14:40.922 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.922 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.922 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00934469 s, 112 MB/s 2023-10-06T11:14:40.933 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.933 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.933 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00945672 s, 111 MB/s 2023-10-06T11:14:40.945 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.945 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.945 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00949965 s, 110 MB/s 2023-10-06T11:14:40.957 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.957 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.957 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954014 s, 110 MB/s 2023-10-06T11:14:40.969 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.969 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.969 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00957957 s, 109 MB/s 2023-10-06T11:14:40.980 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.980 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.981 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954402 s, 110 MB/s 2023-10-06T11:14:40.992 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:40.992 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:40.992 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00941344 s, 111 MB/s 2023-10-06T11:14:41.004 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.005 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.005 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010242 s, 102 MB/s 2023-10-06T11:14:41.016 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.016 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.016 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00887298 s, 118 MB/s 2023-10-06T11:14:41.027 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.027 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.027 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00876613 s, 120 MB/s 2023-10-06T11:14:41.038 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.038 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.038 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00870986 s, 120 MB/s 2023-10-06T11:14:41.049 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.050 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.050 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00925669 s, 113 MB/s 2023-10-06T11:14:41.061 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.061 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.061 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00873586 s, 120 MB/s 2023-10-06T11:14:41.072 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.072 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.072 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00925004 s, 113 MB/s 2023-10-06T11:14:41.084 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.084 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.084 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00941052 s, 111 MB/s 2023-10-06T11:14:41.095 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.096 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.096 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00948101 s, 111 MB/s 2023-10-06T11:14:41.107 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.107 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.107 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00937281 s, 112 MB/s 2023-10-06T11:14:41.119 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.119 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.119 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00967954 s, 108 MB/s 2023-10-06T11:14:41.130 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.131 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.131 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00936062 s, 112 MB/s 2023-10-06T11:14:41.144 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.144 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.144 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116529 s, 90.0 MB/s 2023-10-06T11:14:41.155 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.155 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.155 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00877856 s, 119 MB/s 2023-10-06T11:14:41.167 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.167 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.167 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00961451 s, 109 MB/s 2023-10-06T11:14:41.178 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.178 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.178 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00873027 s, 120 MB/s 2023-10-06T11:14:41.190 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.191 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.191 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103822 s, 101 MB/s 2023-10-06T11:14:41.202 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.202 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.203 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00948296 s, 111 MB/s 2023-10-06T11:14:41.203 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:14:41.204 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:14:41.204 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:14:41.204 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.31 2023-10-06T11:14:41.204 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:14:41.204 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:14:41.204 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:14:41.204 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:14:41.287 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.287 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.287 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00980719 s, 107 MB/s 2023-10-06T11:14:41.297 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.298 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.298 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00948503 s, 111 MB/s 2023-10-06T11:14:41.308 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.309 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.309 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00886686 s, 118 MB/s 2023-10-06T11:14:41.320 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.320 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.320 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00891572 s, 118 MB/s 2023-10-06T11:14:41.332 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.333 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.333 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105013 s, 99.9 MB/s 2023-10-06T11:14:41.344 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.344 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.344 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00922156 s, 114 MB/s 2023-10-06T11:14:41.355 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.356 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.356 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00939113 s, 112 MB/s 2023-10-06T11:14:41.367 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.367 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.367 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00918626 s, 114 MB/s 2023-10-06T11:14:41.379 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.379 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.379 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101956 s, 103 MB/s 2023-10-06T11:14:41.391 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.391 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.391 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00922477 s, 114 MB/s 2023-10-06T11:14:41.402 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.402 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.402 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0090877 s, 115 MB/s 2023-10-06T11:14:41.413 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.413 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.413 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00880801 s, 119 MB/s 2023-10-06T11:14:41.424 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.424 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.424 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00929021 s, 113 MB/s 2023-10-06T11:14:41.436 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.436 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.436 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00926943 s, 113 MB/s 2023-10-06T11:14:41.447 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.447 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.447 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00924234 s, 113 MB/s 2023-10-06T11:14:41.459 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.459 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.459 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00921875 s, 114 MB/s 2023-10-06T11:14:41.471 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.471 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.471 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100317 s, 105 MB/s 2023-10-06T11:14:41.482 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.482 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.482 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00862995 s, 122 MB/s 2023-10-06T11:14:41.493 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.493 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.493 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00929076 s, 113 MB/s 2023-10-06T11:14:41.506 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.506 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.506 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104106 s, 101 MB/s 2023-10-06T11:14:41.518 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.518 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.518 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00971158 s, 108 MB/s 2023-10-06T11:14:41.535 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.536 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.536 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0097363 s, 108 MB/s 2023-10-06T11:14:41.562 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.562 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.562 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00958562 s, 109 MB/s 2023-10-06T11:14:41.573 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.573 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.573 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00944669 s, 111 MB/s 2023-10-06T11:14:41.586 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.586 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.586 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103345 s, 101 MB/s 2023-10-06T11:14:41.597 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.597 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.597 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00874864 s, 120 MB/s 2023-10-06T11:14:41.609 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.609 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.609 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00951234 s, 110 MB/s 2023-10-06T11:14:41.620 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.620 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.620 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0092861 s, 113 MB/s 2023-10-06T11:14:41.631 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.631 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.631 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00868668 s, 121 MB/s 2023-10-06T11:14:41.642 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.642 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.642 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00865418 s, 121 MB/s 2023-10-06T11:14:41.653 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.654 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.654 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00927945 s, 113 MB/s 2023-10-06T11:14:41.665 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:14:41.666 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:14:41.666 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00952153 s, 110 MB/s 2023-10-06T11:14:41.669 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 scrub start /scrub_control_test_path recursive 2023-10-06T11:14:41.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.824+0000 7fdb44d7a700 1 Processor -- start 2023-10-06T11:14:41.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.824+0000 7fdb44d7a700 1 -- start start 2023-10-06T11:14:41.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.825+0000 7fdb44d7a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb4015a160 0x7fdb400c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:41.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.825+0000 7fdb44d7a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb400ae2a0 con 0x7fdb400ae730 2023-10-06T11:14:41.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.825+0000 7fdb44d7a700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb4015a530 con 0x7fdb400cb950 2023-10-06T11:14:41.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.825+0000 7fdb44d7a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb400ad690 con 0x7fdb4015a160 2023-10-06T11:14:41.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.826+0000 7fdb3dd9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fdb400ae730 0x7fdb400aeb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45220/0 (socket says 172.21.15.146:45220) 2023-10-06T11:14:41.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.826+0000 7fdb3dd9b700 1 -- 172.21.15.146:0/3758382078 learned_addr learned my addr 172.21.15.146:0/3758382078 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:14:41.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.826+0000 7fdb3e59c700 1 --2- 172.21.15.146:0/3758382078 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb4015a160 0x7fdb400c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:41.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.826+0000 7fdb3d59a700 1 -- 172.21.15.146:0/3758382078 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1123890580 0 0) 0x7fdb400ae2a0 con 0x7fdb400ae730 2023-10-06T11:14:41.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.826+0000 7fdb3d59a700 1 -- 172.21.15.146:0/3758382078 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb28003570 con 0x7fdb400ae730 2023-10-06T11:14:41.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.826+0000 7fdb3d59a700 1 -- 172.21.15.146:0/3758382078 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1971981050 0 0) 0x7fdb4015a530 con 0x7fdb400cb950 2023-10-06T11:14:41.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.826+0000 7fdb3d59a700 1 -- 172.21.15.146:0/3758382078 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb400ae2a0 con 0x7fdb400cb950 2023-10-06T11:14:41.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.826+0000 7fdb3d59a700 1 -- 172.21.15.146:0/3758382078 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 206536060 0 0) 0x7fdb28003570 con 0x7fdb400ae730 2023-10-06T11:14:41.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.826+0000 7fdb3d59a700 1 -- 172.21.15.146:0/3758382078 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb4015a160 msgr2=0x7fdb400c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:41.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.826+0000 7fdb3d59a700 1 --2- 172.21.15.146:0/3758382078 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb4015a160 0x7fdb400c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:41.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.826+0000 7fdb3d59a700 1 -- 172.21.15.146:0/3758382078 >> v1:172.21.15.151:6789/0 conn(0x7fdb400cb950 legacy=0x7fdb400cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:41.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.826+0000 7fdb3d59a700 1 -- 172.21.15.146:0/3758382078 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb400ad970 con 0x7fdb400ae730 2023-10-06T11:14:41.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.826+0000 7fdb3d59a700 1 -- 172.21.15.146:0/3758382078 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fdb34001470 con 0x7fdb400ae730 2023-10-06T11:14:41.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.826+0000 7fdb3d59a700 1 -- 172.21.15.146:0/3758382078 >> v1:172.21.15.146:6789/0 conn(0x7fdb400ae730 legacy=0x7fdb400aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:41.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.826+0000 7fdb3d59a700 1 --2- 172.21.15.146:0/3758382078 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb4015a160 0x7fdb28003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:41.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.826+0000 7fdb3d59a700 1 --2- 172.21.15.146:0/3758382078 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb280041d0 0x7fdb28004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:41.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.826+0000 7fdb3d59a700 1 --2- 172.21.15.146:0/3758382078 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb28004d50 0x7fdb280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:41.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.826+0000 7fdb3d59a700 1 -- 172.21.15.146:0/3758382078 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb400ad690 con 0x7fdb280041d0 2023-10-06T11:14:41.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.826+0000 7fdb3d59a700 1 -- 172.21.15.146:0/3758382078 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2800bbf0 con 0x7fdb28004d50 2023-10-06T11:14:41.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.826+0000 7fdb3d59a700 1 -- 172.21.15.146:0/3758382078 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb2800bdb0 con 0x7fdb4015a160 2023-10-06T11:14:41.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.826+0000 7fdb3dd9b700 1 --2- 172.21.15.146:0/3758382078 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb280041d0 0x7fdb28004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:41.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.826+0000 7fdb3e59c700 1 --2- 172.21.15.146:0/3758382078 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb4015a160 0x7fdb28003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:41.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.826+0000 7fdb3ed9d700 1 --2- 172.21.15.146:0/3758382078 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb28004d50 0x7fdb280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:41.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.827+0000 7fdb3dd9b700 1 -- 172.21.15.146:0/3758382078 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb4015a160 msgr2=0x7fdb28003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:41.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.827+0000 7fdb3dd9b700 1 --2- 172.21.15.146:0/3758382078 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb4015a160 0x7fdb28003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:41.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.827+0000 7fdb3dd9b700 1 -- 172.21.15.146:0/3758382078 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb28004d50 msgr2=0x7fdb280051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:41.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.827+0000 7fdb3dd9b700 1 --2- 172.21.15.146:0/3758382078 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb28004d50 0x7fdb280051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:41.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.827+0000 7fdb3dd9b700 1 -- 172.21.15.146:0/3758382078 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb28003570 con 0x7fdb280041d0 2023-10-06T11:14:41.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.827+0000 7fdb3e59c700 1 --2- 172.21.15.146:0/3758382078 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb4015a160 0x7fdb28003c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:14:41.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.827+0000 7fdb3dd9b700 1 --2- 172.21.15.146:0/3758382078 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb280041d0 0x7fdb28004810 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fdb3400c1e0 tx=0x7fdb34001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc7a3f5329c12939 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:41.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.827+0000 7fdb3d59a700 1 -- 172.21.15.146:0/3758382078 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3400cb10 con 0x7fdb280041d0 2023-10-06T11:14:41.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.827+0000 7fdb3d59a700 1 -- 172.21.15.146:0/3758382078 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3400cc90 con 0x7fdb280041d0 2023-10-06T11:14:41.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.827+0000 7fdb3d59a700 1 -- 172.21.15.146:0/3758382078 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb34005b70 con 0x7fdb280041d0 2023-10-06T11:14:41.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.827+0000 7fdb44d7a700 1 -- 172.21.15.146:0/3758382078 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb280041d0 msgr2=0x7fdb28004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:41.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.827+0000 7fdb44d7a700 1 --2- 172.21.15.146:0/3758382078 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb280041d0 0x7fdb28004810 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fdb3400c1e0 tx=0x7fdb34001d40 comp rx=0 tx=0).stop 2023-10-06T11:14:41.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.827+0000 7fdb3ed9d700 1 -- 172.21.15.146:0/3758382078 reap_dead start 2023-10-06T11:14:41.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.827+0000 7fdb44d7a700 1 -- 172.21.15.146:0/3758382078 shutdown_connections 2023-10-06T11:14:41.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.827+0000 7fdb44d7a700 1 -- 172.21.15.146:0/3758382078 >> 172.21.15.146:0/3758382078 conn(0x7fdb4006f380 msgr2=0x7fdb400d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:41.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.827+0000 7fdb44d7a700 1 -- 172.21.15.146:0/3758382078 shutdown_connections 2023-10-06T11:14:41.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.827+0000 7fdb44d7a700 1 -- 172.21.15.146:0/3758382078 wait complete. 2023-10-06T11:14:41.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.828+0000 7fdb44d7a700 1 Processor -- start 2023-10-06T11:14:41.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.829+0000 7fdb44d7a700 1 -- start start 2023-10-06T11:14:41.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.829+0000 7fdb44d7a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb280041d0 0x7fdb400b6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:41.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.829+0000 7fdb44d7a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb400afc60 0x7fdb40152d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:41.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.829+0000 7fdb44d7a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb40150600 0x7fdb400b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:41.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.829+0000 7fdb44d7a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb400b00d0 con 0x7fdb400afc60 2023-10-06T11:14:41.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.829+0000 7fdb44d7a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb400b44f0 con 0x7fdb280041d0 2023-10-06T11:14:41.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.829+0000 7fdb44d7a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb40155a90 con 0x7fdb40150600 2023-10-06T11:14:41.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.829+0000 7fdb3dd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb400afc60 0x7fdb40152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:41.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.829+0000 7fdb3dd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb400afc60 0x7fdb40152d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39240/0 (socket says 172.21.15.146:39240) 2023-10-06T11:14:41.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.829+0000 7fdb3dd9b700 1 -- 172.21.15.146:0/1481744928 learned_addr learned my addr 172.21.15.146:0/1481744928 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:41.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.829+0000 7fdb3ed9d700 1 --2- 172.21.15.146:0/1481744928 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb40150600 0x7fdb400b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:41.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.829+0000 7fdb3e59c700 1 --2- 172.21.15.146:0/1481744928 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb280041d0 0x7fdb400b6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:41.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.830+0000 7fdb3dd9b700 1 -- 172.21.15.146:0/1481744928 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb40150600 msgr2=0x7fdb400b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:41.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.830+0000 7fdb3dd9b700 1 --2- 172.21.15.146:0/1481744928 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb40150600 0x7fdb400b4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:41.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.830+0000 7fdb3dd9b700 1 -- 172.21.15.146:0/1481744928 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb280041d0 msgr2=0x7fdb400b6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:41.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.830+0000 7fdb3dd9b700 1 --2- 172.21.15.146:0/1481744928 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb280041d0 0x7fdb400b6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:41.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.830+0000 7fdb3dd9b700 1 -- 172.21.15.146:0/1481744928 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb400b57a0 con 0x7fdb400afc60 2023-10-06T11:14:41.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.830+0000 7fdb3dd9b700 1 --2- 172.21.15.146:0/1481744928 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb400afc60 0x7fdb40152d10 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fdb34001120 tx=0x7fdb34015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:41.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.830+0000 7fdb2e7fc700 1 -- 172.21.15.146:0/1481744928 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb34001650 con 0x7fdb400afc60 2023-10-06T11:14:41.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.830+0000 7fdb2e7fc700 1 -- 172.21.15.146:0/1481744928 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb340070d0 con 0x7fdb400afc60 2023-10-06T11:14:41.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.830+0000 7fdb44d7a700 1 -- 172.21.15.146:0/1481744928 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb400b5d20 con 0x7fdb400afc60 2023-10-06T11:14:41.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.830+0000 7fdb2e7fc700 1 -- 172.21.15.146:0/1481744928 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb34007470 con 0x7fdb400afc60 2023-10-06T11:14:41.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.830+0000 7fdb44d7a700 1 -- 172.21.15.146:0/1481744928 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb400b02d0 con 0x7fdb400afc60 2023-10-06T11:14:41.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.831+0000 7fdb2e7fc700 1 -- 172.21.15.146:0/1481744928 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdb3401f410 con 0x7fdb400afc60 2023-10-06T11:14:41.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.832+0000 7fdb2e7fc700 1 --2- 172.21.15.146:0/1481744928 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdb20066f30 0x7fdb200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:41.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.832+0000 7fdb3e59c700 1 --2- 172.21.15.146:0/1481744928 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdb20066f30 0x7fdb200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:41.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.832+0000 7fdb2e7fc700 1 -- 172.21.15.146:0/1481744928 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdb34085fc0 con 0x7fdb400afc60 2023-10-06T11:14:41.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.832+0000 7fdb3e59c700 1 --2- 172.21.15.146:0/1481744928 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdb20066f30 0x7fdb200693e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fdb30009fd0 tx=0x7fdb3000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:41.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.834+0000 7fdb4e072b80 1 Processor -- start 2023-10-06T11:14:41.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.834+0000 7fdb4e072b80 1 -- start start 2023-10-06T11:14:41.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.835+0000 7fdb4e072b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c1a0c5b90 0x563c1a0c5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:41.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.835+0000 7fdb4e072b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c1a081aa0 0x563c1a07e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:41.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.835+0000 7fdb4e072b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563c1a07fcd0 0x563c1a07ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:41.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.835+0000 7fdb4e072b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c19ffed80 con 0x563c1a081aa0 2023-10-06T11:14:41.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.835+0000 7fdb4e072b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c19fd5b70 con 0x563c1a0c5b90 2023-10-06T11:14:41.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.835+0000 7fdb4e072b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c19fd3370 con 0x563c1a07fcd0 2023-10-06T11:14:41.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.835+0000 7fdb3dd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c1a081aa0 0x563c1a07e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:41.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.835+0000 7fdb3dd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c1a081aa0 0x563c1a07e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39242/0 (socket says 172.21.15.146:39242) 2023-10-06T11:14:41.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.835+0000 7fdb3dd9b700 1 -- 172.21.15.146:0/1484117740 learned_addr learned my addr 172.21.15.146:0/1484117740 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:41.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.835+0000 7fdb3e59c700 1 --2- 172.21.15.146:0/1484117740 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c1a0c5b90 0x563c1a0c5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:41.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.835+0000 7fdb3ed9d700 1 --2- 172.21.15.146:0/1484117740 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563c1a07fcd0 0x563c1a07ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:41.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.835+0000 7fdb3dd9b700 1 -- 172.21.15.146:0/1484117740 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563c1a07fcd0 msgr2=0x563c1a07ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:41.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.835+0000 7fdb3dd9b700 1 --2- 172.21.15.146:0/1484117740 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563c1a07fcd0 0x563c1a07ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:41.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.835+0000 7fdb3dd9b700 1 -- 172.21.15.146:0/1484117740 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c1a0c5b90 msgr2=0x563c1a0c5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:41.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.835+0000 7fdb3dd9b700 1 --2- 172.21.15.146:0/1484117740 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c1a0c5b90 0x563c1a0c5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:41.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.835+0000 7fdb3dd9b700 1 -- 172.21.15.146:0/1484117740 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c19e69370 con 0x563c1a081aa0 2023-10-06T11:14:41.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.835+0000 7fdb3dd9b700 1 --2- 172.21.15.146:0/1484117740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c1a081aa0 0x563c1a07e680 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fdb340843b0 tx=0x7fdb340842e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=962cc1424fd74a4f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:41.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.835+0000 7fdb1f7fe700 1 -- 172.21.15.146:0/1484117740 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb34056e50 con 0x563c1a081aa0 2023-10-06T11:14:41.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.835+0000 7fdb1f7fe700 1 -- 172.21.15.146:0/1484117740 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3405a0a0 con 0x563c1a081aa0 2023-10-06T11:14:41.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.835+0000 7fdb1f7fe700 1 -- 172.21.15.146:0/1484117740 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3405ddf0 con 0x563c1a081aa0 2023-10-06T11:14:41.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.836+0000 7fdb4e072b80 1 -- 172.21.15.146:0/1484117740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c1a081aa0 msgr2=0x563c1a07e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:41.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.836+0000 7fdb4e072b80 1 --2- 172.21.15.146:0/1484117740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c1a081aa0 0x563c1a07e680 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fdb340843b0 tx=0x7fdb340842e0 comp rx=0 tx=0).stop 2023-10-06T11:14:41.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.836+0000 7fdb4e072b80 1 -- 172.21.15.146:0/1484117740 shutdown_connections 2023-10-06T11:14:41.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.836+0000 7fdb4e072b80 1 --2- 172.21.15.146:0/1484117740 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563c1a07fcd0 0x563c1a07ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:41.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.836+0000 7fdb4e072b80 1 --2- 172.21.15.146:0/1484117740 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c1a0c5b90 0x563c1a0c5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:41.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.836+0000 7fdb4e072b80 1 --2- 172.21.15.146:0/1484117740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c1a081aa0 0x563c1a07e680 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:41.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.836+0000 7fdb4e072b80 1 -- 172.21.15.146:0/1484117740 >> 172.21.15.146:0/1484117740 conn(0x563c1a080170 msgr2=0x563c1a080540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:41.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.836+0000 7fdb4e072b80 1 -- 172.21.15.146:0/1484117740 shutdown_connections 2023-10-06T11:14:41.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.836+0000 7fdb4e072b80 1 -- 172.21.15.146:0/1484117740 wait complete. 2023-10-06T11:14:41.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.836+0000 7fdb4e072b80 1 -- start start 2023-10-06T11:14:41.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.837+0000 7fdb4e072b80 1 Processor -- start 2023-10-06T11:14:41.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.837+0000 7fdb4e072b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563c1a07fcd0 0x563c1a07e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:41.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.837+0000 7fdb4e072b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c1a081aa0 0x563c1a0bcbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:41.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.837+0000 7fdb4e072b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c1a0c5b90 0x563c1a0d5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:41.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.837+0000 7fdb4e072b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c19fcf160 con 0x563c1a081aa0 2023-10-06T11:14:41.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.837+0000 7fdb4e072b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c19f7a990 con 0x563c1a0c5b90 2023-10-06T11:14:41.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.837+0000 7fdb4e072b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c19f95fa0 con 0x563c1a07fcd0 2023-10-06T11:14:41.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.838+0000 7fdb4e072b80 10 client.0 _ll_register_callbacks cb 0x563c19e6c030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:14:41.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.838+0000 7fdb3dd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c1a081aa0 0x563c1a0bcbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:41.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.838+0000 7fdb3dd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c1a081aa0 0x563c1a0bcbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39254/0 (socket says 172.21.15.146:39254) 2023-10-06T11:14:41.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.838+0000 7fdb3e59c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563c1a07fcd0 0x563c1a07e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:41.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.838+0000 7fdb3dd9b700 1 -- 172.21.15.146:0/1185435318 learned_addr learned my addr 172.21.15.146:0/1185435318 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:41.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.838+0000 7fdb3ed9d700 1 --2- 172.21.15.146:0/1185435318 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c1a0c5b90 0x563c1a0d5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:41.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.838+0000 7fdb3dd9b700 1 -- 172.21.15.146:0/1185435318 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563c1a07fcd0 msgr2=0x563c1a07e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:41.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.838+0000 7fdb3dd9b700 1 --2- 172.21.15.146:0/1185435318 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563c1a07fcd0 0x563c1a07e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:41.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.838+0000 7fdb3dd9b700 1 -- 172.21.15.146:0/1185435318 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c1a0c5b90 msgr2=0x563c1a0d5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:41.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.838+0000 7fdb3dd9b700 1 --2- 172.21.15.146:0/1185435318 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c1a0c5b90 0x563c1a0d5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:41.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.838+0000 7fdb3dd9b700 1 -- 172.21.15.146:0/1185435318 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb400b02d0 con 0x563c1a081aa0 2023-10-06T11:14:41.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.838+0000 7fdb3dd9b700 1 --2- 172.21.15.146:0/1185435318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c1a081aa0 0x563c1a0bcbb0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fdb34001bb0 tx=0x7fdb3406f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0126fb974834bfb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:41.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.838+0000 7fdb1cff9700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:14:41.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.838+0000 7fdb1cff9700 1 -- 172.21.15.146:0/1185435318 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb34084070 con 0x563c1a081aa0 2023-10-06T11:14:41.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.838+0000 7fdb1cff9700 1 -- 172.21.15.146:0/1185435318 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdb3405ddf0 con 0x563c1a081aa0 2023-10-06T11:14:41.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.838+0000 7fdb4e072b80 1 -- 172.21.15.146:0/1185435318 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563c1a073790 con 0x563c1a081aa0 2023-10-06T11:14:41.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.838+0000 7fdb1cff9700 1 -- 172.21.15.146:0/1185435318 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb340841d0 con 0x563c1a081aa0 2023-10-06T11:14:41.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.838+0000 7fdb4e072b80 10 client.8283 fetch_fsmap learned FSMap version 100 2023-10-06T11:14:41.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.838+0000 7fdb4e072b80 1 -- 172.21.15.146:0/1185435318 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) v3 -- 0x563c19e0c0e0 con 0x563c1a081aa0 2023-10-06T11:14:41.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.838+0000 7fdb1cff9700 1 -- 172.21.15.146:0/1185435318 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563c1a073790 con 0x563c1a081aa0 2023-10-06T11:14:41.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.839+0000 7fdb1cff9700 1 -- 172.21.15.146:0/1185435318 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 100) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fdb340570b0 con 0x563c1a081aa0 2023-10-06T11:14:41.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.839+0000 7fdb4e072b80 10 client.8283 fetch_fsmap finished waiting for FSMap version 100 2023-10-06T11:14:41.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.839+0000 7fdb4e072b80 10 client.8283 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2023-10-06T11:14:41.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.839+0000 7fdb4e072b80 20 client.8283 populate_metadata read hostname 'smithi146' 2023-10-06T11:14:41.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.839+0000 7fdb4e072b80 1 --2- 172.21.15.146:0/1185435318 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x563c1a0d62b0 0x563c1a0d66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:41.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.839+0000 7fdb4e072b80 4 client.8283 mds_command: new command op to 8103 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:14:41.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.839+0000 7fdb4e072b80 1 -- 172.21.15.146:0/1185435318 --> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563c1a0506c0 con 0x563c1a0d62b0 2023-10-06T11:14:41.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.839+0000 7fdb3e59c700 1 --2- 172.21.15.146:0/1185435318 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x563c1a0d62b0 0x563c1a0d66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:41.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.839+0000 7fdb1cff9700 10 client.8283 ms_handle_connect on v2:172.21.15.146:6835/409226151 2023-10-06T11:14:41.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.839+0000 7fdb3e59c700 1 --2- 172.21.15.146:0/1185435318 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x563c1a0d62b0 0x563c1a0d66b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3260a7208576a7de server_cookie=d0765411cf3ce986 in_seq=0 out_seq=0 2023-10-06T11:14:41.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.839+0000 7fdb1cff9700 1 -- 172.21.15.146:0/1185435318 <== mds.0 v2:172.21.15.146:6835/409226151 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x563c1a0506c0 con 0x563c1a0d62b0 2023-10-06T11:14:41.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.840+0000 7fdb1cff9700 10 client.8283 handle_command_reply: tid=0 2023-10-06T11:14:41.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.840+0000 7fdb4e072b80 1 client.8283 shutdown 2023-10-06T11:14:41.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.840+0000 7fdb4e072b80 1 -- 172.21.15.146:0/1185435318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c1a081aa0 msgr2=0x563c1a0bcbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:41.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.840+0000 7fdb4e072b80 1 --2- 172.21.15.146:0/1185435318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c1a081aa0 0x563c1a0bcbb0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fdb34001bb0 tx=0x7fdb3406f000 comp rx=0 tx=0).stop 2023-10-06T11:14:41.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.840+0000 7fdb4e072b80 1 -- 172.21.15.146:0/1185435318 shutdown_connections 2023-10-06T11:14:41.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.840+0000 7fdb4e072b80 1 --2- 172.21.15.146:0/1185435318 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x563c1a0d62b0 0x563c1a0d66b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:41.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.840+0000 7fdb4e072b80 1 --2- 172.21.15.146:0/1185435318 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c1a0c5b90 0x563c1a0d5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:41.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.840+0000 7fdb1cff9700 0 client.8283 ms_handle_reset on v2:172.21.15.146:6835/409226151 2023-10-06T11:14:41.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.840+0000 7fdb4e072b80 1 --2- 172.21.15.146:0/1185435318 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563c1a07fcd0 0x563c1a07e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:41.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.840+0000 7fdb4e072b80 1 --2- 172.21.15.146:0/1185435318 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c1a081aa0 0x563c1a0bcbb0 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:41.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.840+0000 7fdb4e072b80 1 -- 172.21.15.146:0/1185435318 >> 172.21.15.146:0/1185435318 conn(0x563c1a080170 msgr2=0x563c1a07b680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:41.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.840+0000 7fdb4e072b80 1 -- 172.21.15.146:0/1185435318 shutdown_connections 2023-10-06T11:14:41.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.840+0000 7fdb4e072b80 1 -- 172.21.15.146:0/1185435318 wait complete. 2023-10-06T11:14:41.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.840+0000 7fdb4e072b80 20 client.8283 trim_cache size 0 max 16384 2023-10-06T11:14:41.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.856+0000 7fdb4e072b80 1 Processor -- start 2023-10-06T11:14:41.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.856+0000 7fdb4e072b80 1 -- start start 2023-10-06T11:14:41.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.857+0000 7fdb4e072b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c1a07fcd0 0x563c1a07f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:41.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.857+0000 7fdb4e072b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c1a081aa0 0x563c1a0c3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:41.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.857+0000 7fdb4e072b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563c1a0c5b90 0x563c1a0c2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:41.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.857+0000 7fdb4e072b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c19e51f30 con 0x563c1a081aa0 2023-10-06T11:14:41.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.857+0000 7fdb4e072b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c1a0bee80 con 0x563c1a07fcd0 2023-10-06T11:14:41.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.857+0000 7fdb4e072b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c1a0c4000 con 0x563c1a0c5b90 2023-10-06T11:14:41.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.857+0000 7fdb3dd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c1a081aa0 0x563c1a0c3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:41.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.857+0000 7fdb3dd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c1a081aa0 0x563c1a0c3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39264/0 (socket says 172.21.15.146:39264) 2023-10-06T11:14:41.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.857+0000 7fdb3dd9b700 1 -- 172.21.15.146:0/4232319426 learned_addr learned my addr 172.21.15.146:0/4232319426 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:41.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.857+0000 7fdb3e59c700 1 --2- 172.21.15.146:0/4232319426 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c1a07fcd0 0x563c1a07f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:41.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.857+0000 7fdb3dd9b700 1 -- 172.21.15.146:0/4232319426 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563c1a0c5b90 msgr2=0x563c1a0c2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:41.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.857+0000 7fdb3ed9d700 1 --2- 172.21.15.146:0/4232319426 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563c1a0c5b90 0x563c1a0c2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:41.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.857+0000 7fdb3dd9b700 1 --2- 172.21.15.146:0/4232319426 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563c1a0c5b90 0x563c1a0c2400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:41.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.857+0000 7fdb3dd9b700 1 -- 172.21.15.146:0/4232319426 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c1a07fcd0 msgr2=0x563c1a07f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:41.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.857+0000 7fdb3dd9b700 1 --2- 172.21.15.146:0/4232319426 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c1a07fcd0 0x563c1a07f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:41.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.857+0000 7fdb3dd9b700 1 -- 172.21.15.146:0/4232319426 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c19f9d880 con 0x563c1a081aa0 2023-10-06T11:14:41.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.857+0000 7fdb3e59c700 1 --2- 172.21.15.146:0/4232319426 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c1a07fcd0 0x563c1a07f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:41.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.857+0000 7fdb3dd9b700 1 --2- 172.21.15.146:0/4232319426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c1a081aa0 0x563c1a0c3580 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fdb34056b50 tx=0x7fdb34080040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a89d61a5468e70a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:41.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.857+0000 7fdb1ffff700 1 -- 172.21.15.146:0/4232319426 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb34084050 con 0x563c1a081aa0 2023-10-06T11:14:41.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.857+0000 7fdb1ffff700 1 -- 172.21.15.146:0/4232319426 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb34056c20 con 0x563c1a081aa0 2023-10-06T11:14:41.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.857+0000 7fdb1ffff700 1 -- 172.21.15.146:0/4232319426 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3405ddf0 con 0x563c1a081aa0 2023-10-06T11:14:41.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.858+0000 7fdb4e072b80 1 -- 172.21.15.146:0/4232319426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c1a081aa0 msgr2=0x563c1a0c3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:41.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.858+0000 7fdb4e072b80 1 --2- 172.21.15.146:0/4232319426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c1a081aa0 0x563c1a0c3580 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fdb34056b50 tx=0x7fdb34080040 comp rx=0 tx=0).stop 2023-10-06T11:14:41.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.858+0000 7fdb4e072b80 1 -- 172.21.15.146:0/4232319426 shutdown_connections 2023-10-06T11:14:41.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.858+0000 7fdb4e072b80 1 --2- 172.21.15.146:0/4232319426 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563c1a0c5b90 0x563c1a0c2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:41.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.858+0000 7fdb4e072b80 1 --2- 172.21.15.146:0/4232319426 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c1a07fcd0 0x563c1a07f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:41.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.858+0000 7fdb4e072b80 1 --2- 172.21.15.146:0/4232319426 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c1a081aa0 0x563c1a0c3580 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:41.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.858+0000 7fdb4e072b80 1 -- 172.21.15.146:0/4232319426 >> 172.21.15.146:0/4232319426 conn(0x563c1a080170 msgr2=0x563c1a080540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:41.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.858+0000 7fdb4e072b80 1 -- 172.21.15.146:0/4232319426 shutdown_connections 2023-10-06T11:14:41.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.858+0000 7fdb4e072b80 1 -- 172.21.15.146:0/4232319426 wait complete. 2023-10-06T11:14:41.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.858+0000 7fdb4e072b80 1 -- start start 2023-10-06T11:14:41.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.858+0000 7fdb4e072b80 1 Processor -- start 2023-10-06T11:14:41.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.859+0000 7fdb4e072b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c1a07fcd0 0x563c1a121c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:41.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.859+0000 7fdb4e072b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563c1a081aa0 0x563c1a0bb360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:41.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.859+0000 7fdb4e072b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c1a0c5b90 0x563c1a0bb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:41.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.859+0000 7fdb4e072b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c1a0c3190 con 0x563c1a0c5b90 2023-10-06T11:14:41.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.859+0000 7fdb4e072b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c1a0a46f0 con 0x563c1a07fcd0 2023-10-06T11:14:41.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.859+0000 7fdb4e072b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c1a0a6fe0 con 0x563c1a081aa0 2023-10-06T11:14:41.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.859+0000 7fdb4e072b80 10 client.0 _ll_register_callbacks cb 0x563c19e6c030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:14:41.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.859+0000 7fdb3ed9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c1a0c5b90 0x563c1a0bb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:41.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.859+0000 7fdb3ed9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c1a0c5b90 0x563c1a0bb8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39272/0 (socket says 172.21.15.146:39272) 2023-10-06T11:14:41.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.859+0000 7fdb3ed9d700 1 -- 172.21.15.146:0/388583433 learned_addr learned my addr 172.21.15.146:0/388583433 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:41.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.860+0000 7fdb3dd9b700 1 --2- 172.21.15.146:0/388583433 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563c1a081aa0 0x563c1a0bb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:41.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.860+0000 7fdb3e59c700 1 --2- 172.21.15.146:0/388583433 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c1a07fcd0 0x563c1a121c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:41.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.860+0000 7fdb3ed9d700 1 -- 172.21.15.146:0/388583433 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563c1a081aa0 msgr2=0x563c1a0bb360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:41.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.860+0000 7fdb3ed9d700 1 --2- 172.21.15.146:0/388583433 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563c1a081aa0 0x563c1a0bb360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:41.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.860+0000 7fdb3ed9d700 1 -- 172.21.15.146:0/388583433 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c1a07fcd0 msgr2=0x563c1a121c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:41.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.860+0000 7fdb3ed9d700 1 --2- 172.21.15.146:0/388583433 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c1a07fcd0 0x563c1a121c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:41.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.860+0000 7fdb3ed9d700 1 -- 172.21.15.146:0/388583433 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb400b02d0 con 0x563c1a0c5b90 2023-10-06T11:14:41.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.860+0000 7fdb3ed9d700 1 --2- 172.21.15.146:0/388583433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c1a0c5b90 0x563c1a0bb8a0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fdb40088c60 tx=0x7fdb38009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8ec07f1bc4ef36c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:41.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.860+0000 7fdb1cff9700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:14:41.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.860+0000 7fdb1cff9700 1 -- 172.21.15.146:0/388583433 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3801c070 con 0x563c1a0c5b90 2023-10-06T11:14:41.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.860+0000 7fdb1cff9700 1 -- 172.21.15.146:0/388583433 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdb38015650 con 0x563c1a0c5b90 2023-10-06T11:14:41.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.860+0000 7fdb4e072b80 1 -- 172.21.15.146:0/388583433 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdb3405a0a0 con 0x563c1a0c5b90 2023-10-06T11:14:41.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.860+0000 7fdb1cff9700 1 -- 172.21.15.146:0/388583433 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb38015a20 con 0x563c1a0c5b90 2023-10-06T11:14:41.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.860+0000 7fdb4e072b80 10 client.8289 fetch_fsmap learned FSMap version 100 2023-10-06T11:14:41.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.860+0000 7fdb4e072b80 1 -- 172.21.15.146:0/388583433 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) v3 -- 0x563c19f84570 con 0x563c1a0c5b90 2023-10-06T11:14:41.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.860+0000 7fdb1cff9700 1 -- 172.21.15.146:0/388583433 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3405a0a0 con 0x563c1a0c5b90 2023-10-06T11:14:41.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.860+0000 7fdb1cff9700 1 -- 172.21.15.146:0/388583433 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 100) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fdb38015b80 con 0x563c1a0c5b90 2023-10-06T11:14:41.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.860+0000 7fdb4e072b80 10 client.8289 fetch_fsmap finished waiting for FSMap version 100 2023-10-06T11:14:41.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.860+0000 7fdb4e072b80 10 client.8289 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2023-10-06T11:14:41.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.860+0000 7fdb4e072b80 20 client.8289 populate_metadata read hostname 'smithi146' 2023-10-06T11:14:41.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.860+0000 7fdb4e072b80 1 --2- 172.21.15.146:0/388583433 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x563c1a0bc0b0 0x563c1a0a33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:41.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.861+0000 7fdb4e072b80 4 client.8289 mds_command: new command op to 8103 tid=0[{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2023-10-06T11:14:41.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.861+0000 7fdb4e072b80 1 -- 172.21.15.146:0/388583433 --> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) v1 -- 0x563c19f71f00 con 0x563c1a0bc0b0 2023-10-06T11:14:41.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.861+0000 7fdb3e59c700 1 --2- 172.21.15.146:0/388583433 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x563c1a0bc0b0 0x563c1a0a33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:41.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.861+0000 7fdb1cff9700 10 client.8289 ms_handle_connect on v2:172.21.15.146:6835/409226151 2023-10-06T11:14:41.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.861+0000 7fdb3e59c700 1 --2- 172.21.15.146:0/388583433 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x563c1a0bc0b0 0x563c1a0a33b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9a5f05833f7e0c4 server_cookie=8ec19d39576e3d19 in_seq=0 out_seq=0 2023-10-06T11:14:41.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.864+0000 7fdb1cff9700 1 -- 172.21.15.146:0/388583433 <== mds.0 v2:172.21.15.146:6835/409226151 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x563c19f71f00 con 0x563c1a0bc0b0 2023-10-06T11:14:41.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.864+0000 7fdb1cff9700 10 client.8289 handle_command_reply: tid=0 2023-10-06T11:14:41.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.864+0000 7fdb4e072b80 1 client.8289 shutdown 2023-10-06T11:14:41.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.864+0000 7fdb4e072b80 1 -- 172.21.15.146:0/388583433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c1a0c5b90 msgr2=0x563c1a0bb8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:41.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.864+0000 7fdb4e072b80 1 --2- 172.21.15.146:0/388583433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c1a0c5b90 0x563c1a0bb8a0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fdb40088c60 tx=0x7fdb38009040 comp rx=0 tx=0).stop 2023-10-06T11:14:41.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.864+0000 7fdb4e072b80 1 -- 172.21.15.146:0/388583433 shutdown_connections 2023-10-06T11:14:41.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.864+0000 7fdb4e072b80 1 --2- 172.21.15.146:0/388583433 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x563c1a0bc0b0 0x563c1a0a33b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:41.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.864+0000 7fdb4e072b80 1 --2- 172.21.15.146:0/388583433 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x563c1a0c5b90 0x563c1a0bb8a0 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:41.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.864+0000 7fdb4e072b80 1 --2- 172.21.15.146:0/388583433 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c1a07fcd0 0x563c1a121c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:41.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.864+0000 7fdb4e072b80 1 --2- 172.21.15.146:0/388583433 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x563c1a081aa0 0x563c1a0bb360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:41.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.864+0000 7fdb4e072b80 1 -- 172.21.15.146:0/388583433 >> 172.21.15.146:0/388583433 conn(0x563c1a080170 msgr2=0x563c1a07a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:41.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.864+0000 7fdb1cff9700 0 client.8289 ms_handle_reset on v2:172.21.15.146:6835/409226151 2023-10-06T11:14:41.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.864+0000 7fdb4e072b80 1 -- 172.21.15.146:0/388583433 shutdown_connections 2023-10-06T11:14:41.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.864+0000 7fdb4e072b80 1 -- 172.21.15.146:0/388583433 wait complete. 2023-10-06T11:14:41.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.864+0000 7fdb4e072b80 20 client.8289 trim_cache size 0 max 16384 2023-10-06T11:14:41.871 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:14:41.871 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0, 2023-10-06T11:14:41.871 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_tag": "05f08bb9-f8a5-4f3f-aefb-5a902817ec9b", 2023-10-06T11:14:41.871 INFO:teuthology.orchestra.run.smithi146.stdout: "mode": "asynchronous" 2023-10-06T11:14:41.871 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:14:41.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.865+0000 7fdb44d7a700 1 -- 172.21.15.146:0/1481744928 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdb20066f30 msgr2=0x7fdb200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:41.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.865+0000 7fdb44d7a700 1 --2- 172.21.15.146:0/1481744928 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdb20066f30 0x7fdb200693e0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fdb30009fd0 tx=0x7fdb3000b040 comp rx=0 tx=0).stop 2023-10-06T11:14:41.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.865+0000 7fdb44d7a700 1 -- 172.21.15.146:0/1481744928 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb400afc60 msgr2=0x7fdb40152d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:41.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.865+0000 7fdb44d7a700 1 --2- 172.21.15.146:0/1481744928 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb400afc60 0x7fdb40152d10 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fdb34001120 tx=0x7fdb34015000 comp rx=0 tx=0).stop 2023-10-06T11:14:41.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.865+0000 7fdb44d7a700 1 -- 172.21.15.146:0/1481744928 shutdown_connections 2023-10-06T11:14:41.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.865+0000 7fdb44d7a700 1 --2- 172.21.15.146:0/1481744928 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdb20066f30 0x7fdb200693e0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:41.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.865+0000 7fdb44d7a700 1 --2- 172.21.15.146:0/1481744928 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb40150600 0x7fdb400b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:41.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.865+0000 7fdb44d7a700 1 --2- 172.21.15.146:0/1481744928 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb280041d0 0x7fdb400b6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:41.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.865+0000 7fdb44d7a700 1 --2- 172.21.15.146:0/1481744928 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb400afc60 0x7fdb40152d10 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:41.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.865+0000 7fdb44d7a700 1 -- 172.21.15.146:0/1481744928 >> 172.21.15.146:0/1481744928 conn(0x7fdb4006f380 msgr2=0x7fdb40152480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:41.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.865+0000 7fdb44d7a700 1 -- 172.21.15.146:0/1481744928 shutdown_connections 2023-10-06T11:14:41.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:41.865+0000 7fdb44d7a700 1 -- 172.21.15.146:0/1481744928 wait complete. 2023-10-06T11:14:41.879 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 scrub pause 2023-10-06T11:14:42.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.015+0000 7fcb4e628700 1 Processor -- start 2023-10-06T11:14:42.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.015+0000 7fcb4e628700 1 -- start start 2023-10-06T11:14:42.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.016+0000 7fcb4e628700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcb480ae730 0x7fcb480aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.016+0000 7fcb4e628700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb480ae2a0 con 0x7fcb4815a160 2023-10-06T11:14:42.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.016+0000 7fcb4e628700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb4815a530 con 0x7fcb480cb950 2023-10-06T11:14:42.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.016+0000 7fcb4e628700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb480c5cb0 con 0x7fcb480ae730 2023-10-06T11:14:42.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.016+0000 7fcb47fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fcb4815a160 0x7fcb480c55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45228/0 (socket says 172.21.15.146:45228) 2023-10-06T11:14:42.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.016+0000 7fcb47fff700 1 -- 172.21.15.146:0/3246296022 learned_addr learned my addr 172.21.15.146:0/3246296022 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:14:42.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.016+0000 7fcb477fe700 1 --2- 172.21.15.146:0/3246296022 >> v2:172.21.15.151:3300/0 conn(0x7fcb480ae730 0x7fcb480aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.016+0000 7fcb46ffd700 1 -- 172.21.15.146:0/3246296022 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1173619483 0 0) 0x7fcb480ae2a0 con 0x7fcb4815a160 2023-10-06T11:14:42.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.016+0000 7fcb46ffd700 1 -- 172.21.15.146:0/3246296022 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb30003570 con 0x7fcb4815a160 2023-10-06T11:14:42.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.016+0000 7fcb477fe700 1 -- 172.21.15.146:0/3246296022 >> v1:172.21.15.151:6789/0 conn(0x7fcb480cb950 legacy=0x7fcb480cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.016+0000 7fcb477fe700 1 -- 172.21.15.146:0/3246296022 >> v1:172.21.15.146:6789/0 conn(0x7fcb4815a160 legacy=0x7fcb480c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.016+0000 7fcb477fe700 1 -- 172.21.15.146:0/3246296022 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb480af0f0 con 0x7fcb480ae730 2023-10-06T11:14:42.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.017+0000 7fcb477fe700 1 --2- 172.21.15.146:0/3246296022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb480ae730 0x7fcb480aebb0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c0098e0 tx=0x7fcb3c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27cf0bf7f4fa09d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:42.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.017+0000 7fcb46ffd700 1 -- 172.21.15.146:0/3246296022 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c00b640 con 0x7fcb480ae730 2023-10-06T11:14:42.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.017+0000 7fcb46ffd700 1 -- 172.21.15.146:0/3246296022 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3c00b7a0 con 0x7fcb480ae730 2023-10-06T11:14:42.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.017+0000 7fcb46ffd700 1 -- 172.21.15.146:0/3246296022 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c00bb20 con 0x7fcb480ae730 2023-10-06T11:14:42.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.017+0000 7fcb4e628700 1 -- 172.21.15.146:0/3246296022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb480ae730 msgr2=0x7fcb480aebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.017+0000 7fcb4e628700 1 --2- 172.21.15.146:0/3246296022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb480ae730 0x7fcb480aebb0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c0098e0 tx=0x7fcb3c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.017+0000 7fcb4e628700 1 -- 172.21.15.146:0/3246296022 shutdown_connections 2023-10-06T11:14:42.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.017+0000 7fcb4e628700 1 --2- 172.21.15.146:0/3246296022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb480ae730 0x7fcb480aebb0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.017+0000 7fcb4e628700 1 -- 172.21.15.146:0/3246296022 >> 172.21.15.146:0/3246296022 conn(0x7fcb4806f380 msgr2=0x7fcb480d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:42.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.017+0000 7fcb4e628700 1 -- 172.21.15.146:0/3246296022 shutdown_connections 2023-10-06T11:14:42.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.017+0000 7fcb4e628700 1 -- 172.21.15.146:0/3246296022 wait complete. 2023-10-06T11:14:42.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.018+0000 7fcb4e628700 1 Processor -- start 2023-10-06T11:14:42.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.019+0000 7fcb4e628700 1 -- start start 2023-10-06T11:14:42.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.019+0000 7fcb4e628700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb480ae730 0x7fcb4816add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.019+0000 7fcb4e628700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb480cb950 0x7fcb480b5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.019+0000 7fcb4e628700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb4815a160 0x7fcb480b5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.019+0000 7fcb4e628700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb480b4250 con 0x7fcb480cb950 2023-10-06T11:14:42.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.019+0000 7fcb4e628700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4816b310 con 0x7fcb4815a160 2023-10-06T11:14:42.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.019+0000 7fcb4e628700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb480b3640 con 0x7fcb480ae730 2023-10-06T11:14:42.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.019+0000 7fcb477fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb480cb950 0x7fcb480b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.019+0000 7fcb477fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb480cb950 0x7fcb480b5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39280/0 (socket says 172.21.15.146:39280) 2023-10-06T11:14:42.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.019+0000 7fcb477fe700 1 -- 172.21.15.146:0/713192488 learned_addr learned my addr 172.21.15.146:0/713192488 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:42.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.020+0000 7fcb47fff700 1 --2- 172.21.15.146:0/713192488 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb480ae730 0x7fcb4816add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.020+0000 7fcb4cbc5700 1 --2- 172.21.15.146:0/713192488 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb4815a160 0x7fcb480b5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.020+0000 7fcb477fe700 1 -- 172.21.15.146:0/713192488 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb480ae730 msgr2=0x7fcb4816add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.020+0000 7fcb477fe700 1 --2- 172.21.15.146:0/713192488 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb480ae730 0x7fcb4816add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.020+0000 7fcb477fe700 1 -- 172.21.15.146:0/713192488 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb4815a160 msgr2=0x7fcb480b5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.020+0000 7fcb477fe700 1 --2- 172.21.15.146:0/713192488 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb4815a160 0x7fcb480b5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.020+0000 7fcb477fe700 1 -- 172.21.15.146:0/713192488 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb3c009420 con 0x7fcb480cb950 2023-10-06T11:14:42.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.020+0000 7fcb477fe700 1 --2- 172.21.15.146:0/713192488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb480cb950 0x7fcb480b5100 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c0093f0 tx=0x7fcb3c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:42.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.020+0000 7fcb2ffff700 1 -- 172.21.15.146:0/713192488 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c000d10 con 0x7fcb480cb950 2023-10-06T11:14:42.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.020+0000 7fcb2ffff700 1 -- 172.21.15.146:0/713192488 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3c00b910 con 0x7fcb480cb950 2023-10-06T11:14:42.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.020+0000 7fcb4e628700 1 -- 172.21.15.146:0/713192488 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb480b3920 con 0x7fcb480cb950 2023-10-06T11:14:42.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.020+0000 7fcb2ffff700 1 -- 172.21.15.146:0/713192488 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c025650 con 0x7fcb480cb950 2023-10-06T11:14:42.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.020+0000 7fcb4e628700 1 -- 172.21.15.146:0/713192488 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb480b3ee0 con 0x7fcb480cb950 2023-10-06T11:14:42.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.021+0000 7fcb2ffff700 1 -- 172.21.15.146:0/713192488 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcb3c023070 con 0x7fcb480cb950 2023-10-06T11:14:42.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.022+0000 7fcb2ffff700 1 --2- 172.21.15.146:0/713192488 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcb34066f30 0x7fcb340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.022+0000 7fcb2ffff700 1 -- 172.21.15.146:0/713192488 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcb3c085c10 con 0x7fcb480cb950 2023-10-06T11:14:42.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.022+0000 7fcb47fff700 1 --2- 172.21.15.146:0/713192488 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcb34066f30 0x7fcb340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.022+0000 7fcb47fff700 1 --2- 172.21.15.146:0/713192488 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcb34066f30 0x7fcb340693e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fcb480cc860 tx=0x7fcb38009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:42.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.024+0000 7fcb57920b80 1 Processor -- start 2023-10-06T11:14:42.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.024+0000 7fcb57920b80 1 -- start start 2023-10-06T11:14:42.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.025+0000 7fcb57920b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a9cd626ad0 0x55a9cd626ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.025+0000 7fcb57920b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a9cd5e29e0 0x55a9cd5df5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.025+0000 7fcb57920b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9cd5e0c10 0x55a9cd5dfb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.025+0000 7fcb57920b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9cd55fcc0 con 0x55a9cd5e29e0 2023-10-06T11:14:42.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.025+0000 7fcb57920b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9cd536ab0 con 0x55a9cd5e0c10 2023-10-06T11:14:42.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.025+0000 7fcb57920b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a9cd5342b0 con 0x55a9cd626ad0 2023-10-06T11:14:42.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.025+0000 7fcb477fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a9cd5e29e0 0x55a9cd5df5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.025+0000 7fcb477fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a9cd5e29e0 0x55a9cd5df5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39282/0 (socket says 172.21.15.146:39282) 2023-10-06T11:14:42.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.025+0000 7fcb477fe700 1 -- 172.21.15.146:0/3770199521 learned_addr learned my addr 172.21.15.146:0/3770199521 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:42.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.025+0000 7fcb47fff700 1 --2- 172.21.15.146:0/3770199521 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a9cd626ad0 0x55a9cd626ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.025+0000 7fcb4cbc5700 1 --2- 172.21.15.146:0/3770199521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9cd5e0c10 0x55a9cd5dfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.025+0000 7fcb477fe700 1 -- 172.21.15.146:0/3770199521 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a9cd626ad0 msgr2=0x55a9cd626ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:42.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.025+0000 7fcb477fe700 1 --2- 172.21.15.146:0/3770199521 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a9cd626ad0 0x55a9cd626ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.025+0000 7fcb477fe700 1 -- 172.21.15.146:0/3770199521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9cd5e0c10 msgr2=0x55a9cd5dfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:42.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.025+0000 7fcb477fe700 1 --2- 172.21.15.146:0/3770199521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9cd5e0c10 0x55a9cd5dfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.025+0000 7fcb477fe700 1 -- 172.21.15.146:0/3770199521 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a9cd3ca2b0 con 0x55a9cd5e29e0 2023-10-06T11:14:42.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.025+0000 7fcb477fe700 1 --2- 172.21.15.146:0/3770199521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a9cd5e29e0 0x55a9cd5df5c0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c056530 tx=0x7fcb3c083e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11b53d77dcd88081 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:42.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.025+0000 7fcb2d7fa700 1 -- 172.21.15.146:0/3770199521 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c00bac0 con 0x55a9cd5e29e0 2023-10-06T11:14:42.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.025+0000 7fcb2d7fa700 1 -- 172.21.15.146:0/3770199521 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3c057040 con 0x55a9cd5e29e0 2023-10-06T11:14:42.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.025+0000 7fcb2d7fa700 1 -- 172.21.15.146:0/3770199521 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c056940 con 0x55a9cd5e29e0 2023-10-06T11:14:42.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.026+0000 7fcb57920b80 1 -- 172.21.15.146:0/3770199521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a9cd5e29e0 msgr2=0x55a9cd5df5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.026+0000 7fcb57920b80 1 --2- 172.21.15.146:0/3770199521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a9cd5e29e0 0x55a9cd5df5c0 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c056530 tx=0x7fcb3c083e90 comp rx=0 tx=0).stop 2023-10-06T11:14:42.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.026+0000 7fcb57920b80 1 -- 172.21.15.146:0/3770199521 shutdown_connections 2023-10-06T11:14:42.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.026+0000 7fcb57920b80 1 --2- 172.21.15.146:0/3770199521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9cd5e0c10 0x55a9cd5dfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.026+0000 7fcb57920b80 1 --2- 172.21.15.146:0/3770199521 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a9cd626ad0 0x55a9cd626ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.026+0000 7fcb57920b80 1 --2- 172.21.15.146:0/3770199521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a9cd5e29e0 0x55a9cd5df5c0 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.026+0000 7fcb57920b80 1 -- 172.21.15.146:0/3770199521 >> 172.21.15.146:0/3770199521 conn(0x55a9cd5e10b0 msgr2=0x55a9cd5e1480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:42.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.026+0000 7fcb57920b80 1 -- 172.21.15.146:0/3770199521 shutdown_connections 2023-10-06T11:14:42.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.026+0000 7fcb57920b80 1 -- 172.21.15.146:0/3770199521 wait complete. 2023-10-06T11:14:42.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.027+0000 7fcb57920b80 1 -- start start 2023-10-06T11:14:42.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.027+0000 7fcb57920b80 1 Processor -- start 2023-10-06T11:14:42.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.027+0000 7fcb57920b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9cd5e0c10 0x55a9cd606390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.027+0000 7fcb57920b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a9cd5e29e0 0x55a9cd636370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.027+0000 7fcb57920b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a9cd626ad0 0x55a9cd6368b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.027+0000 7fcb57920b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9cd5300a0 con 0x55a9cd5e29e0 2023-10-06T11:14:42.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.027+0000 7fcb57920b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9cd4db8d0 con 0x55a9cd5e0c10 2023-10-06T11:14:42.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.027+0000 7fcb57920b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a9cd4f6ee0 con 0x55a9cd626ad0 2023-10-06T11:14:42.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.028+0000 7fcb57920b80 10 client.0 _ll_register_callbacks cb 0x55a9cd3ccf70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:14:42.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.028+0000 7fcb477fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a9cd5e29e0 0x55a9cd636370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.028+0000 7fcb47fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9cd5e0c10 0x55a9cd606390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.028+0000 7fcb477fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a9cd5e29e0 0x55a9cd636370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39296/0 (socket says 172.21.15.146:39296) 2023-10-06T11:14:42.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.028+0000 7fcb477fe700 1 -- 172.21.15.146:0/3206421580 learned_addr learned my addr 172.21.15.146:0/3206421580 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:42.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.028+0000 7fcb4cbc5700 1 --2- 172.21.15.146:0/3206421580 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a9cd626ad0 0x55a9cd6368b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.028+0000 7fcb477fe700 1 -- 172.21.15.146:0/3206421580 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a9cd626ad0 msgr2=0x55a9cd6368b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:42.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.028+0000 7fcb477fe700 1 --2- 172.21.15.146:0/3206421580 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a9cd626ad0 0x55a9cd6368b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.028+0000 7fcb477fe700 1 -- 172.21.15.146:0/3206421580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9cd5e0c10 msgr2=0x55a9cd606390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:42.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.028+0000 7fcb477fe700 1 --2- 172.21.15.146:0/3206421580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9cd5e0c10 0x55a9cd606390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.028+0000 7fcb477fe700 1 -- 172.21.15.146:0/3206421580 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb480b3ee0 con 0x55a9cd5e29e0 2023-10-06T11:14:42.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.028+0000 7fcb477fe700 1 --2- 172.21.15.146:0/3206421580 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a9cd5e29e0 0x55a9cd636370 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c052e40 tx=0x7fcb3c02f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ea43b54c5d8036e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:42.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.028+0000 7fcb267fc700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:14:42.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.028+0000 7fcb267fc700 1 -- 172.21.15.146:0/3206421580 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c05d8e0 con 0x55a9cd5e29e0 2023-10-06T11:14:42.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.028+0000 7fcb267fc700 1 -- 172.21.15.146:0/3206421580 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcb3c06a030 con 0x55a9cd5e29e0 2023-10-06T11:14:42.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.028+0000 7fcb57920b80 1 -- 172.21.15.146:0/3206421580 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a9cd5d46d0 con 0x55a9cd5e29e0 2023-10-06T11:14:42.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.028+0000 7fcb267fc700 1 -- 172.21.15.146:0/3206421580 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb3c056940 con 0x55a9cd5e29e0 2023-10-06T11:14:42.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.028+0000 7fcb57920b80 10 client.8301 fetch_fsmap learned FSMap version 100 2023-10-06T11:14:42.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.028+0000 7fcb57920b80 1 -- 172.21.15.146:0/3206421580 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) v3 -- 0x55a9cd36d020 con 0x55a9cd5e29e0 2023-10-06T11:14:42.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.028+0000 7fcb267fc700 1 -- 172.21.15.146:0/3206421580 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a9cd5d46d0 con 0x55a9cd5e29e0 2023-10-06T11:14:42.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.028+0000 7fcb267fc700 1 -- 172.21.15.146:0/3206421580 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 100) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fcb3c05d450 con 0x55a9cd5e29e0 2023-10-06T11:14:42.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.028+0000 7fcb57920b80 10 client.8301 fetch_fsmap finished waiting for FSMap version 100 2023-10-06T11:14:42.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.028+0000 7fcb57920b80 10 client.8301 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2023-10-06T11:14:42.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.029+0000 7fcb57920b80 20 client.8301 populate_metadata read hostname 'smithi146' 2023-10-06T11:14:42.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.029+0000 7fcb57920b80 1 --2- 172.21.15.146:0/3206421580 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x55a9cd622310 0x55a9cd5dfab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.029+0000 7fcb57920b80 4 client.8301 mds_command: new command op to 8103 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:14:42.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.029+0000 7fcb57920b80 1 -- 172.21.15.146:0/3206421580 --> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a9cd5b1600 con 0x55a9cd622310 2023-10-06T11:14:42.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.029+0000 7fcb47fff700 1 --2- 172.21.15.146:0/3206421580 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x55a9cd622310 0x55a9cd5dfab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.029+0000 7fcb267fc700 10 client.8301 ms_handle_connect on v2:172.21.15.146:6835/409226151 2023-10-06T11:14:42.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.029+0000 7fcb47fff700 1 --2- 172.21.15.146:0/3206421580 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x55a9cd622310 0x55a9cd5dfab0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e4936c3b8328e90 server_cookie=4a3c543654894c5a in_seq=0 out_seq=0 2023-10-06T11:14:42.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.029+0000 7fcb267fc700 1 -- 172.21.15.146:0/3206421580 <== mds.0 v2:172.21.15.146:6835/409226151 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55a9cd5b1600 con 0x55a9cd622310 2023-10-06T11:14:42.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.029+0000 7fcb267fc700 10 client.8301 handle_command_reply: tid=0 2023-10-06T11:14:42.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.029+0000 7fcb57920b80 1 client.8301 shutdown 2023-10-06T11:14:42.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.030+0000 7fcb57920b80 1 -- 172.21.15.146:0/3206421580 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a9cd5e29e0 msgr2=0x55a9cd636370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.030+0000 7fcb57920b80 1 --2- 172.21.15.146:0/3206421580 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a9cd5e29e0 0x55a9cd636370 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c052e40 tx=0x7fcb3c02f000 comp rx=0 tx=0).stop 2023-10-06T11:14:42.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.030+0000 7fcb57920b80 1 -- 172.21.15.146:0/3206421580 shutdown_connections 2023-10-06T11:14:42.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.030+0000 7fcb57920b80 1 --2- 172.21.15.146:0/3206421580 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x55a9cd622310 0x55a9cd5dfab0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.030+0000 7fcb57920b80 1 --2- 172.21.15.146:0/3206421580 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a9cd626ad0 0x55a9cd6368b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.030+0000 7fcb267fc700 0 client.8301 ms_handle_reset on v2:172.21.15.146:6835/409226151 2023-10-06T11:14:42.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.030+0000 7fcb57920b80 1 --2- 172.21.15.146:0/3206421580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9cd5e0c10 0x55a9cd606390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.030+0000 7fcb57920b80 1 --2- 172.21.15.146:0/3206421580 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a9cd5e29e0 0x55a9cd636370 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.030+0000 7fcb57920b80 1 -- 172.21.15.146:0/3206421580 >> 172.21.15.146:0/3206421580 conn(0x55a9cd5e10b0 msgr2=0x55a9cd624600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:42.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.030+0000 7fcb57920b80 1 -- 172.21.15.146:0/3206421580 shutdown_connections 2023-10-06T11:14:42.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.030+0000 7fcb57920b80 1 -- 172.21.15.146:0/3206421580 wait complete. 2023-10-06T11:14:42.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.030+0000 7fcb57920b80 20 client.8301 trim_cache size 0 max 16384 2023-10-06T11:14:42.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.045+0000 7fcb57920b80 1 Processor -- start 2023-10-06T11:14:42.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.045+0000 7fcb57920b80 1 -- start start 2023-10-06T11:14:42.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.046+0000 7fcb57920b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9cd5e0c10 0x55a9cd608f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.046+0000 7fcb57920b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a9cd5e29e0 0x55a9cd6361d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.046+0000 7fcb57920b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a9cd626ad0 0x55a9cd6252c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.046+0000 7fcb57920b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9cd3b2e70 con 0x55a9cd5e29e0 2023-10-06T11:14:42.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.046+0000 7fcb57920b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9cd5bf110 con 0x55a9cd5e0c10 2023-10-06T11:14:42.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.046+0000 7fcb57920b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a9cd629e90 con 0x55a9cd626ad0 2023-10-06T11:14:42.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.046+0000 7fcb477fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a9cd5e29e0 0x55a9cd6361d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.046+0000 7fcb477fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a9cd5e29e0 0x55a9cd6361d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39302/0 (socket says 172.21.15.146:39302) 2023-10-06T11:14:42.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.046+0000 7fcb477fe700 1 -- 172.21.15.146:0/2156427775 learned_addr learned my addr 172.21.15.146:0/2156427775 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:42.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.046+0000 7fcb47fff700 1 --2- 172.21.15.146:0/2156427775 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9cd5e0c10 0x55a9cd608f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.046+0000 7fcb4cbc5700 1 --2- 172.21.15.146:0/2156427775 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a9cd626ad0 0x55a9cd6252c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.046+0000 7fcb477fe700 1 -- 172.21.15.146:0/2156427775 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a9cd626ad0 msgr2=0x55a9cd6252c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:42.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.046+0000 7fcb477fe700 1 --2- 172.21.15.146:0/2156427775 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a9cd626ad0 0x55a9cd6252c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.046+0000 7fcb477fe700 1 -- 172.21.15.146:0/2156427775 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9cd5e0c10 msgr2=0x55a9cd608f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:42.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.046+0000 7fcb477fe700 1 --2- 172.21.15.146:0/2156427775 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9cd5e0c10 0x55a9cd608f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.046+0000 7fcb477fe700 1 -- 172.21.15.146:0/2156427775 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a9cd4fe7c0 con 0x55a9cd5e29e0 2023-10-06T11:14:42.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.046+0000 7fcb477fe700 1 --2- 172.21.15.146:0/2156427775 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a9cd5e29e0 0x55a9cd6361d0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c054f30 tx=0x7fcb3c06e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5d8b1fbd3bae319 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:42.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.047+0000 7fcb2dffb700 1 -- 172.21.15.146:0/2156427775 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c056940 con 0x55a9cd5e29e0 2023-10-06T11:14:42.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.047+0000 7fcb2dffb700 1 -- 172.21.15.146:0/2156427775 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3c052c80 con 0x55a9cd5e29e0 2023-10-06T11:14:42.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.047+0000 7fcb2dffb700 1 -- 172.21.15.146:0/2156427775 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c05d8e0 con 0x55a9cd5e29e0 2023-10-06T11:14:42.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.047+0000 7fcb57920b80 1 -- 172.21.15.146:0/2156427775 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a9cd5e29e0 msgr2=0x55a9cd6361d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.047+0000 7fcb57920b80 1 --2- 172.21.15.146:0/2156427775 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a9cd5e29e0 0x55a9cd6361d0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c054f30 tx=0x7fcb3c06e040 comp rx=0 tx=0).stop 2023-10-06T11:14:42.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.047+0000 7fcb57920b80 1 -- 172.21.15.146:0/2156427775 shutdown_connections 2023-10-06T11:14:42.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.047+0000 7fcb57920b80 1 --2- 172.21.15.146:0/2156427775 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a9cd626ad0 0x55a9cd6252c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.047+0000 7fcb57920b80 1 --2- 172.21.15.146:0/2156427775 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9cd5e0c10 0x55a9cd608f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.047+0000 7fcb57920b80 1 --2- 172.21.15.146:0/2156427775 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a9cd5e29e0 0x55a9cd6361d0 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.047+0000 7fcb57920b80 1 -- 172.21.15.146:0/2156427775 >> 172.21.15.146:0/2156427775 conn(0x55a9cd5e10b0 msgr2=0x55a9cd62a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:42.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.047+0000 7fcb57920b80 1 -- 172.21.15.146:0/2156427775 shutdown_connections 2023-10-06T11:14:42.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.047+0000 7fcb57920b80 1 -- 172.21.15.146:0/2156427775 wait complete. 2023-10-06T11:14:42.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.048+0000 7fcb57920b80 1 -- start start 2023-10-06T11:14:42.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.048+0000 7fcb57920b80 1 Processor -- start 2023-10-06T11:14:42.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.049+0000 7fcb57920b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a9cd5e0c10 0x55a9cd63f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.049+0000 7fcb57920b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9cd5e29e0 0x55a9cd688d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.049+0000 7fcb57920b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a9cd626ad0 0x55a9cd60f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.049+0000 7fcb57920b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9cd60fe90 con 0x55a9cd626ad0 2023-10-06T11:14:42.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.049+0000 7fcb57920b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9cd60ee70 con 0x55a9cd5e29e0 2023-10-06T11:14:42.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.049+0000 7fcb57920b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a9cd60f150 con 0x55a9cd5e0c10 2023-10-06T11:14:42.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.049+0000 7fcb57920b80 10 client.0 _ll_register_callbacks cb 0x55a9cd3ccf70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:14:42.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.049+0000 7fcb4cbc5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a9cd626ad0 0x55a9cd60f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.049+0000 7fcb4cbc5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a9cd626ad0 0x55a9cd60f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39306/0 (socket says 172.21.15.146:39306) 2023-10-06T11:14:42.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.049+0000 7fcb4cbc5700 1 -- 172.21.15.146:0/923324269 learned_addr learned my addr 172.21.15.146:0/923324269 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:42.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.049+0000 7fcb47fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a9cd5e0c10 0x55a9cd63f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.049+0000 7fcb477fe700 1 --2- 172.21.15.146:0/923324269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9cd5e29e0 0x55a9cd688d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.049+0000 7fcb4cbc5700 1 -- 172.21.15.146:0/923324269 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a9cd5e0c10 msgr2=0x55a9cd63f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:42.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.049+0000 7fcb4cbc5700 1 --2- 172.21.15.146:0/923324269 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a9cd5e0c10 0x55a9cd63f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.049+0000 7fcb4cbc5700 1 -- 172.21.15.146:0/923324269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9cd5e29e0 msgr2=0x55a9cd688d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:42.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.049+0000 7fcb4cbc5700 1 --2- 172.21.15.146:0/923324269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9cd5e29e0 0x55a9cd688d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.049+0000 7fcb4cbc5700 1 -- 172.21.15.146:0/923324269 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb480b3ee0 con 0x55a9cd626ad0 2023-10-06T11:14:42.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.049+0000 7fcb47fff700 1 --2- 172.21.15.146:0/923324269 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a9cd5e0c10 0x55a9cd63f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:14:42.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.049+0000 7fcb4cbc5700 1 --2- 172.21.15.146:0/923324269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a9cd626ad0 0x55a9cd60f950 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fcb40007fd0 tx=0x7fcb40001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1995e5b519e0a2dd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:42.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.049+0000 7fcb267fc700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:14:42.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.049+0000 7fcb267fc700 1 -- 172.21.15.146:0/923324269 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb40014800 con 0x55a9cd626ad0 2023-10-06T11:14:42.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.049+0000 7fcb267fc700 1 -- 172.21.15.146:0/923324269 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcb40021c50 con 0x55a9cd626ad0 2023-10-06T11:14:42.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.049+0000 7fcb57920b80 1 -- 172.21.15.146:0/923324269 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcb3c057040 con 0x55a9cd626ad0 2023-10-06T11:14:42.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.049+0000 7fcb267fc700 1 -- 172.21.15.146:0/923324269 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb40021e10 con 0x55a9cd626ad0 2023-10-06T11:14:42.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.049+0000 7fcb57920b80 10 client.8307 fetch_fsmap learned FSMap version 100 2023-10-06T11:14:42.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.049+0000 7fcb57920b80 1 -- 172.21.15.146:0/923324269 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) v3 -- 0x55a9cd4e54b0 con 0x55a9cd626ad0 2023-10-06T11:14:42.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.050+0000 7fcb267fc700 1 -- 172.21.15.146:0/923324269 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3c057040 con 0x55a9cd626ad0 2023-10-06T11:14:42.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.050+0000 7fcb267fc700 1 -- 172.21.15.146:0/923324269 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 100) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fcb40014b70 con 0x55a9cd626ad0 2023-10-06T11:14:42.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.050+0000 7fcb57920b80 10 client.8307 fetch_fsmap finished waiting for FSMap version 100 2023-10-06T11:14:42.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.050+0000 7fcb57920b80 10 client.8307 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2023-10-06T11:14:42.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.050+0000 7fcb57920b80 20 client.8307 populate_metadata read hostname 'smithi146' 2023-10-06T11:14:42.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.050+0000 7fcb57920b80 1 --2- 172.21.15.146:0/923324269 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x55a9cd6363f0 0x55a9cd68b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.050+0000 7fcb57920b80 4 client.8307 mds_command: new command op to 8103 tid=0[{"prefix": "scrub pause"}] 2023-10-06T11:14:42.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.050+0000 7fcb57920b80 1 -- 172.21.15.146:0/923324269 --> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] -- command(tid 0: {"prefix": "scrub pause"}) v1 -- 0x55a9cd4d2e40 con 0x55a9cd6363f0 2023-10-06T11:14:42.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.050+0000 7fcb47fff700 1 --2- 172.21.15.146:0/923324269 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x55a9cd6363f0 0x55a9cd68b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.050+0000 7fcb267fc700 10 client.8307 ms_handle_connect on v2:172.21.15.146:6835/409226151 2023-10-06T11:14:42.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.050+0000 7fcb47fff700 1 --2- 172.21.15.146:0/923324269 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x55a9cd6363f0 0x55a9cd68b720 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e1c60f299d17451 server_cookie=b91baeae2c669502 in_seq=0 out_seq=0 2023-10-06T11:14:42.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.050+0000 7fcb267fc700 1 -- 172.21.15.146:0/923324269 <== mds.0 v2:172.21.15.146:6835/409226151 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x55a9cd4d2e40 con 0x55a9cd6363f0 2023-10-06T11:14:42.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.050+0000 7fcb267fc700 10 client.8307 handle_command_reply: tid=0 2023-10-06T11:14:42.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.050+0000 7fcb57920b80 1 client.8307 shutdown 2023-10-06T11:14:42.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.050+0000 7fcb57920b80 1 -- 172.21.15.146:0/923324269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a9cd626ad0 msgr2=0x55a9cd60f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.050+0000 7fcb57920b80 1 --2- 172.21.15.146:0/923324269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a9cd626ad0 0x55a9cd60f950 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fcb40007fd0 tx=0x7fcb40001690 comp rx=0 tx=0).stop 2023-10-06T11:14:42.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.050+0000 7fcb57920b80 1 -- 172.21.15.146:0/923324269 shutdown_connections 2023-10-06T11:14:42.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.050+0000 7fcb57920b80 1 --2- 172.21.15.146:0/923324269 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x55a9cd6363f0 0x55a9cd68b720 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.050+0000 7fcb57920b80 1 --2- 172.21.15.146:0/923324269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a9cd626ad0 0x55a9cd60f950 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.050+0000 7fcb267fc700 0 client.8307 ms_handle_reset on v2:172.21.15.146:6835/409226151 2023-10-06T11:14:42.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.050+0000 7fcb57920b80 1 --2- 172.21.15.146:0/923324269 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a9cd5e0c10 0x55a9cd63f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.050+0000 7fcb57920b80 1 --2- 172.21.15.146:0/923324269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9cd5e29e0 0x55a9cd688d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.050+0000 7fcb57920b80 1 -- 172.21.15.146:0/923324269 >> 172.21.15.146:0/923324269 conn(0x55a9cd5e10b0 msgr2=0x55a9cd6252c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:42.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.051+0000 7fcb57920b80 1 -- 172.21.15.146:0/923324269 shutdown_connections 2023-10-06T11:14:42.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.051+0000 7fcb57920b80 1 -- 172.21.15.146:0/923324269 wait complete. 2023-10-06T11:14:42.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.051+0000 7fcb57920b80 20 client.8307 trim_cache size 0 max 16384 2023-10-06T11:14:42.060 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:14:42.060 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0 2023-10-06T11:14:42.060 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:14:42.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.051+0000 7fcb4e628700 1 -- 172.21.15.146:0/713192488 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcb34066f30 msgr2=0x7fcb340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.051+0000 7fcb4e628700 1 --2- 172.21.15.146:0/713192488 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcb34066f30 0x7fcb340693e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fcb480cc860 tx=0x7fcb38009040 comp rx=0 tx=0).stop 2023-10-06T11:14:42.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.051+0000 7fcb4e628700 1 -- 172.21.15.146:0/713192488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb480cb950 msgr2=0x7fcb480b5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.051+0000 7fcb4e628700 1 --2- 172.21.15.146:0/713192488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb480cb950 0x7fcb480b5100 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c0093f0 tx=0x7fcb3c017000 comp rx=0 tx=0).stop 2023-10-06T11:14:42.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.051+0000 7fcb4e628700 1 -- 172.21.15.146:0/713192488 shutdown_connections 2023-10-06T11:14:42.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.051+0000 7fcb4e628700 1 --2- 172.21.15.146:0/713192488 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcb34066f30 0x7fcb340693e0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.051+0000 7fcb4e628700 1 --2- 172.21.15.146:0/713192488 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb4815a160 0x7fcb480b5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.051+0000 7fcb4e628700 1 --2- 172.21.15.146:0/713192488 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb480ae730 0x7fcb4816add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.051+0000 7fcb4e628700 1 --2- 172.21.15.146:0/713192488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb480cb950 0x7fcb480b5100 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.051+0000 7fcb4e628700 1 -- 172.21.15.146:0/713192488 >> 172.21.15.146:0/713192488 conn(0x7fcb4806f380 msgr2=0x7fcb480c55a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:42.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.051+0000 7fcb4e628700 1 -- 172.21.15.146:0/713192488 shutdown_connections 2023-10-06T11:14:42.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.051+0000 7fcb4e628700 1 -- 172.21.15.146:0/713192488 wait complete. 2023-10-06T11:14:42.065 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 scrub status 2023-10-06T11:14:42.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.180+0000 7fb1eee9b700 1 Processor -- start 2023-10-06T11:14:42.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.180+0000 7fb1eee9b700 1 -- start start 2023-10-06T11:14:42.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.181+0000 7fb1eee9b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1e80ae730 0x7fb1e80aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.181+0000 7fb1eee9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb1e80cb950 0x7fb1e80cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.181+0000 7fb1eee9b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1e80ae2a0 con 0x7fb1e815a160 2023-10-06T11:14:42.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.181+0000 7fb1eee9b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1e815a530 con 0x7fb1e80cb950 2023-10-06T11:14:42.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.181+0000 7fb1eee9b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e80c5cb0 con 0x7fb1e80ae730 2023-10-06T11:14:42.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.181+0000 7fb1ecc37700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb1e815a160 0x7fb1e80c55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45232/0 (socket says 172.21.15.146:45232) 2023-10-06T11:14:42.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.181+0000 7fb1ecc37700 1 -- 172.21.15.146:0/834425128 learned_addr learned my addr 172.21.15.146:0/834425128 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:14:42.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.181+0000 7fb1ed438700 1 --2- 172.21.15.146:0/834425128 >> v2:172.21.15.146:3300/0 conn(0x7fb1e80cb950 0x7fb1e80cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.182+0000 7fb1dffff700 1 --2- 172.21.15.146:0/834425128 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1e80ae730 0x7fb1e80aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.182+0000 7fb1df7fe700 1 -- 172.21.15.146:0/834425128 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 634268293 0 0) 0x7fb1e80ae2a0 con 0x7fb1e815a160 2023-10-06T11:14:42.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.182+0000 7fb1df7fe700 1 -- 172.21.15.146:0/834425128 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1d0003570 con 0x7fb1e815a160 2023-10-06T11:14:42.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.182+0000 7fb1ed438700 1 -- 172.21.15.146:0/834425128 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1e80ae730 msgr2=0x7fb1e80aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:42.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.182+0000 7fb1ed438700 1 --2- 172.21.15.146:0/834425128 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1e80ae730 0x7fb1e80aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.182+0000 7fb1ed438700 1 -- 172.21.15.146:0/834425128 >> v1:172.21.15.146:6789/0 conn(0x7fb1e815a160 legacy=0x7fb1e80c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.182+0000 7fb1ed438700 1 -- 172.21.15.146:0/834425128 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e80ad690 con 0x7fb1e80cb950 2023-10-06T11:14:42.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.182+0000 7fb1ed438700 1 --2- 172.21.15.146:0/834425128 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1e80cb950 0x7fb1e80cbdb0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fb1e00098e0 tx=0x7fb1e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ac9981e271f5a83 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:42.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.182+0000 7fb1df7fe700 1 -- 172.21.15.146:0/834425128 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e000b640 con 0x7fb1e80cb950 2023-10-06T11:14:42.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.182+0000 7fb1df7fe700 1 -- 172.21.15.146:0/834425128 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e000b7a0 con 0x7fb1e80cb950 2023-10-06T11:14:42.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.182+0000 7fb1df7fe700 1 -- 172.21.15.146:0/834425128 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e000bb20 con 0x7fb1e80cb950 2023-10-06T11:14:42.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.182+0000 7fb1eee9b700 1 -- 172.21.15.146:0/834425128 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1e80cb950 msgr2=0x7fb1e80cbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.182+0000 7fb1eee9b700 1 --2- 172.21.15.146:0/834425128 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1e80cb950 0x7fb1e80cbdb0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fb1e00098e0 tx=0x7fb1e00091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.182+0000 7fb1eee9b700 1 -- 172.21.15.146:0/834425128 shutdown_connections 2023-10-06T11:14:42.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.182+0000 7fb1eee9b700 1 --2- 172.21.15.146:0/834425128 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1e80cb950 0x7fb1e80cbdb0 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.182+0000 7fb1eee9b700 1 --2- 172.21.15.146:0/834425128 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1e80ae730 0x7fb1e80aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.182+0000 7fb1eee9b700 1 -- 172.21.15.146:0/834425128 >> 172.21.15.146:0/834425128 conn(0x7fb1e806f380 msgr2=0x7fb1e80d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:42.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.182+0000 7fb1eee9b700 1 -- 172.21.15.146:0/834425128 shutdown_connections 2023-10-06T11:14:42.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.183+0000 7fb1eee9b700 1 -- 172.21.15.146:0/834425128 wait complete. 2023-10-06T11:14:42.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.184+0000 7fb1eee9b700 1 Processor -- start 2023-10-06T11:14:42.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.184+0000 7fb1eee9b700 1 -- start start 2023-10-06T11:14:42.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.184+0000 7fb1eee9b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1e80ae730 0x7fb1e80b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.184+0000 7fb1eee9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1e80cb950 0x7fb1e8157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.184+0000 7fb1eee9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1e815a160 0x7fb1e80b4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.184+0000 7fb1eee9b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e80b3f60 con 0x7fb1e815a160 2023-10-06T11:14:42.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.184+0000 7fb1eee9b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e80b4180 con 0x7fb1e80cb950 2023-10-06T11:14:42.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.184+0000 7fb1eee9b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e80b4460 con 0x7fb1e80ae730 2023-10-06T11:14:42.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.185+0000 7fb1ed438700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1e815a160 0x7fb1e80b4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.185+0000 7fb1ed438700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1e815a160 0x7fb1e80b4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39322/0 (socket says 172.21.15.146:39322) 2023-10-06T11:14:42.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.185+0000 7fb1ed438700 1 -- 172.21.15.146:0/1746149817 learned_addr learned my addr 172.21.15.146:0/1746149817 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:42.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.185+0000 7fb1ecc37700 1 --2- 172.21.15.146:0/1746149817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1e80ae730 0x7fb1e80b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.185+0000 7fb1dffff700 1 --2- 172.21.15.146:0/1746149817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1e80cb950 0x7fb1e8157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.185+0000 7fb1ed438700 1 -- 172.21.15.146:0/1746149817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1e80ae730 msgr2=0x7fb1e80b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.185+0000 7fb1ed438700 1 --2- 172.21.15.146:0/1746149817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1e80ae730 0x7fb1e80b35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.185+0000 7fb1ed438700 1 -- 172.21.15.146:0/1746149817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1e80cb950 msgr2=0x7fb1e8157ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.185+0000 7fb1ed438700 1 --2- 172.21.15.146:0/1746149817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1e80cb950 0x7fb1e8157ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.185+0000 7fb1ed438700 1 -- 172.21.15.146:0/1746149817 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e0009420 con 0x7fb1e815a160 2023-10-06T11:14:42.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.185+0000 7fb1ed438700 1 --2- 172.21.15.146:0/1746149817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1e815a160 0x7fb1e80b4ba0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fb1e8088c60 tx=0x7fb1e0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:42.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.185+0000 7fb1dcff9700 1 -- 172.21.15.146:0/1746149817 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e000b9e0 con 0x7fb1e815a160 2023-10-06T11:14:42.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.185+0000 7fb1dcff9700 1 -- 172.21.15.146:0/1746149817 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e0026430 con 0x7fb1e815a160 2023-10-06T11:14:42.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.185+0000 7fb1eee9b700 1 -- 172.21.15.146:0/1746149817 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1e80af4c0 con 0x7fb1e815a160 2023-10-06T11:14:42.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.185+0000 7fb1dcff9700 1 -- 172.21.15.146:0/1746149817 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e00267f0 con 0x7fb1e815a160 2023-10-06T11:14:42.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.185+0000 7fb1eee9b700 1 -- 172.21.15.146:0/1746149817 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e80af850 con 0x7fb1e815a160 2023-10-06T11:14:42.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.186+0000 7fb1dcff9700 1 -- 172.21.15.146:0/1746149817 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb1e0023030 con 0x7fb1e815a160 2023-10-06T11:14:42.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.187+0000 7fb1dcff9700 1 --2- 172.21.15.146:0/1746149817 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb1d4066f30 0x7fb1d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.187+0000 7fb1ecc37700 1 --2- 172.21.15.146:0/1746149817 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb1d4066f30 0x7fb1d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.187+0000 7fb1dcff9700 1 -- 172.21.15.146:0/1746149817 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb1e0085f10 con 0x7fb1e815a160 2023-10-06T11:14:42.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.187+0000 7fb1ecc37700 1 --2- 172.21.15.146:0/1746149817 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb1d4066f30 0x7fb1d40693e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fb1e4000f80 tx=0x7fb1e4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:42.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.189+0000 7fb1f8193b80 1 Processor -- start 2023-10-06T11:14:42.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.189+0000 7fb1f8193b80 1 -- start start 2023-10-06T11:14:42.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.190+0000 7fb1f8193b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b39da1ae0 0x564b39da1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.190+0000 7fb1f8193b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b39d5d9f0 0x564b39d5a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.190+0000 7fb1f8193b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b39d5bc20 0x564b39d5ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.190+0000 7fb1f8193b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b39cdacd0 con 0x564b39da1ae0 2023-10-06T11:14:42.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.190+0000 7fb1f8193b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b39cb1ac0 con 0x564b39d5bc20 2023-10-06T11:14:42.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.190+0000 7fb1f8193b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x564b39caf2c0 con 0x564b39d5d9f0 2023-10-06T11:14:42.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.190+0000 7fb1ecc37700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b39da1ae0 0x564b39da1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.190+0000 7fb1ecc37700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b39da1ae0 0x564b39da1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39336/0 (socket says 172.21.15.146:39336) 2023-10-06T11:14:42.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.190+0000 7fb1ecc37700 1 -- 172.21.15.146:0/1107482893 learned_addr learned my addr 172.21.15.146:0/1107482893 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:42.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.190+0000 7fb1ed438700 1 --2- 172.21.15.146:0/1107482893 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b39d5bc20 0x564b39d5ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.190+0000 7fb1dffff700 1 --2- 172.21.15.146:0/1107482893 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b39d5d9f0 0x564b39d5a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.190+0000 7fb1ecc37700 1 -- 172.21.15.146:0/1107482893 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b39d5d9f0 msgr2=0x564b39d5a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:42.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.190+0000 7fb1ecc37700 1 --2- 172.21.15.146:0/1107482893 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b39d5d9f0 0x564b39d5a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.190+0000 7fb1ecc37700 1 -- 172.21.15.146:0/1107482893 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b39d5bc20 msgr2=0x564b39d5ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:42.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.190+0000 7fb1ecc37700 1 --2- 172.21.15.146:0/1107482893 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b39d5bc20 0x564b39d5ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.190+0000 7fb1ecc37700 1 -- 172.21.15.146:0/1107482893 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b39b452c0 con 0x564b39da1ae0 2023-10-06T11:14:42.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.190+0000 7fb1ed438700 1 --2- 172.21.15.146:0/1107482893 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b39d5bc20 0x564b39d5ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:42.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.190+0000 7fb1ecc37700 1 --2- 172.21.15.146:0/1107482893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b39da1ae0 0x564b39da1eb0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fb1e400fd50 tx=0x7fb1e4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6354f5c630550b5e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:42.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.190+0000 7fb1cdffb700 1 -- 172.21.15.146:0/1107482893 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e40148e0 con 0x564b39da1ae0 2023-10-06T11:14:42.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.190+0000 7fb1cdffb700 1 -- 172.21.15.146:0/1107482893 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e4014a40 con 0x564b39da1ae0 2023-10-06T11:14:42.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.190+0000 7fb1cdffb700 1 -- 172.21.15.146:0/1107482893 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e4014dc0 con 0x564b39da1ae0 2023-10-06T11:14:42.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.191+0000 7fb1f8193b80 1 -- 172.21.15.146:0/1107482893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b39da1ae0 msgr2=0x564b39da1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.191+0000 7fb1f8193b80 1 --2- 172.21.15.146:0/1107482893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b39da1ae0 0x564b39da1eb0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fb1e400fd50 tx=0x7fb1e4015000 comp rx=0 tx=0).stop 2023-10-06T11:14:42.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.191+0000 7fb1f8193b80 1 -- 172.21.15.146:0/1107482893 shutdown_connections 2023-10-06T11:14:42.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.191+0000 7fb1f8193b80 1 --2- 172.21.15.146:0/1107482893 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b39d5bc20 0x564b39d5ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.191+0000 7fb1f8193b80 1 --2- 172.21.15.146:0/1107482893 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b39da1ae0 0x564b39da1eb0 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.191+0000 7fb1f8193b80 1 --2- 172.21.15.146:0/1107482893 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b39d5d9f0 0x564b39d5a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.191+0000 7fb1f8193b80 1 -- 172.21.15.146:0/1107482893 >> 172.21.15.146:0/1107482893 conn(0x564b39d5c0c0 msgr2=0x564b39d5c490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:42.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.191+0000 7fb1f8193b80 1 -- 172.21.15.146:0/1107482893 shutdown_connections 2023-10-06T11:14:42.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.191+0000 7fb1f8193b80 1 -- 172.21.15.146:0/1107482893 wait complete. 2023-10-06T11:14:42.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.191+0000 7fb1f8193b80 1 -- start start 2023-10-06T11:14:42.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.192+0000 7fb1f8193b80 1 Processor -- start 2023-10-06T11:14:42.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.192+0000 7fb1f8193b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b39d5bc20 0x564b39d84a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.192+0000 7fb1f8193b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b39d5d9f0 0x564b39d81a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.192+0000 7fb1f8193b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b39da1ae0 0x564b39d81f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.192+0000 7fb1f8193b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b39cab0b0 con 0x564b39d5d9f0 2023-10-06T11:14:42.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.192+0000 7fb1f8193b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b39c568e0 con 0x564b39da1ae0 2023-10-06T11:14:42.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.192+0000 7fb1f8193b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x564b39c71ef0 con 0x564b39d5bc20 2023-10-06T11:14:42.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.192+0000 7fb1f8193b80 10 client.0 _ll_register_callbacks cb 0x564b39b47f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:14:42.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.193+0000 7fb1dffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b39d5d9f0 0x564b39d81a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.193+0000 7fb1dffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b39d5d9f0 0x564b39d81a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39340/0 (socket says 172.21.15.146:39340) 2023-10-06T11:14:42.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.193+0000 7fb1ed438700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b39da1ae0 0x564b39d81f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.193+0000 7fb1dffff700 1 -- 172.21.15.146:0/1363006345 learned_addr learned my addr 172.21.15.146:0/1363006345 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:42.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.193+0000 7fb1ecc37700 1 --2- 172.21.15.146:0/1363006345 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b39d5bc20 0x564b39d84a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.193+0000 7fb1dffff700 1 -- 172.21.15.146:0/1363006345 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b39d5bc20 msgr2=0x564b39d84a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:42.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.193+0000 7fb1dffff700 1 --2- 172.21.15.146:0/1363006345 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b39d5bc20 0x564b39d84a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.193+0000 7fb1dffff700 1 -- 172.21.15.146:0/1363006345 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b39da1ae0 msgr2=0x564b39d81f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:42.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.193+0000 7fb1dffff700 1 --2- 172.21.15.146:0/1363006345 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b39da1ae0 0x564b39d81f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.193+0000 7fb1dffff700 1 -- 172.21.15.146:0/1363006345 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d0003570 con 0x564b39d5d9f0 2023-10-06T11:14:42.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.193+0000 7fb1dffff700 1 --2- 172.21.15.146:0/1363006345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b39d5d9f0 0x564b39d81a00 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8013970 tx=0x7fb1d8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc949d930fd1b69 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:42.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.193+0000 7fb1c6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:14:42.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.193+0000 7fb1c6ffd700 1 -- 172.21.15.146:0/1363006345 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d8011780 con 0x564b39d5d9f0 2023-10-06T11:14:42.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.193+0000 7fb1c6ffd700 1 -- 172.21.15.146:0/1363006345 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb1d801fc80 con 0x564b39d5d9f0 2023-10-06T11:14:42.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.193+0000 7fb1f8193b80 1 -- 172.21.15.146:0/1363006345 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564b39d4f6e0 con 0x564b39d5d9f0 2023-10-06T11:14:42.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.193+0000 7fb1c6ffd700 1 -- 172.21.15.146:0/1363006345 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb1d801fe40 con 0x564b39d5d9f0 2023-10-06T11:14:42.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.193+0000 7fb1f8193b80 10 client.8322 fetch_fsmap learned FSMap version 100 2023-10-06T11:14:42.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.193+0000 7fb1f8193b80 1 -- 172.21.15.146:0/1363006345 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) v3 -- 0x564b39ae8030 con 0x564b39d5d9f0 2023-10-06T11:14:42.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.193+0000 7fb1c6ffd700 1 -- 172.21.15.146:0/1363006345 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564b39d4f6e0 con 0x564b39d5d9f0 2023-10-06T11:14:42.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.194+0000 7fb1c6ffd700 1 -- 172.21.15.146:0/1363006345 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 100) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb1d8011af0 con 0x564b39d5d9f0 2023-10-06T11:14:42.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.194+0000 7fb1f8193b80 10 client.8322 fetch_fsmap finished waiting for FSMap version 100 2023-10-06T11:14:42.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.194+0000 7fb1f8193b80 10 client.8322 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2023-10-06T11:14:42.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.194+0000 7fb1f8193b80 20 client.8322 populate_metadata read hostname 'smithi146' 2023-10-06T11:14:42.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.194+0000 7fb1f8193b80 1 --2- 172.21.15.146:0/1363006345 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x564b39d81300 0x564b39d9da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.194+0000 7fb1f8193b80 4 client.8322 mds_command: new command op to 8103 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:14:42.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.194+0000 7fb1f8193b80 1 -- 172.21.15.146:0/1363006345 --> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564b39d2c610 con 0x564b39d81300 2023-10-06T11:14:42.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.194+0000 7fb1ecc37700 1 --2- 172.21.15.146:0/1363006345 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x564b39d81300 0x564b39d9da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.194+0000 7fb1c6ffd700 10 client.8322 ms_handle_connect on v2:172.21.15.146:6835/409226151 2023-10-06T11:14:42.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.194+0000 7fb1ecc37700 1 --2- 172.21.15.146:0/1363006345 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x564b39d81300 0x564b39d9da10 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa1fa92400b8231b server_cookie=5f4ee5dd6c7032e3 in_seq=0 out_seq=0 2023-10-06T11:14:42.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.194+0000 7fb1c6ffd700 1 -- 172.21.15.146:0/1363006345 <== mds.0 v2:172.21.15.146:6835/409226151 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x564b39d2c610 con 0x564b39d81300 2023-10-06T11:14:42.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.194+0000 7fb1c6ffd700 10 client.8322 handle_command_reply: tid=0 2023-10-06T11:14:42.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.194+0000 7fb1f8193b80 1 client.8322 shutdown 2023-10-06T11:14:42.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.195+0000 7fb1f8193b80 1 -- 172.21.15.146:0/1363006345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b39d5d9f0 msgr2=0x564b39d81a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.195+0000 7fb1f8193b80 1 --2- 172.21.15.146:0/1363006345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b39d5d9f0 0x564b39d81a00 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8013970 tx=0x7fb1d8008040 comp rx=0 tx=0).stop 2023-10-06T11:14:42.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.195+0000 7fb1f8193b80 1 -- 172.21.15.146:0/1363006345 shutdown_connections 2023-10-06T11:14:42.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.195+0000 7fb1f8193b80 1 --2- 172.21.15.146:0/1363006345 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x564b39d81300 0x564b39d9da10 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.195+0000 7fb1f8193b80 1 --2- 172.21.15.146:0/1363006345 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b39da1ae0 0x564b39d81f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.195+0000 7fb1f8193b80 1 --2- 172.21.15.146:0/1363006345 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b39d5bc20 0x564b39d84a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.195+0000 7fb1c6ffd700 0 client.8322 ms_handle_reset on v2:172.21.15.146:6835/409226151 2023-10-06T11:14:42.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.195+0000 7fb1f8193b80 1 --2- 172.21.15.146:0/1363006345 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b39d5d9f0 0x564b39d81a00 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.195+0000 7fb1f8193b80 1 -- 172.21.15.146:0/1363006345 >> 172.21.15.146:0/1363006345 conn(0x564b39d5c0c0 msgr2=0x564b39d9f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:42.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.195+0000 7fb1f8193b80 1 -- 172.21.15.146:0/1363006345 shutdown_connections 2023-10-06T11:14:42.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.195+0000 7fb1f8193b80 1 -- 172.21.15.146:0/1363006345 wait complete. 2023-10-06T11:14:42.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.195+0000 7fb1f8193b80 20 client.8322 trim_cache size 0 max 16384 2023-10-06T11:14:42.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.211+0000 7fb1f8193b80 1 Processor -- start 2023-10-06T11:14:42.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.211+0000 7fb1f8193b80 1 -- start start 2023-10-06T11:14:42.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.212+0000 7fb1f8193b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b39d5bc20 0x564b39daa100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.212+0000 7fb1f8193b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b39d5d9f0 0x564b39d9c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.212+0000 7fb1f8193b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b39da1ae0 0x564b39d56c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.212+0000 7fb1f8193b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b39b2de80 con 0x564b39d5bc20 2023-10-06T11:14:42.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.212+0000 7fb1f8193b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b39d80a40 con 0x564b39d5d9f0 2023-10-06T11:14:42.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.212+0000 7fb1f8193b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x564b39d86400 con 0x564b39da1ae0 2023-10-06T11:14:42.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.212+0000 7fb1ecc37700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b39d5bc20 0x564b39daa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.212+0000 7fb1ecc37700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b39d5bc20 0x564b39daa100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39348/0 (socket says 172.21.15.146:39348) 2023-10-06T11:14:42.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.212+0000 7fb1ecc37700 1 -- 172.21.15.146:0/516433805 learned_addr learned my addr 172.21.15.146:0/516433805 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:42.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.212+0000 7fb1ed438700 1 --2- 172.21.15.146:0/516433805 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b39da1ae0 0x564b39d56c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.212+0000 7fb1dffff700 1 --2- 172.21.15.146:0/516433805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b39d5d9f0 0x564b39d9c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.212+0000 7fb1ecc37700 1 -- 172.21.15.146:0/516433805 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b39da1ae0 msgr2=0x564b39d56c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:42.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.212+0000 7fb1ecc37700 1 --2- 172.21.15.146:0/516433805 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b39da1ae0 0x564b39d56c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.212+0000 7fb1ecc37700 1 -- 172.21.15.146:0/516433805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b39d5d9f0 msgr2=0x564b39d9c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:42.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.212+0000 7fb1ecc37700 1 --2- 172.21.15.146:0/516433805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b39d5d9f0 0x564b39d9c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.212+0000 7fb1ecc37700 1 -- 172.21.15.146:0/516433805 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b39d5ba90 con 0x564b39d5bc20 2023-10-06T11:14:42.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.212+0000 7fb1ed438700 1 --2- 172.21.15.146:0/516433805 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b39da1ae0 0x564b39d56c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:42.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.212+0000 7fb1ecc37700 1 --2- 172.21.15.146:0/516433805 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b39d5bc20 0x564b39daa100 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7fb1e4014a10 tx=0x7fb1e4031250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5686d16b8023eaed server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:42.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.212+0000 7fb1ce7fc700 1 -- 172.21.15.146:0/516433805 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e4030070 con 0x564b39d5bc20 2023-10-06T11:14:42.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.212+0000 7fb1ce7fc700 1 -- 172.21.15.146:0/516433805 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e400fe30 con 0x564b39d5bc20 2023-10-06T11:14:42.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.212+0000 7fb1ce7fc700 1 -- 172.21.15.146:0/516433805 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e4014dc0 con 0x564b39d5bc20 2023-10-06T11:14:42.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.213+0000 7fb1f8193b80 1 -- 172.21.15.146:0/516433805 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b39d5bc20 msgr2=0x564b39daa100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.213+0000 7fb1f8193b80 1 --2- 172.21.15.146:0/516433805 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b39d5bc20 0x564b39daa100 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7fb1e4014a10 tx=0x7fb1e4031250 comp rx=0 tx=0).stop 2023-10-06T11:14:42.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.213+0000 7fb1f8193b80 1 -- 172.21.15.146:0/516433805 shutdown_connections 2023-10-06T11:14:42.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.213+0000 7fb1f8193b80 1 --2- 172.21.15.146:0/516433805 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b39da1ae0 0x564b39d56c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.213+0000 7fb1f8193b80 1 --2- 172.21.15.146:0/516433805 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b39d5bc20 0x564b39daa100 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.213+0000 7fb1f8193b80 1 --2- 172.21.15.146:0/516433805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b39d5d9f0 0x564b39d9c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.213+0000 7fb1f8193b80 1 -- 172.21.15.146:0/516433805 >> 172.21.15.146:0/516433805 conn(0x564b39d5c0c0 msgr2=0x564b39da0570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:42.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.213+0000 7fb1f8193b80 1 -- 172.21.15.146:0/516433805 shutdown_connections 2023-10-06T11:14:42.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.213+0000 7fb1f8193b80 1 -- 172.21.15.146:0/516433805 wait complete. 2023-10-06T11:14:42.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.214+0000 7fb1f8193b80 1 -- start start 2023-10-06T11:14:42.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.214+0000 7fb1f8193b80 1 Processor -- start 2023-10-06T11:14:42.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.215+0000 7fb1f8193b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b39d5bc20 0x564b39e064a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.215+0000 7fb1f8193b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b39d5d9f0 0x564b39d9eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.215+0000 7fb1f8193b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b39da1ae0 0x564b39d816d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.215+0000 7fb1f8193b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b39e069e0 con 0x564b39d5bc20 2023-10-06T11:14:42.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.215+0000 7fb1f8193b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b39d9e0f0 con 0x564b39da1ae0 2023-10-06T11:14:42.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.215+0000 7fb1f8193b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x564b39d5ce20 con 0x564b39d5d9f0 2023-10-06T11:14:42.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.215+0000 7fb1f8193b80 10 client.0 _ll_register_callbacks cb 0x564b39b47f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:14:42.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.215+0000 7fb1ecc37700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b39d5bc20 0x564b39e064a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.215+0000 7fb1ecc37700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b39d5bc20 0x564b39e064a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39352/0 (socket says 172.21.15.146:39352) 2023-10-06T11:14:42.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.215+0000 7fb1ecc37700 1 -- 172.21.15.146:0/612789032 learned_addr learned my addr 172.21.15.146:0/612789032 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:42.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.215+0000 7fb1ed438700 1 --2- 172.21.15.146:0/612789032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b39da1ae0 0x564b39d816d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.215+0000 7fb1dffff700 1 --2- 172.21.15.146:0/612789032 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b39d5d9f0 0x564b39d9eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.215+0000 7fb1ecc37700 1 -- 172.21.15.146:0/612789032 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b39d5d9f0 msgr2=0x564b39d9eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:42.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.215+0000 7fb1ecc37700 1 --2- 172.21.15.146:0/612789032 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b39d5d9f0 0x564b39d9eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.215+0000 7fb1ecc37700 1 -- 172.21.15.146:0/612789032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b39da1ae0 msgr2=0x564b39d816d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:42.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.215+0000 7fb1ecc37700 1 --2- 172.21.15.146:0/612789032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b39da1ae0 0x564b39d816d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.215+0000 7fb1ecc37700 1 -- 172.21.15.146:0/612789032 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564b39b452c0 con 0x564b39d5bc20 2023-10-06T11:14:42.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.215+0000 7fb1ecc37700 1 --2- 172.21.15.146:0/612789032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b39d5bc20 0x564b39e064a0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7fb1e402d040 tx=0x7fb1e4030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cd4b2ba4cf1cab2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:42.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.215+0000 7fb1c6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:14:42.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.215+0000 7fb1c6ffd700 1 -- 172.21.15.146:0/612789032 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e4020b90 con 0x564b39d5bc20 2023-10-06T11:14:42.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.215+0000 7fb1c6ffd700 1 -- 172.21.15.146:0/612789032 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb1e401c040 con 0x564b39d5bc20 2023-10-06T11:14:42.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.215+0000 7fb1f8193b80 1 -- 172.21.15.146:0/612789032 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb1e4014a40 con 0x564b39d5bc20 2023-10-06T11:14:42.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.215+0000 7fb1c6ffd700 1 -- 172.21.15.146:0/612789032 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb1e4034410 con 0x564b39d5bc20 2023-10-06T11:14:42.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.215+0000 7fb1f8193b80 10 client.8328 fetch_fsmap learned FSMap version 100 2023-10-06T11:14:42.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.215+0000 7fb1f8193b80 1 -- 172.21.15.146:0/612789032 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) v3 -- 0x564b39c797d0 con 0x564b39d5bc20 2023-10-06T11:14:42.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.215+0000 7fb1c6ffd700 1 -- 172.21.15.146:0/612789032 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e4014a40 con 0x564b39d5bc20 2023-10-06T11:14:42.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.216+0000 7fb1c6ffd700 1 -- 172.21.15.146:0/612789032 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 100) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb1e4034570 con 0x564b39d5bc20 2023-10-06T11:14:42.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.216+0000 7fb1f8193b80 10 client.8328 fetch_fsmap finished waiting for FSMap version 100 2023-10-06T11:14:42.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.216+0000 7fb1f8193b80 10 client.8328 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2023-10-06T11:14:42.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.216+0000 7fb1f8193b80 20 client.8328 populate_metadata read hostname 'smithi146' 2023-10-06T11:14:42.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.216+0000 7fb1f8193b80 1 --2- 172.21.15.146:0/612789032 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x564b39d9efe0 0x564b39d81c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.216+0000 7fb1f8193b80 4 client.8328 mds_command: new command op to 8103 tid=0[{"prefix": "scrub status"}] 2023-10-06T11:14:42.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.216+0000 7fb1f8193b80 1 -- 172.21.15.146:0/612789032 --> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564b39c4de50 con 0x564b39d9efe0 2023-10-06T11:14:42.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.216+0000 7fb1dffff700 1 --2- 172.21.15.146:0/612789032 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x564b39d9efe0 0x564b39d81c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.216+0000 7fb1c6ffd700 10 client.8328 ms_handle_connect on v2:172.21.15.146:6835/409226151 2023-10-06T11:14:42.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.216+0000 7fb1dffff700 1 --2- 172.21.15.146:0/612789032 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x564b39d9efe0 0x564b39d81c10 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8444a75d5db0460 server_cookie=371b745a7a7aad7c in_seq=0 out_seq=0 2023-10-06T11:14:42.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.216+0000 7fb1c6ffd700 1 -- 172.21.15.146:0/612789032 <== mds.0 v2:172.21.15.146:6835/409226151 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+276 (crc 0 0 0) 0x564b39c4de50 con 0x564b39d9efe0 2023-10-06T11:14:42.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.216+0000 7fb1c6ffd700 10 client.8328 handle_command_reply: tid=0 2023-10-06T11:14:42.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.216+0000 7fb1f8193b80 1 client.8328 shutdown 2023-10-06T11:14:42.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.216+0000 7fb1f8193b80 1 -- 172.21.15.146:0/612789032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b39d5bc20 msgr2=0x564b39e064a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.216+0000 7fb1f8193b80 1 --2- 172.21.15.146:0/612789032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b39d5bc20 0x564b39e064a0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7fb1e402d040 tx=0x7fb1e4030000 comp rx=0 tx=0).stop 2023-10-06T11:14:42.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.216+0000 7fb1f8193b80 1 -- 172.21.15.146:0/612789032 shutdown_connections 2023-10-06T11:14:42.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.216+0000 7fb1f8193b80 1 --2- 172.21.15.146:0/612789032 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x564b39d9efe0 0x564b39d81c10 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.216+0000 7fb1f8193b80 1 --2- 172.21.15.146:0/612789032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b39da1ae0 0x564b39d816d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.216+0000 7fb1c6ffd700 0 client.8328 ms_handle_reset on v2:172.21.15.146:6835/409226151 2023-10-06T11:14:42.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.216+0000 7fb1f8193b80 1 --2- 172.21.15.146:0/612789032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564b39d5bc20 0x564b39e064a0 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.216+0000 7fb1f8193b80 1 --2- 172.21.15.146:0/612789032 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564b39d5d9f0 0x564b39d9eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.216+0000 7fb1f8193b80 1 -- 172.21.15.146:0/612789032 >> 172.21.15.146:0/612789032 conn(0x564b39d5c0c0 msgr2=0x564b39d9c100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:42.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.217+0000 7fb1f8193b80 1 -- 172.21.15.146:0/612789032 shutdown_connections 2023-10-06T11:14:42.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.217+0000 7fb1f8193b80 1 -- 172.21.15.146:0/612789032 wait complete. 2023-10-06T11:14:42.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.217+0000 7fb1f8193b80 20 client.8328 trim_cache size 0 max 16384 2023-10-06T11:14:42.227 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:14:42.227 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "PAUSED (0 inodes in the stack)", 2023-10-06T11:14:42.227 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": { 2023-10-06T11:14:42.227 INFO:teuthology.orchestra.run.smithi146.stdout: "05f08bb9-f8a5-4f3f-aefb-5a902817ec9b": { 2023-10-06T11:14:42.227 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_control_test_path", 2023-10-06T11:14:42.227 INFO:teuthology.orchestra.run.smithi146.stdout: "tag": "05f08bb9-f8a5-4f3f-aefb-5a902817ec9b", 2023-10-06T11:14:42.227 INFO:teuthology.orchestra.run.smithi146.stdout: "options": "recursive" 2023-10-06T11:14:42.227 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:14:42.227 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:14:42.227 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:14:42.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.217+0000 7fb1eee9b700 1 -- 172.21.15.146:0/1746149817 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb1d4066f30 msgr2=0x7fb1d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.217+0000 7fb1eee9b700 1 --2- 172.21.15.146:0/1746149817 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb1d4066f30 0x7fb1d40693e0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fb1e4000f80 tx=0x7fb1e4009040 comp rx=0 tx=0).stop 2023-10-06T11:14:42.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.217+0000 7fb1eee9b700 1 -- 172.21.15.146:0/1746149817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1e815a160 msgr2=0x7fb1e80b4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.217+0000 7fb1eee9b700 1 --2- 172.21.15.146:0/1746149817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1e815a160 0x7fb1e80b4ba0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fb1e8088c60 tx=0x7fb1e0017000 comp rx=0 tx=0).stop 2023-10-06T11:14:42.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.217+0000 7fb1eee9b700 1 -- 172.21.15.146:0/1746149817 shutdown_connections 2023-10-06T11:14:42.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.217+0000 7fb1eee9b700 1 --2- 172.21.15.146:0/1746149817 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb1d4066f30 0x7fb1d40693e0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.217+0000 7fb1eee9b700 1 --2- 172.21.15.146:0/1746149817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb1e815a160 0x7fb1e80b4ba0 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.217+0000 7fb1eee9b700 1 --2- 172.21.15.146:0/1746149817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb1e80ae730 0x7fb1e80b35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.217+0000 7fb1eee9b700 1 --2- 172.21.15.146:0/1746149817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1e80cb950 0x7fb1e8157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.217+0000 7fb1eee9b700 1 -- 172.21.15.146:0/1746149817 >> 172.21.15.146:0/1746149817 conn(0x7fb1e806f380 msgr2=0x7fb1e80cbd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:42.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.217+0000 7fb1eee9b700 1 -- 172.21.15.146:0/1746149817 shutdown_connections 2023-10-06T11:14:42.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.217+0000 7fb1eee9b700 1 -- 172.21.15.146:0/1746149817 wait complete. 2023-10-06T11:14:42.231 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:14:42.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.343+0000 7f24b4324700 1 Processor -- start 2023-10-06T11:14:42.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.343+0000 7f24b4324700 1 -- start start 2023-10-06T11:14:42.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.344+0000 7f24b4324700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f24ac153ab0 0x7f24ac15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.344+0000 7f24b4324700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f24ac153e80 0x7f24ac068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.345+0000 7f24b4324700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24ac15ac30 con 0x7f24ac0689d0 2023-10-06T11:14:42.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.345+0000 7f24b4324700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24ac068e50 con 0x7f24ac153ab0 2023-10-06T11:14:42.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.345+0000 7f24b4324700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac0b4510 con 0x7f24ac153e80 2023-10-06T11:14:42.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.345+0000 7f24b20c0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f24ac153ab0 0x7f24ac15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.345+0000 7f24b28c1700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f24ac0689d0 0x7f24ac15d270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45244/0 (socket says 172.21.15.146:45244) 2023-10-06T11:14:42.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.345+0000 7f24b28c1700 1 -- 172.21.15.146:0/2112906045 learned_addr learned my addr 172.21.15.146:0/2112906045 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:14:42.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.345+0000 7f24b18bf700 1 --2- 172.21.15.146:0/2112906045 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f24ac153e80 0x7f24ac068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.345+0000 7f24b20c0700 1 -- 172.21.15.146:0/2112906045 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f24ac153e80 msgr2=0x7f24ac068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:42.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.345+0000 7f24b20c0700 1 --2- 172.21.15.146:0/2112906045 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f24ac153e80 0x7f24ac068490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.345+0000 7f24b20c0700 1 -- 172.21.15.146:0/2112906045 >> v1:172.21.15.146:6789/0 conn(0x7f24ac0689d0 legacy=0x7f24ac15d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.345+0000 7f24b20c0700 1 -- 172.21.15.146:0/2112906045 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ac0b6530 con 0x7f24ac153ab0 2023-10-06T11:14:42.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.345+0000 7f24b10be700 1 -- 172.21.15.146:0/2112906045 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2436491597 0 0) 0x7f24a4001490 con 0x7f24ac0689d0 2023-10-06T11:14:42.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.345+0000 7f24b20c0700 1 --2- 172.21.15.146:0/2112906045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24ac153ab0 0x7f24ac15a6f0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f24a80098e0 tx=0x7f24a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d23bb74ed413d1f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:42.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.345+0000 7f24b10be700 1 -- 172.21.15.146:0/2112906045 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a8009e80 con 0x7f24ac153ab0 2023-10-06T11:14:42.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.345+0000 7f24b10be700 1 -- 172.21.15.146:0/2112906045 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a800b860 con 0x7f24ac153ab0 2023-10-06T11:14:42.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.345+0000 7f24b10be700 1 -- 172.21.15.146:0/2112906045 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a800bbe0 con 0x7f24ac153ab0 2023-10-06T11:14:42.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.346+0000 7f24b4324700 1 -- 172.21.15.146:0/2112906045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24ac153ab0 msgr2=0x7f24ac15a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.346+0000 7f24b4324700 1 --2- 172.21.15.146:0/2112906045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24ac153ab0 0x7f24ac15a6f0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f24a80098e0 tx=0x7f24a80091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.346+0000 7f24b4324700 1 -- 172.21.15.146:0/2112906045 shutdown_connections 2023-10-06T11:14:42.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.346+0000 7f24b4324700 1 --2- 172.21.15.146:0/2112906045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24ac153ab0 0x7f24ac15a6f0 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.346+0000 7f24b4324700 1 --2- 172.21.15.146:0/2112906045 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f24ac153e80 0x7f24ac068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.346+0000 7f24b4324700 1 -- 172.21.15.146:0/2112906045 >> 172.21.15.146:0/2112906045 conn(0x7f24ac06eba0 msgr2=0x7f24ac06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:42.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.346+0000 7f24b4324700 1 -- 172.21.15.146:0/2112906045 shutdown_connections 2023-10-06T11:14:42.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.346+0000 7f24b4324700 1 -- 172.21.15.146:0/2112906045 wait complete. 2023-10-06T11:14:42.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.347+0000 7f24b4324700 1 Processor -- start 2023-10-06T11:14:42.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.347+0000 7f24b4324700 1 -- start start 2023-10-06T11:14:42.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.348+0000 7f24b4324700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f24ac0689d0 0x7f24ac156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.348+0000 7f24b4324700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24ac153ab0 0x7f24ac15a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.348+0000 7f24b4324700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24ac153e80 0x7f24ac1545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.348+0000 7f24b4324700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac158e90 con 0x7f24ac153e80 2023-10-06T11:14:42.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.348+0000 7f24b4324700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac159130 con 0x7f24ac153ab0 2023-10-06T11:14:42.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.348+0000 7f24b4324700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac159410 con 0x7f24ac0689d0 2023-10-06T11:14:42.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.348+0000 7f24b28c1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24ac153e80 0x7f24ac1545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.348+0000 7f24b28c1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24ac153e80 0x7f24ac1545c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39374/0 (socket says 172.21.15.146:39374) 2023-10-06T11:14:42.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.348+0000 7f24b28c1700 1 -- 172.21.15.146:0/1263579016 learned_addr learned my addr 172.21.15.146:0/1263579016 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:42.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.348+0000 7f24b20c0700 1 --2- 172.21.15.146:0/1263579016 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f24ac0689d0 0x7f24ac156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.348+0000 7f24b18bf700 1 --2- 172.21.15.146:0/1263579016 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24ac153ab0 0x7f24ac15a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.348+0000 7f24b28c1700 1 -- 172.21.15.146:0/1263579016 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f24ac0689d0 msgr2=0x7f24ac156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.348+0000 7f24b28c1700 1 --2- 172.21.15.146:0/1263579016 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f24ac0689d0 0x7f24ac156f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.348+0000 7f24b28c1700 1 -- 172.21.15.146:0/1263579016 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24ac153ab0 msgr2=0x7f24ac15a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.348+0000 7f24b28c1700 1 --2- 172.21.15.146:0/1263579016 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24ac153ab0 0x7f24ac15a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.348+0000 7f24b28c1700 1 -- 172.21.15.146:0/1263579016 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a8009420 con 0x7f24ac153e80 2023-10-06T11:14:42.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.348+0000 7f24b18bf700 1 --2- 172.21.15.146:0/1263579016 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24ac153ab0 0x7f24ac15a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:42.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.348+0000 7f24b28c1700 1 --2- 172.21.15.146:0/1263579016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24ac153e80 0x7f24ac1545c0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f24a400cbf0 tx=0x7f24a40019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:42.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.348+0000 7f24a27fc700 1 -- 172.21.15.146:0/1263579016 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a400a9c0 con 0x7f24ac153e80 2023-10-06T11:14:42.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.349+0000 7f24a27fc700 1 -- 172.21.15.146:0/1263579016 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a400ab20 con 0x7f24ac153e80 2023-10-06T11:14:42.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.349+0000 7f24b4324700 1 -- 172.21.15.146:0/1263579016 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24ac1596f0 con 0x7f24ac153e80 2023-10-06T11:14:42.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.349+0000 7f24a27fc700 1 -- 172.21.15.146:0/1263579016 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a40070f0 con 0x7f24ac153e80 2023-10-06T11:14:42.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.349+0000 7f24b4324700 1 -- 172.21.15.146:0/1263579016 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24ac159d30 con 0x7f24ac153e80 2023-10-06T11:14:42.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.349+0000 7f24b4324700 1 -- 172.21.15.146:0/1263579016 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24ac04c380 con 0x7f24ac153e80 2023-10-06T11:14:42.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.350+0000 7f24a27fc700 1 -- 172.21.15.146:0/1263579016 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f24a4007520 con 0x7f24ac153e80 2023-10-06T11:14:42.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.350+0000 7f24a27fc700 1 --2- 172.21.15.146:0/1263579016 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2490066f30 0x7f24900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.351+0000 7f24b20c0700 1 --2- 172.21.15.146:0/1263579016 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2490066f30 0x7f24900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.351+0000 7f24a27fc700 1 -- 172.21.15.146:0/1263579016 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f24a40849d0 con 0x7f24ac153e80 2023-10-06T11:14:42.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.351+0000 7f24b20c0700 1 --2- 172.21.15.146:0/1263579016 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2490066f30 0x7f24900693e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f24a80091e0 tx=0x7f24a8017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:42.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.355+0000 7f24a27fc700 1 -- 172.21.15.146:0/1263579016 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f24a4051ac0 con 0x7f24ac153e80 2023-10-06T11:14:42.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.586+0000 7f24b4324700 1 -- 172.21.15.146:0/1263579016 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f24ac0b3720 con 0x7f24ac153e80 2023-10-06T11:14:42.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.587+0000 7f24a27fc700 1 -- 172.21.15.146:0/1263579016 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) v1 ==== 95+0+4610 (secure 0 0 0) 0x7f24a40550e0 con 0x7f24ac153e80 2023-10-06T11:14:42.589 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:42.589 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":100,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6560,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/2109567995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2109567995},{"type":"v1","addr":"172.21.15.151:6834","nonce":2109567995}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":6563,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1783565134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":1783565134},{"type":"v1","addr":"172.21.15.151:6835","nonce":1783565134}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7327,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/1323749517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1323749517},{"type":"v1","addr":"172.21.15.146:6836","nonce":1323749517}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:14:18.891938+0000","modified":"2023-10-06T11:14:22.531674+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8103":{"gid":8103,"name":"c","rank":0,"incarnation":97,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/409226151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":409226151},{"type":"v1","addr":"172.21.15.146:6837","nonce":409226151}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-06T11:14:42.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.589+0000 7f24b4324700 1 -- 172.21.15.146:0/1263579016 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2490066f30 msgr2=0x7f24900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.589+0000 7f24b4324700 1 --2- 172.21.15.146:0/1263579016 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2490066f30 0x7f24900693e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f24a80091e0 tx=0x7f24a8017000 comp rx=0 tx=0).stop 2023-10-06T11:14:42.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.589+0000 7f24b4324700 1 -- 172.21.15.146:0/1263579016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24ac153e80 msgr2=0x7f24ac1545c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.589+0000 7f24b4324700 1 --2- 172.21.15.146:0/1263579016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24ac153e80 0x7f24ac1545c0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f24a400cbf0 tx=0x7f24a40019b0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.589+0000 7f24b4324700 1 -- 172.21.15.146:0/1263579016 shutdown_connections 2023-10-06T11:14:42.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.589+0000 7f24b4324700 1 --2- 172.21.15.146:0/1263579016 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2490066f30 0x7f24900693e0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.589+0000 7f24b4324700 1 --2- 172.21.15.146:0/1263579016 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f24ac153e80 0x7f24ac1545c0 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.589+0000 7f24b4324700 1 --2- 172.21.15.146:0/1263579016 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f24ac0689d0 0x7f24ac156f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.589+0000 7f24b4324700 1 --2- 172.21.15.146:0/1263579016 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24ac153ab0 0x7f24ac15a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.589+0000 7f24b4324700 1 -- 172.21.15.146:0/1263579016 >> 172.21.15.146:0/1263579016 conn(0x7f24ac06eba0 msgr2=0x7f24ac151f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:42.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.589+0000 7f24b4324700 1 -- 172.21.15.146:0/1263579016 shutdown_connections 2023-10-06T11:14:42.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.589+0000 7f24b4324700 1 -- 172.21.15.146:0/1263579016 wait complete. 2023-10-06T11:14:42.592 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 100 2023-10-06T11:14:42.603 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2023-10-06T11:14:42.603 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T11:14:42.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.714+0000 7f9db2f3b700 1 Processor -- start 2023-10-06T11:14:42.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.714+0000 7f9db2f3b700 1 -- start start 2023-10-06T11:14:42.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.715+0000 7f9db2f3b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9dac15a420 0x7f9dac15cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.715+0000 7f9db2f3b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9dac15a7f0 0x7f9dac0b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.715+0000 7f9db2f3b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dac15c630 con 0x7f9dac0b2360 2023-10-06T11:14:42.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.715+0000 7f9db2f3b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dac0ce040 con 0x7f9dac15a420 2023-10-06T11:14:42.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.715+0000 7f9db2f3b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac0b27e0 con 0x7f9dac15a7f0 2023-10-06T11:14:42.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.715+0000 7f9db1f39700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9dac15a420 0x7f9dac15cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.715+0000 7f9db273a700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f9dac0b2360 0x7f9dac15acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45252/0 (socket says 172.21.15.146:45252) 2023-10-06T11:14:42.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.715+0000 7f9db273a700 1 -- 172.21.15.146:0/4096762841 learned_addr learned my addr 172.21.15.146:0/4096762841 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:14:42.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.715+0000 7f9db1738700 1 --2- 172.21.15.146:0/4096762841 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9dac15a7f0 0x7f9dac0b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.715+0000 7f9db1f39700 1 -- 172.21.15.146:0/4096762841 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9dac15a7f0 msgr2=0x7f9dac0b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:42.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.715+0000 7f9db1f39700 1 --2- 172.21.15.146:0/4096762841 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9dac15a7f0 0x7f9dac0b1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.715+0000 7f9db1f39700 1 -- 172.21.15.146:0/4096762841 >> v1:172.21.15.146:6789/0 conn(0x7f9dac0b2360 legacy=0x7f9dac15acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.715+0000 7f9db0f37700 1 -- 172.21.15.146:0/4096762841 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 56420736 0 0) 0x7f9dac15c630 con 0x7f9dac0b2360 2023-10-06T11:14:42.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.715+0000 7f9db1f39700 1 -- 172.21.15.146:0/4096762841 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dac15ba20 con 0x7f9dac15a420 2023-10-06T11:14:42.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.715+0000 7f9db1f39700 1 --2- 172.21.15.146:0/4096762841 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dac15a420 0x7f9dac15cac0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f9da8009910 tx=0x7f9da80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c65843167fe4c0f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:42.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.716+0000 7f9db0f37700 1 -- 172.21.15.146:0/4096762841 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da800b640 con 0x7f9dac15a420 2023-10-06T11:14:42.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.716+0000 7f9db0f37700 1 -- 172.21.15.146:0/4096762841 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da800b7a0 con 0x7f9dac15a420 2023-10-06T11:14:42.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.716+0000 7f9db0f37700 1 -- 172.21.15.146:0/4096762841 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da800bb60 con 0x7f9dac15a420 2023-10-06T11:14:42.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.716+0000 7f9db2f3b700 1 -- 172.21.15.146:0/4096762841 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dac15a420 msgr2=0x7f9dac15cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.716+0000 7f9db2f3b700 1 --2- 172.21.15.146:0/4096762841 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dac15a420 0x7f9dac15cac0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f9da8009910 tx=0x7f9da80091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.716+0000 7f9db2f3b700 1 -- 172.21.15.146:0/4096762841 shutdown_connections 2023-10-06T11:14:42.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.716+0000 7f9db2f3b700 1 --2- 172.21.15.146:0/4096762841 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dac15a420 0x7f9dac15cac0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.716+0000 7f9db2f3b700 1 --2- 172.21.15.146:0/4096762841 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9dac15a7f0 0x7f9dac0b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.716+0000 7f9db2f3b700 1 -- 172.21.15.146:0/4096762841 >> 172.21.15.146:0/4096762841 conn(0x7f9dac06eba0 msgr2=0x7f9dac06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:42.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.716+0000 7f9db2f3b700 1 -- 172.21.15.146:0/4096762841 shutdown_connections 2023-10-06T11:14:42.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.716+0000 7f9db2f3b700 1 -- 172.21.15.146:0/4096762841 wait complete. 2023-10-06T11:14:42.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.717+0000 7f9db2f3b700 1 Processor -- start 2023-10-06T11:14:42.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.717+0000 7f9db2f3b700 1 -- start start 2023-10-06T11:14:42.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.718+0000 7f9db2f3b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9dac0b2360 0x7f9dac14d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.718+0000 7f9db2f3b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dac15a420 0x7f9dac157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.718+0000 7f9db2f3b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9dac15a7f0 0x7f9dac14f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.718+0000 7f9db2f3b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac16a1b0 con 0x7f9dac15a420 2023-10-06T11:14:42.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.718+0000 7f9db2f3b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac1538d0 con 0x7f9dac15a7f0 2023-10-06T11:14:42.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.718+0000 7f9db2f3b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac154670 con 0x7f9dac0b2360 2023-10-06T11:14:42.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.718+0000 7f9db1738700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dac15a420 0x7f9dac157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.718+0000 7f9db1738700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dac15a420 0x7f9dac157250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39398/0 (socket says 172.21.15.146:39398) 2023-10-06T11:14:42.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.718+0000 7f9db1738700 1 -- 172.21.15.146:0/2975557867 learned_addr learned my addr 172.21.15.146:0/2975557867 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:42.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.718+0000 7f9db1738700 1 -- 172.21.15.146:0/2975557867 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9dac0b2360 msgr2=0x7f9dac14d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.718+0000 7f9db1738700 1 --2- 172.21.15.146:0/2975557867 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9dac0b2360 0x7f9dac14d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.718+0000 7f9db1738700 1 -- 172.21.15.146:0/2975557867 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9dac15a7f0 msgr2=0x7f9dac14f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.718+0000 7f9db1738700 1 --2- 172.21.15.146:0/2975557867 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9dac15a7f0 0x7f9dac14f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.718+0000 7f9db1738700 1 -- 172.21.15.146:0/2975557867 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da8009420 con 0x7f9dac15a420 2023-10-06T11:14:42.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.718+0000 7f9db1738700 1 --2- 172.21.15.146:0/2975557867 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dac15a420 0x7f9dac157250 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c00e900 tx=0x7f9d9c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:42.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.719+0000 7f9da1ffb700 1 -- 172.21.15.146:0/2975557867 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c00eea0 con 0x7f9dac15a420 2023-10-06T11:14:42.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.719+0000 7f9da1ffb700 1 -- 172.21.15.146:0/2975557867 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d9c00c850 con 0x7f9dac15a420 2023-10-06T11:14:42.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.719+0000 7f9da1ffb700 1 -- 172.21.15.146:0/2975557867 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c00cbf0 con 0x7f9dac15a420 2023-10-06T11:14:42.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.719+0000 7f9db2f3b700 1 -- 172.21.15.146:0/2975557867 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dac154950 con 0x7f9dac15a420 2023-10-06T11:14:42.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.719+0000 7f9db2f3b700 1 -- 172.21.15.146:0/2975557867 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dac154f10 con 0x7f9dac15a420 2023-10-06T11:14:42.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.720+0000 7f9db2f3b700 1 -- 172.21.15.146:0/2975557867 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dac0afae0 con 0x7f9dac15a420 2023-10-06T11:14:42.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.720+0000 7f9da1ffb700 1 -- 172.21.15.146:0/2975557867 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9d9c013470 con 0x7f9dac15a420 2023-10-06T11:14:42.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.720+0000 7f9da1ffb700 1 --2- 172.21.15.146:0/2975557867 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9d90066f30 0x7f9d900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:42.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.721+0000 7f9da1ffb700 1 -- 172.21.15.146:0/2975557867 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9d9c084910 con 0x7f9dac15a420 2023-10-06T11:14:42.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.721+0000 7f9db1f39700 1 --2- 172.21.15.146:0/2975557867 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9d90066f30 0x7f9d900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:42.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.721+0000 7f9db1f39700 1 --2- 172.21.15.146:0/2975557867 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9d90066f30 0x7f9d900693e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9da80091e0 tx=0x7f9da8017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:42.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.725+0000 7f9da1ffb700 1 -- 172.21.15.146:0/2975557867 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9d9c051a20 con 0x7f9dac15a420 2023-10-06T11:14:42.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.981+0000 7f9db2f3b700 1 -- 172.21.15.146:0/2975557867 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f9dac16a2f0 con 0x7f9dac15a420 2023-10-06T11:14:42.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.981+0000 7f9da1ffb700 1 -- 172.21.15.146:0/2975557867 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1577 (secure 0 0 0) 0x7f9d9c055040 con 0x7f9dac15a420 2023-10-06T11:14:42.983 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:42.983 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":557,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":113,"num_osds":8,"num_up_osds":8,"osd_up_since":1696590336,"num_in_osds":8,"osd_in_since":1696590327,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":689,"data_bytes":698991944,"bytes_used":3839410176,"bytes_avail":769254703104,"bytes_total":773094113280,"write_bytes_sec":57579577,"read_op_per_sec":0,"write_op_per_sec":55},"fsmap":{"epoch":100,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":8103}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":20,"modified":"2023-10-06T11:14:01.246582+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T11:14:42.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.983+0000 7f9db2f3b700 1 -- 172.21.15.146:0/2975557867 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9d90066f30 msgr2=0x7f9d900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.983+0000 7f9db2f3b700 1 --2- 172.21.15.146:0/2975557867 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9d90066f30 0x7f9d900693e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9da80091e0 tx=0x7f9da8017000 comp rx=0 tx=0).stop 2023-10-06T11:14:42.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.983+0000 7f9db2f3b700 1 -- 172.21.15.146:0/2975557867 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dac15a420 msgr2=0x7f9dac157250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:42.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.983+0000 7f9db2f3b700 1 --2- 172.21.15.146:0/2975557867 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dac15a420 0x7f9dac157250 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c00e900 tx=0x7f9d9c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.983+0000 7f9db2f3b700 1 -- 172.21.15.146:0/2975557867 shutdown_connections 2023-10-06T11:14:42.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.983+0000 7f9db2f3b700 1 --2- 172.21.15.146:0/2975557867 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9d90066f30 0x7f9d900693e0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.983+0000 7f9db2f3b700 1 --2- 172.21.15.146:0/2975557867 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9dac15a7f0 0x7f9dac14f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.983+0000 7f9db2f3b700 1 --2- 172.21.15.146:0/2975557867 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9dac0b2360 0x7f9dac14d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.983+0000 7f9db2f3b700 1 --2- 172.21.15.146:0/2975557867 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9dac15a420 0x7f9dac157250 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:42.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.983+0000 7f9db2f3b700 1 -- 172.21.15.146:0/2975557867 >> 172.21.15.146:0/2975557867 conn(0x7f9dac06eba0 msgr2=0x7f9dac14dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:42.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.983+0000 7f9db2f3b700 1 -- 172.21.15.146:0/2975557867 shutdown_connections 2023-10-06T11:14:42.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:42.983+0000 7f9db2f3b700 1 -- 172.21.15.146:0/2975557867 wait complete. 2023-10-06T11:14:42.997 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2023-10-06T11:14:43.998 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:14:44.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.110+0000 7feb76b09700 1 Processor -- start 2023-10-06T11:14:44.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.110+0000 7feb76b09700 1 -- start start 2023-10-06T11:14:44.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.111+0000 7feb76b09700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7feb70153ab0 0x7feb7015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:44.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.111+0000 7feb76b09700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb70153e80 0x7feb70068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:44.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.111+0000 7feb76b09700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb7015ac30 con 0x7feb700689d0 2023-10-06T11:14:44.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.111+0000 7feb76b09700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb70068e50 con 0x7feb70153ab0 2023-10-06T11:14:44.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.111+0000 7feb76b09700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb700b4510 con 0x7feb70153e80 2023-10-06T11:14:44.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.111+0000 7feb750a6700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7feb700689d0 0x7feb7015d270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45266/0 (socket says 172.21.15.146:45266) 2023-10-06T11:14:44.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.111+0000 7feb750a6700 1 -- 172.21.15.146:0/55192900 learned_addr learned my addr 172.21.15.146:0/55192900 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:14:44.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.111+0000 7feb748a5700 1 --2- 172.21.15.146:0/55192900 >> v2:172.21.15.151:3300/0 conn(0x7feb70153ab0 0x7feb7015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:44.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.111+0000 7feb67fff700 1 --2- 172.21.15.146:0/55192900 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb70153e80 0x7feb70068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:44.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.112+0000 7feb677fe700 1 -- 172.21.15.146:0/55192900 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3735271397 0 0) 0x7feb68001110 con 0x7feb700689d0 2023-10-06T11:14:44.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.112+0000 7feb677fe700 1 -- 172.21.15.146:0/55192900 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb58003570 con 0x7feb700689d0 2023-10-06T11:14:44.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.112+0000 7feb677fe700 1 -- 172.21.15.146:0/55192900 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2255806938 0 0) 0x7feb58003570 con 0x7feb700689d0 2023-10-06T11:14:44.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.112+0000 7feb748a5700 1 -- 172.21.15.146:0/55192900 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb70153e80 msgr2=0x7feb70068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:44.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.112+0000 7feb748a5700 1 --2- 172.21.15.146:0/55192900 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb70153e80 0x7feb70068490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:44.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.112+0000 7feb748a5700 1 -- 172.21.15.146:0/55192900 >> v1:172.21.15.146:6789/0 conn(0x7feb700689d0 legacy=0x7feb7015d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:44.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.112+0000 7feb748a5700 1 -- 172.21.15.146:0/55192900 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb700b6530 con 0x7feb70153ab0 2023-10-06T11:14:44.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.112+0000 7feb67fff700 1 --2- 172.21.15.146:0/55192900 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb70153e80 0x7feb70068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:14:44.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.112+0000 7feb748a5700 1 --2- 172.21.15.146:0/55192900 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb70153ab0 0x7feb7015a6f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7feb6c009e60 tx=0x7feb6c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6cddf9a50f1cced server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:44.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.112+0000 7feb677fe700 1 -- 172.21.15.146:0/55192900 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6c00e070 con 0x7feb70153ab0 2023-10-06T11:14:44.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.112+0000 7feb677fe700 1 -- 172.21.15.146:0/55192900 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb6c00b7a0 con 0x7feb70153ab0 2023-10-06T11:14:44.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.112+0000 7feb677fe700 1 -- 172.21.15.146:0/55192900 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb68001600 con 0x7feb70153ab0 2023-10-06T11:14:44.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.113+0000 7feb76b09700 1 -- 172.21.15.146:0/55192900 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb70153ab0 msgr2=0x7feb7015a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:44.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.113+0000 7feb76b09700 1 --2- 172.21.15.146:0/55192900 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb70153ab0 0x7feb7015a6f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7feb6c009e60 tx=0x7feb6c009780 comp rx=0 tx=0).stop 2023-10-06T11:14:44.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.113+0000 7feb76b09700 1 -- 172.21.15.146:0/55192900 shutdown_connections 2023-10-06T11:14:44.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.113+0000 7feb76b09700 1 --2- 172.21.15.146:0/55192900 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb70153ab0 0x7feb7015a6f0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:44.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.113+0000 7feb76b09700 1 --2- 172.21.15.146:0/55192900 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb70153e80 0x7feb70068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:44.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.113+0000 7feb76b09700 1 -- 172.21.15.146:0/55192900 >> 172.21.15.146:0/55192900 conn(0x7feb7006eba0 msgr2=0x7feb7006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:44.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.113+0000 7feb76b09700 1 -- 172.21.15.146:0/55192900 shutdown_connections 2023-10-06T11:14:44.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.113+0000 7feb76b09700 1 -- 172.21.15.146:0/55192900 wait complete. 2023-10-06T11:14:44.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.114+0000 7feb76b09700 1 Processor -- start 2023-10-06T11:14:44.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.114+0000 7feb76b09700 1 -- start start 2023-10-06T11:14:44.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.115+0000 7feb76b09700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb700689d0 0x7feb70169ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:44.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.115+0000 7feb76b09700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb70153ab0 0x7feb70145070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:44.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.115+0000 7feb76b09700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb70153e80 0x7feb7015a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:44.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.115+0000 7feb76b09700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb70156540 con 0x7feb700689d0 2023-10-06T11:14:44.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.115+0000 7feb76b09700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb701455b0 con 0x7feb70153e80 2023-10-06T11:14:44.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.115+0000 7feb76b09700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb701514b0 con 0x7feb70153ab0 2023-10-06T11:14:44.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.115+0000 7feb748a5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb700689d0 0x7feb70169ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:44.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.115+0000 7feb748a5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb700689d0 0x7feb70169ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39414/0 (socket says 172.21.15.146:39414) 2023-10-06T11:14:44.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.115+0000 7feb748a5700 1 -- 172.21.15.146:0/3121896444 learned_addr learned my addr 172.21.15.146:0/3121896444 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:44.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.115+0000 7feb67fff700 1 --2- 172.21.15.146:0/3121896444 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb70153ab0 0x7feb70145070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:44.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.115+0000 7feb750a6700 1 --2- 172.21.15.146:0/3121896444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb70153e80 0x7feb7015a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:44.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.115+0000 7feb748a5700 1 -- 172.21.15.146:0/3121896444 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb70153ab0 msgr2=0x7feb70145070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:44.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.115+0000 7feb748a5700 1 --2- 172.21.15.146:0/3121896444 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb70153ab0 0x7feb70145070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:44.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.115+0000 7feb748a5700 1 -- 172.21.15.146:0/3121896444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb70153e80 msgr2=0x7feb7015a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:44.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.115+0000 7feb748a5700 1 --2- 172.21.15.146:0/3121896444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb70153e80 0x7feb7015a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:44.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.115+0000 7feb748a5700 1 -- 172.21.15.146:0/3121896444 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb60009420 con 0x7feb700689d0 2023-10-06T11:14:44.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.115+0000 7feb748a5700 1 --2- 172.21.15.146:0/3121896444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb700689d0 0x7feb70169ae0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7feb70089010 tx=0x7feb6c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:44.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.115+0000 7feb64ff9700 1 -- 172.21.15.146:0/3121896444 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6c012950 con 0x7feb700689d0 2023-10-06T11:14:44.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.116+0000 7feb64ff9700 1 -- 172.21.15.146:0/3121896444 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb6c012af0 con 0x7feb700689d0 2023-10-06T11:14:44.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.116+0000 7feb64ff9700 1 -- 172.21.15.146:0/3121896444 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6c027470 con 0x7feb700689d0 2023-10-06T11:14:44.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.116+0000 7feb76b09700 1 -- 172.21.15.146:0/3121896444 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb6c009a20 con 0x7feb700689d0 2023-10-06T11:14:44.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.116+0000 7feb76b09700 1 -- 172.21.15.146:0/3121896444 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb70155c10 con 0x7feb700689d0 2023-10-06T11:14:44.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.116+0000 7feb76b09700 1 -- 172.21.15.146:0/3121896444 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb7004c380 con 0x7feb700689d0 2023-10-06T11:14:44.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.117+0000 7feb64ff9700 1 -- 172.21.15.146:0/3121896444 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feb6c024070 con 0x7feb700689d0 2023-10-06T11:14:44.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.117+0000 7feb64ff9700 1 --2- 172.21.15.146:0/3121896444 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feb5c066f30 0x7feb5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:44.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.117+0000 7feb64ff9700 1 -- 172.21.15.146:0/3121896444 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7feb6c0869e0 con 0x7feb700689d0 2023-10-06T11:14:44.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.117+0000 7feb67fff700 1 --2- 172.21.15.146:0/3121896444 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feb5c066f30 0x7feb5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:44.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.118+0000 7feb67fff700 1 --2- 172.21.15.146:0/3121896444 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feb5c066f30 0x7feb5c0693e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7feb700d0c60 tx=0x7feb600091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:44.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.122+0000 7feb64ff9700 1 -- 172.21.15.146:0/3121896444 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feb6c053af0 con 0x7feb700689d0 2023-10-06T11:14:44.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.345+0000 7feb76b09700 1 -- 172.21.15.146:0/3121896444 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feb700b3720 con 0x7feb700689d0 2023-10-06T11:14:44.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.346+0000 7feb64ff9700 1 -- 172.21.15.146:0/3121896444 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) v1 ==== 95+0+4610 (secure 0 0 0) 0x7feb6c057110 con 0x7feb700689d0 2023-10-06T11:14:44.348 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:44.348 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":100,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6560,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/2109567995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2109567995},{"type":"v1","addr":"172.21.15.151:6834","nonce":2109567995}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":6563,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1783565134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":1783565134},{"type":"v1","addr":"172.21.15.151:6835","nonce":1783565134}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7327,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/1323749517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1323749517},{"type":"v1","addr":"172.21.15.146:6836","nonce":1323749517}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:14:18.891938+0000","modified":"2023-10-06T11:14:22.531674+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8103":{"gid":8103,"name":"c","rank":0,"incarnation":97,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/409226151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":409226151},{"type":"v1","addr":"172.21.15.146:6837","nonce":409226151}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-06T11:14:44.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.348+0000 7feb76b09700 1 -- 172.21.15.146:0/3121896444 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feb5c066f30 msgr2=0x7feb5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:44.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.348+0000 7feb76b09700 1 --2- 172.21.15.146:0/3121896444 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feb5c066f30 0x7feb5c0693e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7feb700d0c60 tx=0x7feb600091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:44.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.348+0000 7feb76b09700 1 -- 172.21.15.146:0/3121896444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb700689d0 msgr2=0x7feb70169ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:44.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.348+0000 7feb76b09700 1 --2- 172.21.15.146:0/3121896444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb700689d0 0x7feb70169ae0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7feb70089010 tx=0x7feb6c018000 comp rx=0 tx=0).stop 2023-10-06T11:14:44.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.348+0000 7feb76b09700 1 -- 172.21.15.146:0/3121896444 shutdown_connections 2023-10-06T11:14:44.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.348+0000 7feb76b09700 1 --2- 172.21.15.146:0/3121896444 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feb5c066f30 0x7feb5c0693e0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:44.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.348+0000 7feb76b09700 1 --2- 172.21.15.146:0/3121896444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb70153e80 0x7feb7015a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:44.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.348+0000 7feb76b09700 1 --2- 172.21.15.146:0/3121896444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb700689d0 0x7feb70169ae0 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:44.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.348+0000 7feb76b09700 1 --2- 172.21.15.146:0/3121896444 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb70153ab0 0x7feb70145070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:44.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.348+0000 7feb76b09700 1 -- 172.21.15.146:0/3121896444 >> 172.21.15.146:0/3121896444 conn(0x7feb7006eba0 msgr2=0x7feb70151e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:44.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.348+0000 7feb76b09700 1 -- 172.21.15.146:0/3121896444 shutdown_connections 2023-10-06T11:14:44.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.348+0000 7feb76b09700 1 -- 172.21.15.146:0/3121896444 wait complete. 2023-10-06T11:14:44.351 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 100 2023-10-06T11:14:44.362 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2023-10-06T11:14:44.362 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T11:14:44.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.474+0000 7f7efffff700 1 Processor -- start 2023-10-06T11:14:44.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.474+0000 7f7efffff700 1 -- start start 2023-10-06T11:14:44.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.475+0000 7f7efffff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f00142c20 0x7f7f000cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:44.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.475+0000 7f7efffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7f00068f10 0x7f7f000cc340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:44.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.475+0000 7f7efffff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f000c89a0 con 0x7f7f00142ff0 2023-10-06T11:14:44.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.475+0000 7f7efffff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f00069390 con 0x7f7f00068f10 2023-10-06T11:14:44.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.475+0000 7f7efffff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f00069570 con 0x7f7f00142c20 2023-10-06T11:14:44.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.475+0000 7f7eff7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7f00068f10 0x7f7f000cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:44.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.475+0000 7f7efe7fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7f00142ff0 0x7f7f00068800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45280/0 (socket says 172.21.15.146:45280) 2023-10-06T11:14:44.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.475+0000 7f7efe7fc700 1 -- 172.21.15.146:0/3126560769 learned_addr learned my addr 172.21.15.146:0/3126560769 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:14:44.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.475+0000 7f7efeffd700 1 --2- 172.21.15.146:0/3126560769 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f00142c20 0x7f7f000cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:44.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.475+0000 7f7eff7fe700 1 -- 172.21.15.146:0/3126560769 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f00142c20 msgr2=0x7f7f000cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:44.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.475+0000 7f7eff7fe700 1 --2- 172.21.15.146:0/3126560769 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f00142c20 0x7f7f000cbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:44.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.475+0000 7f7eff7fe700 1 -- 172.21.15.146:0/3126560769 >> v1:172.21.15.146:6789/0 conn(0x7f7f00142ff0 legacy=0x7f7f00068800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:44.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.475+0000 7f7eff7fe700 1 -- 172.21.15.146:0/3126560769 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f00069850 con 0x7f7f00068f10 2023-10-06T11:14:44.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.475+0000 7f7efdffb700 1 -- 172.21.15.146:0/3126560769 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3793072530 0 0) 0x7f7f000c89a0 con 0x7f7f00142ff0 2023-10-06T11:14:44.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.475+0000 7f7efeffd700 1 --2- 172.21.15.146:0/3126560769 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f00142c20 0x7f7f000cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:44.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.476+0000 7f7eff7fe700 1 --2- 172.21.15.146:0/3126560769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f00068f10 0x7f7f000cc340 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f7ef00098e0 tx=0x7f7ef00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c9e35a99b339b47 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:44.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.476+0000 7f7efdffb700 1 -- 172.21.15.146:0/3126560769 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef0009e80 con 0x7f7f00068f10 2023-10-06T11:14:44.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.476+0000 7f7efdffb700 1 -- 172.21.15.146:0/3126560769 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef000b860 con 0x7f7f00068f10 2023-10-06T11:14:44.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.476+0000 7f7efdffb700 1 -- 172.21.15.146:0/3126560769 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef000bbe0 con 0x7f7f00068f10 2023-10-06T11:14:44.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.476+0000 7f7efffff700 1 -- 172.21.15.146:0/3126560769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f00068f10 msgr2=0x7f7f000cc340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:44.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.476+0000 7f7efffff700 1 --2- 172.21.15.146:0/3126560769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f00068f10 0x7f7f000cc340 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f7ef00098e0 tx=0x7f7ef00091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:44.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.476+0000 7f7efffff700 1 -- 172.21.15.146:0/3126560769 shutdown_connections 2023-10-06T11:14:44.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.476+0000 7f7efffff700 1 --2- 172.21.15.146:0/3126560769 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f00068f10 0x7f7f000cc340 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:44.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.476+0000 7f7efffff700 1 --2- 172.21.15.146:0/3126560769 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f00142c20 0x7f7f000cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:44.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.476+0000 7f7efffff700 1 -- 172.21.15.146:0/3126560769 >> 172.21.15.146:0/3126560769 conn(0x7f7f000ce230 msgr2=0x7f7f000ce630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:44.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.476+0000 7f7efffff700 1 -- 172.21.15.146:0/3126560769 shutdown_connections 2023-10-06T11:14:44.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.476+0000 7f7efffff700 1 -- 172.21.15.146:0/3126560769 wait complete. 2023-10-06T11:14:44.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.478+0000 7f7efffff700 1 Processor -- start 2023-10-06T11:14:44.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.478+0000 7f7efffff700 1 -- start start 2023-10-06T11:14:44.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.478+0000 7f7efffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f00068f10 0x7f7f0015d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:44.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.478+0000 7f7efffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f00142c20 0x7f7f0015d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:44.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.478+0000 7f7efffff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f00142ff0 0x7f7f000b27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:44.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.478+0000 7f7efffff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f000ae2a0 con 0x7f7f00142c20 2023-10-06T11:14:44.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.478+0000 7f7efffff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f000aee20 con 0x7f7f00068f10 2023-10-06T11:14:44.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.478+0000 7f7efffff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f000ae4f0 con 0x7f7f00142ff0 2023-10-06T11:14:44.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.478+0000 7f7efe7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f00142c20 0x7f7f0015d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:44.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.478+0000 7f7efe7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f00142c20 0x7f7f0015d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39446/0 (socket says 172.21.15.146:39446) 2023-10-06T11:14:44.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.478+0000 7f7efe7fc700 1 -- 172.21.15.146:0/1376446310 learned_addr learned my addr 172.21.15.146:0/1376446310 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:44.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.479+0000 7f7efeffd700 1 --2- 172.21.15.146:0/1376446310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f00068f10 0x7f7f0015d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:44.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.479+0000 7f7eff7fe700 1 --2- 172.21.15.146:0/1376446310 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f00142ff0 0x7f7f000b27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:44.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.479+0000 7f7efe7fc700 1 -- 172.21.15.146:0/1376446310 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f00142ff0 msgr2=0x7f7f000b27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:44.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.479+0000 7f7efe7fc700 1 --2- 172.21.15.146:0/1376446310 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f00142ff0 0x7f7f000b27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:44.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.479+0000 7f7efe7fc700 1 -- 172.21.15.146:0/1376446310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f00068f10 msgr2=0x7f7f0015d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:44.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.479+0000 7f7efe7fc700 1 --2- 172.21.15.146:0/1376446310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f00068f10 0x7f7f0015d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:44.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.479+0000 7f7efe7fc700 1 -- 172.21.15.146:0/1376446310 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef0009420 con 0x7f7f00142c20 2023-10-06T11:14:44.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.479+0000 7f7efe7fc700 1 --2- 172.21.15.146:0/1376446310 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f00142c20 0x7f7f0015d630 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f7ee800c5b0 tx=0x7f7ee8001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:44.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.479+0000 7f7ef6ffd700 1 -- 172.21.15.146:0/1376446310 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee8005b30 con 0x7f7f00142c20 2023-10-06T11:14:44.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.479+0000 7f7ef6ffd700 1 -- 172.21.15.146:0/1376446310 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee8005c90 con 0x7f7f00142c20 2023-10-06T11:14:44.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.479+0000 7f7efffff700 1 -- 172.21.15.146:0/1376446310 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f000ae7d0 con 0x7f7f00142c20 2023-10-06T11:14:44.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.479+0000 7f7ef6ffd700 1 -- 172.21.15.146:0/1376446310 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee8007320 con 0x7f7f00142c20 2023-10-06T11:14:44.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.479+0000 7f7efffff700 1 -- 172.21.15.146:0/1376446310 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f000b2cf0 con 0x7f7f00142c20 2023-10-06T11:14:44.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.480+0000 7f7efffff700 1 -- 172.21.15.146:0/1376446310 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f000aef90 con 0x7f7f00142c20 2023-10-06T11:14:44.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.480+0000 7f7ef6ffd700 1 -- 172.21.15.146:0/1376446310 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7ee801b3b0 con 0x7f7f00142c20 2023-10-06T11:14:44.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.481+0000 7f7ef6ffd700 1 --2- 172.21.15.146:0/1376446310 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7ee0066f30 0x7f7ee00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:44.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.481+0000 7f7ef6ffd700 1 -- 172.21.15.146:0/1376446310 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7ee8083a60 con 0x7f7f00142c20 2023-10-06T11:14:44.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.481+0000 7f7efeffd700 1 --2- 172.21.15.146:0/1376446310 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7ee0066f30 0x7f7ee00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:44.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.481+0000 7f7efeffd700 1 --2- 172.21.15.146:0/1376446310 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7ee0066f30 0x7f7ee00693e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f7f001416b0 tx=0x7f7ef8009a20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:44.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.485+0000 7f7ef6ffd700 1 -- 172.21.15.146:0/1376446310 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7ee8050b70 con 0x7f7f00142c20 2023-10-06T11:14:44.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.751+0000 7f7efffff700 1 -- 172.21.15.146:0/1376446310 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f7f00069b30 con 0x7f7f00142c20 2023-10-06T11:14:44.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.752+0000 7f7ef6ffd700 1 -- 172.21.15.146:0/1376446310 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1579 (secure 0 0 0) 0x7f7ee8017080 con 0x7f7f00142c20 2023-10-06T11:14:44.754 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:44.754 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":559,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":113,"num_osds":8,"num_up_osds":8,"osd_up_since":1696590336,"num_in_osds":8,"osd_in_since":1696590327,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":1033,"data_bytes":1060951615,"bytes_used":4590592000,"bytes_avail":768503521280,"bytes_total":773094113280,"write_bytes_sec":87739444,"read_op_per_sec":0,"write_op_per_sec":85},"fsmap":{"epoch":100,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":8103}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":20,"modified":"2023-10-06T11:14:01.246582+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T11:14:44.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.754+0000 7f7efffff700 1 -- 172.21.15.146:0/1376446310 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7ee0066f30 msgr2=0x7f7ee00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:44.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.754+0000 7f7efffff700 1 --2- 172.21.15.146:0/1376446310 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7ee0066f30 0x7f7ee00693e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f7f001416b0 tx=0x7f7ef8009a20 comp rx=0 tx=0).stop 2023-10-06T11:14:44.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.754+0000 7f7efffff700 1 -- 172.21.15.146:0/1376446310 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f00142c20 msgr2=0x7f7f0015d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:44.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.754+0000 7f7efffff700 1 --2- 172.21.15.146:0/1376446310 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f00142c20 0x7f7f0015d630 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f7ee800c5b0 tx=0x7f7ee8001070 comp rx=0 tx=0).stop 2023-10-06T11:14:44.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.754+0000 7f7efffff700 1 -- 172.21.15.146:0/1376446310 shutdown_connections 2023-10-06T11:14:44.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.754+0000 7f7efffff700 1 --2- 172.21.15.146:0/1376446310 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7ee0066f30 0x7f7ee00693e0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:44.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.754+0000 7f7efffff700 1 --2- 172.21.15.146:0/1376446310 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7f00142ff0 0x7f7f000b27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:44.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.754+0000 7f7efffff700 1 --2- 172.21.15.146:0/1376446310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f00068f10 0x7f7f0015d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:44.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.754+0000 7f7efffff700 1 --2- 172.21.15.146:0/1376446310 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7f00142c20 0x7f7f0015d630 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:44.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.754+0000 7f7efffff700 1 -- 172.21.15.146:0/1376446310 >> 172.21.15.146:0/1376446310 conn(0x7f7f000ce230 msgr2=0x7f7f000c4070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:44.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.754+0000 7f7efffff700 1 -- 172.21.15.146:0/1376446310 shutdown_connections 2023-10-06T11:14:44.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:44.754+0000 7f7efffff700 1 -- 172.21.15.146:0/1376446310 wait complete. 2023-10-06T11:14:44.767 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2023-10-06T11:14:45.768 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:14:45.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.894+0000 7f0cd0bf7700 1 Processor -- start 2023-10-06T11:14:45.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.894+0000 7f0cd0bf7700 1 -- start start 2023-10-06T11:14:45.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.895+0000 7f0cd0bf7700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ccc153ab0 0x7f0ccc15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:45.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.895+0000 7f0cd0bf7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0ccc153e80 0x7f0ccc068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:45.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.895+0000 7f0cd0bf7700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ccc15ac30 con 0x7f0ccc0689d0 2023-10-06T11:14:45.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.895+0000 7f0cd0bf7700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ccc068e50 con 0x7f0ccc153e80 2023-10-06T11:14:45.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.895+0000 7f0cd0bf7700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ccc0b4510 con 0x7f0ccc153ab0 2023-10-06T11:14:45.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.895+0000 7f0cc1d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0ccc153e80 0x7f0ccc068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:45.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.895+0000 7f0ccad9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0ccc0689d0 0x7f0ccc15d270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45292/0 (socket says 172.21.15.146:45292) 2023-10-06T11:14:45.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.895+0000 7f0ccad9d700 1 -- 172.21.15.146:0/3797597140 learned_addr learned my addr 172.21.15.146:0/3797597140 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:14:45.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.895+0000 7f0cca59c700 1 --2- 172.21.15.146:0/3797597140 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ccc153ab0 0x7f0ccc15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:45.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.896+0000 7f0cc1d9b700 1 -- 172.21.15.146:0/3797597140 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ccc153ab0 msgr2=0x7f0ccc15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:45.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.896+0000 7f0cc1d9b700 1 --2- 172.21.15.146:0/3797597140 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ccc153ab0 0x7f0ccc15a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:45.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.896+0000 7f0cc1d9b700 1 -- 172.21.15.146:0/3797597140 >> v1:172.21.15.146:6789/0 conn(0x7f0ccc0689d0 legacy=0x7f0ccc15d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:45.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.896+0000 7f0cc9d9b700 1 -- 172.21.15.146:0/3797597140 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2462424090 0 0) 0x7f0cc4001490 con 0x7f0ccc0689d0 2023-10-06T11:14:45.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.896+0000 7f0cc1d9b700 1 -- 172.21.15.146:0/3797597140 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ccc0b6530 con 0x7f0ccc153e80 2023-10-06T11:14:45.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.896+0000 7f0cc1d9b700 1 --2- 172.21.15.146:0/3797597140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ccc153e80 0x7f0ccc068490 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f0cb40098e0 tx=0x7f0cb40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=580cbb29f775f90e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:45.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.896+0000 7f0cc9d9b700 1 -- 172.21.15.146:0/3797597140 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb400b640 con 0x7f0ccc153e80 2023-10-06T11:14:45.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.896+0000 7f0cc9d9b700 1 -- 172.21.15.146:0/3797597140 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb400b7a0 con 0x7f0ccc153e80 2023-10-06T11:14:45.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.896+0000 7f0cc9d9b700 1 -- 172.21.15.146:0/3797597140 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb400bb40 con 0x7f0ccc153e80 2023-10-06T11:14:45.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.896+0000 7f0cd0bf7700 1 -- 172.21.15.146:0/3797597140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ccc153e80 msgr2=0x7f0ccc068490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:45.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.896+0000 7f0cd0bf7700 1 --2- 172.21.15.146:0/3797597140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ccc153e80 0x7f0ccc068490 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f0cb40098e0 tx=0x7f0cb40091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:45.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.897+0000 7f0cd0bf7700 1 -- 172.21.15.146:0/3797597140 shutdown_connections 2023-10-06T11:14:45.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.897+0000 7f0cd0bf7700 1 --2- 172.21.15.146:0/3797597140 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ccc153ab0 0x7f0ccc15a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:45.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.897+0000 7f0cd0bf7700 1 --2- 172.21.15.146:0/3797597140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ccc153e80 0x7f0ccc068490 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:45.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.897+0000 7f0cd0bf7700 1 -- 172.21.15.146:0/3797597140 >> 172.21.15.146:0/3797597140 conn(0x7f0ccc06eba0 msgr2=0x7f0ccc06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:45.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.897+0000 7f0cd0bf7700 1 -- 172.21.15.146:0/3797597140 shutdown_connections 2023-10-06T11:14:45.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.897+0000 7f0cd0bf7700 1 -- 172.21.15.146:0/3797597140 wait complete. 2023-10-06T11:14:45.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.898+0000 7f0cd0bf7700 1 Processor -- start 2023-10-06T11:14:45.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.898+0000 7f0cd0bf7700 1 -- start start 2023-10-06T11:14:45.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.899+0000 7f0cd0bf7700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ccc0689d0 0x7f0ccc141170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:45.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.899+0000 7f0cd0bf7700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ccc153ab0 0x7f0ccc1416b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:45.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.899+0000 7f0cd0bf7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ccc153e80 0x7f0ccc13f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:45.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.899+0000 7f0cd0bf7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ccc1421c0 con 0x7f0ccc153e80 2023-10-06T11:14:45.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.899+0000 7f0cd0bf7700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ccc142ec0 con 0x7f0ccc153ab0 2023-10-06T11:14:45.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.899+0000 7f0cd0bf7700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ccc141ee0 con 0x7f0ccc0689d0 2023-10-06T11:14:45.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.899+0000 7f0ccad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ccc153e80 0x7f0ccc13f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:45.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.899+0000 7f0ccad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ccc153e80 0x7f0ccc13f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39458/0 (socket says 172.21.15.146:39458) 2023-10-06T11:14:45.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.899+0000 7f0ccad9d700 1 -- 172.21.15.146:0/2630620576 learned_addr learned my addr 172.21.15.146:0/2630620576 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:45.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.899+0000 7f0cca59c700 1 --2- 172.21.15.146:0/2630620576 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ccc0689d0 0x7f0ccc141170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:45.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.899+0000 7f0cc1d9b700 1 --2- 172.21.15.146:0/2630620576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ccc153ab0 0x7f0ccc1416b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:45.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.899+0000 7f0ccad9d700 1 -- 172.21.15.146:0/2630620576 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ccc0689d0 msgr2=0x7f0ccc141170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:45.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.899+0000 7f0ccad9d700 1 --2- 172.21.15.146:0/2630620576 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ccc0689d0 0x7f0ccc141170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:45.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.899+0000 7f0ccad9d700 1 -- 172.21.15.146:0/2630620576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ccc153ab0 msgr2=0x7f0ccc1416b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:45.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.899+0000 7f0ccad9d700 1 --2- 172.21.15.146:0/2630620576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ccc153ab0 0x7f0ccc1416b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:45.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.899+0000 7f0ccad9d700 1 -- 172.21.15.146:0/2630620576 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb4009420 con 0x7f0ccc153e80 2023-10-06T11:14:45.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.899+0000 7f0ccad9d700 1 --2- 172.21.15.146:0/2630620576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ccc153e80 0x7f0ccc13f240 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f0cc400cc20 tx=0x7f0cc40019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:45.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.899+0000 7f0cc2ffd700 1 -- 172.21.15.146:0/2630620576 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc400a870 con 0x7f0ccc153e80 2023-10-06T11:14:45.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.899+0000 7f0cc2ffd700 1 -- 172.21.15.146:0/2630620576 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cc400a9d0 con 0x7f0ccc153e80 2023-10-06T11:14:45.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.899+0000 7f0cc2ffd700 1 -- 172.21.15.146:0/2630620576 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc400ad90 con 0x7f0ccc153e80 2023-10-06T11:14:45.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.899+0000 7f0cd0bf7700 1 -- 172.21.15.146:0/2630620576 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ccc142870 con 0x7f0ccc153e80 2023-10-06T11:14:45.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.899+0000 7f0cd0bf7700 1 -- 172.21.15.146:0/2630620576 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ccc141bf0 con 0x7f0ccc153e80 2023-10-06T11:14:45.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.900+0000 7f0cd0bf7700 1 -- 172.21.15.146:0/2630620576 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ccc04c380 con 0x7f0ccc153e80 2023-10-06T11:14:45.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.901+0000 7f0cc2ffd700 1 -- 172.21.15.146:0/2630620576 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0cc4007300 con 0x7f0ccc153e80 2023-10-06T11:14:45.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.901+0000 7f0cc2ffd700 1 --2- 172.21.15.146:0/2630620576 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0cac066f30 0x7f0cac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:45.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.901+0000 7f0cc2ffd700 1 -- 172.21.15.146:0/2630620576 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0cc40847a0 con 0x7f0ccc153e80 2023-10-06T11:14:45.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.901+0000 7f0cca59c700 1 --2- 172.21.15.146:0/2630620576 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0cac066f30 0x7f0cac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:45.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.901+0000 7f0cca59c700 1 --2- 172.21.15.146:0/2630620576 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0cac066f30 0x7f0cac0693e0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc009db0 tx=0x7f0cbc0091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:45.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:45.905+0000 7f0cc2ffd700 1 -- 172.21.15.146:0/2630620576 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0cc4051930 con 0x7f0ccc153e80 2023-10-06T11:14:46.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.129+0000 7f0cd0bf7700 1 -- 172.21.15.146:0/2630620576 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ccc15ac30 con 0x7f0ccc153e80 2023-10-06T11:14:46.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.129+0000 7f0cc2ffd700 1 -- 172.21.15.146:0/2630620576 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) v1 ==== 95+0+4610 (secure 0 0 0) 0x7f0ccc15ac30 con 0x7f0ccc153e80 2023-10-06T11:14:46.131 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:46.131 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":100,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6560,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/2109567995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2109567995},{"type":"v1","addr":"172.21.15.151:6834","nonce":2109567995}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":6563,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1783565134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":1783565134},{"type":"v1","addr":"172.21.15.151:6835","nonce":1783565134}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7327,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/1323749517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1323749517},{"type":"v1","addr":"172.21.15.146:6836","nonce":1323749517}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:14:18.891938+0000","modified":"2023-10-06T11:14:22.531674+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8103":{"gid":8103,"name":"c","rank":0,"incarnation":97,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/409226151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":409226151},{"type":"v1","addr":"172.21.15.146:6837","nonce":409226151}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-06T11:14:46.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.131+0000 7f0cd0bf7700 1 -- 172.21.15.146:0/2630620576 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0cac066f30 msgr2=0x7f0cac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:46.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.131+0000 7f0cd0bf7700 1 --2- 172.21.15.146:0/2630620576 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0cac066f30 0x7f0cac0693e0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f0cbc009db0 tx=0x7f0cbc0091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.131+0000 7f0cd0bf7700 1 -- 172.21.15.146:0/2630620576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ccc153e80 msgr2=0x7f0ccc13f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:46.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.131+0000 7f0cd0bf7700 1 --2- 172.21.15.146:0/2630620576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ccc153e80 0x7f0ccc13f240 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f0cc400cc20 tx=0x7f0cc40019b0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.131+0000 7f0cd0bf7700 1 -- 172.21.15.146:0/2630620576 shutdown_connections 2023-10-06T11:14:46.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.131+0000 7f0cd0bf7700 1 --2- 172.21.15.146:0/2630620576 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0cac066f30 0x7f0cac0693e0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.132+0000 7f0cd0bf7700 1 --2- 172.21.15.146:0/2630620576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ccc153e80 0x7f0ccc13f240 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.132+0000 7f0cd0bf7700 1 --2- 172.21.15.146:0/2630620576 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ccc0689d0 0x7f0ccc141170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.132+0000 7f0cd0bf7700 1 --2- 172.21.15.146:0/2630620576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ccc153ab0 0x7f0ccc1416b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.132+0000 7f0cd0bf7700 1 -- 172.21.15.146:0/2630620576 >> 172.21.15.146:0/2630620576 conn(0x7f0ccc06eba0 msgr2=0x7f0ccc0ce940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:46.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.132+0000 7f0cd0bf7700 1 -- 172.21.15.146:0/2630620576 shutdown_connections 2023-10-06T11:14:46.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.132+0000 7f0cd0bf7700 1 -- 172.21.15.146:0/2630620576 wait complete. 2023-10-06T11:14:46.135 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 100 2023-10-06T11:14:46.145 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2023-10-06T11:14:46.146 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T11:14:46.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.257+0000 7f4ae1f17700 1 Processor -- start 2023-10-06T11:14:46.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.257+0000 7f4ae1f17700 1 -- start start 2023-10-06T11:14:46.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.258+0000 7f4ae1f17700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4adc153ab0 0x7f4adc15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.258+0000 7f4ae1f17700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4adc153e80 0x7f4adc068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.258+0000 7f4ae1f17700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4adc15ac30 con 0x7f4adc0689d0 2023-10-06T11:14:46.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.258+0000 7f4ae1f17700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4adc068e50 con 0x7f4adc153e80 2023-10-06T11:14:46.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.258+0000 7f4ae1f17700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4adc0b4510 con 0x7f4adc153ab0 2023-10-06T11:14:46.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.258+0000 7f4ad3fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4adc153e80 0x7f4adc068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.258+0000 7f4adbfff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4adc0689d0 0x7f4adc15d270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45296/0 (socket says 172.21.15.146:45296) 2023-10-06T11:14:46.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.258+0000 7f4adbfff700 1 -- 172.21.15.146:0/3662798653 learned_addr learned my addr 172.21.15.146:0/3662798653 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:14:46.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.258+0000 7f4ad3fff700 1 -- 172.21.15.146:0/3662798653 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4adc153ab0 msgr2=0x7f4adc15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:46.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.258+0000 7f4adb7fe700 1 --2- 172.21.15.146:0/3662798653 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4adc153ab0 0x7f4adc15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.258+0000 7f4ad3fff700 1 --2- 172.21.15.146:0/3662798653 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4adc153ab0 0x7f4adc15a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.258+0000 7f4adaffd700 1 -- 172.21.15.146:0/3662798653 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 239787259 0 0) 0x7f4ad4001490 con 0x7f4adc0689d0 2023-10-06T11:14:46.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.258+0000 7f4ad3fff700 1 -- 172.21.15.146:0/3662798653 >> v1:172.21.15.146:6789/0 conn(0x7f4adc0689d0 legacy=0x7f4adc15d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:46.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.258+0000 7f4ad3fff700 1 -- 172.21.15.146:0/3662798653 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4adc0b6530 con 0x7f4adc153e80 2023-10-06T11:14:46.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.259+0000 7f4ad3fff700 1 --2- 172.21.15.146:0/3662798653 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4adc153e80 0x7f4adc068490 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f4ac40098e0 tx=0x7f4ac40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fae3ecc7282876a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:46.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.259+0000 7f4adaffd700 1 -- 172.21.15.146:0/3662798653 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac4009e80 con 0x7f4adc153e80 2023-10-06T11:14:46.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.259+0000 7f4adaffd700 1 -- 172.21.15.146:0/3662798653 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac400b860 con 0x7f4adc153e80 2023-10-06T11:14:46.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.259+0000 7f4adaffd700 1 -- 172.21.15.146:0/3662798653 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac400bbe0 con 0x7f4adc153e80 2023-10-06T11:14:46.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.259+0000 7f4ae1f17700 1 -- 172.21.15.146:0/3662798653 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4adc153e80 msgr2=0x7f4adc068490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:46.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.259+0000 7f4ae1f17700 1 --2- 172.21.15.146:0/3662798653 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4adc153e80 0x7f4adc068490 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f4ac40098e0 tx=0x7f4ac40091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.259+0000 7f4ae1f17700 1 -- 172.21.15.146:0/3662798653 shutdown_connections 2023-10-06T11:14:46.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.259+0000 7f4ae1f17700 1 --2- 172.21.15.146:0/3662798653 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4adc153ab0 0x7f4adc15a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.259+0000 7f4ae1f17700 1 --2- 172.21.15.146:0/3662798653 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4adc153e80 0x7f4adc068490 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.259+0000 7f4ae1f17700 1 -- 172.21.15.146:0/3662798653 >> 172.21.15.146:0/3662798653 conn(0x7f4adc06eba0 msgr2=0x7f4adc06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:46.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.259+0000 7f4ae1f17700 1 -- 172.21.15.146:0/3662798653 shutdown_connections 2023-10-06T11:14:46.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.259+0000 7f4ae1f17700 1 -- 172.21.15.146:0/3662798653 wait complete. 2023-10-06T11:14:46.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.260+0000 7f4ae1f17700 1 Processor -- start 2023-10-06T11:14:46.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.260+0000 7f4ae1f17700 1 -- start start 2023-10-06T11:14:46.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.261+0000 7f4ae1f17700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4adc0689d0 0x7f4adc157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.261+0000 7f4ae1f17700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4adc153ab0 0x7f4adc150010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.261+0000 7f4ae1f17700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4adc153e80 0x7f4adc0b1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.261+0000 7f4ae1f17700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4adc154fd0 con 0x7f4adc153e80 2023-10-06T11:14:46.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.261+0000 7f4ae1f17700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4adc150550 con 0x7f4adc153ab0 2023-10-06T11:14:46.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.261+0000 7f4ae1f17700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4adc1543c0 con 0x7f4adc0689d0 2023-10-06T11:14:46.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.261+0000 7f4adbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4adc153e80 0x7f4adc0b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.261+0000 7f4adbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4adc153e80 0x7f4adc0b1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39482/0 (socket says 172.21.15.146:39482) 2023-10-06T11:14:46.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.261+0000 7f4adbfff700 1 -- 172.21.15.146:0/1770359891 learned_addr learned my addr 172.21.15.146:0/1770359891 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:46.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.261+0000 7f4ad3fff700 1 --2- 172.21.15.146:0/1770359891 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4adc153ab0 0x7f4adc150010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.261+0000 7f4adb7fe700 1 --2- 172.21.15.146:0/1770359891 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4adc0689d0 0x7f4adc157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.261+0000 7f4adbfff700 1 -- 172.21.15.146:0/1770359891 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4adc0689d0 msgr2=0x7f4adc157390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:46.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.261+0000 7f4adbfff700 1 --2- 172.21.15.146:0/1770359891 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4adc0689d0 0x7f4adc157390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.261+0000 7f4adbfff700 1 -- 172.21.15.146:0/1770359891 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4adc153ab0 msgr2=0x7f4adc150010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:46.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.261+0000 7f4adbfff700 1 --2- 172.21.15.146:0/1770359891 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4adc153ab0 0x7f4adc150010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.262+0000 7f4adbfff700 1 -- 172.21.15.146:0/1770359891 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac4009420 con 0x7f4adc153e80 2023-10-06T11:14:46.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.262+0000 7f4adb7fe700 1 --2- 172.21.15.146:0/1770359891 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4adc0689d0 0x7f4adc157390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:46.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.262+0000 7f4adbfff700 1 --2- 172.21.15.146:0/1770359891 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4adc153e80 0x7f4adc0b1840 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f4ad400cbf0 tx=0x7f4ad40019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:46.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.262+0000 7f4ad37fe700 1 -- 172.21.15.146:0/1770359891 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad400a9c0 con 0x7f4adc153e80 2023-10-06T11:14:46.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.262+0000 7f4ad37fe700 1 -- 172.21.15.146:0/1770359891 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad400ab20 con 0x7f4adc153e80 2023-10-06T11:14:46.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.262+0000 7f4ae1f17700 1 -- 172.21.15.146:0/1770359891 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4adc1546a0 con 0x7f4adc153e80 2023-10-06T11:14:46.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.262+0000 7f4ad37fe700 1 -- 172.21.15.146:0/1770359891 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad40070f0 con 0x7f4adc153e80 2023-10-06T11:14:46.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.262+0000 7f4ae1f17700 1 -- 172.21.15.146:0/1770359891 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4adc154c60 con 0x7f4adc153e80 2023-10-06T11:14:46.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.263+0000 7f4ae1f17700 1 -- 172.21.15.146:0/1770359891 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4adc155140 con 0x7f4adc153e80 2023-10-06T11:14:46.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.263+0000 7f4ad37fe700 1 -- 172.21.15.146:0/1770359891 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4ad4007520 con 0x7f4adc153e80 2023-10-06T11:14:46.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.263+0000 7f4ad37fe700 1 --2- 172.21.15.146:0/1770359891 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4abc066f30 0x7f4abc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.264+0000 7f4ad37fe700 1 -- 172.21.15.146:0/1770359891 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4ad4084930 con 0x7f4adc153e80 2023-10-06T11:14:46.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.264+0000 7f4adb7fe700 1 --2- 172.21.15.146:0/1770359891 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4abc066f30 0x7f4abc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.264+0000 7f4adb7fe700 1 --2- 172.21.15.146:0/1770359891 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4abc066f30 0x7f4abc0693e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f4acc008a80 tx=0x7f4acc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:46.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.268+0000 7f4ad37fe700 1 -- 172.21.15.146:0/1770359891 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ad4051ac0 con 0x7f4adc153e80 2023-10-06T11:14:46.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.530+0000 7f4ae1f17700 1 -- 172.21.15.146:0/1770359891 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f4adc15ac30 con 0x7f4adc153e80 2023-10-06T11:14:46.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.531+0000 7f4ad37fe700 1 -- 172.21.15.146:0/1770359891 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1602 (secure 0 0 0) 0x7f4adc15ac30 con 0x7f4adc153e80 2023-10-06T11:14:46.535 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:46.535 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":560,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":113,"num_osds":8,"num_up_osds":8,"osd_up_since":1696590336,"num_in_osds":8,"osd_in_since":1696590327,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":1033,"data_bytes":1060951615,"bytes_used":4590592000,"bytes_avail":768503521280,"bytes_total":773094113280,"write_bytes_sec":59939343,"read_op_per_sec":0,"write_op_per_sec":58},"fsmap":{"epoch":100,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":8103}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2023-10-06T11:14:45.255803+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T11:14:46.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.533+0000 7f4ae1f17700 1 -- 172.21.15.146:0/1770359891 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4abc066f30 msgr2=0x7f4abc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:46.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.533+0000 7f4ae1f17700 1 --2- 172.21.15.146:0/1770359891 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4abc066f30 0x7f4abc0693e0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f4acc008a80 tx=0x7f4acc008040 comp rx=0 tx=0).stop 2023-10-06T11:14:46.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.533+0000 7f4ae1f17700 1 -- 172.21.15.146:0/1770359891 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4adc153e80 msgr2=0x7f4adc0b1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:46.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.533+0000 7f4ae1f17700 1 --2- 172.21.15.146:0/1770359891 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4adc153e80 0x7f4adc0b1840 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f4ad400cbf0 tx=0x7f4ad40019b0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.533+0000 7f4ae1f17700 1 -- 172.21.15.146:0/1770359891 shutdown_connections 2023-10-06T11:14:46.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.533+0000 7f4ae1f17700 1 --2- 172.21.15.146:0/1770359891 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4abc066f30 0x7f4abc0693e0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.533+0000 7f4ae1f17700 1 --2- 172.21.15.146:0/1770359891 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4adc153e80 0x7f4adc0b1840 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.533+0000 7f4ae1f17700 1 --2- 172.21.15.146:0/1770359891 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4adc0689d0 0x7f4adc157390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.533+0000 7f4ae1f17700 1 --2- 172.21.15.146:0/1770359891 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4adc153ab0 0x7f4adc150010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.533+0000 7f4ae1f17700 1 -- 172.21.15.146:0/1770359891 >> 172.21.15.146:0/1770359891 conn(0x7f4adc06eba0 msgr2=0x7f4adc0d0870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:46.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.533+0000 7f4ae1f17700 1 -- 172.21.15.146:0/1770359891 shutdown_connections 2023-10-06T11:14:46.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.533+0000 7f4ae1f17700 1 -- 172.21.15.146:0/1770359891 wait complete. 2023-10-06T11:14:46.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'c': 'paused'} 2023-10-06T11:14:46.547 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 scrub abort 2023-10-06T11:14:46.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.664+0000 7fc087fff700 1 Processor -- start 2023-10-06T11:14:46.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.664+0000 7fc087fff700 1 -- start start 2023-10-06T11:14:46.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.665+0000 7fc087fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc0880b5640 0x7fc08815a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.665+0000 7fc087fff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc088068780 0x7fc088068c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.665+0000 7fc087fff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0880cc130 con 0x7fc0880cb090 2023-10-06T11:14:46.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.665+0000 7fc087fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc088069140 con 0x7fc0880b5640 2023-10-06T11:14:46.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.665+0000 7fc087fff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0880cccd0 con 0x7fc088068780 2023-10-06T11:14:46.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.665+0000 7fc086ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc0880b5640 0x7fc08815a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.665+0000 7fc086ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc0880b5640 0x7fc08815a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39484/0 (socket says 172.21.15.146:39484) 2023-10-06T11:14:46.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.665+0000 7fc086ffd700 1 -- 172.21.15.146:0/110937758 learned_addr learned my addr 172.21.15.146:0/110937758 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:46.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.665+0000 7fc0877fe700 1 --2- 172.21.15.146:0/110937758 >> v2:172.21.15.151:3300/0 conn(0x7fc088068780 0x7fc088068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.665+0000 7fc086ffd700 1 -- 172.21.15.146:0/110937758 >> v2:172.21.15.151:3300/0 conn(0x7fc088068780 msgr2=0x7fc088068c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:46.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.665+0000 7fc086ffd700 1 --2- 172.21.15.146:0/110937758 >> v2:172.21.15.151:3300/0 conn(0x7fc088068780 0x7fc088068c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.665+0000 7fc086ffd700 1 -- 172.21.15.146:0/110937758 >> v1:172.21.15.151:6789/0 conn(0x7fc0880cb090 legacy=0x7fc0880cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:46.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.665+0000 7fc086ffd700 1 -- 172.21.15.146:0/110937758 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0880b2660 con 0x7fc0880b5640 2023-10-06T11:14:46.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.666+0000 7fc086ffd700 1 --2- 172.21.15.146:0/110937758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0880b5640 0x7fc08815a870 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fc0780099b0 tx=0x7fc078009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14f87b75370127a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:46.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.666+0000 7fc0867fc700 1 -- 172.21.15.146:0/110937758 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07800b7e0 con 0x7fc0880b5640 2023-10-06T11:14:46.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.666+0000 7fc0867fc700 1 -- 172.21.15.146:0/110937758 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07800b940 con 0x7fc0880b5640 2023-10-06T11:14:46.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.666+0000 7fc0867fc700 1 -- 172.21.15.146:0/110937758 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07800bce0 con 0x7fc0880b5640 2023-10-06T11:14:46.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.666+0000 7fc087fff700 1 -- 172.21.15.146:0/110937758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0880b5640 msgr2=0x7fc08815a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:46.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.666+0000 7fc087fff700 1 --2- 172.21.15.146:0/110937758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0880b5640 0x7fc08815a870 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fc0780099b0 tx=0x7fc078009250 comp rx=0 tx=0).stop 2023-10-06T11:14:46.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.666+0000 7fc087fff700 1 -- 172.21.15.146:0/110937758 shutdown_connections 2023-10-06T11:14:46.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.666+0000 7fc087fff700 1 --2- 172.21.15.146:0/110937758 >> v2:172.21.15.151:3300/0 conn(0x7fc088068780 0x7fc088068c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.666+0000 7fc087fff700 1 --2- 172.21.15.146:0/110937758 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc0880b5640 0x7fc08815a870 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.666+0000 7fc087fff700 1 -- 172.21.15.146:0/110937758 >> 172.21.15.146:0/110937758 conn(0x7fc0880703f0 msgr2=0x7fc0880707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:46.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.666+0000 7fc087fff700 1 -- 172.21.15.146:0/110937758 shutdown_connections 2023-10-06T11:14:46.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.666+0000 7fc087fff700 1 -- 172.21.15.146:0/110937758 wait complete. 2023-10-06T11:14:46.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.668+0000 7fc087fff700 1 Processor -- start 2023-10-06T11:14:46.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.668+0000 7fc087fff700 1 -- start start 2023-10-06T11:14:46.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.668+0000 7fc087fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc088068780 0x7fc08816ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.668+0000 7fc087fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0880b5640 0x7fc08815e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.668+0000 7fc087fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0880cb090 0x7fc0880c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.668+0000 7fc087fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0880c48f0 con 0x7fc088068780 2023-10-06T11:14:46.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.668+0000 7fc087fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08815d640 con 0x7fc0880cb090 2023-10-06T11:14:46.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.668+0000 7fc087fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc08815d920 con 0x7fc0880b5640 2023-10-06T11:14:46.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.668+0000 7fc086ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc088068780 0x7fc08816ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.668+0000 7fc086ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc088068780 0x7fc08816ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39496/0 (socket says 172.21.15.146:39496) 2023-10-06T11:14:46.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.668+0000 7fc086ffd700 1 -- 172.21.15.146:0/3337866993 learned_addr learned my addr 172.21.15.146:0/3337866993 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:46.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.669+0000 7fc0877fe700 1 --2- 172.21.15.146:0/3337866993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0880cb090 0x7fc0880c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.669+0000 7fc07e7fc700 1 --2- 172.21.15.146:0/3337866993 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0880b5640 0x7fc08815e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.669+0000 7fc086ffd700 1 -- 172.21.15.146:0/3337866993 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0880b5640 msgr2=0x7fc08815e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:46.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.669+0000 7fc086ffd700 1 --2- 172.21.15.146:0/3337866993 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0880b5640 0x7fc08815e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.669+0000 7fc086ffd700 1 -- 172.21.15.146:0/3337866993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0880cb090 msgr2=0x7fc0880c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:46.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.669+0000 7fc086ffd700 1 --2- 172.21.15.146:0/3337866993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0880cb090 0x7fc0880c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.669+0000 7fc086ffd700 1 -- 172.21.15.146:0/3337866993 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0780094f0 con 0x7fc088068780 2023-10-06T11:14:46.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.669+0000 7fc086ffd700 1 --2- 172.21.15.146:0/3337866993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc088068780 0x7fc08816ca40 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fc078009290 tx=0x7fc078016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:46.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.669+0000 7fc07f7fe700 1 -- 172.21.15.146:0/3337866993 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc078006bc0 con 0x7fc088068780 2023-10-06T11:14:46.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.669+0000 7fc07f7fe700 1 -- 172.21.15.146:0/3337866993 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07801b470 con 0x7fc088068780 2023-10-06T11:14:46.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.669+0000 7fc07f7fe700 1 -- 172.21.15.146:0/3337866993 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07801b810 con 0x7fc088068780 2023-10-06T11:14:46.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.669+0000 7fc087fff700 1 -- 172.21.15.146:0/3337866993 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc08815dc00 con 0x7fc088068780 2023-10-06T11:14:46.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.669+0000 7fc087fff700 1 -- 172.21.15.146:0/3337866993 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc08815e1c0 con 0x7fc088068780 2023-10-06T11:14:46.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.671+0000 7fc07f7fe700 1 -- 172.21.15.146:0/3337866993 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc07801bc00 con 0x7fc088068780 2023-10-06T11:14:46.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.671+0000 7fc07f7fe700 1 --2- 172.21.15.146:0/3337866993 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc068066f60 0x7fc068069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.671+0000 7fc07f7fe700 1 -- 172.21.15.146:0/3337866993 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc078086080 con 0x7fc088068780 2023-10-06T11:14:46.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.671+0000 7fc07e7fc700 1 --2- 172.21.15.146:0/3337866993 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc068066f60 0x7fc068069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.672+0000 7fc07e7fc700 1 --2- 172.21.15.146:0/3337866993 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc068066f60 0x7fc068069410 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fc070006fd0 tx=0x7fc070008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:46.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.673+0000 7fc096c35b80 1 Processor -- start 2023-10-06T11:14:46.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.673+0000 7fc096c35b80 1 -- start start 2023-10-06T11:14:46.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.674+0000 7fc096c35b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5621e9188990 0x5621e9188d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.674+0000 7fc096c35b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621e91d2c00 0x5621e91b1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.674+0000 7fc096c35b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5621e91b1ea0 0x5621e91849d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.674+0000 7fc096c35b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621e9108cc0 con 0x5621e91d2c00 2023-10-06T11:14:46.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.674+0000 7fc096c35b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621e90dfab0 con 0x5621e9188990 2023-10-06T11:14:46.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.674+0000 7fc096c35b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5621e90dd2b0 con 0x5621e91b1ea0 2023-10-06T11:14:46.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.674+0000 7fc07e7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621e91d2c00 0x5621e91b1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.674+0000 7fc07e7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621e91d2c00 0x5621e91b1960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39502/0 (socket says 172.21.15.146:39502) 2023-10-06T11:14:46.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.674+0000 7fc07e7fc700 1 -- 172.21.15.146:0/973331313 learned_addr learned my addr 172.21.15.146:0/973331313 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:46.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.674+0000 7fc086ffd700 1 --2- 172.21.15.146:0/973331313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5621e9188990 0x5621e9188d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.674+0000 7fc0877fe700 1 --2- 172.21.15.146:0/973331313 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5621e91b1ea0 0x5621e91849d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.674+0000 7fc07e7fc700 1 -- 172.21.15.146:0/973331313 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5621e91b1ea0 msgr2=0x5621e91849d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:46.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.674+0000 7fc07e7fc700 1 --2- 172.21.15.146:0/973331313 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5621e91b1ea0 0x5621e91849d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.674+0000 7fc07e7fc700 1 -- 172.21.15.146:0/973331313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5621e9188990 msgr2=0x5621e9188d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:46.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.674+0000 7fc07e7fc700 1 --2- 172.21.15.146:0/973331313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5621e9188990 0x5621e9188d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.674+0000 7fc07e7fc700 1 -- 172.21.15.146:0/973331313 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621e8f732b0 con 0x5621e91d2c00 2023-10-06T11:14:46.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.674+0000 7fc07e7fc700 1 --2- 172.21.15.146:0/973331313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621e91d2c00 0x5621e91b1960 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7fc07000d7f0 tx=0x7fc070012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afc93aa9c932b4a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:46.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.674+0000 7fc067fff700 1 -- 172.21.15.146:0/973331313 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc070012630 con 0x5621e91d2c00 2023-10-06T11:14:46.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.674+0000 7fc067fff700 1 -- 172.21.15.146:0/973331313 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc070012790 con 0x5621e91d2c00 2023-10-06T11:14:46.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.674+0000 7fc067fff700 1 -- 172.21.15.146:0/973331313 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc070012b10 con 0x5621e91d2c00 2023-10-06T11:14:46.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.675+0000 7fc096c35b80 1 -- 172.21.15.146:0/973331313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621e91d2c00 msgr2=0x5621e91b1960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:46.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.675+0000 7fc096c35b80 1 --2- 172.21.15.146:0/973331313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621e91d2c00 0x5621e91b1960 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7fc07000d7f0 tx=0x7fc070012000 comp rx=0 tx=0).stop 2023-10-06T11:14:46.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.675+0000 7fc096c35b80 1 -- 172.21.15.146:0/973331313 shutdown_connections 2023-10-06T11:14:46.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.675+0000 7fc096c35b80 1 --2- 172.21.15.146:0/973331313 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5621e91b1ea0 0x5621e91849d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.675+0000 7fc096c35b80 1 --2- 172.21.15.146:0/973331313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5621e9188990 0x5621e9188d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.675+0000 7fc096c35b80 1 --2- 172.21.15.146:0/973331313 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621e91d2c00 0x5621e91b1960 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.675+0000 7fc096c35b80 1 -- 172.21.15.146:0/973331313 >> 172.21.15.146:0/973331313 conn(0x5621e918a2b0 msgr2=0x5621e918a680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:46.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.675+0000 7fc096c35b80 1 -- 172.21.15.146:0/973331313 shutdown_connections 2023-10-06T11:14:46.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.675+0000 7fc096c35b80 1 -- 172.21.15.146:0/973331313 wait complete. 2023-10-06T11:14:46.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.676+0000 7fc096c35b80 1 -- start start 2023-10-06T11:14:46.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.676+0000 7fc096c35b80 1 Processor -- start 2023-10-06T11:14:46.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.677+0000 7fc096c35b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621e9188990 0x5621e91ae140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.677+0000 7fc096c35b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5621e91b1ea0 0x5621e91ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.677+0000 7fc096c35b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5621e91d2c00 0x5621e917f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.677+0000 7fc096c35b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621e90d90a0 con 0x5621e9188990 2023-10-06T11:14:46.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.677+0000 7fc096c35b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621e90848d0 con 0x5621e91b1ea0 2023-10-06T11:14:46.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.677+0000 7fc096c35b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5621e909fee0 con 0x5621e91d2c00 2023-10-06T11:14:46.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.677+0000 7fc096c35b80 10 client.0 _ll_register_callbacks cb 0x5621e8f75f70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:14:46.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.677+0000 7fc086ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621e9188990 0x5621e91ae140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.677+0000 7fc086ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621e9188990 0x5621e91ae140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39506/0 (socket says 172.21.15.146:39506) 2023-10-06T11:14:46.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.677+0000 7fc086ffd700 1 -- 172.21.15.146:0/3974281608 learned_addr learned my addr 172.21.15.146:0/3974281608 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:46.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.677+0000 7fc07e7fc700 1 --2- 172.21.15.146:0/3974281608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5621e91b1ea0 0x5621e91ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.677+0000 7fc0877fe700 1 --2- 172.21.15.146:0/3974281608 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5621e91d2c00 0x5621e917f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.677+0000 7fc086ffd700 1 -- 172.21.15.146:0/3974281608 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5621e91d2c00 msgr2=0x5621e917f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:46.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.677+0000 7fc086ffd700 1 --2- 172.21.15.146:0/3974281608 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5621e91d2c00 0x5621e917f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.677+0000 7fc086ffd700 1 -- 172.21.15.146:0/3974281608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5621e91b1ea0 msgr2=0x5621e91ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:46.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.677+0000 7fc086ffd700 1 --2- 172.21.15.146:0/3974281608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5621e91b1ea0 0x5621e91ccba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.677+0000 7fc086ffd700 1 -- 172.21.15.146:0/3974281608 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc07000e040 con 0x5621e9188990 2023-10-06T11:14:46.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.677+0000 7fc086ffd700 1 --2- 172.21.15.146:0/3974281608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621e9188990 0x5621e91ae140 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fc078056ab0 tx=0x7fc078084300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be0a4758317db935 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:46.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.677+0000 7fc0657fa700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:14:46.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.677+0000 7fc0657fa700 1 -- 172.21.15.146:0/3974281608 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07806d1c0 con 0x5621e9188990 2023-10-06T11:14:46.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.677+0000 7fc0657fa700 1 -- 172.21.15.146:0/3974281608 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc078056db0 con 0x5621e9188990 2023-10-06T11:14:46.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.677+0000 7fc096c35b80 1 -- 172.21.15.146:0/3974281608 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5621e917d6d0 con 0x5621e9188990 2023-10-06T11:14:46.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.677+0000 7fc0657fa700 1 -- 172.21.15.146:0/3974281608 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc07805a000 con 0x5621e9188990 2023-10-06T11:14:46.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.678+0000 7fc096c35b80 10 client.8391 fetch_fsmap learned FSMap version 100 2023-10-06T11:14:46.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.678+0000 7fc096c35b80 1 -- 172.21.15.146:0/3974281608 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) v3 -- 0x5621e8f16020 con 0x5621e9188990 2023-10-06T11:14:46.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.678+0000 7fc0657fa700 1 -- 172.21.15.146:0/3974281608 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5621e917d6d0 con 0x5621e9188990 2023-10-06T11:14:46.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.678+0000 7fc0657fa700 1 -- 172.21.15.146:0/3974281608 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 100) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc078057010 con 0x5621e9188990 2023-10-06T11:14:46.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.678+0000 7fc096c35b80 10 client.8391 fetch_fsmap finished waiting for FSMap version 100 2023-10-06T11:14:46.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.678+0000 7fc096c35b80 10 client.8391 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2023-10-06T11:14:46.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.678+0000 7fc096c35b80 20 client.8391 populate_metadata read hostname 'smithi146' 2023-10-06T11:14:46.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.678+0000 7fc096c35b80 1 --2- 172.21.15.146:0/3974281608 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x5621e91b0050 0x5621e91b0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.678+0000 7fc096c35b80 4 client.8391 mds_command: new command op to 8103 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:14:46.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.678+0000 7fc096c35b80 1 -- 172.21.15.146:0/3974281608 --> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5621e915a600 con 0x5621e91b0050 2023-10-06T11:14:46.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.678+0000 7fc07e7fc700 1 --2- 172.21.15.146:0/3974281608 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x5621e91b0050 0x5621e91b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.678+0000 7fc07e7fc700 1 --2- 172.21.15.146:0/3974281608 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x5621e91b0050 0x5621e91b0450 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffbf72a2e5046496 server_cookie=8f7f467a9bdd6da5 in_seq=0 out_seq=0 2023-10-06T11:14:46.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.678+0000 7fc0657fa700 10 client.8391 ms_handle_connect on v2:172.21.15.146:6835/409226151 2023-10-06T11:14:46.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.679+0000 7fc0657fa700 1 -- 172.21.15.146:0/3974281608 <== mds.0 v2:172.21.15.146:6835/409226151 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5621e915a600 con 0x5621e91b0050 2023-10-06T11:14:46.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.679+0000 7fc0657fa700 10 client.8391 handle_command_reply: tid=0 2023-10-06T11:14:46.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.679+0000 7fc096c35b80 1 client.8391 shutdown 2023-10-06T11:14:46.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.679+0000 7fc096c35b80 1 -- 172.21.15.146:0/3974281608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621e9188990 msgr2=0x5621e91ae140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:46.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.679+0000 7fc096c35b80 1 --2- 172.21.15.146:0/3974281608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621e9188990 0x5621e91ae140 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fc078056ab0 tx=0x7fc078084300 comp rx=0 tx=0).stop 2023-10-06T11:14:46.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.679+0000 7fc096c35b80 1 -- 172.21.15.146:0/3974281608 shutdown_connections 2023-10-06T11:14:46.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.679+0000 7fc096c35b80 1 --2- 172.21.15.146:0/3974281608 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x5621e91b0050 0x5621e91b0450 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.679+0000 7fc096c35b80 1 --2- 172.21.15.146:0/3974281608 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5621e91d2c00 0x5621e917f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.679+0000 7fc096c35b80 1 --2- 172.21.15.146:0/3974281608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621e9188990 0x5621e91ae140 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.679+0000 7fc0657fa700 0 client.8391 ms_handle_reset on v2:172.21.15.146:6835/409226151 2023-10-06T11:14:46.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.679+0000 7fc096c35b80 1 --2- 172.21.15.146:0/3974281608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5621e91b1ea0 0x5621e91ccba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.679+0000 7fc096c35b80 1 -- 172.21.15.146:0/3974281608 >> 172.21.15.146:0/3974281608 conn(0x5621e918a2b0 msgr2=0x5621e91ae810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:46.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.679+0000 7fc096c35b80 1 -- 172.21.15.146:0/3974281608 shutdown_connections 2023-10-06T11:14:46.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.679+0000 7fc096c35b80 1 -- 172.21.15.146:0/3974281608 wait complete. 2023-10-06T11:14:46.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.679+0000 7fc096c35b80 20 client.8391 trim_cache size 0 max 16384 2023-10-06T11:14:46.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.694+0000 7fc096c35b80 1 Processor -- start 2023-10-06T11:14:46.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.694+0000 7fc096c35b80 1 -- start start 2023-10-06T11:14:46.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.695+0000 7fc096c35b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5621e9188990 0x5621e91b1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.695+0000 7fc096c35b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5621e91b1ea0 0x5621e91ae140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.695+0000 7fc096c35b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621e91d2c00 0x5621e91b05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.695+0000 7fc096c35b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621e8f5be70 con 0x5621e91d2c00 2023-10-06T11:14:46.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.695+0000 7fc096c35b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621e918a160 con 0x5621e91b1ea0 2023-10-06T11:14:46.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.695+0000 7fc096c35b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5621e9189720 con 0x5621e9188990 2023-10-06T11:14:46.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.695+0000 7fc0877fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621e91d2c00 0x5621e91b05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.695+0000 7fc0877fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621e91d2c00 0x5621e91b05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39514/0 (socket says 172.21.15.146:39514) 2023-10-06T11:14:46.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.695+0000 7fc0877fe700 1 -- 172.21.15.146:0/3996648965 learned_addr learned my addr 172.21.15.146:0/3996648965 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:46.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.696+0000 7fc086ffd700 1 --2- 172.21.15.146:0/3996648965 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5621e9188990 0x5621e91b1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.696+0000 7fc0877fe700 1 -- 172.21.15.146:0/3996648965 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5621e9188990 msgr2=0x5621e91b1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:46.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.696+0000 7fc07e7fc700 1 --2- 172.21.15.146:0/3996648965 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5621e91b1ea0 0x5621e91ae140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.696+0000 7fc0877fe700 1 --2- 172.21.15.146:0/3996648965 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5621e9188990 0x5621e91b1190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.696+0000 7fc0877fe700 1 -- 172.21.15.146:0/3996648965 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5621e91b1ea0 msgr2=0x5621e91ae140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:46.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.696+0000 7fc0877fe700 1 --2- 172.21.15.146:0/3996648965 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5621e91b1ea0 0x5621e91ae140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.696+0000 7fc0877fe700 1 -- 172.21.15.146:0/3996648965 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621e90a77c0 con 0x5621e91d2c00 2023-10-06T11:14:46.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.696+0000 7fc0877fe700 1 --2- 172.21.15.146:0/3996648965 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621e91d2c00 0x5621e91b05f0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fc080007450 tx=0x7fc08000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ab2109db5fbbfd6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:46.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.696+0000 7fc07cff9700 1 -- 172.21.15.146:0/3996648965 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc080007e60 con 0x5621e91d2c00 2023-10-06T11:14:46.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.696+0000 7fc07cff9700 1 -- 172.21.15.146:0/3996648965 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08000f040 con 0x5621e91d2c00 2023-10-06T11:14:46.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.696+0000 7fc07cff9700 1 -- 172.21.15.146:0/3996648965 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc080017870 con 0x5621e91d2c00 2023-10-06T11:14:46.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.696+0000 7fc096c35b80 1 -- 172.21.15.146:0/3996648965 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621e91d2c00 msgr2=0x5621e91b05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:46.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.696+0000 7fc096c35b80 1 --2- 172.21.15.146:0/3996648965 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621e91d2c00 0x5621e91b05f0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fc080007450 tx=0x7fc08000b040 comp rx=0 tx=0).stop 2023-10-06T11:14:46.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.696+0000 7fc096c35b80 1 -- 172.21.15.146:0/3996648965 shutdown_connections 2023-10-06T11:14:46.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.696+0000 7fc096c35b80 1 --2- 172.21.15.146:0/3996648965 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621e91d2c00 0x5621e91b05f0 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.696+0000 7fc096c35b80 1 --2- 172.21.15.146:0/3996648965 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5621e9188990 0x5621e91b1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.696+0000 7fc096c35b80 1 --2- 172.21.15.146:0/3996648965 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5621e91b1ea0 0x5621e91ae140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.696+0000 7fc096c35b80 1 -- 172.21.15.146:0/3996648965 >> 172.21.15.146:0/3996648965 conn(0x5621e918a2b0 msgr2=0x5621e91ae810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:46.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.697+0000 7fc096c35b80 1 -- 172.21.15.146:0/3996648965 shutdown_connections 2023-10-06T11:14:46.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.697+0000 7fc096c35b80 1 -- 172.21.15.146:0/3996648965 wait complete. 2023-10-06T11:14:46.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.697+0000 7fc096c35b80 1 -- start start 2023-10-06T11:14:46.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.697+0000 7fc096c35b80 1 Processor -- start 2023-10-06T11:14:46.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.698+0000 7fc096c35b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5621e9188990 0x5621e91acb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.698+0000 7fc096c35b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621e91b1ea0 0x5621e91aa540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.698+0000 7fc096c35b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5621e91d2c00 0x5621e91ae5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.698+0000 7fc096c35b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621e9234400 con 0x5621e91b1ea0 2023-10-06T11:14:46.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.698+0000 7fc096c35b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621e91aeae0 con 0x5621e9188990 2023-10-06T11:14:46.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.698+0000 7fc096c35b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5621e91c7c80 con 0x5621e91d2c00 2023-10-06T11:14:46.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.698+0000 7fc096c35b80 10 client.0 _ll_register_callbacks cb 0x5621e8f75f70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:14:46.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.698+0000 7fc07e7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621e91b1ea0 0x5621e91aa540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.698+0000 7fc07e7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621e91b1ea0 0x5621e91aa540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39516/0 (socket says 172.21.15.146:39516) 2023-10-06T11:14:46.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.698+0000 7fc07e7fc700 1 -- 172.21.15.146:0/3982354878 learned_addr learned my addr 172.21.15.146:0/3982354878 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:46.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.698+0000 7fc0877fe700 1 --2- 172.21.15.146:0/3982354878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5621e91d2c00 0x5621e91ae5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.698+0000 7fc086ffd700 1 --2- 172.21.15.146:0/3982354878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5621e9188990 0x5621e91acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.698+0000 7fc07e7fc700 1 -- 172.21.15.146:0/3982354878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5621e91d2c00 msgr2=0x5621e91ae5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:46.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.698+0000 7fc07e7fc700 1 --2- 172.21.15.146:0/3982354878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5621e91d2c00 0x5621e91ae5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.698+0000 7fc07e7fc700 1 -- 172.21.15.146:0/3982354878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5621e9188990 msgr2=0x5621e91acb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:46.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.698+0000 7fc07e7fc700 1 --2- 172.21.15.146:0/3982354878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5621e9188990 0x5621e91acb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.698+0000 7fc07e7fc700 1 -- 172.21.15.146:0/3982354878 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc080009e50 con 0x5621e91b1ea0 2023-10-06T11:14:46.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.698+0000 7fc07e7fc700 1 --2- 172.21.15.146:0/3982354878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621e91b1ea0 0x5621e91aa540 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fc070009fd0 tx=0x7fc070023040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e5811483651834 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:46.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.698+0000 7fc0657fa700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:14:46.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.699+0000 7fc0657fa700 1 -- 172.21.15.146:0/3982354878 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc070000c30 con 0x5621e91b1ea0 2023-10-06T11:14:46.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.699+0000 7fc0657fa700 1 -- 172.21.15.146:0/3982354878 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc070012900 con 0x5621e91b1ea0 2023-10-06T11:14:46.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.699+0000 7fc096c35b80 1 -- 172.21.15.146:0/3982354878 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5621e91cdb40 con 0x5621e91b1ea0 2023-10-06T11:14:46.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.699+0000 7fc0657fa700 1 -- 172.21.15.146:0/3982354878 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc070005900 con 0x5621e91b1ea0 2023-10-06T11:14:46.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.699+0000 7fc096c35b80 10 client.8397 fetch_fsmap learned FSMap version 100 2023-10-06T11:14:46.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.699+0000 7fc096c35b80 1 -- 172.21.15.146:0/3982354878 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) v3 -- 0x5621e908e4b0 con 0x5621e91b1ea0 2023-10-06T11:14:46.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.699+0000 7fc0657fa700 1 -- 172.21.15.146:0/3982354878 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5621e91cdb40 con 0x5621e91b1ea0 2023-10-06T11:14:46.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.699+0000 7fc0657fa700 1 -- 172.21.15.146:0/3982354878 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 100) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc070005a60 con 0x5621e91b1ea0 2023-10-06T11:14:46.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.699+0000 7fc096c35b80 10 client.8397 fetch_fsmap finished waiting for FSMap version 100 2023-10-06T11:14:46.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.699+0000 7fc096c35b80 10 client.8397 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2023-10-06T11:14:46.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.699+0000 7fc096c35b80 20 client.8397 populate_metadata read hostname 'smithi146' 2023-10-06T11:14:46.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.699+0000 7fc096c35b80 1 --2- 172.21.15.146:0/3982354878 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x5621e921d2b0 0x5621e921d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.699+0000 7fc096c35b80 4 client.8397 mds_command: new command op to 8103 tid=0[{"prefix": "scrub abort"}] 2023-10-06T11:14:46.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.699+0000 7fc096c35b80 1 -- 172.21.15.146:0/3982354878 --> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] -- command(tid 0: {"prefix": "scrub abort"}) v1 -- 0x7fc070012790 con 0x5621e921d2b0 2023-10-06T11:14:46.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.699+0000 7fc086ffd700 1 --2- 172.21.15.146:0/3982354878 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x5621e921d2b0 0x5621e921d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.699+0000 7fc0657fa700 10 client.8397 ms_handle_connect on v2:172.21.15.146:6835/409226151 2023-10-06T11:14:46.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.699+0000 7fc086ffd700 1 --2- 172.21.15.146:0/3982354878 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x5621e921d2b0 0x5621e921d680 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9476836f0f862eea server_cookie=76bec766f3311ad2 in_seq=0 out_seq=0 2023-10-06T11:14:46.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.700+0000 7fc0657fa700 1 -- 172.21.15.146:0/3982354878 <== mds.0 v2:172.21.15.146:6835/409226151 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x7fc070012790 con 0x5621e921d2b0 2023-10-06T11:14:46.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.700+0000 7fc0657fa700 10 client.8397 handle_command_reply: tid=0 2023-10-06T11:14:46.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.700+0000 7fc096c35b80 1 client.8397 shutdown 2023-10-06T11:14:46.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.700+0000 7fc096c35b80 1 -- 172.21.15.146:0/3982354878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621e91b1ea0 msgr2=0x5621e91aa540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:46.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.700+0000 7fc096c35b80 1 --2- 172.21.15.146:0/3982354878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621e91b1ea0 0x5621e91aa540 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fc070009fd0 tx=0x7fc070023040 comp rx=0 tx=0).stop 2023-10-06T11:14:46.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.700+0000 7fc096c35b80 1 -- 172.21.15.146:0/3982354878 shutdown_connections 2023-10-06T11:14:46.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.700+0000 7fc096c35b80 1 --2- 172.21.15.146:0/3982354878 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x5621e921d2b0 0x5621e921d680 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.700+0000 7fc096c35b80 1 --2- 172.21.15.146:0/3982354878 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5621e91d2c00 0x5621e91ae5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.700+0000 7fc096c35b80 1 --2- 172.21.15.146:0/3982354878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5621e9188990 0x5621e91acb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.700+0000 7fc0657fa700 0 client.8397 ms_handle_reset on v2:172.21.15.146:6835/409226151 2023-10-06T11:14:46.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.700+0000 7fc096c35b80 1 --2- 172.21.15.146:0/3982354878 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5621e91b1ea0 0x5621e91aa540 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.700+0000 7fc096c35b80 1 -- 172.21.15.146:0/3982354878 >> 172.21.15.146:0/3982354878 conn(0x5621e918a2b0 msgr2=0x5621e91b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:46.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.700+0000 7fc096c35b80 1 -- 172.21.15.146:0/3982354878 shutdown_connections 2023-10-06T11:14:46.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.700+0000 7fc096c35b80 1 -- 172.21.15.146:0/3982354878 wait complete. 2023-10-06T11:14:46.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.700+0000 7fc096c35b80 20 client.8397 trim_cache size 0 max 16384 2023-10-06T11:14:46.714 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:14:46.714 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0 2023-10-06T11:14:46.714 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:14:46.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.700+0000 7fc087fff700 1 -- 172.21.15.146:0/3337866993 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc068066f60 msgr2=0x7fc068069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:46.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.700+0000 7fc087fff700 1 --2- 172.21.15.146:0/3337866993 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc068066f60 0x7fc068069410 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fc070006fd0 tx=0x7fc070008040 comp rx=0 tx=0).stop 2023-10-06T11:14:46.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.700+0000 7fc087fff700 1 -- 172.21.15.146:0/3337866993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc088068780 msgr2=0x7fc08816ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:46.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.700+0000 7fc087fff700 1 --2- 172.21.15.146:0/3337866993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc088068780 0x7fc08816ca40 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fc078009290 tx=0x7fc078016000 comp rx=0 tx=0).stop 2023-10-06T11:14:46.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.700+0000 7fc087fff700 1 -- 172.21.15.146:0/3337866993 shutdown_connections 2023-10-06T11:14:46.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.700+0000 7fc087fff700 1 --2- 172.21.15.146:0/3337866993 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc068066f60 0x7fc068069410 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.700+0000 7fc087fff700 1 --2- 172.21.15.146:0/3337866993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0880cb090 0x7fc0880c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.700+0000 7fc087fff700 1 --2- 172.21.15.146:0/3337866993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc088068780 0x7fc08816ca40 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.700+0000 7fc087fff700 1 --2- 172.21.15.146:0/3337866993 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0880b5640 0x7fc08815e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.700+0000 7fc087fff700 1 -- 172.21.15.146:0/3337866993 >> 172.21.15.146:0/3337866993 conn(0x7fc0880703f0 msgr2=0x7fc0880b5a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:46.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.701+0000 7fc087fff700 1 -- 172.21.15.146:0/3337866993 shutdown_connections 2023-10-06T11:14:46.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.701+0000 7fc087fff700 1 -- 172.21.15.146:0/3337866993 wait complete. 2023-10-06T11:14:46.717 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 scrub status 2023-10-06T11:14:46.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.831+0000 7fa14506e700 1 Processor -- start 2023-10-06T11:14:46.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.831+0000 7fa14506e700 1 -- start start 2023-10-06T11:14:46.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.832+0000 7fa14506e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa140159f40 0x7fa14015d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.832+0000 7fa14506e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1400d1670 con 0x7fa14015e5f0 2023-10-06T11:14:46.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.832+0000 7fa14506e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1400cee70 con 0x7fa1400c7810 2023-10-06T11:14:46.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.832+0000 7fa14506e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1400cc4b0 con 0x7fa140159f40 2023-10-06T11:14:46.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.832+0000 7fa13f59e700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa14015e5f0 0x7fa1400cada0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45310/0 (socket says 172.21.15.146:45310) 2023-10-06T11:14:46.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.832+0000 7fa13f59e700 1 -- 172.21.15.146:0/1639112534 learned_addr learned my addr 172.21.15.146:0/1639112534 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:14:46.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.832+0000 7fa13ed9d700 1 --2- 172.21.15.146:0/1639112534 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa140159f40 0x7fa14015d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.833+0000 7fa13e59c700 1 -- 172.21.15.146:0/1639112534 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1765111556 0 0) 0x7fa1400d1670 con 0x7fa14015e5f0 2023-10-06T11:14:46.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.833+0000 7fa13e59c700 1 -- 172.21.15.146:0/1639112534 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa12c003570 con 0x7fa14015e5f0 2023-10-06T11:14:46.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.833+0000 7fa13e59c700 1 -- 172.21.15.146:0/1639112534 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2178523165 0 0) 0x7fa1400cee70 con 0x7fa1400c7810 2023-10-06T11:14:46.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.833+0000 7fa13e59c700 1 -- 172.21.15.146:0/1639112534 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1400d1670 con 0x7fa1400c7810 2023-10-06T11:14:46.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.833+0000 7fa13ed9d700 1 -- 172.21.15.146:0/1639112534 >> v1:172.21.15.151:6789/0 conn(0x7fa1400c7810 legacy=0x7fa14015dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:46.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.833+0000 7fa13ed9d700 1 -- 172.21.15.146:0/1639112534 >> v1:172.21.15.146:6789/0 conn(0x7fa14015e5f0 legacy=0x7fa1400cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:46.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.833+0000 7fa13ed9d700 1 -- 172.21.15.146:0/1639112534 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa14006f990 con 0x7fa140159f40 2023-10-06T11:14:46.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.833+0000 7fa13ed9d700 1 --2- 172.21.15.146:0/1639112534 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa140159f40 0x7fa14015d9a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa130009900 tx=0x7fa130009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d8546679b8ea688 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:46.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.833+0000 7fa13e59c700 1 -- 172.21.15.146:0/1639112534 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa130005c10 con 0x7fa140159f40 2023-10-06T11:14:46.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.833+0000 7fa13e59c700 1 -- 172.21.15.146:0/1639112534 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa130005d70 con 0x7fa140159f40 2023-10-06T11:14:46.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.833+0000 7fa13e59c700 1 -- 172.21.15.146:0/1639112534 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa130006240 con 0x7fa140159f40 2023-10-06T11:14:46.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.834+0000 7fa14506e700 1 -- 172.21.15.146:0/1639112534 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa140159f40 msgr2=0x7fa14015d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:46.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.834+0000 7fa14506e700 1 --2- 172.21.15.146:0/1639112534 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa140159f40 0x7fa14015d9a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa130009900 tx=0x7fa130009120 comp rx=0 tx=0).stop 2023-10-06T11:14:46.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.834+0000 7fa14506e700 1 -- 172.21.15.146:0/1639112534 shutdown_connections 2023-10-06T11:14:46.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.834+0000 7fa14506e700 1 --2- 172.21.15.146:0/1639112534 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa140159f40 0x7fa14015d9a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.834+0000 7fa14506e700 1 -- 172.21.15.146:0/1639112534 >> 172.21.15.146:0/1639112534 conn(0x7fa14006f380 msgr2=0x7fa1400d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:46.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.834+0000 7fa14506e700 1 -- 172.21.15.146:0/1639112534 shutdown_connections 2023-10-06T11:14:46.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.834+0000 7fa14506e700 1 -- 172.21.15.146:0/1639112534 wait complete. 2023-10-06T11:14:46.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.835+0000 7fa14506e700 1 Processor -- start 2023-10-06T11:14:46.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.835+0000 7fa14506e700 1 -- start start 2023-10-06T11:14:46.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.835+0000 7fa14506e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1400c7810 0x7fa1400b5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.835+0000 7fa14506e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa140159f40 0x7fa140157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.836+0000 7fa14506e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa14015e5f0 0x7fa14015d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.836+0000 7fa14506e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa140158210 con 0x7fa1400c7810 2023-10-06T11:14:46.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.836+0000 7fa14506e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa14015c890 con 0x7fa140159f40 2023-10-06T11:14:46.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.836+0000 7fa14506e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1400b4980 con 0x7fa14015e5f0 2023-10-06T11:14:46.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.836+0000 7fa13ed9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1400c7810 0x7fa1400b5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.836+0000 7fa13ed9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1400c7810 0x7fa1400b5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39522/0 (socket says 172.21.15.146:39522) 2023-10-06T11:14:46.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.836+0000 7fa13ed9d700 1 -- 172.21.15.146:0/1789617156 learned_addr learned my addr 172.21.15.146:0/1789617156 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:46.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.836+0000 7fa13f59e700 1 --2- 172.21.15.146:0/1789617156 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa14015e5f0 0x7fa14015d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.836+0000 7fa13659c700 1 --2- 172.21.15.146:0/1789617156 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa140159f40 0x7fa140157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.836+0000 7fa13ed9d700 1 -- 172.21.15.146:0/1789617156 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa14015e5f0 msgr2=0x7fa14015d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:46.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.836+0000 7fa13ed9d700 1 --2- 172.21.15.146:0/1789617156 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa14015e5f0 0x7fa14015d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.836+0000 7fa13ed9d700 1 -- 172.21.15.146:0/1789617156 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa140159f40 msgr2=0x7fa140157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:46.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.836+0000 7fa13ed9d700 1 --2- 172.21.15.146:0/1789617156 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa140159f40 0x7fa140157cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.836+0000 7fa13ed9d700 1 -- 172.21.15.146:0/1789617156 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1300093c0 con 0x7fa1400c7810 2023-10-06T11:14:46.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.836+0000 7fa13ed9d700 1 --2- 172.21.15.146:0/1789617156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1400c7810 0x7fa1400b5a20 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fa130009160 tx=0x7fa130016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:46.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.836+0000 7fa1377fe700 1 -- 172.21.15.146:0/1789617156 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa13001d730 con 0x7fa1400c7810 2023-10-06T11:14:46.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.836+0000 7fa1377fe700 1 -- 172.21.15.146:0/1789617156 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa13001d8b0 con 0x7fa1400c7810 2023-10-06T11:14:46.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.836+0000 7fa14506e700 1 -- 172.21.15.146:0/1789617156 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1400b4c60 con 0x7fa1400c7810 2023-10-06T11:14:46.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.836+0000 7fa1377fe700 1 -- 172.21.15.146:0/1789617156 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa13001dc70 con 0x7fa1400c7810 2023-10-06T11:14:46.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.836+0000 7fa14506e700 1 -- 172.21.15.146:0/1789617156 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1400b5220 con 0x7fa1400c7810 2023-10-06T11:14:46.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.838+0000 7fa1377fe700 1 -- 172.21.15.146:0/1789617156 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa13001b690 con 0x7fa1400c7810 2023-10-06T11:14:46.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.838+0000 7fa1377fe700 1 --2- 172.21.15.146:0/1789617156 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa120066f30 0x7fa1200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.838+0000 7fa1377fe700 1 -- 172.21.15.146:0/1789617156 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa130086150 con 0x7fa1400c7810 2023-10-06T11:14:46.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.838+0000 7fa13659c700 1 --2- 172.21.15.146:0/1789617156 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa120066f30 0x7fa1200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.839+0000 7fa13659c700 1 --2- 172.21.15.146:0/1789617156 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa120066f30 0x7fa1200693e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fa14015e4a0 tx=0x7fa128007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:46.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.840+0000 7fa14e366b80 1 Processor -- start 2023-10-06T11:14:46.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.840+0000 7fa14e366b80 1 -- start start 2023-10-06T11:14:46.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.841+0000 7fa14e366b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564675156ae0 0x564675156eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.841+0000 7fa14e366b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646751129f0 0x56467510f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.841+0000 7fa14e366b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564675110c20 0x56467510fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.841+0000 7fa14e366b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x56467508fcd0 con 0x564675156ae0 2023-10-06T11:14:46.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.841+0000 7fa14e366b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x564675066ac0 con 0x5646751129f0 2023-10-06T11:14:46.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.841+0000 7fa14e366b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5646750642c0 con 0x564675110c20 2023-10-06T11:14:46.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.841+0000 7fa13ed9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564675156ae0 0x564675156eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.841+0000 7fa13ed9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564675156ae0 0x564675156eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39524/0 (socket says 172.21.15.146:39524) 2023-10-06T11:14:46.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.841+0000 7fa13ed9d700 1 -- 172.21.15.146:0/1639533977 learned_addr learned my addr 172.21.15.146:0/1639533977 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:46.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.841+0000 7fa13659c700 1 --2- 172.21.15.146:0/1639533977 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646751129f0 0x56467510f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.841+0000 7fa13f59e700 1 --2- 172.21.15.146:0/1639533977 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564675110c20 0x56467510fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.841+0000 7fa13ed9d700 1 -- 172.21.15.146:0/1639533977 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564675110c20 msgr2=0x56467510fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:46.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.841+0000 7fa13ed9d700 1 --2- 172.21.15.146:0/1639533977 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564675110c20 0x56467510fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.841+0000 7fa13ed9d700 1 -- 172.21.15.146:0/1639533977 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646751129f0 msgr2=0x56467510f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:46.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.841+0000 7fa13ed9d700 1 --2- 172.21.15.146:0/1639533977 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646751129f0 0x56467510f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.841+0000 7fa13ed9d700 1 -- 172.21.15.146:0/1639533977 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564674efa2c0 con 0x564675156ae0 2023-10-06T11:14:46.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.841+0000 7fa13ed9d700 1 --2- 172.21.15.146:0/1639533977 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564675156ae0 0x564675156eb0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fa1300845c0 tx=0x7fa13005c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=453c26e8cb4d8652 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:46.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.841+0000 7fa11ffff700 1 -- 172.21.15.146:0/1639533977 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa130056cf0 con 0x564675156ae0 2023-10-06T11:14:46.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.842+0000 7fa11ffff700 1 -- 172.21.15.146:0/1639533977 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa130056f20 con 0x564675156ae0 2023-10-06T11:14:46.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.842+0000 7fa11ffff700 1 -- 172.21.15.146:0/1639533977 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa13005a170 con 0x564675156ae0 2023-10-06T11:14:46.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.842+0000 7fa14e366b80 1 -- 172.21.15.146:0/1639533977 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564675156ae0 msgr2=0x564675156eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:46.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.842+0000 7fa14e366b80 1 --2- 172.21.15.146:0/1639533977 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564675156ae0 0x564675156eb0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fa1300845c0 tx=0x7fa13005c040 comp rx=0 tx=0).stop 2023-10-06T11:14:46.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.842+0000 7fa14e366b80 1 -- 172.21.15.146:0/1639533977 shutdown_connections 2023-10-06T11:14:46.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.842+0000 7fa14e366b80 1 --2- 172.21.15.146:0/1639533977 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564675110c20 0x56467510fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.842+0000 7fa14e366b80 1 --2- 172.21.15.146:0/1639533977 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564675156ae0 0x564675156eb0 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.842+0000 7fa14e366b80 1 --2- 172.21.15.146:0/1639533977 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646751129f0 0x56467510f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.842+0000 7fa14e366b80 1 -- 172.21.15.146:0/1639533977 >> 172.21.15.146:0/1639533977 conn(0x5646751110c0 msgr2=0x564675111490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:46.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.842+0000 7fa14e366b80 1 -- 172.21.15.146:0/1639533977 shutdown_connections 2023-10-06T11:14:46.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.842+0000 7fa14e366b80 1 -- 172.21.15.146:0/1639533977 wait complete. 2023-10-06T11:14:46.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.843+0000 7fa14e366b80 1 -- start start 2023-10-06T11:14:46.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.843+0000 7fa14e366b80 1 Processor -- start 2023-10-06T11:14:46.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.844+0000 7fa14e366b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564675110c20 0x56467513ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.844+0000 7fa14e366b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5646751129f0 0x564675153400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.844+0000 7fa14e366b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564675156ae0 0x56467513a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.844+0000 7fa14e366b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646750600b0 con 0x564675110c20 2023-10-06T11:14:46.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.844+0000 7fa14e366b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56467500b8e0 con 0x564675156ae0 2023-10-06T11:14:46.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.844+0000 7fa14e366b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x564675026ef0 con 0x5646751129f0 2023-10-06T11:14:46.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.844+0000 7fa14e366b80 10 client.0 _ll_register_callbacks cb 0x564674efcf80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:14:46.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.844+0000 7fa13ed9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564675110c20 0x56467513ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.844+0000 7fa13ed9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564675110c20 0x56467513ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39532/0 (socket says 172.21.15.146:39532) 2023-10-06T11:14:46.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.844+0000 7fa13ed9d700 1 -- 172.21.15.146:0/874363572 learned_addr learned my addr 172.21.15.146:0/874363572 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:46.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.844+0000 7fa13659c700 1 --2- 172.21.15.146:0/874363572 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5646751129f0 0x564675153400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.844+0000 7fa13f59e700 1 --2- 172.21.15.146:0/874363572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564675156ae0 0x56467513a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.844+0000 7fa13ed9d700 1 -- 172.21.15.146:0/874363572 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5646751129f0 msgr2=0x564675153400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:46.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.844+0000 7fa13ed9d700 1 --2- 172.21.15.146:0/874363572 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5646751129f0 0x564675153400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.844+0000 7fa13ed9d700 1 -- 172.21.15.146:0/874363572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564675156ae0 msgr2=0x56467513a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:46.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.844+0000 7fa13ed9d700 1 --2- 172.21.15.146:0/874363572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564675156ae0 0x56467513a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.844+0000 7fa13ed9d700 1 -- 172.21.15.146:0/874363572 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1400b5220 con 0x564675110c20 2023-10-06T11:14:46.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.844+0000 7fa13659c700 1 --2- 172.21.15.146:0/874363572 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5646751129f0 0x564675153400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:46.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.844+0000 7fa13f59e700 1 --2- 172.21.15.146:0/874363572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564675156ae0 0x56467513a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:46.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.844+0000 7fa13ed9d700 1 --2- 172.21.15.146:0/874363572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564675110c20 0x56467513ca90 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fa1300569f0 tx=0x7fa130026000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ec9f5de5f32a11c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:46.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.844+0000 7fa11d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:14:46.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.845+0000 7fa11d7fa700 1 -- 172.21.15.146:0/874363572 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa13005a170 con 0x564675110c20 2023-10-06T11:14:46.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.845+0000 7fa11d7fa700 1 -- 172.21.15.146:0/874363572 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa1300552c0 con 0x564675110c20 2023-10-06T11:14:46.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.845+0000 7fa14e366b80 1 -- 172.21.15.146:0/874363572 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5646751046e0 con 0x564675110c20 2023-10-06T11:14:46.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.845+0000 7fa11d7fa700 1 -- 172.21.15.146:0/874363572 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa13006d300 con 0x564675110c20 2023-10-06T11:14:46.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.845+0000 7fa14e366b80 10 client.8409 fetch_fsmap learned FSMap version 100 2023-10-06T11:14:46.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.845+0000 7fa14e366b80 1 -- 172.21.15.146:0/874363572 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) v3 -- 0x564674e9d030 con 0x564675110c20 2023-10-06T11:14:46.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.845+0000 7fa11d7fa700 1 -- 172.21.15.146:0/874363572 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5646751046e0 con 0x564675110c20 2023-10-06T11:14:46.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.845+0000 7fa11d7fa700 1 -- 172.21.15.146:0/874363572 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 100) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa130057180 con 0x564675110c20 2023-10-06T11:14:46.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.845+0000 7fa14e366b80 10 client.8409 fetch_fsmap finished waiting for FSMap version 100 2023-10-06T11:14:46.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.845+0000 7fa14e366b80 10 client.8409 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2023-10-06T11:14:46.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.845+0000 7fa14e366b80 20 client.8409 populate_metadata read hostname 'smithi146' 2023-10-06T11:14:46.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.845+0000 7fa14e366b80 1 --2- 172.21.15.146:0/874363572 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x564675136640 0x564675137bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.845+0000 7fa14e366b80 4 client.8409 mds_command: new command op to 8103 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:14:46.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.845+0000 7fa14e366b80 1 -- 172.21.15.146:0/874363572 --> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5646750e1610 con 0x564675136640 2023-10-06T11:14:46.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.845+0000 7fa13659c700 1 --2- 172.21.15.146:0/874363572 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x564675136640 0x564675137bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.845+0000 7fa11d7fa700 10 client.8409 ms_handle_connect on v2:172.21.15.146:6835/409226151 2023-10-06T11:14:46.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.845+0000 7fa13659c700 1 --2- 172.21.15.146:0/874363572 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x564675136640 0x564675137bf0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe5cbebffc6f3a8c server_cookie=8bd5e513600f8d1e in_seq=0 out_seq=0 2023-10-06T11:14:46.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.846+0000 7fa11d7fa700 1 -- 172.21.15.146:0/874363572 <== mds.0 v2:172.21.15.146:6835/409226151 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5646750e1610 con 0x564675136640 2023-10-06T11:14:46.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.846+0000 7fa11d7fa700 10 client.8409 handle_command_reply: tid=0 2023-10-06T11:14:46.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.846+0000 7fa14e366b80 1 client.8409 shutdown 2023-10-06T11:14:46.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.846+0000 7fa14e366b80 1 -- 172.21.15.146:0/874363572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564675110c20 msgr2=0x56467513ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:46.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.846+0000 7fa14e366b80 1 --2- 172.21.15.146:0/874363572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564675110c20 0x56467513ca90 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fa1300569f0 tx=0x7fa130026000 comp rx=0 tx=0).stop 2023-10-06T11:14:46.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.846+0000 7fa14e366b80 1 -- 172.21.15.146:0/874363572 shutdown_connections 2023-10-06T11:14:46.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.846+0000 7fa14e366b80 1 --2- 172.21.15.146:0/874363572 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x564675136640 0x564675137bf0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.846+0000 7fa14e366b80 1 --2- 172.21.15.146:0/874363572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564675156ae0 0x56467513a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.846+0000 7fa14e366b80 1 --2- 172.21.15.146:0/874363572 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564675110c20 0x56467513ca90 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.846+0000 7fa11d7fa700 0 client.8409 ms_handle_reset on v2:172.21.15.146:6835/409226151 2023-10-06T11:14:46.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.846+0000 7fa14e366b80 1 --2- 172.21.15.146:0/874363572 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5646751129f0 0x564675153400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.846+0000 7fa14e366b80 1 -- 172.21.15.146:0/874363572 >> 172.21.15.146:0/874363572 conn(0x5646751110c0 msgr2=0x5646751544e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:46.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.846+0000 7fa14e366b80 1 -- 172.21.15.146:0/874363572 shutdown_connections 2023-10-06T11:14:46.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.846+0000 7fa14e366b80 1 -- 172.21.15.146:0/874363572 wait complete. 2023-10-06T11:14:46.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.846+0000 7fa14e366b80 20 client.8409 trim_cache size 0 max 16384 2023-10-06T11:14:46.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.862+0000 7fa14e366b80 1 Processor -- start 2023-10-06T11:14:46.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.862+0000 7fa14e366b80 1 -- start start 2023-10-06T11:14:46.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.863+0000 7fa14e366b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564675110c20 0x564675155870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.863+0000 7fa14e366b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5646751129f0 0x564675137f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.863+0000 7fa14e366b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564675156ae0 0x56467513f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.863+0000 7fa14e366b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x564674ee2e80 con 0x5646751129f0 2023-10-06T11:14:46.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.863+0000 7fa14e366b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56467510d6b0 con 0x564675156ae0 2023-10-06T11:14:46.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.863+0000 7fa14e366b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x564675138480 con 0x564675110c20 2023-10-06T11:14:46.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.863+0000 7fa13659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5646751129f0 0x564675137f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.863+0000 7fa13659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5646751129f0 0x564675137f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39544/0 (socket says 172.21.15.146:39544) 2023-10-06T11:14:46.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.863+0000 7fa13659c700 1 -- 172.21.15.146:0/531336590 learned_addr learned my addr 172.21.15.146:0/531336590 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:46.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.863+0000 7fa13659c700 1 -- 172.21.15.146:0/531336590 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564675110c20 msgr2=0x564675155870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:46.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.863+0000 7fa13659c700 1 --2- 172.21.15.146:0/531336590 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564675110c20 0x564675155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.863+0000 7fa13659c700 1 -- 172.21.15.146:0/531336590 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564675156ae0 msgr2=0x56467513f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:46.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.863+0000 7fa13659c700 1 --2- 172.21.15.146:0/531336590 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564675156ae0 0x56467513f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.863+0000 7fa13659c700 1 -- 172.21.15.146:0/531336590 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56467502e7d0 con 0x5646751129f0 2023-10-06T11:14:46.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.863+0000 7fa13659c700 1 --2- 172.21.15.146:0/531336590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5646751129f0 0x564675137f40 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fa128007fd0 tx=0x7fa128013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c84a55a8ef559bca server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:46.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.864+0000 7fa134d99700 1 -- 172.21.15.146:0/531336590 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12802a030 con 0x5646751129f0 2023-10-06T11:14:46.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.864+0000 7fa134d99700 1 -- 172.21.15.146:0/531336590 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1280260b0 con 0x5646751129f0 2023-10-06T11:14:46.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.864+0000 7fa134d99700 1 -- 172.21.15.146:0/531336590 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa128026810 con 0x5646751129f0 2023-10-06T11:14:46.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.864+0000 7fa14e366b80 1 -- 172.21.15.146:0/531336590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5646751129f0 msgr2=0x564675137f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:46.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.864+0000 7fa14e366b80 1 --2- 172.21.15.146:0/531336590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5646751129f0 0x564675137f40 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fa128007fd0 tx=0x7fa128013000 comp rx=0 tx=0).stop 2023-10-06T11:14:46.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.864+0000 7fa14e366b80 1 -- 172.21.15.146:0/531336590 shutdown_connections 2023-10-06T11:14:46.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.864+0000 7fa14e366b80 1 --2- 172.21.15.146:0/531336590 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564675156ae0 0x56467513f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.864+0000 7fa14e366b80 1 --2- 172.21.15.146:0/531336590 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564675110c20 0x564675155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.864+0000 7fa14e366b80 1 --2- 172.21.15.146:0/531336590 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5646751129f0 0x564675137f40 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.864+0000 7fa14e366b80 1 -- 172.21.15.146:0/531336590 >> 172.21.15.146:0/531336590 conn(0x5646751110c0 msgr2=0x5646751357a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:46.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.864+0000 7fa14e366b80 1 -- 172.21.15.146:0/531336590 shutdown_connections 2023-10-06T11:14:46.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.864+0000 7fa14e366b80 1 -- 172.21.15.146:0/531336590 wait complete. 2023-10-06T11:14:46.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.865+0000 7fa14e366b80 1 -- start start 2023-10-06T11:14:46.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.865+0000 7fa14e366b80 1 Processor -- start 2023-10-06T11:14:46.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.866+0000 7fa14e366b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564675110c20 0x5646751bd830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.866+0000 7fa14e366b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646751129f0 0x5646751c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.866+0000 7fa14e366b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564675156ae0 0x56467510f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.866+0000 7fa14e366b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5646751c46f0 con 0x564675110c20 2023-10-06T11:14:46.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.866+0000 7fa14e366b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x564675151b80 con 0x5646751129f0 2023-10-06T11:14:46.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.866+0000 7fa14e366b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x56467510bd40 con 0x564675156ae0 2023-10-06T11:14:46.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.866+0000 7fa14e366b80 10 client.0 _ll_register_callbacks cb 0x564674efcf80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:14:46.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.866+0000 7fa13ed9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564675110c20 0x5646751bd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.866+0000 7fa13ed9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564675110c20 0x5646751bd830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39548/0 (socket says 172.21.15.146:39548) 2023-10-06T11:14:46.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.866+0000 7fa13ed9d700 1 -- 172.21.15.146:0/1604875393 learned_addr learned my addr 172.21.15.146:0/1604875393 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:46.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.866+0000 7fa13659c700 1 --2- 172.21.15.146:0/1604875393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646751129f0 0x5646751c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.866+0000 7fa13f59e700 1 --2- 172.21.15.146:0/1604875393 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564675156ae0 0x56467510f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.866+0000 7fa13ed9d700 1 -- 172.21.15.146:0/1604875393 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564675156ae0 msgr2=0x56467510f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:46.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.866+0000 7fa13ed9d700 1 --2- 172.21.15.146:0/1604875393 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564675156ae0 0x56467510f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.866+0000 7fa13ed9d700 1 -- 172.21.15.146:0/1604875393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646751129f0 msgr2=0x5646751c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:46.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.866+0000 7fa13ed9d700 1 --2- 172.21.15.146:0/1604875393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646751129f0 0x5646751c41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.866+0000 7fa13ed9d700 1 -- 172.21.15.146:0/1604875393 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1400d1670 con 0x564675110c20 2023-10-06T11:14:46.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.866+0000 7fa13659c700 1 --2- 172.21.15.146:0/1604875393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646751129f0 0x5646751c41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:46.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.866+0000 7fa13f59e700 1 --2- 172.21.15.146:0/1604875393 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564675156ae0 0x56467510f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:46.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.866+0000 7fa13ed9d700 1 --2- 172.21.15.146:0/1604875393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564675110c20 0x5646751bd830 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fa130003080 tx=0x7fa13005a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8a418cef8247722 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:46.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.866+0000 7fa11d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:14:46.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.866+0000 7fa11d7fa700 1 -- 172.21.15.146:0/1604875393 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa13006d300 con 0x564675110c20 2023-10-06T11:14:46.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.866+0000 7fa11d7fa700 1 -- 172.21.15.146:0/1604875393 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa13005a170 con 0x564675110c20 2023-10-06T11:14:46.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.866+0000 7fa14e366b80 1 -- 172.21.15.146:0/1604875393 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa130056f20 con 0x564675110c20 2023-10-06T11:14:46.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.866+0000 7fa11d7fa700 1 -- 172.21.15.146:0/1604875393 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa130057180 con 0x564675110c20 2023-10-06T11:14:46.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.866+0000 7fa14e366b80 10 client.8415 fetch_fsmap learned FSMap version 100 2023-10-06T11:14:46.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.866+0000 7fa14e366b80 1 -- 172.21.15.146:0/1604875393 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) v3 -- 0x5646750154c0 con 0x564675110c20 2023-10-06T11:14:46.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.866+0000 7fa11d7fa700 1 -- 172.21.15.146:0/1604875393 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa130056f20 con 0x564675110c20 2023-10-06T11:14:46.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.866+0000 7fa11d7fa700 1 -- 172.21.15.146:0/1604875393 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 100) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa130056410 con 0x564675110c20 2023-10-06T11:14:46.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.867+0000 7fa14e366b80 10 client.8415 fetch_fsmap finished waiting for FSMap version 100 2023-10-06T11:14:46.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.867+0000 7fa14e366b80 10 client.8415 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2023-10-06T11:14:46.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.867+0000 7fa14e366b80 20 client.8415 populate_metadata read hostname 'smithi146' 2023-10-06T11:14:46.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.867+0000 7fa14e366b80 1 --2- 172.21.15.146:0/1604875393 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x564675150f00 0x5646751512d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:46.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.867+0000 7fa14e366b80 4 client.8415 mds_command: new command op to 8103 tid=0[{"prefix": "scrub status"}] 2023-10-06T11:14:46.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.867+0000 7fa14e366b80 1 -- 172.21.15.146:0/1604875393 --> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564675002e50 con 0x564675150f00 2023-10-06T11:14:46.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.867+0000 7fa13659c700 1 --2- 172.21.15.146:0/1604875393 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x564675150f00 0x5646751512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:46.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.867+0000 7fa11d7fa700 10 client.8415 ms_handle_connect on v2:172.21.15.146:6835/409226151 2023-10-06T11:14:46.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.867+0000 7fa13659c700 1 --2- 172.21.15.146:0/1604875393 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x564675150f00 0x5646751512d0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6c5ffa3c70fec24 server_cookie=8b54b8eea121dae7 in_seq=0 out_seq=0 2023-10-06T11:14:46.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.867+0000 7fa11d7fa700 1 -- 172.21.15.146:0/1604875393 <== mds.0 v2:172.21.15.146:6835/409226151 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+69 (crc 0 0 0) 0x564675002e50 con 0x564675150f00 2023-10-06T11:14:46.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.867+0000 7fa11d7fa700 10 client.8415 handle_command_reply: tid=0 2023-10-06T11:14:46.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.867+0000 7fa14e366b80 1 client.8415 shutdown 2023-10-06T11:14:46.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.867+0000 7fa14e366b80 1 -- 172.21.15.146:0/1604875393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564675110c20 msgr2=0x5646751bd830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:46.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.867+0000 7fa14e366b80 1 --2- 172.21.15.146:0/1604875393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564675110c20 0x5646751bd830 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fa130003080 tx=0x7fa13005a040 comp rx=0 tx=0).stop 2023-10-06T11:14:46.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.867+0000 7fa14e366b80 1 -- 172.21.15.146:0/1604875393 shutdown_connections 2023-10-06T11:14:46.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.867+0000 7fa14e366b80 1 --2- 172.21.15.146:0/1604875393 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x564675150f00 0x5646751512d0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.867+0000 7fa14e366b80 1 --2- 172.21.15.146:0/1604875393 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564675156ae0 0x56467510f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.867+0000 7fa11d7fa700 0 client.8415 ms_handle_reset on v2:172.21.15.146:6835/409226151 2023-10-06T11:14:46.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.867+0000 7fa14e366b80 1 --2- 172.21.15.146:0/1604875393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564675110c20 0x5646751bd830 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.867+0000 7fa14e366b80 1 --2- 172.21.15.146:0/1604875393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646751129f0 0x5646751c41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.867+0000 7fa14e366b80 1 -- 172.21.15.146:0/1604875393 >> 172.21.15.146:0/1604875393 conn(0x5646751110c0 msgr2=0x56467510cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:46.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.867+0000 7fa14e366b80 1 -- 172.21.15.146:0/1604875393 shutdown_connections 2023-10-06T11:14:46.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.867+0000 7fa14e366b80 1 -- 172.21.15.146:0/1604875393 wait complete. 2023-10-06T11:14:46.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.868+0000 7fa14e366b80 20 client.8415 trim_cache size 0 max 16384 2023-10-06T11:14:46.881 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:14:46.882 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "PAUSED (0 inodes in the stack)", 2023-10-06T11:14:46.882 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": {} 2023-10-06T11:14:46.882 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:14:46.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.868+0000 7fa14506e700 1 -- 172.21.15.146:0/1789617156 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa120066f30 msgr2=0x7fa1200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:46.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.868+0000 7fa14506e700 1 --2- 172.21.15.146:0/1789617156 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa120066f30 0x7fa1200693e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fa14015e4a0 tx=0x7fa128007d30 comp rx=0 tx=0).stop 2023-10-06T11:14:46.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.868+0000 7fa14506e700 1 -- 172.21.15.146:0/1789617156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1400c7810 msgr2=0x7fa1400b5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:46.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.868+0000 7fa14506e700 1 --2- 172.21.15.146:0/1789617156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1400c7810 0x7fa1400b5a20 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fa130009160 tx=0x7fa130016000 comp rx=0 tx=0).stop 2023-10-06T11:14:46.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.868+0000 7fa14506e700 1 -- 172.21.15.146:0/1789617156 shutdown_connections 2023-10-06T11:14:46.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.868+0000 7fa14506e700 1 --2- 172.21.15.146:0/1789617156 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa120066f30 0x7fa1200693e0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.868+0000 7fa14506e700 1 --2- 172.21.15.146:0/1789617156 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa14015e5f0 0x7fa14015d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.868+0000 7fa14506e700 1 --2- 172.21.15.146:0/1789617156 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa1400c7810 0x7fa1400b5a20 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.868+0000 7fa14506e700 1 --2- 172.21.15.146:0/1789617156 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa140159f40 0x7fa140157cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:46.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.868+0000 7fa14506e700 1 -- 172.21.15.146:0/1789617156 >> 172.21.15.146:0/1789617156 conn(0x7fa14006f380 msgr2=0x7fa1400cd270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:46.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.868+0000 7fa14506e700 1 -- 172.21.15.146:0/1789617156 shutdown_connections 2023-10-06T11:14:46.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.868+0000 7fa14506e700 1 -- 172.21.15.146:0/1789617156 wait complete. 2023-10-06T11:14:46.886 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:14:47.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.998+0000 7f3df0eb3700 1 Processor -- start 2023-10-06T11:14:47.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.998+0000 7f3df0eb3700 1 -- start start 2023-10-06T11:14:47.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.999+0000 7f3df0eb3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3dec068ba0 0x7f3dec15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.999+0000 7f3df0eb3700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3dec153e80 0x7f3dec0b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.999+0000 7f3df0eb3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dec15ac30 con 0x7f3dec153ab0 2023-10-06T11:14:47.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.999+0000 7f3df0eb3700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dec0b4510 con 0x7f3dec153e80 2023-10-06T11:14:47.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.999+0000 7f3df0eb3700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec0b6530 con 0x7f3dec068ba0 2023-10-06T11:14:47.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.999+0000 7f3dea59c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3dec153ab0 0x7f3dec068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45326/0 (socket says 172.21.15.146:45326) 2023-10-06T11:14:47.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.999+0000 7f3dea59c700 1 -- 172.21.15.146:0/3924496406 learned_addr learned my addr 172.21.15.146:0/3924496406 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:14:47.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.999+0000 7f3dead9d700 1 --2- 172.21.15.146:0/3924496406 >> v2:172.21.15.151:3300/0 conn(0x7f3dec153e80 0x7f3dec0b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.999+0000 7f3de9d9b700 1 --2- 172.21.15.146:0/3924496406 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3dec068ba0 0x7f3dec15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.999+0000 7f3de959a700 1 -- 172.21.15.146:0/3924496406 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 200421649 0 0) 0x7f3ddc001110 con 0x7f3dec153ab0 2023-10-06T11:14:47.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.999+0000 7f3de959a700 1 -- 172.21.15.146:0/3924496406 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dd4003570 con 0x7f3dec153ab0 2023-10-06T11:14:47.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.999+0000 7f3de959a700 1 -- 172.21.15.146:0/3924496406 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1491170652 0 0) 0x7f3dd4003570 con 0x7f3dec153ab0 2023-10-06T11:14:47.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.999+0000 7f3de959a700 1 -- 172.21.15.146:0/3924496406 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3dec068ba0 msgr2=0x7f3dec15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:47.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.999+0000 7f3de959a700 1 --2- 172.21.15.146:0/3924496406 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3dec068ba0 0x7f3dec15a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.999+0000 7f3de959a700 1 -- 172.21.15.146:0/3924496406 >> v2:172.21.15.151:3300/0 conn(0x7f3dec153e80 msgr2=0x7f3dec0b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:47.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.999+0000 7f3de959a700 1 --2- 172.21.15.146:0/3924496406 >> v2:172.21.15.151:3300/0 conn(0x7f3dec153e80 0x7f3dec0b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.999+0000 7f3de959a700 1 -- 172.21.15.146:0/3924496406 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dec0b5c50 con 0x7f3dec153ab0 2023-10-06T11:14:47.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:46.999+0000 7f3de959a700 1 -- 172.21.15.146:0/3924496406 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f3ddc001600 con 0x7f3dec153ab0 2023-10-06T11:14:47.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.000+0000 7f3de959a700 1 -- 172.21.15.146:0/3924496406 >> v1:172.21.15.146:6789/0 conn(0x7f3dec153ab0 legacy=0x7f3dec068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.000+0000 7f3de959a700 1 --2- 172.21.15.146:0/3924496406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3dd4003a60 0x7f3dd4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.000+0000 7f3de959a700 1 --2- 172.21.15.146:0/3924496406 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dd4004810 0x7f3dd4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.000+0000 7f3de959a700 1 --2- 172.21.15.146:0/3924496406 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3dec068ba0 0x7f3dd40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.000+0000 7f3de959a700 1 -- 172.21.15.146:0/3924496406 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec0b4510 con 0x7f3dd4004810 2023-10-06T11:14:47.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.000+0000 7f3de959a700 1 -- 172.21.15.146:0/3924496406 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec0b6530 con 0x7f3dd4003a60 2023-10-06T11:14:47.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.000+0000 7f3de959a700 1 -- 172.21.15.146:0/3924496406 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd400ba60 con 0x7f3dec068ba0 2023-10-06T11:14:47.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.000+0000 7f3dead9d700 1 --2- 172.21.15.146:0/3924496406 >> v2:172.21.15.151:3300/0 conn(0x7f3dec153e80 0x7f3dec0b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:14:47.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.000+0000 7f3de9d9b700 1 --2- 172.21.15.146:0/3924496406 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dd4004810 0x7f3dd4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.000+0000 7f3dea59c700 1 --2- 172.21.15.146:0/3924496406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3dd4003a60 0x7f3dd4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.000+0000 7f3dead9d700 1 --2- 172.21.15.146:0/3924496406 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3dec068ba0 0x7f3dd40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.000+0000 7f3de9d9b700 1 -- 172.21.15.146:0/3924496406 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3dec068ba0 msgr2=0x7f3dd40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:47.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.000+0000 7f3de9d9b700 1 --2- 172.21.15.146:0/3924496406 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3dec068ba0 0x7f3dd40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.000+0000 7f3de9d9b700 1 -- 172.21.15.146:0/3924496406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3dd4003a60 msgr2=0x7f3dd4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:47.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.000+0000 7f3de9d9b700 1 --2- 172.21.15.146:0/3924496406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3dd4003a60 0x7f3dd4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.000+0000 7f3de9d9b700 1 -- 172.21.15.146:0/3924496406 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd4003570 con 0x7f3dd4004810 2023-10-06T11:14:47.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.000+0000 7f3de9d9b700 1 --2- 172.21.15.146:0/3924496406 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dd4004810 0x7f3dd4004c80 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f3de0009c30 tx=0x7f3de00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c49b57ef52ea123e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:47.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.000+0000 7f3de959a700 1 -- 172.21.15.146:0/3924496406 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de000e710 con 0x7f3dd4004810 2023-10-06T11:14:47.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.000+0000 7f3de959a700 1 -- 172.21.15.146:0/3924496406 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de000e870 con 0x7f3dd4004810 2023-10-06T11:14:47.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.000+0000 7f3de959a700 1 -- 172.21.15.146:0/3924496406 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de000ec30 con 0x7f3dd4004810 2023-10-06T11:14:47.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.001+0000 7f3df0eb3700 1 -- 172.21.15.146:0/3924496406 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dd4004810 msgr2=0x7f3dd4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.001+0000 7f3df0eb3700 1 --2- 172.21.15.146:0/3924496406 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dd4004810 0x7f3dd4004c80 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f3de0009c30 tx=0x7f3de00091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.001+0000 7f3dead9d700 1 -- 172.21.15.146:0/3924496406 reap_dead start 2023-10-06T11:14:47.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.001+0000 7f3df0eb3700 1 -- 172.21.15.146:0/3924496406 shutdown_connections 2023-10-06T11:14:47.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.001+0000 7f3df0eb3700 1 -- 172.21.15.146:0/3924496406 >> 172.21.15.146:0/3924496406 conn(0x7f3dec06eba0 msgr2=0x7f3dec06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:47.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.001+0000 7f3df0eb3700 1 -- 172.21.15.146:0/3924496406 shutdown_connections 2023-10-06T11:14:47.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.001+0000 7f3df0eb3700 1 -- 172.21.15.146:0/3924496406 wait complete. 2023-10-06T11:14:47.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.002+0000 7f3df0eb3700 1 Processor -- start 2023-10-06T11:14:47.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.002+0000 7f3df0eb3700 1 -- start start 2023-10-06T11:14:47.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.003+0000 7f3df0eb3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3dd4004810 0x7f3dec14f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.003+0000 7f3df0eb3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dec154630 0x7f3dec0b0a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.003+0000 7f3df0eb3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3dec0d02a0 0x7f3dec0d0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.003+0000 7f3df0eb3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec14f830 con 0x7f3dec154630 2023-10-06T11:14:47.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.003+0000 7f3df0eb3700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec0d0c50 con 0x7f3dec0d02a0 2023-10-06T11:14:47.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.003+0000 7f3df0eb3700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec169b60 con 0x7f3dd4004810 2023-10-06T11:14:47.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.003+0000 7f3de9d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dec154630 0x7f3dec0b0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.003+0000 7f3de9d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dec154630 0x7f3dec0b0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39562/0 (socket says 172.21.15.146:39562) 2023-10-06T11:14:47.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.003+0000 7f3de9d9b700 1 -- 172.21.15.146:0/2237815329 learned_addr learned my addr 172.21.15.146:0/2237815329 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:47.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.003+0000 7f3dea59c700 1 --2- 172.21.15.146:0/2237815329 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3dd4004810 0x7f3dec14f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.003+0000 7f3dead9d700 1 --2- 172.21.15.146:0/2237815329 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3dec0d02a0 0x7f3dec0d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.003+0000 7f3de9d9b700 1 -- 172.21.15.146:0/2237815329 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3dd4004810 msgr2=0x7f3dec14f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.003+0000 7f3de9d9b700 1 --2- 172.21.15.146:0/2237815329 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3dd4004810 0x7f3dec14f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.003+0000 7f3de9d9b700 1 -- 172.21.15.146:0/2237815329 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3dec0d02a0 msgr2=0x7f3dec0d0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.003+0000 7f3de9d9b700 1 --2- 172.21.15.146:0/2237815329 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3dec0d02a0 0x7f3dec0d0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.003+0000 7f3de9d9b700 1 -- 172.21.15.146:0/2237815329 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dec0b13b0 con 0x7f3dec154630 2023-10-06T11:14:47.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.003+0000 7f3de9d9b700 1 --2- 172.21.15.146:0/2237815329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dec154630 0x7f3dec0b0a10 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f3de000e4b0 tx=0x7f3de001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:47.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.003+0000 7f3dda7fc700 1 -- 172.21.15.146:0/2237815329 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de0022070 con 0x7f3dec154630 2023-10-06T11:14:47.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.003+0000 7f3dda7fc700 1 -- 172.21.15.146:0/2237815329 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de000e9e0 con 0x7f3dec154630 2023-10-06T11:14:47.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.003+0000 7f3df0eb3700 1 -- 172.21.15.146:0/2237815329 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dec0b1690 con 0x7f3dec154630 2023-10-06T11:14:47.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.003+0000 7f3dda7fc700 1 -- 172.21.15.146:0/2237815329 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de0006e50 con 0x7f3dec154630 2023-10-06T11:14:47.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.003+0000 7f3df0eb3700 1 -- 172.21.15.146:0/2237815329 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dec0b1c50 con 0x7f3dec154630 2023-10-06T11:14:47.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.004+0000 7f3df0eb3700 1 -- 172.21.15.146:0/2237815329 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dec0b1de0 con 0x7f3dec154630 2023-10-06T11:14:47.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.005+0000 7f3dda7fc700 1 -- 172.21.15.146:0/2237815329 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3de001c660 con 0x7f3dec154630 2023-10-06T11:14:47.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.005+0000 7f3dda7fc700 1 --2- 172.21.15.146:0/2237815329 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3dcc066f30 0x7f3dcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.005+0000 7f3dda7fc700 1 -- 172.21.15.146:0/2237815329 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3de0085ca0 con 0x7f3dec154630 2023-10-06T11:14:47.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.005+0000 7f3dea59c700 1 --2- 172.21.15.146:0/2237815329 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3dcc066f30 0x7f3dcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.005+0000 7f3dea59c700 1 --2- 172.21.15.146:0/2237815329 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3dcc066f30 0x7f3dcc0693e0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc0017b0 tx=0x7f3dec159c70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:47.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.009+0000 7f3dda7fc700 1 -- 172.21.15.146:0/2237815329 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3de0052e60 con 0x7f3dec154630 2023-10-06T11:14:47.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.233+0000 7f3df0eb3700 1 -- 172.21.15.146:0/2237815329 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3dec04c380 con 0x7f3dec154630 2023-10-06T11:14:47.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.234+0000 7f3dda7fc700 1 -- 172.21.15.146:0/2237815329 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) v1 ==== 95+0+4610 (secure 0 0 0) 0x7f3de0056480 con 0x7f3dec154630 2023-10-06T11:14:47.235 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:47.235 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":100,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6560,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/2109567995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2109567995},{"type":"v1","addr":"172.21.15.151:6834","nonce":2109567995}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":6563,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1783565134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":1783565134},{"type":"v1","addr":"172.21.15.151:6835","nonce":1783565134}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7327,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/1323749517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1323749517},{"type":"v1","addr":"172.21.15.146:6836","nonce":1323749517}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:14:18.891938+0000","modified":"2023-10-06T11:14:22.531674+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8103":{"gid":8103,"name":"c","rank":0,"incarnation":97,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/409226151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":409226151},{"type":"v1","addr":"172.21.15.146:6837","nonce":409226151}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-06T11:14:47.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.236+0000 7f3df0eb3700 1 -- 172.21.15.146:0/2237815329 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3dcc066f30 msgr2=0x7f3dcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.236+0000 7f3df0eb3700 1 --2- 172.21.15.146:0/2237815329 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3dcc066f30 0x7f3dcc0693e0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc0017b0 tx=0x7f3dec159c70 comp rx=0 tx=0).stop 2023-10-06T11:14:47.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.236+0000 7f3df0eb3700 1 -- 172.21.15.146:0/2237815329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dec154630 msgr2=0x7f3dec0b0a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.236+0000 7f3df0eb3700 1 --2- 172.21.15.146:0/2237815329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dec154630 0x7f3dec0b0a10 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f3de000e4b0 tx=0x7f3de001a000 comp rx=0 tx=0).stop 2023-10-06T11:14:47.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.236+0000 7f3df0eb3700 1 -- 172.21.15.146:0/2237815329 shutdown_connections 2023-10-06T11:14:47.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.236+0000 7f3df0eb3700 1 --2- 172.21.15.146:0/2237815329 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3dcc066f30 0x7f3dcc0693e0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.236+0000 7f3df0eb3700 1 --2- 172.21.15.146:0/2237815329 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3dec0d02a0 0x7f3dec0d0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.236+0000 7f3df0eb3700 1 --2- 172.21.15.146:0/2237815329 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3dd4004810 0x7f3dec14f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.236+0000 7f3df0eb3700 1 --2- 172.21.15.146:0/2237815329 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3dec154630 0x7f3dec0b0a10 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.236+0000 7f3df0eb3700 1 -- 172.21.15.146:0/2237815329 >> 172.21.15.146:0/2237815329 conn(0x7f3dec06eba0 msgr2=0x7f3dec15c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:47.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.236+0000 7f3df0eb3700 1 -- 172.21.15.146:0/2237815329 shutdown_connections 2023-10-06T11:14:47.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.236+0000 7f3df0eb3700 1 -- 172.21.15.146:0/2237815329 wait complete. 2023-10-06T11:14:47.239 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 100 2023-10-06T11:14:47.249 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2023-10-06T11:14:47.249 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T11:14:47.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.361+0000 7f3f296d6700 1 Processor -- start 2023-10-06T11:14:47.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.361+0000 7f3f296d6700 1 -- start start 2023-10-06T11:14:47.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.362+0000 7f3f296d6700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3f24153e80 0x7f3f2415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.362+0000 7f3f296d6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f2415ac30 con 0x7f3f24068ba0 2023-10-06T11:14:47.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.362+0000 7f3f296d6700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f240b4510 con 0x7f3f24153ab0 2023-10-06T11:14:47.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.362+0000 7f3f296d6700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f240b6530 con 0x7f3f24153e80 2023-10-06T11:14:47.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.362+0000 7f3f227fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3f24068ba0 0x7f3f240b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45334/0 (socket says 172.21.15.146:45334) 2023-10-06T11:14:47.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.362+0000 7f3f227fc700 1 -- 172.21.15.146:0/3876902839 learned_addr learned my addr 172.21.15.146:0/3876902839 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:14:47.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.363+0000 7f3f237fe700 1 --2- 172.21.15.146:0/3876902839 >> v2:172.21.15.151:3300/0 conn(0x7f3f24153e80 0x7f3f2415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.363+0000 7f3f21ffb700 1 -- 172.21.15.146:0/3876902839 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 98198632 0 0) 0x7f3f18001110 con 0x7f3f24068ba0 2023-10-06T11:14:47.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.363+0000 7f3f21ffb700 1 -- 172.21.15.146:0/3876902839 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f0c003570 con 0x7f3f24068ba0 2023-10-06T11:14:47.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.363+0000 7f3f21ffb700 1 -- 172.21.15.146:0/3876902839 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 227528964 0 0) 0x7f3f240b4510 con 0x7f3f24153ab0 2023-10-06T11:14:47.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.363+0000 7f3f21ffb700 1 -- 172.21.15.146:0/3876902839 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f18001110 con 0x7f3f24153ab0 2023-10-06T11:14:47.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.363+0000 7f3f21ffb700 1 -- 172.21.15.146:0/3876902839 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 215706978 0 0) 0x7f3f0c003570 con 0x7f3f24068ba0 2023-10-06T11:14:47.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.363+0000 7f3f237fe700 1 -- 172.21.15.146:0/3876902839 >> v1:172.21.15.151:6789/0 conn(0x7f3f24153ab0 legacy=0x7f3f24068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.363+0000 7f3f237fe700 1 -- 172.21.15.146:0/3876902839 >> v1:172.21.15.146:6789/0 conn(0x7f3f24068ba0 legacy=0x7f3f240b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.363+0000 7f3f237fe700 1 -- 172.21.15.146:0/3876902839 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f240b5c50 con 0x7f3f24153e80 2023-10-06T11:14:47.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.363+0000 7f3f237fe700 1 --2- 172.21.15.146:0/3876902839 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f24153e80 0x7f3f2415a6f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c0098e0 tx=0x7f3f1c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae09990b38199de3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:47.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.363+0000 7f3f21ffb700 1 -- 172.21.15.146:0/3876902839 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f18001600 con 0x7f3f24153e80 2023-10-06T11:14:47.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.363+0000 7f3f21ffb700 1 -- 172.21.15.146:0/3876902839 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f1c011420 con 0x7f3f24153e80 2023-10-06T11:14:47.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.363+0000 7f3f21ffb700 1 -- 172.21.15.146:0/3876902839 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c0117c0 con 0x7f3f24153e80 2023-10-06T11:14:47.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.364+0000 7f3f296d6700 1 -- 172.21.15.146:0/3876902839 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f24153e80 msgr2=0x7f3f2415a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.364+0000 7f3f296d6700 1 --2- 172.21.15.146:0/3876902839 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f24153e80 0x7f3f2415a6f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c0098e0 tx=0x7f3f1c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.364+0000 7f3f296d6700 1 -- 172.21.15.146:0/3876902839 shutdown_connections 2023-10-06T11:14:47.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.364+0000 7f3f296d6700 1 --2- 172.21.15.146:0/3876902839 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f24153e80 0x7f3f2415a6f0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.364+0000 7f3f296d6700 1 -- 172.21.15.146:0/3876902839 >> 172.21.15.146:0/3876902839 conn(0x7f3f2406eba0 msgr2=0x7f3f2406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:47.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.364+0000 7f3f296d6700 1 -- 172.21.15.146:0/3876902839 shutdown_connections 2023-10-06T11:14:47.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.364+0000 7f3f296d6700 1 -- 172.21.15.146:0/3876902839 wait complete. 2023-10-06T11:14:47.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.365+0000 7f3f296d6700 1 Processor -- start 2023-10-06T11:14:47.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.365+0000 7f3f296d6700 1 -- start start 2023-10-06T11:14:47.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.366+0000 7f3f296d6700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f24068ba0 0x7f3f2413d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.366+0000 7f3f296d6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f24153ab0 0x7f3f240b17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.366+0000 7f3f296d6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f24153e80 0x7f3f2415e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.366+0000 7f3f296d6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2413d960 con 0x7f3f24153ab0 2023-10-06T11:14:47.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.366+0000 7f3f296d6700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f240b22b0 con 0x7f3f24068ba0 2023-10-06T11:14:47.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.366+0000 7f3f296d6700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f240b2590 con 0x7f3f24153e80 2023-10-06T11:14:47.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.366+0000 7f3f227fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f24153ab0 0x7f3f240b17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.366+0000 7f3f227fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f24153ab0 0x7f3f240b17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39566/0 (socket says 172.21.15.146:39566) 2023-10-06T11:14:47.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.366+0000 7f3f227fc700 1 -- 172.21.15.146:0/3108169478 learned_addr learned my addr 172.21.15.146:0/3108169478 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:47.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.366+0000 7f3f22ffd700 1 --2- 172.21.15.146:0/3108169478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f24068ba0 0x7f3f2413d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.366+0000 7f3f237fe700 1 --2- 172.21.15.146:0/3108169478 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f24153e80 0x7f3f2415e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.366+0000 7f3f227fc700 1 -- 172.21.15.146:0/3108169478 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f24153e80 msgr2=0x7f3f2415e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.366+0000 7f3f227fc700 1 --2- 172.21.15.146:0/3108169478 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f24153e80 0x7f3f2415e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.366+0000 7f3f227fc700 1 -- 172.21.15.146:0/3108169478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f24068ba0 msgr2=0x7f3f2413d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.366+0000 7f3f227fc700 1 --2- 172.21.15.146:0/3108169478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f24068ba0 0x7f3f2413d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.366+0000 7f3f227fc700 1 -- 172.21.15.146:0/3108169478 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f1c009420 con 0x7f3f24153ab0 2023-10-06T11:14:47.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.366+0000 7f3f237fe700 1 --2- 172.21.15.146:0/3108169478 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f24153e80 0x7f3f2415e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:47.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.366+0000 7f3f227fc700 1 --2- 172.21.15.146:0/3108169478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f24153ab0 0x7f3f240b17f0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f3f1800cb60 tx=0x7f3f18001ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:47.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.367+0000 7f3f0affd700 1 -- 172.21.15.146:0/3108169478 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f18005b30 con 0x7f3f24153ab0 2023-10-06T11:14:47.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.367+0000 7f3f0affd700 1 -- 172.21.15.146:0/3108169478 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f18005c90 con 0x7f3f24153ab0 2023-10-06T11:14:47.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.367+0000 7f3f296d6700 1 -- 172.21.15.146:0/3108169478 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f240b2870 con 0x7f3f24153ab0 2023-10-06T11:14:47.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.367+0000 7f3f0affd700 1 -- 172.21.15.146:0/3108169478 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f18007300 con 0x7f3f24153ab0 2023-10-06T11:14:47.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.367+0000 7f3f296d6700 1 -- 172.21.15.146:0/3108169478 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f241575a0 con 0x7f3f24153ab0 2023-10-06T11:14:47.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.368+0000 7f3f296d6700 1 -- 172.21.15.146:0/3108169478 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f24157830 con 0x7f3f24153ab0 2023-10-06T11:14:47.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.368+0000 7f3f0affd700 1 -- 172.21.15.146:0/3108169478 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3f1800a5d0 con 0x7f3f24153ab0 2023-10-06T11:14:47.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.368+0000 7f3f0affd700 1 --2- 172.21.15.146:0/3108169478 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3f10066f30 0x7f3f100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.368+0000 7f3f0affd700 1 -- 172.21.15.146:0/3108169478 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3f18084340 con 0x7f3f24153ab0 2023-10-06T11:14:47.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.368+0000 7f3f22ffd700 1 --2- 172.21.15.146:0/3108169478 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3f10066f30 0x7f3f100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.369+0000 7f3f22ffd700 1 --2- 172.21.15.146:0/3108169478 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3f10066f30 0x7f3f100693e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f3f240b4e60 tx=0x7f3f14002730 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:47.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.373+0000 7f3f0affd700 1 -- 172.21.15.146:0/3108169478 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3f24157830 con 0x7f3f24153ab0 2023-10-06T11:14:47.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.632+0000 7f3f296d6700 1 -- 172.21.15.146:0/3108169478 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f3f2415ac30 con 0x7f3f24153ab0 2023-10-06T11:14:47.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.632+0000 7f3f0affd700 1 -- 172.21.15.146:0/3108169478 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1603 (secure 0 0 0) 0x7f3f2415ac30 con 0x7f3f24153ab0 2023-10-06T11:14:47.634 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:47.634 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":562,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":113,"num_osds":8,"num_up_osds":8,"osd_up_since":1696590336,"num_in_osds":8,"osd_in_since":1696590327,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":1063,"data_bytes":1077945528,"bytes_used":4672598016,"bytes_avail":768421515264,"bytes_total":773094113280,"write_bytes_sec":61376841,"read_op_per_sec":0,"write_op_per_sec":142},"fsmap":{"epoch":100,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":8103}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2023-10-06T11:14:45.255803+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T11:14:47.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.634+0000 7f3f296d6700 1 -- 172.21.15.146:0/3108169478 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3f10066f30 msgr2=0x7f3f100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.634+0000 7f3f296d6700 1 --2- 172.21.15.146:0/3108169478 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3f10066f30 0x7f3f100693e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f3f240b4e60 tx=0x7f3f14002730 comp rx=0 tx=0).stop 2023-10-06T11:14:47.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.634+0000 7f3f296d6700 1 -- 172.21.15.146:0/3108169478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f24153ab0 msgr2=0x7f3f240b17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.634+0000 7f3f296d6700 1 --2- 172.21.15.146:0/3108169478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f24153ab0 0x7f3f240b17f0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f3f1800cb60 tx=0x7f3f18001ac0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.634+0000 7f3f296d6700 1 -- 172.21.15.146:0/3108169478 shutdown_connections 2023-10-06T11:14:47.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.634+0000 7f3f296d6700 1 --2- 172.21.15.146:0/3108169478 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3f10066f30 0x7f3f100693e0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.634+0000 7f3f296d6700 1 --2- 172.21.15.146:0/3108169478 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f24153e80 0x7f3f2415e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.634+0000 7f3f296d6700 1 --2- 172.21.15.146:0/3108169478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f24068ba0 0x7f3f2413d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.634+0000 7f3f296d6700 1 --2- 172.21.15.146:0/3108169478 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f24153ab0 0x7f3f240b17f0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.634+0000 7f3f296d6700 1 -- 172.21.15.146:0/3108169478 >> 172.21.15.146:0/3108169478 conn(0x7f3f2406eba0 msgr2=0x7f3f24151c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:47.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.634+0000 7f3f296d6700 1 -- 172.21.15.146:0/3108169478 shutdown_connections 2023-10-06T11:14:47.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.634+0000 7f3f296d6700 1 -- 172.21.15.146:0/3108169478 wait complete. 2023-10-06T11:14:47.648 INFO:tasks.cephfs.filesystem.ceph_manager:{'c': 'paused'} 2023-10-06T11:14:47.648 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 scrub resume 2023-10-06T11:14:47.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.762+0000 7f3f35ced700 1 Processor -- start 2023-10-06T11:14:47.764 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.762+0000 7f3f35ced700 1 -- start start 2023-10-06T11:14:47.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.763+0000 7f3f35ced700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f300ae730 0x7f3f300aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.763+0000 7f3f35ced700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3f300cb950 0x7f3f300cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.763+0000 7f3f35ced700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f300ae2a0 con 0x7f3f3015a160 2023-10-06T11:14:47.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.763+0000 7f3f35ced700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f3015a530 con 0x7f3f300cb950 2023-10-06T11:14:47.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.763+0000 7f3f35ced700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f300c5cb0 con 0x7f3f300ae730 2023-10-06T11:14:47.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.763+0000 7f3f2f7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3f3015a160 0x7f3f300c55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45344/0 (socket says 172.21.15.146:45344) 2023-10-06T11:14:47.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.763+0000 7f3f2f7fe700 1 -- 172.21.15.146:0/1344655500 learned_addr learned my addr 172.21.15.146:0/1344655500 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:14:47.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.763+0000 7f3f2ffff700 1 --2- 172.21.15.146:0/1344655500 >> v2:172.21.15.146:3300/0 conn(0x7f3f300cb950 0x7f3f300cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.764+0000 7f3f2effd700 1 --2- 172.21.15.146:0/1344655500 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f300ae730 0x7f3f300aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.764+0000 7f3f2e7fc700 1 -- 172.21.15.146:0/1344655500 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1272173157 0 0) 0x7f3f300ae2a0 con 0x7f3f3015a160 2023-10-06T11:14:47.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.764+0000 7f3f2e7fc700 1 -- 172.21.15.146:0/1344655500 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f18003570 con 0x7f3f3015a160 2023-10-06T11:14:47.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.764+0000 7f3f2ffff700 1 -- 172.21.15.146:0/1344655500 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f300ae730 msgr2=0x7f3f300aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:47.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.764+0000 7f3f2ffff700 1 --2- 172.21.15.146:0/1344655500 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f300ae730 0x7f3f300aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.764+0000 7f3f2ffff700 1 -- 172.21.15.146:0/1344655500 >> v1:172.21.15.146:6789/0 conn(0x7f3f3015a160 legacy=0x7f3f300c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.764+0000 7f3f2ffff700 1 -- 172.21.15.146:0/1344655500 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f300ad690 con 0x7f3f300cb950 2023-10-06T11:14:47.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.764+0000 7f3f2effd700 1 --2- 172.21.15.146:0/1344655500 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f300ae730 0x7f3f300aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:47.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.764+0000 7f3f2ffff700 1 --2- 172.21.15.146:0/1344655500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f300cb950 0x7f3f300cbdb0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f3f28009e60 tx=0x7f3f28009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=342d907a661b2bbb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:47.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.764+0000 7f3f2e7fc700 1 -- 172.21.15.146:0/1344655500 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2800e070 con 0x7f3f300cb950 2023-10-06T11:14:47.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.764+0000 7f3f2e7fc700 1 -- 172.21.15.146:0/1344655500 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f2800bb60 con 0x7f3f300cb950 2023-10-06T11:14:47.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.764+0000 7f3f2e7fc700 1 -- 172.21.15.146:0/1344655500 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f28012430 con 0x7f3f300cb950 2023-10-06T11:14:47.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.764+0000 7f3f35ced700 1 -- 172.21.15.146:0/1344655500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f300cb950 msgr2=0x7f3f300cbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.764+0000 7f3f35ced700 1 --2- 172.21.15.146:0/1344655500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f300cb950 0x7f3f300cbdb0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f3f28009e60 tx=0x7f3f28009780 comp rx=0 tx=0).stop 2023-10-06T11:14:47.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.765+0000 7f3f35ced700 1 -- 172.21.15.146:0/1344655500 shutdown_connections 2023-10-06T11:14:47.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.765+0000 7f3f35ced700 1 --2- 172.21.15.146:0/1344655500 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f300cb950 0x7f3f300cbdb0 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.765+0000 7f3f35ced700 1 --2- 172.21.15.146:0/1344655500 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f300ae730 0x7f3f300aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.765+0000 7f3f35ced700 1 -- 172.21.15.146:0/1344655500 >> 172.21.15.146:0/1344655500 conn(0x7f3f3006f380 msgr2=0x7f3f300d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:47.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.765+0000 7f3f35ced700 1 -- 172.21.15.146:0/1344655500 shutdown_connections 2023-10-06T11:14:47.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.765+0000 7f3f35ced700 1 -- 172.21.15.146:0/1344655500 wait complete. 2023-10-06T11:14:47.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.766+0000 7f3f35ced700 1 Processor -- start 2023-10-06T11:14:47.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.766+0000 7f3f35ced700 1 -- start start 2023-10-06T11:14:47.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.767+0000 7f3f35ced700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f300ae730 0x7f3f30159390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.767+0000 7f3f35ced700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f300cb950 0x7f3f300b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.767+0000 7f3f35ced700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f3015a160 0x7f3f300b4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.767+0000 7f3f35ced700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f300b56d0 con 0x7f3f300cb950 2023-10-06T11:14:47.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.767+0000 7f3f35ced700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f3015cd60 con 0x7f3f300ae730 2023-10-06T11:14:47.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.767+0000 7f3f35ced700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f300b4ac0 con 0x7f3f3015a160 2023-10-06T11:14:47.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.767+0000 7f3f2effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f300cb950 0x7f3f300b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.767+0000 7f3f2effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f300cb950 0x7f3f300b3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39592/0 (socket says 172.21.15.146:39592) 2023-10-06T11:14:47.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.767+0000 7f3f2effd700 1 -- 172.21.15.146:0/2114720935 learned_addr learned my addr 172.21.15.146:0/2114720935 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:47.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.767+0000 7f3f2ffff700 1 --2- 172.21.15.146:0/2114720935 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f3015a160 0x7f3f300b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.767+0000 7f3f2f7fe700 1 --2- 172.21.15.146:0/2114720935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f300ae730 0x7f3f30159390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.767+0000 7f3f2effd700 1 -- 172.21.15.146:0/2114720935 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f3015a160 msgr2=0x7f3f300b4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.767+0000 7f3f2effd700 1 --2- 172.21.15.146:0/2114720935 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f3015a160 0x7f3f300b4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.767+0000 7f3f2effd700 1 -- 172.21.15.146:0/2114720935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f300ae730 msgr2=0x7f3f30159390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.767+0000 7f3f2effd700 1 --2- 172.21.15.146:0/2114720935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f300ae730 0x7f3f30159390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.767+0000 7f3f2effd700 1 -- 172.21.15.146:0/2114720935 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f28009a20 con 0x7f3f300cb950 2023-10-06T11:14:47.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.767+0000 7f3f2ffff700 1 --2- 172.21.15.146:0/2114720935 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f3015a160 0x7f3f300b4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:47.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.767+0000 7f3f2effd700 1 --2- 172.21.15.146:0/2114720935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f300cb950 0x7f3f300b3f50 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f3f2400d890 tx=0x7f3f24008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:47.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.767+0000 7f3f177fe700 1 -- 172.21.15.146:0/2114720935 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2400b600 con 0x7f3f300cb950 2023-10-06T11:14:47.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.767+0000 7f3f177fe700 1 -- 172.21.15.146:0/2114720935 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f2400b760 con 0x7f3f300cb950 2023-10-06T11:14:47.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.767+0000 7f3f35ced700 1 -- 172.21.15.146:0/2114720935 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f300b4da0 con 0x7f3f300cb950 2023-10-06T11:14:47.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.767+0000 7f3f177fe700 1 -- 172.21.15.146:0/2114720935 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2400bb00 con 0x7f3f300cb950 2023-10-06T11:14:47.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.767+0000 7f3f35ced700 1 -- 172.21.15.146:0/2114720935 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f300b5360 con 0x7f3f300cb950 2023-10-06T11:14:47.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.769+0000 7f3f177fe700 1 -- 172.21.15.146:0/2114720935 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3f24014430 con 0x7f3f300cb950 2023-10-06T11:14:47.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.769+0000 7f3f177fe700 1 --2- 172.21.15.146:0/2114720935 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3f1c066f30 0x7f3f1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.769+0000 7f3f177fe700 1 -- 172.21.15.146:0/2114720935 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3f24084ab0 con 0x7f3f300cb950 2023-10-06T11:14:47.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.769+0000 7f3f2f7fe700 1 --2- 172.21.15.146:0/2114720935 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3f1c066f30 0x7f3f1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.769+0000 7f3f2f7fe700 1 --2- 172.21.15.146:0/2114720935 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3f1c066f30 0x7f3f1c0693e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f3f20001360 tx=0x7f3f20009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:47.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.771+0000 7f3f3efe5b80 1 Processor -- start 2023-10-06T11:14:47.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.771+0000 7f3f3efe5b80 1 -- start start 2023-10-06T11:14:47.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.772+0000 7f3f3efe5b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e7b42a4ae0 0x55e7b42a4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.772+0000 7f3f3efe5b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7b42609f0 0x55e7b425d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.772+0000 7f3f3efe5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e7b425ec20 0x55e7b425db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.772+0000 7f3f3efe5b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7b41ddcd0 con 0x55e7b42609f0 2023-10-06T11:14:47.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.772+0000 7f3f3efe5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7b41b4ac0 con 0x55e7b425ec20 2023-10-06T11:14:47.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.772+0000 7f3f3efe5b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e7b41b22c0 con 0x55e7b42a4ae0 2023-10-06T11:14:47.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.772+0000 7f3f2effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7b42609f0 0x55e7b425d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.772+0000 7f3f2effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7b42609f0 0x55e7b425d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39598/0 (socket says 172.21.15.146:39598) 2023-10-06T11:14:47.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.772+0000 7f3f2effd700 1 -- 172.21.15.146:0/2177417193 learned_addr learned my addr 172.21.15.146:0/2177417193 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:47.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.772+0000 7f3f2f7fe700 1 --2- 172.21.15.146:0/2177417193 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e7b42a4ae0 0x55e7b42a4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.772+0000 7f3f2ffff700 1 --2- 172.21.15.146:0/2177417193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e7b425ec20 0x55e7b425db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.772+0000 7f3f2effd700 1 -- 172.21.15.146:0/2177417193 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e7b42a4ae0 msgr2=0x55e7b42a4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:47.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.772+0000 7f3f2effd700 1 --2- 172.21.15.146:0/2177417193 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e7b42a4ae0 0x55e7b42a4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.772+0000 7f3f2effd700 1 -- 172.21.15.146:0/2177417193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e7b425ec20 msgr2=0x55e7b425db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:47.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.772+0000 7f3f2effd700 1 --2- 172.21.15.146:0/2177417193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e7b425ec20 0x55e7b425db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.772+0000 7f3f2effd700 1 -- 172.21.15.146:0/2177417193 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7b40482c0 con 0x55e7b42609f0 2023-10-06T11:14:47.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.772+0000 7f3f2ffff700 1 --2- 172.21.15.146:0/2177417193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e7b425ec20 0x55e7b425db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:47.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.772+0000 7f3f2effd700 1 --2- 172.21.15.146:0/2177417193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7b42609f0 0x55e7b425d5d0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f3f24082e70 tx=0x7f3f24082dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c0fdf271bc8cae4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:47.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.773+0000 7f3f14ff9700 1 -- 172.21.15.146:0/2177417193 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2406bea0 con 0x55e7b42609f0 2023-10-06T11:14:47.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.773+0000 7f3f14ff9700 1 -- 172.21.15.146:0/2177417193 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f24058ad0 con 0x55e7b42609f0 2023-10-06T11:14:47.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.773+0000 7f3f14ff9700 1 -- 172.21.15.146:0/2177417193 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2405c820 con 0x55e7b42609f0 2023-10-06T11:14:47.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.773+0000 7f3f3efe5b80 1 -- 172.21.15.146:0/2177417193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7b42609f0 msgr2=0x55e7b425d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.773+0000 7f3f3efe5b80 1 --2- 172.21.15.146:0/2177417193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7b42609f0 0x55e7b425d5d0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f3f24082e70 tx=0x7f3f24082dd0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.773+0000 7f3f3efe5b80 1 -- 172.21.15.146:0/2177417193 shutdown_connections 2023-10-06T11:14:47.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.773+0000 7f3f3efe5b80 1 --2- 172.21.15.146:0/2177417193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e7b425ec20 0x55e7b425db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.773+0000 7f3f3efe5b80 1 --2- 172.21.15.146:0/2177417193 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e7b42a4ae0 0x55e7b42a4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.773+0000 7f3f3efe5b80 1 --2- 172.21.15.146:0/2177417193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7b42609f0 0x55e7b425d5d0 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.773+0000 7f3f3efe5b80 1 -- 172.21.15.146:0/2177417193 >> 172.21.15.146:0/2177417193 conn(0x55e7b425f0c0 msgr2=0x55e7b425f490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:47.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.773+0000 7f3f3efe5b80 1 -- 172.21.15.146:0/2177417193 shutdown_connections 2023-10-06T11:14:47.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.773+0000 7f3f3efe5b80 1 -- 172.21.15.146:0/2177417193 wait complete. 2023-10-06T11:14:47.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.774+0000 7f3f3efe5b80 1 -- start start 2023-10-06T11:14:47.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.774+0000 7f3f3efe5b80 1 Processor -- start 2023-10-06T11:14:47.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.775+0000 7f3f3efe5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e7b425ec20 0x55e7b4284540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.775+0000 7f3f3efe5b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7b42609f0 0x55e7b42881f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.775+0000 7f3f3efe5b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e7b42a4ae0 0x55e7b425d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.775+0000 7f3f3efe5b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7b41ae0b0 con 0x55e7b42609f0 2023-10-06T11:14:47.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.775+0000 7f3f3efe5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7b41598e0 con 0x55e7b425ec20 2023-10-06T11:14:47.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.775+0000 7f3f3efe5b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e7b4174ef0 con 0x55e7b42a4ae0 2023-10-06T11:14:47.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.775+0000 7f3f3efe5b80 10 client.0 _ll_register_callbacks cb 0x55e7b404af80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:14:47.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.775+0000 7f3f2effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7b42609f0 0x55e7b42881f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.775+0000 7f3f2effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7b42609f0 0x55e7b42881f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39610/0 (socket says 172.21.15.146:39610) 2023-10-06T11:14:47.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.775+0000 7f3f2effd700 1 -- 172.21.15.146:0/2964671175 learned_addr learned my addr 172.21.15.146:0/2964671175 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:47.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.775+0000 7f3f2ffff700 1 --2- 172.21.15.146:0/2964671175 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e7b42a4ae0 0x55e7b425d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.775+0000 7f3f2f7fe700 1 --2- 172.21.15.146:0/2964671175 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e7b425ec20 0x55e7b4284540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.775+0000 7f3f2effd700 1 -- 172.21.15.146:0/2964671175 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e7b42a4ae0 msgr2=0x55e7b425d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:47.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.775+0000 7f3f2effd700 1 --2- 172.21.15.146:0/2964671175 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e7b42a4ae0 0x55e7b425d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.775+0000 7f3f2effd700 1 -- 172.21.15.146:0/2964671175 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e7b425ec20 msgr2=0x55e7b4284540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:47.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.775+0000 7f3f2effd700 1 --2- 172.21.15.146:0/2964671175 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e7b425ec20 0x55e7b4284540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.775+0000 7f3f2effd700 1 -- 172.21.15.146:0/2964671175 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f300b5360 con 0x55e7b42609f0 2023-10-06T11:14:47.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.775+0000 7f3f2effd700 1 --2- 172.21.15.146:0/2964671175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7b42609f0 0x55e7b42881f0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f3f24082f50 tx=0x7f3f2406f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fe79ff03fcdb5fe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:47.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.775+0000 7f3f0dffb700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:14:47.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.775+0000 7f3f0dffb700 1 -- 172.21.15.146:0/2964671175 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2405c820 con 0x55e7b42609f0 2023-10-06T11:14:47.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.775+0000 7f3f0dffb700 1 -- 172.21.15.146:0/2964671175 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3f240712b0 con 0x55e7b42609f0 2023-10-06T11:14:47.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.775+0000 7f3f3efe5b80 1 -- 172.21.15.146:0/2964671175 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e7b42526e0 con 0x55e7b42609f0 2023-10-06T11:14:47.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.775+0000 7f3f0dffb700 1 -- 172.21.15.146:0/2964671175 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f24055ae0 con 0x55e7b42609f0 2023-10-06T11:14:47.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.776+0000 7f3f3efe5b80 10 client.8442 fetch_fsmap learned FSMap version 100 2023-10-06T11:14:47.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.776+0000 7f3f3efe5b80 1 -- 172.21.15.146:0/2964671175 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) v3 -- 0x55e7b3feb030 con 0x55e7b42609f0 2023-10-06T11:14:47.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.776+0000 7f3f0dffb700 1 -- 172.21.15.146:0/2964671175 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e7b42526e0 con 0x55e7b42609f0 2023-10-06T11:14:47.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.776+0000 7f3f0dffb700 1 -- 172.21.15.146:0/2964671175 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 100) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3f24054d70 con 0x55e7b42609f0 2023-10-06T11:14:47.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.776+0000 7f3f3efe5b80 10 client.8442 fetch_fsmap finished waiting for FSMap version 100 2023-10-06T11:14:47.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.776+0000 7f3f3efe5b80 10 client.8442 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2023-10-06T11:14:47.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.776+0000 7f3f3efe5b80 20 client.8442 populate_metadata read hostname 'smithi146' 2023-10-06T11:14:47.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.776+0000 7f3f3efe5b80 1 --2- 172.21.15.146:0/2964671175 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x55e7b4288730 0x55e7b42a06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.776+0000 7f3f3efe5b80 4 client.8442 mds_command: new command op to 8103 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:14:47.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.776+0000 7f3f3efe5b80 1 -- 172.21.15.146:0/2964671175 --> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e7b422f610 con 0x55e7b4288730 2023-10-06T11:14:47.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.776+0000 7f3f2f7fe700 1 --2- 172.21.15.146:0/2964671175 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x55e7b4288730 0x55e7b42a06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.776+0000 7f3f0dffb700 10 client.8442 ms_handle_connect on v2:172.21.15.146:6835/409226151 2023-10-06T11:14:47.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.776+0000 7f3f2f7fe700 1 --2- 172.21.15.146:0/2964671175 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x55e7b4288730 0x55e7b42a06c0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44f1e3e6b58c2172 server_cookie=e558d717c1c2f0ae in_seq=0 out_seq=0 2023-10-06T11:14:47.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.777+0000 7f3f0dffb700 1 -- 172.21.15.146:0/2964671175 <== mds.0 v2:172.21.15.146:6835/409226151 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55e7b422f610 con 0x55e7b4288730 2023-10-06T11:14:47.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.777+0000 7f3f0dffb700 10 client.8442 handle_command_reply: tid=0 2023-10-06T11:14:47.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.777+0000 7f3f3efe5b80 1 client.8442 shutdown 2023-10-06T11:14:47.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.777+0000 7f3f3efe5b80 1 -- 172.21.15.146:0/2964671175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7b42609f0 msgr2=0x55e7b42881f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.777+0000 7f3f3efe5b80 1 --2- 172.21.15.146:0/2964671175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7b42609f0 0x55e7b42881f0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f3f24082f50 tx=0x7f3f2406f000 comp rx=0 tx=0).stop 2023-10-06T11:14:47.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.777+0000 7f3f3efe5b80 1 -- 172.21.15.146:0/2964671175 shutdown_connections 2023-10-06T11:14:47.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.777+0000 7f3f3efe5b80 1 --2- 172.21.15.146:0/2964671175 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x55e7b4288730 0x55e7b42a06c0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.777+0000 7f3f3efe5b80 1 --2- 172.21.15.146:0/2964671175 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e7b42a4ae0 0x55e7b425d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.777+0000 7f3f3efe5b80 1 --2- 172.21.15.146:0/2964671175 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e7b425ec20 0x55e7b4284540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.777+0000 7f3f0dffb700 0 client.8442 ms_handle_reset on v2:172.21.15.146:6835/409226151 2023-10-06T11:14:47.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.777+0000 7f3f3efe5b80 1 --2- 172.21.15.146:0/2964671175 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7b42609f0 0x55e7b42881f0 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.777+0000 7f3f3efe5b80 1 -- 172.21.15.146:0/2964671175 >> 172.21.15.146:0/2964671175 conn(0x55e7b425f0c0 msgr2=0x55e7b42a3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:47.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.777+0000 7f3f3efe5b80 1 -- 172.21.15.146:0/2964671175 shutdown_connections 2023-10-06T11:14:47.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.777+0000 7f3f3efe5b80 1 -- 172.21.15.146:0/2964671175 wait complete. 2023-10-06T11:14:47.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.777+0000 7f3f3efe5b80 20 client.8442 trim_cache size 0 max 16384 2023-10-06T11:14:47.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.792+0000 7f3f3efe5b80 1 Processor -- start 2023-10-06T11:14:47.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.793+0000 7f3f3efe5b80 1 -- start start 2023-10-06T11:14:47.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.793+0000 7f3f3efe5b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e7b425ec20 0x55e7b425ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.793+0000 7f3f3efe5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e7b42609f0 0x55e7b42598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.793+0000 7f3f3efe5b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7b42a4ae0 0x55e7b4259e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.793+0000 7f3f3efe5b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7b4030e80 con 0x55e7b42a4ae0 2023-10-06T11:14:47.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.793+0000 7f3f3efe5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7b42a0160 con 0x55e7b42609f0 2023-10-06T11:14:47.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.793+0000 7f3f3efe5b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e7b4256020 con 0x55e7b425ec20 2023-10-06T11:14:47.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.793+0000 7f3f2ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7b42a4ae0 0x55e7b4259e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.793+0000 7f3f2ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7b42a4ae0 0x55e7b4259e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39616/0 (socket says 172.21.15.146:39616) 2023-10-06T11:14:47.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.793+0000 7f3f2ffff700 1 -- 172.21.15.146:0/2884843981 learned_addr learned my addr 172.21.15.146:0/2884843981 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:47.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.794+0000 7f3f2effd700 1 --2- 172.21.15.146:0/2884843981 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e7b42609f0 0x55e7b42598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.794+0000 7f3f2f7fe700 1 --2- 172.21.15.146:0/2884843981 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e7b425ec20 0x55e7b425ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.794+0000 7f3f2ffff700 1 -- 172.21.15.146:0/2884843981 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e7b425ec20 msgr2=0x55e7b425ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:47.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.794+0000 7f3f2ffff700 1 --2- 172.21.15.146:0/2884843981 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e7b425ec20 0x55e7b425ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.794+0000 7f3f2ffff700 1 -- 172.21.15.146:0/2884843981 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e7b42609f0 msgr2=0x55e7b42598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:47.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.794+0000 7f3f2ffff700 1 --2- 172.21.15.146:0/2884843981 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e7b42609f0 0x55e7b42598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.794+0000 7f3f2ffff700 1 -- 172.21.15.146:0/2884843981 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7b417c7d0 con 0x55e7b42a4ae0 2023-10-06T11:14:47.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.794+0000 7f3f2ffff700 1 --2- 172.21.15.146:0/2884843981 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7b42a4ae0 0x55e7b4259e10 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f3f30088c60 tx=0x7f3f28019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6af6c4a931f909d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:47.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.794+0000 7f3f157fa700 1 -- 172.21.15.146:0/2884843981 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2802d070 con 0x55e7b42a4ae0 2023-10-06T11:14:47.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.794+0000 7f3f157fa700 1 -- 172.21.15.146:0/2884843981 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f28024040 con 0x55e7b42a4ae0 2023-10-06T11:14:47.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.794+0000 7f3f157fa700 1 -- 172.21.15.146:0/2884843981 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f28023050 con 0x55e7b42a4ae0 2023-10-06T11:14:47.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.794+0000 7f3f3efe5b80 1 -- 172.21.15.146:0/2884843981 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7b42a4ae0 msgr2=0x55e7b4259e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.794+0000 7f3f3efe5b80 1 --2- 172.21.15.146:0/2884843981 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7b42a4ae0 0x55e7b4259e10 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f3f30088c60 tx=0x7f3f28019000 comp rx=0 tx=0).stop 2023-10-06T11:14:47.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.794+0000 7f3f3efe5b80 1 -- 172.21.15.146:0/2884843981 shutdown_connections 2023-10-06T11:14:47.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.794+0000 7f3f3efe5b80 1 --2- 172.21.15.146:0/2884843981 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7b42a4ae0 0x55e7b4259e10 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.794+0000 7f3f3efe5b80 1 --2- 172.21.15.146:0/2884843981 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e7b425ec20 0x55e7b425ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.794+0000 7f3f3efe5b80 1 --2- 172.21.15.146:0/2884843981 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e7b42609f0 0x55e7b42598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.794+0000 7f3f3efe5b80 1 -- 172.21.15.146:0/2884843981 >> 172.21.15.146:0/2884843981 conn(0x55e7b425f0c0 msgr2=0x55e7b42a32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:47.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.795+0000 7f3f3efe5b80 1 -- 172.21.15.146:0/2884843981 shutdown_connections 2023-10-06T11:14:47.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.795+0000 7f3f3efe5b80 1 -- 172.21.15.146:0/2884843981 wait complete. 2023-10-06T11:14:47.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.795+0000 7f3f3efe5b80 1 -- start start 2023-10-06T11:14:47.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.795+0000 7f3f3efe5b80 1 Processor -- start 2023-10-06T11:14:47.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.796+0000 7f3f3efe5b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e7b425ec20 0x55e7b429e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.796+0000 7f3f3efe5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e7b42609f0 0x55e7b42598d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.796+0000 7f3f3efe5b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7b42a4ae0 0x55e7b4259e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.796+0000 7f3f3efe5b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7b430a710 con 0x55e7b42a4ae0 2023-10-06T11:14:47.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.796+0000 7f3f3efe5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7b42a0930 con 0x55e7b42609f0 2023-10-06T11:14:47.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.796+0000 7f3f3efe5b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e7b429df00 con 0x55e7b425ec20 2023-10-06T11:14:47.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.796+0000 7f3f3efe5b80 10 client.0 _ll_register_callbacks cb 0x55e7b404af80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:14:47.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.796+0000 7f3f2ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7b42a4ae0 0x55e7b4259e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.796+0000 7f3f2ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7b42a4ae0 0x55e7b4259e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39626/0 (socket says 172.21.15.146:39626) 2023-10-06T11:14:47.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.796+0000 7f3f2ffff700 1 -- 172.21.15.146:0/2991710432 learned_addr learned my addr 172.21.15.146:0/2991710432 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:47.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.796+0000 7f3f2effd700 1 --2- 172.21.15.146:0/2991710432 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e7b42609f0 0x55e7b42598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.796+0000 7f3f2f7fe700 1 --2- 172.21.15.146:0/2991710432 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e7b425ec20 0x55e7b429e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.796+0000 7f3f2ffff700 1 -- 172.21.15.146:0/2991710432 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e7b425ec20 msgr2=0x55e7b429e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:47.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.796+0000 7f3f2ffff700 1 --2- 172.21.15.146:0/2991710432 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e7b425ec20 0x55e7b429e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.796+0000 7f3f2ffff700 1 -- 172.21.15.146:0/2991710432 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e7b42609f0 msgr2=0x55e7b42598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:47.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.796+0000 7f3f2ffff700 1 --2- 172.21.15.146:0/2991710432 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e7b42609f0 0x55e7b42598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.796+0000 7f3f2ffff700 1 -- 172.21.15.146:0/2991710432 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f300ad690 con 0x55e7b42a4ae0 2023-10-06T11:14:47.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.796+0000 7f3f2effd700 1 --2- 172.21.15.146:0/2991710432 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e7b42609f0 0x55e7b42598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:47.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.796+0000 7f3f2ffff700 1 --2- 172.21.15.146:0/2991710432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7b42a4ae0 0x55e7b4259e10 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f3f2800c010 tx=0x7f3f28020070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9b46660de8bf64e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:47.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.796+0000 7f3f0dffb700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:14:47.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.797+0000 7f3f0dffb700 1 -- 172.21.15.146:0/2991710432 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2802d040 con 0x55e7b42a4ae0 2023-10-06T11:14:47.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.797+0000 7f3f0dffb700 1 -- 172.21.15.146:0/2991710432 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3f28038030 con 0x55e7b42a4ae0 2023-10-06T11:14:47.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.797+0000 7f3f3efe5b80 1 -- 172.21.15.146:0/2991710432 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3f24058ad0 con 0x55e7b42a4ae0 2023-10-06T11:14:47.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.797+0000 7f3f0dffb700 1 -- 172.21.15.146:0/2991710432 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f28023020 con 0x55e7b42a4ae0 2023-10-06T11:14:47.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.797+0000 7f3f3efe5b80 10 client.8448 fetch_fsmap learned FSMap version 100 2023-10-06T11:14:47.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.797+0000 7f3f3efe5b80 1 -- 172.21.15.146:0/2991710432 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) v3 -- 0x55e7b41634c0 con 0x55e7b42a4ae0 2023-10-06T11:14:47.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.797+0000 7f3f0dffb700 1 -- 172.21.15.146:0/2991710432 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f24058ad0 con 0x55e7b42a4ae0 2023-10-06T11:14:47.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.797+0000 7f3f0dffb700 1 -- 172.21.15.146:0/2991710432 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 100) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3f28029880 con 0x55e7b42a4ae0 2023-10-06T11:14:47.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.797+0000 7f3f3efe5b80 10 client.8448 fetch_fsmap finished waiting for FSMap version 100 2023-10-06T11:14:47.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.797+0000 7f3f3efe5b80 10 client.8448 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2023-10-06T11:14:47.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.797+0000 7f3f3efe5b80 20 client.8448 populate_metadata read hostname 'smithi146' 2023-10-06T11:14:47.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.797+0000 7f3f3efe5b80 1 --2- 172.21.15.146:0/2991710432 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x55e7b42bcf60 0x55e7b4309760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.797+0000 7f3f3efe5b80 4 client.8448 mds_command: new command op to 8103 tid=0[{"prefix": "scrub resume"}] 2023-10-06T11:14:47.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.797+0000 7f3f3efe5b80 1 -- 172.21.15.146:0/2991710432 --> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] -- command(tid 0: {"prefix": "scrub resume"}) v1 -- 0x55e7b4150e50 con 0x55e7b42bcf60 2023-10-06T11:14:47.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.797+0000 7f3f2f7fe700 1 --2- 172.21.15.146:0/2991710432 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x55e7b42bcf60 0x55e7b4309760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.797+0000 7f3f0dffb700 10 client.8448 ms_handle_connect on v2:172.21.15.146:6835/409226151 2023-10-06T11:14:47.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.797+0000 7f3f2f7fe700 1 --2- 172.21.15.146:0/2991710432 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x55e7b42bcf60 0x55e7b4309760 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5763ff096e6d446 server_cookie=2bdc8fa28b425cc3 in_seq=0 out_seq=0 2023-10-06T11:14:47.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.798+0000 7f3f0dffb700 1 -- 172.21.15.146:0/2991710432 <== mds.0 v2:172.21.15.146:6835/409226151 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x55e7b4150e50 con 0x55e7b42bcf60 2023-10-06T11:14:47.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.798+0000 7f3f0dffb700 10 client.8448 handle_command_reply: tid=0 2023-10-06T11:14:47.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.798+0000 7f3f3efe5b80 1 client.8448 shutdown 2023-10-06T11:14:47.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.798+0000 7f3f3efe5b80 1 -- 172.21.15.146:0/2991710432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7b42a4ae0 msgr2=0x55e7b4259e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.798+0000 7f3f3efe5b80 1 --2- 172.21.15.146:0/2991710432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7b42a4ae0 0x55e7b4259e10 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f3f2800c010 tx=0x7f3f28020070 comp rx=0 tx=0).stop 2023-10-06T11:14:47.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.798+0000 7f3f3efe5b80 1 -- 172.21.15.146:0/2991710432 shutdown_connections 2023-10-06T11:14:47.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.798+0000 7f3f3efe5b80 1 --2- 172.21.15.146:0/2991710432 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x55e7b42bcf60 0x55e7b4309760 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.798+0000 7f3f3efe5b80 1 --2- 172.21.15.146:0/2991710432 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e7b42a4ae0 0x55e7b4259e10 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.798+0000 7f3f3efe5b80 1 --2- 172.21.15.146:0/2991710432 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e7b425ec20 0x55e7b429e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.798+0000 7f3f3efe5b80 1 --2- 172.21.15.146:0/2991710432 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e7b42609f0 0x55e7b42598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.798+0000 7f3f0dffb700 0 client.8448 ms_handle_reset on v2:172.21.15.146:6835/409226151 2023-10-06T11:14:47.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.798+0000 7f3f3efe5b80 1 -- 172.21.15.146:0/2991710432 >> 172.21.15.146:0/2991710432 conn(0x55e7b425f0c0 msgr2=0x55e7b42a3570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:47.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.798+0000 7f3f3efe5b80 1 -- 172.21.15.146:0/2991710432 shutdown_connections 2023-10-06T11:14:47.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.798+0000 7f3f3efe5b80 1 -- 172.21.15.146:0/2991710432 wait complete. 2023-10-06T11:14:47.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.798+0000 7f3f3efe5b80 20 client.8448 trim_cache size 0 max 16384 2023-10-06T11:14:47.808 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:14:47.808 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0 2023-10-06T11:14:47.808 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:14:47.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.798+0000 7f3f35ced700 1 -- 172.21.15.146:0/2114720935 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3f1c066f30 msgr2=0x7f3f1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.798+0000 7f3f35ced700 1 --2- 172.21.15.146:0/2114720935 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3f1c066f30 0x7f3f1c0693e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f3f20001360 tx=0x7f3f20009040 comp rx=0 tx=0).stop 2023-10-06T11:14:47.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.798+0000 7f3f35ced700 1 -- 172.21.15.146:0/2114720935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f300cb950 msgr2=0x7f3f300b3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.798+0000 7f3f35ced700 1 --2- 172.21.15.146:0/2114720935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f300cb950 0x7f3f300b3f50 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f3f2400d890 tx=0x7f3f24008040 comp rx=0 tx=0).stop 2023-10-06T11:14:47.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.798+0000 7f3f35ced700 1 -- 172.21.15.146:0/2114720935 shutdown_connections 2023-10-06T11:14:47.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.798+0000 7f3f35ced700 1 --2- 172.21.15.146:0/2114720935 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3f1c066f30 0x7f3f1c0693e0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.798+0000 7f3f35ced700 1 --2- 172.21.15.146:0/2114720935 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3f3015a160 0x7f3f300b4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.798+0000 7f3f35ced700 1 --2- 172.21.15.146:0/2114720935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f300ae730 0x7f3f30159390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.798+0000 7f3f35ced700 1 --2- 172.21.15.146:0/2114720935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3f300cb950 0x7f3f300b3f50 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.798+0000 7f3f35ced700 1 -- 172.21.15.146:0/2114720935 >> 172.21.15.146:0/2114720935 conn(0x7f3f3006f380 msgr2=0x7f3f300cf060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:47.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.798+0000 7f3f35ced700 1 -- 172.21.15.146:0/2114720935 shutdown_connections 2023-10-06T11:14:47.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.798+0000 7f3f35ced700 1 -- 172.21.15.146:0/2114720935 wait complete. 2023-10-06T11:14:47.812 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 scrub status 2023-10-06T11:14:47.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.927+0000 7f007438a700 1 Processor -- start 2023-10-06T11:14:47.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.927+0000 7f007438a700 1 -- start start 2023-10-06T11:14:47.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.928+0000 7f007438a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f006c15a160 0x7f006c0c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.928+0000 7f007438a700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f006c0cb950 0x7f006c0cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.928+0000 7f007438a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f006c0ae2a0 con 0x7f006c0ae730 2023-10-06T11:14:47.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.928+0000 7f007438a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f006c15a530 con 0x7f006c15a160 2023-10-06T11:14:47.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.928+0000 7f007438a700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f006c0ad690 con 0x7f006c0cb950 2023-10-06T11:14:47.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.928+0000 7f0072126700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f006c15a160 0x7f006c0c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.928+0000 7f0071925700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f006c0ae730 0x7f006c0aebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45350/0 (socket says 172.21.15.146:45350) 2023-10-06T11:14:47.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.928+0000 7f0071925700 1 -- 172.21.15.146:0/3930690657 learned_addr learned my addr 172.21.15.146:0/3930690657 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:14:47.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.929+0000 7f0072927700 1 --2- 172.21.15.146:0/3930690657 >> v2:172.21.15.151:3300/0 conn(0x7f006c0cb950 0x7f006c0cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.929+0000 7f0072126700 1 -- 172.21.15.146:0/3930690657 >> v2:172.21.15.151:3300/0 conn(0x7f006c0cb950 msgr2=0x7f006c0cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:47.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.929+0000 7f0072126700 1 --2- 172.21.15.146:0/3930690657 >> v2:172.21.15.151:3300/0 conn(0x7f006c0cb950 0x7f006c0cbd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.929+0000 7f0072126700 1 -- 172.21.15.146:0/3930690657 >> v1:172.21.15.146:6789/0 conn(0x7f006c0ae730 legacy=0x7f006c0aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.929+0000 7f0072126700 1 -- 172.21.15.146:0/3930690657 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006c0ad970 con 0x7f006c15a160 2023-10-06T11:14:47.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.929+0000 7f0071124700 1 -- 172.21.15.146:0/3930690657 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4005682416 0 0) 0x7f006c0ae2a0 con 0x7f006c0ae730 2023-10-06T11:14:47.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.929+0000 7f0072126700 1 --2- 172.21.15.146:0/3930690657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f006c15a160 0x7f006c0c55a0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f006c0890e0 tx=0x7f005c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bebaf5e8cde4212f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:47.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.929+0000 7f0071124700 1 -- 172.21.15.146:0/3930690657 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c00e070 con 0x7f006c15a160 2023-10-06T11:14:47.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.929+0000 7f0071124700 1 -- 172.21.15.146:0/3930690657 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005c00bc30 con 0x7f006c15a160 2023-10-06T11:14:47.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.929+0000 7f0071124700 1 -- 172.21.15.146:0/3930690657 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c012430 con 0x7f006c15a160 2023-10-06T11:14:47.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.929+0000 7f007438a700 1 -- 172.21.15.146:0/3930690657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f006c15a160 msgr2=0x7f006c0c55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.929+0000 7f007438a700 1 --2- 172.21.15.146:0/3930690657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f006c15a160 0x7f006c0c55a0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f006c0890e0 tx=0x7f005c009780 comp rx=0 tx=0).stop 2023-10-06T11:14:47.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.930+0000 7f007438a700 1 -- 172.21.15.146:0/3930690657 shutdown_connections 2023-10-06T11:14:47.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.930+0000 7f007438a700 1 --2- 172.21.15.146:0/3930690657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f006c15a160 0x7f006c0c55a0 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.930+0000 7f007438a700 1 --2- 172.21.15.146:0/3930690657 >> v2:172.21.15.151:3300/0 conn(0x7f006c0cb950 0x7f006c0cbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.930+0000 7f007438a700 1 -- 172.21.15.146:0/3930690657 >> 172.21.15.146:0/3930690657 conn(0x7f006c06f380 msgr2=0x7f006c0d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:47.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.930+0000 7f007438a700 1 -- 172.21.15.146:0/3930690657 shutdown_connections 2023-10-06T11:14:47.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.930+0000 7f007438a700 1 -- 172.21.15.146:0/3930690657 wait complete. 2023-10-06T11:14:47.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.931+0000 7f007438a700 1 Processor -- start 2023-10-06T11:14:47.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.931+0000 7f007438a700 1 -- start start 2023-10-06T11:14:47.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.931+0000 7f007438a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f006c0ae730 0x7f006c16da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.931+0000 7f007438a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f006c0cb950 0x7f006c15c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.931+0000 7f007438a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f006c15a160 0x7f006c144410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.931+0000 7f007438a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f006c0b5560 con 0x7f006c0ae730 2023-10-06T11:14:47.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.931+0000 7f007438a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f006c0b4950 con 0x7f006c15a160 2023-10-06T11:14:47.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.931+0000 7f007438a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f006c0b4c30 con 0x7f006c0cb950 2023-10-06T11:14:47.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.931+0000 7f0072126700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f006c0ae730 0x7f006c16da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.931+0000 7f0072126700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f006c0ae730 0x7f006c16da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39642/0 (socket says 172.21.15.146:39642) 2023-10-06T11:14:47.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.932+0000 7f0072126700 1 -- 172.21.15.146:0/138890378 learned_addr learned my addr 172.21.15.146:0/138890378 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:47.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.932+0000 7f0072927700 1 --2- 172.21.15.146:0/138890378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f006c15a160 0x7f006c144410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.932+0000 7f0071925700 1 --2- 172.21.15.146:0/138890378 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f006c0cb950 0x7f006c15c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.932+0000 7f0072126700 1 -- 172.21.15.146:0/138890378 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f006c0cb950 msgr2=0x7f006c15c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.932+0000 7f0072126700 1 --2- 172.21.15.146:0/138890378 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f006c0cb950 0x7f006c15c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.932+0000 7f0072126700 1 -- 172.21.15.146:0/138890378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f006c15a160 msgr2=0x7f006c144410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.932+0000 7f0072126700 1 --2- 172.21.15.146:0/138890378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f006c15a160 0x7f006c144410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.932+0000 7f0072126700 1 -- 172.21.15.146:0/138890378 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f005c009a20 con 0x7f006c0ae730 2023-10-06T11:14:47.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.932+0000 7f0072927700 1 --2- 172.21.15.146:0/138890378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f006c15a160 0x7f006c144410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:47.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.932+0000 7f0072126700 1 --2- 172.21.15.146:0/138890378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f006c0ae730 0x7f006c16da00 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f005c012580 tx=0x7f005c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:47.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.932+0000 7f006a7fc700 1 -- 172.21.15.146:0/138890378 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c027470 con 0x7f006c0ae730 2023-10-06T11:14:47.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.932+0000 7f006a7fc700 1 -- 172.21.15.146:0/138890378 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005c027610 con 0x7f006c0ae730 2023-10-06T11:14:47.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.932+0000 7f006a7fc700 1 -- 172.21.15.146:0/138890378 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c0279d0 con 0x7f006c0ae730 2023-10-06T11:14:47.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.932+0000 7f007438a700 1 -- 172.21.15.146:0/138890378 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f006c0b4f10 con 0x7f006c0ae730 2023-10-06T11:14:47.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.932+0000 7f007438a700 1 -- 172.21.15.146:0/138890378 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f006c0b45e0 con 0x7f006c0ae730 2023-10-06T11:14:47.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.933+0000 7f006a7fc700 1 -- 172.21.15.146:0/138890378 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f005c024070 con 0x7f006c0ae730 2023-10-06T11:14:47.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.934+0000 7f006a7fc700 1 --2- 172.21.15.146:0/138890378 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0058066f30 0x7f00580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.934+0000 7f006a7fc700 1 -- 172.21.15.146:0/138890378 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f005c086e60 con 0x7f006c0ae730 2023-10-06T11:14:47.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.934+0000 7f0071925700 1 --2- 172.21.15.146:0/138890378 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0058066f30 0x7f00580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.934+0000 7f0071925700 1 --2- 172.21.15.146:0/138890378 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0058066f30 0x7f00580693e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f006c15fba0 tx=0x7f0060009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:47.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.936+0000 7f007d682b80 1 Processor -- start 2023-10-06T11:14:47.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.936+0000 7f007d682b80 1 -- start start 2023-10-06T11:14:47.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.937+0000 7f007d682b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560eaee49ae0 0x560eaee49eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.937+0000 7f007d682b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560eaee059f0 0x560eaee025d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.937+0000 7f007d682b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560eaee03c20 0x560eaee02b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.937+0000 7f007d682b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x560eaed82cd0 con 0x560eaee49ae0 2023-10-06T11:14:47.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.937+0000 7f007d682b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x560eaed59ac0 con 0x560eaee059f0 2023-10-06T11:14:47.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.937+0000 7f007d682b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x560eaed572c0 con 0x560eaee03c20 2023-10-06T11:14:47.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.937+0000 7f0072126700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560eaee49ae0 0x560eaee49eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.937+0000 7f0072126700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560eaee49ae0 0x560eaee49eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39644/0 (socket says 172.21.15.146:39644) 2023-10-06T11:14:47.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.937+0000 7f0072126700 1 -- 172.21.15.146:0/712859601 learned_addr learned my addr 172.21.15.146:0/712859601 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:47.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.937+0000 7f0072927700 1 --2- 172.21.15.146:0/712859601 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560eaee03c20 0x560eaee02b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.937+0000 7f0071925700 1 --2- 172.21.15.146:0/712859601 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560eaee059f0 0x560eaee025d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.937+0000 7f0072126700 1 -- 172.21.15.146:0/712859601 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560eaee03c20 msgr2=0x560eaee02b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:47.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.937+0000 7f0072126700 1 --2- 172.21.15.146:0/712859601 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560eaee03c20 0x560eaee02b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.937+0000 7f0072126700 1 -- 172.21.15.146:0/712859601 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560eaee059f0 msgr2=0x560eaee025d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:47.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.937+0000 7f0072126700 1 --2- 172.21.15.146:0/712859601 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560eaee059f0 0x560eaee025d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.937+0000 7f0072126700 1 -- 172.21.15.146:0/712859601 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560eaebed2c0 con 0x560eaee49ae0 2023-10-06T11:14:47.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.937+0000 7f0072126700 1 --2- 172.21.15.146:0/712859601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560eaee49ae0 0x560eaee49eb0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f005c02d030 tx=0x7f005c020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd9bda982fec5b54 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:47.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.937+0000 7f00537fe700 1 -- 172.21.15.146:0/712859601 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c00e070 con 0x560eaee49ae0 2023-10-06T11:14:47.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.937+0000 7f00537fe700 1 -- 172.21.15.146:0/712859601 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005c058290 con 0x560eaee49ae0 2023-10-06T11:14:47.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.937+0000 7f00537fe700 1 -- 172.21.15.146:0/712859601 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c057b90 con 0x560eaee49ae0 2023-10-06T11:14:47.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.938+0000 7f007d682b80 1 -- 172.21.15.146:0/712859601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560eaee49ae0 msgr2=0x560eaee49eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.938+0000 7f007d682b80 1 --2- 172.21.15.146:0/712859601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560eaee49ae0 0x560eaee49eb0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f005c02d030 tx=0x7f005c020040 comp rx=0 tx=0).stop 2023-10-06T11:14:47.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.938+0000 7f007d682b80 1 -- 172.21.15.146:0/712859601 shutdown_connections 2023-10-06T11:14:47.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.938+0000 7f007d682b80 1 --2- 172.21.15.146:0/712859601 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560eaee03c20 0x560eaee02b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.938+0000 7f007d682b80 1 --2- 172.21.15.146:0/712859601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560eaee49ae0 0x560eaee49eb0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.938+0000 7f007d682b80 1 --2- 172.21.15.146:0/712859601 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560eaee059f0 0x560eaee025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.938+0000 7f007d682b80 1 -- 172.21.15.146:0/712859601 >> 172.21.15.146:0/712859601 conn(0x560eaee040c0 msgr2=0x560eaee04490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:47.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.938+0000 7f007d682b80 1 -- 172.21.15.146:0/712859601 shutdown_connections 2023-10-06T11:14:47.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.938+0000 7f007d682b80 1 -- 172.21.15.146:0/712859601 wait complete. 2023-10-06T11:14:47.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.939+0000 7f007d682b80 1 -- start start 2023-10-06T11:14:47.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.939+0000 7f007d682b80 1 Processor -- start 2023-10-06T11:14:47.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.940+0000 7f007d682b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560eaee03c20 0x560eaee431f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.940+0000 7f007d682b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560eaee059f0 0x560eaee469c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.940+0000 7f007d682b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560eaee49ae0 0x560eaedfd790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.940+0000 7f007d682b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x560eaed530b0 con 0x560eaee03c20 2023-10-06T11:14:47.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.940+0000 7f007d682b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x560eaecfe8e0 con 0x560eaee059f0 2023-10-06T11:14:47.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.940+0000 7f007d682b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x560eaed19ef0 con 0x560eaee49ae0 2023-10-06T11:14:47.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.940+0000 7f007d682b80 10 client.0 _ll_register_callbacks cb 0x560eaebeff80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:14:47.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.940+0000 7f0072126700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560eaee03c20 0x560eaee431f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.940+0000 7f0072126700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560eaee03c20 0x560eaee431f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39660/0 (socket says 172.21.15.146:39660) 2023-10-06T11:14:47.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.940+0000 7f0072126700 1 -- 172.21.15.146:0/3587497368 learned_addr learned my addr 172.21.15.146:0/3587497368 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:47.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.940+0000 7f0071925700 1 --2- 172.21.15.146:0/3587497368 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560eaee059f0 0x560eaee469c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.940+0000 7f0072927700 1 --2- 172.21.15.146:0/3587497368 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560eaee49ae0 0x560eaedfd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.940+0000 7f0072126700 1 -- 172.21.15.146:0/3587497368 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560eaee49ae0 msgr2=0x560eaedfd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:47.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.940+0000 7f0072126700 1 --2- 172.21.15.146:0/3587497368 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560eaee49ae0 0x560eaedfd790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.940+0000 7f0072126700 1 -- 172.21.15.146:0/3587497368 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560eaee059f0 msgr2=0x560eaee469c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:47.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.940+0000 7f0072126700 1 --2- 172.21.15.146:0/3587497368 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560eaee059f0 0x560eaee469c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.940+0000 7f0072126700 1 -- 172.21.15.146:0/3587497368 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f006c0b45e0 con 0x560eaee03c20 2023-10-06T11:14:47.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.940+0000 7f0072126700 1 --2- 172.21.15.146:0/3587497368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560eaee03c20 0x560eaee431f0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f005c054090 tx=0x7f005c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=129f97370c832fa7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:47.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.940+0000 7f0050ff9700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:14:47.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.940+0000 7f0050ff9700 1 -- 172.21.15.146:0/3587497368 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c05eb30 con 0x560eaee03c20 2023-10-06T11:14:47.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.940+0000 7f0050ff9700 1 -- 172.21.15.146:0/3587497368 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f005c057b90 con 0x560eaee03c20 2023-10-06T11:14:47.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.940+0000 7f007d682b80 1 -- 172.21.15.146:0/3587497368 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560eaedf76e0 con 0x560eaee03c20 2023-10-06T11:14:47.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.940+0000 7f0050ff9700 1 -- 172.21.15.146:0/3587497368 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) v2 ==== 24+0+0 (secure 0 0 0) 0x7f005c05e8b0 con 0x560eaee03c20 2023-10-06T11:14:47.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.940+0000 7f007d682b80 10 client.8463 fetch_fsmap learned FSMap version 100 2023-10-06T11:14:47.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.940+0000 7f007d682b80 1 -- 172.21.15.146:0/3587497368 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) v3 -- 0x560eaeb90030 con 0x560eaee03c20 2023-10-06T11:14:47.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.941+0000 7f0050ff9700 1 -- 172.21.15.146:0/3587497368 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560eaedf76e0 con 0x560eaee03c20 2023-10-06T11:14:47.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.941+0000 7f0050ff9700 1 -- 172.21.15.146:0/3587497368 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 100) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f005c058ba0 con 0x560eaee03c20 2023-10-06T11:14:47.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.941+0000 7f007d682b80 10 client.8463 fetch_fsmap finished waiting for FSMap version 100 2023-10-06T11:14:47.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.941+0000 7f007d682b80 10 client.8463 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2023-10-06T11:14:47.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.941+0000 7f007d682b80 20 client.8463 populate_metadata read hostname 'smithi146' 2023-10-06T11:14:47.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.941+0000 7f007d682b80 1 --2- 172.21.15.146:0/3587497368 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x560eaee44e00 0x560eaee025d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.941+0000 7f007d682b80 4 client.8463 mds_command: new command op to 8103 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:14:47.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.941+0000 7f007d682b80 1 -- 172.21.15.146:0/3587497368 --> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560eaedd4610 con 0x560eaee44e00 2023-10-06T11:14:47.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.941+0000 7f0071925700 1 --2- 172.21.15.146:0/3587497368 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x560eaee44e00 0x560eaee025d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.941+0000 7f0050ff9700 10 client.8463 ms_handle_connect on v2:172.21.15.146:6835/409226151 2023-10-06T11:14:47.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.941+0000 7f0071925700 1 --2- 172.21.15.146:0/3587497368 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x560eaee44e00 0x560eaee025d0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=847651c2560c3b7e server_cookie=7d7c77def7538c6c in_seq=0 out_seq=0 2023-10-06T11:14:47.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.942+0000 7f0050ff9700 1 -- 172.21.15.146:0/3587497368 <== mds.0 v2:172.21.15.146:6835/409226151 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x560eaedd4610 con 0x560eaee44e00 2023-10-06T11:14:47.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.942+0000 7f0050ff9700 10 client.8463 handle_command_reply: tid=0 2023-10-06T11:14:47.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.942+0000 7f007d682b80 1 client.8463 shutdown 2023-10-06T11:14:47.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.942+0000 7f007d682b80 1 -- 172.21.15.146:0/3587497368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560eaee03c20 msgr2=0x560eaee431f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.942+0000 7f007d682b80 1 --2- 172.21.15.146:0/3587497368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560eaee03c20 0x560eaee431f0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f005c054090 tx=0x7f005c02c000 comp rx=0 tx=0).stop 2023-10-06T11:14:47.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.942+0000 7f007d682b80 1 -- 172.21.15.146:0/3587497368 shutdown_connections 2023-10-06T11:14:47.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.942+0000 7f007d682b80 1 --2- 172.21.15.146:0/3587497368 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x560eaee44e00 0x560eaee025d0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.942+0000 7f007d682b80 1 --2- 172.21.15.146:0/3587497368 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560eaee49ae0 0x560eaedfd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.942+0000 7f007d682b80 1 --2- 172.21.15.146:0/3587497368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560eaee03c20 0x560eaee431f0 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.942+0000 7f0050ff9700 0 client.8463 ms_handle_reset on v2:172.21.15.146:6835/409226151 2023-10-06T11:14:47.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.942+0000 7f007d682b80 1 --2- 172.21.15.146:0/3587497368 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560eaee059f0 0x560eaee469c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.942+0000 7f007d682b80 1 -- 172.21.15.146:0/3587497368 >> 172.21.15.146:0/3587497368 conn(0x560eaee040c0 msgr2=0x560eaee49030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:47.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.942+0000 7f007d682b80 1 -- 172.21.15.146:0/3587497368 shutdown_connections 2023-10-06T11:14:47.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.942+0000 7f007d682b80 1 -- 172.21.15.146:0/3587497368 wait complete. 2023-10-06T11:14:47.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.942+0000 7f007d682b80 20 client.8463 trim_cache size 0 max 16384 2023-10-06T11:14:47.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.958+0000 7f007d682b80 1 Processor -- start 2023-10-06T11:14:47.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.958+0000 7f007d682b80 1 -- start start 2023-10-06T11:14:47.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.958+0000 7f007d682b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560eaee03c20 0x560eaee04490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.958+0000 7f007d682b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560eaee059f0 0x560eaee433c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.958+0000 7f007d682b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560eaee49ae0 0x560eaee47200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.958+0000 7f007d682b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x560eaebd5e80 con 0x560eaee49ae0 2023-10-06T11:14:47.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.958+0000 7f007d682b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x560eaee01a80 con 0x560eaee03c20 2023-10-06T11:14:47.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.958+0000 7f007d682b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x560eaedfd110 con 0x560eaee059f0 2023-10-06T11:14:47.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.959+0000 7f0072927700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560eaee49ae0 0x560eaee47200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.959+0000 7f0072927700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560eaee49ae0 0x560eaee47200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39664/0 (socket says 172.21.15.146:39664) 2023-10-06T11:14:47.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.959+0000 7f0072927700 1 -- 172.21.15.146:0/2909105314 learned_addr learned my addr 172.21.15.146:0/2909105314 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:47.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.959+0000 7f0072126700 1 --2- 172.21.15.146:0/2909105314 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560eaee03c20 0x560eaee04490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.959+0000 7f0071925700 1 --2- 172.21.15.146:0/2909105314 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560eaee059f0 0x560eaee433c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.959+0000 7f0072927700 1 -- 172.21.15.146:0/2909105314 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560eaee059f0 msgr2=0x560eaee433c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:47.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.959+0000 7f0072927700 1 --2- 172.21.15.146:0/2909105314 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560eaee059f0 0x560eaee433c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.959+0000 7f0072927700 1 -- 172.21.15.146:0/2909105314 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560eaee03c20 msgr2=0x560eaee04490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:47.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.959+0000 7f0072927700 1 --2- 172.21.15.146:0/2909105314 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560eaee03c20 0x560eaee04490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.959+0000 7f0072927700 1 -- 172.21.15.146:0/2909105314 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560eaed217d0 con 0x560eaee49ae0 2023-10-06T11:14:47.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.959+0000 7f0072126700 1 --2- 172.21.15.146:0/2909105314 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560eaee03c20 0x560eaee04490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:47.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.959+0000 7f0072927700 1 --2- 172.21.15.146:0/2909105314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560eaee49ae0 0x560eaee47200 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f0064007b60 tx=0x7f0064008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80338aa0eed882f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:47.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.959+0000 7f0053fff700 1 -- 172.21.15.146:0/2909105314 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0064015930 con 0x560eaee49ae0 2023-10-06T11:14:47.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.959+0000 7f0053fff700 1 -- 172.21.15.146:0/2909105314 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0064015a90 con 0x560eaee49ae0 2023-10-06T11:14:47.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.959+0000 7f0053fff700 1 -- 172.21.15.146:0/2909105314 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0064015e10 con 0x560eaee49ae0 2023-10-06T11:14:47.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.960+0000 7f007d682b80 1 -- 172.21.15.146:0/2909105314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560eaee49ae0 msgr2=0x560eaee47200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.960+0000 7f007d682b80 1 --2- 172.21.15.146:0/2909105314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560eaee49ae0 0x560eaee47200 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f0064007b60 tx=0x7f0064008040 comp rx=0 tx=0).stop 2023-10-06T11:14:47.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.960+0000 7f007d682b80 1 -- 172.21.15.146:0/2909105314 shutdown_connections 2023-10-06T11:14:47.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.960+0000 7f007d682b80 1 --2- 172.21.15.146:0/2909105314 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560eaee49ae0 0x560eaee47200 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.960+0000 7f007d682b80 1 --2- 172.21.15.146:0/2909105314 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560eaee03c20 0x560eaee04490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.960+0000 7f007d682b80 1 --2- 172.21.15.146:0/2909105314 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560eaee059f0 0x560eaee433c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.960+0000 7f007d682b80 1 -- 172.21.15.146:0/2909105314 >> 172.21.15.146:0/2909105314 conn(0x560eaee040c0 msgr2=0x560eaee005a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:47.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.960+0000 7f007d682b80 1 -- 172.21.15.146:0/2909105314 shutdown_connections 2023-10-06T11:14:47.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.960+0000 7f007d682b80 1 -- 172.21.15.146:0/2909105314 wait complete. 2023-10-06T11:14:47.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.960+0000 7f007d682b80 1 -- start start 2023-10-06T11:14:47.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.960+0000 7f007d682b80 1 Processor -- start 2023-10-06T11:14:47.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.961+0000 7f007d682b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560eaee03c20 0x560eaee2d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.961+0000 7f007d682b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560eaee059f0 0x560eaeeaf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.961+0000 7f007d682b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560eaee49ae0 0x560eaee3f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.961+0000 7f007d682b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x560eaee02ee0 con 0x560eaee059f0 2023-10-06T11:14:47.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.961+0000 7f007d682b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x560eaee3fec0 con 0x560eaee49ae0 2023-10-06T11:14:47.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.961+0000 7f007d682b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x560eaee026d0 con 0x560eaee03c20 2023-10-06T11:14:47.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.961+0000 7f007d682b80 10 client.0 _ll_register_callbacks cb 0x560eaebeff80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:14:47.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.961+0000 7f0071925700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560eaee059f0 0x560eaeeaf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.961+0000 7f0071925700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560eaee059f0 0x560eaeeaf1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39666/0 (socket says 172.21.15.146:39666) 2023-10-06T11:14:47.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.961+0000 7f0071925700 1 -- 172.21.15.146:0/4283302490 learned_addr learned my addr 172.21.15.146:0/4283302490 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:47.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.961+0000 7f0072126700 1 --2- 172.21.15.146:0/4283302490 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560eaee03c20 0x560eaee2d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.961+0000 7f0072927700 1 --2- 172.21.15.146:0/4283302490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560eaee49ae0 0x560eaee3f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.962+0000 7f0071925700 1 -- 172.21.15.146:0/4283302490 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560eaee03c20 msgr2=0x560eaee2d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:47.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.962+0000 7f0071925700 1 --2- 172.21.15.146:0/4283302490 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560eaee03c20 0x560eaee2d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.962+0000 7f0071925700 1 -- 172.21.15.146:0/4283302490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560eaee49ae0 msgr2=0x560eaee3f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:47.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.962+0000 7f0071925700 1 --2- 172.21.15.146:0/4283302490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560eaee49ae0 0x560eaee3f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.962+0000 7f0071925700 1 -- 172.21.15.146:0/4283302490 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f006400e040 con 0x560eaee059f0 2023-10-06T11:14:47.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.962+0000 7f0071925700 1 --2- 172.21.15.146:0/4283302490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560eaee059f0 0x560eaeeaf1a0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f006c0ca9b0 tx=0x7f0060015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aedd1866af6841af server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:47.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.962+0000 7f0050ff9700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:14:47.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.962+0000 7f0050ff9700 1 -- 172.21.15.146:0/4283302490 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006000ea90 con 0x560eaee059f0 2023-10-06T11:14:47.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.962+0000 7f0050ff9700 1 -- 172.21.15.146:0/4283302490 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f006000ebf0 con 0x560eaee059f0 2023-10-06T11:14:47.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.962+0000 7f007d682b80 1 -- 172.21.15.146:0/4283302490 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f005c058290 con 0x560eaee059f0 2023-10-06T11:14:47.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.962+0000 7f0050ff9700 1 -- 172.21.15.146:0/4283302490 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) v2 ==== 24+0+0 (secure 0 0 0) 0x7f006000edb0 con 0x560eaee059f0 2023-10-06T11:14:47.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.962+0000 7f007d682b80 10 client.8469 fetch_fsmap learned FSMap version 100 2023-10-06T11:14:47.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.962+0000 7f007d682b80 1 -- 172.21.15.146:0/4283302490 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=2+}) v3 -- 0x560eaed084c0 con 0x560eaee059f0 2023-10-06T11:14:47.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.962+0000 7f0050ff9700 1 -- 172.21.15.146:0/4283302490 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005c058290 con 0x560eaee059f0 2023-10-06T11:14:47.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.962+0000 7f0050ff9700 1 -- 172.21.15.146:0/4283302490 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 100) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f00600265b0 con 0x560eaee059f0 2023-10-06T11:14:47.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.962+0000 7f007d682b80 10 client.8469 fetch_fsmap finished waiting for FSMap version 100 2023-10-06T11:14:47.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.962+0000 7f007d682b80 10 client.8469 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.c 2023-10-06T11:14:47.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.962+0000 7f007d682b80 20 client.8469 populate_metadata read hostname 'smithi146' 2023-10-06T11:14:47.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.962+0000 7f007d682b80 1 --2- 172.21.15.146:0/4283302490 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x560eaee28ee0 0x560eaee2b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:47.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.962+0000 7f007d682b80 4 client.8469 mds_command: new command op to 8103 tid=0[{"prefix": "scrub status"}] 2023-10-06T11:14:47.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.962+0000 7f007d682b80 1 -- 172.21.15.146:0/4283302490 --> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560eaecf5e50 con 0x560eaee28ee0 2023-10-06T11:14:47.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.962+0000 7f0072126700 1 --2- 172.21.15.146:0/4283302490 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x560eaee28ee0 0x560eaee2b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:47.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.963+0000 7f0050ff9700 10 client.8469 ms_handle_connect on v2:172.21.15.146:6835/409226151 2023-10-06T11:14:47.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.963+0000 7f0072126700 1 --2- 172.21.15.146:0/4283302490 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x560eaee28ee0 0x560eaee2b230 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14d44ebfa9ab18df server_cookie=91d303c4a1ef056c in_seq=0 out_seq=0 2023-10-06T11:14:47.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.963+0000 7f0050ff9700 1 -- 172.21.15.146:0/4283302490 <== mds.0 v2:172.21.15.146:6835/409226151 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x560eaecf5e50 con 0x560eaee28ee0 2023-10-06T11:14:47.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.963+0000 7f0050ff9700 10 client.8469 handle_command_reply: tid=0 2023-10-06T11:14:47.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.963+0000 7f007d682b80 1 client.8469 shutdown 2023-10-06T11:14:47.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.963+0000 7f007d682b80 1 -- 172.21.15.146:0/4283302490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560eaee059f0 msgr2=0x560eaeeaf1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.963+0000 7f007d682b80 1 --2- 172.21.15.146:0/4283302490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560eaee059f0 0x560eaeeaf1a0 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f006c0ca9b0 tx=0x7f0060015040 comp rx=0 tx=0).stop 2023-10-06T11:14:47.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.963+0000 7f007d682b80 1 -- 172.21.15.146:0/4283302490 shutdown_connections 2023-10-06T11:14:47.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.963+0000 7f007d682b80 1 --2- 172.21.15.146:0/4283302490 >> [v2:172.21.15.146:6835/409226151,v1:172.21.15.146:6837/409226151] conn(0x560eaee28ee0 0x560eaee2b230 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.963+0000 7f007d682b80 1 --2- 172.21.15.146:0/4283302490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560eaee49ae0 0x560eaee3f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.963+0000 7f007d682b80 1 --2- 172.21.15.146:0/4283302490 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x560eaee03c20 0x560eaee2d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.963+0000 7f0050ff9700 0 client.8469 ms_handle_reset on v2:172.21.15.146:6835/409226151 2023-10-06T11:14:47.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.963+0000 7f007d682b80 1 --2- 172.21.15.146:0/4283302490 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x560eaee059f0 0x560eaeeaf1a0 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.963+0000 7f007d682b80 1 -- 172.21.15.146:0/4283302490 >> 172.21.15.146:0/4283302490 conn(0x560eaee040c0 msgr2=0x560eaee48d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:47.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.963+0000 7f007d682b80 1 -- 172.21.15.146:0/4283302490 shutdown_connections 2023-10-06T11:14:47.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.963+0000 7f007d682b80 1 -- 172.21.15.146:0/4283302490 wait complete. 2023-10-06T11:14:47.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.963+0000 7f007d682b80 20 client.8469 trim_cache size 0 max 16384 2023-10-06T11:14:47.973 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:14:47.973 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "no active scrubs running", 2023-10-06T11:14:47.973 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": {} 2023-10-06T11:14:47.973 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:14:47.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.964+0000 7f007438a700 1 -- 172.21.15.146:0/138890378 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0058066f30 msgr2=0x7f00580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.964+0000 7f007438a700 1 --2- 172.21.15.146:0/138890378 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0058066f30 0x7f00580693e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f006c15fba0 tx=0x7f0060009040 comp rx=0 tx=0).stop 2023-10-06T11:14:47.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.964+0000 7f007438a700 1 -- 172.21.15.146:0/138890378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f006c0ae730 msgr2=0x7f006c16da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:47.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.964+0000 7f007438a700 1 --2- 172.21.15.146:0/138890378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f006c0ae730 0x7f006c16da00 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f005c012580 tx=0x7f005c019000 comp rx=0 tx=0).stop 2023-10-06T11:14:47.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.964+0000 7f007438a700 1 -- 172.21.15.146:0/138890378 shutdown_connections 2023-10-06T11:14:47.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.964+0000 7f007438a700 1 --2- 172.21.15.146:0/138890378 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0058066f30 0x7f00580693e0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.964+0000 7f007438a700 1 --2- 172.21.15.146:0/138890378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f006c15a160 0x7f006c144410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.964+0000 7f007438a700 1 --2- 172.21.15.146:0/138890378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f006c0ae730 0x7f006c16da00 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.964+0000 7f007438a700 1 --2- 172.21.15.146:0/138890378 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f006c0cb950 0x7f006c15c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:47.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.964+0000 7f007438a700 1 -- 172.21.15.146:0/138890378 >> 172.21.15.146:0/138890378 conn(0x7f006c06f380 msgr2=0x7f006c0cbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:47.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.964+0000 7f007438a700 1 -- 172.21.15.146:0/138890378 shutdown_connections 2023-10-06T11:14:47.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:47.964+0000 7f007438a700 1 -- 172.21.15.146:0/138890378 wait complete. 2023-10-06T11:14:47.977 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-06T11:14:47.977 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:14:48.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.090+0000 7f7cc3bd2700 1 Processor -- start 2023-10-06T11:14:48.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.090+0000 7f7cc3bd2700 1 -- start start 2023-10-06T11:14:48.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.090+0000 7f7cc3bd2700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7cbc153ab0 0x7f7cbc15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:48.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.090+0000 7f7cc3bd2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7cbc153e80 0x7f7cbc068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:48.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.090+0000 7f7cc3bd2700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7cbc0689d0 0x7f7cbc15d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:48.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.090+0000 7f7cc3bd2700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cbc15ac30 con 0x7f7cbc153e80 2023-10-06T11:14:48.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.090+0000 7f7cc3bd2700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cbc0b4510 con 0x7f7cbc153ab0 2023-10-06T11:14:48.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.090+0000 7f7cc3bd2700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cbc068e10 con 0x7f7cbc0689d0 2023-10-06T11:14:48.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.091+0000 7f7cc116d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7cbc153e80 0x7f7cbc068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:48.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.091+0000 7f7cc116d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7cbc153e80 0x7f7cbc068490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39670/0 (socket says 172.21.15.146:39670) 2023-10-06T11:14:48.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.091+0000 7f7cc116d700 1 -- 172.21.15.146:0/2915871448 learned_addr learned my addr 172.21.15.146:0/2915871448 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:48.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.091+0000 7f7cc196e700 1 --2- 172.21.15.146:0/2915871448 >> v2:172.21.15.151:3300/0 conn(0x7f7cbc153ab0 0x7f7cbc15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:48.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.091+0000 7f7cc216f700 1 --2- 172.21.15.146:0/2915871448 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7cbc0689d0 0x7f7cbc15d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:48.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.091+0000 7f7cc116d700 1 -- 172.21.15.146:0/2915871448 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7cbc0689d0 msgr2=0x7f7cbc15d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:48.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.091+0000 7f7cc116d700 1 --2- 172.21.15.146:0/2915871448 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7cbc0689d0 0x7f7cbc15d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:48.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.091+0000 7f7cc116d700 1 -- 172.21.15.146:0/2915871448 >> v2:172.21.15.151:3300/0 conn(0x7f7cbc153ab0 msgr2=0x7f7cbc15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:48.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.091+0000 7f7cc116d700 1 --2- 172.21.15.146:0/2915871448 >> v2:172.21.15.151:3300/0 conn(0x7f7cbc153ab0 0x7f7cbc15a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:48.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.091+0000 7f7cc116d700 1 -- 172.21.15.146:0/2915871448 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cbc0b6530 con 0x7f7cbc153e80 2023-10-06T11:14:48.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.091+0000 7f7cc116d700 1 --2- 172.21.15.146:0/2915871448 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cbc153e80 0x7f7cbc068490 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc0b5eb0 tx=0x7f7cac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea996252cdaa661f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:48.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.091+0000 7f7cc096c700 1 -- 172.21.15.146:0/2915871448 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac00b640 con 0x7f7cbc153e80 2023-10-06T11:14:48.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.091+0000 7f7cc096c700 1 -- 172.21.15.146:0/2915871448 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cac00b7a0 con 0x7f7cbc153e80 2023-10-06T11:14:48.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.091+0000 7f7cc096c700 1 -- 172.21.15.146:0/2915871448 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac00bb60 con 0x7f7cbc153e80 2023-10-06T11:14:48.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.092+0000 7f7cc3bd2700 1 -- 172.21.15.146:0/2915871448 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cbc153e80 msgr2=0x7f7cbc068490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:48.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.092+0000 7f7cc3bd2700 1 --2- 172.21.15.146:0/2915871448 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cbc153e80 0x7f7cbc068490 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc0b5eb0 tx=0x7f7cac009250 comp rx=0 tx=0).stop 2023-10-06T11:14:48.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.092+0000 7f7cc3bd2700 1 -- 172.21.15.146:0/2915871448 shutdown_connections 2023-10-06T11:14:48.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.092+0000 7f7cc3bd2700 1 --2- 172.21.15.146:0/2915871448 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7cbc0689d0 0x7f7cbc15d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:48.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.092+0000 7f7cc3bd2700 1 --2- 172.21.15.146:0/2915871448 >> v2:172.21.15.151:3300/0 conn(0x7f7cbc153ab0 0x7f7cbc15a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:48.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.092+0000 7f7cc3bd2700 1 --2- 172.21.15.146:0/2915871448 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cbc153e80 0x7f7cbc068490 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:48.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.092+0000 7f7cc3bd2700 1 -- 172.21.15.146:0/2915871448 >> 172.21.15.146:0/2915871448 conn(0x7f7cbc06eba0 msgr2=0x7f7cbc06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:48.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.092+0000 7f7cc3bd2700 1 -- 172.21.15.146:0/2915871448 shutdown_connections 2023-10-06T11:14:48.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.092+0000 7f7cc3bd2700 1 -- 172.21.15.146:0/2915871448 wait complete. 2023-10-06T11:14:48.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.093+0000 7f7cc3bd2700 1 Processor -- start 2023-10-06T11:14:48.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.093+0000 7f7cc3bd2700 1 -- start start 2023-10-06T11:14:48.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.094+0000 7f7cc3bd2700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7cbc0689d0 0x7f7cbc0cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:48.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.094+0000 7f7cc3bd2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cbc153ab0 0x7f7cbc157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:48.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.094+0000 7f7cc3bd2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cbc153e80 0x7f7cbc158b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:48.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.094+0000 7f7cc3bd2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cbc0cbff0 con 0x7f7cbc153ab0 2023-10-06T11:14:48.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.094+0000 7f7cc3bd2700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cbc1578a0 con 0x7f7cbc153e80 2023-10-06T11:14:48.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.094+0000 7f7cc3bd2700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cbc158270 con 0x7f7cbc0689d0 2023-10-06T11:14:48.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.094+0000 7f7cc116d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cbc153ab0 0x7f7cbc157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:48.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.094+0000 7f7cc116d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cbc153ab0 0x7f7cbc157d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39674/0 (socket says 172.21.15.146:39674) 2023-10-06T11:14:48.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.094+0000 7f7cc116d700 1 -- 172.21.15.146:0/4122460462 learned_addr learned my addr 172.21.15.146:0/4122460462 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:48.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.094+0000 7f7cc196e700 1 --2- 172.21.15.146:0/4122460462 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7cbc0689d0 0x7f7cbc0cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:48.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.094+0000 7f7cc216f700 1 --2- 172.21.15.146:0/4122460462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cbc153e80 0x7f7cbc158b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:48.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.094+0000 7f7cc116d700 1 -- 172.21.15.146:0/4122460462 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7cbc0689d0 msgr2=0x7f7cbc0cbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:48.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.094+0000 7f7cc116d700 1 --2- 172.21.15.146:0/4122460462 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7cbc0689d0 0x7f7cbc0cbab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:48.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.094+0000 7f7cc116d700 1 -- 172.21.15.146:0/4122460462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cbc153e80 msgr2=0x7f7cbc158b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:48.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.094+0000 7f7cc116d700 1 --2- 172.21.15.146:0/4122460462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cbc153e80 0x7f7cbc158b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:48.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.094+0000 7f7cc116d700 1 -- 172.21.15.146:0/4122460462 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cac0094f0 con 0x7f7cbc153ab0 2023-10-06T11:14:48.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.094+0000 7f7cc116d700 1 --2- 172.21.15.146:0/4122460462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cbc153ab0 0x7f7cbc157d30 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc089010 tx=0x7f7cac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:48.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.094+0000 7f7cb1ffb700 1 -- 172.21.15.146:0/4122460462 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac000d10 con 0x7f7cbc153ab0 2023-10-06T11:14:48.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.095+0000 7f7cb1ffb700 1 -- 172.21.15.146:0/4122460462 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cac00bb20 con 0x7f7cbc153ab0 2023-10-06T11:14:48.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.095+0000 7f7cc3bd2700 1 -- 172.21.15.146:0/4122460462 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cbc156c90 con 0x7f7cbc153ab0 2023-10-06T11:14:48.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.095+0000 7f7cb1ffb700 1 -- 172.21.15.146:0/4122460462 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cac011670 con 0x7f7cbc153ab0 2023-10-06T11:14:48.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.095+0000 7f7cc3bd2700 1 -- 172.21.15.146:0/4122460462 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cbc157250 con 0x7f7cbc153ab0 2023-10-06T11:14:48.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.096+0000 7f7cc3bd2700 1 -- 172.21.15.146:0/4122460462 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cbc04c380 con 0x7f7cbc153ab0 2023-10-06T11:14:48.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.096+0000 7f7cb1ffb700 1 -- 172.21.15.146:0/4122460462 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7cac0119e0 con 0x7f7cbc153ab0 2023-10-06T11:14:48.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.097+0000 7f7cb1ffb700 1 --2- 172.21.15.146:0/4122460462 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7ca0066f30 0x7f7ca00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:48.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.097+0000 7f7cc196e700 1 --2- 172.21.15.146:0/4122460462 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7ca0066f30 0x7f7ca00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:48.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.097+0000 7f7cb1ffb700 1 -- 172.21.15.146:0/4122460462 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7cac085fe0 con 0x7f7cbc153ab0 2023-10-06T11:14:48.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.097+0000 7f7cc196e700 1 --2- 172.21.15.146:0/4122460462 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7ca0066f30 0x7f7ca00693e0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f7cb80076a0 tx=0x7f7cb800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:48.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.101+0000 7f7cb1ffb700 1 -- 172.21.15.146:0/4122460462 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7cac053050 con 0x7f7cbc153ab0 2023-10-06T11:14:48.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.329+0000 7f7cc3bd2700 1 -- 172.21.15.146:0/4122460462 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7cbc0b5c50 con 0x7f7cbc153ab0 2023-10-06T11:14:48.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.329+0000 7f7cb1ffb700 1 -- 172.21.15.146:0/4122460462 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) v1 ==== 95+0+4610 (secure 0 0 0) 0x7f7cac056670 con 0x7f7cbc153ab0 2023-10-06T11:14:48.331 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:48.331 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":100,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6560,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/2109567995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2109567995},{"type":"v1","addr":"172.21.15.151:6834","nonce":2109567995}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":6563,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1783565134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":1783565134},{"type":"v1","addr":"172.21.15.151:6835","nonce":1783565134}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7327,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/1323749517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1323749517},{"type":"v1","addr":"172.21.15.146:6836","nonce":1323749517}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:14:18.891938+0000","modified":"2023-10-06T11:14:22.531674+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8103":{"gid":8103,"name":"c","rank":0,"incarnation":97,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/409226151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":409226151},{"type":"v1","addr":"172.21.15.146:6837","nonce":409226151}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-06T11:14:48.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.332+0000 7f7cc3bd2700 1 -- 172.21.15.146:0/4122460462 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7ca0066f30 msgr2=0x7f7ca00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:48.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.332+0000 7f7cc3bd2700 1 --2- 172.21.15.146:0/4122460462 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7ca0066f30 0x7f7ca00693e0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f7cb80076a0 tx=0x7f7cb800b040 comp rx=0 tx=0).stop 2023-10-06T11:14:48.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.332+0000 7f7cc3bd2700 1 -- 172.21.15.146:0/4122460462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cbc153ab0 msgr2=0x7f7cbc157d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:48.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.332+0000 7f7cc3bd2700 1 --2- 172.21.15.146:0/4122460462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cbc153ab0 0x7f7cbc157d30 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc089010 tx=0x7f7cac017000 comp rx=0 tx=0).stop 2023-10-06T11:14:48.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.332+0000 7f7cc3bd2700 1 -- 172.21.15.146:0/4122460462 shutdown_connections 2023-10-06T11:14:48.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.332+0000 7f7cc3bd2700 1 --2- 172.21.15.146:0/4122460462 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7ca0066f30 0x7f7ca00693e0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:48.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.332+0000 7f7cc3bd2700 1 --2- 172.21.15.146:0/4122460462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cbc153e80 0x7f7cbc158b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:48.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.332+0000 7f7cc3bd2700 1 --2- 172.21.15.146:0/4122460462 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7cbc0689d0 0x7f7cbc0cbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:48.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.332+0000 7f7cc3bd2700 1 --2- 172.21.15.146:0/4122460462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7cbc153ab0 0x7f7cbc157d30 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:48.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.332+0000 7f7cc3bd2700 1 -- 172.21.15.146:0/4122460462 >> 172.21.15.146:0/4122460462 conn(0x7f7cbc06eba0 msgr2=0x7f7cbc151de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:48.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.332+0000 7f7cc3bd2700 1 -- 172.21.15.146:0/4122460462 shutdown_connections 2023-10-06T11:14:48.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.332+0000 7f7cc3bd2700 1 -- 172.21.15.146:0/4122460462 wait complete. 2023-10-06T11:14:48.335 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 100 2023-10-06T11:14:48.345 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2023-10-06T11:14:48.345 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T11:14:48.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.467+0000 7f6710d06700 1 Processor -- start 2023-10-06T11:14:48.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.467+0000 7f6710d06700 1 -- start start 2023-10-06T11:14:48.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.469+0000 7f6710d06700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f670c153e00 0x7f670c06b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:48.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.469+0000 7f6710d06700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f670c0b0bd0 0x7f670c0b1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:48.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.469+0000 7f6710d06700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f670c06bea0 con 0x7f670c067470 2023-10-06T11:14:48.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.469+0000 7f6710d06700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f670c15a270 con 0x7f670c0b0bd0 2023-10-06T11:14:48.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.469+0000 7f6710d06700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f670c15a550 con 0x7f670c153e00 2023-10-06T11:14:48.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.469+0000 7f6709d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f670c0b0bd0 0x7f670c0b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:48.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.469+0000 7f6709d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f670c0b0bd0 0x7f670c0b1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39684/0 (socket says 172.21.15.146:39684) 2023-10-06T11:14:48.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.469+0000 7f6709d9b700 1 -- 172.21.15.146:0/2310765151 learned_addr learned my addr 172.21.15.146:0/2310765151 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:48.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.469+0000 7f670a59c700 1 --2- 172.21.15.146:0/2310765151 >> v2:172.21.15.151:3300/0 conn(0x7f670c153e00 0x7f670c06b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:48.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.469+0000 7f6709d9b700 1 -- 172.21.15.146:0/2310765151 >> v2:172.21.15.151:3300/0 conn(0x7f670c153e00 msgr2=0x7f670c06b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:48.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.469+0000 7f6709d9b700 1 --2- 172.21.15.146:0/2310765151 >> v2:172.21.15.151:3300/0 conn(0x7f670c153e00 0x7f670c06b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:48.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.469+0000 7f6709d9b700 1 -- 172.21.15.146:0/2310765151 >> v1:172.21.15.151:6789/0 conn(0x7f670c067470 legacy=0x7f670c067890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:48.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.469+0000 7f6709d9b700 1 -- 172.21.15.146:0/2310765151 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f670c15a830 con 0x7f670c0b0bd0 2023-10-06T11:14:48.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.469+0000 7f670a59c700 1 --2- 172.21.15.146:0/2310765151 >> v2:172.21.15.151:3300/0 conn(0x7f670c153e00 0x7f670c06b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:48.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.470+0000 7f6709d9b700 1 --2- 172.21.15.146:0/2310765151 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f670c0b0bd0 0x7f670c0b1020 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f670c068300 tx=0x7f6700009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=342ba2b968e2aeef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:48.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.470+0000 7f670959a700 1 -- 172.21.15.146:0/2310765151 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6700005c10 con 0x7f670c0b0bd0 2023-10-06T11:14:48.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.470+0000 7f670959a700 1 -- 172.21.15.146:0/2310765151 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6700005d70 con 0x7f670c0b0bd0 2023-10-06T11:14:48.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.470+0000 7f670959a700 1 -- 172.21.15.146:0/2310765151 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670000b840 con 0x7f670c0b0bd0 2023-10-06T11:14:48.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.470+0000 7f6710d06700 1 -- 172.21.15.146:0/2310765151 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f670c0b0bd0 msgr2=0x7f670c0b1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:48.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.470+0000 7f6710d06700 1 --2- 172.21.15.146:0/2310765151 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f670c0b0bd0 0x7f670c0b1020 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f670c068300 tx=0x7f6700009220 comp rx=0 tx=0).stop 2023-10-06T11:14:48.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.470+0000 7f6710d06700 1 -- 172.21.15.146:0/2310765151 shutdown_connections 2023-10-06T11:14:48.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.470+0000 7f6710d06700 1 --2- 172.21.15.146:0/2310765151 >> v2:172.21.15.151:3300/0 conn(0x7f670c153e00 0x7f670c06b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:48.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.470+0000 7f6710d06700 1 --2- 172.21.15.146:0/2310765151 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f670c0b0bd0 0x7f670c0b1020 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:48.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.470+0000 7f6710d06700 1 -- 172.21.15.146:0/2310765151 >> 172.21.15.146:0/2310765151 conn(0x7f670c06b060 msgr2=0x7f670c0aecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:48.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.470+0000 7f6710d06700 1 -- 172.21.15.146:0/2310765151 shutdown_connections 2023-10-06T11:14:48.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.470+0000 7f6710d06700 1 -- 172.21.15.146:0/2310765151 wait complete. 2023-10-06T11:14:48.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.472+0000 7f6710d06700 1 Processor -- start 2023-10-06T11:14:48.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.472+0000 7f6710d06700 1 -- start start 2023-10-06T11:14:48.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.472+0000 7f6710d06700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f670c067470 0x7f670c15c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:48.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.472+0000 7f6710d06700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f670c0b0bd0 0x7f670c144920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:48.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.472+0000 7f6710d06700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f670c153e00 0x7f670c144e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:48.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.473+0000 7f6710d06700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f670c1541d0 con 0x7f670c153e00 2023-10-06T11:14:48.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.473+0000 7f6710d06700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f670c154a70 con 0x7f670c0b0bd0 2023-10-06T11:14:48.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.473+0000 7f6710d06700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f670c0cac30 con 0x7f670c067470 2023-10-06T11:14:48.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.473+0000 7f670ad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f670c153e00 0x7f670c144e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:48.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.473+0000 7f670ad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f670c153e00 0x7f670c144e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39688/0 (socket says 172.21.15.146:39688) 2023-10-06T11:14:48.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.473+0000 7f670ad9d700 1 -- 172.21.15.146:0/1991144615 learned_addr learned my addr 172.21.15.146:0/1991144615 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:48.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.473+0000 7f6709d9b700 1 --2- 172.21.15.146:0/1991144615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f670c0b0bd0 0x7f670c144920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:48.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.473+0000 7f670a59c700 1 --2- 172.21.15.146:0/1991144615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f670c067470 0x7f670c15c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:48.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.473+0000 7f670ad9d700 1 -- 172.21.15.146:0/1991144615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f670c067470 msgr2=0x7f670c15c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:48.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.473+0000 7f670ad9d700 1 --2- 172.21.15.146:0/1991144615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f670c067470 0x7f670c15c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:48.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.473+0000 7f670ad9d700 1 -- 172.21.15.146:0/1991144615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f670c0b0bd0 msgr2=0x7f670c144920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:48.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.473+0000 7f670ad9d700 1 --2- 172.21.15.146:0/1991144615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f670c0b0bd0 0x7f670c144920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:48.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.473+0000 7f670ad9d700 1 -- 172.21.15.146:0/1991144615 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6700009480 con 0x7f670c153e00 2023-10-06T11:14:48.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.473+0000 7f670ad9d700 1 --2- 172.21.15.146:0/1991144615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f670c153e00 0x7f670c144e60 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f670400bc30 tx=0x7f6704009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:48.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.473+0000 7f66fa7fc700 1 -- 172.21.15.146:0/1991144615 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670400c840 con 0x7f670c153e00 2023-10-06T11:14:48.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.473+0000 7f66fa7fc700 1 -- 172.21.15.146:0/1991144615 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670400c9e0 con 0x7f670c153e00 2023-10-06T11:14:48.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.473+0000 7f6710d06700 1 -- 172.21.15.146:0/1991144615 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f670c154420 con 0x7f670c153e00 2023-10-06T11:14:48.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.473+0000 7f66fa7fc700 1 -- 172.21.15.146:0/1991144615 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670400cda0 con 0x7f670c153e00 2023-10-06T11:14:48.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.474+0000 7f6710d06700 1 -- 172.21.15.146:0/1991144615 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f670c15c8b0 con 0x7f670c153e00 2023-10-06T11:14:48.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.475+0000 7f6710d06700 1 -- 172.21.15.146:0/1991144615 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f670c154be0 con 0x7f670c153e00 2023-10-06T11:14:48.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.475+0000 7f66fa7fc700 1 -- 172.21.15.146:0/1991144615 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6704014620 con 0x7f670c153e00 2023-10-06T11:14:48.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.475+0000 7f66fa7fc700 1 --2- 172.21.15.146:0/1991144615 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f66ec066f30 0x7f66ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:48.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.475+0000 7f66fa7fc700 1 -- 172.21.15.146:0/1991144615 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6704084640 con 0x7f670c153e00 2023-10-06T11:14:48.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.475+0000 7f670a59c700 1 --2- 172.21.15.146:0/1991144615 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f66ec066f30 0x7f66ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:48.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.476+0000 7f670a59c700 1 --2- 172.21.15.146:0/1991144615 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f66ec066f30 0x7f66ec0693e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f66fc006fd0 tx=0x7f66fc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:48.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.483+0000 7f66fa7fc700 1 -- 172.21.15.146:0/1991144615 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6704051750 con 0x7f670c153e00 2023-10-06T11:14:48.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.744+0000 7f6710d06700 1 -- 172.21.15.146:0/1991144615 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f670c04c380 con 0x7f670c153e00 2023-10-06T11:14:48.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.744+0000 7f66fa7fc700 1 -- 172.21.15.146:0/1991144615 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1603 (secure 0 0 0) 0x7f6704054d70 con 0x7f670c153e00 2023-10-06T11:14:48.746 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:48.746 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":563,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":113,"num_osds":8,"num_up_osds":8,"osd_up_since":1696590336,"num_in_osds":8,"osd_in_since":1696590327,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":1063,"data_bytes":1077945528,"bytes_used":4672598016,"bytes_avail":768421515264,"bytes_total":773094113280,"write_bytes_sec":61376841,"read_op_per_sec":0,"write_op_per_sec":142},"fsmap":{"epoch":100,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":8103}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2023-10-06T11:14:45.255803+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T11:14:48.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.746+0000 7f6710d06700 1 -- 172.21.15.146:0/1991144615 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f66ec066f30 msgr2=0x7f66ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:48.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.746+0000 7f6710d06700 1 --2- 172.21.15.146:0/1991144615 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f66ec066f30 0x7f66ec0693e0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f66fc006fd0 tx=0x7f66fc008040 comp rx=0 tx=0).stop 2023-10-06T11:14:48.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.746+0000 7f6710d06700 1 -- 172.21.15.146:0/1991144615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f670c153e00 msgr2=0x7f670c144e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:48.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.746+0000 7f6710d06700 1 --2- 172.21.15.146:0/1991144615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f670c153e00 0x7f670c144e60 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f670400bc30 tx=0x7f6704009820 comp rx=0 tx=0).stop 2023-10-06T11:14:48.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.746+0000 7f6710d06700 1 -- 172.21.15.146:0/1991144615 shutdown_connections 2023-10-06T11:14:48.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.746+0000 7f6710d06700 1 --2- 172.21.15.146:0/1991144615 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f66ec066f30 0x7f66ec0693e0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:48.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.746+0000 7f6710d06700 1 --2- 172.21.15.146:0/1991144615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f670c153e00 0x7f670c144e60 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:48.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.746+0000 7f6710d06700 1 --2- 172.21.15.146:0/1991144615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f670c067470 0x7f670c15c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:48.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.746+0000 7f6710d06700 1 --2- 172.21.15.146:0/1991144615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f670c0b0bd0 0x7f670c144920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:48.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.746+0000 7f6710d06700 1 -- 172.21.15.146:0/1991144615 >> 172.21.15.146:0/1991144615 conn(0x7f670c06b060 msgr2=0x7f670c067840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:48.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.746+0000 7f6710d06700 1 -- 172.21.15.146:0/1991144615 shutdown_connections 2023-10-06T11:14:48.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:48.746+0000 7f6710d06700 1 -- 172.21.15.146:0/1991144615 wait complete. 2023-10-06T11:14:48.760 INFO:tasks.cephfs.filesystem.ceph_manager:{'c': 'paused'} 2023-10-06T11:14:49.761 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:14:49.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.877+0000 7f0309728700 1 Processor -- start 2023-10-06T11:14:49.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.877+0000 7f0309728700 1 -- start start 2023-10-06T11:14:49.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.878+0000 7f0309728700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f03040b0c00 0x7f03040c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:49.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.878+0000 7f0309728700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03040ced80 0x7f03040c3200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:49.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.878+0000 7f0309728700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03040cf210 con 0x7f03040c3740 2023-10-06T11:14:49.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.878+0000 7f0309728700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03040682f0 con 0x7f03040b0c00 2023-10-06T11:14:49.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.878+0000 7f0309728700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0304068580 con 0x7f03040ced80 2023-10-06T11:14:49.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.878+0000 7f0302ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f03040b0c00 0x7f03040c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:49.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.878+0000 7f03037fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f03040c3740 0x7f0304069270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45364/0 (socket says 172.21.15.146:45364) 2023-10-06T11:14:49.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.878+0000 7f03037fe700 1 -- 172.21.15.146:0/3137766390 learned_addr learned my addr 172.21.15.146:0/3137766390 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:14:49.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.879+0000 7f0302ffd700 1 -- 172.21.15.146:0/3137766390 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03040ced80 msgr2=0x7f03040c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:49.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.879+0000 7f0302ffd700 1 --2- 172.21.15.146:0/3137766390 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03040ced80 0x7f03040c3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:49.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.879+0000 7f0302ffd700 1 -- 172.21.15.146:0/3137766390 >> v1:172.21.15.146:6789/0 conn(0x7f03040c3740 legacy=0x7f0304069270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:49.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.879+0000 7f0302ffd700 1 -- 172.21.15.146:0/3137766390 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0304068790 con 0x7f03040b0c00 2023-10-06T11:14:49.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.879+0000 7f03027fc700 1 -- 172.21.15.146:0/3137766390 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 174970346 0 0) 0x7f03040cf210 con 0x7f03040c3740 2023-10-06T11:14:49.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.879+0000 7f0302ffd700 1 --2- 172.21.15.146:0/3137766390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03040b0c00 0x7f03040c8aa0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f02f40098e0 tx=0x7f02f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3a53bdcdb6796b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:49.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.879+0000 7f03027fc700 1 -- 172.21.15.146:0/3137766390 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f4009e80 con 0x7f03040b0c00 2023-10-06T11:14:49.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.879+0000 7f03027fc700 1 -- 172.21.15.146:0/3137766390 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f400b8f0 con 0x7f03040b0c00 2023-10-06T11:14:49.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.879+0000 7f03027fc700 1 -- 172.21.15.146:0/3137766390 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f400bc70 con 0x7f03040b0c00 2023-10-06T11:14:49.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.879+0000 7f0309728700 1 -- 172.21.15.146:0/3137766390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03040b0c00 msgr2=0x7f03040c8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:49.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.879+0000 7f0309728700 1 --2- 172.21.15.146:0/3137766390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03040b0c00 0x7f03040c8aa0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f02f40098e0 tx=0x7f02f40091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:49.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.880+0000 7f0309728700 1 -- 172.21.15.146:0/3137766390 shutdown_connections 2023-10-06T11:14:49.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.880+0000 7f0309728700 1 --2- 172.21.15.146:0/3137766390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03040b0c00 0x7f03040c8aa0 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:49.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.880+0000 7f0309728700 1 --2- 172.21.15.146:0/3137766390 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03040ced80 0x7f03040c3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:49.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.880+0000 7f0309728700 1 -- 172.21.15.146:0/3137766390 >> 172.21.15.146:0/3137766390 conn(0x7f0304067c50 msgr2=0x7f03040ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:49.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.880+0000 7f0309728700 1 -- 172.21.15.146:0/3137766390 shutdown_connections 2023-10-06T11:14:49.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.880+0000 7f0309728700 1 -- 172.21.15.146:0/3137766390 wait complete. 2023-10-06T11:14:49.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.881+0000 7f0309728700 1 Processor -- start 2023-10-06T11:14:49.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.881+0000 7f0309728700 1 -- start start 2023-10-06T11:14:49.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.881+0000 7f0309728700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03040b0c00 0x7f03040b1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:49.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.882+0000 7f0309728700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03040c3740 0x7f0304157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:49.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.882+0000 7f0309728700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03040ced80 0x7f030416a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:49.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.882+0000 7f0309728700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f030416bcc0 con 0x7f03040c3740 2023-10-06T11:14:49.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.882+0000 7f0309728700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0304157670 con 0x7f03040b0c00 2023-10-06T11:14:49.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.882+0000 7f0309728700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f030416b0b0 con 0x7f03040ced80 2023-10-06T11:14:49.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.882+0000 7f02fa7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03040c3740 0x7f0304157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:49.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.882+0000 7f02fa7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03040c3740 0x7f0304157130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39702/0 (socket says 172.21.15.146:39702) 2023-10-06T11:14:49.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.882+0000 7f02fa7fc700 1 -- 172.21.15.146:0/3864308847 learned_addr learned my addr 172.21.15.146:0/3864308847 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:49.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.882+0000 7f0302ffd700 1 --2- 172.21.15.146:0/3864308847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03040b0c00 0x7f03040b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:49.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.882+0000 7f03037fe700 1 --2- 172.21.15.146:0/3864308847 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03040ced80 0x7f030416a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:49.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.882+0000 7f02fa7fc700 1 -- 172.21.15.146:0/3864308847 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03040ced80 msgr2=0x7f030416a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:49.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.882+0000 7f02fa7fc700 1 --2- 172.21.15.146:0/3864308847 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03040ced80 0x7f030416a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:49.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.882+0000 7f02fa7fc700 1 -- 172.21.15.146:0/3864308847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03040b0c00 msgr2=0x7f03040b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:49.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.882+0000 7f02fa7fc700 1 --2- 172.21.15.146:0/3864308847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03040b0c00 0x7f03040b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:49.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.882+0000 7f02fa7fc700 1 -- 172.21.15.146:0/3864308847 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f4009420 con 0x7f03040c3740 2023-10-06T11:14:49.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.882+0000 7f02fa7fc700 1 --2- 172.21.15.146:0/3864308847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03040c3740 0x7f0304157130 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f02ec00b810 tx=0x7f02ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:49.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.882+0000 7f02fb7fe700 1 -- 172.21.15.146:0/3864308847 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ec00f510 con 0x7f03040c3740 2023-10-06T11:14:49.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.882+0000 7f02fb7fe700 1 -- 172.21.15.146:0/3864308847 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ec00f690 con 0x7f03040c3740 2023-10-06T11:14:49.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.882+0000 7f0309728700 1 -- 172.21.15.146:0/3864308847 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f030416b390 con 0x7f03040c3740 2023-10-06T11:14:49.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.882+0000 7f02fb7fe700 1 -- 172.21.15.146:0/3864308847 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ec00fa50 con 0x7f03040c3740 2023-10-06T11:14:49.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.882+0000 7f0309728700 1 -- 172.21.15.146:0/3864308847 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f030416b950 con 0x7f03040c3740 2023-10-06T11:14:49.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.883+0000 7f0309728700 1 -- 172.21.15.146:0/3864308847 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f030416be70 con 0x7f03040c3740 2023-10-06T11:14:49.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.884+0000 7f02fb7fe700 1 -- 172.21.15.146:0/3864308847 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f02ec01a400 con 0x7f03040c3740 2023-10-06T11:14:49.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.884+0000 7f02fb7fe700 1 --2- 172.21.15.146:0/3864308847 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f02e4066f30 0x7f02e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:49.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.884+0000 7f0302ffd700 1 --2- 172.21.15.146:0/3864308847 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f02e4066f30 0x7f02e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:49.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.884+0000 7f02fb7fe700 1 -- 172.21.15.146:0/3864308847 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f02ec084110 con 0x7f03040c3740 2023-10-06T11:14:49.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.885+0000 7f0302ffd700 1 --2- 172.21.15.146:0/3864308847 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f02e4066f30 0x7f02e40693e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f02f40091e0 tx=0x7f02f4017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:49.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:49.888+0000 7f02fb7fe700 1 -- 172.21.15.146:0/3864308847 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f030416be70 con 0x7f03040c3740 2023-10-06T11:14:50.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.115+0000 7f0309728700 1 -- 172.21.15.146:0/3864308847 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f030404c380 con 0x7f03040c3740 2023-10-06T11:14:50.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.116+0000 7f02fb7fe700 1 -- 172.21.15.146:0/3864308847 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) v1 ==== 95+0+4610 (secure 0 0 0) 0x7f02ec0512a0 con 0x7f03040c3740 2023-10-06T11:14:50.117 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:50.117 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":100,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6560,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/2109567995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2109567995},{"type":"v1","addr":"172.21.15.151:6834","nonce":2109567995}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":6563,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1783565134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":1783565134},{"type":"v1","addr":"172.21.15.151:6835","nonce":1783565134}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7327,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/1323749517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1323749517},{"type":"v1","addr":"172.21.15.146:6836","nonce":1323749517}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:14:18.891938+0000","modified":"2023-10-06T11:14:22.531674+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8103":{"gid":8103,"name":"c","rank":0,"incarnation":97,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/409226151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":409226151},{"type":"v1","addr":"172.21.15.146:6837","nonce":409226151}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-06T11:14:50.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.118+0000 7f0309728700 1 -- 172.21.15.146:0/3864308847 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f02e4066f30 msgr2=0x7f02e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:50.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.118+0000 7f0309728700 1 --2- 172.21.15.146:0/3864308847 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f02e4066f30 0x7f02e40693e0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f02f40091e0 tx=0x7f02f4017000 comp rx=0 tx=0).stop 2023-10-06T11:14:50.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.118+0000 7f0309728700 1 -- 172.21.15.146:0/3864308847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03040c3740 msgr2=0x7f0304157130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:50.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.118+0000 7f0309728700 1 --2- 172.21.15.146:0/3864308847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03040c3740 0x7f0304157130 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f02ec00b810 tx=0x7f02ec009250 comp rx=0 tx=0).stop 2023-10-06T11:14:50.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.118+0000 7f0309728700 1 -- 172.21.15.146:0/3864308847 shutdown_connections 2023-10-06T11:14:50.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.118+0000 7f0309728700 1 --2- 172.21.15.146:0/3864308847 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f02e4066f30 0x7f02e40693e0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:50.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.118+0000 7f0309728700 1 --2- 172.21.15.146:0/3864308847 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03040ced80 0x7f030416a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:50.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.118+0000 7f0309728700 1 --2- 172.21.15.146:0/3864308847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03040b0c00 0x7f03040b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:50.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.118+0000 7f0309728700 1 --2- 172.21.15.146:0/3864308847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03040c3740 0x7f0304157130 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:50.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.118+0000 7f0309728700 1 -- 172.21.15.146:0/3864308847 >> 172.21.15.146:0/3864308847 conn(0x7f0304067c50 msgr2=0x7f03040cd300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:50.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.118+0000 7f0309728700 1 -- 172.21.15.146:0/3864308847 shutdown_connections 2023-10-06T11:14:50.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.118+0000 7f0309728700 1 -- 172.21.15.146:0/3864308847 wait complete. 2023-10-06T11:14:50.121 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 100 2023-10-06T11:14:50.132 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2023-10-06T11:14:50.132 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T11:14:50.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.244+0000 7f0dbea70700 1 Processor -- start 2023-10-06T11:14:50.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.244+0000 7f0dbea70700 1 -- start start 2023-10-06T11:14:50.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.245+0000 7f0dbea70700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0db815a7f0 0x7f0db815cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:50.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.245+0000 7f0dbea70700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db815c630 con 0x7f0db80b2530 2023-10-06T11:14:50.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.245+0000 7f0dbea70700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0db815ba20 con 0x7f0db815a420 2023-10-06T11:14:50.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.245+0000 7f0dbea70700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db80ce040 con 0x7f0db815a7f0 2023-10-06T11:14:50.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.245+0000 7f0dbe26f700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0db80b2530 0x7f0db815acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:45374/0 (socket says 172.21.15.146:45374) 2023-10-06T11:14:50.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.245+0000 7f0dbe26f700 1 -- 172.21.15.146:0/1047877823 learned_addr learned my addr 172.21.15.146:0/1047877823 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:14:50.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.245+0000 7f0dbd26d700 1 --2- 172.21.15.146:0/1047877823 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0db815a7f0 0x7f0db815cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:50.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.245+0000 7f0dbca6c700 1 -- 172.21.15.146:0/1047877823 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2219886576 0 0) 0x7f0db815c630 con 0x7f0db80b2530 2023-10-06T11:14:50.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.245+0000 7f0dbca6c700 1 -- 172.21.15.146:0/1047877823 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0da0003570 con 0x7f0db80b2530 2023-10-06T11:14:50.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.245+0000 7f0dbca6c700 1 -- 172.21.15.146:0/1047877823 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 225104441 0 0) 0x7f0db815ba20 con 0x7f0db815a420 2023-10-06T11:14:50.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.245+0000 7f0dbca6c700 1 -- 172.21.15.146:0/1047877823 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0db815c630 con 0x7f0db815a420 2023-10-06T11:14:50.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.246+0000 7f0dbd26d700 1 -- 172.21.15.146:0/1047877823 >> v1:172.21.15.151:6789/0 conn(0x7f0db815a420 legacy=0x7f0db80b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:50.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.246+0000 7f0dbd26d700 1 -- 172.21.15.146:0/1047877823 >> v1:172.21.15.146:6789/0 conn(0x7f0db80b2530 legacy=0x7f0db815acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:50.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.246+0000 7f0dbd26d700 1 -- 172.21.15.146:0/1047877823 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db815bd00 con 0x7f0db815a7f0 2023-10-06T11:14:50.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.246+0000 7f0dbd26d700 1 --2- 172.21.15.146:0/1047877823 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0db815a7f0 0x7f0db815cac0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0dac009e90 tx=0x7f0dac009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d597154a0da55dd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:50.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.246+0000 7f0dbca6c700 1 -- 172.21.15.146:0/1047877823 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac00e070 con 0x7f0db815a7f0 2023-10-06T11:14:50.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.246+0000 7f0dbca6c700 1 -- 172.21.15.146:0/1047877823 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dac00bb80 con 0x7f0db815a7f0 2023-10-06T11:14:50.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.246+0000 7f0dbca6c700 1 -- 172.21.15.146:0/1047877823 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac012430 con 0x7f0db815a7f0 2023-10-06T11:14:50.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.246+0000 7f0dbea70700 1 -- 172.21.15.146:0/1047877823 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0db815a7f0 msgr2=0x7f0db815cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:50.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.246+0000 7f0dbea70700 1 --2- 172.21.15.146:0/1047877823 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0db815a7f0 0x7f0db815cac0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0dac009e90 tx=0x7f0dac009780 comp rx=0 tx=0).stop 2023-10-06T11:14:50.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.246+0000 7f0dbea70700 1 -- 172.21.15.146:0/1047877823 shutdown_connections 2023-10-06T11:14:50.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.246+0000 7f0dbea70700 1 --2- 172.21.15.146:0/1047877823 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0db815a7f0 0x7f0db815cac0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:50.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.246+0000 7f0dbea70700 1 -- 172.21.15.146:0/1047877823 >> 172.21.15.146:0/1047877823 conn(0x7f0db806eba0 msgr2=0x7f0db806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:50.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.247+0000 7f0dbea70700 1 -- 172.21.15.146:0/1047877823 shutdown_connections 2023-10-06T11:14:50.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.247+0000 7f0dbea70700 1 -- 172.21.15.146:0/1047877823 wait complete. 2023-10-06T11:14:50.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.248+0000 7f0dbea70700 1 Processor -- start 2023-10-06T11:14:50.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.248+0000 7f0dbea70700 1 -- start start 2023-10-06T11:14:50.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.248+0000 7f0dbea70700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0db80b2530 0x7f0db8153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:50.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.248+0000 7f0dbea70700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0db815a420 0x7f0db814b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:50.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.248+0000 7f0dbea70700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0db815a7f0 0x7f0db80b3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:50.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.248+0000 7f0dbea70700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db81532a0 con 0x7f0db80b2530 2023-10-06T11:14:50.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.248+0000 7f0dbea70700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0db81523f0 con 0x7f0db815a420 2023-10-06T11:14:50.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.248+0000 7f0dbea70700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0db8152690 con 0x7f0db815a7f0 2023-10-06T11:14:50.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.248+0000 7f0dbda6e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0db80b2530 0x7f0db8153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:50.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.248+0000 7f0dbda6e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0db80b2530 0x7f0db8153730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39716/0 (socket says 172.21.15.146:39716) 2023-10-06T11:14:50.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.248+0000 7f0dbda6e700 1 -- 172.21.15.146:0/1674409645 learned_addr learned my addr 172.21.15.146:0/1674409645 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:50.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.249+0000 7f0dbda6e700 1 -- 172.21.15.146:0/1674409645 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0db815a7f0 msgr2=0x7f0db80b3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:50.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.249+0000 7f0dbda6e700 1 --2- 172.21.15.146:0/1674409645 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0db815a7f0 0x7f0db80b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:50.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.249+0000 7f0dbd26d700 1 --2- 172.21.15.146:0/1674409645 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0db815a420 0x7f0db814b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:50.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.249+0000 7f0dbda6e700 1 -- 172.21.15.146:0/1674409645 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0db815a420 msgr2=0x7f0db814b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:50.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.249+0000 7f0dbda6e700 1 --2- 172.21.15.146:0/1674409645 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0db815a420 0x7f0db814b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:50.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.249+0000 7f0dbda6e700 1 -- 172.21.15.146:0/1674409645 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dac009a20 con 0x7f0db80b2530 2023-10-06T11:14:50.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.249+0000 7f0dbd26d700 1 --2- 172.21.15.146:0/1674409645 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0db815a420 0x7f0db814b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:50.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.249+0000 7f0dbda6e700 1 --2- 172.21.15.146:0/1674409645 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0db80b2530 0x7f0db8153730 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f0db000c790 tx=0x7f0db0007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:50.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.249+0000 7f0db5ffb700 1 -- 172.21.15.146:0/1674409645 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db0010510 con 0x7f0db80b2530 2023-10-06T11:14:50.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.249+0000 7f0db5ffb700 1 -- 172.21.15.146:0/1674409645 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db0010670 con 0x7f0db80b2530 2023-10-06T11:14:50.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.249+0000 7f0dbea70700 1 -- 172.21.15.146:0/1674409645 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0db8152970 con 0x7f0db80b2530 2023-10-06T11:14:50.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.249+0000 7f0db5ffb700 1 -- 172.21.15.146:0/1674409645 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db0010a10 con 0x7f0db80b2530 2023-10-06T11:14:50.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.249+0000 7f0dbea70700 1 -- 172.21.15.146:0/1674409645 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0db8152f30 con 0x7f0db80b2530 2023-10-06T11:14:50.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.250+0000 7f0dbea70700 1 -- 172.21.15.146:0/1674409645 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0db80afae0 con 0x7f0db80b2530 2023-10-06T11:14:50.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.250+0000 7f0db5ffb700 1 -- 172.21.15.146:0/1674409645 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0db001b400 con 0x7f0db80b2530 2023-10-06T11:14:50.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.251+0000 7f0db5ffb700 1 --2- 172.21.15.146:0/1674409645 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0da4066f30 0x7f0da40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:50.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.251+0000 7f0dbd26d700 1 --2- 172.21.15.146:0/1674409645 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0da4066f30 0x7f0da40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:50.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.251+0000 7f0db5ffb700 1 -- 172.21.15.146:0/1674409645 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0db00844e0 con 0x7f0db80b2530 2023-10-06T11:14:50.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.251+0000 7f0dbd26d700 1 --2- 172.21.15.146:0/1674409645 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0da4066f30 0x7f0da40693e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f0db815abc0 tx=0x7f0dac019000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:50.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.255+0000 7f0db5ffb700 1 -- 172.21.15.146:0/1674409645 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0db00515f0 con 0x7f0db80b2530 2023-10-06T11:14:50.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.517+0000 7f0dbea70700 1 -- 172.21.15.146:0/1674409645 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f0db815bfe0 con 0x7f0db80b2530 2023-10-06T11:14:50.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.517+0000 7f0db5ffb700 1 -- 172.21.15.146:0/1674409645 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1603 (secure 0 0 0) 0x7f0db0054c10 con 0x7f0db80b2530 2023-10-06T11:14:50.519 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:50.519 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":564,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":113,"num_osds":8,"num_up_osds":8,"osd_up_since":1696590336,"num_in_osds":8,"osd_in_since":1696590327,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":1071,"data_bytes":1077945528,"bytes_used":4673863680,"bytes_avail":768420249600,"bytes_total":773094113280,"write_bytes_sec":41045676,"read_op_per_sec":0,"write_op_per_sec":162},"fsmap":{"epoch":100,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":8103}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2023-10-06T11:14:45.255803+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T11:14:50.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.519+0000 7f0dbea70700 1 -- 172.21.15.146:0/1674409645 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0da4066f30 msgr2=0x7f0da40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:50.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.519+0000 7f0dbea70700 1 --2- 172.21.15.146:0/1674409645 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0da4066f30 0x7f0da40693e0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f0db815abc0 tx=0x7f0dac019000 comp rx=0 tx=0).stop 2023-10-06T11:14:50.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.520+0000 7f0dbea70700 1 -- 172.21.15.146:0/1674409645 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0db80b2530 msgr2=0x7f0db8153730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:50.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.520+0000 7f0dbea70700 1 --2- 172.21.15.146:0/1674409645 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0db80b2530 0x7f0db8153730 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f0db000c790 tx=0x7f0db0007e10 comp rx=0 tx=0).stop 2023-10-06T11:14:50.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.520+0000 7f0dbea70700 1 -- 172.21.15.146:0/1674409645 shutdown_connections 2023-10-06T11:14:50.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.520+0000 7f0dbea70700 1 --2- 172.21.15.146:0/1674409645 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0da4066f30 0x7f0da40693e0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:50.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.520+0000 7f0dbea70700 1 --2- 172.21.15.146:0/1674409645 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0db815a7f0 0x7f0db80b3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:50.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.520+0000 7f0dbea70700 1 --2- 172.21.15.146:0/1674409645 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0db80b2530 0x7f0db8153730 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:50.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.520+0000 7f0dbea70700 1 --2- 172.21.15.146:0/1674409645 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0db815a420 0x7f0db814b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:50.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.520+0000 7f0dbea70700 1 -- 172.21.15.146:0/1674409645 >> 172.21.15.146:0/1674409645 conn(0x7f0db806eba0 msgr2=0x7f0db814fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:50.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.520+0000 7f0dbea70700 1 -- 172.21.15.146:0/1674409645 shutdown_connections 2023-10-06T11:14:50.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:50.520+0000 7f0dbea70700 1 -- 172.21.15.146:0/1674409645 wait complete. 2023-10-06T11:14:50.533 INFO:tasks.cephfs.filesystem.ceph_manager:{'c': 'paused'} 2023-10-06T11:14:51.088 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:14:51.092 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:14:51.534 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:14:51.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.649+0000 7f7816ebc700 1 Processor -- start 2023-10-06T11:14:51.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.649+0000 7f7816ebc700 1 -- start start 2023-10-06T11:14:51.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.649+0000 7f7816ebc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f78100ced80 0x7f78100c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:51.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.649+0000 7f7816ebc700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f78100c3910 0x7f78100cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:51.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.649+0000 7f7816ebc700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78100cf210 con 0x7f78100b0c00 2023-10-06T11:14:51.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.649+0000 7f7816ebc700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78100682f0 con 0x7f78100ced80 2023-10-06T11:14:51.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.649+0000 7f7816ebc700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7810068580 con 0x7f78100c3910 2023-10-06T11:14:51.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.650+0000 7f7807fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f78100ced80 0x7f78100c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:51.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.650+0000 7f7814c58700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f78100b0c00 0x7f78100c3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:41572/0 (socket says 172.21.15.146:41572) 2023-10-06T11:14:51.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.650+0000 7f7814c58700 1 -- 172.21.15.146:0/1720325643 learned_addr learned my addr 172.21.15.146:0/1720325643 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:14:51.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.650+0000 7f7815459700 1 --2- 172.21.15.146:0/1720325643 >> v2:172.21.15.151:3300/0 conn(0x7f78100c3910 0x7f78100cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:51.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.650+0000 7f7807fff700 1 -- 172.21.15.146:0/1720325643 >> v2:172.21.15.151:3300/0 conn(0x7f78100c3910 msgr2=0x7f78100cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:51.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.650+0000 7f7807fff700 1 --2- 172.21.15.146:0/1720325643 >> v2:172.21.15.151:3300/0 conn(0x7f78100c3910 0x7f78100cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:51.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.650+0000 7f7807fff700 1 -- 172.21.15.146:0/1720325643 >> v1:172.21.15.146:6789/0 conn(0x7f78100b0c00 legacy=0x7f78100c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:51.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.650+0000 7f7807fff700 1 -- 172.21.15.146:0/1720325643 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7810068790 con 0x7f78100ced80 2023-10-06T11:14:51.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.650+0000 7f78077fe700 1 -- 172.21.15.146:0/1720325643 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1227908430 0 0) 0x7f78100cf210 con 0x7f78100b0c00 2023-10-06T11:14:51.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.650+0000 7f7807fff700 1 --2- 172.21.15.146:0/1720325643 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78100ced80 0x7f78100c8aa0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f781006fd00 tx=0x7f78000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=771738fa4ee06a50 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:51.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.650+0000 7f78077fe700 1 -- 172.21.15.146:0/1720325643 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780000b740 con 0x7f78100ced80 2023-10-06T11:14:51.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.650+0000 7f78077fe700 1 -- 172.21.15.146:0/1720325643 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780000b8a0 con 0x7f78100ced80 2023-10-06T11:14:51.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.650+0000 7f78077fe700 1 -- 172.21.15.146:0/1720325643 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780000bc40 con 0x7f78100ced80 2023-10-06T11:14:51.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.651+0000 7f7816ebc700 1 -- 172.21.15.146:0/1720325643 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78100ced80 msgr2=0x7f78100c8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:51.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.651+0000 7f7816ebc700 1 --2- 172.21.15.146:0/1720325643 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78100ced80 0x7f78100c8aa0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f781006fd00 tx=0x7f78000091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:51.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.651+0000 7f7816ebc700 1 -- 172.21.15.146:0/1720325643 shutdown_connections 2023-10-06T11:14:51.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.651+0000 7f7816ebc700 1 --2- 172.21.15.146:0/1720325643 >> v2:172.21.15.151:3300/0 conn(0x7f78100c3910 0x7f78100cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:51.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.651+0000 7f7816ebc700 1 --2- 172.21.15.146:0/1720325643 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78100ced80 0x7f78100c8aa0 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:51.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.651+0000 7f7816ebc700 1 -- 172.21.15.146:0/1720325643 >> 172.21.15.146:0/1720325643 conn(0x7f7810067c50 msgr2=0x7f78100ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:51.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.651+0000 7f7816ebc700 1 -- 172.21.15.146:0/1720325643 shutdown_connections 2023-10-06T11:14:51.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.651+0000 7f7816ebc700 1 -- 172.21.15.146:0/1720325643 wait complete. 2023-10-06T11:14:51.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.652+0000 7f7816ebc700 1 Processor -- start 2023-10-06T11:14:51.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.652+0000 7f7816ebc700 1 -- start start 2023-10-06T11:14:51.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.653+0000 7f7816ebc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78100b0c00 0x7f78100c8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:51.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.653+0000 7f7816ebc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78100c3910 0x7f781009bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:51.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.653+0000 7f7816ebc700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78100ced80 0x7f781016d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:51.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.653+0000 7f7816ebc700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f781016d270 con 0x7f78100c3910 2023-10-06T11:14:51.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.653+0000 7f7816ebc700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78100c8cb0 con 0x7f78100b0c00 2023-10-06T11:14:51.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.653+0000 7f7816ebc700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f781016cf40 con 0x7f78100ced80 2023-10-06T11:14:51.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.653+0000 7f7807fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78100c3910 0x7f781009bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:51.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.653+0000 7f7807fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78100c3910 0x7f781009bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41220/0 (socket says 172.21.15.146:41220) 2023-10-06T11:14:51.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.653+0000 7f7807fff700 1 -- 172.21.15.146:0/961501810 learned_addr learned my addr 172.21.15.146:0/961501810 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:51.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.653+0000 7f7814c58700 1 --2- 172.21.15.146:0/961501810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78100b0c00 0x7f78100c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:51.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.653+0000 7f7815459700 1 --2- 172.21.15.146:0/961501810 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78100ced80 0x7f781016d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:51.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.653+0000 7f7807fff700 1 -- 172.21.15.146:0/961501810 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78100ced80 msgr2=0x7f781016d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:51.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.653+0000 7f7807fff700 1 --2- 172.21.15.146:0/961501810 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78100ced80 0x7f781016d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:51.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.653+0000 7f7807fff700 1 -- 172.21.15.146:0/961501810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78100b0c00 msgr2=0x7f78100c8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:51.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.653+0000 7f7807fff700 1 --2- 172.21.15.146:0/961501810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78100b0c00 0x7f78100c8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:51.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.653+0000 7f7807fff700 1 -- 172.21.15.146:0/961501810 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7800009420 con 0x7f78100c3910 2023-10-06T11:14:51.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.653+0000 7f7807fff700 1 --2- 172.21.15.146:0/961501810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78100c3910 0x7f781009bbd0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f781006e410 tx=0x7f7800017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:51.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.654+0000 7f7804ff9700 1 -- 172.21.15.146:0/961501810 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780000bc20 con 0x7f78100c3910 2023-10-06T11:14:51.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.654+0000 7f7804ff9700 1 -- 172.21.15.146:0/961501810 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7800011420 con 0x7f78100c3910 2023-10-06T11:14:51.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.654+0000 7f7816ebc700 1 -- 172.21.15.146:0/961501810 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f781009c110 con 0x7f78100c3910 2023-10-06T11:14:51.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.654+0000 7f7804ff9700 1 -- 172.21.15.146:0/961501810 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78000117e0 con 0x7f78100c3910 2023-10-06T11:14:51.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.654+0000 7f7816ebc700 1 -- 172.21.15.146:0/961501810 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78100c89d0 con 0x7f78100c3910 2023-10-06T11:14:51.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.655+0000 7f7816ebc700 1 -- 172.21.15.146:0/961501810 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f781016d420 con 0x7f78100c3910 2023-10-06T11:14:51.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.655+0000 7f7804ff9700 1 -- 172.21.15.146:0/961501810 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7800011bd0 con 0x7f78100c3910 2023-10-06T11:14:51.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.655+0000 7f7804ff9700 1 --2- 172.21.15.146:0/961501810 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f77fc066f30 0x7f77fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:51.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.655+0000 7f7804ff9700 1 -- 172.21.15.146:0/961501810 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7800085f00 con 0x7f78100c3910 2023-10-06T11:14:51.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.655+0000 7f7814c58700 1 --2- 172.21.15.146:0/961501810 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f77fc066f30 0x7f77fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:51.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.656+0000 7f7814c58700 1 --2- 172.21.15.146:0/961501810 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f77fc066f30 0x7f77fc0693e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f780c007fd0 tx=0x7f780c007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:51.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.660+0000 7f7804ff9700 1 -- 172.21.15.146:0/961501810 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f781016d420 con 0x7f78100c3910 2023-10-06T11:14:51.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.884+0000 7f7816ebc700 1 -- 172.21.15.146:0/961501810 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f781016d080 con 0x7f78100c3910 2023-10-06T11:14:51.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.885+0000 7f7804ff9700 1 -- 172.21.15.146:0/961501810 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) v1 ==== 95+0+4610 (secure 0 0 0) 0x7f781016d080 con 0x7f78100c3910 2023-10-06T11:14:51.887 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:51.887 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":100,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6560,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/2109567995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2109567995},{"type":"v1","addr":"172.21.15.151:6834","nonce":2109567995}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":6563,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1783565134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":1783565134},{"type":"v1","addr":"172.21.15.151:6835","nonce":1783565134}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7327,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/1323749517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1323749517},{"type":"v1","addr":"172.21.15.146:6836","nonce":1323749517}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:14:18.891938+0000","modified":"2023-10-06T11:14:22.531674+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8103":{"gid":8103,"name":"c","rank":0,"incarnation":97,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/409226151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":409226151},{"type":"v1","addr":"172.21.15.146:6837","nonce":409226151}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-06T11:14:51.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.887+0000 7f7816ebc700 1 -- 172.21.15.146:0/961501810 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f77fc066f30 msgr2=0x7f77fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:51.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.887+0000 7f7816ebc700 1 --2- 172.21.15.146:0/961501810 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f77fc066f30 0x7f77fc0693e0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f780c007fd0 tx=0x7f780c007d30 comp rx=0 tx=0).stop 2023-10-06T11:14:51.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.887+0000 7f7816ebc700 1 -- 172.21.15.146:0/961501810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78100c3910 msgr2=0x7f781009bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:51.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.887+0000 7f7816ebc700 1 --2- 172.21.15.146:0/961501810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78100c3910 0x7f781009bbd0 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f781006e410 tx=0x7f7800017000 comp rx=0 tx=0).stop 2023-10-06T11:14:51.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.887+0000 7f7816ebc700 1 -- 172.21.15.146:0/961501810 shutdown_connections 2023-10-06T11:14:51.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.887+0000 7f7816ebc700 1 --2- 172.21.15.146:0/961501810 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f77fc066f30 0x7f77fc0693e0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:51.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.887+0000 7f7816ebc700 1 --2- 172.21.15.146:0/961501810 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78100ced80 0x7f781016d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:51.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.887+0000 7f7816ebc700 1 --2- 172.21.15.146:0/961501810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78100b0c00 0x7f78100c8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:51.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.887+0000 7f7816ebc700 1 --2- 172.21.15.146:0/961501810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78100c3910 0x7f781009bbd0 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:51.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.887+0000 7f7816ebc700 1 -- 172.21.15.146:0/961501810 >> 172.21.15.146:0/961501810 conn(0x7f7810067c50 msgr2=0x7f78100ccc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:51.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.887+0000 7f7816ebc700 1 -- 172.21.15.146:0/961501810 shutdown_connections 2023-10-06T11:14:51.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:51.887+0000 7f7816ebc700 1 -- 172.21.15.146:0/961501810 wait complete. 2023-10-06T11:14:51.890 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 100 2023-10-06T11:14:51.901 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2023-10-06T11:14:51.901 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T11:14:52.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.013+0000 7fc7080a3700 1 Processor -- start 2023-10-06T11:14:52.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.013+0000 7fc7080a3700 1 -- start start 2023-10-06T11:14:52.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.014+0000 7fc7080a3700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc700068ba0 0x7fc70015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:52.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.014+0000 7fc7080a3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc700153e80 0x7fc7000b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:52.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.014+0000 7fc7080a3700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc70015ac30 con 0x7fc700153ab0 2023-10-06T11:14:52.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.014+0000 7fc7080a3700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7000b4510 con 0x7fc700068ba0 2023-10-06T11:14:52.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.014+0000 7fc7080a3700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7000b6530 con 0x7fc700153e80 2023-10-06T11:14:52.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.014+0000 7fc706640700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc700153e80 0x7fc7000b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:52.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.014+0000 7fc70563e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc700068ba0 0x7fc70015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:52.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.014+0000 7fc705e3f700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fc700153ab0 0x7fc700068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:33544/0 (socket says 172.21.15.146:33544) 2023-10-06T11:14:52.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.014+0000 7fc705e3f700 1 -- 172.21.15.146:0/267077546 learned_addr learned my addr 172.21.15.146:0/267077546 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:14:52.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.014+0000 7fc706640700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc700153e80 0x7fc7000b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:58340/0 (socket says 172.21.15.146:58340) 2023-10-06T11:14:52.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.015+0000 7fc706640700 1 -- 172.21.15.146:0/267077546 >> v2:172.21.15.151:3300/0 conn(0x7fc700068ba0 msgr2=0x7fc70015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:52.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.015+0000 7fc706640700 1 --2- 172.21.15.146:0/267077546 >> v2:172.21.15.151:3300/0 conn(0x7fc700068ba0 0x7fc70015a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:52.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.015+0000 7fc706640700 1 -- 172.21.15.146:0/267077546 >> v1:172.21.15.151:6789/0 conn(0x7fc700153ab0 legacy=0x7fc700068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:52.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.015+0000 7fc706640700 1 -- 172.21.15.146:0/267077546 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7000b5c50 con 0x7fc700153e80 2023-10-06T11:14:52.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.015+0000 7fc706640700 1 --2- 172.21.15.146:0/267077546 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc700153e80 0x7fc7000b49a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc6f8009e60 tx=0x7fc6f8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86b4ab04e3bf1284 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:52.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.015+0000 7fc704e3d700 1 -- 172.21.15.146:0/267077546 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f800e070 con 0x7fc700153e80 2023-10-06T11:14:52.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.015+0000 7fc704e3d700 1 -- 172.21.15.146:0/267077546 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f800bb60 con 0x7fc700153e80 2023-10-06T11:14:52.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.015+0000 7fc704e3d700 1 -- 172.21.15.146:0/267077546 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f8012430 con 0x7fc700153e80 2023-10-06T11:14:52.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.016+0000 7fc7080a3700 1 -- 172.21.15.146:0/267077546 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc700153e80 msgr2=0x7fc7000b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:52.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.016+0000 7fc7080a3700 1 --2- 172.21.15.146:0/267077546 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc700153e80 0x7fc7000b49a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc6f8009e60 tx=0x7fc6f8009780 comp rx=0 tx=0).stop 2023-10-06T11:14:52.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.016+0000 7fc7080a3700 1 -- 172.21.15.146:0/267077546 shutdown_connections 2023-10-06T11:14:52.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.016+0000 7fc7080a3700 1 --2- 172.21.15.146:0/267077546 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc700153e80 0x7fc7000b49a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:52.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.016+0000 7fc7080a3700 1 --2- 172.21.15.146:0/267077546 >> v2:172.21.15.151:3300/0 conn(0x7fc700068ba0 0x7fc70015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:52.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.016+0000 7fc7080a3700 1 -- 172.21.15.146:0/267077546 >> 172.21.15.146:0/267077546 conn(0x7fc70006eba0 msgr2=0x7fc70006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:52.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.016+0000 7fc7080a3700 1 -- 172.21.15.146:0/267077546 shutdown_connections 2023-10-06T11:14:52.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.016+0000 7fc7080a3700 1 -- 172.21.15.146:0/267077546 wait complete. 2023-10-06T11:14:52.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.017+0000 7fc7080a3700 1 Processor -- start 2023-10-06T11:14:52.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.017+0000 7fc7080a3700 1 -- start start 2023-10-06T11:14:52.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.018+0000 7fc7080a3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc700068ba0 0x7fc70013d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:52.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.018+0000 7fc7080a3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc700153ab0 0x7fc700159530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:52.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.018+0000 7fc7080a3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc700153e80 0x7fc700159a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:52.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.018+0000 7fc7080a3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc700154a80 con 0x7fc700153e80 2023-10-06T11:14:52.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.018+0000 7fc7080a3700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc700156ce0 con 0x7fc700068ba0 2023-10-06T11:14:52.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.018+0000 7fc7080a3700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc70015a380 con 0x7fc700153ab0 2023-10-06T11:14:52.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.018+0000 7fc706640700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc700153e80 0x7fc700159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:52.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.018+0000 7fc705e3f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc700068ba0 0x7fc70013d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:52.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.018+0000 7fc705e3f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc700068ba0 0x7fc70013d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:40024/0 (socket says 172.21.15.146:40024) 2023-10-06T11:14:52.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.018+0000 7fc705e3f700 1 -- 172.21.15.146:0/3045909625 learned_addr learned my addr 172.21.15.146:0/3045909625 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:52.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.018+0000 7fc706640700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc700153e80 0x7fc700159a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41234/0 (socket says 172.21.15.146:41234) 2023-10-06T11:14:52.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.018+0000 7fc70563e700 1 --2- 172.21.15.146:0/3045909625 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc700153ab0 0x7fc700159530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:52.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.018+0000 7fc706640700 1 -- 172.21.15.146:0/3045909625 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc700153ab0 msgr2=0x7fc700159530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:52.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.018+0000 7fc706640700 1 --2- 172.21.15.146:0/3045909625 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc700153ab0 0x7fc700159530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:52.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.018+0000 7fc706640700 1 -- 172.21.15.146:0/3045909625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc700068ba0 msgr2=0x7fc70013d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:52.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.018+0000 7fc706640700 1 --2- 172.21.15.146:0/3045909625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc700068ba0 0x7fc70013d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:52.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.018+0000 7fc706640700 1 -- 172.21.15.146:0/3045909625 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f8009a20 con 0x7fc700153e80 2023-10-06T11:14:52.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.018+0000 7fc705e3f700 1 --2- 172.21.15.146:0/3045909625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc700068ba0 0x7fc70013d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:14:52.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.018+0000 7fc70563e700 1 --2- 172.21.15.146:0/3045909625 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc700153ab0 0x7fc700159530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:14:52.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.018+0000 7fc706640700 1 --2- 172.21.15.146:0/3045909625 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc700153e80 0x7fc700159a70 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fc7000b5eb0 tx=0x7fc6f8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:52.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.018+0000 7fc6f5ffb700 1 -- 172.21.15.146:0/3045909625 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f8012e60 con 0x7fc700153e80 2023-10-06T11:14:52.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.018+0000 7fc6f5ffb700 1 -- 172.21.15.146:0/3045909625 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f8027470 con 0x7fc700153e80 2023-10-06T11:14:52.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.018+0000 7fc7080a3700 1 -- 172.21.15.146:0/3045909625 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc70015a0a0 con 0x7fc700153e80 2023-10-06T11:14:52.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.018+0000 7fc6f5ffb700 1 -- 172.21.15.146:0/3045909625 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f8027810 con 0x7fc700153e80 2023-10-06T11:14:52.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.019+0000 7fc7080a3700 1 -- 172.21.15.146:0/3045909625 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc700154710 con 0x7fc700153e80 2023-10-06T11:14:52.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.019+0000 7fc7080a3700 1 -- 172.21.15.146:0/3045909625 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc700154c30 con 0x7fc700153e80 2023-10-06T11:14:52.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.020+0000 7fc6f5ffb700 1 -- 172.21.15.146:0/3045909625 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc6f8024070 con 0x7fc700153e80 2023-10-06T11:14:52.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.020+0000 7fc6f5ffb700 1 --2- 172.21.15.146:0/3045909625 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc6e4066f30 0x7fc6e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:52.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.020+0000 7fc6f5ffb700 1 -- 172.21.15.146:0/3045909625 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc6f80870e0 con 0x7fc700153e80 2023-10-06T11:14:52.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.020+0000 7fc705e3f700 1 --2- 172.21.15.146:0/3045909625 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc6e4066f30 0x7fc6e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:52.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.021+0000 7fc705e3f700 1 --2- 172.21.15.146:0/3045909625 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc6e4066f30 0x7fc6e40693e0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc004900 tx=0x7fc6fc007f70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:52.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.025+0000 7fc6f5ffb700 1 -- 172.21.15.146:0/3045909625 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc6f80541f0 con 0x7fc700153e80 2023-10-06T11:14:52.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.282+0000 7fc7080a3700 1 -- 172.21.15.146:0/3045909625 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fc70004c380 con 0x7fc700153e80 2023-10-06T11:14:52.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.283+0000 7fc6f5ffb700 1 -- 172.21.15.146:0/3045909625 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1603 (secure 0 0 0) 0x7fc6f8057810 con 0x7fc700153e80 2023-10-06T11:14:52.285 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:52.285 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":566,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":113,"num_osds":8,"num_up_osds":8,"osd_up_since":1696590336,"num_in_osds":8,"osd_in_since":1696590327,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":1071,"data_bytes":1077945528,"bytes_used":4673863680,"bytes_avail":768420249600,"bytes_total":773094113280,"write_bytes_sec":31608744,"read_op_per_sec":0,"write_op_per_sec":153},"fsmap":{"epoch":100,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":8103}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2023-10-06T11:14:45.255803+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T11:14:52.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.285+0000 7fc7080a3700 1 -- 172.21.15.146:0/3045909625 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc6e4066f30 msgr2=0x7fc6e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:52.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.285+0000 7fc7080a3700 1 --2- 172.21.15.146:0/3045909625 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc6e4066f30 0x7fc6e40693e0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc004900 tx=0x7fc6fc007f70 comp rx=0 tx=0).stop 2023-10-06T11:14:52.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.285+0000 7fc7080a3700 1 -- 172.21.15.146:0/3045909625 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc700153e80 msgr2=0x7fc700159a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:52.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.285+0000 7fc7080a3700 1 --2- 172.21.15.146:0/3045909625 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc700153e80 0x7fc700159a70 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fc7000b5eb0 tx=0x7fc6f8019000 comp rx=0 tx=0).stop 2023-10-06T11:14:52.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.285+0000 7fc7080a3700 1 -- 172.21.15.146:0/3045909625 shutdown_connections 2023-10-06T11:14:52.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.285+0000 7fc7080a3700 1 --2- 172.21.15.146:0/3045909625 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc6e4066f30 0x7fc6e40693e0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:52.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.285+0000 7fc7080a3700 1 --2- 172.21.15.146:0/3045909625 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc700153e80 0x7fc700159a70 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:52.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.285+0000 7fc7080a3700 1 --2- 172.21.15.146:0/3045909625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc700068ba0 0x7fc70013d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:52.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.285+0000 7fc7080a3700 1 --2- 172.21.15.146:0/3045909625 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc700153ab0 0x7fc700159530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:52.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.285+0000 7fc7080a3700 1 -- 172.21.15.146:0/3045909625 >> 172.21.15.146:0/3045909625 conn(0x7fc70006eba0 msgr2=0x7fc700151cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:52.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.285+0000 7fc7080a3700 1 -- 172.21.15.146:0/3045909625 shutdown_connections 2023-10-06T11:14:52.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:52.285+0000 7fc7080a3700 1 -- 172.21.15.146:0/3045909625 wait complete. 2023-10-06T11:14:52.299 INFO:tasks.cephfs.filesystem.ceph_manager:{'c': 'paused'} 2023-10-06T11:14:53.300 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:14:53.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.420+0000 7fa63e72c700 1 Processor -- start 2023-10-06T11:14:53.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.420+0000 7fa63e72c700 1 -- start start 2023-10-06T11:14:53.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.420+0000 7fa63e72c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa638153e80 0x7fa63815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:53.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.420+0000 7fa63e72c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa63815ac30 con 0x7fa638153ab0 2023-10-06T11:14:53.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.420+0000 7fa63e72c700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6380b4510 con 0x7fa638068ba0 2023-10-06T11:14:53.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.420+0000 7fa63e72c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6380b6530 con 0x7fa638153e80 2023-10-06T11:14:53.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.421+0000 7fa63ccc9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa638153e80 0x7fa63815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:53.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.421+0000 7fa637fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa638153ab0 0x7fa638068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:41582/0 (socket says 172.21.15.146:41582) 2023-10-06T11:14:53.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.421+0000 7fa637fff700 1 -- 172.21.15.146:0/1659283180 learned_addr learned my addr 172.21.15.146:0/1659283180 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:14:53.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.421+0000 7fa63ccc9700 1 -- 172.21.15.146:0/1659283180 >> v1:172.21.15.151:6789/0 conn(0x7fa638068ba0 legacy=0x7fa6380b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:53.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.421+0000 7fa63ccc9700 1 -- 172.21.15.146:0/1659283180 >> v1:172.21.15.146:6789/0 conn(0x7fa638153ab0 legacy=0x7fa638068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:53.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.421+0000 7fa63ccc9700 1 -- 172.21.15.146:0/1659283180 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6380b5c50 con 0x7fa638153e80 2023-10-06T11:14:53.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.421+0000 7fa63ccc9700 1 --2- 172.21.15.146:0/1659283180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa638153e80 0x7fa63815a6f0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fa630009e60 tx=0x7fa630009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6e4a7c81ff744ba server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:53.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.421+0000 7fa636ffd700 1 -- 172.21.15.146:0/1659283180 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63000e070 con 0x7fa638153e80 2023-10-06T11:14:53.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.421+0000 7fa636ffd700 1 -- 172.21.15.146:0/1659283180 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa63000bc30 con 0x7fa638153e80 2023-10-06T11:14:53.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.421+0000 7fa636ffd700 1 -- 172.21.15.146:0/1659283180 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa630012430 con 0x7fa638153e80 2023-10-06T11:14:53.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.422+0000 7fa63e72c700 1 -- 172.21.15.146:0/1659283180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa638153e80 msgr2=0x7fa63815a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:53.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.422+0000 7fa63e72c700 1 --2- 172.21.15.146:0/1659283180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa638153e80 0x7fa63815a6f0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fa630009e60 tx=0x7fa630009780 comp rx=0 tx=0).stop 2023-10-06T11:14:53.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.422+0000 7fa63e72c700 1 -- 172.21.15.146:0/1659283180 shutdown_connections 2023-10-06T11:14:53.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.422+0000 7fa63e72c700 1 --2- 172.21.15.146:0/1659283180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa638153e80 0x7fa63815a6f0 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.422+0000 7fa63e72c700 1 -- 172.21.15.146:0/1659283180 >> 172.21.15.146:0/1659283180 conn(0x7fa63806eba0 msgr2=0x7fa63806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:53.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.422+0000 7fa63e72c700 1 -- 172.21.15.146:0/1659283180 shutdown_connections 2023-10-06T11:14:53.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.422+0000 7fa63e72c700 1 -- 172.21.15.146:0/1659283180 wait complete. 2023-10-06T11:14:53.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.423+0000 7fa63e72c700 1 Processor -- start 2023-10-06T11:14:53.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.423+0000 7fa63e72c700 1 -- start start 2023-10-06T11:14:53.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.424+0000 7fa63e72c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa638068ba0 0x7fa63816a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:53.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.424+0000 7fa63e72c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa638153ab0 0x7fa6380afec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:53.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.424+0000 7fa63e72c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa638153e80 0x7fa638141fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:53.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.424+0000 7fa63e72c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6380b0400 con 0x7fa638068ba0 2023-10-06T11:14:53.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.424+0000 7fa63e72c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa638154800 con 0x7fa638153e80 2023-10-06T11:14:53.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.424+0000 7fa63e72c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa638154df0 con 0x7fa638153ab0 2023-10-06T11:14:53.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.424+0000 7fa637fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa638068ba0 0x7fa63816a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:53.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.424+0000 7fa637fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa638068ba0 0x7fa63816a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41254/0 (socket says 172.21.15.146:41254) 2023-10-06T11:14:53.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.424+0000 7fa637fff700 1 -- 172.21.15.146:0/1175665824 learned_addr learned my addr 172.21.15.146:0/1175665824 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:53.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.424+0000 7fa63ccc9700 1 --2- 172.21.15.146:0/1175665824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa638153e80 0x7fa638141fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:53.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.424+0000 7fa6377fe700 1 --2- 172.21.15.146:0/1175665824 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa638153ab0 0x7fa6380afec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:53.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.424+0000 7fa637fff700 1 -- 172.21.15.146:0/1175665824 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa638153ab0 msgr2=0x7fa6380afec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:53.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.424+0000 7fa637fff700 1 --2- 172.21.15.146:0/1175665824 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa638153ab0 0x7fa6380afec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.424+0000 7fa637fff700 1 -- 172.21.15.146:0/1175665824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa638153e80 msgr2=0x7fa638141fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:53.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.424+0000 7fa637fff700 1 --2- 172.21.15.146:0/1175665824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa638153e80 0x7fa638141fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.424+0000 7fa637fff700 1 -- 172.21.15.146:0/1175665824 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa630009a20 con 0x7fa638068ba0 2023-10-06T11:14:53.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.424+0000 7fa63ccc9700 1 --2- 172.21.15.146:0/1175665824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa638153e80 0x7fa638141fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:53.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.424+0000 7fa637fff700 1 --2- 172.21.15.146:0/1175665824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa638068ba0 0x7fa63816a7a0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7fa62800c7c0 tx=0x7fa628007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:53.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.424+0000 7fa61ffff700 1 -- 172.21.15.146:0/1175665824 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa628005b30 con 0x7fa638068ba0 2023-10-06T11:14:53.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.424+0000 7fa61ffff700 1 -- 172.21.15.146:0/1175665824 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa628005cb0 con 0x7fa638068ba0 2023-10-06T11:14:53.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.424+0000 7fa63e72c700 1 -- 172.21.15.146:0/1175665824 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6381550d0 con 0x7fa638068ba0 2023-10-06T11:14:53.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.424+0000 7fa61ffff700 1 -- 172.21.15.146:0/1175665824 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa628004a80 con 0x7fa638068ba0 2023-10-06T11:14:53.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.425+0000 7fa63e72c700 1 -- 172.21.15.146:0/1175665824 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa638142510 con 0x7fa638068ba0 2023-10-06T11:14:53.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.425+0000 7fa63e72c700 1 -- 172.21.15.146:0/1175665824 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa63804c380 con 0x7fa638068ba0 2023-10-06T11:14:53.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.426+0000 7fa61ffff700 1 -- 172.21.15.146:0/1175665824 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa6280070f0 con 0x7fa638068ba0 2023-10-06T11:14:53.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.426+0000 7fa61ffff700 1 --2- 172.21.15.146:0/1175665824 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa624066f30 0x7fa6240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:53.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.426+0000 7fa61ffff700 1 -- 172.21.15.146:0/1175665824 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa628083980 con 0x7fa638068ba0 2023-10-06T11:14:53.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.426+0000 7fa6377fe700 1 --2- 172.21.15.146:0/1175665824 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa624066f30 0x7fa6240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:53.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.427+0000 7fa6377fe700 1 --2- 172.21.15.146:0/1175665824 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa624066f30 0x7fa6240693e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa62c006fd0 tx=0x7fa62c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:53.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.430+0000 7fa61ffff700 1 -- 172.21.15.146:0/1175665824 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa628050b10 con 0x7fa638068ba0 2023-10-06T11:14:53.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.688+0000 7fa63e72c700 1 -- 172.21.15.146:0/1175665824 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa63815ac30 con 0x7fa638068ba0 2023-10-06T11:14:53.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.688+0000 7fa61ffff700 1 -- 172.21.15.146:0/1175665824 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) v1 ==== 95+0+4610 (secure 0 0 0) 0x7fa63815ac30 con 0x7fa638068ba0 2023-10-06T11:14:53.689 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:53.689 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":100,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6560,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/2109567995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2109567995},{"type":"v1","addr":"172.21.15.151:6834","nonce":2109567995}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":6563,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1783565134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":1783565134},{"type":"v1","addr":"172.21.15.151:6835","nonce":1783565134}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7327,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/1323749517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1323749517},{"type":"v1","addr":"172.21.15.146:6836","nonce":1323749517}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:14:18.891938+0000","modified":"2023-10-06T11:14:22.531674+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8103":{"gid":8103,"name":"c","rank":0,"incarnation":97,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/409226151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":409226151},{"type":"v1","addr":"172.21.15.146:6837","nonce":409226151}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-06T11:14:53.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.690+0000 7fa63e72c700 1 -- 172.21.15.146:0/1175665824 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa624066f30 msgr2=0x7fa6240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:53.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.690+0000 7fa63e72c700 1 --2- 172.21.15.146:0/1175665824 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa624066f30 0x7fa6240693e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa62c006fd0 tx=0x7fa62c008040 comp rx=0 tx=0).stop 2023-10-06T11:14:53.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.690+0000 7fa63e72c700 1 -- 172.21.15.146:0/1175665824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa638068ba0 msgr2=0x7fa63816a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:53.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.690+0000 7fa63e72c700 1 --2- 172.21.15.146:0/1175665824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa638068ba0 0x7fa63816a7a0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7fa62800c7c0 tx=0x7fa628007f70 comp rx=0 tx=0).stop 2023-10-06T11:14:53.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.690+0000 7fa63e72c700 1 -- 172.21.15.146:0/1175665824 shutdown_connections 2023-10-06T11:14:53.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.690+0000 7fa63e72c700 1 --2- 172.21.15.146:0/1175665824 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa624066f30 0x7fa6240693e0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.690+0000 7fa63e72c700 1 --2- 172.21.15.146:0/1175665824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa638153e80 0x7fa638141fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.690+0000 7fa63e72c700 1 --2- 172.21.15.146:0/1175665824 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa638068ba0 0x7fa63816a7a0 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.690+0000 7fa63e72c700 1 --2- 172.21.15.146:0/1175665824 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa638153ab0 0x7fa6380afec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.690+0000 7fa63e72c700 1 -- 172.21.15.146:0/1175665824 >> 172.21.15.146:0/1175665824 conn(0x7fa63806eba0 msgr2=0x7fa6380cf440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:53.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.690+0000 7fa63e72c700 1 -- 172.21.15.146:0/1175665824 shutdown_connections 2023-10-06T11:14:53.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.690+0000 7fa63e72c700 1 -- 172.21.15.146:0/1175665824 wait complete. 2023-10-06T11:14:53.692 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 100 2023-10-06T11:14:53.703 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2023-10-06T11:14:53.704 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T11:14:53.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.816+0000 7f7ab700f700 1 Processor -- start 2023-10-06T11:14:53.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.816+0000 7f7ab700f700 1 -- start start 2023-10-06T11:14:53.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.817+0000 7f7ab700f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ab0153ab0 0x7f7ab015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:53.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.817+0000 7f7ab700f700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7ab0068ba0 0x7f7ab00b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:53.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.817+0000 7f7ab700f700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ab015ac30 con 0x7f7ab0153e80 2023-10-06T11:14:53.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.817+0000 7f7ab700f700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ab00b4510 con 0x7f7ab0068ba0 2023-10-06T11:14:53.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.817+0000 7f7ab700f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab00b6530 con 0x7f7ab0153ab0 2023-10-06T11:14:53.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.818+0000 7f7ab4dab700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ab0153ab0 0x7f7ab015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:53.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.818+0000 7f7ab4dab700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ab0153ab0 0x7f7ab015a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:58362/0 (socket says 172.21.15.146:58362) 2023-10-06T11:14:53.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.818+0000 7f7ab4dab700 1 -- 172.21.15.146:0/2009921874 learned_addr learned my addr 172.21.15.146:0/2009921874 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:53.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.818+0000 7f7ab55ac700 1 --2- 172.21.15.146:0/2009921874 >> v2:172.21.15.151:3300/0 conn(0x7f7ab0068ba0 0x7f7ab00b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:53.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.818+0000 7f7ab4dab700 1 -- 172.21.15.146:0/2009921874 >> v2:172.21.15.151:3300/0 conn(0x7f7ab0068ba0 msgr2=0x7f7ab00b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:53.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.818+0000 7f7ab4dab700 1 --2- 172.21.15.146:0/2009921874 >> v2:172.21.15.151:3300/0 conn(0x7f7ab0068ba0 0x7f7ab00b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.818+0000 7f7ab4dab700 1 -- 172.21.15.146:0/2009921874 >> v1:172.21.15.151:6789/0 conn(0x7f7ab0153e80 legacy=0x7f7ab0068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:53.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.818+0000 7f7ab4dab700 1 -- 172.21.15.146:0/2009921874 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab00b5c50 con 0x7f7ab0153ab0 2023-10-06T11:14:53.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.818+0000 7f7ab55ac700 1 --2- 172.21.15.146:0/2009921874 >> v2:172.21.15.151:3300/0 conn(0x7f7ab0068ba0 0x7f7ab00b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:14:53.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.818+0000 7f7ab4dab700 1 --2- 172.21.15.146:0/2009921874 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ab0153ab0 0x7f7ab015a6f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7aac0099b0 tx=0x7f7aac009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e98d54ced566d12 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:53.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.818+0000 7f7aa77fe700 1 -- 172.21.15.146:0/2009921874 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac009ea0 con 0x7f7ab0153ab0 2023-10-06T11:14:53.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.818+0000 7f7aa77fe700 1 -- 172.21.15.146:0/2009921874 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aac00b860 con 0x7f7ab0153ab0 2023-10-06T11:14:53.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.818+0000 7f7aa77fe700 1 -- 172.21.15.146:0/2009921874 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac00bc00 con 0x7f7ab0153ab0 2023-10-06T11:14:53.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.819+0000 7f7ab700f700 1 -- 172.21.15.146:0/2009921874 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ab0153ab0 msgr2=0x7f7ab015a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:53.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.819+0000 7f7ab700f700 1 --2- 172.21.15.146:0/2009921874 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ab0153ab0 0x7f7ab015a6f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7aac0099b0 tx=0x7f7aac009250 comp rx=0 tx=0).stop 2023-10-06T11:14:53.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.819+0000 7f7ab700f700 1 -- 172.21.15.146:0/2009921874 shutdown_connections 2023-10-06T11:14:53.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.819+0000 7f7ab700f700 1 --2- 172.21.15.146:0/2009921874 >> v2:172.21.15.151:3300/0 conn(0x7f7ab0068ba0 0x7f7ab00b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.819+0000 7f7ab700f700 1 --2- 172.21.15.146:0/2009921874 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ab0153ab0 0x7f7ab015a6f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.819+0000 7f7ab700f700 1 -- 172.21.15.146:0/2009921874 >> 172.21.15.146:0/2009921874 conn(0x7f7ab006eba0 msgr2=0x7f7ab006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:53.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.819+0000 7f7ab700f700 1 -- 172.21.15.146:0/2009921874 shutdown_connections 2023-10-06T11:14:53.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.819+0000 7f7ab700f700 1 -- 172.21.15.146:0/2009921874 wait complete. 2023-10-06T11:14:53.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.820+0000 7f7ab700f700 1 Processor -- start 2023-10-06T11:14:53.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.820+0000 7f7ab700f700 1 -- start start 2023-10-06T11:14:53.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.821+0000 7f7ab700f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ab0068ba0 0x7f7ab014dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:53.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.821+0000 7f7ab700f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ab0153ab0 0x7f7ab01376c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:53.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.821+0000 7f7ab700f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ab0153e80 0x7f7ab015e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:53.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.821+0000 7f7ab700f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab014e0e0 con 0x7f7ab0068ba0 2023-10-06T11:14:53.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.821+0000 7f7ab700f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab0169c20 con 0x7f7ab0153e80 2023-10-06T11:14:53.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.821+0000 7f7ab700f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ab0169f00 con 0x7f7ab0153ab0 2023-10-06T11:14:53.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.821+0000 7f7ab4dab700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ab0068ba0 0x7f7ab014dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:53.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.821+0000 7f7ab4dab700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ab0068ba0 0x7f7ab014dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41270/0 (socket says 172.21.15.146:41270) 2023-10-06T11:14:53.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.821+0000 7f7ab4dab700 1 -- 172.21.15.146:0/1410860358 learned_addr learned my addr 172.21.15.146:0/1410860358 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:53.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.821+0000 7f7ab55ac700 1 --2- 172.21.15.146:0/1410860358 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ab0153e80 0x7f7ab015e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:53.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.821+0000 7f7aa7fff700 1 --2- 172.21.15.146:0/1410860358 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ab0153ab0 0x7f7ab01376c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:53.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.821+0000 7f7ab4dab700 1 -- 172.21.15.146:0/1410860358 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ab0153ab0 msgr2=0x7f7ab01376c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:53.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.821+0000 7f7ab4dab700 1 --2- 172.21.15.146:0/1410860358 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ab0153ab0 0x7f7ab01376c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.821+0000 7f7ab4dab700 1 -- 172.21.15.146:0/1410860358 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ab0153e80 msgr2=0x7f7ab015e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:53.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.821+0000 7f7ab4dab700 1 --2- 172.21.15.146:0/1410860358 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ab0153e80 0x7f7ab015e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:53.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.821+0000 7f7ab4dab700 1 -- 172.21.15.146:0/1410860358 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa8009a20 con 0x7f7ab0068ba0 2023-10-06T11:14:53.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.822+0000 7f7ab4dab700 1 --2- 172.21.15.146:0/1410860358 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ab0068ba0 0x7f7ab014dba0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f7ab00b6670 tx=0x7f7aac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:53.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.822+0000 7f7aa4ff9700 1 -- 172.21.15.146:0/1410860358 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac000d10 con 0x7f7ab0068ba0 2023-10-06T11:14:53.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.822+0000 7f7aa4ff9700 1 -- 172.21.15.146:0/1410860358 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aac00bbe0 con 0x7f7ab0068ba0 2023-10-06T11:14:53.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.822+0000 7f7ab700f700 1 -- 172.21.15.146:0/1410860358 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aac0094f0 con 0x7f7ab0068ba0 2023-10-06T11:14:53.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.822+0000 7f7aa4ff9700 1 -- 172.21.15.146:0/1410860358 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac011670 con 0x7f7ab0068ba0 2023-10-06T11:14:53.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.822+0000 7f7ab700f700 1 -- 172.21.15.146:0/1410860358 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ab016a4c0 con 0x7f7ab0068ba0 2023-10-06T11:14:53.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.823+0000 7f7ab700f700 1 -- 172.21.15.146:0/1410860358 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ab016aae0 con 0x7f7ab0068ba0 2023-10-06T11:14:53.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.823+0000 7f7aa4ff9700 1 -- 172.21.15.146:0/1410860358 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7aac011aa0 con 0x7f7ab0068ba0 2023-10-06T11:14:53.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.824+0000 7f7aa4ff9700 1 --2- 172.21.15.146:0/1410860358 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7a9c066f30 0x7f7a9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:53.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.824+0000 7f7aa7fff700 1 --2- 172.21.15.146:0/1410860358 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7a9c066f30 0x7f7a9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:53.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.824+0000 7f7aa4ff9700 1 -- 172.21.15.146:0/1410860358 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7aac085ef0 con 0x7f7ab0068ba0 2023-10-06T11:14:53.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.824+0000 7f7aa7fff700 1 --2- 172.21.15.146:0/1410860358 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7a9c066f30 0x7f7a9c0693e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f7ab00cc4e0 tx=0x7f7aa0007ec0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:53.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:53.828+0000 7f7aa4ff9700 1 -- 172.21.15.146:0/1410860358 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7aac053000 con 0x7f7ab0068ba0 2023-10-06T11:14:54.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:54.085+0000 7f7ab700f700 1 -- 172.21.15.146:0/1410860358 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f7ab004c380 con 0x7f7ab0068ba0 2023-10-06T11:14:54.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:54.086+0000 7f7aa4ff9700 1 -- 172.21.15.146:0/1410860358 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1603 (secure 0 0 0) 0x7f7aac056620 con 0x7f7ab0068ba0 2023-10-06T11:14:54.087 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:54.087 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":568,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":113,"num_osds":8,"num_up_osds":8,"osd_up_since":1696590336,"num_in_osds":8,"osd_in_since":1696590327,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":1071,"data_bytes":1078380240,"bytes_used":4674732032,"bytes_avail":768419381248,"bytes_total":773094113280,"write_bytes_sec":31645167,"read_op_per_sec":0,"write_op_per_sec":153},"fsmap":{"epoch":100,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":8103}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":21,"modified":"2023-10-06T11:14:45.255803+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T11:14:54.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:54.088+0000 7f7ab700f700 1 -- 172.21.15.146:0/1410860358 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7a9c066f30 msgr2=0x7f7a9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:54.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:54.088+0000 7f7ab700f700 1 --2- 172.21.15.146:0/1410860358 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7a9c066f30 0x7f7a9c0693e0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f7ab00cc4e0 tx=0x7f7aa0007ec0 comp rx=0 tx=0).stop 2023-10-06T11:14:54.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:54.088+0000 7f7ab700f700 1 -- 172.21.15.146:0/1410860358 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ab0068ba0 msgr2=0x7f7ab014dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:54.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:54.088+0000 7f7ab700f700 1 --2- 172.21.15.146:0/1410860358 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ab0068ba0 0x7f7ab014dba0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f7ab00b6670 tx=0x7f7aac017000 comp rx=0 tx=0).stop 2023-10-06T11:14:54.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:54.088+0000 7f7ab700f700 1 -- 172.21.15.146:0/1410860358 shutdown_connections 2023-10-06T11:14:54.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:54.088+0000 7f7ab700f700 1 --2- 172.21.15.146:0/1410860358 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7a9c066f30 0x7f7a9c0693e0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:54.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:54.088+0000 7f7ab700f700 1 --2- 172.21.15.146:0/1410860358 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ab0153e80 0x7f7ab015e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:54.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:54.088+0000 7f7ab700f700 1 --2- 172.21.15.146:0/1410860358 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ab0068ba0 0x7f7ab014dba0 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:54.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:54.088+0000 7f7ab700f700 1 --2- 172.21.15.146:0/1410860358 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ab0153ab0 0x7f7ab01376c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:54.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:54.088+0000 7f7ab700f700 1 -- 172.21.15.146:0/1410860358 >> 172.21.15.146:0/1410860358 conn(0x7f7ab006eba0 msgr2=0x7f7ab0151dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:54.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:54.088+0000 7f7ab700f700 1 -- 172.21.15.146:0/1410860358 shutdown_connections 2023-10-06T11:14:54.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:54.088+0000 7f7ab700f700 1 -- 172.21.15.146:0/1410860358 wait complete. 2023-10-06T11:14:54.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'c': 'paused'} 2023-10-06T11:14:55.101 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:14:55.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.220+0000 7fa9a14f3700 1 Processor -- start 2023-10-06T11:14:55.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.220+0000 7fa9a14f3700 1 -- start start 2023-10-06T11:14:55.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.221+0000 7fa9a14f3700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa99c157430 0x7fa99c157800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:55.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.221+0000 7fa9a14f3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa99c0ab010 0x7fa99c0ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:55.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.221+0000 7fa9a14f3700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa99c0cf0b0 con 0x7fa99c0cc240 2023-10-06T11:14:55.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.221+0000 7fa9a14f3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa99c0c3dd0 con 0x7fa99c0ab010 2023-10-06T11:14:55.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.221+0000 7fa9a14f3700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa99c0ccf20 con 0x7fa99c157430 2023-10-06T11:14:55.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.221+0000 7fa9927fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa99c0ab010 0x7fa99c0ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:55.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.221+0000 7fa9927fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa99c0ab010 0x7fa99c0ceb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41286/0 (socket says 172.21.15.146:41286) 2023-10-06T11:14:55.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.221+0000 7fa9927fc700 1 -- 172.21.15.146:0/3248821075 learned_addr learned my addr 172.21.15.146:0/3248821075 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:55.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.221+0000 7fa99affd700 1 --2- 172.21.15.146:0/3248821075 >> v2:172.21.15.151:3300/0 conn(0x7fa99c157430 0x7fa99c157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:55.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.222+0000 7fa9927fc700 1 -- 172.21.15.146:0/3248821075 >> v2:172.21.15.151:3300/0 conn(0x7fa99c157430 msgr2=0x7fa99c157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:55.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.222+0000 7fa9927fc700 1 --2- 172.21.15.146:0/3248821075 >> v2:172.21.15.151:3300/0 conn(0x7fa99c157430 0x7fa99c157800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:55.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.222+0000 7fa9927fc700 1 -- 172.21.15.146:0/3248821075 >> v1:172.21.15.151:6789/0 conn(0x7fa99c0cc240 legacy=0x7fa99c0cc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:55.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.222+0000 7fa9927fc700 1 -- 172.21.15.146:0/3248821075 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa99c0cd200 con 0x7fa99c0ab010 2023-10-06T11:14:55.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.222+0000 7fa9927fc700 1 --2- 172.21.15.146:0/3248821075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa99c0ab010 0x7fa99c0ceb70 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fa99c06eec0 tx=0x7fa984009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ded646e6903c28d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:55.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.222+0000 7fa99a7fc700 1 -- 172.21.15.146:0/3248821075 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa984009e70 con 0x7fa99c0ab010 2023-10-06T11:14:55.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.222+0000 7fa99a7fc700 1 -- 172.21.15.146:0/3248821075 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa98400b860 con 0x7fa99c0ab010 2023-10-06T11:14:55.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.222+0000 7fa99a7fc700 1 -- 172.21.15.146:0/3248821075 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98400bc20 con 0x7fa99c0ab010 2023-10-06T11:14:55.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.222+0000 7fa9a14f3700 1 -- 172.21.15.146:0/3248821075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa99c0ab010 msgr2=0x7fa99c0ceb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:55.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.222+0000 7fa9a14f3700 1 --2- 172.21.15.146:0/3248821075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa99c0ab010 0x7fa99c0ceb70 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fa99c06eec0 tx=0x7fa984009250 comp rx=0 tx=0).stop 2023-10-06T11:14:55.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.222+0000 7fa9a14f3700 1 -- 172.21.15.146:0/3248821075 shutdown_connections 2023-10-06T11:14:55.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.222+0000 7fa9a14f3700 1 --2- 172.21.15.146:0/3248821075 >> v2:172.21.15.151:3300/0 conn(0x7fa99c157430 0x7fa99c157800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:55.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.222+0000 7fa9a14f3700 1 --2- 172.21.15.146:0/3248821075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa99c0ab010 0x7fa99c0ceb70 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:55.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.222+0000 7fa9a14f3700 1 -- 172.21.15.146:0/3248821075 >> 172.21.15.146:0/3248821075 conn(0x7fa99c067c50 msgr2=0x7fa99c0ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:55.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.222+0000 7fa9a14f3700 1 -- 172.21.15.146:0/3248821075 shutdown_connections 2023-10-06T11:14:55.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.222+0000 7fa9a14f3700 1 -- 172.21.15.146:0/3248821075 wait complete. 2023-10-06T11:14:55.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.224+0000 7fa9a14f3700 1 Processor -- start 2023-10-06T11:14:55.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.224+0000 7fa9a14f3700 1 -- start start 2023-10-06T11:14:55.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.224+0000 7fa9a14f3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa99c0ab010 0x7fa99c153420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:55.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.224+0000 7fa9a14f3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa99c0cc240 0x7fa99c154a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:55.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.224+0000 7fa9a14f3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa99c157430 0x7fa99c154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:55.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.224+0000 7fa9a14f3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c0c6590 con 0x7fa99c0ab010 2023-10-06T11:14:55.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.224+0000 7fa9a14f3700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c0c6870 con 0x7fa99c0cc240 2023-10-06T11:14:55.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.224+0000 7fa9a14f3700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c0c6b50 con 0x7fa99c157430 2023-10-06T11:14:55.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.224+0000 7fa99affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa99c0ab010 0x7fa99c153420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:55.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.224+0000 7fa99affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa99c0ab010 0x7fa99c153420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41298/0 (socket says 172.21.15.146:41298) 2023-10-06T11:14:55.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.224+0000 7fa99affd700 1 -- 172.21.15.146:0/1804212587 learned_addr learned my addr 172.21.15.146:0/1804212587 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:55.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.225+0000 7fa9927fc700 1 --2- 172.21.15.146:0/1804212587 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa99c0cc240 0x7fa99c154a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:55.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.225+0000 7fa99b7fe700 1 --2- 172.21.15.146:0/1804212587 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa99c157430 0x7fa99c154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:55.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.225+0000 7fa99affd700 1 -- 172.21.15.146:0/1804212587 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa99c157430 msgr2=0x7fa99c154f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:55.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.225+0000 7fa99affd700 1 --2- 172.21.15.146:0/1804212587 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa99c157430 0x7fa99c154f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:55.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.225+0000 7fa99affd700 1 -- 172.21.15.146:0/1804212587 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa99c0cc240 msgr2=0x7fa99c154a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:55.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.225+0000 7fa99affd700 1 --2- 172.21.15.146:0/1804212587 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa99c0cc240 0x7fa99c154a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:55.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.225+0000 7fa99affd700 1 -- 172.21.15.146:0/1804212587 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9840094f0 con 0x7fa99c0ab010 2023-10-06T11:14:55.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.225+0000 7fa99b7fe700 1 --2- 172.21.15.146:0/1804212587 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa99c157430 0x7fa99c154f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:55.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.225+0000 7fa99affd700 1 --2- 172.21.15.146:0/1804212587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa99c0ab010 0x7fa99c153420 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fa98c00e930 tx=0x7fa98c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:55.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.225+0000 7fa9937fe700 1 -- 172.21.15.146:0/1804212587 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98c013680 con 0x7fa99c0ab010 2023-10-06T11:14:55.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.225+0000 7fa9937fe700 1 -- 172.21.15.146:0/1804212587 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa98c0137e0 con 0x7fa99c0ab010 2023-10-06T11:14:55.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.225+0000 7fa9937fe700 1 -- 172.21.15.146:0/1804212587 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98c013b80 con 0x7fa99c0ab010 2023-10-06T11:14:55.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.225+0000 7fa9a14f3700 1 -- 172.21.15.146:0/1804212587 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa99c0c6e30 con 0x7fa99c0ab010 2023-10-06T11:14:55.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.225+0000 7fa9a14f3700 1 -- 172.21.15.146:0/1804212587 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa99c0af020 con 0x7fa99c0ab010 2023-10-06T11:14:55.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.226+0000 7fa9a14f3700 1 -- 172.21.15.146:0/1804212587 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa99c0af270 con 0x7fa99c0ab010 2023-10-06T11:14:55.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.226+0000 7fa9937fe700 1 -- 172.21.15.146:0/1804212587 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa98c00c460 con 0x7fa99c0ab010 2023-10-06T11:14:55.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.227+0000 7fa9937fe700 1 --2- 172.21.15.146:0/1804212587 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa97c066f30 0x7fa97c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:55.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.227+0000 7fa9937fe700 1 -- 172.21.15.146:0/1804212587 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa98c084800 con 0x7fa99c0ab010 2023-10-06T11:14:55.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.227+0000 7fa9927fc700 1 --2- 172.21.15.146:0/1804212587 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa97c066f30 0x7fa97c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:55.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.227+0000 7fa9927fc700 1 --2- 172.21.15.146:0/1804212587 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa97c066f30 0x7fa97c0693e0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fa99c06eec0 tx=0x7fa984017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:55.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.231+0000 7fa9937fe700 1 -- 172.21.15.146:0/1804212587 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa98c051910 con 0x7fa99c0ab010 2023-10-06T11:14:55.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.460+0000 7fa9a14f3700 1 -- 172.21.15.146:0/1804212587 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa99c04c380 con 0x7fa99c0ab010 2023-10-06T11:14:55.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.461+0000 7fa9937fe700 1 -- 172.21.15.146:0/1804212587 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) v1 ==== 95+0+4610 (secure 0 0 0) 0x7fa98c054f30 con 0x7fa99c0ab010 2023-10-06T11:14:55.462 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:55.462 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":100,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6560,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/2109567995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2109567995},{"type":"v1","addr":"172.21.15.151:6834","nonce":2109567995}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":6563,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1783565134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":1783565134},{"type":"v1","addr":"172.21.15.151:6835","nonce":1783565134}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7327,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/1323749517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1323749517},{"type":"v1","addr":"172.21.15.146:6836","nonce":1323749517}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:14:18.891938+0000","modified":"2023-10-06T11:14:22.531674+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8103":{"gid":8103,"name":"c","rank":0,"incarnation":97,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/409226151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":409226151},{"type":"v1","addr":"172.21.15.146:6837","nonce":409226151}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-06T11:14:55.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.463+0000 7fa9a14f3700 1 -- 172.21.15.146:0/1804212587 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa97c066f30 msgr2=0x7fa97c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:55.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.463+0000 7fa9a14f3700 1 --2- 172.21.15.146:0/1804212587 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa97c066f30 0x7fa97c0693e0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fa99c06eec0 tx=0x7fa984017000 comp rx=0 tx=0).stop 2023-10-06T11:14:55.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.463+0000 7fa9a14f3700 1 -- 172.21.15.146:0/1804212587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa99c0ab010 msgr2=0x7fa99c153420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:55.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.463+0000 7fa9a14f3700 1 --2- 172.21.15.146:0/1804212587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa99c0ab010 0x7fa99c153420 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fa98c00e930 tx=0x7fa98c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:55.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.463+0000 7fa9a14f3700 1 -- 172.21.15.146:0/1804212587 shutdown_connections 2023-10-06T11:14:55.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.463+0000 7fa9a14f3700 1 --2- 172.21.15.146:0/1804212587 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa97c066f30 0x7fa97c0693e0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:55.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.463+0000 7fa9a14f3700 1 --2- 172.21.15.146:0/1804212587 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa99c157430 0x7fa99c154f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:55.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.463+0000 7fa9a14f3700 1 --2- 172.21.15.146:0/1804212587 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa99c0ab010 0x7fa99c153420 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:55.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.463+0000 7fa9a14f3700 1 --2- 172.21.15.146:0/1804212587 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa99c0cc240 0x7fa99c154a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:55.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.463+0000 7fa9a14f3700 1 -- 172.21.15.146:0/1804212587 >> 172.21.15.146:0/1804212587 conn(0x7fa99c067c50 msgr2=0x7fa99c153d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:55.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.463+0000 7fa9a14f3700 1 -- 172.21.15.146:0/1804212587 shutdown_connections 2023-10-06T11:14:55.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.463+0000 7fa9a14f3700 1 -- 172.21.15.146:0/1804212587 wait complete. 2023-10-06T11:14:55.467 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 100 2023-10-06T11:14:55.476 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2023-10-06T11:14:55.477 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T11:14:55.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.591+0000 7f52bd6fb700 1 Processor -- start 2023-10-06T11:14:55.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.591+0000 7f52bd6fb700 1 -- start start 2023-10-06T11:14:55.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.591+0000 7f52bd6fb700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f52b80b28e0 0x7f52b80c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:55.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.591+0000 7f52bd6fb700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f52b80c53f0 0x7f52b80cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:55.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.591+0000 7f52bd6fb700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52b80ad2a0 con 0x7f52b80b2cb0 2023-10-06T11:14:55.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.591+0000 7f52bd6fb700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52b8099ec0 con 0x7f52b80c53f0 2023-10-06T11:14:55.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.591+0000 7f52bd6fb700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52b80c7240 con 0x7f52b80b28e0 2023-10-06T11:14:55.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.592+0000 7f52b6ffd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f52b80b28e0 0x7f52b80c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:55.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.592+0000 7f52ae7fc700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f52b80c53f0 0x7f52b80cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:55.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.592+0000 7f52b77fe700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f52b80b2cb0 0x7f52b815d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:33590/0 (socket says 172.21.15.146:33590) 2023-10-06T11:14:55.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.592+0000 7f52b77fe700 1 -- 172.21.15.146:0/2441774311 learned_addr learned my addr 172.21.15.146:0/2441774311 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:14:55.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.592+0000 7f52ae7fc700 1 -- 172.21.15.146:0/2441774311 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f52b80b28e0 msgr2=0x7f52b80c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:55.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.592+0000 7f52ae7fc700 1 --2- 172.21.15.146:0/2441774311 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f52b80b28e0 0x7f52b80c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:55.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.592+0000 7f52ae7fc700 1 -- 172.21.15.146:0/2441774311 >> v1:172.21.15.151:6789/0 conn(0x7f52b80b2cb0 legacy=0x7f52b815d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:55.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.592+0000 7f52ae7fc700 1 -- 172.21.15.146:0/2441774311 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b80c69a0 con 0x7f52b80c53f0 2023-10-06T11:14:55.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.592+0000 7f52b67fc700 1 -- 172.21.15.146:0/2441774311 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1470366457 0 0) 0x7f52b80ad2a0 con 0x7f52b80b2cb0 2023-10-06T11:14:55.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.592+0000 7f52ae7fc700 1 --2- 172.21.15.146:0/2441774311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52b80c53f0 0x7f52b80cebc0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f52a00098e0 tx=0x7f52a00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7592b9269129f979 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:55.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.593+0000 7f52b67fc700 1 -- 172.21.15.146:0/2441774311 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a000b640 con 0x7f52b80c53f0 2023-10-06T11:14:55.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.593+0000 7f52b67fc700 1 -- 172.21.15.146:0/2441774311 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52a000b7a0 con 0x7f52b80c53f0 2023-10-06T11:14:55.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.593+0000 7f52b67fc700 1 -- 172.21.15.146:0/2441774311 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a000bb40 con 0x7f52b80c53f0 2023-10-06T11:14:55.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.593+0000 7f52bd6fb700 1 -- 172.21.15.146:0/2441774311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52b80c53f0 msgr2=0x7f52b80cebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:55.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.593+0000 7f52bd6fb700 1 --2- 172.21.15.146:0/2441774311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52b80c53f0 0x7f52b80cebc0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f52a00098e0 tx=0x7f52a00091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:55.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.593+0000 7f52bd6fb700 1 -- 172.21.15.146:0/2441774311 shutdown_connections 2023-10-06T11:14:55.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.593+0000 7f52bd6fb700 1 --2- 172.21.15.146:0/2441774311 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f52b80b28e0 0x7f52b80c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:55.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.593+0000 7f52bd6fb700 1 --2- 172.21.15.146:0/2441774311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52b80c53f0 0x7f52b80cebc0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:55.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.593+0000 7f52bd6fb700 1 -- 172.21.15.146:0/2441774311 >> 172.21.15.146:0/2441774311 conn(0x7f52b80999a0 msgr2=0x7f52b806f380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:55.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.593+0000 7f52bd6fb700 1 -- 172.21.15.146:0/2441774311 shutdown_connections 2023-10-06T11:14:55.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.593+0000 7f52bd6fb700 1 -- 172.21.15.146:0/2441774311 wait complete. 2023-10-06T11:14:55.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.594+0000 7f52bd6fb700 1 Processor -- start 2023-10-06T11:14:55.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.594+0000 7f52bd6fb700 1 -- start start 2023-10-06T11:14:55.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.595+0000 7f52bd6fb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52b80b28e0 0x7f52b80cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:55.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.595+0000 7f52bd6fb700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52b80b2cb0 0x7f52b80b3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:55.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.595+0000 7f52bd6fb700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f52b80c53f0 0x7f52b8155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:55.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.595+0000 7f52bd6fb700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b80cc040 con 0x7f52b80b28e0 2023-10-06T11:14:55.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.595+0000 7f52bd6fb700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b80cc320 con 0x7f52b80b2cb0 2023-10-06T11:14:55.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.595+0000 7f52bd6fb700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52b80cc600 con 0x7f52b80c53f0 2023-10-06T11:14:55.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.595+0000 7f52b6ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52b80b28e0 0x7f52b80cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:55.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.595+0000 7f52b6ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52b80b28e0 0x7f52b80cd3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41302/0 (socket says 172.21.15.146:41302) 2023-10-06T11:14:55.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.595+0000 7f52b6ffd700 1 -- 172.21.15.146:0/3710423424 learned_addr learned my addr 172.21.15.146:0/3710423424 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:55.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.595+0000 7f52ae7fc700 1 --2- 172.21.15.146:0/3710423424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52b80b2cb0 0x7f52b80b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:55.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.595+0000 7f52b77fe700 1 --2- 172.21.15.146:0/3710423424 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f52b80c53f0 0x7f52b8155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:55.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.596+0000 7f52b6ffd700 1 -- 172.21.15.146:0/3710423424 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f52b80c53f0 msgr2=0x7f52b8155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:55.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.596+0000 7f52b6ffd700 1 --2- 172.21.15.146:0/3710423424 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f52b80c53f0 0x7f52b8155c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:55.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.596+0000 7f52b6ffd700 1 -- 172.21.15.146:0/3710423424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52b80b2cb0 msgr2=0x7f52b80b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:55.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.596+0000 7f52b6ffd700 1 --2- 172.21.15.146:0/3710423424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52b80b2cb0 0x7f52b80b3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:55.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.596+0000 7f52b6ffd700 1 -- 172.21.15.146:0/3710423424 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a0009420 con 0x7f52b80b28e0 2023-10-06T11:14:55.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.596+0000 7f52ae7fc700 1 --2- 172.21.15.146:0/3710423424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52b80b2cb0 0x7f52b80b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:55.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.596+0000 7f52b6ffd700 1 --2- 172.21.15.146:0/3710423424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52b80b28e0 0x7f52b80cd3c0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f52a800ec80 tx=0x7f52a8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:55.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.596+0000 7f52af7fe700 1 -- 172.21.15.146:0/3710423424 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a800c9d0 con 0x7f52b80b28e0 2023-10-06T11:14:55.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.596+0000 7f52af7fe700 1 -- 172.21.15.146:0/3710423424 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52a800cb30 con 0x7f52b80b28e0 2023-10-06T11:14:55.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.596+0000 7f52bd6fb700 1 -- 172.21.15.146:0/3710423424 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52b80cc8e0 con 0x7f52b80b28e0 2023-10-06T11:14:55.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.596+0000 7f52af7fe700 1 -- 172.21.15.146:0/3710423424 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a8013470 con 0x7f52b80b28e0 2023-10-06T11:14:55.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.596+0000 7f52bd6fb700 1 -- 172.21.15.146:0/3710423424 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52b80ccea0 con 0x7f52b80b28e0 2023-10-06T11:14:55.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.597+0000 7f52bd6fb700 1 -- 172.21.15.146:0/3710423424 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52b80cd210 con 0x7f52b80b28e0 2023-10-06T11:14:55.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.597+0000 7f52af7fe700 1 -- 172.21.15.146:0/3710423424 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f52a8013860 con 0x7f52b80b28e0 2023-10-06T11:14:55.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.598+0000 7f52af7fe700 1 --2- 172.21.15.146:0/3710423424 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5298066f30 0x7f52980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:55.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.598+0000 7f52af7fe700 1 -- 172.21.15.146:0/3710423424 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f52a8084e40 con 0x7f52b80b28e0 2023-10-06T11:14:55.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.598+0000 7f52ae7fc700 1 --2- 172.21.15.146:0/3710423424 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5298066f30 0x7f52980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:55.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.598+0000 7f52ae7fc700 1 --2- 172.21.15.146:0/3710423424 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5298066f30 0x7f52980693e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f52a00091e0 tx=0x7f52a0017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:55.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.602+0000 7f52af7fe700 1 -- 172.21.15.146:0/3710423424 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f52a8051f50 con 0x7f52b80b28e0 2023-10-06T11:14:55.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.861+0000 7f52bd6fb700 1 -- 172.21.15.146:0/3710423424 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f52b804c380 con 0x7f52b80b28e0 2023-10-06T11:14:55.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.861+0000 7f52af7fe700 1 -- 172.21.15.146:0/3710423424 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1579 (secure 0 0 0) 0x7f52a8017640 con 0x7f52b80b28e0 2023-10-06T11:14:55.862 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:55.863 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":570,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":113,"num_osds":8,"num_up_osds":8,"osd_up_since":1696590336,"num_in_osds":8,"osd_in_since":1696590327,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":1071,"data_bytes":1078380240,"bytes_used":4674732032,"bytes_avail":768419381248,"bytes_total":773094113280,"write_bytes_sec":1486956,"read_op_per_sec":0,"write_op_per_sec":124},"fsmap":{"epoch":100,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"c","status":"up:active","gid":8103}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":22,"modified":"2023-10-06T11:14:55.258301+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T11:14:55.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.863+0000 7f52bd6fb700 1 -- 172.21.15.146:0/3710423424 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5298066f30 msgr2=0x7f52980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:55.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.863+0000 7f52bd6fb700 1 --2- 172.21.15.146:0/3710423424 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5298066f30 0x7f52980693e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f52a00091e0 tx=0x7f52a0017000 comp rx=0 tx=0).stop 2023-10-06T11:14:55.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.863+0000 7f52bd6fb700 1 -- 172.21.15.146:0/3710423424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52b80b28e0 msgr2=0x7f52b80cd3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:55.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.863+0000 7f52bd6fb700 1 --2- 172.21.15.146:0/3710423424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52b80b28e0 0x7f52b80cd3c0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f52a800ec80 tx=0x7f52a8009120 comp rx=0 tx=0).stop 2023-10-06T11:14:55.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.863+0000 7f52bd6fb700 1 -- 172.21.15.146:0/3710423424 shutdown_connections 2023-10-06T11:14:55.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.863+0000 7f52bd6fb700 1 --2- 172.21.15.146:0/3710423424 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5298066f30 0x7f52980693e0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:55.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.863+0000 7f52bd6fb700 1 --2- 172.21.15.146:0/3710423424 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f52b80c53f0 0x7f52b8155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:55.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.863+0000 7f52bd6fb700 1 --2- 172.21.15.146:0/3710423424 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f52b80b28e0 0x7f52b80cd3c0 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:55.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.863+0000 7f52bd6fb700 1 --2- 172.21.15.146:0/3710423424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52b80b2cb0 0x7f52b80b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:55.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.863+0000 7f52bd6fb700 1 -- 172.21.15.146:0/3710423424 >> 172.21.15.146:0/3710423424 conn(0x7f52b80999a0 msgr2=0x7f52b8068510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:55.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.863+0000 7f52bd6fb700 1 -- 172.21.15.146:0/3710423424 shutdown_connections 2023-10-06T11:14:55.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:55.863+0000 7f52bd6fb700 1 -- 172.21.15.146:0/3710423424 wait complete. 2023-10-06T11:14:55.876 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2023-10-06T11:14:55.877 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T11:14:55.877 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:14:55.915 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:14:55.958 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T11:14:55.959 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi146.front.sepia.ceph.com... 2023-10-06T11:14:55.959 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T11:14:55.959 DEBUG:teuthology.orchestra.run.smithi146:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T11:14:55.999 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[140154]: fuse finished with error 0 and tester_r 0 2023-10-06T11:14:56.066 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-10-06T11:14:56.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:56.066 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T11:14:56.242 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-10-06T11:14:56.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:56.242 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T11:14:56.259 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:14:56.260 INFO:teuthology.orchestra.run.smithi151.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-06T11:14:56.260 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-10-06T11:14:56.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:56.260 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T11:14:56.297 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:14:56.297 INFO:teuthology.orchestra.run.smithi146.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-06T11:14:56.298 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-10-06T11:14:56.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:14:56.298 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T11:14:56.316 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:14:56.316 INFO:teuthology.orchestra.run.smithi151.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-06T11:14:56.317 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:14:56.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.451+0000 7f41a1907700 1 Processor -- start 2023-10-06T11:14:56.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.452+0000 7f41a1907700 1 -- start start 2023-10-06T11:14:56.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.452+0000 7f41a1907700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f419c068ba0 0x7f419c15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:56.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.452+0000 7f41a1907700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f419c153e80 0x7f419c0b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:56.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.452+0000 7f41a1907700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f419c15ac30 con 0x7f419c153ab0 2023-10-06T11:14:56.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.452+0000 7f41a1907700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f419c0b4510 con 0x7f419c153e80 2023-10-06T11:14:56.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.452+0000 7f41a1907700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f419c0b6530 con 0x7f419c068ba0 2023-10-06T11:14:56.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.453+0000 7f419b7fe700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f419c153e80 0x7f419c0b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:56.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.453+0000 7f41927fc700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f419c068ba0 0x7f419c15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:56.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.453+0000 7f419affd700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f419c153ab0 0x7f419c068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:33592/0 (socket says 172.21.15.146:33592) 2023-10-06T11:14:56.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.453+0000 7f419affd700 1 -- 172.21.15.146:0/3976621420 learned_addr learned my addr 172.21.15.146:0/3976621420 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:14:56.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.453+0000 7f41927fc700 1 -- 172.21.15.146:0/3976621420 >> v2:172.21.15.151:3300/0 conn(0x7f419c153e80 msgr2=0x7f419c0b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:56.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.453+0000 7f41927fc700 1 --2- 172.21.15.146:0/3976621420 >> v2:172.21.15.151:3300/0 conn(0x7f419c153e80 0x7f419c0b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:56.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.453+0000 7f41927fc700 1 -- 172.21.15.146:0/3976621420 >> v1:172.21.15.151:6789/0 conn(0x7f419c153ab0 legacy=0x7f419c068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:56.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.453+0000 7f41927fc700 1 -- 172.21.15.146:0/3976621420 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419c0b5c50 con 0x7f419c068ba0 2023-10-06T11:14:56.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.453+0000 7f419b7fe700 1 --2- 172.21.15.146:0/3976621420 >> v2:172.21.15.151:3300/0 conn(0x7f419c153e80 0x7f419c0b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:14:56.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.453+0000 7f41927fc700 1 --2- 172.21.15.146:0/3976621420 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f419c068ba0 0x7f419c15a6f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f41840098e0 tx=0x7f41840091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdfda13ad4d52fd7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:56.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.453+0000 7f419a7fc700 1 -- 172.21.15.146:0/3976621420 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418400b640 con 0x7f419c068ba0 2023-10-06T11:14:56.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.453+0000 7f419a7fc700 1 -- 172.21.15.146:0/3976621420 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418400b7a0 con 0x7f419c068ba0 2023-10-06T11:14:56.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.453+0000 7f419a7fc700 1 -- 172.21.15.146:0/3976621420 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418400bb40 con 0x7f419c068ba0 2023-10-06T11:14:56.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.454+0000 7f41a1907700 1 -- 172.21.15.146:0/3976621420 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f419c068ba0 msgr2=0x7f419c15a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:56.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.454+0000 7f41a1907700 1 --2- 172.21.15.146:0/3976621420 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f419c068ba0 0x7f419c15a6f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f41840098e0 tx=0x7f41840091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:56.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.454+0000 7f41a1907700 1 -- 172.21.15.146:0/3976621420 shutdown_connections 2023-10-06T11:14:56.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.454+0000 7f41a1907700 1 --2- 172.21.15.146:0/3976621420 >> v2:172.21.15.151:3300/0 conn(0x7f419c153e80 0x7f419c0b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:56.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.454+0000 7f41a1907700 1 --2- 172.21.15.146:0/3976621420 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f419c068ba0 0x7f419c15a6f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:56.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.454+0000 7f41a1907700 1 -- 172.21.15.146:0/3976621420 >> 172.21.15.146:0/3976621420 conn(0x7f419c06eba0 msgr2=0x7f419c06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:56.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.454+0000 7f41a1907700 1 -- 172.21.15.146:0/3976621420 shutdown_connections 2023-10-06T11:14:56.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.454+0000 7f41a1907700 1 -- 172.21.15.146:0/3976621420 wait complete. 2023-10-06T11:14:56.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.455+0000 7f41a1907700 1 Processor -- start 2023-10-06T11:14:56.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.455+0000 7f41a1907700 1 -- start start 2023-10-06T11:14:56.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.456+0000 7f41a1907700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f419c068ba0 0x7f419c1543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:56.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.456+0000 7f41a1907700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f419c153ab0 0x7f419c158bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:56.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.456+0000 7f41a1907700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f419c153e80 0x7f419c15a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:56.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.456+0000 7f41a1907700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419c15a000 con 0x7f419c153e80 2023-10-06T11:14:56.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.456+0000 7f41a1907700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419c159130 con 0x7f419c153ab0 2023-10-06T11:14:56.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.456+0000 7f41a1907700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f419c1593f0 con 0x7f419c068ba0 2023-10-06T11:14:56.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.456+0000 7f419b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f419c153e80 0x7f419c15a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:56.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.456+0000 7f419b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f419c153e80 0x7f419c15a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41316/0 (socket says 172.21.15.146:41316) 2023-10-06T11:14:56.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.456+0000 7f419b7fe700 1 -- 172.21.15.146:0/2661820339 learned_addr learned my addr 172.21.15.146:0/2661820339 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:56.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.456+0000 7f41927fc700 1 --2- 172.21.15.146:0/2661820339 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f419c153ab0 0x7f419c158bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:56.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.456+0000 7f419affd700 1 --2- 172.21.15.146:0/2661820339 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f419c068ba0 0x7f419c1543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:56.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.456+0000 7f419b7fe700 1 -- 172.21.15.146:0/2661820339 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f419c068ba0 msgr2=0x7f419c1543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:56.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.456+0000 7f419b7fe700 1 --2- 172.21.15.146:0/2661820339 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f419c068ba0 0x7f419c1543e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:56.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.456+0000 7f419b7fe700 1 -- 172.21.15.146:0/2661820339 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f419c153ab0 msgr2=0x7f419c158bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:56.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.456+0000 7f419b7fe700 1 --2- 172.21.15.146:0/2661820339 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f419c153ab0 0x7f419c158bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:56.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.456+0000 7f419b7fe700 1 -- 172.21.15.146:0/2661820339 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4194009a20 con 0x7f419c153e80 2023-10-06T11:14:56.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.457+0000 7f419b7fe700 1 --2- 172.21.15.146:0/2661820339 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f419c153e80 0x7f419c15a490 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f4194009fc0 tx=0x7f419400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:56.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.457+0000 7f41937fe700 1 -- 172.21.15.146:0/2661820339 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419400cd30 con 0x7f419c153e80 2023-10-06T11:14:56.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.457+0000 7f41937fe700 1 -- 172.21.15.146:0/2661820339 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f419400f040 con 0x7f419c153e80 2023-10-06T11:14:56.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.457+0000 7f41a1907700 1 -- 172.21.15.146:0/2661820339 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4184009420 con 0x7f419c153e80 2023-10-06T11:14:56.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.457+0000 7f41937fe700 1 -- 172.21.15.146:0/2661820339 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41940146d0 con 0x7f419c153e80 2023-10-06T11:14:56.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.457+0000 7f41a1907700 1 -- 172.21.15.146:0/2661820339 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f419c1599b0 con 0x7f419c153e80 2023-10-06T11:14:56.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.458+0000 7f41a1907700 1 -- 172.21.15.146:0/2661820339 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f419c04c380 con 0x7f419c153e80 2023-10-06T11:14:56.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.458+0000 7f41937fe700 1 -- 172.21.15.146:0/2661820339 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4194003020 con 0x7f419c153e80 2023-10-06T11:14:56.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.458+0000 7f41937fe700 1 --2- 172.21.15.146:0/2661820339 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f417c066f30 0x7f417c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:56.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.459+0000 7f41937fe700 1 -- 172.21.15.146:0/2661820339 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4194085120 con 0x7f419c153e80 2023-10-06T11:14:56.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.459+0000 7f419affd700 1 --2- 172.21.15.146:0/2661820339 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f417c066f30 0x7f417c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:56.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.459+0000 7f419affd700 1 --2- 172.21.15.146:0/2661820339 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f417c066f30 0x7f417c0693e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f418c007fd0 tx=0x7f418c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:56.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.463+0000 7f41937fe700 1 -- 172.21.15.146:0/2661820339 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4194052230 con 0x7f419c153e80 2023-10-06T11:14:56.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.688+0000 7f41a1907700 1 -- 172.21.15.146:0/2661820339 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f419c0b3720 con 0x7f419c153e80 2023-10-06T11:14:56.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.689+0000 7f41937fe700 1 -- 172.21.15.146:0/2661820339 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) v1 ==== 95+0+4610 (secure 0 0 0) 0x7f4194055850 con 0x7f419c153e80 2023-10-06T11:14:56.691 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:56.691 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":100,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6560,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/2109567995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2109567995},{"type":"v1","addr":"172.21.15.151:6834","nonce":2109567995}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":6563,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1783565134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":1783565134},{"type":"v1","addr":"172.21.15.151:6835","nonce":1783565134}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7327,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/1323749517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1323749517},{"type":"v1","addr":"172.21.15.146:6836","nonce":1323749517}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:14:18.891938+0000","modified":"2023-10-06T11:14:22.531674+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8103":{"gid":8103,"name":"c","rank":0,"incarnation":97,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/409226151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":409226151},{"type":"v1","addr":"172.21.15.146:6837","nonce":409226151}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-06T11:14:56.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.691+0000 7f41a1907700 1 -- 172.21.15.146:0/2661820339 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f417c066f30 msgr2=0x7f417c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:56.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.691+0000 7f41a1907700 1 --2- 172.21.15.146:0/2661820339 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f417c066f30 0x7f417c0693e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f418c007fd0 tx=0x7f418c009040 comp rx=0 tx=0).stop 2023-10-06T11:14:56.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.691+0000 7f41a1907700 1 -- 172.21.15.146:0/2661820339 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f419c153e80 msgr2=0x7f419c15a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:56.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.691+0000 7f41a1907700 1 --2- 172.21.15.146:0/2661820339 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f419c153e80 0x7f419c15a490 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f4194009fc0 tx=0x7f419400b040 comp rx=0 tx=0).stop 2023-10-06T11:14:56.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.691+0000 7f41a1907700 1 -- 172.21.15.146:0/2661820339 shutdown_connections 2023-10-06T11:14:56.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.691+0000 7f41a1907700 1 --2- 172.21.15.146:0/2661820339 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f417c066f30 0x7f417c0693e0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:56.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.691+0000 7f41a1907700 1 --2- 172.21.15.146:0/2661820339 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f419c153e80 0x7f419c15a490 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:56.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.691+0000 7f41a1907700 1 --2- 172.21.15.146:0/2661820339 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f419c068ba0 0x7f419c1543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:56.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.691+0000 7f41a1907700 1 --2- 172.21.15.146:0/2661820339 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f419c153ab0 0x7f419c158bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:56.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.691+0000 7f41a1907700 1 -- 172.21.15.146:0/2661820339 >> 172.21.15.146:0/2661820339 conn(0x7f419c06eba0 msgr2=0x7f419c151ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:56.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.691+0000 7f41a1907700 1 -- 172.21.15.146:0/2661820339 shutdown_connections 2023-10-06T11:14:56.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.691+0000 7f41a1907700 1 -- 172.21.15.146:0/2661820339 wait complete. 2023-10-06T11:14:56.694 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 100 2023-10-06T11:14:56.705 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:14:56.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.817+0000 7f0090870700 1 Processor -- start 2023-10-06T11:14:56.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.817+0000 7f0090870700 1 -- start start 2023-10-06T11:14:56.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.818+0000 7f0090870700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f008c153ab0 0x7f008c15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:56.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.818+0000 7f0090870700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f008c153e80 0x7f008c068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:56.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.818+0000 7f0090870700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f008c15ac30 con 0x7f008c0689d0 2023-10-06T11:14:56.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.818+0000 7f0090870700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f008c0b4510 con 0x7f008c153e80 2023-10-06T11:14:56.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.818+0000 7f0090870700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f008c0b6530 con 0x7f008c153ab0 2023-10-06T11:14:56.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.818+0000 7f0081d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f008c153e80 0x7f008c068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:56.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.818+0000 7f0081d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f008c153e80 0x7f008c068490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41322/0 (socket says 172.21.15.146:41322) 2023-10-06T11:14:56.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.818+0000 7f0081d9b700 1 -- 172.21.15.146:0/3569803834 learned_addr learned my addr 172.21.15.146:0/3569803834 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:56.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.818+0000 7f008a59c700 1 --2- 172.21.15.146:0/3569803834 >> v2:172.21.15.151:3300/0 conn(0x7f008c153ab0 0x7f008c15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:56.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.818+0000 7f0081d9b700 1 -- 172.21.15.146:0/3569803834 >> v2:172.21.15.151:3300/0 conn(0x7f008c153ab0 msgr2=0x7f008c15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:56.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.818+0000 7f0081d9b700 1 --2- 172.21.15.146:0/3569803834 >> v2:172.21.15.151:3300/0 conn(0x7f008c153ab0 0x7f008c15a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:56.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.818+0000 7f0081d9b700 1 -- 172.21.15.146:0/3569803834 >> v1:172.21.15.151:6789/0 conn(0x7f008c0689d0 legacy=0x7f008c15d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:56.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.818+0000 7f0081d9b700 1 -- 172.21.15.146:0/3569803834 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f008c068dd0 con 0x7f008c153e80 2023-10-06T11:14:56.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.819+0000 7f0081d9b700 1 --2- 172.21.15.146:0/3569803834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f008c153e80 0x7f008c068490 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f008c0b5eb0 tx=0x7f0074009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f15c45d97c6e4715 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:56.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.819+0000 7f0089d9b700 1 -- 172.21.15.146:0/3569803834 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007400b820 con 0x7f008c153e80 2023-10-06T11:14:56.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.819+0000 7f0089d9b700 1 -- 172.21.15.146:0/3569803834 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f007400b980 con 0x7f008c153e80 2023-10-06T11:14:56.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.819+0000 7f0089d9b700 1 -- 172.21.15.146:0/3569803834 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007400bd20 con 0x7f008c153e80 2023-10-06T11:14:56.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.819+0000 7f0090870700 1 -- 172.21.15.146:0/3569803834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f008c153e80 msgr2=0x7f008c068490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:56.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.819+0000 7f0090870700 1 --2- 172.21.15.146:0/3569803834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f008c153e80 0x7f008c068490 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f008c0b5eb0 tx=0x7f0074009250 comp rx=0 tx=0).stop 2023-10-06T11:14:56.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.819+0000 7f0090870700 1 -- 172.21.15.146:0/3569803834 shutdown_connections 2023-10-06T11:14:56.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.819+0000 7f0090870700 1 --2- 172.21.15.146:0/3569803834 >> v2:172.21.15.151:3300/0 conn(0x7f008c153ab0 0x7f008c15a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:56.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.819+0000 7f0090870700 1 --2- 172.21.15.146:0/3569803834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f008c153e80 0x7f008c068490 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:56.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.819+0000 7f0090870700 1 -- 172.21.15.146:0/3569803834 >> 172.21.15.146:0/3569803834 conn(0x7f008c06eba0 msgr2=0x7f008c06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:56.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.819+0000 7f0090870700 1 -- 172.21.15.146:0/3569803834 shutdown_connections 2023-10-06T11:14:56.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.819+0000 7f0090870700 1 -- 172.21.15.146:0/3569803834 wait complete. 2023-10-06T11:14:56.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.821+0000 7f0090870700 1 Processor -- start 2023-10-06T11:14:56.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.821+0000 7f0090870700 1 -- start start 2023-10-06T11:14:56.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.821+0000 7f0090870700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f008c0689d0 0x7f008c13dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:56.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.821+0000 7f0090870700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f008c153ab0 0x7f008c159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:56.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.821+0000 7f0090870700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f008c153e80 0x7f008c152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:56.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.821+0000 7f0090870700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008c16afc0 con 0x7f008c153e80 2023-10-06T11:14:56.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.821+0000 7f0090870700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008c16bde0 con 0x7f008c153ab0 2023-10-06T11:14:56.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.821+0000 7f0090870700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f008c13e0e0 con 0x7f008c0689d0 2023-10-06T11:14:56.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.821+0000 7f008ad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f008c153e80 0x7f008c152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:56.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.821+0000 7f008ad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f008c153e80 0x7f008c152ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41326/0 (socket says 172.21.15.146:41326) 2023-10-06T11:14:56.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.821+0000 7f008ad9d700 1 -- 172.21.15.146:0/3450107910 learned_addr learned my addr 172.21.15.146:0/3450107910 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:56.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.822+0000 7f008a59c700 1 --2- 172.21.15.146:0/3450107910 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f008c0689d0 0x7f008c13dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:56.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.822+0000 7f0081d9b700 1 --2- 172.21.15.146:0/3450107910 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f008c153ab0 0x7f008c159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:56.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.822+0000 7f008ad9d700 1 -- 172.21.15.146:0/3450107910 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f008c0689d0 msgr2=0x7f008c13dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:56.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.822+0000 7f008ad9d700 1 --2- 172.21.15.146:0/3450107910 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f008c0689d0 0x7f008c13dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:56.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.822+0000 7f008ad9d700 1 -- 172.21.15.146:0/3450107910 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f008c153ab0 msgr2=0x7f008c159430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:56.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.822+0000 7f008ad9d700 1 --2- 172.21.15.146:0/3450107910 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f008c153ab0 0x7f008c159430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:56.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.822+0000 7f008ad9d700 1 -- 172.21.15.146:0/3450107910 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00740094f0 con 0x7f008c153e80 2023-10-06T11:14:56.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.822+0000 7f008ad9d700 1 --2- 172.21.15.146:0/3450107910 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f008c153e80 0x7f008c152ec0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f008400bc60 tx=0x7f0084009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:56.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.822+0000 7f0082ffd700 1 -- 172.21.15.146:0/3450107910 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008400c840 con 0x7f008c153e80 2023-10-06T11:14:56.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.822+0000 7f0082ffd700 1 -- 172.21.15.146:0/3450107910 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f008400c9a0 con 0x7f008c153e80 2023-10-06T11:14:56.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.822+0000 7f0090870700 1 -- 172.21.15.146:0/3450107910 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f008c16b1d0 con 0x7f008c153e80 2023-10-06T11:14:56.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.822+0000 7f0082ffd700 1 -- 172.21.15.146:0/3450107910 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008400cda0 con 0x7f008c153e80 2023-10-06T11:14:56.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.822+0000 7f0090870700 1 -- 172.21.15.146:0/3450107910 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f008c16b790 con 0x7f008c153e80 2023-10-06T11:14:56.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.823+0000 7f0090870700 1 -- 172.21.15.146:0/3450107910 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f008c0882f0 con 0x7f008c153e80 2023-10-06T11:14:56.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.823+0000 7f0082ffd700 1 -- 172.21.15.146:0/3450107910 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0084014620 con 0x7f008c153e80 2023-10-06T11:14:56.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.824+0000 7f0082ffd700 1 --2- 172.21.15.146:0/3450107910 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f006c066f30 0x7f006c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:56.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.824+0000 7f0082ffd700 1 -- 172.21.15.146:0/3450107910 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f00840845d0 con 0x7f008c153e80 2023-10-06T11:14:56.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.824+0000 7f008a59c700 1 --2- 172.21.15.146:0/3450107910 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f006c066f30 0x7f006c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:56.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.824+0000 7f008a59c700 1 --2- 172.21.15.146:0/3450107910 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f006c066f30 0x7f006c0693e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f007c006fd0 tx=0x7f007c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:56.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:56.828+0000 7f0082ffd700 1 -- 172.21.15.146:0/3450107910 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f008404c5a0 con 0x7f008c153e80 2023-10-06T11:14:57.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.012+0000 7f0090870700 1 -- 172.21.15.146:0/3450107910 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f008c069330 con 0x7f008c153e80 2023-10-06T11:14:57.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.013+0000 7f0082ffd700 1 -- 172.21.15.146:0/3450107910 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+16928 (secure 0 0 0) 0x7f00840516e0 con 0x7f008c153e80 2023-10-06T11:14:57.015 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:57.015 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":113,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:14:20.515985+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:14:16.553437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-10-06T11:14:17.858670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:14:57.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.015+0000 7f0090870700 1 -- 172.21.15.146:0/3450107910 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f006c066f30 msgr2=0x7f006c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:57.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.015+0000 7f0090870700 1 --2- 172.21.15.146:0/3450107910 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f006c066f30 0x7f006c0693e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f007c006fd0 tx=0x7f007c008040 comp rx=0 tx=0).stop 2023-10-06T11:14:57.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.015+0000 7f0090870700 1 -- 172.21.15.146:0/3450107910 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f008c153e80 msgr2=0x7f008c152ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:57.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.015+0000 7f0090870700 1 --2- 172.21.15.146:0/3450107910 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f008c153e80 0x7f008c152ec0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f008400bc60 tx=0x7f0084009820 comp rx=0 tx=0).stop 2023-10-06T11:14:57.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.015+0000 7f0090870700 1 -- 172.21.15.146:0/3450107910 shutdown_connections 2023-10-06T11:14:57.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.015+0000 7f0090870700 1 --2- 172.21.15.146:0/3450107910 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f006c066f30 0x7f006c0693e0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.015+0000 7f0090870700 1 --2- 172.21.15.146:0/3450107910 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f008c153e80 0x7f008c152ec0 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.015+0000 7f0090870700 1 --2- 172.21.15.146:0/3450107910 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f008c0689d0 0x7f008c13dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.015+0000 7f0090870700 1 --2- 172.21.15.146:0/3450107910 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f008c153ab0 0x7f008c159430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.015+0000 7f0090870700 1 -- 172.21.15.146:0/3450107910 >> 172.21.15.146:0/3450107910 conn(0x7f008c06eba0 msgr2=0x7f008c15c740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:57.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.015+0000 7f0090870700 1 -- 172.21.15.146:0/3450107910 shutdown_connections 2023-10-06T11:14:57.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.015+0000 7f0090870700 1 -- 172.21.15.146:0/3450107910 wait complete. 2023-10-06T11:14:57.029 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:05:36.687307+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:05:37.171199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T11:14:16.553437+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '112', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T11:14:17.858670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '113', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T11:14:57.030 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:14:57.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.146+0000 7f730e898700 1 Processor -- start 2023-10-06T11:14:57.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.146+0000 7f730e898700 1 -- start start 2023-10-06T11:14:57.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.147+0000 7f730e898700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7308142ed0 0x7f730806b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:57.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.147+0000 7f730e898700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f730806bb90 0x7f730806cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:57.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.147+0000 7f730e898700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f730806bfb0 con 0x7f7308142b00 2023-10-06T11:14:57.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.147+0000 7f730e898700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f730806d8d0 con 0x7f730806bb90 2023-10-06T11:14:57.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.147+0000 7f730e898700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7308068720 con 0x7f7308142ed0 2023-10-06T11:14:57.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.147+0000 7f730e097700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f730806bb90 0x7f730806cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:57.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.147+0000 7f730e097700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f730806bb90 0x7f730806cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41330/0 (socket says 172.21.15.146:41330) 2023-10-06T11:14:57.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.147+0000 7f730e097700 1 -- 172.21.15.146:0/2431150944 learned_addr learned my addr 172.21.15.146:0/2431150944 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:57.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.147+0000 7f730d896700 1 --1- 172.21.15.146:0/2431150944 >> v1:172.21.15.146:6789/0 conn(0x7f7308142b00 0x7f73080c8870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:41596/0 (socket says 172.21.15.146:41596) 2023-10-06T11:14:57.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.147+0000 7f730d095700 1 --2- 172.21.15.146:0/2431150944 >> v2:172.21.15.151:3300/0 conn(0x7f7308142ed0 0x7f730806b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:57.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.147+0000 7f730e097700 1 -- 172.21.15.146:0/2431150944 >> v2:172.21.15.151:3300/0 conn(0x7f7308142ed0 msgr2=0x7f730806b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:57.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.147+0000 7f730e097700 1 --2- 172.21.15.146:0/2431150944 >> v2:172.21.15.151:3300/0 conn(0x7f7308142ed0 0x7f730806b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.147+0000 7f730e097700 1 -- 172.21.15.146:0/2431150944 >> v1:172.21.15.146:6789/0 conn(0x7f7308142b00 legacy=0x7f73080c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:57.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.147+0000 7f730e097700 1 -- 172.21.15.146:0/2431150944 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7308068a00 con 0x7f730806bb90 2023-10-06T11:14:57.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.147+0000 7f730c894700 1 -- 172.21.15.146:0/2431150944 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4184157585 0 0) 0x7f730806bfb0 con 0x7f7308142b00 2023-10-06T11:14:57.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.147+0000 7f730e097700 1 --2- 172.21.15.146:0/2431150944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f730806bb90 0x7f730806cba0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f73080ca8e0 tx=0x7f72f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9134b163f03b792 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:57.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.148+0000 7f730c894700 1 -- 172.21.15.146:0/2431150944 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f800b860 con 0x7f730806bb90 2023-10-06T11:14:57.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.148+0000 7f730c894700 1 -- 172.21.15.146:0/2431150944 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f800b9c0 con 0x7f730806bb90 2023-10-06T11:14:57.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.148+0000 7f730c894700 1 -- 172.21.15.146:0/2431150944 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f800bd60 con 0x7f730806bb90 2023-10-06T11:14:57.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.148+0000 7f730e898700 1 -- 172.21.15.146:0/2431150944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f730806bb90 msgr2=0x7f730806cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:57.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.148+0000 7f730e898700 1 --2- 172.21.15.146:0/2431150944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f730806bb90 0x7f730806cba0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f73080ca8e0 tx=0x7f72f8009250 comp rx=0 tx=0).stop 2023-10-06T11:14:57.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.148+0000 7f730e898700 1 -- 172.21.15.146:0/2431150944 shutdown_connections 2023-10-06T11:14:57.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.148+0000 7f730e898700 1 --2- 172.21.15.146:0/2431150944 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f730806bb90 0x7f730806cba0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.148+0000 7f730e898700 1 --2- 172.21.15.146:0/2431150944 >> v2:172.21.15.151:3300/0 conn(0x7f7308142ed0 0x7f730806b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.148+0000 7f730e898700 1 -- 172.21.15.146:0/2431150944 >> 172.21.15.146:0/2431150944 conn(0x7f73080ce230 msgr2=0x7f73080ce630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:57.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.148+0000 7f730e898700 1 -- 172.21.15.146:0/2431150944 shutdown_connections 2023-10-06T11:14:57.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.148+0000 7f730e898700 1 -- 172.21.15.146:0/2431150944 wait complete. 2023-10-06T11:14:57.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.149+0000 7f730e898700 1 Processor -- start 2023-10-06T11:14:57.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.149+0000 7f730e898700 1 -- start start 2023-10-06T11:14:57.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.150+0000 7f730e898700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f730806bb90 0x7f730815b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:57.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.150+0000 7f730e898700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7308142b00 0x7f7308158e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:57.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.150+0000 7f730e898700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7308142ed0 0x7f730815a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:57.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.150+0000 7f730e898700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73080c8ce0 con 0x7f7308142ed0 2023-10-06T11:14:57.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.150+0000 7f730e898700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730815b850 con 0x7f730806bb90 2023-10-06T11:14:57.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.150+0000 7f730e898700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73080c8690 con 0x7f7308142b00 2023-10-06T11:14:57.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.150+0000 7f730e097700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7308142ed0 0x7f730815a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:57.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.150+0000 7f730e097700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7308142ed0 0x7f730815a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41338/0 (socket says 172.21.15.146:41338) 2023-10-06T11:14:57.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.150+0000 7f730e097700 1 -- 172.21.15.146:0/217610632 learned_addr learned my addr 172.21.15.146:0/217610632 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:57.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.150+0000 7f730d095700 1 --2- 172.21.15.146:0/217610632 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7308142b00 0x7f7308158e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:57.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.150+0000 7f730d896700 1 --2- 172.21.15.146:0/217610632 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f730806bb90 0x7f730815b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:57.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.150+0000 7f730e097700 1 -- 172.21.15.146:0/217610632 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7308142b00 msgr2=0x7f7308158e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:57.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.150+0000 7f730e097700 1 --2- 172.21.15.146:0/217610632 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7308142b00 0x7f7308158e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.150+0000 7f730e097700 1 -- 172.21.15.146:0/217610632 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f730806bb90 msgr2=0x7f730815b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:57.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.150+0000 7f730e097700 1 --2- 172.21.15.146:0/217610632 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f730806bb90 0x7f730815b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.150+0000 7f730e097700 1 -- 172.21.15.146:0/217610632 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f80094f0 con 0x7f7308142ed0 2023-10-06T11:14:57.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.151+0000 7f730e097700 1 --2- 172.21.15.146:0/217610632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7308142ed0 0x7f730815a5c0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f730806fdd0 tx=0x7f72f8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:57.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.151+0000 7f7305ffb700 1 -- 172.21.15.146:0/217610632 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f801a630 con 0x7f7308142ed0 2023-10-06T11:14:57.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.151+0000 7f7305ffb700 1 -- 172.21.15.146:0/217610632 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f801a7d0 con 0x7f7308142ed0 2023-10-06T11:14:57.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.151+0000 7f7305ffb700 1 -- 172.21.15.146:0/217610632 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f801ab90 con 0x7f7308142ed0 2023-10-06T11:14:57.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.151+0000 7f730e898700 1 -- 172.21.15.146:0/217610632 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73080c8970 con 0x7f7308142ed0 2023-10-06T11:14:57.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.151+0000 7f730e898700 1 -- 172.21.15.146:0/217610632 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7308159340 con 0x7f7308142ed0 2023-10-06T11:14:57.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.152+0000 7f730e898700 1 -- 172.21.15.146:0/217610632 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f730806eb80 con 0x7f7308142ed0 2023-10-06T11:14:57.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.152+0000 7f7305ffb700 1 -- 172.21.15.146:0/217610632 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f72f802d440 con 0x7f7308142ed0 2023-10-06T11:14:57.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.153+0000 7f7305ffb700 1 --2- 172.21.15.146:0/217610632 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f72f4066f30 0x7f72f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:57.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.153+0000 7f7305ffb700 1 -- 172.21.15.146:0/217610632 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f72f8086460 con 0x7f7308142ed0 2023-10-06T11:14:57.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.153+0000 7f730d896700 1 --2- 172.21.15.146:0/217610632 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f72f4066f30 0x7f72f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:57.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.153+0000 7f730d896700 1 --2- 172.21.15.146:0/217610632 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f72f4066f30 0x7f72f40693e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f7300001560 tx=0x7f7300005d10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:57.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.157+0000 7f7305ffb700 1 -- 172.21.15.146:0/217610632 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f72f8053570 con 0x7f7308142ed0 2023-10-06T11:14:57.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.340+0000 7f730e898700 1 -- 172.21.15.146:0/217610632 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7308068ce0 con 0x7f7308142ed0 2023-10-06T11:14:57.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.341+0000 7f7305ffb700 1 -- 172.21.15.146:0/217610632 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v113) v1 ==== 92+0+10 (secure 0 0 0) 0x7f72f8056b90 con 0x7f7308142ed0 2023-10-06T11:14:57.343 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-10-06T11:14:57.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.343+0000 7f730e898700 1 -- 172.21.15.146:0/217610632 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f72f4066f30 msgr2=0x7f72f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:57.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.343+0000 7f730e898700 1 --2- 172.21.15.146:0/217610632 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f72f4066f30 0x7f72f40693e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f7300001560 tx=0x7f7300005d10 comp rx=0 tx=0).stop 2023-10-06T11:14:57.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.343+0000 7f730e898700 1 -- 172.21.15.146:0/217610632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7308142ed0 msgr2=0x7f730815a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:57.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.343+0000 7f730e898700 1 --2- 172.21.15.146:0/217610632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7308142ed0 0x7f730815a5c0 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f730806fdd0 tx=0x7f72f8017000 comp rx=0 tx=0).stop 2023-10-06T11:14:57.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.343+0000 7f730e898700 1 -- 172.21.15.146:0/217610632 shutdown_connections 2023-10-06T11:14:57.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.343+0000 7f730e898700 1 --2- 172.21.15.146:0/217610632 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f72f4066f30 0x7f72f40693e0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.343+0000 7f730e898700 1 --2- 172.21.15.146:0/217610632 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7308142ed0 0x7f730815a5c0 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.343+0000 7f730e898700 1 --2- 172.21.15.146:0/217610632 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f730806bb90 0x7f730815b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.343+0000 7f730e898700 1 --2- 172.21.15.146:0/217610632 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7308142b00 0x7f7308158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.343+0000 7f730e898700 1 -- 172.21.15.146:0/217610632 >> 172.21.15.146:0/217610632 conn(0x7f73080ce230 msgr2=0x7f7308141bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:57.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.343+0000 7f730e898700 1 -- 172.21.15.146:0/217610632 shutdown_connections 2023-10-06T11:14:57.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.343+0000 7f730e898700 1 -- 172.21.15.146:0/217610632 wait complete. 2023-10-06T11:14:57.357 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:14:57.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.474+0000 7fb992497700 1 Processor -- start 2023-10-06T11:14:57.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.475+0000 7fb992497700 1 -- start start 2023-10-06T11:14:57.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.475+0000 7fb992497700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb98c142b00 0x7fb98c0c8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:57.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.475+0000 7fb992497700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb98c142ed0 0x7fb98c06b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:57.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.475+0000 7fb992497700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb98c06bb90 0x7fb98c06cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:57.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.475+0000 7fb992497700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb98c06bff0 con 0x7fb98c142ed0 2023-10-06T11:14:57.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.475+0000 7fb992497700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb98c0c8db0 con 0x7fb98c142b00 2023-10-06T11:14:57.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.475+0000 7fb992497700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb98c06d8d0 con 0x7fb98c06bb90 2023-10-06T11:14:57.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.475+0000 7fb990c94700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb98c142ed0 0x7fb98c06b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:57.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.476+0000 7fb990c94700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb98c142ed0 0x7fb98c06b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41348/0 (socket says 172.21.15.146:41348) 2023-10-06T11:14:57.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.476+0000 7fb990c94700 1 -- 172.21.15.146:0/1801701841 learned_addr learned my addr 172.21.15.146:0/1801701841 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:57.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.476+0000 7fb991495700 1 --2- 172.21.15.146:0/1801701841 >> v2:172.21.15.151:3300/0 conn(0x7fb98c142b00 0x7fb98c0c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:57.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.476+0000 7fb991c96700 1 --2- 172.21.15.146:0/1801701841 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb98c06bb90 0x7fb98c06cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:57.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.476+0000 7fb990c94700 1 -- 172.21.15.146:0/1801701841 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb98c06bb90 msgr2=0x7fb98c06cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:57.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.476+0000 7fb990c94700 1 --2- 172.21.15.146:0/1801701841 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb98c06bb90 0x7fb98c06cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.476+0000 7fb990c94700 1 -- 172.21.15.146:0/1801701841 >> v2:172.21.15.151:3300/0 conn(0x7fb98c142b00 msgr2=0x7fb98c0c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:57.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.476+0000 7fb990c94700 1 --2- 172.21.15.146:0/1801701841 >> v2:172.21.15.151:3300/0 conn(0x7fb98c142b00 0x7fb98c0c8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.476+0000 7fb990c94700 1 -- 172.21.15.146:0/1801701841 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb98c068720 con 0x7fb98c142ed0 2023-10-06T11:14:57.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.476+0000 7fb991495700 1 --2- 172.21.15.146:0/1801701841 >> v2:172.21.15.151:3300/0 conn(0x7fb98c142b00 0x7fb98c0c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:57.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.476+0000 7fb990c94700 1 --2- 172.21.15.146:0/1801701841 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb98c142ed0 0x7fb98c06b650 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fb98c0716d0 tx=0x7fb97c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fadc103f9ff145f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:57.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.476+0000 7fb983fff700 1 -- 172.21.15.146:0/1801701841 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97c00b860 con 0x7fb98c142ed0 2023-10-06T11:14:57.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.476+0000 7fb983fff700 1 -- 172.21.15.146:0/1801701841 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb97c00b9c0 con 0x7fb98c142ed0 2023-10-06T11:14:57.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.476+0000 7fb983fff700 1 -- 172.21.15.146:0/1801701841 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97c00bd60 con 0x7fb98c142ed0 2023-10-06T11:14:57.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.477+0000 7fb992497700 1 -- 172.21.15.146:0/1801701841 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb98c142ed0 msgr2=0x7fb98c06b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:57.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.477+0000 7fb992497700 1 --2- 172.21.15.146:0/1801701841 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb98c142ed0 0x7fb98c06b650 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fb98c0716d0 tx=0x7fb97c009250 comp rx=0 tx=0).stop 2023-10-06T11:14:57.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.477+0000 7fb992497700 1 -- 172.21.15.146:0/1801701841 shutdown_connections 2023-10-06T11:14:57.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.477+0000 7fb992497700 1 --2- 172.21.15.146:0/1801701841 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb98c06bb90 0x7fb98c06cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.477+0000 7fb992497700 1 --2- 172.21.15.146:0/1801701841 >> v2:172.21.15.151:3300/0 conn(0x7fb98c142b00 0x7fb98c0c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.477+0000 7fb992497700 1 --2- 172.21.15.146:0/1801701841 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb98c142ed0 0x7fb98c06b650 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.477+0000 7fb992497700 1 -- 172.21.15.146:0/1801701841 >> 172.21.15.146:0/1801701841 conn(0x7fb98c0ce230 msgr2=0x7fb98c0ce630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:57.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.477+0000 7fb992497700 1 -- 172.21.15.146:0/1801701841 shutdown_connections 2023-10-06T11:14:57.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.477+0000 7fb992497700 1 -- 172.21.15.146:0/1801701841 wait complete. 2023-10-06T11:14:57.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.478+0000 7fb992497700 1 Processor -- start 2023-10-06T11:14:57.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.478+0000 7fb992497700 1 -- start start 2023-10-06T11:14:57.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.479+0000 7fb992497700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb98c06bb90 0x7fb98c1400a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:57.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.479+0000 7fb992497700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb98c142b00 0x7fb98c0c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:57.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.479+0000 7fb992497700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb98c142ed0 0x7fb98c069100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:57.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.479+0000 7fb992497700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb98c16a830 con 0x7fb98c142b00 2023-10-06T11:14:57.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.479+0000 7fb992497700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb98c169c20 con 0x7fb98c142ed0 2023-10-06T11:14:57.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.479+0000 7fb992497700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb98c169f00 con 0x7fb98c06bb90 2023-10-06T11:14:57.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.479+0000 7fb990c94700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb98c142b00 0x7fb98c0c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:57.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.479+0000 7fb990c94700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb98c142b00 0x7fb98c0c6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41356/0 (socket says 172.21.15.146:41356) 2023-10-06T11:14:57.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.479+0000 7fb990c94700 1 -- 172.21.15.146:0/3868420269 learned_addr learned my addr 172.21.15.146:0/3868420269 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:57.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.479+0000 7fb991495700 1 --2- 172.21.15.146:0/3868420269 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb98c06bb90 0x7fb98c1400a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:57.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.479+0000 7fb991c96700 1 --2- 172.21.15.146:0/3868420269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb98c142ed0 0x7fb98c069100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:57.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.479+0000 7fb990c94700 1 -- 172.21.15.146:0/3868420269 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb98c06bb90 msgr2=0x7fb98c1400a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:57.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.479+0000 7fb990c94700 1 --2- 172.21.15.146:0/3868420269 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb98c06bb90 0x7fb98c1400a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.479+0000 7fb990c94700 1 -- 172.21.15.146:0/3868420269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb98c142ed0 msgr2=0x7fb98c069100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:57.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.479+0000 7fb990c94700 1 --2- 172.21.15.146:0/3868420269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb98c142ed0 0x7fb98c069100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.479+0000 7fb990c94700 1 -- 172.21.15.146:0/3868420269 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb97c0094f0 con 0x7fb98c142b00 2023-10-06T11:14:57.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.479+0000 7fb990c94700 1 --2- 172.21.15.146:0/3868420269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb98c142b00 0x7fb98c0c6c40 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7fb97c0090b0 tx=0x7fb97c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:57.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.480+0000 7fb9817fa700 1 -- 172.21.15.146:0/3868420269 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97c024440 con 0x7fb98c142b00 2023-10-06T11:14:57.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.480+0000 7fb9817fa700 1 -- 172.21.15.146:0/3868420269 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb97c0245e0 con 0x7fb98c142b00 2023-10-06T11:14:57.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.480+0000 7fb9817fa700 1 -- 172.21.15.146:0/3868420269 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb97c0249a0 con 0x7fb98c142b00 2023-10-06T11:14:57.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.480+0000 7fb992497700 1 -- 172.21.15.146:0/3868420269 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb98c16a1e0 con 0x7fb98c142b00 2023-10-06T11:14:57.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.480+0000 7fb992497700 1 -- 172.21.15.146:0/3868420269 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb98c1698a0 con 0x7fb98c142b00 2023-10-06T11:14:57.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.480+0000 7fb992497700 1 -- 172.21.15.146:0/3868420269 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb98c0cc130 con 0x7fb98c142b00 2023-10-06T11:14:57.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.481+0000 7fb9817fa700 1 -- 172.21.15.146:0/3868420269 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb97c01a420 con 0x7fb98c142b00 2023-10-06T11:14:57.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.481+0000 7fb9817fa700 1 --2- 172.21.15.146:0/3868420269 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb970066f30 0x7fb9700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:57.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.481+0000 7fb9817fa700 1 -- 172.21.15.146:0/3868420269 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb97c086580 con 0x7fb98c142b00 2023-10-06T11:14:57.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.481+0000 7fb991495700 1 --2- 172.21.15.146:0/3868420269 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb970066f30 0x7fb9700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:57.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.482+0000 7fb991495700 1 --2- 172.21.15.146:0/3868420269 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb970066f30 0x7fb9700693e0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fb988006f00 tx=0x7fb988008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:57.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.486+0000 7fb9817fa700 1 -- 172.21.15.146:0/3868420269 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb97c053690 con 0x7fb98c142b00 2023-10-06T11:14:57.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.668+0000 7fb992497700 1 -- 172.21.15.146:0/3868420269 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb98c068a00 con 0x7fb98c142b00 2023-10-06T11:14:57.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.668+0000 7fb9817fa700 1 -- 172.21.15.146:0/3868420269 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v113) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb97c056cb0 con 0x7fb98c142b00 2023-10-06T11:14:57.670 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-10-06T11:14:57.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.670+0000 7fb992497700 1 -- 172.21.15.146:0/3868420269 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb970066f30 msgr2=0x7fb9700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:57.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.670+0000 7fb992497700 1 --2- 172.21.15.146:0/3868420269 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb970066f30 0x7fb9700693e0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fb988006f00 tx=0x7fb988008040 comp rx=0 tx=0).stop 2023-10-06T11:14:57.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.670+0000 7fb992497700 1 -- 172.21.15.146:0/3868420269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb98c142b00 msgr2=0x7fb98c0c6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:57.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.670+0000 7fb992497700 1 --2- 172.21.15.146:0/3868420269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb98c142b00 0x7fb98c0c6c40 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7fb97c0090b0 tx=0x7fb97c017000 comp rx=0 tx=0).stop 2023-10-06T11:14:57.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.670+0000 7fb992497700 1 -- 172.21.15.146:0/3868420269 shutdown_connections 2023-10-06T11:14:57.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.670+0000 7fb992497700 1 --2- 172.21.15.146:0/3868420269 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb970066f30 0x7fb9700693e0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.670+0000 7fb992497700 1 --2- 172.21.15.146:0/3868420269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb98c142ed0 0x7fb98c069100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.670+0000 7fb992497700 1 --2- 172.21.15.146:0/3868420269 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb98c06bb90 0x7fb98c1400a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.670+0000 7fb992497700 1 --2- 172.21.15.146:0/3868420269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb98c142b00 0x7fb98c0c6c40 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.670+0000 7fb992497700 1 -- 172.21.15.146:0/3868420269 >> 172.21.15.146:0/3868420269 conn(0x7fb98c0ce230 msgr2=0x7fb98c0ce600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:57.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.670+0000 7fb992497700 1 -- 172.21.15.146:0/3868420269 shutdown_connections 2023-10-06T11:14:57.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.670+0000 7fb992497700 1 -- 172.21.15.146:0/3868420269 wait complete. 2023-10-06T11:14:57.684 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T11:14:57.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.801+0000 7fa2738b3700 1 Processor -- start 2023-10-06T11:14:57.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.801+0000 7fa2738b3700 1 -- start start 2023-10-06T11:14:57.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.802+0000 7fa2738b3700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa26c15a160 0x7fa26c0c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:57.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.802+0000 7fa2738b3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa26c0ae730 0x7fa26c0aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:57.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.802+0000 7fa2738b3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa26c0ce3d0 0x7fa26c0ce810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:57.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.802+0000 7fa2738b3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa26c0ae2a0 con 0x7fa26c0ae730 2023-10-06T11:14:57.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.802+0000 7fa2738b3700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa26c15a530 con 0x7fa26c15a160 2023-10-06T11:14:57.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.802+0000 7fa2738b3700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa26c0af0f0 con 0x7fa26c0ce3d0 2023-10-06T11:14:57.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.802+0000 7fa270e4e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa26c0ae730 0x7fa26c0aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:57.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.802+0000 7fa270e4e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa26c0ae730 0x7fa26c0aebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41372/0 (socket says 172.21.15.146:41372) 2023-10-06T11:14:57.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.802+0000 7fa270e4e700 1 -- 172.21.15.146:0/4000840717 learned_addr learned my addr 172.21.15.146:0/4000840717 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:57.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.802+0000 7fa27164f700 1 --2- 172.21.15.146:0/4000840717 >> v2:172.21.15.151:3300/0 conn(0x7fa26c15a160 0x7fa26c0c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:57.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.802+0000 7fa270e4e700 1 -- 172.21.15.146:0/4000840717 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa26c0ce3d0 msgr2=0x7fa26c0ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:57.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.802+0000 7fa271e50700 1 --2- 172.21.15.146:0/4000840717 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa26c0ce3d0 0x7fa26c0ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:57.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.802+0000 7fa270e4e700 1 --2- 172.21.15.146:0/4000840717 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa26c0ce3d0 0x7fa26c0ce810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.802+0000 7fa270e4e700 1 -- 172.21.15.146:0/4000840717 >> v2:172.21.15.151:3300/0 conn(0x7fa26c15a160 msgr2=0x7fa26c0c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:57.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.802+0000 7fa270e4e700 1 --2- 172.21.15.146:0/4000840717 >> v2:172.21.15.151:3300/0 conn(0x7fa26c15a160 0x7fa26c0c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.802+0000 7fa270e4e700 1 -- 172.21.15.146:0/4000840717 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa26c0ad690 con 0x7fa26c0ae730 2023-10-06T11:14:57.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.803+0000 7fa27164f700 1 --2- 172.21.15.146:0/4000840717 >> v2:172.21.15.151:3300/0 conn(0x7fa26c15a160 0x7fa26c0c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:57.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.803+0000 7fa271e50700 1 --2- 172.21.15.146:0/4000840717 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa26c0ce3d0 0x7fa26c0ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:57.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.803+0000 7fa270e4e700 1 --2- 172.21.15.146:0/4000840717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa26c0ae730 0x7fa26c0aebb0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7fa26c065100 tx=0x7fa25c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e2c274d70e1be28 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:57.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.803+0000 7fa263fff700 1 -- 172.21.15.146:0/4000840717 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25c00b860 con 0x7fa26c0ae730 2023-10-06T11:14:57.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.803+0000 7fa263fff700 1 -- 172.21.15.146:0/4000840717 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa25c00b9c0 con 0x7fa26c0ae730 2023-10-06T11:14:57.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.803+0000 7fa263fff700 1 -- 172.21.15.146:0/4000840717 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25c00bd60 con 0x7fa26c0ae730 2023-10-06T11:14:57.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.803+0000 7fa2738b3700 1 -- 172.21.15.146:0/4000840717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa26c0ae730 msgr2=0x7fa26c0aebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:57.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.803+0000 7fa2738b3700 1 --2- 172.21.15.146:0/4000840717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa26c0ae730 0x7fa26c0aebb0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7fa26c065100 tx=0x7fa25c009250 comp rx=0 tx=0).stop 2023-10-06T11:14:57.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.803+0000 7fa2738b3700 1 -- 172.21.15.146:0/4000840717 shutdown_connections 2023-10-06T11:14:57.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.803+0000 7fa2738b3700 1 --2- 172.21.15.146:0/4000840717 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa26c0ce3d0 0x7fa26c0ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.803+0000 7fa2738b3700 1 --2- 172.21.15.146:0/4000840717 >> v2:172.21.15.151:3300/0 conn(0x7fa26c15a160 0x7fa26c0c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.803+0000 7fa2738b3700 1 --2- 172.21.15.146:0/4000840717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa26c0ae730 0x7fa26c0aebb0 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.803+0000 7fa2738b3700 1 -- 172.21.15.146:0/4000840717 >> 172.21.15.146:0/4000840717 conn(0x7fa26c06f380 msgr2=0x7fa26c0d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:57.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.803+0000 7fa2738b3700 1 -- 172.21.15.146:0/4000840717 shutdown_connections 2023-10-06T11:14:57.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.803+0000 7fa2738b3700 1 -- 172.21.15.146:0/4000840717 wait complete. 2023-10-06T11:14:57.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.804+0000 7fa2738b3700 1 Processor -- start 2023-10-06T11:14:57.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.805+0000 7fa2738b3700 1 -- start start 2023-10-06T11:14:57.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.805+0000 7fa2738b3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa26c0ae730 0x7fa26c0b1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:57.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.805+0000 7fa2738b3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa26c0ce3d0 0x7fa26c14b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:57.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.805+0000 7fa2738b3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa26c15a160 0x7fa26c169fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:57.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.805+0000 7fa2738b3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26c0b4740 con 0x7fa26c0ce3d0 2023-10-06T11:14:57.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.805+0000 7fa2738b3700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa26c0b55a0 con 0x7fa26c0ae730 2023-10-06T11:14:57.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.805+0000 7fa2738b3700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa26c0b4990 con 0x7fa26c15a160 2023-10-06T11:14:57.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.805+0000 7fa270e4e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa26c0ce3d0 0x7fa26c14b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:57.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.806+0000 7fa270e4e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa26c0ce3d0 0x7fa26c14b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41388/0 (socket says 172.21.15.146:41388) 2023-10-06T11:14:57.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.806+0000 7fa270e4e700 1 -- 172.21.15.146:0/2093689568 learned_addr learned my addr 172.21.15.146:0/2093689568 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:57.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.806+0000 7fa27164f700 1 --2- 172.21.15.146:0/2093689568 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa26c0ae730 0x7fa26c0b1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:57.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.806+0000 7fa271e50700 1 --2- 172.21.15.146:0/2093689568 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa26c15a160 0x7fa26c169fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:57.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.806+0000 7fa270e4e700 1 -- 172.21.15.146:0/2093689568 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa26c15a160 msgr2=0x7fa26c169fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:57.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.806+0000 7fa270e4e700 1 --2- 172.21.15.146:0/2093689568 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa26c15a160 0x7fa26c169fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.806+0000 7fa270e4e700 1 -- 172.21.15.146:0/2093689568 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa26c0ae730 msgr2=0x7fa26c0b1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:57.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.806+0000 7fa270e4e700 1 --2- 172.21.15.146:0/2093689568 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa26c0ae730 0x7fa26c0b1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:57.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.806+0000 7fa270e4e700 1 -- 172.21.15.146:0/2093689568 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa25c0094f0 con 0x7fa26c0ce3d0 2023-10-06T11:14:57.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.806+0000 7fa270e4e700 1 --2- 172.21.15.146:0/2093689568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa26c0ce3d0 0x7fa26c14b3b0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7fa25c006fd0 tx=0x7fa25c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:57.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.806+0000 7fa2617fa700 1 -- 172.21.15.146:0/2093689568 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25c024440 con 0x7fa26c0ce3d0 2023-10-06T11:14:57.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.806+0000 7fa2617fa700 1 -- 172.21.15.146:0/2093689568 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa25c0245a0 con 0x7fa26c0ce3d0 2023-10-06T11:14:57.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.806+0000 7fa2738b3700 1 -- 172.21.15.146:0/2093689568 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa26c0b4c70 con 0x7fa26c0ce3d0 2023-10-06T11:14:57.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.806+0000 7fa2617fa700 1 -- 172.21.15.146:0/2093689568 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25c024960 con 0x7fa26c0ce3d0 2023-10-06T11:14:57.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.806+0000 7fa2738b3700 1 -- 172.21.15.146:0/2093689568 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa26c0b5230 con 0x7fa26c0ce3d0 2023-10-06T11:14:57.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.807+0000 7fa2738b3700 1 -- 172.21.15.146:0/2093689568 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa26c068390 con 0x7fa26c0ce3d0 2023-10-06T11:14:57.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.807+0000 7fa2617fa700 1 -- 172.21.15.146:0/2093689568 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa25c01a420 con 0x7fa26c0ce3d0 2023-10-06T11:14:57.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.808+0000 7fa2617fa700 1 --2- 172.21.15.146:0/2093689568 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa250066f30 0x7fa2500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:57.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.808+0000 7fa2617fa700 1 -- 172.21.15.146:0/2093689568 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa25c0864c0 con 0x7fa26c0ce3d0 2023-10-06T11:14:57.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.808+0000 7fa27164f700 1 --2- 172.21.15.146:0/2093689568 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa250066f30 0x7fa2500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:57.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.808+0000 7fa27164f700 1 --2- 172.21.15.146:0/2093689568 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa250066f30 0x7fa2500693e0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fa26c0686f0 tx=0x7fa268008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:57.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.812+0000 7fa2617fa700 1 -- 172.21.15.146:0/2093689568 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa25c0535d0 con 0x7fa26c0ce3d0 2023-10-06T11:14:57.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.995+0000 7fa2738b3700 1 -- 172.21.15.146:0/2093689568 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa26c04c380 con 0x7fa26c0ce3d0 2023-10-06T11:14:57.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.995+0000 7fa2617fa700 1 -- 172.21.15.146:0/2093689568 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v113) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa25c056bf0 con 0x7fa26c0ce3d0 2023-10-06T11:14:57.997 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2023-10-06T11:14:57.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.997+0000 7fa2738b3700 1 -- 172.21.15.146:0/2093689568 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa250066f30 msgr2=0x7fa2500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:58.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.997+0000 7fa2738b3700 1 --2- 172.21.15.146:0/2093689568 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa250066f30 0x7fa2500693e0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fa26c0686f0 tx=0x7fa268008040 comp rx=0 tx=0).stop 2023-10-06T11:14:58.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.998+0000 7fa2738b3700 1 -- 172.21.15.146:0/2093689568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa26c0ce3d0 msgr2=0x7fa26c14b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:58.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.998+0000 7fa2738b3700 1 --2- 172.21.15.146:0/2093689568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa26c0ce3d0 0x7fa26c14b3b0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7fa25c006fd0 tx=0x7fa25c017000 comp rx=0 tx=0).stop 2023-10-06T11:14:58.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.998+0000 7fa2738b3700 1 -- 172.21.15.146:0/2093689568 shutdown_connections 2023-10-06T11:14:58.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.998+0000 7fa2738b3700 1 --2- 172.21.15.146:0/2093689568 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa250066f30 0x7fa2500693e0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.998+0000 7fa2738b3700 1 --2- 172.21.15.146:0/2093689568 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa26c15a160 0x7fa26c169fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.998+0000 7fa2738b3700 1 --2- 172.21.15.146:0/2093689568 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa26c0ae730 0x7fa26c0b1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.998+0000 7fa2738b3700 1 --2- 172.21.15.146:0/2093689568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa26c0ce3d0 0x7fa26c14b3b0 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.998+0000 7fa2738b3700 1 -- 172.21.15.146:0/2093689568 >> 172.21.15.146:0/2093689568 conn(0x7fa26c06f380 msgr2=0x7fa26c0cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:58.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.998+0000 7fa2738b3700 1 -- 172.21.15.146:0/2093689568 shutdown_connections 2023-10-06T11:14:58.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:57.998+0000 7fa2738b3700 1 -- 172.21.15.146:0/2093689568 wait complete. 2023-10-06T11:14:58.012 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T11:14:58.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.128+0000 7f5dd5bd4700 1 Processor -- start 2023-10-06T11:14:58.130 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.128+0000 7f5dd5bd4700 1 -- start start 2023-10-06T11:14:58.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.129+0000 7f5dd5bd4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5dd015a160 0x7f5dd00c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:58.132 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.129+0000 7f5dd5bd4700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5dd00cb950 0x7f5dd00cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:58.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.129+0000 7f5dd5bd4700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dd00ae2a0 con 0x7f5dd00ae730 2023-10-06T11:14:58.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.129+0000 7f5dd5bd4700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dd015a530 con 0x7f5dd015a160 2023-10-06T11:14:58.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.129+0000 7f5dd5bd4700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dd00ad690 con 0x7f5dd00cb950 2023-10-06T11:14:58.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.129+0000 7f5dcf7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5dd015a160 0x7f5dd00c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:58.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.129+0000 7f5dcf7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5dd015a160 0x7f5dd00c55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41400/0 (socket says 172.21.15.146:41400) 2023-10-06T11:14:58.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.129+0000 7f5dcf7fe700 1 -- 172.21.15.146:0/3449314672 learned_addr learned my addr 172.21.15.146:0/3449314672 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:58.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.129+0000 7f5dcffff700 1 --2- 172.21.15.146:0/3449314672 >> v2:172.21.15.151:3300/0 conn(0x7f5dd00cb950 0x7f5dd00cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:58.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.129+0000 7f5dcf7fe700 1 -- 172.21.15.146:0/3449314672 >> v2:172.21.15.151:3300/0 conn(0x7f5dd00cb950 msgr2=0x7f5dd00cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:58.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.129+0000 7f5dcf7fe700 1 --2- 172.21.15.146:0/3449314672 >> v2:172.21.15.151:3300/0 conn(0x7f5dd00cb950 0x7f5dd00cbd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.129+0000 7f5dcf7fe700 1 -- 172.21.15.146:0/3449314672 >> v1:172.21.15.151:6789/0 conn(0x7f5dd00ae730 legacy=0x7f5dd00aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:58.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.129+0000 7f5dcf7fe700 1 -- 172.21.15.146:0/3449314672 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd00ad970 con 0x7f5dd015a160 2023-10-06T11:14:58.133 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.130+0000 7f5dcf7fe700 1 --2- 172.21.15.146:0/3449314672 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5dd015a160 0x7f5dd00c55a0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f5dd00890e0 tx=0x7f5dc0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b66b7b52bb2fe74d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:58.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.130+0000 7f5dce7fc700 1 -- 172.21.15.146:0/3449314672 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc000e070 con 0x7f5dd015a160 2023-10-06T11:14:58.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.130+0000 7f5dce7fc700 1 -- 172.21.15.146:0/3449314672 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dc000ba20 con 0x7f5dd015a160 2023-10-06T11:14:58.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.130+0000 7f5dce7fc700 1 -- 172.21.15.146:0/3449314672 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc00092e0 con 0x7f5dd015a160 2023-10-06T11:14:58.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.130+0000 7f5dd5bd4700 1 -- 172.21.15.146:0/3449314672 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5dd015a160 msgr2=0x7f5dd00c55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:58.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.130+0000 7f5dd5bd4700 1 --2- 172.21.15.146:0/3449314672 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5dd015a160 0x7f5dd00c55a0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f5dd00890e0 tx=0x7f5dc0009840 comp rx=0 tx=0).stop 2023-10-06T11:14:58.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.130+0000 7f5dd5bd4700 1 -- 172.21.15.146:0/3449314672 shutdown_connections 2023-10-06T11:14:58.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.130+0000 7f5dd5bd4700 1 --2- 172.21.15.146:0/3449314672 >> v2:172.21.15.151:3300/0 conn(0x7f5dd00cb950 0x7f5dd00cbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.130+0000 7f5dd5bd4700 1 --2- 172.21.15.146:0/3449314672 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5dd015a160 0x7f5dd00c55a0 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.130+0000 7f5dd5bd4700 1 -- 172.21.15.146:0/3449314672 >> 172.21.15.146:0/3449314672 conn(0x7f5dd006f380 msgr2=0x7f5dd00d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:58.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.130+0000 7f5dd5bd4700 1 -- 172.21.15.146:0/3449314672 shutdown_connections 2023-10-06T11:14:58.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.130+0000 7f5dd5bd4700 1 -- 172.21.15.146:0/3449314672 wait complete. 2023-10-06T11:14:58.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.132+0000 7f5dd5bd4700 1 Processor -- start 2023-10-06T11:14:58.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.132+0000 7f5dd5bd4700 1 -- start start 2023-10-06T11:14:58.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.132+0000 7f5dd5bd4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5dd00ae730 0x7f5dd00b1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:58.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.132+0000 7f5dd5bd4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5dd00cb950 0x7f5dd0158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:58.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.132+0000 7f5dd5bd4700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5dd015a160 0x7f5dd00c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:58.137 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.132+0000 7f5dd5bd4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd015e740 con 0x7f5dd00ae730 2023-10-06T11:14:58.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.132+0000 7f5dd5bd4700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd015f560 con 0x7f5dd00cb950 2023-10-06T11:14:58.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.132+0000 7f5dd5bd4700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd015e950 con 0x7f5dd015a160 2023-10-06T11:14:58.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.132+0000 7f5dcf7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5dd00ae730 0x7f5dd00b1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:58.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.132+0000 7f5dcf7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5dd00ae730 0x7f5dd00b1fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41416/0 (socket says 172.21.15.146:41416) 2023-10-06T11:14:58.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.132+0000 7f5dcf7fe700 1 -- 172.21.15.146:0/3815985703 learned_addr learned my addr 172.21.15.146:0/3815985703 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:58.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.133+0000 7f5dcffff700 1 --2- 172.21.15.146:0/3815985703 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5dd015a160 0x7f5dd00c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:58.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.133+0000 7f5dceffd700 1 --2- 172.21.15.146:0/3815985703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5dd00cb950 0x7f5dd0158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:58.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.133+0000 7f5dcf7fe700 1 -- 172.21.15.146:0/3815985703 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5dd015a160 msgr2=0x7f5dd00c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:58.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.133+0000 7f5dcf7fe700 1 --2- 172.21.15.146:0/3815985703 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5dd015a160 0x7f5dd00c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.133+0000 7f5dcf7fe700 1 -- 172.21.15.146:0/3815985703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5dd00cb950 msgr2=0x7f5dd0158460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:58.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.133+0000 7f5dcf7fe700 1 --2- 172.21.15.146:0/3815985703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5dd00cb950 0x7f5dd0158460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.133+0000 7f5dcf7fe700 1 -- 172.21.15.146:0/3815985703 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc0009ae0 con 0x7f5dd00ae730 2023-10-06T11:14:58.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.133+0000 7f5dceffd700 1 --2- 172.21.15.146:0/3815985703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5dd00cb950 0x7f5dd0158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:58.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.133+0000 7f5dcf7fe700 1 --2- 172.21.15.146:0/3815985703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5dd00ae730 0x7f5dd00b1fd0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0012000 tx=0x7f5dc0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:58.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.133+0000 7f5db77fe700 1 -- 172.21.15.146:0/3815985703 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc0008a80 con 0x7f5dd00ae730 2023-10-06T11:14:58.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.133+0000 7f5db77fe700 1 -- 172.21.15.146:0/3815985703 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dc0008be0 con 0x7f5dd00ae730 2023-10-06T11:14:58.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.133+0000 7f5dd5bd4700 1 -- 172.21.15.146:0/3815985703 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dd015ec30 con 0x7f5dd00ae730 2023-10-06T11:14:58.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.133+0000 7f5db77fe700 1 -- 172.21.15.146:0/3815985703 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc001c410 con 0x7f5dd00ae730 2023-10-06T11:14:58.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.133+0000 7f5dd5bd4700 1 -- 172.21.15.146:0/3815985703 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dd015f1f0 con 0x7f5dd00ae730 2023-10-06T11:14:58.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.134+0000 7f5dd5bd4700 1 -- 172.21.15.146:0/3815985703 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dd0068390 con 0x7f5dd00ae730 2023-10-06T11:14:58.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.134+0000 7f5db77fe700 1 -- 172.21.15.146:0/3815985703 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5dc0003040 con 0x7f5dd00ae730 2023-10-06T11:14:58.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.135+0000 7f5db77fe700 1 --2- 172.21.15.146:0/3815985703 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5dbc066f30 0x7f5dbc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:58.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.135+0000 7f5db77fe700 1 -- 172.21.15.146:0/3815985703 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5dc0085d60 con 0x7f5dd00ae730 2023-10-06T11:14:58.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.135+0000 7f5dceffd700 1 --2- 172.21.15.146:0/3815985703 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5dbc066f30 0x7f5dbc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:58.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.135+0000 7f5dceffd700 1 --2- 172.21.15.146:0/3815985703 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5dbc066f30 0x7f5dbc0693e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4007fd0 tx=0x7f5dc4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:58.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.139+0000 7f5db77fe700 1 -- 172.21.15.146:0/3815985703 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5dc0052e70 con 0x7f5dd00ae730 2023-10-06T11:14:58.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.322+0000 7f5dd5bd4700 1 -- 172.21.15.146:0/3815985703 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5dd004c380 con 0x7f5dd00ae730 2023-10-06T11:14:58.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.322+0000 7f5db77fe700 1 -- 172.21.15.146:0/3815985703 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v113) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5dc00210a0 con 0x7f5dd00ae730 2023-10-06T11:14:58.324 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2023-10-06T11:14:58.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.324+0000 7f5dd5bd4700 1 -- 172.21.15.146:0/3815985703 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5dbc066f30 msgr2=0x7f5dbc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:58.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.324+0000 7f5dd5bd4700 1 --2- 172.21.15.146:0/3815985703 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5dbc066f30 0x7f5dbc0693e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4007fd0 tx=0x7f5dc4009040 comp rx=0 tx=0).stop 2023-10-06T11:14:58.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.324+0000 7f5dd5bd4700 1 -- 172.21.15.146:0/3815985703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5dd00ae730 msgr2=0x7f5dd00b1fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:58.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.324+0000 7f5dd5bd4700 1 --2- 172.21.15.146:0/3815985703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5dd00ae730 0x7f5dd00b1fd0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0012000 tx=0x7f5dc0018000 comp rx=0 tx=0).stop 2023-10-06T11:14:58.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.324+0000 7f5dd5bd4700 1 -- 172.21.15.146:0/3815985703 shutdown_connections 2023-10-06T11:14:58.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.324+0000 7f5dd5bd4700 1 --2- 172.21.15.146:0/3815985703 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5dbc066f30 0x7f5dbc0693e0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.324+0000 7f5dd5bd4700 1 --2- 172.21.15.146:0/3815985703 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5dd015a160 0x7f5dd00c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.324+0000 7f5dd5bd4700 1 --2- 172.21.15.146:0/3815985703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5dd00ae730 0x7f5dd00b1fd0 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.324+0000 7f5dd5bd4700 1 --2- 172.21.15.146:0/3815985703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5dd00cb950 0x7f5dd0158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.324+0000 7f5dd5bd4700 1 -- 172.21.15.146:0/3815985703 >> 172.21.15.146:0/3815985703 conn(0x7f5dd006f380 msgr2=0x7f5dd00cbe00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:58.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.324+0000 7f5dd5bd4700 1 -- 172.21.15.146:0/3815985703 shutdown_connections 2023-10-06T11:14:58.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.324+0000 7f5dd5bd4700 1 -- 172.21.15.146:0/3815985703 wait complete. 2023-10-06T11:14:58.339 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:14:58.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.454+0000 7f254f59e700 1 Processor -- start 2023-10-06T11:14:58.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.454+0000 7f254f59e700 1 -- start start 2023-10-06T11:14:58.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.455+0000 7f254f59e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f255015cbd0 0x7f25500b0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:58.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.455+0000 7f254f59e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25500b3770 0x7f25500b1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:58.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.455+0000 7f254f59e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25500ae100 con 0x7f255006f780 2023-10-06T11:14:58.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.455+0000 7f254f59e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25500b0db0 con 0x7f255015cbd0 2023-10-06T11:14:58.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.455+0000 7f254f59e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25500d0f10 con 0x7f25500b3770 2023-10-06T11:14:58.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.455+0000 7f254e59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f255015cbd0 0x7f25500b0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:58.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.455+0000 7f254e59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f255015cbd0 0x7f25500b0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41422/0 (socket says 172.21.15.146:41422) 2023-10-06T11:14:58.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.455+0000 7f254e59c700 1 -- 172.21.15.146:0/2308353218 learned_addr learned my addr 172.21.15.146:0/2308353218 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:58.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.455+0000 7f254ed9d700 1 --1- 172.21.15.146:0/2308353218 >> v1:172.21.15.146:6789/0 conn(0x7f255006f780 0x7f25500aeb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:41602/0 (socket says 172.21.15.146:41602) 2023-10-06T11:14:58.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.455+0000 7f2545d9b700 1 --2- 172.21.15.146:0/2308353218 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25500b3770 0x7f25500b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:58.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.455+0000 7f254e59c700 1 -- 172.21.15.146:0/2308353218 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25500b3770 msgr2=0x7f25500b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:58.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.455+0000 7f254e59c700 1 --2- 172.21.15.146:0/2308353218 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25500b3770 0x7f25500b1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.455+0000 7f254e59c700 1 -- 172.21.15.146:0/2308353218 >> v1:172.21.15.146:6789/0 conn(0x7f255006f780 legacy=0x7f25500aeb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:58.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.455+0000 7f254e59c700 1 -- 172.21.15.146:0/2308353218 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25500d11f0 con 0x7f255015cbd0 2023-10-06T11:14:58.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.455+0000 7f2545d9b700 1 --2- 172.21.15.146:0/2308353218 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25500b3770 0x7f25500b1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:14:58.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.455+0000 7f254e59c700 1 --2- 172.21.15.146:0/2308353218 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f255015cbd0 0x7f25500b0870 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f25400099e0 tx=0x7f2540009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b13b7f2cb2245 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:58.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.456+0000 7f254dd9b700 1 -- 172.21.15.146:0/2308353218 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254000b820 con 0x7f255015cbd0 2023-10-06T11:14:58.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.456+0000 7f254dd9b700 1 -- 172.21.15.146:0/2308353218 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254000b980 con 0x7f255015cbd0 2023-10-06T11:14:58.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.456+0000 7f254dd9b700 1 -- 172.21.15.146:0/2308353218 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254000bd20 con 0x7f255015cbd0 2023-10-06T11:14:58.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.456+0000 7f254f59e700 1 -- 172.21.15.146:0/2308353218 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f255015cbd0 msgr2=0x7f25500b0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:58.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.456+0000 7f254f59e700 1 --2- 172.21.15.146:0/2308353218 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f255015cbd0 0x7f25500b0870 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f25400099e0 tx=0x7f2540009250 comp rx=0 tx=0).stop 2023-10-06T11:14:58.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.456+0000 7f254f59e700 1 -- 172.21.15.146:0/2308353218 shutdown_connections 2023-10-06T11:14:58.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.456+0000 7f254f59e700 1 --2- 172.21.15.146:0/2308353218 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f255015cbd0 0x7f25500b0870 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.456+0000 7f254f59e700 1 --2- 172.21.15.146:0/2308353218 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25500b3770 0x7f25500b1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.456+0000 7f254f59e700 1 -- 172.21.15.146:0/2308353218 >> 172.21.15.146:0/2308353218 conn(0x7f255006f380 msgr2=0x7f25500d0660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:58.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.456+0000 7f254f59e700 1 -- 172.21.15.146:0/2308353218 shutdown_connections 2023-10-06T11:14:58.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.456+0000 7f254f59e700 1 -- 172.21.15.146:0/2308353218 wait complete. 2023-10-06T11:14:58.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.457+0000 7f254f59e700 1 Processor -- start 2023-10-06T11:14:58.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.457+0000 7f254f59e700 1 -- start start 2023-10-06T11:14:58.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.458+0000 7f254f59e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f255006f780 0x7f255014c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:58.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.458+0000 7f254f59e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25500b3770 0x7f2550159470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:58.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.458+0000 7f254f59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f255015cbd0 0x7f25500ad0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:58.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.458+0000 7f254f59e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25501599b0 con 0x7f255015cbd0 2023-10-06T11:14:58.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.458+0000 7f254f59e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255015e650 con 0x7f255006f780 2023-10-06T11:14:58.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.458+0000 7f254f59e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f255015a7b0 con 0x7f25500b3770 2023-10-06T11:14:58.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.458+0000 7f254ed9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f255015cbd0 0x7f25500ad0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:58.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.458+0000 7f254ed9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f255015cbd0 0x7f25500ad0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41428/0 (socket says 172.21.15.146:41428) 2023-10-06T11:14:58.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.458+0000 7f254ed9d700 1 -- 172.21.15.146:0/3158472891 learned_addr learned my addr 172.21.15.146:0/3158472891 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:58.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.458+0000 7f254e59c700 1 --2- 172.21.15.146:0/3158472891 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f255006f780 0x7f255014c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:58.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.458+0000 7f2545d9b700 1 --2- 172.21.15.146:0/3158472891 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25500b3770 0x7f2550159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:58.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.459+0000 7f254ed9d700 1 -- 172.21.15.146:0/3158472891 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25500b3770 msgr2=0x7f2550159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:58.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.459+0000 7f254ed9d700 1 --2- 172.21.15.146:0/3158472891 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25500b3770 0x7f2550159470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.459+0000 7f254ed9d700 1 -- 172.21.15.146:0/3158472891 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f255006f780 msgr2=0x7f255014c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:58.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.459+0000 7f254ed9d700 1 --2- 172.21.15.146:0/3158472891 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f255006f780 0x7f255014c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.459+0000 7f254ed9d700 1 -- 172.21.15.146:0/3158472891 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25400094f0 con 0x7f255015cbd0 2023-10-06T11:14:58.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.459+0000 7f254e59c700 1 --2- 172.21.15.146:0/3158472891 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f255006f780 0x7f255014c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:58.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.459+0000 7f254ed9d700 1 --2- 172.21.15.146:0/3158472891 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f255015cbd0 0x7f25500ad0f0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f254800cd60 tx=0x7f2548001ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:58.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.459+0000 7f2546ffd700 1 -- 172.21.15.146:0/3158472891 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2548005df0 con 0x7f255015cbd0 2023-10-06T11:14:58.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.459+0000 7f2546ffd700 1 -- 172.21.15.146:0/3158472891 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254800a920 con 0x7f255015cbd0 2023-10-06T11:14:58.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.459+0000 7f254f59e700 1 -- 172.21.15.146:0/3158472891 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2550159ba0 con 0x7f255015cbd0 2023-10-06T11:14:58.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.459+0000 7f2546ffd700 1 -- 172.21.15.146:0/3158472891 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254800ace0 con 0x7f255015cbd0 2023-10-06T11:14:58.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.459+0000 7f254f59e700 1 -- 172.21.15.146:0/3158472891 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f255015a160 con 0x7f255015cbd0 2023-10-06T11:14:58.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.460+0000 7f254f59e700 1 -- 172.21.15.146:0/3158472891 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2550088170 con 0x7f255015cbd0 2023-10-06T11:14:58.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.460+0000 7f2546ffd700 1 -- 172.21.15.146:0/3158472891 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2548007300 con 0x7f255015cbd0 2023-10-06T11:14:58.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.461+0000 7f2546ffd700 1 --2- 172.21.15.146:0/3158472891 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2530066f30 0x7f25300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:58.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.461+0000 7f254e59c700 1 --2- 172.21.15.146:0/3158472891 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2530066f30 0x7f25300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:58.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.461+0000 7f2546ffd700 1 -- 172.21.15.146:0/3158472891 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2548084720 con 0x7f255015cbd0 2023-10-06T11:14:58.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.461+0000 7f254e59c700 1 --2- 172.21.15.146:0/3158472891 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2530066f30 0x7f25300693e0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f25400099e0 tx=0x7f2540017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:58.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.465+0000 7f2546ffd700 1 -- 172.21.15.146:0/3158472891 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f25480518b0 con 0x7f255015cbd0 2023-10-06T11:14:58.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.696+0000 7f254f59e700 1 -- 172.21.15.146:0/3158472891 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25500ae350 con 0x7f255015cbd0 2023-10-06T11:14:58.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.696+0000 7f2546ffd700 1 -- 172.21.15.146:0/3158472891 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) v1 ==== 95+0+4610 (secure 0 0 0) 0x7f2548054ed0 con 0x7f255015cbd0 2023-10-06T11:14:58.698 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:58.699 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":100,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6560,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/2109567995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2109567995},{"type":"v1","addr":"172.21.15.151:6834","nonce":2109567995}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":6563,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1783565134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":1783565134},{"type":"v1","addr":"172.21.15.151:6835","nonce":1783565134}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7327,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/1323749517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1323749517},{"type":"v1","addr":"172.21.15.146:6836","nonce":1323749517}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:14:18.891938+0000","modified":"2023-10-06T11:14:22.531674+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8103":{"gid":8103,"name":"c","rank":0,"incarnation":97,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/409226151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":409226151},{"type":"v1","addr":"172.21.15.146:6837","nonce":409226151}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-06T11:14:58.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.698+0000 7f254f59e700 1 -- 172.21.15.146:0/3158472891 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2530066f30 msgr2=0x7f25300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:58.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.698+0000 7f254f59e700 1 --2- 172.21.15.146:0/3158472891 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2530066f30 0x7f25300693e0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f25400099e0 tx=0x7f2540017000 comp rx=0 tx=0).stop 2023-10-06T11:14:58.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.698+0000 7f254f59e700 1 -- 172.21.15.146:0/3158472891 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f255015cbd0 msgr2=0x7f25500ad0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:58.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.698+0000 7f254f59e700 1 --2- 172.21.15.146:0/3158472891 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f255015cbd0 0x7f25500ad0f0 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f254800cd60 tx=0x7f2548001ab0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.698+0000 7f254f59e700 1 -- 172.21.15.146:0/3158472891 shutdown_connections 2023-10-06T11:14:58.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.698+0000 7f254f59e700 1 --2- 172.21.15.146:0/3158472891 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2530066f30 0x7f25300693e0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.698+0000 7f254f59e700 1 --2- 172.21.15.146:0/3158472891 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f255015cbd0 0x7f25500ad0f0 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.698+0000 7f254f59e700 1 --2- 172.21.15.146:0/3158472891 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f255006f780 0x7f255014c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.698+0000 7f254f59e700 1 --2- 172.21.15.146:0/3158472891 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f25500b3770 0x7f2550159470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.698+0000 7f254f59e700 1 -- 172.21.15.146:0/3158472891 >> 172.21.15.146:0/3158472891 conn(0x7f255006f380 msgr2=0x7f255015ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:58.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.699+0000 7f254f59e700 1 -- 172.21.15.146:0/3158472891 shutdown_connections 2023-10-06T11:14:58.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.699+0000 7f254f59e700 1 -- 172.21.15.146:0/3158472891 wait complete. 2023-10-06T11:14:58.703 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 100 2023-10-06T11:14:58.713 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:14:58.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.826+0000 7ff3c747a700 1 Processor -- start 2023-10-06T11:14:58.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.826+0000 7ff3c747a700 1 -- start start 2023-10-06T11:14:58.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.827+0000 7ff3c747a700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff3c0068ba0 0x7ff3c015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:58.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.827+0000 7ff3c747a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff3c0153e80 0x7ff3c00b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:58.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.827+0000 7ff3c747a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3c015ac30 con 0x7ff3c0153ab0 2023-10-06T11:14:58.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.827+0000 7ff3c747a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3c00b4510 con 0x7ff3c0153e80 2023-10-06T11:14:58.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.827+0000 7ff3c747a700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3c00b6530 con 0x7ff3c0068ba0 2023-10-06T11:14:58.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.827+0000 7ff3c5a17700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff3c0153e80 0x7ff3c00b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:58.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.827+0000 7ff3c5a17700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff3c0153e80 0x7ff3c00b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41436/0 (socket says 172.21.15.146:41436) 2023-10-06T11:14:58.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.827+0000 7ff3c5216700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff3c0153ab0 0x7ff3c0068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:41612/0 (socket says 172.21.15.146:41612) 2023-10-06T11:14:58.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.827+0000 7ff3c5a17700 1 -- 172.21.15.146:0/1087913747 learned_addr learned my addr 172.21.15.146:0/1087913747 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:58.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.827+0000 7ff3c4a15700 1 --2- 172.21.15.146:0/1087913747 >> v2:172.21.15.151:3300/0 conn(0x7ff3c0068ba0 0x7ff3c015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:58.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.827+0000 7ff3c5a17700 1 -- 172.21.15.146:0/1087913747 >> v2:172.21.15.151:3300/0 conn(0x7ff3c0068ba0 msgr2=0x7ff3c015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:58.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.827+0000 7ff3c5a17700 1 --2- 172.21.15.146:0/1087913747 >> v2:172.21.15.151:3300/0 conn(0x7ff3c0068ba0 0x7ff3c015a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.827+0000 7ff3c5a17700 1 -- 172.21.15.146:0/1087913747 >> v1:172.21.15.146:6789/0 conn(0x7ff3c0153ab0 legacy=0x7ff3c0068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:58.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.827+0000 7ff3c5a17700 1 -- 172.21.15.146:0/1087913747 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c00b5c50 con 0x7ff3c0153e80 2023-10-06T11:14:58.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.827+0000 7ff3c5a17700 1 --2- 172.21.15.146:0/1087913747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3c0153e80 0x7ff3c00b49a0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0089770 tx=0x7ff3b8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b85707fb5240cb7a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:58.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.827+0000 7ff3b7fff700 1 -- 172.21.15.146:0/1087913747 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b800e070 con 0x7ff3c0153e80 2023-10-06T11:14:58.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.827+0000 7ff3b7fff700 1 -- 172.21.15.146:0/1087913747 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b800ba50 con 0x7ff3c0153e80 2023-10-06T11:14:58.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.827+0000 7ff3b7fff700 1 -- 172.21.15.146:0/1087913747 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b80092e0 con 0x7ff3c0153e80 2023-10-06T11:14:58.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.828+0000 7ff3c747a700 1 -- 172.21.15.146:0/1087913747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3c0153e80 msgr2=0x7ff3c00b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:58.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.828+0000 7ff3c747a700 1 --2- 172.21.15.146:0/1087913747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3c0153e80 0x7ff3c00b49a0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0089770 tx=0x7ff3b8009840 comp rx=0 tx=0).stop 2023-10-06T11:14:58.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.828+0000 7ff3c747a700 1 -- 172.21.15.146:0/1087913747 shutdown_connections 2023-10-06T11:14:58.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.828+0000 7ff3c747a700 1 --2- 172.21.15.146:0/1087913747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3c0153e80 0x7ff3c00b49a0 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.828+0000 7ff3c747a700 1 --2- 172.21.15.146:0/1087913747 >> v2:172.21.15.151:3300/0 conn(0x7ff3c0068ba0 0x7ff3c015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.828+0000 7ff3c747a700 1 -- 172.21.15.146:0/1087913747 >> 172.21.15.146:0/1087913747 conn(0x7ff3c006eba0 msgr2=0x7ff3c006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:58.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.828+0000 7ff3c747a700 1 -- 172.21.15.146:0/1087913747 shutdown_connections 2023-10-06T11:14:58.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.828+0000 7ff3c747a700 1 -- 172.21.15.146:0/1087913747 wait complete. 2023-10-06T11:14:58.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.829+0000 7ff3c747a700 1 Processor -- start 2023-10-06T11:14:58.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.829+0000 7ff3c747a700 1 -- start start 2023-10-06T11:14:58.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.830+0000 7ff3c747a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3c0068ba0 0x7ff3c00b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:58.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.830+0000 7ff3c747a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3c0153ab0 0x7ff3c01564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:58.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.830+0000 7ff3c747a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3c0153e80 0x7ff3c0144ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:58.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.830+0000 7ff3c747a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c00b1e20 con 0x7ff3c0068ba0 2023-10-06T11:14:58.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.830+0000 7ff3c747a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c00b0e90 con 0x7ff3c0153e80 2023-10-06T11:14:58.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.830+0000 7ff3c747a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c01569e0 con 0x7ff3c0153ab0 2023-10-06T11:14:58.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.830+0000 7ff3c5216700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3c0068ba0 0x7ff3c00b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:58.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.830+0000 7ff3c5216700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3c0068ba0 0x7ff3c00b18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41450/0 (socket says 172.21.15.146:41450) 2023-10-06T11:14:58.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.830+0000 7ff3c5216700 1 -- 172.21.15.146:0/3316389618 learned_addr learned my addr 172.21.15.146:0/3316389618 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:58.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.830+0000 7ff3c5a17700 1 --2- 172.21.15.146:0/3316389618 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3c0153e80 0x7ff3c0144ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:58.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.830+0000 7ff3c4a15700 1 --2- 172.21.15.146:0/3316389618 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3c0153ab0 0x7ff3c01564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:58.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.830+0000 7ff3c5216700 1 -- 172.21.15.146:0/3316389618 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3c0153ab0 msgr2=0x7ff3c01564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:58.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.830+0000 7ff3c5216700 1 --2- 172.21.15.146:0/3316389618 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3c0153ab0 0x7ff3c01564a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.830+0000 7ff3c5216700 1 -- 172.21.15.146:0/3316389618 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3c0153e80 msgr2=0x7ff3c0144ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:58.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.830+0000 7ff3c5216700 1 --2- 172.21.15.146:0/3316389618 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3c0153e80 0x7ff3c0144ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:58.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.830+0000 7ff3c5216700 1 -- 172.21.15.146:0/3316389618 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b8009ae0 con 0x7ff3c0068ba0 2023-10-06T11:14:58.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.831+0000 7ff3c5216700 1 --2- 172.21.15.146:0/3316389618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3c0068ba0 0x7ff3c00b18e0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc00c7c0 tx=0x7ff3bc007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:58.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.831+0000 7ff3b57fa700 1 -- 172.21.15.146:0/3316389618 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3bc005a70 con 0x7ff3c0068ba0 2023-10-06T11:14:58.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.831+0000 7ff3b57fa700 1 -- 172.21.15.146:0/3316389618 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3bc005bf0 con 0x7ff3c0068ba0 2023-10-06T11:14:58.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.831+0000 7ff3c747a700 1 -- 172.21.15.146:0/3316389618 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3c0156c90 con 0x7ff3c0068ba0 2023-10-06T11:14:58.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.831+0000 7ff3b57fa700 1 -- 172.21.15.146:0/3316389618 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3bc0070f0 con 0x7ff3c0068ba0 2023-10-06T11:14:58.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.831+0000 7ff3c747a700 1 -- 172.21.15.146:0/3316389618 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3c00b10e0 con 0x7ff3c0068ba0 2023-10-06T11:14:58.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.832+0000 7ff3c747a700 1 -- 172.21.15.146:0/3316389618 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3c004c380 con 0x7ff3c0068ba0 2023-10-06T11:14:58.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.832+0000 7ff3b57fa700 1 -- 172.21.15.146:0/3316389618 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff3bc007460 con 0x7ff3c0068ba0 2023-10-06T11:14:58.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.833+0000 7ff3b57fa700 1 --2- 172.21.15.146:0/3316389618 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff3a4066f30 0x7ff3a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:58.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.833+0000 7ff3c4a15700 1 --2- 172.21.15.146:0/3316389618 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff3a4066f30 0x7ff3a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:58.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.833+0000 7ff3b57fa700 1 -- 172.21.15.146:0/3316389618 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff3bc083ee0 con 0x7ff3c0068ba0 2023-10-06T11:14:58.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.833+0000 7ff3c4a15700 1 --2- 172.21.15.146:0/3316389618 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff3a4066f30 0x7ff3a40693e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff3c00cf0b0 tx=0x7ff3b0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:58.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:58.837+0000 7ff3b57fa700 1 -- 172.21.15.146:0/3316389618 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff3bc051070 con 0x7ff3c0068ba0 2023-10-06T11:14:59.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.022+0000 7ff3c747a700 1 -- 172.21.15.146:0/3316389618 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3c00b6250 con 0x7ff3c0068ba0 2023-10-06T11:14:59.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.023+0000 7ff3b57fa700 1 -- 172.21.15.146:0/3316389618 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+16928 (secure 0 0 0) 0x7ff3bc054690 con 0x7ff3c0068ba0 2023-10-06T11:14:59.025 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:59.025 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":113,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:14:20.515985+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:14:16.553437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-10-06T11:14:17.858670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:14:59.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.026+0000 7ff3c747a700 1 -- 172.21.15.146:0/3316389618 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff3a4066f30 msgr2=0x7ff3a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:59.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.026+0000 7ff3c747a700 1 --2- 172.21.15.146:0/3316389618 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff3a4066f30 0x7ff3a40693e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7ff3c00cf0b0 tx=0x7ff3b0008040 comp rx=0 tx=0).stop 2023-10-06T11:14:59.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.026+0000 7ff3c747a700 1 -- 172.21.15.146:0/3316389618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3c0068ba0 msgr2=0x7ff3c00b18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:59.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.026+0000 7ff3c747a700 1 --2- 172.21.15.146:0/3316389618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3c0068ba0 0x7ff3c00b18e0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc00c7c0 tx=0x7ff3bc007f70 comp rx=0 tx=0).stop 2023-10-06T11:14:59.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.026+0000 7ff3c747a700 1 -- 172.21.15.146:0/3316389618 shutdown_connections 2023-10-06T11:14:59.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.026+0000 7ff3c747a700 1 --2- 172.21.15.146:0/3316389618 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff3a4066f30 0x7ff3a40693e0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.026+0000 7ff3c747a700 1 --2- 172.21.15.146:0/3316389618 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3c0153e80 0x7ff3c0144ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.026+0000 7ff3c747a700 1 --2- 172.21.15.146:0/3316389618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff3c0068ba0 0x7ff3c00b18e0 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.026+0000 7ff3c747a700 1 --2- 172.21.15.146:0/3316389618 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff3c0153ab0 0x7ff3c01564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.026+0000 7ff3c747a700 1 -- 172.21.15.146:0/3316389618 >> 172.21.15.146:0/3316389618 conn(0x7ff3c006eba0 msgr2=0x7ff3c0153110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:59.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.026+0000 7ff3c747a700 1 -- 172.21.15.146:0/3316389618 shutdown_connections 2023-10-06T11:14:59.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.026+0000 7ff3c747a700 1 -- 172.21.15.146:0/3316389618 wait complete. 2023-10-06T11:14:59.040 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T11:14:59.040 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:14:59.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.154+0000 7f1c4d768700 1 Processor -- start 2023-10-06T11:14:59.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.154+0000 7f1c4d768700 1 -- start start 2023-10-06T11:14:59.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.155+0000 7f1c4d768700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1c48068ba0 0x7f1c4815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:59.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.155+0000 7f1c4d768700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c48153e80 0x7f1c480b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:59.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.155+0000 7f1c4d768700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c4815ac30 con 0x7f1c48153ab0 2023-10-06T11:14:59.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.155+0000 7f1c4d768700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c480b4510 con 0x7f1c48068ba0 2023-10-06T11:14:59.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.155+0000 7f1c4d768700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c480b6530 con 0x7f1c48153e80 2023-10-06T11:14:59.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.155+0000 7f1c46ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f1c48153ab0 0x7f1c48068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:41616/0 (socket says 172.21.15.146:41616) 2023-10-06T11:14:59.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.155+0000 7f1c46ffd700 1 -- 172.21.15.146:0/3809717661 learned_addr learned my addr 172.21.15.146:0/3809717661 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:14:59.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.156+0000 7f1c467fc700 1 -- 172.21.15.146:0/3809717661 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3305975015 0 0) 0x7f1c38001110 con 0x7f1c48153ab0 2023-10-06T11:14:59.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.156+0000 7f1c3e7fc700 1 --2- 172.21.15.146:0/3809717661 >> v2:172.21.15.151:3300/0 conn(0x7f1c48068ba0 0x7f1c4815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:59.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.156+0000 7f1c477fe700 1 --2- 172.21.15.146:0/3809717661 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c48153e80 0x7f1c480b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:59.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.156+0000 7f1c467fc700 1 -- 172.21.15.146:0/3809717661 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c34003570 con 0x7f1c48153ab0 2023-10-06T11:14:59.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.156+0000 7f1c467fc700 1 -- 172.21.15.146:0/3809717661 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3910693489 0 0) 0x7f1c34003570 con 0x7f1c48153ab0 2023-10-06T11:14:59.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.156+0000 7f1c467fc700 1 -- 172.21.15.146:0/3809717661 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c48153e80 msgr2=0x7f1c480b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:59.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.156+0000 7f1c467fc700 1 --2- 172.21.15.146:0/3809717661 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c48153e80 0x7f1c480b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.156+0000 7f1c467fc700 1 -- 172.21.15.146:0/3809717661 >> v2:172.21.15.151:3300/0 conn(0x7f1c48068ba0 msgr2=0x7f1c4815a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:59.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.156+0000 7f1c467fc700 1 --2- 172.21.15.146:0/3809717661 >> v2:172.21.15.151:3300/0 conn(0x7f1c48068ba0 0x7f1c4815a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.156+0000 7f1c467fc700 1 -- 172.21.15.146:0/3809717661 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c480b5c50 con 0x7f1c48153ab0 2023-10-06T11:14:59.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.156+0000 7f1c467fc700 1 -- 172.21.15.146:0/3809717661 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f1c38001600 con 0x7f1c48153ab0 2023-10-06T11:14:59.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.156+0000 7f1c467fc700 1 -- 172.21.15.146:0/3809717661 >> v1:172.21.15.146:6789/0 conn(0x7f1c48153ab0 legacy=0x7f1c48068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:59.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.156+0000 7f1c467fc700 1 --2- 172.21.15.146:0/3809717661 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c48153e80 0x7f1c34003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:59.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.156+0000 7f1c467fc700 1 --2- 172.21.15.146:0/3809717661 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c34003fe0 0x7f1c34004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:59.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.156+0000 7f1c467fc700 1 --2- 172.21.15.146:0/3809717661 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c34004d50 0x7f1c340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:59.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.156+0000 7f1c467fc700 1 -- 172.21.15.146:0/3809717661 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c480b4510 con 0x7f1c34003fe0 2023-10-06T11:14:59.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.156+0000 7f1c467fc700 1 -- 172.21.15.146:0/3809717661 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c480b6530 con 0x7f1c34004d50 2023-10-06T11:14:59.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.156+0000 7f1c467fc700 1 -- 172.21.15.146:0/3809717661 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3400ba90 con 0x7f1c48153e80 2023-10-06T11:14:59.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.156+0000 7f1c3e7fc700 1 --2- 172.21.15.146:0/3809717661 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c34003fe0 0x7f1c34004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:59.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.156+0000 7f1c46ffd700 1 --2- 172.21.15.146:0/3809717661 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c48153e80 0x7f1c34003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:59.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.156+0000 7f1c477fe700 1 --2- 172.21.15.146:0/3809717661 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c34004d50 0x7f1c340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:59.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.156+0000 7f1c3e7fc700 1 -- 172.21.15.146:0/3809717661 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c48153e80 msgr2=0x7f1c34003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:59.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.156+0000 7f1c3e7fc700 1 --2- 172.21.15.146:0/3809717661 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c48153e80 0x7f1c34003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.156+0000 7f1c3e7fc700 1 -- 172.21.15.146:0/3809717661 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c34004d50 msgr2=0x7f1c340051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:59.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.156+0000 7f1c3e7fc700 1 --2- 172.21.15.146:0/3809717661 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c34004d50 0x7f1c340051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.156+0000 7f1c3e7fc700 1 -- 172.21.15.146:0/3809717661 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c34003570 con 0x7f1c34003fe0 2023-10-06T11:14:59.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.157+0000 7f1c3e7fc700 1 --2- 172.21.15.146:0/3809717661 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c34003fe0 0x7f1c34004810 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f1c48068fa0 tx=0x7f1c300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a60e09d6af1a5306 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:59.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.157+0000 7f1c467fc700 1 -- 172.21.15.146:0/3809717661 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3000e6b0 con 0x7f1c34003fe0 2023-10-06T11:14:59.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.157+0000 7f1c467fc700 1 -- 172.21.15.146:0/3809717661 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3000e810 con 0x7f1c34003fe0 2023-10-06T11:14:59.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.157+0000 7f1c467fc700 1 -- 172.21.15.146:0/3809717661 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3000ebd0 con 0x7f1c34003fe0 2023-10-06T11:14:59.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.157+0000 7f1c4d768700 1 -- 172.21.15.146:0/3809717661 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c34003fe0 msgr2=0x7f1c34004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:59.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.157+0000 7f1c4d768700 1 --2- 172.21.15.146:0/3809717661 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c34003fe0 0x7f1c34004810 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f1c48068fa0 tx=0x7f1c300091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.157+0000 7f1c477fe700 1 -- 172.21.15.146:0/3809717661 reap_dead start 2023-10-06T11:14:59.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.157+0000 7f1c4d768700 1 -- 172.21.15.146:0/3809717661 shutdown_connections 2023-10-06T11:14:59.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.157+0000 7f1c4d768700 1 -- 172.21.15.146:0/3809717661 >> 172.21.15.146:0/3809717661 conn(0x7f1c4806eba0 msgr2=0x7f1c4806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:59.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.157+0000 7f1c4d768700 1 -- 172.21.15.146:0/3809717661 shutdown_connections 2023-10-06T11:14:59.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.157+0000 7f1c4d768700 1 -- 172.21.15.146:0/3809717661 wait complete. 2023-10-06T11:14:59.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.158+0000 7f1c4d768700 1 Processor -- start 2023-10-06T11:14:59.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.159+0000 7f1c4d768700 1 -- start start 2023-10-06T11:14:59.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.159+0000 7f1c4d768700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c34003fe0 0x7f1c481593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:59.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.159+0000 7f1c4d768700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c4813d650 0x7f1c48169cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:59.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.159+0000 7f1c4d768700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c4813dac0 0x7f1c4816a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:59.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.159+0000 7f1c4d768700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4815a1c0 con 0x7f1c4813dac0 2023-10-06T11:14:59.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.159+0000 7f1c4d768700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c480b0360 con 0x7f1c4813d650 2023-10-06T11:14:59.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.159+0000 7f1c4d768700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c48159c00 con 0x7f1c34003fe0 2023-10-06T11:14:59.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.159+0000 7f1c477fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c4813dac0 0x7f1c4816a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:59.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.159+0000 7f1c477fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c4813dac0 0x7f1c4816a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41462/0 (socket says 172.21.15.146:41462) 2023-10-06T11:14:59.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.159+0000 7f1c477fe700 1 -- 172.21.15.146:0/3674089845 learned_addr learned my addr 172.21.15.146:0/3674089845 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:59.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.159+0000 7f1c46ffd700 1 --2- 172.21.15.146:0/3674089845 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c34003fe0 0x7f1c481593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:59.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.159+0000 7f1c3e7fc700 1 --2- 172.21.15.146:0/3674089845 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c4813d650 0x7f1c48169cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:59.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.160+0000 7f1c477fe700 1 -- 172.21.15.146:0/3674089845 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c34003fe0 msgr2=0x7f1c481593d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:59.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.160+0000 7f1c477fe700 1 --2- 172.21.15.146:0/3674089845 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c34003fe0 0x7f1c481593d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.160+0000 7f1c477fe700 1 -- 172.21.15.146:0/3674089845 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c4813d650 msgr2=0x7f1c48169cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:59.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.160+0000 7f1c477fe700 1 --2- 172.21.15.146:0/3674089845 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c4813d650 0x7f1c48169cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.160+0000 7f1c477fe700 1 -- 172.21.15.146:0/3674089845 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c48159ee0 con 0x7f1c4813dac0 2023-10-06T11:14:59.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.160+0000 7f1c477fe700 1 --2- 172.21.15.146:0/3674089845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c4813dac0 0x7f1c4816a1f0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f1c4806fa70 tx=0x7f1c4000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:59.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.160+0000 7f1c3f7fe700 1 -- 172.21.15.146:0/3674089845 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4000e040 con 0x7f1c4813dac0 2023-10-06T11:14:59.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.160+0000 7f1c3f7fe700 1 -- 172.21.15.146:0/3674089845 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c4000f040 con 0x7f1c4813dac0 2023-10-06T11:14:59.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.160+0000 7f1c3f7fe700 1 -- 172.21.15.146:0/3674089845 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4000fd70 con 0x7f1c4813dac0 2023-10-06T11:14:59.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.160+0000 7f1c4d768700 1 -- 172.21.15.146:0/3674089845 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c480afff0 con 0x7f1c4813dac0 2023-10-06T11:14:59.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.160+0000 7f1c4d768700 1 -- 172.21.15.146:0/3674089845 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c4816adc0 con 0x7f1c4813dac0 2023-10-06T11:14:59.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.161+0000 7f1c4d768700 1 -- 172.21.15.146:0/3674089845 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c480b04f0 con 0x7f1c4813dac0 2023-10-06T11:14:59.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.161+0000 7f1c3f7fe700 1 -- 172.21.15.146:0/3674089845 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1c40015640 con 0x7f1c4813dac0 2023-10-06T11:14:59.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.162+0000 7f1c3f7fe700 1 --2- 172.21.15.146:0/3674089845 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1c28066f30 0x7f1c280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:59.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.162+0000 7f1c3f7fe700 1 -- 172.21.15.146:0/3674089845 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1c40084e60 con 0x7f1c4813dac0 2023-10-06T11:14:59.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.162+0000 7f1c46ffd700 1 --2- 172.21.15.146:0/3674089845 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1c28066f30 0x7f1c280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:59.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.162+0000 7f1c46ffd700 1 --2- 172.21.15.146:0/3674089845 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1c28066f30 0x7f1c280693e0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f1c38001ed0 tx=0x7f1c38007a80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:59.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.166+0000 7f1c3f7fe700 1 -- 172.21.15.146:0/3674089845 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1c40051f70 con 0x7f1c4813dac0 2023-10-06T11:14:59.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.392+0000 7f1c4d768700 1 -- 172.21.15.146:0/3674089845 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1c4804c380 con 0x7f1c4813dac0 2023-10-06T11:14:59.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.393+0000 7f1c3f7fe700 1 -- 172.21.15.146:0/3674089845 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) v1 ==== 95+0+4610 (secure 0 0 0) 0x7f1c40055590 con 0x7f1c4813dac0 2023-10-06T11:14:59.395 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:59.395 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":100,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6560,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/2109567995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2109567995},{"type":"v1","addr":"172.21.15.151:6834","nonce":2109567995}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":6563,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1783565134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":1783565134},{"type":"v1","addr":"172.21.15.151:6835","nonce":1783565134}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7327,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/1323749517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1323749517},{"type":"v1","addr":"172.21.15.146:6836","nonce":1323749517}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:14:18.891938+0000","modified":"2023-10-06T11:14:22.531674+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8103":{"gid":8103,"name":"c","rank":0,"incarnation":97,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/409226151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":409226151},{"type":"v1","addr":"172.21.15.146:6837","nonce":409226151}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-06T11:14:59.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.394+0000 7f1c4d768700 1 -- 172.21.15.146:0/3674089845 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1c28066f30 msgr2=0x7f1c280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:59.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.394+0000 7f1c4d768700 1 --2- 172.21.15.146:0/3674089845 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1c28066f30 0x7f1c280693e0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f1c38001ed0 tx=0x7f1c38007a80 comp rx=0 tx=0).stop 2023-10-06T11:14:59.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.394+0000 7f1c4d768700 1 -- 172.21.15.146:0/3674089845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c4813dac0 msgr2=0x7f1c4816a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:59.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.394+0000 7f1c4d768700 1 --2- 172.21.15.146:0/3674089845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c4813dac0 0x7f1c4816a1f0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f1c4806fa70 tx=0x7f1c4000b040 comp rx=0 tx=0).stop 2023-10-06T11:14:59.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.395+0000 7f1c4d768700 1 -- 172.21.15.146:0/3674089845 shutdown_connections 2023-10-06T11:14:59.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.395+0000 7f1c4d768700 1 --2- 172.21.15.146:0/3674089845 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1c28066f30 0x7f1c280693e0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.395+0000 7f1c4d768700 1 --2- 172.21.15.146:0/3674089845 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1c4813dac0 0x7f1c4816a1f0 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.395+0000 7f1c4d768700 1 --2- 172.21.15.146:0/3674089845 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c34003fe0 0x7f1c481593d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.395+0000 7f1c4d768700 1 --2- 172.21.15.146:0/3674089845 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c4813d650 0x7f1c48169cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.395+0000 7f1c4d768700 1 -- 172.21.15.146:0/3674089845 >> 172.21.15.146:0/3674089845 conn(0x7f1c4806eba0 msgr2=0x7f1c48152000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:59.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.395+0000 7f1c4d768700 1 -- 172.21.15.146:0/3674089845 shutdown_connections 2023-10-06T11:14:59.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.395+0000 7f1c4d768700 1 -- 172.21.15.146:0/3674089845 wait complete. 2023-10-06T11:14:59.398 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 100 2023-10-06T11:14:59.410 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:14:59.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.523+0000 7f45aef34700 1 Processor -- start 2023-10-06T11:14:59.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.524+0000 7f45aef34700 1 -- start start 2023-10-06T11:14:59.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.524+0000 7f45aef34700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f45a80c97c0 0x7f45a815aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:59.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.524+0000 7f45aef34700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f45a80ca330 0x7f45a806e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:59.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.524+0000 7f45aef34700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45a80b00c0 con 0x7f45a80ca7d0 2023-10-06T11:14:59.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.525+0000 7f45aef34700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45a80afc30 con 0x7f45a80c97c0 2023-10-06T11:14:59.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.525+0000 7f45aef34700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a81569b0 con 0x7f45a80ca330 2023-10-06T11:14:59.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.525+0000 7f45a7fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f45a80ca330 0x7f45a806e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:59.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.525+0000 7f45accd0700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f45a80c97c0 0x7f45a815aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:59.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.525+0000 7f45a7fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f45a80ca330 0x7f45a806e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:58576/0 (socket says 172.21.15.146:58576) 2023-10-06T11:14:59.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.525+0000 7f45ad4d1700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f45a80ca7d0 0x7f45a80b0830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:33624/0 (socket says 172.21.15.146:33624) 2023-10-06T11:14:59.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.525+0000 7f45a7fff700 1 -- 172.21.15.146:0/2888091841 learned_addr learned my addr 172.21.15.146:0/2888091841 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:59.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.525+0000 7f45accd0700 1 -- 172.21.15.146:0/2888091841 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f45a80ca330 msgr2=0x7f45a806e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:59.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.525+0000 7f45accd0700 1 --2- 172.21.15.146:0/2888091841 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f45a80ca330 0x7f45a806e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.525+0000 7f45accd0700 1 -- 172.21.15.146:0/2888091841 >> v1:172.21.15.151:6789/0 conn(0x7f45a80ca7d0 legacy=0x7f45a80b0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:59.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.525+0000 7f45accd0700 1 -- 172.21.15.146:0/2888091841 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a80b1c60 con 0x7f45a80c97c0 2023-10-06T11:14:59.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.525+0000 7f45accd0700 1 --2- 172.21.15.146:0/2888091841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f45a80c97c0 0x7f45a815aae0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f459c0098e0 tx=0x7f459c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d27ff7dfd4d8af29 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:59.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.526+0000 7f45a77fe700 1 -- 172.21.15.146:0/2888091841 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459c00b640 con 0x7f45a80c97c0 2023-10-06T11:14:59.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.526+0000 7f45a77fe700 1 -- 172.21.15.146:0/2888091841 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459c00b7a0 con 0x7f45a80c97c0 2023-10-06T11:14:59.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.526+0000 7f45a77fe700 1 -- 172.21.15.146:0/2888091841 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459c00bb40 con 0x7f45a80c97c0 2023-10-06T11:14:59.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.526+0000 7f45aef34700 1 -- 172.21.15.146:0/2888091841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f45a80c97c0 msgr2=0x7f45a815aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:59.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.526+0000 7f45aef34700 1 --2- 172.21.15.146:0/2888091841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f45a80c97c0 0x7f45a815aae0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f459c0098e0 tx=0x7f459c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.526+0000 7f45aef34700 1 -- 172.21.15.146:0/2888091841 shutdown_connections 2023-10-06T11:14:59.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.526+0000 7f45aef34700 1 --2- 172.21.15.146:0/2888091841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f45a80c97c0 0x7f45a815aae0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.526+0000 7f45aef34700 1 --2- 172.21.15.146:0/2888091841 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f45a80ca330 0x7f45a806e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.526+0000 7f45aef34700 1 -- 172.21.15.146:0/2888091841 >> 172.21.15.146:0/2888091841 conn(0x7f45a806b060 msgr2=0x7f45a80aecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:59.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.526+0000 7f45aef34700 1 -- 172.21.15.146:0/2888091841 shutdown_connections 2023-10-06T11:14:59.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.526+0000 7f45aef34700 1 -- 172.21.15.146:0/2888091841 wait complete. 2023-10-06T11:14:59.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.528+0000 7f45aef34700 1 Processor -- start 2023-10-06T11:14:59.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.528+0000 7f45aef34700 1 -- start start 2023-10-06T11:14:59.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.529+0000 7f45aef34700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45a80c97c0 0x7f45a814f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:59.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.529+0000 7f45aef34700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f45a80ca330 0x7f45a8156e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:59.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.529+0000 7f45aef34700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f45a81590e0 0x7f45a814bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:59.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.529+0000 7f45aef34700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a8159ac0 con 0x7f45a80c97c0 2023-10-06T11:14:59.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.529+0000 7f45aef34700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a814f450 con 0x7f45a80ca330 2023-10-06T11:14:59.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.529+0000 7f45aef34700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a814e880 con 0x7f45a81590e0 2023-10-06T11:14:59.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.529+0000 7f45accd0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45a80c97c0 0x7f45a814f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:59.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.529+0000 7f45accd0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45a80c97c0 0x7f45a814f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41466/0 (socket says 172.21.15.146:41466) 2023-10-06T11:14:59.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.529+0000 7f45accd0700 1 -- 172.21.15.146:0/1532383871 learned_addr learned my addr 172.21.15.146:0/1532383871 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:59.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.529+0000 7f45a7fff700 1 --2- 172.21.15.146:0/1532383871 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f45a80ca330 0x7f45a8156e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:59.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.529+0000 7f45ad4d1700 1 --2- 172.21.15.146:0/1532383871 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f45a81590e0 0x7f45a814bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:59.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.529+0000 7f45accd0700 1 -- 172.21.15.146:0/1532383871 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f45a81590e0 msgr2=0x7f45a814bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:59.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.529+0000 7f45accd0700 1 --2- 172.21.15.146:0/1532383871 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f45a81590e0 0x7f45a814bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.529+0000 7f45accd0700 1 -- 172.21.15.146:0/1532383871 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f45a80ca330 msgr2=0x7f45a8156e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:59.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.529+0000 7f45accd0700 1 --2- 172.21.15.146:0/1532383871 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f45a80ca330 0x7f45a8156e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.529+0000 7f45accd0700 1 -- 172.21.15.146:0/1532383871 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f459c009420 con 0x7f45a80c97c0 2023-10-06T11:14:59.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.529+0000 7f45accd0700 1 --2- 172.21.15.146:0/1532383871 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45a80c97c0 0x7f45a814f8e0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f45a806e100 tx=0x7f459c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:59.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.529+0000 7f45a4ff9700 1 -- 172.21.15.146:0/1532383871 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459c01bc40 con 0x7f45a80c97c0 2023-10-06T11:14:59.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.529+0000 7f45a4ff9700 1 -- 172.21.15.146:0/1532383871 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459c01bde0 con 0x7f45a80c97c0 2023-10-06T11:14:59.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.529+0000 7f45aef34700 1 -- 172.21.15.146:0/1532383871 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45a814eb20 con 0x7f45a80c97c0 2023-10-06T11:14:59.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.530+0000 7f45a4ff9700 1 -- 172.21.15.146:0/1532383871 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459c011670 con 0x7f45a80c97c0 2023-10-06T11:14:59.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.530+0000 7f45aef34700 1 -- 172.21.15.146:0/1532383871 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a814f160 con 0x7f45a80c97c0 2023-10-06T11:14:59.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.531+0000 7f45aef34700 1 -- 172.21.15.146:0/1532383871 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a804c380 con 0x7f45a80c97c0 2023-10-06T11:14:59.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.531+0000 7f45a4ff9700 1 -- 172.21.15.146:0/1532383871 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f459c0119e0 con 0x7f45a80c97c0 2023-10-06T11:14:59.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.531+0000 7f45a4ff9700 1 --2- 172.21.15.146:0/1532383871 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f458c066f30 0x7f458c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:59.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.532+0000 7f45a7fff700 1 --2- 172.21.15.146:0/1532383871 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f458c066f30 0x7f458c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:59.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.532+0000 7f45a4ff9700 1 -- 172.21.15.146:0/1532383871 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f459c085d50 con 0x7f45a80c97c0 2023-10-06T11:14:59.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.532+0000 7f45a7fff700 1 --2- 172.21.15.146:0/1532383871 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f458c066f30 0x7f458c0693e0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f45a8162250 tx=0x7f4594009220 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:59.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.536+0000 7f45a4ff9700 1 -- 172.21.15.146:0/1532383871 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f459c089030 con 0x7f45a80c97c0 2023-10-06T11:14:59.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.764+0000 7f45aef34700 1 -- 172.21.15.146:0/1532383871 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f45a80b1f40 con 0x7f45a80c97c0 2023-10-06T11:14:59.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.764+0000 7f45a4ff9700 1 -- 172.21.15.146:0/1532383871 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 100 v100) v1 ==== 95+0+4610 (secure 0 0 0) 0x7f459c052e60 con 0x7f45a80c97c0 2023-10-06T11:14:59.766 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:14:59.766 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":100,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6560,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/2109567995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2109567995},{"type":"v1","addr":"172.21.15.151:6834","nonce":2109567995}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":6563,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1783565134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":1783565134},{"type":"v1","addr":"172.21.15.151:6835","nonce":1783565134}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7327,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/1323749517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1323749517},{"type":"v1","addr":"172.21.15.146:6836","nonce":1323749517}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":100,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:14:18.891938+0000","modified":"2023-10-06T11:14:22.531674+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8103":{"gid":8103,"name":"c","rank":0,"incarnation":97,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/409226151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":409226151},{"type":"v1","addr":"172.21.15.146:6837","nonce":409226151}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-06T11:14:59.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.766+0000 7f45aef34700 1 -- 172.21.15.146:0/1532383871 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f458c066f30 msgr2=0x7f458c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:59.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.766+0000 7f45aef34700 1 --2- 172.21.15.146:0/1532383871 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f458c066f30 0x7f458c0693e0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f45a8162250 tx=0x7f4594009220 comp rx=0 tx=0).stop 2023-10-06T11:14:59.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.766+0000 7f45aef34700 1 -- 172.21.15.146:0/1532383871 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45a80c97c0 msgr2=0x7f45a814f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:59.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.766+0000 7f45aef34700 1 --2- 172.21.15.146:0/1532383871 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45a80c97c0 0x7f45a814f8e0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f45a806e100 tx=0x7f459c017000 comp rx=0 tx=0).stop 2023-10-06T11:14:59.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.767+0000 7f45aef34700 1 -- 172.21.15.146:0/1532383871 shutdown_connections 2023-10-06T11:14:59.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.767+0000 7f45aef34700 1 --2- 172.21.15.146:0/1532383871 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f458c066f30 0x7f458c0693e0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.767+0000 7f45aef34700 1 --2- 172.21.15.146:0/1532383871 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f45a81590e0 0x7f45a814bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.767+0000 7f45aef34700 1 --2- 172.21.15.146:0/1532383871 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f45a80c97c0 0x7f45a814f8e0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.767+0000 7f45aef34700 1 --2- 172.21.15.146:0/1532383871 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f45a80ca330 0x7f45a8156e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.767+0000 7f45aef34700 1 -- 172.21.15.146:0/1532383871 >> 172.21.15.146:0/1532383871 conn(0x7f45a806b060 msgr2=0x7f45a806c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:59.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.767+0000 7f45aef34700 1 -- 172.21.15.146:0/1532383871 shutdown_connections 2023-10-06T11:14:59.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.767+0000 7f45aef34700 1 -- 172.21.15.146:0/1532383871 wait complete. 2023-10-06T11:14:59.770 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 100 2023-10-06T11:14:59.781 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:14:59.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.894+0000 7f46bc828700 1 Processor -- start 2023-10-06T11:14:59.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.894+0000 7f46bc828700 1 -- start start 2023-10-06T11:14:59.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.895+0000 7f46bc828700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f46b815a420 0x7f46b815cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:59.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.895+0000 7f46bc828700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f46b80b2530 0x7f46b815acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:59.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.895+0000 7f46bc828700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46b815c630 con 0x7f46b815a7f0 2023-10-06T11:14:59.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.895+0000 7f46bc828700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46b80ce040 con 0x7f46b80b2530 2023-10-06T11:14:59.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.895+0000 7f46bc828700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b815ba20 con 0x7f46b815a420 2023-10-06T11:14:59.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.895+0000 7f46b759e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f46b80b2530 0x7f46b815acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:59.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.895+0000 7f46b759e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f46b80b2530 0x7f46b815acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41480/0 (socket says 172.21.15.146:41480) 2023-10-06T11:14:59.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.895+0000 7f46b759e700 1 -- 172.21.15.146:0/3163935828 learned_addr learned my addr 172.21.15.146:0/3163935828 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:59.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.895+0000 7f46b6d9d700 1 --2- 172.21.15.146:0/3163935828 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f46b815a420 0x7f46b815cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:59.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.895+0000 7f46b759e700 1 -- 172.21.15.146:0/3163935828 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f46b815a420 msgr2=0x7f46b815cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:14:59.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.895+0000 7f46b759e700 1 --2- 172.21.15.146:0/3163935828 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f46b815a420 0x7f46b815cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.895+0000 7f46b759e700 1 -- 172.21.15.146:0/3163935828 >> v1:172.21.15.151:6789/0 conn(0x7f46b815a7f0 legacy=0x7f46b80b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:59.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.895+0000 7f46b759e700 1 -- 172.21.15.146:0/3163935828 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b815bd00 con 0x7f46b80b2530 2023-10-06T11:14:59.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.895+0000 7f46b759e700 1 --2- 172.21.15.146:0/3163935828 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46b80b2530 0x7f46b815acd0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f46b0009f20 tx=0x7f46b0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5e47ac95ee31074 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:59.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.896+0000 7f46b659c700 1 -- 172.21.15.146:0/3163935828 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b000e070 con 0x7f46b80b2530 2023-10-06T11:14:59.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.896+0000 7f46b659c700 1 -- 172.21.15.146:0/3163935828 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b000b9d0 con 0x7f46b80b2530 2023-10-06T11:14:59.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.896+0000 7f46b659c700 1 -- 172.21.15.146:0/3163935828 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b00092e0 con 0x7f46b80b2530 2023-10-06T11:14:59.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.896+0000 7f46bc828700 1 -- 172.21.15.146:0/3163935828 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46b80b2530 msgr2=0x7f46b815acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:59.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.896+0000 7f46bc828700 1 --2- 172.21.15.146:0/3163935828 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46b80b2530 0x7f46b815acd0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f46b0009f20 tx=0x7f46b0009840 comp rx=0 tx=0).stop 2023-10-06T11:14:59.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.896+0000 7f46bc828700 1 -- 172.21.15.146:0/3163935828 shutdown_connections 2023-10-06T11:14:59.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.896+0000 7f46bc828700 1 --2- 172.21.15.146:0/3163935828 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46b80b2530 0x7f46b815acd0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.896+0000 7f46bc828700 1 --2- 172.21.15.146:0/3163935828 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f46b815a420 0x7f46b815cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.896+0000 7f46bc828700 1 -- 172.21.15.146:0/3163935828 >> 172.21.15.146:0/3163935828 conn(0x7f46b806eba0 msgr2=0x7f46b806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:14:59.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.896+0000 7f46bc828700 1 -- 172.21.15.146:0/3163935828 shutdown_connections 2023-10-06T11:14:59.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.896+0000 7f46bc828700 1 -- 172.21.15.146:0/3163935828 wait complete. 2023-10-06T11:14:59.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.897+0000 7f46bc828700 1 Processor -- start 2023-10-06T11:14:59.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.897+0000 7f46bc828700 1 -- start start 2023-10-06T11:14:59.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.898+0000 7f46bc828700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46b80b2530 0x7f46b8146f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:59.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.898+0000 7f46bc828700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f46b815a420 0x7f46b8151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:59.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.898+0000 7f46bc828700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f46b815a7f0 0x7f46b814ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:59.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.898+0000 7f46bc828700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b814c590 con 0x7f46b80b2530 2023-10-06T11:14:59.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.898+0000 7f46bc828700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b814bc60 con 0x7f46b815a420 2023-10-06T11:14:59.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.898+0000 7f46bc828700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b814bf40 con 0x7f46b815a7f0 2023-10-06T11:14:59.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.898+0000 7f46b6d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46b80b2530 0x7f46b8146f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:59.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.898+0000 7f46b6d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46b80b2530 0x7f46b8146f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41492/0 (socket says 172.21.15.146:41492) 2023-10-06T11:14:59.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.898+0000 7f46b6d9d700 1 -- 172.21.15.146:0/2976990879 learned_addr learned my addr 172.21.15.146:0/2976990879 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:14:59.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.898+0000 7f46b759e700 1 --2- 172.21.15.146:0/2976990879 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f46b815a7f0 0x7f46b814ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:59.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.898+0000 7f46ae59c700 1 --2- 172.21.15.146:0/2976990879 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f46b815a420 0x7f46b8151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:59.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.899+0000 7f46b6d9d700 1 -- 172.21.15.146:0/2976990879 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f46b815a7f0 msgr2=0x7f46b814ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:59.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.899+0000 7f46b6d9d700 1 --2- 172.21.15.146:0/2976990879 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f46b815a7f0 0x7f46b814ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.899+0000 7f46b6d9d700 1 -- 172.21.15.146:0/2976990879 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f46b815a420 msgr2=0x7f46b8151af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:14:59.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.899+0000 7f46b6d9d700 1 --2- 172.21.15.146:0/2976990879 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f46b815a420 0x7f46b8151af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:14:59.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.899+0000 7f46b6d9d700 1 -- 172.21.15.146:0/2976990879 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b0009ae0 con 0x7f46b80b2530 2023-10-06T11:14:59.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.899+0000 7f46b759e700 1 --2- 172.21.15.146:0/2976990879 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f46b815a7f0 0x7f46b814ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:14:59.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.899+0000 7f46b6d9d700 1 --2- 172.21.15.146:0/2976990879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46b80b2530 0x7f46b8146f50 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f46a800ec80 tx=0x7f46a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:59.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.899+0000 7f46af7fe700 1 -- 172.21.15.146:0/2976990879 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a800c9d0 con 0x7f46b80b2530 2023-10-06T11:14:59.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.899+0000 7f46af7fe700 1 -- 172.21.15.146:0/2976990879 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a800cb30 con 0x7f46b80b2530 2023-10-06T11:14:59.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.899+0000 7f46bc828700 1 -- 172.21.15.146:0/2976990879 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46b814c220 con 0x7f46b80b2530 2023-10-06T11:14:59.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.899+0000 7f46af7fe700 1 -- 172.21.15.146:0/2976990879 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a8013470 con 0x7f46b80b2530 2023-10-06T11:14:59.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.899+0000 7f46bc828700 1 -- 172.21.15.146:0/2976990879 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46b814b910 con 0x7f46b80b2530 2023-10-06T11:14:59.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.900+0000 7f46bc828700 1 -- 172.21.15.146:0/2976990879 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46b80afae0 con 0x7f46b80b2530 2023-10-06T11:14:59.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.900+0000 7f46af7fe700 1 -- 172.21.15.146:0/2976990879 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f46a8013820 con 0x7f46b80b2530 2023-10-06T11:14:59.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.901+0000 7f46af7fe700 1 --2- 172.21.15.146:0/2976990879 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4698066fb0 0x7f4698069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:14:59.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.901+0000 7f46ae59c700 1 --2- 172.21.15.146:0/2976990879 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4698066fb0 0x7f4698069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:14:59.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.901+0000 7f46af7fe700 1 -- 172.21.15.146:0/2976990879 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f46a8084ac0 con 0x7f46b80b2530 2023-10-06T11:14:59.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.901+0000 7f46ae59c700 1 --2- 172.21.15.146:0/2976990879 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4698066fb0 0x7f4698069460 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f46b80b6160 tx=0x7f46a0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:14:59.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:14:59.905+0000 7f46af7fe700 1 -- 172.21.15.146:0/2976990879 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f46a8051b30 con 0x7f46b80b2530 2023-10-06T11:15:00.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.089+0000 7f46bc828700 1 -- 172.21.15.146:0/2976990879 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46b815bfe0 con 0x7f46b80b2530 2023-10-06T11:15:00.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.090+0000 7f46af7fe700 1 -- 172.21.15.146:0/2976990879 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+16928 (secure 0 0 0) 0x7f46a8055150 con 0x7f46b80b2530 2023-10-06T11:15:00.092 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:15:00.092 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":113,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:14:20.515985+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:14:16.553437+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-10-06T11:14:17.858670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:15:00.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.092+0000 7f46bc828700 1 -- 172.21.15.146:0/2976990879 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4698066fb0 msgr2=0x7f4698069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:00.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.092+0000 7f46bc828700 1 --2- 172.21.15.146:0/2976990879 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4698066fb0 0x7f4698069460 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f46b80b6160 tx=0x7f46a0009040 comp rx=0 tx=0).stop 2023-10-06T11:15:00.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.092+0000 7f46bc828700 1 -- 172.21.15.146:0/2976990879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46b80b2530 msgr2=0x7f46b8146f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:00.094 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.092+0000 7f46bc828700 1 --2- 172.21.15.146:0/2976990879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46b80b2530 0x7f46b8146f50 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f46a800ec80 tx=0x7f46a80091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:00.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.092+0000 7f46bc828700 1 -- 172.21.15.146:0/2976990879 shutdown_connections 2023-10-06T11:15:00.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.092+0000 7f46bc828700 1 --2- 172.21.15.146:0/2976990879 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4698066fb0 0x7f4698069460 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:00.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.092+0000 7f46bc828700 1 --2- 172.21.15.146:0/2976990879 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f46b815a7f0 0x7f46b814ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:00.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.092+0000 7f46bc828700 1 --2- 172.21.15.146:0/2976990879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46b80b2530 0x7f46b8146f50 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:00.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.092+0000 7f46bc828700 1 --2- 172.21.15.146:0/2976990879 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f46b815a420 0x7f46b8151af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:00.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.092+0000 7f46bc828700 1 -- 172.21.15.146:0/2976990879 >> 172.21.15.146:0/2976990879 conn(0x7f46b806eba0 msgr2=0x7f46b80d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:00.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.092+0000 7f46bc828700 1 -- 172.21.15.146:0/2976990879 shutdown_connections 2023-10-06T11:15:00.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.092+0000 7f46bc828700 1 -- 172.21.15.146:0/2976990879 wait complete. 2023-10-06T11:15:00.106 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T11:15:00.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.221+0000 7f346cf10700 1 Processor -- start 2023-10-06T11:15:00.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.221+0000 7f346cf10700 1 -- start start 2023-10-06T11:15:00.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.222+0000 7f346cf10700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f34680b2430 0x7f34680b5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:00.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.222+0000 7f346cf10700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34680b4ec0 con 0x7f34680b3cf0 2023-10-06T11:15:00.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.222+0000 7f346cf10700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34680b42b0 con 0x7f34680b2060 2023-10-06T11:15:00.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.222+0000 7f346cf10700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34680cd470 con 0x7f34680b2430 2023-10-06T11:15:00.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.222+0000 7f3467fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f34680b2430 0x7f34680b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:00.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.222+0000 7f3467fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f34680b2430 0x7f34680b5350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41496/0 (socket says 172.21.15.146:41496) 2023-10-06T11:15:00.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.222+0000 7f3467fff700 1 -- 172.21.15.146:0/2801287211 learned_addr learned my addr 172.21.15.146:0/2801287211 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:00.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.222+0000 7f3466ffd700 1 --1- 172.21.15.146:0/2801287211 >> v1:172.21.15.146:6789/0 conn(0x7f34680b3cf0 0x7f34680ce860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:41628/0 (socket says 172.21.15.146:41628) 2023-10-06T11:15:00.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.222+0000 7f3467fff700 1 -- 172.21.15.146:0/2801287211 >> v1:172.21.15.151:6789/0 conn(0x7f34680b2060 legacy=0x7f34680ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:00.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.222+0000 7f3467fff700 1 -- 172.21.15.146:0/2801287211 >> v1:172.21.15.146:6789/0 conn(0x7f34680b3cf0 legacy=0x7f34680ce860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:00.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.222+0000 7f3467fff700 1 -- 172.21.15.146:0/2801287211 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34680b4590 con 0x7f34680b2430 2023-10-06T11:15:00.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.223+0000 7f3467fff700 1 --2- 172.21.15.146:0/2801287211 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34680b2430 0x7f34680b5350 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f3460009f20 tx=0x7f3460009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58cea3ba6985251a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:00.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.223+0000 7f34667fc700 1 -- 172.21.15.146:0/2801287211 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346000e070 con 0x7f34680b2430 2023-10-06T11:15:00.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.223+0000 7f34667fc700 1 -- 172.21.15.146:0/2801287211 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f346000ba80 con 0x7f34680b2430 2023-10-06T11:15:00.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.223+0000 7f34667fc700 1 -- 172.21.15.146:0/2801287211 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34600092e0 con 0x7f34680b2430 2023-10-06T11:15:00.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.223+0000 7f346cf10700 1 -- 172.21.15.146:0/2801287211 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34680b2430 msgr2=0x7f34680b5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:00.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.223+0000 7f346cf10700 1 --2- 172.21.15.146:0/2801287211 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34680b2430 0x7f34680b5350 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f3460009f20 tx=0x7f3460009840 comp rx=0 tx=0).stop 2023-10-06T11:15:00.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.223+0000 7f346cf10700 1 -- 172.21.15.146:0/2801287211 shutdown_connections 2023-10-06T11:15:00.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.223+0000 7f346cf10700 1 --2- 172.21.15.146:0/2801287211 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34680b2430 0x7f34680b5350 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:00.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.223+0000 7f346cf10700 1 -- 172.21.15.146:0/2801287211 >> 172.21.15.146:0/2801287211 conn(0x7f346806eba0 msgr2=0x7f346806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:00.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.223+0000 7f346cf10700 1 -- 172.21.15.146:0/2801287211 shutdown_connections 2023-10-06T11:15:00.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.223+0000 7f346cf10700 1 -- 172.21.15.146:0/2801287211 wait complete. 2023-10-06T11:15:00.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.224+0000 7f346cf10700 1 Processor -- start 2023-10-06T11:15:00.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.225+0000 7f346cf10700 1 -- start start 2023-10-06T11:15:00.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.225+0000 7f346cf10700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34680b2060 0x7f3468158ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:00.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.225+0000 7f346cf10700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34680b2430 0x7f346815bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:00.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.225+0000 7f346cf10700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34680b3cf0 0x7f346814c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:00.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.225+0000 7f346cf10700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346815c050 con 0x7f34680b3cf0 2023-10-06T11:15:00.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.225+0000 7f346cf10700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346815a1a0 con 0x7f34680b2060 2023-10-06T11:15:00.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.225+0000 7f346cf10700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f346814c540 con 0x7f34680b2430 2023-10-06T11:15:00.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.225+0000 7f3467fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34680b3cf0 0x7f346814c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:00.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.225+0000 7f3467fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34680b3cf0 0x7f346814c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41498/0 (socket says 172.21.15.146:41498) 2023-10-06T11:15:00.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.225+0000 7f3467fff700 1 -- 172.21.15.146:0/728520467 learned_addr learned my addr 172.21.15.146:0/728520467 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:00.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.225+0000 7f34677fe700 1 --2- 172.21.15.146:0/728520467 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34680b2060 0x7f3468158ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:00.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.225+0000 7f3466ffd700 1 --2- 172.21.15.146:0/728520467 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34680b2430 0x7f346815bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:00.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.226+0000 7f3467fff700 1 -- 172.21.15.146:0/728520467 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34680b2430 msgr2=0x7f346815bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:00.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.226+0000 7f3467fff700 1 --2- 172.21.15.146:0/728520467 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34680b2430 0x7f346815bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:00.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.226+0000 7f3467fff700 1 -- 172.21.15.146:0/728520467 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34680b2060 msgr2=0x7f3468158ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:00.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.226+0000 7f3467fff700 1 --2- 172.21.15.146:0/728520467 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34680b2060 0x7f3468158ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:00.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.226+0000 7f3467fff700 1 -- 172.21.15.146:0/728520467 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3460009ae0 con 0x7f34680b3cf0 2023-10-06T11:15:00.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.226+0000 7f3466ffd700 1 --2- 172.21.15.146:0/728520467 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34680b2430 0x7f346815bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:00.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.226+0000 7f3467fff700 1 --2- 172.21.15.146:0/728520467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34680b3cf0 0x7f346814c000 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f3468088db0 tx=0x7f3460018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:00.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.226+0000 7f344f7fe700 1 -- 172.21.15.146:0/728520467 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3460008dd0 con 0x7f34680b3cf0 2023-10-06T11:15:00.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.226+0000 7f344f7fe700 1 -- 172.21.15.146:0/728520467 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3460026460 con 0x7f34680b3cf0 2023-10-06T11:15:00.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.226+0000 7f346cf10700 1 -- 172.21.15.146:0/728520467 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f346815a630 con 0x7f34680b3cf0 2023-10-06T11:15:00.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.226+0000 7f344f7fe700 1 -- 172.21.15.146:0/728520467 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3460026820 con 0x7f34680b3cf0 2023-10-06T11:15:00.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.226+0000 7f346cf10700 1 -- 172.21.15.146:0/728520467 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3468159870 con 0x7f34680b3cf0 2023-10-06T11:15:00.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.227+0000 7f346cf10700 1 -- 172.21.15.146:0/728520467 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f346804c380 con 0x7f34680b3cf0 2023-10-06T11:15:00.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.227+0000 7f344f7fe700 1 -- 172.21.15.146:0/728520467 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3460003040 con 0x7f34680b3cf0 2023-10-06T11:15:00.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.228+0000 7f344f7fe700 1 --2- 172.21.15.146:0/728520467 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3454066f30 0x7f34540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:00.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.228+0000 7f34677fe700 1 --2- 172.21.15.146:0/728520467 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3454066f30 0x7f34540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:00.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.228+0000 7f344f7fe700 1 -- 172.21.15.146:0/728520467 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3460086810 con 0x7f34680b3cf0 2023-10-06T11:15:00.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.228+0000 7f34677fe700 1 --2- 172.21.15.146:0/728520467 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3454066f30 0x7f34540693e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f3458003a80 tx=0x7f3458007ec0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:00.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.232+0000 7f344f7fe700 1 -- 172.21.15.146:0/728520467 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3460053920 con 0x7f34680b3cf0 2023-10-06T11:15:00.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.458+0000 7f346cf10700 1 -- 172.21.15.146:0/728520467 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f346815a2e0 con 0x7f34680b3cf0 2023-10-06T11:15:00.460 INFO:tasks.ceph.mon.a.smithi146.stderr:2023-10-06T11:15:00.459+0000 7f011baa1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T11:15:00.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.462+0000 7f344f7fe700 1 -- 172.21.15.146:0/728520467 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v101) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3460008f30 con 0x7f34680b3cf0 2023-10-06T11:15:00.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.471+0000 7f346cf10700 1 -- 172.21.15.146:0/728520467 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3454066f30 msgr2=0x7f34540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:00.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.471+0000 7f346cf10700 1 --2- 172.21.15.146:0/728520467 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3454066f30 0x7f34540693e0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f3458003a80 tx=0x7f3458007ec0 comp rx=0 tx=0).stop 2023-10-06T11:15:00.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.471+0000 7f346cf10700 1 -- 172.21.15.146:0/728520467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34680b3cf0 msgr2=0x7f346814c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:00.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.471+0000 7f346cf10700 1 --2- 172.21.15.146:0/728520467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34680b3cf0 0x7f346814c000 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f3468088db0 tx=0x7f3460018000 comp rx=0 tx=0).stop 2023-10-06T11:15:00.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.471+0000 7f346cf10700 1 -- 172.21.15.146:0/728520467 shutdown_connections 2023-10-06T11:15:00.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.471+0000 7f346cf10700 1 --2- 172.21.15.146:0/728520467 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3454066f30 0x7f34540693e0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:00.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.471+0000 7f346cf10700 1 --2- 172.21.15.146:0/728520467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34680b3cf0 0x7f346814c000 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:00.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.471+0000 7f346cf10700 1 --2- 172.21.15.146:0/728520467 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34680b2060 0x7f3468158ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:00.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.471+0000 7f346cf10700 1 --2- 172.21.15.146:0/728520467 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34680b2430 0x7f346815bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:00.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.471+0000 7f346cf10700 1 -- 172.21.15.146:0/728520467 >> 172.21.15.146:0/728520467 conn(0x7f346806eba0 msgr2=0x7f34680d0570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:00.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.471+0000 7f346cf10700 1 -- 172.21.15.146:0/728520467 shutdown_connections 2023-10-06T11:15:00.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.471+0000 7f346cf10700 1 -- 172.21.15.146:0/728520467 wait complete. 2023-10-06T11:15:00.475 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T11:15:00.486 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T11:15:00.499 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2023-10-06T11:15:00.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.603+0000 7f827ad05700 1 Processor -- start 2023-10-06T11:15:00.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.603+0000 7f827ad05700 1 -- start start 2023-10-06T11:15:00.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.604+0000 7f827ad05700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f82740b5640 0x7f827415a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:00.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.604+0000 7f827ad05700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8274068780 0x7f8274068c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:00.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.604+0000 7f827ad05700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82740cc130 con 0x7f82740cb090 2023-10-06T11:15:00.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.604+0000 7f827ad05700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8274069140 con 0x7f82740b5640 2023-10-06T11:15:00.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.604+0000 7f827ad05700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82740cccd0 con 0x7f8274068780 2023-10-06T11:15:00.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.604+0000 7f827a504700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8274068780 0x7f8274068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:00.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.604+0000 7f8279d03700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f82740b5640 0x7f827415a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:00.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.604+0000 7f827a504700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8274068780 0x7f8274068c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:58626/0 (socket says 172.21.15.146:58626) 2023-10-06T11:15:00.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.604+0000 7f8279502700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f82740cb090 0x7f82740cc5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:33654/0 (socket says 172.21.15.146:33654) 2023-10-06T11:15:00.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.604+0000 7f827a504700 1 -- 172.21.15.146:0/1303440095 learned_addr learned my addr 172.21.15.146:0/1303440095 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:00.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.605+0000 7f8279d03700 1 -- 172.21.15.146:0/1303440095 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8274068780 msgr2=0x7f8274068c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:00.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.605+0000 7f8279d03700 1 --2- 172.21.15.146:0/1303440095 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8274068780 0x7f8274068c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:00.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.605+0000 7f8279d03700 1 -- 172.21.15.146:0/1303440095 >> v1:172.21.15.151:6789/0 conn(0x7f82740cb090 legacy=0x7f82740cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:00.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.605+0000 7f8279d03700 1 -- 172.21.15.146:0/1303440095 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82740b2660 con 0x7f82740b5640 2023-10-06T11:15:00.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.605+0000 7f827a504700 1 --2- 172.21.15.146:0/1303440095 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8274068780 0x7f8274068c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:15:00.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.605+0000 7f8279d03700 1 --2- 172.21.15.146:0/1303440095 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82740b5640 0x7f827415a870 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f82700098e0 tx=0x7f82700091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cebcf86775c028f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:00.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.605+0000 7f8278d01700 1 -- 172.21.15.146:0/1303440095 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827000b640 con 0x7f82740b5640 2023-10-06T11:15:00.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.605+0000 7f8278d01700 1 -- 172.21.15.146:0/1303440095 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827000b7a0 con 0x7f82740b5640 2023-10-06T11:15:00.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.605+0000 7f8278d01700 1 -- 172.21.15.146:0/1303440095 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827000bb40 con 0x7f82740b5640 2023-10-06T11:15:00.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.605+0000 7f827ad05700 1 -- 172.21.15.146:0/1303440095 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82740b5640 msgr2=0x7f827415a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:00.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.606+0000 7f827ad05700 1 --2- 172.21.15.146:0/1303440095 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82740b5640 0x7f827415a870 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f82700098e0 tx=0x7f82700091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:00.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.606+0000 7f827ad05700 1 -- 172.21.15.146:0/1303440095 shutdown_connections 2023-10-06T11:15:00.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.606+0000 7f827ad05700 1 --2- 172.21.15.146:0/1303440095 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8274068780 0x7f8274068c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:00.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.606+0000 7f827ad05700 1 --2- 172.21.15.146:0/1303440095 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82740b5640 0x7f827415a870 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:00.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.606+0000 7f827ad05700 1 -- 172.21.15.146:0/1303440095 >> 172.21.15.146:0/1303440095 conn(0x7f82740703f0 msgr2=0x7f82740707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:00.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.606+0000 7f827ad05700 1 -- 172.21.15.146:0/1303440095 shutdown_connections 2023-10-06T11:15:00.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.606+0000 7f827ad05700 1 -- 172.21.15.146:0/1303440095 wait complete. 2023-10-06T11:15:00.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.607+0000 7f827ad05700 1 Processor -- start 2023-10-06T11:15:00.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.607+0000 7f827ad05700 1 -- start start 2023-10-06T11:15:00.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.607+0000 7f827ad05700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8274068780 0x7f827415da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:00.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.607+0000 7f827ad05700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82740b5640 0x7f8274169aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:00.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.607+0000 7f827ad05700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82740cb090 0x7f827416acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:00.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.607+0000 7f827ad05700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82740c97f0 con 0x7f8274068780 2023-10-06T11:15:00.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.607+0000 7f827ad05700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f827415dfa0 con 0x7f82740b5640 2023-10-06T11:15:00.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.607+0000 7f827ad05700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f827416a3a0 con 0x7f82740cb090 2023-10-06T11:15:00.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.608+0000 7f8279d03700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8274068780 0x7f827415da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:00.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.608+0000 7f8279d03700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8274068780 0x7f827415da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41532/0 (socket says 172.21.15.146:41532) 2023-10-06T11:15:00.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.608+0000 7f8279d03700 1 -- 172.21.15.146:0/3554434330 learned_addr learned my addr 172.21.15.146:0/3554434330 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:00.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.608+0000 7f8279502700 1 --2- 172.21.15.146:0/3554434330 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82740b5640 0x7f8274169aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:00.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.608+0000 7f827a504700 1 --2- 172.21.15.146:0/3554434330 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82740cb090 0x7f827416acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:00.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.608+0000 7f8279d03700 1 -- 172.21.15.146:0/3554434330 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82740cb090 msgr2=0x7f827416acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:00.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.608+0000 7f8279d03700 1 --2- 172.21.15.146:0/3554434330 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82740cb090 0x7f827416acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:00.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.608+0000 7f8279d03700 1 -- 172.21.15.146:0/3554434330 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82740b5640 msgr2=0x7f8274169aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:00.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.608+0000 7f8279d03700 1 --2- 172.21.15.146:0/3554434330 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82740b5640 0x7f8274169aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:00.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.608+0000 7f8279d03700 1 -- 172.21.15.146:0/3554434330 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f826c009ae0 con 0x7f8274068780 2023-10-06T11:15:00.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.608+0000 7f8279d03700 1 --2- 172.21.15.146:0/3554434330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8274068780 0x7f827415da60 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f8270009f80 tx=0x7f8270017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:00.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.608+0000 7f8269ffb700 1 -- 172.21.15.146:0/3554434330 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827001bc30 con 0x7f8274068780 2023-10-06T11:15:00.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.608+0000 7f8269ffb700 1 -- 172.21.15.146:0/3554434330 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827001bdb0 con 0x7f8274068780 2023-10-06T11:15:00.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.608+0000 7f827ad05700 1 -- 172.21.15.146:0/3554434330 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8270009420 con 0x7f8274068780 2023-10-06T11:15:00.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.608+0000 7f8269ffb700 1 -- 172.21.15.146:0/3554434330 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8270011670 con 0x7f8274068780 2023-10-06T11:15:00.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.608+0000 7f827ad05700 1 -- 172.21.15.146:0/3554434330 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f827416a960 con 0x7f8274068780 2023-10-06T11:15:00.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.609+0000 7f827ad05700 1 -- 172.21.15.146:0/3554434330 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82740894b0 con 0x7f8274068780 2023-10-06T11:15:00.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.610+0000 7f8269ffb700 1 -- 172.21.15.146:0/3554434330 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8270011a20 con 0x7f8274068780 2023-10-06T11:15:00.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.610+0000 7f8269ffb700 1 --2- 172.21.15.146:0/3554434330 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8258066f30 0x7f82580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:00.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.610+0000 7f8279502700 1 --2- 172.21.15.146:0/3554434330 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8258066f30 0x7f82580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:00.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.610+0000 7f8269ffb700 1 -- 172.21.15.146:0/3554434330 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f8270085c40 con 0x7f8274068780 2023-10-06T11:15:00.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.611+0000 7f8279502700 1 --2- 172.21.15.146:0/3554434330 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8258066f30 0x7f82580693e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f82740cd500 tx=0x7f8264007eb0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:00.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.614+0000 7f8269ffb700 1 -- 172.21.15.146:0/3554434330 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8270052d00 con 0x7f8274068780 2023-10-06T11:15:00.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:00.843+0000 7f827ad05700 1 -- 172.21.15.146:0/3554434330 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f827404bb40 con 0x7f8274068780 2023-10-06T11:15:01.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.464+0000 7f8269ffb700 1 -- 172.21.15.146:0/3554434330 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v102) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8270056320 con 0x7f8274068780 2023-10-06T11:15:01.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.467+0000 7f827ad05700 1 -- 172.21.15.146:0/3554434330 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8258066f30 msgr2=0x7f82580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:01.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.467+0000 7f827ad05700 1 --2- 172.21.15.146:0/3554434330 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8258066f30 0x7f82580693e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f82740cd500 tx=0x7f8264007eb0 comp rx=0 tx=0).stop 2023-10-06T11:15:01.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.467+0000 7f827ad05700 1 -- 172.21.15.146:0/3554434330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8274068780 msgr2=0x7f827415da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:01.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.467+0000 7f827ad05700 1 --2- 172.21.15.146:0/3554434330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8274068780 0x7f827415da60 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f8270009f80 tx=0x7f8270017000 comp rx=0 tx=0).stop 2023-10-06T11:15:01.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.468+0000 7f827ad05700 1 -- 172.21.15.146:0/3554434330 shutdown_connections 2023-10-06T11:15:01.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.468+0000 7f827ad05700 1 --2- 172.21.15.146:0/3554434330 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8258066f30 0x7f82580693e0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:01.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.468+0000 7f827ad05700 1 --2- 172.21.15.146:0/3554434330 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82740cb090 0x7f827416acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:01.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.468+0000 7f827ad05700 1 --2- 172.21.15.146:0/3554434330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8274068780 0x7f827415da60 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:01.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.468+0000 7f827ad05700 1 --2- 172.21.15.146:0/3554434330 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82740b5640 0x7f8274169aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:01.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.468+0000 7f827ad05700 1 -- 172.21.15.146:0/3554434330 >> 172.21.15.146:0/3554434330 conn(0x7f82740703f0 msgr2=0x7f8274153ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:01.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.468+0000 7f827ad05700 1 -- 172.21.15.146:0/3554434330 shutdown_connections 2023-10-06T11:15:01.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.468+0000 7f827ad05700 1 -- 172.21.15.146:0/3554434330 wait complete. 2023-10-06T11:15:01.485 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T11:15:01.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.648+0000 7fb0e58a4700 1 Processor -- start 2023-10-06T11:15:01.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.649+0000 7fb0e58a4700 1 -- start start 2023-10-06T11:15:01.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.649+0000 7fb0e58a4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb0e015a160 0x7fb0e00c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:01.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.649+0000 7fb0e58a4700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb0e00ae730 0x7fb0e00aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:01.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.649+0000 7fb0e58a4700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0e00ae2a0 con 0x7fb0e00ce3d0 2023-10-06T11:15:01.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.649+0000 7fb0e58a4700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0e015a530 con 0x7fb0e015a160 2023-10-06T11:15:01.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.649+0000 7fb0e58a4700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0e00af0f0 con 0x7fb0e00ae730 2023-10-06T11:15:01.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.650+0000 7fb0deffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb0e015a160 0x7fb0e00c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:01.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.650+0000 7fb0df7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb0e00ce3d0 0x7fb0e00ce7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39966/0 (socket says 172.21.15.146:39966) 2023-10-06T11:15:01.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.650+0000 7fb0df7fe700 1 -- 172.21.15.146:0/518959827 learned_addr learned my addr 172.21.15.146:0/518959827 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:15:01.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.650+0000 7fb0de7fc700 1 --2- 172.21.15.146:0/518959827 >> v2:172.21.15.151:3300/0 conn(0x7fb0e00ae730 0x7fb0e00aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:01.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.650+0000 7fb0deffd700 1 -- 172.21.15.146:0/518959827 >> v2:172.21.15.151:3300/0 conn(0x7fb0e00ae730 msgr2=0x7fb0e00aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:01.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.650+0000 7fb0deffd700 1 --2- 172.21.15.146:0/518959827 >> v2:172.21.15.151:3300/0 conn(0x7fb0e00ae730 0x7fb0e00aebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:01.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.650+0000 7fb0deffd700 1 -- 172.21.15.146:0/518959827 >> v1:172.21.15.146:6789/0 conn(0x7fb0e00ce3d0 legacy=0x7fb0e00ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:01.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.650+0000 7fb0deffd700 1 -- 172.21.15.146:0/518959827 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e00ad690 con 0x7fb0e015a160 2023-10-06T11:15:01.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.650+0000 7fb0de7fc700 1 --2- 172.21.15.146:0/518959827 >> v2:172.21.15.151:3300/0 conn(0x7fb0e00ae730 0x7fb0e00aebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:01.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.650+0000 7fb0ddffb700 1 -- 172.21.15.146:0/518959827 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1643575477 0 0) 0x7fb0e00ae2a0 con 0x7fb0e00ce3d0 2023-10-06T11:15:01.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.650+0000 7fb0deffd700 1 --2- 172.21.15.146:0/518959827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0e015a160 0x7fb0e00c55a0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fb0e00d16e0 tx=0x7fb0d0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=722d7293c2c69825 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:01.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.650+0000 7fb0ddffb700 1 -- 172.21.15.146:0/518959827 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d000e070 con 0x7fb0e015a160 2023-10-06T11:15:01.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.650+0000 7fb0ddffb700 1 -- 172.21.15.146:0/518959827 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d000bc30 con 0x7fb0e015a160 2023-10-06T11:15:01.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.650+0000 7fb0ddffb700 1 -- 172.21.15.146:0/518959827 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d0012430 con 0x7fb0e015a160 2023-10-06T11:15:01.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.651+0000 7fb0e58a4700 1 -- 172.21.15.146:0/518959827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0e015a160 msgr2=0x7fb0e00c55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:01.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.651+0000 7fb0e58a4700 1 --2- 172.21.15.146:0/518959827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0e015a160 0x7fb0e00c55a0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fb0e00d16e0 tx=0x7fb0d0009780 comp rx=0 tx=0).stop 2023-10-06T11:15:01.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.651+0000 7fb0e58a4700 1 -- 172.21.15.146:0/518959827 shutdown_connections 2023-10-06T11:15:01.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.651+0000 7fb0e58a4700 1 --2- 172.21.15.146:0/518959827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0e015a160 0x7fb0e00c55a0 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:01.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.651+0000 7fb0e58a4700 1 --2- 172.21.15.146:0/518959827 >> v2:172.21.15.151:3300/0 conn(0x7fb0e00ae730 0x7fb0e00aebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:01.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.651+0000 7fb0e58a4700 1 -- 172.21.15.146:0/518959827 >> 172.21.15.146:0/518959827 conn(0x7fb0e006f380 msgr2=0x7fb0e00d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:01.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.651+0000 7fb0e58a4700 1 -- 172.21.15.146:0/518959827 shutdown_connections 2023-10-06T11:15:01.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.651+0000 7fb0e58a4700 1 -- 172.21.15.146:0/518959827 wait complete. 2023-10-06T11:15:01.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.652+0000 7fb0e58a4700 1 Processor -- start 2023-10-06T11:15:01.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.652+0000 7fb0e58a4700 1 -- start start 2023-10-06T11:15:01.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.653+0000 7fb0e58a4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0e00ae730 0x7fb0e01579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:01.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.653+0000 7fb0e58a4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0e00ce3d0 0x7fb0e015b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:01.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.653+0000 7fb0e58a4700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0e015a160 0x7fb0e015bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:01.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.653+0000 7fb0e58a4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e00b4720 con 0x7fb0e00ae730 2023-10-06T11:15:01.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.653+0000 7fb0e58a4700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e00b3b10 con 0x7fb0e00ce3d0 2023-10-06T11:15:01.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.653+0000 7fb0e58a4700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e00b3df0 con 0x7fb0e015a160 2023-10-06T11:15:01.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.653+0000 7fb0deffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0e00ae730 0x7fb0e01579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:01.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.653+0000 7fb0deffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0e00ae730 0x7fb0e01579d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58536/0 (socket says 172.21.15.146:58536) 2023-10-06T11:15:01.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.653+0000 7fb0deffd700 1 -- 172.21.15.146:0/3764499701 learned_addr learned my addr 172.21.15.146:0/3764499701 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:01.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.653+0000 7fb0de7fc700 1 --2- 172.21.15.146:0/3764499701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0e00ce3d0 0x7fb0e015b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:01.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.653+0000 7fb0df7fe700 1 --2- 172.21.15.146:0/3764499701 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0e015a160 0x7fb0e015bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:01.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.653+0000 7fb0deffd700 1 -- 172.21.15.146:0/3764499701 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0e015a160 msgr2=0x7fb0e015bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:01.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.653+0000 7fb0deffd700 1 --2- 172.21.15.146:0/3764499701 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0e015a160 0x7fb0e015bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:01.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.653+0000 7fb0deffd700 1 -- 172.21.15.146:0/3764499701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0e00ce3d0 msgr2=0x7fb0e015b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:01.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.653+0000 7fb0deffd700 1 --2- 172.21.15.146:0/3764499701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0e00ce3d0 0x7fb0e015b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:01.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.653+0000 7fb0deffd700 1 -- 172.21.15.146:0/3764499701 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d0009a20 con 0x7fb0e00ae730 2023-10-06T11:15:01.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.653+0000 7fb0df7fe700 1 --2- 172.21.15.146:0/3764499701 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0e015a160 0x7fb0e015bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:01.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.653+0000 7fb0deffd700 1 --2- 172.21.15.146:0/3764499701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0e00ae730 0x7fb0e01579d0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7fb0d0013000 tx=0x7fb0d0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:01.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.653+0000 7fb0c6ffd700 1 -- 172.21.15.146:0/3764499701 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d0012de0 con 0x7fb0e00ae730 2023-10-06T11:15:01.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.653+0000 7fb0c6ffd700 1 -- 172.21.15.146:0/3764499701 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d0027470 con 0x7fb0e00ae730 2023-10-06T11:15:01.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.653+0000 7fb0c6ffd700 1 -- 172.21.15.146:0/3764499701 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d0027830 con 0x7fb0e00ae730 2023-10-06T11:15:01.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.653+0000 7fb0e58a4700 1 -- 172.21.15.146:0/3764499701 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0e00b40d0 con 0x7fb0e00ae730 2023-10-06T11:15:01.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.653+0000 7fb0e58a4700 1 -- 172.21.15.146:0/3764499701 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0e015eeb0 con 0x7fb0e00ae730 2023-10-06T11:15:01.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.654+0000 7fb0e58a4700 1 -- 172.21.15.146:0/3764499701 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0e00c76a0 con 0x7fb0e00ae730 2023-10-06T11:15:01.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.655+0000 7fb0c6ffd700 1 -- 172.21.15.146:0/3764499701 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb0d0024070 con 0x7fb0e00ae730 2023-10-06T11:15:01.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.655+0000 7fb0c6ffd700 1 --2- 172.21.15.146:0/3764499701 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb0cc066f30 0x7fb0cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:01.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.655+0000 7fb0c6ffd700 1 -- 172.21.15.146:0/3764499701 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fb0d0086ca0 con 0x7fb0e00ae730 2023-10-06T11:15:01.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.655+0000 7fb0de7fc700 1 --2- 172.21.15.146:0/3764499701 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb0cc066f30 0x7fb0cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:01.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.656+0000 7fb0de7fc700 1 --2- 172.21.15.146:0/3764499701 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb0cc066f30 0x7fb0cc0693e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4006f00 tx=0x7fb0d4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:01.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.659+0000 7fb0c6ffd700 1 -- 172.21.15.146:0/3764499701 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb0d0053d60 con 0x7fb0e00ae730 2023-10-06T11:15:01.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:01.844+0000 7fb0e58a4700 1 -- 172.21.15.146:0/3764499701 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb0e0068390 con 0x7fb0e00ae730 2023-10-06T11:15:02.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.469+0000 7fb0c6ffd700 1 -- 172.21.15.146:0/3764499701 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v115) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb0d002c020 con 0x7fb0e00ae730 2023-10-06T11:15:02.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.472+0000 7fb0e58a4700 1 -- 172.21.15.146:0/3764499701 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb0cc066f30 msgr2=0x7fb0cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:02.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.472+0000 7fb0e58a4700 1 --2- 172.21.15.146:0/3764499701 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb0cc066f30 0x7fb0cc0693e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4006f00 tx=0x7fb0d4008040 comp rx=0 tx=0).stop 2023-10-06T11:15:02.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.472+0000 7fb0e58a4700 1 -- 172.21.15.146:0/3764499701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0e00ae730 msgr2=0x7fb0e01579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:02.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.472+0000 7fb0e58a4700 1 --2- 172.21.15.146:0/3764499701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0e00ae730 0x7fb0e01579d0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7fb0d0013000 tx=0x7fb0d0019000 comp rx=0 tx=0).stop 2023-10-06T11:15:02.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.472+0000 7fb0e58a4700 1 -- 172.21.15.146:0/3764499701 shutdown_connections 2023-10-06T11:15:02.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.472+0000 7fb0e58a4700 1 --2- 172.21.15.146:0/3764499701 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb0cc066f30 0x7fb0cc0693e0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:02.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.472+0000 7fb0e58a4700 1 --2- 172.21.15.146:0/3764499701 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0e015a160 0x7fb0e015bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:02.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.472+0000 7fb0e58a4700 1 --2- 172.21.15.146:0/3764499701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0e00ae730 0x7fb0e01579d0 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:02.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.472+0000 7fb0e58a4700 1 --2- 172.21.15.146:0/3764499701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0e00ce3d0 0x7fb0e015b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:02.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.472+0000 7fb0e58a4700 1 -- 172.21.15.146:0/3764499701 >> 172.21.15.146:0/3764499701 conn(0x7fb0e006f380 msgr2=0x7fb0e00c6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:02.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.472+0000 7fb0e58a4700 1 -- 172.21.15.146:0/3764499701 shutdown_connections 2023-10-06T11:15:02.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.472+0000 7fb0e58a4700 1 -- 172.21.15.146:0/3764499701 wait complete. 2023-10-06T11:15:02.475 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' removed 2023-10-06T11:15:02.488 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T11:15:02.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.608+0000 7fbcd5920700 1 Processor -- start 2023-10-06T11:15:02.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.608+0000 7fbcd5920700 1 -- start start 2023-10-06T11:15:02.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.609+0000 7fbcd5920700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbcd015a160 0x7fbcd00c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:02.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.609+0000 7fbcd5920700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbcd00ae730 0x7fbcd00aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:02.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.609+0000 7fbcd5920700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcd00ae2a0 con 0x7fbcd00ce3d0 2023-10-06T11:15:02.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.609+0000 7fbcd5920700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcd015a530 con 0x7fbcd015a160 2023-10-06T11:15:02.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.609+0000 7fbcd5920700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd00ad690 con 0x7fbcd00ae730 2023-10-06T11:15:02.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.609+0000 7fbcceffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbcd015a160 0x7fbcd00c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:02.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.609+0000 7fbccf7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fbcd00ce3d0 0x7fbcd00ce830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39974/0 (socket says 172.21.15.146:39974) 2023-10-06T11:15:02.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.609+0000 7fbccf7fe700 1 -- 172.21.15.146:0/3369676277 learned_addr learned my addr 172.21.15.146:0/3369676277 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:15:02.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.609+0000 7fbcc7fff700 1 --2- 172.21.15.146:0/3369676277 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbcd00ae730 0x7fbcd00aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:02.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.609+0000 7fbcceffd700 1 -- 172.21.15.146:0/3369676277 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbcd00ae730 msgr2=0x7fbcd00aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:02.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.609+0000 7fbcceffd700 1 --2- 172.21.15.146:0/3369676277 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbcd00ae730 0x7fbcd00aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:02.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.609+0000 7fbcceffd700 1 -- 172.21.15.146:0/3369676277 >> v1:172.21.15.146:6789/0 conn(0x7fbcd00ce3d0 legacy=0x7fbcd00ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:02.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.609+0000 7fbcceffd700 1 -- 172.21.15.146:0/3369676277 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd00ad970 con 0x7fbcd015a160 2023-10-06T11:15:02.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.609+0000 7fbcce7fc700 1 -- 172.21.15.146:0/3369676277 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 209860352 0 0) 0x7fbcd00ae2a0 con 0x7fbcd00ce3d0 2023-10-06T11:15:02.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.609+0000 7fbcceffd700 1 --2- 172.21.15.146:0/3369676277 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcd015a160 0x7fbcd00c55a0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fbcc00098d0 tx=0x7fbcc0009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0bf492979be24fc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:02.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.609+0000 7fbcce7fc700 1 -- 172.21.15.146:0/3369676277 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc0009e70 con 0x7fbcd015a160 2023-10-06T11:15:02.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.609+0000 7fbcce7fc700 1 -- 172.21.15.146:0/3369676277 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcc0005c10 con 0x7fbcd015a160 2023-10-06T11:15:02.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.609+0000 7fbcce7fc700 1 -- 172.21.15.146:0/3369676277 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcc000b650 con 0x7fbcd015a160 2023-10-06T11:15:02.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.610+0000 7fbcd5920700 1 -- 172.21.15.146:0/3369676277 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcd015a160 msgr2=0x7fbcd00c55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:02.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.610+0000 7fbcd5920700 1 --2- 172.21.15.146:0/3369676277 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcd015a160 0x7fbcd00c55a0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fbcc00098d0 tx=0x7fbcc0009120 comp rx=0 tx=0).stop 2023-10-06T11:15:02.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.610+0000 7fbcd5920700 1 -- 172.21.15.146:0/3369676277 shutdown_connections 2023-10-06T11:15:02.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.610+0000 7fbcd5920700 1 --2- 172.21.15.146:0/3369676277 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcd015a160 0x7fbcd00c55a0 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:02.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.610+0000 7fbcd5920700 1 --2- 172.21.15.146:0/3369676277 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbcd00ae730 0x7fbcd00aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:02.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.610+0000 7fbcd5920700 1 -- 172.21.15.146:0/3369676277 >> 172.21.15.146:0/3369676277 conn(0x7fbcd006f380 msgr2=0x7fbcd00d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:02.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.610+0000 7fbcd5920700 1 -- 172.21.15.146:0/3369676277 shutdown_connections 2023-10-06T11:15:02.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.610+0000 7fbcd5920700 1 -- 172.21.15.146:0/3369676277 wait complete. 2023-10-06T11:15:02.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.611+0000 7fbcd5920700 1 Processor -- start 2023-10-06T11:15:02.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.611+0000 7fbcd5920700 1 -- start start 2023-10-06T11:15:02.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.612+0000 7fbcd5920700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbcd00ae730 0x7fbcd01575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:02.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.612+0000 7fbcd5920700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcd00ce3d0 0x7fbcd00ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:02.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.612+0000 7fbcd5920700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbcd015a160 0x7fbcd0151480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:02.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.612+0000 7fbcd5920700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd0158e20 con 0x7fbcd00ce3d0 2023-10-06T11:15:02.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.612+0000 7fbcd5920700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd0157ae0 con 0x7fbcd00ae730 2023-10-06T11:15:02.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.612+0000 7fbcd5920700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd0157d80 con 0x7fbcd015a160 2023-10-06T11:15:02.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.612+0000 7fbcc7fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcd00ce3d0 0x7fbcd00ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:02.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.612+0000 7fbcc7fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcd00ce3d0 0x7fbcd00ccd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58554/0 (socket says 172.21.15.146:58554) 2023-10-06T11:15:02.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.612+0000 7fbcc7fff700 1 -- 172.21.15.146:0/4194301315 learned_addr learned my addr 172.21.15.146:0/4194301315 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:02.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.612+0000 7fbcceffd700 1 --2- 172.21.15.146:0/4194301315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbcd00ae730 0x7fbcd01575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:02.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.612+0000 7fbccf7fe700 1 --2- 172.21.15.146:0/4194301315 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbcd015a160 0x7fbcd0151480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:02.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.612+0000 7fbcc7fff700 1 -- 172.21.15.146:0/4194301315 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbcd015a160 msgr2=0x7fbcd0151480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:02.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.612+0000 7fbcc7fff700 1 --2- 172.21.15.146:0/4194301315 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbcd015a160 0x7fbcd0151480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:02.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.612+0000 7fbcc7fff700 1 -- 172.21.15.146:0/4194301315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbcd00ae730 msgr2=0x7fbcd01575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:02.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.612+0000 7fbcc7fff700 1 --2- 172.21.15.146:0/4194301315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbcd00ae730 0x7fbcd01575a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:02.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.612+0000 7fbcc7fff700 1 -- 172.21.15.146:0/4194301315 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc00093c0 con 0x7fbcd00ce3d0 2023-10-06T11:15:02.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.612+0000 7fbcceffd700 1 --2- 172.21.15.146:0/4194301315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbcd00ae730 0x7fbcd01575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:02.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.612+0000 7fbcc7fff700 1 --2- 172.21.15.146:0/4194301315 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcd00ce3d0 0x7fbcd00ccd80 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7fbcb800d860 tx=0x7fbcb8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:02.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.613+0000 7fbcc6ffd700 1 -- 172.21.15.146:0/4194301315 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb8009610 con 0x7fbcd00ce3d0 2023-10-06T11:15:02.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.613+0000 7fbcc6ffd700 1 -- 172.21.15.146:0/4194301315 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcb8009770 con 0x7fbcd00ce3d0 2023-10-06T11:15:02.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.613+0000 7fbcd5920700 1 -- 172.21.15.146:0/4194301315 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcd0158060 con 0x7fbcd00ce3d0 2023-10-06T11:15:02.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.613+0000 7fbcc6ffd700 1 -- 172.21.15.146:0/4194301315 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb8009b30 con 0x7fbcd00ce3d0 2023-10-06T11:15:02.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.613+0000 7fbcd5920700 1 -- 172.21.15.146:0/4194301315 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcd0158620 con 0x7fbcd00ce3d0 2023-10-06T11:15:02.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.614+0000 7fbcd5920700 1 -- 172.21.15.146:0/4194301315 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcd0068390 con 0x7fbcd00ce3d0 2023-10-06T11:15:02.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.614+0000 7fbcc6ffd700 1 -- 172.21.15.146:0/4194301315 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbcb801e460 con 0x7fbcd00ce3d0 2023-10-06T11:15:02.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.614+0000 7fbcc6ffd700 1 --2- 172.21.15.146:0/4194301315 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbcb0066f30 0x7fbcb00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:02.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.614+0000 7fbcceffd700 1 --2- 172.21.15.146:0/4194301315 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbcb0066f30 0x7fbcb00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:02.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.614+0000 7fbcc6ffd700 1 -- 172.21.15.146:0/4194301315 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fbcb8084ba0 con 0x7fbcd00ce3d0 2023-10-06T11:15:02.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.615+0000 7fbcceffd700 1 --2- 172.21.15.146:0/4194301315 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbcb0066f30 0x7fbcb00693e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0009160 tx=0x7fbcc0016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:02.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.619+0000 7fbcc6ffd700 1 -- 172.21.15.146:0/4194301315 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbcb8051e10 con 0x7fbcd00ce3d0 2023-10-06T11:15:02.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:02.803+0000 7fbcd5920700 1 -- 172.21.15.146:0/4194301315 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbcd004c380 con 0x7fbcd00ce3d0 2023-10-06T11:15:03.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.482+0000 7fbcc6ffd700 1 -- 172.21.15.146:0/4194301315 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v116) v1 ==== 169+0+0 (secure 0 0 0) 0x7fbcb8055430 con 0x7fbcd00ce3d0 2023-10-06T11:15:03.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.485+0000 7fbcd5920700 1 -- 172.21.15.146:0/4194301315 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbcb0066f30 msgr2=0x7fbcb00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:03.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.485+0000 7fbcd5920700 1 --2- 172.21.15.146:0/4194301315 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbcb0066f30 0x7fbcb00693e0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fbcc0009160 tx=0x7fbcc0016000 comp rx=0 tx=0).stop 2023-10-06T11:15:03.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.485+0000 7fbcd5920700 1 -- 172.21.15.146:0/4194301315 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcd00ce3d0 msgr2=0x7fbcd00ccd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:03.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.485+0000 7fbcd5920700 1 --2- 172.21.15.146:0/4194301315 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcd00ce3d0 0x7fbcd00ccd80 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7fbcb800d860 tx=0x7fbcb8008040 comp rx=0 tx=0).stop 2023-10-06T11:15:03.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.486+0000 7fbcd5920700 1 -- 172.21.15.146:0/4194301315 shutdown_connections 2023-10-06T11:15:03.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.486+0000 7fbcd5920700 1 --2- 172.21.15.146:0/4194301315 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbcb0066f30 0x7fbcb00693e0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:03.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.486+0000 7fbcd5920700 1 --2- 172.21.15.146:0/4194301315 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbcd015a160 0x7fbcd0151480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:03.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.486+0000 7fbcd5920700 1 --2- 172.21.15.146:0/4194301315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbcd00ae730 0x7fbcd01575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:03.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.486+0000 7fbcd5920700 1 --2- 172.21.15.146:0/4194301315 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbcd00ce3d0 0x7fbcd00ccd80 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:03.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.486+0000 7fbcd5920700 1 -- 172.21.15.146:0/4194301315 >> 172.21.15.146:0/4194301315 conn(0x7fbcd006f380 msgr2=0x7fbcd00cf6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:03.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.486+0000 7fbcd5920700 1 -- 172.21.15.146:0/4194301315 shutdown_connections 2023-10-06T11:15:03.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.486+0000 7fbcd5920700 1 -- 172.21.15.146:0/4194301315 wait complete. 2023-10-06T11:15:03.488 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' removed 2023-10-06T11:15:03.506 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T11:15:03.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.626+0000 7fc6bd9f0700 1 Processor -- start 2023-10-06T11:15:03.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.626+0000 7fc6bd9f0700 1 -- start start 2023-10-06T11:15:03.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.626+0000 7fc6bd9f0700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc6b815a160 0x7fc6b80c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:03.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.626+0000 7fc6bd9f0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc6b80cb950 0x7fc6b80cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:03.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.626+0000 7fc6bd9f0700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6b80ae2a0 con 0x7fc6b80ae730 2023-10-06T11:15:03.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.626+0000 7fc6bd9f0700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6b815a530 con 0x7fc6b80cb950 2023-10-06T11:15:03.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.626+0000 7fc6bd9f0700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6b80ad690 con 0x7fc6b815a160 2023-10-06T11:15:03.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.627+0000 7fc6b77fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc6b80cb950 0x7fc6b80cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:03.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.627+0000 7fc6b77fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc6b80cb950 0x7fc6b80cbd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58570/0 (socket says 172.21.15.146:58570) 2023-10-06T11:15:03.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.627+0000 7fc6b77fe700 1 -- 172.21.15.146:0/1310399444 learned_addr learned my addr 172.21.15.146:0/1310399444 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:03.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.627+0000 7fc6b6ffd700 1 --2- 172.21.15.146:0/1310399444 >> v2:172.21.15.151:3300/0 conn(0x7fc6b815a160 0x7fc6b80c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:03.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.627+0000 7fc6b77fe700 1 -- 172.21.15.146:0/1310399444 >> v2:172.21.15.151:3300/0 conn(0x7fc6b815a160 msgr2=0x7fc6b80c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:03.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.627+0000 7fc6b77fe700 1 --2- 172.21.15.146:0/1310399444 >> v2:172.21.15.151:3300/0 conn(0x7fc6b815a160 0x7fc6b80c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:03.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.627+0000 7fc6b77fe700 1 -- 172.21.15.146:0/1310399444 >> v1:172.21.15.151:6789/0 conn(0x7fc6b80ae730 legacy=0x7fc6b80aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:03.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.627+0000 7fc6b77fe700 1 -- 172.21.15.146:0/1310399444 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b80ad970 con 0x7fc6b80cb950 2023-10-06T11:15:03.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.627+0000 7fc6b77fe700 1 --2- 172.21.15.146:0/1310399444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6b80cb950 0x7fc6b80cbd70 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8065100 tx=0x7fc6b0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=696d96dd0de26745 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:03.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.627+0000 7fc6b67fc700 1 -- 172.21.15.146:0/1310399444 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b000e070 con 0x7fc6b80cb950 2023-10-06T11:15:03.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.627+0000 7fc6b67fc700 1 -- 172.21.15.146:0/1310399444 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b000ba50 con 0x7fc6b80cb950 2023-10-06T11:15:03.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.627+0000 7fc6b67fc700 1 -- 172.21.15.146:0/1310399444 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b00092e0 con 0x7fc6b80cb950 2023-10-06T11:15:03.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.628+0000 7fc6bd9f0700 1 -- 172.21.15.146:0/1310399444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6b80cb950 msgr2=0x7fc6b80cbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:03.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.628+0000 7fc6bd9f0700 1 --2- 172.21.15.146:0/1310399444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6b80cb950 0x7fc6b80cbd70 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8065100 tx=0x7fc6b0009840 comp rx=0 tx=0).stop 2023-10-06T11:15:03.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.628+0000 7fc6bd9f0700 1 -- 172.21.15.146:0/1310399444 shutdown_connections 2023-10-06T11:15:03.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.628+0000 7fc6bd9f0700 1 --2- 172.21.15.146:0/1310399444 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6b80cb950 0x7fc6b80cbd70 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:03.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.628+0000 7fc6bd9f0700 1 --2- 172.21.15.146:0/1310399444 >> v2:172.21.15.151:3300/0 conn(0x7fc6b815a160 0x7fc6b80c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:03.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.628+0000 7fc6bd9f0700 1 -- 172.21.15.146:0/1310399444 >> 172.21.15.146:0/1310399444 conn(0x7fc6b806f380 msgr2=0x7fc6b80d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:03.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.628+0000 7fc6bd9f0700 1 -- 172.21.15.146:0/1310399444 shutdown_connections 2023-10-06T11:15:03.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.628+0000 7fc6bd9f0700 1 -- 172.21.15.146:0/1310399444 wait complete. 2023-10-06T11:15:03.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.629+0000 7fc6bd9f0700 1 Processor -- start 2023-10-06T11:15:03.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.629+0000 7fc6bd9f0700 1 -- start start 2023-10-06T11:15:03.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.630+0000 7fc6bd9f0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6b80ae730 0x7fc6b80b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:03.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.630+0000 7fc6bd9f0700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6b80cb950 0x7fc6b80b3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:03.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.630+0000 7fc6bd9f0700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6b815a160 0x7fc6b80b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:03.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.630+0000 7fc6bd9f0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b80c7f90 con 0x7fc6b80ae730 2023-10-06T11:15:03.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.630+0000 7fc6bd9f0700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b80c79d0 con 0x7fc6b80cb950 2023-10-06T11:15:03.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.630+0000 7fc6bd9f0700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b8154e10 con 0x7fc6b815a160 2023-10-06T11:15:03.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.630+0000 7fc6b6ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6b80ae730 0x7fc6b80b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:03.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.630+0000 7fc6b6ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6b80ae730 0x7fc6b80b4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58578/0 (socket says 172.21.15.146:58578) 2023-10-06T11:15:03.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.630+0000 7fc6b6ffd700 1 -- 172.21.15.146:0/1141944141 learned_addr learned my addr 172.21.15.146:0/1141944141 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:03.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.630+0000 7fc6b77fe700 1 --2- 172.21.15.146:0/1141944141 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6b815a160 0x7fc6b80b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:03.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.630+0000 7fc6ae7fc700 1 --2- 172.21.15.146:0/1141944141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6b80cb950 0x7fc6b80b3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:03.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.630+0000 7fc6b6ffd700 1 -- 172.21.15.146:0/1141944141 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6b815a160 msgr2=0x7fc6b80b3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:03.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.630+0000 7fc6b6ffd700 1 --2- 172.21.15.146:0/1141944141 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6b815a160 0x7fc6b80b3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:03.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.630+0000 7fc6b6ffd700 1 -- 172.21.15.146:0/1141944141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6b80cb950 msgr2=0x7fc6b80b3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:03.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.630+0000 7fc6b6ffd700 1 --2- 172.21.15.146:0/1141944141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6b80cb950 0x7fc6b80b3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:03.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.630+0000 7fc6b6ffd700 1 -- 172.21.15.146:0/1141944141 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b0009ae0 con 0x7fc6b80ae730 2023-10-06T11:15:03.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.630+0000 7fc6ae7fc700 1 --2- 172.21.15.146:0/1141944141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6b80cb950 0x7fc6b80b3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:03.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.630+0000 7fc6b6ffd700 1 --2- 172.21.15.146:0/1141944141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6b80ae730 0x7fc6b80b4eb0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fc6a800d840 tx=0x7fc6a8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:03.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.630+0000 7fc6af7fe700 1 -- 172.21.15.146:0/1141944141 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a8014620 con 0x7fc6b80ae730 2023-10-06T11:15:03.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.630+0000 7fc6af7fe700 1 -- 172.21.15.146:0/1141944141 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a8014780 con 0x7fc6b80ae730 2023-10-06T11:15:03.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.630+0000 7fc6af7fe700 1 -- 172.21.15.146:0/1141944141 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a8014b40 con 0x7fc6b80ae730 2023-10-06T11:15:03.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.631+0000 7fc6bd9f0700 1 -- 172.21.15.146:0/1141944141 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6b81550f0 con 0x7fc6b80ae730 2023-10-06T11:15:03.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.631+0000 7fc6bd9f0700 1 -- 172.21.15.146:0/1141944141 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6b80b53f0 con 0x7fc6b80ae730 2023-10-06T11:15:03.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.631+0000 7fc6bd9f0700 1 -- 172.21.15.146:0/1141944141 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6b80c8270 con 0x7fc6b80ae730 2023-10-06T11:15:03.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.632+0000 7fc6af7fe700 1 -- 172.21.15.146:0/1141944141 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc6a801d400 con 0x7fc6b80ae730 2023-10-06T11:15:03.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.632+0000 7fc6af7fe700 1 --2- 172.21.15.146:0/1141944141 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc698066f30 0x7fc6980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:03.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.633+0000 7fc6af7fe700 1 -- 172.21.15.146:0/1141944141 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fc6a8084b60 con 0x7fc6b80ae730 2023-10-06T11:15:03.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.633+0000 7fc6ae7fc700 1 --2- 172.21.15.146:0/1141944141 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc698066f30 0x7fc6980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:03.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.633+0000 7fc6ae7fc700 1 --2- 172.21.15.146:0/1141944141 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc698066f30 0x7fc6980693e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0007fd0 tx=0x7fc6a0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:03.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.637+0000 7fc6af7fe700 1 -- 172.21.15.146:0/1141944141 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc6a8051f70 con 0x7fc6b80ae730 2023-10-06T11:15:03.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.850+0000 7fc6bd9f0700 1 -- 172.21.15.146:0/1141944141 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc6b8068390 con 0x7fc6b80ae730 2023-10-06T11:15:03.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.854+0000 7fc6af7fe700 1 -- 172.21.15.146:0/1141944141 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc6a8055590 con 0x7fc6b80ae730 2023-10-06T11:15:03.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.856+0000 7fc6bd9f0700 1 -- 172.21.15.146:0/1141944141 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc698066f30 msgr2=0x7fc6980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:03.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.856+0000 7fc6bd9f0700 1 --2- 172.21.15.146:0/1141944141 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc698066f30 0x7fc6980693e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0007fd0 tx=0x7fc6a0009040 comp rx=0 tx=0).stop 2023-10-06T11:15:03.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.856+0000 7fc6bd9f0700 1 -- 172.21.15.146:0/1141944141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6b80ae730 msgr2=0x7fc6b80b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:03.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.856+0000 7fc6bd9f0700 1 --2- 172.21.15.146:0/1141944141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6b80ae730 0x7fc6b80b4eb0 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fc6a800d840 tx=0x7fc6a8008040 comp rx=0 tx=0).stop 2023-10-06T11:15:03.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.856+0000 7fc6bd9f0700 1 -- 172.21.15.146:0/1141944141 shutdown_connections 2023-10-06T11:15:03.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.856+0000 7fc6bd9f0700 1 --2- 172.21.15.146:0/1141944141 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc698066f30 0x7fc6980693e0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:03.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.856+0000 7fc6bd9f0700 1 --2- 172.21.15.146:0/1141944141 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6b815a160 0x7fc6b80b3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:03.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.856+0000 7fc6bd9f0700 1 --2- 172.21.15.146:0/1141944141 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6b80ae730 0x7fc6b80b4eb0 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:03.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.856+0000 7fc6bd9f0700 1 --2- 172.21.15.146:0/1141944141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6b80cb950 0x7fc6b80b3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:03.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.856+0000 7fc6bd9f0700 1 -- 172.21.15.146:0/1141944141 >> 172.21.15.146:0/1141944141 conn(0x7fc6b806f380 msgr2=0x7fc6b80c6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:03.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.856+0000 7fc6bd9f0700 1 -- 172.21.15.146:0/1141944141 shutdown_connections 2023-10-06T11:15:03.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.856+0000 7fc6bd9f0700 1 -- 172.21.15.146:0/1141944141 wait complete. 2023-10-06T11:15:03.870 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort' 2023-10-06T11:15:03.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.984+0000 7f773cd0a700 1 Processor -- start 2023-10-06T11:15:03.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.985+0000 7f773cd0a700 1 -- start start 2023-10-06T11:15:03.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.985+0000 7f773cd0a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77381595d0 0x7f77380a98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:03.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.985+0000 7f773cd0a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f77381599a0 0x7f7738068480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:03.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.985+0000 7f773cd0a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77380a9e10 con 0x7f77380c70e0 2023-10-06T11:15:03.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.985+0000 7f773cd0a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77380c7650 con 0x7f77381599a0 2023-10-06T11:15:03.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.985+0000 7f773cd0a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77380c7930 con 0x7f77381595d0 2023-10-06T11:15:03.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.985+0000 7f7736d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f77381599a0 0x7f7738068480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:03.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.985+0000 7f772dd9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f77380c70e0 0x7f773806ec10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39988/0 (socket says 172.21.15.146:39988) 2023-10-06T11:15:03.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.985+0000 7f772dd9b700 1 -- 172.21.15.146:0/2383643333 learned_addr learned my addr 172.21.15.146:0/2383643333 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:15:03.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.986+0000 7f773659c700 1 --2- 172.21.15.146:0/2383643333 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77381595d0 0x7f77380a98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:03.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.986+0000 7f7736d9d700 1 -- 172.21.15.146:0/2383643333 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77381595d0 msgr2=0x7f77380a98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:03.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.986+0000 7f7736d9d700 1 --2- 172.21.15.146:0/2383643333 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77381595d0 0x7f77380a98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:03.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.986+0000 7f7736d9d700 1 -- 172.21.15.146:0/2383643333 >> v1:172.21.15.146:6789/0 conn(0x7f77380c70e0 legacy=0x7f773806ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:03.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.986+0000 7f7735d9b700 1 -- 172.21.15.146:0/2383643333 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3374264915 0 0) 0x7f77380a9e10 con 0x7f77380c70e0 2023-10-06T11:15:03.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.986+0000 7f7736d9d700 1 -- 172.21.15.146:0/2383643333 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77380c7c10 con 0x7f77381599a0 2023-10-06T11:15:03.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.986+0000 7f773659c700 1 --2- 172.21.15.146:0/2383643333 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77381595d0 0x7f77380a98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:03.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.986+0000 7f7736d9d700 1 --2- 172.21.15.146:0/2383643333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77381599a0 0x7f7738068480 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f7730009e60 tx=0x7f7730009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32da31f2daa280b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:03.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.986+0000 7f7735d9b700 1 -- 172.21.15.146:0/2383643333 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773000e070 con 0x7f77381599a0 2023-10-06T11:15:03.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.986+0000 7f7735d9b700 1 -- 172.21.15.146:0/2383643333 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f773000bc30 con 0x7f77381599a0 2023-10-06T11:15:03.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.986+0000 7f7735d9b700 1 -- 172.21.15.146:0/2383643333 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7730012430 con 0x7f77381599a0 2023-10-06T11:15:03.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.987+0000 7f773cd0a700 1 -- 172.21.15.146:0/2383643333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77381599a0 msgr2=0x7f7738068480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:03.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.987+0000 7f773cd0a700 1 --2- 172.21.15.146:0/2383643333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77381599a0 0x7f7738068480 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f7730009e60 tx=0x7f7730009780 comp rx=0 tx=0).stop 2023-10-06T11:15:03.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.987+0000 7f773cd0a700 1 -- 172.21.15.146:0/2383643333 shutdown_connections 2023-10-06T11:15:03.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.987+0000 7f773cd0a700 1 --2- 172.21.15.146:0/2383643333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77381599a0 0x7f7738068480 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:03.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.987+0000 7f773cd0a700 1 --2- 172.21.15.146:0/2383643333 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77381595d0 0x7f77380a98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:03.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.987+0000 7f773cd0a700 1 -- 172.21.15.146:0/2383643333 >> 172.21.15.146:0/2383643333 conn(0x7f77380c9fe0 msgr2=0x7f773806dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:03.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.987+0000 7f773cd0a700 1 -- 172.21.15.146:0/2383643333 shutdown_connections 2023-10-06T11:15:03.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.987+0000 7f773cd0a700 1 -- 172.21.15.146:0/2383643333 wait complete. 2023-10-06T11:15:03.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.988+0000 7f773cd0a700 1 Processor -- start 2023-10-06T11:15:03.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.988+0000 7f773cd0a700 1 -- start start 2023-10-06T11:15:03.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.989+0000 7f773cd0a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77380c70e0 0x7f77380af950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:03.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.989+0000 7f773cd0a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77381595d0 0x7f77380b1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:03.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.989+0000 7f773cd0a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77381599a0 0x7f77380c8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:03.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.989+0000 7f773cd0a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77380c4b20 con 0x7f77381595d0 2023-10-06T11:15:03.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.989+0000 7f773cd0a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f773816a4d0 con 0x7f77380c70e0 2023-10-06T11:15:03.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.989+0000 7f773cd0a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f773816a7b0 con 0x7f77381599a0 2023-10-06T11:15:03.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.989+0000 7f772dd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77381595d0 0x7f77380b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:03.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.989+0000 7f772dd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77381595d0 0x7f77380b1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58598/0 (socket says 172.21.15.146:58598) 2023-10-06T11:15:03.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.989+0000 7f772dd9b700 1 -- 172.21.15.146:0/2305226325 learned_addr learned my addr 172.21.15.146:0/2305226325 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:03.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.989+0000 7f773659c700 1 --2- 172.21.15.146:0/2305226325 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77380c70e0 0x7f77380af950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:03.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.989+0000 7f7736d9d700 1 --2- 172.21.15.146:0/2305226325 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77381599a0 0x7f77380c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:03.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.989+0000 7f772dd9b700 1 -- 172.21.15.146:0/2305226325 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77381599a0 msgr2=0x7f77380c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:03.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.989+0000 7f772dd9b700 1 --2- 172.21.15.146:0/2305226325 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77381599a0 0x7f77380c8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:03.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.989+0000 7f772dd9b700 1 -- 172.21.15.146:0/2305226325 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77380c70e0 msgr2=0x7f77380af950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:03.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.989+0000 7f772dd9b700 1 --2- 172.21.15.146:0/2305226325 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77380c70e0 0x7f77380af950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:03.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.989+0000 7f772dd9b700 1 -- 172.21.15.146:0/2305226325 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7730009a20 con 0x7f77381595d0 2023-10-06T11:15:03.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.989+0000 7f773659c700 1 --2- 172.21.15.146:0/2305226325 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77380c70e0 0x7f77380af950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:03.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.989+0000 7f7736d9d700 1 --2- 172.21.15.146:0/2305226325 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77381599a0 0x7f77380c8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:03.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.989+0000 7f772dd9b700 1 --2- 172.21.15.146:0/2305226325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77381595d0 0x7f77380b1630 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f772000c5b0 tx=0x7f7720001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:03.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.989+0000 7f772effd700 1 -- 172.21.15.146:0/2305226325 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7720005b30 con 0x7f77381595d0 2023-10-06T11:15:03.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.989+0000 7f772effd700 1 -- 172.21.15.146:0/2305226325 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7720005c90 con 0x7f77381595d0 2023-10-06T11:15:03.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.989+0000 7f772effd700 1 -- 172.21.15.146:0/2305226325 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7720007300 con 0x7f77381595d0 2023-10-06T11:15:03.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.989+0000 7f773cd0a700 1 -- 172.21.15.146:0/2305226325 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f773816aa90 con 0x7f77381595d0 2023-10-06T11:15:03.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.989+0000 7f773cd0a700 1 -- 172.21.15.146:0/2305226325 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77380b1b70 con 0x7f77381595d0 2023-10-06T11:15:03.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.990+0000 7f773cd0a700 1 -- 172.21.15.146:0/2305226325 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77380c4c60 con 0x7f77381595d0 2023-10-06T11:15:03.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.991+0000 7f772effd700 1 -- 172.21.15.146:0/2305226325 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f772001b3b0 con 0x7f77381595d0 2023-10-06T11:15:03.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.991+0000 7f772effd700 1 --2- 172.21.15.146:0/2305226325 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7718066f30 0x7f77180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:03.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.991+0000 7f772effd700 1 -- 172.21.15.146:0/2305226325 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f77200838c0 con 0x7f77381595d0 2023-10-06T11:15:03.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.991+0000 7f773659c700 1 --2- 172.21.15.146:0/2305226325 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7718066f30 0x7f77180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:03.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.992+0000 7f773659c700 1 --2- 172.21.15.146:0/2305226325 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7718066f30 0x7f77180693e0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f7728006fd0 tx=0x7f7728008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:03.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:03.995+0000 7f772effd700 1 -- 172.21.15.146:0/2305226325 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f77380c4c60 con 0x7f77381595d0 2023-10-06T11:15:04.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.254+0000 7f773cd0a700 1 -- 172.21.15.146:0/2305226325 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]} v 0) v1 -- 0x7f77380c4c60 con 0x7f77381595d0 2023-10-06T11:15:04.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.478+0000 7f772effd700 1 -- 172.21.15.146:0/2305226325 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_pause_and_resume_with_abort"]}]=0 v441) v1 ==== 166+0+0 (secure 0 0 0) 0x7f77380c4c60 con 0x7f77381595d0 2023-10-06T11:15:04.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.480+0000 7f773cd0a700 1 -- 172.21.15.146:0/2305226325 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7718066f30 msgr2=0x7f77180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:04.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.480+0000 7f773cd0a700 1 --2- 172.21.15.146:0/2305226325 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7718066f30 0x7f77180693e0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f7728006fd0 tx=0x7f7728008040 comp rx=0 tx=0).stop 2023-10-06T11:15:04.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.480+0000 7f773cd0a700 1 -- 172.21.15.146:0/2305226325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77381595d0 msgr2=0x7f77380b1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:04.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.480+0000 7f773cd0a700 1 --2- 172.21.15.146:0/2305226325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77381595d0 0x7f77380b1630 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f772000c5b0 tx=0x7f7720001070 comp rx=0 tx=0).stop 2023-10-06T11:15:04.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.480+0000 7f773cd0a700 1 -- 172.21.15.146:0/2305226325 shutdown_connections 2023-10-06T11:15:04.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.480+0000 7f773cd0a700 1 --2- 172.21.15.146:0/2305226325 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7718066f30 0x7f77180693e0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:04.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.480+0000 7f773cd0a700 1 --2- 172.21.15.146:0/2305226325 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77381599a0 0x7f77380c8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:04.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.480+0000 7f773cd0a700 1 --2- 172.21.15.146:0/2305226325 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77380c70e0 0x7f77380af950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:04.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.480+0000 7f773cd0a700 1 --2- 172.21.15.146:0/2305226325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77381595d0 0x7f77380b1630 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:04.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.480+0000 7f773cd0a700 1 -- 172.21.15.146:0/2305226325 >> 172.21.15.146:0/2305226325 conn(0x7f77380c9fe0 msgr2=0x7f7738068390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:04.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.480+0000 7f773cd0a700 1 -- 172.21.15.146:0/2305226325 shutdown_connections 2023-10-06T11:15:04.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.480+0000 7f773cd0a700 1 -- 172.21.15.146:0/2305226325 wait complete. 2023-10-06T11:15:04.494 INFO:tasks.cephfs_test_runner:test_scrub_pause_and_resume_with_abort (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2023-10-06T11:15:04.495 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_task_status_on_mds_failover (tasks.cephfs.test_scrub_checks.TestScrubControls) 2023-10-06T11:15:04.495 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover' 2023-10-06T11:15:04.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.607+0000 7f81ba1cc700 1 Processor -- start 2023-10-06T11:15:04.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.607+0000 7f81ba1cc700 1 -- start start 2023-10-06T11:15:04.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.608+0000 7f81ba1cc700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f81b4153e80 0x7f81b415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:04.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.608+0000 7f81ba1cc700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81b415ac30 con 0x7f81b4153ab0 2023-10-06T11:15:04.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.608+0000 7f81ba1cc700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81b40b4510 con 0x7f81b4068ba0 2023-10-06T11:15:04.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.608+0000 7f81ba1cc700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81b40b6530 con 0x7f81b4153e80 2023-10-06T11:15:04.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.608+0000 7f81b37fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f81b4153ab0 0x7f81b4068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39998/0 (socket says 172.21.15.146:39998) 2023-10-06T11:15:04.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.608+0000 7f81b37fe700 1 -- 172.21.15.146:0/2829704244 learned_addr learned my addr 172.21.15.146:0/2829704244 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:15:04.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.609+0000 7f81b3fff700 1 --2- 172.21.15.146:0/2829704244 >> v2:172.21.15.151:3300/0 conn(0x7f81b4153e80 0x7f81b415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:04.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.609+0000 7f81b27fc700 1 -- 172.21.15.146:0/2829704244 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3518436518 0 0) 0x7f81a4001490 con 0x7f81b4153ab0 2023-10-06T11:15:04.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.609+0000 7f81b27fc700 1 -- 172.21.15.146:0/2829704244 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f819c003570 con 0x7f81b4153ab0 2023-10-06T11:15:04.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.609+0000 7f81b27fc700 1 -- 172.21.15.146:0/2829704244 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 430565900 0 0) 0x7f81b40b4510 con 0x7f81b4068ba0 2023-10-06T11:15:04.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.609+0000 7f81b27fc700 1 -- 172.21.15.146:0/2829704244 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81a4001490 con 0x7f81b4068ba0 2023-10-06T11:15:04.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.609+0000 7f81b27fc700 1 -- 172.21.15.146:0/2829704244 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1009144084 0 0) 0x7f819c003570 con 0x7f81b4153ab0 2023-10-06T11:15:04.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.609+0000 7f81b27fc700 1 -- 172.21.15.146:0/2829704244 >> v2:172.21.15.151:3300/0 conn(0x7f81b4153e80 msgr2=0x7f81b415a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:04.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.609+0000 7f81b27fc700 1 --2- 172.21.15.146:0/2829704244 >> v2:172.21.15.151:3300/0 conn(0x7f81b4153e80 0x7f81b415a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:04.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.609+0000 7f81b27fc700 1 -- 172.21.15.146:0/2829704244 >> v1:172.21.15.151:6789/0 conn(0x7f81b4068ba0 legacy=0x7f81b40b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:04.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.609+0000 7f81b27fc700 1 -- 172.21.15.146:0/2829704244 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b40b5c50 con 0x7f81b4153ab0 2023-10-06T11:15:04.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.609+0000 7f81b27fc700 1 -- 172.21.15.146:0/2829704244 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f81a4001900 con 0x7f81b4153ab0 2023-10-06T11:15:04.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.609+0000 7f81b3fff700 1 --2- 172.21.15.146:0/2829704244 >> v2:172.21.15.151:3300/0 conn(0x7f81b4153e80 0x7f81b415a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:15:04.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.609+0000 7f81b27fc700 1 -- 172.21.15.146:0/2829704244 >> v1:172.21.15.146:6789/0 conn(0x7f81b4153ab0 legacy=0x7f81b4068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:04.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.609+0000 7f81b27fc700 1 --2- 172.21.15.146:0/2829704244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f819c003c40 0x7f819c004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:04.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.609+0000 7f81b27fc700 1 --2- 172.21.15.146:0/2829704244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f819c004810 0x7f819c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:04.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.609+0000 7f81b27fc700 1 --2- 172.21.15.146:0/2829704244 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f819c005210 0x7f819c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:04.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.609+0000 7f81b27fc700 1 -- 172.21.15.146:0/2829704244 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b40b6530 con 0x7f819c003c40 2023-10-06T11:15:04.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.609+0000 7f81b27fc700 1 -- 172.21.15.146:0/2829704244 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819c00c130 con 0x7f819c004810 2023-10-06T11:15:04.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.609+0000 7f81b27fc700 1 -- 172.21.15.146:0/2829704244 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f819c00c2c0 con 0x7f819c005210 2023-10-06T11:15:04.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.609+0000 7f81b37fe700 1 --2- 172.21.15.146:0/2829704244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f819c003c40 0x7f819c004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:04.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.609+0000 7f81b2ffd700 1 --2- 172.21.15.146:0/2829704244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f819c004810 0x7f819c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:04.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.609+0000 7f81b3fff700 1 --2- 172.21.15.146:0/2829704244 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f819c005210 0x7f819c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:04.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.609+0000 7f81b37fe700 1 -- 172.21.15.146:0/2829704244 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f819c005210 msgr2=0x7f819c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:04.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.609+0000 7f81b37fe700 1 --2- 172.21.15.146:0/2829704244 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f819c005210 0x7f819c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:04.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.609+0000 7f81b37fe700 1 -- 172.21.15.146:0/2829704244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f819c004810 msgr2=0x7f819c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:04.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.609+0000 7f81b37fe700 1 --2- 172.21.15.146:0/2829704244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f819c004810 0x7f819c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:04.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.609+0000 7f81b37fe700 1 -- 172.21.15.146:0/2829704244 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819c003570 con 0x7f819c003c40 2023-10-06T11:15:04.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.609+0000 7f81b3fff700 1 -- 172.21.15.146:0/2829704244 reap_dead start 2023-10-06T11:15:04.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.610+0000 7f81b37fe700 1 --2- 172.21.15.146:0/2829704244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f819c003c40 0x7f819c004030 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f81a400a930 tx=0x7f81b40b4480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49feb763bb7a3fc2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:04.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.610+0000 7f81b27fc700 1 -- 172.21.15.146:0/2829704244 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a40070d0 con 0x7f819c003c40 2023-10-06T11:15:04.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.610+0000 7f81b27fc700 1 -- 172.21.15.146:0/2829704244 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81a4007250 con 0x7f819c003c40 2023-10-06T11:15:04.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.610+0000 7f81b27fc700 1 -- 172.21.15.146:0/2829704244 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a4007610 con 0x7f819c003c40 2023-10-06T11:15:04.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.610+0000 7f81ba1cc700 1 -- 172.21.15.146:0/2829704244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f819c003c40 msgr2=0x7f819c004030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:04.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.610+0000 7f81ba1cc700 1 --2- 172.21.15.146:0/2829704244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f819c003c40 0x7f819c004030 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f81a400a930 tx=0x7f81b40b4480 comp rx=0 tx=0).stop 2023-10-06T11:15:04.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.610+0000 7f81ba1cc700 1 -- 172.21.15.146:0/2829704244 shutdown_connections 2023-10-06T11:15:04.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.610+0000 7f81ba1cc700 1 --2- 172.21.15.146:0/2829704244 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f819c003c40 0x7f819c004030 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:04.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.610+0000 7f81ba1cc700 1 -- 172.21.15.146:0/2829704244 >> 172.21.15.146:0/2829704244 conn(0x7f81b406eba0 msgr2=0x7f81b406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:04.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.610+0000 7f81ba1cc700 1 -- 172.21.15.146:0/2829704244 shutdown_connections 2023-10-06T11:15:04.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.610+0000 7f81ba1cc700 1 -- 172.21.15.146:0/2829704244 wait complete. 2023-10-06T11:15:04.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.611+0000 7f81ba1cc700 1 Processor -- start 2023-10-06T11:15:04.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.612+0000 7f81ba1cc700 1 -- start start 2023-10-06T11:15:04.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.612+0000 7f81ba1cc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f819c003c40 0x7f81b41576d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:04.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.612+0000 7f81ba1cc700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f81b41526e0 0x7f81b4141fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:04.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.612+0000 7f81ba1cc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81b40b49a0 0x7f81b40b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:04.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.612+0000 7f81ba1cc700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b4158200 con 0x7f81b40b49a0 2023-10-06T11:15:04.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.612+0000 7f81ba1cc700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b40b5350 con 0x7f819c003c40 2023-10-06T11:15:04.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.612+0000 7f81ba1cc700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b4155510 con 0x7f81b41526e0 2023-10-06T11:15:04.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.612+0000 7f81b3fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81b40b49a0 0x7f81b40b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:04.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.612+0000 7f81b3fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81b40b49a0 0x7f81b40b4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58614/0 (socket says 172.21.15.146:58614) 2023-10-06T11:15:04.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.612+0000 7f81b3fff700 1 -- 172.21.15.146:0/1670446488 learned_addr learned my addr 172.21.15.146:0/1670446488 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:04.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.612+0000 7f81b37fe700 1 --2- 172.21.15.146:0/1670446488 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f819c003c40 0x7f81b41576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:04.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.612+0000 7f81b2ffd700 1 --2- 172.21.15.146:0/1670446488 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f81b41526e0 0x7f81b4141fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:04.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.613+0000 7f81b3fff700 1 -- 172.21.15.146:0/1670446488 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f81b41526e0 msgr2=0x7f81b4141fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:04.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.613+0000 7f81b3fff700 1 --2- 172.21.15.146:0/1670446488 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f81b41526e0 0x7f81b4141fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:04.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.613+0000 7f81b3fff700 1 -- 172.21.15.146:0/1670446488 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f819c003c40 msgr2=0x7f81b41576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:04.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.613+0000 7f81b3fff700 1 --2- 172.21.15.146:0/1670446488 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f819c003c40 0x7f81b41576d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:04.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.613+0000 7f81b3fff700 1 -- 172.21.15.146:0/1670446488 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b4157f20 con 0x7f81b40b49a0 2023-10-06T11:15:04.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.613+0000 7f81b37fe700 1 --2- 172.21.15.146:0/1670446488 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f819c003c40 0x7f81b41576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:04.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.613+0000 7f81b3fff700 1 --2- 172.21.15.146:0/1670446488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81b40b49a0 0x7f81b40b4e10 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f81b4154250 tx=0x7f81ac008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:04.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.613+0000 7f819b7fe700 1 -- 172.21.15.146:0/1670446488 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ac015670 con 0x7f81b40b49a0 2023-10-06T11:15:04.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.613+0000 7f819b7fe700 1 -- 172.21.15.146:0/1670446488 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81ac0157d0 con 0x7f81b40b49a0 2023-10-06T11:15:04.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.613+0000 7f81ba1cc700 1 -- 172.21.15.146:0/1670446488 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81b4154ec0 con 0x7f81b40b49a0 2023-10-06T11:15:04.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.613+0000 7f819b7fe700 1 -- 172.21.15.146:0/1670446488 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ac015b70 con 0x7f81b40b49a0 2023-10-06T11:15:04.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.613+0000 7f81ba1cc700 1 -- 172.21.15.146:0/1670446488 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81b4157c10 con 0x7f81b40b49a0 2023-10-06T11:15:04.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.614+0000 7f81ba1cc700 1 -- 172.21.15.146:0/1670446488 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81b4154d20 con 0x7f81b40b49a0 2023-10-06T11:15:04.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.614+0000 7f819b7fe700 1 -- 172.21.15.146:0/1670446488 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f81ac01f410 con 0x7f81b40b49a0 2023-10-06T11:15:04.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.615+0000 7f819b7fe700 1 --2- 172.21.15.146:0/1670446488 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f81a0066f30 0x7f81a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:04.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.615+0000 7f81b37fe700 1 --2- 172.21.15.146:0/1670446488 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f81a0066f30 0x7f81a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:04.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.615+0000 7f819b7fe700 1 -- 172.21.15.146:0/1670446488 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f81ac0843d0 con 0x7f81b40b49a0 2023-10-06T11:15:04.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.615+0000 7f81b37fe700 1 --2- 172.21.15.146:0/1670446488 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f81a0066f30 0x7f81a00693e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f81a400a3f0 tx=0x7f81a4013000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:04.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.619+0000 7f819b7fe700 1 -- 172.21.15.146:0/1670446488 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f81b4154d20 con 0x7f81b40b49a0 2023-10-06T11:15:04.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:04.882+0000 7f81ba1cc700 1 -- 172.21.15.146:0/1670446488 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]} v 0) v1 -- 0x7f81b4154d20 con 0x7f81b40b49a0 2023-10-06T11:15:05.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.487+0000 7f819b7fe700 1 -- 172.21.15.146:0/1670446488 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]}]=0 v442) v1 ==== 169+0+0 (secure 0 0 0) 0x7f81b4154d20 con 0x7f81b40b49a0 2023-10-06T11:15:05.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.489+0000 7f81ba1cc700 1 -- 172.21.15.146:0/1670446488 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f81a0066f30 msgr2=0x7f81a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:05.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.489+0000 7f81ba1cc700 1 --2- 172.21.15.146:0/1670446488 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f81a0066f30 0x7f81a00693e0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f81a400a3f0 tx=0x7f81a4013000 comp rx=0 tx=0).stop 2023-10-06T11:15:05.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.489+0000 7f81ba1cc700 1 -- 172.21.15.146:0/1670446488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81b40b49a0 msgr2=0x7f81b40b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:05.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.489+0000 7f81ba1cc700 1 --2- 172.21.15.146:0/1670446488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81b40b49a0 0x7f81b40b4e10 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f81b4154250 tx=0x7f81ac008040 comp rx=0 tx=0).stop 2023-10-06T11:15:05.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.489+0000 7f81ba1cc700 1 -- 172.21.15.146:0/1670446488 shutdown_connections 2023-10-06T11:15:05.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.489+0000 7f81ba1cc700 1 --2- 172.21.15.146:0/1670446488 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f81a0066f30 0x7f81a00693e0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:05.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.489+0000 7f81ba1cc700 1 --2- 172.21.15.146:0/1670446488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81b40b49a0 0x7f81b40b4e10 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:05.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.489+0000 7f81ba1cc700 1 --2- 172.21.15.146:0/1670446488 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f819c003c40 0x7f81b41576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:05.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.489+0000 7f81ba1cc700 1 --2- 172.21.15.146:0/1670446488 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f81b41526e0 0x7f81b4141fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:05.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.489+0000 7f81ba1cc700 1 -- 172.21.15.146:0/1670446488 >> 172.21.15.146:0/1670446488 conn(0x7f81b406eba0 msgr2=0x7f81b41532a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:05.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.489+0000 7f81ba1cc700 1 -- 172.21.15.146:0/1670446488 shutdown_connections 2023-10-06T11:15:05.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.489+0000 7f81ba1cc700 1 -- 172.21.15.146:0/1670446488 wait complete. 2023-10-06T11:15:05.504 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T11:15:05.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.621+0000 7f178aaa3700 1 Processor -- start 2023-10-06T11:15:05.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.621+0000 7f178aaa3700 1 -- start start 2023-10-06T11:15:05.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.622+0000 7f178aaa3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f17840ae730 0x7f17840aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:05.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.622+0000 7f178aaa3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17840ae2a0 con 0x7f178415a160 2023-10-06T11:15:05.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.622+0000 7f178aaa3700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f178415a530 con 0x7f17840cb950 2023-10-06T11:15:05.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.622+0000 7f178aaa3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17840c5cb0 con 0x7f17840ae730 2023-10-06T11:15:05.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.622+0000 7f178883f700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f178415a160 0x7f17840c55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40002/0 (socket says 172.21.15.146:40002) 2023-10-06T11:15:05.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.622+0000 7f177bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f17840ae730 0x7f17840aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:05.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.622+0000 7f178883f700 1 -- 172.21.15.146:0/2203476430 learned_addr learned my addr 172.21.15.146:0/2203476430 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:15:05.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.623+0000 7f177b7fe700 1 -- 172.21.15.146:0/2203476430 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1505645968 0 0) 0x7f17840ae2a0 con 0x7f178415a160 2023-10-06T11:15:05.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.623+0000 7f177b7fe700 1 -- 172.21.15.146:0/2203476430 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f176c003570 con 0x7f178415a160 2023-10-06T11:15:05.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.623+0000 7f177bfff700 1 -- 172.21.15.146:0/2203476430 >> v1:172.21.15.151:6789/0 conn(0x7f17840cb950 legacy=0x7f17840cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:05.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.623+0000 7f177bfff700 1 -- 172.21.15.146:0/2203476430 >> v1:172.21.15.146:6789/0 conn(0x7f178415a160 legacy=0x7f17840c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:05.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.623+0000 7f177bfff700 1 -- 172.21.15.146:0/2203476430 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17840af0f0 con 0x7f17840ae730 2023-10-06T11:15:05.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.623+0000 7f177bfff700 1 --2- 172.21.15.146:0/2203476430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17840ae730 0x7f17840aebb0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f17740098e0 tx=0x7f17740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b5d81a942619538 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:05.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.623+0000 7f177b7fe700 1 -- 172.21.15.146:0/2203476430 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1774011630 con 0x7f17840ae730 2023-10-06T11:15:05.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.623+0000 7f177b7fe700 1 -- 172.21.15.146:0/2203476430 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1774011790 con 0x7f17840ae730 2023-10-06T11:15:05.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.623+0000 7f177b7fe700 1 -- 172.21.15.146:0/2203476430 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1774011b30 con 0x7f17840ae730 2023-10-06T11:15:05.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.623+0000 7f178aaa3700 1 -- 172.21.15.146:0/2203476430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17840ae730 msgr2=0x7f17840aebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:05.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.623+0000 7f178aaa3700 1 --2- 172.21.15.146:0/2203476430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17840ae730 0x7f17840aebb0 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f17740098e0 tx=0x7f17740091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:05.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.623+0000 7f178aaa3700 1 -- 172.21.15.146:0/2203476430 shutdown_connections 2023-10-06T11:15:05.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.623+0000 7f178aaa3700 1 --2- 172.21.15.146:0/2203476430 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17840ae730 0x7f17840aebb0 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:05.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.623+0000 7f178aaa3700 1 -- 172.21.15.146:0/2203476430 >> 172.21.15.146:0/2203476430 conn(0x7f178406f380 msgr2=0x7f17840d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:05.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.624+0000 7f178aaa3700 1 -- 172.21.15.146:0/2203476430 shutdown_connections 2023-10-06T11:15:05.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.624+0000 7f178aaa3700 1 -- 172.21.15.146:0/2203476430 wait complete. 2023-10-06T11:15:05.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.625+0000 7f178aaa3700 1 Processor -- start 2023-10-06T11:15:05.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.625+0000 7f178aaa3700 1 -- start start 2023-10-06T11:15:05.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.626+0000 7f178aaa3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17840ae730 0x7f17840c97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:05.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.626+0000 7f178aaa3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17840cb950 0x7f1784069930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:05.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.626+0000 7f178aaa3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f178415a160 0x7f1784069e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:05.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.626+0000 7f178aaa3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17840b1490 con 0x7f17840cb950 2023-10-06T11:15:05.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.626+0000 7f178aaa3700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17840b0470 con 0x7f178415a160 2023-10-06T11:15:05.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.626+0000 7f178aaa3700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17840affe0 con 0x7f17840ae730 2023-10-06T11:15:05.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.626+0000 7f177bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17840cb950 0x7f1784069930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:05.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.626+0000 7f177bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17840cb950 0x7f1784069930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58636/0 (socket says 172.21.15.146:58636) 2023-10-06T11:15:05.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.626+0000 7f177bfff700 1 -- 172.21.15.146:0/1181275621 learned_addr learned my addr 172.21.15.146:0/1181275621 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:05.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.626+0000 7f1789040700 1 --2- 172.21.15.146:0/1181275621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f178415a160 0x7f1784069e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:05.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.626+0000 7f178883f700 1 --2- 172.21.15.146:0/1181275621 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17840ae730 0x7f17840c97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:05.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.626+0000 7f177bfff700 1 -- 172.21.15.146:0/1181275621 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17840ae730 msgr2=0x7f17840c97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:05.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.626+0000 7f177bfff700 1 --2- 172.21.15.146:0/1181275621 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17840ae730 0x7f17840c97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:05.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.626+0000 7f177bfff700 1 -- 172.21.15.146:0/1181275621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f178415a160 msgr2=0x7f1784069e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:05.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.626+0000 7f177bfff700 1 --2- 172.21.15.146:0/1181275621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f178415a160 0x7f1784069e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:05.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.626+0000 7f177bfff700 1 -- 172.21.15.146:0/1181275621 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1774009420 con 0x7f17840cb950 2023-10-06T11:15:05.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.626+0000 7f177bfff700 1 --2- 172.21.15.146:0/1181275621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17840cb950 0x7f1784069930 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f17740030c0 tx=0x7f1774016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:05.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.626+0000 7f1778ff9700 1 -- 172.21.15.146:0/1181275621 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1774000c40 con 0x7f17840cb950 2023-10-06T11:15:05.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.626+0000 7f1778ff9700 1 -- 172.21.15.146:0/1181275621 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177401c450 con 0x7f17840cb950 2023-10-06T11:15:05.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.626+0000 7f178aaa3700 1 -- 172.21.15.146:0/1181275621 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17840af410 con 0x7f17840cb950 2023-10-06T11:15:05.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.626+0000 7f1778ff9700 1 -- 172.21.15.146:0/1181275621 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177401c830 con 0x7f17840cb950 2023-10-06T11:15:05.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.626+0000 7f178aaa3700 1 -- 172.21.15.146:0/1181275621 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17840af990 con 0x7f17840cb950 2023-10-06T11:15:05.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.627+0000 7f178aaa3700 1 -- 172.21.15.146:0/1181275621 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1784068390 con 0x7f17840cb950 2023-10-06T11:15:05.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.628+0000 7f1778ff9700 1 -- 172.21.15.146:0/1181275621 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f177401cc60 con 0x7f17840cb950 2023-10-06T11:15:05.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.628+0000 7f1778ff9700 1 --2- 172.21.15.146:0/1181275621 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1770066f30 0x7f17700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:05.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.628+0000 7f1778ff9700 1 -- 172.21.15.146:0/1181275621 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f1774085bf0 con 0x7f17840cb950 2023-10-06T11:15:05.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.628+0000 7f178883f700 1 --2- 172.21.15.146:0/1181275621 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1770066f30 0x7f17700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:05.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.629+0000 7f178883f700 1 --2- 172.21.15.146:0/1181275621 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1770066f30 0x7f17700693e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f1780007fd0 tx=0x7f1780009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:05.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.633+0000 7f1778ff9700 1 -- 172.21.15.146:0/1181275621 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1774053000 con 0x7f17840cb950 2023-10-06T11:15:05.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.816+0000 7f178aaa3700 1 -- 172.21.15.146:0/1181275621 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f1784068390 con 0x7f17840cb950 2023-10-06T11:15:05.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.819+0000 7f1778ff9700 1 -- 172.21.15.146:0/1181275621 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1774056620 con 0x7f17840cb950 2023-10-06T11:15:05.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.821+0000 7f178aaa3700 1 -- 172.21.15.146:0/1181275621 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1770066f30 msgr2=0x7f17700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:05.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.821+0000 7f178aaa3700 1 --2- 172.21.15.146:0/1181275621 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1770066f30 0x7f17700693e0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f1780007fd0 tx=0x7f1780009040 comp rx=0 tx=0).stop 2023-10-06T11:15:05.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.821+0000 7f178aaa3700 1 -- 172.21.15.146:0/1181275621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17840cb950 msgr2=0x7f1784069930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:05.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.821+0000 7f178aaa3700 1 --2- 172.21.15.146:0/1181275621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17840cb950 0x7f1784069930 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f17740030c0 tx=0x7f1774016000 comp rx=0 tx=0).stop 2023-10-06T11:15:05.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.821+0000 7f178aaa3700 1 -- 172.21.15.146:0/1181275621 shutdown_connections 2023-10-06T11:15:05.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.821+0000 7f178aaa3700 1 --2- 172.21.15.146:0/1181275621 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1770066f30 0x7f17700693e0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:05.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.821+0000 7f178aaa3700 1 --2- 172.21.15.146:0/1181275621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f178415a160 0x7f1784069e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:05.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.821+0000 7f178aaa3700 1 --2- 172.21.15.146:0/1181275621 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17840ae730 0x7f17840c97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:05.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.821+0000 7f178aaa3700 1 --2- 172.21.15.146:0/1181275621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17840cb950 0x7f1784069930 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:05.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.821+0000 7f178aaa3700 1 -- 172.21.15.146:0/1181275621 >> 172.21.15.146:0/1181275621 conn(0x7f178406f380 msgr2=0x7f1784159460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:05.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.822+0000 7f178aaa3700 1 -- 172.21.15.146:0/1181275621 shutdown_connections 2023-10-06T11:15:05.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:05.822+0000 7f178aaa3700 1 -- 172.21.15.146:0/1181275621 wait complete. 2023-10-06T11:15:05.835 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T11:15:05.836 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:15:05.879 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:15:05.923 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T11:15:05.923 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T11:15:05.924 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:15:06.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.036+0000 7f9cdcd47700 1 Processor -- start 2023-10-06T11:15:06.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.036+0000 7f9cdcd47700 1 -- start start 2023-10-06T11:15:06.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.037+0000 7f9cdcd47700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9cd80a6e00 0x7f9cd80b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:06.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.037+0000 7f9cdcd47700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cd80ac720 con 0x7f9cd806f460 2023-10-06T11:15:06.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.037+0000 7f9cdcd47700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cd80b0610 con 0x7f9cd806f090 2023-10-06T11:15:06.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.037+0000 7f9cdcd47700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cd81562b0 con 0x7f9cd80a6e00 2023-10-06T11:15:06.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.037+0000 7f9ccdd9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f9cd806f460 0x7f9cd80a66f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40014/0 (socket says 172.21.15.146:40014) 2023-10-06T11:15:06.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.037+0000 7f9ccdd9b700 1 -- 172.21.15.146:0/3453263741 learned_addr learned my addr 172.21.15.146:0/3453263741 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:15:06.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.038+0000 7f9cd5d9b700 1 -- 172.21.15.146:0/3453263741 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3230688736 0 0) 0x7f9cd80ac720 con 0x7f9cd806f460 2023-10-06T11:15:06.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.038+0000 7f9cd5d9b700 1 -- 172.21.15.146:0/3453263741 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cc4003570 con 0x7f9cd806f460 2023-10-06T11:15:06.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.038+0000 7f9cd6d9d700 1 --2- 172.21.15.146:0/3453263741 >> v2:172.21.15.151:3300/0 conn(0x7f9cd80a6e00 0x7f9cd80b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:06.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.038+0000 7f9cd5d9b700 1 -- 172.21.15.146:0/3453263741 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3053784108 0 0) 0x7f9cc4003570 con 0x7f9cd806f460 2023-10-06T11:15:06.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.038+0000 7f9cd5d9b700 1 -- 172.21.15.146:0/3453263741 >> v2:172.21.15.151:3300/0 conn(0x7f9cd80a6e00 msgr2=0x7f9cd80b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:06.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.038+0000 7f9cd5d9b700 1 --2- 172.21.15.146:0/3453263741 >> v2:172.21.15.151:3300/0 conn(0x7f9cd80a6e00 0x7f9cd80b1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:06.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.038+0000 7f9cd5d9b700 1 -- 172.21.15.146:0/3453263741 >> v1:172.21.15.151:6789/0 conn(0x7f9cd806f090 legacy=0x7f9cd80aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:06.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.038+0000 7f9cd5d9b700 1 -- 172.21.15.146:0/3453263741 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd80abb80 con 0x7f9cd806f460 2023-10-06T11:15:06.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.038+0000 7f9cd5d9b700 1 -- 172.21.15.146:0/3453263741 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f9cc0001470 con 0x7f9cd806f460 2023-10-06T11:15:06.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.038+0000 7f9cd5d9b700 1 -- 172.21.15.146:0/3453263741 >> v1:172.21.15.146:6789/0 conn(0x7f9cd806f460 legacy=0x7f9cd80a66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:06.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.038+0000 7f9cd5d9b700 1 --2- 172.21.15.146:0/3453263741 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9cc4003a60 0x7f9cc4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:06.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.038+0000 7f9cd5d9b700 1 --2- 172.21.15.146:0/3453263741 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cc4004810 0x7f9cc4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:06.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.038+0000 7f9cd5d9b700 1 --2- 172.21.15.146:0/3453263741 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9cc40051c0 0x7f9cc400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:06.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.038+0000 7f9cd5d9b700 1 -- 172.21.15.146:0/3453263741 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd81562b0 con 0x7f9cc4004810 2023-10-06T11:15:06.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.038+0000 7f9cd5d9b700 1 -- 172.21.15.146:0/3453263741 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc400c0d0 con 0x7f9cc40051c0 2023-10-06T11:15:06.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.038+0000 7f9cd5d9b700 1 -- 172.21.15.146:0/3453263741 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc400c290 con 0x7f9cc4003a60 2023-10-06T11:15:06.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.038+0000 7f9ccdd9b700 1 --2- 172.21.15.146:0/3453263741 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cc4004810 0x7f9cc4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:06.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.038+0000 7f9cd6d9d700 1 --2- 172.21.15.146:0/3453263741 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9cc40051c0 0x7f9cc400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:06.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.038+0000 7f9cd659c700 1 --2- 172.21.15.146:0/3453263741 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9cc4003a60 0x7f9cc4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:06.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.038+0000 7f9ccdd9b700 1 -- 172.21.15.146:0/3453263741 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9cc4003a60 msgr2=0x7f9cc4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:06.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.038+0000 7f9ccdd9b700 1 --2- 172.21.15.146:0/3453263741 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9cc4003a60 0x7f9cc4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:06.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.038+0000 7f9ccdd9b700 1 -- 172.21.15.146:0/3453263741 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9cc40051c0 msgr2=0x7f9cc400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:06.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.038+0000 7f9ccdd9b700 1 --2- 172.21.15.146:0/3453263741 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9cc40051c0 0x7f9cc400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:06.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.038+0000 7f9ccdd9b700 1 -- 172.21.15.146:0/3453263741 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc4003570 con 0x7f9cc4004810 2023-10-06T11:15:06.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.038+0000 7f9cd6d9d700 1 -- 172.21.15.146:0/3453263741 reap_dead start 2023-10-06T11:15:06.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.038+0000 7f9cd659c700 1 --2- 172.21.15.146:0/3453263741 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9cc4003a60 0x7f9cc4003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:06.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.038+0000 7f9ccdd9b700 1 --2- 172.21.15.146:0/3453263741 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cc4004810 0x7f9cc4004c80 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f9cc000c3c0 tx=0x7f9cc0001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d223832aea82058 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:06.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.039+0000 7f9cd5d9b700 1 -- 172.21.15.146:0/3453263741 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc000cc10 con 0x7f9cc4004810 2023-10-06T11:15:06.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.039+0000 7f9cd5d9b700 1 -- 172.21.15.146:0/3453263741 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cc000cd70 con 0x7f9cc4004810 2023-10-06T11:15:06.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.039+0000 7f9cd5d9b700 1 -- 172.21.15.146:0/3453263741 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc0005b50 con 0x7f9cc4004810 2023-10-06T11:15:06.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.039+0000 7f9cdcd47700 1 -- 172.21.15.146:0/3453263741 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cc4004810 msgr2=0x7f9cc4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:06.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.039+0000 7f9cdcd47700 1 --2- 172.21.15.146:0/3453263741 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cc4004810 0x7f9cc4004c80 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f9cc000c3c0 tx=0x7f9cc0001e50 comp rx=0 tx=0).stop 2023-10-06T11:15:06.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.039+0000 7f9cdcd47700 1 -- 172.21.15.146:0/3453263741 shutdown_connections 2023-10-06T11:15:06.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.039+0000 7f9cdcd47700 1 --2- 172.21.15.146:0/3453263741 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cc4004810 0x7f9cc4004c80 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:06.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.039+0000 7f9cdcd47700 1 -- 172.21.15.146:0/3453263741 >> 172.21.15.146:0/3453263741 conn(0x7f9cd80cc260 msgr2=0x7f9cd80cc660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:06.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.039+0000 7f9cdcd47700 1 -- 172.21.15.146:0/3453263741 shutdown_connections 2023-10-06T11:15:06.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.039+0000 7f9cdcd47700 1 -- 172.21.15.146:0/3453263741 wait complete. 2023-10-06T11:15:06.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.040+0000 7f9cdcd47700 1 Processor -- start 2023-10-06T11:15:06.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.040+0000 7f9cdcd47700 1 -- start start 2023-10-06T11:15:06.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.041+0000 7f9cdcd47700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9cc4004810 0x7f9cd8099620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:06.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.041+0000 7f9cdcd47700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9cd8167b30 0x7f9cd8168d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:06.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.041+0000 7f9cdcd47700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cd816a940 0x7f9cd80adf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:06.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.041+0000 7f9cdcd47700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd8099b60 con 0x7f9cd816a940 2023-10-06T11:15:06.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.041+0000 7f9cdcd47700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd814ef60 con 0x7f9cd8167b30 2023-10-06T11:15:06.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.041+0000 7f9cdcd47700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd8154040 con 0x7f9cc4004810 2023-10-06T11:15:06.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.041+0000 7f9cd6d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cd816a940 0x7f9cd80adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:06.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.041+0000 7f9cd6d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cd816a940 0x7f9cd80adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58664/0 (socket says 172.21.15.146:58664) 2023-10-06T11:15:06.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.041+0000 7f9cd6d9d700 1 -- 172.21.15.146:0/1332104476 learned_addr learned my addr 172.21.15.146:0/1332104476 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:06.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.041+0000 7f9cd659c700 1 --2- 172.21.15.146:0/1332104476 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9cc4004810 0x7f9cd8099620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:06.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.041+0000 7f9ccdd9b700 1 --2- 172.21.15.146:0/1332104476 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9cd8167b30 0x7f9cd8168d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:06.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.041+0000 7f9cd6d9d700 1 -- 172.21.15.146:0/1332104476 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9cc4004810 msgr2=0x7f9cd8099620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:06.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.041+0000 7f9cd6d9d700 1 --2- 172.21.15.146:0/1332104476 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9cc4004810 0x7f9cd8099620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:06.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.041+0000 7f9cd6d9d700 1 -- 172.21.15.146:0/1332104476 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9cd8167b30 msgr2=0x7f9cd8168d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:06.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.041+0000 7f9cd6d9d700 1 --2- 172.21.15.146:0/1332104476 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9cd8167b30 0x7f9cd8168d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:06.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.041+0000 7f9cd6d9d700 1 -- 172.21.15.146:0/1332104476 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd8169240 con 0x7f9cd816a940 2023-10-06T11:15:06.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.042+0000 7f9cd6d9d700 1 --2- 172.21.15.146:0/1332104476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cd816a940 0x7f9cd80adf10 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f9cd80ab880 tx=0x7f9cd000c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:06.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.042+0000 7f9cceffd700 1 -- 172.21.15.146:0/1332104476 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd000f070 con 0x7f9cd816a940 2023-10-06T11:15:06.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.042+0000 7f9cceffd700 1 -- 172.21.15.146:0/1332104476 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cd0010040 con 0x7f9cd816a940 2023-10-06T11:15:06.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.042+0000 7f9cdcd47700 1 -- 172.21.15.146:0/1332104476 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cd81680a0 con 0x7f9cd816a940 2023-10-06T11:15:06.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.042+0000 7f9cceffd700 1 -- 172.21.15.146:0/1332104476 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd0007bd0 con 0x7f9cd816a940 2023-10-06T11:15:06.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.042+0000 7f9cdcd47700 1 -- 172.21.15.146:0/1332104476 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cd8168660 con 0x7f9cd816a940 2023-10-06T11:15:06.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.043+0000 7f9cdcd47700 1 -- 172.21.15.146:0/1332104476 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cd8064dd0 con 0x7f9cd816a940 2023-10-06T11:15:06.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.043+0000 7f9cceffd700 1 -- 172.21.15.146:0/1332104476 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9cd0016480 con 0x7f9cd816a940 2023-10-06T11:15:06.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.043+0000 7f9cceffd700 1 --2- 172.21.15.146:0/1332104476 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9cb8066f30 0x7f9cb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:06.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.044+0000 7f9cceffd700 1 -- 172.21.15.146:0/1332104476 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f9cd0084dd0 con 0x7f9cd816a940 2023-10-06T11:15:06.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.044+0000 7f9cd659c700 1 --2- 172.21.15.146:0/1332104476 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9cb8066f30 0x7f9cb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:06.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.044+0000 7f9cd659c700 1 --2- 172.21.15.146:0/1332104476 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9cb8066f30 0x7f9cb80693e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8007bc0 tx=0x7f9cc8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:06.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.048+0000 7f9cceffd700 1 -- 172.21.15.146:0/1332104476 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9cd0055c70 con 0x7f9cd816a940 2023-10-06T11:15:06.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.272+0000 7f9cdcd47700 1 -- 172.21.15.146:0/1332104476 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9cd814f0f0 con 0x7f9cd816a940 2023-10-06T11:15:06.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.272+0000 7f9cceffd700 1 -- 172.21.15.146:0/1332104476 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) v1 ==== 95+0+3543 (secure 0 0 0) 0x7f9cd0086df0 con 0x7f9cd816a940 2023-10-06T11:15:06.274 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:15:06.274 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":102,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6560,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/2109567995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2109567995},{"type":"v1","addr":"172.21.15.151:6834","nonce":2109567995}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":6563,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1783565134","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":1783565134},{"type":"v1","addr":"172.21.15.151:6835","nonce":1783565134}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":7327,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/1323749517","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1323749517},{"type":"v1","addr":"172.21.15.146:6836","nonce":1323749517}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":96},{"gid":8610,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/1179747010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":1179747010},{"type":"v1","addr":"172.21.15.146:6837","nonce":1179747010}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":102}],"filesystems":[]} 2023-10-06T11:15:06.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.274+0000 7f9cdcd47700 1 -- 172.21.15.146:0/1332104476 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9cb8066f30 msgr2=0x7f9cb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:06.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.274+0000 7f9cdcd47700 1 --2- 172.21.15.146:0/1332104476 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9cb8066f30 0x7f9cb80693e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8007bc0 tx=0x7f9cc8009040 comp rx=0 tx=0).stop 2023-10-06T11:15:06.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.274+0000 7f9cdcd47700 1 -- 172.21.15.146:0/1332104476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cd816a940 msgr2=0x7f9cd80adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:06.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.274+0000 7f9cdcd47700 1 --2- 172.21.15.146:0/1332104476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cd816a940 0x7f9cd80adf10 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f9cd80ab880 tx=0x7f9cd000c040 comp rx=0 tx=0).stop 2023-10-06T11:15:06.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.274+0000 7f9cdcd47700 1 -- 172.21.15.146:0/1332104476 shutdown_connections 2023-10-06T11:15:06.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.274+0000 7f9cdcd47700 1 --2- 172.21.15.146:0/1332104476 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9cb8066f30 0x7f9cb80693e0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:06.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.274+0000 7f9cdcd47700 1 --2- 172.21.15.146:0/1332104476 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9cd816a940 0x7f9cd80adf10 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:06.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.274+0000 7f9cdcd47700 1 --2- 172.21.15.146:0/1332104476 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9cc4004810 0x7f9cd8099620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:06.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.274+0000 7f9cdcd47700 1 --2- 172.21.15.146:0/1332104476 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9cd8167b30 0x7f9cd8168d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:06.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.274+0000 7f9cdcd47700 1 -- 172.21.15.146:0/1332104476 >> 172.21.15.146:0/1332104476 conn(0x7f9cd80cc260 msgr2=0x7f9cd80696f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:06.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.274+0000 7f9cdcd47700 1 -- 172.21.15.146:0/1332104476 shutdown_connections 2023-10-06T11:15:06.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.274+0000 7f9cdcd47700 1 -- 172.21.15.146:0/1332104476 wait complete. 2023-10-06T11:15:06.278 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 102 2023-10-06T11:15:06.288 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T11:15:06.289 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T11:15:06.289 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T11:15:06.289 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:15:06.289 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T11:15:06.289 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T11:15:06.290 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T11:15:06.290 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:15:06.290 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T11:15:06.290 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T11:15:06.290 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T11:15:06.290 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:15:06.290 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T11:15:06.291 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T11:15:06.291 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T11:15:06.291 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:15:06.299 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T11:15:06.299 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T11:15:06.300 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T11:15:06.300 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T11:15:06.301 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T11:15:06.301 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T11:15:06.302 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T11:15:06.302 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T11:15:06.342 INFO:tasks.ceph.mds.a:Started 2023-10-06T11:15:06.343 DEBUG:teuthology.parallel:result is None 2023-10-06T11:15:06.344 INFO:tasks.ceph.mds.c:Started 2023-10-06T11:15:06.344 DEBUG:teuthology.parallel:result is None 2023-10-06T11:15:06.345 INFO:tasks.ceph.mds.b:Started 2023-10-06T11:15:06.345 DEBUG:teuthology.parallel:result is None 2023-10-06T11:15:06.345 INFO:tasks.ceph.mds.d:Started 2023-10-06T11:15:06.345 DEBUG:teuthology.parallel:result is None 2023-10-06T11:15:06.346 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T11:15:06.416 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2023-10-06T11:15:06.416 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2023-10-06T11:15:06.425 INFO:tasks.ceph.mds.b.smithi151.stdout:starting mds.b at 2023-10-06T11:15:06.426 INFO:tasks.ceph.mds.d.smithi151.stdout:starting mds.d at 2023-10-06T11:15:06.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.467+0000 7feb22364700 1 Processor -- start 2023-10-06T11:15:06.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.467+0000 7feb22364700 1 -- start start 2023-10-06T11:15:06.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.467+0000 7feb22364700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7feb1c15a160 0x7feb1c0c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:06.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.467+0000 7feb22364700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb1c0ae2a0 con 0x7feb1c0ae730 2023-10-06T11:15:06.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.467+0000 7feb22364700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb1c15a530 con 0x7feb1c0cb950 2023-10-06T11:15:06.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.467+0000 7feb22364700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb1c0ad690 con 0x7feb1c15a160 2023-10-06T11:15:06.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.468+0000 7feb1b7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7feb1c0ae730 0x7feb1c0aebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40026/0 (socket says 172.21.15.146:40026) 2023-10-06T11:15:06.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.468+0000 7feb1b7fe700 1 -- 172.21.15.146:0/2946165934 learned_addr learned my addr 172.21.15.146:0/2946165934 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:15:06.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.468+0000 7feb1bfff700 1 --2- 172.21.15.146:0/2946165934 >> v2:172.21.15.151:3300/0 conn(0x7feb1c15a160 0x7feb1c0c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:06.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.468+0000 7feb1affd700 1 -- 172.21.15.146:0/2946165934 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2815519202 0 0) 0x7feb1c0ae2a0 con 0x7feb1c0ae730 2023-10-06T11:15:06.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.468+0000 7feb1affd700 1 -- 172.21.15.146:0/2946165934 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb04003570 con 0x7feb1c0ae730 2023-10-06T11:15:06.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.468+0000 7feb1affd700 1 -- 172.21.15.146:0/2946165934 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3961643096 0 0) 0x7feb04003570 con 0x7feb1c0ae730 2023-10-06T11:15:06.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.468+0000 7feb1affd700 1 -- 172.21.15.146:0/2946165934 >> v2:172.21.15.151:3300/0 conn(0x7feb1c15a160 msgr2=0x7feb1c0c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:06.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.468+0000 7feb1affd700 1 --2- 172.21.15.146:0/2946165934 >> v2:172.21.15.151:3300/0 conn(0x7feb1c15a160 0x7feb1c0c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:06.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.468+0000 7feb1affd700 1 -- 172.21.15.146:0/2946165934 >> v1:172.21.15.151:6789/0 conn(0x7feb1c0cb950 legacy=0x7feb1c0cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:06.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.468+0000 7feb1affd700 1 -- 172.21.15.146:0/2946165934 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb1c0ad970 con 0x7feb1c0ae730 2023-10-06T11:15:06.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.468+0000 7feb1affd700 1 -- 172.21.15.146:0/2946165934 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7feb10001470 con 0x7feb1c0ae730 2023-10-06T11:15:06.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.468+0000 7feb1affd700 1 -- 172.21.15.146:0/2946165934 >> v1:172.21.15.146:6789/0 conn(0x7feb1c0ae730 legacy=0x7feb1c0aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:06.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.468+0000 7feb1affd700 1 --2- 172.21.15.146:0/2946165934 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb04003a60 0x7feb04003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:06.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.468+0000 7feb1affd700 1 --2- 172.21.15.146:0/2946165934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb04004810 0x7feb04004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:06.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.468+0000 7feb1affd700 1 --2- 172.21.15.146:0/2946165934 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb040051c0 0x7feb0400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:06.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.468+0000 7feb1affd700 1 -- 172.21.15.146:0/2946165934 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb1c0ad690 con 0x7feb04004810 2023-10-06T11:15:06.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.468+0000 7feb1affd700 1 -- 172.21.15.146:0/2946165934 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb0400c0d0 con 0x7feb040051c0 2023-10-06T11:15:06.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.468+0000 7feb1affd700 1 -- 172.21.15.146:0/2946165934 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb0400c290 con 0x7feb04003a60 2023-10-06T11:15:06.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.468+0000 7feb1b7fe700 1 --2- 172.21.15.146:0/2946165934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb04004810 0x7feb04004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:06.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.468+0000 7feb1bfff700 1 --2- 172.21.15.146:0/2946165934 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb04003a60 0x7feb04003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:06.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.468+0000 7feb20901700 1 --2- 172.21.15.146:0/2946165934 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb040051c0 0x7feb0400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:06.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.469+0000 7feb1b7fe700 1 -- 172.21.15.146:0/2946165934 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb04003a60 msgr2=0x7feb04003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:06.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.469+0000 7feb1b7fe700 1 --2- 172.21.15.146:0/2946165934 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb04003a60 0x7feb04003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:06.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.469+0000 7feb1b7fe700 1 -- 172.21.15.146:0/2946165934 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb040051c0 msgr2=0x7feb0400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:06.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.469+0000 7feb1b7fe700 1 --2- 172.21.15.146:0/2946165934 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb040051c0 0x7feb0400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:06.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.469+0000 7feb1b7fe700 1 -- 172.21.15.146:0/2946165934 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb04003570 con 0x7feb04004810 2023-10-06T11:15:06.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.469+0000 7feb20901700 1 -- 172.21.15.146:0/2946165934 reap_dead start 2023-10-06T11:15:06.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.469+0000 7feb1bfff700 1 --2- 172.21.15.146:0/2946165934 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb04003a60 0x7feb04003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:15:06.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.469+0000 7feb1b7fe700 1 --2- 172.21.15.146:0/2946165934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb04004810 0x7feb04004c80 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7feb1000c3c0 tx=0x7feb10001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f982e8001c994b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:06.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.469+0000 7feb1affd700 1 -- 172.21.15.146:0/2946165934 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1000cc90 con 0x7feb04004810 2023-10-06T11:15:06.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.469+0000 7feb1affd700 1 -- 172.21.15.146:0/2946165934 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb1000cdf0 con 0x7feb04004810 2023-10-06T11:15:06.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.469+0000 7feb1affd700 1 -- 172.21.15.146:0/2946165934 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb10005b50 con 0x7feb04004810 2023-10-06T11:15:06.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.469+0000 7feb22364700 1 -- 172.21.15.146:0/2946165934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb04004810 msgr2=0x7feb04004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:06.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.469+0000 7feb22364700 1 --2- 172.21.15.146:0/2946165934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb04004810 0x7feb04004c80 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7feb1000c3c0 tx=0x7feb10001e50 comp rx=0 tx=0).stop 2023-10-06T11:15:06.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.469+0000 7feb22364700 1 -- 172.21.15.146:0/2946165934 shutdown_connections 2023-10-06T11:15:06.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.469+0000 7feb22364700 1 --2- 172.21.15.146:0/2946165934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb04004810 0x7feb04004c80 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:06.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.469+0000 7feb22364700 1 -- 172.21.15.146:0/2946165934 >> 172.21.15.146:0/2946165934 conn(0x7feb1c06f380 msgr2=0x7feb1c0d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:06.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.469+0000 7feb22364700 1 -- 172.21.15.146:0/2946165934 shutdown_connections 2023-10-06T11:15:06.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.469+0000 7feb22364700 1 -- 172.21.15.146:0/2946165934 wait complete. 2023-10-06T11:15:06.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.470+0000 7feb22364700 1 Processor -- start 2023-10-06T11:15:06.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.471+0000 7feb22364700 1 -- start start 2023-10-06T11:15:06.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.471+0000 7feb22364700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb04004810 0x7feb1c0cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:06.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.471+0000 7feb22364700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb1c0b35a0 0x7feb1c14b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:06.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.471+0000 7feb22364700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb1c0b3a10 0x7feb1c14b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:06.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.471+0000 7feb22364700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb1c0b48f0 con 0x7feb04004810 2023-10-06T11:15:06.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.471+0000 7feb22364700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb1c0b4bd0 con 0x7feb1c0b35a0 2023-10-06T11:15:06.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.471+0000 7feb22364700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb1c0b3f80 con 0x7feb1c0b3a10 2023-10-06T11:15:06.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.472+0000 7feb1bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb04004810 0x7feb1c0cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:06.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.472+0000 7feb1bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb04004810 0x7feb1c0cc9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58720/0 (socket says 172.21.15.146:58720) 2023-10-06T11:15:06.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.472+0000 7feb1bfff700 1 -- 172.21.15.146:0/3767939740 learned_addr learned my addr 172.21.15.146:0/3767939740 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:06.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.472+0000 7feb1b7fe700 1 --2- 172.21.15.146:0/3767939740 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb1c0b35a0 0x7feb1c14b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:06.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.472+0000 7feb20901700 1 --2- 172.21.15.146:0/3767939740 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb1c0b3a10 0x7feb1c14b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:06.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.472+0000 7feb1bfff700 1 -- 172.21.15.146:0/3767939740 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb1c0b3a10 msgr2=0x7feb1c14b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:06.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.472+0000 7feb1bfff700 1 --2- 172.21.15.146:0/3767939740 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb1c0b3a10 0x7feb1c14b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:06.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.472+0000 7feb1bfff700 1 -- 172.21.15.146:0/3767939740 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb1c0b35a0 msgr2=0x7feb1c14b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:06.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.472+0000 7feb1bfff700 1 --2- 172.21.15.146:0/3767939740 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb1c0b35a0 0x7feb1c14b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:06.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.472+0000 7feb1bfff700 1 -- 172.21.15.146:0/3767939740 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb1c0b4260 con 0x7feb04004810 2023-10-06T11:15:06.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.472+0000 7feb20901700 1 --2- 172.21.15.146:0/3767939740 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb1c0b3a10 0x7feb1c14b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:06.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.472+0000 7feb1bfff700 1 --2- 172.21.15.146:0/3767939740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb04004810 0x7feb1c0cc9a0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7feb0c011d50 tx=0x7feb0c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:06.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.472+0000 7feb03fff700 1 -- 172.21.15.146:0/3767939740 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0c011e50 con 0x7feb04004810 2023-10-06T11:15:06.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.472+0000 7feb03fff700 1 -- 172.21.15.146:0/3767939740 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb0c00fcd0 con 0x7feb04004810 2023-10-06T11:15:06.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.472+0000 7feb22364700 1 -- 172.21.15.146:0/3767939740 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb1c0b4540 con 0x7feb04004810 2023-10-06T11:15:06.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.472+0000 7feb03fff700 1 -- 172.21.15.146:0/3767939740 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0c005c50 con 0x7feb04004810 2023-10-06T11:15:06.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.472+0000 7feb22364700 1 -- 172.21.15.146:0/3767939740 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb1c0ccee0 con 0x7feb04004810 2023-10-06T11:15:06.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.473+0000 7feb22364700 1 -- 172.21.15.146:0/3767939740 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb1c068390 con 0x7feb04004810 2023-10-06T11:15:06.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.474+0000 7feb03fff700 1 -- 172.21.15.146:0/3767939740 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feb0c006260 con 0x7feb04004810 2023-10-06T11:15:06.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.474+0000 7feb03fff700 1 --2- 172.21.15.146:0/3767939740 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feb08066f30 0x7feb080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:06.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.474+0000 7feb03fff700 1 -- 172.21.15.146:0/3767939740 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5292+0+0 (secure 0 0 0) 0x7feb0c084be0 con 0x7feb04004810 2023-10-06T11:15:06.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.474+0000 7feb1b7fe700 1 --2- 172.21.15.146:0/3767939740 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feb08066f30 0x7feb080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:06.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.474+0000 7feb1b7fe700 1 --2- 172.21.15.146:0/3767939740 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feb08066f30 0x7feb080693e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7feb10000c00 tx=0x7feb10015000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:06.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.478+0000 7feb03fff700 1 -- 172.21.15.146:0/3767939740 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feb0c051ff0 con 0x7feb04004810 2023-10-06T11:15:06.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:06.685+0000 7feb22364700 1 -- 172.21.15.146:0/3767939740 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7feb1c04c380 con 0x7feb04004810 2023-10-06T11:15:07.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.520+0000 7feb03fff700 1 -- 172.21.15.146:0/3767939740 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v121) v1 ==== 97+0+0 (secure 0 0 0) 0x7feb0c055610 con 0x7feb04004810 2023-10-06T11:15:07.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.523+0000 7feb22364700 1 -- 172.21.15.146:0/3767939740 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feb08066f30 msgr2=0x7feb080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:07.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.523+0000 7feb22364700 1 --2- 172.21.15.146:0/3767939740 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feb08066f30 0x7feb080693e0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7feb10000c00 tx=0x7feb10015000 comp rx=0 tx=0).stop 2023-10-06T11:15:07.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.523+0000 7feb22364700 1 -- 172.21.15.146:0/3767939740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb04004810 msgr2=0x7feb1c0cc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:07.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.523+0000 7feb22364700 1 --2- 172.21.15.146:0/3767939740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb04004810 0x7feb1c0cc9a0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7feb0c011d50 tx=0x7feb0c009120 comp rx=0 tx=0).stop 2023-10-06T11:15:07.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.523+0000 7feb22364700 1 -- 172.21.15.146:0/3767939740 shutdown_connections 2023-10-06T11:15:07.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.523+0000 7feb22364700 1 --2- 172.21.15.146:0/3767939740 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feb08066f30 0x7feb080693e0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:07.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.523+0000 7feb22364700 1 --2- 172.21.15.146:0/3767939740 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb1c0b3a10 0x7feb1c14b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:07.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.523+0000 7feb22364700 1 --2- 172.21.15.146:0/3767939740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb04004810 0x7feb1c0cc9a0 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:07.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.523+0000 7feb22364700 1 --2- 172.21.15.146:0/3767939740 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb1c0b35a0 0x7feb1c14b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:07.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.523+0000 7feb22364700 1 -- 172.21.15.146:0/3767939740 >> 172.21.15.146:0/3767939740 conn(0x7feb1c06f380 msgr2=0x7feb1c159470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:07.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.524+0000 7feb22364700 1 -- 172.21.15.146:0/3767939740 shutdown_connections 2023-10-06T11:15:07.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.524+0000 7feb22364700 1 -- 172.21.15.146:0/3767939740 wait complete. 2023-10-06T11:15:07.527 INFO:teuthology.orchestra.run.smithi146.stderr: removed all blocklist entries 2023-10-06T11:15:07.541 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T11:15:07.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.659+0000 7f382816c700 1 Processor -- start 2023-10-06T11:15:07.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.660+0000 7f382816c700 1 -- start start 2023-10-06T11:15:07.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.660+0000 7f382816c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3820159720 0x7f382006efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:07.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.660+0000 7f382816c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f38200a7f30 0x7f3820067470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:07.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.660+0000 7f382816c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f38200679b0 0x7f38200aea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:07.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.660+0000 7f382816c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f382006eb10 con 0x7f38200679b0 2023-10-06T11:15:07.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.660+0000 7f382816c700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3820067dd0 con 0x7f38200a7f30 2023-10-06T11:15:07.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.660+0000 7f382816c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382006e7e0 con 0x7f3820159720 2023-10-06T11:15:07.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.661+0000 7f3826709700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f38200679b0 0x7f38200aea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:07.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.661+0000 7f3826709700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f38200679b0 0x7f38200aea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58732/0 (socket says 172.21.15.146:58732) 2023-10-06T11:15:07.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.661+0000 7f3826709700 1 -- 172.21.15.146:0/106097836 learned_addr learned my addr 172.21.15.146:0/106097836 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:07.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.661+0000 7f3826709700 1 -- 172.21.15.146:0/106097836 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3820159720 msgr2=0x7f382006efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:07.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.661+0000 7f3826709700 1 --2- 172.21.15.146:0/106097836 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3820159720 0x7f382006efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:07.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.661+0000 7f3826709700 1 -- 172.21.15.146:0/106097836 >> v2:172.21.15.151:3300/0 conn(0x7f38200a7f30 msgr2=0x7f3820067470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:07.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.661+0000 7f3826709700 1 --2- 172.21.15.146:0/106097836 >> v2:172.21.15.151:3300/0 conn(0x7f38200a7f30 0x7f3820067470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:07.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.661+0000 7f3826709700 1 -- 172.21.15.146:0/106097836 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382015a860 con 0x7f38200679b0 2023-10-06T11:15:07.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.661+0000 7f3826709700 1 --2- 172.21.15.146:0/106097836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38200679b0 0x7f38200aea60 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f3820064990 tx=0x7f3818009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46e8a8880d7f9ea5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:07.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.661+0000 7f3824f06700 1 -- 172.21.15.146:0/106097836 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381800e070 con 0x7f38200679b0 2023-10-06T11:15:07.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.661+0000 7f3824f06700 1 -- 172.21.15.146:0/106097836 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381800ba50 con 0x7f38200679b0 2023-10-06T11:15:07.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.661+0000 7f3824f06700 1 -- 172.21.15.146:0/106097836 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38180092e0 con 0x7f38200679b0 2023-10-06T11:15:07.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.662+0000 7f382816c700 1 -- 172.21.15.146:0/106097836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38200679b0 msgr2=0x7f38200aea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:07.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.662+0000 7f382816c700 1 --2- 172.21.15.146:0/106097836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38200679b0 0x7f38200aea60 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f3820064990 tx=0x7f3818009840 comp rx=0 tx=0).stop 2023-10-06T11:15:07.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.662+0000 7f382816c700 1 -- 172.21.15.146:0/106097836 shutdown_connections 2023-10-06T11:15:07.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.662+0000 7f382816c700 1 --2- 172.21.15.146:0/106097836 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f38200679b0 0x7f38200aea60 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:07.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.662+0000 7f382816c700 1 --2- 172.21.15.146:0/106097836 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3820159720 0x7f382006efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:07.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.662+0000 7f382816c700 1 --2- 172.21.15.146:0/106097836 >> v2:172.21.15.151:3300/0 conn(0x7f38200a7f30 0x7f3820067470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:07.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.662+0000 7f382816c700 1 -- 172.21.15.146:0/106097836 >> 172.21.15.146:0/106097836 conn(0x7f3820068580 msgr2=0x7f3820068980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:07.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.662+0000 7f382816c700 1 -- 172.21.15.146:0/106097836 shutdown_connections 2023-10-06T11:15:07.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.662+0000 7f382816c700 1 -- 172.21.15.146:0/106097836 wait complete. 2023-10-06T11:15:07.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.663+0000 7f382816c700 1 Processor -- start 2023-10-06T11:15:07.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.663+0000 7f382816c700 1 -- start start 2023-10-06T11:15:07.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.664+0000 7f382816c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38200679b0 0x7f3820099290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:07.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.664+0000 7f382816c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38200a7f30 0x7f382015bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:07.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.664+0000 7f382816c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3820159720 0x7f382014c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:07.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.664+0000 7f382816c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3820096cb0 con 0x7f3820159720 2023-10-06T11:15:07.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.664+0000 7f382816c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382015c4b0 con 0x7f38200a7f30 2023-10-06T11:15:07.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.664+0000 7f382816c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382015c790 con 0x7f38200679b0 2023-10-06T11:15:07.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.664+0000 7f3826709700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3820159720 0x7f382014c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:07.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.664+0000 7f3826709700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3820159720 0x7f382014c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58746/0 (socket says 172.21.15.146:58746) 2023-10-06T11:15:07.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.664+0000 7f3826709700 1 -- 172.21.15.146:0/3719670628 learned_addr learned my addr 172.21.15.146:0/3719670628 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:07.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.664+0000 7f3825f08700 1 --2- 172.21.15.146:0/3719670628 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38200679b0 0x7f3820099290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:07.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.664+0000 7f3825707700 1 --2- 172.21.15.146:0/3719670628 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38200a7f30 0x7f382015bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:07.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.664+0000 7f3826709700 1 -- 172.21.15.146:0/3719670628 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38200679b0 msgr2=0x7f3820099290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:07.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.664+0000 7f3826709700 1 --2- 172.21.15.146:0/3719670628 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38200679b0 0x7f3820099290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:07.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.664+0000 7f3826709700 1 -- 172.21.15.146:0/3719670628 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38200a7f30 msgr2=0x7f382015bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:07.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.664+0000 7f3826709700 1 --2- 172.21.15.146:0/3719670628 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38200a7f30 0x7f382015bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:07.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.664+0000 7f3826709700 1 -- 172.21.15.146:0/3719670628 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3818009ae0 con 0x7f3820159720 2023-10-06T11:15:07.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.664+0000 7f3826709700 1 --2- 172.21.15.146:0/3719670628 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3820159720 0x7f382014c600 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f382006a040 tx=0x7f3818018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:07.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.664+0000 7f3815ffb700 1 -- 172.21.15.146:0/3719670628 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3818008e80 con 0x7f3820159720 2023-10-06T11:15:07.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.664+0000 7f3815ffb700 1 -- 172.21.15.146:0/3719670628 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38180092e0 con 0x7f3820159720 2023-10-06T11:15:07.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.664+0000 7f3815ffb700 1 -- 172.21.15.146:0/3719670628 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38180266b0 con 0x7f3820159720 2023-10-06T11:15:07.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.664+0000 7f382816c700 1 -- 172.21.15.146:0/3719670628 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f382015ca70 con 0x7f3820159720 2023-10-06T11:15:07.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.664+0000 7f382816c700 1 -- 172.21.15.146:0/3719670628 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38200997d0 con 0x7f3820159720 2023-10-06T11:15:07.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.665+0000 7f382816c700 1 -- 172.21.15.146:0/3719670628 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3820097140 con 0x7f3820159720 2023-10-06T11:15:07.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.666+0000 7f3815ffb700 1 -- 172.21.15.146:0/3719670628 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3818003040 con 0x7f3820159720 2023-10-06T11:15:07.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.666+0000 7f3815ffb700 1 --2- 172.21.15.146:0/3719670628 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3804066f30 0x7f38040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:07.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.666+0000 7f3815ffb700 1 -- 172.21.15.146:0/3719670628 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f3818086400 con 0x7f3820159720 2023-10-06T11:15:07.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.666+0000 7f3825f08700 1 --2- 172.21.15.146:0/3719670628 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3804066f30 0x7f38040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:07.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.667+0000 7f3825f08700 1 --2- 172.21.15.146:0/3719670628 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3804066f30 0x7f38040693e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f381c009950 tx=0x7f381c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:07.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.670+0000 7f3815ffb700 1 -- 172.21.15.146:0/3719670628 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3820097140 con 0x7f3820159720 2023-10-06T11:15:07.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.927+0000 7f382816c700 1 -- 172.21.15.146:0/3719670628 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f3820097140 con 0x7f3820159720 2023-10-06T11:15:07.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.928+0000 7f3815ffb700 1 -- 172.21.15.146:0/3719670628 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f3820097140 con 0x7f3820159720 2023-10-06T11:15:07.930 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:15:07.930 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:15:07.930 INFO:teuthology.orchestra.run.smithi146.stdout: "auth_dump": [ 2023-10-06T11:15:07.930 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:15:07.930 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.a", 2023-10-06T11:15:07.930 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lG4F8DBAAp5A4Dtfzvv8n9ORgkmiP9g==", 2023-10-06T11:15:07.930 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:15:07.931 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:15:07.931 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:15:07.931 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:15:07.931 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:15:07.931 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:15:07.931 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:15:07.931 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:15:07.931 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.b", 2023-10-06T11:15:07.931 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lDIceGBAA4cr0oGVaXiy5hrruKY5DGw==", 2023-10-06T11:15:07.931 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:15:07.931 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:15:07.931 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:15:07.932 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:15:07.932 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:15:07.932 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:15:07.932 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:15:07.932 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:15:07.932 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.c", 2023-10-06T11:15:07.932 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lbYA7ExAAAopKjS7+WMUE5fuVQygILQ==", 2023-10-06T11:15:07.932 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:15:07.932 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:15:07.932 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:15:07.932 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:15:07.932 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:15:07.933 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:15:07.933 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:15:07.933 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:15:07.933 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.d", 2023-10-06T11:15:07.933 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9laygiHxAAasUUn7Wk9EwLa36ggsZtHw==", 2023-10-06T11:15:07.933 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:15:07.933 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:15:07.933 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:15:07.933 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:15:07.933 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:15:07.933 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:15:07.933 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:15:07.934 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:15:07.934 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.0", 2023-10-06T11:15:07.934 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDX6R9lLGo9NhAAcWJuUeOdEUsdDw84W9nLPw==", 2023-10-06T11:15:07.934 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:15:07.934 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:15:07.934 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:15:07.934 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:15:07.934 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:15:07.934 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:15:07.934 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:15:07.934 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.1", 2023-10-06T11:15:07.935 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDa6R9lk02gNBAA9YqWT2/Xds20lv0sGtBApg==", 2023-10-06T11:15:07.935 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:15:07.935 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:15:07.935 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:15:07.935 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:15:07.935 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:15:07.935 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:15:07.935 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:15:07.935 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.2", 2023-10-06T11:15:07.935 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDd6R9lrA6xMxAAmH8r6m2p4Jpa82xfYNcq+g==", 2023-10-06T11:15:07.935 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:15:07.936 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:15:07.936 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:15:07.936 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:15:07.936 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:15:07.936 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:15:07.936 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:15:07.936 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.3", 2023-10-06T11:15:07.936 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDg6R9ltlHXNBAAvhfI1yjlaWCIE9Xr/4F/PA==", 2023-10-06T11:15:07.936 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:15:07.936 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:15:07.936 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:15:07.937 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:15:07.937 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:15:07.937 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:15:07.937 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:15:07.937 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.4", 2023-10-06T11:15:07.937 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDm6R9lPUCvMhAAGbUNfpoFi9SvYdelpnL1jA==", 2023-10-06T11:15:07.937 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:15:07.937 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:15:07.937 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:15:07.937 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:15:07.937 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:15:07.937 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:15:07.938 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:15:07.938 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.5", 2023-10-06T11:15:07.938 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDp6R9lMfrMMBAAUEtnXDNr7+L3dQm4QE9qDw==", 2023-10-06T11:15:07.938 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:15:07.938 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:15:07.938 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:15:07.938 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:15:07.938 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:15:07.938 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:15:07.938 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:15:07.938 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.6", 2023-10-06T11:15:07.938 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDs6R9lAmSDMBAArPp+6dVt/NyH9is46tL49g==", 2023-10-06T11:15:07.939 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:15:07.939 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:15:07.939 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:15:07.939 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:15:07.939 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:15:07.939 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:15:07.939 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:15:07.939 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.7", 2023-10-06T11:15:07.939 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDv6R9lnunMLRAA3o5ZtAyYDUoXTzjX9H8FCw==", 2023-10-06T11:15:07.939 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:15:07.939 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:15:07.939 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:15:07.940 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:15:07.940 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:15:07.940 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:15:07.940 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:15:07.940 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.0", 2023-10-06T11:15:07.940 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lCrPrIhAARrzj2VxVFkzF5L/ifIAqmw==", 2023-10-06T11:15:07.940 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:15:07.940 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:15:07.940 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow r", 2023-10-06T11:15:07.940 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T11:15:07.941 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:15:07.941 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:15:07.941 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:15:07.941 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.1", 2023-10-06T11:15:07.941 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9l10VSKxAA0HmXejgRRCQ7XpsMB7ljkQ==", 2023-10-06T11:15:07.941 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:15:07.941 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:15:07.941 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2023-10-06T11:15:07.941 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2023-10-06T11:15:07.941 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2023-10-06T11:15:07.941 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:15:07.941 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:15:07.942 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:15:07.942 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.2", 2023-10-06T11:15:07.942 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lpLpJKBAAF/vLDkBg9/VBqMK4pVVIkg==", 2023-10-06T11:15:07.942 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:15:07.942 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:15:07.942 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2023-10-06T11:15:07.942 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2023-10-06T11:15:07.942 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2023-10-06T11:15:07.942 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:15:07.942 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:15:07.942 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:15:07.942 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.3", 2023-10-06T11:15:07.943 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9luMqwMBAA4Y4I9hWTk2IqAzYwVQ13Pw==", 2023-10-06T11:15:07.943 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:15:07.943 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:15:07.943 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2023-10-06T11:15:07.943 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2023-10-06T11:15:07.943 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2023-10-06T11:15:07.943 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:15:07.943 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:15:07.943 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:15:07.943 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.admin", 2023-10-06T11:15:07.943 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDT6R9lSr9qIhAAiNEN9xFWUwFGsB+oUE1cXw==", 2023-10-06T11:15:07.943 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:15:07.944 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2023-10-06T11:15:07.944 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:15:07.944 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:15:07.944 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:15:07.944 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:15:07.944 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:15:07.944 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:15:07.944 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.x", 2023-10-06T11:15:07.944 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9llLpwCRAA4UH9Uqli2de9HIJR2fZ9xg==", 2023-10-06T11:15:07.944 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:15:07.944 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2023-10-06T11:15:07.944 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2023-10-06T11:15:07.944 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:15:07.945 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:15:07.945 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:15:07.945 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:15:07.945 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.y", 2023-10-06T11:15:07.945 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDT6R9l2uQxNxAAVSMhKVzbf2vC4opL7YCLdg==", 2023-10-06T11:15:07.945 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:15:07.945 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2023-10-06T11:15:07.945 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2023-10-06T11:15:07.945 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:15:07.945 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:15:07.945 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:15:07.945 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2023-10-06T11:15:07.946 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:15:07.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.930+0000 7f382816c700 1 -- 172.21.15.146:0/3719670628 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3804066f30 msgr2=0x7f38040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:07.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.930+0000 7f382816c700 1 --2- 172.21.15.146:0/3719670628 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3804066f30 0x7f38040693e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f381c009950 tx=0x7f381c008040 comp rx=0 tx=0).stop 2023-10-06T11:15:07.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.930+0000 7f382816c700 1 -- 172.21.15.146:0/3719670628 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3820159720 msgr2=0x7f382014c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:07.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.930+0000 7f382816c700 1 --2- 172.21.15.146:0/3719670628 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3820159720 0x7f382014c600 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f382006a040 tx=0x7f3818018000 comp rx=0 tx=0).stop 2023-10-06T11:15:07.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.930+0000 7f382816c700 1 -- 172.21.15.146:0/3719670628 shutdown_connections 2023-10-06T11:15:07.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.930+0000 7f382816c700 1 --2- 172.21.15.146:0/3719670628 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3804066f30 0x7f38040693e0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:07.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.930+0000 7f382816c700 1 --2- 172.21.15.146:0/3719670628 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3820159720 0x7f382014c600 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:07.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.930+0000 7f382816c700 1 --2- 172.21.15.146:0/3719670628 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f38200679b0 0x7f3820099290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:07.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.930+0000 7f382816c700 1 --2- 172.21.15.146:0/3719670628 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38200a7f30 0x7f382015bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:07.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.930+0000 7f382816c700 1 -- 172.21.15.146:0/3719670628 >> 172.21.15.146:0/3719670628 conn(0x7f3820068580 msgr2=0x7f38200b01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:07.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.930+0000 7f382816c700 1 -- 172.21.15.146:0/3719670628 shutdown_connections 2023-10-06T11:15:07.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:07.930+0000 7f382816c700 1 -- 172.21.15.146:0/3719670628 wait complete. 2023-10-06T11:15:07.950 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:15:08.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.063+0000 7f2f2e5ba700 1 Processor -- start 2023-10-06T11:15:08.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.063+0000 7f2f2e5ba700 1 -- start start 2023-10-06T11:15:08.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.064+0000 7f2f2e5ba700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2f2815a420 0x7f2f2815cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:08.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.064+0000 7f2f2e5ba700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2f2815a7f0 0x7f2f280b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:08.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.064+0000 7f2f2e5ba700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2f280b2360 0x7f2f2815acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:08.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.064+0000 7f2f2e5ba700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f280ce040 con 0x7f2f2815a7f0 2023-10-06T11:15:08.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.064+0000 7f2f2e5ba700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f280b27e0 con 0x7f2f280b2360 2023-10-06T11:15:08.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.064+0000 7f2f2e5ba700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2815c630 con 0x7f2f2815a420 2023-10-06T11:15:08.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.064+0000 7f2f2cdb7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2f2815a7f0 0x7f2f280b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:08.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.064+0000 7f2f2cdb7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2f2815a7f0 0x7f2f280b1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58750/0 (socket says 172.21.15.146:58750) 2023-10-06T11:15:08.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.064+0000 7f2f2cdb7700 1 -- 172.21.15.146:0/259231873 learned_addr learned my addr 172.21.15.146:0/259231873 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:08.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.064+0000 7f2f2ddb9700 1 --2- 172.21.15.146:0/259231873 >> v2:172.21.15.151:3300/0 conn(0x7f2f280b2360 0x7f2f2815acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:08.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.064+0000 7f2f2d5b8700 1 --2- 172.21.15.146:0/259231873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2f2815a420 0x7f2f2815cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:08.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.065+0000 7f2f2cdb7700 1 -- 172.21.15.146:0/259231873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2f2815a420 msgr2=0x7f2f2815cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:08.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.065+0000 7f2f2cdb7700 1 --2- 172.21.15.146:0/259231873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2f2815a420 0x7f2f2815cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.065+0000 7f2f2cdb7700 1 -- 172.21.15.146:0/259231873 >> v2:172.21.15.151:3300/0 conn(0x7f2f280b2360 msgr2=0x7f2f2815acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:08.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.065+0000 7f2f2cdb7700 1 --2- 172.21.15.146:0/259231873 >> v2:172.21.15.151:3300/0 conn(0x7f2f280b2360 0x7f2f2815acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.065+0000 7f2f2cdb7700 1 -- 172.21.15.146:0/259231873 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f2815ba20 con 0x7f2f2815a7f0 2023-10-06T11:15:08.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.065+0000 7f2f2ddb9700 1 --2- 172.21.15.146:0/259231873 >> v2:172.21.15.151:3300/0 conn(0x7f2f280b2360 0x7f2f2815acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:08.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.065+0000 7f2f2cdb7700 1 --2- 172.21.15.146:0/259231873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f2815a7f0 0x7f2f280b1e20 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f2f28089860 tx=0x7f2f18009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=648028d0a1f02d1a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:08.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.065+0000 7f2f1ffff700 1 -- 172.21.15.146:0/259231873 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1800b820 con 0x7f2f2815a7f0 2023-10-06T11:15:08.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.065+0000 7f2f1ffff700 1 -- 172.21.15.146:0/259231873 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1800b980 con 0x7f2f2815a7f0 2023-10-06T11:15:08.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.065+0000 7f2f1ffff700 1 -- 172.21.15.146:0/259231873 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1800bd20 con 0x7f2f2815a7f0 2023-10-06T11:15:08.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.065+0000 7f2f2e5ba700 1 -- 172.21.15.146:0/259231873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f2815a7f0 msgr2=0x7f2f280b1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:08.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.065+0000 7f2f2e5ba700 1 --2- 172.21.15.146:0/259231873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f2815a7f0 0x7f2f280b1e20 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f2f28089860 tx=0x7f2f18009250 comp rx=0 tx=0).stop 2023-10-06T11:15:08.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.065+0000 7f2f2e5ba700 1 -- 172.21.15.146:0/259231873 shutdown_connections 2023-10-06T11:15:08.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.065+0000 7f2f2e5ba700 1 --2- 172.21.15.146:0/259231873 >> v2:172.21.15.151:3300/0 conn(0x7f2f280b2360 0x7f2f2815acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.065+0000 7f2f2e5ba700 1 --2- 172.21.15.146:0/259231873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2f2815a420 0x7f2f2815cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.065+0000 7f2f2e5ba700 1 --2- 172.21.15.146:0/259231873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f2815a7f0 0x7f2f280b1e20 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.065+0000 7f2f2e5ba700 1 -- 172.21.15.146:0/259231873 >> 172.21.15.146:0/259231873 conn(0x7f2f2806eba0 msgr2=0x7f2f2806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:08.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.066+0000 7f2f2e5ba700 1 -- 172.21.15.146:0/259231873 shutdown_connections 2023-10-06T11:15:08.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.066+0000 7f2f2e5ba700 1 -- 172.21.15.146:0/259231873 wait complete. 2023-10-06T11:15:08.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.067+0000 7f2f2e5ba700 1 Processor -- start 2023-10-06T11:15:08.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.067+0000 7f2f2e5ba700 1 -- start start 2023-10-06T11:15:08.072 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.067+0000 7f2f2e5ba700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f280b2360 0x7f2f2816ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:08.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.068+0000 7f2f2e5ba700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2f2815a420 0x7f2f2813b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:08.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.068+0000 7f2f2e5ba700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f2815a7f0 0x7f2f2814f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:08.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.068+0000 7f2f2e5ba700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f280c5f20 con 0x7f2f280b2360 2023-10-06T11:15:08.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.068+0000 7f2f2e5ba700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f280cb7c0 con 0x7f2f2815a7f0 2023-10-06T11:15:08.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.068+0000 7f2f2e5ba700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f280cbaa0 con 0x7f2f2815a420 2023-10-06T11:15:08.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.068+0000 7f2f2d5b8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f280b2360 0x7f2f2816ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:08.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.068+0000 7f2f2d5b8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f280b2360 0x7f2f2816ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58754/0 (socket says 172.21.15.146:58754) 2023-10-06T11:15:08.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.068+0000 7f2f2d5b8700 1 -- 172.21.15.146:0/307863956 learned_addr learned my addr 172.21.15.146:0/307863956 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:08.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.068+0000 7f2f2ddb9700 1 --2- 172.21.15.146:0/307863956 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f2815a7f0 0x7f2f2814f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:08.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.068+0000 7f2f2d5b8700 1 -- 172.21.15.146:0/307863956 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2f2815a420 msgr2=0x7f2f2813b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:08.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.068+0000 7f2f2cdb7700 1 --2- 172.21.15.146:0/307863956 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2f2815a420 0x7f2f2813b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:08.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.068+0000 7f2f2d5b8700 1 --2- 172.21.15.146:0/307863956 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2f2815a420 0x7f2f2813b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.068+0000 7f2f2d5b8700 1 -- 172.21.15.146:0/307863956 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f2815a7f0 msgr2=0x7f2f2814f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:08.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.068+0000 7f2f2d5b8700 1 --2- 172.21.15.146:0/307863956 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f2815a7f0 0x7f2f2814f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.068+0000 7f2f2d5b8700 1 -- 172.21.15.146:0/307863956 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f180094f0 con 0x7f2f280b2360 2023-10-06T11:15:08.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.068+0000 7f2f2d5b8700 1 --2- 172.21.15.146:0/307863956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f280b2360 0x7f2f2816ab30 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f2f2400d890 tx=0x7f2f24008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:08.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.068+0000 7f2f1d7fa700 1 -- 172.21.15.146:0/307863956 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2400b600 con 0x7f2f280b2360 2023-10-06T11:15:08.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.068+0000 7f2f1d7fa700 1 -- 172.21.15.146:0/307863956 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f2400b760 con 0x7f2f280b2360 2023-10-06T11:15:08.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.068+0000 7f2f1d7fa700 1 -- 172.21.15.146:0/307863956 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2400bae0 con 0x7f2f280b2360 2023-10-06T11:15:08.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.068+0000 7f2f2e5ba700 1 -- 172.21.15.146:0/307863956 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f280cbd80 con 0x7f2f280b2360 2023-10-06T11:15:08.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.068+0000 7f2f2e5ba700 1 -- 172.21.15.146:0/307863956 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f2813b790 con 0x7f2f280b2360 2023-10-06T11:15:08.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.069+0000 7f2f2e5ba700 1 -- 172.21.15.146:0/307863956 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f280afae0 con 0x7f2f280b2360 2023-10-06T11:15:08.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.070+0000 7f2f1d7fa700 1 -- 172.21.15.146:0/307863956 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2f2401e460 con 0x7f2f280b2360 2023-10-06T11:15:08.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.070+0000 7f2f1d7fa700 1 --2- 172.21.15.146:0/307863956 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2f0c066f30 0x7f2f0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:08.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.070+0000 7f2f1d7fa700 1 -- 172.21.15.146:0/307863956 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f2f240849f0 con 0x7f2f280b2360 2023-10-06T11:15:08.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.070+0000 7f2f2cdb7700 1 --2- 172.21.15.146:0/307863956 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2f0c066f30 0x7f2f0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:08.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.071+0000 7f2f2cdb7700 1 --2- 172.21.15.146:0/307863956 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2f0c066f30 0x7f2f0c0693e0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f2f28089860 tx=0x7f2f18017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:08.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.074+0000 7f2f1d7fa700 1 -- 172.21.15.146:0/307863956 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f24051e50 con 0x7f2f280b2360 2023-10-06T11:15:08.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.259+0000 7f2f2e5ba700 1 -- 172.21.15.146:0/307863956 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f2815bd00 con 0x7f2f280b2360 2023-10-06T11:15:08.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.260+0000 7f2f1d7fa700 1 -- 172.21.15.146:0/307863956 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v121) v1 ==== 74+0+13708 (secure 0 0 0) 0x7f2f24055470 con 0x7f2f280b2360 2023-10-06T11:15:08.261 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:15:08.262 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":121,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:15:07.513997+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:15:08.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.262+0000 7f2f2e5ba700 1 -- 172.21.15.146:0/307863956 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2f0c066f30 msgr2=0x7f2f0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:08.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.262+0000 7f2f2e5ba700 1 --2- 172.21.15.146:0/307863956 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2f0c066f30 0x7f2f0c0693e0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f2f28089860 tx=0x7f2f18017000 comp rx=0 tx=0).stop 2023-10-06T11:15:08.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.262+0000 7f2f2e5ba700 1 -- 172.21.15.146:0/307863956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f280b2360 msgr2=0x7f2f2816ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:08.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.262+0000 7f2f2e5ba700 1 --2- 172.21.15.146:0/307863956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f280b2360 0x7f2f2816ab30 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f2f2400d890 tx=0x7f2f24008040 comp rx=0 tx=0).stop 2023-10-06T11:15:08.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.262+0000 7f2f2e5ba700 1 -- 172.21.15.146:0/307863956 shutdown_connections 2023-10-06T11:15:08.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.262+0000 7f2f2e5ba700 1 --2- 172.21.15.146:0/307863956 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2f0c066f30 0x7f2f0c0693e0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.262+0000 7f2f2e5ba700 1 --2- 172.21.15.146:0/307863956 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f2815a7f0 0x7f2f2814f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.262+0000 7f2f2e5ba700 1 --2- 172.21.15.146:0/307863956 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f280b2360 0x7f2f2816ab30 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.262+0000 7f2f2e5ba700 1 --2- 172.21.15.146:0/307863956 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2f2815a420 0x7f2f2813b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.262+0000 7f2f2e5ba700 1 -- 172.21.15.146:0/307863956 >> 172.21.15.146:0/307863956 conn(0x7f2f2806eba0 msgr2=0x7f2f280cef30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:08.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.262+0000 7f2f2e5ba700 1 -- 172.21.15.146:0/307863956 shutdown_connections 2023-10-06T11:15:08.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.262+0000 7f2f2e5ba700 1 -- 172.21.15.146:0/307863956 wait complete. 2023-10-06T11:15:08.277 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:05:36.687307+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:05:37.171199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T11:15:08.277 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:15:08.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.394+0000 7f6dd9aba700 1 Processor -- start 2023-10-06T11:15:08.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.394+0000 7f6dd9aba700 1 -- start start 2023-10-06T11:15:08.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.395+0000 7f6dd9aba700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6dd415a160 0x7f6dd40c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:08.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.395+0000 7f6dd9aba700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6dd40ae730 0x7f6dd40aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:08.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.395+0000 7f6dd9aba700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd40ae2a0 con 0x7f6dd40ce3d0 2023-10-06T11:15:08.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.395+0000 7f6dd9aba700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd415a530 con 0x7f6dd40ae730 2023-10-06T11:15:08.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.395+0000 7f6dd9aba700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd40ad690 con 0x7f6dd415a160 2023-10-06T11:15:08.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.395+0000 7f6dd37fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6dd415a160 0x7f6dd40c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:08.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.395+0000 7f6dcaffd700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6dd40ae730 0x7f6dd40aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:08.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.395+0000 7f6dd37fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6dd415a160 0x7f6dd40c55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:38372/0 (socket says 172.21.15.146:38372) 2023-10-06T11:15:08.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.395+0000 7f6dd37fe700 1 -- 172.21.15.146:0/264118525 learned_addr learned my addr 172.21.15.146:0/264118525 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:08.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.395+0000 7f6dcaffd700 1 --2- 172.21.15.146:0/264118525 >> v2:172.21.15.151:3300/0 conn(0x7f6dd40ae730 0x7f6dd40aeb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:49058/0 (socket says 172.21.15.146:49058) 2023-10-06T11:15:08.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.395+0000 7f6dd2ffd700 1 -- 172.21.15.146:0/264118525 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2053800448 0 0) 0x7f6dd40ae2a0 con 0x7f6dd40ce3d0 2023-10-06T11:15:08.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.395+0000 7f6dd2ffd700 1 -- 172.21.15.146:0/264118525 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6dc0003570 con 0x7f6dd40ce3d0 2023-10-06T11:15:08.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.395+0000 7f6dd37fe700 1 -- 172.21.15.146:0/264118525 >> v2:172.21.15.151:3300/0 conn(0x7f6dd40ae730 msgr2=0x7f6dd40aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:08.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.395+0000 7f6dd37fe700 1 --2- 172.21.15.146:0/264118525 >> v2:172.21.15.151:3300/0 conn(0x7f6dd40ae730 0x7f6dd40aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.395+0000 7f6dd37fe700 1 -- 172.21.15.146:0/264118525 >> v1:172.21.15.151:6789/0 conn(0x7f6dd40ce3d0 legacy=0x7f6dd40ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:08.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.395+0000 7f6dd37fe700 1 -- 172.21.15.146:0/264118525 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd40ad970 con 0x7f6dd415a160 2023-10-06T11:15:08.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.395+0000 7f6dcaffd700 1 --2- 172.21.15.146:0/264118525 >> v2:172.21.15.151:3300/0 conn(0x7f6dd40ae730 0x7f6dd40aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:15:08.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.396+0000 7f6dd37fe700 1 --2- 172.21.15.146:0/264118525 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6dd415a160 0x7f6dd40c55a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4009990 tx=0x7f6dc4009220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=536c1734ed20307d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:08.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.396+0000 7f6dd2ffd700 1 -- 172.21.15.146:0/264118525 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc4005c10 con 0x7f6dd415a160 2023-10-06T11:15:08.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.396+0000 7f6dd2ffd700 1 -- 172.21.15.146:0/264118525 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc4005d70 con 0x7f6dd415a160 2023-10-06T11:15:08.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.396+0000 7f6dd2ffd700 1 -- 172.21.15.146:0/264118525 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc4006260 con 0x7f6dd415a160 2023-10-06T11:15:08.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.396+0000 7f6dd9aba700 1 -- 172.21.15.146:0/264118525 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6dd415a160 msgr2=0x7f6dd40c55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:08.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.396+0000 7f6dd9aba700 1 --2- 172.21.15.146:0/264118525 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6dd415a160 0x7f6dd40c55a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4009990 tx=0x7f6dc4009220 comp rx=0 tx=0).stop 2023-10-06T11:15:08.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.396+0000 7f6dd9aba700 1 -- 172.21.15.146:0/264118525 shutdown_connections 2023-10-06T11:15:08.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.396+0000 7f6dd9aba700 1 --2- 172.21.15.146:0/264118525 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6dd415a160 0x7f6dd40c55a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.396+0000 7f6dd9aba700 1 --2- 172.21.15.146:0/264118525 >> v2:172.21.15.151:3300/0 conn(0x7f6dd40ae730 0x7f6dd40aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.396+0000 7f6dd9aba700 1 -- 172.21.15.146:0/264118525 >> 172.21.15.146:0/264118525 conn(0x7f6dd406f380 msgr2=0x7f6dd40d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:08.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.396+0000 7f6dd9aba700 1 -- 172.21.15.146:0/264118525 shutdown_connections 2023-10-06T11:15:08.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.396+0000 7f6dd9aba700 1 -- 172.21.15.146:0/264118525 wait complete. 2023-10-06T11:15:08.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.397+0000 7f6dd9aba700 1 Processor -- start 2023-10-06T11:15:08.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.398+0000 7f6dd9aba700 1 -- start start 2023-10-06T11:15:08.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.398+0000 7f6dd9aba700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dd40ae730 0x7f6dd41506a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:08.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.398+0000 7f6dd9aba700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6dd40ce3d0 0x7f6dd40c9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:08.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.398+0000 7f6dd9aba700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6dd415a160 0x7f6dd40c6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:08.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.398+0000 7f6dd9aba700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd4154e20 con 0x7f6dd40ae730 2023-10-06T11:15:08.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.398+0000 7f6dd9aba700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd416a270 con 0x7f6dd40ce3d0 2023-10-06T11:15:08.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.398+0000 7f6dd9aba700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd4150be0 con 0x7f6dd415a160 2023-10-06T11:15:08.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.398+0000 7f6dd37fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dd40ae730 0x7f6dd41506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:08.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.398+0000 7f6dd37fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dd40ae730 0x7f6dd41506a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58756/0 (socket says 172.21.15.146:58756) 2023-10-06T11:15:08.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.398+0000 7f6dd37fe700 1 -- 172.21.15.146:0/2965373670 learned_addr learned my addr 172.21.15.146:0/2965373670 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:08.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.398+0000 7f6dcaffd700 1 --2- 172.21.15.146:0/2965373670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6dd40ce3d0 0x7f6dd40c9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:08.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.398+0000 7f6dd3fff700 1 --2- 172.21.15.146:0/2965373670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6dd415a160 0x7f6dd40c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:08.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.399+0000 7f6dd37fe700 1 -- 172.21.15.146:0/2965373670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6dd415a160 msgr2=0x7f6dd40c6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:08.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.399+0000 7f6dd37fe700 1 --2- 172.21.15.146:0/2965373670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6dd415a160 0x7f6dd40c6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.399+0000 7f6dd37fe700 1 -- 172.21.15.146:0/2965373670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6dd40ce3d0 msgr2=0x7f6dd40c9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:08.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.399+0000 7f6dd37fe700 1 --2- 172.21.15.146:0/2965373670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6dd40ce3d0 0x7f6dd40c9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.399+0000 7f6dd37fe700 1 -- 172.21.15.146:0/2965373670 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dbc009420 con 0x7f6dd40ae730 2023-10-06T11:15:08.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.399+0000 7f6dd37fe700 1 --2- 172.21.15.146:0/2965373670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dd40ae730 0x7f6dd41506a0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4009260 tx=0x7f6dc4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:08.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.399+0000 7f6dcbfff700 1 -- 172.21.15.146:0/2965373670 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc40119d0 con 0x7f6dd40ae730 2023-10-06T11:15:08.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.399+0000 7f6dd9aba700 1 -- 172.21.15.146:0/2965373670 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dc4009480 con 0x7f6dd40ae730 2023-10-06T11:15:08.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.399+0000 7f6dcbfff700 1 -- 172.21.15.146:0/2965373670 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc4011b50 con 0x7f6dd40ae730 2023-10-06T11:15:08.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.399+0000 7f6dcbfff700 1 -- 172.21.15.146:0/2965373670 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc401b430 con 0x7f6dd40ae730 2023-10-06T11:15:08.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.399+0000 7f6dd9aba700 1 -- 172.21.15.146:0/2965373670 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd4154580 con 0x7f6dd40ae730 2023-10-06T11:15:08.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.400+0000 7f6dd9aba700 1 -- 172.21.15.146:0/2965373670 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dd4068390 con 0x7f6dd40ae730 2023-10-06T11:15:08.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.400+0000 7f6dcbfff700 1 -- 172.21.15.146:0/2965373670 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6dc401b820 con 0x7f6dd40ae730 2023-10-06T11:15:08.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.401+0000 7f6dcbfff700 1 --2- 172.21.15.146:0/2965373670 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6db4066f60 0x7f6db4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:08.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.401+0000 7f6dcbfff700 1 -- 172.21.15.146:0/2965373670 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f6dc4085fb0 con 0x7f6dd40ae730 2023-10-06T11:15:08.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.401+0000 7f6dcaffd700 1 --2- 172.21.15.146:0/2965373670 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6db4066f60 0x7f6db4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:08.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.401+0000 7f6dcaffd700 1 --2- 172.21.15.146:0/2965373670 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6db4066f60 0x7f6db4069410 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f6dd40cbe30 tx=0x7f6dbc0091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:08.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.405+0000 7f6dcbfff700 1 -- 172.21.15.146:0/2965373670 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6dc40b75a0 con 0x7f6dd40ae730 2023-10-06T11:15:08.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.592+0000 7f6dd9aba700 1 -- 172.21.15.146:0/2965373670 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6dd404c380 con 0x7f6dd40ae730 2023-10-06T11:15:08.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.592+0000 7f6dcbfff700 1 -- 172.21.15.146:0/2965373670 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v121) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6dc4053410 con 0x7f6dd40ae730 2023-10-06T11:15:08.624 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-10-06T11:15:08.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.594+0000 7f6dd9aba700 1 -- 172.21.15.146:0/2965373670 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6db4066f60 msgr2=0x7f6db4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:08.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.594+0000 7f6dd9aba700 1 --2- 172.21.15.146:0/2965373670 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6db4066f60 0x7f6db4069410 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f6dd40cbe30 tx=0x7f6dbc0091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.594+0000 7f6dd9aba700 1 -- 172.21.15.146:0/2965373670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dd40ae730 msgr2=0x7f6dd41506a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:08.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.594+0000 7f6dd9aba700 1 --2- 172.21.15.146:0/2965373670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dd40ae730 0x7f6dd41506a0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f6dc4009260 tx=0x7f6dc4016000 comp rx=0 tx=0).stop 2023-10-06T11:15:08.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.594+0000 7f6dd9aba700 1 -- 172.21.15.146:0/2965373670 shutdown_connections 2023-10-06T11:15:08.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.594+0000 7f6dd9aba700 1 --2- 172.21.15.146:0/2965373670 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6db4066f60 0x7f6db4069410 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.594+0000 7f6dd9aba700 1 --2- 172.21.15.146:0/2965373670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6dd415a160 0x7f6dd40c6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.595+0000 7f6dd9aba700 1 --2- 172.21.15.146:0/2965373670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6dd40ae730 0x7f6dd41506a0 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.595+0000 7f6dd9aba700 1 --2- 172.21.15.146:0/2965373670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6dd40ce3d0 0x7f6dd40c9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.595+0000 7f6dd9aba700 1 -- 172.21.15.146:0/2965373670 >> 172.21.15.146:0/2965373670 conn(0x7f6dd406f380 msgr2=0x7f6dd40b55b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:08.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.595+0000 7f6dd9aba700 1 -- 172.21.15.146:0/2965373670 shutdown_connections 2023-10-06T11:15:08.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.595+0000 7f6dd9aba700 1 -- 172.21.15.146:0/2965373670 wait complete. 2023-10-06T11:15:08.627 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:15:08.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.743+0000 7fd54331c700 1 Processor -- start 2023-10-06T11:15:08.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.743+0000 7fd54331c700 1 -- start start 2023-10-06T11:15:08.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.744+0000 7fd54331c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd53c0c7810 0x7fd53c15e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:08.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.744+0000 7fd54331c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd53c15e5f0 0x7fd53c0cada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:08.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.744+0000 7fd54331c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd53c0d1670 con 0x7fd53c159f40 2023-10-06T11:15:08.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.744+0000 7fd54331c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd53c0cc4b0 con 0x7fd53c15e5f0 2023-10-06T11:15:08.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.744+0000 7fd54331c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c15a310 con 0x7fd53c0c7810 2023-10-06T11:15:08.748 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.744+0000 7fd5410b8700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd53c159f40 0x7fd53c15d9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40036/0 (socket says 172.21.15.146:40036) 2023-10-06T11:15:08.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.744+0000 7fd5410b8700 1 -- 172.21.15.146:0/1226338320 learned_addr learned my addr 172.21.15.146:0/1226338320 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:15:08.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.744+0000 7fd5418b9700 1 --2- 172.21.15.146:0/1226338320 >> v2:172.21.15.146:3300/0 conn(0x7fd53c15e5f0 0x7fd53c0cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:08.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.745+0000 7fd533fff700 1 -- 172.21.15.146:0/1226338320 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2503990017 0 0) 0x7fd53c0d1670 con 0x7fd53c159f40 2023-10-06T11:15:08.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.745+0000 7fd533fff700 1 -- 172.21.15.146:0/1226338320 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd528003570 con 0x7fd53c159f40 2023-10-06T11:15:08.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.745+0000 7fd5408b7700 1 --2- 172.21.15.146:0/1226338320 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd53c0c7810 0x7fd53c15e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:08.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.745+0000 7fd5418b9700 1 -- 172.21.15.146:0/1226338320 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd53c0c7810 msgr2=0x7fd53c15e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:08.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.745+0000 7fd5418b9700 1 --2- 172.21.15.146:0/1226338320 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd53c0c7810 0x7fd53c15e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.745+0000 7fd5418b9700 1 -- 172.21.15.146:0/1226338320 >> v1:172.21.15.146:6789/0 conn(0x7fd53c159f40 legacy=0x7fd53c15d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:08.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.745+0000 7fd5418b9700 1 -- 172.21.15.146:0/1226338320 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd53c0cee70 con 0x7fd53c15e5f0 2023-10-06T11:15:08.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.745+0000 7fd5418b9700 1 --2- 172.21.15.146:0/1226338320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd53c15e5f0 0x7fd53c0cada0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7fd534009910 tx=0x7fd5340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a443034bc62d3fb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:08.749 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.745+0000 7fd533fff700 1 -- 172.21.15.146:0/1226338320 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53400b640 con 0x7fd53c15e5f0 2023-10-06T11:15:08.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.745+0000 7fd533fff700 1 -- 172.21.15.146:0/1226338320 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53400b7a0 con 0x7fd53c15e5f0 2023-10-06T11:15:08.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.745+0000 7fd533fff700 1 -- 172.21.15.146:0/1226338320 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53400bb60 con 0x7fd53c15e5f0 2023-10-06T11:15:08.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.745+0000 7fd54331c700 1 -- 172.21.15.146:0/1226338320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd53c15e5f0 msgr2=0x7fd53c0cada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:08.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.745+0000 7fd54331c700 1 --2- 172.21.15.146:0/1226338320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd53c15e5f0 0x7fd53c0cada0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7fd534009910 tx=0x7fd5340091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.745+0000 7fd54331c700 1 -- 172.21.15.146:0/1226338320 shutdown_connections 2023-10-06T11:15:08.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.745+0000 7fd54331c700 1 --2- 172.21.15.146:0/1226338320 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd53c15e5f0 0x7fd53c0cada0 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.745+0000 7fd54331c700 1 --2- 172.21.15.146:0/1226338320 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd53c0c7810 0x7fd53c15e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.745+0000 7fd54331c700 1 -- 172.21.15.146:0/1226338320 >> 172.21.15.146:0/1226338320 conn(0x7fd53c06f380 msgr2=0x7fd53c0d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:08.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.746+0000 7fd54331c700 1 -- 172.21.15.146:0/1226338320 shutdown_connections 2023-10-06T11:15:08.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.746+0000 7fd54331c700 1 -- 172.21.15.146:0/1226338320 wait complete. 2023-10-06T11:15:08.750 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.747+0000 7fd54331c700 1 Processor -- start 2023-10-06T11:15:08.751 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.747+0000 7fd54331c700 1 -- start start 2023-10-06T11:15:08.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.747+0000 7fd54331c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd53c0c7810 0x7fd53c0c4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:08.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.747+0000 7fd54331c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd53c159f40 0x7fd53c15b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:08.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.747+0000 7fd54331c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd53c15e5f0 0x7fd53c15bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:08.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.747+0000 7fd54331c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c0c4c10 con 0x7fd53c0c7810 2023-10-06T11:15:08.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.747+0000 7fd54331c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c0c4ef0 con 0x7fd53c15e5f0 2023-10-06T11:15:08.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.747+0000 7fd54331c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c0c51d0 con 0x7fd53c159f40 2023-10-06T11:15:08.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.748+0000 7fd5410b8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd53c0c7810 0x7fd53c0c4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:08.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.748+0000 7fd5410b8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd53c0c7810 0x7fd53c0c4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58782/0 (socket says 172.21.15.146:58782) 2023-10-06T11:15:08.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.748+0000 7fd5410b8700 1 -- 172.21.15.146:0/1465608905 learned_addr learned my addr 172.21.15.146:0/1465608905 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:08.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.748+0000 7fd5418b9700 1 --2- 172.21.15.146:0/1465608905 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd53c15e5f0 0x7fd53c15bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:08.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.748+0000 7fd5408b7700 1 --2- 172.21.15.146:0/1465608905 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd53c159f40 0x7fd53c15b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:08.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.748+0000 7fd5410b8700 1 -- 172.21.15.146:0/1465608905 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd53c159f40 msgr2=0x7fd53c15b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:08.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.748+0000 7fd5410b8700 1 --2- 172.21.15.146:0/1465608905 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd53c159f40 0x7fd53c15b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.748+0000 7fd5410b8700 1 -- 172.21.15.146:0/1465608905 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd53c15e5f0 msgr2=0x7fd53c15bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:08.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.748+0000 7fd5410b8700 1 --2- 172.21.15.146:0/1465608905 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd53c15e5f0 0x7fd53c15bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.748+0000 7fd5410b8700 1 -- 172.21.15.146:0/1465608905 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd534009420 con 0x7fd53c0c7810 2023-10-06T11:15:08.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.748+0000 7fd5408b7700 1 --2- 172.21.15.146:0/1465608905 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd53c159f40 0x7fd53c15b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:08.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.748+0000 7fd5418b9700 1 --2- 172.21.15.146:0/1465608905 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd53c15e5f0 0x7fd53c15bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:08.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.748+0000 7fd5410b8700 1 --2- 172.21.15.146:0/1465608905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd53c0c7810 0x7fd53c0c4230 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fd53800cb10 tx=0x7fd5380027e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:08.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.748+0000 7fd5317fa700 1 -- 172.21.15.146:0/1465608905 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd538005d80 con 0x7fd53c0c7810 2023-10-06T11:15:08.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.748+0000 7fd5317fa700 1 -- 172.21.15.146:0/1465608905 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5380070f0 con 0x7fd53c0c7810 2023-10-06T11:15:08.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.748+0000 7fd5317fa700 1 -- 172.21.15.146:0/1465608905 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd538007470 con 0x7fd53c0c7810 2023-10-06T11:15:08.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.748+0000 7fd54331c700 1 -- 172.21.15.146:0/1465608905 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd53c0c54b0 con 0x7fd53c0c7810 2023-10-06T11:15:08.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.748+0000 7fd54331c700 1 -- 172.21.15.146:0/1465608905 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd53c157d90 con 0x7fd53c0c7810 2023-10-06T11:15:08.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.749+0000 7fd54331c700 1 -- 172.21.15.146:0/1465608905 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd53c0c59d0 con 0x7fd53c0c7810 2023-10-06T11:15:08.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.749+0000 7fd5317fa700 1 -- 172.21.15.146:0/1465608905 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd5380078a0 con 0x7fd53c0c7810 2023-10-06T11:15:08.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.750+0000 7fd5317fa700 1 --2- 172.21.15.146:0/1465608905 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd520066f30 0x7fd5200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:08.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.750+0000 7fd5317fa700 1 -- 172.21.15.146:0/1465608905 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fd538084220 con 0x7fd53c0c7810 2023-10-06T11:15:08.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.750+0000 7fd5408b7700 1 --2- 172.21.15.146:0/1465608905 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd520066f30 0x7fd5200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:08.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.750+0000 7fd5408b7700 1 --2- 172.21.15.146:0/1465608905 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd520066f30 0x7fd5200693e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fd52c00ab70 tx=0x7fd52c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:08.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.754+0000 7fd5317fa700 1 -- 172.21.15.146:0/1465608905 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd53c0c59d0 con 0x7fd53c0c7810 2023-10-06T11:15:08.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.938+0000 7fd54331c700 1 -- 172.21.15.146:0/1465608905 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd53c0c59d0 con 0x7fd53c0c7810 2023-10-06T11:15:08.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.939+0000 7fd5317fa700 1 -- 172.21.15.146:0/1465608905 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v121) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd53c0c59d0 con 0x7fd53c0c7810 2023-10-06T11:15:08.940 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-10-06T11:15:08.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.941+0000 7fd54331c700 1 -- 172.21.15.146:0/1465608905 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd520066f30 msgr2=0x7fd5200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:08.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.941+0000 7fd54331c700 1 --2- 172.21.15.146:0/1465608905 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd520066f30 0x7fd5200693e0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fd52c00ab70 tx=0x7fd52c008040 comp rx=0 tx=0).stop 2023-10-06T11:15:08.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.941+0000 7fd54331c700 1 -- 172.21.15.146:0/1465608905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd53c0c7810 msgr2=0x7fd53c0c4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:08.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.941+0000 7fd54331c700 1 --2- 172.21.15.146:0/1465608905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd53c0c7810 0x7fd53c0c4230 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fd53800cb10 tx=0x7fd5380027e0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.941+0000 7fd54331c700 1 -- 172.21.15.146:0/1465608905 shutdown_connections 2023-10-06T11:15:08.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.941+0000 7fd54331c700 1 --2- 172.21.15.146:0/1465608905 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd520066f30 0x7fd5200693e0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.941+0000 7fd54331c700 1 --2- 172.21.15.146:0/1465608905 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd53c15e5f0 0x7fd53c15bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.941+0000 7fd54331c700 1 --2- 172.21.15.146:0/1465608905 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd53c0c7810 0x7fd53c0c4230 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.941+0000 7fd54331c700 1 --2- 172.21.15.146:0/1465608905 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd53c159f40 0x7fd53c15b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:08.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.941+0000 7fd54331c700 1 -- 172.21.15.146:0/1465608905 >> 172.21.15.146:0/1465608905 conn(0x7fd53c06f380 msgr2=0x7fd53c0cf200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:08.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.941+0000 7fd54331c700 1 -- 172.21.15.146:0/1465608905 shutdown_connections 2023-10-06T11:15:08.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:08.941+0000 7fd54331c700 1 -- 172.21.15.146:0/1465608905 wait complete. 2023-10-06T11:15:08.955 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T11:15:09.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.069+0000 7fab48ed4700 1 Processor -- start 2023-10-06T11:15:09.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.069+0000 7fab48ed4700 1 -- start start 2023-10-06T11:15:09.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.070+0000 7fab48ed4700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fab4415a420 0x7fab4415cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:09.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.070+0000 7fab48ed4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fab4415a7f0 0x7fab440b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:09.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.070+0000 7fab48ed4700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab4415c630 con 0x7fab440b2360 2023-10-06T11:15:09.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.070+0000 7fab48ed4700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab440ce040 con 0x7fab4415a7f0 2023-10-06T11:15:09.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.070+0000 7fab48ed4700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab440b2780 con 0x7fab4415a420 2023-10-06T11:15:09.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.070+0000 7fab42ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fab4415a7f0 0x7fab440b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:09.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.070+0000 7fab43fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fab440b2360 0x7fab4415acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40040/0 (socket says 172.21.15.146:40040) 2023-10-06T11:15:09.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.070+0000 7fab43fff700 1 -- 172.21.15.146:0/3708361389 learned_addr learned my addr 172.21.15.146:0/3708361389 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:15:09.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.070+0000 7fab437fe700 1 --2- 172.21.15.146:0/3708361389 >> v2:172.21.15.151:3300/0 conn(0x7fab4415a420 0x7fab4415cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:09.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.070+0000 7fab42ffd700 1 -- 172.21.15.146:0/3708361389 >> v2:172.21.15.151:3300/0 conn(0x7fab4415a420 msgr2=0x7fab4415cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:09.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.071+0000 7fab42ffd700 1 --2- 172.21.15.146:0/3708361389 >> v2:172.21.15.151:3300/0 conn(0x7fab4415a420 0x7fab4415cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:09.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.071+0000 7fab42ffd700 1 -- 172.21.15.146:0/3708361389 >> v1:172.21.15.146:6789/0 conn(0x7fab440b2360 legacy=0x7fab4415acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:09.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.071+0000 7fab42ffd700 1 -- 172.21.15.146:0/3708361389 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4415ba20 con 0x7fab4415a7f0 2023-10-06T11:15:09.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.071+0000 7fab427fc700 1 -- 172.21.15.146:0/3708361389 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2389318929 0 0) 0x7fab4415c630 con 0x7fab440b2360 2023-10-06T11:15:09.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.071+0000 7fab437fe700 1 --2- 172.21.15.146:0/3708361389 >> v2:172.21.15.151:3300/0 conn(0x7fab4415a420 0x7fab4415cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:09.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.071+0000 7fab42ffd700 1 --2- 172.21.15.146:0/3708361389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab4415a7f0 0x7fab440b1e20 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fab440d1460 tx=0x7fab380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86b81ba6276045b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:09.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.071+0000 7fab427fc700 1 -- 172.21.15.146:0/3708361389 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3800b6b0 con 0x7fab4415a7f0 2023-10-06T11:15:09.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.071+0000 7fab427fc700 1 -- 172.21.15.146:0/3708361389 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab3800b810 con 0x7fab4415a7f0 2023-10-06T11:15:09.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.071+0000 7fab427fc700 1 -- 172.21.15.146:0/3708361389 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3800bbb0 con 0x7fab4415a7f0 2023-10-06T11:15:09.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.071+0000 7fab48ed4700 1 -- 172.21.15.146:0/3708361389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab4415a7f0 msgr2=0x7fab440b1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:09.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.071+0000 7fab48ed4700 1 --2- 172.21.15.146:0/3708361389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab4415a7f0 0x7fab440b1e20 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7fab440d1460 tx=0x7fab380091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:09.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.071+0000 7fab48ed4700 1 -- 172.21.15.146:0/3708361389 shutdown_connections 2023-10-06T11:15:09.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.071+0000 7fab48ed4700 1 --2- 172.21.15.146:0/3708361389 >> v2:172.21.15.151:3300/0 conn(0x7fab4415a420 0x7fab4415cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:09.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.071+0000 7fab48ed4700 1 --2- 172.21.15.146:0/3708361389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab4415a7f0 0x7fab440b1e20 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:09.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.071+0000 7fab48ed4700 1 -- 172.21.15.146:0/3708361389 >> 172.21.15.146:0/3708361389 conn(0x7fab4406eba0 msgr2=0x7fab4406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:09.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.071+0000 7fab48ed4700 1 -- 172.21.15.146:0/3708361389 shutdown_connections 2023-10-06T11:15:09.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.071+0000 7fab48ed4700 1 -- 172.21.15.146:0/3708361389 wait complete. 2023-10-06T11:15:09.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.073+0000 7fab48ed4700 1 Processor -- start 2023-10-06T11:15:09.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.073+0000 7fab48ed4700 1 -- start start 2023-10-06T11:15:09.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.073+0000 7fab48ed4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab440b2360 0x7fab4413ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:09.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.073+0000 7fab48ed4700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fab4415a420 0x7fab4414f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:09.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.073+0000 7fab48ed4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab4415a7f0 0x7fab4414fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:09.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.073+0000 7fab48ed4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab44169f50 con 0x7fab440b2360 2023-10-06T11:15:09.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.073+0000 7fab48ed4700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4416a230 con 0x7fab4415a7f0 2023-10-06T11:15:09.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.073+0000 7fab48ed4700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab4416a510 con 0x7fab4415a420 2023-10-06T11:15:09.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.073+0000 7fab437fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab440b2360 0x7fab4413ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:09.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.073+0000 7fab437fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab440b2360 0x7fab4413ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58800/0 (socket says 172.21.15.146:58800) 2023-10-06T11:15:09.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.073+0000 7fab437fe700 1 -- 172.21.15.146:0/131599512 learned_addr learned my addr 172.21.15.146:0/131599512 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:09.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.074+0000 7fab43fff700 1 --2- 172.21.15.146:0/131599512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab4415a7f0 0x7fab4414fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:09.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.074+0000 7fab42ffd700 1 --2- 172.21.15.146:0/131599512 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fab4415a420 0x7fab4414f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:09.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.074+0000 7fab437fe700 1 -- 172.21.15.146:0/131599512 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fab4415a420 msgr2=0x7fab4414f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:09.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.074+0000 7fab437fe700 1 --2- 172.21.15.146:0/131599512 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fab4415a420 0x7fab4414f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:09.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.074+0000 7fab437fe700 1 -- 172.21.15.146:0/131599512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab4415a7f0 msgr2=0x7fab4414fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:09.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.074+0000 7fab437fe700 1 --2- 172.21.15.146:0/131599512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab4415a7f0 0x7fab4414fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:09.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.074+0000 7fab437fe700 1 -- 172.21.15.146:0/131599512 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab38009420 con 0x7fab440b2360 2023-10-06T11:15:09.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.074+0000 7fab437fe700 1 --2- 172.21.15.146:0/131599512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab440b2360 0x7fab4413ede0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fab3400a400 tx=0x7fab34007910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:09.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.074+0000 7fab2b7fe700 1 -- 172.21.15.146:0/131599512 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab34015440 con 0x7fab440b2360 2023-10-06T11:15:09.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.074+0000 7fab2b7fe700 1 -- 172.21.15.146:0/131599512 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab340155a0 con 0x7fab440b2360 2023-10-06T11:15:09.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.074+0000 7fab48ed4700 1 -- 172.21.15.146:0/131599512 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab4416a7f0 con 0x7fab440b2360 2023-10-06T11:15:09.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.074+0000 7fab2b7fe700 1 -- 172.21.15.146:0/131599512 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab34015940 con 0x7fab440b2360 2023-10-06T11:15:09.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.074+0000 7fab48ed4700 1 -- 172.21.15.146:0/131599512 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab44169bd0 con 0x7fab440b2360 2023-10-06T11:15:09.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.075+0000 7fab48ed4700 1 -- 172.21.15.146:0/131599512 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab440afae0 con 0x7fab440b2360 2023-10-06T11:15:09.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.075+0000 7fab2b7fe700 1 -- 172.21.15.146:0/131599512 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fab34015cf0 con 0x7fab440b2360 2023-10-06T11:15:09.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.076+0000 7fab2b7fe700 1 --2- 172.21.15.146:0/131599512 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fab30066f30 0x7fab300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:09.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.076+0000 7fab2b7fe700 1 -- 172.21.15.146:0/131599512 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fab34084ac0 con 0x7fab440b2360 2023-10-06T11:15:09.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.076+0000 7fab42ffd700 1 --2- 172.21.15.146:0/131599512 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fab30066f30 0x7fab300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:09.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.076+0000 7fab42ffd700 1 --2- 172.21.15.146:0/131599512 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fab30066f30 0x7fab300693e0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fab380093f0 tx=0x7fab38017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:09.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.080+0000 7fab2b7fe700 1 -- 172.21.15.146:0/131599512 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fab3404e5a0 con 0x7fab440b2360 2023-10-06T11:15:09.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.265+0000 7fab48ed4700 1 -- 172.21.15.146:0/131599512 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fab4415bd00 con 0x7fab440b2360 2023-10-06T11:15:09.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.266+0000 7fab2b7fe700 1 -- 172.21.15.146:0/131599512 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v121) v1 ==== 84+0+126 (secure 0 0 0) 0x7fab3401a090 con 0x7fab440b2360 2023-10-06T11:15:09.267 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:15:09.268 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2023-10-06T11:15:09.268 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:15:09.268 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 1, 2023-10-06T11:15:09.268 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": "rbd" 2023-10-06T11:15:09.268 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:15:09.268 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:15:09.268 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 2, 2023-10-06T11:15:09.268 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": ".mgr" 2023-10-06T11:15:09.268 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:15:09.268 INFO:teuthology.orchestra.run.smithi146.stdout:] 2023-10-06T11:15:09.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.268+0000 7fab48ed4700 1 -- 172.21.15.146:0/131599512 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fab30066f30 msgr2=0x7fab300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:09.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.268+0000 7fab48ed4700 1 --2- 172.21.15.146:0/131599512 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fab30066f30 0x7fab300693e0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fab380093f0 tx=0x7fab38017000 comp rx=0 tx=0).stop 2023-10-06T11:15:09.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.268+0000 7fab48ed4700 1 -- 172.21.15.146:0/131599512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab440b2360 msgr2=0x7fab4413ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:09.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.268+0000 7fab48ed4700 1 --2- 172.21.15.146:0/131599512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab440b2360 0x7fab4413ede0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fab3400a400 tx=0x7fab34007910 comp rx=0 tx=0).stop 2023-10-06T11:15:09.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.268+0000 7fab48ed4700 1 -- 172.21.15.146:0/131599512 shutdown_connections 2023-10-06T11:15:09.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.268+0000 7fab48ed4700 1 --2- 172.21.15.146:0/131599512 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fab30066f30 0x7fab300693e0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:09.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.268+0000 7fab48ed4700 1 --2- 172.21.15.146:0/131599512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab4415a7f0 0x7fab4414fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:09.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.268+0000 7fab48ed4700 1 --2- 172.21.15.146:0/131599512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fab440b2360 0x7fab4413ede0 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:09.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.268+0000 7fab48ed4700 1 --2- 172.21.15.146:0/131599512 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fab4415a420 0x7fab4414f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:09.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.268+0000 7fab48ed4700 1 -- 172.21.15.146:0/131599512 >> 172.21.15.146:0/131599512 conn(0x7fab4406eba0 msgr2=0x7fab4415abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:09.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.268+0000 7fab48ed4700 1 -- 172.21.15.146:0/131599512 shutdown_connections 2023-10-06T11:15:09.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.268+0000 7fab48ed4700 1 -- 172.21.15.146:0/131599512 wait complete. 2023-10-06T11:15:09.282 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T11:15:09.282 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T11:15:09.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.400+0000 7fa5d2fac700 1 Processor -- start 2023-10-06T11:15:09.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.400+0000 7fa5d2fac700 1 -- start start 2023-10-06T11:15:09.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.401+0000 7fa5d2fac700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa5cc0c83c0 0x7fa5cc0c8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:09.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.401+0000 7fa5d2fac700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa5cc0adc70 0x7fa5cc0b0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:09.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.401+0000 7fa5d2fac700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5cc0c9900 con 0x7fa5cc0acd50 2023-10-06T11:15:09.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.401+0000 7fa5d2fac700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5cc0ae7a0 con 0x7fa5cc0adc70 2023-10-06T11:15:09.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.401+0000 7fa5d2fac700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5cc0ae1e0 con 0x7fa5cc0c83c0 2023-10-06T11:15:09.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.401+0000 7fa5cbfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa5cc0adc70 0x7fa5cc0b0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:09.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.401+0000 7fa5cbfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa5cc0adc70 0x7fa5cc0b0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58804/0 (socket says 172.21.15.146:58804) 2023-10-06T11:15:09.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.401+0000 7fa5cbfff700 1 -- 172.21.15.146:0/1533861456 learned_addr learned my addr 172.21.15.146:0/1533861456 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:09.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.401+0000 7fa5d0d48700 1 --2- 172.21.15.146:0/1533861456 >> v2:172.21.15.151:3300/0 conn(0x7fa5cc0c83c0 0x7fa5cc0c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:09.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.401+0000 7fa5cbfff700 1 -- 172.21.15.146:0/1533861456 >> v2:172.21.15.151:3300/0 conn(0x7fa5cc0c83c0 msgr2=0x7fa5cc0c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:09.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.401+0000 7fa5cbfff700 1 --2- 172.21.15.146:0/1533861456 >> v2:172.21.15.151:3300/0 conn(0x7fa5cc0c83c0 0x7fa5cc0c8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:09.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.401+0000 7fa5cbfff700 1 -- 172.21.15.146:0/1533861456 >> v1:172.21.15.151:6789/0 conn(0x7fa5cc0acd50 legacy=0x7fa5cc0aefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:09.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.401+0000 7fa5cbfff700 1 -- 172.21.15.146:0/1533861456 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5cc0ae4c0 con 0x7fa5cc0adc70 2023-10-06T11:15:09.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.401+0000 7fa5d0d48700 1 --2- 172.21.15.146:0/1533861456 >> v2:172.21.15.151:3300/0 conn(0x7fa5cc0c83c0 0x7fa5cc0c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:09.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.401+0000 7fa5cbfff700 1 --2- 172.21.15.146:0/1533861456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5cc0adc70 0x7fa5cc0b0860 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc0ae9c0 tx=0x7fa5b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2596f8489eb18850 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:09.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.401+0000 7fa5cb7fe700 1 -- 172.21.15.146:0/1533861456 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b800b860 con 0x7fa5cc0adc70 2023-10-06T11:15:09.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.402+0000 7fa5cb7fe700 1 -- 172.21.15.146:0/1533861456 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b800b9c0 con 0x7fa5cc0adc70 2023-10-06T11:15:09.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.402+0000 7fa5cb7fe700 1 -- 172.21.15.146:0/1533861456 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b800bd60 con 0x7fa5cc0adc70 2023-10-06T11:15:09.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.402+0000 7fa5d2fac700 1 -- 172.21.15.146:0/1533861456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5cc0adc70 msgr2=0x7fa5cc0b0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:09.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.402+0000 7fa5d2fac700 1 --2- 172.21.15.146:0/1533861456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5cc0adc70 0x7fa5cc0b0860 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc0ae9c0 tx=0x7fa5b8009250 comp rx=0 tx=0).stop 2023-10-06T11:15:09.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.402+0000 7fa5d2fac700 1 -- 172.21.15.146:0/1533861456 shutdown_connections 2023-10-06T11:15:09.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.402+0000 7fa5d2fac700 1 --2- 172.21.15.146:0/1533861456 >> v2:172.21.15.151:3300/0 conn(0x7fa5cc0c83c0 0x7fa5cc0c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:09.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.402+0000 7fa5d2fac700 1 --2- 172.21.15.146:0/1533861456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5cc0adc70 0x7fa5cc0b0860 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:09.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.402+0000 7fa5d2fac700 1 -- 172.21.15.146:0/1533861456 >> 172.21.15.146:0/1533861456 conn(0x7fa5cc06a070 msgr2=0x7fa5cc067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:09.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.402+0000 7fa5d2fac700 1 -- 172.21.15.146:0/1533861456 shutdown_connections 2023-10-06T11:15:09.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.402+0000 7fa5d2fac700 1 -- 172.21.15.146:0/1533861456 wait complete. 2023-10-06T11:15:09.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.403+0000 7fa5d2fac700 1 Processor -- start 2023-10-06T11:15:09.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.403+0000 7fa5d2fac700 1 -- start start 2023-10-06T11:15:09.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.404+0000 7fa5d2fac700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5cc0acd50 0x7fa5cc15cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:09.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.404+0000 7fa5d2fac700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5cc0adc70 0x7fa5cc0c7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:09.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.404+0000 7fa5d2fac700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5cc0c83c0 0x7fa5cc0c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:09.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.404+0000 7fa5d2fac700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5cc15ba10 con 0x7fa5cc0acd50 2023-10-06T11:15:09.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.404+0000 7fa5d2fac700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5cc15bcf0 con 0x7fa5cc0c83c0 2023-10-06T11:15:09.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.404+0000 7fa5d2fac700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5cc15bfd0 con 0x7fa5cc0adc70 2023-10-06T11:15:09.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.404+0000 7fa5d0d48700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5cc0acd50 0x7fa5cc15cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:09.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.404+0000 7fa5d0d48700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5cc0acd50 0x7fa5cc15cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58808/0 (socket says 172.21.15.146:58808) 2023-10-06T11:15:09.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.404+0000 7fa5d0d48700 1 -- 172.21.15.146:0/755407953 learned_addr learned my addr 172.21.15.146:0/755407953 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:09.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.404+0000 7fa5cbfff700 1 --2- 172.21.15.146:0/755407953 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5cc0adc70 0x7fa5cc0c7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:09.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.404+0000 7fa5d1549700 1 --2- 172.21.15.146:0/755407953 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5cc0c83c0 0x7fa5cc0c7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:09.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.404+0000 7fa5d0d48700 1 -- 172.21.15.146:0/755407953 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5cc0adc70 msgr2=0x7fa5cc0c7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:09.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.404+0000 7fa5d0d48700 1 --2- 172.21.15.146:0/755407953 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5cc0adc70 0x7fa5cc0c7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:09.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.404+0000 7fa5d0d48700 1 -- 172.21.15.146:0/755407953 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5cc0c83c0 msgr2=0x7fa5cc0c7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:09.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.404+0000 7fa5d0d48700 1 --2- 172.21.15.146:0/755407953 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5cc0c83c0 0x7fa5cc0c7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:09.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.404+0000 7fa5d0d48700 1 -- 172.21.15.146:0/755407953 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b80094f0 con 0x7fa5cc0acd50 2023-10-06T11:15:09.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.404+0000 7fa5d1549700 1 --2- 172.21.15.146:0/755407953 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5cc0c83c0 0x7fa5cc0c7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:09.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.405+0000 7fa5d0d48700 1 --2- 172.21.15.146:0/755407953 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5cc0acd50 0x7fa5cc15cab0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fa5c000e8d0 tx=0x7fa5c0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:09.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.405+0000 7fa5c8ff9700 1 -- 172.21.15.146:0/755407953 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c000ee70 con 0x7fa5cc0acd50 2023-10-06T11:15:09.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.405+0000 7fa5c8ff9700 1 -- 172.21.15.146:0/755407953 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5c000c5e0 con 0x7fa5cc0acd50 2023-10-06T11:15:09.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.405+0000 7fa5d2fac700 1 -- 172.21.15.146:0/755407953 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5cc15c2b0 con 0x7fa5cc0acd50 2023-10-06T11:15:09.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.405+0000 7fa5c8ff9700 1 -- 172.21.15.146:0/755407953 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c000c980 con 0x7fa5cc0acd50 2023-10-06T11:15:09.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.405+0000 7fa5d2fac700 1 -- 172.21.15.146:0/755407953 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5cc15b4e0 con 0x7fa5cc0acd50 2023-10-06T11:15:09.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.406+0000 7fa5d2fac700 1 -- 172.21.15.146:0/755407953 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5cc15c900 con 0x7fa5cc0acd50 2023-10-06T11:15:09.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.407+0000 7fa5c8ff9700 1 -- 172.21.15.146:0/755407953 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa5c0025430 con 0x7fa5cc0acd50 2023-10-06T11:15:09.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.407+0000 7fa5c8ff9700 1 --2- 172.21.15.146:0/755407953 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa5b0066f30 0x7fa5b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:09.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.407+0000 7fa5c8ff9700 1 -- 172.21.15.146:0/755407953 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fa5c0084540 con 0x7fa5cc0acd50 2023-10-06T11:15:09.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.407+0000 7fa5cbfff700 1 --2- 172.21.15.146:0/755407953 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa5b0066f30 0x7fa5b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:09.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.408+0000 7fa5cbfff700 1 --2- 172.21.15.146:0/755407953 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa5b0066f30 0x7fa5b00693e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc0ae9c0 tx=0x7fa5b8017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:09.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.410+0000 7fa5c8ff9700 1 -- 172.21.15.146:0/755407953 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa5c00554b0 con 0x7fa5cc0acd50 2023-10-06T11:15:09.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:09.595+0000 7fa5d2fac700 1 -- 172.21.15.146:0/755407953 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa5cc15b790 con 0x7fa5cc0acd50 2023-10-06T11:15:10.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.533+0000 7fa5c8ff9700 1 -- 172.21.15.146:0/755407953 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v122) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa5c00200b0 con 0x7fa5cc0acd50 2023-10-06T11:15:10.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.537+0000 7fa5d2fac700 1 -- 172.21.15.146:0/755407953 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa5b0066f30 msgr2=0x7fa5b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:10.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.537+0000 7fa5d2fac700 1 --2- 172.21.15.146:0/755407953 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa5b0066f30 0x7fa5b00693e0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc0ae9c0 tx=0x7fa5b8017000 comp rx=0 tx=0).stop 2023-10-06T11:15:10.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.537+0000 7fa5d2fac700 1 -- 172.21.15.146:0/755407953 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5cc0acd50 msgr2=0x7fa5cc15cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:10.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.537+0000 7fa5d2fac700 1 --2- 172.21.15.146:0/755407953 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5cc0acd50 0x7fa5cc15cab0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fa5c000e8d0 tx=0x7fa5c0008040 comp rx=0 tx=0).stop 2023-10-06T11:15:10.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.537+0000 7fa5d2fac700 1 -- 172.21.15.146:0/755407953 shutdown_connections 2023-10-06T11:15:10.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.537+0000 7fa5d2fac700 1 --2- 172.21.15.146:0/755407953 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa5b0066f30 0x7fa5b00693e0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:10.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.537+0000 7fa5d2fac700 1 --2- 172.21.15.146:0/755407953 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5cc0c83c0 0x7fa5cc0c7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:10.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.537+0000 7fa5d2fac700 1 --2- 172.21.15.146:0/755407953 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5cc0acd50 0x7fa5cc15cab0 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:10.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.537+0000 7fa5d2fac700 1 --2- 172.21.15.146:0/755407953 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5cc0adc70 0x7fa5cc0c7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:10.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.537+0000 7fa5d2fac700 1 -- 172.21.15.146:0/755407953 >> 172.21.15.146:0/755407953 conn(0x7fa5cc06a070 msgr2=0x7fa5cc0cc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:10.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.538+0000 7fa5d2fac700 1 -- 172.21.15.146:0/755407953 shutdown_connections 2023-10-06T11:15:10.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.538+0000 7fa5d2fac700 1 -- 172.21.15.146:0/755407953 wait complete. 2023-10-06T11:15:10.540 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' created 2023-10-06T11:15:10.554 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T11:15:10.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.677+0000 7f1529d5e700 1 Processor -- start 2023-10-06T11:15:10.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.677+0000 7f1529d5e700 1 -- start start 2023-10-06T11:15:10.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.678+0000 7f1529d5e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1524157530 0x7f15240ceb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:10.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.678+0000 7f1529d5e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1524157900 0x7f15240b1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:10.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.678+0000 7f1529d5e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1524068050 0x7f15240adc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:10.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.678+0000 7f1529d5e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15240abfd0 con 0x7f1524068050 2023-10-06T11:15:10.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.678+0000 7f1529d5e700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15240ac870 con 0x7f1524157900 2023-10-06T11:15:10.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.678+0000 7f1529d5e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15240b4290 con 0x7f1524157530 2023-10-06T11:15:10.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.678+0000 7f1523fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1524068050 0x7f15240adc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:10.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.678+0000 7f1523fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1524068050 0x7f15240adc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58822/0 (socket says 172.21.15.146:58822) 2023-10-06T11:15:10.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.678+0000 7f1523fff700 1 -- 172.21.15.146:0/23295655 learned_addr learned my addr 172.21.15.146:0/23295655 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:10.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.679+0000 7f15237fe700 1 --2- 172.21.15.146:0/23295655 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1524157530 0x7f15240ceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:10.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.679+0000 7f1522ffd700 1 --2- 172.21.15.146:0/23295655 >> v2:172.21.15.151:3300/0 conn(0x7f1524157900 0x7f15240b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:10.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.679+0000 7f1523fff700 1 -- 172.21.15.146:0/23295655 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1524157530 msgr2=0x7f15240ceb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:10.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.679+0000 7f1523fff700 1 --2- 172.21.15.146:0/23295655 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1524157530 0x7f15240ceb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:10.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.679+0000 7f1523fff700 1 -- 172.21.15.146:0/23295655 >> v2:172.21.15.151:3300/0 conn(0x7f1524157900 msgr2=0x7f15240b1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:10.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.679+0000 7f1523fff700 1 --2- 172.21.15.146:0/23295655 >> v2:172.21.15.151:3300/0 conn(0x7f1524157900 0x7f15240b1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:10.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.679+0000 7f1523fff700 1 -- 172.21.15.146:0/23295655 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15240b1970 con 0x7f1524068050 2023-10-06T11:15:10.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.679+0000 7f1523fff700 1 --2- 172.21.15.146:0/23295655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1524068050 0x7f15240adc70 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f152406eec0 tx=0x7f151c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24240897e2d0aaa9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:10.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.679+0000 7f15227fc700 1 -- 172.21.15.146:0/23295655 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c00b860 con 0x7f1524068050 2023-10-06T11:15:10.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.679+0000 7f15227fc700 1 -- 172.21.15.146:0/23295655 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151c00b9c0 con 0x7f1524068050 2023-10-06T11:15:10.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.679+0000 7f15227fc700 1 -- 172.21.15.146:0/23295655 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c00bd60 con 0x7f1524068050 2023-10-06T11:15:10.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.679+0000 7f1529d5e700 1 -- 172.21.15.146:0/23295655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1524068050 msgr2=0x7f15240adc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:10.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.679+0000 7f1529d5e700 1 --2- 172.21.15.146:0/23295655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1524068050 0x7f15240adc70 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f152406eec0 tx=0x7f151c009250 comp rx=0 tx=0).stop 2023-10-06T11:15:10.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.680+0000 7f1529d5e700 1 -- 172.21.15.146:0/23295655 shutdown_connections 2023-10-06T11:15:10.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.680+0000 7f1529d5e700 1 --2- 172.21.15.146:0/23295655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1524068050 0x7f15240adc70 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:10.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.680+0000 7f1529d5e700 1 --2- 172.21.15.146:0/23295655 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1524157530 0x7f15240ceb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:10.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.680+0000 7f1529d5e700 1 --2- 172.21.15.146:0/23295655 >> v2:172.21.15.151:3300/0 conn(0x7f1524157900 0x7f15240b1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:10.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.680+0000 7f1529d5e700 1 -- 172.21.15.146:0/23295655 >> 172.21.15.146:0/23295655 conn(0x7f1524067c50 msgr2=0x7f15240ce430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:10.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.680+0000 7f1529d5e700 1 -- 172.21.15.146:0/23295655 shutdown_connections 2023-10-06T11:15:10.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.680+0000 7f1529d5e700 1 -- 172.21.15.146:0/23295655 wait complete. 2023-10-06T11:15:10.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.681+0000 7f1529d5e700 1 Processor -- start 2023-10-06T11:15:10.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.681+0000 7f1529d5e700 1 -- start start 2023-10-06T11:15:10.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.682+0000 7f1529d5e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1524068050 0x7f152415a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:10.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.682+0000 7f1529d5e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1524157530 0x7f15241591f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:10.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.682+0000 7f1529d5e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1524157900 0x7f1524068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:10.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.682+0000 7f1529d5e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1524156dc0 con 0x7f1524068050 2023-10-06T11:15:10.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.682+0000 7f1529d5e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1524158430 con 0x7f1524157900 2023-10-06T11:15:10.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.682+0000 7f1529d5e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1524158710 con 0x7f1524157530 2023-10-06T11:15:10.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.682+0000 7f15237fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1524068050 0x7f152415a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:10.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.682+0000 7f15237fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1524068050 0x7f152415a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58832/0 (socket says 172.21.15.146:58832) 2023-10-06T11:15:10.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.682+0000 7f15237fe700 1 -- 172.21.15.146:0/314421707 learned_addr learned my addr 172.21.15.146:0/314421707 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:10.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.682+0000 7f1522ffd700 1 --2- 172.21.15.146:0/314421707 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1524157530 0x7f15241591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:10.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.682+0000 7f1523fff700 1 --2- 172.21.15.146:0/314421707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1524157900 0x7f1524068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:10.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.682+0000 7f15237fe700 1 -- 172.21.15.146:0/314421707 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1524157530 msgr2=0x7f15241591f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:10.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.682+0000 7f15237fe700 1 --2- 172.21.15.146:0/314421707 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1524157530 0x7f15241591f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:10.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.682+0000 7f15237fe700 1 -- 172.21.15.146:0/314421707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1524157900 msgr2=0x7f1524068580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:10.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.682+0000 7f15237fe700 1 --2- 172.21.15.146:0/314421707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1524157900 0x7f1524068580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:10.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.682+0000 7f15237fe700 1 -- 172.21.15.146:0/314421707 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f151c0094f0 con 0x7f1524068050 2023-10-06T11:15:10.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.682+0000 7f1522ffd700 1 --2- 172.21.15.146:0/314421707 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1524157530 0x7f15241591f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:10.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.682+0000 7f1523fff700 1 --2- 172.21.15.146:0/314421707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1524157900 0x7f1524068580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:10.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.682+0000 7f15237fe700 1 --2- 172.21.15.146:0/314421707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1524068050 0x7f152415a460 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f151400e190 tx=0x7f1514009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:10.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.682+0000 7f150b7fe700 1 -- 172.21.15.146:0/314421707 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151400ee30 con 0x7f1524068050 2023-10-06T11:15:10.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.682+0000 7f150b7fe700 1 -- 172.21.15.146:0/314421707 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1514014420 con 0x7f1524068050 2023-10-06T11:15:10.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.682+0000 7f1529d5e700 1 -- 172.21.15.146:0/314421707 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15241589f0 con 0x7f1524068050 2023-10-06T11:15:10.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.682+0000 7f150b7fe700 1 -- 172.21.15.146:0/314421707 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15140147e0 con 0x7f1524068050 2023-10-06T11:15:10.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.682+0000 7f1529d5e700 1 -- 172.21.15.146:0/314421707 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f152415a9a0 con 0x7f1524068050 2023-10-06T11:15:10.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.683+0000 7f1529d5e700 1 -- 172.21.15.146:0/314421707 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1524158e90 con 0x7f1524068050 2023-10-06T11:15:10.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.684+0000 7f150b7fe700 1 -- 172.21.15.146:0/314421707 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1514014b90 con 0x7f1524068050 2023-10-06T11:15:10.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.684+0000 7f150b7fe700 1 --2- 172.21.15.146:0/314421707 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1510066f30 0x7f15100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:10.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.684+0000 7f150b7fe700 1 -- 172.21.15.146:0/314421707 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f1514084d10 con 0x7f1524068050 2023-10-06T11:15:10.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.684+0000 7f1522ffd700 1 --2- 172.21.15.146:0/314421707 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1510066f30 0x7f15100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:10.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.684+0000 7f1522ffd700 1 --2- 172.21.15.146:0/314421707 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1510066f30 0x7f15100693e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f152416e5b0 tx=0x7f1518008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:10.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.689+0000 7f150b7fe700 1 -- 172.21.15.146:0/314421707 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1514052000 con 0x7f1524068050 2023-10-06T11:15:10.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:10.870+0000 7f1529d5e700 1 -- 172.21.15.146:0/314421707 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f152415ab90 con 0x7f1524068050 2023-10-06T11:15:11.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.539+0000 7f150b7fe700 1 -- 172.21.15.146:0/314421707 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v123) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1514009a60 con 0x7f1524068050 2023-10-06T11:15:11.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.543+0000 7f1529d5e700 1 -- 172.21.15.146:0/314421707 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1510066f30 msgr2=0x7f15100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:11.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.543+0000 7f1529d5e700 1 --2- 172.21.15.146:0/314421707 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1510066f30 0x7f15100693e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f152416e5b0 tx=0x7f1518008040 comp rx=0 tx=0).stop 2023-10-06T11:15:11.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.543+0000 7f1529d5e700 1 -- 172.21.15.146:0/314421707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1524068050 msgr2=0x7f152415a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:11.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.543+0000 7f1529d5e700 1 --2- 172.21.15.146:0/314421707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1524068050 0x7f152415a460 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f151400e190 tx=0x7f1514009920 comp rx=0 tx=0).stop 2023-10-06T11:15:11.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.543+0000 7f1529d5e700 1 -- 172.21.15.146:0/314421707 shutdown_connections 2023-10-06T11:15:11.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.543+0000 7f1529d5e700 1 --2- 172.21.15.146:0/314421707 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1510066f30 0x7f15100693e0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:11.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.543+0000 7f1529d5e700 1 --2- 172.21.15.146:0/314421707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1524157900 0x7f1524068580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:11.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.543+0000 7f1529d5e700 1 --2- 172.21.15.146:0/314421707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1524068050 0x7f152415a460 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:11.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.543+0000 7f1529d5e700 1 --2- 172.21.15.146:0/314421707 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1524157530 0x7f15241591f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:11.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.543+0000 7f1529d5e700 1 -- 172.21.15.146:0/314421707 >> 172.21.15.146:0/314421707 conn(0x7f1524067c50 msgr2=0x7f1524151eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:11.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.543+0000 7f1529d5e700 1 -- 172.21.15.146:0/314421707 shutdown_connections 2023-10-06T11:15:11.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.543+0000 7f1529d5e700 1 -- 172.21.15.146:0/314421707 wait complete. 2023-10-06T11:15:11.548 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' created 2023-10-06T11:15:11.565 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T11:15:11.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.688+0000 7f7544244700 1 Processor -- start 2023-10-06T11:15:11.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.688+0000 7f7544244700 1 -- start start 2023-10-06T11:15:11.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.689+0000 7f7544244700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f753c0abfe0 0x7f753c0add00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:11.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.689+0000 7f7544244700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f753c0ae550 con 0x7f753c0ceb50 2023-10-06T11:15:11.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.689+0000 7f7544244700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f753c0ae830 con 0x7f753c0ac3b0 2023-10-06T11:15:11.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.689+0000 7f7544244700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f753c0aeb10 con 0x7f753c0abfe0 2023-10-06T11:15:11.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.689+0000 7f75417df700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f753c0ceb50 0x7f753c0af5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59184/0 (socket says 172.21.15.146:59184) 2023-10-06T11:15:11.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.689+0000 7f75417df700 1 -- 172.21.15.146:0/1558650327 learned_addr learned my addr 172.21.15.146:0/1558650327 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:15:11.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.689+0000 7f7541fe0700 1 --2- 172.21.15.146:0/1558650327 >> v2:172.21.15.151:3300/0 conn(0x7f753c0abfe0 0x7f753c0add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:11.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.689+0000 7f7540fde700 1 -- 172.21.15.146:0/1558650327 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3814971591 0 0) 0x7f753c0ae550 con 0x7f753c0ceb50 2023-10-06T11:15:11.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.690+0000 7f7540fde700 1 -- 172.21.15.146:0/1558650327 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7528003570 con 0x7f753c0ceb50 2023-10-06T11:15:11.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.690+0000 7f7541fe0700 1 -- 172.21.15.146:0/1558650327 >> v1:172.21.15.151:6789/0 conn(0x7f753c0ac3b0 legacy=0x7f753c0ac810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:11.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.690+0000 7f7541fe0700 1 -- 172.21.15.146:0/1558650327 >> v1:172.21.15.146:6789/0 conn(0x7f753c0ceb50 legacy=0x7f753c0af5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:11.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.690+0000 7f7541fe0700 1 -- 172.21.15.146:0/1558650327 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f753c0aedf0 con 0x7f753c0abfe0 2023-10-06T11:15:11.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.690+0000 7f7541fe0700 1 --2- 172.21.15.146:0/1558650327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f753c0abfe0 0x7f753c0add00 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f75380098e0 tx=0x7f75380091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3064ee87a379420 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:11.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.690+0000 7f7540fde700 1 -- 172.21.15.146:0/1558650327 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753800b640 con 0x7f753c0abfe0 2023-10-06T11:15:11.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.690+0000 7f7540fde700 1 -- 172.21.15.146:0/1558650327 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f753800b7a0 con 0x7f753c0abfe0 2023-10-06T11:15:11.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.690+0000 7f7540fde700 1 -- 172.21.15.146:0/1558650327 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753800bb20 con 0x7f753c0abfe0 2023-10-06T11:15:11.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.691+0000 7f7544244700 1 -- 172.21.15.146:0/1558650327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f753c0abfe0 msgr2=0x7f753c0add00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:11.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.691+0000 7f7544244700 1 --2- 172.21.15.146:0/1558650327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f753c0abfe0 0x7f753c0add00 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f75380098e0 tx=0x7f75380091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:11.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.691+0000 7f7544244700 1 -- 172.21.15.146:0/1558650327 shutdown_connections 2023-10-06T11:15:11.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.691+0000 7f7544244700 1 --2- 172.21.15.146:0/1558650327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f753c0abfe0 0x7f753c0add00 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:11.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.691+0000 7f7544244700 1 -- 172.21.15.146:0/1558650327 >> 172.21.15.146:0/1558650327 conn(0x7f753c067c50 msgr2=0x7f753c0ce440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:11.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.691+0000 7f7544244700 1 -- 172.21.15.146:0/1558650327 shutdown_connections 2023-10-06T11:15:11.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.691+0000 7f7544244700 1 -- 172.21.15.146:0/1558650327 wait complete. 2023-10-06T11:15:11.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.692+0000 7f7544244700 1 Processor -- start 2023-10-06T11:15:11.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.692+0000 7f7544244700 1 -- start start 2023-10-06T11:15:11.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.693+0000 7f7544244700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f753c0abfe0 0x7f753c13ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:11.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.693+0000 7f7544244700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f753c0ac3b0 0x7f753c1507d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:11.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.693+0000 7f7544244700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f753c0ceb50 0x7f753c150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:11.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.693+0000 7f7544244700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753c16b880 con 0x7f753c0abfe0 2023-10-06T11:15:11.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.693+0000 7f7544244700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f753c169100 con 0x7f753c0ac3b0 2023-10-06T11:15:11.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.693+0000 7f7544244700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f753c13bfb0 con 0x7f753c0ceb50 2023-10-06T11:15:11.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.693+0000 7f7541fe0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f753c0abfe0 0x7f753c13ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:11.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.693+0000 7f7541fe0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f753c0abfe0 0x7f753c13ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35282/0 (socket says 172.21.15.146:35282) 2023-10-06T11:15:11.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.693+0000 7f7541fe0700 1 -- 172.21.15.146:0/1550012899 learned_addr learned my addr 172.21.15.146:0/1550012899 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:11.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.693+0000 7f75417df700 1 --2- 172.21.15.146:0/1550012899 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f753c0ac3b0 0x7f753c1507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:11.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.693+0000 7f75427e1700 1 --2- 172.21.15.146:0/1550012899 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f753c0ceb50 0x7f753c150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:11.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.693+0000 7f7541fe0700 1 -- 172.21.15.146:0/1550012899 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f753c0ceb50 msgr2=0x7f753c150d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:11.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.693+0000 7f7541fe0700 1 --2- 172.21.15.146:0/1550012899 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f753c0ceb50 0x7f753c150d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:11.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.693+0000 7f7541fe0700 1 -- 172.21.15.146:0/1550012899 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f753c0ac3b0 msgr2=0x7f753c1507d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:11.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.693+0000 7f7541fe0700 1 --2- 172.21.15.146:0/1550012899 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f753c0ac3b0 0x7f753c1507d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:11.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.693+0000 7f7541fe0700 1 -- 172.21.15.146:0/1550012899 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7538009420 con 0x7f753c0abfe0 2023-10-06T11:15:11.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.693+0000 7f7541fe0700 1 --2- 172.21.15.146:0/1550012899 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f753c0abfe0 0x7f753c13ba70 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f753c06e8e0 tx=0x7f7538017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:11.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.693+0000 7f7531ffb700 1 -- 172.21.15.146:0/1550012899 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753800bb20 con 0x7f753c0abfe0 2023-10-06T11:15:11.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.693+0000 7f7531ffb700 1 -- 172.21.15.146:0/1550012899 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7538000c90 con 0x7f753c0abfe0 2023-10-06T11:15:11.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.693+0000 7f7544244700 1 -- 172.21.15.146:0/1550012899 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f753c0b1920 con 0x7f753c0abfe0 2023-10-06T11:15:11.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.693+0000 7f7531ffb700 1 -- 172.21.15.146:0/1550012899 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7538011650 con 0x7f753c0abfe0 2023-10-06T11:15:11.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.694+0000 7f7544244700 1 -- 172.21.15.146:0/1550012899 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f753c1537a0 con 0x7f753c0abfe0 2023-10-06T11:15:11.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.695+0000 7f7544244700 1 -- 172.21.15.146:0/1550012899 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f753c1505f0 con 0x7f753c0abfe0 2023-10-06T11:15:11.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.695+0000 7f7531ffb700 1 -- 172.21.15.146:0/1550012899 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7538011a40 con 0x7f753c0abfe0 2023-10-06T11:15:11.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.695+0000 7f7531ffb700 1 --2- 172.21.15.146:0/1550012899 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7520066f30 0x7f75200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:11.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.695+0000 7f7531ffb700 1 -- 172.21.15.146:0/1550012899 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f7538085d50 con 0x7f753c0abfe0 2023-10-06T11:15:11.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.695+0000 7f75417df700 1 --2- 172.21.15.146:0/1550012899 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7520066f30 0x7f75200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:11.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.696+0000 7f75417df700 1 --2- 172.21.15.146:0/1550012899 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7520066f30 0x7f75200693e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f753c0ae480 tx=0x7f752c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:11.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.700+0000 7f7531ffb700 1 -- 172.21.15.146:0/1550012899 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7538089030 con 0x7f753c0abfe0 2023-10-06T11:15:11.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:11.927+0000 7f7544244700 1 -- 172.21.15.146:0/1550012899 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f753c04c380 con 0x7f753c0abfe0 2023-10-06T11:15:12.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.554+0000 7f7531ffb700 1 -- 172.21.15.146:0/1550012899 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 19 and data pool 20 v104) v1 ==== 174+0+0 (secure 0 0 0) 0x7f7538052ec0 con 0x7f753c0abfe0 2023-10-06T11:15:12.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.564+0000 7f7544244700 1 -- 172.21.15.146:0/1550012899 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7520066f30 msgr2=0x7f75200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:12.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.564+0000 7f7544244700 1 --2- 172.21.15.146:0/1550012899 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7520066f30 0x7f75200693e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f753c0ae480 tx=0x7f752c009040 comp rx=0 tx=0).stop 2023-10-06T11:15:12.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.564+0000 7f7544244700 1 -- 172.21.15.146:0/1550012899 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f753c0abfe0 msgr2=0x7f753c13ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:12.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.564+0000 7f7544244700 1 --2- 172.21.15.146:0/1550012899 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f753c0abfe0 0x7f753c13ba70 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f753c06e8e0 tx=0x7f7538017000 comp rx=0 tx=0).stop 2023-10-06T11:15:12.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.564+0000 7f7544244700 1 -- 172.21.15.146:0/1550012899 shutdown_connections 2023-10-06T11:15:12.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.564+0000 7f7544244700 1 --2- 172.21.15.146:0/1550012899 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7520066f30 0x7f75200693e0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:12.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.564+0000 7f7544244700 1 --2- 172.21.15.146:0/1550012899 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f753c0ceb50 0x7f753c150d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:12.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.564+0000 7f7544244700 1 --2- 172.21.15.146:0/1550012899 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f753c0abfe0 0x7f753c13ba70 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:12.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.564+0000 7f7544244700 1 --2- 172.21.15.146:0/1550012899 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f753c0ac3b0 0x7f753c1507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:12.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.564+0000 7f7544244700 1 -- 172.21.15.146:0/1550012899 >> 172.21.15.146:0/1550012899 conn(0x7f753c067c50 msgr2=0x7f753c06c130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:12.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.564+0000 7f7544244700 1 -- 172.21.15.146:0/1550012899 shutdown_connections 2023-10-06T11:15:12.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.564+0000 7f7544244700 1 -- 172.21.15.146:0/1550012899 wait complete. 2023-10-06T11:15:12.567 INFO:teuthology.orchestra.run.smithi146.stderr:new fs with metadata pool 19 and data pool 20 2023-10-06T11:15:12.581 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:15:12.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.694+0000 7f30e1f8e700 1 Processor -- start 2023-10-06T11:15:12.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.694+0000 7f30e1f8e700 1 -- start start 2023-10-06T11:15:12.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.695+0000 7f30e1f8e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f30dc068ba0 0x7f30dc15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:12.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.695+0000 7f30e1f8e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30dc153e80 0x7f30dc0b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:12.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.695+0000 7f30e1f8e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30dc15ac30 con 0x7f30dc153ab0 2023-10-06T11:15:12.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.695+0000 7f30e1f8e700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30dc0b4510 con 0x7f30dc068ba0 2023-10-06T11:15:12.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.695+0000 7f30e1f8e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30dc0b6530 con 0x7f30dc153e80 2023-10-06T11:15:12.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.696+0000 7f30daffd700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f30dc068ba0 0x7f30dc15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:12.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.696+0000 7f30dbfff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30dc153e80 0x7f30dc0b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:12.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.696+0000 7f30daffd700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f30dc068ba0 0x7f30dc15a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:52330/0 (socket says 172.21.15.146:52330) 2023-10-06T11:15:12.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.696+0000 7f30db7fe700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f30dc153ab0 0x7f30dc068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:48074/0 (socket says 172.21.15.146:48074) 2023-10-06T11:15:12.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.696+0000 7f30daffd700 1 -- 172.21.15.146:0/1975603707 learned_addr learned my addr 172.21.15.146:0/1975603707 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:12.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.696+0000 7f30dbfff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30dc153e80 0x7f30dc0b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:37224/0 (socket says 172.21.15.146:37224) 2023-10-06T11:15:12.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.696+0000 7f30daffd700 1 -- 172.21.15.146:0/1975603707 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30dc153e80 msgr2=0x7f30dc0b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:12.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.696+0000 7f30daffd700 1 --2- 172.21.15.146:0/1975603707 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30dc153e80 0x7f30dc0b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:12.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.696+0000 7f30daffd700 1 -- 172.21.15.146:0/1975603707 >> v1:172.21.15.151:6789/0 conn(0x7f30dc153ab0 legacy=0x7f30dc068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:12.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.696+0000 7f30daffd700 1 -- 172.21.15.146:0/1975603707 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30dc0b5c50 con 0x7f30dc068ba0 2023-10-06T11:15:12.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.696+0000 7f30dbfff700 1 --2- 172.21.15.146:0/1975603707 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30dc153e80 0x7f30dc0b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:15:12.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.696+0000 7f30daffd700 1 --2- 172.21.15.146:0/1975603707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30dc068ba0 0x7f30dc15a6f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f30d00099b0 tx=0x7f30d0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afab9d551920baf4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:12.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.696+0000 7f30da7fc700 1 -- 172.21.15.146:0/1975603707 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d0009ea0 con 0x7f30dc068ba0 2023-10-06T11:15:12.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.696+0000 7f30da7fc700 1 -- 172.21.15.146:0/1975603707 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30d000b860 con 0x7f30dc068ba0 2023-10-06T11:15:12.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.696+0000 7f30da7fc700 1 -- 172.21.15.146:0/1975603707 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d000bc00 con 0x7f30dc068ba0 2023-10-06T11:15:12.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.697+0000 7f30e1f8e700 1 -- 172.21.15.146:0/1975603707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30dc068ba0 msgr2=0x7f30dc15a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:12.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.697+0000 7f30e1f8e700 1 --2- 172.21.15.146:0/1975603707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30dc068ba0 0x7f30dc15a6f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f30d00099b0 tx=0x7f30d0009250 comp rx=0 tx=0).stop 2023-10-06T11:15:12.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.697+0000 7f30e1f8e700 1 -- 172.21.15.146:0/1975603707 shutdown_connections 2023-10-06T11:15:12.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.697+0000 7f30e1f8e700 1 --2- 172.21.15.146:0/1975603707 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30dc153e80 0x7f30dc0b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:12.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.697+0000 7f30e1f8e700 1 --2- 172.21.15.146:0/1975603707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30dc068ba0 0x7f30dc15a6f0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:12.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.697+0000 7f30e1f8e700 1 -- 172.21.15.146:0/1975603707 >> 172.21.15.146:0/1975603707 conn(0x7f30dc06eba0 msgr2=0x7f30dc06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:12.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.697+0000 7f30e1f8e700 1 -- 172.21.15.146:0/1975603707 shutdown_connections 2023-10-06T11:15:12.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.697+0000 7f30e1f8e700 1 -- 172.21.15.146:0/1975603707 wait complete. 2023-10-06T11:15:12.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.698+0000 7f30e1f8e700 1 Processor -- start 2023-10-06T11:15:12.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.698+0000 7f30e1f8e700 1 -- start start 2023-10-06T11:15:12.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.699+0000 7f30e1f8e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30dc068ba0 0x7f30dc0cbce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:12.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.699+0000 7f30e1f8e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30dc153ab0 0x7f30dc157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:12.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.699+0000 7f30e1f8e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30dc153e80 0x7f30dc158490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:12.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.699+0000 7f30e1f8e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30dc158ac0 con 0x7f30dc153ab0 2023-10-06T11:15:12.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.699+0000 7f30e1f8e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30dc154cd0 con 0x7f30dc153e80 2023-10-06T11:15:12.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.699+0000 7f30e1f8e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30dc155930 con 0x7f30dc068ba0 2023-10-06T11:15:12.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.699+0000 7f30daffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30dc153ab0 0x7f30dc157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:12.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.699+0000 7f30daffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30dc153ab0 0x7f30dc157f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35292/0 (socket says 172.21.15.146:35292) 2023-10-06T11:15:12.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.699+0000 7f30daffd700 1 -- 172.21.15.146:0/99270392 learned_addr learned my addr 172.21.15.146:0/99270392 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:12.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.699+0000 7f30db7fe700 1 --2- 172.21.15.146:0/99270392 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30dc068ba0 0x7f30dc0cbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:12.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.699+0000 7f30dbfff700 1 --2- 172.21.15.146:0/99270392 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30dc153e80 0x7f30dc158490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:12.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.699+0000 7f30daffd700 1 -- 172.21.15.146:0/99270392 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30dc068ba0 msgr2=0x7f30dc0cbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:12.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.699+0000 7f30daffd700 1 --2- 172.21.15.146:0/99270392 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30dc068ba0 0x7f30dc0cbce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:12.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.699+0000 7f30daffd700 1 -- 172.21.15.146:0/99270392 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30dc153e80 msgr2=0x7f30dc158490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:12.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.699+0000 7f30daffd700 1 --2- 172.21.15.146:0/99270392 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30dc153e80 0x7f30dc158490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:12.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.699+0000 7f30daffd700 1 -- 172.21.15.146:0/99270392 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d4009420 con 0x7f30dc153ab0 2023-10-06T11:15:12.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.699+0000 7f30daffd700 1 --2- 172.21.15.146:0/99270392 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30dc153ab0 0x7f30dc157f50 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f30d0006fd0 tx=0x7f30d0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:12.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.700+0000 7f30c37fe700 1 -- 172.21.15.146:0/99270392 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d000bbe0 con 0x7f30dc153ab0 2023-10-06T11:15:12.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.700+0000 7f30c37fe700 1 -- 172.21.15.146:0/99270392 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30d0011420 con 0x7f30dc153ab0 2023-10-06T11:15:12.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.700+0000 7f30e1f8e700 1 -- 172.21.15.146:0/99270392 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30d00094f0 con 0x7f30dc153ab0 2023-10-06T11:15:12.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.700+0000 7f30c37fe700 1 -- 172.21.15.146:0/99270392 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d00117c0 con 0x7f30dc153ab0 2023-10-06T11:15:12.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.700+0000 7f30e1f8e700 1 -- 172.21.15.146:0/99270392 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30dc154680 con 0x7f30dc153ab0 2023-10-06T11:15:12.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.700+0000 7f30e1f8e700 1 -- 172.21.15.146:0/99270392 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30dc154e60 con 0x7f30dc153ab0 2023-10-06T11:15:12.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.701+0000 7f30c37fe700 1 -- 172.21.15.146:0/99270392 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f30d0011bf0 con 0x7f30dc153ab0 2023-10-06T11:15:12.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.701+0000 7f30c37fe700 1 --2- 172.21.15.146:0/99270392 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f30c8066f30 0x7f30c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:12.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.701+0000 7f30db7fe700 1 --2- 172.21.15.146:0/99270392 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f30c8066f30 0x7f30c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:12.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.701+0000 7f30c37fe700 1 -- 172.21.15.146:0/99270392 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f30d0085f50 con 0x7f30dc153ab0 2023-10-06T11:15:12.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.702+0000 7f30db7fe700 1 --2- 172.21.15.146:0/99270392 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f30c8066f30 0x7f30c80693e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f30cc001f80 tx=0x7f30cc005cd0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:12.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.706+0000 7f30c37fe700 1 -- 172.21.15.146:0/99270392 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f30d0053060 con 0x7f30dc153ab0 2023-10-06T11:15:12.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.890+0000 7f30e1f8e700 1 -- 172.21.15.146:0/99270392 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f30dc0cc220 con 0x7f30dc153ab0 2023-10-06T11:15:12.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.891+0000 7f30c37fe700 1 -- 172.21.15.146:0/99270392 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) v1 ==== 74+0+16941 (secure 0 0 0) 0x7f30d0056680 con 0x7f30dc153ab0 2023-10-06T11:15:12.894 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:15:12.894 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":124,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:15:11.928773+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:15:09.613367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-10-06T11:15:10.888669+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:15:12.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.893+0000 7f30e1f8e700 1 -- 172.21.15.146:0/99270392 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f30c8066f30 msgr2=0x7f30c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:12.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.893+0000 7f30e1f8e700 1 --2- 172.21.15.146:0/99270392 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f30c8066f30 0x7f30c80693e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f30cc001f80 tx=0x7f30cc005cd0 comp rx=0 tx=0).stop 2023-10-06T11:15:12.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.893+0000 7f30e1f8e700 1 -- 172.21.15.146:0/99270392 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30dc153ab0 msgr2=0x7f30dc157f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:12.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.893+0000 7f30e1f8e700 1 --2- 172.21.15.146:0/99270392 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30dc153ab0 0x7f30dc157f50 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f30d0006fd0 tx=0x7f30d0017000 comp rx=0 tx=0).stop 2023-10-06T11:15:12.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.893+0000 7f30e1f8e700 1 -- 172.21.15.146:0/99270392 shutdown_connections 2023-10-06T11:15:12.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.893+0000 7f30e1f8e700 1 --2- 172.21.15.146:0/99270392 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f30c8066f30 0x7f30c80693e0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:12.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.893+0000 7f30e1f8e700 1 --2- 172.21.15.146:0/99270392 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30dc153e80 0x7f30dc158490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:12.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.893+0000 7f30e1f8e700 1 --2- 172.21.15.146:0/99270392 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30dc068ba0 0x7f30dc0cbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:12.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.893+0000 7f30e1f8e700 1 --2- 172.21.15.146:0/99270392 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30dc153ab0 0x7f30dc157f50 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:12.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.893+0000 7f30e1f8e700 1 -- 172.21.15.146:0/99270392 >> 172.21.15.146:0/99270392 conn(0x7f30dc06eba0 msgr2=0x7f30dc151ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:12.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.893+0000 7f30e1f8e700 1 -- 172.21.15.146:0/99270392 shutdown_connections 2023-10-06T11:15:12.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:12.893+0000 7f30e1f8e700 1 -- 172.21.15.146:0/99270392 wait complete. 2023-10-06T11:15:12.908 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:15:13.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.020+0000 7ff5eabcf700 1 Processor -- start 2023-10-06T11:15:13.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.020+0000 7ff5eabcf700 1 -- start start 2023-10-06T11:15:13.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.020+0000 7ff5eabcf700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff5e4153e80 0x7ff5e415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:13.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.020+0000 7ff5eabcf700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5e415ac30 con 0x7ff5e4153ab0 2023-10-06T11:15:13.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.021+0000 7ff5eabcf700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5e40b4510 con 0x7ff5e4068ba0 2023-10-06T11:15:13.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.021+0000 7ff5eabcf700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5e40b6530 con 0x7ff5e4153e80 2023-10-06T11:15:13.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.021+0000 7ff5e916c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff5e4153e80 0x7ff5e415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:13.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.021+0000 7ff5e896b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff5e4153ab0 0x7ff5e4068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59186/0 (socket says 172.21.15.146:59186) 2023-10-06T11:15:13.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.021+0000 7ff5e896b700 1 -- 172.21.15.146:0/1133376080 learned_addr learned my addr 172.21.15.146:0/1133376080 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:15:13.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.021+0000 7ff5e916c700 1 -- 172.21.15.146:0/1133376080 >> v1:172.21.15.151:6789/0 conn(0x7ff5e4068ba0 legacy=0x7ff5e40b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:13.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.021+0000 7ff5e916c700 1 -- 172.21.15.146:0/1133376080 >> v1:172.21.15.146:6789/0 conn(0x7ff5e4153ab0 legacy=0x7ff5e4068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:13.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.021+0000 7ff5db7fe700 1 -- 172.21.15.146:0/1133376080 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2170128142 0 0) 0x7ff5e0001110 con 0x7ff5e4153ab0 2023-10-06T11:15:13.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.021+0000 7ff5e916c700 1 -- 172.21.15.146:0/1133376080 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e40b5c50 con 0x7ff5e4153e80 2023-10-06T11:15:13.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.021+0000 7ff5e916c700 1 --2- 172.21.15.146:0/1133376080 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5e4153e80 0x7ff5e415a6f0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc009e60 tx=0x7ff5dc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d72904092eef7470 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:13.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.021+0000 7ff5db7fe700 1 -- 172.21.15.146:0/1133376080 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc00e070 con 0x7ff5e4153e80 2023-10-06T11:15:13.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.021+0000 7ff5db7fe700 1 -- 172.21.15.146:0/1133376080 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5dc00bc30 con 0x7ff5e4153e80 2023-10-06T11:15:13.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.021+0000 7ff5db7fe700 1 -- 172.21.15.146:0/1133376080 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5dc012430 con 0x7ff5e4153e80 2023-10-06T11:15:13.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.022+0000 7ff5eabcf700 1 -- 172.21.15.146:0/1133376080 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5e4153e80 msgr2=0x7ff5e415a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:13.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.022+0000 7ff5eabcf700 1 --2- 172.21.15.146:0/1133376080 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5e4153e80 0x7ff5e415a6f0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc009e60 tx=0x7ff5dc009780 comp rx=0 tx=0).stop 2023-10-06T11:15:13.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.022+0000 7ff5eabcf700 1 -- 172.21.15.146:0/1133376080 shutdown_connections 2023-10-06T11:15:13.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.022+0000 7ff5eabcf700 1 --2- 172.21.15.146:0/1133376080 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5e4153e80 0x7ff5e415a6f0 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:13.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.022+0000 7ff5eabcf700 1 -- 172.21.15.146:0/1133376080 >> 172.21.15.146:0/1133376080 conn(0x7ff5e406eba0 msgr2=0x7ff5e406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:13.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.022+0000 7ff5eabcf700 1 -- 172.21.15.146:0/1133376080 shutdown_connections 2023-10-06T11:15:13.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.022+0000 7ff5eabcf700 1 -- 172.21.15.146:0/1133376080 wait complete. 2023-10-06T11:15:13.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.023+0000 7ff5eabcf700 1 Processor -- start 2023-10-06T11:15:13.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.023+0000 7ff5eabcf700 1 -- start start 2023-10-06T11:15:13.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.024+0000 7ff5eabcf700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5e4068ba0 0x7ff5e40afec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:13.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.024+0000 7ff5eabcf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5e4153ab0 0x7ff5e40b15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:13.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.024+0000 7ff5eabcf700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5e4153e80 0x7ff5e4155810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:13.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.024+0000 7ff5eabcf700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e4155d50 con 0x7ff5e4153ab0 2023-10-06T11:15:13.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.024+0000 7ff5eabcf700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e40b1160 con 0x7ff5e4153e80 2023-10-06T11:15:13.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.024+0000 7ff5eabcf700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e40b0550 con 0x7ff5e4068ba0 2023-10-06T11:15:13.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.024+0000 7ff5dbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5e4153ab0 0x7ff5e40b15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:13.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.024+0000 7ff5dbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5e4153ab0 0x7ff5e40b15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35302/0 (socket says 172.21.15.146:35302) 2023-10-06T11:15:13.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.024+0000 7ff5dbfff700 1 -- 172.21.15.146:0/684010358 learned_addr learned my addr 172.21.15.146:0/684010358 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:13.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.024+0000 7ff5e916c700 1 --2- 172.21.15.146:0/684010358 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5e4153e80 0x7ff5e4155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:13.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.024+0000 7ff5e896b700 1 --2- 172.21.15.146:0/684010358 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5e4068ba0 0x7ff5e40afec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:13.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.024+0000 7ff5dbfff700 1 -- 172.21.15.146:0/684010358 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5e4068ba0 msgr2=0x7ff5e40afec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:13.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.024+0000 7ff5dbfff700 1 --2- 172.21.15.146:0/684010358 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5e4068ba0 0x7ff5e40afec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:13.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.024+0000 7ff5dbfff700 1 -- 172.21.15.146:0/684010358 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5e4153e80 msgr2=0x7ff5e4155810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:13.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.024+0000 7ff5dbfff700 1 --2- 172.21.15.146:0/684010358 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5e4153e80 0x7ff5e4155810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:13.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.024+0000 7ff5dbfff700 1 -- 172.21.15.146:0/684010358 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5dc009a20 con 0x7ff5e4153ab0 2023-10-06T11:15:13.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.024+0000 7ff5e896b700 1 --2- 172.21.15.146:0/684010358 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5e4068ba0 0x7ff5e40afec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:13.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.024+0000 7ff5dbfff700 1 --2- 172.21.15.146:0/684010358 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5e4153ab0 0x7ff5e40b15f0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7ff5d400c590 tx=0x7ff5d4007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:13.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.025+0000 7ff5d8ff9700 1 -- 172.21.15.146:0/684010358 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d4011590 con 0x7ff5e4153ab0 2023-10-06T11:15:13.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.025+0000 7ff5d8ff9700 1 -- 172.21.15.146:0/684010358 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d4011710 con 0x7ff5e4153ab0 2023-10-06T11:15:13.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.025+0000 7ff5eabcf700 1 -- 172.21.15.146:0/684010358 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5e40b0830 con 0x7ff5e4153ab0 2023-10-06T11:15:13.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.025+0000 7ff5d8ff9700 1 -- 172.21.15.146:0/684010358 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d4011ad0 con 0x7ff5e4153ab0 2023-10-06T11:15:13.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.025+0000 7ff5eabcf700 1 -- 172.21.15.146:0/684010358 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5e40b0df0 con 0x7ff5e4153ab0 2023-10-06T11:15:13.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.026+0000 7ff5eabcf700 1 -- 172.21.15.146:0/684010358 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5e404c380 con 0x7ff5e4153ab0 2023-10-06T11:15:13.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.026+0000 7ff5d8ff9700 1 -- 172.21.15.146:0/684010358 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff5d401b3b0 con 0x7ff5e4153ab0 2023-10-06T11:15:13.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.026+0000 7ff5d8ff9700 1 --2- 172.21.15.146:0/684010358 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff5d0066f30 0x7ff5d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:13.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.026+0000 7ff5d8ff9700 1 -- 172.21.15.146:0/684010358 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff5d4083a30 con 0x7ff5e4153ab0 2023-10-06T11:15:13.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.027+0000 7ff5e896b700 1 --2- 172.21.15.146:0/684010358 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff5d0066f30 0x7ff5d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:13.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.027+0000 7ff5e896b700 1 --2- 172.21.15.146:0/684010358 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff5d0066f30 0x7ff5d00693e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ff5e00018c0 tx=0x7ff5e0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:13.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.031+0000 7ff5d8ff9700 1 -- 172.21.15.146:0/684010358 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff5d4050b40 con 0x7ff5e4153ab0 2023-10-06T11:15:13.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.214+0000 7ff5eabcf700 1 -- 172.21.15.146:0/684010358 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5e40b12a0 con 0x7ff5e4153ab0 2023-10-06T11:15:13.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.215+0000 7ff5d8ff9700 1 -- 172.21.15.146:0/684010358 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v124) v1 ==== 74+0+16941 (secure 0 0 0) 0x7ff5d4017070 con 0x7ff5e4153ab0 2023-10-06T11:15:13.217 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:15:13.217 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":124,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:15:11.928773+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:15:09.613367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-10-06T11:15:10.888669+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:15:13.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.217+0000 7ff5eabcf700 1 -- 172.21.15.146:0/684010358 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff5d0066f30 msgr2=0x7ff5d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:13.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.217+0000 7ff5eabcf700 1 --2- 172.21.15.146:0/684010358 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff5d0066f30 0x7ff5d00693e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ff5e00018c0 tx=0x7ff5e0009040 comp rx=0 tx=0).stop 2023-10-06T11:15:13.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.217+0000 7ff5eabcf700 1 -- 172.21.15.146:0/684010358 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5e4153ab0 msgr2=0x7ff5e40b15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:13.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.217+0000 7ff5eabcf700 1 --2- 172.21.15.146:0/684010358 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5e4153ab0 0x7ff5e40b15f0 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7ff5d400c590 tx=0x7ff5d4007f50 comp rx=0 tx=0).stop 2023-10-06T11:15:13.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.217+0000 7ff5eabcf700 1 -- 172.21.15.146:0/684010358 shutdown_connections 2023-10-06T11:15:13.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.217+0000 7ff5eabcf700 1 --2- 172.21.15.146:0/684010358 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff5d0066f30 0x7ff5d00693e0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:13.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.217+0000 7ff5eabcf700 1 --2- 172.21.15.146:0/684010358 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5e4153e80 0x7ff5e4155810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:13.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.217+0000 7ff5eabcf700 1 --2- 172.21.15.146:0/684010358 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff5e4068ba0 0x7ff5e40afec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:13.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.217+0000 7ff5eabcf700 1 --2- 172.21.15.146:0/684010358 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff5e4153ab0 0x7ff5e40b15f0 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:13.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.217+0000 7ff5eabcf700 1 -- 172.21.15.146:0/684010358 >> 172.21.15.146:0/684010358 conn(0x7ff5e406eba0 msgr2=0x7ff5e40cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:13.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.217+0000 7ff5eabcf700 1 -- 172.21.15.146:0/684010358 shutdown_connections 2023-10-06T11:15:13.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.217+0000 7ff5eabcf700 1 -- 172.21.15.146:0/684010358 wait complete. 2023-10-06T11:15:13.232 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T11:15:13.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.347+0000 7f0e9c949700 1 Processor -- start 2023-10-06T11:15:13.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.347+0000 7f0e9c949700 1 -- start start 2023-10-06T11:15:13.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.348+0000 7f0e9c949700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0e9806bc70 0x7f0e980b0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:13.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.348+0000 7f0e9c949700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e980c90f0 con 0x7f0e9806b8a0 2023-10-06T11:15:13.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.348+0000 7f0e9c949700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e980cc350 con 0x7f0e98140800 2023-10-06T11:15:13.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.348+0000 7f0e9c949700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e980c9d40 con 0x7f0e9806bc70 2023-10-06T11:15:13.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.348+0000 7f0e9659c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0e9806bc70 0x7f0e980b0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:13.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.348+0000 7f0e96d9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0e9806b8a0 0x7f0e9815b870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59202/0 (socket says 172.21.15.146:59202) 2023-10-06T11:15:13.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.348+0000 7f0e96d9d700 1 -- 172.21.15.146:0/3377043488 learned_addr learned my addr 172.21.15.146:0/3377043488 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:15:13.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.348+0000 7f0e9659c700 1 -- 172.21.15.146:0/3377043488 >> v1:172.21.15.151:6789/0 conn(0x7f0e98140800 legacy=0x7f0e98140c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:13.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.348+0000 7f0e9659c700 1 -- 172.21.15.146:0/3377043488 >> v1:172.21.15.146:6789/0 conn(0x7f0e9806b8a0 legacy=0x7f0e9815b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:13.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.348+0000 7f0e9659c700 1 -- 172.21.15.146:0/3377043488 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e980c8870 con 0x7f0e9806bc70 2023-10-06T11:15:13.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.348+0000 7f0e95d9b700 1 -- 172.21.15.146:0/3377043488 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1504273643 0 0) 0x7f0e88001110 con 0x7f0e9806b8a0 2023-10-06T11:15:13.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.348+0000 7f0e9659c700 1 --2- 172.21.15.146:0/3377043488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e9806bc70 0x7f0e980b0ff0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c0098e0 tx=0x7f0e8c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7782e0bb84d6ab88 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:13.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.348+0000 7f0e95d9b700 1 -- 172.21.15.146:0/3377043488 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c009e80 con 0x7f0e9806bc70 2023-10-06T11:15:13.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.348+0000 7f0e95d9b700 1 -- 172.21.15.146:0/3377043488 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e8c00b860 con 0x7f0e9806bc70 2023-10-06T11:15:13.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.348+0000 7f0e95d9b700 1 -- 172.21.15.146:0/3377043488 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c00bbe0 con 0x7f0e9806bc70 2023-10-06T11:15:13.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.349+0000 7f0e9c949700 1 -- 172.21.15.146:0/3377043488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e9806bc70 msgr2=0x7f0e980b0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:13.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.349+0000 7f0e9c949700 1 --2- 172.21.15.146:0/3377043488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e9806bc70 0x7f0e980b0ff0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c0098e0 tx=0x7f0e8c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:13.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.349+0000 7f0e9c949700 1 -- 172.21.15.146:0/3377043488 shutdown_connections 2023-10-06T11:15:13.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.349+0000 7f0e9c949700 1 --2- 172.21.15.146:0/3377043488 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e9806bc70 0x7f0e980b0ff0 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:13.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.349+0000 7f0e9c949700 1 -- 172.21.15.146:0/3377043488 >> 172.21.15.146:0/3377043488 conn(0x7f0e980ce230 msgr2=0x7f0e980ce630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:13.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.349+0000 7f0e9c949700 1 -- 172.21.15.146:0/3377043488 shutdown_connections 2023-10-06T11:15:13.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.349+0000 7f0e9c949700 1 -- 172.21.15.146:0/3377043488 wait complete. 2023-10-06T11:15:13.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.350+0000 7f0e9c949700 1 Processor -- start 2023-10-06T11:15:13.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.350+0000 7f0e9c949700 1 -- start start 2023-10-06T11:15:13.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.351+0000 7f0e9c949700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e9806b8a0 0x7f0e980a54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:13.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.351+0000 7f0e9c949700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e9806bc70 0x7f0e980c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:13.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.351+0000 7f0e9c949700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e98140800 0x7f0e980a72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:13.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.351+0000 7f0e9c949700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e980cbe00 con 0x7f0e9806bc70 2023-10-06T11:15:13.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.351+0000 7f0e9c949700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e980a70c0 con 0x7f0e9806b8a0 2023-10-06T11:15:13.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.351+0000 7f0e9c949700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e98168130 con 0x7f0e98140800 2023-10-06T11:15:13.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.351+0000 7f0e9659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e9806bc70 0x7f0e980c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:13.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.351+0000 7f0e9659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e9806bc70 0x7f0e980c79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35316/0 (socket says 172.21.15.146:35316) 2023-10-06T11:15:13.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.351+0000 7f0e9659c700 1 -- 172.21.15.146:0/2803901075 learned_addr learned my addr 172.21.15.146:0/2803901075 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:13.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.351+0000 7f0e96d9d700 1 --2- 172.21.15.146:0/2803901075 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e9806b8a0 0x7f0e980a54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:13.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.351+0000 7f0e9759e700 1 --2- 172.21.15.146:0/2803901075 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e98140800 0x7f0e980a72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:13.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.351+0000 7f0e9659c700 1 -- 172.21.15.146:0/2803901075 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e98140800 msgr2=0x7f0e980a72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:13.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.351+0000 7f0e9659c700 1 --2- 172.21.15.146:0/2803901075 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e98140800 0x7f0e980a72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:13.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.351+0000 7f0e9659c700 1 -- 172.21.15.146:0/2803901075 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e9806b8a0 msgr2=0x7f0e980a54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:13.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.351+0000 7f0e9659c700 1 --2- 172.21.15.146:0/2803901075 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e9806b8a0 0x7f0e980a54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:13.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.351+0000 7f0e9659c700 1 -- 172.21.15.146:0/2803901075 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e8c009420 con 0x7f0e9806bc70 2023-10-06T11:15:13.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.351+0000 7f0e96d9d700 1 --2- 172.21.15.146:0/2803901075 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e9806b8a0 0x7f0e980a54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:13.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.351+0000 7f0e9759e700 1 --2- 172.21.15.146:0/2803901075 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e98140800 0x7f0e980a72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:13.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.351+0000 7f0e9659c700 1 --2- 172.21.15.146:0/2803901075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e9806bc70 0x7f0e980c79c0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f0e9806fdd0 tx=0x7f0e8c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:13.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.351+0000 7f0e7effd700 1 -- 172.21.15.146:0/2803901075 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c01f070 con 0x7f0e9806bc70 2023-10-06T11:15:13.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.352+0000 7f0e7effd700 1 -- 172.21.15.146:0/2803901075 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e8c011420 con 0x7f0e9806bc70 2023-10-06T11:15:13.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.352+0000 7f0e9c949700 1 -- 172.21.15.146:0/2803901075 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e9816bb50 con 0x7f0e9806bc70 2023-10-06T11:15:13.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.352+0000 7f0e7effd700 1 -- 172.21.15.146:0/2803901075 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c00bbe0 con 0x7f0e9806bc70 2023-10-06T11:15:13.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.352+0000 7f0e9c949700 1 -- 172.21.15.146:0/2803901075 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e9816c190 con 0x7f0e9806bc70 2023-10-06T11:15:13.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.352+0000 7f0e9c949700 1 -- 172.21.15.146:0/2803901075 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e9816c510 con 0x7f0e9806bc70 2023-10-06T11:15:13.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.353+0000 7f0e7effd700 1 -- 172.21.15.146:0/2803901075 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0e8c011a30 con 0x7f0e9806bc70 2023-10-06T11:15:13.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.353+0000 7f0e7effd700 1 --2- 172.21.15.146:0/2803901075 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0e84066f30 0x7f0e840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:13.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.353+0000 7f0e7effd700 1 -- 172.21.15.146:0/2803901075 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0e8c085be0 con 0x7f0e9806bc70 2023-10-06T11:15:13.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.353+0000 7f0e96d9d700 1 --2- 172.21.15.146:0/2803901075 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0e84066f30 0x7f0e840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:13.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.354+0000 7f0e96d9d700 1 --2- 172.21.15.146:0/2803901075 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0e84066f30 0x7f0e840693e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f0e88000c00 tx=0x7f0e88009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:13.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.358+0000 7f0e7effd700 1 -- 172.21.15.146:0/2803901075 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e8c052da0 con 0x7f0e9806bc70 2023-10-06T11:15:13.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:13.588+0000 7f0e9c949700 1 -- 172.21.15.146:0/2803901075 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0e981682a0 con 0x7f0e9806bc70 2023-10-06T11:15:14.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.570+0000 7f0e7effd700 1 -- 172.21.15.146:0/2803901075 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v107) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0e8c0150b0 con 0x7f0e9806bc70 2023-10-06T11:15:14.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.573+0000 7f0e9c949700 1 -- 172.21.15.146:0/2803901075 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0e84066f30 msgr2=0x7f0e840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:14.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.573+0000 7f0e9c949700 1 --2- 172.21.15.146:0/2803901075 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0e84066f30 0x7f0e840693e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f0e88000c00 tx=0x7f0e88009040 comp rx=0 tx=0).stop 2023-10-06T11:15:14.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.573+0000 7f0e9c949700 1 -- 172.21.15.146:0/2803901075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e9806bc70 msgr2=0x7f0e980c79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:14.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.573+0000 7f0e9c949700 1 --2- 172.21.15.146:0/2803901075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e9806bc70 0x7f0e980c79c0 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f0e9806fdd0 tx=0x7f0e8c017000 comp rx=0 tx=0).stop 2023-10-06T11:15:14.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.573+0000 7f0e9c949700 1 -- 172.21.15.146:0/2803901075 shutdown_connections 2023-10-06T11:15:14.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.573+0000 7f0e9c949700 1 --2- 172.21.15.146:0/2803901075 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0e84066f30 0x7f0e840693e0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:14.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.573+0000 7f0e9c949700 1 --2- 172.21.15.146:0/2803901075 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0e98140800 0x7f0e980a72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:14.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.573+0000 7f0e9c949700 1 --2- 172.21.15.146:0/2803901075 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e9806b8a0 0x7f0e980a54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:14.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.573+0000 7f0e9c949700 1 --2- 172.21.15.146:0/2803901075 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0e9806bc70 0x7f0e980c79c0 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:14.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.573+0000 7f0e9c949700 1 -- 172.21.15.146:0/2803901075 >> 172.21.15.146:0/2803901075 conn(0x7f0e980ce230 msgr2=0x7f0e9815ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:14.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.573+0000 7f0e9c949700 1 -- 172.21.15.146:0/2803901075 shutdown_connections 2023-10-06T11:15:14.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.573+0000 7f0e9c949700 1 -- 172.21.15.146:0/2803901075 wait complete. 2023-10-06T11:15:14.590 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T11:15:14.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.711+0000 7fe0b8e33700 1 Processor -- start 2023-10-06T11:15:14.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.711+0000 7fe0b8e33700 1 -- start start 2023-10-06T11:15:14.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.712+0000 7fe0b8e33700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe0b406eda0 0x7fe0b40b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:14.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.712+0000 7fe0b8e33700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0b415e4c0 con 0x7fe0b4067a90 2023-10-06T11:15:14.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.712+0000 7fe0b8e33700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0b415a840 con 0x7fe0b40676c0 2023-10-06T11:15:14.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.712+0000 7fe0b8e33700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0b415ab20 con 0x7fe0b406eda0 2023-10-06T11:15:14.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.712+0000 7fe0b2d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe0b406eda0 0x7fe0b40b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:14.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.712+0000 7fe0a9d9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe0b4067a90 0x7fe0b406e690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59218/0 (socket says 172.21.15.146:59218) 2023-10-06T11:15:14.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.712+0000 7fe0a9d9b700 1 -- 172.21.15.146:0/2572158471 learned_addr learned my addr 172.21.15.146:0/2572158471 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:15:14.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.713+0000 7fe0b2d9d700 1 -- 172.21.15.146:0/2572158471 >> v1:172.21.15.151:6789/0 conn(0x7fe0b40676c0 legacy=0x7fe0b415ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:14.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.713+0000 7fe0b2d9d700 1 -- 172.21.15.146:0/2572158471 >> v1:172.21.15.146:6789/0 conn(0x7fe0b4067a90 legacy=0x7fe0b406e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:14.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.713+0000 7fe0b2d9d700 1 -- 172.21.15.146:0/2572158471 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b415ae00 con 0x7fe0b406eda0 2023-10-06T11:15:14.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.713+0000 7fe0b1d9b700 1 -- 172.21.15.146:0/2572158471 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3493233664 0 0) 0x7fe0b415e4c0 con 0x7fe0b4067a90 2023-10-06T11:15:14.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.713+0000 7fe0b2d9d700 1 --2- 172.21.15.146:0/2572158471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0b406eda0 0x7fe0b40b0fa0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac009e60 tx=0x7fe0ac009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9fc211147d04f86 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:14.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.713+0000 7fe0b1d9b700 1 -- 172.21.15.146:0/2572158471 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac00e070 con 0x7fe0b406eda0 2023-10-06T11:15:14.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.713+0000 7fe0b1d9b700 1 -- 172.21.15.146:0/2572158471 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0ac00bc30 con 0x7fe0b406eda0 2023-10-06T11:15:14.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.713+0000 7fe0b1d9b700 1 -- 172.21.15.146:0/2572158471 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac012430 con 0x7fe0b406eda0 2023-10-06T11:15:14.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.713+0000 7fe0b8e33700 1 -- 172.21.15.146:0/2572158471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0b406eda0 msgr2=0x7fe0b40b0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:14.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.713+0000 7fe0b8e33700 1 --2- 172.21.15.146:0/2572158471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0b406eda0 0x7fe0b40b0fa0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac009e60 tx=0x7fe0ac009780 comp rx=0 tx=0).stop 2023-10-06T11:15:14.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.713+0000 7fe0b8e33700 1 -- 172.21.15.146:0/2572158471 shutdown_connections 2023-10-06T11:15:14.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.713+0000 7fe0b8e33700 1 --2- 172.21.15.146:0/2572158471 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0b406eda0 0x7fe0b40b0fa0 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:14.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.713+0000 7fe0b8e33700 1 -- 172.21.15.146:0/2572158471 >> 172.21.15.146:0/2572158471 conn(0x7fe0b4068580 msgr2=0x7fe0b4068980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:14.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.714+0000 7fe0b8e33700 1 -- 172.21.15.146:0/2572158471 shutdown_connections 2023-10-06T11:15:14.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.714+0000 7fe0b8e33700 1 -- 172.21.15.146:0/2572158471 wait complete. 2023-10-06T11:15:14.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.715+0000 7fe0b8e33700 1 Processor -- start 2023-10-06T11:15:14.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.715+0000 7fe0b8e33700 1 -- start start 2023-10-06T11:15:14.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.715+0000 7fe0b8e33700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0b40676c0 0x7fe0b415c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:14.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.715+0000 7fe0b8e33700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0b4067a90 0x7fe0b40ad9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:14.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.715+0000 7fe0b8e33700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0b406eda0 0x7fe0b40adee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:14.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.715+0000 7fe0b8e33700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b415cc40 con 0x7fe0b40676c0 2023-10-06T11:15:14.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.715+0000 7fe0b8e33700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b40a98c0 con 0x7fe0b406eda0 2023-10-06T11:15:14.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.715+0000 7fe0b8e33700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b4157aa0 con 0x7fe0b4067a90 2023-10-06T11:15:14.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.716+0000 7fe0b259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0b40676c0 0x7fe0b415c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:14.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.716+0000 7fe0b259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0b40676c0 0x7fe0b415c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35330/0 (socket says 172.21.15.146:35330) 2023-10-06T11:15:14.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.716+0000 7fe0b259c700 1 -- 172.21.15.146:0/4139063798 learned_addr learned my addr 172.21.15.146:0/4139063798 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:14.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.716+0000 7fe0b2d9d700 1 --2- 172.21.15.146:0/4139063798 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0b406eda0 0x7fe0b40adee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:14.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.716+0000 7fe0a9d9b700 1 --2- 172.21.15.146:0/4139063798 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0b4067a90 0x7fe0b40ad9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:14.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.716+0000 7fe0b259c700 1 -- 172.21.15.146:0/4139063798 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0b4067a90 msgr2=0x7fe0b40ad9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:14.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.716+0000 7fe0b259c700 1 --2- 172.21.15.146:0/4139063798 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0b4067a90 0x7fe0b40ad9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:14.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.716+0000 7fe0b259c700 1 -- 172.21.15.146:0/4139063798 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0b406eda0 msgr2=0x7fe0b40adee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:14.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.716+0000 7fe0b259c700 1 --2- 172.21.15.146:0/4139063798 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0b406eda0 0x7fe0b40adee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:14.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.716+0000 7fe0b259c700 1 -- 172.21.15.146:0/4139063798 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0ac009a20 con 0x7fe0b40676c0 2023-10-06T11:15:14.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.716+0000 7fe0a9d9b700 1 --2- 172.21.15.146:0/4139063798 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0b4067a90 0x7fe0b40ad9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:14.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.716+0000 7fe0b259c700 1 --2- 172.21.15.146:0/4139063798 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0b40676c0 0x7fe0b415c700 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7fe0a400c4e0 tx=0x7fe0a400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:14.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.716+0000 7fe0aaffd700 1 -- 172.21.15.146:0/4139063798 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a4011590 con 0x7fe0b40676c0 2023-10-06T11:15:14.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.716+0000 7fe0aaffd700 1 -- 172.21.15.146:0/4139063798 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0a4011710 con 0x7fe0b40676c0 2023-10-06T11:15:14.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.716+0000 7fe0b8e33700 1 -- 172.21.15.146:0/4139063798 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0b4157d80 con 0x7fe0b40676c0 2023-10-06T11:15:14.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.716+0000 7fe0aaffd700 1 -- 172.21.15.146:0/4139063798 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a4011ad0 con 0x7fe0b40676c0 2023-10-06T11:15:14.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.716+0000 7fe0b8e33700 1 -- 172.21.15.146:0/4139063798 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0b4158340 con 0x7fe0b40676c0 2023-10-06T11:15:14.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.717+0000 7fe0b8e33700 1 -- 172.21.15.146:0/4139063798 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0b404c380 con 0x7fe0b40676c0 2023-10-06T11:15:14.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.717+0000 7fe0aaffd700 1 -- 172.21.15.146:0/4139063798 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe0a401b3b0 con 0x7fe0b40676c0 2023-10-06T11:15:14.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.718+0000 7fe0aaffd700 1 --2- 172.21.15.146:0/4139063798 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe094066f30 0x7fe0940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:14.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.718+0000 7fe0aaffd700 1 -- 172.21.15.146:0/4139063798 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe0a4083b00 con 0x7fe0b40676c0 2023-10-06T11:15:14.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.718+0000 7fe0a9d9b700 1 --2- 172.21.15.146:0/4139063798 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe094066f30 0x7fe0940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:14.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.718+0000 7fe0a9d9b700 1 --2- 172.21.15.146:0/4139063798 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe094066f30 0x7fe0940693e0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fe0b40af270 tx=0x7fe09c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:14.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.722+0000 7fe0aaffd700 1 -- 172.21.15.146:0/4139063798 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe0a4050c10 con 0x7fe0b40676c0 2023-10-06T11:15:14.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:14.952+0000 7fe0b8e33700 1 -- 172.21.15.146:0/4139063798 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe0b40b1b30 con 0x7fe0b40676c0 2023-10-06T11:15:15.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.578+0000 7fe0aaffd700 1 -- 172.21.15.146:0/4139063798 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v108) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe0a4017070 con 0x7fe0b40676c0 2023-10-06T11:15:15.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.581+0000 7fe0b8e33700 1 -- 172.21.15.146:0/4139063798 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe094066f30 msgr2=0x7fe0940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:15.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.581+0000 7fe0b8e33700 1 --2- 172.21.15.146:0/4139063798 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe094066f30 0x7fe0940693e0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fe0b40af270 tx=0x7fe09c009040 comp rx=0 tx=0).stop 2023-10-06T11:15:15.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.581+0000 7fe0b8e33700 1 -- 172.21.15.146:0/4139063798 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0b40676c0 msgr2=0x7fe0b415c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:15.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.581+0000 7fe0b8e33700 1 --2- 172.21.15.146:0/4139063798 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0b40676c0 0x7fe0b415c700 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7fe0a400c4e0 tx=0x7fe0a400c7f0 comp rx=0 tx=0).stop 2023-10-06T11:15:15.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.581+0000 7fe0b8e33700 1 -- 172.21.15.146:0/4139063798 shutdown_connections 2023-10-06T11:15:15.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.581+0000 7fe0b8e33700 1 --2- 172.21.15.146:0/4139063798 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe094066f30 0x7fe0940693e0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:15.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.581+0000 7fe0b8e33700 1 --2- 172.21.15.146:0/4139063798 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0b406eda0 0x7fe0b40adee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:15.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.581+0000 7fe0b8e33700 1 --2- 172.21.15.146:0/4139063798 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0b40676c0 0x7fe0b415c700 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:15.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.581+0000 7fe0b8e33700 1 --2- 172.21.15.146:0/4139063798 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0b4067a90 0x7fe0b40ad9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:15.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.581+0000 7fe0b8e33700 1 -- 172.21.15.146:0/4139063798 >> 172.21.15.146:0/4139063798 conn(0x7fe0b4068580 msgr2=0x7fe0b4149840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:15.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.581+0000 7fe0b8e33700 1 -- 172.21.15.146:0/4139063798 shutdown_connections 2023-10-06T11:15:15.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.581+0000 7fe0b8e33700 1 -- 172.21.15.146:0/4139063798 wait complete. 2023-10-06T11:15:15.595 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:15:15.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.709+0000 7f4c18a37700 1 Processor -- start 2023-10-06T11:15:15.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.709+0000 7f4c18a37700 1 -- start start 2023-10-06T11:15:15.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.710+0000 7f4c18a37700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4c140ced80 0x7f4c140c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:15.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.710+0000 7f4c18a37700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4c140c3910 0x7f4c140cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:15.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.710+0000 7f4c18a37700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c140cf210 con 0x7f4c140b0c00 2023-10-06T11:15:15.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.710+0000 7f4c18a37700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c140682f0 con 0x7f4c140ced80 2023-10-06T11:15:15.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.710+0000 7f4c18a37700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c14068580 con 0x7f4c140c3910 2023-10-06T11:15:15.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.710+0000 7f4c09d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4c140ced80 0x7f4c140c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:15.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.710+0000 7f4c09d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4c140ced80 0x7f4c140c8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35336/0 (socket says 172.21.15.146:35336) 2023-10-06T11:15:15.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.710+0000 7f4c09d9b700 1 -- 172.21.15.146:0/744924232 learned_addr learned my addr 172.21.15.146:0/744924232 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:15.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.710+0000 7f4c12d9d700 1 --2- 172.21.15.146:0/744924232 >> v2:172.21.15.151:3300/0 conn(0x7f4c140c3910 0x7f4c140cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:15.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.710+0000 7f4c09d9b700 1 -- 172.21.15.146:0/744924232 >> v2:172.21.15.151:3300/0 conn(0x7f4c140c3910 msgr2=0x7f4c140cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:15.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.710+0000 7f4c09d9b700 1 --2- 172.21.15.146:0/744924232 >> v2:172.21.15.151:3300/0 conn(0x7f4c140c3910 0x7f4c140cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:15.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.711+0000 7f4c09d9b700 1 -- 172.21.15.146:0/744924232 >> v1:172.21.15.151:6789/0 conn(0x7f4c140b0c00 legacy=0x7f4c140c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:15.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.711+0000 7f4c09d9b700 1 -- 172.21.15.146:0/744924232 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c14068790 con 0x7f4c140ced80 2023-10-06T11:15:15.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.711+0000 7f4c09d9b700 1 --2- 172.21.15.146:0/744924232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c140ced80 0x7f4c140c8aa0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f4c1406fd00 tx=0x7f4bfc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6e7aed48d72a371 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:15.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.711+0000 7f4c11d9b700 1 -- 172.21.15.146:0/744924232 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc00b8b0 con 0x7f4c140ced80 2023-10-06T11:15:15.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.711+0000 7f4c11d9b700 1 -- 172.21.15.146:0/744924232 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bfc00ba10 con 0x7f4c140ced80 2023-10-06T11:15:15.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.711+0000 7f4c11d9b700 1 -- 172.21.15.146:0/744924232 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bfc00bdb0 con 0x7f4c140ced80 2023-10-06T11:15:15.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.711+0000 7f4c18a37700 1 -- 172.21.15.146:0/744924232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c140ced80 msgr2=0x7f4c140c8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:15.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.711+0000 7f4c18a37700 1 --2- 172.21.15.146:0/744924232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c140ced80 0x7f4c140c8aa0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f4c1406fd00 tx=0x7f4bfc009250 comp rx=0 tx=0).stop 2023-10-06T11:15:15.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.711+0000 7f4c18a37700 1 -- 172.21.15.146:0/744924232 shutdown_connections 2023-10-06T11:15:15.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.711+0000 7f4c18a37700 1 --2- 172.21.15.146:0/744924232 >> v2:172.21.15.151:3300/0 conn(0x7f4c140c3910 0x7f4c140cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:15.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.711+0000 7f4c18a37700 1 --2- 172.21.15.146:0/744924232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c140ced80 0x7f4c140c8aa0 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:15.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.711+0000 7f4c18a37700 1 -- 172.21.15.146:0/744924232 >> 172.21.15.146:0/744924232 conn(0x7f4c14067c50 msgr2=0x7f4c140ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:15.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.711+0000 7f4c18a37700 1 -- 172.21.15.146:0/744924232 shutdown_connections 2023-10-06T11:15:15.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.711+0000 7f4c18a37700 1 -- 172.21.15.146:0/744924232 wait complete. 2023-10-06T11:15:15.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.713+0000 7f4c18a37700 1 Processor -- start 2023-10-06T11:15:15.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.713+0000 7f4c18a37700 1 -- start start 2023-10-06T11:15:15.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.713+0000 7f4c18a37700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4c140b0c00 0x7f4c1409bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:15.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.713+0000 7f4c18a37700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4c140c3910 0x7f4c14098a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:15.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.713+0000 7f4c18a37700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c140ced80 0x7f4c1414c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:15.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.713+0000 7f4c18a37700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c14098fa0 con 0x7f4c140ced80 2023-10-06T11:15:15.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.713+0000 7f4c18a37700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1409a860 con 0x7f4c140b0c00 2023-10-06T11:15:15.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.713+0000 7f4c18a37700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1409a3d0 con 0x7f4c140c3910 2023-10-06T11:15:15.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.713+0000 7f4c12d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c140ced80 0x7f4c1414c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:15.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.714+0000 7f4c12d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c140ced80 0x7f4c1414c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35346/0 (socket says 172.21.15.146:35346) 2023-10-06T11:15:15.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.714+0000 7f4c12d9d700 1 -- 172.21.15.146:0/3860350429 learned_addr learned my addr 172.21.15.146:0/3860350429 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:15.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.714+0000 7f4c1259c700 1 --2- 172.21.15.146:0/3860350429 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4c140b0c00 0x7f4c1409bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:15.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.714+0000 7f4c09d9b700 1 --2- 172.21.15.146:0/3860350429 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4c140c3910 0x7f4c14098a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:15.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.714+0000 7f4c12d9d700 1 -- 172.21.15.146:0/3860350429 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4c140c3910 msgr2=0x7f4c14098a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:15.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.714+0000 7f4c12d9d700 1 --2- 172.21.15.146:0/3860350429 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4c140c3910 0x7f4c14098a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:15.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.714+0000 7f4c12d9d700 1 -- 172.21.15.146:0/3860350429 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4c140b0c00 msgr2=0x7f4c1409bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:15.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.714+0000 7f4c12d9d700 1 --2- 172.21.15.146:0/3860350429 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4c140b0c00 0x7f4c1409bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:15.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.714+0000 7f4c12d9d700 1 -- 172.21.15.146:0/3860350429 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bfc0094f0 con 0x7f4c140ced80 2023-10-06T11:15:15.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.714+0000 7f4c12d9d700 1 --2- 172.21.15.146:0/3860350429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c140ced80 0x7f4c1414c3a0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c00ceb0 tx=0x7f4c0c007840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:15.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.714+0000 7f4c0affd700 1 -- 172.21.15.146:0/3860350429 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c00ad50 con 0x7f4c140ced80 2023-10-06T11:15:15.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.714+0000 7f4c0affd700 1 -- 172.21.15.146:0/3860350429 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c0c016430 con 0x7f4c140ced80 2023-10-06T11:15:15.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.714+0000 7f4c18a37700 1 -- 172.21.15.146:0/3860350429 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c140c7f00 con 0x7f4c140ced80 2023-10-06T11:15:15.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.714+0000 7f4c0affd700 1 -- 172.21.15.146:0/3860350429 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c0167d0 con 0x7f4c140ced80 2023-10-06T11:15:15.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.714+0000 7f4c18a37700 1 -- 172.21.15.146:0/3860350429 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c14099d80 con 0x7f4c140ced80 2023-10-06T11:15:15.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.715+0000 7f4c18a37700 1 -- 172.21.15.146:0/3860350429 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c1404c380 con 0x7f4c140ced80 2023-10-06T11:15:15.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.715+0000 7f4c0affd700 1 -- 172.21.15.146:0/3860350429 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4c0c003020 con 0x7f4c140ced80 2023-10-06T11:15:15.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.716+0000 7f4c0affd700 1 --2- 172.21.15.146:0/3860350429 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4bf4066f30 0x7f4bf40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:15.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.716+0000 7f4c0affd700 1 -- 172.21.15.146:0/3860350429 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4c0c012070 con 0x7f4c140ced80 2023-10-06T11:15:15.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.716+0000 7f4c1259c700 1 --2- 172.21.15.146:0/3860350429 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4bf4066f30 0x7f4bf40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:15.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.716+0000 7f4c1259c700 1 --2- 172.21.15.146:0/3860350429 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4bf4066f30 0x7f4bf40693e0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4c04003a30 tx=0x7f4c04007ea0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:15.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.720+0000 7f4c0affd700 1 -- 172.21.15.146:0/3860350429 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4c0c052540 con 0x7f4c140ced80 2023-10-06T11:15:15.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.946+0000 7f4c18a37700 1 -- 172.21.15.146:0/3860350429 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c1409a510 con 0x7f4c140ced80 2023-10-06T11:15:15.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.946+0000 7f4c0affd700 1 -- 172.21.15.146:0/3860350429 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) v1 ==== 95+0+4617 (secure 0 0 0) 0x7f4c0c055b60 con 0x7f4c140ced80 2023-10-06T11:15:15.948 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:15:15.948 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":108,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7792,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3693464886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3693464886},{"type":"v1","addr":"172.21.15.151:6834","nonce":3693464886}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103},{"gid":7795,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1155762565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":1155762565},{"type":"v1","addr":"172.21.15.151:6835","nonce":1155762565}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103},{"gid":8679,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/3868720724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3868720724},{"type":"v1","addr":"172.21.15.146:6836","nonce":3868720724}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:15:11.929158+0000","modified":"2023-10-06T11:15:15.569866+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8682},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8682":{"gid":8682,"name":"c","rank":0,"incarnation":104,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/1974709597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":1974709597},{"type":"v1","addr":"172.21.15.146:6837","nonce":1974709597}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-06T11:15:15.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.948+0000 7f4c18a37700 1 -- 172.21.15.146:0/3860350429 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4bf4066f30 msgr2=0x7f4bf40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:15.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.948+0000 7f4c18a37700 1 --2- 172.21.15.146:0/3860350429 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4bf4066f30 0x7f4bf40693e0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f4c04003a30 tx=0x7f4c04007ea0 comp rx=0 tx=0).stop 2023-10-06T11:15:15.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.948+0000 7f4c18a37700 1 -- 172.21.15.146:0/3860350429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c140ced80 msgr2=0x7f4c1414c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:15.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.948+0000 7f4c18a37700 1 --2- 172.21.15.146:0/3860350429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c140ced80 0x7f4c1414c3a0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c00ceb0 tx=0x7f4c0c007840 comp rx=0 tx=0).stop 2023-10-06T11:15:15.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.948+0000 7f4c18a37700 1 -- 172.21.15.146:0/3860350429 shutdown_connections 2023-10-06T11:15:15.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.948+0000 7f4c18a37700 1 --2- 172.21.15.146:0/3860350429 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4bf4066f30 0x7f4bf40693e0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:15.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.948+0000 7f4c18a37700 1 --2- 172.21.15.146:0/3860350429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4c140ced80 0x7f4c1414c3a0 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:15.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.948+0000 7f4c18a37700 1 --2- 172.21.15.146:0/3860350429 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4c140b0c00 0x7f4c1409bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:15.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.948+0000 7f4c18a37700 1 --2- 172.21.15.146:0/3860350429 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4c140c3910 0x7f4c14098a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:15.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.948+0000 7f4c18a37700 1 -- 172.21.15.146:0/3860350429 >> 172.21.15.146:0/3860350429 conn(0x7f4c14067c50 msgr2=0x7f4c141590f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:15.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.948+0000 7f4c18a37700 1 -- 172.21.15.146:0/3860350429 shutdown_connections 2023-10-06T11:15:15.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:15.948+0000 7f4c18a37700 1 -- 172.21.15.146:0/3860350429 wait complete. 2023-10-06T11:15:15.952 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 108 2023-10-06T11:15:15.962 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:15:16.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.075+0000 7f8252472700 1 Processor -- start 2023-10-06T11:15:16.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.075+0000 7f8252472700 1 -- start start 2023-10-06T11:15:16.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.076+0000 7f8252472700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f824c153ab0 0x7f824c15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:16.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.076+0000 7f8252472700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f824c153e80 0x7f824c068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:16.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.076+0000 7f8252472700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f824c15ac30 con 0x7f824c0689d0 2023-10-06T11:15:16.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.076+0000 7f8252472700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f824c068e50 con 0x7f824c153ab0 2023-10-06T11:15:16.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.076+0000 7f8252472700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f824c0b4510 con 0x7f824c153e80 2023-10-06T11:15:16.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.076+0000 7f824bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f824c153ab0 0x7f824c15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:16.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.076+0000 7f8250a0f700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f824c0689d0 0x7f824c15d270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59224/0 (socket says 172.21.15.146:59224) 2023-10-06T11:15:16.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.076+0000 7f8250a0f700 1 -- 172.21.15.146:0/301378560 learned_addr learned my addr 172.21.15.146:0/301378560 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:15:16.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.077+0000 7f824bfff700 1 -- 172.21.15.146:0/301378560 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f824c153e80 msgr2=0x7f824c068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:16.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.076+0000 7f824b7fe700 1 --2- 172.21.15.146:0/301378560 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f824c153e80 0x7f824c068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:16.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.077+0000 7f824bfff700 1 --2- 172.21.15.146:0/301378560 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f824c153e80 0x7f824c068490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.077+0000 7f824bfff700 1 -- 172.21.15.146:0/301378560 >> v1:172.21.15.146:6789/0 conn(0x7f824c0689d0 legacy=0x7f824c15d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:16.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.077+0000 7f824affd700 1 -- 172.21.15.146:0/301378560 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 231466878 0 0) 0x7f8244001490 con 0x7f824c0689d0 2023-10-06T11:15:16.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.077+0000 7f824bfff700 1 -- 172.21.15.146:0/301378560 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f824c0b6530 con 0x7f824c153ab0 2023-10-06T11:15:16.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.077+0000 7f824bfff700 1 --2- 172.21.15.146:0/301378560 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f824c153ab0 0x7f824c15a6f0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f823c0098e0 tx=0x7f823c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb23076e64f174c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:16.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.077+0000 7f824affd700 1 -- 172.21.15.146:0/301378560 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823c009e80 con 0x7f824c153ab0 2023-10-06T11:15:16.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.077+0000 7f824affd700 1 -- 172.21.15.146:0/301378560 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f823c00b860 con 0x7f824c153ab0 2023-10-06T11:15:16.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.077+0000 7f824affd700 1 -- 172.21.15.146:0/301378560 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823c00bbe0 con 0x7f824c153ab0 2023-10-06T11:15:16.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.077+0000 7f8252472700 1 -- 172.21.15.146:0/301378560 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f824c153ab0 msgr2=0x7f824c15a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:16.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.077+0000 7f8252472700 1 --2- 172.21.15.146:0/301378560 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f824c153ab0 0x7f824c15a6f0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f823c0098e0 tx=0x7f823c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.077+0000 7f8252472700 1 -- 172.21.15.146:0/301378560 shutdown_connections 2023-10-06T11:15:16.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.077+0000 7f8252472700 1 --2- 172.21.15.146:0/301378560 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f824c153ab0 0x7f824c15a6f0 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.077+0000 7f8252472700 1 --2- 172.21.15.146:0/301378560 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f824c153e80 0x7f824c068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.077+0000 7f8252472700 1 -- 172.21.15.146:0/301378560 >> 172.21.15.146:0/301378560 conn(0x7f824c06eba0 msgr2=0x7f824c06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:16.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.077+0000 7f8252472700 1 -- 172.21.15.146:0/301378560 shutdown_connections 2023-10-06T11:15:16.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.077+0000 7f8252472700 1 -- 172.21.15.146:0/301378560 wait complete. 2023-10-06T11:15:16.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.078+0000 7f8252472700 1 Processor -- start 2023-10-06T11:15:16.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.079+0000 7f8252472700 1 -- start start 2023-10-06T11:15:16.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.079+0000 7f8252472700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f824c0689d0 0x7f824c156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:16.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.079+0000 7f8252472700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f824c153ab0 0x7f824c15a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:16.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.079+0000 7f8252472700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f824c153e80 0x7f824c1545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:16.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.079+0000 7f8252472700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f824c158e90 con 0x7f824c153e80 2023-10-06T11:15:16.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.079+0000 7f8252472700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f824c159130 con 0x7f824c0689d0 2023-10-06T11:15:16.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.079+0000 7f8252472700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f824c159410 con 0x7f824c153ab0 2023-10-06T11:15:16.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.079+0000 7f8250a0f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f824c153e80 0x7f824c1545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:16.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.079+0000 7f8250a0f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f824c153e80 0x7f824c1545c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35364/0 (socket says 172.21.15.146:35364) 2023-10-06T11:15:16.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.079+0000 7f8250a0f700 1 -- 172.21.15.146:0/3001845464 learned_addr learned my addr 172.21.15.146:0/3001845464 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:16.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.080+0000 7f824bfff700 1 --2- 172.21.15.146:0/3001845464 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f824c0689d0 0x7f824c156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:16.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.080+0000 7f824b7fe700 1 --2- 172.21.15.146:0/3001845464 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f824c153ab0 0x7f824c15a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:16.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.080+0000 7f8250a0f700 1 -- 172.21.15.146:0/3001845464 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f824c153ab0 msgr2=0x7f824c15a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:16.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.080+0000 7f8250a0f700 1 --2- 172.21.15.146:0/3001845464 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f824c153ab0 0x7f824c15a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.080+0000 7f8250a0f700 1 -- 172.21.15.146:0/3001845464 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f824c0689d0 msgr2=0x7f824c156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:16.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.080+0000 7f8250a0f700 1 --2- 172.21.15.146:0/3001845464 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f824c0689d0 0x7f824c156f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.080+0000 7f8250a0f700 1 -- 172.21.15.146:0/3001845464 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f823c009420 con 0x7f824c153e80 2023-10-06T11:15:16.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.080+0000 7f824b7fe700 1 --2- 172.21.15.146:0/3001845464 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f824c153ab0 0x7f824c15a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:16.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.080+0000 7f824bfff700 1 --2- 172.21.15.146:0/3001845464 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f824c0689d0 0x7f824c156f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:16.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.080+0000 7f8250a0f700 1 --2- 172.21.15.146:0/3001845464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f824c153e80 0x7f824c1545c0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f824400cbf0 tx=0x7f82440019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:16.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.080+0000 7f8233fff700 1 -- 172.21.15.146:0/3001845464 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f824400a9c0 con 0x7f824c153e80 2023-10-06T11:15:16.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.080+0000 7f8233fff700 1 -- 172.21.15.146:0/3001845464 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f824400ab20 con 0x7f824c153e80 2023-10-06T11:15:16.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.080+0000 7f8252472700 1 -- 172.21.15.146:0/3001845464 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f824c1596f0 con 0x7f824c153e80 2023-10-06T11:15:16.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.080+0000 7f8233fff700 1 -- 172.21.15.146:0/3001845464 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82440070f0 con 0x7f824c153e80 2023-10-06T11:15:16.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.080+0000 7f8252472700 1 -- 172.21.15.146:0/3001845464 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f824c159d30 con 0x7f824c153e80 2023-10-06T11:15:16.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.081+0000 7f8252472700 1 -- 172.21.15.146:0/3001845464 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f824c04c380 con 0x7f824c153e80 2023-10-06T11:15:16.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.081+0000 7f8233fff700 1 -- 172.21.15.146:0/3001845464 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8244007520 con 0x7f824c153e80 2023-10-06T11:15:16.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.082+0000 7f8233fff700 1 --2- 172.21.15.146:0/3001845464 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8238066f30 0x7f82380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:16.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.082+0000 7f8233fff700 1 -- 172.21.15.146:0/3001845464 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8244084930 con 0x7f824c153e80 2023-10-06T11:15:16.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.082+0000 7f824bfff700 1 --2- 172.21.15.146:0/3001845464 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8238066f30 0x7f82380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:16.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.082+0000 7f824bfff700 1 --2- 172.21.15.146:0/3001845464 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8238066f30 0x7f82380693e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f823c003080 tx=0x7f823c017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:16.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.086+0000 7f8233fff700 1 -- 172.21.15.146:0/3001845464 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8244051ac0 con 0x7f824c153e80 2023-10-06T11:15:16.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.271+0000 7f8252472700 1 -- 172.21.15.146:0/3001845464 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f824c0b3720 con 0x7f824c153e80 2023-10-06T11:15:16.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.272+0000 7f8233fff700 1 -- 172.21.15.146:0/3001845464 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+16928 (secure 0 0 0) 0x7f82440550e0 con 0x7f824c153e80 2023-10-06T11:15:16.274 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:15:16.274 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":125,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:15:13.549213+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:15:09.613367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-10-06T11:15:10.888669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:15:16.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.274+0000 7f8252472700 1 -- 172.21.15.146:0/3001845464 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8238066f30 msgr2=0x7f82380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:16.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.274+0000 7f8252472700 1 --2- 172.21.15.146:0/3001845464 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8238066f30 0x7f82380693e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f823c003080 tx=0x7f823c017000 comp rx=0 tx=0).stop 2023-10-06T11:15:16.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.274+0000 7f8252472700 1 -- 172.21.15.146:0/3001845464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f824c153e80 msgr2=0x7f824c1545c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:16.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.274+0000 7f8252472700 1 --2- 172.21.15.146:0/3001845464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f824c153e80 0x7f824c1545c0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f824400cbf0 tx=0x7f82440019b0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.274+0000 7f8252472700 1 -- 172.21.15.146:0/3001845464 shutdown_connections 2023-10-06T11:15:16.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.274+0000 7f8252472700 1 --2- 172.21.15.146:0/3001845464 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8238066f30 0x7f82380693e0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.274+0000 7f8252472700 1 --2- 172.21.15.146:0/3001845464 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f824c153e80 0x7f824c1545c0 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.274+0000 7f8252472700 1 --2- 172.21.15.146:0/3001845464 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f824c0689d0 0x7f824c156f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.274+0000 7f8252472700 1 --2- 172.21.15.146:0/3001845464 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f824c153ab0 0x7f824c15a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.274+0000 7f8252472700 1 -- 172.21.15.146:0/3001845464 >> 172.21.15.146:0/3001845464 conn(0x7f824c06eba0 msgr2=0x7f824c151f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:16.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.274+0000 7f8252472700 1 -- 172.21.15.146:0/3001845464 shutdown_connections 2023-10-06T11:15:16.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.274+0000 7f8252472700 1 -- 172.21.15.146:0/3001845464 wait complete. 2023-10-06T11:15:16.289 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T11:15:16.289 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:15:16.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.403+0000 7fb0b8a05700 1 Processor -- start 2023-10-06T11:15:16.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.403+0000 7fb0b8a05700 1 -- start start 2023-10-06T11:15:16.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.404+0000 7fb0b8a05700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb0b4153ab0 0x7fb0b415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:16.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.404+0000 7fb0b8a05700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb0b4068ba0 0x7fb0b40b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:16.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.404+0000 7fb0b8a05700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0b415ac30 con 0x7fb0b4153e80 2023-10-06T11:15:16.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.404+0000 7fb0b8a05700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0b40b4510 con 0x7fb0b4153ab0 2023-10-06T11:15:16.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.404+0000 7fb0b8a05700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0b40b6530 con 0x7fb0b4068ba0 2023-10-06T11:15:16.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.404+0000 7fb0b259c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb0b4153ab0 0x7fb0b415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:16.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.404+0000 7fb0b1d9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb0b4153e80 0x7fb0b4068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59230/0 (socket says 172.21.15.146:59230) 2023-10-06T11:15:16.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.404+0000 7fb0b1d9b700 1 -- 172.21.15.146:0/2295507413 learned_addr learned my addr 172.21.15.146:0/2295507413 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:15:16.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.404+0000 7fb0b259c700 1 -- 172.21.15.146:0/2295507413 >> v2:172.21.15.151:3300/0 conn(0x7fb0b4068ba0 msgr2=0x7fb0b40b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:16.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.404+0000 7fb0b259c700 1 --2- 172.21.15.146:0/2295507413 >> v2:172.21.15.151:3300/0 conn(0x7fb0b4068ba0 0x7fb0b40b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.404+0000 7fb0b259c700 1 -- 172.21.15.146:0/2295507413 >> v1:172.21.15.146:6789/0 conn(0x7fb0b4153e80 legacy=0x7fb0b4068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:16.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.404+0000 7fb0b259c700 1 -- 172.21.15.146:0/2295507413 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b40b5c50 con 0x7fb0b4153ab0 2023-10-06T11:15:16.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.404+0000 7fb0b159a700 1 -- 172.21.15.146:0/2295507413 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3088572818 0 0) 0x7fb09c001110 con 0x7fb0b4153e80 2023-10-06T11:15:16.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.404+0000 7fb0b259c700 1 --2- 172.21.15.146:0/2295507413 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0b4153ab0 0x7fb0b415a6f0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7fb0b40b36d0 tx=0x7fb0ac009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52cc4a1ef8fca57d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:16.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.404+0000 7fb0b159a700 1 -- 172.21.15.146:0/2295507413 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac00e070 con 0x7fb0b4153ab0 2023-10-06T11:15:16.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.404+0000 7fb0b159a700 1 -- 172.21.15.146:0/2295507413 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0ac00bc30 con 0x7fb0b4153ab0 2023-10-06T11:15:16.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.404+0000 7fb0b159a700 1 -- 172.21.15.146:0/2295507413 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac012430 con 0x7fb0b4153ab0 2023-10-06T11:15:16.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.405+0000 7fb0b8a05700 1 -- 172.21.15.146:0/2295507413 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0b4153ab0 msgr2=0x7fb0b415a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:16.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.405+0000 7fb0b8a05700 1 --2- 172.21.15.146:0/2295507413 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0b4153ab0 0x7fb0b415a6f0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7fb0b40b36d0 tx=0x7fb0ac009780 comp rx=0 tx=0).stop 2023-10-06T11:15:16.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.405+0000 7fb0b8a05700 1 -- 172.21.15.146:0/2295507413 shutdown_connections 2023-10-06T11:15:16.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.405+0000 7fb0b8a05700 1 --2- 172.21.15.146:0/2295507413 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0b4153ab0 0x7fb0b415a6f0 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.405+0000 7fb0b8a05700 1 --2- 172.21.15.146:0/2295507413 >> v2:172.21.15.151:3300/0 conn(0x7fb0b4068ba0 0x7fb0b40b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.405+0000 7fb0b8a05700 1 -- 172.21.15.146:0/2295507413 >> 172.21.15.146:0/2295507413 conn(0x7fb0b406eba0 msgr2=0x7fb0b406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:16.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.405+0000 7fb0b8a05700 1 -- 172.21.15.146:0/2295507413 shutdown_connections 2023-10-06T11:15:16.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.405+0000 7fb0b8a05700 1 -- 172.21.15.146:0/2295507413 wait complete. 2023-10-06T11:15:16.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.406+0000 7fb0b8a05700 1 Processor -- start 2023-10-06T11:15:16.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.406+0000 7fb0b8a05700 1 -- start start 2023-10-06T11:15:16.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.407+0000 7fb0b8a05700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0b4068ba0 0x7fb0b413ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:16.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.407+0000 7fb0b8a05700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0b4153ab0 0x7fb0b40b0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:16.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.407+0000 7fb0b8a05700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0b4153e80 0x7fb0b40b13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:16.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.407+0000 7fb0b8a05700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b4141c30 con 0x7fb0b4153ab0 2023-10-06T11:15:16.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.407+0000 7fb0b8a05700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b413f0f0 con 0x7fb0b4153e80 2023-10-06T11:15:16.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.407+0000 7fb0b8a05700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b4141020 con 0x7fb0b4068ba0 2023-10-06T11:15:16.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.407+0000 7fb0b1d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0b4153ab0 0x7fb0b40b0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:16.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.407+0000 7fb0b1d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0b4153ab0 0x7fb0b40b0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35380/0 (socket says 172.21.15.146:35380) 2023-10-06T11:15:16.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.407+0000 7fb0b1d9b700 1 -- 172.21.15.146:0/2339240338 learned_addr learned my addr 172.21.15.146:0/2339240338 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:16.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.407+0000 7fb0b1d9b700 1 -- 172.21.15.146:0/2339240338 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0b4068ba0 msgr2=0x7fb0b413ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:16.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.407+0000 7fb0b259c700 1 --2- 172.21.15.146:0/2339240338 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0b4068ba0 0x7fb0b413ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:16.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.407+0000 7fb0b1d9b700 1 --2- 172.21.15.146:0/2339240338 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0b4068ba0 0x7fb0b413ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.407+0000 7fb0b1d9b700 1 -- 172.21.15.146:0/2339240338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0b4153e80 msgr2=0x7fb0b40b13d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:16.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.407+0000 7fb0b2d9d700 1 --2- 172.21.15.146:0/2339240338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0b4153e80 0x7fb0b40b13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:16.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.407+0000 7fb0b1d9b700 1 --2- 172.21.15.146:0/2339240338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0b4153e80 0x7fb0b40b13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.407+0000 7fb0b1d9b700 1 -- 172.21.15.146:0/2339240338 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ac009a20 con 0x7fb0b4153ab0 2023-10-06T11:15:16.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.407+0000 7fb0b1d9b700 1 --2- 172.21.15.146:0/2339240338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0b4153ab0 0x7fb0b40b0e90 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7fb09c00c810 tx=0x7fb09c007c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:16.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.407+0000 7fb0aa7fc700 1 -- 172.21.15.146:0/2339240338 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c005b30 con 0x7fb0b4153ab0 2023-10-06T11:15:16.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.407+0000 7fb0aa7fc700 1 -- 172.21.15.146:0/2339240338 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09c005c90 con 0x7fb0b4153ab0 2023-10-06T11:15:16.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.408+0000 7fb0b8a05700 1 -- 172.21.15.146:0/2339240338 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0b4141300 con 0x7fb0b4153ab0 2023-10-06T11:15:16.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.408+0000 7fb0aa7fc700 1 -- 172.21.15.146:0/2339240338 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c007340 con 0x7fb0b4153ab0 2023-10-06T11:15:16.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.408+0000 7fb0b8a05700 1 -- 172.21.15.146:0/2339240338 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b41418c0 con 0x7fb0b4153ab0 2023-10-06T11:15:16.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.408+0000 7fb0b8a05700 1 -- 172.21.15.146:0/2339240338 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0b404c380 con 0x7fb0b4153ab0 2023-10-06T11:15:16.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.409+0000 7fb0aa7fc700 1 -- 172.21.15.146:0/2339240338 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb09c01b400 con 0x7fb0b4153ab0 2023-10-06T11:15:16.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.409+0000 7fb0aa7fc700 1 --2- 172.21.15.146:0/2339240338 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb094066f30 0x7fb0940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:16.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.409+0000 7fb0aa7fc700 1 -- 172.21.15.146:0/2339240338 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb09c083fd0 con 0x7fb0b4153ab0 2023-10-06T11:15:16.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.409+0000 7fb0b259c700 1 --2- 172.21.15.146:0/2339240338 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb094066f30 0x7fb0940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:16.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.410+0000 7fb0b259c700 1 --2- 172.21.15.146:0/2339240338 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb094066f30 0x7fb0940693e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fb0b40b36d0 tx=0x7fb0ac019000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:16.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.414+0000 7fb0aa7fc700 1 -- 172.21.15.146:0/2339240338 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb09c0510e0 con 0x7fb0b4153ab0 2023-10-06T11:15:16.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.595+0000 7fb0b8a05700 1 -- 172.21.15.146:0/2339240338 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb0b415ac30 con 0x7fb094066f30 2023-10-06T11:15:16.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.603+0000 7fb0aa7fc700 1 -- 172.21.15.146:0/2339240338 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303649 (secure 0 0 0) 0x7fb0b415ac30 con 0x7fb094066f30 2023-10-06T11:15:16.612 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:15:16.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.607+0000 7fb0b8a05700 1 -- 172.21.15.146:0/2339240338 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb094066f30 msgr2=0x7fb0940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:16.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.607+0000 7fb0b8a05700 1 --2- 172.21.15.146:0/2339240338 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb094066f30 0x7fb0940693e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fb0b40b36d0 tx=0x7fb0ac019000 comp rx=0 tx=0).stop 2023-10-06T11:15:16.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.607+0000 7fb0b8a05700 1 -- 172.21.15.146:0/2339240338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0b4153ab0 msgr2=0x7fb0b40b0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:16.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.607+0000 7fb0b8a05700 1 --2- 172.21.15.146:0/2339240338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0b4153ab0 0x7fb0b40b0e90 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7fb09c00c810 tx=0x7fb09c007c50 comp rx=0 tx=0).stop 2023-10-06T11:15:16.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.607+0000 7fb0b8a05700 1 -- 172.21.15.146:0/2339240338 shutdown_connections 2023-10-06T11:15:16.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.607+0000 7fb0b8a05700 1 --2- 172.21.15.146:0/2339240338 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb094066f30 0x7fb0940693e0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.607+0000 7fb0b8a05700 1 --2- 172.21.15.146:0/2339240338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0b4153e80 0x7fb0b40b13d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.607+0000 7fb0b8a05700 1 --2- 172.21.15.146:0/2339240338 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb0b4068ba0 0x7fb0b413ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.607+0000 7fb0b8a05700 1 --2- 172.21.15.146:0/2339240338 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb0b4153ab0 0x7fb0b40b0e90 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.607+0000 7fb0b8a05700 1 -- 172.21.15.146:0/2339240338 >> 172.21.15.146:0/2339240338 conn(0x7fb0b406eba0 msgr2=0x7fb0b4151e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:16.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.607+0000 7fb0b8a05700 1 -- 172.21.15.146:0/2339240338 shutdown_connections 2023-10-06T11:15:16.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.607+0000 7fb0b8a05700 1 -- 172.21.15.146:0/2339240338 wait complete. 2023-10-06T11:15:16.615 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:15:16.621 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":407,"stamp":"2023-10-06T11:15:15.262227+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":132,"acting":132,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":46,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2461008,"kb_used_data":13072,"kb_used_omap":0,"kb_used_meta":2447872,"kb_avail":752513712,"statfs":{"total":773094113280,"available":770574041088,"internally_reserved":0,"allocated":13385728,"data_stored":6747542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2506620928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.728564"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.548374+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:03:55.986977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.551608+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:25:18.441894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.545346+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:49:53.647910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.553845+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:35:58.009437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.545643+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:58:42.165232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.545611+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:51:27.969369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.551293+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:45:49.982194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.554183+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:33:57.627561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.549474+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:19:29.875101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.549075+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:14:08.040389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.550511+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:06.278594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.549144+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:16:46.194765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.544258+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:33:57.627561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.544863+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:14.774930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.615827+0000","last_change":"2023-10-06T11:15:11.615827+0000","last_active":"2023-10-06T11:15:11.615827+0000","last_peered":"2023-10-06T11:15:11.615827+0000","last_clean":"2023-10-06T11:15:11.615827+0000","last_became_active":"2023-10-06T11:15:11.615550+0000","last_became_peered":"2023-10-06T11:15:11.615550+0000","last_unstale":"2023-10-06T11:15:11.615827+0000","last_undegraded":"2023-10-06T11:15:11.615827+0000","last_fullsized":"2023-10-06T11:15:11.615827+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:12:08.245890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:10.525068+0000","last_change":"2023-10-06T11:15:10.538091+0000","last_active":"2023-10-06T11:15:10.525068+0000","last_peered":"2023-10-06T11:15:10.525068+0000","last_clean":"2023-10-06T11:15:10.525068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:10.525068+0000","last_undegraded":"2023-10-06T11:15:10.525068+0000","last_fullsized":"2023-10-06T11:15:10.525068+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:35:57.001079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:10.525068+0000","last_change":"2023-10-06T11:15:10.658132+0000","last_active":"2023-10-06T11:15:10.525068+0000","last_peered":"2023-10-06T11:15:10.525068+0000","last_clean":"2023-10-06T11:15:10.525068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:10.525068+0000","last_undegraded":"2023-10-06T11:15:10.525068+0000","last_fullsized":"2023-10-06T11:15:10.525068+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:30:36.204472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:10.525068+0000","last_change":"2023-10-06T11:15:10.658099+0000","last_active":"2023-10-06T11:15:10.525068+0000","last_peered":"2023-10-06T11:15:10.525068+0000","last_clean":"2023-10-06T11:15:10.525068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:10.525068+0000","last_undegraded":"2023-10-06T11:15:10.525068+0000","last_fullsized":"2023-10-06T11:15:10.525068+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:59:47.058196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.544806+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:42:28.514350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.555437+0000","last_change":"2023-10-06T11:15:11.555437+0000","last_active":"2023-10-06T11:15:11.555437+0000","last_peered":"2023-10-06T11:15:11.555437+0000","last_clean":"2023-10-06T11:15:11.555437+0000","last_became_active":"2023-10-06T11:15:11.555188+0000","last_became_peered":"2023-10-06T11:15:11.555188+0000","last_unstale":"2023-10-06T11:15:11.555437+0000","last_undegraded":"2023-10-06T11:15:11.555437+0000","last_fullsized":"2023-10-06T11:15:11.555437+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:35.856632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.545719+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:42:08.749955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:10.525068+0000","last_change":"2023-10-06T11:15:10.538184+0000","last_active":"2023-10-06T11:15:10.525068+0000","last_peered":"2023-10-06T11:15:10.525068+0000","last_clean":"2023-10-06T11:15:10.525068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:10.525068+0000","last_undegraded":"2023-10-06T11:15:10.525068+0000","last_fullsized":"2023-10-06T11:15:10.525068+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:11.919378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.555398+0000","last_change":"2023-10-06T11:15:11.555398+0000","last_active":"2023-10-06T11:15:11.555398+0000","last_peered":"2023-10-06T11:15:11.555398+0000","last_clean":"2023-10-06T11:15:11.555398+0000","last_became_active":"2023-10-06T11:15:11.555097+0000","last_became_peered":"2023-10-06T11:15:11.555097+0000","last_unstale":"2023-10-06T11:15:11.555398+0000","last_undegraded":"2023-10-06T11:15:11.555398+0000","last_fullsized":"2023-10-06T11:15:11.555398+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:19:28.866743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.615898+0000","last_change":"2023-10-06T11:15:11.615898+0000","last_active":"2023-10-06T11:15:11.615898+0000","last_peered":"2023-10-06T11:15:11.615898+0000","last_clean":"2023-10-06T11:15:11.615898+0000","last_became_active":"2023-10-06T11:15:11.615593+0000","last_became_peered":"2023-10-06T11:15:11.615593+0000","last_unstale":"2023-10-06T11:15:11.615898+0000","last_undegraded":"2023-10-06T11:15:11.615898+0000","last_fullsized":"2023-10-06T11:15:11.615898+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:31:06.545416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.548277+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:04.347350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:10.525068+0000","last_change":"2023-10-06T11:15:10.535772+0000","last_active":"2023-10-06T11:15:10.525068+0000","last_peered":"2023-10-06T11:15:10.525068+0000","last_clean":"2023-10-06T11:15:10.525068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:10.525068+0000","last_undegraded":"2023-10-06T11:15:10.525068+0000","last_fullsized":"2023-10-06T11:15:10.525068+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:14:07.032030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.615617+0000","last_change":"2023-10-06T11:15:11.615617+0000","last_active":"2023-10-06T11:15:11.615617+0000","last_peered":"2023-10-06T11:15:11.615617+0000","last_clean":"2023-10-06T11:15:11.615617+0000","last_became_active":"2023-10-06T11:15:11.615338+0000","last_became_peered":"2023-10-06T11:15:11.615338+0000","last_unstale":"2023-10-06T11:15:11.615617+0000","last_undegraded":"2023-10-06T11:15:11.615617+0000","last_fullsized":"2023-10-06T11:15:11.615617+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:14:50.760693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.555479+0000","last_change":"2023-10-06T11:15:11.555479+0000","last_active":"2023-10-06T11:15:11.555479+0000","last_peered":"2023-10-06T11:15:11.555479+0000","last_clean":"2023-10-06T11:15:11.555479+0000","last_became_active":"2023-10-06T11:15:11.553333+0000","last_became_peered":"2023-10-06T11:15:11.553333+0000","last_unstale":"2023-10-06T11:15:11.555479+0000","last_undegraded":"2023-10-06T11:15:11.555479+0000","last_fullsized":"2023-10-06T11:15:11.555479+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:14:07.032030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:10.525068+0000","last_change":"2023-10-06T11:15:10.538807+0000","last_active":"2023-10-06T11:15:10.525068+0000","last_peered":"2023-10-06T11:15:10.525068+0000","last_clean":"2023-10-06T11:15:10.525068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:10.525068+0000","last_undegraded":"2023-10-06T11:15:10.525068+0000","last_fullsized":"2023-10-06T11:15:10.525068+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:57:35.417949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.553701+0000","last_change":"2023-10-06T11:15:11.553701+0000","last_active":"2023-10-06T11:15:11.553701+0000","last_peered":"2023-10-06T11:15:11.553701+0000","last_clean":"2023-10-06T11:15:11.553701+0000","last_became_active":"2023-10-06T11:15:11.553429+0000","last_became_peered":"2023-10-06T11:15:11.553429+0000","last_unstale":"2023-10-06T11:15:11.553701+0000","last_undegraded":"2023-10-06T11:15:11.553701+0000","last_fullsized":"2023-10-06T11:15:11.553701+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:11.919378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:10.525068+0000","last_change":"2023-10-06T11:15:10.538734+0000","last_active":"2023-10-06T11:15:10.525068+0000","last_peered":"2023-10-06T11:15:10.525068+0000","last_clean":"2023-10-06T11:15:10.525068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:10.525068+0000","last_undegraded":"2023-10-06T11:15:10.525068+0000","last_fullsized":"2023-10-06T11:15:10.525068+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:52:13.038637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:10.525068+0000","last_change":"2023-10-06T11:15:10.657559+0000","last_active":"2023-10-06T11:15:10.525068+0000","last_peered":"2023-10-06T11:15:10.525068+0000","last_clean":"2023-10-06T11:15:10.525068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:10.525068+0000","last_undegraded":"2023-10-06T11:15:10.525068+0000","last_fullsized":"2023-10-06T11:15:10.525068+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:58:41.156874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.556382+0000","last_change":"2023-10-06T11:15:11.556382+0000","last_active":"2023-10-06T11:15:11.556382+0000","last_peered":"2023-10-06T11:15:11.556382+0000","last_clean":"2023-10-06T11:15:11.556382+0000","last_became_active":"2023-10-06T11:15:11.556112+0000","last_became_peered":"2023-10-06T11:15:11.556112+0000","last_unstale":"2023-10-06T11:15:11.556382+0000","last_undegraded":"2023-10-06T11:15:11.556382+0000","last_fullsized":"2023-10-06T11:15:11.556382+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:16:45.186406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:10.525068+0000","last_change":"2023-10-06T11:15:10.538244+0000","last_active":"2023-10-06T11:15:10.525068+0000","last_peered":"2023-10-06T11:15:10.525068+0000","last_clean":"2023-10-06T11:15:10.525068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:10.525068+0000","last_undegraded":"2023-10-06T11:15:10.525068+0000","last_fullsized":"2023-10-06T11:15:10.525068+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:56.425415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.548722+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:12:17.067365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.557279+0000","last_change":"2023-10-06T11:15:11.557279+0000","last_active":"2023-10-06T11:15:11.557279+0000","last_peered":"2023-10-06T11:15:11.557279+0000","last_clean":"2023-10-06T11:15:11.557279+0000","last_became_active":"2023-10-06T11:15:11.556969+0000","last_became_peered":"2023-10-06T11:15:11.556969+0000","last_unstale":"2023-10-06T11:15:11.557279+0000","last_undegraded":"2023-10-06T11:15:11.557279+0000","last_fullsized":"2023-10-06T11:15:11.557279+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:35:57.001079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.615736+0000","last_change":"2023-10-06T11:15:11.615736+0000","last_active":"2023-10-06T11:15:11.615736+0000","last_peered":"2023-10-06T11:15:11.615736+0000","last_clean":"2023-10-06T11:15:11.615736+0000","last_became_active":"2023-10-06T11:15:11.615436+0000","last_became_peered":"2023-10-06T11:15:11.615436+0000","last_unstale":"2023-10-06T11:15:11.615736+0000","last_undegraded":"2023-10-06T11:15:11.615736+0000","last_fullsized":"2023-10-06T11:15:11.615736+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:25:17.433536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.559110+0000","last_change":"2023-10-06T11:15:11.559110+0000","last_active":"2023-10-06T11:15:11.559110+0000","last_peered":"2023-10-06T11:15:11.559110+0000","last_clean":"2023-10-06T11:15:11.559110+0000","last_became_active":"2023-10-06T11:15:11.558912+0000","last_became_peered":"2023-10-06T11:15:11.558912+0000","last_unstale":"2023-10-06T11:15:11.559110+0000","last_undegraded":"2023-10-06T11:15:11.559110+0000","last_fullsized":"2023-10-06T11:15:11.559110+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:06.108506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.551355+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:59:48.066554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:10.525068+0000","last_change":"2023-10-06T11:15:10.536559+0000","last_active":"2023-10-06T11:15:10.525068+0000","last_peered":"2023-10-06T11:15:10.525068+0000","last_clean":"2023-10-06T11:15:10.525068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:10.525068+0000","last_undegraded":"2023-10-06T11:15:10.525068+0000","last_fullsized":"2023-10-06T11:15:10.525068+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:16:45.186406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.551860+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:30:37.212830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:10.525068+0000","last_change":"2023-10-06T11:15:10.657560+0000","last_active":"2023-10-06T11:15:10.525068+0000","last_peered":"2023-10-06T11:15:10.525068+0000","last_clean":"2023-10-06T11:15:10.525068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:10.525068+0000","last_undegraded":"2023-10-06T11:15:10.525068+0000","last_fullsized":"2023-10-06T11:15:10.525068+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:45:48.973836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.553099+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:36.864990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.557480+0000","last_change":"2023-10-06T11:15:11.557480+0000","last_active":"2023-10-06T11:15:11.557480+0000","last_peered":"2023-10-06T11:15:11.557480+0000","last_clean":"2023-10-06T11:15:11.557480+0000","last_became_active":"2023-10-06T11:15:11.557275+0000","last_became_peered":"2023-10-06T11:15:11.557275+0000","last_unstale":"2023-10-06T11:15:11.557480+0000","last_undegraded":"2023-10-06T11:15:11.557480+0000","last_fullsized":"2023-10-06T11:15:11.557480+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:05.270236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:10.525068+0000","last_change":"2023-10-06T11:15:10.537588+0000","last_active":"2023-10-06T11:15:10.525068+0000","last_peered":"2023-10-06T11:15:10.525068+0000","last_clean":"2023-10-06T11:15:10.525068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:10.525068+0000","last_undegraded":"2023-10-06T11:15:10.525068+0000","last_fullsized":"2023-10-06T11:15:10.525068+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:23:19.627689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:10.525068+0000","last_change":"2023-10-06T11:15:10.537278+0000","last_active":"2023-10-06T11:15:10.525068+0000","last_peered":"2023-10-06T11:15:10.525068+0000","last_clean":"2023-10-06T11:15:10.525068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:10.525068+0000","last_undegraded":"2023-10-06T11:15:10.525068+0000","last_fullsized":"2023-10-06T11:15:10.525068+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:19:28.866743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":108,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-06T11:15:10.541325+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:15:10.541325+0000","last_peered":"2023-10-06T11:15:10.541325+0000","last_clean":"2023-10-06T11:15:10.541325+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:15:10.541325+0000","last_undegraded":"2023-10-06T11:15:10.541325+0000","last_fullsized":"2023-10-06T11:15:10.541325+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.551327+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:40.228447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:10.525068+0000","last_change":"2023-10-06T11:15:10.537563+0000","last_active":"2023-10-06T11:15:10.525068+0000","last_peered":"2023-10-06T11:15:10.525068+0000","last_clean":"2023-10-06T11:15:10.525068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:10.525068+0000","last_undegraded":"2023-10-06T11:15:10.525068+0000","last_fullsized":"2023-10-06T11:15:10.525068+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:56.255641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":98,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-10-06T11:15:08.206609+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:15:08.206609+0000","last_peered":"2023-10-06T11:15:08.206609+0000","last_clean":"2023-10-06T11:15:08.206609+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:15:08.206609+0000","last_undegraded":"2023-10-06T11:15:08.206609+0000","last_fullsized":"2023-10-06T11:15:08.206609+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.557485+0000","last_change":"2023-10-06T11:15:11.557485+0000","last_active":"2023-10-06T11:15:11.557485+0000","last_peered":"2023-10-06T11:15:11.557485+0000","last_clean":"2023-10-06T11:15:11.557485+0000","last_became_active":"2023-10-06T11:15:11.556885+0000","last_became_peered":"2023-10-06T11:15:11.556885+0000","last_unstale":"2023-10-06T11:15:11.557485+0000","last_undegraded":"2023-10-06T11:15:11.557485+0000","last_fullsized":"2023-10-06T11:15:11.557485+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:04:48.873690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":98,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-06T11:15:10.657847+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:15:10.657847+0000","last_peered":"2023-10-06T11:15:10.657847+0000","last_clean":"2023-10-06T11:15:10.657847+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:15:10.657847+0000","last_undegraded":"2023-10-06T11:15:10.657847+0000","last_fullsized":"2023-10-06T11:15:10.657847+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":241,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-10-06T11:15:08.207287+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:15:08.207287+0000","last_peered":"2023-10-06T11:15:08.207287+0000","last_clean":"2023-10-06T11:15:08.207287+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:15:08.207287+0000","last_undegraded":"2023-10-06T11:15:08.207287+0000","last_fullsized":"2023-10-06T11:15:08.207287+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.562606+0000","last_change":"2023-10-06T11:15:11.562606+0000","last_active":"2023-10-06T11:15:11.562606+0000","last_peered":"2023-10-06T11:15:11.562606+0000","last_clean":"2023-10-06T11:15:11.562606+0000","last_became_active":"2023-10-06T11:15:11.562331+0000","last_became_peered":"2023-10-06T11:15:11.562331+0000","last_unstale":"2023-10-06T11:15:11.562606+0000","last_undegraded":"2023-10-06T11:15:11.562606+0000","last_fullsized":"2023-10-06T11:15:11.562606+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:26.937119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":91,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-10-06T11:15:08.207316+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:15:08.207316+0000","last_peered":"2023-10-06T11:15:08.207316+0000","last_clean":"2023-10-06T11:15:08.207316+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:15:08.207316+0000","last_undegraded":"2023-10-06T11:15:08.207316+0000","last_fullsized":"2023-10-06T11:15:08.207316+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.555020+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:07.116865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:10.525068+0000","last_change":"2023-10-06T11:15:10.658153+0000","last_active":"2023-10-06T11:15:10.525068+0000","last_peered":"2023-10-06T11:15:10.525068+0000","last_clean":"2023-10-06T11:15:10.525068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:10.525068+0000","last_undegraded":"2023-10-06T11:15:10.525068+0000","last_fullsized":"2023-10-06T11:15:10.525068+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:25:17.433536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":91,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-10-06T11:15:08.207286+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:15:08.207286+0000","last_peered":"2023-10-06T11:15:08.207286+0000","last_clean":"2023-10-06T11:15:08.207286+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:15:08.207286+0000","last_undegraded":"2023-10-06T11:15:08.207286+0000","last_fullsized":"2023-10-06T11:15:08.207286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:10.525068+0000","last_change":"2023-10-06T11:15:10.537619+0000","last_active":"2023-10-06T11:15:10.525068+0000","last_peered":"2023-10-06T11:15:10.525068+0000","last_clean":"2023-10-06T11:15:10.525068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:10.525068+0000","last_undegraded":"2023-10-06T11:15:10.525068+0000","last_fullsized":"2023-10-06T11:15:10.525068+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:01.931642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":111,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-10-06T11:15:07.522479+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:15:07.522479+0000","last_peered":"2023-10-06T11:15:07.522479+0000","last_clean":"2023-10-06T11:15:07.522479+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:15:07.522479+0000","last_undegraded":"2023-10-06T11:15:07.522479+0000","last_fullsized":"2023-10-06T11:15:07.522479+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.550124+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:27.945477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:10.525068+0000","last_change":"2023-10-06T11:15:10.657476+0000","last_active":"2023-10-06T11:15:10.525068+0000","last_peered":"2023-10-06T11:15:10.525068+0000","last_clean":"2023-10-06T11:15:10.525068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:10.525068+0000","last_undegraded":"2023-10-06T11:15:10.525068+0000","last_fullsized":"2023-10-06T11:15:10.525068+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:51:26.961011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":99,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-06T11:15:10.536695+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:15:10.536695+0000","last_peered":"2023-10-06T11:15:10.536695+0000","last_clean":"2023-10-06T11:15:10.536695+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:15:10.536695+0000","last_undegraded":"2023-10-06T11:15:10.536695+0000","last_fullsized":"2023-10-06T11:15:10.536695+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.548629+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:11.072682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:10.525068+0000","last_change":"2023-10-06T11:15:10.657540+0000","last_active":"2023-10-06T11:15:10.525068+0000","last_peered":"2023-10-06T11:15:10.525068+0000","last_clean":"2023-10-06T11:15:10.525068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:10.525068+0000","last_undegraded":"2023-10-06T11:15:10.525068+0000","last_fullsized":"2023-10-06T11:15:10.525068+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:39.220089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":99,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-06T11:15:10.536733+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:15:10.536733+0000","last_peered":"2023-10-06T11:15:10.536733+0000","last_clean":"2023-10-06T11:15:10.536733+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:15:10.536733+0000","last_undegraded":"2023-10-06T11:15:10.536733+0000","last_fullsized":"2023-10-06T11:15:10.536733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":50,"acting":50,"num_store_stats":3},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574966,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299356,"kb_used_data":2068,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072484,"statfs":{"total":96636764160,"available":96330223616,"internally_reserved":0,"allocated":2117632,"data_stored":1285187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.51600000000000001,"15min":0.624},"min":{"1min":0.252,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.68899999999999995,"5min":4.407,"15min":23.908999999999999},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.48699999999999999,"15min":0.57499999999999996},"min":{"1min":0.26900000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.66600000000000004,"5min":0.69799999999999995,"15min":9.3230000000000004},"last":0.439}]},{"osd":1,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51200000000000001,"15min":0.56100000000000005},"min":{"1min":0.33200000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.73399999999999999,"5min":2.4689999999999999,"15min":9.2360000000000007},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47199999999999998,"15min":0.503},"min":{"1min":0.33100000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.70199999999999996,"5min":0.78900000000000003,"15min":4.327},"last":0.373}]},{"osd":2,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54200000000000004,"15min":0.51800000000000002},"min":{"1min":0.34399999999999997,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.748,"5min":4.3120000000000003,"15min":4.3120000000000003},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.53700000000000003,"15min":0.55700000000000005},"min":{"1min":0.311,"5min":0.31,"15min":0.29999999999999999},"max":{"1min":0.71599999999999997,"5min":3.0600000000000001,"15min":4.7309999999999999},"last":0.54600000000000004}]},{"osd":3,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.54700000000000004,"15min":0.53700000000000003},"min":{"1min":0.32600000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.60099999999999998,"5min":4.5190000000000001,"15min":4.5190000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55600000000000005,"15min":0.59799999999999998},"min":{"1min":0.40200000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.68100000000000005,"5min":3.0070000000000001,"15min":9.3879999999999999},"last":0.502}]},{"osd":4,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.498,"15min":0.48799999999999999},"min":{"1min":0.32700000000000001,"5min":0.26000000000000001,"15min":0.24399999999999999},"max":{"1min":0.59799999999999998,"5min":4.6639999999999997,"15min":4.6639999999999997},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53300000000000003,"15min":0.53400000000000003},"min":{"1min":0.28499999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.69199999999999995,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":0.53100000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.495,"15min":0.56000000000000005},"min":{"1min":0.32900000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.70999999999999996,"5min":0.79700000000000004,"15min":9.3499999999999996},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.497,"15min":0.54400000000000004},"min":{"1min":0.30099999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.65200000000000002,"5min":0.83399999999999996,"15min":4.444},"last":0.47299999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.59799999999999998},"min":{"1min":0.38100000000000001,"5min":0.32400000000000001,"15min":0.29199999999999998},"max":{"1min":0.64800000000000002,"5min":0.81399999999999995,"15min":9.4969999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.60299999999999998,"15min":0.61899999999999999},"min":{"1min":0.36699999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72299999999999998,"5min":4.4669999999999996,"15min":7.2039999999999997},"last":0.56299999999999994}]}]},{"osd":6,"up_from":13,"seq":55834574968,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311072,"kb_used_data":1496,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060768,"statfs":{"total":96636764160,"available":96318226432,"internally_reserved":0,"allocated":1531904,"data_stored":700074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.57899999999999996,"15min":0.52200000000000002},"min":{"1min":0.30299999999999999,"5min":0.187,"15min":0.187},"max":{"1min":9.5549999999999997,"5min":9.5549999999999997,"15min":9.5549999999999997},"last":0.45200000000000001},{"interface":"front","average":{"1min":1.032,"5min":0.63500000000000001,"15min":0.56299999999999994},"min":{"1min":0.38400000000000001,"5min":0.254,"15min":0.254},"max":{"1min":9.4659999999999993,"5min":9.4659999999999993,"15min":9.4659999999999993},"last":0.54700000000000004}]},{"osd":1,"last update":"Fri Oct 6 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.47199999999999998,"15min":0.48599999999999999},"min":{"1min":0.33400000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.80300000000000005,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56499999999999995,"15min":0.51600000000000001},"min":{"1min":0.32900000000000001,"5min":0.216,"15min":0.216},"max":{"1min":2.238,"5min":5.2670000000000003,"15min":5.2670000000000003},"last":0.48299999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.47999999999999998,"15min":0.498},"min":{"1min":0.255,"5min":0.252,"15min":0.252},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":7.0659999999999998},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.503,"5min":0.48699999999999999,"15min":0.51900000000000002},"min":{"1min":0.33700000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.72899999999999998,"5min":1.0069999999999999,"15min":7.0819999999999999},"last":0.504}]},{"osd":3,"last update":"Fri Oct 6 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.55000000000000004,"15min":0.51600000000000001},"min":{"1min":0.38400000000000001,"5min":0.317,"15min":0.25800000000000001},"max":{"1min":3.871,"5min":3.871,"15min":3.871},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.52700000000000002,"15min":0.53300000000000003},"min":{"1min":0.34799999999999998,"5min":0.316,"15min":0.312},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.47599999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.46000000000000002,"15min":0.48399999999999999},"min":{"1min":0.26800000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.628,"5min":0.88,"15min":0.88},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.51300000000000001,"15min":0.53900000000000003},"min":{"1min":0.32200000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.73399999999999999,"5min":0.82399999999999995,"15min":1.0680000000000001},"last":0.59299999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.503,"15min":0.52100000000000002},"min":{"1min":0.375,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.61199999999999999,"15min":0.58699999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":7.1379999999999999,"5min":7.1379999999999999,"15min":7.1379999999999999},"last":0.53700000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56599999999999995,"15min":0.58799999999999997},"min":{"1min":0.42799999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.88400000000000001},"last":0.55900000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574967,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311656,"kb_used_data":2080,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060184,"statfs":{"total":96636764160,"available":96317628416,"internally_reserved":0,"allocated":2129920,"data_stored":1291795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.45900000000000002,"15min":0.379},"min":{"1min":0.20499999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.67000000000000004,"5min":13.393000000000001,"15min":13.393000000000001},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.45700000000000002,"15min":0.38200000000000001},"min":{"1min":0.23599999999999999,"5min":0.22500000000000001,"15min":0.19700000000000001},"max":{"1min":0.64900000000000002,"5min":11.462,"15min":11.462},"last":0.33900000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.40400000000000003,"15min":0.35999999999999999},"min":{"1min":0.23599999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.47999999999999998,"5min":8.0470000000000006,"15min":8.0470000000000006},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.432,"15min":0.40500000000000003},"min":{"1min":0.26100000000000001,"5min":0.22800000000000001,"15min":0.20999999999999999},"max":{"1min":0.74299999999999999,"5min":4.8630000000000004,"15min":4.8630000000000004},"last":0.374}]},{"osd":3,"last update":"Fri Oct 6 11:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.44900000000000001,"15min":0.42399999999999999},"min":{"1min":0.313,"5min":0.252,"15min":0.252},"max":{"1min":0.71299999999999997,"5min":4.8029999999999999,"15min":4.8029999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.37,"5min":0.42999999999999999,"15min":0.39100000000000001},"min":{"1min":0.27600000000000002,"5min":0.217,"15min":0.217},"max":{"1min":0.68799999999999994,"5min":5.8700000000000001,"15min":5.8700000000000001},"last":0.40000000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51800000000000002,"15min":0.51500000000000001},"min":{"1min":0.38200000000000001,"5min":0.29499999999999998,"15min":0.28199999999999997},"max":{"1min":0.68500000000000005,"5min":1.264,"15min":1.264},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.60899999999999999,"15min":0.56599999999999995},"min":{"1min":0.35199999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.88600000000000001,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.48599999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.58799999999999997,"15min":0.56399999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71699999999999997,"5min":3.4390000000000001,"15min":3.4390000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.66000000000000003,"15min":0.58399999999999996},"min":{"1min":0.36799999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.69799999999999995,"5min":9.3829999999999991,"15min":9.3829999999999991},"last":0.5}]},{"osd":6,"last update":"Fri Oct 6 11:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.61899999999999999,"15min":0.58299999999999996},"min":{"1min":0.35999999999999999,"5min":0.34999999999999998,"15min":0.315},"max":{"1min":0.86699999999999999,"5min":3.4750000000000001,"15min":3.4750000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60999999999999999,"15min":0.58899999999999997},"min":{"1min":0.40400000000000003,"5min":0.379,"15min":0.36699999999999999},"max":{"1min":0.748,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.60699999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.64500000000000002,"15min":0.60999999999999999},"min":{"1min":0.42299999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92200000000000004,"5min":4.7290000000000001,"15min":4.7290000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.60999999999999999,"15min":0.59099999999999997},"min":{"1min":0.42099999999999999,"5min":0.378,"15min":0.374},"max":{"1min":0.89500000000000002,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.61599999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574966,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302856,"kb_used_data":1472,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068984,"statfs":{"total":96636764160,"available":96326639616,"internally_reserved":0,"allocated":1507328,"data_stored":687308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.42099999999999999,"15min":0.46800000000000003},"min":{"1min":0.20399999999999999,"5min":0.184,"15min":0.184},"max":{"1min":0.501,"5min":8.4239999999999995,"15min":36.097999999999999},"last":0.318},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.43099999999999999,"15min":0.377},"min":{"1min":0.22,"5min":0.20799999999999999,"15min":0.182},"max":{"1min":0.52000000000000002,"5min":7.2990000000000004,"15min":7.2990000000000004},"last":0.92400000000000004}]},{"osd":2,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.44800000000000001,"15min":0.50600000000000001},"min":{"1min":0.28199999999999997,"5min":0.221,"15min":0.217},"max":{"1min":0.61699999999999999,"5min":8.6080000000000005,"15min":36.07},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.442,"15min":0.40400000000000003},"min":{"1min":0.27100000000000002,"5min":0.23400000000000001,"15min":0.219},"max":{"1min":0.60699999999999998,"5min":6.7800000000000002,"15min":6.7800000000000002},"last":0.94899999999999995}]},{"osd":3,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.36599999999999999,"15min":0.39300000000000002},"min":{"1min":0.255,"5min":0.223,"15min":0.223},"max":{"1min":0.55000000000000004,"5min":1.863,"15min":8.4130000000000003},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.48699999999999999,"15min":0.55700000000000005},"min":{"1min":0.25800000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.65200000000000002,"5min":8.4570000000000007,"15min":35.959000000000003},"last":1.9079999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55900000000000005,"15min":0.56200000000000006},"min":{"1min":0.39300000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.85099999999999998,"5min":2.427,"15min":2.427},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.65400000000000003,"15min":0.73299999999999998},"min":{"1min":0.42799999999999999,"5min":0.34399999999999997,"15min":0.29299999999999998},"max":{"1min":0.94999999999999996,"5min":8.2919999999999998,"15min":36.005000000000003},"last":0.53000000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.628,"15min":0.57899999999999996},"min":{"1min":0.38900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.89600000000000002,"5min":6.6699999999999999,"15min":6.6699999999999999},"last":0.999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55100000000000005,"15min":0.55200000000000005},"min":{"1min":0.372,"5min":0.315,"15min":0.315},"max":{"1min":0.82599999999999996,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.51300000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.66700000000000004,"15min":0.73399999999999999},"min":{"1min":0.42199999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.98699999999999999,"5min":8.2479999999999993,"15min":36.037999999999997},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.624,"5min":0.66400000000000003,"15min":0.63600000000000001},"min":{"1min":0.495,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.97199999999999998,"5min":6.7110000000000003,"15min":6.7110000000000003},"last":1.028}]},{"osd":7,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.65500000000000003,"15min":0.623},"min":{"1min":0.44,"5min":0.371,"15min":0.371},"max":{"1min":0.93100000000000005,"5min":6.742,"15min":6.742},"last":1.054},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57899999999999996,"15min":0.56899999999999995},"min":{"1min":0.41499999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.96199999999999997,"5min":1.917,"15min":1.917},"last":0.69899999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574967,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315156,"kb_used_data":1484,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94056684,"statfs":{"total":96636764160,"available":96314044416,"internally_reserved":0,"allocated":1519616,"data_stored":693466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.313,"15min":0.31},"min":{"1min":0.246,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.36399999999999999,"5min":0.56699999999999995,"15min":0.57499999999999996},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.38400000000000001,"15min":0.38200000000000001},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.438,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.34399999999999997}]},{"osd":1,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.373,"15min":0.372},"min":{"1min":0.252,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.47699999999999998,"5min":0.745,"15min":0.745},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.35199999999999998,"15min":0.34999999999999998},"min":{"1min":0.26200000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.52700000000000002,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.29299999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.35599999999999998,"15min":0.36599999999999999},"min":{"1min":0.27100000000000002,"5min":0.23300000000000001,"15min":0.23200000000000001},"max":{"1min":0.40000000000000002,"5min":0.58699999999999997,"15min":0.629},"last":0.313},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.36499999999999999,"15min":0.36399999999999999},"min":{"1min":0.25900000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.42199999999999999,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.33000000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.505,"15min":0.52500000000000002},"min":{"1min":0.36199999999999999,"5min":0.30599999999999999,"15min":0.30299999999999999},"max":{"1min":0.70899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.52000000000000002,"15min":0.54600000000000004},"min":{"1min":0.35499999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.72299999999999998,"5min":0.80400000000000005,"15min":0.84899999999999998},"last":0.47299999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.52600000000000002,"15min":0.54100000000000004},"min":{"1min":0.38300000000000001,"5min":0.33100000000000002,"15min":0.32400000000000001},"max":{"1min":0.71699999999999997,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.54800000000000004,"15min":0.55200000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.78100000000000003,"5min":0.878,"15min":0.878},"last":0.53200000000000003}]},{"osd":6,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.56499999999999995,"15min":0.57899999999999996},"min":{"1min":0.38700000000000001,"5min":0.36799999999999999,"15min":0.32600000000000001},"max":{"1min":0.73799999999999999,"5min":0.85199999999999998,"15min":0.86299999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55900000000000005,"15min":0.57099999999999995},"min":{"1min":0.40699999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70699999999999996,"5min":0.878,"15min":0.88600000000000001},"last":0.56100000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.37,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67700000000000005,"5min":1.139,"15min":1.139},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.55800000000000005,"15min":0.56699999999999995},"min":{"1min":0.41699999999999998,"5min":0.38800000000000001,"15min":0.38200000000000001},"max":{"1min":0.69699999999999995,"5min":0.89600000000000002,"15min":0.90500000000000003},"last":0.48499999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574967,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306964,"kb_used_data":1484,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064876,"statfs":{"total":96636764160,"available":96322433024,"internally_reserved":0,"allocated":1519616,"data_stored":693466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.31,"15min":0.31900000000000001},"min":{"1min":0.222,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.45500000000000002,"5min":0.48899999999999999,"15min":1.095},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35199999999999998,"15min":0.38100000000000001},"min":{"1min":0.27100000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.52700000000000002,"5min":0.53900000000000003,"15min":1.7210000000000001},"last":0.34999999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.314,"15min":0.311},"min":{"1min":0.23400000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.65400000000000003},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.34100000000000003,"15min":0.35899999999999999},"min":{"1min":0.25800000000000001,"5min":0.188,"15min":0.188},"max":{"1min":0.53100000000000003,"5min":0.53400000000000003,"15min":1.196},"last":0.317}]},{"osd":2,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.34799999999999998,"15min":0.374},"min":{"1min":0.251,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.47799999999999998,"5min":0.73499999999999999,"15min":1.7729999999999999},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39700000000000002,"15min":0.41099999999999998},"min":{"1min":0.308,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.57699999999999996,"5min":0.58599999999999997,"15min":1.224},"last":0.39600000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.50900000000000001,"15min":0.54900000000000004},"min":{"1min":0.32100000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":1.694},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51700000000000002,"15min":0.53700000000000003},"min":{"1min":0.35899999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.432}]},{"osd":5,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53100000000000003,"15min":0.53200000000000003},"min":{"1min":0.35599999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.878},"last":0.501},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53900000000000003,"15min":0.55600000000000005},"min":{"1min":0.39000000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.746,"5min":0.75800000000000001,"15min":1.165},"last":0.443}]},{"osd":6,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55300000000000005,"15min":0.57999999999999996},"min":{"1min":0.372,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.79200000000000004,"5min":0.85099999999999998,"15min":1.1359999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55900000000000005,"15min":0.58799999999999997},"min":{"1min":0.42999999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79700000000000004,"5min":0.82199999999999995,"15min":1.7470000000000001},"last":0.55400000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55000000000000004,"15min":0.57799999999999996},"min":{"1min":0.38900000000000001,"5min":0.35699999999999998,"15min":0.35599999999999998},"max":{"1min":0.754,"5min":0.85399999999999998,"15min":1.657},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56100000000000005,"15min":0.57199999999999995},"min":{"1min":0.38,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.82099999999999995,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.47899999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574966,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302884,"kb_used_data":1500,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068956,"statfs":{"total":96636764160,"available":96326610944,"internally_reserved":0,"allocated":1536000,"data_stored":701427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.45700000000000002,"15min":0.53500000000000003},"min":{"1min":0.216,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":2.6619999999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.439,"5min":0.47499999999999998,"15min":0.49099999999999999},"min":{"1min":0.224,"5min":0.215,"15min":0.215},"max":{"1min":0.69999999999999996,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.33300000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:14:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47099999999999997,"15min":0.55600000000000005},"min":{"1min":0.27300000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1,"5min":1,"15min":2.8650000000000002},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.48199999999999998,"15min":0.56299999999999994},"min":{"1min":0.27400000000000002,"5min":0.26200000000000001,"15min":0.25800000000000001},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":2.7610000000000001},"last":0.41499999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:14:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.49299999999999999,"15min":0.54100000000000004},"min":{"1min":0.28499999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.749,"5min":0.76000000000000001,"15min":1.6910000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54200000000000004,"15min":0.58699999999999997},"min":{"1min":0.41099999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71899999999999997,"5min":0.93899999999999995,"15min":1.718},"last":0.67600000000000005}]},{"osd":3,"last update":"Fri Oct 6 11:14:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.55300000000000005,"15min":0.59999999999999998},"min":{"1min":0.33400000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":2.387,"5min":2.387,"15min":2.677},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.27500000000000002},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":0.64100000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:14:53 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.47099999999999997,"15min":0.48399999999999999},"min":{"1min":0.315,"5min":0.23499999999999999,"15min":0.23200000000000001},"max":{"1min":0.73199999999999998,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.495,"15min":0.52600000000000002},"min":{"1min":0.29299999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.58899999999999997,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.55700000000000005}]},{"osd":6,"last update":"Fri Oct 6 11:14:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.505,"15min":0.52100000000000002},"min":{"1min":0.31,"5min":0.30499999999999999,"15min":0.252},"max":{"1min":0.63400000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.502,"5min":0.53500000000000003,"15min":0.56499999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.64800000000000002,"5min":0.85799999999999998,"15min":1.165},"last":0.61199999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:14:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.55300000000000005,"15min":0.55700000000000005},"min":{"1min":0.35399999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.74399999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.626},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56100000000000005,"15min":0.59299999999999997},"min":{"1min":0.318,"5min":0.317,"15min":0.317},"max":{"1min":0.67900000000000005,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.875}]}]},{"osd":5,"up_from":13,"seq":55834574968,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311064,"kb_used_data":1488,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060776,"statfs":{"total":96636764160,"available":96318234624,"internally_reserved":0,"allocated":1523712,"data_stored":694819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45400000000000001,"15min":0.60799999999999998},"min":{"1min":0.34799999999999998,"5min":0.23100000000000001,"15min":0.20499999999999999},"max":{"1min":0.61099999999999999,"5min":0.72599999999999998,"15min":5.0490000000000004},"last":0.443},{"interface":"front","average":{"1min":0.434,"5min":0.45200000000000001,"15min":0.58499999999999996},"min":{"1min":0.253,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.65500000000000003,"5min":0.78100000000000003,"15min":5.1449999999999996},"last":0.47499999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.46500000000000002,"15min":0.48099999999999998},"min":{"1min":0.29599999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.629,"5min":0.81399999999999995,"15min":0.97199999999999998},"last":0.497},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47699999999999998,"15min":0.51000000000000001},"min":{"1min":0.30099999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.58599999999999997,"5min":0.70199999999999996,"15min":1.8799999999999999},"last":0.53100000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.50700000000000001,"15min":0.54900000000000004},"min":{"1min":0.30099999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.60999999999999999,"5min":0.79800000000000004,"15min":4.234},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52600000000000002,"15min":0.55800000000000005},"min":{"1min":0.40100000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.64000000000000001,"5min":0.81000000000000005,"15min":1.0369999999999999},"last":0.62}]},{"osd":3,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48299999999999998,"15min":0.627},"min":{"1min":0.33200000000000002,"5min":0.30399999999999999,"15min":0.27700000000000002},"max":{"1min":0.60699999999999998,"5min":0.82299999999999995,"15min":5.2169999999999996},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.51300000000000001,"15min":0.54000000000000004},"min":{"1min":0.373,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.56299999999999994,"5min":0.82699999999999996,"15min":1.008},"last":0.45800000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.46999999999999997,"15min":0.51100000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.23999999999999999},"max":{"1min":0.61499999999999999,"5min":0.83399999999999996,"15min":1.917},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46899999999999997,"15min":0.52300000000000002},"min":{"1min":0.35599999999999998,"5min":0.24399999999999999,"15min":0.23899999999999999},"max":{"1min":0.628,"5min":0.71899999999999997,"15min":0.87},"last":0.59099999999999997}]},{"osd":6,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.55100000000000005},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.64700000000000002,"5min":0.77100000000000002,"15min":2.0139999999999998},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55400000000000005,"15min":0.60199999999999998},"min":{"1min":0.43099999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.64000000000000001,"5min":0.82899999999999996,"15min":1.9470000000000001},"last":0.67900000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52100000000000002,"15min":0.57399999999999995},"min":{"1min":0.28799999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.65500000000000003,"5min":0.81000000000000005,"15min":0.96499999999999997},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55200000000000005,"15min":0.60099999999999998},"min":{"1min":0.376,"5min":0.316,"15min":0.28799999999999998},"max":{"1min":0.68000000000000005,"5min":0.79900000000000004,"15min":1.4119999999999999},"last":0.56499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:15:16.628 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:15:16.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.774+0000 7fa9869f2700 1 Processor -- start 2023-10-06T11:15:16.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.774+0000 7fa9869f2700 1 -- start start 2023-10-06T11:15:16.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.774+0000 7fa9869f2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa980153ab0 0x7fa98015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:16.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.774+0000 7fa9869f2700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa980153e80 0x7fa980068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:16.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.774+0000 7fa9869f2700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa9800689d0 0x7fa98015d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:16.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.774+0000 7fa9869f2700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa980068e50 con 0x7fa980153ab0 2023-10-06T11:15:16.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.774+0000 7fa9869f2700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa98015ac30 con 0x7fa9800689d0 2023-10-06T11:15:16.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.774+0000 7fa9869f2700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9800b4510 con 0x7fa980153e80 2023-10-06T11:15:16.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.775+0000 7fa97ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa980153ab0 0x7fa98015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:16.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.775+0000 7fa97ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa980153ab0 0x7fa98015a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35386/0 (socket says 172.21.15.146:35386) 2023-10-06T11:15:16.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.775+0000 7fa97ffff700 1 -- 172.21.15.146:0/1956527810 learned_addr learned my addr 172.21.15.146:0/1956527810 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:16.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.775+0000 7fa97f7fe700 1 --2- 172.21.15.146:0/1956527810 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa980153e80 0x7fa980068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:16.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.775+0000 7fa984f8f700 1 --2- 172.21.15.146:0/1956527810 >> v2:172.21.15.151:3300/0 conn(0x7fa9800689d0 0x7fa98015d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:16.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.775+0000 7fa97ffff700 1 -- 172.21.15.146:0/1956527810 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa980153e80 msgr2=0x7fa980068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:16.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.775+0000 7fa97ffff700 1 --2- 172.21.15.146:0/1956527810 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa980153e80 0x7fa980068490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.775+0000 7fa97ffff700 1 -- 172.21.15.146:0/1956527810 >> v2:172.21.15.151:3300/0 conn(0x7fa9800689d0 msgr2=0x7fa98015d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:16.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.775+0000 7fa97ffff700 1 --2- 172.21.15.146:0/1956527810 >> v2:172.21.15.151:3300/0 conn(0x7fa9800689d0 0x7fa98015d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.775+0000 7fa97ffff700 1 -- 172.21.15.146:0/1956527810 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9800b6530 con 0x7fa980153ab0 2023-10-06T11:15:16.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.775+0000 7fa97ffff700 1 --2- 172.21.15.146:0/1956527810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa980153ab0 0x7fa98015a6f0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7fa980089a80 tx=0x7fa970009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf71a7d17fbd889f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:16.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.775+0000 7fa97effd700 1 -- 172.21.15.146:0/1956527810 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97000b860 con 0x7fa980153ab0 2023-10-06T11:15:16.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.775+0000 7fa97effd700 1 -- 172.21.15.146:0/1956527810 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97000b9c0 con 0x7fa980153ab0 2023-10-06T11:15:16.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.775+0000 7fa97effd700 1 -- 172.21.15.146:0/1956527810 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97000bd60 con 0x7fa980153ab0 2023-10-06T11:15:16.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.776+0000 7fa9869f2700 1 -- 172.21.15.146:0/1956527810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa980153ab0 msgr2=0x7fa98015a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:16.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.776+0000 7fa9869f2700 1 --2- 172.21.15.146:0/1956527810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa980153ab0 0x7fa98015a6f0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7fa980089a80 tx=0x7fa970009250 comp rx=0 tx=0).stop 2023-10-06T11:15:16.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.776+0000 7fa9869f2700 1 -- 172.21.15.146:0/1956527810 shutdown_connections 2023-10-06T11:15:16.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.776+0000 7fa9869f2700 1 --2- 172.21.15.146:0/1956527810 >> v2:172.21.15.151:3300/0 conn(0x7fa9800689d0 0x7fa98015d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.776+0000 7fa9869f2700 1 --2- 172.21.15.146:0/1956527810 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa980153ab0 0x7fa98015a6f0 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.776+0000 7fa9869f2700 1 --2- 172.21.15.146:0/1956527810 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa980153e80 0x7fa980068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.776+0000 7fa9869f2700 1 -- 172.21.15.146:0/1956527810 >> 172.21.15.146:0/1956527810 conn(0x7fa98006eba0 msgr2=0x7fa98006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:16.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.776+0000 7fa9869f2700 1 -- 172.21.15.146:0/1956527810 shutdown_connections 2023-10-06T11:15:16.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.776+0000 7fa9869f2700 1 -- 172.21.15.146:0/1956527810 wait complete. 2023-10-06T11:15:16.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.777+0000 7fa9869f2700 1 Processor -- start 2023-10-06T11:15:16.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.777+0000 7fa9869f2700 1 -- start start 2023-10-06T11:15:16.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.778+0000 7fa9869f2700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa9800689d0 0x7fa98014fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:16.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.778+0000 7fa9869f2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa980153ab0 0x7fa980159e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:16.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.778+0000 7fa9869f2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa980153e80 0x7fa980157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:16.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.778+0000 7fa9869f2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9801566b0 con 0x7fa980153e80 2023-10-06T11:15:16.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.778+0000 7fa9869f2700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa980156220 con 0x7fa980153ab0 2023-10-06T11:15:16.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.778+0000 7fa9869f2700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa980155610 con 0x7fa9800689d0 2023-10-06T11:15:16.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.778+0000 7fa984f8f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa980153e80 0x7fa980157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:16.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.778+0000 7fa984f8f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa980153e80 0x7fa980157060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35394/0 (socket says 172.21.15.146:35394) 2023-10-06T11:15:16.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.778+0000 7fa984f8f700 1 -- 172.21.15.146:0/844695301 learned_addr learned my addr 172.21.15.146:0/844695301 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:16.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.778+0000 7fa97ffff700 1 --2- 172.21.15.146:0/844695301 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa9800689d0 0x7fa98014fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:16.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.778+0000 7fa97f7fe700 1 --2- 172.21.15.146:0/844695301 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa980153ab0 0x7fa980159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:16.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.778+0000 7fa984f8f700 1 -- 172.21.15.146:0/844695301 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa9800689d0 msgr2=0x7fa98014fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:16.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.778+0000 7fa984f8f700 1 --2- 172.21.15.146:0/844695301 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa9800689d0 0x7fa98014fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.778+0000 7fa984f8f700 1 -- 172.21.15.146:0/844695301 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa980153ab0 msgr2=0x7fa980159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:16.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.778+0000 7fa984f8f700 1 --2- 172.21.15.146:0/844695301 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa980153ab0 0x7fa980159e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.778+0000 7fa984f8f700 1 -- 172.21.15.146:0/844695301 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9700094f0 con 0x7fa980153e80 2023-10-06T11:15:16.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.778+0000 7fa984f8f700 1 --2- 172.21.15.146:0/844695301 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa980153e80 0x7fa980157060 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fa978007f20 tx=0x7fa978009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:16.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.778+0000 7fa967fff700 1 -- 172.21.15.146:0/844695301 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97800eb90 con 0x7fa980153e80 2023-10-06T11:15:16.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.779+0000 7fa967fff700 1 -- 172.21.15.146:0/844695301 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97800ed10 con 0x7fa980153e80 2023-10-06T11:15:16.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.779+0000 7fa967fff700 1 -- 172.21.15.146:0/844695301 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa978014670 con 0x7fa980153e80 2023-10-06T11:15:16.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.779+0000 7fa9869f2700 1 -- 172.21.15.146:0/844695301 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9801558f0 con 0x7fa980153e80 2023-10-06T11:15:16.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.779+0000 7fa9869f2700 1 -- 172.21.15.146:0/844695301 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa980155eb0 con 0x7fa980153e80 2023-10-06T11:15:16.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.780+0000 7fa9869f2700 1 -- 172.21.15.146:0/844695301 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9800b2010 con 0x7fa980153e80 2023-10-06T11:15:16.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.780+0000 7fa967fff700 1 -- 172.21.15.146:0/844695301 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa9780149e0 con 0x7fa980153e80 2023-10-06T11:15:16.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.780+0000 7fa967fff700 1 --2- 172.21.15.146:0/844695301 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa96c066f30 0x7fa96c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:16.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.781+0000 7fa97ffff700 1 --2- 172.21.15.146:0/844695301 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa96c066f30 0x7fa96c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:16.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.781+0000 7fa967fff700 1 -- 172.21.15.146:0/844695301 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa978084bf0 con 0x7fa980153e80 2023-10-06T11:15:16.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.781+0000 7fa97ffff700 1 --2- 172.21.15.146:0/844695301 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa96c066f30 0x7fa96c0693e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fa980089a80 tx=0x7fa970017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:16.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.785+0000 7fa967fff700 1 -- 172.21.15.146:0/844695301 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa978051d00 con 0x7fa980153e80 2023-10-06T11:15:16.828 INFO:tasks.ceph.mds.c.smithi146.stderr:2023-10-06T11:15:16.826+0000 7f2884fc1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T11:15:16.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.965+0000 7fa9869f2700 1 -- 172.21.15.146:0/844695301 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa98004c380 con 0x7fa96c066f30 2023-10-06T11:15:16.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.973+0000 7fa967fff700 1 -- 172.21.15.146:0/844695301 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303649 (secure 0 0 0) 0x7fa98004c380 con 0x7fa96c066f30 2023-10-06T11:15:16.979 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:15:16.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.976+0000 7fa9869f2700 1 -- 172.21.15.146:0/844695301 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa96c066f30 msgr2=0x7fa96c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:16.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.976+0000 7fa9869f2700 1 --2- 172.21.15.146:0/844695301 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa96c066f30 0x7fa96c0693e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fa980089a80 tx=0x7fa970017000 comp rx=0 tx=0).stop 2023-10-06T11:15:16.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.976+0000 7fa9869f2700 1 -- 172.21.15.146:0/844695301 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa980153e80 msgr2=0x7fa980157060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:16.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.976+0000 7fa9869f2700 1 --2- 172.21.15.146:0/844695301 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa980153e80 0x7fa980157060 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fa978007f20 tx=0x7fa978009860 comp rx=0 tx=0).stop 2023-10-06T11:15:16.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.976+0000 7fa9869f2700 1 -- 172.21.15.146:0/844695301 shutdown_connections 2023-10-06T11:15:16.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.976+0000 7fa9869f2700 1 --2- 172.21.15.146:0/844695301 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa96c066f30 0x7fa96c0693e0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.976+0000 7fa9869f2700 1 --2- 172.21.15.146:0/844695301 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa980153e80 0x7fa980157060 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.976+0000 7fa9869f2700 1 --2- 172.21.15.146:0/844695301 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa9800689d0 0x7fa98014fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.976+0000 7fa9869f2700 1 --2- 172.21.15.146:0/844695301 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa980153ab0 0x7fa980159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:16.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.976+0000 7fa9869f2700 1 -- 172.21.15.146:0/844695301 >> 172.21.15.146:0/844695301 conn(0x7fa98006eba0 msgr2=0x7fa98015ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:16.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.976+0000 7fa9869f2700 1 -- 172.21.15.146:0/844695301 shutdown_connections 2023-10-06T11:15:16.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:16.976+0000 7fa9869f2700 1 -- 172.21.15.146:0/844695301 wait complete. 2023-10-06T11:15:16.983 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:15:16.991 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":407,"stamp":"2023-10-06T11:15:15.262227+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":132,"acting":132,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":46,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2461008,"kb_used_data":13072,"kb_used_omap":0,"kb_used_meta":2447872,"kb_avail":752513712,"statfs":{"total":773094113280,"available":770574041088,"internally_reserved":0,"allocated":13385728,"data_stored":6747542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2506620928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.728564"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.548374+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:03:55.986977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.551608+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:25:18.441894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.545346+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:49:53.647910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.553845+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:35:58.009437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.545643+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:58:42.165232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.545611+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:51:27.969369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.551293+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:45:49.982194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.554183+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:33:57.627561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.549474+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:19:29.875101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.549075+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:14:08.040389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.550511+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:06.278594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.549144+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:16:46.194765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.544258+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:33:57.627561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.544863+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:14.774930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.615827+0000","last_change":"2023-10-06T11:15:11.615827+0000","last_active":"2023-10-06T11:15:11.615827+0000","last_peered":"2023-10-06T11:15:11.615827+0000","last_clean":"2023-10-06T11:15:11.615827+0000","last_became_active":"2023-10-06T11:15:11.615550+0000","last_became_peered":"2023-10-06T11:15:11.615550+0000","last_unstale":"2023-10-06T11:15:11.615827+0000","last_undegraded":"2023-10-06T11:15:11.615827+0000","last_fullsized":"2023-10-06T11:15:11.615827+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:12:08.245890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:10.525068+0000","last_change":"2023-10-06T11:15:10.538091+0000","last_active":"2023-10-06T11:15:10.525068+0000","last_peered":"2023-10-06T11:15:10.525068+0000","last_clean":"2023-10-06T11:15:10.525068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:10.525068+0000","last_undegraded":"2023-10-06T11:15:10.525068+0000","last_fullsized":"2023-10-06T11:15:10.525068+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:35:57.001079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:10.525068+0000","last_change":"2023-10-06T11:15:10.658132+0000","last_active":"2023-10-06T11:15:10.525068+0000","last_peered":"2023-10-06T11:15:10.525068+0000","last_clean":"2023-10-06T11:15:10.525068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:10.525068+0000","last_undegraded":"2023-10-06T11:15:10.525068+0000","last_fullsized":"2023-10-06T11:15:10.525068+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:30:36.204472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:10.525068+0000","last_change":"2023-10-06T11:15:10.658099+0000","last_active":"2023-10-06T11:15:10.525068+0000","last_peered":"2023-10-06T11:15:10.525068+0000","last_clean":"2023-10-06T11:15:10.525068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:10.525068+0000","last_undegraded":"2023-10-06T11:15:10.525068+0000","last_fullsized":"2023-10-06T11:15:10.525068+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:59:47.058196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.544806+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:42:28.514350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.555437+0000","last_change":"2023-10-06T11:15:11.555437+0000","last_active":"2023-10-06T11:15:11.555437+0000","last_peered":"2023-10-06T11:15:11.555437+0000","last_clean":"2023-10-06T11:15:11.555437+0000","last_became_active":"2023-10-06T11:15:11.555188+0000","last_became_peered":"2023-10-06T11:15:11.555188+0000","last_unstale":"2023-10-06T11:15:11.555437+0000","last_undegraded":"2023-10-06T11:15:11.555437+0000","last_fullsized":"2023-10-06T11:15:11.555437+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:35.856632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.545719+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:42:08.749955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:10.525068+0000","last_change":"2023-10-06T11:15:10.538184+0000","last_active":"2023-10-06T11:15:10.525068+0000","last_peered":"2023-10-06T11:15:10.525068+0000","last_clean":"2023-10-06T11:15:10.525068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:10.525068+0000","last_undegraded":"2023-10-06T11:15:10.525068+0000","last_fullsized":"2023-10-06T11:15:10.525068+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:11.919378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.555398+0000","last_change":"2023-10-06T11:15:11.555398+0000","last_active":"2023-10-06T11:15:11.555398+0000","last_peered":"2023-10-06T11:15:11.555398+0000","last_clean":"2023-10-06T11:15:11.555398+0000","last_became_active":"2023-10-06T11:15:11.555097+0000","last_became_peered":"2023-10-06T11:15:11.555097+0000","last_unstale":"2023-10-06T11:15:11.555398+0000","last_undegraded":"2023-10-06T11:15:11.555398+0000","last_fullsized":"2023-10-06T11:15:11.555398+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:19:28.866743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.615898+0000","last_change":"2023-10-06T11:15:11.615898+0000","last_active":"2023-10-06T11:15:11.615898+0000","last_peered":"2023-10-06T11:15:11.615898+0000","last_clean":"2023-10-06T11:15:11.615898+0000","last_became_active":"2023-10-06T11:15:11.615593+0000","last_became_peered":"2023-10-06T11:15:11.615593+0000","last_unstale":"2023-10-06T11:15:11.615898+0000","last_undegraded":"2023-10-06T11:15:11.615898+0000","last_fullsized":"2023-10-06T11:15:11.615898+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:31:06.545416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.548277+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:04.347350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:10.525068+0000","last_change":"2023-10-06T11:15:10.535772+0000","last_active":"2023-10-06T11:15:10.525068+0000","last_peered":"2023-10-06T11:15:10.525068+0000","last_clean":"2023-10-06T11:15:10.525068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:10.525068+0000","last_undegraded":"2023-10-06T11:15:10.525068+0000","last_fullsized":"2023-10-06T11:15:10.525068+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:14:07.032030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.615617+0000","last_change":"2023-10-06T11:15:11.615617+0000","last_active":"2023-10-06T11:15:11.615617+0000","last_peered":"2023-10-06T11:15:11.615617+0000","last_clean":"2023-10-06T11:15:11.615617+0000","last_became_active":"2023-10-06T11:15:11.615338+0000","last_became_peered":"2023-10-06T11:15:11.615338+0000","last_unstale":"2023-10-06T11:15:11.615617+0000","last_undegraded":"2023-10-06T11:15:11.615617+0000","last_fullsized":"2023-10-06T11:15:11.615617+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:14:50.760693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.555479+0000","last_change":"2023-10-06T11:15:11.555479+0000","last_active":"2023-10-06T11:15:11.555479+0000","last_peered":"2023-10-06T11:15:11.555479+0000","last_clean":"2023-10-06T11:15:11.555479+0000","last_became_active":"2023-10-06T11:15:11.553333+0000","last_became_peered":"2023-10-06T11:15:11.553333+0000","last_unstale":"2023-10-06T11:15:11.555479+0000","last_undegraded":"2023-10-06T11:15:11.555479+0000","last_fullsized":"2023-10-06T11:15:11.555479+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:14:07.032030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:10.525068+0000","last_change":"2023-10-06T11:15:10.538807+0000","last_active":"2023-10-06T11:15:10.525068+0000","last_peered":"2023-10-06T11:15:10.525068+0000","last_clean":"2023-10-06T11:15:10.525068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:10.525068+0000","last_undegraded":"2023-10-06T11:15:10.525068+0000","last_fullsized":"2023-10-06T11:15:10.525068+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:57:35.417949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.553701+0000","last_change":"2023-10-06T11:15:11.553701+0000","last_active":"2023-10-06T11:15:11.553701+0000","last_peered":"2023-10-06T11:15:11.553701+0000","last_clean":"2023-10-06T11:15:11.553701+0000","last_became_active":"2023-10-06T11:15:11.553429+0000","last_became_peered":"2023-10-06T11:15:11.553429+0000","last_unstale":"2023-10-06T11:15:11.553701+0000","last_undegraded":"2023-10-06T11:15:11.553701+0000","last_fullsized":"2023-10-06T11:15:11.553701+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:11.919378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:10.525068+0000","last_change":"2023-10-06T11:15:10.538734+0000","last_active":"2023-10-06T11:15:10.525068+0000","last_peered":"2023-10-06T11:15:10.525068+0000","last_clean":"2023-10-06T11:15:10.525068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:10.525068+0000","last_undegraded":"2023-10-06T11:15:10.525068+0000","last_fullsized":"2023-10-06T11:15:10.525068+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:52:13.038637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:10.525068+0000","last_change":"2023-10-06T11:15:10.657559+0000","last_active":"2023-10-06T11:15:10.525068+0000","last_peered":"2023-10-06T11:15:10.525068+0000","last_clean":"2023-10-06T11:15:10.525068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:10.525068+0000","last_undegraded":"2023-10-06T11:15:10.525068+0000","last_fullsized":"2023-10-06T11:15:10.525068+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:58:41.156874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.556382+0000","last_change":"2023-10-06T11:15:11.556382+0000","last_active":"2023-10-06T11:15:11.556382+0000","last_peered":"2023-10-06T11:15:11.556382+0000","last_clean":"2023-10-06T11:15:11.556382+0000","last_became_active":"2023-10-06T11:15:11.556112+0000","last_became_peered":"2023-10-06T11:15:11.556112+0000","last_unstale":"2023-10-06T11:15:11.556382+0000","last_undegraded":"2023-10-06T11:15:11.556382+0000","last_fullsized":"2023-10-06T11:15:11.556382+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:16:45.186406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:10.525068+0000","last_change":"2023-10-06T11:15:10.538244+0000","last_active":"2023-10-06T11:15:10.525068+0000","last_peered":"2023-10-06T11:15:10.525068+0000","last_clean":"2023-10-06T11:15:10.525068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:10.525068+0000","last_undegraded":"2023-10-06T11:15:10.525068+0000","last_fullsized":"2023-10-06T11:15:10.525068+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:56.425415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.548722+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:12:17.067365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.557279+0000","last_change":"2023-10-06T11:15:11.557279+0000","last_active":"2023-10-06T11:15:11.557279+0000","last_peered":"2023-10-06T11:15:11.557279+0000","last_clean":"2023-10-06T11:15:11.557279+0000","last_became_active":"2023-10-06T11:15:11.556969+0000","last_became_peered":"2023-10-06T11:15:11.556969+0000","last_unstale":"2023-10-06T11:15:11.557279+0000","last_undegraded":"2023-10-06T11:15:11.557279+0000","last_fullsized":"2023-10-06T11:15:11.557279+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:35:57.001079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.615736+0000","last_change":"2023-10-06T11:15:11.615736+0000","last_active":"2023-10-06T11:15:11.615736+0000","last_peered":"2023-10-06T11:15:11.615736+0000","last_clean":"2023-10-06T11:15:11.615736+0000","last_became_active":"2023-10-06T11:15:11.615436+0000","last_became_peered":"2023-10-06T11:15:11.615436+0000","last_unstale":"2023-10-06T11:15:11.615736+0000","last_undegraded":"2023-10-06T11:15:11.615736+0000","last_fullsized":"2023-10-06T11:15:11.615736+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:25:17.433536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.559110+0000","last_change":"2023-10-06T11:15:11.559110+0000","last_active":"2023-10-06T11:15:11.559110+0000","last_peered":"2023-10-06T11:15:11.559110+0000","last_clean":"2023-10-06T11:15:11.559110+0000","last_became_active":"2023-10-06T11:15:11.558912+0000","last_became_peered":"2023-10-06T11:15:11.558912+0000","last_unstale":"2023-10-06T11:15:11.559110+0000","last_undegraded":"2023-10-06T11:15:11.559110+0000","last_fullsized":"2023-10-06T11:15:11.559110+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:06.108506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.551355+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:59:48.066554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:10.525068+0000","last_change":"2023-10-06T11:15:10.536559+0000","last_active":"2023-10-06T11:15:10.525068+0000","last_peered":"2023-10-06T11:15:10.525068+0000","last_clean":"2023-10-06T11:15:10.525068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:10.525068+0000","last_undegraded":"2023-10-06T11:15:10.525068+0000","last_fullsized":"2023-10-06T11:15:10.525068+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:16:45.186406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.551860+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:30:37.212830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:10.525068+0000","last_change":"2023-10-06T11:15:10.657560+0000","last_active":"2023-10-06T11:15:10.525068+0000","last_peered":"2023-10-06T11:15:10.525068+0000","last_clean":"2023-10-06T11:15:10.525068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:10.525068+0000","last_undegraded":"2023-10-06T11:15:10.525068+0000","last_fullsized":"2023-10-06T11:15:10.525068+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:45:48.973836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.553099+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:36.864990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.557480+0000","last_change":"2023-10-06T11:15:11.557480+0000","last_active":"2023-10-06T11:15:11.557480+0000","last_peered":"2023-10-06T11:15:11.557480+0000","last_clean":"2023-10-06T11:15:11.557480+0000","last_became_active":"2023-10-06T11:15:11.557275+0000","last_became_peered":"2023-10-06T11:15:11.557275+0000","last_unstale":"2023-10-06T11:15:11.557480+0000","last_undegraded":"2023-10-06T11:15:11.557480+0000","last_fullsized":"2023-10-06T11:15:11.557480+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:05.270236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:10.525068+0000","last_change":"2023-10-06T11:15:10.537588+0000","last_active":"2023-10-06T11:15:10.525068+0000","last_peered":"2023-10-06T11:15:10.525068+0000","last_clean":"2023-10-06T11:15:10.525068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:10.525068+0000","last_undegraded":"2023-10-06T11:15:10.525068+0000","last_fullsized":"2023-10-06T11:15:10.525068+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:23:19.627689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:10.525068+0000","last_change":"2023-10-06T11:15:10.537278+0000","last_active":"2023-10-06T11:15:10.525068+0000","last_peered":"2023-10-06T11:15:10.525068+0000","last_clean":"2023-10-06T11:15:10.525068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:10.525068+0000","last_undegraded":"2023-10-06T11:15:10.525068+0000","last_fullsized":"2023-10-06T11:15:10.525068+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:19:28.866743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":108,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-06T11:15:10.541325+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:15:10.541325+0000","last_peered":"2023-10-06T11:15:10.541325+0000","last_clean":"2023-10-06T11:15:10.541325+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:15:10.541325+0000","last_undegraded":"2023-10-06T11:15:10.541325+0000","last_fullsized":"2023-10-06T11:15:10.541325+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.551327+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:40.228447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:10.525068+0000","last_change":"2023-10-06T11:15:10.537563+0000","last_active":"2023-10-06T11:15:10.525068+0000","last_peered":"2023-10-06T11:15:10.525068+0000","last_clean":"2023-10-06T11:15:10.525068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:10.525068+0000","last_undegraded":"2023-10-06T11:15:10.525068+0000","last_fullsized":"2023-10-06T11:15:10.525068+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:45:56.255641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":98,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-10-06T11:15:08.206609+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:15:08.206609+0000","last_peered":"2023-10-06T11:15:08.206609+0000","last_clean":"2023-10-06T11:15:08.206609+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:15:08.206609+0000","last_undegraded":"2023-10-06T11:15:08.206609+0000","last_fullsized":"2023-10-06T11:15:08.206609+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.557485+0000","last_change":"2023-10-06T11:15:11.557485+0000","last_active":"2023-10-06T11:15:11.557485+0000","last_peered":"2023-10-06T11:15:11.557485+0000","last_clean":"2023-10-06T11:15:11.557485+0000","last_became_active":"2023-10-06T11:15:11.556885+0000","last_became_peered":"2023-10-06T11:15:11.556885+0000","last_unstale":"2023-10-06T11:15:11.557485+0000","last_undegraded":"2023-10-06T11:15:11.557485+0000","last_fullsized":"2023-10-06T11:15:11.557485+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:04:48.873690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":98,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-06T11:15:10.657847+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:15:10.657847+0000","last_peered":"2023-10-06T11:15:10.657847+0000","last_clean":"2023-10-06T11:15:10.657847+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:15:10.657847+0000","last_undegraded":"2023-10-06T11:15:10.657847+0000","last_fullsized":"2023-10-06T11:15:10.657847+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":241,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-10-06T11:15:08.207287+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:15:08.207287+0000","last_peered":"2023-10-06T11:15:08.207287+0000","last_clean":"2023-10-06T11:15:08.207287+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:15:08.207287+0000","last_undegraded":"2023-10-06T11:15:08.207287+0000","last_fullsized":"2023-10-06T11:15:08.207287+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.562606+0000","last_change":"2023-10-06T11:15:11.562606+0000","last_active":"2023-10-06T11:15:11.562606+0000","last_peered":"2023-10-06T11:15:11.562606+0000","last_clean":"2023-10-06T11:15:11.562606+0000","last_became_active":"2023-10-06T11:15:11.562331+0000","last_became_peered":"2023-10-06T11:15:11.562331+0000","last_unstale":"2023-10-06T11:15:11.562606+0000","last_undegraded":"2023-10-06T11:15:11.562606+0000","last_fullsized":"2023-10-06T11:15:11.562606+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:26.937119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":91,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-10-06T11:15:08.207316+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:15:08.207316+0000","last_peered":"2023-10-06T11:15:08.207316+0000","last_clean":"2023-10-06T11:15:08.207316+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:15:08.207316+0000","last_undegraded":"2023-10-06T11:15:08.207316+0000","last_fullsized":"2023-10-06T11:15:08.207316+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.555020+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:07.116865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:10.525068+0000","last_change":"2023-10-06T11:15:10.658153+0000","last_active":"2023-10-06T11:15:10.525068+0000","last_peered":"2023-10-06T11:15:10.525068+0000","last_clean":"2023-10-06T11:15:10.525068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:10.525068+0000","last_undegraded":"2023-10-06T11:15:10.525068+0000","last_fullsized":"2023-10-06T11:15:10.525068+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:25:17.433536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":91,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-10-06T11:15:08.207286+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:15:08.207286+0000","last_peered":"2023-10-06T11:15:08.207286+0000","last_clean":"2023-10-06T11:15:08.207286+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:15:08.207286+0000","last_undegraded":"2023-10-06T11:15:08.207286+0000","last_fullsized":"2023-10-06T11:15:08.207286+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.533426+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:10.525068+0000","last_change":"2023-10-06T11:15:10.537619+0000","last_active":"2023-10-06T11:15:10.525068+0000","last_peered":"2023-10-06T11:15:10.525068+0000","last_clean":"2023-10-06T11:15:10.525068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:10.525068+0000","last_undegraded":"2023-10-06T11:15:10.525068+0000","last_fullsized":"2023-10-06T11:15:10.525068+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:01.931642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":111,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-10-06T11:15:07.522479+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:15:07.522479+0000","last_peered":"2023-10-06T11:15:07.522479+0000","last_clean":"2023-10-06T11:15:07.522479+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:15:07.522479+0000","last_undegraded":"2023-10-06T11:15:07.522479+0000","last_fullsized":"2023-10-06T11:15:07.522479+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.550124+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:27.945477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:10.525068+0000","last_change":"2023-10-06T11:15:10.657476+0000","last_active":"2023-10-06T11:15:10.525068+0000","last_peered":"2023-10-06T11:15:10.525068+0000","last_clean":"2023-10-06T11:15:10.525068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:10.525068+0000","last_undegraded":"2023-10-06T11:15:10.525068+0000","last_fullsized":"2023-10-06T11:15:10.525068+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:51:26.961011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":99,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-06T11:15:10.536695+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:15:10.536695+0000","last_peered":"2023-10-06T11:15:10.536695+0000","last_clean":"2023-10-06T11:15:10.536695+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:15:10.536695+0000","last_undegraded":"2023-10-06T11:15:10.536695+0000","last_fullsized":"2023-10-06T11:15:10.536695+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.548629+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:11.072682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:10.525068+0000","last_change":"2023-10-06T11:15:10.657540+0000","last_active":"2023-10-06T11:15:10.525068+0000","last_peered":"2023-10-06T11:15:10.525068+0000","last_clean":"2023-10-06T11:15:10.525068+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:10.525068+0000","last_undegraded":"2023-10-06T11:15:10.525068+0000","last_fullsized":"2023-10-06T11:15:10.525068+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:39.220089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":99,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-06T11:15:10.536733+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:15:10.536733+0000","last_peered":"2023-10-06T11:15:10.536733+0000","last_clean":"2023-10-06T11:15:10.536733+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:15:10.536733+0000","last_undegraded":"2023-10-06T11:15:10.536733+0000","last_fullsized":"2023-10-06T11:15:10.536733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":50,"acting":50,"num_store_stats":3},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574966,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299356,"kb_used_data":2068,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072484,"statfs":{"total":96636764160,"available":96330223616,"internally_reserved":0,"allocated":2117632,"data_stored":1285187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.51600000000000001,"15min":0.624},"min":{"1min":0.252,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.68899999999999995,"5min":4.407,"15min":23.908999999999999},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.48699999999999999,"15min":0.57499999999999996},"min":{"1min":0.26900000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.66600000000000004,"5min":0.69799999999999995,"15min":9.3230000000000004},"last":0.439}]},{"osd":1,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51200000000000001,"15min":0.56100000000000005},"min":{"1min":0.33200000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.73399999999999999,"5min":2.4689999999999999,"15min":9.2360000000000007},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47199999999999998,"15min":0.503},"min":{"1min":0.33100000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.70199999999999996,"5min":0.78900000000000003,"15min":4.327},"last":0.373}]},{"osd":2,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54200000000000004,"15min":0.51800000000000002},"min":{"1min":0.34399999999999997,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.748,"5min":4.3120000000000003,"15min":4.3120000000000003},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.53700000000000003,"15min":0.55700000000000005},"min":{"1min":0.311,"5min":0.31,"15min":0.29999999999999999},"max":{"1min":0.71599999999999997,"5min":3.0600000000000001,"15min":4.7309999999999999},"last":0.54600000000000004}]},{"osd":3,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.54700000000000004,"15min":0.53700000000000003},"min":{"1min":0.32600000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.60099999999999998,"5min":4.5190000000000001,"15min":4.5190000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55600000000000005,"15min":0.59799999999999998},"min":{"1min":0.40200000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.68100000000000005,"5min":3.0070000000000001,"15min":9.3879999999999999},"last":0.502}]},{"osd":4,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.498,"15min":0.48799999999999999},"min":{"1min":0.32700000000000001,"5min":0.26000000000000001,"15min":0.24399999999999999},"max":{"1min":0.59799999999999998,"5min":4.6639999999999997,"15min":4.6639999999999997},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53300000000000003,"15min":0.53400000000000003},"min":{"1min":0.28499999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.69199999999999995,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":0.53100000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.495,"15min":0.56000000000000005},"min":{"1min":0.32900000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.70999999999999996,"5min":0.79700000000000004,"15min":9.3499999999999996},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.497,"15min":0.54400000000000004},"min":{"1min":0.30099999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.65200000000000002,"5min":0.83399999999999996,"15min":4.444},"last":0.47299999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.59799999999999998},"min":{"1min":0.38100000000000001,"5min":0.32400000000000001,"15min":0.29199999999999998},"max":{"1min":0.64800000000000002,"5min":0.81399999999999995,"15min":9.4969999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.60299999999999998,"15min":0.61899999999999999},"min":{"1min":0.36699999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72299999999999998,"5min":4.4669999999999996,"15min":7.2039999999999997},"last":0.56299999999999994}]}]},{"osd":6,"up_from":13,"seq":55834574968,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311072,"kb_used_data":1496,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060768,"statfs":{"total":96636764160,"available":96318226432,"internally_reserved":0,"allocated":1531904,"data_stored":700074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.57899999999999996,"15min":0.52200000000000002},"min":{"1min":0.30299999999999999,"5min":0.187,"15min":0.187},"max":{"1min":9.5549999999999997,"5min":9.5549999999999997,"15min":9.5549999999999997},"last":0.45200000000000001},{"interface":"front","average":{"1min":1.032,"5min":0.63500000000000001,"15min":0.56299999999999994},"min":{"1min":0.38400000000000001,"5min":0.254,"15min":0.254},"max":{"1min":9.4659999999999993,"5min":9.4659999999999993,"15min":9.4659999999999993},"last":0.54700000000000004}]},{"osd":1,"last update":"Fri Oct 6 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.47199999999999998,"15min":0.48599999999999999},"min":{"1min":0.33400000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.80300000000000005,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56499999999999995,"15min":0.51600000000000001},"min":{"1min":0.32900000000000001,"5min":0.216,"15min":0.216},"max":{"1min":2.238,"5min":5.2670000000000003,"15min":5.2670000000000003},"last":0.48299999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.47999999999999998,"15min":0.498},"min":{"1min":0.255,"5min":0.252,"15min":0.252},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":7.0659999999999998},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.503,"5min":0.48699999999999999,"15min":0.51900000000000002},"min":{"1min":0.33700000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.72899999999999998,"5min":1.0069999999999999,"15min":7.0819999999999999},"last":0.504}]},{"osd":3,"last update":"Fri Oct 6 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.55000000000000004,"15min":0.51600000000000001},"min":{"1min":0.38400000000000001,"5min":0.317,"15min":0.25800000000000001},"max":{"1min":3.871,"5min":3.871,"15min":3.871},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.52700000000000002,"15min":0.53300000000000003},"min":{"1min":0.34799999999999998,"5min":0.316,"15min":0.312},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.47599999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.46000000000000002,"15min":0.48399999999999999},"min":{"1min":0.26800000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.628,"5min":0.88,"15min":0.88},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.51300000000000001,"15min":0.53900000000000003},"min":{"1min":0.32200000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.73399999999999999,"5min":0.82399999999999995,"15min":1.0680000000000001},"last":0.59299999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.503,"15min":0.52100000000000002},"min":{"1min":0.375,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.61199999999999999,"15min":0.58699999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":7.1379999999999999,"5min":7.1379999999999999,"15min":7.1379999999999999},"last":0.53700000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56599999999999995,"15min":0.58799999999999997},"min":{"1min":0.42799999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.88400000000000001},"last":0.55900000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574967,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311656,"kb_used_data":2080,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060184,"statfs":{"total":96636764160,"available":96317628416,"internally_reserved":0,"allocated":2129920,"data_stored":1291795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.45900000000000002,"15min":0.379},"min":{"1min":0.20499999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.67000000000000004,"5min":13.393000000000001,"15min":13.393000000000001},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.45700000000000002,"15min":0.38200000000000001},"min":{"1min":0.23599999999999999,"5min":0.22500000000000001,"15min":0.19700000000000001},"max":{"1min":0.64900000000000002,"5min":11.462,"15min":11.462},"last":0.33900000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.40400000000000003,"15min":0.35999999999999999},"min":{"1min":0.23599999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.47999999999999998,"5min":8.0470000000000006,"15min":8.0470000000000006},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.432,"15min":0.40500000000000003},"min":{"1min":0.26100000000000001,"5min":0.22800000000000001,"15min":0.20999999999999999},"max":{"1min":0.74299999999999999,"5min":4.8630000000000004,"15min":4.8630000000000004},"last":0.374}]},{"osd":3,"last update":"Fri Oct 6 11:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.44900000000000001,"15min":0.42399999999999999},"min":{"1min":0.313,"5min":0.252,"15min":0.252},"max":{"1min":0.71299999999999997,"5min":4.8029999999999999,"15min":4.8029999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.37,"5min":0.42999999999999999,"15min":0.39100000000000001},"min":{"1min":0.27600000000000002,"5min":0.217,"15min":0.217},"max":{"1min":0.68799999999999994,"5min":5.8700000000000001,"15min":5.8700000000000001},"last":0.40000000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51800000000000002,"15min":0.51500000000000001},"min":{"1min":0.38200000000000001,"5min":0.29499999999999998,"15min":0.28199999999999997},"max":{"1min":0.68500000000000005,"5min":1.264,"15min":1.264},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.60899999999999999,"15min":0.56599999999999995},"min":{"1min":0.35199999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.88600000000000001,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.48599999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.58799999999999997,"15min":0.56399999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71699999999999997,"5min":3.4390000000000001,"15min":3.4390000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.66000000000000003,"15min":0.58399999999999996},"min":{"1min":0.36799999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.69799999999999995,"5min":9.3829999999999991,"15min":9.3829999999999991},"last":0.5}]},{"osd":6,"last update":"Fri Oct 6 11:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.61899999999999999,"15min":0.58299999999999996},"min":{"1min":0.35999999999999999,"5min":0.34999999999999998,"15min":0.315},"max":{"1min":0.86699999999999999,"5min":3.4750000000000001,"15min":3.4750000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60999999999999999,"15min":0.58899999999999997},"min":{"1min":0.40400000000000003,"5min":0.379,"15min":0.36699999999999999},"max":{"1min":0.748,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.60699999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.64500000000000002,"15min":0.60999999999999999},"min":{"1min":0.42299999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92200000000000004,"5min":4.7290000000000001,"15min":4.7290000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.60999999999999999,"15min":0.59099999999999997},"min":{"1min":0.42099999999999999,"5min":0.378,"15min":0.374},"max":{"1min":0.89500000000000002,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.61599999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574966,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302856,"kb_used_data":1472,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068984,"statfs":{"total":96636764160,"available":96326639616,"internally_reserved":0,"allocated":1507328,"data_stored":687308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.42099999999999999,"15min":0.46800000000000003},"min":{"1min":0.20399999999999999,"5min":0.184,"15min":0.184},"max":{"1min":0.501,"5min":8.4239999999999995,"15min":36.097999999999999},"last":0.318},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.43099999999999999,"15min":0.377},"min":{"1min":0.22,"5min":0.20799999999999999,"15min":0.182},"max":{"1min":0.52000000000000002,"5min":7.2990000000000004,"15min":7.2990000000000004},"last":0.92400000000000004}]},{"osd":2,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.44800000000000001,"15min":0.50600000000000001},"min":{"1min":0.28199999999999997,"5min":0.221,"15min":0.217},"max":{"1min":0.61699999999999999,"5min":8.6080000000000005,"15min":36.07},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.442,"15min":0.40400000000000003},"min":{"1min":0.27100000000000002,"5min":0.23400000000000001,"15min":0.219},"max":{"1min":0.60699999999999998,"5min":6.7800000000000002,"15min":6.7800000000000002},"last":0.94899999999999995}]},{"osd":3,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.36599999999999999,"15min":0.39300000000000002},"min":{"1min":0.255,"5min":0.223,"15min":0.223},"max":{"1min":0.55000000000000004,"5min":1.863,"15min":8.4130000000000003},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.48699999999999999,"15min":0.55700000000000005},"min":{"1min":0.25800000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.65200000000000002,"5min":8.4570000000000007,"15min":35.959000000000003},"last":1.9079999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55900000000000005,"15min":0.56200000000000006},"min":{"1min":0.39300000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.85099999999999998,"5min":2.427,"15min":2.427},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.65400000000000003,"15min":0.73299999999999998},"min":{"1min":0.42799999999999999,"5min":0.34399999999999997,"15min":0.29299999999999998},"max":{"1min":0.94999999999999996,"5min":8.2919999999999998,"15min":36.005000000000003},"last":0.53000000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.628,"15min":0.57899999999999996},"min":{"1min":0.38900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.89600000000000002,"5min":6.6699999999999999,"15min":6.6699999999999999},"last":0.999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55100000000000005,"15min":0.55200000000000005},"min":{"1min":0.372,"5min":0.315,"15min":0.315},"max":{"1min":0.82599999999999996,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.51300000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.66700000000000004,"15min":0.73399999999999999},"min":{"1min":0.42199999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.98699999999999999,"5min":8.2479999999999993,"15min":36.037999999999997},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.624,"5min":0.66400000000000003,"15min":0.63600000000000001},"min":{"1min":0.495,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.97199999999999998,"5min":6.7110000000000003,"15min":6.7110000000000003},"last":1.028}]},{"osd":7,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.65500000000000003,"15min":0.623},"min":{"1min":0.44,"5min":0.371,"15min":0.371},"max":{"1min":0.93100000000000005,"5min":6.742,"15min":6.742},"last":1.054},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57899999999999996,"15min":0.56899999999999995},"min":{"1min":0.41499999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.96199999999999997,"5min":1.917,"15min":1.917},"last":0.69899999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574967,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315156,"kb_used_data":1484,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94056684,"statfs":{"total":96636764160,"available":96314044416,"internally_reserved":0,"allocated":1519616,"data_stored":693466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.313,"15min":0.31},"min":{"1min":0.246,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.36399999999999999,"5min":0.56699999999999995,"15min":0.57499999999999996},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.38400000000000001,"15min":0.38200000000000001},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.438,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.34399999999999997}]},{"osd":1,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.373,"15min":0.372},"min":{"1min":0.252,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.47699999999999998,"5min":0.745,"15min":0.745},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.35199999999999998,"15min":0.34999999999999998},"min":{"1min":0.26200000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.52700000000000002,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.29299999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.35599999999999998,"15min":0.36599999999999999},"min":{"1min":0.27100000000000002,"5min":0.23300000000000001,"15min":0.23200000000000001},"max":{"1min":0.40000000000000002,"5min":0.58699999999999997,"15min":0.629},"last":0.313},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.36499999999999999,"15min":0.36399999999999999},"min":{"1min":0.25900000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.42199999999999999,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.33000000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.505,"15min":0.52500000000000002},"min":{"1min":0.36199999999999999,"5min":0.30599999999999999,"15min":0.30299999999999999},"max":{"1min":0.70899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.52000000000000002,"15min":0.54600000000000004},"min":{"1min":0.35499999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.72299999999999998,"5min":0.80400000000000005,"15min":0.84899999999999998},"last":0.47299999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.52600000000000002,"15min":0.54100000000000004},"min":{"1min":0.38300000000000001,"5min":0.33100000000000002,"15min":0.32400000000000001},"max":{"1min":0.71699999999999997,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.54800000000000004,"15min":0.55200000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.78100000000000003,"5min":0.878,"15min":0.878},"last":0.53200000000000003}]},{"osd":6,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.56499999999999995,"15min":0.57899999999999996},"min":{"1min":0.38700000000000001,"5min":0.36799999999999999,"15min":0.32600000000000001},"max":{"1min":0.73799999999999999,"5min":0.85199999999999998,"15min":0.86299999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55900000000000005,"15min":0.57099999999999995},"min":{"1min":0.40699999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70699999999999996,"5min":0.878,"15min":0.88600000000000001},"last":0.56100000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.37,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67700000000000005,"5min":1.139,"15min":1.139},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.55800000000000005,"15min":0.56699999999999995},"min":{"1min":0.41699999999999998,"5min":0.38800000000000001,"15min":0.38200000000000001},"max":{"1min":0.69699999999999995,"5min":0.89600000000000002,"15min":0.90500000000000003},"last":0.48499999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574967,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306964,"kb_used_data":1484,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064876,"statfs":{"total":96636764160,"available":96322433024,"internally_reserved":0,"allocated":1519616,"data_stored":693466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.31,"15min":0.31900000000000001},"min":{"1min":0.222,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.45500000000000002,"5min":0.48899999999999999,"15min":1.095},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35199999999999998,"15min":0.38100000000000001},"min":{"1min":0.27100000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.52700000000000002,"5min":0.53900000000000003,"15min":1.7210000000000001},"last":0.34999999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.314,"15min":0.311},"min":{"1min":0.23400000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.65400000000000003},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.34100000000000003,"15min":0.35899999999999999},"min":{"1min":0.25800000000000001,"5min":0.188,"15min":0.188},"max":{"1min":0.53100000000000003,"5min":0.53400000000000003,"15min":1.196},"last":0.317}]},{"osd":2,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.34799999999999998,"15min":0.374},"min":{"1min":0.251,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.47799999999999998,"5min":0.73499999999999999,"15min":1.7729999999999999},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39700000000000002,"15min":0.41099999999999998},"min":{"1min":0.308,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.57699999999999996,"5min":0.58599999999999997,"15min":1.224},"last":0.39600000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.50900000000000001,"15min":0.54900000000000004},"min":{"1min":0.32100000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":1.694},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51700000000000002,"15min":0.53700000000000003},"min":{"1min":0.35899999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.432}]},{"osd":5,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53100000000000003,"15min":0.53200000000000003},"min":{"1min":0.35599999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.878},"last":0.501},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53900000000000003,"15min":0.55600000000000005},"min":{"1min":0.39000000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.746,"5min":0.75800000000000001,"15min":1.165},"last":0.443}]},{"osd":6,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55300000000000005,"15min":0.57999999999999996},"min":{"1min":0.372,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.79200000000000004,"5min":0.85099999999999998,"15min":1.1359999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55900000000000005,"15min":0.58799999999999997},"min":{"1min":0.42999999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79700000000000004,"5min":0.82199999999999995,"15min":1.7470000000000001},"last":0.55400000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55000000000000004,"15min":0.57799999999999996},"min":{"1min":0.38900000000000001,"5min":0.35699999999999998,"15min":0.35599999999999998},"max":{"1min":0.754,"5min":0.85399999999999998,"15min":1.657},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56100000000000005,"15min":0.57199999999999995},"min":{"1min":0.38,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.82099999999999995,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.47899999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574966,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302884,"kb_used_data":1500,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068956,"statfs":{"total":96636764160,"available":96326610944,"internally_reserved":0,"allocated":1536000,"data_stored":701427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.45700000000000002,"15min":0.53500000000000003},"min":{"1min":0.216,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":2.6619999999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.439,"5min":0.47499999999999998,"15min":0.49099999999999999},"min":{"1min":0.224,"5min":0.215,"15min":0.215},"max":{"1min":0.69999999999999996,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.33300000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:14:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47099999999999997,"15min":0.55600000000000005},"min":{"1min":0.27300000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1,"5min":1,"15min":2.8650000000000002},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.48199999999999998,"15min":0.56299999999999994},"min":{"1min":0.27400000000000002,"5min":0.26200000000000001,"15min":0.25800000000000001},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":2.7610000000000001},"last":0.41499999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:14:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.49299999999999999,"15min":0.54100000000000004},"min":{"1min":0.28499999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.749,"5min":0.76000000000000001,"15min":1.6910000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54200000000000004,"15min":0.58699999999999997},"min":{"1min":0.41099999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71899999999999997,"5min":0.93899999999999995,"15min":1.718},"last":0.67600000000000005}]},{"osd":3,"last update":"Fri Oct 6 11:14:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.55300000000000005,"15min":0.59999999999999998},"min":{"1min":0.33400000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":2.387,"5min":2.387,"15min":2.677},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.27500000000000002},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":0.64100000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:14:53 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.47099999999999997,"15min":0.48399999999999999},"min":{"1min":0.315,"5min":0.23499999999999999,"15min":0.23200000000000001},"max":{"1min":0.73199999999999998,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.495,"15min":0.52600000000000002},"min":{"1min":0.29299999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.58899999999999997,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.55700000000000005}]},{"osd":6,"last update":"Fri Oct 6 11:14:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.505,"15min":0.52100000000000002},"min":{"1min":0.31,"5min":0.30499999999999999,"15min":0.252},"max":{"1min":0.63400000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.502,"5min":0.53500000000000003,"15min":0.56499999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.64800000000000002,"5min":0.85799999999999998,"15min":1.165},"last":0.61199999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:14:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.55300000000000005,"15min":0.55700000000000005},"min":{"1min":0.35399999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.74399999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.626},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56100000000000005,"15min":0.59299999999999997},"min":{"1min":0.318,"5min":0.317,"15min":0.317},"max":{"1min":0.67900000000000005,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.875}]}]},{"osd":5,"up_from":13,"seq":55834574968,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311064,"kb_used_data":1488,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060776,"statfs":{"total":96636764160,"available":96318234624,"internally_reserved":0,"allocated":1523712,"data_stored":694819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45400000000000001,"15min":0.60799999999999998},"min":{"1min":0.34799999999999998,"5min":0.23100000000000001,"15min":0.20499999999999999},"max":{"1min":0.61099999999999999,"5min":0.72599999999999998,"15min":5.0490000000000004},"last":0.443},{"interface":"front","average":{"1min":0.434,"5min":0.45200000000000001,"15min":0.58499999999999996},"min":{"1min":0.253,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.65500000000000003,"5min":0.78100000000000003,"15min":5.1449999999999996},"last":0.47499999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.46500000000000002,"15min":0.48099999999999998},"min":{"1min":0.29599999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.629,"5min":0.81399999999999995,"15min":0.97199999999999998},"last":0.497},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47699999999999998,"15min":0.51000000000000001},"min":{"1min":0.30099999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.58599999999999997,"5min":0.70199999999999996,"15min":1.8799999999999999},"last":0.53100000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.50700000000000001,"15min":0.54900000000000004},"min":{"1min":0.30099999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.60999999999999999,"5min":0.79800000000000004,"15min":4.234},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52600000000000002,"15min":0.55800000000000005},"min":{"1min":0.40100000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.64000000000000001,"5min":0.81000000000000005,"15min":1.0369999999999999},"last":0.62}]},{"osd":3,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48299999999999998,"15min":0.627},"min":{"1min":0.33200000000000002,"5min":0.30399999999999999,"15min":0.27700000000000002},"max":{"1min":0.60699999999999998,"5min":0.82299999999999995,"15min":5.2169999999999996},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.51300000000000001,"15min":0.54000000000000004},"min":{"1min":0.373,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.56299999999999994,"5min":0.82699999999999996,"15min":1.008},"last":0.45800000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.46999999999999997,"15min":0.51100000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.23999999999999999},"max":{"1min":0.61499999999999999,"5min":0.83399999999999996,"15min":1.917},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46899999999999997,"15min":0.52300000000000002},"min":{"1min":0.35599999999999998,"5min":0.24399999999999999,"15min":0.23899999999999999},"max":{"1min":0.628,"5min":0.71899999999999997,"15min":0.87},"last":0.59099999999999997}]},{"osd":6,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.55100000000000005},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.64700000000000002,"5min":0.77100000000000002,"15min":2.0139999999999998},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55400000000000005,"15min":0.60199999999999998},"min":{"1min":0.43099999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.64000000000000001,"5min":0.82899999999999996,"15min":1.9470000000000001},"last":0.67900000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52100000000000002,"15min":0.57399999999999995},"min":{"1min":0.28799999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.65500000000000003,"5min":0.81000000000000005,"15min":0.96499999999999997},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55200000000000005,"15min":0.60099999999999998},"min":{"1min":0.376,"5min":0.316,"15min":0.28799999999999998},"max":{"1min":0.68000000000000005,"5min":0.79900000000000004,"15min":1.4119999999999999},"last":0.56499999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:15:16.998 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:15:17.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.144+0000 7fa3dc1b6700 1 Processor -- start 2023-10-06T11:15:17.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.145+0000 7fa3dc1b6700 1 -- start start 2023-10-06T11:15:17.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.145+0000 7fa3dc1b6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa3d4153ab0 0x7fa3d415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:17.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.145+0000 7fa3dc1b6700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa3d4068ba0 0x7fa3d40b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:17.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.145+0000 7fa3dc1b6700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3d415ac30 con 0x7fa3d4153e80 2023-10-06T11:15:17.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.145+0000 7fa3dc1b6700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3d40b4510 con 0x7fa3d4068ba0 2023-10-06T11:15:17.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.145+0000 7fa3dc1b6700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d40b6530 con 0x7fa3d4153ab0 2023-10-06T11:15:17.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.146+0000 7fa3da753700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa3d4068ba0 0x7fa3d40b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:17.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.146+0000 7fa3d9f52700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa3d4153ab0 0x7fa3d415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:17.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.146+0000 7fa3da753700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa3d4068ba0 0x7fa3d40b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:52438/0 (socket says 172.21.15.146:52438) 2023-10-06T11:15:17.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.146+0000 7fa3d9751700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fa3d4153e80 0x7fa3d4068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:48106/0 (socket says 172.21.15.146:48106) 2023-10-06T11:15:17.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.146+0000 7fa3da753700 1 -- 172.21.15.146:0/2094655140 learned_addr learned my addr 172.21.15.146:0/2094655140 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:17.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.146+0000 7fa3d9f52700 1 -- 172.21.15.146:0/2094655140 >> v2:172.21.15.151:3300/0 conn(0x7fa3d4068ba0 msgr2=0x7fa3d40b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:17.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.146+0000 7fa3d9f52700 1 --2- 172.21.15.146:0/2094655140 >> v2:172.21.15.151:3300/0 conn(0x7fa3d4068ba0 0x7fa3d40b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:17.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.146+0000 7fa3d9f52700 1 -- 172.21.15.146:0/2094655140 >> v1:172.21.15.151:6789/0 conn(0x7fa3d4153e80 legacy=0x7fa3d4068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:17.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.146+0000 7fa3d9f52700 1 -- 172.21.15.146:0/2094655140 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d40b5c50 con 0x7fa3d4153ab0 2023-10-06T11:15:17.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.146+0000 7fa3d9f52700 1 --2- 172.21.15.146:0/2094655140 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa3d4153ab0 0x7fa3d415a6f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0009e60 tx=0x7fa3d0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a944d32f260bcd7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:17.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.147+0000 7fa3d8f50700 1 -- 172.21.15.146:0/2094655140 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d000e070 con 0x7fa3d4153ab0 2023-10-06T11:15:17.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.147+0000 7fa3d8f50700 1 -- 172.21.15.146:0/2094655140 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d000bb60 con 0x7fa3d4153ab0 2023-10-06T11:15:17.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.147+0000 7fa3d8f50700 1 -- 172.21.15.146:0/2094655140 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d0012430 con 0x7fa3d4153ab0 2023-10-06T11:15:17.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.147+0000 7fa3dc1b6700 1 -- 172.21.15.146:0/2094655140 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa3d4153ab0 msgr2=0x7fa3d415a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:17.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.147+0000 7fa3dc1b6700 1 --2- 172.21.15.146:0/2094655140 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa3d4153ab0 0x7fa3d415a6f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0009e60 tx=0x7fa3d0009780 comp rx=0 tx=0).stop 2023-10-06T11:15:17.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.147+0000 7fa3dc1b6700 1 -- 172.21.15.146:0/2094655140 shutdown_connections 2023-10-06T11:15:17.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.147+0000 7fa3dc1b6700 1 --2- 172.21.15.146:0/2094655140 >> v2:172.21.15.151:3300/0 conn(0x7fa3d4068ba0 0x7fa3d40b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:17.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.147+0000 7fa3dc1b6700 1 --2- 172.21.15.146:0/2094655140 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa3d4153ab0 0x7fa3d415a6f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:17.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.147+0000 7fa3dc1b6700 1 -- 172.21.15.146:0/2094655140 >> 172.21.15.146:0/2094655140 conn(0x7fa3d406eba0 msgr2=0x7fa3d406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:17.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.147+0000 7fa3dc1b6700 1 -- 172.21.15.146:0/2094655140 shutdown_connections 2023-10-06T11:15:17.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.147+0000 7fa3dc1b6700 1 -- 172.21.15.146:0/2094655140 wait complete. 2023-10-06T11:15:17.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.148+0000 7fa3dc1b6700 1 Processor -- start 2023-10-06T11:15:17.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.148+0000 7fa3dc1b6700 1 -- start start 2023-10-06T11:15:17.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.149+0000 7fa3dc1b6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3d4068ba0 0x7fa3d4155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:17.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.149+0000 7fa3dc1b6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa3d4153ab0 0x7fa3d416b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:17.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.149+0000 7fa3dc1b6700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3d4153e80 0x7fa3d4169ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:17.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.149+0000 7fa3dc1b6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d4158f50 con 0x7fa3d4068ba0 2023-10-06T11:15:17.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.149+0000 7fa3dc1b6700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d41591c0 con 0x7fa3d4153e80 2023-10-06T11:15:17.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.149+0000 7fa3dc1b6700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d416b600 con 0x7fa3d4153ab0 2023-10-06T11:15:17.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.149+0000 7fa3d9f52700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3d4068ba0 0x7fa3d4155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:17.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.149+0000 7fa3d9f52700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3d4068ba0 0x7fa3d4155e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35402/0 (socket says 172.21.15.146:35402) 2023-10-06T11:15:17.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.149+0000 7fa3d9f52700 1 -- 172.21.15.146:0/2584423740 learned_addr learned my addr 172.21.15.146:0/2584423740 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:17.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.149+0000 7fa3d9751700 1 --2- 172.21.15.146:0/2584423740 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa3d4153ab0 0x7fa3d416b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:17.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.149+0000 7fa3da753700 1 --2- 172.21.15.146:0/2584423740 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3d4153e80 0x7fa3d4169ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:17.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.149+0000 7fa3d9f52700 1 -- 172.21.15.146:0/2584423740 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa3d4153ab0 msgr2=0x7fa3d416b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:17.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.149+0000 7fa3d9f52700 1 --2- 172.21.15.146:0/2584423740 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa3d4153ab0 0x7fa3d416b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:17.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.149+0000 7fa3d9f52700 1 -- 172.21.15.146:0/2584423740 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3d4153e80 msgr2=0x7fa3d4169ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:17.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.149+0000 7fa3d9f52700 1 --2- 172.21.15.146:0/2584423740 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3d4153e80 0x7fa3d4169ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:17.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.149+0000 7fa3d9f52700 1 -- 172.21.15.146:0/2584423740 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d0009a20 con 0x7fa3d4068ba0 2023-10-06T11:15:17.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.149+0000 7fa3da753700 1 --2- 172.21.15.146:0/2584423740 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3d4153e80 0x7fa3d4169ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:17.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.150+0000 7fa3d9f52700 1 --2- 172.21.15.146:0/2584423740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3d4068ba0 0x7fa3d4155e50 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7fa3d00097c0 tx=0x7fa3d0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:17.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.150+0000 7fa3c9ffb700 1 -- 172.21.15.146:0/2584423740 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d0012da0 con 0x7fa3d4068ba0 2023-10-06T11:15:17.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.150+0000 7fa3dc1b6700 1 -- 172.21.15.146:0/2584423740 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3d416a700 con 0x7fa3d4068ba0 2023-10-06T11:15:17.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.150+0000 7fa3c9ffb700 1 -- 172.21.15.146:0/2584423740 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d0027470 con 0x7fa3d4068ba0 2023-10-06T11:15:17.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.150+0000 7fa3c9ffb700 1 -- 172.21.15.146:0/2584423740 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d0027830 con 0x7fa3d4068ba0 2023-10-06T11:15:17.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.150+0000 7fa3dc1b6700 1 -- 172.21.15.146:0/2584423740 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3d416ad40 con 0x7fa3d4068ba0 2023-10-06T11:15:17.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.151+0000 7fa3dc1b6700 1 -- 172.21.15.146:0/2584423740 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3d416aed0 con 0x7fa3d4068ba0 2023-10-06T11:15:17.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.151+0000 7fa3c9ffb700 1 -- 172.21.15.146:0/2584423740 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa3d0024070 con 0x7fa3d4068ba0 2023-10-06T11:15:17.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.152+0000 7fa3c9ffb700 1 --2- 172.21.15.146:0/2584423740 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa3b8066f30 0x7fa3b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:17.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.152+0000 7fa3c9ffb700 1 -- 172.21.15.146:0/2584423740 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa3d0086d00 con 0x7fa3d4068ba0 2023-10-06T11:15:17.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.152+0000 7fa3d9751700 1 --2- 172.21.15.146:0/2584423740 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa3b8066f30 0x7fa3b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:17.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.152+0000 7fa3d9751700 1 --2- 172.21.15.146:0/2584423740 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa3b8066f30 0x7fa3b80693e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4007fd0 tx=0x7fa3c4007d70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:17.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.156+0000 7fa3c9ffb700 1 -- 172.21.15.146:0/2584423740 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa3d0053e10 con 0x7fa3d4068ba0 2023-10-06T11:15:17.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.335+0000 7fa3dc1b6700 1 -- 172.21.15.146:0/2584423740 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa3d416a460 con 0x7fa3b8066f30 2023-10-06T11:15:17.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.343+0000 7fa3c9ffb700 1 -- 172.21.15.146:0/2584423740 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310639 (secure 0 0 0) 0x7fa3d416a460 con 0x7fa3b8066f30 2023-10-06T11:15:17.348 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:15:17.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.346+0000 7fa3dc1b6700 1 -- 172.21.15.146:0/2584423740 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa3b8066f30 msgr2=0x7fa3b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:17.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.346+0000 7fa3dc1b6700 1 --2- 172.21.15.146:0/2584423740 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa3b8066f30 0x7fa3b80693e0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4007fd0 tx=0x7fa3c4007d70 comp rx=0 tx=0).stop 2023-10-06T11:15:17.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.346+0000 7fa3dc1b6700 1 -- 172.21.15.146:0/2584423740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3d4068ba0 msgr2=0x7fa3d4155e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:17.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.346+0000 7fa3dc1b6700 1 --2- 172.21.15.146:0/2584423740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3d4068ba0 0x7fa3d4155e50 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7fa3d00097c0 tx=0x7fa3d0019000 comp rx=0 tx=0).stop 2023-10-06T11:15:17.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.346+0000 7fa3dc1b6700 1 -- 172.21.15.146:0/2584423740 shutdown_connections 2023-10-06T11:15:17.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.346+0000 7fa3dc1b6700 1 --2- 172.21.15.146:0/2584423740 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa3b8066f30 0x7fa3b80693e0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:17.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.346+0000 7fa3dc1b6700 1 --2- 172.21.15.146:0/2584423740 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3d4153e80 0x7fa3d4169ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:17.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.346+0000 7fa3dc1b6700 1 --2- 172.21.15.146:0/2584423740 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa3d4068ba0 0x7fa3d4155e50 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:17.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.346+0000 7fa3dc1b6700 1 --2- 172.21.15.146:0/2584423740 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa3d4153ab0 0x7fa3d416b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:17.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.346+0000 7fa3dc1b6700 1 -- 172.21.15.146:0/2584423740 >> 172.21.15.146:0/2584423740 conn(0x7fa3d406eba0 msgr2=0x7fa3d415c680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:17.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.346+0000 7fa3dc1b6700 1 -- 172.21.15.146:0/2584423740 shutdown_connections 2023-10-06T11:15:17.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.346+0000 7fa3dc1b6700 1 -- 172.21.15.146:0/2584423740 wait complete. 2023-10-06T11:15:17.352 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:15:17.360 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":408,"stamp":"2023-10-06T11:15:17.262531+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592050,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":182,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":158,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2461252,"kb_used_data":13316,"kb_used_omap":0,"kb_used_meta":2447872,"kb_avail":752513468,"statfs":{"total":773094113280,"available":770573791232,"internally_reserved":0,"allocated":13635584,"data_stored":6859423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2506620928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1682,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001139"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.552659+0000","last_change":"2023-10-06T11:15:12.549332+0000","last_active":"2023-10-06T11:15:12.552659+0000","last_peered":"2023-10-06T11:15:12.552659+0000","last_clean":"2023-10-06T11:15:12.552659+0000","last_became_active":"2023-10-06T11:15:12.549080+0000","last_became_peered":"2023-10-06T11:15:12.549080+0000","last_unstale":"2023-10-06T11:15:12.552659+0000","last_undegraded":"2023-10-06T11:15:12.552659+0000","last_fullsized":"2023-10-06T11:15:12.552659+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:24.341162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.563133+0000","last_change":"2023-10-06T11:15:12.556976+0000","last_active":"2023-10-06T11:15:12.563133+0000","last_peered":"2023-10-06T11:15:12.563133+0000","last_clean":"2023-10-06T11:15:12.563133+0000","last_became_active":"2023-10-06T11:15:12.556711+0000","last_became_peered":"2023-10-06T11:15:12.556711+0000","last_unstale":"2023-10-06T11:15:12.563133+0000","last_undegraded":"2023-10-06T11:15:12.563133+0000","last_fullsized":"2023-10-06T11:15:12.563133+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:12.927736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.548374+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:03:55.986977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.554968+0000","last_change":"2023-10-06T11:15:12.553917+0000","last_active":"2023-10-06T11:15:12.554968+0000","last_peered":"2023-10-06T11:15:12.554968+0000","last_clean":"2023-10-06T11:15:12.554968+0000","last_became_active":"2023-10-06T11:15:12.553584+0000","last_became_peered":"2023-10-06T11:15:12.553584+0000","last_unstale":"2023-10-06T11:15:12.554968+0000","last_undegraded":"2023-10-06T11:15:12.554968+0000","last_fullsized":"2023-10-06T11:15:12.554968+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:23:20.636047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.564171+0000","last_change":"2023-10-06T11:15:12.560638+0000","last_active":"2023-10-06T11:15:12.564171+0000","last_peered":"2023-10-06T11:15:12.564171+0000","last_clean":"2023-10-06T11:15:12.564171+0000","last_became_active":"2023-10-06T11:15:12.560214+0000","last_became_peered":"2023-10-06T11:15:12.560214+0000","last_unstale":"2023-10-06T11:15:12.564171+0000","last_undegraded":"2023-10-06T11:15:12.564171+0000","last_fullsized":"2023-10-06T11:15:12.564171+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:59:35.368760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.551608+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:25:18.441894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.568046+0000","last_change":"2023-10-06T11:15:12.563070+0000","last_active":"2023-10-06T11:15:12.568046+0000","last_peered":"2023-10-06T11:15:12.568046+0000","last_clean":"2023-10-06T11:15:12.568046+0000","last_became_active":"2023-10-06T11:15:12.562448+0000","last_became_peered":"2023-10-06T11:15:12.562448+0000","last_unstale":"2023-10-06T11:15:12.568046+0000","last_undegraded":"2023-10-06T11:15:12.568046+0000","last_fullsized":"2023-10-06T11:15:12.568046+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:25:09.868317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.545346+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:49:53.647910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.553845+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:35:58.009437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.560441+0000","last_change":"2023-10-06T11:15:12.557451+0000","last_active":"2023-10-06T11:15:12.560441+0000","last_peered":"2023-10-06T11:15:12.560441+0000","last_clean":"2023-10-06T11:15:12.560441+0000","last_became_active":"2023-10-06T11:15:12.557196+0000","last_became_peered":"2023-10-06T11:15:12.557196+0000","last_unstale":"2023-10-06T11:15:12.560441+0000","last_undegraded":"2023-10-06T11:15:12.560441+0000","last_fullsized":"2023-10-06T11:15:12.560441+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:04:15.796514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.563182+0000","last_change":"2023-10-06T11:15:12.555394+0000","last_active":"2023-10-06T11:15:12.563182+0000","last_peered":"2023-10-06T11:15:12.563182+0000","last_clean":"2023-10-06T11:15:12.563182+0000","last_became_active":"2023-10-06T11:15:12.555139+0000","last_became_peered":"2023-10-06T11:15:12.555139+0000","last_unstale":"2023-10-06T11:15:12.563182+0000","last_undegraded":"2023-10-06T11:15:12.563182+0000","last_fullsized":"2023-10-06T11:15:12.563182+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:14.774930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.556390+0000","last_change":"2023-10-06T11:15:12.550822+0000","last_active":"2023-10-06T11:15:12.556390+0000","last_peered":"2023-10-06T11:15:12.556390+0000","last_clean":"2023-10-06T11:15:12.556390+0000","last_became_active":"2023-10-06T11:15:12.550575+0000","last_became_peered":"2023-10-06T11:15:12.550575+0000","last_unstale":"2023-10-06T11:15:12.556390+0000","last_undegraded":"2023-10-06T11:15:12.556390+0000","last_fullsized":"2023-10-06T11:15:12.556390+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:57:48.775209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.545643+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:58:42.165232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.561017+0000","last_change":"2023-10-06T11:15:12.555280+0000","last_active":"2023-10-06T11:15:12.561017+0000","last_peered":"2023-10-06T11:15:12.561017+0000","last_clean":"2023-10-06T11:15:12.561017+0000","last_became_active":"2023-10-06T11:15:12.555040+0000","last_became_peered":"2023-10-06T11:15:12.555040+0000","last_unstale":"2023-10-06T11:15:12.561017+0000","last_undegraded":"2023-10-06T11:15:12.561017+0000","last_fullsized":"2023-10-06T11:15:12.561017+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:59:31.617255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.558104+0000","last_change":"2023-10-06T11:15:12.554601+0000","last_active":"2023-10-06T11:15:12.558104+0000","last_peered":"2023-10-06T11:15:12.558104+0000","last_clean":"2023-10-06T11:15:12.558104+0000","last_became_active":"2023-10-06T11:15:12.554376+0000","last_became_peered":"2023-10-06T11:15:12.554376+0000","last_unstale":"2023-10-06T11:15:12.558104+0000","last_undegraded":"2023-10-06T11:15:12.558104+0000","last_fullsized":"2023-10-06T11:15:12.558104+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:06:58.266176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.545611+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:51:27.969369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.551293+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:45:49.982194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.560708+0000","last_change":"2023-10-06T11:15:12.556018+0000","last_active":"2023-10-06T11:15:12.560708+0000","last_peered":"2023-10-06T11:15:12.560708+0000","last_clean":"2023-10-06T11:15:12.560708+0000","last_became_active":"2023-10-06T11:15:12.555750+0000","last_became_peered":"2023-10-06T11:15:12.555750+0000","last_unstale":"2023-10-06T11:15:12.560708+0000","last_undegraded":"2023-10-06T11:15:12.560708+0000","last_fullsized":"2023-10-06T11:15:12.560708+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:09:25.439474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.568555+0000","last_change":"2023-10-06T11:15:12.566859+0000","last_active":"2023-10-06T11:15:12.568555+0000","last_peered":"2023-10-06T11:15:12.568555+0000","last_clean":"2023-10-06T11:15:12.568555+0000","last_became_active":"2023-10-06T11:15:12.566559+0000","last_became_peered":"2023-10-06T11:15:12.566559+0000","last_unstale":"2023-10-06T11:15:12.568555+0000","last_undegraded":"2023-10-06T11:15:12.568555+0000","last_fullsized":"2023-10-06T11:15:12.568555+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:56:21.022912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.556172+0000","last_change":"2023-10-06T11:15:12.553202+0000","last_active":"2023-10-06T11:15:12.556172+0000","last_peered":"2023-10-06T11:15:12.556172+0000","last_clean":"2023-10-06T11:15:12.556172+0000","last_became_active":"2023-10-06T11:15:12.552964+0000","last_became_peered":"2023-10-06T11:15:12.552964+0000","last_unstale":"2023-10-06T11:15:12.556172+0000","last_undegraded":"2023-10-06T11:15:12.556172+0000","last_fullsized":"2023-10-06T11:15:12.556172+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:25:09.868317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.564402+0000","last_change":"2023-10-06T11:15:12.561867+0000","last_active":"2023-10-06T11:15:12.564402+0000","last_peered":"2023-10-06T11:15:12.564402+0000","last_clean":"2023-10-06T11:15:12.564402+0000","last_became_active":"2023-10-06T11:15:12.561621+0000","last_became_peered":"2023-10-06T11:15:12.561621+0000","last_unstale":"2023-10-06T11:15:12.564402+0000","last_undegraded":"2023-10-06T11:15:12.564402+0000","last_fullsized":"2023-10-06T11:15:12.564402+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:33:57.627561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.561038+0000","last_change":"2023-10-06T11:15:12.556434+0000","last_active":"2023-10-06T11:15:12.561038+0000","last_peered":"2023-10-06T11:15:12.561038+0000","last_clean":"2023-10-06T11:15:12.561038+0000","last_became_active":"2023-10-06T11:15:12.556084+0000","last_became_peered":"2023-10-06T11:15:12.556084+0000","last_unstale":"2023-10-06T11:15:12.561038+0000","last_undegraded":"2023-10-06T11:15:12.561038+0000","last_fullsized":"2023-10-06T11:15:12.561038+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:13:03.552426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.563099+0000","last_change":"2023-10-06T11:15:12.558929+0000","last_active":"2023-10-06T11:15:12.563099+0000","last_peered":"2023-10-06T11:15:12.563099+0000","last_clean":"2023-10-06T11:15:12.563099+0000","last_became_active":"2023-10-06T11:15:12.558672+0000","last_became_peered":"2023-10-06T11:15:12.558672+0000","last_unstale":"2023-10-06T11:15:12.563099+0000","last_undegraded":"2023-10-06T11:15:12.563099+0000","last_fullsized":"2023-10-06T11:15:12.563099+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:36.864990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.554183+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:33:57.627561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.549474+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:19:29.875101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.549075+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:14:08.040389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.567611+0000","last_change":"2023-10-06T11:15:12.561938+0000","last_active":"2023-10-06T11:15:12.567611+0000","last_peered":"2023-10-06T11:15:12.567611+0000","last_clean":"2023-10-06T11:15:12.567611+0000","last_became_active":"2023-10-06T11:15:12.561689+0000","last_became_peered":"2023-10-06T11:15:12.561689+0000","last_unstale":"2023-10-06T11:15:12.567611+0000","last_undegraded":"2023-10-06T11:15:12.567611+0000","last_fullsized":"2023-10-06T11:15:12.567611+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:32:37.458835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.556345+0000","last_change":"2023-10-06T11:15:12.554453+0000","last_active":"2023-10-06T11:15:12.556345+0000","last_peered":"2023-10-06T11:15:12.556345+0000","last_clean":"2023-10-06T11:15:12.556345+0000","last_became_active":"2023-10-06T11:15:12.554219+0000","last_became_peered":"2023-10-06T11:15:12.554219+0000","last_unstale":"2023-10-06T11:15:12.556345+0000","last_undegraded":"2023-10-06T11:15:12.556345+0000","last_fullsized":"2023-10-06T11:15:12.556345+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:21:45.309284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.550511+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:06.278594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.549144+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:16:46.194765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.544258+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:33:57.627561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.562828+0000","last_change":"2023-10-06T11:15:12.561924+0000","last_active":"2023-10-06T11:15:12.562828+0000","last_peered":"2023-10-06T11:15:12.562828+0000","last_clean":"2023-10-06T11:15:12.562828+0000","last_became_active":"2023-10-06T11:15:12.561662+0000","last_became_peered":"2023-10-06T11:15:12.561662+0000","last_unstale":"2023-10-06T11:15:12.562828+0000","last_undegraded":"2023-10-06T11:15:12.562828+0000","last_fullsized":"2023-10-06T11:15:12.562828+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:52:03.889787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.544863+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:14.774930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.615827+0000","last_change":"2023-10-06T11:15:11.615827+0000","last_active":"2023-10-06T11:15:11.615827+0000","last_peered":"2023-10-06T11:15:11.615827+0000","last_clean":"2023-10-06T11:15:11.615827+0000","last_became_active":"2023-10-06T11:15:11.615550+0000","last_became_peered":"2023-10-06T11:15:11.615550+0000","last_unstale":"2023-10-06T11:15:11.615827+0000","last_undegraded":"2023-10-06T11:15:11.615827+0000","last_fullsized":"2023-10-06T11:15:11.615827+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:12:08.245890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.560926+0000","last_change":"2023-10-06T11:15:12.556304+0000","last_active":"2023-10-06T11:15:12.560926+0000","last_peered":"2023-10-06T11:15:12.560926+0000","last_clean":"2023-10-06T11:15:12.560926+0000","last_became_active":"2023-10-06T11:15:12.556046+0000","last_became_peered":"2023-10-06T11:15:12.556046+0000","last_unstale":"2023-10-06T11:15:12.560926+0000","last_undegraded":"2023-10-06T11:15:12.560926+0000","last_fullsized":"2023-10-06T11:15:12.560926+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:24.253441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"124'1","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.564654+0000","last_change":"2023-10-06T11:15:11.557353+0000","last_active":"2023-10-06T11:15:12.564654+0000","last_peered":"2023-10-06T11:15:12.564654+0000","last_clean":"2023-10-06T11:15:12.564654+0000","last_became_active":"2023-10-06T11:15:11.557113+0000","last_became_peered":"2023-10-06T11:15:11.557113+0000","last_unstale":"2023-10-06T11:15:12.564654+0000","last_undegraded":"2023-10-06T11:15:12.564654+0000","last_fullsized":"2023-10-06T11:15:12.564654+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:33:56.619203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.563158+0000","last_change":"2023-10-06T11:15:12.560179+0000","last_active":"2023-10-06T11:15:12.563158+0000","last_peered":"2023-10-06T11:15:12.563158+0000","last_clean":"2023-10-06T11:15:12.563158+0000","last_became_active":"2023-10-06T11:15:12.559930+0000","last_became_peered":"2023-10-06T11:15:12.559930+0000","last_unstale":"2023-10-06T11:15:12.563158+0000","last_undegraded":"2023-10-06T11:15:12.563158+0000","last_fullsized":"2023-10-06T11:15:12.563158+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:57:36.426307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"124'2","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.570451+0000","last_change":"2023-10-06T11:15:11.560104+0000","last_active":"2023-10-06T11:15:12.570451+0000","last_peered":"2023-10-06T11:15:12.570451+0000","last_clean":"2023-10-06T11:15:12.570451+0000","last_became_active":"2023-10-06T11:15:11.559818+0000","last_became_peered":"2023-10-06T11:15:11.559818+0000","last_unstale":"2023-10-06T11:15:12.570451+0000","last_undegraded":"2023-10-06T11:15:12.570451+0000","last_fullsized":"2023-10-06T11:15:12.570451+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:42:27.505992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.558045+0000","last_change":"2023-10-06T11:15:12.554784+0000","last_active":"2023-10-06T11:15:12.558045+0000","last_peered":"2023-10-06T11:15:12.558045+0000","last_clean":"2023-10-06T11:15:12.558045+0000","last_became_active":"2023-10-06T11:15:12.554499+0000","last_became_peered":"2023-10-06T11:15:12.554499+0000","last_unstale":"2023-10-06T11:15:12.558045+0000","last_undegraded":"2023-10-06T11:15:12.558045+0000","last_fullsized":"2023-10-06T11:15:12.558045+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:25:23.586837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"124'2","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.569295+0000","last_change":"2023-10-06T11:15:11.558478+0000","last_active":"2023-10-06T11:15:12.569295+0000","last_peered":"2023-10-06T11:15:12.569295+0000","last_clean":"2023-10-06T11:15:12.569295+0000","last_became_active":"2023-10-06T11:15:11.558217+0000","last_became_peered":"2023-10-06T11:15:11.558217+0000","last_unstale":"2023-10-06T11:15:12.569295+0000","last_undegraded":"2023-10-06T11:15:12.569295+0000","last_fullsized":"2023-10-06T11:15:12.569295+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:57:35.417949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.544806+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:42:28.514350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.555437+0000","last_change":"2023-10-06T11:15:11.555437+0000","last_active":"2023-10-06T11:15:11.555437+0000","last_peered":"2023-10-06T11:15:11.555437+0000","last_clean":"2023-10-06T11:15:11.555437+0000","last_became_active":"2023-10-06T11:15:11.555188+0000","last_became_peered":"2023-10-06T11:15:11.555188+0000","last_unstale":"2023-10-06T11:15:11.555437+0000","last_undegraded":"2023-10-06T11:15:11.555437+0000","last_fullsized":"2023-10-06T11:15:11.555437+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:35.856632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.545719+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:42:08.749955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"124'1","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.565269+0000","last_change":"2023-10-06T11:15:11.550069+0000","last_active":"2023-10-06T11:15:12.565269+0000","last_peered":"2023-10-06T11:15:12.565269+0000","last_clean":"2023-10-06T11:15:12.565269+0000","last_became_active":"2023-10-06T11:15:11.549745+0000","last_became_peered":"2023-10-06T11:15:11.549745+0000","last_unstale":"2023-10-06T11:15:12.565269+0000","last_undegraded":"2023-10-06T11:15:12.565269+0000","last_fullsized":"2023-10-06T11:15:12.565269+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:13.766571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.560434+0000","last_change":"2023-10-06T11:15:12.554531+0000","last_active":"2023-10-06T11:15:12.560434+0000","last_peered":"2023-10-06T11:15:12.560434+0000","last_clean":"2023-10-06T11:15:12.560434+0000","last_became_active":"2023-10-06T11:15:12.554264+0000","last_became_peered":"2023-10-06T11:15:12.554264+0000","last_unstale":"2023-10-06T11:15:12.560434+0000","last_undegraded":"2023-10-06T11:15:12.560434+0000","last_fullsized":"2023-10-06T11:15:12.560434+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:20.499128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.555398+0000","last_change":"2023-10-06T11:15:11.555398+0000","last_active":"2023-10-06T11:15:11.555398+0000","last_peered":"2023-10-06T11:15:11.555398+0000","last_clean":"2023-10-06T11:15:11.555398+0000","last_became_active":"2023-10-06T11:15:11.555097+0000","last_became_peered":"2023-10-06T11:15:11.555097+0000","last_unstale":"2023-10-06T11:15:11.555398+0000","last_undegraded":"2023-10-06T11:15:11.555398+0000","last_fullsized":"2023-10-06T11:15:11.555398+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:19:28.866743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.567704+0000","last_change":"2023-10-06T11:15:12.562196+0000","last_active":"2023-10-06T11:15:12.567704+0000","last_peered":"2023-10-06T11:15:12.567704+0000","last_clean":"2023-10-06T11:15:12.567704+0000","last_became_active":"2023-10-06T11:15:12.561903+0000","last_became_peered":"2023-10-06T11:15:12.561903+0000","last_unstale":"2023-10-06T11:15:12.567704+0000","last_undegraded":"2023-10-06T11:15:12.567704+0000","last_fullsized":"2023-10-06T11:15:12.567704+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:08:23.845610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.615898+0000","last_change":"2023-10-06T11:15:11.615898+0000","last_active":"2023-10-06T11:15:11.615898+0000","last_peered":"2023-10-06T11:15:11.615898+0000","last_clean":"2023-10-06T11:15:11.615898+0000","last_became_active":"2023-10-06T11:15:11.615593+0000","last_became_peered":"2023-10-06T11:15:11.615593+0000","last_unstale":"2023-10-06T11:15:11.615898+0000","last_undegraded":"2023-10-06T11:15:11.615898+0000","last_fullsized":"2023-10-06T11:15:11.615898+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:31:06.545416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.548277+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:04.347350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"124'1","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.565991+0000","last_change":"2023-10-06T11:15:11.555759+0000","last_active":"2023-10-06T11:15:12.565991+0000","last_peered":"2023-10-06T11:15:12.565991+0000","last_clean":"2023-10-06T11:15:12.565991+0000","last_became_active":"2023-10-06T11:15:11.555515+0000","last_became_peered":"2023-10-06T11:15:11.555515+0000","last_unstale":"2023-10-06T11:15:12.565991+0000","last_undegraded":"2023-10-06T11:15:12.565991+0000","last_fullsized":"2023-10-06T11:15:12.565991+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:26.937119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.567123+0000","last_change":"2023-10-06T11:15:12.556067+0000","last_active":"2023-10-06T11:15:12.567123+0000","last_peered":"2023-10-06T11:15:12.567123+0000","last_clean":"2023-10-06T11:15:12.567123+0000","last_became_active":"2023-10-06T11:15:12.555819+0000","last_became_peered":"2023-10-06T11:15:12.555819+0000","last_unstale":"2023-10-06T11:15:12.567123+0000","last_undegraded":"2023-10-06T11:15:12.567123+0000","last_fullsized":"2023-10-06T11:15:12.567123+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:31:53.456266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.615617+0000","last_change":"2023-10-06T11:15:11.615617+0000","last_active":"2023-10-06T11:15:11.615617+0000","last_peered":"2023-10-06T11:15:11.615617+0000","last_clean":"2023-10-06T11:15:11.615617+0000","last_became_active":"2023-10-06T11:15:11.615338+0000","last_became_peered":"2023-10-06T11:15:11.615338+0000","last_unstale":"2023-10-06T11:15:11.615617+0000","last_undegraded":"2023-10-06T11:15:11.615617+0000","last_fullsized":"2023-10-06T11:15:11.615617+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:14:50.760693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.567937+0000","last_change":"2023-10-06T11:15:12.563592+0000","last_active":"2023-10-06T11:15:12.567937+0000","last_peered":"2023-10-06T11:15:12.567937+0000","last_clean":"2023-10-06T11:15:12.567937+0000","last_became_active":"2023-10-06T11:15:12.562607+0000","last_became_peered":"2023-10-06T11:15:12.562607+0000","last_unstale":"2023-10-06T11:15:12.567937+0000","last_undegraded":"2023-10-06T11:15:12.567937+0000","last_fullsized":"2023-10-06T11:15:12.567937+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:20.499128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.555479+0000","last_change":"2023-10-06T11:15:11.555479+0000","last_active":"2023-10-06T11:15:11.555479+0000","last_peered":"2023-10-06T11:15:11.555479+0000","last_clean":"2023-10-06T11:15:11.555479+0000","last_became_active":"2023-10-06T11:15:11.553333+0000","last_became_peered":"2023-10-06T11:15:11.553333+0000","last_unstale":"2023-10-06T11:15:11.555479+0000","last_undegraded":"2023-10-06T11:15:11.555479+0000","last_fullsized":"2023-10-06T11:15:11.555479+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:14:07.032030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.562902+0000","last_change":"2023-10-06T11:15:12.560178+0000","last_active":"2023-10-06T11:15:12.562902+0000","last_peered":"2023-10-06T11:15:12.562902+0000","last_clean":"2023-10-06T11:15:12.562902+0000","last_became_active":"2023-10-06T11:15:12.559886+0000","last_became_peered":"2023-10-06T11:15:12.559886+0000","last_unstale":"2023-10-06T11:15:12.562902+0000","last_undegraded":"2023-10-06T11:15:12.562902+0000","last_fullsized":"2023-10-06T11:15:12.562902+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:43:09.220052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.547263+0000","last_change":"2023-10-06T11:15:11.614773+0000","last_active":"2023-10-06T11:15:12.547263+0000","last_peered":"2023-10-06T11:15:12.547263+0000","last_clean":"2023-10-06T11:15:12.547263+0000","last_became_active":"2023-10-06T11:15:11.614494+0000","last_became_peered":"2023-10-06T11:15:11.614494+0000","last_unstale":"2023-10-06T11:15:12.547263+0000","last_undegraded":"2023-10-06T11:15:12.547263+0000","last_fullsized":"2023-10-06T11:15:12.547263+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:42:27.505992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.560715+0000","last_change":"2023-10-06T11:15:12.556066+0000","last_active":"2023-10-06T11:15:12.560715+0000","last_peered":"2023-10-06T11:15:12.560715+0000","last_clean":"2023-10-06T11:15:12.560715+0000","last_became_active":"2023-10-06T11:15:12.555821+0000","last_became_peered":"2023-10-06T11:15:12.555821+0000","last_unstale":"2023-10-06T11:15:12.560715+0000","last_undegraded":"2023-10-06T11:15:12.560715+0000","last_fullsized":"2023-10-06T11:15:12.560715+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:01:51.130934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.553701+0000","last_change":"2023-10-06T11:15:11.553701+0000","last_active":"2023-10-06T11:15:11.553701+0000","last_peered":"2023-10-06T11:15:11.553701+0000","last_clean":"2023-10-06T11:15:11.553701+0000","last_became_active":"2023-10-06T11:15:11.553429+0000","last_became_peered":"2023-10-06T11:15:11.553429+0000","last_unstale":"2023-10-06T11:15:11.553701+0000","last_undegraded":"2023-10-06T11:15:11.553701+0000","last_fullsized":"2023-10-06T11:15:11.553701+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:11.919378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.558046+0000","last_change":"2023-10-06T11:15:12.554583+0000","last_active":"2023-10-06T11:15:12.558046+0000","last_peered":"2023-10-06T11:15:12.558046+0000","last_clean":"2023-10-06T11:15:12.558046+0000","last_became_active":"2023-10-06T11:15:12.554321+0000","last_became_peered":"2023-10-06T11:15:12.554321+0000","last_unstale":"2023-10-06T11:15:12.558046+0000","last_undegraded":"2023-10-06T11:15:12.558046+0000","last_fullsized":"2023-10-06T11:15:12.558046+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:09:31.438514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.546072+0000","last_change":"2023-10-06T11:15:11.613844+0000","last_active":"2023-10-06T11:15:12.546072+0000","last_peered":"2023-10-06T11:15:12.546072+0000","last_clean":"2023-10-06T11:15:12.546072+0000","last_became_active":"2023-10-06T11:15:11.611782+0000","last_became_peered":"2023-10-06T11:15:11.611782+0000","last_unstale":"2023-10-06T11:15:12.546072+0000","last_undegraded":"2023-10-06T11:15:12.546072+0000","last_fullsized":"2023-10-06T11:15:12.546072+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:33:26.797503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.560453+0000","last_change":"2023-10-06T11:15:12.555068+0000","last_active":"2023-10-06T11:15:12.560453+0000","last_peered":"2023-10-06T11:15:12.560453+0000","last_clean":"2023-10-06T11:15:12.560453+0000","last_became_active":"2023-10-06T11:15:12.554808+0000","last_became_peered":"2023-10-06T11:15:12.554808+0000","last_unstale":"2023-10-06T11:15:12.560453+0000","last_undegraded":"2023-10-06T11:15:12.560453+0000","last_fullsized":"2023-10-06T11:15:12.560453+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:32:37.458835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.550759+0000","last_change":"2023-10-06T11:15:11.616271+0000","last_active":"2023-10-06T11:15:12.550759+0000","last_peered":"2023-10-06T11:15:12.550759+0000","last_clean":"2023-10-06T11:15:12.550759+0000","last_became_active":"2023-10-06T11:15:11.615995+0000","last_became_peered":"2023-10-06T11:15:11.615995+0000","last_unstale":"2023-10-06T11:15:12.550759+0000","last_undegraded":"2023-10-06T11:15:12.550759+0000","last_fullsized":"2023-10-06T11:15:12.550759+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:11.919378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.564488+0000","last_change":"2023-10-06T11:15:12.561508+0000","last_active":"2023-10-06T11:15:12.564488+0000","last_peered":"2023-10-06T11:15:12.564488+0000","last_clean":"2023-10-06T11:15:12.564488+0000","last_became_active":"2023-10-06T11:15:12.561218+0000","last_became_peered":"2023-10-06T11:15:12.561218+0000","last_unstale":"2023-10-06T11:15:12.564488+0000","last_undegraded":"2023-10-06T11:15:12.564488+0000","last_fullsized":"2023-10-06T11:15:12.564488+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:42:28.514350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.556382+0000","last_change":"2023-10-06T11:15:11.556382+0000","last_active":"2023-10-06T11:15:11.556382+0000","last_peered":"2023-10-06T11:15:11.556382+0000","last_clean":"2023-10-06T11:15:11.556382+0000","last_became_active":"2023-10-06T11:15:11.556112+0000","last_became_peered":"2023-10-06T11:15:11.556112+0000","last_unstale":"2023-10-06T11:15:11.556382+0000","last_undegraded":"2023-10-06T11:15:11.556382+0000","last_fullsized":"2023-10-06T11:15:11.556382+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:16:45.186406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.562131+0000","last_change":"2023-10-06T11:15:12.559696+0000","last_active":"2023-10-06T11:15:12.562131+0000","last_peered":"2023-10-06T11:15:12.562131+0000","last_clean":"2023-10-06T11:15:12.562131+0000","last_became_active":"2023-10-06T11:15:12.559240+0000","last_became_peered":"2023-10-06T11:15:12.559240+0000","last_unstale":"2023-10-06T11:15:12.562131+0000","last_undegraded":"2023-10-06T11:15:12.562131+0000","last_fullsized":"2023-10-06T11:15:12.562131+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:45:30.113928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"124'2","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.569892+0000","last_change":"2023-10-06T11:15:11.615013+0000","last_active":"2023-10-06T11:15:12.569892+0000","last_peered":"2023-10-06T11:15:12.569892+0000","last_clean":"2023-10-06T11:15:12.569892+0000","last_became_active":"2023-10-06T11:15:11.614364+0000","last_became_peered":"2023-10-06T11:15:11.614364+0000","last_unstale":"2023-10-06T11:15:12.569892+0000","last_undegraded":"2023-10-06T11:15:12.569892+0000","last_fullsized":"2023-10-06T11:15:12.569892+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:44.091039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.548722+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:12:17.067365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.557279+0000","last_change":"2023-10-06T11:15:11.557279+0000","last_active":"2023-10-06T11:15:11.557279+0000","last_peered":"2023-10-06T11:15:11.557279+0000","last_clean":"2023-10-06T11:15:11.557279+0000","last_became_active":"2023-10-06T11:15:11.556969+0000","last_became_peered":"2023-10-06T11:15:11.556969+0000","last_unstale":"2023-10-06T11:15:11.557279+0000","last_undegraded":"2023-10-06T11:15:11.557279+0000","last_fullsized":"2023-10-06T11:15:11.557279+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:35:57.001079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.567096+0000","last_change":"2023-10-06T11:15:12.559496+0000","last_active":"2023-10-06T11:15:12.567096+0000","last_peered":"2023-10-06T11:15:12.567096+0000","last_clean":"2023-10-06T11:15:12.567096+0000","last_became_active":"2023-10-06T11:15:12.558184+0000","last_became_peered":"2023-10-06T11:15:12.558184+0000","last_unstale":"2023-10-06T11:15:12.567096+0000","last_undegraded":"2023-10-06T11:15:12.567096+0000","last_fullsized":"2023-10-06T11:15:12.567096+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:45:30.113928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.615736+0000","last_change":"2023-10-06T11:15:11.615736+0000","last_active":"2023-10-06T11:15:11.615736+0000","last_peered":"2023-10-06T11:15:11.615736+0000","last_clean":"2023-10-06T11:15:11.615736+0000","last_became_active":"2023-10-06T11:15:11.615436+0000","last_became_peered":"2023-10-06T11:15:11.615436+0000","last_unstale":"2023-10-06T11:15:11.615736+0000","last_undegraded":"2023-10-06T11:15:11.615736+0000","last_fullsized":"2023-10-06T11:15:11.615736+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:25:17.433536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.560267+0000","last_change":"2023-10-06T11:15:12.555337+0000","last_active":"2023-10-06T11:15:12.560267+0000","last_peered":"2023-10-06T11:15:12.560267+0000","last_clean":"2023-10-06T11:15:12.560267+0000","last_became_active":"2023-10-06T11:15:12.555085+0000","last_became_peered":"2023-10-06T11:15:12.555085+0000","last_unstale":"2023-10-06T11:15:12.560267+0000","last_undegraded":"2023-10-06T11:15:12.560267+0000","last_fullsized":"2023-10-06T11:15:12.560267+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:33:10.885181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.559110+0000","last_change":"2023-10-06T11:15:11.559110+0000","last_active":"2023-10-06T11:15:11.559110+0000","last_peered":"2023-10-06T11:15:11.559110+0000","last_clean":"2023-10-06T11:15:11.559110+0000","last_became_active":"2023-10-06T11:15:11.558912+0000","last_became_peered":"2023-10-06T11:15:11.558912+0000","last_unstale":"2023-10-06T11:15:11.559110+0000","last_undegraded":"2023-10-06T11:15:11.559110+0000","last_fullsized":"2023-10-06T11:15:11.559110+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:06.108506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.551355+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:59:48.066554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.545507+0000","last_change":"2023-10-06T11:15:11.615843+0000","last_active":"2023-10-06T11:15:12.545507+0000","last_peered":"2023-10-06T11:15:12.545507+0000","last_clean":"2023-10-06T11:15:12.545507+0000","last_became_active":"2023-10-06T11:15:11.615583+0000","last_became_peered":"2023-10-06T11:15:11.615583+0000","last_unstale":"2023-10-06T11:15:12.545507+0000","last_undegraded":"2023-10-06T11:15:12.545507+0000","last_fullsized":"2023-10-06T11:15:12.545507+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:06.108506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.551860+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:30:37.212830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.550406+0000","last_change":"2023-10-06T11:15:11.558367+0000","last_active":"2023-10-06T11:15:12.550406+0000","last_peered":"2023-10-06T11:15:12.550406+0000","last_clean":"2023-10-06T11:15:12.550406+0000","last_became_active":"2023-10-06T11:15:11.558080+0000","last_became_peered":"2023-10-06T11:15:11.558080+0000","last_unstale":"2023-10-06T11:15:12.550406+0000","last_undegraded":"2023-10-06T11:15:12.550406+0000","last_fullsized":"2023-10-06T11:15:12.550406+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:23:19.627689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.553099+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:36.864990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.557480+0000","last_change":"2023-10-06T11:15:11.557480+0000","last_active":"2023-10-06T11:15:11.557480+0000","last_peered":"2023-10-06T11:15:11.557480+0000","last_clean":"2023-10-06T11:15:11.557480+0000","last_became_active":"2023-10-06T11:15:11.557275+0000","last_became_peered":"2023-10-06T11:15:11.557275+0000","last_unstale":"2023-10-06T11:15:11.557480+0000","last_undegraded":"2023-10-06T11:15:11.557480+0000","last_fullsized":"2023-10-06T11:15:11.557480+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:05.270236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.567817+0000","last_change":"2023-10-06T11:15:12.563042+0000","last_active":"2023-10-06T11:15:12.567817+0000","last_peered":"2023-10-06T11:15:12.567817+0000","last_clean":"2023-10-06T11:15:12.567817+0000","last_became_active":"2023-10-06T11:15:12.562720+0000","last_became_peered":"2023-10-06T11:15:12.562720+0000","last_unstale":"2023-10-06T11:15:12.567817+0000","last_undegraded":"2023-10-06T11:15:12.567817+0000","last_fullsized":"2023-10-06T11:15:12.567817+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:01:51.130934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.547145+0000","last_change":"2023-10-06T11:15:11.613556+0000","last_active":"2023-10-06T11:15:12.547145+0000","last_peered":"2023-10-06T11:15:12.547145+0000","last_clean":"2023-10-06T11:15:12.547145+0000","last_became_active":"2023-10-06T11:15:11.558706+0000","last_became_peered":"2023-10-06T11:15:11.558706+0000","last_unstale":"2023-10-06T11:15:12.547145+0000","last_undegraded":"2023-10-06T11:15:12.547145+0000","last_fullsized":"2023-10-06T11:15:12.547145+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:35.856632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.564356+0000","last_change":"2023-10-06T11:15:12.561897+0000","last_active":"2023-10-06T11:15:12.564356+0000","last_peered":"2023-10-06T11:15:12.564356+0000","last_clean":"2023-10-06T11:15:12.564356+0000","last_became_active":"2023-10-06T11:15:12.561644+0000","last_became_peered":"2023-10-06T11:15:12.561644+0000","last_unstale":"2023-10-06T11:15:12.564356+0000","last_undegraded":"2023-10-06T11:15:12.564356+0000","last_fullsized":"2023-10-06T11:15:12.564356+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:46.655508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.544963+0000","last_change":"2023-10-06T11:15:11.553743+0000","last_active":"2023-10-06T11:15:12.544963+0000","last_peered":"2023-10-06T11:15:12.544963+0000","last_clean":"2023-10-06T11:15:12.544963+0000","last_became_active":"2023-10-06T11:15:11.553490+0000","last_became_peered":"2023-10-06T11:15:11.553490+0000","last_unstale":"2023-10-06T11:15:12.544963+0000","last_undegraded":"2023-10-06T11:15:12.544963+0000","last_fullsized":"2023-10-06T11:15:12.544963+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:05.270236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":108,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-06T11:15:10.541325+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:15:10.541325+0000","last_peered":"2023-10-06T11:15:10.541325+0000","last_clean":"2023-10-06T11:15:10.541325+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:15:10.541325+0000","last_undegraded":"2023-10-06T11:15:10.541325+0000","last_fullsized":"2023-10-06T11:15:10.541325+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.551327+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:40.228447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.547594+0000","last_change":"2023-10-06T11:15:11.614069+0000","last_active":"2023-10-06T11:15:12.547594+0000","last_peered":"2023-10-06T11:15:12.547594+0000","last_clean":"2023-10-06T11:15:12.547594+0000","last_became_active":"2023-10-06T11:15:11.613023+0000","last_became_peered":"2023-10-06T11:15:11.613023+0000","last_unstale":"2023-10-06T11:15:12.547594+0000","last_undegraded":"2023-10-06T11:15:12.547594+0000","last_fullsized":"2023-10-06T11:15:12.547594+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:00:36.479436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":101,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.547352+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:15:12.547352+0000","last_peered":"2023-10-06T11:15:12.547352+0000","last_clean":"2023-10-06T11:15:12.547352+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:15:12.547352+0000","last_undegraded":"2023-10-06T11:15:12.547352+0000","last_fullsized":"2023-10-06T11:15:12.547352+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.566949+0000","last_change":"2023-10-06T11:15:12.557454+0000","last_active":"2023-10-06T11:15:12.566949+0000","last_peered":"2023-10-06T11:15:12.566949+0000","last_clean":"2023-10-06T11:15:12.566949+0000","last_became_active":"2023-10-06T11:15:12.557183+0000","last_became_peered":"2023-10-06T11:15:12.557183+0000","last_unstale":"2023-10-06T11:15:12.566949+0000","last_undegraded":"2023-10-06T11:15:12.566949+0000","last_fullsized":"2023-10-06T11:15:12.566949+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:09:25.439474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.557485+0000","last_change":"2023-10-06T11:15:11.557485+0000","last_active":"2023-10-06T11:15:11.557485+0000","last_peered":"2023-10-06T11:15:11.557485+0000","last_clean":"2023-10-06T11:15:11.557485+0000","last_became_active":"2023-10-06T11:15:11.556885+0000","last_became_peered":"2023-10-06T11:15:11.556885+0000","last_unstale":"2023-10-06T11:15:11.557485+0000","last_undegraded":"2023-10-06T11:15:11.557485+0000","last_fullsized":"2023-10-06T11:15:11.557485+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:04:48.873690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":98,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-06T11:15:10.657847+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:15:10.657847+0000","last_peered":"2023-10-06T11:15:10.657847+0000","last_clean":"2023-10-06T11:15:10.657847+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:15:10.657847+0000","last_undegraded":"2023-10-06T11:15:10.657847+0000","last_fullsized":"2023-10-06T11:15:10.657847+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":244,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.548590+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:15:12.548590+0000","last_peered":"2023-10-06T11:15:12.548590+0000","last_clean":"2023-10-06T11:15:12.548590+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:15:12.548590+0000","last_undegraded":"2023-10-06T11:15:12.548590+0000","last_fullsized":"2023-10-06T11:15:12.548590+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.552554+0000","last_change":"2023-10-06T11:15:12.549973+0000","last_active":"2023-10-06T11:15:12.552554+0000","last_peered":"2023-10-06T11:15:12.552554+0000","last_clean":"2023-10-06T11:15:12.552554+0000","last_became_active":"2023-10-06T11:15:12.549720+0000","last_became_peered":"2023-10-06T11:15:12.549720+0000","last_unstale":"2023-10-06T11:15:12.552554+0000","last_undegraded":"2023-10-06T11:15:12.552554+0000","last_fullsized":"2023-10-06T11:15:12.552554+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:56:21.022912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.562606+0000","last_change":"2023-10-06T11:15:11.562606+0000","last_active":"2023-10-06T11:15:11.562606+0000","last_peered":"2023-10-06T11:15:11.562606+0000","last_clean":"2023-10-06T11:15:11.562606+0000","last_became_active":"2023-10-06T11:15:11.562331+0000","last_became_peered":"2023-10-06T11:15:11.562331+0000","last_unstale":"2023-10-06T11:15:11.562606+0000","last_undegraded":"2023-10-06T11:15:11.562606+0000","last_fullsized":"2023-10-06T11:15:11.562606+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:26.937119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":94,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.550300+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:15:12.550300+0000","last_peered":"2023-10-06T11:15:12.550300+0000","last_clean":"2023-10-06T11:15:12.550300+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:15:12.550300+0000","last_undegraded":"2023-10-06T11:15:12.550300+0000","last_fullsized":"2023-10-06T11:15:12.550300+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.555020+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:07.116865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.550473+0000","last_change":"2023-10-06T11:15:11.616871+0000","last_active":"2023-10-06T11:15:12.550473+0000","last_peered":"2023-10-06T11:15:12.550473+0000","last_clean":"2023-10-06T11:15:12.550473+0000","last_became_active":"2023-10-06T11:15:11.616308+0000","last_became_peered":"2023-10-06T11:15:11.616308+0000","last_unstale":"2023-10-06T11:15:12.550473+0000","last_undegraded":"2023-10-06T11:15:12.550473+0000","last_fullsized":"2023-10-06T11:15:12.550473+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:33:56.619203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":94,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.548669+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:15:12.548669+0000","last_peered":"2023-10-06T11:15:12.548669+0000","last_clean":"2023-10-06T11:15:12.548669+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:15:12.548669+0000","last_undegraded":"2023-10-06T11:15:12.548669+0000","last_fullsized":"2023-10-06T11:15:12.548669+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.555380+0000","last_change":"2023-10-06T11:15:12.552483+0000","last_active":"2023-10-06T11:15:12.555380+0000","last_peered":"2023-10-06T11:15:12.555380+0000","last_clean":"2023-10-06T11:15:12.555380+0000","last_became_active":"2023-10-06T11:15:12.552230+0000","last_became_peered":"2023-10-06T11:15:12.552230+0000","last_unstale":"2023-10-06T11:15:12.555380+0000","last_undegraded":"2023-10-06T11:15:12.555380+0000","last_fullsized":"2023-10-06T11:15:12.555380+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:45:25.285981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"124'2","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.565208+0000","last_change":"2023-10-06T11:15:11.612981+0000","last_active":"2023-10-06T11:15:12.565208+0000","last_peered":"2023-10-06T11:15:12.565208+0000","last_clean":"2023-10-06T11:15:12.565208+0000","last_became_active":"2023-10-06T11:15:11.612693+0000","last_became_peered":"2023-10-06T11:15:11.612693+0000","last_unstale":"2023-10-06T11:15:12.565208+0000","last_undegraded":"2023-10-06T11:15:12.565208+0000","last_fullsized":"2023-10-06T11:15:12.565208+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:37.193218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":114,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.544242+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:15:12.544242+0000","last_peered":"2023-10-06T11:15:12.544242+0000","last_clean":"2023-10-06T11:15:12.544242+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:15:12.544242+0000","last_undegraded":"2023-10-06T11:15:12.544242+0000","last_fullsized":"2023-10-06T11:15:12.544242+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.550124+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:27.945477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"124'6","reported_seq":16,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.574922+0000","last_change":"2023-10-06T11:15:11.616053+0000","last_active":"2023-10-06T11:15:12.574922+0000","last_peered":"2023-10-06T11:15:12.574922+0000","last_clean":"2023-10-06T11:15:12.574922+0000","last_became_active":"2023-10-06T11:15:11.615774+0000","last_became_peered":"2023-10-06T11:15:11.615774+0000","last_unstale":"2023-10-06T11:15:12.574922+0000","last_undegraded":"2023-10-06T11:15:12.574922+0000","last_fullsized":"2023-10-06T11:15:12.574922+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:35:57.001079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":99,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-06T11:15:10.536695+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:15:10.536695+0000","last_peered":"2023-10-06T11:15:10.536695+0000","last_clean":"2023-10-06T11:15:10.536695+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:15:10.536695+0000","last_undegraded":"2023-10-06T11:15:10.536695+0000","last_fullsized":"2023-10-06T11:15:10.536695+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.548629+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:11.072682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"124'3","reported_seq":13,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.569771+0000","last_change":"2023-10-06T11:15:11.560790+0000","last_active":"2023-10-06T11:15:12.569771+0000","last_peered":"2023-10-06T11:15:12.569771+0000","last_clean":"2023-10-06T11:15:12.569771+0000","last_became_active":"2023-10-06T11:15:11.560492+0000","last_became_peered":"2023-10-06T11:15:11.560492+0000","last_unstale":"2023-10-06T11:15:12.569771+0000","last_undegraded":"2023-10-06T11:15:12.569771+0000","last_fullsized":"2023-10-06T11:15:12.569771+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:35.856632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":99,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-06T11:15:10.536733+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:15:10.536733+0000","last_peered":"2023-10-06T11:15:10.536733+0000","last_clean":"2023-10-06T11:15:10.536733+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:15:10.536733+0000","last_undegraded":"2023-10-06T11:15:10.536733+0000","last_fullsized":"2023-10-06T11:15:10.536733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":1682,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574967,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299408,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072432,"statfs":{"total":96636764160,"available":96330170368,"internally_reserved":0,"allocated":2170880,"data_stored":1307178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.51600000000000001,"15min":0.624},"min":{"1min":0.252,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.68899999999999995,"5min":4.407,"15min":23.908999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.48699999999999999,"15min":0.57499999999999996},"min":{"1min":0.26900000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.66600000000000004,"5min":0.69799999999999995,"15min":9.3230000000000004},"last":0.67500000000000004}]},{"osd":1,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51200000000000001,"15min":0.56100000000000005},"min":{"1min":0.33200000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.73399999999999999,"5min":2.4689999999999999,"15min":9.2360000000000007},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47199999999999998,"15min":0.503},"min":{"1min":0.33100000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.70199999999999996,"5min":0.78900000000000003,"15min":4.327},"last":0.64400000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54200000000000004,"15min":0.51800000000000002},"min":{"1min":0.34399999999999997,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.748,"5min":4.3120000000000003,"15min":4.3120000000000003},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.53700000000000003,"15min":0.55700000000000005},"min":{"1min":0.311,"5min":0.31,"15min":0.29999999999999999},"max":{"1min":0.71599999999999997,"5min":3.0600000000000001,"15min":4.7309999999999999},"last":0.70699999999999996}]},{"osd":3,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.54700000000000004,"15min":0.53700000000000003},"min":{"1min":0.32600000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.60099999999999998,"5min":4.5190000000000001,"15min":4.5190000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55600000000000005,"15min":0.59799999999999998},"min":{"1min":0.40200000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.68100000000000005,"5min":3.0070000000000001,"15min":9.3879999999999999},"last":0.624}]},{"osd":4,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.498,"15min":0.48799999999999999},"min":{"1min":0.32700000000000001,"5min":0.26000000000000001,"15min":0.24399999999999999},"max":{"1min":0.59799999999999998,"5min":4.6639999999999997,"15min":4.6639999999999997},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53300000000000003,"15min":0.53400000000000003},"min":{"1min":0.28499999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.69199999999999995,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":0.66100000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.495,"15min":0.56000000000000005},"min":{"1min":0.32900000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.70999999999999996,"5min":0.79700000000000004,"15min":9.3499999999999996},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.497,"15min":0.54400000000000004},"min":{"1min":0.30099999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.65200000000000002,"5min":0.83399999999999996,"15min":4.444},"last":0.51500000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.59799999999999998},"min":{"1min":0.38100000000000001,"5min":0.32400000000000001,"15min":0.29199999999999998},"max":{"1min":0.64800000000000002,"5min":0.81399999999999995,"15min":9.4969999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.60299999999999998,"15min":0.61899999999999999},"min":{"1min":0.36699999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72299999999999998,"5min":4.4669999999999996,"15min":7.2039999999999997},"last":0.61199999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574968,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311072,"kb_used_data":1496,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060768,"statfs":{"total":96636764160,"available":96318226432,"internally_reserved":0,"allocated":1531904,"data_stored":700074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.57899999999999996,"15min":0.52200000000000002},"min":{"1min":0.30299999999999999,"5min":0.187,"15min":0.187},"max":{"1min":9.5549999999999997,"5min":9.5549999999999997,"15min":9.5549999999999997},"last":0.45200000000000001},{"interface":"front","average":{"1min":1.032,"5min":0.63500000000000001,"15min":0.56299999999999994},"min":{"1min":0.38400000000000001,"5min":0.254,"15min":0.254},"max":{"1min":9.4659999999999993,"5min":9.4659999999999993,"15min":9.4659999999999993},"last":0.54700000000000004}]},{"osd":1,"last update":"Fri Oct 6 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.47199999999999998,"15min":0.48599999999999999},"min":{"1min":0.33400000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.80300000000000005,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56499999999999995,"15min":0.51600000000000001},"min":{"1min":0.32900000000000001,"5min":0.216,"15min":0.216},"max":{"1min":2.238,"5min":5.2670000000000003,"15min":5.2670000000000003},"last":0.48299999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.47999999999999998,"15min":0.498},"min":{"1min":0.255,"5min":0.252,"15min":0.252},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":7.0659999999999998},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.503,"5min":0.48699999999999999,"15min":0.51900000000000002},"min":{"1min":0.33700000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.72899999999999998,"5min":1.0069999999999999,"15min":7.0819999999999999},"last":0.504}]},{"osd":3,"last update":"Fri Oct 6 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.55000000000000004,"15min":0.51600000000000001},"min":{"1min":0.38400000000000001,"5min":0.317,"15min":0.25800000000000001},"max":{"1min":3.871,"5min":3.871,"15min":3.871},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.52700000000000002,"15min":0.53300000000000003},"min":{"1min":0.34799999999999998,"5min":0.316,"15min":0.312},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.47599999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.46000000000000002,"15min":0.48399999999999999},"min":{"1min":0.26800000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.628,"5min":0.88,"15min":0.88},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.51300000000000001,"15min":0.53900000000000003},"min":{"1min":0.32200000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.73399999999999999,"5min":0.82399999999999995,"15min":1.0680000000000001},"last":0.59299999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.503,"15min":0.52100000000000002},"min":{"1min":0.375,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.61199999999999999,"15min":0.58699999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":7.1379999999999999,"5min":7.1379999999999999,"15min":7.1379999999999999},"last":0.53700000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56599999999999995,"15min":0.58799999999999997},"min":{"1min":0.42799999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.88400000000000001},"last":0.55900000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574967,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311656,"kb_used_data":2080,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060184,"statfs":{"total":96636764160,"available":96317628416,"internally_reserved":0,"allocated":2129920,"data_stored":1291795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.45900000000000002,"15min":0.379},"min":{"1min":0.20499999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.67000000000000004,"5min":13.393000000000001,"15min":13.393000000000001},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.45700000000000002,"15min":0.38200000000000001},"min":{"1min":0.23599999999999999,"5min":0.22500000000000001,"15min":0.19700000000000001},"max":{"1min":0.64900000000000002,"5min":11.462,"15min":11.462},"last":0.33900000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.40400000000000003,"15min":0.35999999999999999},"min":{"1min":0.23599999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.47999999999999998,"5min":8.0470000000000006,"15min":8.0470000000000006},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.432,"15min":0.40500000000000003},"min":{"1min":0.26100000000000001,"5min":0.22800000000000001,"15min":0.20999999999999999},"max":{"1min":0.74299999999999999,"5min":4.8630000000000004,"15min":4.8630000000000004},"last":0.374}]},{"osd":3,"last update":"Fri Oct 6 11:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.44900000000000001,"15min":0.42399999999999999},"min":{"1min":0.313,"5min":0.252,"15min":0.252},"max":{"1min":0.71299999999999997,"5min":4.8029999999999999,"15min":4.8029999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.37,"5min":0.42999999999999999,"15min":0.39100000000000001},"min":{"1min":0.27600000000000002,"5min":0.217,"15min":0.217},"max":{"1min":0.68799999999999994,"5min":5.8700000000000001,"15min":5.8700000000000001},"last":0.40000000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51800000000000002,"15min":0.51500000000000001},"min":{"1min":0.38200000000000001,"5min":0.29499999999999998,"15min":0.28199999999999997},"max":{"1min":0.68500000000000005,"5min":1.264,"15min":1.264},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.60899999999999999,"15min":0.56599999999999995},"min":{"1min":0.35199999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.88600000000000001,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.48599999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.58799999999999997,"15min":0.56399999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71699999999999997,"5min":3.4390000000000001,"15min":3.4390000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.66000000000000003,"15min":0.58399999999999996},"min":{"1min":0.36799999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.69799999999999995,"5min":9.3829999999999991,"15min":9.3829999999999991},"last":0.5}]},{"osd":6,"last update":"Fri Oct 6 11:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.61899999999999999,"15min":0.58299999999999996},"min":{"1min":0.35999999999999999,"5min":0.34999999999999998,"15min":0.315},"max":{"1min":0.86699999999999999,"5min":3.4750000000000001,"15min":3.4750000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60999999999999999,"15min":0.58899999999999997},"min":{"1min":0.40400000000000003,"5min":0.379,"15min":0.36699999999999999},"max":{"1min":0.748,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.60699999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.64500000000000002,"15min":0.60999999999999999},"min":{"1min":0.42299999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92200000000000004,"5min":4.7290000000000001,"15min":4.7290000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.60999999999999999,"15min":0.59099999999999997},"min":{"1min":0.42099999999999999,"5min":0.378,"15min":0.374},"max":{"1min":0.89500000000000002,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.61599999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574967,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302912,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068928,"statfs":{"total":96636764160,"available":96326582272,"internally_reserved":0,"allocated":1564672,"data_stored":713887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.42099999999999999,"15min":0.46800000000000003},"min":{"1min":0.20399999999999999,"5min":0.184,"15min":0.184},"max":{"1min":0.501,"5min":8.4239999999999995,"15min":36.097999999999999},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.43099999999999999,"15min":0.377},"min":{"1min":0.22,"5min":0.20799999999999999,"15min":0.182},"max":{"1min":0.52000000000000002,"5min":7.2990000000000004,"15min":7.2990000000000004},"last":0.23999999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.44800000000000001,"15min":0.50600000000000001},"min":{"1min":0.28199999999999997,"5min":0.221,"15min":0.217},"max":{"1min":0.61699999999999999,"5min":8.6080000000000005,"15min":36.07},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.442,"15min":0.40400000000000003},"min":{"1min":0.27100000000000002,"5min":0.23400000000000001,"15min":0.219},"max":{"1min":0.60699999999999998,"5min":6.7800000000000002,"15min":6.7800000000000002},"last":0.35199999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.36599999999999999,"15min":0.39300000000000002},"min":{"1min":0.255,"5min":0.223,"15min":0.223},"max":{"1min":0.55000000000000004,"5min":1.863,"15min":8.4130000000000003},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.48699999999999999,"15min":0.55700000000000005},"min":{"1min":0.25800000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.65200000000000002,"5min":8.4570000000000007,"15min":35.959000000000003},"last":0.33700000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55900000000000005,"15min":0.56200000000000006},"min":{"1min":0.39300000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.85099999999999998,"5min":2.427,"15min":2.427},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.65400000000000003,"15min":0.73299999999999998},"min":{"1min":0.42799999999999999,"5min":0.34399999999999997,"15min":0.29299999999999998},"max":{"1min":0.94999999999999996,"5min":8.2919999999999998,"15min":36.005000000000003},"last":0.55600000000000005}]},{"osd":5,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.628,"15min":0.57899999999999996},"min":{"1min":0.38900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.89600000000000002,"5min":6.6699999999999999,"15min":6.6699999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55100000000000005,"15min":0.55200000000000005},"min":{"1min":0.372,"5min":0.315,"15min":0.315},"max":{"1min":0.82599999999999996,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.54700000000000004}]},{"osd":6,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.66700000000000004,"15min":0.73399999999999999},"min":{"1min":0.42199999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.98699999999999999,"5min":8.2479999999999993,"15min":36.037999999999997},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.66400000000000003,"15min":0.63600000000000001},"min":{"1min":0.495,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.97199999999999998,"5min":6.7110000000000003,"15min":6.7110000000000003},"last":0.59499999999999997}]},{"osd":7,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.65500000000000003,"15min":0.623},"min":{"1min":0.44,"5min":0.371,"15min":0.371},"max":{"1min":0.93100000000000005,"5min":6.742,"15min":6.742},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57899999999999996,"15min":0.56899999999999995},"min":{"1min":0.41499999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.96199999999999997,"5min":1.917,"15min":1.917},"last":0.50600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574968,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315200,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94056640,"statfs":{"total":96636764160,"available":96313999360,"internally_reserved":0,"allocated":1564672,"data_stored":714419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.313,"15min":0.31},"min":{"1min":0.246,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.36399999999999999,"5min":0.56699999999999995,"15min":0.57499999999999996},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.38400000000000001,"15min":0.38200000000000001},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.438,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.40600000000000003}]},{"osd":1,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.373,"15min":0.372},"min":{"1min":0.252,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.47699999999999998,"5min":0.745,"15min":0.745},"last":0.372},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.35199999999999998,"15min":0.34999999999999998},"min":{"1min":0.26200000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.52700000000000002,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.34499999999999997}]},{"osd":3,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.35599999999999998,"15min":0.36599999999999999},"min":{"1min":0.27100000000000002,"5min":0.23300000000000001,"15min":0.23200000000000001},"max":{"1min":0.40000000000000002,"5min":0.58699999999999997,"15min":0.629},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.36499999999999999,"15min":0.36399999999999999},"min":{"1min":0.25900000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.42199999999999999,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.29599999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.505,"15min":0.52500000000000002},"min":{"1min":0.36199999999999999,"5min":0.30599999999999999,"15min":0.30299999999999999},"max":{"1min":0.70899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.52000000000000002,"15min":0.54600000000000004},"min":{"1min":0.35499999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.72299999999999998,"5min":0.80400000000000005,"15min":0.84899999999999998},"last":0.81999999999999995}]},{"osd":5,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.52600000000000002,"15min":0.54100000000000004},"min":{"1min":0.38300000000000001,"5min":0.33100000000000002,"15min":0.32400000000000001},"max":{"1min":0.71699999999999997,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.54800000000000004,"15min":0.55200000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.78100000000000003,"5min":0.878,"15min":0.878},"last":0.84499999999999997}]},{"osd":6,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.56499999999999995,"15min":0.57899999999999996},"min":{"1min":0.38700000000000001,"5min":0.36799999999999999,"15min":0.32600000000000001},"max":{"1min":0.73799999999999999,"5min":0.85199999999999998,"15min":0.86299999999999999},"last":0.746},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55900000000000005,"15min":0.57099999999999995},"min":{"1min":0.40699999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70699999999999996,"5min":0.878,"15min":0.88600000000000001},"last":0.78400000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.37,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67700000000000005,"5min":1.139,"15min":1.139},"last":0.624},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.55800000000000005,"15min":0.56699999999999995},"min":{"1min":0.41699999999999998,"5min":0.38800000000000001,"15min":0.38200000000000001},"max":{"1min":0.69699999999999995,"5min":0.89600000000000002,"15min":0.90500000000000003},"last":0.80600000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574968,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307016,"kb_used_data":1536,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064824,"statfs":{"total":96636764160,"available":96322379776,"internally_reserved":0,"allocated":1572864,"data_stored":715437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.31,"15min":0.31900000000000001},"min":{"1min":0.222,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.45500000000000002,"5min":0.48899999999999999,"15min":1.095},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35199999999999998,"15min":0.38100000000000001},"min":{"1min":0.27100000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.52700000000000002,"5min":0.53900000000000003,"15min":1.7210000000000001},"last":0.23000000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.314,"15min":0.311},"min":{"1min":0.23400000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.65400000000000003},"last":0.251},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.34100000000000003,"15min":0.35899999999999999},"min":{"1min":0.25800000000000001,"5min":0.188,"15min":0.188},"max":{"1min":0.53100000000000003,"5min":0.53400000000000003,"15min":1.196},"last":0.27900000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.34799999999999998,"15min":0.374},"min":{"1min":0.251,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.47799999999999998,"5min":0.73499999999999999,"15min":1.7729999999999999},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39700000000000002,"15min":0.41099999999999998},"min":{"1min":0.308,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.57699999999999996,"5min":0.58599999999999997,"15min":1.224},"last":0.37}]},{"osd":4,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.50900000000000001,"15min":0.54900000000000004},"min":{"1min":0.32100000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":1.694},"last":0.5},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51700000000000002,"15min":0.53700000000000003},"min":{"1min":0.35899999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.56399999999999995}]},{"osd":5,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53100000000000003,"15min":0.53200000000000003},"min":{"1min":0.35599999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.878},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53900000000000003,"15min":0.55600000000000005},"min":{"1min":0.39000000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.746,"5min":0.75800000000000001,"15min":1.165},"last":0.59799999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55300000000000005,"15min":0.57999999999999996},"min":{"1min":0.372,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.79200000000000004,"5min":0.85099999999999998,"15min":1.1359999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55900000000000005,"15min":0.58799999999999997},"min":{"1min":0.42999999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79700000000000004,"5min":0.82199999999999995,"15min":1.7470000000000001},"last":0.61799999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55000000000000004,"15min":0.57799999999999996},"min":{"1min":0.38900000000000001,"5min":0.35699999999999998,"15min":0.35599999999999998},"max":{"1min":0.754,"5min":0.85399999999999998,"15min":1.657},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56100000000000005,"15min":0.57199999999999995},"min":{"1min":0.38,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.82099999999999995,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.60699999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574966,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302884,"kb_used_data":1500,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068956,"statfs":{"total":96636764160,"available":96326610944,"internally_reserved":0,"allocated":1536000,"data_stored":701427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.45700000000000002,"15min":0.53500000000000003},"min":{"1min":0.216,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":2.6619999999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.439,"5min":0.47499999999999998,"15min":0.49099999999999999},"min":{"1min":0.224,"5min":0.215,"15min":0.215},"max":{"1min":0.69999999999999996,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.33300000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:14:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47099999999999997,"15min":0.55600000000000005},"min":{"1min":0.27300000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1,"5min":1,"15min":2.8650000000000002},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.48199999999999998,"15min":0.56299999999999994},"min":{"1min":0.27400000000000002,"5min":0.26200000000000001,"15min":0.25800000000000001},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":2.7610000000000001},"last":0.41499999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:14:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.49299999999999999,"15min":0.54100000000000004},"min":{"1min":0.28499999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.749,"5min":0.76000000000000001,"15min":1.6910000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54200000000000004,"15min":0.58699999999999997},"min":{"1min":0.41099999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71899999999999997,"5min":0.93899999999999995,"15min":1.718},"last":0.67600000000000005}]},{"osd":3,"last update":"Fri Oct 6 11:14:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.55300000000000005,"15min":0.59999999999999998},"min":{"1min":0.33400000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":2.387,"5min":2.387,"15min":2.677},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.27500000000000002},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":0.64100000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:14:53 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.47099999999999997,"15min":0.48399999999999999},"min":{"1min":0.315,"5min":0.23499999999999999,"15min":0.23200000000000001},"max":{"1min":0.73199999999999998,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.495,"15min":0.52600000000000002},"min":{"1min":0.29299999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.58899999999999997,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.55700000000000005}]},{"osd":6,"last update":"Fri Oct 6 11:14:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.505,"15min":0.52100000000000002},"min":{"1min":0.31,"5min":0.30499999999999999,"15min":0.252},"max":{"1min":0.63400000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.502,"5min":0.53500000000000003,"15min":0.56499999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.64800000000000002,"5min":0.85799999999999998,"15min":1.165},"last":0.61199999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:14:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.55300000000000005,"15min":0.55700000000000005},"min":{"1min":0.35399999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.74399999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.626},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56100000000000005,"15min":0.59299999999999997},"min":{"1min":0.318,"5min":0.317,"15min":0.317},"max":{"1min":0.67900000000000005,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.875}]}]},{"osd":5,"up_from":13,"seq":55834574969,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311104,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060736,"statfs":{"total":96636764160,"available":96318193664,"internally_reserved":0,"allocated":1564672,"data_stored":715206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45400000000000001,"15min":0.60799999999999998},"min":{"1min":0.34799999999999998,"5min":0.23100000000000001,"15min":0.20499999999999999},"max":{"1min":0.61099999999999999,"5min":0.72599999999999998,"15min":5.0490000000000004},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.434,"5min":0.45200000000000001,"15min":0.58499999999999996},"min":{"1min":0.253,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.65500000000000003,"5min":0.78100000000000003,"15min":5.1449999999999996},"last":0.53500000000000003}]},{"osd":1,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.46500000000000002,"15min":0.48099999999999998},"min":{"1min":0.29599999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.629,"5min":0.81399999999999995,"15min":0.97199999999999998},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47699999999999998,"15min":0.51000000000000001},"min":{"1min":0.30099999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.58599999999999997,"5min":0.70199999999999996,"15min":1.8799999999999999},"last":0.51100000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.50700000000000001,"15min":0.54900000000000004},"min":{"1min":0.30099999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.60999999999999999,"5min":0.79800000000000004,"15min":4.234},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52600000000000002,"15min":0.55800000000000005},"min":{"1min":0.40100000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.64000000000000001,"5min":0.81000000000000005,"15min":1.0369999999999999},"last":0.627}]},{"osd":3,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48299999999999998,"15min":0.627},"min":{"1min":0.33200000000000002,"5min":0.30399999999999999,"15min":0.27700000000000002},"max":{"1min":0.60699999999999998,"5min":0.82299999999999995,"15min":5.2169999999999996},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.51300000000000001,"15min":0.54000000000000004},"min":{"1min":0.373,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.56299999999999994,"5min":0.82699999999999996,"15min":1.008},"last":0.67600000000000005}]},{"osd":4,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.46999999999999997,"15min":0.51100000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.23999999999999999},"max":{"1min":0.61499999999999999,"5min":0.83399999999999996,"15min":1.917},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46899999999999997,"15min":0.52300000000000002},"min":{"1min":0.35599999999999998,"5min":0.24399999999999999,"15min":0.23899999999999999},"max":{"1min":0.628,"5min":0.71899999999999997,"15min":0.87},"last":0.61099999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.55100000000000005},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.64700000000000002,"5min":0.77100000000000002,"15min":2.0139999999999998},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55400000000000005,"15min":0.60199999999999998},"min":{"1min":0.43099999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.64000000000000001,"5min":0.82899999999999996,"15min":1.9470000000000001},"last":0.69499999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52100000000000002,"15min":0.57399999999999995},"min":{"1min":0.28799999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.65500000000000003,"5min":0.81000000000000005,"15min":0.96499999999999997},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55200000000000005,"15min":0.60099999999999998},"min":{"1min":0.376,"5min":0.316,"15min":0.28799999999999998},"max":{"1min":0.68000000000000005,"5min":0.79900000000000004,"15min":1.4119999999999999},"last":0.75600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:15:17.370 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3d is not active+clean 2023-10-06T11:15:17.370 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:15:11.533426+0000', 'last_change': '2023-10-06T11:15:11.548374+0000', 'last_active': '2023-10-06T11:15:11.533426+0000', 'last_peered': '2023-10-06T11:15:11.533426+0000', 'last_clean': '2023-10-06T11:15:11.533426+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:15:11.533426+0000', 'last_undegraded': '2023-10-06T11:15:11.533426+0000', 'last_fullsized': '2023-10-06T11:15:11.533426+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_clean_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T18:03:55.986977+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:15:17.370 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3a is not active+clean 2023-10-06T11:15:17.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:15:11.533426+0000', 'last_change': '2023-10-06T11:15:11.551608+0000', 'last_active': '2023-10-06T11:15:11.533426+0000', 'last_peered': '2023-10-06T11:15:11.533426+0000', 'last_clean': '2023-10-06T11:15:11.533426+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:15:11.533426+0000', 'last_undegraded': '2023-10-06T11:15:11.533426+0000', 'last_fullsized': '2023-10-06T11:15:11.533426+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_clean_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T22:25:18.441894+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T11:15:17.371 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.38 is not active+clean 2023-10-06T11:15:17.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:15:11.533426+0000', 'last_change': '2023-10-06T11:15:11.545346+0000', 'last_active': '2023-10-06T11:15:11.533426+0000', 'last_peered': '2023-10-06T11:15:11.533426+0000', 'last_clean': '2023-10-06T11:15:11.533426+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:15:11.533426+0000', 'last_undegraded': '2023-10-06T11:15:11.533426+0000', 'last_fullsized': '2023-10-06T11:15:11.533426+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_clean_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T19:49:53.647910+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T11:15:17.371 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.37 is not active+clean 2023-10-06T11:15:17.371 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:15:11.533426+0000', 'last_change': '2023-10-06T11:15:11.553845+0000', 'last_active': '2023-10-06T11:15:11.533426+0000', 'last_peered': '2023-10-06T11:15:11.533426+0000', 'last_clean': '2023-10-06T11:15:11.533426+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:15:11.533426+0000', 'last_undegraded': '2023-10-06T11:15:11.533426+0000', 'last_fullsized': '2023-10-06T11:15:11.533426+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_clean_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T22:35:58.009437+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T11:15:17.372 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.33 is not active+clean 2023-10-06T11:15:17.372 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:15:11.533426+0000', 'last_change': '2023-10-06T11:15:11.545643+0000', 'last_active': '2023-10-06T11:15:11.533426+0000', 'last_peered': '2023-10-06T11:15:11.533426+0000', 'last_clean': '2023-10-06T11:15:11.533426+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:15:11.533426+0000', 'last_undegraded': '2023-10-06T11:15:11.533426+0000', 'last_fullsized': '2023-10-06T11:15:11.533426+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_clean_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T18:58:42.165232+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T11:15:17.372 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.30 is not active+clean 2023-10-06T11:15:17.372 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:15:11.533426+0000', 'last_change': '2023-10-06T11:15:11.545611+0000', 'last_active': '2023-10-06T11:15:11.533426+0000', 'last_peered': '2023-10-06T11:15:11.533426+0000', 'last_clean': '2023-10-06T11:15:11.533426+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:15:11.533426+0000', 'last_undegraded': '2023-10-06T11:15:11.533426+0000', 'last_fullsized': '2023-10-06T11:15:11.533426+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_clean_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T17:51:27.969369+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T11:15:17.373 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2f is not active+clean 2023-10-06T11:15:17.373 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:15:11.533426+0000', 'last_change': '2023-10-06T11:15:11.551293+0000', 'last_active': '2023-10-06T11:15:11.533426+0000', 'last_peered': '2023-10-06T11:15:11.533426+0000', 'last_clean': '2023-10-06T11:15:11.533426+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:15:11.533426+0000', 'last_undegraded': '2023-10-06T11:15:11.533426+0000', 'last_fullsized': '2023-10-06T11:15:11.533426+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_clean_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T18:45:49.982194+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T11:15:17.373 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.28 is not active+clean 2023-10-06T11:15:17.373 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:15:11.533426+0000', 'last_change': '2023-10-06T11:15:11.554183+0000', 'last_active': '2023-10-06T11:15:11.533426+0000', 'last_peered': '2023-10-06T11:15:11.533426+0000', 'last_clean': '2023-10-06T11:15:11.533426+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:15:11.533426+0000', 'last_undegraded': '2023-10-06T11:15:11.533426+0000', 'last_fullsized': '2023-10-06T11:15:11.533426+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_clean_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:33:57.627561+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T11:15:17.373 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.27 is not active+clean 2023-10-06T11:15:17.374 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:15:11.533426+0000', 'last_change': '2023-10-06T11:15:11.549474+0000', 'last_active': '2023-10-06T11:15:11.533426+0000', 'last_peered': '2023-10-06T11:15:11.533426+0000', 'last_clean': '2023-10-06T11:15:11.533426+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:15:11.533426+0000', 'last_undegraded': '2023-10-06T11:15:11.533426+0000', 'last_fullsized': '2023-10-06T11:15:11.533426+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_clean_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T19:19:29.875101+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:15:17.374 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.26 is not active+clean 2023-10-06T11:15:17.374 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:15:11.533426+0000', 'last_change': '2023-10-06T11:15:11.549075+0000', 'last_active': '2023-10-06T11:15:11.533426+0000', 'last_peered': '2023-10-06T11:15:11.533426+0000', 'last_clean': '2023-10-06T11:15:11.533426+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:15:11.533426+0000', 'last_undegraded': '2023-10-06T11:15:11.533426+0000', 'last_fullsized': '2023-10-06T11:15:11.533426+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_clean_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T23:14:08.040389+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:15:17.375 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.23 is not active+clean 2023-10-06T11:15:17.375 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:15:11.533426+0000', 'last_change': '2023-10-06T11:15:11.550511+0000', 'last_active': '2023-10-06T11:15:11.533426+0000', 'last_peered': '2023-10-06T11:15:11.533426+0000', 'last_clean': '2023-10-06T11:15:11.533426+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:15:11.533426+0000', 'last_undegraded': '2023-10-06T11:15:11.533426+0000', 'last_fullsized': '2023-10-06T11:15:11.533426+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_clean_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:01:06.278594+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:15:17.375 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.22 is not active+clean 2023-10-06T11:15:17.376 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:15:11.533426+0000', 'last_change': '2023-10-06T11:15:11.549144+0000', 'last_active': '2023-10-06T11:15:11.533426+0000', 'last_peered': '2023-10-06T11:15:11.533426+0000', 'last_clean': '2023-10-06T11:15:11.533426+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:15:11.533426+0000', 'last_undegraded': '2023-10-06T11:15:11.533426+0000', 'last_fullsized': '2023-10-06T11:15:11.533426+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_clean_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:16:46.194765+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:15:17.376 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.21 is not active+clean 2023-10-06T11:15:17.376 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:15:11.533426+0000', 'last_change': '2023-10-06T11:15:11.544258+0000', 'last_active': '2023-10-06T11:15:11.533426+0000', 'last_peered': '2023-10-06T11:15:11.533426+0000', 'last_clean': '2023-10-06T11:15:11.533426+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:15:11.533426+0000', 'last_undegraded': '2023-10-06T11:15:11.533426+0000', 'last_fullsized': '2023-10-06T11:15:11.533426+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_clean_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:33:57.627561+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T11:15:17.376 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.18 is not active+clean 2023-10-06T11:15:17.376 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:15:11.533426+0000', 'last_change': '2023-10-06T11:15:11.544863+0000', 'last_active': '2023-10-06T11:15:11.533426+0000', 'last_peered': '2023-10-06T11:15:11.533426+0000', 'last_clean': '2023-10-06T11:15:11.533426+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:15:11.533426+0000', 'last_undegraded': '2023-10-06T11:15:11.533426+0000', 'last_fullsized': '2023-10-06T11:15:11.533426+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_clean_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:47:14.774930+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T11:15:17.377 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1c is not active+clean 2023-10-06T11:15:17.377 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:15:11.533426+0000', 'last_change': '2023-10-06T11:15:11.544806+0000', 'last_active': '2023-10-06T11:15:11.533426+0000', 'last_peered': '2023-10-06T11:15:11.533426+0000', 'last_clean': '2023-10-06T11:15:11.533426+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:15:11.533426+0000', 'last_undegraded': '2023-10-06T11:15:11.533426+0000', 'last_fullsized': '2023-10-06T11:15:11.533426+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_clean_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:42:28.514350+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T11:15:17.377 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1d is not active+clean 2023-10-06T11:15:17.377 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:15:11.533426+0000', 'last_change': '2023-10-06T11:15:11.545719+0000', 'last_active': '2023-10-06T11:15:11.533426+0000', 'last_peered': '2023-10-06T11:15:11.533426+0000', 'last_clean': '2023-10-06T11:15:11.533426+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:15:11.533426+0000', 'last_undegraded': '2023-10-06T11:15:11.533426+0000', 'last_fullsized': '2023-10-06T11:15:11.533426+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_clean_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:42:08.749955+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T11:15:17.377 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.8 is not active+clean 2023-10-06T11:15:17.377 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:15:11.533426+0000', 'last_change': '2023-10-06T11:15:11.548277+0000', 'last_active': '2023-10-06T11:15:11.533426+0000', 'last_peered': '2023-10-06T11:15:11.533426+0000', 'last_clean': '2023-10-06T11:15:11.533426+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:15:11.533426+0000', 'last_undegraded': '2023-10-06T11:15:11.533426+0000', 'last_fullsized': '2023-10-06T11:15:11.533426+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_clean_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:41:04.347350+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:15:17.377 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1 is not active+clean 2023-10-06T11:15:17.377 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:15:11.533426+0000', 'last_change': '2023-10-06T11:15:11.548722+0000', 'last_active': '2023-10-06T11:15:11.533426+0000', 'last_peered': '2023-10-06T11:15:11.533426+0000', 'last_clean': '2023-10-06T11:15:11.533426+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:15:11.533426+0000', 'last_undegraded': '2023-10-06T11:15:11.533426+0000', 'last_fullsized': '2023-10-06T11:15:11.533426+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_clean_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:12:17.067365+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:15:17.377 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.4 is not active+clean 2023-10-06T11:15:17.378 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:15:11.533426+0000', 'last_change': '2023-10-06T11:15:11.551355+0000', 'last_active': '2023-10-06T11:15:11.533426+0000', 'last_peered': '2023-10-06T11:15:11.533426+0000', 'last_clean': '2023-10-06T11:15:11.533426+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:15:11.533426+0000', 'last_undegraded': '2023-10-06T11:15:11.533426+0000', 'last_fullsized': '2023-10-06T11:15:11.533426+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_clean_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:59:48.066554+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T11:15:17.378 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.5 is not active+clean 2023-10-06T11:15:17.378 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:15:11.533426+0000', 'last_change': '2023-10-06T11:15:11.551860+0000', 'last_active': '2023-10-06T11:15:11.533426+0000', 'last_peered': '2023-10-06T11:15:11.533426+0000', 'last_clean': '2023-10-06T11:15:11.533426+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:15:11.533426+0000', 'last_undegraded': '2023-10-06T11:15:11.533426+0000', 'last_fullsized': '2023-10-06T11:15:11.533426+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_clean_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T20:30:37.212830+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T11:15:17.378 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.6 is not active+clean 2023-10-06T11:15:17.378 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:15:11.533426+0000', 'last_change': '2023-10-06T11:15:11.553099+0000', 'last_active': '2023-10-06T11:15:11.533426+0000', 'last_peered': '2023-10-06T11:15:11.533426+0000', 'last_clean': '2023-10-06T11:15:11.533426+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:15:11.533426+0000', 'last_undegraded': '2023-10-06T11:15:11.533426+0000', 'last_fullsized': '2023-10-06T11:15:11.533426+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_clean_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T22:53:36.864990+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T11:15:17.378 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.11 is not active+clean 2023-10-06T11:15:17.378 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:15:11.533426+0000', 'last_change': '2023-10-06T11:15:11.551327+0000', 'last_active': '2023-10-06T11:15:11.533426+0000', 'last_peered': '2023-10-06T11:15:11.533426+0000', 'last_clean': '2023-10-06T11:15:11.533426+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:15:11.533426+0000', 'last_undegraded': '2023-10-06T11:15:11.533426+0000', 'last_fullsized': '2023-10-06T11:15:11.533426+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_clean_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:15:40.228447+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T11:15:17.378 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.15 is not active+clean 2023-10-06T11:15:17.378 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:15:11.533426+0000', 'last_change': '2023-10-06T11:15:11.555020+0000', 'last_active': '2023-10-06T11:15:11.533426+0000', 'last_peered': '2023-10-06T11:15:11.533426+0000', 'last_clean': '2023-10-06T11:15:11.533426+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:15:11.533426+0000', 'last_undegraded': '2023-10-06T11:15:11.533426+0000', 'last_fullsized': '2023-10-06T11:15:11.533426+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_clean_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:02:07.116865+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:15:17.379 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.13 is not active+clean 2023-10-06T11:15:17.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:15:11.533426+0000', 'last_change': '2023-10-06T11:15:11.550124+0000', 'last_active': '2023-10-06T11:15:11.533426+0000', 'last_peered': '2023-10-06T11:15:11.533426+0000', 'last_clean': '2023-10-06T11:15:11.533426+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:15:11.533426+0000', 'last_undegraded': '2023-10-06T11:15:11.533426+0000', 'last_fullsized': '2023-10-06T11:15:11.533426+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_clean_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:08:27.945477+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:15:17.379 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.12 is not active+clean 2023-10-06T11:15:17.379 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:15:11.533426+0000', 'last_change': '2023-10-06T11:15:11.548629+0000', 'last_active': '2023-10-06T11:15:11.533426+0000', 'last_peered': '2023-10-06T11:15:11.533426+0000', 'last_clean': '2023-10-06T11:15:11.533426+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:15:11.533426+0000', 'last_undegraded': '2023-10-06T11:15:11.533426+0000', 'last_fullsized': '2023-10-06T11:15:11.533426+0000', 'mapping_epoch': 123, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 123, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'last_clean_scrub_stamp': '2023-10-06T11:15:11.533426+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:18:11.072682+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:15:17.379 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T11:15:17.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.513+0000 7f63f01ab700 1 Processor -- start 2023-10-06T11:15:17.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.513+0000 7f63f01ab700 1 -- start start 2023-10-06T11:15:17.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.514+0000 7f63f01ab700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63e8153ab0 0x7f63e815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:17.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.514+0000 7f63f01ab700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f63e8153e80 0x7f63e8068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:17.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.514+0000 7f63f01ab700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f63e80689d0 0x7f63e815d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:17.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.514+0000 7f63f01ab700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63e8068e50 con 0x7f63e80689d0 2023-10-06T11:15:17.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.514+0000 7f63f01ab700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63e815ac30 con 0x7f63e8153e80 2023-10-06T11:15:17.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.514+0000 7f63f01ab700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e80b4510 con 0x7f63e8153ab0 2023-10-06T11:15:17.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.514+0000 7f63ee748700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f63e80689d0 0x7f63e815d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:17.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.514+0000 7f63ee748700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f63e80689d0 0x7f63e815d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35410/0 (socket says 172.21.15.146:35410) 2023-10-06T11:15:17.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.514+0000 7f63ee748700 1 -- 172.21.15.146:0/2199029393 learned_addr learned my addr 172.21.15.146:0/2199029393 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:17.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.514+0000 7f63ed746700 1 --2- 172.21.15.146:0/2199029393 >> v2:172.21.15.151:3300/0 conn(0x7f63e8153e80 0x7f63e8068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:17.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.514+0000 7f63edf47700 1 --2- 172.21.15.146:0/2199029393 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63e8153ab0 0x7f63e815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:17.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.514+0000 7f63ee748700 1 -- 172.21.15.146:0/2199029393 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63e8153ab0 msgr2=0x7f63e815a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:17.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.514+0000 7f63ee748700 1 --2- 172.21.15.146:0/2199029393 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63e8153ab0 0x7f63e815a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:17.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.514+0000 7f63ee748700 1 -- 172.21.15.146:0/2199029393 >> v2:172.21.15.151:3300/0 conn(0x7f63e8153e80 msgr2=0x7f63e8068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:17.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.514+0000 7f63ee748700 1 --2- 172.21.15.146:0/2199029393 >> v2:172.21.15.151:3300/0 conn(0x7f63e8153e80 0x7f63e8068490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:17.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.514+0000 7f63ee748700 1 -- 172.21.15.146:0/2199029393 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e80b6530 con 0x7f63e80689d0 2023-10-06T11:15:17.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.514+0000 7f63ed746700 1 --2- 172.21.15.146:0/2199029393 >> v2:172.21.15.151:3300/0 conn(0x7f63e8153e80 0x7f63e8068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:17.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.514+0000 7f63edf47700 1 --2- 172.21.15.146:0/2199029393 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63e8153ab0 0x7f63e815a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:17.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.514+0000 7f63ee748700 1 --2- 172.21.15.146:0/2199029393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63e80689d0 0x7f63e815d270 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f63e8089500 tx=0x7f63e0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c7800eb0329d9f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:17.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.515+0000 7f63ecf45700 1 -- 172.21.15.146:0/2199029393 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e000e070 con 0x7f63e80689d0 2023-10-06T11:15:17.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.515+0000 7f63ecf45700 1 -- 172.21.15.146:0/2199029393 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e000ba50 con 0x7f63e80689d0 2023-10-06T11:15:17.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.515+0000 7f63ecf45700 1 -- 172.21.15.146:0/2199029393 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e00092e0 con 0x7f63e80689d0 2023-10-06T11:15:17.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.515+0000 7f63f01ab700 1 -- 172.21.15.146:0/2199029393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63e80689d0 msgr2=0x7f63e815d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:17.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.515+0000 7f63f01ab700 1 --2- 172.21.15.146:0/2199029393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63e80689d0 0x7f63e815d270 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f63e8089500 tx=0x7f63e0009840 comp rx=0 tx=0).stop 2023-10-06T11:15:17.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.515+0000 7f63f01ab700 1 -- 172.21.15.146:0/2199029393 shutdown_connections 2023-10-06T11:15:17.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.515+0000 7f63f01ab700 1 --2- 172.21.15.146:0/2199029393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63e80689d0 0x7f63e815d270 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:17.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.515+0000 7f63f01ab700 1 --2- 172.21.15.146:0/2199029393 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63e8153ab0 0x7f63e815a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:17.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.515+0000 7f63f01ab700 1 --2- 172.21.15.146:0/2199029393 >> v2:172.21.15.151:3300/0 conn(0x7f63e8153e80 0x7f63e8068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:17.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.515+0000 7f63f01ab700 1 -- 172.21.15.146:0/2199029393 >> 172.21.15.146:0/2199029393 conn(0x7f63e806eba0 msgr2=0x7f63e806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:17.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.515+0000 7f63f01ab700 1 -- 172.21.15.146:0/2199029393 shutdown_connections 2023-10-06T11:15:17.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.515+0000 7f63f01ab700 1 -- 172.21.15.146:0/2199029393 wait complete. 2023-10-06T11:15:17.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.516+0000 7f63f01ab700 1 Processor -- start 2023-10-06T11:15:17.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.516+0000 7f63f01ab700 1 -- start start 2023-10-06T11:15:17.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.517+0000 7f63f01ab700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63e80689d0 0x7f63e81695c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:17.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.517+0000 7f63f01ab700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63e8153ab0 0x7f63e813fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:17.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.517+0000 7f63f01ab700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63e8153e80 0x7f63e815daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:17.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.517+0000 7f63f01ab700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e8169f10 con 0x7f63e80689d0 2023-10-06T11:15:17.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.517+0000 7f63f01ab700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63e816a1f0 con 0x7f63e8153ab0 2023-10-06T11:15:17.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.517+0000 7f63f01ab700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63e815d2a0 con 0x7f63e8153e80 2023-10-06T11:15:17.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.517+0000 7f63edf47700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63e80689d0 0x7f63e81695c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:17.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.517+0000 7f63edf47700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63e80689d0 0x7f63e81695c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35414/0 (socket says 172.21.15.146:35414) 2023-10-06T11:15:17.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.517+0000 7f63edf47700 1 -- 172.21.15.146:0/1031825976 learned_addr learned my addr 172.21.15.146:0/1031825976 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:17.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.517+0000 7f63edf47700 1 -- 172.21.15.146:0/1031825976 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63e8153e80 msgr2=0x7f63e815daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:17.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.517+0000 7f63edf47700 1 --2- 172.21.15.146:0/1031825976 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63e8153e80 0x7f63e815daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:17.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.517+0000 7f63edf47700 1 -- 172.21.15.146:0/1031825976 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63e8153ab0 msgr2=0x7f63e813fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:17.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.517+0000 7f63edf47700 1 --2- 172.21.15.146:0/1031825976 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63e8153ab0 0x7f63e813fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:17.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.517+0000 7f63edf47700 1 -- 172.21.15.146:0/1031825976 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e0009ae0 con 0x7f63e80689d0 2023-10-06T11:15:17.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.518+0000 7f63edf47700 1 --2- 172.21.15.146:0/1031825976 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63e80689d0 0x7f63e81695c0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f63e400e8d0 tx=0x7f63e4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:17.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.518+0000 7f63ddffb700 1 -- 172.21.15.146:0/1031825976 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e400ee70 con 0x7f63e80689d0 2023-10-06T11:15:17.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.518+0000 7f63ddffb700 1 -- 172.21.15.146:0/1031825976 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e400c5e0 con 0x7f63e80689d0 2023-10-06T11:15:17.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.518+0000 7f63ddffb700 1 -- 172.21.15.146:0/1031825976 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e400c980 con 0x7f63e80689d0 2023-10-06T11:15:17.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.518+0000 7f63f01ab700 1 -- 172.21.15.146:0/1031825976 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63e815d580 con 0x7f63e80689d0 2023-10-06T11:15:17.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.518+0000 7f63f01ab700 1 -- 172.21.15.146:0/1031825976 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63e8169b00 con 0x7f63e80689d0 2023-10-06T11:15:17.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.519+0000 7f63f01ab700 1 -- 172.21.15.146:0/1031825976 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63e815d7a0 con 0x7f63e80689d0 2023-10-06T11:15:17.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.519+0000 7f63ddffb700 1 -- 172.21.15.146:0/1031825976 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f63e4013410 con 0x7f63e80689d0 2023-10-06T11:15:17.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.519+0000 7f63ddffb700 1 --2- 172.21.15.146:0/1031825976 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f63cc066f30 0x7f63cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:17.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.520+0000 7f63ddffb700 1 -- 172.21.15.146:0/1031825976 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f63e40844f0 con 0x7f63e80689d0 2023-10-06T11:15:17.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.520+0000 7f63ed746700 1 --2- 172.21.15.146:0/1031825976 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f63cc066f30 0x7f63cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:17.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.520+0000 7f63ed746700 1 --2- 172.21.15.146:0/1031825976 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f63cc066f30 0x7f63cc0693e0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f63d8006fd0 tx=0x7f63d8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:17.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.524+0000 7f63ddffb700 1 -- 172.21.15.146:0/1031825976 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f63e4051600 con 0x7f63e80689d0 2023-10-06T11:15:17.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.782+0000 7f63f01ab700 1 -- 172.21.15.146:0/1031825976 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f63e804c380 con 0x7f63e80689d0 2023-10-06T11:15:17.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.783+0000 7f63ddffb700 1 -- 172.21.15.146:0/1031825976 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1523 (secure 0 0 0) 0x7f63e4054c20 con 0x7f63e80689d0 2023-10-06T11:15:17.785 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:15:17.785 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":592,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":125,"num_osds":8,"num_up_osds":8,"osd_up_since":1696590336,"num_in_osds":8,"osd_in_since":1696590327,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":80},{"state_name":"creating+peering","count":25}],"num_pgs":105,"num_pools":4,"num_objects":14,"data_bytes":592050,"bytes_used":2520322048,"bytes_avail":770573791232,"bytes_total":773094113280,"inactive_pgs_ratio":0.2380952388048172,"write_bytes_sec":1876,"read_op_per_sec":0,"write_op_per_sec":3},"fsmap":{"epoch":108,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":8682}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2023-10-06T11:15:01.259518+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T11:15:17.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.785+0000 7f63f01ab700 1 -- 172.21.15.146:0/1031825976 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f63cc066f30 msgr2=0x7f63cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:17.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.785+0000 7f63f01ab700 1 --2- 172.21.15.146:0/1031825976 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f63cc066f30 0x7f63cc0693e0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f63d8006fd0 tx=0x7f63d8008040 comp rx=0 tx=0).stop 2023-10-06T11:15:17.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.785+0000 7f63f01ab700 1 -- 172.21.15.146:0/1031825976 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63e80689d0 msgr2=0x7f63e81695c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:17.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.785+0000 7f63f01ab700 1 --2- 172.21.15.146:0/1031825976 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63e80689d0 0x7f63e81695c0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f63e400e8d0 tx=0x7f63e4008040 comp rx=0 tx=0).stop 2023-10-06T11:15:17.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.785+0000 7f63f01ab700 1 -- 172.21.15.146:0/1031825976 shutdown_connections 2023-10-06T11:15:17.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.785+0000 7f63f01ab700 1 --2- 172.21.15.146:0/1031825976 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f63cc066f30 0x7f63cc0693e0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:17.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.785+0000 7f63f01ab700 1 --2- 172.21.15.146:0/1031825976 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63e8153e80 0x7f63e815daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:17.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.785+0000 7f63f01ab700 1 --2- 172.21.15.146:0/1031825976 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63e80689d0 0x7f63e81695c0 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:17.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.785+0000 7f63f01ab700 1 --2- 172.21.15.146:0/1031825976 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63e8153ab0 0x7f63e813fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:17.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.785+0000 7f63f01ab700 1 -- 172.21.15.146:0/1031825976 >> 172.21.15.146:0/1031825976 conn(0x7f63e806eba0 msgr2=0x7f63e8151b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:17.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.785+0000 7f63f01ab700 1 -- 172.21.15.146:0/1031825976 shutdown_connections 2023-10-06T11:15:17.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.785+0000 7f63f01ab700 1 -- 172.21.15.146:0/1031825976 wait complete. 2023-10-06T11:15:17.799 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-06T11:15:17.799 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:15:17.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.912+0000 7f74b7ab2700 1 Processor -- start 2023-10-06T11:15:17.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.913+0000 7f74b7ab2700 1 -- start start 2023-10-06T11:15:17.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.913+0000 7f74b7ab2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f74b0157430 0x7f74b0157800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:17.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.913+0000 7f74b7ab2700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f74b00ca070 0x7f74b00cc240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:17.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.913+0000 7f74b7ab2700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b00ccf20 con 0x7f74b00ab010 2023-10-06T11:15:17.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.913+0000 7f74b7ab2700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b00ca4f0 con 0x7f74b0157430 2023-10-06T11:15:17.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.913+0000 7f74b7ab2700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b00c3dd0 con 0x7f74b00ca070 2023-10-06T11:15:17.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.914+0000 7f74b584e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f74b0157430 0x7f74b0157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:17.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.914+0000 7f74b504d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f74b00ab010 0x7f74b00ceb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59242/0 (socket says 172.21.15.146:59242) 2023-10-06T11:15:17.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.914+0000 7f74b504d700 1 -- 172.21.15.146:0/694425975 learned_addr learned my addr 172.21.15.146:0/694425975 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:15:17.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.914+0000 7f74b604f700 1 --2- 172.21.15.146:0/694425975 >> v2:172.21.15.151:3300/0 conn(0x7f74b00ca070 0x7f74b00cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:17.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.914+0000 7f74b584e700 1 -- 172.21.15.146:0/694425975 >> v2:172.21.15.151:3300/0 conn(0x7f74b00ca070 msgr2=0x7f74b00cc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:17.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.914+0000 7f74b584e700 1 --2- 172.21.15.146:0/694425975 >> v2:172.21.15.151:3300/0 conn(0x7f74b00ca070 0x7f74b00cc240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:17.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.914+0000 7f74b584e700 1 -- 172.21.15.146:0/694425975 >> v1:172.21.15.146:6789/0 conn(0x7f74b00ab010 legacy=0x7f74b00ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:17.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.914+0000 7f74b584e700 1 -- 172.21.15.146:0/694425975 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b00cd200 con 0x7f74b0157430 2023-10-06T11:15:17.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.914+0000 7f74b484c700 1 -- 172.21.15.146:0/694425975 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2675151828 0 0) 0x7f74b00ccf20 con 0x7f74b00ab010 2023-10-06T11:15:17.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.914+0000 7f74b604f700 1 --2- 172.21.15.146:0/694425975 >> v2:172.21.15.151:3300/0 conn(0x7f74b00ca070 0x7f74b00cc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:17.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.914+0000 7f74b584e700 1 --2- 172.21.15.146:0/694425975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74b0157430 0x7f74b0157800 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f74b00ce3f0 tx=0x7f74ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b4c61b4ba149d72 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:17.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.914+0000 7f74b484c700 1 -- 172.21.15.146:0/694425975 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac00b6b0 con 0x7f74b0157430 2023-10-06T11:15:17.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.914+0000 7f74b484c700 1 -- 172.21.15.146:0/694425975 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ac00b810 con 0x7f74b0157430 2023-10-06T11:15:17.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.914+0000 7f74b484c700 1 -- 172.21.15.146:0/694425975 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac00bbb0 con 0x7f74b0157430 2023-10-06T11:15:17.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.915+0000 7f74b7ab2700 1 -- 172.21.15.146:0/694425975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74b0157430 msgr2=0x7f74b0157800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:17.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.915+0000 7f74b7ab2700 1 --2- 172.21.15.146:0/694425975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74b0157430 0x7f74b0157800 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f74b00ce3f0 tx=0x7f74ac0091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:17.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.915+0000 7f74b7ab2700 1 -- 172.21.15.146:0/694425975 shutdown_connections 2023-10-06T11:15:17.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.915+0000 7f74b7ab2700 1 --2- 172.21.15.146:0/694425975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74b0157430 0x7f74b0157800 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:17.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.915+0000 7f74b7ab2700 1 --2- 172.21.15.146:0/694425975 >> v2:172.21.15.151:3300/0 conn(0x7f74b00ca070 0x7f74b00cc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:17.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.915+0000 7f74b7ab2700 1 -- 172.21.15.146:0/694425975 >> 172.21.15.146:0/694425975 conn(0x7f74b0067c50 msgr2=0x7f74b00ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:17.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.915+0000 7f74b7ab2700 1 -- 172.21.15.146:0/694425975 shutdown_connections 2023-10-06T11:15:17.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.915+0000 7f74b7ab2700 1 -- 172.21.15.146:0/694425975 wait complete. 2023-10-06T11:15:17.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.916+0000 7f74b7ab2700 1 Processor -- start 2023-10-06T11:15:17.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.916+0000 7f74b7ab2700 1 -- start start 2023-10-06T11:15:17.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.917+0000 7f74b7ab2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74b00ab010 0x7f74b00c6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:17.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.917+0000 7f74b7ab2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74b00ca070 0x7f74b016aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:17.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.917+0000 7f74b7ab2700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74b0157430 0x7f74b016aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:17.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.917+0000 7f74b7ab2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b00c5510 con 0x7f74b00ca070 2023-10-06T11:15:17.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.917+0000 7f74b7ab2700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b006bba0 con 0x7f74b00ab010 2023-10-06T11:15:17.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.917+0000 7f74b7ab2700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b00ad060 con 0x7f74b0157430 2023-10-06T11:15:17.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.917+0000 7f74b504d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74b00ca070 0x7f74b016aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:17.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.917+0000 7f74b504d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74b00ca070 0x7f74b016aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35434/0 (socket says 172.21.15.146:35434) 2023-10-06T11:15:17.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.917+0000 7f74b504d700 1 -- 172.21.15.146:0/3870728642 learned_addr learned my addr 172.21.15.146:0/3870728642 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:17.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.917+0000 7f74b504d700 1 -- 172.21.15.146:0/3870728642 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74b0157430 msgr2=0x7f74b016aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:17.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.917+0000 7f74b504d700 1 --2- 172.21.15.146:0/3870728642 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74b0157430 0x7f74b016aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:17.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.917+0000 7f74b504d700 1 -- 172.21.15.146:0/3870728642 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74b00ab010 msgr2=0x7f74b00c6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:17.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.917+0000 7f74b504d700 1 --2- 172.21.15.146:0/3870728642 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74b00ab010 0x7f74b00c6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:17.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.917+0000 7f74b504d700 1 -- 172.21.15.146:0/3870728642 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ac009420 con 0x7f74b00ca070 2023-10-06T11:15:17.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.917+0000 7f74b504d700 1 --2- 172.21.15.146:0/3870728642 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74b00ca070 0x7f74b016aab0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f74a000c7e0 tx=0x7f74a0007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:17.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.917+0000 7f74a5ffb700 1 -- 172.21.15.146:0/3870728642 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a0005b30 con 0x7f74b00ca070 2023-10-06T11:15:17.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.917+0000 7f74a5ffb700 1 -- 172.21.15.146:0/3870728642 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a0005c90 con 0x7f74b00ca070 2023-10-06T11:15:17.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.917+0000 7f74a5ffb700 1 -- 172.21.15.146:0/3870728642 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a0007300 con 0x7f74b00ca070 2023-10-06T11:15:17.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.917+0000 7f74b7ab2700 1 -- 172.21.15.146:0/3870728642 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b00ad340 con 0x7f74b00ca070 2023-10-06T11:15:17.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.917+0000 7f74b7ab2700 1 -- 172.21.15.146:0/3870728642 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b006b830 con 0x7f74b00ca070 2023-10-06T11:15:17.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.918+0000 7f74b7ab2700 1 -- 172.21.15.146:0/3870728642 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b004c380 con 0x7f74b00ca070 2023-10-06T11:15:17.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.919+0000 7f74a5ffb700 1 -- 172.21.15.146:0/3870728642 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f74a001b400 con 0x7f74b00ca070 2023-10-06T11:15:17.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.919+0000 7f74a5ffb700 1 --2- 172.21.15.146:0/3870728642 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7494066f30 0x7f74940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:17.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.919+0000 7f74b584e700 1 --2- 172.21.15.146:0/3870728642 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7494066f30 0x7f74940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:17.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.919+0000 7f74a5ffb700 1 -- 172.21.15.146:0/3870728642 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f74a0084140 con 0x7f74b00ca070 2023-10-06T11:15:17.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.920+0000 7f74b584e700 1 --2- 172.21.15.146:0/3870728642 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7494066f30 0x7f74940693e0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f74b00ce3f0 tx=0x7f74ac017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:17.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:17.924+0000 7f74a5ffb700 1 -- 172.21.15.146:0/3870728642 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f74a00512d0 con 0x7f74b00ca070 2023-10-06T11:15:18.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:18.100+0000 7f74b7ab2700 1 -- 172.21.15.146:0/3870728642 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f74b006bd10 con 0x7f7494066f30 2023-10-06T11:15:18.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:18.108+0000 7f74a5ffb700 1 -- 172.21.15.146:0/3870728642 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310639 (secure 0 0 0) 0x7f74b006bd10 con 0x7f7494066f30 2023-10-06T11:15:18.113 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:15:18.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:18.111+0000 7f74b7ab2700 1 -- 172.21.15.146:0/3870728642 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7494066f30 msgr2=0x7f74940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:18.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:18.111+0000 7f74b7ab2700 1 --2- 172.21.15.146:0/3870728642 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7494066f30 0x7f74940693e0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f74b00ce3f0 tx=0x7f74ac017000 comp rx=0 tx=0).stop 2023-10-06T11:15:18.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:18.111+0000 7f74b7ab2700 1 -- 172.21.15.146:0/3870728642 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74b00ca070 msgr2=0x7f74b016aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:18.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:18.111+0000 7f74b7ab2700 1 --2- 172.21.15.146:0/3870728642 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74b00ca070 0x7f74b016aab0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f74a000c7e0 tx=0x7f74a0007df0 comp rx=0 tx=0).stop 2023-10-06T11:15:18.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:18.111+0000 7f74b7ab2700 1 -- 172.21.15.146:0/3870728642 shutdown_connections 2023-10-06T11:15:18.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:18.111+0000 7f74b7ab2700 1 --2- 172.21.15.146:0/3870728642 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7494066f30 0x7f74940693e0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:18.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:18.111+0000 7f74b7ab2700 1 --2- 172.21.15.146:0/3870728642 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74b0157430 0x7f74b016aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:18.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:18.111+0000 7f74b7ab2700 1 --2- 172.21.15.146:0/3870728642 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74b00ab010 0x7f74b00c6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:18.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:18.111+0000 7f74b7ab2700 1 --2- 172.21.15.146:0/3870728642 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f74b00ca070 0x7f74b016aab0 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:18.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:18.111+0000 7f74b7ab2700 1 -- 172.21.15.146:0/3870728642 >> 172.21.15.146:0/3870728642 conn(0x7f74b0067c50 msgr2=0x7f74b00cb360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:18.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:18.112+0000 7f74b7ab2700 1 -- 172.21.15.146:0/3870728642 shutdown_connections 2023-10-06T11:15:18.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:18.112+0000 7f74b7ab2700 1 -- 172.21.15.146:0/3870728642 wait complete. 2023-10-06T11:15:18.117 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:15:18.125 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":408,"stamp":"2023-10-06T11:15:17.262531+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592050,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":182,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":158,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2461252,"kb_used_data":13316,"kb_used_omap":0,"kb_used_meta":2447872,"kb_avail":752513468,"statfs":{"total":773094113280,"available":770573791232,"internally_reserved":0,"allocated":13635584,"data_stored":6859423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2506620928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1682,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001139"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.552659+0000","last_change":"2023-10-06T11:15:12.549332+0000","last_active":"2023-10-06T11:15:12.552659+0000","last_peered":"2023-10-06T11:15:12.552659+0000","last_clean":"2023-10-06T11:15:12.552659+0000","last_became_active":"2023-10-06T11:15:12.549080+0000","last_became_peered":"2023-10-06T11:15:12.549080+0000","last_unstale":"2023-10-06T11:15:12.552659+0000","last_undegraded":"2023-10-06T11:15:12.552659+0000","last_fullsized":"2023-10-06T11:15:12.552659+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:24.341162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.563133+0000","last_change":"2023-10-06T11:15:12.556976+0000","last_active":"2023-10-06T11:15:12.563133+0000","last_peered":"2023-10-06T11:15:12.563133+0000","last_clean":"2023-10-06T11:15:12.563133+0000","last_became_active":"2023-10-06T11:15:12.556711+0000","last_became_peered":"2023-10-06T11:15:12.556711+0000","last_unstale":"2023-10-06T11:15:12.563133+0000","last_undegraded":"2023-10-06T11:15:12.563133+0000","last_fullsized":"2023-10-06T11:15:12.563133+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:12.927736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.548374+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:03:55.986977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.554968+0000","last_change":"2023-10-06T11:15:12.553917+0000","last_active":"2023-10-06T11:15:12.554968+0000","last_peered":"2023-10-06T11:15:12.554968+0000","last_clean":"2023-10-06T11:15:12.554968+0000","last_became_active":"2023-10-06T11:15:12.553584+0000","last_became_peered":"2023-10-06T11:15:12.553584+0000","last_unstale":"2023-10-06T11:15:12.554968+0000","last_undegraded":"2023-10-06T11:15:12.554968+0000","last_fullsized":"2023-10-06T11:15:12.554968+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:23:20.636047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.564171+0000","last_change":"2023-10-06T11:15:12.560638+0000","last_active":"2023-10-06T11:15:12.564171+0000","last_peered":"2023-10-06T11:15:12.564171+0000","last_clean":"2023-10-06T11:15:12.564171+0000","last_became_active":"2023-10-06T11:15:12.560214+0000","last_became_peered":"2023-10-06T11:15:12.560214+0000","last_unstale":"2023-10-06T11:15:12.564171+0000","last_undegraded":"2023-10-06T11:15:12.564171+0000","last_fullsized":"2023-10-06T11:15:12.564171+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:59:35.368760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.551608+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:25:18.441894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.568046+0000","last_change":"2023-10-06T11:15:12.563070+0000","last_active":"2023-10-06T11:15:12.568046+0000","last_peered":"2023-10-06T11:15:12.568046+0000","last_clean":"2023-10-06T11:15:12.568046+0000","last_became_active":"2023-10-06T11:15:12.562448+0000","last_became_peered":"2023-10-06T11:15:12.562448+0000","last_unstale":"2023-10-06T11:15:12.568046+0000","last_undegraded":"2023-10-06T11:15:12.568046+0000","last_fullsized":"2023-10-06T11:15:12.568046+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:25:09.868317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.545346+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:49:53.647910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.553845+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:35:58.009437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.560441+0000","last_change":"2023-10-06T11:15:12.557451+0000","last_active":"2023-10-06T11:15:12.560441+0000","last_peered":"2023-10-06T11:15:12.560441+0000","last_clean":"2023-10-06T11:15:12.560441+0000","last_became_active":"2023-10-06T11:15:12.557196+0000","last_became_peered":"2023-10-06T11:15:12.557196+0000","last_unstale":"2023-10-06T11:15:12.560441+0000","last_undegraded":"2023-10-06T11:15:12.560441+0000","last_fullsized":"2023-10-06T11:15:12.560441+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:04:15.796514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.563182+0000","last_change":"2023-10-06T11:15:12.555394+0000","last_active":"2023-10-06T11:15:12.563182+0000","last_peered":"2023-10-06T11:15:12.563182+0000","last_clean":"2023-10-06T11:15:12.563182+0000","last_became_active":"2023-10-06T11:15:12.555139+0000","last_became_peered":"2023-10-06T11:15:12.555139+0000","last_unstale":"2023-10-06T11:15:12.563182+0000","last_undegraded":"2023-10-06T11:15:12.563182+0000","last_fullsized":"2023-10-06T11:15:12.563182+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:14.774930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.556390+0000","last_change":"2023-10-06T11:15:12.550822+0000","last_active":"2023-10-06T11:15:12.556390+0000","last_peered":"2023-10-06T11:15:12.556390+0000","last_clean":"2023-10-06T11:15:12.556390+0000","last_became_active":"2023-10-06T11:15:12.550575+0000","last_became_peered":"2023-10-06T11:15:12.550575+0000","last_unstale":"2023-10-06T11:15:12.556390+0000","last_undegraded":"2023-10-06T11:15:12.556390+0000","last_fullsized":"2023-10-06T11:15:12.556390+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:57:48.775209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.545643+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:58:42.165232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.561017+0000","last_change":"2023-10-06T11:15:12.555280+0000","last_active":"2023-10-06T11:15:12.561017+0000","last_peered":"2023-10-06T11:15:12.561017+0000","last_clean":"2023-10-06T11:15:12.561017+0000","last_became_active":"2023-10-06T11:15:12.555040+0000","last_became_peered":"2023-10-06T11:15:12.555040+0000","last_unstale":"2023-10-06T11:15:12.561017+0000","last_undegraded":"2023-10-06T11:15:12.561017+0000","last_fullsized":"2023-10-06T11:15:12.561017+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:59:31.617255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.558104+0000","last_change":"2023-10-06T11:15:12.554601+0000","last_active":"2023-10-06T11:15:12.558104+0000","last_peered":"2023-10-06T11:15:12.558104+0000","last_clean":"2023-10-06T11:15:12.558104+0000","last_became_active":"2023-10-06T11:15:12.554376+0000","last_became_peered":"2023-10-06T11:15:12.554376+0000","last_unstale":"2023-10-06T11:15:12.558104+0000","last_undegraded":"2023-10-06T11:15:12.558104+0000","last_fullsized":"2023-10-06T11:15:12.558104+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:06:58.266176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.545611+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:51:27.969369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.551293+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:45:49.982194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.560708+0000","last_change":"2023-10-06T11:15:12.556018+0000","last_active":"2023-10-06T11:15:12.560708+0000","last_peered":"2023-10-06T11:15:12.560708+0000","last_clean":"2023-10-06T11:15:12.560708+0000","last_became_active":"2023-10-06T11:15:12.555750+0000","last_became_peered":"2023-10-06T11:15:12.555750+0000","last_unstale":"2023-10-06T11:15:12.560708+0000","last_undegraded":"2023-10-06T11:15:12.560708+0000","last_fullsized":"2023-10-06T11:15:12.560708+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:09:25.439474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.568555+0000","last_change":"2023-10-06T11:15:12.566859+0000","last_active":"2023-10-06T11:15:12.568555+0000","last_peered":"2023-10-06T11:15:12.568555+0000","last_clean":"2023-10-06T11:15:12.568555+0000","last_became_active":"2023-10-06T11:15:12.566559+0000","last_became_peered":"2023-10-06T11:15:12.566559+0000","last_unstale":"2023-10-06T11:15:12.568555+0000","last_undegraded":"2023-10-06T11:15:12.568555+0000","last_fullsized":"2023-10-06T11:15:12.568555+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:56:21.022912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.556172+0000","last_change":"2023-10-06T11:15:12.553202+0000","last_active":"2023-10-06T11:15:12.556172+0000","last_peered":"2023-10-06T11:15:12.556172+0000","last_clean":"2023-10-06T11:15:12.556172+0000","last_became_active":"2023-10-06T11:15:12.552964+0000","last_became_peered":"2023-10-06T11:15:12.552964+0000","last_unstale":"2023-10-06T11:15:12.556172+0000","last_undegraded":"2023-10-06T11:15:12.556172+0000","last_fullsized":"2023-10-06T11:15:12.556172+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:25:09.868317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.564402+0000","last_change":"2023-10-06T11:15:12.561867+0000","last_active":"2023-10-06T11:15:12.564402+0000","last_peered":"2023-10-06T11:15:12.564402+0000","last_clean":"2023-10-06T11:15:12.564402+0000","last_became_active":"2023-10-06T11:15:12.561621+0000","last_became_peered":"2023-10-06T11:15:12.561621+0000","last_unstale":"2023-10-06T11:15:12.564402+0000","last_undegraded":"2023-10-06T11:15:12.564402+0000","last_fullsized":"2023-10-06T11:15:12.564402+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:33:57.627561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.561038+0000","last_change":"2023-10-06T11:15:12.556434+0000","last_active":"2023-10-06T11:15:12.561038+0000","last_peered":"2023-10-06T11:15:12.561038+0000","last_clean":"2023-10-06T11:15:12.561038+0000","last_became_active":"2023-10-06T11:15:12.556084+0000","last_became_peered":"2023-10-06T11:15:12.556084+0000","last_unstale":"2023-10-06T11:15:12.561038+0000","last_undegraded":"2023-10-06T11:15:12.561038+0000","last_fullsized":"2023-10-06T11:15:12.561038+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:13:03.552426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.563099+0000","last_change":"2023-10-06T11:15:12.558929+0000","last_active":"2023-10-06T11:15:12.563099+0000","last_peered":"2023-10-06T11:15:12.563099+0000","last_clean":"2023-10-06T11:15:12.563099+0000","last_became_active":"2023-10-06T11:15:12.558672+0000","last_became_peered":"2023-10-06T11:15:12.558672+0000","last_unstale":"2023-10-06T11:15:12.563099+0000","last_undegraded":"2023-10-06T11:15:12.563099+0000","last_fullsized":"2023-10-06T11:15:12.563099+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:36.864990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.554183+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:33:57.627561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.549474+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:19:29.875101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.549075+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:14:08.040389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.567611+0000","last_change":"2023-10-06T11:15:12.561938+0000","last_active":"2023-10-06T11:15:12.567611+0000","last_peered":"2023-10-06T11:15:12.567611+0000","last_clean":"2023-10-06T11:15:12.567611+0000","last_became_active":"2023-10-06T11:15:12.561689+0000","last_became_peered":"2023-10-06T11:15:12.561689+0000","last_unstale":"2023-10-06T11:15:12.567611+0000","last_undegraded":"2023-10-06T11:15:12.567611+0000","last_fullsized":"2023-10-06T11:15:12.567611+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:32:37.458835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.556345+0000","last_change":"2023-10-06T11:15:12.554453+0000","last_active":"2023-10-06T11:15:12.556345+0000","last_peered":"2023-10-06T11:15:12.556345+0000","last_clean":"2023-10-06T11:15:12.556345+0000","last_became_active":"2023-10-06T11:15:12.554219+0000","last_became_peered":"2023-10-06T11:15:12.554219+0000","last_unstale":"2023-10-06T11:15:12.556345+0000","last_undegraded":"2023-10-06T11:15:12.556345+0000","last_fullsized":"2023-10-06T11:15:12.556345+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:21:45.309284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.550511+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:06.278594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.549144+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:16:46.194765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.544258+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:33:57.627561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.562828+0000","last_change":"2023-10-06T11:15:12.561924+0000","last_active":"2023-10-06T11:15:12.562828+0000","last_peered":"2023-10-06T11:15:12.562828+0000","last_clean":"2023-10-06T11:15:12.562828+0000","last_became_active":"2023-10-06T11:15:12.561662+0000","last_became_peered":"2023-10-06T11:15:12.561662+0000","last_unstale":"2023-10-06T11:15:12.562828+0000","last_undegraded":"2023-10-06T11:15:12.562828+0000","last_fullsized":"2023-10-06T11:15:12.562828+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:52:03.889787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.544863+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:14.774930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.615827+0000","last_change":"2023-10-06T11:15:11.615827+0000","last_active":"2023-10-06T11:15:11.615827+0000","last_peered":"2023-10-06T11:15:11.615827+0000","last_clean":"2023-10-06T11:15:11.615827+0000","last_became_active":"2023-10-06T11:15:11.615550+0000","last_became_peered":"2023-10-06T11:15:11.615550+0000","last_unstale":"2023-10-06T11:15:11.615827+0000","last_undegraded":"2023-10-06T11:15:11.615827+0000","last_fullsized":"2023-10-06T11:15:11.615827+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:12:08.245890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.560926+0000","last_change":"2023-10-06T11:15:12.556304+0000","last_active":"2023-10-06T11:15:12.560926+0000","last_peered":"2023-10-06T11:15:12.560926+0000","last_clean":"2023-10-06T11:15:12.560926+0000","last_became_active":"2023-10-06T11:15:12.556046+0000","last_became_peered":"2023-10-06T11:15:12.556046+0000","last_unstale":"2023-10-06T11:15:12.560926+0000","last_undegraded":"2023-10-06T11:15:12.560926+0000","last_fullsized":"2023-10-06T11:15:12.560926+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:24.253441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"124'1","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.564654+0000","last_change":"2023-10-06T11:15:11.557353+0000","last_active":"2023-10-06T11:15:12.564654+0000","last_peered":"2023-10-06T11:15:12.564654+0000","last_clean":"2023-10-06T11:15:12.564654+0000","last_became_active":"2023-10-06T11:15:11.557113+0000","last_became_peered":"2023-10-06T11:15:11.557113+0000","last_unstale":"2023-10-06T11:15:12.564654+0000","last_undegraded":"2023-10-06T11:15:12.564654+0000","last_fullsized":"2023-10-06T11:15:12.564654+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:33:56.619203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.563158+0000","last_change":"2023-10-06T11:15:12.560179+0000","last_active":"2023-10-06T11:15:12.563158+0000","last_peered":"2023-10-06T11:15:12.563158+0000","last_clean":"2023-10-06T11:15:12.563158+0000","last_became_active":"2023-10-06T11:15:12.559930+0000","last_became_peered":"2023-10-06T11:15:12.559930+0000","last_unstale":"2023-10-06T11:15:12.563158+0000","last_undegraded":"2023-10-06T11:15:12.563158+0000","last_fullsized":"2023-10-06T11:15:12.563158+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:57:36.426307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"124'2","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.570451+0000","last_change":"2023-10-06T11:15:11.560104+0000","last_active":"2023-10-06T11:15:12.570451+0000","last_peered":"2023-10-06T11:15:12.570451+0000","last_clean":"2023-10-06T11:15:12.570451+0000","last_became_active":"2023-10-06T11:15:11.559818+0000","last_became_peered":"2023-10-06T11:15:11.559818+0000","last_unstale":"2023-10-06T11:15:12.570451+0000","last_undegraded":"2023-10-06T11:15:12.570451+0000","last_fullsized":"2023-10-06T11:15:12.570451+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:42:27.505992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.558045+0000","last_change":"2023-10-06T11:15:12.554784+0000","last_active":"2023-10-06T11:15:12.558045+0000","last_peered":"2023-10-06T11:15:12.558045+0000","last_clean":"2023-10-06T11:15:12.558045+0000","last_became_active":"2023-10-06T11:15:12.554499+0000","last_became_peered":"2023-10-06T11:15:12.554499+0000","last_unstale":"2023-10-06T11:15:12.558045+0000","last_undegraded":"2023-10-06T11:15:12.558045+0000","last_fullsized":"2023-10-06T11:15:12.558045+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:25:23.586837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"124'2","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.569295+0000","last_change":"2023-10-06T11:15:11.558478+0000","last_active":"2023-10-06T11:15:12.569295+0000","last_peered":"2023-10-06T11:15:12.569295+0000","last_clean":"2023-10-06T11:15:12.569295+0000","last_became_active":"2023-10-06T11:15:11.558217+0000","last_became_peered":"2023-10-06T11:15:11.558217+0000","last_unstale":"2023-10-06T11:15:12.569295+0000","last_undegraded":"2023-10-06T11:15:12.569295+0000","last_fullsized":"2023-10-06T11:15:12.569295+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:57:35.417949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.544806+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:42:28.514350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.555437+0000","last_change":"2023-10-06T11:15:11.555437+0000","last_active":"2023-10-06T11:15:11.555437+0000","last_peered":"2023-10-06T11:15:11.555437+0000","last_clean":"2023-10-06T11:15:11.555437+0000","last_became_active":"2023-10-06T11:15:11.555188+0000","last_became_peered":"2023-10-06T11:15:11.555188+0000","last_unstale":"2023-10-06T11:15:11.555437+0000","last_undegraded":"2023-10-06T11:15:11.555437+0000","last_fullsized":"2023-10-06T11:15:11.555437+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:35.856632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.545719+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:42:08.749955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"124'1","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.565269+0000","last_change":"2023-10-06T11:15:11.550069+0000","last_active":"2023-10-06T11:15:12.565269+0000","last_peered":"2023-10-06T11:15:12.565269+0000","last_clean":"2023-10-06T11:15:12.565269+0000","last_became_active":"2023-10-06T11:15:11.549745+0000","last_became_peered":"2023-10-06T11:15:11.549745+0000","last_unstale":"2023-10-06T11:15:12.565269+0000","last_undegraded":"2023-10-06T11:15:12.565269+0000","last_fullsized":"2023-10-06T11:15:12.565269+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:13.766571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.560434+0000","last_change":"2023-10-06T11:15:12.554531+0000","last_active":"2023-10-06T11:15:12.560434+0000","last_peered":"2023-10-06T11:15:12.560434+0000","last_clean":"2023-10-06T11:15:12.560434+0000","last_became_active":"2023-10-06T11:15:12.554264+0000","last_became_peered":"2023-10-06T11:15:12.554264+0000","last_unstale":"2023-10-06T11:15:12.560434+0000","last_undegraded":"2023-10-06T11:15:12.560434+0000","last_fullsized":"2023-10-06T11:15:12.560434+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:20.499128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.555398+0000","last_change":"2023-10-06T11:15:11.555398+0000","last_active":"2023-10-06T11:15:11.555398+0000","last_peered":"2023-10-06T11:15:11.555398+0000","last_clean":"2023-10-06T11:15:11.555398+0000","last_became_active":"2023-10-06T11:15:11.555097+0000","last_became_peered":"2023-10-06T11:15:11.555097+0000","last_unstale":"2023-10-06T11:15:11.555398+0000","last_undegraded":"2023-10-06T11:15:11.555398+0000","last_fullsized":"2023-10-06T11:15:11.555398+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:19:28.866743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.567704+0000","last_change":"2023-10-06T11:15:12.562196+0000","last_active":"2023-10-06T11:15:12.567704+0000","last_peered":"2023-10-06T11:15:12.567704+0000","last_clean":"2023-10-06T11:15:12.567704+0000","last_became_active":"2023-10-06T11:15:12.561903+0000","last_became_peered":"2023-10-06T11:15:12.561903+0000","last_unstale":"2023-10-06T11:15:12.567704+0000","last_undegraded":"2023-10-06T11:15:12.567704+0000","last_fullsized":"2023-10-06T11:15:12.567704+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:08:23.845610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.615898+0000","last_change":"2023-10-06T11:15:11.615898+0000","last_active":"2023-10-06T11:15:11.615898+0000","last_peered":"2023-10-06T11:15:11.615898+0000","last_clean":"2023-10-06T11:15:11.615898+0000","last_became_active":"2023-10-06T11:15:11.615593+0000","last_became_peered":"2023-10-06T11:15:11.615593+0000","last_unstale":"2023-10-06T11:15:11.615898+0000","last_undegraded":"2023-10-06T11:15:11.615898+0000","last_fullsized":"2023-10-06T11:15:11.615898+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:31:06.545416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.548277+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:41:04.347350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"124'1","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.565991+0000","last_change":"2023-10-06T11:15:11.555759+0000","last_active":"2023-10-06T11:15:12.565991+0000","last_peered":"2023-10-06T11:15:12.565991+0000","last_clean":"2023-10-06T11:15:12.565991+0000","last_became_active":"2023-10-06T11:15:11.555515+0000","last_became_peered":"2023-10-06T11:15:11.555515+0000","last_unstale":"2023-10-06T11:15:12.565991+0000","last_undegraded":"2023-10-06T11:15:12.565991+0000","last_fullsized":"2023-10-06T11:15:12.565991+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:26.937119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.567123+0000","last_change":"2023-10-06T11:15:12.556067+0000","last_active":"2023-10-06T11:15:12.567123+0000","last_peered":"2023-10-06T11:15:12.567123+0000","last_clean":"2023-10-06T11:15:12.567123+0000","last_became_active":"2023-10-06T11:15:12.555819+0000","last_became_peered":"2023-10-06T11:15:12.555819+0000","last_unstale":"2023-10-06T11:15:12.567123+0000","last_undegraded":"2023-10-06T11:15:12.567123+0000","last_fullsized":"2023-10-06T11:15:12.567123+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:31:53.456266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.615617+0000","last_change":"2023-10-06T11:15:11.615617+0000","last_active":"2023-10-06T11:15:11.615617+0000","last_peered":"2023-10-06T11:15:11.615617+0000","last_clean":"2023-10-06T11:15:11.615617+0000","last_became_active":"2023-10-06T11:15:11.615338+0000","last_became_peered":"2023-10-06T11:15:11.615338+0000","last_unstale":"2023-10-06T11:15:11.615617+0000","last_undegraded":"2023-10-06T11:15:11.615617+0000","last_fullsized":"2023-10-06T11:15:11.615617+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:14:50.760693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.567937+0000","last_change":"2023-10-06T11:15:12.563592+0000","last_active":"2023-10-06T11:15:12.567937+0000","last_peered":"2023-10-06T11:15:12.567937+0000","last_clean":"2023-10-06T11:15:12.567937+0000","last_became_active":"2023-10-06T11:15:12.562607+0000","last_became_peered":"2023-10-06T11:15:12.562607+0000","last_unstale":"2023-10-06T11:15:12.567937+0000","last_undegraded":"2023-10-06T11:15:12.567937+0000","last_fullsized":"2023-10-06T11:15:12.567937+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:20.499128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.555479+0000","last_change":"2023-10-06T11:15:11.555479+0000","last_active":"2023-10-06T11:15:11.555479+0000","last_peered":"2023-10-06T11:15:11.555479+0000","last_clean":"2023-10-06T11:15:11.555479+0000","last_became_active":"2023-10-06T11:15:11.553333+0000","last_became_peered":"2023-10-06T11:15:11.553333+0000","last_unstale":"2023-10-06T11:15:11.555479+0000","last_undegraded":"2023-10-06T11:15:11.555479+0000","last_fullsized":"2023-10-06T11:15:11.555479+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:14:07.032030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.562902+0000","last_change":"2023-10-06T11:15:12.560178+0000","last_active":"2023-10-06T11:15:12.562902+0000","last_peered":"2023-10-06T11:15:12.562902+0000","last_clean":"2023-10-06T11:15:12.562902+0000","last_became_active":"2023-10-06T11:15:12.559886+0000","last_became_peered":"2023-10-06T11:15:12.559886+0000","last_unstale":"2023-10-06T11:15:12.562902+0000","last_undegraded":"2023-10-06T11:15:12.562902+0000","last_fullsized":"2023-10-06T11:15:12.562902+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:43:09.220052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.547263+0000","last_change":"2023-10-06T11:15:11.614773+0000","last_active":"2023-10-06T11:15:12.547263+0000","last_peered":"2023-10-06T11:15:12.547263+0000","last_clean":"2023-10-06T11:15:12.547263+0000","last_became_active":"2023-10-06T11:15:11.614494+0000","last_became_peered":"2023-10-06T11:15:11.614494+0000","last_unstale":"2023-10-06T11:15:12.547263+0000","last_undegraded":"2023-10-06T11:15:12.547263+0000","last_fullsized":"2023-10-06T11:15:12.547263+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:42:27.505992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.560715+0000","last_change":"2023-10-06T11:15:12.556066+0000","last_active":"2023-10-06T11:15:12.560715+0000","last_peered":"2023-10-06T11:15:12.560715+0000","last_clean":"2023-10-06T11:15:12.560715+0000","last_became_active":"2023-10-06T11:15:12.555821+0000","last_became_peered":"2023-10-06T11:15:12.555821+0000","last_unstale":"2023-10-06T11:15:12.560715+0000","last_undegraded":"2023-10-06T11:15:12.560715+0000","last_fullsized":"2023-10-06T11:15:12.560715+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:01:51.130934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.553701+0000","last_change":"2023-10-06T11:15:11.553701+0000","last_active":"2023-10-06T11:15:11.553701+0000","last_peered":"2023-10-06T11:15:11.553701+0000","last_clean":"2023-10-06T11:15:11.553701+0000","last_became_active":"2023-10-06T11:15:11.553429+0000","last_became_peered":"2023-10-06T11:15:11.553429+0000","last_unstale":"2023-10-06T11:15:11.553701+0000","last_undegraded":"2023-10-06T11:15:11.553701+0000","last_fullsized":"2023-10-06T11:15:11.553701+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:11.919378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.558046+0000","last_change":"2023-10-06T11:15:12.554583+0000","last_active":"2023-10-06T11:15:12.558046+0000","last_peered":"2023-10-06T11:15:12.558046+0000","last_clean":"2023-10-06T11:15:12.558046+0000","last_became_active":"2023-10-06T11:15:12.554321+0000","last_became_peered":"2023-10-06T11:15:12.554321+0000","last_unstale":"2023-10-06T11:15:12.558046+0000","last_undegraded":"2023-10-06T11:15:12.558046+0000","last_fullsized":"2023-10-06T11:15:12.558046+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:09:31.438514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.546072+0000","last_change":"2023-10-06T11:15:11.613844+0000","last_active":"2023-10-06T11:15:12.546072+0000","last_peered":"2023-10-06T11:15:12.546072+0000","last_clean":"2023-10-06T11:15:12.546072+0000","last_became_active":"2023-10-06T11:15:11.611782+0000","last_became_peered":"2023-10-06T11:15:11.611782+0000","last_unstale":"2023-10-06T11:15:12.546072+0000","last_undegraded":"2023-10-06T11:15:12.546072+0000","last_fullsized":"2023-10-06T11:15:12.546072+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:33:26.797503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.560453+0000","last_change":"2023-10-06T11:15:12.555068+0000","last_active":"2023-10-06T11:15:12.560453+0000","last_peered":"2023-10-06T11:15:12.560453+0000","last_clean":"2023-10-06T11:15:12.560453+0000","last_became_active":"2023-10-06T11:15:12.554808+0000","last_became_peered":"2023-10-06T11:15:12.554808+0000","last_unstale":"2023-10-06T11:15:12.560453+0000","last_undegraded":"2023-10-06T11:15:12.560453+0000","last_fullsized":"2023-10-06T11:15:12.560453+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:32:37.458835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.550759+0000","last_change":"2023-10-06T11:15:11.616271+0000","last_active":"2023-10-06T11:15:12.550759+0000","last_peered":"2023-10-06T11:15:12.550759+0000","last_clean":"2023-10-06T11:15:12.550759+0000","last_became_active":"2023-10-06T11:15:11.615995+0000","last_became_peered":"2023-10-06T11:15:11.615995+0000","last_unstale":"2023-10-06T11:15:12.550759+0000","last_undegraded":"2023-10-06T11:15:12.550759+0000","last_fullsized":"2023-10-06T11:15:12.550759+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:11.919378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.564488+0000","last_change":"2023-10-06T11:15:12.561508+0000","last_active":"2023-10-06T11:15:12.564488+0000","last_peered":"2023-10-06T11:15:12.564488+0000","last_clean":"2023-10-06T11:15:12.564488+0000","last_became_active":"2023-10-06T11:15:12.561218+0000","last_became_peered":"2023-10-06T11:15:12.561218+0000","last_unstale":"2023-10-06T11:15:12.564488+0000","last_undegraded":"2023-10-06T11:15:12.564488+0000","last_fullsized":"2023-10-06T11:15:12.564488+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:42:28.514350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.556382+0000","last_change":"2023-10-06T11:15:11.556382+0000","last_active":"2023-10-06T11:15:11.556382+0000","last_peered":"2023-10-06T11:15:11.556382+0000","last_clean":"2023-10-06T11:15:11.556382+0000","last_became_active":"2023-10-06T11:15:11.556112+0000","last_became_peered":"2023-10-06T11:15:11.556112+0000","last_unstale":"2023-10-06T11:15:11.556382+0000","last_undegraded":"2023-10-06T11:15:11.556382+0000","last_fullsized":"2023-10-06T11:15:11.556382+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:16:45.186406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.562131+0000","last_change":"2023-10-06T11:15:12.559696+0000","last_active":"2023-10-06T11:15:12.562131+0000","last_peered":"2023-10-06T11:15:12.562131+0000","last_clean":"2023-10-06T11:15:12.562131+0000","last_became_active":"2023-10-06T11:15:12.559240+0000","last_became_peered":"2023-10-06T11:15:12.559240+0000","last_unstale":"2023-10-06T11:15:12.562131+0000","last_undegraded":"2023-10-06T11:15:12.562131+0000","last_fullsized":"2023-10-06T11:15:12.562131+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:45:30.113928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"124'2","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.569892+0000","last_change":"2023-10-06T11:15:11.615013+0000","last_active":"2023-10-06T11:15:12.569892+0000","last_peered":"2023-10-06T11:15:12.569892+0000","last_clean":"2023-10-06T11:15:12.569892+0000","last_became_active":"2023-10-06T11:15:11.614364+0000","last_became_peered":"2023-10-06T11:15:11.614364+0000","last_unstale":"2023-10-06T11:15:12.569892+0000","last_undegraded":"2023-10-06T11:15:12.569892+0000","last_fullsized":"2023-10-06T11:15:12.569892+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:44.091039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.548722+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:12:17.067365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.557279+0000","last_change":"2023-10-06T11:15:11.557279+0000","last_active":"2023-10-06T11:15:11.557279+0000","last_peered":"2023-10-06T11:15:11.557279+0000","last_clean":"2023-10-06T11:15:11.557279+0000","last_became_active":"2023-10-06T11:15:11.556969+0000","last_became_peered":"2023-10-06T11:15:11.556969+0000","last_unstale":"2023-10-06T11:15:11.557279+0000","last_undegraded":"2023-10-06T11:15:11.557279+0000","last_fullsized":"2023-10-06T11:15:11.557279+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:35:57.001079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.567096+0000","last_change":"2023-10-06T11:15:12.559496+0000","last_active":"2023-10-06T11:15:12.567096+0000","last_peered":"2023-10-06T11:15:12.567096+0000","last_clean":"2023-10-06T11:15:12.567096+0000","last_became_active":"2023-10-06T11:15:12.558184+0000","last_became_peered":"2023-10-06T11:15:12.558184+0000","last_unstale":"2023-10-06T11:15:12.567096+0000","last_undegraded":"2023-10-06T11:15:12.567096+0000","last_fullsized":"2023-10-06T11:15:12.567096+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:45:30.113928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.615736+0000","last_change":"2023-10-06T11:15:11.615736+0000","last_active":"2023-10-06T11:15:11.615736+0000","last_peered":"2023-10-06T11:15:11.615736+0000","last_clean":"2023-10-06T11:15:11.615736+0000","last_became_active":"2023-10-06T11:15:11.615436+0000","last_became_peered":"2023-10-06T11:15:11.615436+0000","last_unstale":"2023-10-06T11:15:11.615736+0000","last_undegraded":"2023-10-06T11:15:11.615736+0000","last_fullsized":"2023-10-06T11:15:11.615736+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:25:17.433536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.560267+0000","last_change":"2023-10-06T11:15:12.555337+0000","last_active":"2023-10-06T11:15:12.560267+0000","last_peered":"2023-10-06T11:15:12.560267+0000","last_clean":"2023-10-06T11:15:12.560267+0000","last_became_active":"2023-10-06T11:15:12.555085+0000","last_became_peered":"2023-10-06T11:15:12.555085+0000","last_unstale":"2023-10-06T11:15:12.560267+0000","last_undegraded":"2023-10-06T11:15:12.560267+0000","last_fullsized":"2023-10-06T11:15:12.560267+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:33:10.885181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.559110+0000","last_change":"2023-10-06T11:15:11.559110+0000","last_active":"2023-10-06T11:15:11.559110+0000","last_peered":"2023-10-06T11:15:11.559110+0000","last_clean":"2023-10-06T11:15:11.559110+0000","last_became_active":"2023-10-06T11:15:11.558912+0000","last_became_peered":"2023-10-06T11:15:11.558912+0000","last_unstale":"2023-10-06T11:15:11.559110+0000","last_undegraded":"2023-10-06T11:15:11.559110+0000","last_fullsized":"2023-10-06T11:15:11.559110+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:06.108506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.551355+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:59:48.066554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.545507+0000","last_change":"2023-10-06T11:15:11.615843+0000","last_active":"2023-10-06T11:15:12.545507+0000","last_peered":"2023-10-06T11:15:12.545507+0000","last_clean":"2023-10-06T11:15:12.545507+0000","last_became_active":"2023-10-06T11:15:11.615583+0000","last_became_peered":"2023-10-06T11:15:11.615583+0000","last_unstale":"2023-10-06T11:15:12.545507+0000","last_undegraded":"2023-10-06T11:15:12.545507+0000","last_fullsized":"2023-10-06T11:15:12.545507+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:06.108506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.551860+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:30:37.212830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.550406+0000","last_change":"2023-10-06T11:15:11.558367+0000","last_active":"2023-10-06T11:15:12.550406+0000","last_peered":"2023-10-06T11:15:12.550406+0000","last_clean":"2023-10-06T11:15:12.550406+0000","last_became_active":"2023-10-06T11:15:11.558080+0000","last_became_peered":"2023-10-06T11:15:11.558080+0000","last_unstale":"2023-10-06T11:15:12.550406+0000","last_undegraded":"2023-10-06T11:15:12.550406+0000","last_fullsized":"2023-10-06T11:15:12.550406+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:23:19.627689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.553099+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:36.864990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.557480+0000","last_change":"2023-10-06T11:15:11.557480+0000","last_active":"2023-10-06T11:15:11.557480+0000","last_peered":"2023-10-06T11:15:11.557480+0000","last_clean":"2023-10-06T11:15:11.557480+0000","last_became_active":"2023-10-06T11:15:11.557275+0000","last_became_peered":"2023-10-06T11:15:11.557275+0000","last_unstale":"2023-10-06T11:15:11.557480+0000","last_undegraded":"2023-10-06T11:15:11.557480+0000","last_fullsized":"2023-10-06T11:15:11.557480+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:05.270236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.567817+0000","last_change":"2023-10-06T11:15:12.563042+0000","last_active":"2023-10-06T11:15:12.567817+0000","last_peered":"2023-10-06T11:15:12.567817+0000","last_clean":"2023-10-06T11:15:12.567817+0000","last_became_active":"2023-10-06T11:15:12.562720+0000","last_became_peered":"2023-10-06T11:15:12.562720+0000","last_unstale":"2023-10-06T11:15:12.567817+0000","last_undegraded":"2023-10-06T11:15:12.567817+0000","last_fullsized":"2023-10-06T11:15:12.567817+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:01:51.130934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.547145+0000","last_change":"2023-10-06T11:15:11.613556+0000","last_active":"2023-10-06T11:15:12.547145+0000","last_peered":"2023-10-06T11:15:12.547145+0000","last_clean":"2023-10-06T11:15:12.547145+0000","last_became_active":"2023-10-06T11:15:11.558706+0000","last_became_peered":"2023-10-06T11:15:11.558706+0000","last_unstale":"2023-10-06T11:15:12.547145+0000","last_undegraded":"2023-10-06T11:15:12.547145+0000","last_fullsized":"2023-10-06T11:15:12.547145+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:35.856632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.564356+0000","last_change":"2023-10-06T11:15:12.561897+0000","last_active":"2023-10-06T11:15:12.564356+0000","last_peered":"2023-10-06T11:15:12.564356+0000","last_clean":"2023-10-06T11:15:12.564356+0000","last_became_active":"2023-10-06T11:15:12.561644+0000","last_became_peered":"2023-10-06T11:15:12.561644+0000","last_unstale":"2023-10-06T11:15:12.564356+0000","last_undegraded":"2023-10-06T11:15:12.564356+0000","last_fullsized":"2023-10-06T11:15:12.564356+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:46.655508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.544963+0000","last_change":"2023-10-06T11:15:11.553743+0000","last_active":"2023-10-06T11:15:12.544963+0000","last_peered":"2023-10-06T11:15:12.544963+0000","last_clean":"2023-10-06T11:15:12.544963+0000","last_became_active":"2023-10-06T11:15:11.553490+0000","last_became_peered":"2023-10-06T11:15:11.553490+0000","last_unstale":"2023-10-06T11:15:12.544963+0000","last_undegraded":"2023-10-06T11:15:12.544963+0000","last_fullsized":"2023-10-06T11:15:12.544963+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:05.270236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":108,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-06T11:15:10.541325+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:15:10.541325+0000","last_peered":"2023-10-06T11:15:10.541325+0000","last_clean":"2023-10-06T11:15:10.541325+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:15:10.541325+0000","last_undegraded":"2023-10-06T11:15:10.541325+0000","last_fullsized":"2023-10-06T11:15:10.541325+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.551327+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:40.228447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.547594+0000","last_change":"2023-10-06T11:15:11.614069+0000","last_active":"2023-10-06T11:15:12.547594+0000","last_peered":"2023-10-06T11:15:12.547594+0000","last_clean":"2023-10-06T11:15:12.547594+0000","last_became_active":"2023-10-06T11:15:11.613023+0000","last_became_peered":"2023-10-06T11:15:11.613023+0000","last_unstale":"2023-10-06T11:15:12.547594+0000","last_undegraded":"2023-10-06T11:15:12.547594+0000","last_fullsized":"2023-10-06T11:15:12.547594+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:00:36.479436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":101,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.547352+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:15:12.547352+0000","last_peered":"2023-10-06T11:15:12.547352+0000","last_clean":"2023-10-06T11:15:12.547352+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:15:12.547352+0000","last_undegraded":"2023-10-06T11:15:12.547352+0000","last_fullsized":"2023-10-06T11:15:12.547352+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.566949+0000","last_change":"2023-10-06T11:15:12.557454+0000","last_active":"2023-10-06T11:15:12.566949+0000","last_peered":"2023-10-06T11:15:12.566949+0000","last_clean":"2023-10-06T11:15:12.566949+0000","last_became_active":"2023-10-06T11:15:12.557183+0000","last_became_peered":"2023-10-06T11:15:12.557183+0000","last_unstale":"2023-10-06T11:15:12.566949+0000","last_undegraded":"2023-10-06T11:15:12.566949+0000","last_fullsized":"2023-10-06T11:15:12.566949+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:09:25.439474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.557485+0000","last_change":"2023-10-06T11:15:11.557485+0000","last_active":"2023-10-06T11:15:11.557485+0000","last_peered":"2023-10-06T11:15:11.557485+0000","last_clean":"2023-10-06T11:15:11.557485+0000","last_became_active":"2023-10-06T11:15:11.556885+0000","last_became_peered":"2023-10-06T11:15:11.556885+0000","last_unstale":"2023-10-06T11:15:11.557485+0000","last_undegraded":"2023-10-06T11:15:11.557485+0000","last_fullsized":"2023-10-06T11:15:11.557485+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:04:48.873690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":98,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-06T11:15:10.657847+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:15:10.657847+0000","last_peered":"2023-10-06T11:15:10.657847+0000","last_clean":"2023-10-06T11:15:10.657847+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:15:10.657847+0000","last_undegraded":"2023-10-06T11:15:10.657847+0000","last_fullsized":"2023-10-06T11:15:10.657847+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":244,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.548590+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:15:12.548590+0000","last_peered":"2023-10-06T11:15:12.548590+0000","last_clean":"2023-10-06T11:15:12.548590+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:15:12.548590+0000","last_undegraded":"2023-10-06T11:15:12.548590+0000","last_fullsized":"2023-10-06T11:15:12.548590+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.552554+0000","last_change":"2023-10-06T11:15:12.549973+0000","last_active":"2023-10-06T11:15:12.552554+0000","last_peered":"2023-10-06T11:15:12.552554+0000","last_clean":"2023-10-06T11:15:12.552554+0000","last_became_active":"2023-10-06T11:15:12.549720+0000","last_became_peered":"2023-10-06T11:15:12.549720+0000","last_unstale":"2023-10-06T11:15:12.552554+0000","last_undegraded":"2023-10-06T11:15:12.552554+0000","last_fullsized":"2023-10-06T11:15:12.552554+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:56:21.022912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":8,"reported_epoch":123,"state":"active+clean","last_fresh":"2023-10-06T11:15:11.562606+0000","last_change":"2023-10-06T11:15:11.562606+0000","last_active":"2023-10-06T11:15:11.562606+0000","last_peered":"2023-10-06T11:15:11.562606+0000","last_clean":"2023-10-06T11:15:11.562606+0000","last_became_active":"2023-10-06T11:15:11.562331+0000","last_became_peered":"2023-10-06T11:15:11.562331+0000","last_unstale":"2023-10-06T11:15:11.562606+0000","last_undegraded":"2023-10-06T11:15:11.562606+0000","last_fullsized":"2023-10-06T11:15:11.562606+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:26.937119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":94,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.550300+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:15:12.550300+0000","last_peered":"2023-10-06T11:15:12.550300+0000","last_clean":"2023-10-06T11:15:12.550300+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:15:12.550300+0000","last_undegraded":"2023-10-06T11:15:12.550300+0000","last_fullsized":"2023-10-06T11:15:12.550300+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.555020+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:07.116865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.550473+0000","last_change":"2023-10-06T11:15:11.616871+0000","last_active":"2023-10-06T11:15:12.550473+0000","last_peered":"2023-10-06T11:15:12.550473+0000","last_clean":"2023-10-06T11:15:12.550473+0000","last_became_active":"2023-10-06T11:15:11.616308+0000","last_became_peered":"2023-10-06T11:15:11.616308+0000","last_unstale":"2023-10-06T11:15:12.550473+0000","last_undegraded":"2023-10-06T11:15:12.550473+0000","last_fullsized":"2023-10-06T11:15:12.550473+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:33:56.619203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":94,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.548669+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:15:12.548669+0000","last_peered":"2023-10-06T11:15:12.548669+0000","last_clean":"2023-10-06T11:15:12.548669+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:15:12.548669+0000","last_undegraded":"2023-10-06T11:15:12.548669+0000","last_fullsized":"2023-10-06T11:15:12.548669+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.555380+0000","last_change":"2023-10-06T11:15:12.552483+0000","last_active":"2023-10-06T11:15:12.555380+0000","last_peered":"2023-10-06T11:15:12.555380+0000","last_clean":"2023-10-06T11:15:12.555380+0000","last_became_active":"2023-10-06T11:15:12.552230+0000","last_became_peered":"2023-10-06T11:15:12.552230+0000","last_unstale":"2023-10-06T11:15:12.555380+0000","last_undegraded":"2023-10-06T11:15:12.555380+0000","last_fullsized":"2023-10-06T11:15:12.555380+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:45:25.285981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"124'2","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.565208+0000","last_change":"2023-10-06T11:15:11.612981+0000","last_active":"2023-10-06T11:15:12.565208+0000","last_peered":"2023-10-06T11:15:12.565208+0000","last_clean":"2023-10-06T11:15:12.565208+0000","last_became_active":"2023-10-06T11:15:11.612693+0000","last_became_peered":"2023-10-06T11:15:11.612693+0000","last_unstale":"2023-10-06T11:15:12.565208+0000","last_undegraded":"2023-10-06T11:15:12.565208+0000","last_fullsized":"2023-10-06T11:15:12.565208+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:37.193218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":114,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.544242+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:15:12.544242+0000","last_peered":"2023-10-06T11:15:12.544242+0000","last_clean":"2023-10-06T11:15:12.544242+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:15:12.544242+0000","last_undegraded":"2023-10-06T11:15:12.544242+0000","last_fullsized":"2023-10-06T11:15:12.544242+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.550124+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:27.945477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"124'6","reported_seq":16,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.574922+0000","last_change":"2023-10-06T11:15:11.616053+0000","last_active":"2023-10-06T11:15:12.574922+0000","last_peered":"2023-10-06T11:15:12.574922+0000","last_clean":"2023-10-06T11:15:12.574922+0000","last_became_active":"2023-10-06T11:15:11.615774+0000","last_became_peered":"2023-10-06T11:15:11.615774+0000","last_unstale":"2023-10-06T11:15:12.574922+0000","last_undegraded":"2023-10-06T11:15:12.574922+0000","last_fullsized":"2023-10-06T11:15:12.574922+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:35:57.001079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":99,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-06T11:15:10.536695+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:15:10.536695+0000","last_peered":"2023-10-06T11:15:10.536695+0000","last_clean":"2023-10-06T11:15:10.536695+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:15:10.536695+0000","last_undegraded":"2023-10-06T11:15:10.536695+0000","last_fullsized":"2023-10-06T11:15:10.536695+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:15:11.533426+0000","last_change":"2023-10-06T11:15:11.548629+0000","last_active":"2023-10-06T11:15:11.533426+0000","last_peered":"2023-10-06T11:15:11.533426+0000","last_clean":"2023-10-06T11:15:11.533426+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:15:11.533426+0000","last_undegraded":"2023-10-06T11:15:11.533426+0000","last_fullsized":"2023-10-06T11:15:11.533426+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:11.072682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"124'3","reported_seq":13,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.569771+0000","last_change":"2023-10-06T11:15:11.560790+0000","last_active":"2023-10-06T11:15:12.569771+0000","last_peered":"2023-10-06T11:15:12.569771+0000","last_clean":"2023-10-06T11:15:12.569771+0000","last_became_active":"2023-10-06T11:15:11.560492+0000","last_became_peered":"2023-10-06T11:15:11.560492+0000","last_unstale":"2023-10-06T11:15:12.569771+0000","last_undegraded":"2023-10-06T11:15:12.569771+0000","last_fullsized":"2023-10-06T11:15:12.569771+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:35.856632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":99,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-10-06T11:15:10.536733+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:15:10.536733+0000","last_peered":"2023-10-06T11:15:10.536733+0000","last_clean":"2023-10-06T11:15:10.536733+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:15:10.536733+0000","last_undegraded":"2023-10-06T11:15:10.536733+0000","last_fullsized":"2023-10-06T11:15:10.536733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":1682,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574967,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299408,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072432,"statfs":{"total":96636764160,"available":96330170368,"internally_reserved":0,"allocated":2170880,"data_stored":1307178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.51600000000000001,"15min":0.624},"min":{"1min":0.252,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.68899999999999995,"5min":4.407,"15min":23.908999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.48699999999999999,"15min":0.57499999999999996},"min":{"1min":0.26900000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.66600000000000004,"5min":0.69799999999999995,"15min":9.3230000000000004},"last":0.67500000000000004}]},{"osd":1,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51200000000000001,"15min":0.56100000000000005},"min":{"1min":0.33200000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.73399999999999999,"5min":2.4689999999999999,"15min":9.2360000000000007},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47199999999999998,"15min":0.503},"min":{"1min":0.33100000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.70199999999999996,"5min":0.78900000000000003,"15min":4.327},"last":0.64400000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54200000000000004,"15min":0.51800000000000002},"min":{"1min":0.34399999999999997,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.748,"5min":4.3120000000000003,"15min":4.3120000000000003},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.53700000000000003,"15min":0.55700000000000005},"min":{"1min":0.311,"5min":0.31,"15min":0.29999999999999999},"max":{"1min":0.71599999999999997,"5min":3.0600000000000001,"15min":4.7309999999999999},"last":0.70699999999999996}]},{"osd":3,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.54700000000000004,"15min":0.53700000000000003},"min":{"1min":0.32600000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.60099999999999998,"5min":4.5190000000000001,"15min":4.5190000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55600000000000005,"15min":0.59799999999999998},"min":{"1min":0.40200000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.68100000000000005,"5min":3.0070000000000001,"15min":9.3879999999999999},"last":0.624}]},{"osd":4,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.498,"15min":0.48799999999999999},"min":{"1min":0.32700000000000001,"5min":0.26000000000000001,"15min":0.24399999999999999},"max":{"1min":0.59799999999999998,"5min":4.6639999999999997,"15min":4.6639999999999997},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53300000000000003,"15min":0.53400000000000003},"min":{"1min":0.28499999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.69199999999999995,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":0.66100000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.495,"15min":0.56000000000000005},"min":{"1min":0.32900000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.70999999999999996,"5min":0.79700000000000004,"15min":9.3499999999999996},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.497,"15min":0.54400000000000004},"min":{"1min":0.30099999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.65200000000000002,"5min":0.83399999999999996,"15min":4.444},"last":0.51500000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.59799999999999998},"min":{"1min":0.38100000000000001,"5min":0.32400000000000001,"15min":0.29199999999999998},"max":{"1min":0.64800000000000002,"5min":0.81399999999999995,"15min":9.4969999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.60299999999999998,"15min":0.61899999999999999},"min":{"1min":0.36699999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72299999999999998,"5min":4.4669999999999996,"15min":7.2039999999999997},"last":0.61199999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574968,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311072,"kb_used_data":1496,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060768,"statfs":{"total":96636764160,"available":96318226432,"internally_reserved":0,"allocated":1531904,"data_stored":700074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.57899999999999996,"15min":0.52200000000000002},"min":{"1min":0.30299999999999999,"5min":0.187,"15min":0.187},"max":{"1min":9.5549999999999997,"5min":9.5549999999999997,"15min":9.5549999999999997},"last":0.45200000000000001},{"interface":"front","average":{"1min":1.032,"5min":0.63500000000000001,"15min":0.56299999999999994},"min":{"1min":0.38400000000000001,"5min":0.254,"15min":0.254},"max":{"1min":9.4659999999999993,"5min":9.4659999999999993,"15min":9.4659999999999993},"last":0.54700000000000004}]},{"osd":1,"last update":"Fri Oct 6 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.47199999999999998,"15min":0.48599999999999999},"min":{"1min":0.33400000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.80300000000000005,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56499999999999995,"15min":0.51600000000000001},"min":{"1min":0.32900000000000001,"5min":0.216,"15min":0.216},"max":{"1min":2.238,"5min":5.2670000000000003,"15min":5.2670000000000003},"last":0.48299999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.47999999999999998,"15min":0.498},"min":{"1min":0.255,"5min":0.252,"15min":0.252},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":7.0659999999999998},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.503,"5min":0.48699999999999999,"15min":0.51900000000000002},"min":{"1min":0.33700000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.72899999999999998,"5min":1.0069999999999999,"15min":7.0819999999999999},"last":0.504}]},{"osd":3,"last update":"Fri Oct 6 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.55000000000000004,"15min":0.51600000000000001},"min":{"1min":0.38400000000000001,"5min":0.317,"15min":0.25800000000000001},"max":{"1min":3.871,"5min":3.871,"15min":3.871},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.52700000000000002,"15min":0.53300000000000003},"min":{"1min":0.34799999999999998,"5min":0.316,"15min":0.312},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.47599999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.46000000000000002,"15min":0.48399999999999999},"min":{"1min":0.26800000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.628,"5min":0.88,"15min":0.88},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.51300000000000001,"15min":0.53900000000000003},"min":{"1min":0.32200000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.73399999999999999,"5min":0.82399999999999995,"15min":1.0680000000000001},"last":0.59299999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.503,"15min":0.52100000000000002},"min":{"1min":0.375,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.61199999999999999,"15min":0.58699999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":7.1379999999999999,"5min":7.1379999999999999,"15min":7.1379999999999999},"last":0.53700000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56599999999999995,"15min":0.58799999999999997},"min":{"1min":0.42799999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.88400000000000001},"last":0.55900000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574967,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311656,"kb_used_data":2080,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060184,"statfs":{"total":96636764160,"available":96317628416,"internally_reserved":0,"allocated":2129920,"data_stored":1291795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.45900000000000002,"15min":0.379},"min":{"1min":0.20499999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.67000000000000004,"5min":13.393000000000001,"15min":13.393000000000001},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.45700000000000002,"15min":0.38200000000000001},"min":{"1min":0.23599999999999999,"5min":0.22500000000000001,"15min":0.19700000000000001},"max":{"1min":0.64900000000000002,"5min":11.462,"15min":11.462},"last":0.33900000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.40400000000000003,"15min":0.35999999999999999},"min":{"1min":0.23599999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.47999999999999998,"5min":8.0470000000000006,"15min":8.0470000000000006},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.432,"15min":0.40500000000000003},"min":{"1min":0.26100000000000001,"5min":0.22800000000000001,"15min":0.20999999999999999},"max":{"1min":0.74299999999999999,"5min":4.8630000000000004,"15min":4.8630000000000004},"last":0.374}]},{"osd":3,"last update":"Fri Oct 6 11:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.44900000000000001,"15min":0.42399999999999999},"min":{"1min":0.313,"5min":0.252,"15min":0.252},"max":{"1min":0.71299999999999997,"5min":4.8029999999999999,"15min":4.8029999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.37,"5min":0.42999999999999999,"15min":0.39100000000000001},"min":{"1min":0.27600000000000002,"5min":0.217,"15min":0.217},"max":{"1min":0.68799999999999994,"5min":5.8700000000000001,"15min":5.8700000000000001},"last":0.40000000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51800000000000002,"15min":0.51500000000000001},"min":{"1min":0.38200000000000001,"5min":0.29499999999999998,"15min":0.28199999999999997},"max":{"1min":0.68500000000000005,"5min":1.264,"15min":1.264},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.60899999999999999,"15min":0.56599999999999995},"min":{"1min":0.35199999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.88600000000000001,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.48599999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.58799999999999997,"15min":0.56399999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71699999999999997,"5min":3.4390000000000001,"15min":3.4390000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.66000000000000003,"15min":0.58399999999999996},"min":{"1min":0.36799999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.69799999999999995,"5min":9.3829999999999991,"15min":9.3829999999999991},"last":0.5}]},{"osd":6,"last update":"Fri Oct 6 11:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.61899999999999999,"15min":0.58299999999999996},"min":{"1min":0.35999999999999999,"5min":0.34999999999999998,"15min":0.315},"max":{"1min":0.86699999999999999,"5min":3.4750000000000001,"15min":3.4750000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60999999999999999,"15min":0.58899999999999997},"min":{"1min":0.40400000000000003,"5min":0.379,"15min":0.36699999999999999},"max":{"1min":0.748,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.60699999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.64500000000000002,"15min":0.60999999999999999},"min":{"1min":0.42299999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92200000000000004,"5min":4.7290000000000001,"15min":4.7290000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.60999999999999999,"15min":0.59099999999999997},"min":{"1min":0.42099999999999999,"5min":0.378,"15min":0.374},"max":{"1min":0.89500000000000002,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.61599999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574967,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302912,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068928,"statfs":{"total":96636764160,"available":96326582272,"internally_reserved":0,"allocated":1564672,"data_stored":713887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.42099999999999999,"15min":0.46800000000000003},"min":{"1min":0.20399999999999999,"5min":0.184,"15min":0.184},"max":{"1min":0.501,"5min":8.4239999999999995,"15min":36.097999999999999},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.43099999999999999,"15min":0.377},"min":{"1min":0.22,"5min":0.20799999999999999,"15min":0.182},"max":{"1min":0.52000000000000002,"5min":7.2990000000000004,"15min":7.2990000000000004},"last":0.23999999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.44800000000000001,"15min":0.50600000000000001},"min":{"1min":0.28199999999999997,"5min":0.221,"15min":0.217},"max":{"1min":0.61699999999999999,"5min":8.6080000000000005,"15min":36.07},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.442,"15min":0.40400000000000003},"min":{"1min":0.27100000000000002,"5min":0.23400000000000001,"15min":0.219},"max":{"1min":0.60699999999999998,"5min":6.7800000000000002,"15min":6.7800000000000002},"last":0.35199999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.36599999999999999,"15min":0.39300000000000002},"min":{"1min":0.255,"5min":0.223,"15min":0.223},"max":{"1min":0.55000000000000004,"5min":1.863,"15min":8.4130000000000003},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.48699999999999999,"15min":0.55700000000000005},"min":{"1min":0.25800000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.65200000000000002,"5min":8.4570000000000007,"15min":35.959000000000003},"last":0.33700000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55900000000000005,"15min":0.56200000000000006},"min":{"1min":0.39300000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.85099999999999998,"5min":2.427,"15min":2.427},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.65400000000000003,"15min":0.73299999999999998},"min":{"1min":0.42799999999999999,"5min":0.34399999999999997,"15min":0.29299999999999998},"max":{"1min":0.94999999999999996,"5min":8.2919999999999998,"15min":36.005000000000003},"last":0.55600000000000005}]},{"osd":5,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.628,"15min":0.57899999999999996},"min":{"1min":0.38900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.89600000000000002,"5min":6.6699999999999999,"15min":6.6699999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55100000000000005,"15min":0.55200000000000005},"min":{"1min":0.372,"5min":0.315,"15min":0.315},"max":{"1min":0.82599999999999996,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.54700000000000004}]},{"osd":6,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.66700000000000004,"15min":0.73399999999999999},"min":{"1min":0.42199999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.98699999999999999,"5min":8.2479999999999993,"15min":36.037999999999997},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.66400000000000003,"15min":0.63600000000000001},"min":{"1min":0.495,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.97199999999999998,"5min":6.7110000000000003,"15min":6.7110000000000003},"last":0.59499999999999997}]},{"osd":7,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.65500000000000003,"15min":0.623},"min":{"1min":0.44,"5min":0.371,"15min":0.371},"max":{"1min":0.93100000000000005,"5min":6.742,"15min":6.742},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57899999999999996,"15min":0.56899999999999995},"min":{"1min":0.41499999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.96199999999999997,"5min":1.917,"15min":1.917},"last":0.50600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574968,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315200,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94056640,"statfs":{"total":96636764160,"available":96313999360,"internally_reserved":0,"allocated":1564672,"data_stored":714419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.313,"15min":0.31},"min":{"1min":0.246,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.36399999999999999,"5min":0.56699999999999995,"15min":0.57499999999999996},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.38400000000000001,"15min":0.38200000000000001},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.438,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.40600000000000003}]},{"osd":1,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.373,"15min":0.372},"min":{"1min":0.252,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.47699999999999998,"5min":0.745,"15min":0.745},"last":0.372},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.35199999999999998,"15min":0.34999999999999998},"min":{"1min":0.26200000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.52700000000000002,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.34499999999999997}]},{"osd":3,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.35599999999999998,"15min":0.36599999999999999},"min":{"1min":0.27100000000000002,"5min":0.23300000000000001,"15min":0.23200000000000001},"max":{"1min":0.40000000000000002,"5min":0.58699999999999997,"15min":0.629},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.36499999999999999,"15min":0.36399999999999999},"min":{"1min":0.25900000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.42199999999999999,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.29599999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.505,"15min":0.52500000000000002},"min":{"1min":0.36199999999999999,"5min":0.30599999999999999,"15min":0.30299999999999999},"max":{"1min":0.70899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.52000000000000002,"15min":0.54600000000000004},"min":{"1min":0.35499999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.72299999999999998,"5min":0.80400000000000005,"15min":0.84899999999999998},"last":0.81999999999999995}]},{"osd":5,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.52600000000000002,"15min":0.54100000000000004},"min":{"1min":0.38300000000000001,"5min":0.33100000000000002,"15min":0.32400000000000001},"max":{"1min":0.71699999999999997,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.54800000000000004,"15min":0.55200000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.78100000000000003,"5min":0.878,"15min":0.878},"last":0.84499999999999997}]},{"osd":6,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.56499999999999995,"15min":0.57899999999999996},"min":{"1min":0.38700000000000001,"5min":0.36799999999999999,"15min":0.32600000000000001},"max":{"1min":0.73799999999999999,"5min":0.85199999999999998,"15min":0.86299999999999999},"last":0.746},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55900000000000005,"15min":0.57099999999999995},"min":{"1min":0.40699999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70699999999999996,"5min":0.878,"15min":0.88600000000000001},"last":0.78400000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.37,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67700000000000005,"5min":1.139,"15min":1.139},"last":0.624},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.55800000000000005,"15min":0.56699999999999995},"min":{"1min":0.41699999999999998,"5min":0.38800000000000001,"15min":0.38200000000000001},"max":{"1min":0.69699999999999995,"5min":0.89600000000000002,"15min":0.90500000000000003},"last":0.80600000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574968,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307016,"kb_used_data":1536,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064824,"statfs":{"total":96636764160,"available":96322379776,"internally_reserved":0,"allocated":1572864,"data_stored":715437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.31,"15min":0.31900000000000001},"min":{"1min":0.222,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.45500000000000002,"5min":0.48899999999999999,"15min":1.095},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35199999999999998,"15min":0.38100000000000001},"min":{"1min":0.27100000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.52700000000000002,"5min":0.53900000000000003,"15min":1.7210000000000001},"last":0.23000000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.314,"15min":0.311},"min":{"1min":0.23400000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.65400000000000003},"last":0.251},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.34100000000000003,"15min":0.35899999999999999},"min":{"1min":0.25800000000000001,"5min":0.188,"15min":0.188},"max":{"1min":0.53100000000000003,"5min":0.53400000000000003,"15min":1.196},"last":0.27900000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.34799999999999998,"15min":0.374},"min":{"1min":0.251,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.47799999999999998,"5min":0.73499999999999999,"15min":1.7729999999999999},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39700000000000002,"15min":0.41099999999999998},"min":{"1min":0.308,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.57699999999999996,"5min":0.58599999999999997,"15min":1.224},"last":0.37}]},{"osd":4,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.50900000000000001,"15min":0.54900000000000004},"min":{"1min":0.32100000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":1.694},"last":0.5},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51700000000000002,"15min":0.53700000000000003},"min":{"1min":0.35899999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.56399999999999995}]},{"osd":5,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53100000000000003,"15min":0.53200000000000003},"min":{"1min":0.35599999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.878},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53900000000000003,"15min":0.55600000000000005},"min":{"1min":0.39000000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.746,"5min":0.75800000000000001,"15min":1.165},"last":0.59799999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55300000000000005,"15min":0.57999999999999996},"min":{"1min":0.372,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.79200000000000004,"5min":0.85099999999999998,"15min":1.1359999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55900000000000005,"15min":0.58799999999999997},"min":{"1min":0.42999999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79700000000000004,"5min":0.82199999999999995,"15min":1.7470000000000001},"last":0.61799999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55000000000000004,"15min":0.57799999999999996},"min":{"1min":0.38900000000000001,"5min":0.35699999999999998,"15min":0.35599999999999998},"max":{"1min":0.754,"5min":0.85399999999999998,"15min":1.657},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56100000000000005,"15min":0.57199999999999995},"min":{"1min":0.38,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.82099999999999995,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.60699999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574966,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302884,"kb_used_data":1500,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068956,"statfs":{"total":96636764160,"available":96326610944,"internally_reserved":0,"allocated":1536000,"data_stored":701427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.45700000000000002,"15min":0.53500000000000003},"min":{"1min":0.216,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":2.6619999999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.439,"5min":0.47499999999999998,"15min":0.49099999999999999},"min":{"1min":0.224,"5min":0.215,"15min":0.215},"max":{"1min":0.69999999999999996,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.33300000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:14:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47099999999999997,"15min":0.55600000000000005},"min":{"1min":0.27300000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1,"5min":1,"15min":2.8650000000000002},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.48199999999999998,"15min":0.56299999999999994},"min":{"1min":0.27400000000000002,"5min":0.26200000000000001,"15min":0.25800000000000001},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":2.7610000000000001},"last":0.41499999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:14:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.49299999999999999,"15min":0.54100000000000004},"min":{"1min":0.28499999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.749,"5min":0.76000000000000001,"15min":1.6910000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54200000000000004,"15min":0.58699999999999997},"min":{"1min":0.41099999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71899999999999997,"5min":0.93899999999999995,"15min":1.718},"last":0.67600000000000005}]},{"osd":3,"last update":"Fri Oct 6 11:14:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.55300000000000005,"15min":0.59999999999999998},"min":{"1min":0.33400000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":2.387,"5min":2.387,"15min":2.677},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.27500000000000002},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":0.64100000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:14:53 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.47099999999999997,"15min":0.48399999999999999},"min":{"1min":0.315,"5min":0.23499999999999999,"15min":0.23200000000000001},"max":{"1min":0.73199999999999998,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.495,"15min":0.52600000000000002},"min":{"1min":0.29299999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.58899999999999997,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.55700000000000005}]},{"osd":6,"last update":"Fri Oct 6 11:14:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.505,"15min":0.52100000000000002},"min":{"1min":0.31,"5min":0.30499999999999999,"15min":0.252},"max":{"1min":0.63400000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.502,"5min":0.53500000000000003,"15min":0.56499999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.64800000000000002,"5min":0.85799999999999998,"15min":1.165},"last":0.61199999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:14:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.55300000000000005,"15min":0.55700000000000005},"min":{"1min":0.35399999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.74399999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.626},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56100000000000005,"15min":0.59299999999999997},"min":{"1min":0.318,"5min":0.317,"15min":0.317},"max":{"1min":0.67900000000000005,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.875}]}]},{"osd":5,"up_from":13,"seq":55834574969,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311104,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060736,"statfs":{"total":96636764160,"available":96318193664,"internally_reserved":0,"allocated":1564672,"data_stored":715206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45400000000000001,"15min":0.60799999999999998},"min":{"1min":0.34799999999999998,"5min":0.23100000000000001,"15min":0.20499999999999999},"max":{"1min":0.61099999999999999,"5min":0.72599999999999998,"15min":5.0490000000000004},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.434,"5min":0.45200000000000001,"15min":0.58499999999999996},"min":{"1min":0.253,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.65500000000000003,"5min":0.78100000000000003,"15min":5.1449999999999996},"last":0.53500000000000003}]},{"osd":1,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.46500000000000002,"15min":0.48099999999999998},"min":{"1min":0.29599999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.629,"5min":0.81399999999999995,"15min":0.97199999999999998},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47699999999999998,"15min":0.51000000000000001},"min":{"1min":0.30099999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.58599999999999997,"5min":0.70199999999999996,"15min":1.8799999999999999},"last":0.51100000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.50700000000000001,"15min":0.54900000000000004},"min":{"1min":0.30099999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.60999999999999999,"5min":0.79800000000000004,"15min":4.234},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52600000000000002,"15min":0.55800000000000005},"min":{"1min":0.40100000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.64000000000000001,"5min":0.81000000000000005,"15min":1.0369999999999999},"last":0.627}]},{"osd":3,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48299999999999998,"15min":0.627},"min":{"1min":0.33200000000000002,"5min":0.30399999999999999,"15min":0.27700000000000002},"max":{"1min":0.60699999999999998,"5min":0.82299999999999995,"15min":5.2169999999999996},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.51300000000000001,"15min":0.54000000000000004},"min":{"1min":0.373,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.56299999999999994,"5min":0.82699999999999996,"15min":1.008},"last":0.67600000000000005}]},{"osd":4,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.46999999999999997,"15min":0.51100000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.23999999999999999},"max":{"1min":0.61499999999999999,"5min":0.83399999999999996,"15min":1.917},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46899999999999997,"15min":0.52300000000000002},"min":{"1min":0.35599999999999998,"5min":0.24399999999999999,"15min":0.23899999999999999},"max":{"1min":0.628,"5min":0.71899999999999997,"15min":0.87},"last":0.61099999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.55100000000000005},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.64700000000000002,"5min":0.77100000000000002,"15min":2.0139999999999998},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55400000000000005,"15min":0.60199999999999998},"min":{"1min":0.43099999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.64000000000000001,"5min":0.82899999999999996,"15min":1.9470000000000001},"last":0.69499999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52100000000000002,"15min":0.57399999999999995},"min":{"1min":0.28799999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.65500000000000003,"5min":0.81000000000000005,"15min":0.96499999999999997},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55200000000000005,"15min":0.60099999999999998},"min":{"1min":0.376,"5min":0.316,"15min":0.28799999999999998},"max":{"1min":0.68000000000000005,"5min":0.79900000000000004,"15min":1.4119999999999999},"last":0.75600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:15:21.134 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:15:21.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.258+0000 7f325db48700 1 Processor -- start 2023-10-06T11:15:21.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.258+0000 7f325db48700 1 -- start start 2023-10-06T11:15:21.260 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:15:21.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.258+0000 7f325db48700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3258153ab0 0x7f325815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:21.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.258+0000 7f325db48700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3258153e80 0x7f3258068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:21.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.258+0000 7f325db48700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f325815ac30 con 0x7f32580689d0 2023-10-06T11:15:21.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.258+0000 7f325db48700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3258068e50 con 0x7f3258153e80 2023-10-06T11:15:21.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.258+0000 7f325db48700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32580b4510 con 0x7f3258153ab0 2023-10-06T11:15:21.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.259+0000 7f3257fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f32580689d0 0x7f325815d270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:59252/0 (socket says 172.21.15.146:59252) 2023-10-06T11:15:21.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.259+0000 7f3257fff700 1 -- 172.21.15.146:0/1907802301 learned_addr learned my addr 172.21.15.146:0/1907802301 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:15:21.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.259+0000 7f3256ffd700 1 --2- 172.21.15.146:0/1907802301 >> v2:172.21.15.151:3300/0 conn(0x7f3258153e80 0x7f3258068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:21.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.259+0000 7f32577fe700 1 --2- 172.21.15.146:0/1907802301 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3258153ab0 0x7f325815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:21.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.259+0000 7f32567fc700 1 -- 172.21.15.146:0/1907802301 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2756521835 0 0) 0x7f3250001110 con 0x7f32580689d0 2023-10-06T11:15:21.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.259+0000 7f32567fc700 1 -- 172.21.15.146:0/1907802301 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3240003570 con 0x7f32580689d0 2023-10-06T11:15:21.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.259+0000 7f32567fc700 1 -- 172.21.15.146:0/1907802301 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3981180232 0 0) 0x7f3240003570 con 0x7f32580689d0 2023-10-06T11:15:21.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.259+0000 7f32567fc700 1 -- 172.21.15.146:0/1907802301 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3258153ab0 msgr2=0x7f325815a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:21.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.259+0000 7f32567fc700 1 --2- 172.21.15.146:0/1907802301 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3258153ab0 0x7f325815a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:21.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.259+0000 7f32567fc700 1 -- 172.21.15.146:0/1907802301 >> v2:172.21.15.151:3300/0 conn(0x7f3258153e80 msgr2=0x7f3258068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:21.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.259+0000 7f32567fc700 1 --2- 172.21.15.146:0/1907802301 >> v2:172.21.15.151:3300/0 conn(0x7f3258153e80 0x7f3258068490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:21.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.259+0000 7f32567fc700 1 -- 172.21.15.146:0/1907802301 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32580b6530 con 0x7f32580689d0 2023-10-06T11:15:21.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.259+0000 7f32567fc700 1 -- 172.21.15.146:0/1907802301 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f3250001600 con 0x7f32580689d0 2023-10-06T11:15:21.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.259+0000 7f32567fc700 1 -- 172.21.15.146:0/1907802301 >> v1:172.21.15.146:6789/0 conn(0x7f32580689d0 legacy=0x7f325815d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:21.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.259+0000 7f32567fc700 1 --2- 172.21.15.146:0/1907802301 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3258153ab0 0x7f3240003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:21.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.259+0000 7f32567fc700 1 --2- 172.21.15.146:0/1907802301 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3240003fe0 0x7f3240004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:21.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.259+0000 7f32567fc700 1 --2- 172.21.15.146:0/1907802301 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3240004d50 0x7f32400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:21.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.259+0000 7f32567fc700 1 -- 172.21.15.146:0/1907802301 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3258068e50 con 0x7f3240004d50 2023-10-06T11:15:21.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.259+0000 7f32567fc700 1 -- 172.21.15.146:0/1907802301 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32580b4510 con 0x7f3240003fe0 2023-10-06T11:15:21.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.259+0000 7f32567fc700 1 -- 172.21.15.146:0/1907802301 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f324000ba90 con 0x7f3258153ab0 2023-10-06T11:15:21.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.259+0000 7f3257fff700 1 --2- 172.21.15.146:0/1907802301 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3240004d50 0x7f32400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:21.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.259+0000 7f32577fe700 1 --2- 172.21.15.146:0/1907802301 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3258153ab0 0x7f3240003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:21.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.259+0000 7f3256ffd700 1 --2- 172.21.15.146:0/1907802301 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3240003fe0 0x7f3240004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:21.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.260+0000 7f32577fe700 1 -- 172.21.15.146:0/1907802301 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3240003fe0 msgr2=0x7f3240004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:21.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.260+0000 7f32577fe700 1 --2- 172.21.15.146:0/1907802301 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3240003fe0 0x7f3240004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:21.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.260+0000 7f32577fe700 1 -- 172.21.15.146:0/1907802301 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3240004d50 msgr2=0x7f32400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:21.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.260+0000 7f32577fe700 1 --2- 172.21.15.146:0/1907802301 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3240004d50 0x7f32400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:21.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.260+0000 7f32577fe700 1 -- 172.21.15.146:0/1907802301 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3240003570 con 0x7f3258153ab0 2023-10-06T11:15:21.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.260+0000 7f3257fff700 1 --2- 172.21.15.146:0/1907802301 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3240004d50 0x7f32400051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:15:21.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.260+0000 7f32577fe700 1 --2- 172.21.15.146:0/1907802301 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3258153ab0 0x7f3240003a60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f324800e210 tx=0x7f324800b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f39ff307459ce2b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:21.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.260+0000 7f32567fc700 1 -- 172.21.15.146:0/1907802301 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324800ea60 con 0x7f3258153ab0 2023-10-06T11:15:21.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.260+0000 7f32567fc700 1 -- 172.21.15.146:0/1907802301 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f324800f040 con 0x7f3258153ab0 2023-10-06T11:15:21.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.260+0000 7f32567fc700 1 -- 172.21.15.146:0/1907802301 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324800ee10 con 0x7f3258153ab0 2023-10-06T11:15:21.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.260+0000 7f325db48700 1 -- 172.21.15.146:0/1907802301 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3258153ab0 msgr2=0x7f3240003a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:21.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.260+0000 7f325db48700 1 --2- 172.21.15.146:0/1907802301 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3258153ab0 0x7f3240003a60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f324800e210 tx=0x7f324800b040 comp rx=0 tx=0).stop 2023-10-06T11:15:21.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.260+0000 7f3257fff700 1 -- 172.21.15.146:0/1907802301 reap_dead start 2023-10-06T11:15:21.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.261+0000 7f325db48700 1 -- 172.21.15.146:0/1907802301 shutdown_connections 2023-10-06T11:15:21.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.261+0000 7f325db48700 1 -- 172.21.15.146:0/1907802301 >> 172.21.15.146:0/1907802301 conn(0x7f325806eba0 msgr2=0x7f325806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:21.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.261+0000 7f325db48700 1 -- 172.21.15.146:0/1907802301 shutdown_connections 2023-10-06T11:15:21.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.261+0000 7f325db48700 1 -- 172.21.15.146:0/1907802301 wait complete. 2023-10-06T11:15:21.268 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:15:21.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.262+0000 7f325db48700 1 Processor -- start 2023-10-06T11:15:21.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.262+0000 7f325db48700 1 -- start start 2023-10-06T11:15:21.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.263+0000 7f325db48700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3258153ab0 0x7f3258157f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:21.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.263+0000 7f325db48700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3258156160 0x7f3258143a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:21.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.263+0000 7f325db48700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32581565d0 0x7f3258143f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:21.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.263+0000 7f325db48700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32581444d0 con 0x7f32581565d0 2023-10-06T11:15:21.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.263+0000 7f325db48700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3258155010 con 0x7f3258153ab0 2023-10-06T11:15:21.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.263+0000 7f325db48700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32581552f0 con 0x7f3258156160 2023-10-06T11:15:21.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.263+0000 7f3257fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32581565d0 0x7f3258143f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:21.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.263+0000 7f3257fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32581565d0 0x7f3258143f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:35442/0 (socket says 172.21.15.146:35442) 2023-10-06T11:15:21.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.263+0000 7f3257fff700 1 -- 172.21.15.146:0/1713474693 learned_addr learned my addr 172.21.15.146:0/1713474693 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:21.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.263+0000 7f32577fe700 1 --2- 172.21.15.146:0/1713474693 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3258153ab0 0x7f3258157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:21.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.263+0000 7f3256ffd700 1 --2- 172.21.15.146:0/1713474693 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3258156160 0x7f3258143a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:21.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.263+0000 7f3257fff700 1 -- 172.21.15.146:0/1713474693 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3258156160 msgr2=0x7f3258143a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:21.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.263+0000 7f3257fff700 1 --2- 172.21.15.146:0/1713474693 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3258156160 0x7f3258143a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:21.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.263+0000 7f3257fff700 1 -- 172.21.15.146:0/1713474693 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3258153ab0 msgr2=0x7f3258157f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:21.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.263+0000 7f3257fff700 1 --2- 172.21.15.146:0/1713474693 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3258153ab0 0x7f3258157f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:21.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.263+0000 7f3257fff700 1 -- 172.21.15.146:0/1713474693 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32580aff60 con 0x7f32581565d0 2023-10-06T11:15:21.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.263+0000 7f3257fff700 1 --2- 172.21.15.146:0/1713474693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32581565d0 0x7f3258143f90 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f32580ce6b0 tx=0x7f3258159c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:21.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.263+0000 7f323f7fe700 1 -- 172.21.15.146:0/1713474693 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3250011590 con 0x7f32581565d0 2023-10-06T11:15:21.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.263+0000 7f323f7fe700 1 -- 172.21.15.146:0/1713474693 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3250011730 con 0x7f32581565d0 2023-10-06T11:15:21.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.263+0000 7f325db48700 1 -- 172.21.15.146:0/1713474693 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32580b0240 con 0x7f32581565d0 2023-10-06T11:15:21.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.264+0000 7f323f7fe700 1 -- 172.21.15.146:0/1713474693 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3250011af0 con 0x7f32581565d0 2023-10-06T11:15:21.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.264+0000 7f325db48700 1 -- 172.21.15.146:0/1713474693 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3258154320 con 0x7f32581565d0 2023-10-06T11:15:21.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.265+0000 7f325db48700 1 -- 172.21.15.146:0/1713474693 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32580b0760 con 0x7f32581565d0 2023-10-06T11:15:21.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.265+0000 7f323f7fe700 1 -- 172.21.15.146:0/1713474693 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f325001d460 con 0x7f32581565d0 2023-10-06T11:15:21.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.265+0000 7f323f7fe700 1 --2- 172.21.15.146:0/1713474693 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3244066f30 0x7f32440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:21.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.265+0000 7f323f7fe700 1 -- 172.21.15.146:0/1713474693 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3250084590 con 0x7f32581565d0 2023-10-06T11:15:21.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.265+0000 7f32577fe700 1 --2- 172.21.15.146:0/1713474693 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3244066f30 0x7f32440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:21.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.266+0000 7f32577fe700 1 --2- 172.21.15.146:0/1713474693 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3244066f30 0x7f32440693e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f324800afd0 tx=0x7f324801a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:21.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.270+0000 7f323f7fe700 1 -- 172.21.15.146:0/1713474693 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f32580b0760 con 0x7f32581565d0 2023-10-06T11:15:21.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.454+0000 7f325db48700 1 -- 172.21.15.146:0/1713474693 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f32580b0760 con 0x7f3244066f30 2023-10-06T11:15:21.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.462+0000 7f323f7fe700 1 -- 172.21.15.146:0/1713474693 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311785 (secure 0 0 0) 0x7f32580b0760 con 0x7f3244066f30 2023-10-06T11:15:21.468 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:15:21.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.466+0000 7f325db48700 1 -- 172.21.15.146:0/1713474693 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3244066f30 msgr2=0x7f32440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:21.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.466+0000 7f325db48700 1 --2- 172.21.15.146:0/1713474693 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3244066f30 0x7f32440693e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f324800afd0 tx=0x7f324801a000 comp rx=0 tx=0).stop 2023-10-06T11:15:21.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.466+0000 7f325db48700 1 -- 172.21.15.146:0/1713474693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32581565d0 msgr2=0x7f3258143f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:21.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.466+0000 7f325db48700 1 --2- 172.21.15.146:0/1713474693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32581565d0 0x7f3258143f90 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f32580ce6b0 tx=0x7f3258159c70 comp rx=0 tx=0).stop 2023-10-06T11:15:21.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.466+0000 7f325db48700 1 -- 172.21.15.146:0/1713474693 shutdown_connections 2023-10-06T11:15:21.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.466+0000 7f325db48700 1 --2- 172.21.15.146:0/1713474693 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3244066f30 0x7f32440693e0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:21.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.466+0000 7f325db48700 1 --2- 172.21.15.146:0/1713474693 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f32581565d0 0x7f3258143f90 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:21.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.466+0000 7f325db48700 1 --2- 172.21.15.146:0/1713474693 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3258153ab0 0x7f3258157f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:21.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.466+0000 7f325db48700 1 --2- 172.21.15.146:0/1713474693 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3258156160 0x7f3258143a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:21.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.466+0000 7f325db48700 1 -- 172.21.15.146:0/1713474693 >> 172.21.15.146:0/1713474693 conn(0x7f325806eba0 msgr2=0x7f32581520f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:21.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.466+0000 7f325db48700 1 -- 172.21.15.146:0/1713474693 shutdown_connections 2023-10-06T11:15:21.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.466+0000 7f325db48700 1 -- 172.21.15.146:0/1713474693 wait complete. 2023-10-06T11:15:21.472 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:15:21.480 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":410,"stamp":"2023-10-06T11:15:21.263628+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2461336,"kb_used_data":13400,"kb_used_omap":0,"kb_used_meta":2447872,"kb_avail":752513384,"statfs":{"total":773094113280,"available":770573705216,"internally_reserved":0,"allocated":13721600,"data_stored":6901408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2506620928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.723326"},"pg_stats":[{"pgid":"20.3f","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.552659+0000","last_change":"2023-10-06T11:15:12.549332+0000","last_active":"2023-10-06T11:15:12.552659+0000","last_peered":"2023-10-06T11:15:12.552659+0000","last_clean":"2023-10-06T11:15:12.552659+0000","last_became_active":"2023-10-06T11:15:12.549080+0000","last_became_peered":"2023-10-06T11:15:12.549080+0000","last_unstale":"2023-10-06T11:15:12.552659+0000","last_undegraded":"2023-10-06T11:15:12.552659+0000","last_fullsized":"2023-10-06T11:15:12.552659+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:24.341162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3e","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.563133+0000","last_change":"2023-10-06T11:15:12.556976+0000","last_active":"2023-10-06T11:15:12.563133+0000","last_peered":"2023-10-06T11:15:12.563133+0000","last_clean":"2023-10-06T11:15:12.563133+0000","last_became_active":"2023-10-06T11:15:12.556711+0000","last_became_peered":"2023-10-06T11:15:12.556711+0000","last_unstale":"2023-10-06T11:15:12.563133+0000","last_undegraded":"2023-10-06T11:15:12.563133+0000","last_fullsized":"2023-10-06T11:15:12.563133+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:12.927736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3d","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.568190+0000","last_change":"2023-10-06T11:15:12.563523+0000","last_active":"2023-10-06T11:15:12.568190+0000","last_peered":"2023-10-06T11:15:12.568190+0000","last_clean":"2023-10-06T11:15:12.568190+0000","last_became_active":"2023-10-06T11:15:12.562788+0000","last_became_peered":"2023-10-06T11:15:12.562788+0000","last_unstale":"2023-10-06T11:15:12.568190+0000","last_undegraded":"2023-10-06T11:15:12.568190+0000","last_fullsized":"2023-10-06T11:15:12.568190+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:25:18.441894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.3c","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.554968+0000","last_change":"2023-10-06T11:15:12.553917+0000","last_active":"2023-10-06T11:15:12.554968+0000","last_peered":"2023-10-06T11:15:12.554968+0000","last_clean":"2023-10-06T11:15:12.554968+0000","last_became_active":"2023-10-06T11:15:12.553584+0000","last_became_peered":"2023-10-06T11:15:12.553584+0000","last_unstale":"2023-10-06T11:15:12.554968+0000","last_undegraded":"2023-10-06T11:15:12.554968+0000","last_fullsized":"2023-10-06T11:15:12.554968+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:23:20.636047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3b","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.564171+0000","last_change":"2023-10-06T11:15:12.560638+0000","last_active":"2023-10-06T11:15:12.564171+0000","last_peered":"2023-10-06T11:15:12.564171+0000","last_clean":"2023-10-06T11:15:12.564171+0000","last_became_active":"2023-10-06T11:15:12.560214+0000","last_became_peered":"2023-10-06T11:15:12.560214+0000","last_unstale":"2023-10-06T11:15:12.564171+0000","last_undegraded":"2023-10-06T11:15:12.564171+0000","last_fullsized":"2023-10-06T11:15:12.564171+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:59:35.368760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.3a","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.562513+0000","last_change":"2023-10-06T11:15:12.558334+0000","last_active":"2023-10-06T11:15:12.562513+0000","last_peered":"2023-10-06T11:15:12.562513+0000","last_clean":"2023-10-06T11:15:12.562513+0000","last_became_active":"2023-10-06T11:15:12.552947+0000","last_became_peered":"2023-10-06T11:15:12.552947+0000","last_unstale":"2023-10-06T11:15:12.562513+0000","last_undegraded":"2023-10-06T11:15:12.562513+0000","last_fullsized":"2023-10-06T11:15:12.562513+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:57:36.426307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.39","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.568046+0000","last_change":"2023-10-06T11:15:12.563070+0000","last_active":"2023-10-06T11:15:12.568046+0000","last_peered":"2023-10-06T11:15:12.568046+0000","last_clean":"2023-10-06T11:15:12.568046+0000","last_became_active":"2023-10-06T11:15:12.562448+0000","last_became_peered":"2023-10-06T11:15:12.562448+0000","last_unstale":"2023-10-06T11:15:12.568046+0000","last_undegraded":"2023-10-06T11:15:12.568046+0000","last_fullsized":"2023-10-06T11:15:12.568046+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:25:09.868317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.38","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.555381+0000","last_change":"2023-10-06T11:15:12.548645+0000","last_active":"2023-10-06T11:15:12.555381+0000","last_peered":"2023-10-06T11:15:12.555381+0000","last_clean":"2023-10-06T11:15:12.555381+0000","last_became_active":"2023-10-06T11:15:12.548385+0000","last_became_peered":"2023-10-06T11:15:12.548385+0000","last_unstale":"2023-10-06T11:15:12.555381+0000","last_undegraded":"2023-10-06T11:15:12.555381+0000","last_fullsized":"2023-10-06T11:15:12.555381+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:44:12.495772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.37","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.560813+0000","last_change":"2023-10-06T11:15:12.552449+0000","last_active":"2023-10-06T11:15:12.560813+0000","last_peered":"2023-10-06T11:15:12.560813+0000","last_clean":"2023-10-06T11:15:12.560813+0000","last_became_active":"2023-10-06T11:15:12.551265+0000","last_became_peered":"2023-10-06T11:15:12.551265+0000","last_unstale":"2023-10-06T11:15:12.560813+0000","last_undegraded":"2023-10-06T11:15:12.560813+0000","last_fullsized":"2023-10-06T11:15:12.560813+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:42:08.749955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.36","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.560441+0000","last_change":"2023-10-06T11:15:12.557451+0000","last_active":"2023-10-06T11:15:12.560441+0000","last_peered":"2023-10-06T11:15:12.560441+0000","last_clean":"2023-10-06T11:15:12.560441+0000","last_became_active":"2023-10-06T11:15:12.557196+0000","last_became_peered":"2023-10-06T11:15:12.557196+0000","last_unstale":"2023-10-06T11:15:12.560441+0000","last_undegraded":"2023-10-06T11:15:12.560441+0000","last_fullsized":"2023-10-06T11:15:12.560441+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:04:15.796514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.35","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.563182+0000","last_change":"2023-10-06T11:15:12.555394+0000","last_active":"2023-10-06T11:15:12.563182+0000","last_peered":"2023-10-06T11:15:12.563182+0000","last_clean":"2023-10-06T11:15:12.563182+0000","last_became_active":"2023-10-06T11:15:12.555139+0000","last_became_peered":"2023-10-06T11:15:12.555139+0000","last_unstale":"2023-10-06T11:15:12.563182+0000","last_undegraded":"2023-10-06T11:15:12.563182+0000","last_fullsized":"2023-10-06T11:15:12.563182+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:14.774930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.34","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.556390+0000","last_change":"2023-10-06T11:15:12.550822+0000","last_active":"2023-10-06T11:15:12.556390+0000","last_peered":"2023-10-06T11:15:12.556390+0000","last_clean":"2023-10-06T11:15:12.556390+0000","last_became_active":"2023-10-06T11:15:12.550575+0000","last_became_peered":"2023-10-06T11:15:12.550575+0000","last_unstale":"2023-10-06T11:15:12.556390+0000","last_undegraded":"2023-10-06T11:15:12.556390+0000","last_fullsized":"2023-10-06T11:15:12.556390+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:57:48.775209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.33","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.562487+0000","last_change":"2023-10-06T11:15:12.560803+0000","last_active":"2023-10-06T11:15:12.562487+0000","last_peered":"2023-10-06T11:15:12.562487+0000","last_clean":"2023-10-06T11:15:12.562487+0000","last_became_active":"2023-10-06T11:15:12.560558+0000","last_became_peered":"2023-10-06T11:15:12.560558+0000","last_unstale":"2023-10-06T11:15:12.562487+0000","last_undegraded":"2023-10-06T11:15:12.562487+0000","last_fullsized":"2023-10-06T11:15:12.562487+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:23:20.636047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.32","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.561017+0000","last_change":"2023-10-06T11:15:12.555280+0000","last_active":"2023-10-06T11:15:12.561017+0000","last_peered":"2023-10-06T11:15:12.561017+0000","last_clean":"2023-10-06T11:15:12.561017+0000","last_became_active":"2023-10-06T11:15:12.555040+0000","last_became_peered":"2023-10-06T11:15:12.555040+0000","last_unstale":"2023-10-06T11:15:12.561017+0000","last_undegraded":"2023-10-06T11:15:12.561017+0000","last_fullsized":"2023-10-06T11:15:12.561017+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:59:31.617255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.31","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.558104+0000","last_change":"2023-10-06T11:15:12.554601+0000","last_active":"2023-10-06T11:15:12.558104+0000","last_peered":"2023-10-06T11:15:12.558104+0000","last_clean":"2023-10-06T11:15:12.558104+0000","last_became_active":"2023-10-06T11:15:12.554376+0000","last_became_peered":"2023-10-06T11:15:12.554376+0000","last_unstale":"2023-10-06T11:15:12.558104+0000","last_undegraded":"2023-10-06T11:15:12.558104+0000","last_fullsized":"2023-10-06T11:15:12.558104+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:06:58.266176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.30","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.561125+0000","last_change":"2023-10-06T11:15:12.551699+0000","last_active":"2023-10-06T11:15:12.561125+0000","last_peered":"2023-10-06T11:15:12.561125+0000","last_clean":"2023-10-06T11:15:12.561125+0000","last_became_active":"2023-10-06T11:15:12.550912+0000","last_became_peered":"2023-10-06T11:15:12.550912+0000","last_unstale":"2023-10-06T11:15:12.561125+0000","last_undegraded":"2023-10-06T11:15:12.561125+0000","last_fullsized":"2023-10-06T11:15:12.561125+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:14.774930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2f","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.558957+0000","last_change":"2023-10-06T11:15:12.552236+0000","last_active":"2023-10-06T11:15:12.558957+0000","last_peered":"2023-10-06T11:15:12.558957+0000","last_clean":"2023-10-06T11:15:12.558957+0000","last_became_active":"2023-10-06T11:15:12.550969+0000","last_became_peered":"2023-10-06T11:15:12.550969+0000","last_unstale":"2023-10-06T11:15:12.558957+0000","last_undegraded":"2023-10-06T11:15:12.558957+0000","last_fullsized":"2023-10-06T11:15:12.558957+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:42:28.514350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.2e","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.560708+0000","last_change":"2023-10-06T11:15:12.556018+0000","last_active":"2023-10-06T11:15:12.560708+0000","last_peered":"2023-10-06T11:15:12.560708+0000","last_clean":"2023-10-06T11:15:12.560708+0000","last_became_active":"2023-10-06T11:15:12.555750+0000","last_became_peered":"2023-10-06T11:15:12.555750+0000","last_unstale":"2023-10-06T11:15:12.560708+0000","last_undegraded":"2023-10-06T11:15:12.560708+0000","last_fullsized":"2023-10-06T11:15:12.560708+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:09:25.439474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2d","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.568555+0000","last_change":"2023-10-06T11:15:12.566859+0000","last_active":"2023-10-06T11:15:12.568555+0000","last_peered":"2023-10-06T11:15:12.568555+0000","last_clean":"2023-10-06T11:15:12.568555+0000","last_became_active":"2023-10-06T11:15:12.566559+0000","last_became_peered":"2023-10-06T11:15:12.566559+0000","last_unstale":"2023-10-06T11:15:12.568555+0000","last_undegraded":"2023-10-06T11:15:12.568555+0000","last_fullsized":"2023-10-06T11:15:12.568555+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:56:21.022912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.2c","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.556172+0000","last_change":"2023-10-06T11:15:12.553202+0000","last_active":"2023-10-06T11:15:12.556172+0000","last_peered":"2023-10-06T11:15:12.556172+0000","last_clean":"2023-10-06T11:15:12.556172+0000","last_became_active":"2023-10-06T11:15:12.552964+0000","last_became_peered":"2023-10-06T11:15:12.552964+0000","last_unstale":"2023-10-06T11:15:12.556172+0000","last_undegraded":"2023-10-06T11:15:12.556172+0000","last_fullsized":"2023-10-06T11:15:12.556172+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:25:09.868317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.2b","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.564402+0000","last_change":"2023-10-06T11:15:12.561867+0000","last_active":"2023-10-06T11:15:12.564402+0000","last_peered":"2023-10-06T11:15:12.564402+0000","last_clean":"2023-10-06T11:15:12.564402+0000","last_became_active":"2023-10-06T11:15:12.561621+0000","last_became_peered":"2023-10-06T11:15:12.561621+0000","last_unstale":"2023-10-06T11:15:12.564402+0000","last_undegraded":"2023-10-06T11:15:12.564402+0000","last_fullsized":"2023-10-06T11:15:12.564402+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:33:57.627561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2a","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.561038+0000","last_change":"2023-10-06T11:15:12.556434+0000","last_active":"2023-10-06T11:15:12.561038+0000","last_peered":"2023-10-06T11:15:12.561038+0000","last_clean":"2023-10-06T11:15:12.561038+0000","last_became_active":"2023-10-06T11:15:12.556084+0000","last_became_peered":"2023-10-06T11:15:12.556084+0000","last_unstale":"2023-10-06T11:15:12.561038+0000","last_undegraded":"2023-10-06T11:15:12.561038+0000","last_fullsized":"2023-10-06T11:15:12.561038+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:13:03.552426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.29","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.563099+0000","last_change":"2023-10-06T11:15:12.558929+0000","last_active":"2023-10-06T11:15:12.563099+0000","last_peered":"2023-10-06T11:15:12.563099+0000","last_clean":"2023-10-06T11:15:12.563099+0000","last_became_active":"2023-10-06T11:15:12.558672+0000","last_became_peered":"2023-10-06T11:15:12.558672+0000","last_unstale":"2023-10-06T11:15:12.563099+0000","last_undegraded":"2023-10-06T11:15:12.563099+0000","last_fullsized":"2023-10-06T11:15:12.563099+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:36.864990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.28","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.561100+0000","last_change":"2023-10-06T11:15:12.550227+0000","last_active":"2023-10-06T11:15:12.561100+0000","last_peered":"2023-10-06T11:15:12.561100+0000","last_clean":"2023-10-06T11:15:12.561100+0000","last_became_active":"2023-10-06T11:15:12.549948+0000","last_became_peered":"2023-10-06T11:15:12.549948+0000","last_unstale":"2023-10-06T11:15:12.561100+0000","last_undegraded":"2023-10-06T11:15:12.561100+0000","last_fullsized":"2023-10-06T11:15:12.561100+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:49:53.647910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.27","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.569537+0000","last_change":"2023-10-06T11:15:12.560251+0000","last_active":"2023-10-06T11:15:12.569537+0000","last_peered":"2023-10-06T11:15:12.569537+0000","last_clean":"2023-10-06T11:15:12.569537+0000","last_became_active":"2023-10-06T11:15:12.559892+0000","last_became_peered":"2023-10-06T11:15:12.559892+0000","last_unstale":"2023-10-06T11:15:12.569537+0000","last_undegraded":"2023-10-06T11:15:12.569537+0000","last_fullsized":"2023-10-06T11:15:12.569537+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:58:42.165232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.26","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.565036+0000","last_change":"2023-10-06T11:15:12.558787+0000","last_active":"2023-10-06T11:15:12.565036+0000","last_peered":"2023-10-06T11:15:12.565036+0000","last_clean":"2023-10-06T11:15:12.565036+0000","last_became_active":"2023-10-06T11:15:12.558501+0000","last_became_peered":"2023-10-06T11:15:12.558501+0000","last_unstale":"2023-10-06T11:15:12.565036+0000","last_undegraded":"2023-10-06T11:15:12.565036+0000","last_fullsized":"2023-10-06T11:15:12.565036+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:59:48.066554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.25","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.567611+0000","last_change":"2023-10-06T11:15:12.561938+0000","last_active":"2023-10-06T11:15:12.567611+0000","last_peered":"2023-10-06T11:15:12.567611+0000","last_clean":"2023-10-06T11:15:12.567611+0000","last_became_active":"2023-10-06T11:15:12.561689+0000","last_became_peered":"2023-10-06T11:15:12.561689+0000","last_unstale":"2023-10-06T11:15:12.567611+0000","last_undegraded":"2023-10-06T11:15:12.567611+0000","last_fullsized":"2023-10-06T11:15:12.567611+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:32:37.458835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.24","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.556345+0000","last_change":"2023-10-06T11:15:12.554453+0000","last_active":"2023-10-06T11:15:12.556345+0000","last_peered":"2023-10-06T11:15:12.556345+0000","last_clean":"2023-10-06T11:15:12.556345+0000","last_became_active":"2023-10-06T11:15:12.554219+0000","last_became_peered":"2023-10-06T11:15:12.554219+0000","last_unstale":"2023-10-06T11:15:12.556345+0000","last_undegraded":"2023-10-06T11:15:12.556345+0000","last_fullsized":"2023-10-06T11:15:12.556345+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:21:45.309284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.23","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.568126+0000","last_change":"2023-10-06T11:15:12.564276+0000","last_active":"2023-10-06T11:15:12.568126+0000","last_peered":"2023-10-06T11:15:12.568126+0000","last_clean":"2023-10-06T11:15:12.568126+0000","last_became_active":"2023-10-06T11:15:12.563914+0000","last_became_peered":"2023-10-06T11:15:12.563914+0000","last_unstale":"2023-10-06T11:15:12.568126+0000","last_undegraded":"2023-10-06T11:15:12.568126+0000","last_fullsized":"2023-10-06T11:15:12.568126+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:38:05.265107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.22","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.568118+0000","last_change":"2023-10-06T11:15:12.560466+0000","last_active":"2023-10-06T11:15:12.568118+0000","last_peered":"2023-10-06T11:15:12.568118+0000","last_clean":"2023-10-06T11:15:12.568118+0000","last_became_active":"2023-10-06T11:15:12.560164+0000","last_became_peered":"2023-10-06T11:15:12.560164+0000","last_unstale":"2023-10-06T11:15:12.568118+0000","last_undegraded":"2023-10-06T11:15:12.568118+0000","last_fullsized":"2023-10-06T11:15:12.568118+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:51:27.969369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.21","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.555385+0000","last_change":"2023-10-06T11:15:12.551590+0000","last_active":"2023-10-06T11:15:12.555385+0000","last_peered":"2023-10-06T11:15:12.555385+0000","last_clean":"2023-10-06T11:15:12.555385+0000","last_became_active":"2023-10-06T11:15:12.551309+0000","last_became_peered":"2023-10-06T11:15:12.551309+0000","last_unstale":"2023-10-06T11:15:12.555385+0000","last_undegraded":"2023-10-06T11:15:12.555385+0000","last_fullsized":"2023-10-06T11:15:12.555385+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:32:56.949303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.20","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.562828+0000","last_change":"2023-10-06T11:15:12.561924+0000","last_active":"2023-10-06T11:15:12.562828+0000","last_peered":"2023-10-06T11:15:12.562828+0000","last_clean":"2023-10-06T11:15:12.562828+0000","last_became_active":"2023-10-06T11:15:12.561662+0000","last_became_peered":"2023-10-06T11:15:12.561662+0000","last_unstale":"2023-10-06T11:15:12.562828+0000","last_undegraded":"2023-10-06T11:15:12.562828+0000","last_fullsized":"2023-10-06T11:15:12.562828+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:52:03.889787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.561124+0000","last_change":"2023-10-06T11:15:12.554477+0000","last_active":"2023-10-06T11:15:12.561124+0000","last_peered":"2023-10-06T11:15:12.561124+0000","last_clean":"2023-10-06T11:15:12.561124+0000","last_became_active":"2023-10-06T11:15:12.554222+0000","last_became_peered":"2023-10-06T11:15:12.554222+0000","last_unstale":"2023-10-06T11:15:12.561124+0000","last_undegraded":"2023-10-06T11:15:12.561124+0000","last_fullsized":"2023-10-06T11:15:12.561124+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:08:01.563879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1f","version":"124'4","reported_seq":14,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.574879+0000","last_change":"2023-10-06T11:15:11.615827+0000","last_active":"2023-10-06T11:15:12.574879+0000","last_peered":"2023-10-06T11:15:12.574879+0000","last_clean":"2023-10-06T11:15:12.574879+0000","last_became_active":"2023-10-06T11:15:11.615550+0000","last_became_peered":"2023-10-06T11:15:11.615550+0000","last_unstale":"2023-10-06T11:15:12.574879+0000","last_undegraded":"2023-10-06T11:15:12.574879+0000","last_fullsized":"2023-10-06T11:15:12.574879+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:12:08.245890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.560926+0000","last_change":"2023-10-06T11:15:12.556304+0000","last_active":"2023-10-06T11:15:12.560926+0000","last_peered":"2023-10-06T11:15:12.560926+0000","last_clean":"2023-10-06T11:15:12.560926+0000","last_became_active":"2023-10-06T11:15:12.556046+0000","last_became_peered":"2023-10-06T11:15:12.556046+0000","last_unstale":"2023-10-06T11:15:12.560926+0000","last_undegraded":"2023-10-06T11:15:12.560926+0000","last_fullsized":"2023-10-06T11:15:12.560926+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:46:24.253441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1e","version":"124'1","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.564654+0000","last_change":"2023-10-06T11:15:11.557353+0000","last_active":"2023-10-06T11:15:12.564654+0000","last_peered":"2023-10-06T11:15:12.564654+0000","last_clean":"2023-10-06T11:15:12.564654+0000","last_became_active":"2023-10-06T11:15:11.557113+0000","last_became_peered":"2023-10-06T11:15:11.557113+0000","last_unstale":"2023-10-06T11:15:12.564654+0000","last_undegraded":"2023-10-06T11:15:12.564654+0000","last_fullsized":"2023-10-06T11:15:12.564654+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:33:56.619203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.563158+0000","last_change":"2023-10-06T11:15:12.560179+0000","last_active":"2023-10-06T11:15:12.563158+0000","last_peered":"2023-10-06T11:15:12.563158+0000","last_clean":"2023-10-06T11:15:12.563158+0000","last_became_active":"2023-10-06T11:15:12.559930+0000","last_became_peered":"2023-10-06T11:15:12.559930+0000","last_unstale":"2023-10-06T11:15:12.563158+0000","last_undegraded":"2023-10-06T11:15:12.563158+0000","last_fullsized":"2023-10-06T11:15:12.563158+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:57:36.426307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"124'2","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.570451+0000","last_change":"2023-10-06T11:15:11.560104+0000","last_active":"2023-10-06T11:15:12.570451+0000","last_peered":"2023-10-06T11:15:12.570451+0000","last_clean":"2023-10-06T11:15:12.570451+0000","last_became_active":"2023-10-06T11:15:11.559818+0000","last_became_peered":"2023-10-06T11:15:11.559818+0000","last_unstale":"2023-10-06T11:15:12.570451+0000","last_undegraded":"2023-10-06T11:15:12.570451+0000","last_fullsized":"2023-10-06T11:15:12.570451+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:42:27.505992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.558045+0000","last_change":"2023-10-06T11:15:12.554784+0000","last_active":"2023-10-06T11:15:12.558045+0000","last_peered":"2023-10-06T11:15:12.558045+0000","last_clean":"2023-10-06T11:15:12.558045+0000","last_became_active":"2023-10-06T11:15:12.554499+0000","last_became_peered":"2023-10-06T11:15:12.554499+0000","last_unstale":"2023-10-06T11:15:12.558045+0000","last_undegraded":"2023-10-06T11:15:12.558045+0000","last_fullsized":"2023-10-06T11:15:12.558045+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:25:23.586837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1c","version":"124'2","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.569295+0000","last_change":"2023-10-06T11:15:11.558478+0000","last_active":"2023-10-06T11:15:12.569295+0000","last_peered":"2023-10-06T11:15:12.569295+0000","last_clean":"2023-10-06T11:15:12.569295+0000","last_became_active":"2023-10-06T11:15:11.558217+0000","last_became_peered":"2023-10-06T11:15:11.558217+0000","last_unstale":"2023-10-06T11:15:12.569295+0000","last_undegraded":"2023-10-06T11:15:12.569295+0000","last_fullsized":"2023-10-06T11:15:12.569295+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:57:35.417949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.550881+0000","last_change":"2023-10-06T11:15:12.544363+0000","last_active":"2023-10-06T11:15:12.550881+0000","last_peered":"2023-10-06T11:15:12.550881+0000","last_clean":"2023-10-06T11:15:12.550881+0000","last_became_active":"2023-10-06T11:15:12.544103+0000","last_became_peered":"2023-10-06T11:15:12.544103+0000","last_unstale":"2023-10-06T11:15:12.550881+0000","last_undegraded":"2023-10-06T11:15:12.550881+0000","last_fullsized":"2023-10-06T11:15:12.550881+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:58:00.707422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"124'1","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.564646+0000","last_change":"2023-10-06T11:15:11.555437+0000","last_active":"2023-10-06T11:15:12.564646+0000","last_peered":"2023-10-06T11:15:12.564646+0000","last_clean":"2023-10-06T11:15:12.564646+0000","last_became_active":"2023-10-06T11:15:11.555188+0000","last_became_peered":"2023-10-06T11:15:11.555188+0000","last_unstale":"2023-10-06T11:15:12.564646+0000","last_undegraded":"2023-10-06T11:15:12.564646+0000","last_fullsized":"2023-10-06T11:15:12.564646+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:35.856632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.555499+0000","last_change":"2023-10-06T11:15:12.550097+0000","last_active":"2023-10-06T11:15:12.555499+0000","last_peered":"2023-10-06T11:15:12.555499+0000","last_clean":"2023-10-06T11:15:12.555499+0000","last_became_active":"2023-10-06T11:15:12.549830+0000","last_became_peered":"2023-10-06T11:15:12.549830+0000","last_unstale":"2023-10-06T11:15:12.555499+0000","last_undegraded":"2023-10-06T11:15:12.555499+0000","last_fullsized":"2023-10-06T11:15:12.555499+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:55:01.168186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"124'1","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.565269+0000","last_change":"2023-10-06T11:15:11.550069+0000","last_active":"2023-10-06T11:15:12.565269+0000","last_peered":"2023-10-06T11:15:12.565269+0000","last_clean":"2023-10-06T11:15:12.565269+0000","last_became_active":"2023-10-06T11:15:11.549745+0000","last_became_peered":"2023-10-06T11:15:11.549745+0000","last_unstale":"2023-10-06T11:15:12.565269+0000","last_undegraded":"2023-10-06T11:15:12.565269+0000","last_fullsized":"2023-10-06T11:15:12.565269+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:47:13.766571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.560434+0000","last_change":"2023-10-06T11:15:12.554531+0000","last_active":"2023-10-06T11:15:12.560434+0000","last_peered":"2023-10-06T11:15:12.560434+0000","last_clean":"2023-10-06T11:15:12.560434+0000","last_became_active":"2023-10-06T11:15:12.554264+0000","last_became_peered":"2023-10-06T11:15:12.554264+0000","last_unstale":"2023-10-06T11:15:12.560434+0000","last_undegraded":"2023-10-06T11:15:12.560434+0000","last_fullsized":"2023-10-06T11:15:12.560434+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:20.499128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.541020+0000","last_change":"2023-10-06T11:15:11.555398+0000","last_active":"2023-10-06T11:15:12.541020+0000","last_peered":"2023-10-06T11:15:12.541020+0000","last_clean":"2023-10-06T11:15:12.541020+0000","last_became_active":"2023-10-06T11:15:11.555097+0000","last_became_peered":"2023-10-06T11:15:11.555097+0000","last_unstale":"2023-10-06T11:15:12.541020+0000","last_undegraded":"2023-10-06T11:15:12.541020+0000","last_fullsized":"2023-10-06T11:15:12.541020+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:19:28.866743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.567704+0000","last_change":"2023-10-06T11:15:12.562196+0000","last_active":"2023-10-06T11:15:12.567704+0000","last_peered":"2023-10-06T11:15:12.567704+0000","last_clean":"2023-10-06T11:15:12.567704+0000","last_became_active":"2023-10-06T11:15:12.561903+0000","last_became_peered":"2023-10-06T11:15:12.561903+0000","last_unstale":"2023-10-06T11:15:12.567704+0000","last_undegraded":"2023-10-06T11:15:12.567704+0000","last_fullsized":"2023-10-06T11:15:12.567704+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:08:23.845610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.555163+0000","last_change":"2023-10-06T11:15:11.615898+0000","last_active":"2023-10-06T11:15:12.555163+0000","last_peered":"2023-10-06T11:15:12.555163+0000","last_clean":"2023-10-06T11:15:12.555163+0000","last_became_active":"2023-10-06T11:15:11.615593+0000","last_became_peered":"2023-10-06T11:15:11.615593+0000","last_unstale":"2023-10-06T11:15:12.555163+0000","last_undegraded":"2023-10-06T11:15:12.555163+0000","last_fullsized":"2023-10-06T11:15:12.555163+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:31:06.545416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.568074+0000","last_change":"2023-10-06T11:15:12.563042+0000","last_active":"2023-10-06T11:15:12.568074+0000","last_peered":"2023-10-06T11:15:12.568074+0000","last_clean":"2023-10-06T11:15:12.568074+0000","last_became_active":"2023-10-06T11:15:12.562758+0000","last_became_peered":"2023-10-06T11:15:12.562758+0000","last_unstale":"2023-10-06T11:15:12.568074+0000","last_undegraded":"2023-10-06T11:15:12.568074+0000","last_fullsized":"2023-10-06T11:15:12.568074+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:30:37.212830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.f","version":"124'1","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.565991+0000","last_change":"2023-10-06T11:15:11.555759+0000","last_active":"2023-10-06T11:15:12.565991+0000","last_peered":"2023-10-06T11:15:12.565991+0000","last_clean":"2023-10-06T11:15:12.565991+0000","last_became_active":"2023-10-06T11:15:11.555515+0000","last_became_peered":"2023-10-06T11:15:11.555515+0000","last_unstale":"2023-10-06T11:15:12.565991+0000","last_undegraded":"2023-10-06T11:15:12.565991+0000","last_fullsized":"2023-10-06T11:15:12.565991+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:26.937119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.567123+0000","last_change":"2023-10-06T11:15:12.556067+0000","last_active":"2023-10-06T11:15:12.567123+0000","last_peered":"2023-10-06T11:15:12.567123+0000","last_clean":"2023-10-06T11:15:12.567123+0000","last_became_active":"2023-10-06T11:15:12.555819+0000","last_became_peered":"2023-10-06T11:15:12.555819+0000","last_unstale":"2023-10-06T11:15:12.567123+0000","last_undegraded":"2023-10-06T11:15:12.567123+0000","last_fullsized":"2023-10-06T11:15:12.567123+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:31:53.456266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.e","version":"124'2","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.569971+0000","last_change":"2023-10-06T11:15:11.615617+0000","last_active":"2023-10-06T11:15:12.569971+0000","last_peered":"2023-10-06T11:15:12.569971+0000","last_clean":"2023-10-06T11:15:12.569971+0000","last_became_active":"2023-10-06T11:15:11.615338+0000","last_became_peered":"2023-10-06T11:15:11.615338+0000","last_unstale":"2023-10-06T11:15:12.569971+0000","last_undegraded":"2023-10-06T11:15:12.569971+0000","last_fullsized":"2023-10-06T11:15:12.569971+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:14:50.760693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.567937+0000","last_change":"2023-10-06T11:15:12.563592+0000","last_active":"2023-10-06T11:15:12.567937+0000","last_peered":"2023-10-06T11:15:12.567937+0000","last_clean":"2023-10-06T11:15:12.567937+0000","last_became_active":"2023-10-06T11:15:12.562607+0000","last_became_peered":"2023-10-06T11:15:12.562607+0000","last_unstale":"2023-10-06T11:15:12.567937+0000","last_undegraded":"2023-10-06T11:15:12.567937+0000","last_fullsized":"2023-10-06T11:15:12.567937+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:20.499128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.d","version":"124'1","reported_seq":11,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.570312+0000","last_change":"2023-10-06T11:15:11.555479+0000","last_active":"2023-10-06T11:15:12.570312+0000","last_peered":"2023-10-06T11:15:12.570312+0000","last_clean":"2023-10-06T11:15:12.570312+0000","last_became_active":"2023-10-06T11:15:11.553333+0000","last_became_peered":"2023-10-06T11:15:11.553333+0000","last_unstale":"2023-10-06T11:15:12.570312+0000","last_undegraded":"2023-10-06T11:15:12.570312+0000","last_fullsized":"2023-10-06T11:15:12.570312+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:14:07.032030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.562902+0000","last_change":"2023-10-06T11:15:12.560178+0000","last_active":"2023-10-06T11:15:12.562902+0000","last_peered":"2023-10-06T11:15:12.562902+0000","last_clean":"2023-10-06T11:15:12.562902+0000","last_became_active":"2023-10-06T11:15:12.559886+0000","last_became_peered":"2023-10-06T11:15:12.559886+0000","last_unstale":"2023-10-06T11:15:12.562902+0000","last_undegraded":"2023-10-06T11:15:12.562902+0000","last_fullsized":"2023-10-06T11:15:12.562902+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:43:09.220052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.547263+0000","last_change":"2023-10-06T11:15:11.614773+0000","last_active":"2023-10-06T11:15:12.547263+0000","last_peered":"2023-10-06T11:15:12.547263+0000","last_clean":"2023-10-06T11:15:12.547263+0000","last_became_active":"2023-10-06T11:15:11.614494+0000","last_became_peered":"2023-10-06T11:15:11.614494+0000","last_unstale":"2023-10-06T11:15:12.547263+0000","last_undegraded":"2023-10-06T11:15:12.547263+0000","last_fullsized":"2023-10-06T11:15:12.547263+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:42:27.505992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.560715+0000","last_change":"2023-10-06T11:15:12.556066+0000","last_active":"2023-10-06T11:15:12.560715+0000","last_peered":"2023-10-06T11:15:12.560715+0000","last_clean":"2023-10-06T11:15:12.560715+0000","last_became_active":"2023-10-06T11:15:12.555821+0000","last_became_peered":"2023-10-06T11:15:12.555821+0000","last_unstale":"2023-10-06T11:15:12.560715+0000","last_undegraded":"2023-10-06T11:15:12.560715+0000","last_fullsized":"2023-10-06T11:15:12.560715+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:01:51.130934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"124'2","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.568402+0000","last_change":"2023-10-06T11:15:11.553701+0000","last_active":"2023-10-06T11:15:12.568402+0000","last_peered":"2023-10-06T11:15:12.568402+0000","last_clean":"2023-10-06T11:15:12.568402+0000","last_became_active":"2023-10-06T11:15:11.553429+0000","last_became_peered":"2023-10-06T11:15:11.553429+0000","last_unstale":"2023-10-06T11:15:12.568402+0000","last_undegraded":"2023-10-06T11:15:12.568402+0000","last_fullsized":"2023-10-06T11:15:12.568402+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:11.919378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.558046+0000","last_change":"2023-10-06T11:15:12.554583+0000","last_active":"2023-10-06T11:15:12.558046+0000","last_peered":"2023-10-06T11:15:12.558046+0000","last_clean":"2023-10-06T11:15:12.558046+0000","last_became_active":"2023-10-06T11:15:12.554321+0000","last_became_peered":"2023-10-06T11:15:12.554321+0000","last_unstale":"2023-10-06T11:15:12.558046+0000","last_undegraded":"2023-10-06T11:15:12.558046+0000","last_fullsized":"2023-10-06T11:15:12.558046+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:09:31.438514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.546072+0000","last_change":"2023-10-06T11:15:11.613844+0000","last_active":"2023-10-06T11:15:12.546072+0000","last_peered":"2023-10-06T11:15:12.546072+0000","last_clean":"2023-10-06T11:15:12.546072+0000","last_became_active":"2023-10-06T11:15:11.611782+0000","last_became_peered":"2023-10-06T11:15:11.611782+0000","last_unstale":"2023-10-06T11:15:12.546072+0000","last_undegraded":"2023-10-06T11:15:12.546072+0000","last_fullsized":"2023-10-06T11:15:12.546072+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:33:26.797503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.560453+0000","last_change":"2023-10-06T11:15:12.555068+0000","last_active":"2023-10-06T11:15:12.560453+0000","last_peered":"2023-10-06T11:15:12.560453+0000","last_clean":"2023-10-06T11:15:12.560453+0000","last_became_active":"2023-10-06T11:15:12.554808+0000","last_became_peered":"2023-10-06T11:15:12.554808+0000","last_unstale":"2023-10-06T11:15:12.560453+0000","last_undegraded":"2023-10-06T11:15:12.560453+0000","last_fullsized":"2023-10-06T11:15:12.560453+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:32:37.458835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.550759+0000","last_change":"2023-10-06T11:15:11.616271+0000","last_active":"2023-10-06T11:15:12.550759+0000","last_peered":"2023-10-06T11:15:12.550759+0000","last_clean":"2023-10-06T11:15:12.550759+0000","last_became_active":"2023-10-06T11:15:11.615995+0000","last_became_peered":"2023-10-06T11:15:11.615995+0000","last_unstale":"2023-10-06T11:15:12.550759+0000","last_undegraded":"2023-10-06T11:15:12.550759+0000","last_fullsized":"2023-10-06T11:15:12.550759+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:11.919378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.564488+0000","last_change":"2023-10-06T11:15:12.561508+0000","last_active":"2023-10-06T11:15:12.564488+0000","last_peered":"2023-10-06T11:15:12.564488+0000","last_clean":"2023-10-06T11:15:12.564488+0000","last_became_active":"2023-10-06T11:15:12.561218+0000","last_became_peered":"2023-10-06T11:15:12.561218+0000","last_unstale":"2023-10-06T11:15:12.564488+0000","last_undegraded":"2023-10-06T11:15:12.564488+0000","last_fullsized":"2023-10-06T11:15:12.564488+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:42:28.514350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.541081+0000","last_change":"2023-10-06T11:15:11.556382+0000","last_active":"2023-10-06T11:15:12.541081+0000","last_peered":"2023-10-06T11:15:12.541081+0000","last_clean":"2023-10-06T11:15:12.541081+0000","last_became_active":"2023-10-06T11:15:11.556112+0000","last_became_peered":"2023-10-06T11:15:11.556112+0000","last_unstale":"2023-10-06T11:15:12.541081+0000","last_undegraded":"2023-10-06T11:15:12.541081+0000","last_fullsized":"2023-10-06T11:15:12.541081+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:16:45.186406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.562131+0000","last_change":"2023-10-06T11:15:12.559696+0000","last_active":"2023-10-06T11:15:12.562131+0000","last_peered":"2023-10-06T11:15:12.562131+0000","last_clean":"2023-10-06T11:15:12.562131+0000","last_became_active":"2023-10-06T11:15:12.559240+0000","last_became_peered":"2023-10-06T11:15:12.559240+0000","last_unstale":"2023-10-06T11:15:12.562131+0000","last_undegraded":"2023-10-06T11:15:12.562131+0000","last_fullsized":"2023-10-06T11:15:12.562131+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:45:30.113928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.7","version":"124'2","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.569892+0000","last_change":"2023-10-06T11:15:11.615013+0000","last_active":"2023-10-06T11:15:12.569892+0000","last_peered":"2023-10-06T11:15:12.569892+0000","last_clean":"2023-10-06T11:15:12.569892+0000","last_became_active":"2023-10-06T11:15:11.614364+0000","last_became_peered":"2023-10-06T11:15:11.614364+0000","last_unstale":"2023-10-06T11:15:12.569892+0000","last_undegraded":"2023-10-06T11:15:12.569892+0000","last_fullsized":"2023-10-06T11:15:12.569892+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:44.091039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.568351+0000","last_change":"2023-10-06T11:15:12.560574+0000","last_active":"2023-10-06T11:15:12.568351+0000","last_peered":"2023-10-06T11:15:12.568351+0000","last_clean":"2023-10-06T11:15:12.568351+0000","last_became_active":"2023-10-06T11:15:12.560297+0000","last_became_peered":"2023-10-06T11:15:12.560297+0000","last_unstale":"2023-10-06T11:15:12.568351+0000","last_undegraded":"2023-10-06T11:15:12.568351+0000","last_fullsized":"2023-10-06T11:15:12.568351+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:22.164257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.6","version":"125'1","reported_seq":11,"reported_epoch":125,"state":"active+clean","last_fresh":"2023-10-06T11:15:13.564679+0000","last_change":"2023-10-06T11:15:11.557279+0000","last_active":"2023-10-06T11:15:13.564679+0000","last_peered":"2023-10-06T11:15:13.564679+0000","last_clean":"2023-10-06T11:15:13.564679+0000","last_became_active":"2023-10-06T11:15:11.556969+0000","last_became_peered":"2023-10-06T11:15:11.556969+0000","last_unstale":"2023-10-06T11:15:13.564679+0000","last_undegraded":"2023-10-06T11:15:13.564679+0000","last_fullsized":"2023-10-06T11:15:13.564679+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:35:57.001079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.567096+0000","last_change":"2023-10-06T11:15:12.559496+0000","last_active":"2023-10-06T11:15:12.567096+0000","last_peered":"2023-10-06T11:15:12.567096+0000","last_clean":"2023-10-06T11:15:12.567096+0000","last_became_active":"2023-10-06T11:15:12.558184+0000","last_became_peered":"2023-10-06T11:15:12.558184+0000","last_unstale":"2023-10-06T11:15:12.567096+0000","last_undegraded":"2023-10-06T11:15:12.567096+0000","last_fullsized":"2023-10-06T11:15:12.567096+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:45:30.113928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.542539+0000","last_change":"2023-10-06T11:15:11.615736+0000","last_active":"2023-10-06T11:15:12.542539+0000","last_peered":"2023-10-06T11:15:12.542539+0000","last_clean":"2023-10-06T11:15:12.542539+0000","last_became_active":"2023-10-06T11:15:11.615436+0000","last_became_peered":"2023-10-06T11:15:11.615436+0000","last_unstale":"2023-10-06T11:15:12.542539+0000","last_undegraded":"2023-10-06T11:15:12.542539+0000","last_fullsized":"2023-10-06T11:15:12.542539+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:25:17.433536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.560267+0000","last_change":"2023-10-06T11:15:12.555337+0000","last_active":"2023-10-06T11:15:12.560267+0000","last_peered":"2023-10-06T11:15:12.560267+0000","last_clean":"2023-10-06T11:15:12.560267+0000","last_became_active":"2023-10-06T11:15:12.555085+0000","last_became_peered":"2023-10-06T11:15:12.555085+0000","last_unstale":"2023-10-06T11:15:12.560267+0000","last_undegraded":"2023-10-06T11:15:12.560267+0000","last_fullsized":"2023-10-06T11:15:12.560267+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:33:10.885181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.541446+0000","last_change":"2023-10-06T11:15:11.559110+0000","last_active":"2023-10-06T11:15:12.541446+0000","last_peered":"2023-10-06T11:15:12.541446+0000","last_clean":"2023-10-06T11:15:12.541446+0000","last_became_active":"2023-10-06T11:15:11.558912+0000","last_became_peered":"2023-10-06T11:15:11.558912+0000","last_unstale":"2023-10-06T11:15:12.541446+0000","last_undegraded":"2023-10-06T11:15:12.541446+0000","last_fullsized":"2023-10-06T11:15:12.541446+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:06.108506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.552517+0000","last_change":"2023-10-06T11:15:12.549680+0000","last_active":"2023-10-06T11:15:12.552517+0000","last_peered":"2023-10-06T11:15:12.552517+0000","last_clean":"2023-10-06T11:15:12.552517+0000","last_became_active":"2023-10-06T11:15:12.549430+0000","last_became_peered":"2023-10-06T11:15:12.549430+0000","last_unstale":"2023-10-06T11:15:12.552517+0000","last_undegraded":"2023-10-06T11:15:12.552517+0000","last_fullsized":"2023-10-06T11:15:12.552517+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:08:01.563879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.545507+0000","last_change":"2023-10-06T11:15:11.615843+0000","last_active":"2023-10-06T11:15:12.545507+0000","last_peered":"2023-10-06T11:15:12.545507+0000","last_clean":"2023-10-06T11:15:12.545507+0000","last_became_active":"2023-10-06T11:15:11.615583+0000","last_became_peered":"2023-10-06T11:15:11.615583+0000","last_unstale":"2023-10-06T11:15:12.545507+0000","last_undegraded":"2023-10-06T11:15:12.545507+0000","last_fullsized":"2023-10-06T11:15:12.545507+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:06.108506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.552477+0000","last_change":"2023-10-06T11:15:12.549291+0000","last_active":"2023-10-06T11:15:12.552477+0000","last_peered":"2023-10-06T11:15:12.552477+0000","last_clean":"2023-10-06T11:15:12.552477+0000","last_became_active":"2023-10-06T11:15:12.549022+0000","last_became_peered":"2023-10-06T11:15:12.549022+0000","last_unstale":"2023-10-06T11:15:12.552477+0000","last_undegraded":"2023-10-06T11:15:12.552477+0000","last_fullsized":"2023-10-06T11:15:12.552477+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:55:01.168186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.550406+0000","last_change":"2023-10-06T11:15:11.558367+0000","last_active":"2023-10-06T11:15:12.550406+0000","last_peered":"2023-10-06T11:15:12.550406+0000","last_clean":"2023-10-06T11:15:12.550406+0000","last_became_active":"2023-10-06T11:15:11.558080+0000","last_became_peered":"2023-10-06T11:15:11.558080+0000","last_unstale":"2023-10-06T11:15:12.550406+0000","last_undegraded":"2023-10-06T11:15:12.550406+0000","last_fullsized":"2023-10-06T11:15:12.550406+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:23:19.627689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.562425+0000","last_change":"2023-10-06T11:15:12.558280+0000","last_active":"2023-10-06T11:15:12.562425+0000","last_peered":"2023-10-06T11:15:12.562425+0000","last_clean":"2023-10-06T11:15:12.562425+0000","last_became_active":"2023-10-06T11:15:12.553474+0000","last_became_peered":"2023-10-06T11:15:12.553474+0000","last_unstale":"2023-10-06T11:15:12.562425+0000","last_undegraded":"2023-10-06T11:15:12.562425+0000","last_fullsized":"2023-10-06T11:15:12.562425+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:44:12.495772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.541142+0000","last_change":"2023-10-06T11:15:11.557480+0000","last_active":"2023-10-06T11:15:12.541142+0000","last_peered":"2023-10-06T11:15:12.541142+0000","last_clean":"2023-10-06T11:15:12.541142+0000","last_became_active":"2023-10-06T11:15:11.557275+0000","last_became_peered":"2023-10-06T11:15:11.557275+0000","last_unstale":"2023-10-06T11:15:12.541142+0000","last_undegraded":"2023-10-06T11:15:12.541142+0000","last_fullsized":"2023-10-06T11:15:12.541142+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:05.270236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.567817+0000","last_change":"2023-10-06T11:15:12.563042+0000","last_active":"2023-10-06T11:15:12.567817+0000","last_peered":"2023-10-06T11:15:12.567817+0000","last_clean":"2023-10-06T11:15:12.567817+0000","last_became_active":"2023-10-06T11:15:12.562720+0000","last_became_peered":"2023-10-06T11:15:12.562720+0000","last_unstale":"2023-10-06T11:15:12.567817+0000","last_undegraded":"2023-10-06T11:15:12.567817+0000","last_fullsized":"2023-10-06T11:15:12.567817+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:01:51.130934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.547145+0000","last_change":"2023-10-06T11:15:11.613556+0000","last_active":"2023-10-06T11:15:12.547145+0000","last_peered":"2023-10-06T11:15:12.547145+0000","last_clean":"2023-10-06T11:15:12.547145+0000","last_became_active":"2023-10-06T11:15:11.558706+0000","last_became_peered":"2023-10-06T11:15:11.558706+0000","last_unstale":"2023-10-06T11:15:12.547145+0000","last_undegraded":"2023-10-06T11:15:12.547145+0000","last_fullsized":"2023-10-06T11:15:12.547145+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:35.856632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.564356+0000","last_change":"2023-10-06T11:15:12.561897+0000","last_active":"2023-10-06T11:15:12.564356+0000","last_peered":"2023-10-06T11:15:12.564356+0000","last_clean":"2023-10-06T11:15:12.564356+0000","last_became_active":"2023-10-06T11:15:12.561644+0000","last_became_peered":"2023-10-06T11:15:12.561644+0000","last_unstale":"2023-10-06T11:15:12.564356+0000","last_undegraded":"2023-10-06T11:15:12.564356+0000","last_fullsized":"2023-10-06T11:15:12.564356+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:13:46.655508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.544963+0000","last_change":"2023-10-06T11:15:11.553743+0000","last_active":"2023-10-06T11:15:12.544963+0000","last_peered":"2023-10-06T11:15:12.544963+0000","last_clean":"2023-10-06T11:15:12.544963+0000","last_became_active":"2023-10-06T11:15:11.553490+0000","last_became_peered":"2023-10-06T11:15:11.553490+0000","last_unstale":"2023-10-06T11:15:12.544963+0000","last_undegraded":"2023-10-06T11:15:12.544963+0000","last_fullsized":"2023-10-06T11:15:12.544963+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:01:05.270236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":110,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.542640+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:15:12.542640+0000","last_peered":"2023-10-06T11:15:12.542640+0000","last_clean":"2023-10-06T11:15:12.542640+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:15:12.542640+0000","last_undegraded":"2023-10-06T11:15:12.542640+0000","last_fullsized":"2023-10-06T11:15:12.542640+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.561174+0000","last_change":"2023-10-06T11:15:12.553382+0000","last_active":"2023-10-06T11:15:12.561174+0000","last_peered":"2023-10-06T11:15:12.561174+0000","last_clean":"2023-10-06T11:15:12.561174+0000","last_became_active":"2023-10-06T11:15:12.553116+0000","last_became_peered":"2023-10-06T11:15:12.553116+0000","last_unstale":"2023-10-06T11:15:12.561174+0000","last_undegraded":"2023-10-06T11:15:12.561174+0000","last_fullsized":"2023-10-06T11:15:12.561174+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:12.927736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.547594+0000","last_change":"2023-10-06T11:15:11.614069+0000","last_active":"2023-10-06T11:15:12.547594+0000","last_peered":"2023-10-06T11:15:12.547594+0000","last_clean":"2023-10-06T11:15:12.547594+0000","last_became_active":"2023-10-06T11:15:11.613023+0000","last_became_peered":"2023-10-06T11:15:11.613023+0000","last_unstale":"2023-10-06T11:15:12.547594+0000","last_undegraded":"2023-10-06T11:15:12.547594+0000","last_fullsized":"2023-10-06T11:15:12.547594+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:00:36.479436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":101,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.547352+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:15:12.547352+0000","last_peered":"2023-10-06T11:15:12.547352+0000","last_clean":"2023-10-06T11:15:12.547352+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:15:12.547352+0000","last_undegraded":"2023-10-06T11:15:12.547352+0000","last_fullsized":"2023-10-06T11:15:12.547352+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.566949+0000","last_change":"2023-10-06T11:15:12.557454+0000","last_active":"2023-10-06T11:15:12.566949+0000","last_peered":"2023-10-06T11:15:12.566949+0000","last_clean":"2023-10-06T11:15:12.566949+0000","last_became_active":"2023-10-06T11:15:12.557183+0000","last_became_peered":"2023-10-06T11:15:12.557183+0000","last_unstale":"2023-10-06T11:15:12.566949+0000","last_undegraded":"2023-10-06T11:15:12.566949+0000","last_fullsized":"2023-10-06T11:15:12.566949+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:09:25.439474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.555331+0000","last_change":"2023-10-06T11:15:11.557485+0000","last_active":"2023-10-06T11:15:12.555331+0000","last_peered":"2023-10-06T11:15:12.555331+0000","last_clean":"2023-10-06T11:15:12.555331+0000","last_became_active":"2023-10-06T11:15:11.556885+0000","last_became_peered":"2023-10-06T11:15:11.556885+0000","last_unstale":"2023-10-06T11:15:12.555331+0000","last_undegraded":"2023-10-06T11:15:12.555331+0000","last_fullsized":"2023-10-06T11:15:12.555331+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:04:48.873690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":100,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.541769+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:15:12.541769+0000","last_peered":"2023-10-06T11:15:12.541769+0000","last_clean":"2023-10-06T11:15:12.541769+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:15:12.541769+0000","last_undegraded":"2023-10-06T11:15:12.541769+0000","last_fullsized":"2023-10-06T11:15:12.541769+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":244,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.548590+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:15:12.548590+0000","last_peered":"2023-10-06T11:15:12.548590+0000","last_clean":"2023-10-06T11:15:12.548590+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:15:12.548590+0000","last_undegraded":"2023-10-06T11:15:12.548590+0000","last_fullsized":"2023-10-06T11:15:12.548590+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.552554+0000","last_change":"2023-10-06T11:15:12.549973+0000","last_active":"2023-10-06T11:15:12.552554+0000","last_peered":"2023-10-06T11:15:12.552554+0000","last_clean":"2023-10-06T11:15:12.552554+0000","last_became_active":"2023-10-06T11:15:12.549720+0000","last_became_peered":"2023-10-06T11:15:12.549720+0000","last_unstale":"2023-10-06T11:15:12.552554+0000","last_undegraded":"2023-10-06T11:15:12.552554+0000","last_fullsized":"2023-10-06T11:15:12.552554+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:56:21.022912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.10","version":"124'8","reported_seq":18,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.569730+0000","last_change":"2023-10-06T11:15:11.562606+0000","last_active":"2023-10-06T11:15:12.569730+0000","last_peered":"2023-10-06T11:15:12.569730+0000","last_clean":"2023-10-06T11:15:12.569730+0000","last_became_active":"2023-10-06T11:15:11.562331+0000","last_became_peered":"2023-10-06T11:15:11.562331+0000","last_unstale":"2023-10-06T11:15:12.569730+0000","last_undegraded":"2023-10-06T11:15:12.569730+0000","last_fullsized":"2023-10-06T11:15:12.569730+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:26.937119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":94,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.550300+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:15:12.550300+0000","last_peered":"2023-10-06T11:15:12.550300+0000","last_clean":"2023-10-06T11:15:12.550300+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:15:12.550300+0000","last_undegraded":"2023-10-06T11:15:12.550300+0000","last_fullsized":"2023-10-06T11:15:12.550300+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.568209+0000","last_change":"2023-10-06T11:15:12.563691+0000","last_active":"2023-10-06T11:15:12.568209+0000","last_peered":"2023-10-06T11:15:12.568209+0000","last_clean":"2023-10-06T11:15:12.568209+0000","last_became_active":"2023-10-06T11:15:12.563214+0000","last_became_peered":"2023-10-06T11:15:12.563214+0000","last_unstale":"2023-10-06T11:15:12.568209+0000","last_undegraded":"2023-10-06T11:15:12.568209+0000","last_fullsized":"2023-10-06T11:15:12.568209+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:23:20.636047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":10,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.550473+0000","last_change":"2023-10-06T11:15:11.616871+0000","last_active":"2023-10-06T11:15:12.550473+0000","last_peered":"2023-10-06T11:15:12.550473+0000","last_clean":"2023-10-06T11:15:12.550473+0000","last_became_active":"2023-10-06T11:15:11.616308+0000","last_became_peered":"2023-10-06T11:15:11.616308+0000","last_unstale":"2023-10-06T11:15:12.550473+0000","last_undegraded":"2023-10-06T11:15:12.550473+0000","last_fullsized":"2023-10-06T11:15:12.550473+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:33:56.619203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":94,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.548669+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:15:12.548669+0000","last_peered":"2023-10-06T11:15:12.548669+0000","last_clean":"2023-10-06T11:15:12.548669+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:15:12.548669+0000","last_undegraded":"2023-10-06T11:15:12.548669+0000","last_fullsized":"2023-10-06T11:15:12.548669+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.555380+0000","last_change":"2023-10-06T11:15:12.552483+0000","last_active":"2023-10-06T11:15:12.555380+0000","last_peered":"2023-10-06T11:15:12.555380+0000","last_clean":"2023-10-06T11:15:12.555380+0000","last_became_active":"2023-10-06T11:15:12.552230+0000","last_became_peered":"2023-10-06T11:15:12.552230+0000","last_unstale":"2023-10-06T11:15:12.555380+0000","last_undegraded":"2023-10-06T11:15:12.555380+0000","last_fullsized":"2023-10-06T11:15:12.555380+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:45:25.285981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.13","version":"124'2","reported_seq":12,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.565208+0000","last_change":"2023-10-06T11:15:11.612981+0000","last_active":"2023-10-06T11:15:12.565208+0000","last_peered":"2023-10-06T11:15:12.565208+0000","last_clean":"2023-10-06T11:15:12.565208+0000","last_became_active":"2023-10-06T11:15:11.612693+0000","last_became_peered":"2023-10-06T11:15:11.612693+0000","last_unstale":"2023-10-06T11:15:12.565208+0000","last_undegraded":"2023-10-06T11:15:12.565208+0000","last_fullsized":"2023-10-06T11:15:12.565208+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:37.193218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":114,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.544242+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:15:12.544242+0000","last_peered":"2023-10-06T11:15:12.544242+0000","last_clean":"2023-10-06T11:15:12.544242+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:15:12.544242+0000","last_undegraded":"2023-10-06T11:15:12.544242+0000","last_fullsized":"2023-10-06T11:15:12.544242+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.567902+0000","last_change":"2023-10-06T11:15:12.560268+0000","last_active":"2023-10-06T11:15:12.567902+0000","last_peered":"2023-10-06T11:15:12.567902+0000","last_clean":"2023-10-06T11:15:12.567902+0000","last_became_active":"2023-10-06T11:15:12.559639+0000","last_became_peered":"2023-10-06T11:15:12.559639+0000","last_unstale":"2023-10-06T11:15:12.567902+0000","last_undegraded":"2023-10-06T11:15:12.567902+0000","last_fullsized":"2023-10-06T11:15:12.567902+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:15:40.228447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.14","version":"124'6","reported_seq":16,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.574922+0000","last_change":"2023-10-06T11:15:11.616053+0000","last_active":"2023-10-06T11:15:12.574922+0000","last_peered":"2023-10-06T11:15:12.574922+0000","last_clean":"2023-10-06T11:15:12.574922+0000","last_became_active":"2023-10-06T11:15:11.615774+0000","last_became_peered":"2023-10-06T11:15:11.615774+0000","last_unstale":"2023-10-06T11:15:12.574922+0000","last_undegraded":"2023-10-06T11:15:12.574922+0000","last_fullsized":"2023-10-06T11:15:12.574922+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:35:57.001079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":101,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.555211+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:15:12.555211+0000","last_peered":"2023-10-06T11:15:12.555211+0000","last_clean":"2023-10-06T11:15:12.555211+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:15:12.555211+0000","last_undegraded":"2023-10-06T11:15:12.555211+0000","last_fullsized":"2023-10-06T11:15:12.555211+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":9,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.560234+0000","last_change":"2023-10-06T11:15:12.554230+0000","last_active":"2023-10-06T11:15:12.560234+0000","last_peered":"2023-10-06T11:15:12.560234+0000","last_clean":"2023-10-06T11:15:12.560234+0000","last_became_active":"2023-10-06T11:15:12.553964+0000","last_became_peered":"2023-10-06T11:15:12.553964+0000","last_unstale":"2023-10-06T11:15:12.560234+0000","last_undegraded":"2023-10-06T11:15:12.560234+0000","last_fullsized":"2023-10-06T11:15:12.560234+0000","mapping_epoch":123,"log_start":"0'0","ondisk_log_start":"0'0","created":123,"last_epoch_clean":124,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:11.533426+0000","last_clean_scrub_stamp":"2023-10-06T11:15:11.533426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:45:49.982194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.15","version":"124'3","reported_seq":13,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.569771+0000","last_change":"2023-10-06T11:15:11.560790+0000","last_active":"2023-10-06T11:15:12.569771+0000","last_peered":"2023-10-06T11:15:12.569771+0000","last_clean":"2023-10-06T11:15:12.569771+0000","last_became_active":"2023-10-06T11:15:11.560492+0000","last_became_peered":"2023-10-06T11:15:11.560492+0000","last_unstale":"2023-10-06T11:15:12.569771+0000","last_undegraded":"2023-10-06T11:15:12.569771+0000","last_fullsized":"2023-10-06T11:15:12.569771+0000","mapping_epoch":122,"log_start":"0'0","ondisk_log_start":"0'0","created":122,"last_epoch_clean":123,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:15:10.525068+0000","last_clean_scrub_stamp":"2023-10-06T11:15:10.525068+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:53:35.856632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":101,"reported_epoch":124,"state":"active+clean","last_fresh":"2023-10-06T11:15:12.555944+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:15:12.555944+0000","last_peered":"2023-10-06T11:15:12.555944+0000","last_clean":"2023-10-06T11:15:12.555944+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:15:12.555944+0000","last_undegraded":"2023-10-06T11:15:12.555944+0000","last_fullsized":"2023-10-06T11:15:12.555944+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":20,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":19,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574967,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299408,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072432,"statfs":{"total":96636764160,"available":96330170368,"internally_reserved":0,"allocated":2170880,"data_stored":1307178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.51600000000000001,"15min":0.624},"min":{"1min":0.252,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.68899999999999995,"5min":4.407,"15min":23.908999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.48699999999999999,"15min":0.57499999999999996},"min":{"1min":0.26900000000000002,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.66600000000000004,"5min":0.69799999999999995,"15min":9.3230000000000004},"last":0.67500000000000004}]},{"osd":1,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51200000000000001,"15min":0.56100000000000005},"min":{"1min":0.33200000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.73399999999999999,"5min":2.4689999999999999,"15min":9.2360000000000007},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47199999999999998,"15min":0.503},"min":{"1min":0.33100000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.70199999999999996,"5min":0.78900000000000003,"15min":4.327},"last":0.64400000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54200000000000004,"15min":0.51800000000000002},"min":{"1min":0.34399999999999997,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.748,"5min":4.3120000000000003,"15min":4.3120000000000003},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.53700000000000003,"15min":0.55700000000000005},"min":{"1min":0.311,"5min":0.31,"15min":0.29999999999999999},"max":{"1min":0.71599999999999997,"5min":3.0600000000000001,"15min":4.7309999999999999},"last":0.70699999999999996}]},{"osd":3,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.54700000000000004,"15min":0.53700000000000003},"min":{"1min":0.32600000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.60099999999999998,"5min":4.5190000000000001,"15min":4.5190000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55600000000000005,"15min":0.59799999999999998},"min":{"1min":0.40200000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.68100000000000005,"5min":3.0070000000000001,"15min":9.3879999999999999},"last":0.624}]},{"osd":4,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.498,"15min":0.48799999999999999},"min":{"1min":0.32700000000000001,"5min":0.26000000000000001,"15min":0.24399999999999999},"max":{"1min":0.59799999999999998,"5min":4.6639999999999997,"15min":4.6639999999999997},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.53300000000000003,"15min":0.53400000000000003},"min":{"1min":0.28499999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.69199999999999995,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":0.66100000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.495,"15min":0.56000000000000005},"min":{"1min":0.32900000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.70999999999999996,"5min":0.79700000000000004,"15min":9.3499999999999996},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.497,"15min":0.54400000000000004},"min":{"1min":0.30099999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.65200000000000002,"5min":0.83399999999999996,"15min":4.444},"last":0.51500000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.59799999999999998},"min":{"1min":0.38100000000000001,"5min":0.32400000000000001,"15min":0.29199999999999998},"max":{"1min":0.64800000000000002,"5min":0.81399999999999995,"15min":9.4969999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.60299999999999998,"15min":0.61899999999999999},"min":{"1min":0.36699999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.72299999999999998,"5min":4.4669999999999996,"15min":7.2039999999999997},"last":0.61199999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574969,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311104,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060736,"statfs":{"total":96636764160,"available":96318193664,"internally_reserved":0,"allocated":1564672,"data_stored":714475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.57899999999999996,"15min":0.52200000000000002},"min":{"1min":0.30299999999999999,"5min":0.187,"15min":0.187},"max":{"1min":9.5549999999999997,"5min":9.5549999999999997,"15min":9.5549999999999997},"last":0.65100000000000002},{"interface":"front","average":{"1min":1.032,"5min":0.63500000000000001,"15min":0.56299999999999994},"min":{"1min":0.38400000000000001,"5min":0.254,"15min":0.254},"max":{"1min":9.4659999999999993,"5min":9.4659999999999993,"15min":9.4659999999999993},"last":0.67500000000000004}]},{"osd":1,"last update":"Fri Oct 6 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.47199999999999998,"15min":0.48599999999999999},"min":{"1min":0.33400000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.80300000000000005,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56499999999999995,"15min":0.51600000000000001},"min":{"1min":0.32900000000000001,"5min":0.216,"15min":0.216},"max":{"1min":2.238,"5min":5.2670000000000003,"15min":5.2670000000000003},"last":0.71499999999999997}]},{"osd":2,"last update":"Fri Oct 6 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.47999999999999998,"15min":0.498},"min":{"1min":0.255,"5min":0.252,"15min":0.252},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":7.0659999999999998},"last":0.498},{"interface":"front","average":{"1min":0.503,"5min":0.48699999999999999,"15min":0.51900000000000002},"min":{"1min":0.33700000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.72899999999999998,"5min":1.0069999999999999,"15min":7.0819999999999999},"last":0.63600000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.55000000000000004,"15min":0.51600000000000001},"min":{"1min":0.38400000000000001,"5min":0.317,"15min":0.25800000000000001},"max":{"1min":3.871,"5min":3.871,"15min":3.871},"last":0.62},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.52700000000000002,"15min":0.53300000000000003},"min":{"1min":0.34799999999999998,"5min":0.316,"15min":0.312},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.60899999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.46000000000000002,"15min":0.48399999999999999},"min":{"1min":0.26800000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.628,"5min":0.88,"15min":0.88},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.51300000000000001,"15min":0.53900000000000003},"min":{"1min":0.32200000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.73399999999999999,"5min":0.82399999999999995,"15min":1.0680000000000001},"last":0.46999999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.503,"15min":0.52100000000000002},"min":{"1min":0.375,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.433},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.61199999999999999,"15min":0.58699999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":7.1379999999999999,"5min":7.1379999999999999,"15min":7.1379999999999999},"last":0.51000000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:14:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56599999999999995,"15min":0.56899999999999995},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56599999999999995,"15min":0.58799999999999997},"min":{"1min":0.42799999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.88400000000000001},"last":0.52600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574968,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311684,"kb_used_data":2108,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060156,"statfs":{"total":96636764160,"available":96317599744,"internally_reserved":0,"allocated":2158592,"data_stored":1305622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.45900000000000002,"15min":0.379},"min":{"1min":0.20499999999999999,"5min":0.186,"15min":0.186},"max":{"1min":0.67000000000000004,"5min":13.393000000000001,"15min":13.393000000000001},"last":0.378},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.45700000000000002,"15min":0.38200000000000001},"min":{"1min":0.23599999999999999,"5min":0.22500000000000001,"15min":0.19700000000000001},"max":{"1min":0.64900000000000002,"5min":11.462,"15min":11.462},"last":0.441}]},{"osd":2,"last update":"Fri Oct 6 11:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.40400000000000003,"15min":0.35999999999999999},"min":{"1min":0.23599999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.47999999999999998,"5min":8.0470000000000006,"15min":8.0470000000000006},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.432,"15min":0.40500000000000003},"min":{"1min":0.26100000000000001,"5min":0.22800000000000001,"15min":0.20999999999999999},"max":{"1min":0.74299999999999999,"5min":4.8630000000000004,"15min":4.8630000000000004},"last":0.45700000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.44900000000000001,"15min":0.42399999999999999},"min":{"1min":0.313,"5min":0.252,"15min":0.252},"max":{"1min":0.71299999999999997,"5min":4.8029999999999999,"15min":4.8029999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.37,"5min":0.42999999999999999,"15min":0.39100000000000001},"min":{"1min":0.27600000000000002,"5min":0.217,"15min":0.217},"max":{"1min":0.68799999999999994,"5min":5.8700000000000001,"15min":5.8700000000000001},"last":0.52500000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.51800000000000002,"15min":0.51500000000000001},"min":{"1min":0.38200000000000001,"5min":0.29499999999999998,"15min":0.28199999999999997},"max":{"1min":0.68500000000000005,"5min":1.264,"15min":1.264},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.60899999999999999,"15min":0.56599999999999995},"min":{"1min":0.35199999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.88600000000000001,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.84099999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.58799999999999997,"15min":0.56399999999999995},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71699999999999997,"5min":3.4390000000000001,"15min":3.4390000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.66000000000000003,"15min":0.58399999999999996},"min":{"1min":0.36799999999999999,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.69799999999999995,"5min":9.3829999999999991,"15min":9.3829999999999991},"last":0.91500000000000004}]},{"osd":6,"last update":"Fri Oct 6 11:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.61899999999999999,"15min":0.58299999999999996},"min":{"1min":0.35999999999999999,"5min":0.34999999999999998,"15min":0.315},"max":{"1min":0.86699999999999999,"5min":3.4750000000000001,"15min":3.4750000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60999999999999999,"15min":0.58899999999999997},"min":{"1min":0.40400000000000003,"5min":0.379,"15min":0.36699999999999999},"max":{"1min":0.748,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.85799999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:14:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.64500000000000002,"15min":0.60999999999999999},"min":{"1min":0.42299999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.92200000000000004,"5min":4.7290000000000001,"15min":4.7290000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.60999999999999999,"15min":0.59099999999999997},"min":{"1min":0.42099999999999999,"5min":0.378,"15min":0.374},"max":{"1min":0.89500000000000002,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.89200000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574967,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302912,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068928,"statfs":{"total":96636764160,"available":96326582272,"internally_reserved":0,"allocated":1564672,"data_stored":713887,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.42099999999999999,"15min":0.46800000000000003},"min":{"1min":0.20399999999999999,"5min":0.184,"15min":0.184},"max":{"1min":0.501,"5min":8.4239999999999995,"15min":36.097999999999999},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.43099999999999999,"15min":0.377},"min":{"1min":0.22,"5min":0.20799999999999999,"15min":0.182},"max":{"1min":0.52000000000000002,"5min":7.2990000000000004,"15min":7.2990000000000004},"last":0.23999999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.44800000000000001,"15min":0.50600000000000001},"min":{"1min":0.28199999999999997,"5min":0.221,"15min":0.217},"max":{"1min":0.61699999999999999,"5min":8.6080000000000005,"15min":36.07},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.442,"15min":0.40400000000000003},"min":{"1min":0.27100000000000002,"5min":0.23400000000000001,"15min":0.219},"max":{"1min":0.60699999999999998,"5min":6.7800000000000002,"15min":6.7800000000000002},"last":0.35199999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.36599999999999999,"15min":0.39300000000000002},"min":{"1min":0.255,"5min":0.223,"15min":0.223},"max":{"1min":0.55000000000000004,"5min":1.863,"15min":8.4130000000000003},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.48699999999999999,"15min":0.55700000000000005},"min":{"1min":0.25800000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.65200000000000002,"5min":8.4570000000000007,"15min":35.959000000000003},"last":0.33700000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55900000000000005,"15min":0.56200000000000006},"min":{"1min":0.39300000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.85099999999999998,"5min":2.427,"15min":2.427},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.65400000000000003,"15min":0.73299999999999998},"min":{"1min":0.42799999999999999,"5min":0.34399999999999997,"15min":0.29299999999999998},"max":{"1min":0.94999999999999996,"5min":8.2919999999999998,"15min":36.005000000000003},"last":0.55600000000000005}]},{"osd":5,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.628,"15min":0.57899999999999996},"min":{"1min":0.38900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.89600000000000002,"5min":6.6699999999999999,"15min":6.6699999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55100000000000005,"15min":0.55200000000000005},"min":{"1min":0.372,"5min":0.315,"15min":0.315},"max":{"1min":0.82599999999999996,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.54700000000000004}]},{"osd":6,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.66700000000000004,"15min":0.73399999999999999},"min":{"1min":0.42199999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.98699999999999999,"5min":8.2479999999999993,"15min":36.037999999999997},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.66400000000000003,"15min":0.63600000000000001},"min":{"1min":0.495,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.97199999999999998,"5min":6.7110000000000003,"15min":6.7110000000000003},"last":0.59499999999999997}]},{"osd":7,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.65500000000000003,"15min":0.623},"min":{"1min":0.44,"5min":0.371,"15min":0.371},"max":{"1min":0.93100000000000005,"5min":6.742,"15min":6.742},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57899999999999996,"15min":0.56899999999999995},"min":{"1min":0.41499999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.96199999999999997,"5min":1.917,"15min":1.917},"last":0.50600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574968,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315200,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94056640,"statfs":{"total":96636764160,"available":96313999360,"internally_reserved":0,"allocated":1564672,"data_stored":714419,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.313,"15min":0.31},"min":{"1min":0.246,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.36399999999999999,"5min":0.56699999999999995,"15min":0.57499999999999996},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.38400000000000001,"15min":0.38200000000000001},"min":{"1min":0.20999999999999999,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.438,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.40600000000000003}]},{"osd":1,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.373,"15min":0.372},"min":{"1min":0.252,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.47699999999999998,"5min":0.745,"15min":0.745},"last":0.372},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.35199999999999998,"15min":0.34999999999999998},"min":{"1min":0.26200000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.52700000000000002,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.34499999999999997}]},{"osd":3,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.35599999999999998,"15min":0.36599999999999999},"min":{"1min":0.27100000000000002,"5min":0.23300000000000001,"15min":0.23200000000000001},"max":{"1min":0.40000000000000002,"5min":0.58699999999999997,"15min":0.629},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.36499999999999999,"15min":0.36399999999999999},"min":{"1min":0.25900000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.42199999999999999,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.29599999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.505,"15min":0.52500000000000002},"min":{"1min":0.36199999999999999,"5min":0.30599999999999999,"15min":0.30299999999999999},"max":{"1min":0.70899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.52000000000000002,"15min":0.54600000000000004},"min":{"1min":0.35499999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.72299999999999998,"5min":0.80400000000000005,"15min":0.84899999999999998},"last":0.81999999999999995}]},{"osd":5,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.52600000000000002,"15min":0.54100000000000004},"min":{"1min":0.38300000000000001,"5min":0.33100000000000002,"15min":0.32400000000000001},"max":{"1min":0.71699999999999997,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.54800000000000004,"15min":0.55200000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.78100000000000003,"5min":0.878,"15min":0.878},"last":0.84499999999999997}]},{"osd":6,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.56499999999999995,"15min":0.57899999999999996},"min":{"1min":0.38700000000000001,"5min":0.36799999999999999,"15min":0.32600000000000001},"max":{"1min":0.73799999999999999,"5min":0.85199999999999998,"15min":0.86299999999999999},"last":0.746},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.55900000000000005,"15min":0.57099999999999995},"min":{"1min":0.40699999999999997,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.70699999999999996,"5min":0.878,"15min":0.88600000000000001},"last":0.78400000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.37,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.67700000000000005,"5min":1.139,"15min":1.139},"last":0.624},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.55800000000000005,"15min":0.56699999999999995},"min":{"1min":0.41699999999999998,"5min":0.38800000000000001,"15min":0.38200000000000001},"max":{"1min":0.69699999999999995,"5min":0.89600000000000002,"15min":0.90500000000000003},"last":0.80600000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574968,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307016,"kb_used_data":1536,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064824,"statfs":{"total":96636764160,"available":96322379776,"internally_reserved":0,"allocated":1572864,"data_stored":715437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.31,"15min":0.31900000000000001},"min":{"1min":0.222,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.45500000000000002,"5min":0.48899999999999999,"15min":1.095},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35199999999999998,"15min":0.38100000000000001},"min":{"1min":0.27100000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.52700000000000002,"5min":0.53900000000000003,"15min":1.7210000000000001},"last":0.23000000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.314,"15min":0.311},"min":{"1min":0.23400000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.65400000000000003},"last":0.251},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.34100000000000003,"15min":0.35899999999999999},"min":{"1min":0.25800000000000001,"5min":0.188,"15min":0.188},"max":{"1min":0.53100000000000003,"5min":0.53400000000000003,"15min":1.196},"last":0.27900000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.34799999999999998,"15min":0.374},"min":{"1min":0.251,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.47799999999999998,"5min":0.73499999999999999,"15min":1.7729999999999999},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.39700000000000002,"15min":0.41099999999999998},"min":{"1min":0.308,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.57699999999999996,"5min":0.58599999999999997,"15min":1.224},"last":0.37}]},{"osd":4,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.50900000000000001,"15min":0.54900000000000004},"min":{"1min":0.32100000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":1.694},"last":0.5},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51700000000000002,"15min":0.53700000000000003},"min":{"1min":0.35899999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.56399999999999995}]},{"osd":5,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.53100000000000003,"15min":0.53200000000000003},"min":{"1min":0.35599999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.878},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53900000000000003,"15min":0.55600000000000005},"min":{"1min":0.39000000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.746,"5min":0.75800000000000001,"15min":1.165},"last":0.59799999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.55300000000000005,"15min":0.57999999999999996},"min":{"1min":0.372,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.79200000000000004,"5min":0.85099999999999998,"15min":1.1359999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55900000000000005,"15min":0.58799999999999997},"min":{"1min":0.42999999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79700000000000004,"5min":0.82199999999999995,"15min":1.7470000000000001},"last":0.61799999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:14:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55000000000000004,"15min":0.57799999999999996},"min":{"1min":0.38900000000000001,"5min":0.35699999999999998,"15min":0.35599999999999998},"max":{"1min":0.754,"5min":0.85399999999999998,"15min":1.657},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56100000000000005,"15min":0.57199999999999995},"min":{"1min":0.38,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.82099999999999995,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.60699999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574967,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302908,"kb_used_data":1524,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068932,"statfs":{"total":96636764160,"available":96326586368,"internally_reserved":0,"allocated":1560576,"data_stored":715184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.45700000000000002,"15min":0.53500000000000003},"min":{"1min":0.216,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":2.6619999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.47499999999999998,"15min":0.49099999999999999},"min":{"1min":0.224,"5min":0.215,"15min":0.215},"max":{"1min":0.69999999999999996,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.51400000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:14:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47099999999999997,"15min":0.55600000000000005},"min":{"1min":0.27300000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":1,"5min":1,"15min":2.8650000000000002},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.48199999999999998,"15min":0.56299999999999994},"min":{"1min":0.27400000000000002,"5min":0.26200000000000001,"15min":0.25800000000000001},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":2.7610000000000001},"last":0.58899999999999997}]},{"osd":2,"last update":"Fri Oct 6 11:14:53 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.49299999999999999,"15min":0.54100000000000004},"min":{"1min":0.28499999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.749,"5min":0.76000000000000001,"15min":1.6910000000000001},"last":0.442},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54200000000000004,"15min":0.58699999999999997},"min":{"1min":0.41099999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71899999999999997,"5min":0.93899999999999995,"15min":1.718},"last":0.60499999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:14:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.55300000000000005,"15min":0.59999999999999998},"min":{"1min":0.33400000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":2.387,"5min":2.387,"15min":2.677},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.27500000000000002},"max":{"1min":1.784,"5min":1.784,"15min":1.784},"last":0.55700000000000005}]},{"osd":5,"last update":"Fri Oct 6 11:14:53 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.47099999999999997,"15min":0.48399999999999999},"min":{"1min":0.315,"5min":0.23499999999999999,"15min":0.23200000000000001},"max":{"1min":0.73199999999999998,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.495,"15min":0.52600000000000002},"min":{"1min":0.29299999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.58899999999999997,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.65500000000000003}]},{"osd":6,"last update":"Fri Oct 6 11:14:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.505,"15min":0.52100000000000002},"min":{"1min":0.31,"5min":0.30499999999999999,"15min":0.252},"max":{"1min":0.63400000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.502,"5min":0.53500000000000003,"15min":0.56499999999999995},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.64800000000000002,"5min":0.85799999999999998,"15min":1.165},"last":0.63300000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:14:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.55300000000000005,"15min":0.55700000000000005},"min":{"1min":0.35399999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.74399999999999999,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.62},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.56100000000000005,"15min":0.59299999999999997},"min":{"1min":0.318,"5min":0.317,"15min":0.317},"max":{"1min":0.67900000000000005,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.64300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574969,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311104,"kb_used_data":1528,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060736,"statfs":{"total":96636764160,"available":96318193664,"internally_reserved":0,"allocated":1564672,"data_stored":715206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.45400000000000001,"15min":0.60799999999999998},"min":{"1min":0.34799999999999998,"5min":0.23100000000000001,"15min":0.20499999999999999},"max":{"1min":0.61099999999999999,"5min":0.72599999999999998,"15min":5.0490000000000004},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.434,"5min":0.45200000000000001,"15min":0.58499999999999996},"min":{"1min":0.253,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.65500000000000003,"5min":0.78100000000000003,"15min":5.1449999999999996},"last":0.53500000000000003}]},{"osd":1,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.46500000000000002,"15min":0.48099999999999998},"min":{"1min":0.29599999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.629,"5min":0.81399999999999995,"15min":0.97199999999999998},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.47899999999999998,"5min":0.47699999999999998,"15min":0.51000000000000001},"min":{"1min":0.30099999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.58599999999999997,"5min":0.70199999999999996,"15min":1.8799999999999999},"last":0.51100000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.50700000000000001,"15min":0.54900000000000004},"min":{"1min":0.30099999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.60999999999999999,"5min":0.79800000000000004,"15min":4.234},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52600000000000002,"15min":0.55800000000000005},"min":{"1min":0.40100000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.64000000000000001,"5min":0.81000000000000005,"15min":1.0369999999999999},"last":0.627}]},{"osd":3,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48299999999999998,"15min":0.627},"min":{"1min":0.33200000000000002,"5min":0.30399999999999999,"15min":0.27700000000000002},"max":{"1min":0.60699999999999998,"5min":0.82299999999999995,"15min":5.2169999999999996},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.51300000000000001,"15min":0.54000000000000004},"min":{"1min":0.373,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.56299999999999994,"5min":0.82699999999999996,"15min":1.008},"last":0.67600000000000005}]},{"osd":4,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.46999999999999997,"15min":0.51100000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.23999999999999999},"max":{"1min":0.61499999999999999,"5min":0.83399999999999996,"15min":1.917},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46899999999999997,"15min":0.52300000000000002},"min":{"1min":0.35599999999999998,"5min":0.24399999999999999,"15min":0.23899999999999999},"max":{"1min":0.628,"5min":0.71899999999999997,"15min":0.87},"last":0.61099999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.55100000000000005},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.64700000000000002,"5min":0.77100000000000002,"15min":2.0139999999999998},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55400000000000005,"15min":0.60199999999999998},"min":{"1min":0.43099999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.64000000000000001,"5min":0.82899999999999996,"15min":1.9470000000000001},"last":0.69499999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:14:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52100000000000002,"15min":0.57399999999999995},"min":{"1min":0.28799999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.65500000000000003,"5min":0.81000000000000005,"15min":0.96499999999999997},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.55200000000000005,"15min":0.60099999999999998},"min":{"1min":0.376,"5min":0.316,"15min":0.28799999999999998},"max":{"1min":0.68000000000000005,"5min":0.79900000000000004,"15min":1.4119999999999999},"last":0.75600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:15:21.489 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T11:15:21.490 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T11:15:21.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.642+0000 7fb2ea390700 1 Processor -- start 2023-10-06T11:15:21.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.642+0000 7fb2ea390700 1 -- start start 2023-10-06T11:15:21.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.643+0000 7fb2ea390700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb2e40b07d0 0x7fb2e4159d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:21.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.643+0000 7fb2ea390700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb2e415d3f0 0x7fb2e40697b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:21.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.643+0000 7fb2ea390700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2e406a150 con 0x7fb2e4069cf0 2023-10-06T11:15:21.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.643+0000 7fb2ea390700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2e415e390 con 0x7fb2e40b07d0 2023-10-06T11:15:21.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.643+0000 7fb2ea390700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e40ac190 con 0x7fb2e415d3f0 2023-10-06T11:15:21.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.643+0000 7fb2e3fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb2e40b07d0 0x7fb2e4159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:21.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.643+0000 7fb2e3fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb2e40b07d0 0x7fb2e4159d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49192/0 (socket says 172.21.15.146:49192) 2023-10-06T11:15:21.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.643+0000 7fb2e3fff700 1 -- 172.21.15.146:0/458589041 learned_addr learned my addr 172.21.15.146:0/458589041 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:21.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.644+0000 7fb2e37fe700 1 --2- 172.21.15.146:0/458589041 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb2e415d3f0 0x7fb2e40697b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:21.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.644+0000 7fb2e3fff700 1 -- 172.21.15.146:0/458589041 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb2e415d3f0 msgr2=0x7fb2e40697b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:21.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.644+0000 7fb2e3fff700 1 --2- 172.21.15.146:0/458589041 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb2e415d3f0 0x7fb2e40697b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:21.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.644+0000 7fb2e3fff700 1 -- 172.21.15.146:0/458589041 >> v1:172.21.15.151:6789/0 conn(0x7fb2e4069cf0 legacy=0x7fb2e4068580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:21.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.644+0000 7fb2e3fff700 1 -- 172.21.15.146:0/458589041 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2e4068260 con 0x7fb2e40b07d0 2023-10-06T11:15:21.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.644+0000 7fb2e3fff700 1 --2- 172.21.15.146:0/458589041 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2e40b07d0 0x7fb2e4159d40 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7fb2d40099b0 tx=0x7fb2d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8de14f034e9281f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:21.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.644+0000 7fb2e2ffd700 1 -- 172.21.15.146:0/458589041 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d400b860 con 0x7fb2e40b07d0 2023-10-06T11:15:21.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.644+0000 7fb2e2ffd700 1 -- 172.21.15.146:0/458589041 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d400b9c0 con 0x7fb2e40b07d0 2023-10-06T11:15:21.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.644+0000 7fb2e2ffd700 1 -- 172.21.15.146:0/458589041 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d400bd60 con 0x7fb2e40b07d0 2023-10-06T11:15:21.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.644+0000 7fb2ea390700 1 -- 172.21.15.146:0/458589041 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2e40b07d0 msgr2=0x7fb2e4159d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:21.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.644+0000 7fb2ea390700 1 --2- 172.21.15.146:0/458589041 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2e40b07d0 0x7fb2e4159d40 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7fb2d40099b0 tx=0x7fb2d4009250 comp rx=0 tx=0).stop 2023-10-06T11:15:21.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.644+0000 7fb2ea390700 1 -- 172.21.15.146:0/458589041 shutdown_connections 2023-10-06T11:15:21.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.644+0000 7fb2ea390700 1 --2- 172.21.15.146:0/458589041 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2e40b07d0 0x7fb2e4159d40 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:21.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.644+0000 7fb2ea390700 1 --2- 172.21.15.146:0/458589041 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb2e415d3f0 0x7fb2e40697b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:21.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.645+0000 7fb2ea390700 1 -- 172.21.15.146:0/458589041 >> 172.21.15.146:0/458589041 conn(0x7fb2e4067c50 msgr2=0x7fb2e40ce430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:21.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.645+0000 7fb2ea390700 1 -- 172.21.15.146:0/458589041 shutdown_connections 2023-10-06T11:15:21.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.645+0000 7fb2ea390700 1 -- 172.21.15.146:0/458589041 wait complete. 2023-10-06T11:15:21.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.646+0000 7fb2ea390700 1 Processor -- start 2023-10-06T11:15:21.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.646+0000 7fb2ea390700 1 -- start start 2023-10-06T11:15:21.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.647+0000 7fb2ea390700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2e4069cf0 0x7fb2e414af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:21.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.647+0000 7fb2ea390700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2e40b07d0 0x7fb2e40c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:21.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.647+0000 7fb2ea390700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb2e415d3f0 0x7fb2e40c9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:21.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.647+0000 7fb2ea390700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e40b11f0 con 0x7fb2e40b07d0 2023-10-06T11:15:21.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.647+0000 7fb2ea390700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e40b17b0 con 0x7fb2e4069cf0 2023-10-06T11:15:21.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.647+0000 7fb2ea390700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2e40c8310 con 0x7fb2e415d3f0 2023-10-06T11:15:21.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.647+0000 7fb2e37fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2e40b07d0 0x7fb2e40c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:21.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.647+0000 7fb2e37fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2e40b07d0 0x7fb2e40c8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49196/0 (socket says 172.21.15.146:49196) 2023-10-06T11:15:21.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.647+0000 7fb2e37fe700 1 -- 172.21.15.146:0/1173136752 learned_addr learned my addr 172.21.15.146:0/1173136752 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:21.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.647+0000 7fb2e3fff700 1 --2- 172.21.15.146:0/1173136752 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2e4069cf0 0x7fb2e414af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:21.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.647+0000 7fb2e892d700 1 --2- 172.21.15.146:0/1173136752 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb2e415d3f0 0x7fb2e40c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:21.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.647+0000 7fb2e37fe700 1 -- 172.21.15.146:0/1173136752 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb2e415d3f0 msgr2=0x7fb2e40c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:21.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.647+0000 7fb2e37fe700 1 --2- 172.21.15.146:0/1173136752 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb2e415d3f0 0x7fb2e40c9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:21.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.647+0000 7fb2e37fe700 1 -- 172.21.15.146:0/1173136752 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2e4069cf0 msgr2=0x7fb2e414af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:21.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.647+0000 7fb2e37fe700 1 --2- 172.21.15.146:0/1173136752 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2e4069cf0 0x7fb2e414af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:21.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.647+0000 7fb2e37fe700 1 -- 172.21.15.146:0/1173136752 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d40094f0 con 0x7fb2e40b07d0 2023-10-06T11:15:21.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.647+0000 7fb2e37fe700 1 --2- 172.21.15.146:0/1173136752 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2e40b07d0 0x7fb2e40c8ff0 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7fb2d800d860 tx=0x7fb2d8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:21.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.647+0000 7fb2cbfff700 1 -- 172.21.15.146:0/1173136752 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d80125f0 con 0x7fb2e40b07d0 2023-10-06T11:15:21.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.647+0000 7fb2cbfff700 1 -- 172.21.15.146:0/1173136752 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d8012750 con 0x7fb2e40b07d0 2023-10-06T11:15:21.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.647+0000 7fb2ea390700 1 -- 172.21.15.146:0/1173136752 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2e40c85f0 con 0x7fb2e40b07d0 2023-10-06T11:15:21.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.647+0000 7fb2cbfff700 1 -- 172.21.15.146:0/1173136752 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d8012b10 con 0x7fb2e40b07d0 2023-10-06T11:15:21.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.647+0000 7fb2ea390700 1 -- 172.21.15.146:0/1173136752 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2e414b4c0 con 0x7fb2e40b07d0 2023-10-06T11:15:21.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.648+0000 7fb2ea390700 1 -- 172.21.15.146:0/1173136752 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2e40b1960 con 0x7fb2e40b07d0 2023-10-06T11:15:21.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.649+0000 7fb2cbfff700 1 -- 172.21.15.146:0/1173136752 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb2d801e460 con 0x7fb2e40b07d0 2023-10-06T11:15:21.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.649+0000 7fb2cbfff700 1 --2- 172.21.15.146:0/1173136752 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb2d0066f30 0x7fb2d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:21.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.649+0000 7fb2cbfff700 1 -- 172.21.15.146:0/1173136752 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb2d8084b90 con 0x7fb2e40b07d0 2023-10-06T11:15:21.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.649+0000 7fb2e3fff700 1 --2- 172.21.15.146:0/1173136752 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb2d0066f30 0x7fb2d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:21.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.650+0000 7fb2e3fff700 1 --2- 172.21.15.146:0/1173136752 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb2d0066f30 0x7fb2d00693e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fb2d40099b0 tx=0x7fb2d4017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:21.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.653+0000 7fb2cbfff700 1 -- 172.21.15.146:0/1173136752 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb2e40b1960 con 0x7fb2e40b07d0 2023-10-06T11:15:21.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.911+0000 7fb2ea390700 1 -- 172.21.15.146:0/1173136752 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fb2e40b1920 con 0x7fb2e40b07d0 2023-10-06T11:15:21.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.917+0000 7fb2cbfff700 1 -- 172.21.15.146:0/1173136752 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) v1 ==== 190+0+0 (secure 0 0 0) 0x7fb2d8055730 con 0x7fb2e40b07d0 2023-10-06T11:15:21.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.919+0000 7fb2ea390700 1 -- 172.21.15.146:0/1173136752 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb2d0066f30 msgr2=0x7fb2d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:21.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.919+0000 7fb2ea390700 1 --2- 172.21.15.146:0/1173136752 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb2d0066f30 0x7fb2d00693e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fb2d40099b0 tx=0x7fb2d4017000 comp rx=0 tx=0).stop 2023-10-06T11:15:21.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.919+0000 7fb2ea390700 1 -- 172.21.15.146:0/1173136752 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2e40b07d0 msgr2=0x7fb2e40c8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:21.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.919+0000 7fb2ea390700 1 --2- 172.21.15.146:0/1173136752 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2e40b07d0 0x7fb2e40c8ff0 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7fb2d800d860 tx=0x7fb2d8008040 comp rx=0 tx=0).stop 2023-10-06T11:15:21.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.919+0000 7fb2ea390700 1 -- 172.21.15.146:0/1173136752 shutdown_connections 2023-10-06T11:15:21.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.919+0000 7fb2ea390700 1 --2- 172.21.15.146:0/1173136752 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb2d0066f30 0x7fb2d00693e0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:21.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.919+0000 7fb2ea390700 1 --2- 172.21.15.146:0/1173136752 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb2e415d3f0 0x7fb2e40c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:21.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.919+0000 7fb2ea390700 1 --2- 172.21.15.146:0/1173136752 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2e4069cf0 0x7fb2e414af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:21.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.919+0000 7fb2ea390700 1 --2- 172.21.15.146:0/1173136752 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2e40b07d0 0x7fb2e40c8ff0 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:21.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.919+0000 7fb2ea390700 1 -- 172.21.15.146:0/1173136752 >> 172.21.15.146:0/1173136752 conn(0x7fb2e4067c50 msgr2=0x7fb2e4156b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:21.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.919+0000 7fb2ea390700 1 -- 172.21.15.146:0/1173136752 shutdown_connections 2023-10-06T11:15:21.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:21.919+0000 7fb2ea390700 1 -- 172.21.15.146:0/1173136752 wait complete. 2023-10-06T11:15:21.922 INFO:teuthology.orchestra.run.smithi146.stderr:updated caps for client.0 2023-10-06T11:15:21.933 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:15:22.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.047+0000 7f314b7bc700 1 Processor -- start 2023-10-06T11:15:22.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.047+0000 7f314b7bc700 1 -- start start 2023-10-06T11:15:22.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.048+0000 7f314b7bc700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f31440b08d0 0x7f31440c3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.048+0000 7f314b7bc700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3144068a90 con 0x7f31440c4750 2023-10-06T11:15:22.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.048+0000 7f314b7bc700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3144159fd0 con 0x7f31440cef00 2023-10-06T11:15:22.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.048+0000 7f314b7bc700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31440cdcf0 con 0x7f31440b08d0 2023-10-06T11:15:22.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.048+0000 7f3148d57700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f31440c4750 0x7f3144068f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:37300/0 (socket says 172.21.15.146:37300) 2023-10-06T11:15:22.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.048+0000 7f3148d57700 1 -- 172.21.15.146:0/167212737 learned_addr learned my addr 172.21.15.146:0/167212737 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:15:22.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.049+0000 7f313bfff700 1 -- 172.21.15.146:0/167212737 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3839387132 0 0) 0x7f3144068a90 con 0x7f31440c4750 2023-10-06T11:15:22.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.049+0000 7f3149558700 1 --2- 172.21.15.146:0/167212737 >> v2:172.21.15.151:3300/0 conn(0x7f31440b08d0 0x7f31440c3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.049+0000 7f313bfff700 1 -- 172.21.15.146:0/167212737 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3130003570 con 0x7f31440c4750 2023-10-06T11:15:22.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.049+0000 7f313bfff700 1 -- 172.21.15.146:0/167212737 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2950246968 0 0) 0x7f3130003570 con 0x7f31440c4750 2023-10-06T11:15:22.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.049+0000 7f313bfff700 1 -- 172.21.15.146:0/167212737 >> v2:172.21.15.151:3300/0 conn(0x7f31440b08d0 msgr2=0x7f31440c3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:22.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.049+0000 7f313bfff700 1 --2- 172.21.15.146:0/167212737 >> v2:172.21.15.151:3300/0 conn(0x7f31440b08d0 0x7f31440c3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.049+0000 7f313bfff700 1 -- 172.21.15.146:0/167212737 >> v1:172.21.15.151:6789/0 conn(0x7f31440cef00 legacy=0x7f3144069630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:22.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.049+0000 7f313bfff700 1 -- 172.21.15.146:0/167212737 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31440cdfd0 con 0x7f31440c4750 2023-10-06T11:15:22.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.049+0000 7f313bfff700 1 -- 172.21.15.146:0/167212737 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f3134001470 con 0x7f31440c4750 2023-10-06T11:15:22.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.049+0000 7f313bfff700 1 -- 172.21.15.146:0/167212737 >> v1:172.21.15.146:6789/0 conn(0x7f31440c4750 legacy=0x7f3144068f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:22.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.049+0000 7f313bfff700 1 --2- 172.21.15.146:0/167212737 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3130003a60 0x7f3130003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.049+0000 7f313bfff700 1 --2- 172.21.15.146:0/167212737 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3130004810 0x7f3130004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.049+0000 7f313bfff700 1 --2- 172.21.15.146:0/167212737 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31300052e0 0x7f313000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.049+0000 7f313bfff700 1 -- 172.21.15.146:0/167212737 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31440cdcf0 con 0x7f3130004810 2023-10-06T11:15:22.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.049+0000 7f313bfff700 1 -- 172.21.15.146:0/167212737 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f313000c230 con 0x7f3130003a60 2023-10-06T11:15:22.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.049+0000 7f313bfff700 1 -- 172.21.15.146:0/167212737 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f313000c3f0 con 0x7f31300052e0 2023-10-06T11:15:22.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.049+0000 7f3148d57700 1 --2- 172.21.15.146:0/167212737 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3130004810 0x7f3130004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.049+0000 7f3149558700 1 --2- 172.21.15.146:0/167212737 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3130003a60 0x7f3130003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.049+0000 7f3149d59700 1 --2- 172.21.15.146:0/167212737 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31300052e0 0x7f313000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.049+0000 7f3148d57700 1 -- 172.21.15.146:0/167212737 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31300052e0 msgr2=0x7f313000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:22.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.049+0000 7f3148d57700 1 --2- 172.21.15.146:0/167212737 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31300052e0 0x7f313000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.049+0000 7f3148d57700 1 -- 172.21.15.146:0/167212737 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3130003a60 msgr2=0x7f3130003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:22.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.049+0000 7f3148d57700 1 --2- 172.21.15.146:0/167212737 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3130003a60 0x7f3130003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.049+0000 7f3148d57700 1 -- 172.21.15.146:0/167212737 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3130003570 con 0x7f3130004810 2023-10-06T11:15:22.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.049+0000 7f3149d59700 1 --2- 172.21.15.146:0/167212737 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31300052e0 0x7f313000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:22.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.049+0000 7f3149d59700 1 -- 172.21.15.146:0/167212737 reap_dead start 2023-10-06T11:15:22.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.049+0000 7f3148d57700 1 --2- 172.21.15.146:0/167212737 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3130004810 0x7f3130004c80 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f313400c3c0 tx=0x7f3134001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f816bcb759405f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:22.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.050+0000 7f313bfff700 1 -- 172.21.15.146:0/167212737 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313400cc90 con 0x7f3130004810 2023-10-06T11:15:22.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.050+0000 7f313bfff700 1 -- 172.21.15.146:0/167212737 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313400cdf0 con 0x7f3130004810 2023-10-06T11:15:22.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.050+0000 7f313bfff700 1 -- 172.21.15.146:0/167212737 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3134005b50 con 0x7f3130004810 2023-10-06T11:15:22.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.050+0000 7f314b7bc700 1 -- 172.21.15.146:0/167212737 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3130004810 msgr2=0x7f3130004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:22.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.050+0000 7f314b7bc700 1 --2- 172.21.15.146:0/167212737 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3130004810 0x7f3130004c80 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f313400c3c0 tx=0x7f3134001e50 comp rx=0 tx=0).stop 2023-10-06T11:15:22.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.050+0000 7f314b7bc700 1 -- 172.21.15.146:0/167212737 shutdown_connections 2023-10-06T11:15:22.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.050+0000 7f314b7bc700 1 --2- 172.21.15.146:0/167212737 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3130004810 0x7f3130004c80 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.050+0000 7f314b7bc700 1 -- 172.21.15.146:0/167212737 >> 172.21.15.146:0/167212737 conn(0x7f3144067c50 msgr2=0x7f31440ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:22.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.050+0000 7f314b7bc700 1 -- 172.21.15.146:0/167212737 shutdown_connections 2023-10-06T11:15:22.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.050+0000 7f314b7bc700 1 -- 172.21.15.146:0/167212737 wait complete. 2023-10-06T11:15:22.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.051+0000 7f314b7bc700 1 Processor -- start 2023-10-06T11:15:22.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.051+0000 7f314b7bc700 1 -- start start 2023-10-06T11:15:22.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.052+0000 7f314b7bc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3130004810 0x7f314415a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.052+0000 7f314b7bc700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31440c73a0 0x7f31440b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.052+0000 7f314b7bc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31440c7810 0x7f31440b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.052+0000 7f314b7bc700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31440b1c00 con 0x7f31440c7810 2023-10-06T11:15:22.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.052+0000 7f314b7bc700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31440c65a0 con 0x7f3130004810 2023-10-06T11:15:22.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.052+0000 7f314b7bc700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31440b1310 con 0x7f31440c73a0 2023-10-06T11:15:22.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.052+0000 7f3149d59700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31440c7810 0x7f31440b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.052+0000 7f3149d59700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31440c7810 0x7f31440b39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49222/0 (socket says 172.21.15.146:49222) 2023-10-06T11:15:22.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.052+0000 7f3149d59700 1 -- 172.21.15.146:0/1084023366 learned_addr learned my addr 172.21.15.146:0/1084023366 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:22.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.053+0000 7f3148d57700 1 --2- 172.21.15.146:0/1084023366 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31440c73a0 0x7f31440b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.053+0000 7f3149d59700 1 -- 172.21.15.146:0/1084023366 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31440c73a0 msgr2=0x7f31440b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:22.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.053+0000 7f3149558700 1 --2- 172.21.15.146:0/1084023366 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3130004810 0x7f314415a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.053+0000 7f3149d59700 1 --2- 172.21.15.146:0/1084023366 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31440c73a0 0x7f31440b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.053+0000 7f3149d59700 1 -- 172.21.15.146:0/1084023366 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3130004810 msgr2=0x7f314415a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:22.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.053+0000 7f3149d59700 1 --2- 172.21.15.146:0/1084023366 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3130004810 0x7f314415a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.053+0000 7f3149d59700 1 -- 172.21.15.146:0/1084023366 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31440b15b0 con 0x7f31440c7810 2023-10-06T11:15:22.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.053+0000 7f3148d57700 1 --2- 172.21.15.146:0/1084023366 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31440c73a0 0x7f31440b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:22.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.053+0000 7f3149558700 1 --2- 172.21.15.146:0/1084023366 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3130004810 0x7f314415a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:22.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.053+0000 7f3149d59700 1 --2- 172.21.15.146:0/1084023366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31440c7810 0x7f31440b39f0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f31440cf2d0 tx=0x7f313c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:22.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.053+0000 7f31397fa700 1 -- 172.21.15.146:0/1084023366 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c00b070 con 0x7f31440c7810 2023-10-06T11:15:22.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.053+0000 7f31397fa700 1 -- 172.21.15.146:0/1084023366 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313c00de50 con 0x7f31440c7810 2023-10-06T11:15:22.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.053+0000 7f31397fa700 1 -- 172.21.15.146:0/1084023366 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c006a70 con 0x7f31440c7810 2023-10-06T11:15:22.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.053+0000 7f314b7bc700 1 -- 172.21.15.146:0/1084023366 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31440b1890 con 0x7f31440c7810 2023-10-06T11:15:22.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.053+0000 7f314b7bc700 1 -- 172.21.15.146:0/1084023366 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3144151b30 con 0x7f31440c7810 2023-10-06T11:15:22.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.054+0000 7f314b7bc700 1 -- 172.21.15.146:0/1084023366 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31440b1db0 con 0x7f31440c7810 2023-10-06T11:15:22.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.054+0000 7f31397fa700 1 -- 172.21.15.146:0/1084023366 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f313c007030 con 0x7f31440c7810 2023-10-06T11:15:22.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.055+0000 7f31397fa700 1 --2- 172.21.15.146:0/1084023366 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3128066f30 0x7f31280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.055+0000 7f3149558700 1 --2- 172.21.15.146:0/1084023366 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3128066f30 0x7f31280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.055+0000 7f31397fa700 1 -- 172.21.15.146:0/1084023366 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f313c0837c0 con 0x7f31440c7810 2023-10-06T11:15:22.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.055+0000 7f3149558700 1 --2- 172.21.15.146:0/1084023366 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3128066f30 0x7f31280693e0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f31400094d0 tx=0x7f3140009710 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:22.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.059+0000 7f31397fa700 1 -- 172.21.15.146:0/1084023366 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f313c04c5a0 con 0x7f31440c7810 2023-10-06T11:15:22.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.286+0000 7f314b7bc700 1 -- 172.21.15.146:0/1084023366 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f314404c380 con 0x7f31440c7810 2023-10-06T11:15:22.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.287+0000 7f31397fa700 1 -- 172.21.15.146:0/1084023366 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) v1 ==== 95+0+4617 (secure 0 0 0) 0x7f313c018090 con 0x7f31440c7810 2023-10-06T11:15:22.289 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:15:22.289 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":108,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7792,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3693464886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3693464886},{"type":"v1","addr":"172.21.15.151:6834","nonce":3693464886}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103},{"gid":7795,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1155762565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":1155762565},{"type":"v1","addr":"172.21.15.151:6835","nonce":1155762565}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103},{"gid":8679,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/3868720724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3868720724},{"type":"v1","addr":"172.21.15.146:6836","nonce":3868720724}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:15:11.929158+0000","modified":"2023-10-06T11:15:15.569866+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8682},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8682":{"gid":8682,"name":"c","rank":0,"incarnation":104,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/1974709597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":1974709597},{"type":"v1","addr":"172.21.15.146:6837","nonce":1974709597}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-06T11:15:22.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.289+0000 7f314b7bc700 1 -- 172.21.15.146:0/1084023366 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3128066f30 msgr2=0x7f31280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:22.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.289+0000 7f314b7bc700 1 --2- 172.21.15.146:0/1084023366 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3128066f30 0x7f31280693e0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f31400094d0 tx=0x7f3140009710 comp rx=0 tx=0).stop 2023-10-06T11:15:22.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.289+0000 7f314b7bc700 1 -- 172.21.15.146:0/1084023366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31440c7810 msgr2=0x7f31440b39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:22.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.289+0000 7f314b7bc700 1 --2- 172.21.15.146:0/1084023366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31440c7810 0x7f31440b39f0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f31440cf2d0 tx=0x7f313c009040 comp rx=0 tx=0).stop 2023-10-06T11:15:22.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.289+0000 7f314b7bc700 1 -- 172.21.15.146:0/1084023366 shutdown_connections 2023-10-06T11:15:22.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.289+0000 7f314b7bc700 1 --2- 172.21.15.146:0/1084023366 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3128066f30 0x7f31280693e0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.289+0000 7f314b7bc700 1 --2- 172.21.15.146:0/1084023366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31440c7810 0x7f31440b39f0 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.289+0000 7f314b7bc700 1 --2- 172.21.15.146:0/1084023366 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3130004810 0x7f314415a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.289+0000 7f314b7bc700 1 --2- 172.21.15.146:0/1084023366 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31440c73a0 0x7f31440b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.289+0000 7f314b7bc700 1 -- 172.21.15.146:0/1084023366 >> 172.21.15.146:0/1084023366 conn(0x7f3144067c50 msgr2=0x7f31440c9190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:22.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.289+0000 7f314b7bc700 1 -- 172.21.15.146:0/1084023366 shutdown_connections 2023-10-06T11:15:22.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.289+0000 7f314b7bc700 1 -- 172.21.15.146:0/1084023366 wait complete. 2023-10-06T11:15:22.292 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 108 2023-10-06T11:15:22.705 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 108, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T11:15:11.929158+0000', 'modified': '2023-10-06T11:15:15.569866+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8682}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8682': {'gid': 8682, 'name': 'c', 'rank': 0, 'incarnation': 104, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.146:6837/1974709597', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6835', 'nonce': 1974709597}, {'type': 'v1', 'addr': '172.21.15.146:6837', 'nonce': 1974709597}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T11:15:22.705 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T11:15:22.705 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T11:15:22.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.820+0000 7febfb8c6700 1 Processor -- start 2023-10-06T11:15:22.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.820+0000 7febfb8c6700 1 -- start start 2023-10-06T11:15:22.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.821+0000 7febfb8c6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7febf40676c0 0x7febf40b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.821+0000 7febfb8c6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febf4067a90 0x7febf415ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.821+0000 7febfb8c6700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febf415a840 con 0x7febf406e690 2023-10-06T11:15:22.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.821+0000 7febfb8c6700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febf415ab20 con 0x7febf40676c0 2023-10-06T11:15:22.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.821+0000 7febfb8c6700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf415ae00 con 0x7febf4067a90 2023-10-06T11:15:22.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.821+0000 7febf9662700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7febf40676c0 0x7febf40b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.821+0000 7febf9662700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7febf40676c0 0x7febf40b0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49224/0 (socket says 172.21.15.146:49224) 2023-10-06T11:15:22.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.821+0000 7febf9662700 1 -- 172.21.15.146:0/2483161991 learned_addr learned my addr 172.21.15.146:0/2483161991 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:22.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.821+0000 7febf8e61700 1 --2- 172.21.15.146:0/2483161991 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febf4067a90 0x7febf415ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.821+0000 7febf9662700 1 -- 172.21.15.146:0/2483161991 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febf4067a90 msgr2=0x7febf415ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:22.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.821+0000 7febf9662700 1 --2- 172.21.15.146:0/2483161991 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febf4067a90 0x7febf415ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.821+0000 7febf9662700 1 -- 172.21.15.146:0/2483161991 >> v1:172.21.15.151:6789/0 conn(0x7febf406e690 legacy=0x7febf406eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:22.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.821+0000 7febf9662700 1 -- 172.21.15.146:0/2483161991 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf415d5b0 con 0x7febf40676c0 2023-10-06T11:15:22.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.821+0000 7febf8e61700 1 --2- 172.21.15.146:0/2483161991 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febf4067a90 0x7febf415ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:22.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.821+0000 7febf9662700 1 --2- 172.21.15.146:0/2483161991 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febf40676c0 0x7febf40b0fa0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7febf00099b0 tx=0x7febf0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e586d73c5921a8ea server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:22.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.822+0000 7febebfff700 1 -- 172.21.15.146:0/2483161991 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf000b820 con 0x7febf40676c0 2023-10-06T11:15:22.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.822+0000 7febebfff700 1 -- 172.21.15.146:0/2483161991 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf000b980 con 0x7febf40676c0 2023-10-06T11:15:22.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.822+0000 7febebfff700 1 -- 172.21.15.146:0/2483161991 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf000bd20 con 0x7febf40676c0 2023-10-06T11:15:22.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.822+0000 7febfb8c6700 1 -- 172.21.15.146:0/2483161991 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febf40676c0 msgr2=0x7febf40b0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:22.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.822+0000 7febfb8c6700 1 --2- 172.21.15.146:0/2483161991 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febf40676c0 0x7febf40b0fa0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7febf00099b0 tx=0x7febf0009250 comp rx=0 tx=0).stop 2023-10-06T11:15:22.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.822+0000 7febfb8c6700 1 -- 172.21.15.146:0/2483161991 shutdown_connections 2023-10-06T11:15:22.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.822+0000 7febfb8c6700 1 --2- 172.21.15.146:0/2483161991 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febf40676c0 0x7febf40b0fa0 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.822+0000 7febfb8c6700 1 --2- 172.21.15.146:0/2483161991 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febf4067a90 0x7febf415ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.822+0000 7febfb8c6700 1 -- 172.21.15.146:0/2483161991 >> 172.21.15.146:0/2483161991 conn(0x7febf4068580 msgr2=0x7febf4068980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:22.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.822+0000 7febfb8c6700 1 -- 172.21.15.146:0/2483161991 shutdown_connections 2023-10-06T11:15:22.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.822+0000 7febfb8c6700 1 -- 172.21.15.146:0/2483161991 wait complete. 2023-10-06T11:15:22.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.823+0000 7febfb8c6700 1 Processor -- start 2023-10-06T11:15:22.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.823+0000 7febfb8c6700 1 -- start start 2023-10-06T11:15:22.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.824+0000 7febfb8c6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febf40676c0 0x7febf40ae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.824+0000 7febfb8c6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febf4067a90 0x7febf4148de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.824+0000 7febfb8c6700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7febf406e690 0x7febf40c20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.824+0000 7febfb8c6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf416a3f0 con 0x7febf40676c0 2023-10-06T11:15:22.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.824+0000 7febfb8c6700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf4149320 con 0x7febf406e690 2023-10-06T11:15:22.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.824+0000 7febfb8c6700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf40c2e10 con 0x7febf4067a90 2023-10-06T11:15:22.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.824+0000 7febf9662700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febf40676c0 0x7febf40ae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.824+0000 7febf9662700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febf40676c0 0x7febf40ae4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49230/0 (socket says 172.21.15.146:49230) 2023-10-06T11:15:22.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.824+0000 7febf9662700 1 -- 172.21.15.146:0/4161684519 learned_addr learned my addr 172.21.15.146:0/4161684519 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:22.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.825+0000 7febf9e63700 1 --2- 172.21.15.146:0/4161684519 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7febf406e690 0x7febf40c20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.825+0000 7febf8e61700 1 --2- 172.21.15.146:0/4161684519 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febf4067a90 0x7febf4148de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.825+0000 7febf9662700 1 -- 172.21.15.146:0/4161684519 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febf4067a90 msgr2=0x7febf4148de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:22.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.825+0000 7febf9662700 1 --2- 172.21.15.146:0/4161684519 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febf4067a90 0x7febf4148de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.825+0000 7febf9662700 1 -- 172.21.15.146:0/4161684519 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7febf406e690 msgr2=0x7febf40c20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:22.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.825+0000 7febf9662700 1 --2- 172.21.15.146:0/4161684519 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7febf406e690 0x7febf40c20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.825+0000 7febf9662700 1 -- 172.21.15.146:0/4161684519 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf00094f0 con 0x7febf40676c0 2023-10-06T11:15:22.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.825+0000 7febf9e63700 1 --2- 172.21.15.146:0/4161684519 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7febf406e690 0x7febf40c20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:22.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.825+0000 7febf8e61700 1 --2- 172.21.15.146:0/4161684519 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febf4067a90 0x7febf4148de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:22.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.825+0000 7febf9662700 1 --2- 172.21.15.146:0/4161684519 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febf40676c0 0x7febf40ae4e0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7febf0009290 tx=0x7febf0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:22.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.825+0000 7febe97fa700 1 -- 172.21.15.146:0/4161684519 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf0011d70 con 0x7febf40676c0 2023-10-06T11:15:22.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.825+0000 7febe97fa700 1 -- 172.21.15.146:0/4161684519 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf0020070 con 0x7febf40676c0 2023-10-06T11:15:22.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.825+0000 7febfb8c6700 1 -- 172.21.15.146:0/4161684519 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febf40aeb70 con 0x7febf40676c0 2023-10-06T11:15:22.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.825+0000 7febe97fa700 1 -- 172.21.15.146:0/4161684519 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf001b6a0 con 0x7febf40676c0 2023-10-06T11:15:22.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.825+0000 7febfb8c6700 1 -- 172.21.15.146:0/4161684519 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febf40af130 con 0x7febf40676c0 2023-10-06T11:15:22.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.826+0000 7febe97fa700 1 -- 172.21.15.146:0/4161684519 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7febf0022030 con 0x7febf40676c0 2023-10-06T11:15:22.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.827+0000 7febe97fa700 1 --2- 172.21.15.146:0/4161684519 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7febd8066f30 0x7febd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.827+0000 7febe97fa700 1 -- 172.21.15.146:0/4161684519 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6058+0+0 (secure 0 0 0) 0x7febf00866b0 con 0x7febf40676c0 2023-10-06T11:15:22.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.827+0000 7febf8e61700 1 --2- 172.21.15.146:0/4161684519 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7febd8066f30 0x7febd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.827+0000 7febf8e61700 1 --2- 172.21.15.146:0/4161684519 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7febd8066f30 0x7febd80693e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7febf4155af0 tx=0x7febe4006f90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:22.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.829+0000 7fec04bbeb80 1 Processor -- start 2023-10-06T11:15:22.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.829+0000 7fec04bbeb80 1 -- start start 2023-10-06T11:15:22.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.830+0000 7fec04bbeb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bc3ff5ba90 0x55bc3ff5be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.830+0000 7fec04bbeb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc3ff179a0 0x55bc3ff14580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.830+0000 7fec04bbeb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bc3ff15bd0 0x55bc3ff14ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.830+0000 7fec04bbeb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc3fe94c80 con 0x55bc3ff179a0 2023-10-06T11:15:22.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.830+0000 7fec04bbeb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc3fe6ba70 con 0x55bc3ff5ba90 2023-10-06T11:15:22.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.830+0000 7fec04bbeb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bc3fe69270 con 0x55bc3ff15bd0 2023-10-06T11:15:22.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.830+0000 7febf8e61700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc3ff179a0 0x55bc3ff14580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.830+0000 7febf8e61700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc3ff179a0 0x55bc3ff14580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49246/0 (socket says 172.21.15.146:49246) 2023-10-06T11:15:22.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.830+0000 7febf8e61700 1 -- 172.21.15.146:0/3149082674 learned_addr learned my addr 172.21.15.146:0/3149082674 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:22.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.830+0000 7febf9e63700 1 --2- 172.21.15.146:0/3149082674 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bc3ff15bd0 0x55bc3ff14ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.830+0000 7febf9662700 1 --2- 172.21.15.146:0/3149082674 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bc3ff5ba90 0x55bc3ff5be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.830+0000 7febf8e61700 1 -- 172.21.15.146:0/3149082674 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bc3ff15bd0 msgr2=0x55bc3ff14ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:22.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.830+0000 7febf8e61700 1 --2- 172.21.15.146:0/3149082674 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bc3ff15bd0 0x55bc3ff14ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.830+0000 7febf8e61700 1 -- 172.21.15.146:0/3149082674 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bc3ff5ba90 msgr2=0x55bc3ff5be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:22.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.830+0000 7febf8e61700 1 --2- 172.21.15.146:0/3149082674 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bc3ff5ba90 0x55bc3ff5be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.830+0000 7febf8e61700 1 -- 172.21.15.146:0/3149082674 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc3fcff270 con 0x55bc3ff179a0 2023-10-06T11:15:22.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.830+0000 7febf9662700 1 --2- 172.21.15.146:0/3149082674 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bc3ff5ba90 0x55bc3ff5be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:22.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.830+0000 7febf8e61700 1 --2- 172.21.15.146:0/3149082674 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc3ff179a0 0x55bc3ff14580 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7febe400fb40 tx=0x7febe4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91237fe79eb8cfd6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:22.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.830+0000 7febde7fc700 1 -- 172.21.15.146:0/3149082674 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe40148f0 con 0x55bc3ff179a0 2023-10-06T11:15:22.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.830+0000 7febde7fc700 1 -- 172.21.15.146:0/3149082674 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe4019070 con 0x55bc3ff179a0 2023-10-06T11:15:22.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.830+0000 7febde7fc700 1 -- 172.21.15.146:0/3149082674 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe4014c60 con 0x55bc3ff179a0 2023-10-06T11:15:22.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.831+0000 7fec04bbeb80 1 -- 172.21.15.146:0/3149082674 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc3ff179a0 msgr2=0x55bc3ff14580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:22.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.831+0000 7fec04bbeb80 1 --2- 172.21.15.146:0/3149082674 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc3ff179a0 0x55bc3ff14580 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7febe400fb40 tx=0x7febe4016000 comp rx=0 tx=0).stop 2023-10-06T11:15:22.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.831+0000 7fec04bbeb80 1 -- 172.21.15.146:0/3149082674 shutdown_connections 2023-10-06T11:15:22.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.831+0000 7fec04bbeb80 1 --2- 172.21.15.146:0/3149082674 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bc3ff15bd0 0x55bc3ff14ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.831+0000 7fec04bbeb80 1 --2- 172.21.15.146:0/3149082674 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bc3ff5ba90 0x55bc3ff5be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.831+0000 7fec04bbeb80 1 --2- 172.21.15.146:0/3149082674 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc3ff179a0 0x55bc3ff14580 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.831+0000 7fec04bbeb80 1 -- 172.21.15.146:0/3149082674 >> 172.21.15.146:0/3149082674 conn(0x55bc3ff16070 msgr2=0x55bc3ff16440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:22.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.831+0000 7fec04bbeb80 1 -- 172.21.15.146:0/3149082674 shutdown_connections 2023-10-06T11:15:22.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.831+0000 7fec04bbeb80 1 -- 172.21.15.146:0/3149082674 wait complete. 2023-10-06T11:15:22.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.831+0000 7fec04bbeb80 1 -- start start 2023-10-06T11:15:22.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.832+0000 7fec04bbeb80 1 Processor -- start 2023-10-06T11:15:22.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.832+0000 7fec04bbeb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bc3ff15bd0 0x55bc3ff3fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.832+0000 7fec04bbeb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc3ff179a0 0x55bc3ff6bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.832+0000 7fec04bbeb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bc3ff5ba90 0x55bc3ff6c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.832+0000 7fec04bbeb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc3fe65060 con 0x55bc3ff179a0 2023-10-06T11:15:22.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.832+0000 7fec04bbeb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc3fe10890 con 0x55bc3ff5ba90 2023-10-06T11:15:22.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.832+0000 7fec04bbeb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bc3fe2bea0 con 0x55bc3ff15bd0 2023-10-06T11:15:22.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.832+0000 7fec04bbeb80 10 client.0 _ll_register_callbacks cb 0x55bc3fd01f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:15:22.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.833+0000 7febf8e61700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc3ff179a0 0x55bc3ff6bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.833+0000 7febf8e61700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc3ff179a0 0x55bc3ff6bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49262/0 (socket says 172.21.15.146:49262) 2023-10-06T11:15:22.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.833+0000 7febf8e61700 1 -- 172.21.15.146:0/3034186663 learned_addr learned my addr 172.21.15.146:0/3034186663 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:22.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.833+0000 7febf9e63700 1 --2- 172.21.15.146:0/3034186663 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bc3ff5ba90 0x55bc3ff6c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.833+0000 7febf9662700 1 --2- 172.21.15.146:0/3034186663 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bc3ff15bd0 0x55bc3ff3fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.833+0000 7febf8e61700 1 -- 172.21.15.146:0/3034186663 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bc3ff15bd0 msgr2=0x55bc3ff3fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:22.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.833+0000 7febf8e61700 1 --2- 172.21.15.146:0/3034186663 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bc3ff15bd0 0x55bc3ff3fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.833+0000 7febf8e61700 1 -- 172.21.15.146:0/3034186663 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bc3ff5ba90 msgr2=0x55bc3ff6c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:22.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.833+0000 7febf8e61700 1 --2- 172.21.15.146:0/3034186663 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bc3ff5ba90 0x55bc3ff6c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.833+0000 7febf8e61700 1 -- 172.21.15.146:0/3034186663 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febe400e040 con 0x55bc3ff179a0 2023-10-06T11:15:22.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.833+0000 7febf9662700 1 --2- 172.21.15.146:0/3034186663 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bc3ff15bd0 0x55bc3ff3fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:22.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.833+0000 7febf8e61700 1 --2- 172.21.15.146:0/3034186663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc3ff179a0 0x55bc3ff6bcd0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x55bc3ff17ef0 tx=0x7febe4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31f3974f96d82204 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:22.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.833+0000 7febd37fe700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:15:22.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.833+0000 7febd37fe700 1 -- 172.21.15.146:0/3034186663 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe4020930 con 0x55bc3ff179a0 2023-10-06T11:15:22.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.833+0000 7febd37fe700 1 -- 172.21.15.146:0/3034186663 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(125..125 src has 1..125) v4 ==== 6058+0+0 (secure 0 0 0) 0x7febe4020a90 con 0x55bc3ff179a0 2023-10-06T11:15:22.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.833+0000 7fec04bbeb80 1 -- 172.21.15.146:0/3034186663 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bc3ff09690 con 0x55bc3ff179a0 2023-10-06T11:15:22.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.833+0000 7febd37fe700 1 -- 172.21.15.146:0/3034186663 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7febe4020e80 con 0x55bc3ff179a0 2023-10-06T11:15:22.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.833+0000 7fec04bbeb80 10 client.8859 fetch_fsmap learned FSMap version 108 2023-10-06T11:15:22.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.833+0000 7fec04bbeb80 1 -- 172.21.15.146:0/3034186663 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) v3 -- 0x55bc3fca1fe0 con 0x55bc3ff179a0 2023-10-06T11:15:22.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.833+0000 7febd37fe700 1 -- 172.21.15.146:0/3034186663 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bc3ff09690 con 0x55bc3ff179a0 2023-10-06T11:15:22.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.834+0000 7febd37fe700 1 -- 172.21.15.146:0/3034186663 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 108) v1 ==== 3100+0+0 (secure 0 0 0) 0x7febe4033460 con 0x55bc3ff179a0 2023-10-06T11:15:22.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.834+0000 7fec04bbeb80 10 client.8859 fetch_fsmap finished waiting for FSMap version 108 2023-10-06T11:15:22.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.834+0000 7fec04bbeb80 10 client.8859 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T11:15:22.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.834+0000 7fec04bbeb80 20 client.8859 populate_metadata read hostname 'smithi146' 2023-10-06T11:15:22.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.834+0000 7fec04bbeb80 1 --2- 172.21.15.146:0/3034186663 >> [v2:172.21.15.146:6835/1974709597,v1:172.21.15.146:6837/1974709597] conn(0x55bc3ff6b060 0x55bc3ff6b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.834+0000 7fec04bbeb80 4 client.8859 mds_command: new command op to 8682 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:15:22.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.834+0000 7fec04bbeb80 1 -- 172.21.15.146:0/3034186663 --> [v2:172.21.15.146:6835/1974709597,v1:172.21.15.146:6837/1974709597] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bc3fee65c0 con 0x55bc3ff6b060 2023-10-06T11:15:22.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.834+0000 7febf9662700 1 --2- 172.21.15.146:0/3034186663 >> [v2:172.21.15.146:6835/1974709597,v1:172.21.15.146:6837/1974709597] conn(0x55bc3ff6b060 0x55bc3ff6b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.834+0000 7febf9662700 1 --2- 172.21.15.146:0/3034186663 >> [v2:172.21.15.146:6835/1974709597,v1:172.21.15.146:6837/1974709597] conn(0x55bc3ff6b060 0x55bc3ff6b430 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c70bbe4c8bc8bf6 server_cookie=12f0b65b26e59c62 in_seq=0 out_seq=0 2023-10-06T11:15:22.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.834+0000 7febd37fe700 10 client.8859 ms_handle_connect on v2:172.21.15.146:6835/1974709597 2023-10-06T11:15:22.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.834+0000 7febd37fe700 1 -- 172.21.15.146:0/3034186663 <== mds.0 v2:172.21.15.146:6835/1974709597 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55bc3fee65c0 con 0x55bc3ff6b060 2023-10-06T11:15:22.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.834+0000 7febd37fe700 10 client.8859 handle_command_reply: tid=0 2023-10-06T11:15:22.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.835+0000 7fec04bbeb80 1 client.8859 shutdown 2023-10-06T11:15:22.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.835+0000 7fec04bbeb80 1 -- 172.21.15.146:0/3034186663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc3ff179a0 msgr2=0x55bc3ff6bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:22.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.835+0000 7fec04bbeb80 1 --2- 172.21.15.146:0/3034186663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc3ff179a0 0x55bc3ff6bcd0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x55bc3ff17ef0 tx=0x7febe4019000 comp rx=0 tx=0).stop 2023-10-06T11:15:22.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.835+0000 7fec04bbeb80 1 -- 172.21.15.146:0/3034186663 shutdown_connections 2023-10-06T11:15:22.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.835+0000 7fec04bbeb80 1 --2- 172.21.15.146:0/3034186663 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bc3ff5ba90 0x55bc3ff6c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.835+0000 7fec04bbeb80 1 --2- 172.21.15.146:0/3034186663 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bc3ff15bd0 0x55bc3ff3fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.835+0000 7fec04bbeb80 1 --2- 172.21.15.146:0/3034186663 >> [v2:172.21.15.146:6835/1974709597,v1:172.21.15.146:6837/1974709597] conn(0x55bc3ff6b060 0x55bc3ff6b430 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.835+0000 7fec04bbeb80 1 --2- 172.21.15.146:0/3034186663 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc3ff179a0 0x55bc3ff6bcd0 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.835+0000 7febd37fe700 0 client.8859 ms_handle_reset on v2:172.21.15.146:6835/1974709597 2023-10-06T11:15:22.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.835+0000 7fec04bbeb80 1 -- 172.21.15.146:0/3034186663 >> 172.21.15.146:0/3034186663 conn(0x55bc3ff16070 msgr2=0x55bc3ff5afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:22.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.835+0000 7fec04bbeb80 1 -- 172.21.15.146:0/3034186663 shutdown_connections 2023-10-06T11:15:22.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.835+0000 7fec04bbeb80 1 -- 172.21.15.146:0/3034186663 wait complete. 2023-10-06T11:15:22.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.835+0000 7fec04bbeb80 20 client.8859 trim_cache size 0 max 16384 2023-10-06T11:15:22.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.851+0000 7fec04bbeb80 1 Processor -- start 2023-10-06T11:15:22.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.851+0000 7fec04bbeb80 1 -- start start 2023-10-06T11:15:22.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.852+0000 7fec04bbeb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc3ff15bd0 0x55bc3ff3b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.852+0000 7fec04bbeb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bc3ff179a0 0x55bc3ff3ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.852+0000 7fec04bbeb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bc3ff5ba90 0x55bc3ff0f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.852+0000 7fec04bbeb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc3fce7e30 con 0x55bc3ff15bd0 2023-10-06T11:15:22.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.852+0000 7fec04bbeb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc3ff400a0 con 0x55bc3ff179a0 2023-10-06T11:15:22.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.852+0000 7fec04bbeb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bc3ff16da0 con 0x55bc3ff5ba90 2023-10-06T11:15:22.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.852+0000 7febf9662700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc3ff15bd0 0x55bc3ff3b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.852+0000 7febf9662700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc3ff15bd0 0x55bc3ff3b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49268/0 (socket says 172.21.15.146:49268) 2023-10-06T11:15:22.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.852+0000 7febf9662700 1 -- 172.21.15.146:0/3879967046 learned_addr learned my addr 172.21.15.146:0/3879967046 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:22.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.852+0000 7febf9662700 1 -- 172.21.15.146:0/3879967046 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bc3ff5ba90 msgr2=0x55bc3ff0f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:22.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.852+0000 7febf9662700 1 --2- 172.21.15.146:0/3879967046 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bc3ff5ba90 0x55bc3ff0f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.852+0000 7febf9662700 1 -- 172.21.15.146:0/3879967046 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bc3ff179a0 msgr2=0x55bc3ff3ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:22.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.852+0000 7febf8e61700 1 --2- 172.21.15.146:0/3879967046 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bc3ff179a0 0x55bc3ff3ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.853+0000 7febf9662700 1 --2- 172.21.15.146:0/3879967046 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bc3ff179a0 0x55bc3ff3ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.853+0000 7febf9662700 1 -- 172.21.15.146:0/3879967046 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc3fe33780 con 0x55bc3ff15bd0 2023-10-06T11:15:22.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.853+0000 7febf8e61700 1 --2- 172.21.15.146:0/3879967046 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bc3ff179a0 0x55bc3ff3ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:22.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.853+0000 7febf9662700 1 --2- 172.21.15.146:0/3879967046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc3ff15bd0 0x55bc3ff3b1d0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7febf00538e0 tx=0x7febf0027040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58c07b19a6a34527 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:22.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.853+0000 7febdeffd700 1 -- 172.21.15.146:0/3879967046 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf0072070 con 0x55bc3ff15bd0 2023-10-06T11:15:22.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.853+0000 7febdeffd700 1 -- 172.21.15.146:0/3879967046 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf006d070 con 0x55bc3ff15bd0 2023-10-06T11:15:22.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.853+0000 7febdeffd700 1 -- 172.21.15.146:0/3879967046 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf0007ea0 con 0x55bc3ff15bd0 2023-10-06T11:15:22.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.853+0000 7fec04bbeb80 1 -- 172.21.15.146:0/3879967046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc3ff15bd0 msgr2=0x55bc3ff3b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:22.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.853+0000 7fec04bbeb80 1 --2- 172.21.15.146:0/3879967046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc3ff15bd0 0x55bc3ff3b1d0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7febf00538e0 tx=0x7febf0027040 comp rx=0 tx=0).stop 2023-10-06T11:15:22.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.853+0000 7fec04bbeb80 1 -- 172.21.15.146:0/3879967046 shutdown_connections 2023-10-06T11:15:22.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.853+0000 7fec04bbeb80 1 --2- 172.21.15.146:0/3879967046 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bc3ff5ba90 0x55bc3ff0f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.853+0000 7fec04bbeb80 1 --2- 172.21.15.146:0/3879967046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc3ff15bd0 0x55bc3ff3b1d0 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.853+0000 7fec04bbeb80 1 --2- 172.21.15.146:0/3879967046 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bc3ff179a0 0x55bc3ff3ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.853+0000 7fec04bbeb80 1 -- 172.21.15.146:0/3879967046 >> 172.21.15.146:0/3879967046 conn(0x55bc3ff16070 msgr2=0x55bc3ff5add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:22.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.853+0000 7fec04bbeb80 1 -- 172.21.15.146:0/3879967046 shutdown_connections 2023-10-06T11:15:22.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.853+0000 7fec04bbeb80 1 -- 172.21.15.146:0/3879967046 wait complete. 2023-10-06T11:15:22.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.854+0000 7fec04bbeb80 1 -- start start 2023-10-06T11:15:22.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.854+0000 7fec04bbeb80 1 Processor -- start 2023-10-06T11:15:22.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.855+0000 7fec04bbeb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bc3ff15bd0 0x55bc3ffbff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.855+0000 7fec04bbeb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc3ff179a0 0x55bc3ffba780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.855+0000 7fec04bbeb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bc3ff5ba90 0x55bc3ff3e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.855+0000 7fec04bbeb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc3ff3d370 con 0x55bc3ff179a0 2023-10-06T11:15:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.855+0000 7fec04bbeb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc3ffc0590 con 0x55bc3ff5ba90 2023-10-06T11:15:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.855+0000 7fec04bbeb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bc3ff14580 con 0x55bc3ff15bd0 2023-10-06T11:15:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.855+0000 7fec04bbeb80 10 client.0 _ll_register_callbacks cb 0x55bc3fd01f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:15:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.855+0000 7febf8e61700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc3ff179a0 0x55bc3ffba780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.855+0000 7febf8e61700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc3ff179a0 0x55bc3ffba780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49274/0 (socket says 172.21.15.146:49274) 2023-10-06T11:15:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.855+0000 7febf8e61700 1 -- 172.21.15.146:0/784495920 learned_addr learned my addr 172.21.15.146:0/784495920 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.855+0000 7febf9e63700 1 --2- 172.21.15.146:0/784495920 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bc3ff5ba90 0x55bc3ff3e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.855+0000 7febf9662700 1 --2- 172.21.15.146:0/784495920 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bc3ff15bd0 0x55bc3ffbff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.855+0000 7febf8e61700 1 -- 172.21.15.146:0/784495920 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bc3ff15bd0 msgr2=0x55bc3ffbff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:22.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.855+0000 7febf8e61700 1 --2- 172.21.15.146:0/784495920 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bc3ff15bd0 0x55bc3ffbff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.855+0000 7febf8e61700 1 -- 172.21.15.146:0/784495920 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bc3ff5ba90 msgr2=0x55bc3ff3e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:22.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.855+0000 7febf8e61700 1 --2- 172.21.15.146:0/784495920 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bc3ff5ba90 0x55bc3ff3e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.855+0000 7febf8e61700 1 -- 172.21.15.146:0/784495920 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febf40af130 con 0x55bc3ff179a0 2023-10-06T11:15:22.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.855+0000 7febf8e61700 1 --2- 172.21.15.146:0/784495920 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc3ff179a0 0x55bc3ffba780 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7febe400f9b0 tx=0x7febe402b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9fbb9c2d2d5eb74 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:22.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.855+0000 7febd37fe700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:15:22.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.856+0000 7febd37fe700 1 -- 172.21.15.146:0/784495920 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe4020e80 con 0x55bc3ff179a0 2023-10-06T11:15:22.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.856+0000 7febd37fe700 1 -- 172.21.15.146:0/784495920 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(125..125 src has 1..125) v4 ==== 6058+0+0 (secure 0 0 0) 0x7febe4033920 con 0x55bc3ff179a0 2023-10-06T11:15:22.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.856+0000 7fec04bbeb80 1 -- 172.21.15.146:0/784495920 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7febe4019070 con 0x55bc3ff179a0 2023-10-06T11:15:22.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.856+0000 7febd37fe700 1 -- 172.21.15.146:0/784495920 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7febe400a240 con 0x55bc3ff179a0 2023-10-06T11:15:22.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.856+0000 7fec04bbeb80 10 client.8865 fetch_fsmap learned FSMap version 108 2023-10-06T11:15:22.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.856+0000 7fec04bbeb80 1 -- 172.21.15.146:0/784495920 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) v3 -- 0x55bc3fe1a470 con 0x55bc3ff179a0 2023-10-06T11:15:22.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.856+0000 7febd37fe700 1 -- 172.21.15.146:0/784495920 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe4019070 con 0x55bc3ff179a0 2023-10-06T11:15:22.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.856+0000 7febd37fe700 1 -- 172.21.15.146:0/784495920 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 108) v1 ==== 3100+0+0 (secure 0 0 0) 0x7febe4005a00 con 0x55bc3ff179a0 2023-10-06T11:15:22.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.856+0000 7fec04bbeb80 10 client.8865 fetch_fsmap finished waiting for FSMap version 108 2023-10-06T11:15:22.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.856+0000 7fec04bbeb80 10 client.8865 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T11:15:22.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.856+0000 7fec04bbeb80 20 client.8865 populate_metadata read hostname 'smithi146' 2023-10-06T11:15:22.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.856+0000 7fec04bbeb80 1 --2- 172.21.15.146:0/784495920 >> [v2:172.21.15.146:6835/1974709597,v1:172.21.15.146:6837/1974709597] conn(0x55bc3ff14a10 0x55bc3ff14de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.856+0000 7fec04bbeb80 4 client.8865 mds_command: new command op to 8682 tid=0[{"prefix": "status"}] 2023-10-06T11:15:22.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.856+0000 7fec04bbeb80 1 -- 172.21.15.146:0/784495920 --> [v2:172.21.15.146:6835/1974709597,v1:172.21.15.146:6837/1974709597] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55bc3fe07e00 con 0x55bc3ff14a10 2023-10-06T11:15:22.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.856+0000 7febf9662700 1 --2- 172.21.15.146:0/784495920 >> [v2:172.21.15.146:6835/1974709597,v1:172.21.15.146:6837/1974709597] conn(0x55bc3ff14a10 0x55bc3ff14de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.856+0000 7febd37fe700 10 client.8865 ms_handle_connect on v2:172.21.15.146:6835/1974709597 2023-10-06T11:15:22.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.856+0000 7febf9662700 1 --2- 172.21.15.146:0/784495920 >> [v2:172.21.15.146:6835/1974709597,v1:172.21.15.146:6837/1974709597] conn(0x55bc3ff14a10 0x55bc3ff14de0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=454ce1845fa109d6 server_cookie=248440c23b61376 in_seq=0 out_seq=0 2023-10-06T11:15:22.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.857+0000 7febd37fe700 1 -- 172.21.15.146:0/784495920 <== mds.0 v2:172.21.15.146:6835/1974709597 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x55bc3fe07e00 con 0x55bc3ff14a10 2023-10-06T11:15:22.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.857+0000 7febd37fe700 10 client.8865 handle_command_reply: tid=0 2023-10-06T11:15:22.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.857+0000 7fec04bbeb80 1 client.8865 shutdown 2023-10-06T11:15:22.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.857+0000 7fec04bbeb80 1 -- 172.21.15.146:0/784495920 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc3ff179a0 msgr2=0x55bc3ffba780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:22.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.857+0000 7fec04bbeb80 1 --2- 172.21.15.146:0/784495920 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc3ff179a0 0x55bc3ffba780 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7febe400f9b0 tx=0x7febe402b000 comp rx=0 tx=0).stop 2023-10-06T11:15:22.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.857+0000 7fec04bbeb80 1 -- 172.21.15.146:0/784495920 shutdown_connections 2023-10-06T11:15:22.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.857+0000 7fec04bbeb80 1 --2- 172.21.15.146:0/784495920 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bc3ff5ba90 0x55bc3ff3e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.857+0000 7fec04bbeb80 1 --2- 172.21.15.146:0/784495920 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bc3ff15bd0 0x55bc3ffbff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.857+0000 7fec04bbeb80 1 --2- 172.21.15.146:0/784495920 >> [v2:172.21.15.146:6835/1974709597,v1:172.21.15.146:6837/1974709597] conn(0x55bc3ff14a10 0x55bc3ff14de0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.857+0000 7fec04bbeb80 1 --2- 172.21.15.146:0/784495920 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bc3ff179a0 0x55bc3ffba780 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.857+0000 7febd37fe700 0 client.8865 ms_handle_reset on v2:172.21.15.146:6835/1974709597 2023-10-06T11:15:22.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.857+0000 7fec04bbeb80 1 -- 172.21.15.146:0/784495920 >> 172.21.15.146:0/784495920 conn(0x55bc3ff16070 msgr2=0x55bc3ff0f910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:22.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.857+0000 7fec04bbeb80 1 -- 172.21.15.146:0/784495920 shutdown_connections 2023-10-06T11:15:22.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.857+0000 7fec04bbeb80 1 -- 172.21.15.146:0/784495920 wait complete. 2023-10-06T11:15:22.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.857+0000 7fec04bbeb80 20 client.8865 trim_cache size 0 max 16384 2023-10-06T11:15:22.866 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:15:22.866 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1", 2023-10-06T11:15:22.866 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2023-10-06T11:15:22.866 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 8682, 2023-10-06T11:15:22.866 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2023-10-06T11:15:22.867 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2023-10-06T11:15:22.867 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2023-10-06T11:15:22.867 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 10.308213682, 2023-10-06T11:15:22.867 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 108, 2023-10-06T11:15:22.867 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 125, 2023-10-06T11:15:22.867 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 125, 2023-10-06T11:15:22.867 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 16.440417664999998 2023-10-06T11:15:22.867 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:15:22.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.857+0000 7febfb8c6700 1 -- 172.21.15.146:0/4161684519 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7febd8066f30 msgr2=0x7febd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:22.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.857+0000 7febfb8c6700 1 --2- 172.21.15.146:0/4161684519 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7febd8066f30 0x7febd80693e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7febf4155af0 tx=0x7febe4006f90 comp rx=0 tx=0).stop 2023-10-06T11:15:22.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.857+0000 7febfb8c6700 1 -- 172.21.15.146:0/4161684519 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febf40676c0 msgr2=0x7febf40ae4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:22.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.857+0000 7febfb8c6700 1 --2- 172.21.15.146:0/4161684519 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febf40676c0 0x7febf40ae4e0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7febf0009290 tx=0x7febf0016000 comp rx=0 tx=0).stop 2023-10-06T11:15:22.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.857+0000 7febfb8c6700 1 -- 172.21.15.146:0/4161684519 shutdown_connections 2023-10-06T11:15:22.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.857+0000 7febfb8c6700 1 --2- 172.21.15.146:0/4161684519 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7febd8066f30 0x7febd80693e0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.857+0000 7febfb8c6700 1 --2- 172.21.15.146:0/4161684519 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7febf406e690 0x7febf40c20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.857+0000 7febfb8c6700 1 --2- 172.21.15.146:0/4161684519 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7febf40676c0 0x7febf40ae4e0 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.857+0000 7febfb8c6700 1 --2- 172.21.15.146:0/4161684519 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7febf4067a90 0x7febf4148de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.857+0000 7febfb8c6700 1 -- 172.21.15.146:0/4161684519 >> 172.21.15.146:0/4161684519 conn(0x7febf4068580 msgr2=0x7febf4068950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:22.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.858+0000 7febfb8c6700 1 -- 172.21.15.146:0/4161684519 shutdown_connections 2023-10-06T11:15:22.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.858+0000 7febfb8c6700 1 -- 172.21.15.146:0/4161684519 wait complete. 2023-10-06T11:15:22.871 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T11:15:22.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.983+0000 7ff05e1d1700 1 Processor -- start 2023-10-06T11:15:22.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.983+0000 7ff05e1d1700 1 -- start start 2023-10-06T11:15:22.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.984+0000 7ff05e1d1700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff058153ab0 0x7ff05815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.984+0000 7ff05e1d1700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff058153e80 0x7ff058068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.984+0000 7ff05e1d1700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff0580689d0 0x7ff05815d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.984+0000 7ff05e1d1700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff058068e50 con 0x7ff058153e80 2023-10-06T11:15:22.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.984+0000 7ff05e1d1700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff05815ac30 con 0x7ff0580689d0 2023-10-06T11:15:22.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.984+0000 7ff05e1d1700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0580b4510 con 0x7ff058153ab0 2023-10-06T11:15:22.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.984+0000 7ff056ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff058153e80 0x7ff058068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.984+0000 7ff056ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff058153e80 0x7ff058068490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49276/0 (socket says 172.21.15.146:49276) 2023-10-06T11:15:22.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.984+0000 7ff056ffd700 1 -- 172.21.15.146:0/4058878817 learned_addr learned my addr 172.21.15.146:0/4058878817 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:22.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.984+0000 7ff057fff700 1 --2- 172.21.15.146:0/4058878817 >> v2:172.21.15.151:3300/0 conn(0x7ff0580689d0 0x7ff05815d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.984+0000 7ff0577fe700 1 --2- 172.21.15.146:0/4058878817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff058153ab0 0x7ff05815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.985+0000 7ff056ffd700 1 -- 172.21.15.146:0/4058878817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff058153ab0 msgr2=0x7ff05815a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:22.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.985+0000 7ff056ffd700 1 --2- 172.21.15.146:0/4058878817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff058153ab0 0x7ff05815a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.985+0000 7ff056ffd700 1 -- 172.21.15.146:0/4058878817 >> v2:172.21.15.151:3300/0 conn(0x7ff0580689d0 msgr2=0x7ff05815d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:22.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.985+0000 7ff056ffd700 1 --2- 172.21.15.146:0/4058878817 >> v2:172.21.15.151:3300/0 conn(0x7ff0580689d0 0x7ff05815d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.985+0000 7ff056ffd700 1 -- 172.21.15.146:0/4058878817 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0580b6530 con 0x7ff058153e80 2023-10-06T11:15:22.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.985+0000 7ff057fff700 1 --2- 172.21.15.146:0/4058878817 >> v2:172.21.15.151:3300/0 conn(0x7ff0580689d0 0x7ff05815d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:22.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.985+0000 7ff056ffd700 1 --2- 172.21.15.146:0/4058878817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff058153e80 0x7ff058068490 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7ff058089a80 tx=0x7ff04c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a45324a18bc9f0ee server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:22.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.985+0000 7ff0567fc700 1 -- 172.21.15.146:0/4058878817 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04c00b860 con 0x7ff058153e80 2023-10-06T11:15:22.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.985+0000 7ff0567fc700 1 -- 172.21.15.146:0/4058878817 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04c00b9c0 con 0x7ff058153e80 2023-10-06T11:15:22.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.985+0000 7ff0567fc700 1 -- 172.21.15.146:0/4058878817 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04c00bd60 con 0x7ff058153e80 2023-10-06T11:15:22.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.985+0000 7ff05e1d1700 1 -- 172.21.15.146:0/4058878817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff058153e80 msgr2=0x7ff058068490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:22.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.985+0000 7ff05e1d1700 1 --2- 172.21.15.146:0/4058878817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff058153e80 0x7ff058068490 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7ff058089a80 tx=0x7ff04c009250 comp rx=0 tx=0).stop 2023-10-06T11:15:22.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.985+0000 7ff05e1d1700 1 -- 172.21.15.146:0/4058878817 shutdown_connections 2023-10-06T11:15:22.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.985+0000 7ff05e1d1700 1 --2- 172.21.15.146:0/4058878817 >> v2:172.21.15.151:3300/0 conn(0x7ff0580689d0 0x7ff05815d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.985+0000 7ff05e1d1700 1 --2- 172.21.15.146:0/4058878817 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff058153ab0 0x7ff05815a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.985+0000 7ff05e1d1700 1 --2- 172.21.15.146:0/4058878817 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff058153e80 0x7ff058068490 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.985+0000 7ff05e1d1700 1 -- 172.21.15.146:0/4058878817 >> 172.21.15.146:0/4058878817 conn(0x7ff05806eba0 msgr2=0x7ff05806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:22.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.985+0000 7ff05e1d1700 1 -- 172.21.15.146:0/4058878817 shutdown_connections 2023-10-06T11:15:22.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.985+0000 7ff05e1d1700 1 -- 172.21.15.146:0/4058878817 wait complete. 2023-10-06T11:15:22.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.987+0000 7ff05e1d1700 1 Processor -- start 2023-10-06T11:15:22.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.987+0000 7ff05e1d1700 1 -- start start 2023-10-06T11:15:22.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.987+0000 7ff05e1d1700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0580689d0 0x7ff05813d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.987+0000 7ff05e1d1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff058153ab0 0x7ff0580b1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.987+0000 7ff05e1d1700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff058153e80 0x7ff0580b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.987+0000 7ff05e1d1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05813e590 con 0x7ff058153ab0 2023-10-06T11:15:22.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.987+0000 7ff05e1d1700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05816e4d0 con 0x7ff0580689d0 2023-10-06T11:15:22.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.987+0000 7ff05e1d1700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0580b23f0 con 0x7ff058153e80 2023-10-06T11:15:22.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.988+0000 7ff056ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff058153ab0 0x7ff0580b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.988+0000 7ff056ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff058153ab0 0x7ff0580b1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49278/0 (socket says 172.21.15.146:49278) 2023-10-06T11:15:22.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.988+0000 7ff056ffd700 1 -- 172.21.15.146:0/3632266294 learned_addr learned my addr 172.21.15.146:0/3632266294 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:22.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.988+0000 7ff0577fe700 1 --2- 172.21.15.146:0/3632266294 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0580689d0 0x7ff05813d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.988+0000 7ff057fff700 1 --2- 172.21.15.146:0/3632266294 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff058153e80 0x7ff0580b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.988+0000 7ff056ffd700 1 -- 172.21.15.146:0/3632266294 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff058153e80 msgr2=0x7ff0580b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:22.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.988+0000 7ff056ffd700 1 --2- 172.21.15.146:0/3632266294 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff058153e80 0x7ff0580b1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.988+0000 7ff056ffd700 1 -- 172.21.15.146:0/3632266294 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0580689d0 msgr2=0x7ff05813d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:22.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.988+0000 7ff056ffd700 1 --2- 172.21.15.146:0/3632266294 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0580689d0 0x7ff05813d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:22.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.988+0000 7ff056ffd700 1 -- 172.21.15.146:0/3632266294 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff04c0094f0 con 0x7ff058153ab0 2023-10-06T11:15:22.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.988+0000 7ff056ffd700 1 --2- 172.21.15.146:0/3632266294 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff058153ab0 0x7ff0580b1870 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7ff04c009290 tx=0x7ff04c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:22.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.988+0000 7ff03f7fe700 1 -- 172.21.15.146:0/3632266294 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04c011e40 con 0x7ff058153ab0 2023-10-06T11:15:22.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.988+0000 7ff03f7fe700 1 -- 172.21.15.146:0/3632266294 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04c01f070 con 0x7ff058153ab0 2023-10-06T11:15:22.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.988+0000 7ff03f7fe700 1 -- 172.21.15.146:0/3632266294 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04c0266d0 con 0x7ff058153ab0 2023-10-06T11:15:22.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.988+0000 7ff05e1d1700 1 -- 172.21.15.146:0/3632266294 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0580b26d0 con 0x7ff058153ab0 2023-10-06T11:15:22.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.988+0000 7ff05e1d1700 1 -- 172.21.15.146:0/3632266294 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff05813e220 con 0x7ff058153ab0 2023-10-06T11:15:22.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.989+0000 7ff05e1d1700 1 -- 172.21.15.146:0/3632266294 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff05804c380 con 0x7ff058153ab0 2023-10-06T11:15:22.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.989+0000 7ff03f7fe700 1 -- 172.21.15.146:0/3632266294 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff04c026a40 con 0x7ff058153ab0 2023-10-06T11:15:22.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.990+0000 7ff03f7fe700 1 --2- 172.21.15.146:0/3632266294 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff044066f30 0x7ff0440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:22.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.990+0000 7ff03f7fe700 1 -- 172.21.15.146:0/3632266294 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff04c021070 con 0x7ff058153ab0 2023-10-06T11:15:22.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.990+0000 7ff0577fe700 1 --2- 172.21.15.146:0/3632266294 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff044066f30 0x7ff0440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:22.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.990+0000 7ff0577fe700 1 --2- 172.21.15.146:0/3632266294 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff044066f30 0x7ff0440693e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ff048009fd0 tx=0x7ff048009880 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:22.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:22.994+0000 7ff03f7fe700 1 -- 172.21.15.146:0/3632266294 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff04c053540 con 0x7ff058153ab0 2023-10-06T11:15:23.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:23.217+0000 7ff05e1d1700 1 -- 172.21.15.146:0/3632266294 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff05813e6d0 con 0x7ff058153ab0 2023-10-06T11:15:23.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:23.218+0000 7ff03f7fe700 1 -- 172.21.15.146:0/3632266294 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v108) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff04c056b60 con 0x7ff058153ab0 2023-10-06T11:15:23.220 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T11:15:23.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:23.220+0000 7ff05e1d1700 1 -- 172.21.15.146:0/3632266294 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff044066f30 msgr2=0x7ff0440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:23.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:23.220+0000 7ff05e1d1700 1 --2- 172.21.15.146:0/3632266294 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff044066f30 0x7ff0440693e0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7ff048009fd0 tx=0x7ff048009880 comp rx=0 tx=0).stop 2023-10-06T11:15:23.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:23.220+0000 7ff05e1d1700 1 -- 172.21.15.146:0/3632266294 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff058153ab0 msgr2=0x7ff0580b1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:23.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:23.220+0000 7ff05e1d1700 1 --2- 172.21.15.146:0/3632266294 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff058153ab0 0x7ff0580b1870 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7ff04c009290 tx=0x7ff04c017000 comp rx=0 tx=0).stop 2023-10-06T11:15:23.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:23.220+0000 7ff05e1d1700 1 -- 172.21.15.146:0/3632266294 shutdown_connections 2023-10-06T11:15:23.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:23.220+0000 7ff05e1d1700 1 --2- 172.21.15.146:0/3632266294 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff044066f30 0x7ff0440693e0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:23.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:23.220+0000 7ff05e1d1700 1 --2- 172.21.15.146:0/3632266294 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff058153e80 0x7ff0580b1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:23.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:23.220+0000 7ff05e1d1700 1 --2- 172.21.15.146:0/3632266294 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0580689d0 0x7ff05813d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:23.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:23.220+0000 7ff05e1d1700 1 --2- 172.21.15.146:0/3632266294 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff058153ab0 0x7ff0580b1870 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:23.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:23.220+0000 7ff05e1d1700 1 -- 172.21.15.146:0/3632266294 >> 172.21.15.146:0/3632266294 conn(0x7ff05806eba0 msgr2=0x7ff058151d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:23.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:23.220+0000 7ff05e1d1700 1 -- 172.21.15.146:0/3632266294 shutdown_connections 2023-10-06T11:15:23.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:23.220+0000 7ff05e1d1700 1 -- 172.21.15.146:0/3632266294 wait complete. 2023-10-06T11:15:23.234 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T11:15:23.234 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T11:15:23.234 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2023-10-06T11:15:23.234 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T11:15:23.234 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T11:15:23.234 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T11:15:23.234 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T11:15:23.234 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T11:15:23.235 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:15:23.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:15:23.235 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2023-10-06T11:15:23.250 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:15:23.250 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:15:23.250 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:15:23.250 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:15:23.250 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2023-10-06T11:15:23.250 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:15:23.250 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:15:23.250 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2023-10-06T11:15:23.251 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2023-10-06T11:15:23.251 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:15:23.251 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2023-10-06T11:15:23.251 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2023-10-06T11:15:23.251 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:15:23.251 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2023-10-06T11:15:23.251 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T11:15:23.251 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2023-10-06T11:15:23.251 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T11:15:23.251 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 41934sec preferred_lft 41934sec 2023-10-06T11:15:23.251 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link noprefixroute 2023-10-06T11:15:23.251 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:15:23.252 INFO:teuthology.orchestra.run.smithi146.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T11:15:23.252 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0e:4f:33:80:c4:0e brd ff:ff:ff:ff:ff:ff 2023-10-06T11:15:23.252 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T11:15:23.252 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:15:23.252 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3884:6eff:fefc:ffc7/64 scope link 2023-10-06T11:15:23.252 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:15:23.252 INFO:teuthology.orchestra.run.smithi146.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:15:23.252 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0e:4f:33:80:c4:0e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T11:15:23.252 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::c4f:33ff:fe80:c40e/64 scope link 2023-10-06T11:15:23.252 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:15:23.252 INFO:teuthology.orchestra.run.smithi146.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:15:23.252 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 36:96:28:73:57:c4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T11:15:23.253 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3496:28ff:fe73:57c4/64 scope link 2023-10-06T11:15:23.253 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:15:23.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:15:23.253 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T11:15:23.313 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-06T11:15:23.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:15:23.315 DEBUG:teuthology.orchestra.run.smithi146:> route 2023-10-06T11:15:23.370 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2023-10-06T11:15:23.370 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T11:15:23.370 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T11:15:23.370 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T11:15:23.370 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T11:15:23.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:15:23.371 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-10-06T11:15:23.371 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:15:23.371 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T11:15:23.371 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T11:15:23.371 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T11:15:23.371 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:15:23.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:15:23.471 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-10-06T11:15:23.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T11:15:23.486 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T11:15:23.486 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:15:23.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:15:23.486 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2023-10-06T11:15:23.550 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T11:15:23.550 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:15:23.550 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T11:15:23.605 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:15:23.605 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:15:23.606 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:15:23.660 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-06T11:15:23.725 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:15:23.725 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:15:23.789 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:15:23.790 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:15:23.791 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:15:23.791 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-06T11:15:23.846 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T11:15:23.847 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T11:15:23.889 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-06T11:15:23.913 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:15:23.941 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:15:23.971 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:2023-10-06T11:15:23.969+0000 7f1ccd3bd540 -1 init, newargv = 0x55b00954cf90 newargc=15 2023-10-06T11:15:23.971 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[145916]: starting ceph client 2023-10-06T11:15:23.975 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[145916]: starting fuse 2023-10-06T11:15:23.980 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:15:23.981 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:15:23.981 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:15:23.981 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-06T11:15:24.036 INFO:teuthology.orchestra.run.smithi146.stdout:46 2023-10-06T11:15:24.037 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-06T11:15:24.037 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T11:15:24.037 DEBUG:teuthology.orchestra.run.smithi146:> import glob 2023-10-06T11:15:24.037 DEBUG:teuthology.orchestra.run.smithi146:> import re 2023-10-06T11:15:24.037 DEBUG:teuthology.orchestra.run.smithi146:> import os 2023-10-06T11:15:24.037 DEBUG:teuthology.orchestra.run.smithi146:> import subprocess 2023-10-06T11:15:24.037 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:15:24.037 DEBUG:teuthology.orchestra.run.smithi146:> def _find_admin_socket(client_name): 2023-10-06T11:15:24.037 DEBUG:teuthology.orchestra.run.smithi146:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T11:15:24.037 DEBUG:teuthology.orchestra.run.smithi146:> files = glob.glob(asok_path) 2023-10-06T11:15:24.038 DEBUG:teuthology.orchestra.run.smithi146:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T11:15:24.038 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:15:24.038 DEBUG:teuthology.orchestra.run.smithi146:> # Given a non-glob path, it better be there 2023-10-06T11:15:24.038 DEBUG:teuthology.orchestra.run.smithi146:> if "*" not in asok_path: 2023-10-06T11:15:24.038 DEBUG:teuthology.orchestra.run.smithi146:> assert(len(files) == 1) 2023-10-06T11:15:24.038 DEBUG:teuthology.orchestra.run.smithi146:> return files[0] 2023-10-06T11:15:24.038 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:15:24.038 DEBUG:teuthology.orchestra.run.smithi146:> for f in files: 2023-10-06T11:15:24.038 DEBUG:teuthology.orchestra.run.smithi146:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T11:15:24.038 DEBUG:teuthology.orchestra.run.smithi146:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T11:15:24.038 DEBUG:teuthology.orchestra.run.smithi146:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T11:15:24.038 DEBUG:teuthology.orchestra.run.smithi146:> contents = proc_f.read() 2023-10-06T11:15:24.038 DEBUG:teuthology.orchestra.run.smithi146:> if mountpoint in contents: 2023-10-06T11:15:24.039 DEBUG:teuthology.orchestra.run.smithi146:> return f 2023-10-06T11:15:24.039 DEBUG:teuthology.orchestra.run.smithi146:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T11:15:24.039 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:15:24.039 DEBUG:teuthology.orchestra.run.smithi146:> print(_find_admin_socket("client.0")) 2023-10-06T11:15:24.039 DEBUG:teuthology.orchestra.run.smithi146:> ' 2023-10-06T11:15:24.157 INFO:teuthology.orchestra.run.smithi146.stdout:/var/run/ceph/ceph-client.0.145916.asok 2023-10-06T11:15:24.339 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.145916.asok 2023-10-06T11:15:24.340 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:15:24.340 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.145916.asok status 2023-10-06T11:15:24.490 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:15:24.491 INFO:teuthology.orchestra.run.smithi146.stdout: "metadata": { 2023-10-06T11:15:24.491 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T11:15:24.491 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T11:15:24.491 INFO:teuthology.orchestra.run.smithi146.stdout: "entity_id": "0", 2023-10-06T11:15:24.491 INFO:teuthology.orchestra.run.smithi146.stdout: "hostname": "smithi146", 2023-10-06T11:15:24.491 INFO:teuthology.orchestra.run.smithi146.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T11:15:24.491 INFO:teuthology.orchestra.run.smithi146.stdout: "pid": "145916", 2023-10-06T11:15:24.492 INFO:teuthology.orchestra.run.smithi146.stdout: "root": "/" 2023-10-06T11:15:24.492 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:15:24.492 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_count": 0, 2023-10-06T11:15:24.492 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_pinned_count": 0, 2023-10-06T11:15:24.492 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 8880, 2023-10-06T11:15:24.492 INFO:teuthology.orchestra.run.smithi146.stdout: "inst": { 2023-10-06T11:15:24.492 INFO:teuthology.orchestra.run.smithi146.stdout: "name": { 2023-10-06T11:15:24.492 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "client", 2023-10-06T11:15:24.492 INFO:teuthology.orchestra.run.smithi146.stdout: "num": 8880 2023-10-06T11:15:24.492 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:15:24.492 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-06T11:15:24.493 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-06T11:15:24.493 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:15:24.493 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 1564020564 2023-10-06T11:15:24.493 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:15:24.493 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:15:24.493 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-06T11:15:24.493 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-06T11:15:24.493 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:15:24.493 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 1564020564 2023-10-06T11:15:24.493 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:15:24.493 INFO:teuthology.orchestra.run.smithi146.stdout: "inst_str": "client.8880 192.168.0.1:0/1564020564", 2023-10-06T11:15:24.494 INFO:teuthology.orchestra.run.smithi146.stdout: "addr_str": "192.168.0.1:0/1564020564", 2023-10-06T11:15:24.494 INFO:teuthology.orchestra.run.smithi146.stdout: "inode_count": 1, 2023-10-06T11:15:24.494 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_epoch": 108, 2023-10-06T11:15:24.494 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch": 125, 2023-10-06T11:15:24.494 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch_barrier": 0, 2023-10-06T11:15:24.494 INFO:teuthology.orchestra.run.smithi146.stdout: "blocklisted": false, 2023-10-06T11:15:24.494 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs" 2023-10-06T11:15:24.494 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:15:24.500 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:15:24.501 DEBUG:teuthology.orchestra.run.smithi146:> stat --file-system '--printf=%T 2023-10-06T11:15:24.501 DEBUG:teuthology.orchestra.run.smithi146:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T11:15:24.515 INFO:teuthology.orchestra.run.smithi146.stdout:fuseblk 2023-10-06T11:15:24.516 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T11:15:24.516 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:15:24.516 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:15:24.580 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:15:24.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.734+0000 7fd3bfade700 1 Processor -- start 2023-10-06T11:15:24.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.734+0000 7fd3bfade700 1 -- start start 2023-10-06T11:15:24.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.735+0000 7fd3bfade700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd3b8153e80 0x7fd3b815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:24.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.735+0000 7fd3bfade700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3b815ac30 con 0x7fd3b8153ab0 2023-10-06T11:15:24.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.735+0000 7fd3bfade700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3b80b4510 con 0x7fd3b8068ba0 2023-10-06T11:15:24.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.735+0000 7fd3bfade700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3b80b6530 con 0x7fd3b8153e80 2023-10-06T11:15:24.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.735+0000 7fd3be07b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd3b8153e80 0x7fd3b815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:24.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.735+0000 7fd3bd87a700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd3b8153ab0 0x7fd3b8068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:37314/0 (socket says 172.21.15.146:37314) 2023-10-06T11:15:24.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.735+0000 7fd3bd87a700 1 -- 172.21.15.146:0/4125040056 learned_addr learned my addr 172.21.15.146:0/4125040056 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:15:24.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.735+0000 7fd3be07b700 1 -- 172.21.15.146:0/4125040056 >> v1:172.21.15.151:6789/0 conn(0x7fd3b8068ba0 legacy=0x7fd3b80b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:24.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.735+0000 7fd3be07b700 1 -- 172.21.15.146:0/4125040056 >> v1:172.21.15.146:6789/0 conn(0x7fd3b8153ab0 legacy=0x7fd3b8068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:24.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.735+0000 7fd3be07b700 1 -- 172.21.15.146:0/4125040056 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b80b5c50 con 0x7fd3b8153e80 2023-10-06T11:15:24.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.735+0000 7fd3be07b700 1 --2- 172.21.15.146:0/4125040056 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3b8153e80 0x7fd3b815a6f0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fd3a80098e0 tx=0x7fd3a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff315fb088411411 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:24.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.735+0000 7fd3bc878700 1 -- 172.21.15.146:0/4125040056 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a8009e80 con 0x7fd3b8153e80 2023-10-06T11:15:24.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.735+0000 7fd3bc878700 1 -- 172.21.15.146:0/4125040056 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a800b860 con 0x7fd3b8153e80 2023-10-06T11:15:24.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.735+0000 7fd3bc878700 1 -- 172.21.15.146:0/4125040056 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a800bbe0 con 0x7fd3b8153e80 2023-10-06T11:15:24.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.736+0000 7fd3bfade700 1 -- 172.21.15.146:0/4125040056 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3b8153e80 msgr2=0x7fd3b815a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:24.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.736+0000 7fd3bfade700 1 --2- 172.21.15.146:0/4125040056 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3b8153e80 0x7fd3b815a6f0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fd3a80098e0 tx=0x7fd3a80091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:24.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.736+0000 7fd3bfade700 1 -- 172.21.15.146:0/4125040056 shutdown_connections 2023-10-06T11:15:24.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.736+0000 7fd3bfade700 1 --2- 172.21.15.146:0/4125040056 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3b8153e80 0x7fd3b815a6f0 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:24.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.736+0000 7fd3bfade700 1 -- 172.21.15.146:0/4125040056 >> 172.21.15.146:0/4125040056 conn(0x7fd3b806eba0 msgr2=0x7fd3b806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:24.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.736+0000 7fd3bfade700 1 -- 172.21.15.146:0/4125040056 shutdown_connections 2023-10-06T11:15:24.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.736+0000 7fd3bfade700 1 -- 172.21.15.146:0/4125040056 wait complete. 2023-10-06T11:15:24.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.737+0000 7fd3bfade700 1 Processor -- start 2023-10-06T11:15:24.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.737+0000 7fd3bfade700 1 -- start start 2023-10-06T11:15:24.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.738+0000 7fd3bfade700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd3b8068ba0 0x7fd3b8154370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:24.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.738+0000 7fd3bfade700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3b8153ab0 0x7fd3b8155f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:24.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.738+0000 7fd3bfade700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3b8153e80 0x7fd3b8156be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:24.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.738+0000 7fd3bfade700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b8155ad0 con 0x7fd3b8153ab0 2023-10-06T11:15:24.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.738+0000 7fd3bfade700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b81548b0 con 0x7fd3b8153e80 2023-10-06T11:15:24.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.738+0000 7fd3bfade700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b8154be0 con 0x7fd3b8068ba0 2023-10-06T11:15:24.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.738+0000 7fd3bd079700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3b8153ab0 0x7fd3b8155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:24.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.738+0000 7fd3bd079700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3b8153ab0 0x7fd3b8155f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49300/0 (socket says 172.21.15.146:49300) 2023-10-06T11:15:24.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.738+0000 7fd3bd079700 1 -- 172.21.15.146:0/3347662052 learned_addr learned my addr 172.21.15.146:0/3347662052 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:24.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.738+0000 7fd3bd87a700 1 --2- 172.21.15.146:0/3347662052 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd3b8068ba0 0x7fd3b8154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:24.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.738+0000 7fd3be07b700 1 --2- 172.21.15.146:0/3347662052 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3b8153e80 0x7fd3b8156be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:24.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.738+0000 7fd3bd079700 1 -- 172.21.15.146:0/3347662052 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd3b8068ba0 msgr2=0x7fd3b8154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:24.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.738+0000 7fd3bd079700 1 --2- 172.21.15.146:0/3347662052 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd3b8068ba0 0x7fd3b8154370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:24.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.738+0000 7fd3bd079700 1 -- 172.21.15.146:0/3347662052 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3b8153e80 msgr2=0x7fd3b8156be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:24.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.738+0000 7fd3bd079700 1 --2- 172.21.15.146:0/3347662052 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3b8153e80 0x7fd3b8156be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:24.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.738+0000 7fd3bd079700 1 -- 172.21.15.146:0/3347662052 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a8009420 con 0x7fd3b8153ab0 2023-10-06T11:15:24.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.738+0000 7fd3bd079700 1 --2- 172.21.15.146:0/3347662052 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3b8153ab0 0x7fd3b8155f60 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac00bb60 tx=0x7fd3ac0097f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:24.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.739+0000 7fd3b5ffb700 1 -- 172.21.15.146:0/3347662052 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac00c940 con 0x7fd3b8153ab0 2023-10-06T11:15:24.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.739+0000 7fd3b5ffb700 1 -- 172.21.15.146:0/3347662052 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3ac00caa0 con 0x7fd3b8153ab0 2023-10-06T11:15:24.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.739+0000 7fd3bfade700 1 -- 172.21.15.146:0/3347662052 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3b8154ec0 con 0x7fd3b8153ab0 2023-10-06T11:15:24.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.739+0000 7fd3b5ffb700 1 -- 172.21.15.146:0/3347662052 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac00ce60 con 0x7fd3b8153ab0 2023-10-06T11:15:24.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.739+0000 7fd3bfade700 1 -- 172.21.15.146:0/3347662052 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3b8155480 con 0x7fd3b8153ab0 2023-10-06T11:15:24.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.740+0000 7fd3bfade700 1 -- 172.21.15.146:0/3347662052 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3b804c380 con 0x7fd3b8153ab0 2023-10-06T11:15:24.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.740+0000 7fd3b5ffb700 1 -- 172.21.15.146:0/3347662052 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd3ac014620 con 0x7fd3b8153ab0 2023-10-06T11:15:24.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.741+0000 7fd3b5ffb700 1 --2- 172.21.15.146:0/3347662052 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd3a4066f30 0x7fd3a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:24.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.741+0000 7fd3b5ffb700 1 -- 172.21.15.146:0/3347662052 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd3ac084760 con 0x7fd3b8153ab0 2023-10-06T11:15:24.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.741+0000 7fd3bd87a700 1 --2- 172.21.15.146:0/3347662052 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd3a4066f30 0x7fd3a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:24.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.741+0000 7fd3bd87a700 1 --2- 172.21.15.146:0/3347662052 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd3a4066f30 0x7fd3a40693e0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0001800 tx=0x7fd3b0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:24.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.745+0000 7fd3b5ffb700 1 -- 172.21.15.146:0/3347662052 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd3ac04c5a0 con 0x7fd3b8153ab0 2023-10-06T11:15:24.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.969+0000 7fd3bfade700 1 -- 172.21.15.146:0/3347662052 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3b80b6250 con 0x7fd3b8153ab0 2023-10-06T11:15:24.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.969+0000 7fd3b5ffb700 1 -- 172.21.15.146:0/3347662052 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) v1 ==== 95+0+4617 (secure 0 0 0) 0x7fd3ac0517d0 con 0x7fd3b8153ab0 2023-10-06T11:15:24.972 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:15:24.972 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":108,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7792,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3693464886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3693464886},{"type":"v1","addr":"172.21.15.151:6834","nonce":3693464886}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103},{"gid":7795,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1155762565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":1155762565},{"type":"v1","addr":"172.21.15.151:6835","nonce":1155762565}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103},{"gid":8679,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/3868720724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3868720724},{"type":"v1","addr":"172.21.15.146:6836","nonce":3868720724}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:15:11.929158+0000","modified":"2023-10-06T11:15:15.569866+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8682},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8682":{"gid":8682,"name":"c","rank":0,"incarnation":104,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/1974709597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":1974709597},{"type":"v1","addr":"172.21.15.146:6837","nonce":1974709597}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-06T11:15:24.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.972+0000 7fd3bfade700 1 -- 172.21.15.146:0/3347662052 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd3a4066f30 msgr2=0x7fd3a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:24.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.972+0000 7fd3bfade700 1 --2- 172.21.15.146:0/3347662052 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd3a4066f30 0x7fd3a40693e0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fd3b0001800 tx=0x7fd3b0009040 comp rx=0 tx=0).stop 2023-10-06T11:15:24.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.972+0000 7fd3bfade700 1 -- 172.21.15.146:0/3347662052 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3b8153ab0 msgr2=0x7fd3b8155f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:24.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.972+0000 7fd3bfade700 1 --2- 172.21.15.146:0/3347662052 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3b8153ab0 0x7fd3b8155f60 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac00bb60 tx=0x7fd3ac0097f0 comp rx=0 tx=0).stop 2023-10-06T11:15:24.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.972+0000 7fd3bfade700 1 -- 172.21.15.146:0/3347662052 shutdown_connections 2023-10-06T11:15:24.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.972+0000 7fd3bfade700 1 --2- 172.21.15.146:0/3347662052 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd3a4066f30 0x7fd3a40693e0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:24.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.972+0000 7fd3bfade700 1 --2- 172.21.15.146:0/3347662052 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd3b8153e80 0x7fd3b8156be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:24.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.972+0000 7fd3bfade700 1 --2- 172.21.15.146:0/3347662052 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd3b8068ba0 0x7fd3b8154370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:24.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.972+0000 7fd3bfade700 1 --2- 172.21.15.146:0/3347662052 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd3b8153ab0 0x7fd3b8155f60 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:24.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.972+0000 7fd3bfade700 1 -- 172.21.15.146:0/3347662052 >> 172.21.15.146:0/3347662052 conn(0x7fd3b806eba0 msgr2=0x7fd3b80cf440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:24.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.972+0000 7fd3bfade700 1 -- 172.21.15.146:0/3347662052 shutdown_connections 2023-10-06T11:15:24.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:24.972+0000 7fd3bfade700 1 -- 172.21.15.146:0/3347662052 wait complete. 2023-10-06T11:15:24.975 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 108 2023-10-06T11:15:24.987 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:15:25.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.101+0000 7f51b6f3f700 1 Processor -- start 2023-10-06T11:15:25.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.101+0000 7f51b6f3f700 1 -- start start 2023-10-06T11:15:25.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.102+0000 7f51b6f3f700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f51b0153ab0 0x7f51b015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:25.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.102+0000 7f51b6f3f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51b015ac30 con 0x7f51b0068ba0 2023-10-06T11:15:25.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.102+0000 7f51b6f3f700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51b00b4510 con 0x7f51b0153e80 2023-10-06T11:15:25.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.102+0000 7f51b6f3f700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51b00b6530 con 0x7f51b0153ab0 2023-10-06T11:15:25.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.102+0000 7f51b54dc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f51b0068ba0 0x7f51b00b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:37326/0 (socket says 172.21.15.146:37326) 2023-10-06T11:15:25.113 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.102+0000 7f51b54dc700 1 -- 172.21.15.146:0/304915999 learned_addr learned my addr 172.21.15.146:0/304915999 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:15:25.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.102+0000 7f51b4cdb700 1 --2- 172.21.15.146:0/304915999 >> v2:172.21.15.151:3300/0 conn(0x7f51b0153ab0 0x7f51b015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:25.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.103+0000 7f51a77fe700 1 -- 172.21.15.146:0/304915999 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 727058589 0 0) 0x7f51a8001490 con 0x7f51b0068ba0 2023-10-06T11:15:25.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.103+0000 7f51a77fe700 1 -- 172.21.15.146:0/304915999 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5198003570 con 0x7f51b0068ba0 2023-10-06T11:15:25.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.103+0000 7f51b4cdb700 1 -- 172.21.15.146:0/304915999 >> v1:172.21.15.151:6789/0 conn(0x7f51b0153e80 legacy=0x7f51b0068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:25.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.103+0000 7f51a77fe700 1 -- 172.21.15.146:0/304915999 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3240896754 0 0) 0x7f5198003570 con 0x7f51b0068ba0 2023-10-06T11:15:25.114 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.103+0000 7f51b4cdb700 1 -- 172.21.15.146:0/304915999 >> v1:172.21.15.146:6789/0 conn(0x7f51b0068ba0 legacy=0x7f51b00b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:25.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.103+0000 7f51b4cdb700 1 -- 172.21.15.146:0/304915999 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b00b5c50 con 0x7f51b0153ab0 2023-10-06T11:15:25.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.103+0000 7f51b4cdb700 1 --2- 172.21.15.146:0/304915999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51b0153ab0 0x7f51b015a6f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f51ac0098e0 tx=0x7f51ac0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f568f16723e14aa3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:25.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.103+0000 7f51a77fe700 1 -- 172.21.15.146:0/304915999 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a8001980 con 0x7f51b0153ab0 2023-10-06T11:15:25.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.103+0000 7f51a77fe700 1 -- 172.21.15.146:0/304915999 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ac011420 con 0x7f51b0153ab0 2023-10-06T11:15:25.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.103+0000 7f51a77fe700 1 -- 172.21.15.146:0/304915999 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ac0117a0 con 0x7f51b0153ab0 2023-10-06T11:15:25.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.104+0000 7f51b6f3f700 1 -- 172.21.15.146:0/304915999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51b0153ab0 msgr2=0x7f51b015a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:25.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.104+0000 7f51b6f3f700 1 --2- 172.21.15.146:0/304915999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51b0153ab0 0x7f51b015a6f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f51ac0098e0 tx=0x7f51ac0091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:25.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.104+0000 7f51b6f3f700 1 -- 172.21.15.146:0/304915999 shutdown_connections 2023-10-06T11:15:25.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.104+0000 7f51b6f3f700 1 --2- 172.21.15.146:0/304915999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51b0153ab0 0x7f51b015a6f0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:25.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.104+0000 7f51b6f3f700 1 -- 172.21.15.146:0/304915999 >> 172.21.15.146:0/304915999 conn(0x7f51b006eba0 msgr2=0x7f51b006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:25.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.104+0000 7f51b6f3f700 1 -- 172.21.15.146:0/304915999 shutdown_connections 2023-10-06T11:15:25.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.104+0000 7f51b6f3f700 1 -- 172.21.15.146:0/304915999 wait complete. 2023-10-06T11:15:25.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.105+0000 7f51b6f3f700 1 Processor -- start 2023-10-06T11:15:25.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.105+0000 7f51b6f3f700 1 -- start start 2023-10-06T11:15:25.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.106+0000 7f51b6f3f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51b0068ba0 0x7f51b00b0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:25.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.106+0000 7f51b6f3f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51b0153ab0 0x7f51b016a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:25.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.106+0000 7f51b6f3f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51b0153e80 0x7f51b01420b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:25.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.106+0000 7f51b6f3f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b016ada0 con 0x7f51b0153e80 2023-10-06T11:15:25.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.106+0000 7f51b6f3f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b01425f0 con 0x7f51b0153ab0 2023-10-06T11:15:25.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.106+0000 7f51b6f3f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b00b1160 con 0x7f51b0068ba0 2023-10-06T11:15:25.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.106+0000 7f51b54dc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51b0153e80 0x7f51b01420b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:25.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.106+0000 7f51b54dc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51b0153e80 0x7f51b01420b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49316/0 (socket says 172.21.15.146:49316) 2023-10-06T11:15:25.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.106+0000 7f51b54dc700 1 -- 172.21.15.146:0/3511343247 learned_addr learned my addr 172.21.15.146:0/3511343247 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:25.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.106+0000 7f51b4cdb700 1 --2- 172.21.15.146:0/3511343247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51b0068ba0 0x7f51b00b0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:25.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.106+0000 7f51a7fff700 1 --2- 172.21.15.146:0/3511343247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51b0153ab0 0x7f51b016a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:25.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.106+0000 7f51b54dc700 1 -- 172.21.15.146:0/3511343247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51b0068ba0 msgr2=0x7f51b00b0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:25.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.106+0000 7f51b54dc700 1 --2- 172.21.15.146:0/3511343247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51b0068ba0 0x7f51b00b0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:25.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.106+0000 7f51b54dc700 1 -- 172.21.15.146:0/3511343247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51b0153ab0 msgr2=0x7f51b016a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:25.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.106+0000 7f51b54dc700 1 --2- 172.21.15.146:0/3511343247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51b0153ab0 0x7f51b016a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:25.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.106+0000 7f51b54dc700 1 -- 172.21.15.146:0/3511343247 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ac009420 con 0x7f51b0153e80 2023-10-06T11:15:25.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.106+0000 7f51b54dc700 1 --2- 172.21.15.146:0/3511343247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51b0153e80 0x7f51b01420b0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f51a800cbc0 tx=0x7f51a8007f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:25.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.107+0000 7f51a4ff9700 1 -- 172.21.15.146:0/3511343247 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a8004dc0 con 0x7f51b0153e80 2023-10-06T11:15:25.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.107+0000 7f51a4ff9700 1 -- 172.21.15.146:0/3511343247 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51a800a590 con 0x7f51b0153e80 2023-10-06T11:15:25.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.107+0000 7f51b6f3f700 1 -- 172.21.15.146:0/3511343247 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51b00b1440 con 0x7f51b0153e80 2023-10-06T11:15:25.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.107+0000 7f51a4ff9700 1 -- 172.21.15.146:0/3511343247 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a800a950 con 0x7f51b0153e80 2023-10-06T11:15:25.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.107+0000 7f51b6f3f700 1 -- 172.21.15.146:0/3511343247 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51b00b1a00 con 0x7f51b0153e80 2023-10-06T11:15:25.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.107+0000 7f51b6f3f700 1 -- 172.21.15.146:0/3511343247 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51b006f6c0 con 0x7f51b0153e80 2023-10-06T11:15:25.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.108+0000 7f51a4ff9700 1 -- 172.21.15.146:0/3511343247 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f51a800ad40 con 0x7f51b0153e80 2023-10-06T11:15:25.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.108+0000 7f51a4ff9700 1 --2- 172.21.15.146:0/3511343247 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f519c066f30 0x7f519c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:25.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.108+0000 7f51a4ff9700 1 -- 172.21.15.146:0/3511343247 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f51a8083e60 con 0x7f51b0153e80 2023-10-06T11:15:25.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.108+0000 7f51b4cdb700 1 --2- 172.21.15.146:0/3511343247 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f519c066f30 0x7f519c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:25.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.109+0000 7f51b4cdb700 1 --2- 172.21.15.146:0/3511343247 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f519c066f30 0x7f519c0693e0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f51ac0091e0 tx=0x7f51ac017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:25.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.113+0000 7f51a4ff9700 1 -- 172.21.15.146:0/3511343247 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f51a8050f70 con 0x7f51b0153e80 2023-10-06T11:15:25.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.339+0000 7f51b6f3f700 1 -- 172.21.15.146:0/3511343247 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51b015ac30 con 0x7f51b0153e80 2023-10-06T11:15:25.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.339+0000 7f51a4ff9700 1 -- 172.21.15.146:0/3511343247 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) v1 ==== 95+0+4617 (secure 0 0 0) 0x7f51b015ac30 con 0x7f51b0153e80 2023-10-06T11:15:25.342 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:15:25.342 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":108,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7792,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3693464886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3693464886},{"type":"v1","addr":"172.21.15.151:6834","nonce":3693464886}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103},{"gid":7795,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1155762565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":1155762565},{"type":"v1","addr":"172.21.15.151:6835","nonce":1155762565}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103},{"gid":8679,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/3868720724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3868720724},{"type":"v1","addr":"172.21.15.146:6836","nonce":3868720724}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:15:11.929158+0000","modified":"2023-10-06T11:15:15.569866+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8682},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8682":{"gid":8682,"name":"c","rank":0,"incarnation":104,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/1974709597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":1974709597},{"type":"v1","addr":"172.21.15.146:6837","nonce":1974709597}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-06T11:15:25.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.342+0000 7f51b6f3f700 1 -- 172.21.15.146:0/3511343247 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f519c066f30 msgr2=0x7f519c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:25.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.342+0000 7f51b6f3f700 1 --2- 172.21.15.146:0/3511343247 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f519c066f30 0x7f519c0693e0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f51ac0091e0 tx=0x7f51ac017000 comp rx=0 tx=0).stop 2023-10-06T11:15:25.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.342+0000 7f51b6f3f700 1 -- 172.21.15.146:0/3511343247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51b0153e80 msgr2=0x7f51b01420b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:25.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.342+0000 7f51b6f3f700 1 --2- 172.21.15.146:0/3511343247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51b0153e80 0x7f51b01420b0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f51a800cbc0 tx=0x7f51a8007f10 comp rx=0 tx=0).stop 2023-10-06T11:15:25.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.342+0000 7f51b6f3f700 1 -- 172.21.15.146:0/3511343247 shutdown_connections 2023-10-06T11:15:25.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.342+0000 7f51b6f3f700 1 --2- 172.21.15.146:0/3511343247 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f519c066f30 0x7f519c0693e0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:25.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.342+0000 7f51b6f3f700 1 --2- 172.21.15.146:0/3511343247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f51b0153e80 0x7f51b01420b0 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:25.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.342+0000 7f51b6f3f700 1 --2- 172.21.15.146:0/3511343247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51b0068ba0 0x7f51b00b0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:25.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.342+0000 7f51b6f3f700 1 --2- 172.21.15.146:0/3511343247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51b0153ab0 0x7f51b016a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:25.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.342+0000 7f51b6f3f700 1 -- 172.21.15.146:0/3511343247 >> 172.21.15.146:0/3511343247 conn(0x7f51b006eba0 msgr2=0x7f51b0153230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:25.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.342+0000 7f51b6f3f700 1 -- 172.21.15.146:0/3511343247 shutdown_connections 2023-10-06T11:15:25.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:25.342+0000 7f51b6f3f700 1 -- 172.21.15.146:0/3511343247 wait complete. 2023-10-06T11:15:25.345 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 108 2023-10-06T11:15:25.356 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:15:25.357 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:15:25.357 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:15:25.357 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.0 2023-10-06T11:15:25.357 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:15:25.357 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.0/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:15:25.357 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:15:25.357 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:15:25.417 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:25.417 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:25.417 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0137514 s, 76.3 MB/s 2023-10-06T11:15:25.430 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:25.430 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:25.431 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111799 s, 93.8 MB/s 2023-10-06T11:15:25.444 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:25.444 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:25.444 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111341 s, 94.2 MB/s 2023-10-06T11:15:25.456 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:25.456 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:25.456 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00994247 s, 105 MB/s 2023-10-06T11:15:25.467 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:25.467 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:25.467 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00910224 s, 115 MB/s 2023-10-06T11:15:25.480 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:25.480 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:25.480 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110093 s, 95.2 MB/s 2023-10-06T11:15:25.492 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:25.492 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:25.492 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00968758 s, 108 MB/s 2023-10-06T11:15:25.504 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:25.505 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:25.505 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101535 s, 103 MB/s 2023-10-06T11:15:25.517 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:25.517 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:25.517 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103774 s, 101 MB/s 2023-10-06T11:15:25.530 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:25.530 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:25.530 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107371 s, 97.7 MB/s 2023-10-06T11:15:25.542 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:25.542 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:25.542 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100907 s, 104 MB/s 2023-10-06T11:15:25.555 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:25.555 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:25.555 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105428 s, 99.5 MB/s 2023-10-06T11:15:25.567 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:25.567 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:25.567 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954678 s, 110 MB/s 2023-10-06T11:15:25.580 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:25.581 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:25.581 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117054 s, 89.6 MB/s 2023-10-06T11:15:25.591 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:25.591 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:25.592 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00864943 s, 121 MB/s 2023-10-06T11:15:25.605 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:25.605 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:25.605 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112528 s, 93.2 MB/s 2023-10-06T11:15:25.618 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:25.618 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:25.619 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107173 s, 97.8 MB/s 2023-10-06T11:15:25.632 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:25.632 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:25.632 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113539 s, 92.4 MB/s 2023-10-06T11:15:25.644 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:25.645 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:25.645 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010537 s, 99.5 MB/s 2023-10-06T11:15:25.656 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:25.657 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:25.657 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101844 s, 103 MB/s 2023-10-06T11:15:25.669 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:25.669 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:25.669 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00994901 s, 105 MB/s 2023-10-06T11:15:25.680 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:25.680 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:25.680 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00899147 s, 117 MB/s 2023-10-06T11:15:25.692 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:25.693 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:25.693 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101295 s, 104 MB/s 2023-10-06T11:15:25.706 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:25.706 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:25.706 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111352 s, 94.2 MB/s 2023-10-06T11:15:25.717 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:25.717 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:25.717 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0087522 s, 120 MB/s 2023-10-06T11:15:25.729 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:25.729 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:25.729 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101481 s, 103 MB/s 2023-10-06T11:15:25.741 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:25.741 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:25.742 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102207 s, 103 MB/s 2023-10-06T11:15:25.752 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:25.752 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:25.752 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00885295 s, 118 MB/s 2023-10-06T11:15:25.765 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:25.765 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:25.765 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104417 s, 100 MB/s 2023-10-06T11:15:25.777 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:25.778 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:25.778 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102798 s, 102 MB/s 2023-10-06T11:15:25.790 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:25.791 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:25.791 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109191 s, 96.0 MB/s 2023-10-06T11:15:25.801 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:25.802 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:25.802 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00889853 s, 118 MB/s 2023-10-06T11:15:25.803 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:15:25.803 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:15:25.803 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:15:25.803 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.1 2023-10-06T11:15:25.803 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:15:25.803 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.1/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:15:25.803 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:15:25.803 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:15:25.846 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:25.846 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:25.846 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100539 s, 104 MB/s 2023-10-06T11:15:25.858 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:25.859 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:25.859 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104731 s, 100 MB/s 2023-10-06T11:15:25.872 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:25.872 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:25.872 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111422 s, 94.1 MB/s 2023-10-06T11:15:25.884 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:25.884 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:25.884 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103156 s, 102 MB/s 2023-10-06T11:15:25.896 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:25.896 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:25.896 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00997659 s, 105 MB/s 2023-10-06T11:15:25.908 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:25.908 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:25.908 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00981725 s, 107 MB/s 2023-10-06T11:15:25.920 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:25.920 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:25.920 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00929284 s, 113 MB/s 2023-10-06T11:15:25.932 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:25.932 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:25.932 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00993444 s, 106 MB/s 2023-10-06T11:15:25.944 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:25.945 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:25.945 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103367 s, 101 MB/s 2023-10-06T11:15:25.956 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:25.956 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:25.956 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00900003 s, 117 MB/s 2023-10-06T11:15:25.966 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:25.966 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:25.967 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00870308 s, 120 MB/s 2023-10-06T11:15:25.979 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:25.979 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:25.980 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104002 s, 101 MB/s 2023-10-06T11:15:25.991 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:25.991 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:25.992 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102224 s, 103 MB/s 2023-10-06T11:15:26.004 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.004 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.004 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105851 s, 99.1 MB/s 2023-10-06T11:15:26.016 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.016 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.016 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00990657 s, 106 MB/s 2023-10-06T11:15:26.029 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.029 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.029 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106448 s, 98.5 MB/s 2023-10-06T11:15:26.040 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.041 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.041 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00905238 s, 116 MB/s 2023-10-06T11:15:26.053 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.053 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.053 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100461 s, 104 MB/s 2023-10-06T11:15:26.065 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.066 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.066 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105733 s, 99.2 MB/s 2023-10-06T11:15:26.077 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.078 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.078 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00998375 s, 105 MB/s 2023-10-06T11:15:26.089 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.090 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.090 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00998951 s, 105 MB/s 2023-10-06T11:15:26.102 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.102 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.102 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100142 s, 105 MB/s 2023-10-06T11:15:26.115 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.115 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.116 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110661 s, 94.8 MB/s 2023-10-06T11:15:26.128 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.128 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.128 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010772 s, 97.3 MB/s 2023-10-06T11:15:26.140 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.140 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.140 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100904 s, 104 MB/s 2023-10-06T11:15:26.153 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.153 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.153 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104636 s, 100 MB/s 2023-10-06T11:15:26.165 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.165 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.165 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00997255 s, 105 MB/s 2023-10-06T11:15:26.176 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.177 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.177 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0089906 s, 117 MB/s 2023-10-06T11:15:26.189 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.189 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.189 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102167 s, 103 MB/s 2023-10-06T11:15:26.201 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.201 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.201 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00974523 s, 108 MB/s 2023-10-06T11:15:26.213 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.213 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.214 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103306 s, 102 MB/s 2023-10-06T11:15:26.225 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.225 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.226 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.009703 s, 108 MB/s 2023-10-06T11:15:26.227 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:15:26.227 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:15:26.227 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:15:26.227 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.2 2023-10-06T11:15:26.227 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:15:26.227 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.2/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:15:26.227 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:15:26.227 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:15:26.310 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.311 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.311 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107864 s, 97.2 MB/s 2023-10-06T11:15:26.323 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.324 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.324 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104769 s, 100 MB/s 2023-10-06T11:15:26.337 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.337 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.337 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0112443 s, 93.3 MB/s 2023-10-06T11:15:26.349 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.350 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.350 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010575 s, 99.2 MB/s 2023-10-06T11:15:26.362 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.362 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.362 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104016 s, 101 MB/s 2023-10-06T11:15:26.374 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.375 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.375 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102467 s, 102 MB/s 2023-10-06T11:15:26.387 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.387 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.387 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00994766 s, 105 MB/s 2023-10-06T11:15:26.400 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.400 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.400 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010787 s, 97.2 MB/s 2023-10-06T11:15:26.412 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.412 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.412 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104108 s, 101 MB/s 2023-10-06T11:15:26.425 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.426 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.426 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106762 s, 98.2 MB/s 2023-10-06T11:15:26.438 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.439 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.439 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105794 s, 99.1 MB/s 2023-10-06T11:15:26.452 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.452 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.452 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108781 s, 96.4 MB/s 2023-10-06T11:15:26.462 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.463 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.463 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00883393 s, 119 MB/s 2023-10-06T11:15:26.475 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.475 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.476 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101584 s, 103 MB/s 2023-10-06T11:15:26.489 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.489 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.489 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0113966 s, 92.0 MB/s 2023-10-06T11:15:26.501 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.501 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.502 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100848 s, 104 MB/s 2023-10-06T11:15:26.514 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.514 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.514 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102281 s, 103 MB/s 2023-10-06T11:15:26.526 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.526 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.526 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0097399 s, 108 MB/s 2023-10-06T11:15:26.538 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.538 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.538 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101695 s, 103 MB/s 2023-10-06T11:15:26.550 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.550 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.550 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00972601 s, 108 MB/s 2023-10-06T11:15:26.562 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.562 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.563 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00987917 s, 106 MB/s 2023-10-06T11:15:26.575 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.575 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.575 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105122 s, 99.7 MB/s 2023-10-06T11:15:26.586 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.587 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.587 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00963225 s, 109 MB/s 2023-10-06T11:15:26.599 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.599 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.599 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101209 s, 104 MB/s 2023-10-06T11:15:26.612 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.612 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.612 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109928 s, 95.4 MB/s 2023-10-06T11:15:26.625 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.625 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.625 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103328 s, 101 MB/s 2023-10-06T11:15:26.637 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.637 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.637 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00948686 s, 111 MB/s 2023-10-06T11:15:26.648 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.648 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.648 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00886219 s, 118 MB/s 2023-10-06T11:15:26.659 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.659 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.659 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00870269 s, 120 MB/s 2023-10-06T11:15:26.671 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.671 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.671 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00997503 s, 105 MB/s 2023-10-06T11:15:26.684 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.684 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.684 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106654 s, 98.3 MB/s 2023-10-06T11:15:26.696 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.696 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.696 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00979744 s, 107 MB/s 2023-10-06T11:15:26.697 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:15:26.697 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:15:26.697 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:15:26.697 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.3 2023-10-06T11:15:26.698 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:15:26.698 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.3/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:15:26.698 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:15:26.698 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:15:26.780 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.780 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.781 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101352 s, 103 MB/s 2023-10-06T11:15:26.793 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.793 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.793 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107867 s, 97.2 MB/s 2023-10-06T11:15:26.805 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.805 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.805 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00989633 s, 106 MB/s 2023-10-06T11:15:26.816 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.816 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.816 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00875274 s, 120 MB/s 2023-10-06T11:15:26.830 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.830 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.830 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010166 s, 103 MB/s 2023-10-06T11:15:26.842 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.842 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.842 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102979 s, 102 MB/s 2023-10-06T11:15:26.852 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.853 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.853 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00899207 s, 117 MB/s 2023-10-06T11:15:26.864 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.864 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.864 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00895662 s, 117 MB/s 2023-10-06T11:15:26.876 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.876 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.876 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954682 s, 110 MB/s 2023-10-06T11:15:26.890 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.890 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.890 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00965567 s, 109 MB/s 2023-10-06T11:15:26.898 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.899 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.899 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00877449 s, 120 MB/s 2023-10-06T11:15:26.910 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.910 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.910 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00951462 s, 110 MB/s 2023-10-06T11:15:26.922 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.922 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.922 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00965223 s, 109 MB/s 2023-10-06T11:15:26.934 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.934 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.935 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00978753 s, 107 MB/s 2023-10-06T11:15:26.946 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.946 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.946 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00991584 s, 106 MB/s 2023-10-06T11:15:26.959 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.959 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.959 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103206 s, 102 MB/s 2023-10-06T11:15:26.970 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.970 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.970 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00877307 s, 120 MB/s 2023-10-06T11:15:26.982 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.982 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.982 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101947 s, 103 MB/s 2023-10-06T11:15:26.994 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:26.994 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:26.994 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00970204 s, 108 MB/s 2023-10-06T11:15:27.005 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.006 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.006 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00938523 s, 112 MB/s 2023-10-06T11:15:27.017 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.017 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.017 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0096065 s, 109 MB/s 2023-10-06T11:15:27.029 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.030 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.030 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010124 s, 104 MB/s 2023-10-06T11:15:27.042 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.042 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.042 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00983156 s, 107 MB/s 2023-10-06T11:15:27.052 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.052 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.052 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00873655 s, 120 MB/s 2023-10-06T11:15:27.065 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.065 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.065 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103125 s, 102 MB/s 2023-10-06T11:15:27.077 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.077 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.077 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102933 s, 102 MB/s 2023-10-06T11:15:27.090 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.090 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.090 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110786 s, 94.6 MB/s 2023-10-06T11:15:27.102 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.102 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.103 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00979895 s, 107 MB/s 2023-10-06T11:15:27.115 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.115 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.115 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107828 s, 97.2 MB/s 2023-10-06T11:15:27.127 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.127 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.127 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.009762 s, 107 MB/s 2023-10-06T11:15:27.139 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.139 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.139 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00985091 s, 106 MB/s 2023-10-06T11:15:27.151 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.151 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.152 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00987705 s, 106 MB/s 2023-10-06T11:15:27.153 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:15:27.153 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:15:27.153 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:15:27.153 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.4 2023-10-06T11:15:27.154 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:15:27.154 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.4/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:15:27.154 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:15:27.154 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:15:27.237 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.237 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.237 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105734 s, 99.2 MB/s 2023-10-06T11:15:27.250 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.251 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.251 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00966104 s, 109 MB/s 2023-10-06T11:15:27.262 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.262 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.262 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103567 s, 101 MB/s 2023-10-06T11:15:27.274 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.274 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.274 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109553 s, 95.7 MB/s 2023-10-06T11:15:27.285 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.285 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.285 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00863623 s, 121 MB/s 2023-10-06T11:15:27.297 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.297 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.297 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00994215 s, 105 MB/s 2023-10-06T11:15:27.309 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.310 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.310 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00987407 s, 106 MB/s 2023-10-06T11:15:27.321 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.321 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.322 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0096337 s, 109 MB/s 2023-10-06T11:15:27.332 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.333 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.333 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00895791 s, 117 MB/s 2023-10-06T11:15:27.343 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.344 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.344 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00887298 s, 118 MB/s 2023-10-06T11:15:27.357 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.357 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.357 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111559 s, 94.0 MB/s 2023-10-06T11:15:27.369 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.370 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.370 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104712 s, 100 MB/s 2023-10-06T11:15:27.382 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.383 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.383 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010642 s, 98.5 MB/s 2023-10-06T11:15:27.394 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.395 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.395 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00992693 s, 106 MB/s 2023-10-06T11:15:27.406 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.406 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.406 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0092145 s, 114 MB/s 2023-10-06T11:15:27.417 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.417 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.417 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00882937 s, 119 MB/s 2023-10-06T11:15:27.429 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.430 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.430 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010362 s, 101 MB/s 2023-10-06T11:15:27.441 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.441 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.442 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00981934 s, 107 MB/s 2023-10-06T11:15:27.454 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.454 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.455 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104996 s, 99.9 MB/s 2023-10-06T11:15:27.466 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.466 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.466 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100293 s, 105 MB/s 2023-10-06T11:15:27.479 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.479 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.479 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103129 s, 102 MB/s 2023-10-06T11:15:27.491 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.492 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.492 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106727 s, 98.2 MB/s 2023-10-06T11:15:27.504 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.504 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.504 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100712 s, 104 MB/s 2023-10-06T11:15:27.517 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.517 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.517 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104601 s, 100 MB/s 2023-10-06T11:15:27.528 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.529 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.529 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00983369 s, 107 MB/s 2023-10-06T11:15:27.540 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.540 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.540 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00922997 s, 114 MB/s 2023-10-06T11:15:27.553 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.553 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.553 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103369 s, 101 MB/s 2023-10-06T11:15:27.565 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.565 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.566 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00996637 s, 105 MB/s 2023-10-06T11:15:27.578 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.578 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.579 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107028 s, 98.0 MB/s 2023-10-06T11:15:27.591 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.592 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.592 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105309 s, 99.6 MB/s 2023-10-06T11:15:27.605 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.605 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.605 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106591 s, 98.4 MB/s 2023-10-06T11:15:27.618 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.618 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.618 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107024 s, 98.0 MB/s 2023-10-06T11:15:27.619 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:15:27.619 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:15:27.620 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:15:27.620 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.5 2023-10-06T11:15:27.620 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:15:27.620 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.5/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:15:27.620 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:15:27.620 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:15:27.704 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.704 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.704 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109832 s, 95.5 MB/s 2023-10-06T11:15:27.716 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.716 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.716 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00986107 s, 106 MB/s 2023-10-06T11:15:27.729 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.730 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.730 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106249 s, 98.7 MB/s 2023-10-06T11:15:27.743 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.743 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.743 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105233 s, 99.6 MB/s 2023-10-06T11:15:27.755 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.755 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.755 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00948557 s, 111 MB/s 2023-10-06T11:15:27.767 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.767 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.768 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100155 s, 105 MB/s 2023-10-06T11:15:27.779 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.779 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.779 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00918301 s, 114 MB/s 2023-10-06T11:15:27.791 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.791 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.791 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00911862 s, 115 MB/s 2023-10-06T11:15:27.804 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.804 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.804 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106158 s, 98.8 MB/s 2023-10-06T11:15:27.817 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.817 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.817 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107288 s, 97.7 MB/s 2023-10-06T11:15:27.828 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.829 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.829 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00893197 s, 117 MB/s 2023-10-06T11:15:27.841 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.841 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.841 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00984211 s, 107 MB/s 2023-10-06T11:15:27.853 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.853 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.854 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00985617 s, 106 MB/s 2023-10-06T11:15:27.866 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.866 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.866 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00973432 s, 108 MB/s 2023-10-06T11:15:27.878 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.878 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.878 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0095411 s, 110 MB/s 2023-10-06T11:15:27.890 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.890 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.890 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00963493 s, 109 MB/s 2023-10-06T11:15:27.902 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.903 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.903 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00981725 s, 107 MB/s 2023-10-06T11:15:27.914 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.915 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.915 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00966858 s, 108 MB/s 2023-10-06T11:15:27.926 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.926 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.926 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00878082 s, 119 MB/s 2023-10-06T11:15:27.939 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.939 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.939 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100596 s, 104 MB/s 2023-10-06T11:15:27.951 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.951 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.951 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00983229 s, 107 MB/s 2023-10-06T11:15:27.964 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.964 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.964 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100733 s, 104 MB/s 2023-10-06T11:15:27.976 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.977 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.977 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01059 s, 99.0 MB/s 2023-10-06T11:15:27.989 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:27.989 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:27.989 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100953 s, 104 MB/s 2023-10-06T11:15:28.002 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.003 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.003 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108174 s, 96.9 MB/s 2023-10-06T11:15:28.014 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.014 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.014 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00885119 s, 118 MB/s 2023-10-06T11:15:28.026 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.026 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.026 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.009497 s, 110 MB/s 2023-10-06T11:15:28.039 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.039 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.039 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00974831 s, 108 MB/s 2023-10-06T11:15:28.050 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.050 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.050 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0088803 s, 118 MB/s 2023-10-06T11:15:28.062 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.062 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.062 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00947376 s, 111 MB/s 2023-10-06T11:15:28.075 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.075 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.076 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106925 s, 98.1 MB/s 2023-10-06T11:15:28.087 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.087 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.087 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00923466 s, 114 MB/s 2023-10-06T11:15:28.088 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:15:28.088 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:15:28.089 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:15:28.089 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.6 2023-10-06T11:15:28.089 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:15:28.089 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.6/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:15:28.089 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:15:28.089 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:15:28.132 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.132 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.132 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102357 s, 102 MB/s 2023-10-06T11:15:28.144 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.144 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.144 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00989327 s, 106 MB/s 2023-10-06T11:15:28.156 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.156 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.157 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00900778 s, 116 MB/s 2023-10-06T11:15:28.169 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.169 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.169 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01011 s, 104 MB/s 2023-10-06T11:15:28.181 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.181 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.181 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00947216 s, 111 MB/s 2023-10-06T11:15:28.193 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.193 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.193 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00989923 s, 106 MB/s 2023-10-06T11:15:28.206 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.206 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.206 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00991594 s, 106 MB/s 2023-10-06T11:15:28.218 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.218 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.218 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00964374 s, 109 MB/s 2023-10-06T11:15:28.229 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.229 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.229 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00889183 s, 118 MB/s 2023-10-06T11:15:28.241 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.241 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.241 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00886418 s, 118 MB/s 2023-10-06T11:15:28.253 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.253 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.253 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00996767 s, 105 MB/s 2023-10-06T11:15:28.265 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.265 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.266 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0094645 s, 111 MB/s 2023-10-06T11:15:28.278 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.279 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.279 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106361 s, 98.6 MB/s 2023-10-06T11:15:28.292 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.292 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.292 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105684 s, 99.2 MB/s 2023-10-06T11:15:28.303 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.303 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.303 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00857063 s, 122 MB/s 2023-10-06T11:15:28.315 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.315 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.315 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00965237 s, 109 MB/s 2023-10-06T11:15:28.327 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.327 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.327 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00937546 s, 112 MB/s 2023-10-06T11:15:28.338 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.338 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.338 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00860472 s, 122 MB/s 2023-10-06T11:15:28.350 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.350 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.350 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00918077 s, 114 MB/s 2023-10-06T11:15:28.362 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.362 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.362 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00948916 s, 111 MB/s 2023-10-06T11:15:28.374 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.374 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.374 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00947127 s, 111 MB/s 2023-10-06T11:15:28.386 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.386 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.386 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00970703 s, 108 MB/s 2023-10-06T11:15:28.397 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.397 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.397 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00868059 s, 121 MB/s 2023-10-06T11:15:28.409 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.409 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.409 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0092693 s, 113 MB/s 2023-10-06T11:15:28.420 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.420 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.420 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00876355 s, 120 MB/s 2023-10-06T11:15:28.433 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.433 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.434 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103384 s, 101 MB/s 2023-10-06T11:15:28.446 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.446 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.446 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00980169 s, 107 MB/s 2023-10-06T11:15:28.458 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.458 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.458 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00970055 s, 108 MB/s 2023-10-06T11:15:28.469 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.469 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.469 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00847621 s, 124 MB/s 2023-10-06T11:15:28.482 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.482 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.482 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103603 s, 101 MB/s 2023-10-06T11:15:28.494 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.494 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.494 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00989001 s, 106 MB/s 2023-10-06T11:15:28.507 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.507 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.507 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0096731 s, 108 MB/s 2023-10-06T11:15:28.508 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:15:28.508 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:15:28.508 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:15:28.508 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.7 2023-10-06T11:15:28.508 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:15:28.508 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.7/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:15:28.508 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:15:28.508 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:15:28.591 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.591 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.591 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00912363 s, 115 MB/s 2023-10-06T11:15:28.604 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.604 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.604 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101295 s, 104 MB/s 2023-10-06T11:15:28.616 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.616 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.616 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00969483 s, 108 MB/s 2023-10-06T11:15:28.628 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.629 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.629 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00981183 s, 107 MB/s 2023-10-06T11:15:28.641 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.641 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.641 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00949918 s, 110 MB/s 2023-10-06T11:15:28.652 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.652 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.652 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00892321 s, 118 MB/s 2023-10-06T11:15:28.664 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.664 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.664 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00929487 s, 113 MB/s 2023-10-06T11:15:28.677 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.677 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.677 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108434 s, 96.7 MB/s 2023-10-06T11:15:28.689 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.689 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.689 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00940399 s, 112 MB/s 2023-10-06T11:15:28.701 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.701 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.701 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00941472 s, 111 MB/s 2023-10-06T11:15:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.712 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00842853 s, 124 MB/s 2023-10-06T11:15:28.723 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.723 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.723 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00845963 s, 124 MB/s 2023-10-06T11:15:28.735 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.735 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.735 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00952807 s, 110 MB/s 2023-10-06T11:15:28.745 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.745 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.745 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0084565 s, 124 MB/s 2023-10-06T11:15:28.757 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.757 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.757 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00942881 s, 111 MB/s 2023-10-06T11:15:28.768 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.768 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.768 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00912573 s, 115 MB/s 2023-10-06T11:15:28.780 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.780 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.780 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101412 s, 103 MB/s 2023-10-06T11:15:28.792 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.792 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.792 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00961557 s, 109 MB/s 2023-10-06T11:15:28.805 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.805 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.805 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101482 s, 103 MB/s 2023-10-06T11:15:28.816 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.816 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.816 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00928588 s, 113 MB/s 2023-10-06T11:15:28.827 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.827 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.828 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00915231 s, 115 MB/s 2023-10-06T11:15:28.838 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.838 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.839 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00865439 s, 121 MB/s 2023-10-06T11:15:28.850 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.850 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.850 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0093973 s, 112 MB/s 2023-10-06T11:15:28.862 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.862 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.863 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103941 s, 101 MB/s 2023-10-06T11:15:28.875 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.875 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.875 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00992282 s, 106 MB/s 2023-10-06T11:15:28.886 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.886 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.887 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00934798 s, 112 MB/s 2023-10-06T11:15:28.898 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.898 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.898 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00939058 s, 112 MB/s 2023-10-06T11:15:28.910 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.910 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.910 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00942513 s, 111 MB/s 2023-10-06T11:15:28.921 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.922 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.922 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00976645 s, 107 MB/s 2023-10-06T11:15:28.932 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.932 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.932 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00867803 s, 121 MB/s 2023-10-06T11:15:28.944 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.944 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.944 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00966058 s, 109 MB/s 2023-10-06T11:15:28.956 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:28.957 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:28.957 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100757 s, 104 MB/s 2023-10-06T11:15:28.958 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:15:28.958 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:15:28.958 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:15:28.958 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.8 2023-10-06T11:15:28.958 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:15:28.958 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.8/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:15:28.958 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:15:28.958 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:15:29.041 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.042 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.042 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101394 s, 103 MB/s 2023-10-06T11:15:29.053 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.053 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.053 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00955026 s, 110 MB/s 2023-10-06T11:15:29.065 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.065 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.065 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00944255 s, 111 MB/s 2023-10-06T11:15:29.077 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.077 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.077 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00971884 s, 108 MB/s 2023-10-06T11:15:29.089 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.089 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.089 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00937641 s, 112 MB/s 2023-10-06T11:15:29.100 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.100 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.100 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00963773 s, 109 MB/s 2023-10-06T11:15:29.111 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.112 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.112 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00943906 s, 111 MB/s 2023-10-06T11:15:29.122 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.123 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.123 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00854533 s, 123 MB/s 2023-10-06T11:15:29.133 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.133 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.133 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00837775 s, 125 MB/s 2023-10-06T11:15:29.145 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.145 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.145 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00943534 s, 111 MB/s 2023-10-06T11:15:29.156 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.157 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.157 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00951851 s, 110 MB/s 2023-10-06T11:15:29.167 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.168 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.168 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00874463 s, 120 MB/s 2023-10-06T11:15:29.180 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.180 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.180 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101387 s, 103 MB/s 2023-10-06T11:15:29.192 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.193 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.193 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104593 s, 100 MB/s 2023-10-06T11:15:29.205 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.205 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.205 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00990225 s, 106 MB/s 2023-10-06T11:15:29.217 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.217 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.217 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00956053 s, 110 MB/s 2023-10-06T11:15:29.228 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.228 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.228 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00908556 s, 115 MB/s 2023-10-06T11:15:29.239 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.239 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.240 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00916963 s, 114 MB/s 2023-10-06T11:15:29.251 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.252 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.252 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00985231 s, 106 MB/s 2023-10-06T11:15:29.263 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.263 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.263 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00919346 s, 114 MB/s 2023-10-06T11:15:29.274 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.274 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.275 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00951112 s, 110 MB/s 2023-10-06T11:15:29.286 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.286 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.286 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00951782 s, 110 MB/s 2023-10-06T11:15:29.297 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.298 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.298 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00922488 s, 114 MB/s 2023-10-06T11:15:29.309 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.309 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.309 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00937089 s, 112 MB/s 2023-10-06T11:15:29.320 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.320 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.320 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00914784 s, 115 MB/s 2023-10-06T11:15:29.333 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.333 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.333 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101117 s, 104 MB/s 2023-10-06T11:15:29.344 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.344 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.344 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00947332 s, 111 MB/s 2023-10-06T11:15:29.357 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.357 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.357 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00968205 s, 108 MB/s 2023-10-06T11:15:29.367 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.367 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.367 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0087219 s, 120 MB/s 2023-10-06T11:15:29.379 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.380 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.380 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100762 s, 104 MB/s 2023-10-06T11:15:29.391 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.391 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.391 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0092232 s, 114 MB/s 2023-10-06T11:15:29.402 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.402 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.402 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00910564 s, 115 MB/s 2023-10-06T11:15:29.403 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:15:29.404 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:15:29.404 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:15:29.404 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.9 2023-10-06T11:15:29.404 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:15:29.404 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.9/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:15:29.404 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:15:29.404 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:15:29.485 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.486 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.486 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00905263 s, 116 MB/s 2023-10-06T11:15:29.497 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.497 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.498 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0092655 s, 113 MB/s 2023-10-06T11:15:29.508 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.508 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.508 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00877171 s, 120 MB/s 2023-10-06T11:15:29.520 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.520 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.520 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00936488 s, 112 MB/s 2023-10-06T11:15:29.531 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.531 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.531 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00936996 s, 112 MB/s 2023-10-06T11:15:29.543 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.543 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.543 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00931172 s, 113 MB/s 2023-10-06T11:15:29.555 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.555 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.555 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102976 s, 102 MB/s 2023-10-06T11:15:29.567 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.567 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.568 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00986457 s, 106 MB/s 2023-10-06T11:15:29.578 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.579 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.579 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00908584 s, 115 MB/s 2023-10-06T11:15:29.590 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.590 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.590 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00962596 s, 109 MB/s 2023-10-06T11:15:29.602 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.602 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.603 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100635 s, 104 MB/s 2023-10-06T11:15:29.615 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.615 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.615 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103105 s, 102 MB/s 2023-10-06T11:15:29.627 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.627 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.628 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954428 s, 110 MB/s 2023-10-06T11:15:29.639 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.639 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.639 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00888314 s, 118 MB/s 2023-10-06T11:15:29.650 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.650 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.650 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00841455 s, 125 MB/s 2023-10-06T11:15:29.663 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.663 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.663 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102434 s, 102 MB/s 2023-10-06T11:15:29.675 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.675 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.675 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00947832 s, 111 MB/s 2023-10-06T11:15:29.686 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.687 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.687 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00933585 s, 112 MB/s 2023-10-06T11:15:29.699 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.699 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.699 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00988265 s, 106 MB/s 2023-10-06T11:15:29.712 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.712 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.712 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103016 s, 102 MB/s 2023-10-06T11:15:29.724 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.724 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.724 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00984737 s, 106 MB/s 2023-10-06T11:15:29.736 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.736 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.736 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.009266 s, 113 MB/s 2023-10-06T11:15:29.748 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.748 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.748 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00971951 s, 108 MB/s 2023-10-06T11:15:29.760 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.760 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.760 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00932741 s, 112 MB/s 2023-10-06T11:15:29.772 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.772 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.772 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00951652 s, 110 MB/s 2023-10-06T11:15:29.784 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.784 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.784 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00936559 s, 112 MB/s 2023-10-06T11:15:29.795 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.796 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.796 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00911534 s, 115 MB/s 2023-10-06T11:15:29.807 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.807 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.807 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00941048 s, 111 MB/s 2023-10-06T11:15:29.819 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.819 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.819 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00930386 s, 113 MB/s 2023-10-06T11:15:29.831 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.831 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.831 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00955129 s, 110 MB/s 2023-10-06T11:15:29.842 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.842 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.842 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00938115 s, 112 MB/s 2023-10-06T11:15:29.854 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.854 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.854 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00914473 s, 115 MB/s 2023-10-06T11:15:29.855 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:15:29.855 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:15:29.855 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:15:29.855 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.10 2023-10-06T11:15:29.855 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:15:29.856 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.10/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:15:29.856 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:15:29.856 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:15:29.938 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.939 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.939 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103555 s, 101 MB/s 2023-10-06T11:15:29.950 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.950 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.950 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00942004 s, 111 MB/s 2023-10-06T11:15:29.962 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.962 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.962 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00936288 s, 112 MB/s 2023-10-06T11:15:29.973 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.974 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.974 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00945604 s, 111 MB/s 2023-10-06T11:15:29.985 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.985 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.986 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00947281 s, 111 MB/s 2023-10-06T11:15:29.996 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:29.996 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:29.996 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00869875 s, 121 MB/s 2023-10-06T11:15:30.007 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.007 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.007 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00873173 s, 120 MB/s 2023-10-06T11:15:30.019 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.019 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.019 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00932869 s, 112 MB/s 2023-10-06T11:15:30.029 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.029 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.030 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00848546 s, 124 MB/s 2023-10-06T11:15:30.041 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.042 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.042 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0094295 s, 111 MB/s 2023-10-06T11:15:30.053 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.053 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.053 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00963423 s, 109 MB/s 2023-10-06T11:15:30.066 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.066 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.066 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105241 s, 99.6 MB/s 2023-10-06T11:15:30.077 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.078 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.078 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00957681 s, 109 MB/s 2023-10-06T11:15:30.090 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.090 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.090 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101564 s, 103 MB/s 2023-10-06T11:15:30.102 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.102 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.103 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101981 s, 103 MB/s 2023-10-06T11:15:30.113 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.113 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.114 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00861666 s, 122 MB/s 2023-10-06T11:15:30.125 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.125 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.125 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00914539 s, 115 MB/s 2023-10-06T11:15:30.136 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.136 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.136 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00924658 s, 113 MB/s 2023-10-06T11:15:30.147 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.147 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.148 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00912278 s, 115 MB/s 2023-10-06T11:15:30.159 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.159 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.159 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00934602 s, 112 MB/s 2023-10-06T11:15:30.170 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.171 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.171 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00929626 s, 113 MB/s 2023-10-06T11:15:30.182 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.182 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.183 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00959587 s, 109 MB/s 2023-10-06T11:15:30.193 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.194 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.194 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00926038 s, 113 MB/s 2023-10-06T11:15:30.205 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.207 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.207 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00923702 s, 114 MB/s 2023-10-06T11:15:30.216 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.216 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.216 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00911877 s, 115 MB/s 2023-10-06T11:15:30.228 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.228 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.228 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00949129 s, 110 MB/s 2023-10-06T11:15:30.239 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.239 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.240 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00923882 s, 113 MB/s 2023-10-06T11:15:30.252 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.252 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.252 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103758 s, 101 MB/s 2023-10-06T11:15:30.264 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.265 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.265 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00967376 s, 108 MB/s 2023-10-06T11:15:30.275 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.276 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.276 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00960345 s, 109 MB/s 2023-10-06T11:15:30.288 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.288 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.288 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010024 s, 105 MB/s 2023-10-06T11:15:30.299 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.299 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.299 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00873439 s, 120 MB/s 2023-10-06T11:15:30.300 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:15:30.301 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:15:30.301 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:15:30.301 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.11 2023-10-06T11:15:30.301 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:15:30.301 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.11/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:15:30.301 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:15:30.301 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:15:30.383 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.383 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.383 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00946083 s, 111 MB/s 2023-10-06T11:15:30.395 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.395 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.395 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102632 s, 102 MB/s 2023-10-06T11:15:30.407 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.407 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.408 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00976778 s, 107 MB/s 2023-10-06T11:15:30.418 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.418 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.419 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00895066 s, 117 MB/s 2023-10-06T11:15:30.430 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.430 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.430 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00929529 s, 113 MB/s 2023-10-06T11:15:30.442 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.442 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.442 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00960408 s, 109 MB/s 2023-10-06T11:15:30.453 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.453 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.454 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00922207 s, 114 MB/s 2023-10-06T11:15:30.465 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.465 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.465 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00906898 s, 116 MB/s 2023-10-06T11:15:30.475 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.475 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.476 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00851684 s, 123 MB/s 2023-10-06T11:15:30.487 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.487 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.487 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00920534 s, 114 MB/s 2023-10-06T11:15:30.498 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.498 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.498 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00863771 s, 121 MB/s 2023-10-06T11:15:30.513 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.513 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.513 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00903815 s, 116 MB/s 2023-10-06T11:15:30.522 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.522 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.522 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104542 s, 100 MB/s 2023-10-06T11:15:30.533 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.533 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.534 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00946553 s, 111 MB/s 2023-10-06T11:15:30.544 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.544 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.545 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00904396 s, 116 MB/s 2023-10-06T11:15:30.555 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.555 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.555 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00866944 s, 121 MB/s 2023-10-06T11:15:30.568 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.568 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.568 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102945 s, 102 MB/s 2023-10-06T11:15:30.580 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.580 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.580 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102329 s, 102 MB/s 2023-10-06T11:15:30.592 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.592 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.592 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.009519 s, 110 MB/s 2023-10-06T11:15:30.603 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.604 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.604 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00935799 s, 112 MB/s 2023-10-06T11:15:30.616 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.616 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.616 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100893 s, 104 MB/s 2023-10-06T11:15:30.628 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.628 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.628 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.009618 s, 109 MB/s 2023-10-06T11:15:30.639 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.639 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.639 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00931423 s, 113 MB/s 2023-10-06T11:15:30.651 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.651 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.651 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00932681 s, 112 MB/s 2023-10-06T11:15:30.663 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.663 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.663 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00991183 s, 106 MB/s 2023-10-06T11:15:30.675 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.675 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.676 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104581 s, 100 MB/s 2023-10-06T11:15:30.687 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.687 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.687 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00916856 s, 114 MB/s 2023-10-06T11:15:30.698 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.698 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.698 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00921978 s, 114 MB/s 2023-10-06T11:15:30.710 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.710 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.710 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00930961 s, 113 MB/s 2023-10-06T11:15:30.721 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.721 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.721 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00923542 s, 114 MB/s 2023-10-06T11:15:30.733 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.733 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.733 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00942425 s, 111 MB/s 2023-10-06T11:15:30.744 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.744 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.744 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00877932 s, 119 MB/s 2023-10-06T11:15:30.745 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:15:30.745 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:15:30.745 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:15:30.745 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.12 2023-10-06T11:15:30.746 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:15:30.746 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.12/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:15:30.746 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:15:30.746 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:15:30.828 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.828 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.828 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100755 s, 104 MB/s 2023-10-06T11:15:30.839 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.840 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.840 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0090426 s, 116 MB/s 2023-10-06T11:15:30.851 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.851 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.851 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0093093 s, 113 MB/s 2023-10-06T11:15:30.862 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.862 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.862 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00855043 s, 123 MB/s 2023-10-06T11:15:30.873 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.873 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.873 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00941557 s, 111 MB/s 2023-10-06T11:15:30.884 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.885 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.885 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00903296 s, 116 MB/s 2023-10-06T11:15:30.897 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.897 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.897 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101529 s, 103 MB/s 2023-10-06T11:15:30.910 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.910 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.910 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101639 s, 103 MB/s 2023-10-06T11:15:30.922 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.923 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.923 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00928311 s, 113 MB/s 2023-10-06T11:15:30.933 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.933 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.933 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0085464 s, 123 MB/s 2023-10-06T11:15:30.945 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.945 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.946 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00909898 s, 115 MB/s 2023-10-06T11:15:30.955 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.956 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.956 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00905307 s, 116 MB/s 2023-10-06T11:15:30.966 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.966 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.966 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00841519 s, 125 MB/s 2023-10-06T11:15:30.980 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:30.981 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:30.981 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0116747 s, 89.8 MB/s 2023-10-06T11:15:31.005 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.005 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.005 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00906278 s, 116 MB/s 2023-10-06T11:15:31.017 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.017 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.017 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101359 s, 103 MB/s 2023-10-06T11:15:31.030 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.030 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.030 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00940061 s, 112 MB/s 2023-10-06T11:15:31.041 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.041 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.041 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00921187 s, 114 MB/s 2023-10-06T11:15:31.053 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.053 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.053 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101781 s, 103 MB/s 2023-10-06T11:15:31.064 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.064 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.064 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00929146 s, 113 MB/s 2023-10-06T11:15:31.076 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.076 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.076 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00955307 s, 110 MB/s 2023-10-06T11:15:31.087 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.088 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.088 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00949373 s, 110 MB/s 2023-10-06T11:15:31.099 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.099 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.099 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00905454 s, 116 MB/s 2023-10-06T11:15:31.110 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.110 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.110 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00904508 s, 116 MB/s 2023-10-06T11:15:31.121 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.122 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.122 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00952088 s, 110 MB/s 2023-10-06T11:15:31.133 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.133 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.134 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00922343 s, 114 MB/s 2023-10-06T11:15:31.145 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.145 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.145 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100457 s, 104 MB/s 2023-10-06T11:15:31.158 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.158 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.158 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102408 s, 102 MB/s 2023-10-06T11:15:31.170 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.170 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.170 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101841 s, 103 MB/s 2023-10-06T11:15:31.181 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.182 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.182 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00902514 s, 116 MB/s 2023-10-06T11:15:31.193 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.193 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.193 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00907633 s, 116 MB/s 2023-10-06T11:15:31.205 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.205 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.205 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00932134 s, 112 MB/s 2023-10-06T11:15:31.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:15:31.206 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:15:31.206 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:15:31.206 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.13 2023-10-06T11:15:31.206 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:15:31.206 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.13/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:15:31.206 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:15:31.206 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:15:31.288 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.288 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.288 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0092434 s, 113 MB/s 2023-10-06T11:15:31.300 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.300 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.300 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101429 s, 103 MB/s 2023-10-06T11:15:31.312 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.312 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.312 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00943333 s, 111 MB/s 2023-10-06T11:15:31.324 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.324 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.324 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00960656 s, 109 MB/s 2023-10-06T11:15:31.336 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.336 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.336 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102241 s, 103 MB/s 2023-10-06T11:15:31.347 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.347 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.347 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00867163 s, 121 MB/s 2023-10-06T11:15:31.359 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.359 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.360 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101111 s, 104 MB/s 2023-10-06T11:15:31.370 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.370 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.371 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00868316 s, 121 MB/s 2023-10-06T11:15:31.383 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.383 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.383 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101042 s, 104 MB/s 2023-10-06T11:15:31.395 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.395 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.395 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100337 s, 105 MB/s 2023-10-06T11:15:31.406 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.406 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.406 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00882427 s, 119 MB/s 2023-10-06T11:15:31.418 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.418 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.418 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00956605 s, 110 MB/s 2023-10-06T11:15:31.431 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.431 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.431 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106876 s, 98.1 MB/s 2023-10-06T11:15:31.443 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.443 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.443 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00977511 s, 107 MB/s 2023-10-06T11:15:31.456 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.456 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.456 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107433 s, 97.6 MB/s 2023-10-06T11:15:31.469 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.470 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.470 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109869 s, 95.4 MB/s 2023-10-06T11:15:31.481 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.482 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.482 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00962796 s, 109 MB/s 2023-10-06T11:15:31.495 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.495 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.495 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106162 s, 98.8 MB/s 2023-10-06T11:15:31.507 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.507 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.507 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0099628 s, 105 MB/s 2023-10-06T11:15:31.520 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.520 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.520 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100342 s, 105 MB/s 2023-10-06T11:15:31.534 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.534 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.534 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0108761 s, 96.4 MB/s 2023-10-06T11:15:31.547 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.547 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.547 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107038 s, 98.0 MB/s 2023-10-06T11:15:31.558 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.558 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.559 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00909391 s, 115 MB/s 2023-10-06T11:15:31.570 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.570 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.570 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0094455 s, 111 MB/s 2023-10-06T11:15:31.581 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.582 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.582 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00939545 s, 112 MB/s 2023-10-06T11:15:31.593 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.593 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.594 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00950032 s, 110 MB/s 2023-10-06T11:15:31.605 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.605 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.606 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00927176 s, 113 MB/s 2023-10-06T11:15:31.616 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.616 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.616 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0093032 s, 113 MB/s 2023-10-06T11:15:31.628 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.628 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.628 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00942435 s, 111 MB/s 2023-10-06T11:15:31.639 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.639 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.639 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00895819 s, 117 MB/s 2023-10-06T11:15:31.651 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.652 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.652 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100056 s, 105 MB/s 2023-10-06T11:15:31.663 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.663 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.663 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0092337 s, 114 MB/s 2023-10-06T11:15:31.664 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:15:31.664 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:15:31.664 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:15:31.664 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.14 2023-10-06T11:15:31.664 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:15:31.664 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.14/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:15:31.665 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:15:31.665 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:15:31.746 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.747 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.747 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00951476 s, 110 MB/s 2023-10-06T11:15:31.759 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.759 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.759 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102781 s, 102 MB/s 2023-10-06T11:15:31.770 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.770 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.770 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0091933 s, 114 MB/s 2023-10-06T11:15:31.782 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.782 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.782 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00911108 s, 115 MB/s 2023-10-06T11:15:31.794 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.794 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.794 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101836 s, 103 MB/s 2023-10-06T11:15:31.806 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.806 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.806 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00937327 s, 112 MB/s 2023-10-06T11:15:31.817 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.818 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.818 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00967076 s, 108 MB/s 2023-10-06T11:15:31.829 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.829 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.829 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00926468 s, 113 MB/s 2023-10-06T11:15:31.841 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.841 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.841 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00940182 s, 112 MB/s 2023-10-06T11:15:31.853 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.853 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.853 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010265 s, 102 MB/s 2023-10-06T11:15:31.866 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.866 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.866 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010242 s, 102 MB/s 2023-10-06T11:15:31.877 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.877 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.878 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00942101 s, 111 MB/s 2023-10-06T11:15:31.890 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.890 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.890 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100229 s, 105 MB/s 2023-10-06T11:15:31.901 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.902 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.902 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00936127 s, 112 MB/s 2023-10-06T11:15:31.914 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.914 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.914 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102152 s, 103 MB/s 2023-10-06T11:15:31.926 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.926 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.926 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00996694 s, 105 MB/s 2023-10-06T11:15:31.937 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.938 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.938 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00933354 s, 112 MB/s 2023-10-06T11:15:31.949 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.949 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.949 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00890482 s, 118 MB/s 2023-10-06T11:15:31.962 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.962 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.962 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105403 s, 99.5 MB/s 2023-10-06T11:15:31.973 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.973 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.973 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00931601 s, 113 MB/s 2023-10-06T11:15:31.993 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:31.993 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:31.993 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0173814 s, 60.3 MB/s 2023-10-06T11:15:32.019 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.020 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.020 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0095514 s, 110 MB/s 2023-10-06T11:15:32.031 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.031 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.031 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00950187 s, 110 MB/s 2023-10-06T11:15:32.043 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.043 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.043 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00940697 s, 111 MB/s 2023-10-06T11:15:32.054 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.054 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.054 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00922519 s, 114 MB/s 2023-10-06T11:15:32.067 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.067 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.067 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103058 s, 102 MB/s 2023-10-06T11:15:32.078 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.078 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.078 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00936598 s, 112 MB/s 2023-10-06T11:15:32.090 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.090 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.090 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00926637 s, 113 MB/s 2023-10-06T11:15:32.100 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.100 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.101 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00840216 s, 125 MB/s 2023-10-06T11:15:32.113 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.113 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.113 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102124 s, 103 MB/s 2023-10-06T11:15:32.125 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.125 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.126 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100682 s, 104 MB/s 2023-10-06T11:15:32.137 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.137 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.137 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00901855 s, 116 MB/s 2023-10-06T11:15:32.138 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:15:32.138 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:15:32.138 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:15:32.138 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.15 2023-10-06T11:15:32.138 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:15:32.139 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.15/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:15:32.139 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:15:32.139 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:15:32.221 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.221 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.221 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00957269 s, 110 MB/s 2023-10-06T11:15:32.232 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.233 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.233 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00953423 s, 110 MB/s 2023-10-06T11:15:32.244 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.244 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.244 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00911913 s, 115 MB/s 2023-10-06T11:15:32.257 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.257 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.257 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103806 s, 101 MB/s 2023-10-06T11:15:32.268 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.269 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.269 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00962909 s, 109 MB/s 2023-10-06T11:15:32.281 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.281 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.281 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101486 s, 103 MB/s 2023-10-06T11:15:32.291 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.292 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.292 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00845685 s, 124 MB/s 2023-10-06T11:15:32.302 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.303 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.303 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00871905 s, 120 MB/s 2023-10-06T11:15:32.314 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.314 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.314 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00924611 s, 113 MB/s 2023-10-06T11:15:32.325 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.325 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.326 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00930189 s, 113 MB/s 2023-10-06T11:15:32.337 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.337 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.337 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0092125 s, 114 MB/s 2023-10-06T11:15:32.348 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.348 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.348 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00889702 s, 118 MB/s 2023-10-06T11:15:32.359 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.359 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.359 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00862417 s, 122 MB/s 2023-10-06T11:15:32.371 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.371 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.372 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010243 s, 102 MB/s 2023-10-06T11:15:32.382 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.382 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.382 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00847488 s, 124 MB/s 2023-10-06T11:15:32.395 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.395 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.395 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103722 s, 101 MB/s 2023-10-06T11:15:32.406 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.406 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.406 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00864383 s, 121 MB/s 2023-10-06T11:15:32.416 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.417 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.417 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00853681 s, 123 MB/s 2023-10-06T11:15:32.428 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.428 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.428 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0092767 s, 113 MB/s 2023-10-06T11:15:32.440 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.440 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.440 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00943256 s, 111 MB/s 2023-10-06T11:15:32.451 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.451 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.451 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00870596 s, 120 MB/s 2023-10-06T11:15:32.462 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.463 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.463 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00951726 s, 110 MB/s 2023-10-06T11:15:32.474 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.474 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.474 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00936132 s, 112 MB/s 2023-10-06T11:15:32.486 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.486 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.487 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101189 s, 104 MB/s 2023-10-06T11:15:32.498 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.498 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.498 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00952553 s, 110 MB/s 2023-10-06T11:15:32.510 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.510 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.510 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00969396 s, 108 MB/s 2023-10-06T11:15:32.522 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.523 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.523 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102018 s, 103 MB/s 2023-10-06T11:15:32.534 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.534 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.534 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0093312 s, 112 MB/s 2023-10-06T11:15:32.546 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.546 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.546 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00943437 s, 111 MB/s 2023-10-06T11:15:32.557 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.558 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.558 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00951576 s, 110 MB/s 2023-10-06T11:15:32.569 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.569 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.569 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954926 s, 110 MB/s 2023-10-06T11:15:32.581 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.581 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.581 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0099196 s, 106 MB/s 2023-10-06T11:15:32.582 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:15:32.583 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:15:32.583 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:15:32.583 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.16 2023-10-06T11:15:32.583 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:15:32.583 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.16/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:15:32.583 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:15:32.583 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:15:32.665 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.665 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.665 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00970333 s, 108 MB/s 2023-10-06T11:15:32.677 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.677 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.677 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.01013 s, 104 MB/s 2023-10-06T11:15:32.689 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.689 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.689 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00946709 s, 111 MB/s 2023-10-06T11:15:32.700 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.700 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.700 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00867642 s, 121 MB/s 2023-10-06T11:15:32.712 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.712 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.712 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00992683 s, 106 MB/s 2023-10-06T11:15:32.723 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.723 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.723 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00894871 s, 117 MB/s 2023-10-06T11:15:32.734 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.734 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.734 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00853191 s, 123 MB/s 2023-10-06T11:15:32.746 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.746 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.746 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00951961 s, 110 MB/s 2023-10-06T11:15:32.758 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.758 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.758 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00959287 s, 109 MB/s 2023-10-06T11:15:32.769 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.769 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.769 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00908994 s, 115 MB/s 2023-10-06T11:15:32.781 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.781 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.781 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00927429 s, 113 MB/s 2023-10-06T11:15:32.792 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.792 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.792 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00893565 s, 117 MB/s 2023-10-06T11:15:32.803 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.803 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.803 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00848508 s, 124 MB/s 2023-10-06T11:15:32.814 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.814 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.814 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00920863 s, 114 MB/s 2023-10-06T11:15:32.826 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.826 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.826 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00951113 s, 110 MB/s 2023-10-06T11:15:32.837 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.837 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.837 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00914783 s, 115 MB/s 2023-10-06T11:15:32.848 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.848 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.848 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0086496 s, 121 MB/s 2023-10-06T11:15:32.860 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.860 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.860 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00977915 s, 107 MB/s 2023-10-06T11:15:32.873 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.873 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.873 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106664 s, 98.3 MB/s 2023-10-06T11:15:32.885 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.885 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.885 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00942307 s, 111 MB/s 2023-10-06T11:15:32.896 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.897 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.897 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00922468 s, 114 MB/s 2023-10-06T11:15:32.908 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.908 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.908 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00939802 s, 112 MB/s 2023-10-06T11:15:32.921 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.921 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.921 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00917762 s, 114 MB/s 2023-10-06T11:15:32.932 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.932 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.932 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00941528 s, 111 MB/s 2023-10-06T11:15:32.945 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.945 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.945 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101757 s, 103 MB/s 2023-10-06T11:15:32.956 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.957 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.957 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00930035 s, 113 MB/s 2023-10-06T11:15:32.969 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.969 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.970 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102475 s, 102 MB/s 2023-10-06T11:15:32.981 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.981 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.982 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00938139 s, 112 MB/s 2023-10-06T11:15:32.997 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:32.997 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:32.997 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0132853 s, 78.9 MB/s 2023-10-06T11:15:33.028 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.028 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.028 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00927193 s, 113 MB/s 2023-10-06T11:15:33.039 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.039 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.039 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00928652 s, 113 MB/s 2023-10-06T11:15:33.051 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.051 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.051 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00910144 s, 115 MB/s 2023-10-06T11:15:33.052 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:15:33.052 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:15:33.052 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:15:33.052 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.17 2023-10-06T11:15:33.052 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:15:33.052 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.17/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:15:33.052 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:15:33.052 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:15:33.133 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.134 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.134 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00923677 s, 114 MB/s 2023-10-06T11:15:33.145 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.145 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.145 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00937285 s, 112 MB/s 2023-10-06T11:15:33.156 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.156 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.156 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00923949 s, 113 MB/s 2023-10-06T11:15:33.168 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.169 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.169 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100663 s, 104 MB/s 2023-10-06T11:15:33.181 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.181 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.181 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010213 s, 103 MB/s 2023-10-06T11:15:33.194 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.194 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.194 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103935 s, 101 MB/s 2023-10-06T11:15:33.206 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.206 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.206 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00975569 s, 107 MB/s 2023-10-06T11:15:33.217 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.217 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.217 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00871083 s, 120 MB/s 2023-10-06T11:15:33.229 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.229 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.229 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101225 s, 104 MB/s 2023-10-06T11:15:33.241 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.242 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.242 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101434 s, 103 MB/s 2023-10-06T11:15:33.254 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.254 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.254 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101389 s, 103 MB/s 2023-10-06T11:15:33.265 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.265 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.265 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00865736 s, 121 MB/s 2023-10-06T11:15:33.276 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.276 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.276 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00867186 s, 121 MB/s 2023-10-06T11:15:33.288 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.288 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.288 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00960263 s, 109 MB/s 2023-10-06T11:15:33.300 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.300 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.300 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00976687 s, 107 MB/s 2023-10-06T11:15:33.311 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.311 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.311 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00921926 s, 114 MB/s 2023-10-06T11:15:33.323 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.323 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.323 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00942608 s, 111 MB/s 2023-10-06T11:15:33.334 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.334 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.334 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00853929 s, 123 MB/s 2023-10-06T11:15:33.344 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.345 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.345 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0085667 s, 122 MB/s 2023-10-06T11:15:33.356 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.356 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.356 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00925029 s, 113 MB/s 2023-10-06T11:15:33.367 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.367 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.367 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00861853 s, 122 MB/s 2023-10-06T11:15:33.379 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.379 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.379 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0097699 s, 107 MB/s 2023-10-06T11:15:33.391 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.391 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.391 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00877638 s, 119 MB/s 2023-10-06T11:15:33.402 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.403 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.403 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100998 s, 104 MB/s 2023-10-06T11:15:33.414 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.414 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.414 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00940882 s, 111 MB/s 2023-10-06T11:15:33.426 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.426 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.426 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101039 s, 104 MB/s 2023-10-06T11:15:33.438 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.439 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.439 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00982385 s, 107 MB/s 2023-10-06T11:15:33.450 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.450 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.450 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00932233 s, 112 MB/s 2023-10-06T11:15:33.462 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.463 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.463 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100873 s, 104 MB/s 2023-10-06T11:15:33.474 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.474 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.474 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0092498 s, 113 MB/s 2023-10-06T11:15:33.486 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.486 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.486 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00952731 s, 110 MB/s 2023-10-06T11:15:33.497 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.497 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.497 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.009238 s, 114 MB/s 2023-10-06T11:15:33.498 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:15:33.499 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:15:33.499 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:15:33.499 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.18 2023-10-06T11:15:33.499 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:15:33.499 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.18/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:15:33.499 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:15:33.499 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:15:33.581 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.581 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.581 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00946571 s, 111 MB/s 2023-10-06T11:15:33.593 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.593 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.593 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00939753 s, 112 MB/s 2023-10-06T11:15:33.604 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.604 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.604 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00940873 s, 111 MB/s 2023-10-06T11:15:33.615 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.615 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.615 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00880071 s, 119 MB/s 2023-10-06T11:15:33.628 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.628 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.629 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107488 s, 97.6 MB/s 2023-10-06T11:15:33.640 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.640 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.640 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00975702 s, 107 MB/s 2023-10-06T11:15:33.652 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.652 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.652 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00959779 s, 109 MB/s 2023-10-06T11:15:33.664 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.664 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.664 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00946036 s, 111 MB/s 2023-10-06T11:15:33.675 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.675 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.675 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00926169 s, 113 MB/s 2023-10-06T11:15:33.685 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.686 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.686 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0084479 s, 124 MB/s 2023-10-06T11:15:33.698 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.698 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.698 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00997257 s, 105 MB/s 2023-10-06T11:15:33.709 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.709 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.709 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00927976 s, 113 MB/s 2023-10-06T11:15:33.720 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.721 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.721 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00913856 s, 115 MB/s 2023-10-06T11:15:33.732 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.732 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.732 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00937014 s, 112 MB/s 2023-10-06T11:15:33.743 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.743 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.744 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00916499 s, 114 MB/s 2023-10-06T11:15:33.755 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.755 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.755 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00927242 s, 113 MB/s 2023-10-06T11:15:33.766 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.766 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.766 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00926142 s, 113 MB/s 2023-10-06T11:15:33.778 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.778 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.778 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00917255 s, 114 MB/s 2023-10-06T11:15:33.789 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.789 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.789 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00908312 s, 115 MB/s 2023-10-06T11:15:33.800 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.801 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.801 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00925875 s, 113 MB/s 2023-10-06T11:15:33.812 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.812 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.812 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00942786 s, 111 MB/s 2023-10-06T11:15:33.823 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.824 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.824 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00924142 s, 113 MB/s 2023-10-06T11:15:33.835 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.835 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.835 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00960544 s, 109 MB/s 2023-10-06T11:15:33.846 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.846 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.847 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00909012 s, 115 MB/s 2023-10-06T11:15:33.857 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.857 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.857 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00868475 s, 121 MB/s 2023-10-06T11:15:33.869 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.870 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.870 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100278 s, 105 MB/s 2023-10-06T11:15:33.882 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.882 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.882 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100409 s, 104 MB/s 2023-10-06T11:15:33.893 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.893 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.894 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00945996 s, 111 MB/s 2023-10-06T11:15:33.906 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.906 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.906 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102338 s, 102 MB/s 2023-10-06T11:15:33.917 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.918 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.918 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0094536 s, 111 MB/s 2023-10-06T11:15:33.929 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.929 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.929 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00931269 s, 113 MB/s 2023-10-06T11:15:33.941 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:33.941 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:33.941 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00942782 s, 111 MB/s 2023-10-06T11:15:33.942 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:15:33.942 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:15:33.942 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:15:33.942 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.19 2023-10-06T11:15:33.942 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:15:33.942 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.19/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:15:33.943 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:15:33.943 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:15:34.036 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.036 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.036 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101461 s, 103 MB/s 2023-10-06T11:15:34.048 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.048 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.048 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00956088 s, 110 MB/s 2023-10-06T11:15:34.059 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.059 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.059 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00926303 s, 113 MB/s 2023-10-06T11:15:34.070 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.071 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.071 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0093608 s, 112 MB/s 2023-10-06T11:15:34.083 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.083 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.083 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101897 s, 103 MB/s 2023-10-06T11:15:34.094 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.094 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.095 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00936404 s, 112 MB/s 2023-10-06T11:15:34.107 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.107 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.107 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101103 s, 104 MB/s 2023-10-06T11:15:34.119 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.119 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.119 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100421 s, 104 MB/s 2023-10-06T11:15:34.131 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.132 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.132 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102564 s, 102 MB/s 2023-10-06T11:15:34.144 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.144 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.144 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100251 s, 105 MB/s 2023-10-06T11:15:34.155 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.155 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.155 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00917351 s, 114 MB/s 2023-10-06T11:15:34.167 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.167 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.168 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0099698 s, 105 MB/s 2023-10-06T11:15:34.180 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.180 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.180 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103187 s, 102 MB/s 2023-10-06T11:15:34.191 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.192 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.192 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00935674 s, 112 MB/s 2023-10-06T11:15:34.205 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.205 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.205 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00864046 s, 121 MB/s 2023-10-06T11:15:34.213 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.213 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.213 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00855049 s, 123 MB/s 2023-10-06T11:15:34.224 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.224 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.225 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00922026 s, 114 MB/s 2023-10-06T11:15:34.236 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.237 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.237 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00997546 s, 105 MB/s 2023-10-06T11:15:34.248 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.248 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.248 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00930989 s, 113 MB/s 2023-10-06T11:15:34.260 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.260 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.260 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00922913 s, 114 MB/s 2023-10-06T11:15:34.271 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.272 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.272 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0099588 s, 105 MB/s 2023-10-06T11:15:34.283 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.283 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.283 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00937274 s, 112 MB/s 2023-10-06T11:15:34.294 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.294 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.294 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00906227 s, 116 MB/s 2023-10-06T11:15:34.305 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.306 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.306 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00912902 s, 115 MB/s 2023-10-06T11:15:34.317 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.317 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.317 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00937539 s, 112 MB/s 2023-10-06T11:15:34.328 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.328 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.328 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00875059 s, 120 MB/s 2023-10-06T11:15:34.340 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.340 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.340 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00924907 s, 113 MB/s 2023-10-06T11:15:34.351 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.351 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.351 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00921937 s, 114 MB/s 2023-10-06T11:15:34.362 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.363 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.363 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0090081 s, 116 MB/s 2023-10-06T11:15:34.373 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.373 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.373 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00856926 s, 122 MB/s 2023-10-06T11:15:34.384 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.384 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.384 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00930948 s, 113 MB/s 2023-10-06T11:15:34.396 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.396 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.396 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0093163 s, 113 MB/s 2023-10-06T11:15:34.397 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:15:34.397 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:15:34.397 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:15:34.397 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.20 2023-10-06T11:15:34.397 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:15:34.397 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.20/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:15:34.398 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:15:34.398 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:15:34.439 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.439 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.439 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00902299 s, 116 MB/s 2023-10-06T11:15:34.451 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.451 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.451 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0099898 s, 105 MB/s 2023-10-06T11:15:34.462 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.462 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.462 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00896049 s, 117 MB/s 2023-10-06T11:15:34.474 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.474 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.474 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00933441 s, 112 MB/s 2023-10-06T11:15:34.484 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.485 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.485 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00864666 s, 121 MB/s 2023-10-06T11:15:34.496 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.496 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.496 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00927905 s, 113 MB/s 2023-10-06T11:15:34.508 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.508 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.508 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00944321 s, 111 MB/s 2023-10-06T11:15:34.519 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.519 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.520 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00935748 s, 112 MB/s 2023-10-06T11:15:34.530 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.531 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.531 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00941557 s, 111 MB/s 2023-10-06T11:15:34.543 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.543 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.543 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00994619 s, 105 MB/s 2023-10-06T11:15:34.554 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.554 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.554 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00929018 s, 113 MB/s 2023-10-06T11:15:34.566 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.566 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.566 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00997078 s, 105 MB/s 2023-10-06T11:15:34.578 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.578 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.578 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00951027 s, 110 MB/s 2023-10-06T11:15:34.590 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.590 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.590 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00956883 s, 110 MB/s 2023-10-06T11:15:34.601 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.602 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.602 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00914917 s, 115 MB/s 2023-10-06T11:15:34.613 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.614 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.614 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102705 s, 102 MB/s 2023-10-06T11:15:34.626 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.626 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.626 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00998652 s, 105 MB/s 2023-10-06T11:15:34.637 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.637 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.637 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00907581 s, 116 MB/s 2023-10-06T11:15:34.649 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.649 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.649 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00996432 s, 105 MB/s 2023-10-06T11:15:34.661 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.661 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.661 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00937311 s, 112 MB/s 2023-10-06T11:15:34.672 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.672 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.672 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00919629 s, 114 MB/s 2023-10-06T11:15:34.683 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.684 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.684 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00920743 s, 114 MB/s 2023-10-06T11:15:34.694 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.695 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.695 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00892289 s, 118 MB/s 2023-10-06T11:15:34.706 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.706 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.706 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00945537 s, 111 MB/s 2023-10-06T11:15:34.717 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.717 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.717 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00827987 s, 127 MB/s 2023-10-06T11:15:34.730 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.730 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.730 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00943749 s, 111 MB/s 2023-10-06T11:15:34.740 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.741 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.741 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00995509 s, 105 MB/s 2023-10-06T11:15:34.752 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.752 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.752 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00915799 s, 114 MB/s 2023-10-06T11:15:34.764 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.764 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.764 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00987527 s, 106 MB/s 2023-10-06T11:15:34.775 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.775 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.775 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00910042 s, 115 MB/s 2023-10-06T11:15:34.787 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.787 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.787 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00997208 s, 105 MB/s 2023-10-06T11:15:34.799 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.799 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.800 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0098259 s, 107 MB/s 2023-10-06T11:15:34.800 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:15:34.801 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:15:34.801 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:15:34.801 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.21 2023-10-06T11:15:34.801 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:15:34.801 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.21/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:15:34.801 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:15:34.801 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:15:34.883 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.883 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.883 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00951938 s, 110 MB/s 2023-10-06T11:15:34.894 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.894 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.894 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00895331 s, 117 MB/s 2023-10-06T11:15:34.905 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.906 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.906 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00938206 s, 112 MB/s 2023-10-06T11:15:34.918 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.918 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.918 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00991035 s, 106 MB/s 2023-10-06T11:15:34.928 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.928 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.929 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00840729 s, 125 MB/s 2023-10-06T11:15:34.940 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.940 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.940 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0088134 s, 119 MB/s 2023-10-06T11:15:34.952 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.952 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.952 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100302 s, 105 MB/s 2023-10-06T11:15:34.963 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.963 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.963 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00914694 s, 115 MB/s 2023-10-06T11:15:34.974 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.975 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.975 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00925657 s, 113 MB/s 2023-10-06T11:15:34.987 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:34.987 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:34.987 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100377 s, 104 MB/s 2023-10-06T11:15:35.001 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.001 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.001 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0118672 s, 88.4 MB/s 2023-10-06T11:15:35.035 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.035 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.035 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0090978 s, 115 MB/s 2023-10-06T11:15:35.046 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.046 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.047 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00914875 s, 115 MB/s 2023-10-06T11:15:35.058 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.058 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.058 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00920871 s, 114 MB/s 2023-10-06T11:15:35.069 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.070 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.070 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0095022 s, 110 MB/s 2023-10-06T11:15:35.081 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.081 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.081 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00934894 s, 112 MB/s 2023-10-06T11:15:35.092 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.093 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.093 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00932437 s, 112 MB/s 2023-10-06T11:15:35.103 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.104 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.104 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00851088 s, 123 MB/s 2023-10-06T11:15:35.115 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.115 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.115 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00910222 s, 115 MB/s 2023-10-06T11:15:35.127 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.127 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.127 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0096671 s, 108 MB/s 2023-10-06T11:15:35.137 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.138 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.138 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00863467 s, 121 MB/s 2023-10-06T11:15:35.149 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.149 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.149 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00925839 s, 113 MB/s 2023-10-06T11:15:35.161 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.161 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.161 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00933239 s, 112 MB/s 2023-10-06T11:15:35.174 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.174 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.174 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102809 s, 102 MB/s 2023-10-06T11:15:35.185 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.185 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.185 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00970315 s, 108 MB/s 2023-10-06T11:15:35.198 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.198 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.198 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102478 s, 102 MB/s 2023-10-06T11:15:35.210 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.210 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.210 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103697 s, 101 MB/s 2023-10-06T11:15:35.222 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.222 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.223 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00971687 s, 108 MB/s 2023-10-06T11:15:35.234 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.234 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.234 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00877287 s, 120 MB/s 2023-10-06T11:15:35.244 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.245 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.245 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00900463 s, 116 MB/s 2023-10-06T11:15:35.257 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.257 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.257 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102251 s, 103 MB/s 2023-10-06T11:15:35.268 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.268 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.268 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00899079 s, 117 MB/s 2023-10-06T11:15:35.269 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:15:35.269 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:15:35.269 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:15:35.269 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.22 2023-10-06T11:15:35.269 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:15:35.270 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.22/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:15:35.270 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:15:35.270 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:15:35.352 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.352 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.352 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00944954 s, 111 MB/s 2023-10-06T11:15:35.363 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.363 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.363 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00950215 s, 110 MB/s 2023-10-06T11:15:35.376 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.376 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.376 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103048 s, 102 MB/s 2023-10-06T11:15:35.388 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.388 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.388 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101383 s, 103 MB/s 2023-10-06T11:15:35.401 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.401 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.401 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101997 s, 103 MB/s 2023-10-06T11:15:35.414 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.414 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.414 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101906 s, 103 MB/s 2023-10-06T11:15:35.425 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.425 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.426 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00951927 s, 110 MB/s 2023-10-06T11:15:35.438 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.438 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.438 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105201 s, 99.7 MB/s 2023-10-06T11:15:35.450 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.450 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.450 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00948902 s, 111 MB/s 2023-10-06T11:15:35.461 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.461 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.461 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00863415 s, 121 MB/s 2023-10-06T11:15:35.472 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.473 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.473 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00957515 s, 110 MB/s 2023-10-06T11:15:35.483 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.484 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.484 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00874855 s, 120 MB/s 2023-10-06T11:15:35.495 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.495 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.495 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00916958 s, 114 MB/s 2023-10-06T11:15:35.507 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.507 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.507 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0094976 s, 110 MB/s 2023-10-06T11:15:35.519 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.519 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.519 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101519 s, 103 MB/s 2023-10-06T11:15:35.531 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.531 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.531 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00940634 s, 111 MB/s 2023-10-06T11:15:35.542 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.542 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.542 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00928534 s, 113 MB/s 2023-10-06T11:15:35.554 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.554 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.554 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0093751 s, 112 MB/s 2023-10-06T11:15:35.566 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.566 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.566 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100156 s, 105 MB/s 2023-10-06T11:15:35.578 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.578 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.578 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0094168 s, 111 MB/s 2023-10-06T11:15:35.589 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.589 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.589 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00851763 s, 123 MB/s 2023-10-06T11:15:35.601 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.601 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.601 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00983795 s, 107 MB/s 2023-10-06T11:15:35.612 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.612 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.612 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00925683 s, 113 MB/s 2023-10-06T11:15:35.624 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.624 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.624 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00946894 s, 111 MB/s 2023-10-06T11:15:35.635 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.635 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.635 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00867666 s, 121 MB/s 2023-10-06T11:15:35.647 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.648 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.648 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100578 s, 104 MB/s 2023-10-06T11:15:35.658 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.659 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.659 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00854809 s, 123 MB/s 2023-10-06T11:15:35.670 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.670 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.670 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00917043 s, 114 MB/s 2023-10-06T11:15:35.681 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.681 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.681 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00902779 s, 116 MB/s 2023-10-06T11:15:35.692 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.692 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.692 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00839158 s, 125 MB/s 2023-10-06T11:15:35.703 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.703 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.703 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00909582 s, 115 MB/s 2023-10-06T11:15:35.716 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.716 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.716 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00962023 s, 109 MB/s 2023-10-06T11:15:35.716 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:15:35.717 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:15:35.717 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:15:35.717 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.23 2023-10-06T11:15:35.717 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:15:35.717 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.23/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:15:35.717 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:15:35.717 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:15:35.798 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.798 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.798 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00916533 s, 114 MB/s 2023-10-06T11:15:35.810 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.810 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.810 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00929371 s, 113 MB/s 2023-10-06T11:15:35.822 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.822 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.822 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00990916 s, 106 MB/s 2023-10-06T11:15:35.833 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.833 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.833 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00859909 s, 122 MB/s 2023-10-06T11:15:35.846 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.846 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.846 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00916064 s, 114 MB/s 2023-10-06T11:15:35.855 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.855 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.856 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00926098 s, 113 MB/s 2023-10-06T11:15:35.867 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.867 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.867 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00939628 s, 112 MB/s 2023-10-06T11:15:35.879 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.879 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.879 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0094156 s, 111 MB/s 2023-10-06T11:15:35.890 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.890 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.890 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00896031 s, 117 MB/s 2023-10-06T11:15:35.902 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.902 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.902 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00961817 s, 109 MB/s 2023-10-06T11:15:35.914 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.914 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.914 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100671 s, 104 MB/s 2023-10-06T11:15:35.928 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.928 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.928 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104592 s, 100 MB/s 2023-10-06T11:15:35.938 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.938 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.938 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00932808 s, 112 MB/s 2023-10-06T11:15:35.951 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.951 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.951 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101684 s, 103 MB/s 2023-10-06T11:15:35.963 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.963 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.963 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00996458 s, 105 MB/s 2023-10-06T11:15:35.975 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.975 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.975 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00928699 s, 113 MB/s 2023-10-06T11:15:35.986 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.986 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.986 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00875657 s, 120 MB/s 2023-10-06T11:15:35.997 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:35.997 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:35.998 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00912983 s, 115 MB/s 2023-10-06T11:15:36.011 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.012 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.012 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0117584 s, 89.2 MB/s 2023-10-06T11:15:36.042 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.042 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.042 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00929787 s, 113 MB/s 2023-10-06T11:15:36.054 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.054 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.054 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00883928 s, 119 MB/s 2023-10-06T11:15:36.064 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.064 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.065 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00924459 s, 113 MB/s 2023-10-06T11:15:36.076 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.077 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.077 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100886 s, 104 MB/s 2023-10-06T11:15:36.088 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.088 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.088 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00914794 s, 115 MB/s 2023-10-06T11:15:36.100 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.100 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.100 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00939623 s, 112 MB/s 2023-10-06T11:15:36.111 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.111 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.111 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00938447 s, 112 MB/s 2023-10-06T11:15:36.123 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.123 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.123 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00919116 s, 114 MB/s 2023-10-06T11:15:36.134 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.134 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.134 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.009308 s, 113 MB/s 2023-10-06T11:15:36.145 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.146 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.146 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0092958 s, 113 MB/s 2023-10-06T11:15:36.156 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.156 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.156 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0085307 s, 123 MB/s 2023-10-06T11:15:36.167 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.167 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.167 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00846871 s, 124 MB/s 2023-10-06T11:15:36.178 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.178 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.179 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00921416 s, 114 MB/s 2023-10-06T11:15:36.179 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:15:36.180 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:15:36.180 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:15:36.180 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.24 2023-10-06T11:15:36.180 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:15:36.180 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.24/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:15:36.180 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:15:36.180 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:15:36.263 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.263 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.263 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00971354 s, 108 MB/s 2023-10-06T11:15:36.274 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.274 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.275 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00960002 s, 109 MB/s 2023-10-06T11:15:36.286 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.287 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.287 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00970958 s, 108 MB/s 2023-10-06T11:15:36.297 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.298 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.298 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00853321 s, 123 MB/s 2023-10-06T11:15:36.310 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.310 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.310 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102183 s, 103 MB/s 2023-10-06T11:15:36.321 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.322 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.322 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00926379 s, 113 MB/s 2023-10-06T11:15:36.333 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.333 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.333 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00920325 s, 114 MB/s 2023-10-06T11:15:36.344 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.345 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.345 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00941679 s, 111 MB/s 2023-10-06T11:15:36.357 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.357 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.357 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00974863 s, 108 MB/s 2023-10-06T11:15:36.368 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.369 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.369 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00960293 s, 109 MB/s 2023-10-06T11:15:36.379 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.380 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.380 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00875247 s, 120 MB/s 2023-10-06T11:15:36.392 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.392 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.392 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102288 s, 103 MB/s 2023-10-06T11:15:36.405 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.405 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.405 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0107675 s, 97.4 MB/s 2023-10-06T11:15:36.418 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.418 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.418 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105523 s, 99.4 MB/s 2023-10-06T11:15:36.430 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.430 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.430 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00952904 s, 110 MB/s 2023-10-06T11:15:36.442 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.443 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.443 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00999083 s, 105 MB/s 2023-10-06T11:15:36.456 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.456 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.456 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010705 s, 98.0 MB/s 2023-10-06T11:15:36.469 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.469 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.469 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104564 s, 100 MB/s 2023-10-06T11:15:36.481 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.481 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.481 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00964998 s, 109 MB/s 2023-10-06T11:15:36.492 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.492 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.493 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00905043 s, 116 MB/s 2023-10-06T11:15:36.505 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.505 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.505 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00994107 s, 105 MB/s 2023-10-06T11:15:36.519 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.519 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.519 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.011354 s, 92.4 MB/s 2023-10-06T11:15:36.531 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.531 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.531 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0098627 s, 106 MB/s 2023-10-06T11:15:36.545 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.545 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.545 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110938 s, 94.5 MB/s 2023-10-06T11:15:36.558 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.558 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.558 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0105882 s, 99.0 MB/s 2023-10-06T11:15:36.571 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.571 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.571 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102764 s, 102 MB/s 2023-10-06T11:15:36.583 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.583 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.583 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00969302 s, 108 MB/s 2023-10-06T11:15:36.596 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.597 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.597 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0111877 s, 93.7 MB/s 2023-10-06T11:15:36.609 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.609 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.609 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00969836 s, 108 MB/s 2023-10-06T11:15:36.622 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.622 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.622 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103188 s, 102 MB/s 2023-10-06T11:15:36.635 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.635 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.635 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104342 s, 100 MB/s 2023-10-06T11:15:36.647 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.647 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.648 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102165 s, 103 MB/s 2023-10-06T11:15:36.648 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:15:36.649 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:15:36.649 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:15:36.649 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.25 2023-10-06T11:15:36.649 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:15:36.649 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.25/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:15:36.649 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:15:36.649 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:15:36.731 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.732 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.732 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104268 s, 101 MB/s 2023-10-06T11:15:36.744 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.744 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.744 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00987349 s, 106 MB/s 2023-10-06T11:15:36.755 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.755 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.756 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00938042 s, 112 MB/s 2023-10-06T11:15:36.766 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.766 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.766 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00868585 s, 121 MB/s 2023-10-06T11:15:36.777 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.777 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.777 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00858285 s, 122 MB/s 2023-10-06T11:15:36.788 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.789 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.789 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00934825 s, 112 MB/s 2023-10-06T11:15:36.799 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.799 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.800 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00871585 s, 120 MB/s 2023-10-06T11:15:36.812 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.812 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.812 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00978293 s, 107 MB/s 2023-10-06T11:15:36.824 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.824 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.824 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010064 s, 104 MB/s 2023-10-06T11:15:36.836 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.836 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.836 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00898442 s, 117 MB/s 2023-10-06T11:15:36.847 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.847 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.847 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00945452 s, 111 MB/s 2023-10-06T11:15:36.858 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.858 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.858 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00880716 s, 119 MB/s 2023-10-06T11:15:36.869 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.869 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.869 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00881055 s, 119 MB/s 2023-10-06T11:15:36.881 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.881 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.881 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100461 s, 104 MB/s 2023-10-06T11:15:36.893 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.893 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.893 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00958713 s, 109 MB/s 2023-10-06T11:15:36.905 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.905 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.905 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954001 s, 110 MB/s 2023-10-06T11:15:36.917 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.917 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.917 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00999935 s, 105 MB/s 2023-10-06T11:15:36.928 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.929 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.929 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00922644 s, 114 MB/s 2023-10-06T11:15:36.940 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.940 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.940 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00929245 s, 113 MB/s 2023-10-06T11:15:36.951 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.951 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.951 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00888483 s, 118 MB/s 2023-10-06T11:15:36.962 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.962 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.963 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00950951 s, 110 MB/s 2023-10-06T11:15:36.973 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.973 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.973 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00848613 s, 124 MB/s 2023-10-06T11:15:36.984 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.984 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.984 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00855107 s, 123 MB/s 2023-10-06T11:15:36.996 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:36.996 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:36.996 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00962402 s, 109 MB/s 2023-10-06T11:15:37.018 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.018 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.018 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0199765 s, 52.5 MB/s 2023-10-06T11:15:37.049 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.049 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.049 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00924589 s, 113 MB/s 2023-10-06T11:15:37.061 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.061 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.061 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00917647 s, 114 MB/s 2023-10-06T11:15:37.073 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.074 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.074 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00945101 s, 111 MB/s 2023-10-06T11:15:37.083 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.083 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.083 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00904368 s, 116 MB/s 2023-10-06T11:15:37.095 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.095 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.095 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00933463 s, 112 MB/s 2023-10-06T11:15:37.106 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.107 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.107 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00956346 s, 110 MB/s 2023-10-06T11:15:37.119 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.119 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.119 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101948 s, 103 MB/s 2023-10-06T11:15:37.120 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:15:37.120 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:15:37.120 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:15:37.120 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.26 2023-10-06T11:15:37.120 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:15:37.121 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.26/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:15:37.121 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:15:37.121 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:15:37.204 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.204 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.204 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104959 s, 99.9 MB/s 2023-10-06T11:15:37.215 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.216 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.216 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00948709 s, 111 MB/s 2023-10-06T11:15:37.227 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.227 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.227 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00954227 s, 110 MB/s 2023-10-06T11:15:37.240 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.241 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.241 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00959483 s, 109 MB/s 2023-10-06T11:15:37.251 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.251 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.251 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101549 s, 103 MB/s 2023-10-06T11:15:37.263 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.263 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.263 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00969368 s, 108 MB/s 2023-10-06T11:15:37.275 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.275 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.275 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00945425 s, 111 MB/s 2023-10-06T11:15:37.286 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.286 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.286 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00868861 s, 121 MB/s 2023-10-06T11:15:37.296 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.297 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.297 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00866836 s, 121 MB/s 2023-10-06T11:15:37.308 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.308 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.308 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00921621 s, 114 MB/s 2023-10-06T11:15:37.319 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.320 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.320 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00937652 s, 112 MB/s 2023-10-06T11:15:37.333 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.333 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.334 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103997 s, 101 MB/s 2023-10-06T11:15:37.344 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.344 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.344 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00963357 s, 109 MB/s 2023-10-06T11:15:37.355 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.355 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.355 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0086851 s, 121 MB/s 2023-10-06T11:15:37.366 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.366 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.366 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00869816 s, 121 MB/s 2023-10-06T11:15:37.378 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.378 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.378 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00941519 s, 111 MB/s 2023-10-06T11:15:37.388 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.389 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.389 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00860052 s, 122 MB/s 2023-10-06T11:15:37.401 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.401 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.401 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102549 s, 102 MB/s 2023-10-06T11:15:37.414 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.414 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.414 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010062 s, 104 MB/s 2023-10-06T11:15:37.426 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.426 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.426 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103148 s, 102 MB/s 2023-10-06T11:15:37.437 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.438 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.438 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00934179 s, 112 MB/s 2023-10-06T11:15:37.449 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.449 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.449 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00959529 s, 109 MB/s 2023-10-06T11:15:37.460 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.460 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.461 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00919509 s, 114 MB/s 2023-10-06T11:15:37.472 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.472 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.472 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00927112 s, 113 MB/s 2023-10-06T11:15:37.483 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.483 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.483 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00872478 s, 120 MB/s 2023-10-06T11:15:37.493 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.494 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.494 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0084814 s, 124 MB/s 2023-10-06T11:15:37.505 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.505 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.505 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00873443 s, 120 MB/s 2023-10-06T11:15:37.516 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.516 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.516 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00917765 s, 114 MB/s 2023-10-06T11:15:37.528 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.528 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.528 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00967028 s, 108 MB/s 2023-10-06T11:15:37.539 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.540 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.540 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00924337 s, 113 MB/s 2023-10-06T11:15:37.552 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.552 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.552 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00938803 s, 112 MB/s 2023-10-06T11:15:37.563 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.564 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.564 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00936077 s, 112 MB/s 2023-10-06T11:15:37.565 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:15:37.565 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:15:37.565 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:15:37.565 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.27 2023-10-06T11:15:37.565 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:15:37.565 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.27/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:15:37.565 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:15:37.565 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:15:37.649 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.649 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.649 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101068 s, 104 MB/s 2023-10-06T11:15:37.661 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.661 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.661 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00930081 s, 113 MB/s 2023-10-06T11:15:37.672 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.672 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.672 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00908716 s, 115 MB/s 2023-10-06T11:15:37.685 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.685 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.685 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101527 s, 103 MB/s 2023-10-06T11:15:37.697 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.698 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.698 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0097327 s, 108 MB/s 2023-10-06T11:15:37.709 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.709 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.709 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00872337 s, 120 MB/s 2023-10-06T11:15:37.721 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.721 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.721 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00958361 s, 109 MB/s 2023-10-06T11:15:37.732 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.732 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.732 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00930924 s, 113 MB/s 2023-10-06T11:15:37.744 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.744 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.744 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00964212 s, 109 MB/s 2023-10-06T11:15:37.756 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.756 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.756 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0092243 s, 114 MB/s 2023-10-06T11:15:37.768 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.768 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.768 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00918012 s, 114 MB/s 2023-10-06T11:15:37.780 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.780 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.780 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00927729 s, 113 MB/s 2023-10-06T11:15:37.791 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.792 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.792 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00926362 s, 113 MB/s 2023-10-06T11:15:37.803 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.803 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.803 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00910765 s, 115 MB/s 2023-10-06T11:15:37.815 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.816 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.816 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00979291 s, 107 MB/s 2023-10-06T11:15:37.829 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.829 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.829 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010243 s, 102 MB/s 2023-10-06T11:15:37.840 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.840 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.840 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00924206 s, 113 MB/s 2023-10-06T11:15:37.853 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.854 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.854 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101827 s, 103 MB/s 2023-10-06T11:15:37.864 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.864 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.864 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00840039 s, 125 MB/s 2023-10-06T11:15:37.875 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.875 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.876 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00844087 s, 124 MB/s 2023-10-06T11:15:37.890 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.890 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.891 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00915347 s, 115 MB/s 2023-10-06T11:15:37.898 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.899 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.899 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00910468 s, 115 MB/s 2023-10-06T11:15:37.910 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.911 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.911 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00947754 s, 111 MB/s 2023-10-06T11:15:37.921 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.922 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.922 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00840832 s, 125 MB/s 2023-10-06T11:15:37.933 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.933 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.933 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00926773 s, 113 MB/s 2023-10-06T11:15:37.944 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.944 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.944 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00837139 s, 125 MB/s 2023-10-06T11:15:37.957 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.957 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.957 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103333 s, 101 MB/s 2023-10-06T11:15:37.968 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.968 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.968 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00845638 s, 124 MB/s 2023-10-06T11:15:37.980 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.980 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.980 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00944286 s, 111 MB/s 2023-10-06T11:15:37.993 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:37.993 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:37.993 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00998924 s, 105 MB/s 2023-10-06T11:15:38.005 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.005 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.006 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101814 s, 103 MB/s 2023-10-06T11:15:38.018 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.019 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.019 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00932193 s, 112 MB/s 2023-10-06T11:15:38.019 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:15:38.019 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:15:38.020 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:15:38.020 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.28 2023-10-06T11:15:38.020 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:15:38.020 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.28/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:15:38.020 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:15:38.021 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:15:38.101 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.101 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.101 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101666 s, 103 MB/s 2023-10-06T11:15:38.112 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.112 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.112 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00889427 s, 118 MB/s 2023-10-06T11:15:38.124 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.124 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.124 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00948972 s, 110 MB/s 2023-10-06T11:15:38.135 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.135 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.135 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00913101 s, 115 MB/s 2023-10-06T11:15:38.146 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.146 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.146 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00859355 s, 122 MB/s 2023-10-06T11:15:38.158 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.159 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.159 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101362 s, 103 MB/s 2023-10-06T11:15:38.170 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.170 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.170 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0094532 s, 111 MB/s 2023-10-06T11:15:38.181 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.182 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.182 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00925822 s, 113 MB/s 2023-10-06T11:15:38.194 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.195 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.195 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0093207 s, 112 MB/s 2023-10-06T11:15:38.206 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.206 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.206 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100179 s, 105 MB/s 2023-10-06T11:15:38.217 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.217 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.217 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00937764 s, 112 MB/s 2023-10-06T11:15:38.229 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.229 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.229 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00955012 s, 110 MB/s 2023-10-06T11:15:38.240 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.241 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.241 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00949871 s, 110 MB/s 2023-10-06T11:15:38.253 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.253 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.253 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104974 s, 99.9 MB/s 2023-10-06T11:15:38.265 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.265 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.265 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00914351 s, 115 MB/s 2023-10-06T11:15:38.276 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.277 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.277 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010112 s, 104 MB/s 2023-10-06T11:15:38.288 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.288 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.288 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00916851 s, 114 MB/s 2023-10-06T11:15:38.299 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.299 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.300 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00903744 s, 116 MB/s 2023-10-06T11:15:38.311 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.311 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.311 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0093455 s, 112 MB/s 2023-10-06T11:15:38.323 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.323 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.323 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101115 s, 104 MB/s 2023-10-06T11:15:38.335 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.336 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.336 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100536 s, 104 MB/s 2023-10-06T11:15:38.347 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.347 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.347 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00944158 s, 111 MB/s 2023-10-06T11:15:38.358 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.359 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.359 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00919327 s, 114 MB/s 2023-10-06T11:15:38.370 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.370 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.370 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00903204 s, 116 MB/s 2023-10-06T11:15:38.382 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.382 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.382 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101704 s, 103 MB/s 2023-10-06T11:15:38.393 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.393 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.393 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00849548 s, 123 MB/s 2023-10-06T11:15:38.404 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.405 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.405 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00928002 s, 113 MB/s 2023-10-06T11:15:38.416 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.416 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.416 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00948628 s, 111 MB/s 2023-10-06T11:15:38.428 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.428 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.428 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00936843 s, 112 MB/s 2023-10-06T11:15:38.440 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.440 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.440 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100292 s, 105 MB/s 2023-10-06T11:15:38.452 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.453 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.453 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101636 s, 103 MB/s 2023-10-06T11:15:38.465 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.465 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.465 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.010299 s, 102 MB/s 2023-10-06T11:15:38.466 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:15:38.466 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:15:38.467 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:15:38.467 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.29 2023-10-06T11:15:38.467 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:15:38.467 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.29/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:15:38.467 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:15:38.467 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:15:38.551 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.551 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.551 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102532 s, 102 MB/s 2023-10-06T11:15:38.562 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.562 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.563 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00957218 s, 110 MB/s 2023-10-06T11:15:38.574 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.575 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.575 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00977631 s, 107 MB/s 2023-10-06T11:15:38.586 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.587 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.587 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00940895 s, 111 MB/s 2023-10-06T11:15:38.598 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.598 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.598 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00923984 s, 113 MB/s 2023-10-06T11:15:38.610 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.610 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.610 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00976737 s, 107 MB/s 2023-10-06T11:15:38.621 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.621 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.621 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00924052 s, 113 MB/s 2023-10-06T11:15:38.633 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.633 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.633 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0096578 s, 109 MB/s 2023-10-06T11:15:38.646 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.646 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.646 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102188 s, 103 MB/s 2023-10-06T11:15:38.658 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.658 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.658 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100656 s, 104 MB/s 2023-10-06T11:15:38.670 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.670 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.670 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00960679 s, 109 MB/s 2023-10-06T11:15:38.683 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.683 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.683 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104156 s, 101 MB/s 2023-10-06T11:15:38.694 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.694 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.695 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00938837 s, 112 MB/s 2023-10-06T11:15:38.706 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.706 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.706 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00916681 s, 114 MB/s 2023-10-06T11:15:38.717 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.719 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.719 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00935173 s, 112 MB/s 2023-10-06T11:15:38.729 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.729 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.730 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00962623 s, 109 MB/s 2023-10-06T11:15:38.740 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.740 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.741 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00894705 s, 117 MB/s 2023-10-06T11:15:38.752 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.752 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.752 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00900501 s, 116 MB/s 2023-10-06T11:15:38.763 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.763 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.763 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00942607 s, 111 MB/s 2023-10-06T11:15:38.775 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.775 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.776 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00976577 s, 107 MB/s 2023-10-06T11:15:38.787 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.787 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.787 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00977335 s, 107 MB/s 2023-10-06T11:15:38.800 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.800 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.800 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103699 s, 101 MB/s 2023-10-06T11:15:38.812 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.812 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.812 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00974409 s, 108 MB/s 2023-10-06T11:15:38.824 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.824 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.824 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00967133 s, 108 MB/s 2023-10-06T11:15:38.835 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.836 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.836 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00940264 s, 112 MB/s 2023-10-06T11:15:38.847 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.847 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.847 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00950826 s, 110 MB/s 2023-10-06T11:15:38.860 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.860 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.860 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0103701 s, 101 MB/s 2023-10-06T11:15:38.871 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.872 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.872 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00938015 s, 112 MB/s 2023-10-06T11:15:38.883 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.883 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.883 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0092681 s, 113 MB/s 2023-10-06T11:15:38.894 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.894 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.894 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00935148 s, 112 MB/s 2023-10-06T11:15:38.907 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.907 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.907 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00980702 s, 107 MB/s 2023-10-06T11:15:38.920 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:38.920 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:38.921 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102481 s, 102 MB/s 2023-10-06T11:15:38.921 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:15:38.921 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:15:38.921 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:15:38.921 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.30 2023-10-06T11:15:38.921 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:15:38.921 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.30/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:15:38.921 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:15:38.921 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:15:39.002 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.003 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.003 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0092802 s, 113 MB/s 2023-10-06T11:15:39.014 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.015 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.015 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00981892 s, 107 MB/s 2023-10-06T11:15:39.031 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.031 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.031 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0141595 s, 74.1 MB/s 2023-10-06T11:15:39.069 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.069 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.070 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00976718 s, 107 MB/s 2023-10-06T11:15:39.081 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.081 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.081 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00957768 s, 109 MB/s 2023-10-06T11:15:39.093 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.093 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.093 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00956205 s, 110 MB/s 2023-10-06T11:15:39.105 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.105 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.105 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00991262 s, 106 MB/s 2023-10-06T11:15:39.117 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.117 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.117 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00921061 s, 114 MB/s 2023-10-06T11:15:39.127 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.127 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.128 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00855925 s, 123 MB/s 2023-10-06T11:15:39.139 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.139 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.139 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00942622 s, 111 MB/s 2023-10-06T11:15:39.151 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.151 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.151 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00955172 s, 110 MB/s 2023-10-06T11:15:39.162 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.162 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.162 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00857278 s, 122 MB/s 2023-10-06T11:15:39.173 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.174 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.174 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00942433 s, 111 MB/s 2023-10-06T11:15:39.184 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.184 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.184 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00858719 s, 122 MB/s 2023-10-06T11:15:39.196 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.197 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.197 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00988455 s, 106 MB/s 2023-10-06T11:15:39.207 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.207 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.208 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00892421 s, 117 MB/s 2023-10-06T11:15:39.218 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.218 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.218 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00843923 s, 124 MB/s 2023-10-06T11:15:39.230 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.230 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.230 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0094861 s, 111 MB/s 2023-10-06T11:15:39.241 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.241 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.242 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00942232 s, 111 MB/s 2023-10-06T11:15:39.252 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.253 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.253 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00911715 s, 115 MB/s 2023-10-06T11:15:39.264 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.332 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.332 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00919518 s, 114 MB/s 2023-10-06T11:15:39.333 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.334 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.334 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00983063 s, 107 MB/s 2023-10-06T11:15:39.334 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.334 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.334 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0093335 s, 112 MB/s 2023-10-06T11:15:39.334 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.334 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.334 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00898481 s, 117 MB/s 2023-10-06T11:15:39.335 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.335 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.335 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00935601 s, 112 MB/s 2023-10-06T11:15:39.335 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.335 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.335 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00831925 s, 126 MB/s 2023-10-06T11:15:39.336 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.336 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.336 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00931743 s, 113 MB/s 2023-10-06T11:15:39.345 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.345 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.345 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00916507 s, 114 MB/s 2023-10-06T11:15:39.357 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.357 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.357 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00998711 s, 105 MB/s 2023-10-06T11:15:39.369 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.369 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.369 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00917509 s, 114 MB/s 2023-10-06T11:15:39.379 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.379 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.379 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00854846 s, 123 MB/s 2023-10-06T11:15:39.395 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.395 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.396 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0109054 s, 96.2 MB/s 2023-10-06T11:15:39.397 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:15:39.397 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c ' 2023-10-06T11:15:39.397 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:15:39.398 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p scrub_control_test_path/dir.31 2023-10-06T11:15:39.398 DEBUG:teuthology.orchestra.run.smithi146:> for ((i = 0; i < 32; i++)); do 2023-10-06T11:15:39.398 DEBUG:teuthology.orchestra.run.smithi146:> dd if=/dev/urandom of=scrub_control_test_path/dir.31/filename.$i bs=1M conv=fdatasync count=1 2023-10-06T11:15:39.398 DEBUG:teuthology.orchestra.run.smithi146:> done 2023-10-06T11:15:39.398 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:15:39.482 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.482 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.482 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00957666 s, 109 MB/s 2023-10-06T11:15:39.494 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.494 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.494 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00955264 s, 110 MB/s 2023-10-06T11:15:39.506 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.506 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.506 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00995109 s, 105 MB/s 2023-10-06T11:15:39.518 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.518 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.518 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00934966 s, 112 MB/s 2023-10-06T11:15:39.529 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.530 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.530 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00966619 s, 108 MB/s 2023-10-06T11:15:39.542 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.542 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.542 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104713 s, 100 MB/s 2023-10-06T11:15:39.554 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.554 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.554 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00961898 s, 109 MB/s 2023-10-06T11:15:39.566 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.566 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.566 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00946343 s, 111 MB/s 2023-10-06T11:15:39.579 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.579 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.579 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00990106 s, 106 MB/s 2023-10-06T11:15:39.590 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.592 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.592 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00948676 s, 111 MB/s 2023-10-06T11:15:39.602 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.603 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.604 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00926969 s, 113 MB/s 2023-10-06T11:15:39.613 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.613 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.614 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0101797 s, 103 MB/s 2023-10-06T11:15:39.625 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.625 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.625 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00910418 s, 115 MB/s 2023-10-06T11:15:39.637 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.637 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.637 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00998903 s, 105 MB/s 2023-10-06T11:15:39.649 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.649 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.649 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00953734 s, 110 MB/s 2023-10-06T11:15:39.661 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.661 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.661 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00972937 s, 108 MB/s 2023-10-06T11:15:39.672 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.672 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.672 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00891052 s, 118 MB/s 2023-10-06T11:15:39.684 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.684 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.684 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102279 s, 103 MB/s 2023-10-06T11:15:39.696 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.696 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.696 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00949456 s, 110 MB/s 2023-10-06T11:15:39.708 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.708 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.708 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0100248 s, 105 MB/s 2023-10-06T11:15:39.720 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.720 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.720 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00923209 s, 114 MB/s 2023-10-06T11:15:39.733 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.733 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.733 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104747 s, 100 MB/s 2023-10-06T11:15:39.744 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.744 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.744 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00934505 s, 112 MB/s 2023-10-06T11:15:39.756 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.757 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.757 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00996846 s, 105 MB/s 2023-10-06T11:15:39.768 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.768 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.768 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00878996 s, 119 MB/s 2023-10-06T11:15:39.779 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.780 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.780 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00941893 s, 111 MB/s 2023-10-06T11:15:39.790 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.791 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.791 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00867807 s, 121 MB/s 2023-10-06T11:15:39.802 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.802 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.803 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00943236 s, 111 MB/s 2023-10-06T11:15:39.814 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.814 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.814 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00917878 s, 114 MB/s 2023-10-06T11:15:39.825 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.825 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.825 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00868359 s, 121 MB/s 2023-10-06T11:15:39.836 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.837 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.837 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00942289 s, 111 MB/s 2023-10-06T11:15:39.848 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records in 2023-10-06T11:15:39.848 INFO:teuthology.orchestra.run.smithi146.stderr:1+0 records out 2023-10-06T11:15:39.849 INFO:teuthology.orchestra.run.smithi146.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00939259 s, 112 MB/s 2023-10-06T11:15:39.850 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.9:0 scrub start /scrub_control_test_path recursive 2023-10-06T11:15:40.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.007+0000 7f0caf59e700 1 Processor -- start 2023-10-06T11:15:40.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.007+0000 7f0caf59e700 1 -- start start 2023-10-06T11:15:40.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.008+0000 7f0caf59e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0cb00cb090 0x7f0cb00cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.008+0000 7f0caf59e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cb0068780 0x7f0cb0068b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.008+0000 7f0caf59e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cb00cc130 con 0x7f0cb00b5640 2023-10-06T11:15:40.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.008+0000 7f0caf59e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cb00b2660 con 0x7f0cb00cb090 2023-10-06T11:15:40.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.008+0000 7f0caf59e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb00690d0 con 0x7f0cb0068780 2023-10-06T11:15:40.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.008+0000 7f0ca5d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0cb00cb090 0x7f0cb00cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.008+0000 7f0cae59c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0cb00b5640 0x7f0cb015a870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55976/0 (socket says 172.21.15.146:55976) 2023-10-06T11:15:40.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.008+0000 7f0ca5d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0cb00cb090 0x7f0cb00cc5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33696/0 (socket says 172.21.15.146:33696) 2023-10-06T11:15:40.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.008+0000 7f0cae59c700 1 -- 172.21.15.146:0/2749184920 learned_addr learned my addr 172.21.15.146:0/2749184920 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:15:40.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.008+0000 7f0caed9d700 1 --2- 172.21.15.146:0/2749184920 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cb0068780 0x7f0cb0068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.008+0000 7f0ca5d9b700 1 -- 172.21.15.146:0/2749184920 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cb0068780 msgr2=0x7f0cb0068b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:40.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.008+0000 7f0ca5d9b700 1 --2- 172.21.15.146:0/2749184920 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cb0068780 0x7f0cb0068b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.008+0000 7f0ca5d9b700 1 -- 172.21.15.146:0/2749184920 >> v1:172.21.15.146:6789/0 conn(0x7f0cb00b5640 legacy=0x7f0cb015a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.008+0000 7f0ca5d9b700 1 -- 172.21.15.146:0/2749184920 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb00cb520 con 0x7f0cb00cb090 2023-10-06T11:15:40.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.008+0000 7f0cadd9b700 1 -- 172.21.15.146:0/2749184920 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 556482698 0 0) 0x7f0cb00cc130 con 0x7f0cb00b5640 2023-10-06T11:15:40.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.008+0000 7f0caed9d700 1 --2- 172.21.15.146:0/2749184920 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cb0068780 0x7f0cb0068b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:40.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.009+0000 7f0ca5d9b700 1 --2- 172.21.15.146:0/2749184920 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cb00cb090 0x7f0cb00cc5c0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f0c980098e0 tx=0x7f0c980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afa1331a41c2db8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:40.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.009+0000 7f0cadd9b700 1 -- 172.21.15.146:0/2749184920 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c98009e80 con 0x7f0cb00cb090 2023-10-06T11:15:40.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.009+0000 7f0cadd9b700 1 -- 172.21.15.146:0/2749184920 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9800b860 con 0x7f0cb00cb090 2023-10-06T11:15:40.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.009+0000 7f0cadd9b700 1 -- 172.21.15.146:0/2749184920 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9800bbe0 con 0x7f0cb00cb090 2023-10-06T11:15:40.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.009+0000 7f0caf59e700 1 -- 172.21.15.146:0/2749184920 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cb00cb090 msgr2=0x7f0cb00cc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.009+0000 7f0caf59e700 1 --2- 172.21.15.146:0/2749184920 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cb00cb090 0x7f0cb00cc5c0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f0c980098e0 tx=0x7f0c980091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.009+0000 7f0caf59e700 1 -- 172.21.15.146:0/2749184920 shutdown_connections 2023-10-06T11:15:40.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.009+0000 7f0caf59e700 1 --2- 172.21.15.146:0/2749184920 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cb0068780 0x7f0cb0068b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.009+0000 7f0caf59e700 1 --2- 172.21.15.146:0/2749184920 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cb00cb090 0x7f0cb00cc5c0 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.009+0000 7f0caf59e700 1 -- 172.21.15.146:0/2749184920 >> 172.21.15.146:0/2749184920 conn(0x7f0cb00703f0 msgr2=0x7f0cb00707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:40.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.009+0000 7f0caf59e700 1 -- 172.21.15.146:0/2749184920 shutdown_connections 2023-10-06T11:15:40.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.009+0000 7f0caf59e700 1 -- 172.21.15.146:0/2749184920 wait complete. 2023-10-06T11:15:40.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.010+0000 7f0caf59e700 1 Processor -- start 2023-10-06T11:15:40.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.010+0000 7f0caf59e700 1 -- start start 2023-10-06T11:15:40.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.011+0000 7f0caf59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cb0068780 0x7f0cb00c9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.011+0000 7f0caf59e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cb00b5640 0x7f0cb00c9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.011+0000 7f0caf59e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0cb00cb090 0x7f0cb0169db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.011+0000 7f0caf59e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb016b950 con 0x7f0cb0068780 2023-10-06T11:15:40.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.011+0000 7f0caf59e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb00c9a90 con 0x7f0cb00cb090 2023-10-06T11:15:40.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.011+0000 7f0caf59e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb00c9d40 con 0x7f0cb00b5640 2023-10-06T11:15:40.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.011+0000 7f0cae59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cb0068780 0x7f0cb00c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.011+0000 7f0cae59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cb0068780 0x7f0cb00c9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33702/0 (socket says 172.21.15.146:33702) 2023-10-06T11:15:40.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.011+0000 7f0cae59c700 1 -- 172.21.15.146:0/1442791479 learned_addr learned my addr 172.21.15.146:0/1442791479 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:40.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.012+0000 7f0ca5d9b700 1 --2- 172.21.15.146:0/1442791479 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cb00b5640 0x7f0cb00c9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.012+0000 7f0cae59c700 1 -- 172.21.15.146:0/1442791479 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cb00b5640 msgr2=0x7f0cb00c9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.012+0000 7f0cae59c700 1 --2- 172.21.15.146:0/1442791479 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cb00b5640 0x7f0cb00c9550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.012+0000 7f0caed9d700 1 --2- 172.21.15.146:0/1442791479 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0cb00cb090 0x7f0cb0169db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.012+0000 7f0cae59c700 1 -- 172.21.15.146:0/1442791479 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0cb00cb090 msgr2=0x7f0cb0169db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.012+0000 7f0cae59c700 1 --2- 172.21.15.146:0/1442791479 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0cb00cb090 0x7f0cb0169db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.012+0000 7f0cae59c700 1 -- 172.21.15.146:0/1442791479 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c98009420 con 0x7f0cb0068780 2023-10-06T11:15:40.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.012+0000 7f0cae59c700 1 --2- 172.21.15.146:0/1442791479 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cb0068780 0x7f0cb00c9010 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f0ca000c7e0 tx=0x7f0ca0007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:40.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.012+0000 7f0ca6ffd700 1 -- 172.21.15.146:0/1442791479 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca0005b30 con 0x7f0cb0068780 2023-10-06T11:15:40.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.012+0000 7f0ca6ffd700 1 -- 172.21.15.146:0/1442791479 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca0005c90 con 0x7f0cb0068780 2023-10-06T11:15:40.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.012+0000 7f0ca6ffd700 1 -- 172.21.15.146:0/1442791479 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca0007300 con 0x7f0cb0068780 2023-10-06T11:15:40.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.012+0000 7f0caf59e700 1 -- 172.21.15.146:0/1442791479 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cb016b020 con 0x7f0cb0068780 2023-10-06T11:15:40.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.012+0000 7f0caf59e700 1 -- 172.21.15.146:0/1442791479 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cb016b5e0 con 0x7f0cb0068780 2023-10-06T11:15:40.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.013+0000 7f0ca6ffd700 1 -- 172.21.15.146:0/1442791479 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0ca001b400 con 0x7f0cb0068780 2023-10-06T11:15:40.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.014+0000 7f0ca6ffd700 1 --2- 172.21.15.146:0/1442791479 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0c90066f30 0x7f0c900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.014+0000 7f0ca6ffd700 1 -- 172.21.15.146:0/1442791479 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0ca0084120 con 0x7f0cb0068780 2023-10-06T11:15:40.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.014+0000 7f0ca5d9b700 1 --2- 172.21.15.146:0/1442791479 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0c90066f30 0x7f0c900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.014+0000 7f0ca5d9b700 1 --2- 172.21.15.146:0/1442791479 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0c90066f30 0x7f0c900693e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0154980 tx=0x7f0c98017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:40.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.016+0000 7f0cbdb9cb80 1 Processor -- start 2023-10-06T11:15:40.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.016+0000 7f0cbdb9cb80 1 -- start start 2023-10-06T11:15:40.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.016+0000 7f0cbdb9cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604f0f71a50 0x5604f0f71e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.016+0000 7f0cbdb9cb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604f0fbbcc0 0x5604f0f9aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.016+0000 7f0cbdb9cb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604f0f9af60 0x5604f0f6da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.016+0000 7f0cbdb9cb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604f0ef1d80 con 0x5604f0fbbcc0 2023-10-06T11:15:40.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.016+0000 7f0cbdb9cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604f0ec8b70 con 0x5604f0f71a50 2023-10-06T11:15:40.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.016+0000 7f0cbdb9cb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5604f0ec6370 con 0x5604f0f9af60 2023-10-06T11:15:40.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.017+0000 7f0ca5d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604f0fbbcc0 0x5604f0f9aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.017+0000 7f0ca5d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604f0fbbcc0 0x5604f0f9aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33708/0 (socket says 172.21.15.146:33708) 2023-10-06T11:15:40.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.017+0000 7f0ca5d9b700 1 -- 172.21.15.146:0/1574235750 learned_addr learned my addr 172.21.15.146:0/1574235750 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:40.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.017+0000 7f0cae59c700 1 --2- 172.21.15.146:0/1574235750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604f0f71a50 0x5604f0f71e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.017+0000 7f0caed9d700 1 --2- 172.21.15.146:0/1574235750 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604f0f9af60 0x5604f0f6da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.017+0000 7f0ca5d9b700 1 -- 172.21.15.146:0/1574235750 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604f0f9af60 msgr2=0x5604f0f6da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:40.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.017+0000 7f0ca5d9b700 1 --2- 172.21.15.146:0/1574235750 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604f0f9af60 0x5604f0f6da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.017+0000 7f0ca5d9b700 1 -- 172.21.15.146:0/1574235750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604f0f71a50 msgr2=0x5604f0f71e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:40.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.017+0000 7f0ca5d9b700 1 --2- 172.21.15.146:0/1574235750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604f0f71a50 0x5604f0f71e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.017+0000 7f0ca5d9b700 1 -- 172.21.15.146:0/1574235750 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604f0d5c370 con 0x5604f0fbbcc0 2023-10-06T11:15:40.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.017+0000 7f0caed9d700 1 --2- 172.21.15.146:0/1574235750 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604f0f9af60 0x5604f0f6da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:40.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.017+0000 7f0ca5d9b700 1 --2- 172.21.15.146:0/1574235750 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604f0fbbcc0 0x5604f0f9aa20 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f0c980091e0 tx=0x7f0c9801e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=754addbb371ccb42 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:40.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.017+0000 7f0c8f7fe700 1 -- 172.21.15.146:0/1574235750 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9801c950 con 0x5604f0fbbcc0 2023-10-06T11:15:40.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.017+0000 7f0c8f7fe700 1 -- 172.21.15.146:0/1574235750 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9801cab0 con 0x5604f0fbbcc0 2023-10-06T11:15:40.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.017+0000 7f0c8f7fe700 1 -- 172.21.15.146:0/1574235750 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c9801ce30 con 0x5604f0fbbcc0 2023-10-06T11:15:40.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.018+0000 7f0cbdb9cb80 1 -- 172.21.15.146:0/1574235750 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604f0fbbcc0 msgr2=0x5604f0f9aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.018+0000 7f0cbdb9cb80 1 --2- 172.21.15.146:0/1574235750 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604f0fbbcc0 0x5604f0f9aa20 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f0c980091e0 tx=0x7f0c9801e040 comp rx=0 tx=0).stop 2023-10-06T11:15:40.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.018+0000 7f0cbdb9cb80 1 -- 172.21.15.146:0/1574235750 shutdown_connections 2023-10-06T11:15:40.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.018+0000 7f0cbdb9cb80 1 --2- 172.21.15.146:0/1574235750 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604f0f9af60 0x5604f0f6da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.018+0000 7f0cbdb9cb80 1 --2- 172.21.15.146:0/1574235750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604f0f71a50 0x5604f0f71e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.018+0000 7f0cbdb9cb80 1 --2- 172.21.15.146:0/1574235750 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604f0fbbcc0 0x5604f0f9aa20 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.018+0000 7f0cbdb9cb80 1 -- 172.21.15.146:0/1574235750 >> 172.21.15.146:0/1574235750 conn(0x5604f0f73370 msgr2=0x5604f0f73740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:40.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.018+0000 7f0cbdb9cb80 1 -- 172.21.15.146:0/1574235750 shutdown_connections 2023-10-06T11:15:40.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.018+0000 7f0cbdb9cb80 1 -- 172.21.15.146:0/1574235750 wait complete. 2023-10-06T11:15:40.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.019+0000 7f0cbdb9cb80 1 -- start start 2023-10-06T11:15:40.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.019+0000 7f0cbdb9cb80 1 Processor -- start 2023-10-06T11:15:40.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.020+0000 7f0cbdb9cb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604f0f71a50 0x5604f0fafbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.020+0000 7f0cbdb9cb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604f0f9af60 0x5604f0fb19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.020+0000 7f0cbdb9cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604f0fbbcc0 0x5604f0fb1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.020+0000 7f0cbdb9cb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604f0ec2160 con 0x5604f0f71a50 2023-10-06T11:15:40.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.020+0000 7f0cbdb9cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604f0e6d990 con 0x5604f0fbbcc0 2023-10-06T11:15:40.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.020+0000 7f0cbdb9cb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5604f0e88fa0 con 0x5604f0f9af60 2023-10-06T11:15:40.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.020+0000 7f0cae59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604f0f71a50 0x5604f0fafbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.020+0000 7f0cbdb9cb80 10 client.0 _ll_register_callbacks cb 0x5604f0d5f030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:15:40.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.020+0000 7f0cae59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604f0f71a50 0x5604f0fafbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33716/0 (socket says 172.21.15.146:33716) 2023-10-06T11:15:40.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.020+0000 7f0cae59c700 1 -- 172.21.15.146:0/2071618557 learned_addr learned my addr 172.21.15.146:0/2071618557 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:40.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.020+0000 7f0ca5d9b700 1 --2- 172.21.15.146:0/2071618557 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604f0f9af60 0x5604f0fb19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.020+0000 7f0caed9d700 1 --2- 172.21.15.146:0/2071618557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604f0fbbcc0 0x5604f0fb1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.020+0000 7f0cae59c700 1 -- 172.21.15.146:0/2071618557 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604f0f9af60 msgr2=0x5604f0fb19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:40.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.020+0000 7f0cae59c700 1 --2- 172.21.15.146:0/2071618557 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604f0f9af60 0x5604f0fb19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.020+0000 7f0cae59c700 1 -- 172.21.15.146:0/2071618557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604f0fbbcc0 msgr2=0x5604f0fb1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:40.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.020+0000 7f0cae59c700 1 --2- 172.21.15.146:0/2071618557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604f0fbbcc0 0x5604f0fb1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.020+0000 7f0cae59c700 1 -- 172.21.15.146:0/2071618557 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c98022070 con 0x5604f0f71a50 2023-10-06T11:15:40.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.020+0000 7f0cae59c700 1 --2- 172.21.15.146:0/2071618557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604f0f71a50 0x5604f0fafbe0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0007fd0 tx=0x7f0ca0014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98efe5cd77f2fe52 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:40.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.020+0000 7f0c8cff9700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:15:40.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.020+0000 7f0c8cff9700 1 -- 172.21.15.146:0/2071618557 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca0080070 con 0x5604f0f71a50 2023-10-06T11:15:40.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.020+0000 7f0c8cff9700 1 -- 172.21.15.146:0/2071618557 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(125..125 src has 1..125) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0ca005bf10 con 0x5604f0f71a50 2023-10-06T11:15:40.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.020+0000 7f0cbdb9cb80 1 -- 172.21.15.146:0/2071618557 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5604f0f66790 con 0x5604f0f71a50 2023-10-06T11:15:40.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.020+0000 7f0c8cff9700 1 -- 172.21.15.146:0/2071618557 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ca00822b0 con 0x5604f0f71a50 2023-10-06T11:15:40.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.020+0000 7f0cbdb9cb80 10 client.8910 fetch_fsmap learned FSMap version 108 2023-10-06T11:15:40.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.020+0000 7f0cbdb9cb80 1 -- 172.21.15.146:0/2071618557 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) v3 -- 0x5604f0cff0e0 con 0x5604f0f71a50 2023-10-06T11:15:40.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.020+0000 7f0c8cff9700 1 -- 172.21.15.146:0/2071618557 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5604f0f66790 con 0x5604f0f71a50 2023-10-06T11:15:40.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.021+0000 7f0c8cff9700 1 -- 172.21.15.146:0/2071618557 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 108) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0ca0055280 con 0x5604f0f71a50 2023-10-06T11:15:40.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.021+0000 7f0cbdb9cb80 10 client.8910 fetch_fsmap finished waiting for FSMap version 108 2023-10-06T11:15:40.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.021+0000 7f0cbdb9cb80 10 client.8910 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2023-10-06T11:15:40.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.021+0000 7f0cbdb9cb80 20 client.8910 populate_metadata read hostname 'smithi146' 2023-10-06T11:15:40.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.021+0000 7f0cbdb9cb80 1 --2- 172.21.15.146:0/2071618557 >> [v2:172.21.15.146:6835/1974709597,v1:172.21.15.146:6837/1974709597] conn(0x5604f0fb3780 0x5604f0fb3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.021+0000 7f0cbdb9cb80 4 client.8910 mds_command: new command op to 8682 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:15:40.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.021+0000 7f0cbdb9cb80 1 -- 172.21.15.146:0/2071618557 --> [v2:172.21.15.146:6835/1974709597,v1:172.21.15.146:6837/1974709597] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5604f0f436c0 con 0x5604f0fb3780 2023-10-06T11:15:40.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.021+0000 7f0ca5d9b700 1 --2- 172.21.15.146:0/2071618557 >> [v2:172.21.15.146:6835/1974709597,v1:172.21.15.146:6837/1974709597] conn(0x5604f0fb3780 0x5604f0fb3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.021+0000 7f0c8cff9700 10 client.8910 ms_handle_connect on v2:172.21.15.146:6835/1974709597 2023-10-06T11:15:40.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.021+0000 7f0ca5d9b700 1 --2- 172.21.15.146:0/2071618557 >> [v2:172.21.15.146:6835/1974709597,v1:172.21.15.146:6837/1974709597] conn(0x5604f0fb3780 0x5604f0fb3b80 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9de989e02a3ea server_cookie=92a628df6af49113 in_seq=0 out_seq=0 2023-10-06T11:15:40.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.022+0000 7f0c8cff9700 1 -- 172.21.15.146:0/2071618557 <== mds.0 v2:172.21.15.146:6835/1974709597 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5604f0f436c0 con 0x5604f0fb3780 2023-10-06T11:15:40.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.022+0000 7f0c8cff9700 10 client.8910 handle_command_reply: tid=0 2023-10-06T11:15:40.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.022+0000 7f0cbdb9cb80 1 client.8910 shutdown 2023-10-06T11:15:40.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.022+0000 7f0cbdb9cb80 1 -- 172.21.15.146:0/2071618557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604f0f71a50 msgr2=0x5604f0fafbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.022+0000 7f0cbdb9cb80 1 --2- 172.21.15.146:0/2071618557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604f0f71a50 0x5604f0fafbe0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0007fd0 tx=0x7f0ca0014040 comp rx=0 tx=0).stop 2023-10-06T11:15:40.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.022+0000 7f0cbdb9cb80 1 -- 172.21.15.146:0/2071618557 shutdown_connections 2023-10-06T11:15:40.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.022+0000 7f0cbdb9cb80 1 --2- 172.21.15.146:0/2071618557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604f0fbbcc0 0x5604f0fb1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.022+0000 7f0cbdb9cb80 1 --2- 172.21.15.146:0/2071618557 >> [v2:172.21.15.146:6835/1974709597,v1:172.21.15.146:6837/1974709597] conn(0x5604f0fb3780 0x5604f0fb3b80 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.022+0000 7f0cbdb9cb80 1 --2- 172.21.15.146:0/2071618557 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604f0f71a50 0x5604f0fafbe0 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.022+0000 7f0cbdb9cb80 1 --2- 172.21.15.146:0/2071618557 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604f0f9af60 0x5604f0fb19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.022+0000 7f0c8cff9700 0 client.8910 ms_handle_reset on v2:172.21.15.146:6835/1974709597 2023-10-06T11:15:40.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.022+0000 7f0cbdb9cb80 1 -- 172.21.15.146:0/2071618557 >> 172.21.15.146:0/2071618557 conn(0x5604f0f73370 msgr2=0x5604f0f682a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:40.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.022+0000 7f0cbdb9cb80 1 -- 172.21.15.146:0/2071618557 shutdown_connections 2023-10-06T11:15:40.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.022+0000 7f0cbdb9cb80 1 -- 172.21.15.146:0/2071618557 wait complete. 2023-10-06T11:15:40.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.022+0000 7f0cbdb9cb80 20 client.8910 trim_cache size 0 max 16384 2023-10-06T11:15:40.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.039+0000 7f0cbdb9cb80 1 Processor -- start 2023-10-06T11:15:40.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.039+0000 7f0cbdb9cb80 1 -- start start 2023-10-06T11:15:40.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.040+0000 7f0cbdb9cb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604f0f73370 0x5604f0fb4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.040+0000 7f0cbdb9cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604f0f71a50 0x5604f0fb1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.040+0000 7f0cbdb9cb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604f0f9af60 0x5604f0fb75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.040+0000 7f0cbdb9cb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604f0f70d40 con 0x5604f0f9af60 2023-10-06T11:15:40.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.040+0000 7f0cbdb9cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604f0d44f30 con 0x5604f0f71a50 2023-10-06T11:15:40.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.040+0000 7f0cbdb9cb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5604f0f72750 con 0x5604f0f73370 2023-10-06T11:15:40.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.040+0000 7f0caed9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604f0f9af60 0x5604f0fb75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.040+0000 7f0caed9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604f0f9af60 0x5604f0fb75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33726/0 (socket says 172.21.15.146:33726) 2023-10-06T11:15:40.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.040+0000 7f0caed9d700 1 -- 172.21.15.146:0/1441265593 learned_addr learned my addr 172.21.15.146:0/1441265593 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:40.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.040+0000 7f0cae59c700 1 --2- 172.21.15.146:0/1441265593 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604f0f73370 0x5604f0fb4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.040+0000 7f0ca5d9b700 1 --2- 172.21.15.146:0/1441265593 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604f0f71a50 0x5604f0fb1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.040+0000 7f0cae59c700 1 -- 172.21.15.146:0/1441265593 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604f0f71a50 msgr2=0x5604f0fb1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:40.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.040+0000 7f0cae59c700 1 --2- 172.21.15.146:0/1441265593 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604f0f71a50 0x5604f0fb1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.040+0000 7f0cae59c700 1 -- 172.21.15.146:0/1441265593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604f0f9af60 msgr2=0x5604f0fb75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:40.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.040+0000 7f0cae59c700 1 --2- 172.21.15.146:0/1441265593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604f0f9af60 0x5604f0fb75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.040+0000 7f0cae59c700 1 -- 172.21.15.146:0/1441265593 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604f0e90880 con 0x5604f0f73370 2023-10-06T11:15:40.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.040+0000 7f0caed9d700 1 --2- 172.21.15.146:0/1441265593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604f0f9af60 0x5604f0fb75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:15:40.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.041+0000 7f0cae59c700 1 --2- 172.21.15.146:0/1441265593 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604f0f73370 0x5604f0fb4100 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0051520 tx=0x7f0ca001d030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ee235e7aef9ae65 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:40.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.041+0000 7f0c8ffff700 1 -- 172.21.15.146:0/1441265593 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca0080040 con 0x5604f0f73370 2023-10-06T11:15:40.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.041+0000 7f0c8ffff700 1 -- 172.21.15.146:0/1441265593 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca00822b0 con 0x5604f0f73370 2023-10-06T11:15:40.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.041+0000 7f0c8ffff700 1 -- 172.21.15.146:0/1441265593 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca0054df0 con 0x5604f0f73370 2023-10-06T11:15:40.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.041+0000 7f0cbdb9cb80 1 -- 172.21.15.146:0/1441265593 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604f0f73370 msgr2=0x5604f0fb4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.041+0000 7f0cbdb9cb80 1 --2- 172.21.15.146:0/1441265593 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604f0f73370 0x5604f0fb4100 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0051520 tx=0x7f0ca001d030 comp rx=0 tx=0).stop 2023-10-06T11:15:40.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.041+0000 7f0cbdb9cb80 1 -- 172.21.15.146:0/1441265593 shutdown_connections 2023-10-06T11:15:40.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.041+0000 7f0cbdb9cb80 1 --2- 172.21.15.146:0/1441265593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604f0f9af60 0x5604f0fb75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.041+0000 7f0cbdb9cb80 1 --2- 172.21.15.146:0/1441265593 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604f0f73370 0x5604f0fb4100 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.041+0000 7f0cbdb9cb80 1 --2- 172.21.15.146:0/1441265593 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604f0f71a50 0x5604f0fb1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.041+0000 7f0cbdb9cb80 1 -- 172.21.15.146:0/1441265593 >> 172.21.15.146:0/1441265593 conn(0x5604f0f710b0 msgr2=0x5604f0fbb540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:40.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.041+0000 7f0cbdb9cb80 1 -- 172.21.15.146:0/1441265593 shutdown_connections 2023-10-06T11:15:40.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.041+0000 7f0cbdb9cb80 1 -- 172.21.15.146:0/1441265593 wait complete. 2023-10-06T11:15:40.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.042+0000 7f0cbdb9cb80 1 -- start start 2023-10-06T11:15:40.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.042+0000 7f0cbdb9cb80 1 Processor -- start 2023-10-06T11:15:40.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.043+0000 7f0cbdb9cb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604f0f71a50 0x5604f101df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.043+0000 7f0cbdb9cb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604f0f73370 0x5604f0fb4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.043+0000 7f0cbdb9cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604f0f9af60 0x5604f0fb8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.043+0000 7f0cbdb9cb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604f0fb4c50 con 0x5604f0f73370 2023-10-06T11:15:40.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.043+0000 7f0cbdb9cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604f101fdf0 con 0x5604f0f9af60 2023-10-06T11:15:40.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.043+0000 7f0cbdb9cb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5604f0fc9660 con 0x5604f0f71a50 2023-10-06T11:15:40.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.043+0000 7f0cbdb9cb80 10 client.0 _ll_register_callbacks cb 0x5604f0d5f030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:15:40.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.043+0000 7f0ca5d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604f0f73370 0x5604f0fb4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.043+0000 7f0ca5d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604f0f73370 0x5604f0fb4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33740/0 (socket says 172.21.15.146:33740) 2023-10-06T11:15:40.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.043+0000 7f0ca5d9b700 1 -- 172.21.15.146:0/930506369 learned_addr learned my addr 172.21.15.146:0/930506369 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:40.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.043+0000 7f0cae59c700 1 --2- 172.21.15.146:0/930506369 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604f0f71a50 0x5604f101df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.043+0000 7f0caed9d700 1 --2- 172.21.15.146:0/930506369 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604f0f9af60 0x5604f0fb8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.043+0000 7f0ca5d9b700 1 -- 172.21.15.146:0/930506369 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604f0f71a50 msgr2=0x5604f101df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:40.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.043+0000 7f0ca5d9b700 1 --2- 172.21.15.146:0/930506369 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604f0f71a50 0x5604f101df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.043+0000 7f0ca5d9b700 1 -- 172.21.15.146:0/930506369 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604f0f9af60 msgr2=0x5604f0fb8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:40.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.043+0000 7f0ca5d9b700 1 --2- 172.21.15.146:0/930506369 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604f0f9af60 0x5604f0fb8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.043+0000 7f0ca5d9b700 1 -- 172.21.15.146:0/930506369 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca8013370 con 0x5604f0f73370 2023-10-06T11:15:40.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.043+0000 7f0ca5d9b700 1 --2- 172.21.15.146:0/930506369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604f0f73370 0x5604f0fb4fc0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f0c980091e0 tx=0x7f0c98033040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce01bd4e706347fe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:40.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.043+0000 7f0c8cff9700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:15:40.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.044+0000 7f0c8cff9700 1 -- 172.21.15.146:0/930506369 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c98037040 con 0x5604f0f73370 2023-10-06T11:15:40.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.044+0000 7f0cbdb9cb80 1 -- 172.21.15.146:0/930506369 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0c9801cab0 con 0x5604f0f73370 2023-10-06T11:15:40.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.044+0000 7f0c8cff9700 1 -- 172.21.15.146:0/930506369 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(125..125 src has 1..125) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0c98044070 con 0x5604f0f73370 2023-10-06T11:15:40.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.044+0000 7f0c8cff9700 1 -- 172.21.15.146:0/930506369 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c9801aa60 con 0x5604f0f73370 2023-10-06T11:15:40.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.044+0000 7f0cbdb9cb80 10 client.8916 fetch_fsmap learned FSMap version 108 2023-10-06T11:15:40.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.044+0000 7f0cbdb9cb80 1 -- 172.21.15.146:0/930506369 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) v3 -- 0x5604f0cff0e0 con 0x5604f0f73370 2023-10-06T11:15:40.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.044+0000 7f0c8cff9700 1 -- 172.21.15.146:0/930506369 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c9801cab0 con 0x5604f0f73370 2023-10-06T11:15:40.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.044+0000 7f0c8cff9700 1 -- 172.21.15.146:0/930506369 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 108) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f0c9801abc0 con 0x5604f0f73370 2023-10-06T11:15:40.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.044+0000 7f0cbdb9cb80 10 client.8916 fetch_fsmap finished waiting for FSMap version 108 2023-10-06T11:15:40.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.044+0000 7f0cbdb9cb80 10 client.8916 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2023-10-06T11:15:40.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.044+0000 7f0cbdb9cb80 20 client.8916 populate_metadata read hostname 'smithi146' 2023-10-06T11:15:40.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.044+0000 7f0cbdb9cb80 1 --2- 172.21.15.146:0/930506369 >> [v2:172.21.15.146:6835/1974709597,v1:172.21.15.146:6837/1974709597] conn(0x5604f0fbbcc0 0x5604f0fb8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.044+0000 7f0cbdb9cb80 4 client.8916 mds_command: new command op to 8682 tid=0[{"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}] 2023-10-06T11:15:40.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.044+0000 7f0cbdb9cb80 1 -- 172.21.15.146:0/930506369 --> [v2:172.21.15.146:6835/1974709597,v1:172.21.15.146:6837/1974709597] -- command(tid 0: {"prefix": "scrub start", "path": "/scrub_control_test_path", "scrubops": ["recursive"]}) v1 -- 0x5604f0e64f00 con 0x5604f0fbbcc0 2023-10-06T11:15:40.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.044+0000 7f0cae59c700 1 --2- 172.21.15.146:0/930506369 >> [v2:172.21.15.146:6835/1974709597,v1:172.21.15.146:6837/1974709597] conn(0x5604f0fbbcc0 0x5604f0fb8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.045+0000 7f0c8cff9700 10 client.8916 ms_handle_connect on v2:172.21.15.146:6835/1974709597 2023-10-06T11:15:40.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.045+0000 7f0cae59c700 1 --2- 172.21.15.146:0/930506369 >> [v2:172.21.15.146:6835/1974709597,v1:172.21.15.146:6837/1974709597] conn(0x5604f0fbbcc0 0x5604f0fb8b90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ad83dd12a24d2b8 server_cookie=bb653aa6f84936af in_seq=0 out_seq=0 2023-10-06T11:15:40.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.048+0000 7f0c8cff9700 1 -- 172.21.15.146:0/930506369 <== mds.0 v2:172.21.15.146:6835/1974709597 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5604f0e64f00 con 0x5604f0fbbcc0 2023-10-06T11:15:40.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.048+0000 7f0c8cff9700 10 client.8916 handle_command_reply: tid=0 2023-10-06T11:15:40.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.048+0000 7f0cbdb9cb80 1 client.8916 shutdown 2023-10-06T11:15:40.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.049+0000 7f0cbdb9cb80 1 -- 172.21.15.146:0/930506369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604f0f73370 msgr2=0x5604f0fb4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.049+0000 7f0cbdb9cb80 1 --2- 172.21.15.146:0/930506369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604f0f73370 0x5604f0fb4fc0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f0c980091e0 tx=0x7f0c98033040 comp rx=0 tx=0).stop 2023-10-06T11:15:40.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.049+0000 7f0cbdb9cb80 1 -- 172.21.15.146:0/930506369 shutdown_connections 2023-10-06T11:15:40.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.049+0000 7f0cbdb9cb80 1 --2- 172.21.15.146:0/930506369 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5604f0f9af60 0x5604f0fb8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.049+0000 7f0cbdb9cb80 1 --2- 172.21.15.146:0/930506369 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5604f0f71a50 0x5604f101df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.049+0000 7f0cbdb9cb80 1 --2- 172.21.15.146:0/930506369 >> [v2:172.21.15.146:6835/1974709597,v1:172.21.15.146:6837/1974709597] conn(0x5604f0fbbcc0 0x5604f0fb8b90 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.049+0000 7f0cbdb9cb80 1 --2- 172.21.15.146:0/930506369 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5604f0f73370 0x5604f0fb4fc0 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.049+0000 7f0cbdb9cb80 1 -- 172.21.15.146:0/930506369 >> 172.21.15.146:0/930506369 conn(0x5604f0f710b0 msgr2=0x5604f0fb2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:40.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.049+0000 7f0c8cff9700 0 client.8916 ms_handle_reset on v2:172.21.15.146:6835/1974709597 2023-10-06T11:15:40.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.049+0000 7f0cbdb9cb80 1 -- 172.21.15.146:0/930506369 shutdown_connections 2023-10-06T11:15:40.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.049+0000 7f0cbdb9cb80 1 -- 172.21.15.146:0/930506369 wait complete. 2023-10-06T11:15:40.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.049+0000 7f0cbdb9cb80 20 client.8916 trim_cache size 0 max 16384 2023-10-06T11:15:40.055 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:15:40.056 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0, 2023-10-06T11:15:40.056 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_tag": "2b054de5-fb0b-4daa-882e-0db701411e36", 2023-10-06T11:15:40.056 INFO:teuthology.orchestra.run.smithi146.stdout: "mode": "asynchronous" 2023-10-06T11:15:40.056 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:15:40.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.049+0000 7f0caf59e700 1 -- 172.21.15.146:0/1442791479 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0c90066f30 msgr2=0x7f0c900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.049+0000 7f0caf59e700 1 --2- 172.21.15.146:0/1442791479 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0c90066f30 0x7f0c900693e0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0154980 tx=0x7f0c98017000 comp rx=0 tx=0).stop 2023-10-06T11:15:40.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.049+0000 7f0caf59e700 1 -- 172.21.15.146:0/1442791479 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cb0068780 msgr2=0x7f0cb00c9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.049+0000 7f0caf59e700 1 --2- 172.21.15.146:0/1442791479 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cb0068780 0x7f0cb00c9010 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f0ca000c7e0 tx=0x7f0ca0007df0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.049+0000 7f0caf59e700 1 -- 172.21.15.146:0/1442791479 shutdown_connections 2023-10-06T11:15:40.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.049+0000 7f0caf59e700 1 --2- 172.21.15.146:0/1442791479 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0c90066f30 0x7f0c900693e0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.049+0000 7f0caf59e700 1 --2- 172.21.15.146:0/1442791479 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0cb00cb090 0x7f0cb0169db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.049+0000 7f0caf59e700 1 --2- 172.21.15.146:0/1442791479 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0cb0068780 0x7f0cb00c9010 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.049+0000 7f0caf59e700 1 --2- 172.21.15.146:0/1442791479 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0cb00b5640 0x7f0cb00c9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.049+0000 7f0caf59e700 1 -- 172.21.15.146:0/1442791479 >> 172.21.15.146:0/1442791479 conn(0x7f0cb00703f0 msgr2=0x7f0cb015c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:40.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.050+0000 7f0caf59e700 1 -- 172.21.15.146:0/1442791479 shutdown_connections 2023-10-06T11:15:40.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.050+0000 7f0caf59e700 1 -- 172.21.15.146:0/1442791479 wait complete. 2023-10-06T11:15:40.065 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.9:0 scrub pause 2023-10-06T11:15:40.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.218+0000 7f3eead89700 1 Processor -- start 2023-10-06T11:15:40.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.218+0000 7f3eead89700 1 -- start start 2023-10-06T11:15:40.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.219+0000 7f3eead89700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3ee415cff0 0x7f3ee415d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.219+0000 7f3eead89700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3ee40d0c50 0x7f3ee415a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.219+0000 7f3eead89700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ee40cf030 con 0x7f3ee415cc20 2023-10-06T11:15:40.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.219+0000 7f3eead89700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ee415e390 con 0x7f3ee415cff0 2023-10-06T11:15:40.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.219+0000 7f3eead89700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ee40ced20 con 0x7f3ee40d0c50 2023-10-06T11:15:40.223 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.219+0000 7f3ee8b25700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3ee415cc20 0x7f3ee40d0540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55978/0 (socket says 172.21.15.146:55978) 2023-10-06T11:15:40.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.219+0000 7f3ee8b25700 1 -- 172.21.15.146:0/2802831969 learned_addr learned my addr 172.21.15.146:0/2802831969 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:15:40.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.219+0000 7f3ee3fff700 1 --2- 172.21.15.146:0/2802831969 >> v2:172.21.15.146:3300/0 conn(0x7f3ee415cff0 0x7f3ee415d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.219+0000 7f3ee9326700 1 --2- 172.21.15.146:0/2802831969 >> v2:172.21.15.151:3300/0 conn(0x7f3ee40d0c50 0x7f3ee415a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.219+0000 7f3ee3fff700 1 -- 172.21.15.146:0/2802831969 >> v2:172.21.15.151:3300/0 conn(0x7f3ee40d0c50 msgr2=0x7f3ee415a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:40.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.219+0000 7f3ee3fff700 1 --2- 172.21.15.146:0/2802831969 >> v2:172.21.15.151:3300/0 conn(0x7f3ee40d0c50 0x7f3ee415a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.220+0000 7f3ee3fff700 1 -- 172.21.15.146:0/2802831969 >> v1:172.21.15.146:6789/0 conn(0x7f3ee415cc20 legacy=0x7f3ee40d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.220+0000 7f3ee37fe700 1 -- 172.21.15.146:0/2802831969 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1289507562 0 0) 0x7f3ee40cf030 con 0x7f3ee415cc20 2023-10-06T11:15:40.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.220+0000 7f3ee3fff700 1 -- 172.21.15.146:0/2802831969 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee415daf0 con 0x7f3ee415cff0 2023-10-06T11:15:40.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.220+0000 7f3ee3fff700 1 --2- 172.21.15.146:0/2802831969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ee415cff0 0x7f3ee415d460 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f3ee415e590 tx=0x7f3ed00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed4607cf6c42bff server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:40.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.220+0000 7f3ee37fe700 1 -- 172.21.15.146:0/2802831969 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed000b6b0 con 0x7f3ee415cff0 2023-10-06T11:15:40.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.220+0000 7f3ee37fe700 1 -- 172.21.15.146:0/2802831969 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed000b810 con 0x7f3ee415cff0 2023-10-06T11:15:40.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.220+0000 7f3ee37fe700 1 -- 172.21.15.146:0/2802831969 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed000bbb0 con 0x7f3ee415cff0 2023-10-06T11:15:40.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.220+0000 7f3eead89700 1 -- 172.21.15.146:0/2802831969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ee415cff0 msgr2=0x7f3ee415d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.220+0000 7f3eead89700 1 --2- 172.21.15.146:0/2802831969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ee415cff0 0x7f3ee415d460 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f3ee415e590 tx=0x7f3ed00091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.220+0000 7f3eead89700 1 -- 172.21.15.146:0/2802831969 shutdown_connections 2023-10-06T11:15:40.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.220+0000 7f3eead89700 1 --2- 172.21.15.146:0/2802831969 >> v2:172.21.15.151:3300/0 conn(0x7f3ee40d0c50 0x7f3ee415a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.220+0000 7f3eead89700 1 --2- 172.21.15.146:0/2802831969 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ee415cff0 0x7f3ee415d460 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.220+0000 7f3eead89700 1 -- 172.21.15.146:0/2802831969 >> 172.21.15.146:0/2802831969 conn(0x7f3ee406eba0 msgr2=0x7f3ee406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:40.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.220+0000 7f3eead89700 1 -- 172.21.15.146:0/2802831969 shutdown_connections 2023-10-06T11:15:40.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.220+0000 7f3eead89700 1 -- 172.21.15.146:0/2802831969 wait complete. 2023-10-06T11:15:40.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.221+0000 7f3eead89700 1 Processor -- start 2023-10-06T11:15:40.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.222+0000 7f3eead89700 1 -- start start 2023-10-06T11:15:40.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.222+0000 7f3eead89700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ee40d0c50 0x7f3ee416b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.222+0000 7f3eead89700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ee415cc20 0x7f3ee416dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.222+0000 7f3eead89700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ee415cff0 0x7f3ee4151610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.222+0000 7f3eead89700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee416bb00 con 0x7f3ee415cc20 2023-10-06T11:15:40.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.222+0000 7f3eead89700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee413db50 con 0x7f3ee40d0c50 2023-10-06T11:15:40.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.222+0000 7f3eead89700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee40b0d20 con 0x7f3ee415cff0 2023-10-06T11:15:40.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.222+0000 7f3ee3fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ee415cc20 0x7f3ee416dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.223+0000 7f3ee3fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ee415cc20 0x7f3ee416dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33766/0 (socket says 172.21.15.146:33766) 2023-10-06T11:15:40.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.223+0000 7f3ee3fff700 1 -- 172.21.15.146:0/3662634567 learned_addr learned my addr 172.21.15.146:0/3662634567 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:40.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.223+0000 7f3ee8b25700 1 --2- 172.21.15.146:0/3662634567 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ee40d0c50 0x7f3ee416b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.223+0000 7f3ee9326700 1 --2- 172.21.15.146:0/3662634567 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ee415cff0 0x7f3ee4151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.223+0000 7f3ee3fff700 1 -- 172.21.15.146:0/3662634567 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ee415cff0 msgr2=0x7f3ee4151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.223+0000 7f3ee3fff700 1 --2- 172.21.15.146:0/3662634567 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ee415cff0 0x7f3ee4151610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.223+0000 7f3ee3fff700 1 -- 172.21.15.146:0/3662634567 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ee40d0c50 msgr2=0x7f3ee416b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.223+0000 7f3ee3fff700 1 --2- 172.21.15.146:0/3662634567 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ee40d0c50 0x7f3ee416b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.223+0000 7f3ee3fff700 1 -- 172.21.15.146:0/3662634567 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed0009420 con 0x7f3ee415cc20 2023-10-06T11:15:40.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.223+0000 7f3ee8b25700 1 --2- 172.21.15.146:0/3662634567 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ee40d0c50 0x7f3ee416b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:40.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.223+0000 7f3ee3fff700 1 --2- 172.21.15.146:0/3662634567 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ee415cc20 0x7f3ee416dd00 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0013000 tx=0x7f3ed0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:40.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.223+0000 7f3ee0ff9700 1 -- 172.21.15.146:0/3662634567 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed000b980 con 0x7f3ee415cc20 2023-10-06T11:15:40.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.223+0000 7f3ee0ff9700 1 -- 172.21.15.146:0/3662634567 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed000bb00 con 0x7f3ee415cc20 2023-10-06T11:15:40.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.223+0000 7f3eead89700 1 -- 172.21.15.146:0/3662634567 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ee4152040 con 0x7f3ee415cc20 2023-10-06T11:15:40.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.223+0000 7f3ee0ff9700 1 -- 172.21.15.146:0/3662634567 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed0025670 con 0x7f3ee415cc20 2023-10-06T11:15:40.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.223+0000 7f3eead89700 1 -- 172.21.15.146:0/3662634567 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ee40b1530 con 0x7f3ee415cc20 2023-10-06T11:15:40.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.225+0000 7f3ee0ff9700 1 -- 172.21.15.146:0/3662634567 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3ed0023070 con 0x7f3ee415cc20 2023-10-06T11:15:40.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.225+0000 7f3ee0ff9700 1 --2- 172.21.15.146:0/3662634567 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3ec8066f30 0x7f3ec80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.225+0000 7f3ee8b25700 1 --2- 172.21.15.146:0/3662634567 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3ec8066f30 0x7f3ec80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.225+0000 7f3ee0ff9700 1 -- 172.21.15.146:0/3662634567 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3ed0085cd0 con 0x7f3ee415cc20 2023-10-06T11:15:40.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.225+0000 7f3ee8b25700 1 --2- 172.21.15.146:0/3662634567 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3ec8066f30 0x7f3ec80693e0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f3ee40af220 tx=0x7f3ed8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:40.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.227+0000 7f3ef4081b80 1 Processor -- start 2023-10-06T11:15:40.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.227+0000 7f3ef4081b80 1 -- start start 2023-10-06T11:15:40.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.228+0000 7f3ef4081b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5da2fad0 0x557b5da2fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.228+0000 7f3ef4081b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557b5d9eb9e0 0x557b5d9e85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.228+0000 7f3ef4081b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b5d9e9c10 0x557b5d9e8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.228+0000 7f3ef4081b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b5d968cc0 con 0x557b5d9e9c10 2023-10-06T11:15:40.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.228+0000 7f3ef4081b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b5d93fab0 con 0x557b5da2fad0 2023-10-06T11:15:40.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.228+0000 7f3ef4081b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x557b5d93d2b0 con 0x557b5d9eb9e0 2023-10-06T11:15:40.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.228+0000 7f3ee9326700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b5d9e9c10 0x557b5d9e8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.228+0000 7f3ee9326700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b5d9e9c10 0x557b5d9e8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33780/0 (socket says 172.21.15.146:33780) 2023-10-06T11:15:40.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.228+0000 7f3ee9326700 1 -- 172.21.15.146:0/905368150 learned_addr learned my addr 172.21.15.146:0/905368150 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:40.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.228+0000 7f3ee8b25700 1 --2- 172.21.15.146:0/905368150 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5da2fad0 0x557b5da2fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.228+0000 7f3ee3fff700 1 --2- 172.21.15.146:0/905368150 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557b5d9eb9e0 0x557b5d9e85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.228+0000 7f3ee9326700 1 -- 172.21.15.146:0/905368150 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557b5d9eb9e0 msgr2=0x557b5d9e85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:40.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.228+0000 7f3ee9326700 1 --2- 172.21.15.146:0/905368150 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557b5d9eb9e0 0x557b5d9e85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.228+0000 7f3ee9326700 1 -- 172.21.15.146:0/905368150 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5da2fad0 msgr2=0x557b5da2fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:40.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.228+0000 7f3ee9326700 1 --2- 172.21.15.146:0/905368150 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5da2fad0 0x557b5da2fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.228+0000 7f3ee9326700 1 -- 172.21.15.146:0/905368150 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b5d7d32b0 con 0x557b5d9e9c10 2023-10-06T11:15:40.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.228+0000 7f3ee9326700 1 --2- 172.21.15.146:0/905368150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b5d9e9c10 0x557b5d9e8b00 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f3edc007370 tx=0x7f3edc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95953ade9a4858a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:40.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.228+0000 7f3ecdffb700 1 -- 172.21.15.146:0/905368150 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3edc007e00 con 0x557b5d9e9c10 2023-10-06T11:15:40.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.228+0000 7f3ecdffb700 1 -- 172.21.15.146:0/905368150 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3edc00f050 con 0x557b5d9e9c10 2023-10-06T11:15:40.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.228+0000 7f3ecdffb700 1 -- 172.21.15.146:0/905368150 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3edc0147f0 con 0x557b5d9e9c10 2023-10-06T11:15:40.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.229+0000 7f3ef4081b80 1 -- 172.21.15.146:0/905368150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b5d9e9c10 msgr2=0x557b5d9e8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.240 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.229+0000 7f3ef4081b80 1 --2- 172.21.15.146:0/905368150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b5d9e9c10 0x557b5d9e8b00 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f3edc007370 tx=0x7f3edc00b040 comp rx=0 tx=0).stop 2023-10-06T11:15:40.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.229+0000 7f3ef4081b80 1 -- 172.21.15.146:0/905368150 shutdown_connections 2023-10-06T11:15:40.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.229+0000 7f3ef4081b80 1 --2- 172.21.15.146:0/905368150 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b5d9e9c10 0x557b5d9e8b00 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.229+0000 7f3ef4081b80 1 --2- 172.21.15.146:0/905368150 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5da2fad0 0x557b5da2fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.229+0000 7f3ef4081b80 1 --2- 172.21.15.146:0/905368150 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557b5d9eb9e0 0x557b5d9e85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.229+0000 7f3ef4081b80 1 -- 172.21.15.146:0/905368150 >> 172.21.15.146:0/905368150 conn(0x557b5d9ea0b0 msgr2=0x557b5d9ea480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:40.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.229+0000 7f3ef4081b80 1 -- 172.21.15.146:0/905368150 shutdown_connections 2023-10-06T11:15:40.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.229+0000 7f3ef4081b80 1 -- 172.21.15.146:0/905368150 wait complete. 2023-10-06T11:15:40.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.229+0000 7f3ef4081b80 1 -- start start 2023-10-06T11:15:40.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.230+0000 7f3ef4081b80 1 Processor -- start 2023-10-06T11:15:40.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.230+0000 7f3ef4081b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b5d9e9c10 0x557b5da3f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.230+0000 7f3ef4081b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557b5d9eb9e0 0x557b5d9e86c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.230+0000 7f3ef4081b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5da2fad0 0x557b5d9e8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.230+0000 7f3ef4081b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b5d9390a0 con 0x557b5d9e9c10 2023-10-06T11:15:40.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.230+0000 7f3ef4081b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b5d8e48d0 con 0x557b5da2fad0 2023-10-06T11:15:40.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.230+0000 7f3ef4081b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x557b5d8ffee0 con 0x557b5d9eb9e0 2023-10-06T11:15:40.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.231+0000 7f3ef4081b80 10 client.0 _ll_register_callbacks cb 0x557b5d7d5f70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:15:40.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.231+0000 7f3ee8b25700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b5d9e9c10 0x557b5da3f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.231+0000 7f3ee8b25700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b5d9e9c10 0x557b5da3f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33784/0 (socket says 172.21.15.146:33784) 2023-10-06T11:15:40.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.231+0000 7f3ee8b25700 1 -- 172.21.15.146:0/2474414934 learned_addr learned my addr 172.21.15.146:0/2474414934 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:40.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.231+0000 7f3ee9326700 1 --2- 172.21.15.146:0/2474414934 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5da2fad0 0x557b5d9e8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.231+0000 7f3ee3fff700 1 --2- 172.21.15.146:0/2474414934 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557b5d9eb9e0 0x557b5d9e86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.231+0000 7f3ee8b25700 1 -- 172.21.15.146:0/2474414934 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557b5d9eb9e0 msgr2=0x557b5d9e86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:40.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.231+0000 7f3ee8b25700 1 --2- 172.21.15.146:0/2474414934 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557b5d9eb9e0 0x557b5d9e86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.231+0000 7f3ee8b25700 1 -- 172.21.15.146:0/2474414934 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5da2fad0 msgr2=0x557b5d9e8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:40.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.231+0000 7f3ee8b25700 1 --2- 172.21.15.146:0/2474414934 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5da2fad0 0x557b5d9e8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.231+0000 7f3ee8b25700 1 -- 172.21.15.146:0/2474414934 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3edc009cc0 con 0x557b5d9e9c10 2023-10-06T11:15:40.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.231+0000 7f3ee8b25700 1 --2- 172.21.15.146:0/2474414934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b5d9e9c10 0x557b5da3f480 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f3ed80059a0 tx=0x7f3ed8017040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=489901f8483dcac0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:40.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.231+0000 7f3ec2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:15:40.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.231+0000 7f3ec2ffd700 1 -- 172.21.15.146:0/2474414934 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed800e9c0 con 0x557b5d9e9c10 2023-10-06T11:15:40.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.231+0000 7f3ec2ffd700 1 -- 172.21.15.146:0/2474414934 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(125..125 src has 1..125) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3ed8021bf0 con 0x557b5d9e9c10 2023-10-06T11:15:40.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.231+0000 7f3ef4081b80 1 -- 172.21.15.146:0/2474414934 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557b5d9dd6d0 con 0x557b5d9e9c10 2023-10-06T11:15:40.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.231+0000 7f3ec2ffd700 1 -- 172.21.15.146:0/2474414934 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ed800eb20 con 0x557b5d9e9c10 2023-10-06T11:15:40.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.231+0000 7f3ef4081b80 10 client.8931 fetch_fsmap learned FSMap version 108 2023-10-06T11:15:40.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.231+0000 7f3ef4081b80 1 -- 172.21.15.146:0/2474414934 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) v3 -- 0x557b5d776020 con 0x557b5d9e9c10 2023-10-06T11:15:40.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.231+0000 7f3ec2ffd700 1 -- 172.21.15.146:0/2474414934 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557b5d9dd6d0 con 0x557b5d9e9c10 2023-10-06T11:15:40.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.232+0000 7f3ec2ffd700 1 -- 172.21.15.146:0/2474414934 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 108) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3ed800ec80 con 0x557b5d9e9c10 2023-10-06T11:15:40.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.232+0000 7f3ef4081b80 10 client.8931 fetch_fsmap finished waiting for FSMap version 108 2023-10-06T11:15:40.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.232+0000 7f3ef4081b80 10 client.8931 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2023-10-06T11:15:40.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.232+0000 7f3ef4081b80 20 client.8931 populate_metadata read hostname 'smithi146' 2023-10-06T11:15:40.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.232+0000 7f3ef4081b80 1 --2- 172.21.15.146:0/2474414934 >> [v2:172.21.15.146:6835/1974709597,v1:172.21.15.146:6837/1974709597] conn(0x557b5da13000 0x557b5da133d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.232+0000 7f3ef4081b80 4 client.8931 mds_command: new command op to 8682 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:15:40.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.232+0000 7f3ef4081b80 1 -- 172.21.15.146:0/2474414934 --> [v2:172.21.15.146:6835/1974709597,v1:172.21.15.146:6837/1974709597] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557b5d9ba600 con 0x557b5da13000 2023-10-06T11:15:40.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.232+0000 7f3ee3fff700 1 --2- 172.21.15.146:0/2474414934 >> [v2:172.21.15.146:6835/1974709597,v1:172.21.15.146:6837/1974709597] conn(0x557b5da13000 0x557b5da133d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.232+0000 7f3ec2ffd700 10 client.8931 ms_handle_connect on v2:172.21.15.146:6835/1974709597 2023-10-06T11:15:40.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.232+0000 7f3ee3fff700 1 --2- 172.21.15.146:0/2474414934 >> [v2:172.21.15.146:6835/1974709597,v1:172.21.15.146:6837/1974709597] conn(0x557b5da13000 0x557b5da133d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e97fa8ced24c38d6 server_cookie=7d1ced86f7ea869a in_seq=0 out_seq=0 2023-10-06T11:15:40.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.232+0000 7f3ec2ffd700 1 -- 172.21.15.146:0/2474414934 <== mds.0 v2:172.21.15.146:6835/1974709597 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x557b5d9ba600 con 0x557b5da13000 2023-10-06T11:15:40.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.233+0000 7f3ec2ffd700 10 client.8931 handle_command_reply: tid=0 2023-10-06T11:15:40.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.233+0000 7f3ef4081b80 1 client.8931 shutdown 2023-10-06T11:15:40.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.233+0000 7f3ef4081b80 1 -- 172.21.15.146:0/2474414934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b5d9e9c10 msgr2=0x557b5da3f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.233+0000 7f3ef4081b80 1 --2- 172.21.15.146:0/2474414934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b5d9e9c10 0x557b5da3f480 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f3ed80059a0 tx=0x7f3ed8017040 comp rx=0 tx=0).stop 2023-10-06T11:15:40.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.233+0000 7f3ef4081b80 1 -- 172.21.15.146:0/2474414934 shutdown_connections 2023-10-06T11:15:40.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.233+0000 7f3ef4081b80 1 --2- 172.21.15.146:0/2474414934 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5da2fad0 0x557b5d9e8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.233+0000 7f3ef4081b80 1 --2- 172.21.15.146:0/2474414934 >> [v2:172.21.15.146:6835/1974709597,v1:172.21.15.146:6837/1974709597] conn(0x557b5da13000 0x557b5da133d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.233+0000 7f3ef4081b80 1 --2- 172.21.15.146:0/2474414934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b5d9e9c10 0x557b5da3f480 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.233+0000 7f3ec2ffd700 0 client.8931 ms_handle_reset on v2:172.21.15.146:6835/1974709597 2023-10-06T11:15:40.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.233+0000 7f3ef4081b80 1 --2- 172.21.15.146:0/2474414934 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557b5d9eb9e0 0x557b5d9e86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.233+0000 7f3ef4081b80 1 -- 172.21.15.146:0/2474414934 >> 172.21.15.146:0/2474414934 conn(0x557b5d9ea0b0 msgr2=0x557b5da2eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:40.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.233+0000 7f3ef4081b80 1 -- 172.21.15.146:0/2474414934 shutdown_connections 2023-10-06T11:15:40.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.233+0000 7f3ef4081b80 1 -- 172.21.15.146:0/2474414934 wait complete. 2023-10-06T11:15:40.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.233+0000 7f3ef4081b80 20 client.8931 trim_cache size 0 max 16384 2023-10-06T11:15:40.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.248+0000 7f3ef4081b80 1 Processor -- start 2023-10-06T11:15:40.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.249+0000 7f3ef4081b80 1 -- start start 2023-10-06T11:15:40.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.249+0000 7f3ef4081b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b5d9e9c10 0x557b5da133d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.249+0000 7f3ef4081b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5d9eb9e0 0x557b5da0c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.249+0000 7f3ef4081b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557b5da2fad0 0x557b5da0c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.249+0000 7f3ef4081b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b5d7bbe70 con 0x557b5d9e9c10 2023-10-06T11:15:40.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.249+0000 7f3ef4081b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b5da14e10 con 0x557b5d9eb9e0 2023-10-06T11:15:40.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.249+0000 7f3ef4081b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x557b5d9e3100 con 0x557b5da2fad0 2023-10-06T11:15:40.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.249+0000 7f3ee8b25700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b5d9e9c10 0x557b5da133d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.249+0000 7f3ee8b25700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b5d9e9c10 0x557b5da133d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33798/0 (socket says 172.21.15.146:33798) 2023-10-06T11:15:40.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.249+0000 7f3ee8b25700 1 -- 172.21.15.146:0/2443006045 learned_addr learned my addr 172.21.15.146:0/2443006045 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:40.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.250+0000 7f3ee9326700 1 --2- 172.21.15.146:0/2443006045 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557b5da2fad0 0x557b5da0c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.250+0000 7f3ee8b25700 1 -- 172.21.15.146:0/2443006045 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557b5da2fad0 msgr2=0x557b5da0c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:40.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.250+0000 7f3ee8b25700 1 --2- 172.21.15.146:0/2443006045 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557b5da2fad0 0x557b5da0c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.250+0000 7f3ee8b25700 1 -- 172.21.15.146:0/2443006045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5d9eb9e0 msgr2=0x557b5da0c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:40.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.250+0000 7f3ee8b25700 1 --2- 172.21.15.146:0/2443006045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5d9eb9e0 0x557b5da0c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.250+0000 7f3ee8b25700 1 -- 172.21.15.146:0/2443006045 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b5d9077c0 con 0x557b5d9e9c10 2023-10-06T11:15:40.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.250+0000 7f3ee8b25700 1 --2- 172.21.15.146:0/2443006045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b5d9e9c10 0x557b5da133d0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f3ed80017d0 tx=0x7f3ed8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6f9caf937162818 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:40.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.250+0000 7f3ece7fc700 1 -- 172.21.15.146:0/2443006045 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed800e9c0 con 0x557b5d9e9c10 2023-10-06T11:15:40.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.250+0000 7f3ece7fc700 1 -- 172.21.15.146:0/2443006045 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed801b050 con 0x557b5d9e9c10 2023-10-06T11:15:40.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.250+0000 7f3ece7fc700 1 -- 172.21.15.146:0/2443006045 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed800eb20 con 0x557b5d9e9c10 2023-10-06T11:15:40.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.250+0000 7f3ef4081b80 1 -- 172.21.15.146:0/2443006045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b5d9e9c10 msgr2=0x557b5da133d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.250+0000 7f3ef4081b80 1 --2- 172.21.15.146:0/2443006045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b5d9e9c10 0x557b5da133d0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f3ed80017d0 tx=0x7f3ed8014000 comp rx=0 tx=0).stop 2023-10-06T11:15:40.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.250+0000 7f3ef4081b80 1 -- 172.21.15.146:0/2443006045 shutdown_connections 2023-10-06T11:15:40.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.250+0000 7f3ef4081b80 1 --2- 172.21.15.146:0/2443006045 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557b5da2fad0 0x557b5da0c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.250+0000 7f3ef4081b80 1 --2- 172.21.15.146:0/2443006045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b5d9e9c10 0x557b5da133d0 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.250+0000 7f3ef4081b80 1 --2- 172.21.15.146:0/2443006045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5d9eb9e0 0x557b5da0c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.250+0000 7f3ef4081b80 1 -- 172.21.15.146:0/2443006045 >> 172.21.15.146:0/2443006045 conn(0x557b5d9ea0b0 msgr2=0x557b5da13ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:40.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.250+0000 7f3ef4081b80 1 -- 172.21.15.146:0/2443006045 shutdown_connections 2023-10-06T11:15:40.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.251+0000 7f3ef4081b80 1 -- 172.21.15.146:0/2443006045 wait complete. 2023-10-06T11:15:40.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.251+0000 7f3ef4081b80 1 -- start start 2023-10-06T11:15:40.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.251+0000 7f3ef4081b80 1 Processor -- start 2023-10-06T11:15:40.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.252+0000 7f3ef4081b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b5d9e9c10 0x557b5d9e90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.252+0000 7f3ef4081b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5d9eb9e0 0x557b5da94660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.252+0000 7f3ef4081b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557b5da2fad0 0x557b5da2b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.252+0000 7f3ef4081b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b5da2bf80 con 0x557b5d9e9c10 2023-10-06T11:15:40.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.252+0000 7f3ef4081b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b5da95040 con 0x557b5d9eb9e0 2023-10-06T11:15:40.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.252+0000 7f3ef4081b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x557b5d9e8c10 con 0x557b5da2fad0 2023-10-06T11:15:40.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.252+0000 7f3ef4081b80 10 client.0 _ll_register_callbacks cb 0x557b5d7d5f70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:15:40.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.252+0000 7f3ee8b25700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b5d9e9c10 0x557b5d9e90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.252+0000 7f3ee8b25700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b5d9e9c10 0x557b5d9e90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33800/0 (socket says 172.21.15.146:33800) 2023-10-06T11:15:40.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.252+0000 7f3ee8b25700 1 -- 172.21.15.146:0/382604995 learned_addr learned my addr 172.21.15.146:0/382604995 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:40.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.252+0000 7f3ee9326700 1 --2- 172.21.15.146:0/382604995 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557b5da2fad0 0x557b5da2b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.252+0000 7f3ee3fff700 1 --2- 172.21.15.146:0/382604995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5d9eb9e0 0x557b5da94660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.252+0000 7f3ee8b25700 1 -- 172.21.15.146:0/382604995 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557b5da2fad0 msgr2=0x557b5da2b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:40.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.252+0000 7f3ee8b25700 1 --2- 172.21.15.146:0/382604995 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557b5da2fad0 0x557b5da2b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.252+0000 7f3ee8b25700 1 -- 172.21.15.146:0/382604995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5d9eb9e0 msgr2=0x557b5da94660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:40.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.252+0000 7f3ee8b25700 1 --2- 172.21.15.146:0/382604995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5d9eb9e0 0x557b5da94660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.252+0000 7f3ee8b25700 1 -- 172.21.15.146:0/382604995 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557b5d776020 con 0x557b5d9e9c10 2023-10-06T11:15:40.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.252+0000 7f3ee3fff700 1 --2- 172.21.15.146:0/382604995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5d9eb9e0 0x557b5da94660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:40.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.253+0000 7f3ee8b25700 1 --2- 172.21.15.146:0/382604995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b5d9e9c10 0x557b5d9e90a0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f3ed8001130 tx=0x7f3ed8032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46119b76c3a5e239 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:40.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.253+0000 7f3ec2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:15:40.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.253+0000 7f3ec2ffd700 1 -- 172.21.15.146:0/382604995 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed8007610 con 0x557b5d9e9c10 2023-10-06T11:15:40.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.253+0000 7f3ec2ffd700 1 -- 172.21.15.146:0/382604995 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(125..125 src has 1..125) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3ed80218c0 con 0x557b5d9e9c10 2023-10-06T11:15:40.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.253+0000 7f3ef4081b80 1 -- 172.21.15.146:0/382604995 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3edc00f050 con 0x557b5d9e9c10 2023-10-06T11:15:40.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.253+0000 7f3ec2ffd700 1 -- 172.21.15.146:0/382604995 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ed802c430 con 0x557b5d9e9c10 2023-10-06T11:15:40.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.253+0000 7f3ef4081b80 10 client.8937 fetch_fsmap learned FSMap version 108 2023-10-06T11:15:40.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.253+0000 7f3ef4081b80 1 -- 172.21.15.146:0/382604995 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) v3 -- 0x557b5d8ee4b0 con 0x557b5d9e9c10 2023-10-06T11:15:40.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.253+0000 7f3ec2ffd700 1 -- 172.21.15.146:0/382604995 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3edc00f050 con 0x557b5d9e9c10 2023-10-06T11:15:40.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.253+0000 7f3ec2ffd700 1 -- 172.21.15.146:0/382604995 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 108) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3ed802c590 con 0x557b5d9e9c10 2023-10-06T11:15:40.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.253+0000 7f3ef4081b80 10 client.8937 fetch_fsmap finished waiting for FSMap version 108 2023-10-06T11:15:40.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.253+0000 7f3ef4081b80 10 client.8937 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2023-10-06T11:15:40.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.253+0000 7f3ef4081b80 20 client.8937 populate_metadata read hostname 'smithi146' 2023-10-06T11:15:40.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.253+0000 7f3ef4081b80 1 --2- 172.21.15.146:0/382604995 >> [v2:172.21.15.146:6835/1974709597,v1:172.21.15.146:6837/1974709597] conn(0x557b5da8e910 0x557b5da2cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.253+0000 7f3ef4081b80 4 client.8937 mds_command: new command op to 8682 tid=0[{"prefix": "scrub pause"}] 2023-10-06T11:15:40.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.253+0000 7f3ef4081b80 1 -- 172.21.15.146:0/382604995 --> [v2:172.21.15.146:6835/1974709597,v1:172.21.15.146:6837/1974709597] -- command(tid 0: {"prefix": "scrub pause"}) v1 -- 0x557b5d8dbe40 con 0x557b5da8e910 2023-10-06T11:15:40.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.253+0000 7f3ee3fff700 1 --2- 172.21.15.146:0/382604995 >> [v2:172.21.15.146:6835/1974709597,v1:172.21.15.146:6837/1974709597] conn(0x557b5da8e910 0x557b5da2cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.253+0000 7f3ec2ffd700 10 client.8937 ms_handle_connect on v2:172.21.15.146:6835/1974709597 2023-10-06T11:15:40.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.253+0000 7f3ee3fff700 1 --2- 172.21.15.146:0/382604995 >> [v2:172.21.15.146:6835/1974709597,v1:172.21.15.146:6837/1974709597] conn(0x557b5da8e910 0x557b5da2cfa0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b17dcaf4ad3a8b6d server_cookie=78f17600853021f2 in_seq=0 out_seq=0 2023-10-06T11:15:40.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.254+0000 7f3ec2ffd700 1 -- 172.21.15.146:0/382604995 <== mds.0 v2:172.21.15.146:6835/1974709597 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+25 (crc 0 0 0) 0x557b5d8dbe40 con 0x557b5da8e910 2023-10-06T11:15:40.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.254+0000 7f3ec2ffd700 10 client.8937 handle_command_reply: tid=0 2023-10-06T11:15:40.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.254+0000 7f3ef4081b80 1 client.8937 shutdown 2023-10-06T11:15:40.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.254+0000 7f3ef4081b80 1 -- 172.21.15.146:0/382604995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b5d9e9c10 msgr2=0x557b5d9e90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.254+0000 7f3ef4081b80 1 --2- 172.21.15.146:0/382604995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b5d9e9c10 0x557b5d9e90a0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f3ed8001130 tx=0x7f3ed8032000 comp rx=0 tx=0).stop 2023-10-06T11:15:40.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.254+0000 7f3ef4081b80 1 -- 172.21.15.146:0/382604995 shutdown_connections 2023-10-06T11:15:40.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.254+0000 7f3ef4081b80 1 --2- 172.21.15.146:0/382604995 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557b5da2fad0 0x557b5da2b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.254+0000 7f3ef4081b80 1 --2- 172.21.15.146:0/382604995 >> [v2:172.21.15.146:6835/1974709597,v1:172.21.15.146:6837/1974709597] conn(0x557b5da8e910 0x557b5da2cfa0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.254+0000 7f3ef4081b80 1 --2- 172.21.15.146:0/382604995 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557b5d9e9c10 0x557b5d9e90a0 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.254+0000 7f3ef4081b80 1 --2- 172.21.15.146:0/382604995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5d9eb9e0 0x557b5da94660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.254+0000 7f3ec2ffd700 0 client.8937 ms_handle_reset on v2:172.21.15.146:6835/1974709597 2023-10-06T11:15:40.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.254+0000 7f3ef4081b80 1 -- 172.21.15.146:0/382604995 >> 172.21.15.146:0/382604995 conn(0x557b5d9ea0b0 msgr2=0x557b5da133d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:40.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.254+0000 7f3ef4081b80 1 -- 172.21.15.146:0/382604995 shutdown_connections 2023-10-06T11:15:40.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.254+0000 7f3ef4081b80 1 -- 172.21.15.146:0/382604995 wait complete. 2023-10-06T11:15:40.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.254+0000 7f3ef4081b80 20 client.8937 trim_cache size 0 max 16384 2023-10-06T11:15:40.266 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:15:40.266 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0 2023-10-06T11:15:40.266 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:15:40.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.254+0000 7f3eead89700 1 -- 172.21.15.146:0/3662634567 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3ec8066f30 msgr2=0x7f3ec80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.254+0000 7f3eead89700 1 --2- 172.21.15.146:0/3662634567 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3ec8066f30 0x7f3ec80693e0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f3ee40af220 tx=0x7f3ed8009040 comp rx=0 tx=0).stop 2023-10-06T11:15:40.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.254+0000 7f3eead89700 1 -- 172.21.15.146:0/3662634567 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ee415cc20 msgr2=0x7f3ee416dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.254+0000 7f3eead89700 1 --2- 172.21.15.146:0/3662634567 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ee415cc20 0x7f3ee416dd00 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0013000 tx=0x7f3ed0017000 comp rx=0 tx=0).stop 2023-10-06T11:15:40.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.255+0000 7f3eead89700 1 -- 172.21.15.146:0/3662634567 shutdown_connections 2023-10-06T11:15:40.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.255+0000 7f3eead89700 1 --2- 172.21.15.146:0/3662634567 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3ec8066f30 0x7f3ec80693e0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.255+0000 7f3eead89700 1 --2- 172.21.15.146:0/3662634567 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ee415cff0 0x7f3ee4151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.255+0000 7f3eead89700 1 --2- 172.21.15.146:0/3662634567 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ee40d0c50 0x7f3ee416b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.255+0000 7f3eead89700 1 --2- 172.21.15.146:0/3662634567 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3ee415cc20 0x7f3ee416dd00 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.255+0000 7f3eead89700 1 -- 172.21.15.146:0/3662634567 >> 172.21.15.146:0/3662634567 conn(0x7f3ee406eba0 msgr2=0x7f3ee406ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:40.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.255+0000 7f3eead89700 1 -- 172.21.15.146:0/3662634567 shutdown_connections 2023-10-06T11:15:40.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.255+0000 7f3eead89700 1 -- 172.21.15.146:0/3662634567 wait complete. 2023-10-06T11:15:40.270 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.9:0 scrub status 2023-10-06T11:15:40.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.384+0000 7f22b7fff700 1 Processor -- start 2023-10-06T11:15:40.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.384+0000 7f22b7fff700 1 -- start start 2023-10-06T11:15:40.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.385+0000 7f22b7fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22b80b5640 0x7f22b815a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.385+0000 7f22b7fff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f22b8068780 0x7f22b8068b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.385+0000 7f22b7fff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22b80cc130 con 0x7f22b80cb090 2023-10-06T11:15:40.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.385+0000 7f22b7fff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22b80cccd0 con 0x7f22b8068780 2023-10-06T11:15:40.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.385+0000 7f22b7fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b80b2660 con 0x7f22b80b5640 2023-10-06T11:15:40.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.385+0000 7f22b6ffd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22b80b5640 0x7f22b815a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.385+0000 7f22b77fe700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f22b8068780 0x7f22b8068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.385+0000 7f22b6ffd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22b80b5640 0x7f22b815a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:51162/0 (socket says 172.21.15.146:51162) 2023-10-06T11:15:40.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.385+0000 7f22ae7fc700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f22b80cb090 0x7f22b80cc5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:36536/0 (socket says 172.21.15.146:36536) 2023-10-06T11:15:40.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.385+0000 7f22b77fe700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f22b8068780 0x7f22b8068b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:40988/0 (socket says 172.21.15.146:40988) 2023-10-06T11:15:40.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.385+0000 7f22b6ffd700 1 -- 172.21.15.146:0/377323363 learned_addr learned my addr 172.21.15.146:0/377323363 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:40.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.385+0000 7f22b6ffd700 1 -- 172.21.15.146:0/377323363 >> v2:172.21.15.151:3300/0 conn(0x7f22b8068780 msgr2=0x7f22b8068b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:40.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.385+0000 7f22b6ffd700 1 --2- 172.21.15.146:0/377323363 >> v2:172.21.15.151:3300/0 conn(0x7f22b8068780 0x7f22b8068b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.385+0000 7f22b6ffd700 1 -- 172.21.15.146:0/377323363 >> v1:172.21.15.151:6789/0 conn(0x7f22b80cb090 legacy=0x7f22b80cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.385+0000 7f22b6ffd700 1 -- 172.21.15.146:0/377323363 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b815adb0 con 0x7f22b80b5640 2023-10-06T11:15:40.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.385+0000 7f22b77fe700 1 --2- 172.21.15.146:0/377323363 >> v2:172.21.15.151:3300/0 conn(0x7f22b8068780 0x7f22b8068b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:15:40.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.386+0000 7f22b6ffd700 1 --2- 172.21.15.146:0/377323363 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22b80b5640 0x7f22b815a870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f22a80099b0 tx=0x7f22a8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d00c30f260b6b83 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:40.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.386+0000 7f22b67fc700 1 -- 172.21.15.146:0/377323363 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a8009ea0 con 0x7f22b80b5640 2023-10-06T11:15:40.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.386+0000 7f22b67fc700 1 -- 172.21.15.146:0/377323363 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a800b860 con 0x7f22b80b5640 2023-10-06T11:15:40.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.386+0000 7f22b67fc700 1 -- 172.21.15.146:0/377323363 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a800bc00 con 0x7f22b80b5640 2023-10-06T11:15:40.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.386+0000 7f22b7fff700 1 -- 172.21.15.146:0/377323363 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22b80b5640 msgr2=0x7f22b815a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.386+0000 7f22b7fff700 1 --2- 172.21.15.146:0/377323363 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22b80b5640 0x7f22b815a870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f22a80099b0 tx=0x7f22a8009250 comp rx=0 tx=0).stop 2023-10-06T11:15:40.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.386+0000 7f22b7fff700 1 -- 172.21.15.146:0/377323363 shutdown_connections 2023-10-06T11:15:40.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.386+0000 7f22b7fff700 1 --2- 172.21.15.146:0/377323363 >> v2:172.21.15.151:3300/0 conn(0x7f22b8068780 0x7f22b8068b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.386+0000 7f22b7fff700 1 --2- 172.21.15.146:0/377323363 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22b80b5640 0x7f22b815a870 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.386+0000 7f22b7fff700 1 -- 172.21.15.146:0/377323363 >> 172.21.15.146:0/377323363 conn(0x7f22b80703f0 msgr2=0x7f22b80707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:40.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.386+0000 7f22b7fff700 1 -- 172.21.15.146:0/377323363 shutdown_connections 2023-10-06T11:15:40.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.386+0000 7f22b7fff700 1 -- 172.21.15.146:0/377323363 wait complete. 2023-10-06T11:15:40.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.388+0000 7f22b7fff700 1 Processor -- start 2023-10-06T11:15:40.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.388+0000 7f22b7fff700 1 -- start start 2023-10-06T11:15:40.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.388+0000 7f22b7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22b8068780 0x7f22b80c96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.388+0000 7f22b7fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22b80b5640 0x7f22b80c9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.388+0000 7f22b7fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22b80cb090 0x7f22b80c7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.388+0000 7f22b7fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b816a1e0 con 0x7f22b80cb090 2023-10-06T11:15:40.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.388+0000 7f22b7fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b80c3c00 con 0x7f22b8068780 2023-10-06T11:15:40.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.388+0000 7f22b7fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22b80c3ee0 con 0x7f22b80b5640 2023-10-06T11:15:40.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.388+0000 7f22b77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22b80cb090 0x7f22b80c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.388+0000 7f22b77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22b80cb090 0x7f22b80c7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33812/0 (socket says 172.21.15.146:33812) 2023-10-06T11:15:40.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.388+0000 7f22b77fe700 1 -- 172.21.15.146:0/1487892573 learned_addr learned my addr 172.21.15.146:0/1487892573 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:40.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.389+0000 7f22ae7fc700 1 --2- 172.21.15.146:0/1487892573 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22b80b5640 0x7f22b80c9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.389+0000 7f22b6ffd700 1 --2- 172.21.15.146:0/1487892573 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22b8068780 0x7f22b80c96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.389+0000 7f22b77fe700 1 -- 172.21.15.146:0/1487892573 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22b80b5640 msgr2=0x7f22b80c9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.389+0000 7f22b77fe700 1 --2- 172.21.15.146:0/1487892573 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22b80b5640 0x7f22b80c9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.389+0000 7f22b77fe700 1 -- 172.21.15.146:0/1487892573 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22b8068780 msgr2=0x7f22b80c96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.389+0000 7f22b77fe700 1 --2- 172.21.15.146:0/1487892573 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22b8068780 0x7f22b80c96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.389+0000 7f22b77fe700 1 -- 172.21.15.146:0/1487892573 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22b0009a20 con 0x7f22b80cb090 2023-10-06T11:15:40.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.389+0000 7f22b77fe700 1 --2- 172.21.15.146:0/1487892573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22b80cb090 0x7f22b80c7470 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f22b0009fc0 tx=0x7f22b000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:40.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.389+0000 7f22af7fe700 1 -- 172.21.15.146:0/1487892573 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b000cd30 con 0x7f22b80cb090 2023-10-06T11:15:40.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.389+0000 7f22af7fe700 1 -- 172.21.15.146:0/1487892573 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b000f040 con 0x7f22b80cb090 2023-10-06T11:15:40.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.389+0000 7f22b7fff700 1 -- 172.21.15.146:0/1487892573 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22a80094f0 con 0x7f22b80cb090 2023-10-06T11:15:40.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.389+0000 7f22af7fe700 1 -- 172.21.15.146:0/1487892573 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22b00146d0 con 0x7f22b80cb090 2023-10-06T11:15:40.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.389+0000 7f22b7fff700 1 -- 172.21.15.146:0/1487892573 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b80c44a0 con 0x7f22b80cb090 2023-10-06T11:15:40.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.390+0000 7f22af7fe700 1 -- 172.21.15.146:0/1487892573 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f22b0003020 con 0x7f22b80cb090 2023-10-06T11:15:40.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.391+0000 7f22af7fe700 1 --2- 172.21.15.146:0/1487892573 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2298066f30 0x7f22980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.391+0000 7f22af7fe700 1 -- 172.21.15.146:0/1487892573 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f22b0085120 con 0x7f22b80cb090 2023-10-06T11:15:40.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.391+0000 7f22b6ffd700 1 --2- 172.21.15.146:0/1487892573 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2298066f30 0x7f22980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.391+0000 7f22b6ffd700 1 --2- 172.21.15.146:0/1487892573 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2298066f30 0x7f22980693e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f22a80099b0 tx=0x7f22a8017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:40.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.393+0000 7f22c683bb80 1 Processor -- start 2023-10-06T11:15:40.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.393+0000 7f22c683bb80 1 -- start start 2023-10-06T11:15:40.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.394+0000 7f22c683bb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f5444b19a0 0x55f5444b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.394+0000 7f22c683bb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5444fbc10 0x55f5444da970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.394+0000 7f22c683bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f5444daeb0 0x55f5444ad9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.394+0000 7f22c683bb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f544431cd0 con 0x55f5444fbc10 2023-10-06T11:15:40.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.394+0000 7f22c683bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f544408ac0 con 0x55f5444daeb0 2023-10-06T11:15:40.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.394+0000 7f22c683bb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f5444062c0 con 0x55f5444b19a0 2023-10-06T11:15:40.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.394+0000 7f22ae7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5444fbc10 0x55f5444da970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.394+0000 7f22ae7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5444fbc10 0x55f5444da970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33822/0 (socket says 172.21.15.146:33822) 2023-10-06T11:15:40.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.394+0000 7f22ae7fc700 1 -- 172.21.15.146:0/4020750615 learned_addr learned my addr 172.21.15.146:0/4020750615 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:40.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.394+0000 7f22b77fe700 1 --2- 172.21.15.146:0/4020750615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f5444daeb0 0x55f5444ad9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.394+0000 7f22b6ffd700 1 --2- 172.21.15.146:0/4020750615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f5444b19a0 0x55f5444b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.394+0000 7f22ae7fc700 1 -- 172.21.15.146:0/4020750615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f5444b19a0 msgr2=0x55f5444b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:40.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.394+0000 7f22ae7fc700 1 --2- 172.21.15.146:0/4020750615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f5444b19a0 0x55f5444b1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.394+0000 7f22ae7fc700 1 -- 172.21.15.146:0/4020750615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f5444daeb0 msgr2=0x55f5444ad9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:40.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.394+0000 7f22ae7fc700 1 --2- 172.21.15.146:0/4020750615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f5444daeb0 0x55f5444ad9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.394+0000 7f22ae7fc700 1 -- 172.21.15.146:0/4020750615 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f54429c2c0 con 0x55f5444fbc10 2023-10-06T11:15:40.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.394+0000 7f22b77fe700 1 --2- 172.21.15.146:0/4020750615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f5444daeb0 0x55f5444ad9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:15:40.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.394+0000 7f22ae7fc700 1 --2- 172.21.15.146:0/4020750615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5444fbc10 0x55f5444da970 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f22a0005ec0 tx=0x7f22a00059b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f92be2de7bcb418a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:40.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.394+0000 7f2297fff700 1 -- 172.21.15.146:0/4020750615 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a00114f0 con 0x55f5444fbc10 2023-10-06T11:15:40.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.394+0000 7f2297fff700 1 -- 172.21.15.146:0/4020750615 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a0011650 con 0x55f5444fbc10 2023-10-06T11:15:40.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.394+0000 7f2297fff700 1 -- 172.21.15.146:0/4020750615 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a00119d0 con 0x55f5444fbc10 2023-10-06T11:15:40.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.395+0000 7f22c683bb80 1 -- 172.21.15.146:0/4020750615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5444fbc10 msgr2=0x55f5444da970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.395+0000 7f22c683bb80 1 --2- 172.21.15.146:0/4020750615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5444fbc10 0x55f5444da970 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f22a0005ec0 tx=0x7f22a00059b0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.395+0000 7f22c683bb80 1 -- 172.21.15.146:0/4020750615 shutdown_connections 2023-10-06T11:15:40.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.395+0000 7f22c683bb80 1 --2- 172.21.15.146:0/4020750615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f5444daeb0 0x55f5444ad9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.395+0000 7f22c683bb80 1 --2- 172.21.15.146:0/4020750615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f5444b19a0 0x55f5444b1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.395+0000 7f22c683bb80 1 --2- 172.21.15.146:0/4020750615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5444fbc10 0x55f5444da970 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.395+0000 7f22c683bb80 1 -- 172.21.15.146:0/4020750615 >> 172.21.15.146:0/4020750615 conn(0x55f5444b32c0 msgr2=0x55f5444b3690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:40.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.395+0000 7f22c683bb80 1 -- 172.21.15.146:0/4020750615 shutdown_connections 2023-10-06T11:15:40.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.395+0000 7f22c683bb80 1 -- 172.21.15.146:0/4020750615 wait complete. 2023-10-06T11:15:40.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.396+0000 7f22c683bb80 1 -- start start 2023-10-06T11:15:40.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.396+0000 7f22c683bb80 1 Processor -- start 2023-10-06T11:15:40.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.396+0000 7f22c683bb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f5444b19a0 0x55f5444f0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.396+0000 7f22c683bb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5444daeb0 0x55f5444d8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.397+0000 7f22c683bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f5444fbc10 0x55f5444f1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.397+0000 7f22c683bb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5444020b0 con 0x55f5444daeb0 2023-10-06T11:15:40.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.397+0000 7f22c683bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5443ad8e0 con 0x55f5444fbc10 2023-10-06T11:15:40.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.397+0000 7f22c683bb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f5443c8ef0 con 0x55f5444b19a0 2023-10-06T11:15:40.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.397+0000 7f22c683bb80 10 client.0 _ll_register_callbacks cb 0x55f54429ef80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:15:40.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.397+0000 7f22ae7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5444daeb0 0x55f5444d8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.397+0000 7f22ae7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5444daeb0 0x55f5444d8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33824/0 (socket says 172.21.15.146:33824) 2023-10-06T11:15:40.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.397+0000 7f22ae7fc700 1 -- 172.21.15.146:0/3535052371 learned_addr learned my addr 172.21.15.146:0/3535052371 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:40.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.397+0000 7f22b6ffd700 1 --2- 172.21.15.146:0/3535052371 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f5444b19a0 0x55f5444f0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.397+0000 7f22b77fe700 1 --2- 172.21.15.146:0/3535052371 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f5444fbc10 0x55f5444f1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.397+0000 7f22ae7fc700 1 -- 172.21.15.146:0/3535052371 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f5444b19a0 msgr2=0x55f5444f0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:40.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.397+0000 7f22ae7fc700 1 --2- 172.21.15.146:0/3535052371 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f5444b19a0 0x55f5444f0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.397+0000 7f22ae7fc700 1 -- 172.21.15.146:0/3535052371 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f5444fbc10 msgr2=0x55f5444f1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:40.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.397+0000 7f22ae7fc700 1 --2- 172.21.15.146:0/3535052371 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f5444fbc10 0x55f5444f1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.397+0000 7f22ae7fc700 1 -- 172.21.15.146:0/3535052371 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b80c44a0 con 0x55f5444daeb0 2023-10-06T11:15:40.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.397+0000 7f22ae7fc700 1 --2- 172.21.15.146:0/3535052371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5444daeb0 0x55f5444d8090 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f22a0013000 tx=0x7f22a0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1665baec88422cf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:40.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.397+0000 7f22957fa700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:15:40.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.397+0000 7f22957fa700 1 -- 172.21.15.146:0/3535052371 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a0024070 con 0x55f5444daeb0 2023-10-06T11:15:40.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.397+0000 7f22957fa700 1 -- 172.21.15.146:0/3535052371 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(125..125 src has 1..125) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f22a00117c0 con 0x55f5444daeb0 2023-10-06T11:15:40.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.397+0000 7f22c683bb80 1 -- 172.21.15.146:0/3535052371 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f5444a66e0 con 0x55f5444daeb0 2023-10-06T11:15:40.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.397+0000 7f22957fa700 1 -- 172.21.15.146:0/3535052371 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22a0007880 con 0x55f5444daeb0 2023-10-06T11:15:40.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.397+0000 7f22c683bb80 10 client.8946 fetch_fsmap learned FSMap version 108 2023-10-06T11:15:40.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.397+0000 7f22c683bb80 1 -- 172.21.15.146:0/3535052371 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) v3 -- 0x7f22a000f040 con 0x55f5444daeb0 2023-10-06T11:15:40.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.397+0000 7f22957fa700 1 -- 172.21.15.146:0/3535052371 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f5444a66e0 con 0x55f5444daeb0 2023-10-06T11:15:40.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.398+0000 7f22957fa700 1 -- 172.21.15.146:0/3535052371 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 108) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f22a0027020 con 0x55f5444daeb0 2023-10-06T11:15:40.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.398+0000 7f22c683bb80 10 client.8946 fetch_fsmap finished waiting for FSMap version 108 2023-10-06T11:15:40.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.398+0000 7f22c683bb80 10 client.8946 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2023-10-06T11:15:40.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.398+0000 7f22c683bb80 20 client.8946 populate_metadata read hostname 'smithi146' 2023-10-06T11:15:40.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.398+0000 7f22c683bb80 1 --2- 172.21.15.146:0/3535052371 >> [v2:172.21.15.146:6835/1974709597,v1:172.21.15.146:6837/1974709597] conn(0x55f5444f30c0 0x55f5444f1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.398+0000 7f22c683bb80 4 client.8946 mds_command: new command op to 8682 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:15:40.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.398+0000 7f22c683bb80 1 -- 172.21.15.146:0/3535052371 --> [v2:172.21.15.146:6835/1974709597,v1:172.21.15.146:6837/1974709597] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f544483610 con 0x55f5444f30c0 2023-10-06T11:15:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.398+0000 7f22b6ffd700 1 --2- 172.21.15.146:0/3535052371 >> [v2:172.21.15.146:6835/1974709597,v1:172.21.15.146:6837/1974709597] conn(0x55f5444f30c0 0x55f5444f1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.398+0000 7f22957fa700 10 client.8946 ms_handle_connect on v2:172.21.15.146:6835/1974709597 2023-10-06T11:15:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.398+0000 7f22b6ffd700 1 --2- 172.21.15.146:0/3535052371 >> [v2:172.21.15.146:6835/1974709597,v1:172.21.15.146:6837/1974709597] conn(0x55f5444f30c0 0x55f5444f1db0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3070fde1d294be51 server_cookie=60f0ce73bf427391 in_seq=0 out_seq=0 2023-10-06T11:15:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.399+0000 7f22957fa700 1 -- 172.21.15.146:0/3535052371 <== mds.0 v2:172.21.15.146:6835/1974709597 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55f544483610 con 0x55f5444f30c0 2023-10-06T11:15:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.399+0000 7f22957fa700 10 client.8946 handle_command_reply: tid=0 2023-10-06T11:15:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.399+0000 7f22c683bb80 1 client.8946 shutdown 2023-10-06T11:15:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.399+0000 7f22c683bb80 1 -- 172.21.15.146:0/3535052371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5444daeb0 msgr2=0x55f5444d8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.399+0000 7f22c683bb80 1 --2- 172.21.15.146:0/3535052371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5444daeb0 0x55f5444d8090 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f22a0013000 tx=0x7f22a0017000 comp rx=0 tx=0).stop 2023-10-06T11:15:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.399+0000 7f22c683bb80 1 -- 172.21.15.146:0/3535052371 shutdown_connections 2023-10-06T11:15:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.399+0000 7f22c683bb80 1 --2- 172.21.15.146:0/3535052371 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f5444fbc10 0x55f5444f1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.399+0000 7f22c683bb80 1 --2- 172.21.15.146:0/3535052371 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f5444b19a0 0x55f5444f0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.399+0000 7f22c683bb80 1 --2- 172.21.15.146:0/3535052371 >> [v2:172.21.15.146:6835/1974709597,v1:172.21.15.146:6837/1974709597] conn(0x55f5444f30c0 0x55f5444f1db0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.399+0000 7f22c683bb80 1 --2- 172.21.15.146:0/3535052371 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5444daeb0 0x55f5444d8090 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.399+0000 7f22957fa700 0 client.8946 ms_handle_reset on v2:172.21.15.146:6835/1974709597 2023-10-06T11:15:40.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.399+0000 7f22c683bb80 1 -- 172.21.15.146:0/3535052371 >> 172.21.15.146:0/3535052371 conn(0x55f5444b32c0 msgr2=0x55f5444b21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:40.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.399+0000 7f22c683bb80 1 -- 172.21.15.146:0/3535052371 shutdown_connections 2023-10-06T11:15:40.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.399+0000 7f22c683bb80 1 -- 172.21.15.146:0/3535052371 wait complete. 2023-10-06T11:15:40.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.399+0000 7f22c683bb80 20 client.8946 trim_cache size 0 max 16384 2023-10-06T11:15:40.416 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.415+0000 7f22c683bb80 1 Processor -- start 2023-10-06T11:15:40.417 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.415+0000 7f22c683bb80 1 -- start start 2023-10-06T11:15:40.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.416+0000 7f22c683bb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f5444b19a0 0x55f5444f6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.416+0000 7f22c683bb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5444daeb0 0x55f5444f46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.416+0000 7f22c683bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f5444fbc10 0x55f5444a81f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.416+0000 7f22c683bb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f544284e80 con 0x55f5444daeb0 2023-10-06T11:15:40.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.416+0000 7f22c683bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5444f0e80 con 0x55f5444fbc10 2023-10-06T11:15:40.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.416+0000 7f22c683bb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f5444f2d00 con 0x55f5444b19a0 2023-10-06T11:15:40.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.416+0000 7f22ae7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5444daeb0 0x55f5444f46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.416+0000 7f22ae7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5444daeb0 0x55f5444f46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33832/0 (socket says 172.21.15.146:33832) 2023-10-06T11:15:40.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.416+0000 7f22ae7fc700 1 -- 172.21.15.146:0/927050020 learned_addr learned my addr 172.21.15.146:0/927050020 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:40.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.416+0000 7f22b6ffd700 1 --2- 172.21.15.146:0/927050020 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f5444b19a0 0x55f5444f6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.416+0000 7f22b77fe700 1 --2- 172.21.15.146:0/927050020 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f5444fbc10 0x55f5444a81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.416+0000 7f22ae7fc700 1 -- 172.21.15.146:0/927050020 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f5444b19a0 msgr2=0x55f5444f6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:40.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.416+0000 7f22ae7fc700 1 --2- 172.21.15.146:0/927050020 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f5444b19a0 0x55f5444f6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.416+0000 7f22ae7fc700 1 -- 172.21.15.146:0/927050020 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f5444fbc10 msgr2=0x55f5444a81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:40.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.416+0000 7f22ae7fc700 1 --2- 172.21.15.146:0/927050020 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f5444fbc10 0x55f5444a81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.416+0000 7f22ae7fc700 1 -- 172.21.15.146:0/927050020 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f54423f030 con 0x55f5444daeb0 2023-10-06T11:15:40.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.416+0000 7f22ae7fc700 1 --2- 172.21.15.146:0/927050020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5444daeb0 0x55f5444f46a0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f22a00115f0 tx=0x7f22a0020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=297b5de39eb53c1c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:40.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.416+0000 7f22acff9700 1 -- 172.21.15.146:0/927050020 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a0024040 con 0x55f5444daeb0 2023-10-06T11:15:40.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.416+0000 7f22acff9700 1 -- 172.21.15.146:0/927050020 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a00117c0 con 0x55f5444daeb0 2023-10-06T11:15:40.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.416+0000 7f22acff9700 1 -- 172.21.15.146:0/927050020 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a0000e40 con 0x55f5444daeb0 2023-10-06T11:15:40.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.417+0000 7f22c683bb80 1 -- 172.21.15.146:0/927050020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5444daeb0 msgr2=0x55f5444f46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.417+0000 7f22c683bb80 1 --2- 172.21.15.146:0/927050020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5444daeb0 0x55f5444f46a0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f22a00115f0 tx=0x7f22a0020000 comp rx=0 tx=0).stop 2023-10-06T11:15:40.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.417+0000 7f22c683bb80 1 -- 172.21.15.146:0/927050020 shutdown_connections 2023-10-06T11:15:40.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.417+0000 7f22c683bb80 1 --2- 172.21.15.146:0/927050020 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f5444fbc10 0x55f5444a81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.417+0000 7f22c683bb80 1 --2- 172.21.15.146:0/927050020 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f5444b19a0 0x55f5444f6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.417+0000 7f22c683bb80 1 --2- 172.21.15.146:0/927050020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5444daeb0 0x55f5444f46a0 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.417+0000 7f22c683bb80 1 -- 172.21.15.146:0/927050020 >> 172.21.15.146:0/927050020 conn(0x55f5444b32c0 msgr2=0x55f5444afa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:40.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.417+0000 7f22c683bb80 1 -- 172.21.15.146:0/927050020 shutdown_connections 2023-10-06T11:15:40.421 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.417+0000 7f22c683bb80 1 -- 172.21.15.146:0/927050020 wait complete. 2023-10-06T11:15:40.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.418+0000 7f22c683bb80 1 -- start start 2023-10-06T11:15:40.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.418+0000 7f22c683bb80 1 Processor -- start 2023-10-06T11:15:40.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.418+0000 7f22c683bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f5444b19a0 0x55f54455c910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.418+0000 7f22c683bb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5444daeb0 0x55f5444a81f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.418+0000 7f22c683bb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f5444fbc10 0x55f5444a8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.419+0000 7f22c683bb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5444d5560 con 0x55f5444daeb0 2023-10-06T11:15:40.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.419+0000 7f22c683bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5444d59c0 con 0x55f5444b19a0 2023-10-06T11:15:40.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.419+0000 7f22c683bb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f5445110d0 con 0x55f5444fbc10 2023-10-06T11:15:40.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.419+0000 7f22c683bb80 10 client.0 _ll_register_callbacks cb 0x55f54429ef80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:15:40.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.419+0000 7f22ae7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5444daeb0 0x55f5444a81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.419+0000 7f22b6ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f5444b19a0 0x55f54455c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.419+0000 7f22ae7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5444daeb0 0x55f5444a81f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33842/0 (socket says 172.21.15.146:33842) 2023-10-06T11:15:40.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.419+0000 7f22b77fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f5444fbc10 0x55f5444a8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.419+0000 7f22ae7fc700 1 -- 172.21.15.146:0/3214694492 learned_addr learned my addr 172.21.15.146:0/3214694492 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:40.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.419+0000 7f22b6ffd700 1 --2- 172.21.15.146:0/3214694492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f5444b19a0 0x55f54455c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:41038/0 (socket says 172.21.15.146:41038) 2023-10-06T11:15:40.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.419+0000 7f22ae7fc700 1 -- 172.21.15.146:0/3214694492 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f5444fbc10 msgr2=0x55f5444a8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:40.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.419+0000 7f22ae7fc700 1 --2- 172.21.15.146:0/3214694492 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f5444fbc10 0x55f5444a8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.419+0000 7f22ae7fc700 1 -- 172.21.15.146:0/3214694492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f5444b19a0 msgr2=0x55f54455c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:40.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.419+0000 7f22ae7fc700 1 --2- 172.21.15.146:0/3214694492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f5444b19a0 0x55f54455c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.419+0000 7f22ae7fc700 1 -- 172.21.15.146:0/3214694492 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22a000f040 con 0x55f5444daeb0 2023-10-06T11:15:40.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.419+0000 7f22ae7fc700 1 --2- 172.21.15.146:0/3214694492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5444daeb0 0x55f5444a81f0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f22a00115f0 tx=0x7f22a0028000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30c624bbfe1387ac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:40.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.419+0000 7f22957fa700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:15:40.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.419+0000 7f22957fa700 1 -- 172.21.15.146:0/3214694492 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a0011c30 con 0x55f5444daeb0 2023-10-06T11:15:40.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.419+0000 7f22957fa700 1 -- 172.21.15.146:0/3214694492 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(125..125 src has 1..125) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f22a0011d90 con 0x55f5444daeb0 2023-10-06T11:15:40.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.419+0000 7f22c683bb80 1 -- 172.21.15.146:0/3214694492 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f22a0011650 con 0x55f5444daeb0 2023-10-06T11:15:40.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.419+0000 7f22957fa700 1 -- 172.21.15.146:0/3214694492 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=108) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22a0039450 con 0x55f5444daeb0 2023-10-06T11:15:40.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.419+0000 7f22c683bb80 10 client.8952 fetch_fsmap learned FSMap version 108 2023-10-06T11:15:40.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.419+0000 7f22c683bb80 1 -- 172.21.15.146:0/3214694492 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=108,monmap=2+}) v3 -- 0x55f5443d07d0 con 0x55f5444daeb0 2023-10-06T11:15:40.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.419+0000 7f22957fa700 1 -- 172.21.15.146:0/3214694492 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a0011650 con 0x55f5444daeb0 2023-10-06T11:15:40.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.420+0000 7f22957fa700 1 -- 172.21.15.146:0/3214694492 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 108) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f22a0027040 con 0x55f5444daeb0 2023-10-06T11:15:40.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.420+0000 7f22c683bb80 10 client.8952 fetch_fsmap finished waiting for FSMap version 108 2023-10-06T11:15:40.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.420+0000 7f22c683bb80 10 client.8952 resolve_mds: resolved 9:0 to role '9:0' aka daemon mds.c 2023-10-06T11:15:40.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.420+0000 7f22c683bb80 20 client.8952 populate_metadata read hostname 'smithi146' 2023-10-06T11:15:40.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.420+0000 7f22c683bb80 1 --2- 172.21.15.146:0/3214694492 >> [v2:172.21.15.146:6835/1974709597,v1:172.21.15.146:6837/1974709597] conn(0x55f5444f84d0 0x55f5444d8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.420+0000 7f22c683bb80 4 client.8952 mds_command: new command op to 8682 tid=0[{"prefix": "scrub status"}] 2023-10-06T11:15:40.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.420+0000 7f22c683bb80 1 -- 172.21.15.146:0/3214694492 --> [v2:172.21.15.146:6835/1974709597,v1:172.21.15.146:6837/1974709597] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f5443a4e50 con 0x55f5444f84d0 2023-10-06T11:15:40.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.420+0000 7f22b6ffd700 1 --2- 172.21.15.146:0/3214694492 >> [v2:172.21.15.146:6835/1974709597,v1:172.21.15.146:6837/1974709597] conn(0x55f5444f84d0 0x55f5444d8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.420+0000 7f22957fa700 10 client.8952 ms_handle_connect on v2:172.21.15.146:6835/1974709597 2023-10-06T11:15:40.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.420+0000 7f22b6ffd700 1 --2- 172.21.15.146:0/3214694492 >> [v2:172.21.15.146:6835/1974709597,v1:172.21.15.146:6837/1974709597] conn(0x55f5444f84d0 0x55f5444d8c80 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d901262250dc5e4 server_cookie=5670000b4c674516 in_seq=0 out_seq=0 2023-10-06T11:15:40.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.420+0000 7f22957fa700 1 -- 172.21.15.146:0/3214694492 <== mds.0 v2:172.21.15.146:6835/1974709597 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+276 (crc 0 0 0) 0x55f5443a4e50 con 0x55f5444f84d0 2023-10-06T11:15:40.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.420+0000 7f22957fa700 10 client.8952 handle_command_reply: tid=0 2023-10-06T11:15:40.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.420+0000 7f22c683bb80 1 client.8952 shutdown 2023-10-06T11:15:40.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.420+0000 7f22c683bb80 1 -- 172.21.15.146:0/3214694492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5444daeb0 msgr2=0x55f5444a81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.420+0000 7f22c683bb80 1 --2- 172.21.15.146:0/3214694492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5444daeb0 0x55f5444a81f0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f22a00115f0 tx=0x7f22a0028000 comp rx=0 tx=0).stop 2023-10-06T11:15:40.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.420+0000 7f22c683bb80 1 -- 172.21.15.146:0/3214694492 shutdown_connections 2023-10-06T11:15:40.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.420+0000 7f22c683bb80 1 --2- 172.21.15.146:0/3214694492 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f5444fbc10 0x55f5444a8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.420+0000 7f22c683bb80 1 --2- 172.21.15.146:0/3214694492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f5444b19a0 0x55f54455c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.420+0000 7f22c683bb80 1 --2- 172.21.15.146:0/3214694492 >> [v2:172.21.15.146:6835/1974709597,v1:172.21.15.146:6837/1974709597] conn(0x55f5444f84d0 0x55f5444d8c80 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.420+0000 7f22c683bb80 1 --2- 172.21.15.146:0/3214694492 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f5444daeb0 0x55f5444a81f0 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.420+0000 7f22957fa700 0 client.8952 ms_handle_reset on v2:172.21.15.146:6835/1974709597 2023-10-06T11:15:40.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.420+0000 7f22c683bb80 1 -- 172.21.15.146:0/3214694492 >> 172.21.15.146:0/3214694492 conn(0x55f5444b32c0 msgr2=0x55f5444f46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:40.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.420+0000 7f22c683bb80 1 -- 172.21.15.146:0/3214694492 shutdown_connections 2023-10-06T11:15:40.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.421+0000 7f22c683bb80 1 -- 172.21.15.146:0/3214694492 wait complete. 2023-10-06T11:15:40.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.421+0000 7f22c683bb80 20 client.8952 trim_cache size 0 max 16384 2023-10-06T11:15:40.430 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:15:40.430 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "PAUSED (0 inodes in the stack)", 2023-10-06T11:15:40.430 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": { 2023-10-06T11:15:40.430 INFO:teuthology.orchestra.run.smithi146.stdout: "2b054de5-fb0b-4daa-882e-0db701411e36": { 2023-10-06T11:15:40.430 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/scrub_control_test_path", 2023-10-06T11:15:40.430 INFO:teuthology.orchestra.run.smithi146.stdout: "tag": "2b054de5-fb0b-4daa-882e-0db701411e36", 2023-10-06T11:15:40.430 INFO:teuthology.orchestra.run.smithi146.stdout: "options": "recursive" 2023-10-06T11:15:40.430 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:15:40.430 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:15:40.431 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:15:40.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.421+0000 7f22b7fff700 1 -- 172.21.15.146:0/1487892573 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2298066f30 msgr2=0x7f22980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.421+0000 7f22b7fff700 1 --2- 172.21.15.146:0/1487892573 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2298066f30 0x7f22980693e0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f22a80099b0 tx=0x7f22a8017000 comp rx=0 tx=0).stop 2023-10-06T11:15:40.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.421+0000 7f22b7fff700 1 -- 172.21.15.146:0/1487892573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22b80cb090 msgr2=0x7f22b80c7470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.421+0000 7f22b7fff700 1 --2- 172.21.15.146:0/1487892573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22b80cb090 0x7f22b80c7470 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f22b0009fc0 tx=0x7f22b000b040 comp rx=0 tx=0).stop 2023-10-06T11:15:40.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.421+0000 7f22b7fff700 1 -- 172.21.15.146:0/1487892573 shutdown_connections 2023-10-06T11:15:40.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.421+0000 7f22b7fff700 1 --2- 172.21.15.146:0/1487892573 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2298066f30 0x7f22980693e0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.421+0000 7f22b7fff700 1 --2- 172.21.15.146:0/1487892573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f22b80cb090 0x7f22b80c7470 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.421+0000 7f22b7fff700 1 --2- 172.21.15.146:0/1487892573 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22b8068780 0x7f22b80c96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.421+0000 7f22b7fff700 1 --2- 172.21.15.146:0/1487892573 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22b80b5640 0x7f22b80c9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.421+0000 7f22b7fff700 1 -- 172.21.15.146:0/1487892573 >> 172.21.15.146:0/1487892573 conn(0x7f22b80703f0 msgr2=0x7f22b80b39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:40.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.421+0000 7f22b7fff700 1 -- 172.21.15.146:0/1487892573 shutdown_connections 2023-10-06T11:15:40.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.421+0000 7f22b7fff700 1 -- 172.21.15.146:0/1487892573 wait complete. 2023-10-06T11:15:40.434 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:15:40.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.547+0000 7f03efc90700 1 Processor -- start 2023-10-06T11:15:40.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.547+0000 7f03efc90700 1 -- start start 2023-10-06T11:15:40.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.548+0000 7f03efc90700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f03e8153e80 0x7f03e815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.548+0000 7f03efc90700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03e815ac30 con 0x7f03e8068ba0 2023-10-06T11:15:40.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.548+0000 7f03efc90700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03e80b4510 con 0x7f03e8153ab0 2023-10-06T11:15:40.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.548+0000 7f03efc90700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03e80b6530 con 0x7f03e8153e80 2023-10-06T11:15:40.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.548+0000 7f03ee22d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f03e8153e80 0x7f03e815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.548+0000 7f03ed22b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f03e8068ba0 0x7f03e80b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55992/0 (socket says 172.21.15.146:55992) 2023-10-06T11:15:40.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.548+0000 7f03ed22b700 1 -- 172.21.15.146:0/1317852931 learned_addr learned my addr 172.21.15.146:0/1317852931 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:15:40.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.548+0000 7f03ee22d700 1 -- 172.21.15.146:0/1317852931 >> v1:172.21.15.151:6789/0 conn(0x7f03e8153ab0 legacy=0x7f03e8068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.548+0000 7f03ee22d700 1 -- 172.21.15.146:0/1317852931 >> v1:172.21.15.146:6789/0 conn(0x7f03e8068ba0 legacy=0x7f03e80b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.548+0000 7f03eca2a700 1 -- 172.21.15.146:0/1317852931 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2560949162 0 0) 0x7f03e80b4510 con 0x7f03e8153ab0 2023-10-06T11:15:40.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.548+0000 7f03ee22d700 1 -- 172.21.15.146:0/1317852931 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e80b5c50 con 0x7f03e8153e80 2023-10-06T11:15:40.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.548+0000 7f03ee22d700 1 --2- 172.21.15.146:0/1317852931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03e8153e80 0x7f03e815a6f0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f03e0009e60 tx=0x7f03e0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e757b922c67053 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:40.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.549+0000 7f03eca2a700 1 -- 172.21.15.146:0/1317852931 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e000e070 con 0x7f03e8153e80 2023-10-06T11:15:40.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.549+0000 7f03eca2a700 1 -- 172.21.15.146:0/1317852931 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e000bb30 con 0x7f03e8153e80 2023-10-06T11:15:40.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.549+0000 7f03eca2a700 1 -- 172.21.15.146:0/1317852931 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e0012430 con 0x7f03e8153e80 2023-10-06T11:15:40.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.549+0000 7f03efc90700 1 -- 172.21.15.146:0/1317852931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03e8153e80 msgr2=0x7f03e815a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.549+0000 7f03efc90700 1 --2- 172.21.15.146:0/1317852931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03e8153e80 0x7f03e815a6f0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f03e0009e60 tx=0x7f03e0009780 comp rx=0 tx=0).stop 2023-10-06T11:15:40.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.549+0000 7f03efc90700 1 -- 172.21.15.146:0/1317852931 shutdown_connections 2023-10-06T11:15:40.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.549+0000 7f03efc90700 1 --2- 172.21.15.146:0/1317852931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03e8153e80 0x7f03e815a6f0 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.549+0000 7f03efc90700 1 -- 172.21.15.146:0/1317852931 >> 172.21.15.146:0/1317852931 conn(0x7f03e806eba0 msgr2=0x7f03e806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:40.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.549+0000 7f03efc90700 1 -- 172.21.15.146:0/1317852931 shutdown_connections 2023-10-06T11:15:40.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.549+0000 7f03efc90700 1 -- 172.21.15.146:0/1317852931 wait complete. 2023-10-06T11:15:40.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.550+0000 7f03efc90700 1 Processor -- start 2023-10-06T11:15:40.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.550+0000 7f03efc90700 1 -- start start 2023-10-06T11:15:40.554 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.551+0000 7f03efc90700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03e8068ba0 0x7f03e816b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.551+0000 7f03efc90700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03e8153ab0 0x7f03e80b2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.551+0000 7f03efc90700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03e8153e80 0x7f03e816a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.551+0000 7f03efc90700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e816b770 con 0x7f03e8068ba0 2023-10-06T11:15:40.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.551+0000 7f03efc90700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e814c5a0 con 0x7f03e8153ab0 2023-10-06T11:15:40.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.551+0000 7f03efc90700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03e814c880 con 0x7f03e8153e80 2023-10-06T11:15:40.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.551+0000 7f03eda2c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03e8068ba0 0x7f03e816b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.551+0000 7f03eda2c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03e8068ba0 0x7f03e816b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33862/0 (socket says 172.21.15.146:33862) 2023-10-06T11:15:40.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.551+0000 7f03eda2c700 1 -- 172.21.15.146:0/2226355759 learned_addr learned my addr 172.21.15.146:0/2226355759 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:40.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.551+0000 7f03ee22d700 1 --2- 172.21.15.146:0/2226355759 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03e8153e80 0x7f03e816a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.551+0000 7f03ed22b700 1 --2- 172.21.15.146:0/2226355759 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03e8153ab0 0x7f03e80b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.551+0000 7f03eda2c700 1 -- 172.21.15.146:0/2226355759 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03e8153e80 msgr2=0x7f03e816a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.555 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.551+0000 7f03eda2c700 1 --2- 172.21.15.146:0/2226355759 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03e8153e80 0x7f03e816a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.551+0000 7f03eda2c700 1 -- 172.21.15.146:0/2226355759 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03e8153ab0 msgr2=0x7f03e80b2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.551+0000 7f03eda2c700 1 --2- 172.21.15.146:0/2226355759 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03e8153ab0 0x7f03e80b2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.551+0000 7f03eda2c700 1 -- 172.21.15.146:0/2226355759 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e0009a20 con 0x7f03e8068ba0 2023-10-06T11:15:40.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.552+0000 7f03eda2c700 1 --2- 172.21.15.146:0/2226355759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03e8068ba0 0x7f03e816b230 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f03e400c7c0 tx=0x7f03e4007da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:40.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.552+0000 7f03ddffb700 1 -- 172.21.15.146:0/2226355759 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e4011590 con 0x7f03e8068ba0 2023-10-06T11:15:40.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.552+0000 7f03ddffb700 1 -- 172.21.15.146:0/2226355759 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e40116f0 con 0x7f03e8068ba0 2023-10-06T11:15:40.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.552+0000 7f03efc90700 1 -- 172.21.15.146:0/2226355759 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03e814cb60 con 0x7f03e8068ba0 2023-10-06T11:15:40.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.552+0000 7f03ddffb700 1 -- 172.21.15.146:0/2226355759 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e4011ab0 con 0x7f03e8068ba0 2023-10-06T11:15:40.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.552+0000 7f03efc90700 1 -- 172.21.15.146:0/2226355759 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03e814c1c0 con 0x7f03e8068ba0 2023-10-06T11:15:40.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.553+0000 7f03efc90700 1 -- 172.21.15.146:0/2226355759 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03e804c380 con 0x7f03e8068ba0 2023-10-06T11:15:40.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.553+0000 7f03ddffb700 1 -- 172.21.15.146:0/2226355759 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f03e401b3b0 con 0x7f03e8068ba0 2023-10-06T11:15:40.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.554+0000 7f03ddffb700 1 --2- 172.21.15.146:0/2226355759 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f03cc066f30 0x7f03cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.554+0000 7f03ddffb700 1 -- 172.21.15.146:0/2226355759 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f03e4083b10 con 0x7f03e8068ba0 2023-10-06T11:15:40.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.554+0000 7f03ed22b700 1 --2- 172.21.15.146:0/2226355759 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f03cc066f30 0x7f03cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.554+0000 7f03ed22b700 1 --2- 172.21.15.146:0/2226355759 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f03cc066f30 0x7f03cc0693e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f03e8167c50 tx=0x7f03d8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:40.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.558+0000 7f03ddffb700 1 -- 172.21.15.146:0/2226355759 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f03e4050c20 con 0x7f03e8068ba0 2023-10-06T11:15:40.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.785+0000 7f03efc90700 1 -- 172.21.15.146:0/2226355759 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03e80b6250 con 0x7f03e8068ba0 2023-10-06T11:15:40.787 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.785+0000 7f03ddffb700 1 -- 172.21.15.146:0/2226355759 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) v1 ==== 95+0+4617 (secure 0 0 0) 0x7f03e4017070 con 0x7f03e8068ba0 2023-10-06T11:15:40.787 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:15:40.787 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":108,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7792,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3693464886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3693464886},{"type":"v1","addr":"172.21.15.151:6834","nonce":3693464886}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103},{"gid":7795,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1155762565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":1155762565},{"type":"v1","addr":"172.21.15.151:6835","nonce":1155762565}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103},{"gid":8679,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/3868720724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3868720724},{"type":"v1","addr":"172.21.15.146:6836","nonce":3868720724}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:15:11.929158+0000","modified":"2023-10-06T11:15:15.569866+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8682},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8682":{"gid":8682,"name":"c","rank":0,"incarnation":104,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/1974709597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":1974709597},{"type":"v1","addr":"172.21.15.146:6837","nonce":1974709597}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-06T11:15:40.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.787+0000 7f03efc90700 1 -- 172.21.15.146:0/2226355759 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f03cc066f30 msgr2=0x7f03cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.787+0000 7f03efc90700 1 --2- 172.21.15.146:0/2226355759 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f03cc066f30 0x7f03cc0693e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f03e8167c50 tx=0x7f03d8009040 comp rx=0 tx=0).stop 2023-10-06T11:15:40.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.787+0000 7f03efc90700 1 -- 172.21.15.146:0/2226355759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03e8068ba0 msgr2=0x7f03e816b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.787+0000 7f03efc90700 1 --2- 172.21.15.146:0/2226355759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03e8068ba0 0x7f03e816b230 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f03e400c7c0 tx=0x7f03e4007da0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.788+0000 7f03efc90700 1 -- 172.21.15.146:0/2226355759 shutdown_connections 2023-10-06T11:15:40.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.788+0000 7f03efc90700 1 --2- 172.21.15.146:0/2226355759 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f03cc066f30 0x7f03cc0693e0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.788+0000 7f03efc90700 1 --2- 172.21.15.146:0/2226355759 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03e8153e80 0x7f03e816a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.788+0000 7f03efc90700 1 --2- 172.21.15.146:0/2226355759 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03e8068ba0 0x7f03e816b230 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.788+0000 7f03efc90700 1 --2- 172.21.15.146:0/2226355759 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03e8153ab0 0x7f03e80b2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.788+0000 7f03efc90700 1 -- 172.21.15.146:0/2226355759 >> 172.21.15.146:0/2226355759 conn(0x7f03e806eba0 msgr2=0x7f03e80ce950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:40.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.788+0000 7f03efc90700 1 -- 172.21.15.146:0/2226355759 shutdown_connections 2023-10-06T11:15:40.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.788+0000 7f03efc90700 1 -- 172.21.15.146:0/2226355759 wait complete. 2023-10-06T11:15:40.791 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 108 2023-10-06T11:15:40.801 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2023-10-06T11:15:40.802 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T11:15:40.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.913+0000 7fe0dbe24700 1 Processor -- start 2023-10-06T11:15:40.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.913+0000 7fe0dbe24700 1 -- start start 2023-10-06T11:15:40.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.914+0000 7fe0dbe24700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe0d40ae900 0x7fe0d40aecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.914+0000 7fe0dbe24700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0d406e6d0 0x7fe0d40b0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.914+0000 7fe0dbe24700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe0d40c8d70 0x7fe0d41572c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.914+0000 7fe0dbe24700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0d40b12c0 con 0x7fe0d40ae900 2023-10-06T11:15:40.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.914+0000 7fe0dbe24700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0d406ebb0 con 0x7fe0d40c8d70 2023-10-06T11:15:40.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.914+0000 7fe0dbe24700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d4067510 con 0x7fe0d406e6d0 2023-10-06T11:15:40.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.914+0000 7fe0d9bc0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe0d40ae900 0x7fe0d40aecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.914+0000 7fe0d9bc0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe0d40ae900 0x7fe0d40aecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33866/0 (socket says 172.21.15.146:33866) 2023-10-06T11:15:40.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.914+0000 7fe0d9bc0700 1 -- 172.21.15.146:0/3842751142 learned_addr learned my addr 172.21.15.146:0/3842751142 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:40.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.914+0000 7fe0d93bf700 1 --2- 172.21.15.146:0/3842751142 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0d406e6d0 0x7fe0d40b0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.914+0000 7fe0d9bc0700 1 -- 172.21.15.146:0/3842751142 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0d406e6d0 msgr2=0x7fe0d40b0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:40.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.914+0000 7fe0d9bc0700 1 --2- 172.21.15.146:0/3842751142 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0d406e6d0 0x7fe0d40b0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.914+0000 7fe0da3c1700 1 --2- 172.21.15.146:0/3842751142 >> v2:172.21.15.151:3300/0 conn(0x7fe0d40c8d70 0x7fe0d41572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.914+0000 7fe0d9bc0700 1 -- 172.21.15.146:0/3842751142 >> v2:172.21.15.151:3300/0 conn(0x7fe0d40c8d70 msgr2=0x7fe0d41572c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:40.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.914+0000 7fe0d9bc0700 1 --2- 172.21.15.146:0/3842751142 >> v2:172.21.15.151:3300/0 conn(0x7fe0d40c8d70 0x7fe0d41572c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.914+0000 7fe0d9bc0700 1 -- 172.21.15.146:0/3842751142 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d40677f0 con 0x7fe0d40ae900 2023-10-06T11:15:40.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.914+0000 7fe0d9bc0700 1 --2- 172.21.15.146:0/3842751142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0d40ae900 0x7fe0d40aecd0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fe0d40697d0 tx=0x7fe0d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8414c8545087374e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:40.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.915+0000 7fe0d8bbe700 1 -- 172.21.15.146:0/3842751142 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d000b860 con 0x7fe0d40ae900 2023-10-06T11:15:40.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.915+0000 7fe0d8bbe700 1 -- 172.21.15.146:0/3842751142 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d000b9c0 con 0x7fe0d40ae900 2023-10-06T11:15:40.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.915+0000 7fe0d8bbe700 1 -- 172.21.15.146:0/3842751142 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d000bd60 con 0x7fe0d40ae900 2023-10-06T11:15:40.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.915+0000 7fe0dbe24700 1 -- 172.21.15.146:0/3842751142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0d40ae900 msgr2=0x7fe0d40aecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.915+0000 7fe0dbe24700 1 --2- 172.21.15.146:0/3842751142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0d40ae900 0x7fe0d40aecd0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fe0d40697d0 tx=0x7fe0d0009250 comp rx=0 tx=0).stop 2023-10-06T11:15:40.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.915+0000 7fe0dbe24700 1 -- 172.21.15.146:0/3842751142 shutdown_connections 2023-10-06T11:15:40.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.915+0000 7fe0dbe24700 1 --2- 172.21.15.146:0/3842751142 >> v2:172.21.15.151:3300/0 conn(0x7fe0d40c8d70 0x7fe0d41572c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.915+0000 7fe0dbe24700 1 --2- 172.21.15.146:0/3842751142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0d40ae900 0x7fe0d40aecd0 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.915+0000 7fe0dbe24700 1 --2- 172.21.15.146:0/3842751142 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0d406e6d0 0x7fe0d40b0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.915+0000 7fe0dbe24700 1 -- 172.21.15.146:0/3842751142 >> 172.21.15.146:0/3842751142 conn(0x7fe0d40cd530 msgr2=0x7fe0d4069f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:40.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.915+0000 7fe0dbe24700 1 -- 172.21.15.146:0/3842751142 shutdown_connections 2023-10-06T11:15:40.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.915+0000 7fe0dbe24700 1 -- 172.21.15.146:0/3842751142 wait complete. 2023-10-06T11:15:40.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.916+0000 7fe0dbe24700 1 Processor -- start 2023-10-06T11:15:40.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.916+0000 7fe0dbe24700 1 -- start start 2023-10-06T11:15:40.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.917+0000 7fe0dbe24700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0d406e6d0 0x7fe0d4155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.917+0000 7fe0dbe24700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0d40ae900 0x7fe0d4153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.917+0000 7fe0dbe24700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0d40c8d70 0x7fe0d4133510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.917+0000 7fe0dbe24700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d4155f90 con 0x7fe0d406e6d0 2023-10-06T11:15:40.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.917+0000 7fe0dbe24700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d4156270 con 0x7fe0d40ae900 2023-10-06T11:15:40.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.917+0000 7fe0dbe24700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d4156550 con 0x7fe0d40c8d70 2023-10-06T11:15:40.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.917+0000 7fe0d9bc0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0d406e6d0 0x7fe0d4155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.917+0000 7fe0d9bc0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0d406e6d0 0x7fe0d4155900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33870/0 (socket says 172.21.15.146:33870) 2023-10-06T11:15:40.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.917+0000 7fe0d9bc0700 1 -- 172.21.15.146:0/832142799 learned_addr learned my addr 172.21.15.146:0/832142799 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:40.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.917+0000 7fe0da3c1700 1 --2- 172.21.15.146:0/832142799 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0d40c8d70 0x7fe0d4133510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.917+0000 7fe0d93bf700 1 --2- 172.21.15.146:0/832142799 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0d40ae900 0x7fe0d4153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.917+0000 7fe0d9bc0700 1 -- 172.21.15.146:0/832142799 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0d40c8d70 msgr2=0x7fe0d4133510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.917+0000 7fe0d9bc0700 1 --2- 172.21.15.146:0/832142799 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0d40c8d70 0x7fe0d4133510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.917+0000 7fe0d9bc0700 1 -- 172.21.15.146:0/832142799 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0d40ae900 msgr2=0x7fe0d4153410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:40.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.917+0000 7fe0d9bc0700 1 --2- 172.21.15.146:0/832142799 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0d40ae900 0x7fe0d4153410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:40.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.917+0000 7fe0d9bc0700 1 -- 172.21.15.146:0/832142799 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d00094f0 con 0x7fe0d406e6d0 2023-10-06T11:15:40.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.917+0000 7fe0d93bf700 1 --2- 172.21.15.146:0/832142799 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0d40ae900 0x7fe0d4153410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:40.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.917+0000 7fe0da3c1700 1 --2- 172.21.15.146:0/832142799 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0d40c8d70 0x7fe0d4133510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:40.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.918+0000 7fe0d9bc0700 1 --2- 172.21.15.146:0/832142799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0d406e6d0 0x7fe0d4155900 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fe0d406d2d0 tx=0x7fe0d0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:40.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.918+0000 7fe0c9ffb700 1 -- 172.21.15.146:0/832142799 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d0024440 con 0x7fe0d406e6d0 2023-10-06T11:15:40.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.918+0000 7fe0c9ffb700 1 -- 172.21.15.146:0/832142799 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d00245a0 con 0x7fe0d406e6d0 2023-10-06T11:15:40.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.918+0000 7fe0dbe24700 1 -- 172.21.15.146:0/832142799 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0d4156830 con 0x7fe0d406e6d0 2023-10-06T11:15:40.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.918+0000 7fe0c9ffb700 1 -- 172.21.15.146:0/832142799 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d0024960 con 0x7fe0d406e6d0 2023-10-06T11:15:40.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.918+0000 7fe0dbe24700 1 -- 172.21.15.146:0/832142799 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0d4133a50 con 0x7fe0d406e6d0 2023-10-06T11:15:40.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.919+0000 7fe0dbe24700 1 -- 172.21.15.146:0/832142799 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0d404c380 con 0x7fe0d406e6d0 2023-10-06T11:15:40.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.919+0000 7fe0c9ffb700 1 -- 172.21.15.146:0/832142799 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe0d001a420 con 0x7fe0d406e6d0 2023-10-06T11:15:40.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.920+0000 7fe0c9ffb700 1 --2- 172.21.15.146:0/832142799 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe0b8066f30 0x7fe0b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:40.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.920+0000 7fe0d93bf700 1 --2- 172.21.15.146:0/832142799 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe0b8066f30 0x7fe0b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:40.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.920+0000 7fe0c9ffb700 1 -- 172.21.15.146:0/832142799 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe0d00864d0 con 0x7fe0d406e6d0 2023-10-06T11:15:40.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.920+0000 7fe0d93bf700 1 --2- 172.21.15.146:0/832142799 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe0b8066f30 0x7fe0b80693e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fe0d40ca080 tx=0x7fe0c4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:40.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:40.924+0000 7fe0c9ffb700 1 -- 172.21.15.146:0/832142799 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe0d0053660 con 0x7fe0d406e6d0 2023-10-06T11:15:41.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:41.186+0000 7fe0dbe24700 1 -- 172.21.15.146:0/832142799 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe0d406f100 con 0x7fe0d406e6d0 2023-10-06T11:15:41.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:41.187+0000 7fe0c9ffb700 1 -- 172.21.15.146:0/832142799 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1448 (secure 0 0 0) 0x7fe0d0056c80 con 0x7fe0d406e6d0 2023-10-06T11:15:41.189 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:15:41.189 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":615,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":125,"num_osds":8,"num_up_osds":8,"osd_up_since":1696590336,"num_in_osds":8,"osd_in_since":1696590327,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":829,"data_bytes":845671114,"bytes_used":4138213376,"bytes_avail":768955899904,"bytes_total":773094113280,"write_bytes_sec":66481751,"read_op_per_sec":0,"write_op_per_sec":64},"fsmap":{"epoch":108,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":8682}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2023-10-06T11:15:01.259518+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T11:15:41.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:41.189+0000 7fe0dbe24700 1 -- 172.21.15.146:0/832142799 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe0b8066f30 msgr2=0x7fe0b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:41.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:41.189+0000 7fe0dbe24700 1 --2- 172.21.15.146:0/832142799 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe0b8066f30 0x7fe0b80693e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fe0d40ca080 tx=0x7fe0c4008040 comp rx=0 tx=0).stop 2023-10-06T11:15:41.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:41.189+0000 7fe0dbe24700 1 -- 172.21.15.146:0/832142799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0d406e6d0 msgr2=0x7fe0d4155900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:41.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:41.189+0000 7fe0dbe24700 1 --2- 172.21.15.146:0/832142799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0d406e6d0 0x7fe0d4155900 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fe0d406d2d0 tx=0x7fe0d0017000 comp rx=0 tx=0).stop 2023-10-06T11:15:41.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:41.189+0000 7fe0dbe24700 1 -- 172.21.15.146:0/832142799 shutdown_connections 2023-10-06T11:15:41.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:41.189+0000 7fe0dbe24700 1 --2- 172.21.15.146:0/832142799 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe0b8066f30 0x7fe0b80693e0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:41.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:41.189+0000 7fe0dbe24700 1 --2- 172.21.15.146:0/832142799 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0d40c8d70 0x7fe0d4133510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:41.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:41.189+0000 7fe0dbe24700 1 --2- 172.21.15.146:0/832142799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0d406e6d0 0x7fe0d4155900 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:41.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:41.189+0000 7fe0dbe24700 1 --2- 172.21.15.146:0/832142799 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0d40ae900 0x7fe0d4153410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:41.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:41.189+0000 7fe0dbe24700 1 -- 172.21.15.146:0/832142799 >> 172.21.15.146:0/832142799 conn(0x7fe0d40cd530 msgr2=0x7fe0d40cba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:41.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:41.189+0000 7fe0dbe24700 1 -- 172.21.15.146:0/832142799 shutdown_connections 2023-10-06T11:15:41.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:41.189+0000 7fe0dbe24700 1 -- 172.21.15.146:0/832142799 wait complete. 2023-10-06T11:15:41.203 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2023-10-06T11:15:42.204 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:15:42.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.318+0000 7f5ad33f4700 1 Processor -- start 2023-10-06T11:15:42.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.318+0000 7f5ad33f4700 1 -- start start 2023-10-06T11:15:42.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.319+0000 7f5ad33f4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5acc068ba0 0x7f5acc15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:42.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.319+0000 7f5ad33f4700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5acc153e80 0x7f5acc0b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:42.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.319+0000 7f5ad33f4700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5acc15ac30 con 0x7f5acc153ab0 2023-10-06T11:15:42.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.319+0000 7f5ad33f4700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5acc0b4510 con 0x7f5acc068ba0 2023-10-06T11:15:42.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.319+0000 7f5ad33f4700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5acc0b6530 con 0x7f5acc153e80 2023-10-06T11:15:42.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.319+0000 7f5ad098f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5acc068ba0 0x7f5acc15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:42.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.319+0000 7f5ad1190700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f5acc153ab0 0x7f5acc068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:51704/0 (socket says 172.21.15.146:51704) 2023-10-06T11:15:42.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.319+0000 7f5ad1190700 1 -- 172.21.15.146:0/1087561104 learned_addr learned my addr 172.21.15.146:0/1087561104 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:15:42.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.319+0000 7f5ad098f700 1 -- 172.21.15.146:0/1087561104 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5acc153e80 msgr2=0x7f5acc0b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:42.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.319+0000 7f5ad098f700 1 --2- 172.21.15.146:0/1087561104 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5acc153e80 0x7f5acc0b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:42.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.319+0000 7f5ad098f700 1 -- 172.21.15.146:0/1087561104 >> v1:172.21.15.146:6789/0 conn(0x7f5acc153ab0 legacy=0x7f5acc068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:42.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.319+0000 7f5ad098f700 1 -- 172.21.15.146:0/1087561104 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5acc0b5c50 con 0x7f5acc068ba0 2023-10-06T11:15:42.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.319+0000 7f5ac3fff700 1 -- 172.21.15.146:0/1087561104 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3088942305 0 0) 0x7f5ac8001490 con 0x7f5acc153ab0 2023-10-06T11:15:42.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.320+0000 7f5ad098f700 1 --2- 172.21.15.146:0/1087561104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5acc068ba0 0x7f5acc15a6f0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f5abc0098e0 tx=0x7f5abc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71b83a1ca4ff1ea1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:42.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.320+0000 7f5ac3fff700 1 -- 172.21.15.146:0/1087561104 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5abc009e80 con 0x7f5acc068ba0 2023-10-06T11:15:42.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.320+0000 7f5ac3fff700 1 -- 172.21.15.146:0/1087561104 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5abc00b860 con 0x7f5acc068ba0 2023-10-06T11:15:42.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.320+0000 7f5ac3fff700 1 -- 172.21.15.146:0/1087561104 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5abc00bbe0 con 0x7f5acc068ba0 2023-10-06T11:15:42.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.320+0000 7f5ad33f4700 1 -- 172.21.15.146:0/1087561104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5acc068ba0 msgr2=0x7f5acc15a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:42.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.320+0000 7f5ad33f4700 1 --2- 172.21.15.146:0/1087561104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5acc068ba0 0x7f5acc15a6f0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f5abc0098e0 tx=0x7f5abc0091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:42.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.320+0000 7f5ad33f4700 1 -- 172.21.15.146:0/1087561104 shutdown_connections 2023-10-06T11:15:42.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.320+0000 7f5ad33f4700 1 --2- 172.21.15.146:0/1087561104 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5acc153e80 0x7f5acc0b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:42.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.320+0000 7f5ad33f4700 1 --2- 172.21.15.146:0/1087561104 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5acc068ba0 0x7f5acc15a6f0 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:42.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.320+0000 7f5ad33f4700 1 -- 172.21.15.146:0/1087561104 >> 172.21.15.146:0/1087561104 conn(0x7f5acc06eba0 msgr2=0x7f5acc06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:42.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.320+0000 7f5ad33f4700 1 -- 172.21.15.146:0/1087561104 shutdown_connections 2023-10-06T11:15:42.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.320+0000 7f5ad33f4700 1 -- 172.21.15.146:0/1087561104 wait complete. 2023-10-06T11:15:42.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.321+0000 7f5ad33f4700 1 Processor -- start 2023-10-06T11:15:42.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.321+0000 7f5ad33f4700 1 -- start start 2023-10-06T11:15:42.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.322+0000 7f5ad33f4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5acc068ba0 0x7f5acc15bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:42.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.322+0000 7f5ad33f4700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5acc153ab0 0x7f5acc15a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:42.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.322+0000 7f5ad33f4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5acc153e80 0x7f5acc157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:42.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.322+0000 7f5ad33f4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5acc1594c0 con 0x7f5acc153e80 2023-10-06T11:15:42.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.322+0000 7f5ad33f4700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5acc16e110 con 0x7f5acc068ba0 2023-10-06T11:15:42.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.322+0000 7f5ad33f4700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5acc159760 con 0x7f5acc153ab0 2023-10-06T11:15:42.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.322+0000 7f5ad1991700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5acc153e80 0x7f5acc157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:42.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.322+0000 7f5ad1991700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5acc153e80 0x7f5acc157210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48588/0 (socket says 172.21.15.146:48588) 2023-10-06T11:15:42.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.322+0000 7f5ad1991700 1 -- 172.21.15.146:0/3247553101 learned_addr learned my addr 172.21.15.146:0/3247553101 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:42.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.323+0000 7f5ad098f700 1 --2- 172.21.15.146:0/3247553101 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5acc153ab0 0x7f5acc15a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:42.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.323+0000 7f5ad1991700 1 -- 172.21.15.146:0/3247553101 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5acc153ab0 msgr2=0x7f5acc15a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:42.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.323+0000 7f5ad1190700 1 --2- 172.21.15.146:0/3247553101 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5acc068ba0 0x7f5acc15bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:42.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.323+0000 7f5ad1991700 1 --2- 172.21.15.146:0/3247553101 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5acc153ab0 0x7f5acc15a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:42.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.323+0000 7f5ad1991700 1 -- 172.21.15.146:0/3247553101 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5acc068ba0 msgr2=0x7f5acc15bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:42.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.323+0000 7f5ad1991700 1 --2- 172.21.15.146:0/3247553101 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5acc068ba0 0x7f5acc15bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:42.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.323+0000 7f5ad1991700 1 -- 172.21.15.146:0/3247553101 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5abc009420 con 0x7f5acc153e80 2023-10-06T11:15:42.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.323+0000 7f5ad1991700 1 --2- 172.21.15.146:0/3247553101 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5acc153e80 0x7f5acc157210 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f5ac400b810 tx=0x7f5ac40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:42.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.323+0000 7f5ac17fa700 1 -- 172.21.15.146:0/3247553101 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac400f570 con 0x7f5acc153e80 2023-10-06T11:15:42.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.323+0000 7f5ac17fa700 1 -- 172.21.15.146:0/3247553101 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac400f6f0 con 0x7f5acc153e80 2023-10-06T11:15:42.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.323+0000 7f5ad33f4700 1 -- 172.21.15.146:0/3247553101 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5acc159a40 con 0x7f5acc153e80 2023-10-06T11:15:42.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.323+0000 7f5ac17fa700 1 -- 172.21.15.146:0/3247553101 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac400fab0 con 0x7f5acc153e80 2023-10-06T11:15:42.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.323+0000 7f5ad33f4700 1 -- 172.21.15.146:0/3247553101 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5acc157d80 con 0x7f5acc153e80 2023-10-06T11:15:42.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.324+0000 7f5ad33f4700 1 -- 172.21.15.146:0/3247553101 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5acc04c380 con 0x7f5acc153e80 2023-10-06T11:15:42.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.324+0000 7f5ac17fa700 1 -- 172.21.15.146:0/3247553101 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5ac401a460 con 0x7f5acc153e80 2023-10-06T11:15:42.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.325+0000 7f5ac17fa700 1 --2- 172.21.15.146:0/3247553101 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5ab0066f30 0x7f5ab00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:42.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.325+0000 7f5ac17fa700 1 -- 172.21.15.146:0/3247553101 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5ac40843c0 con 0x7f5acc153e80 2023-10-06T11:15:42.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.325+0000 7f5ad1190700 1 --2- 172.21.15.146:0/3247553101 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5ab0066f30 0x7f5ab00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:42.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.325+0000 7f5ad1190700 1 --2- 172.21.15.146:0/3247553101 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5ab0066f30 0x7f5ab00693e0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8002220 tx=0x7f5ac8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:42.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.329+0000 7f5ac17fa700 1 -- 172.21.15.146:0/3247553101 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ac4051550 con 0x7f5acc153e80 2023-10-06T11:15:42.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.556+0000 7f5ad33f4700 1 -- 172.21.15.146:0/3247553101 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5acc0b6250 con 0x7f5acc153e80 2023-10-06T11:15:42.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.556+0000 7f5ac17fa700 1 -- 172.21.15.146:0/3247553101 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) v1 ==== 95+0+4617 (secure 0 0 0) 0x7f5ac4054b70 con 0x7f5acc153e80 2023-10-06T11:15:42.558 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:15:42.558 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":108,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7792,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3693464886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3693464886},{"type":"v1","addr":"172.21.15.151:6834","nonce":3693464886}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103},{"gid":7795,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1155762565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":1155762565},{"type":"v1","addr":"172.21.15.151:6835","nonce":1155762565}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103},{"gid":8679,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/3868720724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3868720724},{"type":"v1","addr":"172.21.15.146:6836","nonce":3868720724}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:15:11.929158+0000","modified":"2023-10-06T11:15:15.569866+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8682},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8682":{"gid":8682,"name":"c","rank":0,"incarnation":104,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/1974709597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":1974709597},{"type":"v1","addr":"172.21.15.146:6837","nonce":1974709597}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-06T11:15:42.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.559+0000 7f5ad33f4700 1 -- 172.21.15.146:0/3247553101 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5ab0066f30 msgr2=0x7f5ab00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:42.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.559+0000 7f5ad33f4700 1 --2- 172.21.15.146:0/3247553101 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5ab0066f30 0x7f5ab00693e0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8002220 tx=0x7f5ac8009040 comp rx=0 tx=0).stop 2023-10-06T11:15:42.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.559+0000 7f5ad33f4700 1 -- 172.21.15.146:0/3247553101 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5acc153e80 msgr2=0x7f5acc157210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:42.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.559+0000 7f5ad33f4700 1 --2- 172.21.15.146:0/3247553101 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5acc153e80 0x7f5acc157210 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f5ac400b810 tx=0x7f5ac40091d0 comp rx=0 tx=0).stop 2023-10-06T11:15:42.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.559+0000 7f5ad33f4700 1 -- 172.21.15.146:0/3247553101 shutdown_connections 2023-10-06T11:15:42.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.559+0000 7f5ad33f4700 1 --2- 172.21.15.146:0/3247553101 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5ab0066f30 0x7f5ab00693e0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:42.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.559+0000 7f5ad33f4700 1 --2- 172.21.15.146:0/3247553101 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5acc153e80 0x7f5acc157210 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:42.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.559+0000 7f5ad33f4700 1 --2- 172.21.15.146:0/3247553101 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5acc068ba0 0x7f5acc15bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:42.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.559+0000 7f5ad33f4700 1 --2- 172.21.15.146:0/3247553101 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5acc153ab0 0x7f5acc15a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:42.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.559+0000 7f5ad33f4700 1 -- 172.21.15.146:0/3247553101 >> 172.21.15.146:0/3247553101 conn(0x7f5acc06eba0 msgr2=0x7f5acc151ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:42.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.559+0000 7f5ad33f4700 1 -- 172.21.15.146:0/3247553101 shutdown_connections 2023-10-06T11:15:42.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.559+0000 7f5ad33f4700 1 -- 172.21.15.146:0/3247553101 wait complete. 2023-10-06T11:15:42.562 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 108 2023-10-06T11:15:42.572 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2023-10-06T11:15:42.572 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T11:15:42.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.685+0000 7fc9f68ff700 1 Processor -- start 2023-10-06T11:15:42.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.685+0000 7fc9f68ff700 1 -- start start 2023-10-06T11:15:42.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.686+0000 7fc9f68ff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc9f015a420 0x7fc9f015cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:42.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.686+0000 7fc9f68ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc9f00b2530 0x7fc9f015acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:42.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.686+0000 7fc9f68ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9f015c630 con 0x7fc9f015a7f0 2023-10-06T11:15:42.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.686+0000 7fc9f68ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9f00ce040 con 0x7fc9f00b2530 2023-10-06T11:15:42.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.686+0000 7fc9f68ff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9f015ba20 con 0x7fc9f015a420 2023-10-06T11:15:42.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.686+0000 7fc9f60fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc9f00b2530 0x7fc9f015acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:42.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.686+0000 7fc9f60fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc9f00b2530 0x7fc9f015acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48600/0 (socket says 172.21.15.146:48600) 2023-10-06T11:15:42.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.686+0000 7fc9f60fe700 1 -- 172.21.15.146:0/481821252 learned_addr learned my addr 172.21.15.146:0/481821252 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:42.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.686+0000 7fc9f58fd700 1 --2- 172.21.15.146:0/481821252 >> v2:172.21.15.151:3300/0 conn(0x7fc9f015a420 0x7fc9f015cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:42.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.686+0000 7fc9f60fe700 1 -- 172.21.15.146:0/481821252 >> v2:172.21.15.151:3300/0 conn(0x7fc9f015a420 msgr2=0x7fc9f015cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:42.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.686+0000 7fc9f60fe700 1 --2- 172.21.15.146:0/481821252 >> v2:172.21.15.151:3300/0 conn(0x7fc9f015a420 0x7fc9f015cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:42.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.686+0000 7fc9f60fe700 1 -- 172.21.15.146:0/481821252 >> v1:172.21.15.151:6789/0 conn(0x7fc9f015a7f0 legacy=0x7fc9f00b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:42.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.686+0000 7fc9f60fe700 1 -- 172.21.15.146:0/481821252 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f015bd00 con 0x7fc9f00b2530 2023-10-06T11:15:42.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.687+0000 7fc9f60fe700 1 --2- 172.21.15.146:0/481821252 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9f00b2530 0x7fc9f015acd0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fc9f00d1460 tx=0x7fc9e8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0c246e66273e92a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:42.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.687+0000 7fc9f48fb700 1 -- 172.21.15.146:0/481821252 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e800e070 con 0x7fc9f00b2530 2023-10-06T11:15:42.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.687+0000 7fc9f48fb700 1 -- 172.21.15.146:0/481821252 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e800ba20 con 0x7fc9f00b2530 2023-10-06T11:15:42.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.687+0000 7fc9f48fb700 1 -- 172.21.15.146:0/481821252 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e80092e0 con 0x7fc9f00b2530 2023-10-06T11:15:42.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.687+0000 7fc9f68ff700 1 -- 172.21.15.146:0/481821252 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9f00b2530 msgr2=0x7fc9f015acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:42.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.687+0000 7fc9f68ff700 1 --2- 172.21.15.146:0/481821252 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9f00b2530 0x7fc9f015acd0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fc9f00d1460 tx=0x7fc9e8009840 comp rx=0 tx=0).stop 2023-10-06T11:15:42.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.687+0000 7fc9f68ff700 1 -- 172.21.15.146:0/481821252 shutdown_connections 2023-10-06T11:15:42.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.687+0000 7fc9f68ff700 1 --2- 172.21.15.146:0/481821252 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9f00b2530 0x7fc9f015acd0 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:42.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.687+0000 7fc9f68ff700 1 --2- 172.21.15.146:0/481821252 >> v2:172.21.15.151:3300/0 conn(0x7fc9f015a420 0x7fc9f015cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:42.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.687+0000 7fc9f68ff700 1 -- 172.21.15.146:0/481821252 >> 172.21.15.146:0/481821252 conn(0x7fc9f006eba0 msgr2=0x7fc9f006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:42.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.687+0000 7fc9f68ff700 1 -- 172.21.15.146:0/481821252 shutdown_connections 2023-10-06T11:15:42.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.687+0000 7fc9f68ff700 1 -- 172.21.15.146:0/481821252 wait complete. 2023-10-06T11:15:42.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.688+0000 7fc9f68ff700 1 Processor -- start 2023-10-06T11:15:42.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.688+0000 7fc9f68ff700 1 -- start start 2023-10-06T11:15:42.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.689+0000 7fc9f68ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9f00b2530 0x7fc9f00cfe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:42.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.689+0000 7fc9f68ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9f015a420 0x7fc9f013a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:42.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.689+0000 7fc9f68ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9f015a7f0 0x7fc9f01538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:42.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.689+0000 7fc9f68ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f00cf9b0 con 0x7fc9f00b2530 2023-10-06T11:15:42.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.689+0000 7fc9f68ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f013ae70 con 0x7fc9f015a420 2023-10-06T11:15:42.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.689+0000 7fc9f68ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f0150ed0 con 0x7fc9f015a7f0 2023-10-06T11:15:42.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.689+0000 7fc9f58fd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9f00b2530 0x7fc9f00cfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:42.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.689+0000 7fc9f58fd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9f00b2530 0x7fc9f00cfe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48604/0 (socket says 172.21.15.146:48604) 2023-10-06T11:15:42.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.689+0000 7fc9f58fd700 1 -- 172.21.15.146:0/2205122625 learned_addr learned my addr 172.21.15.146:0/2205122625 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:42.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.689+0000 7fc9f50fc700 1 --2- 172.21.15.146:0/2205122625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9f015a420 0x7fc9f013a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:42.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.689+0000 7fc9f60fe700 1 --2- 172.21.15.146:0/2205122625 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9f015a7f0 0x7fc9f01538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:42.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.689+0000 7fc9f58fd700 1 -- 172.21.15.146:0/2205122625 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9f015a7f0 msgr2=0x7fc9f01538c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:42.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.689+0000 7fc9f58fd700 1 --2- 172.21.15.146:0/2205122625 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9f015a7f0 0x7fc9f01538c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:42.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.689+0000 7fc9f58fd700 1 -- 172.21.15.146:0/2205122625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9f015a420 msgr2=0x7fc9f013a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:42.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.689+0000 7fc9f58fd700 1 --2- 172.21.15.146:0/2205122625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9f015a420 0x7fc9f013a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:42.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.689+0000 7fc9f58fd700 1 -- 172.21.15.146:0/2205122625 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9e8009ae0 con 0x7fc9f00b2530 2023-10-06T11:15:42.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.690+0000 7fc9f50fc700 1 --2- 172.21.15.146:0/2205122625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9f015a420 0x7fc9f013a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:42.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.690+0000 7fc9f58fd700 1 --2- 172.21.15.146:0/2205122625 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9f00b2530 0x7fc9f00cfe40 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fc9e000ec80 tx=0x7fc9e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:42.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.690+0000 7fc9edffb700 1 -- 172.21.15.146:0/2205122625 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e000c9d0 con 0x7fc9f00b2530 2023-10-06T11:15:42.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.690+0000 7fc9edffb700 1 -- 172.21.15.146:0/2205122625 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9e000cb30 con 0x7fc9f00b2530 2023-10-06T11:15:42.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.690+0000 7fc9f68ff700 1 -- 172.21.15.146:0/2205122625 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9f01511b0 con 0x7fc9f00b2530 2023-10-06T11:15:42.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.690+0000 7fc9edffb700 1 -- 172.21.15.146:0/2205122625 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9e0013470 con 0x7fc9f00b2530 2023-10-06T11:15:42.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.690+0000 7fc9f68ff700 1 -- 172.21.15.146:0/2205122625 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9f00cf360 con 0x7fc9f00b2530 2023-10-06T11:15:42.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.691+0000 7fc9f68ff700 1 -- 172.21.15.146:0/2205122625 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9f00b02b0 con 0x7fc9f00b2530 2023-10-06T11:15:42.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.691+0000 7fc9edffb700 1 -- 172.21.15.146:0/2205122625 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc9e0013820 con 0x7fc9f00b2530 2023-10-06T11:15:42.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.692+0000 7fc9edffb700 1 --2- 172.21.15.146:0/2205122625 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc9dc066f30 0x7fc9dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:42.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.692+0000 7fc9edffb700 1 -- 172.21.15.146:0/2205122625 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc9e0084a40 con 0x7fc9f00b2530 2023-10-06T11:15:42.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.692+0000 7fc9f50fc700 1 --2- 172.21.15.146:0/2205122625 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc9dc066f30 0x7fc9dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:42.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.692+0000 7fc9f50fc700 1 --2- 172.21.15.146:0/2205122625 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc9dc066f30 0x7fc9dc0693e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4007fd0 tx=0x7fc9e4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:42.699 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.696+0000 7fc9edffb700 1 -- 172.21.15.146:0/2205122625 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc9e0051ab0 con 0x7fc9f00b2530 2023-10-06T11:15:42.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.954+0000 7fc9f68ff700 1 -- 172.21.15.146:0/2205122625 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fc9f00cfc90 con 0x7fc9f00b2530 2023-10-06T11:15:42.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.954+0000 7fc9edffb700 1 -- 172.21.15.146:0/2205122625 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1448 (secure 0 0 0) 0x7fc9e00550d0 con 0x7fc9f00b2530 2023-10-06T11:15:42.956 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:15:42.956 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":617,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":125,"num_osds":8,"num_up_osds":8,"osd_up_since":1696590336,"num_in_osds":8,"osd_in_since":1696590327,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":829,"data_bytes":845671114,"bytes_used":4138213376,"bytes_avail":768955899904,"bytes_total":773094113280,"write_bytes_sec":62375449,"read_op_per_sec":0,"write_op_per_sec":60},"fsmap":{"epoch":108,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":8682}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":23,"modified":"2023-10-06T11:15:01.259518+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T11:15:42.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.956+0000 7fc9f68ff700 1 -- 172.21.15.146:0/2205122625 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc9dc066f30 msgr2=0x7fc9dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:42.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.956+0000 7fc9f68ff700 1 --2- 172.21.15.146:0/2205122625 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc9dc066f30 0x7fc9dc0693e0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fc9e4007fd0 tx=0x7fc9e4009040 comp rx=0 tx=0).stop 2023-10-06T11:15:42.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.956+0000 7fc9f68ff700 1 -- 172.21.15.146:0/2205122625 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9f00b2530 msgr2=0x7fc9f00cfe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:42.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.956+0000 7fc9f68ff700 1 --2- 172.21.15.146:0/2205122625 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9f00b2530 0x7fc9f00cfe40 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fc9e000ec80 tx=0x7fc9e00091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:42.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.956+0000 7fc9f68ff700 1 -- 172.21.15.146:0/2205122625 shutdown_connections 2023-10-06T11:15:42.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.956+0000 7fc9f68ff700 1 --2- 172.21.15.146:0/2205122625 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc9dc066f30 0x7fc9dc0693e0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:42.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.956+0000 7fc9f68ff700 1 --2- 172.21.15.146:0/2205122625 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc9f015a7f0 0x7fc9f01538c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:42.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.956+0000 7fc9f68ff700 1 --2- 172.21.15.146:0/2205122625 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc9f00b2530 0x7fc9f00cfe40 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:42.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.956+0000 7fc9f68ff700 1 --2- 172.21.15.146:0/2205122625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9f015a420 0x7fc9f013a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:42.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.956+0000 7fc9f68ff700 1 -- 172.21.15.146:0/2205122625 >> 172.21.15.146:0/2205122625 conn(0x7fc9f006eba0 msgr2=0x7fc9f00b1420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:42.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.956+0000 7fc9f68ff700 1 -- 172.21.15.146:0/2205122625 shutdown_connections 2023-10-06T11:15:42.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:42.956+0000 7fc9f68ff700 1 -- 172.21.15.146:0/2205122625 wait complete. 2023-10-06T11:15:42.969 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2023-10-06T11:15:43.970 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:15:44.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.093+0000 7f80795b9700 1 Processor -- start 2023-10-06T11:15:44.095 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.093+0000 7f80795b9700 1 -- start start 2023-10-06T11:15:44.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.094+0000 7f80795b9700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8074153ab0 0x7f807415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:44.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.094+0000 7f80795b9700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f807415ac30 con 0x7f8074153e80 2023-10-06T11:15:44.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.094+0000 7f80795b9700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80740b4510 con 0x7f8074068ba0 2023-10-06T11:15:44.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.094+0000 7f80795b9700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80740b6530 con 0x7f8074153ab0 2023-10-06T11:15:44.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.094+0000 7f806a7fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8074153e80 0x7f8074068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:51708/0 (socket says 172.21.15.146:51708) 2023-10-06T11:15:44.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.094+0000 7f806a7fc700 1 -- 172.21.15.146:0/3945403145 learned_addr learned my addr 172.21.15.146:0/3945403145 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:15:44.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.094+0000 7f8072ffd700 1 --2- 172.21.15.146:0/3945403145 >> v2:172.21.15.151:3300/0 conn(0x7f8074153ab0 0x7f807415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:44.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.094+0000 7f80727fc700 1 -- 172.21.15.146:0/3945403145 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 659762807 0 0) 0x7f805c001110 con 0x7f8074153e80 2023-10-06T11:15:44.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.095+0000 7f80727fc700 1 -- 172.21.15.146:0/3945403145 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8060003570 con 0x7f8074153e80 2023-10-06T11:15:44.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.095+0000 7f80727fc700 1 -- 172.21.15.146:0/3945403145 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2949706556 0 0) 0x7f8060003570 con 0x7f8074153e80 2023-10-06T11:15:44.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.095+0000 7f80727fc700 1 -- 172.21.15.146:0/3945403145 >> v2:172.21.15.151:3300/0 conn(0x7f8074153ab0 msgr2=0x7f807415a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:44.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.095+0000 7f80727fc700 1 --2- 172.21.15.146:0/3945403145 >> v2:172.21.15.151:3300/0 conn(0x7f8074153ab0 0x7f807415a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:44.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.095+0000 7f80727fc700 1 -- 172.21.15.146:0/3945403145 >> v1:172.21.15.151:6789/0 conn(0x7f8074068ba0 legacy=0x7f80740b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:44.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.095+0000 7f80727fc700 1 -- 172.21.15.146:0/3945403145 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80740b5c50 con 0x7f8074153e80 2023-10-06T11:15:44.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.095+0000 7f80727fc700 1 -- 172.21.15.146:0/3945403145 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f805c001600 con 0x7f8074153e80 2023-10-06T11:15:44.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.095+0000 7f80727fc700 1 -- 172.21.15.146:0/3945403145 >> v1:172.21.15.146:6789/0 conn(0x7f8074153e80 legacy=0x7f8074068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:44.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.095+0000 7f80727fc700 1 --2- 172.21.15.146:0/3945403145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8060003a60 0x7f8060003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:44.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.095+0000 7f80727fc700 1 --2- 172.21.15.146:0/3945403145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8060004810 0x7f8060004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:44.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.095+0000 7f80727fc700 1 --2- 172.21.15.146:0/3945403145 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80600051c0 0x7f806000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:44.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.095+0000 7f80727fc700 1 -- 172.21.15.146:0/3945403145 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80740b6530 con 0x7f8060004810 2023-10-06T11:15:44.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.095+0000 7f80727fc700 1 -- 172.21.15.146:0/3945403145 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f806000c0d0 con 0x7f8060003a60 2023-10-06T11:15:44.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.095+0000 7f80727fc700 1 -- 172.21.15.146:0/3945403145 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f806000c290 con 0x7f80600051c0 2023-10-06T11:15:44.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.095+0000 7f8072ffd700 1 --2- 172.21.15.146:0/3945403145 >> v2:172.21.15.151:3300/0 conn(0x7f8074153ab0 0x7f807415a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:15:44.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.095+0000 7f806a7fc700 1 --2- 172.21.15.146:0/3945403145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8060004810 0x7f8060004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:44.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.095+0000 7f80737fe700 1 --2- 172.21.15.146:0/3945403145 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80600051c0 0x7f806000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:44.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.095+0000 7f8072ffd700 1 --2- 172.21.15.146:0/3945403145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8060003a60 0x7f8060003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:44.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.095+0000 7f806a7fc700 1 -- 172.21.15.146:0/3945403145 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80600051c0 msgr2=0x7f806000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:44.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.095+0000 7f806a7fc700 1 --2- 172.21.15.146:0/3945403145 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80600051c0 0x7f806000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:44.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.095+0000 7f806a7fc700 1 -- 172.21.15.146:0/3945403145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8060003a60 msgr2=0x7f8060003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:44.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.095+0000 7f806a7fc700 1 --2- 172.21.15.146:0/3945403145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8060003a60 0x7f8060003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:44.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.095+0000 7f806a7fc700 1 -- 172.21.15.146:0/3945403145 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8060003570 con 0x7f8060004810 2023-10-06T11:15:44.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.095+0000 7f80737fe700 1 --2- 172.21.15.146:0/3945403145 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80600051c0 0x7f806000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:44.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.095+0000 7f8072ffd700 1 --2- 172.21.15.146:0/3945403145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8060003a60 0x7f8060003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:15:44.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.095+0000 7f80737fe700 1 -- 172.21.15.146:0/3945403145 reap_dead start 2023-10-06T11:15:44.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.095+0000 7f806a7fc700 1 --2- 172.21.15.146:0/3945403145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8060004810 0x7f8060004c80 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f805c00c5f0 tx=0x7f80740b3db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fd7acd891cd713b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:44.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.095+0000 7f80727fc700 1 -- 172.21.15.146:0/3945403145 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f805c00cdf0 con 0x7f8060004810 2023-10-06T11:15:44.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.095+0000 7f80727fc700 1 -- 172.21.15.146:0/3945403145 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f805c005920 con 0x7f8060004810 2023-10-06T11:15:44.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.095+0000 7f80727fc700 1 -- 172.21.15.146:0/3945403145 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f805c005ce0 con 0x7f8060004810 2023-10-06T11:15:44.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.096+0000 7f80795b9700 1 -- 172.21.15.146:0/3945403145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8060004810 msgr2=0x7f8060004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:44.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.096+0000 7f80795b9700 1 --2- 172.21.15.146:0/3945403145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8060004810 0x7f8060004c80 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f805c00c5f0 tx=0x7f80740b3db0 comp rx=0 tx=0).stop 2023-10-06T11:15:44.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.096+0000 7f80795b9700 1 -- 172.21.15.146:0/3945403145 shutdown_connections 2023-10-06T11:15:44.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.096+0000 7f80795b9700 1 --2- 172.21.15.146:0/3945403145 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8060004810 0x7f8060004c80 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:44.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.096+0000 7f80795b9700 1 -- 172.21.15.146:0/3945403145 >> 172.21.15.146:0/3945403145 conn(0x7f807406eba0 msgr2=0x7f807406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:44.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.096+0000 7f80795b9700 1 -- 172.21.15.146:0/3945403145 shutdown_connections 2023-10-06T11:15:44.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.096+0000 7f80795b9700 1 -- 172.21.15.146:0/3945403145 wait complete. 2023-10-06T11:15:44.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.097+0000 7f80795b9700 1 Processor -- start 2023-10-06T11:15:44.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.097+0000 7f80795b9700 1 -- start start 2023-10-06T11:15:44.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.098+0000 7f80795b9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8060004810 0x7f80740b2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:44.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.098+0000 7f80795b9700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80740b10e0 0x7f80741430c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:44.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.098+0000 7f80795b9700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80741542a0 0x7f807415add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:44.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.098+0000 7f80795b9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8074143600 con 0x7f8060004810 2023-10-06T11:15:44.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.098+0000 7f80795b9700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8074150550 con 0x7f80740b10e0 2023-10-06T11:15:44.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.098+0000 7f80795b9700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80740b15a0 con 0x7f80741542a0 2023-10-06T11:15:44.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.098+0000 7f8072ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8060004810 0x7f80740b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:44.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.098+0000 7f8072ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8060004810 0x7f80740b2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48622/0 (socket says 172.21.15.146:48622) 2023-10-06T11:15:44.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.098+0000 7f8072ffd700 1 -- 172.21.15.146:0/644688417 learned_addr learned my addr 172.21.15.146:0/644688417 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:44.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.098+0000 7f8072ffd700 1 -- 172.21.15.146:0/644688417 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80741542a0 msgr2=0x7f807415add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:44.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.098+0000 7f8072ffd700 1 --2- 172.21.15.146:0/644688417 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80741542a0 0x7f807415add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:44.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.098+0000 7f8072ffd700 1 -- 172.21.15.146:0/644688417 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80740b10e0 msgr2=0x7f80741430c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:44.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.098+0000 7f8072ffd700 1 --2- 172.21.15.146:0/644688417 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80740b10e0 0x7f80741430c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:44.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.098+0000 7f8072ffd700 1 -- 172.21.15.146:0/644688417 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80740b1880 con 0x7f8060004810 2023-10-06T11:15:44.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.099+0000 7f8072ffd700 1 --2- 172.21.15.146:0/644688417 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8060004810 0x7f80740b2640 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f8064010ca0 tx=0x7f8064008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:44.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.099+0000 7f806b7fe700 1 -- 172.21.15.146:0/644688417 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8064010eb0 con 0x7f8060004810 2023-10-06T11:15:44.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.099+0000 7f806b7fe700 1 -- 172.21.15.146:0/644688417 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806400eba0 con 0x7f8060004810 2023-10-06T11:15:44.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.099+0000 7f806b7fe700 1 -- 172.21.15.146:0/644688417 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f806401c400 con 0x7f8060004810 2023-10-06T11:15:44.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.099+0000 7f80795b9700 1 -- 172.21.15.146:0/644688417 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80740b1b60 con 0x7f8060004810 2023-10-06T11:15:44.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.099+0000 7f80795b9700 1 -- 172.21.15.146:0/644688417 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80740b2120 con 0x7f8060004810 2023-10-06T11:15:44.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.100+0000 7f80795b9700 1 -- 172.21.15.146:0/644688417 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f807404c380 con 0x7f8060004810 2023-10-06T11:15:44.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.100+0000 7f806b7fe700 1 -- 172.21.15.146:0/644688417 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f80640143f0 con 0x7f8060004810 2023-10-06T11:15:44.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.101+0000 7f806b7fe700 1 --2- 172.21.15.146:0/644688417 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8054066f30 0x7f80540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:44.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.101+0000 7f806a7fc700 1 --2- 172.21.15.146:0/644688417 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8054066f30 0x7f80540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:44.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.101+0000 7f806b7fe700 1 -- 172.21.15.146:0/644688417 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f80640849d0 con 0x7f8060004810 2023-10-06T11:15:44.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.101+0000 7f806a7fc700 1 --2- 172.21.15.146:0/644688417 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8054066f30 0x7f80540693e0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f80740b0fc0 tx=0x7f805c015000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:44.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.105+0000 7f806b7fe700 1 -- 172.21.15.146:0/644688417 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8064055570 con 0x7f8060004810 2023-10-06T11:15:44.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.329+0000 7f80795b9700 1 -- 172.21.15.146:0/644688417 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f80740b6250 con 0x7f8060004810 2023-10-06T11:15:44.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.329+0000 7f806b7fe700 1 -- 172.21.15.146:0/644688417 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) v1 ==== 95+0+4617 (secure 0 0 0) 0x7f8064055100 con 0x7f8060004810 2023-10-06T11:15:44.331 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:15:44.331 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":108,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7792,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3693464886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3693464886},{"type":"v1","addr":"172.21.15.151:6834","nonce":3693464886}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103},{"gid":7795,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1155762565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":1155762565},{"type":"v1","addr":"172.21.15.151:6835","nonce":1155762565}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103},{"gid":8679,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/3868720724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3868720724},{"type":"v1","addr":"172.21.15.146:6836","nonce":3868720724}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:15:11.929158+0000","modified":"2023-10-06T11:15:15.569866+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8682},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8682":{"gid":8682,"name":"c","rank":0,"incarnation":104,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/1974709597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":1974709597},{"type":"v1","addr":"172.21.15.146:6837","nonce":1974709597}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-06T11:15:44.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.331+0000 7f80795b9700 1 -- 172.21.15.146:0/644688417 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8054066f30 msgr2=0x7f80540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:44.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.331+0000 7f80795b9700 1 --2- 172.21.15.146:0/644688417 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8054066f30 0x7f80540693e0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f80740b0fc0 tx=0x7f805c015000 comp rx=0 tx=0).stop 2023-10-06T11:15:44.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.331+0000 7f80795b9700 1 -- 172.21.15.146:0/644688417 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8060004810 msgr2=0x7f80740b2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:44.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.331+0000 7f80795b9700 1 --2- 172.21.15.146:0/644688417 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8060004810 0x7f80740b2640 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f8064010ca0 tx=0x7f8064008040 comp rx=0 tx=0).stop 2023-10-06T11:15:44.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.331+0000 7f80795b9700 1 -- 172.21.15.146:0/644688417 shutdown_connections 2023-10-06T11:15:44.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.331+0000 7f80795b9700 1 --2- 172.21.15.146:0/644688417 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8054066f30 0x7f80540693e0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:44.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.331+0000 7f80795b9700 1 --2- 172.21.15.146:0/644688417 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80741542a0 0x7f807415add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:44.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.331+0000 7f80795b9700 1 --2- 172.21.15.146:0/644688417 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8060004810 0x7f80740b2640 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:44.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.331+0000 7f80795b9700 1 --2- 172.21.15.146:0/644688417 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80740b10e0 0x7f80741430c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:44.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.331+0000 7f80795b9700 1 -- 172.21.15.146:0/644688417 >> 172.21.15.146:0/644688417 conn(0x7f807406eba0 msgr2=0x7f80740cee80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:44.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.331+0000 7f80795b9700 1 -- 172.21.15.146:0/644688417 shutdown_connections 2023-10-06T11:15:44.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.331+0000 7f80795b9700 1 -- 172.21.15.146:0/644688417 wait complete. 2023-10-06T11:15:44.334 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 108 2023-10-06T11:15:44.345 DEBUG:tasks.cephfs.test_scrub_checks:current active=['c'] 2023-10-06T11:15:44.345 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T11:15:44.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.457+0000 7f929cee3700 1 Processor -- start 2023-10-06T11:15:44.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.457+0000 7f929cee3700 1 -- start start 2023-10-06T11:15:44.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.458+0000 7f929cee3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9298068ba0 0x7f929815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:44.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.458+0000 7f929cee3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9298153e80 0x7f92980b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:44.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.458+0000 7f929cee3700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f929815ac30 con 0x7f9298153ab0 2023-10-06T11:15:44.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.458+0000 7f929cee3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92980b4510 con 0x7f9298153e80 2023-10-06T11:15:44.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.458+0000 7f929cee3700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92980b6530 con 0x7f9298068ba0 2023-10-06T11:15:44.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.458+0000 7f9296d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9298153e80 0x7f92980b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:44.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.458+0000 7f929659c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f9298153ab0 0x7f9298068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:51714/0 (socket says 172.21.15.146:51714) 2023-10-06T11:15:44.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.458+0000 7f929659c700 1 -- 172.21.15.146:0/401716304 learned_addr learned my addr 172.21.15.146:0/401716304 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:15:44.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.458+0000 7f928dd9b700 1 --2- 172.21.15.146:0/401716304 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9298068ba0 0x7f929815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:44.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.459+0000 7f9296d9d700 1 -- 172.21.15.146:0/401716304 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9298068ba0 msgr2=0x7f929815a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:44.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.459+0000 7f9296d9d700 1 --2- 172.21.15.146:0/401716304 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9298068ba0 0x7f929815a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:44.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.459+0000 7f9296d9d700 1 -- 172.21.15.146:0/401716304 >> v1:172.21.15.146:6789/0 conn(0x7f9298153ab0 legacy=0x7f9298068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:44.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.459+0000 7f9295d9b700 1 -- 172.21.15.146:0/401716304 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4137477849 0 0) 0x7f9288001110 con 0x7f9298153ab0 2023-10-06T11:15:44.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.459+0000 7f9296d9d700 1 -- 172.21.15.146:0/401716304 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92980b5c50 con 0x7f9298153e80 2023-10-06T11:15:44.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.459+0000 7f9296d9d700 1 --2- 172.21.15.146:0/401716304 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9298153e80 0x7f92980b49a0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f9290009e60 tx=0x7f9290009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e001620575abff9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:44.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.459+0000 7f9295d9b700 1 -- 172.21.15.146:0/401716304 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929000e070 con 0x7f9298153e80 2023-10-06T11:15:44.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.459+0000 7f9295d9b700 1 -- 172.21.15.146:0/401716304 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f929000bc30 con 0x7f9298153e80 2023-10-06T11:15:44.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.459+0000 7f9295d9b700 1 -- 172.21.15.146:0/401716304 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9290012430 con 0x7f9298153e80 2023-10-06T11:15:44.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.459+0000 7f929cee3700 1 -- 172.21.15.146:0/401716304 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9298153e80 msgr2=0x7f92980b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:44.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.459+0000 7f929cee3700 1 --2- 172.21.15.146:0/401716304 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9298153e80 0x7f92980b49a0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f9290009e60 tx=0x7f9290009780 comp rx=0 tx=0).stop 2023-10-06T11:15:44.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.459+0000 7f929cee3700 1 -- 172.21.15.146:0/401716304 shutdown_connections 2023-10-06T11:15:44.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.459+0000 7f929cee3700 1 --2- 172.21.15.146:0/401716304 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9298153e80 0x7f92980b49a0 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:44.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.459+0000 7f929cee3700 1 --2- 172.21.15.146:0/401716304 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9298068ba0 0x7f929815a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:44.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.459+0000 7f929cee3700 1 -- 172.21.15.146:0/401716304 >> 172.21.15.146:0/401716304 conn(0x7f929806eba0 msgr2=0x7f929806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:44.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.459+0000 7f929cee3700 1 -- 172.21.15.146:0/401716304 shutdown_connections 2023-10-06T11:15:44.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.459+0000 7f929cee3700 1 -- 172.21.15.146:0/401716304 wait complete. 2023-10-06T11:15:44.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.461+0000 7f929cee3700 1 Processor -- start 2023-10-06T11:15:44.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.461+0000 7f929cee3700 1 -- start start 2023-10-06T11:15:44.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.461+0000 7f929cee3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9298068ba0 0x7f9298137ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:44.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.461+0000 7f929cee3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9298153ab0 0x7f929815bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:44.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.461+0000 7f929cee3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9298153e80 0x7f929815c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:44.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.461+0000 7f929cee3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92980b0590 con 0x7f9298068ba0 2023-10-06T11:15:44.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.461+0000 7f929cee3700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92980b0b50 con 0x7f9298153ab0 2023-10-06T11:15:44.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.461+0000 7f929cee3700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f929814fb10 con 0x7f9298153e80 2023-10-06T11:15:44.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.461+0000 7f929659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9298068ba0 0x7f9298137ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:44.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.461+0000 7f929659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9298068ba0 0x7f9298137ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48644/0 (socket says 172.21.15.146:48644) 2023-10-06T11:15:44.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.461+0000 7f929659c700 1 -- 172.21.15.146:0/1581500170 learned_addr learned my addr 172.21.15.146:0/1581500170 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:44.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.462+0000 7f929659c700 1 -- 172.21.15.146:0/1581500170 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9298153e80 msgr2=0x7f929815c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:44.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.462+0000 7f929659c700 1 --2- 172.21.15.146:0/1581500170 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9298153e80 0x7f929815c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:44.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.462+0000 7f929659c700 1 -- 172.21.15.146:0/1581500170 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9298153ab0 msgr2=0x7f929815bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:44.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.462+0000 7f929659c700 1 --2- 172.21.15.146:0/1581500170 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9298153ab0 0x7f929815bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:44.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.462+0000 7f929659c700 1 -- 172.21.15.146:0/1581500170 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9290009a20 con 0x7f9298068ba0 2023-10-06T11:15:44.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.462+0000 7f929659c700 1 --2- 172.21.15.146:0/1581500170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9298068ba0 0x7f9298137ab0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f928800c810 tx=0x7f9288007c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:44.475 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.462+0000 7f928effd700 1 -- 172.21.15.146:0/1581500170 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9288005b30 con 0x7f9298068ba0 2023-10-06T11:15:44.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.462+0000 7f928effd700 1 -- 172.21.15.146:0/1581500170 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9288005c90 con 0x7f9298068ba0 2023-10-06T11:15:44.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.462+0000 7f929cee3700 1 -- 172.21.15.146:0/1581500170 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f929814fdf0 con 0x7f9298068ba0 2023-10-06T11:15:44.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.462+0000 7f928effd700 1 -- 172.21.15.146:0/1581500170 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9288007300 con 0x7f9298068ba0 2023-10-06T11:15:44.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.462+0000 7f929cee3700 1 -- 172.21.15.146:0/1581500170 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9298137ff0 con 0x7f9298068ba0 2023-10-06T11:15:44.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.463+0000 7f929cee3700 1 -- 172.21.15.146:0/1581500170 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f929804c380 con 0x7f9298068ba0 2023-10-06T11:15:44.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.463+0000 7f928effd700 1 -- 172.21.15.146:0/1581500170 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f92880076f0 con 0x7f9298068ba0 2023-10-06T11:15:44.476 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.464+0000 7f928effd700 1 --2- 172.21.15.146:0/1581500170 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9278066f30 0x7f92780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:44.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.464+0000 7f928effd700 1 -- 172.21.15.146:0/1581500170 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9288084140 con 0x7f9298068ba0 2023-10-06T11:15:44.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.464+0000 7f928dd9b700 1 --2- 172.21.15.146:0/1581500170 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9278066f30 0x7f92780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:44.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.464+0000 7f928dd9b700 1 --2- 172.21.15.146:0/1581500170 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9278066f30 0x7f92780693e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f928000a900 tx=0x7f9280008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:44.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.468+0000 7f928effd700 1 -- 172.21.15.146:0/1581500170 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9288054c40 con 0x7f9298068ba0 2023-10-06T11:15:44.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.729+0000 7f929cee3700 1 -- 172.21.15.146:0/1581500170 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f929815bdb0 con 0x7f9298068ba0 2023-10-06T11:15:44.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.730+0000 7f928effd700 1 -- 172.21.15.146:0/1581500170 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1636 (secure 0 0 0) 0x7f929815bdb0 con 0x7f9298068ba0 2023-10-06T11:15:44.732 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:15:44.732 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":619,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":125,"num_osds":8,"num_up_osds":8,"osd_up_since":1696590336,"num_in_osds":8,"osd_in_since":1696590327,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":1062,"data_bytes":1076684541,"bytes_used":4647419904,"bytes_avail":768446693376,"bytes_total":773094113280,"write_bytes_sec":81644279,"read_op_per_sec":0,"write_op_per_sec":128},"fsmap":{"epoch":108,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"c","status":"up:active","gid":8682}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":24,"modified":"2023-10-06T11:15:43.268382+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{"scrub status":"paused paths [/scrub_control_test_path]"}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T11:15:44.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.732+0000 7f929cee3700 1 -- 172.21.15.146:0/1581500170 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9278066f30 msgr2=0x7f92780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:44.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.732+0000 7f929cee3700 1 --2- 172.21.15.146:0/1581500170 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9278066f30 0x7f92780693e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f928000a900 tx=0x7f9280008040 comp rx=0 tx=0).stop 2023-10-06T11:15:44.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.732+0000 7f929cee3700 1 -- 172.21.15.146:0/1581500170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9298068ba0 msgr2=0x7f9298137ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:44.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.732+0000 7f929cee3700 1 --2- 172.21.15.146:0/1581500170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9298068ba0 0x7f9298137ab0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f928800c810 tx=0x7f9288007c50 comp rx=0 tx=0).stop 2023-10-06T11:15:44.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.732+0000 7f929cee3700 1 -- 172.21.15.146:0/1581500170 shutdown_connections 2023-10-06T11:15:44.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.732+0000 7f929cee3700 1 --2- 172.21.15.146:0/1581500170 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9278066f30 0x7f92780693e0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:44.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.732+0000 7f929cee3700 1 --2- 172.21.15.146:0/1581500170 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9298153e80 0x7f929815c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:44.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.732+0000 7f929cee3700 1 --2- 172.21.15.146:0/1581500170 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9298068ba0 0x7f9298137ab0 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:44.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.732+0000 7f929cee3700 1 --2- 172.21.15.146:0/1581500170 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9298153ab0 0x7f929815bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:44.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.732+0000 7f929cee3700 1 -- 172.21.15.146:0/1581500170 >> 172.21.15.146:0/1581500170 conn(0x7f929806eba0 msgr2=0x7f929814c480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:44.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.732+0000 7f929cee3700 1 -- 172.21.15.146:0/1581500170 shutdown_connections 2023-10-06T11:15:44.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:44.732+0000 7f929cee3700 1 -- 172.21.15.146:0/1581500170 wait complete. 2023-10-06T11:15:44.745 INFO:tasks.cephfs.filesystem.ceph_manager:{'c': 'paused paths [/scrub_control_test_path]'} 2023-10-06T11:15:44.746 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T11:15:44.746 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:15:44.756 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T11:15:44.756 INFO:tasks.cephfs.test_scrub_checks:Waiting for promotion of one of the original standbys {'b', 'a', 'd'} 2023-10-06T11:15:44.756 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_beacon_grace 2023-10-06T11:15:44.920 INFO:teuthology.orchestra.run.smithi146.stdout:{"mds_beacon_grace":"15.000000"} 2023-10-06T11:15:44.920 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_beacon_grace": "15.000000" } 2023-10-06T11:15:44.921 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:15:45.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.034+0000 7f11f6473700 1 Processor -- start 2023-10-06T11:15:45.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.035+0000 7f11f6473700 1 -- start start 2023-10-06T11:15:45.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.035+0000 7f11f6473700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f11f00ab010 0x7f11f0157800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:45.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.035+0000 7f11f6473700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11f00ca070 0x7f11f00cc240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:45.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.035+0000 7f11f6473700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11f00ccf20 con 0x7f11f0157430 2023-10-06T11:15:45.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.035+0000 7f11f6473700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11f00ca4f0 con 0x7f11f00ab010 2023-10-06T11:15:45.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.035+0000 7f11f6473700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11f00c3dd0 con 0x7f11f00ca070 2023-10-06T11:15:45.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.036+0000 7f11f4a10700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11f00ca070 0x7f11f00cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:45.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.036+0000 7f11ef7fe700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f11f00ab010 0x7f11f0157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:45.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.036+0000 7f11effff700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f11f0157430 0x7f11f00ceb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:41700/0 (socket says 172.21.15.146:41700) 2023-10-06T11:15:45.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.036+0000 7f11effff700 1 -- 172.21.15.146:0/2433248120 learned_addr learned my addr 172.21.15.146:0/2433248120 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:15:45.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.036+0000 7f11f4a10700 1 -- 172.21.15.146:0/2433248120 >> v2:172.21.15.151:3300/0 conn(0x7f11f00ab010 msgr2=0x7f11f0157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:45.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.036+0000 7f11f4a10700 1 --2- 172.21.15.146:0/2433248120 >> v2:172.21.15.151:3300/0 conn(0x7f11f00ab010 0x7f11f0157800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:45.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.036+0000 7f11f4a10700 1 -- 172.21.15.146:0/2433248120 >> v1:172.21.15.151:6789/0 conn(0x7f11f0157430 legacy=0x7f11f00ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:45.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.036+0000 7f11f4a10700 1 -- 172.21.15.146:0/2433248120 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f00cd200 con 0x7f11f00ca070 2023-10-06T11:15:45.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.036+0000 7f11eeffd700 1 -- 172.21.15.146:0/2433248120 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1587596187 0 0) 0x7f11f00ccf20 con 0x7f11f0157430 2023-10-06T11:15:45.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.036+0000 7f11ef7fe700 1 --2- 172.21.15.146:0/2433248120 >> v2:172.21.15.151:3300/0 conn(0x7f11f00ab010 0x7f11f0157800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:15:45.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.036+0000 7f11f4a10700 1 --2- 172.21.15.146:0/2433248120 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11f00ca070 0x7f11f00cc240 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f11e8009e60 tx=0x7f11e8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a01bcec082e0e9b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:45.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.036+0000 7f11eeffd700 1 -- 172.21.15.146:0/2433248120 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e800e070 con 0x7f11f00ca070 2023-10-06T11:15:45.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.037+0000 7f11eeffd700 1 -- 172.21.15.146:0/2433248120 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e800bb60 con 0x7f11f00ca070 2023-10-06T11:15:45.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.037+0000 7f11eeffd700 1 -- 172.21.15.146:0/2433248120 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e8012430 con 0x7f11f00ca070 2023-10-06T11:15:45.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.037+0000 7f11f6473700 1 -- 172.21.15.146:0/2433248120 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11f00ca070 msgr2=0x7f11f00cc240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:45.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.037+0000 7f11f6473700 1 --2- 172.21.15.146:0/2433248120 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11f00ca070 0x7f11f00cc240 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f11e8009e60 tx=0x7f11e8009780 comp rx=0 tx=0).stop 2023-10-06T11:15:45.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.037+0000 7f11f6473700 1 -- 172.21.15.146:0/2433248120 shutdown_connections 2023-10-06T11:15:45.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.037+0000 7f11f6473700 1 --2- 172.21.15.146:0/2433248120 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11f00ca070 0x7f11f00cc240 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:45.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.037+0000 7f11f6473700 1 --2- 172.21.15.146:0/2433248120 >> v2:172.21.15.151:3300/0 conn(0x7f11f00ab010 0x7f11f0157800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:45.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.037+0000 7f11f6473700 1 -- 172.21.15.146:0/2433248120 >> 172.21.15.146:0/2433248120 conn(0x7f11f0067c50 msgr2=0x7f11f00ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:45.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.037+0000 7f11f6473700 1 -- 172.21.15.146:0/2433248120 shutdown_connections 2023-10-06T11:15:45.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.037+0000 7f11f6473700 1 -- 172.21.15.146:0/2433248120 wait complete. 2023-10-06T11:15:45.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.038+0000 7f11f6473700 1 Processor -- start 2023-10-06T11:15:45.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.038+0000 7f11f6473700 1 -- start start 2023-10-06T11:15:45.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.039+0000 7f11f6473700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11f00ab010 0x7f11f016aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:45.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.039+0000 7f11f6473700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11f00ca070 0x7f11f00acdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:45.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.039+0000 7f11f6473700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11f0157430 0x7f11f014adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:45.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.039+0000 7f11f6473700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f00b2420 con 0x7f11f00ca070 2023-10-06T11:15:45.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.039+0000 7f11f6473700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f016b0e0 con 0x7f11f00ab010 2023-10-06T11:15:45.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.039+0000 7f11f6473700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11f016b3b0 con 0x7f11f0157430 2023-10-06T11:15:45.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.039+0000 7f11ef7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11f00ca070 0x7f11f00acdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:45.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.039+0000 7f11ef7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11f00ca070 0x7f11f00acdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48648/0 (socket says 172.21.15.146:48648) 2023-10-06T11:15:45.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.039+0000 7f11ef7fe700 1 -- 172.21.15.146:0/2489850401 learned_addr learned my addr 172.21.15.146:0/2489850401 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:45.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.039+0000 7f11effff700 1 --2- 172.21.15.146:0/2489850401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11f00ab010 0x7f11f016aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:45.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.039+0000 7f11f4a10700 1 --2- 172.21.15.146:0/2489850401 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11f0157430 0x7f11f014adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:45.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.040+0000 7f11ef7fe700 1 -- 172.21.15.146:0/2489850401 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11f0157430 msgr2=0x7f11f014adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:45.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.040+0000 7f11ef7fe700 1 --2- 172.21.15.146:0/2489850401 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11f0157430 0x7f11f014adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:45.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.040+0000 7f11ef7fe700 1 -- 172.21.15.146:0/2489850401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11f00ab010 msgr2=0x7f11f016aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:45.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.040+0000 7f11ef7fe700 1 --2- 172.21.15.146:0/2489850401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11f00ab010 0x7f11f016aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:45.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.040+0000 7f11ef7fe700 1 -- 172.21.15.146:0/2489850401 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e4009420 con 0x7f11f00ca070 2023-10-06T11:15:45.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.040+0000 7f11ef7fe700 1 --2- 172.21.15.146:0/2489850401 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11f00ca070 0x7f11f00acdc0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f11e400ec80 tx=0x7f11e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:45.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.040+0000 7f11d7fff700 1 -- 172.21.15.146:0/2489850401 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e400c850 con 0x7f11f00ca070 2023-10-06T11:15:45.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.040+0000 7f11d7fff700 1 -- 172.21.15.146:0/2489850401 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e400c9b0 con 0x7f11f00ca070 2023-10-06T11:15:45.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.040+0000 7f11f6473700 1 -- 172.21.15.146:0/2489850401 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11e8009a20 con 0x7f11f00ca070 2023-10-06T11:15:45.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.040+0000 7f11d7fff700 1 -- 172.21.15.146:0/2489850401 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e400cd30 con 0x7f11f00ca070 2023-10-06T11:15:45.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.040+0000 7f11f6473700 1 -- 172.21.15.146:0/2489850401 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11f016b970 con 0x7f11f00ca070 2023-10-06T11:15:45.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.041+0000 7f11f6473700 1 -- 172.21.15.146:0/2489850401 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11f004c380 con 0x7f11f00ca070 2023-10-06T11:15:45.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.041+0000 7f11d7fff700 1 -- 172.21.15.146:0/2489850401 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f11e4013680 con 0x7f11f00ca070 2023-10-06T11:15:45.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.042+0000 7f11d7fff700 1 --2- 172.21.15.146:0/2489850401 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f11dc066f30 0x7f11dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:45.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.042+0000 7f11d7fff700 1 -- 172.21.15.146:0/2489850401 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f11e4084950 con 0x7f11f00ca070 2023-10-06T11:15:45.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.042+0000 7f11effff700 1 --2- 172.21.15.146:0/2489850401 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f11dc066f30 0x7f11dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:45.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.042+0000 7f11effff700 1 --2- 172.21.15.146:0/2489850401 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f11dc066f30 0x7f11dc0693e0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f11e0007160 tx=0x7f11e0007f50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:45.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.046+0000 7f11d7fff700 1 -- 172.21.15.146:0/2489850401 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f11e40554f0 con 0x7f11f00ca070 2023-10-06T11:15:45.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.273+0000 7f11f6473700 1 -- 172.21.15.146:0/2489850401 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f11f00cd4e0 con 0x7f11f00ca070 2023-10-06T11:15:45.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.273+0000 7f11d7fff700 1 -- 172.21.15.146:0/2489850401 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) v1 ==== 95+0+4617 (secure 0 0 0) 0x7f11e4055080 con 0x7f11f00ca070 2023-10-06T11:15:45.275 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:15:45.276 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":108,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7792,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3693464886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3693464886},{"type":"v1","addr":"172.21.15.151:6834","nonce":3693464886}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103},{"gid":7795,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1155762565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":1155762565},{"type":"v1","addr":"172.21.15.151:6835","nonce":1155762565}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103},{"gid":8679,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/3868720724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3868720724},{"type":"v1","addr":"172.21.15.146:6836","nonce":3868720724}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:15:11.929158+0000","modified":"2023-10-06T11:15:15.569866+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8682},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8682":{"gid":8682,"name":"c","rank":0,"incarnation":104,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/1974709597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":1974709597},{"type":"v1","addr":"172.21.15.146:6837","nonce":1974709597}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-06T11:15:45.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.276+0000 7f11f6473700 1 -- 172.21.15.146:0/2489850401 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f11dc066f30 msgr2=0x7f11dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:45.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.276+0000 7f11f6473700 1 --2- 172.21.15.146:0/2489850401 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f11dc066f30 0x7f11dc0693e0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f11e0007160 tx=0x7f11e0007f50 comp rx=0 tx=0).stop 2023-10-06T11:15:45.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.276+0000 7f11f6473700 1 -- 172.21.15.146:0/2489850401 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11f00ca070 msgr2=0x7f11f00acdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:45.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.276+0000 7f11f6473700 1 --2- 172.21.15.146:0/2489850401 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11f00ca070 0x7f11f00acdc0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f11e400ec80 tx=0x7f11e40091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:45.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.276+0000 7f11f6473700 1 -- 172.21.15.146:0/2489850401 shutdown_connections 2023-10-06T11:15:45.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.276+0000 7f11f6473700 1 --2- 172.21.15.146:0/2489850401 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f11dc066f30 0x7f11dc0693e0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:45.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.276+0000 7f11f6473700 1 --2- 172.21.15.146:0/2489850401 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f11f0157430 0x7f11f014adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:45.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.276+0000 7f11f6473700 1 --2- 172.21.15.146:0/2489850401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11f00ab010 0x7f11f016aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:45.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.276+0000 7f11f6473700 1 --2- 172.21.15.146:0/2489850401 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11f00ca070 0x7f11f00acdc0 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:45.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.276+0000 7f11f6473700 1 -- 172.21.15.146:0/2489850401 >> 172.21.15.146:0/2489850401 conn(0x7f11f0067c50 msgr2=0x7f11f00ca630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:45.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.276+0000 7f11f6473700 1 -- 172.21.15.146:0/2489850401 shutdown_connections 2023-10-06T11:15:45.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:45.276+0000 7f11f6473700 1 -- 172.21.15.146:0/2489850401 wait complete. 2023-10-06T11:15:45.280 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 108 2023-10-06T11:15:45.290 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-10-06T11:15:50.291 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:15:50.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.417+0000 7f2df20b8700 1 Processor -- start 2023-10-06T11:15:50.419 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.417+0000 7f2df20b8700 1 -- start start 2023-10-06T11:15:50.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.418+0000 7f2df20b8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2dec0b3770 0x7f2dec0b1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:50.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.418+0000 7f2df20b8700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dec0ae100 con 0x7f2dec06f780 2023-10-06T11:15:50.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.418+0000 7f2df20b8700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dec0d0f10 con 0x7f2dec15cbd0 2023-10-06T11:15:50.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.418+0000 7f2df20b8700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dec0d11f0 con 0x7f2dec0b3770 2023-10-06T11:15:50.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.418+0000 7f2df18b7700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2dec06f780 0x7f2dec1633d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:51716/0 (socket says 172.21.15.146:51716) 2023-10-06T11:15:50.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.418+0000 7f2df18b7700 1 -- 172.21.15.146:0/1754539194 learned_addr learned my addr 172.21.15.146:0/1754539194 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:15:50.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.418+0000 7f2df08b5700 1 --2- 172.21.15.146:0/1754539194 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2dec0b3770 0x7f2dec0b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:50.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.418+0000 7f2de3fff700 1 -- 172.21.15.146:0/1754539194 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1600353993 0 0) 0x7f2dec0ae100 con 0x7f2dec06f780 2023-10-06T11:15:50.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.418+0000 7f2de3fff700 1 -- 172.21.15.146:0/1754539194 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dd8003570 con 0x7f2dec06f780 2023-10-06T11:15:50.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.419+0000 7f2de3fff700 1 -- 172.21.15.146:0/1754539194 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1715631802 0 0) 0x7f2dd8003570 con 0x7f2dec06f780 2023-10-06T11:15:50.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.419+0000 7f2de3fff700 1 -- 172.21.15.146:0/1754539194 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2dec0b3770 msgr2=0x7f2dec0b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:50.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.419+0000 7f2de3fff700 1 --2- 172.21.15.146:0/1754539194 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2dec0b3770 0x7f2dec0b1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:50.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.419+0000 7f2de3fff700 1 -- 172.21.15.146:0/1754539194 >> v1:172.21.15.151:6789/0 conn(0x7f2dec15cbd0 legacy=0x7f2dec0b0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:50.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.419+0000 7f2de3fff700 1 -- 172.21.15.146:0/1754539194 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dec0ae350 con 0x7f2dec06f780 2023-10-06T11:15:50.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.419+0000 7f2de3fff700 1 -- 172.21.15.146:0/1754539194 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f2de40017f0 con 0x7f2dec06f780 2023-10-06T11:15:50.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.419+0000 7f2de3fff700 1 -- 172.21.15.146:0/1754539194 >> v1:172.21.15.146:6789/0 conn(0x7f2dec06f780 legacy=0x7f2dec1633d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:50.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.419+0000 7f2de3fff700 1 --2- 172.21.15.146:0/1754539194 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2dec0b3770 0x7f2dd8003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:50.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.419+0000 7f2de3fff700 1 --2- 172.21.15.146:0/1754539194 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dd8003fd0 0x7f2dd8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:50.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.419+0000 7f2de3fff700 1 --2- 172.21.15.146:0/1754539194 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2dd8004d50 0x7f2dd80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:50.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.419+0000 7f2de3fff700 1 -- 172.21.15.146:0/1754539194 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dec0d11f0 con 0x7f2dd8003fd0 2023-10-06T11:15:50.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.419+0000 7f2de3fff700 1 -- 172.21.15.146:0/1754539194 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd800bb40 con 0x7f2dd8004d50 2023-10-06T11:15:50.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.419+0000 7f2de3fff700 1 -- 172.21.15.146:0/1754539194 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd800bd00 con 0x7f2dec0b3770 2023-10-06T11:15:50.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.419+0000 7f2df08b5700 1 --2- 172.21.15.146:0/1754539194 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dd8003fd0 0x7f2dd8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:50.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.419+0000 7f2df10b6700 1 --2- 172.21.15.146:0/1754539194 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2dec0b3770 0x7f2dd8003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:50.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.419+0000 7f2df18b7700 1 --2- 172.21.15.146:0/1754539194 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2dd8004d50 0x7f2dd80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:50.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.419+0000 7f2df08b5700 1 -- 172.21.15.146:0/1754539194 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2dec0b3770 msgr2=0x7f2dd8003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:50.424 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.419+0000 7f2df08b5700 1 --2- 172.21.15.146:0/1754539194 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2dec0b3770 0x7f2dd8003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:50.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.419+0000 7f2df08b5700 1 -- 172.21.15.146:0/1754539194 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2dd8004d50 msgr2=0x7f2dd80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:50.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.419+0000 7f2df08b5700 1 --2- 172.21.15.146:0/1754539194 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2dd8004d50 0x7f2dd80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:50.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.419+0000 7f2df08b5700 1 -- 172.21.15.146:0/1754539194 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd8003570 con 0x7f2dd8003fd0 2023-10-06T11:15:50.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.419+0000 7f2df18b7700 1 --2- 172.21.15.146:0/1754539194 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2dd8004d50 0x7f2dd80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:15:50.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.419+0000 7f2df08b5700 1 --2- 172.21.15.146:0/1754539194 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dd8003fd0 0x7f2dd8004810 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc009c00 tx=0x7f2ddc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=242c345b13925bb5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:50.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.419+0000 7f2de3fff700 1 -- 172.21.15.146:0/1754539194 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc00e710 con 0x7f2dd8003fd0 2023-10-06T11:15:50.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.420+0000 7f2de3fff700 1 -- 172.21.15.146:0/1754539194 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ddc00e870 con 0x7f2dd8003fd0 2023-10-06T11:15:50.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.420+0000 7f2de3fff700 1 -- 172.21.15.146:0/1754539194 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc00ec30 con 0x7f2dd8003fd0 2023-10-06T11:15:50.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.420+0000 7f2df20b8700 1 -- 172.21.15.146:0/1754539194 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dd8003fd0 msgr2=0x7f2dd8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:50.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.420+0000 7f2df20b8700 1 --2- 172.21.15.146:0/1754539194 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dd8003fd0 0x7f2dd8004810 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc009c00 tx=0x7f2ddc0091a0 comp rx=0 tx=0).stop 2023-10-06T11:15:50.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.420+0000 7f2df18b7700 1 -- 172.21.15.146:0/1754539194 reap_dead start 2023-10-06T11:15:50.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.420+0000 7f2df20b8700 1 -- 172.21.15.146:0/1754539194 shutdown_connections 2023-10-06T11:15:50.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.420+0000 7f2df20b8700 1 -- 172.21.15.146:0/1754539194 >> 172.21.15.146:0/1754539194 conn(0x7f2dec06f380 msgr2=0x7f2dec0d0660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:50.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.420+0000 7f2df20b8700 1 -- 172.21.15.146:0/1754539194 shutdown_connections 2023-10-06T11:15:50.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.420+0000 7f2df20b8700 1 -- 172.21.15.146:0/1754539194 wait complete. 2023-10-06T11:15:50.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.421+0000 7f2df20b8700 1 Processor -- start 2023-10-06T11:15:50.428 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.421+0000 7f2df20b8700 1 -- start start 2023-10-06T11:15:50.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.422+0000 7f2df20b8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dd8003fd0 0x7f2dec169ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:50.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.422+0000 7f2df20b8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2dec1524c0 0x7f2dec157d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:50.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.422+0000 7f2df20b8700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2dec069390 0x7f2dec0697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:50.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.422+0000 7f2df20b8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dec157890 con 0x7f2dd8003fd0 2023-10-06T11:15:50.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.422+0000 7f2df20b8700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dec069d20 con 0x7f2dec069390 2023-10-06T11:15:50.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.422+0000 7f2df20b8700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dec16a1e0 con 0x7f2dec1524c0 2023-10-06T11:15:50.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.422+0000 7f2df10b6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dd8003fd0 0x7f2dec169ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:50.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.422+0000 7f2df10b6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dd8003fd0 0x7f2dec169ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48656/0 (socket says 172.21.15.146:48656) 2023-10-06T11:15:50.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.422+0000 7f2df10b6700 1 -- 172.21.15.146:0/350715701 learned_addr learned my addr 172.21.15.146:0/350715701 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:50.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.423+0000 7f2df18b7700 1 --2- 172.21.15.146:0/350715701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2dec069390 0x7f2dec0697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:50.429 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.423+0000 7f2df10b6700 1 -- 172.21.15.146:0/350715701 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2dec1524c0 msgr2=0x7f2dec157d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:50.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.423+0000 7f2df10b6700 1 --2- 172.21.15.146:0/350715701 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2dec1524c0 0x7f2dec157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:50.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.423+0000 7f2df10b6700 1 -- 172.21.15.146:0/350715701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2dec069390 msgr2=0x7f2dec0697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:50.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.423+0000 7f2df10b6700 1 --2- 172.21.15.146:0/350715701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2dec069390 0x7f2dec0697e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:50.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.423+0000 7f2df10b6700 1 -- 172.21.15.146:0/350715701 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dec156c80 con 0x7f2dd8003fd0 2023-10-06T11:15:50.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.423+0000 7f2df10b6700 1 --2- 172.21.15.146:0/350715701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dd8003fd0 0x7f2dec169ca0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f2de8002ae0 tx=0x7f2de8007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:50.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.423+0000 7f2de17fa700 1 -- 172.21.15.146:0/350715701 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de800f9a0 con 0x7f2dd8003fd0 2023-10-06T11:15:50.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.423+0000 7f2de17fa700 1 -- 172.21.15.146:0/350715701 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de800fb00 con 0x7f2dd8003fd0 2023-10-06T11:15:50.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.423+0000 7f2de17fa700 1 -- 172.21.15.146:0/350715701 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de800fec0 con 0x7f2dd8003fd0 2023-10-06T11:15:50.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.423+0000 7f2df20b8700 1 -- 172.21.15.146:0/350715701 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dec156f60 con 0x7f2dd8003fd0 2023-10-06T11:15:50.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.423+0000 7f2df20b8700 1 -- 172.21.15.146:0/350715701 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dec157520 con 0x7f2dd8003fd0 2023-10-06T11:15:50.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.424+0000 7f2df20b8700 1 -- 172.21.15.146:0/350715701 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dec088170 con 0x7f2dd8003fd0 2023-10-06T11:15:50.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.424+0000 7f2de17fa700 1 -- 172.21.15.146:0/350715701 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2de8013600 con 0x7f2dd8003fd0 2023-10-06T11:15:50.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.425+0000 7f2de17fa700 1 --2- 172.21.15.146:0/350715701 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2dd0066f30 0x7f2dd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:50.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.425+0000 7f2de17fa700 1 -- 172.21.15.146:0/350715701 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2de8084ce0 con 0x7f2dd8003fd0 2023-10-06T11:15:50.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.425+0000 7f2df08b5700 1 --2- 172.21.15.146:0/350715701 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2dd0066f30 0x7f2dd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:50.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.425+0000 7f2df08b5700 1 --2- 172.21.15.146:0/350715701 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2dd0066f30 0x7f2dd00693e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f2dec0d0640 tx=0x7f2ddc01a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:50.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.429+0000 7f2de17fa700 1 -- 172.21.15.146:0/350715701 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2de8051df0 con 0x7f2dd8003fd0 2023-10-06T11:15:50.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.655+0000 7f2df20b8700 1 -- 172.21.15.146:0/350715701 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2dec0ae630 con 0x7f2dd8003fd0 2023-10-06T11:15:50.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.655+0000 7f2de17fa700 1 -- 172.21.15.146:0/350715701 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) v1 ==== 95+0+4617 (secure 0 0 0) 0x7f2de8017090 con 0x7f2dd8003fd0 2023-10-06T11:15:50.657 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:15:50.657 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":108,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7792,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3693464886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3693464886},{"type":"v1","addr":"172.21.15.151:6834","nonce":3693464886}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103},{"gid":7795,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1155762565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":1155762565},{"type":"v1","addr":"172.21.15.151:6835","nonce":1155762565}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103},{"gid":8679,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/3868720724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3868720724},{"type":"v1","addr":"172.21.15.146:6836","nonce":3868720724}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:15:11.929158+0000","modified":"2023-10-06T11:15:15.569866+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8682},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8682":{"gid":8682,"name":"c","rank":0,"incarnation":104,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/1974709597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":1974709597},{"type":"v1","addr":"172.21.15.146:6837","nonce":1974709597}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-06T11:15:50.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.658+0000 7f2df20b8700 1 -- 172.21.15.146:0/350715701 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2dd0066f30 msgr2=0x7f2dd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:50.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.658+0000 7f2df20b8700 1 --2- 172.21.15.146:0/350715701 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2dd0066f30 0x7f2dd00693e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f2dec0d0640 tx=0x7f2ddc01a000 comp rx=0 tx=0).stop 2023-10-06T11:15:50.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.658+0000 7f2df20b8700 1 -- 172.21.15.146:0/350715701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dd8003fd0 msgr2=0x7f2dec169ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:50.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.658+0000 7f2df20b8700 1 --2- 172.21.15.146:0/350715701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dd8003fd0 0x7f2dec169ca0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f2de8002ae0 tx=0x7f2de8007d10 comp rx=0 tx=0).stop 2023-10-06T11:15:50.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.658+0000 7f2df20b8700 1 -- 172.21.15.146:0/350715701 shutdown_connections 2023-10-06T11:15:50.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.658+0000 7f2df20b8700 1 --2- 172.21.15.146:0/350715701 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2dd0066f30 0x7f2dd00693e0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:50.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.658+0000 7f2df20b8700 1 --2- 172.21.15.146:0/350715701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2dec069390 0x7f2dec0697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:50.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.658+0000 7f2df20b8700 1 --2- 172.21.15.146:0/350715701 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2dd8003fd0 0x7f2dec169ca0 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:50.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.658+0000 7f2df20b8700 1 --2- 172.21.15.146:0/350715701 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2dec1524c0 0x7f2dec157d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:50.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.658+0000 7f2df20b8700 1 -- 172.21.15.146:0/350715701 >> 172.21.15.146:0/350715701 conn(0x7f2dec06f380 msgr2=0x7f2dec152ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:50.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.658+0000 7f2df20b8700 1 -- 172.21.15.146:0/350715701 shutdown_connections 2023-10-06T11:15:50.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:50.658+0000 7f2df20b8700 1 -- 172.21.15.146:0/350715701 wait complete. 2023-10-06T11:15:50.661 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 108 2023-10-06T11:15:50.672 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-10-06T11:15:51.329 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:15:51.331 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:15:55.673 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:15:55.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.800+0000 7f6ef3499700 1 Processor -- start 2023-10-06T11:15:55.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.801+0000 7f6ef3499700 1 -- start start 2023-10-06T11:15:55.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.801+0000 7f6ef3499700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6eec153ab0 0x7f6eec15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:55.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.801+0000 7f6ef3499700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6eec068ba0 0x7f6eec0b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:55.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.801+0000 7f6ef3499700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6eec15ac30 con 0x7f6eec153e80 2023-10-06T11:15:55.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.801+0000 7f6ef3499700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6eec0b4510 con 0x7f6eec068ba0 2023-10-06T11:15:55.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.801+0000 7f6ef3499700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eec0b6530 con 0x7f6eec153ab0 2023-10-06T11:15:55.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.801+0000 7f6ef1a36700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6eec068ba0 0x7f6eec0b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:55.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.801+0000 7f6ef1a36700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6eec068ba0 0x7f6eec0b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56936/0 (socket says 172.21.15.146:56936) 2023-10-06T11:15:55.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.801+0000 7f6ef1a36700 1 -- 172.21.15.146:0/2903789517 learned_addr learned my addr 172.21.15.146:0/2903789517 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:55.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.802+0000 7f6ef1235700 1 --2- 172.21.15.146:0/2903789517 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6eec153ab0 0x7f6eec15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:55.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.802+0000 7f6ef1a36700 1 -- 172.21.15.146:0/2903789517 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6eec153ab0 msgr2=0x7f6eec15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:15:55.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.802+0000 7f6ef1a36700 1 --2- 172.21.15.146:0/2903789517 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6eec153ab0 0x7f6eec15a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:55.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.802+0000 7f6ef1a36700 1 -- 172.21.15.146:0/2903789517 >> v1:172.21.15.146:6789/0 conn(0x7f6eec153e80 legacy=0x7f6eec068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:55.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.802+0000 7f6ef1a36700 1 -- 172.21.15.146:0/2903789517 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eec0b5c50 con 0x7f6eec068ba0 2023-10-06T11:15:55.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.802+0000 7f6ef1a36700 1 --2- 172.21.15.146:0/2903789517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6eec068ba0 0x7f6eec0b49a0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f6ee40099b0 tx=0x7f6ee4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c9aa9cd69999ce5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:55.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.802+0000 7f6ee3fff700 1 -- 172.21.15.146:0/2903789517 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee400b860 con 0x7f6eec068ba0 2023-10-06T11:15:55.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.802+0000 7f6ee3fff700 1 -- 172.21.15.146:0/2903789517 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee400b9c0 con 0x7f6eec068ba0 2023-10-06T11:15:55.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.802+0000 7f6ee3fff700 1 -- 172.21.15.146:0/2903789517 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee400bd60 con 0x7f6eec068ba0 2023-10-06T11:15:55.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.803+0000 7f6ef3499700 1 -- 172.21.15.146:0/2903789517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6eec068ba0 msgr2=0x7f6eec0b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:55.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.803+0000 7f6ef3499700 1 --2- 172.21.15.146:0/2903789517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6eec068ba0 0x7f6eec0b49a0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f6ee40099b0 tx=0x7f6ee4009250 comp rx=0 tx=0).stop 2023-10-06T11:15:55.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.803+0000 7f6ef3499700 1 -- 172.21.15.146:0/2903789517 shutdown_connections 2023-10-06T11:15:55.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.803+0000 7f6ef3499700 1 --2- 172.21.15.146:0/2903789517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6eec068ba0 0x7f6eec0b49a0 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:55.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.803+0000 7f6ef3499700 1 --2- 172.21.15.146:0/2903789517 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6eec153ab0 0x7f6eec15a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:55.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.803+0000 7f6ef3499700 1 -- 172.21.15.146:0/2903789517 >> 172.21.15.146:0/2903789517 conn(0x7f6eec06eba0 msgr2=0x7f6eec06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:55.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.803+0000 7f6ef3499700 1 -- 172.21.15.146:0/2903789517 shutdown_connections 2023-10-06T11:15:55.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.803+0000 7f6ef3499700 1 -- 172.21.15.146:0/2903789517 wait complete. 2023-10-06T11:15:55.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.804+0000 7f6ef3499700 1 Processor -- start 2023-10-06T11:15:55.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.804+0000 7f6ef3499700 1 -- start start 2023-10-06T11:15:55.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.805+0000 7f6ef3499700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6eec068ba0 0x7f6eec147140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:55.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.805+0000 7f6ef3499700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6eec153ab0 0x7f6eec14b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:55.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.805+0000 7f6ef3499700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6eec153e80 0x7f6eec1526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:55.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.805+0000 7f6ef3499700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eec14e0b0 con 0x7f6eec068ba0 2023-10-06T11:15:55.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.805+0000 7f6ef3499700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eec14d4a0 con 0x7f6eec153ab0 2023-10-06T11:15:55.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.805+0000 7f6ef3499700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eec14d780 con 0x7f6eec153e80 2023-10-06T11:15:55.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.805+0000 7f6ef1235700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6eec068ba0 0x7f6eec147140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:55.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.805+0000 7f6ef1235700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6eec068ba0 0x7f6eec147140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56952/0 (socket says 172.21.15.146:56952) 2023-10-06T11:15:55.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.805+0000 7f6ef1235700 1 -- 172.21.15.146:0/1195984390 learned_addr learned my addr 172.21.15.146:0/1195984390 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:15:55.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.805+0000 7f6ef1a36700 1 --2- 172.21.15.146:0/1195984390 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6eec153e80 0x7f6eec1526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:55.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.805+0000 7f6ef0a34700 1 --2- 172.21.15.146:0/1195984390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6eec153ab0 0x7f6eec14b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:55.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.805+0000 7f6ef1235700 1 -- 172.21.15.146:0/1195984390 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6eec153e80 msgr2=0x7f6eec1526e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:55.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.805+0000 7f6ef1235700 1 --2- 172.21.15.146:0/1195984390 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6eec153e80 0x7f6eec1526e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:55.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.805+0000 7f6ef1235700 1 -- 172.21.15.146:0/1195984390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6eec153ab0 msgr2=0x7f6eec14b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:55.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.805+0000 7f6ef1235700 1 --2- 172.21.15.146:0/1195984390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6eec153ab0 0x7f6eec14b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:55.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.805+0000 7f6ef1235700 1 -- 172.21.15.146:0/1195984390 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee40094f0 con 0x7f6eec068ba0 2023-10-06T11:15:55.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.805+0000 7f6ef1235700 1 --2- 172.21.15.146:0/1195984390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6eec068ba0 0x7f6eec147140 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f6ee800cfc0 tx=0x7f6ee80078b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:55.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.806+0000 7f6ee17fa700 1 -- 172.21.15.146:0/1195984390 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee8016430 con 0x7f6eec068ba0 2023-10-06T11:15:55.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.806+0000 7f6ee17fa700 1 -- 172.21.15.146:0/1195984390 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee8016590 con 0x7f6eec068ba0 2023-10-06T11:15:55.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.806+0000 7f6ef3499700 1 -- 172.21.15.146:0/1195984390 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eec14da60 con 0x7f6eec068ba0 2023-10-06T11:15:55.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.806+0000 7f6ee17fa700 1 -- 172.21.15.146:0/1195984390 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ee8016930 con 0x7f6eec068ba0 2023-10-06T11:15:55.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.806+0000 7f6ef3499700 1 -- 172.21.15.146:0/1195984390 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eec14d150 con 0x7f6eec068ba0 2023-10-06T11:15:55.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.807+0000 7f6ef3499700 1 -- 172.21.15.146:0/1195984390 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6eec04c380 con 0x7f6eec068ba0 2023-10-06T11:15:55.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.807+0000 7f6ee17fa700 1 -- 172.21.15.146:0/1195984390 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6ee8003020 con 0x7f6eec068ba0 2023-10-06T11:15:55.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.807+0000 7f6ee17fa700 1 --2- 172.21.15.146:0/1195984390 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6ed0066f30 0x7f6ed00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:15:55.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.808+0000 7f6ee17fa700 1 -- 172.21.15.146:0/1195984390 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6ee8012070 con 0x7f6eec068ba0 2023-10-06T11:15:55.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.808+0000 7f6ef0a34700 1 --2- 172.21.15.146:0/1195984390 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6ed0066f30 0x7f6ed00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:15:55.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.808+0000 7f6ef0a34700 1 --2- 172.21.15.146:0/1195984390 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6ed0066f30 0x7f6ed00693e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f6eec0b2ff0 tx=0x7f6edc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:15:55.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:55.812+0000 7f6ee17fa700 1 -- 172.21.15.146:0/1195984390 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6ee80526f0 con 0x7f6eec068ba0 2023-10-06T11:15:56.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:56.037+0000 7f6ef3499700 1 -- 172.21.15.146:0/1195984390 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6eec0b6250 con 0x7f6eec068ba0 2023-10-06T11:15:56.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:56.037+0000 7f6ee17fa700 1 -- 172.21.15.146:0/1195984390 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) v1 ==== 95+0+4617 (secure 0 0 0) 0x7f6ee8055d10 con 0x7f6eec068ba0 2023-10-06T11:15:56.039 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:15:56.039 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":108,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7792,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3693464886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3693464886},{"type":"v1","addr":"172.21.15.151:6834","nonce":3693464886}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103},{"gid":7795,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1155762565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":1155762565},{"type":"v1","addr":"172.21.15.151:6835","nonce":1155762565}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103},{"gid":8679,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/3868720724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3868720724},{"type":"v1","addr":"172.21.15.146:6836","nonce":3868720724}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:15:11.929158+0000","modified":"2023-10-06T11:15:15.569866+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8682},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8682":{"gid":8682,"name":"c","rank":0,"incarnation":104,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/1974709597","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":1974709597},{"type":"v1","addr":"172.21.15.146:6837","nonce":1974709597}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-06T11:15:56.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:56.039+0000 7f6ef3499700 1 -- 172.21.15.146:0/1195984390 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6ed0066f30 msgr2=0x7f6ed00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:56.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:56.039+0000 7f6ef3499700 1 --2- 172.21.15.146:0/1195984390 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6ed0066f30 0x7f6ed00693e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f6eec0b2ff0 tx=0x7f6edc009040 comp rx=0 tx=0).stop 2023-10-06T11:15:56.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:56.039+0000 7f6ef3499700 1 -- 172.21.15.146:0/1195984390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6eec068ba0 msgr2=0x7f6eec147140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:15:56.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:56.039+0000 7f6ef3499700 1 --2- 172.21.15.146:0/1195984390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6eec068ba0 0x7f6eec147140 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f6ee800cfc0 tx=0x7f6ee80078b0 comp rx=0 tx=0).stop 2023-10-06T11:15:56.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:56.039+0000 7f6ef3499700 1 -- 172.21.15.146:0/1195984390 shutdown_connections 2023-10-06T11:15:56.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:56.039+0000 7f6ef3499700 1 --2- 172.21.15.146:0/1195984390 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6ed0066f30 0x7f6ed00693e0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:56.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:56.039+0000 7f6ef3499700 1 --2- 172.21.15.146:0/1195984390 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6eec153e80 0x7f6eec1526e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:56.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:56.039+0000 7f6ef3499700 1 --2- 172.21.15.146:0/1195984390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6eec068ba0 0x7f6eec147140 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:56.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:56.039+0000 7f6ef3499700 1 --2- 172.21.15.146:0/1195984390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6eec153ab0 0x7f6eec14b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:15:56.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:56.039+0000 7f6ef3499700 1 -- 172.21.15.146:0/1195984390 >> 172.21.15.146:0/1195984390 conn(0x7f6eec06eba0 msgr2=0x7f6eec151f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:15:56.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:56.039+0000 7f6ef3499700 1 -- 172.21.15.146:0/1195984390 shutdown_connections 2023-10-06T11:15:56.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:15:56.039+0000 7f6ef3499700 1 -- 172.21.15.146:0/1195984390 wait complete. 2023-10-06T11:15:56.042 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 108 2023-10-06T11:15:56.053 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-10-06T11:16:01.055 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:16:01.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.171+0000 7f8ed5052700 1 Processor -- start 2023-10-06T11:16:01.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.171+0000 7f8ed5052700 1 -- start start 2023-10-06T11:16:01.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.172+0000 7f8ed5052700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8ed00b0bd0 0x7f8ed00b1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:01.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.172+0000 7f8ed5052700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8ed0067470 0x7f8ed0067890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:01.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.172+0000 7f8ed5052700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ed0067dd0 con 0x7f8ed0153e00 2023-10-06T11:16:01.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.172+0000 7f8ed5052700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ed015a270 con 0x7f8ed00b0bd0 2023-10-06T11:16:01.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.172+0000 7f8ed5052700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ed015a550 con 0x7f8ed0067470 2023-10-06T11:16:01.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.172+0000 7f8ec659c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8ed00b0bd0 0x7f8ed00b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:01.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.172+0000 7f8ec659c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8ed00b0bd0 0x7f8ed00b1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56964/0 (socket says 172.21.15.146:56964) 2023-10-06T11:16:01.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.172+0000 7f8ec659c700 1 -- 172.21.15.146:0/795271124 learned_addr learned my addr 172.21.15.146:0/795271124 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:01.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.172+0000 7f8ecf59e700 1 --2- 172.21.15.146:0/795271124 >> v2:172.21.15.151:3300/0 conn(0x7f8ed0067470 0x7f8ed0067890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:01.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.173+0000 7f8ec659c700 1 -- 172.21.15.146:0/795271124 >> v2:172.21.15.151:3300/0 conn(0x7f8ed0067470 msgr2=0x7f8ed0067890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:01.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.173+0000 7f8ec659c700 1 --2- 172.21.15.146:0/795271124 >> v2:172.21.15.151:3300/0 conn(0x7f8ed0067470 0x7f8ed0067890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:01.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.173+0000 7f8ec659c700 1 -- 172.21.15.146:0/795271124 >> v1:172.21.15.151:6789/0 conn(0x7f8ed0153e00 legacy=0x7f8ed006b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:01.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.173+0000 7f8ec659c700 1 -- 172.21.15.146:0/795271124 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed015a830 con 0x7f8ed00b0bd0 2023-10-06T11:16:01.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.173+0000 7f8ec659c700 1 --2- 172.21.15.146:0/795271124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ed00b0bd0 0x7f8ed00b1020 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f8ed00b0350 tx=0x7f8eb8009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e24d5a9cffc842f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:01.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.173+0000 7f8ece59c700 1 -- 172.21.15.146:0/795271124 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb8005c10 con 0x7f8ed00b0bd0 2023-10-06T11:16:01.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.173+0000 7f8ece59c700 1 -- 172.21.15.146:0/795271124 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb8005d70 con 0x7f8ed00b0bd0 2023-10-06T11:16:01.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.173+0000 7f8ece59c700 1 -- 172.21.15.146:0/795271124 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb8006260 con 0x7f8ed00b0bd0 2023-10-06T11:16:01.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.173+0000 7f8ed5052700 1 -- 172.21.15.146:0/795271124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ed00b0bd0 msgr2=0x7f8ed00b1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:01.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.173+0000 7f8ed5052700 1 --2- 172.21.15.146:0/795271124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ed00b0bd0 0x7f8ed00b1020 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f8ed00b0350 tx=0x7f8eb8009220 comp rx=0 tx=0).stop 2023-10-06T11:16:01.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.173+0000 7f8ed5052700 1 -- 172.21.15.146:0/795271124 shutdown_connections 2023-10-06T11:16:01.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.173+0000 7f8ed5052700 1 --2- 172.21.15.146:0/795271124 >> v2:172.21.15.151:3300/0 conn(0x7f8ed0067470 0x7f8ed0067890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:01.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.173+0000 7f8ed5052700 1 --2- 172.21.15.146:0/795271124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ed00b0bd0 0x7f8ed00b1020 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:01.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.173+0000 7f8ed5052700 1 -- 172.21.15.146:0/795271124 >> 172.21.15.146:0/795271124 conn(0x7f8ed006b060 msgr2=0x7f8ed00aecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:01.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.173+0000 7f8ed5052700 1 -- 172.21.15.146:0/795271124 shutdown_connections 2023-10-06T11:16:01.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.174+0000 7f8ed5052700 1 -- 172.21.15.146:0/795271124 wait complete. 2023-10-06T11:16:01.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.175+0000 7f8ed5052700 1 Processor -- start 2023-10-06T11:16:01.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.175+0000 7f8ed5052700 1 -- start start 2023-10-06T11:16:01.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.175+0000 7f8ed5052700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ed0067470 0x7f8ed0144e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:01.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.175+0000 7f8ed5052700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ed00b0bd0 0x7f8ed015c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:01.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.175+0000 7f8ed5052700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ed0153e00 0x7f8ed015c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:01.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.175+0000 7f8ed5052700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed016e110 con 0x7f8ed0067470 2023-10-06T11:16:01.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.175+0000 7f8ed5052700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed01541d0 con 0x7f8ed00b0bd0 2023-10-06T11:16:01.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.175+0000 7f8ed5052700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed0145370 con 0x7f8ed0153e00 2023-10-06T11:16:01.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.176+0000 7f8eced9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ed0067470 0x7f8ed0144e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:01.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.176+0000 7f8eced9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ed0067470 0x7f8ed0144e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56976/0 (socket says 172.21.15.146:56976) 2023-10-06T11:16:01.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.176+0000 7f8eced9d700 1 -- 172.21.15.146:0/2419829458 learned_addr learned my addr 172.21.15.146:0/2419829458 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:01.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.176+0000 7f8ec659c700 1 --2- 172.21.15.146:0/2419829458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ed00b0bd0 0x7f8ed015c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:01.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.176+0000 7f8ecf59e700 1 --2- 172.21.15.146:0/2419829458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ed0153e00 0x7f8ed015c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:01.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.176+0000 7f8eced9d700 1 -- 172.21.15.146:0/2419829458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ed0153e00 msgr2=0x7f8ed015c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:01.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.176+0000 7f8eced9d700 1 --2- 172.21.15.146:0/2419829458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ed0153e00 0x7f8ed015c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:01.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.176+0000 7f8eced9d700 1 -- 172.21.15.146:0/2419829458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ed00b0bd0 msgr2=0x7f8ed015c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:01.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.176+0000 7f8eced9d700 1 --2- 172.21.15.146:0/2419829458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ed00b0bd0 0x7f8ed015c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:01.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.176+0000 7f8eced9d700 1 -- 172.21.15.146:0/2419829458 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb8009480 con 0x7f8ed0067470 2023-10-06T11:16:01.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.176+0000 7f8ecf59e700 1 --2- 172.21.15.146:0/2419829458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ed0153e00 0x7f8ed015c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:01.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.176+0000 7f8eced9d700 1 --2- 172.21.15.146:0/2419829458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ed0067470 0x7f8ed0144e30 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f8ec000c510 tx=0x7f8ec000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:01.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.176+0000 7f8ec77fe700 1 -- 172.21.15.146:0/2419829458 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec0011590 con 0x7f8ed0067470 2023-10-06T11:16:01.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.176+0000 7f8ec77fe700 1 -- 172.21.15.146:0/2419829458 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec0011710 con 0x7f8ed0067470 2023-10-06T11:16:01.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.176+0000 7f8ed5052700 1 -- 172.21.15.146:0/2419829458 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ed016b000 con 0x7f8ed0067470 2023-10-06T11:16:01.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.176+0000 7f8ec77fe700 1 -- 172.21.15.146:0/2419829458 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec0011ad0 con 0x7f8ed0067470 2023-10-06T11:16:01.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.176+0000 7f8ed5052700 1 -- 172.21.15.146:0/2419829458 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ed016dac0 con 0x7f8ed0067470 2023-10-06T11:16:01.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.177+0000 7f8ed5052700 1 -- 172.21.15.146:0/2419829458 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ed004c380 con 0x7f8ed0067470 2023-10-06T11:16:01.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.178+0000 7f8ec77fe700 1 -- 172.21.15.146:0/2419829458 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ec001b3b0 con 0x7f8ed0067470 2023-10-06T11:16:01.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.178+0000 7f8ec77fe700 1 --2- 172.21.15.146:0/2419829458 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8eb0066f30 0x7f8eb00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:01.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.178+0000 7f8ec659c700 1 --2- 172.21.15.146:0/2419829458 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8eb0066f30 0x7f8eb00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:01.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.178+0000 7f8ec77fe700 1 -- 172.21.15.146:0/2419829458 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f8ec0083b90 con 0x7f8ed0067470 2023-10-06T11:16:01.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.178+0000 7f8ec659c700 1 --2- 172.21.15.146:0/2419829458 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8eb0066f30 0x7f8eb00693e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8007fd0 tx=0x7f8eb8016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:01.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.182+0000 7f8ec77fe700 1 -- 172.21.15.146:0/2419829458 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ec0050c50 con 0x7f8ed0067470 2023-10-06T11:16:01.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.408+0000 7f8ed5052700 1 -- 172.21.15.146:0/2419829458 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ed016e3f0 con 0x7f8ed0067470 2023-10-06T11:16:01.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.408+0000 7f8ec77fe700 1 -- 172.21.15.146:0/2419829458 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) v1 ==== 95+0+3858 (secure 0 0 0) 0x7f8ec0017070 con 0x7f8ed0067470 2023-10-06T11:16:01.409 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:16:01.409 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":109,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7792,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3693464886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3693464886},{"type":"v1","addr":"172.21.15.151:6834","nonce":3693464886}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103},{"gid":7795,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1155762565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":1155762565},{"type":"v1","addr":"172.21.15.151:6835","nonce":1155762565}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:15:11.929158+0000","modified":"2023-10-06T11:16:00.403456+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":126,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8679":{"gid":8679,"name":"a","rank":0,"incarnation":109,"state":"up:replay","state_seq":1,"addr":"172.21.15.146:6836/3868720724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3868720724},{"type":"v1","addr":"172.21.15.146:6836","nonce":3868720724}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-06T11:16:01.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.411+0000 7f8ed5052700 1 -- 172.21.15.146:0/2419829458 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8eb0066f30 msgr2=0x7f8eb00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:01.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.411+0000 7f8ed5052700 1 --2- 172.21.15.146:0/2419829458 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8eb0066f30 0x7f8eb00693e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8007fd0 tx=0x7f8eb8016000 comp rx=0 tx=0).stop 2023-10-06T11:16:01.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.411+0000 7f8ed5052700 1 -- 172.21.15.146:0/2419829458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ed0067470 msgr2=0x7f8ed0144e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:01.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.411+0000 7f8ed5052700 1 --2- 172.21.15.146:0/2419829458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ed0067470 0x7f8ed0144e30 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f8ec000c510 tx=0x7f8ec000c820 comp rx=0 tx=0).stop 2023-10-06T11:16:01.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.411+0000 7f8ed5052700 1 -- 172.21.15.146:0/2419829458 shutdown_connections 2023-10-06T11:16:01.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.411+0000 7f8ed5052700 1 --2- 172.21.15.146:0/2419829458 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8eb0066f30 0x7f8eb00693e0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:01.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.411+0000 7f8ed5052700 1 --2- 172.21.15.146:0/2419829458 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ed0153e00 0x7f8ed015c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:01.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.411+0000 7f8ed5052700 1 --2- 172.21.15.146:0/2419829458 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ed0067470 0x7f8ed0144e30 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:01.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.411+0000 7f8ed5052700 1 --2- 172.21.15.146:0/2419829458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ed00b0bd0 0x7f8ed015c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:01.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.411+0000 7f8ed5052700 1 -- 172.21.15.146:0/2419829458 >> 172.21.15.146:0/2419829458 conn(0x7f8ed006b060 msgr2=0x7f8ed0152e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:01.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.411+0000 7f8ed5052700 1 -- 172.21.15.146:0/2419829458 shutdown_connections 2023-10-06T11:16:01.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:01.411+0000 7f8ed5052700 1 -- 172.21.15.146:0/2419829458 wait complete. 2023-10-06T11:16:01.413 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 109 2023-10-06T11:16:01.424 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=45.0 retry_count=0)... 2023-10-06T11:16:06.424 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:16:06.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.613+0000 7fbc4287a700 1 Processor -- start 2023-10-06T11:16:06.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.613+0000 7fbc4287a700 1 -- start start 2023-10-06T11:16:06.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.614+0000 7fbc4287a700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbc3c153ab0 0x7fbc3c15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:06.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.614+0000 7fbc4287a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc3c15ac30 con 0x7fbc3c068ba0 2023-10-06T11:16:06.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.614+0000 7fbc4287a700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc3c0b4510 con 0x7fbc3c153e80 2023-10-06T11:16:06.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.614+0000 7fbc4287a700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc3c0b6530 con 0x7fbc3c153ab0 2023-10-06T11:16:06.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.614+0000 7fbc40e17700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fbc3c068ba0 0x7fbc3c0b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:42558/0 (socket says 172.21.15.146:42558) 2023-10-06T11:16:06.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.614+0000 7fbc40e17700 1 -- 172.21.15.146:0/2920254086 learned_addr learned my addr 172.21.15.146:0/2920254086 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:16:06.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.614+0000 7fbc3bfff700 1 --2- 172.21.15.146:0/2920254086 >> v2:172.21.15.151:3300/0 conn(0x7fbc3c153ab0 0x7fbc3c15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:06.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.614+0000 7fbc3affd700 1 -- 172.21.15.146:0/2920254086 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2480978605 0 0) 0x7fbc34001490 con 0x7fbc3c068ba0 2023-10-06T11:16:06.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.614+0000 7fbc3affd700 1 -- 172.21.15.146:0/2920254086 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc24003570 con 0x7fbc3c068ba0 2023-10-06T11:16:06.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.614+0000 7fbc3affd700 1 -- 172.21.15.146:0/2920254086 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2097160938 0 0) 0x7fbc3c0b4510 con 0x7fbc3c153e80 2023-10-06T11:16:06.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.614+0000 7fbc3affd700 1 -- 172.21.15.146:0/2920254086 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc34001490 con 0x7fbc3c153e80 2023-10-06T11:16:06.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.614+0000 7fbc3affd700 1 -- 172.21.15.146:0/2920254086 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1326640558 0 0) 0x7fbc24003570 con 0x7fbc3c068ba0 2023-10-06T11:16:06.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.614+0000 7fbc3affd700 1 -- 172.21.15.146:0/2920254086 >> v2:172.21.15.151:3300/0 conn(0x7fbc3c153ab0 msgr2=0x7fbc3c15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:06.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.614+0000 7fbc3affd700 1 --2- 172.21.15.146:0/2920254086 >> v2:172.21.15.151:3300/0 conn(0x7fbc3c153ab0 0x7fbc3c15a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:06.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.614+0000 7fbc3affd700 1 -- 172.21.15.146:0/2920254086 >> v1:172.21.15.151:6789/0 conn(0x7fbc3c153e80 legacy=0x7fbc3c068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:06.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.614+0000 7fbc3affd700 1 -- 172.21.15.146:0/2920254086 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3c0b5c50 con 0x7fbc3c068ba0 2023-10-06T11:16:06.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.614+0000 7fbc3affd700 1 -- 172.21.15.146:0/2920254086 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fbc34001980 con 0x7fbc3c068ba0 2023-10-06T11:16:06.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.614+0000 7fbc3affd700 1 -- 172.21.15.146:0/2920254086 >> v1:172.21.15.146:6789/0 conn(0x7fbc3c068ba0 legacy=0x7fbc3c0b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:06.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.614+0000 7fbc3affd700 1 --2- 172.21.15.146:0/2920254086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc24003bf0 0x7fbc24003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:06.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.614+0000 7fbc3affd700 1 --2- 172.21.15.146:0/2920254086 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc24004810 0x7fbc24004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:06.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.614+0000 7fbc3affd700 1 --2- 172.21.15.146:0/2920254086 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc240051c0 0x7fbc2400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:06.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.614+0000 7fbc3affd700 1 -- 172.21.15.146:0/2920254086 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c0b6530 con 0x7fbc24004810 2023-10-06T11:16:06.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.614+0000 7fbc3affd700 1 -- 172.21.15.146:0/2920254086 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2400c0b0 con 0x7fbc24003bf0 2023-10-06T11:16:06.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.614+0000 7fbc3affd700 1 -- 172.21.15.146:0/2920254086 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2400c270 con 0x7fbc240051c0 2023-10-06T11:16:06.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.614+0000 7fbc3b7fe700 1 --2- 172.21.15.146:0/2920254086 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc24004810 0x7fbc24004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:06.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.614+0000 7fbc3bfff700 1 --2- 172.21.15.146:0/2920254086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc24003bf0 0x7fbc24003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:06.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.615+0000 7fbc40e17700 1 --2- 172.21.15.146:0/2920254086 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc240051c0 0x7fbc2400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:06.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.615+0000 7fbc3b7fe700 1 -- 172.21.15.146:0/2920254086 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc240051c0 msgr2=0x7fbc2400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:06.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.615+0000 7fbc3b7fe700 1 --2- 172.21.15.146:0/2920254086 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc240051c0 0x7fbc2400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:06.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.615+0000 7fbc3b7fe700 1 -- 172.21.15.146:0/2920254086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc24003bf0 msgr2=0x7fbc24003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:06.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.615+0000 7fbc3b7fe700 1 --2- 172.21.15.146:0/2920254086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc24003bf0 0x7fbc24003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:06.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.615+0000 7fbc3b7fe700 1 -- 172.21.15.146:0/2920254086 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc24003570 con 0x7fbc24004810 2023-10-06T11:16:06.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.615+0000 7fbc40e17700 1 --2- 172.21.15.146:0/2920254086 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc240051c0 0x7fbc2400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:06.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.615+0000 7fbc40e17700 1 -- 172.21.15.146:0/2920254086 reap_dead start 2023-10-06T11:16:06.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.615+0000 7fbc3b7fe700 1 --2- 172.21.15.146:0/2920254086 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc24004810 0x7fbc24004c80 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c001a10 tx=0x7fbc2c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82f60c22435739b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:06.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.615+0000 7fbc3affd700 1 -- 172.21.15.146:0/2920254086 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c00c5d0 con 0x7fbc24004810 2023-10-06T11:16:06.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.615+0000 7fbc3affd700 1 -- 172.21.15.146:0/2920254086 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc2c00c730 con 0x7fbc24004810 2023-10-06T11:16:06.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.615+0000 7fbc3affd700 1 -- 172.21.15.146:0/2920254086 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2c00cad0 con 0x7fbc24004810 2023-10-06T11:16:06.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.615+0000 7fbc4287a700 1 -- 172.21.15.146:0/2920254086 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc24004810 msgr2=0x7fbc24004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:06.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.615+0000 7fbc4287a700 1 --2- 172.21.15.146:0/2920254086 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc24004810 0x7fbc24004c80 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c001a10 tx=0x7fbc2c007d30 comp rx=0 tx=0).stop 2023-10-06T11:16:06.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.615+0000 7fbc4287a700 1 -- 172.21.15.146:0/2920254086 shutdown_connections 2023-10-06T11:16:06.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.615+0000 7fbc4287a700 1 --2- 172.21.15.146:0/2920254086 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc24004810 0x7fbc24004c80 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:06.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.615+0000 7fbc4287a700 1 -- 172.21.15.146:0/2920254086 >> 172.21.15.146:0/2920254086 conn(0x7fbc3c06eba0 msgr2=0x7fbc3c06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:06.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.616+0000 7fbc4287a700 1 -- 172.21.15.146:0/2920254086 shutdown_connections 2023-10-06T11:16:06.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.616+0000 7fbc4287a700 1 -- 172.21.15.146:0/2920254086 wait complete. 2023-10-06T11:16:06.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.617+0000 7fbc4287a700 1 Processor -- start 2023-10-06T11:16:06.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.617+0000 7fbc4287a700 1 -- start start 2023-10-06T11:16:06.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.617+0000 7fbc4287a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc24004810 0x7fbc3c138030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:06.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.617+0000 7fbc4287a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc3c14cb90 0x7fbc3c0b0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:06.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.617+0000 7fbc4287a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc3c14d000 0x7fbc3c0b13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:06.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.617+0000 7fbc4287a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c14fe00 con 0x7fbc3c14d000 2023-10-06T11:16:06.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.617+0000 7fbc4287a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c14f840 con 0x7fbc24004810 2023-10-06T11:16:06.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.617+0000 7fbc4287a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3c14fb20 con 0x7fbc3c14cb90 2023-10-06T11:16:06.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.618+0000 7fbc40e17700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc3c14d000 0x7fbc3c0b13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:06.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.618+0000 7fbc3bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc24004810 0x7fbc3c138030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:06.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.618+0000 7fbc40e17700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc3c14d000 0x7fbc3c0b13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36240/0 (socket says 172.21.15.146:36240) 2023-10-06T11:16:06.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.618+0000 7fbc40e17700 1 -- 172.21.15.146:0/2645128046 learned_addr learned my addr 172.21.15.146:0/2645128046 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:06.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.618+0000 7fbc3b7fe700 1 --2- 172.21.15.146:0/2645128046 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc3c14cb90 0x7fbc3c0b0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:06.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.618+0000 7fbc40e17700 1 -- 172.21.15.146:0/2645128046 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc3c14cb90 msgr2=0x7fbc3c0b0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:06.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.618+0000 7fbc40e17700 1 --2- 172.21.15.146:0/2645128046 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc3c14cb90 0x7fbc3c0b0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:06.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.618+0000 7fbc40e17700 1 -- 172.21.15.146:0/2645128046 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc24004810 msgr2=0x7fbc3c138030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:06.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.618+0000 7fbc40e17700 1 --2- 172.21.15.146:0/2645128046 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc24004810 0x7fbc3c138030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:06.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.618+0000 7fbc40e17700 1 -- 172.21.15.146:0/2645128046 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3c138aa0 con 0x7fbc3c14d000 2023-10-06T11:16:06.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.618+0000 7fbc40e17700 1 --2- 172.21.15.146:0/2645128046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc3c14d000 0x7fbc3c0b13d0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7fbc34000f80 tx=0x7fbc3c0b3db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:06.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.618+0000 7fbc23fff700 1 -- 172.21.15.146:0/2645128046 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3400eab0 con 0x7fbc3c14d000 2023-10-06T11:16:06.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.618+0000 7fbc23fff700 1 -- 172.21.15.146:0/2645128046 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3400ec30 con 0x7fbc3c14d000 2023-10-06T11:16:06.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.618+0000 7fbc4287a700 1 -- 172.21.15.146:0/2645128046 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc3c138d80 con 0x7fbc3c14d000 2023-10-06T11:16:06.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.618+0000 7fbc23fff700 1 -- 172.21.15.146:0/2645128046 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc34013420 con 0x7fbc3c14d000 2023-10-06T11:16:06.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.618+0000 7fbc4287a700 1 -- 172.21.15.146:0/2645128046 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc3c0b1910 con 0x7fbc3c14d000 2023-10-06T11:16:06.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.619+0000 7fbc4287a700 1 -- 172.21.15.146:0/2645128046 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc3c138f70 con 0x7fbc3c14d000 2023-10-06T11:16:06.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.619+0000 7fbc23fff700 1 -- 172.21.15.146:0/2645128046 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbc34013810 con 0x7fbc3c14d000 2023-10-06T11:16:06.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.620+0000 7fbc23fff700 1 --2- 172.21.15.146:0/2645128046 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbc28066f30 0x7fbc280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:06.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.620+0000 7fbc23fff700 1 -- 172.21.15.146:0/2645128046 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fbc34084a60 con 0x7fbc3c14d000 2023-10-06T11:16:06.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.620+0000 7fbc3bfff700 1 --2- 172.21.15.146:0/2645128046 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbc28066f30 0x7fbc280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:06.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.620+0000 7fbc3bfff700 1 --2- 172.21.15.146:0/2645128046 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbc28066f30 0x7fbc280693e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c0b2f50 tx=0x7fbc300091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:06.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.624+0000 7fbc23fff700 1 -- 172.21.15.146:0/2645128046 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbc34051b20 con 0x7fbc3c14d000 2023-10-06T11:16:06.829 INFO:tasks.ceph.mds.a.smithi146.stderr:2023-10-06T11:16:06.827+0000 7f291c3d9700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T11:16:06.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.849+0000 7fbc4287a700 1 -- 172.21.15.146:0/2645128046 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbc3c15bdb0 con 0x7fbc3c14d000 2023-10-06T11:16:06.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.850+0000 7fbc23fff700 1 -- 172.21.15.146:0/2645128046 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) v1 ==== 95+0+3859 (secure 0 0 0) 0x7fbc3c15bdb0 con 0x7fbc3c14d000 2023-10-06T11:16:06.852 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:16:06.852 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":112,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7792,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3693464886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3693464886},{"type":"v1","addr":"172.21.15.151:6834","nonce":3693464886}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103},{"gid":7795,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1155762565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":1155762565},{"type":"v1","addr":"172.21.15.151:6835","nonce":1155762565}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:15:11.929158+0000","modified":"2023-10-06T11:16:03.435307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":126,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8679":{"gid":8679,"name":"a","rank":0,"incarnation":109,"state":"up:active","state_seq":17,"addr":"172.21.15.146:6836/3868720724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3868720724},{"type":"v1","addr":"172.21.15.146:6836","nonce":3868720724}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-06T11:16:06.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.852+0000 7fbc4287a700 1 -- 172.21.15.146:0/2645128046 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbc28066f30 msgr2=0x7fbc280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:06.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.852+0000 7fbc4287a700 1 --2- 172.21.15.146:0/2645128046 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbc28066f30 0x7fbc280693e0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c0b2f50 tx=0x7fbc300091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:06.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.852+0000 7fbc4287a700 1 -- 172.21.15.146:0/2645128046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc3c14d000 msgr2=0x7fbc3c0b13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:06.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.852+0000 7fbc4287a700 1 --2- 172.21.15.146:0/2645128046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc3c14d000 0x7fbc3c0b13d0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7fbc34000f80 tx=0x7fbc3c0b3db0 comp rx=0 tx=0).stop 2023-10-06T11:16:06.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.852+0000 7fbc4287a700 1 -- 172.21.15.146:0/2645128046 shutdown_connections 2023-10-06T11:16:06.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.852+0000 7fbc4287a700 1 --2- 172.21.15.146:0/2645128046 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbc28066f30 0x7fbc280693e0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:06.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.852+0000 7fbc4287a700 1 --2- 172.21.15.146:0/2645128046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbc3c14d000 0x7fbc3c0b13d0 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:06.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.852+0000 7fbc4287a700 1 --2- 172.21.15.146:0/2645128046 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbc24004810 0x7fbc3c138030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:06.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.852+0000 7fbc4287a700 1 --2- 172.21.15.146:0/2645128046 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbc3c14cb90 0x7fbc3c0b0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:06.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.852+0000 7fbc4287a700 1 -- 172.21.15.146:0/2645128046 >> 172.21.15.146:0/2645128046 conn(0x7fbc3c06eba0 msgr2=0x7fbc3c15c730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:06.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.852+0000 7fbc4287a700 1 -- 172.21.15.146:0/2645128046 shutdown_connections 2023-10-06T11:16:06.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.852+0000 7fbc4287a700 1 -- 172.21.15.146:0/2645128046 wait complete. 2023-10-06T11:16:06.855 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 112 2023-10-06T11:16:06.866 DEBUG:tasks.ceph_test_case:wait_until_true: success in 20s and 0 retries 2023-10-06T11:16:06.866 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:16:06.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.979+0000 7fb9ec775700 1 Processor -- start 2023-10-06T11:16:06.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.979+0000 7fb9ec775700 1 -- start start 2023-10-06T11:16:06.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.980+0000 7fb9ec775700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9e4153e80 0x7fb9e415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:06.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.980+0000 7fb9ec775700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e415ac30 con 0x7fb9e4153ab0 2023-10-06T11:16:06.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.980+0000 7fb9ec775700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9e40b4510 con 0x7fb9e4068ba0 2023-10-06T11:16:06.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.980+0000 7fb9ec775700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e40b6530 con 0x7fb9e4153e80 2023-10-06T11:16:06.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.980+0000 7fb9ea511700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb9e4153ab0 0x7fb9e4068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:42572/0 (socket says 172.21.15.146:42572) 2023-10-06T11:16:06.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.980+0000 7fb9ea511700 1 -- 172.21.15.146:0/560097677 learned_addr learned my addr 172.21.15.146:0/560097677 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:16:06.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.980+0000 7fb9e950f700 1 -- 172.21.15.146:0/560097677 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1930399230 0 0) 0x7fb9dc001110 con 0x7fb9e4153ab0 2023-10-06T11:16:06.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.980+0000 7fb9ead12700 1 --2- 172.21.15.146:0/560097677 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9e4153e80 0x7fb9e415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:06.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.981+0000 7fb9e950f700 1 -- 172.21.15.146:0/560097677 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9cc003570 con 0x7fb9e4153ab0 2023-10-06T11:16:06.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.981+0000 7fb9e950f700 1 -- 172.21.15.146:0/560097677 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3358914843 0 0) 0x7fb9cc003570 con 0x7fb9e4153ab0 2023-10-06T11:16:06.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.981+0000 7fb9e950f700 1 -- 172.21.15.146:0/560097677 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9e4153e80 msgr2=0x7fb9e415a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:06.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.981+0000 7fb9e950f700 1 --2- 172.21.15.146:0/560097677 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9e4153e80 0x7fb9e415a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:06.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.981+0000 7fb9e950f700 1 -- 172.21.15.146:0/560097677 >> v1:172.21.15.151:6789/0 conn(0x7fb9e4068ba0 legacy=0x7fb9e40b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:06.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.981+0000 7fb9e950f700 1 -- 172.21.15.146:0/560097677 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e40b5c50 con 0x7fb9e4153ab0 2023-10-06T11:16:06.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.981+0000 7fb9e950f700 1 -- 172.21.15.146:0/560097677 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fb9dc001600 con 0x7fb9e4153ab0 2023-10-06T11:16:06.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.981+0000 7fb9e950f700 1 -- 172.21.15.146:0/560097677 >> v1:172.21.15.146:6789/0 conn(0x7fb9e4153ab0 legacy=0x7fb9e4068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:06.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.981+0000 7fb9e950f700 1 --2- 172.21.15.146:0/560097677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9cc003a90 0x7fb9cc003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:06.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.981+0000 7fb9e950f700 1 --2- 172.21.15.146:0/560097677 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9e4153e80 0x7fb9cc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:06.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.981+0000 7fb9e950f700 1 --2- 172.21.15.146:0/560097677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9cc004d50 0x7fb9cc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:06.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.981+0000 7fb9e950f700 1 -- 172.21.15.146:0/560097677 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e40b6530 con 0x7fb9cc003a90 2023-10-06T11:16:06.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.981+0000 7fb9e950f700 1 -- 172.21.15.146:0/560097677 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9cc00bb70 con 0x7fb9cc004d50 2023-10-06T11:16:06.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.981+0000 7fb9e950f700 1 -- 172.21.15.146:0/560097677 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9cc00bd30 con 0x7fb9e4153e80 2023-10-06T11:16:06.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.981+0000 7fb9ea511700 1 --2- 172.21.15.146:0/560097677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9cc003a90 0x7fb9cc003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:06.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.981+0000 7fb9ead12700 1 --2- 172.21.15.146:0/560097677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9cc004d50 0x7fb9cc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:06.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.981+0000 7fb9e9d10700 1 --2- 172.21.15.146:0/560097677 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9e4153e80 0x7fb9cc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:06.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.981+0000 7fb9ea511700 1 -- 172.21.15.146:0/560097677 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9e4153e80 msgr2=0x7fb9cc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:06.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.981+0000 7fb9ea511700 1 --2- 172.21.15.146:0/560097677 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9e4153e80 0x7fb9cc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:06.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.981+0000 7fb9ea511700 1 -- 172.21.15.146:0/560097677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9cc004d50 msgr2=0x7fb9cc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:06.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.981+0000 7fb9ea511700 1 --2- 172.21.15.146:0/560097677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9cc004d50 0x7fb9cc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:06.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.981+0000 7fb9ea511700 1 -- 172.21.15.146:0/560097677 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9cc003570 con 0x7fb9cc003a90 2023-10-06T11:16:06.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.981+0000 7fb9ea511700 1 --2- 172.21.15.146:0/560097677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9cc003a90 0x7fb9cc003ea0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc00c5f0 tx=0x7fb9e4159c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb55df491818fbb1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:06.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.982+0000 7fb9e950f700 1 -- 172.21.15.146:0/560097677 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc00cdf0 con 0x7fb9cc003a90 2023-10-06T11:16:06.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.982+0000 7fb9e950f700 1 -- 172.21.15.146:0/560097677 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9dc005920 con 0x7fb9cc003a90 2023-10-06T11:16:06.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.982+0000 7fb9e950f700 1 -- 172.21.15.146:0/560097677 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc005ce0 con 0x7fb9cc003a90 2023-10-06T11:16:06.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.982+0000 7fb9ec775700 1 -- 172.21.15.146:0/560097677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9cc003a90 msgr2=0x7fb9cc003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:06.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.982+0000 7fb9ec775700 1 --2- 172.21.15.146:0/560097677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9cc003a90 0x7fb9cc003ea0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc00c5f0 tx=0x7fb9e4159c70 comp rx=0 tx=0).stop 2023-10-06T11:16:06.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.982+0000 7fb9ead12700 1 -- 172.21.15.146:0/560097677 reap_dead start 2023-10-06T11:16:06.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.982+0000 7fb9ec775700 1 -- 172.21.15.146:0/560097677 shutdown_connections 2023-10-06T11:16:06.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.982+0000 7fb9ec775700 1 -- 172.21.15.146:0/560097677 >> 172.21.15.146:0/560097677 conn(0x7fb9e406eba0 msgr2=0x7fb9e406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:06.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.982+0000 7fb9ec775700 1 -- 172.21.15.146:0/560097677 shutdown_connections 2023-10-06T11:16:06.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.982+0000 7fb9ec775700 1 -- 172.21.15.146:0/560097677 wait complete. 2023-10-06T11:16:06.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.983+0000 7fb9ec775700 1 Processor -- start 2023-10-06T11:16:06.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.983+0000 7fb9ec775700 1 -- start start 2023-10-06T11:16:06.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.984+0000 7fb9ec775700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9cc003a90 0x7fb9e4167780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:06.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.984+0000 7fb9ec775700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9e40ceba0 0x7fb9e416a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:06.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.984+0000 7fb9ec775700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9e40cf010 0x7fb9e416ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:06.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.984+0000 7fb9ec775700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e40c56b0 con 0x7fb9e40ceba0 2023-10-06T11:16:06.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.984+0000 7fb9ec775700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e416b1f0 con 0x7fb9cc003a90 2023-10-06T11:16:06.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.984+0000 7fb9ec775700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9e416b4d0 con 0x7fb9e40cf010 2023-10-06T11:16:06.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.984+0000 7fb9e9d10700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9e40ceba0 0x7fb9e416a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:06.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.984+0000 7fb9e9d10700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9e40ceba0 0x7fb9e416a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36260/0 (socket says 172.21.15.146:36260) 2023-10-06T11:16:06.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.984+0000 7fb9e9d10700 1 -- 172.21.15.146:0/1862739053 learned_addr learned my addr 172.21.15.146:0/1862739053 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:06.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.984+0000 7fb9ead12700 1 --2- 172.21.15.146:0/1862739053 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9e40cf010 0x7fb9e416ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:06.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.984+0000 7fb9e9d10700 1 -- 172.21.15.146:0/1862739053 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9e40cf010 msgr2=0x7fb9e416ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:06.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.984+0000 7fb9ea511700 1 --2- 172.21.15.146:0/1862739053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9cc003a90 0x7fb9e4167780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:06.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.984+0000 7fb9e9d10700 1 --2- 172.21.15.146:0/1862739053 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9e40cf010 0x7fb9e416ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:06.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.984+0000 7fb9e9d10700 1 -- 172.21.15.146:0/1862739053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9cc003a90 msgr2=0x7fb9e4167780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:06.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.984+0000 7fb9e9d10700 1 --2- 172.21.15.146:0/1862739053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9cc003a90 0x7fb9e4167780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:06.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.984+0000 7fb9e9d10700 1 -- 172.21.15.146:0/1862739053 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e416b7b0 con 0x7fb9e40ceba0 2023-10-06T11:16:06.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.984+0000 7fb9ead12700 1 --2- 172.21.15.146:0/1862739053 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9e40cf010 0x7fb9e416ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:06.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.985+0000 7fb9e9d10700 1 --2- 172.21.15.146:0/1862739053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9e40ceba0 0x7fb9e416a610 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7fb9d800eae0 tx=0x7fb9d8001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:06.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.985+0000 7fb9e27fc700 1 -- 172.21.15.146:0/1862739053 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d800c8b0 con 0x7fb9e40ceba0 2023-10-06T11:16:06.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.985+0000 7fb9e27fc700 1 -- 172.21.15.146:0/1862739053 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d800ca10 con 0x7fb9e40ceba0 2023-10-06T11:16:06.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.985+0000 7fb9ec775700 1 -- 172.21.15.146:0/1862739053 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9e416ba90 con 0x7fb9e40ceba0 2023-10-06T11:16:06.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.985+0000 7fb9e27fc700 1 -- 172.21.15.146:0/1862739053 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d800cdb0 con 0x7fb9e40ceba0 2023-10-06T11:16:06.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.985+0000 7fb9ec775700 1 -- 172.21.15.146:0/1862739053 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9e4159770 con 0x7fb9e40ceba0 2023-10-06T11:16:06.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.986+0000 7fb9ec775700 1 -- 172.21.15.146:0/1862739053 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9e404c380 con 0x7fb9e40ceba0 2023-10-06T11:16:06.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.986+0000 7fb9e27fc700 1 -- 172.21.15.146:0/1862739053 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb9d8013630 con 0x7fb9e40ceba0 2023-10-06T11:16:06.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.986+0000 7fb9e27fc700 1 --2- 172.21.15.146:0/1862739053 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb9d0066f30 0x7fb9d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:06.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.986+0000 7fb9e27fc700 1 -- 172.21.15.146:0/1862739053 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fb9d8084c60 con 0x7fb9e40ceba0 2023-10-06T11:16:06.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.986+0000 7fb9ea511700 1 --2- 172.21.15.146:0/1862739053 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb9d0066f30 0x7fb9d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:06.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.987+0000 7fb9ea511700 1 --2- 172.21.15.146:0/1862739053 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb9d0066f30 0x7fb9d00693e0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc007e10 tx=0x7fb9dc015000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:06.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:06.991+0000 7fb9e27fc700 1 -- 172.21.15.146:0/1862739053 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb9d8051da0 con 0x7fb9e40ceba0 2023-10-06T11:16:07.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.215+0000 7fb9ec775700 1 -- 172.21.15.146:0/1862739053 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb9e40b6250 con 0x7fb9e40ceba0 2023-10-06T11:16:07.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.216+0000 7fb9e27fc700 1 -- 172.21.15.146:0/1862739053 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) v1 ==== 95+0+3859 (secure 0 0 0) 0x7fb9d80553c0 con 0x7fb9e40ceba0 2023-10-06T11:16:07.218 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:16:07.218 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":112,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7792,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3693464886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3693464886},{"type":"v1","addr":"172.21.15.151:6834","nonce":3693464886}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103},{"gid":7795,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1155762565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":1155762565},{"type":"v1","addr":"172.21.15.151:6835","nonce":1155762565}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:15:11.929158+0000","modified":"2023-10-06T11:16:03.435307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":126,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8679":{"gid":8679,"name":"a","rank":0,"incarnation":109,"state":"up:active","state_seq":17,"addr":"172.21.15.146:6836/3868720724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3868720724},{"type":"v1","addr":"172.21.15.146:6836","nonce":3868720724}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-06T11:16:07.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.218+0000 7fb9ec775700 1 -- 172.21.15.146:0/1862739053 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb9d0066f30 msgr2=0x7fb9d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:07.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.218+0000 7fb9ec775700 1 --2- 172.21.15.146:0/1862739053 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb9d0066f30 0x7fb9d00693e0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc007e10 tx=0x7fb9dc015000 comp rx=0 tx=0).stop 2023-10-06T11:16:07.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.218+0000 7fb9ec775700 1 -- 172.21.15.146:0/1862739053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9e40ceba0 msgr2=0x7fb9e416a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:07.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.218+0000 7fb9ec775700 1 --2- 172.21.15.146:0/1862739053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9e40ceba0 0x7fb9e416a610 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7fb9d800eae0 tx=0x7fb9d8001640 comp rx=0 tx=0).stop 2023-10-06T11:16:07.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.218+0000 7fb9ec775700 1 -- 172.21.15.146:0/1862739053 shutdown_connections 2023-10-06T11:16:07.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.218+0000 7fb9ec775700 1 --2- 172.21.15.146:0/1862739053 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb9d0066f30 0x7fb9d00693e0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:07.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.218+0000 7fb9ec775700 1 --2- 172.21.15.146:0/1862739053 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9e40cf010 0x7fb9e416ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:07.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.218+0000 7fb9ec775700 1 --2- 172.21.15.146:0/1862739053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9cc003a90 0x7fb9e4167780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:07.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.218+0000 7fb9ec775700 1 --2- 172.21.15.146:0/1862739053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9e40ceba0 0x7fb9e416a610 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:07.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.218+0000 7fb9ec775700 1 -- 172.21.15.146:0/1862739053 >> 172.21.15.146:0/1862739053 conn(0x7fb9e406eba0 msgr2=0x7fb9e40b1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:07.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.218+0000 7fb9ec775700 1 -- 172.21.15.146:0/1862739053 shutdown_connections 2023-10-06T11:16:07.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.218+0000 7fb9ec775700 1 -- 172.21.15.146:0/1862739053 wait complete. 2023-10-06T11:16:07.221 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 112 2023-10-06T11:16:07.232 DEBUG:tasks.cephfs.test_scrub_checks:current active=['a'] 2023-10-06T11:16:07.232 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T11:16:07.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.344+0000 7fb7cd9ff700 1 Processor -- start 2023-10-06T11:16:07.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.344+0000 7fb7cd9ff700 1 -- start start 2023-10-06T11:16:07.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.345+0000 7fb7cd9ff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb7c806b7c0 0x7fb7c80a9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:07.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.345+0000 7fb7cd9ff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7c8067b50 con 0x7fb7c8068bf0 2023-10-06T11:16:07.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.345+0000 7fb7cd9ff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7c8067e30 con 0x7fb7c80a9b10 2023-10-06T11:16:07.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.345+0000 7fb7cd9ff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7c8068110 con 0x7fb7c806b7c0 2023-10-06T11:16:07.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.345+0000 7fb7c77fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb7c806b7c0 0x7fb7c80a9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:07.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.345+0000 7fb7c77fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb7c806b7c0 0x7fb7c80a9ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36276/0 (socket says 172.21.15.146:36276) 2023-10-06T11:16:07.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.345+0000 7fb7c77fe700 1 -- 172.21.15.146:0/874524844 learned_addr learned my addr 172.21.15.146:0/874524844 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:07.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.346+0000 7fb7c77fe700 1 -- 172.21.15.146:0/874524844 >> v1:172.21.15.151:6789/0 conn(0x7fb7c80a9b10 legacy=0x7fb7c806b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:07.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.346+0000 7fb7c77fe700 1 -- 172.21.15.146:0/874524844 >> v1:172.21.15.146:6789/0 conn(0x7fb7c8068bf0 legacy=0x7fb7c8069c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:07.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.346+0000 7fb7c77fe700 1 -- 172.21.15.146:0/874524844 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c80683f0 con 0x7fb7c806b7c0 2023-10-06T11:16:07.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.346+0000 7fb7c77fe700 1 --2- 172.21.15.146:0/874524844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7c806b7c0 0x7fb7c80a9ee0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7fb7b80099b0 tx=0x7fb7b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=763cd8a1507304b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:07.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.346+0000 7fb7c5ffb700 1 -- 172.21.15.146:0/874524844 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b800b860 con 0x7fb7c806b7c0 2023-10-06T11:16:07.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.346+0000 7fb7c5ffb700 1 -- 172.21.15.146:0/874524844 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b800b9c0 con 0x7fb7c806b7c0 2023-10-06T11:16:07.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.346+0000 7fb7c5ffb700 1 -- 172.21.15.146:0/874524844 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b800bd60 con 0x7fb7c806b7c0 2023-10-06T11:16:07.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.346+0000 7fb7cd9ff700 1 -- 172.21.15.146:0/874524844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7c806b7c0 msgr2=0x7fb7c80a9ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:07.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.346+0000 7fb7cd9ff700 1 --2- 172.21.15.146:0/874524844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7c806b7c0 0x7fb7c80a9ee0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7fb7b80099b0 tx=0x7fb7b8009250 comp rx=0 tx=0).stop 2023-10-06T11:16:07.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.347+0000 7fb7cd9ff700 1 -- 172.21.15.146:0/874524844 shutdown_connections 2023-10-06T11:16:07.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.347+0000 7fb7cd9ff700 1 --2- 172.21.15.146:0/874524844 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7c806b7c0 0x7fb7c80a9ee0 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:07.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.347+0000 7fb7cd9ff700 1 -- 172.21.15.146:0/874524844 >> 172.21.15.146:0/874524844 conn(0x7fb7c80c93e0 msgr2=0x7fb7c80c97e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:07.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.347+0000 7fb7cd9ff700 1 -- 172.21.15.146:0/874524844 shutdown_connections 2023-10-06T11:16:07.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.347+0000 7fb7cd9ff700 1 -- 172.21.15.146:0/874524844 wait complete. 2023-10-06T11:16:07.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.348+0000 7fb7cd9ff700 1 Processor -- start 2023-10-06T11:16:07.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.348+0000 7fb7cd9ff700 1 -- start start 2023-10-06T11:16:07.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.349+0000 7fb7cd9ff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb7c8068bf0 0x7fb7c815e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:07.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.349+0000 7fb7cd9ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7c806b7c0 0x7fb7c81589d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:07.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.349+0000 7fb7cd9ff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7c80a9b10 0x7fb7c815b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:07.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.349+0000 7fb7cd9ff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c815a690 con 0x7fb7c80a9b10 2023-10-06T11:16:07.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.349+0000 7fb7cd9ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c815a8a0 con 0x7fb7c806b7c0 2023-10-06T11:16:07.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.349+0000 7fb7cd9ff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c815ab80 con 0x7fb7c8068bf0 2023-10-06T11:16:07.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.349+0000 7fb7c77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7c80a9b10 0x7fb7c815b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:07.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.349+0000 7fb7c77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7c80a9b10 0x7fb7c815b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36286/0 (socket says 172.21.15.146:36286) 2023-10-06T11:16:07.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.349+0000 7fb7c77fe700 1 -- 172.21.15.146:0/259102018 learned_addr learned my addr 172.21.15.146:0/259102018 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:07.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.349+0000 7fb7c67fc700 1 --2- 172.21.15.146:0/259102018 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7c806b7c0 0x7fb7c81589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:07.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.349+0000 7fb7c6ffd700 1 --2- 172.21.15.146:0/259102018 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb7c8068bf0 0x7fb7c815e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:07.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.349+0000 7fb7c77fe700 1 -- 172.21.15.146:0/259102018 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb7c8068bf0 msgr2=0x7fb7c815e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:07.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.349+0000 7fb7c77fe700 1 --2- 172.21.15.146:0/259102018 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb7c8068bf0 0x7fb7c815e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:07.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.349+0000 7fb7c77fe700 1 -- 172.21.15.146:0/259102018 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7c806b7c0 msgr2=0x7fb7c81589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:07.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.349+0000 7fb7c77fe700 1 --2- 172.21.15.146:0/259102018 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7c806b7c0 0x7fb7c81589d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:07.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.349+0000 7fb7c77fe700 1 -- 172.21.15.146:0/259102018 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b80094f0 con 0x7fb7c80a9b10 2023-10-06T11:16:07.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.349+0000 7fb7c77fe700 1 --2- 172.21.15.146:0/259102018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7c80a9b10 0x7fb7c815b940 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7fb7b80094c0 tx=0x7fb7b8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:07.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.349+0000 7fb7beffd700 1 -- 172.21.15.146:0/259102018 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b801a630 con 0x7fb7c80a9b10 2023-10-06T11:16:07.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.349+0000 7fb7beffd700 1 -- 172.21.15.146:0/259102018 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b801a790 con 0x7fb7c80a9b10 2023-10-06T11:16:07.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.349+0000 7fb7beffd700 1 -- 172.21.15.146:0/259102018 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b801ab50 con 0x7fb7c80a9b10 2023-10-06T11:16:07.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.349+0000 7fb7cd9ff700 1 -- 172.21.15.146:0/259102018 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7c815ae60 con 0x7fb7c80a9b10 2023-10-06T11:16:07.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.349+0000 7fb7cd9ff700 1 -- 172.21.15.146:0/259102018 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7c815b420 con 0x7fb7c80a9b10 2023-10-06T11:16:07.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.350+0000 7fb7cd9ff700 1 -- 172.21.15.146:0/259102018 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7c80ca5a0 con 0x7fb7c80a9b10 2023-10-06T11:16:07.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.351+0000 7fb7beffd700 1 -- 172.21.15.146:0/259102018 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb7b8024440 con 0x7fb7c80a9b10 2023-10-06T11:16:07.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.351+0000 7fb7beffd700 1 --2- 172.21.15.146:0/259102018 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb7a8066f30 0x7fb7a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:07.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.351+0000 7fb7beffd700 1 -- 172.21.15.146:0/259102018 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fb7b8086470 con 0x7fb7c80a9b10 2023-10-06T11:16:07.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.351+0000 7fb7c6ffd700 1 --2- 172.21.15.146:0/259102018 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb7a8066f30 0x7fb7a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:07.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.352+0000 7fb7c6ffd700 1 --2- 172.21.15.146:0/259102018 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb7a8066f30 0x7fb7a80693e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fb7c000c580 tx=0x7fb7c0001b20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:07.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.356+0000 7fb7beffd700 1 -- 172.21.15.146:0/259102018 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb7b8053530 con 0x7fb7c80a9b10 2023-10-06T11:16:07.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.619+0000 7fb7cd9ff700 1 -- 172.21.15.146:0/259102018 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fb7c815b610 con 0x7fb7c80a9b10 2023-10-06T11:16:07.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.619+0000 7fb7beffd700 1 -- 172.21.15.146:0/259102018 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1213 (secure 0 0 0) 0x7fb7b8056b50 con 0x7fb7c80a9b10 2023-10-06T11:16:07.622 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:16:07.622 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":642,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":126,"num_osds":8,"num_up_osds":8,"osd_up_since":1696590336,"num_in_osds":8,"osd_in_since":1696590327,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":1071,"data_bytes":1078527910,"bytes_used":4651204608,"bytes_avail":768442908672,"bytes_total":773094113280,"read_bytes_sec":357068,"write_bytes_sec":91826,"read_op_per_sec":3,"write_op_per_sec":27},"fsmap":{"epoch":112,"id":9,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":9,"rank":0,"name":"a","status":"up:active","gid":8679}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":26,"modified":"2023-10-06T11:16:07.275107+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T11:16:07.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.622+0000 7fb7cd9ff700 1 -- 172.21.15.146:0/259102018 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb7a8066f30 msgr2=0x7fb7a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:07.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.622+0000 7fb7cd9ff700 1 --2- 172.21.15.146:0/259102018 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb7a8066f30 0x7fb7a80693e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fb7c000c580 tx=0x7fb7c0001b20 comp rx=0 tx=0).stop 2023-10-06T11:16:07.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.622+0000 7fb7cd9ff700 1 -- 172.21.15.146:0/259102018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7c80a9b10 msgr2=0x7fb7c815b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:07.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.622+0000 7fb7cd9ff700 1 --2- 172.21.15.146:0/259102018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7c80a9b10 0x7fb7c815b940 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7fb7b80094c0 tx=0x7fb7b8017000 comp rx=0 tx=0).stop 2023-10-06T11:16:07.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.622+0000 7fb7cd9ff700 1 -- 172.21.15.146:0/259102018 shutdown_connections 2023-10-06T11:16:07.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.622+0000 7fb7cd9ff700 1 --2- 172.21.15.146:0/259102018 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb7a8066f30 0x7fb7a80693e0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:07.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.622+0000 7fb7cd9ff700 1 --2- 172.21.15.146:0/259102018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb7c80a9b10 0x7fb7c815b940 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:07.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.622+0000 7fb7cd9ff700 1 --2- 172.21.15.146:0/259102018 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb7c8068bf0 0x7fb7c815e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:07.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.622+0000 7fb7cd9ff700 1 --2- 172.21.15.146:0/259102018 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7c806b7c0 0x7fb7c81589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:07.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.622+0000 7fb7cd9ff700 1 -- 172.21.15.146:0/259102018 >> 172.21.15.146:0/259102018 conn(0x7fb7c80c93e0 msgr2=0x7fb7c80cb100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:07.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.622+0000 7fb7cd9ff700 1 -- 172.21.15.146:0/259102018 shutdown_connections 2023-10-06T11:16:07.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:07.622+0000 7fb7cd9ff700 1 -- 172.21.15.146:0/259102018 wait complete. 2023-10-06T11:16:07.636 INFO:tasks.cephfs.filesystem.ceph_manager:{} 2023-10-06T11:16:07.636 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T11:16:07.636 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:16:07.672 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:16:07.712 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T11:16:07.713 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi146.front.sepia.ceph.com... 2023-10-06T11:16:07.713 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T11:16:07.713 DEBUG:teuthology.orchestra.run.smithi146:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T11:16:07.750 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[145916]: fuse finished with error 0 and tester_r 0 2023-10-06T11:16:07.751 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-10-06T11:16:07.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:07.751 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T11:16:07.817 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-10-06T11:16:07.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:07.817 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T11:16:07.833 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:16:07.834 INFO:teuthology.orchestra.run.smithi151.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-06T11:16:07.834 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-10-06T11:16:07.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:07.835 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T11:16:07.871 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:16:07.873 INFO:teuthology.orchestra.run.smithi146.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-06T11:16:07.874 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-10-06T11:16:07.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:07.874 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T11:16:07.890 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:16:07.890 INFO:teuthology.orchestra.run.smithi151.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-06T11:16:07.891 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:16:08.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.026+0000 7f1867912700 1 Processor -- start 2023-10-06T11:16:08.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.027+0000 7f1867912700 1 -- start start 2023-10-06T11:16:08.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.027+0000 7f1867912700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1860153ab0 0x7f186015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:08.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.027+0000 7f1867912700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1860153e80 0x7f1860068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:08.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.027+0000 7f1867912700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f186015ac30 con 0x7f18600689d0 2023-10-06T11:16:08.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.027+0000 7f1867912700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1860068e50 con 0x7f1860153e80 2023-10-06T11:16:08.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.027+0000 7f1867912700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18600b4510 con 0x7f1860153ab0 2023-10-06T11:16:08.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.028+0000 7f1864ead700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1860153e80 0x7f1860068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:08.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.028+0000 7f1864ead700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1860153e80 0x7f1860068490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36294/0 (socket says 172.21.15.146:36294) 2023-10-06T11:16:08.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.028+0000 7f1864ead700 1 -- 172.21.15.146:0/3311994562 learned_addr learned my addr 172.21.15.146:0/3311994562 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:08.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.028+0000 7f18656ae700 1 --2- 172.21.15.146:0/3311994562 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1860153ab0 0x7f186015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:08.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.028+0000 7f1864ead700 1 -- 172.21.15.146:0/3311994562 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1860153ab0 msgr2=0x7f186015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:08.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.028+0000 7f1864ead700 1 --2- 172.21.15.146:0/3311994562 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1860153ab0 0x7f186015a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.028+0000 7f1864ead700 1 -- 172.21.15.146:0/3311994562 >> v1:172.21.15.151:6789/0 conn(0x7f18600689d0 legacy=0x7f186015d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:08.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.028+0000 7f1864ead700 1 -- 172.21.15.146:0/3311994562 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18600b6530 con 0x7f1860153e80 2023-10-06T11:16:08.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.028+0000 7f1864ead700 1 --2- 172.21.15.146:0/3311994562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1860153e80 0x7f1860068490 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f18500099b0 tx=0x7f1850009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c38baa717e9ab261 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:08.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.028+0000 7f1857fff700 1 -- 172.21.15.146:0/3311994562 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185000b820 con 0x7f1860153e80 2023-10-06T11:16:08.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.028+0000 7f1857fff700 1 -- 172.21.15.146:0/3311994562 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185000b980 con 0x7f1860153e80 2023-10-06T11:16:08.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.028+0000 7f1857fff700 1 -- 172.21.15.146:0/3311994562 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185000bd20 con 0x7f1860153e80 2023-10-06T11:16:08.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.029+0000 7f1867912700 1 -- 172.21.15.146:0/3311994562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1860153e80 msgr2=0x7f1860068490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:08.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.029+0000 7f1867912700 1 --2- 172.21.15.146:0/3311994562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1860153e80 0x7f1860068490 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f18500099b0 tx=0x7f1850009250 comp rx=0 tx=0).stop 2023-10-06T11:16:08.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.029+0000 7f1867912700 1 -- 172.21.15.146:0/3311994562 shutdown_connections 2023-10-06T11:16:08.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.029+0000 7f1867912700 1 --2- 172.21.15.146:0/3311994562 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1860153ab0 0x7f186015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.029+0000 7f1867912700 1 --2- 172.21.15.146:0/3311994562 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1860153e80 0x7f1860068490 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.029+0000 7f1867912700 1 -- 172.21.15.146:0/3311994562 >> 172.21.15.146:0/3311994562 conn(0x7f186006eba0 msgr2=0x7f186006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:08.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.029+0000 7f1867912700 1 -- 172.21.15.146:0/3311994562 shutdown_connections 2023-10-06T11:16:08.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.029+0000 7f1867912700 1 -- 172.21.15.146:0/3311994562 wait complete. 2023-10-06T11:16:08.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.030+0000 7f1867912700 1 Processor -- start 2023-10-06T11:16:08.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.030+0000 7f1867912700 1 -- start start 2023-10-06T11:16:08.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.031+0000 7f1867912700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18600689d0 0x7f1860142fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:08.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.031+0000 7f1867912700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1860153ab0 0x7f18600cffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:08.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.031+0000 7f1867912700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1860153e80 0x7f18600d0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:08.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.031+0000 7f1867912700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186016ac30 con 0x7f1860153ab0 2023-10-06T11:16:08.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.031+0000 7f1867912700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186016a6c0 con 0x7f1860153e80 2023-10-06T11:16:08.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.031+0000 7f1867912700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1860169d90 con 0x7f18600689d0 2023-10-06T11:16:08.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.031+0000 7f1864ead700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1860153ab0 0x7f18600cffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:08.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.031+0000 7f1864ead700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1860153ab0 0x7f18600cffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36298/0 (socket says 172.21.15.146:36298) 2023-10-06T11:16:08.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.031+0000 7f1864ead700 1 -- 172.21.15.146:0/1801675862 learned_addr learned my addr 172.21.15.146:0/1801675862 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:08.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.031+0000 7f18656ae700 1 --2- 172.21.15.146:0/1801675862 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18600689d0 0x7f1860142fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:08.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.031+0000 7f1865eaf700 1 --2- 172.21.15.146:0/1801675862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1860153e80 0x7f18600d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:08.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.031+0000 7f1864ead700 1 -- 172.21.15.146:0/1801675862 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18600689d0 msgr2=0x7f1860142fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:08.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.031+0000 7f1864ead700 1 --2- 172.21.15.146:0/1801675862 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18600689d0 0x7f1860142fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.031+0000 7f1864ead700 1 -- 172.21.15.146:0/1801675862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1860153e80 msgr2=0x7f18600d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:08.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.031+0000 7f1864ead700 1 --2- 172.21.15.146:0/1801675862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1860153e80 0x7f18600d0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.031+0000 7f1864ead700 1 -- 172.21.15.146:0/1801675862 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18500094f0 con 0x7f1860153ab0 2023-10-06T11:16:08.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.031+0000 7f1864ead700 1 --2- 172.21.15.146:0/1801675862 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1860153ab0 0x7f18600cffd0 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f18500094c0 tx=0x7f1850016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:08.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.031+0000 7f18557fa700 1 -- 172.21.15.146:0/1801675862 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1850011c30 con 0x7f1860153ab0 2023-10-06T11:16:08.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.031+0000 7f18557fa700 1 -- 172.21.15.146:0/1801675862 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1850020070 con 0x7f1860153ab0 2023-10-06T11:16:08.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.031+0000 7f1867912700 1 -- 172.21.15.146:0/1801675862 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f186016a070 con 0x7f1860153ab0 2023-10-06T11:16:08.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.031+0000 7f18557fa700 1 -- 172.21.15.146:0/1801675862 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185001b450 con 0x7f1860153ab0 2023-10-06T11:16:08.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.032+0000 7f1867912700 1 -- 172.21.15.146:0/1801675862 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1860143500 con 0x7f1860153ab0 2023-10-06T11:16:08.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.032+0000 7f1867912700 1 -- 172.21.15.146:0/1801675862 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f186016a830 con 0x7f1860153ab0 2023-10-06T11:16:08.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.033+0000 7f18557fa700 1 -- 172.21.15.146:0/1801675862 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1850022030 con 0x7f1860153ab0 2023-10-06T11:16:08.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.033+0000 7f18557fa700 1 --2- 172.21.15.146:0/1801675862 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1844066f30 0x7f18440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:08.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.033+0000 7f18557fa700 1 -- 172.21.15.146:0/1801675862 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f1850086370 con 0x7f1860153ab0 2023-10-06T11:16:08.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.033+0000 7f18656ae700 1 --2- 172.21.15.146:0/1801675862 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1844066f30 0x7f18440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:08.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.034+0000 7f18656ae700 1 --2- 172.21.15.146:0/1801675862 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1844066f30 0x7f18440693e0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f185c00f610 tx=0x7f185c0077f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:08.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.037+0000 7f18557fa700 1 -- 172.21.15.146:0/1801675862 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1850053430 con 0x7f1860153ab0 2023-10-06T11:16:08.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.261+0000 7f1867912700 1 -- 172.21.15.146:0/1801675862 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f186015ac30 con 0x7f1860153ab0 2023-10-06T11:16:08.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.261+0000 7f18557fa700 1 -- 172.21.15.146:0/1801675862 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) v1 ==== 95+0+3859 (secure 0 0 0) 0x7f186015ac30 con 0x7f1860153ab0 2023-10-06T11:16:08.263 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:16:08.263 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":112,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7792,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3693464886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3693464886},{"type":"v1","addr":"172.21.15.151:6834","nonce":3693464886}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103},{"gid":7795,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1155762565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":1155762565},{"type":"v1","addr":"172.21.15.151:6835","nonce":1155762565}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:15:11.929158+0000","modified":"2023-10-06T11:16:03.435307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":126,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8679":{"gid":8679,"name":"a","rank":0,"incarnation":109,"state":"up:active","state_seq":17,"addr":"172.21.15.146:6836/3868720724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3868720724},{"type":"v1","addr":"172.21.15.146:6836","nonce":3868720724}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-06T11:16:08.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.263+0000 7f1867912700 1 -- 172.21.15.146:0/1801675862 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1844066f30 msgr2=0x7f18440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:08.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.263+0000 7f1867912700 1 --2- 172.21.15.146:0/1801675862 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1844066f30 0x7f18440693e0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f185c00f610 tx=0x7f185c0077f0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.263+0000 7f1867912700 1 -- 172.21.15.146:0/1801675862 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1860153ab0 msgr2=0x7f18600cffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:08.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.263+0000 7f1867912700 1 --2- 172.21.15.146:0/1801675862 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1860153ab0 0x7f18600cffd0 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f18500094c0 tx=0x7f1850016000 comp rx=0 tx=0).stop 2023-10-06T11:16:08.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.263+0000 7f1867912700 1 -- 172.21.15.146:0/1801675862 shutdown_connections 2023-10-06T11:16:08.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.263+0000 7f1867912700 1 --2- 172.21.15.146:0/1801675862 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1844066f30 0x7f18440693e0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.263+0000 7f1867912700 1 --2- 172.21.15.146:0/1801675862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1860153e80 0x7f18600d0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.263+0000 7f1867912700 1 --2- 172.21.15.146:0/1801675862 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18600689d0 0x7f1860142fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.263+0000 7f1867912700 1 --2- 172.21.15.146:0/1801675862 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1860153ab0 0x7f18600cffd0 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.263+0000 7f1867912700 1 -- 172.21.15.146:0/1801675862 >> 172.21.15.146:0/1801675862 conn(0x7f186006eba0 msgr2=0x7f1860153070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:08.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.264+0000 7f1867912700 1 -- 172.21.15.146:0/1801675862 shutdown_connections 2023-10-06T11:16:08.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.264+0000 7f1867912700 1 -- 172.21.15.146:0/1801675862 wait complete. 2023-10-06T11:16:08.268 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 112 2023-10-06T11:16:08.278 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:16:08.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.390+0000 7fcd76427700 1 Processor -- start 2023-10-06T11:16:08.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.390+0000 7fcd76427700 1 -- start start 2023-10-06T11:16:08.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.391+0000 7fcd76427700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcd70068ba0 0x7fcd7015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:08.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.391+0000 7fcd76427700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcd70153e80 0x7fcd700b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:08.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.391+0000 7fcd76427700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd7015ac30 con 0x7fcd70153ab0 2023-10-06T11:16:08.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.391+0000 7fcd76427700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd700b4510 con 0x7fcd70153e80 2023-10-06T11:16:08.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.391+0000 7fcd76427700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd700b6530 con 0x7fcd70068ba0 2023-10-06T11:16:08.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.391+0000 7fcd749c4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fcd70153e80 0x7fcd700b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:08.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.391+0000 7fcd6ffff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fcd70153ab0 0x7fcd70068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:42600/0 (socket says 172.21.15.146:42600) 2023-10-06T11:16:08.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.391+0000 7fcd6ffff700 1 -- 172.21.15.146:0/3584163232 learned_addr learned my addr 172.21.15.146:0/3584163232 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:16:08.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.391+0000 7fcd6f7fe700 1 --2- 172.21.15.146:0/3584163232 >> v2:172.21.15.151:3300/0 conn(0x7fcd70068ba0 0x7fcd7015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:08.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.392+0000 7fcd749c4700 1 -- 172.21.15.146:0/3584163232 >> v2:172.21.15.151:3300/0 conn(0x7fcd70068ba0 msgr2=0x7fcd7015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:08.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.392+0000 7fcd749c4700 1 --2- 172.21.15.146:0/3584163232 >> v2:172.21.15.151:3300/0 conn(0x7fcd70068ba0 0x7fcd7015a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.392+0000 7fcd749c4700 1 -- 172.21.15.146:0/3584163232 >> v1:172.21.15.146:6789/0 conn(0x7fcd70153ab0 legacy=0x7fcd70068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:08.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.392+0000 7fcd749c4700 1 -- 172.21.15.146:0/3584163232 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd700b5c50 con 0x7fcd70153e80 2023-10-06T11:16:08.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.392+0000 7fcd6effd700 1 -- 172.21.15.146:0/3584163232 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2473021697 0 0) 0x7fcd60001110 con 0x7fcd70153ab0 2023-10-06T11:16:08.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.392+0000 7fcd749c4700 1 --2- 172.21.15.146:0/3584163232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd70153e80 0x7fcd700b49a0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7fcd70089770 tx=0x7fcd68009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=235b783086f23716 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:08.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.392+0000 7fcd6effd700 1 -- 172.21.15.146:0/3584163232 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6800e070 con 0x7fcd70153e80 2023-10-06T11:16:08.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.392+0000 7fcd6effd700 1 -- 172.21.15.146:0/3584163232 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd6800bc30 con 0x7fcd70153e80 2023-10-06T11:16:08.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.392+0000 7fcd6effd700 1 -- 172.21.15.146:0/3584163232 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd68012430 con 0x7fcd70153e80 2023-10-06T11:16:08.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.392+0000 7fcd76427700 1 -- 172.21.15.146:0/3584163232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd70153e80 msgr2=0x7fcd700b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:08.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.392+0000 7fcd76427700 1 --2- 172.21.15.146:0/3584163232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd70153e80 0x7fcd700b49a0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7fcd70089770 tx=0x7fcd68009780 comp rx=0 tx=0).stop 2023-10-06T11:16:08.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.392+0000 7fcd76427700 1 -- 172.21.15.146:0/3584163232 shutdown_connections 2023-10-06T11:16:08.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.392+0000 7fcd76427700 1 --2- 172.21.15.146:0/3584163232 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd70153e80 0x7fcd700b49a0 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.392+0000 7fcd76427700 1 --2- 172.21.15.146:0/3584163232 >> v2:172.21.15.151:3300/0 conn(0x7fcd70068ba0 0x7fcd7015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.392+0000 7fcd76427700 1 -- 172.21.15.146:0/3584163232 >> 172.21.15.146:0/3584163232 conn(0x7fcd7006eba0 msgr2=0x7fcd7006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:08.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.392+0000 7fcd76427700 1 -- 172.21.15.146:0/3584163232 shutdown_connections 2023-10-06T11:16:08.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.392+0000 7fcd76427700 1 -- 172.21.15.146:0/3584163232 wait complete. 2023-10-06T11:16:08.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.393+0000 7fcd76427700 1 Processor -- start 2023-10-06T11:16:08.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.394+0000 7fcd76427700 1 -- start start 2023-10-06T11:16:08.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.394+0000 7fcd76427700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd70068ba0 0x7fcd701480a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:08.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.394+0000 7fcd76427700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd70153ab0 0x7fcd7014c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:08.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.394+0000 7fcd76427700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd70153e80 0x7fcd7016a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:08.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.395+0000 7fcd76427700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd70169fa0 con 0x7fcd70153e80 2023-10-06T11:16:08.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.395+0000 7fcd76427700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7014cd10 con 0x7fcd70153ab0 2023-10-06T11:16:08.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.395+0000 7fcd76427700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7014cff0 con 0x7fcd70068ba0 2023-10-06T11:16:08.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.395+0000 7fcd6ffff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd70068ba0 0x7fcd701480a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:08.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.395+0000 7fcd6f7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd70153ab0 0x7fcd7014c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:08.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.395+0000 7fcd749c4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd70153e80 0x7fcd7016a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:08.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.395+0000 7fcd6ffff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd70068ba0 0x7fcd701480a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:39360/0 (socket says 172.21.15.146:39360) 2023-10-06T11:16:08.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.395+0000 7fcd6ffff700 1 -- 172.21.15.146:0/3634681227 learned_addr learned my addr 172.21.15.146:0/3634681227 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:08.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.395+0000 7fcd6f7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd70153ab0 0x7fcd7014c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:59786/0 (socket says 172.21.15.146:59786) 2023-10-06T11:16:08.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.395+0000 7fcd749c4700 1 -- 172.21.15.146:0/3634681227 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd70068ba0 msgr2=0x7fcd701480a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:08.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.395+0000 7fcd749c4700 1 --2- 172.21.15.146:0/3634681227 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd70068ba0 0x7fcd701480a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.395+0000 7fcd749c4700 1 -- 172.21.15.146:0/3634681227 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd70153ab0 msgr2=0x7fcd7014c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:08.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.395+0000 7fcd749c4700 1 --2- 172.21.15.146:0/3634681227 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd70153ab0 0x7fcd7014c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.395+0000 7fcd749c4700 1 -- 172.21.15.146:0/3634681227 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd68009a20 con 0x7fcd70153e80 2023-10-06T11:16:08.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.395+0000 7fcd749c4700 1 --2- 172.21.15.146:0/3634681227 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd70153e80 0x7fcd7016a430 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7fcd68016000 tx=0x7fcd68019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:08.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.395+0000 7fcd57fff700 1 -- 172.21.15.146:0/3634681227 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd68027470 con 0x7fcd70153e80 2023-10-06T11:16:08.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.395+0000 7fcd57fff700 1 -- 172.21.15.146:0/3634681227 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd680275d0 con 0x7fcd70153e80 2023-10-06T11:16:08.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.395+0000 7fcd76427700 1 -- 172.21.15.146:0/3634681227 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd7014d2d0 con 0x7fcd70153e80 2023-10-06T11:16:08.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.395+0000 7fcd57fff700 1 -- 172.21.15.146:0/3634681227 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd68027990 con 0x7fcd70153e80 2023-10-06T11:16:08.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.395+0000 7fcd76427700 1 -- 172.21.15.146:0/3634681227 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd701485e0 con 0x7fcd70153e80 2023-10-06T11:16:08.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.396+0000 7fcd76427700 1 -- 172.21.15.146:0/3634681227 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd70169dd0 con 0x7fcd70153e80 2023-10-06T11:16:08.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.397+0000 7fcd57fff700 1 -- 172.21.15.146:0/3634681227 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcd68024070 con 0x7fcd70153e80 2023-10-06T11:16:08.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.397+0000 7fcd57fff700 1 --2- 172.21.15.146:0/3634681227 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcd5c066f30 0x7fcd5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:08.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.397+0000 7fcd57fff700 1 -- 172.21.15.146:0/3634681227 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fcd68087240 con 0x7fcd70153e80 2023-10-06T11:16:08.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.397+0000 7fcd6ffff700 1 --2- 172.21.15.146:0/3634681227 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcd5c066f30 0x7fcd5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:08.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.398+0000 7fcd6ffff700 1 --2- 172.21.15.146:0/3634681227 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcd5c066f30 0x7fcd5c0693e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fcd60006fd0 tx=0x7fcd60007c50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:08.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.401+0000 7fcd57fff700 1 -- 172.21.15.146:0/3634681227 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcd680543b0 con 0x7fcd70153e80 2023-10-06T11:16:08.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.590+0000 7fcd76427700 1 -- 172.21.15.146:0/3634681227 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd7014d130 con 0x7fcd70153e80 2023-10-06T11:16:08.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.590+0000 7fcd57fff700 1 -- 172.21.15.146:0/3634681227 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+17059 (secure 0 0 0) 0x7fcd7014d130 con 0x7fcd70153e80 2023-10-06T11:16:08.592 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:16:08.593 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":126,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:16:00.403291+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:15:09.613367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-10-06T11:15:10.888669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6837/1974709597":"2023-10-07T11:16:00.403222+0000","172.21.15.146:6835/1974709597":"2023-10-07T11:16:00.403222+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:16:08.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.592+0000 7fcd76427700 1 -- 172.21.15.146:0/3634681227 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcd5c066f30 msgr2=0x7fcd5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:08.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.592+0000 7fcd76427700 1 --2- 172.21.15.146:0/3634681227 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcd5c066f30 0x7fcd5c0693e0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fcd60006fd0 tx=0x7fcd60007c50 comp rx=0 tx=0).stop 2023-10-06T11:16:08.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.593+0000 7fcd76427700 1 -- 172.21.15.146:0/3634681227 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd70153e80 msgr2=0x7fcd7016a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:08.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.593+0000 7fcd76427700 1 --2- 172.21.15.146:0/3634681227 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd70153e80 0x7fcd7016a430 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7fcd68016000 tx=0x7fcd68019000 comp rx=0 tx=0).stop 2023-10-06T11:16:08.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.593+0000 7fcd76427700 1 -- 172.21.15.146:0/3634681227 shutdown_connections 2023-10-06T11:16:08.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.593+0000 7fcd76427700 1 --2- 172.21.15.146:0/3634681227 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcd5c066f30 0x7fcd5c0693e0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.593+0000 7fcd76427700 1 --2- 172.21.15.146:0/3634681227 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd70153e80 0x7fcd7016a430 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.593+0000 7fcd76427700 1 --2- 172.21.15.146:0/3634681227 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd70068ba0 0x7fcd701480a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.593+0000 7fcd76427700 1 --2- 172.21.15.146:0/3634681227 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd70153ab0 0x7fcd7014c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.593+0000 7fcd76427700 1 -- 172.21.15.146:0/3634681227 >> 172.21.15.146:0/3634681227 conn(0x7fcd7006eba0 msgr2=0x7fcd700cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:08.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.593+0000 7fcd76427700 1 -- 172.21.15.146:0/3634681227 shutdown_connections 2023-10-06T11:16:08.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.593+0000 7fcd76427700 1 -- 172.21.15.146:0/3634681227 wait complete. 2023-10-06T11:16:08.607 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:05:36.687307+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:05:37.171199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T11:15:09.613367+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '124', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T11:15:10.888669+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '125', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T11:16:08.607 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:16:08.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.723+0000 7faa31393700 1 Processor -- start 2023-10-06T11:16:08.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.723+0000 7faa31393700 1 -- start start 2023-10-06T11:16:08.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.724+0000 7faa31393700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faa2c0cc960 0x7faa2c164c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:08.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.724+0000 7faa31393700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa2c0ccd80 con 0x7faa2c0ae730 2023-10-06T11:16:08.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.724+0000 7faa31393700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa2c0ae2a0 con 0x7faa2c15a160 2023-10-06T11:16:08.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.724+0000 7faa31393700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa2c15a530 con 0x7faa2c0cc960 2023-10-06T11:16:08.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.724+0000 7faa2b7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7faa2c0cc960 0x7faa2c164c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:08.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.724+0000 7faa227fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7faa2c0ae730 0x7faa2c0aebb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:42602/0 (socket says 172.21.15.146:42602) 2023-10-06T11:16:08.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.724+0000 7faa227fc700 1 -- 172.21.15.146:0/2474836333 learned_addr learned my addr 172.21.15.146:0/2474836333 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:16:08.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.724+0000 7faa2b7fe700 1 -- 172.21.15.146:0/2474836333 >> v1:172.21.15.151:6789/0 conn(0x7faa2c15a160 legacy=0x7faa2c0c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:08.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.724+0000 7faa2b7fe700 1 -- 172.21.15.146:0/2474836333 >> v1:172.21.15.146:6789/0 conn(0x7faa2c0ae730 legacy=0x7faa2c0aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:08.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.724+0000 7faa2a7fc700 1 -- 172.21.15.146:0/2474836333 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2431011315 0 0) 0x7faa14001110 con 0x7faa2c0ae730 2023-10-06T11:16:08.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.724+0000 7faa2b7fe700 1 -- 172.21.15.146:0/2474836333 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa2c0c5cb0 con 0x7faa2c0cc960 2023-10-06T11:16:08.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.725+0000 7faa2b7fe700 1 --2- 172.21.15.146:0/2474836333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa2c0cc960 0x7faa2c164c60 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7faa24009e60 tx=0x7faa24009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fda62abd5a0e8e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:08.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.725+0000 7faa2a7fc700 1 -- 172.21.15.146:0/2474836333 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2400e070 con 0x7faa2c0cc960 2023-10-06T11:16:08.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.725+0000 7faa2a7fc700 1 -- 172.21.15.146:0/2474836333 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa2400bbf0 con 0x7faa2c0cc960 2023-10-06T11:16:08.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.725+0000 7faa2a7fc700 1 -- 172.21.15.146:0/2474836333 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa24012430 con 0x7faa2c0cc960 2023-10-06T11:16:08.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.725+0000 7faa31393700 1 -- 172.21.15.146:0/2474836333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa2c0cc960 msgr2=0x7faa2c164c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:08.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.725+0000 7faa31393700 1 --2- 172.21.15.146:0/2474836333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa2c0cc960 0x7faa2c164c60 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7faa24009e60 tx=0x7faa24009780 comp rx=0 tx=0).stop 2023-10-06T11:16:08.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.725+0000 7faa31393700 1 -- 172.21.15.146:0/2474836333 shutdown_connections 2023-10-06T11:16:08.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.725+0000 7faa31393700 1 --2- 172.21.15.146:0/2474836333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa2c0cc960 0x7faa2c164c60 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.725+0000 7faa31393700 1 -- 172.21.15.146:0/2474836333 >> 172.21.15.146:0/2474836333 conn(0x7faa2c06f380 msgr2=0x7faa2c0d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:08.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.725+0000 7faa31393700 1 -- 172.21.15.146:0/2474836333 shutdown_connections 2023-10-06T11:16:08.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.725+0000 7faa31393700 1 -- 172.21.15.146:0/2474836333 wait complete. 2023-10-06T11:16:08.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.726+0000 7faa31393700 1 Processor -- start 2023-10-06T11:16:08.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.727+0000 7faa31393700 1 -- start start 2023-10-06T11:16:08.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.727+0000 7faa31393700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa2c0ae730 0x7faa2c0c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:08.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.727+0000 7faa31393700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa2c0cc960 0x7faa2c144370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:08.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.727+0000 7faa31393700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa2c15a160 0x7faa2c0c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:08.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.727+0000 7faa31393700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa2c0c8f10 con 0x7faa2c0ae730 2023-10-06T11:16:08.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.727+0000 7faa31393700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa2c0c8300 con 0x7faa2c0cc960 2023-10-06T11:16:08.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.727+0000 7faa31393700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa2c0c85e0 con 0x7faa2c15a160 2023-10-06T11:16:08.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.727+0000 7faa2affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa2c0ae730 0x7faa2c0c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:08.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.727+0000 7faa2affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa2c0ae730 0x7faa2c0c93a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36332/0 (socket says 172.21.15.146:36332) 2023-10-06T11:16:08.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.727+0000 7faa2affd700 1 -- 172.21.15.146:0/998109607 learned_addr learned my addr 172.21.15.146:0/998109607 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:08.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.728+0000 7faa2b7fe700 1 --2- 172.21.15.146:0/998109607 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa2c15a160 0x7faa2c0c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:08.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.728+0000 7faa227fc700 1 --2- 172.21.15.146:0/998109607 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa2c0cc960 0x7faa2c144370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:08.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.728+0000 7faa2affd700 1 -- 172.21.15.146:0/998109607 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa2c15a160 msgr2=0x7faa2c0c78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:08.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.728+0000 7faa2affd700 1 --2- 172.21.15.146:0/998109607 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa2c15a160 0x7faa2c0c78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.728+0000 7faa2affd700 1 -- 172.21.15.146:0/998109607 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa2c0cc960 msgr2=0x7faa2c144370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:08.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.728+0000 7faa2affd700 1 --2- 172.21.15.146:0/998109607 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa2c0cc960 0x7faa2c144370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.728+0000 7faa2affd700 1 -- 172.21.15.146:0/998109607 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa24009a20 con 0x7faa2c0ae730 2023-10-06T11:16:08.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.728+0000 7faa2b7fe700 1 --2- 172.21.15.146:0/998109607 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa2c15a160 0x7faa2c0c78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:08.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.728+0000 7faa227fc700 1 --2- 172.21.15.146:0/998109607 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa2c0cc960 0x7faa2c144370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:08.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.728+0000 7faa2affd700 1 --2- 172.21.15.146:0/998109607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa2c0ae730 0x7faa2c0c93a0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7faa1c00b5e0 tx=0x7faa1c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:08.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.728+0000 7faa237fe700 1 -- 172.21.15.146:0/998109607 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1c00f510 con 0x7faa2c0ae730 2023-10-06T11:16:08.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.728+0000 7faa237fe700 1 -- 172.21.15.146:0/998109607 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa1c00f690 con 0x7faa2c0ae730 2023-10-06T11:16:08.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.728+0000 7faa31393700 1 -- 172.21.15.146:0/998109607 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa2c0c88c0 con 0x7faa2c0ae730 2023-10-06T11:16:08.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.728+0000 7faa237fe700 1 -- 172.21.15.146:0/998109607 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1c00fa50 con 0x7faa2c0ae730 2023-10-06T11:16:08.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.728+0000 7faa31393700 1 -- 172.21.15.146:0/998109607 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa2c0b51d0 con 0x7faa2c0ae730 2023-10-06T11:16:08.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.729+0000 7faa31393700 1 -- 172.21.15.146:0/998109607 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa2c068390 con 0x7faa2c0ae730 2023-10-06T11:16:08.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.729+0000 7faa237fe700 1 -- 172.21.15.146:0/998109607 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faa1c01a400 con 0x7faa2c0ae730 2023-10-06T11:16:08.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.730+0000 7faa237fe700 1 --2- 172.21.15.146:0/998109607 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faa0c066f30 0x7faa0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:08.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.730+0000 7faa227fc700 1 --2- 172.21.15.146:0/998109607 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faa0c066f30 0x7faa0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:08.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.730+0000 7faa237fe700 1 -- 172.21.15.146:0/998109607 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6144+0+0 (secure 0 0 0) 0x7faa1c0841f0 con 0x7faa2c0ae730 2023-10-06T11:16:08.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.730+0000 7faa227fc700 1 --2- 172.21.15.146:0/998109607 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faa0c066f30 0x7faa0c0693e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7faa2c15fa20 tx=0x7faa14009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:08.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.734+0000 7faa237fe700 1 -- 172.21.15.146:0/998109607 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faa1c051330 con 0x7faa2c0ae730 2023-10-06T11:16:08.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.915+0000 7faa31393700 1 -- 172.21.15.146:0/998109607 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7faa2c0c8d60 con 0x7faa2c0ae730 2023-10-06T11:16:08.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.915+0000 7faa237fe700 1 -- 172.21.15.146:0/998109607 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v126) v1 ==== 92+0+10 (secure 0 0 0) 0x7faa1c054950 con 0x7faa2c0ae730 2023-10-06T11:16:08.917 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-10-06T11:16:08.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.917+0000 7faa31393700 1 -- 172.21.15.146:0/998109607 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faa0c066f30 msgr2=0x7faa0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:08.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.917+0000 7faa31393700 1 --2- 172.21.15.146:0/998109607 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faa0c066f30 0x7faa0c0693e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7faa2c15fa20 tx=0x7faa14009040 comp rx=0 tx=0).stop 2023-10-06T11:16:08.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.917+0000 7faa31393700 1 -- 172.21.15.146:0/998109607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa2c0ae730 msgr2=0x7faa2c0c93a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:08.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.917+0000 7faa31393700 1 --2- 172.21.15.146:0/998109607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa2c0ae730 0x7faa2c0c93a0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7faa1c00b5e0 tx=0x7faa1c0090f0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.917+0000 7faa31393700 1 -- 172.21.15.146:0/998109607 shutdown_connections 2023-10-06T11:16:08.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.917+0000 7faa31393700 1 --2- 172.21.15.146:0/998109607 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faa0c066f30 0x7faa0c0693e0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.917+0000 7faa31393700 1 --2- 172.21.15.146:0/998109607 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa2c15a160 0x7faa2c0c78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.917+0000 7faa31393700 1 --2- 172.21.15.146:0/998109607 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa2c0ae730 0x7faa2c0c93a0 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.917+0000 7faa31393700 1 --2- 172.21.15.146:0/998109607 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa2c0cc960 0x7faa2c144370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:08.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.917+0000 7faa31393700 1 -- 172.21.15.146:0/998109607 >> 172.21.15.146:0/998109607 conn(0x7faa2c06f380 msgr2=0x7faa2c152590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:08.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.917+0000 7faa31393700 1 -- 172.21.15.146:0/998109607 shutdown_connections 2023-10-06T11:16:08.920 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:08.917+0000 7faa31393700 1 -- 172.21.15.146:0/998109607 wait complete. 2023-10-06T11:16:08.931 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:16:09.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.047+0000 7f77e6630700 1 Processor -- start 2023-10-06T11:16:09.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.047+0000 7f77e6630700 1 -- start start 2023-10-06T11:16:09.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.047+0000 7f77e6630700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f77e015a160 0x7f77e00c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:09.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.047+0000 7f77e6630700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77e00ae730 0x7f77e00aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:09.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.047+0000 7f77e6630700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f77e00ce3d0 0x7f77e00ce830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:09.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.047+0000 7f77e6630700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77e00ae2a0 con 0x7f77e015a160 2023-10-06T11:16:09.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.047+0000 7f77e6630700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77e015a530 con 0x7f77e00ce3d0 2023-10-06T11:16:09.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.047+0000 7f77e6630700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e00ad690 con 0x7f77e00ae730 2023-10-06T11:16:09.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.048+0000 7f77dffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f77e015a160 0x7f77e00c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:09.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.048+0000 7f77dffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f77e015a160 0x7f77e00c55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36336/0 (socket says 172.21.15.146:36336) 2023-10-06T11:16:09.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.048+0000 7f77dffff700 1 -- 172.21.15.146:0/1353215033 learned_addr learned my addr 172.21.15.146:0/1353215033 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:09.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.048+0000 7f77df7fe700 1 --2- 172.21.15.146:0/1353215033 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77e00ae730 0x7f77e00aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:09.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.048+0000 7f77e4bcd700 1 --2- 172.21.15.146:0/1353215033 >> v2:172.21.15.151:3300/0 conn(0x7f77e00ce3d0 0x7f77e00ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:09.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.048+0000 7f77dffff700 1 -- 172.21.15.146:0/1353215033 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77e00ae730 msgr2=0x7f77e00aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:09.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.048+0000 7f77dffff700 1 --2- 172.21.15.146:0/1353215033 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77e00ae730 0x7f77e00aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.048+0000 7f77dffff700 1 -- 172.21.15.146:0/1353215033 >> v2:172.21.15.151:3300/0 conn(0x7f77e00ce3d0 msgr2=0x7f77e00ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:09.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.048+0000 7f77dffff700 1 --2- 172.21.15.146:0/1353215033 >> v2:172.21.15.151:3300/0 conn(0x7f77e00ce3d0 0x7f77e00ce830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.048+0000 7f77dffff700 1 -- 172.21.15.146:0/1353215033 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e00ad970 con 0x7f77e015a160 2023-10-06T11:16:09.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.048+0000 7f77dffff700 1 --2- 172.21.15.146:0/1353215033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77e015a160 0x7f77e00c55a0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f77e0089c40 tx=0x7f77d0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=296c999f8c01b465 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:09.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.048+0000 7f77deffd700 1 -- 172.21.15.146:0/1353215033 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d0005c10 con 0x7f77e015a160 2023-10-06T11:16:09.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.048+0000 7f77deffd700 1 -- 172.21.15.146:0/1353215033 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d0005d70 con 0x7f77e015a160 2023-10-06T11:16:09.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.048+0000 7f77deffd700 1 -- 172.21.15.146:0/1353215033 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d000b880 con 0x7f77e015a160 2023-10-06T11:16:09.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.049+0000 7f77e6630700 1 -- 172.21.15.146:0/1353215033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77e015a160 msgr2=0x7f77e00c55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:09.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.049+0000 7f77e6630700 1 --2- 172.21.15.146:0/1353215033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77e015a160 0x7f77e00c55a0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f77e0089c40 tx=0x7f77d0009220 comp rx=0 tx=0).stop 2023-10-06T11:16:09.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.049+0000 7f77e6630700 1 -- 172.21.15.146:0/1353215033 shutdown_connections 2023-10-06T11:16:09.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.049+0000 7f77e6630700 1 --2- 172.21.15.146:0/1353215033 >> v2:172.21.15.151:3300/0 conn(0x7f77e00ce3d0 0x7f77e00ce830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.049+0000 7f77e6630700 1 --2- 172.21.15.146:0/1353215033 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77e015a160 0x7f77e00c55a0 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.049+0000 7f77e6630700 1 --2- 172.21.15.146:0/1353215033 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77e00ae730 0x7f77e00aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.049+0000 7f77e6630700 1 -- 172.21.15.146:0/1353215033 >> 172.21.15.146:0/1353215033 conn(0x7f77e006f380 msgr2=0x7f77e00d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:09.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.049+0000 7f77e6630700 1 -- 172.21.15.146:0/1353215033 shutdown_connections 2023-10-06T11:16:09.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.049+0000 7f77e6630700 1 -- 172.21.15.146:0/1353215033 wait complete. 2023-10-06T11:16:09.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.050+0000 7f77e6630700 1 Processor -- start 2023-10-06T11:16:09.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.050+0000 7f77e6630700 1 -- start start 2023-10-06T11:16:09.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.051+0000 7f77e6630700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77e00ae730 0x7f77e00b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:09.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.051+0000 7f77e6630700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77e00ce3d0 0x7f77e015e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:09.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.051+0000 7f77e6630700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77e015a160 0x7f77e00b5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:09.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.051+0000 7f77e6630700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e00b5870 con 0x7f77e00ae730 2023-10-06T11:16:09.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.051+0000 7f77e6630700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e00b3b80 con 0x7f77e015a160 2023-10-06T11:16:09.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.051+0000 7f77e6630700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e00b3e60 con 0x7f77e00ce3d0 2023-10-06T11:16:09.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.051+0000 7f77dffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77e00ae730 0x7f77e00b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:09.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.051+0000 7f77dffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77e00ae730 0x7f77e00b35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36344/0 (socket says 172.21.15.146:36344) 2023-10-06T11:16:09.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.051+0000 7f77dffff700 1 -- 172.21.15.146:0/1449653873 learned_addr learned my addr 172.21.15.146:0/1449653873 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:09.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.051+0000 7f77df7fe700 1 --2- 172.21.15.146:0/1449653873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77e00ce3d0 0x7f77e015e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:09.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.051+0000 7f77e4bcd700 1 --2- 172.21.15.146:0/1449653873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77e015a160 0x7f77e00b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:09.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.051+0000 7f77dffff700 1 -- 172.21.15.146:0/1449653873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77e00ce3d0 msgr2=0x7f77e015e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:09.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.051+0000 7f77dffff700 1 --2- 172.21.15.146:0/1449653873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77e00ce3d0 0x7f77e015e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.051+0000 7f77dffff700 1 -- 172.21.15.146:0/1449653873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77e015a160 msgr2=0x7f77e00b5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:09.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.051+0000 7f77dffff700 1 --2- 172.21.15.146:0/1449653873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77e015a160 0x7f77e00b5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.051+0000 7f77dffff700 1 -- 172.21.15.146:0/1449653873 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d0009480 con 0x7f77e00ae730 2023-10-06T11:16:09.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.051+0000 7f77dffff700 1 --2- 172.21.15.146:0/1449653873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77e00ae730 0x7f77e00b35a0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f77d000b3c0 tx=0x7f77d0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:09.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.051+0000 7f77c7fff700 1 -- 172.21.15.146:0/1449653873 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d0011740 con 0x7f77e00ae730 2023-10-06T11:16:09.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.051+0000 7f77c7fff700 1 -- 172.21.15.146:0/1449653873 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d0020070 con 0x7f77e00ae730 2023-10-06T11:16:09.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.051+0000 7f77e6630700 1 -- 172.21.15.146:0/1449653873 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77e00b4140 con 0x7f77e00ae730 2023-10-06T11:16:09.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.052+0000 7f77c7fff700 1 -- 172.21.15.146:0/1449653873 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d0011ad0 con 0x7f77e00ae730 2023-10-06T11:16:09.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.052+0000 7f77e6630700 1 -- 172.21.15.146:0/1449653873 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e014ff50 con 0x7f77e00ae730 2023-10-06T11:16:09.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.052+0000 7f77e6630700 1 -- 172.21.15.146:0/1449653873 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77e0068390 con 0x7f77e00ae730 2023-10-06T11:16:09.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.053+0000 7f77c7fff700 1 -- 172.21.15.146:0/1449653873 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f77d0022030 con 0x7f77e00ae730 2023-10-06T11:16:09.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.053+0000 7f77c7fff700 1 --2- 172.21.15.146:0/1449653873 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f77cc066f30 0x7f77cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:09.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.053+0000 7f77c7fff700 1 -- 172.21.15.146:0/1449653873 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f77d0086190 con 0x7f77e00ae730 2023-10-06T11:16:09.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.053+0000 7f77df7fe700 1 --2- 172.21.15.146:0/1449653873 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f77cc066f30 0x7f77cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:09.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.054+0000 7f77df7fe700 1 --2- 172.21.15.146:0/1449653873 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f77cc066f30 0x7f77cc0693e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f77d4006fd0 tx=0x7f77d4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:09.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.058+0000 7f77c7fff700 1 -- 172.21.15.146:0/1449653873 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f77d0053250 con 0x7f77e00ae730 2023-10-06T11:16:09.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.241+0000 7f77e6630700 1 -- 172.21.15.146:0/1449653873 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f77e004c380 con 0x7f77e00ae730 2023-10-06T11:16:09.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.241+0000 7f77c7fff700 1 -- 172.21.15.146:0/1449653873 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v126) v1 ==== 93+0+10 (secure 0 0 0) 0x7f77d0056870 con 0x7f77e00ae730 2023-10-06T11:16:09.243 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-10-06T11:16:09.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.244+0000 7f77e6630700 1 -- 172.21.15.146:0/1449653873 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f77cc066f30 msgr2=0x7f77cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:09.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.244+0000 7f77e6630700 1 --2- 172.21.15.146:0/1449653873 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f77cc066f30 0x7f77cc0693e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f77d4006fd0 tx=0x7f77d4008040 comp rx=0 tx=0).stop 2023-10-06T11:16:09.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.244+0000 7f77e6630700 1 -- 172.21.15.146:0/1449653873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77e00ae730 msgr2=0x7f77e00b35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:09.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.244+0000 7f77e6630700 1 --2- 172.21.15.146:0/1449653873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77e00ae730 0x7f77e00b35a0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f77d000b3c0 tx=0x7f77d0016000 comp rx=0 tx=0).stop 2023-10-06T11:16:09.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.244+0000 7f77e6630700 1 -- 172.21.15.146:0/1449653873 shutdown_connections 2023-10-06T11:16:09.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.244+0000 7f77e6630700 1 --2- 172.21.15.146:0/1449653873 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f77cc066f30 0x7f77cc0693e0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.244+0000 7f77e6630700 1 --2- 172.21.15.146:0/1449653873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77e015a160 0x7f77e00b5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.244+0000 7f77e6630700 1 --2- 172.21.15.146:0/1449653873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f77e00ae730 0x7f77e00b35a0 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.244+0000 7f77e6630700 1 --2- 172.21.15.146:0/1449653873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77e00ce3d0 0x7f77e015e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.244+0000 7f77e6630700 1 -- 172.21.15.146:0/1449653873 >> 172.21.15.146:0/1449653873 conn(0x7f77e006f380 msgr2=0x7f77e00cdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:09.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.244+0000 7f77e6630700 1 -- 172.21.15.146:0/1449653873 shutdown_connections 2023-10-06T11:16:09.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.244+0000 7f77e6630700 1 -- 172.21.15.146:0/1449653873 wait complete. 2023-10-06T11:16:09.258 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T11:16:09.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.374+0000 7f9ac3901700 1 Processor -- start 2023-10-06T11:16:09.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.374+0000 7f9ac3901700 1 -- start start 2023-10-06T11:16:09.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.375+0000 7f9ac3901700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9abc158e90 0x7f9abc0adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:09.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.375+0000 7f9ac3901700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9abc156870 0x7f9abc0ae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:09.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.375+0000 7f9ac3901700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9abc1579f0 con 0x7f9abc0adbd0 2023-10-06T11:16:09.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.375+0000 7f9ac3901700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9abc0aea20 con 0x7f9abc158e90 2023-10-06T11:16:09.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.375+0000 7f9ac3901700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9abc156de0 con 0x7f9abc156870 2023-10-06T11:16:09.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.375+0000 7f9ac0e9c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9abc158e90 0x7f9abc0adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:09.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.375+0000 7f9ac0e9c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9abc158e90 0x7f9abc0adfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36350/0 (socket says 172.21.15.146:36350) 2023-10-06T11:16:09.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.375+0000 7f9ac0e9c700 1 -- 172.21.15.146:0/3289073386 learned_addr learned my addr 172.21.15.146:0/3289073386 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:09.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.376+0000 7f9ac1e9e700 1 --2- 172.21.15.146:0/3289073386 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9abc156870 0x7f9abc0ae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:09.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.376+0000 7f9ac0e9c700 1 -- 172.21.15.146:0/3289073386 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9abc156870 msgr2=0x7f9abc0ae4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:09.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.376+0000 7f9ac0e9c700 1 --2- 172.21.15.146:0/3289073386 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9abc156870 0x7f9abc0ae4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.376+0000 7f9ac0e9c700 1 -- 172.21.15.146:0/3289073386 >> v1:172.21.15.151:6789/0 conn(0x7f9abc0adbd0 legacy=0x7f9abc156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:09.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.376+0000 7f9ac0e9c700 1 -- 172.21.15.146:0/3289073386 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9abc1570c0 con 0x7f9abc158e90 2023-10-06T11:16:09.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.376+0000 7f9ac1e9e700 1 --2- 172.21.15.146:0/3289073386 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9abc156870 0x7f9abc0ae4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:09.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.376+0000 7f9ac0e9c700 1 --2- 172.21.15.146:0/3289073386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9abc158e90 0x7f9abc0adfa0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f9aac0099b0 tx=0x7f9aac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=673f60ef46ee043c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:09.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.376+0000 7f9ab3fff700 1 -- 172.21.15.146:0/3289073386 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aac00b860 con 0x7f9abc158e90 2023-10-06T11:16:09.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.376+0000 7f9ab3fff700 1 -- 172.21.15.146:0/3289073386 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aac00b9c0 con 0x7f9abc158e90 2023-10-06T11:16:09.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.376+0000 7f9ab3fff700 1 -- 172.21.15.146:0/3289073386 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aac00bd60 con 0x7f9abc158e90 2023-10-06T11:16:09.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.376+0000 7f9ac3901700 1 -- 172.21.15.146:0/3289073386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9abc158e90 msgr2=0x7f9abc0adfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:09.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.376+0000 7f9ac3901700 1 --2- 172.21.15.146:0/3289073386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9abc158e90 0x7f9abc0adfa0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f9aac0099b0 tx=0x7f9aac009250 comp rx=0 tx=0).stop 2023-10-06T11:16:09.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.377+0000 7f9ac3901700 1 -- 172.21.15.146:0/3289073386 shutdown_connections 2023-10-06T11:16:09.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.377+0000 7f9ac3901700 1 --2- 172.21.15.146:0/3289073386 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9abc156870 0x7f9abc0ae4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.377+0000 7f9ac3901700 1 --2- 172.21.15.146:0/3289073386 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9abc158e90 0x7f9abc0adfa0 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.377+0000 7f9ac3901700 1 -- 172.21.15.146:0/3289073386 >> 172.21.15.146:0/3289073386 conn(0x7f9abc06a070 msgr2=0x7f9abc067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:09.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.377+0000 7f9ac3901700 1 -- 172.21.15.146:0/3289073386 shutdown_connections 2023-10-06T11:16:09.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.377+0000 7f9ac3901700 1 -- 172.21.15.146:0/3289073386 wait complete. 2023-10-06T11:16:09.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.378+0000 7f9ac3901700 1 Processor -- start 2023-10-06T11:16:09.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.378+0000 7f9ac3901700 1 -- start start 2023-10-06T11:16:09.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.379+0000 7f9ac3901700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9abc0adbd0 0x7f9abc141220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:09.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.379+0000 7f9ac3901700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9abc156870 0x7f9abc13d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:09.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.379+0000 7f9ac3901700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9abc158e90 0x7f9abc149830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:09.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.379+0000 7f9ac3901700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9abc142a30 con 0x7f9abc156870 2023-10-06T11:16:09.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.379+0000 7f9ac3901700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9abc142610 con 0x7f9abc158e90 2023-10-06T11:16:09.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.379+0000 7f9ac3901700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9abc141760 con 0x7f9abc0adbd0 2023-10-06T11:16:09.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.379+0000 7f9ac0e9c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9abc156870 0x7f9abc13d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:09.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.379+0000 7f9ac0e9c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9abc156870 0x7f9abc13d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36364/0 (socket says 172.21.15.146:36364) 2023-10-06T11:16:09.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.379+0000 7f9ac0e9c700 1 -- 172.21.15.146:0/3283969801 learned_addr learned my addr 172.21.15.146:0/3283969801 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:09.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.379+0000 7f9ac1e9e700 1 --2- 172.21.15.146:0/3283969801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9abc158e90 0x7f9abc149830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:09.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.379+0000 7f9ac169d700 1 --2- 172.21.15.146:0/3283969801 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9abc0adbd0 0x7f9abc141220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:09.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.379+0000 7f9ac0e9c700 1 -- 172.21.15.146:0/3283969801 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9abc0adbd0 msgr2=0x7f9abc141220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:09.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.379+0000 7f9ac0e9c700 1 --2- 172.21.15.146:0/3283969801 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9abc0adbd0 0x7f9abc141220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.379+0000 7f9ac0e9c700 1 -- 172.21.15.146:0/3283969801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9abc158e90 msgr2=0x7f9abc149830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:09.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.379+0000 7f9ac0e9c700 1 --2- 172.21.15.146:0/3283969801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9abc158e90 0x7f9abc149830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.379+0000 7f9ac0e9c700 1 -- 172.21.15.146:0/3283969801 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aac0094f0 con 0x7f9abc156870 2023-10-06T11:16:09.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.379+0000 7f9ac169d700 1 --2- 172.21.15.146:0/3283969801 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9abc0adbd0 0x7f9abc141220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:09.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.379+0000 7f9ac0e9c700 1 --2- 172.21.15.146:0/3283969801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9abc156870 0x7f9abc13d420 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f9aac0090b0 tx=0x7f9aac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:09.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.379+0000 7f9ab17fa700 1 -- 172.21.15.146:0/3283969801 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aac026480 con 0x7f9abc156870 2023-10-06T11:16:09.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.379+0000 7f9ab17fa700 1 -- 172.21.15.146:0/3283969801 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aac01f070 con 0x7f9abc156870 2023-10-06T11:16:09.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.379+0000 7f9ab17fa700 1 -- 172.21.15.146:0/3283969801 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aac026830 con 0x7f9abc156870 2023-10-06T11:16:09.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.379+0000 7f9ac3901700 1 -- 172.21.15.146:0/3283969801 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9abc141a00 con 0x7f9abc156870 2023-10-06T11:16:09.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.379+0000 7f9ac3901700 1 -- 172.21.15.146:0/3283969801 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9abc141fc0 con 0x7f9abc156870 2023-10-06T11:16:09.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.380+0000 7f9ac3901700 1 -- 172.21.15.146:0/3283969801 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9abc04c380 con 0x7f9abc156870 2023-10-06T11:16:09.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.381+0000 7f9ab17fa700 1 -- 172.21.15.146:0/3283969801 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9aac01a430 con 0x7f9abc156870 2023-10-06T11:16:09.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.381+0000 7f9ab17fa700 1 --2- 172.21.15.146:0/3283969801 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9aa0066f30 0x7f9aa00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:09.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.381+0000 7f9ab17fa700 1 -- 172.21.15.146:0/3283969801 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f9aac021070 con 0x7f9abc156870 2023-10-06T11:16:09.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.381+0000 7f9ac169d700 1 --2- 172.21.15.146:0/3283969801 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9aa0066f30 0x7f9aa00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:09.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.381+0000 7f9ac169d700 1 --2- 172.21.15.146:0/3283969801 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9aa0066f30 0x7f9aa00693e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8007fd0 tx=0x7f9ab8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:09.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.385+0000 7f9ab17fa700 1 -- 172.21.15.146:0/3283969801 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9aac053630 con 0x7f9abc156870 2023-10-06T11:16:09.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.569+0000 7f9ac3901700 1 -- 172.21.15.146:0/3283969801 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9abc0afc50 con 0x7f9abc156870 2023-10-06T11:16:09.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.570+0000 7f9ab17fa700 1 -- 172.21.15.146:0/3283969801 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v126) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9abc0afc50 con 0x7f9abc156870 2023-10-06T11:16:09.572 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2023-10-06T11:16:09.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.572+0000 7f9ac3901700 1 -- 172.21.15.146:0/3283969801 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9aa0066f30 msgr2=0x7f9aa00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:09.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.572+0000 7f9ac3901700 1 --2- 172.21.15.146:0/3283969801 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9aa0066f30 0x7f9aa00693e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8007fd0 tx=0x7f9ab8009040 comp rx=0 tx=0).stop 2023-10-06T11:16:09.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.572+0000 7f9ac3901700 1 -- 172.21.15.146:0/3283969801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9abc156870 msgr2=0x7f9abc13d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:09.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.572+0000 7f9ac3901700 1 --2- 172.21.15.146:0/3283969801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9abc156870 0x7f9abc13d420 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f9aac0090b0 tx=0x7f9aac017000 comp rx=0 tx=0).stop 2023-10-06T11:16:09.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.572+0000 7f9ac3901700 1 -- 172.21.15.146:0/3283969801 shutdown_connections 2023-10-06T11:16:09.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.572+0000 7f9ac3901700 1 --2- 172.21.15.146:0/3283969801 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9aa0066f30 0x7f9aa00693e0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.572+0000 7f9ac3901700 1 --2- 172.21.15.146:0/3283969801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9abc158e90 0x7f9abc149830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.572+0000 7f9ac3901700 1 --2- 172.21.15.146:0/3283969801 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9abc0adbd0 0x7f9abc141220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.572+0000 7f9ac3901700 1 --2- 172.21.15.146:0/3283969801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9abc156870 0x7f9abc13d420 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.572+0000 7f9ac3901700 1 -- 172.21.15.146:0/3283969801 >> 172.21.15.146:0/3283969801 conn(0x7f9abc06a070 msgr2=0x7f9abc06e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:09.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.572+0000 7f9ac3901700 1 -- 172.21.15.146:0/3283969801 shutdown_connections 2023-10-06T11:16:09.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.572+0000 7f9ac3901700 1 -- 172.21.15.146:0/3283969801 wait complete. 2023-10-06T11:16:09.586 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T11:16:09.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.701+0000 7ffb29c0b700 1 Processor -- start 2023-10-06T11:16:09.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.701+0000 7ffb29c0b700 1 -- start start 2023-10-06T11:16:09.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.702+0000 7ffb29c0b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffb2415a160 0x7ffb240c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:09.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.702+0000 7ffb29c0b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffb240ae730 0x7ffb240aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:09.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.702+0000 7ffb29c0b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ffb240ce3d0 0x7ffb240ce830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:09.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.702+0000 7ffb29c0b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb240ae2a0 con 0x7ffb2415a160 2023-10-06T11:16:09.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.702+0000 7ffb29c0b700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb2415a530 con 0x7ffb240ce3d0 2023-10-06T11:16:09.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.702+0000 7ffb29c0b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb240ad690 con 0x7ffb240ae730 2023-10-06T11:16:09.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.702+0000 7ffb237fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffb2415a160 0x7ffb240c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:09.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.702+0000 7ffb237fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffb2415a160 0x7ffb240c55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36368/0 (socket says 172.21.15.146:36368) 2023-10-06T11:16:09.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.702+0000 7ffb237fe700 1 -- 172.21.15.146:0/310326193 learned_addr learned my addr 172.21.15.146:0/310326193 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:09.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.703+0000 7ffb23fff700 1 --2- 172.21.15.146:0/310326193 >> v2:172.21.15.151:3300/0 conn(0x7ffb240ce3d0 0x7ffb240ce830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:09.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.703+0000 7ffb237fe700 1 -- 172.21.15.146:0/310326193 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffb240ae730 msgr2=0x7ffb240aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:09.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.703+0000 7ffb237fe700 1 --2- 172.21.15.146:0/310326193 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffb240ae730 0x7ffb240aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.703+0000 7ffb237fe700 1 -- 172.21.15.146:0/310326193 >> v2:172.21.15.151:3300/0 conn(0x7ffb240ce3d0 msgr2=0x7ffb240ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:09.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.703+0000 7ffb237fe700 1 --2- 172.21.15.146:0/310326193 >> v2:172.21.15.151:3300/0 conn(0x7ffb240ce3d0 0x7ffb240ce830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.703+0000 7ffb237fe700 1 -- 172.21.15.146:0/310326193 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb240ad970 con 0x7ffb2415a160 2023-10-06T11:16:09.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.703+0000 7ffb237fe700 1 --2- 172.21.15.146:0/310326193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb2415a160 0x7ffb240c55a0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7ffb24089c40 tx=0x7ffb14009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de4ba2a6f625292 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:09.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.703+0000 7ffb227fc700 1 -- 172.21.15.146:0/310326193 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1400e070 con 0x7ffb2415a160 2023-10-06T11:16:09.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.703+0000 7ffb227fc700 1 -- 172.21.15.146:0/310326193 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb1400bad0 con 0x7ffb2415a160 2023-10-06T11:16:09.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.703+0000 7ffb227fc700 1 -- 172.21.15.146:0/310326193 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb140092e0 con 0x7ffb2415a160 2023-10-06T11:16:09.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.703+0000 7ffb29c0b700 1 -- 172.21.15.146:0/310326193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb2415a160 msgr2=0x7ffb240c55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:09.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.703+0000 7ffb29c0b700 1 --2- 172.21.15.146:0/310326193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb2415a160 0x7ffb240c55a0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7ffb24089c40 tx=0x7ffb14009840 comp rx=0 tx=0).stop 2023-10-06T11:16:09.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.703+0000 7ffb29c0b700 1 -- 172.21.15.146:0/310326193 shutdown_connections 2023-10-06T11:16:09.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.703+0000 7ffb29c0b700 1 --2- 172.21.15.146:0/310326193 >> v2:172.21.15.151:3300/0 conn(0x7ffb240ce3d0 0x7ffb240ce830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.703+0000 7ffb29c0b700 1 --2- 172.21.15.146:0/310326193 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb2415a160 0x7ffb240c55a0 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.703+0000 7ffb29c0b700 1 --2- 172.21.15.146:0/310326193 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffb240ae730 0x7ffb240aeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.703+0000 7ffb29c0b700 1 -- 172.21.15.146:0/310326193 >> 172.21.15.146:0/310326193 conn(0x7ffb2406f380 msgr2=0x7ffb240d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:09.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.703+0000 7ffb29c0b700 1 -- 172.21.15.146:0/310326193 shutdown_connections 2023-10-06T11:16:09.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.704+0000 7ffb29c0b700 1 -- 172.21.15.146:0/310326193 wait complete. 2023-10-06T11:16:09.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.705+0000 7ffb29c0b700 1 Processor -- start 2023-10-06T11:16:09.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.705+0000 7ffb29c0b700 1 -- start start 2023-10-06T11:16:09.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.705+0000 7ffb29c0b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb240ae730 0x7ffb2415cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:09.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.705+0000 7ffb29c0b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffb240ce3d0 0x7ffb240ca160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:09.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.705+0000 7ffb29c0b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffb2415a160 0x7ffb2416a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:09.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.705+0000 7ffb29c0b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2415fbf0 con 0x7ffb240ae730 2023-10-06T11:16:09.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.705+0000 7ffb29c0b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb240b4a80 con 0x7ffb240ce3d0 2023-10-06T11:16:09.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.705+0000 7ffb29c0b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb2415f630 con 0x7ffb2415a160 2023-10-06T11:16:09.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.706+0000 7ffb237fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb240ae730 0x7ffb2415cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:09.712 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.706+0000 7ffb237fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb240ae730 0x7ffb2415cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36374/0 (socket says 172.21.15.146:36374) 2023-10-06T11:16:09.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.706+0000 7ffb237fe700 1 -- 172.21.15.146:0/530160390 learned_addr learned my addr 172.21.15.146:0/530160390 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:09.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.706+0000 7ffb23fff700 1 --2- 172.21.15.146:0/530160390 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffb2415a160 0x7ffb2416a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:09.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.706+0000 7ffb22ffd700 1 --2- 172.21.15.146:0/530160390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffb240ce3d0 0x7ffb240ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:09.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.706+0000 7ffb237fe700 1 -- 172.21.15.146:0/530160390 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffb2415a160 msgr2=0x7ffb2416a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:09.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.706+0000 7ffb237fe700 1 --2- 172.21.15.146:0/530160390 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffb2415a160 0x7ffb2416a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.706+0000 7ffb237fe700 1 -- 172.21.15.146:0/530160390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffb240ce3d0 msgr2=0x7ffb240ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:09.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.706+0000 7ffb237fe700 1 --2- 172.21.15.146:0/530160390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffb240ce3d0 0x7ffb240ca160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.706+0000 7ffb237fe700 1 -- 172.21.15.146:0/530160390 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb14009ae0 con 0x7ffb240ae730 2023-10-06T11:16:09.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.706+0000 7ffb22ffd700 1 --2- 172.21.15.146:0/530160390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffb240ce3d0 0x7ffb240ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:09.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.706+0000 7ffb237fe700 1 --2- 172.21.15.146:0/530160390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb240ae730 0x7ffb2415cad0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7ffb14012000 tx=0x7ffb14018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:09.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.706+0000 7ffb0b7fe700 1 -- 172.21.15.146:0/530160390 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb14008bb0 con 0x7ffb240ae730 2023-10-06T11:16:09.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.706+0000 7ffb0b7fe700 1 -- 172.21.15.146:0/530160390 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb14008d50 con 0x7ffb240ae730 2023-10-06T11:16:09.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.706+0000 7ffb29c0b700 1 -- 172.21.15.146:0/530160390 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb2415f910 con 0x7ffb240ae730 2023-10-06T11:16:09.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.706+0000 7ffb0b7fe700 1 -- 172.21.15.146:0/530160390 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb140266b0 con 0x7ffb240ae730 2023-10-06T11:16:09.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.706+0000 7ffb29c0b700 1 -- 172.21.15.146:0/530160390 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb2416b8d0 con 0x7ffb240ae730 2023-10-06T11:16:09.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.707+0000 7ffb29c0b700 1 -- 172.21.15.146:0/530160390 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb240b4570 con 0x7ffb240ae730 2023-10-06T11:16:09.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.708+0000 7ffb0b7fe700 1 -- 172.21.15.146:0/530160390 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffb14003040 con 0x7ffb240ae730 2023-10-06T11:16:09.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.708+0000 7ffb0b7fe700 1 --2- 172.21.15.146:0/530160390 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ffb10066f30 0x7ffb100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:09.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.708+0000 7ffb0b7fe700 1 -- 172.21.15.146:0/530160390 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6144+0+0 (secure 0 0 0) 0x7ffb14086580 con 0x7ffb240ae730 2023-10-06T11:16:09.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.708+0000 7ffb22ffd700 1 --2- 172.21.15.146:0/530160390 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ffb10066f30 0x7ffb100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:09.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.708+0000 7ffb22ffd700 1 --2- 172.21.15.146:0/530160390 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ffb10066f30 0x7ffb100693e0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7ffb18006fd0 tx=0x7ffb18008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:09.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.712+0000 7ffb0b7fe700 1 -- 172.21.15.146:0/530160390 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffb240b4570 con 0x7ffb240ae730 2023-10-06T11:16:09.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.897+0000 7ffb29c0b700 1 -- 172.21.15.146:0/530160390 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffb240b4570 con 0x7ffb240ae730 2023-10-06T11:16:09.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.897+0000 7ffb0b7fe700 1 -- 172.21.15.146:0/530160390 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v126) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffb240b4570 con 0x7ffb240ae730 2023-10-06T11:16:09.899 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2023-10-06T11:16:09.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.899+0000 7ffb29c0b700 1 -- 172.21.15.146:0/530160390 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ffb10066f30 msgr2=0x7ffb100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:09.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.899+0000 7ffb29c0b700 1 --2- 172.21.15.146:0/530160390 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ffb10066f30 0x7ffb100693e0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7ffb18006fd0 tx=0x7ffb18008040 comp rx=0 tx=0).stop 2023-10-06T11:16:09.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.899+0000 7ffb29c0b700 1 -- 172.21.15.146:0/530160390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb240ae730 msgr2=0x7ffb2415cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:09.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.899+0000 7ffb29c0b700 1 --2- 172.21.15.146:0/530160390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb240ae730 0x7ffb2415cad0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7ffb14012000 tx=0x7ffb14018000 comp rx=0 tx=0).stop 2023-10-06T11:16:09.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.899+0000 7ffb29c0b700 1 -- 172.21.15.146:0/530160390 shutdown_connections 2023-10-06T11:16:09.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.899+0000 7ffb29c0b700 1 --2- 172.21.15.146:0/530160390 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ffb10066f30 0x7ffb100693e0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.899+0000 7ffb29c0b700 1 --2- 172.21.15.146:0/530160390 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffb2415a160 0x7ffb2416a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.899+0000 7ffb29c0b700 1 --2- 172.21.15.146:0/530160390 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffb240ae730 0x7ffb2415cad0 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.899+0000 7ffb29c0b700 1 --2- 172.21.15.146:0/530160390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffb240ce3d0 0x7ffb240ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:09.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.899+0000 7ffb29c0b700 1 -- 172.21.15.146:0/530160390 >> 172.21.15.146:0/530160390 conn(0x7ffb2406f380 msgr2=0x7ffb24068550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:09.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.899+0000 7ffb29c0b700 1 -- 172.21.15.146:0/530160390 shutdown_connections 2023-10-06T11:16:09.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:09.899+0000 7ffb29c0b700 1 -- 172.21.15.146:0/530160390 wait complete. 2023-10-06T11:16:09.913 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:16:10.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.026+0000 7f988bfff700 1 Processor -- start 2023-10-06T11:16:10.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.026+0000 7f988bfff700 1 -- start start 2023-10-06T11:16:10.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.027+0000 7f988bfff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f988c13c390 0x7f988c15da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:10.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.027+0000 7f988bfff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f988c159c20 0x7f988c15a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:10.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.027+0000 7f988bfff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f988c06c5a0 con 0x7f988c0cbe30 2023-10-06T11:16:10.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.027+0000 7f988bfff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f988c15dfb0 con 0x7f988c13c390 2023-10-06T11:16:10.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.027+0000 7f988bfff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f988c06b6b0 con 0x7f988c159c20 2023-10-06T11:16:10.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.027+0000 7f98827fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f988c0cbe30 0x7f988c0cc2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:42608/0 (socket says 172.21.15.146:42608) 2023-10-06T11:16:10.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.027+0000 7f98827fc700 1 -- 172.21.15.146:0/2641921247 learned_addr learned my addr 172.21.15.146:0/2641921247 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:16:10.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.027+0000 7f988affd700 1 --2- 172.21.15.146:0/2641921247 >> v2:172.21.15.151:3300/0 conn(0x7f988c13c390 0x7f988c15da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:10.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.027+0000 7f988b7fe700 1 --2- 172.21.15.146:0/2641921247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f988c159c20 0x7f988c15a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:10.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.027+0000 7f988a7fc700 1 -- 172.21.15.146:0/2641921247 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1051948034 0 0) 0x7f988c06c5a0 con 0x7f988c0cbe30 2023-10-06T11:16:10.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.028+0000 7f988a7fc700 1 -- 172.21.15.146:0/2641921247 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9878003570 con 0x7f988c0cbe30 2023-10-06T11:16:10.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.028+0000 7f988a7fc700 1 -- 172.21.15.146:0/2641921247 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3817295466 0 0) 0x7f9878003570 con 0x7f988c0cbe30 2023-10-06T11:16:10.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.028+0000 7f988a7fc700 1 -- 172.21.15.146:0/2641921247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f988c159c20 msgr2=0x7f988c15a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:10.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.028+0000 7f988a7fc700 1 --2- 172.21.15.146:0/2641921247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f988c159c20 0x7f988c15a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:10.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.028+0000 7f988a7fc700 1 -- 172.21.15.146:0/2641921247 >> v2:172.21.15.151:3300/0 conn(0x7f988c13c390 msgr2=0x7f988c15da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:10.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.028+0000 7f988a7fc700 1 --2- 172.21.15.146:0/2641921247 >> v2:172.21.15.151:3300/0 conn(0x7f988c13c390 0x7f988c15da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:10.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.028+0000 7f988a7fc700 1 -- 172.21.15.146:0/2641921247 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f988c06b990 con 0x7f988c0cbe30 2023-10-06T11:16:10.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.028+0000 7f988a7fc700 1 -- 172.21.15.146:0/2641921247 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f9874001470 con 0x7f988c0cbe30 2023-10-06T11:16:10.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.028+0000 7f988a7fc700 1 -- 172.21.15.146:0/2641921247 >> v1:172.21.15.146:6789/0 conn(0x7f988c0cbe30 legacy=0x7f988c0cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:10.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.028+0000 7f988a7fc700 1 --2- 172.21.15.146:0/2641921247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9878003a60 0x7f9878003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:10.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.028+0000 7f988a7fc700 1 --2- 172.21.15.146:0/2641921247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9878004810 0x7f9878004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:10.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.028+0000 7f988a7fc700 1 --2- 172.21.15.146:0/2641921247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f988c159c20 0x7f98780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:10.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.028+0000 7f988a7fc700 1 -- 172.21.15.146:0/2641921247 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988c15dfb0 con 0x7f9878003a60 2023-10-06T11:16:10.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.028+0000 7f988a7fc700 1 -- 172.21.15.146:0/2641921247 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988c06b6b0 con 0x7f9878004810 2023-10-06T11:16:10.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.028+0000 7f988a7fc700 1 -- 172.21.15.146:0/2641921247 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f987800ba60 con 0x7f988c159c20 2023-10-06T11:16:10.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.028+0000 7f988affd700 1 --2- 172.21.15.146:0/2641921247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9878003a60 0x7f9878003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:10.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.028+0000 7f98827fc700 1 --2- 172.21.15.146:0/2641921247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9878004810 0x7f9878004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:10.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.028+0000 7f988b7fe700 1 --2- 172.21.15.146:0/2641921247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f988c159c20 0x7f98780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:10.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.028+0000 7f988affd700 1 -- 172.21.15.146:0/2641921247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f988c159c20 msgr2=0x7f98780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:10.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.028+0000 7f988affd700 1 --2- 172.21.15.146:0/2641921247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f988c159c20 0x7f98780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:10.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.028+0000 7f988affd700 1 -- 172.21.15.146:0/2641921247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9878004810 msgr2=0x7f9878004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:10.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.028+0000 7f988affd700 1 --2- 172.21.15.146:0/2641921247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9878004810 0x7f9878004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:10.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.028+0000 7f988affd700 1 -- 172.21.15.146:0/2641921247 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9878003570 con 0x7f9878003a60 2023-10-06T11:16:10.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.028+0000 7f98827fc700 1 --2- 172.21.15.146:0/2641921247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9878004810 0x7f9878004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:10.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.028+0000 7f988b7fe700 1 --2- 172.21.15.146:0/2641921247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f988c159c20 0x7f98780051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:10.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.028+0000 7f988affd700 1 --2- 172.21.15.146:0/2641921247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9878003a60 0x7f9878003e70 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f987c009c20 tx=0x7f987c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=470fce1e210c3e29 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:10.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.028+0000 7f988a7fc700 1 -- 172.21.15.146:0/2641921247 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987c005a00 con 0x7f9878003a60 2023-10-06T11:16:10.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.028+0000 7f988a7fc700 1 -- 172.21.15.146:0/2641921247 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f987c005b60 con 0x7f9878003a60 2023-10-06T11:16:10.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.029+0000 7f988a7fc700 1 -- 172.21.15.146:0/2641921247 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987c00e710 con 0x7f9878003a60 2023-10-06T11:16:10.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.029+0000 7f988bfff700 1 -- 172.21.15.146:0/2641921247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9878003a60 msgr2=0x7f9878003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:10.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.029+0000 7f988bfff700 1 --2- 172.21.15.146:0/2641921247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9878003a60 0x7f9878003e70 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f987c009c20 tx=0x7f987c009120 comp rx=0 tx=0).stop 2023-10-06T11:16:10.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.029+0000 7f988b7fe700 1 -- 172.21.15.146:0/2641921247 reap_dead start 2023-10-06T11:16:10.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.029+0000 7f988bfff700 1 -- 172.21.15.146:0/2641921247 shutdown_connections 2023-10-06T11:16:10.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.029+0000 7f988bfff700 1 -- 172.21.15.146:0/2641921247 >> 172.21.15.146:0/2641921247 conn(0x7f988c0ce260 msgr2=0x7f988c0ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:10.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.029+0000 7f988bfff700 1 -- 172.21.15.146:0/2641921247 shutdown_connections 2023-10-06T11:16:10.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.029+0000 7f988bfff700 1 -- 172.21.15.146:0/2641921247 wait complete. 2023-10-06T11:16:10.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.030+0000 7f988bfff700 1 Processor -- start 2023-10-06T11:16:10.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.030+0000 7f988bfff700 1 -- start start 2023-10-06T11:16:10.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.031+0000 7f988bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9878003a60 0x7f988c0b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:10.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.031+0000 7f988bfff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f988c0b10b0 0x7f988c0caad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:10.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.031+0000 7f988bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f988c0cb010 0x7f988c16cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:10.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.031+0000 7f988bfff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988c16de90 con 0x7f9878003a60 2023-10-06T11:16:10.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.031+0000 7f988bfff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988c0b4010 con 0x7f988c0cb010 2023-10-06T11:16:10.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.031+0000 7f988bfff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f988c06a170 con 0x7f988c0b10b0 2023-10-06T11:16:10.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.031+0000 7f988affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9878003a60 0x7f988c0b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:10.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.031+0000 7f988affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9878003a60 0x7f988c0b3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36392/0 (socket says 172.21.15.146:36392) 2023-10-06T11:16:10.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.031+0000 7f988affd700 1 -- 172.21.15.146:0/3311695356 learned_addr learned my addr 172.21.15.146:0/3311695356 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:10.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.031+0000 7f98827fc700 1 --2- 172.21.15.146:0/3311695356 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f988c0b10b0 0x7f988c0caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:10.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.031+0000 7f988b7fe700 1 --2- 172.21.15.146:0/3311695356 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f988c0cb010 0x7f988c16cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:10.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.031+0000 7f988affd700 1 -- 172.21.15.146:0/3311695356 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f988c0b10b0 msgr2=0x7f988c0caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:10.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.031+0000 7f988affd700 1 --2- 172.21.15.146:0/3311695356 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f988c0b10b0 0x7f988c0caad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:10.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.031+0000 7f988affd700 1 -- 172.21.15.146:0/3311695356 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f988c0cb010 msgr2=0x7f988c16cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:10.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.031+0000 7f988affd700 1 --2- 172.21.15.146:0/3311695356 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f988c0cb010 0x7f988c16cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:10.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.031+0000 7f988affd700 1 -- 172.21.15.146:0/3311695356 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f988c13a740 con 0x7f9878003a60 2023-10-06T11:16:10.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.031+0000 7f98827fc700 1 --2- 172.21.15.146:0/3311695356 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f988c0b10b0 0x7f988c0caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:10.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.031+0000 7f988b7fe700 1 --2- 172.21.15.146:0/3311695356 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f988c0cb010 0x7f988c16cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:10.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.032+0000 7f988affd700 1 --2- 172.21.15.146:0/3311695356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9878003a60 0x7f988c0b3ad0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f98780046d0 tx=0x7f987c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:10.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.032+0000 7f98837fe700 1 -- 172.21.15.146:0/3311695356 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987c006240 con 0x7f9878003a60 2023-10-06T11:16:10.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.032+0000 7f98837fe700 1 -- 172.21.15.146:0/3311695356 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f987c0063e0 con 0x7f9878003a60 2023-10-06T11:16:10.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.032+0000 7f988bfff700 1 -- 172.21.15.146:0/3311695356 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f988c154950 con 0x7f9878003a60 2023-10-06T11:16:10.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.032+0000 7f98837fe700 1 -- 172.21.15.146:0/3311695356 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987c0067a0 con 0x7f9878003a60 2023-10-06T11:16:10.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.032+0000 7f988bfff700 1 -- 172.21.15.146:0/3311695356 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f988c154300 con 0x7f9878003a60 2023-10-06T11:16:10.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.033+0000 7f988bfff700 1 -- 172.21.15.146:0/3311695356 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f988c154160 con 0x7f9878003a60 2023-10-06T11:16:10.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.033+0000 7f98837fe700 1 -- 172.21.15.146:0/3311695356 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f987c013680 con 0x7f9878003a60 2023-10-06T11:16:10.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.034+0000 7f98837fe700 1 --2- 172.21.15.146:0/3311695356 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f986c066f30 0x7f986c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:10.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.034+0000 7f98827fc700 1 --2- 172.21.15.146:0/3311695356 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f986c066f30 0x7f986c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:10.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.034+0000 7f98837fe700 1 -- 172.21.15.146:0/3311695356 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f987c085d60 con 0x7f9878003a60 2023-10-06T11:16:10.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.034+0000 7f98827fc700 1 --2- 172.21.15.146:0/3311695356 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f986c066f30 0x7f986c0693e0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f9874001d20 tx=0x7f9874000ed0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:10.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.038+0000 7f98837fe700 1 -- 172.21.15.146:0/3311695356 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f988c154160 con 0x7f9878003a60 2023-10-06T11:16:10.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.263+0000 7f988bfff700 1 -- 172.21.15.146:0/3311695356 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f988c154160 con 0x7f9878003a60 2023-10-06T11:16:10.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.264+0000 7f98837fe700 1 -- 172.21.15.146:0/3311695356 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) v1 ==== 95+0+3859 (secure 0 0 0) 0x7f988c154160 con 0x7f9878003a60 2023-10-06T11:16:10.266 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:16:10.267 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":112,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7792,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3693464886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3693464886},{"type":"v1","addr":"172.21.15.151:6834","nonce":3693464886}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103},{"gid":7795,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1155762565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":1155762565},{"type":"v1","addr":"172.21.15.151:6835","nonce":1155762565}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:15:11.929158+0000","modified":"2023-10-06T11:16:03.435307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":126,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8679":{"gid":8679,"name":"a","rank":0,"incarnation":109,"state":"up:active","state_seq":17,"addr":"172.21.15.146:6836/3868720724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3868720724},{"type":"v1","addr":"172.21.15.146:6836","nonce":3868720724}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-06T11:16:10.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.266+0000 7f988bfff700 1 -- 172.21.15.146:0/3311695356 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f986c066f30 msgr2=0x7f986c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:10.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.266+0000 7f988bfff700 1 --2- 172.21.15.146:0/3311695356 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f986c066f30 0x7f986c0693e0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f9874001d20 tx=0x7f9874000ed0 comp rx=0 tx=0).stop 2023-10-06T11:16:10.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.266+0000 7f988bfff700 1 -- 172.21.15.146:0/3311695356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9878003a60 msgr2=0x7f988c0b3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:10.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.266+0000 7f988bfff700 1 --2- 172.21.15.146:0/3311695356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9878003a60 0x7f988c0b3ad0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f98780046d0 tx=0x7f987c019000 comp rx=0 tx=0).stop 2023-10-06T11:16:10.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.266+0000 7f988bfff700 1 -- 172.21.15.146:0/3311695356 shutdown_connections 2023-10-06T11:16:10.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.266+0000 7f988bfff700 1 --2- 172.21.15.146:0/3311695356 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f986c066f30 0x7f986c0693e0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:10.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.266+0000 7f988bfff700 1 --2- 172.21.15.146:0/3311695356 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f988c0cb010 0x7f988c16cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:10.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.266+0000 7f988bfff700 1 --2- 172.21.15.146:0/3311695356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9878003a60 0x7f988c0b3ad0 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:10.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.266+0000 7f988bfff700 1 --2- 172.21.15.146:0/3311695356 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f988c0b10b0 0x7f988c0caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:10.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.266+0000 7f988bfff700 1 -- 172.21.15.146:0/3311695356 >> 172.21.15.146:0/3311695356 conn(0x7f988c0ce260 msgr2=0x7f988c0c4520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:10.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.266+0000 7f988bfff700 1 -- 172.21.15.146:0/3311695356 shutdown_connections 2023-10-06T11:16:10.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.266+0000 7f988bfff700 1 -- 172.21.15.146:0/3311695356 wait complete. 2023-10-06T11:16:10.269 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 112 2023-10-06T11:16:10.280 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:16:10.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.393+0000 7ff5247a5700 1 Processor -- start 2023-10-06T11:16:10.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.393+0000 7ff5247a5700 1 -- start start 2023-10-06T11:16:10.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.394+0000 7ff5247a5700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff51c068ba0 0x7ff51c15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:10.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.394+0000 7ff5247a5700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff51c153e80 0x7ff51c0b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:10.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.394+0000 7ff5247a5700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff51c15ac30 con 0x7ff51c153ab0 2023-10-06T11:16:10.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.394+0000 7ff5247a5700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff51c0b4510 con 0x7ff51c153e80 2023-10-06T11:16:10.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.394+0000 7ff5247a5700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c0b6530 con 0x7ff51c068ba0 2023-10-06T11:16:10.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.394+0000 7ff522541700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff51c153ab0 0x7ff51c068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:42610/0 (socket says 172.21.15.146:42610) 2023-10-06T11:16:10.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.394+0000 7ff522541700 1 -- 172.21.15.146:0/2475813819 learned_addr learned my addr 172.21.15.146:0/2475813819 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:16:10.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.394+0000 7ff522d42700 1 --2- 172.21.15.146:0/2475813819 >> v2:172.21.15.151:3300/0 conn(0x7ff51c153e80 0x7ff51c0b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:10.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.394+0000 7ff521d40700 1 --2- 172.21.15.146:0/2475813819 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff51c068ba0 0x7ff51c15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:10.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.394+0000 7ff52153f700 1 -- 172.21.15.146:0/2475813819 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4141009237 0 0) 0x7ff518001110 con 0x7ff51c153ab0 2023-10-06T11:16:10.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.395+0000 7ff52153f700 1 -- 172.21.15.146:0/2475813819 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff508003570 con 0x7ff51c153ab0 2023-10-06T11:16:10.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.395+0000 7ff521d40700 1 -- 172.21.15.146:0/2475813819 >> v2:172.21.15.151:3300/0 conn(0x7ff51c153e80 msgr2=0x7ff51c0b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:10.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.395+0000 7ff521d40700 1 --2- 172.21.15.146:0/2475813819 >> v2:172.21.15.151:3300/0 conn(0x7ff51c153e80 0x7ff51c0b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:10.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.395+0000 7ff521d40700 1 -- 172.21.15.146:0/2475813819 >> v1:172.21.15.146:6789/0 conn(0x7ff51c153ab0 legacy=0x7ff51c068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:10.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.395+0000 7ff52153f700 1 -- 172.21.15.146:0/2475813819 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2287220338 0 0) 0x7ff508003570 con 0x7ff51c153ab0 2023-10-06T11:16:10.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.395+0000 7ff521d40700 1 -- 172.21.15.146:0/2475813819 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff51c0b5c50 con 0x7ff51c068ba0 2023-10-06T11:16:10.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.395+0000 7ff522d42700 1 --2- 172.21.15.146:0/2475813819 >> v2:172.21.15.151:3300/0 conn(0x7ff51c153e80 0x7ff51c0b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:16:10.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.395+0000 7ff521d40700 1 --2- 172.21.15.146:0/2475813819 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff51c068ba0 0x7ff51c15a6f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff50c0098e0 tx=0x7ff50c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27a7fd4aed2d44a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:10.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.395+0000 7ff52153f700 1 -- 172.21.15.146:0/2475813819 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff518001600 con 0x7ff51c068ba0 2023-10-06T11:16:10.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.395+0000 7ff52153f700 1 -- 172.21.15.146:0/2475813819 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50c011420 con 0x7ff51c068ba0 2023-10-06T11:16:10.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.395+0000 7ff52153f700 1 -- 172.21.15.146:0/2475813819 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50c0117c0 con 0x7ff51c068ba0 2023-10-06T11:16:10.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.396+0000 7ff5247a5700 1 -- 172.21.15.146:0/2475813819 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff51c068ba0 msgr2=0x7ff51c15a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:10.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.396+0000 7ff5247a5700 1 --2- 172.21.15.146:0/2475813819 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff51c068ba0 0x7ff51c15a6f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff50c0098e0 tx=0x7ff50c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:10.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.396+0000 7ff5247a5700 1 -- 172.21.15.146:0/2475813819 shutdown_connections 2023-10-06T11:16:10.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.396+0000 7ff5247a5700 1 --2- 172.21.15.146:0/2475813819 >> v2:172.21.15.151:3300/0 conn(0x7ff51c153e80 0x7ff51c0b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:10.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.396+0000 7ff5247a5700 1 --2- 172.21.15.146:0/2475813819 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff51c068ba0 0x7ff51c15a6f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:10.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.396+0000 7ff5247a5700 1 -- 172.21.15.146:0/2475813819 >> 172.21.15.146:0/2475813819 conn(0x7ff51c06eba0 msgr2=0x7ff51c06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:10.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.396+0000 7ff5247a5700 1 -- 172.21.15.146:0/2475813819 shutdown_connections 2023-10-06T11:16:10.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.396+0000 7ff5247a5700 1 -- 172.21.15.146:0/2475813819 wait complete. 2023-10-06T11:16:10.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.397+0000 7ff5247a5700 1 Processor -- start 2023-10-06T11:16:10.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.397+0000 7ff5247a5700 1 -- start start 2023-10-06T11:16:10.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.397+0000 7ff5247a5700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff51c068ba0 0x7ff51c14b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:10.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.397+0000 7ff5247a5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff51c153ab0 0x7ff51c0b27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:10.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.397+0000 7ff5247a5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff51c153e80 0x7ff51c169ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:10.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.397+0000 7ff5247a5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c147280 con 0x7ff51c153e80 2023-10-06T11:16:10.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.398+0000 7ff5247a5700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c14c2f0 con 0x7ff51c153ab0 2023-10-06T11:16:10.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.398+0000 7ff5247a5700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff51c0cf1d0 con 0x7ff51c068ba0 2023-10-06T11:16:10.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.398+0000 7ff522d42700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff51c153e80 0x7ff51c169ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:10.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.398+0000 7ff522d42700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff51c153e80 0x7ff51c169ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36402/0 (socket says 172.21.15.146:36402) 2023-10-06T11:16:10.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.398+0000 7ff522d42700 1 -- 172.21.15.146:0/2289928053 learned_addr learned my addr 172.21.15.146:0/2289928053 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:10.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.398+0000 7ff522541700 1 --2- 172.21.15.146:0/2289928053 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff51c068ba0 0x7ff51c14b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:10.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.398+0000 7ff521d40700 1 --2- 172.21.15.146:0/2289928053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff51c153ab0 0x7ff51c0b27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:10.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.398+0000 7ff522d42700 1 -- 172.21.15.146:0/2289928053 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff51c068ba0 msgr2=0x7ff51c14b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:10.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.398+0000 7ff522d42700 1 --2- 172.21.15.146:0/2289928053 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff51c068ba0 0x7ff51c14b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:10.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.398+0000 7ff522d42700 1 -- 172.21.15.146:0/2289928053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff51c153ab0 msgr2=0x7ff51c0b27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:10.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.398+0000 7ff522d42700 1 --2- 172.21.15.146:0/2289928053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff51c153ab0 0x7ff51c0b27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:10.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.398+0000 7ff522d42700 1 -- 172.21.15.146:0/2289928053 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff514009a20 con 0x7ff51c153e80 2023-10-06T11:16:10.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.398+0000 7ff522d42700 1 --2- 172.21.15.146:0/2289928053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff51c153e80 0x7ff51c169ab0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7ff51400c0f0 tx=0x7ff51400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:10.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.398+0000 7ff5127fc700 1 -- 172.21.15.146:0/2289928053 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51400cc30 con 0x7ff51c153e80 2023-10-06T11:16:10.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.398+0000 7ff5127fc700 1 -- 172.21.15.146:0/2289928053 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff51400f040 con 0x7ff51c153e80 2023-10-06T11:16:10.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.398+0000 7ff5247a5700 1 -- 172.21.15.146:0/2289928053 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff50c009420 con 0x7ff51c153e80 2023-10-06T11:16:10.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.398+0000 7ff5127fc700 1 -- 172.21.15.146:0/2289928053 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff514014480 con 0x7ff51c153e80 2023-10-06T11:16:10.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.398+0000 7ff5247a5700 1 -- 172.21.15.146:0/2289928053 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff51c14bd30 con 0x7ff51c153e80 2023-10-06T11:16:10.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.399+0000 7ff5247a5700 1 -- 172.21.15.146:0/2289928053 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff51c0cf360 con 0x7ff51c153e80 2023-10-06T11:16:10.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.400+0000 7ff5127fc700 1 -- 172.21.15.146:0/2289928053 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff514003020 con 0x7ff51c153e80 2023-10-06T11:16:10.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.400+0000 7ff5127fc700 1 --2- 172.21.15.146:0/2289928053 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff500066f30 0x7ff5000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:10.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.400+0000 7ff5127fc700 1 -- 172.21.15.146:0/2289928053 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6144+0+0 (secure 0 0 0) 0x7ff514085060 con 0x7ff51c153e80 2023-10-06T11:16:10.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.400+0000 7ff522541700 1 --2- 172.21.15.146:0/2289928053 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff500066f30 0x7ff5000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:10.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.400+0000 7ff522541700 1 --2- 172.21.15.146:0/2289928053 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff500066f30 0x7ff5000693e0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7ff518004d80 tx=0x7ff518001310 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:10.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.404+0000 7ff5127fc700 1 -- 172.21.15.146:0/2289928053 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff514052120 con 0x7ff51c153e80 2023-10-06T11:16:10.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.591+0000 7ff5247a5700 1 -- 172.21.15.146:0/2289928053 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff51c04c380 con 0x7ff51c153e80 2023-10-06T11:16:10.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.592+0000 7ff5127fc700 1 -- 172.21.15.146:0/2289928053 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+17059 (secure 0 0 0) 0x7ff514055740 con 0x7ff51c153e80 2023-10-06T11:16:10.594 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:16:10.594 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":126,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:16:00.403291+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:15:09.613367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-10-06T11:15:10.888669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6837/1974709597":"2023-10-07T11:16:00.403222+0000","172.21.15.146:6835/1974709597":"2023-10-07T11:16:00.403222+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:16:10.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.594+0000 7ff5247a5700 1 -- 172.21.15.146:0/2289928053 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff500066f30 msgr2=0x7ff5000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:10.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.594+0000 7ff5247a5700 1 --2- 172.21.15.146:0/2289928053 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff500066f30 0x7ff5000693e0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7ff518004d80 tx=0x7ff518001310 comp rx=0 tx=0).stop 2023-10-06T11:16:10.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.594+0000 7ff5247a5700 1 -- 172.21.15.146:0/2289928053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff51c153e80 msgr2=0x7ff51c169ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:10.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.594+0000 7ff5247a5700 1 --2- 172.21.15.146:0/2289928053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff51c153e80 0x7ff51c169ab0 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7ff51400c0f0 tx=0x7ff51400b040 comp rx=0 tx=0).stop 2023-10-06T11:16:10.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.594+0000 7ff5247a5700 1 -- 172.21.15.146:0/2289928053 shutdown_connections 2023-10-06T11:16:10.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.594+0000 7ff5247a5700 1 --2- 172.21.15.146:0/2289928053 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff500066f30 0x7ff5000693e0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:10.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.594+0000 7ff5247a5700 1 --2- 172.21.15.146:0/2289928053 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff51c153e80 0x7ff51c169ab0 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:10.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.594+0000 7ff5247a5700 1 --2- 172.21.15.146:0/2289928053 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff51c068ba0 0x7ff51c14b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:10.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.594+0000 7ff5247a5700 1 --2- 172.21.15.146:0/2289928053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff51c153ab0 0x7ff51c0b27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:10.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.594+0000 7ff5247a5700 1 -- 172.21.15.146:0/2289928053 >> 172.21.15.146:0/2289928053 conn(0x7ff51c06eba0 msgr2=0x7ff51c151f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:10.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.594+0000 7ff5247a5700 1 -- 172.21.15.146:0/2289928053 shutdown_connections 2023-10-06T11:16:10.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.595+0000 7ff5247a5700 1 -- 172.21.15.146:0/2289928053 wait complete. 2023-10-06T11:16:10.609 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T11:16:10.609 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:16:10.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.721+0000 7f723a38c700 1 Processor -- start 2023-10-06T11:16:10.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.721+0000 7f723a38c700 1 -- start start 2023-10-06T11:16:10.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.722+0000 7f723a38c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7234153ab0 0x7f723415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:10.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.722+0000 7f723a38c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7234153e80 0x7f7234068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:10.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.722+0000 7f723a38c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f72340689d0 0x7f723415d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:10.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.722+0000 7f723a38c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7234068e50 con 0x7f72340689d0 2023-10-06T11:16:10.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.722+0000 7f723a38c700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f723415ac30 con 0x7f7234153ab0 2023-10-06T11:16:10.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.722+0000 7f723a38c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72340b4510 con 0x7f7234153e80 2023-10-06T11:16:10.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.722+0000 7f7238929700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f72340689d0 0x7f723415d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:10.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.722+0000 7f7238929700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f72340689d0 0x7f723415d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36412/0 (socket says 172.21.15.146:36412) 2023-10-06T11:16:10.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.722+0000 7f7238929700 1 -- 172.21.15.146:0/1413248578 learned_addr learned my addr 172.21.15.146:0/1413248578 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:10.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.723+0000 7f7233fff700 1 --2- 172.21.15.146:0/1413248578 >> v2:172.21.15.151:3300/0 conn(0x7f7234153ab0 0x7f723415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:10.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.723+0000 7f72337fe700 1 --2- 172.21.15.146:0/1413248578 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7234153e80 0x7f7234068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:10.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.723+0000 7f7238929700 1 -- 172.21.15.146:0/1413248578 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7234153e80 msgr2=0x7f7234068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:10.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.723+0000 7f7238929700 1 --2- 172.21.15.146:0/1413248578 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7234153e80 0x7f7234068490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:10.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.723+0000 7f7238929700 1 -- 172.21.15.146:0/1413248578 >> v2:172.21.15.151:3300/0 conn(0x7f7234153ab0 msgr2=0x7f723415a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:10.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.723+0000 7f7238929700 1 --2- 172.21.15.146:0/1413248578 >> v2:172.21.15.151:3300/0 conn(0x7f7234153ab0 0x7f723415a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:10.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.723+0000 7f7238929700 1 -- 172.21.15.146:0/1413248578 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72340b6530 con 0x7f72340689d0 2023-10-06T11:16:10.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.723+0000 7f7238929700 1 --2- 172.21.15.146:0/1413248578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72340689d0 0x7f723415d270 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f72340b5eb0 tx=0x7f722c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=516f66878bac53cc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:10.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.723+0000 7f7232ffd700 1 -- 172.21.15.146:0/1413248578 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722c00e070 con 0x7f72340689d0 2023-10-06T11:16:10.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.723+0000 7f7232ffd700 1 -- 172.21.15.146:0/1413248578 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f722c00ba50 con 0x7f72340689d0 2023-10-06T11:16:10.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.723+0000 7f7232ffd700 1 -- 172.21.15.146:0/1413248578 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722c0092e0 con 0x7f72340689d0 2023-10-06T11:16:10.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.723+0000 7f723a38c700 1 -- 172.21.15.146:0/1413248578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72340689d0 msgr2=0x7f723415d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:10.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.723+0000 7f723a38c700 1 --2- 172.21.15.146:0/1413248578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72340689d0 0x7f723415d270 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f72340b5eb0 tx=0x7f722c009840 comp rx=0 tx=0).stop 2023-10-06T11:16:10.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.723+0000 7f723a38c700 1 -- 172.21.15.146:0/1413248578 shutdown_connections 2023-10-06T11:16:10.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.723+0000 7f723a38c700 1 --2- 172.21.15.146:0/1413248578 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f72340689d0 0x7f723415d270 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:10.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.723+0000 7f723a38c700 1 --2- 172.21.15.146:0/1413248578 >> v2:172.21.15.151:3300/0 conn(0x7f7234153ab0 0x7f723415a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:10.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.723+0000 7f723a38c700 1 --2- 172.21.15.146:0/1413248578 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7234153e80 0x7f7234068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:10.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.723+0000 7f723a38c700 1 -- 172.21.15.146:0/1413248578 >> 172.21.15.146:0/1413248578 conn(0x7f723406eba0 msgr2=0x7f723406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:10.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.723+0000 7f723a38c700 1 -- 172.21.15.146:0/1413248578 shutdown_connections 2023-10-06T11:16:10.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.724+0000 7f723a38c700 1 -- 172.21.15.146:0/1413248578 wait complete. 2023-10-06T11:16:10.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.724+0000 7f723a38c700 1 Processor -- start 2023-10-06T11:16:10.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.725+0000 7f723a38c700 1 -- start start 2023-10-06T11:16:10.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.725+0000 7f723a38c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f72340689d0 0x7f72340b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:10.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.725+0000 7f723a38c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7234153ab0 0x7f723414a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:10.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.725+0000 7f723a38c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7234153e80 0x7f723414b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:10.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.725+0000 7f723a38c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f723415aa30 con 0x7f7234153ab0 2023-10-06T11:16:10.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.725+0000 7f723a38c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f723414e7d0 con 0x7f72340689d0 2023-10-06T11:16:10.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.725+0000 7f723a38c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72340b1510 con 0x7f7234153e80 2023-10-06T11:16:10.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.726+0000 7f72337fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7234153ab0 0x7f723414a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:10.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.726+0000 7f72337fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7234153ab0 0x7f723414a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36414/0 (socket says 172.21.15.146:36414) 2023-10-06T11:16:10.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.726+0000 7f72337fe700 1 -- 172.21.15.146:0/3982608468 learned_addr learned my addr 172.21.15.146:0/3982608468 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:10.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.726+0000 7f7233fff700 1 --2- 172.21.15.146:0/3982608468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f72340689d0 0x7f72340b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:10.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.726+0000 7f7238929700 1 --2- 172.21.15.146:0/3982608468 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7234153e80 0x7f723414b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:10.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.726+0000 7f72337fe700 1 -- 172.21.15.146:0/3982608468 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7234153e80 msgr2=0x7f723414b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:10.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.726+0000 7f72337fe700 1 --2- 172.21.15.146:0/3982608468 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7234153e80 0x7f723414b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:10.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.726+0000 7f72337fe700 1 -- 172.21.15.146:0/3982608468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f72340689d0 msgr2=0x7f72340b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:10.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.726+0000 7f72337fe700 1 --2- 172.21.15.146:0/3982608468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f72340689d0 0x7f72340b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:10.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.726+0000 7f72337fe700 1 -- 172.21.15.146:0/3982608468 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f722c009ae0 con 0x7f7234153ab0 2023-10-06T11:16:10.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.726+0000 7f7238929700 1 --2- 172.21.15.146:0/3982608468 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7234153e80 0x7f723414b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:10.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.726+0000 7f72337fe700 1 --2- 172.21.15.146:0/3982608468 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7234153ab0 0x7f723414a0c0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f722800c880 tx=0x7f7228008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:10.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.726+0000 7f721bfff700 1 -- 172.21.15.146:0/3982608468 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f722800a2e0 con 0x7f7234153ab0 2023-10-06T11:16:10.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.726+0000 7f721bfff700 1 -- 172.21.15.146:0/3982608468 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7228011600 con 0x7f7234153ab0 2023-10-06T11:16:10.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.726+0000 7f721bfff700 1 -- 172.21.15.146:0/3982608468 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72280119c0 con 0x7f7234153ab0 2023-10-06T11:16:10.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.726+0000 7f723a38c700 1 -- 172.21.15.146:0/3982608468 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7234159eb0 con 0x7f7234153ab0 2023-10-06T11:16:10.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.726+0000 7f723a38c700 1 -- 172.21.15.146:0/3982608468 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f723415a470 con 0x7f7234153ab0 2023-10-06T11:16:10.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.727+0000 7f723a38c700 1 -- 172.21.15.146:0/3982608468 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f723404c380 con 0x7f7234153ab0 2023-10-06T11:16:10.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.727+0000 7f721bfff700 1 -- 172.21.15.146:0/3982608468 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f72280193f0 con 0x7f7234153ab0 2023-10-06T11:16:10.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.728+0000 7f721bfff700 1 --2- 172.21.15.146:0/3982608468 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7220066f30 0x7f72200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:10.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.728+0000 7f721bfff700 1 -- 172.21.15.146:0/3982608468 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f72280849b0 con 0x7f7234153ab0 2023-10-06T11:16:10.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.728+0000 7f7233fff700 1 --2- 172.21.15.146:0/3982608468 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7220066f30 0x7f72200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:10.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.728+0000 7f7233fff700 1 --2- 172.21.15.146:0/3982608468 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7220066f30 0x7f72200693e0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f722400acb0 tx=0x7f7224008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:10.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.732+0000 7f721bfff700 1 -- 172.21.15.146:0/3982608468 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7228051a70 con 0x7f7234153ab0 2023-10-06T11:16:10.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.958+0000 7f723a38c700 1 -- 172.21.15.146:0/3982608468 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f72340b5c50 con 0x7f7234153ab0 2023-10-06T11:16:10.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.958+0000 7f721bfff700 1 -- 172.21.15.146:0/3982608468 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) v1 ==== 95+0+3859 (secure 0 0 0) 0x7f7228055090 con 0x7f7234153ab0 2023-10-06T11:16:10.960 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:16:10.961 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":112,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7792,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3693464886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3693464886},{"type":"v1","addr":"172.21.15.151:6834","nonce":3693464886}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103},{"gid":7795,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1155762565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":1155762565},{"type":"v1","addr":"172.21.15.151:6835","nonce":1155762565}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:15:11.929158+0000","modified":"2023-10-06T11:16:03.435307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":126,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8679":{"gid":8679,"name":"a","rank":0,"incarnation":109,"state":"up:active","state_seq":17,"addr":"172.21.15.146:6836/3868720724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3868720724},{"type":"v1","addr":"172.21.15.146:6836","nonce":3868720724}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-06T11:16:10.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.960+0000 7f723a38c700 1 -- 172.21.15.146:0/3982608468 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7220066f30 msgr2=0x7f72200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:10.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.960+0000 7f723a38c700 1 --2- 172.21.15.146:0/3982608468 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7220066f30 0x7f72200693e0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f722400acb0 tx=0x7f7224008040 comp rx=0 tx=0).stop 2023-10-06T11:16:10.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.960+0000 7f723a38c700 1 -- 172.21.15.146:0/3982608468 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7234153ab0 msgr2=0x7f723414a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:10.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.960+0000 7f723a38c700 1 --2- 172.21.15.146:0/3982608468 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7234153ab0 0x7f723414a0c0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f722800c880 tx=0x7f7228008040 comp rx=0 tx=0).stop 2023-10-06T11:16:10.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.960+0000 7f723a38c700 1 -- 172.21.15.146:0/3982608468 shutdown_connections 2023-10-06T11:16:10.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.960+0000 7f723a38c700 1 --2- 172.21.15.146:0/3982608468 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7220066f30 0x7f72200693e0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:10.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.960+0000 7f723a38c700 1 --2- 172.21.15.146:0/3982608468 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7234153e80 0x7f723414b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:10.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.960+0000 7f723a38c700 1 --2- 172.21.15.146:0/3982608468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f72340689d0 0x7f72340b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:10.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.960+0000 7f723a38c700 1 --2- 172.21.15.146:0/3982608468 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7234153ab0 0x7f723414a0c0 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:10.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.960+0000 7f723a38c700 1 -- 172.21.15.146:0/3982608468 >> 172.21.15.146:0/3982608468 conn(0x7f723406eba0 msgr2=0x7f723415c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:10.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.960+0000 7f723a38c700 1 -- 172.21.15.146:0/3982608468 shutdown_connections 2023-10-06T11:16:10.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:10.960+0000 7f723a38c700 1 -- 172.21.15.146:0/3982608468 wait complete. 2023-10-06T11:16:10.964 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 112 2023-10-06T11:16:10.974 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:16:11.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.087+0000 7f49a3b95700 1 Processor -- start 2023-10-06T11:16:11.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.088+0000 7f49a3b95700 1 -- start start 2023-10-06T11:16:11.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.088+0000 7f49a3b95700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f499c0b28e0 0x7f499c0c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:11.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.088+0000 7f49a3b95700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f499c0c53f0 0x7f499c0cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:11.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.088+0000 7f49a3b95700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f499c0ad2a0 con 0x7f499c0b2cb0 2023-10-06T11:16:11.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.088+0000 7f49a3b95700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f499c099ec0 con 0x7f499c0b28e0 2023-10-06T11:16:11.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.088+0000 7f49a3b95700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f499c0c7240 con 0x7f499c0c53f0 2023-10-06T11:16:11.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.089+0000 7f49a1931700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f499c0b28e0 0x7f499c0c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:11.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.089+0000 7f49a2132700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f499c0b2cb0 0x7f499c15d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:42622/0 (socket says 172.21.15.146:42622) 2023-10-06T11:16:11.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.089+0000 7f49a2132700 1 -- 172.21.15.146:0/575120925 learned_addr learned my addr 172.21.15.146:0/575120925 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:16:11.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.089+0000 7f49a1130700 1 --2- 172.21.15.146:0/575120925 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f499c0c53f0 0x7f499c0cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:11.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.089+0000 7f49a1931700 1 -- 172.21.15.146:0/575120925 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f499c0c53f0 msgr2=0x7f499c0cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:11.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.089+0000 7f49a1931700 1 --2- 172.21.15.146:0/575120925 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f499c0c53f0 0x7f499c0cebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:11.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.089+0000 7f49a1931700 1 -- 172.21.15.146:0/575120925 >> v1:172.21.15.146:6789/0 conn(0x7f499c0b2cb0 legacy=0x7f499c15d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:11.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.089+0000 7f49a1931700 1 -- 172.21.15.146:0/575120925 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f499c0c69a0 con 0x7f499c0b28e0 2023-10-06T11:16:11.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.089+0000 7f49a092f700 1 -- 172.21.15.146:0/575120925 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 506904919 0 0) 0x7f499c0ad2a0 con 0x7f499c0b2cb0 2023-10-06T11:16:11.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.089+0000 7f49a1931700 1 --2- 172.21.15.146:0/575120925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f499c0b28e0 0x7f499c0c6310 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f49980098d0 tx=0x7f4998009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79b69b8aa062dc46 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:11.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.089+0000 7f49a092f700 1 -- 172.21.15.146:0/575120925 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4998009e70 con 0x7f499c0b28e0 2023-10-06T11:16:11.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.089+0000 7f49a092f700 1 -- 172.21.15.146:0/575120925 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4998005c10 con 0x7f499c0b28e0 2023-10-06T11:16:11.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.089+0000 7f49a092f700 1 -- 172.21.15.146:0/575120925 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499800b6e0 con 0x7f499c0b28e0 2023-10-06T11:16:11.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.090+0000 7f49a3b95700 1 -- 172.21.15.146:0/575120925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f499c0b28e0 msgr2=0x7f499c0c6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:11.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.090+0000 7f49a3b95700 1 --2- 172.21.15.146:0/575120925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f499c0b28e0 0x7f499c0c6310 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f49980098d0 tx=0x7f4998009120 comp rx=0 tx=0).stop 2023-10-06T11:16:11.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.090+0000 7f49a3b95700 1 -- 172.21.15.146:0/575120925 shutdown_connections 2023-10-06T11:16:11.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.090+0000 7f49a3b95700 1 --2- 172.21.15.146:0/575120925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f499c0b28e0 0x7f499c0c6310 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:11.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.090+0000 7f49a3b95700 1 --2- 172.21.15.146:0/575120925 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f499c0c53f0 0x7f499c0cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:11.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.090+0000 7f49a3b95700 1 -- 172.21.15.146:0/575120925 >> 172.21.15.146:0/575120925 conn(0x7f499c0999a0 msgr2=0x7f499c06f380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:11.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.090+0000 7f49a3b95700 1 -- 172.21.15.146:0/575120925 shutdown_connections 2023-10-06T11:16:11.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.090+0000 7f49a3b95700 1 -- 172.21.15.146:0/575120925 wait complete. 2023-10-06T11:16:11.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.091+0000 7f49a3b95700 1 Processor -- start 2023-10-06T11:16:11.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.091+0000 7f49a3b95700 1 -- start start 2023-10-06T11:16:11.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.092+0000 7f49a3b95700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f499c0b28e0 0x7f499c1554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:11.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.092+0000 7f49a3b95700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f499c0b2cb0 0x7f499c0c9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:11.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.092+0000 7f49a3b95700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f499c0c53f0 0x7f499c0b5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:11.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.092+0000 7f49a3b95700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499c0c8860 con 0x7f499c0b2cb0 2023-10-06T11:16:11.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.092+0000 7f49a3b95700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499c0c7c50 con 0x7f499c0c53f0 2023-10-06T11:16:11.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.092+0000 7f49a3b95700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f499c0c7f30 con 0x7f499c0b28e0 2023-10-06T11:16:11.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.092+0000 7f49a1130700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f499c0b2cb0 0x7f499c0c9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:11.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.092+0000 7f49a1130700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f499c0b2cb0 0x7f499c0c9820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36430/0 (socket says 172.21.15.146:36430) 2023-10-06T11:16:11.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.092+0000 7f49a1130700 1 -- 172.21.15.146:0/696901183 learned_addr learned my addr 172.21.15.146:0/696901183 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:11.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.092+0000 7f49a1931700 1 --2- 172.21.15.146:0/696901183 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f499c0b28e0 0x7f499c1554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:11.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.092+0000 7f49a2132700 1 --2- 172.21.15.146:0/696901183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f499c0c53f0 0x7f499c0b5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:11.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.092+0000 7f49a1130700 1 -- 172.21.15.146:0/696901183 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f499c0b28e0 msgr2=0x7f499c1554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:11.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.092+0000 7f49a1130700 1 --2- 172.21.15.146:0/696901183 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f499c0b28e0 0x7f499c1554c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:11.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.092+0000 7f49a1130700 1 -- 172.21.15.146:0/696901183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f499c0c53f0 msgr2=0x7f499c0b5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:11.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.092+0000 7f49a1130700 1 --2- 172.21.15.146:0/696901183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f499c0c53f0 0x7f499c0b5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:11.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.092+0000 7f49a1130700 1 -- 172.21.15.146:0/696901183 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49980093c0 con 0x7f499c0b2cb0 2023-10-06T11:16:11.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.092+0000 7f49a2132700 1 --2- 172.21.15.146:0/696901183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f499c0c53f0 0x7f499c0b5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:11.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.092+0000 7f49a1130700 1 --2- 172.21.15.146:0/696901183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f499c0b2cb0 0x7f499c0c9820 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f498c00d860 tx=0x7f498c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:11.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.092+0000 7f4991ffb700 1 -- 172.21.15.146:0/696901183 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c009610 con 0x7f499c0b2cb0 2023-10-06T11:16:11.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.092+0000 7f4991ffb700 1 -- 172.21.15.146:0/696901183 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f498c009770 con 0x7f499c0b2cb0 2023-10-06T11:16:11.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.092+0000 7f4991ffb700 1 -- 172.21.15.146:0/696901183 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c009b30 con 0x7f499c0b2cb0 2023-10-06T11:16:11.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.092+0000 7f49a3b95700 1 -- 172.21.15.146:0/696901183 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f499c0c8210 con 0x7f499c0b2cb0 2023-10-06T11:16:11.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.092+0000 7f49a3b95700 1 -- 172.21.15.146:0/696901183 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f499c155a00 con 0x7f499c0b2cb0 2023-10-06T11:16:11.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.093+0000 7f49a3b95700 1 -- 172.21.15.146:0/696901183 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f499c0c89a0 con 0x7f499c0b2cb0 2023-10-06T11:16:11.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.094+0000 7f4991ffb700 1 -- 172.21.15.146:0/696901183 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f498c01e460 con 0x7f499c0b2cb0 2023-10-06T11:16:11.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.094+0000 7f4991ffb700 1 --2- 172.21.15.146:0/696901183 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4980066f30 0x7f49800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:11.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.094+0000 7f4991ffb700 1 -- 172.21.15.146:0/696901183 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f498c084d50 con 0x7f499c0b2cb0 2023-10-06T11:16:11.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.094+0000 7f49a1931700 1 --2- 172.21.15.146:0/696901183 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4980066f30 0x7f49800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:11.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.094+0000 7f49a1931700 1 --2- 172.21.15.146:0/696901183 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4980066f30 0x7f49800693e0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f4998009160 tx=0x7f4998016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:11.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.098+0000 7f4991ffb700 1 -- 172.21.15.146:0/696901183 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f499c0c89a0 con 0x7f499c0b2cb0 2023-10-06T11:16:11.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.324+0000 7f49a3b95700 1 -- 172.21.15.146:0/696901183 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f499c0c89a0 con 0x7f499c0b2cb0 2023-10-06T11:16:11.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.325+0000 7f4991ffb700 1 -- 172.21.15.146:0/696901183 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) v1 ==== 95+0+3859 (secure 0 0 0) 0x7f499c0c89a0 con 0x7f499c0b2cb0 2023-10-06T11:16:11.327 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:16:11.327 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":112,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7792,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3693464886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3693464886},{"type":"v1","addr":"172.21.15.151:6834","nonce":3693464886}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103},{"gid":7795,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1155762565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":1155762565},{"type":"v1","addr":"172.21.15.151:6835","nonce":1155762565}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:15:11.929158+0000","modified":"2023-10-06T11:16:03.435307+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":126,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8679":{"gid":8679,"name":"a","rank":0,"incarnation":109,"state":"up:active","state_seq":17,"addr":"172.21.15.146:6836/3868720724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3868720724},{"type":"v1","addr":"172.21.15.146:6836","nonce":3868720724}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-06T11:16:11.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.327+0000 7f49a3b95700 1 -- 172.21.15.146:0/696901183 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4980066f30 msgr2=0x7f49800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:11.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.327+0000 7f49a3b95700 1 --2- 172.21.15.146:0/696901183 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4980066f30 0x7f49800693e0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f4998009160 tx=0x7f4998016000 comp rx=0 tx=0).stop 2023-10-06T11:16:11.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.327+0000 7f49a3b95700 1 -- 172.21.15.146:0/696901183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f499c0b2cb0 msgr2=0x7f499c0c9820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:11.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.327+0000 7f49a3b95700 1 --2- 172.21.15.146:0/696901183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f499c0b2cb0 0x7f499c0c9820 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f498c00d860 tx=0x7f498c008040 comp rx=0 tx=0).stop 2023-10-06T11:16:11.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.327+0000 7f49a3b95700 1 -- 172.21.15.146:0/696901183 shutdown_connections 2023-10-06T11:16:11.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.327+0000 7f49a3b95700 1 --2- 172.21.15.146:0/696901183 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4980066f30 0x7f49800693e0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:11.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.327+0000 7f49a3b95700 1 --2- 172.21.15.146:0/696901183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f499c0c53f0 0x7f499c0b5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:11.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.327+0000 7f49a3b95700 1 --2- 172.21.15.146:0/696901183 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f499c0b28e0 0x7f499c1554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:11.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.327+0000 7f49a3b95700 1 --2- 172.21.15.146:0/696901183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f499c0b2cb0 0x7f499c0c9820 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:11.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.327+0000 7f49a3b95700 1 -- 172.21.15.146:0/696901183 >> 172.21.15.146:0/696901183 conn(0x7f499c0999a0 msgr2=0x7f499c0d0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:11.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.327+0000 7f49a3b95700 1 -- 172.21.15.146:0/696901183 shutdown_connections 2023-10-06T11:16:11.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.328+0000 7f49a3b95700 1 -- 172.21.15.146:0/696901183 wait complete. 2023-10-06T11:16:11.331 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 112 2023-10-06T11:16:11.341 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:16:11.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.459+0000 7fe41dbe5700 1 Processor -- start 2023-10-06T11:16:11.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.459+0000 7fe41dbe5700 1 -- start start 2023-10-06T11:16:11.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.460+0000 7fe41dbe5700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe418153ab0 0x7fe41815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:11.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.460+0000 7fe41dbe5700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe41815ac30 con 0x7fe418153e80 2023-10-06T11:16:11.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.460+0000 7fe41dbe5700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4180b4510 con 0x7fe418068ba0 2023-10-06T11:16:11.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.460+0000 7fe41dbe5700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4180b6530 con 0x7fe418153ab0 2023-10-06T11:16:11.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.460+0000 7fe416ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe418153e80 0x7fe418068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35126/0 (socket says 172.21.15.146:35126) 2023-10-06T11:16:11.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.460+0000 7fe416ffd700 1 -- 172.21.15.146:0/2948389770 learned_addr learned my addr 172.21.15.146:0/2948389770 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:16:11.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.460+0000 7fe4177fe700 1 --2- 172.21.15.146:0/2948389770 >> v2:172.21.15.151:3300/0 conn(0x7fe418153ab0 0x7fe41815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:11.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.460+0000 7fe4177fe700 1 -- 172.21.15.146:0/2948389770 >> v1:172.21.15.151:6789/0 conn(0x7fe418068ba0 legacy=0x7fe4180b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:11.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.460+0000 7fe4177fe700 1 -- 172.21.15.146:0/2948389770 >> v1:172.21.15.146:6789/0 conn(0x7fe418153e80 legacy=0x7fe418068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:11.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.460+0000 7fe4177fe700 1 -- 172.21.15.146:0/2948389770 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4180b5c50 con 0x7fe418153ab0 2023-10-06T11:16:11.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.460+0000 7fe4177fe700 1 --2- 172.21.15.146:0/2948389770 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe418153ab0 0x7fe41815a6f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe4080098e0 tx=0x7fe4080091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72449d08243239c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:11.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.462+0000 7fe4167fc700 1 -- 172.21.15.146:0/2948389770 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe408009e80 con 0x7fe418153ab0 2023-10-06T11:16:11.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.462+0000 7fe4167fc700 1 -- 172.21.15.146:0/2948389770 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40800b860 con 0x7fe418153ab0 2023-10-06T11:16:11.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.462+0000 7fe4167fc700 1 -- 172.21.15.146:0/2948389770 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40800bbe0 con 0x7fe418153ab0 2023-10-06T11:16:11.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.463+0000 7fe41dbe5700 1 -- 172.21.15.146:0/2948389770 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe418153ab0 msgr2=0x7fe41815a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:11.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.463+0000 7fe41dbe5700 1 --2- 172.21.15.146:0/2948389770 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe418153ab0 0x7fe41815a6f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe4080098e0 tx=0x7fe4080091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:11.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.463+0000 7fe41dbe5700 1 -- 172.21.15.146:0/2948389770 shutdown_connections 2023-10-06T11:16:11.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.463+0000 7fe41dbe5700 1 --2- 172.21.15.146:0/2948389770 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe418153ab0 0x7fe41815a6f0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:11.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.463+0000 7fe41dbe5700 1 -- 172.21.15.146:0/2948389770 >> 172.21.15.146:0/2948389770 conn(0x7fe41806eba0 msgr2=0x7fe41806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:11.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.463+0000 7fe41dbe5700 1 -- 172.21.15.146:0/2948389770 shutdown_connections 2023-10-06T11:16:11.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.463+0000 7fe41dbe5700 1 -- 172.21.15.146:0/2948389770 wait complete. 2023-10-06T11:16:11.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.464+0000 7fe41dbe5700 1 Processor -- start 2023-10-06T11:16:11.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.464+0000 7fe41dbe5700 1 -- start start 2023-10-06T11:16:11.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.465+0000 7fe41dbe5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe418068ba0 0x7fe418156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:11.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.465+0000 7fe41dbe5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe418153ab0 0x7fe4180cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:11.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.465+0000 7fe41dbe5700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe418153e80 0x7fe4180d0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:11.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.465+0000 7fe41dbe5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41816a0c0 con 0x7fe418068ba0 2023-10-06T11:16:11.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.465+0000 7fe41dbe5700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe418157530 con 0x7fe418153ab0 2023-10-06T11:16:11.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.465+0000 7fe41dbe5700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe418157810 con 0x7fe418153e80 2023-10-06T11:16:11.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.465+0000 7fe4177fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe418068ba0 0x7fe418156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:11.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.465+0000 7fe4177fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe418068ba0 0x7fe418156bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51228/0 (socket says 172.21.15.146:51228) 2023-10-06T11:16:11.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.465+0000 7fe4177fe700 1 -- 172.21.15.146:0/4249653879 learned_addr learned my addr 172.21.15.146:0/4249653879 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:11.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.465+0000 7fe416ffd700 1 --2- 172.21.15.146:0/4249653879 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe418153ab0 0x7fe4180cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:11.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.465+0000 7fe417fff700 1 --2- 172.21.15.146:0/4249653879 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe418153e80 0x7fe4180d0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:11.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.466+0000 7fe4177fe700 1 -- 172.21.15.146:0/4249653879 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe418153e80 msgr2=0x7fe4180d0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:11.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.466+0000 7fe4177fe700 1 --2- 172.21.15.146:0/4249653879 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe418153e80 0x7fe4180d0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:11.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.466+0000 7fe4177fe700 1 -- 172.21.15.146:0/4249653879 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe418153ab0 msgr2=0x7fe4180cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:11.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.466+0000 7fe4177fe700 1 --2- 172.21.15.146:0/4249653879 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe418153ab0 0x7fe4180cbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:11.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.466+0000 7fe4177fe700 1 -- 172.21.15.146:0/4249653879 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe408009420 con 0x7fe418068ba0 2023-10-06T11:16:11.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.466+0000 7fe417fff700 1 --2- 172.21.15.146:0/4249653879 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe418153e80 0x7fe4180d0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:11.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.466+0000 7fe4177fe700 1 --2- 172.21.15.146:0/4249653879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe418068ba0 0x7fe418156bc0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7fe418089010 tx=0x7fe408017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:11.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.466+0000 7fe3ff7fe700 1 -- 172.21.15.146:0/4249653879 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40800baa0 con 0x7fe418068ba0 2023-10-06T11:16:11.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.466+0000 7fe3ff7fe700 1 -- 172.21.15.146:0/4249653879 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe408025420 con 0x7fe418068ba0 2023-10-06T11:16:11.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.466+0000 7fe41dbe5700 1 -- 172.21.15.146:0/4249653879 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe418157af0 con 0x7fe418068ba0 2023-10-06T11:16:11.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.466+0000 7fe3ff7fe700 1 -- 172.21.15.146:0/4249653879 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4080257c0 con 0x7fe418068ba0 2023-10-06T11:16:11.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.466+0000 7fe41dbe5700 1 -- 172.21.15.146:0/4249653879 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe418157180 con 0x7fe418068ba0 2023-10-06T11:16:11.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.467+0000 7fe41dbe5700 1 -- 172.21.15.146:0/4249653879 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe41816a5c0 con 0x7fe418068ba0 2023-10-06T11:16:11.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.467+0000 7fe3ff7fe700 1 -- 172.21.15.146:0/4249653879 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe408023070 con 0x7fe418068ba0 2023-10-06T11:16:11.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.468+0000 7fe3ff7fe700 1 --2- 172.21.15.146:0/4249653879 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe404066f30 0x7fe4040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:11.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.468+0000 7fe416ffd700 1 --2- 172.21.15.146:0/4249653879 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe404066f30 0x7fe4040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:11.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.468+0000 7fe3ff7fe700 1 -- 172.21.15.146:0/4249653879 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fe408085e00 con 0x7fe418068ba0 2023-10-06T11:16:11.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.468+0000 7fe416ffd700 1 --2- 172.21.15.146:0/4249653879 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe404066f30 0x7fe4040693e0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fe418157ff0 tx=0x7fe40c007eb0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:11.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.472+0000 7fe3ff7fe700 1 -- 172.21.15.146:0/4249653879 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe41816a5c0 con 0x7fe418068ba0 2023-10-06T11:16:11.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.659+0000 7fe41dbe5700 1 -- 172.21.15.146:0/4249653879 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe41816a5c0 con 0x7fe418068ba0 2023-10-06T11:16:11.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.660+0000 7fe3ff7fe700 1 -- 172.21.15.146:0/4249653879 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) v1 ==== 74+0+17059 (secure 0 0 0) 0x7fe41816a5c0 con 0x7fe418068ba0 2023-10-06T11:16:11.662 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:16:11.662 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":126,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:16:00.403291+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:15:09.613367+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2023-10-06T11:15:10.888669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"125","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6837/1974709597":"2023-10-07T11:16:00.403222+0000","172.21.15.146:6835/1974709597":"2023-10-07T11:16:00.403222+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:16:11.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.662+0000 7fe41dbe5700 1 -- 172.21.15.146:0/4249653879 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe404066f30 msgr2=0x7fe4040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:11.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.662+0000 7fe41dbe5700 1 --2- 172.21.15.146:0/4249653879 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe404066f30 0x7fe4040693e0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fe418157ff0 tx=0x7fe40c007eb0 comp rx=0 tx=0).stop 2023-10-06T11:16:11.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.662+0000 7fe41dbe5700 1 -- 172.21.15.146:0/4249653879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe418068ba0 msgr2=0x7fe418156bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:11.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.662+0000 7fe41dbe5700 1 --2- 172.21.15.146:0/4249653879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe418068ba0 0x7fe418156bc0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7fe418089010 tx=0x7fe408017000 comp rx=0 tx=0).stop 2023-10-06T11:16:11.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.662+0000 7fe41dbe5700 1 -- 172.21.15.146:0/4249653879 shutdown_connections 2023-10-06T11:16:11.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.662+0000 7fe41dbe5700 1 --2- 172.21.15.146:0/4249653879 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe404066f30 0x7fe4040693e0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:11.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.662+0000 7fe41dbe5700 1 --2- 172.21.15.146:0/4249653879 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe418153e80 0x7fe4180d0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:11.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.662+0000 7fe41dbe5700 1 --2- 172.21.15.146:0/4249653879 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe418068ba0 0x7fe418156bc0 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:11.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.662+0000 7fe41dbe5700 1 --2- 172.21.15.146:0/4249653879 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe418153ab0 0x7fe4180cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:11.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.662+0000 7fe41dbe5700 1 -- 172.21.15.146:0/4249653879 >> 172.21.15.146:0/4249653879 conn(0x7fe41806eba0 msgr2=0x7fe41815c180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:11.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.662+0000 7fe41dbe5700 1 -- 172.21.15.146:0/4249653879 shutdown_connections 2023-10-06T11:16:11.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.662+0000 7fe41dbe5700 1 -- 172.21.15.146:0/4249653879 wait complete. 2023-10-06T11:16:11.677 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T11:16:11.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.792+0000 7f4f448bc700 1 Processor -- start 2023-10-06T11:16:11.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.792+0000 7f4f448bc700 1 -- start start 2023-10-06T11:16:11.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.793+0000 7f4f448bc700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f4015a160 0x7f4f400c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:11.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.793+0000 7f4f448bc700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f400ae2a0 con 0x7f4f400ae730 2023-10-06T11:16:11.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.793+0000 7f4f448bc700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f4015a530 con 0x7f4f400cb950 2023-10-06T11:16:11.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.793+0000 7f4f448bc700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f400ad690 con 0x7f4f4015a160 2023-10-06T11:16:11.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.793+0000 7f4f35d9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4f400ae730 0x7f4f400aeb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35138/0 (socket says 172.21.15.146:35138) 2023-10-06T11:16:11.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.793+0000 7f4f35d9b700 1 -- 172.21.15.146:0/3477694828 learned_addr learned my addr 172.21.15.146:0/3477694828 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:16:11.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.793+0000 7f4f3e59c700 1 --2- 172.21.15.146:0/3477694828 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f4015a160 0x7f4f400c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:11.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.793+0000 7f4f3dd9b700 1 -- 172.21.15.146:0/3477694828 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 174083839 0 0) 0x7f4f400ae2a0 con 0x7f4f400ae730 2023-10-06T11:16:11.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.793+0000 7f4f3dd9b700 1 -- 172.21.15.146:0/3477694828 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f2c003570 con 0x7f4f400ae730 2023-10-06T11:16:11.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.794+0000 7f4f3dd9b700 1 -- 172.21.15.146:0/3477694828 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 537471462 0 0) 0x7f4f2c003570 con 0x7f4f400ae730 2023-10-06T11:16:11.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.794+0000 7f4f3dd9b700 1 -- 172.21.15.146:0/3477694828 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f4015a160 msgr2=0x7f4f400c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:11.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.794+0000 7f4f3dd9b700 1 --2- 172.21.15.146:0/3477694828 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f4015a160 0x7f4f400c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:11.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.794+0000 7f4f3dd9b700 1 -- 172.21.15.146:0/3477694828 >> v1:172.21.15.151:6789/0 conn(0x7f4f400cb950 legacy=0x7f4f400cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:11.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.794+0000 7f4f3dd9b700 1 -- 172.21.15.146:0/3477694828 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f400ad970 con 0x7f4f400ae730 2023-10-06T11:16:11.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.794+0000 7f4f3dd9b700 1 -- 172.21.15.146:0/3477694828 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f4f28001470 con 0x7f4f400ae730 2023-10-06T11:16:11.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.794+0000 7f4f3dd9b700 1 -- 172.21.15.146:0/3477694828 >> v1:172.21.15.146:6789/0 conn(0x7f4f400ae730 legacy=0x7f4f400aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:11.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.794+0000 7f4f3dd9b700 1 --2- 172.21.15.146:0/3477694828 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f4015a160 0x7f4f2c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:11.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.794+0000 7f4f3dd9b700 1 --2- 172.21.15.146:0/3477694828 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f2c003fd0 0x7f4f2c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:11.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.794+0000 7f4f3dd9b700 1 --2- 172.21.15.146:0/3477694828 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f2c004d50 0x7f4f2c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:11.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.794+0000 7f4f3dd9b700 1 -- 172.21.15.146:0/3477694828 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f400ad690 con 0x7f4f2c003fd0 2023-10-06T11:16:11.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.794+0000 7f4f3dd9b700 1 -- 172.21.15.146:0/3477694828 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c00bb40 con 0x7f4f2c004d50 2023-10-06T11:16:11.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.794+0000 7f4f3dd9b700 1 -- 172.21.15.146:0/3477694828 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c00bd00 con 0x7f4f4015a160 2023-10-06T11:16:11.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.794+0000 7f4f35d9b700 1 --2- 172.21.15.146:0/3477694828 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f2c003fd0 0x7f4f2c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:11.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.794+0000 7f4f3e59c700 1 --2- 172.21.15.146:0/3477694828 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f4015a160 0x7f4f2c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:11.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.794+0000 7f4f3ed9d700 1 --2- 172.21.15.146:0/3477694828 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f2c004d50 0x7f4f2c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:11.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.794+0000 7f4f35d9b700 1 -- 172.21.15.146:0/3477694828 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f4015a160 msgr2=0x7f4f2c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:11.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.794+0000 7f4f35d9b700 1 --2- 172.21.15.146:0/3477694828 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f4015a160 0x7f4f2c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:11.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.794+0000 7f4f35d9b700 1 -- 172.21.15.146:0/3477694828 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f2c004d50 msgr2=0x7f4f2c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:11.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.794+0000 7f4f35d9b700 1 --2- 172.21.15.146:0/3477694828 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f2c004d50 0x7f4f2c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:11.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.794+0000 7f4f35d9b700 1 -- 172.21.15.146:0/3477694828 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f2c003570 con 0x7f4f2c003fd0 2023-10-06T11:16:11.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.794+0000 7f4f3ed9d700 1 --2- 172.21.15.146:0/3477694828 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f2c004d50 0x7f4f2c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:11.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.794+0000 7f4f35d9b700 1 --2- 172.21.15.146:0/3477694828 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f2c003fd0 0x7f4f2c004810 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f4f2800c3c0 tx=0x7f4f28001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=affcfd5a54c94d5f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:11.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.794+0000 7f4f3dd9b700 1 -- 172.21.15.146:0/3477694828 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2800cc90 con 0x7f4f2c003fd0 2023-10-06T11:16:11.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.794+0000 7f4f3dd9b700 1 -- 172.21.15.146:0/3477694828 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2800cdf0 con 0x7f4f2c003fd0 2023-10-06T11:16:11.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.794+0000 7f4f3dd9b700 1 -- 172.21.15.146:0/3477694828 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f28005b70 con 0x7f4f2c003fd0 2023-10-06T11:16:11.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.795+0000 7f4f448bc700 1 -- 172.21.15.146:0/3477694828 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f2c003fd0 msgr2=0x7f4f2c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:11.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.795+0000 7f4f448bc700 1 --2- 172.21.15.146:0/3477694828 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f2c003fd0 0x7f4f2c004810 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f4f2800c3c0 tx=0x7f4f28001e70 comp rx=0 tx=0).stop 2023-10-06T11:16:11.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.795+0000 7f4f3ed9d700 1 -- 172.21.15.146:0/3477694828 reap_dead start 2023-10-06T11:16:11.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.795+0000 7f4f448bc700 1 -- 172.21.15.146:0/3477694828 shutdown_connections 2023-10-06T11:16:11.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.795+0000 7f4f448bc700 1 -- 172.21.15.146:0/3477694828 >> 172.21.15.146:0/3477694828 conn(0x7f4f4006f380 msgr2=0x7f4f400d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:11.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.795+0000 7f4f448bc700 1 -- 172.21.15.146:0/3477694828 shutdown_connections 2023-10-06T11:16:11.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.795+0000 7f4f448bc700 1 -- 172.21.15.146:0/3477694828 wait complete. 2023-10-06T11:16:11.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.796+0000 7f4f448bc700 1 Processor -- start 2023-10-06T11:16:11.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.796+0000 7f4f448bc700 1 -- start start 2023-10-06T11:16:11.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.797+0000 7f4f448bc700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f2c003fd0 0x7f4f4015f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:11.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.797+0000 7f4f448bc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f401577c0 0x7f4f4009dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:11.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.797+0000 7f4f448bc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f400cf1c0 0x7f4f400cf630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:11.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.797+0000 7f4f448bc700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4009e450 con 0x7f4f401577c0 2023-10-06T11:16:11.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.797+0000 7f4f448bc700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f400cfb70 con 0x7f4f400cf1c0 2023-10-06T11:16:11.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.797+0000 7f4f448bc700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f40157c30 con 0x7f4f2c003fd0 2023-10-06T11:16:11.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.797+0000 7f4f35d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f401577c0 0x7f4f4009dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:11.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.797+0000 7f4f35d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f401577c0 0x7f4f4009dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51250/0 (socket says 172.21.15.146:51250) 2023-10-06T11:16:11.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.797+0000 7f4f35d9b700 1 -- 172.21.15.146:0/4213573560 learned_addr learned my addr 172.21.15.146:0/4213573560 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:11.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.797+0000 7f4f3e59c700 1 --2- 172.21.15.146:0/4213573560 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f2c003fd0 0x7f4f4015f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:11.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.797+0000 7f4f3ed9d700 1 --2- 172.21.15.146:0/4213573560 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f400cf1c0 0x7f4f400cf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:11.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.797+0000 7f4f35d9b700 1 -- 172.21.15.146:0/4213573560 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f2c003fd0 msgr2=0x7f4f4015f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:11.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.797+0000 7f4f35d9b700 1 --2- 172.21.15.146:0/4213573560 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f2c003fd0 0x7f4f4015f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:11.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.797+0000 7f4f35d9b700 1 -- 172.21.15.146:0/4213573560 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f400cf1c0 msgr2=0x7f4f400cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:11.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.797+0000 7f4f35d9b700 1 --2- 172.21.15.146:0/4213573560 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f400cf1c0 0x7f4f400cf630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:11.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.797+0000 7f4f35d9b700 1 -- 172.21.15.146:0/4213573560 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f4009e1b0 con 0x7f4f401577c0 2023-10-06T11:16:11.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.797+0000 7f4f35d9b700 1 --2- 172.21.15.146:0/4213573560 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f401577c0 0x7f4f4009dc70 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f4f2800c9b0 tx=0x7f4f28015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:11.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.798+0000 7f4f36ffd700 1 -- 172.21.15.146:0/4213573560 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2800cc90 con 0x7f4f401577c0 2023-10-06T11:16:11.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.798+0000 7f4f36ffd700 1 -- 172.21.15.146:0/4213573560 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f280072e0 con 0x7f4f401577c0 2023-10-06T11:16:11.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.798+0000 7f4f448bc700 1 -- 172.21.15.146:0/4213573560 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f400b41b0 con 0x7f4f401577c0 2023-10-06T11:16:11.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.798+0000 7f4f36ffd700 1 -- 172.21.15.146:0/4213573560 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f28007680 con 0x7f4f401577c0 2023-10-06T11:16:11.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.798+0000 7f4f448bc700 1 -- 172.21.15.146:0/4213573560 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f400b4770 con 0x7f4f401577c0 2023-10-06T11:16:11.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.798+0000 7f4f448bc700 1 -- 172.21.15.146:0/4213573560 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f40068390 con 0x7f4f401577c0 2023-10-06T11:16:11.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.799+0000 7f4f36ffd700 1 -- 172.21.15.146:0/4213573560 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4f28019030 con 0x7f4f401577c0 2023-10-06T11:16:11.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.799+0000 7f4f36ffd700 1 --2- 172.21.15.146:0/4213573560 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4f20066fb0 0x7f4f20069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:11.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.800+0000 7f4f36ffd700 1 -- 172.21.15.146:0/4213573560 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f4f28085ac0 con 0x7f4f401577c0 2023-10-06T11:16:11.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.800+0000 7f4f3e59c700 1 --2- 172.21.15.146:0/4213573560 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4f20066fb0 0x7f4f20069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:11.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.800+0000 7f4f3e59c700 1 --2- 172.21.15.146:0/4213573560 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4f20066fb0 0x7f4f20069460 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f4f30009390 tx=0x7f4f30008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:11.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:11.804+0000 7f4f36ffd700 1 -- 172.21.15.146:0/4213573560 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4f28052bb0 con 0x7f4f401577c0 2023-10-06T11:16:12.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.028+0000 7f4f448bc700 1 -- 172.21.15.146:0/4213573560 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4f4004c380 con 0x7f4f401577c0 2023-10-06T11:16:12.030 INFO:tasks.ceph.mon.a.smithi146.stderr:2023-10-06T11:16:12.028+0000 7f011baa1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T11:16:12.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.033+0000 7f4f36ffd700 1 -- 172.21.15.146:0/4213573560 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v114) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4f280561d0 con 0x7f4f401577c0 2023-10-06T11:16:12.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.035+0000 7f4f448bc700 1 -- 172.21.15.146:0/4213573560 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4f20066fb0 msgr2=0x7f4f20069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:12.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.035+0000 7f4f448bc700 1 --2- 172.21.15.146:0/4213573560 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4f20066fb0 0x7f4f20069460 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f4f30009390 tx=0x7f4f30008040 comp rx=0 tx=0).stop 2023-10-06T11:16:12.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.035+0000 7f4f448bc700 1 -- 172.21.15.146:0/4213573560 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f401577c0 msgr2=0x7f4f4009dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:12.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.035+0000 7f4f448bc700 1 --2- 172.21.15.146:0/4213573560 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f401577c0 0x7f4f4009dc70 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f4f2800c9b0 tx=0x7f4f28015000 comp rx=0 tx=0).stop 2023-10-06T11:16:12.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.035+0000 7f4f448bc700 1 -- 172.21.15.146:0/4213573560 shutdown_connections 2023-10-06T11:16:12.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.035+0000 7f4f448bc700 1 --2- 172.21.15.146:0/4213573560 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4f20066fb0 0x7f4f20069460 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:12.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.035+0000 7f4f448bc700 1 --2- 172.21.15.146:0/4213573560 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f400cf1c0 0x7f4f400cf630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:12.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.035+0000 7f4f448bc700 1 --2- 172.21.15.146:0/4213573560 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f2c003fd0 0x7f4f4015f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:12.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.035+0000 7f4f448bc700 1 --2- 172.21.15.146:0/4213573560 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4f401577c0 0x7f4f4009dc70 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:12.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.035+0000 7f4f448bc700 1 -- 172.21.15.146:0/4213573560 >> 172.21.15.146:0/4213573560 conn(0x7f4f4006f380 msgr2=0x7f4f40069d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:12.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.035+0000 7f4f448bc700 1 -- 172.21.15.146:0/4213573560 shutdown_connections 2023-10-06T11:16:12.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.035+0000 7f4f448bc700 1 -- 172.21.15.146:0/4213573560 wait complete. 2023-10-06T11:16:12.039 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T11:16:12.039 INFO:tasks.ceph.mds.a.smithi146.stderr: -8305> 2023-10-06T11:16:06.827+0000 7f291c3d9700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T11:16:12.050 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T11:16:12.068 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2023-10-06T11:16:12.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.167+0000 7f63ca3fb700 1 Processor -- start 2023-10-06T11:16:12.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.167+0000 7f63ca3fb700 1 -- start start 2023-10-06T11:16:12.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.168+0000 7f63ca3fb700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63c40b5640 0x7f63c415a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:12.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.168+0000 7f63ca3fb700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f63c40cb090 0x7f63c40cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:12.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.168+0000 7f63ca3fb700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c40cc130 con 0x7f63c4068780 2023-10-06T11:16:12.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.168+0000 7f63ca3fb700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63c40b2660 con 0x7f63c40cb090 2023-10-06T11:16:12.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.168+0000 7f63ca3fb700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c415adb0 con 0x7f63c40b5640 2023-10-06T11:16:12.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.168+0000 7f63c9bfa700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f63c4068780 0x7f63c415b010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35142/0 (socket says 172.21.15.146:35142) 2023-10-06T11:16:12.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.168+0000 7f63c9bfa700 1 -- 172.21.15.146:0/3411628773 learned_addr learned my addr 172.21.15.146:0/3411628773 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:16:12.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.168+0000 7f63c8bf8700 1 --2- 172.21.15.146:0/3411628773 >> v2:172.21.15.151:3300/0 conn(0x7f63c40cb090 0x7f63c40cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:12.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.168+0000 7f63c93f9700 1 --2- 172.21.15.146:0/3411628773 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63c40b5640 0x7f63c415a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:12.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.168+0000 7f63bbfff700 1 -- 172.21.15.146:0/3411628773 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 589049255 0 0) 0x7f63c40cc130 con 0x7f63c4068780 2023-10-06T11:16:12.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.168+0000 7f63bbfff700 1 -- 172.21.15.146:0/3411628773 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63b0003570 con 0x7f63c4068780 2023-10-06T11:16:12.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.169+0000 7f63c8bf8700 1 -- 172.21.15.146:0/3411628773 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63c40b5640 msgr2=0x7f63c415a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:12.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.169+0000 7f63c8bf8700 1 --2- 172.21.15.146:0/3411628773 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63c40b5640 0x7f63c415a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:12.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.169+0000 7f63c8bf8700 1 -- 172.21.15.146:0/3411628773 >> v1:172.21.15.146:6789/0 conn(0x7f63c4068780 legacy=0x7f63c415b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:12.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.169+0000 7f63c8bf8700 1 -- 172.21.15.146:0/3411628773 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c40cb520 con 0x7f63c40cb090 2023-10-06T11:16:12.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.169+0000 7f63c93f9700 1 --2- 172.21.15.146:0/3411628773 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63c40b5640 0x7f63c415a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:16:12.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.169+0000 7f63c8bf8700 1 --2- 172.21.15.146:0/3411628773 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63c40cb090 0x7f63c40cc5c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f63b40098e0 tx=0x7f63b40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67bff410b762b0ef server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:12.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.169+0000 7f63bbfff700 1 -- 172.21.15.146:0/3411628773 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b4011630 con 0x7f63c40cb090 2023-10-06T11:16:12.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.169+0000 7f63bbfff700 1 -- 172.21.15.146:0/3411628773 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b4011790 con 0x7f63c40cb090 2023-10-06T11:16:12.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.169+0000 7f63bbfff700 1 -- 172.21.15.146:0/3411628773 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b4011b30 con 0x7f63c40cb090 2023-10-06T11:16:12.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.169+0000 7f63ca3fb700 1 -- 172.21.15.146:0/3411628773 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63c40cb090 msgr2=0x7f63c40cc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:12.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.169+0000 7f63ca3fb700 1 --2- 172.21.15.146:0/3411628773 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63c40cb090 0x7f63c40cc5c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f63b40098e0 tx=0x7f63b40091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:12.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.169+0000 7f63ca3fb700 1 -- 172.21.15.146:0/3411628773 shutdown_connections 2023-10-06T11:16:12.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.169+0000 7f63ca3fb700 1 --2- 172.21.15.146:0/3411628773 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63c40b5640 0x7f63c415a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:12.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.169+0000 7f63ca3fb700 1 --2- 172.21.15.146:0/3411628773 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63c40cb090 0x7f63c40cc5c0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:12.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.169+0000 7f63ca3fb700 1 -- 172.21.15.146:0/3411628773 >> 172.21.15.146:0/3411628773 conn(0x7f63c40703f0 msgr2=0x7f63c40707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:12.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.170+0000 7f63ca3fb700 1 -- 172.21.15.146:0/3411628773 shutdown_connections 2023-10-06T11:16:12.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.170+0000 7f63ca3fb700 1 -- 172.21.15.146:0/3411628773 wait complete. 2023-10-06T11:16:12.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.171+0000 7f63ca3fb700 1 Processor -- start 2023-10-06T11:16:12.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.171+0000 7f63ca3fb700 1 -- start start 2023-10-06T11:16:12.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.172+0000 7f63ca3fb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63c4068780 0x7f63c415bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:12.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.172+0000 7f63ca3fb700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63c40b5640 0x7f63c415dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:12.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.172+0000 7f63ca3fb700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63c40cb090 0x7f63c4152320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:12.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.172+0000 7f63ca3fb700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c415c130 con 0x7f63c4068780 2023-10-06T11:16:12.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.172+0000 7f63ca3fb700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c40c5390 con 0x7f63c40b5640 2023-10-06T11:16:12.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.172+0000 7f63ca3fb700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c415e510 con 0x7f63c40cb090 2023-10-06T11:16:12.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.172+0000 7f63c93f9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63c4068780 0x7f63c415bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:12.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.172+0000 7f63c93f9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63c4068780 0x7f63c415bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51284/0 (socket says 172.21.15.146:51284) 2023-10-06T11:16:12.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.172+0000 7f63c93f9700 1 -- 172.21.15.146:0/451163966 learned_addr learned my addr 172.21.15.146:0/451163966 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:12.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.172+0000 7f63c9bfa700 1 --2- 172.21.15.146:0/451163966 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63c40cb090 0x7f63c4152320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:12.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.172+0000 7f63c8bf8700 1 --2- 172.21.15.146:0/451163966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63c40b5640 0x7f63c415dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:12.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.172+0000 7f63c93f9700 1 -- 172.21.15.146:0/451163966 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63c40cb090 msgr2=0x7f63c4152320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:12.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.172+0000 7f63c93f9700 1 --2- 172.21.15.146:0/451163966 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63c40cb090 0x7f63c4152320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:12.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.172+0000 7f63c93f9700 1 -- 172.21.15.146:0/451163966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63c40b5640 msgr2=0x7f63c415dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:12.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.172+0000 7f63c93f9700 1 --2- 172.21.15.146:0/451163966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63c40b5640 0x7f63c415dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:12.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.172+0000 7f63c93f9700 1 -- 172.21.15.146:0/451163966 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c0009420 con 0x7f63c4068780 2023-10-06T11:16:12.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.172+0000 7f63c9bfa700 1 --2- 172.21.15.146:0/451163966 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63c40cb090 0x7f63c4152320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:12.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.172+0000 7f63c8bf8700 1 --2- 172.21.15.146:0/451163966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63c40b5640 0x7f63c415dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:12.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.172+0000 7f63c93f9700 1 --2- 172.21.15.146:0/451163966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63c4068780 0x7f63c415bbf0 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f63c000ec80 tx=0x7f63c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:12.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.172+0000 7f63b97fa700 1 -- 172.21.15.146:0/451163966 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c000c9d0 con 0x7f63c4068780 2023-10-06T11:16:12.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.172+0000 7f63b97fa700 1 -- 172.21.15.146:0/451163966 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c000cb30 con 0x7f63c4068780 2023-10-06T11:16:12.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.172+0000 7f63ca3fb700 1 -- 172.21.15.146:0/451163966 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63b4009420 con 0x7f63c4068780 2023-10-06T11:16:12.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.172+0000 7f63b97fa700 1 -- 172.21.15.146:0/451163966 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c000ceb0 con 0x7f63c4068780 2023-10-06T11:16:12.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.172+0000 7f63ca3fb700 1 -- 172.21.15.146:0/451163966 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c415eaa0 con 0x7f63c4068780 2023-10-06T11:16:12.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.173+0000 7f63ca3fb700 1 -- 172.21.15.146:0/451163966 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c40894b0 con 0x7f63c4068780 2023-10-06T11:16:12.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.174+0000 7f63b97fa700 1 -- 172.21.15.146:0/451163966 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f63c0013680 con 0x7f63c4068780 2023-10-06T11:16:12.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.174+0000 7f63b97fa700 1 --2- 172.21.15.146:0/451163966 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f63a8066f30 0x7f63a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:12.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.174+0000 7f63b97fa700 1 -- 172.21.15.146:0/451163966 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f63c0084bc0 con 0x7f63c4068780 2023-10-06T11:16:12.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.174+0000 7f63c8bf8700 1 --2- 172.21.15.146:0/451163966 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f63a8066f30 0x7f63a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:12.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.174+0000 7f63c8bf8700 1 --2- 172.21.15.146:0/451163966 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f63a8066f30 0x7f63a80693e0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f63b40091e0 tx=0x7f63b4017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:12.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.178+0000 7f63b97fa700 1 -- 172.21.15.146:0/451163966 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f63c0051c20 con 0x7f63c4068780 2023-10-06T11:16:12.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:12.404+0000 7f63ca3fb700 1 -- 172.21.15.146:0/451163966 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f63c404bb40 con 0x7f63c4068780 2023-10-06T11:16:13.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.033+0000 7f63b97fa700 1 -- 172.21.15.146:0/451163966 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v115) v1 ==== 104+0+0 (secure 0 0 0) 0x7f63c0055240 con 0x7f63c4068780 2023-10-06T11:16:13.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.035+0000 7f63ca3fb700 1 -- 172.21.15.146:0/451163966 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f63a8066f30 msgr2=0x7f63a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:13.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.035+0000 7f63ca3fb700 1 --2- 172.21.15.146:0/451163966 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f63a8066f30 0x7f63a80693e0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f63b40091e0 tx=0x7f63b4017000 comp rx=0 tx=0).stop 2023-10-06T11:16:13.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.035+0000 7f63ca3fb700 1 -- 172.21.15.146:0/451163966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63c4068780 msgr2=0x7f63c415bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:13.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.035+0000 7f63ca3fb700 1 --2- 172.21.15.146:0/451163966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63c4068780 0x7f63c415bbf0 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f63c000ec80 tx=0x7f63c00091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:13.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.035+0000 7f63ca3fb700 1 -- 172.21.15.146:0/451163966 shutdown_connections 2023-10-06T11:16:13.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.035+0000 7f63ca3fb700 1 --2- 172.21.15.146:0/451163966 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f63a8066f30 0x7f63a80693e0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:13.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.035+0000 7f63ca3fb700 1 --2- 172.21.15.146:0/451163966 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63c40cb090 0x7f63c4152320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:13.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.035+0000 7f63ca3fb700 1 --2- 172.21.15.146:0/451163966 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63c4068780 0x7f63c415bbf0 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:13.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.035+0000 7f63ca3fb700 1 --2- 172.21.15.146:0/451163966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63c40b5640 0x7f63c415dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:13.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.035+0000 7f63ca3fb700 1 -- 172.21.15.146:0/451163966 >> 172.21.15.146:0/451163966 conn(0x7f63c40703f0 msgr2=0x7f63c4153740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:13.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.036+0000 7f63ca3fb700 1 -- 172.21.15.146:0/451163966 shutdown_connections 2023-10-06T11:16:13.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.036+0000 7f63ca3fb700 1 -- 172.21.15.146:0/451163966 wait complete. 2023-10-06T11:16:13.051 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T11:16:13.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.209+0000 7f634f203700 1 Processor -- start 2023-10-06T11:16:13.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.210+0000 7f634f203700 1 -- start start 2023-10-06T11:16:13.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.210+0000 7f634f203700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f63480b5640 0x7f634815a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:13.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.210+0000 7f634f203700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63480cb090 0x7f63480cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:13.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.210+0000 7f634f203700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63480cc130 con 0x7f6348068780 2023-10-06T11:16:13.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.210+0000 7f634f203700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63480b2660 con 0x7f63480b5640 2023-10-06T11:16:13.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.210+0000 7f634f203700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f634815adb0 con 0x7f63480cb090 2023-10-06T11:16:13.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.211+0000 7f634e201700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f63480b5640 0x7f634815a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:13.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.211+0000 7f634ea02700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6348068780 0x7f6348068bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35154/0 (socket says 172.21.15.146:35154) 2023-10-06T11:16:13.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.211+0000 7f634ea02700 1 -- 172.21.15.146:0/1762698865 learned_addr learned my addr 172.21.15.146:0/1762698865 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:16:13.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.211+0000 7f634da00700 1 --2- 172.21.15.146:0/1762698865 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63480cb090 0x7f63480cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:13.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.211+0000 7f634e201700 1 -- 172.21.15.146:0/1762698865 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63480cb090 msgr2=0x7f63480cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:13.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.211+0000 7f634e201700 1 --2- 172.21.15.146:0/1762698865 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63480cb090 0x7f63480cc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:13.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.211+0000 7f634e201700 1 -- 172.21.15.146:0/1762698865 >> v1:172.21.15.146:6789/0 conn(0x7f6348068780 legacy=0x7f6348068bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:13.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.211+0000 7f634e201700 1 -- 172.21.15.146:0/1762698865 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63480cb520 con 0x7f63480b5640 2023-10-06T11:16:13.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.211+0000 7f634d1ff700 1 -- 172.21.15.146:0/1762698865 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1035696124 0 0) 0x7f63480cc130 con 0x7f6348068780 2023-10-06T11:16:13.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.211+0000 7f634e201700 1 --2- 172.21.15.146:0/1762698865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63480b5640 0x7f634815a870 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f63440098e0 tx=0x7f63440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8584097b293e258 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:13.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.211+0000 7f634d1ff700 1 -- 172.21.15.146:0/1762698865 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634400b640 con 0x7f63480b5640 2023-10-06T11:16:13.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.211+0000 7f634d1ff700 1 -- 172.21.15.146:0/1762698865 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f634400b7a0 con 0x7f63480b5640 2023-10-06T11:16:13.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.211+0000 7f634d1ff700 1 -- 172.21.15.146:0/1762698865 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634400bb40 con 0x7f63480b5640 2023-10-06T11:16:13.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.212+0000 7f634f203700 1 -- 172.21.15.146:0/1762698865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63480b5640 msgr2=0x7f634815a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:13.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.212+0000 7f634f203700 1 --2- 172.21.15.146:0/1762698865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63480b5640 0x7f634815a870 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f63440098e0 tx=0x7f63440091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:13.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.212+0000 7f634f203700 1 -- 172.21.15.146:0/1762698865 shutdown_connections 2023-10-06T11:16:13.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.212+0000 7f634f203700 1 --2- 172.21.15.146:0/1762698865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63480b5640 0x7f634815a870 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:13.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.212+0000 7f634f203700 1 --2- 172.21.15.146:0/1762698865 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63480cb090 0x7f63480cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:13.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.212+0000 7f634f203700 1 -- 172.21.15.146:0/1762698865 >> 172.21.15.146:0/1762698865 conn(0x7f63480703f0 msgr2=0x7f63480707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:13.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.212+0000 7f634f203700 1 -- 172.21.15.146:0/1762698865 shutdown_connections 2023-10-06T11:16:13.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.212+0000 7f634f203700 1 -- 172.21.15.146:0/1762698865 wait complete. 2023-10-06T11:16:13.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.213+0000 7f634f203700 1 Processor -- start 2023-10-06T11:16:13.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.213+0000 7f634f203700 1 -- start start 2023-10-06T11:16:13.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.214+0000 7f634f203700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6348068780 0x7f63481535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:13.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.214+0000 7f634f203700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63480b5640 0x7f63480c6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:13.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.214+0000 7f634f203700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63480cb090 0x7f63480cf330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:13.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.214+0000 7f634f203700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6348169b30 con 0x7f63480b5640 2023-10-06T11:16:13.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.214+0000 7f634f203700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634816a980 con 0x7f63480cb090 2023-10-06T11:16:13.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.214+0000 7f634f203700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6348153e60 con 0x7f6348068780 2023-10-06T11:16:13.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.214+0000 7f634da00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63480b5640 0x7f63480c6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:13.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.214+0000 7f634da00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63480b5640 0x7f63480c6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51304/0 (socket says 172.21.15.146:51304) 2023-10-06T11:16:13.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.214+0000 7f634da00700 1 -- 172.21.15.146:0/521129586 learned_addr learned my addr 172.21.15.146:0/521129586 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:13.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.214+0000 7f634e201700 1 --2- 172.21.15.146:0/521129586 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6348068780 0x7f63481535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:13.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.215+0000 7f634ea02700 1 --2- 172.21.15.146:0/521129586 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63480cb090 0x7f63480cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:13.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.215+0000 7f634da00700 1 -- 172.21.15.146:0/521129586 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6348068780 msgr2=0x7f63481535f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:13.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.215+0000 7f634da00700 1 --2- 172.21.15.146:0/521129586 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6348068780 0x7f63481535f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:13.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.215+0000 7f634da00700 1 -- 172.21.15.146:0/521129586 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63480cb090 msgr2=0x7f63480cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:13.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.215+0000 7f634da00700 1 --2- 172.21.15.146:0/521129586 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63480cb090 0x7f63480cf330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:13.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.215+0000 7f634da00700 1 -- 172.21.15.146:0/521129586 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6344009420 con 0x7f63480b5640 2023-10-06T11:16:13.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.215+0000 7f634ea02700 1 --2- 172.21.15.146:0/521129586 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63480cb090 0x7f63480cf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:13.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.215+0000 7f634da00700 1 --2- 172.21.15.146:0/521129586 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63480b5640 0x7f63480c6a40 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f633800e930 tx=0x7f63380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:13.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.215+0000 7f633e7fc700 1 -- 172.21.15.146:0/521129586 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633800eed0 con 0x7f63480b5640 2023-10-06T11:16:13.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.215+0000 7f633e7fc700 1 -- 172.21.15.146:0/521129586 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633800c850 con 0x7f63480b5640 2023-10-06T11:16:13.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.215+0000 7f633e7fc700 1 -- 172.21.15.146:0/521129586 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633800cbf0 con 0x7f63480b5640 2023-10-06T11:16:13.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.216+0000 7f634f203700 1 -- 172.21.15.146:0/521129586 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6348169d70 con 0x7f63480b5640 2023-10-06T11:16:13.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.216+0000 7f634f203700 1 -- 172.21.15.146:0/521129586 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f634816a330 con 0x7f63480b5640 2023-10-06T11:16:13.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.217+0000 7f634f203700 1 -- 172.21.15.146:0/521129586 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f634816ab10 con 0x7f63480b5640 2023-10-06T11:16:13.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.218+0000 7f633e7fc700 1 -- 172.21.15.146:0/521129586 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6338013470 con 0x7f63480b5640 2023-10-06T11:16:13.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.218+0000 7f633e7fc700 1 --2- 172.21.15.146:0/521129586 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f632c066f30 0x7f632c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:13.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.219+0000 7f633e7fc700 1 -- 172.21.15.146:0/521129586 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6230+0+0 (secure 0 0 0) 0x7f6338084a10 con 0x7f63480b5640 2023-10-06T11:16:13.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.219+0000 7f634e201700 1 --2- 172.21.15.146:0/521129586 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f632c066f30 0x7f632c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:13.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.219+0000 7f634e201700 1 --2- 172.21.15.146:0/521129586 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f632c066f30 0x7f632c0693e0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f63440093f0 tx=0x7f6344017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:13.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.223+0000 7f633e7fc700 1 -- 172.21.15.146:0/521129586 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f63380519d0 con 0x7f63480b5640 2023-10-06T11:16:13.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:13.406+0000 7f634f203700 1 -- 172.21.15.146:0/521129586 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f634804bb40 con 0x7f63480b5640 2023-10-06T11:16:14.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.037+0000 7f633e7fc700 1 -- 172.21.15.146:0/521129586 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v128) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6338054ff0 con 0x7f63480b5640 2023-10-06T11:16:14.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.040+0000 7f634f203700 1 -- 172.21.15.146:0/521129586 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f632c066f30 msgr2=0x7f632c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:14.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.040+0000 7f634f203700 1 --2- 172.21.15.146:0/521129586 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f632c066f30 0x7f632c0693e0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f63440093f0 tx=0x7f6344017000 comp rx=0 tx=0).stop 2023-10-06T11:16:14.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.040+0000 7f634f203700 1 -- 172.21.15.146:0/521129586 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63480b5640 msgr2=0x7f63480c6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:14.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.040+0000 7f634f203700 1 --2- 172.21.15.146:0/521129586 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63480b5640 0x7f63480c6a40 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f633800e930 tx=0x7f63380091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.040+0000 7f634f203700 1 -- 172.21.15.146:0/521129586 shutdown_connections 2023-10-06T11:16:14.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.040+0000 7f634f203700 1 --2- 172.21.15.146:0/521129586 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f632c066f30 0x7f632c0693e0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.040+0000 7f634f203700 1 --2- 172.21.15.146:0/521129586 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63480cb090 0x7f63480cf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.040+0000 7f634f203700 1 --2- 172.21.15.146:0/521129586 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6348068780 0x7f63481535f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.040+0000 7f634f203700 1 --2- 172.21.15.146:0/521129586 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63480b5640 0x7f63480c6a40 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.040+0000 7f634f203700 1 -- 172.21.15.146:0/521129586 >> 172.21.15.146:0/521129586 conn(0x7f63480703f0 msgr2=0x7f634815c740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:14.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.040+0000 7f634f203700 1 -- 172.21.15.146:0/521129586 shutdown_connections 2023-10-06T11:16:14.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.040+0000 7f634f203700 1 -- 172.21.15.146:0/521129586 wait complete. 2023-10-06T11:16:14.044 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' removed 2023-10-06T11:16:14.057 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T11:16:14.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.176+0000 7fb308392700 1 Processor -- start 2023-10-06T11:16:14.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.176+0000 7fb308392700 1 -- start start 2023-10-06T11:16:14.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.177+0000 7fb308392700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb30015a160 0x7fb3000c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:14.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.177+0000 7fb308392700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3000ae2a0 con 0x7fb3000ae730 2023-10-06T11:16:14.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.177+0000 7fb308392700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb30015a530 con 0x7fb3000cb950 2023-10-06T11:16:14.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.177+0000 7fb308392700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3000ad690 con 0x7fb30015a160 2023-10-06T11:16:14.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.177+0000 7fb30592d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb3000ae730 0x7fb3000aeb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35170/0 (socket says 172.21.15.146:35170) 2023-10-06T11:16:14.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.177+0000 7fb30592d700 1 -- 172.21.15.146:0/3292937200 learned_addr learned my addr 172.21.15.146:0/3292937200 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:16:14.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.177+0000 7fb30512c700 1 -- 172.21.15.146:0/3292937200 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2078132284 0 0) 0x7fb3000ae2a0 con 0x7fb3000ae730 2023-10-06T11:16:14.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.177+0000 7fb30512c700 1 -- 172.21.15.146:0/3292937200 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2ec003570 con 0x7fb3000ae730 2023-10-06T11:16:14.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.177+0000 7fb30612e700 1 --2- 172.21.15.146:0/3292937200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb30015a160 0x7fb3000c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:14.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.177+0000 7fb30512c700 1 -- 172.21.15.146:0/3292937200 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2878121204 0 0) 0x7fb2ec003570 con 0x7fb3000ae730 2023-10-06T11:16:14.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.177+0000 7fb30512c700 1 -- 172.21.15.146:0/3292937200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb30015a160 msgr2=0x7fb3000c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:14.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.177+0000 7fb30512c700 1 --2- 172.21.15.146:0/3292937200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb30015a160 0x7fb3000c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.177+0000 7fb30512c700 1 -- 172.21.15.146:0/3292937200 >> v1:172.21.15.151:6789/0 conn(0x7fb3000cb950 legacy=0x7fb3000cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:14.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.177+0000 7fb30512c700 1 -- 172.21.15.146:0/3292937200 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3000ad970 con 0x7fb3000ae730 2023-10-06T11:16:14.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.177+0000 7fb30512c700 1 -- 172.21.15.146:0/3292937200 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fb2f0001470 con 0x7fb3000ae730 2023-10-06T11:16:14.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.177+0000 7fb30512c700 1 -- 172.21.15.146:0/3292937200 >> v1:172.21.15.146:6789/0 conn(0x7fb3000ae730 legacy=0x7fb3000aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:14.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.178+0000 7fb30512c700 1 --2- 172.21.15.146:0/3292937200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb30015a160 0x7fb2ec003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:14.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.178+0000 7fb30512c700 1 --2- 172.21.15.146:0/3292937200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2ec004010 0x7fb2ec004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:14.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.178+0000 7fb30512c700 1 --2- 172.21.15.146:0/3292937200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2ec004d50 0x7fb2ec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:14.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.178+0000 7fb30512c700 1 -- 172.21.15.146:0/3292937200 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3000ad690 con 0x7fb2ec004010 2023-10-06T11:16:14.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.178+0000 7fb30512c700 1 -- 172.21.15.146:0/3292937200 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec00bbf0 con 0x7fb2ec004d50 2023-10-06T11:16:14.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.178+0000 7fb30512c700 1 -- 172.21.15.146:0/3292937200 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2ec00bdb0 con 0x7fb30015a160 2023-10-06T11:16:14.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.178+0000 7fb30592d700 1 --2- 172.21.15.146:0/3292937200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2ec004010 0x7fb2ec004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:14.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.178+0000 7fb30612e700 1 --2- 172.21.15.146:0/3292937200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb30015a160 0x7fb2ec003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:14.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.178+0000 7fb30692f700 1 --2- 172.21.15.146:0/3292937200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2ec004d50 0x7fb2ec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:14.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.178+0000 7fb30592d700 1 -- 172.21.15.146:0/3292937200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb30015a160 msgr2=0x7fb2ec003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:14.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.178+0000 7fb30592d700 1 --2- 172.21.15.146:0/3292937200 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb30015a160 0x7fb2ec003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.178+0000 7fb30592d700 1 -- 172.21.15.146:0/3292937200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2ec004d50 msgr2=0x7fb2ec0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:14.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.178+0000 7fb30592d700 1 --2- 172.21.15.146:0/3292937200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2ec004d50 0x7fb2ec0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.178+0000 7fb30592d700 1 -- 172.21.15.146:0/3292937200 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ec003570 con 0x7fb2ec004010 2023-10-06T11:16:14.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.178+0000 7fb30592d700 1 --2- 172.21.15.146:0/3292937200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2ec004010 0x7fb2ec004810 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7fb2f000c390 tx=0x7fb2f0001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58647f86fa50534a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:14.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.178+0000 7fb30512c700 1 -- 172.21.15.146:0/3292937200 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f000cc60 con 0x7fb2ec004010 2023-10-06T11:16:14.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.178+0000 7fb30512c700 1 -- 172.21.15.146:0/3292937200 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f000cdc0 con 0x7fb2ec004010 2023-10-06T11:16:14.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.178+0000 7fb30512c700 1 -- 172.21.15.146:0/3292937200 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f0005b50 con 0x7fb2ec004010 2023-10-06T11:16:14.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.179+0000 7fb308392700 1 -- 172.21.15.146:0/3292937200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2ec004010 msgr2=0x7fb2ec004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:14.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.179+0000 7fb308392700 1 --2- 172.21.15.146:0/3292937200 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb2ec004010 0x7fb2ec004810 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7fb2f000c390 tx=0x7fb2f0001e50 comp rx=0 tx=0).stop 2023-10-06T11:16:14.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.179+0000 7fb30692f700 1 -- 172.21.15.146:0/3292937200 reap_dead start 2023-10-06T11:16:14.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.179+0000 7fb308392700 1 -- 172.21.15.146:0/3292937200 shutdown_connections 2023-10-06T11:16:14.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.179+0000 7fb308392700 1 -- 172.21.15.146:0/3292937200 >> 172.21.15.146:0/3292937200 conn(0x7fb30006f380 msgr2=0x7fb3000d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:14.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.179+0000 7fb308392700 1 -- 172.21.15.146:0/3292937200 shutdown_connections 2023-10-06T11:16:14.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.179+0000 7fb308392700 1 -- 172.21.15.146:0/3292937200 wait complete. 2023-10-06T11:16:14.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.180+0000 7fb308392700 1 Processor -- start 2023-10-06T11:16:14.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.180+0000 7fb308392700 1 -- start start 2023-10-06T11:16:14.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.181+0000 7fb308392700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2ec004010 0x7fb300150950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:14.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.181+0000 7fb308392700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3000c5e40 0x7fb3000c62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:14.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.181+0000 7fb308392700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb3000c8270 0x7fb3000c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:14.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.181+0000 7fb308392700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb300150e90 con 0x7fb3000c5e40 2023-10-06T11:16:14.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.181+0000 7fb308392700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3000c67f0 con 0x7fb2ec004010 2023-10-06T11:16:14.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.181+0000 7fb308392700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3000c8f40 con 0x7fb3000c8270 2023-10-06T11:16:14.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.181+0000 7fb30592d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3000c5e40 0x7fb3000c62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:14.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.181+0000 7fb30592d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3000c5e40 0x7fb3000c62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51318/0 (socket says 172.21.15.146:51318) 2023-10-06T11:16:14.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.181+0000 7fb30592d700 1 -- 172.21.15.146:0/1947223718 learned_addr learned my addr 172.21.15.146:0/1947223718 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:14.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.181+0000 7fb30692f700 1 --2- 172.21.15.146:0/1947223718 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb3000c8270 0x7fb3000c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:14.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.181+0000 7fb30612e700 1 --2- 172.21.15.146:0/1947223718 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2ec004010 0x7fb300150950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:14.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.181+0000 7fb30592d700 1 -- 172.21.15.146:0/1947223718 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb3000c8270 msgr2=0x7fb3000c86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:14.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.181+0000 7fb30592d700 1 --2- 172.21.15.146:0/1947223718 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb3000c8270 0x7fb3000c86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.181+0000 7fb30592d700 1 -- 172.21.15.146:0/1947223718 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2ec004010 msgr2=0x7fb300150950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:14.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.181+0000 7fb30592d700 1 --2- 172.21.15.146:0/1947223718 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2ec004010 0x7fb300150950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:14.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.181+0000 7fb30592d700 1 -- 172.21.15.146:0/1947223718 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3000c9220 con 0x7fb3000c5e40 2023-10-06T11:16:14.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.181+0000 7fb30592d700 1 --2- 172.21.15.146:0/1947223718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3000c5e40 0x7fb3000c62b0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec0057d0 tx=0x7fb2f0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:14.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.181+0000 7fb2f67fc700 1 -- 172.21.15.146:0/1947223718 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f000cc60 con 0x7fb3000c5e40 2023-10-06T11:16:14.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.181+0000 7fb2f67fc700 1 -- 172.21.15.146:0/1947223718 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f00072e0 con 0x7fb3000c5e40 2023-10-06T11:16:14.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.181+0000 7fb308392700 1 -- 172.21.15.146:0/1947223718 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3000c9500 con 0x7fb3000c5e40 2023-10-06T11:16:14.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.181+0000 7fb2f67fc700 1 -- 172.21.15.146:0/1947223718 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f0007680 con 0x7fb3000c5e40 2023-10-06T11:16:14.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.181+0000 7fb308392700 1 -- 172.21.15.146:0/1947223718 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3000c9ac0 con 0x7fb3000c5e40 2023-10-06T11:16:14.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.182+0000 7fb308392700 1 -- 172.21.15.146:0/1947223718 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb300068390 con 0x7fb3000c5e40 2023-10-06T11:16:14.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.183+0000 7fb2f67fc700 1 -- 172.21.15.146:0/1947223718 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb2f0019030 con 0x7fb3000c5e40 2023-10-06T11:16:14.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.183+0000 7fb2f67fc700 1 --2- 172.21.15.146:0/1947223718 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb2e4066f30 0x7fb2e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:14.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.183+0000 7fb2f67fc700 1 -- 172.21.15.146:0/1947223718 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5792+0+0 (secure 0 0 0) 0x7fb2f0085600 con 0x7fb3000c5e40 2023-10-06T11:16:14.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.183+0000 7fb30612e700 1 --2- 172.21.15.146:0/1947223718 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb2e4066f30 0x7fb2e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:14.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.183+0000 7fb30612e700 1 --2- 172.21.15.146:0/1947223718 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb2e4066f30 0x7fb2e40693e0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc0094d0 tx=0x7fb2fc00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:14.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.187+0000 7fb2f67fc700 1 -- 172.21.15.146:0/1947223718 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb2f0052820 con 0x7fb3000c5e40 2023-10-06T11:16:14.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:14.371+0000 7fb308392700 1 -- 172.21.15.146:0/1947223718 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb3000b3e80 con 0x7fb3000c5e40 2023-10-06T11:16:15.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.039+0000 7fb2f67fc700 1 -- 172.21.15.146:0/1947223718 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v129) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb2f0055e40 con 0x7fb3000c5e40 2023-10-06T11:16:15.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.043+0000 7fb308392700 1 -- 172.21.15.146:0/1947223718 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb2e4066f30 msgr2=0x7fb2e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:15.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.043+0000 7fb308392700 1 --2- 172.21.15.146:0/1947223718 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb2e4066f30 0x7fb2e40693e0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc0094d0 tx=0x7fb2fc00b040 comp rx=0 tx=0).stop 2023-10-06T11:16:15.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.043+0000 7fb308392700 1 -- 172.21.15.146:0/1947223718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3000c5e40 msgr2=0x7fb3000c62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:15.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.043+0000 7fb308392700 1 --2- 172.21.15.146:0/1947223718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3000c5e40 0x7fb3000c62b0 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec0057d0 tx=0x7fb2f0015000 comp rx=0 tx=0).stop 2023-10-06T11:16:15.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.043+0000 7fb308392700 1 -- 172.21.15.146:0/1947223718 shutdown_connections 2023-10-06T11:16:15.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.043+0000 7fb308392700 1 --2- 172.21.15.146:0/1947223718 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb2e4066f30 0x7fb2e40693e0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:15.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.043+0000 7fb308392700 1 --2- 172.21.15.146:0/1947223718 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb3000c8270 0x7fb3000c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:15.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.043+0000 7fb308392700 1 --2- 172.21.15.146:0/1947223718 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2ec004010 0x7fb300150950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:15.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.043+0000 7fb308392700 1 --2- 172.21.15.146:0/1947223718 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3000c5e40 0x7fb3000c62b0 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:15.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.043+0000 7fb308392700 1 -- 172.21.15.146:0/1947223718 >> 172.21.15.146:0/1947223718 conn(0x7fb30006f380 msgr2=0x7fb3000b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:15.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.043+0000 7fb308392700 1 -- 172.21.15.146:0/1947223718 shutdown_connections 2023-10-06T11:16:15.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.043+0000 7fb308392700 1 -- 172.21.15.146:0/1947223718 wait complete. 2023-10-06T11:16:15.057 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' removed 2023-10-06T11:16:15.064 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T11:16:15.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.179+0000 7fb4edac9700 1 Processor -- start 2023-10-06T11:16:15.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.179+0000 7fb4edac9700 1 -- start start 2023-10-06T11:16:15.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.180+0000 7fb4edac9700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4e815a160 0x7fb4e80c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:15.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.180+0000 7fb4edac9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb4e80cb950 0x7fb4e80cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:15.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.180+0000 7fb4edac9700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4e80ae2a0 con 0x7fb4e80ae730 2023-10-06T11:16:15.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.180+0000 7fb4edac9700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4e815a530 con 0x7fb4e80cb950 2023-10-06T11:16:15.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.180+0000 7fb4edac9700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e80ad690 con 0x7fb4e815a160 2023-10-06T11:16:15.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.180+0000 7fb4e7fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb4e80cb950 0x7fb4e80cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:15.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.180+0000 7fb4e6ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb4e80ae730 0x7fb4e80aeb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35172/0 (socket says 172.21.15.146:35172) 2023-10-06T11:16:15.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.180+0000 7fb4e6ffd700 1 -- 172.21.15.146:0/2294947923 learned_addr learned my addr 172.21.15.146:0/2294947923 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:16:15.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.180+0000 7fb4e77fe700 1 --2- 172.21.15.146:0/2294947923 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4e815a160 0x7fb4e80c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:15.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.180+0000 7fb4e7fff700 1 -- 172.21.15.146:0/2294947923 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4e815a160 msgr2=0x7fb4e80c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:15.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.180+0000 7fb4e7fff700 1 --2- 172.21.15.146:0/2294947923 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4e815a160 0x7fb4e80c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:15.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.180+0000 7fb4e7fff700 1 -- 172.21.15.146:0/2294947923 >> v1:172.21.15.146:6789/0 conn(0x7fb4e80ae730 legacy=0x7fb4e80aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:15.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.180+0000 7fb4e7fff700 1 -- 172.21.15.146:0/2294947923 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e80ad970 con 0x7fb4e80cb950 2023-10-06T11:16:15.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.180+0000 7fb4e67fc700 1 -- 172.21.15.146:0/2294947923 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 344621966 0 0) 0x7fb4e80ae2a0 con 0x7fb4e80ae730 2023-10-06T11:16:15.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.180+0000 7fb4e7fff700 1 --2- 172.21.15.146:0/2294947923 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4e80cb950 0x7fb4e80cbdb0 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7fb4e0009e60 tx=0x7fb4e0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45f9daf215446e54 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:15.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.180+0000 7fb4e67fc700 1 -- 172.21.15.146:0/2294947923 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e000e070 con 0x7fb4e80cb950 2023-10-06T11:16:15.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.180+0000 7fb4e67fc700 1 -- 172.21.15.146:0/2294947923 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e000bc30 con 0x7fb4e80cb950 2023-10-06T11:16:15.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.180+0000 7fb4e67fc700 1 -- 172.21.15.146:0/2294947923 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e0012430 con 0x7fb4e80cb950 2023-10-06T11:16:15.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.181+0000 7fb4edac9700 1 -- 172.21.15.146:0/2294947923 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4e80cb950 msgr2=0x7fb4e80cbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:15.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.181+0000 7fb4edac9700 1 --2- 172.21.15.146:0/2294947923 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4e80cb950 0x7fb4e80cbdb0 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7fb4e0009e60 tx=0x7fb4e0009780 comp rx=0 tx=0).stop 2023-10-06T11:16:15.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.181+0000 7fb4edac9700 1 -- 172.21.15.146:0/2294947923 shutdown_connections 2023-10-06T11:16:15.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.181+0000 7fb4edac9700 1 --2- 172.21.15.146:0/2294947923 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4e80cb950 0x7fb4e80cbdb0 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:15.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.181+0000 7fb4edac9700 1 --2- 172.21.15.146:0/2294947923 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4e815a160 0x7fb4e80c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:15.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.181+0000 7fb4edac9700 1 -- 172.21.15.146:0/2294947923 >> 172.21.15.146:0/2294947923 conn(0x7fb4e806f380 msgr2=0x7fb4e80d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:15.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.181+0000 7fb4edac9700 1 -- 172.21.15.146:0/2294947923 shutdown_connections 2023-10-06T11:16:15.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.181+0000 7fb4edac9700 1 -- 172.21.15.146:0/2294947923 wait complete. 2023-10-06T11:16:15.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.182+0000 7fb4edac9700 1 Processor -- start 2023-10-06T11:16:15.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.182+0000 7fb4edac9700 1 -- start start 2023-10-06T11:16:15.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.183+0000 7fb4edac9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4e80ae730 0x7fb4e814e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:15.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.183+0000 7fb4edac9700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4e80cb950 0x7fb4e80c9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:15.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.183+0000 7fb4edac9700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4e815a160 0x7fb4e80ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:15.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.183+0000 7fb4edac9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e80c8880 con 0x7fb4e80ae730 2023-10-06T11:16:15.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.183+0000 7fb4edac9700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e80c85a0 con 0x7fb4e80cb950 2023-10-06T11:16:15.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.183+0000 7fb4edac9700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e80b3940 con 0x7fb4e815a160 2023-10-06T11:16:15.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.183+0000 7fb4e77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4e80ae730 0x7fb4e814e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:15.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.183+0000 7fb4e77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4e80ae730 0x7fb4e814e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51332/0 (socket says 172.21.15.146:51332) 2023-10-06T11:16:15.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.183+0000 7fb4e77fe700 1 -- 172.21.15.146:0/3151601399 learned_addr learned my addr 172.21.15.146:0/3151601399 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:15.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.183+0000 7fb4e7fff700 1 --2- 172.21.15.146:0/3151601399 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4e815a160 0x7fb4e80ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:15.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.183+0000 7fb4e77fe700 1 -- 172.21.15.146:0/3151601399 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4e815a160 msgr2=0x7fb4e80ca2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:15.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.183+0000 7fb4e77fe700 1 --2- 172.21.15.146:0/3151601399 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4e815a160 0x7fb4e80ca2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:15.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.183+0000 7fb4e77fe700 1 -- 172.21.15.146:0/3151601399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4e80cb950 msgr2=0x7fb4e80c9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:15.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.183+0000 7fb4e6ffd700 1 --2- 172.21.15.146:0/3151601399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4e80cb950 0x7fb4e80c9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:15.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.183+0000 7fb4e77fe700 1 --2- 172.21.15.146:0/3151601399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4e80cb950 0x7fb4e80c9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:15.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.183+0000 7fb4e77fe700 1 -- 172.21.15.146:0/3151601399 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e0009a20 con 0x7fb4e80ae730 2023-10-06T11:16:15.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.183+0000 7fb4e77fe700 1 --2- 172.21.15.146:0/3151601399 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4e80ae730 0x7fb4e814e730 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7fb4d800d810 tx=0x7fb4d8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:15.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.184+0000 7fb4cf7fe700 1 -- 172.21.15.146:0/3151601399 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d80125f0 con 0x7fb4e80ae730 2023-10-06T11:16:15.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.184+0000 7fb4cf7fe700 1 -- 172.21.15.146:0/3151601399 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d8012750 con 0x7fb4e80ae730 2023-10-06T11:16:15.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.184+0000 7fb4edac9700 1 -- 172.21.15.146:0/3151601399 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4e80b3c20 con 0x7fb4e80ae730 2023-10-06T11:16:15.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.184+0000 7fb4cf7fe700 1 -- 172.21.15.146:0/3151601399 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d8012b10 con 0x7fb4e80ae730 2023-10-06T11:16:15.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.184+0000 7fb4edac9700 1 -- 172.21.15.146:0/3151601399 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4e80af700 con 0x7fb4e80ae730 2023-10-06T11:16:15.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.185+0000 7fb4edac9700 1 -- 172.21.15.146:0/3151601399 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4e80b37b0 con 0x7fb4e80ae730 2023-10-06T11:16:15.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.185+0000 7fb4cf7fe700 1 -- 172.21.15.146:0/3151601399 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb4d801e460 con 0x7fb4e80ae730 2023-10-06T11:16:15.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.185+0000 7fb4cf7fe700 1 --2- 172.21.15.146:0/3151601399 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb4d4066f30 0x7fb4d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:15.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.185+0000 7fb4cf7fe700 1 -- 172.21.15.146:0/3151601399 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5378+0+0 (secure 0 0 0) 0x7fb4d8084a60 con 0x7fb4e80ae730 2023-10-06T11:16:15.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.185+0000 7fb4e6ffd700 1 --2- 172.21.15.146:0/3151601399 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb4d4066f30 0x7fb4d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:15.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.186+0000 7fb4e6ffd700 1 --2- 172.21.15.146:0/3151601399 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb4d4066f30 0x7fb4d40693e0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8155720 tx=0x7fb4dc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:15.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.190+0000 7fb4cf7fe700 1 -- 172.21.15.146:0/3151601399 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb4d8051e10 con 0x7fb4e80ae730 2023-10-06T11:16:15.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.372+0000 7fb4edac9700 1 -- 172.21.15.146:0/3151601399 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fb4e80b4270 con 0x7fb4e80ae730 2023-10-06T11:16:15.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.375+0000 7fb4cf7fe700 1 -- 172.21.15.146:0/3151601399 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb4d8055430 con 0x7fb4e80ae730 2023-10-06T11:16:15.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.377+0000 7fb4edac9700 1 -- 172.21.15.146:0/3151601399 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb4d4066f30 msgr2=0x7fb4d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:15.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.377+0000 7fb4edac9700 1 --2- 172.21.15.146:0/3151601399 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb4d4066f30 0x7fb4d40693e0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fb4e8155720 tx=0x7fb4dc009040 comp rx=0 tx=0).stop 2023-10-06T11:16:15.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.377+0000 7fb4edac9700 1 -- 172.21.15.146:0/3151601399 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4e80ae730 msgr2=0x7fb4e814e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:15.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.377+0000 7fb4edac9700 1 --2- 172.21.15.146:0/3151601399 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4e80ae730 0x7fb4e814e730 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7fb4d800d810 tx=0x7fb4d8008040 comp rx=0 tx=0).stop 2023-10-06T11:16:15.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.377+0000 7fb4edac9700 1 -- 172.21.15.146:0/3151601399 shutdown_connections 2023-10-06T11:16:15.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.377+0000 7fb4edac9700 1 --2- 172.21.15.146:0/3151601399 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb4d4066f30 0x7fb4d40693e0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:15.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.377+0000 7fb4edac9700 1 --2- 172.21.15.146:0/3151601399 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb4e815a160 0x7fb4e80ca2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:15.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.377+0000 7fb4edac9700 1 --2- 172.21.15.146:0/3151601399 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb4e80ae730 0x7fb4e814e730 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:15.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.377+0000 7fb4edac9700 1 --2- 172.21.15.146:0/3151601399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4e80cb950 0x7fb4e80c9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:15.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.377+0000 7fb4edac9700 1 -- 172.21.15.146:0/3151601399 >> 172.21.15.146:0/3151601399 conn(0x7fb4e806f380 msgr2=0x7fb4e80d0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:15.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.378+0000 7fb4edac9700 1 -- 172.21.15.146:0/3151601399 shutdown_connections 2023-10-06T11:16:15.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.378+0000 7fb4edac9700 1 -- 172.21.15.146:0/3151601399 wait complete. 2023-10-06T11:16:15.392 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover' 2023-10-06T11:16:15.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.506+0000 7f8e2489c700 1 Processor -- start 2023-10-06T11:16:15.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.507+0000 7f8e2489c700 1 -- start start 2023-10-06T11:16:15.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.507+0000 7f8e2489c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e2006f090 0x7f8e2006f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:15.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.507+0000 7f8e2489c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8e200a66f0 0x7f8e200a6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:15.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.507+0000 7f8e2489c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e200b1e90 con 0x7f8e200b1a40 2023-10-06T11:16:15.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.507+0000 7f8e2489c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e201562b0 con 0x7f8e200a66f0 2023-10-06T11:16:15.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.507+0000 7f8e2489c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e200ac720 con 0x7f8e2006f090 2023-10-06T11:16:15.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.507+0000 7f8e1ed9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8e200a66f0 0x7f8e200a6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:15.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.507+0000 7f8e15d9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8e200b1a40 0x7f8e200aff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35176/0 (socket says 172.21.15.146:35176) 2023-10-06T11:16:15.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.507+0000 7f8e15d9b700 1 -- 172.21.15.146:0/2322845093 learned_addr learned my addr 172.21.15.146:0/2322845093 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:16:15.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.508+0000 7f8e1e59c700 1 --2- 172.21.15.146:0/2322845093 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e2006f090 0x7f8e2006f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:15.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.508+0000 7f8e1ed9d700 1 -- 172.21.15.146:0/2322845093 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e2006f090 msgr2=0x7f8e2006f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:15.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.508+0000 7f8e1ed9d700 1 --2- 172.21.15.146:0/2322845093 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e2006f090 0x7f8e2006f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:15.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.508+0000 7f8e1ed9d700 1 -- 172.21.15.146:0/2322845093 >> v1:172.21.15.146:6789/0 conn(0x7f8e200b1a40 legacy=0x7f8e200aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:15.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.508+0000 7f8e1dd9b700 1 -- 172.21.15.146:0/2322845093 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 555659217 0 0) 0x7f8e200b1e90 con 0x7f8e200b1a40 2023-10-06T11:16:15.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.508+0000 7f8e1ed9d700 1 -- 172.21.15.146:0/2322845093 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e200b0610 con 0x7f8e200a66f0 2023-10-06T11:16:15.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.508+0000 7f8e1ed9d700 1 --2- 172.21.15.146:0/2322845093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e200a66f0 0x7f8e200a6b70 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800af70 tx=0x7f8e1800a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58d7dfbea5e6cbf1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:15.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.508+0000 7f8e1dd9b700 1 -- 172.21.15.146:0/2322845093 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1800f070 con 0x7f8e200a66f0 2023-10-06T11:16:15.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.508+0000 7f8e1dd9b700 1 -- 172.21.15.146:0/2322845093 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1800a2e0 con 0x7f8e200a66f0 2023-10-06T11:16:15.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.508+0000 7f8e1dd9b700 1 -- 172.21.15.146:0/2322845093 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1800cd20 con 0x7f8e200a66f0 2023-10-06T11:16:15.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.508+0000 7f8e2489c700 1 -- 172.21.15.146:0/2322845093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e200a66f0 msgr2=0x7f8e200a6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:15.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.508+0000 7f8e2489c700 1 --2- 172.21.15.146:0/2322845093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e200a66f0 0x7f8e200a6b70 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800af70 tx=0x7f8e1800a890 comp rx=0 tx=0).stop 2023-10-06T11:16:15.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.509+0000 7f8e2489c700 1 -- 172.21.15.146:0/2322845093 shutdown_connections 2023-10-06T11:16:15.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.509+0000 7f8e2489c700 1 --2- 172.21.15.146:0/2322845093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e200a66f0 0x7f8e200a6b70 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:15.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.509+0000 7f8e2489c700 1 --2- 172.21.15.146:0/2322845093 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e2006f090 0x7f8e2006f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:15.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.509+0000 7f8e2489c700 1 -- 172.21.15.146:0/2322845093 >> 172.21.15.146:0/2322845093 conn(0x7f8e200cc260 msgr2=0x7f8e200cc660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:15.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.509+0000 7f8e2489c700 1 -- 172.21.15.146:0/2322845093 shutdown_connections 2023-10-06T11:16:15.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.509+0000 7f8e2489c700 1 -- 172.21.15.146:0/2322845093 wait complete. 2023-10-06T11:16:15.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.510+0000 7f8e2489c700 1 Processor -- start 2023-10-06T11:16:15.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.510+0000 7f8e2489c700 1 -- start start 2023-10-06T11:16:15.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.511+0000 7f8e2489c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e2006f090 0x7f8e200cace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:15.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.511+0000 7f8e2489c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e200a66f0 0x7f8e200aa0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:15.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.511+0000 7f8e2489c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e200b1a40 0x7f8e20098ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:15.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.511+0000 7f8e2489c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e20154270 con 0x7f8e200a66f0 2023-10-06T11:16:15.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.511+0000 7f8e2489c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e201686a0 con 0x7f8e2006f090 2023-10-06T11:16:15.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.511+0000 7f8e2489c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e20168980 con 0x7f8e200b1a40 2023-10-06T11:16:15.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.511+0000 7f8e15d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e200a66f0 0x7f8e200aa0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:15.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.511+0000 7f8e15d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e200a66f0 0x7f8e200aa0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51340/0 (socket says 172.21.15.146:51340) 2023-10-06T11:16:15.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.511+0000 7f8e15d9b700 1 -- 172.21.15.146:0/306048069 learned_addr learned my addr 172.21.15.146:0/306048069 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:15.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.511+0000 7f8e1ed9d700 1 --2- 172.21.15.146:0/306048069 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e200b1a40 0x7f8e20098ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:15.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.511+0000 7f8e1e59c700 1 --2- 172.21.15.146:0/306048069 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e2006f090 0x7f8e200cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:15.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.511+0000 7f8e15d9b700 1 -- 172.21.15.146:0/306048069 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e200b1a40 msgr2=0x7f8e20098ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:15.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.511+0000 7f8e15d9b700 1 --2- 172.21.15.146:0/306048069 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e200b1a40 0x7f8e20098ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:15.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.511+0000 7f8e15d9b700 1 -- 172.21.15.146:0/306048069 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e2006f090 msgr2=0x7f8e200cace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:15.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.511+0000 7f8e15d9b700 1 --2- 172.21.15.146:0/306048069 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e2006f090 0x7f8e200cace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:15.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.511+0000 7f8e15d9b700 1 -- 172.21.15.146:0/306048069 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e1800ab30 con 0x7f8e200a66f0 2023-10-06T11:16:15.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.511+0000 7f8e1e59c700 1 --2- 172.21.15.146:0/306048069 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e2006f090 0x7f8e200cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:15.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.511+0000 7f8e1ed9d700 1 --2- 172.21.15.146:0/306048069 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e200b1a40 0x7f8e20098ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:15.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.511+0000 7f8e15d9b700 1 --2- 172.21.15.146:0/306048069 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e200a66f0 0x7f8e200aa0b0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f8e0800c5b0 tx=0x7f8e08001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:15.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.511+0000 7f8e16ffd700 1 -- 172.21.15.146:0/306048069 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e08005b30 con 0x7f8e200a66f0 2023-10-06T11:16:15.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.511+0000 7f8e16ffd700 1 -- 172.21.15.146:0/306048069 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e08005c90 con 0x7f8e200a66f0 2023-10-06T11:16:15.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.511+0000 7f8e2489c700 1 -- 172.21.15.146:0/306048069 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e200aa9b0 con 0x7f8e200a66f0 2023-10-06T11:16:15.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.511+0000 7f8e16ffd700 1 -- 172.21.15.146:0/306048069 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e08007300 con 0x7f8e200a66f0 2023-10-06T11:16:15.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.511+0000 7f8e2489c700 1 -- 172.21.15.146:0/306048069 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e200aaf70 con 0x7f8e200a66f0 2023-10-06T11:16:15.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.512+0000 7f8e2489c700 1 -- 172.21.15.146:0/306048069 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e20168b30 con 0x7f8e200a66f0 2023-10-06T11:16:15.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.513+0000 7f8e16ffd700 1 -- 172.21.15.146:0/306048069 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8e0801b3b0 con 0x7f8e200a66f0 2023-10-06T11:16:15.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.513+0000 7f8e16ffd700 1 --2- 172.21.15.146:0/306048069 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8e00066f30 0x7f8e000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:15.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.513+0000 7f8e1e59c700 1 --2- 172.21.15.146:0/306048069 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8e00066f30 0x7f8e000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:15.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.513+0000 7f8e16ffd700 1 -- 172.21.15.146:0/306048069 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f8e08083930 con 0x7f8e200a66f0 2023-10-06T11:16:15.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.513+0000 7f8e1e59c700 1 --2- 172.21.15.146:0/306048069 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8e00066f30 0x7f8e000693e0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f8e10008a80 tx=0x7f8e10008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:15.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.517+0000 7f8e16ffd700 1 -- 172.21.15.146:0/306048069 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8e20168b30 con 0x7f8e200a66f0 2023-10-06T11:16:15.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:15.804+0000 7f8e2489c700 1 -- 172.21.15.146:0/306048069 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]} v 0) v1 -- 0x7f8e20168af0 con 0x7f8e200a66f0 2023-10-06T11:16:16.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.042+0000 7f8e16ffd700 1 -- 172.21.15.146:0/306048069 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub_checks.TestScrubControls.test_scrub_task_status_on_mds_failover"]}]=0 v496) v1 ==== 166+0+0 (secure 0 0 0) 0x7f8e080170e0 con 0x7f8e200a66f0 2023-10-06T11:16:16.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.044+0000 7f8e2489c700 1 -- 172.21.15.146:0/306048069 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8e00066f30 msgr2=0x7f8e000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:16.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.044+0000 7f8e2489c700 1 --2- 172.21.15.146:0/306048069 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8e00066f30 0x7f8e000693e0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f8e10008a80 tx=0x7f8e10008040 comp rx=0 tx=0).stop 2023-10-06T11:16:16.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.044+0000 7f8e2489c700 1 -- 172.21.15.146:0/306048069 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e200a66f0 msgr2=0x7f8e200aa0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:16.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.044+0000 7f8e2489c700 1 --2- 172.21.15.146:0/306048069 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e200a66f0 0x7f8e200aa0b0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f8e0800c5b0 tx=0x7f8e08001070 comp rx=0 tx=0).stop 2023-10-06T11:16:16.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.044+0000 7f8e2489c700 1 -- 172.21.15.146:0/306048069 shutdown_connections 2023-10-06T11:16:16.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.044+0000 7f8e2489c700 1 --2- 172.21.15.146:0/306048069 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8e00066f30 0x7f8e000693e0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:16.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.044+0000 7f8e2489c700 1 --2- 172.21.15.146:0/306048069 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8e200b1a40 0x7f8e20098ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:16.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.044+0000 7f8e2489c700 1 --2- 172.21.15.146:0/306048069 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e2006f090 0x7f8e200cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:16.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.044+0000 7f8e2489c700 1 --2- 172.21.15.146:0/306048069 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8e200a66f0 0x7f8e200aa0b0 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:16.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.044+0000 7f8e2489c700 1 -- 172.21.15.146:0/306048069 >> 172.21.15.146:0/306048069 conn(0x7f8e200cc260 msgr2=0x7f8e201556b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:16.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.045+0000 7f8e2489c700 1 -- 172.21.15.146:0/306048069 shutdown_connections 2023-10-06T11:16:16.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.045+0000 7f8e2489c700 1 -- 172.21.15.146:0/306048069 wait complete. 2023-10-06T11:16:16.059 INFO:tasks.cephfs_test_runner:test_scrub_task_status_on_mds_failover (tasks.cephfs.test_scrub_checks.TestScrubControls) ... ok 2023-10-06T11:16:16.059 INFO:tasks.cephfs_test_runner:Starting test: test_mdsdir_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2023-10-06T11:16:16.059 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace' 2023-10-06T11:16:16.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.171+0000 7ff6b1a6d700 1 Processor -- start 2023-10-06T11:16:16.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.171+0000 7ff6b1a6d700 1 -- start start 2023-10-06T11:16:16.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.172+0000 7ff6b1a6d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff6ac15a420 0x7ff6ac15cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:16.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.172+0000 7ff6b1a6d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6ac15c630 con 0x7ff6ac0b2530 2023-10-06T11:16:16.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.172+0000 7ff6b1a6d700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6ac15ba20 con 0x7ff6ac15a7f0 2023-10-06T11:16:16.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.172+0000 7ff6b1a6d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6ac0ce040 con 0x7ff6ac15a420 2023-10-06T11:16:16.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.172+0000 7ff6b0a6b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff6ac15a420 0x7ff6ac15cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:16.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.172+0000 7ff6b126c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff6ac0b2530 0x7ff6ac15acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35178/0 (socket says 172.21.15.146:35178) 2023-10-06T11:16:16.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.172+0000 7ff6b0a6b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff6ac15a420 0x7ff6ac15cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51354/0 (socket says 172.21.15.146:51354) 2023-10-06T11:16:16.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.172+0000 7ff6b126c700 1 -- 172.21.15.146:0/1556717368 learned_addr learned my addr 172.21.15.146:0/1556717368 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:16:16.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.173+0000 7ff6b0a6b700 1 -- 172.21.15.146:0/1556717368 >> v1:172.21.15.151:6789/0 conn(0x7ff6ac15a7f0 legacy=0x7ff6ac0b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:16.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.173+0000 7ff6b0a6b700 1 -- 172.21.15.146:0/1556717368 >> v1:172.21.15.146:6789/0 conn(0x7ff6ac0b2530 legacy=0x7ff6ac15acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:16.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.173+0000 7ff6b0a6b700 1 -- 172.21.15.146:0/1556717368 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ac15bd00 con 0x7ff6ac15a420 2023-10-06T11:16:16.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.173+0000 7ff6a37fe700 1 -- 172.21.15.146:0/1556717368 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 770734907 0 0) 0x7ff6ac15c630 con 0x7ff6ac0b2530 2023-10-06T11:16:16.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.173+0000 7ff6b0a6b700 1 --2- 172.21.15.146:0/1556717368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6ac15a420 0x7ff6ac15cac0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8009e60 tx=0x7ff6a8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba795d6601e2fdf3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:16.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.173+0000 7ff6a37fe700 1 -- 172.21.15.146:0/1556717368 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a800e070 con 0x7ff6ac15a420 2023-10-06T11:16:16.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.173+0000 7ff6a37fe700 1 -- 172.21.15.146:0/1556717368 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a800bbf0 con 0x7ff6ac15a420 2023-10-06T11:16:16.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.173+0000 7ff6a37fe700 1 -- 172.21.15.146:0/1556717368 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a8012430 con 0x7ff6ac15a420 2023-10-06T11:16:16.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.173+0000 7ff6b1a6d700 1 -- 172.21.15.146:0/1556717368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6ac15a420 msgr2=0x7ff6ac15cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:16.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.173+0000 7ff6b1a6d700 1 --2- 172.21.15.146:0/1556717368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6ac15a420 0x7ff6ac15cac0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8009e60 tx=0x7ff6a8009780 comp rx=0 tx=0).stop 2023-10-06T11:16:16.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.174+0000 7ff6b1a6d700 1 -- 172.21.15.146:0/1556717368 shutdown_connections 2023-10-06T11:16:16.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.174+0000 7ff6b1a6d700 1 --2- 172.21.15.146:0/1556717368 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6ac15a420 0x7ff6ac15cac0 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:16.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.174+0000 7ff6b1a6d700 1 -- 172.21.15.146:0/1556717368 >> 172.21.15.146:0/1556717368 conn(0x7ff6ac06eba0 msgr2=0x7ff6ac06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:16.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.174+0000 7ff6b1a6d700 1 -- 172.21.15.146:0/1556717368 shutdown_connections 2023-10-06T11:16:16.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.174+0000 7ff6b1a6d700 1 -- 172.21.15.146:0/1556717368 wait complete. 2023-10-06T11:16:16.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.175+0000 7ff6b1a6d700 1 Processor -- start 2023-10-06T11:16:16.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.175+0000 7ff6b1a6d700 1 -- start start 2023-10-06T11:16:16.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.175+0000 7ff6b1a6d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6ac0b2530 0x7ff6ac153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:16.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.176+0000 7ff6b1a6d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6ac15a420 0x7ff6ac14d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:16.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.176+0000 7ff6b1a6d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6ac15a7f0 0x7ff6ac169a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:16.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.176+0000 7ff6b1a6d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac155880 con 0x7ff6ac0b2530 2023-10-06T11:16:16.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.176+0000 7ff6b1a6d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac16a9b0 con 0x7ff6ac15a7f0 2023-10-06T11:16:16.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.176+0000 7ff6b1a6d700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac16a110 con 0x7ff6ac15a420 2023-10-06T11:16:16.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.176+0000 7ff6b0a6b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6ac0b2530 0x7ff6ac153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:16.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.176+0000 7ff6b0a6b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6ac0b2530 0x7ff6ac153520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51370/0 (socket says 172.21.15.146:51370) 2023-10-06T11:16:16.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.176+0000 7ff6b0a6b700 1 -- 172.21.15.146:0/268450179 learned_addr learned my addr 172.21.15.146:0/268450179 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:16.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.176+0000 7ff6a3fff700 1 --2- 172.21.15.146:0/268450179 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6ac15a420 0x7ff6ac14d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:16.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.176+0000 7ff6b126c700 1 --2- 172.21.15.146:0/268450179 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6ac15a7f0 0x7ff6ac169a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:16.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.176+0000 7ff6b0a6b700 1 -- 172.21.15.146:0/268450179 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6ac15a420 msgr2=0x7ff6ac14d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:16.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.176+0000 7ff6b0a6b700 1 --2- 172.21.15.146:0/268450179 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6ac15a420 0x7ff6ac14d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:16.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.176+0000 7ff6b0a6b700 1 -- 172.21.15.146:0/268450179 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6ac15a7f0 msgr2=0x7ff6ac169a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:16.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.176+0000 7ff6b0a6b700 1 --2- 172.21.15.146:0/268450179 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6ac15a7f0 0x7ff6ac169a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:16.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.176+0000 7ff6b0a6b700 1 -- 172.21.15.146:0/268450179 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a8009a20 con 0x7ff6ac0b2530 2023-10-06T11:16:16.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.176+0000 7ff6b126c700 1 --2- 172.21.15.146:0/268450179 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6ac15a7f0 0x7ff6ac169a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:16.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.176+0000 7ff6b0a6b700 1 --2- 172.21.15.146:0/268450179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6ac0b2530 0x7ff6ac153520 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac088e40 tx=0x7ff6a8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:16.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.176+0000 7ff6a0ff9700 1 -- 172.21.15.146:0/268450179 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a8012e90 con 0x7ff6ac0b2530 2023-10-06T11:16:16.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.176+0000 7ff6a0ff9700 1 -- 172.21.15.146:0/268450179 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a8027470 con 0x7ff6ac0b2530 2023-10-06T11:16:16.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.176+0000 7ff6b1a6d700 1 -- 172.21.15.146:0/268450179 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6ac16a3f0 con 0x7ff6ac0b2530 2023-10-06T11:16:16.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.176+0000 7ff6a0ff9700 1 -- 172.21.15.146:0/268450179 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a8027810 con 0x7ff6ac0b2530 2023-10-06T11:16:16.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.176+0000 7ff6b1a6d700 1 -- 172.21.15.146:0/268450179 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6ac154200 con 0x7ff6ac0b2530 2023-10-06T11:16:16.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.177+0000 7ff6b1a6d700 1 -- 172.21.15.146:0/268450179 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6ac1543f0 con 0x7ff6ac0b2530 2023-10-06T11:16:16.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.178+0000 7ff6a0ff9700 1 -- 172.21.15.146:0/268450179 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff6a8024070 con 0x7ff6ac0b2530 2023-10-06T11:16:16.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.178+0000 7ff6a0ff9700 1 --2- 172.21.15.146:0/268450179 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff698066f30 0x7ff6980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:16.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.178+0000 7ff6a0ff9700 1 -- 172.21.15.146:0/268450179 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5378+0+0 (secure 0 0 0) 0x7ff6a8086c70 con 0x7ff6ac0b2530 2023-10-06T11:16:16.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.178+0000 7ff6a3fff700 1 --2- 172.21.15.146:0/268450179 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff698066f30 0x7ff6980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:16.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.179+0000 7ff6a3fff700 1 --2- 172.21.15.146:0/268450179 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff698066f30 0x7ff6980693e0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac06f9b0 tx=0x7ff69c009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:16.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.183+0000 7ff6a0ff9700 1 -- 172.21.15.146:0/268450179 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff6a8054020 con 0x7ff6ac0b2530 2023-10-06T11:16:16.441 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:16.439+0000 7ff6b1a6d700 1 -- 172.21.15.146:0/268450179 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]} v 0) v1 -- 0x7ff6ac0afae0 con 0x7ff6ac0b2530 2023-10-06T11:16:17.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.045+0000 7ff6a0ff9700 1 -- 172.21.15.146:0/268450179 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]}]=0 v497) v1 ==== 143+0+0 (secure 0 0 0) 0x7ff6a8057640 con 0x7ff6ac0b2530 2023-10-06T11:16:17.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.047+0000 7ff6b1a6d700 1 -- 172.21.15.146:0/268450179 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff698066f30 msgr2=0x7ff6980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:17.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.047+0000 7ff6b1a6d700 1 --2- 172.21.15.146:0/268450179 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff698066f30 0x7ff6980693e0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac06f9b0 tx=0x7ff69c009060 comp rx=0 tx=0).stop 2023-10-06T11:16:17.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.047+0000 7ff6b1a6d700 1 -- 172.21.15.146:0/268450179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6ac0b2530 msgr2=0x7ff6ac153520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:17.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.047+0000 7ff6b1a6d700 1 --2- 172.21.15.146:0/268450179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6ac0b2530 0x7ff6ac153520 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac088e40 tx=0x7ff6a8018000 comp rx=0 tx=0).stop 2023-10-06T11:16:17.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.048+0000 7ff6b1a6d700 1 -- 172.21.15.146:0/268450179 shutdown_connections 2023-10-06T11:16:17.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.048+0000 7ff6b1a6d700 1 --2- 172.21.15.146:0/268450179 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff698066f30 0x7ff6980693e0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.048+0000 7ff6b1a6d700 1 --2- 172.21.15.146:0/268450179 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6ac15a7f0 0x7ff6ac169a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.048+0000 7ff6b1a6d700 1 --2- 172.21.15.146:0/268450179 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6ac0b2530 0x7ff6ac153520 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.048+0000 7ff6b1a6d700 1 --2- 172.21.15.146:0/268450179 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6ac15a420 0x7ff6ac14d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.048+0000 7ff6b1a6d700 1 -- 172.21.15.146:0/268450179 >> 172.21.15.146:0/268450179 conn(0x7ff6ac06eba0 msgr2=0x7ff6ac14f960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:17.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.048+0000 7ff6b1a6d700 1 -- 172.21.15.146:0/268450179 shutdown_connections 2023-10-06T11:16:17.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.048+0000 7ff6b1a6d700 1 -- 172.21.15.146:0/268450179 wait complete. 2023-10-06T11:16:17.064 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T11:16:17.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.186+0000 7f398bc40700 1 Processor -- start 2023-10-06T11:16:17.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.186+0000 7f398bc40700 1 -- start start 2023-10-06T11:16:17.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.187+0000 7f398bc40700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f39840abfe0 0x7f39840add00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.187+0000 7f398bc40700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f39840ceb50 0x7f39840af5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.187+0000 7f398bc40700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39840ae550 con 0x7f39840ac3b0 2023-10-06T11:16:17.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.187+0000 7f398bc40700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39840ae830 con 0x7f39840ceb50 2023-10-06T11:16:17.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.187+0000 7f398bc40700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39840aeb10 con 0x7f39840abfe0 2023-10-06T11:16:17.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.187+0000 7f39891db700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f39840ceb50 0x7f39840af5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.187+0000 7f39891db700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f39840ceb50 0x7f39840af5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51372/0 (socket says 172.21.15.146:51372) 2023-10-06T11:16:17.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.187+0000 7f39891db700 1 -- 172.21.15.146:0/3011746506 learned_addr learned my addr 172.21.15.146:0/3011746506 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:17.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.188+0000 7f39899dc700 1 --2- 172.21.15.146:0/3011746506 >> v2:172.21.15.151:3300/0 conn(0x7f39840abfe0 0x7f39840add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.188+0000 7f39891db700 1 -- 172.21.15.146:0/3011746506 >> v2:172.21.15.151:3300/0 conn(0x7f39840abfe0 msgr2=0x7f39840add00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:17.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.188+0000 7f39891db700 1 --2- 172.21.15.146:0/3011746506 >> v2:172.21.15.151:3300/0 conn(0x7f39840abfe0 0x7f39840add00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.188+0000 7f39891db700 1 -- 172.21.15.146:0/3011746506 >> v1:172.21.15.151:6789/0 conn(0x7f39840ac3b0 legacy=0x7f39840ac810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:17.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.188+0000 7f39891db700 1 -- 172.21.15.146:0/3011746506 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39840aedf0 con 0x7f39840ceb50 2023-10-06T11:16:17.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.188+0000 7f39891db700 1 --2- 172.21.15.146:0/3011746506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39840ceb50 0x7f39840af5f0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f398406e480 tx=0x7f3974009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef7527b9ab352fe1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:17.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.188+0000 7f39889da700 1 -- 172.21.15.146:0/3011746506 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397400b820 con 0x7f39840ceb50 2023-10-06T11:16:17.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.188+0000 7f39889da700 1 -- 172.21.15.146:0/3011746506 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397400b980 con 0x7f39840ceb50 2023-10-06T11:16:17.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.188+0000 7f39889da700 1 -- 172.21.15.146:0/3011746506 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397400bd20 con 0x7f39840ceb50 2023-10-06T11:16:17.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.189+0000 7f398bc40700 1 -- 172.21.15.146:0/3011746506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39840ceb50 msgr2=0x7f39840af5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:17.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.189+0000 7f398bc40700 1 --2- 172.21.15.146:0/3011746506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39840ceb50 0x7f39840af5f0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f398406e480 tx=0x7f3974009250 comp rx=0 tx=0).stop 2023-10-06T11:16:17.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.189+0000 7f398bc40700 1 -- 172.21.15.146:0/3011746506 shutdown_connections 2023-10-06T11:16:17.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.189+0000 7f398bc40700 1 --2- 172.21.15.146:0/3011746506 >> v2:172.21.15.151:3300/0 conn(0x7f39840abfe0 0x7f39840add00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.189+0000 7f398bc40700 1 --2- 172.21.15.146:0/3011746506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39840ceb50 0x7f39840af5f0 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.189+0000 7f398bc40700 1 -- 172.21.15.146:0/3011746506 >> 172.21.15.146:0/3011746506 conn(0x7f3984067c50 msgr2=0x7f39840ce440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:17.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.189+0000 7f398bc40700 1 -- 172.21.15.146:0/3011746506 shutdown_connections 2023-10-06T11:16:17.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.189+0000 7f398bc40700 1 -- 172.21.15.146:0/3011746506 wait complete. 2023-10-06T11:16:17.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.190+0000 7f398bc40700 1 Processor -- start 2023-10-06T11:16:17.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.190+0000 7f398bc40700 1 -- start start 2023-10-06T11:16:17.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.191+0000 7f398bc40700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39840abfe0 0x7f39841594e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.191+0000 7f398bc40700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39840ac3b0 0x7f39841511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.191+0000 7f398bc40700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39840ceb50 0x7f398409b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.191+0000 7f398bc40700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3984159050 con 0x7f39840ceb50 2023-10-06T11:16:17.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.191+0000 7f398bc40700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3984158440 con 0x7f39840ac3b0 2023-10-06T11:16:17.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.191+0000 7f398bc40700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3984158720 con 0x7f39840abfe0 2023-10-06T11:16:17.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.191+0000 7f398a1dd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39840ceb50 0x7f398409b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.191+0000 7f398a1dd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39840ceb50 0x7f398409b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51374/0 (socket says 172.21.15.146:51374) 2023-10-06T11:16:17.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.191+0000 7f398a1dd700 1 -- 172.21.15.146:0/3750920188 learned_addr learned my addr 172.21.15.146:0/3750920188 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:17.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.191+0000 7f39891db700 1 --2- 172.21.15.146:0/3750920188 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39840ac3b0 0x7f39841511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.191+0000 7f39899dc700 1 --2- 172.21.15.146:0/3750920188 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39840abfe0 0x7f39841594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.191+0000 7f398a1dd700 1 -- 172.21.15.146:0/3750920188 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39840abfe0 msgr2=0x7f39841594e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:17.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.191+0000 7f398a1dd700 1 --2- 172.21.15.146:0/3750920188 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39840abfe0 0x7f39841594e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.191+0000 7f398a1dd700 1 -- 172.21.15.146:0/3750920188 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39840ac3b0 msgr2=0x7f39841511a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:17.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.191+0000 7f398a1dd700 1 --2- 172.21.15.146:0/3750920188 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39840ac3b0 0x7f39841511a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.191+0000 7f398a1dd700 1 -- 172.21.15.146:0/3750920188 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39740094f0 con 0x7f39840ceb50 2023-10-06T11:16:17.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.191+0000 7f398a1dd700 1 --2- 172.21.15.146:0/3750920188 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39840ceb50 0x7f398409b6b0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f397c00c930 tx=0x7f397c0026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:17.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.191+0000 7f3979ffb700 1 -- 172.21.15.146:0/3750920188 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c012630 con 0x7f39840ceb50 2023-10-06T11:16:17.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.191+0000 7f3979ffb700 1 -- 172.21.15.146:0/3750920188 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397c0127d0 con 0x7f39840ceb50 2023-10-06T11:16:17.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.191+0000 7f3979ffb700 1 -- 172.21.15.146:0/3750920188 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c012b90 con 0x7f39840ceb50 2023-10-06T11:16:17.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.191+0000 7f398bc40700 1 -- 172.21.15.146:0/3750920188 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3984158a00 con 0x7f39840ceb50 2023-10-06T11:16:17.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.192+0000 7f398bc40700 1 -- 172.21.15.146:0/3750920188 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3984159a20 con 0x7f39840ceb50 2023-10-06T11:16:17.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.192+0000 7f398bc40700 1 -- 172.21.15.146:0/3750920188 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39841591c0 con 0x7f39840ceb50 2023-10-06T11:16:17.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.193+0000 7f3979ffb700 1 -- 172.21.15.146:0/3750920188 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f397c01a3b0 con 0x7f39840ceb50 2023-10-06T11:16:17.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.193+0000 7f3979ffb700 1 --2- 172.21.15.146:0/3750920188 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3968066f30 0x7f39680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.193+0000 7f3979ffb700 1 -- 172.21.15.146:0/3750920188 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f397c0840a0 con 0x7f39840ceb50 2023-10-06T11:16:17.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.193+0000 7f39899dc700 1 --2- 172.21.15.146:0/3750920188 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3968066f30 0x7f39680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.194+0000 7f39899dc700 1 --2- 172.21.15.146:0/3750920188 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3968066f30 0x7f39680693e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f3980006fd0 tx=0x7f3980008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:17.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.197+0000 7f3979ffb700 1 -- 172.21.15.146:0/3750920188 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f397c054ee0 con 0x7f39840ceb50 2023-10-06T11:16:17.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.382+0000 7f398bc40700 1 -- 172.21.15.146:0/3750920188 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f398404c380 con 0x7f39840ceb50 2023-10-06T11:16:17.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.386+0000 7f3979ffb700 1 -- 172.21.15.146:0/3750920188 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7f397c054a70 con 0x7f39840ceb50 2023-10-06T11:16:17.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.388+0000 7f398bc40700 1 -- 172.21.15.146:0/3750920188 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3968066f30 msgr2=0x7f39680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:17.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.388+0000 7f398bc40700 1 --2- 172.21.15.146:0/3750920188 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3968066f30 0x7f39680693e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f3980006fd0 tx=0x7f3980008040 comp rx=0 tx=0).stop 2023-10-06T11:16:17.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.388+0000 7f398bc40700 1 -- 172.21.15.146:0/3750920188 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39840ceb50 msgr2=0x7f398409b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:17.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.388+0000 7f398bc40700 1 --2- 172.21.15.146:0/3750920188 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39840ceb50 0x7f398409b6b0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f397c00c930 tx=0x7f397c0026e0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.388+0000 7f398bc40700 1 -- 172.21.15.146:0/3750920188 shutdown_connections 2023-10-06T11:16:17.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.388+0000 7f398bc40700 1 --2- 172.21.15.146:0/3750920188 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3968066f30 0x7f39680693e0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.388+0000 7f398bc40700 1 --2- 172.21.15.146:0/3750920188 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f39840ceb50 0x7f398409b6b0 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.388+0000 7f398bc40700 1 --2- 172.21.15.146:0/3750920188 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f39840abfe0 0x7f39841594e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.388+0000 7f398bc40700 1 --2- 172.21.15.146:0/3750920188 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39840ac3b0 0x7f39841511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.388+0000 7f398bc40700 1 -- 172.21.15.146:0/3750920188 >> 172.21.15.146:0/3750920188 conn(0x7f3984067c50 msgr2=0x7f398406d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:17.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.388+0000 7f398bc40700 1 -- 172.21.15.146:0/3750920188 shutdown_connections 2023-10-06T11:16:17.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.388+0000 7f398bc40700 1 -- 172.21.15.146:0/3750920188 wait complete. 2023-10-06T11:16:17.402 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T11:16:17.402 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:16:17.448 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:16:17.490 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T11:16:17.490 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T11:16:17.491 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:16:17.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.603+0000 7f558cb28700 1 Processor -- start 2023-10-06T11:16:17.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.603+0000 7f558cb28700 1 -- start start 2023-10-06T11:16:17.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.604+0000 7f558cb28700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f558815a420 0x7f558815cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.604+0000 7f558cb28700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f558815a7f0 0x7f55880b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.604+0000 7f558cb28700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f558815c630 con 0x7f55880b2360 2023-10-06T11:16:17.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.604+0000 7f558cb28700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55880ce040 con 0x7f558815a420 2023-10-06T11:16:17.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.604+0000 7f558cb28700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55880b27e0 con 0x7f558815a7f0 2023-10-06T11:16:17.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.604+0000 7f5587fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f55880b2360 0x7f558815acd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35186/0 (socket says 172.21.15.146:35186) 2023-10-06T11:16:17.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.604+0000 7f5587fff700 1 -- 172.21.15.146:0/2242596819 learned_addr learned my addr 172.21.15.146:0/2242596819 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:16:17.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.604+0000 7f557effd700 1 --2- 172.21.15.146:0/2242596819 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f558815a7f0 0x7f55880b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.604+0000 7f5586ffd700 1 -- 172.21.15.146:0/2242596819 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1912758458 0 0) 0x7f558815c630 con 0x7f55880b2360 2023-10-06T11:16:17.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.604+0000 7f55877fe700 1 --2- 172.21.15.146:0/2242596819 >> v2:172.21.15.151:3300/0 conn(0x7f558815a420 0x7f558815cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.604+0000 7f5586ffd700 1 -- 172.21.15.146:0/2242596819 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5574003570 con 0x7f55880b2360 2023-10-06T11:16:17.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.604+0000 7f5586ffd700 1 -- 172.21.15.146:0/2242596819 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 679542144 0 0) 0x7f5574003570 con 0x7f55880b2360 2023-10-06T11:16:17.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.604+0000 7f5586ffd700 1 -- 172.21.15.146:0/2242596819 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f558815a7f0 msgr2=0x7f55880b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:17.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.604+0000 7f5586ffd700 1 --2- 172.21.15.146:0/2242596819 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f558815a7f0 0x7f55880b1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.604+0000 7f5586ffd700 1 -- 172.21.15.146:0/2242596819 >> v2:172.21.15.151:3300/0 conn(0x7f558815a420 msgr2=0x7f558815cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:17.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.604+0000 7f5586ffd700 1 --2- 172.21.15.146:0/2242596819 >> v2:172.21.15.151:3300/0 conn(0x7f558815a420 0x7f558815cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.604+0000 7f5586ffd700 1 -- 172.21.15.146:0/2242596819 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f558815ba20 con 0x7f55880b2360 2023-10-06T11:16:17.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.604+0000 7f5586ffd700 1 -- 172.21.15.146:0/2242596819 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f55800017f0 con 0x7f55880b2360 2023-10-06T11:16:17.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.605+0000 7f5586ffd700 1 -- 172.21.15.146:0/2242596819 >> v1:172.21.15.146:6789/0 conn(0x7f55880b2360 legacy=0x7f558815acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:17.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.605+0000 7f5586ffd700 1 --2- 172.21.15.146:0/2242596819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5574003a90 0x7f5574003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.605+0000 7f5586ffd700 1 --2- 172.21.15.146:0/2242596819 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5574004810 0x7f5574004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.605+0000 7f5586ffd700 1 --2- 172.21.15.146:0/2242596819 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f558815a7f0 0x7f55740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.605+0000 7f5586ffd700 1 -- 172.21.15.146:0/2242596819 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55880b27e0 con 0x7f5574003a90 2023-10-06T11:16:17.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.605+0000 7f5586ffd700 1 -- 172.21.15.146:0/2242596819 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557400ba60 con 0x7f5574004810 2023-10-06T11:16:17.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.605+0000 7f5586ffd700 1 -- 172.21.15.146:0/2242596819 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f557400bbd0 con 0x7f558815a7f0 2023-10-06T11:16:17.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.605+0000 7f55877fe700 1 --2- 172.21.15.146:0/2242596819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5574003a90 0x7f5574003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.605+0000 7f557effd700 1 --2- 172.21.15.146:0/2242596819 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5574004810 0x7f5574004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.605+0000 7f5587fff700 1 --2- 172.21.15.146:0/2242596819 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f558815a7f0 0x7f55740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.605+0000 7f55877fe700 1 -- 172.21.15.146:0/2242596819 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f558815a7f0 msgr2=0x7f55740051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:17.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.605+0000 7f55877fe700 1 --2- 172.21.15.146:0/2242596819 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f558815a7f0 0x7f55740051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.605+0000 7f55877fe700 1 -- 172.21.15.146:0/2242596819 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5574004810 msgr2=0x7f5574004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:17.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.605+0000 7f55877fe700 1 --2- 172.21.15.146:0/2242596819 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5574004810 0x7f5574004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.605+0000 7f55877fe700 1 -- 172.21.15.146:0/2242596819 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5574003570 con 0x7f5574003a90 2023-10-06T11:16:17.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.605+0000 7f55877fe700 1 --2- 172.21.15.146:0/2242596819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5574003a90 0x7f5574003ea0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f5578009c00 tx=0x7f55780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63bc70f5c247f603 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:17.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.605+0000 7f5586ffd700 1 -- 172.21.15.146:0/2242596819 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557800e6b0 con 0x7f5574003a90 2023-10-06T11:16:17.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.605+0000 7f5586ffd700 1 -- 172.21.15.146:0/2242596819 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f557800e810 con 0x7f5574003a90 2023-10-06T11:16:17.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.605+0000 7f5586ffd700 1 -- 172.21.15.146:0/2242596819 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557800ebd0 con 0x7f5574003a90 2023-10-06T11:16:17.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.606+0000 7f558cb28700 1 -- 172.21.15.146:0/2242596819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5574003a90 msgr2=0x7f5574003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:17.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.606+0000 7f558cb28700 1 --2- 172.21.15.146:0/2242596819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5574003a90 0x7f5574003ea0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f5578009c00 tx=0x7f55780091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.606+0000 7f5587fff700 1 -- 172.21.15.146:0/2242596819 reap_dead start 2023-10-06T11:16:17.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.606+0000 7f558cb28700 1 -- 172.21.15.146:0/2242596819 shutdown_connections 2023-10-06T11:16:17.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.606+0000 7f558cb28700 1 -- 172.21.15.146:0/2242596819 >> 172.21.15.146:0/2242596819 conn(0x7f558806eba0 msgr2=0x7f558806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:17.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.606+0000 7f558cb28700 1 -- 172.21.15.146:0/2242596819 shutdown_connections 2023-10-06T11:16:17.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.606+0000 7f558cb28700 1 -- 172.21.15.146:0/2242596819 wait complete. 2023-10-06T11:16:17.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.607+0000 7f558cb28700 1 Processor -- start 2023-10-06T11:16:17.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.607+0000 7f558cb28700 1 -- start start 2023-10-06T11:16:17.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.608+0000 7f558cb28700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5574003a90 0x7f55880b1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.608+0000 7f558cb28700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5588152f20 0x7f5588143ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.608+0000 7f558cb28700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55880b1ac0 0x7f5588144010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.608+0000 7f558cb28700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5588144550 con 0x7f5588152f20 2023-10-06T11:16:17.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.608+0000 7f558cb28700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f558814db60 con 0x7f5574003a90 2023-10-06T11:16:17.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.608+0000 7f558cb28700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5588152160 con 0x7f55880b1ac0 2023-10-06T11:16:17.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.608+0000 7f557effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5588152f20 0x7f5588143ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.608+0000 7f557effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5588152f20 0x7f5588143ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51384/0 (socket says 172.21.15.146:51384) 2023-10-06T11:16:17.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.608+0000 7f557effd700 1 -- 172.21.15.146:0/2769495363 learned_addr learned my addr 172.21.15.146:0/2769495363 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:17.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.608+0000 7f55877fe700 1 --2- 172.21.15.146:0/2769495363 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5574003a90 0x7f55880b1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.608+0000 7f5587fff700 1 --2- 172.21.15.146:0/2769495363 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55880b1ac0 0x7f5588144010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.608+0000 7f557effd700 1 -- 172.21.15.146:0/2769495363 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55880b1ac0 msgr2=0x7f5588144010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:17.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.608+0000 7f557effd700 1 --2- 172.21.15.146:0/2769495363 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55880b1ac0 0x7f5588144010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.608+0000 7f557effd700 1 -- 172.21.15.146:0/2769495363 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5574003a90 msgr2=0x7f55880b1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:17.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.608+0000 7f557effd700 1 --2- 172.21.15.146:0/2769495363 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5574003a90 0x7f55880b1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.608+0000 7f557effd700 1 -- 172.21.15.146:0/2769495363 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5588152440 con 0x7f5588152f20 2023-10-06T11:16:17.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.608+0000 7f557effd700 1 --2- 172.21.15.146:0/2769495363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5588152f20 0x7f5588143ad0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f5570011b70 tx=0x7f55700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:17.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.608+0000 7f557ffff700 1 -- 172.21.15.146:0/2769495363 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557000f940 con 0x7f5588152f20 2023-10-06T11:16:17.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.608+0000 7f557ffff700 1 -- 172.21.15.146:0/2769495363 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f557000faa0 con 0x7f5588152f20 2023-10-06T11:16:17.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.608+0000 7f558cb28700 1 -- 172.21.15.146:0/2769495363 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5588152720 con 0x7f5588152f20 2023-10-06T11:16:17.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.608+0000 7f557ffff700 1 -- 172.21.15.146:0/2769495363 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557000fe20 con 0x7f5588152f20 2023-10-06T11:16:17.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.608+0000 7f558cb28700 1 -- 172.21.15.146:0/2769495363 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f558814ce70 con 0x7f5588152f20 2023-10-06T11:16:17.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.609+0000 7f558cb28700 1 -- 172.21.15.146:0/2769495363 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5588152c40 con 0x7f5588152f20 2023-10-06T11:16:17.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.610+0000 7f557ffff700 1 -- 172.21.15.146:0/2769495363 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5570014650 con 0x7f5588152f20 2023-10-06T11:16:17.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.610+0000 7f557ffff700 1 --2- 172.21.15.146:0/2769495363 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5568066f30 0x7f55680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:17.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.610+0000 7f557ffff700 1 -- 172.21.15.146:0/2769495363 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f5570018030 con 0x7f5588152f20 2023-10-06T11:16:17.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.610+0000 7f55877fe700 1 --2- 172.21.15.146:0/2769495363 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5568066f30 0x7f55680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:17.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.611+0000 7f55877fe700 1 --2- 172.21.15.146:0/2769495363 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5568066f30 0x7f55680693e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f55780091e0 tx=0x7f557801a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:17.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.614+0000 7f557ffff700 1 -- 172.21.15.146:0/2769495363 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5588152c40 con 0x7f5588152f20 2023-10-06T11:16:17.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.837+0000 7f558cb28700 1 -- 172.21.15.146:0/2769495363 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5588152c40 con 0x7f5588152f20 2023-10-06T11:16:17.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.837+0000 7f557ffff700 1 -- 172.21.15.146:0/2769495363 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 115 v115) v1 ==== 95+0+2785 (secure 0 0 0) 0x7f5588152c40 con 0x7f5588152f20 2023-10-06T11:16:17.840 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:16:17.840 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":115,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7792,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3693464886","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3693464886},{"type":"v1","addr":"172.21.15.151:6834","nonce":3693464886}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103},{"gid":7795,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/1155762565","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":1155762565},{"type":"v1","addr":"172.21.15.151:6835","nonce":1155762565}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":103},{"gid":9123,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/2617832126","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2617832126},{"type":"v1","addr":"172.21.15.146:6835","nonce":2617832126}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":115}],"filesystems":[]} 2023-10-06T11:16:17.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.839+0000 7f558cb28700 1 -- 172.21.15.146:0/2769495363 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5568066f30 msgr2=0x7f55680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:17.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.839+0000 7f558cb28700 1 --2- 172.21.15.146:0/2769495363 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5568066f30 0x7f55680693e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f55780091e0 tx=0x7f557801a000 comp rx=0 tx=0).stop 2023-10-06T11:16:17.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.839+0000 7f558cb28700 1 -- 172.21.15.146:0/2769495363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5588152f20 msgr2=0x7f5588143ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:17.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.839+0000 7f558cb28700 1 --2- 172.21.15.146:0/2769495363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5588152f20 0x7f5588143ad0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f5570011b70 tx=0x7f55700091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.840+0000 7f558cb28700 1 -- 172.21.15.146:0/2769495363 shutdown_connections 2023-10-06T11:16:17.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.840+0000 7f558cb28700 1 --2- 172.21.15.146:0/2769495363 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5568066f30 0x7f55680693e0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.840+0000 7f558cb28700 1 --2- 172.21.15.146:0/2769495363 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55880b1ac0 0x7f5588144010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.840+0000 7f558cb28700 1 --2- 172.21.15.146:0/2769495363 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5574003a90 0x7f55880b1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.840+0000 7f558cb28700 1 --2- 172.21.15.146:0/2769495363 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5588152f20 0x7f5588143ad0 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:17.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.840+0000 7f558cb28700 1 -- 172.21.15.146:0/2769495363 >> 172.21.15.146:0/2769495363 conn(0x7f558806eba0 msgr2=0x7f558815af30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:17.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.840+0000 7f558cb28700 1 -- 172.21.15.146:0/2769495363 shutdown_connections 2023-10-06T11:16:17.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:17.840+0000 7f558cb28700 1 -- 172.21.15.146:0/2769495363 wait complete. 2023-10-06T11:16:17.844 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 115 2023-10-06T11:16:17.855 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T11:16:17.855 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T11:16:17.855 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T11:16:17.855 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:16:17.855 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T11:16:17.856 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T11:16:17.856 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T11:16:17.856 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T11:16:17.856 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T11:16:17.856 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:16:17.857 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T11:16:17.857 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T11:16:17.858 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T11:16:17.858 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:16:17.860 INFO:tasks.ceph.mds.c:Started 2023-10-06T11:16:17.860 DEBUG:teuthology.parallel:result is None 2023-10-06T11:16:17.863 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T11:16:17.864 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T11:16:17.868 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T11:16:17.869 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T11:16:17.869 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T11:16:17.870 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T11:16:17.907 INFO:tasks.ceph.mds.a:Started 2023-10-06T11:16:17.907 DEBUG:teuthology.parallel:result is None 2023-10-06T11:16:17.911 INFO:tasks.ceph.mds.b:Started 2023-10-06T11:16:17.912 INFO:tasks.ceph.mds.d:Started 2023-10-06T11:16:17.912 DEBUG:teuthology.parallel:result is None 2023-10-06T11:16:17.912 DEBUG:teuthology.parallel:result is None 2023-10-06T11:16:17.913 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T11:16:17.933 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2023-10-06T11:16:17.983 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2023-10-06T11:16:17.996 INFO:tasks.ceph.mds.d.smithi151.stdout:starting mds.d at 2023-10-06T11:16:17.996 INFO:tasks.ceph.mds.b.smithi151.stdout:starting mds.b at 2023-10-06T11:16:18.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.032+0000 7ffa5b5bc700 1 Processor -- start 2023-10-06T11:16:18.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.033+0000 7ffa5b5bc700 1 -- start start 2023-10-06T11:16:18.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.033+0000 7ffa5b5bc700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa5415cc20 0x7ffa5415d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:18.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.033+0000 7ffa5b5bc700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa540cf030 con 0x7ffa5415cff0 2023-10-06T11:16:18.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.033+0000 7ffa5b5bc700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa540ced20 con 0x7ffa540d0c50 2023-10-06T11:16:18.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.033+0000 7ffa5b5bc700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa5415e390 con 0x7ffa5415cc20 2023-10-06T11:16:18.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.033+0000 7ffa58b57700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ffa5415cff0 0x7ffa540d0540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35220/0 (socket says 172.21.15.146:35220) 2023-10-06T11:16:18.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.033+0000 7ffa58b57700 1 -- 172.21.15.146:0/3568188039 learned_addr learned my addr 172.21.15.146:0/3568188039 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:16:18.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.034+0000 7ffa59358700 1 --2- 172.21.15.146:0/3568188039 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa5415cc20 0x7ffa5415d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:18.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.034+0000 7ffa4bfff700 1 -- 172.21.15.146:0/3568188039 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3470634256 0 0) 0x7ffa540cf030 con 0x7ffa5415cff0 2023-10-06T11:16:18.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.034+0000 7ffa4bfff700 1 -- 172.21.15.146:0/3568188039 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa40003570 con 0x7ffa5415cff0 2023-10-06T11:16:18.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.034+0000 7ffa4bfff700 1 -- 172.21.15.146:0/3568188039 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4166065905 0 0) 0x7ffa540ced20 con 0x7ffa540d0c50 2023-10-06T11:16:18.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.034+0000 7ffa4bfff700 1 -- 172.21.15.146:0/3568188039 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa540cf030 con 0x7ffa540d0c50 2023-10-06T11:16:18.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.034+0000 7ffa59358700 1 -- 172.21.15.146:0/3568188039 >> v1:172.21.15.151:6789/0 conn(0x7ffa540d0c50 legacy=0x7ffa5415a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:18.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.034+0000 7ffa4bfff700 1 -- 172.21.15.146:0/3568188039 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2404416266 0 0) 0x7ffa40003570 con 0x7ffa5415cff0 2023-10-06T11:16:18.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.034+0000 7ffa59358700 1 -- 172.21.15.146:0/3568188039 >> v1:172.21.15.146:6789/0 conn(0x7ffa5415cff0 legacy=0x7ffa540d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:18.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.034+0000 7ffa59358700 1 -- 172.21.15.146:0/3568188039 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5415daf0 con 0x7ffa5415cc20 2023-10-06T11:16:18.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.034+0000 7ffa59358700 1 --2- 172.21.15.146:0/3568188039 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa5415cc20 0x7ffa5415d460 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ffa50009900 tx=0x7ffa50009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d59f9aca6c5bc9a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:18.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.034+0000 7ffa4bfff700 1 -- 172.21.15.146:0/3568188039 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa44001470 con 0x7ffa5415cc20 2023-10-06T11:16:18.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.034+0000 7ffa4bfff700 1 -- 172.21.15.146:0/3568188039 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa50011420 con 0x7ffa5415cc20 2023-10-06T11:16:18.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.034+0000 7ffa4bfff700 1 -- 172.21.15.146:0/3568188039 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa500117c0 con 0x7ffa5415cc20 2023-10-06T11:16:18.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.035+0000 7ffa5b5bc700 1 -- 172.21.15.146:0/3568188039 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa5415cc20 msgr2=0x7ffa5415d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:18.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.035+0000 7ffa5b5bc700 1 --2- 172.21.15.146:0/3568188039 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa5415cc20 0x7ffa5415d460 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ffa50009900 tx=0x7ffa50009120 comp rx=0 tx=0).stop 2023-10-06T11:16:18.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.035+0000 7ffa5b5bc700 1 -- 172.21.15.146:0/3568188039 shutdown_connections 2023-10-06T11:16:18.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.035+0000 7ffa5b5bc700 1 --2- 172.21.15.146:0/3568188039 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa5415cc20 0x7ffa5415d460 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:18.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.035+0000 7ffa5b5bc700 1 -- 172.21.15.146:0/3568188039 >> 172.21.15.146:0/3568188039 conn(0x7ffa5406eba0 msgr2=0x7ffa5406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:18.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.035+0000 7ffa5b5bc700 1 -- 172.21.15.146:0/3568188039 shutdown_connections 2023-10-06T11:16:18.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.035+0000 7ffa5b5bc700 1 -- 172.21.15.146:0/3568188039 wait complete. 2023-10-06T11:16:18.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.036+0000 7ffa5b5bc700 1 Processor -- start 2023-10-06T11:16:18.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.036+0000 7ffa5b5bc700 1 -- start start 2023-10-06T11:16:18.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.037+0000 7ffa5b5bc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa540d0c50 0x7ffa541456a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:18.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.037+0000 7ffa5b5bc700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa5415cc20 0x7ffa540cb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:18.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.037+0000 7ffa5b5bc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa5415cff0 0x7ffa54158e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:18.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.037+0000 7ffa5b5bc700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa540c71b0 con 0x7ffa540d0c50 2023-10-06T11:16:18.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.037+0000 7ffa5b5bc700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa540c7490 con 0x7ffa5415cff0 2023-10-06T11:16:18.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.037+0000 7ffa5b5bc700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa540c7770 con 0x7ffa5415cc20 2023-10-06T11:16:18.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.037+0000 7ffa59358700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa540d0c50 0x7ffa541456a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:18.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.037+0000 7ffa59358700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa540d0c50 0x7ffa541456a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51416/0 (socket says 172.21.15.146:51416) 2023-10-06T11:16:18.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.037+0000 7ffa59358700 1 -- 172.21.15.146:0/1276126741 learned_addr learned my addr 172.21.15.146:0/1276126741 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:18.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.037+0000 7ffa59358700 1 -- 172.21.15.146:0/1276126741 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa5415cc20 msgr2=0x7ffa540cb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:18.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.037+0000 7ffa59358700 1 --2- 172.21.15.146:0/1276126741 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa5415cc20 0x7ffa540cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:18.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.037+0000 7ffa59358700 1 -- 172.21.15.146:0/1276126741 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa5415cff0 msgr2=0x7ffa54158e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:18.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.037+0000 7ffa59b59700 1 --2- 172.21.15.146:0/1276126741 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa5415cff0 0x7ffa54158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:18.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.037+0000 7ffa59358700 1 --2- 172.21.15.146:0/1276126741 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa5415cff0 0x7ffa54158e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:18.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.037+0000 7ffa59358700 1 -- 172.21.15.146:0/1276126741 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa500093c0 con 0x7ffa540d0c50 2023-10-06T11:16:18.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.037+0000 7ffa59358700 1 --2- 172.21.15.146:0/1276126741 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa540d0c50 0x7ffa541456a0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7ffa50009160 tx=0x7ffa50016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:18.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.038+0000 7ffa497fa700 1 -- 172.21.15.146:0/1276126741 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5001cc90 con 0x7ffa540d0c50 2023-10-06T11:16:18.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.038+0000 7ffa497fa700 1 -- 172.21.15.146:0/1276126741 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5001cdf0 con 0x7ffa540d0c50 2023-10-06T11:16:18.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.038+0000 7ffa5b5bc700 1 -- 172.21.15.146:0/1276126741 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa540c7a50 con 0x7ffa540d0c50 2023-10-06T11:16:18.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.038+0000 7ffa497fa700 1 -- 172.21.15.146:0/1276126741 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5001a6a0 con 0x7ffa540d0c50 2023-10-06T11:16:18.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.038+0000 7ffa5b5bc700 1 -- 172.21.15.146:0/1276126741 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa540c6e80 con 0x7ffa540d0c50 2023-10-06T11:16:18.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.039+0000 7ffa5b5bc700 1 -- 172.21.15.146:0/1276126741 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa5404c380 con 0x7ffa540d0c50 2023-10-06T11:16:18.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.039+0000 7ffa497fa700 1 -- 172.21.15.146:0/1276126741 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffa5001aa90 con 0x7ffa540d0c50 2023-10-06T11:16:18.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.039+0000 7ffa497fa700 1 --2- 172.21.15.146:0/1276126741 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ffa38066f30 0x7ffa380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:18.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.039+0000 7ffa497fa700 1 -- 172.21.15.146:0/1276126741 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5378+0+0 (secure 0 0 0) 0x7ffa50085db0 con 0x7ffa540d0c50 2023-10-06T11:16:18.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.039+0000 7ffa58b57700 1 --2- 172.21.15.146:0/1276126741 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ffa38066f30 0x7ffa380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:18.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.040+0000 7ffa58b57700 1 --2- 172.21.15.146:0/1276126741 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ffa38066f30 0x7ffa380693e0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7ffa440011e0 tx=0x7ffa44001340 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:18.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.044+0000 7ffa497fa700 1 -- 172.21.15.146:0/1276126741 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffa50053160 con 0x7ffa540d0c50 2023-10-06T11:16:18.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:18.245+0000 7ffa5b5bc700 1 -- 172.21.15.146:0/1276126741 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ffa540b3b50 con 0x7ffa540d0c50 2023-10-06T11:16:19.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.069+0000 7ffa497fa700 1 -- 172.21.15.146:0/1276126741 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v133) v1 ==== 97+0+0 (secure 0 0 0) 0x7ffa50056780 con 0x7ffa540d0c50 2023-10-06T11:16:19.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.071+0000 7ffa5b5bc700 1 -- 172.21.15.146:0/1276126741 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ffa38066f30 msgr2=0x7ffa380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:19.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.071+0000 7ffa5b5bc700 1 --2- 172.21.15.146:0/1276126741 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ffa38066f30 0x7ffa380693e0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7ffa440011e0 tx=0x7ffa44001340 comp rx=0 tx=0).stop 2023-10-06T11:16:19.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.071+0000 7ffa5b5bc700 1 -- 172.21.15.146:0/1276126741 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa540d0c50 msgr2=0x7ffa541456a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:19.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.071+0000 7ffa5b5bc700 1 --2- 172.21.15.146:0/1276126741 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa540d0c50 0x7ffa541456a0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7ffa50009160 tx=0x7ffa50016000 comp rx=0 tx=0).stop 2023-10-06T11:16:19.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.072+0000 7ffa5b5bc700 1 -- 172.21.15.146:0/1276126741 shutdown_connections 2023-10-06T11:16:19.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.072+0000 7ffa5b5bc700 1 --2- 172.21.15.146:0/1276126741 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ffa38066f30 0x7ffa380693e0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.072+0000 7ffa5b5bc700 1 --2- 172.21.15.146:0/1276126741 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa5415cff0 0x7ffa54158e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.072+0000 7ffa5b5bc700 1 --2- 172.21.15.146:0/1276126741 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffa540d0c50 0x7ffa541456a0 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.072+0000 7ffa5b5bc700 1 --2- 172.21.15.146:0/1276126741 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffa5415cc20 0x7ffa540cb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.072+0000 7ffa5b5bc700 1 -- 172.21.15.146:0/1276126741 >> 172.21.15.146:0/1276126741 conn(0x7ffa5406eba0 msgr2=0x7ffa540b3d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:19.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.072+0000 7ffa5b5bc700 1 -- 172.21.15.146:0/1276126741 shutdown_connections 2023-10-06T11:16:19.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.072+0000 7ffa5b5bc700 1 -- 172.21.15.146:0/1276126741 wait complete. 2023-10-06T11:16:19.075 INFO:teuthology.orchestra.run.smithi146.stderr: removed all blocklist entries 2023-10-06T11:16:19.087 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T11:16:19.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.246+0000 7fb91395c700 1 Processor -- start 2023-10-06T11:16:19.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.246+0000 7fb91395c700 1 -- start start 2023-10-06T11:16:19.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.247+0000 7fb91395c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb90c0cf2d0 0x7fb90c0c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:19.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.247+0000 7fb91395c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb90c0c53f0 0x7fb90c0ad730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:19.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.247+0000 7fb91395c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb90c0ad2a0 con 0x7fb90c0b28e0 2023-10-06T11:16:19.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.247+0000 7fb91395c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb90c099ec0 con 0x7fb90c0cf2d0 2023-10-06T11:16:19.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.247+0000 7fb91395c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb90c0c7240 con 0x7fb90c0c53f0 2023-10-06T11:16:19.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.247+0000 7fb910ef7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb90c0cf2d0 0x7fb90c0c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:19.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.247+0000 7fb9116f8700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb90c0b28e0 0x7fb90c0cebc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35230/0 (socket says 172.21.15.146:35230) 2023-10-06T11:16:19.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.247+0000 7fb9116f8700 1 -- 172.21.15.146:0/3847642704 learned_addr learned my addr 172.21.15.146:0/3847642704 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:16:19.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.247+0000 7fb911ef9700 1 --2- 172.21.15.146:0/3847642704 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb90c0c53f0 0x7fb90c0ad730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:19.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.247+0000 7fb910ef7700 1 -- 172.21.15.146:0/3847642704 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb90c0c53f0 msgr2=0x7fb90c0ad730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:19.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.247+0000 7fb910ef7700 1 --2- 172.21.15.146:0/3847642704 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb90c0c53f0 0x7fb90c0ad730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.247+0000 7fb910ef7700 1 -- 172.21.15.146:0/3847642704 >> v1:172.21.15.146:6789/0 conn(0x7fb90c0b28e0 legacy=0x7fb90c0cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:19.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.247+0000 7fb903fff700 1 -- 172.21.15.146:0/3847642704 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2263658202 0 0) 0x7fb90c0ad2a0 con 0x7fb90c0b28e0 2023-10-06T11:16:19.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.247+0000 7fb910ef7700 1 -- 172.21.15.146:0/3847642704 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb90c0c69a0 con 0x7fb90c0cf2d0 2023-10-06T11:16:19.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.247+0000 7fb910ef7700 1 --2- 172.21.15.146:0/3847642704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb90c0cf2d0 0x7fb90c0c6310 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc0098e0 tx=0x7fb8fc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca0db42a6b2b3388 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:19.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.247+0000 7fb903fff700 1 -- 172.21.15.146:0/3847642704 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc009e80 con 0x7fb90c0cf2d0 2023-10-06T11:16:19.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.247+0000 7fb903fff700 1 -- 172.21.15.146:0/3847642704 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8fc00b860 con 0x7fb90c0cf2d0 2023-10-06T11:16:19.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.247+0000 7fb903fff700 1 -- 172.21.15.146:0/3847642704 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc00bbe0 con 0x7fb90c0cf2d0 2023-10-06T11:16:19.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.248+0000 7fb91395c700 1 -- 172.21.15.146:0/3847642704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb90c0cf2d0 msgr2=0x7fb90c0c6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:19.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.248+0000 7fb91395c700 1 --2- 172.21.15.146:0/3847642704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb90c0cf2d0 0x7fb90c0c6310 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc0098e0 tx=0x7fb8fc0091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.248+0000 7fb91395c700 1 -- 172.21.15.146:0/3847642704 shutdown_connections 2023-10-06T11:16:19.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.248+0000 7fb91395c700 1 --2- 172.21.15.146:0/3847642704 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb90c0c53f0 0x7fb90c0ad730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.248+0000 7fb91395c700 1 --2- 172.21.15.146:0/3847642704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb90c0cf2d0 0x7fb90c0c6310 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.248+0000 7fb91395c700 1 -- 172.21.15.146:0/3847642704 >> 172.21.15.146:0/3847642704 conn(0x7fb90c0999a0 msgr2=0x7fb90c06f380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:19.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.248+0000 7fb91395c700 1 -- 172.21.15.146:0/3847642704 shutdown_connections 2023-10-06T11:16:19.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.248+0000 7fb91395c700 1 -- 172.21.15.146:0/3847642704 wait complete. 2023-10-06T11:16:19.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.249+0000 7fb91395c700 1 Processor -- start 2023-10-06T11:16:19.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.249+0000 7fb91395c700 1 -- start start 2023-10-06T11:16:19.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.250+0000 7fb91395c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb90c0b28e0 0x7fb90c1556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:19.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.250+0000 7fb91395c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb90c0c53f0 0x7fb90c0b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:19.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.250+0000 7fb91395c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb90c0cf2d0 0x7fb90c0b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:19.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.250+0000 7fb91395c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb90c0b4950 con 0x7fb90c0cf2d0 2023-10-06T11:16:19.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.250+0000 7fb91395c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb90c0b3d40 con 0x7fb90c0c53f0 2023-10-06T11:16:19.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.250+0000 7fb91395c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb90c0b4020 con 0x7fb90c0b28e0 2023-10-06T11:16:19.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.250+0000 7fb911ef9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb90c0cf2d0 0x7fb90c0b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:19.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.250+0000 7fb911ef9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb90c0cf2d0 0x7fb90c0b4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51440/0 (socket says 172.21.15.146:51440) 2023-10-06T11:16:19.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.250+0000 7fb911ef9700 1 -- 172.21.15.146:0/493487622 learned_addr learned my addr 172.21.15.146:0/493487622 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:19.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.250+0000 7fb911ef9700 1 -- 172.21.15.146:0/493487622 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb90c0b28e0 msgr2=0x7fb90c1556a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:19.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.250+0000 7fb9116f8700 1 --2- 172.21.15.146:0/493487622 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb90c0b28e0 0x7fb90c1556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:19.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.250+0000 7fb911ef9700 1 --2- 172.21.15.146:0/493487622 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb90c0b28e0 0x7fb90c1556a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.250+0000 7fb911ef9700 1 -- 172.21.15.146:0/493487622 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb90c0c53f0 msgr2=0x7fb90c0b33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:19.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.250+0000 7fb910ef7700 1 --2- 172.21.15.146:0/493487622 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb90c0c53f0 0x7fb90c0b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:19.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.250+0000 7fb911ef9700 1 --2- 172.21.15.146:0/493487622 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb90c0c53f0 0x7fb90c0b33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.250+0000 7fb911ef9700 1 -- 172.21.15.146:0/493487622 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8fc009420 con 0x7fb90c0cf2d0 2023-10-06T11:16:19.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.251+0000 7fb911ef9700 1 --2- 172.21.15.146:0/493487622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb90c0cf2d0 0x7fb90c0b4de0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7fb90400ceb0 tx=0x7fb904007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:19.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.251+0000 7fb9017fa700 1 -- 172.21.15.146:0/493487622 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90400ae40 con 0x7fb90c0cf2d0 2023-10-06T11:16:19.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.251+0000 7fb9017fa700 1 -- 172.21.15.146:0/493487622 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb904016430 con 0x7fb90c0cf2d0 2023-10-06T11:16:19.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.251+0000 7fb91395c700 1 -- 172.21.15.146:0/493487622 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb90c0b4300 con 0x7fb90c0cf2d0 2023-10-06T11:16:19.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.251+0000 7fb9017fa700 1 -- 172.21.15.146:0/493487622 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9040167d0 con 0x7fb90c0cf2d0 2023-10-06T11:16:19.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.251+0000 7fb91395c700 1 -- 172.21.15.146:0/493487622 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb90c155be0 con 0x7fb90c0cf2d0 2023-10-06T11:16:19.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.252+0000 7fb91395c700 1 -- 172.21.15.146:0/493487622 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb90c04c380 con 0x7fb90c0cf2d0 2023-10-06T11:16:19.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.252+0000 7fb9017fa700 1 -- 172.21.15.146:0/493487622 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb904003020 con 0x7fb90c0cf2d0 2023-10-06T11:16:19.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.253+0000 7fb9017fa700 1 --2- 172.21.15.146:0/493487622 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb8f0066f30 0x7fb8f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:19.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.253+0000 7fb9116f8700 1 --2- 172.21.15.146:0/493487622 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb8f0066f30 0x7fb8f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:19.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.253+0000 7fb9017fa700 1 -- 172.21.15.146:0/493487622 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fb904012070 con 0x7fb90c0cf2d0 2023-10-06T11:16:19.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.253+0000 7fb9116f8700 1 --2- 172.21.15.146:0/493487622 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb8f0066f30 0x7fb8f00693e0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fb908001780 tx=0x7fb908009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:19.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.257+0000 7fb9017fa700 1 -- 172.21.15.146:0/493487622 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb904052750 con 0x7fb90c0cf2d0 2023-10-06T11:16:19.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.512+0000 7fb91395c700 1 -- 172.21.15.146:0/493487622 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb90c0c6c80 con 0x7fb90c0cf2d0 2023-10-06T11:16:19.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.513+0000 7fb9017fa700 1 -- 172.21.15.146:0/493487622 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fb904055d70 con 0x7fb90c0cf2d0 2023-10-06T11:16:19.515 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:16:19.515 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:16:19.515 INFO:teuthology.orchestra.run.smithi146.stdout: "auth_dump": [ 2023-10-06T11:16:19.515 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:16:19.515 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.a", 2023-10-06T11:16:19.515 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lG4F8DBAAp5A4Dtfzvv8n9ORgkmiP9g==", 2023-10-06T11:16:19.515 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:16:19.515 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:16:19.515 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:16:19.516 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:16:19.516 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:16:19.516 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:16:19.516 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:16:19.516 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:16:19.516 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.b", 2023-10-06T11:16:19.516 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lDIceGBAA4cr0oGVaXiy5hrruKY5DGw==", 2023-10-06T11:16:19.516 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:16:19.516 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:16:19.516 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:16:19.517 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:16:19.517 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:16:19.517 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:16:19.517 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:16:19.517 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:16:19.517 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.c", 2023-10-06T11:16:19.517 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lbYA7ExAAAopKjS7+WMUE5fuVQygILQ==", 2023-10-06T11:16:19.517 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:16:19.517 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:16:19.517 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:16:19.517 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:16:19.517 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:16:19.518 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:16:19.518 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:16:19.518 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:16:19.518 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.d", 2023-10-06T11:16:19.518 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9laygiHxAAasUUn7Wk9EwLa36ggsZtHw==", 2023-10-06T11:16:19.518 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:16:19.518 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:16:19.518 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:16:19.518 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:16:19.518 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:16:19.518 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:16:19.518 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:16:19.518 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:16:19.519 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.0", 2023-10-06T11:16:19.519 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDX6R9lLGo9NhAAcWJuUeOdEUsdDw84W9nLPw==", 2023-10-06T11:16:19.519 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:16:19.519 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:16:19.519 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:16:19.519 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:16:19.519 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:16:19.519 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:16:19.519 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:16:19.519 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.1", 2023-10-06T11:16:19.519 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDa6R9lk02gNBAA9YqWT2/Xds20lv0sGtBApg==", 2023-10-06T11:16:19.519 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:16:19.520 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:16:19.520 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:16:19.520 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:16:19.520 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:16:19.520 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:16:19.520 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:16:19.520 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.2", 2023-10-06T11:16:19.520 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDd6R9lrA6xMxAAmH8r6m2p4Jpa82xfYNcq+g==", 2023-10-06T11:16:19.520 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:16:19.520 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:16:19.520 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:16:19.520 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:16:19.520 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:16:19.521 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:16:19.521 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:16:19.521 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.3", 2023-10-06T11:16:19.521 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDg6R9ltlHXNBAAvhfI1yjlaWCIE9Xr/4F/PA==", 2023-10-06T11:16:19.521 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:16:19.521 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:16:19.521 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:16:19.521 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:16:19.521 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:16:19.521 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:16:19.521 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:16:19.521 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.4", 2023-10-06T11:16:19.521 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDm6R9lPUCvMhAAGbUNfpoFi9SvYdelpnL1jA==", 2023-10-06T11:16:19.522 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:16:19.522 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:16:19.522 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:16:19.522 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:16:19.522 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:16:19.522 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:16:19.522 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:16:19.522 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.5", 2023-10-06T11:16:19.522 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDp6R9lMfrMMBAAUEtnXDNr7+L3dQm4QE9qDw==", 2023-10-06T11:16:19.522 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:16:19.522 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:16:19.522 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:16:19.522 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:16:19.523 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:16:19.523 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:16:19.523 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:16:19.523 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.6", 2023-10-06T11:16:19.523 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDs6R9lAmSDMBAArPp+6dVt/NyH9is46tL49g==", 2023-10-06T11:16:19.523 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:16:19.523 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:16:19.523 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:16:19.523 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:16:19.523 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:16:19.523 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:16:19.523 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:16:19.523 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.7", 2023-10-06T11:16:19.524 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDv6R9lnunMLRAA3o5ZtAyYDUoXTzjX9H8FCw==", 2023-10-06T11:16:19.524 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:16:19.524 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:16:19.524 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:16:19.524 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:16:19.524 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:16:19.524 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:16:19.524 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:16:19.524 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.0", 2023-10-06T11:16:19.524 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lCrPrIhAARrzj2VxVFkzF5L/ifIAqmw==", 2023-10-06T11:16:19.524 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:16:19.524 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:16:19.524 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow r", 2023-10-06T11:16:19.525 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T11:16:19.525 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:16:19.525 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:16:19.525 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:16:19.525 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.1", 2023-10-06T11:16:19.525 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9l10VSKxAA0HmXejgRRCQ7XpsMB7ljkQ==", 2023-10-06T11:16:19.525 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:16:19.525 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:16:19.525 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2023-10-06T11:16:19.525 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2023-10-06T11:16:19.525 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2023-10-06T11:16:19.525 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:16:19.526 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:16:19.526 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:16:19.526 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.2", 2023-10-06T11:16:19.526 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lpLpJKBAAF/vLDkBg9/VBqMK4pVVIkg==", 2023-10-06T11:16:19.526 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:16:19.526 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:16:19.526 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2023-10-06T11:16:19.526 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2023-10-06T11:16:19.526 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2023-10-06T11:16:19.526 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:16:19.527 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:16:19.527 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:16:19.527 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.3", 2023-10-06T11:16:19.527 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9luMqwMBAA4Y4I9hWTk2IqAzYwVQ13Pw==", 2023-10-06T11:16:19.527 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:16:19.527 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:16:19.527 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2023-10-06T11:16:19.527 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2023-10-06T11:16:19.527 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2023-10-06T11:16:19.527 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:16:19.527 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:16:19.527 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:16:19.527 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.admin", 2023-10-06T11:16:19.528 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDT6R9lSr9qIhAAiNEN9xFWUwFGsB+oUE1cXw==", 2023-10-06T11:16:19.528 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:16:19.528 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2023-10-06T11:16:19.528 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:16:19.528 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:16:19.528 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:16:19.528 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:16:19.528 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:16:19.528 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:16:19.528 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.x", 2023-10-06T11:16:19.528 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9llLpwCRAA4UH9Uqli2de9HIJR2fZ9xg==", 2023-10-06T11:16:19.528 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:16:19.529 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2023-10-06T11:16:19.529 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2023-10-06T11:16:19.529 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:16:19.529 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:16:19.529 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:16:19.529 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:16:19.529 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.y", 2023-10-06T11:16:19.529 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDT6R9l2uQxNxAAVSMhKVzbf2vC4opL7YCLdg==", 2023-10-06T11:16:19.529 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:16:19.529 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2023-10-06T11:16:19.529 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2023-10-06T11:16:19.529 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:16:19.529 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:16:19.530 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:16:19.530 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2023-10-06T11:16:19.530 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:16:19.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.515+0000 7fb91395c700 1 -- 172.21.15.146:0/493487622 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb8f0066f30 msgr2=0x7fb8f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:19.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.515+0000 7fb91395c700 1 --2- 172.21.15.146:0/493487622 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb8f0066f30 0x7fb8f00693e0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fb908001780 tx=0x7fb908009040 comp rx=0 tx=0).stop 2023-10-06T11:16:19.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.515+0000 7fb91395c700 1 -- 172.21.15.146:0/493487622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb90c0cf2d0 msgr2=0x7fb90c0b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:19.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.515+0000 7fb91395c700 1 --2- 172.21.15.146:0/493487622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb90c0cf2d0 0x7fb90c0b4de0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7fb90400ceb0 tx=0x7fb904007870 comp rx=0 tx=0).stop 2023-10-06T11:16:19.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.515+0000 7fb91395c700 1 -- 172.21.15.146:0/493487622 shutdown_connections 2023-10-06T11:16:19.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.515+0000 7fb91395c700 1 --2- 172.21.15.146:0/493487622 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb8f0066f30 0x7fb8f00693e0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.515+0000 7fb91395c700 1 --2- 172.21.15.146:0/493487622 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb90c0cf2d0 0x7fb90c0b4de0 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.515+0000 7fb91395c700 1 --2- 172.21.15.146:0/493487622 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb90c0b28e0 0x7fb90c1556a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.515+0000 7fb91395c700 1 --2- 172.21.15.146:0/493487622 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb90c0c53f0 0x7fb90c0b33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.515+0000 7fb91395c700 1 -- 172.21.15.146:0/493487622 >> 172.21.15.146:0/493487622 conn(0x7fb90c0999a0 msgr2=0x7fb90c068da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:19.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.515+0000 7fb91395c700 1 -- 172.21.15.146:0/493487622 shutdown_connections 2023-10-06T11:16:19.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.515+0000 7fb91395c700 1 -- 172.21.15.146:0/493487622 wait complete. 2023-10-06T11:16:19.533 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:16:19.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.646+0000 7fa29547f700 1 Processor -- start 2023-10-06T11:16:19.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.646+0000 7fa29547f700 1 -- start start 2023-10-06T11:16:19.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.647+0000 7fa29547f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa2900c3910 0x7fa2900c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:19.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.647+0000 7fa29547f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2900cf210 con 0x7fa2900b0c00 2023-10-06T11:16:19.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.647+0000 7fa29547f700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa290068790 con 0x7fa2900ced80 2023-10-06T11:16:19.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.647+0000 7fa29547f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2900682f0 con 0x7fa2900c3910 2023-10-06T11:16:19.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.647+0000 7fa28effd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa2900b0c00 0x7fa2900c3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35234/0 (socket says 172.21.15.146:35234) 2023-10-06T11:16:19.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.647+0000 7fa28effd700 1 -- 172.21.15.146:0/1898281573 learned_addr learned my addr 172.21.15.146:0/1898281573 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:16:19.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.648+0000 7fa28e7fc700 1 -- 172.21.15.146:0/1898281573 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3584542933 0 0) 0x7fa2900cf210 con 0x7fa2900b0c00 2023-10-06T11:16:19.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.648+0000 7fa28e7fc700 1 -- 172.21.15.146:0/1898281573 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa27c003570 con 0x7fa2900b0c00 2023-10-06T11:16:19.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.648+0000 7fa28f7fe700 1 --2- 172.21.15.146:0/1898281573 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa2900c3910 0x7fa2900c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:19.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.648+0000 7fa28e7fc700 1 -- 172.21.15.146:0/1898281573 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3443115609 0 0) 0x7fa27c003570 con 0x7fa2900b0c00 2023-10-06T11:16:19.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.648+0000 7fa28e7fc700 1 -- 172.21.15.146:0/1898281573 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa2900c3910 msgr2=0x7fa2900c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:19.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.648+0000 7fa28e7fc700 1 --2- 172.21.15.146:0/1898281573 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa2900c3910 0x7fa2900c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.648+0000 7fa28e7fc700 1 -- 172.21.15.146:0/1898281573 >> v1:172.21.15.151:6789/0 conn(0x7fa2900ced80 legacy=0x7fa2900cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:19.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.648+0000 7fa28e7fc700 1 -- 172.21.15.146:0/1898281573 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa290068a70 con 0x7fa2900b0c00 2023-10-06T11:16:19.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.648+0000 7fa28e7fc700 1 -- 172.21.15.146:0/1898281573 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fa280001470 con 0x7fa2900b0c00 2023-10-06T11:16:19.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.648+0000 7fa28e7fc700 1 -- 172.21.15.146:0/1898281573 >> v1:172.21.15.146:6789/0 conn(0x7fa2900b0c00 legacy=0x7fa2900c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:19.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.648+0000 7fa28e7fc700 1 --2- 172.21.15.146:0/1898281573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa27c003a90 0x7fa27c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:19.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.648+0000 7fa28e7fc700 1 --2- 172.21.15.146:0/1898281573 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa27c004810 0x7fa27c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:19.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.648+0000 7fa28e7fc700 1 --2- 172.21.15.146:0/1898281573 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa2900c3910 0x7fa27c005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:19.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.648+0000 7fa28e7fc700 1 -- 172.21.15.146:0/1898281573 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2900682f0 con 0x7fa27c003a90 2023-10-06T11:16:19.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.648+0000 7fa28e7fc700 1 -- 172.21.15.146:0/1898281573 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c00bc20 con 0x7fa27c004810 2023-10-06T11:16:19.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.648+0000 7fa28e7fc700 1 -- 172.21.15.146:0/1898281573 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa27c00bde0 con 0x7fa2900c3910 2023-10-06T11:16:19.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.648+0000 7fa28effd700 1 --2- 172.21.15.146:0/1898281573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa27c003a90 0x7fa27c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:19.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.648+0000 7fa2867fc700 1 --2- 172.21.15.146:0/1898281573 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa27c004810 0x7fa27c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:19.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.648+0000 7fa28f7fe700 1 --2- 172.21.15.146:0/1898281573 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa2900c3910 0x7fa27c005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:19.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.648+0000 7fa28effd700 1 -- 172.21.15.146:0/1898281573 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa2900c3910 msgr2=0x7fa27c005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:19.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.648+0000 7fa28effd700 1 --2- 172.21.15.146:0/1898281573 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa2900c3910 0x7fa27c005290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.648+0000 7fa28effd700 1 -- 172.21.15.146:0/1898281573 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa27c004810 msgr2=0x7fa27c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:19.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.648+0000 7fa28effd700 1 --2- 172.21.15.146:0/1898281573 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa27c004810 0x7fa27c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.648+0000 7fa28effd700 1 -- 172.21.15.146:0/1898281573 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa27c003570 con 0x7fa27c003a90 2023-10-06T11:16:19.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.648+0000 7fa28effd700 1 --2- 172.21.15.146:0/1898281573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa27c003a90 0x7fa27c003ea0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7fa28000c390 tx=0x7fa280001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4666feff0e8ee7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:19.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.649+0000 7fa28e7fc700 1 -- 172.21.15.146:0/1898281573 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28000cc60 con 0x7fa27c003a90 2023-10-06T11:16:19.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.649+0000 7fa28e7fc700 1 -- 172.21.15.146:0/1898281573 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28000cdc0 con 0x7fa27c003a90 2023-10-06T11:16:19.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.649+0000 7fa28e7fc700 1 -- 172.21.15.146:0/1898281573 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa280005b50 con 0x7fa27c003a90 2023-10-06T11:16:19.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.649+0000 7fa29547f700 1 -- 172.21.15.146:0/1898281573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa27c003a90 msgr2=0x7fa27c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:19.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.649+0000 7fa29547f700 1 --2- 172.21.15.146:0/1898281573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa27c003a90 0x7fa27c003ea0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7fa28000c390 tx=0x7fa280001e50 comp rx=0 tx=0).stop 2023-10-06T11:16:19.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.649+0000 7fa28f7fe700 1 -- 172.21.15.146:0/1898281573 reap_dead start 2023-10-06T11:16:19.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.649+0000 7fa29547f700 1 -- 172.21.15.146:0/1898281573 shutdown_connections 2023-10-06T11:16:19.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.649+0000 7fa29547f700 1 -- 172.21.15.146:0/1898281573 >> 172.21.15.146:0/1898281573 conn(0x7fa290067c50 msgr2=0x7fa2900ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:19.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.649+0000 7fa29547f700 1 -- 172.21.15.146:0/1898281573 shutdown_connections 2023-10-06T11:16:19.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.649+0000 7fa29547f700 1 -- 172.21.15.146:0/1898281573 wait complete. 2023-10-06T11:16:19.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.650+0000 7fa29547f700 1 Processor -- start 2023-10-06T11:16:19.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.651+0000 7fa29547f700 1 -- start start 2023-10-06T11:16:19.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.651+0000 7fa29547f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa27c003a90 0x7fa2901527b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:19.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.651+0000 7fa29547f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2900b2cf0 0x7fa2900c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:19.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.651+0000 7fa29547f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2900b1bc0 0x7fa2900c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:19.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.651+0000 7fa29547f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2900c6ea0 con 0x7fa2900b1bc0 2023-10-06T11:16:19.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.651+0000 7fa29547f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2900c7180 con 0x7fa2900b2cf0 2023-10-06T11:16:19.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.651+0000 7fa29547f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2900c7460 con 0x7fa27c003a90 2023-10-06T11:16:19.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.651+0000 7fa28f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2900b1bc0 0x7fa2900c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:19.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.651+0000 7fa28f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2900b1bc0 0x7fa2900c93d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51462/0 (socket says 172.21.15.146:51462) 2023-10-06T11:16:19.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.651+0000 7fa28f7fe700 1 -- 172.21.15.146:0/2206552909 learned_addr learned my addr 172.21.15.146:0/2206552909 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:19.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.651+0000 7fa2867fc700 1 --2- 172.21.15.146:0/2206552909 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2900b2cf0 0x7fa2900c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:19.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.651+0000 7fa28effd700 1 --2- 172.21.15.146:0/2206552909 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa27c003a90 0x7fa2901527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:19.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.652+0000 7fa28f7fe700 1 -- 172.21.15.146:0/2206552909 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa27c003a90 msgr2=0x7fa2901527b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:19.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.652+0000 7fa28f7fe700 1 --2- 172.21.15.146:0/2206552909 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa27c003a90 0x7fa2901527b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.652+0000 7fa28f7fe700 1 -- 172.21.15.146:0/2206552909 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2900b2cf0 msgr2=0x7fa2900c7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:19.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.652+0000 7fa28f7fe700 1 --2- 172.21.15.146:0/2206552909 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2900b2cf0 0x7fa2900c7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.652+0000 7fa28f7fe700 1 -- 172.21.15.146:0/2206552909 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2900c7740 con 0x7fa2900b1bc0 2023-10-06T11:16:19.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.652+0000 7fa28f7fe700 1 --2- 172.21.15.146:0/2206552909 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2900b1bc0 0x7fa2900c93d0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7fa290088c30 tx=0x7fa288009710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:19.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.652+0000 7fa2877fe700 1 -- 172.21.15.146:0/2206552909 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa288002ca0 con 0x7fa2900b1bc0 2023-10-06T11:16:19.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.652+0000 7fa2877fe700 1 -- 172.21.15.146:0/2206552909 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa288002e00 con 0x7fa2900b1bc0 2023-10-06T11:16:19.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.652+0000 7fa29547f700 1 -- 172.21.15.146:0/2206552909 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2900c7a20 con 0x7fa2900b1bc0 2023-10-06T11:16:19.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.652+0000 7fa2877fe700 1 -- 172.21.15.146:0/2206552909 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa288015670 con 0x7fa2900b1bc0 2023-10-06T11:16:19.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.652+0000 7fa29547f700 1 -- 172.21.15.146:0/2206552909 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2900b2220 con 0x7fa2900b1bc0 2023-10-06T11:16:19.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.653+0000 7fa29547f700 1 -- 172.21.15.146:0/2206552909 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa29004c380 con 0x7fa2900b1bc0 2023-10-06T11:16:19.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.653+0000 7fa2877fe700 1 -- 172.21.15.146:0/2206552909 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa288003040 con 0x7fa2900b1bc0 2023-10-06T11:16:19.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.654+0000 7fa2877fe700 1 --2- 172.21.15.146:0/2206552909 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa270066f30 0x7fa2700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:19.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.654+0000 7fa2877fe700 1 -- 172.21.15.146:0/2206552909 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fa288084780 con 0x7fa2900b1bc0 2023-10-06T11:16:19.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.654+0000 7fa28effd700 1 --2- 172.21.15.146:0/2206552909 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa270066f30 0x7fa2700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:19.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.654+0000 7fa28effd700 1 --2- 172.21.15.146:0/2206552909 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa270066f30 0x7fa2700693e0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fa280007cd0 tx=0x7fa280015000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:19.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.658+0000 7fa2877fe700 1 -- 172.21.15.146:0/2206552909 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa288051c90 con 0x7fa2900b1bc0 2023-10-06T11:16:19.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.841+0000 7fa29547f700 1 -- 172.21.15.146:0/2206552909 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2900b2220 con 0x7fa2900b1bc0 2023-10-06T11:16:19.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.842+0000 7fa2877fe700 1 -- 172.21.15.146:0/2206552909 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v133) v1 ==== 74+0+13708 (secure 0 0 0) 0x7fa2900b2220 con 0x7fa2900b1bc0 2023-10-06T11:16:19.846 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:16:19.849 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":133,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:16:19.063214+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":123,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:16:19.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.844+0000 7fa29547f700 1 -- 172.21.15.146:0/2206552909 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa270066f30 msgr2=0x7fa2700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:19.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.844+0000 7fa29547f700 1 --2- 172.21.15.146:0/2206552909 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa270066f30 0x7fa2700693e0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fa280007cd0 tx=0x7fa280015000 comp rx=0 tx=0).stop 2023-10-06T11:16:19.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.844+0000 7fa29547f700 1 -- 172.21.15.146:0/2206552909 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2900b1bc0 msgr2=0x7fa2900c93d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:19.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.844+0000 7fa29547f700 1 --2- 172.21.15.146:0/2206552909 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2900b1bc0 0x7fa2900c93d0 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7fa290088c30 tx=0x7fa288009710 comp rx=0 tx=0).stop 2023-10-06T11:16:19.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.844+0000 7fa29547f700 1 -- 172.21.15.146:0/2206552909 shutdown_connections 2023-10-06T11:16:19.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.844+0000 7fa29547f700 1 --2- 172.21.15.146:0/2206552909 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa270066f30 0x7fa2700693e0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.844+0000 7fa29547f700 1 --2- 172.21.15.146:0/2206552909 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa2900b1bc0 0x7fa2900c93d0 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.844+0000 7fa29547f700 1 --2- 172.21.15.146:0/2206552909 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa27c003a90 0x7fa2901527b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.844+0000 7fa29547f700 1 --2- 172.21.15.146:0/2206552909 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2900b2cf0 0x7fa2900c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.844+0000 7fa29547f700 1 -- 172.21.15.146:0/2206552909 >> 172.21.15.146:0/2206552909 conn(0x7fa290067c50 msgr2=0x7fa2900c3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:19.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.845+0000 7fa29547f700 1 -- 172.21.15.146:0/2206552909 shutdown_connections 2023-10-06T11:16:19.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.845+0000 7fa29547f700 1 -- 172.21.15.146:0/2206552909 wait complete. 2023-10-06T11:16:19.859 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:05:36.687307+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:05:37.171199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T11:16:19.859 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:16:19.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.974+0000 7fd60df10700 1 Processor -- start 2023-10-06T11:16:19.976 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.974+0000 7fd60df10700 1 -- start start 2023-10-06T11:16:19.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.975+0000 7fd60df10700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6080abfe0 0x7fd6080add00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:19.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.975+0000 7fd60df10700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd6080ac3b0 0x7fd6080ac800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:19.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.975+0000 7fd60df10700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6080ae550 con 0x7fd6080ceb50 2023-10-06T11:16:19.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.975+0000 7fd60df10700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6080ae830 con 0x7fd6080ac3b0 2023-10-06T11:16:19.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.975+0000 7fd60df10700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6080aeb10 con 0x7fd6080abfe0 2023-10-06T11:16:19.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.976+0000 7fd6077fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6080abfe0 0x7fd6080add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:19.978 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.976+0000 7fd607fff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd6080ac3b0 0x7fd6080ac800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:19.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.976+0000 7fd606ffd700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fd6080ceb50 0x7fd6080af5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:46756/0 (socket says 172.21.15.146:46756) 2023-10-06T11:16:19.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.976+0000 7fd606ffd700 1 -- 172.21.15.146:0/4044315330 learned_addr learned my addr 172.21.15.146:0/4044315330 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:16:19.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.976+0000 7fd6077fe700 1 -- 172.21.15.146:0/4044315330 >> v2:172.21.15.151:3300/0 conn(0x7fd6080ac3b0 msgr2=0x7fd6080ac800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:19.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.976+0000 7fd6067fc700 1 -- 172.21.15.146:0/4044315330 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 952972256 0 0) 0x7fd6080ae550 con 0x7fd6080ceb50 2023-10-06T11:16:19.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.976+0000 7fd6077fe700 1 --2- 172.21.15.146:0/4044315330 >> v2:172.21.15.151:3300/0 conn(0x7fd6080ac3b0 0x7fd6080ac800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.976+0000 7fd6077fe700 1 -- 172.21.15.146:0/4044315330 >> v1:172.21.15.151:6789/0 conn(0x7fd6080ceb50 legacy=0x7fd6080af5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:19.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.976+0000 7fd6077fe700 1 -- 172.21.15.146:0/4044315330 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6080aedf0 con 0x7fd6080abfe0 2023-10-06T11:16:19.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.976+0000 7fd6077fe700 1 --2- 172.21.15.146:0/4044315330 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6080abfe0 0x7fd6080add00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd5f8009e60 tx=0x7fd5f8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36595f66f1a803d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:19.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.976+0000 7fd6067fc700 1 -- 172.21.15.146:0/4044315330 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f800e070 con 0x7fd6080abfe0 2023-10-06T11:16:19.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.976+0000 7fd6067fc700 1 -- 172.21.15.146:0/4044315330 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f800bb60 con 0x7fd6080abfe0 2023-10-06T11:16:19.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.976+0000 7fd6067fc700 1 -- 172.21.15.146:0/4044315330 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f8012430 con 0x7fd6080abfe0 2023-10-06T11:16:19.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.977+0000 7fd60df10700 1 -- 172.21.15.146:0/4044315330 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6080abfe0 msgr2=0x7fd6080add00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:19.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.977+0000 7fd60df10700 1 --2- 172.21.15.146:0/4044315330 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6080abfe0 0x7fd6080add00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fd5f8009e60 tx=0x7fd5f8009780 comp rx=0 tx=0).stop 2023-10-06T11:16:19.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.977+0000 7fd60df10700 1 -- 172.21.15.146:0/4044315330 shutdown_connections 2023-10-06T11:16:19.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.977+0000 7fd60df10700 1 --2- 172.21.15.146:0/4044315330 >> v2:172.21.15.151:3300/0 conn(0x7fd6080ac3b0 0x7fd6080ac800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.977+0000 7fd60df10700 1 --2- 172.21.15.146:0/4044315330 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6080abfe0 0x7fd6080add00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.977+0000 7fd60df10700 1 -- 172.21.15.146:0/4044315330 >> 172.21.15.146:0/4044315330 conn(0x7fd608067c50 msgr2=0x7fd6080ce440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:19.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.977+0000 7fd60df10700 1 -- 172.21.15.146:0/4044315330 shutdown_connections 2023-10-06T11:16:19.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.977+0000 7fd60df10700 1 -- 172.21.15.146:0/4044315330 wait complete. 2023-10-06T11:16:19.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.978+0000 7fd60df10700 1 Processor -- start 2023-10-06T11:16:19.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.978+0000 7fd60df10700 1 -- start start 2023-10-06T11:16:19.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.979+0000 7fd60df10700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6080abfe0 0x7fd6080b35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:19.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.979+0000 7fd60df10700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6080ac3b0 0x7fd608142d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:19.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.979+0000 7fd60df10700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6080ceb50 0x7fd6080b1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:19.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.979+0000 7fd60df10700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6080b3140 con 0x7fd6080abfe0 2023-10-06T11:16:19.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.979+0000 7fd60df10700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6080b3b10 con 0x7fd6080ceb50 2023-10-06T11:16:19.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.979+0000 7fd60df10700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6080b2530 con 0x7fd6080ac3b0 2023-10-06T11:16:19.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.979+0000 7fd6077fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6080abfe0 0x7fd6080b35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:19.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.979+0000 7fd6077fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6080abfe0 0x7fd6080b35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51472/0 (socket says 172.21.15.146:51472) 2023-10-06T11:16:19.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.979+0000 7fd6077fe700 1 -- 172.21.15.146:0/1918297698 learned_addr learned my addr 172.21.15.146:0/1918297698 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:19.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.979+0000 7fd606ffd700 1 --2- 172.21.15.146:0/1918297698 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6080ac3b0 0x7fd608142d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:19.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.979+0000 7fd607fff700 1 --2- 172.21.15.146:0/1918297698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6080ceb50 0x7fd6080b1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:19.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.979+0000 7fd6077fe700 1 -- 172.21.15.146:0/1918297698 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6080ac3b0 msgr2=0x7fd608142d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:19.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.979+0000 7fd6077fe700 1 --2- 172.21.15.146:0/1918297698 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6080ac3b0 0x7fd608142d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.979+0000 7fd6077fe700 1 -- 172.21.15.146:0/1918297698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6080ceb50 msgr2=0x7fd6080b1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:19.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.979+0000 7fd6077fe700 1 --2- 172.21.15.146:0/1918297698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6080ceb50 0x7fd6080b1be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:19.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.979+0000 7fd6077fe700 1 -- 172.21.15.146:0/1918297698 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f8009a20 con 0x7fd6080abfe0 2023-10-06T11:16:19.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.979+0000 7fd607fff700 1 --2- 172.21.15.146:0/1918297698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6080ceb50 0x7fd6080b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:19.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.980+0000 7fd6077fe700 1 --2- 172.21.15.146:0/1918297698 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6080abfe0 0x7fd6080b35d0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7fd5f800b6c0 tx=0x7fd5f8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:19.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.980+0000 7fd5ff7fe700 1 -- 172.21.15.146:0/1918297698 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f8012dc0 con 0x7fd6080abfe0 2023-10-06T11:16:19.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.980+0000 7fd5ff7fe700 1 -- 172.21.15.146:0/1918297698 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f8027470 con 0x7fd6080abfe0 2023-10-06T11:16:19.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.980+0000 7fd60df10700 1 -- 172.21.15.146:0/1918297698 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6080b2810 con 0x7fd6080abfe0 2023-10-06T11:16:19.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.980+0000 7fd5ff7fe700 1 -- 172.21.15.146:0/1918297698 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f8027830 con 0x7fd6080abfe0 2023-10-06T11:16:19.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.980+0000 7fd60df10700 1 -- 172.21.15.146:0/1918297698 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6080b2dd0 con 0x7fd6080abfe0 2023-10-06T11:16:19.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.981+0000 7fd60df10700 1 -- 172.21.15.146:0/1918297698 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6080b3420 con 0x7fd6080abfe0 2023-10-06T11:16:19.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.981+0000 7fd5ff7fe700 1 -- 172.21.15.146:0/1918297698 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd5f8024070 con 0x7fd6080abfe0 2023-10-06T11:16:19.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.981+0000 7fd5ff7fe700 1 --2- 172.21.15.146:0/1918297698 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd5e8066f30 0x7fd5e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:19.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.982+0000 7fd5ff7fe700 1 -- 172.21.15.146:0/1918297698 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fd5f8086a30 con 0x7fd6080abfe0 2023-10-06T11:16:19.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.982+0000 7fd606ffd700 1 --2- 172.21.15.146:0/1918297698 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd5e8066f30 0x7fd5e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:19.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.982+0000 7fd606ffd700 1 --2- 172.21.15.146:0/1918297698 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd5e8066f30 0x7fd5e80693e0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fd6080cf4f0 tx=0x7fd5f0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:19.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:19.986+0000 7fd5ff7fe700 1 -- 172.21.15.146:0/1918297698 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd5f8053e90 con 0x7fd6080abfe0 2023-10-06T11:16:20.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.171+0000 7fd60df10700 1 -- 172.21.15.146:0/1918297698 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd60804c380 con 0x7fd6080abfe0 2023-10-06T11:16:20.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.172+0000 7fd5ff7fe700 1 -- 172.21.15.146:0/1918297698 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v133) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd5f802c020 con 0x7fd6080abfe0 2023-10-06T11:16:20.174 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-10-06T11:16:20.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.174+0000 7fd60df10700 1 -- 172.21.15.146:0/1918297698 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd5e8066f30 msgr2=0x7fd5e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:20.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.174+0000 7fd60df10700 1 --2- 172.21.15.146:0/1918297698 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd5e8066f30 0x7fd5e80693e0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fd6080cf4f0 tx=0x7fd5f0009040 comp rx=0 tx=0).stop 2023-10-06T11:16:20.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.174+0000 7fd60df10700 1 -- 172.21.15.146:0/1918297698 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6080abfe0 msgr2=0x7fd6080b35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:20.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.174+0000 7fd60df10700 1 --2- 172.21.15.146:0/1918297698 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6080abfe0 0x7fd6080b35d0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7fd5f800b6c0 tx=0x7fd5f8019000 comp rx=0 tx=0).stop 2023-10-06T11:16:20.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.174+0000 7fd60df10700 1 -- 172.21.15.146:0/1918297698 shutdown_connections 2023-10-06T11:16:20.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.174+0000 7fd60df10700 1 --2- 172.21.15.146:0/1918297698 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd5e8066f30 0x7fd5e80693e0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.174+0000 7fd60df10700 1 --2- 172.21.15.146:0/1918297698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6080ceb50 0x7fd6080b1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.174+0000 7fd60df10700 1 --2- 172.21.15.146:0/1918297698 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6080abfe0 0x7fd6080b35d0 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.174+0000 7fd60df10700 1 --2- 172.21.15.146:0/1918297698 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6080ac3b0 0x7fd608142d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.174+0000 7fd60df10700 1 -- 172.21.15.146:0/1918297698 >> 172.21.15.146:0/1918297698 conn(0x7fd608067c50 msgr2=0x7fd608153da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:20.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.174+0000 7fd60df10700 1 -- 172.21.15.146:0/1918297698 shutdown_connections 2023-10-06T11:16:20.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.174+0000 7fd60df10700 1 -- 172.21.15.146:0/1918297698 wait complete. 2023-10-06T11:16:20.189 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:16:20.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.306+0000 7ff89d737700 1 Processor -- start 2023-10-06T11:16:20.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.306+0000 7ff89d737700 1 -- start start 2023-10-06T11:16:20.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.307+0000 7ff89d737700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff898068b90 0x7ff89806e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:20.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.307+0000 7ff89d737700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff89806eac0 0x7ff898069d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:20.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.307+0000 7ff89d737700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8980c8b80 con 0x7ff8981595d0 2023-10-06T11:16:20.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.307+0000 7ff89d737700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8980ca7d0 con 0x7ff898068b90 2023-10-06T11:16:20.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.307+0000 7ff89d737700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8980c7fb0 con 0x7ff89806eac0 2023-10-06T11:16:20.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.307+0000 7ff8977fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff898068b90 0x7ff89806e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:20.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.307+0000 7ff8977fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff898068b90 0x7ff89806e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51480/0 (socket says 172.21.15.146:51480) 2023-10-06T11:16:20.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.307+0000 7ff8977fe700 1 -- 172.21.15.146:0/1475790664 learned_addr learned my addr 172.21.15.146:0/1475790664 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:20.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.307+0000 7ff89cf36700 1 --2- 172.21.15.146:0/1475790664 >> v2:172.21.15.151:3300/0 conn(0x7ff89806eac0 0x7ff898069d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:20.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.307+0000 7ff8977fe700 1 -- 172.21.15.146:0/1475790664 >> v2:172.21.15.151:3300/0 conn(0x7ff89806eac0 msgr2=0x7ff898069d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:20.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.307+0000 7ff8977fe700 1 --2- 172.21.15.146:0/1475790664 >> v2:172.21.15.151:3300/0 conn(0x7ff89806eac0 0x7ff898069d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.307+0000 7ff8977fe700 1 -- 172.21.15.146:0/1475790664 >> v1:172.21.15.151:6789/0 conn(0x7ff8981595d0 legacy=0x7ff898068480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:20.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.307+0000 7ff8977fe700 1 -- 172.21.15.146:0/1475790664 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff89806ef00 con 0x7ff898068b90 2023-10-06T11:16:20.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.307+0000 7ff8977fe700 1 --2- 172.21.15.146:0/1475790664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff898068b90 0x7ff89806e580 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7ff8980c8af0 tx=0x7ff88c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa4a1c51a5ec9fec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:20.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.308+0000 7ff896ffd700 1 -- 172.21.15.146:0/1475790664 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c009e70 con 0x7ff898068b90 2023-10-06T11:16:20.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.308+0000 7ff896ffd700 1 -- 172.21.15.146:0/1475790664 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff88c00b860 con 0x7ff898068b90 2023-10-06T11:16:20.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.308+0000 7ff896ffd700 1 -- 172.21.15.146:0/1475790664 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c00bc20 con 0x7ff898068b90 2023-10-06T11:16:20.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.308+0000 7ff89d737700 1 -- 172.21.15.146:0/1475790664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff898068b90 msgr2=0x7ff89806e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:20.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.308+0000 7ff89d737700 1 --2- 172.21.15.146:0/1475790664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff898068b90 0x7ff89806e580 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7ff8980c8af0 tx=0x7ff88c009250 comp rx=0 tx=0).stop 2023-10-06T11:16:20.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.308+0000 7ff89d737700 1 -- 172.21.15.146:0/1475790664 shutdown_connections 2023-10-06T11:16:20.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.308+0000 7ff89d737700 1 --2- 172.21.15.146:0/1475790664 >> v2:172.21.15.151:3300/0 conn(0x7ff89806eac0 0x7ff898069d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.308+0000 7ff89d737700 1 --2- 172.21.15.146:0/1475790664 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff898068b90 0x7ff89806e580 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.308+0000 7ff89d737700 1 -- 172.21.15.146:0/1475790664 >> 172.21.15.146:0/1475790664 conn(0x7ff8980c9dc0 msgr2=0x7ff89806dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:20.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.308+0000 7ff89d737700 1 -- 172.21.15.146:0/1475790664 shutdown_connections 2023-10-06T11:16:20.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.308+0000 7ff89d737700 1 -- 172.21.15.146:0/1475790664 wait complete. 2023-10-06T11:16:20.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.309+0000 7ff89d737700 1 Processor -- start 2023-10-06T11:16:20.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.309+0000 7ff89d737700 1 -- start start 2023-10-06T11:16:20.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.310+0000 7ff89d737700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff898068b90 0x7ff8980c6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:20.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.310+0000 7ff89d737700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff89806eac0 0x7ff898152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:20.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.310+0000 7ff89d737700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8981595d0 0x7ff8981544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:20.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.310+0000 7ff89d737700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8980a9ef0 con 0x7ff898068b90 2023-10-06T11:16:20.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.310+0000 7ff89d737700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff898154080 con 0x7ff89806eac0 2023-10-06T11:16:20.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.310+0000 7ff89d737700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8980c3b30 con 0x7ff8981595d0 2023-10-06T11:16:20.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.310+0000 7ff897fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff898068b90 0x7ff8980c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:20.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.310+0000 7ff897fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff898068b90 0x7ff8980c6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51488/0 (socket says 172.21.15.146:51488) 2023-10-06T11:16:20.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.310+0000 7ff897fff700 1 -- 172.21.15.146:0/1257711409 learned_addr learned my addr 172.21.15.146:0/1257711409 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:20.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.310+0000 7ff8977fe700 1 --2- 172.21.15.146:0/1257711409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff89806eac0 0x7ff898152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:20.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.311+0000 7ff89cf36700 1 --2- 172.21.15.146:0/1257711409 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8981595d0 0x7ff8981544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:20.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.311+0000 7ff897fff700 1 -- 172.21.15.146:0/1257711409 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8981595d0 msgr2=0x7ff8981544c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:20.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.311+0000 7ff897fff700 1 --2- 172.21.15.146:0/1257711409 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8981595d0 0x7ff8981544c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.311+0000 7ff897fff700 1 -- 172.21.15.146:0/1257711409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff89806eac0 msgr2=0x7ff898152430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:20.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.311+0000 7ff897fff700 1 --2- 172.21.15.146:0/1257711409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff89806eac0 0x7ff898152430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.311+0000 7ff897fff700 1 -- 172.21.15.146:0/1257711409 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff88c0094f0 con 0x7ff898068b90 2023-10-06T11:16:20.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.311+0000 7ff8977fe700 1 --2- 172.21.15.146:0/1257711409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff89806eac0 0x7ff898152430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:20.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.311+0000 7ff89cf36700 1 --2- 172.21.15.146:0/1257711409 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8981595d0 0x7ff8981544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:20.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.311+0000 7ff897fff700 1 --2- 172.21.15.146:0/1257711409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff898068b90 0x7ff8980c6670 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7ff88800c4e0 tx=0x7ff88800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:20.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.311+0000 7ff87ffff700 1 -- 172.21.15.146:0/1257711409 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff888011590 con 0x7ff898068b90 2023-10-06T11:16:20.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.311+0000 7ff87ffff700 1 -- 172.21.15.146:0/1257711409 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff888011710 con 0x7ff898068b90 2023-10-06T11:16:20.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.311+0000 7ff89d737700 1 -- 172.21.15.146:0/1257711409 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8981537e0 con 0x7ff898068b90 2023-10-06T11:16:20.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.311+0000 7ff87ffff700 1 -- 172.21.15.146:0/1257711409 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff888011ad0 con 0x7ff898068b90 2023-10-06T11:16:20.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.311+0000 7ff89d737700 1 -- 172.21.15.146:0/1257711409 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff898153e20 con 0x7ff898068b90 2023-10-06T11:16:20.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.312+0000 7ff89d737700 1 -- 172.21.15.146:0/1257711409 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8980c8250 con 0x7ff898068b90 2023-10-06T11:16:20.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.312+0000 7ff87ffff700 1 -- 172.21.15.146:0/1257711409 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff88801b3b0 con 0x7ff898068b90 2023-10-06T11:16:20.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.313+0000 7ff87ffff700 1 --2- 172.21.15.146:0/1257711409 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff884066f30 0x7ff8840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:20.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.313+0000 7ff87ffff700 1 -- 172.21.15.146:0/1257711409 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5206+0+0 (secure 0 0 0) 0x7ff888083870 con 0x7ff898068b90 2023-10-06T11:16:20.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.313+0000 7ff8977fe700 1 --2- 172.21.15.146:0/1257711409 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff884066f30 0x7ff8840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:20.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.313+0000 7ff8977fe700 1 --2- 172.21.15.146:0/1257711409 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff884066f30 0x7ff8840693e0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7ff8980c8af0 tx=0x7ff88c017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:20.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.317+0000 7ff87ffff700 1 -- 172.21.15.146:0/1257711409 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff888050cd0 con 0x7ff898068b90 2023-10-06T11:16:20.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.498+0000 7ff89d737700 1 -- 172.21.15.146:0/1257711409 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff89806e340 con 0x7ff898068b90 2023-10-06T11:16:20.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.498+0000 7ff87ffff700 1 -- 172.21.15.146:0/1257711409 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v133) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff888017070 con 0x7ff898068b90 2023-10-06T11:16:20.500 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-10-06T11:16:20.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.500+0000 7ff89d737700 1 -- 172.21.15.146:0/1257711409 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff884066f30 msgr2=0x7ff8840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:20.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.500+0000 7ff89d737700 1 --2- 172.21.15.146:0/1257711409 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff884066f30 0x7ff8840693e0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7ff8980c8af0 tx=0x7ff88c017000 comp rx=0 tx=0).stop 2023-10-06T11:16:20.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.500+0000 7ff89d737700 1 -- 172.21.15.146:0/1257711409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff898068b90 msgr2=0x7ff8980c6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:20.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.500+0000 7ff89d737700 1 --2- 172.21.15.146:0/1257711409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff898068b90 0x7ff8980c6670 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7ff88800c4e0 tx=0x7ff88800c8a0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.500+0000 7ff89d737700 1 -- 172.21.15.146:0/1257711409 shutdown_connections 2023-10-06T11:16:20.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.500+0000 7ff89d737700 1 --2- 172.21.15.146:0/1257711409 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff884066f30 0x7ff8840693e0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.500+0000 7ff89d737700 1 --2- 172.21.15.146:0/1257711409 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8981595d0 0x7ff8981544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.500+0000 7ff89d737700 1 --2- 172.21.15.146:0/1257711409 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff898068b90 0x7ff8980c6670 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.500+0000 7ff89d737700 1 --2- 172.21.15.146:0/1257711409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff89806eac0 0x7ff898152430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.500+0000 7ff89d737700 1 -- 172.21.15.146:0/1257711409 >> 172.21.15.146:0/1257711409 conn(0x7ff8980c9dc0 msgr2=0x7ff8980c1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:20.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.500+0000 7ff89d737700 1 -- 172.21.15.146:0/1257711409 shutdown_connections 2023-10-06T11:16:20.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.500+0000 7ff89d737700 1 -- 172.21.15.146:0/1257711409 wait complete. 2023-10-06T11:16:20.515 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T11:16:20.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.628+0000 7fd20c463700 1 Processor -- start 2023-10-06T11:16:20.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.628+0000 7fd20c463700 1 -- start start 2023-10-06T11:16:20.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.629+0000 7fd20c463700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd204068ba0 0x7fd20415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:20.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.629+0000 7fd20c463700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd20415ac30 con 0x7fd204153e80 2023-10-06T11:16:20.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.629+0000 7fd20c463700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2040b4510 con 0x7fd204153ab0 2023-10-06T11:16:20.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.629+0000 7fd20c463700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2040b6530 con 0x7fd204068ba0 2023-10-06T11:16:20.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.630+0000 7fd20aa00700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd204153e80 0x7fd2040b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:35240/0 (socket says 172.21.15.146:35240) 2023-10-06T11:16:20.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.630+0000 7fd20aa00700 1 -- 172.21.15.146:0/897464339 learned_addr learned my addr 172.21.15.146:0/897464339 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:16:20.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.630+0000 7fd2099fe700 1 --2- 172.21.15.146:0/897464339 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd204068ba0 0x7fd20415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:20.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.630+0000 7fd2091fd700 1 -- 172.21.15.146:0/897464339 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 268317246 0 0) 0x7fd1fc001490 con 0x7fd204153e80 2023-10-06T11:16:20.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.630+0000 7fd2091fd700 1 -- 172.21.15.146:0/897464339 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1f0003570 con 0x7fd204153e80 2023-10-06T11:16:20.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.630+0000 7fd2091fd700 1 -- 172.21.15.146:0/897464339 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2649733891 0 0) 0x7fd2040b4510 con 0x7fd204153ab0 2023-10-06T11:16:20.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.630+0000 7fd2091fd700 1 -- 172.21.15.146:0/897464339 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1fc001490 con 0x7fd204153ab0 2023-10-06T11:16:20.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.630+0000 7fd2099fe700 1 -- 172.21.15.146:0/897464339 >> v1:172.21.15.151:6789/0 conn(0x7fd204153ab0 legacy=0x7fd204068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:20.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.630+0000 7fd2099fe700 1 -- 172.21.15.146:0/897464339 >> v1:172.21.15.146:6789/0 conn(0x7fd204153e80 legacy=0x7fd2040b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:20.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.630+0000 7fd2099fe700 1 -- 172.21.15.146:0/897464339 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2040b5c50 con 0x7fd204068ba0 2023-10-06T11:16:20.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.630+0000 7fd2099fe700 1 --2- 172.21.15.146:0/897464339 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd204068ba0 0x7fd20415a6f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4009910 tx=0x7fd1f40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c8c69593a80b650 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:20.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.630+0000 7fd2091fd700 1 -- 172.21.15.146:0/897464339 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f4011630 con 0x7fd204068ba0 2023-10-06T11:16:20.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.630+0000 7fd2091fd700 1 -- 172.21.15.146:0/897464339 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f4011790 con 0x7fd204068ba0 2023-10-06T11:16:20.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.630+0000 7fd2091fd700 1 -- 172.21.15.146:0/897464339 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f4011b30 con 0x7fd204068ba0 2023-10-06T11:16:20.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.631+0000 7fd20c463700 1 -- 172.21.15.146:0/897464339 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd204068ba0 msgr2=0x7fd20415a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:20.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.631+0000 7fd20c463700 1 --2- 172.21.15.146:0/897464339 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd204068ba0 0x7fd20415a6f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4009910 tx=0x7fd1f40091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.631+0000 7fd20c463700 1 -- 172.21.15.146:0/897464339 shutdown_connections 2023-10-06T11:16:20.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.631+0000 7fd20c463700 1 --2- 172.21.15.146:0/897464339 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd204068ba0 0x7fd20415a6f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.631+0000 7fd20c463700 1 -- 172.21.15.146:0/897464339 >> 172.21.15.146:0/897464339 conn(0x7fd20406eba0 msgr2=0x7fd20406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:20.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.631+0000 7fd20c463700 1 -- 172.21.15.146:0/897464339 shutdown_connections 2023-10-06T11:16:20.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.631+0000 7fd20c463700 1 -- 172.21.15.146:0/897464339 wait complete. 2023-10-06T11:16:20.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.632+0000 7fd20c463700 1 Processor -- start 2023-10-06T11:16:20.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.632+0000 7fd20c463700 1 -- start start 2023-10-06T11:16:20.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.633+0000 7fd20c463700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd204068ba0 0x7fd204157df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:20.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.633+0000 7fd20c463700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd204153ab0 0x7fd2040b1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:20.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.633+0000 7fd20c463700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd204153e80 0x7fd2040b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:20.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.633+0000 7fd20c463700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2041517f0 con 0x7fd204153e80 2023-10-06T11:16:20.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.633+0000 7fd20c463700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2040b2940 con 0x7fd204153ab0 2023-10-06T11:16:20.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.633+0000 7fd20c463700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2040b1d30 con 0x7fd204068ba0 2023-10-06T11:16:20.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.633+0000 7fd20aa00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd204153e80 0x7fd2040b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:20.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.633+0000 7fd20aa00700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd204153e80 0x7fd2040b1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51490/0 (socket says 172.21.15.146:51490) 2023-10-06T11:16:20.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.633+0000 7fd20aa00700 1 -- 172.21.15.146:0/441905613 learned_addr learned my addr 172.21.15.146:0/441905613 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:20.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.633+0000 7fd20a1ff700 1 --2- 172.21.15.146:0/441905613 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd204068ba0 0x7fd204157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:20.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.633+0000 7fd2099fe700 1 --2- 172.21.15.146:0/441905613 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd204153ab0 0x7fd2040b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:20.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.633+0000 7fd20aa00700 1 -- 172.21.15.146:0/441905613 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd204068ba0 msgr2=0x7fd204157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:20.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.633+0000 7fd20aa00700 1 --2- 172.21.15.146:0/441905613 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd204068ba0 0x7fd204157df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.633+0000 7fd20aa00700 1 -- 172.21.15.146:0/441905613 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd204153ab0 msgr2=0x7fd2040b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:20.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.633+0000 7fd20aa00700 1 --2- 172.21.15.146:0/441905613 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd204153ab0 0x7fd2040b1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.633+0000 7fd20aa00700 1 -- 172.21.15.146:0/441905613 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f4009420 con 0x7fd204153e80 2023-10-06T11:16:20.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.633+0000 7fd20a1ff700 1 --2- 172.21.15.146:0/441905613 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd204068ba0 0x7fd204157df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:20.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.633+0000 7fd2099fe700 1 --2- 172.21.15.146:0/441905613 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd204153ab0 0x7fd2040b1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:20.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.634+0000 7fd20aa00700 1 --2- 172.21.15.146:0/441905613 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd204153e80 0x7fd2040b1690 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc002070 tx=0x7fd1fc001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:20.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.634+0000 7fd1fa7fc700 1 -- 172.21.15.146:0/441905613 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc00ab70 con 0x7fd204153e80 2023-10-06T11:16:20.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.634+0000 7fd1fa7fc700 1 -- 172.21.15.146:0/441905613 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1fc00acf0 con 0x7fd204153e80 2023-10-06T11:16:20.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.634+0000 7fd20c463700 1 -- 172.21.15.146:0/441905613 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2040b2010 con 0x7fd204153e80 2023-10-06T11:16:20.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.634+0000 7fd1fa7fc700 1 -- 172.21.15.146:0/441905613 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc007340 con 0x7fd204153e80 2023-10-06T11:16:20.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.634+0000 7fd20c463700 1 -- 172.21.15.146:0/441905613 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2040b25d0 con 0x7fd204153e80 2023-10-06T11:16:20.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.635+0000 7fd20c463700 1 -- 172.21.15.146:0/441905613 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2040b5a90 con 0x7fd204153e80 2023-10-06T11:16:20.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.635+0000 7fd1fa7fc700 1 -- 172.21.15.146:0/441905613 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd1fc0076b0 con 0x7fd204153e80 2023-10-06T11:16:20.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.635+0000 7fd1fa7fc700 1 --2- 172.21.15.146:0/441905613 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd1e8066f60 0x7fd1e8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:20.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.636+0000 7fd1fa7fc700 1 -- 172.21.15.146:0/441905613 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fd1fc0847f0 con 0x7fd204153e80 2023-10-06T11:16:20.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.636+0000 7fd20a1ff700 1 --2- 172.21.15.146:0/441905613 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd1e8066f60 0x7fd1e8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:20.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.636+0000 7fd20a1ff700 1 --2- 172.21.15.146:0/441905613 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd1e8066f60 0x7fd1e8069410 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fd200003990 tx=0x7fd200009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:20.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.640+0000 7fd1fa7fc700 1 -- 172.21.15.146:0/441905613 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd1fc0556e0 con 0x7fd204153e80 2023-10-06T11:16:20.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.827+0000 7fd20c463700 1 -- 172.21.15.146:0/441905613 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd20415ac30 con 0x7fd204153e80 2023-10-06T11:16:20.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.827+0000 7fd1fa7fc700 1 -- 172.21.15.146:0/441905613 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v133) v1 ==== 84+0+126 (secure 0 0 0) 0x7fd20415ac30 con 0x7fd204153e80 2023-10-06T11:16:20.829 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:16:20.829 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2023-10-06T11:16:20.829 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:16:20.830 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 1, 2023-10-06T11:16:20.830 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": "rbd" 2023-10-06T11:16:20.830 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:16:20.830 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:16:20.830 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 2, 2023-10-06T11:16:20.830 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": ".mgr" 2023-10-06T11:16:20.830 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:16:20.830 INFO:teuthology.orchestra.run.smithi146.stdout:] 2023-10-06T11:16:20.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.829+0000 7fd20c463700 1 -- 172.21.15.146:0/441905613 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd1e8066f60 msgr2=0x7fd1e8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:20.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.829+0000 7fd20c463700 1 --2- 172.21.15.146:0/441905613 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd1e8066f60 0x7fd1e8069410 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fd200003990 tx=0x7fd200009040 comp rx=0 tx=0).stop 2023-10-06T11:16:20.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.829+0000 7fd20c463700 1 -- 172.21.15.146:0/441905613 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd204153e80 msgr2=0x7fd2040b1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:20.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.829+0000 7fd20c463700 1 --2- 172.21.15.146:0/441905613 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd204153e80 0x7fd2040b1690 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc002070 tx=0x7fd1fc001c70 comp rx=0 tx=0).stop 2023-10-06T11:16:20.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.830+0000 7fd20c463700 1 -- 172.21.15.146:0/441905613 shutdown_connections 2023-10-06T11:16:20.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.830+0000 7fd20c463700 1 --2- 172.21.15.146:0/441905613 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd1e8066f60 0x7fd1e8069410 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.830+0000 7fd20c463700 1 --2- 172.21.15.146:0/441905613 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd204153e80 0x7fd2040b1690 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.830+0000 7fd20c463700 1 --2- 172.21.15.146:0/441905613 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd204068ba0 0x7fd204157df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.830+0000 7fd20c463700 1 --2- 172.21.15.146:0/441905613 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd204153ab0 0x7fd2040b1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.830+0000 7fd20c463700 1 -- 172.21.15.146:0/441905613 >> 172.21.15.146:0/441905613 conn(0x7fd20406eba0 msgr2=0x7fd2041531c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:20.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.830+0000 7fd20c463700 1 -- 172.21.15.146:0/441905613 shutdown_connections 2023-10-06T11:16:20.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.830+0000 7fd20c463700 1 -- 172.21.15.146:0/441905613 wait complete. 2023-10-06T11:16:20.844 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T11:16:20.844 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T11:16:20.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.962+0000 7f782b90e700 1 Processor -- start 2023-10-06T11:16:20.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.962+0000 7f782b90e700 1 -- start start 2023-10-06T11:16:20.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.963+0000 7f782b90e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f782415cff0 0x7f782415d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:20.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.963+0000 7f782b90e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78240d0c50 0x7f782415a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:20.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.963+0000 7f782b90e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78240cf030 con 0x7f782415cc20 2023-10-06T11:16:20.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.963+0000 7f782b90e700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f782415e390 con 0x7f782415cff0 2023-10-06T11:16:20.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.963+0000 7f782b90e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78240ced20 con 0x7f78240d0c50 2023-10-06T11:16:20.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.963+0000 7f7829eab700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78240d0c50 0x7f782415a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:20.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.963+0000 7f78296aa700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f782415cc20 0x7f78240d0540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:46778/0 (socket says 172.21.15.146:46778) 2023-10-06T11:16:20.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.963+0000 7f7828ea9700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f782415cff0 0x7f782415d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:20.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.963+0000 7f78296aa700 1 -- 172.21.15.146:0/391548315 learned_addr learned my addr 172.21.15.146:0/391548315 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:16:20.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.963+0000 7f7828ea9700 1 -- 172.21.15.146:0/391548315 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78240d0c50 msgr2=0x7f782415a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:20.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.963+0000 7f7828ea9700 1 --2- 172.21.15.146:0/391548315 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78240d0c50 0x7f782415a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.963+0000 7f7828ea9700 1 -- 172.21.15.146:0/391548315 >> v1:172.21.15.151:6789/0 conn(0x7f782415cc20 legacy=0x7f78240d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:20.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.963+0000 7f7828ea9700 1 -- 172.21.15.146:0/391548315 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f782415daf0 con 0x7f782415cff0 2023-10-06T11:16:20.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.964+0000 7f7828ea9700 1 --2- 172.21.15.146:0/391548315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f782415cff0 0x7f782415d460 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f78180098e0 tx=0x7f78180091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98bd16866931be98 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:20.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.964+0000 7f7823fff700 1 -- 172.21.15.146:0/391548315 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781800b640 con 0x7f782415cff0 2023-10-06T11:16:20.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.964+0000 7f7823fff700 1 -- 172.21.15.146:0/391548315 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781800b7a0 con 0x7f782415cff0 2023-10-06T11:16:20.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.964+0000 7f7823fff700 1 -- 172.21.15.146:0/391548315 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781800bb40 con 0x7f782415cff0 2023-10-06T11:16:20.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.964+0000 7f782b90e700 1 -- 172.21.15.146:0/391548315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f782415cff0 msgr2=0x7f782415d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:20.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.964+0000 7f782b90e700 1 --2- 172.21.15.146:0/391548315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f782415cff0 0x7f782415d460 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f78180098e0 tx=0x7f78180091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.964+0000 7f782b90e700 1 -- 172.21.15.146:0/391548315 shutdown_connections 2023-10-06T11:16:20.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.964+0000 7f782b90e700 1 --2- 172.21.15.146:0/391548315 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78240d0c50 0x7f782415a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.964+0000 7f782b90e700 1 --2- 172.21.15.146:0/391548315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f782415cff0 0x7f782415d460 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.964+0000 7f782b90e700 1 -- 172.21.15.146:0/391548315 >> 172.21.15.146:0/391548315 conn(0x7f782406eba0 msgr2=0x7f782406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:20.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.964+0000 7f782b90e700 1 -- 172.21.15.146:0/391548315 shutdown_connections 2023-10-06T11:16:20.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.964+0000 7f782b90e700 1 -- 172.21.15.146:0/391548315 wait complete. 2023-10-06T11:16:20.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.965+0000 7f782b90e700 1 Processor -- start 2023-10-06T11:16:20.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.965+0000 7f782b90e700 1 -- start start 2023-10-06T11:16:20.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.966+0000 7f782b90e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78240d0c50 0x7f78240c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:20.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.966+0000 7f782b90e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f782415cc20 0x7f78240cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:20.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.966+0000 7f782b90e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f782415cff0 0x7f78240b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:20.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.966+0000 7f782b90e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78240cb900 con 0x7f78240d0c50 2023-10-06T11:16:20.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.966+0000 7f782b90e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78240cacf0 con 0x7f782415cc20 2023-10-06T11:16:20.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.966+0000 7f782b90e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78240cafd0 con 0x7f782415cff0 2023-10-06T11:16:20.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.966+0000 7f78296aa700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78240d0c50 0x7f78240c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:20.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.967+0000 7f78296aa700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78240d0c50 0x7f78240c8bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:51498/0 (socket says 172.21.15.146:51498) 2023-10-06T11:16:20.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.967+0000 7f78296aa700 1 -- 172.21.15.146:0/4053650649 learned_addr learned my addr 172.21.15.146:0/4053650649 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:20.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.967+0000 7f7828ea9700 1 --2- 172.21.15.146:0/4053650649 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f782415cc20 0x7f78240cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:20.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.967+0000 7f7829eab700 1 --2- 172.21.15.146:0/4053650649 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f782415cff0 0x7f78240b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:20.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.967+0000 7f78296aa700 1 -- 172.21.15.146:0/4053650649 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f782415cff0 msgr2=0x7f78240b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:20.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.967+0000 7f78296aa700 1 --2- 172.21.15.146:0/4053650649 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f782415cff0 0x7f78240b1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.967+0000 7f78296aa700 1 -- 172.21.15.146:0/4053650649 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f782415cc20 msgr2=0x7f78240cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:20.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.967+0000 7f78296aa700 1 --2- 172.21.15.146:0/4053650649 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f782415cc20 0x7f78240cbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:20.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.967+0000 7f78296aa700 1 -- 172.21.15.146:0/4053650649 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7818009420 con 0x7f78240d0c50 2023-10-06T11:16:20.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.967+0000 7f7828ea9700 1 --2- 172.21.15.146:0/4053650649 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f782415cc20 0x7f78240cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:20.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.967+0000 7f78296aa700 1 --2- 172.21.15.146:0/4053650649 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78240d0c50 0x7f78240c8bd0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f781400cc70 tx=0x7f7814001ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:20.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.967+0000 7f78217fa700 1 -- 172.21.15.146:0/4053650649 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781400a960 con 0x7f78240d0c50 2023-10-06T11:16:20.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.967+0000 7f78217fa700 1 -- 172.21.15.146:0/4053650649 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781400aac0 con 0x7f78240d0c50 2023-10-06T11:16:20.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.967+0000 7f782b90e700 1 -- 172.21.15.146:0/4053650649 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78240cb2b0 con 0x7f78240d0c50 2023-10-06T11:16:20.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.967+0000 7f78217fa700 1 -- 172.21.15.146:0/4053650649 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781400ae80 con 0x7f78240d0c50 2023-10-06T11:16:20.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.967+0000 7f782b90e700 1 -- 172.21.15.146:0/4053650649 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78240ca9a0 con 0x7f78240d0c50 2023-10-06T11:16:20.974 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.968+0000 7f782b90e700 1 -- 172.21.15.146:0/4053650649 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78240cbbe0 con 0x7f78240d0c50 2023-10-06T11:16:20.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.968+0000 7f78217fa700 1 -- 172.21.15.146:0/4053650649 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7814012610 con 0x7f78240d0c50 2023-10-06T11:16:20.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.969+0000 7f78217fa700 1 --2- 172.21.15.146:0/4053650649 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7810066f30 0x7f78100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:20.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.969+0000 7f78217fa700 1 -- 172.21.15.146:0/4053650649 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f78140847a0 con 0x7f78240d0c50 2023-10-06T11:16:20.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.969+0000 7f7828ea9700 1 --2- 172.21.15.146:0/4053650649 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7810066f30 0x7f78100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:20.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.969+0000 7f7828ea9700 1 --2- 172.21.15.146:0/4053650649 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7810066f30 0x7f78100693e0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f782415d3c0 tx=0x7f7818017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:20.975 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:20.973+0000 7f78217fa700 1 -- 172.21.15.146:0/4053650649 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7814051cc0 con 0x7f78240d0c50 2023-10-06T11:16:21.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:21.155+0000 7f782b90e700 1 -- 172.21.15.146:0/4053650649 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f782404c380 con 0x7f78240d0c50 2023-10-06T11:16:21.396 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:16:21.398 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:16:22.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.080+0000 7f78217fa700 1 -- 172.21.15.146:0/4053650649 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v134) v1 ==== 138+0+0 (secure 0 0 0) 0x7f78140552e0 con 0x7f78240d0c50 2023-10-06T11:16:22.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.083+0000 7f782b90e700 1 -- 172.21.15.146:0/4053650649 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7810066f30 msgr2=0x7f78100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:22.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.083+0000 7f782b90e700 1 --2- 172.21.15.146:0/4053650649 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7810066f30 0x7f78100693e0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f782415d3c0 tx=0x7f7818017000 comp rx=0 tx=0).stop 2023-10-06T11:16:22.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.083+0000 7f782b90e700 1 -- 172.21.15.146:0/4053650649 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78240d0c50 msgr2=0x7f78240c8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:22.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.083+0000 7f782b90e700 1 --2- 172.21.15.146:0/4053650649 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78240d0c50 0x7f78240c8bd0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f781400cc70 tx=0x7f7814001ac0 comp rx=0 tx=0).stop 2023-10-06T11:16:22.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.083+0000 7f782b90e700 1 -- 172.21.15.146:0/4053650649 shutdown_connections 2023-10-06T11:16:22.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.083+0000 7f782b90e700 1 --2- 172.21.15.146:0/4053650649 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7810066f30 0x7f78100693e0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:22.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.083+0000 7f782b90e700 1 --2- 172.21.15.146:0/4053650649 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f782415cff0 0x7f78240b1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:22.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.083+0000 7f782b90e700 1 --2- 172.21.15.146:0/4053650649 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f78240d0c50 0x7f78240c8bd0 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:22.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.083+0000 7f782b90e700 1 --2- 172.21.15.146:0/4053650649 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f782415cc20 0x7f78240cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:22.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.083+0000 7f782b90e700 1 -- 172.21.15.146:0/4053650649 >> 172.21.15.146:0/4053650649 conn(0x7f782406eba0 msgr2=0x7f782415bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:22.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.083+0000 7f782b90e700 1 -- 172.21.15.146:0/4053650649 shutdown_connections 2023-10-06T11:16:22.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.083+0000 7f782b90e700 1 -- 172.21.15.146:0/4053650649 wait complete. 2023-10-06T11:16:22.086 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' created 2023-10-06T11:16:22.100 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T11:16:22.226 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.224+0000 7f0905bba700 1 Processor -- start 2023-10-06T11:16:22.227 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.225+0000 7f0905bba700 1 -- start start 2023-10-06T11:16:22.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.225+0000 7f0905bba700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f09000b35f0 0x7f09000b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:22.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.225+0000 7f0905bba700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09000b3f20 con 0x7f09000c55d0 2023-10-06T11:16:22.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.225+0000 7f0905bba700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09000c5c20 con 0x7f0900159f60 2023-10-06T11:16:22.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.225+0000 7f0905bba700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09000b3260 con 0x7f09000b35f0 2023-10-06T11:16:22.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.225+0000 7f08fffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f09000b35f0 0x7f09000b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:22.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.226+0000 7f08feffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f09000c55d0 0x7f09000c6cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:34584/0 (socket says 172.21.15.146:34584) 2023-10-06T11:16:22.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.226+0000 7f08feffd700 1 -- 172.21.15.146:0/1705927061 learned_addr learned my addr 172.21.15.146:0/1705927061 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:16:22.229 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.226+0000 7f08fffff700 1 -- 172.21.15.146:0/1705927061 >> v1:172.21.15.151:6789/0 conn(0x7f0900159f60 legacy=0x7f09000cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:22.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.226+0000 7f08fffff700 1 -- 172.21.15.146:0/1705927061 >> v1:172.21.15.146:6789/0 conn(0x7f09000c55d0 legacy=0x7f09000c6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:22.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.226+0000 7f08fffff700 1 -- 172.21.15.146:0/1705927061 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09000c5f00 con 0x7f09000b35f0 2023-10-06T11:16:22.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.226+0000 7f08fffff700 1 --2- 172.21.15.146:0/1705927061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09000b35f0 0x7f09000b39e0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f08f80098e0 tx=0x7f08f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cd12b455d9d7efd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:22.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.226+0000 7f08fe7fc700 1 -- 172.21.15.146:0/1705927061 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f8009e80 con 0x7f09000b35f0 2023-10-06T11:16:22.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.226+0000 7f08fe7fc700 1 -- 172.21.15.146:0/1705927061 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f800b820 con 0x7f09000b35f0 2023-10-06T11:16:22.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.226+0000 7f08fe7fc700 1 -- 172.21.15.146:0/1705927061 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f800bba0 con 0x7f09000b35f0 2023-10-06T11:16:22.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.227+0000 7f0905bba700 1 -- 172.21.15.146:0/1705927061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09000b35f0 msgr2=0x7f09000b39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:22.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.227+0000 7f0905bba700 1 --2- 172.21.15.146:0/1705927061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09000b35f0 0x7f09000b39e0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f08f80098e0 tx=0x7f08f80091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:22.230 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.227+0000 7f0905bba700 1 -- 172.21.15.146:0/1705927061 shutdown_connections 2023-10-06T11:16:22.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.227+0000 7f0905bba700 1 --2- 172.21.15.146:0/1705927061 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09000b35f0 0x7f09000b39e0 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:22.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.227+0000 7f0905bba700 1 -- 172.21.15.146:0/1705927061 >> 172.21.15.146:0/1705927061 conn(0x7f090006f380 msgr2=0x7f09000d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:22.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.227+0000 7f0905bba700 1 -- 172.21.15.146:0/1705927061 shutdown_connections 2023-10-06T11:16:22.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.227+0000 7f0905bba700 1 -- 172.21.15.146:0/1705927061 wait complete. 2023-10-06T11:16:22.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.228+0000 7f0905bba700 1 Processor -- start 2023-10-06T11:16:22.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.228+0000 7f0905bba700 1 -- start start 2023-10-06T11:16:22.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.229+0000 7f0905bba700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09000b35f0 0x7f0900169eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:22.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.229+0000 7f0905bba700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09000c55d0 0x7f09000ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:22.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.229+0000 7f0905bba700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0900159f60 0x7f090014b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:22.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.229+0000 7f0905bba700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09000c5a40 con 0x7f09000c55d0 2023-10-06T11:16:22.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.229+0000 7f0905bba700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0900157df0 con 0x7f09000b35f0 2023-10-06T11:16:22.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.229+0000 7f0905bba700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09000caae0 con 0x7f0900159f60 2023-10-06T11:16:22.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.229+0000 7f08feffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09000c55d0 0x7f09000ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:22.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.229+0000 7f08feffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09000c55d0 0x7f09000ca5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48886/0 (socket says 172.21.15.146:48886) 2023-10-06T11:16:22.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.229+0000 7f08feffd700 1 -- 172.21.15.146:0/25937063 learned_addr learned my addr 172.21.15.146:0/25937063 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:22.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.229+0000 7f08fffff700 1 --2- 172.21.15.146:0/25937063 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0900159f60 0x7f090014b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:22.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.229+0000 7f08ff7fe700 1 --2- 172.21.15.146:0/25937063 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09000b35f0 0x7f0900169eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:22.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.229+0000 7f08feffd700 1 -- 172.21.15.146:0/25937063 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0900159f60 msgr2=0x7f090014b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:22.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.229+0000 7f08feffd700 1 --2- 172.21.15.146:0/25937063 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0900159f60 0x7f090014b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:22.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.229+0000 7f08feffd700 1 -- 172.21.15.146:0/25937063 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09000b35f0 msgr2=0x7f0900169eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:22.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.229+0000 7f08feffd700 1 --2- 172.21.15.146:0/25937063 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09000b35f0 0x7f0900169eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:22.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.229+0000 7f08feffd700 1 -- 172.21.15.146:0/25937063 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f8009420 con 0x7f09000c55d0 2023-10-06T11:16:22.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.229+0000 7f08feffd700 1 --2- 172.21.15.146:0/25937063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09000c55d0 0x7f09000ca5a0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f08f400c7c0 tx=0x7f08f4007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:22.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.229+0000 7f08e77fe700 1 -- 172.21.15.146:0/25937063 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f4005b30 con 0x7f09000c55d0 2023-10-06T11:16:22.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.229+0000 7f08e77fe700 1 -- 172.21.15.146:0/25937063 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f4005c90 con 0x7f09000c55d0 2023-10-06T11:16:22.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.229+0000 7f0905bba700 1 -- 172.21.15.146:0/25937063 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f090014ba90 con 0x7f09000c55d0 2023-10-06T11:16:22.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.230+0000 7f08e77fe700 1 -- 172.21.15.146:0/25937063 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f4004a80 con 0x7f09000c55d0 2023-10-06T11:16:22.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.230+0000 7f0905bba700 1 -- 172.21.15.146:0/25937063 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f090015d610 con 0x7f09000c55d0 2023-10-06T11:16:22.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.231+0000 7f0905bba700 1 -- 172.21.15.146:0/25937063 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0900068390 con 0x7f09000c55d0 2023-10-06T11:16:22.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.231+0000 7f08e77fe700 1 -- 172.21.15.146:0/25937063 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f08f40070d0 con 0x7f09000c55d0 2023-10-06T11:16:22.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.231+0000 7f08e77fe700 1 --2- 172.21.15.146:0/25937063 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f08ec066f30 0x7f08ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:22.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.231+0000 7f08e77fe700 1 -- 172.21.15.146:0/25937063 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f08f40835a0 con 0x7f09000c55d0 2023-10-06T11:16:22.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.231+0000 7f08ff7fe700 1 --2- 172.21.15.146:0/25937063 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f08ec066f30 0x7f08ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:22.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.232+0000 7f08ff7fe700 1 --2- 172.21.15.146:0/25937063 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f08ec066f30 0x7f08ec0693e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f08f0007560 tx=0x7f08f0009760 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:22.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.236+0000 7f08e77fe700 1 -- 172.21.15.146:0/25937063 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f08f404b5a0 con 0x7f09000c55d0 2023-10-06T11:16:22.420 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:22.419+0000 7f0905bba700 1 -- 172.21.15.146:0/25937063 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f09000c6270 con 0x7f09000c55d0 2023-10-06T11:16:23.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.083+0000 7f08e77fe700 1 -- 172.21.15.146:0/25937063 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v135) v1 ==== 170+0+0 (secure 0 0 0) 0x7f08f4050890 con 0x7f09000c55d0 2023-10-06T11:16:23.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.087+0000 7f0905bba700 1 -- 172.21.15.146:0/25937063 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f08ec066f30 msgr2=0x7f08ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:23.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.087+0000 7f0905bba700 1 --2- 172.21.15.146:0/25937063 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f08ec066f30 0x7f08ec0693e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f08f0007560 tx=0x7f08f0009760 comp rx=0 tx=0).stop 2023-10-06T11:16:23.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.087+0000 7f0905bba700 1 -- 172.21.15.146:0/25937063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09000c55d0 msgr2=0x7f09000ca5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:23.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.087+0000 7f0905bba700 1 --2- 172.21.15.146:0/25937063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09000c55d0 0x7f09000ca5a0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f08f400c7c0 tx=0x7f08f4007f70 comp rx=0 tx=0).stop 2023-10-06T11:16:23.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.088+0000 7f0905bba700 1 -- 172.21.15.146:0/25937063 shutdown_connections 2023-10-06T11:16:23.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.088+0000 7f0905bba700 1 --2- 172.21.15.146:0/25937063 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f08ec066f30 0x7f08ec0693e0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:23.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.088+0000 7f0905bba700 1 --2- 172.21.15.146:0/25937063 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0900159f60 0x7f090014b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:23.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.088+0000 7f0905bba700 1 --2- 172.21.15.146:0/25937063 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09000b35f0 0x7f0900169eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:23.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.088+0000 7f0905bba700 1 --2- 172.21.15.146:0/25937063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09000c55d0 0x7f09000ca5a0 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:23.090 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.088+0000 7f0905bba700 1 -- 172.21.15.146:0/25937063 >> 172.21.15.146:0/25937063 conn(0x7f090006f380 msgr2=0x7f09000c6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:23.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.088+0000 7f0905bba700 1 -- 172.21.15.146:0/25937063 shutdown_connections 2023-10-06T11:16:23.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.088+0000 7f0905bba700 1 -- 172.21.15.146:0/25937063 wait complete. 2023-10-06T11:16:23.098 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' created 2023-10-06T11:16:23.113 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T11:16:23.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.230+0000 7fdb56af2700 1 Processor -- start 2023-10-06T11:16:23.233 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.230+0000 7fdb56af2700 1 -- start start 2023-10-06T11:16:23.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.231+0000 7fdb56af2700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fdb500b11e0 0x7fdb500cee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:23.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.231+0000 7fdb56af2700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb500cd3d0 0x7fdb500c9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:23.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.231+0000 7fdb56af2700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb500cc830 con 0x7fdb50159a60 2023-10-06T11:16:23.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.231+0000 7fdb56af2700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb500cf350 con 0x7fdb500b11e0 2023-10-06T11:16:23.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.231+0000 7fdb56af2700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb500b1650 con 0x7fdb500cd3d0 2023-10-06T11:16:23.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.232+0000 7fdb5508f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb500cd3d0 0x7fdb500c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:23.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.232+0000 7fdb47fff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fdb500b11e0 0x7fdb500cee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:23.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.232+0000 7fdb5508f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb500cd3d0 0x7fdb500c9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:41126/0 (socket says 172.21.15.146:41126) 2023-10-06T11:16:23.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.232+0000 7fdb47fff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fdb500b11e0 0x7fdb500cee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:39826/0 (socket says 172.21.15.146:39826) 2023-10-06T11:16:23.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.232+0000 7fdb5488e700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fdb50159a60 0x7fdb500cccc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:58116/0 (socket says 172.21.15.146:58116) 2023-10-06T11:16:23.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.232+0000 7fdb5508f700 1 -- 172.21.15.146:0/1014350307 learned_addr learned my addr 172.21.15.146:0/1014350307 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:23.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.232+0000 7fdb5508f700 1 -- 172.21.15.146:0/1014350307 >> v2:172.21.15.151:3300/0 conn(0x7fdb500b11e0 msgr2=0x7fdb500cee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:23.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.232+0000 7fdb5508f700 1 --2- 172.21.15.146:0/1014350307 >> v2:172.21.15.151:3300/0 conn(0x7fdb500b11e0 0x7fdb500cee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:23.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.232+0000 7fdb5508f700 1 -- 172.21.15.146:0/1014350307 >> v1:172.21.15.151:6789/0 conn(0x7fdb50159a60 legacy=0x7fdb500cccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:23.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.232+0000 7fdb5508f700 1 -- 172.21.15.146:0/1014350307 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb500cbf40 con 0x7fdb500cd3d0 2023-10-06T11:16:23.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.232+0000 7fdb5508f700 1 --2- 172.21.15.146:0/1014350307 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb500cd3d0 0x7fdb500c9480 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdb48009f20 tx=0x7fdb48009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=514431ac6322fb52 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:23.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.232+0000 7fdb477fe700 1 -- 172.21.15.146:0/1014350307 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4800e070 con 0x7fdb500cd3d0 2023-10-06T11:16:23.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.232+0000 7fdb477fe700 1 -- 172.21.15.146:0/1014350307 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb4800b9d0 con 0x7fdb500cd3d0 2023-10-06T11:16:23.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.232+0000 7fdb477fe700 1 -- 172.21.15.146:0/1014350307 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb480092e0 con 0x7fdb500cd3d0 2023-10-06T11:16:23.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.233+0000 7fdb56af2700 1 -- 172.21.15.146:0/1014350307 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb500cd3d0 msgr2=0x7fdb500c9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:23.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.233+0000 7fdb56af2700 1 --2- 172.21.15.146:0/1014350307 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb500cd3d0 0x7fdb500c9480 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdb48009f20 tx=0x7fdb48009840 comp rx=0 tx=0).stop 2023-10-06T11:16:23.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.233+0000 7fdb56af2700 1 -- 172.21.15.146:0/1014350307 shutdown_connections 2023-10-06T11:16:23.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.233+0000 7fdb56af2700 1 --2- 172.21.15.146:0/1014350307 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb500cd3d0 0x7fdb500c9480 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:23.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.233+0000 7fdb56af2700 1 --2- 172.21.15.146:0/1014350307 >> v2:172.21.15.151:3300/0 conn(0x7fdb500b11e0 0x7fdb500cee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:23.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.233+0000 7fdb56af2700 1 -- 172.21.15.146:0/1014350307 >> 172.21.15.146:0/1014350307 conn(0x7fdb50067c50 msgr2=0x7fdb500ce410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:23.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.233+0000 7fdb56af2700 1 -- 172.21.15.146:0/1014350307 shutdown_connections 2023-10-06T11:16:23.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.233+0000 7fdb56af2700 1 -- 172.21.15.146:0/1014350307 wait complete. 2023-10-06T11:16:23.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.234+0000 7fdb56af2700 1 Processor -- start 2023-10-06T11:16:23.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.234+0000 7fdb56af2700 1 -- start start 2023-10-06T11:16:23.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.235+0000 7fdb56af2700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb500b11e0 0x7fdb501498d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:23.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.235+0000 7fdb56af2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb500cd3d0 0x7fdb50068580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:23.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.235+0000 7fdb56af2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb50159a60 0x7fdb50068ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:23.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.235+0000 7fdb56af2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5015f370 con 0x7fdb50159a60 2023-10-06T11:16:23.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.235+0000 7fdb56af2700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb500c6830 con 0x7fdb500cd3d0 2023-10-06T11:16:23.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.235+0000 7fdb56af2700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb500c5f60 con 0x7fdb500b11e0 2023-10-06T11:16:23.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.235+0000 7fdb5508f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb50159a60 0x7fdb50068ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:23.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.235+0000 7fdb5508f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb50159a60 0x7fdb50068ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48900/0 (socket says 172.21.15.146:48900) 2023-10-06T11:16:23.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.235+0000 7fdb5508f700 1 -- 172.21.15.146:0/1538664904 learned_addr learned my addr 172.21.15.146:0/1538664904 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:23.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.235+0000 7fdb5488e700 1 --2- 172.21.15.146:0/1538664904 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb500b11e0 0x7fdb501498d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:23.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.235+0000 7fdb47fff700 1 --2- 172.21.15.146:0/1538664904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb500cd3d0 0x7fdb50068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:23.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.235+0000 7fdb5508f700 1 -- 172.21.15.146:0/1538664904 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb500b11e0 msgr2=0x7fdb501498d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:23.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.235+0000 7fdb5508f700 1 --2- 172.21.15.146:0/1538664904 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb500b11e0 0x7fdb501498d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:23.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.235+0000 7fdb5508f700 1 -- 172.21.15.146:0/1538664904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb500cd3d0 msgr2=0x7fdb50068580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:23.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.235+0000 7fdb5508f700 1 --2- 172.21.15.146:0/1538664904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb500cd3d0 0x7fdb50068580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:23.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.235+0000 7fdb5508f700 1 -- 172.21.15.146:0/1538664904 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb48009ae0 con 0x7fdb50159a60 2023-10-06T11:16:23.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.236+0000 7fdb5508f700 1 --2- 172.21.15.146:0/1538664904 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb50159a60 0x7fdb50068ac0 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7fdb48009430 tx=0x7fdb48018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:23.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.236+0000 7fdb44ff9700 1 -- 172.21.15.146:0/1538664904 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb48008b00 con 0x7fdb50159a60 2023-10-06T11:16:23.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.236+0000 7fdb44ff9700 1 -- 172.21.15.146:0/1538664904 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb48008c60 con 0x7fdb50159a60 2023-10-06T11:16:23.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.236+0000 7fdb44ff9700 1 -- 172.21.15.146:0/1538664904 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb48026460 con 0x7fdb50159a60 2023-10-06T11:16:23.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.236+0000 7fdb56af2700 1 -- 172.21.15.146:0/1538664904 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb5015edb0 con 0x7fdb50159a60 2023-10-06T11:16:23.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.236+0000 7fdb56af2700 1 -- 172.21.15.146:0/1538664904 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb500c64c0 con 0x7fdb50159a60 2023-10-06T11:16:23.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.237+0000 7fdb56af2700 1 -- 172.21.15.146:0/1538664904 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb5004c380 con 0x7fdb50159a60 2023-10-06T11:16:23.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.237+0000 7fdb44ff9700 1 -- 172.21.15.146:0/1538664904 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdb48003040 con 0x7fdb50159a60 2023-10-06T11:16:23.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.237+0000 7fdb44ff9700 1 --2- 172.21.15.146:0/1538664904 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdb3c066f30 0x7fdb3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:23.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.238+0000 7fdb44ff9700 1 -- 172.21.15.146:0/1538664904 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5958+0+0 (secure 0 0 0) 0x7fdb48086440 con 0x7fdb50159a60 2023-10-06T11:16:23.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.238+0000 7fdb5488e700 1 --2- 172.21.15.146:0/1538664904 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdb3c066f30 0x7fdb3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:23.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.238+0000 7fdb5488e700 1 --2- 172.21.15.146:0/1538664904 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdb3c066f30 0x7fdb3c0693e0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c007060 tx=0x7fdb4c007ea0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:23.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.242+0000 7fdb44ff9700 1 -- 172.21.15.146:0/1538664904 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdb480535b0 con 0x7fdb50159a60 2023-10-06T11:16:23.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:23.470+0000 7fdb56af2700 1 -- 172.21.15.146:0/1538664904 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fdb500c6970 con 0x7fdb50159a60 2023-10-06T11:16:24.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.105+0000 7fdb44ff9700 1 -- 172.21.15.146:0/1538664904 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 21 and data pool 22 v117) v1 ==== 174+0+0 (secure 0 0 0) 0x7fdb48056bd0 con 0x7fdb50159a60 2023-10-06T11:16:24.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.116+0000 7fdb56af2700 1 -- 172.21.15.146:0/1538664904 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdb3c066f30 msgr2=0x7fdb3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:24.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.116+0000 7fdb56af2700 1 --2- 172.21.15.146:0/1538664904 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdb3c066f30 0x7fdb3c0693e0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c007060 tx=0x7fdb4c007ea0 comp rx=0 tx=0).stop 2023-10-06T11:16:24.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.116+0000 7fdb56af2700 1 -- 172.21.15.146:0/1538664904 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb50159a60 msgr2=0x7fdb50068ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:24.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.116+0000 7fdb56af2700 1 --2- 172.21.15.146:0/1538664904 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb50159a60 0x7fdb50068ac0 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7fdb48009430 tx=0x7fdb48018000 comp rx=0 tx=0).stop 2023-10-06T11:16:24.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.117+0000 7fdb56af2700 1 -- 172.21.15.146:0/1538664904 shutdown_connections 2023-10-06T11:16:24.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.117+0000 7fdb56af2700 1 --2- 172.21.15.146:0/1538664904 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdb3c066f30 0x7fdb3c0693e0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:24.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.117+0000 7fdb56af2700 1 --2- 172.21.15.146:0/1538664904 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdb50159a60 0x7fdb50068ac0 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:24.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.117+0000 7fdb56af2700 1 --2- 172.21.15.146:0/1538664904 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb500b11e0 0x7fdb501498d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:24.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.117+0000 7fdb56af2700 1 --2- 172.21.15.146:0/1538664904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb500cd3d0 0x7fdb50068580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:24.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.117+0000 7fdb56af2700 1 -- 172.21.15.146:0/1538664904 >> 172.21.15.146:0/1538664904 conn(0x7fdb50067c50 msgr2=0x7fdb50069770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:24.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.117+0000 7fdb56af2700 1 -- 172.21.15.146:0/1538664904 shutdown_connections 2023-10-06T11:16:24.120 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.117+0000 7fdb56af2700 1 -- 172.21.15.146:0/1538664904 wait complete. 2023-10-06T11:16:24.121 INFO:teuthology.orchestra.run.smithi146.stderr:new fs with metadata pool 21 and data pool 22 2023-10-06T11:16:24.133 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:16:24.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.246+0000 7fe332ba1700 1 Processor -- start 2023-10-06T11:16:24.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.246+0000 7fe332ba1700 1 -- start start 2023-10-06T11:16:24.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.247+0000 7fe332ba1700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe32c0c3910 0x7fe32c0c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:24.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.247+0000 7fe332ba1700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe32c0cf210 con 0x7fe32c0b0c00 2023-10-06T11:16:24.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.247+0000 7fe332ba1700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe32c068790 con 0x7fe32c0ced80 2023-10-06T11:16:24.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.247+0000 7fe332ba1700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe32c0682f0 con 0x7fe32c0c3910 2023-10-06T11:16:24.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.247+0000 7fe33113e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe32c0c3910 0x7fe32c0c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:24.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.247+0000 7fe33093d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe32c0b0c00 0x7fe32c0c3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:34598/0 (socket says 172.21.15.146:34598) 2023-10-06T11:16:24.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.247+0000 7fe33093d700 1 -- 172.21.15.146:0/3996784703 learned_addr learned my addr 172.21.15.146:0/3996784703 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:16:24.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.248+0000 7fe33113e700 1 -- 172.21.15.146:0/3996784703 >> v1:172.21.15.151:6789/0 conn(0x7fe32c0ced80 legacy=0x7fe32c0cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:24.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.248+0000 7fe33113e700 1 -- 172.21.15.146:0/3996784703 >> v1:172.21.15.146:6789/0 conn(0x7fe32c0b0c00 legacy=0x7fe32c0c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:24.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.248+0000 7fe33113e700 1 -- 172.21.15.146:0/3996784703 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe32c068a70 con 0x7fe32c0c3910 2023-10-06T11:16:24.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.248+0000 7fe3237fe700 1 -- 172.21.15.146:0/3996784703 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3347285156 0 0) 0x7fe32c0cf210 con 0x7fe32c0b0c00 2023-10-06T11:16:24.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.248+0000 7fe33113e700 1 --2- 172.21.15.146:0/3996784703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe32c0c3910 0x7fe32c0c8aa0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7fe3240098e0 tx=0x7fe3240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e7e3a0be8335996 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:24.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.248+0000 7fe3237fe700 1 -- 172.21.15.146:0/3996784703 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe324009e80 con 0x7fe32c0c3910 2023-10-06T11:16:24.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.248+0000 7fe3237fe700 1 -- 172.21.15.146:0/3996784703 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe32400b8b0 con 0x7fe32c0c3910 2023-10-06T11:16:24.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.248+0000 7fe3237fe700 1 -- 172.21.15.146:0/3996784703 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32400bc30 con 0x7fe32c0c3910 2023-10-06T11:16:24.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.248+0000 7fe332ba1700 1 -- 172.21.15.146:0/3996784703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe32c0c3910 msgr2=0x7fe32c0c8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:24.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.248+0000 7fe332ba1700 1 --2- 172.21.15.146:0/3996784703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe32c0c3910 0x7fe32c0c8aa0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7fe3240098e0 tx=0x7fe3240091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:24.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.248+0000 7fe332ba1700 1 -- 172.21.15.146:0/3996784703 shutdown_connections 2023-10-06T11:16:24.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.248+0000 7fe332ba1700 1 --2- 172.21.15.146:0/3996784703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe32c0c3910 0x7fe32c0c8aa0 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:24.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.248+0000 7fe332ba1700 1 -- 172.21.15.146:0/3996784703 >> 172.21.15.146:0/3996784703 conn(0x7fe32c067c50 msgr2=0x7fe32c0ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:24.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.248+0000 7fe332ba1700 1 -- 172.21.15.146:0/3996784703 shutdown_connections 2023-10-06T11:16:24.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.249+0000 7fe332ba1700 1 -- 172.21.15.146:0/3996784703 wait complete. 2023-10-06T11:16:24.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.250+0000 7fe332ba1700 1 Processor -- start 2023-10-06T11:16:24.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.250+0000 7fe332ba1700 1 -- start start 2023-10-06T11:16:24.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.250+0000 7fe332ba1700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe32c0b0c00 0x7fe32c16a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:24.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.250+0000 7fe332ba1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe32c0c3910 0x7fe32c156ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:24.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.250+0000 7fe332ba1700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe32c0ced80 0x7fe32c098a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:24.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.250+0000 7fe332ba1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c0c6400 con 0x7fe32c0c3910 2023-10-06T11:16:24.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.250+0000 7fe332ba1700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c16aa10 con 0x7fe32c0b0c00 2023-10-06T11:16:24.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.250+0000 7fe332ba1700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe32c0c5510 con 0x7fe32c0ced80 2023-10-06T11:16:24.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.251+0000 7fe323fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe32c0c3910 0x7fe32c156ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:24.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.251+0000 7fe323fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe32c0c3910 0x7fe32c156ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48910/0 (socket says 172.21.15.146:48910) 2023-10-06T11:16:24.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.251+0000 7fe323fff700 1 -- 172.21.15.146:0/450225556 learned_addr learned my addr 172.21.15.146:0/450225556 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:24.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.251+0000 7fe33093d700 1 --2- 172.21.15.146:0/450225556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe32c0b0c00 0x7fe32c16a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:24.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.251+0000 7fe33113e700 1 --2- 172.21.15.146:0/450225556 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe32c0ced80 0x7fe32c098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:24.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.251+0000 7fe323fff700 1 -- 172.21.15.146:0/450225556 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe32c0ced80 msgr2=0x7fe32c098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:24.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.251+0000 7fe323fff700 1 --2- 172.21.15.146:0/450225556 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe32c0ced80 0x7fe32c098a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:24.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.251+0000 7fe323fff700 1 -- 172.21.15.146:0/450225556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe32c0b0c00 msgr2=0x7fe32c16a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:24.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.251+0000 7fe323fff700 1 --2- 172.21.15.146:0/450225556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe32c0b0c00 0x7fe32c16a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:24.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.251+0000 7fe323fff700 1 -- 172.21.15.146:0/450225556 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe324009420 con 0x7fe32c0c3910 2023-10-06T11:16:24.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.251+0000 7fe33113e700 1 --2- 172.21.15.146:0/450225556 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe32c0ced80 0x7fe32c098a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:24.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.251+0000 7fe33093d700 1 --2- 172.21.15.146:0/450225556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe32c0b0c00 0x7fe32c16a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:24.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.251+0000 7fe323fff700 1 --2- 172.21.15.146:0/450225556 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe32c0c3910 0x7fe32c156ef0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7fe31c00b600 tx=0x7fe31c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:24.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.251+0000 7fe320ff9700 1 -- 172.21.15.146:0/450225556 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c00f510 con 0x7fe32c0c3910 2023-10-06T11:16:24.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.251+0000 7fe320ff9700 1 -- 172.21.15.146:0/450225556 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe31c00f670 con 0x7fe32c0c3910 2023-10-06T11:16:24.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.251+0000 7fe332ba1700 1 -- 172.21.15.146:0/450225556 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe32c0c57f0 con 0x7fe32c0c3910 2023-10-06T11:16:24.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.251+0000 7fe320ff9700 1 -- 172.21.15.146:0/450225556 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c00fa30 con 0x7fe32c0c3910 2023-10-06T11:16:24.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.251+0000 7fe332ba1700 1 -- 172.21.15.146:0/450225556 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe32c0c5db0 con 0x7fe32c0c3910 2023-10-06T11:16:24.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.252+0000 7fe332ba1700 1 -- 172.21.15.146:0/450225556 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe32c04c380 con 0x7fe32c0c3910 2023-10-06T11:16:24.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.253+0000 7fe320ff9700 1 -- 172.21.15.146:0/450225556 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe31c01a400 con 0x7fe32c0c3910 2023-10-06T11:16:24.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.253+0000 7fe320ff9700 1 --2- 172.21.15.146:0/450225556 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe318066f30 0x7fe3180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:24.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.253+0000 7fe320ff9700 1 -- 172.21.15.146:0/450225556 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe31c084150 con 0x7fe32c0c3910 2023-10-06T11:16:24.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.253+0000 7fe33093d700 1 --2- 172.21.15.146:0/450225556 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe318066f30 0x7fe3180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:24.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.254+0000 7fe33093d700 1 --2- 172.21.15.146:0/450225556 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe318066f30 0x7fe3180693e0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0cd070 tx=0x7fe328009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:24.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.258+0000 7fe320ff9700 1 -- 172.21.15.146:0/450225556 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe31c0512e0 con 0x7fe32c0c3910 2023-10-06T11:16:24.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.441+0000 7fe332ba1700 1 -- 172.21.15.146:0/450225556 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe32c0c32a0 con 0x7fe32c0c3910 2023-10-06T11:16:24.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.442+0000 7fe320ff9700 1 -- 172.21.15.146:0/450225556 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) v1 ==== 74+0+16941 (secure 0 0 0) 0x7fe31c054900 con 0x7fe32c0c3910 2023-10-06T11:16:24.444 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:16:24.444 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":136,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:16:23.472359+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:16:21.174178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-10-06T11:16:22.437689+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:16:24.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.444+0000 7fe332ba1700 1 -- 172.21.15.146:0/450225556 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe318066f30 msgr2=0x7fe3180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:24.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.444+0000 7fe332ba1700 1 --2- 172.21.15.146:0/450225556 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe318066f30 0x7fe3180693e0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fe32c0cd070 tx=0x7fe328009040 comp rx=0 tx=0).stop 2023-10-06T11:16:24.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.444+0000 7fe332ba1700 1 -- 172.21.15.146:0/450225556 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe32c0c3910 msgr2=0x7fe32c156ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:24.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.444+0000 7fe332ba1700 1 --2- 172.21.15.146:0/450225556 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe32c0c3910 0x7fe32c156ef0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7fe31c00b600 tx=0x7fe31c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:24.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.444+0000 7fe332ba1700 1 -- 172.21.15.146:0/450225556 shutdown_connections 2023-10-06T11:16:24.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.444+0000 7fe332ba1700 1 --2- 172.21.15.146:0/450225556 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe318066f30 0x7fe3180693e0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:24.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.444+0000 7fe332ba1700 1 --2- 172.21.15.146:0/450225556 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe32c0ced80 0x7fe32c098a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:24.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.444+0000 7fe332ba1700 1 --2- 172.21.15.146:0/450225556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe32c0b0c00 0x7fe32c16a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:24.446 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.444+0000 7fe332ba1700 1 --2- 172.21.15.146:0/450225556 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe32c0c3910 0x7fe32c156ef0 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:24.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.444+0000 7fe332ba1700 1 -- 172.21.15.146:0/450225556 >> 172.21.15.146:0/450225556 conn(0x7fe32c067c50 msgr2=0x7fe32c1590a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:24.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.444+0000 7fe332ba1700 1 -- 172.21.15.146:0/450225556 shutdown_connections 2023-10-06T11:16:24.447 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.444+0000 7fe332ba1700 1 -- 172.21.15.146:0/450225556 wait complete. 2023-10-06T11:16:24.458 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:16:24.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.571+0000 7fde7c3d2700 1 Processor -- start 2023-10-06T11:16:24.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.571+0000 7fde7c3d2700 1 -- start start 2023-10-06T11:16:24.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.572+0000 7fde7c3d2700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde74157430 0x7fde74157800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:24.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.572+0000 7fde7c3d2700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fde740ca070 0x7fde740cc240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:24.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.572+0000 7fde7c3d2700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde740ccf20 con 0x7fde740ab010 2023-10-06T11:16:24.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.572+0000 7fde7c3d2700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde740ca4f0 con 0x7fde740ca070 2023-10-06T11:16:24.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.572+0000 7fde7c3d2700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde740c3dd0 con 0x7fde74157430 2023-10-06T11:16:24.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.572+0000 7fde7996d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fde740ab010 0x7fde740ceb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:34614/0 (socket says 172.21.15.146:34614) 2023-10-06T11:16:24.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.572+0000 7fde7996d700 1 -- 172.21.15.146:0/936642696 learned_addr learned my addr 172.21.15.146:0/936642696 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:16:24.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.573+0000 7fde7a16e700 1 --2- 172.21.15.146:0/936642696 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde74157430 0x7fde74157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:24.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.573+0000 7fde7a96f700 1 --2- 172.21.15.146:0/936642696 >> v2:172.21.15.151:3300/0 conn(0x7fde740ca070 0x7fde740cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:24.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.573+0000 7fde7916c700 1 -- 172.21.15.146:0/936642696 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2507177904 0 0) 0x7fde740ccf20 con 0x7fde740ab010 2023-10-06T11:16:24.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.573+0000 7fde7916c700 1 -- 172.21.15.146:0/936642696 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde60003570 con 0x7fde740ab010 2023-10-06T11:16:24.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.573+0000 7fde7916c700 1 -- 172.21.15.146:0/936642696 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 979066871 0 0) 0x7fde60003570 con 0x7fde740ab010 2023-10-06T11:16:24.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.573+0000 7fde7916c700 1 -- 172.21.15.146:0/936642696 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde74157430 msgr2=0x7fde74157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:24.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.573+0000 7fde7916c700 1 --2- 172.21.15.146:0/936642696 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde74157430 0x7fde74157800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:24.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.573+0000 7fde7916c700 1 -- 172.21.15.146:0/936642696 >> v2:172.21.15.151:3300/0 conn(0x7fde740ca070 msgr2=0x7fde740cc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:24.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.573+0000 7fde7916c700 1 --2- 172.21.15.146:0/936642696 >> v2:172.21.15.151:3300/0 conn(0x7fde740ca070 0x7fde740cc240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:24.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.573+0000 7fde7916c700 1 -- 172.21.15.146:0/936642696 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde740cd200 con 0x7fde740ab010 2023-10-06T11:16:24.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.573+0000 7fde7916c700 1 -- 172.21.15.146:0/936642696 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fde64001470 con 0x7fde740ab010 2023-10-06T11:16:24.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.573+0000 7fde7916c700 1 -- 172.21.15.146:0/936642696 >> v1:172.21.15.146:6789/0 conn(0x7fde740ab010 legacy=0x7fde740ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:24.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.573+0000 7fde7916c700 1 --2- 172.21.15.146:0/936642696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde60003a60 0x7fde60003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:24.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.573+0000 7fde7916c700 1 --2- 172.21.15.146:0/936642696 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde74157430 0x7fde60004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:24.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.573+0000 7fde7916c700 1 --2- 172.21.15.146:0/936642696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde60004d50 0x7fde600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:24.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.573+0000 7fde7916c700 1 -- 172.21.15.146:0/936642696 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde740ca4f0 con 0x7fde60003a60 2023-10-06T11:16:24.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.573+0000 7fde7916c700 1 -- 172.21.15.146:0/936642696 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde740c3dd0 con 0x7fde60004d50 2023-10-06T11:16:24.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.573+0000 7fde7916c700 1 -- 172.21.15.146:0/936642696 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde6000ba60 con 0x7fde74157430 2023-10-06T11:16:24.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.573+0000 7fde7a16e700 1 --2- 172.21.15.146:0/936642696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde60003a60 0x7fde60003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:24.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.573+0000 7fde7996d700 1 --2- 172.21.15.146:0/936642696 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde74157430 0x7fde60004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:24.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.573+0000 7fde7a96f700 1 --2- 172.21.15.146:0/936642696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde60004d50 0x7fde600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:24.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.573+0000 7fde7a16e700 1 -- 172.21.15.146:0/936642696 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde74157430 msgr2=0x7fde60004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:24.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.573+0000 7fde7a16e700 1 --2- 172.21.15.146:0/936642696 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde74157430 0x7fde60004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:24.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.573+0000 7fde7a16e700 1 -- 172.21.15.146:0/936642696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde60004d50 msgr2=0x7fde600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:24.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.573+0000 7fde7a16e700 1 --2- 172.21.15.146:0/936642696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde60004d50 0x7fde600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:24.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.573+0000 7fde7a16e700 1 -- 172.21.15.146:0/936642696 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde60003570 con 0x7fde60003a60 2023-10-06T11:16:24.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.573+0000 7fde7a96f700 1 --2- 172.21.15.146:0/936642696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde60004d50 0x7fde600051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:24.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.574+0000 7fde7a16e700 1 --2- 172.21.15.146:0/936642696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde60003a60 0x7fde60003e70 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7fde70009c00 tx=0x7fde700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60b1b3dee26a853e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:24.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.574+0000 7fde7916c700 1 -- 172.21.15.146:0/936642696 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7000e6b0 con 0x7fde60003a60 2023-10-06T11:16:24.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.574+0000 7fde7916c700 1 -- 172.21.15.146:0/936642696 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7000e810 con 0x7fde60003a60 2023-10-06T11:16:24.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.574+0000 7fde7916c700 1 -- 172.21.15.146:0/936642696 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7000ebd0 con 0x7fde60003a60 2023-10-06T11:16:24.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.574+0000 7fde7c3d2700 1 -- 172.21.15.146:0/936642696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde60003a60 msgr2=0x7fde60003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:24.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.574+0000 7fde7c3d2700 1 --2- 172.21.15.146:0/936642696 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde60003a60 0x7fde60003e70 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7fde70009c00 tx=0x7fde700091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:24.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.574+0000 7fde7a96f700 1 -- 172.21.15.146:0/936642696 reap_dead start 2023-10-06T11:16:24.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.574+0000 7fde7c3d2700 1 -- 172.21.15.146:0/936642696 shutdown_connections 2023-10-06T11:16:24.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.574+0000 7fde7c3d2700 1 -- 172.21.15.146:0/936642696 >> 172.21.15.146:0/936642696 conn(0x7fde74067c50 msgr2=0x7fde740ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:24.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.574+0000 7fde7c3d2700 1 -- 172.21.15.146:0/936642696 shutdown_connections 2023-10-06T11:16:24.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.574+0000 7fde7c3d2700 1 -- 172.21.15.146:0/936642696 wait complete. 2023-10-06T11:16:24.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.575+0000 7fde7c3d2700 1 Processor -- start 2023-10-06T11:16:24.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.576+0000 7fde7c3d2700 1 -- start start 2023-10-06T11:16:24.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.576+0000 7fde7c3d2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde60003a60 0x7fde74150890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:24.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.576+0000 7fde7c3d2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde740b2110 0x7fde7406cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:24.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.576+0000 7fde7c3d2700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde7406d420 0x7fde74151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:24.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.576+0000 7fde7c3d2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde741689a0 con 0x7fde60003a60 2023-10-06T11:16:24.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.576+0000 7fde7c3d2700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde74150dd0 con 0x7fde740b2110 2023-10-06T11:16:24.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.576+0000 7fde7c3d2700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde74167d90 con 0x7fde7406d420 2023-10-06T11:16:24.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.576+0000 7fde7a16e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde60003a60 0x7fde74150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:24.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.576+0000 7fde7a16e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde60003a60 0x7fde74150890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48924/0 (socket says 172.21.15.146:48924) 2023-10-06T11:16:24.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.576+0000 7fde7a16e700 1 -- 172.21.15.146:0/2775100047 learned_addr learned my addr 172.21.15.146:0/2775100047 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:24.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.576+0000 7fde7a96f700 1 --2- 172.21.15.146:0/2775100047 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde7406d420 0x7fde74151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:24.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.576+0000 7fde7996d700 1 --2- 172.21.15.146:0/2775100047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde740b2110 0x7fde7406cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:24.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.577+0000 7fde7a16e700 1 -- 172.21.15.146:0/2775100047 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde7406d420 msgr2=0x7fde74151550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:24.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.577+0000 7fde7a16e700 1 --2- 172.21.15.146:0/2775100047 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde7406d420 0x7fde74151550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:24.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.577+0000 7fde7a16e700 1 -- 172.21.15.146:0/2775100047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde740b2110 msgr2=0x7fde7406cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:24.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.577+0000 7fde7a16e700 1 --2- 172.21.15.146:0/2775100047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde740b2110 0x7fde7406cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:24.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.577+0000 7fde7a16e700 1 -- 172.21.15.146:0/2775100047 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde74168070 con 0x7fde60003a60 2023-10-06T11:16:24.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.577+0000 7fde7996d700 1 --2- 172.21.15.146:0/2775100047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde740b2110 0x7fde7406cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:24.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.577+0000 7fde7a16e700 1 --2- 172.21.15.146:0/2775100047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde60003a60 0x7fde74150890 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7fde60004730 tx=0x7fde7001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:24.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.577+0000 7fde6a7fc700 1 -- 172.21.15.146:0/2775100047 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde70023070 con 0x7fde60003a60 2023-10-06T11:16:24.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.577+0000 7fde6a7fc700 1 -- 172.21.15.146:0/2775100047 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7000ebb0 con 0x7fde60003a60 2023-10-06T11:16:24.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.577+0000 7fde7c3d2700 1 -- 172.21.15.146:0/2775100047 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde74168350 con 0x7fde60003a60 2023-10-06T11:16:24.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.577+0000 7fde6a7fc700 1 -- 172.21.15.146:0/2775100047 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7000e6b0 con 0x7fde60003a60 2023-10-06T11:16:24.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.577+0000 7fde7c3d2700 1 -- 172.21.15.146:0/2775100047 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde741511d0 con 0x7fde60003a60 2023-10-06T11:16:24.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.578+0000 7fde7c3d2700 1 -- 172.21.15.146:0/2775100047 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde7404c380 con 0x7fde60003a60 2023-10-06T11:16:24.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.578+0000 7fde6a7fc700 1 -- 172.21.15.146:0/2775100047 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fde70013680 con 0x7fde60003a60 2023-10-06T11:16:24.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.578+0000 7fde6a7fc700 1 --2- 172.21.15.146:0/2775100047 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fde58066f30 0x7fde580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:24.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.579+0000 7fde7996d700 1 --2- 172.21.15.146:0/2775100047 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fde58066f30 0x7fde580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:24.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.579+0000 7fde6a7fc700 1 -- 172.21.15.146:0/2775100047 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fde70057290 con 0x7fde60003a60 2023-10-06T11:16:24.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.579+0000 7fde7996d700 1 --2- 172.21.15.146:0/2775100047 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fde58066f30 0x7fde580693e0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fde740ccb00 tx=0x7fde64009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:24.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.583+0000 7fde6a7fc700 1 -- 172.21.15.146:0/2775100047 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fde70052ed0 con 0x7fde60003a60 2023-10-06T11:16:24.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.767+0000 7fde7c3d2700 1 -- 172.21.15.146:0/2775100047 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde740cd4e0 con 0x7fde60003a60 2023-10-06T11:16:24.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.768+0000 7fde6a7fc700 1 -- 172.21.15.146:0/2775100047 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) v1 ==== 74+0+16941 (secure 0 0 0) 0x7fde70017090 con 0x7fde60003a60 2023-10-06T11:16:24.770 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:16:24.770 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":136,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:16:23.472359+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:16:21.174178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-10-06T11:16:22.437689+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:16:24.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.770+0000 7fde7c3d2700 1 -- 172.21.15.146:0/2775100047 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fde58066f30 msgr2=0x7fde580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:24.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.770+0000 7fde7c3d2700 1 --2- 172.21.15.146:0/2775100047 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fde58066f30 0x7fde580693e0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fde740ccb00 tx=0x7fde64009040 comp rx=0 tx=0).stop 2023-10-06T11:16:24.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.770+0000 7fde7c3d2700 1 -- 172.21.15.146:0/2775100047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde60003a60 msgr2=0x7fde74150890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:24.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.770+0000 7fde7c3d2700 1 --2- 172.21.15.146:0/2775100047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde60003a60 0x7fde74150890 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7fde60004730 tx=0x7fde7001a000 comp rx=0 tx=0).stop 2023-10-06T11:16:24.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.770+0000 7fde7c3d2700 1 -- 172.21.15.146:0/2775100047 shutdown_connections 2023-10-06T11:16:24.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.770+0000 7fde7c3d2700 1 --2- 172.21.15.146:0/2775100047 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fde58066f30 0x7fde580693e0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:24.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.770+0000 7fde7c3d2700 1 --2- 172.21.15.146:0/2775100047 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fde7406d420 0x7fde74151550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:24.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.770+0000 7fde7c3d2700 1 --2- 172.21.15.146:0/2775100047 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fde60003a60 0x7fde74150890 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:24.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.770+0000 7fde7c3d2700 1 --2- 172.21.15.146:0/2775100047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde740b2110 0x7fde7406cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:24.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.770+0000 7fde7c3d2700 1 -- 172.21.15.146:0/2775100047 >> 172.21.15.146:0/2775100047 conn(0x7fde74067c50 msgr2=0x7fde74153d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:24.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.770+0000 7fde7c3d2700 1 -- 172.21.15.146:0/2775100047 shutdown_connections 2023-10-06T11:16:24.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.770+0000 7fde7c3d2700 1 -- 172.21.15.146:0/2775100047 wait complete. 2023-10-06T11:16:24.784 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T11:16:24.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.900+0000 7f85d82fd700 1 Processor -- start 2023-10-06T11:16:24.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.900+0000 7f85d82fd700 1 -- start start 2023-10-06T11:16:24.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.901+0000 7f85d82fd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85d015cff0 0x7f85d015d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:24.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.901+0000 7f85d82fd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f85d00d0c50 0x7f85d015a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:24.904 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.901+0000 7f85d82fd700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85d00cf030 con 0x7f85d015cc20 2023-10-06T11:16:24.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.901+0000 7f85d82fd700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85d015e390 con 0x7f85d00d0c50 2023-10-06T11:16:24.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.901+0000 7f85d82fd700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d00ced20 con 0x7f85d015cff0 2023-10-06T11:16:24.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.901+0000 7f85d689a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f85d00d0c50 0x7f85d015a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:24.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.901+0000 7f85d6099700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f85d015cc20 0x7f85d00d0540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:34626/0 (socket says 172.21.15.146:34626) 2023-10-06T11:16:24.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.901+0000 7f85d6099700 1 -- 172.21.15.146:0/2328271219 learned_addr learned my addr 172.21.15.146:0/2328271219 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:16:24.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.902+0000 7f85d689a700 1 -- 172.21.15.146:0/2328271219 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85d015cff0 msgr2=0x7f85d015d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:24.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.902+0000 7f85d689a700 1 --2- 172.21.15.146:0/2328271219 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85d015cff0 0x7f85d015d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:24.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.902+0000 7f85d689a700 1 -- 172.21.15.146:0/2328271219 >> v1:172.21.15.146:6789/0 conn(0x7f85d015cc20 legacy=0x7f85d00d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:24.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.902+0000 7f85d689a700 1 -- 172.21.15.146:0/2328271219 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d015daf0 con 0x7f85d00d0c50 2023-10-06T11:16:24.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.902+0000 7f85d5097700 1 -- 172.21.15.146:0/2328271219 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3978110103 0 0) 0x7f85d00cf030 con 0x7f85d015cc20 2023-10-06T11:16:24.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.902+0000 7f85d689a700 1 --2- 172.21.15.146:0/2328271219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85d00d0c50 0x7f85d015a890 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f85c80098e0 tx=0x7f85c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4811cedff203bd46 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:24.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.902+0000 7f85d5097700 1 -- 172.21.15.146:0/2328271219 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c8009e80 con 0x7f85d00d0c50 2023-10-06T11:16:24.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.902+0000 7f85d5097700 1 -- 172.21.15.146:0/2328271219 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c800b860 con 0x7f85d00d0c50 2023-10-06T11:16:24.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.902+0000 7f85d5097700 1 -- 172.21.15.146:0/2328271219 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c800bbe0 con 0x7f85d00d0c50 2023-10-06T11:16:24.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.902+0000 7f85d82fd700 1 -- 172.21.15.146:0/2328271219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85d00d0c50 msgr2=0x7f85d015a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:24.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.902+0000 7f85d82fd700 1 --2- 172.21.15.146:0/2328271219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85d00d0c50 0x7f85d015a890 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f85c80098e0 tx=0x7f85c80091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:24.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.902+0000 7f85d82fd700 1 -- 172.21.15.146:0/2328271219 shutdown_connections 2023-10-06T11:16:24.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.902+0000 7f85d82fd700 1 --2- 172.21.15.146:0/2328271219 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85d00d0c50 0x7f85d015a890 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:24.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.902+0000 7f85d82fd700 1 --2- 172.21.15.146:0/2328271219 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85d015cff0 0x7f85d015d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:24.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.902+0000 7f85d82fd700 1 -- 172.21.15.146:0/2328271219 >> 172.21.15.146:0/2328271219 conn(0x7f85d006eba0 msgr2=0x7f85d006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:24.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.902+0000 7f85d82fd700 1 -- 172.21.15.146:0/2328271219 shutdown_connections 2023-10-06T11:16:24.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.902+0000 7f85d82fd700 1 -- 172.21.15.146:0/2328271219 wait complete. 2023-10-06T11:16:24.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.903+0000 7f85d82fd700 1 Processor -- start 2023-10-06T11:16:24.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.904+0000 7f85d82fd700 1 -- start start 2023-10-06T11:16:24.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.904+0000 7f85d82fd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85d00d0c50 0x7f85d00afd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:24.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.904+0000 7f85d82fd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85d015cc20 0x7f85d0147fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:24.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.904+0000 7f85d82fd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85d015cff0 0x7f85d015aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:24.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.904+0000 7f85d82fd700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d00b0f40 con 0x7f85d00d0c50 2023-10-06T11:16:24.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.904+0000 7f85d82fd700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d00b0330 con 0x7f85d015cc20 2023-10-06T11:16:24.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.904+0000 7f85d82fd700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d00b0610 con 0x7f85d015cff0 2023-10-06T11:16:24.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.904+0000 7f85d6099700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85d00d0c50 0x7f85d00afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:24.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.904+0000 7f85d6099700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85d00d0c50 0x7f85d00afd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48946/0 (socket says 172.21.15.146:48946) 2023-10-06T11:16:24.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.904+0000 7f85d6099700 1 -- 172.21.15.146:0/488250096 learned_addr learned my addr 172.21.15.146:0/488250096 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:24.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.905+0000 7f85d6099700 1 -- 172.21.15.146:0/488250096 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85d015cff0 msgr2=0x7f85d015aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:24.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.905+0000 7f85d689a700 1 --2- 172.21.15.146:0/488250096 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85d015cff0 0x7f85d015aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:24.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.905+0000 7f85d6099700 1 --2- 172.21.15.146:0/488250096 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85d015cff0 0x7f85d015aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:24.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.905+0000 7f85d6099700 1 -- 172.21.15.146:0/488250096 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85d015cc20 msgr2=0x7f85d0147fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:24.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.905+0000 7f85d6099700 1 --2- 172.21.15.146:0/488250096 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85d015cc20 0x7f85d0147fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:24.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.905+0000 7f85d6099700 1 -- 172.21.15.146:0/488250096 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c8009420 con 0x7f85d00d0c50 2023-10-06T11:16:24.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.905+0000 7f85d6099700 1 --2- 172.21.15.146:0/488250096 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85d00d0c50 0x7f85d00afd50 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f85cc00cb60 tx=0x7f85cc0017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:24.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.905+0000 7f85c67fc700 1 -- 172.21.15.146:0/488250096 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc005d80 con 0x7f85d00d0c50 2023-10-06T11:16:24.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.905+0000 7f85c67fc700 1 -- 172.21.15.146:0/488250096 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85cc00a5a0 con 0x7f85d00d0c50 2023-10-06T11:16:24.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.905+0000 7f85c67fc700 1 -- 172.21.15.146:0/488250096 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85cc00a960 con 0x7f85d00d0c50 2023-10-06T11:16:24.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.905+0000 7f85d82fd700 1 -- 172.21.15.146:0/488250096 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85d00b08f0 con 0x7f85d00d0c50 2023-10-06T11:16:24.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.905+0000 7f85d82fd700 1 -- 172.21.15.146:0/488250096 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85d0155980 con 0x7f85d00d0c50 2023-10-06T11:16:24.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.906+0000 7f85d82fd700 1 -- 172.21.15.146:0/488250096 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85d004c380 con 0x7f85d00d0c50 2023-10-06T11:16:24.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.906+0000 7f85c67fc700 1 -- 172.21.15.146:0/488250096 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f85cc00acd0 con 0x7f85d00d0c50 2023-10-06T11:16:24.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.907+0000 7f85c67fc700 1 --2- 172.21.15.146:0/488250096 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f85b4066f30 0x7f85b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:24.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.907+0000 7f85c67fc700 1 -- 172.21.15.146:0/488250096 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f85cc084150 con 0x7f85d00d0c50 2023-10-06T11:16:24.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.907+0000 7f85d5898700 1 --2- 172.21.15.146:0/488250096 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f85b4066f30 0x7f85b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:24.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.907+0000 7f85d5898700 1 --2- 172.21.15.146:0/488250096 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f85b4066f30 0x7f85b40693e0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f85d00b3f60 tx=0x7f85c0006d10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:24.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:24.911+0000 7f85c67fc700 1 -- 172.21.15.146:0/488250096 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f85cc0512e0 con 0x7f85d00d0c50 2023-10-06T11:16:25.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:25.147+0000 7f85d82fd700 1 -- 172.21.15.146:0/488250096 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f85d00b3b50 con 0x7f85d00d0c50 2023-10-06T11:16:26.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.117+0000 7f85c67fc700 1 -- 172.21.15.146:0/488250096 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v120) v1 ==== 118+0+0 (secure 0 0 0) 0x7f85cc054900 con 0x7f85d00d0c50 2023-10-06T11:16:26.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.120+0000 7f85d82fd700 1 -- 172.21.15.146:0/488250096 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f85b4066f30 msgr2=0x7f85b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:26.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.120+0000 7f85d82fd700 1 --2- 172.21.15.146:0/488250096 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f85b4066f30 0x7f85b40693e0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f85d00b3f60 tx=0x7f85c0006d10 comp rx=0 tx=0).stop 2023-10-06T11:16:26.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.120+0000 7f85d82fd700 1 -- 172.21.15.146:0/488250096 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85d00d0c50 msgr2=0x7f85d00afd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:26.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.120+0000 7f85d82fd700 1 --2- 172.21.15.146:0/488250096 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85d00d0c50 0x7f85d00afd50 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f85cc00cb60 tx=0x7f85cc0017b0 comp rx=0 tx=0).stop 2023-10-06T11:16:26.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.120+0000 7f85d82fd700 1 -- 172.21.15.146:0/488250096 shutdown_connections 2023-10-06T11:16:26.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.120+0000 7f85d82fd700 1 --2- 172.21.15.146:0/488250096 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f85b4066f30 0x7f85b40693e0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:26.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.120+0000 7f85d82fd700 1 --2- 172.21.15.146:0/488250096 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f85d015cff0 0x7f85d015aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:26.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.120+0000 7f85d82fd700 1 --2- 172.21.15.146:0/488250096 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f85d00d0c50 0x7f85d00afd50 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:26.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.120+0000 7f85d82fd700 1 --2- 172.21.15.146:0/488250096 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85d015cc20 0x7f85d0147fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:26.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.120+0000 7f85d82fd700 1 -- 172.21.15.146:0/488250096 >> 172.21.15.146:0/488250096 conn(0x7f85d006eba0 msgr2=0x7f85d00b4210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:26.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.120+0000 7f85d82fd700 1 -- 172.21.15.146:0/488250096 shutdown_connections 2023-10-06T11:16:26.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.120+0000 7f85d82fd700 1 -- 172.21.15.146:0/488250096 wait complete. 2023-10-06T11:16:26.136 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T11:16:26.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.258+0000 7f18bf59e700 1 Processor -- start 2023-10-06T11:16:26.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.258+0000 7f18bf59e700 1 -- start start 2023-10-06T11:16:26.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.259+0000 7f18bf59e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18c0142b00 0x7f18c00c8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:26.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.259+0000 7f18bf59e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f18c006bd60 0x7f18c006cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:26.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.259+0000 7f18bf59e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18c00c8db0 con 0x7f18c0142ed0 2023-10-06T11:16:26.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.259+0000 7f18bf59e700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18c006d8d0 con 0x7f18c006bd60 2023-10-06T11:16:26.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.259+0000 7f18bf59e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18c0068720 con 0x7f18c0142b00 2023-10-06T11:16:26.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.260+0000 7f18b5d9b700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f18c0142ed0 0x7f18c006b650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:58140/0 (socket says 172.21.15.146:58140) 2023-10-06T11:16:26.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.260+0000 7f18b5d9b700 1 -- 172.21.15.146:0/2375716781 learned_addr learned my addr 172.21.15.146:0/2375716781 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:16:26.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.260+0000 7f18bed9d700 1 --2- 172.21.15.146:0/2375716781 >> v2:172.21.15.151:3300/0 conn(0x7f18c006bd60 0x7f18c006cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:26.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.260+0000 7f18be59c700 1 --2- 172.21.15.146:0/2375716781 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18c0142b00 0x7f18c00c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:26.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.260+0000 7f18bdd9b700 1 -- 172.21.15.146:0/2375716781 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2118476002 0 0) 0x7f18c00c8db0 con 0x7f18c0142ed0 2023-10-06T11:16:26.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.260+0000 7f18bdd9b700 1 -- 172.21.15.146:0/2375716781 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18ac003570 con 0x7f18c0142ed0 2023-10-06T11:16:26.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.260+0000 7f18be59c700 1 -- 172.21.15.146:0/2375716781 >> v2:172.21.15.151:3300/0 conn(0x7f18c006bd60 msgr2=0x7f18c006cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:26.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.260+0000 7f18be59c700 1 --2- 172.21.15.146:0/2375716781 >> v2:172.21.15.151:3300/0 conn(0x7f18c006bd60 0x7f18c006cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:26.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.260+0000 7f18be59c700 1 -- 172.21.15.146:0/2375716781 >> v1:172.21.15.151:6789/0 conn(0x7f18c0142ed0 legacy=0x7f18c006b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:26.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.260+0000 7f18be59c700 1 -- 172.21.15.146:0/2375716781 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c0068a00 con 0x7f18c0142b00 2023-10-06T11:16:26.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.260+0000 7f18bed9d700 1 --2- 172.21.15.146:0/2375716781 >> v2:172.21.15.151:3300/0 conn(0x7f18c006bd60 0x7f18c006cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:16:26.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.260+0000 7f18be59c700 1 --2- 172.21.15.146:0/2375716781 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18c0142b00 0x7f18c00c8870 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f18b00098e0 tx=0x7f18b00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aba2b499df75bfc3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:26.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.260+0000 7f18bdd9b700 1 -- 172.21.15.146:0/2375716781 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b0011630 con 0x7f18c0142b00 2023-10-06T11:16:26.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.260+0000 7f18bdd9b700 1 -- 172.21.15.146:0/2375716781 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b0011790 con 0x7f18c0142b00 2023-10-06T11:16:26.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.260+0000 7f18bdd9b700 1 -- 172.21.15.146:0/2375716781 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b0011b30 con 0x7f18c0142b00 2023-10-06T11:16:26.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.261+0000 7f18bf59e700 1 -- 172.21.15.146:0/2375716781 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18c0142b00 msgr2=0x7f18c00c8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:26.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.261+0000 7f18bf59e700 1 --2- 172.21.15.146:0/2375716781 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18c0142b00 0x7f18c00c8870 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f18b00098e0 tx=0x7f18b00091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:26.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.261+0000 7f18bf59e700 1 -- 172.21.15.146:0/2375716781 shutdown_connections 2023-10-06T11:16:26.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.261+0000 7f18bf59e700 1 --2- 172.21.15.146:0/2375716781 >> v2:172.21.15.151:3300/0 conn(0x7f18c006bd60 0x7f18c006cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:26.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.261+0000 7f18bf59e700 1 --2- 172.21.15.146:0/2375716781 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18c0142b00 0x7f18c00c8870 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:26.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.261+0000 7f18bf59e700 1 -- 172.21.15.146:0/2375716781 >> 172.21.15.146:0/2375716781 conn(0x7f18c00ce230 msgr2=0x7f18c00ce630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:26.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.261+0000 7f18bf59e700 1 -- 172.21.15.146:0/2375716781 shutdown_connections 2023-10-06T11:16:26.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.261+0000 7f18bf59e700 1 -- 172.21.15.146:0/2375716781 wait complete. 2023-10-06T11:16:26.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.262+0000 7f18bf59e700 1 Processor -- start 2023-10-06T11:16:26.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.262+0000 7f18bf59e700 1 -- start start 2023-10-06T11:16:26.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.263+0000 7f18bf59e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18c006bd60 0x7f18c00b2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:26.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.263+0000 7f18bf59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18c0142b00 0x7f18c0159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:26.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.263+0000 7f18bf59e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18c0142ed0 0x7f18c00c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:26.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.263+0000 7f18bf59e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c015a0d0 con 0x7f18c0142b00 2023-10-06T11:16:26.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.263+0000 7f18bf59e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c00b19e0 con 0x7f18c0142ed0 2023-10-06T11:16:26.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.263+0000 7f18bf59e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18c00b2280 con 0x7f18c006bd60 2023-10-06T11:16:26.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.263+0000 7f18b5d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18c0142b00 0x7f18c0159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:26.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.263+0000 7f18b5d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18c0142b00 0x7f18c0159b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48948/0 (socket says 172.21.15.146:48948) 2023-10-06T11:16:26.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.263+0000 7f18b5d9b700 1 -- 172.21.15.146:0/993028529 learned_addr learned my addr 172.21.15.146:0/993028529 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:26.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.263+0000 7f18be59c700 1 --2- 172.21.15.146:0/993028529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18c006bd60 0x7f18c00b2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:26.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.263+0000 7f18bed9d700 1 --2- 172.21.15.146:0/993028529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18c0142ed0 0x7f18c00c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:26.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.263+0000 7f18b5d9b700 1 -- 172.21.15.146:0/993028529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18c006bd60 msgr2=0x7f18c00b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:26.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.263+0000 7f18b5d9b700 1 --2- 172.21.15.146:0/993028529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18c006bd60 0x7f18c00b2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:26.268 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.263+0000 7f18b5d9b700 1 -- 172.21.15.146:0/993028529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18c0142ed0 msgr2=0x7f18c00c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:26.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.263+0000 7f18b5d9b700 1 --2- 172.21.15.146:0/993028529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18c0142ed0 0x7f18c00c5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:26.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.263+0000 7f18b5d9b700 1 -- 172.21.15.146:0/993028529 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b8009a20 con 0x7f18c0142b00 2023-10-06T11:16:26.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.264+0000 7f18b5d9b700 1 --2- 172.21.15.146:0/993028529 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18c0142b00 0x7f18c0159b90 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f18a800c580 tx=0x7f18a8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:26.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.264+0000 7f18b6ffd700 1 -- 172.21.15.146:0/993028529 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a8005b30 con 0x7f18c0142b00 2023-10-06T11:16:26.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.264+0000 7f18b6ffd700 1 -- 172.21.15.146:0/993028529 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a8005c90 con 0x7f18c0142b00 2023-10-06T11:16:26.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.264+0000 7f18b6ffd700 1 -- 172.21.15.146:0/993028529 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a8007320 con 0x7f18c0142b00 2023-10-06T11:16:26.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.264+0000 7f18bf59e700 1 -- 172.21.15.146:0/993028529 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18b0009420 con 0x7f18c0142b00 2023-10-06T11:16:26.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.264+0000 7f18bf59e700 1 -- 172.21.15.146:0/993028529 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18c015ca90 con 0x7f18c0142b00 2023-10-06T11:16:26.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.265+0000 7f18bf59e700 1 -- 172.21.15.146:0/993028529 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18c006eb80 con 0x7f18c0142b00 2023-10-06T11:16:26.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.265+0000 7f18b6ffd700 1 -- 172.21.15.146:0/993028529 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f18a8007690 con 0x7f18c0142b00 2023-10-06T11:16:26.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.265+0000 7f18b6ffd700 1 --2- 172.21.15.146:0/993028529 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f18a0066f30 0x7f18a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:26.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.266+0000 7f18b6ffd700 1 -- 172.21.15.146:0/993028529 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f18a8083b40 con 0x7f18c0142b00 2023-10-06T11:16:26.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.266+0000 7f18be59c700 1 --2- 172.21.15.146:0/993028529 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f18a0066f30 0x7f18a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:26.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.266+0000 7f18be59c700 1 --2- 172.21.15.146:0/993028529 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f18a0066f30 0x7f18a00693e0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f18b00091e0 tx=0x7f18b0017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:26.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.270+0000 7f18b6ffd700 1 -- 172.21.15.146:0/993028529 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f18a8050c50 con 0x7f18c0142b00 2023-10-06T11:16:26.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:26.501+0000 7f18bf59e700 1 -- 172.21.15.146:0/993028529 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f18c00b23c0 con 0x7f18c0142b00 2023-10-06T11:16:27.119 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.118+0000 7f18b6ffd700 1 -- 172.21.15.146:0/993028529 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v121) v1 ==== 122+0+0 (secure 0 0 0) 0x7f18a8017020 con 0x7f18c0142b00 2023-10-06T11:16:27.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.120+0000 7f18bf59e700 1 -- 172.21.15.146:0/993028529 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f18a0066f30 msgr2=0x7f18a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:27.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.120+0000 7f18bf59e700 1 --2- 172.21.15.146:0/993028529 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f18a0066f30 0x7f18a00693e0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f18b00091e0 tx=0x7f18b0017000 comp rx=0 tx=0).stop 2023-10-06T11:16:27.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.120+0000 7f18bf59e700 1 -- 172.21.15.146:0/993028529 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18c0142b00 msgr2=0x7f18c0159b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:27.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.120+0000 7f18bf59e700 1 --2- 172.21.15.146:0/993028529 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18c0142b00 0x7f18c0159b90 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f18a800c580 tx=0x7f18a8007df0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.120+0000 7f18bf59e700 1 -- 172.21.15.146:0/993028529 shutdown_connections 2023-10-06T11:16:27.122 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.120+0000 7f18bf59e700 1 --2- 172.21.15.146:0/993028529 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f18a0066f30 0x7f18a00693e0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.120+0000 7f18bf59e700 1 --2- 172.21.15.146:0/993028529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18c0142ed0 0x7f18c00c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.120+0000 7f18bf59e700 1 --2- 172.21.15.146:0/993028529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18c006bd60 0x7f18c00b2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.120+0000 7f18bf59e700 1 --2- 172.21.15.146:0/993028529 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18c0142b00 0x7f18c0159b90 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.120+0000 7f18bf59e700 1 -- 172.21.15.146:0/993028529 >> 172.21.15.146:0/993028529 conn(0x7f18c00ce230 msgr2=0x7f18c0141c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:27.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.120+0000 7f18bf59e700 1 -- 172.21.15.146:0/993028529 shutdown_connections 2023-10-06T11:16:27.123 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.120+0000 7f18bf59e700 1 -- 172.21.15.146:0/993028529 wait complete. 2023-10-06T11:16:27.135 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:16:27.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.248+0000 7fdd77fff700 1 Processor -- start 2023-10-06T11:16:27.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.248+0000 7fdd77fff700 1 -- start start 2023-10-06T11:16:27.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.249+0000 7fdd77fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdd7815a420 0x7fdd7815cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:27.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.249+0000 7fdd77fff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fdd780b2530 0x7fdd7815acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:27.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.249+0000 7fdd77fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd7815c630 con 0x7fdd7815a7f0 2023-10-06T11:16:27.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.249+0000 7fdd77fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd780ce040 con 0x7fdd7815a420 2023-10-06T11:16:27.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.249+0000 7fdd77fff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd7815ba20 con 0x7fdd780b2530 2023-10-06T11:16:27.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.249+0000 7fdd76ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fdd7815a420 0x7fdd7815cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:27.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.249+0000 7fdd6e7fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fdd7815a7f0 0x7fdd780b1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:34636/0 (socket says 172.21.15.146:34636) 2023-10-06T11:16:27.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.249+0000 7fdd6e7fc700 1 -- 172.21.15.146:0/4054859831 learned_addr learned my addr 172.21.15.146:0/4054859831 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:16:27.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.249+0000 7fdd76ffd700 1 -- 172.21.15.146:0/4054859831 >> v2:172.21.15.151:3300/0 conn(0x7fdd780b2530 msgr2=0x7fdd7815acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:27.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.249+0000 7fdd777fe700 1 --2- 172.21.15.146:0/4054859831 >> v2:172.21.15.151:3300/0 conn(0x7fdd780b2530 0x7fdd7815acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:27.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.249+0000 7fdd767fc700 1 -- 172.21.15.146:0/4054859831 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2412752301 0 0) 0x7fdd7815c630 con 0x7fdd7815a7f0 2023-10-06T11:16:27.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.249+0000 7fdd76ffd700 1 --2- 172.21.15.146:0/4054859831 >> v2:172.21.15.151:3300/0 conn(0x7fdd780b2530 0x7fdd7815acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.249+0000 7fdd76ffd700 1 -- 172.21.15.146:0/4054859831 >> v1:172.21.15.146:6789/0 conn(0x7fdd7815a7f0 legacy=0x7fdd780b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:27.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.249+0000 7fdd76ffd700 1 -- 172.21.15.146:0/4054859831 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd7815bd00 con 0x7fdd7815a420 2023-10-06T11:16:27.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.250+0000 7fdd76ffd700 1 --2- 172.21.15.146:0/4054859831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd7815a420 0x7fdd7815cac0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7fdd7815c5a0 tx=0x7fdd680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=959b4f30b86d5c2b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:27.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.250+0000 7fdd767fc700 1 -- 172.21.15.146:0/4054859831 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6800b6b0 con 0x7fdd7815a420 2023-10-06T11:16:27.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.250+0000 7fdd767fc700 1 -- 172.21.15.146:0/4054859831 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd6800b810 con 0x7fdd7815a420 2023-10-06T11:16:27.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.250+0000 7fdd767fc700 1 -- 172.21.15.146:0/4054859831 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6800bbb0 con 0x7fdd7815a420 2023-10-06T11:16:27.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.250+0000 7fdd77fff700 1 -- 172.21.15.146:0/4054859831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd7815a420 msgr2=0x7fdd7815cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:27.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.250+0000 7fdd77fff700 1 --2- 172.21.15.146:0/4054859831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd7815a420 0x7fdd7815cac0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7fdd7815c5a0 tx=0x7fdd680091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.250+0000 7fdd77fff700 1 -- 172.21.15.146:0/4054859831 shutdown_connections 2023-10-06T11:16:27.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.250+0000 7fdd77fff700 1 --2- 172.21.15.146:0/4054859831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd7815a420 0x7fdd7815cac0 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.250+0000 7fdd77fff700 1 --2- 172.21.15.146:0/4054859831 >> v2:172.21.15.151:3300/0 conn(0x7fdd780b2530 0x7fdd7815acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.250+0000 7fdd77fff700 1 -- 172.21.15.146:0/4054859831 >> 172.21.15.146:0/4054859831 conn(0x7fdd7806eba0 msgr2=0x7fdd7806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:27.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.250+0000 7fdd77fff700 1 -- 172.21.15.146:0/4054859831 shutdown_connections 2023-10-06T11:16:27.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.250+0000 7fdd77fff700 1 -- 172.21.15.146:0/4054859831 wait complete. 2023-10-06T11:16:27.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.252+0000 7fdd77fff700 1 Processor -- start 2023-10-06T11:16:27.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.252+0000 7fdd77fff700 1 -- start start 2023-10-06T11:16:27.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.252+0000 7fdd77fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd780b2530 0x7fdd78147e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:27.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.252+0000 7fdd77fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd7815a420 0x7fdd78169e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:27.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.252+0000 7fdd77fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd7815a7f0 0x7fdd781514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:27.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.252+0000 7fdd77fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7814c630 con 0x7fdd780b2530 2023-10-06T11:16:27.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.252+0000 7fdd77fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7816ae60 con 0x7fdd7815a7f0 2023-10-06T11:16:27.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.252+0000 7fdd77fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7814c300 con 0x7fdd7815a420 2023-10-06T11:16:27.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.252+0000 7fdd76ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd780b2530 0x7fdd78147e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:27.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.252+0000 7fdd76ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd780b2530 0x7fdd78147e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48958/0 (socket says 172.21.15.146:48958) 2023-10-06T11:16:27.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.252+0000 7fdd76ffd700 1 -- 172.21.15.146:0/4276046068 learned_addr learned my addr 172.21.15.146:0/4276046068 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.253+0000 7fdd6e7fc700 1 --2- 172.21.15.146:0/4276046068 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd7815a420 0x7fdd78169e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.253+0000 7fdd777fe700 1 --2- 172.21.15.146:0/4276046068 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd7815a7f0 0x7fdd781514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.253+0000 7fdd76ffd700 1 -- 172.21.15.146:0/4276046068 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd7815a420 msgr2=0x7fdd78169e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.253+0000 7fdd76ffd700 1 --2- 172.21.15.146:0/4276046068 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd7815a420 0x7fdd78169e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.253+0000 7fdd76ffd700 1 -- 172.21.15.146:0/4276046068 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd7815a7f0 msgr2=0x7fdd781514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.253+0000 7fdd76ffd700 1 --2- 172.21.15.146:0/4276046068 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd7815a7f0 0x7fdd781514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.253+0000 7fdd76ffd700 1 -- 172.21.15.146:0/4276046068 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd68009420 con 0x7fdd780b2530 2023-10-06T11:16:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.253+0000 7fdd777fe700 1 --2- 172.21.15.146:0/4276046068 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd7815a7f0 0x7fdd781514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.253+0000 7fdd76ffd700 1 --2- 172.21.15.146:0/4276046068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd780b2530 0x7fdd78147e70 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7fdd78088e40 tx=0x7fdd68017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.253+0000 7fdd6f7fe700 1 -- 172.21.15.146:0/4276046068 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd68011420 con 0x7fdd780b2530 2023-10-06T11:16:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.253+0000 7fdd77fff700 1 -- 172.21.15.146:0/4276046068 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd7816a8a0 con 0x7fdd780b2530 2023-10-06T11:16:27.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.253+0000 7fdd77fff700 1 -- 172.21.15.146:0/4276046068 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd781483b0 con 0x7fdd780b2530 2023-10-06T11:16:27.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.253+0000 7fdd6f7fe700 1 -- 172.21.15.146:0/4276046068 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd68011790 con 0x7fdd780b2530 2023-10-06T11:16:27.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.253+0000 7fdd6f7fe700 1 -- 172.21.15.146:0/4276046068 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd68011900 con 0x7fdd780b2530 2023-10-06T11:16:27.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.254+0000 7fdd77fff700 1 -- 172.21.15.146:0/4276046068 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd7814c440 con 0x7fdd780b2530 2023-10-06T11:16:27.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.254+0000 7fdd6f7fe700 1 -- 172.21.15.146:0/4276046068 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdd68011c70 con 0x7fdd780b2530 2023-10-06T11:16:27.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.255+0000 7fdd6f7fe700 1 --2- 172.21.15.146:0/4276046068 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdd58066f30 0x7fdd580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:27.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.255+0000 7fdd6f7fe700 1 -- 172.21.15.146:0/4276046068 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdd68085ce0 con 0x7fdd780b2530 2023-10-06T11:16:27.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.255+0000 7fdd6e7fc700 1 --2- 172.21.15.146:0/4276046068 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdd58066f30 0x7fdd580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:27.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.255+0000 7fdd6e7fc700 1 --2- 172.21.15.146:0/4276046068 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdd58066f30 0x7fdd580693e0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fdd60000c00 tx=0x7fdd60009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:27.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.259+0000 7fdd6f7fe700 1 -- 172.21.15.146:0/4276046068 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdd7814c440 con 0x7fdd780b2530 2023-10-06T11:16:27.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.483+0000 7fdd77fff700 1 -- 172.21.15.146:0/4276046068 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdd7814c440 con 0x7fdd780b2530 2023-10-06T11:16:27.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.483+0000 7fdd6f7fe700 1 -- 172.21.15.146:0/4276046068 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 121 v121) v1 ==== 95+0+4610 (secure 0 0 0) 0x7fdd7814c440 con 0x7fdd780b2530 2023-10-06T11:16:27.486 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:16:27.486 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":121,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7181,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/255475004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":255475004},{"type":"v1","addr":"172.21.15.151:6834","nonce":255475004}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":116},{"gid":7184,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/206881843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":206881843},{"type":"v1","addr":"172.21.15.151:6835","nonce":206881843}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":116},{"gid":9192,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/3140231910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3140231910},{"type":"v1","addr":"172.21.15.146:6835","nonce":3140231910}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":116}],"filesystems":[{"mdsmap":{"epoch":121,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:16:23.472674+0000","modified":"2023-10-06T11:16:27.116489+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9198},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9198":{"gid":9198,"name":"a","rank":0,"incarnation":117,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/525107449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":525107449},{"type":"v1","addr":"172.21.15.146:6837","nonce":525107449}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-06T11:16:27.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.485+0000 7fdd77fff700 1 -- 172.21.15.146:0/4276046068 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdd58066f30 msgr2=0x7fdd580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:27.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.485+0000 7fdd77fff700 1 --2- 172.21.15.146:0/4276046068 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdd58066f30 0x7fdd580693e0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fdd60000c00 tx=0x7fdd60009040 comp rx=0 tx=0).stop 2023-10-06T11:16:27.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.485+0000 7fdd77fff700 1 -- 172.21.15.146:0/4276046068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd780b2530 msgr2=0x7fdd78147e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:27.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.485+0000 7fdd77fff700 1 --2- 172.21.15.146:0/4276046068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd780b2530 0x7fdd78147e70 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7fdd78088e40 tx=0x7fdd68017000 comp rx=0 tx=0).stop 2023-10-06T11:16:27.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.485+0000 7fdd77fff700 1 -- 172.21.15.146:0/4276046068 shutdown_connections 2023-10-06T11:16:27.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.485+0000 7fdd77fff700 1 --2- 172.21.15.146:0/4276046068 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdd58066f30 0x7fdd580693e0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.485+0000 7fdd77fff700 1 --2- 172.21.15.146:0/4276046068 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd7815a7f0 0x7fdd781514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.485+0000 7fdd77fff700 1 --2- 172.21.15.146:0/4276046068 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdd780b2530 0x7fdd78147e70 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.485+0000 7fdd77fff700 1 --2- 172.21.15.146:0/4276046068 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd7815a420 0x7fdd78169e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.485+0000 7fdd77fff700 1 -- 172.21.15.146:0/4276046068 >> 172.21.15.146:0/4276046068 conn(0x7fdd7806eba0 msgr2=0x7fdd780b0210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:27.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.485+0000 7fdd77fff700 1 -- 172.21.15.146:0/4276046068 shutdown_connections 2023-10-06T11:16:27.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.485+0000 7fdd77fff700 1 -- 172.21.15.146:0/4276046068 wait complete. 2023-10-06T11:16:27.491 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 121 2023-10-06T11:16:27.499 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:16:27.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.612+0000 7f8efab57700 1 Processor -- start 2023-10-06T11:16:27.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.612+0000 7f8efab57700 1 -- start start 2023-10-06T11:16:27.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.613+0000 7f8efab57700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8ef4068ba0 0x7f8ef415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:27.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.613+0000 7f8efab57700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ef415ac30 con 0x7f8ef4153e80 2023-10-06T11:16:27.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.613+0000 7f8efab57700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ef40b4510 con 0x7f8ef4153ab0 2023-10-06T11:16:27.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.613+0000 7f8efab57700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ef40b6530 con 0x7f8ef4068ba0 2023-10-06T11:16:27.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.613+0000 7f8eebfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8ef4068ba0 0x7f8ef415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:27.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.613+0000 7f8ef90f4700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8ef4153e80 0x7f8ef40b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:34642/0 (socket says 172.21.15.146:34642) 2023-10-06T11:16:27.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.613+0000 7f8ef90f4700 1 -- 172.21.15.146:0/151285630 learned_addr learned my addr 172.21.15.146:0/151285630 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:16:27.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.614+0000 7f8eebfff700 1 -- 172.21.15.146:0/151285630 >> v1:172.21.15.151:6789/0 conn(0x7f8ef4153ab0 legacy=0x7f8ef4068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:27.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.614+0000 7f8eebfff700 1 -- 172.21.15.146:0/151285630 >> v1:172.21.15.146:6789/0 conn(0x7f8ef4153e80 legacy=0x7f8ef40b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:27.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.614+0000 7f8eebfff700 1 -- 172.21.15.146:0/151285630 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef40b5c50 con 0x7f8ef4068ba0 2023-10-06T11:16:27.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.614+0000 7f8eeb7fe700 1 -- 172.21.15.146:0/151285630 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1714368469 0 0) 0x7f8eec001490 con 0x7f8ef4153e80 2023-10-06T11:16:27.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.614+0000 7f8eebfff700 1 --2- 172.21.15.146:0/151285630 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ef4068ba0 0x7f8ef415a6f0 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f8ee40098e0 tx=0x7f8ee40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d548ae0fd8310d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:27.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.614+0000 7f8eeb7fe700 1 -- 172.21.15.146:0/151285630 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee4009e80 con 0x7f8ef4068ba0 2023-10-06T11:16:27.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.614+0000 7f8eeb7fe700 1 -- 172.21.15.146:0/151285630 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee400b860 con 0x7f8ef4068ba0 2023-10-06T11:16:27.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.614+0000 7f8eeb7fe700 1 -- 172.21.15.146:0/151285630 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee400bbe0 con 0x7f8ef4068ba0 2023-10-06T11:16:27.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.614+0000 7f8efab57700 1 -- 172.21.15.146:0/151285630 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ef4068ba0 msgr2=0x7f8ef415a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:27.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.614+0000 7f8efab57700 1 --2- 172.21.15.146:0/151285630 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ef4068ba0 0x7f8ef415a6f0 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f8ee40098e0 tx=0x7f8ee40091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.614+0000 7f8efab57700 1 -- 172.21.15.146:0/151285630 shutdown_connections 2023-10-06T11:16:27.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.614+0000 7f8efab57700 1 --2- 172.21.15.146:0/151285630 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ef4068ba0 0x7f8ef415a6f0 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.614+0000 7f8efab57700 1 -- 172.21.15.146:0/151285630 >> 172.21.15.146:0/151285630 conn(0x7f8ef406eba0 msgr2=0x7f8ef406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:27.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.615+0000 7f8efab57700 1 -- 172.21.15.146:0/151285630 shutdown_connections 2023-10-06T11:16:27.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.615+0000 7f8efab57700 1 -- 172.21.15.146:0/151285630 wait complete. 2023-10-06T11:16:27.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.616+0000 7f8efab57700 1 Processor -- start 2023-10-06T11:16:27.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.616+0000 7f8efab57700 1 -- start start 2023-10-06T11:16:27.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.616+0000 7f8efab57700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ef4068ba0 0x7f8ef4140fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:27.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.616+0000 7f8efab57700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ef4153ab0 0x7f8ef41583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:27.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.616+0000 7f8efab57700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ef4153e80 0x7f8ef415ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:27.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.617+0000 7f8efab57700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef41599e0 con 0x7f8ef4068ba0 2023-10-06T11:16:27.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.617+0000 7f8efab57700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef4158dd0 con 0x7f8ef4153ab0 2023-10-06T11:16:27.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.617+0000 7f8efab57700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef41590b0 con 0x7f8ef4153e80 2023-10-06T11:16:27.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.617+0000 7f8ef88f3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ef4068ba0 0x7f8ef4140fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:27.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.617+0000 7f8ef88f3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ef4068ba0 0x7f8ef4140fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48974/0 (socket says 172.21.15.146:48974) 2023-10-06T11:16:27.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.617+0000 7f8ef88f3700 1 -- 172.21.15.146:0/3101016357 learned_addr learned my addr 172.21.15.146:0/3101016357 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:27.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.617+0000 7f8ef88f3700 1 -- 172.21.15.146:0/3101016357 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ef4153e80 msgr2=0x7f8ef415ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:27.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.617+0000 7f8eebfff700 1 --2- 172.21.15.146:0/3101016357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ef4153ab0 0x7f8ef41583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:27.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.617+0000 7f8ef90f4700 1 --2- 172.21.15.146:0/3101016357 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ef4153e80 0x7f8ef415ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:27.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.617+0000 7f8ef88f3700 1 --2- 172.21.15.146:0/3101016357 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ef4153e80 0x7f8ef415ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.617+0000 7f8ef88f3700 1 -- 172.21.15.146:0/3101016357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ef4153ab0 msgr2=0x7f8ef41583d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:27.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.617+0000 7f8ef88f3700 1 --2- 172.21.15.146:0/3101016357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ef4153ab0 0x7f8ef41583d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.617+0000 7f8ef88f3700 1 -- 172.21.15.146:0/3101016357 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee4009420 con 0x7f8ef4068ba0 2023-10-06T11:16:27.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.617+0000 7f8eebfff700 1 --2- 172.21.15.146:0/3101016357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ef4153ab0 0x7f8ef41583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:27.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.617+0000 7f8ef90f4700 1 --2- 172.21.15.146:0/3101016357 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ef4153e80 0x7f8ef415ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:27.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.617+0000 7f8ef88f3700 1 --2- 172.21.15.146:0/3101016357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ef4068ba0 0x7f8ef4140fa0 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f8ef000c5d0 tx=0x7f8ef0007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:27.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.617+0000 7f8ee8ff9700 1 -- 172.21.15.146:0/3101016357 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef0011590 con 0x7f8ef4068ba0 2023-10-06T11:16:27.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.617+0000 7f8ee8ff9700 1 -- 172.21.15.146:0/3101016357 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef0011710 con 0x7f8ef4068ba0 2023-10-06T11:16:27.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.617+0000 7f8efab57700 1 -- 172.21.15.146:0/3101016357 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ef4159390 con 0x7f8ef4068ba0 2023-10-06T11:16:27.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.617+0000 7f8ee8ff9700 1 -- 172.21.15.146:0/3101016357 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef0011ad0 con 0x7f8ef4068ba0 2023-10-06T11:16:27.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.617+0000 7f8efab57700 1 -- 172.21.15.146:0/3101016357 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ef41414e0 con 0x7f8ef4068ba0 2023-10-06T11:16:27.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.618+0000 7f8efab57700 1 -- 172.21.15.146:0/3101016357 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ef404c380 con 0x7f8ef4068ba0 2023-10-06T11:16:27.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.619+0000 7f8ee8ff9700 1 -- 172.21.15.146:0/3101016357 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ef001c460 con 0x7f8ef4068ba0 2023-10-06T11:16:27.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.619+0000 7f8ee8ff9700 1 --2- 172.21.15.146:0/3101016357 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8ee0066f30 0x7f8ee00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:27.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.619+0000 7f8ee8ff9700 1 -- 172.21.15.146:0/3101016357 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8ef0084490 con 0x7f8ef4068ba0 2023-10-06T11:16:27.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.619+0000 7f8eebfff700 1 --2- 172.21.15.146:0/3101016357 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8ee0066f30 0x7f8ee00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:27.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.619+0000 7f8eebfff700 1 --2- 172.21.15.146:0/3101016357 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8ee0066f30 0x7f8ee00693e0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4068fa0 tx=0x7f8ee4016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:27.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.623+0000 7f8ee8ff9700 1 -- 172.21.15.146:0/3101016357 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ef00515a0 con 0x7f8ef4068ba0 2023-10-06T11:16:27.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.807+0000 7f8efab57700 1 -- 172.21.15.146:0/3101016357 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ef40b6250 con 0x7f8ef4068ba0 2023-10-06T11:16:27.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.807+0000 7f8ee8ff9700 1 -- 172.21.15.146:0/3101016357 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) v1 ==== 74+0+16928 (secure 0 0 0) 0x7f8ef0054bc0 con 0x7f8ef4068ba0 2023-10-06T11:16:27.809 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:16:27.810 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":137,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:16:25.092143+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:16:21.174178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-10-06T11:16:22.437689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:16:27.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.810+0000 7f8efab57700 1 -- 172.21.15.146:0/3101016357 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8ee0066f30 msgr2=0x7f8ee00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:27.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.810+0000 7f8efab57700 1 --2- 172.21.15.146:0/3101016357 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8ee0066f30 0x7f8ee00693e0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f8ef4068fa0 tx=0x7f8ee4016000 comp rx=0 tx=0).stop 2023-10-06T11:16:27.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.810+0000 7f8efab57700 1 -- 172.21.15.146:0/3101016357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ef4068ba0 msgr2=0x7f8ef4140fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:27.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.810+0000 7f8efab57700 1 --2- 172.21.15.146:0/3101016357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ef4068ba0 0x7f8ef4140fa0 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f8ef000c5d0 tx=0x7f8ef0007f60 comp rx=0 tx=0).stop 2023-10-06T11:16:27.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.810+0000 7f8efab57700 1 -- 172.21.15.146:0/3101016357 shutdown_connections 2023-10-06T11:16:27.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.810+0000 7f8efab57700 1 --2- 172.21.15.146:0/3101016357 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8ee0066f30 0x7f8ee00693e0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.810+0000 7f8efab57700 1 --2- 172.21.15.146:0/3101016357 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ef4153e80 0x7f8ef415ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.810+0000 7f8efab57700 1 --2- 172.21.15.146:0/3101016357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ef4068ba0 0x7f8ef4140fa0 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.810+0000 7f8efab57700 1 --2- 172.21.15.146:0/3101016357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ef4153ab0 0x7f8ef41583d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.810+0000 7f8efab57700 1 -- 172.21.15.146:0/3101016357 >> 172.21.15.146:0/3101016357 conn(0x7f8ef406eba0 msgr2=0x7f8ef40ce950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:27.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.810+0000 7f8efab57700 1 -- 172.21.15.146:0/3101016357 shutdown_connections 2023-10-06T11:16:27.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.810+0000 7f8efab57700 1 -- 172.21.15.146:0/3101016357 wait complete. 2023-10-06T11:16:27.824 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T11:16:27.825 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:16:27.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.937+0000 7fa92b47d700 1 Processor -- start 2023-10-06T11:16:27.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.937+0000 7fa92b47d700 1 -- start start 2023-10-06T11:16:27.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.938+0000 7fa92b47d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa92415cbd0 0x7fa9240b0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:27.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.938+0000 7fa92b47d700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa9240b3770 0x7fa9240b1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:27.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.938+0000 7fa92b47d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9240ae100 con 0x7fa92406f780 2023-10-06T11:16:27.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.938+0000 7fa92b47d700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9240b0db0 con 0x7fa9240b3770 2023-10-06T11:16:27.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.938+0000 7fa92b47d700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9240d0f10 con 0x7fa92415cbd0 2023-10-06T11:16:27.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.938+0000 7fa92ac7c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa92406f780 0x7fa9240aeb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:34644/0 (socket says 172.21.15.146:34644) 2023-10-06T11:16:27.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.938+0000 7fa92ac7c700 1 -- 172.21.15.146:0/1601591670 learned_addr learned my addr 172.21.15.146:0/1601591670 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:16:27.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.938+0000 7fa929479700 1 -- 172.21.15.146:0/1601591670 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 304243427 0 0) 0x7fa9240ae100 con 0x7fa92406f780 2023-10-06T11:16:27.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.938+0000 7fa929479700 1 -- 172.21.15.146:0/1601591670 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa910003570 con 0x7fa92406f780 2023-10-06T11:16:27.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.938+0000 7fa92a47b700 1 --2- 172.21.15.146:0/1601591670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa92415cbd0 0x7fa9240b0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:27.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.938+0000 7fa929c7a700 1 --2- 172.21.15.146:0/1601591670 >> v2:172.21.15.151:3300/0 conn(0x7fa9240b3770 0x7fa9240b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:27.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.938+0000 7fa929479700 1 -- 172.21.15.146:0/1601591670 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 895747149 0 0) 0x7fa910003570 con 0x7fa92406f780 2023-10-06T11:16:27.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.938+0000 7fa929479700 1 -- 172.21.15.146:0/1601591670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa92415cbd0 msgr2=0x7fa9240b0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:27.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.938+0000 7fa929479700 1 --2- 172.21.15.146:0/1601591670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa92415cbd0 0x7fa9240b0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.938+0000 7fa929479700 1 -- 172.21.15.146:0/1601591670 >> v2:172.21.15.151:3300/0 conn(0x7fa9240b3770 msgr2=0x7fa9240b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:27.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.938+0000 7fa929479700 1 --2- 172.21.15.146:0/1601591670 >> v2:172.21.15.151:3300/0 conn(0x7fa9240b3770 0x7fa9240b1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.938+0000 7fa929479700 1 -- 172.21.15.146:0/1601591670 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9240d11f0 con 0x7fa92406f780 2023-10-06T11:16:27.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.938+0000 7fa929479700 1 -- 172.21.15.146:0/1601591670 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fa9200017f0 con 0x7fa92406f780 2023-10-06T11:16:27.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.939+0000 7fa929479700 1 -- 172.21.15.146:0/1601591670 >> v1:172.21.15.146:6789/0 conn(0x7fa92406f780 legacy=0x7fa9240aeb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:27.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.939+0000 7fa929479700 1 --2- 172.21.15.146:0/1601591670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa910003a60 0x7fa910003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:27.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.939+0000 7fa929479700 1 --2- 172.21.15.146:0/1601591670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa910004810 0x7fa910004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:27.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.939+0000 7fa929479700 1 --2- 172.21.15.146:0/1601591670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa92415cbd0 0x7fa9100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:27.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.939+0000 7fa929479700 1 -- 172.21.15.146:0/1601591670 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9240b0db0 con 0x7fa910004810 2023-10-06T11:16:27.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.939+0000 7fa929479700 1 -- 172.21.15.146:0/1601591670 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9240d0f10 con 0x7fa910003a60 2023-10-06T11:16:27.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.939+0000 7fa929479700 1 -- 172.21.15.146:0/1601591670 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa91000ba60 con 0x7fa92415cbd0 2023-10-06T11:16:27.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.939+0000 7fa929c7a700 1 --2- 172.21.15.146:0/1601591670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa910004810 0x7fa910004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:27.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.939+0000 7fa92a47b700 1 --2- 172.21.15.146:0/1601591670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa910003a60 0x7fa910003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:27.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.939+0000 7fa92ac7c700 1 --2- 172.21.15.146:0/1601591670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa92415cbd0 0x7fa9100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:27.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.939+0000 7fa929c7a700 1 -- 172.21.15.146:0/1601591670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa92415cbd0 msgr2=0x7fa9100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:27.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.939+0000 7fa929c7a700 1 --2- 172.21.15.146:0/1601591670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa92415cbd0 0x7fa9100051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.945 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.939+0000 7fa929c7a700 1 -- 172.21.15.146:0/1601591670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa910003a60 msgr2=0x7fa910003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:27.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.939+0000 7fa929c7a700 1 --2- 172.21.15.146:0/1601591670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa910003a60 0x7fa910003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.939+0000 7fa929c7a700 1 -- 172.21.15.146:0/1601591670 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa910003570 con 0x7fa910004810 2023-10-06T11:16:27.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.939+0000 7fa929c7a700 1 --2- 172.21.15.146:0/1601591670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa910004810 0x7fa910004c80 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7fa914009c30 tx=0x7fa9140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80c2d6fc6c576876 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:27.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.939+0000 7fa929479700 1 -- 172.21.15.146:0/1601591670 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91400e710 con 0x7fa910004810 2023-10-06T11:16:27.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.939+0000 7fa929479700 1 -- 172.21.15.146:0/1601591670 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa91400e870 con 0x7fa910004810 2023-10-06T11:16:27.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.939+0000 7fa929479700 1 -- 172.21.15.146:0/1601591670 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91400ec30 con 0x7fa910004810 2023-10-06T11:16:27.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.940+0000 7fa92b47d700 1 -- 172.21.15.146:0/1601591670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa910004810 msgr2=0x7fa910004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:27.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.940+0000 7fa92b47d700 1 --2- 172.21.15.146:0/1601591670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa910004810 0x7fa910004c80 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7fa914009c30 tx=0x7fa9140091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.940+0000 7fa92ac7c700 1 -- 172.21.15.146:0/1601591670 reap_dead start 2023-10-06T11:16:27.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.940+0000 7fa92b47d700 1 -- 172.21.15.146:0/1601591670 shutdown_connections 2023-10-06T11:16:27.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.940+0000 7fa92b47d700 1 -- 172.21.15.146:0/1601591670 >> 172.21.15.146:0/1601591670 conn(0x7fa92406f380 msgr2=0x7fa9240d0660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:27.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.940+0000 7fa92b47d700 1 -- 172.21.15.146:0/1601591670 shutdown_connections 2023-10-06T11:16:27.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.940+0000 7fa92b47d700 1 -- 172.21.15.146:0/1601591670 wait complete. 2023-10-06T11:16:27.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.941+0000 7fa92b47d700 1 Processor -- start 2023-10-06T11:16:27.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.941+0000 7fa92b47d700 1 -- start start 2023-10-06T11:16:27.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.942+0000 7fa92b47d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa910004810 0x7fa924153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:27.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.942+0000 7fa92b47d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa92414f0c0 0x7fa9240b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:27.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.942+0000 7fa92b47d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa92414f530 0x7fa92414d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:27.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.942+0000 7fa92b47d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa924153680 con 0x7fa92414f530 2023-10-06T11:16:27.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.942+0000 7fa92b47d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa924169f20 con 0x7fa92414f0c0 2023-10-06T11:16:27.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.942+0000 7fa92b47d700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa92416a200 con 0x7fa910004810 2023-10-06T11:16:27.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.942+0000 7fa92ac7c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa92414f530 0x7fa92414d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:27.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.942+0000 7fa92ac7c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa92414f530 0x7fa92414d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48990/0 (socket says 172.21.15.146:48990) 2023-10-06T11:16:27.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.942+0000 7fa92ac7c700 1 -- 172.21.15.146:0/1220662704 learned_addr learned my addr 172.21.15.146:0/1220662704 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:27.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.942+0000 7fa92a47b700 1 --2- 172.21.15.146:0/1220662704 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa910004810 0x7fa924153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:27.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.942+0000 7fa929c7a700 1 --2- 172.21.15.146:0/1220662704 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa92414f0c0 0x7fa9240b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:27.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.942+0000 7fa92ac7c700 1 -- 172.21.15.146:0/1220662704 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa910004810 msgr2=0x7fa924153140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:27.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.942+0000 7fa92ac7c700 1 --2- 172.21.15.146:0/1220662704 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa910004810 0x7fa924153140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.942+0000 7fa92ac7c700 1 -- 172.21.15.146:0/1220662704 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa92414f0c0 msgr2=0x7fa9240b50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:27.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.942+0000 7fa92ac7c700 1 --2- 172.21.15.146:0/1220662704 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa92414f0c0 0x7fa9240b50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:27.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.942+0000 7fa92ac7c700 1 -- 172.21.15.146:0/1220662704 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa92416a4e0 con 0x7fa92414f530 2023-10-06T11:16:27.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.942+0000 7fa92ac7c700 1 --2- 172.21.15.146:0/1220662704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa92414f530 0x7fa92414d2b0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7fa924071250 tx=0x7fa9200021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:27.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.942+0000 7fa91a7fc700 1 -- 172.21.15.146:0/1220662704 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92000ac90 con 0x7fa92414f530 2023-10-06T11:16:27.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.942+0000 7fa91a7fc700 1 -- 172.21.15.146:0/1220662704 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa92000ae10 con 0x7fa92414f530 2023-10-06T11:16:27.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.942+0000 7fa92b47d700 1 -- 172.21.15.146:0/1220662704 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa92416a7c0 con 0x7fa92414f530 2023-10-06T11:16:27.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.942+0000 7fa91a7fc700 1 -- 172.21.15.146:0/1220662704 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa920013640 con 0x7fa92414f530 2023-10-06T11:16:27.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.942+0000 7fa92b47d700 1 -- 172.21.15.146:0/1220662704 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa924169b00 con 0x7fa92414f530 2023-10-06T11:16:27.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.943+0000 7fa92b47d700 1 -- 172.21.15.146:0/1220662704 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa924088170 con 0x7fa92414f530 2023-10-06T11:16:27.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.944+0000 7fa91a7fc700 1 -- 172.21.15.146:0/1220662704 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa920013a30 con 0x7fa92414f530 2023-10-06T11:16:27.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.944+0000 7fa91a7fc700 1 --2- 172.21.15.146:0/1220662704 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa908066fb0 0x7fa908069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:27.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.944+0000 7fa91a7fc700 1 -- 172.21.15.146:0/1220662704 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa920084e10 con 0x7fa92414f530 2023-10-06T11:16:27.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.944+0000 7fa92a47b700 1 --2- 172.21.15.146:0/1220662704 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa908066fb0 0x7fa908069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:27.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.945+0000 7fa92a47b700 1 --2- 172.21.15.146:0/1220662704 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa908066fb0 0x7fa908069460 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fa91c006f00 tx=0x7fa91c0091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:27.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:27.949+0000 7fa91a7fc700 1 -- 172.21.15.146:0/1220662704 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa920051e80 con 0x7fa92414f530 2023-10-06T11:16:28.131 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.130+0000 7fa92b47d700 1 -- 172.21.15.146:0/1220662704 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa9240ae350 con 0x7fa908066fb0 2023-10-06T11:16:28.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.138+0000 7fa91a7fc700 1 -- 172.21.15.146:0/1220662704 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+307640 (secure 0 0 0) 0x7fa9240ae350 con 0x7fa908066fb0 2023-10-06T11:16:28.143 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:16:28.147 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.141+0000 7fa92b47d700 1 -- 172.21.15.146:0/1220662704 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa908066fb0 msgr2=0x7fa908069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:28.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.141+0000 7fa92b47d700 1 --2- 172.21.15.146:0/1220662704 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa908066fb0 0x7fa908069460 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fa91c006f00 tx=0x7fa91c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:28.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.141+0000 7fa92b47d700 1 -- 172.21.15.146:0/1220662704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa92414f530 msgr2=0x7fa92414d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:28.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.141+0000 7fa92b47d700 1 --2- 172.21.15.146:0/1220662704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa92414f530 0x7fa92414d2b0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7fa924071250 tx=0x7fa9200021d0 comp rx=0 tx=0).stop 2023-10-06T11:16:28.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.141+0000 7fa92b47d700 1 -- 172.21.15.146:0/1220662704 shutdown_connections 2023-10-06T11:16:28.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.141+0000 7fa92b47d700 1 --2- 172.21.15.146:0/1220662704 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa908066fb0 0x7fa908069460 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:28.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.141+0000 7fa92b47d700 1 --2- 172.21.15.146:0/1220662704 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa92414f530 0x7fa92414d2b0 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:28.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.141+0000 7fa92b47d700 1 --2- 172.21.15.146:0/1220662704 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa910004810 0x7fa924153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:28.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.141+0000 7fa92b47d700 1 --2- 172.21.15.146:0/1220662704 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa92414f0c0 0x7fa9240b50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:28.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.141+0000 7fa92b47d700 1 -- 172.21.15.146:0/1220662704 >> 172.21.15.146:0/1220662704 conn(0x7fa92406f380 msgr2=0x7fa9240d0760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:28.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.141+0000 7fa92b47d700 1 -- 172.21.15.146:0/1220662704 shutdown_connections 2023-10-06T11:16:28.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.141+0000 7fa92b47d700 1 -- 172.21.15.146:0/1220662704 wait complete. 2023-10-06T11:16:28.149 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:16:28.155 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":455,"stamp":"2023-10-06T11:16:27.278649+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592604,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":196,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":154,"acting":154,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":127,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2437824,"kb_used_data":14464,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752536896,"statfs":{"total":773094113280,"available":770597781504,"internally_reserved":0,"allocated":14811136,"data_stored":7419345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2236,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.194253"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.114163+0000","last_change":"2023-10-06T11:16:24.109016+0000","last_active":"2023-10-06T11:16:24.114163+0000","last_peered":"2023-10-06T11:16:24.114163+0000","last_clean":"2023-10-06T11:16:24.114163+0000","last_became_active":"2023-10-06T11:16:24.108230+0000","last_became_peered":"2023-10-06T11:16:24.108230+0000","last_unstale":"2023-10-06T11:16:24.114163+0000","last_undegraded":"2023-10-06T11:16:24.114163+0000","last_fullsized":"2023-10-06T11:16:24.114163+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:46:32.933025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.114773+0000","last_change":"2023-10-06T11:16:24.108647+0000","last_active":"2023-10-06T11:16:24.114773+0000","last_peered":"2023-10-06T11:16:24.114773+0000","last_clean":"2023-10-06T11:16:24.114773+0000","last_became_active":"2023-10-06T11:16:24.108417+0000","last_became_peered":"2023-10-06T11:16:24.108417+0000","last_unstale":"2023-10-06T11:16:24.114773+0000","last_undegraded":"2023-10-06T11:16:24.114773+0000","last_fullsized":"2023-10-06T11:16:24.114773+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:26:03.575635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116075+0000","last_change":"2023-10-06T11:16:24.108739+0000","last_active":"2023-10-06T11:16:24.116075+0000","last_peered":"2023-10-06T11:16:24.116075+0000","last_clean":"2023-10-06T11:16:24.116075+0000","last_became_active":"2023-10-06T11:16:24.108453+0000","last_became_peered":"2023-10-06T11:16:24.108453+0000","last_unstale":"2023-10-06T11:16:24.116075+0000","last_undegraded":"2023-10-06T11:16:24.116075+0000","last_fullsized":"2023-10-06T11:16:24.116075+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:59:45.901579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.120838+0000","last_change":"2023-10-06T11:16:24.115798+0000","last_active":"2023-10-06T11:16:24.120838+0000","last_peered":"2023-10-06T11:16:24.120838+0000","last_clean":"2023-10-06T11:16:24.120838+0000","last_became_active":"2023-10-06T11:16:24.115530+0000","last_became_peered":"2023-10-06T11:16:24.115530+0000","last_unstale":"2023-10-06T11:16:24.120838+0000","last_undegraded":"2023-10-06T11:16:24.120838+0000","last_fullsized":"2023-10-06T11:16:24.120838+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:26:32.565614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116267+0000","last_change":"2023-10-06T11:16:24.112144+0000","last_active":"2023-10-06T11:16:24.116267+0000","last_peered":"2023-10-06T11:16:24.116267+0000","last_clean":"2023-10-06T11:16:24.116267+0000","last_became_active":"2023-10-06T11:16:24.111426+0000","last_became_peered":"2023-10-06T11:16:24.111426+0000","last_unstale":"2023-10-06T11:16:24.116267+0000","last_undegraded":"2023-10-06T11:16:24.116267+0000","last_fullsized":"2023-10-06T11:16:24.116267+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:12:06.066982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116349+0000","last_change":"2023-10-06T11:16:24.113655+0000","last_active":"2023-10-06T11:16:24.116349+0000","last_peered":"2023-10-06T11:16:24.116349+0000","last_clean":"2023-10-06T11:16:24.116349+0000","last_became_active":"2023-10-06T11:16:24.113399+0000","last_became_peered":"2023-10-06T11:16:24.113399+0000","last_unstale":"2023-10-06T11:16:24.116349+0000","last_undegraded":"2023-10-06T11:16:24.116349+0000","last_fullsized":"2023-10-06T11:16:24.116349+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:50:16.146183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121936+0000","last_change":"2023-10-06T11:16:24.119814+0000","last_active":"2023-10-06T11:16:24.121936+0000","last_peered":"2023-10-06T11:16:24.121936+0000","last_clean":"2023-10-06T11:16:24.121936+0000","last_became_active":"2023-10-06T11:16:24.119316+0000","last_became_peered":"2023-10-06T11:16:24.119316+0000","last_unstale":"2023-10-06T11:16:24.121936+0000","last_undegraded":"2023-10-06T11:16:24.121936+0000","last_fullsized":"2023-10-06T11:16:24.121936+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:26.166829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116386+0000","last_change":"2023-10-06T11:16:24.113716+0000","last_active":"2023-10-06T11:16:24.116386+0000","last_peered":"2023-10-06T11:16:24.116386+0000","last_clean":"2023-10-06T11:16:24.116386+0000","last_became_active":"2023-10-06T11:16:24.113447+0000","last_became_peered":"2023-10-06T11:16:24.113447+0000","last_unstale":"2023-10-06T11:16:24.116386+0000","last_undegraded":"2023-10-06T11:16:24.116386+0000","last_fullsized":"2023-10-06T11:16:24.116386+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:28.023957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.106632+0000","last_change":"2023-10-06T11:16:24.103595+0000","last_active":"2023-10-06T11:16:24.106632+0000","last_peered":"2023-10-06T11:16:24.106632+0000","last_clean":"2023-10-06T11:16:24.106632+0000","last_became_active":"2023-10-06T11:16:24.103341+0000","last_became_peered":"2023-10-06T11:16:24.103341+0000","last_unstale":"2023-10-06T11:16:24.106632+0000","last_undegraded":"2023-10-06T11:16:24.106632+0000","last_fullsized":"2023-10-06T11:16:24.106632+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:30:19.278442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.120354+0000","last_change":"2023-10-06T11:16:24.107132+0000","last_active":"2023-10-06T11:16:24.120354+0000","last_peered":"2023-10-06T11:16:24.120354+0000","last_clean":"2023-10-06T11:16:24.120354+0000","last_became_active":"2023-10-06T11:16:24.106714+0000","last_became_peered":"2023-10-06T11:16:24.106714+0000","last_unstale":"2023-10-06T11:16:24.120354+0000","last_undegraded":"2023-10-06T11:16:24.120354+0000","last_fullsized":"2023-10-06T11:16:24.120354+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:08.737914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121851+0000","last_change":"2023-10-06T11:16:24.116978+0000","last_active":"2023-10-06T11:16:24.121851+0000","last_peered":"2023-10-06T11:16:24.121851+0000","last_clean":"2023-10-06T11:16:24.121851+0000","last_became_active":"2023-10-06T11:16:24.116483+0000","last_became_peered":"2023-10-06T11:16:24.116483+0000","last_unstale":"2023-10-06T11:16:24.121851+0000","last_undegraded":"2023-10-06T11:16:24.121851+0000","last_fullsized":"2023-10-06T11:16:24.121851+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:07.106736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.112359+0000","last_change":"2023-10-06T11:16:24.101538+0000","last_active":"2023-10-06T11:16:24.112359+0000","last_peered":"2023-10-06T11:16:24.112359+0000","last_clean":"2023-10-06T11:16:24.112359+0000","last_became_active":"2023-10-06T11:16:24.101276+0000","last_became_peered":"2023-10-06T11:16:24.101276+0000","last_unstale":"2023-10-06T11:16:24.112359+0000","last_undegraded":"2023-10-06T11:16:24.112359+0000","last_fullsized":"2023-10-06T11:16:24.112359+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:26:02.681339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.118962+0000","last_change":"2023-10-06T11:16:24.117423+0000","last_active":"2023-10-06T11:16:24.118962+0000","last_peered":"2023-10-06T11:16:24.118962+0000","last_clean":"2023-10-06T11:16:24.118962+0000","last_became_active":"2023-10-06T11:16:24.117137+0000","last_became_peered":"2023-10-06T11:16:24.117137+0000","last_unstale":"2023-10-06T11:16:24.118962+0000","last_undegraded":"2023-10-06T11:16:24.118962+0000","last_fullsized":"2023-10-06T11:16:24.118962+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:17.086479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.119950+0000","last_change":"2023-10-06T11:16:24.112281+0000","last_active":"2023-10-06T11:16:24.119950+0000","last_peered":"2023-10-06T11:16:24.119950+0000","last_clean":"2023-10-06T11:16:24.119950+0000","last_became_active":"2023-10-06T11:16:24.111821+0000","last_became_peered":"2023-10-06T11:16:24.111821+0000","last_unstale":"2023-10-06T11:16:24.119950+0000","last_undegraded":"2023-10-06T11:16:24.119950+0000","last_fullsized":"2023-10-06T11:16:24.119950+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:11.876870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.108707+0000","last_change":"2023-10-06T11:16:24.105272+0000","last_active":"2023-10-06T11:16:24.108707+0000","last_peered":"2023-10-06T11:16:24.108707+0000","last_clean":"2023-10-06T11:16:24.108707+0000","last_became_active":"2023-10-06T11:16:24.104836+0000","last_became_peered":"2023-10-06T11:16:24.104836+0000","last_unstale":"2023-10-06T11:16:24.108707+0000","last_undegraded":"2023-10-06T11:16:24.108707+0000","last_fullsized":"2023-10-06T11:16:24.108707+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:20:21.978391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.114191+0000","last_change":"2023-10-06T11:16:24.109203+0000","last_active":"2023-10-06T11:16:24.114191+0000","last_peered":"2023-10-06T11:16:24.114191+0000","last_clean":"2023-10-06T11:16:24.114191+0000","last_became_active":"2023-10-06T11:16:24.103632+0000","last_became_peered":"2023-10-06T11:16:24.103632+0000","last_unstale":"2023-10-06T11:16:24.114191+0000","last_undegraded":"2023-10-06T11:16:24.114191+0000","last_fullsized":"2023-10-06T11:16:24.114191+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:21:48.286337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.119621+0000","last_change":"2023-10-06T11:16:24.112055+0000","last_active":"2023-10-06T11:16:24.119621+0000","last_peered":"2023-10-06T11:16:24.119621+0000","last_clean":"2023-10-06T11:16:24.119621+0000","last_became_active":"2023-10-06T11:16:24.111459+0000","last_became_peered":"2023-10-06T11:16:24.111459+0000","last_unstale":"2023-10-06T11:16:24.119621+0000","last_undegraded":"2023-10-06T11:16:24.119621+0000","last_fullsized":"2023-10-06T11:16:24.119621+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:56:01.575492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116536+0000","last_change":"2023-10-06T11:16:24.114696+0000","last_active":"2023-10-06T11:16:24.116536+0000","last_peered":"2023-10-06T11:16:24.116536+0000","last_clean":"2023-10-06T11:16:24.116536+0000","last_became_active":"2023-10-06T11:16:24.114468+0000","last_became_peered":"2023-10-06T11:16:24.114468+0000","last_unstale":"2023-10-06T11:16:24.116536+0000","last_undegraded":"2023-10-06T11:16:24.116536+0000","last_fullsized":"2023-10-06T11:16:24.116536+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:29.132592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121795+0000","last_change":"2023-10-06T11:16:24.118093+0000","last_active":"2023-10-06T11:16:24.121795+0000","last_peered":"2023-10-06T11:16:24.121795+0000","last_clean":"2023-10-06T11:16:24.121795+0000","last_became_active":"2023-10-06T11:16:24.117790+0000","last_became_peered":"2023-10-06T11:16:24.117790+0000","last_unstale":"2023-10-06T11:16:24.121795+0000","last_undegraded":"2023-10-06T11:16:24.121795+0000","last_fullsized":"2023-10-06T11:16:24.121795+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:47:48.803032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121730+0000","last_change":"2023-10-06T11:16:24.118266+0000","last_active":"2023-10-06T11:16:24.121730+0000","last_peered":"2023-10-06T11:16:24.121730+0000","last_clean":"2023-10-06T11:16:24.121730+0000","last_became_active":"2023-10-06T11:16:24.118001+0000","last_became_peered":"2023-10-06T11:16:24.118001+0000","last_unstale":"2023-10-06T11:16:24.121730+0000","last_undegraded":"2023-10-06T11:16:24.121730+0000","last_fullsized":"2023-10-06T11:16:24.121730+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:59:42.744899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.107924+0000","last_change":"2023-10-06T11:16:24.103535+0000","last_active":"2023-10-06T11:16:24.107924+0000","last_peered":"2023-10-06T11:16:24.107924+0000","last_clean":"2023-10-06T11:16:24.107924+0000","last_became_active":"2023-10-06T11:16:24.103293+0000","last_became_peered":"2023-10-06T11:16:24.103293+0000","last_unstale":"2023-10-06T11:16:24.107924+0000","last_undegraded":"2023-10-06T11:16:24.107924+0000","last_fullsized":"2023-10-06T11:16:24.107924+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:10:53.231459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1f","version":"136'4","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.118823+0000","last_change":"2023-10-06T11:16:23.099064+0000","last_active":"2023-10-06T11:16:24.118823+0000","last_peered":"2023-10-06T11:16:24.118823+0000","last_clean":"2023-10-06T11:16:24.118823+0000","last_became_active":"2023-10-06T11:16:23.098801+0000","last_became_peered":"2023-10-06T11:16:23.098801+0000","last_unstale":"2023-10-06T11:16:24.118823+0000","last_undegraded":"2023-10-06T11:16:24.118823+0000","last_fullsized":"2023-10-06T11:16:24.118823+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:41:43.291967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"136'1","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121286+0000","last_change":"2023-10-06T11:16:23.104447+0000","last_active":"2023-10-06T11:16:24.121286+0000","last_peered":"2023-10-06T11:16:24.121286+0000","last_clean":"2023-10-06T11:16:24.121286+0000","last_became_active":"2023-10-06T11:16:23.104161+0000","last_became_peered":"2023-10-06T11:16:23.104161+0000","last_unstale":"2023-10-06T11:16:24.121286+0000","last_undegraded":"2023-10-06T11:16:24.121286+0000","last_fullsized":"2023-10-06T11:16:24.121286+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:56:00.571220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1d","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.123951+0000","last_change":"2023-10-06T11:16:23.104220+0000","last_active":"2023-10-06T11:16:24.123951+0000","last_peered":"2023-10-06T11:16:24.123951+0000","last_clean":"2023-10-06T11:16:24.123951+0000","last_became_active":"2023-10-06T11:16:23.103920+0000","last_became_peered":"2023-10-06T11:16:23.103920+0000","last_unstale":"2023-10-06T11:16:24.123951+0000","last_undegraded":"2023-10-06T11:16:24.123951+0000","last_fullsized":"2023-10-06T11:16:24.123951+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:50.360247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.122009+0000","last_change":"2023-10-06T11:16:24.118231+0000","last_active":"2023-10-06T11:16:24.122009+0000","last_peered":"2023-10-06T11:16:24.122009+0000","last_clean":"2023-10-06T11:16:24.122009+0000","last_became_active":"2023-10-06T11:16:24.117962+0000","last_became_peered":"2023-10-06T11:16:24.117962+0000","last_unstale":"2023-10-06T11:16:24.122009+0000","last_undegraded":"2023-10-06T11:16:24.122009+0000","last_fullsized":"2023-10-06T11:16:24.122009+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:34:42.484972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:22.074583+0000","last_change":"2023-10-06T11:16:22.089441+0000","last_active":"2023-10-06T11:16:22.074583+0000","last_peered":"2023-10-06T11:16:22.074583+0000","last_clean":"2023-10-06T11:16:22.074583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:22.074583+0000","last_undegraded":"2023-10-06T11:16:22.074583+0000","last_fullsized":"2023-10-06T11:16:22.074583+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:59.486245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.113203+0000","last_change":"2023-10-06T11:16:24.105810+0000","last_active":"2023-10-06T11:16:24.113203+0000","last_peered":"2023-10-06T11:16:24.113203+0000","last_clean":"2023-10-06T11:16:24.113203+0000","last_became_active":"2023-10-06T11:16:24.105537+0000","last_became_peered":"2023-10-06T11:16:24.105537+0000","last_unstale":"2023-10-06T11:16:24.113203+0000","last_undegraded":"2023-10-06T11:16:24.113203+0000","last_fullsized":"2023-10-06T11:16:24.113203+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:42:42.357861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:22.074583+0000","last_change":"2023-10-06T11:16:22.087560+0000","last_active":"2023-10-06T11:16:22.074583+0000","last_peered":"2023-10-06T11:16:22.074583+0000","last_clean":"2023-10-06T11:16:22.074583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:22.074583+0000","last_undegraded":"2023-10-06T11:16:22.074583+0000","last_fullsized":"2023-10-06T11:16:22.074583+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:34:43.602621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"136'1","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116331+0000","last_change":"2023-10-06T11:16:23.099499+0000","last_active":"2023-10-06T11:16:24.116331+0000","last_peered":"2023-10-06T11:16:24.116331+0000","last_clean":"2023-10-06T11:16:24.116331+0000","last_became_active":"2023-10-06T11:16:23.099285+0000","last_became_peered":"2023-10-06T11:16:23.099285+0000","last_unstale":"2023-10-06T11:16:24.116331+0000","last_undegraded":"2023-10-06T11:16:24.116331+0000","last_fullsized":"2023-10-06T11:16:24.116331+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:56:00.571220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.095986+0000","last_change":"2023-10-06T11:16:23.100854+0000","last_active":"2023-10-06T11:16:24.095986+0000","last_peered":"2023-10-06T11:16:24.095986+0000","last_clean":"2023-10-06T11:16:24.095986+0000","last_became_active":"2023-10-06T11:16:23.100200+0000","last_became_peered":"2023-10-06T11:16:23.100200+0000","last_unstale":"2023-10-06T11:16:24.095986+0000","last_undegraded":"2023-10-06T11:16:24.095986+0000","last_fullsized":"2023-10-06T11:16:24.095986+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:22:40.220215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.107002+0000","last_change":"2023-10-06T11:16:24.104492+0000","last_active":"2023-10-06T11:16:24.107002+0000","last_peered":"2023-10-06T11:16:24.107002+0000","last_clean":"2023-10-06T11:16:24.107002+0000","last_became_active":"2023-10-06T11:16:24.104181+0000","last_became_peered":"2023-10-06T11:16:24.104181+0000","last_unstale":"2023-10-06T11:16:24.107002+0000","last_undegraded":"2023-10-06T11:16:24.107002+0000","last_fullsized":"2023-10-06T11:16:24.107002+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:55:36.589699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.098162+0000","last_change":"2023-10-06T11:16:23.097833+0000","last_active":"2023-10-06T11:16:24.098162+0000","last_peered":"2023-10-06T11:16:24.098162+0000","last_clean":"2023-10-06T11:16:24.098162+0000","last_became_active":"2023-10-06T11:16:23.097560+0000","last_became_peered":"2023-10-06T11:16:23.097560+0000","last_unstale":"2023-10-06T11:16:24.098162+0000","last_undegraded":"2023-10-06T11:16:24.098162+0000","last_fullsized":"2023-10-06T11:16:24.098162+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:01:05.784628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121995+0000","last_change":"2023-10-06T11:16:24.118160+0000","last_active":"2023-10-06T11:16:24.121995+0000","last_peered":"2023-10-06T11:16:24.121995+0000","last_clean":"2023-10-06T11:16:24.121995+0000","last_became_active":"2023-10-06T11:16:24.117892+0000","last_became_peered":"2023-10-06T11:16:24.117892+0000","last_unstale":"2023-10-06T11:16:24.121995+0000","last_undegraded":"2023-10-06T11:16:24.121995+0000","last_fullsized":"2023-10-06T11:16:24.121995+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:52.405684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"136'1","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121722+0000","last_change":"2023-10-06T11:16:23.100806+0000","last_active":"2023-10-06T11:16:24.121722+0000","last_peered":"2023-10-06T11:16:24.121722+0000","last_clean":"2023-10-06T11:16:24.121722+0000","last_became_active":"2023-10-06T11:16:23.099910+0000","last_became_peered":"2023-10-06T11:16:23.099910+0000","last_unstale":"2023-10-06T11:16:24.121722+0000","last_undegraded":"2023-10-06T11:16:24.121722+0000","last_fullsized":"2023-10-06T11:16:24.121722+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:21:56.372977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.119434+0000","last_change":"2023-10-06T11:16:24.115023+0000","last_active":"2023-10-06T11:16:24.119434+0000","last_peered":"2023-10-06T11:16:24.119434+0000","last_clean":"2023-10-06T11:16:24.119434+0000","last_became_active":"2023-10-06T11:16:24.114720+0000","last_became_peered":"2023-10-06T11:16:24.114720+0000","last_unstale":"2023-10-06T11:16:24.119434+0000","last_undegraded":"2023-10-06T11:16:24.119434+0000","last_fullsized":"2023-10-06T11:16:24.119434+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:19.593270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121773+0000","last_change":"2023-10-06T11:16:23.103494+0000","last_active":"2023-10-06T11:16:24.121773+0000","last_peered":"2023-10-06T11:16:24.121773+0000","last_clean":"2023-10-06T11:16:24.121773+0000","last_became_active":"2023-10-06T11:16:23.103217+0000","last_became_peered":"2023-10-06T11:16:23.103217+0000","last_unstale":"2023-10-06T11:16:24.121773+0000","last_undegraded":"2023-10-06T11:16:24.121773+0000","last_fullsized":"2023-10-06T11:16:24.121773+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:01:05.784628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.107033+0000","last_change":"2023-10-06T11:16:24.104031+0000","last_active":"2023-10-06T11:16:24.107033+0000","last_peered":"2023-10-06T11:16:24.107033+0000","last_clean":"2023-10-06T11:16:24.107033+0000","last_became_active":"2023-10-06T11:16:24.103748+0000","last_became_peered":"2023-10-06T11:16:24.103748+0000","last_unstale":"2023-10-06T11:16:24.107033+0000","last_undegraded":"2023-10-06T11:16:24.107033+0000","last_fullsized":"2023-10-06T11:16:24.107033+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:51.364520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:22.074583+0000","last_change":"2023-10-06T11:16:22.089897+0000","last_active":"2023-10-06T11:16:22.074583+0000","last_peered":"2023-10-06T11:16:22.074583+0000","last_clean":"2023-10-06T11:16:22.074583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:22.074583+0000","last_undegraded":"2023-10-06T11:16:22.074583+0000","last_fullsized":"2023-10-06T11:16:22.074583+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:10.613647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.119617+0000","last_change":"2023-10-06T11:16:24.114058+0000","last_active":"2023-10-06T11:16:24.119617+0000","last_peered":"2023-10-06T11:16:24.119617+0000","last_clean":"2023-10-06T11:16:24.119617+0000","last_became_active":"2023-10-06T11:16:24.111051+0000","last_became_peered":"2023-10-06T11:16:24.111051+0000","last_unstale":"2023-10-06T11:16:24.119617+0000","last_undegraded":"2023-10-06T11:16:24.119617+0000","last_fullsized":"2023-10-06T11:16:24.119617+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:46:59.369734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:22.074583+0000","last_change":"2023-10-06T11:16:22.091691+0000","last_active":"2023-10-06T11:16:22.074583+0000","last_peered":"2023-10-06T11:16:22.074583+0000","last_clean":"2023-10-06T11:16:22.074583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:22.074583+0000","last_undegraded":"2023-10-06T11:16:22.074583+0000","last_fullsized":"2023-10-06T11:16:22.074583+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:51:27.162572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121900+0000","last_change":"2023-10-06T11:16:24.116989+0000","last_active":"2023-10-06T11:16:24.121900+0000","last_peered":"2023-10-06T11:16:24.121900+0000","last_clean":"2023-10-06T11:16:24.121900+0000","last_became_active":"2023-10-06T11:16:24.116709+0000","last_became_peered":"2023-10-06T11:16:24.116709+0000","last_unstale":"2023-10-06T11:16:24.121900+0000","last_undegraded":"2023-10-06T11:16:24.121900+0000","last_fullsized":"2023-10-06T11:16:24.121900+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:37:37.920152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.118772+0000","last_change":"2023-10-06T11:16:23.094553+0000","last_active":"2023-10-06T11:16:24.118772+0000","last_peered":"2023-10-06T11:16:24.118772+0000","last_clean":"2023-10-06T11:16:24.118772+0000","last_became_active":"2023-10-06T11:16:23.094319+0000","last_became_peered":"2023-10-06T11:16:23.094319+0000","last_unstale":"2023-10-06T11:16:24.118772+0000","last_undegraded":"2023-10-06T11:16:24.118772+0000","last_fullsized":"2023-10-06T11:16:24.118772+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:28.128320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:22.074583+0000","last_change":"2023-10-06T11:16:22.087428+0000","last_active":"2023-10-06T11:16:22.074583+0000","last_peered":"2023-10-06T11:16:22.074583+0000","last_clean":"2023-10-06T11:16:22.074583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:22.074583+0000","last_undegraded":"2023-10-06T11:16:22.074583+0000","last_fullsized":"2023-10-06T11:16:22.074583+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:23:31.995315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.123888+0000","last_change":"2023-10-06T11:16:24.122010+0000","last_active":"2023-10-06T11:16:24.123888+0000","last_peered":"2023-10-06T11:16:24.123888+0000","last_clean":"2023-10-06T11:16:24.123888+0000","last_became_active":"2023-10-06T11:16:24.121668+0000","last_became_peered":"2023-10-06T11:16:24.121668+0000","last_unstale":"2023-10-06T11:16:24.123888+0000","last_undegraded":"2023-10-06T11:16:24.123888+0000","last_fullsized":"2023-10-06T11:16:24.123888+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:48.961124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.101790+0000","last_change":"2023-10-06T11:16:23.094432+0000","last_active":"2023-10-06T11:16:24.101790+0000","last_peered":"2023-10-06T11:16:24.101790+0000","last_clean":"2023-10-06T11:16:24.101790+0000","last_became_active":"2023-10-06T11:16:23.094187+0000","last_became_peered":"2023-10-06T11:16:23.094187+0000","last_unstale":"2023-10-06T11:16:24.101790+0000","last_undegraded":"2023-10-06T11:16:24.101790+0000","last_fullsized":"2023-10-06T11:16:24.101790+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:10:52.227186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:22.074583+0000","last_change":"2023-10-06T11:16:22.087660+0000","last_active":"2023-10-06T11:16:22.074583+0000","last_peered":"2023-10-06T11:16:22.074583+0000","last_clean":"2023-10-06T11:16:22.074583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:22.074583+0000","last_undegraded":"2023-10-06T11:16:22.074583+0000","last_fullsized":"2023-10-06T11:16:22.074583+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:29:00.300634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116082+0000","last_change":"2023-10-06T11:16:24.108869+0000","last_active":"2023-10-06T11:16:24.116082+0000","last_peered":"2023-10-06T11:16:24.116082+0000","last_clean":"2023-10-06T11:16:24.116082+0000","last_became_active":"2023-10-06T11:16:24.108622+0000","last_became_peered":"2023-10-06T11:16:24.108622+0000","last_unstale":"2023-10-06T11:16:24.116082+0000","last_undegraded":"2023-10-06T11:16:24.116082+0000","last_fullsized":"2023-10-06T11:16:24.116082+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:52.405684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:22.074583+0000","last_change":"2023-10-06T11:16:22.090769+0000","last_active":"2023-10-06T11:16:22.074583+0000","last_peered":"2023-10-06T11:16:22.074583+0000","last_clean":"2023-10-06T11:16:22.074583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:22.074583+0000","last_undegraded":"2023-10-06T11:16:22.074583+0000","last_fullsized":"2023-10-06T11:16:22.074583+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:03.275656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.098101+0000","last_change":"2023-10-06T11:16:23.103805+0000","last_active":"2023-10-06T11:16:24.098101+0000","last_peered":"2023-10-06T11:16:24.098101+0000","last_clean":"2023-10-06T11:16:24.098101+0000","last_became_active":"2023-10-06T11:16:23.103470+0000","last_became_peered":"2023-10-06T11:16:23.103470+0000","last_unstale":"2023-10-06T11:16:24.098101+0000","last_undegraded":"2023-10-06T11:16:24.098101+0000","last_fullsized":"2023-10-06T11:16:24.098101+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:56:40.401445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.107051+0000","last_change":"2023-10-06T11:16:24.104047+0000","last_active":"2023-10-06T11:16:24.107051+0000","last_peered":"2023-10-06T11:16:24.107051+0000","last_clean":"2023-10-06T11:16:24.107051+0000","last_became_active":"2023-10-06T11:16:24.103777+0000","last_became_peered":"2023-10-06T11:16:24.103777+0000","last_unstale":"2023-10-06T11:16:24.107051+0000","last_undegraded":"2023-10-06T11:16:24.107051+0000","last_fullsized":"2023-10-06T11:16:24.107051+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:01:06.788901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:22.074583+0000","last_change":"2023-10-06T11:16:22.089457+0000","last_active":"2023-10-06T11:16:22.074583+0000","last_peered":"2023-10-06T11:16:22.074583+0000","last_clean":"2023-10-06T11:16:22.074583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:22.074583+0000","last_undegraded":"2023-10-06T11:16:22.074583+0000","last_fullsized":"2023-10-06T11:16:22.074583+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:26.467632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116127+0000","last_change":"2023-10-06T11:16:24.109597+0000","last_active":"2023-10-06T11:16:24.116127+0000","last_peered":"2023-10-06T11:16:24.116127+0000","last_clean":"2023-10-06T11:16:24.116127+0000","last_became_active":"2023-10-06T11:16:24.109315+0000","last_became_peered":"2023-10-06T11:16:24.109315+0000","last_unstale":"2023-10-06T11:16:24.116127+0000","last_undegraded":"2023-10-06T11:16:24.116127+0000","last_fullsized":"2023-10-06T11:16:24.116127+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:02.452752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.098576+0000","last_change":"2023-10-06T11:16:23.102516+0000","last_active":"2023-10-06T11:16:24.098576+0000","last_peered":"2023-10-06T11:16:24.098576+0000","last_clean":"2023-10-06T11:16:24.098576+0000","last_became_active":"2023-10-06T11:16:23.102238+0000","last_became_peered":"2023-10-06T11:16:23.102238+0000","last_unstale":"2023-10-06T11:16:24.098576+0000","last_undegraded":"2023-10-06T11:16:24.098576+0000","last_fullsized":"2023-10-06T11:16:24.098576+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:50.360247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.095562+0000","last_change":"2023-10-06T11:16:23.095758+0000","last_active":"2023-10-06T11:16:24.095562+0000","last_peered":"2023-10-06T11:16:24.095562+0000","last_clean":"2023-10-06T11:16:24.095562+0000","last_became_active":"2023-10-06T11:16:23.095515+0000","last_became_peered":"2023-10-06T11:16:23.095515+0000","last_unstale":"2023-10-06T11:16:24.095562+0000","last_undegraded":"2023-10-06T11:16:24.095562+0000","last_fullsized":"2023-10-06T11:16:24.095562+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:23:31.995315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.104780+0000","last_change":"2023-10-06T11:16:23.095211+0000","last_active":"2023-10-06T11:16:24.104780+0000","last_peered":"2023-10-06T11:16:24.104780+0000","last_clean":"2023-10-06T11:16:24.104780+0000","last_became_active":"2023-10-06T11:16:23.094924+0000","last_became_peered":"2023-10-06T11:16:23.094924+0000","last_unstale":"2023-10-06T11:16:24.104780+0000","last_undegraded":"2023-10-06T11:16:24.104780+0000","last_fullsized":"2023-10-06T11:16:24.104780+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:10:17.504059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.096094+0000","last_change":"2023-10-06T11:16:23.098284+0000","last_active":"2023-10-06T11:16:24.096094+0000","last_peered":"2023-10-06T11:16:24.096094+0000","last_clean":"2023-10-06T11:16:24.096094+0000","last_became_active":"2023-10-06T11:16:23.098000+0000","last_became_peered":"2023-10-06T11:16:23.098000+0000","last_unstale":"2023-10-06T11:16:24.096094+0000","last_undegraded":"2023-10-06T11:16:24.096094+0000","last_fullsized":"2023-10-06T11:16:24.096094+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:13:24.765345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.104935+0000","last_change":"2023-10-06T11:16:23.101344+0000","last_active":"2023-10-06T11:16:24.104935+0000","last_peered":"2023-10-06T11:16:24.104935+0000","last_clean":"2023-10-06T11:16:24.104935+0000","last_became_active":"2023-10-06T11:16:23.101075+0000","last_became_peered":"2023-10-06T11:16:23.101075+0000","last_unstale":"2023-10-06T11:16:24.104935+0000","last_undegraded":"2023-10-06T11:16:24.104935+0000","last_fullsized":"2023-10-06T11:16:24.104935+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:17:34.910126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.111925+0000","last_change":"2023-10-06T11:16:24.107101+0000","last_active":"2023-10-06T11:16:24.111925+0000","last_peered":"2023-10-06T11:16:24.111925+0000","last_clean":"2023-10-06T11:16:24.111925+0000","last_became_active":"2023-10-06T11:16:24.106838+0000","last_became_peered":"2023-10-06T11:16:24.106838+0000","last_unstale":"2023-10-06T11:16:24.111925+0000","last_undegraded":"2023-10-06T11:16:24.111925+0000","last_fullsized":"2023-10-06T11:16:24.111925+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:52:28.634794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:22.074583+0000","last_change":"2023-10-06T11:16:22.089284+0000","last_active":"2023-10-06T11:16:22.074583+0000","last_peered":"2023-10-06T11:16:22.074583+0000","last_clean":"2023-10-06T11:16:22.074583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:22.074583+0000","last_undegraded":"2023-10-06T11:16:22.074583+0000","last_fullsized":"2023-10-06T11:16:22.074583+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:45.097185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":117,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T11:16:19.070220+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:16:19.070220+0000","last_peered":"2023-10-06T11:16:19.070220+0000","last_clean":"2023-10-06T11:16:19.070220+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:16:19.070220+0000","last_undegraded":"2023-10-06T11:16:19.070220+0000","last_fullsized":"2023-10-06T11:16:19.070220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.10","version":"136'8","reported_seq":18,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.126509+0000","last_change":"2023-10-06T11:16:23.100992+0000","last_active":"2023-10-06T11:16:24.126509+0000","last_peered":"2023-10-06T11:16:24.126509+0000","last_clean":"2023-10-06T11:16:24.126509+0000","last_became_active":"2023-10-06T11:16:23.100717+0000","last_became_peered":"2023-10-06T11:16:23.100717+0000","last_unstale":"2023-10-06T11:16:24.126509+0000","last_undegraded":"2023-10-06T11:16:24.126509+0000","last_fullsized":"2023-10-06T11:16:24.126509+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:10.613647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":112,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.098652+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:16:24.098652+0000","last_peered":"2023-10-06T11:16:24.098652+0000","last_clean":"2023-10-06T11:16:24.098652+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:16:24.098652+0000","last_undegraded":"2023-10-06T11:16:24.098652+0000","last_fullsized":"2023-10-06T11:16:24.098652+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.107394+0000","last_change":"2023-10-06T11:16:23.100682+0000","last_active":"2023-10-06T11:16:24.107394+0000","last_peered":"2023-10-06T11:16:24.107394+0000","last_clean":"2023-10-06T11:16:24.107394+0000","last_became_active":"2023-10-06T11:16:23.099315+0000","last_became_peered":"2023-10-06T11:16:23.099315+0000","last_unstale":"2023-10-06T11:16:24.107394+0000","last_undegraded":"2023-10-06T11:16:24.107394+0000","last_fullsized":"2023-10-06T11:16:24.107394+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:26:31.561341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":106,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T11:16:19.072895+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:16:19.072895+0000","last_peered":"2023-10-06T11:16:19.072895+0000","last_clean":"2023-10-06T11:16:19.072895+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:16:19.072895+0000","last_undegraded":"2023-10-06T11:16:19.072895+0000","last_fullsized":"2023-10-06T11:16:19.072895+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":255,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.105025+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:16:24.105025+0000","last_peered":"2023-10-06T11:16:24.105025+0000","last_clean":"2023-10-06T11:16:24.105025+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:16:24.105025+0000","last_undegraded":"2023-10-06T11:16:24.105025+0000","last_fullsized":"2023-10-06T11:16:24.105025+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121988+0000","last_change":"2023-10-06T11:16:24.120168+0000","last_active":"2023-10-06T11:16:24.121988+0000","last_peered":"2023-10-06T11:16:24.121988+0000","last_clean":"2023-10-06T11:16:24.121988+0000","last_became_active":"2023-10-06T11:16:24.119797+0000","last_became_peered":"2023-10-06T11:16:24.119797+0000","last_unstale":"2023-10-06T11:16:24.121988+0000","last_undegraded":"2023-10-06T11:16:24.121988+0000","last_fullsized":"2023-10-06T11:16:24.121988+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:04:48.357935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.098212+0000","last_change":"2023-10-06T11:16:23.098273+0000","last_active":"2023-10-06T11:16:24.098212+0000","last_peered":"2023-10-06T11:16:24.098212+0000","last_clean":"2023-10-06T11:16:24.098212+0000","last_became_active":"2023-10-06T11:16:23.097970+0000","last_became_peered":"2023-10-06T11:16:23.097970+0000","last_unstale":"2023-10-06T11:16:24.098212+0000","last_undegraded":"2023-10-06T11:16:24.098212+0000","last_fullsized":"2023-10-06T11:16:24.098212+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:29.555606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":105,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.106284+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:16:24.106284+0000","last_peered":"2023-10-06T11:16:24.106284+0000","last_clean":"2023-10-06T11:16:24.106284+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:16:24.106284+0000","last_undegraded":"2023-10-06T11:16:24.106284+0000","last_fullsized":"2023-10-06T11:16:24.106284+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.14","version":"136'6","reported_seq":16,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.126641+0000","last_change":"2023-10-06T11:16:23.095177+0000","last_active":"2023-10-06T11:16:24.126641+0000","last_peered":"2023-10-06T11:16:24.126641+0000","last_clean":"2023-10-06T11:16:24.126641+0000","last_became_active":"2023-10-06T11:16:23.094700+0000","last_became_peered":"2023-10-06T11:16:23.094700+0000","last_unstale":"2023-10-06T11:16:24.126641+0000","last_undegraded":"2023-10-06T11:16:24.126641+0000","last_fullsized":"2023-10-06T11:16:24.126641+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:16.082206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":105,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.105115+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:16:24.105115+0000","last_peered":"2023-10-06T11:16:24.105115+0000","last_clean":"2023-10-06T11:16:24.105115+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:16:24.105115+0000","last_undegraded":"2023-10-06T11:16:24.105115+0000","last_fullsized":"2023-10-06T11:16:24.105115+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.120333+0000","last_change":"2023-10-06T11:16:24.106952+0000","last_active":"2023-10-06T11:16:24.120333+0000","last_peered":"2023-10-06T11:16:24.120333+0000","last_clean":"2023-10-06T11:16:24.120333+0000","last_became_active":"2023-10-06T11:16:24.106431+0000","last_became_peered":"2023-10-06T11:16:24.106431+0000","last_unstale":"2023-10-06T11:16:24.120333+0000","last_undegraded":"2023-10-06T11:16:24.120333+0000","last_fullsized":"2023-10-06T11:16:24.120333+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:59:53.565267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"136'3","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121884+0000","last_change":"2023-10-06T11:16:23.091484+0000","last_active":"2023-10-06T11:16:24.121884+0000","last_peered":"2023-10-06T11:16:24.121884+0000","last_clean":"2023-10-06T11:16:24.121884+0000","last_became_active":"2023-10-06T11:16:23.090228+0000","last_became_peered":"2023-10-06T11:16:23.090228+0000","last_unstale":"2023-10-06T11:16:24.121884+0000","last_undegraded":"2023-10-06T11:16:24.121884+0000","last_fullsized":"2023-10-06T11:16:24.121884+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:05:24.455055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":126,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.096193+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:16:24.096193+0000","last_peered":"2023-10-06T11:16:24.096193+0000","last_clean":"2023-10-06T11:16:24.096193+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:16:24.096193+0000","last_undegraded":"2023-10-06T11:16:24.096193+0000","last_fullsized":"2023-10-06T11:16:24.096193+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:22.074583+0000","last_change":"2023-10-06T11:16:22.089652+0000","last_active":"2023-10-06T11:16:22.074583+0000","last_peered":"2023-10-06T11:16:22.074583+0000","last_clean":"2023-10-06T11:16:22.074583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:22.074583+0000","last_undegraded":"2023-10-06T11:16:22.074583+0000","last_fullsized":"2023-10-06T11:16:22.074583+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:35:44.567263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":109,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T11:16:19.512167+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:16:19.512167+0000","last_peered":"2023-10-06T11:16:19.512167+0000","last_clean":"2023-10-06T11:16:19.512167+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:16:19.512167+0000","last_undegraded":"2023-10-06T11:16:19.512167+0000","last_fullsized":"2023-10-06T11:16:19.512167+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.13","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.117964+0000","last_change":"2023-10-06T11:16:23.099218+0000","last_active":"2023-10-06T11:16:24.117964+0000","last_peered":"2023-10-06T11:16:24.117964+0000","last_clean":"2023-10-06T11:16:24.117964+0000","last_became_active":"2023-10-06T11:16:23.098941+0000","last_became_peered":"2023-10-06T11:16:23.098941+0000","last_unstale":"2023-10-06T11:16:24.117964+0000","last_undegraded":"2023-10-06T11:16:24.117964+0000","last_fullsized":"2023-10-06T11:16:24.117964+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:46:58.365462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":109,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T11:16:19.512196+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:16:19.512196+0000","last_peered":"2023-10-06T11:16:19.512196+0000","last_clean":"2023-10-06T11:16:19.512196+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:16:19.512196+0000","last_undegraded":"2023-10-06T11:16:19.512196+0000","last_fullsized":"2023-10-06T11:16:19.512196+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2236,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":64,"acting":64,"num_store_stats":8},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":72,"acting":72,"num_store_stats":5},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574981,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303644,"kb_used_data":2260,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068196,"statfs":{"total":96636764160,"available":96325832704,"internally_reserved":0,"allocated":2314240,"data_stored":1379705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51200000000000001,"15min":0.625},"min":{"1min":0.30299999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.68899999999999995,"5min":4.407,"15min":23.908999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.48499999999999999,"15min":0.57399999999999995},"min":{"1min":0.313,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.68300000000000005,"5min":0.69799999999999995,"15min":9.3230000000000004},"last":0.42399999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51000000000000001,"15min":0.55900000000000005},"min":{"1min":0.35299999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.71499999999999997,"5min":2.4689999999999999,"15min":9.2360000000000007},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.47299999999999998,"15min":0.503},"min":{"1min":0.373,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.64400000000000002,"5min":0.78900000000000003,"15min":4.327},"last":0.40999999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54000000000000004,"15min":0.51700000000000002},"min":{"1min":0.39900000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.63500000000000001,"5min":4.3120000000000003,"15min":4.3120000000000003},"last":0.442},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53600000000000003,"15min":0.55700000000000005},"min":{"1min":0.34799999999999998,"5min":0.31,"15min":0.29999999999999999},"max":{"1min":0.70699999999999996,"5min":3.0600000000000001,"15min":4.7309999999999999},"last":0.376}]},{"osd":3,"last update":"Fri Oct 6 11:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54600000000000004,"15min":0.53900000000000003},"min":{"1min":0.36499999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.72099999999999997,"5min":4.5190000000000001,"15min":4.5190000000000001},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56100000000000005,"15min":0.59899999999999998},"min":{"1min":0.38100000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.74099999999999999,"5min":3.0070000000000001,"15min":9.3879999999999999},"last":0.498}]},{"osd":4,"last update":"Fri Oct 6 11:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.502,"15min":0.48999999999999999},"min":{"1min":0.32800000000000001,"5min":0.26000000000000001,"15min":0.24399999999999999},"max":{"1min":0.68700000000000006,"5min":4.6639999999999997,"15min":4.6639999999999997},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.53600000000000003},"min":{"1min":0.33300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.78200000000000003,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":0.48599999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.51200000000000001,"15min":0.56100000000000005},"min":{"1min":0.33900000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":9.3499999999999996},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.5,"15min":0.54200000000000004},"min":{"1min":0.377,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.74299999999999999,"5min":0.83399999999999996,"15min":4.444},"last":0.54700000000000004}]},{"osd":6,"last update":"Fri Oct 6 11:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.53800000000000003,"15min":0.59699999999999998},"min":{"1min":0.41499999999999998,"5min":0.32400000000000001,"15min":0.29199999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":9.4969999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60899999999999999,"15min":0.62},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.85799999999999998,"5min":4.4669999999999996,"15min":7.2039999999999997},"last":0.52200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574982,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298912,"kb_used_data":1624,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072928,"statfs":{"total":96636764160,"available":96330678272,"internally_reserved":0,"allocated":1662976,"data_stored":761431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.56299999999999994,"15min":0.52000000000000002},"min":{"1min":0.254,"5min":0.187,"15min":0.187},"max":{"1min":0.66400000000000003,"5min":9.5549999999999997,"15min":9.5549999999999997},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.63300000000000001,"15min":0.56399999999999995},"min":{"1min":0.30399999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.73999999999999999,"5min":9.4659999999999993,"15min":9.4659999999999993},"last":0.65200000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46100000000000002,"15min":0.48299999999999998},"min":{"1min":0.27500000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.68000000000000005,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.56000000000000005,"15min":0.51500000000000001},"min":{"1min":0.34399999999999997,"5min":0.216,"15min":0.216},"max":{"1min":0.71499999999999997,"5min":5.2670000000000003,"15min":5.2670000000000003},"last":0.61299999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.46600000000000003,"15min":0.499},"min":{"1min":0.29399999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.65800000000000003,"5min":0.93200000000000005,"15min":7.0659999999999998},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.48399999999999999,"15min":0.51800000000000002},"min":{"1min":0.39100000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.72599999999999998,"5min":1.0069999999999999,"15min":7.0819999999999999},"last":0.55900000000000005}]},{"osd":3,"last update":"Fri Oct 6 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54000000000000004,"15min":0.51700000000000002},"min":{"1min":0.34300000000000003,"5min":0.317,"15min":0.25800000000000001},"max":{"1min":0.67300000000000004,"5min":3.871,"15min":3.871},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.503,"5min":0.51100000000000001,"15min":0.53000000000000003},"min":{"1min":0.32100000000000001,"5min":0.316,"15min":0.312},"max":{"1min":0.69199999999999995,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.70999999999999996}]},{"osd":4,"last update":"Fri Oct 6 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.45600000000000002,"15min":0.48099999999999998},"min":{"1min":0.27400000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.65600000000000003,"5min":0.88,"15min":0.88},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51400000000000001,"15min":0.53600000000000003},"min":{"1min":0.29699999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.75700000000000001,"5min":0.82399999999999995,"15min":1.0680000000000001},"last":0.47299999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.499,"15min":0.51900000000000002},"min":{"1min":0.33000000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.78700000000000003,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.60699999999999998,"15min":0.58299999999999996},"min":{"1min":0.36499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.86699999999999999,"5min":7.1379999999999999,"15min":7.1379999999999999},"last":0.45400000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56899999999999995,"15min":0.56799999999999995},"min":{"1min":0.40999999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.73399999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55900000000000005,"15min":0.58599999999999997},"min":{"1min":0.374,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.77300000000000002,"5min":0.86899999999999999,"15min":0.88400000000000001},"last":0.53200000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574981,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311796,"kb_used_data":2220,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060044,"statfs":{"total":96636764160,"available":96317485056,"internally_reserved":0,"allocated":2273280,"data_stored":1359310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:57 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.45500000000000002,"15min":0.377},"min":{"1min":0.217,"5min":0.189,"15min":0.186},"max":{"1min":0.44,"5min":13.393000000000001,"15min":13.393000000000001},"last":0.37},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.45400000000000001,"15min":0.38400000000000001},"min":{"1min":0.22700000000000001,"5min":0.22500000000000001,"15min":0.19700000000000001},"max":{"1min":0.49299999999999999,"5min":11.462,"15min":11.462},"last":0.33900000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:15:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.40400000000000003,"15min":0.35999999999999999},"min":{"1min":0.248,"5min":0.216,"15min":0.216},"max":{"1min":0.49299999999999999,"5min":8.0470000000000006,"15min":8.0470000000000006},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.42799999999999999,"15min":0.40500000000000003},"min":{"1min":0.215,"5min":0.215,"15min":0.20999999999999999},"max":{"1min":0.59899999999999998,"5min":4.8630000000000004,"15min":4.8630000000000004},"last":0.41799999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:15:57 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.44700000000000001,"15min":0.42299999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.252},"max":{"1min":0.54000000000000004,"5min":4.8029999999999999,"15min":4.8029999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.42999999999999999,"15min":0.39300000000000002},"min":{"1min":0.27700000000000002,"5min":0.217,"15min":0.217},"max":{"1min":0.53900000000000003,"5min":5.8700000000000001,"15min":5.8700000000000001},"last":0.40200000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:15:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.50600000000000001,"15min":0.51700000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28199999999999997},"max":{"1min":0.81899999999999995,"5min":1.264,"15min":1.264},"last":0.498},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.60399999999999998,"15min":0.56799999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.84099999999999997,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.47799999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:15:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.58499999999999996,"15min":0.56599999999999995},"min":{"1min":0.378,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80500000000000005,"5min":3.4390000000000001,"15min":3.4390000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.65400000000000003,"15min":0.58699999999999997},"min":{"1min":0.39000000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.91500000000000004,"5min":9.3829999999999991,"15min":9.3829999999999991},"last":0.439}]},{"osd":6,"last update":"Fri Oct 6 11:15:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.61299999999999999,"15min":0.58499999999999996},"min":{"1min":0.43099999999999999,"5min":0.34999999999999998,"15min":0.315},"max":{"1min":0.86699999999999999,"5min":3.4750000000000001,"15min":3.4750000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60899999999999999,"15min":0.59399999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85799999999999998,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.38800000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:15:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.63300000000000001,"15min":0.60899999999999999},"min":{"1min":0.39800000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76100000000000001,"5min":4.7290000000000001,"15min":4.7290000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60499999999999998,"15min":0.59299999999999997},"min":{"1min":0.44,"5min":0.378,"15min":0.374},"max":{"1min":0.89200000000000002,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.48599999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574981,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303080,"kb_used_data":1696,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068760,"statfs":{"total":96636764160,"available":96326410240,"internally_reserved":0,"allocated":1736704,"data_stored":790176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:15:58 2023","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.41499999999999998,"15min":0.46600000000000003},"min":{"1min":0.20999999999999999,"5min":0.184,"15min":0.184},"max":{"1min":0.60199999999999998,"5min":8.4239999999999995,"15min":36.097999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.42999999999999999,"15min":0.378},"min":{"1min":0.23100000000000001,"5min":0.20799999999999999,"15min":0.182},"max":{"1min":0.92400000000000004,"5min":7.2990000000000004,"15min":7.2990000000000004},"last":0.30499999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:15:58 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.44400000000000001,"15min":0.503},"min":{"1min":0.22800000000000001,"5min":0.221,"15min":0.217},"max":{"1min":0.53500000000000003,"5min":8.6080000000000005,"15min":36.07},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.44800000000000001,"15min":0.40600000000000003},"min":{"1min":0.27200000000000002,"5min":0.23400000000000001,"15min":0.219},"max":{"1min":0.94899999999999995,"5min":6.7800000000000002,"15min":6.7800000000000002},"last":0.26800000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:15:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36299999999999999,"15min":0.39300000000000002},"min":{"1min":0.26300000000000001,"5min":0.22500000000000001,"15min":0.223},"max":{"1min":0.52000000000000002,"5min":1.863,"15min":8.4130000000000003},"last":0.315},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.499,"15min":0.55900000000000005},"min":{"1min":0.28199999999999997,"5min":0.249,"15min":0.249},"max":{"1min":1.9079999999999999,"5min":8.4570000000000007,"15min":35.959000000000003},"last":0.438}]},{"osd":4,"last update":"Fri Oct 6 11:15:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55700000000000005,"15min":0.56299999999999994},"min":{"1min":0.38800000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.72399999999999998,"5min":2.427,"15min":2.427},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.64600000000000002,"15min":0.72999999999999998},"min":{"1min":0.42399999999999999,"5min":0.34399999999999997,"15min":0.29299999999999998},"max":{"1min":0.748,"5min":8.2919999999999998,"15min":36.005000000000003},"last":0.5}]},{"osd":5,"last update":"Fri Oct 6 11:15:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.61599999999999999,"15min":0.57899999999999996},"min":{"1min":0.40000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.999,"5min":6.6699999999999999,"15min":6.6699999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.47799999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.76900000000000002,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.47999999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:15:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.65600000000000003,"15min":0.73099999999999998},"min":{"1min":0.39200000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.78800000000000003,"5min":8.2479999999999993,"15min":36.037999999999997},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.66200000000000003,"15min":0.63700000000000001},"min":{"1min":0.42899999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.028,"5min":6.7110000000000003,"15min":6.7110000000000003},"last":0.41299999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:15:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.65200000000000002,"15min":0.621},"min":{"1min":0.44900000000000001,"5min":0.371,"15min":0.371},"max":{"1min":1.054,"5min":6.742,"15min":6.742},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56799999999999995,"15min":0.56899999999999995},"min":{"1min":0.41399999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.69899999999999995,"5min":1.917,"15min":1.917},"last":0.42799999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574982,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298968,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072872,"statfs":{"total":96636764160,"available":96330620928,"internally_reserved":0,"allocated":1720320,"data_stored":788074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.30299999999999999,"15min":0.31},"min":{"1min":0.22900000000000001,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.41599999999999998,"5min":0.46300000000000002,"15min":0.57499999999999996},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.376,"15min":0.38200000000000001},"min":{"1min":0.28599999999999998,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.52800000000000002,"5min":0.55600000000000005,"15min":0.66300000000000003},"last":0.45500000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.36399999999999999,"15min":0.372},"min":{"1min":0.28100000000000003,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.48099999999999998,"5min":0.57499999999999996,"15min":0.745},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.34200000000000003,"15min":0.34999999999999998},"min":{"1min":0.247,"5min":0.216,"15min":0.216},"max":{"1min":0.437,"5min":0.52900000000000003,"15min":0.59399999999999997},"last":0.42799999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34599999999999997,"15min":0.36399999999999999},"min":{"1min":0.255,"5min":0.23300000000000001,"15min":0.23200000000000001},"max":{"1min":0.45300000000000001,"5min":0.57699999999999996,"15min":0.629},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.35799999999999998,"15min":0.36399999999999999},"min":{"1min":0.26600000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.64400000000000002},"last":0.47099999999999997}]},{"osd":4,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.503,"15min":0.52700000000000002},"min":{"1min":0.35799999999999998,"5min":0.30599999999999999,"15min":0.30299999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.51100000000000001,"15min":0.54400000000000004},"min":{"1min":0.36499999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.84899999999999998},"last":0.68400000000000005}]},{"osd":5,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.52400000000000002,"15min":0.54300000000000004},"min":{"1min":0.44700000000000001,"5min":0.33100000000000002,"15min":0.32400000000000001},"max":{"1min":0.77100000000000002,"5min":0.80400000000000005,"15min":0.86199999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.54100000000000004,"15min":0.55300000000000005},"min":{"1min":0.40600000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.84499999999999997,"5min":0.872,"15min":0.878},"last":0.77100000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56100000000000005,"15min":0.57899999999999996},"min":{"1min":0.46700000000000003,"5min":0.36799999999999999,"15min":0.32600000000000001},"max":{"1min":0.76200000000000001,"5min":0.84599999999999997,"15min":0.86299999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.55500000000000005,"15min":0.57299999999999995},"min":{"1min":0.44800000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80700000000000005,"5min":0.83499999999999996,"15min":0.88600000000000001},"last":0.69499999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54500000000000004,"15min":0.55800000000000005},"min":{"1min":0.41399999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79300000000000004,"5min":1.139,"15min":1.139},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55000000000000004,"15min":0.56699999999999995},"min":{"1min":0.42499999999999999,"5min":0.38800000000000001,"15min":0.38200000000000001},"max":{"1min":0.80600000000000005,"5min":0.89600000000000002,"15min":0.90500000000000003},"last":0.70499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574982,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307160,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064680,"statfs":{"total":96636764160,"available":96322232320,"internally_reserved":0,"allocated":1720320,"data_stored":788550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.32200000000000001,"15min":0.32300000000000001},"min":{"1min":0.224,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":2.2109999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.375},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.39100000000000001,"15min":0.39200000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.22700000000000001},"max":{"1min":4.4820000000000002,"5min":4.4820000000000002,"15min":4.4820000000000002},"last":0.34899999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.308,"15min":0.311},"min":{"1min":0.251,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.40500000000000003,"5min":0.54000000000000004,"15min":0.65400000000000003},"last":0.313},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.35599999999999998},"min":{"1min":0.27300000000000002,"5min":0.188,"15min":0.188},"max":{"1min":0.439,"5min":0.53100000000000003,"15min":1.196},"last":0.33000000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.38800000000000001,"15min":0.38500000000000001},"min":{"1min":0.245,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":4.601,"5min":4.601,"15min":4.601},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.41499999999999998,"15min":0.41699999999999998},"min":{"1min":0.29899999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.40400000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.50600000000000001,"15min":0.54700000000000004},"min":{"1min":0.39400000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.81799999999999995,"5min":0.88500000000000001,"15min":1.694},"last":0.5},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.51200000000000001,"15min":0.53700000000000003},"min":{"1min":0.32600000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.46500000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.51700000000000002,"15min":0.53100000000000003},"min":{"1min":0.34100000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.78100000000000003,"5min":0.86399999999999999,"15min":0.878},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52300000000000002,"15min":0.55200000000000005},"min":{"1min":0.35699999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.71099999999999997,"5min":0.746,"15min":1.165},"last":0.56000000000000005}]},{"osd":6,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54400000000000004,"15min":0.57699999999999996},"min":{"1min":0.42499999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76900000000000002,"5min":0.79200000000000004,"15min":1.1359999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.54600000000000004,"15min":0.58599999999999997},"min":{"1min":0.36799999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79100000000000004,"5min":0.82199999999999995,"15min":1.7470000000000001},"last":0.44500000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.54400000000000004,"15min":0.57599999999999996},"min":{"1min":0.42199999999999999,"5min":0.35699999999999998,"15min":0.35599999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":1.657},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55300000000000005,"15min":0.57099999999999995},"min":{"1min":0.40400000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.54600000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574980,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303012,"kb_used_data":1628,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068828,"statfs":{"total":96636764160,"available":96326479872,"internally_reserved":0,"allocated":1667072,"data_stored":762784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.45100000000000001,"15min":0.52400000000000002},"min":{"1min":0.26200000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.70799999999999996,"5min":0.82099999999999995,"15min":2.6619999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.47499999999999998,"15min":0.48999999999999999},"min":{"1min":0.29799999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.69099999999999995,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.41599999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:15:56 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47199999999999998,"15min":0.54500000000000004},"min":{"1min":0.28499999999999998,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.70499999999999996,"5min":1,"15min":2.8650000000000002},"last":0.505},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47399999999999998,"15min":0.55100000000000005},"min":{"1min":0.34000000000000002,"5min":0.26200000000000001,"15min":0.25800000000000001},"max":{"1min":0.67800000000000005,"5min":1.2869999999999999,"15min":2.7610000000000001},"last":0.43099999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:15:56 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48499999999999999,"15min":0.53400000000000003},"min":{"1min":0.312,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.73399999999999999,"5min":0.76000000000000001,"15min":1.6910000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54300000000000004,"15min":0.58299999999999996},"min":{"1min":0.38700000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.68000000000000005,"5min":0.93899999999999995,"15min":1.718},"last":0.59599999999999997}]},{"osd":3,"last update":"Fri Oct 6 11:15:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54900000000000004,"15min":0.59299999999999997},"min":{"1min":0.36699999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.71299999999999997,"5min":2.387,"15min":2.677},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.52200000000000002,"15min":0.52400000000000002},"min":{"1min":0.35599999999999998,"5min":0.29299999999999998,"15min":0.27500000000000002},"max":{"1min":0.69399999999999995,"5min":1.784,"15min":1.784},"last":0.66800000000000004}]},{"osd":5,"last update":"Fri Oct 6 11:15:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.47099999999999997,"15min":0.48399999999999999},"min":{"1min":0.33700000000000002,"5min":0.23499999999999999,"15min":0.23200000000000001},"max":{"1min":0.65700000000000003,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.621},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.48799999999999999,"15min":0.52400000000000002},"min":{"1min":0.29099999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.65900000000000003,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.71099999999999997}]},{"osd":6,"last update":"Fri Oct 6 11:15:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.502,"15min":0.52100000000000002},"min":{"1min":0.313,"5min":0.30499999999999999,"15min":0.252},"max":{"1min":0.83499999999999996,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53100000000000003,"15min":0.56200000000000006},"min":{"1min":0.38900000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.69399999999999995,"5min":0.85799999999999998,"15min":1.165},"last":0.68400000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:15:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54300000000000004,"15min":0.55700000000000005},"min":{"1min":0.36899999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.70199999999999996,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.55900000000000005,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.875,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.75900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574983,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311252,"kb_used_data":1676,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060588,"statfs":{"total":96636764160,"available":96318042112,"internally_reserved":0,"allocated":1716224,"data_stored":789315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.44700000000000001,"15min":0.58999999999999997},"min":{"1min":0.26200000000000001,"5min":0.23100000000000001,"15min":0.20499999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":5.0490000000000004},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.44900000000000001,"15min":0.56899999999999995},"min":{"1min":0.26600000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.66500000000000004,"5min":0.78100000000000003,"15min":5.1449999999999996},"last":0.61499999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.46100000000000002,"15min":0.48199999999999998},"min":{"1min":0.307,"5min":0.25,"15min":0.25},"max":{"1min":0.72999999999999998,"5min":0.81399999999999995,"15min":0.97199999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.47699999999999998,"15min":0.50900000000000001},"min":{"1min":0.35299999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":1.8799999999999999},"last":0.69299999999999995}]},{"osd":2,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.499,"15min":0.54600000000000004},"min":{"1min":0.313,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76600000000000001,"5min":0.79800000000000004,"15min":4.234},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.52500000000000002,"15min":0.55900000000000005},"min":{"1min":0.39800000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.747,"5min":0.81000000000000005,"15min":1.0369999999999999},"last":0.79200000000000004}]},{"osd":3,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.47999999999999998,"15min":0.60899999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.27700000000000002},"max":{"1min":0.72799999999999998,"5min":0.82299999999999995,"15min":5.2169999999999996},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.505,"15min":0.53900000000000003},"min":{"1min":0.32400000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":1.008},"last":0.42299999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.46999999999999997,"15min":0.50700000000000001},"min":{"1min":0.26400000000000001,"5min":0.25600000000000001,"15min":0.23999999999999999},"max":{"1min":0.78000000000000003,"5min":0.83399999999999996,"15min":1.917},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.46899999999999997,"15min":0.51800000000000002},"min":{"1min":0.251,"5min":0.24399999999999999,"15min":0.23899999999999999},"max":{"1min":0.68899999999999995,"5min":0.69199999999999995,"15min":0.87},"last":0.39500000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.49099999999999999,"15min":0.54600000000000004},"min":{"1min":0.32700000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":2.0139999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55400000000000005,"15min":0.59699999999999998},"min":{"1min":0.30299999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.80800000000000005,"5min":0.82899999999999996,"15min":1.9470000000000001},"last":0.72599999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.51600000000000001,"15min":0.56799999999999995},"min":{"1min":0.311,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.71999999999999997,"5min":0.81000000000000005,"15min":0.96499999999999997},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.54800000000000004,"15min":0.59599999999999997},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.28799999999999998},"max":{"1min":0.75600000000000001,"5min":0.77300000000000002,"15min":1.4119999999999999},"last":0.746}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:16:28.163 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:16:28.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.308+0000 7fb763b06700 1 Processor -- start 2023-10-06T11:16:28.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.308+0000 7fb763b06700 1 -- start start 2023-10-06T11:16:28.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.309+0000 7fb763b06700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb75c153ab0 0x7fb75c15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:28.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.309+0000 7fb763b06700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb75c153e80 0x7fb75c068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:28.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.309+0000 7fb763b06700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb75c0689d0 0x7fb75c15d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:28.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.309+0000 7fb763b06700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb75c068e50 con 0x7fb75c0689d0 2023-10-06T11:16:28.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.309+0000 7fb763b06700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb75c15ac30 con 0x7fb75c153e80 2023-10-06T11:16:28.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.309+0000 7fb763b06700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c0b4510 con 0x7fb75c153ab0 2023-10-06T11:16:28.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.309+0000 7fb7620a3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb75c0689d0 0x7fb75c15d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:28.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.309+0000 7fb7620a3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb75c0689d0 0x7fb75c15d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49000/0 (socket says 172.21.15.146:49000) 2023-10-06T11:16:28.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.309+0000 7fb7620a3700 1 -- 172.21.15.146:0/1697511451 learned_addr learned my addr 172.21.15.146:0/1697511451 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:28.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.309+0000 7fb7618a2700 1 --2- 172.21.15.146:0/1697511451 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb75c153ab0 0x7fb75c15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:28.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.309+0000 7fb7610a1700 1 --2- 172.21.15.146:0/1697511451 >> v2:172.21.15.151:3300/0 conn(0x7fb75c153e80 0x7fb75c068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:28.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.309+0000 7fb7620a3700 1 -- 172.21.15.146:0/1697511451 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb75c153ab0 msgr2=0x7fb75c15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:28.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.309+0000 7fb7620a3700 1 --2- 172.21.15.146:0/1697511451 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb75c153ab0 0x7fb75c15a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:28.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.309+0000 7fb7620a3700 1 -- 172.21.15.146:0/1697511451 >> v2:172.21.15.151:3300/0 conn(0x7fb75c153e80 msgr2=0x7fb75c068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:28.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.309+0000 7fb7620a3700 1 --2- 172.21.15.146:0/1697511451 >> v2:172.21.15.151:3300/0 conn(0x7fb75c153e80 0x7fb75c068490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:28.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.309+0000 7fb7620a3700 1 -- 172.21.15.146:0/1697511451 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb75c0b6530 con 0x7fb75c0689d0 2023-10-06T11:16:28.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.309+0000 7fb7620a3700 1 --2- 172.21.15.146:0/1697511451 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb75c0689d0 0x7fb75c15d270 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7fb75c089500 tx=0x7fb754009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae0c719aadbe6ae server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:28.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.309+0000 7fb7608a0700 1 -- 172.21.15.146:0/1697511451 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75400e070 con 0x7fb75c0689d0 2023-10-06T11:16:28.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.309+0000 7fb7608a0700 1 -- 172.21.15.146:0/1697511451 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75400ba50 con 0x7fb75c0689d0 2023-10-06T11:16:28.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.309+0000 7fb7608a0700 1 -- 172.21.15.146:0/1697511451 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7540092e0 con 0x7fb75c0689d0 2023-10-06T11:16:28.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.310+0000 7fb763b06700 1 -- 172.21.15.146:0/1697511451 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb75c0689d0 msgr2=0x7fb75c15d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:28.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.310+0000 7fb763b06700 1 --2- 172.21.15.146:0/1697511451 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb75c0689d0 0x7fb75c15d270 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7fb75c089500 tx=0x7fb754009840 comp rx=0 tx=0).stop 2023-10-06T11:16:28.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.310+0000 7fb763b06700 1 -- 172.21.15.146:0/1697511451 shutdown_connections 2023-10-06T11:16:28.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.310+0000 7fb763b06700 1 --2- 172.21.15.146:0/1697511451 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb75c0689d0 0x7fb75c15d270 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:28.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.310+0000 7fb763b06700 1 --2- 172.21.15.146:0/1697511451 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb75c153ab0 0x7fb75c15a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:28.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.310+0000 7fb763b06700 1 --2- 172.21.15.146:0/1697511451 >> v2:172.21.15.151:3300/0 conn(0x7fb75c153e80 0x7fb75c068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:28.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.310+0000 7fb763b06700 1 -- 172.21.15.146:0/1697511451 >> 172.21.15.146:0/1697511451 conn(0x7fb75c06eba0 msgr2=0x7fb75c06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:28.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.310+0000 7fb763b06700 1 -- 172.21.15.146:0/1697511451 shutdown_connections 2023-10-06T11:16:28.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.310+0000 7fb763b06700 1 -- 172.21.15.146:0/1697511451 wait complete. 2023-10-06T11:16:28.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.311+0000 7fb763b06700 1 Processor -- start 2023-10-06T11:16:28.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.311+0000 7fb763b06700 1 -- start start 2023-10-06T11:16:28.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.312+0000 7fb763b06700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb75c0689d0 0x7fb75c157400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:28.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.312+0000 7fb763b06700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb75c153ab0 0x7fb75c16cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:28.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.312+0000 7fb763b06700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb75c153e80 0x7fb75c16d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:28.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.312+0000 7fb763b06700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c15fa90 con 0x7fb75c0689d0 2023-10-06T11:16:28.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.312+0000 7fb763b06700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c15ebe0 con 0x7fb75c153ab0 2023-10-06T11:16:28.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.312+0000 7fb763b06700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c15ee80 con 0x7fb75c153e80 2023-10-06T11:16:28.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.312+0000 7fb7618a2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb75c0689d0 0x7fb75c157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:28.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.312+0000 7fb7618a2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb75c0689d0 0x7fb75c157400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49004/0 (socket says 172.21.15.146:49004) 2023-10-06T11:16:28.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.312+0000 7fb7618a2700 1 -- 172.21.15.146:0/2377281658 learned_addr learned my addr 172.21.15.146:0/2377281658 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:28.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.312+0000 7fb7620a3700 1 --2- 172.21.15.146:0/2377281658 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb75c153e80 0x7fb75c16d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:28.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.312+0000 7fb7610a1700 1 --2- 172.21.15.146:0/2377281658 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb75c153ab0 0x7fb75c16cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:28.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.312+0000 7fb7618a2700 1 -- 172.21.15.146:0/2377281658 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb75c153e80 msgr2=0x7fb75c16d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:28.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.312+0000 7fb7618a2700 1 --2- 172.21.15.146:0/2377281658 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb75c153e80 0x7fb75c16d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:28.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.312+0000 7fb7618a2700 1 -- 172.21.15.146:0/2377281658 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb75c153ab0 msgr2=0x7fb75c16cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:28.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.312+0000 7fb7618a2700 1 --2- 172.21.15.146:0/2377281658 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb75c153ab0 0x7fb75c16cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:28.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.312+0000 7fb7618a2700 1 -- 172.21.15.146:0/2377281658 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb754009ae0 con 0x7fb75c0689d0 2023-10-06T11:16:28.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.312+0000 7fb7620a3700 1 --2- 172.21.15.146:0/2377281658 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb75c153e80 0x7fb75c16d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:28.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.312+0000 7fb7610a1700 1 --2- 172.21.15.146:0/2377281658 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb75c153ab0 0x7fb75c16cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:28.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.312+0000 7fb7618a2700 1 --2- 172.21.15.146:0/2377281658 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb75c0689d0 0x7fb75c157400 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7fb75800c7d0 tx=0x7fb758008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:28.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.312+0000 7fb751ffb700 1 -- 172.21.15.146:0/2377281658 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb758011600 con 0x7fb75c0689d0 2023-10-06T11:16:28.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.312+0000 7fb751ffb700 1 -- 172.21.15.146:0/2377281658 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb758011760 con 0x7fb75c0689d0 2023-10-06T11:16:28.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.312+0000 7fb763b06700 1 -- 172.21.15.146:0/2377281658 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb75c15f160 con 0x7fb75c0689d0 2023-10-06T11:16:28.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.312+0000 7fb751ffb700 1 -- 172.21.15.146:0/2377281658 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb758011b20 con 0x7fb75c0689d0 2023-10-06T11:16:28.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.313+0000 7fb763b06700 1 -- 172.21.15.146:0/2377281658 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb75c15f7a0 con 0x7fb75c0689d0 2023-10-06T11:16:28.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.314+0000 7fb763b06700 1 -- 172.21.15.146:0/2377281658 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb75c151cd0 con 0x7fb75c0689d0 2023-10-06T11:16:28.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.314+0000 7fb751ffb700 1 -- 172.21.15.146:0/2377281658 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb7580193f0 con 0x7fb75c0689d0 2023-10-06T11:16:28.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.314+0000 7fb751ffb700 1 --2- 172.21.15.146:0/2377281658 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb740066f30 0x7fb7400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:28.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.314+0000 7fb751ffb700 1 -- 172.21.15.146:0/2377281658 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb758084b10 con 0x7fb75c0689d0 2023-10-06T11:16:28.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.315+0000 7fb7610a1700 1 --2- 172.21.15.146:0/2377281658 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb740066f30 0x7fb7400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:28.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.315+0000 7fb7610a1700 1 --2- 172.21.15.146:0/2377281658 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb740066f30 0x7fb7400693e0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fb75c154560 tx=0x7fb74c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:28.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.319+0000 7fb751ffb700 1 -- 172.21.15.146:0/2377281658 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb758051c20 con 0x7fb75c0689d0 2023-10-06T11:16:28.392 INFO:tasks.ceph.mds.a.smithi146.stderr:2023-10-06T11:16:28.390+0000 7f04736f0700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T11:16:28.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.499+0000 7fb763b06700 1 -- 172.21.15.146:0/2377281658 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb75c15fbd0 con 0x7fb740066f30 2023-10-06T11:16:28.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.507+0000 7fb751ffb700 1 -- 172.21.15.146:0/2377281658 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+307640 (secure 0 0 0) 0x7fb74c00c050 con 0x7fb740066f30 2023-10-06T11:16:28.513 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:16:28.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.511+0000 7fb763b06700 1 -- 172.21.15.146:0/2377281658 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb740066f30 msgr2=0x7fb7400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:28.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.511+0000 7fb763b06700 1 --2- 172.21.15.146:0/2377281658 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb740066f30 0x7fb7400693e0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fb75c154560 tx=0x7fb74c008040 comp rx=0 tx=0).stop 2023-10-06T11:16:28.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.511+0000 7fb763b06700 1 -- 172.21.15.146:0/2377281658 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb75c0689d0 msgr2=0x7fb75c157400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:28.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.511+0000 7fb763b06700 1 --2- 172.21.15.146:0/2377281658 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb75c0689d0 0x7fb75c157400 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7fb75800c7d0 tx=0x7fb758008040 comp rx=0 tx=0).stop 2023-10-06T11:16:28.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.511+0000 7fb763b06700 1 -- 172.21.15.146:0/2377281658 shutdown_connections 2023-10-06T11:16:28.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.511+0000 7fb763b06700 1 --2- 172.21.15.146:0/2377281658 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb740066f30 0x7fb7400693e0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:28.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.511+0000 7fb763b06700 1 --2- 172.21.15.146:0/2377281658 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb75c153e80 0x7fb75c16d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:28.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.511+0000 7fb763b06700 1 --2- 172.21.15.146:0/2377281658 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb75c0689d0 0x7fb75c157400 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:28.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.511+0000 7fb763b06700 1 --2- 172.21.15.146:0/2377281658 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb75c153ab0 0x7fb75c16cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:28.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.511+0000 7fb763b06700 1 -- 172.21.15.146:0/2377281658 >> 172.21.15.146:0/2377281658 conn(0x7fb75c06eba0 msgr2=0x7fb75c1530f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:28.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.511+0000 7fb763b06700 1 -- 172.21.15.146:0/2377281658 shutdown_connections 2023-10-06T11:16:28.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.511+0000 7fb763b06700 1 -- 172.21.15.146:0/2377281658 wait complete. 2023-10-06T11:16:28.516 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:16:28.525 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":455,"stamp":"2023-10-06T11:16:27.278649+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592604,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":196,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":154,"acting":154,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":127,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2437824,"kb_used_data":14464,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752536896,"statfs":{"total":773094113280,"available":770597781504,"internally_reserved":0,"allocated":14811136,"data_stored":7419345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2236,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.194253"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.114163+0000","last_change":"2023-10-06T11:16:24.109016+0000","last_active":"2023-10-06T11:16:24.114163+0000","last_peered":"2023-10-06T11:16:24.114163+0000","last_clean":"2023-10-06T11:16:24.114163+0000","last_became_active":"2023-10-06T11:16:24.108230+0000","last_became_peered":"2023-10-06T11:16:24.108230+0000","last_unstale":"2023-10-06T11:16:24.114163+0000","last_undegraded":"2023-10-06T11:16:24.114163+0000","last_fullsized":"2023-10-06T11:16:24.114163+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:46:32.933025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.114773+0000","last_change":"2023-10-06T11:16:24.108647+0000","last_active":"2023-10-06T11:16:24.114773+0000","last_peered":"2023-10-06T11:16:24.114773+0000","last_clean":"2023-10-06T11:16:24.114773+0000","last_became_active":"2023-10-06T11:16:24.108417+0000","last_became_peered":"2023-10-06T11:16:24.108417+0000","last_unstale":"2023-10-06T11:16:24.114773+0000","last_undegraded":"2023-10-06T11:16:24.114773+0000","last_fullsized":"2023-10-06T11:16:24.114773+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:26:03.575635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116075+0000","last_change":"2023-10-06T11:16:24.108739+0000","last_active":"2023-10-06T11:16:24.116075+0000","last_peered":"2023-10-06T11:16:24.116075+0000","last_clean":"2023-10-06T11:16:24.116075+0000","last_became_active":"2023-10-06T11:16:24.108453+0000","last_became_peered":"2023-10-06T11:16:24.108453+0000","last_unstale":"2023-10-06T11:16:24.116075+0000","last_undegraded":"2023-10-06T11:16:24.116075+0000","last_fullsized":"2023-10-06T11:16:24.116075+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:59:45.901579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.120838+0000","last_change":"2023-10-06T11:16:24.115798+0000","last_active":"2023-10-06T11:16:24.120838+0000","last_peered":"2023-10-06T11:16:24.120838+0000","last_clean":"2023-10-06T11:16:24.120838+0000","last_became_active":"2023-10-06T11:16:24.115530+0000","last_became_peered":"2023-10-06T11:16:24.115530+0000","last_unstale":"2023-10-06T11:16:24.120838+0000","last_undegraded":"2023-10-06T11:16:24.120838+0000","last_fullsized":"2023-10-06T11:16:24.120838+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:26:32.565614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116267+0000","last_change":"2023-10-06T11:16:24.112144+0000","last_active":"2023-10-06T11:16:24.116267+0000","last_peered":"2023-10-06T11:16:24.116267+0000","last_clean":"2023-10-06T11:16:24.116267+0000","last_became_active":"2023-10-06T11:16:24.111426+0000","last_became_peered":"2023-10-06T11:16:24.111426+0000","last_unstale":"2023-10-06T11:16:24.116267+0000","last_undegraded":"2023-10-06T11:16:24.116267+0000","last_fullsized":"2023-10-06T11:16:24.116267+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:12:06.066982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116349+0000","last_change":"2023-10-06T11:16:24.113655+0000","last_active":"2023-10-06T11:16:24.116349+0000","last_peered":"2023-10-06T11:16:24.116349+0000","last_clean":"2023-10-06T11:16:24.116349+0000","last_became_active":"2023-10-06T11:16:24.113399+0000","last_became_peered":"2023-10-06T11:16:24.113399+0000","last_unstale":"2023-10-06T11:16:24.116349+0000","last_undegraded":"2023-10-06T11:16:24.116349+0000","last_fullsized":"2023-10-06T11:16:24.116349+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:50:16.146183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121936+0000","last_change":"2023-10-06T11:16:24.119814+0000","last_active":"2023-10-06T11:16:24.121936+0000","last_peered":"2023-10-06T11:16:24.121936+0000","last_clean":"2023-10-06T11:16:24.121936+0000","last_became_active":"2023-10-06T11:16:24.119316+0000","last_became_peered":"2023-10-06T11:16:24.119316+0000","last_unstale":"2023-10-06T11:16:24.121936+0000","last_undegraded":"2023-10-06T11:16:24.121936+0000","last_fullsized":"2023-10-06T11:16:24.121936+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:26.166829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116386+0000","last_change":"2023-10-06T11:16:24.113716+0000","last_active":"2023-10-06T11:16:24.116386+0000","last_peered":"2023-10-06T11:16:24.116386+0000","last_clean":"2023-10-06T11:16:24.116386+0000","last_became_active":"2023-10-06T11:16:24.113447+0000","last_became_peered":"2023-10-06T11:16:24.113447+0000","last_unstale":"2023-10-06T11:16:24.116386+0000","last_undegraded":"2023-10-06T11:16:24.116386+0000","last_fullsized":"2023-10-06T11:16:24.116386+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:28.023957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.106632+0000","last_change":"2023-10-06T11:16:24.103595+0000","last_active":"2023-10-06T11:16:24.106632+0000","last_peered":"2023-10-06T11:16:24.106632+0000","last_clean":"2023-10-06T11:16:24.106632+0000","last_became_active":"2023-10-06T11:16:24.103341+0000","last_became_peered":"2023-10-06T11:16:24.103341+0000","last_unstale":"2023-10-06T11:16:24.106632+0000","last_undegraded":"2023-10-06T11:16:24.106632+0000","last_fullsized":"2023-10-06T11:16:24.106632+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:30:19.278442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.120354+0000","last_change":"2023-10-06T11:16:24.107132+0000","last_active":"2023-10-06T11:16:24.120354+0000","last_peered":"2023-10-06T11:16:24.120354+0000","last_clean":"2023-10-06T11:16:24.120354+0000","last_became_active":"2023-10-06T11:16:24.106714+0000","last_became_peered":"2023-10-06T11:16:24.106714+0000","last_unstale":"2023-10-06T11:16:24.120354+0000","last_undegraded":"2023-10-06T11:16:24.120354+0000","last_fullsized":"2023-10-06T11:16:24.120354+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:08.737914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121851+0000","last_change":"2023-10-06T11:16:24.116978+0000","last_active":"2023-10-06T11:16:24.121851+0000","last_peered":"2023-10-06T11:16:24.121851+0000","last_clean":"2023-10-06T11:16:24.121851+0000","last_became_active":"2023-10-06T11:16:24.116483+0000","last_became_peered":"2023-10-06T11:16:24.116483+0000","last_unstale":"2023-10-06T11:16:24.121851+0000","last_undegraded":"2023-10-06T11:16:24.121851+0000","last_fullsized":"2023-10-06T11:16:24.121851+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:07.106736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.112359+0000","last_change":"2023-10-06T11:16:24.101538+0000","last_active":"2023-10-06T11:16:24.112359+0000","last_peered":"2023-10-06T11:16:24.112359+0000","last_clean":"2023-10-06T11:16:24.112359+0000","last_became_active":"2023-10-06T11:16:24.101276+0000","last_became_peered":"2023-10-06T11:16:24.101276+0000","last_unstale":"2023-10-06T11:16:24.112359+0000","last_undegraded":"2023-10-06T11:16:24.112359+0000","last_fullsized":"2023-10-06T11:16:24.112359+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:26:02.681339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.118962+0000","last_change":"2023-10-06T11:16:24.117423+0000","last_active":"2023-10-06T11:16:24.118962+0000","last_peered":"2023-10-06T11:16:24.118962+0000","last_clean":"2023-10-06T11:16:24.118962+0000","last_became_active":"2023-10-06T11:16:24.117137+0000","last_became_peered":"2023-10-06T11:16:24.117137+0000","last_unstale":"2023-10-06T11:16:24.118962+0000","last_undegraded":"2023-10-06T11:16:24.118962+0000","last_fullsized":"2023-10-06T11:16:24.118962+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:17.086479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.119950+0000","last_change":"2023-10-06T11:16:24.112281+0000","last_active":"2023-10-06T11:16:24.119950+0000","last_peered":"2023-10-06T11:16:24.119950+0000","last_clean":"2023-10-06T11:16:24.119950+0000","last_became_active":"2023-10-06T11:16:24.111821+0000","last_became_peered":"2023-10-06T11:16:24.111821+0000","last_unstale":"2023-10-06T11:16:24.119950+0000","last_undegraded":"2023-10-06T11:16:24.119950+0000","last_fullsized":"2023-10-06T11:16:24.119950+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:11.876870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.108707+0000","last_change":"2023-10-06T11:16:24.105272+0000","last_active":"2023-10-06T11:16:24.108707+0000","last_peered":"2023-10-06T11:16:24.108707+0000","last_clean":"2023-10-06T11:16:24.108707+0000","last_became_active":"2023-10-06T11:16:24.104836+0000","last_became_peered":"2023-10-06T11:16:24.104836+0000","last_unstale":"2023-10-06T11:16:24.108707+0000","last_undegraded":"2023-10-06T11:16:24.108707+0000","last_fullsized":"2023-10-06T11:16:24.108707+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:20:21.978391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.114191+0000","last_change":"2023-10-06T11:16:24.109203+0000","last_active":"2023-10-06T11:16:24.114191+0000","last_peered":"2023-10-06T11:16:24.114191+0000","last_clean":"2023-10-06T11:16:24.114191+0000","last_became_active":"2023-10-06T11:16:24.103632+0000","last_became_peered":"2023-10-06T11:16:24.103632+0000","last_unstale":"2023-10-06T11:16:24.114191+0000","last_undegraded":"2023-10-06T11:16:24.114191+0000","last_fullsized":"2023-10-06T11:16:24.114191+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:21:48.286337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.119621+0000","last_change":"2023-10-06T11:16:24.112055+0000","last_active":"2023-10-06T11:16:24.119621+0000","last_peered":"2023-10-06T11:16:24.119621+0000","last_clean":"2023-10-06T11:16:24.119621+0000","last_became_active":"2023-10-06T11:16:24.111459+0000","last_became_peered":"2023-10-06T11:16:24.111459+0000","last_unstale":"2023-10-06T11:16:24.119621+0000","last_undegraded":"2023-10-06T11:16:24.119621+0000","last_fullsized":"2023-10-06T11:16:24.119621+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:56:01.575492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116536+0000","last_change":"2023-10-06T11:16:24.114696+0000","last_active":"2023-10-06T11:16:24.116536+0000","last_peered":"2023-10-06T11:16:24.116536+0000","last_clean":"2023-10-06T11:16:24.116536+0000","last_became_active":"2023-10-06T11:16:24.114468+0000","last_became_peered":"2023-10-06T11:16:24.114468+0000","last_unstale":"2023-10-06T11:16:24.116536+0000","last_undegraded":"2023-10-06T11:16:24.116536+0000","last_fullsized":"2023-10-06T11:16:24.116536+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:29.132592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121795+0000","last_change":"2023-10-06T11:16:24.118093+0000","last_active":"2023-10-06T11:16:24.121795+0000","last_peered":"2023-10-06T11:16:24.121795+0000","last_clean":"2023-10-06T11:16:24.121795+0000","last_became_active":"2023-10-06T11:16:24.117790+0000","last_became_peered":"2023-10-06T11:16:24.117790+0000","last_unstale":"2023-10-06T11:16:24.121795+0000","last_undegraded":"2023-10-06T11:16:24.121795+0000","last_fullsized":"2023-10-06T11:16:24.121795+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:47:48.803032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121730+0000","last_change":"2023-10-06T11:16:24.118266+0000","last_active":"2023-10-06T11:16:24.121730+0000","last_peered":"2023-10-06T11:16:24.121730+0000","last_clean":"2023-10-06T11:16:24.121730+0000","last_became_active":"2023-10-06T11:16:24.118001+0000","last_became_peered":"2023-10-06T11:16:24.118001+0000","last_unstale":"2023-10-06T11:16:24.121730+0000","last_undegraded":"2023-10-06T11:16:24.121730+0000","last_fullsized":"2023-10-06T11:16:24.121730+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:59:42.744899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.107924+0000","last_change":"2023-10-06T11:16:24.103535+0000","last_active":"2023-10-06T11:16:24.107924+0000","last_peered":"2023-10-06T11:16:24.107924+0000","last_clean":"2023-10-06T11:16:24.107924+0000","last_became_active":"2023-10-06T11:16:24.103293+0000","last_became_peered":"2023-10-06T11:16:24.103293+0000","last_unstale":"2023-10-06T11:16:24.107924+0000","last_undegraded":"2023-10-06T11:16:24.107924+0000","last_fullsized":"2023-10-06T11:16:24.107924+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:10:53.231459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1f","version":"136'4","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.118823+0000","last_change":"2023-10-06T11:16:23.099064+0000","last_active":"2023-10-06T11:16:24.118823+0000","last_peered":"2023-10-06T11:16:24.118823+0000","last_clean":"2023-10-06T11:16:24.118823+0000","last_became_active":"2023-10-06T11:16:23.098801+0000","last_became_peered":"2023-10-06T11:16:23.098801+0000","last_unstale":"2023-10-06T11:16:24.118823+0000","last_undegraded":"2023-10-06T11:16:24.118823+0000","last_fullsized":"2023-10-06T11:16:24.118823+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:41:43.291967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"136'1","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121286+0000","last_change":"2023-10-06T11:16:23.104447+0000","last_active":"2023-10-06T11:16:24.121286+0000","last_peered":"2023-10-06T11:16:24.121286+0000","last_clean":"2023-10-06T11:16:24.121286+0000","last_became_active":"2023-10-06T11:16:23.104161+0000","last_became_peered":"2023-10-06T11:16:23.104161+0000","last_unstale":"2023-10-06T11:16:24.121286+0000","last_undegraded":"2023-10-06T11:16:24.121286+0000","last_fullsized":"2023-10-06T11:16:24.121286+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:56:00.571220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1d","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.123951+0000","last_change":"2023-10-06T11:16:23.104220+0000","last_active":"2023-10-06T11:16:24.123951+0000","last_peered":"2023-10-06T11:16:24.123951+0000","last_clean":"2023-10-06T11:16:24.123951+0000","last_became_active":"2023-10-06T11:16:23.103920+0000","last_became_peered":"2023-10-06T11:16:23.103920+0000","last_unstale":"2023-10-06T11:16:24.123951+0000","last_undegraded":"2023-10-06T11:16:24.123951+0000","last_fullsized":"2023-10-06T11:16:24.123951+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:50.360247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.122009+0000","last_change":"2023-10-06T11:16:24.118231+0000","last_active":"2023-10-06T11:16:24.122009+0000","last_peered":"2023-10-06T11:16:24.122009+0000","last_clean":"2023-10-06T11:16:24.122009+0000","last_became_active":"2023-10-06T11:16:24.117962+0000","last_became_peered":"2023-10-06T11:16:24.117962+0000","last_unstale":"2023-10-06T11:16:24.122009+0000","last_undegraded":"2023-10-06T11:16:24.122009+0000","last_fullsized":"2023-10-06T11:16:24.122009+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:34:42.484972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:22.074583+0000","last_change":"2023-10-06T11:16:22.089441+0000","last_active":"2023-10-06T11:16:22.074583+0000","last_peered":"2023-10-06T11:16:22.074583+0000","last_clean":"2023-10-06T11:16:22.074583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:22.074583+0000","last_undegraded":"2023-10-06T11:16:22.074583+0000","last_fullsized":"2023-10-06T11:16:22.074583+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:59.486245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.113203+0000","last_change":"2023-10-06T11:16:24.105810+0000","last_active":"2023-10-06T11:16:24.113203+0000","last_peered":"2023-10-06T11:16:24.113203+0000","last_clean":"2023-10-06T11:16:24.113203+0000","last_became_active":"2023-10-06T11:16:24.105537+0000","last_became_peered":"2023-10-06T11:16:24.105537+0000","last_unstale":"2023-10-06T11:16:24.113203+0000","last_undegraded":"2023-10-06T11:16:24.113203+0000","last_fullsized":"2023-10-06T11:16:24.113203+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:42:42.357861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:22.074583+0000","last_change":"2023-10-06T11:16:22.087560+0000","last_active":"2023-10-06T11:16:22.074583+0000","last_peered":"2023-10-06T11:16:22.074583+0000","last_clean":"2023-10-06T11:16:22.074583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:22.074583+0000","last_undegraded":"2023-10-06T11:16:22.074583+0000","last_fullsized":"2023-10-06T11:16:22.074583+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:34:43.602621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"136'1","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116331+0000","last_change":"2023-10-06T11:16:23.099499+0000","last_active":"2023-10-06T11:16:24.116331+0000","last_peered":"2023-10-06T11:16:24.116331+0000","last_clean":"2023-10-06T11:16:24.116331+0000","last_became_active":"2023-10-06T11:16:23.099285+0000","last_became_peered":"2023-10-06T11:16:23.099285+0000","last_unstale":"2023-10-06T11:16:24.116331+0000","last_undegraded":"2023-10-06T11:16:24.116331+0000","last_fullsized":"2023-10-06T11:16:24.116331+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:56:00.571220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.095986+0000","last_change":"2023-10-06T11:16:23.100854+0000","last_active":"2023-10-06T11:16:24.095986+0000","last_peered":"2023-10-06T11:16:24.095986+0000","last_clean":"2023-10-06T11:16:24.095986+0000","last_became_active":"2023-10-06T11:16:23.100200+0000","last_became_peered":"2023-10-06T11:16:23.100200+0000","last_unstale":"2023-10-06T11:16:24.095986+0000","last_undegraded":"2023-10-06T11:16:24.095986+0000","last_fullsized":"2023-10-06T11:16:24.095986+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:22:40.220215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.107002+0000","last_change":"2023-10-06T11:16:24.104492+0000","last_active":"2023-10-06T11:16:24.107002+0000","last_peered":"2023-10-06T11:16:24.107002+0000","last_clean":"2023-10-06T11:16:24.107002+0000","last_became_active":"2023-10-06T11:16:24.104181+0000","last_became_peered":"2023-10-06T11:16:24.104181+0000","last_unstale":"2023-10-06T11:16:24.107002+0000","last_undegraded":"2023-10-06T11:16:24.107002+0000","last_fullsized":"2023-10-06T11:16:24.107002+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:55:36.589699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.098162+0000","last_change":"2023-10-06T11:16:23.097833+0000","last_active":"2023-10-06T11:16:24.098162+0000","last_peered":"2023-10-06T11:16:24.098162+0000","last_clean":"2023-10-06T11:16:24.098162+0000","last_became_active":"2023-10-06T11:16:23.097560+0000","last_became_peered":"2023-10-06T11:16:23.097560+0000","last_unstale":"2023-10-06T11:16:24.098162+0000","last_undegraded":"2023-10-06T11:16:24.098162+0000","last_fullsized":"2023-10-06T11:16:24.098162+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:01:05.784628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121995+0000","last_change":"2023-10-06T11:16:24.118160+0000","last_active":"2023-10-06T11:16:24.121995+0000","last_peered":"2023-10-06T11:16:24.121995+0000","last_clean":"2023-10-06T11:16:24.121995+0000","last_became_active":"2023-10-06T11:16:24.117892+0000","last_became_peered":"2023-10-06T11:16:24.117892+0000","last_unstale":"2023-10-06T11:16:24.121995+0000","last_undegraded":"2023-10-06T11:16:24.121995+0000","last_fullsized":"2023-10-06T11:16:24.121995+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:52.405684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"136'1","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121722+0000","last_change":"2023-10-06T11:16:23.100806+0000","last_active":"2023-10-06T11:16:24.121722+0000","last_peered":"2023-10-06T11:16:24.121722+0000","last_clean":"2023-10-06T11:16:24.121722+0000","last_became_active":"2023-10-06T11:16:23.099910+0000","last_became_peered":"2023-10-06T11:16:23.099910+0000","last_unstale":"2023-10-06T11:16:24.121722+0000","last_undegraded":"2023-10-06T11:16:24.121722+0000","last_fullsized":"2023-10-06T11:16:24.121722+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:21:56.372977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.119434+0000","last_change":"2023-10-06T11:16:24.115023+0000","last_active":"2023-10-06T11:16:24.119434+0000","last_peered":"2023-10-06T11:16:24.119434+0000","last_clean":"2023-10-06T11:16:24.119434+0000","last_became_active":"2023-10-06T11:16:24.114720+0000","last_became_peered":"2023-10-06T11:16:24.114720+0000","last_unstale":"2023-10-06T11:16:24.119434+0000","last_undegraded":"2023-10-06T11:16:24.119434+0000","last_fullsized":"2023-10-06T11:16:24.119434+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:19.593270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121773+0000","last_change":"2023-10-06T11:16:23.103494+0000","last_active":"2023-10-06T11:16:24.121773+0000","last_peered":"2023-10-06T11:16:24.121773+0000","last_clean":"2023-10-06T11:16:24.121773+0000","last_became_active":"2023-10-06T11:16:23.103217+0000","last_became_peered":"2023-10-06T11:16:23.103217+0000","last_unstale":"2023-10-06T11:16:24.121773+0000","last_undegraded":"2023-10-06T11:16:24.121773+0000","last_fullsized":"2023-10-06T11:16:24.121773+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:01:05.784628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.107033+0000","last_change":"2023-10-06T11:16:24.104031+0000","last_active":"2023-10-06T11:16:24.107033+0000","last_peered":"2023-10-06T11:16:24.107033+0000","last_clean":"2023-10-06T11:16:24.107033+0000","last_became_active":"2023-10-06T11:16:24.103748+0000","last_became_peered":"2023-10-06T11:16:24.103748+0000","last_unstale":"2023-10-06T11:16:24.107033+0000","last_undegraded":"2023-10-06T11:16:24.107033+0000","last_fullsized":"2023-10-06T11:16:24.107033+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:51.364520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:22.074583+0000","last_change":"2023-10-06T11:16:22.089897+0000","last_active":"2023-10-06T11:16:22.074583+0000","last_peered":"2023-10-06T11:16:22.074583+0000","last_clean":"2023-10-06T11:16:22.074583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:22.074583+0000","last_undegraded":"2023-10-06T11:16:22.074583+0000","last_fullsized":"2023-10-06T11:16:22.074583+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:10.613647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.119617+0000","last_change":"2023-10-06T11:16:24.114058+0000","last_active":"2023-10-06T11:16:24.119617+0000","last_peered":"2023-10-06T11:16:24.119617+0000","last_clean":"2023-10-06T11:16:24.119617+0000","last_became_active":"2023-10-06T11:16:24.111051+0000","last_became_peered":"2023-10-06T11:16:24.111051+0000","last_unstale":"2023-10-06T11:16:24.119617+0000","last_undegraded":"2023-10-06T11:16:24.119617+0000","last_fullsized":"2023-10-06T11:16:24.119617+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:46:59.369734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:22.074583+0000","last_change":"2023-10-06T11:16:22.091691+0000","last_active":"2023-10-06T11:16:22.074583+0000","last_peered":"2023-10-06T11:16:22.074583+0000","last_clean":"2023-10-06T11:16:22.074583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:22.074583+0000","last_undegraded":"2023-10-06T11:16:22.074583+0000","last_fullsized":"2023-10-06T11:16:22.074583+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:51:27.162572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121900+0000","last_change":"2023-10-06T11:16:24.116989+0000","last_active":"2023-10-06T11:16:24.121900+0000","last_peered":"2023-10-06T11:16:24.121900+0000","last_clean":"2023-10-06T11:16:24.121900+0000","last_became_active":"2023-10-06T11:16:24.116709+0000","last_became_peered":"2023-10-06T11:16:24.116709+0000","last_unstale":"2023-10-06T11:16:24.121900+0000","last_undegraded":"2023-10-06T11:16:24.121900+0000","last_fullsized":"2023-10-06T11:16:24.121900+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:37:37.920152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.118772+0000","last_change":"2023-10-06T11:16:23.094553+0000","last_active":"2023-10-06T11:16:24.118772+0000","last_peered":"2023-10-06T11:16:24.118772+0000","last_clean":"2023-10-06T11:16:24.118772+0000","last_became_active":"2023-10-06T11:16:23.094319+0000","last_became_peered":"2023-10-06T11:16:23.094319+0000","last_unstale":"2023-10-06T11:16:24.118772+0000","last_undegraded":"2023-10-06T11:16:24.118772+0000","last_fullsized":"2023-10-06T11:16:24.118772+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:28.128320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:22.074583+0000","last_change":"2023-10-06T11:16:22.087428+0000","last_active":"2023-10-06T11:16:22.074583+0000","last_peered":"2023-10-06T11:16:22.074583+0000","last_clean":"2023-10-06T11:16:22.074583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:22.074583+0000","last_undegraded":"2023-10-06T11:16:22.074583+0000","last_fullsized":"2023-10-06T11:16:22.074583+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:23:31.995315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.123888+0000","last_change":"2023-10-06T11:16:24.122010+0000","last_active":"2023-10-06T11:16:24.123888+0000","last_peered":"2023-10-06T11:16:24.123888+0000","last_clean":"2023-10-06T11:16:24.123888+0000","last_became_active":"2023-10-06T11:16:24.121668+0000","last_became_peered":"2023-10-06T11:16:24.121668+0000","last_unstale":"2023-10-06T11:16:24.123888+0000","last_undegraded":"2023-10-06T11:16:24.123888+0000","last_fullsized":"2023-10-06T11:16:24.123888+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:48.961124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.101790+0000","last_change":"2023-10-06T11:16:23.094432+0000","last_active":"2023-10-06T11:16:24.101790+0000","last_peered":"2023-10-06T11:16:24.101790+0000","last_clean":"2023-10-06T11:16:24.101790+0000","last_became_active":"2023-10-06T11:16:23.094187+0000","last_became_peered":"2023-10-06T11:16:23.094187+0000","last_unstale":"2023-10-06T11:16:24.101790+0000","last_undegraded":"2023-10-06T11:16:24.101790+0000","last_fullsized":"2023-10-06T11:16:24.101790+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:10:52.227186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:22.074583+0000","last_change":"2023-10-06T11:16:22.087660+0000","last_active":"2023-10-06T11:16:22.074583+0000","last_peered":"2023-10-06T11:16:22.074583+0000","last_clean":"2023-10-06T11:16:22.074583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:22.074583+0000","last_undegraded":"2023-10-06T11:16:22.074583+0000","last_fullsized":"2023-10-06T11:16:22.074583+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:29:00.300634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116082+0000","last_change":"2023-10-06T11:16:24.108869+0000","last_active":"2023-10-06T11:16:24.116082+0000","last_peered":"2023-10-06T11:16:24.116082+0000","last_clean":"2023-10-06T11:16:24.116082+0000","last_became_active":"2023-10-06T11:16:24.108622+0000","last_became_peered":"2023-10-06T11:16:24.108622+0000","last_unstale":"2023-10-06T11:16:24.116082+0000","last_undegraded":"2023-10-06T11:16:24.116082+0000","last_fullsized":"2023-10-06T11:16:24.116082+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:52.405684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:22.074583+0000","last_change":"2023-10-06T11:16:22.090769+0000","last_active":"2023-10-06T11:16:22.074583+0000","last_peered":"2023-10-06T11:16:22.074583+0000","last_clean":"2023-10-06T11:16:22.074583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:22.074583+0000","last_undegraded":"2023-10-06T11:16:22.074583+0000","last_fullsized":"2023-10-06T11:16:22.074583+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:03.275656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.098101+0000","last_change":"2023-10-06T11:16:23.103805+0000","last_active":"2023-10-06T11:16:24.098101+0000","last_peered":"2023-10-06T11:16:24.098101+0000","last_clean":"2023-10-06T11:16:24.098101+0000","last_became_active":"2023-10-06T11:16:23.103470+0000","last_became_peered":"2023-10-06T11:16:23.103470+0000","last_unstale":"2023-10-06T11:16:24.098101+0000","last_undegraded":"2023-10-06T11:16:24.098101+0000","last_fullsized":"2023-10-06T11:16:24.098101+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:56:40.401445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.107051+0000","last_change":"2023-10-06T11:16:24.104047+0000","last_active":"2023-10-06T11:16:24.107051+0000","last_peered":"2023-10-06T11:16:24.107051+0000","last_clean":"2023-10-06T11:16:24.107051+0000","last_became_active":"2023-10-06T11:16:24.103777+0000","last_became_peered":"2023-10-06T11:16:24.103777+0000","last_unstale":"2023-10-06T11:16:24.107051+0000","last_undegraded":"2023-10-06T11:16:24.107051+0000","last_fullsized":"2023-10-06T11:16:24.107051+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:01:06.788901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:22.074583+0000","last_change":"2023-10-06T11:16:22.089457+0000","last_active":"2023-10-06T11:16:22.074583+0000","last_peered":"2023-10-06T11:16:22.074583+0000","last_clean":"2023-10-06T11:16:22.074583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:22.074583+0000","last_undegraded":"2023-10-06T11:16:22.074583+0000","last_fullsized":"2023-10-06T11:16:22.074583+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:26.467632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116127+0000","last_change":"2023-10-06T11:16:24.109597+0000","last_active":"2023-10-06T11:16:24.116127+0000","last_peered":"2023-10-06T11:16:24.116127+0000","last_clean":"2023-10-06T11:16:24.116127+0000","last_became_active":"2023-10-06T11:16:24.109315+0000","last_became_peered":"2023-10-06T11:16:24.109315+0000","last_unstale":"2023-10-06T11:16:24.116127+0000","last_undegraded":"2023-10-06T11:16:24.116127+0000","last_fullsized":"2023-10-06T11:16:24.116127+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:02.452752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.098576+0000","last_change":"2023-10-06T11:16:23.102516+0000","last_active":"2023-10-06T11:16:24.098576+0000","last_peered":"2023-10-06T11:16:24.098576+0000","last_clean":"2023-10-06T11:16:24.098576+0000","last_became_active":"2023-10-06T11:16:23.102238+0000","last_became_peered":"2023-10-06T11:16:23.102238+0000","last_unstale":"2023-10-06T11:16:24.098576+0000","last_undegraded":"2023-10-06T11:16:24.098576+0000","last_fullsized":"2023-10-06T11:16:24.098576+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:50.360247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.095562+0000","last_change":"2023-10-06T11:16:23.095758+0000","last_active":"2023-10-06T11:16:24.095562+0000","last_peered":"2023-10-06T11:16:24.095562+0000","last_clean":"2023-10-06T11:16:24.095562+0000","last_became_active":"2023-10-06T11:16:23.095515+0000","last_became_peered":"2023-10-06T11:16:23.095515+0000","last_unstale":"2023-10-06T11:16:24.095562+0000","last_undegraded":"2023-10-06T11:16:24.095562+0000","last_fullsized":"2023-10-06T11:16:24.095562+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:23:31.995315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.104780+0000","last_change":"2023-10-06T11:16:23.095211+0000","last_active":"2023-10-06T11:16:24.104780+0000","last_peered":"2023-10-06T11:16:24.104780+0000","last_clean":"2023-10-06T11:16:24.104780+0000","last_became_active":"2023-10-06T11:16:23.094924+0000","last_became_peered":"2023-10-06T11:16:23.094924+0000","last_unstale":"2023-10-06T11:16:24.104780+0000","last_undegraded":"2023-10-06T11:16:24.104780+0000","last_fullsized":"2023-10-06T11:16:24.104780+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:10:17.504059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.096094+0000","last_change":"2023-10-06T11:16:23.098284+0000","last_active":"2023-10-06T11:16:24.096094+0000","last_peered":"2023-10-06T11:16:24.096094+0000","last_clean":"2023-10-06T11:16:24.096094+0000","last_became_active":"2023-10-06T11:16:23.098000+0000","last_became_peered":"2023-10-06T11:16:23.098000+0000","last_unstale":"2023-10-06T11:16:24.096094+0000","last_undegraded":"2023-10-06T11:16:24.096094+0000","last_fullsized":"2023-10-06T11:16:24.096094+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:13:24.765345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.104935+0000","last_change":"2023-10-06T11:16:23.101344+0000","last_active":"2023-10-06T11:16:24.104935+0000","last_peered":"2023-10-06T11:16:24.104935+0000","last_clean":"2023-10-06T11:16:24.104935+0000","last_became_active":"2023-10-06T11:16:23.101075+0000","last_became_peered":"2023-10-06T11:16:23.101075+0000","last_unstale":"2023-10-06T11:16:24.104935+0000","last_undegraded":"2023-10-06T11:16:24.104935+0000","last_fullsized":"2023-10-06T11:16:24.104935+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:17:34.910126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.111925+0000","last_change":"2023-10-06T11:16:24.107101+0000","last_active":"2023-10-06T11:16:24.111925+0000","last_peered":"2023-10-06T11:16:24.111925+0000","last_clean":"2023-10-06T11:16:24.111925+0000","last_became_active":"2023-10-06T11:16:24.106838+0000","last_became_peered":"2023-10-06T11:16:24.106838+0000","last_unstale":"2023-10-06T11:16:24.111925+0000","last_undegraded":"2023-10-06T11:16:24.111925+0000","last_fullsized":"2023-10-06T11:16:24.111925+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:52:28.634794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:22.074583+0000","last_change":"2023-10-06T11:16:22.089284+0000","last_active":"2023-10-06T11:16:22.074583+0000","last_peered":"2023-10-06T11:16:22.074583+0000","last_clean":"2023-10-06T11:16:22.074583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:22.074583+0000","last_undegraded":"2023-10-06T11:16:22.074583+0000","last_fullsized":"2023-10-06T11:16:22.074583+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:45.097185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":117,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T11:16:19.070220+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:16:19.070220+0000","last_peered":"2023-10-06T11:16:19.070220+0000","last_clean":"2023-10-06T11:16:19.070220+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:16:19.070220+0000","last_undegraded":"2023-10-06T11:16:19.070220+0000","last_fullsized":"2023-10-06T11:16:19.070220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.10","version":"136'8","reported_seq":18,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.126509+0000","last_change":"2023-10-06T11:16:23.100992+0000","last_active":"2023-10-06T11:16:24.126509+0000","last_peered":"2023-10-06T11:16:24.126509+0000","last_clean":"2023-10-06T11:16:24.126509+0000","last_became_active":"2023-10-06T11:16:23.100717+0000","last_became_peered":"2023-10-06T11:16:23.100717+0000","last_unstale":"2023-10-06T11:16:24.126509+0000","last_undegraded":"2023-10-06T11:16:24.126509+0000","last_fullsized":"2023-10-06T11:16:24.126509+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:10.613647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":112,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.098652+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:16:24.098652+0000","last_peered":"2023-10-06T11:16:24.098652+0000","last_clean":"2023-10-06T11:16:24.098652+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:16:24.098652+0000","last_undegraded":"2023-10-06T11:16:24.098652+0000","last_fullsized":"2023-10-06T11:16:24.098652+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.107394+0000","last_change":"2023-10-06T11:16:23.100682+0000","last_active":"2023-10-06T11:16:24.107394+0000","last_peered":"2023-10-06T11:16:24.107394+0000","last_clean":"2023-10-06T11:16:24.107394+0000","last_became_active":"2023-10-06T11:16:23.099315+0000","last_became_peered":"2023-10-06T11:16:23.099315+0000","last_unstale":"2023-10-06T11:16:24.107394+0000","last_undegraded":"2023-10-06T11:16:24.107394+0000","last_fullsized":"2023-10-06T11:16:24.107394+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:26:31.561341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":106,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T11:16:19.072895+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:16:19.072895+0000","last_peered":"2023-10-06T11:16:19.072895+0000","last_clean":"2023-10-06T11:16:19.072895+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:16:19.072895+0000","last_undegraded":"2023-10-06T11:16:19.072895+0000","last_fullsized":"2023-10-06T11:16:19.072895+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":255,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.105025+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:16:24.105025+0000","last_peered":"2023-10-06T11:16:24.105025+0000","last_clean":"2023-10-06T11:16:24.105025+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:16:24.105025+0000","last_undegraded":"2023-10-06T11:16:24.105025+0000","last_fullsized":"2023-10-06T11:16:24.105025+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121988+0000","last_change":"2023-10-06T11:16:24.120168+0000","last_active":"2023-10-06T11:16:24.121988+0000","last_peered":"2023-10-06T11:16:24.121988+0000","last_clean":"2023-10-06T11:16:24.121988+0000","last_became_active":"2023-10-06T11:16:24.119797+0000","last_became_peered":"2023-10-06T11:16:24.119797+0000","last_unstale":"2023-10-06T11:16:24.121988+0000","last_undegraded":"2023-10-06T11:16:24.121988+0000","last_fullsized":"2023-10-06T11:16:24.121988+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:04:48.357935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.098212+0000","last_change":"2023-10-06T11:16:23.098273+0000","last_active":"2023-10-06T11:16:24.098212+0000","last_peered":"2023-10-06T11:16:24.098212+0000","last_clean":"2023-10-06T11:16:24.098212+0000","last_became_active":"2023-10-06T11:16:23.097970+0000","last_became_peered":"2023-10-06T11:16:23.097970+0000","last_unstale":"2023-10-06T11:16:24.098212+0000","last_undegraded":"2023-10-06T11:16:24.098212+0000","last_fullsized":"2023-10-06T11:16:24.098212+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:29.555606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":105,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.106284+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:16:24.106284+0000","last_peered":"2023-10-06T11:16:24.106284+0000","last_clean":"2023-10-06T11:16:24.106284+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:16:24.106284+0000","last_undegraded":"2023-10-06T11:16:24.106284+0000","last_fullsized":"2023-10-06T11:16:24.106284+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.14","version":"136'6","reported_seq":16,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.126641+0000","last_change":"2023-10-06T11:16:23.095177+0000","last_active":"2023-10-06T11:16:24.126641+0000","last_peered":"2023-10-06T11:16:24.126641+0000","last_clean":"2023-10-06T11:16:24.126641+0000","last_became_active":"2023-10-06T11:16:23.094700+0000","last_became_peered":"2023-10-06T11:16:23.094700+0000","last_unstale":"2023-10-06T11:16:24.126641+0000","last_undegraded":"2023-10-06T11:16:24.126641+0000","last_fullsized":"2023-10-06T11:16:24.126641+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:16.082206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":105,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.105115+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:16:24.105115+0000","last_peered":"2023-10-06T11:16:24.105115+0000","last_clean":"2023-10-06T11:16:24.105115+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:16:24.105115+0000","last_undegraded":"2023-10-06T11:16:24.105115+0000","last_fullsized":"2023-10-06T11:16:24.105115+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.120333+0000","last_change":"2023-10-06T11:16:24.106952+0000","last_active":"2023-10-06T11:16:24.120333+0000","last_peered":"2023-10-06T11:16:24.120333+0000","last_clean":"2023-10-06T11:16:24.120333+0000","last_became_active":"2023-10-06T11:16:24.106431+0000","last_became_peered":"2023-10-06T11:16:24.106431+0000","last_unstale":"2023-10-06T11:16:24.120333+0000","last_undegraded":"2023-10-06T11:16:24.120333+0000","last_fullsized":"2023-10-06T11:16:24.120333+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:59:53.565267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"136'3","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121884+0000","last_change":"2023-10-06T11:16:23.091484+0000","last_active":"2023-10-06T11:16:24.121884+0000","last_peered":"2023-10-06T11:16:24.121884+0000","last_clean":"2023-10-06T11:16:24.121884+0000","last_became_active":"2023-10-06T11:16:23.090228+0000","last_became_peered":"2023-10-06T11:16:23.090228+0000","last_unstale":"2023-10-06T11:16:24.121884+0000","last_undegraded":"2023-10-06T11:16:24.121884+0000","last_fullsized":"2023-10-06T11:16:24.121884+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:05:24.455055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":126,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.096193+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:16:24.096193+0000","last_peered":"2023-10-06T11:16:24.096193+0000","last_clean":"2023-10-06T11:16:24.096193+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:16:24.096193+0000","last_undegraded":"2023-10-06T11:16:24.096193+0000","last_fullsized":"2023-10-06T11:16:24.096193+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:22.074583+0000","last_change":"2023-10-06T11:16:22.089652+0000","last_active":"2023-10-06T11:16:22.074583+0000","last_peered":"2023-10-06T11:16:22.074583+0000","last_clean":"2023-10-06T11:16:22.074583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:22.074583+0000","last_undegraded":"2023-10-06T11:16:22.074583+0000","last_fullsized":"2023-10-06T11:16:22.074583+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:35:44.567263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":109,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T11:16:19.512167+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:16:19.512167+0000","last_peered":"2023-10-06T11:16:19.512167+0000","last_clean":"2023-10-06T11:16:19.512167+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:16:19.512167+0000","last_undegraded":"2023-10-06T11:16:19.512167+0000","last_fullsized":"2023-10-06T11:16:19.512167+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.13","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.117964+0000","last_change":"2023-10-06T11:16:23.099218+0000","last_active":"2023-10-06T11:16:24.117964+0000","last_peered":"2023-10-06T11:16:24.117964+0000","last_clean":"2023-10-06T11:16:24.117964+0000","last_became_active":"2023-10-06T11:16:23.098941+0000","last_became_peered":"2023-10-06T11:16:23.098941+0000","last_unstale":"2023-10-06T11:16:24.117964+0000","last_undegraded":"2023-10-06T11:16:24.117964+0000","last_fullsized":"2023-10-06T11:16:24.117964+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:46:58.365462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":109,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T11:16:19.512196+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:16:19.512196+0000","last_peered":"2023-10-06T11:16:19.512196+0000","last_clean":"2023-10-06T11:16:19.512196+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:16:19.512196+0000","last_undegraded":"2023-10-06T11:16:19.512196+0000","last_fullsized":"2023-10-06T11:16:19.512196+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2236,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":64,"acting":64,"num_store_stats":8},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":72,"acting":72,"num_store_stats":5},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574981,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303644,"kb_used_data":2260,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068196,"statfs":{"total":96636764160,"available":96325832704,"internally_reserved":0,"allocated":2314240,"data_stored":1379705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51200000000000001,"15min":0.625},"min":{"1min":0.30299999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.68899999999999995,"5min":4.407,"15min":23.908999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.48499999999999999,"15min":0.57399999999999995},"min":{"1min":0.313,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.68300000000000005,"5min":0.69799999999999995,"15min":9.3230000000000004},"last":0.42399999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51000000000000001,"15min":0.55900000000000005},"min":{"1min":0.35299999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.71499999999999997,"5min":2.4689999999999999,"15min":9.2360000000000007},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.47299999999999998,"15min":0.503},"min":{"1min":0.373,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.64400000000000002,"5min":0.78900000000000003,"15min":4.327},"last":0.40999999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54000000000000004,"15min":0.51700000000000002},"min":{"1min":0.39900000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.63500000000000001,"5min":4.3120000000000003,"15min":4.3120000000000003},"last":0.442},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53600000000000003,"15min":0.55700000000000005},"min":{"1min":0.34799999999999998,"5min":0.31,"15min":0.29999999999999999},"max":{"1min":0.70699999999999996,"5min":3.0600000000000001,"15min":4.7309999999999999},"last":0.376}]},{"osd":3,"last update":"Fri Oct 6 11:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54600000000000004,"15min":0.53900000000000003},"min":{"1min":0.36499999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.72099999999999997,"5min":4.5190000000000001,"15min":4.5190000000000001},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56100000000000005,"15min":0.59899999999999998},"min":{"1min":0.38100000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.74099999999999999,"5min":3.0070000000000001,"15min":9.3879999999999999},"last":0.498}]},{"osd":4,"last update":"Fri Oct 6 11:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.502,"15min":0.48999999999999999},"min":{"1min":0.32800000000000001,"5min":0.26000000000000001,"15min":0.24399999999999999},"max":{"1min":0.68700000000000006,"5min":4.6639999999999997,"15min":4.6639999999999997},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.53600000000000003},"min":{"1min":0.33300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.78200000000000003,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":0.48599999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.51200000000000001,"15min":0.56100000000000005},"min":{"1min":0.33900000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":9.3499999999999996},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.5,"15min":0.54200000000000004},"min":{"1min":0.377,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.74299999999999999,"5min":0.83399999999999996,"15min":4.444},"last":0.54700000000000004}]},{"osd":6,"last update":"Fri Oct 6 11:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.53800000000000003,"15min":0.59699999999999998},"min":{"1min":0.41499999999999998,"5min":0.32400000000000001,"15min":0.29199999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":9.4969999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60899999999999999,"15min":0.62},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.85799999999999998,"5min":4.4669999999999996,"15min":7.2039999999999997},"last":0.52200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574982,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298912,"kb_used_data":1624,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072928,"statfs":{"total":96636764160,"available":96330678272,"internally_reserved":0,"allocated":1662976,"data_stored":761431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.56299999999999994,"15min":0.52000000000000002},"min":{"1min":0.254,"5min":0.187,"15min":0.187},"max":{"1min":0.66400000000000003,"5min":9.5549999999999997,"15min":9.5549999999999997},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.63300000000000001,"15min":0.56399999999999995},"min":{"1min":0.30399999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.73999999999999999,"5min":9.4659999999999993,"15min":9.4659999999999993},"last":0.65200000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46100000000000002,"15min":0.48299999999999998},"min":{"1min":0.27500000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.68000000000000005,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.56000000000000005,"15min":0.51500000000000001},"min":{"1min":0.34399999999999997,"5min":0.216,"15min":0.216},"max":{"1min":0.71499999999999997,"5min":5.2670000000000003,"15min":5.2670000000000003},"last":0.61299999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.46600000000000003,"15min":0.499},"min":{"1min":0.29399999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.65800000000000003,"5min":0.93200000000000005,"15min":7.0659999999999998},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.48399999999999999,"15min":0.51800000000000002},"min":{"1min":0.39100000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.72599999999999998,"5min":1.0069999999999999,"15min":7.0819999999999999},"last":0.55900000000000005}]},{"osd":3,"last update":"Fri Oct 6 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54000000000000004,"15min":0.51700000000000002},"min":{"1min":0.34300000000000003,"5min":0.317,"15min":0.25800000000000001},"max":{"1min":0.67300000000000004,"5min":3.871,"15min":3.871},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.503,"5min":0.51100000000000001,"15min":0.53000000000000003},"min":{"1min":0.32100000000000001,"5min":0.316,"15min":0.312},"max":{"1min":0.69199999999999995,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.70999999999999996}]},{"osd":4,"last update":"Fri Oct 6 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.45600000000000002,"15min":0.48099999999999998},"min":{"1min":0.27400000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.65600000000000003,"5min":0.88,"15min":0.88},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51400000000000001,"15min":0.53600000000000003},"min":{"1min":0.29699999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.75700000000000001,"5min":0.82399999999999995,"15min":1.0680000000000001},"last":0.47299999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.499,"15min":0.51900000000000002},"min":{"1min":0.33000000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.78700000000000003,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.60699999999999998,"15min":0.58299999999999996},"min":{"1min":0.36499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.86699999999999999,"5min":7.1379999999999999,"15min":7.1379999999999999},"last":0.45400000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56899999999999995,"15min":0.56799999999999995},"min":{"1min":0.40999999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.73399999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55900000000000005,"15min":0.58599999999999997},"min":{"1min":0.374,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.77300000000000002,"5min":0.86899999999999999,"15min":0.88400000000000001},"last":0.53200000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574981,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311796,"kb_used_data":2220,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060044,"statfs":{"total":96636764160,"available":96317485056,"internally_reserved":0,"allocated":2273280,"data_stored":1359310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:57 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.45500000000000002,"15min":0.377},"min":{"1min":0.217,"5min":0.189,"15min":0.186},"max":{"1min":0.44,"5min":13.393000000000001,"15min":13.393000000000001},"last":0.37},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.45400000000000001,"15min":0.38400000000000001},"min":{"1min":0.22700000000000001,"5min":0.22500000000000001,"15min":0.19700000000000001},"max":{"1min":0.49299999999999999,"5min":11.462,"15min":11.462},"last":0.33900000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:15:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.40400000000000003,"15min":0.35999999999999999},"min":{"1min":0.248,"5min":0.216,"15min":0.216},"max":{"1min":0.49299999999999999,"5min":8.0470000000000006,"15min":8.0470000000000006},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.42799999999999999,"15min":0.40500000000000003},"min":{"1min":0.215,"5min":0.215,"15min":0.20999999999999999},"max":{"1min":0.59899999999999998,"5min":4.8630000000000004,"15min":4.8630000000000004},"last":0.41799999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:15:57 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.44700000000000001,"15min":0.42299999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.252},"max":{"1min":0.54000000000000004,"5min":4.8029999999999999,"15min":4.8029999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.42999999999999999,"15min":0.39300000000000002},"min":{"1min":0.27700000000000002,"5min":0.217,"15min":0.217},"max":{"1min":0.53900000000000003,"5min":5.8700000000000001,"15min":5.8700000000000001},"last":0.40200000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:15:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.50600000000000001,"15min":0.51700000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28199999999999997},"max":{"1min":0.81899999999999995,"5min":1.264,"15min":1.264},"last":0.498},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.60399999999999998,"15min":0.56799999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.84099999999999997,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.47799999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:15:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.58499999999999996,"15min":0.56599999999999995},"min":{"1min":0.378,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80500000000000005,"5min":3.4390000000000001,"15min":3.4390000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.65400000000000003,"15min":0.58699999999999997},"min":{"1min":0.39000000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.91500000000000004,"5min":9.3829999999999991,"15min":9.3829999999999991},"last":0.439}]},{"osd":6,"last update":"Fri Oct 6 11:15:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.61299999999999999,"15min":0.58499999999999996},"min":{"1min":0.43099999999999999,"5min":0.34999999999999998,"15min":0.315},"max":{"1min":0.86699999999999999,"5min":3.4750000000000001,"15min":3.4750000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60899999999999999,"15min":0.59399999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85799999999999998,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.38800000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:15:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.63300000000000001,"15min":0.60899999999999999},"min":{"1min":0.39800000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76100000000000001,"5min":4.7290000000000001,"15min":4.7290000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60499999999999998,"15min":0.59299999999999997},"min":{"1min":0.44,"5min":0.378,"15min":0.374},"max":{"1min":0.89200000000000002,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.48599999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574981,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303080,"kb_used_data":1696,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068760,"statfs":{"total":96636764160,"available":96326410240,"internally_reserved":0,"allocated":1736704,"data_stored":790176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:15:58 2023","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.41499999999999998,"15min":0.46600000000000003},"min":{"1min":0.20999999999999999,"5min":0.184,"15min":0.184},"max":{"1min":0.60199999999999998,"5min":8.4239999999999995,"15min":36.097999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.42999999999999999,"15min":0.378},"min":{"1min":0.23100000000000001,"5min":0.20799999999999999,"15min":0.182},"max":{"1min":0.92400000000000004,"5min":7.2990000000000004,"15min":7.2990000000000004},"last":0.30499999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:15:58 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.44400000000000001,"15min":0.503},"min":{"1min":0.22800000000000001,"5min":0.221,"15min":0.217},"max":{"1min":0.53500000000000003,"5min":8.6080000000000005,"15min":36.07},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.44800000000000001,"15min":0.40600000000000003},"min":{"1min":0.27200000000000002,"5min":0.23400000000000001,"15min":0.219},"max":{"1min":0.94899999999999995,"5min":6.7800000000000002,"15min":6.7800000000000002},"last":0.26800000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:15:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36299999999999999,"15min":0.39300000000000002},"min":{"1min":0.26300000000000001,"5min":0.22500000000000001,"15min":0.223},"max":{"1min":0.52000000000000002,"5min":1.863,"15min":8.4130000000000003},"last":0.315},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.499,"15min":0.55900000000000005},"min":{"1min":0.28199999999999997,"5min":0.249,"15min":0.249},"max":{"1min":1.9079999999999999,"5min":8.4570000000000007,"15min":35.959000000000003},"last":0.438}]},{"osd":4,"last update":"Fri Oct 6 11:15:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55700000000000005,"15min":0.56299999999999994},"min":{"1min":0.38800000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.72399999999999998,"5min":2.427,"15min":2.427},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.64600000000000002,"15min":0.72999999999999998},"min":{"1min":0.42399999999999999,"5min":0.34399999999999997,"15min":0.29299999999999998},"max":{"1min":0.748,"5min":8.2919999999999998,"15min":36.005000000000003},"last":0.5}]},{"osd":5,"last update":"Fri Oct 6 11:15:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.61599999999999999,"15min":0.57899999999999996},"min":{"1min":0.40000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.999,"5min":6.6699999999999999,"15min":6.6699999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.47799999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.76900000000000002,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.47999999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:15:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.65600000000000003,"15min":0.73099999999999998},"min":{"1min":0.39200000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.78800000000000003,"5min":8.2479999999999993,"15min":36.037999999999997},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.66200000000000003,"15min":0.63700000000000001},"min":{"1min":0.42899999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.028,"5min":6.7110000000000003,"15min":6.7110000000000003},"last":0.41299999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:15:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.65200000000000002,"15min":0.621},"min":{"1min":0.44900000000000001,"5min":0.371,"15min":0.371},"max":{"1min":1.054,"5min":6.742,"15min":6.742},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56799999999999995,"15min":0.56899999999999995},"min":{"1min":0.41399999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.69899999999999995,"5min":1.917,"15min":1.917},"last":0.42799999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574982,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298968,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072872,"statfs":{"total":96636764160,"available":96330620928,"internally_reserved":0,"allocated":1720320,"data_stored":788074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.30299999999999999,"15min":0.31},"min":{"1min":0.22900000000000001,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.41599999999999998,"5min":0.46300000000000002,"15min":0.57499999999999996},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.376,"15min":0.38200000000000001},"min":{"1min":0.28599999999999998,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.52800000000000002,"5min":0.55600000000000005,"15min":0.66300000000000003},"last":0.45500000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.36399999999999999,"15min":0.372},"min":{"1min":0.28100000000000003,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.48099999999999998,"5min":0.57499999999999996,"15min":0.745},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.34200000000000003,"15min":0.34999999999999998},"min":{"1min":0.247,"5min":0.216,"15min":0.216},"max":{"1min":0.437,"5min":0.52900000000000003,"15min":0.59399999999999997},"last":0.42799999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34599999999999997,"15min":0.36399999999999999},"min":{"1min":0.255,"5min":0.23300000000000001,"15min":0.23200000000000001},"max":{"1min":0.45300000000000001,"5min":0.57699999999999996,"15min":0.629},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.35799999999999998,"15min":0.36399999999999999},"min":{"1min":0.26600000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.64400000000000002},"last":0.47099999999999997}]},{"osd":4,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.503,"15min":0.52700000000000002},"min":{"1min":0.35799999999999998,"5min":0.30599999999999999,"15min":0.30299999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.51100000000000001,"15min":0.54400000000000004},"min":{"1min":0.36499999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.84899999999999998},"last":0.68400000000000005}]},{"osd":5,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.52400000000000002,"15min":0.54300000000000004},"min":{"1min":0.44700000000000001,"5min":0.33100000000000002,"15min":0.32400000000000001},"max":{"1min":0.77100000000000002,"5min":0.80400000000000005,"15min":0.86199999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.54100000000000004,"15min":0.55300000000000005},"min":{"1min":0.40600000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.84499999999999997,"5min":0.872,"15min":0.878},"last":0.77100000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56100000000000005,"15min":0.57899999999999996},"min":{"1min":0.46700000000000003,"5min":0.36799999999999999,"15min":0.32600000000000001},"max":{"1min":0.76200000000000001,"5min":0.84599999999999997,"15min":0.86299999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.55500000000000005,"15min":0.57299999999999995},"min":{"1min":0.44800000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80700000000000005,"5min":0.83499999999999996,"15min":0.88600000000000001},"last":0.69499999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54500000000000004,"15min":0.55800000000000005},"min":{"1min":0.41399999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79300000000000004,"5min":1.139,"15min":1.139},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55000000000000004,"15min":0.56699999999999995},"min":{"1min":0.42499999999999999,"5min":0.38800000000000001,"15min":0.38200000000000001},"max":{"1min":0.80600000000000005,"5min":0.89600000000000002,"15min":0.90500000000000003},"last":0.70499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574982,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307160,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064680,"statfs":{"total":96636764160,"available":96322232320,"internally_reserved":0,"allocated":1720320,"data_stored":788550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.32200000000000001,"15min":0.32300000000000001},"min":{"1min":0.224,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":2.2109999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.375},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.39100000000000001,"15min":0.39200000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.22700000000000001},"max":{"1min":4.4820000000000002,"5min":4.4820000000000002,"15min":4.4820000000000002},"last":0.34899999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.308,"15min":0.311},"min":{"1min":0.251,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.40500000000000003,"5min":0.54000000000000004,"15min":0.65400000000000003},"last":0.313},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.35599999999999998},"min":{"1min":0.27300000000000002,"5min":0.188,"15min":0.188},"max":{"1min":0.439,"5min":0.53100000000000003,"15min":1.196},"last":0.33000000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.38800000000000001,"15min":0.38500000000000001},"min":{"1min":0.245,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":4.601,"5min":4.601,"15min":4.601},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.41499999999999998,"15min":0.41699999999999998},"min":{"1min":0.29899999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.40400000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.50600000000000001,"15min":0.54700000000000004},"min":{"1min":0.39400000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.81799999999999995,"5min":0.88500000000000001,"15min":1.694},"last":0.5},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.51200000000000001,"15min":0.53700000000000003},"min":{"1min":0.32600000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.46500000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.51700000000000002,"15min":0.53100000000000003},"min":{"1min":0.34100000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.78100000000000003,"5min":0.86399999999999999,"15min":0.878},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52300000000000002,"15min":0.55200000000000005},"min":{"1min":0.35699999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.71099999999999997,"5min":0.746,"15min":1.165},"last":0.56000000000000005}]},{"osd":6,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54400000000000004,"15min":0.57699999999999996},"min":{"1min":0.42499999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76900000000000002,"5min":0.79200000000000004,"15min":1.1359999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.54600000000000004,"15min":0.58599999999999997},"min":{"1min":0.36799999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79100000000000004,"5min":0.82199999999999995,"15min":1.7470000000000001},"last":0.44500000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.54400000000000004,"15min":0.57599999999999996},"min":{"1min":0.42199999999999999,"5min":0.35699999999999998,"15min":0.35599999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":1.657},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55300000000000005,"15min":0.57099999999999995},"min":{"1min":0.40400000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.54600000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574980,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303012,"kb_used_data":1628,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068828,"statfs":{"total":96636764160,"available":96326479872,"internally_reserved":0,"allocated":1667072,"data_stored":762784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.45100000000000001,"15min":0.52400000000000002},"min":{"1min":0.26200000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.70799999999999996,"5min":0.82099999999999995,"15min":2.6619999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.47499999999999998,"15min":0.48999999999999999},"min":{"1min":0.29799999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.69099999999999995,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.41599999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:15:56 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47199999999999998,"15min":0.54500000000000004},"min":{"1min":0.28499999999999998,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.70499999999999996,"5min":1,"15min":2.8650000000000002},"last":0.505},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47399999999999998,"15min":0.55100000000000005},"min":{"1min":0.34000000000000002,"5min":0.26200000000000001,"15min":0.25800000000000001},"max":{"1min":0.67800000000000005,"5min":1.2869999999999999,"15min":2.7610000000000001},"last":0.43099999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:15:56 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48499999999999999,"15min":0.53400000000000003},"min":{"1min":0.312,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.73399999999999999,"5min":0.76000000000000001,"15min":1.6910000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54300000000000004,"15min":0.58299999999999996},"min":{"1min":0.38700000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.68000000000000005,"5min":0.93899999999999995,"15min":1.718},"last":0.59599999999999997}]},{"osd":3,"last update":"Fri Oct 6 11:15:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54900000000000004,"15min":0.59299999999999997},"min":{"1min":0.36699999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.71299999999999997,"5min":2.387,"15min":2.677},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.52200000000000002,"15min":0.52400000000000002},"min":{"1min":0.35599999999999998,"5min":0.29299999999999998,"15min":0.27500000000000002},"max":{"1min":0.69399999999999995,"5min":1.784,"15min":1.784},"last":0.66800000000000004}]},{"osd":5,"last update":"Fri Oct 6 11:15:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.47099999999999997,"15min":0.48399999999999999},"min":{"1min":0.33700000000000002,"5min":0.23499999999999999,"15min":0.23200000000000001},"max":{"1min":0.65700000000000003,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.621},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.48799999999999999,"15min":0.52400000000000002},"min":{"1min":0.29099999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.65900000000000003,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.71099999999999997}]},{"osd":6,"last update":"Fri Oct 6 11:15:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.502,"15min":0.52100000000000002},"min":{"1min":0.313,"5min":0.30499999999999999,"15min":0.252},"max":{"1min":0.83499999999999996,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53100000000000003,"15min":0.56200000000000006},"min":{"1min":0.38900000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.69399999999999995,"5min":0.85799999999999998,"15min":1.165},"last":0.68400000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:15:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54300000000000004,"15min":0.55700000000000005},"min":{"1min":0.36899999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.70199999999999996,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.55900000000000005,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.875,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.75900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574983,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311252,"kb_used_data":1676,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060588,"statfs":{"total":96636764160,"available":96318042112,"internally_reserved":0,"allocated":1716224,"data_stored":789315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.44700000000000001,"15min":0.58999999999999997},"min":{"1min":0.26200000000000001,"5min":0.23100000000000001,"15min":0.20499999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":5.0490000000000004},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.44900000000000001,"15min":0.56899999999999995},"min":{"1min":0.26600000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.66500000000000004,"5min":0.78100000000000003,"15min":5.1449999999999996},"last":0.61499999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.46100000000000002,"15min":0.48199999999999998},"min":{"1min":0.307,"5min":0.25,"15min":0.25},"max":{"1min":0.72999999999999998,"5min":0.81399999999999995,"15min":0.97199999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.47699999999999998,"15min":0.50900000000000001},"min":{"1min":0.35299999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":1.8799999999999999},"last":0.69299999999999995}]},{"osd":2,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.499,"15min":0.54600000000000004},"min":{"1min":0.313,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76600000000000001,"5min":0.79800000000000004,"15min":4.234},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.52500000000000002,"15min":0.55900000000000005},"min":{"1min":0.39800000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.747,"5min":0.81000000000000005,"15min":1.0369999999999999},"last":0.79200000000000004}]},{"osd":3,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.47999999999999998,"15min":0.60899999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.27700000000000002},"max":{"1min":0.72799999999999998,"5min":0.82299999999999995,"15min":5.2169999999999996},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.505,"15min":0.53900000000000003},"min":{"1min":0.32400000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":1.008},"last":0.42299999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.46999999999999997,"15min":0.50700000000000001},"min":{"1min":0.26400000000000001,"5min":0.25600000000000001,"15min":0.23999999999999999},"max":{"1min":0.78000000000000003,"5min":0.83399999999999996,"15min":1.917},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.46899999999999997,"15min":0.51800000000000002},"min":{"1min":0.251,"5min":0.24399999999999999,"15min":0.23899999999999999},"max":{"1min":0.68899999999999995,"5min":0.69199999999999995,"15min":0.87},"last":0.39500000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.49099999999999999,"15min":0.54600000000000004},"min":{"1min":0.32700000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":2.0139999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55400000000000005,"15min":0.59699999999999998},"min":{"1min":0.30299999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.80800000000000005,"5min":0.82899999999999996,"15min":1.9470000000000001},"last":0.72599999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.51600000000000001,"15min":0.56799999999999995},"min":{"1min":0.311,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.71999999999999997,"5min":0.81000000000000005,"15min":0.96499999999999997},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.54800000000000004,"15min":0.59599999999999997},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.28799999999999998},"max":{"1min":0.75600000000000001,"5min":0.77300000000000002,"15min":1.4119999999999999},"last":0.746}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:16:28.533 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:16:28.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.680+0000 7f0813666700 1 Processor -- start 2023-10-06T11:16:28.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.680+0000 7f0813666700 1 -- start start 2023-10-06T11:16:28.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.681+0000 7f0813666700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f080c153ab0 0x7f080c15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:28.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.681+0000 7f0813666700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f080c153e80 0x7f080c068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:28.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.681+0000 7f0813666700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f080c0689d0 0x7f080c15d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:28.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.681+0000 7f0813666700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f080c068e50 con 0x7f080c153e80 2023-10-06T11:16:28.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.681+0000 7f0813666700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f080c15ac30 con 0x7f080c0689d0 2023-10-06T11:16:28.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.681+0000 7f0813666700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f080c0b4510 con 0x7f080c153ab0 2023-10-06T11:16:28.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.681+0000 7f0810c01700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f080c153e80 0x7f080c068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:28.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.681+0000 7f0810c01700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f080c153e80 0x7f080c068490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49020/0 (socket says 172.21.15.146:49020) 2023-10-06T11:16:28.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.681+0000 7f0810c01700 1 -- 172.21.15.146:0/3543875635 learned_addr learned my addr 172.21.15.146:0/3543875635 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:28.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.681+0000 7f0811c03700 1 --2- 172.21.15.146:0/3543875635 >> v2:172.21.15.151:3300/0 conn(0x7f080c0689d0 0x7f080c15d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:28.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.681+0000 7f0811402700 1 --2- 172.21.15.146:0/3543875635 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f080c153ab0 0x7f080c15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:28.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.681+0000 7f0810c01700 1 -- 172.21.15.146:0/3543875635 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f080c153ab0 msgr2=0x7f080c15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:28.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.681+0000 7f0810c01700 1 --2- 172.21.15.146:0/3543875635 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f080c153ab0 0x7f080c15a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:28.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.681+0000 7f0810c01700 1 -- 172.21.15.146:0/3543875635 >> v2:172.21.15.151:3300/0 conn(0x7f080c0689d0 msgr2=0x7f080c15d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:28.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.681+0000 7f0810c01700 1 --2- 172.21.15.146:0/3543875635 >> v2:172.21.15.151:3300/0 conn(0x7f080c0689d0 0x7f080c15d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:28.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.681+0000 7f0810c01700 1 -- 172.21.15.146:0/3543875635 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f080c0b6530 con 0x7f080c153e80 2023-10-06T11:16:28.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.682+0000 7f0810c01700 1 --2- 172.21.15.146:0/3543875635 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f080c153e80 0x7f080c068490 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f080c089a80 tx=0x7f0800009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f57f190f03e2bf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:28.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.682+0000 7f080bfff700 1 -- 172.21.15.146:0/3543875635 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080000b640 con 0x7f080c153e80 2023-10-06T11:16:28.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.682+0000 7f080bfff700 1 -- 172.21.15.146:0/3543875635 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080000b7a0 con 0x7f080c153e80 2023-10-06T11:16:28.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.682+0000 7f080bfff700 1 -- 172.21.15.146:0/3543875635 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080000bb60 con 0x7f080c153e80 2023-10-06T11:16:28.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.682+0000 7f0813666700 1 -- 172.21.15.146:0/3543875635 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f080c153e80 msgr2=0x7f080c068490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:28.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.682+0000 7f0813666700 1 --2- 172.21.15.146:0/3543875635 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f080c153e80 0x7f080c068490 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f080c089a80 tx=0x7f0800009250 comp rx=0 tx=0).stop 2023-10-06T11:16:28.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.682+0000 7f0813666700 1 -- 172.21.15.146:0/3543875635 shutdown_connections 2023-10-06T11:16:28.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.682+0000 7f0813666700 1 --2- 172.21.15.146:0/3543875635 >> v2:172.21.15.151:3300/0 conn(0x7f080c0689d0 0x7f080c15d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:28.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.682+0000 7f0813666700 1 --2- 172.21.15.146:0/3543875635 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f080c153ab0 0x7f080c15a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:28.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.682+0000 7f0813666700 1 --2- 172.21.15.146:0/3543875635 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f080c153e80 0x7f080c068490 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:28.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.682+0000 7f0813666700 1 -- 172.21.15.146:0/3543875635 >> 172.21.15.146:0/3543875635 conn(0x7f080c06eba0 msgr2=0x7f080c06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:28.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.683+0000 7f0813666700 1 -- 172.21.15.146:0/3543875635 shutdown_connections 2023-10-06T11:16:28.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.683+0000 7f0813666700 1 -- 172.21.15.146:0/3543875635 wait complete. 2023-10-06T11:16:28.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.684+0000 7f0813666700 1 Processor -- start 2023-10-06T11:16:28.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.684+0000 7f0813666700 1 -- start start 2023-10-06T11:16:28.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.684+0000 7f0813666700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f080c0689d0 0x7f080c1585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:28.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.684+0000 7f0813666700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f080c153ab0 0x7f080c0b1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:28.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.685+0000 7f0813666700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f080c153e80 0x7f080c144cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:28.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.685+0000 7f0813666700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080c154320 con 0x7f080c153e80 2023-10-06T11:16:28.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.685+0000 7f0813666700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080c155140 con 0x7f080c153ab0 2023-10-06T11:16:28.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.685+0000 7f0813666700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f080c154530 con 0x7f080c0689d0 2023-10-06T11:16:28.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.685+0000 7f0811c03700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f080c153e80 0x7f080c144cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:28.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.685+0000 7f0811c03700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f080c153e80 0x7f080c144cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49022/0 (socket says 172.21.15.146:49022) 2023-10-06T11:16:28.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.685+0000 7f0811c03700 1 -- 172.21.15.146:0/2010128675 learned_addr learned my addr 172.21.15.146:0/2010128675 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:28.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.685+0000 7f0811402700 1 --2- 172.21.15.146:0/2010128675 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f080c0689d0 0x7f080c1585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:28.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.685+0000 7f0810c01700 1 --2- 172.21.15.146:0/2010128675 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f080c153ab0 0x7f080c0b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:28.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.685+0000 7f0811c03700 1 -- 172.21.15.146:0/2010128675 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f080c0689d0 msgr2=0x7f080c1585f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:28.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.685+0000 7f0811c03700 1 --2- 172.21.15.146:0/2010128675 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f080c0689d0 0x7f080c1585f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:28.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.685+0000 7f0811c03700 1 -- 172.21.15.146:0/2010128675 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f080c153ab0 msgr2=0x7f080c0b1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:28.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.685+0000 7f0811c03700 1 --2- 172.21.15.146:0/2010128675 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f080c153ab0 0x7f080c0b1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:28.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.685+0000 7f0811c03700 1 -- 172.21.15.146:0/2010128675 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08000094f0 con 0x7f080c153e80 2023-10-06T11:16:28.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.685+0000 7f0811c03700 1 --2- 172.21.15.146:0/2010128675 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f080c153e80 0x7f080c144cf0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f07fc00e8d0 tx=0x7f07fc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:28.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.685+0000 7f08097fa700 1 -- 172.21.15.146:0/2010128675 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07fc013680 con 0x7f080c153e80 2023-10-06T11:16:28.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.685+0000 7f08097fa700 1 -- 172.21.15.146:0/2010128675 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07fc0137e0 con 0x7f080c153e80 2023-10-06T11:16:28.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.685+0000 7f0813666700 1 -- 172.21.15.146:0/2010128675 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f080c154810 con 0x7f080c153e80 2023-10-06T11:16:28.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.685+0000 7f08097fa700 1 -- 172.21.15.146:0/2010128675 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07fc013ba0 con 0x7f080c153e80 2023-10-06T11:16:28.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.685+0000 7f0813666700 1 -- 172.21.15.146:0/2010128675 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f080c154dd0 con 0x7f080c153e80 2023-10-06T11:16:28.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.686+0000 7f0813666700 1 -- 172.21.15.146:0/2010128675 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f080c1552b0 con 0x7f080c153e80 2023-10-06T11:16:28.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.687+0000 7f08097fa700 1 -- 172.21.15.146:0/2010128675 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f07fc01c450 con 0x7f080c153e80 2023-10-06T11:16:28.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.687+0000 7f08097fa700 1 --2- 172.21.15.146:0/2010128675 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f07f8066f30 0x7f07f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:28.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.687+0000 7f08097fa700 1 -- 172.21.15.146:0/2010128675 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f07fc084ae0 con 0x7f080c153e80 2023-10-06T11:16:28.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.687+0000 7f0811402700 1 --2- 172.21.15.146:0/2010128675 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f07f8066f30 0x7f07f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:28.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.687+0000 7f0811402700 1 --2- 172.21.15.146:0/2010128675 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f07f8066f30 0x7f07f80693e0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f0804009fd0 tx=0x7f080400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:28.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.691+0000 7f08097fa700 1 -- 172.21.15.146:0/2010128675 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f07fc051bf0 con 0x7f080c153e80 2023-10-06T11:16:28.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.869+0000 7f0813666700 1 -- 172.21.15.146:0/2010128675 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f080c04c380 con 0x7f07f8066f30 2023-10-06T11:16:28.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.877+0000 7f08097fa700 1 -- 172.21.15.146:0/2010128675 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+307640 (secure 0 0 0) 0x7f080c04c380 con 0x7f07f8066f30 2023-10-06T11:16:28.882 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:16:28.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.881+0000 7f0813666700 1 -- 172.21.15.146:0/2010128675 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f07f8066f30 msgr2=0x7f07f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:28.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.881+0000 7f0813666700 1 --2- 172.21.15.146:0/2010128675 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f07f8066f30 0x7f07f80693e0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f0804009fd0 tx=0x7f080400b040 comp rx=0 tx=0).stop 2023-10-06T11:16:28.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.881+0000 7f0813666700 1 -- 172.21.15.146:0/2010128675 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f080c153e80 msgr2=0x7f080c144cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:28.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.881+0000 7f0813666700 1 --2- 172.21.15.146:0/2010128675 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f080c153e80 0x7f080c144cf0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f07fc00e8d0 tx=0x7f07fc0091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:28.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.881+0000 7f0813666700 1 -- 172.21.15.146:0/2010128675 shutdown_connections 2023-10-06T11:16:28.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.881+0000 7f0813666700 1 --2- 172.21.15.146:0/2010128675 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f07f8066f30 0x7f07f80693e0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:28.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.881+0000 7f0813666700 1 --2- 172.21.15.146:0/2010128675 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f080c153e80 0x7f080c144cf0 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:28.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.881+0000 7f0813666700 1 --2- 172.21.15.146:0/2010128675 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f080c0689d0 0x7f080c1585f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:28.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.881+0000 7f0813666700 1 --2- 172.21.15.146:0/2010128675 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f080c153ab0 0x7f080c0b1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:28.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.881+0000 7f0813666700 1 -- 172.21.15.146:0/2010128675 >> 172.21.15.146:0/2010128675 conn(0x7f080c06eba0 msgr2=0x7f080c0d0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:28.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.881+0000 7f0813666700 1 -- 172.21.15.146:0/2010128675 shutdown_connections 2023-10-06T11:16:28.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:28.881+0000 7f0813666700 1 -- 172.21.15.146:0/2010128675 wait complete. 2023-10-06T11:16:28.886 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:16:28.895 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":455,"stamp":"2023-10-06T11:16:27.278649+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592604,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":196,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":154,"acting":154,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":127,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2437824,"kb_used_data":14464,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752536896,"statfs":{"total":773094113280,"available":770597781504,"internally_reserved":0,"allocated":14811136,"data_stored":7419345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2236,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.194253"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.114163+0000","last_change":"2023-10-06T11:16:24.109016+0000","last_active":"2023-10-06T11:16:24.114163+0000","last_peered":"2023-10-06T11:16:24.114163+0000","last_clean":"2023-10-06T11:16:24.114163+0000","last_became_active":"2023-10-06T11:16:24.108230+0000","last_became_peered":"2023-10-06T11:16:24.108230+0000","last_unstale":"2023-10-06T11:16:24.114163+0000","last_undegraded":"2023-10-06T11:16:24.114163+0000","last_fullsized":"2023-10-06T11:16:24.114163+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:46:32.933025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.114773+0000","last_change":"2023-10-06T11:16:24.108647+0000","last_active":"2023-10-06T11:16:24.114773+0000","last_peered":"2023-10-06T11:16:24.114773+0000","last_clean":"2023-10-06T11:16:24.114773+0000","last_became_active":"2023-10-06T11:16:24.108417+0000","last_became_peered":"2023-10-06T11:16:24.108417+0000","last_unstale":"2023-10-06T11:16:24.114773+0000","last_undegraded":"2023-10-06T11:16:24.114773+0000","last_fullsized":"2023-10-06T11:16:24.114773+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:26:03.575635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116075+0000","last_change":"2023-10-06T11:16:24.108739+0000","last_active":"2023-10-06T11:16:24.116075+0000","last_peered":"2023-10-06T11:16:24.116075+0000","last_clean":"2023-10-06T11:16:24.116075+0000","last_became_active":"2023-10-06T11:16:24.108453+0000","last_became_peered":"2023-10-06T11:16:24.108453+0000","last_unstale":"2023-10-06T11:16:24.116075+0000","last_undegraded":"2023-10-06T11:16:24.116075+0000","last_fullsized":"2023-10-06T11:16:24.116075+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:59:45.901579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.120838+0000","last_change":"2023-10-06T11:16:24.115798+0000","last_active":"2023-10-06T11:16:24.120838+0000","last_peered":"2023-10-06T11:16:24.120838+0000","last_clean":"2023-10-06T11:16:24.120838+0000","last_became_active":"2023-10-06T11:16:24.115530+0000","last_became_peered":"2023-10-06T11:16:24.115530+0000","last_unstale":"2023-10-06T11:16:24.120838+0000","last_undegraded":"2023-10-06T11:16:24.120838+0000","last_fullsized":"2023-10-06T11:16:24.120838+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:26:32.565614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116267+0000","last_change":"2023-10-06T11:16:24.112144+0000","last_active":"2023-10-06T11:16:24.116267+0000","last_peered":"2023-10-06T11:16:24.116267+0000","last_clean":"2023-10-06T11:16:24.116267+0000","last_became_active":"2023-10-06T11:16:24.111426+0000","last_became_peered":"2023-10-06T11:16:24.111426+0000","last_unstale":"2023-10-06T11:16:24.116267+0000","last_undegraded":"2023-10-06T11:16:24.116267+0000","last_fullsized":"2023-10-06T11:16:24.116267+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:12:06.066982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116349+0000","last_change":"2023-10-06T11:16:24.113655+0000","last_active":"2023-10-06T11:16:24.116349+0000","last_peered":"2023-10-06T11:16:24.116349+0000","last_clean":"2023-10-06T11:16:24.116349+0000","last_became_active":"2023-10-06T11:16:24.113399+0000","last_became_peered":"2023-10-06T11:16:24.113399+0000","last_unstale":"2023-10-06T11:16:24.116349+0000","last_undegraded":"2023-10-06T11:16:24.116349+0000","last_fullsized":"2023-10-06T11:16:24.116349+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:50:16.146183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121936+0000","last_change":"2023-10-06T11:16:24.119814+0000","last_active":"2023-10-06T11:16:24.121936+0000","last_peered":"2023-10-06T11:16:24.121936+0000","last_clean":"2023-10-06T11:16:24.121936+0000","last_became_active":"2023-10-06T11:16:24.119316+0000","last_became_peered":"2023-10-06T11:16:24.119316+0000","last_unstale":"2023-10-06T11:16:24.121936+0000","last_undegraded":"2023-10-06T11:16:24.121936+0000","last_fullsized":"2023-10-06T11:16:24.121936+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:26.166829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116386+0000","last_change":"2023-10-06T11:16:24.113716+0000","last_active":"2023-10-06T11:16:24.116386+0000","last_peered":"2023-10-06T11:16:24.116386+0000","last_clean":"2023-10-06T11:16:24.116386+0000","last_became_active":"2023-10-06T11:16:24.113447+0000","last_became_peered":"2023-10-06T11:16:24.113447+0000","last_unstale":"2023-10-06T11:16:24.116386+0000","last_undegraded":"2023-10-06T11:16:24.116386+0000","last_fullsized":"2023-10-06T11:16:24.116386+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:28.023957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.106632+0000","last_change":"2023-10-06T11:16:24.103595+0000","last_active":"2023-10-06T11:16:24.106632+0000","last_peered":"2023-10-06T11:16:24.106632+0000","last_clean":"2023-10-06T11:16:24.106632+0000","last_became_active":"2023-10-06T11:16:24.103341+0000","last_became_peered":"2023-10-06T11:16:24.103341+0000","last_unstale":"2023-10-06T11:16:24.106632+0000","last_undegraded":"2023-10-06T11:16:24.106632+0000","last_fullsized":"2023-10-06T11:16:24.106632+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:30:19.278442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.120354+0000","last_change":"2023-10-06T11:16:24.107132+0000","last_active":"2023-10-06T11:16:24.120354+0000","last_peered":"2023-10-06T11:16:24.120354+0000","last_clean":"2023-10-06T11:16:24.120354+0000","last_became_active":"2023-10-06T11:16:24.106714+0000","last_became_peered":"2023-10-06T11:16:24.106714+0000","last_unstale":"2023-10-06T11:16:24.120354+0000","last_undegraded":"2023-10-06T11:16:24.120354+0000","last_fullsized":"2023-10-06T11:16:24.120354+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:08.737914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121851+0000","last_change":"2023-10-06T11:16:24.116978+0000","last_active":"2023-10-06T11:16:24.121851+0000","last_peered":"2023-10-06T11:16:24.121851+0000","last_clean":"2023-10-06T11:16:24.121851+0000","last_became_active":"2023-10-06T11:16:24.116483+0000","last_became_peered":"2023-10-06T11:16:24.116483+0000","last_unstale":"2023-10-06T11:16:24.121851+0000","last_undegraded":"2023-10-06T11:16:24.121851+0000","last_fullsized":"2023-10-06T11:16:24.121851+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:07.106736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.112359+0000","last_change":"2023-10-06T11:16:24.101538+0000","last_active":"2023-10-06T11:16:24.112359+0000","last_peered":"2023-10-06T11:16:24.112359+0000","last_clean":"2023-10-06T11:16:24.112359+0000","last_became_active":"2023-10-06T11:16:24.101276+0000","last_became_peered":"2023-10-06T11:16:24.101276+0000","last_unstale":"2023-10-06T11:16:24.112359+0000","last_undegraded":"2023-10-06T11:16:24.112359+0000","last_fullsized":"2023-10-06T11:16:24.112359+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:26:02.681339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.118962+0000","last_change":"2023-10-06T11:16:24.117423+0000","last_active":"2023-10-06T11:16:24.118962+0000","last_peered":"2023-10-06T11:16:24.118962+0000","last_clean":"2023-10-06T11:16:24.118962+0000","last_became_active":"2023-10-06T11:16:24.117137+0000","last_became_peered":"2023-10-06T11:16:24.117137+0000","last_unstale":"2023-10-06T11:16:24.118962+0000","last_undegraded":"2023-10-06T11:16:24.118962+0000","last_fullsized":"2023-10-06T11:16:24.118962+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:17.086479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.119950+0000","last_change":"2023-10-06T11:16:24.112281+0000","last_active":"2023-10-06T11:16:24.119950+0000","last_peered":"2023-10-06T11:16:24.119950+0000","last_clean":"2023-10-06T11:16:24.119950+0000","last_became_active":"2023-10-06T11:16:24.111821+0000","last_became_peered":"2023-10-06T11:16:24.111821+0000","last_unstale":"2023-10-06T11:16:24.119950+0000","last_undegraded":"2023-10-06T11:16:24.119950+0000","last_fullsized":"2023-10-06T11:16:24.119950+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:11.876870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.108707+0000","last_change":"2023-10-06T11:16:24.105272+0000","last_active":"2023-10-06T11:16:24.108707+0000","last_peered":"2023-10-06T11:16:24.108707+0000","last_clean":"2023-10-06T11:16:24.108707+0000","last_became_active":"2023-10-06T11:16:24.104836+0000","last_became_peered":"2023-10-06T11:16:24.104836+0000","last_unstale":"2023-10-06T11:16:24.108707+0000","last_undegraded":"2023-10-06T11:16:24.108707+0000","last_fullsized":"2023-10-06T11:16:24.108707+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:20:21.978391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.114191+0000","last_change":"2023-10-06T11:16:24.109203+0000","last_active":"2023-10-06T11:16:24.114191+0000","last_peered":"2023-10-06T11:16:24.114191+0000","last_clean":"2023-10-06T11:16:24.114191+0000","last_became_active":"2023-10-06T11:16:24.103632+0000","last_became_peered":"2023-10-06T11:16:24.103632+0000","last_unstale":"2023-10-06T11:16:24.114191+0000","last_undegraded":"2023-10-06T11:16:24.114191+0000","last_fullsized":"2023-10-06T11:16:24.114191+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:21:48.286337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.119621+0000","last_change":"2023-10-06T11:16:24.112055+0000","last_active":"2023-10-06T11:16:24.119621+0000","last_peered":"2023-10-06T11:16:24.119621+0000","last_clean":"2023-10-06T11:16:24.119621+0000","last_became_active":"2023-10-06T11:16:24.111459+0000","last_became_peered":"2023-10-06T11:16:24.111459+0000","last_unstale":"2023-10-06T11:16:24.119621+0000","last_undegraded":"2023-10-06T11:16:24.119621+0000","last_fullsized":"2023-10-06T11:16:24.119621+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:56:01.575492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116536+0000","last_change":"2023-10-06T11:16:24.114696+0000","last_active":"2023-10-06T11:16:24.116536+0000","last_peered":"2023-10-06T11:16:24.116536+0000","last_clean":"2023-10-06T11:16:24.116536+0000","last_became_active":"2023-10-06T11:16:24.114468+0000","last_became_peered":"2023-10-06T11:16:24.114468+0000","last_unstale":"2023-10-06T11:16:24.116536+0000","last_undegraded":"2023-10-06T11:16:24.116536+0000","last_fullsized":"2023-10-06T11:16:24.116536+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:29.132592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121795+0000","last_change":"2023-10-06T11:16:24.118093+0000","last_active":"2023-10-06T11:16:24.121795+0000","last_peered":"2023-10-06T11:16:24.121795+0000","last_clean":"2023-10-06T11:16:24.121795+0000","last_became_active":"2023-10-06T11:16:24.117790+0000","last_became_peered":"2023-10-06T11:16:24.117790+0000","last_unstale":"2023-10-06T11:16:24.121795+0000","last_undegraded":"2023-10-06T11:16:24.121795+0000","last_fullsized":"2023-10-06T11:16:24.121795+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:47:48.803032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121730+0000","last_change":"2023-10-06T11:16:24.118266+0000","last_active":"2023-10-06T11:16:24.121730+0000","last_peered":"2023-10-06T11:16:24.121730+0000","last_clean":"2023-10-06T11:16:24.121730+0000","last_became_active":"2023-10-06T11:16:24.118001+0000","last_became_peered":"2023-10-06T11:16:24.118001+0000","last_unstale":"2023-10-06T11:16:24.121730+0000","last_undegraded":"2023-10-06T11:16:24.121730+0000","last_fullsized":"2023-10-06T11:16:24.121730+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:59:42.744899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.107924+0000","last_change":"2023-10-06T11:16:24.103535+0000","last_active":"2023-10-06T11:16:24.107924+0000","last_peered":"2023-10-06T11:16:24.107924+0000","last_clean":"2023-10-06T11:16:24.107924+0000","last_became_active":"2023-10-06T11:16:24.103293+0000","last_became_peered":"2023-10-06T11:16:24.103293+0000","last_unstale":"2023-10-06T11:16:24.107924+0000","last_undegraded":"2023-10-06T11:16:24.107924+0000","last_fullsized":"2023-10-06T11:16:24.107924+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:10:53.231459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1f","version":"136'4","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.118823+0000","last_change":"2023-10-06T11:16:23.099064+0000","last_active":"2023-10-06T11:16:24.118823+0000","last_peered":"2023-10-06T11:16:24.118823+0000","last_clean":"2023-10-06T11:16:24.118823+0000","last_became_active":"2023-10-06T11:16:23.098801+0000","last_became_peered":"2023-10-06T11:16:23.098801+0000","last_unstale":"2023-10-06T11:16:24.118823+0000","last_undegraded":"2023-10-06T11:16:24.118823+0000","last_fullsized":"2023-10-06T11:16:24.118823+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:41:43.291967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"136'1","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121286+0000","last_change":"2023-10-06T11:16:23.104447+0000","last_active":"2023-10-06T11:16:24.121286+0000","last_peered":"2023-10-06T11:16:24.121286+0000","last_clean":"2023-10-06T11:16:24.121286+0000","last_became_active":"2023-10-06T11:16:23.104161+0000","last_became_peered":"2023-10-06T11:16:23.104161+0000","last_unstale":"2023-10-06T11:16:24.121286+0000","last_undegraded":"2023-10-06T11:16:24.121286+0000","last_fullsized":"2023-10-06T11:16:24.121286+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:56:00.571220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1d","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.123951+0000","last_change":"2023-10-06T11:16:23.104220+0000","last_active":"2023-10-06T11:16:24.123951+0000","last_peered":"2023-10-06T11:16:24.123951+0000","last_clean":"2023-10-06T11:16:24.123951+0000","last_became_active":"2023-10-06T11:16:23.103920+0000","last_became_peered":"2023-10-06T11:16:23.103920+0000","last_unstale":"2023-10-06T11:16:24.123951+0000","last_undegraded":"2023-10-06T11:16:24.123951+0000","last_fullsized":"2023-10-06T11:16:24.123951+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:50.360247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.122009+0000","last_change":"2023-10-06T11:16:24.118231+0000","last_active":"2023-10-06T11:16:24.122009+0000","last_peered":"2023-10-06T11:16:24.122009+0000","last_clean":"2023-10-06T11:16:24.122009+0000","last_became_active":"2023-10-06T11:16:24.117962+0000","last_became_peered":"2023-10-06T11:16:24.117962+0000","last_unstale":"2023-10-06T11:16:24.122009+0000","last_undegraded":"2023-10-06T11:16:24.122009+0000","last_fullsized":"2023-10-06T11:16:24.122009+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:34:42.484972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:22.074583+0000","last_change":"2023-10-06T11:16:22.089441+0000","last_active":"2023-10-06T11:16:22.074583+0000","last_peered":"2023-10-06T11:16:22.074583+0000","last_clean":"2023-10-06T11:16:22.074583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:22.074583+0000","last_undegraded":"2023-10-06T11:16:22.074583+0000","last_fullsized":"2023-10-06T11:16:22.074583+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:59.486245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.113203+0000","last_change":"2023-10-06T11:16:24.105810+0000","last_active":"2023-10-06T11:16:24.113203+0000","last_peered":"2023-10-06T11:16:24.113203+0000","last_clean":"2023-10-06T11:16:24.113203+0000","last_became_active":"2023-10-06T11:16:24.105537+0000","last_became_peered":"2023-10-06T11:16:24.105537+0000","last_unstale":"2023-10-06T11:16:24.113203+0000","last_undegraded":"2023-10-06T11:16:24.113203+0000","last_fullsized":"2023-10-06T11:16:24.113203+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:42:42.357861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:22.074583+0000","last_change":"2023-10-06T11:16:22.087560+0000","last_active":"2023-10-06T11:16:22.074583+0000","last_peered":"2023-10-06T11:16:22.074583+0000","last_clean":"2023-10-06T11:16:22.074583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:22.074583+0000","last_undegraded":"2023-10-06T11:16:22.074583+0000","last_fullsized":"2023-10-06T11:16:22.074583+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:34:43.602621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1a","version":"136'1","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116331+0000","last_change":"2023-10-06T11:16:23.099499+0000","last_active":"2023-10-06T11:16:24.116331+0000","last_peered":"2023-10-06T11:16:24.116331+0000","last_clean":"2023-10-06T11:16:24.116331+0000","last_became_active":"2023-10-06T11:16:23.099285+0000","last_became_peered":"2023-10-06T11:16:23.099285+0000","last_unstale":"2023-10-06T11:16:24.116331+0000","last_undegraded":"2023-10-06T11:16:24.116331+0000","last_fullsized":"2023-10-06T11:16:24.116331+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:56:00.571220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.095986+0000","last_change":"2023-10-06T11:16:23.100854+0000","last_active":"2023-10-06T11:16:24.095986+0000","last_peered":"2023-10-06T11:16:24.095986+0000","last_clean":"2023-10-06T11:16:24.095986+0000","last_became_active":"2023-10-06T11:16:23.100200+0000","last_became_peered":"2023-10-06T11:16:23.100200+0000","last_unstale":"2023-10-06T11:16:24.095986+0000","last_undegraded":"2023-10-06T11:16:24.095986+0000","last_fullsized":"2023-10-06T11:16:24.095986+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:22:40.220215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.107002+0000","last_change":"2023-10-06T11:16:24.104492+0000","last_active":"2023-10-06T11:16:24.107002+0000","last_peered":"2023-10-06T11:16:24.107002+0000","last_clean":"2023-10-06T11:16:24.107002+0000","last_became_active":"2023-10-06T11:16:24.104181+0000","last_became_peered":"2023-10-06T11:16:24.104181+0000","last_unstale":"2023-10-06T11:16:24.107002+0000","last_undegraded":"2023-10-06T11:16:24.107002+0000","last_fullsized":"2023-10-06T11:16:24.107002+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:55:36.589699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.098162+0000","last_change":"2023-10-06T11:16:23.097833+0000","last_active":"2023-10-06T11:16:24.098162+0000","last_peered":"2023-10-06T11:16:24.098162+0000","last_clean":"2023-10-06T11:16:24.098162+0000","last_became_active":"2023-10-06T11:16:23.097560+0000","last_became_peered":"2023-10-06T11:16:23.097560+0000","last_unstale":"2023-10-06T11:16:24.098162+0000","last_undegraded":"2023-10-06T11:16:24.098162+0000","last_fullsized":"2023-10-06T11:16:24.098162+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:01:05.784628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121995+0000","last_change":"2023-10-06T11:16:24.118160+0000","last_active":"2023-10-06T11:16:24.121995+0000","last_peered":"2023-10-06T11:16:24.121995+0000","last_clean":"2023-10-06T11:16:24.121995+0000","last_became_active":"2023-10-06T11:16:24.117892+0000","last_became_peered":"2023-10-06T11:16:24.117892+0000","last_unstale":"2023-10-06T11:16:24.121995+0000","last_undegraded":"2023-10-06T11:16:24.121995+0000","last_fullsized":"2023-10-06T11:16:24.121995+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:52.405684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"136'1","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121722+0000","last_change":"2023-10-06T11:16:23.100806+0000","last_active":"2023-10-06T11:16:24.121722+0000","last_peered":"2023-10-06T11:16:24.121722+0000","last_clean":"2023-10-06T11:16:24.121722+0000","last_became_active":"2023-10-06T11:16:23.099910+0000","last_became_peered":"2023-10-06T11:16:23.099910+0000","last_unstale":"2023-10-06T11:16:24.121722+0000","last_undegraded":"2023-10-06T11:16:24.121722+0000","last_fullsized":"2023-10-06T11:16:24.121722+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:21:56.372977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.119434+0000","last_change":"2023-10-06T11:16:24.115023+0000","last_active":"2023-10-06T11:16:24.119434+0000","last_peered":"2023-10-06T11:16:24.119434+0000","last_clean":"2023-10-06T11:16:24.119434+0000","last_became_active":"2023-10-06T11:16:24.114720+0000","last_became_peered":"2023-10-06T11:16:24.114720+0000","last_unstale":"2023-10-06T11:16:24.119434+0000","last_undegraded":"2023-10-06T11:16:24.119434+0000","last_fullsized":"2023-10-06T11:16:24.119434+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:19.593270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121773+0000","last_change":"2023-10-06T11:16:23.103494+0000","last_active":"2023-10-06T11:16:24.121773+0000","last_peered":"2023-10-06T11:16:24.121773+0000","last_clean":"2023-10-06T11:16:24.121773+0000","last_became_active":"2023-10-06T11:16:23.103217+0000","last_became_peered":"2023-10-06T11:16:23.103217+0000","last_unstale":"2023-10-06T11:16:24.121773+0000","last_undegraded":"2023-10-06T11:16:24.121773+0000","last_fullsized":"2023-10-06T11:16:24.121773+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:01:05.784628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.107033+0000","last_change":"2023-10-06T11:16:24.104031+0000","last_active":"2023-10-06T11:16:24.107033+0000","last_peered":"2023-10-06T11:16:24.107033+0000","last_clean":"2023-10-06T11:16:24.107033+0000","last_became_active":"2023-10-06T11:16:24.103748+0000","last_became_peered":"2023-10-06T11:16:24.103748+0000","last_unstale":"2023-10-06T11:16:24.107033+0000","last_undegraded":"2023-10-06T11:16:24.107033+0000","last_fullsized":"2023-10-06T11:16:24.107033+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:51.364520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:22.074583+0000","last_change":"2023-10-06T11:16:22.089897+0000","last_active":"2023-10-06T11:16:22.074583+0000","last_peered":"2023-10-06T11:16:22.074583+0000","last_clean":"2023-10-06T11:16:22.074583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:22.074583+0000","last_undegraded":"2023-10-06T11:16:22.074583+0000","last_fullsized":"2023-10-06T11:16:22.074583+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:10.613647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.119617+0000","last_change":"2023-10-06T11:16:24.114058+0000","last_active":"2023-10-06T11:16:24.119617+0000","last_peered":"2023-10-06T11:16:24.119617+0000","last_clean":"2023-10-06T11:16:24.119617+0000","last_became_active":"2023-10-06T11:16:24.111051+0000","last_became_peered":"2023-10-06T11:16:24.111051+0000","last_unstale":"2023-10-06T11:16:24.119617+0000","last_undegraded":"2023-10-06T11:16:24.119617+0000","last_fullsized":"2023-10-06T11:16:24.119617+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:46:59.369734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:22.074583+0000","last_change":"2023-10-06T11:16:22.091691+0000","last_active":"2023-10-06T11:16:22.074583+0000","last_peered":"2023-10-06T11:16:22.074583+0000","last_clean":"2023-10-06T11:16:22.074583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:22.074583+0000","last_undegraded":"2023-10-06T11:16:22.074583+0000","last_fullsized":"2023-10-06T11:16:22.074583+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:51:27.162572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121900+0000","last_change":"2023-10-06T11:16:24.116989+0000","last_active":"2023-10-06T11:16:24.121900+0000","last_peered":"2023-10-06T11:16:24.121900+0000","last_clean":"2023-10-06T11:16:24.121900+0000","last_became_active":"2023-10-06T11:16:24.116709+0000","last_became_peered":"2023-10-06T11:16:24.116709+0000","last_unstale":"2023-10-06T11:16:24.121900+0000","last_undegraded":"2023-10-06T11:16:24.121900+0000","last_fullsized":"2023-10-06T11:16:24.121900+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:37:37.920152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.118772+0000","last_change":"2023-10-06T11:16:23.094553+0000","last_active":"2023-10-06T11:16:24.118772+0000","last_peered":"2023-10-06T11:16:24.118772+0000","last_clean":"2023-10-06T11:16:24.118772+0000","last_became_active":"2023-10-06T11:16:23.094319+0000","last_became_peered":"2023-10-06T11:16:23.094319+0000","last_unstale":"2023-10-06T11:16:24.118772+0000","last_undegraded":"2023-10-06T11:16:24.118772+0000","last_fullsized":"2023-10-06T11:16:24.118772+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:28.128320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:22.074583+0000","last_change":"2023-10-06T11:16:22.087428+0000","last_active":"2023-10-06T11:16:22.074583+0000","last_peered":"2023-10-06T11:16:22.074583+0000","last_clean":"2023-10-06T11:16:22.074583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:22.074583+0000","last_undegraded":"2023-10-06T11:16:22.074583+0000","last_fullsized":"2023-10-06T11:16:22.074583+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:23:31.995315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.123888+0000","last_change":"2023-10-06T11:16:24.122010+0000","last_active":"2023-10-06T11:16:24.123888+0000","last_peered":"2023-10-06T11:16:24.123888+0000","last_clean":"2023-10-06T11:16:24.123888+0000","last_became_active":"2023-10-06T11:16:24.121668+0000","last_became_peered":"2023-10-06T11:16:24.121668+0000","last_unstale":"2023-10-06T11:16:24.123888+0000","last_undegraded":"2023-10-06T11:16:24.123888+0000","last_fullsized":"2023-10-06T11:16:24.123888+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:48.961124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.101790+0000","last_change":"2023-10-06T11:16:23.094432+0000","last_active":"2023-10-06T11:16:24.101790+0000","last_peered":"2023-10-06T11:16:24.101790+0000","last_clean":"2023-10-06T11:16:24.101790+0000","last_became_active":"2023-10-06T11:16:23.094187+0000","last_became_peered":"2023-10-06T11:16:23.094187+0000","last_unstale":"2023-10-06T11:16:24.101790+0000","last_undegraded":"2023-10-06T11:16:24.101790+0000","last_fullsized":"2023-10-06T11:16:24.101790+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:10:52.227186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:22.074583+0000","last_change":"2023-10-06T11:16:22.087660+0000","last_active":"2023-10-06T11:16:22.074583+0000","last_peered":"2023-10-06T11:16:22.074583+0000","last_clean":"2023-10-06T11:16:22.074583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:22.074583+0000","last_undegraded":"2023-10-06T11:16:22.074583+0000","last_fullsized":"2023-10-06T11:16:22.074583+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:29:00.300634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116082+0000","last_change":"2023-10-06T11:16:24.108869+0000","last_active":"2023-10-06T11:16:24.116082+0000","last_peered":"2023-10-06T11:16:24.116082+0000","last_clean":"2023-10-06T11:16:24.116082+0000","last_became_active":"2023-10-06T11:16:24.108622+0000","last_became_peered":"2023-10-06T11:16:24.108622+0000","last_unstale":"2023-10-06T11:16:24.116082+0000","last_undegraded":"2023-10-06T11:16:24.116082+0000","last_fullsized":"2023-10-06T11:16:24.116082+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:52.405684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:22.074583+0000","last_change":"2023-10-06T11:16:22.090769+0000","last_active":"2023-10-06T11:16:22.074583+0000","last_peered":"2023-10-06T11:16:22.074583+0000","last_clean":"2023-10-06T11:16:22.074583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:22.074583+0000","last_undegraded":"2023-10-06T11:16:22.074583+0000","last_fullsized":"2023-10-06T11:16:22.074583+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:10:03.275656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.098101+0000","last_change":"2023-10-06T11:16:23.103805+0000","last_active":"2023-10-06T11:16:24.098101+0000","last_peered":"2023-10-06T11:16:24.098101+0000","last_clean":"2023-10-06T11:16:24.098101+0000","last_became_active":"2023-10-06T11:16:23.103470+0000","last_became_peered":"2023-10-06T11:16:23.103470+0000","last_unstale":"2023-10-06T11:16:24.098101+0000","last_undegraded":"2023-10-06T11:16:24.098101+0000","last_fullsized":"2023-10-06T11:16:24.098101+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:56:40.401445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.107051+0000","last_change":"2023-10-06T11:16:24.104047+0000","last_active":"2023-10-06T11:16:24.107051+0000","last_peered":"2023-10-06T11:16:24.107051+0000","last_clean":"2023-10-06T11:16:24.107051+0000","last_became_active":"2023-10-06T11:16:24.103777+0000","last_became_peered":"2023-10-06T11:16:24.103777+0000","last_unstale":"2023-10-06T11:16:24.107051+0000","last_undegraded":"2023-10-06T11:16:24.107051+0000","last_fullsized":"2023-10-06T11:16:24.107051+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:01:06.788901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:22.074583+0000","last_change":"2023-10-06T11:16:22.089457+0000","last_active":"2023-10-06T11:16:22.074583+0000","last_peered":"2023-10-06T11:16:22.074583+0000","last_clean":"2023-10-06T11:16:22.074583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:22.074583+0000","last_undegraded":"2023-10-06T11:16:22.074583+0000","last_fullsized":"2023-10-06T11:16:22.074583+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:35:26.467632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116127+0000","last_change":"2023-10-06T11:16:24.109597+0000","last_active":"2023-10-06T11:16:24.116127+0000","last_peered":"2023-10-06T11:16:24.116127+0000","last_clean":"2023-10-06T11:16:24.116127+0000","last_became_active":"2023-10-06T11:16:24.109315+0000","last_became_peered":"2023-10-06T11:16:24.109315+0000","last_unstale":"2023-10-06T11:16:24.116127+0000","last_undegraded":"2023-10-06T11:16:24.116127+0000","last_fullsized":"2023-10-06T11:16:24.116127+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:02.452752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.098576+0000","last_change":"2023-10-06T11:16:23.102516+0000","last_active":"2023-10-06T11:16:24.098576+0000","last_peered":"2023-10-06T11:16:24.098576+0000","last_clean":"2023-10-06T11:16:24.098576+0000","last_became_active":"2023-10-06T11:16:23.102238+0000","last_became_peered":"2023-10-06T11:16:23.102238+0000","last_unstale":"2023-10-06T11:16:24.098576+0000","last_undegraded":"2023-10-06T11:16:24.098576+0000","last_fullsized":"2023-10-06T11:16:24.098576+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:50.360247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.095562+0000","last_change":"2023-10-06T11:16:23.095758+0000","last_active":"2023-10-06T11:16:24.095562+0000","last_peered":"2023-10-06T11:16:24.095562+0000","last_clean":"2023-10-06T11:16:24.095562+0000","last_became_active":"2023-10-06T11:16:23.095515+0000","last_became_peered":"2023-10-06T11:16:23.095515+0000","last_unstale":"2023-10-06T11:16:24.095562+0000","last_undegraded":"2023-10-06T11:16:24.095562+0000","last_fullsized":"2023-10-06T11:16:24.095562+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:23:31.995315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.104780+0000","last_change":"2023-10-06T11:16:23.095211+0000","last_active":"2023-10-06T11:16:24.104780+0000","last_peered":"2023-10-06T11:16:24.104780+0000","last_clean":"2023-10-06T11:16:24.104780+0000","last_became_active":"2023-10-06T11:16:23.094924+0000","last_became_peered":"2023-10-06T11:16:23.094924+0000","last_unstale":"2023-10-06T11:16:24.104780+0000","last_undegraded":"2023-10-06T11:16:24.104780+0000","last_fullsized":"2023-10-06T11:16:24.104780+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:10:17.504059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.096094+0000","last_change":"2023-10-06T11:16:23.098284+0000","last_active":"2023-10-06T11:16:24.096094+0000","last_peered":"2023-10-06T11:16:24.096094+0000","last_clean":"2023-10-06T11:16:24.096094+0000","last_became_active":"2023-10-06T11:16:23.098000+0000","last_became_peered":"2023-10-06T11:16:23.098000+0000","last_unstale":"2023-10-06T11:16:24.096094+0000","last_undegraded":"2023-10-06T11:16:24.096094+0000","last_fullsized":"2023-10-06T11:16:24.096094+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:13:24.765345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.104935+0000","last_change":"2023-10-06T11:16:23.101344+0000","last_active":"2023-10-06T11:16:24.104935+0000","last_peered":"2023-10-06T11:16:24.104935+0000","last_clean":"2023-10-06T11:16:24.104935+0000","last_became_active":"2023-10-06T11:16:23.101075+0000","last_became_peered":"2023-10-06T11:16:23.101075+0000","last_unstale":"2023-10-06T11:16:24.104935+0000","last_undegraded":"2023-10-06T11:16:24.104935+0000","last_fullsized":"2023-10-06T11:16:24.104935+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:17:34.910126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.111925+0000","last_change":"2023-10-06T11:16:24.107101+0000","last_active":"2023-10-06T11:16:24.111925+0000","last_peered":"2023-10-06T11:16:24.111925+0000","last_clean":"2023-10-06T11:16:24.111925+0000","last_became_active":"2023-10-06T11:16:24.106838+0000","last_became_peered":"2023-10-06T11:16:24.106838+0000","last_unstale":"2023-10-06T11:16:24.111925+0000","last_undegraded":"2023-10-06T11:16:24.111925+0000","last_fullsized":"2023-10-06T11:16:24.111925+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:52:28.634794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:22.074583+0000","last_change":"2023-10-06T11:16:22.089284+0000","last_active":"2023-10-06T11:16:22.074583+0000","last_peered":"2023-10-06T11:16:22.074583+0000","last_clean":"2023-10-06T11:16:22.074583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:22.074583+0000","last_undegraded":"2023-10-06T11:16:22.074583+0000","last_fullsized":"2023-10-06T11:16:22.074583+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:23:45.097185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":117,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T11:16:19.070220+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:16:19.070220+0000","last_peered":"2023-10-06T11:16:19.070220+0000","last_clean":"2023-10-06T11:16:19.070220+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:16:19.070220+0000","last_undegraded":"2023-10-06T11:16:19.070220+0000","last_fullsized":"2023-10-06T11:16:19.070220+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.10","version":"136'8","reported_seq":18,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.126509+0000","last_change":"2023-10-06T11:16:23.100992+0000","last_active":"2023-10-06T11:16:24.126509+0000","last_peered":"2023-10-06T11:16:24.126509+0000","last_clean":"2023-10-06T11:16:24.126509+0000","last_became_active":"2023-10-06T11:16:23.100717+0000","last_became_peered":"2023-10-06T11:16:23.100717+0000","last_unstale":"2023-10-06T11:16:24.126509+0000","last_undegraded":"2023-10-06T11:16:24.126509+0000","last_fullsized":"2023-10-06T11:16:24.126509+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:10.613647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":112,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.098652+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:16:24.098652+0000","last_peered":"2023-10-06T11:16:24.098652+0000","last_clean":"2023-10-06T11:16:24.098652+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:16:24.098652+0000","last_undegraded":"2023-10-06T11:16:24.098652+0000","last_fullsized":"2023-10-06T11:16:24.098652+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.107394+0000","last_change":"2023-10-06T11:16:23.100682+0000","last_active":"2023-10-06T11:16:24.107394+0000","last_peered":"2023-10-06T11:16:24.107394+0000","last_clean":"2023-10-06T11:16:24.107394+0000","last_became_active":"2023-10-06T11:16:23.099315+0000","last_became_peered":"2023-10-06T11:16:23.099315+0000","last_unstale":"2023-10-06T11:16:24.107394+0000","last_undegraded":"2023-10-06T11:16:24.107394+0000","last_fullsized":"2023-10-06T11:16:24.107394+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:26:31.561341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":106,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T11:16:19.072895+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:16:19.072895+0000","last_peered":"2023-10-06T11:16:19.072895+0000","last_clean":"2023-10-06T11:16:19.072895+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:16:19.072895+0000","last_undegraded":"2023-10-06T11:16:19.072895+0000","last_fullsized":"2023-10-06T11:16:19.072895+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":255,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.105025+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:16:24.105025+0000","last_peered":"2023-10-06T11:16:24.105025+0000","last_clean":"2023-10-06T11:16:24.105025+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:16:24.105025+0000","last_undegraded":"2023-10-06T11:16:24.105025+0000","last_fullsized":"2023-10-06T11:16:24.105025+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121988+0000","last_change":"2023-10-06T11:16:24.120168+0000","last_active":"2023-10-06T11:16:24.121988+0000","last_peered":"2023-10-06T11:16:24.121988+0000","last_clean":"2023-10-06T11:16:24.121988+0000","last_became_active":"2023-10-06T11:16:24.119797+0000","last_became_peered":"2023-10-06T11:16:24.119797+0000","last_unstale":"2023-10-06T11:16:24.121988+0000","last_undegraded":"2023-10-06T11:16:24.121988+0000","last_fullsized":"2023-10-06T11:16:24.121988+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:04:48.357935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.098212+0000","last_change":"2023-10-06T11:16:23.098273+0000","last_active":"2023-10-06T11:16:24.098212+0000","last_peered":"2023-10-06T11:16:24.098212+0000","last_clean":"2023-10-06T11:16:24.098212+0000","last_became_active":"2023-10-06T11:16:23.097970+0000","last_became_peered":"2023-10-06T11:16:23.097970+0000","last_unstale":"2023-10-06T11:16:24.098212+0000","last_undegraded":"2023-10-06T11:16:24.098212+0000","last_fullsized":"2023-10-06T11:16:24.098212+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:29.555606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":105,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.106284+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:16:24.106284+0000","last_peered":"2023-10-06T11:16:24.106284+0000","last_clean":"2023-10-06T11:16:24.106284+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:16:24.106284+0000","last_undegraded":"2023-10-06T11:16:24.106284+0000","last_fullsized":"2023-10-06T11:16:24.106284+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.14","version":"136'6","reported_seq":16,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.126641+0000","last_change":"2023-10-06T11:16:23.095177+0000","last_active":"2023-10-06T11:16:24.126641+0000","last_peered":"2023-10-06T11:16:24.126641+0000","last_clean":"2023-10-06T11:16:24.126641+0000","last_became_active":"2023-10-06T11:16:23.094700+0000","last_became_peered":"2023-10-06T11:16:23.094700+0000","last_unstale":"2023-10-06T11:16:24.126641+0000","last_undegraded":"2023-10-06T11:16:24.126641+0000","last_fullsized":"2023-10-06T11:16:24.126641+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:16.082206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":105,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.105115+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:16:24.105115+0000","last_peered":"2023-10-06T11:16:24.105115+0000","last_clean":"2023-10-06T11:16:24.105115+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:16:24.105115+0000","last_undegraded":"2023-10-06T11:16:24.105115+0000","last_fullsized":"2023-10-06T11:16:24.105115+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.120333+0000","last_change":"2023-10-06T11:16:24.106952+0000","last_active":"2023-10-06T11:16:24.120333+0000","last_peered":"2023-10-06T11:16:24.120333+0000","last_clean":"2023-10-06T11:16:24.120333+0000","last_became_active":"2023-10-06T11:16:24.106431+0000","last_became_peered":"2023-10-06T11:16:24.106431+0000","last_unstale":"2023-10-06T11:16:24.120333+0000","last_undegraded":"2023-10-06T11:16:24.120333+0000","last_fullsized":"2023-10-06T11:16:24.120333+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:59:53.565267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"136'3","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121884+0000","last_change":"2023-10-06T11:16:23.091484+0000","last_active":"2023-10-06T11:16:24.121884+0000","last_peered":"2023-10-06T11:16:24.121884+0000","last_clean":"2023-10-06T11:16:24.121884+0000","last_became_active":"2023-10-06T11:16:23.090228+0000","last_became_peered":"2023-10-06T11:16:23.090228+0000","last_unstale":"2023-10-06T11:16:24.121884+0000","last_undegraded":"2023-10-06T11:16:24.121884+0000","last_fullsized":"2023-10-06T11:16:24.121884+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:05:24.455055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":126,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.096193+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:16:24.096193+0000","last_peered":"2023-10-06T11:16:24.096193+0000","last_clean":"2023-10-06T11:16:24.096193+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:16:24.096193+0000","last_undegraded":"2023-10-06T11:16:24.096193+0000","last_fullsized":"2023-10-06T11:16:24.096193+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:16:22.074583+0000","last_change":"2023-10-06T11:16:22.089652+0000","last_active":"2023-10-06T11:16:22.074583+0000","last_peered":"2023-10-06T11:16:22.074583+0000","last_clean":"2023-10-06T11:16:22.074583+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:22.074583+0000","last_undegraded":"2023-10-06T11:16:22.074583+0000","last_fullsized":"2023-10-06T11:16:22.074583+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:35:44.567263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":109,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T11:16:19.512167+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:16:19.512167+0000","last_peered":"2023-10-06T11:16:19.512167+0000","last_clean":"2023-10-06T11:16:19.512167+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:16:19.512167+0000","last_undegraded":"2023-10-06T11:16:19.512167+0000","last_fullsized":"2023-10-06T11:16:19.512167+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:16:23.078855+0000","last_change":"2023-10-06T11:16:23.078855+0000","last_active":"2023-10-06T11:16:23.078855+0000","last_peered":"2023-10-06T11:16:23.078855+0000","last_clean":"2023-10-06T11:16:23.078855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:16:23.078855+0000","last_undegraded":"2023-10-06T11:16:23.078855+0000","last_fullsized":"2023-10-06T11:16:23.078855+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.13","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.117964+0000","last_change":"2023-10-06T11:16:23.099218+0000","last_active":"2023-10-06T11:16:24.117964+0000","last_peered":"2023-10-06T11:16:24.117964+0000","last_clean":"2023-10-06T11:16:24.117964+0000","last_became_active":"2023-10-06T11:16:23.098941+0000","last_became_peered":"2023-10-06T11:16:23.098941+0000","last_unstale":"2023-10-06T11:16:24.117964+0000","last_undegraded":"2023-10-06T11:16:24.117964+0000","last_fullsized":"2023-10-06T11:16:24.117964+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:46:58.365462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":109,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-10-06T11:16:19.512196+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:16:19.512196+0000","last_peered":"2023-10-06T11:16:19.512196+0000","last_clean":"2023-10-06T11:16:19.512196+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:16:19.512196+0000","last_undegraded":"2023-10-06T11:16:19.512196+0000","last_fullsized":"2023-10-06T11:16:19.512196+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2236,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":64,"acting":64,"num_store_stats":8},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":72,"acting":72,"num_store_stats":5},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574981,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303644,"kb_used_data":2260,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068196,"statfs":{"total":96636764160,"available":96325832704,"internally_reserved":0,"allocated":2314240,"data_stored":1379705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51200000000000001,"15min":0.625},"min":{"1min":0.30299999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.68899999999999995,"5min":4.407,"15min":23.908999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.48499999999999999,"15min":0.57399999999999995},"min":{"1min":0.313,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.68300000000000005,"5min":0.69799999999999995,"15min":9.3230000000000004},"last":0.42399999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51000000000000001,"15min":0.55900000000000005},"min":{"1min":0.35299999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.71499999999999997,"5min":2.4689999999999999,"15min":9.2360000000000007},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.47299999999999998,"15min":0.503},"min":{"1min":0.373,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.64400000000000002,"5min":0.78900000000000003,"15min":4.327},"last":0.40999999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54000000000000004,"15min":0.51700000000000002},"min":{"1min":0.39900000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.63500000000000001,"5min":4.3120000000000003,"15min":4.3120000000000003},"last":0.442},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53600000000000003,"15min":0.55700000000000005},"min":{"1min":0.34799999999999998,"5min":0.31,"15min":0.29999999999999999},"max":{"1min":0.70699999999999996,"5min":3.0600000000000001,"15min":4.7309999999999999},"last":0.376}]},{"osd":3,"last update":"Fri Oct 6 11:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54600000000000004,"15min":0.53900000000000003},"min":{"1min":0.36499999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.72099999999999997,"5min":4.5190000000000001,"15min":4.5190000000000001},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56100000000000005,"15min":0.59899999999999998},"min":{"1min":0.38100000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.74099999999999999,"5min":3.0070000000000001,"15min":9.3879999999999999},"last":0.498}]},{"osd":4,"last update":"Fri Oct 6 11:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.502,"15min":0.48999999999999999},"min":{"1min":0.32800000000000001,"5min":0.26000000000000001,"15min":0.24399999999999999},"max":{"1min":0.68700000000000006,"5min":4.6639999999999997,"15min":4.6639999999999997},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.53600000000000003},"min":{"1min":0.33300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.78200000000000003,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":0.48599999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.51200000000000001,"15min":0.56100000000000005},"min":{"1min":0.33900000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":9.3499999999999996},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.5,"15min":0.54200000000000004},"min":{"1min":0.377,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.74299999999999999,"5min":0.83399999999999996,"15min":4.444},"last":0.54700000000000004}]},{"osd":6,"last update":"Fri Oct 6 11:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.53800000000000003,"15min":0.59699999999999998},"min":{"1min":0.41499999999999998,"5min":0.32400000000000001,"15min":0.29199999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":9.4969999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60899999999999999,"15min":0.62},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.85799999999999998,"5min":4.4669999999999996,"15min":7.2039999999999997},"last":0.52200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574982,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298912,"kb_used_data":1624,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072928,"statfs":{"total":96636764160,"available":96330678272,"internally_reserved":0,"allocated":1662976,"data_stored":761431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.56299999999999994,"15min":0.52000000000000002},"min":{"1min":0.254,"5min":0.187,"15min":0.187},"max":{"1min":0.66400000000000003,"5min":9.5549999999999997,"15min":9.5549999999999997},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.63300000000000001,"15min":0.56399999999999995},"min":{"1min":0.30399999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.73999999999999999,"5min":9.4659999999999993,"15min":9.4659999999999993},"last":0.65200000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46100000000000002,"15min":0.48299999999999998},"min":{"1min":0.27500000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.68000000000000005,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.56000000000000005,"15min":0.51500000000000001},"min":{"1min":0.34399999999999997,"5min":0.216,"15min":0.216},"max":{"1min":0.71499999999999997,"5min":5.2670000000000003,"15min":5.2670000000000003},"last":0.61299999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.46600000000000003,"15min":0.499},"min":{"1min":0.29399999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.65800000000000003,"5min":0.93200000000000005,"15min":7.0659999999999998},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.48399999999999999,"15min":0.51800000000000002},"min":{"1min":0.39100000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.72599999999999998,"5min":1.0069999999999999,"15min":7.0819999999999999},"last":0.55900000000000005}]},{"osd":3,"last update":"Fri Oct 6 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54000000000000004,"15min":0.51700000000000002},"min":{"1min":0.34300000000000003,"5min":0.317,"15min":0.25800000000000001},"max":{"1min":0.67300000000000004,"5min":3.871,"15min":3.871},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.503,"5min":0.51100000000000001,"15min":0.53000000000000003},"min":{"1min":0.32100000000000001,"5min":0.316,"15min":0.312},"max":{"1min":0.69199999999999995,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.70999999999999996}]},{"osd":4,"last update":"Fri Oct 6 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.45600000000000002,"15min":0.48099999999999998},"min":{"1min":0.27400000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.65600000000000003,"5min":0.88,"15min":0.88},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51400000000000001,"15min":0.53600000000000003},"min":{"1min":0.29699999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.75700000000000001,"5min":0.82399999999999995,"15min":1.0680000000000001},"last":0.47299999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.499,"15min":0.51900000000000002},"min":{"1min":0.33000000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.78700000000000003,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.60699999999999998,"15min":0.58299999999999996},"min":{"1min":0.36499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.86699999999999999,"5min":7.1379999999999999,"15min":7.1379999999999999},"last":0.45400000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56899999999999995,"15min":0.56799999999999995},"min":{"1min":0.40999999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.73399999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55900000000000005,"15min":0.58599999999999997},"min":{"1min":0.374,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.77300000000000002,"5min":0.86899999999999999,"15min":0.88400000000000001},"last":0.53200000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574981,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311796,"kb_used_data":2220,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060044,"statfs":{"total":96636764160,"available":96317485056,"internally_reserved":0,"allocated":2273280,"data_stored":1359310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:57 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.45500000000000002,"15min":0.377},"min":{"1min":0.217,"5min":0.189,"15min":0.186},"max":{"1min":0.44,"5min":13.393000000000001,"15min":13.393000000000001},"last":0.37},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.45400000000000001,"15min":0.38400000000000001},"min":{"1min":0.22700000000000001,"5min":0.22500000000000001,"15min":0.19700000000000001},"max":{"1min":0.49299999999999999,"5min":11.462,"15min":11.462},"last":0.33900000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:15:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.40400000000000003,"15min":0.35999999999999999},"min":{"1min":0.248,"5min":0.216,"15min":0.216},"max":{"1min":0.49299999999999999,"5min":8.0470000000000006,"15min":8.0470000000000006},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.42799999999999999,"15min":0.40500000000000003},"min":{"1min":0.215,"5min":0.215,"15min":0.20999999999999999},"max":{"1min":0.59899999999999998,"5min":4.8630000000000004,"15min":4.8630000000000004},"last":0.41799999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:15:57 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.44700000000000001,"15min":0.42299999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.252},"max":{"1min":0.54000000000000004,"5min":4.8029999999999999,"15min":4.8029999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.42999999999999999,"15min":0.39300000000000002},"min":{"1min":0.27700000000000002,"5min":0.217,"15min":0.217},"max":{"1min":0.53900000000000003,"5min":5.8700000000000001,"15min":5.8700000000000001},"last":0.40200000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:15:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.50600000000000001,"15min":0.51700000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28199999999999997},"max":{"1min":0.81899999999999995,"5min":1.264,"15min":1.264},"last":0.498},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.60399999999999998,"15min":0.56799999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.84099999999999997,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.47799999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:15:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.58499999999999996,"15min":0.56599999999999995},"min":{"1min":0.378,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80500000000000005,"5min":3.4390000000000001,"15min":3.4390000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.65400000000000003,"15min":0.58699999999999997},"min":{"1min":0.39000000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.91500000000000004,"5min":9.3829999999999991,"15min":9.3829999999999991},"last":0.439}]},{"osd":6,"last update":"Fri Oct 6 11:15:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.61299999999999999,"15min":0.58499999999999996},"min":{"1min":0.43099999999999999,"5min":0.34999999999999998,"15min":0.315},"max":{"1min":0.86699999999999999,"5min":3.4750000000000001,"15min":3.4750000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60899999999999999,"15min":0.59399999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85799999999999998,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.38800000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:15:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.63300000000000001,"15min":0.60899999999999999},"min":{"1min":0.39800000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76100000000000001,"5min":4.7290000000000001,"15min":4.7290000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60499999999999998,"15min":0.59299999999999997},"min":{"1min":0.44,"5min":0.378,"15min":0.374},"max":{"1min":0.89200000000000002,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.48599999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574981,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303080,"kb_used_data":1696,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068760,"statfs":{"total":96636764160,"available":96326410240,"internally_reserved":0,"allocated":1736704,"data_stored":790176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:15:58 2023","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.41499999999999998,"15min":0.46600000000000003},"min":{"1min":0.20999999999999999,"5min":0.184,"15min":0.184},"max":{"1min":0.60199999999999998,"5min":8.4239999999999995,"15min":36.097999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.42999999999999999,"15min":0.378},"min":{"1min":0.23100000000000001,"5min":0.20799999999999999,"15min":0.182},"max":{"1min":0.92400000000000004,"5min":7.2990000000000004,"15min":7.2990000000000004},"last":0.30499999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:15:58 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.44400000000000001,"15min":0.503},"min":{"1min":0.22800000000000001,"5min":0.221,"15min":0.217},"max":{"1min":0.53500000000000003,"5min":8.6080000000000005,"15min":36.07},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.44800000000000001,"15min":0.40600000000000003},"min":{"1min":0.27200000000000002,"5min":0.23400000000000001,"15min":0.219},"max":{"1min":0.94899999999999995,"5min":6.7800000000000002,"15min":6.7800000000000002},"last":0.26800000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:15:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36299999999999999,"15min":0.39300000000000002},"min":{"1min":0.26300000000000001,"5min":0.22500000000000001,"15min":0.223},"max":{"1min":0.52000000000000002,"5min":1.863,"15min":8.4130000000000003},"last":0.315},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.499,"15min":0.55900000000000005},"min":{"1min":0.28199999999999997,"5min":0.249,"15min":0.249},"max":{"1min":1.9079999999999999,"5min":8.4570000000000007,"15min":35.959000000000003},"last":0.438}]},{"osd":4,"last update":"Fri Oct 6 11:15:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55700000000000005,"15min":0.56299999999999994},"min":{"1min":0.38800000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.72399999999999998,"5min":2.427,"15min":2.427},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.64600000000000002,"15min":0.72999999999999998},"min":{"1min":0.42399999999999999,"5min":0.34399999999999997,"15min":0.29299999999999998},"max":{"1min":0.748,"5min":8.2919999999999998,"15min":36.005000000000003},"last":0.5}]},{"osd":5,"last update":"Fri Oct 6 11:15:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.61599999999999999,"15min":0.57899999999999996},"min":{"1min":0.40000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.999,"5min":6.6699999999999999,"15min":6.6699999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.47799999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.76900000000000002,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.47999999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:15:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.65600000000000003,"15min":0.73099999999999998},"min":{"1min":0.39200000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.78800000000000003,"5min":8.2479999999999993,"15min":36.037999999999997},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.66200000000000003,"15min":0.63700000000000001},"min":{"1min":0.42899999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.028,"5min":6.7110000000000003,"15min":6.7110000000000003},"last":0.41299999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:15:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.65200000000000002,"15min":0.621},"min":{"1min":0.44900000000000001,"5min":0.371,"15min":0.371},"max":{"1min":1.054,"5min":6.742,"15min":6.742},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56799999999999995,"15min":0.56899999999999995},"min":{"1min":0.41399999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.69899999999999995,"5min":1.917,"15min":1.917},"last":0.42799999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574982,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298968,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072872,"statfs":{"total":96636764160,"available":96330620928,"internally_reserved":0,"allocated":1720320,"data_stored":788074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.30299999999999999,"15min":0.31},"min":{"1min":0.22900000000000001,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.41599999999999998,"5min":0.46300000000000002,"15min":0.57499999999999996},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.376,"15min":0.38200000000000001},"min":{"1min":0.28599999999999998,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.52800000000000002,"5min":0.55600000000000005,"15min":0.66300000000000003},"last":0.45500000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.36399999999999999,"15min":0.372},"min":{"1min":0.28100000000000003,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.48099999999999998,"5min":0.57499999999999996,"15min":0.745},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.34200000000000003,"15min":0.34999999999999998},"min":{"1min":0.247,"5min":0.216,"15min":0.216},"max":{"1min":0.437,"5min":0.52900000000000003,"15min":0.59399999999999997},"last":0.42799999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34599999999999997,"15min":0.36399999999999999},"min":{"1min":0.255,"5min":0.23300000000000001,"15min":0.23200000000000001},"max":{"1min":0.45300000000000001,"5min":0.57699999999999996,"15min":0.629},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.35799999999999998,"15min":0.36399999999999999},"min":{"1min":0.26600000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.64400000000000002},"last":0.47099999999999997}]},{"osd":4,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.503,"15min":0.52700000000000002},"min":{"1min":0.35799999999999998,"5min":0.30599999999999999,"15min":0.30299999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.51100000000000001,"15min":0.54400000000000004},"min":{"1min":0.36499999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.84899999999999998},"last":0.68400000000000005}]},{"osd":5,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.52400000000000002,"15min":0.54300000000000004},"min":{"1min":0.44700000000000001,"5min":0.33100000000000002,"15min":0.32400000000000001},"max":{"1min":0.77100000000000002,"5min":0.80400000000000005,"15min":0.86199999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.54100000000000004,"15min":0.55300000000000005},"min":{"1min":0.40600000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.84499999999999997,"5min":0.872,"15min":0.878},"last":0.77100000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56100000000000005,"15min":0.57899999999999996},"min":{"1min":0.46700000000000003,"5min":0.36799999999999999,"15min":0.32600000000000001},"max":{"1min":0.76200000000000001,"5min":0.84599999999999997,"15min":0.86299999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.55500000000000005,"15min":0.57299999999999995},"min":{"1min":0.44800000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80700000000000005,"5min":0.83499999999999996,"15min":0.88600000000000001},"last":0.69499999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54500000000000004,"15min":0.55800000000000005},"min":{"1min":0.41399999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79300000000000004,"5min":1.139,"15min":1.139},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55000000000000004,"15min":0.56699999999999995},"min":{"1min":0.42499999999999999,"5min":0.38800000000000001,"15min":0.38200000000000001},"max":{"1min":0.80600000000000005,"5min":0.89600000000000002,"15min":0.90500000000000003},"last":0.70499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574982,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307160,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064680,"statfs":{"total":96636764160,"available":96322232320,"internally_reserved":0,"allocated":1720320,"data_stored":788550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.32200000000000001,"15min":0.32300000000000001},"min":{"1min":0.224,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":2.2109999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.375},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.39100000000000001,"15min":0.39200000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.22700000000000001},"max":{"1min":4.4820000000000002,"5min":4.4820000000000002,"15min":4.4820000000000002},"last":0.34899999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.308,"15min":0.311},"min":{"1min":0.251,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.40500000000000003,"5min":0.54000000000000004,"15min":0.65400000000000003},"last":0.313},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.35599999999999998},"min":{"1min":0.27300000000000002,"5min":0.188,"15min":0.188},"max":{"1min":0.439,"5min":0.53100000000000003,"15min":1.196},"last":0.33000000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.38800000000000001,"15min":0.38500000000000001},"min":{"1min":0.245,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":4.601,"5min":4.601,"15min":4.601},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.41499999999999998,"15min":0.41699999999999998},"min":{"1min":0.29899999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.40400000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.50600000000000001,"15min":0.54700000000000004},"min":{"1min":0.39400000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.81799999999999995,"5min":0.88500000000000001,"15min":1.694},"last":0.5},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.51200000000000001,"15min":0.53700000000000003},"min":{"1min":0.32600000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.46500000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.51700000000000002,"15min":0.53100000000000003},"min":{"1min":0.34100000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.78100000000000003,"5min":0.86399999999999999,"15min":0.878},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52300000000000002,"15min":0.55200000000000005},"min":{"1min":0.35699999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.71099999999999997,"5min":0.746,"15min":1.165},"last":0.56000000000000005}]},{"osd":6,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54400000000000004,"15min":0.57699999999999996},"min":{"1min":0.42499999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76900000000000002,"5min":0.79200000000000004,"15min":1.1359999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.54600000000000004,"15min":0.58599999999999997},"min":{"1min":0.36799999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79100000000000004,"5min":0.82199999999999995,"15min":1.7470000000000001},"last":0.44500000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.54400000000000004,"15min":0.57599999999999996},"min":{"1min":0.42199999999999999,"5min":0.35699999999999998,"15min":0.35599999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":1.657},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55300000000000005,"15min":0.57099999999999995},"min":{"1min":0.40400000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.54600000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574980,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303012,"kb_used_data":1628,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068828,"statfs":{"total":96636764160,"available":96326479872,"internally_reserved":0,"allocated":1667072,"data_stored":762784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.45100000000000001,"15min":0.52400000000000002},"min":{"1min":0.26200000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.70799999999999996,"5min":0.82099999999999995,"15min":2.6619999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.47499999999999998,"15min":0.48999999999999999},"min":{"1min":0.29799999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.69099999999999995,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.41599999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:15:56 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47199999999999998,"15min":0.54500000000000004},"min":{"1min":0.28499999999999998,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.70499999999999996,"5min":1,"15min":2.8650000000000002},"last":0.505},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47399999999999998,"15min":0.55100000000000005},"min":{"1min":0.34000000000000002,"5min":0.26200000000000001,"15min":0.25800000000000001},"max":{"1min":0.67800000000000005,"5min":1.2869999999999999,"15min":2.7610000000000001},"last":0.43099999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:15:56 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48499999999999999,"15min":0.53400000000000003},"min":{"1min":0.312,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.73399999999999999,"5min":0.76000000000000001,"15min":1.6910000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54300000000000004,"15min":0.58299999999999996},"min":{"1min":0.38700000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.68000000000000005,"5min":0.93899999999999995,"15min":1.718},"last":0.59599999999999997}]},{"osd":3,"last update":"Fri Oct 6 11:15:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54900000000000004,"15min":0.59299999999999997},"min":{"1min":0.36699999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.71299999999999997,"5min":2.387,"15min":2.677},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.52200000000000002,"15min":0.52400000000000002},"min":{"1min":0.35599999999999998,"5min":0.29299999999999998,"15min":0.27500000000000002},"max":{"1min":0.69399999999999995,"5min":1.784,"15min":1.784},"last":0.66800000000000004}]},{"osd":5,"last update":"Fri Oct 6 11:15:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.47099999999999997,"15min":0.48399999999999999},"min":{"1min":0.33700000000000002,"5min":0.23499999999999999,"15min":0.23200000000000001},"max":{"1min":0.65700000000000003,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.621},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.48799999999999999,"15min":0.52400000000000002},"min":{"1min":0.29099999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.65900000000000003,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.71099999999999997}]},{"osd":6,"last update":"Fri Oct 6 11:15:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.502,"15min":0.52100000000000002},"min":{"1min":0.313,"5min":0.30499999999999999,"15min":0.252},"max":{"1min":0.83499999999999996,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53100000000000003,"15min":0.56200000000000006},"min":{"1min":0.38900000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.69399999999999995,"5min":0.85799999999999998,"15min":1.165},"last":0.68400000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:15:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54300000000000004,"15min":0.55700000000000005},"min":{"1min":0.36899999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.70199999999999996,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.55900000000000005,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.875,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.75900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574983,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311252,"kb_used_data":1676,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060588,"statfs":{"total":96636764160,"available":96318042112,"internally_reserved":0,"allocated":1716224,"data_stored":789315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.44700000000000001,"15min":0.58999999999999997},"min":{"1min":0.26200000000000001,"5min":0.23100000000000001,"15min":0.20499999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":5.0490000000000004},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.44900000000000001,"15min":0.56899999999999995},"min":{"1min":0.26600000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.66500000000000004,"5min":0.78100000000000003,"15min":5.1449999999999996},"last":0.61499999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.46100000000000002,"15min":0.48199999999999998},"min":{"1min":0.307,"5min":0.25,"15min":0.25},"max":{"1min":0.72999999999999998,"5min":0.81399999999999995,"15min":0.97199999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.47699999999999998,"15min":0.50900000000000001},"min":{"1min":0.35299999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":1.8799999999999999},"last":0.69299999999999995}]},{"osd":2,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.499,"15min":0.54600000000000004},"min":{"1min":0.313,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76600000000000001,"5min":0.79800000000000004,"15min":4.234},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.52500000000000002,"15min":0.55900000000000005},"min":{"1min":0.39800000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.747,"5min":0.81000000000000005,"15min":1.0369999999999999},"last":0.79200000000000004}]},{"osd":3,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.47999999999999998,"15min":0.60899999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.27700000000000002},"max":{"1min":0.72799999999999998,"5min":0.82299999999999995,"15min":5.2169999999999996},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.505,"15min":0.53900000000000003},"min":{"1min":0.32400000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":1.008},"last":0.42299999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.46999999999999997,"15min":0.50700000000000001},"min":{"1min":0.26400000000000001,"5min":0.25600000000000001,"15min":0.23999999999999999},"max":{"1min":0.78000000000000003,"5min":0.83399999999999996,"15min":1.917},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.46899999999999997,"15min":0.51800000000000002},"min":{"1min":0.251,"5min":0.24399999999999999,"15min":0.23899999999999999},"max":{"1min":0.68899999999999995,"5min":0.69199999999999995,"15min":0.87},"last":0.39500000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.49099999999999999,"15min":0.54600000000000004},"min":{"1min":0.32700000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":2.0139999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55400000000000005,"15min":0.59699999999999998},"min":{"1min":0.30299999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.80800000000000005,"5min":0.82899999999999996,"15min":1.9470000000000001},"last":0.72599999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.51600000000000001,"15min":0.56799999999999995},"min":{"1min":0.311,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.71999999999999997,"5min":0.81000000000000005,"15min":0.96499999999999997},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.54800000000000004,"15min":0.59599999999999997},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.28799999999999998},"max":{"1min":0.75600000000000001,"5min":0.77300000000000002,"15min":1.4119999999999999},"last":0.746}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:16:28.902 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3e is not active+clean 2023-10-06T11:16:28.903 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:16:23.078855+0000', 'last_change': '2023-10-06T11:16:23.078855+0000', 'last_active': '2023-10-06T11:16:23.078855+0000', 'last_peered': '2023-10-06T11:16:23.078855+0000', 'last_clean': '2023-10-06T11:16:23.078855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:23.078855+0000', 'last_undegraded': '2023-10-06T11:16:23.078855+0000', 'last_fullsized': '2023-10-06T11:16:23.078855+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:16:28.903 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3d is not active+clean 2023-10-06T11:16:28.903 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:16:23.078855+0000', 'last_change': '2023-10-06T11:16:23.078855+0000', 'last_active': '2023-10-06T11:16:23.078855+0000', 'last_peered': '2023-10-06T11:16:23.078855+0000', 'last_clean': '2023-10-06T11:16:23.078855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:23.078855+0000', 'last_undegraded': '2023-10-06T11:16:23.078855+0000', 'last_fullsized': '2023-10-06T11:16:23.078855+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:16:28.904 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3c is not active+clean 2023-10-06T11:16:28.904 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:16:23.078855+0000', 'last_change': '2023-10-06T11:16:23.078855+0000', 'last_active': '2023-10-06T11:16:23.078855+0000', 'last_peered': '2023-10-06T11:16:23.078855+0000', 'last_clean': '2023-10-06T11:16:23.078855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:23.078855+0000', 'last_undegraded': '2023-10-06T11:16:23.078855+0000', 'last_fullsized': '2023-10-06T11:16:23.078855+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:16:28.904 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.38 is not active+clean 2023-10-06T11:16:28.904 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:16:23.078855+0000', 'last_change': '2023-10-06T11:16:23.078855+0000', 'last_active': '2023-10-06T11:16:23.078855+0000', 'last_peered': '2023-10-06T11:16:23.078855+0000', 'last_clean': '2023-10-06T11:16:23.078855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:23.078855+0000', 'last_undegraded': '2023-10-06T11:16:23.078855+0000', 'last_fullsized': '2023-10-06T11:16:23.078855+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:16:28.904 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.34 is not active+clean 2023-10-06T11:16:28.904 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:16:23.078855+0000', 'last_change': '2023-10-06T11:16:23.078855+0000', 'last_active': '2023-10-06T11:16:23.078855+0000', 'last_peered': '2023-10-06T11:16:23.078855+0000', 'last_clean': '2023-10-06T11:16:23.078855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:23.078855+0000', 'last_undegraded': '2023-10-06T11:16:23.078855+0000', 'last_fullsized': '2023-10-06T11:16:23.078855+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:16:28.905 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.32 is not active+clean 2023-10-06T11:16:28.905 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:16:23.078855+0000', 'last_change': '2023-10-06T11:16:23.078855+0000', 'last_active': '2023-10-06T11:16:23.078855+0000', 'last_peered': '2023-10-06T11:16:23.078855+0000', 'last_clean': '2023-10-06T11:16:23.078855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:23.078855+0000', 'last_undegraded': '2023-10-06T11:16:23.078855+0000', 'last_fullsized': '2023-10-06T11:16:23.078855+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:16:28.905 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.31 is not active+clean 2023-10-06T11:16:28.905 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:16:23.078855+0000', 'last_change': '2023-10-06T11:16:23.078855+0000', 'last_active': '2023-10-06T11:16:23.078855+0000', 'last_peered': '2023-10-06T11:16:23.078855+0000', 'last_clean': '2023-10-06T11:16:23.078855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:23.078855+0000', 'last_undegraded': '2023-10-06T11:16:23.078855+0000', 'last_fullsized': '2023-10-06T11:16:23.078855+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:16:28.905 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2f is not active+clean 2023-10-06T11:16:28.905 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:16:23.078855+0000', 'last_change': '2023-10-06T11:16:23.078855+0000', 'last_active': '2023-10-06T11:16:23.078855+0000', 'last_peered': '2023-10-06T11:16:23.078855+0000', 'last_clean': '2023-10-06T11:16:23.078855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:23.078855+0000', 'last_undegraded': '2023-10-06T11:16:23.078855+0000', 'last_fullsized': '2023-10-06T11:16:23.078855+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:16:28.905 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.29 is not active+clean 2023-10-06T11:16:28.905 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:16:23.078855+0000', 'last_change': '2023-10-06T11:16:23.078855+0000', 'last_active': '2023-10-06T11:16:23.078855+0000', 'last_peered': '2023-10-06T11:16:23.078855+0000', 'last_clean': '2023-10-06T11:16:23.078855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:23.078855+0000', 'last_undegraded': '2023-10-06T11:16:23.078855+0000', 'last_fullsized': '2023-10-06T11:16:23.078855+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:16:28.905 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.23 is not active+clean 2023-10-06T11:16:28.906 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:16:23.078855+0000', 'last_change': '2023-10-06T11:16:23.078855+0000', 'last_active': '2023-10-06T11:16:23.078855+0000', 'last_peered': '2023-10-06T11:16:23.078855+0000', 'last_clean': '2023-10-06T11:16:23.078855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:23.078855+0000', 'last_undegraded': '2023-10-06T11:16:23.078855+0000', 'last_fullsized': '2023-10-06T11:16:23.078855+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:16:28.906 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.20 is not active+clean 2023-10-06T11:16:28.906 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:16:23.078855+0000', 'last_change': '2023-10-06T11:16:23.078855+0000', 'last_active': '2023-10-06T11:16:23.078855+0000', 'last_peered': '2023-10-06T11:16:23.078855+0000', 'last_clean': '2023-10-06T11:16:23.078855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:23.078855+0000', 'last_undegraded': '2023-10-06T11:16:23.078855+0000', 'last_fullsized': '2023-10-06T11:16:23.078855+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:16:28.906 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1c is not active+clean 2023-10-06T11:16:28.906 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:16:23.078855+0000', 'last_change': '2023-10-06T11:16:23.078855+0000', 'last_active': '2023-10-06T11:16:23.078855+0000', 'last_peered': '2023-10-06T11:16:23.078855+0000', 'last_clean': '2023-10-06T11:16:23.078855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:23.078855+0000', 'last_undegraded': '2023-10-06T11:16:23.078855+0000', 'last_fullsized': '2023-10-06T11:16:23.078855+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:16:28.906 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1d is not active+clean 2023-10-06T11:16:28.906 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:16:23.078855+0000', 'last_change': '2023-10-06T11:16:23.078855+0000', 'last_active': '2023-10-06T11:16:23.078855+0000', 'last_peered': '2023-10-06T11:16:23.078855+0000', 'last_clean': '2023-10-06T11:16:23.078855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:23.078855+0000', 'last_undegraded': '2023-10-06T11:16:23.078855+0000', 'last_fullsized': '2023-10-06T11:16:23.078855+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:16:28.906 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1e is not active+clean 2023-10-06T11:16:28.906 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:16:23.078855+0000', 'last_change': '2023-10-06T11:16:23.078855+0000', 'last_active': '2023-10-06T11:16:23.078855+0000', 'last_peered': '2023-10-06T11:16:23.078855+0000', 'last_clean': '2023-10-06T11:16:23.078855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:23.078855+0000', 'last_undegraded': '2023-10-06T11:16:23.078855+0000', 'last_fullsized': '2023-10-06T11:16:23.078855+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:16:28.907 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1c is not active+clean 2023-10-06T11:16:28.907 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:22.074583+0000', 'last_change': '2023-10-06T11:16:22.089441+0000', 'last_active': '2023-10-06T11:16:22.074583+0000', 'last_peered': '2023-10-06T11:16:22.074583+0000', 'last_clean': '2023-10-06T11:16:22.074583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:22.074583+0000', 'last_undegraded': '2023-10-06T11:16:22.074583+0000', 'last_fullsized': '2023-10-06T11:16:22.074583+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:22.074583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:22.074583+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:22.074583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:24:59.486245+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T11:16:28.907 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1b is not active+clean 2023-10-06T11:16:28.907 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:22.074583+0000', 'last_change': '2023-10-06T11:16:22.087560+0000', 'last_active': '2023-10-06T11:16:22.074583+0000', 'last_peered': '2023-10-06T11:16:22.074583+0000', 'last_clean': '2023-10-06T11:16:22.074583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:22.074583+0000', 'last_undegraded': '2023-10-06T11:16:22.074583+0000', 'last_fullsized': '2023-10-06T11:16:22.074583+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:22.074583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:22.074583+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:22.074583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T20:34:43.602621+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T11:16:28.907 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.19 is not active+clean 2023-10-06T11:16:28.907 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:16:23.078855+0000', 'last_change': '2023-10-06T11:16:23.078855+0000', 'last_active': '2023-10-06T11:16:23.078855+0000', 'last_peered': '2023-10-06T11:16:23.078855+0000', 'last_clean': '2023-10-06T11:16:23.078855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:23.078855+0000', 'last_undegraded': '2023-10-06T11:16:23.078855+0000', 'last_fullsized': '2023-10-06T11:16:23.078855+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:16:28.907 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1a is not active+clean 2023-10-06T11:16:28.907 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:16:23.078855+0000', 'last_change': '2023-10-06T11:16:23.078855+0000', 'last_active': '2023-10-06T11:16:23.078855+0000', 'last_peered': '2023-10-06T11:16:23.078855+0000', 'last_clean': '2023-10-06T11:16:23.078855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:23.078855+0000', 'last_undegraded': '2023-10-06T11:16:23.078855+0000', 'last_fullsized': '2023-10-06T11:16:23.078855+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:16:28.907 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.d is not active+clean 2023-10-06T11:16:28.908 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:22.074583+0000', 'last_change': '2023-10-06T11:16:22.089897+0000', 'last_active': '2023-10-06T11:16:22.074583+0000', 'last_peered': '2023-10-06T11:16:22.074583+0000', 'last_clean': '2023-10-06T11:16:22.074583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:22.074583+0000', 'last_undegraded': '2023-10-06T11:16:22.074583+0000', 'last_fullsized': '2023-10-06T11:16:22.074583+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:22.074583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:22.074583+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:22.074583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:17:10.613647+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T11:16:28.908 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.c is not active+clean 2023-10-06T11:16:28.908 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:22.074583+0000', 'last_change': '2023-10-06T11:16:22.091691+0000', 'last_active': '2023-10-06T11:16:22.074583+0000', 'last_peered': '2023-10-06T11:16:22.074583+0000', 'last_clean': '2023-10-06T11:16:22.074583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:22.074583+0000', 'last_undegraded': '2023-10-06T11:16:22.074583+0000', 'last_fullsized': '2023-10-06T11:16:22.074583+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:22.074583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:22.074583+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:22.074583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T17:51:27.162572+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:16:28.908 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.9 is not active+clean 2023-10-06T11:16:28.908 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:16:23.078855+0000', 'last_change': '2023-10-06T11:16:23.078855+0000', 'last_active': '2023-10-06T11:16:23.078855+0000', 'last_peered': '2023-10-06T11:16:23.078855+0000', 'last_clean': '2023-10-06T11:16:23.078855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:23.078855+0000', 'last_undegraded': '2023-10-06T11:16:23.078855+0000', 'last_fullsized': '2023-10-06T11:16:23.078855+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:16:28.908 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.a is not active+clean 2023-10-06T11:16:28.908 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:22.074583+0000', 'last_change': '2023-10-06T11:16:22.087428+0000', 'last_active': '2023-10-06T11:16:22.074583+0000', 'last_peered': '2023-10-06T11:16:22.074583+0000', 'last_clean': '2023-10-06T11:16:22.074583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:22.074583+0000', 'last_undegraded': '2023-10-06T11:16:22.074583+0000', 'last_fullsized': '2023-10-06T11:16:22.074583+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:22.074583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:22.074583+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:22.074583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T17:23:31.995315+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T11:16:28.908 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.b is not active+clean 2023-10-06T11:16:28.908 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:16:23.078855+0000', 'last_change': '2023-10-06T11:16:23.078855+0000', 'last_active': '2023-10-06T11:16:23.078855+0000', 'last_peered': '2023-10-06T11:16:23.078855+0000', 'last_clean': '2023-10-06T11:16:23.078855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:23.078855+0000', 'last_undegraded': '2023-10-06T11:16:23.078855+0000', 'last_fullsized': '2023-10-06T11:16:23.078855+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:16:28.909 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.8 is not active+clean 2023-10-06T11:16:28.909 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:22.074583+0000', 'last_change': '2023-10-06T11:16:22.087660+0000', 'last_active': '2023-10-06T11:16:22.074583+0000', 'last_peered': '2023-10-06T11:16:22.074583+0000', 'last_clean': '2023-10-06T11:16:22.074583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:22.074583+0000', 'last_undegraded': '2023-10-06T11:16:22.074583+0000', 'last_fullsized': '2023-10-06T11:16:22.074583+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:22.074583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:22.074583+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:22.074583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:29:00.300634+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T11:16:28.909 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.7 is not active+clean 2023-10-06T11:16:28.909 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:22.074583+0000', 'last_change': '2023-10-06T11:16:22.090769+0000', 'last_active': '2023-10-06T11:16:22.074583+0000', 'last_peered': '2023-10-06T11:16:22.074583+0000', 'last_clean': '2023-10-06T11:16:22.074583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:22.074583+0000', 'last_undegraded': '2023-10-06T11:16:22.074583+0000', 'last_fullsized': '2023-10-06T11:16:22.074583+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:22.074583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:22.074583+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:22.074583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:10:03.275656+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:16:28.909 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.5 is not active+clean 2023-10-06T11:16:28.909 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:16:23.078855+0000', 'last_change': '2023-10-06T11:16:23.078855+0000', 'last_active': '2023-10-06T11:16:23.078855+0000', 'last_peered': '2023-10-06T11:16:23.078855+0000', 'last_clean': '2023-10-06T11:16:23.078855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:23.078855+0000', 'last_undegraded': '2023-10-06T11:16:23.078855+0000', 'last_fullsized': '2023-10-06T11:16:23.078855+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:16:28.910 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.5 is not active+clean 2023-10-06T11:16:28.910 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:22.074583+0000', 'last_change': '2023-10-06T11:16:22.089457+0000', 'last_active': '2023-10-06T11:16:22.074583+0000', 'last_peered': '2023-10-06T11:16:22.074583+0000', 'last_clean': '2023-10-06T11:16:22.074583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:22.074583+0000', 'last_undegraded': '2023-10-06T11:16:22.074583+0000', 'last_fullsized': '2023-10-06T11:16:22.074583+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:22.074583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:22.074583+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:22.074583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:35:26.467632+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T11:16:28.910 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.0 is not active+clean 2023-10-06T11:16:28.910 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:16:23.078855+0000', 'last_change': '2023-10-06T11:16:23.078855+0000', 'last_active': '2023-10-06T11:16:23.078855+0000', 'last_peered': '2023-10-06T11:16:23.078855+0000', 'last_clean': '2023-10-06T11:16:23.078855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:23.078855+0000', 'last_undegraded': '2023-10-06T11:16:23.078855+0000', 'last_fullsized': '2023-10-06T11:16:23.078855+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:16:28.910 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.1 is not active+clean 2023-10-06T11:16:28.911 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:16:23.078855+0000', 'last_change': '2023-10-06T11:16:23.078855+0000', 'last_active': '2023-10-06T11:16:23.078855+0000', 'last_peered': '2023-10-06T11:16:23.078855+0000', 'last_clean': '2023-10-06T11:16:23.078855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:23.078855+0000', 'last_undegraded': '2023-10-06T11:16:23.078855+0000', 'last_fullsized': '2023-10-06T11:16:23.078855+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:16:28.911 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.2 is not active+clean 2023-10-06T11:16:28.911 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:16:23.078855+0000', 'last_change': '2023-10-06T11:16:23.078855+0000', 'last_active': '2023-10-06T11:16:23.078855+0000', 'last_peered': '2023-10-06T11:16:23.078855+0000', 'last_clean': '2023-10-06T11:16:23.078855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:23.078855+0000', 'last_undegraded': '2023-10-06T11:16:23.078855+0000', 'last_fullsized': '2023-10-06T11:16:23.078855+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:16:28.911 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.3 is not active+clean 2023-10-06T11:16:28.912 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:16:23.078855+0000', 'last_change': '2023-10-06T11:16:23.078855+0000', 'last_active': '2023-10-06T11:16:23.078855+0000', 'last_peered': '2023-10-06T11:16:23.078855+0000', 'last_clean': '2023-10-06T11:16:23.078855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:23.078855+0000', 'last_undegraded': '2023-10-06T11:16:23.078855+0000', 'last_fullsized': '2023-10-06T11:16:23.078855+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:16:28.912 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.11 is not active+clean 2023-10-06T11:16:28.912 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:22.074583+0000', 'last_change': '2023-10-06T11:16:22.089284+0000', 'last_active': '2023-10-06T11:16:22.074583+0000', 'last_peered': '2023-10-06T11:16:22.074583+0000', 'last_clean': '2023-10-06T11:16:22.074583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:22.074583+0000', 'last_undegraded': '2023-10-06T11:16:22.074583+0000', 'last_fullsized': '2023-10-06T11:16:22.074583+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:22.074583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:22.074583+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:22.074583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:23:45.097185+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:16:28.912 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.13 is not active+clean 2023-10-06T11:16:28.912 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:16:23.078855+0000', 'last_change': '2023-10-06T11:16:23.078855+0000', 'last_active': '2023-10-06T11:16:23.078855+0000', 'last_peered': '2023-10-06T11:16:23.078855+0000', 'last_clean': '2023-10-06T11:16:23.078855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:23.078855+0000', 'last_undegraded': '2023-10-06T11:16:23.078855+0000', 'last_fullsized': '2023-10-06T11:16:23.078855+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:16:28.912 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.14 is not active+clean 2023-10-06T11:16:28.912 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:16:23.078855+0000', 'last_change': '2023-10-06T11:16:23.078855+0000', 'last_active': '2023-10-06T11:16:23.078855+0000', 'last_peered': '2023-10-06T11:16:23.078855+0000', 'last_clean': '2023-10-06T11:16:23.078855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:23.078855+0000', 'last_undegraded': '2023-10-06T11:16:23.078855+0000', 'last_fullsized': '2023-10-06T11:16:23.078855+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:16:28.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.17 is not active+clean 2023-10-06T11:16:28.913 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:16:23.078855+0000', 'last_change': '2023-10-06T11:16:23.078855+0000', 'last_active': '2023-10-06T11:16:23.078855+0000', 'last_peered': '2023-10-06T11:16:23.078855+0000', 'last_clean': '2023-10-06T11:16:23.078855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:23.078855+0000', 'last_undegraded': '2023-10-06T11:16:23.078855+0000', 'last_fullsized': '2023-10-06T11:16:23.078855+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:16:28.913 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.11 is not active+clean 2023-10-06T11:16:28.914 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:16:23.078855+0000', 'last_change': '2023-10-06T11:16:23.078855+0000', 'last_active': '2023-10-06T11:16:23.078855+0000', 'last_peered': '2023-10-06T11:16:23.078855+0000', 'last_clean': '2023-10-06T11:16:23.078855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:23.078855+0000', 'last_undegraded': '2023-10-06T11:16:23.078855+0000', 'last_fullsized': '2023-10-06T11:16:23.078855+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:16:28.914 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.12 is not active+clean 2023-10-06T11:16:28.914 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:16:22.074583+0000', 'last_change': '2023-10-06T11:16:22.089652+0000', 'last_active': '2023-10-06T11:16:22.074583+0000', 'last_peered': '2023-10-06T11:16:22.074583+0000', 'last_clean': '2023-10-06T11:16:22.074583+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:22.074583+0000', 'last_undegraded': '2023-10-06T11:16:22.074583+0000', 'last_fullsized': '2023-10-06T11:16:22.074583+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:22.074583+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:22.074583+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:22.074583+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T22:35:44.567263+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:16:28.914 INFO:tasks.cephfs.filesystem.ceph_manager:PG 22.10 is not active+clean 2023-10-06T11:16:28.914 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '22.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:16:23.078855+0000', 'last_change': '2023-10-06T11:16:23.078855+0000', 'last_active': '2023-10-06T11:16:23.078855+0000', 'last_peered': '2023-10-06T11:16:23.078855+0000', 'last_clean': '2023-10-06T11:16:23.078855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:16:23.078855+0000', 'last_undegraded': '2023-10-06T11:16:23.078855+0000', 'last_fullsized': '2023-10-06T11:16:23.078855+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'last_clean_scrub_stamp': '2023-10-06T11:16:23.078855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:16:28.915 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T11:16:29.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.048+0000 7fd42ec95700 1 Processor -- start 2023-10-06T11:16:29.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.048+0000 7fd42ec95700 1 -- start start 2023-10-06T11:16:29.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.049+0000 7fd42ec95700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd42815a7f0 0x7fd42815cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:29.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.049+0000 7fd42ec95700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd4280b2530 0x7fd42815acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:29.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.049+0000 7fd42ec95700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd42815c630 con 0x7fd42815a420 2023-10-06T11:16:29.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.049+0000 7fd42ec95700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4280ce040 con 0x7fd42815a7f0 2023-10-06T11:16:29.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.049+0000 7fd42ec95700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd42815ba20 con 0x7fd4280b2530 2023-10-06T11:16:29.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.049+0000 7fd42d492700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd42815a7f0 0x7fd42815cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:29.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.049+0000 7fd42d492700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd42815a7f0 0x7fd42815cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49028/0 (socket says 172.21.15.146:49028) 2023-10-06T11:16:29.053 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.049+0000 7fd42d492700 1 -- 172.21.15.146:0/3240342991 learned_addr learned my addr 172.21.15.146:0/3240342991 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:29.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.049+0000 7fd42e494700 1 --2- 172.21.15.146:0/3240342991 >> v2:172.21.15.151:3300/0 conn(0x7fd4280b2530 0x7fd42815acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:29.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.050+0000 7fd42d492700 1 -- 172.21.15.146:0/3240342991 >> v2:172.21.15.151:3300/0 conn(0x7fd4280b2530 msgr2=0x7fd42815acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:29.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.050+0000 7fd42d492700 1 --2- 172.21.15.146:0/3240342991 >> v2:172.21.15.151:3300/0 conn(0x7fd4280b2530 0x7fd42815acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:29.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.050+0000 7fd42d492700 1 -- 172.21.15.146:0/3240342991 >> v1:172.21.15.151:6789/0 conn(0x7fd42815a420 legacy=0x7fd4280b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:29.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.050+0000 7fd42d492700 1 -- 172.21.15.146:0/3240342991 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd42815bd00 con 0x7fd42815a7f0 2023-10-06T11:16:29.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.050+0000 7fd42d492700 1 --2- 172.21.15.146:0/3240342991 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd42815a7f0 0x7fd42815cac0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7fd42815c5a0 tx=0x7fd418009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abe1b3ecae52c55c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:29.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.050+0000 7fd42cc91700 1 -- 172.21.15.146:0/3240342991 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41800b860 con 0x7fd42815a7f0 2023-10-06T11:16:29.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.050+0000 7fd42cc91700 1 -- 172.21.15.146:0/3240342991 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd41800b9c0 con 0x7fd42815a7f0 2023-10-06T11:16:29.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.050+0000 7fd42cc91700 1 -- 172.21.15.146:0/3240342991 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41800bd60 con 0x7fd42815a7f0 2023-10-06T11:16:29.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.050+0000 7fd42ec95700 1 -- 172.21.15.146:0/3240342991 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd42815a7f0 msgr2=0x7fd42815cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:29.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.050+0000 7fd42ec95700 1 --2- 172.21.15.146:0/3240342991 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd42815a7f0 0x7fd42815cac0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7fd42815c5a0 tx=0x7fd418009250 comp rx=0 tx=0).stop 2023-10-06T11:16:29.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.050+0000 7fd42ec95700 1 -- 172.21.15.146:0/3240342991 shutdown_connections 2023-10-06T11:16:29.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.050+0000 7fd42ec95700 1 --2- 172.21.15.146:0/3240342991 >> v2:172.21.15.151:3300/0 conn(0x7fd4280b2530 0x7fd42815acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:29.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.050+0000 7fd42ec95700 1 --2- 172.21.15.146:0/3240342991 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd42815a7f0 0x7fd42815cac0 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:29.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.050+0000 7fd42ec95700 1 -- 172.21.15.146:0/3240342991 >> 172.21.15.146:0/3240342991 conn(0x7fd42806eba0 msgr2=0x7fd42806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:29.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.050+0000 7fd42ec95700 1 -- 172.21.15.146:0/3240342991 shutdown_connections 2023-10-06T11:16:29.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.050+0000 7fd42ec95700 1 -- 172.21.15.146:0/3240342991 wait complete. 2023-10-06T11:16:29.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.051+0000 7fd42ec95700 1 Processor -- start 2023-10-06T11:16:29.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.051+0000 7fd42ec95700 1 -- start start 2023-10-06T11:16:29.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.052+0000 7fd42ec95700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4280b2530 0x7fd42814b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:29.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.052+0000 7fd42ec95700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd42815a420 0x7fd42816d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:29.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.052+0000 7fd42ec95700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd42815a7f0 0x7fd42816db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:29.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.052+0000 7fd42ec95700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42814a370 con 0x7fd42815a420 2023-10-06T11:16:29.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.052+0000 7fd42ec95700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd42814af70 con 0x7fd4280b2530 2023-10-06T11:16:29.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.052+0000 7fd42ec95700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd428149760 con 0x7fd42815a7f0 2023-10-06T11:16:29.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.052+0000 7fd42d492700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd42815a420 0x7fd42816d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:29.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.052+0000 7fd42d492700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd42815a420 0x7fd42816d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49034/0 (socket says 172.21.15.146:49034) 2023-10-06T11:16:29.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.052+0000 7fd42d492700 1 -- 172.21.15.146:0/3537522970 learned_addr learned my addr 172.21.15.146:0/3537522970 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:29.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.052+0000 7fd42dc93700 1 --2- 172.21.15.146:0/3537522970 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4280b2530 0x7fd42814b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:29.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.052+0000 7fd42e494700 1 --2- 172.21.15.146:0/3537522970 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd42815a7f0 0x7fd42816db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:29.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.053+0000 7fd42d492700 1 -- 172.21.15.146:0/3537522970 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd42815a7f0 msgr2=0x7fd42816db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:29.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.053+0000 7fd42d492700 1 --2- 172.21.15.146:0/3537522970 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd42815a7f0 0x7fd42816db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:29.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.053+0000 7fd42d492700 1 -- 172.21.15.146:0/3537522970 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4280b2530 msgr2=0x7fd42814b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:29.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.053+0000 7fd42d492700 1 --2- 172.21.15.146:0/3537522970 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4280b2530 0x7fd42814b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:29.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.053+0000 7fd42d492700 1 -- 172.21.15.146:0/3537522970 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4180094f0 con 0x7fd42815a420 2023-10-06T11:16:29.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.053+0000 7fd42d492700 1 --2- 172.21.15.146:0/3537522970 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd42815a420 0x7fd42816d5c0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fd428088e40 tx=0x7fd418017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:29.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.053+0000 7fd41dffb700 1 -- 172.21.15.146:0/3537522970 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd418024440 con 0x7fd42815a420 2023-10-06T11:16:29.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.053+0000 7fd41dffb700 1 -- 172.21.15.146:0/3537522970 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4180245a0 con 0x7fd42815a420 2023-10-06T11:16:29.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.053+0000 7fd42ec95700 1 -- 172.21.15.146:0/3537522970 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd428149a40 con 0x7fd42815a420 2023-10-06T11:16:29.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.053+0000 7fd41dffb700 1 -- 172.21.15.146:0/3537522970 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd418024960 con 0x7fd42815a420 2023-10-06T11:16:29.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.053+0000 7fd42ec95700 1 -- 172.21.15.146:0/3537522970 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd42814a000 con 0x7fd42815a420 2023-10-06T11:16:29.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.054+0000 7fd42ec95700 1 -- 172.21.15.146:0/3537522970 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4280afae0 con 0x7fd42815a420 2023-10-06T11:16:29.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.054+0000 7fd41dffb700 1 -- 172.21.15.146:0/3537522970 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd418024d50 con 0x7fd42815a420 2023-10-06T11:16:29.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.055+0000 7fd41dffb700 1 --2- 172.21.15.146:0/3537522970 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd40c066f30 0x7fd40c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:29.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.055+0000 7fd41dffb700 1 -- 172.21.15.146:0/3537522970 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd418086160 con 0x7fd42815a420 2023-10-06T11:16:29.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.055+0000 7fd42dc93700 1 --2- 172.21.15.146:0/3537522970 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd40c066f30 0x7fd40c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:29.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.055+0000 7fd42dc93700 1 --2- 172.21.15.146:0/3537522970 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd40c066f30 0x7fd40c0693e0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fd424007fd0 tx=0x7fd424009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:29.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.059+0000 7fd41dffb700 1 -- 172.21.15.146:0/3537522970 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd4180532f0 con 0x7fd42815a420 2023-10-06T11:16:29.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.317+0000 7fd42ec95700 1 -- 172.21.15.146:0/3537522970 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd42815bfe0 con 0x7fd42815a420 2023-10-06T11:16:29.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.318+0000 7fd41dffb700 1 -- 172.21.15.146:0/3537522970 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1345 (secure 0 0 0) 0x7fd41802b340 con 0x7fd42815a420 2023-10-06T11:16:29.320 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:16:29.320 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":663,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":137,"num_osds":8,"num_up_osds":8,"osd_up_since":1696590336,"num_in_osds":8,"osd_in_since":1696590327,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":67},{"state_name":"unknown","count":28},{"state_name":"creating+peering","count":10}],"num_pgs":105,"num_pools":4,"num_objects":20,"data_bytes":592604,"bytes_used":2496331776,"bytes_avail":770597781504,"bytes_total":773094113280,"unknown_pgs_ratio":0.26666668057441711,"inactive_pgs_ratio":0.095238097012042999,"write_bytes_sec":2365,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":121,"id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"a","status":"up:active","gid":9198}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":26,"modified":"2023-10-06T11:16:07.275107+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T11:16:29.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.319+0000 7fd42ec95700 1 -- 172.21.15.146:0/3537522970 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd40c066f30 msgr2=0x7fd40c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:29.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.319+0000 7fd42ec95700 1 --2- 172.21.15.146:0/3537522970 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd40c066f30 0x7fd40c0693e0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fd424007fd0 tx=0x7fd424009040 comp rx=0 tx=0).stop 2023-10-06T11:16:29.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.319+0000 7fd42ec95700 1 -- 172.21.15.146:0/3537522970 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd42815a420 msgr2=0x7fd42816d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:29.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.320+0000 7fd42ec95700 1 --2- 172.21.15.146:0/3537522970 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd42815a420 0x7fd42816d5c0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fd428088e40 tx=0x7fd418017000 comp rx=0 tx=0).stop 2023-10-06T11:16:29.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.320+0000 7fd42ec95700 1 -- 172.21.15.146:0/3537522970 shutdown_connections 2023-10-06T11:16:29.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.320+0000 7fd42ec95700 1 --2- 172.21.15.146:0/3537522970 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd40c066f30 0x7fd40c0693e0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:29.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.320+0000 7fd42ec95700 1 --2- 172.21.15.146:0/3537522970 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd42815a7f0 0x7fd42816db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:29.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.320+0000 7fd42ec95700 1 --2- 172.21.15.146:0/3537522970 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4280b2530 0x7fd42814b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:29.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.320+0000 7fd42ec95700 1 --2- 172.21.15.146:0/3537522970 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd42815a420 0x7fd42816d5c0 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:29.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.320+0000 7fd42ec95700 1 -- 172.21.15.146:0/3537522970 >> 172.21.15.146:0/3537522970 conn(0x7fd42806eba0 msgr2=0x7fd4280b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:29.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.320+0000 7fd42ec95700 1 -- 172.21.15.146:0/3537522970 shutdown_connections 2023-10-06T11:16:29.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.320+0000 7fd42ec95700 1 -- 172.21.15.146:0/3537522970 wait complete. 2023-10-06T11:16:29.333 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-06T11:16:29.334 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:16:29.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.446+0000 7f2e23fff700 1 Processor -- start 2023-10-06T11:16:29.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.446+0000 7f2e23fff700 1 -- start start 2023-10-06T11:16:29.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.447+0000 7f2e23fff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2e2415a7f0 0x7f2e2415cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:29.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.447+0000 7f2e23fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2e240b2530 0x7f2e2415acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:29.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.447+0000 7f2e23fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e2415c630 con 0x7f2e2415a420 2023-10-06T11:16:29.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.447+0000 7f2e23fff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e240ce040 con 0x7f2e240b2530 2023-10-06T11:16:29.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.447+0000 7f2e23fff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e2415ba20 con 0x7f2e2415a7f0 2023-10-06T11:16:29.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.447+0000 7f2e237fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2e240b2530 0x7f2e2415acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:29.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.447+0000 7f2e22ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2e2415a420 0x7f2e240b1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:34648/0 (socket says 172.21.15.146:34648) 2023-10-06T11:16:29.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.447+0000 7f2e22ffd700 1 -- 172.21.15.146:0/3984901463 learned_addr learned my addr 172.21.15.146:0/3984901463 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:16:29.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.447+0000 7f2e1a7fc700 1 --2- 172.21.15.146:0/3984901463 >> v2:172.21.15.151:3300/0 conn(0x7f2e2415a7f0 0x7f2e2415cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:29.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.447+0000 7f2e237fe700 1 -- 172.21.15.146:0/3984901463 >> v2:172.21.15.151:3300/0 conn(0x7f2e2415a7f0 msgr2=0x7f2e2415cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:29.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.447+0000 7f2e237fe700 1 --2- 172.21.15.146:0/3984901463 >> v2:172.21.15.151:3300/0 conn(0x7f2e2415a7f0 0x7f2e2415cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:29.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.447+0000 7f2e237fe700 1 -- 172.21.15.146:0/3984901463 >> v1:172.21.15.146:6789/0 conn(0x7f2e2415a420 legacy=0x7f2e240b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:29.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.447+0000 7f2e237fe700 1 -- 172.21.15.146:0/3984901463 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e2415bd00 con 0x7f2e240b2530 2023-10-06T11:16:29.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.447+0000 7f2e227fc700 1 -- 172.21.15.146:0/3984901463 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1369151090 0 0) 0x7f2e2415c630 con 0x7f2e2415a420 2023-10-06T11:16:29.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.447+0000 7f2e1a7fc700 1 --2- 172.21.15.146:0/3984901463 >> v2:172.21.15.151:3300/0 conn(0x7f2e2415a7f0 0x7f2e2415cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:29.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.447+0000 7f2e237fe700 1 --2- 172.21.15.146:0/3984901463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e240b2530 0x7f2e2415acd0 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f2e240b33c0 tx=0x7f2e1c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e46405c5b3e177ff server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:29.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.448+0000 7f2e227fc700 1 -- 172.21.15.146:0/3984901463 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c00e070 con 0x7f2e240b2530 2023-10-06T11:16:29.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.448+0000 7f2e227fc700 1 -- 172.21.15.146:0/3984901463 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e1c00bc30 con 0x7f2e240b2530 2023-10-06T11:16:29.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.448+0000 7f2e227fc700 1 -- 172.21.15.146:0/3984901463 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c012430 con 0x7f2e240b2530 2023-10-06T11:16:29.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.448+0000 7f2e23fff700 1 -- 172.21.15.146:0/3984901463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e240b2530 msgr2=0x7f2e2415acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:29.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.448+0000 7f2e23fff700 1 --2- 172.21.15.146:0/3984901463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e240b2530 0x7f2e2415acd0 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f2e240b33c0 tx=0x7f2e1c009780 comp rx=0 tx=0).stop 2023-10-06T11:16:29.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.448+0000 7f2e23fff700 1 -- 172.21.15.146:0/3984901463 shutdown_connections 2023-10-06T11:16:29.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.448+0000 7f2e23fff700 1 --2- 172.21.15.146:0/3984901463 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e240b2530 0x7f2e2415acd0 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:29.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.448+0000 7f2e23fff700 1 --2- 172.21.15.146:0/3984901463 >> v2:172.21.15.151:3300/0 conn(0x7f2e2415a7f0 0x7f2e2415cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:29.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.448+0000 7f2e23fff700 1 -- 172.21.15.146:0/3984901463 >> 172.21.15.146:0/3984901463 conn(0x7f2e2406eba0 msgr2=0x7f2e2406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:29.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.448+0000 7f2e23fff700 1 -- 172.21.15.146:0/3984901463 shutdown_connections 2023-10-06T11:16:29.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.448+0000 7f2e23fff700 1 -- 172.21.15.146:0/3984901463 wait complete. 2023-10-06T11:16:29.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.449+0000 7f2e23fff700 1 Processor -- start 2023-10-06T11:16:29.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.449+0000 7f2e23fff700 1 -- start start 2023-10-06T11:16:29.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.450+0000 7f2e23fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e240b2530 0x7f2e24156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:29.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.450+0000 7f2e23fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e2415a420 0x7f2e24141e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:29.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.450+0000 7f2e23fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e2415a7f0 0x7f2e240cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:29.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.450+0000 7f2e23fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e24154490 con 0x7f2e2415a420 2023-10-06T11:16:29.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.450+0000 7f2e23fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e241527e0 con 0x7f2e240b2530 2023-10-06T11:16:29.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.450+0000 7f2e23fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e241573d0 con 0x7f2e2415a7f0 2023-10-06T11:16:29.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.450+0000 7f2e1a7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e2415a420 0x7f2e24141e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:29.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.450+0000 7f2e1a7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e2415a420 0x7f2e24141e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49062/0 (socket says 172.21.15.146:49062) 2023-10-06T11:16:29.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.450+0000 7f2e1a7fc700 1 -- 172.21.15.146:0/3288859288 learned_addr learned my addr 172.21.15.146:0/3288859288 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:29.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.450+0000 7f2e237fe700 1 --2- 172.21.15.146:0/3288859288 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e2415a7f0 0x7f2e240cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:29.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.450+0000 7f2e22ffd700 1 --2- 172.21.15.146:0/3288859288 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e240b2530 0x7f2e24156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:29.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.450+0000 7f2e1a7fc700 1 -- 172.21.15.146:0/3288859288 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e2415a7f0 msgr2=0x7f2e240cfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:29.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.450+0000 7f2e1a7fc700 1 --2- 172.21.15.146:0/3288859288 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e2415a7f0 0x7f2e240cfa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:29.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.450+0000 7f2e1a7fc700 1 -- 172.21.15.146:0/3288859288 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e240b2530 msgr2=0x7f2e24156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:29.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.450+0000 7f2e1a7fc700 1 --2- 172.21.15.146:0/3288859288 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e240b2530 0x7f2e24156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:29.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.450+0000 7f2e1a7fc700 1 -- 172.21.15.146:0/3288859288 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e1c009a20 con 0x7f2e2415a420 2023-10-06T11:16:29.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.451+0000 7f2e1a7fc700 1 --2- 172.21.15.146:0/3288859288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e2415a420 0x7f2e24141e00 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c00d860 tx=0x7f2e0c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:29.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.451+0000 7f2e1b7fe700 1 -- 172.21.15.146:0/3288859288 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c0125f0 con 0x7f2e2415a420 2023-10-06T11:16:29.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.451+0000 7f2e1b7fe700 1 -- 172.21.15.146:0/3288859288 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0c012750 con 0x7f2e2415a420 2023-10-06T11:16:29.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.451+0000 7f2e23fff700 1 -- 172.21.15.146:0/3288859288 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e24151780 con 0x7f2e2415a420 2023-10-06T11:16:29.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.451+0000 7f2e1b7fe700 1 -- 172.21.15.146:0/3288859288 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e0c012ad0 con 0x7f2e2415a420 2023-10-06T11:16:29.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.451+0000 7f2e23fff700 1 -- 172.21.15.146:0/3288859288 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e24152190 con 0x7f2e2415a420 2023-10-06T11:16:29.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.452+0000 7f2e23fff700 1 -- 172.21.15.146:0/3288859288 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e240afae0 con 0x7f2e2415a420 2023-10-06T11:16:29.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.452+0000 7f2e1b7fe700 1 -- 172.21.15.146:0/3288859288 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2e0c014430 con 0x7f2e2415a420 2023-10-06T11:16:29.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.452+0000 7f2e1b7fe700 1 --2- 172.21.15.146:0/3288859288 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2e04066f30 0x7f2e040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:29.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.453+0000 7f2e1b7fe700 1 -- 172.21.15.146:0/3288859288 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2e0c084b80 con 0x7f2e2415a420 2023-10-06T11:16:29.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.453+0000 7f2e22ffd700 1 --2- 172.21.15.146:0/3288859288 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2e04066f30 0x7f2e040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:29.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.453+0000 7f2e22ffd700 1 --2- 172.21.15.146:0/3288859288 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2e04066f30 0x7f2e040693e0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f2e140011e0 tx=0x7f2e14009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:29.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.457+0000 7f2e1b7fe700 1 -- 172.21.15.146:0/3288859288 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2e0c051bf0 con 0x7f2e2415a420 2023-10-06T11:16:29.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.635+0000 7f2e23fff700 1 -- 172.21.15.146:0/3288859288 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2e2404bb40 con 0x7f2e04066f30 2023-10-06T11:16:29.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.644+0000 7f2e1b7fe700 1 -- 172.21.15.146:0/3288859288 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+312120 (secure 0 0 0) 0x7f2e2404bb40 con 0x7f2e04066f30 2023-10-06T11:16:29.649 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:16:29.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.647+0000 7f2e23fff700 1 -- 172.21.15.146:0/3288859288 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2e04066f30 msgr2=0x7f2e040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:29.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.647+0000 7f2e23fff700 1 --2- 172.21.15.146:0/3288859288 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2e04066f30 0x7f2e040693e0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f2e140011e0 tx=0x7f2e14009040 comp rx=0 tx=0).stop 2023-10-06T11:16:29.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.647+0000 7f2e23fff700 1 -- 172.21.15.146:0/3288859288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e2415a420 msgr2=0x7f2e24141e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:29.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.647+0000 7f2e23fff700 1 --2- 172.21.15.146:0/3288859288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e2415a420 0x7f2e24141e00 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f2e0c00d860 tx=0x7f2e0c008040 comp rx=0 tx=0).stop 2023-10-06T11:16:29.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.647+0000 7f2e23fff700 1 -- 172.21.15.146:0/3288859288 shutdown_connections 2023-10-06T11:16:29.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.647+0000 7f2e23fff700 1 --2- 172.21.15.146:0/3288859288 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2e04066f30 0x7f2e040693e0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:29.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.647+0000 7f2e23fff700 1 --2- 172.21.15.146:0/3288859288 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e2415a7f0 0x7f2e240cfa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:29.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.647+0000 7f2e23fff700 1 --2- 172.21.15.146:0/3288859288 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e240b2530 0x7f2e24156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:29.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.647+0000 7f2e23fff700 1 --2- 172.21.15.146:0/3288859288 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2e2415a420 0x7f2e24141e00 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:29.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.647+0000 7f2e23fff700 1 -- 172.21.15.146:0/3288859288 >> 172.21.15.146:0/3288859288 conn(0x7f2e2406eba0 msgr2=0x7f2e2414d710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:29.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.647+0000 7f2e23fff700 1 -- 172.21.15.146:0/3288859288 shutdown_connections 2023-10-06T11:16:29.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:29.647+0000 7f2e23fff700 1 -- 172.21.15.146:0/3288859288 wait complete. 2023-10-06T11:16:29.652 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:16:29.661 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":456,"stamp":"2023-10-06T11:16:29.279071+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":203,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2437976,"kb_used_data":14616,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752536744,"statfs":{"total":773094113280,"available":770597625856,"internally_reserved":0,"allocated":14966784,"data_stored":7494456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.196636"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.114163+0000","last_change":"2023-10-06T11:16:24.109016+0000","last_active":"2023-10-06T11:16:24.114163+0000","last_peered":"2023-10-06T11:16:24.114163+0000","last_clean":"2023-10-06T11:16:24.114163+0000","last_became_active":"2023-10-06T11:16:24.108230+0000","last_became_peered":"2023-10-06T11:16:24.108230+0000","last_unstale":"2023-10-06T11:16:24.114163+0000","last_undegraded":"2023-10-06T11:16:24.114163+0000","last_fullsized":"2023-10-06T11:16:24.114163+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:46:32.933025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.113900+0000","last_change":"2023-10-06T11:16:24.109332+0000","last_active":"2023-10-06T11:16:24.113900+0000","last_peered":"2023-10-06T11:16:24.113900+0000","last_clean":"2023-10-06T11:16:24.113900+0000","last_became_active":"2023-10-06T11:16:24.109078+0000","last_became_peered":"2023-10-06T11:16:24.109078+0000","last_unstale":"2023-10-06T11:16:24.113900+0000","last_undegraded":"2023-10-06T11:16:24.113900+0000","last_fullsized":"2023-10-06T11:16:24.113900+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:01:06.788901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.119393+0000","last_change":"2023-10-06T11:16:24.117527+0000","last_active":"2023-10-06T11:16:24.119393+0000","last_peered":"2023-10-06T11:16:24.119393+0000","last_clean":"2023-10-06T11:16:24.119393+0000","last_became_active":"2023-10-06T11:16:24.117195+0000","last_became_peered":"2023-10-06T11:16:24.117195+0000","last_unstale":"2023-10-06T11:16:24.119393+0000","last_undegraded":"2023-10-06T11:16:24.119393+0000","last_fullsized":"2023-10-06T11:16:24.119393+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:09:31.548998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116257+0000","last_change":"2023-10-06T11:16:24.110210+0000","last_active":"2023-10-06T11:16:24.116257+0000","last_peered":"2023-10-06T11:16:24.116257+0000","last_clean":"2023-10-06T11:16:24.116257+0000","last_became_active":"2023-10-06T11:16:24.109785+0000","last_became_peered":"2023-10-06T11:16:24.109785+0000","last_unstale":"2023-10-06T11:16:24.116257+0000","last_undegraded":"2023-10-06T11:16:24.116257+0000","last_fullsized":"2023-10-06T11:16:24.116257+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:23:32.999587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.114773+0000","last_change":"2023-10-06T11:16:24.108647+0000","last_active":"2023-10-06T11:16:24.114773+0000","last_peered":"2023-10-06T11:16:24.114773+0000","last_clean":"2023-10-06T11:16:24.114773+0000","last_became_active":"2023-10-06T11:16:24.108417+0000","last_became_peered":"2023-10-06T11:16:24.108417+0000","last_unstale":"2023-10-06T11:16:24.114773+0000","last_undegraded":"2023-10-06T11:16:24.114773+0000","last_fullsized":"2023-10-06T11:16:24.114773+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:26:03.575635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116075+0000","last_change":"2023-10-06T11:16:24.108739+0000","last_active":"2023-10-06T11:16:24.116075+0000","last_peered":"2023-10-06T11:16:24.116075+0000","last_clean":"2023-10-06T11:16:24.116075+0000","last_became_active":"2023-10-06T11:16:24.108453+0000","last_became_peered":"2023-10-06T11:16:24.108453+0000","last_unstale":"2023-10-06T11:16:24.116075+0000","last_undegraded":"2023-10-06T11:16:24.116075+0000","last_fullsized":"2023-10-06T11:16:24.116075+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:59:45.901579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.120838+0000","last_change":"2023-10-06T11:16:24.115798+0000","last_active":"2023-10-06T11:16:24.120838+0000","last_peered":"2023-10-06T11:16:24.120838+0000","last_clean":"2023-10-06T11:16:24.120838+0000","last_became_active":"2023-10-06T11:16:24.115530+0000","last_became_peered":"2023-10-06T11:16:24.115530+0000","last_unstale":"2023-10-06T11:16:24.120838+0000","last_undegraded":"2023-10-06T11:16:24.120838+0000","last_fullsized":"2023-10-06T11:16:24.120838+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:26:32.565614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.114861+0000","last_change":"2023-10-06T11:16:24.112572+0000","last_active":"2023-10-06T11:16:24.114861+0000","last_peered":"2023-10-06T11:16:24.114861+0000","last_clean":"2023-10-06T11:16:24.114861+0000","last_became_active":"2023-10-06T11:16:24.109041+0000","last_became_peered":"2023-10-06T11:16:24.109041+0000","last_unstale":"2023-10-06T11:16:24.114861+0000","last_undegraded":"2023-10-06T11:16:24.114861+0000","last_fullsized":"2023-10-06T11:16:24.114861+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:11.876870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116267+0000","last_change":"2023-10-06T11:16:24.112144+0000","last_active":"2023-10-06T11:16:24.116267+0000","last_peered":"2023-10-06T11:16:24.116267+0000","last_clean":"2023-10-06T11:16:24.116267+0000","last_became_active":"2023-10-06T11:16:24.111426+0000","last_became_peered":"2023-10-06T11:16:24.111426+0000","last_unstale":"2023-10-06T11:16:24.116267+0000","last_undegraded":"2023-10-06T11:16:24.116267+0000","last_fullsized":"2023-10-06T11:16:24.116267+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:12:06.066982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116349+0000","last_change":"2023-10-06T11:16:24.113655+0000","last_active":"2023-10-06T11:16:24.116349+0000","last_peered":"2023-10-06T11:16:24.116349+0000","last_clean":"2023-10-06T11:16:24.116349+0000","last_became_active":"2023-10-06T11:16:24.113399+0000","last_became_peered":"2023-10-06T11:16:24.113399+0000","last_unstale":"2023-10-06T11:16:24.116349+0000","last_undegraded":"2023-10-06T11:16:24.116349+0000","last_fullsized":"2023-10-06T11:16:24.116349+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:50:16.146183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121936+0000","last_change":"2023-10-06T11:16:24.119814+0000","last_active":"2023-10-06T11:16:24.121936+0000","last_peered":"2023-10-06T11:16:24.121936+0000","last_clean":"2023-10-06T11:16:24.121936+0000","last_became_active":"2023-10-06T11:16:24.119316+0000","last_became_peered":"2023-10-06T11:16:24.119316+0000","last_unstale":"2023-10-06T11:16:24.121936+0000","last_undegraded":"2023-10-06T11:16:24.121936+0000","last_fullsized":"2023-10-06T11:16:24.121936+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:26.166829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.114541+0000","last_change":"2023-10-06T11:16:24.109182+0000","last_active":"2023-10-06T11:16:24.114541+0000","last_peered":"2023-10-06T11:16:24.114541+0000","last_clean":"2023-10-06T11:16:24.114541+0000","last_became_active":"2023-10-06T11:16:24.108845+0000","last_became_peered":"2023-10-06T11:16:24.108845+0000","last_unstale":"2023-10-06T11:16:24.114541+0000","last_undegraded":"2023-10-06T11:16:24.114541+0000","last_fullsized":"2023-10-06T11:16:24.114541+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:29:01.304906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116386+0000","last_change":"2023-10-06T11:16:24.113716+0000","last_active":"2023-10-06T11:16:24.116386+0000","last_peered":"2023-10-06T11:16:24.116386+0000","last_clean":"2023-10-06T11:16:24.116386+0000","last_became_active":"2023-10-06T11:16:24.113447+0000","last_became_peered":"2023-10-06T11:16:24.113447+0000","last_unstale":"2023-10-06T11:16:24.116386+0000","last_undegraded":"2023-10-06T11:16:24.116386+0000","last_fullsized":"2023-10-06T11:16:24.116386+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:28.023957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.115716+0000","last_change":"2023-10-06T11:16:24.110152+0000","last_active":"2023-10-06T11:16:24.115716+0000","last_peered":"2023-10-06T11:16:24.115716+0000","last_clean":"2023-10-06T11:16:24.115716+0000","last_became_active":"2023-10-06T11:16:24.108867+0000","last_became_peered":"2023-10-06T11:16:24.108867+0000","last_unstale":"2023-10-06T11:16:24.115716+0000","last_undegraded":"2023-10-06T11:16:24.115716+0000","last_fullsized":"2023-10-06T11:16:24.115716+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:34.956629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.114671+0000","last_change":"2023-10-06T11:16:24.110834+0000","last_active":"2023-10-06T11:16:24.114671+0000","last_peered":"2023-10-06T11:16:24.114671+0000","last_clean":"2023-10-06T11:16:24.114671+0000","last_became_active":"2023-10-06T11:16:24.110085+0000","last_became_peered":"2023-10-06T11:16:24.110085+0000","last_unstale":"2023-10-06T11:16:24.114671+0000","last_undegraded":"2023-10-06T11:16:24.114671+0000","last_fullsized":"2023-10-06T11:16:24.114671+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:26:32.565614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.106632+0000","last_change":"2023-10-06T11:16:24.103595+0000","last_active":"2023-10-06T11:16:24.106632+0000","last_peered":"2023-10-06T11:16:24.106632+0000","last_clean":"2023-10-06T11:16:24.106632+0000","last_became_active":"2023-10-06T11:16:24.103341+0000","last_became_peered":"2023-10-06T11:16:24.103341+0000","last_unstale":"2023-10-06T11:16:24.106632+0000","last_undegraded":"2023-10-06T11:16:24.106632+0000","last_fullsized":"2023-10-06T11:16:24.106632+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:30:19.278442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121404+0000","last_change":"2023-10-06T11:16:24.115304+0000","last_active":"2023-10-06T11:16:24.121404+0000","last_peered":"2023-10-06T11:16:24.121404+0000","last_clean":"2023-10-06T11:16:24.121404+0000","last_became_active":"2023-10-06T11:16:24.114874+0000","last_became_peered":"2023-10-06T11:16:24.114874+0000","last_unstale":"2023-10-06T11:16:24.121404+0000","last_undegraded":"2023-10-06T11:16:24.121404+0000","last_fullsized":"2023-10-06T11:16:24.121404+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:24:33.125902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.120354+0000","last_change":"2023-10-06T11:16:24.107132+0000","last_active":"2023-10-06T11:16:24.120354+0000","last_peered":"2023-10-06T11:16:24.120354+0000","last_clean":"2023-10-06T11:16:24.120354+0000","last_became_active":"2023-10-06T11:16:24.106714+0000","last_became_peered":"2023-10-06T11:16:24.106714+0000","last_unstale":"2023-10-06T11:16:24.120354+0000","last_undegraded":"2023-10-06T11:16:24.120354+0000","last_fullsized":"2023-10-06T11:16:24.120354+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:08.737914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121851+0000","last_change":"2023-10-06T11:16:24.116978+0000","last_active":"2023-10-06T11:16:24.121851+0000","last_peered":"2023-10-06T11:16:24.121851+0000","last_clean":"2023-10-06T11:16:24.121851+0000","last_became_active":"2023-10-06T11:16:24.116483+0000","last_became_peered":"2023-10-06T11:16:24.116483+0000","last_unstale":"2023-10-06T11:16:24.121851+0000","last_undegraded":"2023-10-06T11:16:24.121851+0000","last_fullsized":"2023-10-06T11:16:24.121851+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:07.106736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.112359+0000","last_change":"2023-10-06T11:16:24.101538+0000","last_active":"2023-10-06T11:16:24.112359+0000","last_peered":"2023-10-06T11:16:24.112359+0000","last_clean":"2023-10-06T11:16:24.112359+0000","last_became_active":"2023-10-06T11:16:24.101276+0000","last_became_peered":"2023-10-06T11:16:24.101276+0000","last_unstale":"2023-10-06T11:16:24.112359+0000","last_undegraded":"2023-10-06T11:16:24.112359+0000","last_fullsized":"2023-10-06T11:16:24.112359+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:26:02.681339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.118962+0000","last_change":"2023-10-06T11:16:24.117423+0000","last_active":"2023-10-06T11:16:24.118962+0000","last_peered":"2023-10-06T11:16:24.118962+0000","last_clean":"2023-10-06T11:16:24.118962+0000","last_became_active":"2023-10-06T11:16:24.117137+0000","last_became_peered":"2023-10-06T11:16:24.117137+0000","last_unstale":"2023-10-06T11:16:24.118962+0000","last_undegraded":"2023-10-06T11:16:24.118962+0000","last_fullsized":"2023-10-06T11:16:24.118962+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:17.086479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.119950+0000","last_change":"2023-10-06T11:16:24.112281+0000","last_active":"2023-10-06T11:16:24.119950+0000","last_peered":"2023-10-06T11:16:24.119950+0000","last_clean":"2023-10-06T11:16:24.119950+0000","last_became_active":"2023-10-06T11:16:24.111821+0000","last_became_peered":"2023-10-06T11:16:24.111821+0000","last_unstale":"2023-10-06T11:16:24.119950+0000","last_undegraded":"2023-10-06T11:16:24.119950+0000","last_fullsized":"2023-10-06T11:16:24.119950+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:11.876870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.106869+0000","last_change":"2023-10-06T11:16:24.104606+0000","last_active":"2023-10-06T11:16:24.106869+0000","last_peered":"2023-10-06T11:16:24.106869+0000","last_clean":"2023-10-06T11:16:24.106869+0000","last_became_active":"2023-10-06T11:16:24.104331+0000","last_became_peered":"2023-10-06T11:16:24.104331+0000","last_unstale":"2023-10-06T11:16:24.106869+0000","last_undegraded":"2023-10-06T11:16:24.106869+0000","last_fullsized":"2023-10-06T11:16:24.106869+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:51:39.490885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.108707+0000","last_change":"2023-10-06T11:16:24.105272+0000","last_active":"2023-10-06T11:16:24.108707+0000","last_peered":"2023-10-06T11:16:24.108707+0000","last_clean":"2023-10-06T11:16:24.108707+0000","last_became_active":"2023-10-06T11:16:24.104836+0000","last_became_peered":"2023-10-06T11:16:24.104836+0000","last_unstale":"2023-10-06T11:16:24.108707+0000","last_undegraded":"2023-10-06T11:16:24.108707+0000","last_fullsized":"2023-10-06T11:16:24.108707+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:20:21.978391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.114191+0000","last_change":"2023-10-06T11:16:24.109203+0000","last_active":"2023-10-06T11:16:24.114191+0000","last_peered":"2023-10-06T11:16:24.114191+0000","last_clean":"2023-10-06T11:16:24.114191+0000","last_became_active":"2023-10-06T11:16:24.103632+0000","last_became_peered":"2023-10-06T11:16:24.103632+0000","last_unstale":"2023-10-06T11:16:24.114191+0000","last_undegraded":"2023-10-06T11:16:24.114191+0000","last_fullsized":"2023-10-06T11:16:24.114191+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:21:48.286337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.119621+0000","last_change":"2023-10-06T11:16:24.112055+0000","last_active":"2023-10-06T11:16:24.119621+0000","last_peered":"2023-10-06T11:16:24.119621+0000","last_clean":"2023-10-06T11:16:24.119621+0000","last_became_active":"2023-10-06T11:16:24.111459+0000","last_became_peered":"2023-10-06T11:16:24.111459+0000","last_unstale":"2023-10-06T11:16:24.119621+0000","last_undegraded":"2023-10-06T11:16:24.119621+0000","last_fullsized":"2023-10-06T11:16:24.119621+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:56:01.575492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116536+0000","last_change":"2023-10-06T11:16:24.114696+0000","last_active":"2023-10-06T11:16:24.116536+0000","last_peered":"2023-10-06T11:16:24.116536+0000","last_clean":"2023-10-06T11:16:24.116536+0000","last_became_active":"2023-10-06T11:16:24.114468+0000","last_became_peered":"2023-10-06T11:16:24.114468+0000","last_unstale":"2023-10-06T11:16:24.116536+0000","last_undegraded":"2023-10-06T11:16:24.116536+0000","last_fullsized":"2023-10-06T11:16:24.116536+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:29.132592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121795+0000","last_change":"2023-10-06T11:16:24.118093+0000","last_active":"2023-10-06T11:16:24.121795+0000","last_peered":"2023-10-06T11:16:24.121795+0000","last_clean":"2023-10-06T11:16:24.121795+0000","last_became_active":"2023-10-06T11:16:24.117790+0000","last_became_peered":"2023-10-06T11:16:24.117790+0000","last_unstale":"2023-10-06T11:16:24.121795+0000","last_undegraded":"2023-10-06T11:16:24.121795+0000","last_fullsized":"2023-10-06T11:16:24.121795+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:47:48.803032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.105021+0000","last_change":"2023-10-06T11:16:24.103268+0000","last_active":"2023-10-06T11:16:24.105021+0000","last_peered":"2023-10-06T11:16:24.105021+0000","last_clean":"2023-10-06T11:16:24.105021+0000","last_became_active":"2023-10-06T11:16:24.101418+0000","last_became_peered":"2023-10-06T11:16:24.101418+0000","last_unstale":"2023-10-06T11:16:24.105021+0000","last_undegraded":"2023-10-06T11:16:24.105021+0000","last_fullsized":"2023-10-06T11:16:24.105021+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:00:16.902527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121730+0000","last_change":"2023-10-06T11:16:24.118266+0000","last_active":"2023-10-06T11:16:24.121730+0000","last_peered":"2023-10-06T11:16:24.121730+0000","last_clean":"2023-10-06T11:16:24.121730+0000","last_became_active":"2023-10-06T11:16:24.118001+0000","last_became_peered":"2023-10-06T11:16:24.118001+0000","last_unstale":"2023-10-06T11:16:24.121730+0000","last_undegraded":"2023-10-06T11:16:24.121730+0000","last_fullsized":"2023-10-06T11:16:24.121730+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:59:42.744899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.107924+0000","last_change":"2023-10-06T11:16:24.103535+0000","last_active":"2023-10-06T11:16:24.107924+0000","last_peered":"2023-10-06T11:16:24.107924+0000","last_clean":"2023-10-06T11:16:24.107924+0000","last_became_active":"2023-10-06T11:16:24.103293+0000","last_became_peered":"2023-10-06T11:16:24.103293+0000","last_unstale":"2023-10-06T11:16:24.107924+0000","last_undegraded":"2023-10-06T11:16:24.107924+0000","last_fullsized":"2023-10-06T11:16:24.107924+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:10:53.231459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.114840+0000","last_change":"2023-10-06T11:16:24.112213+0000","last_active":"2023-10-06T11:16:24.114840+0000","last_peered":"2023-10-06T11:16:24.114840+0000","last_clean":"2023-10-06T11:16:24.114840+0000","last_became_active":"2023-10-06T11:16:24.111913+0000","last_became_peered":"2023-10-06T11:16:24.111913+0000","last_unstale":"2023-10-06T11:16:24.114840+0000","last_undegraded":"2023-10-06T11:16:24.114840+0000","last_fullsized":"2023-10-06T11:16:24.114840+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:26:32.565614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.115511+0000","last_change":"2023-10-06T11:16:24.114570+0000","last_active":"2023-10-06T11:16:24.115511+0000","last_peered":"2023-10-06T11:16:24.115511+0000","last_clean":"2023-10-06T11:16:24.115511+0000","last_became_active":"2023-10-06T11:16:24.114308+0000","last_became_peered":"2023-10-06T11:16:24.114308+0000","last_unstale":"2023-10-06T11:16:24.115511+0000","last_undegraded":"2023-10-06T11:16:24.115511+0000","last_fullsized":"2023-10-06T11:16:24.115511+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:51:39.490885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"136'4","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.118823+0000","last_change":"2023-10-06T11:16:23.099064+0000","last_active":"2023-10-06T11:16:24.118823+0000","last_peered":"2023-10-06T11:16:24.118823+0000","last_clean":"2023-10-06T11:16:24.118823+0000","last_became_active":"2023-10-06T11:16:23.098801+0000","last_became_peered":"2023-10-06T11:16:23.098801+0000","last_unstale":"2023-10-06T11:16:24.118823+0000","last_undegraded":"2023-10-06T11:16:24.118823+0000","last_fullsized":"2023-10-06T11:16:24.118823+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:41:43.291967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.114685+0000","last_change":"2023-10-06T11:16:24.109497+0000","last_active":"2023-10-06T11:16:24.114685+0000","last_peered":"2023-10-06T11:16:24.114685+0000","last_clean":"2023-10-06T11:16:24.114685+0000","last_became_active":"2023-10-06T11:16:24.109294+0000","last_became_peered":"2023-10-06T11:16:24.109294+0000","last_unstale":"2023-10-06T11:16:24.114685+0000","last_undegraded":"2023-10-06T11:16:24.114685+0000","last_fullsized":"2023-10-06T11:16:24.114685+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:56:01.575492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"136'1","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121286+0000","last_change":"2023-10-06T11:16:23.104447+0000","last_active":"2023-10-06T11:16:24.121286+0000","last_peered":"2023-10-06T11:16:24.121286+0000","last_clean":"2023-10-06T11:16:24.121286+0000","last_became_active":"2023-10-06T11:16:23.104161+0000","last_became_peered":"2023-10-06T11:16:23.104161+0000","last_unstale":"2023-10-06T11:16:24.121286+0000","last_undegraded":"2023-10-06T11:16:24.121286+0000","last_fullsized":"2023-10-06T11:16:24.121286+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:56:00.571220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.111352+0000","last_change":"2023-10-06T11:16:24.109988+0000","last_active":"2023-10-06T11:16:24.111352+0000","last_peered":"2023-10-06T11:16:24.111352+0000","last_clean":"2023-10-06T11:16:24.111352+0000","last_became_active":"2023-10-06T11:16:24.108764+0000","last_became_peered":"2023-10-06T11:16:24.108764+0000","last_unstale":"2023-10-06T11:16:24.111352+0000","last_undegraded":"2023-10-06T11:16:24.111352+0000","last_fullsized":"2023-10-06T11:16:24.111352+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:00.422039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.123951+0000","last_change":"2023-10-06T11:16:23.104220+0000","last_active":"2023-10-06T11:16:24.123951+0000","last_peered":"2023-10-06T11:16:24.123951+0000","last_clean":"2023-10-06T11:16:24.123951+0000","last_became_active":"2023-10-06T11:16:23.103920+0000","last_became_peered":"2023-10-06T11:16:23.103920+0000","last_unstale":"2023-10-06T11:16:24.123951+0000","last_undegraded":"2023-10-06T11:16:24.123951+0000","last_fullsized":"2023-10-06T11:16:24.123951+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:50.360247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.122009+0000","last_change":"2023-10-06T11:16:24.118231+0000","last_active":"2023-10-06T11:16:24.122009+0000","last_peered":"2023-10-06T11:16:24.122009+0000","last_clean":"2023-10-06T11:16:24.122009+0000","last_became_active":"2023-10-06T11:16:24.117962+0000","last_became_peered":"2023-10-06T11:16:24.117962+0000","last_unstale":"2023-10-06T11:16:24.122009+0000","last_undegraded":"2023-10-06T11:16:24.122009+0000","last_fullsized":"2023-10-06T11:16:24.122009+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:34:42.484972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.115288+0000","last_change":"2023-10-06T11:16:23.095632+0000","last_active":"2023-10-06T11:16:24.115288+0000","last_peered":"2023-10-06T11:16:24.115288+0000","last_clean":"2023-10-06T11:16:24.115288+0000","last_became_active":"2023-10-06T11:16:23.095155+0000","last_became_peered":"2023-10-06T11:16:23.095155+0000","last_unstale":"2023-10-06T11:16:24.115288+0000","last_undegraded":"2023-10-06T11:16:24.115288+0000","last_fullsized":"2023-10-06T11:16:24.115288+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:29.555606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.113203+0000","last_change":"2023-10-06T11:16:24.105810+0000","last_active":"2023-10-06T11:16:24.113203+0000","last_peered":"2023-10-06T11:16:24.113203+0000","last_clean":"2023-10-06T11:16:24.113203+0000","last_became_active":"2023-10-06T11:16:24.105537+0000","last_became_peered":"2023-10-06T11:16:24.105537+0000","last_unstale":"2023-10-06T11:16:24.113203+0000","last_undegraded":"2023-10-06T11:16:24.113203+0000","last_fullsized":"2023-10-06T11:16:24.113203+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:42:42.357861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"136'1","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121542+0000","last_change":"2023-10-06T11:16:23.097141+0000","last_active":"2023-10-06T11:16:24.121542+0000","last_peered":"2023-10-06T11:16:24.121542+0000","last_clean":"2023-10-06T11:16:24.121542+0000","last_became_active":"2023-10-06T11:16:23.096642+0000","last_became_peered":"2023-10-06T11:16:23.096642+0000","last_unstale":"2023-10-06T11:16:24.121542+0000","last_undegraded":"2023-10-06T11:16:24.121542+0000","last_fullsized":"2023-10-06T11:16:24.121542+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:23:39.341387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.114034+0000","last_change":"2023-10-06T11:16:24.109556+0000","last_active":"2023-10-06T11:16:24.114034+0000","last_peered":"2023-10-06T11:16:24.114034+0000","last_clean":"2023-10-06T11:16:24.114034+0000","last_became_active":"2023-10-06T11:16:24.109278+0000","last_became_peered":"2023-10-06T11:16:24.109278+0000","last_unstale":"2023-10-06T11:16:24.114034+0000","last_undegraded":"2023-10-06T11:16:24.114034+0000","last_fullsized":"2023-10-06T11:16:24.114034+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:56:39.904546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"136'1","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116331+0000","last_change":"2023-10-06T11:16:23.099499+0000","last_active":"2023-10-06T11:16:24.116331+0000","last_peered":"2023-10-06T11:16:24.116331+0000","last_clean":"2023-10-06T11:16:24.116331+0000","last_became_active":"2023-10-06T11:16:23.099285+0000","last_became_peered":"2023-10-06T11:16:23.099285+0000","last_unstale":"2023-10-06T11:16:24.116331+0000","last_undegraded":"2023-10-06T11:16:24.116331+0000","last_fullsized":"2023-10-06T11:16:24.116331+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:56:00.571220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.100085+0000","last_change":"2023-10-06T11:16:24.099610+0000","last_active":"2023-10-06T11:16:24.100085+0000","last_peered":"2023-10-06T11:16:24.100085+0000","last_clean":"2023-10-06T11:16:24.100085+0000","last_became_active":"2023-10-06T11:16:24.099351+0000","last_became_peered":"2023-10-06T11:16:24.099351+0000","last_unstale":"2023-10-06T11:16:24.100085+0000","last_undegraded":"2023-10-06T11:16:24.100085+0000","last_fullsized":"2023-10-06T11:16:24.100085+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:28.341917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.095986+0000","last_change":"2023-10-06T11:16:23.100854+0000","last_active":"2023-10-06T11:16:24.095986+0000","last_peered":"2023-10-06T11:16:24.095986+0000","last_clean":"2023-10-06T11:16:24.095986+0000","last_became_active":"2023-10-06T11:16:23.100200+0000","last_became_peered":"2023-10-06T11:16:23.100200+0000","last_unstale":"2023-10-06T11:16:24.095986+0000","last_undegraded":"2023-10-06T11:16:24.095986+0000","last_fullsized":"2023-10-06T11:16:24.095986+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:22:40.220215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.107002+0000","last_change":"2023-10-06T11:16:24.104492+0000","last_active":"2023-10-06T11:16:24.107002+0000","last_peered":"2023-10-06T11:16:24.107002+0000","last_clean":"2023-10-06T11:16:24.107002+0000","last_became_active":"2023-10-06T11:16:24.104181+0000","last_became_peered":"2023-10-06T11:16:24.104181+0000","last_unstale":"2023-10-06T11:16:24.107002+0000","last_undegraded":"2023-10-06T11:16:24.107002+0000","last_fullsized":"2023-10-06T11:16:24.107002+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:55:36.589699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.098162+0000","last_change":"2023-10-06T11:16:23.097833+0000","last_active":"2023-10-06T11:16:24.098162+0000","last_peered":"2023-10-06T11:16:24.098162+0000","last_clean":"2023-10-06T11:16:24.098162+0000","last_became_active":"2023-10-06T11:16:23.097560+0000","last_became_peered":"2023-10-06T11:16:23.097560+0000","last_unstale":"2023-10-06T11:16:24.098162+0000","last_undegraded":"2023-10-06T11:16:24.098162+0000","last_fullsized":"2023-10-06T11:16:24.098162+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:01:05.784628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121995+0000","last_change":"2023-10-06T11:16:24.118160+0000","last_active":"2023-10-06T11:16:24.121995+0000","last_peered":"2023-10-06T11:16:24.121995+0000","last_clean":"2023-10-06T11:16:24.121995+0000","last_became_active":"2023-10-06T11:16:24.117892+0000","last_became_peered":"2023-10-06T11:16:24.117892+0000","last_unstale":"2023-10-06T11:16:24.121995+0000","last_undegraded":"2023-10-06T11:16:24.121995+0000","last_fullsized":"2023-10-06T11:16:24.121995+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:52.405684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"136'1","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121722+0000","last_change":"2023-10-06T11:16:23.100806+0000","last_active":"2023-10-06T11:16:24.121722+0000","last_peered":"2023-10-06T11:16:24.121722+0000","last_clean":"2023-10-06T11:16:24.121722+0000","last_became_active":"2023-10-06T11:16:23.099910+0000","last_became_peered":"2023-10-06T11:16:23.099910+0000","last_unstale":"2023-10-06T11:16:24.121722+0000","last_undegraded":"2023-10-06T11:16:24.121722+0000","last_fullsized":"2023-10-06T11:16:24.121722+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:21:56.372977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.119434+0000","last_change":"2023-10-06T11:16:24.115023+0000","last_active":"2023-10-06T11:16:24.119434+0000","last_peered":"2023-10-06T11:16:24.119434+0000","last_clean":"2023-10-06T11:16:24.119434+0000","last_became_active":"2023-10-06T11:16:24.114720+0000","last_became_peered":"2023-10-06T11:16:24.114720+0000","last_unstale":"2023-10-06T11:16:24.119434+0000","last_undegraded":"2023-10-06T11:16:24.119434+0000","last_fullsized":"2023-10-06T11:16:24.119434+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:19.593270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121773+0000","last_change":"2023-10-06T11:16:23.103494+0000","last_active":"2023-10-06T11:16:24.121773+0000","last_peered":"2023-10-06T11:16:24.121773+0000","last_clean":"2023-10-06T11:16:24.121773+0000","last_became_active":"2023-10-06T11:16:23.103217+0000","last_became_peered":"2023-10-06T11:16:23.103217+0000","last_unstale":"2023-10-06T11:16:24.121773+0000","last_undegraded":"2023-10-06T11:16:24.121773+0000","last_fullsized":"2023-10-06T11:16:24.121773+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:01:05.784628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.107033+0000","last_change":"2023-10-06T11:16:24.104031+0000","last_active":"2023-10-06T11:16:24.107033+0000","last_peered":"2023-10-06T11:16:24.107033+0000","last_clean":"2023-10-06T11:16:24.107033+0000","last_became_active":"2023-10-06T11:16:24.103748+0000","last_became_peered":"2023-10-06T11:16:24.103748+0000","last_unstale":"2023-10-06T11:16:24.107033+0000","last_undegraded":"2023-10-06T11:16:24.107033+0000","last_fullsized":"2023-10-06T11:16:24.107033+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:51.364520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"136'1","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116628+0000","last_change":"2023-10-06T11:16:23.096904+0000","last_active":"2023-10-06T11:16:24.116628+0000","last_peered":"2023-10-06T11:16:24.116628+0000","last_clean":"2023-10-06T11:16:24.116628+0000","last_became_active":"2023-10-06T11:16:23.096415+0000","last_became_peered":"2023-10-06T11:16:23.096415+0000","last_unstale":"2023-10-06T11:16:24.116628+0000","last_undegraded":"2023-10-06T11:16:24.116628+0000","last_fullsized":"2023-10-06T11:16:24.116628+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:22:40.220215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.119617+0000","last_change":"2023-10-06T11:16:24.114058+0000","last_active":"2023-10-06T11:16:24.119617+0000","last_peered":"2023-10-06T11:16:24.119617+0000","last_clean":"2023-10-06T11:16:24.119617+0000","last_became_active":"2023-10-06T11:16:24.111051+0000","last_became_peered":"2023-10-06T11:16:24.111051+0000","last_unstale":"2023-10-06T11:16:24.119617+0000","last_undegraded":"2023-10-06T11:16:24.119617+0000","last_fullsized":"2023-10-06T11:16:24.119617+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:46:59.369734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.100537+0000","last_change":"2023-10-06T11:16:23.100758+0000","last_active":"2023-10-06T11:16:24.100537+0000","last_peered":"2023-10-06T11:16:24.100537+0000","last_clean":"2023-10-06T11:16:24.100537+0000","last_became_active":"2023-10-06T11:16:23.100386+0000","last_became_peered":"2023-10-06T11:16:23.100386+0000","last_unstale":"2023-10-06T11:16:24.100537+0000","last_undegraded":"2023-10-06T11:16:24.100537+0000","last_fullsized":"2023-10-06T11:16:24.100537+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:21:40.808593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121900+0000","last_change":"2023-10-06T11:16:24.116989+0000","last_active":"2023-10-06T11:16:24.121900+0000","last_peered":"2023-10-06T11:16:24.121900+0000","last_clean":"2023-10-06T11:16:24.121900+0000","last_became_active":"2023-10-06T11:16:24.116709+0000","last_became_peered":"2023-10-06T11:16:24.116709+0000","last_unstale":"2023-10-06T11:16:24.121900+0000","last_undegraded":"2023-10-06T11:16:24.121900+0000","last_fullsized":"2023-10-06T11:16:24.121900+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:37:37.920152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.118772+0000","last_change":"2023-10-06T11:16:23.094553+0000","last_active":"2023-10-06T11:16:24.118772+0000","last_peered":"2023-10-06T11:16:24.118772+0000","last_clean":"2023-10-06T11:16:24.118772+0000","last_became_active":"2023-10-06T11:16:23.094319+0000","last_became_peered":"2023-10-06T11:16:23.094319+0000","last_unstale":"2023-10-06T11:16:24.118772+0000","last_undegraded":"2023-10-06T11:16:24.118772+0000","last_fullsized":"2023-10-06T11:16:24.118772+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:28.128320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.110934+0000","last_change":"2023-10-06T11:16:24.105441+0000","last_active":"2023-10-06T11:16:24.110934+0000","last_peered":"2023-10-06T11:16:24.110934+0000","last_clean":"2023-10-06T11:16:24.110934+0000","last_became_active":"2023-10-06T11:16:24.105198+0000","last_became_peered":"2023-10-06T11:16:24.105198+0000","last_unstale":"2023-10-06T11:16:24.110934+0000","last_undegraded":"2023-10-06T11:16:24.110934+0000","last_fullsized":"2023-10-06T11:16:24.110934+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:17:35.914399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.097721+0000","last_change":"2023-10-06T11:16:23.095380+0000","last_active":"2023-10-06T11:16:24.097721+0000","last_peered":"2023-10-06T11:16:24.097721+0000","last_clean":"2023-10-06T11:16:24.097721+0000","last_became_active":"2023-10-06T11:16:23.095085+0000","last_became_peered":"2023-10-06T11:16:23.095085+0000","last_unstale":"2023-10-06T11:16:24.097721+0000","last_undegraded":"2023-10-06T11:16:24.097721+0000","last_fullsized":"2023-10-06T11:16:24.097721+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:24:32.121630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.123888+0000","last_change":"2023-10-06T11:16:24.122010+0000","last_active":"2023-10-06T11:16:24.123888+0000","last_peered":"2023-10-06T11:16:24.123888+0000","last_clean":"2023-10-06T11:16:24.123888+0000","last_became_active":"2023-10-06T11:16:24.121668+0000","last_became_peered":"2023-10-06T11:16:24.121668+0000","last_unstale":"2023-10-06T11:16:24.123888+0000","last_undegraded":"2023-10-06T11:16:24.123888+0000","last_fullsized":"2023-10-06T11:16:24.123888+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:48.961124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.101790+0000","last_change":"2023-10-06T11:16:23.094432+0000","last_active":"2023-10-06T11:16:24.101790+0000","last_peered":"2023-10-06T11:16:24.101790+0000","last_clean":"2023-10-06T11:16:24.101790+0000","last_became_active":"2023-10-06T11:16:23.094187+0000","last_became_peered":"2023-10-06T11:16:23.094187+0000","last_unstale":"2023-10-06T11:16:24.101790+0000","last_undegraded":"2023-10-06T11:16:24.101790+0000","last_fullsized":"2023-10-06T11:16:24.101790+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:10:52.227186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.113900+0000","last_change":"2023-10-06T11:16:24.108819+0000","last_active":"2023-10-06T11:16:24.113900+0000","last_peered":"2023-10-06T11:16:24.113900+0000","last_clean":"2023-10-06T11:16:24.113900+0000","last_became_active":"2023-10-06T11:16:24.108557+0000","last_became_peered":"2023-10-06T11:16:24.108557+0000","last_unstale":"2023-10-06T11:16:24.113900+0000","last_undegraded":"2023-10-06T11:16:24.113900+0000","last_fullsized":"2023-10-06T11:16:24.113900+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:51.364520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.096738+0000","last_change":"2023-10-06T11:16:23.093074+0000","last_active":"2023-10-06T11:16:24.096738+0000","last_peered":"2023-10-06T11:16:24.096738+0000","last_clean":"2023-10-06T11:16:24.096738+0000","last_became_active":"2023-10-06T11:16:23.092798+0000","last_became_peered":"2023-10-06T11:16:23.092798+0000","last_unstale":"2023-10-06T11:16:24.096738+0000","last_undegraded":"2023-10-06T11:16:24.096738+0000","last_fullsized":"2023-10-06T11:16:24.096738+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:33.952357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116082+0000","last_change":"2023-10-06T11:16:24.108869+0000","last_active":"2023-10-06T11:16:24.116082+0000","last_peered":"2023-10-06T11:16:24.116082+0000","last_clean":"2023-10-06T11:16:24.116082+0000","last_became_active":"2023-10-06T11:16:24.108622+0000","last_became_peered":"2023-10-06T11:16:24.108622+0000","last_unstale":"2023-10-06T11:16:24.116082+0000","last_undegraded":"2023-10-06T11:16:24.116082+0000","last_fullsized":"2023-10-06T11:16:24.116082+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:52.405684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121466+0000","last_change":"2023-10-06T11:16:23.098062+0000","last_active":"2023-10-06T11:16:24.121466+0000","last_peered":"2023-10-06T11:16:24.121466+0000","last_clean":"2023-10-06T11:16:24.121466+0000","last_became_active":"2023-10-06T11:16:23.097769+0000","last_became_peered":"2023-10-06T11:16:23.097769+0000","last_unstale":"2023-10-06T11:16:24.121466+0000","last_undegraded":"2023-10-06T11:16:24.121466+0000","last_fullsized":"2023-10-06T11:16:24.121466+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:41:28.999854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.114153+0000","last_change":"2023-10-06T11:16:24.108302+0000","last_active":"2023-10-06T11:16:24.114153+0000","last_peered":"2023-10-06T11:16:24.114153+0000","last_clean":"2023-10-06T11:16:24.114153+0000","last_became_active":"2023-10-06T11:16:24.108014+0000","last_became_peered":"2023-10-06T11:16:24.108014+0000","last_unstale":"2023-10-06T11:16:24.114153+0000","last_undegraded":"2023-10-06T11:16:24.114153+0000","last_fullsized":"2023-10-06T11:16:24.114153+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:23:40.345660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.098101+0000","last_change":"2023-10-06T11:16:23.103805+0000","last_active":"2023-10-06T11:16:24.098101+0000","last_peered":"2023-10-06T11:16:24.098101+0000","last_clean":"2023-10-06T11:16:24.098101+0000","last_became_active":"2023-10-06T11:16:23.103470+0000","last_became_peered":"2023-10-06T11:16:23.103470+0000","last_unstale":"2023-10-06T11:16:24.098101+0000","last_undegraded":"2023-10-06T11:16:24.098101+0000","last_fullsized":"2023-10-06T11:16:24.098101+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:56:40.401445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.107051+0000","last_change":"2023-10-06T11:16:24.104047+0000","last_active":"2023-10-06T11:16:24.107051+0000","last_peered":"2023-10-06T11:16:24.107051+0000","last_clean":"2023-10-06T11:16:24.107051+0000","last_became_active":"2023-10-06T11:16:24.103777+0000","last_became_peered":"2023-10-06T11:16:24.103777+0000","last_unstale":"2023-10-06T11:16:24.107051+0000","last_undegraded":"2023-10-06T11:16:24.107051+0000","last_fullsized":"2023-10-06T11:16:24.107051+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:01:06.788901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.094909+0000","last_change":"2023-10-06T11:16:23.096622+0000","last_active":"2023-10-06T11:16:24.094909+0000","last_peered":"2023-10-06T11:16:24.094909+0000","last_clean":"2023-10-06T11:16:24.094909+0000","last_became_active":"2023-10-06T11:16:23.096367+0000","last_became_peered":"2023-10-06T11:16:23.096367+0000","last_unstale":"2023-10-06T11:16:24.094909+0000","last_undegraded":"2023-10-06T11:16:24.094909+0000","last_fullsized":"2023-10-06T11:16:24.094909+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:13:24.765345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116127+0000","last_change":"2023-10-06T11:16:24.109597+0000","last_active":"2023-10-06T11:16:24.116127+0000","last_peered":"2023-10-06T11:16:24.116127+0000","last_clean":"2023-10-06T11:16:24.116127+0000","last_became_active":"2023-10-06T11:16:24.109315+0000","last_became_peered":"2023-10-06T11:16:24.109315+0000","last_unstale":"2023-10-06T11:16:24.116127+0000","last_undegraded":"2023-10-06T11:16:24.116127+0000","last_fullsized":"2023-10-06T11:16:24.116127+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:02.452752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.098576+0000","last_change":"2023-10-06T11:16:23.102516+0000","last_active":"2023-10-06T11:16:24.098576+0000","last_peered":"2023-10-06T11:16:24.098576+0000","last_clean":"2023-10-06T11:16:24.098576+0000","last_became_active":"2023-10-06T11:16:23.102238+0000","last_became_peered":"2023-10-06T11:16:23.102238+0000","last_unstale":"2023-10-06T11:16:24.098576+0000","last_undegraded":"2023-10-06T11:16:24.098576+0000","last_fullsized":"2023-10-06T11:16:24.098576+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:50.360247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116314+0000","last_change":"2023-10-06T11:16:24.113790+0000","last_active":"2023-10-06T11:16:24.116314+0000","last_peered":"2023-10-06T11:16:24.116314+0000","last_clean":"2023-10-06T11:16:24.116314+0000","last_became_active":"2023-10-06T11:16:24.113521+0000","last_became_peered":"2023-10-06T11:16:24.113521+0000","last_unstale":"2023-10-06T11:16:24.116314+0000","last_undegraded":"2023-10-06T11:16:24.116314+0000","last_fullsized":"2023-10-06T11:16:24.116314+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:56:01.575492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.095562+0000","last_change":"2023-10-06T11:16:23.095758+0000","last_active":"2023-10-06T11:16:24.095562+0000","last_peered":"2023-10-06T11:16:24.095562+0000","last_clean":"2023-10-06T11:16:24.095562+0000","last_became_active":"2023-10-06T11:16:23.095515+0000","last_became_peered":"2023-10-06T11:16:23.095515+0000","last_unstale":"2023-10-06T11:16:24.095562+0000","last_undegraded":"2023-10-06T11:16:24.095562+0000","last_fullsized":"2023-10-06T11:16:24.095562+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:23:31.995315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.114013+0000","last_change":"2023-10-06T11:16:24.109510+0000","last_active":"2023-10-06T11:16:24.114013+0000","last_peered":"2023-10-06T11:16:24.114013+0000","last_clean":"2023-10-06T11:16:24.114013+0000","last_became_active":"2023-10-06T11:16:24.108794+0000","last_became_peered":"2023-10-06T11:16:24.108794+0000","last_unstale":"2023-10-06T11:16:24.114013+0000","last_undegraded":"2023-10-06T11:16:24.114013+0000","last_fullsized":"2023-10-06T11:16:24.114013+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:34:44.606893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.104780+0000","last_change":"2023-10-06T11:16:23.095211+0000","last_active":"2023-10-06T11:16:24.104780+0000","last_peered":"2023-10-06T11:16:24.104780+0000","last_clean":"2023-10-06T11:16:24.104780+0000","last_became_active":"2023-10-06T11:16:23.094924+0000","last_became_peered":"2023-10-06T11:16:23.094924+0000","last_unstale":"2023-10-06T11:16:24.104780+0000","last_undegraded":"2023-10-06T11:16:24.104780+0000","last_fullsized":"2023-10-06T11:16:24.104780+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:10:17.504059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.108093+0000","last_change":"2023-10-06T11:16:24.103563+0000","last_active":"2023-10-06T11:16:24.108093+0000","last_peered":"2023-10-06T11:16:24.108093+0000","last_clean":"2023-10-06T11:16:24.108093+0000","last_became_active":"2023-10-06T11:16:24.103321+0000","last_became_peered":"2023-10-06T11:16:24.103321+0000","last_unstale":"2023-10-06T11:16:24.108093+0000","last_undegraded":"2023-10-06T11:16:24.108093+0000","last_fullsized":"2023-10-06T11:16:24.108093+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:46:59.369734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.096094+0000","last_change":"2023-10-06T11:16:23.098284+0000","last_active":"2023-10-06T11:16:24.096094+0000","last_peered":"2023-10-06T11:16:24.096094+0000","last_clean":"2023-10-06T11:16:24.096094+0000","last_became_active":"2023-10-06T11:16:23.098000+0000","last_became_peered":"2023-10-06T11:16:23.098000+0000","last_unstale":"2023-10-06T11:16:24.096094+0000","last_undegraded":"2023-10-06T11:16:24.096094+0000","last_fullsized":"2023-10-06T11:16:24.096094+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:13:24.765345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.115582+0000","last_change":"2023-10-06T11:16:24.113207+0000","last_active":"2023-10-06T11:16:24.115582+0000","last_peered":"2023-10-06T11:16:24.115582+0000","last_clean":"2023-10-06T11:16:24.115582+0000","last_became_active":"2023-10-06T11:16:24.112366+0000","last_became_peered":"2023-10-06T11:16:24.112366+0000","last_unstale":"2023-10-06T11:16:24.115582+0000","last_undegraded":"2023-10-06T11:16:24.115582+0000","last_fullsized":"2023-10-06T11:16:24.115582+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:41:30.610880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.104935+0000","last_change":"2023-10-06T11:16:23.101344+0000","last_active":"2023-10-06T11:16:24.104935+0000","last_peered":"2023-10-06T11:16:24.104935+0000","last_clean":"2023-10-06T11:16:24.104935+0000","last_became_active":"2023-10-06T11:16:23.101075+0000","last_became_peered":"2023-10-06T11:16:23.101075+0000","last_unstale":"2023-10-06T11:16:24.104935+0000","last_undegraded":"2023-10-06T11:16:24.104935+0000","last_fullsized":"2023-10-06T11:16:24.104935+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:17:34.910126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.111925+0000","last_change":"2023-10-06T11:16:24.107101+0000","last_active":"2023-10-06T11:16:24.111925+0000","last_peered":"2023-10-06T11:16:24.111925+0000","last_clean":"2023-10-06T11:16:24.111925+0000","last_became_active":"2023-10-06T11:16:24.106838+0000","last_became_peered":"2023-10-06T11:16:24.106838+0000","last_unstale":"2023-10-06T11:16:24.111925+0000","last_undegraded":"2023-10-06T11:16:24.111925+0000","last_fullsized":"2023-10-06T11:16:24.111925+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:52:28.634794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.102585+0000","last_change":"2023-10-06T11:16:23.098276+0000","last_active":"2023-10-06T11:16:24.102585+0000","last_peered":"2023-10-06T11:16:24.102585+0000","last_clean":"2023-10-06T11:16:24.102585+0000","last_became_active":"2023-10-06T11:16:23.097993+0000","last_became_peered":"2023-10-06T11:16:23.097993+0000","last_unstale":"2023-10-06T11:16:24.102585+0000","last_undegraded":"2023-10-06T11:16:24.102585+0000","last_fullsized":"2023-10-06T11:16:24.102585+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:24.280341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":120,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.095270+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:16:24.095270+0000","last_peered":"2023-10-06T11:16:24.095270+0000","last_clean":"2023-10-06T11:16:24.095270+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:16:24.095270+0000","last_undegraded":"2023-10-06T11:16:24.095270+0000","last_fullsized":"2023-10-06T11:16:24.095270+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.114659+0000","last_change":"2023-10-06T11:16:24.111698+0000","last_active":"2023-10-06T11:16:24.114659+0000","last_peered":"2023-10-06T11:16:24.114659+0000","last_clean":"2023-10-06T11:16:24.114659+0000","last_became_active":"2023-10-06T11:16:24.111432+0000","last_became_peered":"2023-10-06T11:16:24.111432+0000","last_unstale":"2023-10-06T11:16:24.114659+0000","last_undegraded":"2023-10-06T11:16:24.114659+0000","last_fullsized":"2023-10-06T11:16:24.114659+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:55:36.589699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"136'8","reported_seq":18,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.126509+0000","last_change":"2023-10-06T11:16:23.100992+0000","last_active":"2023-10-06T11:16:24.126509+0000","last_peered":"2023-10-06T11:16:24.126509+0000","last_clean":"2023-10-06T11:16:24.126509+0000","last_became_active":"2023-10-06T11:16:23.100717+0000","last_became_peered":"2023-10-06T11:16:23.100717+0000","last_unstale":"2023-10-06T11:16:24.126509+0000","last_undegraded":"2023-10-06T11:16:24.126509+0000","last_fullsized":"2023-10-06T11:16:24.126509+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:10.613647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":112,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.098652+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:16:24.098652+0000","last_peered":"2023-10-06T11:16:24.098652+0000","last_clean":"2023-10-06T11:16:24.098652+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:16:24.098652+0000","last_undegraded":"2023-10-06T11:16:24.098652+0000","last_fullsized":"2023-10-06T11:16:24.098652+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.118408+0000","last_change":"2023-10-06T11:16:24.114806+0000","last_active":"2023-10-06T11:16:24.118408+0000","last_peered":"2023-10-06T11:16:24.118408+0000","last_clean":"2023-10-06T11:16:24.118408+0000","last_became_active":"2023-10-06T11:16:24.114534+0000","last_became_peered":"2023-10-06T11:16:24.114534+0000","last_unstale":"2023-10-06T11:16:24.118408+0000","last_undegraded":"2023-10-06T11:16:24.118408+0000","last_fullsized":"2023-10-06T11:16:24.118408+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:35.003929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.107394+0000","last_change":"2023-10-06T11:16:23.100682+0000","last_active":"2023-10-06T11:16:24.107394+0000","last_peered":"2023-10-06T11:16:24.107394+0000","last_clean":"2023-10-06T11:16:24.107394+0000","last_became_active":"2023-10-06T11:16:23.099315+0000","last_became_peered":"2023-10-06T11:16:23.099315+0000","last_unstale":"2023-10-06T11:16:24.107394+0000","last_undegraded":"2023-10-06T11:16:24.107394+0000","last_fullsized":"2023-10-06T11:16:24.107394+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:26:31.561341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":109,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.094719+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:16:24.094719+0000","last_peered":"2023-10-06T11:16:24.094719+0000","last_clean":"2023-10-06T11:16:24.094719+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:16:24.094719+0000","last_undegraded":"2023-10-06T11:16:24.094719+0000","last_fullsized":"2023-10-06T11:16:24.094719+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":255,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.105025+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:16:24.105025+0000","last_peered":"2023-10-06T11:16:24.105025+0000","last_clean":"2023-10-06T11:16:24.105025+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:16:24.105025+0000","last_undegraded":"2023-10-06T11:16:24.105025+0000","last_fullsized":"2023-10-06T11:16:24.105025+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121988+0000","last_change":"2023-10-06T11:16:24.120168+0000","last_active":"2023-10-06T11:16:24.121988+0000","last_peered":"2023-10-06T11:16:24.121988+0000","last_clean":"2023-10-06T11:16:24.121988+0000","last_became_active":"2023-10-06T11:16:24.119797+0000","last_became_peered":"2023-10-06T11:16:24.119797+0000","last_unstale":"2023-10-06T11:16:24.121988+0000","last_undegraded":"2023-10-06T11:16:24.121988+0000","last_fullsized":"2023-10-06T11:16:24.121988+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:04:48.357935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.098212+0000","last_change":"2023-10-06T11:16:23.098273+0000","last_active":"2023-10-06T11:16:24.098212+0000","last_peered":"2023-10-06T11:16:24.098212+0000","last_clean":"2023-10-06T11:16:24.098212+0000","last_became_active":"2023-10-06T11:16:23.097970+0000","last_became_peered":"2023-10-06T11:16:23.097970+0000","last_unstale":"2023-10-06T11:16:24.098212+0000","last_undegraded":"2023-10-06T11:16:24.098212+0000","last_fullsized":"2023-10-06T11:16:24.098212+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:29.555606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":105,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.106284+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:16:24.106284+0000","last_peered":"2023-10-06T11:16:24.106284+0000","last_clean":"2023-10-06T11:16:24.106284+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:16:24.106284+0000","last_undegraded":"2023-10-06T11:16:24.106284+0000","last_fullsized":"2023-10-06T11:16:24.106284+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.101540+0000","last_change":"2023-10-06T11:16:24.099206+0000","last_active":"2023-10-06T11:16:24.101540+0000","last_peered":"2023-10-06T11:16:24.101540+0000","last_clean":"2023-10-06T11:16:24.101540+0000","last_became_active":"2023-10-06T11:16:24.098925+0000","last_became_peered":"2023-10-06T11:16:24.098925+0000","last_unstale":"2023-10-06T11:16:24.101540+0000","last_undegraded":"2023-10-06T11:16:24.101540+0000","last_fullsized":"2023-10-06T11:16:24.101540+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:09:31.548998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"136'6","reported_seq":16,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.126641+0000","last_change":"2023-10-06T11:16:23.095177+0000","last_active":"2023-10-06T11:16:24.126641+0000","last_peered":"2023-10-06T11:16:24.126641+0000","last_clean":"2023-10-06T11:16:24.126641+0000","last_became_active":"2023-10-06T11:16:23.094700+0000","last_became_peered":"2023-10-06T11:16:23.094700+0000","last_unstale":"2023-10-06T11:16:24.126641+0000","last_undegraded":"2023-10-06T11:16:24.126641+0000","last_fullsized":"2023-10-06T11:16:24.126641+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:16.082206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":105,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.105115+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:16:24.105115+0000","last_peered":"2023-10-06T11:16:24.105115+0000","last_clean":"2023-10-06T11:16:24.105115+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:16:24.105115+0000","last_undegraded":"2023-10-06T11:16:24.105115+0000","last_fullsized":"2023-10-06T11:16:24.105115+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.120333+0000","last_change":"2023-10-06T11:16:24.106952+0000","last_active":"2023-10-06T11:16:24.120333+0000","last_peered":"2023-10-06T11:16:24.120333+0000","last_clean":"2023-10-06T11:16:24.120333+0000","last_became_active":"2023-10-06T11:16:24.106431+0000","last_became_peered":"2023-10-06T11:16:24.106431+0000","last_unstale":"2023-10-06T11:16:24.120333+0000","last_undegraded":"2023-10-06T11:16:24.120333+0000","last_fullsized":"2023-10-06T11:16:24.120333+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:59:53.565267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"136'3","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121884+0000","last_change":"2023-10-06T11:16:23.091484+0000","last_active":"2023-10-06T11:16:24.121884+0000","last_peered":"2023-10-06T11:16:24.121884+0000","last_clean":"2023-10-06T11:16:24.121884+0000","last_became_active":"2023-10-06T11:16:23.090228+0000","last_became_peered":"2023-10-06T11:16:23.090228+0000","last_unstale":"2023-10-06T11:16:24.121884+0000","last_undegraded":"2023-10-06T11:16:24.121884+0000","last_fullsized":"2023-10-06T11:16:24.121884+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:05:24.455055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":126,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.096193+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:16:24.096193+0000","last_peered":"2023-10-06T11:16:24.096193+0000","last_clean":"2023-10-06T11:16:24.096193+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:16:24.096193+0000","last_undegraded":"2023-10-06T11:16:24.096193+0000","last_fullsized":"2023-10-06T11:16:24.096193+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.114696+0000","last_change":"2023-10-06T11:16:24.110980+0000","last_active":"2023-10-06T11:16:24.114696+0000","last_peered":"2023-10-06T11:16:24.114696+0000","last_clean":"2023-10-06T11:16:24.114696+0000","last_became_active":"2023-10-06T11:16:24.109822+0000","last_became_peered":"2023-10-06T11:16:24.109822+0000","last_unstale":"2023-10-06T11:16:24.114696+0000","last_undegraded":"2023-10-06T11:16:24.114696+0000","last_fullsized":"2023-10-06T11:16:24.114696+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:11.876870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.102176+0000","last_change":"2023-10-06T11:16:23.102634+0000","last_active":"2023-10-06T11:16:24.102176+0000","last_peered":"2023-10-06T11:16:24.102176+0000","last_clean":"2023-10-06T11:16:24.102176+0000","last_became_active":"2023-10-06T11:16:23.102283+0000","last_became_peered":"2023-10-06T11:16:23.102283+0000","last_unstale":"2023-10-06T11:16:24.102176+0000","last_undegraded":"2023-10-06T11:16:24.102176+0000","last_fullsized":"2023-10-06T11:16:24.102176+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:29:52.048108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":112,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.102185+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:16:24.102185+0000","last_peered":"2023-10-06T11:16:24.102185+0000","last_clean":"2023-10-06T11:16:24.102185+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:16:24.102185+0000","last_undegraded":"2023-10-06T11:16:24.102185+0000","last_fullsized":"2023-10-06T11:16:24.102185+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.118386+0000","last_change":"2023-10-06T11:16:24.114730+0000","last_active":"2023-10-06T11:16:24.118386+0000","last_peered":"2023-10-06T11:16:24.118386+0000","last_clean":"2023-10-06T11:16:24.118386+0000","last_became_active":"2023-10-06T11:16:24.114246+0000","last_became_peered":"2023-10-06T11:16:24.114246+0000","last_unstale":"2023-10-06T11:16:24.118386+0000","last_undegraded":"2023-10-06T11:16:24.118386+0000","last_fullsized":"2023-10-06T11:16:24.118386+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:48.961124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.117964+0000","last_change":"2023-10-06T11:16:23.099218+0000","last_active":"2023-10-06T11:16:24.117964+0000","last_peered":"2023-10-06T11:16:24.117964+0000","last_clean":"2023-10-06T11:16:24.117964+0000","last_became_active":"2023-10-06T11:16:23.098941+0000","last_became_peered":"2023-10-06T11:16:23.098941+0000","last_unstale":"2023-10-06T11:16:24.117964+0000","last_undegraded":"2023-10-06T11:16:24.117964+0000","last_fullsized":"2023-10-06T11:16:24.117964+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:46:58.365462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":112,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.102758+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:16:24.102758+0000","last_peered":"2023-10-06T11:16:24.102758+0000","last_clean":"2023-10-06T11:16:24.102758+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:16:24.102758+0000","last_undegraded":"2023-10-06T11:16:24.102758+0000","last_fullsized":"2023-10-06T11:16:24.102758+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574981,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303644,"kb_used_data":2260,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068196,"statfs":{"total":96636764160,"available":96325832704,"internally_reserved":0,"allocated":2314240,"data_stored":1379705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51200000000000001,"15min":0.625},"min":{"1min":0.30299999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.68899999999999995,"5min":4.407,"15min":23.908999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.48499999999999999,"15min":0.57399999999999995},"min":{"1min":0.313,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.68300000000000005,"5min":0.69799999999999995,"15min":9.3230000000000004},"last":0.42399999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51000000000000001,"15min":0.55900000000000005},"min":{"1min":0.35299999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.71499999999999997,"5min":2.4689999999999999,"15min":9.2360000000000007},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.47299999999999998,"15min":0.503},"min":{"1min":0.373,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.64400000000000002,"5min":0.78900000000000003,"15min":4.327},"last":0.40999999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54000000000000004,"15min":0.51700000000000002},"min":{"1min":0.39900000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.63500000000000001,"5min":4.3120000000000003,"15min":4.3120000000000003},"last":0.442},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53600000000000003,"15min":0.55700000000000005},"min":{"1min":0.34799999999999998,"5min":0.31,"15min":0.29999999999999999},"max":{"1min":0.70699999999999996,"5min":3.0600000000000001,"15min":4.7309999999999999},"last":0.376}]},{"osd":3,"last update":"Fri Oct 6 11:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54600000000000004,"15min":0.53900000000000003},"min":{"1min":0.36499999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.72099999999999997,"5min":4.5190000000000001,"15min":4.5190000000000001},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56100000000000005,"15min":0.59899999999999998},"min":{"1min":0.38100000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.74099999999999999,"5min":3.0070000000000001,"15min":9.3879999999999999},"last":0.498}]},{"osd":4,"last update":"Fri Oct 6 11:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.502,"15min":0.48999999999999999},"min":{"1min":0.32800000000000001,"5min":0.26000000000000001,"15min":0.24399999999999999},"max":{"1min":0.68700000000000006,"5min":4.6639999999999997,"15min":4.6639999999999997},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.53600000000000003},"min":{"1min":0.33300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.78200000000000003,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":0.48599999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.51200000000000001,"15min":0.56100000000000005},"min":{"1min":0.33900000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":9.3499999999999996},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.5,"15min":0.54200000000000004},"min":{"1min":0.377,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.74299999999999999,"5min":0.83399999999999996,"15min":4.444},"last":0.54700000000000004}]},{"osd":6,"last update":"Fri Oct 6 11:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.53800000000000003,"15min":0.59699999999999998},"min":{"1min":0.41499999999999998,"5min":0.32400000000000001,"15min":0.29199999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":9.4969999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60899999999999999,"15min":0.62},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.85799999999999998,"5min":4.4669999999999996,"15min":7.2039999999999997},"last":0.52200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574983,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298964,"kb_used_data":1676,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072876,"statfs":{"total":96636764160,"available":96330625024,"internally_reserved":0,"allocated":1716224,"data_stored":788032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.56299999999999994,"15min":0.52000000000000002},"min":{"1min":0.254,"5min":0.187,"15min":0.187},"max":{"1min":0.66400000000000003,"5min":9.5549999999999997,"15min":9.5549999999999997},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.63300000000000001,"15min":0.56399999999999995},"min":{"1min":0.30399999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.73999999999999999,"5min":9.4659999999999993,"15min":9.4659999999999993},"last":0.59099999999999997}]},{"osd":1,"last update":"Fri Oct 6 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46100000000000002,"15min":0.48299999999999998},"min":{"1min":0.27500000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.68000000000000005,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.56000000000000005,"15min":0.51500000000000001},"min":{"1min":0.34399999999999997,"5min":0.216,"15min":0.216},"max":{"1min":0.71499999999999997,"5min":5.2670000000000003,"15min":5.2670000000000003},"last":0.34399999999999997}]},{"osd":2,"last update":"Fri Oct 6 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.46600000000000003,"15min":0.499},"min":{"1min":0.29399999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.65800000000000003,"5min":0.93200000000000005,"15min":7.0659999999999998},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.48399999999999999,"15min":0.51800000000000002},"min":{"1min":0.39100000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.72599999999999998,"5min":1.0069999999999999,"15min":7.0819999999999999},"last":0.46100000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54000000000000004,"15min":0.51700000000000002},"min":{"1min":0.34300000000000003,"5min":0.317,"15min":0.25800000000000001},"max":{"1min":0.67300000000000004,"5min":3.871,"15min":3.871},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.503,"5min":0.51100000000000001,"15min":0.53000000000000003},"min":{"1min":0.32100000000000001,"5min":0.316,"15min":0.312},"max":{"1min":0.69199999999999995,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.47799999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.45600000000000002,"15min":0.48099999999999998},"min":{"1min":0.27400000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.65600000000000003,"5min":0.88,"15min":0.88},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51400000000000001,"15min":0.53600000000000003},"min":{"1min":0.29699999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.75700000000000001,"5min":0.82399999999999995,"15min":1.0680000000000001},"last":0.44}]},{"osd":5,"last update":"Fri Oct 6 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.499,"15min":0.51900000000000002},"min":{"1min":0.33000000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.78700000000000003,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.60699999999999998,"15min":0.58299999999999996},"min":{"1min":0.36499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.86699999999999999,"5min":7.1379999999999999,"15min":7.1379999999999999},"last":0.61499999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56899999999999995,"15min":0.56799999999999995},"min":{"1min":0.40999999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.73399999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.496},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55900000000000005,"15min":0.58599999999999997},"min":{"1min":0.374,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.77300000000000002,"5min":0.86899999999999999,"15min":0.88400000000000001},"last":0.54000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574982,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311836,"kb_used_data":2260,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060004,"statfs":{"total":96636764160,"available":96317444096,"internally_reserved":0,"allocated":2314240,"data_stored":1379753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:57 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.45500000000000002,"15min":0.377},"min":{"1min":0.217,"5min":0.189,"15min":0.186},"max":{"1min":0.44,"5min":13.393000000000001,"15min":13.393000000000001},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.45400000000000001,"15min":0.38400000000000001},"min":{"1min":0.22700000000000001,"5min":0.22500000000000001,"15min":0.19700000000000001},"max":{"1min":0.49299999999999999,"5min":11.462,"15min":11.462},"last":0.40300000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:15:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.40400000000000003,"15min":0.35999999999999999},"min":{"1min":0.248,"5min":0.216,"15min":0.216},"max":{"1min":0.49299999999999999,"5min":8.0470000000000006,"15min":8.0470000000000006},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.42799999999999999,"15min":0.40500000000000003},"min":{"1min":0.215,"5min":0.215,"15min":0.20999999999999999},"max":{"1min":0.59899999999999998,"5min":4.8630000000000004,"15min":4.8630000000000004},"last":0.378}]},{"osd":3,"last update":"Fri Oct 6 11:15:57 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.44700000000000001,"15min":0.42299999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.252},"max":{"1min":0.54000000000000004,"5min":4.8029999999999999,"15min":4.8029999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.42999999999999999,"15min":0.39300000000000002},"min":{"1min":0.27700000000000002,"5min":0.217,"15min":0.217},"max":{"1min":0.53900000000000003,"5min":5.8700000000000001,"15min":5.8700000000000001},"last":0.36199999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:15:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.50600000000000001,"15min":0.51700000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28199999999999997},"max":{"1min":0.81899999999999995,"5min":1.264,"15min":1.264},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.60399999999999998,"15min":0.56799999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.84099999999999997,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.63600000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:15:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.58499999999999996,"15min":0.56599999999999995},"min":{"1min":0.378,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80500000000000005,"5min":3.4390000000000001,"15min":3.4390000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.65400000000000003,"15min":0.58699999999999997},"min":{"1min":0.39000000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.91500000000000004,"5min":9.3829999999999991,"15min":9.3829999999999991},"last":0.65700000000000003}]},{"osd":6,"last update":"Fri Oct 6 11:15:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.61299999999999999,"15min":0.58499999999999996},"min":{"1min":0.43099999999999999,"5min":0.34999999999999998,"15min":0.315},"max":{"1min":0.86699999999999999,"5min":3.4750000000000001,"15min":3.4750000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60899999999999999,"15min":0.59399999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85799999999999998,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.68100000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:15:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.63300000000000001,"15min":0.60899999999999999},"min":{"1min":0.39800000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76100000000000001,"5min":4.7290000000000001,"15min":4.7290000000000001},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60499999999999998,"15min":0.59299999999999997},"min":{"1min":0.44,"5min":0.378,"15min":0.374},"max":{"1min":0.89200000000000002,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.59099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574981,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303080,"kb_used_data":1696,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068760,"statfs":{"total":96636764160,"available":96326410240,"internally_reserved":0,"allocated":1736704,"data_stored":790176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:15:58 2023","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.41499999999999998,"15min":0.46600000000000003},"min":{"1min":0.20999999999999999,"5min":0.184,"15min":0.184},"max":{"1min":0.60199999999999998,"5min":8.4239999999999995,"15min":36.097999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.42999999999999999,"15min":0.378},"min":{"1min":0.23100000000000001,"5min":0.20799999999999999,"15min":0.182},"max":{"1min":0.92400000000000004,"5min":7.2990000000000004,"15min":7.2990000000000004},"last":0.30499999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:15:58 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.44400000000000001,"15min":0.503},"min":{"1min":0.22800000000000001,"5min":0.221,"15min":0.217},"max":{"1min":0.53500000000000003,"5min":8.6080000000000005,"15min":36.07},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.44800000000000001,"15min":0.40600000000000003},"min":{"1min":0.27200000000000002,"5min":0.23400000000000001,"15min":0.219},"max":{"1min":0.94899999999999995,"5min":6.7800000000000002,"15min":6.7800000000000002},"last":0.26800000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:15:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36299999999999999,"15min":0.39300000000000002},"min":{"1min":0.26300000000000001,"5min":0.22500000000000001,"15min":0.223},"max":{"1min":0.52000000000000002,"5min":1.863,"15min":8.4130000000000003},"last":0.315},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.499,"15min":0.55900000000000005},"min":{"1min":0.28199999999999997,"5min":0.249,"15min":0.249},"max":{"1min":1.9079999999999999,"5min":8.4570000000000007,"15min":35.959000000000003},"last":0.438}]},{"osd":4,"last update":"Fri Oct 6 11:15:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55700000000000005,"15min":0.56299999999999994},"min":{"1min":0.38800000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.72399999999999998,"5min":2.427,"15min":2.427},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.64600000000000002,"15min":0.72999999999999998},"min":{"1min":0.42399999999999999,"5min":0.34399999999999997,"15min":0.29299999999999998},"max":{"1min":0.748,"5min":8.2919999999999998,"15min":36.005000000000003},"last":0.5}]},{"osd":5,"last update":"Fri Oct 6 11:15:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.61599999999999999,"15min":0.57899999999999996},"min":{"1min":0.40000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.999,"5min":6.6699999999999999,"15min":6.6699999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.47799999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.76900000000000002,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.47999999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:15:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.65600000000000003,"15min":0.73099999999999998},"min":{"1min":0.39200000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.78800000000000003,"5min":8.2479999999999993,"15min":36.037999999999997},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.66200000000000003,"15min":0.63700000000000001},"min":{"1min":0.42899999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.028,"5min":6.7110000000000003,"15min":6.7110000000000003},"last":0.41299999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:15:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.65200000000000002,"15min":0.621},"min":{"1min":0.44900000000000001,"5min":0.371,"15min":0.371},"max":{"1min":1.054,"5min":6.742,"15min":6.742},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56799999999999995,"15min":0.56899999999999995},"min":{"1min":0.41399999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.69899999999999995,"5min":1.917,"15min":1.917},"last":0.42799999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574982,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298968,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072872,"statfs":{"total":96636764160,"available":96330620928,"internally_reserved":0,"allocated":1720320,"data_stored":788074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.30299999999999999,"15min":0.31},"min":{"1min":0.22900000000000001,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.41599999999999998,"5min":0.46300000000000002,"15min":0.57499999999999996},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.376,"15min":0.38200000000000001},"min":{"1min":0.28599999999999998,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.52800000000000002,"5min":0.55600000000000005,"15min":0.66300000000000003},"last":0.45500000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.36399999999999999,"15min":0.372},"min":{"1min":0.28100000000000003,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.48099999999999998,"5min":0.57499999999999996,"15min":0.745},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.34200000000000003,"15min":0.34999999999999998},"min":{"1min":0.247,"5min":0.216,"15min":0.216},"max":{"1min":0.437,"5min":0.52900000000000003,"15min":0.59399999999999997},"last":0.42799999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34599999999999997,"15min":0.36399999999999999},"min":{"1min":0.255,"5min":0.23300000000000001,"15min":0.23200000000000001},"max":{"1min":0.45300000000000001,"5min":0.57699999999999996,"15min":0.629},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.35799999999999998,"15min":0.36399999999999999},"min":{"1min":0.26600000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.64400000000000002},"last":0.47099999999999997}]},{"osd":4,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.503,"15min":0.52700000000000002},"min":{"1min":0.35799999999999998,"5min":0.30599999999999999,"15min":0.30299999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.51100000000000001,"15min":0.54400000000000004},"min":{"1min":0.36499999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.84899999999999998},"last":0.68400000000000005}]},{"osd":5,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.52400000000000002,"15min":0.54300000000000004},"min":{"1min":0.44700000000000001,"5min":0.33100000000000002,"15min":0.32400000000000001},"max":{"1min":0.77100000000000002,"5min":0.80400000000000005,"15min":0.86199999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.54100000000000004,"15min":0.55300000000000005},"min":{"1min":0.40600000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.84499999999999997,"5min":0.872,"15min":0.878},"last":0.77100000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56100000000000005,"15min":0.57899999999999996},"min":{"1min":0.46700000000000003,"5min":0.36799999999999999,"15min":0.32600000000000001},"max":{"1min":0.76200000000000001,"5min":0.84599999999999997,"15min":0.86299999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.55500000000000005,"15min":0.57299999999999995},"min":{"1min":0.44800000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80700000000000005,"5min":0.83499999999999996,"15min":0.88600000000000001},"last":0.69499999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54500000000000004,"15min":0.55800000000000005},"min":{"1min":0.41399999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79300000000000004,"5min":1.139,"15min":1.139},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55000000000000004,"15min":0.56699999999999995},"min":{"1min":0.42499999999999999,"5min":0.38800000000000001,"15min":0.38200000000000001},"max":{"1min":0.80600000000000005,"5min":0.89600000000000002,"15min":0.90500000000000003},"last":0.70499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574982,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307160,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064680,"statfs":{"total":96636764160,"available":96322232320,"internally_reserved":0,"allocated":1720320,"data_stored":788550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.32200000000000001,"15min":0.32300000000000001},"min":{"1min":0.224,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":2.2109999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.375},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.39100000000000001,"15min":0.39200000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.22700000000000001},"max":{"1min":4.4820000000000002,"5min":4.4820000000000002,"15min":4.4820000000000002},"last":0.34899999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.308,"15min":0.311},"min":{"1min":0.251,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.40500000000000003,"5min":0.54000000000000004,"15min":0.65400000000000003},"last":0.313},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.35599999999999998},"min":{"1min":0.27300000000000002,"5min":0.188,"15min":0.188},"max":{"1min":0.439,"5min":0.53100000000000003,"15min":1.196},"last":0.33000000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.38800000000000001,"15min":0.38500000000000001},"min":{"1min":0.245,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":4.601,"5min":4.601,"15min":4.601},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.41499999999999998,"15min":0.41699999999999998},"min":{"1min":0.29899999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.40400000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.50600000000000001,"15min":0.54700000000000004},"min":{"1min":0.39400000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.81799999999999995,"5min":0.88500000000000001,"15min":1.694},"last":0.5},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.51200000000000001,"15min":0.53700000000000003},"min":{"1min":0.32600000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.46500000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.51700000000000002,"15min":0.53100000000000003},"min":{"1min":0.34100000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.78100000000000003,"5min":0.86399999999999999,"15min":0.878},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52300000000000002,"15min":0.55200000000000005},"min":{"1min":0.35699999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.71099999999999997,"5min":0.746,"15min":1.165},"last":0.56000000000000005}]},{"osd":6,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54400000000000004,"15min":0.57699999999999996},"min":{"1min":0.42499999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76900000000000002,"5min":0.79200000000000004,"15min":1.1359999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.54600000000000004,"15min":0.58599999999999997},"min":{"1min":0.36799999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79100000000000004,"5min":0.82199999999999995,"15min":1.7470000000000001},"last":0.44500000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.54400000000000004,"15min":0.57599999999999996},"min":{"1min":0.42199999999999999,"5min":0.35699999999999998,"15min":0.35599999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":1.657},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55300000000000005,"15min":0.57099999999999995},"min":{"1min":0.40400000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.54600000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574981,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303072,"kb_used_data":1688,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068768,"statfs":{"total":96636764160,"available":96326418432,"internally_reserved":0,"allocated":1728512,"data_stored":790851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.45100000000000001,"15min":0.52400000000000002},"min":{"1min":0.26200000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.70799999999999996,"5min":0.82099999999999995,"15min":2.6619999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.47499999999999998,"15min":0.48999999999999999},"min":{"1min":0.29799999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.69099999999999995,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.47499999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:15:56 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47199999999999998,"15min":0.54500000000000004},"min":{"1min":0.28499999999999998,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.70499999999999996,"5min":1,"15min":2.8650000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47399999999999998,"15min":0.55100000000000005},"min":{"1min":0.34000000000000002,"5min":0.26200000000000001,"15min":0.25800000000000001},"max":{"1min":0.67800000000000005,"5min":1.2869999999999999,"15min":2.7610000000000001},"last":0.48399999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:15:56 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48499999999999999,"15min":0.53400000000000003},"min":{"1min":0.312,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.73399999999999999,"5min":0.76000000000000001,"15min":1.6910000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54300000000000004,"15min":0.58299999999999996},"min":{"1min":0.38700000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.68000000000000005,"5min":0.93899999999999995,"15min":1.718},"last":0.495}]},{"osd":3,"last update":"Fri Oct 6 11:15:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54900000000000004,"15min":0.59299999999999997},"min":{"1min":0.36699999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.71299999999999997,"5min":2.387,"15min":2.677},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.52200000000000002,"15min":0.52400000000000002},"min":{"1min":0.35599999999999998,"5min":0.29299999999999998,"15min":0.27500000000000002},"max":{"1min":0.69399999999999995,"5min":1.784,"15min":1.784},"last":0.52800000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:15:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.47099999999999997,"15min":0.48399999999999999},"min":{"1min":0.33700000000000002,"5min":0.23499999999999999,"15min":0.23200000000000001},"max":{"1min":0.65700000000000003,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.48799999999999999,"15min":0.52400000000000002},"min":{"1min":0.29099999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.65900000000000003,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.39400000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:15:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.502,"15min":0.52100000000000002},"min":{"1min":0.313,"5min":0.30499999999999999,"15min":0.252},"max":{"1min":0.83499999999999996,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53100000000000003,"15min":0.56200000000000006},"min":{"1min":0.38900000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.69399999999999995,"5min":0.85799999999999998,"15min":1.165},"last":0.41199999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:15:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54300000000000004,"15min":0.55700000000000005},"min":{"1min":0.36899999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.70199999999999996,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.44},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.55900000000000005,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.875,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.55100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574983,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311252,"kb_used_data":1676,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060588,"statfs":{"total":96636764160,"available":96318042112,"internally_reserved":0,"allocated":1716224,"data_stored":789315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.44700000000000001,"15min":0.58999999999999997},"min":{"1min":0.26200000000000001,"5min":0.23100000000000001,"15min":0.20499999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":5.0490000000000004},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.44900000000000001,"15min":0.56899999999999995},"min":{"1min":0.26600000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.66500000000000004,"5min":0.78100000000000003,"15min":5.1449999999999996},"last":0.61499999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.46100000000000002,"15min":0.48199999999999998},"min":{"1min":0.307,"5min":0.25,"15min":0.25},"max":{"1min":0.72999999999999998,"5min":0.81399999999999995,"15min":0.97199999999999998},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.47699999999999998,"15min":0.50900000000000001},"min":{"1min":0.35299999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":1.8799999999999999},"last":0.69299999999999995}]},{"osd":2,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.499,"15min":0.54600000000000004},"min":{"1min":0.313,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76600000000000001,"5min":0.79800000000000004,"15min":4.234},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.52500000000000002,"15min":0.55900000000000005},"min":{"1min":0.39800000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.747,"5min":0.81000000000000005,"15min":1.0369999999999999},"last":0.79200000000000004}]},{"osd":3,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.47999999999999998,"15min":0.60899999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.27700000000000002},"max":{"1min":0.72799999999999998,"5min":0.82299999999999995,"15min":5.2169999999999996},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.505,"15min":0.53900000000000003},"min":{"1min":0.32400000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":1.008},"last":0.42299999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.46999999999999997,"15min":0.50700000000000001},"min":{"1min":0.26400000000000001,"5min":0.25600000000000001,"15min":0.23999999999999999},"max":{"1min":0.78000000000000003,"5min":0.83399999999999996,"15min":1.917},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.46899999999999997,"15min":0.51800000000000002},"min":{"1min":0.251,"5min":0.24399999999999999,"15min":0.23899999999999999},"max":{"1min":0.68899999999999995,"5min":0.69199999999999995,"15min":0.87},"last":0.39500000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.49099999999999999,"15min":0.54600000000000004},"min":{"1min":0.32700000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":2.0139999999999998},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55400000000000005,"15min":0.59699999999999998},"min":{"1min":0.30299999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.80800000000000005,"5min":0.82899999999999996,"15min":1.9470000000000001},"last":0.72599999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.51600000000000001,"15min":0.56799999999999995},"min":{"1min":0.311,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.71999999999999997,"5min":0.81000000000000005,"15min":0.96499999999999997},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.54800000000000004,"15min":0.59599999999999997},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.28799999999999998},"max":{"1min":0.75600000000000001,"5min":0.77300000000000002,"15min":1.4119999999999999},"last":0.746}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:16:32.669 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:16:32.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.797+0000 7f9fae062700 1 Processor -- start 2023-10-06T11:16:32.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.797+0000 7f9fae062700 1 -- start start 2023-10-06T11:16:32.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.798+0000 7f9fae062700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9fa80b28e0 0x7f9fa80c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:32.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.798+0000 7f9fae062700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9fa80cf2d0 0x7f9fa80ad730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:32.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.798+0000 7f9fae062700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fa80ad2a0 con 0x7f9fa80c53f0 2023-10-06T11:16:32.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.798+0000 7f9fae062700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fa8099ec0 con 0x7f9fa80cf2d0 2023-10-06T11:16:32.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.798+0000 7f9fae062700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa80c7240 con 0x7f9fa80b28e0 2023-10-06T11:16:32.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.798+0000 7f9fa6ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f9fa80c53f0 0x7f9fa80cebc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50458/0 (socket says 172.21.15.146:50458) 2023-10-06T11:16:32.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.798+0000 7f9fa6ffd700 1 -- 172.21.15.146:0/3111069389 learned_addr learned my addr 172.21.15.146:0/3111069389 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:16:32.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.798+0000 7f9fa67fc700 1 -- 172.21.15.146:0/3111069389 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3705676415 0 0) 0x7f9fa80ad2a0 con 0x7f9fa80c53f0 2023-10-06T11:16:32.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.798+0000 7f9fa7fff700 1 --2- 172.21.15.146:0/3111069389 >> v2:172.21.15.151:3300/0 conn(0x7f9fa80cf2d0 0x7f9fa80ad730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:32.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.798+0000 7f9fa67fc700 1 -- 172.21.15.146:0/3111069389 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f90003570 con 0x7f9fa80c53f0 2023-10-06T11:16:32.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.798+0000 7f9fa77fe700 1 --2- 172.21.15.146:0/3111069389 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9fa80b28e0 0x7f9fa80c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:32.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.798+0000 7f9fa67fc700 1 -- 172.21.15.146:0/3111069389 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1147967403 0 0) 0x7f9f90003570 con 0x7f9fa80c53f0 2023-10-06T11:16:32.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.798+0000 7f9fa67fc700 1 -- 172.21.15.146:0/3111069389 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9fa80b28e0 msgr2=0x7f9fa80c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:32.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.798+0000 7f9fa67fc700 1 --2- 172.21.15.146:0/3111069389 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9fa80b28e0 0x7f9fa80c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:32.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.798+0000 7f9fa67fc700 1 -- 172.21.15.146:0/3111069389 >> v2:172.21.15.151:3300/0 conn(0x7f9fa80cf2d0 msgr2=0x7f9fa80ad730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:32.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.798+0000 7f9fa67fc700 1 --2- 172.21.15.146:0/3111069389 >> v2:172.21.15.151:3300/0 conn(0x7f9fa80cf2d0 0x7f9fa80ad730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:32.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.798+0000 7f9fa67fc700 1 -- 172.21.15.146:0/3111069389 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa80c69a0 con 0x7f9fa80c53f0 2023-10-06T11:16:32.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.798+0000 7f9fa67fc700 1 -- 172.21.15.146:0/3111069389 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f9f9c001470 con 0x7f9fa80c53f0 2023-10-06T11:16:32.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.798+0000 7f9fa67fc700 1 -- 172.21.15.146:0/3111069389 >> v1:172.21.15.146:6789/0 conn(0x7f9fa80c53f0 legacy=0x7f9fa80cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:32.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.798+0000 7f9fa67fc700 1 --2- 172.21.15.146:0/3111069389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f90003a60 0x7f9f90003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:32.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.799+0000 7f9fa67fc700 1 --2- 172.21.15.146:0/3111069389 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9fa80b28e0 0x7f9f90004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:32.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.799+0000 7f9fa67fc700 1 --2- 172.21.15.146:0/3111069389 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f90004d50 0x7f9f900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:32.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.799+0000 7f9fa67fc700 1 -- 172.21.15.146:0/3111069389 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa8099ec0 con 0x7f9f90003a60 2023-10-06T11:16:32.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.799+0000 7f9fa67fc700 1 -- 172.21.15.146:0/3111069389 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa80c7240 con 0x7f9f90004d50 2023-10-06T11:16:32.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.799+0000 7f9fa67fc700 1 -- 172.21.15.146:0/3111069389 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9000ba60 con 0x7f9fa80b28e0 2023-10-06T11:16:32.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.799+0000 7f9fa77fe700 1 --2- 172.21.15.146:0/3111069389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f90003a60 0x7f9f90003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:32.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.799+0000 7f9fa6ffd700 1 --2- 172.21.15.146:0/3111069389 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9fa80b28e0 0x7f9f90004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:32.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.799+0000 7f9fa7fff700 1 --2- 172.21.15.146:0/3111069389 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f90004d50 0x7f9f900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:32.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.799+0000 7f9fa77fe700 1 -- 172.21.15.146:0/3111069389 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9fa80b28e0 msgr2=0x7f9f90004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:32.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.799+0000 7f9fa77fe700 1 --2- 172.21.15.146:0/3111069389 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9fa80b28e0 0x7f9f90004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:32.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.799+0000 7f9fa77fe700 1 -- 172.21.15.146:0/3111069389 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f90004d50 msgr2=0x7f9f900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:32.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.799+0000 7f9fa77fe700 1 --2- 172.21.15.146:0/3111069389 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f90004d50 0x7f9f900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:32.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.799+0000 7f9fa77fe700 1 -- 172.21.15.146:0/3111069389 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f90003570 con 0x7f9f90003a60 2023-10-06T11:16:32.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.799+0000 7f9fa77fe700 1 --2- 172.21.15.146:0/3111069389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f90003a60 0x7f9f90003e70 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f9f98009bf0 tx=0x7f9f98009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fde6a8186cbb1ec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:32.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.799+0000 7f9fa67fc700 1 -- 172.21.15.146:0/3111069389 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f98005a00 con 0x7f9f90003a60 2023-10-06T11:16:32.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.799+0000 7f9fa67fc700 1 -- 172.21.15.146:0/3111069389 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f98005b60 con 0x7f9f90003a60 2023-10-06T11:16:32.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.799+0000 7f9fa67fc700 1 -- 172.21.15.146:0/3111069389 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9800e6b0 con 0x7f9f90003a60 2023-10-06T11:16:32.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.800+0000 7f9fae062700 1 -- 172.21.15.146:0/3111069389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f90003a60 msgr2=0x7f9f90003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:32.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.800+0000 7f9fae062700 1 --2- 172.21.15.146:0/3111069389 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f90003a60 0x7f9f90003e70 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f9f98009bf0 tx=0x7f9f98009120 comp rx=0 tx=0).stop 2023-10-06T11:16:32.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.800+0000 7f9fa7fff700 1 -- 172.21.15.146:0/3111069389 reap_dead start 2023-10-06T11:16:32.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.800+0000 7f9fae062700 1 -- 172.21.15.146:0/3111069389 shutdown_connections 2023-10-06T11:16:32.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.800+0000 7f9fae062700 1 -- 172.21.15.146:0/3111069389 >> 172.21.15.146:0/3111069389 conn(0x7f9fa80999a0 msgr2=0x7f9fa806f380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:32.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.800+0000 7f9fae062700 1 -- 172.21.15.146:0/3111069389 shutdown_connections 2023-10-06T11:16:32.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.800+0000 7f9fae062700 1 -- 172.21.15.146:0/3111069389 wait complete. 2023-10-06T11:16:32.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.801+0000 7f9fae062700 1 Processor -- start 2023-10-06T11:16:32.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.801+0000 7f9fae062700 1 -- start start 2023-10-06T11:16:32.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.802+0000 7f9fae062700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9f90003a60 0x7f9fa8149f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:32.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.802+0000 7f9fae062700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fa80b33f0 0x7f9fa80b3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:32.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.802+0000 7f9fae062700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9fa814d470 0x7f9fa814d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:32.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.802+0000 7f9fae062700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa814de50 con 0x7f9fa80b33f0 2023-10-06T11:16:32.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.802+0000 7f9fae062700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa814a4a0 con 0x7f9fa814d470 2023-10-06T11:16:32.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.802+0000 7f9fae062700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fa80b3da0 con 0x7f9f90003a60 2023-10-06T11:16:32.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.802+0000 7f9fa6ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fa80b33f0 0x7f9fa80b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:32.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.802+0000 7f9fa6ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fa80b33f0 0x7f9fa80b3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39268/0 (socket says 172.21.15.146:39268) 2023-10-06T11:16:32.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.802+0000 7f9fa6ffd700 1 -- 172.21.15.146:0/2199085268 learned_addr learned my addr 172.21.15.146:0/2199085268 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:32.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.802+0000 7f9fa7fff700 1 --2- 172.21.15.146:0/2199085268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9fa814d470 0x7f9fa814d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:32.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.802+0000 7f9fa77fe700 1 --2- 172.21.15.146:0/2199085268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9f90003a60 0x7f9fa8149f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:32.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.802+0000 7f9fa6ffd700 1 -- 172.21.15.146:0/2199085268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9f90003a60 msgr2=0x7f9fa8149f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:32.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.802+0000 7f9fa6ffd700 1 --2- 172.21.15.146:0/2199085268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9f90003a60 0x7f9fa8149f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:32.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.802+0000 7f9fa6ffd700 1 -- 172.21.15.146:0/2199085268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9fa814d470 msgr2=0x7f9fa814d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:32.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.802+0000 7f9fa6ffd700 1 --2- 172.21.15.146:0/2199085268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9fa814d470 0x7f9fa814d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:32.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.802+0000 7f9fa6ffd700 1 -- 172.21.15.146:0/2199085268 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa80b5450 con 0x7f9fa80b33f0 2023-10-06T11:16:32.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.802+0000 7f9fa7fff700 1 --2- 172.21.15.146:0/2199085268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9fa814d470 0x7f9fa814d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:32.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.802+0000 7f9fa77fe700 1 --2- 172.21.15.146:0/2199085268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9f90003a60 0x7f9fa8149f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:32.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.802+0000 7f9fa6ffd700 1 --2- 172.21.15.146:0/2199085268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fa80b33f0 0x7f9fa80b3860 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c000fd0 tx=0x7f9f9c001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:32.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.802+0000 7f9f8f7fe700 1 -- 172.21.15.146:0/2199085268 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c00f8d0 con 0x7f9fa80b33f0 2023-10-06T11:16:32.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.803+0000 7f9f8f7fe700 1 -- 172.21.15.146:0/2199085268 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f9c00fa30 con 0x7f9fa80b33f0 2023-10-06T11:16:32.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.803+0000 7f9fae062700 1 -- 172.21.15.146:0/2199085268 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fa80b3fd0 con 0x7f9fa80b33f0 2023-10-06T11:16:32.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.803+0000 7f9f8f7fe700 1 -- 172.21.15.146:0/2199085268 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9c00fdf0 con 0x7f9fa80b33f0 2023-10-06T11:16:32.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.803+0000 7f9fae062700 1 -- 172.21.15.146:0/2199085268 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fa80b59d0 con 0x7f9fa80b33f0 2023-10-06T11:16:32.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.803+0000 7f9fae062700 1 -- 172.21.15.146:0/2199085268 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fa804c380 con 0x7f9fa80b33f0 2023-10-06T11:16:32.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.804+0000 7f9f8f7fe700 1 -- 172.21.15.146:0/2199085268 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9f9c013600 con 0x7f9fa80b33f0 2023-10-06T11:16:32.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.804+0000 7f9f8f7fe700 1 --2- 172.21.15.146:0/2199085268 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9f94066f30 0x7f9f940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:32.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.804+0000 7f9fa77fe700 1 --2- 172.21.15.146:0/2199085268 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9f94066f30 0x7f9f940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:32.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.804+0000 7f9f8f7fe700 1 -- 172.21.15.146:0/2199085268 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f9f9c084990 con 0x7f9fa80b33f0 2023-10-06T11:16:32.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.805+0000 7f9fa77fe700 1 --2- 172.21.15.146:0/2199085268 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9f94066f30 0x7f9f940693e0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8159110 tx=0x7f9f98019000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:32.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.809+0000 7f9f8f7fe700 1 -- 172.21.15.146:0/2199085268 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9f9c051a60 con 0x7f9fa80b33f0 2023-10-06T11:16:32.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.988+0000 7f9fae062700 1 -- 172.21.15.146:0/2199085268 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9fa80c6c80 con 0x7f9f94066f30 2023-10-06T11:16:32.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:32.997+0000 7f9f8f7fe700 1 -- 172.21.15.146:0/2199085268 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311998 (secure 0 0 0) 0x7f9fa80c6c80 con 0x7f9f94066f30 2023-10-06T11:16:33.003 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:16:33.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.000+0000 7f9fae062700 1 -- 172.21.15.146:0/2199085268 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9f94066f30 msgr2=0x7f9f940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:33.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.000+0000 7f9fae062700 1 --2- 172.21.15.146:0/2199085268 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9f94066f30 0x7f9f940693e0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8159110 tx=0x7f9f98019000 comp rx=0 tx=0).stop 2023-10-06T11:16:33.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.000+0000 7f9fae062700 1 -- 172.21.15.146:0/2199085268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fa80b33f0 msgr2=0x7f9fa80b3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:33.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.000+0000 7f9fae062700 1 --2- 172.21.15.146:0/2199085268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fa80b33f0 0x7f9fa80b3860 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c000fd0 tx=0x7f9f9c001e90 comp rx=0 tx=0).stop 2023-10-06T11:16:33.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.000+0000 7f9fae062700 1 -- 172.21.15.146:0/2199085268 shutdown_connections 2023-10-06T11:16:33.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.000+0000 7f9fae062700 1 --2- 172.21.15.146:0/2199085268 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9f94066f30 0x7f9f940693e0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:33.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.000+0000 7f9fae062700 1 --2- 172.21.15.146:0/2199085268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9fa814d470 0x7f9fa814d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:33.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.000+0000 7f9fae062700 1 --2- 172.21.15.146:0/2199085268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9f90003a60 0x7f9fa8149f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:33.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.000+0000 7f9fae062700 1 --2- 172.21.15.146:0/2199085268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9fa80b33f0 0x7f9fa80b3860 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:33.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.000+0000 7f9fae062700 1 -- 172.21.15.146:0/2199085268 >> 172.21.15.146:0/2199085268 conn(0x7f9fa80999a0 msgr2=0x7f9fa80695c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:33.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.000+0000 7f9fae062700 1 -- 172.21.15.146:0/2199085268 shutdown_connections 2023-10-06T11:16:33.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.000+0000 7f9fae062700 1 -- 172.21.15.146:0/2199085268 wait complete. 2023-10-06T11:16:33.006 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:16:33.014 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":458,"stamp":"2023-10-06T11:16:32.414701+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2437976,"kb_used_data":14616,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752536744,"statfs":{"total":773094113280,"available":770597625856,"internally_reserved":0,"allocated":14966784,"data_stored":7494456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.321454"},"pg_stats":[{"pgid":"22.3f","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.114163+0000","last_change":"2023-10-06T11:16:24.109016+0000","last_active":"2023-10-06T11:16:24.114163+0000","last_peered":"2023-10-06T11:16:24.114163+0000","last_clean":"2023-10-06T11:16:24.114163+0000","last_became_active":"2023-10-06T11:16:24.108230+0000","last_became_peered":"2023-10-06T11:16:24.108230+0000","last_unstale":"2023-10-06T11:16:24.114163+0000","last_undegraded":"2023-10-06T11:16:24.114163+0000","last_fullsized":"2023-10-06T11:16:24.114163+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:46:32.933025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3e","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.113900+0000","last_change":"2023-10-06T11:16:24.109332+0000","last_active":"2023-10-06T11:16:24.113900+0000","last_peered":"2023-10-06T11:16:24.113900+0000","last_clean":"2023-10-06T11:16:24.113900+0000","last_became_active":"2023-10-06T11:16:24.109078+0000","last_became_peered":"2023-10-06T11:16:24.109078+0000","last_unstale":"2023-10-06T11:16:24.113900+0000","last_undegraded":"2023-10-06T11:16:24.113900+0000","last_fullsized":"2023-10-06T11:16:24.113900+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:01:06.788901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3d","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.119393+0000","last_change":"2023-10-06T11:16:24.117527+0000","last_active":"2023-10-06T11:16:24.119393+0000","last_peered":"2023-10-06T11:16:24.119393+0000","last_clean":"2023-10-06T11:16:24.119393+0000","last_became_active":"2023-10-06T11:16:24.117195+0000","last_became_peered":"2023-10-06T11:16:24.117195+0000","last_unstale":"2023-10-06T11:16:24.119393+0000","last_undegraded":"2023-10-06T11:16:24.119393+0000","last_fullsized":"2023-10-06T11:16:24.119393+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:09:31.548998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.3c","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116257+0000","last_change":"2023-10-06T11:16:24.110210+0000","last_active":"2023-10-06T11:16:24.116257+0000","last_peered":"2023-10-06T11:16:24.116257+0000","last_clean":"2023-10-06T11:16:24.116257+0000","last_became_active":"2023-10-06T11:16:24.109785+0000","last_became_peered":"2023-10-06T11:16:24.109785+0000","last_unstale":"2023-10-06T11:16:24.116257+0000","last_undegraded":"2023-10-06T11:16:24.116257+0000","last_fullsized":"2023-10-06T11:16:24.116257+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:23:32.999587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.3b","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.114773+0000","last_change":"2023-10-06T11:16:24.108647+0000","last_active":"2023-10-06T11:16:24.114773+0000","last_peered":"2023-10-06T11:16:24.114773+0000","last_clean":"2023-10-06T11:16:24.114773+0000","last_became_active":"2023-10-06T11:16:24.108417+0000","last_became_peered":"2023-10-06T11:16:24.108417+0000","last_unstale":"2023-10-06T11:16:24.114773+0000","last_undegraded":"2023-10-06T11:16:24.114773+0000","last_fullsized":"2023-10-06T11:16:24.114773+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:26:03.575635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3a","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116075+0000","last_change":"2023-10-06T11:16:24.108739+0000","last_active":"2023-10-06T11:16:24.116075+0000","last_peered":"2023-10-06T11:16:24.116075+0000","last_clean":"2023-10-06T11:16:24.116075+0000","last_became_active":"2023-10-06T11:16:24.108453+0000","last_became_peered":"2023-10-06T11:16:24.108453+0000","last_unstale":"2023-10-06T11:16:24.116075+0000","last_undegraded":"2023-10-06T11:16:24.116075+0000","last_fullsized":"2023-10-06T11:16:24.116075+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:59:45.901579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.39","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.120838+0000","last_change":"2023-10-06T11:16:24.115798+0000","last_active":"2023-10-06T11:16:24.120838+0000","last_peered":"2023-10-06T11:16:24.120838+0000","last_clean":"2023-10-06T11:16:24.120838+0000","last_became_active":"2023-10-06T11:16:24.115530+0000","last_became_peered":"2023-10-06T11:16:24.115530+0000","last_unstale":"2023-10-06T11:16:24.120838+0000","last_undegraded":"2023-10-06T11:16:24.120838+0000","last_fullsized":"2023-10-06T11:16:24.120838+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:26:32.565614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.38","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.114861+0000","last_change":"2023-10-06T11:16:24.112572+0000","last_active":"2023-10-06T11:16:24.114861+0000","last_peered":"2023-10-06T11:16:24.114861+0000","last_clean":"2023-10-06T11:16:24.114861+0000","last_became_active":"2023-10-06T11:16:24.109041+0000","last_became_peered":"2023-10-06T11:16:24.109041+0000","last_unstale":"2023-10-06T11:16:24.114861+0000","last_undegraded":"2023-10-06T11:16:24.114861+0000","last_fullsized":"2023-10-06T11:16:24.114861+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:11.876870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.37","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116267+0000","last_change":"2023-10-06T11:16:24.112144+0000","last_active":"2023-10-06T11:16:24.116267+0000","last_peered":"2023-10-06T11:16:24.116267+0000","last_clean":"2023-10-06T11:16:24.116267+0000","last_became_active":"2023-10-06T11:16:24.111426+0000","last_became_peered":"2023-10-06T11:16:24.111426+0000","last_unstale":"2023-10-06T11:16:24.116267+0000","last_undegraded":"2023-10-06T11:16:24.116267+0000","last_fullsized":"2023-10-06T11:16:24.116267+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:12:06.066982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.36","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116349+0000","last_change":"2023-10-06T11:16:24.113655+0000","last_active":"2023-10-06T11:16:24.116349+0000","last_peered":"2023-10-06T11:16:24.116349+0000","last_clean":"2023-10-06T11:16:24.116349+0000","last_became_active":"2023-10-06T11:16:24.113399+0000","last_became_peered":"2023-10-06T11:16:24.113399+0000","last_unstale":"2023-10-06T11:16:24.116349+0000","last_undegraded":"2023-10-06T11:16:24.116349+0000","last_fullsized":"2023-10-06T11:16:24.116349+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:50:16.146183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.35","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121936+0000","last_change":"2023-10-06T11:16:24.119814+0000","last_active":"2023-10-06T11:16:24.121936+0000","last_peered":"2023-10-06T11:16:24.121936+0000","last_clean":"2023-10-06T11:16:24.121936+0000","last_became_active":"2023-10-06T11:16:24.119316+0000","last_became_peered":"2023-10-06T11:16:24.119316+0000","last_unstale":"2023-10-06T11:16:24.121936+0000","last_undegraded":"2023-10-06T11:16:24.121936+0000","last_fullsized":"2023-10-06T11:16:24.121936+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:26.166829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.34","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.114541+0000","last_change":"2023-10-06T11:16:24.109182+0000","last_active":"2023-10-06T11:16:24.114541+0000","last_peered":"2023-10-06T11:16:24.114541+0000","last_clean":"2023-10-06T11:16:24.114541+0000","last_became_active":"2023-10-06T11:16:24.108845+0000","last_became_peered":"2023-10-06T11:16:24.108845+0000","last_unstale":"2023-10-06T11:16:24.114541+0000","last_undegraded":"2023-10-06T11:16:24.114541+0000","last_fullsized":"2023-10-06T11:16:24.114541+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:29:01.304906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.33","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116386+0000","last_change":"2023-10-06T11:16:24.113716+0000","last_active":"2023-10-06T11:16:24.116386+0000","last_peered":"2023-10-06T11:16:24.116386+0000","last_clean":"2023-10-06T11:16:24.116386+0000","last_became_active":"2023-10-06T11:16:24.113447+0000","last_became_peered":"2023-10-06T11:16:24.113447+0000","last_unstale":"2023-10-06T11:16:24.116386+0000","last_undegraded":"2023-10-06T11:16:24.116386+0000","last_fullsized":"2023-10-06T11:16:24.116386+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:28.023957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.32","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.115716+0000","last_change":"2023-10-06T11:16:24.110152+0000","last_active":"2023-10-06T11:16:24.115716+0000","last_peered":"2023-10-06T11:16:24.115716+0000","last_clean":"2023-10-06T11:16:24.115716+0000","last_became_active":"2023-10-06T11:16:24.108867+0000","last_became_peered":"2023-10-06T11:16:24.108867+0000","last_unstale":"2023-10-06T11:16:24.115716+0000","last_undegraded":"2023-10-06T11:16:24.115716+0000","last_fullsized":"2023-10-06T11:16:24.115716+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:34.956629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.31","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.114671+0000","last_change":"2023-10-06T11:16:24.110834+0000","last_active":"2023-10-06T11:16:24.114671+0000","last_peered":"2023-10-06T11:16:24.114671+0000","last_clean":"2023-10-06T11:16:24.114671+0000","last_became_active":"2023-10-06T11:16:24.110085+0000","last_became_peered":"2023-10-06T11:16:24.110085+0000","last_unstale":"2023-10-06T11:16:24.114671+0000","last_undegraded":"2023-10-06T11:16:24.114671+0000","last_fullsized":"2023-10-06T11:16:24.114671+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:26:32.565614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.30","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.106632+0000","last_change":"2023-10-06T11:16:24.103595+0000","last_active":"2023-10-06T11:16:24.106632+0000","last_peered":"2023-10-06T11:16:24.106632+0000","last_clean":"2023-10-06T11:16:24.106632+0000","last_became_active":"2023-10-06T11:16:24.103341+0000","last_became_peered":"2023-10-06T11:16:24.103341+0000","last_unstale":"2023-10-06T11:16:24.106632+0000","last_undegraded":"2023-10-06T11:16:24.106632+0000","last_fullsized":"2023-10-06T11:16:24.106632+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:30:19.278442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2f","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121404+0000","last_change":"2023-10-06T11:16:24.115304+0000","last_active":"2023-10-06T11:16:24.121404+0000","last_peered":"2023-10-06T11:16:24.121404+0000","last_clean":"2023-10-06T11:16:24.121404+0000","last_became_active":"2023-10-06T11:16:24.114874+0000","last_became_peered":"2023-10-06T11:16:24.114874+0000","last_unstale":"2023-10-06T11:16:24.121404+0000","last_undegraded":"2023-10-06T11:16:24.121404+0000","last_fullsized":"2023-10-06T11:16:24.121404+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:24:33.125902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.2e","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.120354+0000","last_change":"2023-10-06T11:16:24.107132+0000","last_active":"2023-10-06T11:16:24.120354+0000","last_peered":"2023-10-06T11:16:24.120354+0000","last_clean":"2023-10-06T11:16:24.120354+0000","last_became_active":"2023-10-06T11:16:24.106714+0000","last_became_peered":"2023-10-06T11:16:24.106714+0000","last_unstale":"2023-10-06T11:16:24.120354+0000","last_undegraded":"2023-10-06T11:16:24.120354+0000","last_fullsized":"2023-10-06T11:16:24.120354+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:08.737914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2d","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121851+0000","last_change":"2023-10-06T11:16:24.116978+0000","last_active":"2023-10-06T11:16:24.121851+0000","last_peered":"2023-10-06T11:16:24.121851+0000","last_clean":"2023-10-06T11:16:24.121851+0000","last_became_active":"2023-10-06T11:16:24.116483+0000","last_became_peered":"2023-10-06T11:16:24.116483+0000","last_unstale":"2023-10-06T11:16:24.121851+0000","last_undegraded":"2023-10-06T11:16:24.121851+0000","last_fullsized":"2023-10-06T11:16:24.121851+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:34:07.106736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.2c","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.112359+0000","last_change":"2023-10-06T11:16:24.101538+0000","last_active":"2023-10-06T11:16:24.112359+0000","last_peered":"2023-10-06T11:16:24.112359+0000","last_clean":"2023-10-06T11:16:24.112359+0000","last_became_active":"2023-10-06T11:16:24.101276+0000","last_became_peered":"2023-10-06T11:16:24.101276+0000","last_unstale":"2023-10-06T11:16:24.112359+0000","last_undegraded":"2023-10-06T11:16:24.112359+0000","last_fullsized":"2023-10-06T11:16:24.112359+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:26:02.681339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.2b","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.118962+0000","last_change":"2023-10-06T11:16:24.117423+0000","last_active":"2023-10-06T11:16:24.118962+0000","last_peered":"2023-10-06T11:16:24.118962+0000","last_clean":"2023-10-06T11:16:24.118962+0000","last_became_active":"2023-10-06T11:16:24.117137+0000","last_became_peered":"2023-10-06T11:16:24.117137+0000","last_unstale":"2023-10-06T11:16:24.118962+0000","last_undegraded":"2023-10-06T11:16:24.118962+0000","last_fullsized":"2023-10-06T11:16:24.118962+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:17.086479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.2a","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.119950+0000","last_change":"2023-10-06T11:16:24.112281+0000","last_active":"2023-10-06T11:16:24.119950+0000","last_peered":"2023-10-06T11:16:24.119950+0000","last_clean":"2023-10-06T11:16:24.119950+0000","last_became_active":"2023-10-06T11:16:24.111821+0000","last_became_peered":"2023-10-06T11:16:24.111821+0000","last_unstale":"2023-10-06T11:16:24.119950+0000","last_undegraded":"2023-10-06T11:16:24.119950+0000","last_fullsized":"2023-10-06T11:16:24.119950+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:11.876870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.29","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.106869+0000","last_change":"2023-10-06T11:16:24.104606+0000","last_active":"2023-10-06T11:16:24.106869+0000","last_peered":"2023-10-06T11:16:24.106869+0000","last_clean":"2023-10-06T11:16:24.106869+0000","last_became_active":"2023-10-06T11:16:24.104331+0000","last_became_peered":"2023-10-06T11:16:24.104331+0000","last_unstale":"2023-10-06T11:16:24.106869+0000","last_undegraded":"2023-10-06T11:16:24.106869+0000","last_fullsized":"2023-10-06T11:16:24.106869+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:51:39.490885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.28","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.108707+0000","last_change":"2023-10-06T11:16:24.105272+0000","last_active":"2023-10-06T11:16:24.108707+0000","last_peered":"2023-10-06T11:16:24.108707+0000","last_clean":"2023-10-06T11:16:24.108707+0000","last_became_active":"2023-10-06T11:16:24.104836+0000","last_became_peered":"2023-10-06T11:16:24.104836+0000","last_unstale":"2023-10-06T11:16:24.108707+0000","last_undegraded":"2023-10-06T11:16:24.108707+0000","last_fullsized":"2023-10-06T11:16:24.108707+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:20:21.978391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.27","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.114191+0000","last_change":"2023-10-06T11:16:24.109203+0000","last_active":"2023-10-06T11:16:24.114191+0000","last_peered":"2023-10-06T11:16:24.114191+0000","last_clean":"2023-10-06T11:16:24.114191+0000","last_became_active":"2023-10-06T11:16:24.103632+0000","last_became_peered":"2023-10-06T11:16:24.103632+0000","last_unstale":"2023-10-06T11:16:24.114191+0000","last_undegraded":"2023-10-06T11:16:24.114191+0000","last_fullsized":"2023-10-06T11:16:24.114191+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:21:48.286337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.26","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.119621+0000","last_change":"2023-10-06T11:16:24.112055+0000","last_active":"2023-10-06T11:16:24.119621+0000","last_peered":"2023-10-06T11:16:24.119621+0000","last_clean":"2023-10-06T11:16:24.119621+0000","last_became_active":"2023-10-06T11:16:24.111459+0000","last_became_peered":"2023-10-06T11:16:24.111459+0000","last_unstale":"2023-10-06T11:16:24.119621+0000","last_undegraded":"2023-10-06T11:16:24.119621+0000","last_fullsized":"2023-10-06T11:16:24.119621+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:56:01.575492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.25","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116536+0000","last_change":"2023-10-06T11:16:24.114696+0000","last_active":"2023-10-06T11:16:24.116536+0000","last_peered":"2023-10-06T11:16:24.116536+0000","last_clean":"2023-10-06T11:16:24.116536+0000","last_became_active":"2023-10-06T11:16:24.114468+0000","last_became_peered":"2023-10-06T11:16:24.114468+0000","last_unstale":"2023-10-06T11:16:24.116536+0000","last_undegraded":"2023-10-06T11:16:24.116536+0000","last_fullsized":"2023-10-06T11:16:24.116536+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:29.132592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.24","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121795+0000","last_change":"2023-10-06T11:16:24.118093+0000","last_active":"2023-10-06T11:16:24.121795+0000","last_peered":"2023-10-06T11:16:24.121795+0000","last_clean":"2023-10-06T11:16:24.121795+0000","last_became_active":"2023-10-06T11:16:24.117790+0000","last_became_peered":"2023-10-06T11:16:24.117790+0000","last_unstale":"2023-10-06T11:16:24.121795+0000","last_undegraded":"2023-10-06T11:16:24.121795+0000","last_fullsized":"2023-10-06T11:16:24.121795+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:47:48.803032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.23","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.105021+0000","last_change":"2023-10-06T11:16:24.103268+0000","last_active":"2023-10-06T11:16:24.105021+0000","last_peered":"2023-10-06T11:16:24.105021+0000","last_clean":"2023-10-06T11:16:24.105021+0000","last_became_active":"2023-10-06T11:16:24.101418+0000","last_became_peered":"2023-10-06T11:16:24.101418+0000","last_unstale":"2023-10-06T11:16:24.105021+0000","last_undegraded":"2023-10-06T11:16:24.105021+0000","last_fullsized":"2023-10-06T11:16:24.105021+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:00:16.902527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.22","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121730+0000","last_change":"2023-10-06T11:16:24.118266+0000","last_active":"2023-10-06T11:16:24.121730+0000","last_peered":"2023-10-06T11:16:24.121730+0000","last_clean":"2023-10-06T11:16:24.121730+0000","last_became_active":"2023-10-06T11:16:24.118001+0000","last_became_peered":"2023-10-06T11:16:24.118001+0000","last_unstale":"2023-10-06T11:16:24.121730+0000","last_undegraded":"2023-10-06T11:16:24.121730+0000","last_fullsized":"2023-10-06T11:16:24.121730+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:59:42.744899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.21","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.107924+0000","last_change":"2023-10-06T11:16:24.103535+0000","last_active":"2023-10-06T11:16:24.107924+0000","last_peered":"2023-10-06T11:16:24.107924+0000","last_clean":"2023-10-06T11:16:24.107924+0000","last_became_active":"2023-10-06T11:16:24.103293+0000","last_became_peered":"2023-10-06T11:16:24.103293+0000","last_unstale":"2023-10-06T11:16:24.107924+0000","last_undegraded":"2023-10-06T11:16:24.107924+0000","last_fullsized":"2023-10-06T11:16:24.107924+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:10:53.231459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.20","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.114840+0000","last_change":"2023-10-06T11:16:24.112213+0000","last_active":"2023-10-06T11:16:24.114840+0000","last_peered":"2023-10-06T11:16:24.114840+0000","last_clean":"2023-10-06T11:16:24.114840+0000","last_became_active":"2023-10-06T11:16:24.111913+0000","last_became_peered":"2023-10-06T11:16:24.111913+0000","last_unstale":"2023-10-06T11:16:24.114840+0000","last_undegraded":"2023-10-06T11:16:24.114840+0000","last_fullsized":"2023-10-06T11:16:24.114840+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:26:32.565614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.115511+0000","last_change":"2023-10-06T11:16:24.114570+0000","last_active":"2023-10-06T11:16:24.115511+0000","last_peered":"2023-10-06T11:16:24.115511+0000","last_clean":"2023-10-06T11:16:24.115511+0000","last_became_active":"2023-10-06T11:16:24.114308+0000","last_became_peered":"2023-10-06T11:16:24.114308+0000","last_unstale":"2023-10-06T11:16:24.115511+0000","last_undegraded":"2023-10-06T11:16:24.115511+0000","last_fullsized":"2023-10-06T11:16:24.115511+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:51:39.490885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1f","version":"136'4","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.118823+0000","last_change":"2023-10-06T11:16:23.099064+0000","last_active":"2023-10-06T11:16:24.118823+0000","last_peered":"2023-10-06T11:16:24.118823+0000","last_clean":"2023-10-06T11:16:24.118823+0000","last_became_active":"2023-10-06T11:16:23.098801+0000","last_became_peered":"2023-10-06T11:16:23.098801+0000","last_unstale":"2023-10-06T11:16:24.118823+0000","last_undegraded":"2023-10-06T11:16:24.118823+0000","last_fullsized":"2023-10-06T11:16:24.118823+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:41:43.291967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.114685+0000","last_change":"2023-10-06T11:16:24.109497+0000","last_active":"2023-10-06T11:16:24.114685+0000","last_peered":"2023-10-06T11:16:24.114685+0000","last_clean":"2023-10-06T11:16:24.114685+0000","last_became_active":"2023-10-06T11:16:24.109294+0000","last_became_peered":"2023-10-06T11:16:24.109294+0000","last_unstale":"2023-10-06T11:16:24.114685+0000","last_undegraded":"2023-10-06T11:16:24.114685+0000","last_fullsized":"2023-10-06T11:16:24.114685+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:56:01.575492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1e","version":"136'1","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121286+0000","last_change":"2023-10-06T11:16:23.104447+0000","last_active":"2023-10-06T11:16:24.121286+0000","last_peered":"2023-10-06T11:16:24.121286+0000","last_clean":"2023-10-06T11:16:24.121286+0000","last_became_active":"2023-10-06T11:16:23.104161+0000","last_became_peered":"2023-10-06T11:16:23.104161+0000","last_unstale":"2023-10-06T11:16:24.121286+0000","last_undegraded":"2023-10-06T11:16:24.121286+0000","last_fullsized":"2023-10-06T11:16:24.121286+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:56:00.571220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.111352+0000","last_change":"2023-10-06T11:16:24.109988+0000","last_active":"2023-10-06T11:16:24.111352+0000","last_peered":"2023-10-06T11:16:24.111352+0000","last_clean":"2023-10-06T11:16:24.111352+0000","last_became_active":"2023-10-06T11:16:24.108764+0000","last_became_peered":"2023-10-06T11:16:24.108764+0000","last_unstale":"2023-10-06T11:16:24.111352+0000","last_undegraded":"2023-10-06T11:16:24.111352+0000","last_fullsized":"2023-10-06T11:16:24.111352+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:00.422039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.123951+0000","last_change":"2023-10-06T11:16:23.104220+0000","last_active":"2023-10-06T11:16:24.123951+0000","last_peered":"2023-10-06T11:16:24.123951+0000","last_clean":"2023-10-06T11:16:24.123951+0000","last_became_active":"2023-10-06T11:16:23.103920+0000","last_became_peered":"2023-10-06T11:16:23.103920+0000","last_unstale":"2023-10-06T11:16:24.123951+0000","last_undegraded":"2023-10-06T11:16:24.123951+0000","last_fullsized":"2023-10-06T11:16:24.123951+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:50.360247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.122009+0000","last_change":"2023-10-06T11:16:24.118231+0000","last_active":"2023-10-06T11:16:24.122009+0000","last_peered":"2023-10-06T11:16:24.122009+0000","last_clean":"2023-10-06T11:16:24.122009+0000","last_became_active":"2023-10-06T11:16:24.117962+0000","last_became_peered":"2023-10-06T11:16:24.117962+0000","last_unstale":"2023-10-06T11:16:24.122009+0000","last_undegraded":"2023-10-06T11:16:24.122009+0000","last_fullsized":"2023-10-06T11:16:24.122009+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:34:42.484972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1c","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.115288+0000","last_change":"2023-10-06T11:16:23.095632+0000","last_active":"2023-10-06T11:16:24.115288+0000","last_peered":"2023-10-06T11:16:24.115288+0000","last_clean":"2023-10-06T11:16:24.115288+0000","last_became_active":"2023-10-06T11:16:23.095155+0000","last_became_peered":"2023-10-06T11:16:23.095155+0000","last_unstale":"2023-10-06T11:16:24.115288+0000","last_undegraded":"2023-10-06T11:16:24.115288+0000","last_fullsized":"2023-10-06T11:16:24.115288+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:29.555606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.113203+0000","last_change":"2023-10-06T11:16:24.105810+0000","last_active":"2023-10-06T11:16:24.113203+0000","last_peered":"2023-10-06T11:16:24.113203+0000","last_clean":"2023-10-06T11:16:24.113203+0000","last_became_active":"2023-10-06T11:16:24.105537+0000","last_became_peered":"2023-10-06T11:16:24.105537+0000","last_unstale":"2023-10-06T11:16:24.113203+0000","last_undegraded":"2023-10-06T11:16:24.113203+0000","last_fullsized":"2023-10-06T11:16:24.113203+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:42:42.357861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1b","version":"136'1","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121542+0000","last_change":"2023-10-06T11:16:23.097141+0000","last_active":"2023-10-06T11:16:24.121542+0000","last_peered":"2023-10-06T11:16:24.121542+0000","last_clean":"2023-10-06T11:16:24.121542+0000","last_became_active":"2023-10-06T11:16:23.096642+0000","last_became_peered":"2023-10-06T11:16:23.096642+0000","last_unstale":"2023-10-06T11:16:24.121542+0000","last_undegraded":"2023-10-06T11:16:24.121542+0000","last_fullsized":"2023-10-06T11:16:24.121542+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:23:39.341387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.114034+0000","last_change":"2023-10-06T11:16:24.109556+0000","last_active":"2023-10-06T11:16:24.114034+0000","last_peered":"2023-10-06T11:16:24.114034+0000","last_clean":"2023-10-06T11:16:24.114034+0000","last_became_active":"2023-10-06T11:16:24.109278+0000","last_became_peered":"2023-10-06T11:16:24.109278+0000","last_unstale":"2023-10-06T11:16:24.114034+0000","last_undegraded":"2023-10-06T11:16:24.114034+0000","last_fullsized":"2023-10-06T11:16:24.114034+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:56:39.904546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1a","version":"136'1","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116331+0000","last_change":"2023-10-06T11:16:23.099499+0000","last_active":"2023-10-06T11:16:24.116331+0000","last_peered":"2023-10-06T11:16:24.116331+0000","last_clean":"2023-10-06T11:16:24.116331+0000","last_became_active":"2023-10-06T11:16:23.099285+0000","last_became_peered":"2023-10-06T11:16:23.099285+0000","last_unstale":"2023-10-06T11:16:24.116331+0000","last_undegraded":"2023-10-06T11:16:24.116331+0000","last_fullsized":"2023-10-06T11:16:24.116331+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:56:00.571220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.100085+0000","last_change":"2023-10-06T11:16:24.099610+0000","last_active":"2023-10-06T11:16:24.100085+0000","last_peered":"2023-10-06T11:16:24.100085+0000","last_clean":"2023-10-06T11:16:24.100085+0000","last_became_active":"2023-10-06T11:16:24.099351+0000","last_became_peered":"2023-10-06T11:16:24.099351+0000","last_unstale":"2023-10-06T11:16:24.100085+0000","last_undegraded":"2023-10-06T11:16:24.100085+0000","last_fullsized":"2023-10-06T11:16:24.100085+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:28.341917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.095986+0000","last_change":"2023-10-06T11:16:23.100854+0000","last_active":"2023-10-06T11:16:24.095986+0000","last_peered":"2023-10-06T11:16:24.095986+0000","last_clean":"2023-10-06T11:16:24.095986+0000","last_became_active":"2023-10-06T11:16:23.100200+0000","last_became_peered":"2023-10-06T11:16:23.100200+0000","last_unstale":"2023-10-06T11:16:24.095986+0000","last_undegraded":"2023-10-06T11:16:24.095986+0000","last_fullsized":"2023-10-06T11:16:24.095986+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:22:40.220215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.107002+0000","last_change":"2023-10-06T11:16:24.104492+0000","last_active":"2023-10-06T11:16:24.107002+0000","last_peered":"2023-10-06T11:16:24.107002+0000","last_clean":"2023-10-06T11:16:24.107002+0000","last_became_active":"2023-10-06T11:16:24.104181+0000","last_became_peered":"2023-10-06T11:16:24.104181+0000","last_unstale":"2023-10-06T11:16:24.107002+0000","last_undegraded":"2023-10-06T11:16:24.107002+0000","last_fullsized":"2023-10-06T11:16:24.107002+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:55:36.589699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.098162+0000","last_change":"2023-10-06T11:16:23.097833+0000","last_active":"2023-10-06T11:16:24.098162+0000","last_peered":"2023-10-06T11:16:24.098162+0000","last_clean":"2023-10-06T11:16:24.098162+0000","last_became_active":"2023-10-06T11:16:23.097560+0000","last_became_peered":"2023-10-06T11:16:23.097560+0000","last_unstale":"2023-10-06T11:16:24.098162+0000","last_undegraded":"2023-10-06T11:16:24.098162+0000","last_fullsized":"2023-10-06T11:16:24.098162+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:01:05.784628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121995+0000","last_change":"2023-10-06T11:16:24.118160+0000","last_active":"2023-10-06T11:16:24.121995+0000","last_peered":"2023-10-06T11:16:24.121995+0000","last_clean":"2023-10-06T11:16:24.121995+0000","last_became_active":"2023-10-06T11:16:24.117892+0000","last_became_peered":"2023-10-06T11:16:24.117892+0000","last_unstale":"2023-10-06T11:16:24.121995+0000","last_undegraded":"2023-10-06T11:16:24.121995+0000","last_fullsized":"2023-10-06T11:16:24.121995+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:52.405684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.f","version":"136'1","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121722+0000","last_change":"2023-10-06T11:16:23.100806+0000","last_active":"2023-10-06T11:16:24.121722+0000","last_peered":"2023-10-06T11:16:24.121722+0000","last_clean":"2023-10-06T11:16:24.121722+0000","last_became_active":"2023-10-06T11:16:23.099910+0000","last_became_peered":"2023-10-06T11:16:23.099910+0000","last_unstale":"2023-10-06T11:16:24.121722+0000","last_undegraded":"2023-10-06T11:16:24.121722+0000","last_fullsized":"2023-10-06T11:16:24.121722+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:21:56.372977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.119434+0000","last_change":"2023-10-06T11:16:24.115023+0000","last_active":"2023-10-06T11:16:24.119434+0000","last_peered":"2023-10-06T11:16:24.119434+0000","last_clean":"2023-10-06T11:16:24.119434+0000","last_became_active":"2023-10-06T11:16:24.114720+0000","last_became_peered":"2023-10-06T11:16:24.114720+0000","last_unstale":"2023-10-06T11:16:24.119434+0000","last_undegraded":"2023-10-06T11:16:24.119434+0000","last_fullsized":"2023-10-06T11:16:24.119434+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:57:19.593270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.e","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121773+0000","last_change":"2023-10-06T11:16:23.103494+0000","last_active":"2023-10-06T11:16:24.121773+0000","last_peered":"2023-10-06T11:16:24.121773+0000","last_clean":"2023-10-06T11:16:24.121773+0000","last_became_active":"2023-10-06T11:16:23.103217+0000","last_became_peered":"2023-10-06T11:16:23.103217+0000","last_unstale":"2023-10-06T11:16:24.121773+0000","last_undegraded":"2023-10-06T11:16:24.121773+0000","last_fullsized":"2023-10-06T11:16:24.121773+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:01:05.784628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.107033+0000","last_change":"2023-10-06T11:16:24.104031+0000","last_active":"2023-10-06T11:16:24.107033+0000","last_peered":"2023-10-06T11:16:24.107033+0000","last_clean":"2023-10-06T11:16:24.107033+0000","last_became_active":"2023-10-06T11:16:24.103748+0000","last_became_peered":"2023-10-06T11:16:24.103748+0000","last_unstale":"2023-10-06T11:16:24.107033+0000","last_undegraded":"2023-10-06T11:16:24.107033+0000","last_fullsized":"2023-10-06T11:16:24.107033+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:51.364520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"136'1","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116628+0000","last_change":"2023-10-06T11:16:23.096904+0000","last_active":"2023-10-06T11:16:24.116628+0000","last_peered":"2023-10-06T11:16:24.116628+0000","last_clean":"2023-10-06T11:16:24.116628+0000","last_became_active":"2023-10-06T11:16:23.096415+0000","last_became_peered":"2023-10-06T11:16:23.096415+0000","last_unstale":"2023-10-06T11:16:24.116628+0000","last_undegraded":"2023-10-06T11:16:24.116628+0000","last_fullsized":"2023-10-06T11:16:24.116628+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:22:40.220215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.119617+0000","last_change":"2023-10-06T11:16:24.114058+0000","last_active":"2023-10-06T11:16:24.119617+0000","last_peered":"2023-10-06T11:16:24.119617+0000","last_clean":"2023-10-06T11:16:24.119617+0000","last_became_active":"2023-10-06T11:16:24.111051+0000","last_became_peered":"2023-10-06T11:16:24.111051+0000","last_unstale":"2023-10-06T11:16:24.119617+0000","last_undegraded":"2023-10-06T11:16:24.119617+0000","last_fullsized":"2023-10-06T11:16:24.119617+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:46:59.369734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.100537+0000","last_change":"2023-10-06T11:16:23.100758+0000","last_active":"2023-10-06T11:16:24.100537+0000","last_peered":"2023-10-06T11:16:24.100537+0000","last_clean":"2023-10-06T11:16:24.100537+0000","last_became_active":"2023-10-06T11:16:23.100386+0000","last_became_peered":"2023-10-06T11:16:23.100386+0000","last_unstale":"2023-10-06T11:16:24.100537+0000","last_undegraded":"2023-10-06T11:16:24.100537+0000","last_fullsized":"2023-10-06T11:16:24.100537+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:21:40.808593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121900+0000","last_change":"2023-10-06T11:16:24.116989+0000","last_active":"2023-10-06T11:16:24.121900+0000","last_peered":"2023-10-06T11:16:24.121900+0000","last_clean":"2023-10-06T11:16:24.121900+0000","last_became_active":"2023-10-06T11:16:24.116709+0000","last_became_peered":"2023-10-06T11:16:24.116709+0000","last_unstale":"2023-10-06T11:16:24.121900+0000","last_undegraded":"2023-10-06T11:16:24.121900+0000","last_fullsized":"2023-10-06T11:16:24.121900+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:37:37.920152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.b","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.118772+0000","last_change":"2023-10-06T11:16:23.094553+0000","last_active":"2023-10-06T11:16:24.118772+0000","last_peered":"2023-10-06T11:16:24.118772+0000","last_clean":"2023-10-06T11:16:24.118772+0000","last_became_active":"2023-10-06T11:16:23.094319+0000","last_became_peered":"2023-10-06T11:16:23.094319+0000","last_unstale":"2023-10-06T11:16:24.118772+0000","last_undegraded":"2023-10-06T11:16:24.118772+0000","last_fullsized":"2023-10-06T11:16:24.118772+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:28.128320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.110934+0000","last_change":"2023-10-06T11:16:24.105441+0000","last_active":"2023-10-06T11:16:24.110934+0000","last_peered":"2023-10-06T11:16:24.110934+0000","last_clean":"2023-10-06T11:16:24.110934+0000","last_became_active":"2023-10-06T11:16:24.105198+0000","last_became_peered":"2023-10-06T11:16:24.105198+0000","last_unstale":"2023-10-06T11:16:24.110934+0000","last_undegraded":"2023-10-06T11:16:24.110934+0000","last_fullsized":"2023-10-06T11:16:24.110934+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:17:35.914399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.097721+0000","last_change":"2023-10-06T11:16:23.095380+0000","last_active":"2023-10-06T11:16:24.097721+0000","last_peered":"2023-10-06T11:16:24.097721+0000","last_clean":"2023-10-06T11:16:24.097721+0000","last_became_active":"2023-10-06T11:16:23.095085+0000","last_became_peered":"2023-10-06T11:16:23.095085+0000","last_unstale":"2023-10-06T11:16:24.097721+0000","last_undegraded":"2023-10-06T11:16:24.097721+0000","last_fullsized":"2023-10-06T11:16:24.097721+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:24:32.121630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.123888+0000","last_change":"2023-10-06T11:16:24.122010+0000","last_active":"2023-10-06T11:16:24.123888+0000","last_peered":"2023-10-06T11:16:24.123888+0000","last_clean":"2023-10-06T11:16:24.123888+0000","last_became_active":"2023-10-06T11:16:24.121668+0000","last_became_peered":"2023-10-06T11:16:24.121668+0000","last_unstale":"2023-10-06T11:16:24.123888+0000","last_undegraded":"2023-10-06T11:16:24.123888+0000","last_fullsized":"2023-10-06T11:16:24.123888+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:48.961124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.101790+0000","last_change":"2023-10-06T11:16:23.094432+0000","last_active":"2023-10-06T11:16:24.101790+0000","last_peered":"2023-10-06T11:16:24.101790+0000","last_clean":"2023-10-06T11:16:24.101790+0000","last_became_active":"2023-10-06T11:16:23.094187+0000","last_became_peered":"2023-10-06T11:16:23.094187+0000","last_unstale":"2023-10-06T11:16:24.101790+0000","last_undegraded":"2023-10-06T11:16:24.101790+0000","last_fullsized":"2023-10-06T11:16:24.101790+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:10:52.227186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.113900+0000","last_change":"2023-10-06T11:16:24.108819+0000","last_active":"2023-10-06T11:16:24.113900+0000","last_peered":"2023-10-06T11:16:24.113900+0000","last_clean":"2023-10-06T11:16:24.113900+0000","last_became_active":"2023-10-06T11:16:24.108557+0000","last_became_peered":"2023-10-06T11:16:24.108557+0000","last_unstale":"2023-10-06T11:16:24.113900+0000","last_undegraded":"2023-10-06T11:16:24.113900+0000","last_fullsized":"2023-10-06T11:16:24.113900+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:51.364520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.096738+0000","last_change":"2023-10-06T11:16:23.093074+0000","last_active":"2023-10-06T11:16:24.096738+0000","last_peered":"2023-10-06T11:16:24.096738+0000","last_clean":"2023-10-06T11:16:24.096738+0000","last_became_active":"2023-10-06T11:16:23.092798+0000","last_became_peered":"2023-10-06T11:16:23.092798+0000","last_unstale":"2023-10-06T11:16:24.096738+0000","last_undegraded":"2023-10-06T11:16:24.096738+0000","last_fullsized":"2023-10-06T11:16:24.096738+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:33.952357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116082+0000","last_change":"2023-10-06T11:16:24.108869+0000","last_active":"2023-10-06T11:16:24.116082+0000","last_peered":"2023-10-06T11:16:24.116082+0000","last_clean":"2023-10-06T11:16:24.116082+0000","last_became_active":"2023-10-06T11:16:24.108622+0000","last_became_peered":"2023-10-06T11:16:24.108622+0000","last_unstale":"2023-10-06T11:16:24.116082+0000","last_undegraded":"2023-10-06T11:16:24.116082+0000","last_fullsized":"2023-10-06T11:16:24.116082+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:41:52.405684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.7","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121466+0000","last_change":"2023-10-06T11:16:23.098062+0000","last_active":"2023-10-06T11:16:24.121466+0000","last_peered":"2023-10-06T11:16:24.121466+0000","last_clean":"2023-10-06T11:16:24.121466+0000","last_became_active":"2023-10-06T11:16:23.097769+0000","last_became_peered":"2023-10-06T11:16:23.097769+0000","last_unstale":"2023-10-06T11:16:24.121466+0000","last_undegraded":"2023-10-06T11:16:24.121466+0000","last_fullsized":"2023-10-06T11:16:24.121466+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:41:28.999854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.114153+0000","last_change":"2023-10-06T11:16:24.108302+0000","last_active":"2023-10-06T11:16:24.114153+0000","last_peered":"2023-10-06T11:16:24.114153+0000","last_clean":"2023-10-06T11:16:24.114153+0000","last_became_active":"2023-10-06T11:16:24.108014+0000","last_became_peered":"2023-10-06T11:16:24.108014+0000","last_unstale":"2023-10-06T11:16:24.114153+0000","last_undegraded":"2023-10-06T11:16:24.114153+0000","last_fullsized":"2023-10-06T11:16:24.114153+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:23:40.345660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"137'1","reported_seq":11,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-06T11:16:25.097162+0000","last_change":"2023-10-06T11:16:23.103805+0000","last_active":"2023-10-06T11:16:25.097162+0000","last_peered":"2023-10-06T11:16:25.097162+0000","last_clean":"2023-10-06T11:16:25.097162+0000","last_became_active":"2023-10-06T11:16:23.103470+0000","last_became_peered":"2023-10-06T11:16:23.103470+0000","last_unstale":"2023-10-06T11:16:25.097162+0000","last_undegraded":"2023-10-06T11:16:25.097162+0000","last_fullsized":"2023-10-06T11:16:25.097162+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:56:40.401445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.107051+0000","last_change":"2023-10-06T11:16:24.104047+0000","last_active":"2023-10-06T11:16:24.107051+0000","last_peered":"2023-10-06T11:16:24.107051+0000","last_clean":"2023-10-06T11:16:24.107051+0000","last_became_active":"2023-10-06T11:16:24.103777+0000","last_became_peered":"2023-10-06T11:16:24.103777+0000","last_unstale":"2023-10-06T11:16:24.107051+0000","last_undegraded":"2023-10-06T11:16:24.107051+0000","last_fullsized":"2023-10-06T11:16:24.107051+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:01:06.788901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.094909+0000","last_change":"2023-10-06T11:16:23.096622+0000","last_active":"2023-10-06T11:16:24.094909+0000","last_peered":"2023-10-06T11:16:24.094909+0000","last_clean":"2023-10-06T11:16:24.094909+0000","last_became_active":"2023-10-06T11:16:23.096367+0000","last_became_peered":"2023-10-06T11:16:23.096367+0000","last_unstale":"2023-10-06T11:16:24.094909+0000","last_undegraded":"2023-10-06T11:16:24.094909+0000","last_fullsized":"2023-10-06T11:16:24.094909+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:13:24.765345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116127+0000","last_change":"2023-10-06T11:16:24.109597+0000","last_active":"2023-10-06T11:16:24.116127+0000","last_peered":"2023-10-06T11:16:24.116127+0000","last_clean":"2023-10-06T11:16:24.116127+0000","last_became_active":"2023-10-06T11:16:24.109315+0000","last_became_peered":"2023-10-06T11:16:24.109315+0000","last_unstale":"2023-10-06T11:16:24.116127+0000","last_undegraded":"2023-10-06T11:16:24.116127+0000","last_fullsized":"2023-10-06T11:16:24.116127+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:02.452752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.098576+0000","last_change":"2023-10-06T11:16:23.102516+0000","last_active":"2023-10-06T11:16:24.098576+0000","last_peered":"2023-10-06T11:16:24.098576+0000","last_clean":"2023-10-06T11:16:24.098576+0000","last_became_active":"2023-10-06T11:16:23.102238+0000","last_became_peered":"2023-10-06T11:16:23.102238+0000","last_unstale":"2023-10-06T11:16:24.098576+0000","last_undegraded":"2023-10-06T11:16:24.098576+0000","last_fullsized":"2023-10-06T11:16:24.098576+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:32:50.360247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.116314+0000","last_change":"2023-10-06T11:16:24.113790+0000","last_active":"2023-10-06T11:16:24.116314+0000","last_peered":"2023-10-06T11:16:24.116314+0000","last_clean":"2023-10-06T11:16:24.116314+0000","last_became_active":"2023-10-06T11:16:24.113521+0000","last_became_peered":"2023-10-06T11:16:24.113521+0000","last_unstale":"2023-10-06T11:16:24.116314+0000","last_undegraded":"2023-10-06T11:16:24.116314+0000","last_fullsized":"2023-10-06T11:16:24.116314+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:56:01.575492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.095562+0000","last_change":"2023-10-06T11:16:23.095758+0000","last_active":"2023-10-06T11:16:24.095562+0000","last_peered":"2023-10-06T11:16:24.095562+0000","last_clean":"2023-10-06T11:16:24.095562+0000","last_became_active":"2023-10-06T11:16:23.095515+0000","last_became_peered":"2023-10-06T11:16:23.095515+0000","last_unstale":"2023-10-06T11:16:24.095562+0000","last_undegraded":"2023-10-06T11:16:24.095562+0000","last_fullsized":"2023-10-06T11:16:24.095562+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:23:31.995315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.114013+0000","last_change":"2023-10-06T11:16:24.109510+0000","last_active":"2023-10-06T11:16:24.114013+0000","last_peered":"2023-10-06T11:16:24.114013+0000","last_clean":"2023-10-06T11:16:24.114013+0000","last_became_active":"2023-10-06T11:16:24.108794+0000","last_became_peered":"2023-10-06T11:16:24.108794+0000","last_unstale":"2023-10-06T11:16:24.114013+0000","last_undegraded":"2023-10-06T11:16:24.114013+0000","last_fullsized":"2023-10-06T11:16:24.114013+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:34:44.606893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.104780+0000","last_change":"2023-10-06T11:16:23.095211+0000","last_active":"2023-10-06T11:16:24.104780+0000","last_peered":"2023-10-06T11:16:24.104780+0000","last_clean":"2023-10-06T11:16:24.104780+0000","last_became_active":"2023-10-06T11:16:23.094924+0000","last_became_peered":"2023-10-06T11:16:23.094924+0000","last_unstale":"2023-10-06T11:16:24.104780+0000","last_undegraded":"2023-10-06T11:16:24.104780+0000","last_fullsized":"2023-10-06T11:16:24.104780+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:10:17.504059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.108093+0000","last_change":"2023-10-06T11:16:24.103563+0000","last_active":"2023-10-06T11:16:24.108093+0000","last_peered":"2023-10-06T11:16:24.108093+0000","last_clean":"2023-10-06T11:16:24.108093+0000","last_became_active":"2023-10-06T11:16:24.103321+0000","last_became_peered":"2023-10-06T11:16:24.103321+0000","last_unstale":"2023-10-06T11:16:24.108093+0000","last_undegraded":"2023-10-06T11:16:24.108093+0000","last_fullsized":"2023-10-06T11:16:24.108093+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:46:59.369734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.096094+0000","last_change":"2023-10-06T11:16:23.098284+0000","last_active":"2023-10-06T11:16:24.096094+0000","last_peered":"2023-10-06T11:16:24.096094+0000","last_clean":"2023-10-06T11:16:24.096094+0000","last_became_active":"2023-10-06T11:16:23.098000+0000","last_became_peered":"2023-10-06T11:16:23.098000+0000","last_unstale":"2023-10-06T11:16:24.096094+0000","last_undegraded":"2023-10-06T11:16:24.096094+0000","last_fullsized":"2023-10-06T11:16:24.096094+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:13:24.765345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.115582+0000","last_change":"2023-10-06T11:16:24.113207+0000","last_active":"2023-10-06T11:16:24.115582+0000","last_peered":"2023-10-06T11:16:24.115582+0000","last_clean":"2023-10-06T11:16:24.115582+0000","last_became_active":"2023-10-06T11:16:24.112366+0000","last_became_peered":"2023-10-06T11:16:24.112366+0000","last_unstale":"2023-10-06T11:16:24.115582+0000","last_undegraded":"2023-10-06T11:16:24.115582+0000","last_fullsized":"2023-10-06T11:16:24.115582+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:41:30.610880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.104935+0000","last_change":"2023-10-06T11:16:23.101344+0000","last_active":"2023-10-06T11:16:24.104935+0000","last_peered":"2023-10-06T11:16:24.104935+0000","last_clean":"2023-10-06T11:16:24.104935+0000","last_became_active":"2023-10-06T11:16:23.101075+0000","last_became_peered":"2023-10-06T11:16:23.101075+0000","last_unstale":"2023-10-06T11:16:24.104935+0000","last_undegraded":"2023-10-06T11:16:24.104935+0000","last_fullsized":"2023-10-06T11:16:24.104935+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:17:34.910126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.111925+0000","last_change":"2023-10-06T11:16:24.107101+0000","last_active":"2023-10-06T11:16:24.111925+0000","last_peered":"2023-10-06T11:16:24.111925+0000","last_clean":"2023-10-06T11:16:24.111925+0000","last_became_active":"2023-10-06T11:16:24.106838+0000","last_became_peered":"2023-10-06T11:16:24.106838+0000","last_unstale":"2023-10-06T11:16:24.111925+0000","last_undegraded":"2023-10-06T11:16:24.111925+0000","last_fullsized":"2023-10-06T11:16:24.111925+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:52:28.634794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.102585+0000","last_change":"2023-10-06T11:16:23.098276+0000","last_active":"2023-10-06T11:16:24.102585+0000","last_peered":"2023-10-06T11:16:24.102585+0000","last_clean":"2023-10-06T11:16:24.102585+0000","last_became_active":"2023-10-06T11:16:23.097993+0000","last_became_peered":"2023-10-06T11:16:23.097993+0000","last_unstale":"2023-10-06T11:16:24.102585+0000","last_undegraded":"2023-10-06T11:16:24.102585+0000","last_fullsized":"2023-10-06T11:16:24.102585+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:25:24.280341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":120,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.095270+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:16:24.095270+0000","last_peered":"2023-10-06T11:16:24.095270+0000","last_clean":"2023-10-06T11:16:24.095270+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:16:24.095270+0000","last_undegraded":"2023-10-06T11:16:24.095270+0000","last_fullsized":"2023-10-06T11:16:24.095270+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.114659+0000","last_change":"2023-10-06T11:16:24.111698+0000","last_active":"2023-10-06T11:16:24.114659+0000","last_peered":"2023-10-06T11:16:24.114659+0000","last_clean":"2023-10-06T11:16:24.114659+0000","last_became_active":"2023-10-06T11:16:24.111432+0000","last_became_peered":"2023-10-06T11:16:24.111432+0000","last_unstale":"2023-10-06T11:16:24.114659+0000","last_undegraded":"2023-10-06T11:16:24.114659+0000","last_fullsized":"2023-10-06T11:16:24.114659+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:55:36.589699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.10","version":"136'8","reported_seq":18,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.126509+0000","last_change":"2023-10-06T11:16:23.100992+0000","last_active":"2023-10-06T11:16:24.126509+0000","last_peered":"2023-10-06T11:16:24.126509+0000","last_clean":"2023-10-06T11:16:24.126509+0000","last_became_active":"2023-10-06T11:16:23.100717+0000","last_became_peered":"2023-10-06T11:16:23.100717+0000","last_unstale":"2023-10-06T11:16:24.126509+0000","last_undegraded":"2023-10-06T11:16:24.126509+0000","last_fullsized":"2023-10-06T11:16:24.126509+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:17:10.613647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":112,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.098652+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:16:24.098652+0000","last_peered":"2023-10-06T11:16:24.098652+0000","last_clean":"2023-10-06T11:16:24.098652+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:16:24.098652+0000","last_undegraded":"2023-10-06T11:16:24.098652+0000","last_fullsized":"2023-10-06T11:16:24.098652+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.118408+0000","last_change":"2023-10-06T11:16:24.114806+0000","last_active":"2023-10-06T11:16:24.118408+0000","last_peered":"2023-10-06T11:16:24.118408+0000","last_clean":"2023-10-06T11:16:24.118408+0000","last_became_active":"2023-10-06T11:16:24.114534+0000","last_became_peered":"2023-10-06T11:16:24.114534+0000","last_unstale":"2023-10-06T11:16:24.118408+0000","last_undegraded":"2023-10-06T11:16:24.118408+0000","last_fullsized":"2023-10-06T11:16:24.118408+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:00:35.003929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.107394+0000","last_change":"2023-10-06T11:16:23.100682+0000","last_active":"2023-10-06T11:16:24.107394+0000","last_peered":"2023-10-06T11:16:24.107394+0000","last_clean":"2023-10-06T11:16:24.107394+0000","last_became_active":"2023-10-06T11:16:23.099315+0000","last_became_peered":"2023-10-06T11:16:23.099315+0000","last_unstale":"2023-10-06T11:16:24.107394+0000","last_undegraded":"2023-10-06T11:16:24.107394+0000","last_fullsized":"2023-10-06T11:16:24.107394+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:26:31.561341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":109,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.094719+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:16:24.094719+0000","last_peered":"2023-10-06T11:16:24.094719+0000","last_clean":"2023-10-06T11:16:24.094719+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:16:24.094719+0000","last_undegraded":"2023-10-06T11:16:24.094719+0000","last_fullsized":"2023-10-06T11:16:24.094719+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":255,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.105025+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:16:24.105025+0000","last_peered":"2023-10-06T11:16:24.105025+0000","last_clean":"2023-10-06T11:16:24.105025+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:16:24.105025+0000","last_undegraded":"2023-10-06T11:16:24.105025+0000","last_fullsized":"2023-10-06T11:16:24.105025+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121988+0000","last_change":"2023-10-06T11:16:24.120168+0000","last_active":"2023-10-06T11:16:24.121988+0000","last_peered":"2023-10-06T11:16:24.121988+0000","last_clean":"2023-10-06T11:16:24.121988+0000","last_became_active":"2023-10-06T11:16:24.119797+0000","last_became_peered":"2023-10-06T11:16:24.119797+0000","last_unstale":"2023-10-06T11:16:24.121988+0000","last_undegraded":"2023-10-06T11:16:24.121988+0000","last_fullsized":"2023-10-06T11:16:24.121988+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:04:48.357935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.098212+0000","last_change":"2023-10-06T11:16:23.098273+0000","last_active":"2023-10-06T11:16:24.098212+0000","last_peered":"2023-10-06T11:16:24.098212+0000","last_clean":"2023-10-06T11:16:24.098212+0000","last_became_active":"2023-10-06T11:16:23.097970+0000","last_became_peered":"2023-10-06T11:16:23.097970+0000","last_unstale":"2023-10-06T11:16:24.098212+0000","last_undegraded":"2023-10-06T11:16:24.098212+0000","last_fullsized":"2023-10-06T11:16:24.098212+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:50:29.555606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":105,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.106284+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:16:24.106284+0000","last_peered":"2023-10-06T11:16:24.106284+0000","last_clean":"2023-10-06T11:16:24.106284+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:16:24.106284+0000","last_undegraded":"2023-10-06T11:16:24.106284+0000","last_fullsized":"2023-10-06T11:16:24.106284+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.101540+0000","last_change":"2023-10-06T11:16:24.099206+0000","last_active":"2023-10-06T11:16:24.101540+0000","last_peered":"2023-10-06T11:16:24.101540+0000","last_clean":"2023-10-06T11:16:24.101540+0000","last_became_active":"2023-10-06T11:16:24.098925+0000","last_became_peered":"2023-10-06T11:16:24.098925+0000","last_unstale":"2023-10-06T11:16:24.101540+0000","last_undegraded":"2023-10-06T11:16:24.101540+0000","last_fullsized":"2023-10-06T11:16:24.101540+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:09:31.548998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.14","version":"136'6","reported_seq":16,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.126641+0000","last_change":"2023-10-06T11:16:23.095177+0000","last_active":"2023-10-06T11:16:24.126641+0000","last_peered":"2023-10-06T11:16:24.126641+0000","last_clean":"2023-10-06T11:16:24.126641+0000","last_became_active":"2023-10-06T11:16:23.094700+0000","last_became_peered":"2023-10-06T11:16:23.094700+0000","last_unstale":"2023-10-06T11:16:24.126641+0000","last_undegraded":"2023-10-06T11:16:24.126641+0000","last_fullsized":"2023-10-06T11:16:24.126641+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:05:16.082206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":105,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.105115+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:16:24.105115+0000","last_peered":"2023-10-06T11:16:24.105115+0000","last_clean":"2023-10-06T11:16:24.105115+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:16:24.105115+0000","last_undegraded":"2023-10-06T11:16:24.105115+0000","last_fullsized":"2023-10-06T11:16:24.105115+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.120333+0000","last_change":"2023-10-06T11:16:24.106952+0000","last_active":"2023-10-06T11:16:24.120333+0000","last_peered":"2023-10-06T11:16:24.120333+0000","last_clean":"2023-10-06T11:16:24.120333+0000","last_became_active":"2023-10-06T11:16:24.106431+0000","last_became_peered":"2023-10-06T11:16:24.106431+0000","last_unstale":"2023-10-06T11:16:24.120333+0000","last_undegraded":"2023-10-06T11:16:24.120333+0000","last_fullsized":"2023-10-06T11:16:24.120333+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:59:53.565267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.15","version":"136'3","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.121884+0000","last_change":"2023-10-06T11:16:23.091484+0000","last_active":"2023-10-06T11:16:24.121884+0000","last_peered":"2023-10-06T11:16:24.121884+0000","last_clean":"2023-10-06T11:16:24.121884+0000","last_became_active":"2023-10-06T11:16:23.090228+0000","last_became_peered":"2023-10-06T11:16:23.090228+0000","last_unstale":"2023-10-06T11:16:24.121884+0000","last_undegraded":"2023-10-06T11:16:24.121884+0000","last_fullsized":"2023-10-06T11:16:24.121884+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:05:24.455055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":126,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.096193+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:16:24.096193+0000","last_peered":"2023-10-06T11:16:24.096193+0000","last_clean":"2023-10-06T11:16:24.096193+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:16:24.096193+0000","last_undegraded":"2023-10-06T11:16:24.096193+0000","last_fullsized":"2023-10-06T11:16:24.096193+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.114696+0000","last_change":"2023-10-06T11:16:24.110980+0000","last_active":"2023-10-06T11:16:24.114696+0000","last_peered":"2023-10-06T11:16:24.114696+0000","last_clean":"2023-10-06T11:16:24.114696+0000","last_became_active":"2023-10-06T11:16:24.109822+0000","last_became_peered":"2023-10-06T11:16:24.109822+0000","last_unstale":"2023-10-06T11:16:24.114696+0000","last_undegraded":"2023-10-06T11:16:24.114696+0000","last_fullsized":"2023-10-06T11:16:24.114696+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:11.876870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":10,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.102176+0000","last_change":"2023-10-06T11:16:23.102634+0000","last_active":"2023-10-06T11:16:24.102176+0000","last_peered":"2023-10-06T11:16:24.102176+0000","last_clean":"2023-10-06T11:16:24.102176+0000","last_became_active":"2023-10-06T11:16:23.102283+0000","last_became_peered":"2023-10-06T11:16:23.102283+0000","last_unstale":"2023-10-06T11:16:24.102176+0000","last_undegraded":"2023-10-06T11:16:24.102176+0000","last_fullsized":"2023-10-06T11:16:24.102176+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:29:52.048108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":112,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.102185+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:16:24.102185+0000","last_peered":"2023-10-06T11:16:24.102185+0000","last_clean":"2023-10-06T11:16:24.102185+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:16:24.102185+0000","last_undegraded":"2023-10-06T11:16:24.102185+0000","last_fullsized":"2023-10-06T11:16:24.102185+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":9,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.118386+0000","last_change":"2023-10-06T11:16:24.114730+0000","last_active":"2023-10-06T11:16:24.118386+0000","last_peered":"2023-10-06T11:16:24.118386+0000","last_clean":"2023-10-06T11:16:24.118386+0000","last_became_active":"2023-10-06T11:16:24.114246+0000","last_became_peered":"2023-10-06T11:16:24.114246+0000","last_unstale":"2023-10-06T11:16:24.118386+0000","last_undegraded":"2023-10-06T11:16:24.118386+0000","last_fullsized":"2023-10-06T11:16:24.118386+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:23.078855+0000","last_clean_scrub_stamp":"2023-10-06T11:16:23.078855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:48.961124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.13","version":"136'2","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.117964+0000","last_change":"2023-10-06T11:16:23.099218+0000","last_active":"2023-10-06T11:16:24.117964+0000","last_peered":"2023-10-06T11:16:24.117964+0000","last_clean":"2023-10-06T11:16:24.117964+0000","last_became_active":"2023-10-06T11:16:23.098941+0000","last_became_peered":"2023-10-06T11:16:23.098941+0000","last_unstale":"2023-10-06T11:16:24.117964+0000","last_undegraded":"2023-10-06T11:16:24.117964+0000","last_fullsized":"2023-10-06T11:16:24.117964+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:16:22.074583+0000","last_clean_scrub_stamp":"2023-10-06T11:16:22.074583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:46:58.365462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":112,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-10-06T11:16:24.102758+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:16:24.102758+0000","last_peered":"2023-10-06T11:16:24.102758+0000","last_clean":"2023-10-06T11:16:24.102758+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:16:24.102758+0000","last_undegraded":"2023-10-06T11:16:24.102758+0000","last_fullsized":"2023-10-06T11:16:24.102758+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":22,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574982,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303644,"kb_used_data":2260,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068196,"statfs":{"total":96636764160,"available":96325832704,"internally_reserved":0,"allocated":2314240,"data_stored":1379705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.51200000000000001,"15min":0.625},"min":{"1min":0.30299999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.68899999999999995,"5min":4.407,"15min":23.908999999999999},"last":0.499},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.48499999999999999,"15min":0.57399999999999995},"min":{"1min":0.313,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.68300000000000005,"5min":0.69799999999999995,"15min":9.3230000000000004},"last":0.61399999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51000000000000001,"15min":0.55900000000000005},"min":{"1min":0.35299999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.71499999999999997,"5min":2.4689999999999999,"15min":9.2360000000000007},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.47299999999999998,"15min":0.503},"min":{"1min":0.373,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.64400000000000002,"5min":0.78900000000000003,"15min":4.327},"last":0.45900000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54000000000000004,"15min":0.51700000000000002},"min":{"1min":0.39900000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.63500000000000001,"5min":4.3120000000000003,"15min":4.3120000000000003},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53600000000000003,"15min":0.55700000000000005},"min":{"1min":0.34799999999999998,"5min":0.31,"15min":0.29999999999999999},"max":{"1min":0.70699999999999996,"5min":3.0600000000000001,"15min":4.7309999999999999},"last":0.47599999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.54600000000000004,"15min":0.53900000000000003},"min":{"1min":0.36499999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.72099999999999997,"5min":4.5190000000000001,"15min":4.5190000000000001},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56100000000000005,"15min":0.59899999999999998},"min":{"1min":0.38100000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.74099999999999999,"5min":3.0070000000000001,"15min":9.3879999999999999},"last":0.52400000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.502,"15min":0.48999999999999999},"min":{"1min":0.32800000000000001,"5min":0.26000000000000001,"15min":0.24399999999999999},"max":{"1min":0.68700000000000006,"5min":4.6639999999999997,"15min":4.6639999999999997},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.53600000000000003},"min":{"1min":0.33300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.78200000000000003,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":0.55000000000000004}]},{"osd":5,"last update":"Fri Oct 6 11:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.51200000000000001,"15min":0.56100000000000005},"min":{"1min":0.33900000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":9.3499999999999996},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.5,"15min":0.54200000000000004},"min":{"1min":0.377,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.74299999999999999,"5min":0.83399999999999996,"15min":4.444},"last":0.51300000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:16:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.53800000000000003,"15min":0.59699999999999998},"min":{"1min":0.41499999999999998,"5min":0.32400000000000001,"15min":0.29199999999999998},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":9.4969999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60899999999999999,"15min":0.62},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.85799999999999998,"5min":4.4669999999999996,"15min":7.2039999999999997},"last":0.59799999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574984,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298964,"kb_used_data":1676,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072876,"statfs":{"total":96636764160,"available":96330625024,"internally_reserved":0,"allocated":1716224,"data_stored":788032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.56299999999999994,"15min":0.52000000000000002},"min":{"1min":0.254,"5min":0.187,"15min":0.187},"max":{"1min":0.66400000000000003,"5min":9.5549999999999997,"15min":9.5549999999999997},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.63300000000000001,"15min":0.56399999999999995},"min":{"1min":0.30399999999999999,"5min":0.254,"15min":0.254},"max":{"1min":0.73999999999999999,"5min":9.4659999999999993,"15min":9.4659999999999993},"last":0.46300000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46100000000000002,"15min":0.48299999999999998},"min":{"1min":0.27500000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.68000000000000005,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.498},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.56000000000000005,"15min":0.51500000000000001},"min":{"1min":0.34399999999999997,"5min":0.216,"15min":0.216},"max":{"1min":0.71499999999999997,"5min":5.2670000000000003,"15min":5.2670000000000003},"last":0.36199999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.46600000000000003,"15min":0.499},"min":{"1min":0.29399999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.65800000000000003,"5min":0.93200000000000005,"15min":7.0659999999999998},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.48399999999999999,"15min":0.51800000000000002},"min":{"1min":0.39100000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.72599999999999998,"5min":1.0069999999999999,"15min":7.0819999999999999},"last":0.443}]},{"osd":3,"last update":"Fri Oct 6 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54000000000000004,"15min":0.51700000000000002},"min":{"1min":0.34300000000000003,"5min":0.317,"15min":0.25800000000000001},"max":{"1min":0.67300000000000004,"5min":3.871,"15min":3.871},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.51100000000000001,"15min":0.53000000000000003},"min":{"1min":0.32100000000000001,"5min":0.316,"15min":0.312},"max":{"1min":0.69199999999999995,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.51200000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.45600000000000002,"15min":0.48099999999999998},"min":{"1min":0.27400000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.65600000000000003,"5min":0.88,"15min":0.88},"last":0.378},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51400000000000001,"15min":0.53600000000000003},"min":{"1min":0.29699999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.75700000000000001,"5min":0.82399999999999995,"15min":1.0680000000000001},"last":0.55200000000000005}]},{"osd":5,"last update":"Fri Oct 6 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.499,"15min":0.51900000000000002},"min":{"1min":0.33000000000000002,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.78700000000000003,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.60699999999999998,"15min":0.58299999999999996},"min":{"1min":0.36499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.86699999999999999,"5min":7.1379999999999999,"15min":7.1379999999999999},"last":0.53800000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:15:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56899999999999995,"15min":0.56799999999999995},"min":{"1min":0.40999999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.73399999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55900000000000005,"15min":0.58599999999999997},"min":{"1min":0.374,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.77300000000000002,"5min":0.86899999999999999,"15min":0.88400000000000001},"last":0.56299999999999994}]}]},{"osd":1,"up_from":13,"seq":55834574983,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311836,"kb_used_data":2260,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060004,"statfs":{"total":96636764160,"available":96317444096,"internally_reserved":0,"allocated":2314240,"data_stored":1379753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:57 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.45500000000000002,"15min":0.377},"min":{"1min":0.217,"5min":0.189,"15min":0.186},"max":{"1min":0.44,"5min":13.393000000000001,"15min":13.393000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.45400000000000001,"15min":0.38400000000000001},"min":{"1min":0.22700000000000001,"5min":0.22500000000000001,"15min":0.19700000000000001},"max":{"1min":0.49299999999999999,"5min":11.462,"15min":11.462},"last":0.52900000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:15:57 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.40400000000000003,"15min":0.35999999999999999},"min":{"1min":0.248,"5min":0.216,"15min":0.216},"max":{"1min":0.49299999999999999,"5min":8.0470000000000006,"15min":8.0470000000000006},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.42799999999999999,"15min":0.40500000000000003},"min":{"1min":0.215,"5min":0.215,"15min":0.20999999999999999},"max":{"1min":0.59899999999999998,"5min":4.8630000000000004,"15min":4.8630000000000004},"last":0.50900000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:15:57 2023","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.44700000000000001,"15min":0.42299999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.252},"max":{"1min":0.54000000000000004,"5min":4.8029999999999999,"15min":4.8029999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.42999999999999999,"15min":0.39300000000000002},"min":{"1min":0.27700000000000002,"5min":0.217,"15min":0.217},"max":{"1min":0.53900000000000003,"5min":5.8700000000000001,"15min":5.8700000000000001},"last":0.48599999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:15:57 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.50600000000000001,"15min":0.51700000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28199999999999997},"max":{"1min":0.81899999999999995,"5min":1.264,"15min":1.264},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.60399999999999998,"15min":0.56799999999999995},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.84099999999999997,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.73699999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:15:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.58499999999999996,"15min":0.56599999999999995},"min":{"1min":0.378,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80500000000000005,"5min":3.4390000000000001,"15min":3.4390000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.65400000000000003,"15min":0.58699999999999997},"min":{"1min":0.39000000000000001,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.91500000000000004,"5min":9.3829999999999991,"15min":9.3829999999999991},"last":0.753}]},{"osd":6,"last update":"Fri Oct 6 11:15:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.61299999999999999,"15min":0.58499999999999996},"min":{"1min":0.43099999999999999,"5min":0.34999999999999998,"15min":0.315},"max":{"1min":0.86699999999999999,"5min":3.4750000000000001,"15min":3.4750000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60899999999999999,"15min":0.59399999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.85799999999999998,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.80100000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:15:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.63300000000000001,"15min":0.60899999999999999},"min":{"1min":0.39800000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76100000000000001,"5min":4.7290000000000001,"15min":4.7290000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60499999999999998,"15min":0.59299999999999997},"min":{"1min":0.44,"5min":0.378,"15min":0.374},"max":{"1min":0.89200000000000002,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.81100000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574982,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303080,"kb_used_data":1696,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068760,"statfs":{"total":96636764160,"available":96326410240,"internally_reserved":0,"allocated":1736704,"data_stored":790176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:15:58 2023","interfaces":[{"interface":"back","average":{"1min":0.30499999999999999,"5min":0.41499999999999998,"15min":0.46600000000000003},"min":{"1min":0.20999999999999999,"5min":0.184,"15min":0.184},"max":{"1min":0.60199999999999998,"5min":8.4239999999999995,"15min":36.097999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.42999999999999999,"15min":0.378},"min":{"1min":0.23100000000000001,"5min":0.20799999999999999,"15min":0.182},"max":{"1min":0.92400000000000004,"5min":7.2990000000000004,"15min":7.2990000000000004},"last":0.33600000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:15:58 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.44400000000000001,"15min":0.503},"min":{"1min":0.22800000000000001,"5min":0.221,"15min":0.217},"max":{"1min":0.53500000000000003,"5min":8.6080000000000005,"15min":36.07},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.44800000000000001,"15min":0.40600000000000003},"min":{"1min":0.27200000000000002,"5min":0.23400000000000001,"15min":0.219},"max":{"1min":0.94899999999999995,"5min":6.7800000000000002,"15min":6.7800000000000002},"last":0.38700000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:15:58 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.36299999999999999,"15min":0.39300000000000002},"min":{"1min":0.26300000000000001,"5min":0.22500000000000001,"15min":0.223},"max":{"1min":0.52000000000000002,"5min":1.863,"15min":8.4130000000000003},"last":0.374},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.499,"15min":0.55900000000000005},"min":{"1min":0.28199999999999997,"5min":0.249,"15min":0.249},"max":{"1min":1.9079999999999999,"5min":8.4570000000000007,"15min":35.959000000000003},"last":0.432}]},{"osd":4,"last update":"Fri Oct 6 11:15:58 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55700000000000005,"15min":0.56299999999999994},"min":{"1min":0.38800000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.72399999999999998,"5min":2.427,"15min":2.427},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.64600000000000002,"15min":0.72999999999999998},"min":{"1min":0.42399999999999999,"5min":0.34399999999999997,"15min":0.29299999999999998},"max":{"1min":0.748,"5min":8.2919999999999998,"15min":36.005000000000003},"last":0.54300000000000004}]},{"osd":5,"last update":"Fri Oct 6 11:15:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.61599999999999999,"15min":0.57899999999999996},"min":{"1min":0.40000000000000002,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.999,"5min":6.6699999999999999,"15min":6.6699999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55300000000000005,"15min":0.55500000000000005},"min":{"1min":0.47799999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.76900000000000002,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":0.56799999999999995}]},{"osd":6,"last update":"Fri Oct 6 11:15:58 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.65600000000000003,"15min":0.73099999999999998},"min":{"1min":0.39200000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.78800000000000003,"5min":8.2479999999999993,"15min":36.037999999999997},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.66200000000000003,"15min":0.63700000000000001},"min":{"1min":0.42899999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.028,"5min":6.7110000000000003,"15min":6.7110000000000003},"last":0.504}]},{"osd":7,"last update":"Fri Oct 6 11:15:58 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.65200000000000002,"15min":0.621},"min":{"1min":0.44900000000000001,"5min":0.371,"15min":0.371},"max":{"1min":1.054,"5min":6.742,"15min":6.742},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56799999999999995,"15min":0.56899999999999995},"min":{"1min":0.41399999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.69899999999999995,"5min":1.917,"15min":1.917},"last":0.49299999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574983,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298968,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072872,"statfs":{"total":96636764160,"available":96330620928,"internally_reserved":0,"allocated":1720320,"data_stored":788074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.32000000000000001,"5min":0.30299999999999999,"15min":0.31},"min":{"1min":0.22900000000000001,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.41599999999999998,"5min":0.46300000000000002,"15min":0.57499999999999996},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.376,"15min":0.38200000000000001},"min":{"1min":0.28599999999999998,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.52800000000000002,"5min":0.55600000000000005,"15min":0.66300000000000003},"last":0.40899999999999997}]},{"osd":1,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.36399999999999999,"15min":0.372},"min":{"1min":0.28100000000000003,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.48099999999999998,"5min":0.57499999999999996,"15min":0.745},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.34200000000000003,"15min":0.34999999999999998},"min":{"1min":0.247,"5min":0.216,"15min":0.216},"max":{"1min":0.437,"5min":0.52900000000000003,"15min":0.59399999999999997},"last":0.35099999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.34599999999999997,"15min":0.36399999999999999},"min":{"1min":0.255,"5min":0.23300000000000001,"15min":0.23200000000000001},"max":{"1min":0.45300000000000001,"5min":0.57699999999999996,"15min":0.629},"last":0.438},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.35799999999999998,"15min":0.36399999999999999},"min":{"1min":0.26600000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.64400000000000002},"last":0.315}]},{"osd":4,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.503,"15min":0.52700000000000002},"min":{"1min":0.35799999999999998,"5min":0.30599999999999999,"15min":0.30299999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.51100000000000001,"15min":0.54400000000000004},"min":{"1min":0.36499999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.84899999999999998},"last":0.52500000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.52400000000000002,"15min":0.54300000000000004},"min":{"1min":0.44700000000000001,"5min":0.33100000000000002,"15min":0.32400000000000001},"max":{"1min":0.77100000000000002,"5min":0.80400000000000005,"15min":0.86199999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.54100000000000004,"15min":0.55300000000000005},"min":{"1min":0.40600000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.84499999999999997,"5min":0.872,"15min":0.878},"last":0.53500000000000003}]},{"osd":6,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.56100000000000005,"15min":0.57899999999999996},"min":{"1min":0.46700000000000003,"5min":0.36799999999999999,"15min":0.32600000000000001},"max":{"1min":0.76200000000000001,"5min":0.84599999999999997,"15min":0.86299999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.55500000000000005,"15min":0.57299999999999995},"min":{"1min":0.44800000000000001,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.80700000000000005,"5min":0.83499999999999996,"15min":0.88600000000000001},"last":0.59699999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.54500000000000004,"15min":0.55800000000000005},"min":{"1min":0.41399999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79300000000000004,"5min":1.139,"15min":1.139},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.55000000000000004,"15min":0.56699999999999995},"min":{"1min":0.42499999999999999,"5min":0.38800000000000001,"15min":0.38200000000000001},"max":{"1min":0.80600000000000005,"5min":0.89600000000000002,"15min":0.90500000000000003},"last":0.64600000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574983,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307160,"kb_used_data":1680,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064680,"statfs":{"total":96636764160,"available":96322232320,"internally_reserved":0,"allocated":1720320,"data_stored":788550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.32200000000000001,"15min":0.32300000000000001},"min":{"1min":0.224,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":2.2109999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.39100000000000001,"15min":0.39200000000000002},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.22700000000000001},"max":{"1min":4.4820000000000002,"5min":4.4820000000000002,"15min":4.4820000000000002},"last":0.42099999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.308,"15min":0.311},"min":{"1min":0.251,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.40500000000000003,"5min":0.54000000000000004,"15min":0.65400000000000003},"last":0.311},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.35599999999999998},"min":{"1min":0.27300000000000002,"5min":0.188,"15min":0.188},"max":{"1min":0.439,"5min":0.53100000000000003,"15min":1.196},"last":0.35499999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.38800000000000001,"15min":0.38500000000000001},"min":{"1min":0.245,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":4.601,"5min":4.601,"15min":4.601},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.41499999999999998,"15min":0.41699999999999998},"min":{"1min":0.29899999999999999,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":2.6059999999999999,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.39200000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.50600000000000001,"15min":0.54700000000000004},"min":{"1min":0.39400000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.81799999999999995,"5min":0.88500000000000001,"15min":1.694},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.51200000000000001,"15min":0.53700000000000003},"min":{"1min":0.32600000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.56499999999999995}]},{"osd":5,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.51700000000000002,"15min":0.53100000000000003},"min":{"1min":0.34100000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.78100000000000003,"5min":0.86399999999999999,"15min":0.878},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.52300000000000002,"15min":0.55200000000000005},"min":{"1min":0.35699999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.71099999999999997,"5min":0.746,"15min":1.165},"last":0.436}]},{"osd":6,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54400000000000004,"15min":0.57699999999999996},"min":{"1min":0.42499999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76900000000000002,"5min":0.79200000000000004,"15min":1.1359999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.54600000000000004,"15min":0.58599999999999997},"min":{"1min":0.36799999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79100000000000004,"5min":0.82199999999999995,"15min":1.7470000000000001},"last":0.54800000000000004}]},{"osd":7,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.54400000000000004,"15min":0.57599999999999996},"min":{"1min":0.42199999999999999,"5min":0.35699999999999998,"15min":0.35599999999999998},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":1.657},"last":0.5},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55300000000000005,"15min":0.57099999999999995},"min":{"1min":0.40400000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.48699999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574982,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303072,"kb_used_data":1688,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068768,"statfs":{"total":96636764160,"available":96326418432,"internally_reserved":0,"allocated":1728512,"data_stored":790851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:15:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.45100000000000001,"15min":0.52400000000000002},"min":{"1min":0.26200000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.70799999999999996,"5min":0.82099999999999995,"15min":2.6619999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.47499999999999998,"15min":0.48999999999999999},"min":{"1min":0.29799999999999999,"5min":0.215,"15min":0.215},"max":{"1min":0.69099999999999995,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.63500000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:15:56 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.47199999999999998,"15min":0.54500000000000004},"min":{"1min":0.28499999999999998,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.70499999999999996,"5min":1,"15min":2.8650000000000002},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47399999999999998,"15min":0.55100000000000005},"min":{"1min":0.34000000000000002,"5min":0.26200000000000001,"15min":0.25800000000000001},"max":{"1min":0.67800000000000005,"5min":1.2869999999999999,"15min":2.7610000000000001},"last":0.60199999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:15:56 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48499999999999999,"15min":0.53400000000000003},"min":{"1min":0.312,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.73399999999999999,"5min":0.76000000000000001,"15min":1.6910000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54300000000000004,"15min":0.58299999999999996},"min":{"1min":0.38700000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.68000000000000005,"5min":0.93899999999999995,"15min":1.718},"last":0.55200000000000005}]},{"osd":3,"last update":"Fri Oct 6 11:15:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.54900000000000004,"15min":0.59299999999999997},"min":{"1min":0.36699999999999999,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.71299999999999997,"5min":2.387,"15min":2.677},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.52200000000000002,"15min":0.52400000000000002},"min":{"1min":0.35599999999999998,"5min":0.29299999999999998,"15min":0.27500000000000002},"max":{"1min":0.69399999999999995,"5min":1.784,"15min":1.784},"last":0.58099999999999996}]},{"osd":5,"last update":"Fri Oct 6 11:15:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.47099999999999997,"15min":0.48399999999999999},"min":{"1min":0.33700000000000002,"5min":0.23499999999999999,"15min":0.23200000000000001},"max":{"1min":0.65700000000000003,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.378},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.48799999999999999,"15min":0.52400000000000002},"min":{"1min":0.29099999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.65900000000000003,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.40000000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:15:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.502,"15min":0.52100000000000002},"min":{"1min":0.313,"5min":0.30499999999999999,"15min":0.252},"max":{"1min":0.83499999999999996,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.441},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53100000000000003,"15min":0.56200000000000006},"min":{"1min":0.38900000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.69399999999999995,"5min":0.85799999999999998,"15min":1.165},"last":0.42799999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:15:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54300000000000004,"15min":0.55700000000000005},"min":{"1min":0.36899999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.70199999999999996,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.55900000000000005,"15min":0.59199999999999997},"min":{"1min":0.40100000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.875,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.5}]}]},{"osd":5,"up_from":13,"seq":55834574984,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311252,"kb_used_data":1676,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060588,"statfs":{"total":96636764160,"available":96318042112,"internally_reserved":0,"allocated":1716224,"data_stored":789315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.44700000000000001,"15min":0.58999999999999997},"min":{"1min":0.26200000000000001,"5min":0.23100000000000001,"15min":0.20499999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":5.0490000000000004},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.44900000000000001,"15min":0.56899999999999995},"min":{"1min":0.26600000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.66500000000000004,"5min":0.78100000000000003,"15min":5.1449999999999996},"last":0.53600000000000003}]},{"osd":1,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.46100000000000002,"15min":0.48199999999999998},"min":{"1min":0.307,"5min":0.25,"15min":0.25},"max":{"1min":0.72999999999999998,"5min":0.81399999999999995,"15min":0.97199999999999998},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.47699999999999998,"15min":0.50900000000000001},"min":{"1min":0.35299999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":1.8799999999999999},"last":0.50700000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.499,"15min":0.54600000000000004},"min":{"1min":0.313,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.76600000000000001,"5min":0.79800000000000004,"15min":4.234},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.52500000000000002,"15min":0.55900000000000005},"min":{"1min":0.39800000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.747,"5min":0.81000000000000005,"15min":1.0369999999999999},"last":0.60499999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.47999999999999998,"15min":0.60899999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.27700000000000002},"max":{"1min":0.72799999999999998,"5min":0.82299999999999995,"15min":5.2169999999999996},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.505,"15min":0.53900000000000003},"min":{"1min":0.32400000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":1.008},"last":0.56799999999999995}]},{"osd":4,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.46999999999999997,"15min":0.50700000000000001},"min":{"1min":0.26400000000000001,"5min":0.25600000000000001,"15min":0.23999999999999999},"max":{"1min":0.78000000000000003,"5min":0.83399999999999996,"15min":1.917},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.46899999999999997,"15min":0.51800000000000002},"min":{"1min":0.251,"5min":0.24399999999999999,"15min":0.23899999999999999},"max":{"1min":0.68899999999999995,"5min":0.69199999999999995,"15min":0.87},"last":0.65500000000000003}]},{"osd":6,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.49099999999999999,"15min":0.54600000000000004},"min":{"1min":0.32700000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":2.0139999999999998},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.55400000000000005,"15min":0.59699999999999998},"min":{"1min":0.30299999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.80800000000000005,"5min":0.82899999999999996,"15min":1.9470000000000001},"last":0.66800000000000004}]},{"osd":7,"last update":"Fri Oct 6 11:16:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.51600000000000001,"15min":0.56799999999999995},"min":{"1min":0.311,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.71999999999999997,"5min":0.81000000000000005,"15min":0.96499999999999997},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.54800000000000004,"15min":0.59599999999999997},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.28799999999999998},"max":{"1min":0.75600000000000001,"5min":0.77300000000000002,"15min":1.4119999999999999},"last":0.68100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:16:33.022 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T11:16:33.022 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T11:16:33.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.174+0000 7fd27ce74700 1 Processor -- start 2023-10-06T11:16:33.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.174+0000 7fd27ce74700 1 -- start start 2023-10-06T11:16:33.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.175+0000 7fd27ce74700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd278159f60 0x7fd2780c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:33.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.175+0000 7fd27ce74700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2780cc760 0x7fd2780c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:33.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.175+0000 7fd27ce74700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2780c5c20 con 0x7fd2780c7200 2023-10-06T11:16:33.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.175+0000 7fd27ce74700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2780b3260 con 0x7fd278159f60 2023-10-06T11:16:33.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.175+0000 7fd27ce74700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2780c5f00 con 0x7fd2780cc760 2023-10-06T11:16:33.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.175+0000 7fd27659c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd278159f60 0x7fd2780c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:33.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.175+0000 7fd275d9b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2780cc760 0x7fd2780c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:33.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.175+0000 7fd276d9d700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fd2780c7200 0x7fd2780b35f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:32984/0 (socket says 172.21.15.146:32984) 2023-10-06T11:16:33.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.175+0000 7fd27659c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd278159f60 0x7fd2780c55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:45800/0 (socket says 172.21.15.146:45800) 2023-10-06T11:16:33.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.175+0000 7fd275d9b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2780cc760 0x7fd2780c6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:47492/0 (socket says 172.21.15.146:47492) 2023-10-06T11:16:33.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.175+0000 7fd276d9d700 1 -- 172.21.15.146:0/3551778724 learned_addr learned my addr 172.21.15.146:0/3551778724 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:16:33.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.176+0000 7fd275d9b700 1 -- 172.21.15.146:0/3551778724 >> v2:172.21.15.151:3300/0 conn(0x7fd278159f60 msgr2=0x7fd2780c55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:33.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.176+0000 7fd275d9b700 1 --2- 172.21.15.146:0/3551778724 >> v2:172.21.15.151:3300/0 conn(0x7fd278159f60 0x7fd2780c55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:33.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.176+0000 7fd275d9b700 1 -- 172.21.15.146:0/3551778724 >> v1:172.21.15.151:6789/0 conn(0x7fd2780c7200 legacy=0x7fd2780b35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:33.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.176+0000 7fd275d9b700 1 -- 172.21.15.146:0/3551778724 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2780c61e0 con 0x7fd2780cc760 2023-10-06T11:16:33.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.176+0000 7fd27659c700 1 --2- 172.21.15.146:0/3551778724 >> v2:172.21.15.151:3300/0 conn(0x7fd278159f60 0x7fd2780c55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:16:33.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.176+0000 7fd275d9b700 1 --2- 172.21.15.146:0/3551778724 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2780cc760 0x7fd2780c6cc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd2600098e0 tx=0x7fd2600091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=328b5622e95b8643 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:33.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.176+0000 7fd27559a700 1 -- 172.21.15.146:0/3551778724 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26000b640 con 0x7fd2780cc760 2023-10-06T11:16:33.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.176+0000 7fd27559a700 1 -- 172.21.15.146:0/3551778724 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26000b7a0 con 0x7fd2780cc760 2023-10-06T11:16:33.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.176+0000 7fd27559a700 1 -- 172.21.15.146:0/3551778724 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26000bb40 con 0x7fd2780cc760 2023-10-06T11:16:33.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.177+0000 7fd27ce74700 1 -- 172.21.15.146:0/3551778724 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2780cc760 msgr2=0x7fd2780c6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:33.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.177+0000 7fd27ce74700 1 --2- 172.21.15.146:0/3551778724 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2780cc760 0x7fd2780c6cc0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd2600098e0 tx=0x7fd2600091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:33.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.177+0000 7fd27ce74700 1 -- 172.21.15.146:0/3551778724 shutdown_connections 2023-10-06T11:16:33.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.177+0000 7fd27ce74700 1 --2- 172.21.15.146:0/3551778724 >> v2:172.21.15.151:3300/0 conn(0x7fd278159f60 0x7fd2780c55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:33.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.177+0000 7fd27ce74700 1 --2- 172.21.15.146:0/3551778724 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2780cc760 0x7fd2780c6cc0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:33.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.177+0000 7fd27ce74700 1 -- 172.21.15.146:0/3551778724 >> 172.21.15.146:0/3551778724 conn(0x7fd27806f380 msgr2=0x7fd2780d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:33.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.177+0000 7fd27ce74700 1 -- 172.21.15.146:0/3551778724 shutdown_connections 2023-10-06T11:16:33.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.177+0000 7fd27ce74700 1 -- 172.21.15.146:0/3551778724 wait complete. 2023-10-06T11:16:33.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.178+0000 7fd27ce74700 1 Processor -- start 2023-10-06T11:16:33.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.178+0000 7fd27ce74700 1 -- start start 2023-10-06T11:16:33.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.178+0000 7fd27ce74700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2780c7200 0x7fd27815aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:33.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.178+0000 7fd27ce74700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2780cc760 0x7fd27815bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:33.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.178+0000 7fd27ce74700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd278159f60 0x7fd278157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:33.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.178+0000 7fd27ce74700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27815b3f0 con 0x7fd278159f60 2023-10-06T11:16:33.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.178+0000 7fd27ce74700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27815ca90 con 0x7fd2780cc760 2023-10-06T11:16:33.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.178+0000 7fd27ce74700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd27815c7b0 con 0x7fd2780c7200 2023-10-06T11:16:33.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.179+0000 7fd276d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd278159f60 0x7fd278157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:33.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.179+0000 7fd276d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd278159f60 0x7fd278157b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39282/0 (socket says 172.21.15.146:39282) 2023-10-06T11:16:33.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.179+0000 7fd276d9d700 1 -- 172.21.15.146:0/1673757707 learned_addr learned my addr 172.21.15.146:0/1673757707 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:33.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.179+0000 7fd27659c700 1 --2- 172.21.15.146:0/1673757707 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2780c7200 0x7fd27815aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:33.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.179+0000 7fd275d9b700 1 --2- 172.21.15.146:0/1673757707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2780cc760 0x7fd27815bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:33.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.179+0000 7fd276d9d700 1 -- 172.21.15.146:0/1673757707 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2780c7200 msgr2=0x7fd27815aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:33.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.179+0000 7fd276d9d700 1 --2- 172.21.15.146:0/1673757707 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2780c7200 0x7fd27815aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:33.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.179+0000 7fd276d9d700 1 -- 172.21.15.146:0/1673757707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2780cc760 msgr2=0x7fd27815bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:33.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.179+0000 7fd276d9d700 1 --2- 172.21.15.146:0/1673757707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2780cc760 0x7fd27815bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:33.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.179+0000 7fd276d9d700 1 -- 172.21.15.146:0/1673757707 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2700093c0 con 0x7fd278159f60 2023-10-06T11:16:33.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.179+0000 7fd27659c700 1 --2- 172.21.15.146:0/1673757707 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2780c7200 0x7fd27815aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:16:33.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.179+0000 7fd276d9d700 1 --2- 172.21.15.146:0/1673757707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd278159f60 0x7fd278157b90 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7fd26800cc70 tx=0x7fd2680019f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:33.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.179+0000 7fd26e7fc700 1 -- 172.21.15.146:0/1673757707 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26800a830 con 0x7fd278159f60 2023-10-06T11:16:33.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.179+0000 7fd26e7fc700 1 -- 172.21.15.146:0/1673757707 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26800a9b0 con 0x7fd278159f60 2023-10-06T11:16:33.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.179+0000 7fd27ce74700 1 -- 172.21.15.146:0/1673757707 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd260009420 con 0x7fd278159f60 2023-10-06T11:16:33.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.179+0000 7fd26e7fc700 1 -- 172.21.15.146:0/1673757707 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26800ad70 con 0x7fd278159f60 2023-10-06T11:16:33.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.179+0000 7fd27ce74700 1 -- 172.21.15.146:0/1673757707 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd27815a6b0 con 0x7fd278159f60 2023-10-06T11:16:33.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.180+0000 7fd27ce74700 1 -- 172.21.15.146:0/1673757707 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2780cfcd0 con 0x7fd278159f60 2023-10-06T11:16:33.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.180+0000 7fd26e7fc700 1 -- 172.21.15.146:0/1673757707 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd268007300 con 0x7fd278159f60 2023-10-06T11:16:33.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.181+0000 7fd26e7fc700 1 --2- 172.21.15.146:0/1673757707 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd258066f30 0x7fd2580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:33.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.181+0000 7fd26e7fc700 1 -- 172.21.15.146:0/1673757707 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fd268084860 con 0x7fd278159f60 2023-10-06T11:16:33.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.181+0000 7fd27659c700 1 --2- 172.21.15.146:0/1673757707 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd258066f30 0x7fd2580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:33.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.181+0000 7fd27659c700 1 --2- 172.21.15.146:0/1673757707 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd258066f30 0x7fd2580693e0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fd270011560 tx=0x7fd270009120 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:33.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.185+0000 7fd26e7fc700 1 -- 172.21.15.146:0/1673757707 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd2680519b0 con 0x7fd278159f60 2023-10-06T11:16:33.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.450+0000 7fd27ce74700 1 -- 172.21.15.146:0/1673757707 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fd27804c380 con 0x7fd278159f60 2023-10-06T11:16:33.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.454+0000 7fd26e7fc700 1 -- 172.21.15.146:0/1673757707 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) v1 ==== 190+0+0 (secure 0 0 0) 0x7fd268054fd0 con 0x7fd278159f60 2023-10-06T11:16:33.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.456+0000 7fd27ce74700 1 -- 172.21.15.146:0/1673757707 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd258066f30 msgr2=0x7fd2580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:33.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.456+0000 7fd27ce74700 1 --2- 172.21.15.146:0/1673757707 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd258066f30 0x7fd2580693e0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fd270011560 tx=0x7fd270009120 comp rx=0 tx=0).stop 2023-10-06T11:16:33.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.456+0000 7fd27ce74700 1 -- 172.21.15.146:0/1673757707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd278159f60 msgr2=0x7fd278157b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:33.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.456+0000 7fd27ce74700 1 --2- 172.21.15.146:0/1673757707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd278159f60 0x7fd278157b90 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7fd26800cc70 tx=0x7fd2680019f0 comp rx=0 tx=0).stop 2023-10-06T11:16:33.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.456+0000 7fd27ce74700 1 -- 172.21.15.146:0/1673757707 shutdown_connections 2023-10-06T11:16:33.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.456+0000 7fd27ce74700 1 --2- 172.21.15.146:0/1673757707 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd258066f30 0x7fd2580693e0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:33.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.456+0000 7fd27ce74700 1 --2- 172.21.15.146:0/1673757707 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd278159f60 0x7fd278157b90 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:33.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.456+0000 7fd27ce74700 1 --2- 172.21.15.146:0/1673757707 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2780c7200 0x7fd27815aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:33.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.456+0000 7fd27ce74700 1 --2- 172.21.15.146:0/1673757707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2780cc760 0x7fd27815bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:33.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.456+0000 7fd27ce74700 1 -- 172.21.15.146:0/1673757707 >> 172.21.15.146:0/1673757707 conn(0x7fd27806f380 msgr2=0x7fd2781590f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:33.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.456+0000 7fd27ce74700 1 -- 172.21.15.146:0/1673757707 shutdown_connections 2023-10-06T11:16:33.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.456+0000 7fd27ce74700 1 -- 172.21.15.146:0/1673757707 wait complete. 2023-10-06T11:16:33.462 INFO:teuthology.orchestra.run.smithi146.stderr:updated caps for client.0 2023-10-06T11:16:33.470 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:16:33.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.584+0000 7f344759e700 1 Processor -- start 2023-10-06T11:16:33.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.584+0000 7f344759e700 1 -- start start 2023-10-06T11:16:33.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.585+0000 7f344759e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f34480b3960 0x7f34480b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:33.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.585+0000 7f344759e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f34480b4750 0x7f344809a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:33.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.585+0000 7f344759e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34480b4b50 con 0x7f344815cc20 2023-10-06T11:16:33.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.585+0000 7f344759e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f344809a3d0 con 0x7f34480b4750 2023-10-06T11:16:33.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.585+0000 7f344759e700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34480b22e0 con 0x7f34480b3960 2023-10-06T11:16:33.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.585+0000 7f3446d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f34480b4750 0x7f344809a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:33.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.585+0000 7f344659c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f344815cc20 0x7f34480b3250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50472/0 (socket says 172.21.15.146:50472) 2023-10-06T11:16:33.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.585+0000 7f344659c700 1 -- 172.21.15.146:0/3494140889 learned_addr learned my addr 172.21.15.146:0/3494140889 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:16:33.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.585+0000 7f3446d9d700 1 -- 172.21.15.146:0/3494140889 >> v2:172.21.15.151:3300/0 conn(0x7f34480b3960 msgr2=0x7f34480b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:33.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.585+0000 7f3446d9d700 1 --2- 172.21.15.146:0/3494140889 >> v2:172.21.15.151:3300/0 conn(0x7f34480b3960 0x7f34480b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:33.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.585+0000 7f3446d9d700 1 -- 172.21.15.146:0/3494140889 >> v1:172.21.15.146:6789/0 conn(0x7f344815cc20 legacy=0x7f34480b3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:33.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.585+0000 7f3446d9d700 1 -- 172.21.15.146:0/3494140889 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34480b25c0 con 0x7f34480b4750 2023-10-06T11:16:33.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.585+0000 7f344559a700 1 -- 172.21.15.146:0/3494140889 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2007118878 0 0) 0x7f3440001110 con 0x7f344815cc20 2023-10-06T11:16:33.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.586+0000 7f3446d9d700 1 --2- 172.21.15.146:0/3494140889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34480b4750 0x7f344809a860 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f34480885c0 tx=0x7f3438009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ab81e9850e2f9c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:33.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.586+0000 7f344559a700 1 -- 172.21.15.146:0/3494140889 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343800e070 con 0x7f34480b4750 2023-10-06T11:16:33.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.586+0000 7f344559a700 1 -- 172.21.15.146:0/3494140889 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f343800bc30 con 0x7f34480b4750 2023-10-06T11:16:33.589 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.586+0000 7f344559a700 1 -- 172.21.15.146:0/3494140889 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3438012430 con 0x7f34480b4750 2023-10-06T11:16:33.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.586+0000 7f344759e700 1 -- 172.21.15.146:0/3494140889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34480b4750 msgr2=0x7f344809a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:33.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.586+0000 7f344759e700 1 --2- 172.21.15.146:0/3494140889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34480b4750 0x7f344809a860 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f34480885c0 tx=0x7f3438009780 comp rx=0 tx=0).stop 2023-10-06T11:16:33.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.586+0000 7f344759e700 1 -- 172.21.15.146:0/3494140889 shutdown_connections 2023-10-06T11:16:33.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.586+0000 7f344759e700 1 --2- 172.21.15.146:0/3494140889 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34480b4750 0x7f344809a860 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:33.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.586+0000 7f344759e700 1 --2- 172.21.15.146:0/3494140889 >> v2:172.21.15.151:3300/0 conn(0x7f34480b3960 0x7f34480b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:33.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.586+0000 7f344759e700 1 -- 172.21.15.146:0/3494140889 >> 172.21.15.146:0/3494140889 conn(0x7f344806f380 msgr2=0x7f34480d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:33.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.586+0000 7f344759e700 1 -- 172.21.15.146:0/3494140889 shutdown_connections 2023-10-06T11:16:33.590 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.586+0000 7f344759e700 1 -- 172.21.15.146:0/3494140889 wait complete. 2023-10-06T11:16:33.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.587+0000 7f344759e700 1 Processor -- start 2023-10-06T11:16:33.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.587+0000 7f344759e700 1 -- start start 2023-10-06T11:16:33.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.588+0000 7f344759e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34480b3960 0x7f34480ae110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:33.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.588+0000 7f344759e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34480b4750 0x7f3448069010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:33.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.588+0000 7f344759e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f344815cc20 0x7f3448069550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:33.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.588+0000 7f344759e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34480b06b0 con 0x7f344815cc20 2023-10-06T11:16:33.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.588+0000 7f344759e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34480b0990 con 0x7f34480b3960 2023-10-06T11:16:33.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.588+0000 7f344759e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34480aea40 con 0x7f34480b4750 2023-10-06T11:16:33.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.588+0000 7f3446d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f344815cc20 0x7f3448069550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:33.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.588+0000 7f3446d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f344815cc20 0x7f3448069550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39300/0 (socket says 172.21.15.146:39300) 2023-10-06T11:16:33.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.588+0000 7f3446d9d700 1 -- 172.21.15.146:0/4114635124 learned_addr learned my addr 172.21.15.146:0/4114635124 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:33.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.588+0000 7f344659c700 1 --2- 172.21.15.146:0/4114635124 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34480b3960 0x7f34480ae110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:33.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.588+0000 7f3446d9d700 1 -- 172.21.15.146:0/4114635124 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34480b4750 msgr2=0x7f3448069010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:33.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.588+0000 7f3446d9d700 1 --2- 172.21.15.146:0/4114635124 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34480b4750 0x7f3448069010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:33.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.588+0000 7f3446d9d700 1 -- 172.21.15.146:0/4114635124 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34480b3960 msgr2=0x7f34480ae110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:33.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.589+0000 7f3446d9d700 1 --2- 172.21.15.146:0/4114635124 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34480b3960 0x7f34480ae110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:33.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.589+0000 7f3446d9d700 1 -- 172.21.15.146:0/4114635124 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3438009a20 con 0x7f344815cc20 2023-10-06T11:16:33.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.589+0000 7f3446d9d700 1 --2- 172.21.15.146:0/4114635124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f344815cc20 0x7f3448069550 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f3448071940 tx=0x7f3438019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:33.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.589+0000 7f343e7fc700 1 -- 172.21.15.146:0/4114635124 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343801e630 con 0x7f344815cc20 2023-10-06T11:16:33.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.589+0000 7f343e7fc700 1 -- 172.21.15.146:0/4114635124 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f343801e7b0 con 0x7f344815cc20 2023-10-06T11:16:33.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.589+0000 7f343e7fc700 1 -- 172.21.15.146:0/4114635124 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343801eb70 con 0x7f344815cc20 2023-10-06T11:16:33.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.589+0000 7f344759e700 1 -- 172.21.15.146:0/4114635124 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34480aed20 con 0x7f344815cc20 2023-10-06T11:16:33.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.589+0000 7f344759e700 1 -- 172.21.15.146:0/4114635124 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34480ae650 con 0x7f344815cc20 2023-10-06T11:16:33.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.590+0000 7f344759e700 1 -- 172.21.15.146:0/4114635124 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f344806a1d0 con 0x7f344815cc20 2023-10-06T11:16:33.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.590+0000 7f343e7fc700 1 -- 172.21.15.146:0/4114635124 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3438024070 con 0x7f344815cc20 2023-10-06T11:16:33.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.590+0000 7f343e7fc700 1 --2- 172.21.15.146:0/4114635124 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3428066f30 0x7f34280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:33.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.590+0000 7f343e7fc700 1 -- 172.21.15.146:0/4114635124 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f3438087050 con 0x7f344815cc20 2023-10-06T11:16:33.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.591+0000 7f344659c700 1 --2- 172.21.15.146:0/4114635124 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3428066f30 0x7f34280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:33.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.591+0000 7f344659c700 1 --2- 172.21.15.146:0/4114635124 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3428066f30 0x7f34280693e0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f344809c3e0 tx=0x7f3440009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:33.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.595+0000 7f343e7fc700 1 -- 172.21.15.146:0/4114635124 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3438054120 con 0x7f344815cc20 2023-10-06T11:16:33.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.820+0000 7f344759e700 1 -- 172.21.15.146:0/4114635124 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f34480b0ad0 con 0x7f344815cc20 2023-10-06T11:16:33.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.820+0000 7f343e7fc700 1 -- 172.21.15.146:0/4114635124 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 121 v121) v1 ==== 95+0+4610 (secure 0 0 0) 0x7f3438057740 con 0x7f344815cc20 2023-10-06T11:16:33.822 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:16:33.822 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":121,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7181,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/255475004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":255475004},{"type":"v1","addr":"172.21.15.151:6834","nonce":255475004}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":116},{"gid":7184,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/206881843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":206881843},{"type":"v1","addr":"172.21.15.151:6835","nonce":206881843}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":116},{"gid":9192,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/3140231910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3140231910},{"type":"v1","addr":"172.21.15.146:6835","nonce":3140231910}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":116}],"filesystems":[{"mdsmap":{"epoch":121,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:16:23.472674+0000","modified":"2023-10-06T11:16:27.116489+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9198},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9198":{"gid":9198,"name":"a","rank":0,"incarnation":117,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/525107449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":525107449},{"type":"v1","addr":"172.21.15.146:6837","nonce":525107449}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-06T11:16:33.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.822+0000 7f344759e700 1 -- 172.21.15.146:0/4114635124 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3428066f30 msgr2=0x7f34280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:33.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.822+0000 7f344759e700 1 --2- 172.21.15.146:0/4114635124 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3428066f30 0x7f34280693e0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f344809c3e0 tx=0x7f3440009040 comp rx=0 tx=0).stop 2023-10-06T11:16:33.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.822+0000 7f344759e700 1 -- 172.21.15.146:0/4114635124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f344815cc20 msgr2=0x7f3448069550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:33.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.822+0000 7f344759e700 1 --2- 172.21.15.146:0/4114635124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f344815cc20 0x7f3448069550 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f3448071940 tx=0x7f3438019000 comp rx=0 tx=0).stop 2023-10-06T11:16:33.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.822+0000 7f344759e700 1 -- 172.21.15.146:0/4114635124 shutdown_connections 2023-10-06T11:16:33.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.822+0000 7f344759e700 1 --2- 172.21.15.146:0/4114635124 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3428066f30 0x7f34280693e0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:33.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.822+0000 7f344759e700 1 --2- 172.21.15.146:0/4114635124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f344815cc20 0x7f3448069550 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:33.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.822+0000 7f344759e700 1 --2- 172.21.15.146:0/4114635124 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34480b3960 0x7f34480ae110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:33.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.822+0000 7f344759e700 1 --2- 172.21.15.146:0/4114635124 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34480b4750 0x7f3448069010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:33.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.822+0000 7f344759e700 1 -- 172.21.15.146:0/4114635124 >> 172.21.15.146:0/4114635124 conn(0x7f344806f380 msgr2=0x7f34480af3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:33.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.823+0000 7f344759e700 1 -- 172.21.15.146:0/4114635124 shutdown_connections 2023-10-06T11:16:33.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:33.823+0000 7f344759e700 1 -- 172.21.15.146:0/4114635124 wait complete. 2023-10-06T11:16:33.826 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 121 2023-10-06T11:16:34.239 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 121, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T11:16:23.472674+0000', 'modified': '2023-10-06T11:16:27.116489+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9198}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9198': {'gid': 9198, 'name': 'a', 'rank': 0, 'incarnation': 117, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.146:6837/525107449', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6836', 'nonce': 525107449}, {'type': 'v1', 'addr': '172.21.15.146:6837', 'nonce': 525107449}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T11:16:34.240 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T11:16:34.240 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T11:16:34.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.356+0000 7f421e9db700 1 Processor -- start 2023-10-06T11:16:34.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.356+0000 7f421e9db700 1 -- start start 2023-10-06T11:16:34.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.357+0000 7f421e9db700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f42180cc960 0x7f4218164c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:34.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.357+0000 7f421e9db700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42180ccd80 con 0x7f421815a160 2023-10-06T11:16:34.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.357+0000 7f421e9db700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42180ae2a0 con 0x7f42180ae730 2023-10-06T11:16:34.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.357+0000 7f421e9db700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f421815a530 con 0x7f42180cc960 2023-10-06T11:16:34.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.357+0000 7f4217fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f421815a160 0x7f42180c55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50486/0 (socket says 172.21.15.146:50486) 2023-10-06T11:16:34.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.357+0000 7f4217fff700 1 -- 172.21.15.146:0/1308390003 learned_addr learned my addr 172.21.15.146:0/1308390003 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:16:34.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.357+0000 7f4216ffd700 1 -- 172.21.15.146:0/1308390003 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3424370133 0 0) 0x7f420c001290 con 0x7f421815a160 2023-10-06T11:16:34.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.357+0000 7f4216ffd700 1 -- 172.21.15.146:0/1308390003 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4200003570 con 0x7f421815a160 2023-10-06T11:16:34.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.357+0000 7f421cf78700 1 --2- 172.21.15.146:0/1308390003 >> v2:172.21.15.151:3300/0 conn(0x7f42180cc960 0x7f4218164c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:34.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.357+0000 7f4216ffd700 1 -- 172.21.15.146:0/1308390003 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1465037964 0 0) 0x7f4200003570 con 0x7f421815a160 2023-10-06T11:16:34.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.357+0000 7f4216ffd700 1 -- 172.21.15.146:0/1308390003 >> v2:172.21.15.151:3300/0 conn(0x7f42180cc960 msgr2=0x7f4218164c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:34.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.357+0000 7f4216ffd700 1 --2- 172.21.15.146:0/1308390003 >> v2:172.21.15.151:3300/0 conn(0x7f42180cc960 0x7f4218164c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.357+0000 7f4216ffd700 1 -- 172.21.15.146:0/1308390003 >> v1:172.21.15.151:6789/0 conn(0x7f42180ae730 legacy=0x7f42180aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:34.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.357+0000 7f4216ffd700 1 -- 172.21.15.146:0/1308390003 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42180c5cb0 con 0x7f421815a160 2023-10-06T11:16:34.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.357+0000 7f4216ffd700 1 -- 172.21.15.146:0/1308390003 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f420c001780 con 0x7f421815a160 2023-10-06T11:16:34.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.357+0000 7f4216ffd700 1 -- 172.21.15.146:0/1308390003 >> v1:172.21.15.146:6789/0 conn(0x7f421815a160 legacy=0x7f42180c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:34.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.357+0000 7f4216ffd700 1 --2- 172.21.15.146:0/1308390003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4200003a60 0x7f4200003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:34.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.357+0000 7f4216ffd700 1 --2- 172.21.15.146:0/1308390003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4200004810 0x7f4200004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:34.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.357+0000 7f4216ffd700 1 --2- 172.21.15.146:0/1308390003 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42000051c0 0x7f420000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:34.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.357+0000 7f4216ffd700 1 -- 172.21.15.146:0/1308390003 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f421815a530 con 0x7f4200004810 2023-10-06T11:16:34.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.357+0000 7f4216ffd700 1 -- 172.21.15.146:0/1308390003 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420000c0d0 con 0x7f4200003a60 2023-10-06T11:16:34.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.357+0000 7f4216ffd700 1 -- 172.21.15.146:0/1308390003 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f420000c290 con 0x7f42000051c0 2023-10-06T11:16:34.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.357+0000 7f42177fe700 1 --2- 172.21.15.146:0/1308390003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4200004810 0x7f4200004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:34.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.357+0000 7f4217fff700 1 --2- 172.21.15.146:0/1308390003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4200003a60 0x7f4200003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:34.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.358+0000 7f421cf78700 1 --2- 172.21.15.146:0/1308390003 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42000051c0 0x7f420000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:34.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.358+0000 7f42177fe700 1 -- 172.21.15.146:0/1308390003 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42000051c0 msgr2=0x7f420000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:34.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.358+0000 7f42177fe700 1 --2- 172.21.15.146:0/1308390003 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42000051c0 0x7f420000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.358+0000 7f42177fe700 1 -- 172.21.15.146:0/1308390003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4200003a60 msgr2=0x7f4200003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:34.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.358+0000 7f42177fe700 1 --2- 172.21.15.146:0/1308390003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4200003a60 0x7f4200003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.358+0000 7f42177fe700 1 -- 172.21.15.146:0/1308390003 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4200003570 con 0x7f4200004810 2023-10-06T11:16:34.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.358+0000 7f421cf78700 1 --2- 172.21.15.146:0/1308390003 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f42000051c0 0x7f420000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:34.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.358+0000 7f421cf78700 1 -- 172.21.15.146:0/1308390003 reap_dead start 2023-10-06T11:16:34.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.358+0000 7f42177fe700 1 --2- 172.21.15.146:0/1308390003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4200004810 0x7f4200004c80 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f42080018b0 tx=0x7f4208007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee07a93c39d465a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:34.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.358+0000 7f4216ffd700 1 -- 172.21.15.146:0/1308390003 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4208012420 con 0x7f4200004810 2023-10-06T11:16:34.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.358+0000 7f4216ffd700 1 -- 172.21.15.146:0/1308390003 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42080125a0 con 0x7f4200004810 2023-10-06T11:16:34.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.358+0000 7f4216ffd700 1 -- 172.21.15.146:0/1308390003 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4208012960 con 0x7f4200004810 2023-10-06T11:16:34.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.358+0000 7f421e9db700 1 -- 172.21.15.146:0/1308390003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4200004810 msgr2=0x7f4200004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:34.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.358+0000 7f421e9db700 1 --2- 172.21.15.146:0/1308390003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4200004810 0x7f4200004c80 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f42080018b0 tx=0x7f4208007d30 comp rx=0 tx=0).stop 2023-10-06T11:16:34.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.359+0000 7f421e9db700 1 -- 172.21.15.146:0/1308390003 shutdown_connections 2023-10-06T11:16:34.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.359+0000 7f421e9db700 1 --2- 172.21.15.146:0/1308390003 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4200004810 0x7f4200004c80 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.359+0000 7f421e9db700 1 -- 172.21.15.146:0/1308390003 >> 172.21.15.146:0/1308390003 conn(0x7f421806f380 msgr2=0x7f42180d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:34.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.359+0000 7f421e9db700 1 -- 172.21.15.146:0/1308390003 shutdown_connections 2023-10-06T11:16:34.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.359+0000 7f421e9db700 1 -- 172.21.15.146:0/1308390003 wait complete. 2023-10-06T11:16:34.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.360+0000 7f421e9db700 1 Processor -- start 2023-10-06T11:16:34.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.360+0000 7f421e9db700 1 -- start start 2023-10-06T11:16:34.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.360+0000 7f421e9db700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4200004810 0x7f42180c92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:34.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.360+0000 7f421e9db700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42180b1550 0x7f42180b19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:34.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.361+0000 7f421e9db700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4218151c60 0x7f4218152100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:34.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.361+0000 7f421e9db700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42180b1f00 con 0x7f42180b1550 2023-10-06T11:16:34.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.361+0000 7f421e9db700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42180ca550 con 0x7f4200004810 2023-10-06T11:16:34.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.361+0000 7f421e9db700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42180c9940 con 0x7f4218151c60 2023-10-06T11:16:34.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.361+0000 7f42177fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42180b1550 0x7f42180b19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:34.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.361+0000 7f42177fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42180b1550 0x7f42180b19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39316/0 (socket says 172.21.15.146:39316) 2023-10-06T11:16:34.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.361+0000 7f42177fe700 1 -- 172.21.15.146:0/467125517 learned_addr learned my addr 172.21.15.146:0/467125517 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:34.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.361+0000 7f4217fff700 1 --2- 172.21.15.146:0/467125517 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4200004810 0x7f42180c92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:34.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.361+0000 7f421cf78700 1 --2- 172.21.15.146:0/467125517 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4218151c60 0x7f4218152100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:34.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.361+0000 7f42177fe700 1 -- 172.21.15.146:0/467125517 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4218151c60 msgr2=0x7f4218152100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:34.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.361+0000 7f42177fe700 1 --2- 172.21.15.146:0/467125517 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4218151c60 0x7f4218152100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.361+0000 7f42177fe700 1 -- 172.21.15.146:0/467125517 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4200004810 msgr2=0x7f42180c92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:34.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.361+0000 7f42177fe700 1 --2- 172.21.15.146:0/467125517 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4200004810 0x7f42180c92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.361+0000 7f42177fe700 1 -- 172.21.15.146:0/467125517 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42180c9c20 con 0x7f42180b1550 2023-10-06T11:16:34.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.361+0000 7f421cf78700 1 --2- 172.21.15.146:0/467125517 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4218151c60 0x7f4218152100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:34.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.361+0000 7f42177fe700 1 --2- 172.21.15.146:0/467125517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42180b1550 0x7f42180b19c0 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f420000c0a0 tx=0x7f4208015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:34.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.361+0000 7f41fffff700 1 -- 172.21.15.146:0/467125517 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420800c800 con 0x7f42180b1550 2023-10-06T11:16:34.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.361+0000 7f41fffff700 1 -- 172.21.15.146:0/467125517 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f420800c960 con 0x7f42180b1550 2023-10-06T11:16:34.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.361+0000 7f41fffff700 1 -- 172.21.15.146:0/467125517 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420800cd00 con 0x7f42180b1550 2023-10-06T11:16:34.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.361+0000 7f421e9db700 1 -- 172.21.15.146:0/467125517 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42180c9f00 con 0x7f42180b1550 2023-10-06T11:16:34.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.361+0000 7f421e9db700 1 -- 172.21.15.146:0/467125517 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4218152640 con 0x7f42180b1550 2023-10-06T11:16:34.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.363+0000 7f41fffff700 1 -- 172.21.15.146:0/467125517 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f420801f620 con 0x7f42180b1550 2023-10-06T11:16:34.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.363+0000 7f41fffff700 1 --2- 172.21.15.146:0/467125517 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4204066f30 0x7f42040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:34.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.363+0000 7f41fffff700 1 -- 172.21.15.146:0/467125517 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f4208085dc0 con 0x7f42180b1550 2023-10-06T11:16:34.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.363+0000 7f4217fff700 1 --2- 172.21.15.146:0/467125517 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4204066f30 0x7f42040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:34.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.363+0000 7f4217fff700 1 --2- 172.21.15.146:0/467125517 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4204066f30 0x7f42040693e0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f420c001510 tx=0x7f420c007a70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:34.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.365+0000 7f4227cd3b80 1 Processor -- start 2023-10-06T11:16:34.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.365+0000 7f4227cd3b80 1 -- start start 2023-10-06T11:16:34.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.366+0000 7f4227cd3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0b5c4ea90 0x55e0b5c4ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:34.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.366+0000 7f4227cd3b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0b5c0a9a0 0x55e0b5c07580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:34.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.366+0000 7f4227cd3b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e0b5c08bd0 0x55e0b5c07ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:34.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.366+0000 7f4227cd3b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b5b87c80 con 0x55e0b5c0a9a0 2023-10-06T11:16:34.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.366+0000 7f4227cd3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b5b5ea70 con 0x55e0b5c4ea90 2023-10-06T11:16:34.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.366+0000 7f4227cd3b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e0b5b5c270 con 0x55e0b5c08bd0 2023-10-06T11:16:34.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.366+0000 7f42177fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0b5c0a9a0 0x55e0b5c07580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:34.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.366+0000 7f42177fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0b5c0a9a0 0x55e0b5c07580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39322/0 (socket says 172.21.15.146:39322) 2023-10-06T11:16:34.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.366+0000 7f42177fe700 1 -- 172.21.15.146:0/3785537354 learned_addr learned my addr 172.21.15.146:0/3785537354 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:34.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.366+0000 7f421cf78700 1 --2- 172.21.15.146:0/3785537354 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e0b5c08bd0 0x55e0b5c07ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:34.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.366+0000 7f4217fff700 1 --2- 172.21.15.146:0/3785537354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0b5c4ea90 0x55e0b5c4ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:34.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.366+0000 7f42177fe700 1 -- 172.21.15.146:0/3785537354 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e0b5c08bd0 msgr2=0x55e0b5c07ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:34.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.366+0000 7f42177fe700 1 --2- 172.21.15.146:0/3785537354 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e0b5c08bd0 0x55e0b5c07ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.366+0000 7f42177fe700 1 -- 172.21.15.146:0/3785537354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0b5c4ea90 msgr2=0x55e0b5c4ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:34.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.366+0000 7f42177fe700 1 --2- 172.21.15.146:0/3785537354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0b5c4ea90 0x55e0b5c4ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.366+0000 7f42177fe700 1 -- 172.21.15.146:0/3785537354 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0b59f2270 con 0x55e0b5c0a9a0 2023-10-06T11:16:34.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.366+0000 7f4217fff700 1 --2- 172.21.15.146:0/3785537354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0b5c4ea90 0x55e0b5c4ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:34.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.366+0000 7f42177fe700 1 --2- 172.21.15.146:0/3785537354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0b5c0a9a0 0x55e0b5c07580 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f4208084140 tx=0x7f42080840a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7ae17056e1de5d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:34.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.366+0000 7f41fd7fa700 1 -- 172.21.15.146:0/3785537354 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420800ce60 con 0x55e0b5c0a9a0 2023-10-06T11:16:34.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.366+0000 7f41fd7fa700 1 -- 172.21.15.146:0/3785537354 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4208057310 con 0x55e0b5c0a9a0 2023-10-06T11:16:34.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.366+0000 7f41fd7fa700 1 -- 172.21.15.146:0/3785537354 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4208056c10 con 0x55e0b5c0a9a0 2023-10-06T11:16:34.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.367+0000 7f4227cd3b80 1 -- 172.21.15.146:0/3785537354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0b5c0a9a0 msgr2=0x55e0b5c07580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:34.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.367+0000 7f4227cd3b80 1 --2- 172.21.15.146:0/3785537354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0b5c0a9a0 0x55e0b5c07580 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f4208084140 tx=0x7f42080840a0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.367+0000 7f4227cd3b80 1 -- 172.21.15.146:0/3785537354 shutdown_connections 2023-10-06T11:16:34.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.367+0000 7f4227cd3b80 1 --2- 172.21.15.146:0/3785537354 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e0b5c08bd0 0x55e0b5c07ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.367+0000 7f4227cd3b80 1 --2- 172.21.15.146:0/3785537354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0b5c4ea90 0x55e0b5c4ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.367+0000 7f4227cd3b80 1 --2- 172.21.15.146:0/3785537354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0b5c0a9a0 0x55e0b5c07580 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.367+0000 7f4227cd3b80 1 -- 172.21.15.146:0/3785537354 >> 172.21.15.146:0/3785537354 conn(0x55e0b5c09070 msgr2=0x55e0b5c09440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:34.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.367+0000 7f4227cd3b80 1 -- 172.21.15.146:0/3785537354 shutdown_connections 2023-10-06T11:16:34.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.367+0000 7f4227cd3b80 1 -- 172.21.15.146:0/3785537354 wait complete. 2023-10-06T11:16:34.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.368+0000 7f4227cd3b80 1 -- start start 2023-10-06T11:16:34.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.368+0000 7f4227cd3b80 1 Processor -- start 2023-10-06T11:16:34.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.369+0000 7f4227cd3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0b5c08bd0 0x55e0b5c04550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:34.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.369+0000 7f4227cd3b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0b5c0a9a0 0x55e0b5c45a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:34.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.369+0000 7f4227cd3b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e0b5c4ea90 0x55e0b5c30790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:34.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.369+0000 7f4227cd3b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b5b58060 con 0x55e0b5c0a9a0 2023-10-06T11:16:34.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.369+0000 7f4227cd3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b5b03890 con 0x55e0b5c08bd0 2023-10-06T11:16:34.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.369+0000 7f4227cd3b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e0b5b1eea0 con 0x55e0b5c4ea90 2023-10-06T11:16:34.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.369+0000 7f4227cd3b80 10 client.0 _ll_register_callbacks cb 0x55e0b59f4f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:16:34.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.369+0000 7f42177fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0b5c0a9a0 0x55e0b5c45a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:34.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.369+0000 7f42177fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0b5c0a9a0 0x55e0b5c45a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39324/0 (socket says 172.21.15.146:39324) 2023-10-06T11:16:34.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.369+0000 7f42177fe700 1 -- 172.21.15.146:0/2900634655 learned_addr learned my addr 172.21.15.146:0/2900634655 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:34.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.369+0000 7f4217fff700 1 --2- 172.21.15.146:0/2900634655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0b5c08bd0 0x55e0b5c04550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:34.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.369+0000 7f421cf78700 1 --2- 172.21.15.146:0/2900634655 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e0b5c4ea90 0x55e0b5c30790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:34.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.369+0000 7f42177fe700 1 -- 172.21.15.146:0/2900634655 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e0b5c4ea90 msgr2=0x55e0b5c30790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:34.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.369+0000 7f42177fe700 1 --2- 172.21.15.146:0/2900634655 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e0b5c4ea90 0x55e0b5c30790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.369+0000 7f42177fe700 1 -- 172.21.15.146:0/2900634655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0b5c08bd0 msgr2=0x55e0b5c04550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:34.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.369+0000 7f42177fe700 1 --2- 172.21.15.146:0/2900634655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0b5c08bd0 0x55e0b5c04550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.369+0000 7f42177fe700 1 -- 172.21.15.146:0/2900634655 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4218152640 con 0x55e0b5c0a9a0 2023-10-06T11:16:34.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.369+0000 7f42177fe700 1 --2- 172.21.15.146:0/2900634655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0b5c0a9a0 0x55e0b5c45a40 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f42080574c0 tx=0x7f4208009020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f19930813a448b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:34.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.369+0000 7f41f67fc700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:16:34.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.369+0000 7f41f67fc700 1 -- 172.21.15.146:0/2900634655 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4208059e60 con 0x55e0b5c0a9a0 2023-10-06T11:16:34.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.369+0000 7f41f67fc700 1 -- 172.21.15.146:0/2900634655 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f420805dbb0 con 0x55e0b5c0a9a0 2023-10-06T11:16:34.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.369+0000 7f4227cd3b80 1 -- 172.21.15.146:0/2900634655 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e0b5bfc690 con 0x55e0b5c0a9a0 2023-10-06T11:16:34.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.369+0000 7f41f67fc700 1 -- 172.21.15.146:0/2900634655 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=121) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4208056c10 con 0x55e0b5c0a9a0 2023-10-06T11:16:34.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.369+0000 7f4227cd3b80 10 client.9372 fetch_fsmap learned FSMap version 121 2023-10-06T11:16:34.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.369+0000 7f4227cd3b80 1 -- 172.21.15.146:0/2900634655 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=121,monmap=2+}) v3 -- 0x55e0b5994fe0 con 0x55e0b5c0a9a0 2023-10-06T11:16:34.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.370+0000 7f41f67fc700 1 -- 172.21.15.146:0/2900634655 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e0b5bfc690 con 0x55e0b5c0a9a0 2023-10-06T11:16:34.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.370+0000 7f41f67fc700 1 -- 172.21.15.146:0/2900634655 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 121) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4208056e70 con 0x55e0b5c0a9a0 2023-10-06T11:16:34.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.370+0000 7f4227cd3b80 10 client.9372 fetch_fsmap finished waiting for FSMap version 121 2023-10-06T11:16:34.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.370+0000 7f4227cd3b80 10 client.9372 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T11:16:34.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.370+0000 7f4227cd3b80 20 client.9372 populate_metadata read hostname 'smithi146' 2023-10-06T11:16:34.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.370+0000 7f4227cd3b80 1 --2- 172.21.15.146:0/2900634655 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x55e0b5c47a50 0x55e0b5c47e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:34.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.370+0000 7f4227cd3b80 4 client.9372 mds_command: new command op to 9198 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:16:34.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.370+0000 7f4227cd3b80 1 -- 172.21.15.146:0/2900634655 --> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e0b5bd95c0 con 0x55e0b5c47a50 2023-10-06T11:16:34.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.370+0000 7f4217fff700 1 --2- 172.21.15.146:0/2900634655 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x55e0b5c47a50 0x55e0b5c47e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:34.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.370+0000 7f41f67fc700 10 client.9372 ms_handle_connect on v2:172.21.15.146:6836/525107449 2023-10-06T11:16:34.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.370+0000 7f4217fff700 1 --2- 172.21.15.146:0/2900634655 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x55e0b5c47a50 0x55e0b5c47e20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6c64a8c6d7ace7f server_cookie=cc42ce863b01a6be in_seq=0 out_seq=0 2023-10-06T11:16:34.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.371+0000 7f41f67fc700 1 -- 172.21.15.146:0/2900634655 <== mds.0 v2:172.21.15.146:6836/525107449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55e0b5bd95c0 con 0x55e0b5c47a50 2023-10-06T11:16:34.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.371+0000 7f41f67fc700 10 client.9372 handle_command_reply: tid=0 2023-10-06T11:16:34.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.371+0000 7f4227cd3b80 1 client.9372 shutdown 2023-10-06T11:16:34.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.371+0000 7f4227cd3b80 1 -- 172.21.15.146:0/2900634655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0b5c0a9a0 msgr2=0x55e0b5c45a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:34.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.371+0000 7f4227cd3b80 1 --2- 172.21.15.146:0/2900634655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0b5c0a9a0 0x55e0b5c45a40 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f42080574c0 tx=0x7f4208009020 comp rx=0 tx=0).stop 2023-10-06T11:16:34.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.371+0000 7f4227cd3b80 1 -- 172.21.15.146:0/2900634655 shutdown_connections 2023-10-06T11:16:34.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.371+0000 7f4227cd3b80 1 --2- 172.21.15.146:0/2900634655 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x55e0b5c47a50 0x55e0b5c47e20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.371+0000 7f4227cd3b80 1 --2- 172.21.15.146:0/2900634655 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e0b5c4ea90 0x55e0b5c30790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.371+0000 7f41f67fc700 0 client.9372 ms_handle_reset on v2:172.21.15.146:6836/525107449 2023-10-06T11:16:34.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.371+0000 7f4227cd3b80 1 --2- 172.21.15.146:0/2900634655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0b5c08bd0 0x55e0b5c04550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.371+0000 7f4227cd3b80 1 --2- 172.21.15.146:0/2900634655 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0b5c0a9a0 0x55e0b5c45a40 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.371+0000 7f4227cd3b80 1 -- 172.21.15.146:0/2900634655 >> 172.21.15.146:0/2900634655 conn(0x55e0b5c09070 msgr2=0x55e0b5c4ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:34.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.371+0000 7f4227cd3b80 1 -- 172.21.15.146:0/2900634655 shutdown_connections 2023-10-06T11:16:34.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.371+0000 7f4227cd3b80 1 -- 172.21.15.146:0/2900634655 wait complete. 2023-10-06T11:16:34.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.371+0000 7f4227cd3b80 20 client.9372 trim_cache size 0 max 16384 2023-10-06T11:16:34.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.388+0000 7f4227cd3b80 1 Processor -- start 2023-10-06T11:16:34.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.388+0000 7f4227cd3b80 1 -- start start 2023-10-06T11:16:34.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.389+0000 7f4227cd3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0b5c08bd0 0x55e0b5c048a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:34.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.389+0000 7f4227cd3b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e0b5c0a9a0 0x55e0b5c47ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:34.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.389+0000 7f4227cd3b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0b5c4ea90 0x55e0b5c55e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:34.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.389+0000 7f4227cd3b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b59dae30 con 0x55e0b5c4ea90 2023-10-06T11:16:34.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.389+0000 7f4227cd3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b5c51890 con 0x55e0b5c08bd0 2023-10-06T11:16:34.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.389+0000 7f4227cd3b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e0b5c45ad0 con 0x55e0b5c0a9a0 2023-10-06T11:16:34.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.389+0000 7f421cf78700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0b5c4ea90 0x55e0b5c55e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:34.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.389+0000 7f421cf78700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0b5c4ea90 0x55e0b5c55e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39326/0 (socket says 172.21.15.146:39326) 2023-10-06T11:16:34.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.389+0000 7f421cf78700 1 -- 172.21.15.146:0/3328907615 learned_addr learned my addr 172.21.15.146:0/3328907615 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:34.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.389+0000 7f421cf78700 1 -- 172.21.15.146:0/3328907615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e0b5c0a9a0 msgr2=0x55e0b5c47ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:34.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.389+0000 7f421cf78700 1 --2- 172.21.15.146:0/3328907615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e0b5c0a9a0 0x55e0b5c47ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.389+0000 7f421cf78700 1 -- 172.21.15.146:0/3328907615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0b5c08bd0 msgr2=0x55e0b5c048a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:34.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.389+0000 7f421cf78700 1 --2- 172.21.15.146:0/3328907615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0b5c08bd0 0x55e0b5c048a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.389+0000 7f421cf78700 1 -- 172.21.15.146:0/3328907615 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0b5b26780 con 0x55e0b5c4ea90 2023-10-06T11:16:34.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.389+0000 7f421cf78700 1 --2- 172.21.15.146:0/3328907615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0b5c4ea90 0x55e0b5c55e70 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f4218088980 tx=0x7f421000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79298112c30dcd05 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:34.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.390+0000 7f41fdffb700 1 -- 172.21.15.146:0/3328907615 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421000e040 con 0x55e0b5c4ea90 2023-10-06T11:16:34.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.390+0000 7f41fdffb700 1 -- 172.21.15.146:0/3328907615 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421000f040 con 0x55e0b5c4ea90 2023-10-06T11:16:34.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.390+0000 7f41fdffb700 1 -- 172.21.15.146:0/3328907615 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4210017850 con 0x55e0b5c4ea90 2023-10-06T11:16:34.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.390+0000 7f4227cd3b80 1 -- 172.21.15.146:0/3328907615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0b5c4ea90 msgr2=0x55e0b5c55e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:34.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.390+0000 7f4227cd3b80 1 --2- 172.21.15.146:0/3328907615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0b5c4ea90 0x55e0b5c55e70 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f4218088980 tx=0x7f421000b040 comp rx=0 tx=0).stop 2023-10-06T11:16:34.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.390+0000 7f4227cd3b80 1 -- 172.21.15.146:0/3328907615 shutdown_connections 2023-10-06T11:16:34.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.390+0000 7f4227cd3b80 1 --2- 172.21.15.146:0/3328907615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0b5c4ea90 0x55e0b5c55e70 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.390+0000 7f4227cd3b80 1 --2- 172.21.15.146:0/3328907615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0b5c08bd0 0x55e0b5c048a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.390+0000 7f4227cd3b80 1 --2- 172.21.15.146:0/3328907615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e0b5c0a9a0 0x55e0b5c47ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.390+0000 7f4227cd3b80 1 -- 172.21.15.146:0/3328907615 >> 172.21.15.146:0/3328907615 conn(0x55e0b5c09070 msgr2=0x55e0b5c09440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:34.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.390+0000 7f4227cd3b80 1 -- 172.21.15.146:0/3328907615 shutdown_connections 2023-10-06T11:16:34.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.390+0000 7f4227cd3b80 1 -- 172.21.15.146:0/3328907615 wait complete. 2023-10-06T11:16:34.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.391+0000 7f4227cd3b80 1 -- start start 2023-10-06T11:16:34.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.391+0000 7f4227cd3b80 1 Processor -- start 2023-10-06T11:16:34.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.392+0000 7f4227cd3b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0b5c08bd0 0x55e0b5cad1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:34.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.392+0000 7f4227cd3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0b5c0a9a0 0x55e0b5c077e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:34.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.392+0000 7f4227cd3b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e0b5c4ea90 0x55e0b5c07d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:34.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.392+0000 7f4227cd3b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b5c085f0 con 0x55e0b5c08bd0 2023-10-06T11:16:34.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.392+0000 7f4227cd3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0b5cad6e0 con 0x55e0b5c0a9a0 2023-10-06T11:16:34.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.392+0000 7f4227cd3b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e0b5c2f780 con 0x55e0b5c4ea90 2023-10-06T11:16:34.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.392+0000 7f4227cd3b80 10 client.0 _ll_register_callbacks cb 0x55e0b59f4f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:16:34.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.392+0000 7f4217fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0b5c08bd0 0x55e0b5cad1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:34.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.392+0000 7f4217fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0b5c08bd0 0x55e0b5cad1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39336/0 (socket says 172.21.15.146:39336) 2023-10-06T11:16:34.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.392+0000 7f4217fff700 1 -- 172.21.15.146:0/3126613133 learned_addr learned my addr 172.21.15.146:0/3126613133 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:34.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.392+0000 7f421cf78700 1 --2- 172.21.15.146:0/3126613133 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e0b5c4ea90 0x55e0b5c07d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:34.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.392+0000 7f42177fe700 1 --2- 172.21.15.146:0/3126613133 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0b5c0a9a0 0x55e0b5c077e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:34.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.392+0000 7f4217fff700 1 -- 172.21.15.146:0/3126613133 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e0b5c4ea90 msgr2=0x55e0b5c07d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:34.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.392+0000 7f4217fff700 1 --2- 172.21.15.146:0/3126613133 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e0b5c4ea90 0x55e0b5c07d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.392+0000 7f4217fff700 1 -- 172.21.15.146:0/3126613133 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0b5c0a9a0 msgr2=0x55e0b5c077e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:34.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.392+0000 7f4217fff700 1 --2- 172.21.15.146:0/3126613133 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0b5c0a9a0 0x55e0b5c077e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.392+0000 7f4217fff700 1 -- 172.21.15.146:0/3126613133 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4210016550 con 0x55e0b5c08bd0 2023-10-06T11:16:34.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.392+0000 7f4217fff700 1 --2- 172.21.15.146:0/3126613133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0b5c08bd0 0x55e0b5cad1a0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f420c000da0 tx=0x7f420c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b592e064a55618e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:34.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.392+0000 7f41f67fc700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:16:34.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.392+0000 7f41f67fc700 1 -- 172.21.15.146:0/3126613133 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420c02c430 con 0x55e0b5c08bd0 2023-10-06T11:16:34.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.392+0000 7f41f67fc700 1 -- 172.21.15.146:0/3126613133 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f420c02c590 con 0x55e0b5c08bd0 2023-10-06T11:16:34.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.392+0000 7f4227cd3b80 1 -- 172.21.15.146:0/3126613133 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4208057310 con 0x55e0b5c08bd0 2023-10-06T11:16:34.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.392+0000 7f41f67fc700 1 -- 172.21.15.146:0/3126613133 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=121) v2 ==== 24+0+0 (secure 0 0 0) 0x7f420c02c960 con 0x55e0b5c08bd0 2023-10-06T11:16:34.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.392+0000 7f4227cd3b80 10 client.9378 fetch_fsmap learned FSMap version 121 2023-10-06T11:16:34.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.392+0000 7f4227cd3b80 1 -- 172.21.15.146:0/3126613133 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=121,monmap=2+}) v3 -- 0x55e0b5b0d470 con 0x55e0b5c08bd0 2023-10-06T11:16:34.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.393+0000 7f41f67fc700 1 -- 172.21.15.146:0/3126613133 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4208057310 con 0x55e0b5c08bd0 2023-10-06T11:16:34.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.393+0000 7f41f67fc700 1 -- 172.21.15.146:0/3126613133 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 121) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f420c02cac0 con 0x55e0b5c08bd0 2023-10-06T11:16:34.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.393+0000 7f4227cd3b80 10 client.9378 fetch_fsmap finished waiting for FSMap version 121 2023-10-06T11:16:34.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.393+0000 7f4227cd3b80 10 client.9378 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T11:16:34.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.393+0000 7f4227cd3b80 20 client.9378 populate_metadata read hostname 'smithi146' 2023-10-06T11:16:34.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.393+0000 7f4227cd3b80 1 --2- 172.21.15.146:0/3126613133 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x55e0b5c4d9b0 0x55e0b5c4dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:34.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.393+0000 7f4227cd3b80 4 client.9378 mds_command: new command op to 9198 tid=0[{"prefix": "status"}] 2023-10-06T11:16:34.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.393+0000 7f4227cd3b80 1 -- 172.21.15.146:0/3126613133 --> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e0b5afae00 con 0x55e0b5c4d9b0 2023-10-06T11:16:34.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.393+0000 7f42177fe700 1 --2- 172.21.15.146:0/3126613133 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x55e0b5c4d9b0 0x55e0b5c4dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:34.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.393+0000 7f41f67fc700 10 client.9378 ms_handle_connect on v2:172.21.15.146:6836/525107449 2023-10-06T11:16:34.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.393+0000 7f42177fe700 1 --2- 172.21.15.146:0/3126613133 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x55e0b5c4d9b0 0x55e0b5c4dd80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=614530db0601dc53 server_cookie=a71aae0e74ca744a in_seq=0 out_seq=0 2023-10-06T11:16:34.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.393+0000 7f41f67fc700 1 -- 172.21.15.146:0/3126613133 <== mds.0 v2:172.21.15.146:6836/525107449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+334 (crc 0 0 0) 0x55e0b5afae00 con 0x55e0b5c4d9b0 2023-10-06T11:16:34.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.393+0000 7f41f67fc700 10 client.9378 handle_command_reply: tid=0 2023-10-06T11:16:34.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.393+0000 7f4227cd3b80 1 client.9378 shutdown 2023-10-06T11:16:34.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.393+0000 7f4227cd3b80 1 -- 172.21.15.146:0/3126613133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0b5c08bd0 msgr2=0x55e0b5cad1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:34.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.393+0000 7f4227cd3b80 1 --2- 172.21.15.146:0/3126613133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0b5c08bd0 0x55e0b5cad1a0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f420c000da0 tx=0x7f420c018000 comp rx=0 tx=0).stop 2023-10-06T11:16:34.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.393+0000 7f4227cd3b80 1 -- 172.21.15.146:0/3126613133 shutdown_connections 2023-10-06T11:16:34.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.393+0000 7f4227cd3b80 1 --2- 172.21.15.146:0/3126613133 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x55e0b5c4d9b0 0x55e0b5c4dd80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.393+0000 7f4227cd3b80 1 --2- 172.21.15.146:0/3126613133 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55e0b5c4ea90 0x55e0b5c07d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.393+0000 7f4227cd3b80 1 --2- 172.21.15.146:0/3126613133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55e0b5c08bd0 0x55e0b5cad1a0 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.393+0000 7f41f67fc700 0 client.9378 ms_handle_reset on v2:172.21.15.146:6836/525107449 2023-10-06T11:16:34.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.393+0000 7f4227cd3b80 1 --2- 172.21.15.146:0/3126613133 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0b5c0a9a0 0x55e0b5c077e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.393+0000 7f4227cd3b80 1 -- 172.21.15.146:0/3126613133 >> 172.21.15.146:0/3126613133 conn(0x55e0b5c09070 msgr2=0x55e0b5c46690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:34.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.394+0000 7f4227cd3b80 1 -- 172.21.15.146:0/3126613133 shutdown_connections 2023-10-06T11:16:34.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.394+0000 7f4227cd3b80 1 -- 172.21.15.146:0/3126613133 wait complete. 2023-10-06T11:16:34.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.394+0000 7f4227cd3b80 20 client.9378 trim_cache size 0 max 16384 2023-10-06T11:16:34.405 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:16:34.405 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1", 2023-10-06T11:16:34.406 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2023-10-06T11:16:34.406 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 9198, 2023-10-06T11:16:34.406 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2023-10-06T11:16:34.406 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2023-10-06T11:16:34.406 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2023-10-06T11:16:34.406 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 10.293171924999999, 2023-10-06T11:16:34.406 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 121, 2023-10-06T11:16:34.406 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 139, 2023-10-06T11:16:34.406 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 137, 2023-10-06T11:16:34.406 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 16.410614540000001 2023-10-06T11:16:34.406 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:16:34.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.394+0000 7f421e9db700 1 -- 172.21.15.146:0/467125517 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4204066f30 msgr2=0x7f42040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:34.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.394+0000 7f421e9db700 1 --2- 172.21.15.146:0/467125517 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4204066f30 0x7f42040693e0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f420c001510 tx=0x7f420c007a70 comp rx=0 tx=0).stop 2023-10-06T11:16:34.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.394+0000 7f421e9db700 1 -- 172.21.15.146:0/467125517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42180b1550 msgr2=0x7f42180b19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:34.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.394+0000 7f421e9db700 1 --2- 172.21.15.146:0/467125517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42180b1550 0x7f42180b19c0 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f420000c0a0 tx=0x7f4208015000 comp rx=0 tx=0).stop 2023-10-06T11:16:34.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.394+0000 7f421e9db700 1 -- 172.21.15.146:0/467125517 shutdown_connections 2023-10-06T11:16:34.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.394+0000 7f421e9db700 1 --2- 172.21.15.146:0/467125517 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4204066f30 0x7f42040693e0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.394+0000 7f421e9db700 1 --2- 172.21.15.146:0/467125517 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4218151c60 0x7f4218152100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.394+0000 7f421e9db700 1 --2- 172.21.15.146:0/467125517 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4200004810 0x7f42180c92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.394+0000 7f421e9db700 1 --2- 172.21.15.146:0/467125517 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f42180b1550 0x7f42180b19c0 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.394+0000 7f421e9db700 1 -- 172.21.15.146:0/467125517 >> 172.21.15.146:0/467125517 conn(0x7f421806f380 msgr2=0x7f42180b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:34.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.394+0000 7f421e9db700 1 -- 172.21.15.146:0/467125517 shutdown_connections 2023-10-06T11:16:34.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.394+0000 7f421e9db700 1 -- 172.21.15.146:0/467125517 wait complete. 2023-10-06T11:16:34.409 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T11:16:34.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.524+0000 7f63dd604700 1 Processor -- start 2023-10-06T11:16:34.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.524+0000 7f63dd604700 1 -- start start 2023-10-06T11:16:34.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.524+0000 7f63dd604700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63d80c7800 0x7f63d80c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:34.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.524+0000 7f63dd604700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f63d80c45e0 0x7f63d80c4a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:34.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.524+0000 7f63dd604700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63d806f480 con 0x7f63d8140d50 2023-10-06T11:16:34.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.524+0000 7f63dd604700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63d806e900 con 0x7f63d80c45e0 2023-10-06T11:16:34.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.524+0000 7f63dd604700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d806ebe0 con 0x7f63d80c7800 2023-10-06T11:16:34.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.525+0000 7f63d77fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f63d80c45e0 0x7f63d80c4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:34.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.525+0000 7f63d77fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f63d80c45e0 0x7f63d80c4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39342/0 (socket says 172.21.15.146:39342) 2023-10-06T11:16:34.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.525+0000 7f63d77fe700 1 -- 172.21.15.146:0/857846702 learned_addr learned my addr 172.21.15.146:0/857846702 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:34.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.525+0000 7f63cffff700 1 --2- 172.21.15.146:0/857846702 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63d80c7800 0x7f63d80c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:34.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.525+0000 7f63d77fe700 1 -- 172.21.15.146:0/857846702 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63d80c7800 msgr2=0x7f63d80c7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:34.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.525+0000 7f63d77fe700 1 --2- 172.21.15.146:0/857846702 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63d80c7800 0x7f63d80c7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.525+0000 7f63d77fe700 1 -- 172.21.15.146:0/857846702 >> v1:172.21.15.151:6789/0 conn(0x7f63d8140d50 legacy=0x7f63d80cd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:34.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.525+0000 7f63d77fe700 1 -- 172.21.15.146:0/857846702 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d806eec0 con 0x7f63d80c45e0 2023-10-06T11:16:34.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.525+0000 7f63cffff700 1 --2- 172.21.15.146:0/857846702 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63d80c7800 0x7f63d80c7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:34.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.525+0000 7f63d77fe700 1 --2- 172.21.15.146:0/857846702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63d80c45e0 0x7f63d80c4a40 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f63d0009f20 tx=0x7f63d0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c3f81e7a9d6aa49 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:34.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.525+0000 7f63d67fc700 1 -- 172.21.15.146:0/857846702 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d000e070 con 0x7f63d80c45e0 2023-10-06T11:16:34.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.525+0000 7f63d67fc700 1 -- 172.21.15.146:0/857846702 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d000ba40 con 0x7f63d80c45e0 2023-10-06T11:16:34.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.525+0000 7f63d67fc700 1 -- 172.21.15.146:0/857846702 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d00092e0 con 0x7f63d80c45e0 2023-10-06T11:16:34.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.526+0000 7f63dd604700 1 -- 172.21.15.146:0/857846702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63d80c45e0 msgr2=0x7f63d80c4a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:34.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.526+0000 7f63dd604700 1 --2- 172.21.15.146:0/857846702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63d80c45e0 0x7f63d80c4a40 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f63d0009f20 tx=0x7f63d0009840 comp rx=0 tx=0).stop 2023-10-06T11:16:34.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.526+0000 7f63dd604700 1 -- 172.21.15.146:0/857846702 shutdown_connections 2023-10-06T11:16:34.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.526+0000 7f63dd604700 1 --2- 172.21.15.146:0/857846702 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63d80c45e0 0x7f63d80c4a40 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.526+0000 7f63dd604700 1 --2- 172.21.15.146:0/857846702 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63d80c7800 0x7f63d80c7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.526+0000 7f63dd604700 1 -- 172.21.15.146:0/857846702 >> 172.21.15.146:0/857846702 conn(0x7f63d806b040 msgr2=0x7f63d80cd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:34.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.526+0000 7f63dd604700 1 -- 172.21.15.146:0/857846702 shutdown_connections 2023-10-06T11:16:34.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.526+0000 7f63dd604700 1 -- 172.21.15.146:0/857846702 wait complete. 2023-10-06T11:16:34.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.527+0000 7f63dd604700 1 Processor -- start 2023-10-06T11:16:34.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.527+0000 7f63dd604700 1 -- start start 2023-10-06T11:16:34.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.528+0000 7f63dd604700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63d80c45e0 0x7f63d813d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:34.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.528+0000 7f63dd604700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63d80c7800 0x7f63d815bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:34.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.528+0000 7f63dd604700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63d8140d50 0x7f63d813f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:34.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.528+0000 7f63dd604700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d815ab40 con 0x7f63d80c7800 2023-10-06T11:16:34.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.528+0000 7f63dd604700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d813dd70 con 0x7f63d80c45e0 2023-10-06T11:16:34.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.528+0000 7f63dd604700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d8159f30 con 0x7f63d8140d50 2023-10-06T11:16:34.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.528+0000 7f63cffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63d80c7800 0x7f63d815bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:34.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.528+0000 7f63cffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63d80c7800 0x7f63d815bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39352/0 (socket says 172.21.15.146:39352) 2023-10-06T11:16:34.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.528+0000 7f63cffff700 1 -- 172.21.15.146:0/172189853 learned_addr learned my addr 172.21.15.146:0/172189853 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:34.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.528+0000 7f63d77fe700 1 --2- 172.21.15.146:0/172189853 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63d8140d50 0x7f63d813f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:34.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.528+0000 7f63d6ffd700 1 --2- 172.21.15.146:0/172189853 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63d80c45e0 0x7f63d813d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:34.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.528+0000 7f63cffff700 1 -- 172.21.15.146:0/172189853 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63d8140d50 msgr2=0x7f63d813f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:34.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.528+0000 7f63cffff700 1 --2- 172.21.15.146:0/172189853 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63d8140d50 0x7f63d813f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.528+0000 7f63cffff700 1 -- 172.21.15.146:0/172189853 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63d80c45e0 msgr2=0x7f63d813d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:34.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.528+0000 7f63cffff700 1 --2- 172.21.15.146:0/172189853 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63d80c45e0 0x7f63d813d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.528+0000 7f63cffff700 1 -- 172.21.15.146:0/172189853 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d0009ae0 con 0x7f63d80c7800 2023-10-06T11:16:34.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.528+0000 7f63cffff700 1 --2- 172.21.15.146:0/172189853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63d80c7800 0x7f63d815bcf0 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f63c000c830 tx=0x7f63c0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:34.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.528+0000 7f63ceffd700 1 -- 172.21.15.146:0/172189853 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c0011600 con 0x7f63d80c7800 2023-10-06T11:16:34.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.528+0000 7f63ceffd700 1 -- 172.21.15.146:0/172189853 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c0011760 con 0x7f63d80c7800 2023-10-06T11:16:34.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.528+0000 7f63dd604700 1 -- 172.21.15.146:0/172189853 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63d815a210 con 0x7f63d80c7800 2023-10-06T11:16:34.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.528+0000 7f63ceffd700 1 -- 172.21.15.146:0/172189853 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c0011b20 con 0x7f63d80c7800 2023-10-06T11:16:34.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.528+0000 7f63dd604700 1 -- 172.21.15.146:0/172189853 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63d815a7d0 con 0x7f63d80c7800 2023-10-06T11:16:34.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.529+0000 7f63dd604700 1 -- 172.21.15.146:0/172189853 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63d815acf0 con 0x7f63d80c7800 2023-10-06T11:16:34.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.530+0000 7f63ceffd700 1 -- 172.21.15.146:0/172189853 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f63c0018360 con 0x7f63d80c7800 2023-10-06T11:16:34.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.530+0000 7f63ceffd700 1 --2- 172.21.15.146:0/172189853 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f63b8066f30 0x7f63b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:34.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.530+0000 7f63ceffd700 1 -- 172.21.15.146:0/172189853 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f63c0084660 con 0x7f63d80c7800 2023-10-06T11:16:34.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.530+0000 7f63d6ffd700 1 --2- 172.21.15.146:0/172189853 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f63b8066f30 0x7f63b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:34.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.531+0000 7f63d6ffd700 1 --2- 172.21.15.146:0/172189853 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f63b8066f30 0x7f63b80693e0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f63d813e880 tx=0x7f63c8009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:34.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.534+0000 7f63ceffd700 1 -- 172.21.15.146:0/172189853 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f63d815acf0 con 0x7f63d80c7800 2023-10-06T11:16:34.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.765+0000 7f63dd604700 1 -- 172.21.15.146:0/172189853 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f63d815ac80 con 0x7f63d80c7800 2023-10-06T11:16:34.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.766+0000 7f63ceffd700 1 -- 172.21.15.146:0/172189853 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v121) v1 ==== 53+0+73 (secure 0 0 0) 0x7f63c0051730 con 0x7f63d80c7800 2023-10-06T11:16:34.768 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T11:16:34.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.768+0000 7f63dd604700 1 -- 172.21.15.146:0/172189853 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f63b8066f30 msgr2=0x7f63b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:34.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.768+0000 7f63dd604700 1 --2- 172.21.15.146:0/172189853 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f63b8066f30 0x7f63b80693e0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f63d813e880 tx=0x7f63c8009060 comp rx=0 tx=0).stop 2023-10-06T11:16:34.770 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.768+0000 7f63dd604700 1 -- 172.21.15.146:0/172189853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63d80c7800 msgr2=0x7f63d815bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:34.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.768+0000 7f63dd604700 1 --2- 172.21.15.146:0/172189853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63d80c7800 0x7f63d815bcf0 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f63c000c830 tx=0x7f63c0008040 comp rx=0 tx=0).stop 2023-10-06T11:16:34.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.768+0000 7f63dd604700 1 -- 172.21.15.146:0/172189853 shutdown_connections 2023-10-06T11:16:34.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.768+0000 7f63dd604700 1 --2- 172.21.15.146:0/172189853 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f63b8066f30 0x7f63b80693e0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.771 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.768+0000 7f63dd604700 1 --2- 172.21.15.146:0/172189853 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f63d8140d50 0x7f63d813f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.768+0000 7f63dd604700 1 --2- 172.21.15.146:0/172189853 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63d80c45e0 0x7f63d813d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.768+0000 7f63dd604700 1 --2- 172.21.15.146:0/172189853 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f63d80c7800 0x7f63d815bcf0 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:34.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.768+0000 7f63dd604700 1 -- 172.21.15.146:0/172189853 >> 172.21.15.146:0/172189853 conn(0x7f63d806b040 msgr2=0x7f63d80c69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:34.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.768+0000 7f63dd604700 1 -- 172.21.15.146:0/172189853 shutdown_connections 2023-10-06T11:16:34.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:34.768+0000 7f63dd604700 1 -- 172.21.15.146:0/172189853 wait complete. 2023-10-06T11:16:34.783 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T11:16:34.783 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T11:16:34.784 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2023-10-06T11:16:34.784 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T11:16:34.784 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T11:16:34.784 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T11:16:34.785 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T11:16:34.785 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T11:16:34.785 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:16:34.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:34.786 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2023-10-06T11:16:34.802 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:16:34.802 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:16:34.802 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:16:34.802 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:34.802 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2023-10-06T11:16:34.802 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:34.802 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:16:34.803 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2023-10-06T11:16:34.803 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2023-10-06T11:16:34.803 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:16:34.803 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2023-10-06T11:16:34.803 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2023-10-06T11:16:34.803 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:16:34.803 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2023-10-06T11:16:34.803 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T11:16:34.803 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2023-10-06T11:16:34.803 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T11:16:34.804 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 41862sec preferred_lft 41862sec 2023-10-06T11:16:34.804 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link noprefixroute 2023-10-06T11:16:34.804 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:34.804 INFO:teuthology.orchestra.run.smithi146.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T11:16:34.804 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0e:4f:33:80:c4:0e brd ff:ff:ff:ff:ff:ff 2023-10-06T11:16:34.804 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T11:16:34.804 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:34.804 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3884:6eff:fefc:ffc7/64 scope link 2023-10-06T11:16:34.804 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:34.804 INFO:teuthology.orchestra.run.smithi146.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:16:34.804 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0e:4f:33:80:c4:0e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T11:16:34.805 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::c4f:33ff:fe80:c40e/64 scope link 2023-10-06T11:16:34.805 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:34.805 INFO:teuthology.orchestra.run.smithi146.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:16:34.805 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 36:96:28:73:57:c4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T11:16:34.805 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3496:28ff:fe73:57c4/64 scope link 2023-10-06T11:16:34.805 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:16:34.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:34.806 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T11:16:34.865 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-06T11:16:34.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:34.867 DEBUG:teuthology.orchestra.run.smithi146:> route 2023-10-06T11:16:34.922 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2023-10-06T11:16:34.922 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T11:16:34.923 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T11:16:34.923 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T11:16:34.923 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T11:16:34.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:34.923 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-10-06T11:16:34.923 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:16:34.923 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T11:16:34.923 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T11:16:34.923 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T11:16:34.924 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:16:35.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:35.023 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-10-06T11:16:35.037 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T11:16:35.038 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T11:16:35.038 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:16:35.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:16:35.038 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2023-10-06T11:16:35.101 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T11:16:35.102 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:16:35.102 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T11:16:35.157 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:16:35.158 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:16:35.158 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:16:35.213 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-06T11:16:35.277 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:16:35.277 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:16:35.341 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:16:35.342 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:16:35.342 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:16:35.343 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-06T11:16:35.397 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T11:16:35.398 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T11:16:35.440 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-06T11:16:35.464 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:16:35.464 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:16:35.521 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:2023-10-06T11:16:35.520+0000 7f8e0eee0540 -1 init, newargv = 0x560166784af0 newargc=15 2023-10-06T11:16:35.521 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[151321]: starting ceph client 2023-10-06T11:16:35.526 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[151321]: starting fuse 2023-10-06T11:16:35.530 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:16:35.531 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:16:35.531 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:16:35.531 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-06T11:16:35.587 INFO:teuthology.orchestra.run.smithi146.stdout:46 2023-10-06T11:16:35.587 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-06T11:16:35.587 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T11:16:35.587 DEBUG:teuthology.orchestra.run.smithi146:> import glob 2023-10-06T11:16:35.587 DEBUG:teuthology.orchestra.run.smithi146:> import re 2023-10-06T11:16:35.587 DEBUG:teuthology.orchestra.run.smithi146:> import os 2023-10-06T11:16:35.588 DEBUG:teuthology.orchestra.run.smithi146:> import subprocess 2023-10-06T11:16:35.588 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:16:35.588 DEBUG:teuthology.orchestra.run.smithi146:> def _find_admin_socket(client_name): 2023-10-06T11:16:35.588 DEBUG:teuthology.orchestra.run.smithi146:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T11:16:35.588 DEBUG:teuthology.orchestra.run.smithi146:> files = glob.glob(asok_path) 2023-10-06T11:16:35.588 DEBUG:teuthology.orchestra.run.smithi146:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T11:16:35.588 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:16:35.588 DEBUG:teuthology.orchestra.run.smithi146:> # Given a non-glob path, it better be there 2023-10-06T11:16:35.588 DEBUG:teuthology.orchestra.run.smithi146:> if "*" not in asok_path: 2023-10-06T11:16:35.588 DEBUG:teuthology.orchestra.run.smithi146:> assert(len(files) == 1) 2023-10-06T11:16:35.588 DEBUG:teuthology.orchestra.run.smithi146:> return files[0] 2023-10-06T11:16:35.588 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:16:35.588 DEBUG:teuthology.orchestra.run.smithi146:> for f in files: 2023-10-06T11:16:35.588 DEBUG:teuthology.orchestra.run.smithi146:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T11:16:35.589 DEBUG:teuthology.orchestra.run.smithi146:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T11:16:35.589 DEBUG:teuthology.orchestra.run.smithi146:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T11:16:35.589 DEBUG:teuthology.orchestra.run.smithi146:> contents = proc_f.read() 2023-10-06T11:16:35.589 DEBUG:teuthology.orchestra.run.smithi146:> if mountpoint in contents: 2023-10-06T11:16:35.589 DEBUG:teuthology.orchestra.run.smithi146:> return f 2023-10-06T11:16:35.589 DEBUG:teuthology.orchestra.run.smithi146:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T11:16:35.589 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:16:35.589 DEBUG:teuthology.orchestra.run.smithi146:> print(_find_admin_socket("client.0")) 2023-10-06T11:16:35.589 DEBUG:teuthology.orchestra.run.smithi146:> ' 2023-10-06T11:16:35.708 INFO:teuthology.orchestra.run.smithi146.stdout:/var/run/ceph/ceph-client.0.151321.asok 2023-10-06T11:16:35.891 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.151321.asok 2023-10-06T11:16:35.891 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:16:35.891 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.151321.asok status 2023-10-06T11:16:36.041 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:16:36.041 INFO:teuthology.orchestra.run.smithi146.stdout: "metadata": { 2023-10-06T11:16:36.041 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T11:16:36.041 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T11:16:36.041 INFO:teuthology.orchestra.run.smithi146.stdout: "entity_id": "0", 2023-10-06T11:16:36.041 INFO:teuthology.orchestra.run.smithi146.stdout: "hostname": "smithi146", 2023-10-06T11:16:36.041 INFO:teuthology.orchestra.run.smithi146.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T11:16:36.041 INFO:teuthology.orchestra.run.smithi146.stdout: "pid": "151321", 2023-10-06T11:16:36.041 INFO:teuthology.orchestra.run.smithi146.stdout: "root": "/" 2023-10-06T11:16:36.042 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:16:36.042 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_count": 0, 2023-10-06T11:16:36.042 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_pinned_count": 0, 2023-10-06T11:16:36.042 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 9390, 2023-10-06T11:16:36.042 INFO:teuthology.orchestra.run.smithi146.stdout: "inst": { 2023-10-06T11:16:36.042 INFO:teuthology.orchestra.run.smithi146.stdout: "name": { 2023-10-06T11:16:36.042 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "client", 2023-10-06T11:16:36.042 INFO:teuthology.orchestra.run.smithi146.stdout: "num": 9390 2023-10-06T11:16:36.042 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:16:36.042 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-06T11:16:36.042 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-06T11:16:36.043 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:16:36.043 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 3642460771 2023-10-06T11:16:36.043 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:16:36.043 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:16:36.043 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-06T11:16:36.043 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-06T11:16:36.043 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:16:36.043 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 3642460771 2023-10-06T11:16:36.043 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:16:36.043 INFO:teuthology.orchestra.run.smithi146.stdout: "inst_str": "client.9390 192.168.0.1:0/3642460771", 2023-10-06T11:16:36.043 INFO:teuthology.orchestra.run.smithi146.stdout: "addr_str": "192.168.0.1:0/3642460771", 2023-10-06T11:16:36.043 INFO:teuthology.orchestra.run.smithi146.stdout: "inode_count": 1, 2023-10-06T11:16:36.044 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_epoch": 121, 2023-10-06T11:16:36.044 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch": 139, 2023-10-06T11:16:36.044 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch_barrier": 0, 2023-10-06T11:16:36.044 INFO:teuthology.orchestra.run.smithi146.stdout: "blocklisted": false, 2023-10-06T11:16:36.044 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs" 2023-10-06T11:16:36.044 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:16:36.051 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:16:36.051 DEBUG:teuthology.orchestra.run.smithi146:> stat --file-system '--printf=%T 2023-10-06T11:16:36.051 DEBUG:teuthology.orchestra.run.smithi146:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T11:16:36.067 INFO:teuthology.orchestra.run.smithi146.stdout:fuseblk 2023-10-06T11:16:36.067 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T11:16:36.067 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:16:36.067 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:16:36.132 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.10:0 damage ls 2023-10-06T11:16:36.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.287+0000 7ffbe29f9700 1 Processor -- start 2023-10-06T11:16:36.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.287+0000 7ffbe29f9700 1 -- start start 2023-10-06T11:16:36.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.288+0000 7ffbe29f9700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffbdc0adbd0 0x7ffbdc156160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.288+0000 7ffbe29f9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffbdc1566a0 0x7ffbdc0adfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.288+0000 7ffbe29f9700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbdc1579f0 con 0x7ffbdc0ae4e0 2023-10-06T11:16:36.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.288+0000 7ffbe29f9700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbdc156b10 con 0x7ffbdc1566a0 2023-10-06T11:16:36.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.288+0000 7ffbe29f9700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc156de0 con 0x7ffbdc0adbd0 2023-10-06T11:16:36.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.288+0000 7ffbdb7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffbdc1566a0 0x7ffbdc0adfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.288+0000 7ffbdb7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ffbdc1566a0 0x7ffbdc0adfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39356/0 (socket says 172.21.15.146:39356) 2023-10-06T11:16:36.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.288+0000 7ffbdb7fe700 1 -- 172.21.15.146:0/2360144096 learned_addr learned my addr 172.21.15.146:0/2360144096 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:36.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.288+0000 7ffbdbfff700 1 --2- 172.21.15.146:0/2360144096 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffbdc0adbd0 0x7ffbdc156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.289+0000 7ffbdb7fe700 1 -- 172.21.15.146:0/2360144096 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffbdc0adbd0 msgr2=0x7ffbdc156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:36.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.289+0000 7ffbdb7fe700 1 --2- 172.21.15.146:0/2360144096 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffbdc0adbd0 0x7ffbdc156160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.289+0000 7ffbdb7fe700 1 -- 172.21.15.146:0/2360144096 >> v1:172.21.15.151:6789/0 conn(0x7ffbdc0ae4e0 legacy=0x7ffbdc157e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:36.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.289+0000 7ffbdb7fe700 1 -- 172.21.15.146:0/2360144096 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbdc1570c0 con 0x7ffbdc1566a0 2023-10-06T11:16:36.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.289+0000 7ffbdb7fe700 1 --2- 172.21.15.146:0/2360144096 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffbdc1566a0 0x7ffbdc0adfa0 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7ffbd00099b0 tx=0x7ffbd0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46fcaee15288ff73 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:36.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.289+0000 7ffbdaffd700 1 -- 172.21.15.146:0/2360144096 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd0009ea0 con 0x7ffbdc1566a0 2023-10-06T11:16:36.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.289+0000 7ffbdaffd700 1 -- 172.21.15.146:0/2360144096 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbd000b860 con 0x7ffbdc1566a0 2023-10-06T11:16:36.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.289+0000 7ffbdaffd700 1 -- 172.21.15.146:0/2360144096 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd000bc00 con 0x7ffbdc1566a0 2023-10-06T11:16:36.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.289+0000 7ffbe29f9700 1 -- 172.21.15.146:0/2360144096 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffbdc1566a0 msgr2=0x7ffbdc0adfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:36.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.289+0000 7ffbe29f9700 1 --2- 172.21.15.146:0/2360144096 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffbdc1566a0 0x7ffbdc0adfa0 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7ffbd00099b0 tx=0x7ffbd0009250 comp rx=0 tx=0).stop 2023-10-06T11:16:36.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.289+0000 7ffbe29f9700 1 -- 172.21.15.146:0/2360144096 shutdown_connections 2023-10-06T11:16:36.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.289+0000 7ffbe29f9700 1 --2- 172.21.15.146:0/2360144096 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffbdc0adbd0 0x7ffbdc156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.289+0000 7ffbe29f9700 1 --2- 172.21.15.146:0/2360144096 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffbdc1566a0 0x7ffbdc0adfa0 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.289+0000 7ffbe29f9700 1 -- 172.21.15.146:0/2360144096 >> 172.21.15.146:0/2360144096 conn(0x7ffbdc06a070 msgr2=0x7ffbdc067470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:36.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.289+0000 7ffbe29f9700 1 -- 172.21.15.146:0/2360144096 shutdown_connections 2023-10-06T11:16:36.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.290+0000 7ffbe29f9700 1 -- 172.21.15.146:0/2360144096 wait complete. 2023-10-06T11:16:36.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.291+0000 7ffbe29f9700 1 Processor -- start 2023-10-06T11:16:36.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.291+0000 7ffbe29f9700 1 -- start start 2023-10-06T11:16:36.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.291+0000 7ffbe29f9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffbdc0adbd0 0x7ffbdc0c1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.291+0000 7ffbe29f9700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffbdc0ae4e0 0x7ffbdc16af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.291+0000 7ffbe29f9700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffbdc1566a0 0x7ffbdc16b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.291+0000 7ffbe29f9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc148ca0 con 0x7ffbdc0adbd0 2023-10-06T11:16:36.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.291+0000 7ffbe29f9700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc0c27d0 con 0x7ffbdc0ae4e0 2023-10-06T11:16:36.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.291+0000 7ffbe29f9700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc0c2ab0 con 0x7ffbdc1566a0 2023-10-06T11:16:36.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.292+0000 7ffbdbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffbdc0adbd0 0x7ffbdc0c1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.292+0000 7ffbdbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffbdc0adbd0 0x7ffbdc0c1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39366/0 (socket says 172.21.15.146:39366) 2023-10-06T11:16:36.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.292+0000 7ffbdbfff700 1 -- 172.21.15.146:0/3234778081 learned_addr learned my addr 172.21.15.146:0/3234778081 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:36.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.292+0000 7ffbdb7fe700 1 --2- 172.21.15.146:0/3234778081 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffbdc0ae4e0 0x7ffbdc16af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.292+0000 7ffbe0f96700 1 --2- 172.21.15.146:0/3234778081 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffbdc1566a0 0x7ffbdc16b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.292+0000 7ffbdbfff700 1 -- 172.21.15.146:0/3234778081 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffbdc1566a0 msgr2=0x7ffbdc16b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:36.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.292+0000 7ffbdbfff700 1 --2- 172.21.15.146:0/3234778081 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffbdc1566a0 0x7ffbdc16b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.292+0000 7ffbdbfff700 1 -- 172.21.15.146:0/3234778081 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffbdc0ae4e0 msgr2=0x7ffbdc16af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:36.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.292+0000 7ffbdbfff700 1 --2- 172.21.15.146:0/3234778081 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffbdc0ae4e0 0x7ffbdc16af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.292+0000 7ffbdbfff700 1 -- 172.21.15.146:0/3234778081 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd00094f0 con 0x7ffbdc0adbd0 2023-10-06T11:16:36.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.292+0000 7ffbdbfff700 1 --2- 172.21.15.146:0/3234778081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffbdc0adbd0 0x7ffbdc0c1da0 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc00ec80 tx=0x7ffbcc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:36.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.292+0000 7ffbc3fff700 1 -- 172.21.15.146:0/3234778081 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc00c850 con 0x7ffbdc0adbd0 2023-10-06T11:16:36.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.292+0000 7ffbc3fff700 1 -- 172.21.15.146:0/3234778081 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbcc00c9b0 con 0x7ffbdc0adbd0 2023-10-06T11:16:36.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.292+0000 7ffbe29f9700 1 -- 172.21.15.146:0/3234778081 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbdc148650 con 0x7ffbdc0adbd0 2023-10-06T11:16:36.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.292+0000 7ffbc3fff700 1 -- 172.21.15.146:0/3234778081 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc00cd50 con 0x7ffbdc0adbd0 2023-10-06T11:16:36.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.292+0000 7ffbe29f9700 1 -- 172.21.15.146:0/3234778081 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbdc0c22e0 con 0x7ffbdc0adbd0 2023-10-06T11:16:36.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.294+0000 7ffbc3fff700 1 -- 172.21.15.146:0/3234778081 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffbcc013680 con 0x7ffbdc0adbd0 2023-10-06T11:16:36.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.294+0000 7ffbc3fff700 1 --2- 172.21.15.146:0/3234778081 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ffbc8066f30 0x7ffbc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.294+0000 7ffbc3fff700 1 -- 172.21.15.146:0/3234778081 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6116+0+0 (secure 0 0 0) 0x7ffbcc084900 con 0x7ffbdc0adbd0 2023-10-06T11:16:36.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.294+0000 7ffbdb7fe700 1 --2- 172.21.15.146:0/3234778081 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ffbc8066f30 0x7ffbc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.294+0000 7ffbdb7fe700 1 --2- 172.21.15.146:0/3234778081 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ffbc8066f30 0x7ffbc80693e0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7ffbd00099b0 tx=0x7ffbd0017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:36.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.296+0000 7ffbebcf1b80 1 Processor -- start 2023-10-06T11:16:36.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.296+0000 7ffbebcf1b80 1 -- start start 2023-10-06T11:16:36.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.297+0000 7ffbebcf1b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f416dbfae0 0x55f416dbfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.297+0000 7ffbebcf1b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f416d7b9f0 0x55f416d785d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.297+0000 7ffbebcf1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f416d79c20 0x55f416d78b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.297+0000 7ffbebcf1b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f416cf8cd0 con 0x55f416dbfae0 2023-10-06T11:16:36.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.297+0000 7ffbebcf1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f416ccfac0 con 0x55f416d79c20 2023-10-06T11:16:36.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.297+0000 7ffbebcf1b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f416ccd2c0 con 0x55f416d7b9f0 2023-10-06T11:16:36.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.297+0000 7ffbdbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f416dbfae0 0x55f416dbfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.307 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.297+0000 7ffbdbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f416dbfae0 0x55f416dbfeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39368/0 (socket says 172.21.15.146:39368) 2023-10-06T11:16:36.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.297+0000 7ffbdbfff700 1 -- 172.21.15.146:0/2442527396 learned_addr learned my addr 172.21.15.146:0/2442527396 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:36.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.297+0000 7ffbdbfff700 1 -- 172.21.15.146:0/2442527396 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f416d7b9f0 msgr2=0x55f416d785d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:36.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.297+0000 7ffbdb7fe700 1 --2- 172.21.15.146:0/2442527396 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f416d7b9f0 0x55f416d785d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.297+0000 7ffbe0f96700 1 --2- 172.21.15.146:0/2442527396 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f416d79c20 0x55f416d78b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.297+0000 7ffbdbfff700 1 --2- 172.21.15.146:0/2442527396 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f416d7b9f0 0x55f416d785d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.297+0000 7ffbdbfff700 1 -- 172.21.15.146:0/2442527396 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f416d79c20 msgr2=0x55f416d78b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:36.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.297+0000 7ffbdbfff700 1 --2- 172.21.15.146:0/2442527396 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f416d79c20 0x55f416d78b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.297+0000 7ffbdbfff700 1 -- 172.21.15.146:0/2442527396 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f416b632c0 con 0x55f416dbfae0 2023-10-06T11:16:36.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.297+0000 7ffbdbfff700 1 --2- 172.21.15.146:0/2442527396 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f416dbfae0 0x55f416dbfeb0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc00f010 tx=0x7ffbcc082be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7afe31d9a138f3a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:36.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.297+0000 7ffbc17fa700 1 -- 172.21.15.146:0/2442527396 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc0588e0 con 0x55f416dbfae0 2023-10-06T11:16:36.308 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.297+0000 7ffbc17fa700 1 -- 172.21.15.146:0/2442527396 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbcc05c630 con 0x55f416dbfae0 2023-10-06T11:16:36.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.297+0000 7ffbc17fa700 1 -- 172.21.15.146:0/2442527396 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc053a30 con 0x55f416dbfae0 2023-10-06T11:16:36.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.298+0000 7ffbebcf1b80 1 -- 172.21.15.146:0/2442527396 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f416dbfae0 msgr2=0x55f416dbfeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:36.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.298+0000 7ffbebcf1b80 1 --2- 172.21.15.146:0/2442527396 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f416dbfae0 0x55f416dbfeb0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc00f010 tx=0x7ffbcc082be0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.298+0000 7ffbebcf1b80 1 -- 172.21.15.146:0/2442527396 shutdown_connections 2023-10-06T11:16:36.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.298+0000 7ffbebcf1b80 1 --2- 172.21.15.146:0/2442527396 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f416d79c20 0x55f416d78b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.298+0000 7ffbebcf1b80 1 --2- 172.21.15.146:0/2442527396 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f416dbfae0 0x55f416dbfeb0 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.298+0000 7ffbebcf1b80 1 --2- 172.21.15.146:0/2442527396 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f416d7b9f0 0x55f416d785d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.298+0000 7ffbebcf1b80 1 -- 172.21.15.146:0/2442527396 >> 172.21.15.146:0/2442527396 conn(0x55f416d7a0c0 msgr2=0x55f416d7a490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:36.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.298+0000 7ffbebcf1b80 1 -- 172.21.15.146:0/2442527396 shutdown_connections 2023-10-06T11:16:36.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.298+0000 7ffbebcf1b80 1 -- 172.21.15.146:0/2442527396 wait complete. 2023-10-06T11:16:36.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.299+0000 7ffbebcf1b80 1 -- start start 2023-10-06T11:16:36.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.299+0000 7ffbebcf1b80 1 Processor -- start 2023-10-06T11:16:36.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.299+0000 7ffbebcf1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f416d79c20 0x55f416d785d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.299+0000 7ffbebcf1b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f416d7b9f0 0x55f416d78b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.299+0000 7ffbebcf1b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f416dbfae0 0x55f416dbac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.300+0000 7ffbebcf1b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f416cc90b0 con 0x55f416d7b9f0 2023-10-06T11:16:36.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.300+0000 7ffbebcf1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f416c748e0 con 0x55f416d79c20 2023-10-06T11:16:36.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.300+0000 7ffbebcf1b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f416c8fef0 con 0x55f416dbfae0 2023-10-06T11:16:36.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.300+0000 7ffbebcf1b80 10 client.0 _ll_register_callbacks cb 0x55f416b65f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:16:36.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.300+0000 7ffbdb7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f416d7b9f0 0x55f416d78b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.300+0000 7ffbdb7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f416d7b9f0 0x55f416d78b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39378/0 (socket says 172.21.15.146:39378) 2023-10-06T11:16:36.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.300+0000 7ffbdb7fe700 1 -- 172.21.15.146:0/2158059986 learned_addr learned my addr 172.21.15.146:0/2158059986 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:36.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.300+0000 7ffbdbfff700 1 --2- 172.21.15.146:0/2158059986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f416d79c20 0x55f416d785d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.300+0000 7ffbe0f96700 1 --2- 172.21.15.146:0/2158059986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f416dbfae0 0x55f416dbac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.300+0000 7ffbdb7fe700 1 -- 172.21.15.146:0/2158059986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f416dbfae0 msgr2=0x55f416dbac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:36.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.300+0000 7ffbdb7fe700 1 --2- 172.21.15.146:0/2158059986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f416dbfae0 0x55f416dbac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.300+0000 7ffbdb7fe700 1 -- 172.21.15.146:0/2158059986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f416d79c20 msgr2=0x55f416d785d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:36.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.300+0000 7ffbdb7fe700 1 --2- 172.21.15.146:0/2158059986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f416d79c20 0x55f416d785d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.300+0000 7ffbdb7fe700 1 -- 172.21.15.146:0/2158059986 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbdc0c22e0 con 0x55f416d7b9f0 2023-10-06T11:16:36.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.300+0000 7ffbe0f96700 1 --2- 172.21.15.146:0/2158059986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f416dbfae0 0x55f416dbac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:36.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.300+0000 7ffbdb7fe700 1 --2- 172.21.15.146:0/2158059986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f416d7b9f0 0x55f416d78b10 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7ffbd000b3c0 tx=0x7ffbd0021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8399e1c54905647a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:36.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.300+0000 7ffbba7fc700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:16:36.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.300+0000 7ffbba7fc700 1 -- 172.21.15.146:0/2158059986 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd002e070 con 0x55f416d7b9f0 2023-10-06T11:16:36.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.300+0000 7ffbba7fc700 1 -- 172.21.15.146:0/2158059986 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 6116+0+0 (secure 0 0 0) 0x7ffbd0033460 con 0x55f416d7b9f0 2023-10-06T11:16:36.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.300+0000 7ffbebcf1b80 1 -- 172.21.15.146:0/2158059986 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f416d6d6e0 con 0x55f416d7b9f0 2023-10-06T11:16:36.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.300+0000 7ffbba7fc700 1 -- 172.21.15.146:0/2158059986 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=121) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffbd0021070 con 0x55f416d7b9f0 2023-10-06T11:16:36.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.300+0000 7ffbebcf1b80 10 client.9402 fetch_fsmap learned FSMap version 121 2023-10-06T11:16:36.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.300+0000 7ffbebcf1b80 1 -- 172.21.15.146:0/2158059986 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=121,monmap=2+}) v3 -- 0x55f416b06030 con 0x55f416d7b9f0 2023-10-06T11:16:36.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.301+0000 7ffbba7fc700 1 -- 172.21.15.146:0/2158059986 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f416d6d6e0 con 0x55f416d7b9f0 2023-10-06T11:16:36.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.301+0000 7ffbba7fc700 1 -- 172.21.15.146:0/2158059986 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 121) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ffbd0033830 con 0x55f416d7b9f0 2023-10-06T11:16:36.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.301+0000 7ffbebcf1b80 10 client.9402 fetch_fsmap finished waiting for FSMap version 121 2023-10-06T11:16:36.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.301+0000 7ffbebcf1b80 10 client.9402 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2023-10-06T11:16:36.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.301+0000 7ffbebcf1b80 20 client.9402 populate_metadata read hostname 'smithi146' 2023-10-06T11:16:36.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.301+0000 7ffbebcf1b80 1 --2- 172.21.15.146:0/2158059986 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x55f416da30d0 0x55f416dbb680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.301+0000 7ffbebcf1b80 4 client.9402 mds_command: new command op to 9198 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:16:36.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.301+0000 7ffbebcf1b80 1 -- 172.21.15.146:0/2158059986 --> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f416d4a610 con 0x55f416da30d0 2023-10-06T11:16:36.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.301+0000 7ffbdbfff700 1 --2- 172.21.15.146:0/2158059986 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x55f416da30d0 0x55f416dbb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.301+0000 7ffbdbfff700 1 --2- 172.21.15.146:0/2158059986 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x55f416da30d0 0x55f416dbb680 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87f3f854a49b5cec server_cookie=78c3de42a35c4c7d in_seq=0 out_seq=0 2023-10-06T11:16:36.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.301+0000 7ffbba7fc700 10 client.9402 ms_handle_connect on v2:172.21.15.146:6836/525107449 2023-10-06T11:16:36.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.302+0000 7ffbba7fc700 1 -- 172.21.15.146:0/2158059986 <== mds.0 v2:172.21.15.146:6836/525107449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55f416d4a610 con 0x55f416da30d0 2023-10-06T11:16:36.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.302+0000 7ffbba7fc700 10 client.9402 handle_command_reply: tid=0 2023-10-06T11:16:36.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.302+0000 7ffbebcf1b80 1 client.9402 shutdown 2023-10-06T11:16:36.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.302+0000 7ffbebcf1b80 1 -- 172.21.15.146:0/2158059986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f416d7b9f0 msgr2=0x55f416d78b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:36.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.302+0000 7ffbebcf1b80 1 --2- 172.21.15.146:0/2158059986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f416d7b9f0 0x55f416d78b10 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7ffbd000b3c0 tx=0x7ffbd0021000 comp rx=0 tx=0).stop 2023-10-06T11:16:36.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.302+0000 7ffbebcf1b80 1 -- 172.21.15.146:0/2158059986 shutdown_connections 2023-10-06T11:16:36.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.302+0000 7ffbebcf1b80 1 --2- 172.21.15.146:0/2158059986 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x55f416da30d0 0x55f416dbb680 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.302+0000 7ffbebcf1b80 1 --2- 172.21.15.146:0/2158059986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f416dbfae0 0x55f416dbac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.302+0000 7ffbebcf1b80 1 --2- 172.21.15.146:0/2158059986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f416d79c20 0x55f416d785d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.302+0000 7ffbba7fc700 0 client.9402 ms_handle_reset on v2:172.21.15.146:6836/525107449 2023-10-06T11:16:36.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.302+0000 7ffbebcf1b80 1 --2- 172.21.15.146:0/2158059986 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f416d7b9f0 0x55f416d78b10 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.302+0000 7ffbebcf1b80 1 -- 172.21.15.146:0/2158059986 >> 172.21.15.146:0/2158059986 conn(0x55f416d7a0c0 msgr2=0x55f416d74ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:36.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.302+0000 7ffbebcf1b80 1 -- 172.21.15.146:0/2158059986 shutdown_connections 2023-10-06T11:16:36.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.302+0000 7ffbebcf1b80 1 -- 172.21.15.146:0/2158059986 wait complete. 2023-10-06T11:16:36.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.302+0000 7ffbebcf1b80 20 client.9402 trim_cache size 0 max 16384 2023-10-06T11:16:36.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.314+0000 7ffbebcf1b80 1 Processor -- start 2023-10-06T11:16:36.316 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.314+0000 7ffbebcf1b80 1 -- start start 2023-10-06T11:16:36.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.315+0000 7ffbebcf1b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f416d79c20 0x55f416db8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.315+0000 7ffbebcf1b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f416d7b9f0 0x55f416dbe2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.315+0000 7ffbebcf1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f416dbfae0 0x55f416dbe810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.315+0000 7ffbebcf1b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f416b4be80 con 0x55f416d79c20 2023-10-06T11:16:36.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.315+0000 7ffbebcf1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f416dbcb90 con 0x55f416dbfae0 2023-10-06T11:16:36.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.315+0000 7ffbebcf1b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f416d73110 con 0x55f416d7b9f0 2023-10-06T11:16:36.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.315+0000 7ffbdbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f416d79c20 0x55f416db8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.315+0000 7ffbdbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f416d79c20 0x55f416db8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39380/0 (socket says 172.21.15.146:39380) 2023-10-06T11:16:36.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.315+0000 7ffbdbfff700 1 -- 172.21.15.146:0/3803028045 learned_addr learned my addr 172.21.15.146:0/3803028045 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:36.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.315+0000 7ffbe0f96700 1 --2- 172.21.15.146:0/3803028045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f416dbfae0 0x55f416dbe810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.315+0000 7ffbdb7fe700 1 --2- 172.21.15.146:0/3803028045 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f416d7b9f0 0x55f416dbe2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.315+0000 7ffbdbfff700 1 -- 172.21.15.146:0/3803028045 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f416d7b9f0 msgr2=0x55f416dbe2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:36.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.315+0000 7ffbdbfff700 1 --2- 172.21.15.146:0/3803028045 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f416d7b9f0 0x55f416dbe2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.315+0000 7ffbdbfff700 1 -- 172.21.15.146:0/3803028045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f416dbfae0 msgr2=0x55f416dbe810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:36.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.315+0000 7ffbdbfff700 1 --2- 172.21.15.146:0/3803028045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f416dbfae0 0x55f416dbe810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.315+0000 7ffbdbfff700 1 -- 172.21.15.146:0/3803028045 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f416c977d0 con 0x55f416d79c20 2023-10-06T11:16:36.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.315+0000 7ffbdb7fe700 1 --2- 172.21.15.146:0/3803028045 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f416d7b9f0 0x55f416dbe2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:36.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.315+0000 7ffbe0f96700 1 --2- 172.21.15.146:0/3803028045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f416dbfae0 0x55f416dbe810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:16:36.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.316+0000 7ffbdbfff700 1 --2- 172.21.15.146:0/3803028045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f416d79c20 0x55f416db8a30 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc055f40 tx=0x7ffbcc069000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87e99aded3c8f6c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:36.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.316+0000 7ffbc1ffb700 1 -- 172.21.15.146:0/3803028045 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc0712b0 con 0x55f416d79c20 2023-10-06T11:16:36.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.316+0000 7ffbc1ffb700 1 -- 172.21.15.146:0/3803028045 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbcc0588e0 con 0x55f416d79c20 2023-10-06T11:16:36.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.316+0000 7ffbc1ffb700 1 -- 172.21.15.146:0/3803028045 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc013470 con 0x55f416d79c20 2023-10-06T11:16:36.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.316+0000 7ffbebcf1b80 1 -- 172.21.15.146:0/3803028045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f416d79c20 msgr2=0x55f416db8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:36.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.316+0000 7ffbebcf1b80 1 --2- 172.21.15.146:0/3803028045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f416d79c20 0x55f416db8a30 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc055f40 tx=0x7ffbcc069000 comp rx=0 tx=0).stop 2023-10-06T11:16:36.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.316+0000 7ffbebcf1b80 1 -- 172.21.15.146:0/3803028045 shutdown_connections 2023-10-06T11:16:36.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.316+0000 7ffbebcf1b80 1 --2- 172.21.15.146:0/3803028045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f416dbfae0 0x55f416dbe810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.316+0000 7ffbebcf1b80 1 --2- 172.21.15.146:0/3803028045 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f416d79c20 0x55f416db8a30 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.316+0000 7ffbebcf1b80 1 --2- 172.21.15.146:0/3803028045 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f416d7b9f0 0x55f416dbe2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.316+0000 7ffbebcf1b80 1 -- 172.21.15.146:0/3803028045 >> 172.21.15.146:0/3803028045 conn(0x55f416d7a0c0 msgr2=0x55f416da4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:36.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.316+0000 7ffbebcf1b80 1 -- 172.21.15.146:0/3803028045 shutdown_connections 2023-10-06T11:16:36.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.316+0000 7ffbebcf1b80 1 -- 172.21.15.146:0/3803028045 wait complete. 2023-10-06T11:16:36.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.317+0000 7ffbebcf1b80 1 -- start start 2023-10-06T11:16:36.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.317+0000 7ffbebcf1b80 1 Processor -- start 2023-10-06T11:16:36.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.318+0000 7ffbebcf1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f416d79c20 0x55f416d75bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.318+0000 7ffbebcf1b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f416d7b9f0 0x55f416da7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.318+0000 7ffbebcf1b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f416dbfae0 0x55f416da82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.318+0000 7ffbebcf1b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f416d78ea0 con 0x55f416d7b9f0 2023-10-06T11:16:36.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.318+0000 7ffbebcf1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f416d78c60 con 0x55f416d79c20 2023-10-06T11:16:36.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.318+0000 7ffbebcf1b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f416d76110 con 0x55f416dbfae0 2023-10-06T11:16:36.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.318+0000 7ffbebcf1b80 10 client.0 _ll_register_callbacks cb 0x55f416b65f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:16:36.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.318+0000 7ffbdb7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f416d7b9f0 0x55f416da7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.318+0000 7ffbdb7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f416d7b9f0 0x55f416da7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39382/0 (socket says 172.21.15.146:39382) 2023-10-06T11:16:36.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.318+0000 7ffbdb7fe700 1 -- 172.21.15.146:0/4133675160 learned_addr learned my addr 172.21.15.146:0/4133675160 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:36.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.318+0000 7ffbdbfff700 1 --2- 172.21.15.146:0/4133675160 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f416d79c20 0x55f416d75bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.318+0000 7ffbe0f96700 1 --2- 172.21.15.146:0/4133675160 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f416dbfae0 0x55f416da82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.318+0000 7ffbdb7fe700 1 -- 172.21.15.146:0/4133675160 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f416dbfae0 msgr2=0x55f416da82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:36.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.318+0000 7ffbdb7fe700 1 --2- 172.21.15.146:0/4133675160 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f416dbfae0 0x55f416da82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.318+0000 7ffbdb7fe700 1 -- 172.21.15.146:0/4133675160 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f416d79c20 msgr2=0x55f416d75bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:36.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.318+0000 7ffbdb7fe700 1 --2- 172.21.15.146:0/4133675160 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f416d79c20 0x55f416d75bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.318+0000 7ffbdb7fe700 1 -- 172.21.15.146:0/4133675160 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbcc06f040 con 0x55f416d7b9f0 2023-10-06T11:16:36.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.318+0000 7ffbdb7fe700 1 --2- 172.21.15.146:0/4133675160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f416d7b9f0 0x55f416da7da0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0003080 tx=0x7ffbd002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7000d72ace5aee90 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:36.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.318+0000 7ffbba7fc700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:16:36.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.318+0000 7ffbba7fc700 1 -- 172.21.15.146:0/4133675160 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbd0021070 con 0x55f416d7b9f0 2023-10-06T11:16:36.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.318+0000 7ffbba7fc700 1 -- 172.21.15.146:0/4133675160 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 6116+0+0 (secure 0 0 0) 0x7ffbd0033460 con 0x55f416d7b9f0 2023-10-06T11:16:36.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.318+0000 7ffbebcf1b80 1 -- 172.21.15.146:0/4133675160 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffbcc05c630 con 0x55f416d7b9f0 2023-10-06T11:16:36.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.319+0000 7ffbba7fc700 1 -- 172.21.15.146:0/4133675160 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=121) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffbd0000bc0 con 0x55f416d7b9f0 2023-10-06T11:16:36.328 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.319+0000 7ffbebcf1b80 10 client.9408 fetch_fsmap learned FSMap version 121 2023-10-06T11:16:36.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.319+0000 7ffbebcf1b80 1 -- 172.21.15.146:0/4133675160 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=121,monmap=2+}) v3 -- 0x55f416c7e4c0 con 0x55f416d7b9f0 2023-10-06T11:16:36.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.319+0000 7ffbba7fc700 1 -- 172.21.15.146:0/4133675160 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbcc05c630 con 0x55f416d7b9f0 2023-10-06T11:16:36.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.319+0000 7ffbba7fc700 1 -- 172.21.15.146:0/4133675160 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 121) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ffbd0011840 con 0x55f416d7b9f0 2023-10-06T11:16:36.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.319+0000 7ffbebcf1b80 10 client.9408 fetch_fsmap finished waiting for FSMap version 121 2023-10-06T11:16:36.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.319+0000 7ffbebcf1b80 10 client.9408 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2023-10-06T11:16:36.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.319+0000 7ffbebcf1b80 20 client.9408 populate_metadata read hostname 'smithi146' 2023-10-06T11:16:36.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.319+0000 7ffbebcf1b80 1 --2- 172.21.15.146:0/4133675160 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x55f416dc7590 0x55f416e234f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.319+0000 7ffbebcf1b80 4 client.9408 mds_command: new command op to 9198 tid=0[{"prefix": "damage ls"}] 2023-10-06T11:16:36.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.319+0000 7ffbebcf1b80 1 -- 172.21.15.146:0/4133675160 --> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f416c6be50 con 0x55f416dc7590 2023-10-06T11:16:36.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.319+0000 7ffbdbfff700 1 --2- 172.21.15.146:0/4133675160 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x55f416dc7590 0x55f416e234f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.329 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.319+0000 7ffbba7fc700 10 client.9408 ms_handle_connect on v2:172.21.15.146:6836/525107449 2023-10-06T11:16:36.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.319+0000 7ffbdbfff700 1 --2- 172.21.15.146:0/4133675160 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x55f416dc7590 0x55f416e234f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4a7c4d27239526f server_cookie=64cccb99ef6623c in_seq=0 out_seq=0 2023-10-06T11:16:36.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.319+0000 7ffbba7fc700 1 -- 172.21.15.146:0/4133675160 <== mds.0 v2:172.21.15.146:6836/525107449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f416c6be50 con 0x55f416dc7590 2023-10-06T11:16:36.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.319+0000 7ffbba7fc700 10 client.9408 handle_command_reply: tid=0 2023-10-06T11:16:36.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.319+0000 7ffbebcf1b80 1 client.9408 shutdown 2023-10-06T11:16:36.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.320+0000 7ffbebcf1b80 1 -- 172.21.15.146:0/4133675160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f416d7b9f0 msgr2=0x55f416da7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:36.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.320+0000 7ffbebcf1b80 1 --2- 172.21.15.146:0/4133675160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f416d7b9f0 0x55f416da7da0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7ffbd0003080 tx=0x7ffbd002e000 comp rx=0 tx=0).stop 2023-10-06T11:16:36.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.320+0000 7ffbebcf1b80 1 -- 172.21.15.146:0/4133675160 shutdown_connections 2023-10-06T11:16:36.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.320+0000 7ffbebcf1b80 1 --2- 172.21.15.146:0/4133675160 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x55f416dc7590 0x55f416e234f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.320+0000 7ffbebcf1b80 1 --2- 172.21.15.146:0/4133675160 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f416dbfae0 0x55f416da82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.320+0000 7ffbba7fc700 0 client.9408 ms_handle_reset on v2:172.21.15.146:6836/525107449 2023-10-06T11:16:36.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.320+0000 7ffbebcf1b80 1 --2- 172.21.15.146:0/4133675160 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f416d79c20 0x55f416d75bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.330 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.320+0000 7ffbebcf1b80 1 --2- 172.21.15.146:0/4133675160 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f416d7b9f0 0x55f416da7da0 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.320+0000 7ffbebcf1b80 1 -- 172.21.15.146:0/4133675160 >> 172.21.15.146:0/4133675160 conn(0x55f416d7a0c0 msgr2=0x55f416db9530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:36.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.320+0000 7ffbebcf1b80 1 -- 172.21.15.146:0/4133675160 shutdown_connections 2023-10-06T11:16:36.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.320+0000 7ffbebcf1b80 1 -- 172.21.15.146:0/4133675160 wait complete. 2023-10-06T11:16:36.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.320+0000 7ffbebcf1b80 20 client.9408 trim_cache size 0 max 16384 2023-10-06T11:16:36.331 INFO:teuthology.orchestra.run.smithi146.stdout:[] 2023-10-06T11:16:36.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.320+0000 7ffbe29f9700 1 -- 172.21.15.146:0/3234778081 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ffbc8066f30 msgr2=0x7ffbc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:36.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.320+0000 7ffbe29f9700 1 --2- 172.21.15.146:0/3234778081 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ffbc8066f30 0x7ffbc80693e0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7ffbd00099b0 tx=0x7ffbd0017000 comp rx=0 tx=0).stop 2023-10-06T11:16:36.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.320+0000 7ffbe29f9700 1 -- 172.21.15.146:0/3234778081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffbdc0adbd0 msgr2=0x7ffbdc0c1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:36.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.320+0000 7ffbe29f9700 1 --2- 172.21.15.146:0/3234778081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffbdc0adbd0 0x7ffbdc0c1da0 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc00ec80 tx=0x7ffbcc0091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.320+0000 7ffbe29f9700 1 -- 172.21.15.146:0/3234778081 shutdown_connections 2023-10-06T11:16:36.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.320+0000 7ffbe29f9700 1 --2- 172.21.15.146:0/3234778081 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ffbc8066f30 0x7ffbc80693e0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.320+0000 7ffbe29f9700 1 --2- 172.21.15.146:0/3234778081 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ffbdc1566a0 0x7ffbdc16b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.320+0000 7ffbe29f9700 1 --2- 172.21.15.146:0/3234778081 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ffbdc0adbd0 0x7ffbdc0c1da0 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.320+0000 7ffbe29f9700 1 --2- 172.21.15.146:0/3234778081 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffbdc0ae4e0 0x7ffbdc16af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.320+0000 7ffbe29f9700 1 -- 172.21.15.146:0/3234778081 >> 172.21.15.146:0/3234778081 conn(0x7ffbdc06a070 msgr2=0x7ffbdc06dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:36.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.320+0000 7ffbe29f9700 1 -- 172.21.15.146:0/3234778081 shutdown_connections 2023-10-06T11:16:36.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.320+0000 7ffbe29f9700 1 -- 172.21.15.146:0/3234778081 wait complete. 2023-10-06T11:16:36.334 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-06T11:16:36.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.446+0000 7fbce9155700 1 Processor -- start 2023-10-06T11:16:36.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.446+0000 7fbce9155700 1 -- start start 2023-10-06T11:16:36.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.447+0000 7fbce9155700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbce4068ba0 0x7fbce415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.447+0000 7fbce9155700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbce4153e80 0x7fbce40b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.447+0000 7fbce9155700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbce415ac30 con 0x7fbce4153ab0 2023-10-06T11:16:36.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.447+0000 7fbce9155700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbce40b4510 con 0x7fbce4153e80 2023-10-06T11:16:36.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.447+0000 7fbce9155700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce40b6530 con 0x7fbce4068ba0 2023-10-06T11:16:36.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.447+0000 7fbce259c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbce4068ba0 0x7fbce415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.447+0000 7fbce359e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbce4153e80 0x7fbce40b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.447+0000 7fbce259c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbce4068ba0 0x7fbce415a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:47622/0 (socket says 172.21.15.146:47622) 2023-10-06T11:16:36.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.447+0000 7fbce259c700 1 -- 172.21.15.146:0/2278415529 learned_addr learned my addr 172.21.15.146:0/2278415529 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:36.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.448+0000 7fbce259c700 1 -- 172.21.15.146:0/2278415529 >> v2:172.21.15.151:3300/0 conn(0x7fbce4153e80 msgr2=0x7fbce40b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:36.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.448+0000 7fbce259c700 1 --2- 172.21.15.146:0/2278415529 >> v2:172.21.15.151:3300/0 conn(0x7fbce4153e80 0x7fbce40b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.448+0000 7fbce259c700 1 -- 172.21.15.146:0/2278415529 >> v1:172.21.15.151:6789/0 conn(0x7fbce4153ab0 legacy=0x7fbce4068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:36.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.448+0000 7fbce259c700 1 -- 172.21.15.146:0/2278415529 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce40b5c50 con 0x7fbce4068ba0 2023-10-06T11:16:36.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.448+0000 7fbce359e700 1 --2- 172.21.15.146:0/2278415529 >> v2:172.21.15.151:3300/0 conn(0x7fbce4153e80 0x7fbce40b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:16:36.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.448+0000 7fbce259c700 1 --2- 172.21.15.146:0/2278415529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbce4068ba0 0x7fbce415a6f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbcd80099b0 tx=0x7fbcd8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee5b803db918e17 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:36.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.448+0000 7fbce1d9b700 1 -- 172.21.15.146:0/2278415529 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd8009ea0 con 0x7fbce4068ba0 2023-10-06T11:16:36.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.448+0000 7fbce1d9b700 1 -- 172.21.15.146:0/2278415529 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd800b860 con 0x7fbce4068ba0 2023-10-06T11:16:36.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.448+0000 7fbce1d9b700 1 -- 172.21.15.146:0/2278415529 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd800bc00 con 0x7fbce4068ba0 2023-10-06T11:16:36.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.449+0000 7fbce9155700 1 -- 172.21.15.146:0/2278415529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbce4068ba0 msgr2=0x7fbce415a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:36.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.449+0000 7fbce9155700 1 --2- 172.21.15.146:0/2278415529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbce4068ba0 0x7fbce415a6f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbcd80099b0 tx=0x7fbcd8009250 comp rx=0 tx=0).stop 2023-10-06T11:16:36.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.449+0000 7fbce9155700 1 -- 172.21.15.146:0/2278415529 shutdown_connections 2023-10-06T11:16:36.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.449+0000 7fbce9155700 1 --2- 172.21.15.146:0/2278415529 >> v2:172.21.15.151:3300/0 conn(0x7fbce4153e80 0x7fbce40b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.449+0000 7fbce9155700 1 --2- 172.21.15.146:0/2278415529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbce4068ba0 0x7fbce415a6f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.449+0000 7fbce9155700 1 -- 172.21.15.146:0/2278415529 >> 172.21.15.146:0/2278415529 conn(0x7fbce406eba0 msgr2=0x7fbce406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:36.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.449+0000 7fbce9155700 1 -- 172.21.15.146:0/2278415529 shutdown_connections 2023-10-06T11:16:36.453 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.449+0000 7fbce9155700 1 -- 172.21.15.146:0/2278415529 wait complete. 2023-10-06T11:16:36.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.450+0000 7fbce9155700 1 Processor -- start 2023-10-06T11:16:36.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.450+0000 7fbce9155700 1 -- start start 2023-10-06T11:16:36.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.451+0000 7fbce9155700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbce4068ba0 0x7fbce40c53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.451+0000 7fbce9155700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbce4153ab0 0x7fbce416d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.451+0000 7fbce9155700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbce4153e80 0x7fbce4143c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.451+0000 7fbce9155700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce4156b40 con 0x7fbce4068ba0 2023-10-06T11:16:36.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.451+0000 7fbce9155700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce4155c90 con 0x7fbce4153ab0 2023-10-06T11:16:36.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.451+0000 7fbce9155700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce4156fd0 con 0x7fbce4153e80 2023-10-06T11:16:36.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.451+0000 7fbce2d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbce4068ba0 0x7fbce40c53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.451+0000 7fbce2d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbce4068ba0 0x7fbce40c53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39394/0 (socket says 172.21.15.146:39394) 2023-10-06T11:16:36.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.451+0000 7fbce2d9d700 1 -- 172.21.15.146:0/1181399996 learned_addr learned my addr 172.21.15.146:0/1181399996 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:36.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.451+0000 7fbce259c700 1 --2- 172.21.15.146:0/1181399996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbce4153ab0 0x7fbce416d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.451+0000 7fbce359e700 1 --2- 172.21.15.146:0/1181399996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbce4153e80 0x7fbce4143c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.451+0000 7fbce2d9d700 1 -- 172.21.15.146:0/1181399996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbce4153e80 msgr2=0x7fbce4143c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:36.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.451+0000 7fbce2d9d700 1 --2- 172.21.15.146:0/1181399996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbce4153e80 0x7fbce4143c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.451+0000 7fbce2d9d700 1 -- 172.21.15.146:0/1181399996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbce4153ab0 msgr2=0x7fbce416d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:36.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.451+0000 7fbce2d9d700 1 --2- 172.21.15.146:0/1181399996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbce4153ab0 0x7fbce416d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.451+0000 7fbce2d9d700 1 -- 172.21.15.146:0/1181399996 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcdc009a20 con 0x7fbce4068ba0 2023-10-06T11:16:36.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.451+0000 7fbce2d9d700 1 --2- 172.21.15.146:0/1181399996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbce4068ba0 0x7fbce40c53a0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7fbcd400c590 tx=0x7fbcd400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:36.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.451+0000 7fbccaffd700 1 -- 172.21.15.146:0/1181399996 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd4011590 con 0x7fbce4068ba0 2023-10-06T11:16:36.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.451+0000 7fbccaffd700 1 -- 172.21.15.146:0/1181399996 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd4011710 con 0x7fbce4068ba0 2023-10-06T11:16:36.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.451+0000 7fbce9155700 1 -- 172.21.15.146:0/1181399996 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcd80094f0 con 0x7fbce4068ba0 2023-10-06T11:16:36.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.451+0000 7fbccaffd700 1 -- 172.21.15.146:0/1181399996 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd4011ad0 con 0x7fbce4068ba0 2023-10-06T11:16:36.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.451+0000 7fbce9155700 1 -- 172.21.15.146:0/1181399996 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbce41564f0 con 0x7fbce4068ba0 2023-10-06T11:16:36.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.452+0000 7fbce9155700 1 -- 172.21.15.146:0/1181399996 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbce404c380 con 0x7fbce4068ba0 2023-10-06T11:16:36.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.453+0000 7fbccaffd700 1 -- 172.21.15.146:0/1181399996 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbcd401b3b0 con 0x7fbce4068ba0 2023-10-06T11:16:36.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.453+0000 7fbccaffd700 1 --2- 172.21.15.146:0/1181399996 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbcd0066f30 0x7fbcd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.453+0000 7fbccaffd700 1 -- 172.21.15.146:0/1181399996 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fbcd4083950 con 0x7fbce4068ba0 2023-10-06T11:16:36.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.453+0000 7fbce259c700 1 --2- 172.21.15.146:0/1181399996 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbcd0066f30 0x7fbcd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.454+0000 7fbce259c700 1 --2- 172.21.15.146:0/1181399996 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbcd0066f30 0x7fbcd00693e0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fbcd80099b0 tx=0x7fbcd8017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:36.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.457+0000 7fbccaffd700 1 -- 172.21.15.146:0/1181399996 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbcd4050ae0 con 0x7fbce4068ba0 2023-10-06T11:16:36.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.680+0000 7fbce9155700 1 -- 172.21.15.146:0/1181399996 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fbce40b6250 con 0x7fbce4068ba0 2023-10-06T11:16:36.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.680+0000 7fbccaffd700 1 -- 172.21.15.146:0/1181399996 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fbcd4017020 con 0x7fbce4068ba0 2023-10-06T11:16:36.682 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:16:36.682 INFO:teuthology.orchestra.run.smithi146.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-06T11:16:36.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.682+0000 7fbce9155700 1 -- 172.21.15.146:0/1181399996 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbcd0066f30 msgr2=0x7fbcd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:36.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.682+0000 7fbce9155700 1 --2- 172.21.15.146:0/1181399996 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbcd0066f30 0x7fbcd00693e0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fbcd80099b0 tx=0x7fbcd8017000 comp rx=0 tx=0).stop 2023-10-06T11:16:36.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.682+0000 7fbce9155700 1 -- 172.21.15.146:0/1181399996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbce4068ba0 msgr2=0x7fbce40c53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:36.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.682+0000 7fbce9155700 1 --2- 172.21.15.146:0/1181399996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbce4068ba0 0x7fbce40c53a0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7fbcd400c590 tx=0x7fbcd400c8a0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.682+0000 7fbce9155700 1 -- 172.21.15.146:0/1181399996 shutdown_connections 2023-10-06T11:16:36.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.682+0000 7fbce9155700 1 --2- 172.21.15.146:0/1181399996 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbcd0066f30 0x7fbcd00693e0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.682+0000 7fbce9155700 1 --2- 172.21.15.146:0/1181399996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbce4153e80 0x7fbce4143c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.682+0000 7fbce9155700 1 --2- 172.21.15.146:0/1181399996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbce4068ba0 0x7fbce40c53a0 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.682+0000 7fbce9155700 1 --2- 172.21.15.146:0/1181399996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbce4153ab0 0x7fbce416d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.682+0000 7fbce9155700 1 -- 172.21.15.146:0/1181399996 >> 172.21.15.146:0/1181399996 conn(0x7fbce406eba0 msgr2=0x7fbce40cfda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:36.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.683+0000 7fbce9155700 1 -- 172.21.15.146:0/1181399996 shutdown_connections 2023-10-06T11:16:36.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.683+0000 7fbce9155700 1 -- 172.21.15.146:0/1181399996 wait complete. 2023-10-06T11:16:36.697 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.10:0 scrub start '~mdsdir' recursive 2023-10-06T11:16:36.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.814+0000 7fd470a7f700 1 Processor -- start 2023-10-06T11:16:36.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.815+0000 7fd470a7f700 1 -- start start 2023-10-06T11:16:36.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.815+0000 7fd470a7f700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd46c0b5640 0x7fd46c15a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.815+0000 7fd470a7f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd46c068780 0x7fd46c068c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.815+0000 7fd470a7f700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd46c0cc130 con 0x7fd46c0cb090 2023-10-06T11:16:36.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.815+0000 7fd470a7f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd46c069140 con 0x7fd46c068780 2023-10-06T11:16:36.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.815+0000 7fd470a7f700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd46c0cccd0 con 0x7fd46c0b5640 2023-10-06T11:16:36.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.816+0000 7fd46bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd46c068780 0x7fd46c068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.816+0000 7fd46bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd46c068780 0x7fd46c068c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39410/0 (socket says 172.21.15.146:39410) 2023-10-06T11:16:36.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.816+0000 7fd46bfff700 1 -- 172.21.15.146:0/1731675605 learned_addr learned my addr 172.21.15.146:0/1731675605 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:36.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.816+0000 7fd46b7fe700 1 --2- 172.21.15.146:0/1731675605 >> v2:172.21.15.151:3300/0 conn(0x7fd46c0b5640 0x7fd46c15a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.816+0000 7fd46bfff700 1 -- 172.21.15.146:0/1731675605 >> v2:172.21.15.151:3300/0 conn(0x7fd46c0b5640 msgr2=0x7fd46c15a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:36.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.816+0000 7fd46bfff700 1 --2- 172.21.15.146:0/1731675605 >> v2:172.21.15.151:3300/0 conn(0x7fd46c0b5640 0x7fd46c15a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.816+0000 7fd46bfff700 1 -- 172.21.15.146:0/1731675605 >> v1:172.21.15.151:6789/0 conn(0x7fd46c0cb090 legacy=0x7fd46c0cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:36.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.816+0000 7fd46bfff700 1 -- 172.21.15.146:0/1731675605 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd46c0b2660 con 0x7fd46c068780 2023-10-06T11:16:36.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.816+0000 7fd46bfff700 1 --2- 172.21.15.146:0/1731675605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd46c068780 0x7fd46c068c00 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7fd464009f20 tx=0x7fd464009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9f0339189d6a20 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:36.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.816+0000 7fd46affd700 1 -- 172.21.15.146:0/1731675605 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46400e070 con 0x7fd46c068780 2023-10-06T11:16:36.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.816+0000 7fd46affd700 1 -- 172.21.15.146:0/1731675605 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46400ba00 con 0x7fd46c068780 2023-10-06T11:16:36.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.816+0000 7fd46affd700 1 -- 172.21.15.146:0/1731675605 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4640092e0 con 0x7fd46c068780 2023-10-06T11:16:36.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.817+0000 7fd470a7f700 1 -- 172.21.15.146:0/1731675605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd46c068780 msgr2=0x7fd46c068c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:36.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.817+0000 7fd470a7f700 1 --2- 172.21.15.146:0/1731675605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd46c068780 0x7fd46c068c00 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7fd464009f20 tx=0x7fd464009840 comp rx=0 tx=0).stop 2023-10-06T11:16:36.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.817+0000 7fd470a7f700 1 -- 172.21.15.146:0/1731675605 shutdown_connections 2023-10-06T11:16:36.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.817+0000 7fd470a7f700 1 --2- 172.21.15.146:0/1731675605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd46c068780 0x7fd46c068c00 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.817+0000 7fd470a7f700 1 --2- 172.21.15.146:0/1731675605 >> v2:172.21.15.151:3300/0 conn(0x7fd46c0b5640 0x7fd46c15a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.817+0000 7fd470a7f700 1 -- 172.21.15.146:0/1731675605 >> 172.21.15.146:0/1731675605 conn(0x7fd46c0703f0 msgr2=0x7fd46c0707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:36.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.817+0000 7fd470a7f700 1 -- 172.21.15.146:0/1731675605 shutdown_connections 2023-10-06T11:16:36.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.817+0000 7fd470a7f700 1 -- 172.21.15.146:0/1731675605 wait complete. 2023-10-06T11:16:36.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.818+0000 7fd470a7f700 1 Processor -- start 2023-10-06T11:16:36.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.818+0000 7fd470a7f700 1 -- start start 2023-10-06T11:16:36.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.819+0000 7fd470a7f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd46c068780 0x7fd46c0c9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.819+0000 7fd470a7f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd46c0b5640 0x7fd46c0c4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.819+0000 7fd470a7f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd46c0cb090 0x7fd46c0c4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.819+0000 7fd470a7f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46c1699f0 con 0x7fd46c0cb090 2023-10-06T11:16:36.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.819+0000 7fd470a7f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46c169c00 con 0x7fd46c068780 2023-10-06T11:16:36.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.819+0000 7fd470a7f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd46c169ee0 con 0x7fd46c0b5640 2023-10-06T11:16:36.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.819+0000 7fd46bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd46c0cb090 0x7fd46c0c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.819+0000 7fd46bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd46c0cb090 0x7fd46c0c4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39416/0 (socket says 172.21.15.146:39416) 2023-10-06T11:16:36.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.819+0000 7fd46bfff700 1 -- 172.21.15.146:0/304181511 learned_addr learned my addr 172.21.15.146:0/304181511 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:36.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.819+0000 7fd46b7fe700 1 --2- 172.21.15.146:0/304181511 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd46c068780 0x7fd46c0c9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.819+0000 7fd463fff700 1 --2- 172.21.15.146:0/304181511 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd46c0b5640 0x7fd46c0c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.819+0000 7fd46bfff700 1 -- 172.21.15.146:0/304181511 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd46c0b5640 msgr2=0x7fd46c0c4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:36.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.819+0000 7fd46bfff700 1 --2- 172.21.15.146:0/304181511 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd46c0b5640 0x7fd46c0c4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.819+0000 7fd46bfff700 1 -- 172.21.15.146:0/304181511 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd46c068780 msgr2=0x7fd46c0c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:36.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.819+0000 7fd46bfff700 1 --2- 172.21.15.146:0/304181511 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd46c068780 0x7fd46c0c9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.819+0000 7fd46bfff700 1 -- 172.21.15.146:0/304181511 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd464009ae0 con 0x7fd46c0cb090 2023-10-06T11:16:36.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.819+0000 7fd46bfff700 1 --2- 172.21.15.146:0/304181511 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd46c0cb090 0x7fd46c0c4980 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7fd46c0694f0 tx=0x7fd464017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:36.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.819+0000 7fd4637fe700 1 -- 172.21.15.146:0/304181511 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4640032f0 con 0x7fd46c0cb090 2023-10-06T11:16:36.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.819+0000 7fd4637fe700 1 -- 172.21.15.146:0/304181511 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd464012d00 con 0x7fd46c0cb090 2023-10-06T11:16:36.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.819+0000 7fd4637fe700 1 -- 172.21.15.146:0/304181511 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46401d650 con 0x7fd46c0cb090 2023-10-06T11:16:36.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.819+0000 7fd470a7f700 1 -- 172.21.15.146:0/304181511 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd46c16a1c0 con 0x7fd46c0cb090 2023-10-06T11:16:36.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.819+0000 7fd470a7f700 1 -- 172.21.15.146:0/304181511 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd46c16a780 con 0x7fd46c0cb090 2023-10-06T11:16:36.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.821+0000 7fd4637fe700 1 -- 172.21.15.146:0/304181511 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd46401da80 con 0x7fd46c0cb090 2023-10-06T11:16:36.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.821+0000 7fd4637fe700 1 --2- 172.21.15.146:0/304181511 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd44c066f30 0x7fd44c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.822+0000 7fd4637fe700 1 -- 172.21.15.146:0/304181511 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fd464085f60 con 0x7fd46c0cb090 2023-10-06T11:16:36.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.822+0000 7fd46b7fe700 1 --2- 172.21.15.146:0/304181511 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd44c066f30 0x7fd44c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.822+0000 7fd46b7fe700 1 --2- 172.21.15.146:0/304181511 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd44c066f30 0x7fd44c0693e0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fd45c00acb0 tx=0x7fd45c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:36.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.823+0000 7fd47afd9b80 1 Processor -- start 2023-10-06T11:16:36.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.824+0000 7fd47afd9b80 1 -- start start 2023-10-06T11:16:36.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.824+0000 7fd47afd9b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55af96066a10 0x55af96066de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.824+0000 7fd47afd9b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55af960b0c80 0x55af9608f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.824+0000 7fd47afd9b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55af9608ff20 0x55af96062a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.824+0000 7fd47afd9b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af95fe6d40 con 0x55af960b0c80 2023-10-06T11:16:36.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.824+0000 7fd47afd9b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af95fbdb30 con 0x55af9608ff20 2023-10-06T11:16:36.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.824+0000 7fd47afd9b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55af95fbb330 con 0x55af96066a10 2023-10-06T11:16:36.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.824+0000 7fd463fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55af960b0c80 0x55af9608f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.824+0000 7fd463fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55af960b0c80 0x55af9608f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39424/0 (socket says 172.21.15.146:39424) 2023-10-06T11:16:36.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.824+0000 7fd463fff700 1 -- 172.21.15.146:0/2343600848 learned_addr learned my addr 172.21.15.146:0/2343600848 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:36.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.825+0000 7fd463fff700 1 -- 172.21.15.146:0/2343600848 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55af96066a10 msgr2=0x55af96066de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:36.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.825+0000 7fd463fff700 1 --2- 172.21.15.146:0/2343600848 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55af96066a10 0x55af96066de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.825+0000 7fd463fff700 1 -- 172.21.15.146:0/2343600848 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55af9608ff20 msgr2=0x55af96062a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:36.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.825+0000 7fd463fff700 1 --2- 172.21.15.146:0/2343600848 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55af9608ff20 0x55af96062a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.825+0000 7fd463fff700 1 -- 172.21.15.146:0/2343600848 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55af95e51330 con 0x55af960b0c80 2023-10-06T11:16:36.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.825+0000 7fd463fff700 1 --2- 172.21.15.146:0/2343600848 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55af960b0c80 0x55af9608f9e0 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7fd454009a60 tx=0x7fd454009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d91d0e0f209b6e2d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:36.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.825+0000 7fd460ff9700 1 -- 172.21.15.146:0/2343600848 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45400e8d0 con 0x55af960b0c80 2023-10-06T11:16:36.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.825+0000 7fd460ff9700 1 -- 172.21.15.146:0/2343600848 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd45400ea30 con 0x55af960b0c80 2023-10-06T11:16:36.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.825+0000 7fd460ff9700 1 -- 172.21.15.146:0/2343600848 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45400edd0 con 0x55af960b0c80 2023-10-06T11:16:36.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.825+0000 7fd47afd9b80 1 -- 172.21.15.146:0/2343600848 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55af960b0c80 msgr2=0x55af9608f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:36.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.825+0000 7fd47afd9b80 1 --2- 172.21.15.146:0/2343600848 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55af960b0c80 0x55af9608f9e0 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7fd454009a60 tx=0x7fd454009060 comp rx=0 tx=0).stop 2023-10-06T11:16:36.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.826+0000 7fd47afd9b80 1 -- 172.21.15.146:0/2343600848 shutdown_connections 2023-10-06T11:16:36.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.826+0000 7fd47afd9b80 1 --2- 172.21.15.146:0/2343600848 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55af9608ff20 0x55af96062a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.826+0000 7fd47afd9b80 1 --2- 172.21.15.146:0/2343600848 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55af96066a10 0x55af96066de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.826+0000 7fd47afd9b80 1 --2- 172.21.15.146:0/2343600848 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55af960b0c80 0x55af9608f9e0 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.826+0000 7fd47afd9b80 1 -- 172.21.15.146:0/2343600848 >> 172.21.15.146:0/2343600848 conn(0x55af96068330 msgr2=0x55af96068700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:36.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.826+0000 7fd47afd9b80 1 -- 172.21.15.146:0/2343600848 shutdown_connections 2023-10-06T11:16:36.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.826+0000 7fd47afd9b80 1 -- 172.21.15.146:0/2343600848 wait complete. 2023-10-06T11:16:36.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.826+0000 7fd47afd9b80 1 -- start start 2023-10-06T11:16:36.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.826+0000 7fd47afd9b80 1 Processor -- start 2023-10-06T11:16:36.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.827+0000 7fd47afd9b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55af96066a10 0x55af960aded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.827+0000 7fd47afd9b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55af9608ff20 0x55af960c04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.827+0000 7fd47afd9b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55af960b0c80 0x55af960a5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.827+0000 7fd47afd9b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af95fb7120 con 0x55af96066a10 2023-10-06T11:16:36.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.827+0000 7fd47afd9b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af95f62950 con 0x55af960b0c80 2023-10-06T11:16:36.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.827+0000 7fd47afd9b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55af95f7df60 con 0x55af9608ff20 2023-10-06T11:16:36.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.827+0000 7fd47afd9b80 10 client.0 _ll_register_callbacks cb 0x55af95e53ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:16:36.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.827+0000 7fd46b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55af96066a10 0x55af960aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.827+0000 7fd46b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55af96066a10 0x55af960aded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39426/0 (socket says 172.21.15.146:39426) 2023-10-06T11:16:36.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.827+0000 7fd46b7fe700 1 -- 172.21.15.146:0/687715838 learned_addr learned my addr 172.21.15.146:0/687715838 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:36.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.827+0000 7fd463fff700 1 --2- 172.21.15.146:0/687715838 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55af9608ff20 0x55af960c04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.827+0000 7fd46bfff700 1 --2- 172.21.15.146:0/687715838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55af960b0c80 0x55af960a5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.827+0000 7fd46b7fe700 1 -- 172.21.15.146:0/687715838 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55af9608ff20 msgr2=0x55af960c04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:36.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.827+0000 7fd46b7fe700 1 --2- 172.21.15.146:0/687715838 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55af9608ff20 0x55af960c04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.827+0000 7fd46b7fe700 1 -- 172.21.15.146:0/687715838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55af960b0c80 msgr2=0x55af960a5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:36.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.827+0000 7fd46b7fe700 1 --2- 172.21.15.146:0/687715838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55af960b0c80 0x55af960a5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.827+0000 7fd46b7fe700 1 -- 172.21.15.146:0/687715838 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4540096c0 con 0x55af96066a10 2023-10-06T11:16:36.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.827+0000 7fd46bfff700 1 --2- 172.21.15.146:0/687715838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55af960b0c80 0x55af960a5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:36.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.828+0000 7fd46b7fe700 1 --2- 172.21.15.146:0/687715838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55af96066a10 0x55af960aded0 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7fd45c015b50 tx=0x7fd45c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da5b087c33ab99f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:36.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.828+0000 7fd449ffb700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:16:36.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.828+0000 7fd449ffb700 1 -- 172.21.15.146:0/687715838 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45c0135a0 con 0x55af96066a10 2023-10-06T11:16:36.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.828+0000 7fd449ffb700 1 -- 172.21.15.146:0/687715838 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fd45c013700 con 0x55af96066a10 2023-10-06T11:16:36.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.828+0000 7fd47afd9b80 1 -- 172.21.15.146:0/687715838 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55af9605b750 con 0x55af96066a10 2023-10-06T11:16:36.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.828+0000 7fd449ffb700 1 -- 172.21.15.146:0/687715838 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=121) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd45c013ad0 con 0x55af96066a10 2023-10-06T11:16:36.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.828+0000 7fd47afd9b80 10 client.9423 fetch_fsmap learned FSMap version 121 2023-10-06T11:16:36.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.828+0000 7fd47afd9b80 1 -- 172.21.15.146:0/687715838 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=121,monmap=2+}) v3 -- 0x55af95df40a0 con 0x55af96066a10 2023-10-06T11:16:36.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.828+0000 7fd449ffb700 1 -- 172.21.15.146:0/687715838 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55af9605b750 con 0x55af96066a10 2023-10-06T11:16:36.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.828+0000 7fd449ffb700 1 -- 172.21.15.146:0/687715838 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 121) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd45c013c30 con 0x55af96066a10 2023-10-06T11:16:36.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.828+0000 7fd47afd9b80 10 client.9423 fetch_fsmap finished waiting for FSMap version 121 2023-10-06T11:16:36.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.828+0000 7fd47afd9b80 10 client.9423 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2023-10-06T11:16:36.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.828+0000 7fd47afd9b80 20 client.9423 populate_metadata read hostname 'smithi146' 2023-10-06T11:16:36.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.828+0000 7fd47afd9b80 1 --2- 172.21.15.146:0/687715838 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x55af960c0a10 0x55af960a6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.828+0000 7fd47afd9b80 4 client.9423 mds_command: new command op to 9198 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:16:36.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.828+0000 7fd47afd9b80 1 -- 172.21.15.146:0/687715838 --> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55af96038680 con 0x55af960c0a10 2023-10-06T11:16:36.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.828+0000 7fd463fff700 1 --2- 172.21.15.146:0/687715838 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x55af960c0a10 0x55af960a6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.829+0000 7fd449ffb700 10 client.9423 ms_handle_connect on v2:172.21.15.146:6836/525107449 2023-10-06T11:16:36.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.829+0000 7fd463fff700 1 --2- 172.21.15.146:0/687715838 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x55af960c0a10 0x55af960a6f80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3cb8ca521d1dc4f server_cookie=4e5f258157b372ec in_seq=0 out_seq=0 2023-10-06T11:16:36.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.829+0000 7fd449ffb700 1 -- 172.21.15.146:0/687715838 <== mds.0 v2:172.21.15.146:6836/525107449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55af96038680 con 0x55af960c0a10 2023-10-06T11:16:36.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.829+0000 7fd449ffb700 10 client.9423 handle_command_reply: tid=0 2023-10-06T11:16:36.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.829+0000 7fd47afd9b80 1 client.9423 shutdown 2023-10-06T11:16:36.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.829+0000 7fd47afd9b80 1 -- 172.21.15.146:0/687715838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55af96066a10 msgr2=0x55af960aded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:36.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.829+0000 7fd47afd9b80 1 --2- 172.21.15.146:0/687715838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55af96066a10 0x55af960aded0 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7fd45c015b50 tx=0x7fd45c017000 comp rx=0 tx=0).stop 2023-10-06T11:16:36.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.829+0000 7fd47afd9b80 1 -- 172.21.15.146:0/687715838 shutdown_connections 2023-10-06T11:16:36.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.829+0000 7fd47afd9b80 1 --2- 172.21.15.146:0/687715838 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x55af960c0a10 0x55af960a6f80 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.829+0000 7fd47afd9b80 1 --2- 172.21.15.146:0/687715838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55af960b0c80 0x55af960a5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.829+0000 7fd47afd9b80 1 --2- 172.21.15.146:0/687715838 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55af96066a10 0x55af960aded0 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.829+0000 7fd449ffb700 0 client.9423 ms_handle_reset on v2:172.21.15.146:6836/525107449 2023-10-06T11:16:36.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.829+0000 7fd47afd9b80 1 --2- 172.21.15.146:0/687715838 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55af9608ff20 0x55af960c04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.829+0000 7fd47afd9b80 1 -- 172.21.15.146:0/687715838 >> 172.21.15.146:0/687715838 conn(0x55af96068330 msgr2=0x55af96067260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:36.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.829+0000 7fd47afd9b80 1 -- 172.21.15.146:0/687715838 shutdown_connections 2023-10-06T11:16:36.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.829+0000 7fd47afd9b80 1 -- 172.21.15.146:0/687715838 wait complete. 2023-10-06T11:16:36.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.829+0000 7fd47afd9b80 20 client.9423 trim_cache size 0 max 16384 2023-10-06T11:16:36.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.846+0000 7fd47afd9b80 1 Processor -- start 2023-10-06T11:16:36.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.846+0000 7fd47afd9b80 1 -- start start 2023-10-06T11:16:36.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.846+0000 7fd47afd9b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55af96066a10 0x55af96066fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.846+0000 7fd47afd9b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55af9608ff20 0x55af960674f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.846+0000 7fd47afd9b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55af960b0c80 0x55af9608b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.846+0000 7fd47afd9b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af95e39ef0 con 0x55af9608ff20 2023-10-06T11:16:36.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.846+0000 7fd47afd9b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af960abbf0 con 0x55af96066a10 2023-10-06T11:16:36.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.846+0000 7fd47afd9b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55af960cfa30 con 0x55af960b0c80 2023-10-06T11:16:36.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.846+0000 7fd463fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55af9608ff20 0x55af960674f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.847+0000 7fd463fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55af9608ff20 0x55af960674f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39430/0 (socket says 172.21.15.146:39430) 2023-10-06T11:16:36.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.847+0000 7fd463fff700 1 -- 172.21.15.146:0/1658163975 learned_addr learned my addr 172.21.15.146:0/1658163975 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:36.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.847+0000 7fd463fff700 1 -- 172.21.15.146:0/1658163975 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55af960b0c80 msgr2=0x55af9608b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:36.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.847+0000 7fd463fff700 1 --2- 172.21.15.146:0/1658163975 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55af960b0c80 0x55af9608b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.847+0000 7fd463fff700 1 -- 172.21.15.146:0/1658163975 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55af96066a10 msgr2=0x55af96066fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:36.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.847+0000 7fd463fff700 1 --2- 172.21.15.146:0/1658163975 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55af96066a10 0x55af96066fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.847+0000 7fd463fff700 1 -- 172.21.15.146:0/1658163975 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55af96064aa0 con 0x55af9608ff20 2023-10-06T11:16:36.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.847+0000 7fd463fff700 1 --2- 172.21.15.146:0/1658163975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55af9608ff20 0x55af960674f0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7fd454009290 tx=0x7fd45401e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f22fb6066c07394 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:36.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.847+0000 7fd4617fa700 1 -- 172.21.15.146:0/1658163975 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4540290f0 con 0x55af9608ff20 2023-10-06T11:16:36.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.847+0000 7fd4617fa700 1 -- 172.21.15.146:0/1658163975 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd454022040 con 0x55af9608ff20 2023-10-06T11:16:36.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.847+0000 7fd4617fa700 1 -- 172.21.15.146:0/1658163975 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45400edb0 con 0x55af9608ff20 2023-10-06T11:16:36.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.847+0000 7fd47afd9b80 1 -- 172.21.15.146:0/1658163975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55af9608ff20 msgr2=0x55af960674f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:36.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.847+0000 7fd47afd9b80 1 --2- 172.21.15.146:0/1658163975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55af9608ff20 0x55af960674f0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7fd454009290 tx=0x7fd45401e040 comp rx=0 tx=0).stop 2023-10-06T11:16:36.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.847+0000 7fd47afd9b80 1 -- 172.21.15.146:0/1658163975 shutdown_connections 2023-10-06T11:16:36.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.847+0000 7fd47afd9b80 1 --2- 172.21.15.146:0/1658163975 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55af960b0c80 0x55af9608b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.847+0000 7fd47afd9b80 1 --2- 172.21.15.146:0/1658163975 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55af96066a10 0x55af96066fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.847+0000 7fd47afd9b80 1 --2- 172.21.15.146:0/1658163975 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55af9608ff20 0x55af960674f0 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.847+0000 7fd47afd9b80 1 -- 172.21.15.146:0/1658163975 >> 172.21.15.146:0/1658163975 conn(0x55af96068330 msgr2=0x55af96069d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:36.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.848+0000 7fd47afd9b80 1 -- 172.21.15.146:0/1658163975 shutdown_connections 2023-10-06T11:16:36.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.848+0000 7fd47afd9b80 1 -- 172.21.15.146:0/1658163975 wait complete. 2023-10-06T11:16:36.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.848+0000 7fd47afd9b80 1 -- start start 2023-10-06T11:16:36.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.848+0000 7fd47afd9b80 1 Processor -- start 2023-10-06T11:16:36.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.849+0000 7fd47afd9b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55af96066a10 0x55af96066fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.849+0000 7fd47afd9b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55af9608ff20 0x55af960674f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.849+0000 7fd47afd9b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55af960b0c80 0x55af9608a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.849+0000 7fd47afd9b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af960c35c0 con 0x55af960b0c80 2023-10-06T11:16:36.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.849+0000 7fd47afd9b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af9608c360 con 0x55af9608ff20 2023-10-06T11:16:36.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.849+0000 7fd47afd9b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55af9608b6e0 con 0x55af96066a10 2023-10-06T11:16:36.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.849+0000 7fd47afd9b80 10 client.0 _ll_register_callbacks cb 0x55af95e53ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:16:36.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.849+0000 7fd46bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55af960b0c80 0x55af9608a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.849+0000 7fd46bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55af960b0c80 0x55af9608a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39440/0 (socket says 172.21.15.146:39440) 2023-10-06T11:16:36.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.849+0000 7fd46bfff700 1 -- 172.21.15.146:0/532559182 learned_addr learned my addr 172.21.15.146:0/532559182 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:36.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.849+0000 7fd46b7fe700 1 --2- 172.21.15.146:0/532559182 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55af96066a10 0x55af96066fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.849+0000 7fd463fff700 1 --2- 172.21.15.146:0/532559182 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55af9608ff20 0x55af960674f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.849+0000 7fd46bfff700 1 -- 172.21.15.146:0/532559182 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55af96066a10 msgr2=0x55af96066fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:36.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.849+0000 7fd46bfff700 1 --2- 172.21.15.146:0/532559182 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55af96066a10 0x55af96066fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.849+0000 7fd46bfff700 1 -- 172.21.15.146:0/532559182 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55af9608ff20 msgr2=0x55af960674f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:36.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.849+0000 7fd46bfff700 1 --2- 172.21.15.146:0/532559182 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55af9608ff20 0x55af960674f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.849+0000 7fd46bfff700 1 -- 172.21.15.146:0/532559182 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55af95e51330 con 0x55af960b0c80 2023-10-06T11:16:36.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.849+0000 7fd46b7fe700 1 --2- 172.21.15.146:0/532559182 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55af96066a10 0x55af96066fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:36.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.849+0000 7fd46bfff700 1 --2- 172.21.15.146:0/532559182 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55af960b0c80 0x55af9608a5d0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7fd464015040 tx=0x7fd4640841e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb883fa36e0cf1b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:36.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.849+0000 7fd449ffb700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:16:36.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.850+0000 7fd449ffb700 1 -- 172.21.15.146:0/532559182 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46400e040 con 0x55af960b0c80 2023-10-06T11:16:36.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.850+0000 7fd449ffb700 1 -- 172.21.15.146:0/532559182 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fd464057390 con 0x55af960b0c80 2023-10-06T11:16:36.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.850+0000 7fd47afd9b80 1 -- 172.21.15.146:0/532559182 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd45400ea30 con 0x55af960b0c80 2023-10-06T11:16:36.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.850+0000 7fd449ffb700 1 -- 172.21.15.146:0/532559182 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=121) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd464056c90 con 0x55af960b0c80 2023-10-06T11:16:36.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.850+0000 7fd47afd9b80 10 client.9429 fetch_fsmap learned FSMap version 121 2023-10-06T11:16:36.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.850+0000 7fd47afd9b80 1 -- 172.21.15.146:0/532559182 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=121,monmap=2+}) v3 -- 0x55af96064f70 con 0x55af960b0c80 2023-10-06T11:16:36.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.850+0000 7fd449ffb700 1 -- 172.21.15.146:0/532559182 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd45400ea30 con 0x55af960b0c80 2023-10-06T11:16:36.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.850+0000 7fd449ffb700 1 -- 172.21.15.146:0/532559182 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 121) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd46406e070 con 0x55af960b0c80 2023-10-06T11:16:36.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.850+0000 7fd47afd9b80 10 client.9429 fetch_fsmap finished waiting for FSMap version 121 2023-10-06T11:16:36.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.850+0000 7fd47afd9b80 10 client.9429 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2023-10-06T11:16:36.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.850+0000 7fd47afd9b80 20 client.9429 populate_metadata read hostname 'smithi146' 2023-10-06T11:16:36.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.850+0000 7fd47afd9b80 1 --2- 172.21.15.146:0/532559182 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x55af9610d7d0 0x55af9608ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.850+0000 7fd47afd9b80 4 client.9429 mds_command: new command op to 9198 tid=0[{"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}] 2023-10-06T11:16:36.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.850+0000 7fd47afd9b80 1 -- 172.21.15.146:0/532559182 --> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] -- command(tid 0: {"prefix": "scrub start", "path": "~mdsdir", "scrubops": ["recursive"]}) v1 -- 0x55af95f59ec0 con 0x55af9610d7d0 2023-10-06T11:16:36.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.850+0000 7fd46b7fe700 1 --2- 172.21.15.146:0/532559182 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x55af9610d7d0 0x55af9608ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.850+0000 7fd449ffb700 10 client.9429 ms_handle_connect on v2:172.21.15.146:6836/525107449 2023-10-06T11:16:36.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.850+0000 7fd46b7fe700 1 --2- 172.21.15.146:0/532559182 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x55af9610d7d0 0x55af9608ab10 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a71532a0250d481 server_cookie=160e89fc50d070c4 in_seq=0 out_seq=0 2023-10-06T11:16:36.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.851+0000 7fd449ffb700 1 -- 172.21.15.146:0/532559182 <== mds.0 v2:172.21.15.146:6836/525107449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55af95f59ec0 con 0x55af9610d7d0 2023-10-06T11:16:36.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.851+0000 7fd449ffb700 10 client.9429 handle_command_reply: tid=0 2023-10-06T11:16:36.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.851+0000 7fd47afd9b80 1 client.9429 shutdown 2023-10-06T11:16:36.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.851+0000 7fd47afd9b80 1 -- 172.21.15.146:0/532559182 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55af960b0c80 msgr2=0x55af9608a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:36.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.851+0000 7fd47afd9b80 1 --2- 172.21.15.146:0/532559182 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55af960b0c80 0x55af9608a5d0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7fd464015040 tx=0x7fd4640841e0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.851+0000 7fd47afd9b80 1 -- 172.21.15.146:0/532559182 shutdown_connections 2023-10-06T11:16:36.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.851+0000 7fd47afd9b80 1 --2- 172.21.15.146:0/532559182 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x55af9610d7d0 0x55af9608ab10 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.851+0000 7fd47afd9b80 1 --2- 172.21.15.146:0/532559182 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55af960b0c80 0x55af9608a5d0 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.851+0000 7fd47afd9b80 1 --2- 172.21.15.146:0/532559182 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55af96066a10 0x55af96066fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.851+0000 7fd449ffb700 0 client.9429 ms_handle_reset on v2:172.21.15.146:6836/525107449 2023-10-06T11:16:36.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.851+0000 7fd47afd9b80 1 --2- 172.21.15.146:0/532559182 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55af9608ff20 0x55af960674f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.851+0000 7fd47afd9b80 1 -- 172.21.15.146:0/532559182 >> 172.21.15.146:0/532559182 conn(0x55af96068330 msgr2=0x55af96069d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:36.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.851+0000 7fd47afd9b80 1 -- 172.21.15.146:0/532559182 shutdown_connections 2023-10-06T11:16:36.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.851+0000 7fd47afd9b80 1 -- 172.21.15.146:0/532559182 wait complete. 2023-10-06T11:16:36.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.851+0000 7fd47afd9b80 20 client.9429 trim_cache size 0 max 16384 2023-10-06T11:16:36.863 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:16:36.863 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0, 2023-10-06T11:16:36.863 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_tag": "856ab5b7-d17a-4d5b-af49-36e390c87a8c", 2023-10-06T11:16:36.863 INFO:teuthology.orchestra.run.smithi146.stdout: "mode": "asynchronous" 2023-10-06T11:16:36.863 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:16:36.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.852+0000 7fd470a7f700 1 -- 172.21.15.146:0/304181511 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd44c066f30 msgr2=0x7fd44c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:36.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.852+0000 7fd470a7f700 1 --2- 172.21.15.146:0/304181511 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd44c066f30 0x7fd44c0693e0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fd45c00acb0 tx=0x7fd45c008040 comp rx=0 tx=0).stop 2023-10-06T11:16:36.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.852+0000 7fd470a7f700 1 -- 172.21.15.146:0/304181511 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd46c0cb090 msgr2=0x7fd46c0c4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:36.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.852+0000 7fd470a7f700 1 --2- 172.21.15.146:0/304181511 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd46c0cb090 0x7fd46c0c4980 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7fd46c0694f0 tx=0x7fd464017000 comp rx=0 tx=0).stop 2023-10-06T11:16:36.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.852+0000 7fd470a7f700 1 -- 172.21.15.146:0/304181511 shutdown_connections 2023-10-06T11:16:36.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.852+0000 7fd470a7f700 1 --2- 172.21.15.146:0/304181511 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd44c066f30 0x7fd44c0693e0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.852+0000 7fd470a7f700 1 --2- 172.21.15.146:0/304181511 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd46c0cb090 0x7fd46c0c4980 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.852+0000 7fd470a7f700 1 --2- 172.21.15.146:0/304181511 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd46c068780 0x7fd46c0c9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.852+0000 7fd470a7f700 1 --2- 172.21.15.146:0/304181511 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd46c0b5640 0x7fd46c0c4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.852+0000 7fd470a7f700 1 -- 172.21.15.146:0/304181511 >> 172.21.15.146:0/304181511 conn(0x7fd46c0703f0 msgr2=0x7fd46c15b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:36.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.852+0000 7fd470a7f700 1 -- 172.21.15.146:0/304181511 shutdown_connections 2023-10-06T11:16:36.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.852+0000 7fd470a7f700 1 -- 172.21.15.146:0/304181511 wait complete. 2023-10-06T11:16:36.867 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.10:0 scrub status 2023-10-06T11:16:36.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.981+0000 7fc01245d700 1 Processor -- start 2023-10-06T11:16:36.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.981+0000 7fc01245d700 1 -- start start 2023-10-06T11:16:36.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.982+0000 7fc01245d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc00c068780 0x7fc00c068b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.982+0000 7fc01245d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc00c0cc130 con 0x7fc00c0b5640 2023-10-06T11:16:36.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.982+0000 7fc01245d700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc00c0cccd0 con 0x7fc00c0cb090 2023-10-06T11:16:36.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.982+0000 7fc01245d700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c0b2660 con 0x7fc00c068780 2023-10-06T11:16:36.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.982+0000 7fc01145b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc00c0b5640 0x7fc00c15a870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:50500/0 (socket says 172.21.15.146:50500) 2023-10-06T11:16:36.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.982+0000 7fc01145b700 1 -- 172.21.15.146:0/2020531111 learned_addr learned my addr 172.21.15.146:0/2020531111 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:16:36.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.982+0000 7fc011c5c700 1 --2- 172.21.15.146:0/2020531111 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc00c068780 0x7fc00c068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.982+0000 7fc003fff700 1 -- 172.21.15.146:0/2020531111 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3445592741 0 0) 0x7fc00c0cc130 con 0x7fc00c0b5640 2023-10-06T11:16:36.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.982+0000 7fc003fff700 1 -- 172.21.15.146:0/2020531111 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbff8003570 con 0x7fc00c0b5640 2023-10-06T11:16:36.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.983+0000 7fc003fff700 1 -- 172.21.15.146:0/2020531111 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2323393967 0 0) 0x7fc00c0cccd0 con 0x7fc00c0cb090 2023-10-06T11:16:36.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.983+0000 7fc003fff700 1 -- 172.21.15.146:0/2020531111 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc00c0cc130 con 0x7fc00c0cb090 2023-10-06T11:16:36.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.983+0000 7fc011c5c700 1 -- 172.21.15.146:0/2020531111 >> v1:172.21.15.151:6789/0 conn(0x7fc00c0cb090 legacy=0x7fc00c0cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:36.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.983+0000 7fc011c5c700 1 -- 172.21.15.146:0/2020531111 >> v1:172.21.15.146:6789/0 conn(0x7fc00c0b5640 legacy=0x7fc00c15a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:36.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.983+0000 7fc003fff700 1 -- 172.21.15.146:0/2020531111 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3338235512 0 0) 0x7fbff8003570 con 0x7fc00c0b5640 2023-10-06T11:16:36.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.983+0000 7fc011c5c700 1 -- 172.21.15.146:0/2020531111 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc00c0690d0 con 0x7fc00c068780 2023-10-06T11:16:36.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.983+0000 7fc011c5c700 1 --2- 172.21.15.146:0/2020531111 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc00c068780 0x7fc00c068b90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc008009910 tx=0x7fc0080091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b96b7c3f99bbeca server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:36.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.983+0000 7fc003fff700 1 -- 172.21.15.146:0/2020531111 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0040017f0 con 0x7fc00c068780 2023-10-06T11:16:36.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.983+0000 7fc003fff700 1 -- 172.21.15.146:0/2020531111 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc008011420 con 0x7fc00c068780 2023-10-06T11:16:36.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.983+0000 7fc003fff700 1 -- 172.21.15.146:0/2020531111 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0080117c0 con 0x7fc00c068780 2023-10-06T11:16:36.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.983+0000 7fc01245d700 1 -- 172.21.15.146:0/2020531111 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc00c068780 msgr2=0x7fc00c068b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:36.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.983+0000 7fc01245d700 1 --2- 172.21.15.146:0/2020531111 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc00c068780 0x7fc00c068b90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc008009910 tx=0x7fc0080091a0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.983+0000 7fc01245d700 1 -- 172.21.15.146:0/2020531111 shutdown_connections 2023-10-06T11:16:36.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.983+0000 7fc01245d700 1 --2- 172.21.15.146:0/2020531111 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc00c068780 0x7fc00c068b90 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.983+0000 7fc01245d700 1 -- 172.21.15.146:0/2020531111 >> 172.21.15.146:0/2020531111 conn(0x7fc00c0703f0 msgr2=0x7fc00c0707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:36.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.984+0000 7fc01245d700 1 -- 172.21.15.146:0/2020531111 shutdown_connections 2023-10-06T11:16:36.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.984+0000 7fc01245d700 1 -- 172.21.15.146:0/2020531111 wait complete. 2023-10-06T11:16:36.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.985+0000 7fc01245d700 1 Processor -- start 2023-10-06T11:16:36.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.985+0000 7fc01245d700 1 -- start start 2023-10-06T11:16:36.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.985+0000 7fc01245d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc00c068780 0x7fc00c145c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.986+0000 7fc01245d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc00c0b5640 0x7fc00c169da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.986+0000 7fc01245d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc00c0cb090 0x7fc00c0b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.986+0000 7fc01245d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c0c8cc0 con 0x7fc00c068780 2023-10-06T11:16:36.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.986+0000 7fc01245d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c0c3a80 con 0x7fc00c0b5640 2023-10-06T11:16:36.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.986+0000 7fc01245d700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c146140 con 0x7fc00c0cb090 2023-10-06T11:16:36.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.986+0000 7fc01145b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc00c068780 0x7fc00c145c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.986+0000 7fc01145b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc00c068780 0x7fc00c145c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39454/0 (socket says 172.21.15.146:39454) 2023-10-06T11:16:36.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.986+0000 7fc01145b700 1 -- 172.21.15.146:0/3957825665 learned_addr learned my addr 172.21.15.146:0/3957825665 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:36.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.986+0000 7fc011c5c700 1 --2- 172.21.15.146:0/3957825665 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc00c0cb090 0x7fc00c0b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.986+0000 7fc010c5a700 1 --2- 172.21.15.146:0/3957825665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc00c0b5640 0x7fc00c169da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.986+0000 7fc01145b700 1 -- 172.21.15.146:0/3957825665 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc00c0cb090 msgr2=0x7fc00c0b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:36.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.986+0000 7fc01145b700 1 --2- 172.21.15.146:0/3957825665 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc00c0cb090 0x7fc00c0b48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.986+0000 7fc01145b700 1 -- 172.21.15.146:0/3957825665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc00c0b5640 msgr2=0x7fc00c169da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:36.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.986+0000 7fc01145b700 1 --2- 172.21.15.146:0/3957825665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc00c0b5640 0x7fc00c169da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:36.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.986+0000 7fc01145b700 1 -- 172.21.15.146:0/3957825665 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc008009420 con 0x7fc00c068780 2023-10-06T11:16:36.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.986+0000 7fc011c5c700 1 --2- 172.21.15.146:0/3957825665 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc00c0cb090 0x7fc00c0b48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:36.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.986+0000 7fc010c5a700 1 --2- 172.21.15.146:0/3957825665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc00c0b5640 0x7fc00c169da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:36.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.986+0000 7fc01145b700 1 --2- 172.21.15.146:0/3957825665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc00c068780 0x7fc00c145c00 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7fc00400cca0 tx=0x7fc004007da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:36.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.986+0000 7fc0017fa700 1 -- 172.21.15.146:0/3957825665 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc004004dc0 con 0x7fc00c068780 2023-10-06T11:16:36.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.986+0000 7fc0017fa700 1 -- 172.21.15.146:0/3957825665 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc00400a920 con 0x7fc00c068780 2023-10-06T11:16:36.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.986+0000 7fc0017fa700 1 -- 172.21.15.146:0/3957825665 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00400ace0 con 0x7fc00c068780 2023-10-06T11:16:36.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.986+0000 7fc01245d700 1 -- 172.21.15.146:0/3957825665 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc00c0cf710 con 0x7fc00c068780 2023-10-06T11:16:36.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.986+0000 7fc01245d700 1 -- 172.21.15.146:0/3957825665 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc00c0cfcd0 con 0x7fc00c068780 2023-10-06T11:16:36.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.988+0000 7fc0017fa700 1 -- 172.21.15.146:0/3957825665 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc004007360 con 0x7fc00c068780 2023-10-06T11:16:36.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.988+0000 7fc0017fa700 1 --2- 172.21.15.146:0/3957825665 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbff0066f30 0x7fbff00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:36.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.988+0000 7fc0017fa700 1 -- 172.21.15.146:0/3957825665 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fc004083e70 con 0x7fc00c068780 2023-10-06T11:16:36.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.988+0000 7fc010c5a700 1 --2- 172.21.15.146:0/3957825665 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbff0066f30 0x7fbff00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:36.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.988+0000 7fc010c5a700 1 --2- 172.21.15.146:0/3957825665 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbff0066f30 0x7fbff00693e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fc00c166f70 tx=0x7fbffc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:37.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.990+0000 7fc01c9b7b80 1 Processor -- start 2023-10-06T11:16:37.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.990+0000 7fc01c9b7b80 1 -- start start 2023-10-06T11:16:37.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.991+0000 7fc01c9b7b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639a69459a0 0x5639a6945d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:37.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.991+0000 7fc01c9b7b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5639a698fc10 0x5639a696e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:37.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.991+0000 7fc01c9b7b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5639a696eeb0 0x5639a69419e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:37.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.991+0000 7fc01c9b7b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639a68c5cd0 con 0x5639a69459a0 2023-10-06T11:16:37.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.991+0000 7fc01c9b7b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639a689cac0 con 0x5639a696eeb0 2023-10-06T11:16:37.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.991+0000 7fc01c9b7b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5639a689a2c0 con 0x5639a698fc10 2023-10-06T11:16:37.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.991+0000 7fc01145b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639a69459a0 0x5639a6945d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:37.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.991+0000 7fc01145b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639a69459a0 0x5639a6945d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39468/0 (socket says 172.21.15.146:39468) 2023-10-06T11:16:37.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.991+0000 7fc01145b700 1 -- 172.21.15.146:0/3153634239 learned_addr learned my addr 172.21.15.146:0/3153634239 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:37.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.991+0000 7fc011c5c700 1 --2- 172.21.15.146:0/3153634239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5639a696eeb0 0x5639a69419e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:37.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.991+0000 7fc010c5a700 1 --2- 172.21.15.146:0/3153634239 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5639a698fc10 0x5639a696e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:37.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.991+0000 7fc01145b700 1 -- 172.21.15.146:0/3153634239 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5639a698fc10 msgr2=0x5639a696e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:37.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.991+0000 7fc01145b700 1 --2- 172.21.15.146:0/3153634239 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5639a698fc10 0x5639a696e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.991+0000 7fc01145b700 1 -- 172.21.15.146:0/3153634239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5639a696eeb0 msgr2=0x5639a69419e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:37.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.991+0000 7fc01145b700 1 --2- 172.21.15.146:0/3153634239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5639a696eeb0 0x5639a69419e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.991+0000 7fc01145b700 1 -- 172.21.15.146:0/3153634239 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5639a67302c0 con 0x5639a69459a0 2023-10-06T11:16:37.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.991+0000 7fc010c5a700 1 --2- 172.21.15.146:0/3153634239 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5639a698fc10 0x5639a696e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:37.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.991+0000 7fc011c5c700 1 --2- 172.21.15.146:0/3153634239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5639a696eeb0 0x5639a69419e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:16:37.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.991+0000 7fc01145b700 1 --2- 172.21.15.146:0/3153634239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639a69459a0 0x5639a6945d70 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7fc004000f80 tx=0x7fc004009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d61478745bb70a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:37.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.991+0000 7fbff67fc700 1 -- 172.21.15.146:0/3153634239 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc004055380 con 0x5639a69459a0 2023-10-06T11:16:37.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.991+0000 7fbff67fc700 1 -- 172.21.15.146:0/3153634239 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc004054c80 con 0x5639a69459a0 2023-10-06T11:16:37.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.991+0000 7fbff67fc700 1 -- 172.21.15.146:0/3153634239 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc004057ed0 con 0x5639a69459a0 2023-10-06T11:16:37.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.992+0000 7fc01c9b7b80 1 -- 172.21.15.146:0/3153634239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639a69459a0 msgr2=0x5639a6945d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:37.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.992+0000 7fc01c9b7b80 1 --2- 172.21.15.146:0/3153634239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639a69459a0 0x5639a6945d70 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7fc004000f80 tx=0x7fc004009040 comp rx=0 tx=0).stop 2023-10-06T11:16:37.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.992+0000 7fc01c9b7b80 1 -- 172.21.15.146:0/3153634239 shutdown_connections 2023-10-06T11:16:37.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.992+0000 7fc01c9b7b80 1 --2- 172.21.15.146:0/3153634239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5639a696eeb0 0x5639a69419e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.992+0000 7fc01c9b7b80 1 --2- 172.21.15.146:0/3153634239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639a69459a0 0x5639a6945d70 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.992+0000 7fc01c9b7b80 1 --2- 172.21.15.146:0/3153634239 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5639a698fc10 0x5639a696e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.992+0000 7fc01c9b7b80 1 -- 172.21.15.146:0/3153634239 >> 172.21.15.146:0/3153634239 conn(0x5639a69472c0 msgr2=0x5639a6947690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:37.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.992+0000 7fc01c9b7b80 1 -- 172.21.15.146:0/3153634239 shutdown_connections 2023-10-06T11:16:37.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.992+0000 7fc01c9b7b80 1 -- 172.21.15.146:0/3153634239 wait complete. 2023-10-06T11:16:37.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.992+0000 7fc01c9b7b80 1 -- start start 2023-10-06T11:16:37.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.993+0000 7fc01c9b7b80 1 Processor -- start 2023-10-06T11:16:37.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.993+0000 7fc01c9b7b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5639a69459a0 0x5639a6983b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:37.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.993+0000 7fc01c9b7b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639a696eeb0 0x5639a693c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:37.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.993+0000 7fc01c9b7b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5639a698fc10 0x5639a693c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:37.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.994+0000 7fc01c9b7b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639a68960b0 con 0x5639a696eeb0 2023-10-06T11:16:37.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.994+0000 7fc01c9b7b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639a68418e0 con 0x5639a69459a0 2023-10-06T11:16:37.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.994+0000 7fc01c9b7b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5639a685cef0 con 0x5639a698fc10 2023-10-06T11:16:37.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.994+0000 7fc01c9b7b80 10 client.0 _ll_register_callbacks cb 0x5639a6732f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:16:37.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.994+0000 7fc010c5a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639a696eeb0 0x5639a693c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:37.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.994+0000 7fc010c5a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639a696eeb0 0x5639a693c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39484/0 (socket says 172.21.15.146:39484) 2023-10-06T11:16:37.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.994+0000 7fc010c5a700 1 -- 172.21.15.146:0/2004085176 learned_addr learned my addr 172.21.15.146:0/2004085176 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:37.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.994+0000 7fc011c5c700 1 --2- 172.21.15.146:0/2004085176 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5639a698fc10 0x5639a693c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:37.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.994+0000 7fc01145b700 1 --2- 172.21.15.146:0/2004085176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5639a69459a0 0x5639a6983b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:37.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.994+0000 7fc010c5a700 1 -- 172.21.15.146:0/2004085176 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5639a698fc10 msgr2=0x5639a693c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:37.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.994+0000 7fc010c5a700 1 --2- 172.21.15.146:0/2004085176 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5639a698fc10 0x5639a693c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.994+0000 7fc010c5a700 1 -- 172.21.15.146:0/2004085176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5639a69459a0 msgr2=0x5639a6983b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:37.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.994+0000 7fc010c5a700 1 --2- 172.21.15.146:0/2004085176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5639a69459a0 0x5639a6983b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.994+0000 7fc010c5a700 1 -- 172.21.15.146:0/2004085176 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc00c0cfcd0 con 0x5639a696eeb0 2023-10-06T11:16:37.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.994+0000 7fc010c5a700 1 --2- 172.21.15.146:0/2004085176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639a696eeb0 0x5639a693c1f0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fbffc00ee00 tx=0x7fbffc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1817a26b0ef20e4b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:37.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.994+0000 7fbfeb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:16:37.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.994+0000 7fbfeb7fe700 1 -- 172.21.15.146:0/2004085176 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc013b90 con 0x5639a696eeb0 2023-10-06T11:16:37.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.994+0000 7fbfeb7fe700 1 -- 172.21.15.146:0/2004085176 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fbffc01b070 con 0x5639a696eeb0 2023-10-06T11:16:37.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.994+0000 7fc01c9b7b80 1 -- 172.21.15.146:0/2004085176 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5639a693a6e0 con 0x5639a696eeb0 2023-10-06T11:16:37.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.994+0000 7fbfeb7fe700 1 -- 172.21.15.146:0/2004085176 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=121) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbffc021400 con 0x5639a696eeb0 2023-10-06T11:16:37.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.994+0000 7fc01c9b7b80 10 client.9441 fetch_fsmap learned FSMap version 121 2023-10-06T11:16:37.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.994+0000 7fc01c9b7b80 1 -- 172.21.15.146:0/2004085176 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=121,monmap=2+}) v3 -- 0x5639a66d3030 con 0x5639a696eeb0 2023-10-06T11:16:37.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.994+0000 7fbfeb7fe700 1 -- 172.21.15.146:0/2004085176 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5639a693a6e0 con 0x5639a696eeb0 2023-10-06T11:16:37.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.995+0000 7fbfeb7fe700 1 -- 172.21.15.146:0/2004085176 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 121) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fbffc021560 con 0x5639a696eeb0 2023-10-06T11:16:37.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.995+0000 7fc01c9b7b80 10 client.9441 fetch_fsmap finished waiting for FSMap version 121 2023-10-06T11:16:37.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.995+0000 7fc01c9b7b80 10 client.9441 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2023-10-06T11:16:37.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.995+0000 7fc01c9b7b80 20 client.9441 populate_metadata read hostname 'smithi146' 2023-10-06T11:16:37.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.995+0000 7fc01c9b7b80 1 --2- 172.21.15.146:0/2004085176 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x5639a6984070 0x5639a696d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:37.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.995+0000 7fc01c9b7b80 4 client.9441 mds_command: new command op to 9198 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:16:37.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.995+0000 7fc01c9b7b80 1 -- 172.21.15.146:0/2004085176 --> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5639a6917610 con 0x5639a6984070 2023-10-06T11:16:37.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.995+0000 7fc01145b700 1 --2- 172.21.15.146:0/2004085176 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x5639a6984070 0x5639a696d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:37.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.995+0000 7fbfeb7fe700 10 client.9441 ms_handle_connect on v2:172.21.15.146:6836/525107449 2023-10-06T11:16:37.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.995+0000 7fc01145b700 1 --2- 172.21.15.146:0/2004085176 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x5639a6984070 0x5639a696d550 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cea3f7c72333d8f9 server_cookie=dc9671e0bfc7877 in_seq=0 out_seq=0 2023-10-06T11:16:37.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.995+0000 7fbfeb7fe700 1 -- 172.21.15.146:0/2004085176 <== mds.0 v2:172.21.15.146:6836/525107449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5639a6917610 con 0x5639a6984070 2023-10-06T11:16:37.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.995+0000 7fbfeb7fe700 10 client.9441 handle_command_reply: tid=0 2023-10-06T11:16:37.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.996+0000 7fc01c9b7b80 1 client.9441 shutdown 2023-10-06T11:16:37.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.996+0000 7fc01c9b7b80 1 -- 172.21.15.146:0/2004085176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639a696eeb0 msgr2=0x5639a693c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:37.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.996+0000 7fc01c9b7b80 1 --2- 172.21.15.146:0/2004085176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639a696eeb0 0x5639a693c1f0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fbffc00ee00 tx=0x7fbffc014000 comp rx=0 tx=0).stop 2023-10-06T11:16:37.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.996+0000 7fc01c9b7b80 1 -- 172.21.15.146:0/2004085176 shutdown_connections 2023-10-06T11:16:37.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.996+0000 7fc01c9b7b80 1 --2- 172.21.15.146:0/2004085176 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x5639a6984070 0x5639a696d550 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.996+0000 7fc01c9b7b80 1 --2- 172.21.15.146:0/2004085176 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5639a698fc10 0x5639a693c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.996+0000 7fbfeb7fe700 0 client.9441 ms_handle_reset on v2:172.21.15.146:6836/525107449 2023-10-06T11:16:37.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.996+0000 7fc01c9b7b80 1 --2- 172.21.15.146:0/2004085176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5639a69459a0 0x5639a6983b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.996+0000 7fc01c9b7b80 1 --2- 172.21.15.146:0/2004085176 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639a696eeb0 0x5639a693c1f0 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.996+0000 7fc01c9b7b80 1 -- 172.21.15.146:0/2004085176 >> 172.21.15.146:0/2004085176 conn(0x5639a69472c0 msgr2=0x5639a69461f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:37.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.996+0000 7fc01c9b7b80 1 -- 172.21.15.146:0/2004085176 shutdown_connections 2023-10-06T11:16:37.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.996+0000 7fc01c9b7b80 1 -- 172.21.15.146:0/2004085176 wait complete. 2023-10-06T11:16:37.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:36.996+0000 7fc01c9b7b80 20 client.9441 trim_cache size 0 max 16384 2023-10-06T11:16:37.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.012+0000 7fc01c9b7b80 1 Processor -- start 2023-10-06T11:16:37.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.012+0000 7fc01c9b7b80 1 -- start start 2023-10-06T11:16:37.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.013+0000 7fc01c9b7b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5639a69459a0 0x5639a696d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:37.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.013+0000 7fc01c9b7b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639a696eeb0 0x5639a69870e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:37.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.013+0000 7fc01c9b7b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5639a698fc10 0x5639a6989760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:37.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.013+0000 7fc01c9b7b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639a6944c90 con 0x5639a696eeb0 2023-10-06T11:16:37.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.013+0000 7fc01c9b7b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639a6718e80 con 0x5639a698fc10 2023-10-06T11:16:37.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.013+0000 7fc01c9b7b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5639a6947690 con 0x5639a69459a0 2023-10-06T11:16:37.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.013+0000 7fc010c5a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639a696eeb0 0x5639a69870e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:37.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.013+0000 7fc010c5a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639a696eeb0 0x5639a69870e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39498/0 (socket says 172.21.15.146:39498) 2023-10-06T11:16:37.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.013+0000 7fc010c5a700 1 -- 172.21.15.146:0/3305611621 learned_addr learned my addr 172.21.15.146:0/3305611621 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:37.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.013+0000 7fc011c5c700 1 --2- 172.21.15.146:0/3305611621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5639a698fc10 0x5639a6989760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:37.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.013+0000 7fc01145b700 1 --2- 172.21.15.146:0/3305611621 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5639a69459a0 0x5639a696d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:37.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.013+0000 7fc010c5a700 1 -- 172.21.15.146:0/3305611621 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5639a69459a0 msgr2=0x5639a696d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:37.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.013+0000 7fc010c5a700 1 --2- 172.21.15.146:0/3305611621 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5639a69459a0 0x5639a696d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.013+0000 7fc010c5a700 1 -- 172.21.15.146:0/3305611621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5639a698fc10 msgr2=0x5639a6989760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:37.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.013+0000 7fc010c5a700 1 --2- 172.21.15.146:0/3305611621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5639a698fc10 0x5639a6989760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.013+0000 7fc010c5a700 1 -- 172.21.15.146:0/3305611621 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5639a68647d0 con 0x5639a696eeb0 2023-10-06T11:16:37.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.013+0000 7fc010c5a700 1 --2- 172.21.15.146:0/3305611621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639a696eeb0 0x5639a69870e0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7fbffc007980 tx=0x7fbffc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4891e4caa2411312 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:37.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.014+0000 7fbff6ffd700 1 -- 172.21.15.146:0/3305611621 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc021a70 con 0x5639a696eeb0 2023-10-06T11:16:37.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.014+0000 7fbff6ffd700 1 -- 172.21.15.146:0/3305611621 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbffc000c30 con 0x5639a696eeb0 2023-10-06T11:16:37.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.014+0000 7fbff6ffd700 1 -- 172.21.15.146:0/3305611621 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc003090 con 0x5639a696eeb0 2023-10-06T11:16:37.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.014+0000 7fc01c9b7b80 1 -- 172.21.15.146:0/3305611621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639a696eeb0 msgr2=0x5639a69870e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:37.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.014+0000 7fc01c9b7b80 1 --2- 172.21.15.146:0/3305611621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639a696eeb0 0x5639a69870e0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7fbffc007980 tx=0x7fbffc019000 comp rx=0 tx=0).stop 2023-10-06T11:16:37.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.014+0000 7fc01c9b7b80 1 -- 172.21.15.146:0/3305611621 shutdown_connections 2023-10-06T11:16:37.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.014+0000 7fc01c9b7b80 1 --2- 172.21.15.146:0/3305611621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5639a698fc10 0x5639a6989760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.014+0000 7fc01c9b7b80 1 --2- 172.21.15.146:0/3305611621 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5639a69459a0 0x5639a696d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.014+0000 7fc01c9b7b80 1 --2- 172.21.15.146:0/3305611621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639a696eeb0 0x5639a69870e0 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.014+0000 7fc01c9b7b80 1 -- 172.21.15.146:0/3305611621 >> 172.21.15.146:0/3305611621 conn(0x5639a69472c0 msgr2=0x5639a6943760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:37.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.014+0000 7fc01c9b7b80 1 -- 172.21.15.146:0/3305611621 shutdown_connections 2023-10-06T11:16:37.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.014+0000 7fc01c9b7b80 1 -- 172.21.15.146:0/3305611621 wait complete. 2023-10-06T11:16:37.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.015+0000 7fc01c9b7b80 1 -- start start 2023-10-06T11:16:37.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.015+0000 7fc01c9b7b80 1 Processor -- start 2023-10-06T11:16:37.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.016+0000 7fc01c9b7b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639a69459a0 0x5639a6989760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:37.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.016+0000 7fc01c9b7b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5639a696eeb0 0x5639a6989ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:37.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.016+0000 7fc01c9b7b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5639a698fc10 0x5639a69a5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:37.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.016+0000 7fc01c9b7b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639a69893d0 con 0x5639a69459a0 2023-10-06T11:16:37.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.016+0000 7fc01c9b7b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639a6987320 con 0x5639a698fc10 2023-10-06T11:16:37.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.016+0000 7fc01c9b7b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5639a699ec40 con 0x5639a696eeb0 2023-10-06T11:16:37.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.016+0000 7fc01c9b7b80 10 client.0 _ll_register_callbacks cb 0x5639a6732f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:16:37.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.016+0000 7fc01145b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639a69459a0 0x5639a6989760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:37.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.016+0000 7fc01145b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639a69459a0 0x5639a6989760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:39506/0 (socket says 172.21.15.146:39506) 2023-10-06T11:16:37.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.016+0000 7fc01145b700 1 -- 172.21.15.146:0/866980239 learned_addr learned my addr 172.21.15.146:0/866980239 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:16:37.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.016+0000 7fc011c5c700 1 --2- 172.21.15.146:0/866980239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5639a698fc10 0x5639a69a5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:37.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.016+0000 7fc01145b700 1 -- 172.21.15.146:0/866980239 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5639a696eeb0 msgr2=0x5639a6989ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:37.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.016+0000 7fc010c5a700 1 --2- 172.21.15.146:0/866980239 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5639a696eeb0 0x5639a6989ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:37.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.016+0000 7fc01145b700 1 --2- 172.21.15.146:0/866980239 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5639a696eeb0 0x5639a6989ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.016+0000 7fc01145b700 1 -- 172.21.15.146:0/866980239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5639a698fc10 msgr2=0x5639a69a5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:16:37.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.016+0000 7fc01145b700 1 --2- 172.21.15.146:0/866980239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5639a698fc10 0x5639a69a5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.016+0000 7fc01145b700 1 -- 172.21.15.146:0/866980239 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5639a66d3030 con 0x5639a69459a0 2023-10-06T11:16:37.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.016+0000 7fc01145b700 1 --2- 172.21.15.146:0/866980239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639a69459a0 0x5639a6989760 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fc004000f80 tx=0x7fc004069040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd243e6ff870cfb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:16:37.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.016+0000 7fbfeb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:16:37.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.016+0000 7fbfeb7fe700 1 -- 172.21.15.146:0/866980239 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc004055380 con 0x5639a69459a0 2023-10-06T11:16:37.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.016+0000 7fbfeb7fe700 1 -- 172.21.15.146:0/866980239 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fc00405bc20 con 0x5639a69459a0 2023-10-06T11:16:37.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.016+0000 7fc01c9b7b80 1 -- 172.21.15.146:0/866980239 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc004054c80 con 0x5639a69459a0 2023-10-06T11:16:37.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.016+0000 7fbfeb7fe700 1 -- 172.21.15.146:0/866980239 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=121) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc004057ed0 con 0x5639a69459a0 2023-10-06T11:16:37.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.017+0000 7fc01c9b7b80 10 client.9447 fetch_fsmap learned FSMap version 121 2023-10-06T11:16:37.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.017+0000 7fc01c9b7b80 1 -- 172.21.15.146:0/866980239 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=121,monmap=2+}) v3 -- 0x5639a684b4c0 con 0x5639a69459a0 2023-10-06T11:16:37.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.017+0000 7fbfeb7fe700 1 -- 172.21.15.146:0/866980239 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc004054c80 con 0x5639a69459a0 2023-10-06T11:16:37.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.017+0000 7fbfeb7fe700 1 -- 172.21.15.146:0/866980239 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 121) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc004067120 con 0x5639a69459a0 2023-10-06T11:16:37.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.017+0000 7fc01c9b7b80 10 client.9447 fetch_fsmap finished waiting for FSMap version 121 2023-10-06T11:16:37.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.017+0000 7fc01c9b7b80 10 client.9447 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2023-10-06T11:16:37.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.017+0000 7fc01c9b7b80 20 client.9447 populate_metadata read hostname 'smithi146' 2023-10-06T11:16:37.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.017+0000 7fc01c9b7b80 1 --2- 172.21.15.146:0/866980239 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x5639a69f1850 0x5639a69a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:16:37.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.017+0000 7fc01c9b7b80 4 client.9447 mds_command: new command op to 9198 tid=0[{"prefix": "scrub status"}] 2023-10-06T11:16:37.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.017+0000 7fc01c9b7b80 1 -- 172.21.15.146:0/866980239 --> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5639a6838e50 con 0x5639a69f1850 2023-10-06T11:16:37.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.017+0000 7fc010c5a700 1 --2- 172.21.15.146:0/866980239 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x5639a69f1850 0x5639a69a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:16:37.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.017+0000 7fbfeb7fe700 10 client.9447 ms_handle_connect on v2:172.21.15.146:6836/525107449 2023-10-06T11:16:37.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.017+0000 7fc010c5a700 1 --2- 172.21.15.146:0/866980239 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x5639a69f1850 0x5639a69a58d0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d999d27c1d2ffd2f server_cookie=172c04a1b9189640 in_seq=0 out_seq=0 2023-10-06T11:16:37.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.017+0000 7fbfeb7fe700 1 -- 172.21.15.146:0/866980239 <== mds.0 v2:172.21.15.146:6836/525107449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+257 (crc 0 0 0) 0x5639a6838e50 con 0x5639a69f1850 2023-10-06T11:16:37.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.017+0000 7fbfeb7fe700 10 client.9447 handle_command_reply: tid=0 2023-10-06T11:16:37.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.017+0000 7fc01c9b7b80 1 client.9447 shutdown 2023-10-06T11:16:37.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.018+0000 7fc01c9b7b80 1 -- 172.21.15.146:0/866980239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639a69459a0 msgr2=0x5639a6989760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:37.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.018+0000 7fc01c9b7b80 1 --2- 172.21.15.146:0/866980239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639a69459a0 0x5639a6989760 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fc004000f80 tx=0x7fc004069040 comp rx=0 tx=0).stop 2023-10-06T11:16:37.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.018+0000 7fc01c9b7b80 1 -- 172.21.15.146:0/866980239 shutdown_connections 2023-10-06T11:16:37.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.018+0000 7fc01c9b7b80 1 --2- 172.21.15.146:0/866980239 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x5639a69f1850 0x5639a69a58d0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.018+0000 7fc01c9b7b80 1 --2- 172.21.15.146:0/866980239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5639a698fc10 0x5639a69a5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.018+0000 7fc01c9b7b80 1 --2- 172.21.15.146:0/866980239 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5639a69459a0 0x5639a6989760 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.018+0000 7fc01c9b7b80 1 --2- 172.21.15.146:0/866980239 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5639a696eeb0 0x5639a6989ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.018+0000 7fbfeb7fe700 0 client.9447 ms_handle_reset on v2:172.21.15.146:6836/525107449 2023-10-06T11:16:37.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.018+0000 7fc01c9b7b80 1 -- 172.21.15.146:0/866980239 >> 172.21.15.146:0/866980239 conn(0x5639a69472c0 msgr2=0x5639a696d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:37.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.018+0000 7fc01c9b7b80 1 -- 172.21.15.146:0/866980239 shutdown_connections 2023-10-06T11:16:37.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.018+0000 7fc01c9b7b80 1 -- 172.21.15.146:0/866980239 wait complete. 2023-10-06T11:16:37.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.018+0000 7fc01c9b7b80 20 client.9447 trim_cache size 0 max 16384 2023-10-06T11:16:37.028 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:16:37.028 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-06T11:16:37.028 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": { 2023-10-06T11:16:37.028 INFO:teuthology.orchestra.run.smithi146.stdout: "856ab5b7-d17a-4d5b-af49-36e390c87a8c": { 2023-10-06T11:16:37.028 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "~mds0", 2023-10-06T11:16:37.028 INFO:teuthology.orchestra.run.smithi146.stdout: "tag": "856ab5b7-d17a-4d5b-af49-36e390c87a8c", 2023-10-06T11:16:37.028 INFO:teuthology.orchestra.run.smithi146.stdout: "options": "recursive" 2023-10-06T11:16:37.028 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:16:37.028 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:16:37.028 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:16:37.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.018+0000 7fc01245d700 1 -- 172.21.15.146:0/3957825665 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbff0066f30 msgr2=0x7fbff00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:37.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.018+0000 7fc01245d700 1 --2- 172.21.15.146:0/3957825665 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbff0066f30 0x7fbff00693e0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fc00c166f70 tx=0x7fbffc009040 comp rx=0 tx=0).stop 2023-10-06T11:16:37.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.018+0000 7fc01245d700 1 -- 172.21.15.146:0/3957825665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc00c068780 msgr2=0x7fc00c145c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:16:37.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.018+0000 7fc01245d700 1 --2- 172.21.15.146:0/3957825665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc00c068780 0x7fc00c145c00 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7fc00400cca0 tx=0x7fc004007da0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.018+0000 7fc01245d700 1 -- 172.21.15.146:0/3957825665 shutdown_connections 2023-10-06T11:16:37.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.018+0000 7fc01245d700 1 --2- 172.21.15.146:0/3957825665 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbff0066f30 0x7fbff00693e0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.018+0000 7fc01245d700 1 --2- 172.21.15.146:0/3957825665 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc00c0cb090 0x7fc00c0b48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.018+0000 7fc01245d700 1 --2- 172.21.15.146:0/3957825665 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc00c068780 0x7fc00c145c00 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.018+0000 7fc01245d700 1 --2- 172.21.15.146:0/3957825665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc00c0b5640 0x7fc00c169da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:16:37.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.018+0000 7fc01245d700 1 -- 172.21.15.146:0/3957825665 >> 172.21.15.146:0/3957825665 conn(0x7fc00c0703f0 msgr2=0x7fc00c0c6cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:16:37.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.018+0000 7fc01245d700 1 -- 172.21.15.146:0/3957825665 shutdown_connections 2023-10-06T11:16:37.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:16:37.018+0000 7fc01245d700 1 -- 172.21.15.146:0/3957825665 wait complete. 2023-10-06T11:16:37.032 INFO:tasks.cephfs.filesystem:scrub status for tag:856ab5b7-d17a-4d5b-af49-36e390c87a8c - {'path': '~mds0', 'tag': '856ab5b7-d17a-4d5b-af49-36e390c87a8c', 'options': 'recursive'} 2023-10-06T11:16:51.461 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:16:51.464 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:17:07.033 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.10:0 scrub status 2023-10-06T11:17:07.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.164+0000 7fedfe669700 1 Processor -- start 2023-10-06T11:17:07.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.164+0000 7fedfe669700 1 -- start start 2023-10-06T11:17:07.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.164+0000 7fedfe669700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fedf815a160 0x7fedf80c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.164+0000 7fedfe669700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fedf80ae730 0x7fedf80aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.164+0000 7fedfe669700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fedf80ce3d0 0x7fedf80ce810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.164+0000 7fedfe669700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedf80ae2a0 con 0x7fedf80ae730 2023-10-06T11:17:07.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.164+0000 7fedfe669700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedf815a530 con 0x7fedf815a160 2023-10-06T11:17:07.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.164+0000 7fedfe669700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf80af0f0 con 0x7fedf80ce3d0 2023-10-06T11:17:07.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.164+0000 7fedf77fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fedf80ae730 0x7fedf80aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.164+0000 7fedf77fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fedf80ae730 0x7fedf80aebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36088/0 (socket says 172.21.15.146:36088) 2023-10-06T11:17:07.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.164+0000 7fedf77fe700 1 -- 172.21.15.146:0/2040494133 learned_addr learned my addr 172.21.15.146:0/2040494133 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:07.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.164+0000 7fedf7fff700 1 --2- 172.21.15.146:0/2040494133 >> v2:172.21.15.151:3300/0 conn(0x7fedf815a160 0x7fedf80c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.164+0000 7fedfcc06700 1 --2- 172.21.15.146:0/2040494133 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fedf80ce3d0 0x7fedf80ce810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.164+0000 7fedf77fe700 1 -- 172.21.15.146:0/2040494133 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fedf80ce3d0 msgr2=0x7fedf80ce810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:07.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.164+0000 7fedf77fe700 1 --2- 172.21.15.146:0/2040494133 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fedf80ce3d0 0x7fedf80ce810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.164+0000 7fedf77fe700 1 -- 172.21.15.146:0/2040494133 >> v2:172.21.15.151:3300/0 conn(0x7fedf815a160 msgr2=0x7fedf80c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:07.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.164+0000 7fedf77fe700 1 --2- 172.21.15.146:0/2040494133 >> v2:172.21.15.151:3300/0 conn(0x7fedf815a160 0x7fedf80c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.164+0000 7fedf77fe700 1 -- 172.21.15.146:0/2040494133 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf80ad690 con 0x7fedf80ae730 2023-10-06T11:17:07.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.164+0000 7fedf77fe700 1 --2- 172.21.15.146:0/2040494133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedf80ae730 0x7fedf80aebb0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7fedf8065100 tx=0x7fedec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9faf1c1ec4046d4d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:07.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.165+0000 7fedf6ffd700 1 -- 172.21.15.146:0/2040494133 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedec00b640 con 0x7fedf80ae730 2023-10-06T11:17:07.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.165+0000 7fedf6ffd700 1 -- 172.21.15.146:0/2040494133 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedec00b7a0 con 0x7fedf80ae730 2023-10-06T11:17:07.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.165+0000 7fedf6ffd700 1 -- 172.21.15.146:0/2040494133 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedec00bb60 con 0x7fedf80ae730 2023-10-06T11:17:07.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.165+0000 7fedfe669700 1 -- 172.21.15.146:0/2040494133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedf80ae730 msgr2=0x7fedf80aebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:07.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.165+0000 7fedfe669700 1 --2- 172.21.15.146:0/2040494133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedf80ae730 0x7fedf80aebb0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7fedf8065100 tx=0x7fedec009250 comp rx=0 tx=0).stop 2023-10-06T11:17:07.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.165+0000 7fedfe669700 1 -- 172.21.15.146:0/2040494133 shutdown_connections 2023-10-06T11:17:07.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.165+0000 7fedfe669700 1 --2- 172.21.15.146:0/2040494133 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fedf80ce3d0 0x7fedf80ce810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.165+0000 7fedfe669700 1 --2- 172.21.15.146:0/2040494133 >> v2:172.21.15.151:3300/0 conn(0x7fedf815a160 0x7fedf80c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.165+0000 7fedfe669700 1 --2- 172.21.15.146:0/2040494133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedf80ae730 0x7fedf80aebb0 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.165+0000 7fedfe669700 1 -- 172.21.15.146:0/2040494133 >> 172.21.15.146:0/2040494133 conn(0x7fedf806f380 msgr2=0x7fedf80d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:07.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.165+0000 7fedfe669700 1 -- 172.21.15.146:0/2040494133 shutdown_connections 2023-10-06T11:17:07.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.165+0000 7fedfe669700 1 -- 172.21.15.146:0/2040494133 wait complete. 2023-10-06T11:17:07.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.166+0000 7fedfe669700 1 Processor -- start 2023-10-06T11:17:07.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.167+0000 7fedfe669700 1 -- start start 2023-10-06T11:17:07.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.167+0000 7fedfe669700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fedf80ae730 0x7fedf8157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.167+0000 7fedfe669700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedf80ce3d0 0x7fedf80b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.167+0000 7fedfe669700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fedf815a160 0x7fedf80b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.167+0000 7fedfe669700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf80b1f80 con 0x7fedf80ce3d0 2023-10-06T11:17:07.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.167+0000 7fedfe669700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf816b0c0 con 0x7fedf80ae730 2023-10-06T11:17:07.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.167+0000 7fedfe669700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf816b550 con 0x7fedf815a160 2023-10-06T11:17:07.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.167+0000 7fedf77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedf80ce3d0 0x7fedf80b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.167+0000 7fedf77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedf80ce3d0 0x7fedf80b13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36096/0 (socket says 172.21.15.146:36096) 2023-10-06T11:17:07.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.167+0000 7fedf77fe700 1 -- 172.21.15.146:0/1006010520 learned_addr learned my addr 172.21.15.146:0/1006010520 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:07.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.168+0000 7fedfcc06700 1 --2- 172.21.15.146:0/1006010520 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fedf815a160 0x7fedf80b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.168+0000 7fedf7fff700 1 --2- 172.21.15.146:0/1006010520 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fedf80ae730 0x7fedf8157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.168+0000 7fedf77fe700 1 -- 172.21.15.146:0/1006010520 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fedf815a160 msgr2=0x7fedf80b18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:07.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.168+0000 7fedf77fe700 1 --2- 172.21.15.146:0/1006010520 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fedf815a160 0x7fedf80b18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.168+0000 7fedf77fe700 1 -- 172.21.15.146:0/1006010520 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fedf80ae730 msgr2=0x7fedf8157500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:07.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.168+0000 7fedf77fe700 1 --2- 172.21.15.146:0/1006010520 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fedf80ae730 0x7fedf8157500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.168+0000 7fedf77fe700 1 -- 172.21.15.146:0/1006010520 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedec0094f0 con 0x7fedf80ce3d0 2023-10-06T11:17:07.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.168+0000 7fedf77fe700 1 --2- 172.21.15.146:0/1006010520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedf80ce3d0 0x7fedf80b13a0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7fedec006fd0 tx=0x7fedec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:07.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.168+0000 7feddffff700 1 -- 172.21.15.146:0/1006010520 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedec00b910 con 0x7fedf80ce3d0 2023-10-06T11:17:07.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.168+0000 7feddffff700 1 -- 172.21.15.146:0/1006010520 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedec00ba70 con 0x7fedf80ce3d0 2023-10-06T11:17:07.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.168+0000 7fedfe669700 1 -- 172.21.15.146:0/1006010520 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedf8157a40 con 0x7fedf80ce3d0 2023-10-06T11:17:07.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.168+0000 7feddffff700 1 -- 172.21.15.146:0/1006010520 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedec011650 con 0x7fedf80ce3d0 2023-10-06T11:17:07.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.168+0000 7fedfe669700 1 -- 172.21.15.146:0/1006010520 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf816aa70 con 0x7fedf80ce3d0 2023-10-06T11:17:07.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.169+0000 7feddffff700 1 -- 172.21.15.146:0/1006010520 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fedec0119c0 con 0x7fedf80ce3d0 2023-10-06T11:17:07.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.170+0000 7feddffff700 1 --2- 172.21.15.146:0/1006010520 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fede4066f30 0x7fede40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.170+0000 7feddffff700 1 -- 172.21.15.146:0/1006010520 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fedec085d40 con 0x7fedf80ce3d0 2023-10-06T11:17:07.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.170+0000 7fedf7fff700 1 --2- 172.21.15.146:0/1006010520 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fede4066f30 0x7fede40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.170+0000 7fedf7fff700 1 --2- 172.21.15.146:0/1006010520 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fede4066f30 0x7fede40693e0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fedf809e5e0 tx=0x7fede8009120 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:07.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.172+0000 7fee07961b80 1 Processor -- start 2023-10-06T11:17:07.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.172+0000 7fee07961b80 1 -- start start 2023-10-06T11:17:07.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.173+0000 7fee07961b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5cbed9ae0 0x55a5cbed9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.173+0000 7fee07961b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5cbe959f0 0x55a5cbe925d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.173+0000 7fee07961b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a5cbe93c20 0x55a5cbe92b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.173+0000 7fee07961b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5cbe12cd0 con 0x55a5cbed9ae0 2023-10-06T11:17:07.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.173+0000 7fee07961b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5cbde9ac0 con 0x55a5cbe959f0 2023-10-06T11:17:07.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.173+0000 7fee07961b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a5cbde72c0 con 0x55a5cbe93c20 2023-10-06T11:17:07.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.173+0000 7fedf7fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5cbed9ae0 0x55a5cbed9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.173+0000 7fedf7fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5cbed9ae0 0x55a5cbed9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36102/0 (socket says 172.21.15.146:36102) 2023-10-06T11:17:07.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.173+0000 7fedf7fff700 1 -- 172.21.15.146:0/2545231717 learned_addr learned my addr 172.21.15.146:0/2545231717 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:07.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.173+0000 7fedfcc06700 1 --2- 172.21.15.146:0/2545231717 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a5cbe93c20 0x55a5cbe92b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.173+0000 7fedf77fe700 1 --2- 172.21.15.146:0/2545231717 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5cbe959f0 0x55a5cbe925d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.173+0000 7fedf7fff700 1 -- 172.21.15.146:0/2545231717 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a5cbe93c20 msgr2=0x55a5cbe92b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:07.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.173+0000 7fedf7fff700 1 --2- 172.21.15.146:0/2545231717 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a5cbe93c20 0x55a5cbe92b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.173+0000 7fedf7fff700 1 -- 172.21.15.146:0/2545231717 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5cbe959f0 msgr2=0x55a5cbe925d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:07.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.173+0000 7fedf7fff700 1 --2- 172.21.15.146:0/2545231717 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5cbe959f0 0x55a5cbe925d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.173+0000 7fedf7fff700 1 -- 172.21.15.146:0/2545231717 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5cbc7d2c0 con 0x55a5cbed9ae0 2023-10-06T11:17:07.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.173+0000 7fedf77fe700 1 --2- 172.21.15.146:0/2545231717 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5cbe959f0 0x55a5cbe925d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:17:07.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.173+0000 7fedf7fff700 1 --2- 172.21.15.146:0/2545231717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5cbed9ae0 0x55a5cbed9eb0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7fede8011ed0 tx=0x7fede8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=778abdec8d4caeba server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:07.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.173+0000 7feddd7fa700 1 -- 172.21.15.146:0/2545231717 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede8005d90 con 0x55a5cbed9ae0 2023-10-06T11:17:07.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.174+0000 7feddd7fa700 1 -- 172.21.15.146:0/2545231717 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede80064e0 con 0x55a5cbed9ae0 2023-10-06T11:17:07.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.174+0000 7feddd7fa700 1 -- 172.21.15.146:0/2545231717 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede8006880 con 0x55a5cbed9ae0 2023-10-06T11:17:07.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.174+0000 7fee07961b80 1 -- 172.21.15.146:0/2545231717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5cbed9ae0 msgr2=0x55a5cbed9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:07.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.174+0000 7fee07961b80 1 --2- 172.21.15.146:0/2545231717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5cbed9ae0 0x55a5cbed9eb0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7fede8011ed0 tx=0x7fede8018000 comp rx=0 tx=0).stop 2023-10-06T11:17:07.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.174+0000 7fee07961b80 1 -- 172.21.15.146:0/2545231717 shutdown_connections 2023-10-06T11:17:07.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.174+0000 7fee07961b80 1 --2- 172.21.15.146:0/2545231717 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a5cbe93c20 0x55a5cbe92b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.174+0000 7fee07961b80 1 --2- 172.21.15.146:0/2545231717 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5cbed9ae0 0x55a5cbed9eb0 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.174+0000 7fee07961b80 1 --2- 172.21.15.146:0/2545231717 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5cbe959f0 0x55a5cbe925d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.174+0000 7fee07961b80 1 -- 172.21.15.146:0/2545231717 >> 172.21.15.146:0/2545231717 conn(0x55a5cbe940c0 msgr2=0x55a5cbe94490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:07.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.174+0000 7fee07961b80 1 -- 172.21.15.146:0/2545231717 shutdown_connections 2023-10-06T11:17:07.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.174+0000 7fee07961b80 1 -- 172.21.15.146:0/2545231717 wait complete. 2023-10-06T11:17:07.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.175+0000 7fee07961b80 1 -- start start 2023-10-06T11:17:07.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.175+0000 7fee07961b80 1 Processor -- start 2023-10-06T11:17:07.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.176+0000 7fee07961b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5cbe93c20 0x55a5cbec1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.176+0000 7fee07961b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a5cbe959f0 0x55a5cbec2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.176+0000 7fee07961b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5cbed9ae0 0x55a5cbe8d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.176+0000 7fee07961b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5cbde30b0 con 0x55a5cbed9ae0 2023-10-06T11:17:07.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.176+0000 7fee07961b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5cbd8e8e0 con 0x55a5cbe93c20 2023-10-06T11:17:07.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.176+0000 7fee07961b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a5cbda9ef0 con 0x55a5cbe959f0 2023-10-06T11:17:07.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.176+0000 7fee07961b80 10 client.0 _ll_register_callbacks cb 0x55a5cbc7ff80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:17:07.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.176+0000 7fedfcc06700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5cbed9ae0 0x55a5cbe8d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.176+0000 7fedfcc06700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5cbed9ae0 0x55a5cbe8d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36112/0 (socket says 172.21.15.146:36112) 2023-10-06T11:17:07.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.176+0000 7fedfcc06700 1 -- 172.21.15.146:0/538423108 learned_addr learned my addr 172.21.15.146:0/538423108 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:07.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.176+0000 7fedf77fe700 1 --2- 172.21.15.146:0/538423108 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a5cbe959f0 0x55a5cbec2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.176+0000 7fedf7fff700 1 --2- 172.21.15.146:0/538423108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5cbe93c20 0x55a5cbec1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.176+0000 7fedfcc06700 1 -- 172.21.15.146:0/538423108 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a5cbe959f0 msgr2=0x55a5cbec2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:07.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.176+0000 7fedfcc06700 1 --2- 172.21.15.146:0/538423108 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a5cbe959f0 0x55a5cbec2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.176+0000 7fedfcc06700 1 -- 172.21.15.146:0/538423108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5cbe93c20 msgr2=0x55a5cbec1fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:07.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.176+0000 7fedfcc06700 1 --2- 172.21.15.146:0/538423108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5cbe93c20 0x55a5cbec1fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.176+0000 7fedfcc06700 1 -- 172.21.15.146:0/538423108 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fede8011bb0 con 0x55a5cbed9ae0 2023-10-06T11:17:07.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.176+0000 7fedfcc06700 1 --2- 172.21.15.146:0/538423108 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5cbed9ae0 0x55a5cbe8d790 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7fedf0007e70 tx=0x7fedf000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92bd78e9dfa713b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:07.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.176+0000 7fedd67fc700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:17:07.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.176+0000 7fedd67fc700 1 -- 172.21.15.146:0/538423108 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf000e040 con 0x55a5cbed9ae0 2023-10-06T11:17:07.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.176+0000 7fee07961b80 1 -- 172.21.15.146:0/538423108 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a5cbe876e0 con 0x55a5cbed9ae0 2023-10-06T11:17:07.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.176+0000 7fedd67fc700 1 -- 172.21.15.146:0/538423108 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fedf00139b0 con 0x55a5cbed9ae0 2023-10-06T11:17:07.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.177+0000 7fedd67fc700 1 -- 172.21.15.146:0/538423108 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=121) v2 ==== 24+0+0 (secure 0 0 0) 0x7fedf0013d80 con 0x55a5cbed9ae0 2023-10-06T11:17:07.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.177+0000 7fee07961b80 10 client.9459 fetch_fsmap learned FSMap version 121 2023-10-06T11:17:07.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.177+0000 7fee07961b80 1 -- 172.21.15.146:0/538423108 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=121,monmap=2+}) v3 -- 0x55a5cbc20030 con 0x55a5cbed9ae0 2023-10-06T11:17:07.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.177+0000 7fedd67fc700 1 -- 172.21.15.146:0/538423108 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a5cbe876e0 con 0x55a5cbed9ae0 2023-10-06T11:17:07.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.177+0000 7fedd67fc700 1 -- 172.21.15.146:0/538423108 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 121) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fedf0021440 con 0x55a5cbed9ae0 2023-10-06T11:17:07.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.177+0000 7fee07961b80 10 client.9459 fetch_fsmap finished waiting for FSMap version 121 2023-10-06T11:17:07.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.177+0000 7fee07961b80 10 client.9459 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2023-10-06T11:17:07.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.177+0000 7fee07961b80 20 client.9459 populate_metadata read hostname 'smithi146' 2023-10-06T11:17:07.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.177+0000 7fee07961b80 1 --2- 172.21.15.146:0/538423108 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x55a5cbeb9840 0x55a5cbe925d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.177+0000 7fee07961b80 4 client.9459 mds_command: new command op to 9198 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:17:07.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.177+0000 7fee07961b80 1 -- 172.21.15.146:0/538423108 --> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a5cbe64610 con 0x55a5cbeb9840 2023-10-06T11:17:07.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.177+0000 7fedf7fff700 1 --2- 172.21.15.146:0/538423108 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x55a5cbeb9840 0x55a5cbe925d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.177+0000 7fedd67fc700 10 client.9459 ms_handle_connect on v2:172.21.15.146:6836/525107449 2023-10-06T11:17:07.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.177+0000 7fedf7fff700 1 --2- 172.21.15.146:0/538423108 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x55a5cbeb9840 0x55a5cbe925d0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe47f944555ff244 server_cookie=4918df6f5b87b4a9 in_seq=0 out_seq=0 2023-10-06T11:17:07.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.178+0000 7fedd67fc700 1 -- 172.21.15.146:0/538423108 <== mds.0 v2:172.21.15.146:6836/525107449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55a5cbe64610 con 0x55a5cbeb9840 2023-10-06T11:17:07.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.178+0000 7fedd67fc700 10 client.9459 handle_command_reply: tid=0 2023-10-06T11:17:07.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.178+0000 7fee07961b80 1 client.9459 shutdown 2023-10-06T11:17:07.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.178+0000 7fee07961b80 1 -- 172.21.15.146:0/538423108 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5cbed9ae0 msgr2=0x55a5cbe8d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:07.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.178+0000 7fee07961b80 1 --2- 172.21.15.146:0/538423108 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5cbed9ae0 0x55a5cbe8d790 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7fedf0007e70 tx=0x7fedf000b040 comp rx=0 tx=0).stop 2023-10-06T11:17:07.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.178+0000 7fee07961b80 1 -- 172.21.15.146:0/538423108 shutdown_connections 2023-10-06T11:17:07.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.178+0000 7fee07961b80 1 --2- 172.21.15.146:0/538423108 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x55a5cbeb9840 0x55a5cbe925d0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.178+0000 7fee07961b80 1 --2- 172.21.15.146:0/538423108 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5cbed9ae0 0x55a5cbe8d790 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.178+0000 7fee07961b80 1 --2- 172.21.15.146:0/538423108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5cbe93c20 0x55a5cbec1fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.178+0000 7fedd67fc700 0 client.9459 ms_handle_reset on v2:172.21.15.146:6836/525107449 2023-10-06T11:17:07.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.178+0000 7fee07961b80 1 --2- 172.21.15.146:0/538423108 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a5cbe959f0 0x55a5cbec2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.178+0000 7fee07961b80 1 -- 172.21.15.146:0/538423108 >> 172.21.15.146:0/538423108 conn(0x55a5cbe940c0 msgr2=0x55a5cbe8eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:07.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.178+0000 7fee07961b80 1 -- 172.21.15.146:0/538423108 shutdown_connections 2023-10-06T11:17:07.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.178+0000 7fee07961b80 1 -- 172.21.15.146:0/538423108 wait complete. 2023-10-06T11:17:07.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.178+0000 7fee07961b80 20 client.9459 trim_cache size 0 max 16384 2023-10-06T11:17:07.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.194+0000 7fee07961b80 1 Processor -- start 2023-10-06T11:17:07.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.194+0000 7fee07961b80 1 -- start start 2023-10-06T11:17:07.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.195+0000 7fee07961b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a5cbe93c20 0x55a5cbee8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.195+0000 7fee07961b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5cbe959f0 0x55a5cbebe6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.195+0000 7fee07961b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5cbed9ae0 0x55a5cbebec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.195+0000 7fee07961b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5cbc65e80 con 0x55a5cbe959f0 2023-10-06T11:17:07.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.195+0000 7fee07961b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5cbe92b60 con 0x55a5cbed9ae0 2023-10-06T11:17:07.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.195+0000 7fee07961b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a5cbed4ab0 con 0x55a5cbe93c20 2023-10-06T11:17:07.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.195+0000 7fedf77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5cbe959f0 0x55a5cbebe6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.195+0000 7fedf77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5cbe959f0 0x55a5cbebe6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36114/0 (socket says 172.21.15.146:36114) 2023-10-06T11:17:07.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.195+0000 7fedf77fe700 1 -- 172.21.15.146:0/1044494245 learned_addr learned my addr 172.21.15.146:0/1044494245 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:07.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.195+0000 7fedfcc06700 1 --2- 172.21.15.146:0/1044494245 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5cbed9ae0 0x55a5cbebec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.195+0000 7fedf7fff700 1 --2- 172.21.15.146:0/1044494245 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a5cbe93c20 0x55a5cbee8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.195+0000 7fedf77fe700 1 -- 172.21.15.146:0/1044494245 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a5cbe93c20 msgr2=0x55a5cbee8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:07.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.195+0000 7fedf77fe700 1 --2- 172.21.15.146:0/1044494245 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a5cbe93c20 0x55a5cbee8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.195+0000 7fedf77fe700 1 -- 172.21.15.146:0/1044494245 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5cbed9ae0 msgr2=0x55a5cbebec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:07.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.195+0000 7fedf77fe700 1 --2- 172.21.15.146:0/1044494245 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5cbed9ae0 0x55a5cbebec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.195+0000 7fedf77fe700 1 -- 172.21.15.146:0/1044494245 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5cbdb17d0 con 0x55a5cbe959f0 2023-10-06T11:17:07.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.195+0000 7fedf7fff700 1 --2- 172.21.15.146:0/1044494245 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a5cbe93c20 0x55a5cbee8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:17:07.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.196+0000 7fedf77fe700 1 --2- 172.21.15.146:0/1044494245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5cbe959f0 0x55a5cbebe6d0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7fedec000e50 tx=0x7fedec003040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2863b4dd32600b9c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:07.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.196+0000 7fedddffb700 1 -- 172.21.15.146:0/1044494245 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedec0571d0 con 0x55a5cbe959f0 2023-10-06T11:17:07.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.196+0000 7fedddffb700 1 -- 172.21.15.146:0/1044494245 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedec056ad0 con 0x55a5cbe959f0 2023-10-06T11:17:07.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.196+0000 7fedddffb700 1 -- 172.21.15.146:0/1044494245 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedec059d20 con 0x55a5cbe959f0 2023-10-06T11:17:07.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.196+0000 7fee07961b80 1 -- 172.21.15.146:0/1044494245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5cbe959f0 msgr2=0x55a5cbebe6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:07.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.196+0000 7fee07961b80 1 --2- 172.21.15.146:0/1044494245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5cbe959f0 0x55a5cbebe6d0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7fedec000e50 tx=0x7fedec003040 comp rx=0 tx=0).stop 2023-10-06T11:17:07.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.196+0000 7fee07961b80 1 -- 172.21.15.146:0/1044494245 shutdown_connections 2023-10-06T11:17:07.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.196+0000 7fee07961b80 1 --2- 172.21.15.146:0/1044494245 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5cbed9ae0 0x55a5cbebec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.196+0000 7fee07961b80 1 --2- 172.21.15.146:0/1044494245 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a5cbe93c20 0x55a5cbee8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.196+0000 7fee07961b80 1 --2- 172.21.15.146:0/1044494245 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5cbe959f0 0x55a5cbebe6d0 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.196+0000 7fee07961b80 1 -- 172.21.15.146:0/1044494245 >> 172.21.15.146:0/1044494245 conn(0x55a5cbe940c0 msgr2=0x55a5cbe905a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:07.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.196+0000 7fee07961b80 1 -- 172.21.15.146:0/1044494245 shutdown_connections 2023-10-06T11:17:07.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.196+0000 7fee07961b80 1 -- 172.21.15.146:0/1044494245 wait complete. 2023-10-06T11:17:07.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.197+0000 7fee07961b80 1 -- start start 2023-10-06T11:17:07.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.197+0000 7fee07961b80 1 Processor -- start 2023-10-06T11:17:07.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.198+0000 7fee07961b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a5cbe93c20 0x55a5cbebeb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.198+0000 7fee07961b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5cbe959f0 0x55a5cbf42b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.198+0000 7fee07961b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5cbed9ae0 0x55a5cbf3eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.198+0000 7fee07961b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5cbf42120 con 0x55a5cbe959f0 2023-10-06T11:17:07.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.198+0000 7fee07961b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5cbf3f7a0 con 0x55a5cbed9ae0 2023-10-06T11:17:07.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.198+0000 7fee07961b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a5cbec27a0 con 0x55a5cbe93c20 2023-10-06T11:17:07.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.198+0000 7fee07961b80 10 client.0 _ll_register_callbacks cb 0x55a5cbc7ff80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:17:07.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.198+0000 7fedf77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5cbe959f0 0x55a5cbf42b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.198+0000 7fedf77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5cbe959f0 0x55a5cbf42b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36124/0 (socket says 172.21.15.146:36124) 2023-10-06T11:17:07.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.198+0000 7fedf77fe700 1 -- 172.21.15.146:0/2555512295 learned_addr learned my addr 172.21.15.146:0/2555512295 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:07.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.198+0000 7fedfcc06700 1 --2- 172.21.15.146:0/2555512295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5cbed9ae0 0x55a5cbf3eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.198+0000 7fedf7fff700 1 --2- 172.21.15.146:0/2555512295 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a5cbe93c20 0x55a5cbebeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.198+0000 7fedf77fe700 1 -- 172.21.15.146:0/2555512295 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a5cbe93c20 msgr2=0x55a5cbebeb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:07.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.198+0000 7fedf77fe700 1 --2- 172.21.15.146:0/2555512295 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a5cbe93c20 0x55a5cbebeb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.198+0000 7fedf77fe700 1 -- 172.21.15.146:0/2555512295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5cbed9ae0 msgr2=0x55a5cbf3eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:07.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.198+0000 7fedf77fe700 1 --2- 172.21.15.146:0/2555512295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5cbed9ae0 0x55a5cbf3eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.198+0000 7fedf77fe700 1 -- 172.21.15.146:0/2555512295 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf816aa70 con 0x55a5cbe959f0 2023-10-06T11:17:07.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.199+0000 7fedf77fe700 1 --2- 172.21.15.146:0/2555512295 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5cbe959f0 0x55a5cbf42b30 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7fedec01bfd0 tx=0x7fedec008000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e4a854dc3c38e66 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:07.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.199+0000 7fedd67fc700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:17:07.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.199+0000 7fedd67fc700 1 -- 172.21.15.146:0/2555512295 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedec059d20 con 0x55a5cbe959f0 2023-10-06T11:17:07.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.199+0000 7fedd67fc700 1 -- 172.21.15.146:0/2555512295 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fedec06f070 con 0x55a5cbe959f0 2023-10-06T11:17:07.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.199+0000 7fee07961b80 1 -- 172.21.15.146:0/2555512295 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fede80064e0 con 0x55a5cbe959f0 2023-10-06T11:17:07.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.199+0000 7fedd67fc700 1 -- 172.21.15.146:0/2555512295 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=121) v2 ==== 24+0+0 (secure 0 0 0) 0x7fedec06ce90 con 0x55a5cbe959f0 2023-10-06T11:17:07.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.199+0000 7fee07961b80 10 client.9465 fetch_fsmap learned FSMap version 121 2023-10-06T11:17:07.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.199+0000 7fee07961b80 1 -- 172.21.15.146:0/2555512295 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=121,monmap=2+}) v3 -- 0x55a5cbd984c0 con 0x55a5cbe959f0 2023-10-06T11:17:07.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.199+0000 7fedd67fc700 1 -- 172.21.15.146:0/2555512295 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fede80064e0 con 0x55a5cbe959f0 2023-10-06T11:17:07.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.199+0000 7fedd67fc700 1 -- 172.21.15.146:0/2555512295 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 121) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fedec055fc0 con 0x55a5cbe959f0 2023-10-06T11:17:07.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.199+0000 7fee07961b80 10 client.9465 fetch_fsmap finished waiting for FSMap version 121 2023-10-06T11:17:07.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.199+0000 7fee07961b80 10 client.9465 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2023-10-06T11:17:07.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.199+0000 7fee07961b80 20 client.9465 populate_metadata read hostname 'smithi146' 2023-10-06T11:17:07.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.199+0000 7fee07961b80 1 --2- 172.21.15.146:0/2555512295 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x55a5cbefa0f0 0x55a5cbf35090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.199+0000 7fee07961b80 4 client.9465 mds_command: new command op to 9198 tid=0[{"prefix": "scrub status"}] 2023-10-06T11:17:07.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.199+0000 7fee07961b80 1 -- 172.21.15.146:0/2555512295 --> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a5cbd85e50 con 0x55a5cbefa0f0 2023-10-06T11:17:07.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.199+0000 7fedf7fff700 1 --2- 172.21.15.146:0/2555512295 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x55a5cbefa0f0 0x55a5cbf35090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.200+0000 7fedd67fc700 10 client.9465 ms_handle_connect on v2:172.21.15.146:6836/525107449 2023-10-06T11:17:07.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.200+0000 7fedf7fff700 1 --2- 172.21.15.146:0/2555512295 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x55a5cbefa0f0 0x55a5cbf35090 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9afe4d83ef2f5eaf server_cookie=7d37de9f4913c14b in_seq=0 out_seq=0 2023-10-06T11:17:07.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.200+0000 7fedd67fc700 1 -- 172.21.15.146:0/2555512295 <== mds.0 v2:172.21.15.146:6836/525107449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55a5cbd85e50 con 0x55a5cbefa0f0 2023-10-06T11:17:07.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.200+0000 7fedd67fc700 10 client.9465 handle_command_reply: tid=0 2023-10-06T11:17:07.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.200+0000 7fee07961b80 1 client.9465 shutdown 2023-10-06T11:17:07.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.200+0000 7fee07961b80 1 -- 172.21.15.146:0/2555512295 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5cbe959f0 msgr2=0x55a5cbf42b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:07.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.200+0000 7fee07961b80 1 --2- 172.21.15.146:0/2555512295 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5cbe959f0 0x55a5cbf42b30 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7fedec01bfd0 tx=0x7fedec008000 comp rx=0 tx=0).stop 2023-10-06T11:17:07.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.200+0000 7fee07961b80 1 -- 172.21.15.146:0/2555512295 shutdown_connections 2023-10-06T11:17:07.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.200+0000 7fee07961b80 1 --2- 172.21.15.146:0/2555512295 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x55a5cbefa0f0 0x55a5cbf35090 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.200+0000 7fedd67fc700 0 client.9465 ms_handle_reset on v2:172.21.15.146:6836/525107449 2023-10-06T11:17:07.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.200+0000 7fee07961b80 1 --2- 172.21.15.146:0/2555512295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5cbed9ae0 0x55a5cbf3eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.200+0000 7fee07961b80 1 --2- 172.21.15.146:0/2555512295 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55a5cbe93c20 0x55a5cbebeb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.200+0000 7fee07961b80 1 --2- 172.21.15.146:0/2555512295 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55a5cbe959f0 0x55a5cbf42b30 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.200+0000 7fee07961b80 1 -- 172.21.15.146:0/2555512295 >> 172.21.15.146:0/2555512295 conn(0x55a5cbe940c0 msgr2=0x55a5cbed82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:07.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.200+0000 7fee07961b80 1 -- 172.21.15.146:0/2555512295 shutdown_connections 2023-10-06T11:17:07.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.200+0000 7fee07961b80 1 -- 172.21.15.146:0/2555512295 wait complete. 2023-10-06T11:17:07.209 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.200+0000 7fee07961b80 20 client.9465 trim_cache size 0 max 16384 2023-10-06T11:17:07.209 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:17:07.210 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "no active scrubs running", 2023-10-06T11:17:07.210 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": {} 2023-10-06T11:17:07.210 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:17:07.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.200+0000 7fedfe669700 1 -- 172.21.15.146:0/1006010520 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fede4066f30 msgr2=0x7fede40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:07.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.200+0000 7fedfe669700 1 --2- 172.21.15.146:0/1006010520 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fede4066f30 0x7fede40693e0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fedf809e5e0 tx=0x7fede8009120 comp rx=0 tx=0).stop 2023-10-06T11:17:07.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.200+0000 7fedfe669700 1 -- 172.21.15.146:0/1006010520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedf80ce3d0 msgr2=0x7fedf80b13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:07.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.200+0000 7fedfe669700 1 --2- 172.21.15.146:0/1006010520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedf80ce3d0 0x7fedf80b13a0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7fedec006fd0 tx=0x7fedec017000 comp rx=0 tx=0).stop 2023-10-06T11:17:07.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.201+0000 7fedfe669700 1 -- 172.21.15.146:0/1006010520 shutdown_connections 2023-10-06T11:17:07.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.201+0000 7fedfe669700 1 --2- 172.21.15.146:0/1006010520 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fede4066f30 0x7fede40693e0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.201+0000 7fedfe669700 1 --2- 172.21.15.146:0/1006010520 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fedf815a160 0x7fedf80b18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.201+0000 7fedfe669700 1 --2- 172.21.15.146:0/1006010520 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fedf80ae730 0x7fedf8157500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.201+0000 7fedfe669700 1 --2- 172.21.15.146:0/1006010520 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedf80ce3d0 0x7fedf80b13a0 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.201+0000 7fedfe669700 1 -- 172.21.15.146:0/1006010520 >> 172.21.15.146:0/1006010520 conn(0x7fedf806f380 msgr2=0x7fedf80cf6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:07.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.201+0000 7fedfe669700 1 -- 172.21.15.146:0/1006010520 shutdown_connections 2023-10-06T11:17:07.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.201+0000 7fedfe669700 1 -- 172.21.15.146:0/1006010520 wait complete. 2023-10-06T11:17:07.214 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-06T11:17:07.214 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.10:0 damage ls 2023-10-06T11:17:07.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.329+0000 7fb30d25b700 1 Processor -- start 2023-10-06T11:17:07.331 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.329+0000 7fb30d25b700 1 -- start start 2023-10-06T11:17:07.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.331+0000 7fb30d25b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb3080b5640 0x7fb30815a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.331+0000 7fb30d25b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb308068780 0x7fb308068c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.331+0000 7fb30d25b700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3080cc130 con 0x7fb3080cb090 2023-10-06T11:17:07.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.331+0000 7fb30d25b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb308069140 con 0x7fb3080b5640 2023-10-06T11:17:07.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.331+0000 7fb30d25b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3080cccd0 con 0x7fb308068780 2023-10-06T11:17:07.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.331+0000 7fb307fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb3080b5640 0x7fb30815a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.331+0000 7fb307fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb3080b5640 0x7fb30815a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36134/0 (socket says 172.21.15.146:36134) 2023-10-06T11:17:07.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.331+0000 7fb307fff700 1 -- 172.21.15.146:0/2000801224 learned_addr learned my addr 172.21.15.146:0/2000801224 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:07.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.331+0000 7fb30ca5a700 1 --2- 172.21.15.146:0/2000801224 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb308068780 0x7fb308068c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.331+0000 7fb307fff700 1 -- 172.21.15.146:0/2000801224 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb308068780 msgr2=0x7fb308068c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:07.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.331+0000 7fb307fff700 1 --2- 172.21.15.146:0/2000801224 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb308068780 0x7fb308068c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.331+0000 7fb307fff700 1 -- 172.21.15.146:0/2000801224 >> v1:172.21.15.151:6789/0 conn(0x7fb3080cb090 legacy=0x7fb3080cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:07.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.331+0000 7fb307fff700 1 -- 172.21.15.146:0/2000801224 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3080b2660 con 0x7fb3080b5640 2023-10-06T11:17:07.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.331+0000 7fb307fff700 1 --2- 172.21.15.146:0/2000801224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3080b5640 0x7fb30815a870 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7fb2f80099b0 tx=0x7fb2f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a86cfa0e73826df server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:07.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.331+0000 7fb306ffd700 1 -- 172.21.15.146:0/2000801224 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f800b820 con 0x7fb3080b5640 2023-10-06T11:17:07.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.331+0000 7fb306ffd700 1 -- 172.21.15.146:0/2000801224 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f800b980 con 0x7fb3080b5640 2023-10-06T11:17:07.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.331+0000 7fb306ffd700 1 -- 172.21.15.146:0/2000801224 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f800bd20 con 0x7fb3080b5640 2023-10-06T11:17:07.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.331+0000 7fb30d25b700 1 -- 172.21.15.146:0/2000801224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3080b5640 msgr2=0x7fb30815a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:07.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.331+0000 7fb30d25b700 1 --2- 172.21.15.146:0/2000801224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3080b5640 0x7fb30815a870 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7fb2f80099b0 tx=0x7fb2f8009250 comp rx=0 tx=0).stop 2023-10-06T11:17:07.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.331+0000 7fb30d25b700 1 -- 172.21.15.146:0/2000801224 shutdown_connections 2023-10-06T11:17:07.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.331+0000 7fb30d25b700 1 --2- 172.21.15.146:0/2000801224 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb308068780 0x7fb308068c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.331+0000 7fb30d25b700 1 --2- 172.21.15.146:0/2000801224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3080b5640 0x7fb30815a870 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.331+0000 7fb30d25b700 1 -- 172.21.15.146:0/2000801224 >> 172.21.15.146:0/2000801224 conn(0x7fb3080703f0 msgr2=0x7fb3080707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:07.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.331+0000 7fb30d25b700 1 -- 172.21.15.146:0/2000801224 shutdown_connections 2023-10-06T11:17:07.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.331+0000 7fb30d25b700 1 -- 172.21.15.146:0/2000801224 wait complete. 2023-10-06T11:17:07.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.332+0000 7fb30d25b700 1 Processor -- start 2023-10-06T11:17:07.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.333+0000 7fb30d25b700 1 -- start start 2023-10-06T11:17:07.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.333+0000 7fb30d25b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb308068780 0x7fb3080c7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.333+0000 7fb30d25b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3080b5640 0x7fb3080c9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.333+0000 7fb30d25b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb3080cb090 0x7fb3080c9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.333+0000 7fb30d25b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3080d0270 con 0x7fb3080b5640 2023-10-06T11:17:07.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.333+0000 7fb30d25b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3080d0550 con 0x7fb308068780 2023-10-06T11:17:07.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.333+0000 7fb30d25b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3080d0830 con 0x7fb3080cb090 2023-10-06T11:17:07.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.333+0000 7fb3077fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3080b5640 0x7fb3080c9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.333+0000 7fb3077fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3080b5640 0x7fb3080c9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36144/0 (socket says 172.21.15.146:36144) 2023-10-06T11:17:07.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.333+0000 7fb3077fe700 1 -- 172.21.15.146:0/2142171212 learned_addr learned my addr 172.21.15.146:0/2142171212 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:07.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.334+0000 7fb307fff700 1 --2- 172.21.15.146:0/2142171212 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb308068780 0x7fb3080c7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.334+0000 7fb30ca5a700 1 --2- 172.21.15.146:0/2142171212 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb3080cb090 0x7fb3080c9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.334+0000 7fb3077fe700 1 -- 172.21.15.146:0/2142171212 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb3080cb090 msgr2=0x7fb3080c9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:07.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.334+0000 7fb3077fe700 1 --2- 172.21.15.146:0/2142171212 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb3080cb090 0x7fb3080c9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.334+0000 7fb3077fe700 1 -- 172.21.15.146:0/2142171212 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb308068780 msgr2=0x7fb3080c7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:07.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.334+0000 7fb3077fe700 1 --2- 172.21.15.146:0/2142171212 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb308068780 0x7fb3080c7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.334+0000 7fb3077fe700 1 -- 172.21.15.146:0/2142171212 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f80094f0 con 0x7fb3080b5640 2023-10-06T11:17:07.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.334+0000 7fb3077fe700 1 --2- 172.21.15.146:0/2142171212 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3080b5640 0x7fb3080c9150 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc00b5e0 tx=0x7fb2fc0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:07.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.334+0000 7fb2effff700 1 -- 172.21.15.146:0/2142171212 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc00f510 con 0x7fb3080b5640 2023-10-06T11:17:07.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.334+0000 7fb2effff700 1 -- 172.21.15.146:0/2142171212 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2fc00f6b0 con 0x7fb3080b5640 2023-10-06T11:17:07.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.334+0000 7fb30d25b700 1 -- 172.21.15.146:0/2142171212 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3080d0b10 con 0x7fb3080b5640 2023-10-06T11:17:07.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.334+0000 7fb2effff700 1 -- 172.21.15.146:0/2142171212 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc00fa70 con 0x7fb3080b5640 2023-10-06T11:17:07.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.334+0000 7fb30d25b700 1 -- 172.21.15.146:0/2142171212 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb308151a10 con 0x7fb3080b5640 2023-10-06T11:17:07.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.335+0000 7fb2effff700 1 -- 172.21.15.146:0/2142171212 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb2fc01a400 con 0x7fb3080b5640 2023-10-06T11:17:07.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.336+0000 7fb2effff700 1 --2- 172.21.15.146:0/2142171212 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb2f4066f30 0x7fb2f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.336+0000 7fb2effff700 1 -- 172.21.15.146:0/2142171212 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fb2fc084050 con 0x7fb3080b5640 2023-10-06T11:17:07.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.336+0000 7fb307fff700 1 --2- 172.21.15.146:0/2142171212 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb2f4066f30 0x7fb2f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.336+0000 7fb307fff700 1 --2- 172.21.15.146:0/2142171212 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb2f4066f30 0x7fb2f40693e0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fb2f80099b0 tx=0x7fb2f8016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:07.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.338+0000 7fb3177b5b80 1 Processor -- start 2023-10-06T11:17:07.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.338+0000 7fb3177b5b80 1 -- start start 2023-10-06T11:17:07.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.338+0000 7fb3177b5b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fc825ec9a0 0x55fc825ecd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.339+0000 7fb3177b5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc82636c10 0x55fc82615970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.339+0000 7fb3177b5b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55fc82615eb0 0x55fc825e89e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.339+0000 7fb3177b5b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc8256ccd0 con 0x55fc825ec9a0 2023-10-06T11:17:07.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.339+0000 7fb3177b5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc82543ac0 con 0x55fc82636c10 2023-10-06T11:17:07.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.339+0000 7fb3177b5b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fc825412c0 con 0x55fc82615eb0 2023-10-06T11:17:07.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.339+0000 7fb307fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fc825ec9a0 0x55fc825ecd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.339+0000 7fb307fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fc825ec9a0 0x55fc825ecd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36152/0 (socket says 172.21.15.146:36152) 2023-10-06T11:17:07.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.339+0000 7fb307fff700 1 -- 172.21.15.146:0/3307550530 learned_addr learned my addr 172.21.15.146:0/3307550530 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:07.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.339+0000 7fb3077fe700 1 --2- 172.21.15.146:0/3307550530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc82636c10 0x55fc82615970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.339+0000 7fb30ca5a700 1 --2- 172.21.15.146:0/3307550530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55fc82615eb0 0x55fc825e89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.339+0000 7fb307fff700 1 -- 172.21.15.146:0/3307550530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55fc82615eb0 msgr2=0x55fc825e89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:07.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.339+0000 7fb307fff700 1 --2- 172.21.15.146:0/3307550530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55fc82615eb0 0x55fc825e89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.339+0000 7fb307fff700 1 -- 172.21.15.146:0/3307550530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc82636c10 msgr2=0x55fc82615970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:07.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.339+0000 7fb307fff700 1 --2- 172.21.15.146:0/3307550530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc82636c10 0x55fc82615970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.339+0000 7fb307fff700 1 -- 172.21.15.146:0/3307550530 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc823d72c0 con 0x55fc825ec9a0 2023-10-06T11:17:07.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.339+0000 7fb307fff700 1 --2- 172.21.15.146:0/3307550530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fc825ec9a0 0x55fc825ecd70 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8006fd0 tx=0x7fb2f8021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=806457af75e234d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:07.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.339+0000 7fb2ed7fa700 1 -- 172.21.15.146:0/3307550530 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f8021070 con 0x55fc825ec9a0 2023-10-06T11:17:07.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.339+0000 7fb2ed7fa700 1 -- 172.21.15.146:0/3307550530 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f8011a90 con 0x55fc825ec9a0 2023-10-06T11:17:07.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.339+0000 7fb2ed7fa700 1 -- 172.21.15.146:0/3307550530 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f8011c20 con 0x55fc825ec9a0 2023-10-06T11:17:07.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.340+0000 7fb3177b5b80 1 -- 172.21.15.146:0/3307550530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fc825ec9a0 msgr2=0x55fc825ecd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:07.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.340+0000 7fb3177b5b80 1 --2- 172.21.15.146:0/3307550530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fc825ec9a0 0x55fc825ecd70 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8006fd0 tx=0x7fb2f8021000 comp rx=0 tx=0).stop 2023-10-06T11:17:07.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.340+0000 7fb3177b5b80 1 -- 172.21.15.146:0/3307550530 shutdown_connections 2023-10-06T11:17:07.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.340+0000 7fb3177b5b80 1 --2- 172.21.15.146:0/3307550530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55fc82615eb0 0x55fc825e89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.340+0000 7fb3177b5b80 1 --2- 172.21.15.146:0/3307550530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fc825ec9a0 0x55fc825ecd70 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.340+0000 7fb3177b5b80 1 --2- 172.21.15.146:0/3307550530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc82636c10 0x55fc82615970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.340+0000 7fb3177b5b80 1 -- 172.21.15.146:0/3307550530 >> 172.21.15.146:0/3307550530 conn(0x55fc825ee2c0 msgr2=0x55fc825ee690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:07.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.340+0000 7fb3177b5b80 1 -- 172.21.15.146:0/3307550530 shutdown_connections 2023-10-06T11:17:07.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.340+0000 7fb3177b5b80 1 -- 172.21.15.146:0/3307550530 wait complete. 2023-10-06T11:17:07.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.340+0000 7fb3177b5b80 1 -- start start 2023-10-06T11:17:07.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.341+0000 7fb3177b5b80 1 Processor -- start 2023-10-06T11:17:07.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.341+0000 7fb3177b5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc825ec9a0 0x55fc82611d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.341+0000 7fb3177b5b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55fc82615eb0 0x55fc8262e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.341+0000 7fb3177b5b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fc82636c10 0x55fc82642e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.341+0000 7fb3177b5b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc8253d0b0 con 0x55fc82636c10 2023-10-06T11:17:07.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.341+0000 7fb3177b5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc824e88e0 con 0x55fc825ec9a0 2023-10-06T11:17:07.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.341+0000 7fb3177b5b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fc82503ef0 con 0x55fc82615eb0 2023-10-06T11:17:07.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.341+0000 7fb3177b5b80 10 client.0 _ll_register_callbacks cb 0x55fc823d9f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:17:07.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.341+0000 7fb30ca5a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fc82636c10 0x55fc82642e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.341+0000 7fb30ca5a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fc82636c10 0x55fc82642e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36160/0 (socket says 172.21.15.146:36160) 2023-10-06T11:17:07.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.341+0000 7fb30ca5a700 1 -- 172.21.15.146:0/3454907188 learned_addr learned my addr 172.21.15.146:0/3454907188 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:07.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.342+0000 7fb307fff700 1 --2- 172.21.15.146:0/3454907188 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc825ec9a0 0x55fc82611d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.342+0000 7fb3077fe700 1 --2- 172.21.15.146:0/3454907188 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55fc82615eb0 0x55fc8262e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.342+0000 7fb30ca5a700 1 -- 172.21.15.146:0/3454907188 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55fc82615eb0 msgr2=0x55fc8262e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:07.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.342+0000 7fb30ca5a700 1 --2- 172.21.15.146:0/3454907188 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55fc82615eb0 0x55fc8262e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.342+0000 7fb30ca5a700 1 -- 172.21.15.146:0/3454907188 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc825ec9a0 msgr2=0x55fc82611d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:07.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.342+0000 7fb30ca5a700 1 --2- 172.21.15.146:0/3454907188 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc825ec9a0 0x55fc82611d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.342+0000 7fb30ca5a700 1 -- 172.21.15.146:0/3454907188 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3080b2660 con 0x55fc82636c10 2023-10-06T11:17:07.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.342+0000 7fb30ca5a700 1 --2- 172.21.15.146:0/3454907188 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fc82636c10 0x55fc82642e40 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7fb30000fe70 tx=0x7fb3000077b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b21d6de98bc305e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:07.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.342+0000 7fb2e67fc700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:17:07.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.342+0000 7fb2e67fc700 1 -- 172.21.15.146:0/3454907188 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb300014070 con 0x55fc82636c10 2023-10-06T11:17:07.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.342+0000 7fb2e67fc700 1 -- 172.21.15.146:0/3454907188 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fb30000dd70 con 0x55fc82636c10 2023-10-06T11:17:07.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.342+0000 7fb3177b5b80 1 -- 172.21.15.146:0/3454907188 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fc825e16e0 con 0x55fc82636c10 2023-10-06T11:17:07.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.342+0000 7fb2e67fc700 1 -- 172.21.15.146:0/3454907188 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=121) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb300018620 con 0x55fc82636c10 2023-10-06T11:17:07.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.342+0000 7fb3177b5b80 10 client.9477 fetch_fsmap learned FSMap version 121 2023-10-06T11:17:07.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.342+0000 7fb3177b5b80 1 -- 172.21.15.146:0/3454907188 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=121,monmap=2+}) v3 -- 0x55fc8237a030 con 0x55fc82636c10 2023-10-06T11:17:07.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.342+0000 7fb2e67fc700 1 -- 172.21.15.146:0/3454907188 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fc825e16e0 con 0x55fc82636c10 2023-10-06T11:17:07.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.342+0000 7fb2e67fc700 1 -- 172.21.15.146:0/3454907188 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 121) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb300018780 con 0x55fc82636c10 2023-10-06T11:17:07.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.342+0000 7fb3177b5b80 10 client.9477 fetch_fsmap finished waiting for FSMap version 121 2023-10-06T11:17:07.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.342+0000 7fb3177b5b80 10 client.9477 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2023-10-06T11:17:07.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.342+0000 7fb3177b5b80 20 client.9477 populate_metadata read hostname 'smithi146' 2023-10-06T11:17:07.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.342+0000 7fb3177b5b80 1 --2- 172.21.15.146:0/3454907188 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x55fc82647060 0x55fc825e31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.343+0000 7fb3177b5b80 4 client.9477 mds_command: new command op to 9198 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:17:07.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.343+0000 7fb3177b5b80 1 -- 172.21.15.146:0/3454907188 --> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fc825be610 con 0x55fc82647060 2023-10-06T11:17:07.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.343+0000 7fb307fff700 1 --2- 172.21.15.146:0/3454907188 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x55fc82647060 0x55fc825e31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.343+0000 7fb307fff700 1 --2- 172.21.15.146:0/3454907188 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x55fc82647060 0x55fc825e31f0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b15e57c58c3232b7 server_cookie=725c2540b5b483b1 in_seq=0 out_seq=0 2023-10-06T11:17:07.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.343+0000 7fb2e67fc700 10 client.9477 ms_handle_connect on v2:172.21.15.146:6836/525107449 2023-10-06T11:17:07.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.343+0000 7fb2e67fc700 1 -- 172.21.15.146:0/3454907188 <== mds.0 v2:172.21.15.146:6836/525107449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55fc825be610 con 0x55fc82647060 2023-10-06T11:17:07.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.343+0000 7fb2e67fc700 10 client.9477 handle_command_reply: tid=0 2023-10-06T11:17:07.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.343+0000 7fb3177b5b80 1 client.9477 shutdown 2023-10-06T11:17:07.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.343+0000 7fb3177b5b80 1 -- 172.21.15.146:0/3454907188 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fc82636c10 msgr2=0x55fc82642e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:07.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.343+0000 7fb3177b5b80 1 --2- 172.21.15.146:0/3454907188 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fc82636c10 0x55fc82642e40 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7fb30000fe70 tx=0x7fb3000077b0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.344+0000 7fb3177b5b80 1 -- 172.21.15.146:0/3454907188 shutdown_connections 2023-10-06T11:17:07.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.344+0000 7fb3177b5b80 1 --2- 172.21.15.146:0/3454907188 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x55fc82647060 0x55fc825e31f0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.344+0000 7fb3177b5b80 1 --2- 172.21.15.146:0/3454907188 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fc82636c10 0x55fc82642e40 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.344+0000 7fb3177b5b80 1 --2- 172.21.15.146:0/3454907188 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc825ec9a0 0x55fc82611d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.344+0000 7fb3177b5b80 1 --2- 172.21.15.146:0/3454907188 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55fc82615eb0 0x55fc8262e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.344+0000 7fb2e67fc700 0 client.9477 ms_handle_reset on v2:172.21.15.146:6836/525107449 2023-10-06T11:17:07.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.344+0000 7fb3177b5b80 1 -- 172.21.15.146:0/3454907188 >> 172.21.15.146:0/3454907188 conn(0x55fc825ee2c0 msgr2=0x55fc826128e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:07.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.344+0000 7fb3177b5b80 1 -- 172.21.15.146:0/3454907188 shutdown_connections 2023-10-06T11:17:07.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.344+0000 7fb3177b5b80 1 -- 172.21.15.146:0/3454907188 wait complete. 2023-10-06T11:17:07.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.344+0000 7fb3177b5b80 20 client.9477 trim_cache size 0 max 16384 2023-10-06T11:17:07.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.356+0000 7fb3177b5b80 1 Processor -- start 2023-10-06T11:17:07.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.356+0000 7fb3177b5b80 1 -- start start 2023-10-06T11:17:07.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.357+0000 7fb3177b5b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fc825ec9a0 0x55fc8262e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.357+0000 7fb3177b5b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55fc82615eb0 0x55fc82611d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.357+0000 7fb3177b5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc82636c10 0x55fc82630280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.357+0000 7fb3177b5b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc823bfe80 con 0x55fc825ec9a0 2023-10-06T11:17:07.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.357+0000 7fb3177b5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc825ed280 con 0x55fc82636c10 2023-10-06T11:17:07.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.357+0000 7fb3177b5b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fc826307c0 con 0x55fc82615eb0 2023-10-06T11:17:07.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.357+0000 7fb307fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fc825ec9a0 0x55fc8262e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.357+0000 7fb307fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fc825ec9a0 0x55fc8262e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36172/0 (socket says 172.21.15.146:36172) 2023-10-06T11:17:07.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.357+0000 7fb307fff700 1 -- 172.21.15.146:0/1306950834 learned_addr learned my addr 172.21.15.146:0/1306950834 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:07.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.357+0000 7fb30ca5a700 1 --2- 172.21.15.146:0/1306950834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc82636c10 0x55fc82630280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.357+0000 7fb3077fe700 1 --2- 172.21.15.146:0/1306950834 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55fc82615eb0 0x55fc82611d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.357+0000 7fb307fff700 1 -- 172.21.15.146:0/1306950834 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55fc82615eb0 msgr2=0x55fc82611d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:07.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.357+0000 7fb307fff700 1 --2- 172.21.15.146:0/1306950834 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55fc82615eb0 0x55fc82611d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.357+0000 7fb307fff700 1 -- 172.21.15.146:0/1306950834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc82636c10 msgr2=0x55fc82630280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:07.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.357+0000 7fb307fff700 1 --2- 172.21.15.146:0/1306950834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc82636c10 0x55fc82630280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.357+0000 7fb307fff700 1 -- 172.21.15.146:0/1306950834 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc8250b7d0 con 0x55fc825ec9a0 2023-10-06T11:17:07.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.357+0000 7fb307fff700 1 --2- 172.21.15.146:0/1306950834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fc825ec9a0 0x55fc8262e5b0 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8003010 tx=0x7fb2f8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f86ab6a46a5d0bf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:07.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.357+0000 7fb2edffb700 1 -- 172.21.15.146:0/1306950834 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f8021040 con 0x55fc825ec9a0 2023-10-06T11:17:07.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.358+0000 7fb2edffb700 1 -- 172.21.15.146:0/1306950834 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f8011c00 con 0x55fc825ec9a0 2023-10-06T11:17:07.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.358+0000 7fb2edffb700 1 -- 172.21.15.146:0/1306950834 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f800bee0 con 0x55fc825ec9a0 2023-10-06T11:17:07.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.358+0000 7fb3177b5b80 1 -- 172.21.15.146:0/1306950834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fc825ec9a0 msgr2=0x55fc8262e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:07.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.358+0000 7fb3177b5b80 1 --2- 172.21.15.146:0/1306950834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fc825ec9a0 0x55fc8262e5b0 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8003010 tx=0x7fb2f8013000 comp rx=0 tx=0).stop 2023-10-06T11:17:07.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.358+0000 7fb3177b5b80 1 -- 172.21.15.146:0/1306950834 shutdown_connections 2023-10-06T11:17:07.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.358+0000 7fb3177b5b80 1 --2- 172.21.15.146:0/1306950834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc82636c10 0x55fc82630280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.358+0000 7fb3177b5b80 1 --2- 172.21.15.146:0/1306950834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fc825ec9a0 0x55fc8262e5b0 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.358+0000 7fb3177b5b80 1 --2- 172.21.15.146:0/1306950834 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55fc82615eb0 0x55fc82611d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.358+0000 7fb3177b5b80 1 -- 172.21.15.146:0/1306950834 >> 172.21.15.146:0/1306950834 conn(0x55fc825ee2c0 msgr2=0x55fc825ee690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:07.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.358+0000 7fb3177b5b80 1 -- 172.21.15.146:0/1306950834 shutdown_connections 2023-10-06T11:17:07.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.358+0000 7fb3177b5b80 1 -- 172.21.15.146:0/1306950834 wait complete. 2023-10-06T11:17:07.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.359+0000 7fb3177b5b80 1 -- start start 2023-10-06T11:17:07.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.359+0000 7fb3177b5b80 1 Processor -- start 2023-10-06T11:17:07.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb3177b5b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55fc825ec9a0 0x55fc82692ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb3177b5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc82615eb0 0x55fc82629470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb3177b5b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fc82636c10 0x55fc82699060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb3177b5b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc82629bc0 con 0x55fc82636c10 2023-10-06T11:17:07.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb3177b5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc826299b0 con 0x55fc82615eb0 2023-10-06T11:17:07.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb3177b5b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fc826150a0 con 0x55fc825ec9a0 2023-10-06T11:17:07.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb3177b5b80 10 client.0 _ll_register_callbacks cb 0x55fc823d9f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:17:07.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb30ca5a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fc82636c10 0x55fc82699060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb30ca5a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fc82636c10 0x55fc82699060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36186/0 (socket says 172.21.15.146:36186) 2023-10-06T11:17:07.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb30ca5a700 1 -- 172.21.15.146:0/3732558385 learned_addr learned my addr 172.21.15.146:0/3732558385 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:07.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb307fff700 1 --2- 172.21.15.146:0/3732558385 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55fc825ec9a0 0x55fc82692ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb3077fe700 1 --2- 172.21.15.146:0/3732558385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc82615eb0 0x55fc82629470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb30ca5a700 1 -- 172.21.15.146:0/3732558385 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55fc825ec9a0 msgr2=0x55fc82692ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:07.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb30ca5a700 1 --2- 172.21.15.146:0/3732558385 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55fc825ec9a0 0x55fc82692ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb30ca5a700 1 -- 172.21.15.146:0/3732558385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc82615eb0 msgr2=0x55fc82629470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:07.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb30ca5a700 1 --2- 172.21.15.146:0/3732558385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc82615eb0 0x55fc82629470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb30ca5a700 1 -- 172.21.15.146:0/3732558385 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fc823d72c0 con 0x55fc82636c10 2023-10-06T11:17:07.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb30ca5a700 1 --2- 172.21.15.146:0/3732558385 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fc82636c10 0x55fc82699060 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x55fc82644210 tx=0x7fb300020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=996e678ad8e8781b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:07.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb2e67fc700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:17:07.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb2e67fc700 1 -- 172.21.15.146:0/3732558385 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30000d950 con 0x55fc82636c10 2023-10-06T11:17:07.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb2e67fc700 1 -- 172.21.15.146:0/3732558385 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fb30000dd70 con 0x55fc82636c10 2023-10-06T11:17:07.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb3177b5b80 1 -- 172.21.15.146:0/3732558385 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fc825ea1d0 con 0x55fc82636c10 2023-10-06T11:17:07.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb2e67fc700 1 -- 172.21.15.146:0/3732558385 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=121) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb300027410 con 0x55fc82636c10 2023-10-06T11:17:07.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb3177b5b80 10 client.9483 fetch_fsmap learned FSMap version 121 2023-10-06T11:17:07.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb3177b5b80 1 -- 172.21.15.146:0/3732558385 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=121,monmap=2+}) v3 -- 0x55fc824f24c0 con 0x55fc82636c10 2023-10-06T11:17:07.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb2e67fc700 1 -- 172.21.15.146:0/3732558385 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fc825ea1d0 con 0x55fc82636c10 2023-10-06T11:17:07.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb2e67fc700 1 -- 172.21.15.146:0/3732558385 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 121) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb300027570 con 0x55fc82636c10 2023-10-06T11:17:07.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb3177b5b80 10 client.9483 fetch_fsmap finished waiting for FSMap version 121 2023-10-06T11:17:07.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb3177b5b80 10 client.9483 resolve_mds: resolved 10:0 to role '10:0' aka daemon mds.a 2023-10-06T11:17:07.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb3177b5b80 20 client.9483 populate_metadata read hostname 'smithi146' 2023-10-06T11:17:07.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb3177b5b80 1 --2- 172.21.15.146:0/3732558385 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x55fc8262e0c0 0x55fc826995a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb3177b5b80 4 client.9483 mds_command: new command op to 9198 tid=0[{"prefix": "damage ls"}] 2023-10-06T11:17:07.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb3177b5b80 1 -- 172.21.15.146:0/3732558385 --> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x7fb2f8011a90 con 0x55fc8262e0c0 2023-10-06T11:17:07.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb307fff700 1 --2- 172.21.15.146:0/3732558385 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x55fc8262e0c0 0x55fc826995a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb2e67fc700 10 client.9483 ms_handle_connect on v2:172.21.15.146:6836/525107449 2023-10-06T11:17:07.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb307fff700 1 --2- 172.21.15.146:0/3732558385 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x55fc8262e0c0 0x55fc826995a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e2c30fd55da4f91 server_cookie=f272cfe155944683 in_seq=0 out_seq=0 2023-10-06T11:17:07.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb2e67fc700 1 -- 172.21.15.146:0/3732558385 <== mds.0 v2:172.21.15.146:6836/525107449 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x7fb2f8011a90 con 0x55fc8262e0c0 2023-10-06T11:17:07.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb2e67fc700 10 client.9483 handle_command_reply: tid=0 2023-10-06T11:17:07.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb3177b5b80 1 client.9483 shutdown 2023-10-06T11:17:07.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb3177b5b80 1 -- 172.21.15.146:0/3732558385 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fc82636c10 msgr2=0x55fc82699060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:07.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb3177b5b80 1 --2- 172.21.15.146:0/3732558385 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fc82636c10 0x55fc82699060 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x55fc82644210 tx=0x7fb300020000 comp rx=0 tx=0).stop 2023-10-06T11:17:07.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb3177b5b80 1 -- 172.21.15.146:0/3732558385 shutdown_connections 2023-10-06T11:17:07.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb3177b5b80 1 --2- 172.21.15.146:0/3732558385 >> [v2:172.21.15.146:6836/525107449,v1:172.21.15.146:6837/525107449] conn(0x55fc8262e0c0 0x55fc826995a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb3177b5b80 1 --2- 172.21.15.146:0/3732558385 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55fc82636c10 0x55fc82699060 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb2e67fc700 0 client.9483 ms_handle_reset on v2:172.21.15.146:6836/525107449 2023-10-06T11:17:07.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb3177b5b80 1 --2- 172.21.15.146:0/3732558385 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55fc825ec9a0 0x55fc82692ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb3177b5b80 1 --2- 172.21.15.146:0/3732558385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fc82615eb0 0x55fc82629470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb3177b5b80 1 -- 172.21.15.146:0/3732558385 >> 172.21.15.146:0/3732558385 conn(0x55fc825ee2c0 msgr2=0x55fc82611d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:07.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb3177b5b80 1 -- 172.21.15.146:0/3732558385 shutdown_connections 2023-10-06T11:17:07.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.361+0000 7fb3177b5b80 1 -- 172.21.15.146:0/3732558385 wait complete. 2023-10-06T11:17:07.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.362+0000 7fb3177b5b80 20 client.9483 trim_cache size 0 max 16384 2023-10-06T11:17:07.374 INFO:teuthology.orchestra.run.smithi146.stdout:[] 2023-10-06T11:17:07.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.362+0000 7fb30d25b700 1 -- 172.21.15.146:0/2142171212 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb2f4066f30 msgr2=0x7fb2f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:07.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.362+0000 7fb30d25b700 1 --2- 172.21.15.146:0/2142171212 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb2f4066f30 0x7fb2f40693e0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fb2f80099b0 tx=0x7fb2f8016000 comp rx=0 tx=0).stop 2023-10-06T11:17:07.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.362+0000 7fb30d25b700 1 -- 172.21.15.146:0/2142171212 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3080b5640 msgr2=0x7fb3080c9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:07.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.362+0000 7fb30d25b700 1 --2- 172.21.15.146:0/2142171212 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3080b5640 0x7fb3080c9150 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc00b5e0 tx=0x7fb2fc0090f0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.362+0000 7fb30d25b700 1 -- 172.21.15.146:0/2142171212 shutdown_connections 2023-10-06T11:17:07.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.362+0000 7fb30d25b700 1 --2- 172.21.15.146:0/2142171212 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb2f4066f30 0x7fb2f40693e0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.362+0000 7fb30d25b700 1 --2- 172.21.15.146:0/2142171212 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb3080cb090 0x7fb3080c9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.362+0000 7fb30d25b700 1 --2- 172.21.15.146:0/2142171212 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb308068780 0x7fb3080c7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.362+0000 7fb30d25b700 1 --2- 172.21.15.146:0/2142171212 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3080b5640 0x7fb3080c9150 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.362+0000 7fb30d25b700 1 -- 172.21.15.146:0/2142171212 >> 172.21.15.146:0/2142171212 conn(0x7fb3080703f0 msgr2=0x7fb308153a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:07.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.362+0000 7fb30d25b700 1 -- 172.21.15.146:0/2142171212 shutdown_connections 2023-10-06T11:17:07.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.362+0000 7fb30d25b700 1 -- 172.21.15.146:0/2142171212 wait complete. 2023-10-06T11:17:07.377 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-06T11:17:07.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.490+0000 7fe898c94700 1 Processor -- start 2023-10-06T11:17:07.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.490+0000 7fe898c94700 1 -- start start 2023-10-06T11:17:07.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.490+0000 7fe898c94700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe894153ab0 0x7fe89415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.490+0000 7fe898c94700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe894068ba0 0x7fe8940b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.490+0000 7fe898c94700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe89415ac30 con 0x7fe894153e80 2023-10-06T11:17:07.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.490+0000 7fe898c94700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8940b4510 con 0x7fe894068ba0 2023-10-06T11:17:07.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.490+0000 7fe898c94700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8940b6530 con 0x7fe894153ab0 2023-10-06T11:17:07.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.491+0000 7fe889d9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe894153e80 0x7fe894068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60910/0 (socket says 172.21.15.146:60910) 2023-10-06T11:17:07.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.491+0000 7fe889d9b700 1 -- 172.21.15.146:0/2573637747 learned_addr learned my addr 172.21.15.146:0/2573637747 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:17:07.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.491+0000 7fe892d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe894068ba0 0x7fe8940b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.491+0000 7fe892d9d700 1 -- 172.21.15.146:0/2573637747 >> v2:172.21.15.151:3300/0 conn(0x7fe894153ab0 msgr2=0x7fe89415a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:07.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.491+0000 7fe892d9d700 1 --2- 172.21.15.146:0/2573637747 >> v2:172.21.15.151:3300/0 conn(0x7fe894153ab0 0x7fe89415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.491+0000 7fe892d9d700 1 -- 172.21.15.146:0/2573637747 >> v1:172.21.15.146:6789/0 conn(0x7fe894153e80 legacy=0x7fe894068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:07.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.491+0000 7fe891d9b700 1 -- 172.21.15.146:0/2573637747 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1668336897 0 0) 0x7fe87c001110 con 0x7fe894153e80 2023-10-06T11:17:07.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.491+0000 7fe892d9d700 1 -- 172.21.15.146:0/2573637747 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8940b5c50 con 0x7fe894068ba0 2023-10-06T11:17:07.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.491+0000 7fe892d9d700 1 --2- 172.21.15.146:0/2573637747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe894068ba0 0x7fe8940b49a0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7fe8940b5eb0 tx=0x7fe88c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28d33826e2cadd73 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:07.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.491+0000 7fe891d9b700 1 -- 172.21.15.146:0/2573637747 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c00e070 con 0x7fe894068ba0 2023-10-06T11:17:07.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.491+0000 7fe891d9b700 1 -- 172.21.15.146:0/2573637747 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88c00bc30 con 0x7fe894068ba0 2023-10-06T11:17:07.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.491+0000 7fe891d9b700 1 -- 172.21.15.146:0/2573637747 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c012430 con 0x7fe894068ba0 2023-10-06T11:17:07.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.492+0000 7fe898c94700 1 -- 172.21.15.146:0/2573637747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe894068ba0 msgr2=0x7fe8940b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:07.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.492+0000 7fe898c94700 1 --2- 172.21.15.146:0/2573637747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe894068ba0 0x7fe8940b49a0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7fe8940b5eb0 tx=0x7fe88c009780 comp rx=0 tx=0).stop 2023-10-06T11:17:07.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.492+0000 7fe898c94700 1 -- 172.21.15.146:0/2573637747 shutdown_connections 2023-10-06T11:17:07.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.492+0000 7fe898c94700 1 --2- 172.21.15.146:0/2573637747 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe894068ba0 0x7fe8940b49a0 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.492+0000 7fe898c94700 1 --2- 172.21.15.146:0/2573637747 >> v2:172.21.15.151:3300/0 conn(0x7fe894153ab0 0x7fe89415a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.492+0000 7fe898c94700 1 -- 172.21.15.146:0/2573637747 >> 172.21.15.146:0/2573637747 conn(0x7fe89406eba0 msgr2=0x7fe89406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:07.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.492+0000 7fe898c94700 1 -- 172.21.15.146:0/2573637747 shutdown_connections 2023-10-06T11:17:07.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.492+0000 7fe898c94700 1 -- 172.21.15.146:0/2573637747 wait complete. 2023-10-06T11:17:07.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.493+0000 7fe898c94700 1 Processor -- start 2023-10-06T11:17:07.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.493+0000 7fe898c94700 1 -- start start 2023-10-06T11:17:07.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.495+0000 7fe898c94700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe894068ba0 0x7fe894157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.495+0000 7fe898c94700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe894153ab0 0x7fe894150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.495+0000 7fe898c94700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe894153e80 0x7fe894159da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.495+0000 7fe898c94700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe894157b40 con 0x7fe894068ba0 2023-10-06T11:17:07.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.495+0000 7fe898c94700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8941558e0 con 0x7fe894153ab0 2023-10-06T11:17:07.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.495+0000 7fe898c94700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8941552b0 con 0x7fe894153e80 2023-10-06T11:17:07.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.495+0000 7fe89259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe894068ba0 0x7fe894157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.495+0000 7fe89259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe894068ba0 0x7fe894157600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36190/0 (socket says 172.21.15.146:36190) 2023-10-06T11:17:07.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.495+0000 7fe89259c700 1 -- 172.21.15.146:0/3701350988 learned_addr learned my addr 172.21.15.146:0/3701350988 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:07.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.495+0000 7fe892d9d700 1 --2- 172.21.15.146:0/3701350988 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe894153e80 0x7fe894159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.495+0000 7fe889d9b700 1 --2- 172.21.15.146:0/3701350988 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe894153ab0 0x7fe894150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.495+0000 7fe89259c700 1 -- 172.21.15.146:0/3701350988 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe894153e80 msgr2=0x7fe894159da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:07.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.495+0000 7fe89259c700 1 --2- 172.21.15.146:0/3701350988 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe894153e80 0x7fe894159da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.495+0000 7fe89259c700 1 -- 172.21.15.146:0/3701350988 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe894153ab0 msgr2=0x7fe894150710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:07.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.495+0000 7fe89259c700 1 --2- 172.21.15.146:0/3701350988 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe894153ab0 0x7fe894150710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.495+0000 7fe89259c700 1 -- 172.21.15.146:0/3701350988 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe88c009a20 con 0x7fe894068ba0 2023-10-06T11:17:07.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.495+0000 7fe89259c700 1 --2- 172.21.15.146:0/3701350988 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe894068ba0 0x7fe894157600 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7fe88400b810 tx=0x7fe884009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:07.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.495+0000 7fe88affd700 1 -- 172.21.15.146:0/3701350988 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88400f510 con 0x7fe894068ba0 2023-10-06T11:17:07.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.495+0000 7fe88affd700 1 -- 172.21.15.146:0/3701350988 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88400f690 con 0x7fe894068ba0 2023-10-06T11:17:07.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.495+0000 7fe88affd700 1 -- 172.21.15.146:0/3701350988 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88400fa50 con 0x7fe894068ba0 2023-10-06T11:17:07.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.495+0000 7fe898c94700 1 -- 172.21.15.146:0/3701350988 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe894158d00 con 0x7fe894068ba0 2023-10-06T11:17:07.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.495+0000 7fe898c94700 1 -- 172.21.15.146:0/3701350988 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe894155570 con 0x7fe894068ba0 2023-10-06T11:17:07.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.495+0000 7fe898c94700 1 -- 172.21.15.146:0/3701350988 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe894069330 con 0x7fe894068ba0 2023-10-06T11:17:07.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.496+0000 7fe88affd700 1 -- 172.21.15.146:0/3701350988 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe88401a400 con 0x7fe894068ba0 2023-10-06T11:17:07.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.496+0000 7fe88affd700 1 --2- 172.21.15.146:0/3701350988 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe874066f30 0x7fe8740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:07.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.496+0000 7fe88affd700 1 -- 172.21.15.146:0/3701350988 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fe8840841a0 con 0x7fe894068ba0 2023-10-06T11:17:07.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.496+0000 7fe889d9b700 1 --2- 172.21.15.146:0/3701350988 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe874066f30 0x7fe8740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:07.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.496+0000 7fe889d9b700 1 --2- 172.21.15.146:0/3701350988 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe874066f30 0x7fe8740693e0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fe894159490 tx=0x7fe87c007b90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:07.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.501+0000 7fe88affd700 1 -- 172.21.15.146:0/3701350988 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe8840512f0 con 0x7fe894068ba0 2023-10-06T11:17:07.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.727+0000 7fe898c94700 1 -- 172.21.15.146:0/3701350988 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe89404c380 con 0x7fe894068ba0 2023-10-06T11:17:07.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.727+0000 7fe88affd700 1 -- 172.21.15.146:0/3701350988 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fe884054910 con 0x7fe894068ba0 2023-10-06T11:17:07.730 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:07.731 INFO:teuthology.orchestra.run.smithi146.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-06T11:17:07.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.729+0000 7fe898c94700 1 -- 172.21.15.146:0/3701350988 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe874066f30 msgr2=0x7fe8740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:07.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.729+0000 7fe898c94700 1 --2- 172.21.15.146:0/3701350988 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe874066f30 0x7fe8740693e0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fe894159490 tx=0x7fe87c007b90 comp rx=0 tx=0).stop 2023-10-06T11:17:07.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.729+0000 7fe898c94700 1 -- 172.21.15.146:0/3701350988 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe894068ba0 msgr2=0x7fe894157600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:07.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.729+0000 7fe898c94700 1 --2- 172.21.15.146:0/3701350988 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe894068ba0 0x7fe894157600 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7fe88400b810 tx=0x7fe884009250 comp rx=0 tx=0).stop 2023-10-06T11:17:07.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.729+0000 7fe898c94700 1 -- 172.21.15.146:0/3701350988 shutdown_connections 2023-10-06T11:17:07.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.729+0000 7fe898c94700 1 --2- 172.21.15.146:0/3701350988 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe874066f30 0x7fe8740693e0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.729+0000 7fe898c94700 1 --2- 172.21.15.146:0/3701350988 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe894153e80 0x7fe894159da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.729+0000 7fe898c94700 1 --2- 172.21.15.146:0/3701350988 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe894068ba0 0x7fe894157600 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.729+0000 7fe898c94700 1 --2- 172.21.15.146:0/3701350988 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe894153ab0 0x7fe894150710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:07.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.729+0000 7fe898c94700 1 -- 172.21.15.146:0/3701350988 >> 172.21.15.146:0/3701350988 conn(0x7fe89406eba0 msgr2=0x7fe894151d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:07.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.730+0000 7fe898c94700 1 -- 172.21.15.146:0/3701350988 shutdown_connections 2023-10-06T11:17:07.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:07.730+0000 7fe898c94700 1 -- 172.21.15.146:0/3701350988 wait complete. 2023-10-06T11:17:07.743 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T11:17:07.744 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:17:07.792 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:17:07.832 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T11:17:07.832 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi146.front.sepia.ceph.com... 2023-10-06T11:17:07.832 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T11:17:07.833 DEBUG:teuthology.orchestra.run.smithi146:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T11:17:07.869 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[151321]: fuse finished with error 0 and tester_r 0 2023-10-06T11:17:07.871 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-10-06T11:17:07.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:17:07.871 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T11:17:07.955 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-10-06T11:17:07.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:17:07.956 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T11:17:07.973 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:17:07.973 INFO:teuthology.orchestra.run.smithi151.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-06T11:17:07.974 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-10-06T11:17:07.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:17:07.974 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T11:17:08.010 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:17:08.010 INFO:teuthology.orchestra.run.smithi146.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-06T11:17:08.010 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-10-06T11:17:08.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:17:08.011 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T11:17:08.029 INFO:teuthology.orchestra.run.smithi151.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-06T11:17:08.030 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:17:08.030 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:17:08.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.164+0000 7f3218831700 1 Processor -- start 2023-10-06T11:17:08.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.164+0000 7f3218831700 1 -- start start 2023-10-06T11:17:08.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.166+0000 7f3218831700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f321415a420 0x7f321415cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:08.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.166+0000 7f3218831700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f32140b2530 0x7f321415acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:08.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.166+0000 7f3218831700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f321415c630 con 0x7f321415a7f0 2023-10-06T11:17:08.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.166+0000 7f3218831700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32140ce040 con 0x7f321415a420 2023-10-06T11:17:08.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.166+0000 7f3218831700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f321415ba20 con 0x7f32140b2530 2023-10-06T11:17:08.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.166+0000 7f3212d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f321415a420 0x7f321415cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:08.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.166+0000 7f320a59c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f321415a7f0 0x7f32140b1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60912/0 (socket says 172.21.15.146:60912) 2023-10-06T11:17:08.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.166+0000 7f320a59c700 1 -- 172.21.15.146:0/4169972074 learned_addr learned my addr 172.21.15.146:0/4169972074 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:17:08.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.166+0000 7f321359e700 1 --2- 172.21.15.146:0/4169972074 >> v2:172.21.15.151:3300/0 conn(0x7f32140b2530 0x7f321415acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:08.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.166+0000 7f3212d9d700 1 -- 172.21.15.146:0/4169972074 >> v2:172.21.15.151:3300/0 conn(0x7f32140b2530 msgr2=0x7f321415acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:08.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.166+0000 7f3212d9d700 1 --2- 172.21.15.146:0/4169972074 >> v2:172.21.15.151:3300/0 conn(0x7f32140b2530 0x7f321415acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:08.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.166+0000 7f3212d9d700 1 -- 172.21.15.146:0/4169972074 >> v1:172.21.15.146:6789/0 conn(0x7f321415a7f0 legacy=0x7f32140b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:08.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.166+0000 7f3212d9d700 1 -- 172.21.15.146:0/4169972074 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f321415bd00 con 0x7f321415a420 2023-10-06T11:17:08.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.166+0000 7f321259c700 1 -- 172.21.15.146:0/4169972074 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3791695890 0 0) 0x7f321415c630 con 0x7f321415a7f0 2023-10-06T11:17:08.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.166+0000 7f3212d9d700 1 --2- 172.21.15.146:0/4169972074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f321415a420 0x7f321415cac0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f321415c5a0 tx=0x7f32040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b457c93f0d5e2f63 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:08.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.166+0000 7f321259c700 1 -- 172.21.15.146:0/4169972074 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320400b6b0 con 0x7f321415a420 2023-10-06T11:17:08.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.166+0000 7f321259c700 1 -- 172.21.15.146:0/4169972074 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f320400b810 con 0x7f321415a420 2023-10-06T11:17:08.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.166+0000 7f321259c700 1 -- 172.21.15.146:0/4169972074 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320400bbb0 con 0x7f321415a420 2023-10-06T11:17:08.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.166+0000 7f3218831700 1 -- 172.21.15.146:0/4169972074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f321415a420 msgr2=0x7f321415cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:08.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.166+0000 7f3218831700 1 --2- 172.21.15.146:0/4169972074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f321415a420 0x7f321415cac0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f321415c5a0 tx=0x7f32040091a0 comp rx=0 tx=0).stop 2023-10-06T11:17:08.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.166+0000 7f3218831700 1 -- 172.21.15.146:0/4169972074 shutdown_connections 2023-10-06T11:17:08.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.166+0000 7f3218831700 1 --2- 172.21.15.146:0/4169972074 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f321415a420 0x7f321415cac0 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:08.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.166+0000 7f3218831700 1 --2- 172.21.15.146:0/4169972074 >> v2:172.21.15.151:3300/0 conn(0x7f32140b2530 0x7f321415acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:08.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.166+0000 7f3218831700 1 -- 172.21.15.146:0/4169972074 >> 172.21.15.146:0/4169972074 conn(0x7f321406eba0 msgr2=0x7f321406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:08.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.166+0000 7f3218831700 1 -- 172.21.15.146:0/4169972074 shutdown_connections 2023-10-06T11:17:08.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.166+0000 7f3218831700 1 -- 172.21.15.146:0/4169972074 wait complete. 2023-10-06T11:17:08.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.167+0000 7f3218831700 1 Processor -- start 2023-10-06T11:17:08.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.167+0000 7f3218831700 1 -- start start 2023-10-06T11:17:08.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.168+0000 7f3218831700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32140b2530 0x7f321413ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:08.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.168+0000 7f3218831700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f321415a420 0x7f32141559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:08.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.168+0000 7f3218831700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f321415a7f0 0x7f3214155f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:08.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.168+0000 7f3218831700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32141574f0 con 0x7f321415a420 2023-10-06T11:17:08.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.168+0000 7f3218831700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3214155470 con 0x7f32140b2530 2023-10-06T11:17:08.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.168+0000 7f3218831700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3214150fa0 con 0x7f321415a7f0 2023-10-06T11:17:08.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.168+0000 7f320a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f321415a420 0x7f32141559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:08.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.168+0000 7f320a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f321415a420 0x7f32141559f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36210/0 (socket says 172.21.15.146:36210) 2023-10-06T11:17:08.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.168+0000 7f320a59c700 1 -- 172.21.15.146:0/3063595627 learned_addr learned my addr 172.21.15.146:0/3063595627 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:08.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.168+0000 7f3212d9d700 1 --2- 172.21.15.146:0/3063595627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32140b2530 0x7f321413ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:08.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.168+0000 7f321359e700 1 --2- 172.21.15.146:0/3063595627 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f321415a7f0 0x7f3214155f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:08.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.168+0000 7f320a59c700 1 -- 172.21.15.146:0/3063595627 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f321415a7f0 msgr2=0x7f3214155f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:08.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.168+0000 7f320a59c700 1 --2- 172.21.15.146:0/3063595627 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f321415a7f0 0x7f3214155f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:08.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.168+0000 7f320a59c700 1 -- 172.21.15.146:0/3063595627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32140b2530 msgr2=0x7f321413ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:08.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.168+0000 7f320a59c700 1 --2- 172.21.15.146:0/3063595627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32140b2530 0x7f321413ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:08.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.168+0000 7f320a59c700 1 -- 172.21.15.146:0/3063595627 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3204009420 con 0x7f321415a420 2023-10-06T11:17:08.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.168+0000 7f321359e700 1 --2- 172.21.15.146:0/3063595627 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f321415a7f0 0x7f3214155f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:17:08.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.169+0000 7f320a59c700 1 --2- 172.21.15.146:0/3063595627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f321415a420 0x7f32141559f0 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f31fc00c5b0 tx=0x7f31fc001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:08.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.169+0000 7f320b7fe700 1 -- 172.21.15.146:0/3063595627 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc005b30 con 0x7f321415a420 2023-10-06T11:17:08.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.169+0000 7f320b7fe700 1 -- 172.21.15.146:0/3063595627 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31fc005c90 con 0x7f321415a420 2023-10-06T11:17:08.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.169+0000 7f3218831700 1 -- 172.21.15.146:0/3063595627 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f321416ac10 con 0x7f321415a420 2023-10-06T11:17:08.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.169+0000 7f320b7fe700 1 -- 172.21.15.146:0/3063595627 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31fc007300 con 0x7f321415a420 2023-10-06T11:17:08.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.169+0000 7f3218831700 1 -- 172.21.15.146:0/3063595627 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3214155190 con 0x7f321415a420 2023-10-06T11:17:08.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.170+0000 7f3218831700 1 -- 172.21.15.146:0/3063595627 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3214151110 con 0x7f321415a420 2023-10-06T11:17:08.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.170+0000 7f320b7fe700 1 -- 172.21.15.146:0/3063595627 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f31fc01b3b0 con 0x7f321415a420 2023-10-06T11:17:08.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.170+0000 7f320b7fe700 1 --2- 172.21.15.146:0/3063595627 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f31f4066fb0 0x7f31f4069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:08.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.171+0000 7f320b7fe700 1 -- 172.21.15.146:0/3063595627 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f31fc083bf0 con 0x7f321415a420 2023-10-06T11:17:08.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.171+0000 7f3212d9d700 1 --2- 172.21.15.146:0/3063595627 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f31f4066fb0 0x7f31f4069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:08.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.171+0000 7f3212d9d700 1 --2- 172.21.15.146:0/3063595627 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f31f4066fb0 0x7f31f4069460 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f32040093f0 tx=0x7f3204017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:08.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.175+0000 7f320b7fe700 1 -- 172.21.15.146:0/3063595627 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f31fc050c20 con 0x7f321415a420 2023-10-06T11:17:08.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.397+0000 7f3218831700 1 -- 172.21.15.146:0/3063595627 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f321415bfe0 con 0x7f321415a420 2023-10-06T11:17:08.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.399+0000 7f320b7fe700 1 -- 172.21.15.146:0/3063595627 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 121 v121) v1 ==== 95+0+4610 (secure 0 0 0) 0x7f31fc017090 con 0x7f321415a420 2023-10-06T11:17:08.400 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:08.400 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":121,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7181,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/255475004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":255475004},{"type":"v1","addr":"172.21.15.151:6834","nonce":255475004}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":116},{"gid":7184,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/206881843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":206881843},{"type":"v1","addr":"172.21.15.151:6835","nonce":206881843}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":116},{"gid":9192,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/3140231910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3140231910},{"type":"v1","addr":"172.21.15.146:6835","nonce":3140231910}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":116}],"filesystems":[{"mdsmap":{"epoch":121,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:16:23.472674+0000","modified":"2023-10-06T11:16:27.116489+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9198},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9198":{"gid":9198,"name":"a","rank":0,"incarnation":117,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/525107449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":525107449},{"type":"v1","addr":"172.21.15.146:6837","nonce":525107449}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-06T11:17:08.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.401+0000 7f3218831700 1 -- 172.21.15.146:0/3063595627 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f31f4066fb0 msgr2=0x7f31f4069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:08.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.401+0000 7f3218831700 1 --2- 172.21.15.146:0/3063595627 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f31f4066fb0 0x7f31f4069460 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f32040093f0 tx=0x7f3204017000 comp rx=0 tx=0).stop 2023-10-06T11:17:08.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.401+0000 7f3218831700 1 -- 172.21.15.146:0/3063595627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f321415a420 msgr2=0x7f32141559f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:08.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.401+0000 7f3218831700 1 --2- 172.21.15.146:0/3063595627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f321415a420 0x7f32141559f0 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f31fc00c5b0 tx=0x7f31fc001070 comp rx=0 tx=0).stop 2023-10-06T11:17:08.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.401+0000 7f3218831700 1 -- 172.21.15.146:0/3063595627 shutdown_connections 2023-10-06T11:17:08.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.401+0000 7f3218831700 1 --2- 172.21.15.146:0/3063595627 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f31f4066fb0 0x7f31f4069460 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:08.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.401+0000 7f3218831700 1 --2- 172.21.15.146:0/3063595627 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f321415a7f0 0x7f3214155f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:08.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.401+0000 7f3218831700 1 --2- 172.21.15.146:0/3063595627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32140b2530 0x7f321413ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:08.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.401+0000 7f3218831700 1 --2- 172.21.15.146:0/3063595627 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f321415a420 0x7f32141559f0 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:08.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.401+0000 7f3218831700 1 -- 172.21.15.146:0/3063595627 >> 172.21.15.146:0/3063595627 conn(0x7f321406eba0 msgr2=0x7f32140aff60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:08.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.401+0000 7f3218831700 1 -- 172.21.15.146:0/3063595627 shutdown_connections 2023-10-06T11:17:08.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.401+0000 7f3218831700 1 -- 172.21.15.146:0/3063595627 wait complete. 2023-10-06T11:17:08.403 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 121 2023-10-06T11:17:08.414 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:17:08.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.528+0000 7f737385f700 1 Processor -- start 2023-10-06T11:17:08.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.528+0000 7f737385f700 1 -- start start 2023-10-06T11:17:08.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.529+0000 7f737385f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f736c068ba0 0x7f736c15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:08.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.529+0000 7f737385f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f736c153e80 0x7f736c0b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:08.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.529+0000 7f737385f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f736c15ac30 con 0x7f736c153ab0 2023-10-06T11:17:08.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.529+0000 7f737385f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f736c0b4510 con 0x7f736c068ba0 2023-10-06T11:17:08.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.529+0000 7f737385f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f736c0b6530 con 0x7f736c153e80 2023-10-06T11:17:08.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.529+0000 7f7370dfa700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f736c068ba0 0x7f736c15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:08.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.529+0000 7f73715fb700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f736c153ab0 0x7f736c068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60914/0 (socket says 172.21.15.146:60914) 2023-10-06T11:17:08.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.529+0000 7f73715fb700 1 -- 172.21.15.146:0/4084353224 learned_addr learned my addr 172.21.15.146:0/4084353224 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:17:08.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.530+0000 7f7370dfa700 1 -- 172.21.15.146:0/4084353224 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f736c153e80 msgr2=0x7f736c0b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:08.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.530+0000 7f7371dfc700 1 --2- 172.21.15.146:0/4084353224 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f736c153e80 0x7f736c0b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:08.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.530+0000 7f7363fff700 1 -- 172.21.15.146:0/4084353224 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3345516391 0 0) 0x7f7368001490 con 0x7f736c153ab0 2023-10-06T11:17:08.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.530+0000 7f7370dfa700 1 --2- 172.21.15.146:0/4084353224 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f736c153e80 0x7f736c0b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:08.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.530+0000 7f7370dfa700 1 -- 172.21.15.146:0/4084353224 >> v1:172.21.15.146:6789/0 conn(0x7f736c153ab0 legacy=0x7f736c068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:08.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.530+0000 7f7370dfa700 1 -- 172.21.15.146:0/4084353224 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f736c0b5c50 con 0x7f736c068ba0 2023-10-06T11:17:08.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.530+0000 7f7370dfa700 1 --2- 172.21.15.146:0/4084353224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f736c068ba0 0x7f736c15a6f0 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f735c0098e0 tx=0x7f735c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f563e1bb8b66008b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:08.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.530+0000 7f7363fff700 1 -- 172.21.15.146:0/4084353224 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735c009e80 con 0x7f736c068ba0 2023-10-06T11:17:08.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.530+0000 7f7363fff700 1 -- 172.21.15.146:0/4084353224 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f735c00b860 con 0x7f736c068ba0 2023-10-06T11:17:08.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.530+0000 7f7363fff700 1 -- 172.21.15.146:0/4084353224 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735c00bbe0 con 0x7f736c068ba0 2023-10-06T11:17:08.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.530+0000 7f737385f700 1 -- 172.21.15.146:0/4084353224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f736c068ba0 msgr2=0x7f736c15a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:08.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.530+0000 7f737385f700 1 --2- 172.21.15.146:0/4084353224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f736c068ba0 0x7f736c15a6f0 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f735c0098e0 tx=0x7f735c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:17:08.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.530+0000 7f737385f700 1 -- 172.21.15.146:0/4084353224 shutdown_connections 2023-10-06T11:17:08.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.530+0000 7f737385f700 1 --2- 172.21.15.146:0/4084353224 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f736c153e80 0x7f736c0b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:08.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.531+0000 7f737385f700 1 --2- 172.21.15.146:0/4084353224 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f736c068ba0 0x7f736c15a6f0 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:08.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.531+0000 7f737385f700 1 -- 172.21.15.146:0/4084353224 >> 172.21.15.146:0/4084353224 conn(0x7f736c06eba0 msgr2=0x7f736c06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:08.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.531+0000 7f737385f700 1 -- 172.21.15.146:0/4084353224 shutdown_connections 2023-10-06T11:17:08.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.531+0000 7f737385f700 1 -- 172.21.15.146:0/4084353224 wait complete. 2023-10-06T11:17:08.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.532+0000 7f737385f700 1 Processor -- start 2023-10-06T11:17:08.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.532+0000 7f737385f700 1 -- start start 2023-10-06T11:17:08.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.533+0000 7f737385f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f736c068ba0 0x7f736c151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:08.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.533+0000 7f737385f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f736c153ab0 0x7f736c14d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:08.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.533+0000 7f737385f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f736c153e80 0x7f736c146f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:08.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.533+0000 7f737385f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f736c14e540 con 0x7f736c068ba0 2023-10-06T11:17:08.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.533+0000 7f737385f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f736c16dd10 con 0x7f736c153ab0 2023-10-06T11:17:08.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.533+0000 7f737385f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f736c14e260 con 0x7f736c153e80 2023-10-06T11:17:08.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.533+0000 7f73715fb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f736c068ba0 0x7f736c151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:08.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.533+0000 7f73715fb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f736c068ba0 0x7f736c151280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36222/0 (socket says 172.21.15.146:36222) 2023-10-06T11:17:08.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.533+0000 7f73715fb700 1 -- 172.21.15.146:0/1099569079 learned_addr learned my addr 172.21.15.146:0/1099569079 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:08.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.533+0000 7f7371dfc700 1 --2- 172.21.15.146:0/1099569079 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f736c153e80 0x7f736c146f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:08.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.533+0000 7f7370dfa700 1 --2- 172.21.15.146:0/1099569079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f736c153ab0 0x7f736c14d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:08.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.533+0000 7f73715fb700 1 -- 172.21.15.146:0/1099569079 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f736c153e80 msgr2=0x7f736c146f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:08.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.533+0000 7f73715fb700 1 --2- 172.21.15.146:0/1099569079 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f736c153e80 0x7f736c146f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:08.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.533+0000 7f73715fb700 1 -- 172.21.15.146:0/1099569079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f736c153ab0 msgr2=0x7f736c14d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:08.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.533+0000 7f73715fb700 1 --2- 172.21.15.146:0/1099569079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f736c153ab0 0x7f736c14d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:08.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.533+0000 7f73715fb700 1 -- 172.21.15.146:0/1099569079 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f735c009420 con 0x7f736c068ba0 2023-10-06T11:17:08.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.533+0000 7f73715fb700 1 --2- 172.21.15.146:0/1099569079 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f736c068ba0 0x7f736c151280 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f736800cd80 tx=0x7f7368001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:08.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.533+0000 7f73617fa700 1 -- 172.21.15.146:0/1099569079 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736800ce80 con 0x7f736c068ba0 2023-10-06T11:17:08.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.533+0000 7f73617fa700 1 -- 172.21.15.146:0/1099569079 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f736800aac0 con 0x7f736c068ba0 2023-10-06T11:17:08.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.533+0000 7f73617fa700 1 -- 172.21.15.146:0/1099569079 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736800ae40 con 0x7f736c068ba0 2023-10-06T11:17:08.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.533+0000 7f737385f700 1 -- 172.21.15.146:0/1099569079 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f736c16d6c0 con 0x7f736c068ba0 2023-10-06T11:17:08.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.533+0000 7f737385f700 1 -- 172.21.15.146:0/1099569079 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f736c1517c0 con 0x7f736c068ba0 2023-10-06T11:17:08.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.534+0000 7f737385f700 1 -- 172.21.15.146:0/1099569079 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f736c16d520 con 0x7f736c068ba0 2023-10-06T11:17:08.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.535+0000 7f73617fa700 1 -- 172.21.15.146:0/1099569079 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7368007300 con 0x7f736c068ba0 2023-10-06T11:17:08.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.535+0000 7f73617fa700 1 --2- 172.21.15.146:0/1099569079 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7350066f30 0x7f73500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:08.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.535+0000 7f73617fa700 1 -- 172.21.15.146:0/1099569079 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f7368084950 con 0x7f736c068ba0 2023-10-06T11:17:08.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.535+0000 7f7370dfa700 1 --2- 172.21.15.146:0/1099569079 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7350066f30 0x7f73500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:08.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.535+0000 7f7370dfa700 1 --2- 172.21.15.146:0/1099569079 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7350066f30 0x7f73500693e0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f736c068fa0 tx=0x7f735c017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:08.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.539+0000 7f73617fa700 1 -- 172.21.15.146:0/1099569079 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f736c16d520 con 0x7f736c068ba0 2023-10-06T11:17:08.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.726+0000 7f737385f700 1 -- 172.21.15.146:0/1099569079 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f736c15ac30 con 0x7f736c068ba0 2023-10-06T11:17:08.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.727+0000 7f73617fa700 1 -- 172.21.15.146:0/1099569079 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) v1 ==== 74+0+17026 (secure 0 0 0) 0x7f736c15ac30 con 0x7f736c068ba0 2023-10-06T11:17:08.728 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:08.728 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":139,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:16:33.419424+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:16:21.174178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-10-06T11:16:22.437689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.21","mappings":[{"from":3,"to":0}]},{"pgid":"22.3a","mappings":[{"from":3,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:17:08.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.729+0000 7f737385f700 1 -- 172.21.15.146:0/1099569079 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7350066f30 msgr2=0x7f73500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:08.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.729+0000 7f737385f700 1 --2- 172.21.15.146:0/1099569079 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7350066f30 0x7f73500693e0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f736c068fa0 tx=0x7f735c017000 comp rx=0 tx=0).stop 2023-10-06T11:17:08.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.729+0000 7f737385f700 1 -- 172.21.15.146:0/1099569079 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f736c068ba0 msgr2=0x7f736c151280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:08.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.729+0000 7f737385f700 1 --2- 172.21.15.146:0/1099569079 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f736c068ba0 0x7f736c151280 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f736800cd80 tx=0x7f7368001ad0 comp rx=0 tx=0).stop 2023-10-06T11:17:08.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.729+0000 7f737385f700 1 -- 172.21.15.146:0/1099569079 shutdown_connections 2023-10-06T11:17:08.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.729+0000 7f737385f700 1 --2- 172.21.15.146:0/1099569079 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7350066f30 0x7f73500693e0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:08.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.729+0000 7f737385f700 1 --2- 172.21.15.146:0/1099569079 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f736c153e80 0x7f736c146f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:08.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.729+0000 7f737385f700 1 --2- 172.21.15.146:0/1099569079 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f736c068ba0 0x7f736c151280 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:08.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.729+0000 7f737385f700 1 --2- 172.21.15.146:0/1099569079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f736c153ab0 0x7f736c14d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:08.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.729+0000 7f737385f700 1 -- 172.21.15.146:0/1099569079 >> 172.21.15.146:0/1099569079 conn(0x7f736c06eba0 msgr2=0x7f736c1521c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:08.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.729+0000 7f737385f700 1 -- 172.21.15.146:0/1099569079 shutdown_connections 2023-10-06T11:17:08.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.729+0000 7f737385f700 1 -- 172.21.15.146:0/1099569079 wait complete. 2023-10-06T11:17:08.745 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:05:36.687307+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:05:37.171199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T11:16:21.174178+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '136', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T11:16:22.437689+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '137', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T11:17:08.747 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:17:08.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.864+0000 7f65d8b6e700 1 Processor -- start 2023-10-06T11:17:08.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.864+0000 7f65d8b6e700 1 -- start start 2023-10-06T11:17:08.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.865+0000 7f65d8b6e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f65d415a160 0x7f65d40c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:08.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.865+0000 7f65d8b6e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f65d40ae730 0x7f65d40aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:08.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.865+0000 7f65d8b6e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65d40ae2a0 con 0x7f65d40ce3d0 2023-10-06T11:17:08.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.865+0000 7f65d8b6e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65d415a530 con 0x7f65d40ae730 2023-10-06T11:17:08.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.865+0000 7f65d8b6e700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65d40af0f0 con 0x7f65d415a160 2023-10-06T11:17:08.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.865+0000 7f65d1d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f65d40ae730 0x7f65d40aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:08.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.865+0000 7f65d1d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f65d40ae730 0x7f65d40aebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36224/0 (socket says 172.21.15.146:36224) 2023-10-06T11:17:08.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.865+0000 7f65d1d9b700 1 -- 172.21.15.146:0/2385881980 learned_addr learned my addr 172.21.15.146:0/2385881980 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:08.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.865+0000 7f65d259c700 1 --2- 172.21.15.146:0/2385881980 >> v2:172.21.15.151:3300/0 conn(0x7f65d415a160 0x7f65d40c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:08.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.865+0000 7f65d1d9b700 1 -- 172.21.15.146:0/2385881980 >> v2:172.21.15.151:3300/0 conn(0x7f65d415a160 msgr2=0x7f65d40c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:08.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.865+0000 7f65d1d9b700 1 --2- 172.21.15.146:0/2385881980 >> v2:172.21.15.151:3300/0 conn(0x7f65d415a160 0x7f65d40c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:08.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.865+0000 7f65d1d9b700 1 -- 172.21.15.146:0/2385881980 >> v1:172.21.15.151:6789/0 conn(0x7f65d40ce3d0 legacy=0x7f65d40ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:08.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.865+0000 7f65d1d9b700 1 -- 172.21.15.146:0/2385881980 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d40ad690 con 0x7f65d40ae730 2023-10-06T11:17:08.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.865+0000 7f65d1d9b700 1 --2- 172.21.15.146:0/2385881980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65d40ae730 0x7f65d40aebb0 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f65d4065100 tx=0x7f65c8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb2d1e9431b4a835 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:08.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.866+0000 7f65d159a700 1 -- 172.21.15.146:0/2385881980 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c8009e70 con 0x7f65d40ae730 2023-10-06T11:17:08.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.866+0000 7f65d159a700 1 -- 172.21.15.146:0/2385881980 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c800b860 con 0x7f65d40ae730 2023-10-06T11:17:08.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.866+0000 7f65d159a700 1 -- 172.21.15.146:0/2385881980 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c800bc00 con 0x7f65d40ae730 2023-10-06T11:17:08.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.866+0000 7f65d8b6e700 1 -- 172.21.15.146:0/2385881980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65d40ae730 msgr2=0x7f65d40aebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:08.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.866+0000 7f65d8b6e700 1 --2- 172.21.15.146:0/2385881980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65d40ae730 0x7f65d40aebb0 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f65d4065100 tx=0x7f65c8009250 comp rx=0 tx=0).stop 2023-10-06T11:17:08.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.866+0000 7f65d8b6e700 1 -- 172.21.15.146:0/2385881980 shutdown_connections 2023-10-06T11:17:08.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.866+0000 7f65d8b6e700 1 --2- 172.21.15.146:0/2385881980 >> v2:172.21.15.151:3300/0 conn(0x7f65d415a160 0x7f65d40c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:08.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.866+0000 7f65d8b6e700 1 --2- 172.21.15.146:0/2385881980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65d40ae730 0x7f65d40aebb0 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:08.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.866+0000 7f65d8b6e700 1 -- 172.21.15.146:0/2385881980 >> 172.21.15.146:0/2385881980 conn(0x7f65d406f380 msgr2=0x7f65d40d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:08.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.866+0000 7f65d8b6e700 1 -- 172.21.15.146:0/2385881980 shutdown_connections 2023-10-06T11:17:08.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.866+0000 7f65d8b6e700 1 -- 172.21.15.146:0/2385881980 wait complete. 2023-10-06T11:17:08.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.867+0000 7f65d8b6e700 1 Processor -- start 2023-10-06T11:17:08.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.867+0000 7f65d8b6e700 1 -- start start 2023-10-06T11:17:08.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.868+0000 7f65d8b6e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f65d40ae730 0x7f65d415f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:08.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.868+0000 7f65d8b6e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f65d40ce3d0 0x7f65d415d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:08.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.868+0000 7f65d8b6e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65d415a160 0x7f65d415d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:08.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.868+0000 7f65d8b6e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d415dc50 con 0x7f65d415a160 2023-10-06T11:17:08.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.868+0000 7f65d8b6e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65d416aa00 con 0x7f65d40ae730 2023-10-06T11:17:08.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.868+0000 7f65d8b6e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65d416ace0 con 0x7f65d40ce3d0 2023-10-06T11:17:08.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.868+0000 7f65d2d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65d415a160 0x7f65d415d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:08.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.868+0000 7f65d2d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65d415a160 0x7f65d415d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36236/0 (socket says 172.21.15.146:36236) 2023-10-06T11:17:08.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.868+0000 7f65d2d9d700 1 -- 172.21.15.146:0/1896537278 learned_addr learned my addr 172.21.15.146:0/1896537278 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:08.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.868+0000 7f65d2d9d700 1 -- 172.21.15.146:0/1896537278 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f65d40ce3d0 msgr2=0x7f65d415d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:08.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.868+0000 7f65d2d9d700 1 --2- 172.21.15.146:0/1896537278 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f65d40ce3d0 0x7f65d415d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:08.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.868+0000 7f65d2d9d700 1 -- 172.21.15.146:0/1896537278 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f65d40ae730 msgr2=0x7f65d415f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:08.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.868+0000 7f65d2d9d700 1 --2- 172.21.15.146:0/1896537278 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f65d40ae730 0x7f65d415f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:08.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.868+0000 7f65d2d9d700 1 -- 172.21.15.146:0/1896537278 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c80094f0 con 0x7f65d415a160 2023-10-06T11:17:08.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.868+0000 7f65d2d9d700 1 --2- 172.21.15.146:0/1896537278 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65d415a160 0x7f65d415d710 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f65c400c560 tx=0x7f65c4007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:08.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.869+0000 7f65c27fc700 1 -- 172.21.15.146:0/1896537278 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c4001120 con 0x7f65d415a160 2023-10-06T11:17:08.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.869+0000 7f65c27fc700 1 -- 172.21.15.146:0/1896537278 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c4011590 con 0x7f65d415a160 2023-10-06T11:17:08.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.869+0000 7f65d8b6e700 1 -- 172.21.15.146:0/1896537278 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65d416afc0 con 0x7f65d415a160 2023-10-06T11:17:08.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.869+0000 7f65c27fc700 1 -- 172.21.15.146:0/1896537278 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c4011950 con 0x7f65d415a160 2023-10-06T11:17:08.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.869+0000 7f65d8b6e700 1 -- 172.21.15.146:0/1896537278 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65d40c8880 con 0x7f65d415a160 2023-10-06T11:17:08.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.870+0000 7f65d8b6e700 1 -- 172.21.15.146:0/1896537278 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65d4068390 con 0x7f65d415a160 2023-10-06T11:17:08.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.870+0000 7f65c27fc700 1 -- 172.21.15.146:0/1896537278 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f65c4011d00 con 0x7f65d415a160 2023-10-06T11:17:08.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.870+0000 7f65c27fc700 1 --2- 172.21.15.146:0/1896537278 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f65b4066f30 0x7f65b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:08.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.871+0000 7f65c27fc700 1 -- 172.21.15.146:0/1896537278 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f65c4083b80 con 0x7f65d415a160 2023-10-06T11:17:08.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.871+0000 7f65d259c700 1 --2- 172.21.15.146:0/1896537278 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f65b4066f30 0x7f65b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:08.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.871+0000 7f65d259c700 1 --2- 172.21.15.146:0/1896537278 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f65b4066f30 0x7f65b40693e0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f65d40b43e0 tx=0x7f65cc00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:08.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:08.875+0000 7f65c27fc700 1 -- 172.21.15.146:0/1896537278 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f65c4050c50 con 0x7f65d415a160 2023-10-06T11:17:09.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.058+0000 7f65d8b6e700 1 -- 172.21.15.146:0/1896537278 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f65d40b4d50 con 0x7f65d415a160 2023-10-06T11:17:09.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.058+0000 7f65c27fc700 1 -- 172.21.15.146:0/1896537278 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v139) v1 ==== 92+0+10 (secure 0 0 0) 0x7f65d40b4d50 con 0x7f65d415a160 2023-10-06T11:17:09.059 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-10-06T11:17:09.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.060+0000 7f65d8b6e700 1 -- 172.21.15.146:0/1896537278 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f65b4066f30 msgr2=0x7f65b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:09.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.060+0000 7f65d8b6e700 1 --2- 172.21.15.146:0/1896537278 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f65b4066f30 0x7f65b40693e0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f65d40b43e0 tx=0x7f65cc00b040 comp rx=0 tx=0).stop 2023-10-06T11:17:09.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.060+0000 7f65d8b6e700 1 -- 172.21.15.146:0/1896537278 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65d415a160 msgr2=0x7f65d415d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:09.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.060+0000 7f65d8b6e700 1 --2- 172.21.15.146:0/1896537278 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65d415a160 0x7f65d415d710 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f65c400c560 tx=0x7f65c4007ef0 comp rx=0 tx=0).stop 2023-10-06T11:17:09.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.060+0000 7f65d8b6e700 1 -- 172.21.15.146:0/1896537278 shutdown_connections 2023-10-06T11:17:09.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.060+0000 7f65d8b6e700 1 --2- 172.21.15.146:0/1896537278 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f65b4066f30 0x7f65b40693e0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:09.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.060+0000 7f65d8b6e700 1 --2- 172.21.15.146:0/1896537278 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f65d415a160 0x7f65d415d710 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:09.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.060+0000 7f65d8b6e700 1 --2- 172.21.15.146:0/1896537278 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f65d40ae730 0x7f65d415f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:09.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.060+0000 7f65d8b6e700 1 --2- 172.21.15.146:0/1896537278 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f65d40ce3d0 0x7f65d415d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:09.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.060+0000 7f65d8b6e700 1 -- 172.21.15.146:0/1896537278 >> 172.21.15.146:0/1896537278 conn(0x7f65d406f380 msgr2=0x7f65d40cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:09.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.060+0000 7f65d8b6e700 1 -- 172.21.15.146:0/1896537278 shutdown_connections 2023-10-06T11:17:09.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.061+0000 7f65d8b6e700 1 -- 172.21.15.146:0/1896537278 wait complete. 2023-10-06T11:17:09.074 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:17:09.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.191+0000 7fb23827c700 1 Processor -- start 2023-10-06T11:17:09.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.191+0000 7fb23827c700 1 -- start start 2023-10-06T11:17:09.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.192+0000 7fb23827c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb23015d710 0x7fb2300ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:09.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.192+0000 7fb23827c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb2300aef20 0x7fb230068580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:09.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.192+0000 7fb23827c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb230068ac0 0x7fb2300b04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:09.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.192+0000 7fb23827c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb23015e340 con 0x7fb23015d710 2023-10-06T11:17:09.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.192+0000 7fb23827c700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2300b0010 con 0x7fb2300aef20 2023-10-06T11:17:09.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.192+0000 7fb23827c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2300cf090 con 0x7fb230068ac0 2023-10-06T11:17:09.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.192+0000 7fb236018700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb23015d710 0x7fb2300ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:09.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.193+0000 7fb236018700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb23015d710 0x7fb2300ceb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36238/0 (socket says 172.21.15.146:36238) 2023-10-06T11:17:09.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.193+0000 7fb236018700 1 -- 172.21.15.146:0/425945373 learned_addr learned my addr 172.21.15.146:0/425945373 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:09.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.193+0000 7fb236018700 1 -- 172.21.15.146:0/425945373 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb230068ac0 msgr2=0x7fb2300b04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:09.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.193+0000 7fb236018700 1 --2- 172.21.15.146:0/425945373 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb230068ac0 0x7fb2300b04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:09.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.193+0000 7fb236018700 1 -- 172.21.15.146:0/425945373 >> v2:172.21.15.151:3300/0 conn(0x7fb2300aef20 msgr2=0x7fb230068580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:09.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.193+0000 7fb236018700 1 --2- 172.21.15.146:0/425945373 >> v2:172.21.15.151:3300/0 conn(0x7fb2300aef20 0x7fb230068580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:09.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.193+0000 7fb236018700 1 -- 172.21.15.146:0/425945373 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2300af400 con 0x7fb23015d710 2023-10-06T11:17:09.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.193+0000 7fb236018700 1 --2- 172.21.15.146:0/425945373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb23015d710 0x7fb2300ceb50 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7fb2300ce410 tx=0x7fb22c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adf624bdbdf656e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:09.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.193+0000 7fb235016700 1 -- 172.21.15.146:0/425945373 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22c00e070 con 0x7fb23015d710 2023-10-06T11:17:09.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.193+0000 7fb235016700 1 -- 172.21.15.146:0/425945373 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb22c00ba50 con 0x7fb23015d710 2023-10-06T11:17:09.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.193+0000 7fb235016700 1 -- 172.21.15.146:0/425945373 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22c0092e0 con 0x7fb23015d710 2023-10-06T11:17:09.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.194+0000 7fb23827c700 1 -- 172.21.15.146:0/425945373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb23015d710 msgr2=0x7fb2300ceb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:09.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.194+0000 7fb23827c700 1 --2- 172.21.15.146:0/425945373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb23015d710 0x7fb2300ceb50 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7fb2300ce410 tx=0x7fb22c009840 comp rx=0 tx=0).stop 2023-10-06T11:17:09.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.194+0000 7fb23827c700 1 -- 172.21.15.146:0/425945373 shutdown_connections 2023-10-06T11:17:09.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.194+0000 7fb23827c700 1 --2- 172.21.15.146:0/425945373 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb230068ac0 0x7fb2300b04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:09.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.194+0000 7fb23827c700 1 --2- 172.21.15.146:0/425945373 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb23015d710 0x7fb2300ceb50 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:09.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.194+0000 7fb23827c700 1 --2- 172.21.15.146:0/425945373 >> v2:172.21.15.151:3300/0 conn(0x7fb2300aef20 0x7fb230068580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:09.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.194+0000 7fb23827c700 1 -- 172.21.15.146:0/425945373 >> 172.21.15.146:0/425945373 conn(0x7fb230067c50 msgr2=0x7fb2300ce440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:09.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.194+0000 7fb23827c700 1 -- 172.21.15.146:0/425945373 shutdown_connections 2023-10-06T11:17:09.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.194+0000 7fb23827c700 1 -- 172.21.15.146:0/425945373 wait complete. 2023-10-06T11:17:09.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.195+0000 7fb23827c700 1 Processor -- start 2023-10-06T11:17:09.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.195+0000 7fb23827c700 1 -- start start 2023-10-06T11:17:09.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.195+0000 7fb23827c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb230068ac0 0x7fb2300ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:09.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.195+0000 7fb23827c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2300aef20 0x7fb2300ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:09.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.195+0000 7fb23827c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb23015d710 0x7fb23016a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:09.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.195+0000 7fb23827c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2300cbd70 con 0x7fb23015d710 2023-10-06T11:17:09.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.195+0000 7fb23827c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2300cae20 con 0x7fb2300aef20 2023-10-06T11:17:09.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.195+0000 7fb23827c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2300cb0f0 con 0x7fb230068ac0 2023-10-06T11:17:09.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.196+0000 7fb236819700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb23015d710 0x7fb23016a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:09.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.196+0000 7fb236819700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb23015d710 0x7fb23016a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36250/0 (socket says 172.21.15.146:36250) 2023-10-06T11:17:09.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.196+0000 7fb236819700 1 -- 172.21.15.146:0/102098439 learned_addr learned my addr 172.21.15.146:0/102098439 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:09.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.196+0000 7fb236018700 1 --2- 172.21.15.146:0/102098439 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb230068ac0 0x7fb2300ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:09.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.196+0000 7fb235817700 1 --2- 172.21.15.146:0/102098439 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2300aef20 0x7fb2300ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:09.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.196+0000 7fb236819700 1 -- 172.21.15.146:0/102098439 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb230068ac0 msgr2=0x7fb2300ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:09.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.196+0000 7fb236819700 1 --2- 172.21.15.146:0/102098439 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb230068ac0 0x7fb2300ca1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:09.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.196+0000 7fb236819700 1 -- 172.21.15.146:0/102098439 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2300aef20 msgr2=0x7fb2300ca8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:09.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.196+0000 7fb236819700 1 --2- 172.21.15.146:0/102098439 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2300aef20 0x7fb2300ca8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:09.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.196+0000 7fb236819700 1 -- 172.21.15.146:0/102098439 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb22c009ae0 con 0x7fb23015d710 2023-10-06T11:17:09.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.196+0000 7fb236819700 1 --2- 172.21.15.146:0/102098439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb23015d710 0x7fb23016a010 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7fb22800b810 tx=0x7fb2280091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:09.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.196+0000 7fb2267fc700 1 -- 172.21.15.146:0/102098439 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22800f570 con 0x7fb23015d710 2023-10-06T11:17:09.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.196+0000 7fb2267fc700 1 -- 172.21.15.146:0/102098439 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb22800f6d0 con 0x7fb23015d710 2023-10-06T11:17:09.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.196+0000 7fb2267fc700 1 -- 172.21.15.146:0/102098439 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb22800fa90 con 0x7fb23015d710 2023-10-06T11:17:09.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.196+0000 7fb23827c700 1 -- 172.21.15.146:0/102098439 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2300cb3d0 con 0x7fb23015d710 2023-10-06T11:17:09.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.196+0000 7fb23827c700 1 -- 172.21.15.146:0/102098439 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2300cb990 con 0x7fb23015d710 2023-10-06T11:17:09.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.197+0000 7fb23827c700 1 -- 172.21.15.146:0/102098439 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb23015de40 con 0x7fb23015d710 2023-10-06T11:17:09.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.198+0000 7fb2267fc700 1 -- 172.21.15.146:0/102098439 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb22801a460 con 0x7fb23015d710 2023-10-06T11:17:09.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.198+0000 7fb2267fc700 1 --2- 172.21.15.146:0/102098439 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb214066f30 0x7fb2140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:09.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.198+0000 7fb236018700 1 --2- 172.21.15.146:0/102098439 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb214066f30 0x7fb2140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:09.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.198+0000 7fb2267fc700 1 -- 172.21.15.146:0/102098439 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fb228084340 con 0x7fb23015d710 2023-10-06T11:17:09.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.198+0000 7fb236018700 1 --2- 172.21.15.146:0/102098439 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb214066f30 0x7fb2140693e0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fb22c009880 tx=0x7fb22c018000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:09.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.202+0000 7fb2267fc700 1 -- 172.21.15.146:0/102098439 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb228051490 con 0x7fb23015d710 2023-10-06T11:17:09.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.387+0000 7fb23827c700 1 -- 172.21.15.146:0/102098439 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb2300cbeb0 con 0x7fb23015d710 2023-10-06T11:17:09.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.388+0000 7fb2267fc700 1 -- 172.21.15.146:0/102098439 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v139) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb228054ab0 con 0x7fb23015d710 2023-10-06T11:17:09.389 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-10-06T11:17:09.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.390+0000 7fb23827c700 1 -- 172.21.15.146:0/102098439 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb214066f30 msgr2=0x7fb2140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:09.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.390+0000 7fb23827c700 1 --2- 172.21.15.146:0/102098439 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb214066f30 0x7fb2140693e0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fb22c009880 tx=0x7fb22c018000 comp rx=0 tx=0).stop 2023-10-06T11:17:09.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.390+0000 7fb23827c700 1 -- 172.21.15.146:0/102098439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb23015d710 msgr2=0x7fb23016a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:09.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.390+0000 7fb23827c700 1 --2- 172.21.15.146:0/102098439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb23015d710 0x7fb23016a010 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7fb22800b810 tx=0x7fb2280091d0 comp rx=0 tx=0).stop 2023-10-06T11:17:09.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.390+0000 7fb23827c700 1 -- 172.21.15.146:0/102098439 shutdown_connections 2023-10-06T11:17:09.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.390+0000 7fb23827c700 1 --2- 172.21.15.146:0/102098439 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb214066f30 0x7fb2140693e0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:09.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.390+0000 7fb23827c700 1 --2- 172.21.15.146:0/102098439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb23015d710 0x7fb23016a010 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:09.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.390+0000 7fb23827c700 1 --2- 172.21.15.146:0/102098439 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb230068ac0 0x7fb2300ca1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:09.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.390+0000 7fb23827c700 1 --2- 172.21.15.146:0/102098439 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2300aef20 0x7fb2300ca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:09.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.390+0000 7fb23827c700 1 -- 172.21.15.146:0/102098439 >> 172.21.15.146:0/102098439 conn(0x7fb230067c50 msgr2=0x7fb2300ac2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:09.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.390+0000 7fb23827c700 1 -- 172.21.15.146:0/102098439 shutdown_connections 2023-10-06T11:17:09.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.390+0000 7fb23827c700 1 -- 172.21.15.146:0/102098439 wait complete. 2023-10-06T11:17:09.403 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T11:17:09.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.521+0000 7fb04b59e700 1 Processor -- start 2023-10-06T11:17:09.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.521+0000 7fb04b59e700 1 -- start start 2023-10-06T11:17:09.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.522+0000 7fb04b59e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb04c068780 0x7fb04c068b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:09.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.522+0000 7fb04b59e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb04c0cc130 con 0x7fb04c0b5640 2023-10-06T11:17:09.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.522+0000 7fb04b59e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb04c0cccd0 con 0x7fb04c0cb090 2023-10-06T11:17:09.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.522+0000 7fb04b59e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c0b2660 con 0x7fb04c068780 2023-10-06T11:17:09.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.522+0000 7fb04a59c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb04c0b5640 0x7fb04c15a870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60926/0 (socket says 172.21.15.146:60926) 2023-10-06T11:17:09.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.522+0000 7fb04a59c700 1 -- 172.21.15.146:0/1397585915 learned_addr learned my addr 172.21.15.146:0/1397585915 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:17:09.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.522+0000 7fb04ad9d700 1 --2- 172.21.15.146:0/1397585915 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb04c068780 0x7fb04c068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:09.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.523+0000 7fb04959a700 1 -- 172.21.15.146:0/1397585915 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3653055874 0 0) 0x7fb04c0cc130 con 0x7fb04c0b5640 2023-10-06T11:17:09.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.523+0000 7fb04959a700 1 -- 172.21.15.146:0/1397585915 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb034003570 con 0x7fb04c0b5640 2023-10-06T11:17:09.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.523+0000 7fb04959a700 1 -- 172.21.15.146:0/1397585915 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 417913576 0 0) 0x7fb034003570 con 0x7fb04c0b5640 2023-10-06T11:17:09.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.523+0000 7fb04959a700 1 -- 172.21.15.146:0/1397585915 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb04c068780 msgr2=0x7fb04c068b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:09.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.523+0000 7fb04959a700 1 --2- 172.21.15.146:0/1397585915 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb04c068780 0x7fb04c068b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:09.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.523+0000 7fb04959a700 1 -- 172.21.15.146:0/1397585915 >> v1:172.21.15.151:6789/0 conn(0x7fb04c0cb090 legacy=0x7fb04c0cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:09.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.523+0000 7fb04959a700 1 -- 172.21.15.146:0/1397585915 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb04c0690d0 con 0x7fb04c0b5640 2023-10-06T11:17:09.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.523+0000 7fb04959a700 1 -- 172.21.15.146:0/1397585915 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fb03c0017f0 con 0x7fb04c0b5640 2023-10-06T11:17:09.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.523+0000 7fb04959a700 1 -- 172.21.15.146:0/1397585915 >> v1:172.21.15.146:6789/0 conn(0x7fb04c0b5640 legacy=0x7fb04c15a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:09.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.523+0000 7fb04959a700 1 --2- 172.21.15.146:0/1397585915 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb034003a90 0x7fb034003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:09.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.523+0000 7fb04959a700 1 --2- 172.21.15.146:0/1397585915 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb034004810 0x7fb034004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:09.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.523+0000 7fb04959a700 1 --2- 172.21.15.146:0/1397585915 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb04c068780 0x7fb0340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:09.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.523+0000 7fb04959a700 1 -- 172.21.15.146:0/1397585915 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c0b2660 con 0x7fb034004810 2023-10-06T11:17:09.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.523+0000 7fb04959a700 1 -- 172.21.15.146:0/1397585915 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03400bb10 con 0x7fb034003a90 2023-10-06T11:17:09.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.523+0000 7fb04959a700 1 -- 172.21.15.146:0/1397585915 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb03400bcd0 con 0x7fb04c068780 2023-10-06T11:17:09.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.523+0000 7fb049d9b700 1 --2- 172.21.15.146:0/1397585915 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb034004810 0x7fb034004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:09.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.523+0000 7fb04ad9d700 1 --2- 172.21.15.146:0/1397585915 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb04c068780 0x7fb0340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:09.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.523+0000 7fb04a59c700 1 --2- 172.21.15.146:0/1397585915 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb034003a90 0x7fb034003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:09.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.523+0000 7fb049d9b700 1 -- 172.21.15.146:0/1397585915 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb04c068780 msgr2=0x7fb0340051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:09.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.523+0000 7fb049d9b700 1 --2- 172.21.15.146:0/1397585915 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb04c068780 0x7fb0340051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:09.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.523+0000 7fb049d9b700 1 -- 172.21.15.146:0/1397585915 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb034003a90 msgr2=0x7fb034003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:09.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.523+0000 7fb049d9b700 1 --2- 172.21.15.146:0/1397585915 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb034003a90 0x7fb034003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:09.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.523+0000 7fb049d9b700 1 -- 172.21.15.146:0/1397585915 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb034003570 con 0x7fb034004810 2023-10-06T11:17:09.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.524+0000 7fb049d9b700 1 --2- 172.21.15.146:0/1397585915 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb034004810 0x7fb034004c80 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7fb0400019a0 tx=0x7fb040007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a69b41399b45478 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:09.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.524+0000 7fb04959a700 1 -- 172.21.15.146:0/1397585915 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04000c5d0 con 0x7fb034004810 2023-10-06T11:17:09.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.524+0000 7fb04959a700 1 -- 172.21.15.146:0/1397585915 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04000c750 con 0x7fb034004810 2023-10-06T11:17:09.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.524+0000 7fb04959a700 1 -- 172.21.15.146:0/1397585915 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04000cb10 con 0x7fb034004810 2023-10-06T11:17:09.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.524+0000 7fb04b59e700 1 -- 172.21.15.146:0/1397585915 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb034004810 msgr2=0x7fb034004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:09.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.524+0000 7fb04b59e700 1 --2- 172.21.15.146:0/1397585915 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb034004810 0x7fb034004c80 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7fb0400019a0 tx=0x7fb040007d10 comp rx=0 tx=0).stop 2023-10-06T11:17:09.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.524+0000 7fb04ad9d700 1 -- 172.21.15.146:0/1397585915 reap_dead start 2023-10-06T11:17:09.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.524+0000 7fb04b59e700 1 -- 172.21.15.146:0/1397585915 shutdown_connections 2023-10-06T11:17:09.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.524+0000 7fb04b59e700 1 -- 172.21.15.146:0/1397585915 >> 172.21.15.146:0/1397585915 conn(0x7fb04c0703f0 msgr2=0x7fb04c0707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:09.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.524+0000 7fb04b59e700 1 -- 172.21.15.146:0/1397585915 shutdown_connections 2023-10-06T11:17:09.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.524+0000 7fb04b59e700 1 -- 172.21.15.146:0/1397585915 wait complete. 2023-10-06T11:17:09.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.525+0000 7fb04b59e700 1 Processor -- start 2023-10-06T11:17:09.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.525+0000 7fb04b59e700 1 -- start start 2023-10-06T11:17:09.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.526+0000 7fb04b59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb034004810 0x7fb04c153a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:09.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.526+0000 7fb04b59e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb04c0c6360 0x7fb04c0c67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:09.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.526+0000 7fb04b59e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb04c0c8ea0 0x7fb04c0c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:09.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.526+0000 7fb04b59e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c0c7200 con 0x7fb034004810 2023-10-06T11:17:09.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.526+0000 7fb04b59e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c0c6d10 con 0x7fb04c0c8ea0 2023-10-06T11:17:09.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.526+0000 7fb04b59e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb04c15f000 con 0x7fb04c0c6360 2023-10-06T11:17:09.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.526+0000 7fb04a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb034004810 0x7fb04c153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:09.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.526+0000 7fb04a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb034004810 0x7fb04c153a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36272/0 (socket says 172.21.15.146:36272) 2023-10-06T11:17:09.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.526+0000 7fb04a59c700 1 -- 172.21.15.146:0/188129613 learned_addr learned my addr 172.21.15.146:0/188129613 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:09.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.526+0000 7fb049d9b700 1 --2- 172.21.15.146:0/188129613 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb04c0c6360 0x7fb04c0c67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:09.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.526+0000 7fb04ad9d700 1 --2- 172.21.15.146:0/188129613 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb04c0c8ea0 0x7fb04c0c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:09.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.526+0000 7fb04a59c700 1 -- 172.21.15.146:0/188129613 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb04c0c6360 msgr2=0x7fb04c0c67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:09.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.526+0000 7fb04a59c700 1 --2- 172.21.15.146:0/188129613 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb04c0c6360 0x7fb04c0c67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:09.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.526+0000 7fb04a59c700 1 -- 172.21.15.146:0/188129613 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb04c0c8ea0 msgr2=0x7fb04c0c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:09.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.526+0000 7fb04a59c700 1 --2- 172.21.15.146:0/188129613 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb04c0c8ea0 0x7fb04c0c92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:09.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.526+0000 7fb04a59c700 1 -- 172.21.15.146:0/188129613 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb04c0c9830 con 0x7fb034004810 2023-10-06T11:17:09.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.526+0000 7fb04ad9d700 1 --2- 172.21.15.146:0/188129613 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb04c0c8ea0 0x7fb04c0c92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:17:09.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.527+0000 7fb04a59c700 1 --2- 172.21.15.146:0/188129613 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb034004810 0x7fb04c153a20 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7fb03c007ac0 tx=0x7fb03c002170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:09.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.527+0000 7fb03a7fc700 1 -- 172.21.15.146:0/188129613 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c00ad10 con 0x7fb034004810 2023-10-06T11:17:09.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.527+0000 7fb03a7fc700 1 -- 172.21.15.146:0/188129613 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03c00ae90 con 0x7fb034004810 2023-10-06T11:17:09.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.527+0000 7fb03a7fc700 1 -- 172.21.15.146:0/188129613 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03c013640 con 0x7fb034004810 2023-10-06T11:17:09.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.527+0000 7fb04b59e700 1 -- 172.21.15.146:0/188129613 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb04c0c3d10 con 0x7fb034004810 2023-10-06T11:17:09.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.527+0000 7fb04b59e700 1 -- 172.21.15.146:0/188129613 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb04c0c6f20 con 0x7fb034004810 2023-10-06T11:17:09.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.528+0000 7fb04b59e700 1 -- 172.21.15.146:0/188129613 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb04c15e810 con 0x7fb034004810 2023-10-06T11:17:09.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.528+0000 7fb03a7fc700 1 -- 172.21.15.146:0/188129613 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb03c0139f0 con 0x7fb034004810 2023-10-06T11:17:09.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.528+0000 7fb03a7fc700 1 --2- 172.21.15.146:0/188129613 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb02c066f30 0x7fb02c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:09.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.529+0000 7fb03a7fc700 1 -- 172.21.15.146:0/188129613 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fb03c0854b0 con 0x7fb034004810 2023-10-06T11:17:09.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.529+0000 7fb049d9b700 1 --2- 172.21.15.146:0/188129613 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb02c066f30 0x7fb02c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:09.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.529+0000 7fb049d9b700 1 --2- 172.21.15.146:0/188129613 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb02c066f30 0x7fb02c0693e0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fb04c0ca470 tx=0x7fb040015000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:09.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.533+0000 7fb03a7fc700 1 -- 172.21.15.146:0/188129613 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb04c15e810 con 0x7fb034004810 2023-10-06T11:17:09.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.714+0000 7fb04b59e700 1 -- 172.21.15.146:0/188129613 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb04c15e810 con 0x7fb034004810 2023-10-06T11:17:09.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.714+0000 7fb03a7fc700 1 -- 172.21.15.146:0/188129613 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v139) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb04c15e810 con 0x7fb034004810 2023-10-06T11:17:09.715 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2023-10-06T11:17:09.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.716+0000 7fb04b59e700 1 -- 172.21.15.146:0/188129613 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb02c066f30 msgr2=0x7fb02c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:09.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.716+0000 7fb04b59e700 1 --2- 172.21.15.146:0/188129613 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb02c066f30 0x7fb02c0693e0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fb04c0ca470 tx=0x7fb040015000 comp rx=0 tx=0).stop 2023-10-06T11:17:09.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.716+0000 7fb04b59e700 1 -- 172.21.15.146:0/188129613 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb034004810 msgr2=0x7fb04c153a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:09.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.716+0000 7fb04b59e700 1 --2- 172.21.15.146:0/188129613 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb034004810 0x7fb04c153a20 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7fb03c007ac0 tx=0x7fb03c002170 comp rx=0 tx=0).stop 2023-10-06T11:17:09.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.716+0000 7fb04b59e700 1 -- 172.21.15.146:0/188129613 shutdown_connections 2023-10-06T11:17:09.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.716+0000 7fb04b59e700 1 --2- 172.21.15.146:0/188129613 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb02c066f30 0x7fb02c0693e0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:09.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.716+0000 7fb04b59e700 1 --2- 172.21.15.146:0/188129613 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb04c0c8ea0 0x7fb04c0c92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:09.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.716+0000 7fb04b59e700 1 --2- 172.21.15.146:0/188129613 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb034004810 0x7fb04c153a20 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:09.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.716+0000 7fb04b59e700 1 --2- 172.21.15.146:0/188129613 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb04c0c6360 0x7fb04c0c67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:09.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.716+0000 7fb04b59e700 1 -- 172.21.15.146:0/188129613 >> 172.21.15.146:0/188129613 conn(0x7fb04c0703f0 msgr2=0x7fb04c0cf380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:09.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.716+0000 7fb04b59e700 1 -- 172.21.15.146:0/188129613 shutdown_connections 2023-10-06T11:17:09.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.716+0000 7fb04b59e700 1 -- 172.21.15.146:0/188129613 wait complete. 2023-10-06T11:17:09.729 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T11:17:09.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.846+0000 7f2a87362700 1 Processor -- start 2023-10-06T11:17:09.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.846+0000 7f2a87362700 1 -- start start 2023-10-06T11:17:09.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.847+0000 7f2a87362700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2a801596a0 0x7f2a800ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:09.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.847+0000 7f2a87362700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a800b19b0 con 0x7f2a800ccd90 2023-10-06T11:17:09.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.847+0000 7f2a87362700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a800b0da0 con 0x7f2a800ce9e0 2023-10-06T11:17:09.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.847+0000 7f2a87362700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a800b1080 con 0x7f2a801596a0 2023-10-06T11:17:09.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.847+0000 7f2a86b61700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2a800ccd90 0x7f2a800cd1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60932/0 (socket says 172.21.15.146:60932) 2023-10-06T11:17:09.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.847+0000 7f2a86b61700 1 -- 172.21.15.146:0/1458924133 learned_addr learned my addr 172.21.15.146:0/1458924133 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:17:09.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.848+0000 7f2a86360700 1 --2- 172.21.15.146:0/1458924133 >> v2:172.21.15.151:3300/0 conn(0x7f2a801596a0 0x7f2a800ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:09.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.848+0000 7f2a8535e700 1 -- 172.21.15.146:0/1458924133 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2392861397 0 0) 0x7f2a800b19b0 con 0x7f2a800ccd90 2023-10-06T11:17:09.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.848+0000 7f2a8535e700 1 -- 172.21.15.146:0/1458924133 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a6c003570 con 0x7f2a800ccd90 2023-10-06T11:17:09.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.848+0000 7f2a8535e700 1 -- 172.21.15.146:0/1458924133 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 840163364 0 0) 0x7f2a800b0da0 con 0x7f2a800ce9e0 2023-10-06T11:17:09.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.848+0000 7f2a8535e700 1 -- 172.21.15.146:0/1458924133 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a800b19b0 con 0x7f2a800ce9e0 2023-10-06T11:17:09.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.848+0000 7f2a86360700 1 -- 172.21.15.146:0/1458924133 >> v1:172.21.15.151:6789/0 conn(0x7f2a800ce9e0 legacy=0x7f2a800cb460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:09.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.848+0000 7f2a86360700 1 -- 172.21.15.146:0/1458924133 >> v1:172.21.15.146:6789/0 conn(0x7f2a800ccd90 legacy=0x7f2a800cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:09.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.848+0000 7f2a86360700 1 -- 172.21.15.146:0/1458924133 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a800b1360 con 0x7f2a801596a0 2023-10-06T11:17:09.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.848+0000 7f2a86360700 1 --2- 172.21.15.146:0/1458924133 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a801596a0 0x7f2a800ce4a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c0098e0 tx=0x7f2a7c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f98405582ee9a729 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:09.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.848+0000 7f2a8535e700 1 -- 172.21.15.146:0/1458924133 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c011630 con 0x7f2a801596a0 2023-10-06T11:17:09.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.848+0000 7f2a8535e700 1 -- 172.21.15.146:0/1458924133 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a7c011790 con 0x7f2a801596a0 2023-10-06T11:17:09.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.848+0000 7f2a8535e700 1 -- 172.21.15.146:0/1458924133 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c011b10 con 0x7f2a801596a0 2023-10-06T11:17:09.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.849+0000 7f2a87362700 1 -- 172.21.15.146:0/1458924133 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a801596a0 msgr2=0x7f2a800ce4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:09.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.849+0000 7f2a87362700 1 --2- 172.21.15.146:0/1458924133 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a801596a0 0x7f2a800ce4a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c0098e0 tx=0x7f2a7c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:17:09.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.849+0000 7f2a87362700 1 -- 172.21.15.146:0/1458924133 shutdown_connections 2023-10-06T11:17:09.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.849+0000 7f2a87362700 1 --2- 172.21.15.146:0/1458924133 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a801596a0 0x7f2a800ce4a0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:09.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.849+0000 7f2a87362700 1 -- 172.21.15.146:0/1458924133 >> 172.21.15.146:0/1458924133 conn(0x7f2a8006eba0 msgr2=0x7f2a8006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:09.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.849+0000 7f2a87362700 1 -- 172.21.15.146:0/1458924133 shutdown_connections 2023-10-06T11:17:09.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.849+0000 7f2a87362700 1 -- 172.21.15.146:0/1458924133 wait complete. 2023-10-06T11:17:09.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.850+0000 7f2a87362700 1 Processor -- start 2023-10-06T11:17:09.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.850+0000 7f2a87362700 1 -- start start 2023-10-06T11:17:09.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.851+0000 7f2a87362700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a800ccd90 0x7f2a801542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:09.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.851+0000 7f2a87362700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a800ce9e0 0x7f2a80159a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:09.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.851+0000 7f2a87362700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2a801596a0 0x7f2a800ca920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:09.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.851+0000 7f2a87362700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8016a370 con 0x7f2a800ccd90 2023-10-06T11:17:09.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.851+0000 7f2a87362700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a8015a4c0 con 0x7f2a800ce9e0 2023-10-06T11:17:09.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.851+0000 7f2a87362700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a80169d20 con 0x7f2a801596a0 2023-10-06T11:17:09.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.851+0000 7f2a86360700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a800ccd90 0x7f2a801542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:09.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.851+0000 7f2a86360700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a800ccd90 0x7f2a801542a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36276/0 (socket says 172.21.15.146:36276) 2023-10-06T11:17:09.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.851+0000 7f2a86360700 1 -- 172.21.15.146:0/133925382 learned_addr learned my addr 172.21.15.146:0/133925382 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:09.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.851+0000 7f2a86360700 1 -- 172.21.15.146:0/133925382 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2a801596a0 msgr2=0x7f2a800ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:09.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.851+0000 7f2a86360700 1 --2- 172.21.15.146:0/133925382 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2a801596a0 0x7f2a800ca920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:09.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.851+0000 7f2a86360700 1 -- 172.21.15.146:0/133925382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a800ce9e0 msgr2=0x7f2a80159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:09.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.851+0000 7f2a85b5f700 1 --2- 172.21.15.146:0/133925382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a800ce9e0 0x7f2a80159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:09.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.851+0000 7f2a86360700 1 --2- 172.21.15.146:0/133925382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a800ce9e0 0x7f2a80159a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:09.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.851+0000 7f2a86360700 1 -- 172.21.15.146:0/133925382 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a7c009420 con 0x7f2a800ccd90 2023-10-06T11:17:09.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.851+0000 7f2a86360700 1 --2- 172.21.15.146:0/133925382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a800ccd90 0x7f2a801542a0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c009ed0 tx=0x7f2a7c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:09.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.851+0000 7f2a767fc700 1 -- 172.21.15.146:0/133925382 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c011b10 con 0x7f2a800ccd90 2023-10-06T11:17:09.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.851+0000 7f2a767fc700 1 -- 172.21.15.146:0/133925382 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a7c01a430 con 0x7f2a800ccd90 2023-10-06T11:17:09.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.851+0000 7f2a87362700 1 -- 172.21.15.146:0/133925382 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a8016a000 con 0x7f2a800ccd90 2023-10-06T11:17:09.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.851+0000 7f2a767fc700 1 -- 172.21.15.146:0/133925382 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c01a7d0 con 0x7f2a800ccd90 2023-10-06T11:17:09.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.851+0000 7f2a87362700 1 -- 172.21.15.146:0/133925382 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a800b3bc0 con 0x7f2a800ccd90 2023-10-06T11:17:09.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.852+0000 7f2a87362700 1 -- 172.21.15.146:0/133925382 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a800b41f0 con 0x7f2a800ccd90 2023-10-06T11:17:09.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.853+0000 7f2a767fc700 1 -- 172.21.15.146:0/133925382 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2a7c01ab80 con 0x7f2a800ccd90 2023-10-06T11:17:09.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.853+0000 7f2a767fc700 1 --2- 172.21.15.146:0/133925382 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2a64066f30 0x7f2a640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:09.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.853+0000 7f2a767fc700 1 -- 172.21.15.146:0/133925382 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f2a7c086470 con 0x7f2a800ccd90 2023-10-06T11:17:09.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.853+0000 7f2a85b5f700 1 --2- 172.21.15.146:0/133925382 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2a64066f30 0x7f2a640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:09.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.854+0000 7f2a85b5f700 1 --2- 172.21.15.146:0/133925382 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2a64066f30 0x7f2a640693e0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f2a8015caf0 tx=0x7f2a70009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:09.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:09.857+0000 7f2a767fc700 1 -- 172.21.15.146:0/133925382 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2a7c053540 con 0x7f2a800ccd90 2023-10-06T11:17:10.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.039+0000 7f2a87362700 1 -- 172.21.15.146:0/133925382 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2a80169b50 con 0x7f2a800ccd90 2023-10-06T11:17:10.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.039+0000 7f2a767fc700 1 -- 172.21.15.146:0/133925382 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v139) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2a7c056b60 con 0x7f2a800ccd90 2023-10-06T11:17:10.040 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2023-10-06T11:17:10.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.041+0000 7f2a87362700 1 -- 172.21.15.146:0/133925382 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2a64066f30 msgr2=0x7f2a640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:10.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.041+0000 7f2a87362700 1 --2- 172.21.15.146:0/133925382 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2a64066f30 0x7f2a640693e0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f2a8015caf0 tx=0x7f2a70009040 comp rx=0 tx=0).stop 2023-10-06T11:17:10.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.041+0000 7f2a87362700 1 -- 172.21.15.146:0/133925382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a800ccd90 msgr2=0x7f2a801542a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:10.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.041+0000 7f2a87362700 1 --2- 172.21.15.146:0/133925382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a800ccd90 0x7f2a801542a0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c009ed0 tx=0x7f2a7c017000 comp rx=0 tx=0).stop 2023-10-06T11:17:10.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.041+0000 7f2a87362700 1 -- 172.21.15.146:0/133925382 shutdown_connections 2023-10-06T11:17:10.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.041+0000 7f2a87362700 1 --2- 172.21.15.146:0/133925382 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2a64066f30 0x7f2a640693e0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:10.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.041+0000 7f2a87362700 1 --2- 172.21.15.146:0/133925382 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2a801596a0 0x7f2a800ca920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:10.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.041+0000 7f2a87362700 1 --2- 172.21.15.146:0/133925382 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2a800ccd90 0x7f2a801542a0 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:10.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.041+0000 7f2a87362700 1 --2- 172.21.15.146:0/133925382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2a800ce9e0 0x7f2a80159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:10.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.041+0000 7f2a87362700 1 -- 172.21.15.146:0/133925382 >> 172.21.15.146:0/133925382 conn(0x7f2a8006eba0 msgr2=0x7f2a800c99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:10.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.042+0000 7f2a87362700 1 -- 172.21.15.146:0/133925382 shutdown_connections 2023-10-06T11:17:10.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.042+0000 7f2a87362700 1 -- 172.21.15.146:0/133925382 wait complete. 2023-10-06T11:17:10.056 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:17:10.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.171+0000 7f09fc0ac700 1 Processor -- start 2023-10-06T11:17:10.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.171+0000 7f09fc0ac700 1 -- start start 2023-10-06T11:17:10.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.172+0000 7f09fc0ac700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f09f4153ab0 0x7f09f415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:10.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.172+0000 7f09fc0ac700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09f4153e80 0x7f09f4068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:10.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.172+0000 7f09fc0ac700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f09f40689d0 0x7f09f415d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:10.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.172+0000 7f09fc0ac700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f4068e50 con 0x7f09f40689d0 2023-10-06T11:17:10.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.172+0000 7f09fc0ac700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f415ac30 con 0x7f09f4153ab0 2023-10-06T11:17:10.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.172+0000 7f09fc0ac700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f40b4510 con 0x7f09f4153e80 2023-10-06T11:17:10.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.172+0000 7f09fa649700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f09f40689d0 0x7f09f415d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:10.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.172+0000 7f09fa649700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f09f40689d0 0x7f09f415d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36286/0 (socket says 172.21.15.146:36286) 2023-10-06T11:17:10.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.172+0000 7f09fa649700 1 -- 172.21.15.146:0/1240179615 learned_addr learned my addr 172.21.15.146:0/1240179615 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:10.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.172+0000 7f09f9e48700 1 --2- 172.21.15.146:0/1240179615 >> v2:172.21.15.151:3300/0 conn(0x7f09f4153ab0 0x7f09f415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:10.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.172+0000 7f09f9647700 1 --2- 172.21.15.146:0/1240179615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09f4153e80 0x7f09f4068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:10.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.172+0000 7f09fa649700 1 -- 172.21.15.146:0/1240179615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09f4153e80 msgr2=0x7f09f4068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:10.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.172+0000 7f09fa649700 1 --2- 172.21.15.146:0/1240179615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09f4153e80 0x7f09f4068490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:10.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.172+0000 7f09fa649700 1 -- 172.21.15.146:0/1240179615 >> v2:172.21.15.151:3300/0 conn(0x7f09f4153ab0 msgr2=0x7f09f415a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:10.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.172+0000 7f09fa649700 1 --2- 172.21.15.146:0/1240179615 >> v2:172.21.15.151:3300/0 conn(0x7f09f4153ab0 0x7f09f415a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:10.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.172+0000 7f09fa649700 1 -- 172.21.15.146:0/1240179615 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f40b6530 con 0x7f09f40689d0 2023-10-06T11:17:10.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.172+0000 7f09f9647700 1 --2- 172.21.15.146:0/1240179615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09f4153e80 0x7f09f4068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:17:10.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.172+0000 7f09fa649700 1 --2- 172.21.15.146:0/1240179615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09f40689d0 0x7f09f415d270 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f09f40b5eb0 tx=0x7f09ec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=685680ea6cfc808 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:10.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.172+0000 7f09f8e46700 1 -- 172.21.15.146:0/1240179615 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ec00e070 con 0x7f09f40689d0 2023-10-06T11:17:10.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.172+0000 7f09f8e46700 1 -- 172.21.15.146:0/1240179615 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09ec00ba20 con 0x7f09f40689d0 2023-10-06T11:17:10.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.172+0000 7f09f8e46700 1 -- 172.21.15.146:0/1240179615 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ec0092e0 con 0x7f09f40689d0 2023-10-06T11:17:10.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.173+0000 7f09fc0ac700 1 -- 172.21.15.146:0/1240179615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09f40689d0 msgr2=0x7f09f415d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:10.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.173+0000 7f09fc0ac700 1 --2- 172.21.15.146:0/1240179615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09f40689d0 0x7f09f415d270 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f09f40b5eb0 tx=0x7f09ec009840 comp rx=0 tx=0).stop 2023-10-06T11:17:10.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.173+0000 7f09fc0ac700 1 -- 172.21.15.146:0/1240179615 shutdown_connections 2023-10-06T11:17:10.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.173+0000 7f09fc0ac700 1 --2- 172.21.15.146:0/1240179615 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09f40689d0 0x7f09f415d270 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:10.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.173+0000 7f09fc0ac700 1 --2- 172.21.15.146:0/1240179615 >> v2:172.21.15.151:3300/0 conn(0x7f09f4153ab0 0x7f09f415a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:10.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.173+0000 7f09fc0ac700 1 --2- 172.21.15.146:0/1240179615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09f4153e80 0x7f09f4068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:10.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.173+0000 7f09fc0ac700 1 -- 172.21.15.146:0/1240179615 >> 172.21.15.146:0/1240179615 conn(0x7f09f406eba0 msgr2=0x7f09f406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:10.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.173+0000 7f09fc0ac700 1 -- 172.21.15.146:0/1240179615 shutdown_connections 2023-10-06T11:17:10.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.173+0000 7f09fc0ac700 1 -- 172.21.15.146:0/1240179615 wait complete. 2023-10-06T11:17:10.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.174+0000 7f09fc0ac700 1 Processor -- start 2023-10-06T11:17:10.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.174+0000 7f09fc0ac700 1 -- start start 2023-10-06T11:17:10.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.175+0000 7f09fc0ac700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09f40689d0 0x7f09f414aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:10.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.175+0000 7f09fc0ac700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09f4153ab0 0x7f09f414afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:10.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.175+0000 7f09fc0ac700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09f4153e80 0x7f09f416cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:10.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.175+0000 7f09fc0ac700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f414a750 con 0x7f09f4153ab0 2023-10-06T11:17:10.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.175+0000 7f09fc0ac700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f414d1a0 con 0x7f09f4153e80 2023-10-06T11:17:10.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.175+0000 7f09fc0ac700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f414d480 con 0x7f09f40689d0 2023-10-06T11:17:10.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.175+0000 7f09f9647700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09f4153ab0 0x7f09f414afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:10.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.175+0000 7f09f9647700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09f4153ab0 0x7f09f414afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36292/0 (socket says 172.21.15.146:36292) 2023-10-06T11:17:10.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.175+0000 7f09f9647700 1 -- 172.21.15.146:0/1112392267 learned_addr learned my addr 172.21.15.146:0/1112392267 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:10.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.175+0000 7f09fa649700 1 --2- 172.21.15.146:0/1112392267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09f4153e80 0x7f09f416cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:10.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.175+0000 7f09f9e48700 1 --2- 172.21.15.146:0/1112392267 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09f40689d0 0x7f09f414aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:10.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.175+0000 7f09f9647700 1 -- 172.21.15.146:0/1112392267 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09f40689d0 msgr2=0x7f09f414aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:10.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.175+0000 7f09f9647700 1 --2- 172.21.15.146:0/1112392267 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09f40689d0 0x7f09f414aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:10.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.175+0000 7f09f9647700 1 -- 172.21.15.146:0/1112392267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09f4153e80 msgr2=0x7f09f416cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:10.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.175+0000 7f09f9647700 1 --2- 172.21.15.146:0/1112392267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09f4153e80 0x7f09f416cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:10.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.175+0000 7f09f9647700 1 -- 172.21.15.146:0/1112392267 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09ec009ae0 con 0x7f09f4153ab0 2023-10-06T11:17:10.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.175+0000 7f09f9647700 1 --2- 172.21.15.146:0/1112392267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09f4153ab0 0x7f09f414afd0 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f09e400e8f0 tx=0x7f09e4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:10.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.175+0000 7f09e9ffb700 1 -- 172.21.15.146:0/1112392267 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e4013410 con 0x7f09f4153ab0 2023-10-06T11:17:10.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.176+0000 7f09e9ffb700 1 -- 172.21.15.146:0/1112392267 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e4013570 con 0x7f09f4153ab0 2023-10-06T11:17:10.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.176+0000 7f09fc0ac700 1 -- 172.21.15.146:0/1112392267 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f414d760 con 0x7f09f4153ab0 2023-10-06T11:17:10.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.176+0000 7f09e9ffb700 1 -- 172.21.15.146:0/1112392267 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e4013930 con 0x7f09f4153ab0 2023-10-06T11:17:10.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.176+0000 7f09fc0ac700 1 -- 172.21.15.146:0/1112392267 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f414dd20 con 0x7f09f4153ab0 2023-10-06T11:17:10.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.177+0000 7f09fc0ac700 1 -- 172.21.15.146:0/1112392267 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f404c380 con 0x7f09f4153ab0 2023-10-06T11:17:10.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.177+0000 7f09e9ffb700 1 -- 172.21.15.146:0/1112392267 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f09e4013ca0 con 0x7f09f4153ab0 2023-10-06T11:17:10.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.177+0000 7f09e9ffb700 1 --2- 172.21.15.146:0/1112392267 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f09d8066f30 0x7f09d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:10.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.178+0000 7f09f9e48700 1 --2- 172.21.15.146:0/1112392267 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f09d8066f30 0x7f09d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:10.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.178+0000 7f09e9ffb700 1 -- 172.21.15.146:0/1112392267 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f09e40844c0 con 0x7f09f4153ab0 2023-10-06T11:17:10.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.178+0000 7f09f9e48700 1 --2- 172.21.15.146:0/1112392267 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f09d8066f30 0x7f09d80693e0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f09f0009db0 tx=0x7f09f00091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:10.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.182+0000 7f09e9ffb700 1 -- 172.21.15.146:0/1112392267 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f09e4055020 con 0x7f09f4153ab0 2023-10-06T11:17:10.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.408+0000 7f09fc0ac700 1 -- 172.21.15.146:0/1112392267 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f09f40b5c50 con 0x7f09f4153ab0 2023-10-06T11:17:10.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.409+0000 7f09e9ffb700 1 -- 172.21.15.146:0/1112392267 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 121 v121) v1 ==== 95+0+4610 (secure 0 0 0) 0x7f09e4054bb0 con 0x7f09f4153ab0 2023-10-06T11:17:10.410 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:10.410 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":121,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7181,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/255475004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":255475004},{"type":"v1","addr":"172.21.15.151:6834","nonce":255475004}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":116},{"gid":7184,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/206881843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":206881843},{"type":"v1","addr":"172.21.15.151:6835","nonce":206881843}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":116},{"gid":9192,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/3140231910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3140231910},{"type":"v1","addr":"172.21.15.146:6835","nonce":3140231910}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":116}],"filesystems":[{"mdsmap":{"epoch":121,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:16:23.472674+0000","modified":"2023-10-06T11:16:27.116489+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9198},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9198":{"gid":9198,"name":"a","rank":0,"incarnation":117,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/525107449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":525107449},{"type":"v1","addr":"172.21.15.146:6837","nonce":525107449}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-06T11:17:10.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.411+0000 7f09fc0ac700 1 -- 172.21.15.146:0/1112392267 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f09d8066f30 msgr2=0x7f09d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:10.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.411+0000 7f09fc0ac700 1 --2- 172.21.15.146:0/1112392267 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f09d8066f30 0x7f09d80693e0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f09f0009db0 tx=0x7f09f00091a0 comp rx=0 tx=0).stop 2023-10-06T11:17:10.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.411+0000 7f09fc0ac700 1 -- 172.21.15.146:0/1112392267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09f4153ab0 msgr2=0x7f09f414afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:10.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.411+0000 7f09fc0ac700 1 --2- 172.21.15.146:0/1112392267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09f4153ab0 0x7f09f414afd0 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f09e400e8f0 tx=0x7f09e4008040 comp rx=0 tx=0).stop 2023-10-06T11:17:10.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.411+0000 7f09fc0ac700 1 -- 172.21.15.146:0/1112392267 shutdown_connections 2023-10-06T11:17:10.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.411+0000 7f09fc0ac700 1 --2- 172.21.15.146:0/1112392267 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f09d8066f30 0x7f09d80693e0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:10.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.411+0000 7f09fc0ac700 1 --2- 172.21.15.146:0/1112392267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09f4153e80 0x7f09f416cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:10.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.411+0000 7f09fc0ac700 1 --2- 172.21.15.146:0/1112392267 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f09f40689d0 0x7f09f414aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:10.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.411+0000 7f09fc0ac700 1 --2- 172.21.15.146:0/1112392267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f09f4153ab0 0x7f09f414afd0 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:10.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.411+0000 7f09fc0ac700 1 -- 172.21.15.146:0/1112392267 >> 172.21.15.146:0/1112392267 conn(0x7f09f406eba0 msgr2=0x7f09f415c250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:10.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.411+0000 7f09fc0ac700 1 -- 172.21.15.146:0/1112392267 shutdown_connections 2023-10-06T11:17:10.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.411+0000 7f09fc0ac700 1 -- 172.21.15.146:0/1112392267 wait complete. 2023-10-06T11:17:10.414 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 121 2023-10-06T11:17:10.425 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:17:10.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.539+0000 7f43ba57f700 1 Processor -- start 2023-10-06T11:17:10.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.539+0000 7f43ba57f700 1 -- start start 2023-10-06T11:17:10.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.540+0000 7f43ba57f700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f43b415a7f0 0x7f43b415cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:10.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.540+0000 7f43ba57f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43b40b2530 0x7f43b415acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:10.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.540+0000 7f43ba57f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43b415c630 con 0x7f43b415a420 2023-10-06T11:17:10.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.540+0000 7f43ba57f700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43b40ce040 con 0x7f43b415a7f0 2023-10-06T11:17:10.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.540+0000 7f43ba57f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b415ba20 con 0x7f43b40b2530 2023-10-06T11:17:10.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.540+0000 7f43b957d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f43b415a420 0x7f43b40b1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60936/0 (socket says 172.21.15.146:60936) 2023-10-06T11:17:10.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.540+0000 7f43b957d700 1 -- 172.21.15.146:0/920428400 learned_addr learned my addr 172.21.15.146:0/920428400 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:17:10.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.540+0000 7f43abfff700 1 -- 172.21.15.146:0/920428400 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3725982417 0 0) 0x7f43b415c630 con 0x7f43b415a420 2023-10-06T11:17:10.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.540+0000 7f43b9d7e700 1 --2- 172.21.15.146:0/920428400 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43b40b2530 0x7f43b415acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:10.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.540+0000 7f43abfff700 1 -- 172.21.15.146:0/920428400 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43a0003570 con 0x7f43b415a420 2023-10-06T11:17:10.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.540+0000 7f43b8d7c700 1 --2- 172.21.15.146:0/920428400 >> v2:172.21.15.151:3300/0 conn(0x7f43b415a7f0 0x7f43b415cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:10.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.540+0000 7f43abfff700 1 -- 172.21.15.146:0/920428400 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 215320097 0 0) 0x7f43a0003570 con 0x7f43b415a420 2023-10-06T11:17:10.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.540+0000 7f43abfff700 1 -- 172.21.15.146:0/920428400 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43b40b2530 msgr2=0x7f43b415acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:10.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.540+0000 7f43abfff700 1 --2- 172.21.15.146:0/920428400 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43b40b2530 0x7f43b415acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:10.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.540+0000 7f43abfff700 1 -- 172.21.15.146:0/920428400 >> v2:172.21.15.151:3300/0 conn(0x7f43b415a7f0 msgr2=0x7f43b415cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:10.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.540+0000 7f43abfff700 1 --2- 172.21.15.146:0/920428400 >> v2:172.21.15.151:3300/0 conn(0x7f43b415a7f0 0x7f43b415cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:10.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.540+0000 7f43abfff700 1 -- 172.21.15.146:0/920428400 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b415bd00 con 0x7f43b415a420 2023-10-06T11:17:10.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.540+0000 7f43abfff700 1 -- 172.21.15.146:0/920428400 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f43ac0017f0 con 0x7f43b415a420 2023-10-06T11:17:10.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.540+0000 7f43abfff700 1 -- 172.21.15.146:0/920428400 >> v1:172.21.15.146:6789/0 conn(0x7f43b415a420 legacy=0x7f43b40b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:10.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.540+0000 7f43abfff700 1 --2- 172.21.15.146:0/920428400 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43b40b2530 0x7f43a0003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:10.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.541+0000 7f43abfff700 1 --2- 172.21.15.146:0/920428400 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43a0003fe0 0x7f43a0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:10.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.541+0000 7f43abfff700 1 --2- 172.21.15.146:0/920428400 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43a0004d50 0x7f43a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:10.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.541+0000 7f43abfff700 1 -- 172.21.15.146:0/920428400 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b415ba20 con 0x7f43a0003fe0 2023-10-06T11:17:10.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.541+0000 7f43abfff700 1 -- 172.21.15.146:0/920428400 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a000ba60 con 0x7f43a0004d50 2023-10-06T11:17:10.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.541+0000 7f43abfff700 1 -- 172.21.15.146:0/920428400 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a000bbd0 con 0x7f43b40b2530 2023-10-06T11:17:10.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.541+0000 7f43b8d7c700 1 --2- 172.21.15.146:0/920428400 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43a0003fe0 0x7f43a0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:10.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.541+0000 7f43b957d700 1 --2- 172.21.15.146:0/920428400 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43b40b2530 0x7f43a0003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:10.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.541+0000 7f43b9d7e700 1 --2- 172.21.15.146:0/920428400 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43a0004d50 0x7f43a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:10.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.541+0000 7f43b8d7c700 1 -- 172.21.15.146:0/920428400 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43b40b2530 msgr2=0x7f43a0003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:10.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.541+0000 7f43b8d7c700 1 --2- 172.21.15.146:0/920428400 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43b40b2530 0x7f43a0003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:10.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.541+0000 7f43b8d7c700 1 -- 172.21.15.146:0/920428400 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43a0004d50 msgr2=0x7f43a00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:10.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.541+0000 7f43b8d7c700 1 --2- 172.21.15.146:0/920428400 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43a0004d50 0x7f43a00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:10.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.541+0000 7f43b8d7c700 1 -- 172.21.15.146:0/920428400 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a0003570 con 0x7f43a0003fe0 2023-10-06T11:17:10.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.541+0000 7f43b9d7e700 1 --2- 172.21.15.146:0/920428400 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43a0004d50 0x7f43a00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:17:10.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.541+0000 7f43b8d7c700 1 --2- 172.21.15.146:0/920428400 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43a0003fe0 0x7f43a0004810 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f43a4009c00 tx=0x7f43a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e6af9c348bd06ee server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:10.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.541+0000 7f43abfff700 1 -- 172.21.15.146:0/920428400 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a400e6b0 con 0x7f43a0003fe0 2023-10-06T11:17:10.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.541+0000 7f43abfff700 1 -- 172.21.15.146:0/920428400 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a400e810 con 0x7f43a0003fe0 2023-10-06T11:17:10.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.541+0000 7f43abfff700 1 -- 172.21.15.146:0/920428400 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a400ebd0 con 0x7f43a0003fe0 2023-10-06T11:17:10.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.542+0000 7f43ba57f700 1 -- 172.21.15.146:0/920428400 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43a0003fe0 msgr2=0x7f43a0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:10.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.542+0000 7f43ba57f700 1 --2- 172.21.15.146:0/920428400 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43a0003fe0 0x7f43a0004810 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f43a4009c00 tx=0x7f43a40091a0 comp rx=0 tx=0).stop 2023-10-06T11:17:10.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.542+0000 7f43b9d7e700 1 -- 172.21.15.146:0/920428400 reap_dead start 2023-10-06T11:17:10.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.542+0000 7f43ba57f700 1 -- 172.21.15.146:0/920428400 shutdown_connections 2023-10-06T11:17:10.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.542+0000 7f43ba57f700 1 -- 172.21.15.146:0/920428400 >> 172.21.15.146:0/920428400 conn(0x7f43b406eba0 msgr2=0x7f43b406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:10.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.542+0000 7f43ba57f700 1 -- 172.21.15.146:0/920428400 shutdown_connections 2023-10-06T11:17:10.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.542+0000 7f43ba57f700 1 -- 172.21.15.146:0/920428400 wait complete. 2023-10-06T11:17:10.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.543+0000 7f43ba57f700 1 Processor -- start 2023-10-06T11:17:10.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.543+0000 7f43ba57f700 1 -- start start 2023-10-06T11:17:10.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.544+0000 7f43ba57f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43a0003fe0 0x7f43b4169b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:10.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.544+0000 7f43ba57f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43b414c850 0x7f43b40c52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:10.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.544+0000 7f43ba57f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43b40cfc70 0x7f43b40d00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:10.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.544+0000 7f43ba57f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b40d0620 con 0x7f43a0003fe0 2023-10-06T11:17:10.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.544+0000 7f43ba57f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b415e7d0 con 0x7f43b414c850 2023-10-06T11:17:10.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.544+0000 7f43ba57f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b40c5810 con 0x7f43b40cfc70 2023-10-06T11:17:10.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.544+0000 7f43b957d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43a0003fe0 0x7f43b4169b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:10.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.544+0000 7f43b957d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43a0003fe0 0x7f43b4169b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36308/0 (socket says 172.21.15.146:36308) 2023-10-06T11:17:10.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.544+0000 7f43b957d700 1 -- 172.21.15.146:0/490159452 learned_addr learned my addr 172.21.15.146:0/490159452 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:10.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.544+0000 7f43b9d7e700 1 --2- 172.21.15.146:0/490159452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43b40cfc70 0x7f43b40d00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:10.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.544+0000 7f43b8d7c700 1 --2- 172.21.15.146:0/490159452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43b414c850 0x7f43b40c52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:10.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.544+0000 7f43b957d700 1 -- 172.21.15.146:0/490159452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43b40cfc70 msgr2=0x7f43b40d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:10.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.544+0000 7f43b957d700 1 --2- 172.21.15.146:0/490159452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43b40cfc70 0x7f43b40d00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:10.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.544+0000 7f43b957d700 1 -- 172.21.15.146:0/490159452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43b414c850 msgr2=0x7f43b40c52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:10.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.544+0000 7f43b957d700 1 --2- 172.21.15.146:0/490159452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43b414c850 0x7f43b40c52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:10.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.544+0000 7f43b957d700 1 -- 172.21.15.146:0/490159452 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b416a200 con 0x7f43a0003fe0 2023-10-06T11:17:10.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.544+0000 7f43b957d700 1 --2- 172.21.15.146:0/490159452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43a0003fe0 0x7f43b4169b50 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f43ac001190 tx=0x7f43ac002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:10.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.545+0000 7f43a97fa700 1 -- 172.21.15.146:0/490159452 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ac007b60 con 0x7f43a0003fe0 2023-10-06T11:17:10.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.545+0000 7f43a97fa700 1 -- 172.21.15.146:0/490159452 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43ac00ad00 con 0x7f43a0003fe0 2023-10-06T11:17:10.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.545+0000 7f43ba57f700 1 -- 172.21.15.146:0/490159452 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43b416a4e0 con 0x7f43a0003fe0 2023-10-06T11:17:10.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.545+0000 7f43a97fa700 1 -- 172.21.15.146:0/490159452 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43ac013660 con 0x7f43a0003fe0 2023-10-06T11:17:10.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.545+0000 7f43ba57f700 1 -- 172.21.15.146:0/490159452 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43b416aaa0 con 0x7f43a0003fe0 2023-10-06T11:17:10.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.546+0000 7f43ba57f700 1 -- 172.21.15.146:0/490159452 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43b40b02b0 con 0x7f43a0003fe0 2023-10-06T11:17:10.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.546+0000 7f43a97fa700 1 -- 172.21.15.146:0/490159452 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f43ac0139d0 con 0x7f43a0003fe0 2023-10-06T11:17:10.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.546+0000 7f43a97fa700 1 --2- 172.21.15.146:0/490159452 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4398066f30 0x7f43980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:10.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.547+0000 7f43b8d7c700 1 --2- 172.21.15.146:0/490159452 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4398066f30 0x7f43980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:10.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.547+0000 7f43a97fa700 1 -- 172.21.15.146:0/490159452 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f43ac0853d0 con 0x7f43a0003fe0 2023-10-06T11:17:10.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.547+0000 7f43b8d7c700 1 --2- 172.21.15.146:0/490159452 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4398066f30 0x7f43980693e0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f43a40091e0 tx=0x7f43a401a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:10.553 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.551+0000 7f43a97fa700 1 -- 172.21.15.146:0/490159452 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f43ac0524a0 con 0x7f43a0003fe0 2023-10-06T11:17:10.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.736+0000 7f43ba57f700 1 -- 172.21.15.146:0/490159452 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43b415bfe0 con 0x7f43a0003fe0 2023-10-06T11:17:10.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.736+0000 7f43a97fa700 1 -- 172.21.15.146:0/490159452 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) v1 ==== 74+0+17026 (secure 0 0 0) 0x7f43ac055ac0 con 0x7f43a0003fe0 2023-10-06T11:17:10.737 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:10.738 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":139,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:16:33.419424+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:16:21.174178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-10-06T11:16:22.437689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.21","mappings":[{"from":3,"to":0}]},{"pgid":"22.3a","mappings":[{"from":3,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:17:10.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.738+0000 7f43ba57f700 1 -- 172.21.15.146:0/490159452 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4398066f30 msgr2=0x7f43980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:10.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.738+0000 7f43ba57f700 1 --2- 172.21.15.146:0/490159452 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4398066f30 0x7f43980693e0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f43a40091e0 tx=0x7f43a401a000 comp rx=0 tx=0).stop 2023-10-06T11:17:10.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.738+0000 7f43ba57f700 1 -- 172.21.15.146:0/490159452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43a0003fe0 msgr2=0x7f43b4169b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:10.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.738+0000 7f43ba57f700 1 --2- 172.21.15.146:0/490159452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43a0003fe0 0x7f43b4169b50 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f43ac001190 tx=0x7f43ac002210 comp rx=0 tx=0).stop 2023-10-06T11:17:10.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.738+0000 7f43ba57f700 1 -- 172.21.15.146:0/490159452 shutdown_connections 2023-10-06T11:17:10.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.738+0000 7f43ba57f700 1 --2- 172.21.15.146:0/490159452 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4398066f30 0x7f43980693e0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:10.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.738+0000 7f43ba57f700 1 --2- 172.21.15.146:0/490159452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43b40cfc70 0x7f43b40d00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:10.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.738+0000 7f43ba57f700 1 --2- 172.21.15.146:0/490159452 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43a0003fe0 0x7f43b4169b50 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:10.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.738+0000 7f43ba57f700 1 --2- 172.21.15.146:0/490159452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43b414c850 0x7f43b40c52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:10.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.738+0000 7f43ba57f700 1 -- 172.21.15.146:0/490159452 >> 172.21.15.146:0/490159452 conn(0x7f43b406eba0 msgr2=0x7f43b414f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:10.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.738+0000 7f43ba57f700 1 -- 172.21.15.146:0/490159452 shutdown_connections 2023-10-06T11:17:10.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.738+0000 7f43ba57f700 1 -- 172.21.15.146:0/490159452 wait complete. 2023-10-06T11:17:10.752 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T11:17:10.752 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:17:10.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.866+0000 7fedcc738700 1 Processor -- start 2023-10-06T11:17:10.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.866+0000 7fedcc738700 1 -- start start 2023-10-06T11:17:10.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.867+0000 7fedcc738700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fedc4068ba0 0x7fedc415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:10.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.867+0000 7fedcc738700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedc415ac30 con 0x7fedc4153e80 2023-10-06T11:17:10.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.867+0000 7fedcc738700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedc40b4510 con 0x7fedc4153ab0 2023-10-06T11:17:10.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.867+0000 7fedcc738700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedc40b6530 con 0x7fedc4068ba0 2023-10-06T11:17:10.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.867+0000 7fedcacd5700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fedc4153e80 0x7fedc40b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:60950/0 (socket says 172.21.15.146:60950) 2023-10-06T11:17:10.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.867+0000 7fedcacd5700 1 -- 172.21.15.146:0/414447043 learned_addr learned my addr 172.21.15.146:0/414447043 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:17:10.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.867+0000 7fedc9cd3700 1 --2- 172.21.15.146:0/414447043 >> v2:172.21.15.151:3300/0 conn(0x7fedc4068ba0 0x7fedc415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:10.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.867+0000 7fedc94d2700 1 -- 172.21.15.146:0/414447043 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1287357069 0 0) 0x7fedbc001490 con 0x7fedc4153e80 2023-10-06T11:17:10.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.867+0000 7fedc94d2700 1 -- 172.21.15.146:0/414447043 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedb4003570 con 0x7fedc4153e80 2023-10-06T11:17:10.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.867+0000 7fedc94d2700 1 -- 172.21.15.146:0/414447043 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2528449669 0 0) 0x7fedb4003570 con 0x7fedc4153e80 2023-10-06T11:17:10.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.867+0000 7fedc94d2700 1 -- 172.21.15.146:0/414447043 >> v2:172.21.15.151:3300/0 conn(0x7fedc4068ba0 msgr2=0x7fedc415a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:10.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.867+0000 7fedc94d2700 1 --2- 172.21.15.146:0/414447043 >> v2:172.21.15.151:3300/0 conn(0x7fedc4068ba0 0x7fedc415a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:10.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.867+0000 7fedc94d2700 1 -- 172.21.15.146:0/414447043 >> v1:172.21.15.151:6789/0 conn(0x7fedc4153ab0 legacy=0x7fedc4068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:10.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.867+0000 7fedc94d2700 1 -- 172.21.15.146:0/414447043 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc40b5c50 con 0x7fedc4153e80 2023-10-06T11:17:10.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.867+0000 7fedc94d2700 1 -- 172.21.15.146:0/414447043 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fedbc001980 con 0x7fedc4153e80 2023-10-06T11:17:10.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.867+0000 7fedc94d2700 1 -- 172.21.15.146:0/414447043 >> v1:172.21.15.146:6789/0 conn(0x7fedc4153e80 legacy=0x7fedc40b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:10.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.867+0000 7fedc94d2700 1 --2- 172.21.15.146:0/414447043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedb4003a60 0x7fedb4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:10.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.867+0000 7fedc94d2700 1 --2- 172.21.15.146:0/414447043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fedb4004810 0x7fedb4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:10.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.867+0000 7fedc94d2700 1 --2- 172.21.15.146:0/414447043 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fedb40051c0 0x7fedb400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:10.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.867+0000 7fedc94d2700 1 -- 172.21.15.146:0/414447043 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc40b6530 con 0x7fedb4003a60 2023-10-06T11:17:10.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.867+0000 7fedc94d2700 1 -- 172.21.15.146:0/414447043 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb400c0d0 con 0x7fedb4004810 2023-10-06T11:17:10.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.867+0000 7fedc94d2700 1 -- 172.21.15.146:0/414447043 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb400c290 con 0x7fedb40051c0 2023-10-06T11:17:10.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.867+0000 7fedca4d4700 1 --2- 172.21.15.146:0/414447043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedb4003a60 0x7fedb4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:10.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.867+0000 7fedc9cd3700 1 --2- 172.21.15.146:0/414447043 >> v2:172.21.15.151:3300/0 conn(0x7fedc4068ba0 0x7fedc415a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:17:10.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.868+0000 7fedcacd5700 1 --2- 172.21.15.146:0/414447043 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fedb40051c0 0x7fedb400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:10.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.868+0000 7fedc9cd3700 1 --2- 172.21.15.146:0/414447043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fedb4004810 0x7fedb4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:10.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.868+0000 7fedca4d4700 1 -- 172.21.15.146:0/414447043 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fedb40051c0 msgr2=0x7fedb400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:10.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.868+0000 7fedca4d4700 1 --2- 172.21.15.146:0/414447043 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fedb40051c0 0x7fedb400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:10.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.868+0000 7fedca4d4700 1 -- 172.21.15.146:0/414447043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fedb4004810 msgr2=0x7fedb4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:10.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.868+0000 7fedca4d4700 1 --2- 172.21.15.146:0/414447043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fedb4004810 0x7fedb4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:10.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.868+0000 7fedca4d4700 1 -- 172.21.15.146:0/414447043 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb4003570 con 0x7fedb4003a60 2023-10-06T11:17:10.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.868+0000 7fedcacd5700 1 -- 172.21.15.146:0/414447043 reap_dead start 2023-10-06T11:17:10.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.868+0000 7fedc9cd3700 1 --2- 172.21.15.146:0/414447043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fedb4004810 0x7fedb4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:17:10.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.868+0000 7fedca4d4700 1 --2- 172.21.15.146:0/414447043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedb4003a60 0x7fedb4003e70 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7fedb80018e0 tx=0x7fedb8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fea6fd088fc496f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:10.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.868+0000 7fedc94d2700 1 -- 172.21.15.146:0/414447043 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb8012420 con 0x7fedb4003a60 2023-10-06T11:17:10.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.868+0000 7fedc94d2700 1 -- 172.21.15.146:0/414447043 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb80125a0 con 0x7fedb4003a60 2023-10-06T11:17:10.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.868+0000 7fedc94d2700 1 -- 172.21.15.146:0/414447043 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb8012960 con 0x7fedb4003a60 2023-10-06T11:17:10.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.869+0000 7fedcc738700 1 -- 172.21.15.146:0/414447043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedb4003a60 msgr2=0x7fedb4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:10.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.869+0000 7fedcc738700 1 --2- 172.21.15.146:0/414447043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedb4003a60 0x7fedb4003e70 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7fedb80018e0 tx=0x7fedb8007d30 comp rx=0 tx=0).stop 2023-10-06T11:17:10.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.869+0000 7fedcc738700 1 -- 172.21.15.146:0/414447043 shutdown_connections 2023-10-06T11:17:10.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.869+0000 7fedcc738700 1 --2- 172.21.15.146:0/414447043 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedb4003a60 0x7fedb4003e70 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:10.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.869+0000 7fedcc738700 1 -- 172.21.15.146:0/414447043 >> 172.21.15.146:0/414447043 conn(0x7fedc406eba0 msgr2=0x7fedc406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:10.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.869+0000 7fedcc738700 1 -- 172.21.15.146:0/414447043 shutdown_connections 2023-10-06T11:17:10.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.869+0000 7fedcc738700 1 -- 172.21.15.146:0/414447043 wait complete. 2023-10-06T11:17:10.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.870+0000 7fedcc738700 1 Processor -- start 2023-10-06T11:17:10.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.870+0000 7fedcc738700 1 -- start start 2023-10-06T11:17:10.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.870+0000 7fedcc738700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fedb4003a60 0x7fedc41697e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:10.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.870+0000 7fedcc738700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedc4151e20 0x7fedc4159570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:10.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.870+0000 7fedcc738700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fedc415b790 0x7fedc415bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:10.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.870+0000 7fedcc738700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc415c150 con 0x7fedc4151e20 2023-10-06T11:17:10.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.870+0000 7fedcc738700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc4159ab0 con 0x7fedb4003a60 2023-10-06T11:17:10.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.870+0000 7fedcc738700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc4154ae0 con 0x7fedc415b790 2023-10-06T11:17:10.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.870+0000 7fedc9cd3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedc4151e20 0x7fedc4159570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:10.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.871+0000 7fedc9cd3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedc4151e20 0x7fedc4159570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36326/0 (socket says 172.21.15.146:36326) 2023-10-06T11:17:10.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.871+0000 7fedc9cd3700 1 -- 172.21.15.146:0/487002961 learned_addr learned my addr 172.21.15.146:0/487002961 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:10.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.871+0000 7fedcacd5700 1 --2- 172.21.15.146:0/487002961 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fedc415b790 0x7fedc415bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:10.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.871+0000 7fedca4d4700 1 --2- 172.21.15.146:0/487002961 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fedb4003a60 0x7fedc41697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:10.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.871+0000 7fedc9cd3700 1 -- 172.21.15.146:0/487002961 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fedc415b790 msgr2=0x7fedc415bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:10.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.871+0000 7fedc9cd3700 1 --2- 172.21.15.146:0/487002961 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fedc415b790 0x7fedc415bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:10.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.871+0000 7fedc9cd3700 1 -- 172.21.15.146:0/487002961 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fedb4003a60 msgr2=0x7fedc41697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:10.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.871+0000 7fedc9cd3700 1 --2- 172.21.15.146:0/487002961 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fedb4003a60 0x7fedc41697e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:10.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.871+0000 7fedc9cd3700 1 -- 172.21.15.146:0/487002961 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc416a740 con 0x7fedc4151e20 2023-10-06T11:17:10.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.871+0000 7fedca4d4700 1 --2- 172.21.15.146:0/487002961 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fedb4003a60 0x7fedc41697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:17:10.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.871+0000 7fedc9cd3700 1 --2- 172.21.15.146:0/487002961 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedc4151e20 0x7fedc4159570 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7fedb0010a20 tx=0x7fedb0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:10.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.871+0000 7fedc27fc700 1 -- 172.21.15.146:0/487002961 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb000e870 con 0x7fedc4151e20 2023-10-06T11:17:10.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.871+0000 7fedc27fc700 1 -- 172.21.15.146:0/487002961 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedb000e9d0 con 0x7fedc4151e20 2023-10-06T11:17:10.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.871+0000 7fedcc738700 1 -- 172.21.15.146:0/487002961 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedc4152290 con 0x7fedc4151e20 2023-10-06T11:17:10.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.871+0000 7fedc27fc700 1 -- 172.21.15.146:0/487002961 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb000ed90 con 0x7fedc4151e20 2023-10-06T11:17:10.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.871+0000 7fedcc738700 1 -- 172.21.15.146:0/487002961 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedc416a180 con 0x7fedc4151e20 2023-10-06T11:17:10.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.872+0000 7fedcc738700 1 -- 172.21.15.146:0/487002961 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedc404c380 con 0x7fedc4151e20 2023-10-06T11:17:10.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.873+0000 7fedc27fc700 1 -- 172.21.15.146:0/487002961 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fedb0014600 con 0x7fedc4151e20 2023-10-06T11:17:10.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.873+0000 7fedc27fc700 1 --2- 172.21.15.146:0/487002961 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feda8066f30 0x7feda80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:10.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.873+0000 7fedc27fc700 1 -- 172.21.15.146:0/487002961 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fedb0084940 con 0x7fedc4151e20 2023-10-06T11:17:10.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.873+0000 7fedca4d4700 1 --2- 172.21.15.146:0/487002961 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feda8066f30 0x7feda80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:10.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.873+0000 7fedca4d4700 1 --2- 172.21.15.146:0/487002961 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feda8066f30 0x7feda80693e0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fedc415f320 tx=0x7fedb8015000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:10.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:10.877+0000 7fedc27fc700 1 -- 172.21.15.146:0/487002961 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fedb0051ad0 con 0x7fedc4151e20 2023-10-06T11:17:11.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.104+0000 7fedcc738700 1 -- 172.21.15.146:0/487002961 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fedc40b6250 con 0x7fedc4151e20 2023-10-06T11:17:11.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.105+0000 7fedc27fc700 1 -- 172.21.15.146:0/487002961 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 121 v121) v1 ==== 95+0+4610 (secure 0 0 0) 0x7fedb00550f0 con 0x7fedc4151e20 2023-10-06T11:17:11.106 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:11.106 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":121,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7181,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/255475004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":255475004},{"type":"v1","addr":"172.21.15.151:6834","nonce":255475004}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":116},{"gid":7184,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/206881843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":206881843},{"type":"v1","addr":"172.21.15.151:6835","nonce":206881843}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":116},{"gid":9192,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/3140231910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3140231910},{"type":"v1","addr":"172.21.15.146:6835","nonce":3140231910}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":116}],"filesystems":[{"mdsmap":{"epoch":121,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:16:23.472674+0000","modified":"2023-10-06T11:16:27.116489+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9198},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9198":{"gid":9198,"name":"a","rank":0,"incarnation":117,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/525107449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":525107449},{"type":"v1","addr":"172.21.15.146:6837","nonce":525107449}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-06T11:17:11.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.107+0000 7fedcc738700 1 -- 172.21.15.146:0/487002961 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feda8066f30 msgr2=0x7feda80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:11.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.107+0000 7fedcc738700 1 --2- 172.21.15.146:0/487002961 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feda8066f30 0x7feda80693e0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fedc415f320 tx=0x7fedb8015000 comp rx=0 tx=0).stop 2023-10-06T11:17:11.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.107+0000 7fedcc738700 1 -- 172.21.15.146:0/487002961 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedc4151e20 msgr2=0x7fedc4159570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:11.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.107+0000 7fedcc738700 1 --2- 172.21.15.146:0/487002961 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedc4151e20 0x7fedc4159570 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7fedb0010a20 tx=0x7fedb0008040 comp rx=0 tx=0).stop 2023-10-06T11:17:11.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.107+0000 7fedcc738700 1 -- 172.21.15.146:0/487002961 shutdown_connections 2023-10-06T11:17:11.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.107+0000 7fedcc738700 1 --2- 172.21.15.146:0/487002961 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feda8066f30 0x7feda80693e0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.107+0000 7fedcc738700 1 --2- 172.21.15.146:0/487002961 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fedc415b790 0x7fedc415bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.107+0000 7fedcc738700 1 --2- 172.21.15.146:0/487002961 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fedb4003a60 0x7fedc41697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.107+0000 7fedcc738700 1 --2- 172.21.15.146:0/487002961 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fedc4151e20 0x7fedc4159570 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.107+0000 7fedcc738700 1 -- 172.21.15.146:0/487002961 >> 172.21.15.146:0/487002961 conn(0x7fedc406eba0 msgr2=0x7fedc415c650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:11.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.107+0000 7fedcc738700 1 -- 172.21.15.146:0/487002961 shutdown_connections 2023-10-06T11:17:11.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.107+0000 7fedcc738700 1 -- 172.21.15.146:0/487002961 wait complete. 2023-10-06T11:17:11.111 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 121 2023-10-06T11:17:11.120 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:17:11.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.233+0000 7ff6f8df5700 1 Processor -- start 2023-10-06T11:17:11.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.233+0000 7ff6f8df5700 1 -- start start 2023-10-06T11:17:11.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.234+0000 7ff6f8df5700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff6f4153ab0 0x7ff6f415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:11.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.234+0000 7ff6f8df5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff6f4068ba0 0x7ff6f40b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:11.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.234+0000 7ff6f8df5700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6f415ac30 con 0x7ff6f4153e80 2023-10-06T11:17:11.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.234+0000 7ff6f8df5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6f40b4510 con 0x7ff6f4068ba0 2023-10-06T11:17:11.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.234+0000 7ff6f8df5700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6f40b6530 con 0x7ff6f4153ab0 2023-10-06T11:17:11.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.234+0000 7ff6f2d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff6f4068ba0 0x7ff6f40b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:11.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.234+0000 7ff6f2d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff6f4068ba0 0x7ff6f40b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36330/0 (socket says 172.21.15.146:36330) 2023-10-06T11:17:11.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.234+0000 7ff6f2d9d700 1 -- 172.21.15.146:0/100959559 learned_addr learned my addr 172.21.15.146:0/100959559 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:11.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.235+0000 7ff6f259c700 1 --2- 172.21.15.146:0/100959559 >> v2:172.21.15.151:3300/0 conn(0x7ff6f4153ab0 0x7ff6f415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:11.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.235+0000 7ff6f2d9d700 1 -- 172.21.15.146:0/100959559 >> v2:172.21.15.151:3300/0 conn(0x7ff6f4153ab0 msgr2=0x7ff6f415a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:11.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.235+0000 7ff6f2d9d700 1 --2- 172.21.15.146:0/100959559 >> v2:172.21.15.151:3300/0 conn(0x7ff6f4153ab0 0x7ff6f415a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.235+0000 7ff6f2d9d700 1 -- 172.21.15.146:0/100959559 >> v1:172.21.15.151:6789/0 conn(0x7ff6f4153e80 legacy=0x7ff6f4068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:11.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.235+0000 7ff6f2d9d700 1 -- 172.21.15.146:0/100959559 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f40b5c50 con 0x7ff6f4068ba0 2023-10-06T11:17:11.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.235+0000 7ff6f2d9d700 1 --2- 172.21.15.146:0/100959559 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f4068ba0 0x7ff6f40b49a0 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7ff6f40b5eb0 tx=0x7ff6ec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce843056d6f5e279 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:11.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.235+0000 7ff6f1d9b700 1 -- 172.21.15.146:0/100959559 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec00e070 con 0x7ff6f4068ba0 2023-10-06T11:17:11.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.235+0000 7ff6f1d9b700 1 -- 172.21.15.146:0/100959559 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6ec00ba50 con 0x7ff6f4068ba0 2023-10-06T11:17:11.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.235+0000 7ff6f1d9b700 1 -- 172.21.15.146:0/100959559 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec0092e0 con 0x7ff6f4068ba0 2023-10-06T11:17:11.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.235+0000 7ff6f8df5700 1 -- 172.21.15.146:0/100959559 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f4068ba0 msgr2=0x7ff6f40b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:11.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.235+0000 7ff6f8df5700 1 --2- 172.21.15.146:0/100959559 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f4068ba0 0x7ff6f40b49a0 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7ff6f40b5eb0 tx=0x7ff6ec009840 comp rx=0 tx=0).stop 2023-10-06T11:17:11.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.236+0000 7ff6f8df5700 1 -- 172.21.15.146:0/100959559 shutdown_connections 2023-10-06T11:17:11.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.236+0000 7ff6f8df5700 1 --2- 172.21.15.146:0/100959559 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f4068ba0 0x7ff6f40b49a0 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.236+0000 7ff6f8df5700 1 --2- 172.21.15.146:0/100959559 >> v2:172.21.15.151:3300/0 conn(0x7ff6f4153ab0 0x7ff6f415a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.236+0000 7ff6f8df5700 1 -- 172.21.15.146:0/100959559 >> 172.21.15.146:0/100959559 conn(0x7ff6f406eba0 msgr2=0x7ff6f406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:11.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.236+0000 7ff6f8df5700 1 -- 172.21.15.146:0/100959559 shutdown_connections 2023-10-06T11:17:11.239 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.236+0000 7ff6f8df5700 1 -- 172.21.15.146:0/100959559 wait complete. 2023-10-06T11:17:11.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.237+0000 7ff6f8df5700 1 Processor -- start 2023-10-06T11:17:11.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.237+0000 7ff6f8df5700 1 -- start start 2023-10-06T11:17:11.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.237+0000 7ff6f8df5700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6f4068ba0 0x7ff6f40b18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:11.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.237+0000 7ff6f8df5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f4153ab0 0x7ff6f4154310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:11.241 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.238+0000 7ff6f8df5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6f4153e80 0x7ff6f415a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:11.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.238+0000 7ff6f8df5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f4154850 con 0x7ff6f4153ab0 2023-10-06T11:17:11.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.238+0000 7ff6f8df5700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f40b1e80 con 0x7ff6f4153e80 2023-10-06T11:17:11.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.238+0000 7ff6f8df5700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6f40b2160 con 0x7ff6f4068ba0 2023-10-06T11:17:11.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.238+0000 7ff6e9d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f4153ab0 0x7ff6f4154310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:11.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.238+0000 7ff6e9d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f4153ab0 0x7ff6f4154310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:36340/0 (socket says 172.21.15.146:36340) 2023-10-06T11:17:11.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.238+0000 7ff6e9d9b700 1 -- 172.21.15.146:0/3426638354 learned_addr learned my addr 172.21.15.146:0/3426638354 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:11.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.238+0000 7ff6e9d9b700 1 -- 172.21.15.146:0/3426638354 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6f4068ba0 msgr2=0x7ff6f40b18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:11.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.238+0000 7ff6e9d9b700 1 --2- 172.21.15.146:0/3426638354 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6f4068ba0 0x7ff6f40b18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.238+0000 7ff6e9d9b700 1 -- 172.21.15.146:0/3426638354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6f4153e80 msgr2=0x7ff6f415a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:11.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.238+0000 7ff6e9d9b700 1 --2- 172.21.15.146:0/3426638354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6f4153e80 0x7ff6f415a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.238+0000 7ff6e9d9b700 1 -- 172.21.15.146:0/3426638354 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ec009ae0 con 0x7ff6f4153ab0 2023-10-06T11:17:11.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.238+0000 7ff6e9d9b700 1 --2- 172.21.15.146:0/3426638354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f4153ab0 0x7ff6f4154310 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc00c590 tx=0x7ff6dc00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:11.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.238+0000 7ff6eaffd700 1 -- 172.21.15.146:0/3426638354 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc011590 con 0x7ff6f4153ab0 2023-10-06T11:17:11.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.238+0000 7ff6eaffd700 1 -- 172.21.15.146:0/3426638354 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6dc0116f0 con 0x7ff6f4153ab0 2023-10-06T11:17:11.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.238+0000 7ff6f8df5700 1 -- 172.21.15.146:0/3426638354 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6f40b2440 con 0x7ff6f4153ab0 2023-10-06T11:17:11.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.238+0000 7ff6eaffd700 1 -- 172.21.15.146:0/3426638354 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc011ab0 con 0x7ff6f4153ab0 2023-10-06T11:17:11.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.238+0000 7ff6f8df5700 1 -- 172.21.15.146:0/3426638354 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6f4169f00 con 0x7ff6f4153ab0 2023-10-06T11:17:11.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.239+0000 7ff6f8df5700 1 -- 172.21.15.146:0/3426638354 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6f416a0f0 con 0x7ff6f4153ab0 2023-10-06T11:17:11.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.240+0000 7ff6eaffd700 1 -- 172.21.15.146:0/3426638354 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff6dc01b3b0 con 0x7ff6f4153ab0 2023-10-06T11:17:11.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.240+0000 7ff6eaffd700 1 --2- 172.21.15.146:0/3426638354 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff6d4066f30 0x7ff6d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:11.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.240+0000 7ff6eaffd700 1 -- 172.21.15.146:0/3426638354 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6116+0+0 (secure 0 0 0) 0x7ff6dc083b00 con 0x7ff6f4153ab0 2023-10-06T11:17:11.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.240+0000 7ff6f259c700 1 --2- 172.21.15.146:0/3426638354 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff6d4066f30 0x7ff6d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:11.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.240+0000 7ff6f259c700 1 --2- 172.21.15.146:0/3426638354 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff6d4066f30 0x7ff6d40693e0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4009a60 tx=0x7ff6e4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:11.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.244+0000 7ff6eaffd700 1 -- 172.21.15.146:0/3426638354 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff6dc050bd0 con 0x7ff6f4153ab0 2023-10-06T11:17:11.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.468+0000 7ff6f8df5700 1 -- 172.21.15.146:0/3426638354 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff6f415ac30 con 0x7ff6f4153ab0 2023-10-06T11:17:11.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.469+0000 7ff6eaffd700 1 -- 172.21.15.146:0/3426638354 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 121 v121) v1 ==== 95+0+4610 (secure 0 0 0) 0x7ff6f415ac30 con 0x7ff6f4153ab0 2023-10-06T11:17:11.470 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:11.470 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":121,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7181,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/255475004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":255475004},{"type":"v1","addr":"172.21.15.151:6834","nonce":255475004}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":116},{"gid":7184,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/206881843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":206881843},{"type":"v1","addr":"172.21.15.151:6835","nonce":206881843}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":116},{"gid":9192,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/3140231910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3140231910},{"type":"v1","addr":"172.21.15.146:6835","nonce":3140231910}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":116}],"filesystems":[{"mdsmap":{"epoch":121,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:16:23.472674+0000","modified":"2023-10-06T11:16:27.116489+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9198},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9198":{"gid":9198,"name":"a","rank":0,"incarnation":117,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/525107449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":525107449},{"type":"v1","addr":"172.21.15.146:6837","nonce":525107449}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2023-10-06T11:17:11.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.471+0000 7ff6f8df5700 1 -- 172.21.15.146:0/3426638354 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff6d4066f30 msgr2=0x7ff6d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:11.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.471+0000 7ff6f8df5700 1 --2- 172.21.15.146:0/3426638354 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff6d4066f30 0x7ff6d40693e0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4009a60 tx=0x7ff6e4008040 comp rx=0 tx=0).stop 2023-10-06T11:17:11.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.471+0000 7ff6f8df5700 1 -- 172.21.15.146:0/3426638354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f4153ab0 msgr2=0x7ff6f4154310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:11.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.471+0000 7ff6f8df5700 1 --2- 172.21.15.146:0/3426638354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f4153ab0 0x7ff6f4154310 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc00c590 tx=0x7ff6dc00c950 comp rx=0 tx=0).stop 2023-10-06T11:17:11.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.471+0000 7ff6f8df5700 1 -- 172.21.15.146:0/3426638354 shutdown_connections 2023-10-06T11:17:11.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.471+0000 7ff6f8df5700 1 --2- 172.21.15.146:0/3426638354 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff6d4066f30 0x7ff6d40693e0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.471+0000 7ff6f8df5700 1 --2- 172.21.15.146:0/3426638354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6f4153e80 0x7ff6f415a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.471+0000 7ff6f8df5700 1 --2- 172.21.15.146:0/3426638354 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6f4068ba0 0x7ff6f40b18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.471+0000 7ff6f8df5700 1 --2- 172.21.15.146:0/3426638354 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6f4153ab0 0x7ff6f4154310 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.471+0000 7ff6f8df5700 1 -- 172.21.15.146:0/3426638354 >> 172.21.15.146:0/3426638354 conn(0x7ff6f406eba0 msgr2=0x7ff6f415e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:11.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.471+0000 7ff6f8df5700 1 -- 172.21.15.146:0/3426638354 shutdown_connections 2023-10-06T11:17:11.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.471+0000 7ff6f8df5700 1 -- 172.21.15.146:0/3426638354 wait complete. 2023-10-06T11:17:11.474 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 121 2023-10-06T11:17:11.484 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:17:11.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.598+0000 7f1b47a45700 1 Processor -- start 2023-10-06T11:17:11.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.598+0000 7f1b47a45700 1 -- start start 2023-10-06T11:17:11.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.599+0000 7f1b47a45700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b40153ab0 0x7f1b4015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:11.600 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.599+0000 7f1b47a45700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1b40153e80 0x7f1b40068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:11.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.599+0000 7f1b47a45700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b4015ac30 con 0x7f1b400689d0 2023-10-06T11:17:11.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.599+0000 7f1b47a45700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b40068e50 con 0x7f1b40153e80 2023-10-06T11:17:11.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.599+0000 7f1b47a45700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b400b4510 con 0x7f1b40153ab0 2023-10-06T11:17:11.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.599+0000 7f1b44fe0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1b40153e80 0x7f1b40068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:11.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.599+0000 7f1b45fe2700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f1b400689d0 0x7f1b4015d270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40170/0 (socket says 172.21.15.146:40170) 2023-10-06T11:17:11.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.599+0000 7f1b45fe2700 1 -- 172.21.15.146:0/2788217366 learned_addr learned my addr 172.21.15.146:0/2788217366 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:17:11.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.599+0000 7f1b457e1700 1 --2- 172.21.15.146:0/2788217366 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b40153ab0 0x7f1b4015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:11.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.600+0000 7f1b44fe0700 1 -- 172.21.15.146:0/2788217366 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b40153ab0 msgr2=0x7f1b4015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:11.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.600+0000 7f1b44fe0700 1 --2- 172.21.15.146:0/2788217366 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b40153ab0 0x7f1b4015a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.600+0000 7f1b44fe0700 1 -- 172.21.15.146:0/2788217366 >> v1:172.21.15.146:6789/0 conn(0x7f1b400689d0 legacy=0x7f1b4015d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:11.601 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.600+0000 7f1b44fe0700 1 -- 172.21.15.146:0/2788217366 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b400b6530 con 0x7f1b40153e80 2023-10-06T11:17:11.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.600+0000 7f1b457e1700 1 --2- 172.21.15.146:0/2788217366 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b40153ab0 0x7f1b4015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:17:11.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.600+0000 7f1b44fe0700 1 --2- 172.21.15.146:0/2788217366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b40153e80 0x7f1b40068490 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f1b300098e0 tx=0x7f1b300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=752a02ec5da59e4a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:11.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.600+0000 7f1b37fff700 1 -- 172.21.15.146:0/2788217366 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b30009e80 con 0x7f1b40153e80 2023-10-06T11:17:11.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.600+0000 7f1b37fff700 1 -- 172.21.15.146:0/2788217366 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b3000b860 con 0x7f1b40153e80 2023-10-06T11:17:11.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.600+0000 7f1b37fff700 1 -- 172.21.15.146:0/2788217366 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3000bbe0 con 0x7f1b40153e80 2023-10-06T11:17:11.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.600+0000 7f1b47a45700 1 -- 172.21.15.146:0/2788217366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b40153e80 msgr2=0x7f1b40068490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:11.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.600+0000 7f1b47a45700 1 --2- 172.21.15.146:0/2788217366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b40153e80 0x7f1b40068490 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f1b300098e0 tx=0x7f1b300091a0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.600+0000 7f1b47a45700 1 -- 172.21.15.146:0/2788217366 shutdown_connections 2023-10-06T11:17:11.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.600+0000 7f1b47a45700 1 --2- 172.21.15.146:0/2788217366 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b40153ab0 0x7f1b4015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.600+0000 7f1b47a45700 1 --2- 172.21.15.146:0/2788217366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b40153e80 0x7f1b40068490 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.600+0000 7f1b47a45700 1 -- 172.21.15.146:0/2788217366 >> 172.21.15.146:0/2788217366 conn(0x7f1b4006eba0 msgr2=0x7f1b4006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:11.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.601+0000 7f1b47a45700 1 -- 172.21.15.146:0/2788217366 shutdown_connections 2023-10-06T11:17:11.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.601+0000 7f1b47a45700 1 -- 172.21.15.146:0/2788217366 wait complete. 2023-10-06T11:17:11.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.602+0000 7f1b47a45700 1 Processor -- start 2023-10-06T11:17:11.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.602+0000 7f1b47a45700 1 -- start start 2023-10-06T11:17:11.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.602+0000 7f1b47a45700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b400689d0 0x7f1b40146e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:11.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.602+0000 7f1b47a45700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b40153ab0 0x7f1b4014dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:11.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.602+0000 7f1b47a45700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b40153e80 0x7f1b401528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:11.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.602+0000 7f1b47a45700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b400b1260 con 0x7f1b40153e80 2023-10-06T11:17:11.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.602+0000 7f1b47a45700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b40147370 con 0x7f1b40153ab0 2023-10-06T11:17:11.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.602+0000 7f1b47a45700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b400b0650 con 0x7f1b400689d0 2023-10-06T11:17:11.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.603+0000 7f1b45fe2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b40153e80 0x7f1b401528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:11.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.603+0000 7f1b45fe2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b40153e80 0x7f1b401528e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38656/0 (socket says 172.21.15.146:38656) 2023-10-06T11:17:11.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.603+0000 7f1b45fe2700 1 -- 172.21.15.146:0/1974398439 learned_addr learned my addr 172.21.15.146:0/1974398439 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:11.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.603+0000 7f1b457e1700 1 --2- 172.21.15.146:0/1974398439 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b400689d0 0x7f1b40146e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:11.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.603+0000 7f1b44fe0700 1 --2- 172.21.15.146:0/1974398439 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b40153ab0 0x7f1b4014dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:11.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.603+0000 7f1b45fe2700 1 -- 172.21.15.146:0/1974398439 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b400689d0 msgr2=0x7f1b40146e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:11.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.603+0000 7f1b45fe2700 1 --2- 172.21.15.146:0/1974398439 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b400689d0 0x7f1b40146e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.603+0000 7f1b45fe2700 1 -- 172.21.15.146:0/1974398439 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b40153ab0 msgr2=0x7f1b4014dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:11.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.603+0000 7f1b45fe2700 1 --2- 172.21.15.146:0/1974398439 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b40153ab0 0x7f1b4014dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.603+0000 7f1b45fe2700 1 -- 172.21.15.146:0/1974398439 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b30009420 con 0x7f1b40153e80 2023-10-06T11:17:11.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.603+0000 7f1b45fe2700 1 --2- 172.21.15.146:0/1974398439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b40153e80 0x7f1b401528e0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f1b3800c560 tx=0x7f1b38007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:11.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.603+0000 7f1b357fa700 1 -- 172.21.15.146:0/1974398439 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b38005b30 con 0x7f1b40153e80 2023-10-06T11:17:11.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.603+0000 7f1b357fa700 1 -- 172.21.15.146:0/1974398439 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b38005c90 con 0x7f1b40153e80 2023-10-06T11:17:11.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.603+0000 7f1b357fa700 1 -- 172.21.15.146:0/1974398439 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b380072e0 con 0x7f1b40153e80 2023-10-06T11:17:11.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.603+0000 7f1b47a45700 1 -- 172.21.15.146:0/1974398439 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b400b0930 con 0x7f1b40153e80 2023-10-06T11:17:11.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.603+0000 7f1b47a45700 1 -- 172.21.15.146:0/1974398439 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b400b0ef0 con 0x7f1b40153e80 2023-10-06T11:17:11.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.604+0000 7f1b47a45700 1 -- 172.21.15.146:0/1974398439 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b400b1410 con 0x7f1b40153e80 2023-10-06T11:17:11.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.605+0000 7f1b357fa700 1 -- 172.21.15.146:0/1974398439 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1b38007690 con 0x7f1b40153e80 2023-10-06T11:17:11.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.605+0000 7f1b357fa700 1 --2- 172.21.15.146:0/1974398439 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1b24066f30 0x7f1b240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:11.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.605+0000 7f1b457e1700 1 --2- 172.21.15.146:0/1974398439 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1b24066f30 0x7f1b240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:11.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.605+0000 7f1b357fa700 1 -- 172.21.15.146:0/1974398439 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f1b38083870 con 0x7f1b40153e80 2023-10-06T11:17:11.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.605+0000 7f1b457e1700 1 --2- 172.21.15.146:0/1974398439 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1b24066f30 0x7f1b240693e0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c0094d0 tx=0x7f1b3c00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:11.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.609+0000 7f1b357fa700 1 -- 172.21.15.146:0/1974398439 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1b3804b5a0 con 0x7f1b40153e80 2023-10-06T11:17:11.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.794+0000 7f1b47a45700 1 -- 172.21.15.146:0/1974398439 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b4015ac30 con 0x7f1b40153e80 2023-10-06T11:17:11.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.795+0000 7f1b357fa700 1 -- 172.21.15.146:0/1974398439 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) v1 ==== 74+0+17026 (secure 0 0 0) 0x7f1b4015ac30 con 0x7f1b40153e80 2023-10-06T11:17:11.796 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:11.796 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":139,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:16:33.419424+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:16:21.174178+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2023-10-06T11:16:22.437689+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"22.21","mappings":[{"from":3,"to":0}]},{"pgid":"22.3a","mappings":[{"from":3,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:17:11.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.797+0000 7f1b47a45700 1 -- 172.21.15.146:0/1974398439 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1b24066f30 msgr2=0x7f1b240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:11.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.797+0000 7f1b47a45700 1 --2- 172.21.15.146:0/1974398439 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1b24066f30 0x7f1b240693e0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c0094d0 tx=0x7f1b3c00b040 comp rx=0 tx=0).stop 2023-10-06T11:17:11.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.797+0000 7f1b47a45700 1 -- 172.21.15.146:0/1974398439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b40153e80 msgr2=0x7f1b401528e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:11.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.797+0000 7f1b47a45700 1 --2- 172.21.15.146:0/1974398439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b40153e80 0x7f1b401528e0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f1b3800c560 tx=0x7f1b38007f60 comp rx=0 tx=0).stop 2023-10-06T11:17:11.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.797+0000 7f1b47a45700 1 -- 172.21.15.146:0/1974398439 shutdown_connections 2023-10-06T11:17:11.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.797+0000 7f1b47a45700 1 --2- 172.21.15.146:0/1974398439 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1b24066f30 0x7f1b240693e0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.797+0000 7f1b47a45700 1 --2- 172.21.15.146:0/1974398439 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1b40153e80 0x7f1b401528e0 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.797+0000 7f1b47a45700 1 --2- 172.21.15.146:0/1974398439 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1b400689d0 0x7f1b40146e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.797+0000 7f1b47a45700 1 --2- 172.21.15.146:0/1974398439 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b40153ab0 0x7f1b4014dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.797+0000 7f1b47a45700 1 -- 172.21.15.146:0/1974398439 >> 172.21.15.146:0/1974398439 conn(0x7f1b4006eba0 msgr2=0x7f1b40151f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:11.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.797+0000 7f1b47a45700 1 -- 172.21.15.146:0/1974398439 shutdown_connections 2023-10-06T11:17:11.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.797+0000 7f1b47a45700 1 -- 172.21.15.146:0/1974398439 wait complete. 2023-10-06T11:17:11.811 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T11:17:11.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.924+0000 7fe0ebb73700 1 Processor -- start 2023-10-06T11:17:11.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.924+0000 7fe0ebb73700 1 -- start start 2023-10-06T11:17:11.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.925+0000 7fe0ebb73700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe0e40676c0 0x7fe0e40b0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:11.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.925+0000 7fe0ebb73700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0e4162230 con 0x7fe0e4067a90 2023-10-06T11:17:11.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.925+0000 7fe0ebb73700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0e4161920 con 0x7fe0e415de30 2023-10-06T11:17:11.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.925+0000 7fe0ebb73700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0e415e250 con 0x7fe0e40676c0 2023-10-06T11:17:11.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.925+0000 7fe0e910e700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe0e4067a90 0x7fe0e415d720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40186/0 (socket says 172.21.15.146:40186) 2023-10-06T11:17:11.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.925+0000 7fe0e910e700 1 -- 172.21.15.146:0/2236615669 learned_addr learned my addr 172.21.15.146:0/2236615669 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:17:11.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.926+0000 7fe0e990f700 1 --2- 172.21.15.146:0/2236615669 >> v2:172.21.15.151:3300/0 conn(0x7fe0e40676c0 0x7fe0e40b0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:11.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.926+0000 7fe0e890d700 1 -- 172.21.15.146:0/2236615669 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3895828203 0 0) 0x7fe0e4162230 con 0x7fe0e4067a90 2023-10-06T11:17:11.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.926+0000 7fe0e890d700 1 -- 172.21.15.146:0/2236615669 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0d0003570 con 0x7fe0e4067a90 2023-10-06T11:17:11.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.926+0000 7fe0e890d700 1 -- 172.21.15.146:0/2236615669 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3720800193 0 0) 0x7fe0d0003570 con 0x7fe0e4067a90 2023-10-06T11:17:11.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.926+0000 7fe0e890d700 1 -- 172.21.15.146:0/2236615669 >> v2:172.21.15.151:3300/0 conn(0x7fe0e40676c0 msgr2=0x7fe0e40b0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:11.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.926+0000 7fe0e890d700 1 --2- 172.21.15.146:0/2236615669 >> v2:172.21.15.151:3300/0 conn(0x7fe0e40676c0 0x7fe0e40b0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.926+0000 7fe0e890d700 1 -- 172.21.15.146:0/2236615669 >> v1:172.21.15.151:6789/0 conn(0x7fe0e415de30 legacy=0x7fe0e406e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:11.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.926+0000 7fe0e890d700 1 -- 172.21.15.146:0/2236615669 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e40b11b0 con 0x7fe0e4067a90 2023-10-06T11:17:11.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.926+0000 7fe0e890d700 1 -- 172.21.15.146:0/2236615669 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fe0d4001470 con 0x7fe0e4067a90 2023-10-06T11:17:11.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.926+0000 7fe0e890d700 1 -- 172.21.15.146:0/2236615669 >> v1:172.21.15.146:6789/0 conn(0x7fe0e4067a90 legacy=0x7fe0e415d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:11.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.926+0000 7fe0e890d700 1 --2- 172.21.15.146:0/2236615669 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0d0003a60 0x7fe0d0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:11.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.926+0000 7fe0e890d700 1 --2- 172.21.15.146:0/2236615669 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0d0004810 0x7fe0d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:11.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.926+0000 7fe0e890d700 1 --2- 172.21.15.146:0/2236615669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0d00051c0 0x7fe0d000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:11.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.926+0000 7fe0e890d700 1 -- 172.21.15.146:0/2236615669 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e415e250 con 0x7fe0d00051c0 2023-10-06T11:17:11.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.926+0000 7fe0e890d700 1 -- 172.21.15.146:0/2236615669 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d000c0d0 con 0x7fe0d0003a60 2023-10-06T11:17:11.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.926+0000 7fe0e890d700 1 -- 172.21.15.146:0/2236615669 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d000c290 con 0x7fe0d0004810 2023-10-06T11:17:11.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.926+0000 7fe0ea110700 1 --2- 172.21.15.146:0/2236615669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0d00051c0 0x7fe0d000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:11.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.926+0000 7fe0e990f700 1 --2- 172.21.15.146:0/2236615669 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0d0003a60 0x7fe0d0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:11.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.926+0000 7fe0e910e700 1 --2- 172.21.15.146:0/2236615669 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0d0004810 0x7fe0d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:11.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.926+0000 7fe0ea110700 1 -- 172.21.15.146:0/2236615669 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0d0004810 msgr2=0x7fe0d0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:11.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.926+0000 7fe0ea110700 1 --2- 172.21.15.146:0/2236615669 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0d0004810 0x7fe0d0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.926+0000 7fe0ea110700 1 -- 172.21.15.146:0/2236615669 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0d0003a60 msgr2=0x7fe0d0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:11.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.926+0000 7fe0ea110700 1 --2- 172.21.15.146:0/2236615669 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0d0003a60 0x7fe0d0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.926+0000 7fe0ea110700 1 -- 172.21.15.146:0/2236615669 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d0003570 con 0x7fe0d00051c0 2023-10-06T11:17:11.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.927+0000 7fe0ea110700 1 -- 172.21.15.146:0/2236615669 reap_dead start 2023-10-06T11:17:11.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.927+0000 7fe0ea110700 1 --2- 172.21.15.146:0/2236615669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0d00051c0 0x7fe0d000ba60 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc0018b0 tx=0x7fe0dc007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc5d998a58b43e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:11.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.927+0000 7fe0e890d700 1 -- 172.21.15.146:0/2236615669 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc012420 con 0x7fe0d00051c0 2023-10-06T11:17:11.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.927+0000 7fe0e890d700 1 -- 172.21.15.146:0/2236615669 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0dc012580 con 0x7fe0d00051c0 2023-10-06T11:17:11.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.927+0000 7fe0e890d700 1 -- 172.21.15.146:0/2236615669 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc012920 con 0x7fe0d00051c0 2023-10-06T11:17:11.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.927+0000 7fe0ebb73700 1 -- 172.21.15.146:0/2236615669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0d00051c0 msgr2=0x7fe0d000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:11.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.927+0000 7fe0ebb73700 1 --2- 172.21.15.146:0/2236615669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0d00051c0 0x7fe0d000ba60 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc0018b0 tx=0x7fe0dc007d30 comp rx=0 tx=0).stop 2023-10-06T11:17:11.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.927+0000 7fe0ebb73700 1 -- 172.21.15.146:0/2236615669 shutdown_connections 2023-10-06T11:17:11.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.927+0000 7fe0ebb73700 1 --2- 172.21.15.146:0/2236615669 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0d00051c0 0x7fe0d000ba60 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.927+0000 7fe0ebb73700 1 -- 172.21.15.146:0/2236615669 >> 172.21.15.146:0/2236615669 conn(0x7fe0e4068580 msgr2=0x7fe0e4068980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:11.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.927+0000 7fe0ebb73700 1 -- 172.21.15.146:0/2236615669 shutdown_connections 2023-10-06T11:17:11.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.927+0000 7fe0ebb73700 1 -- 172.21.15.146:0/2236615669 wait complete. 2023-10-06T11:17:11.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.928+0000 7fe0ebb73700 1 Processor -- start 2023-10-06T11:17:11.934 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.928+0000 7fe0ebb73700 1 -- start start 2023-10-06T11:17:11.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.929+0000 7fe0ebb73700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0d00051c0 0x7fe0e414e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:11.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.929+0000 7fe0ebb73700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0e415e650 0x7fe0e415eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:11.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.929+0000 7fe0ebb73700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0e40a8980 0x7fe0e40a8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:11.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.929+0000 7fe0ebb73700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e414eba0 con 0x7fe0d00051c0 2023-10-06T11:17:11.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.929+0000 7fe0ebb73700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e40a9360 con 0x7fe0e40a8980 2023-10-06T11:17:11.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.929+0000 7fe0ebb73700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e415fdd0 con 0x7fe0e415e650 2023-10-06T11:17:11.937 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.929+0000 7fe0e990f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0d00051c0 0x7fe0e414e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:11.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.929+0000 7fe0e990f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0d00051c0 0x7fe0e414e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38686/0 (socket says 172.21.15.146:38686) 2023-10-06T11:17:11.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.929+0000 7fe0e990f700 1 -- 172.21.15.146:0/3629234795 learned_addr learned my addr 172.21.15.146:0/3629234795 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:11.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.929+0000 7fe0e990f700 1 -- 172.21.15.146:0/3629234795 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0e415e650 msgr2=0x7fe0e415eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:11.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.929+0000 7fe0ea110700 1 --2- 172.21.15.146:0/3629234795 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0e40a8980 0x7fe0e40a8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:11.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.929+0000 7fe0e910e700 1 --2- 172.21.15.146:0/3629234795 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0e415e650 0x7fe0e415eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:11.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.929+0000 7fe0e990f700 1 --2- 172.21.15.146:0/3629234795 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0e415e650 0x7fe0e415eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.929+0000 7fe0e990f700 1 -- 172.21.15.146:0/3629234795 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0e40a8980 msgr2=0x7fe0e40a8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:11.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.929+0000 7fe0e990f700 1 --2- 172.21.15.146:0/3629234795 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0e40a8980 0x7fe0e40a8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:11.938 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.929+0000 7fe0e990f700 1 -- 172.21.15.146:0/3629234795 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e415f1c0 con 0x7fe0d00051c0 2023-10-06T11:17:11.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.930+0000 7fe0ea110700 1 --2- 172.21.15.146:0/3629234795 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0e40a8980 0x7fe0e40a8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:17:11.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.930+0000 7fe0e990f700 1 --2- 172.21.15.146:0/3629234795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0d00051c0 0x7fe0e414e660 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0011e80 tx=0x7fe0e000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:11.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.930+0000 7fe0d9ffb700 1 -- 172.21.15.146:0/3629234795 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e000e040 con 0x7fe0d00051c0 2023-10-06T11:17:11.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.930+0000 7fe0d9ffb700 1 -- 172.21.15.146:0/3629234795 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e000f040 con 0x7fe0d00051c0 2023-10-06T11:17:11.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.930+0000 7fe0ebb73700 1 -- 172.21.15.146:0/3629234795 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0e415f4a0 con 0x7fe0d00051c0 2023-10-06T11:17:11.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.930+0000 7fe0d9ffb700 1 -- 172.21.15.146:0/3629234795 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e0015430 con 0x7fe0d00051c0 2023-10-06T11:17:11.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.930+0000 7fe0ebb73700 1 -- 172.21.15.146:0/3629234795 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0e415fa60 con 0x7fe0d00051c0 2023-10-06T11:17:11.939 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.931+0000 7fe0ebb73700 1 -- 172.21.15.146:0/3629234795 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0e404c380 con 0x7fe0d00051c0 2023-10-06T11:17:11.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.931+0000 7fe0d9ffb700 1 -- 172.21.15.146:0/3629234795 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe0e0015820 con 0x7fe0d00051c0 2023-10-06T11:17:11.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.932+0000 7fe0d9ffb700 1 --2- 172.21.15.146:0/3629234795 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe0c8066f30 0x7fe0c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:11.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.932+0000 7fe0d9ffb700 1 -- 172.21.15.146:0/3629234795 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fe0e00852f0 con 0x7fe0d00051c0 2023-10-06T11:17:11.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.932+0000 7fe0e910e700 1 --2- 172.21.15.146:0/3629234795 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe0c8066f30 0x7fe0c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:11.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.932+0000 7fe0e910e700 1 --2- 172.21.15.146:0/3629234795 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe0c8066f30 0x7fe0c80693e0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4000c00 tx=0x7fe0d4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:11.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:11.936+0000 7fe0d9ffb700 1 -- 172.21.15.146:0/3629234795 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe0e00523c0 con 0x7fe0d00051c0 2023-10-06T11:17:12.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.166+0000 7fe0ebb73700 1 -- 172.21.15.146:0/3629234795 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe0e40cd8f0 con 0x7fe0d00051c0 2023-10-06T11:17:12.168 INFO:tasks.ceph.mon.a.smithi146.stderr:2023-10-06T11:17:12.167+0000 7f011baa1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T11:17:12.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.171+0000 7fe0d9ffb700 1 -- 172.21.15.146:0/3629234795 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v122) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe0e00559e0 con 0x7fe0d00051c0 2023-10-06T11:17:12.173 INFO:tasks.ceph.mds.a.smithi146.stderr: -2025> 2023-10-06T11:16:28.390+0000 7f04736f0700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T11:17:12.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.173+0000 7fe0ebb73700 1 -- 172.21.15.146:0/3629234795 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe0c8066f30 msgr2=0x7fe0c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:12.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.173+0000 7fe0ebb73700 1 --2- 172.21.15.146:0/3629234795 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe0c8066f30 0x7fe0c80693e0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4000c00 tx=0x7fe0d4009040 comp rx=0 tx=0).stop 2023-10-06T11:17:12.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.173+0000 7fe0ebb73700 1 -- 172.21.15.146:0/3629234795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0d00051c0 msgr2=0x7fe0e414e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:12.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.173+0000 7fe0ebb73700 1 --2- 172.21.15.146:0/3629234795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0d00051c0 0x7fe0e414e660 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7fe0e0011e80 tx=0x7fe0e000b040 comp rx=0 tx=0).stop 2023-10-06T11:17:12.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.173+0000 7fe0ebb73700 1 -- 172.21.15.146:0/3629234795 shutdown_connections 2023-10-06T11:17:12.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.173+0000 7fe0ebb73700 1 --2- 172.21.15.146:0/3629234795 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe0c8066f30 0x7fe0c80693e0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:12.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.173+0000 7fe0ebb73700 1 --2- 172.21.15.146:0/3629234795 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0e40a8980 0x7fe0e40a8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:12.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.173+0000 7fe0ebb73700 1 --2- 172.21.15.146:0/3629234795 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe0d00051c0 0x7fe0e414e660 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:12.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.173+0000 7fe0ebb73700 1 --2- 172.21.15.146:0/3629234795 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0e415e650 0x7fe0e415eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:12.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.173+0000 7fe0ebb73700 1 -- 172.21.15.146:0/3629234795 >> 172.21.15.146:0/3629234795 conn(0x7fe0e4068580 msgr2=0x7fe0e40accc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:12.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.173+0000 7fe0ebb73700 1 -- 172.21.15.146:0/3629234795 shutdown_connections 2023-10-06T11:17:12.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.173+0000 7fe0ebb73700 1 -- 172.21.15.146:0/3629234795 wait complete. 2023-10-06T11:17:12.177 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T11:17:12.188 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T11:17:12.196 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2023-10-06T11:17:12.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.304+0000 7f0277fff700 1 Processor -- start 2023-10-06T11:17:12.306 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.304+0000 7f0277fff700 1 -- start start 2023-10-06T11:17:12.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.305+0000 7f0277fff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0278068780 0x7f0278068bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:12.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.305+0000 7f0277fff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02780cc130 con 0x7f02780b5640 2023-10-06T11:17:12.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.305+0000 7f0277fff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02780cccd0 con 0x7f02780cb090 2023-10-06T11:17:12.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.305+0000 7f0277fff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0278069100 con 0x7f0278068780 2023-10-06T11:17:12.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.305+0000 7f0276ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f02780b5640 0x7f027815a870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40200/0 (socket says 172.21.15.146:40200) 2023-10-06T11:17:12.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.305+0000 7f0276ffd700 1 -- 172.21.15.146:0/3704200001 learned_addr learned my addr 172.21.15.146:0/3704200001 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:17:12.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.305+0000 7f02777fe700 1 --2- 172.21.15.146:0/3704200001 >> v2:172.21.15.151:3300/0 conn(0x7f0278068780 0x7f0278068bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:12.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.306+0000 7f0275ffb700 1 -- 172.21.15.146:0/3704200001 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2620794784 0 0) 0x7f02780cc130 con 0x7f02780b5640 2023-10-06T11:17:12.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.306+0000 7f0275ffb700 1 -- 172.21.15.146:0/3704200001 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0264003570 con 0x7f02780b5640 2023-10-06T11:17:12.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.306+0000 7f0275ffb700 1 -- 172.21.15.146:0/3704200001 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3193390535 0 0) 0x7f02780cccd0 con 0x7f02780cb090 2023-10-06T11:17:12.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.306+0000 7f0275ffb700 1 -- 172.21.15.146:0/3704200001 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02780cc130 con 0x7f02780cb090 2023-10-06T11:17:12.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.306+0000 7f0275ffb700 1 -- 172.21.15.146:0/3704200001 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4031853628 0 0) 0x7f0264003570 con 0x7f02780b5640 2023-10-06T11:17:12.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.306+0000 7f0275ffb700 1 -- 172.21.15.146:0/3704200001 >> v2:172.21.15.151:3300/0 conn(0x7f0278068780 msgr2=0x7f0278068bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:12.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.306+0000 7f0275ffb700 1 --2- 172.21.15.146:0/3704200001 >> v2:172.21.15.151:3300/0 conn(0x7f0278068780 0x7f0278068bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:12.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.306+0000 7f0275ffb700 1 -- 172.21.15.146:0/3704200001 >> v1:172.21.15.151:6789/0 conn(0x7f02780cb090 legacy=0x7f02780cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:12.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.306+0000 7f0275ffb700 1 -- 172.21.15.146:0/3704200001 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02780b2660 con 0x7f02780b5640 2023-10-06T11:17:12.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.306+0000 7f0275ffb700 1 -- 172.21.15.146:0/3704200001 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f02680017f0 con 0x7f02780b5640 2023-10-06T11:17:12.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.306+0000 7f0275ffb700 1 -- 172.21.15.146:0/3704200001 >> v1:172.21.15.146:6789/0 conn(0x7f02780b5640 legacy=0x7f027815a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:12.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.306+0000 7f0275ffb700 1 --2- 172.21.15.146:0/3704200001 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0264003bf0 0x7f0264003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:12.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.306+0000 7f0275ffb700 1 --2- 172.21.15.146:0/3704200001 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0264004810 0x7f0264004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:12.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.306+0000 7f0275ffb700 1 --2- 172.21.15.146:0/3704200001 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02640051c0 0x7f026400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:12.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.306+0000 7f0275ffb700 1 -- 172.21.15.146:0/3704200001 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0278069100 con 0x7f0264004810 2023-10-06T11:17:12.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.306+0000 7f0275ffb700 1 -- 172.21.15.146:0/3704200001 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026400c0b0 con 0x7f02640051c0 2023-10-06T11:17:12.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.306+0000 7f0275ffb700 1 -- 172.21.15.146:0/3704200001 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f026400c270 con 0x7f0264003bf0 2023-10-06T11:17:12.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.306+0000 7f02767fc700 1 --2- 172.21.15.146:0/3704200001 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0264004810 0x7f0264004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:12.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.306+0000 7f0276ffd700 1 --2- 172.21.15.146:0/3704200001 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0264003bf0 0x7f0264003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:12.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.306+0000 7f02777fe700 1 --2- 172.21.15.146:0/3704200001 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02640051c0 0x7f026400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:12.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.306+0000 7f02767fc700 1 -- 172.21.15.146:0/3704200001 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0264003bf0 msgr2=0x7f0264003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:12.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.306+0000 7f02767fc700 1 --2- 172.21.15.146:0/3704200001 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0264003bf0 0x7f0264003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:12.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.306+0000 7f02767fc700 1 -- 172.21.15.146:0/3704200001 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02640051c0 msgr2=0x7f026400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:12.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.306+0000 7f02767fc700 1 --2- 172.21.15.146:0/3704200001 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02640051c0 0x7f026400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:12.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.306+0000 7f02767fc700 1 -- 172.21.15.146:0/3704200001 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0264003570 con 0x7f0264004810 2023-10-06T11:17:12.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.306+0000 7f02777fe700 1 --2- 172.21.15.146:0/3704200001 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02640051c0 0x7f026400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:17:12.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.306+0000 7f02777fe700 1 -- 172.21.15.146:0/3704200001 reap_dead start 2023-10-06T11:17:12.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.306+0000 7f02767fc700 1 --2- 172.21.15.146:0/3704200001 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0264004810 0x7f0264004c80 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f0260001a10 tx=0x7f0260007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b266da46336fae6b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:12.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.307+0000 7f0275ffb700 1 -- 172.21.15.146:0/3704200001 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026000c5d0 con 0x7f0264004810 2023-10-06T11:17:12.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.307+0000 7f0275ffb700 1 -- 172.21.15.146:0/3704200001 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f026000c730 con 0x7f0264004810 2023-10-06T11:17:12.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.307+0000 7f0275ffb700 1 -- 172.21.15.146:0/3704200001 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026000caf0 con 0x7f0264004810 2023-10-06T11:17:12.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.307+0000 7f0277fff700 1 -- 172.21.15.146:0/3704200001 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0264004810 msgr2=0x7f0264004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:12.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.307+0000 7f0277fff700 1 --2- 172.21.15.146:0/3704200001 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0264004810 0x7f0264004c80 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f0260001a10 tx=0x7f0260007d30 comp rx=0 tx=0).stop 2023-10-06T11:17:12.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.307+0000 7f0277fff700 1 -- 172.21.15.146:0/3704200001 shutdown_connections 2023-10-06T11:17:12.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.307+0000 7f0277fff700 1 --2- 172.21.15.146:0/3704200001 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0264004810 0x7f0264004c80 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:12.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.307+0000 7f0277fff700 1 -- 172.21.15.146:0/3704200001 >> 172.21.15.146:0/3704200001 conn(0x7f02780703f0 msgr2=0x7f02780707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:12.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.307+0000 7f0277fff700 1 -- 172.21.15.146:0/3704200001 shutdown_connections 2023-10-06T11:17:12.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.307+0000 7f0277fff700 1 -- 172.21.15.146:0/3704200001 wait complete. 2023-10-06T11:17:12.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.308+0000 7f0277fff700 1 Processor -- start 2023-10-06T11:17:12.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.308+0000 7f0277fff700 1 -- start start 2023-10-06T11:17:12.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.309+0000 7f0277fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0264004810 0x7f02780c2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:12.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.309+0000 7f0277fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f027815b0c0 0x7f027815b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:12.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.309+0000 7f0277fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f027815d3e0 0x7f027815d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:12.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.309+0000 7f0277fff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027815ed20 con 0x7f027815b0c0 2023-10-06T11:17:12.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.309+0000 7f0277fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f027815ba70 con 0x7f0264004810 2023-10-06T11:17:12.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.309+0000 7f0277fff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f027815e110 con 0x7f027815d3e0 2023-10-06T11:17:12.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.309+0000 7f02767fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f027815b0c0 0x7f027815b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:12.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.309+0000 7f02767fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f027815b0c0 0x7f027815b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38724/0 (socket says 172.21.15.146:38724) 2023-10-06T11:17:12.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.309+0000 7f02767fc700 1 -- 172.21.15.146:0/617638366 learned_addr learned my addr 172.21.15.146:0/617638366 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:12.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.309+0000 7f0276ffd700 1 --2- 172.21.15.146:0/617638366 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0264004810 0x7f02780c2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:12.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.309+0000 7f02777fe700 1 --2- 172.21.15.146:0/617638366 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f027815d3e0 0x7f027815d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:12.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.309+0000 7f02767fc700 1 -- 172.21.15.146:0/617638366 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f027815d3e0 msgr2=0x7f027815d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:12.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.309+0000 7f02767fc700 1 --2- 172.21.15.146:0/617638366 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f027815d3e0 0x7f027815d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:12.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.309+0000 7f02767fc700 1 -- 172.21.15.146:0/617638366 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0264004810 msgr2=0x7f02780c2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:12.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.309+0000 7f02767fc700 1 --2- 172.21.15.146:0/617638366 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0264004810 0x7f02780c2ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:12.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.310+0000 7f02767fc700 1 -- 172.21.15.146:0/617638366 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f027815e3f0 con 0x7f027815b0c0 2023-10-06T11:17:12.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.310+0000 7f0276ffd700 1 --2- 172.21.15.146:0/617638366 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0264004810 0x7f02780c2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:17:12.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.310+0000 7f02767fc700 1 --2- 172.21.15.146:0/617638366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f027815b0c0 0x7f027815b530 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f0260000c00 tx=0x7f0260015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:12.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.310+0000 7f026effd700 1 -- 172.21.15.146:0/617638366 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f026000c5d0 con 0x7f027815b0c0 2023-10-06T11:17:12.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.310+0000 7f026effd700 1 -- 172.21.15.146:0/617638366 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f026000cea0 con 0x7f027815b0c0 2023-10-06T11:17:12.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.310+0000 7f0277fff700 1 -- 172.21.15.146:0/617638366 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f027815e6d0 con 0x7f027815b0c0 2023-10-06T11:17:12.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.310+0000 7f026effd700 1 -- 172.21.15.146:0/617638366 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0260007b10 con 0x7f027815b0c0 2023-10-06T11:17:12.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.310+0000 7f0277fff700 1 -- 172.21.15.146:0/617638366 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02780c3400 con 0x7f027815b0c0 2023-10-06T11:17:12.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.311+0000 7f0277fff700 1 -- 172.21.15.146:0/617638366 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f027815ee90 con 0x7f027815b0c0 2023-10-06T11:17:12.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.311+0000 7f026effd700 1 -- 172.21.15.146:0/617638366 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0260019070 con 0x7f027815b0c0 2023-10-06T11:17:12.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.311+0000 7f026effd700 1 --2- 172.21.15.146:0/617638366 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0258066f30 0x7f02580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:12.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.312+0000 7f026effd700 1 -- 172.21.15.146:0/617638366 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f0260085490 con 0x7f027815b0c0 2023-10-06T11:17:12.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.312+0000 7f0276ffd700 1 --2- 172.21.15.146:0/617638366 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0258066f30 0x7f02580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:12.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.312+0000 7f0276ffd700 1 --2- 172.21.15.146:0/617638366 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0258066f30 0x7f02580693e0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f0268002000 tx=0x7f0268006040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:12.320 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.316+0000 7f026effd700 1 -- 172.21.15.146:0/617638366 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f02600525c0 con 0x7f027815b0c0 2023-10-06T11:17:12.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:12.543+0000 7f0277fff700 1 -- 172.21.15.146:0/617638366 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f02781540c0 con 0x7f027815b0c0 2023-10-06T11:17:13.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.171+0000 7f026effd700 1 -- 172.21.15.146:0/617638366 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v123) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0260055be0 con 0x7f027815b0c0 2023-10-06T11:17:13.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.174+0000 7f0277fff700 1 -- 172.21.15.146:0/617638366 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0258066f30 msgr2=0x7f02580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:13.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.174+0000 7f0277fff700 1 --2- 172.21.15.146:0/617638366 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0258066f30 0x7f02580693e0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f0268002000 tx=0x7f0268006040 comp rx=0 tx=0).stop 2023-10-06T11:17:13.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.174+0000 7f0277fff700 1 -- 172.21.15.146:0/617638366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f027815b0c0 msgr2=0x7f027815b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:13.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.174+0000 7f0277fff700 1 --2- 172.21.15.146:0/617638366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f027815b0c0 0x7f027815b530 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f0260000c00 tx=0x7f0260015000 comp rx=0 tx=0).stop 2023-10-06T11:17:13.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.174+0000 7f0277fff700 1 -- 172.21.15.146:0/617638366 shutdown_connections 2023-10-06T11:17:13.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.174+0000 7f0277fff700 1 --2- 172.21.15.146:0/617638366 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0258066f30 0x7f02580693e0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:13.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.174+0000 7f0277fff700 1 --2- 172.21.15.146:0/617638366 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f027815d3e0 0x7f027815d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:13.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.174+0000 7f0277fff700 1 --2- 172.21.15.146:0/617638366 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0264004810 0x7f02780c2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:13.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.174+0000 7f0277fff700 1 --2- 172.21.15.146:0/617638366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f027815b0c0 0x7f027815b530 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:13.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.174+0000 7f0277fff700 1 -- 172.21.15.146:0/617638366 >> 172.21.15.146:0/617638366 conn(0x7f02780703f0 msgr2=0x7f027806eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:13.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.174+0000 7f0277fff700 1 -- 172.21.15.146:0/617638366 shutdown_connections 2023-10-06T11:17:13.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.174+0000 7f0277fff700 1 -- 172.21.15.146:0/617638366 wait complete. 2023-10-06T11:17:13.189 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T11:17:13.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.348+0000 7f5bf9280700 1 Processor -- start 2023-10-06T11:17:13.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.348+0000 7f5bf9280700 1 -- start start 2023-10-06T11:17:13.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.349+0000 7f5bf9280700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5bf40ae730 0x7f5bf40aebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:13.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.349+0000 7f5bf9280700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5bf40cb950 0x7f5bf40cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:13.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.349+0000 7f5bf9280700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bf40ae2a0 con 0x7f5bf415a160 2023-10-06T11:17:13.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.349+0000 7f5bf9280700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bf415a530 con 0x7f5bf40cb950 2023-10-06T11:17:13.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.349+0000 7f5bf9280700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bf40c5cb0 con 0x7f5bf40ae730 2023-10-06T11:17:13.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.349+0000 7f5bf37fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5bf40cb950 0x7f5bf40cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:13.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.349+0000 7f5bf37fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5bf40cb950 0x7f5bf40cbd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38726/0 (socket says 172.21.15.146:38726) 2023-10-06T11:17:13.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.349+0000 7f5bf37fe700 1 -- 172.21.15.146:0/4123972258 learned_addr learned my addr 172.21.15.146:0/4123972258 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:13.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.349+0000 7f5bea7fc700 1 --2- 172.21.15.146:0/4123972258 >> v2:172.21.15.151:3300/0 conn(0x7f5bf40ae730 0x7f5bf40aebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:13.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.349+0000 7f5bf37fe700 1 -- 172.21.15.146:0/4123972258 >> v2:172.21.15.151:3300/0 conn(0x7f5bf40ae730 msgr2=0x7f5bf40aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:13.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.349+0000 7f5bf37fe700 1 --2- 172.21.15.146:0/4123972258 >> v2:172.21.15.151:3300/0 conn(0x7f5bf40ae730 0x7f5bf40aebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:13.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.349+0000 7f5bf37fe700 1 -- 172.21.15.146:0/4123972258 >> v1:172.21.15.151:6789/0 conn(0x7f5bf415a160 legacy=0x7f5bf40c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:13.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.349+0000 7f5bf37fe700 1 -- 172.21.15.146:0/4123972258 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf40af0f0 con 0x7f5bf40cb950 2023-10-06T11:17:13.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.349+0000 7f5bf37fe700 1 --2- 172.21.15.146:0/4123972258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bf40cb950 0x7f5bf40cbd40 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f5bf40d16e0 tx=0x7f5bec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be0029c6816f76f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:13.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.350+0000 7f5bf27fc700 1 -- 172.21.15.146:0/4123972258 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bec00e070 con 0x7f5bf40cb950 2023-10-06T11:17:13.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.350+0000 7f5bf27fc700 1 -- 172.21.15.146:0/4123972258 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bec00ba20 con 0x7f5bf40cb950 2023-10-06T11:17:13.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.350+0000 7f5bf27fc700 1 -- 172.21.15.146:0/4123972258 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bec0092e0 con 0x7f5bf40cb950 2023-10-06T11:17:13.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.350+0000 7f5bf9280700 1 -- 172.21.15.146:0/4123972258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bf40cb950 msgr2=0x7f5bf40cbd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:13.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.350+0000 7f5bf9280700 1 --2- 172.21.15.146:0/4123972258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bf40cb950 0x7f5bf40cbd40 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f5bf40d16e0 tx=0x7f5bec009840 comp rx=0 tx=0).stop 2023-10-06T11:17:13.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.350+0000 7f5bf9280700 1 -- 172.21.15.146:0/4123972258 shutdown_connections 2023-10-06T11:17:13.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.350+0000 7f5bf9280700 1 --2- 172.21.15.146:0/4123972258 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bf40cb950 0x7f5bf40cbd40 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:13.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.350+0000 7f5bf9280700 1 --2- 172.21.15.146:0/4123972258 >> v2:172.21.15.151:3300/0 conn(0x7f5bf40ae730 0x7f5bf40aebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:13.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.350+0000 7f5bf9280700 1 -- 172.21.15.146:0/4123972258 >> 172.21.15.146:0/4123972258 conn(0x7f5bf406f380 msgr2=0x7f5bf40d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:13.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.350+0000 7f5bf9280700 1 -- 172.21.15.146:0/4123972258 shutdown_connections 2023-10-06T11:17:13.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.350+0000 7f5bf9280700 1 -- 172.21.15.146:0/4123972258 wait complete. 2023-10-06T11:17:13.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.351+0000 7f5bf9280700 1 Processor -- start 2023-10-06T11:17:13.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.352+0000 7f5bf9280700 1 -- start start 2023-10-06T11:17:13.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.352+0000 7f5bf9280700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5bf40ae730 0x7f5bf40ca280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:13.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.352+0000 7f5bf9280700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bf40cb950 0x7f5bf4155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:13.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.352+0000 7f5bf9280700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5bf415a160 0x7f5bf40cf340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:13.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.352+0000 7f5bf9280700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf4156080 con 0x7f5bf40cb950 2023-10-06T11:17:13.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.352+0000 7f5bf9280700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf416af50 con 0x7f5bf40ae730 2023-10-06T11:17:13.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.352+0000 7f5bf9280700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf416a340 con 0x7f5bf415a160 2023-10-06T11:17:13.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.352+0000 7f5bea7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bf40cb950 0x7f5bf4155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:13.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.352+0000 7f5bea7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bf40cb950 0x7f5bf4155b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38740/0 (socket says 172.21.15.146:38740) 2023-10-06T11:17:13.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.352+0000 7f5bea7fc700 1 -- 172.21.15.146:0/3141022816 learned_addr learned my addr 172.21.15.146:0/3141022816 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:13.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.352+0000 7f5bf37fe700 1 --2- 172.21.15.146:0/3141022816 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5bf415a160 0x7f5bf40cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:13.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.352+0000 7f5bf2ffd700 1 --2- 172.21.15.146:0/3141022816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5bf40ae730 0x7f5bf40ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:13.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.353+0000 7f5bea7fc700 1 -- 172.21.15.146:0/3141022816 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5bf415a160 msgr2=0x7f5bf40cf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:13.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.353+0000 7f5bea7fc700 1 --2- 172.21.15.146:0/3141022816 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5bf415a160 0x7f5bf40cf340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:13.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.353+0000 7f5bea7fc700 1 -- 172.21.15.146:0/3141022816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5bf40ae730 msgr2=0x7f5bf40ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:13.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.353+0000 7f5bea7fc700 1 --2- 172.21.15.146:0/3141022816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5bf40ae730 0x7f5bf40ca280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:13.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.353+0000 7f5bea7fc700 1 -- 172.21.15.146:0/3141022816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bec009ae0 con 0x7f5bf40cb950 2023-10-06T11:17:13.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.353+0000 7f5bf2ffd700 1 --2- 172.21.15.146:0/3141022816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5bf40ae730 0x7f5bf40ca280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:17:13.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.353+0000 7f5bea7fc700 1 --2- 172.21.15.146:0/3141022816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bf40cb950 0x7f5bf4155b40 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc00ec80 tx=0x7f5bdc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:13.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.353+0000 7f5beb7fe700 1 -- 172.21.15.146:0/3141022816 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc00c850 con 0x7f5bf40cb950 2023-10-06T11:17:13.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.353+0000 7f5beb7fe700 1 -- 172.21.15.146:0/3141022816 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bdc00c9b0 con 0x7f5bf40cb950 2023-10-06T11:17:13.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.353+0000 7f5bf9280700 1 -- 172.21.15.146:0/3141022816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bf416a620 con 0x7f5bf40cb950 2023-10-06T11:17:13.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.353+0000 7f5beb7fe700 1 -- 172.21.15.146:0/3141022816 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bdc00cd50 con 0x7f5bf40cb950 2023-10-06T11:17:13.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.353+0000 7f5bf9280700 1 -- 172.21.15.146:0/3141022816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf416abe0 con 0x7f5bf40cb950 2023-10-06T11:17:13.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.354+0000 7f5bf9280700 1 -- 172.21.15.146:0/3141022816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bf416b090 con 0x7f5bf40cb950 2023-10-06T11:17:13.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.354+0000 7f5beb7fe700 1 -- 172.21.15.146:0/3141022816 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5bdc013680 con 0x7f5bf40cb950 2023-10-06T11:17:13.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.355+0000 7f5beb7fe700 1 --2- 172.21.15.146:0/3141022816 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5bd4066f30 0x7f5bd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:13.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.355+0000 7f5bf2ffd700 1 --2- 172.21.15.146:0/3141022816 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5bd4066f30 0x7f5bd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:13.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.355+0000 7f5beb7fe700 1 -- 172.21.15.146:0/3141022816 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f5bdc084d00 con 0x7f5bf40cb950 2023-10-06T11:17:13.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.355+0000 7f5bf2ffd700 1 --2- 172.21.15.146:0/3141022816 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5bd4066f30 0x7f5bd40693e0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f5be4001850 tx=0x7f5be4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:13.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.359+0000 7f5beb7fe700 1 -- 172.21.15.146:0/3141022816 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5bf416b090 con 0x7f5bf40cb950 2023-10-06T11:17:13.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:13.545+0000 7f5bf9280700 1 -- 172.21.15.146:0/3141022816 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5bf416b090 con 0x7f5bf40cb950 2023-10-06T11:17:14.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.502+0000 7f5beb7fe700 1 -- 172.21.15.146:0/3141022816 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v141) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5bf416b090 con 0x7f5bf40cb950 2023-10-06T11:17:14.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.505+0000 7f5bf9280700 1 -- 172.21.15.146:0/3141022816 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5bd4066f30 msgr2=0x7f5bd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:14.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.505+0000 7f5bf9280700 1 --2- 172.21.15.146:0/3141022816 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5bd4066f30 0x7f5bd40693e0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f5be4001850 tx=0x7f5be4009040 comp rx=0 tx=0).stop 2023-10-06T11:17:14.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.505+0000 7f5bf9280700 1 -- 172.21.15.146:0/3141022816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bf40cb950 msgr2=0x7f5bf4155b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:14.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.505+0000 7f5bf9280700 1 --2- 172.21.15.146:0/3141022816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bf40cb950 0x7f5bf4155b40 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f5bdc00ec80 tx=0x7f5bdc0091a0 comp rx=0 tx=0).stop 2023-10-06T11:17:14.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.505+0000 7f5bf9280700 1 -- 172.21.15.146:0/3141022816 shutdown_connections 2023-10-06T11:17:14.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.505+0000 7f5bf9280700 1 --2- 172.21.15.146:0/3141022816 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5bd4066f30 0x7f5bd40693e0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:14.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.505+0000 7f5bf9280700 1 --2- 172.21.15.146:0/3141022816 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5bf415a160 0x7f5bf40cf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:14.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.505+0000 7f5bf9280700 1 --2- 172.21.15.146:0/3141022816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5bf40ae730 0x7f5bf40ca280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:14.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.505+0000 7f5bf9280700 1 --2- 172.21.15.146:0/3141022816 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5bf40cb950 0x7f5bf4155b40 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:14.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.505+0000 7f5bf9280700 1 -- 172.21.15.146:0/3141022816 >> 172.21.15.146:0/3141022816 conn(0x7f5bf406f380 msgr2=0x7f5bf4069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:14.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.505+0000 7f5bf9280700 1 -- 172.21.15.146:0/3141022816 shutdown_connections 2023-10-06T11:17:14.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.505+0000 7f5bf9280700 1 -- 172.21.15.146:0/3141022816 wait complete. 2023-10-06T11:17:14.509 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' removed 2023-10-06T11:17:14.521 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T11:17:14.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.639+0000 7f55bec3c700 1 Processor -- start 2023-10-06T11:17:14.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.639+0000 7f55bec3c700 1 -- start start 2023-10-06T11:17:14.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.640+0000 7f55bec3c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f55b8068b90 0x7f55b806e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:14.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.640+0000 7f55bec3c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55b80c8b80 con 0x7f55b81595d0 2023-10-06T11:17:14.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.640+0000 7f55bec3c700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55b80c7fb0 con 0x7f55b806eac0 2023-10-06T11:17:14.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.640+0000 7f55bec3c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55b80ca7d0 con 0x7f55b8068b90 2023-10-06T11:17:14.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.640+0000 7f55bd439700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f55b8068b90 0x7f55b806e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:14.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.640+0000 7f55bdc3a700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f55b81595d0 0x7f55b8068480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40214/0 (socket says 172.21.15.146:40214) 2023-10-06T11:17:14.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.640+0000 7f55bdc3a700 1 -- 172.21.15.146:0/3206575465 learned_addr learned my addr 172.21.15.146:0/3206575465 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:17:14.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.641+0000 7f55bd439700 1 -- 172.21.15.146:0/3206575465 >> v1:172.21.15.151:6789/0 conn(0x7f55b806eac0 legacy=0x7f55b8069d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:14.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.641+0000 7f55bd439700 1 -- 172.21.15.146:0/3206575465 >> v1:172.21.15.146:6789/0 conn(0x7f55b81595d0 legacy=0x7f55b8068480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:14.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.641+0000 7f55bcc38700 1 -- 172.21.15.146:0/3206575465 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3265131950 0 0) 0x7f55b80c8b80 con 0x7f55b81595d0 2023-10-06T11:17:14.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.641+0000 7f55bd439700 1 -- 172.21.15.146:0/3206575465 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b806ef00 con 0x7f55b8068b90 2023-10-06T11:17:14.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.641+0000 7f55bd439700 1 --2- 172.21.15.146:0/3206575465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55b8068b90 0x7f55b806e580 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7f55a80098e0 tx=0x7f55a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e20e5ce4b1ce2d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:14.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.641+0000 7f55bcc38700 1 -- 172.21.15.146:0/3206575465 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a8009e80 con 0x7f55b8068b90 2023-10-06T11:17:14.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.641+0000 7f55bcc38700 1 -- 172.21.15.146:0/3206575465 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a800b820 con 0x7f55b8068b90 2023-10-06T11:17:14.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.641+0000 7f55bcc38700 1 -- 172.21.15.146:0/3206575465 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a800bba0 con 0x7f55b8068b90 2023-10-06T11:17:14.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.641+0000 7f55bec3c700 1 -- 172.21.15.146:0/3206575465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55b8068b90 msgr2=0x7f55b806e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:14.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.641+0000 7f55bec3c700 1 --2- 172.21.15.146:0/3206575465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55b8068b90 0x7f55b806e580 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7f55a80098e0 tx=0x7f55a80091a0 comp rx=0 tx=0).stop 2023-10-06T11:17:14.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.641+0000 7f55bec3c700 1 -- 172.21.15.146:0/3206575465 shutdown_connections 2023-10-06T11:17:14.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.641+0000 7f55bec3c700 1 --2- 172.21.15.146:0/3206575465 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55b8068b90 0x7f55b806e580 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:14.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.641+0000 7f55bec3c700 1 -- 172.21.15.146:0/3206575465 >> 172.21.15.146:0/3206575465 conn(0x7f55b80c9dc0 msgr2=0x7f55b806dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:14.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.642+0000 7f55bec3c700 1 -- 172.21.15.146:0/3206575465 shutdown_connections 2023-10-06T11:17:14.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.642+0000 7f55bec3c700 1 -- 172.21.15.146:0/3206575465 wait complete. 2023-10-06T11:17:14.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.643+0000 7f55bec3c700 1 Processor -- start 2023-10-06T11:17:14.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.643+0000 7f55bec3c700 1 -- start start 2023-10-06T11:17:14.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.643+0000 7f55bec3c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55b8068b90 0x7f55b815cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:14.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.643+0000 7f55bec3c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55b806eac0 0x7f55b815e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:14.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.643+0000 7f55bec3c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55b81595d0 0x7f55b81695e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:14.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.643+0000 7f55bec3c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b80b0950 con 0x7f55b806eac0 2023-10-06T11:17:14.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.643+0000 7f55bec3c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b80b0b60 con 0x7f55b8068b90 2023-10-06T11:17:14.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.643+0000 7f55bec3c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55b80b0e40 con 0x7f55b81595d0 2023-10-06T11:17:14.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.643+0000 7f55bd439700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55b806eac0 0x7f55b815e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:14.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.643+0000 7f55bd439700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55b806eac0 0x7f55b815e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38752/0 (socket says 172.21.15.146:38752) 2023-10-06T11:17:14.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.643+0000 7f55bd439700 1 -- 172.21.15.146:0/1852855018 learned_addr learned my addr 172.21.15.146:0/1852855018 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:14.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.644+0000 7f55bdc3a700 1 --2- 172.21.15.146:0/1852855018 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55b8068b90 0x7f55b815cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:14.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.644+0000 7f55be43b700 1 --2- 172.21.15.146:0/1852855018 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55b81595d0 0x7f55b81695e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:14.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.644+0000 7f55bd439700 1 -- 172.21.15.146:0/1852855018 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55b81595d0 msgr2=0x7f55b81695e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:14.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.644+0000 7f55bd439700 1 --2- 172.21.15.146:0/1852855018 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55b81595d0 0x7f55b81695e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:14.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.644+0000 7f55bd439700 1 -- 172.21.15.146:0/1852855018 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55b8068b90 msgr2=0x7f55b815cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:14.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.644+0000 7f55bd439700 1 --2- 172.21.15.146:0/1852855018 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55b8068b90 0x7f55b815cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:14.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.644+0000 7f55bd439700 1 -- 172.21.15.146:0/1852855018 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a8009420 con 0x7f55b806eac0 2023-10-06T11:17:14.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.644+0000 7f55bd439700 1 --2- 172.21.15.146:0/1852855018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55b806eac0 0x7f55b815e870 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f55a80030c0 tx=0x7f55a8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:14.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.644+0000 7f55adffb700 1 -- 172.21.15.146:0/1852855018 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a800b990 con 0x7f55b806eac0 2023-10-06T11:17:14.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.644+0000 7f55adffb700 1 -- 172.21.15.146:0/1852855018 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55a8020070 con 0x7f55b806eac0 2023-10-06T11:17:14.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.644+0000 7f55bec3c700 1 -- 172.21.15.146:0/1852855018 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55b80b1120 con 0x7f55b806eac0 2023-10-06T11:17:14.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.644+0000 7f55adffb700 1 -- 172.21.15.146:0/1852855018 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55a801b6a0 con 0x7f55b806eac0 2023-10-06T11:17:14.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.644+0000 7f55bec3c700 1 -- 172.21.15.146:0/1852855018 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55b80b16e0 con 0x7f55b806eac0 2023-10-06T11:17:14.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.645+0000 7f55bec3c700 1 -- 172.21.15.146:0/1852855018 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55b80b18d0 con 0x7f55b806eac0 2023-10-06T11:17:14.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.645+0000 7f55adffb700 1 -- 172.21.15.146:0/1852855018 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f55a8022030 con 0x7f55b806eac0 2023-10-06T11:17:14.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.646+0000 7f55adffb700 1 --2- 172.21.15.146:0/1852855018 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f559c066f30 0x7f559c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:14.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.646+0000 7f55adffb700 1 -- 172.21.15.146:0/1852855018 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5764+0+0 (secure 0 0 0) 0x7f55a8086560 con 0x7f55b806eac0 2023-10-06T11:17:14.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.646+0000 7f55bdc3a700 1 --2- 172.21.15.146:0/1852855018 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f559c066f30 0x7f559c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:14.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.646+0000 7f55bdc3a700 1 --2- 172.21.15.146:0/1852855018 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f559c066f30 0x7f559c0693e0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f55b400c8f0 tx=0x7f55b4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:14.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.650+0000 7f55adffb700 1 -- 172.21.15.146:0/1852855018 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f55a8053790 con 0x7f55b806eac0 2023-10-06T11:17:14.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:14.832+0000 7f55bec3c700 1 -- 172.21.15.146:0/1852855018 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f55b80b18d0 con 0x7f55b806eac0 2023-10-06T11:17:15.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.511+0000 7f55adffb700 1 -- 172.21.15.146:0/1852855018 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v142) v1 ==== 169+0+0 (secure 0 0 0) 0x7f55a8084e60 con 0x7f55b806eac0 2023-10-06T11:17:15.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.513+0000 7f55bec3c700 1 -- 172.21.15.146:0/1852855018 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f559c066f30 msgr2=0x7f559c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:15.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.513+0000 7f55bec3c700 1 --2- 172.21.15.146:0/1852855018 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f559c066f30 0x7f559c0693e0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f55b400c8f0 tx=0x7f55b4009040 comp rx=0 tx=0).stop 2023-10-06T11:17:15.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.513+0000 7f55bec3c700 1 -- 172.21.15.146:0/1852855018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55b806eac0 msgr2=0x7f55b815e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:15.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.514+0000 7f55bec3c700 1 --2- 172.21.15.146:0/1852855018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55b806eac0 0x7f55b815e870 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f55a80030c0 tx=0x7f55a8016000 comp rx=0 tx=0).stop 2023-10-06T11:17:15.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.514+0000 7f55bec3c700 1 -- 172.21.15.146:0/1852855018 shutdown_connections 2023-10-06T11:17:15.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.514+0000 7f55bec3c700 1 --2- 172.21.15.146:0/1852855018 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f559c066f30 0x7f559c0693e0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.514+0000 7f55bec3c700 1 --2- 172.21.15.146:0/1852855018 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f55b81595d0 0x7f55b81695e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.514+0000 7f55bec3c700 1 --2- 172.21.15.146:0/1852855018 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55b8068b90 0x7f55b815cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.514+0000 7f55bec3c700 1 --2- 172.21.15.146:0/1852855018 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55b806eac0 0x7f55b815e870 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.514+0000 7f55bec3c700 1 -- 172.21.15.146:0/1852855018 >> 172.21.15.146:0/1852855018 conn(0x7f55b80c9dc0 msgr2=0x7f55b80c30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:15.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.514+0000 7f55bec3c700 1 -- 172.21.15.146:0/1852855018 shutdown_connections 2023-10-06T11:17:15.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.514+0000 7f55bec3c700 1 -- 172.21.15.146:0/1852855018 wait complete. 2023-10-06T11:17:15.517 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' removed 2023-10-06T11:17:15.531 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T11:17:15.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.648+0000 7f8aff59e700 1 Processor -- start 2023-10-06T11:17:15.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.648+0000 7f8aff59e700 1 -- start start 2023-10-06T11:17:15.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.649+0000 7f8aff59e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8b000b5640 0x7f8b0015a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:15.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.649+0000 7f8aff59e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8b000cb090 0x7f8b000cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:15.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.649+0000 7f8aff59e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b000cc130 con 0x7f8b00068780 2023-10-06T11:17:15.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.649+0000 7f8aff59e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b000b2660 con 0x7f8b000cb090 2023-10-06T11:17:15.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.649+0000 7f8aff59e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0015adb0 con 0x7f8b000b5640 2023-10-06T11:17:15.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.649+0000 7f8afdd9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8b000cb090 0x7f8b000cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:15.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.649+0000 7f8afdd9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8b000cb090 0x7f8b000cc5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38756/0 (socket says 172.21.15.146:38756) 2023-10-06T11:17:15.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.649+0000 7f8afdd9b700 1 -- 172.21.15.146:0/4084260352 learned_addr learned my addr 172.21.15.146:0/4084260352 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:15.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.649+0000 7f8afe59c700 1 --2- 172.21.15.146:0/4084260352 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8b000b5640 0x7f8b0015a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:15.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.650+0000 7f8afdd9b700 1 -- 172.21.15.146:0/4084260352 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8b000b5640 msgr2=0x7f8b0015a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:15.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.650+0000 7f8afdd9b700 1 --2- 172.21.15.146:0/4084260352 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8b000b5640 0x7f8b0015a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.650+0000 7f8afdd9b700 1 -- 172.21.15.146:0/4084260352 >> v1:172.21.15.151:6789/0 conn(0x7f8b00068780 legacy=0x7f8b0015b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:15.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.650+0000 7f8afdd9b700 1 -- 172.21.15.146:0/4084260352 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b000cb520 con 0x7f8b000cb090 2023-10-06T11:17:15.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.650+0000 7f8afdd9b700 1 --2- 172.21.15.146:0/4084260352 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b000cb090 0x7f8b000cc5c0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f8ae80099b0 tx=0x7f8ae8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0bce0b21d97c21d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:15.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.650+0000 7f8afd59a700 1 -- 172.21.15.146:0/4084260352 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae800b860 con 0x7f8b000cb090 2023-10-06T11:17:15.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.650+0000 7f8afd59a700 1 -- 172.21.15.146:0/4084260352 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae800b9c0 con 0x7f8b000cb090 2023-10-06T11:17:15.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.650+0000 7f8afd59a700 1 -- 172.21.15.146:0/4084260352 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae800bd60 con 0x7f8b000cb090 2023-10-06T11:17:15.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.650+0000 7f8aff59e700 1 -- 172.21.15.146:0/4084260352 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b000cb090 msgr2=0x7f8b000cc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:15.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.650+0000 7f8aff59e700 1 --2- 172.21.15.146:0/4084260352 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b000cb090 0x7f8b000cc5c0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f8ae80099b0 tx=0x7f8ae8009250 comp rx=0 tx=0).stop 2023-10-06T11:17:15.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.650+0000 7f8aff59e700 1 -- 172.21.15.146:0/4084260352 shutdown_connections 2023-10-06T11:17:15.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.650+0000 7f8aff59e700 1 --2- 172.21.15.146:0/4084260352 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8b000b5640 0x7f8b0015a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.650+0000 7f8aff59e700 1 --2- 172.21.15.146:0/4084260352 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b000cb090 0x7f8b000cc5c0 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.650+0000 7f8aff59e700 1 -- 172.21.15.146:0/4084260352 >> 172.21.15.146:0/4084260352 conn(0x7f8b000703f0 msgr2=0x7f8b000707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:15.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.650+0000 7f8aff59e700 1 -- 172.21.15.146:0/4084260352 shutdown_connections 2023-10-06T11:17:15.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.651+0000 7f8aff59e700 1 -- 172.21.15.146:0/4084260352 wait complete. 2023-10-06T11:17:15.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.652+0000 7f8aff59e700 1 Processor -- start 2023-10-06T11:17:15.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.652+0000 7f8aff59e700 1 -- start start 2023-10-06T11:17:15.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.652+0000 7f8aff59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b00068780 0x7f8b000c6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:15.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.652+0000 7f8aff59e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8b000b5640 0x7f8b000c3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:15.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.652+0000 7f8aff59e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8b000cb090 0x7f8b0015dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:15.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.652+0000 7f8aff59e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b000c71b0 con 0x7f8b00068780 2023-10-06T11:17:15.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.652+0000 7f8aff59e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b000c5bd0 con 0x7f8b000b5640 2023-10-06T11:17:15.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.652+0000 7f8aff59e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b000c5eb0 con 0x7f8b000cb090 2023-10-06T11:17:15.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.652+0000 7f8afe59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b00068780 0x7f8b000c6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:15.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.652+0000 7f8afe59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b00068780 0x7f8b000c6c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38758/0 (socket says 172.21.15.146:38758) 2023-10-06T11:17:15.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.652+0000 7f8afe59c700 1 -- 172.21.15.146:0/2531751234 learned_addr learned my addr 172.21.15.146:0/2531751234 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:15.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.652+0000 7f8afdd9b700 1 --2- 172.21.15.146:0/2531751234 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8b000b5640 0x7f8b000c3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:15.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.652+0000 7f8afed9d700 1 --2- 172.21.15.146:0/2531751234 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8b000cb090 0x7f8b0015dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:15.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.653+0000 7f8afe59c700 1 -- 172.21.15.146:0/2531751234 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8b000cb090 msgr2=0x7f8b0015dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:15.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.653+0000 7f8afe59c700 1 --2- 172.21.15.146:0/2531751234 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8b000cb090 0x7f8b0015dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.653+0000 7f8afe59c700 1 -- 172.21.15.146:0/2531751234 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8b000b5640 msgr2=0x7f8b000c3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:15.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.653+0000 7f8afe59c700 1 --2- 172.21.15.146:0/2531751234 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8b000b5640 0x7f8b000c3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.653+0000 7f8afe59c700 1 -- 172.21.15.146:0/2531751234 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae80094f0 con 0x7f8b00068780 2023-10-06T11:17:15.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.653+0000 7f8afe59c700 1 --2- 172.21.15.146:0/2531751234 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b00068780 0x7f8b000c6c70 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f8af000e190 tx=0x7f8af0009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:15.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.653+0000 7f8af67fc700 1 -- 172.21.15.146:0/2531751234 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af000ecd0 con 0x7f8b00068780 2023-10-06T11:17:15.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.653+0000 7f8af67fc700 1 -- 172.21.15.146:0/2531751234 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af000ee30 con 0x7f8b00068780 2023-10-06T11:17:15.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.653+0000 7f8aff59e700 1 -- 172.21.15.146:0/2531751234 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b000c6190 con 0x7f8b00068780 2023-10-06T11:17:15.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.653+0000 7f8af67fc700 1 -- 172.21.15.146:0/2531751234 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af0014670 con 0x7f8b00068780 2023-10-06T11:17:15.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.653+0000 7f8aff59e700 1 -- 172.21.15.146:0/2531751234 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b000c6750 con 0x7f8b00068780 2023-10-06T11:17:15.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.654+0000 7f8aff59e700 1 -- 172.21.15.146:0/2531751234 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b000c6ac0 con 0x7f8b00068780 2023-10-06T11:17:15.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.654+0000 7f8af67fc700 1 -- 172.21.15.146:0/2531751234 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8af0014a20 con 0x7f8b00068780 2023-10-06T11:17:15.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.655+0000 7f8af67fc700 1 --2- 172.21.15.146:0/2531751234 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8ae0066f30 0x7f8ae00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:15.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.655+0000 7f8af67fc700 1 -- 172.21.15.146:0/2531751234 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f8af0084af0 con 0x7f8b00068780 2023-10-06T11:17:15.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.655+0000 7f8afdd9b700 1 --2- 172.21.15.146:0/2531751234 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8ae0066f30 0x7f8ae00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:15.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.655+0000 7f8afdd9b700 1 --2- 172.21.15.146:0/2531751234 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8ae0066f30 0x7f8ae00693e0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f8ae80099b0 tx=0x7f8ae8017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:15.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.659+0000 7f8af67fc700 1 -- 172.21.15.146:0/2531751234 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8af0051e60 con 0x7f8b00068780 2023-10-06T11:17:15.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.846+0000 7f8aff59e700 1 -- 172.21.15.146:0/2531751234 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f8b0004bb40 con 0x7f8b00068780 2023-10-06T11:17:15.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.849+0000 7f8af67fc700 1 -- 172.21.15.146:0/2531751234 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8af0009a60 con 0x7f8b00068780 2023-10-06T11:17:15.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.851+0000 7f8aff59e700 1 -- 172.21.15.146:0/2531751234 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8ae0066f30 msgr2=0x7f8ae00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:15.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.851+0000 7f8aff59e700 1 --2- 172.21.15.146:0/2531751234 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8ae0066f30 0x7f8ae00693e0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f8ae80099b0 tx=0x7f8ae8017000 comp rx=0 tx=0).stop 2023-10-06T11:17:15.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.851+0000 7f8aff59e700 1 -- 172.21.15.146:0/2531751234 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b00068780 msgr2=0x7f8b000c6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:15.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.851+0000 7f8aff59e700 1 --2- 172.21.15.146:0/2531751234 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b00068780 0x7f8b000c6c70 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f8af000e190 tx=0x7f8af0009920 comp rx=0 tx=0).stop 2023-10-06T11:17:15.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.851+0000 7f8aff59e700 1 -- 172.21.15.146:0/2531751234 shutdown_connections 2023-10-06T11:17:15.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.851+0000 7f8aff59e700 1 --2- 172.21.15.146:0/2531751234 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8ae0066f30 0x7f8ae00693e0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.851+0000 7f8aff59e700 1 --2- 172.21.15.146:0/2531751234 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8b000cb090 0x7f8b0015dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.851+0000 7f8aff59e700 1 --2- 172.21.15.146:0/2531751234 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8b00068780 0x7f8b000c6c70 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.851+0000 7f8aff59e700 1 --2- 172.21.15.146:0/2531751234 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8b000b5640 0x7f8b000c3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.851+0000 7f8aff59e700 1 -- 172.21.15.146:0/2531751234 >> 172.21.15.146:0/2531751234 conn(0x7f8b000703f0 msgr2=0x7f8b0015a310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:15.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.851+0000 7f8aff59e700 1 -- 172.21.15.146:0/2531751234 shutdown_connections 2023-10-06T11:17:15.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.851+0000 7f8aff59e700 1 -- 172.21.15.146:0/2531751234 wait complete. 2023-10-06T11:17:15.865 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace' 2023-10-06T11:17:15.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.979+0000 7f29040e7700 1 Processor -- start 2023-10-06T11:17:15.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.979+0000 7f29040e7700 1 -- start start 2023-10-06T11:17:15.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.980+0000 7f29040e7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f28fc157430 0x7f28fc157800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:15.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.980+0000 7f29040e7700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28fc0ccf20 con 0x7f28fc0ab010 2023-10-06T11:17:15.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.980+0000 7f29040e7700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28fc0cd200 con 0x7f28fc0ca070 2023-10-06T11:17:15.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.980+0000 7f29040e7700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28fc0ca4f0 con 0x7f28fc157430 2023-10-06T11:17:15.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.980+0000 7f2901e83700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f28fc157430 0x7f28fc157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:15.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.980+0000 7f2901682700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f28fc0ab010 0x7f28fc0ceb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40222/0 (socket says 172.21.15.146:40222) 2023-10-06T11:17:15.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.980+0000 7f2901682700 1 -- 172.21.15.146:0/4196831084 learned_addr learned my addr 172.21.15.146:0/4196831084 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:17:15.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.980+0000 7f2900e81700 1 -- 172.21.15.146:0/4196831084 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1212656165 0 0) 0x7f28fc0ccf20 con 0x7f28fc0ab010 2023-10-06T11:17:15.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.980+0000 7f2900e81700 1 -- 172.21.15.146:0/4196831084 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28e8003570 con 0x7f28fc0ab010 2023-10-06T11:17:15.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.980+0000 7f2901e83700 1 -- 172.21.15.146:0/4196831084 >> v1:172.21.15.151:6789/0 conn(0x7f28fc0ca070 legacy=0x7f28fc0cc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:15.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.980+0000 7f2901e83700 1 -- 172.21.15.146:0/4196831084 >> v1:172.21.15.146:6789/0 conn(0x7f28fc0ab010 legacy=0x7f28fc0ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:15.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.980+0000 7f2901e83700 1 -- 172.21.15.146:0/4196831084 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28fc0cd4e0 con 0x7f28fc157430 2023-10-06T11:17:15.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.981+0000 7f2901e83700 1 --2- 172.21.15.146:0/4196831084 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28fc157430 0x7f28fc157800 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f28f80098e0 tx=0x7f28f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2581be1e3bcaf871 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:15.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.981+0000 7f2900e81700 1 -- 172.21.15.146:0/4196831084 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f800b640 con 0x7f28fc157430 2023-10-06T11:17:15.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.981+0000 7f2900e81700 1 -- 172.21.15.146:0/4196831084 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f800b7a0 con 0x7f28fc157430 2023-10-06T11:17:15.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.981+0000 7f2900e81700 1 -- 172.21.15.146:0/4196831084 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f800bb40 con 0x7f28fc157430 2023-10-06T11:17:15.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.981+0000 7f29040e7700 1 -- 172.21.15.146:0/4196831084 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28fc157430 msgr2=0x7f28fc157800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:15.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.981+0000 7f29040e7700 1 --2- 172.21.15.146:0/4196831084 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28fc157430 0x7f28fc157800 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f28f80098e0 tx=0x7f28f80091a0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.981+0000 7f29040e7700 1 -- 172.21.15.146:0/4196831084 shutdown_connections 2023-10-06T11:17:15.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.981+0000 7f29040e7700 1 --2- 172.21.15.146:0/4196831084 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28fc157430 0x7f28fc157800 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.981+0000 7f29040e7700 1 -- 172.21.15.146:0/4196831084 >> 172.21.15.146:0/4196831084 conn(0x7f28fc067c50 msgr2=0x7f28fc0ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:15.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.981+0000 7f29040e7700 1 -- 172.21.15.146:0/4196831084 shutdown_connections 2023-10-06T11:17:15.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.981+0000 7f29040e7700 1 -- 172.21.15.146:0/4196831084 wait complete. 2023-10-06T11:17:15.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.982+0000 7f29040e7700 1 Processor -- start 2023-10-06T11:17:15.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.982+0000 7f29040e7700 1 -- start start 2023-10-06T11:17:15.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.983+0000 7f29040e7700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28fc0ab010 0x7f28fc15c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:15.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.983+0000 7f29040e7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28fc0ca070 0x7f28fc157f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:15.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.983+0000 7f29040e7700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28fc157430 0x7f28fc1506c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:15.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.983+0000 7f29040e7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc1688b0 con 0x7f28fc0ca070 2023-10-06T11:17:15.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.983+0000 7f29040e7700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc167ca0 con 0x7f28fc0ab010 2023-10-06T11:17:15.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.983+0000 7f29040e7700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc167f80 con 0x7f28fc157430 2023-10-06T11:17:15.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.983+0000 7f2901682700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28fc0ca070 0x7f28fc157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:15.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.983+0000 7f2901682700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28fc0ca070 0x7f28fc157f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38786/0 (socket says 172.21.15.146:38786) 2023-10-06T11:17:15.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.983+0000 7f2901682700 1 -- 172.21.15.146:0/3009761203 learned_addr learned my addr 172.21.15.146:0/3009761203 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:15.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.983+0000 7f2901e83700 1 --2- 172.21.15.146:0/3009761203 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28fc0ab010 0x7f28fc15c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:15.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.983+0000 7f2902684700 1 --2- 172.21.15.146:0/3009761203 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28fc157430 0x7f28fc1506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:15.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.983+0000 7f2901682700 1 -- 172.21.15.146:0/3009761203 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28fc157430 msgr2=0x7f28fc1506c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:15.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.983+0000 7f2901682700 1 --2- 172.21.15.146:0/3009761203 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28fc157430 0x7f28fc1506c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.983+0000 7f2901682700 1 -- 172.21.15.146:0/3009761203 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28fc0ab010 msgr2=0x7f28fc15c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:15.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.983+0000 7f2901682700 1 --2- 172.21.15.146:0/3009761203 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28fc0ab010 0x7f28fc15c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:15.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.983+0000 7f2901682700 1 -- 172.21.15.146:0/3009761203 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f8009420 con 0x7f28fc0ca070 2023-10-06T11:17:15.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.984+0000 7f2901682700 1 --2- 172.21.15.146:0/3009761203 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28fc0ca070 0x7f28fc157f80 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f28ec00c7c0 tx=0x7f28ec007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:15.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.984+0000 7f28f1ffb700 1 -- 172.21.15.146:0/3009761203 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ec005cd0 con 0x7f28fc0ca070 2023-10-06T11:17:15.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.984+0000 7f28f1ffb700 1 -- 172.21.15.146:0/3009761203 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28ec005e30 con 0x7f28fc0ca070 2023-10-06T11:17:15.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.984+0000 7f28f1ffb700 1 -- 172.21.15.146:0/3009761203 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ec007320 con 0x7f28fc0ca070 2023-10-06T11:17:15.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.984+0000 7f29040e7700 1 -- 172.21.15.146:0/3009761203 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28fc168260 con 0x7f28fc0ca070 2023-10-06T11:17:15.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.984+0000 7f29040e7700 1 -- 172.21.15.146:0/3009761203 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28fc1678f0 con 0x7f28fc0ca070 2023-10-06T11:17:15.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.985+0000 7f29040e7700 1 -- 172.21.15.146:0/3009761203 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28fc15afb0 con 0x7f28fc0ca070 2023-10-06T11:17:15.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.985+0000 7f28f1ffb700 1 -- 172.21.15.146:0/3009761203 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f28ec01b3b0 con 0x7f28fc0ca070 2023-10-06T11:17:15.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.985+0000 7f28f1ffb700 1 --2- 172.21.15.146:0/3009761203 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f28e0066f30 0x7f28e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:15.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.986+0000 7f28f1ffb700 1 -- 172.21.15.146:0/3009761203 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f28ec083a30 con 0x7f28fc0ca070 2023-10-06T11:17:15.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.986+0000 7f2901e83700 1 --2- 172.21.15.146:0/3009761203 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f28e0066f30 0x7f28e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:15.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.986+0000 7f2901e83700 1 --2- 172.21.15.146:0/3009761203 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f28e0066f30 0x7f28e00693e0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f28f80093f0 tx=0x7f28f8017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:15.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:15.990+0000 7f28f1ffb700 1 -- 172.21.15.146:0/3009761203 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f28fc15afb0 con 0x7f28fc0ca070 2023-10-06T11:17:16.251 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.249+0000 7f29040e7700 1 -- 172.21.15.146:0/3009761203 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]} v 0) v1 -- 0x7f28fc15afb0 con 0x7f28fc0ca070 2023-10-06T11:17:16.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.510+0000 7f28f1ffb700 1 -- 172.21.15.146:0/3009761203 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_mdsdir_scrub_backtrace"]}]=0 v540) v1 ==== 140+0+0 (secure 0 0 0) 0x7f28fc15afb0 con 0x7f28fc0ca070 2023-10-06T11:17:16.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.512+0000 7f29040e7700 1 -- 172.21.15.146:0/3009761203 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f28e0066f30 msgr2=0x7f28e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:16.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.512+0000 7f29040e7700 1 --2- 172.21.15.146:0/3009761203 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f28e0066f30 0x7f28e00693e0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f28f80093f0 tx=0x7f28f8017000 comp rx=0 tx=0).stop 2023-10-06T11:17:16.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.512+0000 7f29040e7700 1 -- 172.21.15.146:0/3009761203 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28fc0ca070 msgr2=0x7f28fc157f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:16.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.512+0000 7f29040e7700 1 --2- 172.21.15.146:0/3009761203 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28fc0ca070 0x7f28fc157f80 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f28ec00c7c0 tx=0x7f28ec007e00 comp rx=0 tx=0).stop 2023-10-06T11:17:16.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.512+0000 7f29040e7700 1 -- 172.21.15.146:0/3009761203 shutdown_connections 2023-10-06T11:17:16.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.512+0000 7f29040e7700 1 --2- 172.21.15.146:0/3009761203 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f28e0066f30 0x7f28e00693e0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:16.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.512+0000 7f29040e7700 1 --2- 172.21.15.146:0/3009761203 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28fc157430 0x7f28fc1506c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:16.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.512+0000 7f29040e7700 1 --2- 172.21.15.146:0/3009761203 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28fc0ab010 0x7f28fc15c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:16.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.512+0000 7f29040e7700 1 --2- 172.21.15.146:0/3009761203 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f28fc0ca070 0x7f28fc157f80 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:16.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.512+0000 7f29040e7700 1 -- 172.21.15.146:0/3009761203 >> 172.21.15.146:0/3009761203 conn(0x7f28fc067c50 msgr2=0x7f28fc0ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:16.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.512+0000 7f29040e7700 1 -- 172.21.15.146:0/3009761203 shutdown_connections 2023-10-06T11:17:16.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.512+0000 7f29040e7700 1 -- 172.21.15.146:0/3009761203 wait complete. 2023-10-06T11:17:16.526 INFO:tasks.cephfs_test_runner:test_mdsdir_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) ... ok 2023-10-06T11:17:16.527 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) 2023-10-06T11:17:16.527 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace' 2023-10-06T11:17:16.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.639+0000 7f7656f65700 1 Processor -- start 2023-10-06T11:17:16.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.639+0000 7f7656f65700 1 -- start start 2023-10-06T11:17:16.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.640+0000 7f7656f65700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7650153ab0 0x7f765015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:16.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.640+0000 7f7656f65700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7650068ba0 0x7f76500b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:16.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.640+0000 7f7656f65700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f765015ac30 con 0x7f7650153e80 2023-10-06T11:17:16.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.640+0000 7f7656f65700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76500b4510 con 0x7f7650153ab0 2023-10-06T11:17:16.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.640+0000 7f7656f65700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76500b6530 con 0x7f7650068ba0 2023-10-06T11:17:16.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.640+0000 7f7654d01700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7650153ab0 0x7f765015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:16.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.640+0000 7f7654d01700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7650153ab0 0x7f765015a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38790/0 (socket says 172.21.15.146:38790) 2023-10-06T11:17:16.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.640+0000 7f7654d01700 1 -- 172.21.15.146:0/889617588 learned_addr learned my addr 172.21.15.146:0/889617588 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:16.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.640+0000 7f7655502700 1 --2- 172.21.15.146:0/889617588 >> v2:172.21.15.151:3300/0 conn(0x7f7650068ba0 0x7f76500b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:16.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.640+0000 7f7654d01700 1 -- 172.21.15.146:0/889617588 >> v2:172.21.15.151:3300/0 conn(0x7f7650068ba0 msgr2=0x7f76500b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:16.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.640+0000 7f7654d01700 1 --2- 172.21.15.146:0/889617588 >> v2:172.21.15.151:3300/0 conn(0x7f7650068ba0 0x7f76500b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:16.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.640+0000 7f7654d01700 1 -- 172.21.15.146:0/889617588 >> v1:172.21.15.151:6789/0 conn(0x7f7650153e80 legacy=0x7f7650068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:16.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.640+0000 7f7654d01700 1 -- 172.21.15.146:0/889617588 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76500b5c50 con 0x7f7650153ab0 2023-10-06T11:17:16.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.641+0000 7f7654d01700 1 --2- 172.21.15.146:0/889617588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7650153ab0 0x7f765015a6f0 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f76500b36d0 tx=0x7f764c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8a1e26c35acca09 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:16.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.641+0000 7f76477fe700 1 -- 172.21.15.146:0/889617588 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764c00e070 con 0x7f7650153ab0 2023-10-06T11:17:16.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.641+0000 7f76477fe700 1 -- 172.21.15.146:0/889617588 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f764c00ba20 con 0x7f7650153ab0 2023-10-06T11:17:16.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.641+0000 7f76477fe700 1 -- 172.21.15.146:0/889617588 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764c0092e0 con 0x7f7650153ab0 2023-10-06T11:17:16.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.641+0000 7f7656f65700 1 -- 172.21.15.146:0/889617588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7650153ab0 msgr2=0x7f765015a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:16.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.641+0000 7f7656f65700 1 --2- 172.21.15.146:0/889617588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7650153ab0 0x7f765015a6f0 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f76500b36d0 tx=0x7f764c009840 comp rx=0 tx=0).stop 2023-10-06T11:17:16.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.641+0000 7f7656f65700 1 -- 172.21.15.146:0/889617588 shutdown_connections 2023-10-06T11:17:16.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.641+0000 7f7656f65700 1 --2- 172.21.15.146:0/889617588 >> v2:172.21.15.151:3300/0 conn(0x7f7650068ba0 0x7f76500b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:16.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.641+0000 7f7656f65700 1 --2- 172.21.15.146:0/889617588 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7650153ab0 0x7f765015a6f0 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:16.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.641+0000 7f7656f65700 1 -- 172.21.15.146:0/889617588 >> 172.21.15.146:0/889617588 conn(0x7f765006eba0 msgr2=0x7f765006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:16.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.641+0000 7f7656f65700 1 -- 172.21.15.146:0/889617588 shutdown_connections 2023-10-06T11:17:16.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.641+0000 7f7656f65700 1 -- 172.21.15.146:0/889617588 wait complete. 2023-10-06T11:17:16.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.642+0000 7f7656f65700 1 Processor -- start 2023-10-06T11:17:16.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.643+0000 7f7656f65700 1 -- start start 2023-10-06T11:17:16.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.643+0000 7f7656f65700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7650068ba0 0x7f76500aff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:16.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.643+0000 7f7656f65700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7650153ab0 0x7f765015a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:16.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.643+0000 7f7656f65700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7650153e80 0x7f7650143fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:16.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.643+0000 7f7656f65700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765015aa90 con 0x7f7650153ab0 2023-10-06T11:17:16.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.643+0000 7f7656f65700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76500b0640 con 0x7f7650068ba0 2023-10-06T11:17:16.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.643+0000 7f7656f65700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76500b0920 con 0x7f7650153e80 2023-10-06T11:17:16.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.643+0000 7f7647fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7650153ab0 0x7f765015a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:16.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.643+0000 7f7647fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7650153ab0 0x7f765015a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38804/0 (socket says 172.21.15.146:38804) 2023-10-06T11:17:16.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.643+0000 7f7647fff700 1 -- 172.21.15.146:0/244245414 learned_addr learned my addr 172.21.15.146:0/244245414 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:16.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.644+0000 7f7654d01700 1 --2- 172.21.15.146:0/244245414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7650068ba0 0x7f76500aff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:16.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.644+0000 7f7655502700 1 --2- 172.21.15.146:0/244245414 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7650153e80 0x7f7650143fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:16.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.644+0000 7f7647fff700 1 -- 172.21.15.146:0/244245414 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7650153e80 msgr2=0x7f7650143fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:16.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.644+0000 7f7647fff700 1 --2- 172.21.15.146:0/244245414 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7650153e80 0x7f7650143fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:16.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.644+0000 7f7647fff700 1 -- 172.21.15.146:0/244245414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7650068ba0 msgr2=0x7f76500aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:16.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.644+0000 7f7647fff700 1 --2- 172.21.15.146:0/244245414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7650068ba0 0x7f76500aff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:16.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.644+0000 7f7647fff700 1 -- 172.21.15.146:0/244245414 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f764c009ae0 con 0x7f7650153ab0 2023-10-06T11:17:16.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.644+0000 7f7654d01700 1 --2- 172.21.15.146:0/244245414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7650068ba0 0x7f76500aff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:17:16.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.644+0000 7f7647fff700 1 --2- 172.21.15.146:0/244245414 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7650153ab0 0x7f765015a550 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f764000c590 tx=0x7f764000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:16.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.644+0000 7f7644ff9700 1 -- 172.21.15.146:0/244245414 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7640011590 con 0x7f7650153ab0 2023-10-06T11:17:16.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.644+0000 7f7644ff9700 1 -- 172.21.15.146:0/244245414 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76400116f0 con 0x7f7650153ab0 2023-10-06T11:17:16.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.644+0000 7f7656f65700 1 -- 172.21.15.146:0/244245414 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76500b0c00 con 0x7f7650153ab0 2023-10-06T11:17:16.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.644+0000 7f7644ff9700 1 -- 172.21.15.146:0/244245414 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7640011ab0 con 0x7f7650153ab0 2023-10-06T11:17:16.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.644+0000 7f7656f65700 1 -- 172.21.15.146:0/244245414 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76500b11c0 con 0x7f7650153ab0 2023-10-06T11:17:16.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.645+0000 7f7656f65700 1 -- 172.21.15.146:0/244245414 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76500b13e0 con 0x7f7650153ab0 2023-10-06T11:17:16.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.646+0000 7f7644ff9700 1 -- 172.21.15.146:0/244245414 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f764001b3b0 con 0x7f7650153ab0 2023-10-06T11:17:16.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.646+0000 7f7644ff9700 1 --2- 172.21.15.146:0/244245414 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f763c066f30 0x7f763c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:16.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.646+0000 7f7644ff9700 1 -- 172.21.15.146:0/244245414 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f76400837c0 con 0x7f7650153ab0 2023-10-06T11:17:16.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.646+0000 7f7654d01700 1 --2- 172.21.15.146:0/244245414 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f763c066f30 0x7f763c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:16.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.646+0000 7f7654d01700 1 --2- 172.21.15.146:0/244245414 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f763c066f30 0x7f763c0693e0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f764c009880 tx=0x7f764c018000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:16.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.650+0000 7f7644ff9700 1 -- 172.21.15.146:0/244245414 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7640050bd0 con 0x7f7650153ab0 2023-10-06T11:17:16.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:16.909+0000 7f7656f65700 1 -- 172.21.15.146:0/244245414 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]} v 0) v1 -- 0x7f765004c380 con 0x7f7650153ab0 2023-10-06T11:17:17.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.513+0000 7f7644ff9700 1 -- 172.21.15.146:0/244245414 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]}]=0 v541) v1 ==== 136+0+0 (secure 0 0 0) 0x7f76400541f0 con 0x7f7650153ab0 2023-10-06T11:17:17.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.516+0000 7f7656f65700 1 -- 172.21.15.146:0/244245414 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f763c066f30 msgr2=0x7f763c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:17.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.516+0000 7f7656f65700 1 --2- 172.21.15.146:0/244245414 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f763c066f30 0x7f763c0693e0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f764c009880 tx=0x7f764c018000 comp rx=0 tx=0).stop 2023-10-06T11:17:17.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.516+0000 7f7656f65700 1 -- 172.21.15.146:0/244245414 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7650153ab0 msgr2=0x7f765015a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:17.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.516+0000 7f7656f65700 1 --2- 172.21.15.146:0/244245414 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7650153ab0 0x7f765015a550 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f764000c590 tx=0x7f764000c950 comp rx=0 tx=0).stop 2023-10-06T11:17:17.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.516+0000 7f7656f65700 1 -- 172.21.15.146:0/244245414 shutdown_connections 2023-10-06T11:17:17.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.516+0000 7f7656f65700 1 --2- 172.21.15.146:0/244245414 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f763c066f30 0x7f763c0693e0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:17.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.516+0000 7f7656f65700 1 --2- 172.21.15.146:0/244245414 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7650153e80 0x7f7650143fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:17.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.516+0000 7f7656f65700 1 --2- 172.21.15.146:0/244245414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7650068ba0 0x7f76500aff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:17.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.516+0000 7f7656f65700 1 --2- 172.21.15.146:0/244245414 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7650153ab0 0x7f765015a550 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:17.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.516+0000 7f7656f65700 1 -- 172.21.15.146:0/244245414 >> 172.21.15.146:0/244245414 conn(0x7f765006eba0 msgr2=0x7f765015c640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:17.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.516+0000 7f7656f65700 1 -- 172.21.15.146:0/244245414 shutdown_connections 2023-10-06T11:17:17.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.516+0000 7f7656f65700 1 -- 172.21.15.146:0/244245414 wait complete. 2023-10-06T11:17:17.531 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T11:17:17.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.648+0000 7f1003f16700 1 Processor -- start 2023-10-06T11:17:17.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.648+0000 7f1003f16700 1 -- start start 2023-10-06T11:17:17.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.649+0000 7f1003f16700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ffc0ae730 0x7f0ffc0aeb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:17.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.649+0000 7f1003f16700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0ffc0cb950 0x7f0ffc0cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:17.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.649+0000 7f1003f16700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ffc0ae2a0 con 0x7f0ffc15a160 2023-10-06T11:17:17.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.649+0000 7f1003f16700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ffc15a530 con 0x7f0ffc0cb950 2023-10-06T11:17:17.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.649+0000 7f1003f16700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ffc0c5cb0 con 0x7f0ffc0ae730 2023-10-06T11:17:17.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.650+0000 7f1001cb2700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0ffc15a160 0x7f0ffc0c55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40236/0 (socket says 172.21.15.146:40236) 2023-10-06T11:17:17.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.650+0000 7f1001cb2700 1 -- 172.21.15.146:0/664475526 learned_addr learned my addr 172.21.15.146:0/664475526 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:17:17.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.650+0000 7f1000cb0700 1 -- 172.21.15.146:0/664475526 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3299197050 0 0) 0x7f0ffc0ae2a0 con 0x7f0ffc15a160 2023-10-06T11:17:17.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.650+0000 7f1000cb0700 1 -- 172.21.15.146:0/664475526 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fe8003570 con 0x7f0ffc15a160 2023-10-06T11:17:17.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.650+0000 7f10014b1700 1 --2- 172.21.15.146:0/664475526 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ffc0ae730 0x7f0ffc0aeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:17.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.650+0000 7f10024b3700 1 --2- 172.21.15.146:0/664475526 >> v2:172.21.15.151:3300/0 conn(0x7f0ffc0cb950 0x7f0ffc0cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:17.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.650+0000 7f1000cb0700 1 -- 172.21.15.146:0/664475526 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 242806019 0 0) 0x7f0fe8003570 con 0x7f0ffc15a160 2023-10-06T11:17:17.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.650+0000 7f1000cb0700 1 -- 172.21.15.146:0/664475526 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ffc0ae730 msgr2=0x7f0ffc0aeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:17.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.650+0000 7f1000cb0700 1 --2- 172.21.15.146:0/664475526 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ffc0ae730 0x7f0ffc0aeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:17.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.650+0000 7f1000cb0700 1 -- 172.21.15.146:0/664475526 >> v2:172.21.15.151:3300/0 conn(0x7f0ffc0cb950 msgr2=0x7f0ffc0cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:17.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.650+0000 7f1000cb0700 1 --2- 172.21.15.146:0/664475526 >> v2:172.21.15.151:3300/0 conn(0x7f0ffc0cb950 0x7f0ffc0cbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:17.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.650+0000 7f1000cb0700 1 -- 172.21.15.146:0/664475526 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ffc0ad690 con 0x7f0ffc15a160 2023-10-06T11:17:17.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.650+0000 7f1000cb0700 1 -- 172.21.15.146:0/664475526 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f0ff80015f0 con 0x7f0ffc15a160 2023-10-06T11:17:17.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.650+0000 7f1000cb0700 1 -- 172.21.15.146:0/664475526 >> v1:172.21.15.146:6789/0 conn(0x7f0ffc15a160 legacy=0x7f0ffc0c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:17.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.650+0000 7f1000cb0700 1 --2- 172.21.15.146:0/664475526 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ffc0ae730 0x7f0fe8003ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:17.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.650+0000 7f1000cb0700 1 --2- 172.21.15.146:0/664475526 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0fe8004160 0x7f0fe8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:17.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.650+0000 7f1000cb0700 1 --2- 172.21.15.146:0/664475526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fe8004d50 0x7f0fe80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:17.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.650+0000 7f1000cb0700 1 -- 172.21.15.146:0/664475526 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ffc15a530 con 0x7f0fe8004d50 2023-10-06T11:17:17.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.650+0000 7f1000cb0700 1 -- 172.21.15.146:0/664475526 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ffc0c5cb0 con 0x7f0fe8004160 2023-10-06T11:17:17.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.650+0000 7f1000cb0700 1 -- 172.21.15.146:0/664475526 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe800bd20 con 0x7f0ffc0ae730 2023-10-06T11:17:17.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.650+0000 7f10024b3700 1 --2- 172.21.15.146:0/664475526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fe8004d50 0x7f0fe80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:17.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.650+0000 7f1001cb2700 1 --2- 172.21.15.146:0/664475526 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ffc0ae730 0x7f0fe8003ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:17.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.650+0000 7f10014b1700 1 --2- 172.21.15.146:0/664475526 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0fe8004160 0x7f0fe8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:17.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.650+0000 7f10024b3700 1 -- 172.21.15.146:0/664475526 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ffc0ae730 msgr2=0x7f0fe8003ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:17.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.650+0000 7f10024b3700 1 --2- 172.21.15.146:0/664475526 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0ffc0ae730 0x7f0fe8003ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:17.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.650+0000 7f10024b3700 1 -- 172.21.15.146:0/664475526 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0fe8004160 msgr2=0x7f0fe8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:17.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.650+0000 7f10024b3700 1 --2- 172.21.15.146:0/664475526 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0fe8004160 0x7f0fe8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:17.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.650+0000 7f10024b3700 1 -- 172.21.15.146:0/664475526 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe8003570 con 0x7f0fe8004d50 2023-10-06T11:17:17.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.651+0000 7f10024b3700 1 --2- 172.21.15.146:0/664475526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fe8004d50 0x7f0fe80051c0 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f0ff4009fd0 tx=0x7f0ff4009710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ff66bd8b66c4eb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:17.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.651+0000 7f1000cb0700 1 -- 172.21.15.146:0/664475526 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff4009a40 con 0x7f0fe8004d50 2023-10-06T11:17:17.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.651+0000 7f1000cb0700 1 -- 172.21.15.146:0/664475526 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff4007cc0 con 0x7f0fe8004d50 2023-10-06T11:17:17.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.651+0000 7f1000cb0700 1 -- 172.21.15.146:0/664475526 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff4014630 con 0x7f0fe8004d50 2023-10-06T11:17:17.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.651+0000 7f1003f16700 1 -- 172.21.15.146:0/664475526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fe8004d50 msgr2=0x7f0fe80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:17.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.651+0000 7f1003f16700 1 --2- 172.21.15.146:0/664475526 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0fe8004d50 0x7f0fe80051c0 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f0ff4009fd0 tx=0x7f0ff4009710 comp rx=0 tx=0).stop 2023-10-06T11:17:17.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.651+0000 7f10024b3700 1 -- 172.21.15.146:0/664475526 reap_dead start 2023-10-06T11:17:17.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.651+0000 7f1003f16700 1 -- 172.21.15.146:0/664475526 shutdown_connections 2023-10-06T11:17:17.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.651+0000 7f1003f16700 1 -- 172.21.15.146:0/664475526 >> 172.21.15.146:0/664475526 conn(0x7f0ffc06f380 msgr2=0x7f0ffc0d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:17.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.651+0000 7f1003f16700 1 -- 172.21.15.146:0/664475526 shutdown_connections 2023-10-06T11:17:17.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.651+0000 7f1003f16700 1 -- 172.21.15.146:0/664475526 wait complete. 2023-10-06T11:17:17.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.652+0000 7f1003f16700 1 Processor -- start 2023-10-06T11:17:17.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.652+0000 7f1003f16700 1 -- start start 2023-10-06T11:17:17.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.653+0000 7f1003f16700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0fe8004d50 0x7f0ffc0c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:17.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.653+0000 7f1003f16700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ffc1575c0 0x7f0ffc0b2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:17.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.653+0000 7f1003f16700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ffc0aeb00 0x7f0ffc0aef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:17.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.653+0000 7f1003f16700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ffc0c86d0 con 0x7f0ffc1575c0 2023-10-06T11:17:17.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.653+0000 7f1003f16700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ffc0ca410 con 0x7f0ffc0aeb00 2023-10-06T11:17:17.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.653+0000 7f1003f16700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ffc0c9e50 con 0x7f0fe8004d50 2023-10-06T11:17:17.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.653+0000 7f10014b1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ffc1575c0 0x7f0ffc0b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:17.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.653+0000 7f10014b1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ffc1575c0 0x7f0ffc0b2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38824/0 (socket says 172.21.15.146:38824) 2023-10-06T11:17:17.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.653+0000 7f10014b1700 1 -- 172.21.15.146:0/2916048629 learned_addr learned my addr 172.21.15.146:0/2916048629 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:17.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.653+0000 7f1001cb2700 1 --2- 172.21.15.146:0/2916048629 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0fe8004d50 0x7f0ffc0c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:17.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.653+0000 7f10024b3700 1 --2- 172.21.15.146:0/2916048629 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ffc0aeb00 0x7f0ffc0aef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:17.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.654+0000 7f10014b1700 1 -- 172.21.15.146:0/2916048629 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0fe8004d50 msgr2=0x7f0ffc0c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:17.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.654+0000 7f10014b1700 1 --2- 172.21.15.146:0/2916048629 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0fe8004d50 0x7f0ffc0c8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:17.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.654+0000 7f10014b1700 1 -- 172.21.15.146:0/2916048629 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ffc0aeb00 msgr2=0x7f0ffc0aef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:17.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.654+0000 7f10014b1700 1 --2- 172.21.15.146:0/2916048629 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ffc0aeb00 0x7f0ffc0aef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:17.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.654+0000 7f10014b1700 1 -- 172.21.15.146:0/2916048629 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ffc0ca130 con 0x7f0ffc1575c0 2023-10-06T11:17:17.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.654+0000 7f10024b3700 1 --2- 172.21.15.146:0/2916048629 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ffc0aeb00 0x7f0ffc0aef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:17:17.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.654+0000 7f10014b1700 1 --2- 172.21.15.146:0/2916048629 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ffc1575c0 0x7f0ffc0b2260 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f0fec010aa0 tx=0x7f0fec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:17.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.654+0000 7f0ff1ffb700 1 -- 172.21.15.146:0/2916048629 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec00e8d0 con 0x7f0ffc1575c0 2023-10-06T11:17:17.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.654+0000 7f0ff1ffb700 1 -- 172.21.15.146:0/2916048629 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fec00ea30 con 0x7f0ffc1575c0 2023-10-06T11:17:17.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.654+0000 7f0ff1ffb700 1 -- 172.21.15.146:0/2916048629 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec00edd0 con 0x7f0ffc1575c0 2023-10-06T11:17:17.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.654+0000 7f1003f16700 1 -- 172.21.15.146:0/2916048629 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ffc0c8360 con 0x7f0ffc1575c0 2023-10-06T11:17:17.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.654+0000 7f1003f16700 1 -- 172.21.15.146:0/2916048629 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ffc14b900 con 0x7f0ffc1575c0 2023-10-06T11:17:17.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.655+0000 7f1003f16700 1 -- 172.21.15.146:0/2916048629 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ffc0c8880 con 0x7f0ffc1575c0 2023-10-06T11:17:17.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.655+0000 7f0ff1ffb700 1 -- 172.21.15.146:0/2916048629 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0fec014640 con 0x7f0ffc1575c0 2023-10-06T11:17:17.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.656+0000 7f0ff1ffb700 1 --2- 172.21.15.146:0/2916048629 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0fe0066f60 0x7f0fe0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:17.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.656+0000 7f0ff1ffb700 1 -- 172.21.15.146:0/2916048629 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f0fec084ac0 con 0x7f0ffc1575c0 2023-10-06T11:17:17.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.656+0000 7f1001cb2700 1 --2- 172.21.15.146:0/2916048629 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0fe0066f60 0x7f0fe0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:17.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.656+0000 7f1001cb2700 1 --2- 172.21.15.146:0/2916048629 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0fe0066f60 0x7f0fe0069410 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8000e50 tx=0x7f0ff8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:17.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.660+0000 7f0ff1ffb700 1 -- 172.21.15.146:0/2916048629 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0ffc0c8880 con 0x7f0ffc1575c0 2023-10-06T11:17:17.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.845+0000 7f1003f16700 1 -- 172.21.15.146:0/2916048629 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f0ffc088480 con 0x7f0ffc1575c0 2023-10-06T11:17:17.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.849+0000 7f0ff1ffb700 1 -- 172.21.15.146:0/2916048629 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0fec0180c0 con 0x7f0ffc1575c0 2023-10-06T11:17:17.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.851+0000 7f1003f16700 1 -- 172.21.15.146:0/2916048629 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0fe0066f60 msgr2=0x7f0fe0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:17.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.851+0000 7f1003f16700 1 --2- 172.21.15.146:0/2916048629 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0fe0066f60 0x7f0fe0069410 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8000e50 tx=0x7f0ff8009040 comp rx=0 tx=0).stop 2023-10-06T11:17:17.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.851+0000 7f1003f16700 1 -- 172.21.15.146:0/2916048629 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ffc1575c0 msgr2=0x7f0ffc0b2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:17.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.851+0000 7f1003f16700 1 --2- 172.21.15.146:0/2916048629 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ffc1575c0 0x7f0ffc0b2260 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f0fec010aa0 tx=0x7f0fec008040 comp rx=0 tx=0).stop 2023-10-06T11:17:17.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.851+0000 7f1003f16700 1 -- 172.21.15.146:0/2916048629 shutdown_connections 2023-10-06T11:17:17.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.851+0000 7f1003f16700 1 --2- 172.21.15.146:0/2916048629 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0fe0066f60 0x7f0fe0069410 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:17.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.851+0000 7f1003f16700 1 --2- 172.21.15.146:0/2916048629 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ffc0aeb00 0x7f0ffc0aef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:17.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.851+0000 7f1003f16700 1 --2- 172.21.15.146:0/2916048629 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0fe8004d50 0x7f0ffc0c8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:17.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.851+0000 7f1003f16700 1 --2- 172.21.15.146:0/2916048629 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0ffc1575c0 0x7f0ffc0b2260 unknown :-1 s=CLOSED pgs=1897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:17.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.851+0000 7f1003f16700 1 -- 172.21.15.146:0/2916048629 >> 172.21.15.146:0/2916048629 conn(0x7f0ffc06f380 msgr2=0x7f0ffc0cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:17.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.851+0000 7f1003f16700 1 -- 172.21.15.146:0/2916048629 shutdown_connections 2023-10-06T11:17:17.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:17.851+0000 7f1003f16700 1 -- 172.21.15.146:0/2916048629 wait complete. 2023-10-06T11:17:17.865 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T11:17:17.865 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:17:17.903 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:17:17.948 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T11:17:17.949 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T11:17:17.949 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:17:18.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.061+0000 7f62ea7c4700 1 Processor -- start 2023-10-06T11:17:18.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.061+0000 7f62ea7c4700 1 -- start start 2023-10-06T11:17:18.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.062+0000 7f62ea7c4700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62e4157430 0x7f62e4157800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:18.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.062+0000 7f62ea7c4700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62e40ccf20 con 0x7f62e40ca070 2023-10-06T11:17:18.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.062+0000 7f62ea7c4700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62e40cd200 con 0x7f62e40ab010 2023-10-06T11:17:18.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.062+0000 7f62ea7c4700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e40ca4f0 con 0x7f62e4157430 2023-10-06T11:17:18.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.062+0000 7f62e8d61700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f62e40ca070 0x7f62e40cc240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40240/0 (socket says 172.21.15.146:40240) 2023-10-06T11:17:18.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.062+0000 7f62e8d61700 1 -- 172.21.15.146:0/2505677357 learned_addr learned my addr 172.21.15.146:0/2505677357 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:17:18.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.063+0000 7f62e2ffd700 1 -- 172.21.15.146:0/2505677357 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3145747341 0 0) 0x7f62e40ccf20 con 0x7f62e40ca070 2023-10-06T11:17:18.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.063+0000 7f62e3fff700 1 --2- 172.21.15.146:0/2505677357 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62e4157430 0x7f62e4157800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:18.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.063+0000 7f62e2ffd700 1 -- 172.21.15.146:0/2505677357 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62cc003570 con 0x7f62e40ca070 2023-10-06T11:17:18.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.063+0000 7f62e2ffd700 1 -- 172.21.15.146:0/2505677357 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3936636791 0 0) 0x7f62cc003570 con 0x7f62e40ca070 2023-10-06T11:17:18.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.063+0000 7f62e2ffd700 1 -- 172.21.15.146:0/2505677357 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62e4157430 msgr2=0x7f62e4157800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:18.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.063+0000 7f62e2ffd700 1 --2- 172.21.15.146:0/2505677357 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62e4157430 0x7f62e4157800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:18.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.063+0000 7f62e2ffd700 1 -- 172.21.15.146:0/2505677357 >> v1:172.21.15.151:6789/0 conn(0x7f62e40ab010 legacy=0x7f62e40ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:18.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.063+0000 7f62e2ffd700 1 -- 172.21.15.146:0/2505677357 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e40cd4e0 con 0x7f62e40ca070 2023-10-06T11:17:18.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.063+0000 7f62e2ffd700 1 -- 172.21.15.146:0/2505677357 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f62dc0017f0 con 0x7f62e40ca070 2023-10-06T11:17:18.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.063+0000 7f62e2ffd700 1 -- 172.21.15.146:0/2505677357 >> v1:172.21.15.146:6789/0 conn(0x7f62e40ca070 legacy=0x7f62e40cc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:18.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.063+0000 7f62e2ffd700 1 --2- 172.21.15.146:0/2505677357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62cc003a90 0x7f62cc003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:18.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.063+0000 7f62e2ffd700 1 --2- 172.21.15.146:0/2505677357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62cc004810 0x7f62cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:18.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.063+0000 7f62e2ffd700 1 --2- 172.21.15.146:0/2505677357 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62e4157430 0x7f62cc0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:18.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.063+0000 7f62e2ffd700 1 -- 172.21.15.146:0/2505677357 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e40ca4f0 con 0x7f62cc004810 2023-10-06T11:17:18.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.063+0000 7f62e2ffd700 1 -- 172.21.15.146:0/2505677357 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62cc00bb60 con 0x7f62cc003a90 2023-10-06T11:17:18.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.063+0000 7f62e2ffd700 1 -- 172.21.15.146:0/2505677357 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62cc00bd20 con 0x7f62e4157430 2023-10-06T11:17:18.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.063+0000 7f62e37fe700 1 --2- 172.21.15.146:0/2505677357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62cc004810 0x7f62cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:18.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.063+0000 7f62e3fff700 1 --2- 172.21.15.146:0/2505677357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62cc003a90 0x7f62cc003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:18.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.063+0000 7f62e8d61700 1 --2- 172.21.15.146:0/2505677357 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62e4157430 0x7f62cc0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:18.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.063+0000 7f62e37fe700 1 -- 172.21.15.146:0/2505677357 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62e4157430 msgr2=0x7f62cc0051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:18.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.063+0000 7f62e37fe700 1 --2- 172.21.15.146:0/2505677357 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62e4157430 0x7f62cc0051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:18.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.063+0000 7f62e37fe700 1 -- 172.21.15.146:0/2505677357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62cc003a90 msgr2=0x7f62cc003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:18.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.063+0000 7f62e37fe700 1 --2- 172.21.15.146:0/2505677357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62cc003a90 0x7f62cc003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:18.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.063+0000 7f62e37fe700 1 -- 172.21.15.146:0/2505677357 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62cc003570 con 0x7f62cc004810 2023-10-06T11:17:18.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.064+0000 7f62e37fe700 1 --2- 172.21.15.146:0/2505677357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62cc004810 0x7f62cc004c80 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7f62d80018b0 tx=0x7f62d8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2395dab7783dc758 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:18.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.064+0000 7f62e2ffd700 1 -- 172.21.15.146:0/2505677357 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d8012420 con 0x7f62cc004810 2023-10-06T11:17:18.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.064+0000 7f62e2ffd700 1 -- 172.21.15.146:0/2505677357 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d8012580 con 0x7f62cc004810 2023-10-06T11:17:18.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.064+0000 7f62e2ffd700 1 -- 172.21.15.146:0/2505677357 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d8012920 con 0x7f62cc004810 2023-10-06T11:17:18.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.064+0000 7f62ea7c4700 1 -- 172.21.15.146:0/2505677357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62cc004810 msgr2=0x7f62cc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:18.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.064+0000 7f62ea7c4700 1 --2- 172.21.15.146:0/2505677357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62cc004810 0x7f62cc004c80 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7f62d80018b0 tx=0x7f62d8007d30 comp rx=0 tx=0).stop 2023-10-06T11:17:18.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.064+0000 7f62e8d61700 1 -- 172.21.15.146:0/2505677357 reap_dead start 2023-10-06T11:17:18.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.064+0000 7f62ea7c4700 1 -- 172.21.15.146:0/2505677357 shutdown_connections 2023-10-06T11:17:18.070 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.064+0000 7f62ea7c4700 1 -- 172.21.15.146:0/2505677357 >> 172.21.15.146:0/2505677357 conn(0x7f62e4067c50 msgr2=0x7f62e40ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:18.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.064+0000 7f62ea7c4700 1 -- 172.21.15.146:0/2505677357 shutdown_connections 2023-10-06T11:17:18.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.064+0000 7f62ea7c4700 1 -- 172.21.15.146:0/2505677357 wait complete. 2023-10-06T11:17:18.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.065+0000 7f62ea7c4700 1 Processor -- start 2023-10-06T11:17:18.071 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.066+0000 7f62ea7c4700 1 -- start start 2023-10-06T11:17:18.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.066+0000 7f62ea7c4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62cc004810 0x7f62e40afe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:18.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.066+0000 7f62ea7c4700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62e40c5c30 0x7f62e40c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:18.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.066+0000 7f62ea7c4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62e4154100 0x7f62e40c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:18.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.066+0000 7f62ea7c4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e4098080 con 0x7f62e4154100 2023-10-06T11:17:18.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.066+0000 7f62ea7c4700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e40b25a0 con 0x7f62cc004810 2023-10-06T11:17:18.073 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.066+0000 7f62ea7c4700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e40b2270 con 0x7f62e40c5c30 2023-10-06T11:17:18.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.066+0000 7f62e8d61700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62e4154100 0x7f62e40c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:18.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.066+0000 7f62e8d61700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62e4154100 0x7f62e40c8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38848/0 (socket says 172.21.15.146:38848) 2023-10-06T11:17:18.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.066+0000 7f62e8d61700 1 -- 172.21.15.146:0/684412635 learned_addr learned my addr 172.21.15.146:0/684412635 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:18.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.066+0000 7f62e3fff700 1 --2- 172.21.15.146:0/684412635 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62cc004810 0x7f62e40afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:18.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.066+0000 7f62e37fe700 1 --2- 172.21.15.146:0/684412635 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62e40c5c30 0x7f62e40c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:18.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.067+0000 7f62e8d61700 1 -- 172.21.15.146:0/684412635 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62e40c5c30 msgr2=0x7f62e40c7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:18.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.067+0000 7f62e8d61700 1 --2- 172.21.15.146:0/684412635 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62e40c5c30 0x7f62e40c7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:18.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.067+0000 7f62e8d61700 1 -- 172.21.15.146:0/684412635 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62cc004810 msgr2=0x7f62e40afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:18.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.067+0000 7f62e8d61700 1 --2- 172.21.15.146:0/684412635 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62cc004810 0x7f62e40afe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:18.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.067+0000 7f62e8d61700 1 -- 172.21.15.146:0/684412635 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e40b07b0 con 0x7f62e4154100 2023-10-06T11:17:18.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.067+0000 7f62e8d61700 1 --2- 172.21.15.146:0/684412635 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62e4154100 0x7f62e40c8130 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f62e406eec0 tx=0x7f62dc0021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:18.074 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.067+0000 7f62cbfff700 1 -- 172.21.15.146:0/684412635 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc00ac30 con 0x7f62e4154100 2023-10-06T11:17:18.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.067+0000 7f62cbfff700 1 -- 172.21.15.146:0/684412635 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62dc00adb0 con 0x7f62e4154100 2023-10-06T11:17:18.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.067+0000 7f62ea7c4700 1 -- 172.21.15.146:0/684412635 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e40b0a90 con 0x7f62e4154100 2023-10-06T11:17:18.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.067+0000 7f62cbfff700 1 -- 172.21.15.146:0/684412635 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62dc013640 con 0x7f62e4154100 2023-10-06T11:17:18.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.067+0000 7f62ea7c4700 1 -- 172.21.15.146:0/684412635 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e40b0380 con 0x7f62e4154100 2023-10-06T11:17:18.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.068+0000 7f62ea7c4700 1 -- 172.21.15.146:0/684412635 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62e40b0570 con 0x7f62e4154100 2023-10-06T11:17:18.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.068+0000 7f62cbfff700 1 -- 172.21.15.146:0/684412635 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f62dc0139f0 con 0x7f62e4154100 2023-10-06T11:17:18.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.069+0000 7f62cbfff700 1 --2- 172.21.15.146:0/684412635 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f62d0066f30 0x7f62d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:18.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.069+0000 7f62cbfff700 1 -- 172.21.15.146:0/684412635 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f62dc084c60 con 0x7f62e4154100 2023-10-06T11:17:18.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.069+0000 7f62e3fff700 1 --2- 172.21.15.146:0/684412635 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f62d0066f30 0x7f62d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:18.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.069+0000 7f62e3fff700 1 --2- 172.21.15.146:0/684412635 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f62d0066f30 0x7f62d00693e0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f62d4006f00 tx=0x7f62d40091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:18.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.073+0000 7f62cbfff700 1 -- 172.21.15.146:0/684412635 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f62e40b0570 con 0x7f62e4154100 2023-10-06T11:17:18.300 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.299+0000 7f62ea7c4700 1 -- 172.21.15.146:0/684412635 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62e40b0570 con 0x7f62e4154100 2023-10-06T11:17:18.301 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.299+0000 7f62cbfff700 1 -- 172.21.15.146:0/684412635 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 123 v123) v1 ==== 95+0+3540 (secure 0 0 0) 0x7f62e40b0570 con 0x7f62e4154100 2023-10-06T11:17:18.301 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:18.301 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":123,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7181,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/255475004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":255475004},{"type":"v1","addr":"172.21.15.151:6834","nonce":255475004}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":116},{"gid":7184,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/206881843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":206881843},{"type":"v1","addr":"172.21.15.151:6835","nonce":206881843}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":116},{"gid":9192,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6835/3140231910","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3140231910},{"type":"v1","addr":"172.21.15.146:6835","nonce":3140231910}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":116},{"gid":9579,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/4129582569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6836","nonce":4129582569},{"type":"v1","addr":"172.21.15.146:6837","nonce":4129582569}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":123}],"filesystems":[]} 2023-10-06T11:17:18.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.301+0000 7f62ea7c4700 1 -- 172.21.15.146:0/684412635 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f62d0066f30 msgr2=0x7f62d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:18.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.301+0000 7f62ea7c4700 1 --2- 172.21.15.146:0/684412635 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f62d0066f30 0x7f62d00693e0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f62d4006f00 tx=0x7f62d40091a0 comp rx=0 tx=0).stop 2023-10-06T11:17:18.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.301+0000 7f62ea7c4700 1 -- 172.21.15.146:0/684412635 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62e4154100 msgr2=0x7f62e40c8130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:18.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.301+0000 7f62ea7c4700 1 --2- 172.21.15.146:0/684412635 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62e4154100 0x7f62e40c8130 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f62e406eec0 tx=0x7f62dc0021d0 comp rx=0 tx=0).stop 2023-10-06T11:17:18.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.301+0000 7f62ea7c4700 1 -- 172.21.15.146:0/684412635 shutdown_connections 2023-10-06T11:17:18.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.301+0000 7f62ea7c4700 1 --2- 172.21.15.146:0/684412635 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f62d0066f30 0x7f62d00693e0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:18.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.301+0000 7f62ea7c4700 1 --2- 172.21.15.146:0/684412635 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f62e4154100 0x7f62e40c8130 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:18.303 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.301+0000 7f62ea7c4700 1 --2- 172.21.15.146:0/684412635 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62cc004810 0x7f62e40afe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:18.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.301+0000 7f62ea7c4700 1 --2- 172.21.15.146:0/684412635 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f62e40c5c30 0x7f62e40c7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:18.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.301+0000 7f62ea7c4700 1 -- 172.21.15.146:0/684412635 >> 172.21.15.146:0/684412635 conn(0x7f62e4067c50 msgr2=0x7f62e4154e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:18.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.301+0000 7f62ea7c4700 1 -- 172.21.15.146:0/684412635 shutdown_connections 2023-10-06T11:17:18.304 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.301+0000 7f62ea7c4700 1 -- 172.21.15.146:0/684412635 wait complete. 2023-10-06T11:17:18.304 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 123 2023-10-06T11:17:18.315 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T11:17:18.315 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T11:17:18.316 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T11:17:18.316 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:17:18.316 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T11:17:18.316 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T11:17:18.316 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T11:17:18.317 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:17:18.317 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T11:17:18.317 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T11:17:18.317 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T11:17:18.317 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:17:18.317 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T11:17:18.317 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T11:17:18.318 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T11:17:18.318 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:17:18.325 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T11:17:18.325 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T11:17:18.326 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T11:17:18.326 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T11:17:18.328 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T11:17:18.328 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T11:17:18.329 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T11:17:18.329 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T11:17:18.367 INFO:tasks.ceph.mds.a:Started 2023-10-06T11:17:18.367 DEBUG:teuthology.parallel:result is None 2023-10-06T11:17:18.368 INFO:tasks.ceph.mds.c:Started 2023-10-06T11:17:18.368 DEBUG:teuthology.parallel:result is None 2023-10-06T11:17:18.371 INFO:tasks.ceph.mds.b:Started 2023-10-06T11:17:18.371 DEBUG:teuthology.parallel:result is None 2023-10-06T11:17:18.372 INFO:tasks.ceph.mds.d:Started 2023-10-06T11:17:18.372 DEBUG:teuthology.parallel:result is None 2023-10-06T11:17:18.372 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T11:17:18.440 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2023-10-06T11:17:18.441 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2023-10-06T11:17:18.451 INFO:tasks.ceph.mds.d.smithi151.stdout:starting mds.d at 2023-10-06T11:17:18.452 INFO:tasks.ceph.mds.b.smithi151.stdout:starting mds.b at 2023-10-06T11:17:18.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.492+0000 7f8f9b59e700 1 Processor -- start 2023-10-06T11:17:18.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.492+0000 7f8f9b59e700 1 -- start start 2023-10-06T11:17:18.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.493+0000 7f8f9b59e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f9c06a220 0x7f8f9c0c3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:18.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.493+0000 7f8f9b59e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8f9c0c3e70 0x7f8f9c067d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:18.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.493+0000 7f8f9b59e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f9c067880 con 0x7f8f9c069e50 2023-10-06T11:17:18.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.493+0000 7f8f9b59e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f9c06b190 con 0x7f8f9c0c3e70 2023-10-06T11:17:18.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.493+0000 7f8f9b59e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9c0c72a0 con 0x7f8f9c06a220 2023-10-06T11:17:18.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.493+0000 7f8f9ad9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8f9c0c3e70 0x7f8f9c067d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:18.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.493+0000 7f8f9a59c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8f9c069e50 0x7f8f9c06aa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40246/0 (socket says 172.21.15.146:40246) 2023-10-06T11:17:18.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.493+0000 7f8f9a59c700 1 -- 172.21.15.146:0/2162788964 learned_addr learned my addr 172.21.15.146:0/2162788964 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:17:18.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.493+0000 7f8f99d9b700 1 --2- 172.21.15.146:0/2162788964 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f9c06a220 0x7f8f9c0c3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:18.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.494+0000 7f8f9ad9d700 1 -- 172.21.15.146:0/2162788964 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f9c06a220 msgr2=0x7f8f9c0c3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:18.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.494+0000 7f8f9ad9d700 1 --2- 172.21.15.146:0/2162788964 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f9c06a220 0x7f8f9c0c3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:18.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.494+0000 7f8f9ad9d700 1 -- 172.21.15.146:0/2162788964 >> v1:172.21.15.146:6789/0 conn(0x7f8f9c069e50 legacy=0x7f8f9c06aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:18.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.494+0000 7f8f9ad9d700 1 -- 172.21.15.146:0/2162788964 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f9c0c7580 con 0x7f8f9c0c3e70 2023-10-06T11:17:18.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.494+0000 7f8f9959a700 1 -- 172.21.15.146:0/2162788964 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3886598061 0 0) 0x7f8f9c067880 con 0x7f8f9c069e50 2023-10-06T11:17:18.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.494+0000 7f8f9ad9d700 1 --2- 172.21.15.146:0/2162788964 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f9c0c3e70 0x7f8f9c067d10 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f8f94009e60 tx=0x7f8f94009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5807cd1470342652 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:18.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.494+0000 7f8f9959a700 1 -- 172.21.15.146:0/2162788964 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9400e070 con 0x7f8f9c0c3e70 2023-10-06T11:17:18.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.494+0000 7f8f9959a700 1 -- 172.21.15.146:0/2162788964 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f9400bb60 con 0x7f8f9c0c3e70 2023-10-06T11:17:18.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.494+0000 7f8f9959a700 1 -- 172.21.15.146:0/2162788964 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f94012430 con 0x7f8f9c0c3e70 2023-10-06T11:17:18.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.494+0000 7f8f9b59e700 1 -- 172.21.15.146:0/2162788964 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f9c0c3e70 msgr2=0x7f8f9c067d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:18.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.494+0000 7f8f9b59e700 1 --2- 172.21.15.146:0/2162788964 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f9c0c3e70 0x7f8f9c067d10 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f8f94009e60 tx=0x7f8f94009780 comp rx=0 tx=0).stop 2023-10-06T11:17:18.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.495+0000 7f8f9b59e700 1 -- 172.21.15.146:0/2162788964 shutdown_connections 2023-10-06T11:17:18.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.495+0000 7f8f9b59e700 1 --2- 172.21.15.146:0/2162788964 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f9c0c3e70 0x7f8f9c067d10 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:18.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.495+0000 7f8f9b59e700 1 --2- 172.21.15.146:0/2162788964 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f9c06a220 0x7f8f9c0c3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:18.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.495+0000 7f8f9b59e700 1 -- 172.21.15.146:0/2162788964 >> 172.21.15.146:0/2162788964 conn(0x7f8f9c0cd350 msgr2=0x7f8f9c0c92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:18.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.495+0000 7f8f9b59e700 1 -- 172.21.15.146:0/2162788964 shutdown_connections 2023-10-06T11:17:18.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.495+0000 7f8f9b59e700 1 -- 172.21.15.146:0/2162788964 wait complete. 2023-10-06T11:17:18.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.496+0000 7f8f9b59e700 1 Processor -- start 2023-10-06T11:17:18.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.496+0000 7f8f9b59e700 1 -- start start 2023-10-06T11:17:18.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.496+0000 7f8f9b59e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f9c069e50 0x7f8f9c0c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:18.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.496+0000 7f8f9b59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f9c06a220 0x7f8f9c0b1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:18.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.496+0000 7f8f9b59e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f9c0c3e70 0x7f8f9c159240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:18.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.496+0000 7f8f9b59e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9c0b13a0 con 0x7f8f9c06a220 2023-10-06T11:17:18.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.496+0000 7f8f9b59e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9c0b0790 con 0x7f8f9c0c3e70 2023-10-06T11:17:18.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.496+0000 7f8f9b59e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f9c0b0a70 con 0x7f8f9c069e50 2023-10-06T11:17:18.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.496+0000 7f8f99d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f9c06a220 0x7f8f9c0b1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:18.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.496+0000 7f8f99d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f9c06a220 0x7f8f9c0b1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38904/0 (socket says 172.21.15.146:38904) 2023-10-06T11:17:18.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.496+0000 7f8f99d9b700 1 -- 172.21.15.146:0/965186938 learned_addr learned my addr 172.21.15.146:0/965186938 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:18.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.497+0000 7f8f9a59c700 1 --2- 172.21.15.146:0/965186938 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f9c069e50 0x7f8f9c0c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:18.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.497+0000 7f8f9ad9d700 1 --2- 172.21.15.146:0/965186938 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f9c0c3e70 0x7f8f9c159240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:18.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.497+0000 7f8f99d9b700 1 -- 172.21.15.146:0/965186938 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f9c069e50 msgr2=0x7f8f9c0c44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:18.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.497+0000 7f8f99d9b700 1 --2- 172.21.15.146:0/965186938 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f9c069e50 0x7f8f9c0c44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:18.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.497+0000 7f8f99d9b700 1 -- 172.21.15.146:0/965186938 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f9c0c3e70 msgr2=0x7f8f9c159240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:18.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.497+0000 7f8f99d9b700 1 --2- 172.21.15.146:0/965186938 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f9c0c3e70 0x7f8f9c159240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:18.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.497+0000 7f8f99d9b700 1 -- 172.21.15.146:0/965186938 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f94009a20 con 0x7f8f9c06a220 2023-10-06T11:17:18.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.497+0000 7f8f99d9b700 1 --2- 172.21.15.146:0/965186938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f9c06a220 0x7f8f9c0b1830 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f8f9000ec80 tx=0x7f8f900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:18.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.497+0000 7f8f8a7fc700 1 -- 172.21.15.146:0/965186938 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9000c850 con 0x7f8f9c06a220 2023-10-06T11:17:18.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.497+0000 7f8f8a7fc700 1 -- 172.21.15.146:0/965186938 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f9000c9b0 con 0x7f8f9c06a220 2023-10-06T11:17:18.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.497+0000 7f8f9b59e700 1 -- 172.21.15.146:0/965186938 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f9c0b0d50 con 0x7f8f9c06a220 2023-10-06T11:17:18.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.497+0000 7f8f8a7fc700 1 -- 172.21.15.146:0/965186938 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f9000cd50 con 0x7f8f9c06a220 2023-10-06T11:17:18.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.497+0000 7f8f9b59e700 1 -- 172.21.15.146:0/965186938 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f9c0c4ab0 con 0x7f8f9c06a220 2023-10-06T11:17:18.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.498+0000 7f8f9b59e700 1 -- 172.21.15.146:0/965186938 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f9c0b1510 con 0x7f8f9c06a220 2023-10-06T11:17:18.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.498+0000 7f8f8a7fc700 1 -- 172.21.15.146:0/965186938 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8f90013680 con 0x7f8f9c06a220 2023-10-06T11:17:18.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.499+0000 7f8f8a7fc700 1 --2- 172.21.15.146:0/965186938 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8f7c066f30 0x7f8f7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:18.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.499+0000 7f8f8a7fc700 1 -- 172.21.15.146:0/965186938 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f8f90084610 con 0x7f8f9c06a220 2023-10-06T11:17:18.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.499+0000 7f8f9a59c700 1 --2- 172.21.15.146:0/965186938 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8f7c066f30 0x7f8f7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:18.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.499+0000 7f8f9a59c700 1 --2- 172.21.15.146:0/965186938 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8f7c066f30 0x7f8f7c0693e0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c007fd0 tx=0x7f8f8c007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:18.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.503+0000 7f8f8a7fc700 1 -- 172.21.15.146:0/965186938 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8f90051a20 con 0x7f8f9c06a220 2023-10-06T11:17:18.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:18.703+0000 7f8f9b59e700 1 -- 172.21.15.146:0/965186938 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f8f9c04bb40 con 0x7f8f9c06a220 2023-10-06T11:17:19.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.535+0000 7f8f8a7fc700 1 -- 172.21.15.146:0/965186938 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v147) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8f90055040 con 0x7f8f9c06a220 2023-10-06T11:17:19.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.537+0000 7f8f9b59e700 1 -- 172.21.15.146:0/965186938 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8f7c066f30 msgr2=0x7f8f7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:19.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.537+0000 7f8f9b59e700 1 --2- 172.21.15.146:0/965186938 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8f7c066f30 0x7f8f7c0693e0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c007fd0 tx=0x7f8f8c007d30 comp rx=0 tx=0).stop 2023-10-06T11:17:19.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.537+0000 7f8f9b59e700 1 -- 172.21.15.146:0/965186938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f9c06a220 msgr2=0x7f8f9c0b1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:19.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.537+0000 7f8f9b59e700 1 --2- 172.21.15.146:0/965186938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f9c06a220 0x7f8f9c0b1830 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f8f9000ec80 tx=0x7f8f900091a0 comp rx=0 tx=0).stop 2023-10-06T11:17:19.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.537+0000 7f8f9b59e700 1 -- 172.21.15.146:0/965186938 shutdown_connections 2023-10-06T11:17:19.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.538+0000 7f8f9b59e700 1 --2- 172.21.15.146:0/965186938 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8f7c066f30 0x7f8f7c0693e0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:19.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.538+0000 7f8f9b59e700 1 --2- 172.21.15.146:0/965186938 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f9c0c3e70 0x7f8f9c159240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:19.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.538+0000 7f8f9b59e700 1 --2- 172.21.15.146:0/965186938 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f9c069e50 0x7f8f9c0c44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:19.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.538+0000 7f8f9b59e700 1 --2- 172.21.15.146:0/965186938 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8f9c06a220 0x7f8f9c0b1830 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:19.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.538+0000 7f8f9b59e700 1 -- 172.21.15.146:0/965186938 >> 172.21.15.146:0/965186938 conn(0x7f8f9c0cd350 msgr2=0x7f8f9c0ca780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:19.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.538+0000 7f8f9b59e700 1 -- 172.21.15.146:0/965186938 shutdown_connections 2023-10-06T11:17:19.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.538+0000 7f8f9b59e700 1 -- 172.21.15.146:0/965186938 wait complete. 2023-10-06T11:17:19.542 INFO:teuthology.orchestra.run.smithi146.stderr: removed all blocklist entries 2023-10-06T11:17:19.552 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T11:17:19.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.666+0000 7f237d47b700 1 Processor -- start 2023-10-06T11:17:19.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.666+0000 7f237d47b700 1 -- start start 2023-10-06T11:17:19.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.667+0000 7f237d47b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f23780b3770 0x7f23780b1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:19.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.667+0000 7f237d47b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23780ae100 con 0x7f237806f780 2023-10-06T11:17:19.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.667+0000 7f237d47b700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23780d0f10 con 0x7f237815cbd0 2023-10-06T11:17:19.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.667+0000 7f237d47b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23780d11f0 con 0x7f23780b3770 2023-10-06T11:17:19.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.667+0000 7f23777fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f23780b3770 0x7f23780b1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:19.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.667+0000 7f237cc7a700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f237806f780 0x7f23781633d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40248/0 (socket says 172.21.15.146:40248) 2023-10-06T11:17:19.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.667+0000 7f237cc7a700 1 -- 172.21.15.146:0/560330411 learned_addr learned my addr 172.21.15.146:0/560330411 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:17:19.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.667+0000 7f23777fe700 1 -- 172.21.15.146:0/560330411 >> v1:172.21.15.151:6789/0 conn(0x7f237815cbd0 legacy=0x7f23780b0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:19.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.667+0000 7f23777fe700 1 -- 172.21.15.146:0/560330411 >> v1:172.21.15.146:6789/0 conn(0x7f237806f780 legacy=0x7f23781633d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:19.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.667+0000 7f23777fe700 1 -- 172.21.15.146:0/560330411 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23780ae350 con 0x7f23780b3770 2023-10-06T11:17:19.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.667+0000 7f2376ffd700 1 -- 172.21.15.146:0/560330411 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1299096261 0 0) 0x7f23780ae100 con 0x7f237806f780 2023-10-06T11:17:19.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.667+0000 7f23777fe700 1 --2- 172.21.15.146:0/560330411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23780b3770 0x7f23780b1240 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f23680098e0 tx=0x7f23680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f755a2a1d0fdb8ab server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:19.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.667+0000 7f2376ffd700 1 -- 172.21.15.146:0/560330411 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2368009e80 con 0x7f23780b3770 2023-10-06T11:17:19.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.667+0000 7f2376ffd700 1 -- 172.21.15.146:0/560330411 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f236800b860 con 0x7f23780b3770 2023-10-06T11:17:19.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.667+0000 7f2376ffd700 1 -- 172.21.15.146:0/560330411 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236800bbe0 con 0x7f23780b3770 2023-10-06T11:17:19.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.668+0000 7f237d47b700 1 -- 172.21.15.146:0/560330411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23780b3770 msgr2=0x7f23780b1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:19.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.668+0000 7f237d47b700 1 --2- 172.21.15.146:0/560330411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23780b3770 0x7f23780b1240 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f23680098e0 tx=0x7f23680091a0 comp rx=0 tx=0).stop 2023-10-06T11:17:19.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.668+0000 7f237d47b700 1 -- 172.21.15.146:0/560330411 shutdown_connections 2023-10-06T11:17:19.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.668+0000 7f237d47b700 1 --2- 172.21.15.146:0/560330411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f23780b3770 0x7f23780b1240 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:19.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.668+0000 7f237d47b700 1 -- 172.21.15.146:0/560330411 >> 172.21.15.146:0/560330411 conn(0x7f237806f380 msgr2=0x7f23780d0660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:19.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.668+0000 7f237d47b700 1 -- 172.21.15.146:0/560330411 shutdown_connections 2023-10-06T11:17:19.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.668+0000 7f237d47b700 1 -- 172.21.15.146:0/560330411 wait complete. 2023-10-06T11:17:19.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.669+0000 7f237d47b700 1 Processor -- start 2023-10-06T11:17:19.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.669+0000 7f237d47b700 1 -- start start 2023-10-06T11:17:19.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.670+0000 7f237d47b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f237806f780 0x7f237814e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:19.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.670+0000 7f237d47b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23780b3770 0x7f23780b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:19.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.670+0000 7f237d47b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f237815cbd0 0x7f237815d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:19.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.670+0000 7f237d47b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23781551d0 con 0x7f237806f780 2023-10-06T11:17:19.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.670+0000 7f237d47b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f237814eb60 con 0x7f237815cbd0 2023-10-06T11:17:19.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.670+0000 7f237d47b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23781545c0 con 0x7f23780b3770 2023-10-06T11:17:19.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.670+0000 7f2377fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f237806f780 0x7f237814e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:19.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.670+0000 7f2377fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f237806f780 0x7f237814e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38916/0 (socket says 172.21.15.146:38916) 2023-10-06T11:17:19.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.670+0000 7f2377fff700 1 -- 172.21.15.146:0/2589217730 learned_addr learned my addr 172.21.15.146:0/2589217730 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:19.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.670+0000 7f237cc7a700 1 --2- 172.21.15.146:0/2589217730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f237815cbd0 0x7f237815d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:19.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.670+0000 7f23777fe700 1 --2- 172.21.15.146:0/2589217730 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23780b3770 0x7f23780b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:19.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.670+0000 7f2377fff700 1 -- 172.21.15.146:0/2589217730 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23780b3770 msgr2=0x7f23780b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:19.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.670+0000 7f2377fff700 1 --2- 172.21.15.146:0/2589217730 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23780b3770 0x7f23780b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:19.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.670+0000 7f2377fff700 1 -- 172.21.15.146:0/2589217730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f237815cbd0 msgr2=0x7f237815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:19.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.670+0000 7f2377fff700 1 --2- 172.21.15.146:0/2589217730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f237815cbd0 0x7f237815d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:19.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.670+0000 7f2377fff700 1 -- 172.21.15.146:0/2589217730 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2368009420 con 0x7f237806f780 2023-10-06T11:17:19.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.670+0000 7f2377fff700 1 --2- 172.21.15.146:0/2589217730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f237806f780 0x7f237814e620 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7f236c00c4e0 tx=0x7f236c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:19.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.671+0000 7f235ffff700 1 -- 172.21.15.146:0/2589217730 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236c011590 con 0x7f237806f780 2023-10-06T11:17:19.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.671+0000 7f235ffff700 1 -- 172.21.15.146:0/2589217730 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f236c011710 con 0x7f237806f780 2023-10-06T11:17:19.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.671+0000 7f235ffff700 1 -- 172.21.15.146:0/2589217730 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236c011ad0 con 0x7f237806f780 2023-10-06T11:17:19.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.671+0000 7f237d47b700 1 -- 172.21.15.146:0/2589217730 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23781548a0 con 0x7f237806f780 2023-10-06T11:17:19.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.671+0000 7f237d47b700 1 -- 172.21.15.146:0/2589217730 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2378154e60 con 0x7f237806f780 2023-10-06T11:17:19.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.671+0000 7f237d47b700 1 -- 172.21.15.146:0/2589217730 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23781554b0 con 0x7f237806f780 2023-10-06T11:17:19.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.672+0000 7f235ffff700 1 -- 172.21.15.146:0/2589217730 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f236c01b3b0 con 0x7f237806f780 2023-10-06T11:17:19.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.672+0000 7f235ffff700 1 --2- 172.21.15.146:0/2589217730 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2364066f30 0x7f23640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:19.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.672+0000 7f235ffff700 1 -- 172.21.15.146:0/2589217730 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f236c083870 con 0x7f237806f780 2023-10-06T11:17:19.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.672+0000 7f23777fe700 1 --2- 172.21.15.146:0/2589217730 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2364066f30 0x7f23640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:19.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.673+0000 7f23777fe700 1 --2- 172.21.15.146:0/2589217730 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2364066f30 0x7f23640693e0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f23680093f0 tx=0x7f2368017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:19.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.676+0000 7f235ffff700 1 -- 172.21.15.146:0/2589217730 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f236c050cd0 con 0x7f237806f780 2023-10-06T11:17:19.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.934+0000 7f237d47b700 1 -- 172.21.15.146:0/2589217730 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f2378088170 con 0x7f237806f780 2023-10-06T11:17:19.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.934+0000 7f235ffff700 1 -- 172.21.15.146:0/2589217730 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f236c017070 con 0x7f237806f780 2023-10-06T11:17:19.936 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:19.936 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:17:19.937 INFO:teuthology.orchestra.run.smithi146.stdout: "auth_dump": [ 2023-10-06T11:17:19.937 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:17:19.937 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.a", 2023-10-06T11:17:19.937 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lG4F8DBAAp5A4Dtfzvv8n9ORgkmiP9g==", 2023-10-06T11:17:19.937 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:17:19.937 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:17:19.937 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:17:19.937 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:17:19.937 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:17:19.937 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:17:19.937 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:17:19.937 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:17:19.937 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.b", 2023-10-06T11:17:19.938 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lDIceGBAA4cr0oGVaXiy5hrruKY5DGw==", 2023-10-06T11:17:19.938 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:17:19.938 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:17:19.938 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:17:19.938 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:17:19.938 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:17:19.938 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:17:19.938 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:17:19.938 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:17:19.938 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.c", 2023-10-06T11:17:19.938 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lbYA7ExAAAopKjS7+WMUE5fuVQygILQ==", 2023-10-06T11:17:19.939 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:17:19.939 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:17:19.939 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:17:19.939 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:17:19.939 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:17:19.939 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:17:19.939 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:17:19.939 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:17:19.939 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.d", 2023-10-06T11:17:19.939 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9laygiHxAAasUUn7Wk9EwLa36ggsZtHw==", 2023-10-06T11:17:19.939 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:17:19.939 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:17:19.939 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:17:19.940 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:17:19.940 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:17:19.940 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:17:19.940 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:17:19.940 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:17:19.940 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.0", 2023-10-06T11:17:19.940 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDX6R9lLGo9NhAAcWJuUeOdEUsdDw84W9nLPw==", 2023-10-06T11:17:19.940 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:17:19.940 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:17:19.940 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:17:19.940 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:17:19.940 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:17:19.941 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:17:19.941 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:17:19.941 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.1", 2023-10-06T11:17:19.941 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDa6R9lk02gNBAA9YqWT2/Xds20lv0sGtBApg==", 2023-10-06T11:17:19.941 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:17:19.941 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:17:19.941 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:17:19.941 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:17:19.941 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:17:19.941 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:17:19.941 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:17:19.941 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.2", 2023-10-06T11:17:19.941 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDd6R9lrA6xMxAAmH8r6m2p4Jpa82xfYNcq+g==", 2023-10-06T11:17:19.942 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:17:19.942 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:17:19.942 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:17:19.942 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:17:19.942 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:17:19.942 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:17:19.942 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:17:19.942 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.3", 2023-10-06T11:17:19.942 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDg6R9ltlHXNBAAvhfI1yjlaWCIE9Xr/4F/PA==", 2023-10-06T11:17:19.942 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:17:19.942 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:17:19.942 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:17:19.942 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:17:19.943 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:17:19.943 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:17:19.943 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:17:19.943 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.4", 2023-10-06T11:17:19.943 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDm6R9lPUCvMhAAGbUNfpoFi9SvYdelpnL1jA==", 2023-10-06T11:17:19.943 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:17:19.943 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:17:19.943 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:17:19.943 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:17:19.943 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:17:19.943 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:17:19.943 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:17:19.943 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.5", 2023-10-06T11:17:19.943 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDp6R9lMfrMMBAAUEtnXDNr7+L3dQm4QE9qDw==", 2023-10-06T11:17:19.944 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:17:19.944 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:17:19.944 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:17:19.944 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:17:19.944 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:17:19.944 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:17:19.944 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:17:19.944 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.6", 2023-10-06T11:17:19.944 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDs6R9lAmSDMBAArPp+6dVt/NyH9is46tL49g==", 2023-10-06T11:17:19.944 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:17:19.945 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:17:19.945 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:17:19.945 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:17:19.945 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:17:19.945 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:17:19.945 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:17:19.945 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.7", 2023-10-06T11:17:19.945 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDv6R9lnunMLRAA3o5ZtAyYDUoXTzjX9H8FCw==", 2023-10-06T11:17:19.945 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:17:19.945 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:17:19.945 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:17:19.945 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:17:19.946 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:17:19.946 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:17:19.946 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:17:19.946 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.0", 2023-10-06T11:17:19.946 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lCrPrIhAARrzj2VxVFkzF5L/ifIAqmw==", 2023-10-06T11:17:19.946 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:17:19.946 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:17:19.946 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow r", 2023-10-06T11:17:19.946 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T11:17:19.946 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:17:19.946 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:17:19.946 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:17:19.946 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.1", 2023-10-06T11:17:19.947 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9l10VSKxAA0HmXejgRRCQ7XpsMB7ljkQ==", 2023-10-06T11:17:19.947 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:17:19.947 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:17:19.947 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2023-10-06T11:17:19.947 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2023-10-06T11:17:19.947 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2023-10-06T11:17:19.947 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:17:19.947 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:17:19.947 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:17:19.947 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.2", 2023-10-06T11:17:19.947 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lpLpJKBAAF/vLDkBg9/VBqMK4pVVIkg==", 2023-10-06T11:17:19.947 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:17:19.948 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:17:19.948 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2023-10-06T11:17:19.948 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2023-10-06T11:17:19.948 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2023-10-06T11:17:19.948 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:17:19.948 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:17:19.948 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:17:19.948 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.3", 2023-10-06T11:17:19.948 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9luMqwMBAA4Y4I9hWTk2IqAzYwVQ13Pw==", 2023-10-06T11:17:19.948 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:17:19.948 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:17:19.948 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2023-10-06T11:17:19.949 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2023-10-06T11:17:19.949 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2023-10-06T11:17:19.949 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:17:19.949 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:17:19.949 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:17:19.949 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.admin", 2023-10-06T11:17:19.949 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDT6R9lSr9qIhAAiNEN9xFWUwFGsB+oUE1cXw==", 2023-10-06T11:17:19.949 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:17:19.949 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2023-10-06T11:17:19.949 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:17:19.949 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:17:19.949 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:17:19.949 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:17:19.950 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:17:19.950 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:17:19.950 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.x", 2023-10-06T11:17:19.950 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9llLpwCRAA4UH9Uqli2de9HIJR2fZ9xg==", 2023-10-06T11:17:19.950 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:17:19.950 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2023-10-06T11:17:19.950 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2023-10-06T11:17:19.950 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:17:19.950 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:17:19.950 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:17:19.950 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:17:19.950 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.y", 2023-10-06T11:17:19.951 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDT6R9l2uQxNxAAVSMhKVzbf2vC4opL7YCLdg==", 2023-10-06T11:17:19.951 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:17:19.951 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2023-10-06T11:17:19.951 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2023-10-06T11:17:19.951 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:17:19.951 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:17:19.951 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:17:19.951 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2023-10-06T11:17:19.951 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:17:19.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.936+0000 7f237d47b700 1 -- 172.21.15.146:0/2589217730 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2364066f30 msgr2=0x7f23640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:19.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.936+0000 7f237d47b700 1 --2- 172.21.15.146:0/2589217730 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2364066f30 0x7f23640693e0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f23680093f0 tx=0x7f2368017000 comp rx=0 tx=0).stop 2023-10-06T11:17:19.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.936+0000 7f237d47b700 1 -- 172.21.15.146:0/2589217730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f237806f780 msgr2=0x7f237814e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:19.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.936+0000 7f237d47b700 1 --2- 172.21.15.146:0/2589217730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f237806f780 0x7f237814e620 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7f236c00c4e0 tx=0x7f236c00c8a0 comp rx=0 tx=0).stop 2023-10-06T11:17:19.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.936+0000 7f237d47b700 1 -- 172.21.15.146:0/2589217730 shutdown_connections 2023-10-06T11:17:19.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.936+0000 7f237d47b700 1 --2- 172.21.15.146:0/2589217730 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2364066f30 0x7f23640693e0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:19.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.936+0000 7f237d47b700 1 --2- 172.21.15.146:0/2589217730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f237815cbd0 0x7f237815d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:19.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.936+0000 7f237d47b700 1 --2- 172.21.15.146:0/2589217730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f237806f780 0x7f237814e620 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:19.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.936+0000 7f237d47b700 1 --2- 172.21.15.146:0/2589217730 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23780b3770 0x7f23780b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:19.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.936+0000 7f237d47b700 1 -- 172.21.15.146:0/2589217730 >> 172.21.15.146:0/2589217730 conn(0x7f237806f380 msgr2=0x7f23780ad0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:19.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.937+0000 7f237d47b700 1 -- 172.21.15.146:0/2589217730 shutdown_connections 2023-10-06T11:17:19.954 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:19.937+0000 7f237d47b700 1 -- 172.21.15.146:0/2589217730 wait complete. 2023-10-06T11:17:19.954 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:17:20.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.067+0000 7fd2d558b700 1 Processor -- start 2023-10-06T11:17:20.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.067+0000 7fd2d558b700 1 -- start start 2023-10-06T11:17:20.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.068+0000 7fd2d558b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd2d015a420 0x7fd2d015cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:20.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.068+0000 7fd2d558b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2d015c630 con 0x7fd2d015a7f0 2023-10-06T11:17:20.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.068+0000 7fd2d558b700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2d015ba20 con 0x7fd2d00b2530 2023-10-06T11:17:20.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.068+0000 7fd2d558b700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2d00ce040 con 0x7fd2d015a420 2023-10-06T11:17:20.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.068+0000 7fd2cf7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd2d015a7f0 0x7fd2d00b1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40264/0 (socket says 172.21.15.146:40264) 2023-10-06T11:17:20.075 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.068+0000 7fd2cf7fe700 1 -- 172.21.15.146:0/3195941054 learned_addr learned my addr 172.21.15.146:0/3195941054 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:17:20.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.068+0000 7fd2cffff700 1 --2- 172.21.15.146:0/3195941054 >> v2:172.21.15.151:3300/0 conn(0x7fd2d015a420 0x7fd2d015cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:20.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.068+0000 7fd2ceffd700 1 -- 172.21.15.146:0/3195941054 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 779867929 0 0) 0x7fd2d015c630 con 0x7fd2d015a7f0 2023-10-06T11:17:20.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.068+0000 7fd2ceffd700 1 -- 172.21.15.146:0/3195941054 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2b8003570 con 0x7fd2d015a7f0 2023-10-06T11:17:20.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.069+0000 7fd2ceffd700 1 -- 172.21.15.146:0/3195941054 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 857191632 0 0) 0x7fd2d015ba20 con 0x7fd2d00b2530 2023-10-06T11:17:20.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.069+0000 7fd2ceffd700 1 -- 172.21.15.146:0/3195941054 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2d015c630 con 0x7fd2d00b2530 2023-10-06T11:17:20.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.069+0000 7fd2ceffd700 1 -- 172.21.15.146:0/3195941054 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 949651356 0 0) 0x7fd2b8003570 con 0x7fd2d015a7f0 2023-10-06T11:17:20.076 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.069+0000 7fd2ceffd700 1 -- 172.21.15.146:0/3195941054 >> v2:172.21.15.151:3300/0 conn(0x7fd2d015a420 msgr2=0x7fd2d015cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:20.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.069+0000 7fd2ceffd700 1 --2- 172.21.15.146:0/3195941054 >> v2:172.21.15.151:3300/0 conn(0x7fd2d015a420 0x7fd2d015cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:20.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.069+0000 7fd2ceffd700 1 -- 172.21.15.146:0/3195941054 >> v1:172.21.15.151:6789/0 conn(0x7fd2d00b2530 legacy=0x7fd2d015acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:20.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.069+0000 7fd2ceffd700 1 -- 172.21.15.146:0/3195941054 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d015bd00 con 0x7fd2d015a7f0 2023-10-06T11:17:20.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.069+0000 7fd2ceffd700 1 -- 172.21.15.146:0/3195941054 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fd2c4001470 con 0x7fd2d015a7f0 2023-10-06T11:17:20.077 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.069+0000 7fd2cffff700 1 --2- 172.21.15.146:0/3195941054 >> v2:172.21.15.151:3300/0 conn(0x7fd2d015a420 0x7fd2d015cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:17:20.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.069+0000 7fd2ceffd700 1 -- 172.21.15.146:0/3195941054 >> v1:172.21.15.146:6789/0 conn(0x7fd2d015a7f0 legacy=0x7fd2d00b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:20.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.069+0000 7fd2ceffd700 1 --2- 172.21.15.146:0/3195941054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2b8003bf0 0x7fd2b8003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:20.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.069+0000 7fd2ceffd700 1 --2- 172.21.15.146:0/3195941054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2b8004810 0x7fd2b8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:20.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.069+0000 7fd2ceffd700 1 --2- 172.21.15.146:0/3195941054 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2b80051c0 0x7fd2b800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:20.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.069+0000 7fd2ceffd700 1 -- 172.21.15.146:0/3195941054 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b800c080 con 0x7fd2b8003bf0 2023-10-06T11:17:20.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.069+0000 7fd2ceffd700 1 -- 172.21.15.146:0/3195941054 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b800c1f0 con 0x7fd2b8004810 2023-10-06T11:17:20.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.069+0000 7fd2ceffd700 1 -- 172.21.15.146:0/3195941054 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b800c3b0 con 0x7fd2b80051c0 2023-10-06T11:17:20.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.069+0000 7fd2cffff700 1 --2- 172.21.15.146:0/3195941054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2b8003bf0 0x7fd2b8003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:20.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.069+0000 7fd2cf7fe700 1 --2- 172.21.15.146:0/3195941054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2b8004810 0x7fd2b8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:20.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.069+0000 7fd2d4d8a700 1 --2- 172.21.15.146:0/3195941054 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2b80051c0 0x7fd2b800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:20.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.069+0000 7fd2cffff700 1 -- 172.21.15.146:0/3195941054 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2b80051c0 msgr2=0x7fd2b800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:20.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.069+0000 7fd2cffff700 1 --2- 172.21.15.146:0/3195941054 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2b80051c0 0x7fd2b800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:20.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.069+0000 7fd2cffff700 1 -- 172.21.15.146:0/3195941054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2b8004810 msgr2=0x7fd2b8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:20.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.069+0000 7fd2cffff700 1 --2- 172.21.15.146:0/3195941054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2b8004810 0x7fd2b8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:20.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.069+0000 7fd2d4d8a700 1 -- 172.21.15.146:0/3195941054 reap_dead start 2023-10-06T11:17:20.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.069+0000 7fd2cffff700 1 -- 172.21.15.146:0/3195941054 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b8003570 con 0x7fd2b8003bf0 2023-10-06T11:17:20.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.069+0000 7fd2cffff700 1 --2- 172.21.15.146:0/3195941054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2b8003bf0 0x7fd2b8003fe0 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0009df0 tx=0x7fd2c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a742e2f3137aac00 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:20.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.069+0000 7fd2ceffd700 1 -- 172.21.15.146:0/3195941054 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c0009740 con 0x7fd2b8003bf0 2023-10-06T11:17:20.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.069+0000 7fd2ceffd700 1 -- 172.21.15.146:0/3195941054 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c000e920 con 0x7fd2b8003bf0 2023-10-06T11:17:20.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.069+0000 7fd2ceffd700 1 -- 172.21.15.146:0/3195941054 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c000ece0 con 0x7fd2b8003bf0 2023-10-06T11:17:20.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.070+0000 7fd2d558b700 1 -- 172.21.15.146:0/3195941054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2b8003bf0 msgr2=0x7fd2b8003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:20.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.070+0000 7fd2d558b700 1 --2- 172.21.15.146:0/3195941054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2b8003bf0 0x7fd2b8003fe0 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0009df0 tx=0x7fd2c00091a0 comp rx=0 tx=0).stop 2023-10-06T11:17:20.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.070+0000 7fd2d558b700 1 -- 172.21.15.146:0/3195941054 shutdown_connections 2023-10-06T11:17:20.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.070+0000 7fd2d558b700 1 --2- 172.21.15.146:0/3195941054 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2b8003bf0 0x7fd2b8003fe0 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:20.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.070+0000 7fd2d558b700 1 -- 172.21.15.146:0/3195941054 >> 172.21.15.146:0/3195941054 conn(0x7fd2d006eba0 msgr2=0x7fd2d006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:20.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.070+0000 7fd2d558b700 1 -- 172.21.15.146:0/3195941054 shutdown_connections 2023-10-06T11:17:20.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.070+0000 7fd2d558b700 1 -- 172.21.15.146:0/3195941054 wait complete. 2023-10-06T11:17:20.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.071+0000 7fd2d558b700 1 Processor -- start 2023-10-06T11:17:20.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.071+0000 7fd2d558b700 1 -- start start 2023-10-06T11:17:20.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.072+0000 7fd2d558b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2b8003bf0 0x7fd2d0147ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:20.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.072+0000 7fd2d558b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2d0150340 0x7fd2d016a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:20.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.072+0000 7fd2d558b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2d0148730 0x7fd2d014aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:20.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.072+0000 7fd2d558b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d016a2f0 con 0x7fd2d0150340 2023-10-06T11:17:20.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.072+0000 7fd2d558b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d0169d20 con 0x7fd2d0148730 2023-10-06T11:17:20.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.072+0000 7fd2d558b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d01490b0 con 0x7fd2b8003bf0 2023-10-06T11:17:20.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.072+0000 7fd2cf7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2d0150340 0x7fd2d016a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:20.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.072+0000 7fd2cf7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2d0150340 0x7fd2d016a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38926/0 (socket says 172.21.15.146:38926) 2023-10-06T11:17:20.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.072+0000 7fd2cf7fe700 1 -- 172.21.15.146:0/3295886676 learned_addr learned my addr 172.21.15.146:0/3295886676 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:20.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.072+0000 7fd2cf7fe700 1 -- 172.21.15.146:0/3295886676 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2b8003bf0 msgr2=0x7fd2d0147ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:20.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.072+0000 7fd2cf7fe700 1 --2- 172.21.15.146:0/3295886676 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2b8003bf0 0x7fd2d0147ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:20.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.072+0000 7fd2cf7fe700 1 -- 172.21.15.146:0/3295886676 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2d0148730 msgr2=0x7fd2d014aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:20.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.072+0000 7fd2cf7fe700 1 --2- 172.21.15.146:0/3295886676 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2d0148730 0x7fd2d014aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:20.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.072+0000 7fd2cf7fe700 1 -- 172.21.15.146:0/3295886676 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d0149390 con 0x7fd2d0150340 2023-10-06T11:17:20.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.072+0000 7fd2cf7fe700 1 --2- 172.21.15.146:0/3295886676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2d0150340 0x7fd2d016a780 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7fd2c4000fd0 tx=0x7fd2c4001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:20.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.073+0000 7fd2b7fff700 1 -- 172.21.15.146:0/3295886676 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c4018030 con 0x7fd2d0150340 2023-10-06T11:17:20.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.073+0000 7fd2b7fff700 1 -- 172.21.15.146:0/3295886676 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2c400f8d0 con 0x7fd2d0150340 2023-10-06T11:17:20.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.073+0000 7fd2d558b700 1 -- 172.21.15.146:0/3295886676 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2d0169f80 con 0x7fd2d0150340 2023-10-06T11:17:20.084 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.073+0000 7fd2b7fff700 1 -- 172.21.15.146:0/3295886676 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c400fc90 con 0x7fd2d0150340 2023-10-06T11:17:20.085 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.073+0000 7fd2d558b700 1 -- 172.21.15.146:0/3295886676 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2d0148bb0 con 0x7fd2d0150340 2023-10-06T11:17:20.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.074+0000 7fd2d558b700 1 -- 172.21.15.146:0/3295886676 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2d00afae0 con 0x7fd2d0150340 2023-10-06T11:17:20.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.074+0000 7fd2b7fff700 1 -- 172.21.15.146:0/3295886676 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd2c401b070 con 0x7fd2d0150340 2023-10-06T11:17:20.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.074+0000 7fd2b7fff700 1 --2- 172.21.15.146:0/3295886676 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd2bc066f30 0x7fd2bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:20.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.074+0000 7fd2b7fff700 1 -- 172.21.15.146:0/3295886676 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fd2c4019070 con 0x7fd2d0150340 2023-10-06T11:17:20.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.074+0000 7fd2cffff700 1 --2- 172.21.15.146:0/3295886676 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd2bc066f30 0x7fd2bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:20.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.075+0000 7fd2cffff700 1 --2- 172.21.15.146:0/3295886676 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd2bc066f30 0x7fd2bc0693e0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fd2d00b2290 tx=0x7fd2c001a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:20.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.079+0000 7fd2b7fff700 1 -- 172.21.15.146:0/3295886676 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd2c40516f0 con 0x7fd2d0150340 2023-10-06T11:17:20.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.264+0000 7fd2d558b700 1 -- 172.21.15.146:0/3295886676 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd2d016a430 con 0x7fd2d0150340 2023-10-06T11:17:20.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.265+0000 7fd2b7fff700 1 -- 172.21.15.146:0/3295886676 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v147) v1 ==== 74+0+13708 (secure 0 0 0) 0x7fd2c400fdf0 con 0x7fd2d0150340 2023-10-06T11:17:20.267 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:20.267 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":147,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:17:19.533585+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:17:20.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.267+0000 7fd2d558b700 1 -- 172.21.15.146:0/3295886676 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd2bc066f30 msgr2=0x7fd2bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:20.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.267+0000 7fd2d558b700 1 --2- 172.21.15.146:0/3295886676 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd2bc066f30 0x7fd2bc0693e0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fd2d00b2290 tx=0x7fd2c001a000 comp rx=0 tx=0).stop 2023-10-06T11:17:20.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.267+0000 7fd2d558b700 1 -- 172.21.15.146:0/3295886676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2d0150340 msgr2=0x7fd2d016a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:20.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.267+0000 7fd2d558b700 1 --2- 172.21.15.146:0/3295886676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2d0150340 0x7fd2d016a780 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7fd2c4000fd0 tx=0x7fd2c4001e10 comp rx=0 tx=0).stop 2023-10-06T11:17:20.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.267+0000 7fd2d558b700 1 -- 172.21.15.146:0/3295886676 shutdown_connections 2023-10-06T11:17:20.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.267+0000 7fd2d558b700 1 --2- 172.21.15.146:0/3295886676 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd2bc066f30 0x7fd2bc0693e0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:20.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.267+0000 7fd2d558b700 1 --2- 172.21.15.146:0/3295886676 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2d0148730 0x7fd2d014aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:20.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.267+0000 7fd2d558b700 1 --2- 172.21.15.146:0/3295886676 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2b8003bf0 0x7fd2d0147ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:20.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.267+0000 7fd2d558b700 1 --2- 172.21.15.146:0/3295886676 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd2d0150340 0x7fd2d016a780 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:20.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.267+0000 7fd2d558b700 1 -- 172.21.15.146:0/3295886676 >> 172.21.15.146:0/3295886676 conn(0x7fd2d006eba0 msgr2=0x7fd2d00b04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:20.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.267+0000 7fd2d558b700 1 -- 172.21.15.146:0/3295886676 shutdown_connections 2023-10-06T11:17:20.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.267+0000 7fd2d558b700 1 -- 172.21.15.146:0/3295886676 wait complete. 2023-10-06T11:17:20.281 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:05:36.687307+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:05:37.171199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T11:17:20.282 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:17:20.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.398+0000 7f4b26c7f700 1 Processor -- start 2023-10-06T11:17:20.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.398+0000 7f4b26c7f700 1 -- start start 2023-10-06T11:17:20.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.399+0000 7f4b26c7f700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4b200b5640 0x7f4b2015a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:20.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.399+0000 7f4b26c7f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b200cb090 0x7f4b200cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:20.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.399+0000 7f4b26c7f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b200cc130 con 0x7f4b20068780 2023-10-06T11:17:20.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.399+0000 7f4b26c7f700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b200b2660 con 0x7f4b200b5640 2023-10-06T11:17:20.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.399+0000 7f4b26c7f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b2015adb0 con 0x7f4b200cb090 2023-10-06T11:17:20.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.399+0000 7f4b2647e700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4b20068780 0x7f4b20068bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40274/0 (socket says 172.21.15.146:40274) 2023-10-06T11:17:20.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.399+0000 7f4b2647e700 1 -- 172.21.15.146:0/126341132 learned_addr learned my addr 172.21.15.146:0/126341132 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:17:20.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.399+0000 7f4b25c7d700 1 --2- 172.21.15.146:0/126341132 >> v2:172.21.15.151:3300/0 conn(0x7f4b200b5640 0x7f4b2015a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:20.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.399+0000 7f4b2547c700 1 --2- 172.21.15.146:0/126341132 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b200cb090 0x7f4b200cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:20.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.399+0000 7f4b24c7b700 1 -- 172.21.15.146:0/126341132 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2413900411 0 0) 0x7f4b200cc130 con 0x7f4b20068780 2023-10-06T11:17:20.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.399+0000 7f4b24c7b700 1 -- 172.21.15.146:0/126341132 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b0c003570 con 0x7f4b20068780 2023-10-06T11:17:20.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.399+0000 7f4b25c7d700 1 -- 172.21.15.146:0/126341132 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b200cb090 msgr2=0x7f4b200cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:20.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.399+0000 7f4b25c7d700 1 --2- 172.21.15.146:0/126341132 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b200cb090 0x7f4b200cc5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:20.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.399+0000 7f4b25c7d700 1 -- 172.21.15.146:0/126341132 >> v1:172.21.15.146:6789/0 conn(0x7f4b20068780 legacy=0x7f4b20068bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:20.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.399+0000 7f4b25c7d700 1 -- 172.21.15.146:0/126341132 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b200cb520 con 0x7f4b200b5640 2023-10-06T11:17:20.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.399+0000 7f4b2547c700 1 --2- 172.21.15.146:0/126341132 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b200cb090 0x7f4b200cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:17:20.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.400+0000 7f4b25c7d700 1 --2- 172.21.15.146:0/126341132 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b200b5640 0x7f4b2015a870 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c0098e0 tx=0x7f4b1c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e122d8c3e91d9ad server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:20.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.400+0000 7f4b24c7b700 1 -- 172.21.15.146:0/126341132 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c011630 con 0x7f4b200b5640 2023-10-06T11:17:20.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.400+0000 7f4b24c7b700 1 -- 172.21.15.146:0/126341132 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1c011790 con 0x7f4b200b5640 2023-10-06T11:17:20.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.400+0000 7f4b24c7b700 1 -- 172.21.15.146:0/126341132 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c011b30 con 0x7f4b200b5640 2023-10-06T11:17:20.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.400+0000 7f4b26c7f700 1 -- 172.21.15.146:0/126341132 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b200b5640 msgr2=0x7f4b2015a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:20.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.400+0000 7f4b26c7f700 1 --2- 172.21.15.146:0/126341132 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b200b5640 0x7f4b2015a870 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c0098e0 tx=0x7f4b1c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:17:20.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.400+0000 7f4b26c7f700 1 -- 172.21.15.146:0/126341132 shutdown_connections 2023-10-06T11:17:20.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.400+0000 7f4b26c7f700 1 --2- 172.21.15.146:0/126341132 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b200b5640 0x7f4b2015a870 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:20.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.400+0000 7f4b26c7f700 1 --2- 172.21.15.146:0/126341132 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b200cb090 0x7f4b200cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:20.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.400+0000 7f4b26c7f700 1 -- 172.21.15.146:0/126341132 >> 172.21.15.146:0/126341132 conn(0x7f4b200703f0 msgr2=0x7f4b200707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:20.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.400+0000 7f4b26c7f700 1 -- 172.21.15.146:0/126341132 shutdown_connections 2023-10-06T11:17:20.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.400+0000 7f4b26c7f700 1 -- 172.21.15.146:0/126341132 wait complete. 2023-10-06T11:17:20.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.401+0000 7f4b26c7f700 1 Processor -- start 2023-10-06T11:17:20.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.401+0000 7f4b26c7f700 1 -- start start 2023-10-06T11:17:20.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.402+0000 7f4b26c7f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b20068780 0x7f4b200c89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:20.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.402+0000 7f4b26c7f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b200b5640 0x7f4b200c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:20.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.402+0000 7f4b26c7f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b200cb090 0x7f4b200c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:20.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.402+0000 7f4b26c7f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b200d1230 con 0x7f4b200cb090 2023-10-06T11:17:20.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.402+0000 7f4b26c7f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b200c7eb0 con 0x7f4b200b5640 2023-10-06T11:17:20.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.402+0000 7f4b26c7f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b200c7580 con 0x7f4b20068780 2023-10-06T11:17:20.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.402+0000 7f4b2647e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b200cb090 0x7f4b200c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:20.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.402+0000 7f4b2647e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b200cb090 0x7f4b200c5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38940/0 (socket says 172.21.15.146:38940) 2023-10-06T11:17:20.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.402+0000 7f4b2647e700 1 -- 172.21.15.146:0/3024569422 learned_addr learned my addr 172.21.15.146:0/3024569422 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:20.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.402+0000 7f4b2547c700 1 --2- 172.21.15.146:0/3024569422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b200b5640 0x7f4b200c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:20.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.402+0000 7f4b25c7d700 1 --2- 172.21.15.146:0/3024569422 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b20068780 0x7f4b200c89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:20.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.402+0000 7f4b2647e700 1 -- 172.21.15.146:0/3024569422 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b20068780 msgr2=0x7f4b200c89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:20.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.402+0000 7f4b2647e700 1 --2- 172.21.15.146:0/3024569422 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b20068780 0x7f4b200c89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:20.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.402+0000 7f4b2647e700 1 -- 172.21.15.146:0/3024569422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b200b5640 msgr2=0x7f4b200c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:20.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.402+0000 7f4b2647e700 1 --2- 172.21.15.146:0/3024569422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b200b5640 0x7f4b200c8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:20.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.403+0000 7f4b2647e700 1 -- 172.21.15.146:0/3024569422 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b10009420 con 0x7f4b200cb090 2023-10-06T11:17:20.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.403+0000 7f4b2547c700 1 --2- 172.21.15.146:0/3024569422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b200b5640 0x7f4b200c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:17:20.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.403+0000 7f4b2647e700 1 --2- 172.21.15.146:0/3024569422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b200cb090 0x7f4b200c5bd0 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7f4b18001460 tx=0x7f4b18001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:20.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.403+0000 7f4b15ffb700 1 -- 172.21.15.146:0/3024569422 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1800a890 con 0x7f4b200cb090 2023-10-06T11:17:20.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.403+0000 7f4b15ffb700 1 -- 172.21.15.146:0/3024569422 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1800a9f0 con 0x7f4b200cb090 2023-10-06T11:17:20.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.403+0000 7f4b26c7f700 1 -- 172.21.15.146:0/3024569422 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b1c009420 con 0x7f4b200cb090 2023-10-06T11:17:20.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.403+0000 7f4b15ffb700 1 -- 172.21.15.146:0/3024569422 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1800ad70 con 0x7f4b200cb090 2023-10-06T11:17:20.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.403+0000 7f4b26c7f700 1 -- 172.21.15.146:0/3024569422 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b200c7b40 con 0x7f4b200cb090 2023-10-06T11:17:20.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.404+0000 7f4b26c7f700 1 -- 172.21.15.146:0/3024569422 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b200b2c10 con 0x7f4b200cb090 2023-10-06T11:17:20.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.404+0000 7f4b15ffb700 1 -- 172.21.15.146:0/3024569422 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4b18007300 con 0x7f4b200cb090 2023-10-06T11:17:20.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.405+0000 7f4b15ffb700 1 --2- 172.21.15.146:0/3024569422 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4b04066f00 0x7f4b040693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:20.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.405+0000 7f4b15ffb700 1 -- 172.21.15.146:0/3024569422 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f4b18084770 con 0x7f4b200cb090 2023-10-06T11:17:20.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.405+0000 7f4b25c7d700 1 --2- 172.21.15.146:0/3024569422 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4b04066f00 0x7f4b040693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:20.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.405+0000 7f4b25c7d700 1 --2- 172.21.15.146:0/3024569422 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4b04066f00 0x7f4b040693b0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c0091e0 tx=0x7f4b1c017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:20.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.409+0000 7f4b15ffb700 1 -- 172.21.15.146:0/3024569422 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b18051b40 con 0x7f4b200cb090 2023-10-06T11:17:20.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.592+0000 7f4b26c7f700 1 -- 172.21.15.146:0/3024569422 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4b200b29d0 con 0x7f4b200cb090 2023-10-06T11:17:20.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.592+0000 7f4b15ffb700 1 -- 172.21.15.146:0/3024569422 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v147) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4b18055160 con 0x7f4b200cb090 2023-10-06T11:17:20.594 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-10-06T11:17:20.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.594+0000 7f4b26c7f700 1 -- 172.21.15.146:0/3024569422 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4b04066f00 msgr2=0x7f4b040693b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:20.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.594+0000 7f4b26c7f700 1 --2- 172.21.15.146:0/3024569422 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4b04066f00 0x7f4b040693b0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c0091e0 tx=0x7f4b1c017000 comp rx=0 tx=0).stop 2023-10-06T11:17:20.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.594+0000 7f4b26c7f700 1 -- 172.21.15.146:0/3024569422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b200cb090 msgr2=0x7f4b200c5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:20.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.594+0000 7f4b26c7f700 1 --2- 172.21.15.146:0/3024569422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b200cb090 0x7f4b200c5bd0 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7f4b18001460 tx=0x7f4b18001ae0 comp rx=0 tx=0).stop 2023-10-06T11:17:20.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.594+0000 7f4b26c7f700 1 -- 172.21.15.146:0/3024569422 shutdown_connections 2023-10-06T11:17:20.596 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.594+0000 7f4b26c7f700 1 --2- 172.21.15.146:0/3024569422 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4b04066f00 0x7f4b040693b0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:20.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.594+0000 7f4b26c7f700 1 --2- 172.21.15.146:0/3024569422 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4b200cb090 0x7f4b200c5bd0 unknown :-1 s=CLOSED pgs=1919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:20.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.594+0000 7f4b26c7f700 1 --2- 172.21.15.146:0/3024569422 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4b20068780 0x7f4b200c89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:20.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.594+0000 7f4b26c7f700 1 --2- 172.21.15.146:0/3024569422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b200b5640 0x7f4b200c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:20.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.594+0000 7f4b26c7f700 1 -- 172.21.15.146:0/3024569422 >> 172.21.15.146:0/3024569422 conn(0x7f4b200703f0 msgr2=0x7f4b2015c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:20.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.594+0000 7f4b26c7f700 1 -- 172.21.15.146:0/3024569422 shutdown_connections 2023-10-06T11:17:20.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.594+0000 7f4b26c7f700 1 -- 172.21.15.146:0/3024569422 wait complete. 2023-10-06T11:17:20.608 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:17:20.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.724+0000 7f610f49a700 1 Processor -- start 2023-10-06T11:17:20.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.724+0000 7f610f49a700 1 -- start start 2023-10-06T11:17:20.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.725+0000 7f610f49a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f610815a160 0x7f61080c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:20.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.725+0000 7f610f49a700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f61080cb950 0x7f61080cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:20.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.725+0000 7f610f49a700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61080ae2a0 con 0x7f61080ae730 2023-10-06T11:17:20.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.725+0000 7f610f49a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f610815a530 con 0x7f610815a160 2023-10-06T11:17:20.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.725+0000 7f610f49a700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61080ad690 con 0x7f61080cb950 2023-10-06T11:17:20.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.725+0000 7f610d236700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f610815a160 0x7f61080c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:20.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.725+0000 7f610d236700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f610815a160 0x7f61080c55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38942/0 (socket says 172.21.15.146:38942) 2023-10-06T11:17:20.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.725+0000 7f610d236700 1 -- 172.21.15.146:0/1194747641 learned_addr learned my addr 172.21.15.146:0/1194747641 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:20.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.725+0000 7f610da37700 1 --2- 172.21.15.146:0/1194747641 >> v2:172.21.15.151:3300/0 conn(0x7f61080cb950 0x7f61080cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:20.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.725+0000 7f610d236700 1 -- 172.21.15.146:0/1194747641 >> v2:172.21.15.151:3300/0 conn(0x7f61080cb950 msgr2=0x7f61080cbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:20.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.725+0000 7f610d236700 1 --2- 172.21.15.146:0/1194747641 >> v2:172.21.15.151:3300/0 conn(0x7f61080cb950 0x7f61080cbd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:20.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.725+0000 7f610d236700 1 -- 172.21.15.146:0/1194747641 >> v1:172.21.15.151:6789/0 conn(0x7f61080ae730 legacy=0x7f61080aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:20.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.725+0000 7f610d236700 1 -- 172.21.15.146:0/1194747641 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61080ad970 con 0x7f610815a160 2023-10-06T11:17:20.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.725+0000 7f610d236700 1 --2- 172.21.15.146:0/1194747641 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f610815a160 0x7f61080c55a0 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f61080890e0 tx=0x7f6104009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1760381f7e88b13c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:20.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.725+0000 7f60fffff700 1 -- 172.21.15.146:0/1194747641 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6104005c10 con 0x7f610815a160 2023-10-06T11:17:20.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.725+0000 7f60fffff700 1 -- 172.21.15.146:0/1194747641 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6104005d70 con 0x7f610815a160 2023-10-06T11:17:20.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.725+0000 7f60fffff700 1 -- 172.21.15.146:0/1194747641 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610400b880 con 0x7f610815a160 2023-10-06T11:17:20.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.726+0000 7f610f49a700 1 -- 172.21.15.146:0/1194747641 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f610815a160 msgr2=0x7f61080c55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:20.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.726+0000 7f610f49a700 1 --2- 172.21.15.146:0/1194747641 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f610815a160 0x7f61080c55a0 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f61080890e0 tx=0x7f6104009220 comp rx=0 tx=0).stop 2023-10-06T11:17:20.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.726+0000 7f610f49a700 1 -- 172.21.15.146:0/1194747641 shutdown_connections 2023-10-06T11:17:20.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.726+0000 7f610f49a700 1 --2- 172.21.15.146:0/1194747641 >> v2:172.21.15.151:3300/0 conn(0x7f61080cb950 0x7f61080cbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:20.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.726+0000 7f610f49a700 1 --2- 172.21.15.146:0/1194747641 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f610815a160 0x7f61080c55a0 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:20.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.726+0000 7f610f49a700 1 -- 172.21.15.146:0/1194747641 >> 172.21.15.146:0/1194747641 conn(0x7f610806f380 msgr2=0x7f61080d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:20.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.726+0000 7f610f49a700 1 -- 172.21.15.146:0/1194747641 shutdown_connections 2023-10-06T11:17:20.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.726+0000 7f610f49a700 1 -- 172.21.15.146:0/1194747641 wait complete. 2023-10-06T11:17:20.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.727+0000 7f610f49a700 1 Processor -- start 2023-10-06T11:17:20.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.727+0000 7f610f49a700 1 -- start start 2023-10-06T11:17:20.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.728+0000 7f610f49a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61080ae730 0x7f61080b6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:20.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.728+0000 7f610f49a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61080cb950 0x7f61080c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:20.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.728+0000 7f610f49a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f610815a160 0x7f610814b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:20.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.728+0000 7f610f49a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61080c8d00 con 0x7f610815a160 2023-10-06T11:17:20.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.728+0000 7f610f49a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61080c8700 con 0x7f61080ae730 2023-10-06T11:17:20.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.728+0000 7f610f49a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f610815c9b0 con 0x7f61080cb950 2023-10-06T11:17:20.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.728+0000 7f610da37700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f610815a160 0x7f610814b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:20.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.728+0000 7f610da37700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f610815a160 0x7f610814b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38946/0 (socket says 172.21.15.146:38946) 2023-10-06T11:17:20.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.728+0000 7f610da37700 1 -- 172.21.15.146:0/1424871873 learned_addr learned my addr 172.21.15.146:0/1424871873 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:20.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.728+0000 7f610d236700 1 --2- 172.21.15.146:0/1424871873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61080ae730 0x7f61080b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:20.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.728+0000 7f610ca35700 1 --2- 172.21.15.146:0/1424871873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61080cb950 0x7f61080c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:20.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.728+0000 7f610da37700 1 -- 172.21.15.146:0/1424871873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61080cb950 msgr2=0x7f61080c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:20.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.728+0000 7f610da37700 1 --2- 172.21.15.146:0/1424871873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61080cb950 0x7f61080c9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:20.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.728+0000 7f610da37700 1 -- 172.21.15.146:0/1424871873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61080ae730 msgr2=0x7f61080b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:20.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.728+0000 7f610da37700 1 --2- 172.21.15.146:0/1424871873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61080ae730 0x7f61080b6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:20.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.728+0000 7f610da37700 1 -- 172.21.15.146:0/1424871873 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6104009480 con 0x7f610815a160 2023-10-06T11:17:20.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.728+0000 7f610da37700 1 --2- 172.21.15.146:0/1424871873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f610815a160 0x7f610814b050 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f6100009fa0 tx=0x7f6100009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:20.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.729+0000 7f60fd7fa700 1 -- 172.21.15.146:0/1424871873 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f610000ed20 con 0x7f610815a160 2023-10-06T11:17:20.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.729+0000 7f60fd7fa700 1 -- 172.21.15.146:0/1424871873 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f610000ee80 con 0x7f610815a160 2023-10-06T11:17:20.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.729+0000 7f610f49a700 1 -- 172.21.15.146:0/1424871873 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f610815cc90 con 0x7f610815a160 2023-10-06T11:17:20.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.729+0000 7f60fd7fa700 1 -- 172.21.15.146:0/1424871873 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6100014670 con 0x7f610815a160 2023-10-06T11:17:20.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.729+0000 7f610f49a700 1 -- 172.21.15.146:0/1424871873 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61080c96d0 con 0x7f610815a160 2023-10-06T11:17:20.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.730+0000 7f610f49a700 1 -- 172.21.15.146:0/1424871873 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61080c8eb0 con 0x7f610815a160 2023-10-06T11:17:20.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.730+0000 7f60fd7fa700 1 -- 172.21.15.146:0/1424871873 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f61000149e0 con 0x7f610815a160 2023-10-06T11:17:20.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.730+0000 7f60fd7fa700 1 --2- 172.21.15.146:0/1424871873 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f60ec066f30 0x7f60ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:20.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.730+0000 7f60fd7fa700 1 -- 172.21.15.146:0/1424871873 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f6100084ae0 con 0x7f610815a160 2023-10-06T11:17:20.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.730+0000 7f610d236700 1 --2- 172.21.15.146:0/1424871873 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f60ec066f30 0x7f60ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:20.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.731+0000 7f610d236700 1 --2- 172.21.15.146:0/1424871873 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f60ec066f30 0x7f60ec0693e0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f6104009260 tx=0x7f6104016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:20.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.735+0000 7f60fd7fa700 1 -- 172.21.15.146:0/1424871873 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f61080c8eb0 con 0x7f610815a160 2023-10-06T11:17:20.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.916+0000 7f610f49a700 1 -- 172.21.15.146:0/1424871873 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6108068390 con 0x7f610815a160 2023-10-06T11:17:20.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.916+0000 7f60fd7fa700 1 -- 172.21.15.146:0/1424871873 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v147) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6100051f40 con 0x7f610815a160 2023-10-06T11:17:20.919 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-10-06T11:17:20.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.919+0000 7f610f49a700 1 -- 172.21.15.146:0/1424871873 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f60ec066f30 msgr2=0x7f60ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:20.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.919+0000 7f610f49a700 1 --2- 172.21.15.146:0/1424871873 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f60ec066f30 0x7f60ec0693e0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f6104009260 tx=0x7f6104016000 comp rx=0 tx=0).stop 2023-10-06T11:17:20.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.919+0000 7f610f49a700 1 -- 172.21.15.146:0/1424871873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f610815a160 msgr2=0x7f610814b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:20.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.919+0000 7f610f49a700 1 --2- 172.21.15.146:0/1424871873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f610815a160 0x7f610814b050 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f6100009fa0 tx=0x7f6100009900 comp rx=0 tx=0).stop 2023-10-06T11:17:20.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.919+0000 7f610f49a700 1 -- 172.21.15.146:0/1424871873 shutdown_connections 2023-10-06T11:17:20.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.919+0000 7f610f49a700 1 --2- 172.21.15.146:0/1424871873 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f60ec066f30 0x7f60ec0693e0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:20.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.919+0000 7f610f49a700 1 --2- 172.21.15.146:0/1424871873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f610815a160 0x7f610814b050 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:20.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.919+0000 7f610f49a700 1 --2- 172.21.15.146:0/1424871873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61080ae730 0x7f61080b6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:20.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.919+0000 7f610f49a700 1 --2- 172.21.15.146:0/1424871873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61080cb950 0x7f61080c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:20.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.919+0000 7f610f49a700 1 -- 172.21.15.146:0/1424871873 >> 172.21.15.146:0/1424871873 conn(0x7f610806f380 msgr2=0x7f6108159400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:20.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.919+0000 7f610f49a700 1 -- 172.21.15.146:0/1424871873 shutdown_connections 2023-10-06T11:17:20.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:20.919+0000 7f610f49a700 1 -- 172.21.15.146:0/1424871873 wait complete. 2023-10-06T11:17:20.933 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T11:17:21.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.046+0000 7f3166f90700 1 Processor -- start 2023-10-06T11:17:21.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.046+0000 7f3166f90700 1 -- start start 2023-10-06T11:17:21.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.047+0000 7f3166f90700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f316015a420 0x7f316015cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:21.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.047+0000 7f3166f90700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f316015c630 con 0x7f316015a7f0 2023-10-06T11:17:21.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.047+0000 7f3166f90700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f316015ba20 con 0x7f31600b2530 2023-10-06T11:17:21.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.047+0000 7f3166f90700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31600ce040 con 0x7f316015a420 2023-10-06T11:17:21.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.047+0000 7f3165f8e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f316015a420 0x7f316015cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:21.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.047+0000 7f316578d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f316015a7f0 0x7f31600b1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40280/0 (socket says 172.21.15.146:40280) 2023-10-06T11:17:21.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.047+0000 7f316578d700 1 -- 172.21.15.146:0/1955227720 learned_addr learned my addr 172.21.15.146:0/1955227720 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:17:21.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.047+0000 7f3165f8e700 1 -- 172.21.15.146:0/1955227720 >> v1:172.21.15.151:6789/0 conn(0x7f31600b2530 legacy=0x7f316015acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:21.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.047+0000 7f3165f8e700 1 -- 172.21.15.146:0/1955227720 >> v1:172.21.15.146:6789/0 conn(0x7f316015a7f0 legacy=0x7f31600b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:21.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.047+0000 7f3165f8e700 1 -- 172.21.15.146:0/1955227720 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f316015bd00 con 0x7f316015a420 2023-10-06T11:17:21.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.047+0000 7f3164f8c700 1 -- 172.21.15.146:0/1955227720 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1942507932 0 0) 0x7f316015c630 con 0x7f316015a7f0 2023-10-06T11:17:21.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.048+0000 7f3165f8e700 1 --2- 172.21.15.146:0/1955227720 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f316015a420 0x7f316015cac0 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f3150009e60 tx=0x7f3150009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f796f71dd23478b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:21.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.048+0000 7f3164f8c700 1 -- 172.21.15.146:0/1955227720 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315000e070 con 0x7f316015a420 2023-10-06T11:17:21.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.048+0000 7f3164f8c700 1 -- 172.21.15.146:0/1955227720 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315000bbf0 con 0x7f316015a420 2023-10-06T11:17:21.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.048+0000 7f3164f8c700 1 -- 172.21.15.146:0/1955227720 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3150012430 con 0x7f316015a420 2023-10-06T11:17:21.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.048+0000 7f3166f90700 1 -- 172.21.15.146:0/1955227720 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f316015a420 msgr2=0x7f316015cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:21.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.048+0000 7f3166f90700 1 --2- 172.21.15.146:0/1955227720 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f316015a420 0x7f316015cac0 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f3150009e60 tx=0x7f3150009780 comp rx=0 tx=0).stop 2023-10-06T11:17:21.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.048+0000 7f3166f90700 1 -- 172.21.15.146:0/1955227720 shutdown_connections 2023-10-06T11:17:21.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.048+0000 7f3166f90700 1 --2- 172.21.15.146:0/1955227720 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f316015a420 0x7f316015cac0 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:21.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.048+0000 7f3166f90700 1 -- 172.21.15.146:0/1955227720 >> 172.21.15.146:0/1955227720 conn(0x7f316006eba0 msgr2=0x7f316006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:21.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.048+0000 7f3166f90700 1 -- 172.21.15.146:0/1955227720 shutdown_connections 2023-10-06T11:17:21.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.048+0000 7f3166f90700 1 -- 172.21.15.146:0/1955227720 wait complete. 2023-10-06T11:17:21.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.049+0000 7f3166f90700 1 Processor -- start 2023-10-06T11:17:21.054 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.049+0000 7f3166f90700 1 -- start start 2023-10-06T11:17:21.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.050+0000 7f3166f90700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31600b2530 0x7f31601552f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:21.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.050+0000 7f3166f90700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f316015a420 0x7f3160155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:21.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.050+0000 7f3166f90700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f316015a7f0 0x7f3160153150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:21.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.050+0000 7f3166f90700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3160154e60 con 0x7f31600b2530 2023-10-06T11:17:21.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.050+0000 7f3166f90700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3160154250 con 0x7f316015a420 2023-10-06T11:17:21.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.050+0000 7f3166f90700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3160154530 con 0x7f316015a7f0 2023-10-06T11:17:21.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.050+0000 7f3165f8e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31600b2530 0x7f31601552f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:21.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.050+0000 7f3165f8e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31600b2530 0x7f31601552f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38964/0 (socket says 172.21.15.146:38964) 2023-10-06T11:17:21.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.050+0000 7f3165f8e700 1 -- 172.21.15.146:0/2534847 learned_addr learned my addr 172.21.15.146:0/2534847 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:21.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.050+0000 7f316578d700 1 --2- 172.21.15.146:0/2534847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f316015a420 0x7f3160155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:21.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.050+0000 7f316678f700 1 --2- 172.21.15.146:0/2534847 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f316015a7f0 0x7f3160153150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:21.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.050+0000 7f3165f8e700 1 -- 172.21.15.146:0/2534847 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f316015a7f0 msgr2=0x7f3160153150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:21.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.050+0000 7f3165f8e700 1 --2- 172.21.15.146:0/2534847 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f316015a7f0 0x7f3160153150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:21.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.050+0000 7f3165f8e700 1 -- 172.21.15.146:0/2534847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f316015a420 msgr2=0x7f3160155ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:21.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.050+0000 7f3165f8e700 1 --2- 172.21.15.146:0/2534847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f316015a420 0x7f3160155ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:21.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.050+0000 7f3165f8e700 1 -- 172.21.15.146:0/2534847 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3150009a20 con 0x7f31600b2530 2023-10-06T11:17:21.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.051+0000 7f3165f8e700 1 --2- 172.21.15.146:0/2534847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31600b2530 0x7f31601552f0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f3160088e40 tx=0x7f3150018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:21.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.051+0000 7f315dffb700 1 -- 172.21.15.146:0/2534847 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3150012e00 con 0x7f31600b2530 2023-10-06T11:17:21.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.051+0000 7f315dffb700 1 -- 172.21.15.146:0/2534847 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315001d640 con 0x7f31600b2530 2023-10-06T11:17:21.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.051+0000 7f3166f90700 1 -- 172.21.15.146:0/2534847 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3160154810 con 0x7f31600b2530 2023-10-06T11:17:21.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.051+0000 7f315dffb700 1 -- 172.21.15.146:0/2534847 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315001da00 con 0x7f31600b2530 2023-10-06T11:17:21.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.051+0000 7f3166f90700 1 -- 172.21.15.146:0/2534847 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3160155ff0 con 0x7f31600b2530 2023-10-06T11:17:21.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.052+0000 7f3166f90700 1 -- 172.21.15.146:0/2534847 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31601562a0 con 0x7f31600b2530 2023-10-06T11:17:21.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.052+0000 7f315dffb700 1 -- 172.21.15.146:0/2534847 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3150024070 con 0x7f31600b2530 2023-10-06T11:17:21.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.053+0000 7f315dffb700 1 --2- 172.21.15.146:0/2534847 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f314c066f30 0x7f314c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:21.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.053+0000 7f315dffb700 1 -- 172.21.15.146:0/2534847 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f3150086d50 con 0x7f31600b2530 2023-10-06T11:17:21.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.053+0000 7f316578d700 1 --2- 172.21.15.146:0/2534847 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f314c066f30 0x7f314c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:21.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.053+0000 7f316578d700 1 --2- 172.21.15.146:0/2534847 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f314c066f30 0x7f314c0693e0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f3160167920 tx=0x7f3154009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:21.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.057+0000 7f315dffb700 1 -- 172.21.15.146:0/2534847 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f315008a030 con 0x7f31600b2530 2023-10-06T11:17:21.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.241+0000 7f3166f90700 1 -- 172.21.15.146:0/2534847 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f31600afae0 con 0x7f31600b2530 2023-10-06T11:17:21.243 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.241+0000 7f315dffb700 1 -- 172.21.15.146:0/2534847 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v147) v1 ==== 84+0+126 (secure 0 0 0) 0x7f31500541b0 con 0x7f31600b2530 2023-10-06T11:17:21.243 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:21.244 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2023-10-06T11:17:21.244 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:17:21.244 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 1, 2023-10-06T11:17:21.244 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": "rbd" 2023-10-06T11:17:21.244 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:17:21.244 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:17:21.244 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 2, 2023-10-06T11:17:21.244 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": ".mgr" 2023-10-06T11:17:21.244 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:17:21.244 INFO:teuthology.orchestra.run.smithi146.stdout:] 2023-10-06T11:17:21.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.243+0000 7f3166f90700 1 -- 172.21.15.146:0/2534847 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f314c066f30 msgr2=0x7f314c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:21.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.243+0000 7f3166f90700 1 --2- 172.21.15.146:0/2534847 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f314c066f30 0x7f314c0693e0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f3160167920 tx=0x7f3154009040 comp rx=0 tx=0).stop 2023-10-06T11:17:21.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.243+0000 7f3166f90700 1 -- 172.21.15.146:0/2534847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31600b2530 msgr2=0x7f31601552f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:21.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.243+0000 7f3166f90700 1 --2- 172.21.15.146:0/2534847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31600b2530 0x7f31601552f0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f3160088e40 tx=0x7f3150018000 comp rx=0 tx=0).stop 2023-10-06T11:17:21.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.243+0000 7f3166f90700 1 -- 172.21.15.146:0/2534847 shutdown_connections 2023-10-06T11:17:21.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.243+0000 7f3166f90700 1 --2- 172.21.15.146:0/2534847 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f314c066f30 0x7f314c0693e0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:21.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.243+0000 7f3166f90700 1 --2- 172.21.15.146:0/2534847 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f316015a7f0 0x7f3160153150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:21.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.243+0000 7f3166f90700 1 --2- 172.21.15.146:0/2534847 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f31600b2530 0x7f31601552f0 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:21.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.243+0000 7f3166f90700 1 --2- 172.21.15.146:0/2534847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f316015a420 0x7f3160155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:21.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.243+0000 7f3166f90700 1 -- 172.21.15.146:0/2534847 >> 172.21.15.146:0/2534847 conn(0x7f316006eba0 msgr2=0x7f31600afcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:21.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.243+0000 7f3166f90700 1 -- 172.21.15.146:0/2534847 shutdown_connections 2023-10-06T11:17:21.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.243+0000 7f3166f90700 1 -- 172.21.15.146:0/2534847 wait complete. 2023-10-06T11:17:21.257 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T11:17:21.258 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T11:17:21.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.375+0000 7f0b9599b700 1 Processor -- start 2023-10-06T11:17:21.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.375+0000 7f0b9599b700 1 -- start start 2023-10-06T11:17:21.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.376+0000 7f0b9599b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0b900cb040 0x7f0b90068480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:21.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.376+0000 7f0b9599b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b900cb460 con 0x7f0b90155850 2023-10-06T11:17:21.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.376+0000 7f0b9599b700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b900c7a10 con 0x7f0b90155c20 2023-10-06T11:17:21.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.376+0000 7f0b9599b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b9006aee0 con 0x7f0b900cb040 2023-10-06T11:17:21.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.376+0000 7f0b8f7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0b900cb040 0x7f0b90068480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:21.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.376+0000 7f0b8effd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0b90155850 0x7f0b900cbfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39640/0 (socket says 172.21.15.146:39640) 2023-10-06T11:17:21.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.376+0000 7f0b8f7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0b900cb040 0x7f0b90068480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49566/0 (socket says 172.21.15.146:49566) 2023-10-06T11:17:21.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.376+0000 7f0b8effd700 1 -- 172.21.15.146:0/2309934190 learned_addr learned my addr 172.21.15.146:0/2309934190 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:17:21.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.377+0000 7f0b8f7fe700 1 -- 172.21.15.146:0/2309934190 >> v1:172.21.15.151:6789/0 conn(0x7f0b90155c20 legacy=0x7f0b9006a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:21.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.377+0000 7f0b8f7fe700 1 -- 172.21.15.146:0/2309934190 >> v1:172.21.15.146:6789/0 conn(0x7f0b90155850 legacy=0x7f0b900cbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:21.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.377+0000 7f0b8e7fc700 1 -- 172.21.15.146:0/2309934190 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4158975384 0 0) 0x7f0b80001110 con 0x7f0b90155850 2023-10-06T11:17:21.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.377+0000 7f0b8f7fe700 1 -- 172.21.15.146:0/2309934190 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b900c70e0 con 0x7f0b900cb040 2023-10-06T11:17:21.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.377+0000 7f0b8f7fe700 1 --2- 172.21.15.146:0/2309934190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b900cb040 0x7f0b90068480 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7f0b8800af70 tx=0x7f0b8800a890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75e65384f152f4a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:21.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.377+0000 7f0b8e7fc700 1 -- 172.21.15.146:0/2309934190 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8800f070 con 0x7f0b900cb040 2023-10-06T11:17:21.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.377+0000 7f0b8e7fc700 1 -- 172.21.15.146:0/2309934190 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b8800a2e0 con 0x7f0b900cb040 2023-10-06T11:17:21.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.377+0000 7f0b8e7fc700 1 -- 172.21.15.146:0/2309934190 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b8800cce0 con 0x7f0b900cb040 2023-10-06T11:17:21.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.377+0000 7f0b9599b700 1 -- 172.21.15.146:0/2309934190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b900cb040 msgr2=0x7f0b90068480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:21.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.377+0000 7f0b9599b700 1 --2- 172.21.15.146:0/2309934190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b900cb040 0x7f0b90068480 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7f0b8800af70 tx=0x7f0b8800a890 comp rx=0 tx=0).stop 2023-10-06T11:17:21.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.377+0000 7f0b9599b700 1 -- 172.21.15.146:0/2309934190 shutdown_connections 2023-10-06T11:17:21.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.378+0000 7f0b9599b700 1 --2- 172.21.15.146:0/2309934190 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b900cb040 0x7f0b90068480 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:21.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.378+0000 7f0b9599b700 1 -- 172.21.15.146:0/2309934190 >> 172.21.15.146:0/2309934190 conn(0x7f0b900c9da0 msgr2=0x7f0b9006dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:21.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.378+0000 7f0b9599b700 1 -- 172.21.15.146:0/2309934190 shutdown_connections 2023-10-06T11:17:21.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.378+0000 7f0b9599b700 1 -- 172.21.15.146:0/2309934190 wait complete. 2023-10-06T11:17:21.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.379+0000 7f0b9599b700 1 Processor -- start 2023-10-06T11:17:21.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.379+0000 7f0b9599b700 1 -- start start 2023-10-06T11:17:21.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.379+0000 7f0b9599b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b900cb040 0x7f0b901507c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:21.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.379+0000 7f0b9599b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b90155850 0x7f0b9014b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:21.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.379+0000 7f0b9599b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b90155c20 0x7f0b901444a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:21.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.379+0000 7f0b9599b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b90150330 con 0x7f0b90155c20 2023-10-06T11:17:21.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.379+0000 7f0b9599b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9014fd20 con 0x7f0b90155850 2023-10-06T11:17:21.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.379+0000 7f0b9599b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b900c3020 con 0x7f0b900cb040 2023-10-06T11:17:21.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.380+0000 7f0b8f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b90155c20 0x7f0b901444a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:21.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.380+0000 7f0b8f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b90155c20 0x7f0b901444a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49570/0 (socket says 172.21.15.146:49570) 2023-10-06T11:17:21.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.380+0000 7f0b8f7fe700 1 -- 172.21.15.146:0/1181531057 learned_addr learned my addr 172.21.15.146:0/1181531057 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:21.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.380+0000 7f0b8f7fe700 1 -- 172.21.15.146:0/1181531057 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b900cb040 msgr2=0x7f0b901507c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:21.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.380+0000 7f0b8f7fe700 1 --2- 172.21.15.146:0/1181531057 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b900cb040 0x7f0b901507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:21.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.380+0000 7f0b8f7fe700 1 -- 172.21.15.146:0/1181531057 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b90155850 msgr2=0x7f0b9014b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:21.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.380+0000 7f0b8f7fe700 1 --2- 172.21.15.146:0/1181531057 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b90155850 0x7f0b9014b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:21.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.380+0000 7f0b8f7fe700 1 -- 172.21.15.146:0/1181531057 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b8800ab30 con 0x7f0b90155c20 2023-10-06T11:17:21.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.380+0000 7f0b8f7fe700 1 --2- 172.21.15.146:0/1181531057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b90155c20 0x7f0b901444a0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7f0b8800ab00 tx=0x7f0b88018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:21.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.380+0000 7f0b877fe700 1 -- 172.21.15.146:0/1181531057 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b88009cf0 con 0x7f0b90155c20 2023-10-06T11:17:21.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.380+0000 7f0b877fe700 1 -- 172.21.15.146:0/1181531057 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b88009e50 con 0x7f0b90155c20 2023-10-06T11:17:21.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.380+0000 7f0b9599b700 1 -- 172.21.15.146:0/1181531057 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b9014d780 con 0x7f0b90155c20 2023-10-06T11:17:21.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.380+0000 7f0b877fe700 1 -- 172.21.15.146:0/1181531057 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b88013680 con 0x7f0b90155c20 2023-10-06T11:17:21.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.380+0000 7f0b9599b700 1 -- 172.21.15.146:0/1181531057 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b9014da60 con 0x7f0b90155c20 2023-10-06T11:17:21.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.381+0000 7f0b9599b700 1 -- 172.21.15.146:0/1181531057 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b90150d00 con 0x7f0b90155c20 2023-10-06T11:17:21.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.381+0000 7f0b877fe700 1 -- 172.21.15.146:0/1181531057 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0b880139f0 con 0x7f0b90155c20 2023-10-06T11:17:21.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.382+0000 7f0b877fe700 1 --2- 172.21.15.146:0/1181531057 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0b70066f30 0x7f0b700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:21.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.382+0000 7f0b8effd700 1 --2- 172.21.15.146:0/1181531057 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0b70066f30 0x7f0b700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:21.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.382+0000 7f0b877fe700 1 -- 172.21.15.146:0/1181531057 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f0b88085fc0 con 0x7f0b90155c20 2023-10-06T11:17:21.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.382+0000 7f0b8effd700 1 --2- 172.21.15.146:0/1181531057 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0b70066f30 0x7f0b700693e0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f0b80001700 tx=0x7f0b80001270 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:21.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.386+0000 7f0b877fe700 1 -- 172.21.15.146:0/1181531057 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0b880b75a0 con 0x7f0b90155c20 2023-10-06T11:17:21.541 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:17:21.543 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:17:21.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:21.575+0000 7f0b9599b700 1 -- 172.21.15.146:0/1181531057 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f0b90150470 con 0x7f0b90155c20 2023-10-06T11:17:22.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.547+0000 7f0b877fe700 1 -- 172.21.15.146:0/1181531057 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v148) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0b8802c0b0 con 0x7f0b90155c20 2023-10-06T11:17:22.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.552+0000 7f0b9599b700 1 -- 172.21.15.146:0/1181531057 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0b70066f30 msgr2=0x7f0b700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:22.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.552+0000 7f0b9599b700 1 --2- 172.21.15.146:0/1181531057 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0b70066f30 0x7f0b700693e0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f0b80001700 tx=0x7f0b80001270 comp rx=0 tx=0).stop 2023-10-06T11:17:22.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.552+0000 7f0b9599b700 1 -- 172.21.15.146:0/1181531057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b90155c20 msgr2=0x7f0b901444a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:22.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.552+0000 7f0b9599b700 1 --2- 172.21.15.146:0/1181531057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b90155c20 0x7f0b901444a0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7f0b8800ab00 tx=0x7f0b88018000 comp rx=0 tx=0).stop 2023-10-06T11:17:22.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.552+0000 7f0b9599b700 1 -- 172.21.15.146:0/1181531057 shutdown_connections 2023-10-06T11:17:22.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.552+0000 7f0b9599b700 1 --2- 172.21.15.146:0/1181531057 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0b70066f30 0x7f0b700693e0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:22.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.552+0000 7f0b9599b700 1 --2- 172.21.15.146:0/1181531057 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0b90155c20 0x7f0b901444a0 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:22.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.552+0000 7f0b9599b700 1 --2- 172.21.15.146:0/1181531057 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0b900cb040 0x7f0b901507c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:22.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.552+0000 7f0b9599b700 1 --2- 172.21.15.146:0/1181531057 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b90155850 0x7f0b9014b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:22.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.552+0000 7f0b9599b700 1 -- 172.21.15.146:0/1181531057 >> 172.21.15.146:0/1181531057 conn(0x7f0b900c9da0 msgr2=0x7f0b90067af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:22.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.553+0000 7f0b9599b700 1 -- 172.21.15.146:0/1181531057 shutdown_connections 2023-10-06T11:17:22.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.553+0000 7f0b9599b700 1 -- 172.21.15.146:0/1181531057 wait complete. 2023-10-06T11:17:22.670 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' created 2023-10-06T11:17:22.670 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T11:17:22.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.795+0000 7f5fdffff700 1 Processor -- start 2023-10-06T11:17:22.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.795+0000 7f5fdffff700 1 -- start start 2023-10-06T11:17:22.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.795+0000 7f5fdffff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5fe00b5640 0x7f5fe015a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:22.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.796+0000 7f5fdffff700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fe00cc130 con 0x7f5fe0068780 2023-10-06T11:17:22.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.796+0000 7f5fdffff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fe00cccd0 con 0x7f5fe00cb090 2023-10-06T11:17:22.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.796+0000 7f5fdffff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fe00b2660 con 0x7f5fe00b5640 2023-10-06T11:17:22.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.796+0000 7f5fdf7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f5fe0068780 0x7f5fe015b010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39646/0 (socket says 172.21.15.146:39646) 2023-10-06T11:17:22.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.796+0000 7f5fdf7fe700 1 -- 172.21.15.146:0/3196744934 learned_addr learned my addr 172.21.15.146:0/3196744934 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:17:22.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.796+0000 7f5fdeffd700 1 --2- 172.21.15.146:0/3196744934 >> v2:172.21.15.151:3300/0 conn(0x7f5fe00b5640 0x7f5fe015a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:22.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.796+0000 7f5fddffb700 1 -- 172.21.15.146:0/3196744934 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2401492895 0 0) 0x7f5fe00cc130 con 0x7f5fe0068780 2023-10-06T11:17:22.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.796+0000 7f5fddffb700 1 -- 172.21.15.146:0/3196744934 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fc8003570 con 0x7f5fe0068780 2023-10-06T11:17:22.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.796+0000 7f5fddffb700 1 -- 172.21.15.146:0/3196744934 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2860861022 0 0) 0x7f5fe00cccd0 con 0x7f5fe00cb090 2023-10-06T11:17:22.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.796+0000 7f5fddffb700 1 -- 172.21.15.146:0/3196744934 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fe00cc130 con 0x7f5fe00cb090 2023-10-06T11:17:22.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.796+0000 7f5fddffb700 1 -- 172.21.15.146:0/3196744934 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1193655354 0 0) 0x7f5fc8003570 con 0x7f5fe0068780 2023-10-06T11:17:22.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.796+0000 7f5fddffb700 1 -- 172.21.15.146:0/3196744934 >> v2:172.21.15.151:3300/0 conn(0x7f5fe00b5640 msgr2=0x7f5fe015a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:22.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.796+0000 7f5fddffb700 1 --2- 172.21.15.146:0/3196744934 >> v2:172.21.15.151:3300/0 conn(0x7f5fe00b5640 0x7f5fe015a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:22.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.796+0000 7f5fddffb700 1 -- 172.21.15.146:0/3196744934 >> v1:172.21.15.151:6789/0 conn(0x7f5fe00cb090 legacy=0x7f5fe00cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:22.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.796+0000 7f5fddffb700 1 -- 172.21.15.146:0/3196744934 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe015adb0 con 0x7f5fe0068780 2023-10-06T11:17:22.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.796+0000 7f5fddffb700 1 -- 172.21.15.146:0/3196744934 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f5fd0001470 con 0x7f5fe0068780 2023-10-06T11:17:22.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.796+0000 7f5fddffb700 1 -- 172.21.15.146:0/3196744934 >> v1:172.21.15.146:6789/0 conn(0x7f5fe0068780 legacy=0x7f5fe015b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:22.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.796+0000 7f5fddffb700 1 --2- 172.21.15.146:0/3196744934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fc8003c40 0x7f5fc8004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:22.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.796+0000 7f5fddffb700 1 --2- 172.21.15.146:0/3196744934 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fc8004810 0x7f5fc8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:22.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.796+0000 7f5fddffb700 1 --2- 172.21.15.146:0/3196744934 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fc8005210 0x7f5fc800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:22.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.796+0000 7f5fddffb700 1 -- 172.21.15.146:0/3196744934 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe00b2660 con 0x7f5fc8003c40 2023-10-06T11:17:22.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.796+0000 7f5fddffb700 1 -- 172.21.15.146:0/3196744934 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc800c130 con 0x7f5fc8004810 2023-10-06T11:17:22.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.796+0000 7f5fddffb700 1 -- 172.21.15.146:0/3196744934 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc800c2c0 con 0x7f5fc8005210 2023-10-06T11:17:22.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.796+0000 7f5fdeffd700 1 --2- 172.21.15.146:0/3196744934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fc8003c40 0x7f5fc8004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:22.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.797+0000 7f5fde7fc700 1 --2- 172.21.15.146:0/3196744934 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fc8004810 0x7f5fc8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:22.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.797+0000 7f5fdf7fe700 1 --2- 172.21.15.146:0/3196744934 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fc8005210 0x7f5fc800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:22.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.797+0000 7f5fdeffd700 1 -- 172.21.15.146:0/3196744934 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fc8005210 msgr2=0x7f5fc800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:22.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.797+0000 7f5fdeffd700 1 --2- 172.21.15.146:0/3196744934 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fc8005210 0x7f5fc800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:22.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.797+0000 7f5fdeffd700 1 -- 172.21.15.146:0/3196744934 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fc8004810 msgr2=0x7f5fc8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:22.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.797+0000 7f5fdeffd700 1 --2- 172.21.15.146:0/3196744934 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fc8004810 0x7f5fc8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:22.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.797+0000 7f5fdeffd700 1 -- 172.21.15.146:0/3196744934 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc8003570 con 0x7f5fc8003c40 2023-10-06T11:17:22.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.797+0000 7f5fdf7fe700 1 -- 172.21.15.146:0/3196744934 reap_dead start 2023-10-06T11:17:22.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.797+0000 7f5fdeffd700 1 --2- 172.21.15.146:0/3196744934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fc8003c40 0x7f5fc8004030 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f5fd800e240 tx=0x7f5fd800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83cb3daf9952f5f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:22.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.797+0000 7f5fddffb700 1 -- 172.21.15.146:0/3196744934 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd800eaf0 con 0x7f5fc8003c40 2023-10-06T11:17:22.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.797+0000 7f5fddffb700 1 -- 172.21.15.146:0/3196744934 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd800f040 con 0x7f5fc8003c40 2023-10-06T11:17:22.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.797+0000 7f5fddffb700 1 -- 172.21.15.146:0/3196744934 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd800eea0 con 0x7f5fc8003c40 2023-10-06T11:17:22.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.797+0000 7f5fdffff700 1 -- 172.21.15.146:0/3196744934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fc8003c40 msgr2=0x7f5fc8004030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:22.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.797+0000 7f5fdffff700 1 --2- 172.21.15.146:0/3196744934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fc8003c40 0x7f5fc8004030 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f5fd800e240 tx=0x7f5fd800b040 comp rx=0 tx=0).stop 2023-10-06T11:17:22.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.798+0000 7f5fdffff700 1 -- 172.21.15.146:0/3196744934 shutdown_connections 2023-10-06T11:17:22.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.798+0000 7f5fdffff700 1 --2- 172.21.15.146:0/3196744934 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fc8003c40 0x7f5fc8004030 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:22.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.798+0000 7f5fdffff700 1 -- 172.21.15.146:0/3196744934 >> 172.21.15.146:0/3196744934 conn(0x7f5fe00703f0 msgr2=0x7f5fe00707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:22.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.798+0000 7f5fdffff700 1 -- 172.21.15.146:0/3196744934 shutdown_connections 2023-10-06T11:17:22.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.798+0000 7f5fdffff700 1 -- 172.21.15.146:0/3196744934 wait complete. 2023-10-06T11:17:22.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.799+0000 7f5fdffff700 1 Processor -- start 2023-10-06T11:17:22.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.799+0000 7f5fdffff700 1 -- start start 2023-10-06T11:17:22.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.799+0000 7f5fdffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fc8003c40 0x7f5fe00c69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:22.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.800+0000 7f5fdffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fe0158500 0x7f5fe0153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:22.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.800+0000 7f5fdffff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fe00cf530 0x7f5fe00cf980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:22.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.800+0000 7f5fdffff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe00c6f30 con 0x7f5fc8003c40 2023-10-06T11:17:22.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.800+0000 7f5fdffff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe016cfe0 con 0x7f5fe0158500 2023-10-06T11:17:22.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.800+0000 7f5fdffff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe00cfec0 con 0x7f5fe00cf530 2023-10-06T11:17:22.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.800+0000 7f5fdeffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fc8003c40 0x7f5fe00c69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:22.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.800+0000 7f5fdeffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fc8003c40 0x7f5fe00c69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49580/0 (socket says 172.21.15.146:49580) 2023-10-06T11:17:22.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.800+0000 7f5fdeffd700 1 -- 172.21.15.146:0/3834477339 learned_addr learned my addr 172.21.15.146:0/3834477339 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:22.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.800+0000 7f5fdf7fe700 1 --2- 172.21.15.146:0/3834477339 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fe00cf530 0x7f5fe00cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:22.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.800+0000 7f5fde7fc700 1 --2- 172.21.15.146:0/3834477339 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fe0158500 0x7f5fe0153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:22.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.800+0000 7f5fdeffd700 1 -- 172.21.15.146:0/3834477339 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fe00cf530 msgr2=0x7f5fe00cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:22.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.800+0000 7f5fdeffd700 1 --2- 172.21.15.146:0/3834477339 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fe00cf530 0x7f5fe00cf980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:22.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.800+0000 7f5fdeffd700 1 -- 172.21.15.146:0/3834477339 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fe0158500 msgr2=0x7f5fe0153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:22.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.800+0000 7f5fdeffd700 1 --2- 172.21.15.146:0/3834477339 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fe0158500 0x7f5fe0153070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:22.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.800+0000 7f5fdeffd700 1 -- 172.21.15.146:0/3834477339 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe0158ce0 con 0x7f5fc8003c40 2023-10-06T11:17:22.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.800+0000 7f5fde7fc700 1 --2- 172.21.15.146:0/3834477339 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fe0158500 0x7f5fe0153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:17:22.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.800+0000 7f5fdeffd700 1 --2- 172.21.15.146:0/3834477339 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fc8003c40 0x7f5fe00c69f0 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f5fd800e830 tx=0x7f5fd801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:22.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.800+0000 7f5fc6ffd700 1 -- 172.21.15.146:0/3834477339 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd801d420 con 0x7f5fc8003c40 2023-10-06T11:17:22.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.800+0000 7f5fc6ffd700 1 -- 172.21.15.146:0/3834477339 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd801d580 con 0x7f5fc8003c40 2023-10-06T11:17:22.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.800+0000 7f5fdffff700 1 -- 172.21.15.146:0/3834477339 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fe0158fc0 con 0x7f5fc8003c40 2023-10-06T11:17:22.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.800+0000 7f5fc6ffd700 1 -- 172.21.15.146:0/3834477339 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd801d940 con 0x7f5fc8003c40 2023-10-06T11:17:22.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.800+0000 7f5fdffff700 1 -- 172.21.15.146:0/3834477339 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fe016d230 con 0x7f5fc8003c40 2023-10-06T11:17:22.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.801+0000 7f5fdffff700 1 -- 172.21.15.146:0/3834477339 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fe016d5a0 con 0x7f5fc8003c40 2023-10-06T11:17:22.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.802+0000 7f5fc6ffd700 1 -- 172.21.15.146:0/3834477339 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5fd8003040 con 0x7f5fc8003c40 2023-10-06T11:17:22.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.802+0000 7f5fc6ffd700 1 --2- 172.21.15.146:0/3834477339 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5fcc066f30 0x7f5fcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:22.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.802+0000 7f5fc6ffd700 1 -- 172.21.15.146:0/3834477339 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f5fd8086c60 con 0x7f5fc8003c40 2023-10-06T11:17:22.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.802+0000 7f5fde7fc700 1 --2- 172.21.15.146:0/3834477339 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5fcc066f30 0x7f5fcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:22.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.803+0000 7f5fde7fc700 1 --2- 172.21.15.146:0/3834477339 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5fcc066f30 0x7f5fcc0693e0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4000f60 tx=0x7f5fd4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:22.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.806+0000 7f5fc6ffd700 1 -- 172.21.15.146:0/3834477339 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5fd8054080 con 0x7f5fc8003c40 2023-10-06T11:17:22.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:22.990+0000 7f5fdffff700 1 -- 172.21.15.146:0/3834477339 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5fe004bb40 con 0x7f5fc8003c40 2023-10-06T11:17:23.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.554+0000 7f5fc6ffd700 1 -- 172.21.15.146:0/3834477339 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v149) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5fd8018020 con 0x7f5fc8003c40 2023-10-06T11:17:23.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.562+0000 7f5fdffff700 1 -- 172.21.15.146:0/3834477339 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5fcc066f30 msgr2=0x7f5fcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:23.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.562+0000 7f5fdffff700 1 --2- 172.21.15.146:0/3834477339 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5fcc066f30 0x7f5fcc0693e0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4000f60 tx=0x7f5fd4009040 comp rx=0 tx=0).stop 2023-10-06T11:17:23.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.562+0000 7f5fdffff700 1 -- 172.21.15.146:0/3834477339 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fc8003c40 msgr2=0x7f5fe00c69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:23.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.562+0000 7f5fdffff700 1 --2- 172.21.15.146:0/3834477339 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fc8003c40 0x7f5fe00c69f0 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f5fd800e830 tx=0x7f5fd801a000 comp rx=0 tx=0).stop 2023-10-06T11:17:23.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.562+0000 7f5fdffff700 1 -- 172.21.15.146:0/3834477339 shutdown_connections 2023-10-06T11:17:23.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.562+0000 7f5fdffff700 1 --2- 172.21.15.146:0/3834477339 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5fcc066f30 0x7f5fcc0693e0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:23.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.562+0000 7f5fdffff700 1 --2- 172.21.15.146:0/3834477339 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fe00cf530 0x7f5fe00cf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:23.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.562+0000 7f5fdffff700 1 --2- 172.21.15.146:0/3834477339 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5fc8003c40 0x7f5fe00c69f0 secure :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f5fd800e830 tx=0x7f5fd801a000 comp rx=0 tx=0).stop 2023-10-06T11:17:23.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.562+0000 7f5fdffff700 1 --2- 172.21.15.146:0/3834477339 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fe0158500 0x7f5fe0153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:23.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.562+0000 7f5fdffff700 1 -- 172.21.15.146:0/3834477339 >> 172.21.15.146:0/3834477339 conn(0x7f5fe00703f0 msgr2=0x7f5fe006eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:23.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.563+0000 7f5fdffff700 1 -- 172.21.15.146:0/3834477339 shutdown_connections 2023-10-06T11:17:23.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.564+0000 7f5fdffff700 1 -- 172.21.15.146:0/3834477339 wait complete. 2023-10-06T11:17:23.571 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' created 2023-10-06T11:17:23.584 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T11:17:23.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.700+0000 7f5a6f59e700 1 Processor -- start 2023-10-06T11:17:23.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.700+0000 7f5a6f59e700 1 -- start start 2023-10-06T11:17:23.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.701+0000 7f5a6f59e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5a700cb090 0x7f5a700cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:23.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.701+0000 7f5a6f59e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a70068780 0x7f5a70068b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:23.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.701+0000 7f5a6f59e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a700cc130 con 0x7f5a700b5640 2023-10-06T11:17:23.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.701+0000 7f5a6f59e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a700b2660 con 0x7f5a700cb090 2023-10-06T11:17:23.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.701+0000 7f5a6f59e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a700690d0 con 0x7f5a70068780 2023-10-06T11:17:23.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.701+0000 7f5a6dd9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5a700cb090 0x7f5a700cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:23.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.701+0000 7f5a6dd9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5a700cb090 0x7f5a700cc5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49594/0 (socket says 172.21.15.146:49594) 2023-10-06T11:17:23.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.701+0000 7f5a6dd9b700 1 -- 172.21.15.146:0/2500129710 learned_addr learned my addr 172.21.15.146:0/2500129710 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:23.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.701+0000 7f5a6ed9d700 1 --2- 172.21.15.146:0/2500129710 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a70068780 0x7f5a70068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:23.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.701+0000 7f5a6dd9b700 1 -- 172.21.15.146:0/2500129710 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a70068780 msgr2=0x7f5a70068b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:23.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.701+0000 7f5a6dd9b700 1 --2- 172.21.15.146:0/2500129710 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a70068780 0x7f5a70068b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:23.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.701+0000 7f5a6dd9b700 1 -- 172.21.15.146:0/2500129710 >> v1:172.21.15.151:6789/0 conn(0x7f5a700b5640 legacy=0x7f5a7015a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:23.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.701+0000 7f5a6dd9b700 1 -- 172.21.15.146:0/2500129710 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a700cb520 con 0x7f5a700cb090 2023-10-06T11:17:23.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.702+0000 7f5a6dd9b700 1 --2- 172.21.15.146:0/2500129710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a700cb090 0x7f5a700cc5c0 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f5a640099b0 tx=0x7f5a64009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e9c57c99a1f8882 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:23.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.702+0000 7f5a6d59a700 1 -- 172.21.15.146:0/2500129710 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a64009ea0 con 0x7f5a700cb090 2023-10-06T11:17:23.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.702+0000 7f5a6d59a700 1 -- 172.21.15.146:0/2500129710 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6400b860 con 0x7f5a700cb090 2023-10-06T11:17:23.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.702+0000 7f5a6d59a700 1 -- 172.21.15.146:0/2500129710 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6400bc00 con 0x7f5a700cb090 2023-10-06T11:17:23.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.702+0000 7f5a6f59e700 1 -- 172.21.15.146:0/2500129710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a700cb090 msgr2=0x7f5a700cc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:23.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.702+0000 7f5a6f59e700 1 --2- 172.21.15.146:0/2500129710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a700cb090 0x7f5a700cc5c0 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f5a640099b0 tx=0x7f5a64009250 comp rx=0 tx=0).stop 2023-10-06T11:17:23.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.702+0000 7f5a6f59e700 1 -- 172.21.15.146:0/2500129710 shutdown_connections 2023-10-06T11:17:23.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.702+0000 7f5a6f59e700 1 --2- 172.21.15.146:0/2500129710 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a70068780 0x7f5a70068b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:23.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.702+0000 7f5a6f59e700 1 --2- 172.21.15.146:0/2500129710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a700cb090 0x7f5a700cc5c0 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:23.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.702+0000 7f5a6f59e700 1 -- 172.21.15.146:0/2500129710 >> 172.21.15.146:0/2500129710 conn(0x7f5a700703f0 msgr2=0x7f5a700707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:23.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.702+0000 7f5a6f59e700 1 -- 172.21.15.146:0/2500129710 shutdown_connections 2023-10-06T11:17:23.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.702+0000 7f5a6f59e700 1 -- 172.21.15.146:0/2500129710 wait complete. 2023-10-06T11:17:23.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.703+0000 7f5a6f59e700 1 Processor -- start 2023-10-06T11:17:23.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.704+0000 7f5a6f59e700 1 -- start start 2023-10-06T11:17:23.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.704+0000 7f5a6f59e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a70068780 0x7f5a700c31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:23.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.704+0000 7f5a6f59e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a700b5640 0x7f5a700c3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:23.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.704+0000 7f5a6f59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a700cb090 0x7f5a7015c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:23.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.704+0000 7f5a6f59e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a700c3720 con 0x7f5a700cb090 2023-10-06T11:17:23.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.704+0000 7f5a6f59e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a700c6750 con 0x7f5a70068780 2023-10-06T11:17:23.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.704+0000 7f5a6f59e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a700c6be0 con 0x7f5a700b5640 2023-10-06T11:17:23.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.704+0000 7f5a6ed9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a700cb090 0x7f5a7015c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:23.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.704+0000 7f5a6ed9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a700cb090 0x7f5a7015c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49598/0 (socket says 172.21.15.146:49598) 2023-10-06T11:17:23.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.704+0000 7f5a6ed9d700 1 -- 172.21.15.146:0/3789638051 learned_addr learned my addr 172.21.15.146:0/3789638051 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:23.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.704+0000 7f5a6e59c700 1 --2- 172.21.15.146:0/3789638051 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a70068780 0x7f5a700c31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:23.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.704+0000 7f5a6dd9b700 1 --2- 172.21.15.146:0/3789638051 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a700b5640 0x7f5a700c3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:23.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.705+0000 7f5a6ed9d700 1 -- 172.21.15.146:0/3789638051 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a700b5640 msgr2=0x7f5a700c3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:23.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.705+0000 7f5a6ed9d700 1 --2- 172.21.15.146:0/3789638051 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a700b5640 0x7f5a700c3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:23.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.705+0000 7f5a6ed9d700 1 -- 172.21.15.146:0/3789638051 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a70068780 msgr2=0x7f5a700c31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:23.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.705+0000 7f5a6ed9d700 1 --2- 172.21.15.146:0/3789638051 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a70068780 0x7f5a700c31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:23.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.705+0000 7f5a6ed9d700 1 -- 172.21.15.146:0/3789638051 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a640094f0 con 0x7f5a700cb090 2023-10-06T11:17:23.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.705+0000 7f5a6ed9d700 1 --2- 172.21.15.146:0/3789638051 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a700cb090 0x7f5a7015c810 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f5a68009e90 tx=0x7f5a6800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:23.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.705+0000 7f5a5e7fc700 1 -- 172.21.15.146:0/3789638051 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6800cb70 con 0x7f5a700cb090 2023-10-06T11:17:23.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.705+0000 7f5a5e7fc700 1 -- 172.21.15.146:0/3789638051 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a6800f040 con 0x7f5a700cb090 2023-10-06T11:17:23.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.705+0000 7f5a6f59e700 1 -- 172.21.15.146:0/3789638051 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a700c5b40 con 0x7f5a700cb090 2023-10-06T11:17:23.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.705+0000 7f5a5e7fc700 1 -- 172.21.15.146:0/3789638051 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a68014480 con 0x7f5a700cb090 2023-10-06T11:17:23.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.705+0000 7f5a6f59e700 1 -- 172.21.15.146:0/3789638051 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a700c6100 con 0x7f5a700cb090 2023-10-06T11:17:23.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.706+0000 7f5a6f59e700 1 -- 172.21.15.146:0/3789638051 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a700c68e0 con 0x7f5a700cb090 2023-10-06T11:17:23.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.706+0000 7f5a5e7fc700 1 -- 172.21.15.146:0/3789638051 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5a680147f0 con 0x7f5a700cb090 2023-10-06T11:17:23.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.707+0000 7f5a5e7fc700 1 --2- 172.21.15.146:0/3789638051 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5a50066f30 0x7f5a500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:23.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.707+0000 7f5a5e7fc700 1 -- 172.21.15.146:0/3789638051 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f5a68085310 con 0x7f5a700cb090 2023-10-06T11:17:23.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.707+0000 7f5a6e59c700 1 --2- 172.21.15.146:0/3789638051 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5a50066f30 0x7f5a500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:23.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.707+0000 7f5a6e59c700 1 --2- 172.21.15.146:0/3789638051 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5a50066f30 0x7f5a500693e0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f5a60003a80 tx=0x7f5a60007ec0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:23.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.711+0000 7f5a5e7fc700 1 -- 172.21.15.146:0/3789638051 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a68052480 con 0x7f5a700cb090 2023-10-06T11:17:23.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:23.937+0000 7f5a6f59e700 1 -- 172.21.15.146:0/3789638051 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5a700c7c30 con 0x7f5a700cb090 2023-10-06T11:17:24.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.571+0000 7f5a5e7fc700 1 -- 172.21.15.146:0/3789638051 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 23 and data pool 24 v125) v1 ==== 174+0+0 (secure 0 0 0) 0x7f5a68055aa0 con 0x7f5a700cb090 2023-10-06T11:17:24.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.576+0000 7f5a6f59e700 1 -- 172.21.15.146:0/3789638051 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5a50066f30 msgr2=0x7f5a500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:24.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.576+0000 7f5a6f59e700 1 --2- 172.21.15.146:0/3789638051 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5a50066f30 0x7f5a500693e0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f5a60003a80 tx=0x7f5a60007ec0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.576+0000 7f5a6f59e700 1 -- 172.21.15.146:0/3789638051 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a700cb090 msgr2=0x7f5a7015c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:24.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.576+0000 7f5a6f59e700 1 --2- 172.21.15.146:0/3789638051 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a700cb090 0x7f5a7015c810 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f5a68009e90 tx=0x7f5a6800b040 comp rx=0 tx=0).stop 2023-10-06T11:17:24.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.580+0000 7f5a6f59e700 1 -- 172.21.15.146:0/3789638051 shutdown_connections 2023-10-06T11:17:24.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.580+0000 7f5a6f59e700 1 --2- 172.21.15.146:0/3789638051 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5a50066f30 0x7f5a500693e0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.580+0000 7f5a6f59e700 1 --2- 172.21.15.146:0/3789638051 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5a700cb090 0x7f5a7015c810 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.580+0000 7f5a6f59e700 1 --2- 172.21.15.146:0/3789638051 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a70068780 0x7f5a700c31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.580+0000 7f5a6f59e700 1 --2- 172.21.15.146:0/3789638051 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5a700b5640 0x7f5a700c3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.580+0000 7f5a6f59e700 1 -- 172.21.15.146:0/3789638051 >> 172.21.15.146:0/3789638051 conn(0x7f5a700703f0 msgr2=0x7f5a7015a740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:24.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.580+0000 7f5a6f59e700 1 -- 172.21.15.146:0/3789638051 shutdown_connections 2023-10-06T11:17:24.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.580+0000 7f5a6f59e700 1 -- 172.21.15.146:0/3789638051 wait complete. 2023-10-06T11:17:24.584 INFO:teuthology.orchestra.run.smithi146.stderr:new fs with metadata pool 23 and data pool 24 2023-10-06T11:17:24.597 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:17:24.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.710+0000 7f7772eeb700 1 Processor -- start 2023-10-06T11:17:24.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.710+0000 7f7772eeb700 1 -- start start 2023-10-06T11:17:24.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.711+0000 7f7772eeb700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f776c153ab0 0x7f776c15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:24.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.711+0000 7f7772eeb700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f776c153e80 0x7f776c068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:24.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.711+0000 7f7772eeb700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f776c15ac30 con 0x7f776c0689d0 2023-10-06T11:17:24.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.711+0000 7f7772eeb700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f776c068e50 con 0x7f776c153ab0 2023-10-06T11:17:24.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.711+0000 7f7772eeb700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f776c0b4510 con 0x7f776c153e80 2023-10-06T11:17:24.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.711+0000 7f7771488700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f776c0689d0 0x7f776c15d270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39662/0 (socket says 172.21.15.146:39662) 2023-10-06T11:17:24.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.711+0000 7f7771488700 1 -- 172.21.15.146:0/2974781279 learned_addr learned my addr 172.21.15.146:0/2974781279 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:17:24.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.711+0000 7f77637fe700 1 -- 172.21.15.146:0/2974781279 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3393539234 0 0) 0x7f7764001110 con 0x7f776c0689d0 2023-10-06T11:17:24.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.711+0000 7f7770c87700 1 --2- 172.21.15.146:0/2974781279 >> v2:172.21.15.151:3300/0 conn(0x7f776c153ab0 0x7f776c15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:24.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.711+0000 7f77637fe700 1 -- 172.21.15.146:0/2974781279 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7754003570 con 0x7f776c0689d0 2023-10-06T11:17:24.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.712+0000 7f7763fff700 1 --2- 172.21.15.146:0/2974781279 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f776c153e80 0x7f776c068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:24.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.712+0000 7f77637fe700 1 -- 172.21.15.146:0/2974781279 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 14673951 0 0) 0x7f7754003570 con 0x7f776c0689d0 2023-10-06T11:17:24.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.712+0000 7f77637fe700 1 -- 172.21.15.146:0/2974781279 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f776c153e80 msgr2=0x7f776c068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:24.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.712+0000 7f77637fe700 1 --2- 172.21.15.146:0/2974781279 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f776c153e80 0x7f776c068490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.712+0000 7f77637fe700 1 -- 172.21.15.146:0/2974781279 >> v2:172.21.15.151:3300/0 conn(0x7f776c153ab0 msgr2=0x7f776c15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:24.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.712+0000 7f77637fe700 1 --2- 172.21.15.146:0/2974781279 >> v2:172.21.15.151:3300/0 conn(0x7f776c153ab0 0x7f776c15a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.712+0000 7f77637fe700 1 -- 172.21.15.146:0/2974781279 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f776c0b6530 con 0x7f776c0689d0 2023-10-06T11:17:24.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.712+0000 7f77637fe700 1 -- 172.21.15.146:0/2974781279 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f7764001600 con 0x7f776c0689d0 2023-10-06T11:17:24.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.712+0000 7f77637fe700 1 -- 172.21.15.146:0/2974781279 >> v1:172.21.15.146:6789/0 conn(0x7f776c0689d0 legacy=0x7f776c15d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:24.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.712+0000 7f77637fe700 1 --2- 172.21.15.146:0/2974781279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7754003a60 0x7f7754003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:24.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.712+0000 7f77637fe700 1 --2- 172.21.15.146:0/2974781279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7754004810 0x7f7754004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:24.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.712+0000 7f77637fe700 1 --2- 172.21.15.146:0/2974781279 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f776c153e80 0x7f77540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:24.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.712+0000 7f77637fe700 1 -- 172.21.15.146:0/2974781279 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f776c068e50 con 0x7f7754003a60 2023-10-06T11:17:24.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.712+0000 7f77637fe700 1 -- 172.21.15.146:0/2974781279 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f776c0b4510 con 0x7f7754004810 2023-10-06T11:17:24.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.712+0000 7f77637fe700 1 -- 172.21.15.146:0/2974781279 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f775400ba60 con 0x7f776c153e80 2023-10-06T11:17:24.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.712+0000 7f7770c87700 1 --2- 172.21.15.146:0/2974781279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7754003a60 0x7f7754003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:24.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.712+0000 7f7771488700 1 --2- 172.21.15.146:0/2974781279 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f776c153e80 0x7f77540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:24.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.712+0000 7f7763fff700 1 --2- 172.21.15.146:0/2974781279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7754004810 0x7f7754004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:24.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.712+0000 7f7770c87700 1 -- 172.21.15.146:0/2974781279 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f776c153e80 msgr2=0x7f77540051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:24.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.712+0000 7f7770c87700 1 --2- 172.21.15.146:0/2974781279 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f776c153e80 0x7f77540051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.712+0000 7f7770c87700 1 -- 172.21.15.146:0/2974781279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7754004810 msgr2=0x7f7754004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:24.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.712+0000 7f7770c87700 1 --2- 172.21.15.146:0/2974781279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7754004810 0x7f7754004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.712+0000 7f7770c87700 1 -- 172.21.15.146:0/2974781279 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7754003570 con 0x7f7754003a60 2023-10-06T11:17:24.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.712+0000 7f7771488700 1 --2- 172.21.15.146:0/2974781279 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f776c153e80 0x7f77540051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:17:24.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.712+0000 7f7763fff700 1 --2- 172.21.15.146:0/2974781279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7754004810 0x7f7754004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:17:24.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.712+0000 7f7770c87700 1 --2- 172.21.15.146:0/2974781279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7754003a60 0x7f7754003e70 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f776800e240 tx=0x7f776800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daa179f15417450f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:24.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.713+0000 7f77637fe700 1 -- 172.21.15.146:0/2974781279 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776800eaf0 con 0x7f7754003a60 2023-10-06T11:17:24.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.713+0000 7f77637fe700 1 -- 172.21.15.146:0/2974781279 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f776800f040 con 0x7f7754003a60 2023-10-06T11:17:24.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.713+0000 7f77637fe700 1 -- 172.21.15.146:0/2974781279 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776800eea0 con 0x7f7754003a60 2023-10-06T11:17:24.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.713+0000 7f7772eeb700 1 -- 172.21.15.146:0/2974781279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7754003a60 msgr2=0x7f7754003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:24.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.713+0000 7f7772eeb700 1 --2- 172.21.15.146:0/2974781279 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7754003a60 0x7f7754003e70 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f776800e240 tx=0x7f776800b040 comp rx=0 tx=0).stop 2023-10-06T11:17:24.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.713+0000 7f7771488700 1 -- 172.21.15.146:0/2974781279 reap_dead start 2023-10-06T11:17:24.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.713+0000 7f7772eeb700 1 -- 172.21.15.146:0/2974781279 shutdown_connections 2023-10-06T11:17:24.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.713+0000 7f7772eeb700 1 -- 172.21.15.146:0/2974781279 >> 172.21.15.146:0/2974781279 conn(0x7f776c06eba0 msgr2=0x7f776c06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:24.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.713+0000 7f7772eeb700 1 -- 172.21.15.146:0/2974781279 shutdown_connections 2023-10-06T11:17:24.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.713+0000 7f7772eeb700 1 -- 172.21.15.146:0/2974781279 wait complete. 2023-10-06T11:17:24.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.714+0000 7f7772eeb700 1 Processor -- start 2023-10-06T11:17:24.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.714+0000 7f7772eeb700 1 -- start start 2023-10-06T11:17:24.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.715+0000 7f7772eeb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7754003a60 0x7f776c0cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:24.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.715+0000 7f7772eeb700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f776c156bb0 0x7f776c157020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:24.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.715+0000 7f7772eeb700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f776c0b0e90 0x7f776c0b1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:24.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.715+0000 7f7772eeb700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f776c1514e0 con 0x7f7754003a60 2023-10-06T11:17:24.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.715+0000 7f7772eeb700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f776c157560 con 0x7f776c156bb0 2023-10-06T11:17:24.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.715+0000 7f7772eeb700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f776c0b26f0 con 0x7f776c0b0e90 2023-10-06T11:17:24.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.715+0000 7f7770c87700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7754003a60 0x7f776c0cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:24.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.715+0000 7f7770c87700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7754003a60 0x7f776c0cbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49622/0 (socket says 172.21.15.146:49622) 2023-10-06T11:17:24.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.715+0000 7f7770c87700 1 -- 172.21.15.146:0/1002637544 learned_addr learned my addr 172.21.15.146:0/1002637544 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:24.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.715+0000 7f7771488700 1 --2- 172.21.15.146:0/1002637544 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f776c0b0e90 0x7f776c0b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:24.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.715+0000 7f7763fff700 1 --2- 172.21.15.146:0/1002637544 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f776c156bb0 0x7f776c157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:24.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.715+0000 7f7770c87700 1 -- 172.21.15.146:0/1002637544 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f776c0b0e90 msgr2=0x7f776c0b1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:24.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.715+0000 7f7770c87700 1 --2- 172.21.15.146:0/1002637544 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f776c0b0e90 0x7f776c0b1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.715+0000 7f7770c87700 1 -- 172.21.15.146:0/1002637544 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f776c156bb0 msgr2=0x7f776c157020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:24.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.715+0000 7f7770c87700 1 --2- 172.21.15.146:0/1002637544 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f776c156bb0 0x7f776c157020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.715+0000 7f7770c87700 1 -- 172.21.15.146:0/1002637544 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f776c0b1870 con 0x7f7754003a60 2023-10-06T11:17:24.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.716+0000 7f7770c87700 1 --2- 172.21.15.146:0/1002637544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7754003a60 0x7f776c0cbde0 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7f7768014a40 tx=0x7f776801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:24.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.716+0000 7f7760ff9700 1 -- 172.21.15.146:0/1002637544 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7768014e50 con 0x7f7754003a60 2023-10-06T11:17:24.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.716+0000 7f7760ff9700 1 -- 172.21.15.146:0/1002637544 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f776801d630 con 0x7f7754003a60 2023-10-06T11:17:24.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.716+0000 7f7772eeb700 1 -- 172.21.15.146:0/1002637544 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f776c0b1ae0 con 0x7f7754003a60 2023-10-06T11:17:24.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.716+0000 7f7760ff9700 1 -- 172.21.15.146:0/1002637544 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f776801d9f0 con 0x7f7754003a60 2023-10-06T11:17:24.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.716+0000 7f7772eeb700 1 -- 172.21.15.146:0/1002637544 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f776c0b20a0 con 0x7f7754003a60 2023-10-06T11:17:24.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.717+0000 7f7772eeb700 1 -- 172.21.15.146:0/1002637544 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f776c0b29d0 con 0x7f7754003a60 2023-10-06T11:17:24.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.717+0000 7f7760ff9700 1 -- 172.21.15.146:0/1002637544 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7768003040 con 0x7f7754003a60 2023-10-06T11:17:24.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.717+0000 7f7760ff9700 1 --2- 172.21.15.146:0/1002637544 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7758066f30 0x7f77580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:24.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.718+0000 7f7760ff9700 1 -- 172.21.15.146:0/1002637544 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7768086710 con 0x7f7754003a60 2023-10-06T11:17:24.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.718+0000 7f7763fff700 1 --2- 172.21.15.146:0/1002637544 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7758066f30 0x7f77580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:24.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.718+0000 7f7763fff700 1 --2- 172.21.15.146:0/1002637544 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7758066f30 0x7f77580693e0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f776c0684d0 tx=0x7f775c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:24.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.722+0000 7f7760ff9700 1 -- 172.21.15.146:0/1002637544 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7768053820 con 0x7f7754003a60 2023-10-06T11:17:24.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.905+0000 7f7772eeb700 1 -- 172.21.15.146:0/1002637544 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f776c04c380 con 0x7f7754003a60 2023-10-06T11:17:24.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.905+0000 7f7760ff9700 1 -- 172.21.15.146:0/1002637544 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v150) v1 ==== 74+0+16941 (secure 0 0 0) 0x7f7768056e40 con 0x7f7754003a60 2023-10-06T11:17:24.907 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:24.908 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":150,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:17:23.939017+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:17:21.595161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-10-06T11:17:23.009401+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:17:24.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.908+0000 7f7772eeb700 1 -- 172.21.15.146:0/1002637544 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7758066f30 msgr2=0x7f77580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:24.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.908+0000 7f7772eeb700 1 --2- 172.21.15.146:0/1002637544 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7758066f30 0x7f77580693e0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f776c0684d0 tx=0x7f775c008040 comp rx=0 tx=0).stop 2023-10-06T11:17:24.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.908+0000 7f7772eeb700 1 -- 172.21.15.146:0/1002637544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7754003a60 msgr2=0x7f776c0cbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:24.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.908+0000 7f7772eeb700 1 --2- 172.21.15.146:0/1002637544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7754003a60 0x7f776c0cbde0 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7f7768014a40 tx=0x7f776801a000 comp rx=0 tx=0).stop 2023-10-06T11:17:24.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.908+0000 7f7772eeb700 1 -- 172.21.15.146:0/1002637544 shutdown_connections 2023-10-06T11:17:24.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.908+0000 7f7772eeb700 1 --2- 172.21.15.146:0/1002637544 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7758066f30 0x7f77580693e0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.908+0000 7f7772eeb700 1 --2- 172.21.15.146:0/1002637544 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f776c0b0e90 0x7f776c0b1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.908+0000 7f7772eeb700 1 --2- 172.21.15.146:0/1002637544 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7754003a60 0x7f776c0cbde0 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.908+0000 7f7772eeb700 1 --2- 172.21.15.146:0/1002637544 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f776c156bb0 0x7f776c157020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:24.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.908+0000 7f7772eeb700 1 -- 172.21.15.146:0/1002637544 >> 172.21.15.146:0/1002637544 conn(0x7f776c06eba0 msgr2=0x7f776c0cf1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:24.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.908+0000 7f7772eeb700 1 -- 172.21.15.146:0/1002637544 shutdown_connections 2023-10-06T11:17:24.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:24.908+0000 7f7772eeb700 1 -- 172.21.15.146:0/1002637544 wait complete. 2023-10-06T11:17:24.922 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:17:25.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.036+0000 7f004c429700 1 Processor -- start 2023-10-06T11:17:25.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.036+0000 7f004c429700 1 -- start start 2023-10-06T11:17:25.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.037+0000 7f004c429700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0044153ab0 0x7f004415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:25.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.037+0000 7f004c429700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0044068ba0 0x7f00440b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:25.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.037+0000 7f004c429700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f004415ac30 con 0x7f0044153e80 2023-10-06T11:17:25.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.037+0000 7f004c429700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00440b4510 con 0x7f0044153ab0 2023-10-06T11:17:25.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.037+0000 7f004c429700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00440b6530 con 0x7f0044068ba0 2023-10-06T11:17:25.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.037+0000 7f004a1c5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0044153ab0 0x7f004415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:25.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.037+0000 7f00499c4700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0044153e80 0x7f0044068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39676/0 (socket says 172.21.15.146:39676) 2023-10-06T11:17:25.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.037+0000 7f00499c4700 1 -- 172.21.15.146:0/121669106 learned_addr learned my addr 172.21.15.146:0/121669106 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:17:25.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.037+0000 7f004a9c6700 1 --2- 172.21.15.146:0/121669106 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0044068ba0 0x7f00440b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:25.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.037+0000 7f004a1c5700 1 -- 172.21.15.146:0/121669106 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0044068ba0 msgr2=0x7f00440b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:25.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.037+0000 7f004a1c5700 1 --2- 172.21.15.146:0/121669106 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0044068ba0 0x7f00440b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.037+0000 7f004a1c5700 1 -- 172.21.15.146:0/121669106 >> v1:172.21.15.146:6789/0 conn(0x7f0044153e80 legacy=0x7f0044068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:25.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.037+0000 7f004a1c5700 1 -- 172.21.15.146:0/121669106 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00440b5c50 con 0x7f0044153ab0 2023-10-06T11:17:25.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.037+0000 7f00491c3700 1 -- 172.21.15.146:0/121669106 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1652864734 0 0) 0x7f0038001110 con 0x7f0044153e80 2023-10-06T11:17:25.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.037+0000 7f004a1c5700 1 --2- 172.21.15.146:0/121669106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0044153ab0 0x7f004415a6f0 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f0034009e60 tx=0x7f0034009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2440e5e7b09da93 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:25.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.037+0000 7f00491c3700 1 -- 172.21.15.146:0/121669106 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003400e070 con 0x7f0044153ab0 2023-10-06T11:17:25.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.037+0000 7f00491c3700 1 -- 172.21.15.146:0/121669106 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003400bc30 con 0x7f0044153ab0 2023-10-06T11:17:25.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.037+0000 7f00491c3700 1 -- 172.21.15.146:0/121669106 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0034012430 con 0x7f0044153ab0 2023-10-06T11:17:25.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.038+0000 7f004c429700 1 -- 172.21.15.146:0/121669106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0044153ab0 msgr2=0x7f004415a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:25.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.038+0000 7f004c429700 1 --2- 172.21.15.146:0/121669106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0044153ab0 0x7f004415a6f0 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f0034009e60 tx=0x7f0034009780 comp rx=0 tx=0).stop 2023-10-06T11:17:25.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.038+0000 7f004c429700 1 -- 172.21.15.146:0/121669106 shutdown_connections 2023-10-06T11:17:25.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.038+0000 7f004c429700 1 --2- 172.21.15.146:0/121669106 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0044068ba0 0x7f00440b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.038+0000 7f004c429700 1 --2- 172.21.15.146:0/121669106 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0044153ab0 0x7f004415a6f0 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.038+0000 7f004c429700 1 -- 172.21.15.146:0/121669106 >> 172.21.15.146:0/121669106 conn(0x7f004406eba0 msgr2=0x7f004406efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:25.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.038+0000 7f004c429700 1 -- 172.21.15.146:0/121669106 shutdown_connections 2023-10-06T11:17:25.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.038+0000 7f004c429700 1 -- 172.21.15.146:0/121669106 wait complete. 2023-10-06T11:17:25.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.039+0000 7f004c429700 1 Processor -- start 2023-10-06T11:17:25.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.039+0000 7f004c429700 1 -- start start 2023-10-06T11:17:25.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.040+0000 7f004c429700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0044068ba0 0x7f00440b2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:25.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.040+0000 7f004c429700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0044153ab0 0x7f004416d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:25.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.040+0000 7f004c429700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0044153e80 0x7f004413e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:25.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.040+0000 7f004c429700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004416e460 con 0x7f0044068ba0 2023-10-06T11:17:25.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.040+0000 7f004c429700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0044155f80 con 0x7f0044153e80 2023-10-06T11:17:25.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.040+0000 7f004c429700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f004416dea0 con 0x7f0044153ab0 2023-10-06T11:17:25.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.040+0000 7f004a1c5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0044068ba0 0x7f00440b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:25.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.040+0000 7f004a1c5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0044068ba0 0x7f00440b2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49632/0 (socket says 172.21.15.146:49632) 2023-10-06T11:17:25.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.040+0000 7f004a1c5700 1 -- 172.21.15.146:0/515103483 learned_addr learned my addr 172.21.15.146:0/515103483 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:25.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.040+0000 7f004a9c6700 1 --2- 172.21.15.146:0/515103483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0044153e80 0x7f004413e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:25.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.040+0000 7f00499c4700 1 --2- 172.21.15.146:0/515103483 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0044153ab0 0x7f004416d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:25.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.040+0000 7f004a1c5700 1 -- 172.21.15.146:0/515103483 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0044153ab0 msgr2=0x7f004416d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:25.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.040+0000 7f004a1c5700 1 --2- 172.21.15.146:0/515103483 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0044153ab0 0x7f004416d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.040+0000 7f004a1c5700 1 -- 172.21.15.146:0/515103483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0044153e80 msgr2=0x7f004413e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:25.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.040+0000 7f004a1c5700 1 --2- 172.21.15.146:0/515103483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0044153e80 0x7f004413e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.040+0000 7f004a1c5700 1 -- 172.21.15.146:0/515103483 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0034009a20 con 0x7f0044068ba0 2023-10-06T11:17:25.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.040+0000 7f004a9c6700 1 --2- 172.21.15.146:0/515103483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0044153e80 0x7f004413e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:17:25.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.040+0000 7f00499c4700 1 --2- 172.21.15.146:0/515103483 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0044153ab0 0x7f004416d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:17:25.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.041+0000 7f004a1c5700 1 --2- 172.21.15.146:0/515103483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0044068ba0 0x7f00440b2260 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f0044089010 tx=0x7f0034019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:25.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.041+0000 7f00427fc700 1 -- 172.21.15.146:0/515103483 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0034012e80 con 0x7f0044068ba0 2023-10-06T11:17:25.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.041+0000 7f00427fc700 1 -- 172.21.15.146:0/515103483 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0034027470 con 0x7f0044068ba0 2023-10-06T11:17:25.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.041+0000 7f00427fc700 1 -- 172.21.15.146:0/515103483 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0034027810 con 0x7f0044068ba0 2023-10-06T11:17:25.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.041+0000 7f004c429700 1 -- 172.21.15.146:0/515103483 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f004416e180 con 0x7f0044068ba0 2023-10-06T11:17:25.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.041+0000 7f004c429700 1 -- 172.21.15.146:0/515103483 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0044151670 con 0x7f0044068ba0 2023-10-06T11:17:25.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.042+0000 7f004c429700 1 -- 172.21.15.146:0/515103483 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0044155a70 con 0x7f0044068ba0 2023-10-06T11:17:25.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.042+0000 7f00427fc700 1 -- 172.21.15.146:0/515103483 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0034024070 con 0x7f0044068ba0 2023-10-06T11:17:25.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.042+0000 7f00427fc700 1 --2- 172.21.15.146:0/515103483 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0030066f30 0x7f00300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:25.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.043+0000 7f00499c4700 1 --2- 172.21.15.146:0/515103483 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0030066f30 0x7f00300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:25.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.043+0000 7f00427fc700 1 -- 172.21.15.146:0/515103483 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0034087220 con 0x7f0044068ba0 2023-10-06T11:17:25.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.043+0000 7f00499c4700 1 --2- 172.21.15.146:0/515103483 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0030066f30 0x7f00300693e0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f00441527c0 tx=0x7f0038009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:25.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.047+0000 7f00427fc700 1 -- 172.21.15.146:0/515103483 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0044155a70 con 0x7f0044068ba0 2023-10-06T11:17:25.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.232+0000 7f004c429700 1 -- 172.21.15.146:0/515103483 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0044155a70 con 0x7f0044068ba0 2023-10-06T11:17:25.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.233+0000 7f00427fc700 1 -- 172.21.15.146:0/515103483 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v150) v1 ==== 74+0+16941 (secure 0 0 0) 0x7f0044155a70 con 0x7f0044068ba0 2023-10-06T11:17:25.235 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:25.235 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":150,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:17:23.939017+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:17:21.595161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-10-06T11:17:23.009401+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:17:25.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.235+0000 7f004c429700 1 -- 172.21.15.146:0/515103483 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0030066f30 msgr2=0x7f00300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:25.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.235+0000 7f004c429700 1 --2- 172.21.15.146:0/515103483 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0030066f30 0x7f00300693e0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f00441527c0 tx=0x7f0038009040 comp rx=0 tx=0).stop 2023-10-06T11:17:25.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.235+0000 7f004c429700 1 -- 172.21.15.146:0/515103483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0044068ba0 msgr2=0x7f00440b2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:25.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.235+0000 7f004c429700 1 --2- 172.21.15.146:0/515103483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0044068ba0 0x7f00440b2260 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f0044089010 tx=0x7f0034019000 comp rx=0 tx=0).stop 2023-10-06T11:17:25.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.235+0000 7f004c429700 1 -- 172.21.15.146:0/515103483 shutdown_connections 2023-10-06T11:17:25.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.235+0000 7f004c429700 1 --2- 172.21.15.146:0/515103483 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0030066f30 0x7f00300693e0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.235+0000 7f004c429700 1 --2- 172.21.15.146:0/515103483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0044153e80 0x7f004413e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.235+0000 7f004c429700 1 --2- 172.21.15.146:0/515103483 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0044068ba0 0x7f00440b2260 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.235+0000 7f004c429700 1 --2- 172.21.15.146:0/515103483 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0044153ab0 0x7f004416d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.235+0000 7f004c429700 1 -- 172.21.15.146:0/515103483 >> 172.21.15.146:0/515103483 conn(0x7f004406eba0 msgr2=0x7f00440d0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:25.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.235+0000 7f004c429700 1 -- 172.21.15.146:0/515103483 shutdown_connections 2023-10-06T11:17:25.238 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.235+0000 7f004c429700 1 -- 172.21.15.146:0/515103483 wait complete. 2023-10-06T11:17:25.250 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T11:17:25.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.365+0000 7f0c8bcaf700 1 Processor -- start 2023-10-06T11:17:25.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.366+0000 7f0c8bcaf700 1 -- start start 2023-10-06T11:17:25.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.366+0000 7f0c8bcaf700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0c8415a160 0x7f0c840c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:25.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.366+0000 7f0c8bcaf700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0c840cb950 0x7f0c840cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:25.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.366+0000 7f0c8bcaf700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c840ae2a0 con 0x7f0c840ae730 2023-10-06T11:17:25.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.366+0000 7f0c8bcaf700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c8415a530 con 0x7f0c840cb950 2023-10-06T11:17:25.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.366+0000 7f0c8bcaf700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c840ad690 con 0x7f0c8415a160 2023-10-06T11:17:25.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.366+0000 7f0c8a24c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0c840cb950 0x7f0c840cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:25.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.367+0000 7f0c8a24c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0c840cb950 0x7f0c840cbd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49642/0 (socket says 172.21.15.146:49642) 2023-10-06T11:17:25.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.367+0000 7f0c8a24c700 1 -- 172.21.15.146:0/1045831143 learned_addr learned my addr 172.21.15.146:0/1045831143 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:25.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.367+0000 7f0c89a4b700 1 --2- 172.21.15.146:0/1045831143 >> v2:172.21.15.151:3300/0 conn(0x7f0c8415a160 0x7f0c840c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:25.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.367+0000 7f0c8a24c700 1 -- 172.21.15.146:0/1045831143 >> v2:172.21.15.151:3300/0 conn(0x7f0c8415a160 msgr2=0x7f0c840c55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:25.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.367+0000 7f0c8a24c700 1 --2- 172.21.15.146:0/1045831143 >> v2:172.21.15.151:3300/0 conn(0x7f0c8415a160 0x7f0c840c55a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.367+0000 7f0c8a24c700 1 -- 172.21.15.146:0/1045831143 >> v1:172.21.15.151:6789/0 conn(0x7f0c840ae730 legacy=0x7f0c840aebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:25.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.367+0000 7f0c8a24c700 1 -- 172.21.15.146:0/1045831143 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c840ad970 con 0x7f0c840cb950 2023-10-06T11:17:25.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.367+0000 7f0c89a4b700 1 --2- 172.21.15.146:0/1045831143 >> v2:172.21.15.151:3300/0 conn(0x7f0c8415a160 0x7f0c840c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:17:25.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.367+0000 7f0c8a24c700 1 --2- 172.21.15.146:0/1045831143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c840cb950 0x7f0c840cbd70 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f0c84065100 tx=0x7f0c7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fac356bc720248c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:25.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.367+0000 7f0c88a49700 1 -- 172.21.15.146:0/1045831143 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c00b820 con 0x7f0c840cb950 2023-10-06T11:17:25.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.367+0000 7f0c88a49700 1 -- 172.21.15.146:0/1045831143 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7c00b980 con 0x7f0c840cb950 2023-10-06T11:17:25.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.367+0000 7f0c88a49700 1 -- 172.21.15.146:0/1045831143 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c00bd20 con 0x7f0c840cb950 2023-10-06T11:17:25.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.368+0000 7f0c8bcaf700 1 -- 172.21.15.146:0/1045831143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c840cb950 msgr2=0x7f0c840cbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:25.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.368+0000 7f0c8bcaf700 1 --2- 172.21.15.146:0/1045831143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c840cb950 0x7f0c840cbd70 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f0c84065100 tx=0x7f0c7c009250 comp rx=0 tx=0).stop 2023-10-06T11:17:25.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.368+0000 7f0c8bcaf700 1 -- 172.21.15.146:0/1045831143 shutdown_connections 2023-10-06T11:17:25.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.368+0000 7f0c8bcaf700 1 --2- 172.21.15.146:0/1045831143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c840cb950 0x7f0c840cbd70 unknown :-1 s=CLOSED pgs=1939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.368+0000 7f0c8bcaf700 1 --2- 172.21.15.146:0/1045831143 >> v2:172.21.15.151:3300/0 conn(0x7f0c8415a160 0x7f0c840c55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.368+0000 7f0c8bcaf700 1 -- 172.21.15.146:0/1045831143 >> 172.21.15.146:0/1045831143 conn(0x7f0c8406f380 msgr2=0x7f0c840d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:25.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.368+0000 7f0c8bcaf700 1 -- 172.21.15.146:0/1045831143 shutdown_connections 2023-10-06T11:17:25.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.368+0000 7f0c8bcaf700 1 -- 172.21.15.146:0/1045831143 wait complete. 2023-10-06T11:17:25.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.369+0000 7f0c8bcaf700 1 Processor -- start 2023-10-06T11:17:25.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.369+0000 7f0c8bcaf700 1 -- start start 2023-10-06T11:17:25.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.370+0000 7f0c8bcaf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c840ae730 0x7f0c840b5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:25.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.370+0000 7f0c8bcaf700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c840cb950 0x7f0c840b4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:25.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.370+0000 7f0c8bcaf700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c8415a160 0x7f0c840b4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:25.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.370+0000 7f0c8bcaf700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c840b6070 con 0x7f0c840ae730 2023-10-06T11:17:25.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.370+0000 7f0c8bcaf700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c840c87a0 con 0x7f0c840cb950 2023-10-06T11:17:25.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.370+0000 7f0c8bcaf700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c840c7b90 con 0x7f0c8415a160 2023-10-06T11:17:25.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.370+0000 7f0c89a4b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c840ae730 0x7f0c840b5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:25.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.370+0000 7f0c89a4b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c840ae730 0x7f0c840b5b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49656/0 (socket says 172.21.15.146:49656) 2023-10-06T11:17:25.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.370+0000 7f0c89a4b700 1 -- 172.21.15.146:0/3281460086 learned_addr learned my addr 172.21.15.146:0/3281460086 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:25.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.370+0000 7f0c8924a700 1 --2- 172.21.15.146:0/3281460086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c840cb950 0x7f0c840b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:25.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.370+0000 7f0c8a24c700 1 --2- 172.21.15.146:0/3281460086 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c8415a160 0x7f0c840b4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:25.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.370+0000 7f0c89a4b700 1 -- 172.21.15.146:0/3281460086 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c8415a160 msgr2=0x7f0c840b4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:25.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.370+0000 7f0c89a4b700 1 --2- 172.21.15.146:0/3281460086 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c8415a160 0x7f0c840b4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.370+0000 7f0c89a4b700 1 -- 172.21.15.146:0/3281460086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c840cb950 msgr2=0x7f0c840b4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:25.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.370+0000 7f0c89a4b700 1 --2- 172.21.15.146:0/3281460086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c840cb950 0x7f0c840b4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:25.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.370+0000 7f0c89a4b700 1 -- 172.21.15.146:0/3281460086 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c7c0094f0 con 0x7f0c840ae730 2023-10-06T11:17:25.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.370+0000 7f0c8a24c700 1 --2- 172.21.15.146:0/3281460086 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c8415a160 0x7f0c840b4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:17:25.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.370+0000 7f0c89a4b700 1 --2- 172.21.15.146:0/3281460086 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c840ae730 0x7f0c840b5b30 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f0c8000a300 tx=0x7f0c800078c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:25.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.370+0000 7f0c79ffb700 1 -- 172.21.15.146:0/3281460086 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c80015440 con 0x7f0c840ae730 2023-10-06T11:17:25.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.370+0000 7f0c79ffb700 1 -- 172.21.15.146:0/3281460086 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c800155a0 con 0x7f0c840ae730 2023-10-06T11:17:25.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.370+0000 7f0c8bcaf700 1 -- 172.21.15.146:0/3281460086 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c840c7e70 con 0x7f0c840ae730 2023-10-06T11:17:25.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.370+0000 7f0c79ffb700 1 -- 172.21.15.146:0/3281460086 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c80015940 con 0x7f0c840ae730 2023-10-06T11:17:25.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.371+0000 7f0c8bcaf700 1 -- 172.21.15.146:0/3281460086 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c840c8430 con 0x7f0c840ae730 2023-10-06T11:17:25.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.371+0000 7f0c8bcaf700 1 -- 172.21.15.146:0/3281460086 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c84068390 con 0x7f0c840ae730 2023-10-06T11:17:25.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.372+0000 7f0c79ffb700 1 -- 172.21.15.146:0/3281460086 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0c80015cf0 con 0x7f0c840ae730 2023-10-06T11:17:25.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.372+0000 7f0c79ffb700 1 --2- 172.21.15.146:0/3281460086 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0c68066f30 0x7f0c680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:25.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.372+0000 7f0c79ffb700 1 -- 172.21.15.146:0/3281460086 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0c80084d10 con 0x7f0c840ae730 2023-10-06T11:17:25.383 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.372+0000 7f0c8924a700 1 --2- 172.21.15.146:0/3281460086 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0c68066f30 0x7f0c680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:25.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.372+0000 7f0c8924a700 1 --2- 172.21.15.146:0/3281460086 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0c68066f30 0x7f0c680693e0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f0c840cc600 tx=0x7f0c74007ea0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:25.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.376+0000 7f0c79ffb700 1 -- 172.21.15.146:0/3281460086 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0c8004e5a0 con 0x7f0c840ae730 2023-10-06T11:17:25.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:25.612+0000 7f0c8bcaf700 1 -- 172.21.15.146:0/3281460086 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0c8404c380 con 0x7f0c840ae730 2023-10-06T11:17:26.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.570+0000 7f0c79ffb700 1 -- 172.21.15.146:0/3281460086 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v127) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0c8001a020 con 0x7f0c840ae730 2023-10-06T11:17:26.575 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.573+0000 7f0c8bcaf700 1 -- 172.21.15.146:0/3281460086 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0c68066f30 msgr2=0x7f0c680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:26.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.573+0000 7f0c8bcaf700 1 --2- 172.21.15.146:0/3281460086 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0c68066f30 0x7f0c680693e0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f0c840cc600 tx=0x7f0c74007ea0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.573+0000 7f0c8bcaf700 1 -- 172.21.15.146:0/3281460086 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c840ae730 msgr2=0x7f0c840b5b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:26.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.573+0000 7f0c8bcaf700 1 --2- 172.21.15.146:0/3281460086 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c840ae730 0x7f0c840b5b30 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f0c8000a300 tx=0x7f0c800078c0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.573+0000 7f0c8bcaf700 1 -- 172.21.15.146:0/3281460086 shutdown_connections 2023-10-06T11:17:26.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.573+0000 7f0c8bcaf700 1 --2- 172.21.15.146:0/3281460086 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0c68066f30 0x7f0c680693e0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.573+0000 7f0c8bcaf700 1 --2- 172.21.15.146:0/3281460086 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c8415a160 0x7f0c840b4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.573+0000 7f0c8bcaf700 1 --2- 172.21.15.146:0/3281460086 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c840ae730 0x7f0c840b5b30 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.573+0000 7f0c8bcaf700 1 --2- 172.21.15.146:0/3281460086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c840cb950 0x7f0c840b4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.573+0000 7f0c8bcaf700 1 -- 172.21.15.146:0/3281460086 >> 172.21.15.146:0/3281460086 conn(0x7f0c8406f380 msgr2=0x7f0c84152460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:26.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.574+0000 7f0c8bcaf700 1 -- 172.21.15.146:0/3281460086 shutdown_connections 2023-10-06T11:17:26.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.574+0000 7f0c8bcaf700 1 -- 172.21.15.146:0/3281460086 wait complete. 2023-10-06T11:17:26.590 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T11:17:26.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.712+0000 7ff8f61fa700 1 Processor -- start 2023-10-06T11:17:26.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.712+0000 7ff8f61fa700 1 -- start start 2023-10-06T11:17:26.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.712+0000 7ff8f61fa700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8f00cbdb0 0x7ff8f0164ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:26.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.712+0000 7ff8f61fa700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8f00d1670 con 0x7ff8f0159f40 2023-10-06T11:17:26.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.712+0000 7ff8f61fa700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8f00cee70 con 0x7ff8f00c7810 2023-10-06T11:17:26.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.712+0000 7ff8f61fa700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f00cc4b0 con 0x7ff8f00cbdb0 2023-10-06T11:17:26.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.713+0000 7ff8ef7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff8f0159f40 0x7ff8f015d9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39686/0 (socket says 172.21.15.146:39686) 2023-10-06T11:17:26.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.713+0000 7ff8ef7fe700 1 -- 172.21.15.146:0/3791120670 learned_addr learned my addr 172.21.15.146:0/3791120670 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:17:26.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.713+0000 7ff8ee7fc700 1 -- 172.21.15.146:0/3791120670 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 342095265 0 0) 0x7ff8f00d1670 con 0x7ff8f0159f40 2023-10-06T11:17:26.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.713+0000 7ff8effff700 1 --2- 172.21.15.146:0/3791120670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8f00cbdb0 0x7ff8f0164ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:26.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.713+0000 7ff8ee7fc700 1 -- 172.21.15.146:0/3791120670 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8d8003570 con 0x7ff8f0159f40 2023-10-06T11:17:26.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.713+0000 7ff8ee7fc700 1 -- 172.21.15.146:0/3791120670 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2705839334 0 0) 0x7ff8d8003570 con 0x7ff8f0159f40 2023-10-06T11:17:26.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.713+0000 7ff8ee7fc700 1 -- 172.21.15.146:0/3791120670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8f00cbdb0 msgr2=0x7ff8f0164ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:26.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.713+0000 7ff8ee7fc700 1 --2- 172.21.15.146:0/3791120670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8f00cbdb0 0x7ff8f0164ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.713+0000 7ff8ee7fc700 1 -- 172.21.15.146:0/3791120670 >> v1:172.21.15.151:6789/0 conn(0x7ff8f00c7810 legacy=0x7ff8f015e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:26.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.713+0000 7ff8ee7fc700 1 -- 172.21.15.146:0/3791120670 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f00cc250 con 0x7ff8f0159f40 2023-10-06T11:17:26.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.713+0000 7ff8ee7fc700 1 -- 172.21.15.146:0/3791120670 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7ff8e0001970 con 0x7ff8f0159f40 2023-10-06T11:17:26.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.713+0000 7ff8ee7fc700 1 -- 172.21.15.146:0/3791120670 >> v1:172.21.15.146:6789/0 conn(0x7ff8f0159f40 legacy=0x7ff8f015d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:26.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.713+0000 7ff8ee7fc700 1 --2- 172.21.15.146:0/3791120670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8d8003a90 0x7ff8d8003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:26.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.713+0000 7ff8ee7fc700 1 --2- 172.21.15.146:0/3791120670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8d8004810 0x7ff8d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:26.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.713+0000 7ff8ee7fc700 1 --2- 172.21.15.146:0/3791120670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8f00cbdb0 0x7ff8d80051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:26.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.713+0000 7ff8ee7fc700 1 -- 172.21.15.146:0/3791120670 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f00cc4b0 con 0x7ff8d8003a90 2023-10-06T11:17:26.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.713+0000 7ff8ee7fc700 1 -- 172.21.15.146:0/3791120670 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d800bb90 con 0x7ff8d8004810 2023-10-06T11:17:26.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.713+0000 7ff8ee7fc700 1 -- 172.21.15.146:0/3791120670 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d800bd50 con 0x7ff8f00cbdb0 2023-10-06T11:17:26.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.713+0000 7ff8ef7fe700 1 --2- 172.21.15.146:0/3791120670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8d8003a90 0x7ff8d8003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:26.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.713+0000 7ff8effff700 1 --2- 172.21.15.146:0/3791120670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8f00cbdb0 0x7ff8d80051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:26.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.713+0000 7ff8eeffd700 1 --2- 172.21.15.146:0/3791120670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8d8004810 0x7ff8d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:26.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.714+0000 7ff8ef7fe700 1 -- 172.21.15.146:0/3791120670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8f00cbdb0 msgr2=0x7ff8d80051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:26.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.714+0000 7ff8ef7fe700 1 --2- 172.21.15.146:0/3791120670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8f00cbdb0 0x7ff8d80051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.714+0000 7ff8ef7fe700 1 -- 172.21.15.146:0/3791120670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8d8004810 msgr2=0x7ff8d8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:26.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.714+0000 7ff8ef7fe700 1 --2- 172.21.15.146:0/3791120670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8d8004810 0x7ff8d8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.714+0000 7ff8ef7fe700 1 -- 172.21.15.146:0/3791120670 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d8003570 con 0x7ff8d8003a90 2023-10-06T11:17:26.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.714+0000 7ff8ef7fe700 1 --2- 172.21.15.146:0/3791120670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8d8003a90 0x7ff8d8003ea0 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7ff8e000c670 tx=0x7ff8e0007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82ddd1e156871fd1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:26.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.714+0000 7ff8ee7fc700 1 -- 172.21.15.146:0/3791120670 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e0005b70 con 0x7ff8d8003a90 2023-10-06T11:17:26.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.714+0000 7ff8ee7fc700 1 -- 172.21.15.146:0/3791120670 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e0005cf0 con 0x7ff8d8003a90 2023-10-06T11:17:26.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.714+0000 7ff8ee7fc700 1 -- 172.21.15.146:0/3791120670 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e0007360 con 0x7ff8d8003a90 2023-10-06T11:17:26.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.714+0000 7ff8f61fa700 1 -- 172.21.15.146:0/3791120670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8d8003a90 msgr2=0x7ff8d8003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:26.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.714+0000 7ff8f61fa700 1 --2- 172.21.15.146:0/3791120670 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8d8003a90 0x7ff8d8003ea0 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7ff8e000c670 tx=0x7ff8e0007ca0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.714+0000 7ff8effff700 1 -- 172.21.15.146:0/3791120670 reap_dead start 2023-10-06T11:17:26.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.714+0000 7ff8f61fa700 1 -- 172.21.15.146:0/3791120670 shutdown_connections 2023-10-06T11:17:26.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.714+0000 7ff8f61fa700 1 -- 172.21.15.146:0/3791120670 >> 172.21.15.146:0/3791120670 conn(0x7ff8f006f380 msgr2=0x7ff8f00d0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:26.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.714+0000 7ff8f61fa700 1 -- 172.21.15.146:0/3791120670 shutdown_connections 2023-10-06T11:17:26.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.714+0000 7ff8f61fa700 1 -- 172.21.15.146:0/3791120670 wait complete. 2023-10-06T11:17:26.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.716+0000 7ff8f61fa700 1 Processor -- start 2023-10-06T11:17:26.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.716+0000 7ff8f61fa700 1 -- start start 2023-10-06T11:17:26.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.716+0000 7ff8f61fa700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8d8003a90 0x7ff8f016a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:26.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.716+0000 7ff8f61fa700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8f00c6140 0x7ff8f0155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:26.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.716+0000 7ff8f61fa700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8f0069890 0x7ff8f0069d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:26.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.716+0000 7ff8f61fa700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f009a6b0 con 0x7ff8f0069890 2023-10-06T11:17:26.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.716+0000 7ff8f61fa700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f006a270 con 0x7ff8f00c6140 2023-10-06T11:17:26.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.717+0000 7ff8f61fa700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f0156280 con 0x7ff8d8003a90 2023-10-06T11:17:26.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.717+0000 7ff8effff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8f0069890 0x7ff8f0069d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:26.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.717+0000 7ff8effff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8f0069890 0x7ff8f0069d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49674/0 (socket says 172.21.15.146:49674) 2023-10-06T11:17:26.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.717+0000 7ff8effff700 1 -- 172.21.15.146:0/147713109 learned_addr learned my addr 172.21.15.146:0/147713109 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:26.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.717+0000 7ff8ef7fe700 1 --2- 172.21.15.146:0/147713109 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8d8003a90 0x7ff8f016a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:26.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.717+0000 7ff8eeffd700 1 --2- 172.21.15.146:0/147713109 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8f00c6140 0x7ff8f0155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:26.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.717+0000 7ff8effff700 1 -- 172.21.15.146:0/147713109 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8d8003a90 msgr2=0x7ff8f016a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:26.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.717+0000 7ff8effff700 1 --2- 172.21.15.146:0/147713109 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8d8003a90 0x7ff8f016a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.717+0000 7ff8effff700 1 -- 172.21.15.146:0/147713109 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8f00c6140 msgr2=0x7ff8f0155d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:26.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.717+0000 7ff8effff700 1 --2- 172.21.15.146:0/147713109 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8f00c6140 0x7ff8f0155d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:26.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.717+0000 7ff8effff700 1 -- 172.21.15.146:0/147713109 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f00c70e0 con 0x7ff8f0069890 2023-10-06T11:17:26.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.717+0000 7ff8ef7fe700 1 --2- 172.21.15.146:0/147713109 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8d8003a90 0x7ff8f016a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:17:26.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.717+0000 7ff8effff700 1 --2- 172.21.15.146:0/147713109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8f0069890 0x7ff8f0069d30 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7ff8f00d07d0 tx=0x7ff8e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:26.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.717+0000 7ff8d77fe700 1 -- 172.21.15.146:0/147713109 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e800f7d0 con 0x7ff8f0069890 2023-10-06T11:17:26.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.717+0000 7ff8d77fe700 1 -- 172.21.15.146:0/147713109 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e800f930 con 0x7ff8f0069890 2023-10-06T11:17:26.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.717+0000 7ff8d77fe700 1 -- 172.21.15.146:0/147713109 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e800fcd0 con 0x7ff8f0069890 2023-10-06T11:17:26.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.717+0000 7ff8f61fa700 1 -- 172.21.15.146:0/147713109 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8f00c65b0 con 0x7ff8f0069890 2023-10-06T11:17:26.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.717+0000 7ff8f61fa700 1 -- 172.21.15.146:0/147713109 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8f00c6b20 con 0x7ff8f0069890 2023-10-06T11:17:26.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.718+0000 7ff8f61fa700 1 -- 172.21.15.146:0/147713109 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8f004c380 con 0x7ff8f0069890 2023-10-06T11:17:26.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.719+0000 7ff8d77fe700 1 -- 172.21.15.146:0/147713109 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff8e8014650 con 0x7ff8f0069890 2023-10-06T11:17:26.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.719+0000 7ff8d77fe700 1 --2- 172.21.15.146:0/147713109 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff8dc066f30 0x7ff8dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:26.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.719+0000 7ff8d77fe700 1 -- 172.21.15.146:0/147713109 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff8e8084c30 con 0x7ff8f0069890 2023-10-06T11:17:26.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.719+0000 7ff8ef7fe700 1 --2- 172.21.15.146:0/147713109 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff8dc066f30 0x7ff8dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:26.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.719+0000 7ff8ef7fe700 1 --2- 172.21.15.146:0/147713109 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff8dc066f30 0x7ff8dc0693e0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7ff8e000c670 tx=0x7ff8e0015000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:26.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.723+0000 7ff8d77fe700 1 -- 172.21.15.146:0/147713109 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff8e8051dc0 con 0x7ff8f0069890 2023-10-06T11:17:26.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:26.950+0000 7ff8f61fa700 1 -- 172.21.15.146:0/147713109 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff8f00cdfd0 con 0x7ff8f0069890 2023-10-06T11:17:27.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.575+0000 7ff8d77fe700 1 -- 172.21.15.146:0/147713109 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v128) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff8e80220c0 con 0x7ff8f0069890 2023-10-06T11:17:27.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.577+0000 7ff8f61fa700 1 -- 172.21.15.146:0/147713109 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff8dc066f30 msgr2=0x7ff8dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:27.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.577+0000 7ff8f61fa700 1 --2- 172.21.15.146:0/147713109 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff8dc066f30 0x7ff8dc0693e0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7ff8e000c670 tx=0x7ff8e0015000 comp rx=0 tx=0).stop 2023-10-06T11:17:27.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.577+0000 7ff8f61fa700 1 -- 172.21.15.146:0/147713109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8f0069890 msgr2=0x7ff8f0069d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:27.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.577+0000 7ff8f61fa700 1 --2- 172.21.15.146:0/147713109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8f0069890 0x7ff8f0069d30 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7ff8f00d07d0 tx=0x7ff8e80091a0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.577+0000 7ff8f61fa700 1 -- 172.21.15.146:0/147713109 shutdown_connections 2023-10-06T11:17:27.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.578+0000 7ff8f61fa700 1 --2- 172.21.15.146:0/147713109 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff8dc066f30 0x7ff8dc0693e0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.578+0000 7ff8f61fa700 1 --2- 172.21.15.146:0/147713109 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8f0069890 0x7ff8f0069d30 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.578+0000 7ff8f61fa700 1 --2- 172.21.15.146:0/147713109 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8d8003a90 0x7ff8f016a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.578+0000 7ff8f61fa700 1 --2- 172.21.15.146:0/147713109 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8f00c6140 0x7ff8f0155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.578+0000 7ff8f61fa700 1 -- 172.21.15.146:0/147713109 >> 172.21.15.146:0/147713109 conn(0x7ff8f006f380 msgr2=0x7ff8f0156b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:27.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.578+0000 7ff8f61fa700 1 -- 172.21.15.146:0/147713109 shutdown_connections 2023-10-06T11:17:27.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.578+0000 7ff8f61fa700 1 -- 172.21.15.146:0/147713109 wait complete. 2023-10-06T11:17:27.595 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:17:27.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.709+0000 7f34c7ff3700 1 Processor -- start 2023-10-06T11:17:27.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.709+0000 7f34c7ff3700 1 -- start start 2023-10-06T11:17:27.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.710+0000 7f34c7ff3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34c0153ab0 0x7f34c015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:27.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.710+0000 7f34c7ff3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f34c0068ba0 0x7f34c00b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:27.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.710+0000 7f34c7ff3700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34c015ac30 con 0x7f34c0153e80 2023-10-06T11:17:27.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.710+0000 7f34c7ff3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34c00b4510 con 0x7f34c0068ba0 2023-10-06T11:17:27.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.710+0000 7f34c7ff3700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34c00b6530 con 0x7f34c0153ab0 2023-10-06T11:17:27.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.710+0000 7f34c6590700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f34c0068ba0 0x7f34c00b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:27.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.710+0000 7f34c6590700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f34c0068ba0 0x7f34c00b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49676/0 (socket says 172.21.15.146:49676) 2023-10-06T11:17:27.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.711+0000 7f34c6590700 1 -- 172.21.15.146:0/1874110046 learned_addr learned my addr 172.21.15.146:0/1874110046 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:27.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.711+0000 7f34c5d8f700 1 --2- 172.21.15.146:0/1874110046 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34c0153ab0 0x7f34c015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:27.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.711+0000 7f34c6590700 1 -- 172.21.15.146:0/1874110046 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34c0153ab0 msgr2=0x7f34c015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:27.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.711+0000 7f34c6590700 1 --2- 172.21.15.146:0/1874110046 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34c0153ab0 0x7f34c015a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.711+0000 7f34c6590700 1 -- 172.21.15.146:0/1874110046 >> v1:172.21.15.151:6789/0 conn(0x7f34c0153e80 legacy=0x7f34c0068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:27.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.711+0000 7f34c6590700 1 -- 172.21.15.146:0/1874110046 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c00b5c50 con 0x7f34c0068ba0 2023-10-06T11:17:27.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.711+0000 7f34c5d8f700 1 --2- 172.21.15.146:0/1874110046 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34c0153ab0 0x7f34c015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:17:27.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.711+0000 7f34c6590700 1 --2- 172.21.15.146:0/1874110046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34c0068ba0 0x7f34c00b49a0 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7f34b80099b0 tx=0x7f34b8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11e80e43ec613fad server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:27.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.711+0000 7f34c4d8d700 1 -- 172.21.15.146:0/1874110046 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b800b820 con 0x7f34c0068ba0 2023-10-06T11:17:27.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.711+0000 7f34c4d8d700 1 -- 172.21.15.146:0/1874110046 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b800b980 con 0x7f34c0068ba0 2023-10-06T11:17:27.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.711+0000 7f34c4d8d700 1 -- 172.21.15.146:0/1874110046 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b800bd20 con 0x7f34c0068ba0 2023-10-06T11:17:27.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.712+0000 7f34c7ff3700 1 -- 172.21.15.146:0/1874110046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34c0068ba0 msgr2=0x7f34c00b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:27.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.712+0000 7f34c7ff3700 1 --2- 172.21.15.146:0/1874110046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34c0068ba0 0x7f34c00b49a0 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7f34b80099b0 tx=0x7f34b8009250 comp rx=0 tx=0).stop 2023-10-06T11:17:27.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.712+0000 7f34c7ff3700 1 -- 172.21.15.146:0/1874110046 shutdown_connections 2023-10-06T11:17:27.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.712+0000 7f34c7ff3700 1 --2- 172.21.15.146:0/1874110046 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34c0068ba0 0x7f34c00b49a0 unknown :-1 s=CLOSED pgs=1944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.712+0000 7f34c7ff3700 1 --2- 172.21.15.146:0/1874110046 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34c0153ab0 0x7f34c015a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.712+0000 7f34c7ff3700 1 -- 172.21.15.146:0/1874110046 >> 172.21.15.146:0/1874110046 conn(0x7f34c006eba0 msgr2=0x7f34c006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:27.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.712+0000 7f34c7ff3700 1 -- 172.21.15.146:0/1874110046 shutdown_connections 2023-10-06T11:17:27.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.712+0000 7f34c7ff3700 1 -- 172.21.15.146:0/1874110046 wait complete. 2023-10-06T11:17:27.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.713+0000 7f34c7ff3700 1 Processor -- start 2023-10-06T11:17:27.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.713+0000 7f34c7ff3700 1 -- start start 2023-10-06T11:17:27.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.713+0000 7f34c7ff3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34c0068ba0 0x7f34c0156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:27.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.713+0000 7f34c7ff3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34c0153ab0 0x7f34c014f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:27.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.713+0000 7f34c7ff3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34c0153e80 0x7f34c00cf340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:27.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.713+0000 7f34c7ff3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c016db60 con 0x7f34c0153e80 2023-10-06T11:17:27.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.713+0000 7f34c7ff3700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c0150450 con 0x7f34c0068ba0 2023-10-06T11:17:27.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.713+0000 7f34c7ff3700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34c016cf50 con 0x7f34c0153ab0 2023-10-06T11:17:27.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.714+0000 7f34c6590700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34c0153e80 0x7f34c00cf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:27.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.714+0000 7f34c6590700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34c0153e80 0x7f34c00cf340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49686/0 (socket says 172.21.15.146:49686) 2023-10-06T11:17:27.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.714+0000 7f34c6590700 1 -- 172.21.15.146:0/181339359 learned_addr learned my addr 172.21.15.146:0/181339359 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:27.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.714+0000 7f34c5d8f700 1 --2- 172.21.15.146:0/181339359 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34c0068ba0 0x7f34c0156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:27.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.714+0000 7f34c558e700 1 --2- 172.21.15.146:0/181339359 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34c0153ab0 0x7f34c014f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:27.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.714+0000 7f34c6590700 1 -- 172.21.15.146:0/181339359 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34c0153ab0 msgr2=0x7f34c014f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:27.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.714+0000 7f34c6590700 1 --2- 172.21.15.146:0/181339359 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34c0153ab0 0x7f34c014f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.714+0000 7f34c6590700 1 -- 172.21.15.146:0/181339359 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34c0068ba0 msgr2=0x7f34c0156de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:27.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.714+0000 7f34c6590700 1 --2- 172.21.15.146:0/181339359 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34c0068ba0 0x7f34c0156de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.714+0000 7f34c6590700 1 -- 172.21.15.146:0/181339359 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b80094f0 con 0x7f34c0153e80 2023-10-06T11:17:27.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.714+0000 7f34c6590700 1 --2- 172.21.15.146:0/181339359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34c0153e80 0x7f34c00cf340 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7f34b80030c0 tx=0x7f34b8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:27.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.714+0000 7f34b5ffb700 1 -- 172.21.15.146:0/181339359 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b8011ea0 con 0x7f34c0153e80 2023-10-06T11:17:27.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.714+0000 7f34b5ffb700 1 -- 172.21.15.146:0/181339359 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b8020070 con 0x7f34c0153e80 2023-10-06T11:17:27.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.714+0000 7f34b5ffb700 1 -- 172.21.15.146:0/181339359 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b801b6a0 con 0x7f34c0153e80 2023-10-06T11:17:27.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.714+0000 7f34c7ff3700 1 -- 172.21.15.146:0/181339359 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34c016d230 con 0x7f34c0153e80 2023-10-06T11:17:27.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.714+0000 7f34c7ff3700 1 -- 172.21.15.146:0/181339359 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34c016d7f0 con 0x7f34c0153e80 2023-10-06T11:17:27.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.715+0000 7f34c7ff3700 1 -- 172.21.15.146:0/181339359 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34c016dd10 con 0x7f34c0153e80 2023-10-06T11:17:27.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.716+0000 7f34b5ffb700 1 -- 172.21.15.146:0/181339359 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f34b8022030 con 0x7f34c0153e80 2023-10-06T11:17:27.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.716+0000 7f34b5ffb700 1 --2- 172.21.15.146:0/181339359 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f34a4066f30 0x7f34a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:27.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.716+0000 7f34b5ffb700 1 -- 172.21.15.146:0/181339359 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f34b80864a0 con 0x7f34c0153e80 2023-10-06T11:17:27.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.716+0000 7f34c5d8f700 1 --2- 172.21.15.146:0/181339359 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f34a4066f30 0x7f34a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:27.722 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.716+0000 7f34c5d8f700 1 --2- 172.21.15.146:0/181339359 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f34a4066f30 0x7f34a40693e0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f34bc00d6e0 tx=0x7f34bc007850 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:27.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.720+0000 7f34b5ffb700 1 -- 172.21.15.146:0/181339359 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f34c016dd10 con 0x7f34c0153e80 2023-10-06T11:17:27.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.948+0000 7f34c7ff3700 1 -- 172.21.15.146:0/181339359 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f34c016dd10 con 0x7f34c0153e80 2023-10-06T11:17:27.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.948+0000 7f34b5ffb700 1 -- 172.21.15.146:0/181339359 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 128 v128) v1 ==== 95+0+4619 (secure 0 0 0) 0x7f34c016dd10 con 0x7f34c0153e80 2023-10-06T11:17:27.950 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:27.950 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":128,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7433,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3681774523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3681774523},{"type":"v1","addr":"172.21.15.151:6834","nonce":3681774523}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":124},{"gid":7436,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/3243480101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":3243480101},{"type":"v1","addr":"172.21.15.151:6835","nonce":3243480101}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":124},{"gid":9645,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/1871572981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1871572981},{"type":"v1","addr":"172.21.15.146:6836","nonce":1871572981}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":124}],"filesystems":[{"mdsmap":{"epoch":128,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:17:23.939322+0000","modified":"2023-10-06T11:17:27.570448+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9648},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9648":{"gid":9648,"name":"c","rank":0,"incarnation":125,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/2875253990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2875253990},{"type":"v1","addr":"172.21.15.146:6837","nonce":2875253990}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-06T11:17:27.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.950+0000 7f34c7ff3700 1 -- 172.21.15.146:0/181339359 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f34a4066f30 msgr2=0x7f34a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:27.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.950+0000 7f34c7ff3700 1 --2- 172.21.15.146:0/181339359 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f34a4066f30 0x7f34a40693e0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f34bc00d6e0 tx=0x7f34bc007850 comp rx=0 tx=0).stop 2023-10-06T11:17:27.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.950+0000 7f34c7ff3700 1 -- 172.21.15.146:0/181339359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34c0153e80 msgr2=0x7f34c00cf340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:27.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.950+0000 7f34c7ff3700 1 --2- 172.21.15.146:0/181339359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34c0153e80 0x7f34c00cf340 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7f34b80030c0 tx=0x7f34b8016000 comp rx=0 tx=0).stop 2023-10-06T11:17:27.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.950+0000 7f34c7ff3700 1 -- 172.21.15.146:0/181339359 shutdown_connections 2023-10-06T11:17:27.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.950+0000 7f34c7ff3700 1 --2- 172.21.15.146:0/181339359 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f34a4066f30 0x7f34a40693e0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.950+0000 7f34c7ff3700 1 --2- 172.21.15.146:0/181339359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f34c0153e80 0x7f34c00cf340 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.950+0000 7f34c7ff3700 1 --2- 172.21.15.146:0/181339359 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34c0068ba0 0x7f34c0156de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.950+0000 7f34c7ff3700 1 --2- 172.21.15.146:0/181339359 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34c0153ab0 0x7f34c014f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:27.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.950+0000 7f34c7ff3700 1 -- 172.21.15.146:0/181339359 >> 172.21.15.146:0/181339359 conn(0x7f34c006eba0 msgr2=0x7f34c00d02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:27.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.951+0000 7f34c7ff3700 1 -- 172.21.15.146:0/181339359 shutdown_connections 2023-10-06T11:17:27.953 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:27.951+0000 7f34c7ff3700 1 -- 172.21.15.146:0/181339359 wait complete. 2023-10-06T11:17:27.954 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 128 2023-10-06T11:17:27.965 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:17:28.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.077+0000 7f8205f7a700 1 Processor -- start 2023-10-06T11:17:28.079 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.077+0000 7f8205f7a700 1 -- start start 2023-10-06T11:17:28.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.078+0000 7f8205f7a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82000ced80 0x7f82000c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:28.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.078+0000 7f8205f7a700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f82000c3910 0x7f82000cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:28.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.078+0000 7f8205f7a700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82000cf210 con 0x7f82000b0c00 2023-10-06T11:17:28.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.078+0000 7f8205f7a700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82000682f0 con 0x7f82000c3910 2023-10-06T11:17:28.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.078+0000 7f8205f7a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8200068580 con 0x7f82000ced80 2023-10-06T11:17:28.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.078+0000 7f81feffd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82000ced80 0x7f82000c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:28.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.078+0000 7f81fffff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f82000c3910 0x7f82000cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:28.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.078+0000 7f81feffd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82000ced80 0x7f82000c8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:47276/0 (socket says 172.21.15.146:47276) 2023-10-06T11:17:28.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.078+0000 7f81fffff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f82000c3910 0x7f82000cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:44046/0 (socket says 172.21.15.146:44046) 2023-10-06T11:17:28.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.078+0000 7f81feffd700 1 -- 172.21.15.146:0/41718767 learned_addr learned my addr 172.21.15.146:0/41718767 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:28.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.078+0000 7f81ff7fe700 1 --1- 172.21.15.146:0/41718767 >> v1:172.21.15.151:6789/0 conn(0x7f82000b0c00 0x7f82000c3200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:45134/0 (socket says 172.21.15.146:45134) 2023-10-06T11:17:28.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.078+0000 7f81feffd700 1 -- 172.21.15.146:0/41718767 >> v2:172.21.15.151:3300/0 conn(0x7f82000c3910 msgr2=0x7f82000cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:28.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.078+0000 7f81feffd700 1 --2- 172.21.15.146:0/41718767 >> v2:172.21.15.151:3300/0 conn(0x7f82000c3910 0x7f82000cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:28.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.078+0000 7f81feffd700 1 -- 172.21.15.146:0/41718767 >> v1:172.21.15.151:6789/0 conn(0x7f82000b0c00 legacy=0x7f82000c3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:28.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.078+0000 7f81feffd700 1 -- 172.21.15.146:0/41718767 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8200068790 con 0x7f82000ced80 2023-10-06T11:17:28.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.078+0000 7f81feffd700 1 --2- 172.21.15.146:0/41718767 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82000ced80 0x7f82000c8aa0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f81e80099b0 tx=0x7f81e8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75f65d01aad0a9d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:28.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.079+0000 7f81fe7fc700 1 -- 172.21.15.146:0/41718767 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e8009ea0 con 0x7f82000ced80 2023-10-06T11:17:28.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.079+0000 7f81fe7fc700 1 -- 172.21.15.146:0/41718767 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e800b8f0 con 0x7f82000ced80 2023-10-06T11:17:28.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.079+0000 7f81fe7fc700 1 -- 172.21.15.146:0/41718767 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e800bc90 con 0x7f82000ced80 2023-10-06T11:17:28.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.079+0000 7f8205f7a700 1 -- 172.21.15.146:0/41718767 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82000ced80 msgr2=0x7f82000c8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:28.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.079+0000 7f8205f7a700 1 --2- 172.21.15.146:0/41718767 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82000ced80 0x7f82000c8aa0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f81e80099b0 tx=0x7f81e8009250 comp rx=0 tx=0).stop 2023-10-06T11:17:28.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.079+0000 7f8205f7a700 1 -- 172.21.15.146:0/41718767 shutdown_connections 2023-10-06T11:17:28.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.079+0000 7f8205f7a700 1 --2- 172.21.15.146:0/41718767 >> v2:172.21.15.151:3300/0 conn(0x7f82000c3910 0x7f82000cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:28.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.079+0000 7f8205f7a700 1 --2- 172.21.15.146:0/41718767 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82000ced80 0x7f82000c8aa0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:28.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.079+0000 7f8205f7a700 1 -- 172.21.15.146:0/41718767 >> 172.21.15.146:0/41718767 conn(0x7f8200067c50 msgr2=0x7f82000ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:28.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.079+0000 7f8205f7a700 1 -- 172.21.15.146:0/41718767 shutdown_connections 2023-10-06T11:17:28.083 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.079+0000 7f8205f7a700 1 -- 172.21.15.146:0/41718767 wait complete. 2023-10-06T11:17:28.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.080+0000 7f8205f7a700 1 Processor -- start 2023-10-06T11:17:28.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.080+0000 7f8205f7a700 1 -- start start 2023-10-06T11:17:28.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.081+0000 7f8205f7a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82000b0c00 0x7f820015ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:28.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.081+0000 7f8205f7a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82000c3910 0x7f820015a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:28.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.081+0000 7f8205f7a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82000ced80 0x7f820015c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:28.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.081+0000 7f8205f7a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820015b420 con 0x7f82000c3910 2023-10-06T11:17:28.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.081+0000 7f8205f7a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f820015a5b0 con 0x7f82000ced80 2023-10-06T11:17:28.086 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.081+0000 7f8205f7a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f820015a810 con 0x7f82000b0c00 2023-10-06T11:17:28.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.081+0000 7f81feffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82000c3910 0x7f820015a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:28.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.081+0000 7f81feffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82000c3910 0x7f820015a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49700/0 (socket says 172.21.15.146:49700) 2023-10-06T11:17:28.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.081+0000 7f81feffd700 1 -- 172.21.15.146:0/3918215561 learned_addr learned my addr 172.21.15.146:0/3918215561 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:28.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.081+0000 7f81ff7fe700 1 --2- 172.21.15.146:0/3918215561 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82000b0c00 0x7f820015ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:28.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.081+0000 7f81fffff700 1 --2- 172.21.15.146:0/3918215561 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82000ced80 0x7f820015c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:28.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.082+0000 7f81feffd700 1 -- 172.21.15.146:0/3918215561 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82000b0c00 msgr2=0x7f820015ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:28.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.082+0000 7f81feffd700 1 --2- 172.21.15.146:0/3918215561 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82000b0c00 0x7f820015ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:28.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.082+0000 7f81feffd700 1 -- 172.21.15.146:0/3918215561 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82000ced80 msgr2=0x7f820015c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:28.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.082+0000 7f81feffd700 1 --2- 172.21.15.146:0/3918215561 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82000ced80 0x7f820015c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:28.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.082+0000 7f81feffd700 1 -- 172.21.15.146:0/3918215561 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e80094f0 con 0x7f82000c3910 2023-10-06T11:17:28.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.082+0000 7f81feffd700 1 --2- 172.21.15.146:0/3918215561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82000c3910 0x7f820015a070 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7f82000caea0 tx=0x7f81e8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:28.087 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.082+0000 7f81f77fe700 1 -- 172.21.15.146:0/3918215561 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e800ba60 con 0x7f82000c3910 2023-10-06T11:17:28.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.082+0000 7f81f77fe700 1 -- 172.21.15.146:0/3918215561 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e800bbe0 con 0x7f82000c3910 2023-10-06T11:17:28.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.082+0000 7f8205f7a700 1 -- 172.21.15.146:0/3918215561 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f820015aaf0 con 0x7f82000c3910 2023-10-06T11:17:28.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.082+0000 7f81f77fe700 1 -- 172.21.15.146:0/3918215561 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e8026680 con 0x7f82000c3910 2023-10-06T11:17:28.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.082+0000 7f8205f7a700 1 -- 172.21.15.146:0/3918215561 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f820015b0b0 con 0x7f82000c3910 2023-10-06T11:17:28.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.083+0000 7f8205f7a700 1 -- 172.21.15.146:0/3918215561 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f820004c380 con 0x7f82000c3910 2023-10-06T11:17:28.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.083+0000 7f81f77fe700 1 -- 172.21.15.146:0/3918215561 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f81e8023030 con 0x7f82000c3910 2023-10-06T11:17:28.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.084+0000 7f81f77fe700 1 --2- 172.21.15.146:0/3918215561 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f81e0066f30 0x7f81e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:28.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.084+0000 7f81f77fe700 1 -- 172.21.15.146:0/3918215561 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f81e8084f30 con 0x7f82000c3910 2023-10-06T11:17:28.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.084+0000 7f81ff7fe700 1 --2- 172.21.15.146:0/3918215561 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f81e0066f30 0x7f81e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:28.088 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.084+0000 7f81ff7fe700 1 --2- 172.21.15.146:0/3918215561 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f81e0066f30 0x7f81e00693e0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f81f8002020 tx=0x7f81f8001a30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:28.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.088+0000 7f81f77fe700 1 -- 172.21.15.146:0/3918215561 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f81e80520c0 con 0x7f82000c3910 2023-10-06T11:17:28.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.269+0000 7f8205f7a700 1 -- 172.21.15.146:0/3918215561 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f820015b560 con 0x7f82000c3910 2023-10-06T11:17:28.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.270+0000 7f81f77fe700 1 -- 172.21.15.146:0/3918215561 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v151) v1 ==== 74+0+16928 (secure 0 0 0) 0x7f81e8015090 con 0x7f82000c3910 2023-10-06T11:17:28.272 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:28.272 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":151,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:17:25.552935+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:17:21.595161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-10-06T11:17:23.009401+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:17:28.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.272+0000 7f8205f7a700 1 -- 172.21.15.146:0/3918215561 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f81e0066f30 msgr2=0x7f81e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:28.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.272+0000 7f8205f7a700 1 --2- 172.21.15.146:0/3918215561 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f81e0066f30 0x7f81e00693e0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f81f8002020 tx=0x7f81f8001a30 comp rx=0 tx=0).stop 2023-10-06T11:17:28.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.272+0000 7f8205f7a700 1 -- 172.21.15.146:0/3918215561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82000c3910 msgr2=0x7f820015a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:28.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.272+0000 7f8205f7a700 1 --2- 172.21.15.146:0/3918215561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82000c3910 0x7f820015a070 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7f82000caea0 tx=0x7f81e8017000 comp rx=0 tx=0).stop 2023-10-06T11:17:28.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.272+0000 7f8205f7a700 1 -- 172.21.15.146:0/3918215561 shutdown_connections 2023-10-06T11:17:28.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.272+0000 7f8205f7a700 1 --2- 172.21.15.146:0/3918215561 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f81e0066f30 0x7f81e00693e0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:28.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.272+0000 7f8205f7a700 1 --2- 172.21.15.146:0/3918215561 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82000ced80 0x7f820015c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:28.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.272+0000 7f8205f7a700 1 --2- 172.21.15.146:0/3918215561 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f82000b0c00 0x7f820015ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:28.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.272+0000 7f8205f7a700 1 --2- 172.21.15.146:0/3918215561 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f82000c3910 0x7f820015a070 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:28.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.272+0000 7f8205f7a700 1 -- 172.21.15.146:0/3918215561 >> 172.21.15.146:0/3918215561 conn(0x7f8200067c50 msgr2=0x7f82000c85e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:28.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.272+0000 7f8205f7a700 1 -- 172.21.15.146:0/3918215561 shutdown_connections 2023-10-06T11:17:28.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.272+0000 7f8205f7a700 1 -- 172.21.15.146:0/3918215561 wait complete. 2023-10-06T11:17:28.287 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T11:17:28.287 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:17:28.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.400+0000 7fd024a8f700 1 Processor -- start 2023-10-06T11:17:28.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.400+0000 7fd024a8f700 1 -- start start 2023-10-06T11:17:28.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.401+0000 7fd024a8f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd020068ba0 0x7fd02015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:28.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.401+0000 7fd024a8f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd02015ac30 con 0x7fd020153ab0 2023-10-06T11:17:28.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.401+0000 7fd024a8f700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0200b4510 con 0x7fd020153e80 2023-10-06T11:17:28.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.401+0000 7fd024a8f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0200b6530 con 0x7fd020068ba0 2023-10-06T11:17:28.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.401+0000 7fd01e59c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd020153ab0 0x7fd020068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39698/0 (socket says 172.21.15.146:39698) 2023-10-06T11:17:28.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.401+0000 7fd01e59c700 1 -- 172.21.15.146:0/1617447928 learned_addr learned my addr 172.21.15.146:0/1617447928 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:17:28.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.401+0000 7fd015d9b700 1 --2- 172.21.15.146:0/1617447928 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd020068ba0 0x7fd02015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:28.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.401+0000 7fd01dd9b700 1 -- 172.21.15.146:0/1617447928 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3442947552 0 0) 0x7fd010001110 con 0x7fd020153ab0 2023-10-06T11:17:28.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.401+0000 7fd01dd9b700 1 -- 172.21.15.146:0/1617447928 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd00c003570 con 0x7fd020153ab0 2023-10-06T11:17:28.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.402+0000 7fd01dd9b700 1 -- 172.21.15.146:0/1617447928 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3572934019 0 0) 0x7fd00c003570 con 0x7fd020153ab0 2023-10-06T11:17:28.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.402+0000 7fd01dd9b700 1 -- 172.21.15.146:0/1617447928 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd020068ba0 msgr2=0x7fd02015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:28.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.402+0000 7fd01dd9b700 1 --2- 172.21.15.146:0/1617447928 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd020068ba0 0x7fd02015a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:28.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.402+0000 7fd01dd9b700 1 -- 172.21.15.146:0/1617447928 >> v1:172.21.15.151:6789/0 conn(0x7fd020153e80 legacy=0x7fd0200b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:28.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.402+0000 7fd01dd9b700 1 -- 172.21.15.146:0/1617447928 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0200b5c50 con 0x7fd020153ab0 2023-10-06T11:17:28.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.402+0000 7fd01dd9b700 1 -- 172.21.15.146:0/1617447928 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fd010001600 con 0x7fd020153ab0 2023-10-06T11:17:28.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.402+0000 7fd01dd9b700 1 -- 172.21.15.146:0/1617447928 >> v1:172.21.15.146:6789/0 conn(0x7fd020153ab0 legacy=0x7fd020068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:28.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.402+0000 7fd01dd9b700 1 --2- 172.21.15.146:0/1617447928 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd00c003a90 0x7fd00c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:28.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.402+0000 7fd01dd9b700 1 --2- 172.21.15.146:0/1617447928 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd00c004810 0x7fd00c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:28.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.402+0000 7fd01dd9b700 1 --2- 172.21.15.146:0/1617447928 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd020068ba0 0x7fd00c0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:28.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.402+0000 7fd01dd9b700 1 -- 172.21.15.146:0/1617447928 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0200b6530 con 0x7fd00c003a90 2023-10-06T11:17:28.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.402+0000 7fd01dd9b700 1 -- 172.21.15.146:0/1617447928 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c00bb60 con 0x7fd00c004810 2023-10-06T11:17:28.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.402+0000 7fd01dd9b700 1 -- 172.21.15.146:0/1617447928 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd00c00bd20 con 0x7fd020068ba0 2023-10-06T11:17:28.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.402+0000 7fd01e59c700 1 --2- 172.21.15.146:0/1617447928 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd00c003a90 0x7fd00c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:28.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.402+0000 7fd015d9b700 1 --2- 172.21.15.146:0/1617447928 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd00c004810 0x7fd00c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:28.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.402+0000 7fd01ed9d700 1 --2- 172.21.15.146:0/1617447928 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd020068ba0 0x7fd00c0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:28.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.402+0000 7fd01e59c700 1 -- 172.21.15.146:0/1617447928 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd020068ba0 msgr2=0x7fd00c0051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:28.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.402+0000 7fd01e59c700 1 --2- 172.21.15.146:0/1617447928 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd020068ba0 0x7fd00c0051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:28.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.402+0000 7fd01e59c700 1 -- 172.21.15.146:0/1617447928 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd00c004810 msgr2=0x7fd00c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:28.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.402+0000 7fd01e59c700 1 --2- 172.21.15.146:0/1617447928 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd00c004810 0x7fd00c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:28.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.402+0000 7fd01e59c700 1 -- 172.21.15.146:0/1617447928 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd00c003570 con 0x7fd00c003a90 2023-10-06T11:17:28.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.402+0000 7fd01ed9d700 1 --2- 172.21.15.146:0/1617447928 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd020068ba0 0x7fd00c0051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:17:28.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.402+0000 7fd01e59c700 1 --2- 172.21.15.146:0/1617447928 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd00c003a90 0x7fd00c003ea0 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7fd01000c5f0 tx=0x7fd0200b3db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49daa2783a5ac4e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:28.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.402+0000 7fd01dd9b700 1 -- 172.21.15.146:0/1617447928 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01000cdf0 con 0x7fd00c003a90 2023-10-06T11:17:28.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.402+0000 7fd01dd9b700 1 -- 172.21.15.146:0/1617447928 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd010005920 con 0x7fd00c003a90 2023-10-06T11:17:28.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.402+0000 7fd01dd9b700 1 -- 172.21.15.146:0/1617447928 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd010005ce0 con 0x7fd00c003a90 2023-10-06T11:17:28.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.403+0000 7fd024a8f700 1 -- 172.21.15.146:0/1617447928 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd00c003a90 msgr2=0x7fd00c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:28.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.403+0000 7fd024a8f700 1 --2- 172.21.15.146:0/1617447928 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd00c003a90 0x7fd00c003ea0 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7fd01000c5f0 tx=0x7fd0200b3db0 comp rx=0 tx=0).stop 2023-10-06T11:17:28.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.403+0000 7fd01ed9d700 1 -- 172.21.15.146:0/1617447928 reap_dead start 2023-10-06T11:17:28.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.403+0000 7fd024a8f700 1 -- 172.21.15.146:0/1617447928 shutdown_connections 2023-10-06T11:17:28.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.403+0000 7fd024a8f700 1 -- 172.21.15.146:0/1617447928 >> 172.21.15.146:0/1617447928 conn(0x7fd02006eba0 msgr2=0x7fd02006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:28.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.403+0000 7fd024a8f700 1 -- 172.21.15.146:0/1617447928 shutdown_connections 2023-10-06T11:17:28.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.403+0000 7fd024a8f700 1 -- 172.21.15.146:0/1617447928 wait complete. 2023-10-06T11:17:28.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.404+0000 7fd024a8f700 1 Processor -- start 2023-10-06T11:17:28.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.404+0000 7fd024a8f700 1 -- start start 2023-10-06T11:17:28.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.405+0000 7fd024a8f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd00c003a90 0x7fd0201503d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:28.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.405+0000 7fd024a8f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0201529f0 0x7fd020152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:28.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.405+0000 7fd024a8f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd020158520 0x7fd0201589a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:28.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.405+0000 7fd024a8f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd020169830 con 0x7fd020158520 2023-10-06T11:17:28.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.405+0000 7fd024a8f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd020150910 con 0x7fd00c003a90 2023-10-06T11:17:28.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.405+0000 7fd024a8f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0201533a0 con 0x7fd0201529f0 2023-10-06T11:17:28.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.405+0000 7fd01ed9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd020158520 0x7fd0201589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:28.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.405+0000 7fd01ed9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd020158520 0x7fd0201589a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49716/0 (socket says 172.21.15.146:49716) 2023-10-06T11:17:28.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.405+0000 7fd01ed9d700 1 -- 172.21.15.146:0/2562082677 learned_addr learned my addr 172.21.15.146:0/2562082677 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:28.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.405+0000 7fd015d9b700 1 --2- 172.21.15.146:0/2562082677 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0201529f0 0x7fd020152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:28.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.405+0000 7fd01e59c700 1 --2- 172.21.15.146:0/2562082677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd00c003a90 0x7fd0201503d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:28.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.405+0000 7fd01ed9d700 1 -- 172.21.15.146:0/2562082677 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0201529f0 msgr2=0x7fd020152e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:28.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.405+0000 7fd01ed9d700 1 --2- 172.21.15.146:0/2562082677 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0201529f0 0x7fd020152e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:28.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.405+0000 7fd01ed9d700 1 -- 172.21.15.146:0/2562082677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd00c003a90 msgr2=0x7fd0201503d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:28.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.405+0000 7fd01ed9d700 1 --2- 172.21.15.146:0/2562082677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd00c003a90 0x7fd0201503d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:28.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.405+0000 7fd01ed9d700 1 -- 172.21.15.146:0/2562082677 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd020154dd0 con 0x7fd020158520 2023-10-06T11:17:28.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.406+0000 7fd01ed9d700 1 --2- 172.21.15.146:0/2562082677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd020158520 0x7fd0201589a0 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7fd0200ce6b0 tx=0x7fd018009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:28.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.406+0000 7fd016ffd700 1 -- 172.21.15.146:0/2562082677 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd018012590 con 0x7fd020158520 2023-10-06T11:17:28.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.406+0000 7fd016ffd700 1 -- 172.21.15.146:0/2562082677 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd018012710 con 0x7fd020158520 2023-10-06T11:17:28.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.406+0000 7fd024a8f700 1 -- 172.21.15.146:0/2562082677 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0201544a0 con 0x7fd020158520 2023-10-06T11:17:28.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.406+0000 7fd016ffd700 1 -- 172.21.15.146:0/2562082677 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd018012ad0 con 0x7fd020158520 2023-10-06T11:17:28.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.406+0000 7fd024a8f700 1 -- 172.21.15.146:0/2562082677 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd020154a60 con 0x7fd020158520 2023-10-06T11:17:28.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.407+0000 7fd024a8f700 1 -- 172.21.15.146:0/2562082677 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd020154f60 con 0x7fd020158520 2023-10-06T11:17:28.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.407+0000 7fd016ffd700 1 -- 172.21.15.146:0/2562082677 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd018003030 con 0x7fd020158520 2023-10-06T11:17:28.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.407+0000 7fd016ffd700 1 --2- 172.21.15.146:0/2562082677 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd000066f30 0x7fd0000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:28.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.408+0000 7fd01e59c700 1 --2- 172.21.15.146:0/2562082677 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd000066f30 0x7fd0000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:28.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.408+0000 7fd016ffd700 1 -- 172.21.15.146:0/2562082677 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd0180844c0 con 0x7fd020158520 2023-10-06T11:17:28.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.408+0000 7fd01e59c700 1 --2- 172.21.15.146:0/2562082677 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd000066f30 0x7fd0000693e0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fd010007e10 tx=0x7fd010015000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:28.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.412+0000 7fd016ffd700 1 -- 172.21.15.146:0/2562082677 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd018051530 con 0x7fd020158520 2023-10-06T11:17:28.595 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.593+0000 7fd024a8f700 1 -- 172.21.15.146:0/2562082677 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd02004c380 con 0x7fd000066f30 2023-10-06T11:17:28.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.601+0000 7fd016ffd700 1 -- 172.21.15.146:0/2562082677 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306887 (secure 0 0 0) 0x7fd02004c380 con 0x7fd000066f30 2023-10-06T11:17:28.609 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:28.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.604+0000 7fd024a8f700 1 -- 172.21.15.146:0/2562082677 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd000066f30 msgr2=0x7fd0000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:28.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.604+0000 7fd024a8f700 1 --2- 172.21.15.146:0/2562082677 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd000066f30 0x7fd0000693e0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fd010007e10 tx=0x7fd010015000 comp rx=0 tx=0).stop 2023-10-06T11:17:28.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.604+0000 7fd024a8f700 1 -- 172.21.15.146:0/2562082677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd020158520 msgr2=0x7fd0201589a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:28.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.604+0000 7fd024a8f700 1 --2- 172.21.15.146:0/2562082677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd020158520 0x7fd0201589a0 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7fd0200ce6b0 tx=0x7fd018009040 comp rx=0 tx=0).stop 2023-10-06T11:17:28.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.604+0000 7fd024a8f700 1 -- 172.21.15.146:0/2562082677 shutdown_connections 2023-10-06T11:17:28.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.604+0000 7fd024a8f700 1 --2- 172.21.15.146:0/2562082677 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd000066f30 0x7fd0000693e0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:28.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.604+0000 7fd024a8f700 1 --2- 172.21.15.146:0/2562082677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd020158520 0x7fd0201589a0 unknown :-1 s=CLOSED pgs=1949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:28.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.604+0000 7fd024a8f700 1 --2- 172.21.15.146:0/2562082677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd00c003a90 0x7fd0201503d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:28.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.604+0000 7fd024a8f700 1 --2- 172.21.15.146:0/2562082677 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd0201529f0 0x7fd020152e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:28.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.604+0000 7fd024a8f700 1 -- 172.21.15.146:0/2562082677 >> 172.21.15.146:0/2562082677 conn(0x7fd02006eba0 msgr2=0x7fd020152100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:28.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.604+0000 7fd024a8f700 1 -- 172.21.15.146:0/2562082677 shutdown_connections 2023-10-06T11:17:28.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.604+0000 7fd024a8f700 1 -- 172.21.15.146:0/2562082677 wait complete. 2023-10-06T11:17:28.613 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:17:28.618 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":499,"stamp":"2023-10-06T11:17:27.292223+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592030,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":180,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":150,"acting":150,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":93,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2443296,"kb_used_data":15840,"kb_used_omap":0,"kb_used_meta":2427392,"kb_avail":752531424,"statfs":{"total":773094113280,"available":770592178176,"internally_reserved":0,"allocated":16220160,"data_stored":8089422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2485649408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1662,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.745508"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:23.546397+0000","last_change":"2023-10-06T11:17:23.546397+0000","last_active":"2023-10-06T11:17:23.546397+0000","last_peered":"2023-10-06T11:17:23.546397+0000","last_clean":"2023-10-06T11:17:23.546397+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:23.546397+0000","last_undegraded":"2023-10-06T11:17:23.546397+0000","last_fullsized":"2023-10-06T11:17:23.546397+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575584+0000","last_change":"2023-10-06T11:17:24.574790+0000","last_active":"2023-10-06T11:17:24.575584+0000","last_peered":"2023-10-06T11:17:24.575584+0000","last_clean":"2023-10-06T11:17:24.575584+0000","last_became_active":"2023-10-06T11:17:24.574475+0000","last_became_peered":"2023-10-06T11:17:24.574475+0000","last_unstale":"2023-10-06T11:17:24.575584+0000","last_undegraded":"2023-10-06T11:17:24.575584+0000","last_fullsized":"2023-10-06T11:17:24.575584+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:20.201597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:23.546397+0000","last_change":"2023-10-06T11:17:23.546397+0000","last_active":"2023-10-06T11:17:23.546397+0000","last_peered":"2023-10-06T11:17:23.546397+0000","last_clean":"2023-10-06T11:17:23.546397+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:23.546397+0000","last_undegraded":"2023-10-06T11:17:23.546397+0000","last_fullsized":"2023-10-06T11:17:23.546397+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:23.546397+0000","last_change":"2023-10-06T11:17:23.546397+0000","last_active":"2023-10-06T11:17:23.546397+0000","last_peered":"2023-10-06T11:17:23.546397+0000","last_clean":"2023-10-06T11:17:23.546397+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:23.546397+0000","last_undegraded":"2023-10-06T11:17:23.546397+0000","last_fullsized":"2023-10-06T11:17:23.546397+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.576344+0000","last_change":"2023-10-06T11:17:24.570249+0000","last_active":"2023-10-06T11:17:24.576344+0000","last_peered":"2023-10-06T11:17:24.576344+0000","last_clean":"2023-10-06T11:17:24.576344+0000","last_became_active":"2023-10-06T11:17:24.570080+0000","last_became_peered":"2023-10-06T11:17:24.570080+0000","last_unstale":"2023-10-06T11:17:24.576344+0000","last_undegraded":"2023-10-06T11:17:24.576344+0000","last_fullsized":"2023-10-06T11:17:24.576344+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:32:08.893601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.569849+0000","last_change":"2023-10-06T11:17:24.568112+0000","last_active":"2023-10-06T11:17:24.569849+0000","last_peered":"2023-10-06T11:17:24.569849+0000","last_clean":"2023-10-06T11:17:24.569849+0000","last_became_active":"2023-10-06T11:17:24.567855+0000","last_became_peered":"2023-10-06T11:17:24.567855+0000","last_unstale":"2023-10-06T11:17:24.569849+0000","last_undegraded":"2023-10-06T11:17:24.569849+0000","last_fullsized":"2023-10-06T11:17:24.569849+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:11:12.692922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:23.546397+0000","last_change":"2023-10-06T11:17:23.546397+0000","last_active":"2023-10-06T11:17:23.546397+0000","last_peered":"2023-10-06T11:17:23.546397+0000","last_clean":"2023-10-06T11:17:23.546397+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:23.546397+0000","last_undegraded":"2023-10-06T11:17:23.546397+0000","last_fullsized":"2023-10-06T11:17:23.546397+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:23.546397+0000","last_change":"2023-10-06T11:17:23.546397+0000","last_active":"2023-10-06T11:17:23.546397+0000","last_peered":"2023-10-06T11:17:23.546397+0000","last_clean":"2023-10-06T11:17:23.546397+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:23.546397+0000","last_undegraded":"2023-10-06T11:17:23.546397+0000","last_fullsized":"2023-10-06T11:17:23.546397+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:23.546397+0000","last_change":"2023-10-06T11:17:23.546397+0000","last_active":"2023-10-06T11:17:23.546397+0000","last_peered":"2023-10-06T11:17:23.546397+0000","last_clean":"2023-10-06T11:17:23.546397+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:23.546397+0000","last_undegraded":"2023-10-06T11:17:23.546397+0000","last_fullsized":"2023-10-06T11:17:23.546397+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:23.546397+0000","last_change":"2023-10-06T11:17:23.546397+0000","last_active":"2023-10-06T11:17:23.546397+0000","last_peered":"2023-10-06T11:17:23.546397+0000","last_clean":"2023-10-06T11:17:23.546397+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:23.546397+0000","last_undegraded":"2023-10-06T11:17:23.546397+0000","last_fullsized":"2023-10-06T11:17:23.546397+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.570755+0000","last_change":"2023-10-06T11:17:24.568848+0000","last_active":"2023-10-06T11:17:24.570755+0000","last_peered":"2023-10-06T11:17:24.570755+0000","last_clean":"2023-10-06T11:17:24.570755+0000","last_became_active":"2023-10-06T11:17:24.567763+0000","last_became_peered":"2023-10-06T11:17:24.567763+0000","last_unstale":"2023-10-06T11:17:24.570755+0000","last_undegraded":"2023-10-06T11:17:24.570755+0000","last_fullsized":"2023-10-06T11:17:24.570755+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:56.951675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575114+0000","last_change":"2023-10-06T11:17:24.573144+0000","last_active":"2023-10-06T11:17:24.575114+0000","last_peered":"2023-10-06T11:17:24.575114+0000","last_clean":"2023-10-06T11:17:24.575114+0000","last_became_active":"2023-10-06T11:17:24.572892+0000","last_became_peered":"2023-10-06T11:17:24.572892+0000","last_unstale":"2023-10-06T11:17:24.575114+0000","last_undegraded":"2023-10-06T11:17:24.575114+0000","last_fullsized":"2023-10-06T11:17:24.575114+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:15:52.609098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.580555+0000","last_change":"2023-10-06T11:17:24.571121+0000","last_active":"2023-10-06T11:17:24.580555+0000","last_peered":"2023-10-06T11:17:24.580555+0000","last_clean":"2023-10-06T11:17:24.580555+0000","last_became_active":"2023-10-06T11:17:24.570858+0000","last_became_peered":"2023-10-06T11:17:24.570858+0000","last_unstale":"2023-10-06T11:17:24.580555+0000","last_undegraded":"2023-10-06T11:17:24.580555+0000","last_fullsized":"2023-10-06T11:17:24.580555+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:32:17.113391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.573663+0000","last_change":"2023-10-06T11:17:24.568783+0000","last_active":"2023-10-06T11:17:24.573663+0000","last_peered":"2023-10-06T11:17:24.573663+0000","last_clean":"2023-10-06T11:17:24.573663+0000","last_became_active":"2023-10-06T11:17:24.565857+0000","last_became_peered":"2023-10-06T11:17:24.565857+0000","last_unstale":"2023-10-06T11:17:24.573663+0000","last_undegraded":"2023-10-06T11:17:24.573663+0000","last_fullsized":"2023-10-06T11:17:24.573663+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:11:22.690663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.574923+0000","last_change":"2023-10-06T11:17:24.571861+0000","last_active":"2023-10-06T11:17:24.574923+0000","last_peered":"2023-10-06T11:17:24.574923+0000","last_clean":"2023-10-06T11:17:24.574923+0000","last_became_active":"2023-10-06T11:17:24.571607+0000","last_became_peered":"2023-10-06T11:17:24.571607+0000","last_unstale":"2023-10-06T11:17:24.574923+0000","last_undegraded":"2023-10-06T11:17:24.574923+0000","last_fullsized":"2023-10-06T11:17:24.574923+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:55:29.624889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:23.546397+0000","last_change":"2023-10-06T11:17:23.546397+0000","last_active":"2023-10-06T11:17:23.546397+0000","last_peered":"2023-10-06T11:17:23.546397+0000","last_clean":"2023-10-06T11:17:23.546397+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:23.546397+0000","last_undegraded":"2023-10-06T11:17:23.546397+0000","last_fullsized":"2023-10-06T11:17:23.546397+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:23.546397+0000","last_change":"2023-10-06T11:17:23.546397+0000","last_active":"2023-10-06T11:17:23.546397+0000","last_peered":"2023-10-06T11:17:23.546397+0000","last_clean":"2023-10-06T11:17:23.546397+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:23.546397+0000","last_undegraded":"2023-10-06T11:17:23.546397+0000","last_fullsized":"2023-10-06T11:17:23.546397+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:23.546397+0000","last_change":"2023-10-06T11:17:23.546397+0000","last_active":"2023-10-06T11:17:23.546397+0000","last_peered":"2023-10-06T11:17:23.546397+0000","last_clean":"2023-10-06T11:17:23.546397+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:23.546397+0000","last_undegraded":"2023-10-06T11:17:23.546397+0000","last_fullsized":"2023-10-06T11:17:23.546397+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.574906+0000","last_change":"2023-10-06T11:17:24.571935+0000","last_active":"2023-10-06T11:17:24.574906+0000","last_peered":"2023-10-06T11:17:24.574906+0000","last_clean":"2023-10-06T11:17:24.574906+0000","last_became_active":"2023-10-06T11:17:24.571681+0000","last_became_peered":"2023-10-06T11:17:24.571681+0000","last_unstale":"2023-10-06T11:17:24.574906+0000","last_undegraded":"2023-10-06T11:17:24.574906+0000","last_fullsized":"2023-10-06T11:17:24.574906+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:56:17.624615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575898+0000","last_change":"2023-10-06T11:17:24.568125+0000","last_active":"2023-10-06T11:17:24.575898+0000","last_peered":"2023-10-06T11:17:24.575898+0000","last_clean":"2023-10-06T11:17:24.575898+0000","last_became_active":"2023-10-06T11:17:24.567809+0000","last_became_peered":"2023-10-06T11:17:24.567809+0000","last_unstale":"2023-10-06T11:17:24.575898+0000","last_undegraded":"2023-10-06T11:17:24.575898+0000","last_fullsized":"2023-10-06T11:17:24.575898+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:32:27.294341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.565724+0000","last_change":"2023-10-06T11:17:24.561075+0000","last_active":"2023-10-06T11:17:24.565724+0000","last_peered":"2023-10-06T11:17:24.565724+0000","last_clean":"2023-10-06T11:17:24.565724+0000","last_became_active":"2023-10-06T11:17:24.560699+0000","last_became_peered":"2023-10-06T11:17:24.560699+0000","last_unstale":"2023-10-06T11:17:24.565724+0000","last_undegraded":"2023-10-06T11:17:24.565724+0000","last_fullsized":"2023-10-06T11:17:24.565724+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:06:27.406680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.574973+0000","last_change":"2023-10-06T11:17:24.572835+0000","last_active":"2023-10-06T11:17:24.574973+0000","last_peered":"2023-10-06T11:17:24.574973+0000","last_clean":"2023-10-06T11:17:24.574973+0000","last_became_active":"2023-10-06T11:17:24.570204+0000","last_became_peered":"2023-10-06T11:17:24.570204+0000","last_unstale":"2023-10-06T11:17:24.574973+0000","last_undegraded":"2023-10-06T11:17:24.574973+0000","last_fullsized":"2023-10-06T11:17:24.574973+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:18.748550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.570377+0000","last_change":"2023-10-06T11:17:24.567291+0000","last_active":"2023-10-06T11:17:24.570377+0000","last_peered":"2023-10-06T11:17:24.570377+0000","last_clean":"2023-10-06T11:17:24.570377+0000","last_became_active":"2023-10-06T11:17:24.566984+0000","last_became_peered":"2023-10-06T11:17:24.566984+0000","last_unstale":"2023-10-06T11:17:24.570377+0000","last_undegraded":"2023-10-06T11:17:24.570377+0000","last_fullsized":"2023-10-06T11:17:24.570377+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:42:04.095734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:23.546397+0000","last_change":"2023-10-06T11:17:23.546397+0000","last_active":"2023-10-06T11:17:23.546397+0000","last_peered":"2023-10-06T11:17:23.546397+0000","last_clean":"2023-10-06T11:17:23.546397+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:23.546397+0000","last_undegraded":"2023-10-06T11:17:23.546397+0000","last_fullsized":"2023-10-06T11:17:23.546397+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.565288+0000","last_change":"2023-10-06T11:17:24.561095+0000","last_active":"2023-10-06T11:17:24.565288+0000","last_peered":"2023-10-06T11:17:24.565288+0000","last_clean":"2023-10-06T11:17:24.565288+0000","last_became_active":"2023-10-06T11:17:24.560834+0000","last_became_peered":"2023-10-06T11:17:24.560834+0000","last_unstale":"2023-10-06T11:17:24.565288+0000","last_undegraded":"2023-10-06T11:17:24.565288+0000","last_fullsized":"2023-10-06T11:17:24.565288+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:33:05.816585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.570099+0000","last_change":"2023-10-06T11:17:24.566087+0000","last_active":"2023-10-06T11:17:24.570099+0000","last_peered":"2023-10-06T11:17:24.570099+0000","last_clean":"2023-10-06T11:17:24.570099+0000","last_became_active":"2023-10-06T11:17:24.565836+0000","last_became_peered":"2023-10-06T11:17:24.565836+0000","last_unstale":"2023-10-06T11:17:24.570099+0000","last_undegraded":"2023-10-06T11:17:24.570099+0000","last_fullsized":"2023-10-06T11:17:24.570099+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:32:22.601435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575177+0000","last_change":"2023-10-06T11:17:24.574344+0000","last_active":"2023-10-06T11:17:24.575177+0000","last_peered":"2023-10-06T11:17:24.575177+0000","last_clean":"2023-10-06T11:17:24.575177+0000","last_became_active":"2023-10-06T11:17:24.570258+0000","last_became_peered":"2023-10-06T11:17:24.570258+0000","last_unstale":"2023-10-06T11:17:24.575177+0000","last_undegraded":"2023-10-06T11:17:24.575177+0000","last_fullsized":"2023-10-06T11:17:24.575177+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:56.951675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.565509+0000","last_change":"2023-10-06T11:17:24.561410+0000","last_active":"2023-10-06T11:17:24.565509+0000","last_peered":"2023-10-06T11:17:24.565509+0000","last_clean":"2023-10-06T11:17:24.565509+0000","last_became_active":"2023-10-06T11:17:24.561150+0000","last_became_peered":"2023-10-06T11:17:24.561150+0000","last_unstale":"2023-10-06T11:17:24.565509+0000","last_undegraded":"2023-10-06T11:17:24.565509+0000","last_fullsized":"2023-10-06T11:17:24.565509+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:03:32.754632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.579321+0000","last_change":"2023-10-06T11:17:24.576372+0000","last_active":"2023-10-06T11:17:24.579321+0000","last_peered":"2023-10-06T11:17:24.579321+0000","last_clean":"2023-10-06T11:17:24.579321+0000","last_became_active":"2023-10-06T11:17:24.575959+0000","last_became_peered":"2023-10-06T11:17:24.575959+0000","last_unstale":"2023-10-06T11:17:24.579321+0000","last_undegraded":"2023-10-06T11:17:24.579321+0000","last_fullsized":"2023-10-06T11:17:24.579321+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:01:59.076681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:23.546397+0000","last_change":"2023-10-06T11:17:23.546397+0000","last_active":"2023-10-06T11:17:23.546397+0000","last_peered":"2023-10-06T11:17:23.546397+0000","last_clean":"2023-10-06T11:17:23.546397+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:23.546397+0000","last_undegraded":"2023-10-06T11:17:23.546397+0000","last_fullsized":"2023-10-06T11:17:23.546397+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.571340+0000","last_change":"2023-10-06T11:17:24.567865+0000","last_active":"2023-10-06T11:17:24.571340+0000","last_peered":"2023-10-06T11:17:24.571340+0000","last_clean":"2023-10-06T11:17:24.571340+0000","last_became_active":"2023-10-06T11:17:24.567577+0000","last_became_peered":"2023-10-06T11:17:24.567577+0000","last_unstale":"2023-10-06T11:17:24.571340+0000","last_undegraded":"2023-10-06T11:17:24.571340+0000","last_fullsized":"2023-10-06T11:17:24.571340+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:38.610243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:23.546397+0000","last_change":"2023-10-06T11:17:23.546397+0000","last_active":"2023-10-06T11:17:23.546397+0000","last_peered":"2023-10-06T11:17:23.546397+0000","last_clean":"2023-10-06T11:17:23.546397+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:23.546397+0000","last_undegraded":"2023-10-06T11:17:23.546397+0000","last_fullsized":"2023-10-06T11:17:23.546397+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.579569+0000","last_change":"2023-10-06T11:17:24.577831+0000","last_active":"2023-10-06T11:17:24.579569+0000","last_peered":"2023-10-06T11:17:24.579569+0000","last_clean":"2023-10-06T11:17:24.579569+0000","last_became_active":"2023-10-06T11:17:24.577572+0000","last_became_peered":"2023-10-06T11:17:24.577572+0000","last_unstale":"2023-10-06T11:17:24.579569+0000","last_undegraded":"2023-10-06T11:17:24.579569+0000","last_fullsized":"2023-10-06T11:17:24.579569+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:48.792063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:22.540743+0000","last_change":"2023-10-06T11:17:22.540743+0000","last_active":"2023-10-06T11:17:22.540743+0000","last_peered":"2023-10-06T11:17:22.540743+0000","last_clean":"2023-10-06T11:17:22.540743+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:22.540743+0000","last_undegraded":"2023-10-06T11:17:22.540743+0000","last_fullsized":"2023-10-06T11:17:22.540743+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.573070+0000","last_change":"2023-10-06T11:17:24.565982+0000","last_active":"2023-10-06T11:17:24.573070+0000","last_peered":"2023-10-06T11:17:24.573070+0000","last_clean":"2023-10-06T11:17:24.573070+0000","last_became_active":"2023-10-06T11:17:24.565734+0000","last_became_peered":"2023-10-06T11:17:24.565734+0000","last_unstale":"2023-10-06T11:17:24.573070+0000","last_undegraded":"2023-10-06T11:17:24.573070+0000","last_fullsized":"2023-10-06T11:17:24.573070+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:33.751143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.582526+0000","last_change":"2023-10-06T11:17:23.569143+0000","last_active":"2023-10-06T11:17:24.582526+0000","last_peered":"2023-10-06T11:17:24.582526+0000","last_clean":"2023-10-06T11:17:24.582526+0000","last_became_active":"2023-10-06T11:17:23.568883+0000","last_became_peered":"2023-10-06T11:17:23.568883+0000","last_unstale":"2023-10-06T11:17:24.582526+0000","last_undegraded":"2023-10-06T11:17:24.582526+0000","last_fullsized":"2023-10-06T11:17:24.582526+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:33:04.810931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.569717+0000","last_change":"2023-10-06T11:17:24.565660+0000","last_active":"2023-10-06T11:17:24.569717+0000","last_peered":"2023-10-06T11:17:24.569717+0000","last_clean":"2023-10-06T11:17:24.569717+0000","last_became_active":"2023-10-06T11:17:24.564786+0000","last_became_peered":"2023-10-06T11:17:24.564786+0000","last_unstale":"2023-10-06T11:17:24.569717+0000","last_undegraded":"2023-10-06T11:17:24.569717+0000","last_fullsized":"2023-10-06T11:17:24.569717+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:51:39.405314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.581331+0000","last_change":"2023-10-06T11:17:23.567167+0000","last_active":"2023-10-06T11:17:24.581331+0000","last_peered":"2023-10-06T11:17:24.581331+0000","last_clean":"2023-10-06T11:17:24.581331+0000","last_became_active":"2023-10-06T11:17:23.566837+0000","last_became_peered":"2023-10-06T11:17:23.566837+0000","last_unstale":"2023-10-06T11:17:24.581331+0000","last_undegraded":"2023-10-06T11:17:24.581331+0000","last_fullsized":"2023-10-06T11:17:24.581331+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:02:19.001747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.579437+0000","last_change":"2023-10-06T11:17:24.576887+0000","last_active":"2023-10-06T11:17:24.579437+0000","last_peered":"2023-10-06T11:17:24.579437+0000","last_clean":"2023-10-06T11:17:24.579437+0000","last_became_active":"2023-10-06T11:17:24.576611+0000","last_became_peered":"2023-10-06T11:17:24.576611+0000","last_unstale":"2023-10-06T11:17:24.579437+0000","last_undegraded":"2023-10-06T11:17:24.579437+0000","last_fullsized":"2023-10-06T11:17:24.579437+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:08:07.693719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.580673+0000","last_change":"2023-10-06T11:17:23.569167+0000","last_active":"2023-10-06T11:17:24.580673+0000","last_peered":"2023-10-06T11:17:24.580673+0000","last_clean":"2023-10-06T11:17:24.580673+0000","last_became_active":"2023-10-06T11:17:23.568918+0000","last_became_peered":"2023-10-06T11:17:23.568918+0000","last_unstale":"2023-10-06T11:17:24.580673+0000","last_undegraded":"2023-10-06T11:17:24.580673+0000","last_fullsized":"2023-10-06T11:17:24.580673+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:36:10.273812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:23.546397+0000","last_change":"2023-10-06T11:17:23.546397+0000","last_active":"2023-10-06T11:17:23.546397+0000","last_peered":"2023-10-06T11:17:23.546397+0000","last_clean":"2023-10-06T11:17:23.546397+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:23.546397+0000","last_undegraded":"2023-10-06T11:17:23.546397+0000","last_fullsized":"2023-10-06T11:17:23.546397+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:22.540743+0000","last_change":"2023-10-06T11:17:22.540743+0000","last_active":"2023-10-06T11:17:22.540743+0000","last_peered":"2023-10-06T11:17:22.540743+0000","last_clean":"2023-10-06T11:17:22.540743+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:22.540743+0000","last_undegraded":"2023-10-06T11:17:22.540743+0000","last_fullsized":"2023-10-06T11:17:22.540743+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.570073+0000","last_change":"2023-10-06T11:17:24.565604+0000","last_active":"2023-10-06T11:17:24.570073+0000","last_peered":"2023-10-06T11:17:24.570073+0000","last_clean":"2023-10-06T11:17:24.570073+0000","last_became_active":"2023-10-06T11:17:24.565350+0000","last_became_peered":"2023-10-06T11:17:24.565350+0000","last_unstale":"2023-10-06T11:17:24.570073+0000","last_undegraded":"2023-10-06T11:17:24.570073+0000","last_fullsized":"2023-10-06T11:17:24.570073+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:15:45.424139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.582384+0000","last_change":"2023-10-06T11:17:23.574166+0000","last_active":"2023-10-06T11:17:24.582384+0000","last_peered":"2023-10-06T11:17:24.582384+0000","last_clean":"2023-10-06T11:17:24.582384+0000","last_became_active":"2023-10-06T11:17:23.573890+0000","last_became_peered":"2023-10-06T11:17:23.573890+0000","last_unstale":"2023-10-06T11:17:24.582384+0000","last_undegraded":"2023-10-06T11:17:24.582384+0000","last_fullsized":"2023-10-06T11:17:24.582384+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:03:31.748977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.576106+0000","last_change":"2023-10-06T11:17:24.568162+0000","last_active":"2023-10-06T11:17:24.576106+0000","last_peered":"2023-10-06T11:17:24.576106+0000","last_clean":"2023-10-06T11:17:24.576106+0000","last_became_active":"2023-10-06T11:17:24.567852+0000","last_became_peered":"2023-10-06T11:17:24.567852+0000","last_unstale":"2023-10-06T11:17:24.576106+0000","last_undegraded":"2023-10-06T11:17:24.576106+0000","last_fullsized":"2023-10-06T11:17:24.576106+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:55.042996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.559880+0000","last_change":"2023-10-06T11:17:23.564753+0000","last_active":"2023-10-06T11:17:24.559880+0000","last_peered":"2023-10-06T11:17:24.559880+0000","last_clean":"2023-10-06T11:17:24.559880+0000","last_became_active":"2023-10-06T11:17:23.564344+0000","last_became_peered":"2023-10-06T11:17:23.564344+0000","last_unstale":"2023-10-06T11:17:24.559880+0000","last_undegraded":"2023-10-06T11:17:24.559880+0000","last_fullsized":"2023-10-06T11:17:24.559880+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:16:28.786528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:23.546397+0000","last_change":"2023-10-06T11:17:23.546397+0000","last_active":"2023-10-06T11:17:23.546397+0000","last_peered":"2023-10-06T11:17:23.546397+0000","last_clean":"2023-10-06T11:17:23.546397+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:23.546397+0000","last_undegraded":"2023-10-06T11:17:23.546397+0000","last_fullsized":"2023-10-06T11:17:23.546397+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:22.540743+0000","last_change":"2023-10-06T11:17:22.540743+0000","last_active":"2023-10-06T11:17:22.540743+0000","last_peered":"2023-10-06T11:17:22.540743+0000","last_clean":"2023-10-06T11:17:22.540743+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:22.540743+0000","last_undegraded":"2023-10-06T11:17:22.540743+0000","last_fullsized":"2023-10-06T11:17:22.540743+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:23.546397+0000","last_change":"2023-10-06T11:17:23.546397+0000","last_active":"2023-10-06T11:17:23.546397+0000","last_peered":"2023-10-06T11:17:23.546397+0000","last_clean":"2023-10-06T11:17:23.546397+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:23.546397+0000","last_undegraded":"2023-10-06T11:17:23.546397+0000","last_fullsized":"2023-10-06T11:17:23.546397+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.f","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.584220+0000","last_change":"2023-10-06T11:17:23.570528+0000","last_active":"2023-10-06T11:17:24.584220+0000","last_peered":"2023-10-06T11:17:24.584220+0000","last_clean":"2023-10-06T11:17:24.584220+0000","last_became_active":"2023-10-06T11:17:23.569805+0000","last_became_peered":"2023-10-06T11:17:23.569805+0000","last_unstale":"2023-10-06T11:17:24.584220+0000","last_undegraded":"2023-10-06T11:17:24.584220+0000","last_fullsized":"2023-10-06T11:17:24.584220+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:47.786408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:23.546397+0000","last_change":"2023-10-06T11:17:23.546397+0000","last_active":"2023-10-06T11:17:23.546397+0000","last_peered":"2023-10-06T11:17:23.546397+0000","last_clean":"2023-10-06T11:17:23.546397+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:23.546397+0000","last_undegraded":"2023-10-06T11:17:23.546397+0000","last_fullsized":"2023-10-06T11:17:23.546397+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:22.540743+0000","last_change":"2023-10-06T11:17:22.540743+0000","last_active":"2023-10-06T11:17:22.540743+0000","last_peered":"2023-10-06T11:17:22.540743+0000","last_clean":"2023-10-06T11:17:22.540743+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:22.540743+0000","last_undegraded":"2023-10-06T11:17:22.540743+0000","last_fullsized":"2023-10-06T11:17:22.540743+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.566193+0000","last_change":"2023-10-06T11:17:24.560745+0000","last_active":"2023-10-06T11:17:24.566193+0000","last_peered":"2023-10-06T11:17:24.566193+0000","last_clean":"2023-10-06T11:17:24.566193+0000","last_became_active":"2023-10-06T11:17:24.560494+0000","last_became_peered":"2023-10-06T11:17:24.560494+0000","last_unstale":"2023-10-06T11:17:24.566193+0000","last_undegraded":"2023-10-06T11:17:24.566193+0000","last_fullsized":"2023-10-06T11:17:24.566193+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:36:51.480975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.584634+0000","last_change":"2023-10-06T11:17:23.567691+0000","last_active":"2023-10-06T11:17:24.584634+0000","last_peered":"2023-10-06T11:17:24.584634+0000","last_clean":"2023-10-06T11:17:24.584634+0000","last_became_active":"2023-10-06T11:17:23.567421+0000","last_became_peered":"2023-10-06T11:17:23.567421+0000","last_unstale":"2023-10-06T11:17:24.584634+0000","last_undegraded":"2023-10-06T11:17:24.584634+0000","last_fullsized":"2023-10-06T11:17:24.584634+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:04:18.984996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.570793+0000","last_change":"2023-10-06T11:17:24.568416+0000","last_active":"2023-10-06T11:17:24.570793+0000","last_peered":"2023-10-06T11:17:24.570793+0000","last_clean":"2023-10-06T11:17:24.570793+0000","last_became_active":"2023-10-06T11:17:24.568134+0000","last_became_peered":"2023-10-06T11:17:24.568134+0000","last_unstale":"2023-10-06T11:17:24.570793+0000","last_undegraded":"2023-10-06T11:17:24.570793+0000","last_fullsized":"2023-10-06T11:17:24.570793+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:09.705291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:22.540743+0000","last_change":"2023-10-06T11:17:22.540743+0000","last_active":"2023-10-06T11:17:22.540743+0000","last_peered":"2023-10-06T11:17:22.540743+0000","last_clean":"2023-10-06T11:17:22.540743+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:22.540743+0000","last_undegraded":"2023-10-06T11:17:22.540743+0000","last_fullsized":"2023-10-06T11:17:22.540743+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.565528+0000","last_change":"2023-10-06T11:17:24.563167+0000","last_active":"2023-10-06T11:17:24.565528+0000","last_peered":"2023-10-06T11:17:24.565528+0000","last_clean":"2023-10-06T11:17:24.565528+0000","last_became_active":"2023-10-06T11:17:24.562916+0000","last_became_peered":"2023-10-06T11:17:24.562916+0000","last_unstale":"2023-10-06T11:17:24.565528+0000","last_undegraded":"2023-10-06T11:17:24.565528+0000","last_fullsized":"2023-10-06T11:17:24.565528+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:07.151312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.582310+0000","last_change":"2023-10-06T11:17:23.564393+0000","last_active":"2023-10-06T11:17:24.582310+0000","last_peered":"2023-10-06T11:17:24.582310+0000","last_clean":"2023-10-06T11:17:24.582310+0000","last_became_active":"2023-10-06T11:17:23.564170+0000","last_became_peered":"2023-10-06T11:17:23.564170+0000","last_unstale":"2023-10-06T11:17:24.582310+0000","last_undegraded":"2023-10-06T11:17:24.582310+0000","last_fullsized":"2023-10-06T11:17:24.582310+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:06:26.401026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.576850+0000","last_change":"2023-10-06T11:17:24.573793+0000","last_active":"2023-10-06T11:17:24.576850+0000","last_peered":"2023-10-06T11:17:24.576850+0000","last_clean":"2023-10-06T11:17:24.576850+0000","last_became_active":"2023-10-06T11:17:24.572324+0000","last_became_peered":"2023-10-06T11:17:24.572324+0000","last_unstale":"2023-10-06T11:17:24.576850+0000","last_undegraded":"2023-10-06T11:17:24.576850+0000","last_fullsized":"2023-10-06T11:17:24.576850+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:46:42.885085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.557151+0000","last_change":"2023-10-06T11:17:23.574712+0000","last_active":"2023-10-06T11:17:24.557151+0000","last_peered":"2023-10-06T11:17:24.557151+0000","last_clean":"2023-10-06T11:17:24.557151+0000","last_became_active":"2023-10-06T11:17:23.574435+0000","last_became_peered":"2023-10-06T11:17:23.574435+0000","last_unstale":"2023-10-06T11:17:24.557151+0000","last_undegraded":"2023-10-06T11:17:24.557151+0000","last_fullsized":"2023-10-06T11:17:24.557151+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:22:25.530859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.576306+0000","last_change":"2023-10-06T11:17:24.571701+0000","last_active":"2023-10-06T11:17:24.576306+0000","last_peered":"2023-10-06T11:17:24.576306+0000","last_clean":"2023-10-06T11:17:24.576306+0000","last_became_active":"2023-10-06T11:17:24.571457+0000","last_became_peered":"2023-10-06T11:17:24.571457+0000","last_unstale":"2023-10-06T11:17:24.576306+0000","last_undegraded":"2023-10-06T11:17:24.576306+0000","last_fullsized":"2023-10-06T11:17:24.576306+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:45:28.551838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.559974+0000","last_change":"2023-10-06T11:17:23.564865+0000","last_active":"2023-10-06T11:17:24.559974+0000","last_peered":"2023-10-06T11:17:24.559974+0000","last_clean":"2023-10-06T11:17:24.559974+0000","last_became_active":"2023-10-06T11:17:23.564694+0000","last_became_peered":"2023-10-06T11:17:23.564694+0000","last_unstale":"2023-10-06T11:17:24.559974+0000","last_undegraded":"2023-10-06T11:17:24.559974+0000","last_fullsized":"2023-10-06T11:17:24.559974+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:11.629965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.576583+0000","last_change":"2023-10-06T11:17:24.575646+0000","last_active":"2023-10-06T11:17:24.576583+0000","last_peered":"2023-10-06T11:17:24.576583+0000","last_clean":"2023-10-06T11:17:24.576583+0000","last_became_active":"2023-10-06T11:17:24.570344+0000","last_became_peered":"2023-10-06T11:17:24.570344+0000","last_unstale":"2023-10-06T11:17:24.576583+0000","last_undegraded":"2023-10-06T11:17:24.576583+0000","last_fullsized":"2023-10-06T11:17:24.576583+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:38.610243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.566184+0000","last_change":"2023-10-06T11:17:23.574083+0000","last_active":"2023-10-06T11:17:24.566184+0000","last_peered":"2023-10-06T11:17:24.566184+0000","last_clean":"2023-10-06T11:17:24.566184+0000","last_became_active":"2023-10-06T11:17:23.573768+0000","last_became_peered":"2023-10-06T11:17:23.573768+0000","last_unstale":"2023-10-06T11:17:24.566184+0000","last_undegraded":"2023-10-06T11:17:24.566184+0000","last_fullsized":"2023-10-06T11:17:24.566184+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:32:36.073066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.570609+0000","last_change":"2023-10-06T11:17:24.567062+0000","last_active":"2023-10-06T11:17:24.570609+0000","last_peered":"2023-10-06T11:17:24.570609+0000","last_clean":"2023-10-06T11:17:24.570609+0000","last_became_active":"2023-10-06T11:17:24.566801+0000","last_became_peered":"2023-10-06T11:17:24.566801+0000","last_unstale":"2023-10-06T11:17:24.570609+0000","last_undegraded":"2023-10-06T11:17:24.570609+0000","last_fullsized":"2023-10-06T11:17:24.570609+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:31:49.318112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.584283+0000","last_change":"2023-10-06T11:17:23.564402+0000","last_active":"2023-10-06T11:17:24.584283+0000","last_peered":"2023-10-06T11:17:24.584283+0000","last_clean":"2023-10-06T11:17:24.584283+0000","last_became_active":"2023-10-06T11:17:23.564113+0000","last_became_peered":"2023-10-06T11:17:23.564113+0000","last_unstale":"2023-10-06T11:17:24.584283+0000","last_undegraded":"2023-10-06T11:17:24.584283+0000","last_fullsized":"2023-10-06T11:17:24.584283+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:53:59.261371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:23.546397+0000","last_change":"2023-10-06T11:17:23.546397+0000","last_active":"2023-10-06T11:17:23.546397+0000","last_peered":"2023-10-06T11:17:23.546397+0000","last_clean":"2023-10-06T11:17:23.546397+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:23.546397+0000","last_undegraded":"2023-10-06T11:17:23.546397+0000","last_fullsized":"2023-10-06T11:17:23.546397+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.555158+0000","last_change":"2023-10-06T11:17:23.570514+0000","last_active":"2023-10-06T11:17:24.555158+0000","last_peered":"2023-10-06T11:17:24.555158+0000","last_clean":"2023-10-06T11:17:24.555158+0000","last_became_active":"2023-10-06T11:17:23.570179+0000","last_became_peered":"2023-10-06T11:17:23.570179+0000","last_unstale":"2023-10-06T11:17:24.555158+0000","last_undegraded":"2023-10-06T11:17:24.555158+0000","last_fullsized":"2023-10-06T11:17:24.555158+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:08:06.688065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575970+0000","last_change":"2023-10-06T11:17:24.566933+0000","last_active":"2023-10-06T11:17:24.575970+0000","last_peered":"2023-10-06T11:17:24.575970+0000","last_clean":"2023-10-06T11:17:24.575970+0000","last_became_active":"2023-10-06T11:17:24.566764+0000","last_became_peered":"2023-10-06T11:17:24.566764+0000","last_unstale":"2023-10-06T11:17:24.575970+0000","last_undegraded":"2023-10-06T11:17:24.575970+0000","last_fullsized":"2023-10-06T11:17:24.575970+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:21:32.239463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.554770+0000","last_change":"2023-10-06T11:17:23.571952+0000","last_active":"2023-10-06T11:17:24.554770+0000","last_peered":"2023-10-06T11:17:24.554770+0000","last_clean":"2023-10-06T11:17:24.554770+0000","last_became_active":"2023-10-06T11:17:23.565102+0000","last_became_peered":"2023-10-06T11:17:23.565102+0000","last_unstale":"2023-10-06T11:17:24.554770+0000","last_undegraded":"2023-10-06T11:17:24.554770+0000","last_fullsized":"2023-10-06T11:17:24.554770+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:11:11.687267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:23.546397+0000","last_change":"2023-10-06T11:17:23.546397+0000","last_active":"2023-10-06T11:17:23.546397+0000","last_peered":"2023-10-06T11:17:23.546397+0000","last_clean":"2023-10-06T11:17:23.546397+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:23.546397+0000","last_undegraded":"2023-10-06T11:17:23.546397+0000","last_fullsized":"2023-10-06T11:17:23.546397+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.560119+0000","last_change":"2023-10-06T11:17:23.569219+0000","last_active":"2023-10-06T11:17:24.560119+0000","last_peered":"2023-10-06T11:17:24.560119+0000","last_clean":"2023-10-06T11:17:24.560119+0000","last_became_active":"2023-10-06T11:17:23.568946+0000","last_became_peered":"2023-10-06T11:17:23.568946+0000","last_unstale":"2023-10-06T11:17:24.560119+0000","last_undegraded":"2023-10-06T11:17:24.560119+0000","last_fullsized":"2023-10-06T11:17:24.560119+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:12:28.041975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:23.546397+0000","last_change":"2023-10-06T11:17:23.546397+0000","last_active":"2023-10-06T11:17:23.546397+0000","last_peered":"2023-10-06T11:17:23.546397+0000","last_clean":"2023-10-06T11:17:23.546397+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:23.546397+0000","last_undegraded":"2023-10-06T11:17:23.546397+0000","last_fullsized":"2023-10-06T11:17:23.546397+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:22.540743+0000","last_change":"2023-10-06T11:17:22.540743+0000","last_active":"2023-10-06T11:17:22.540743+0000","last_peered":"2023-10-06T11:17:22.540743+0000","last_clean":"2023-10-06T11:17:22.540743+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:22.540743+0000","last_undegraded":"2023-10-06T11:17:22.540743+0000","last_fullsized":"2023-10-06T11:17:22.540743+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.579474+0000","last_change":"2023-10-06T11:17:24.577355+0000","last_active":"2023-10-06T11:17:24.579474+0000","last_peered":"2023-10-06T11:17:24.579474+0000","last_clean":"2023-10-06T11:17:24.579474+0000","last_became_active":"2023-10-06T11:17:24.577095+0000","last_became_peered":"2023-10-06T11:17:24.577095+0000","last_unstale":"2023-10-06T11:17:24.579474+0000","last_undegraded":"2023-10-06T11:17:24.579474+0000","last_fullsized":"2023-10-06T11:17:24.579474+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:15:11.263158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.554819+0000","last_change":"2023-10-06T11:17:23.562075+0000","last_active":"2023-10-06T11:17:24.554819+0000","last_peered":"2023-10-06T11:17:24.554819+0000","last_clean":"2023-10-06T11:17:24.554819+0000","last_became_active":"2023-10-06T11:17:23.561792+0000","last_became_peered":"2023-10-06T11:17:23.561792+0000","last_unstale":"2023-10-06T11:17:24.554819+0000","last_undegraded":"2023-10-06T11:17:24.554819+0000","last_fullsized":"2023-10-06T11:17:24.554819+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:08.699637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.567434+0000","last_change":"2023-10-06T11:17:24.560966+0000","last_active":"2023-10-06T11:17:24.567434+0000","last_peered":"2023-10-06T11:17:24.567434+0000","last_clean":"2023-10-06T11:17:24.567434+0000","last_became_active":"2023-10-06T11:17:24.560664+0000","last_became_peered":"2023-10-06T11:17:24.560664+0000","last_unstale":"2023-10-06T11:17:24.567434+0000","last_undegraded":"2023-10-06T11:17:24.567434+0000","last_fullsized":"2023-10-06T11:17:24.567434+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:41:38.833103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.558951+0000","last_change":"2023-10-06T11:17:23.567100+0000","last_active":"2023-10-06T11:17:24.558951+0000","last_peered":"2023-10-06T11:17:24.558951+0000","last_clean":"2023-10-06T11:17:24.558951+0000","last_became_active":"2023-10-06T11:17:23.566811+0000","last_became_peered":"2023-10-06T11:17:23.566811+0000","last_unstale":"2023-10-06T11:17:24.558951+0000","last_undegraded":"2023-10-06T11:17:24.558951+0000","last_fullsized":"2023-10-06T11:17:24.558951+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:11:04.566108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575944+0000","last_change":"2023-10-06T11:17:24.567836+0000","last_active":"2023-10-06T11:17:24.575944+0000","last_peered":"2023-10-06T11:17:24.575944+0000","last_clean":"2023-10-06T11:17:24.575944+0000","last_became_active":"2023-10-06T11:17:24.567579+0000","last_became_peered":"2023-10-06T11:17:24.567579+0000","last_unstale":"2023-10-06T11:17:24.575944+0000","last_undegraded":"2023-10-06T11:17:24.575944+0000","last_fullsized":"2023-10-06T11:17:24.575944+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:02:58.843409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.558726+0000","last_change":"2023-10-06T11:17:23.569068+0000","last_active":"2023-10-06T11:17:24.558726+0000","last_peered":"2023-10-06T11:17:24.558726+0000","last_clean":"2023-10-06T11:17:24.558726+0000","last_became_active":"2023-10-06T11:17:23.568821+0000","last_became_peered":"2023-10-06T11:17:23.568821+0000","last_unstale":"2023-10-06T11:17:24.558726+0000","last_undegraded":"2023-10-06T11:17:24.558726+0000","last_fullsized":"2023-10-06T11:17:24.558726+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:08:53.820378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:23.546397+0000","last_change":"2023-10-06T11:17:23.546397+0000","last_active":"2023-10-06T11:17:23.546397+0000","last_peered":"2023-10-06T11:17:23.546397+0000","last_clean":"2023-10-06T11:17:23.546397+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:23.546397+0000","last_undegraded":"2023-10-06T11:17:23.546397+0000","last_fullsized":"2023-10-06T11:17:23.546397+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.13","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.587184+0000","last_change":"2023-10-06T11:17:23.567296+0000","last_active":"2023-10-06T11:17:24.587184+0000","last_peered":"2023-10-06T11:17:24.587184+0000","last_clean":"2023-10-06T11:17:24.587184+0000","last_became_active":"2023-10-06T11:17:23.566993+0000","last_became_peered":"2023-10-06T11:17:23.566993+0000","last_unstale":"2023-10-06T11:17:24.587184+0000","last_undegraded":"2023-10-06T11:17:24.587184+0000","last_fullsized":"2023-10-06T11:17:24.587184+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:06.145658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":127,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-06T11:17:18.537687+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:17:18.537687+0000","last_peered":"2023-10-06T11:17:18.537687+0000","last_clean":"2023-10-06T11:17:18.537687+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:17:18.537687+0000","last_undegraded":"2023-10-06T11:17:18.537687+0000","last_fullsized":"2023-10-06T11:17:18.537687+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:23.546397+0000","last_change":"2023-10-06T11:17:23.546397+0000","last_active":"2023-10-06T11:17:23.546397+0000","last_peered":"2023-10-06T11:17:23.546397+0000","last_clean":"2023-10-06T11:17:23.546397+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:23.546397+0000","last_undegraded":"2023-10-06T11:17:23.546397+0000","last_fullsized":"2023-10-06T11:17:23.546397+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.554724+0000","last_change":"2023-10-06T11:17:23.564126+0000","last_active":"2023-10-06T11:17:24.554724+0000","last_peered":"2023-10-06T11:17:24.554724+0000","last_clean":"2023-10-06T11:17:24.554724+0000","last_became_active":"2023-10-06T11:17:23.563881+0000","last_became_peered":"2023-10-06T11:17:23.563881+0000","last_unstale":"2023-10-06T11:17:24.554724+0000","last_undegraded":"2023-10-06T11:17:24.554724+0000","last_fullsized":"2023-10-06T11:17:24.554724+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:55.946021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":124,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.555311+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:17:24.555311+0000","last_peered":"2023-10-06T11:17:24.555311+0000","last_clean":"2023-10-06T11:17:24.555311+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:17:24.555311+0000","last_undegraded":"2023-10-06T11:17:24.555311+0000","last_fullsized":"2023-10-06T11:17:24.555311+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.580493+0000","last_change":"2023-10-06T11:17:24.569576+0000","last_active":"2023-10-06T11:17:24.580493+0000","last_peered":"2023-10-06T11:17:24.580493+0000","last_clean":"2023-10-06T11:17:24.580493+0000","last_became_active":"2023-10-06T11:17:24.569315+0000","last_became_peered":"2023-10-06T11:17:24.569315+0000","last_unstale":"2023-10-06T11:17:24.580493+0000","last_undegraded":"2023-10-06T11:17:24.580493+0000","last_fullsized":"2023-10-06T11:17:24.580493+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:23.035153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:22.540743+0000","last_change":"2023-10-06T11:17:22.540743+0000","last_active":"2023-10-06T11:17:22.540743+0000","last_peered":"2023-10-06T11:17:22.540743+0000","last_clean":"2023-10-06T11:17:22.540743+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:22.540743+0000","last_undegraded":"2023-10-06T11:17:22.540743+0000","last_fullsized":"2023-10-06T11:17:22.540743+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":118,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-06T11:17:19.175847+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:17:19.175847+0000","last_peered":"2023-10-06T11:17:19.175847+0000","last_clean":"2023-10-06T11:17:19.175847+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:17:19.175847+0000","last_undegraded":"2023-10-06T11:17:19.175847+0000","last_fullsized":"2023-10-06T11:17:19.175847+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":267,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.566276+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:17:24.566276+0000","last_peered":"2023-10-06T11:17:24.566276+0000","last_clean":"2023-10-06T11:17:24.566276+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:17:24.566276+0000","last_undegraded":"2023-10-06T11:17:24.566276+0000","last_fullsized":"2023-10-06T11:17:24.566276+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575929+0000","last_change":"2023-10-06T11:17:24.567759+0000","last_active":"2023-10-06T11:17:24.575929+0000","last_peered":"2023-10-06T11:17:24.575929+0000","last_clean":"2023-10-06T11:17:24.575929+0000","last_became_active":"2023-10-06T11:17:24.567496+0000","last_became_peered":"2023-10-06T11:17:24.567496+0000","last_unstale":"2023-10-06T11:17:24.575929+0000","last_undegraded":"2023-10-06T11:17:24.575929+0000","last_fullsized":"2023-10-06T11:17:24.575929+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:25:25.920939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"150'6","reported_seq":16,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.586312+0000","last_change":"2023-10-06T11:17:23.570090+0000","last_active":"2023-10-06T11:17:24.586312+0000","last_peered":"2023-10-06T11:17:24.586312+0000","last_clean":"2023-10-06T11:17:24.586312+0000","last_became_active":"2023-10-06T11:17:23.569829+0000","last_became_peered":"2023-10-06T11:17:23.569829+0000","last_unstale":"2023-10-06T11:17:24.586312+0000","last_undegraded":"2023-10-06T11:17:24.586312+0000","last_fullsized":"2023-10-06T11:17:24.586312+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:15:10.257503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":117,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.563929+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:17:24.563929+0000","last_peered":"2023-10-06T11:17:24.563929+0000","last_clean":"2023-10-06T11:17:24.563929+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:17:24.563929+0000","last_undegraded":"2023-10-06T11:17:24.563929+0000","last_fullsized":"2023-10-06T11:17:24.563929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.579240+0000","last_change":"2023-10-06T11:17:24.575811+0000","last_active":"2023-10-06T11:17:24.579240+0000","last_peered":"2023-10-06T11:17:24.579240+0000","last_clean":"2023-10-06T11:17:24.579240+0000","last_became_active":"2023-10-06T11:17:24.570303+0000","last_became_peered":"2023-10-06T11:17:24.570303+0000","last_unstale":"2023-10-06T11:17:24.579240+0000","last_undegraded":"2023-10-06T11:17:24.579240+0000","last_fullsized":"2023-10-06T11:17:24.579240+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:59:56.385931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.555042+0000","last_change":"2023-10-06T11:17:23.570382+0000","last_active":"2023-10-06T11:17:24.555042+0000","last_peered":"2023-10-06T11:17:24.555042+0000","last_clean":"2023-10-06T11:17:24.555042+0000","last_became_active":"2023-10-06T11:17:23.569847+0000","last_became_peered":"2023-10-06T11:17:23.569847+0000","last_unstale":"2023-10-06T11:17:24.555042+0000","last_undegraded":"2023-10-06T11:17:24.555042+0000","last_fullsized":"2023-10-06T11:17:24.555042+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:15:11.795033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":117,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.566358+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:17:24.566358+0000","last_peered":"2023-10-06T11:17:24.566358+0000","last_clean":"2023-10-06T11:17:24.566358+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:17:24.566358+0000","last_undegraded":"2023-10-06T11:17:24.566358+0000","last_fullsized":"2023-10-06T11:17:24.566358+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.579416+0000","last_change":"2023-10-06T11:17:24.576816+0000","last_active":"2023-10-06T11:17:24.579416+0000","last_peered":"2023-10-06T11:17:24.579416+0000","last_clean":"2023-10-06T11:17:24.579416+0000","last_became_active":"2023-10-06T11:17:24.576459+0000","last_became_peered":"2023-10-06T11:17:24.576459+0000","last_unstale":"2023-10-06T11:17:24.579416+0000","last_undegraded":"2023-10-06T11:17:24.579416+0000","last_fullsized":"2023-10-06T11:17:24.579416+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:15:12.800687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.555532+0000","last_change":"2023-10-06T11:17:23.570674+0000","last_active":"2023-10-06T11:17:24.555532+0000","last_peered":"2023-10-06T11:17:24.555532+0000","last_clean":"2023-10-06T11:17:24.555532+0000","last_became_active":"2023-10-06T11:17:23.570308+0000","last_became_peered":"2023-10-06T11:17:23.570308+0000","last_unstale":"2023-10-06T11:17:24.555532+0000","last_undegraded":"2023-10-06T11:17:24.555532+0000","last_fullsized":"2023-10-06T11:17:24.555532+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:59:55.380277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":140,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.559017+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:17:24.559017+0000","last_peered":"2023-10-06T11:17:24.559017+0000","last_clean":"2023-10-06T11:17:24.559017+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:17:24.559017+0000","last_undegraded":"2023-10-06T11:17:24.559017+0000","last_fullsized":"2023-10-06T11:17:24.559017+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575922+0000","last_change":"2023-10-06T11:17:24.566665+0000","last_active":"2023-10-06T11:17:24.575922+0000","last_peered":"2023-10-06T11:17:24.575922+0000","last_clean":"2023-10-06T11:17:24.575922+0000","last_became_active":"2023-10-06T11:17:24.566426+0000","last_became_peered":"2023-10-06T11:17:24.566426+0000","last_unstale":"2023-10-06T11:17:24.575922+0000","last_undegraded":"2023-10-06T11:17:24.575922+0000","last_fullsized":"2023-10-06T11:17:24.575922+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:29:19.469513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:22.540743+0000","last_change":"2023-10-06T11:17:22.540743+0000","last_active":"2023-10-06T11:17:22.540743+0000","last_peered":"2023-10-06T11:17:22.540743+0000","last_clean":"2023-10-06T11:17:22.540743+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:22.540743+0000","last_undegraded":"2023-10-06T11:17:22.540743+0000","last_fullsized":"2023-10-06T11:17:22.540743+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":120,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-06T11:17:19.175644+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:17:19.175644+0000","last_peered":"2023-10-06T11:17:19.175644+0000","last_clean":"2023-10-06T11:17:19.175644+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:17:19.175644+0000","last_undegraded":"2023-10-06T11:17:19.175644+0000","last_fullsized":"2023-10-06T11:17:19.175644+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.570686+0000","last_change":"2023-10-06T11:17:24.567445+0000","last_active":"2023-10-06T11:17:24.570686+0000","last_peered":"2023-10-06T11:17:24.570686+0000","last_clean":"2023-10-06T11:17:24.570686+0000","last_became_active":"2023-10-06T11:17:24.567192+0000","last_became_peered":"2023-10-06T11:17:24.567192+0000","last_unstale":"2023-10-06T11:17:24.570686+0000","last_undegraded":"2023-10-06T11:17:24.570686+0000","last_fullsized":"2023-10-06T11:17:24.570686+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:20.201597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.558847+0000","last_change":"2023-10-06T11:17:23.565830+0000","last_active":"2023-10-06T11:17:24.558847+0000","last_peered":"2023-10-06T11:17:24.558847+0000","last_clean":"2023-10-06T11:17:24.558847+0000","last_became_active":"2023-10-06T11:17:23.565544+0000","last_became_peered":"2023-10-06T11:17:23.565544+0000","last_unstale":"2023-10-06T11:17:24.558847+0000","last_undegraded":"2023-10-06T11:17:24.558847+0000","last_fullsized":"2023-10-06T11:17:24.558847+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:45.678850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":120,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-06T11:17:19.175649+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:17:19.175649+0000","last_peered":"2023-10-06T11:17:19.175649+0000","last_clean":"2023-10-06T11:17:19.175649+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:17:19.175649+0000","last_undegraded":"2023-10-06T11:17:19.175649+0000","last_fullsized":"2023-10-06T11:17:19.175649+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":84,"acting":84,"num_store_stats":5},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":1662,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":48,"acting":48,"num_store_stats":5},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574993,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303816,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068024,"statfs":{"total":96636764160,"available":96325656576,"internally_reserved":0,"allocated":2490368,"data_stored":1465114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.54300000000000004,"15min":0.626},"min":{"1min":0.35699999999999998,"5min":0.252,"15min":0.21199999999999999},"max":{"1min":0.71699999999999997,"5min":4.407,"15min":23.908999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.51400000000000001,"15min":0.57499999999999996},"min":{"1min":0.33200000000000002,"5min":0.26900000000000002,"15min":0.22500000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":9.3230000000000004},"last":0.628}]},{"osd":1,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53700000000000003,"15min":0.56000000000000005},"min":{"1min":0.28799999999999998,"5min":0.28399999999999997,"15min":0.26000000000000001},"max":{"1min":0.77700000000000002,"5min":2.4689999999999999,"15min":9.2360000000000007},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.502,"15min":0.504},"min":{"1min":0.40999999999999998,"5min":0.33100000000000002,"15min":0.25900000000000001},"max":{"1min":0.70899999999999996,"5min":0.78900000000000003,"15min":4.327},"last":0.499}]},{"osd":2,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56899999999999995,"15min":0.51900000000000002},"min":{"1min":0.40100000000000002,"5min":0.33000000000000002,"15min":0.26500000000000001},"max":{"1min":0.69999999999999996,"5min":4.3120000000000003,"15min":4.3120000000000003},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55900000000000005,"15min":0.55600000000000005},"min":{"1min":0.372,"5min":0.31,"15min":0.29999999999999999},"max":{"1min":0.74099999999999999,"5min":3.0600000000000001,"15min":4.7309999999999999},"last":0.56699999999999995}]},{"osd":3,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.56899999999999995,"15min":0.54100000000000004},"min":{"1min":0.35299999999999998,"5min":0.32600000000000001,"15min":0.27900000000000003},"max":{"1min":0.72299999999999998,"5min":4.5190000000000001,"15min":4.5190000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.59499999999999997,"15min":0.59999999999999998},"min":{"1min":0.42799999999999999,"5min":0.36599999999999999,"15min":0.29699999999999999},"max":{"1min":0.76200000000000001,"5min":3.0070000000000001,"15min":9.3879999999999999},"last":0.60099999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.53400000000000003,"15min":0.49299999999999999},"min":{"1min":0.32000000000000001,"5min":0.29799999999999999,"15min":0.24399999999999999},"max":{"1min":0.69199999999999995,"5min":4.6639999999999997,"15min":4.6639999999999997},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.57299999999999995,"15min":0.53600000000000003},"min":{"1min":0.35399999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.70899999999999996,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":0.45600000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.56000000000000005},"min":{"1min":0.39200000000000002,"5min":0.32900000000000001,"15min":0.26000000000000001},"max":{"1min":0.66100000000000003,"5min":0.77000000000000002,"15min":9.3499999999999996},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.53100000000000003,"15min":0.54200000000000004},"min":{"1min":0.377,"5min":0.30099999999999999,"15min":0.26800000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":4.444},"last":0.54300000000000004}]},{"osd":6,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57099999999999995,"15min":0.59699999999999998},"min":{"1min":0.41399999999999998,"5min":0.38100000000000001,"15min":0.29199999999999998},"max":{"1min":0.73699999999999999,"5min":0.82099999999999995,"15min":9.4969999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.64000000000000001,"15min":0.62},"min":{"1min":0.44,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.75600000000000001,"5min":4.4669999999999996,"15min":7.2039999999999997},"last":0.51700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574994,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299088,"kb_used_data":1800,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072752,"statfs":{"total":96636764160,"available":96330498048,"internally_reserved":0,"allocated":1843200,"data_stored":846870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.60199999999999998,"15min":0.52400000000000002},"min":{"1min":0.35199999999999998,"5min":0.247,"15min":0.187},"max":{"1min":0.80500000000000005,"5min":9.5549999999999997,"15min":9.5549999999999997},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.65600000000000003,"15min":0.56699999999999995},"min":{"1min":0.44400000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.78400000000000003,"5min":9.4659999999999993,"15min":9.4659999999999993},"last":0.72799999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.49299999999999999,"15min":0.48399999999999999},"min":{"1min":0.33500000000000002,"5min":0.26800000000000002,"15min":0.23300000000000001},"max":{"1min":0.74299999999999999,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.622},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.57699999999999996,"15min":0.51600000000000001},"min":{"1min":0.34399999999999997,"5min":0.216,"15min":0.216},"max":{"1min":0.71399999999999997,"5min":5.2670000000000003,"15min":5.2670000000000003},"last":0.77300000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.5,"15min":0.503},"min":{"1min":0.33700000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.77100000000000002,"5min":0.93200000000000005,"15min":7.0659999999999998},"last":0.745},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.51300000000000001,"15min":0.51900000000000002},"min":{"1min":0.41199999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.69199999999999995,"5min":1.0069999999999999,"15min":7.0819999999999999},"last":0.71499999999999997}]},{"osd":3,"last update":"Fri Oct 6 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.56000000000000005,"15min":0.52000000000000002},"min":{"1min":0.39700000000000002,"5min":0.317,"15min":0.25800000000000001},"max":{"1min":0.75700000000000001,"5min":3.871,"15min":3.871},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.54000000000000004,"15min":0.53200000000000003},"min":{"1min":0.43099999999999999,"5min":0.32100000000000001,"15min":0.312},"max":{"1min":0.72799999999999998,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.80700000000000005}]},{"osd":4,"last update":"Fri Oct 6 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.48099999999999998,"15min":0.47799999999999998},"min":{"1min":0.34899999999999998,"5min":0.26800000000000002,"15min":0.24299999999999999},"max":{"1min":0.68600000000000005,"5min":0.88,"15min":0.88},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53600000000000003,"15min":0.53300000000000003},"min":{"1min":0.378,"5min":0.29699999999999999,"15min":0.27900000000000003},"max":{"1min":0.71199999999999997,"5min":0.82399999999999995,"15min":1.0680000000000001},"last":0.59699999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52100000000000002,"15min":0.51700000000000002},"min":{"1min":0.38400000000000001,"5min":0.32000000000000001,"15min":0.28399999999999997},"max":{"1min":0.73399999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.627,"15min":0.57999999999999996},"min":{"1min":0.39500000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.745,"5min":7.1379999999999999,"15min":7.1379999999999999},"last":0.67200000000000004}]},{"osd":7,"last update":"Fri Oct 6 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58599999999999997,"15min":0.56799999999999995},"min":{"1min":0.42499999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.748,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59099999999999997,"15min":0.58499999999999996},"min":{"1min":0.45800000000000002,"5min":0.36399999999999999,"15min":0.30199999999999999},"max":{"1min":0.82099999999999995,"5min":0.86899999999999999,"15min":0.88400000000000001},"last":0.82999999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574993,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311960,"kb_used_data":2384,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059880,"statfs":{"total":96636764160,"available":96317317120,"internally_reserved":0,"allocated":2441216,"data_stored":1438591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:59 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.47099999999999997,"15min":0.377},"min":{"1min":0.247,"5min":0.20499999999999999,"15min":0.186},"max":{"1min":0.49399999999999999,"5min":13.393000000000001,"15min":13.393000000000001},"last":0.438},{"interface":"front","average":{"1min":0.374,"5min":0.46899999999999997,"15min":0.38600000000000001},"min":{"1min":0.254,"5min":0.22500000000000001,"15min":0.19700000000000001},"max":{"1min":0.53900000000000003,"5min":11.462,"15min":11.462},"last":0.247}]},{"osd":2,"last update":"Fri Oct 6 11:16:59 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.41399999999999998,"15min":0.36099999999999999},"min":{"1min":0.25800000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.48099999999999998,"5min":8.0470000000000006,"15min":8.0470000000000006},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.44900000000000001,"15min":0.40799999999999997},"min":{"1min":0.32100000000000001,"5min":0.215,"15min":0.20999999999999999},"max":{"1min":0.58399999999999996,"5min":4.8630000000000004,"15min":4.8630000000000004},"last":0.36199999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:16:59 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46700000000000003,"15min":0.42599999999999999},"min":{"1min":0.28599999999999998,"5min":0.255,"15min":0.252},"max":{"1min":0.64800000000000002,"5min":4.8029999999999999,"15min":4.8029999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.45100000000000001,"15min":0.39700000000000002},"min":{"1min":0.29699999999999999,"5min":0.23400000000000001,"15min":0.217},"max":{"1min":0.749,"5min":5.8700000000000001,"15min":5.8700000000000001},"last":0.38100000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:16:59 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.54500000000000004,"15min":0.52500000000000002},"min":{"1min":0.39900000000000002,"5min":0.28299999999999997,"15min":0.28199999999999997},"max":{"1min":0.88400000000000001,"5min":1.264,"15min":1.264},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.625,"15min":0.57299999999999995},"min":{"1min":0.41199999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.89400000000000002,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.58099999999999996}]},{"osd":5,"last update":"Fri Oct 6 11:16:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.61299999999999999,"15min":0.57199999999999995},"min":{"1min":0.45600000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78600000000000003,"5min":3.4390000000000001,"15min":3.4390000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.68500000000000005,"15min":0.59299999999999997},"min":{"1min":0.42999999999999999,"5min":0.36799999999999999,"15min":0.29499999999999998},"max":{"1min":0.84499999999999997,"5min":9.3829999999999991,"15min":9.3829999999999991},"last":0.75800000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:16:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.64200000000000002,"15min":0.59299999999999997},"min":{"1min":0.42099999999999999,"5min":0.35999999999999999,"15min":0.315},"max":{"1min":0.83599999999999997,"5min":3.4750000000000001,"15min":3.4750000000000001},"last":0.748},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.64000000000000001,"15min":0.60099999999999998},"min":{"1min":0.36599999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.872,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.64600000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:16:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66200000000000003,"15min":0.61499999999999999},"min":{"1min":0.46600000000000003,"5min":0.39800000000000002,"15min":0.38500000000000001},"max":{"1min":0.82999999999999996,"5min":4.7290000000000001,"15min":4.7290000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.627,"15min":0.59599999999999997},"min":{"1min":0.48599999999999999,"5min":0.38900000000000001,"15min":0.374},"max":{"1min":0.81100000000000005,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.68400000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574993,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303240,"kb_used_data":1856,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068600,"statfs":{"total":96636764160,"available":96326246400,"internally_reserved":0,"allocated":1900544,"data_stored":873497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.34799999999999998,"15min":0.47099999999999997},"min":{"1min":0.248,"5min":0.20399999999999999,"15min":0.184},"max":{"1min":0.59599999999999997,"5min":0.64900000000000002,"15min":36.097999999999999},"last":0.436},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.371,"15min":0.38300000000000001},"min":{"1min":0.29899999999999999,"5min":0.22,"15min":0.182},"max":{"1min":0.497,"5min":0.92400000000000004,"15min":7.2990000000000004},"last":0.26400000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.37,"15min":0.503},"min":{"1min":0.223,"5min":0.223,"15min":0.217},"max":{"1min":0.49099999999999999,"5min":0.82599999999999996,"15min":36.07},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.39800000000000002,"15min":0.40999999999999998},"min":{"1min":0.26800000000000002,"5min":0.25600000000000001,"15min":0.219},"max":{"1min":0.57099999999999995,"5min":0.94899999999999995,"15min":6.7800000000000002},"last":0.41899999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.36899999999999999,"15min":0.39500000000000002},"min":{"1min":0.27500000000000002,"5min":0.255,"15min":0.223},"max":{"1min":0.53800000000000003,"5min":0.64100000000000001,"15min":8.4130000000000003},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.43099999999999999,"15min":0.56000000000000005},"min":{"1min":0.315,"5min":0.25800000000000001,"15min":0.249},"max":{"1min":0.59999999999999998,"5min":1.9079999999999999,"15min":35.959000000000003},"last":0.40600000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.57999999999999996,"15min":0.56699999999999995},"min":{"1min":0.39100000000000001,"5min":0.33800000000000002,"15min":0.29599999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":2.427},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.60199999999999998,"15min":0.73199999999999998},"min":{"1min":0.42899999999999999,"5min":0.374,"15min":0.29299999999999998},"max":{"1min":0.84999999999999998,"5min":0.94999999999999996,"15min":36.005000000000003},"last":0.82699999999999996}]},{"osd":5,"last update":"Fri Oct 6 11:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.58599999999999997,"15min":0.58499999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.32900000000000001},"max":{"1min":0.95299999999999996,"5min":0.999,"15min":6.6699999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58099999999999996,"15min":0.56000000000000005},"min":{"1min":0.41299999999999998,"5min":0.372,"15min":0.315},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":2.0600000000000001},"last":0.71399999999999997}]},{"osd":6,"last update":"Fri Oct 6 11:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.61299999999999999,"15min":0.73399999999999999},"min":{"1min":0.50600000000000001,"5min":0.39200000000000002,"15min":0.317},"max":{"1min":0.89600000000000002,"5min":0.98699999999999999,"15min":36.037999999999997},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.63100000000000001,"15min":0.64000000000000001},"min":{"1min":0.41299999999999998,"5min":0.40999999999999998,"15min":0.36399999999999999},"max":{"1min":0.89200000000000002,"5min":1.028,"15min":6.7110000000000003},"last":0.74099999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61499999999999999,"15min":0.624},"min":{"1min":0.432,"5min":0.40999999999999998,"15min":0.371},"max":{"1min":0.86599999999999999,"5min":1.054,"15min":6.742},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.58999999999999997,"15min":0.57399999999999995},"min":{"1min":0.42799999999999999,"5min":0.41399999999999998,"15min":0.34499999999999997},"max":{"1min":0.86699999999999999,"5min":0.96199999999999997,"15min":1.917},"last":0.628}]}]},{"osd":2,"up_from":13,"seq":55834574994,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299124,"kb_used_data":1836,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072716,"statfs":{"total":96636764160,"available":96330461184,"internally_reserved":0,"allocated":1880064,"data_stored":866752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":0.46700000000000003,"15min":0.36299999999999999},"min":{"1min":0.248,"5min":0.214,"15min":0.17999999999999999},"max":{"1min":15.228,"5min":15.228,"15min":15.228},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.503,"5min":0.40600000000000003,"15min":0.38900000000000001},"min":{"1min":0.32900000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":0.36599999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.38200000000000001,"15min":0.375},"min":{"1min":0.28899999999999998,"5min":0.23599999999999999,"15min":0.19900000000000001},"max":{"1min":0.56200000000000006,"5min":0.57499999999999996,"15min":0.745},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.36199999999999999,"15min":0.35399999999999998},"min":{"1min":0.23200000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.35699999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.36899999999999999,"15min":0.36799999999999999},"min":{"1min":0.27900000000000003,"5min":0.23699999999999999,"15min":0.23200000000000001},"max":{"1min":0.621,"5min":0.621,"15min":0.629},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.378,"15min":0.36799999999999999},"min":{"1min":0.27500000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.64400000000000002},"last":0.313}]},{"osd":4,"last update":"Fri Oct 6 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.46700000000000003,"5min":0.30599999999999999,"15min":0.30299999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":1.3200000000000001,"5min":0.69199999999999995,"15min":0.59499999999999997},"min":{"1min":0.42799999999999999,"5min":0.28199999999999997,"15min":0.27900000000000003},"max":{"1min":15.26,"5min":15.26,"15min":15.26},"last":0.65400000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":0.69999999999999996,"15min":0.59399999999999997},"min":{"1min":0.38200000000000001,"5min":0.35799999999999998,"15min":0.32400000000000001},"max":{"1min":15.186,"5min":15.186,"15min":15.186},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.57599999999999996,"15min":0.55900000000000005},"min":{"1min":0.44600000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.64200000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.60099999999999998,"15min":0.58499999999999996},"min":{"1min":0.48899999999999999,"5min":0.38200000000000001,"15min":0.32600000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.60199999999999998,"15min":0.57899999999999996},"min":{"1min":0.47099999999999997,"5min":0.40699999999999997,"15min":0.34200000000000003},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.67400000000000004}]},{"osd":7,"last update":"Fri Oct 6 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":0.68200000000000005,"15min":0.59799999999999998},"min":{"1min":0.46600000000000003,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":10.977,"5min":10.977,"15min":10.977},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.58599999999999997,"15min":0.57399999999999995},"min":{"1min":0.52100000000000002,"5min":0.38800000000000001,"15min":0.38200000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.66500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574994,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311444,"kb_used_data":1868,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060396,"statfs":{"total":96636764160,"available":96317845504,"internally_reserved":0,"allocated":1912832,"data_stored":875505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.34399999999999997,"15min":0.32500000000000001},"min":{"1min":0.248,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.46899999999999997,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.41199999999999998,"15min":0.39100000000000001},"min":{"1min":0.313,"5min":0.23000000000000001,"15min":0.22700000000000001},"max":{"1min":0.55100000000000005,"5min":4.4820000000000002,"15min":4.4820000000000002},"last":0.32800000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.32100000000000001,"15min":0.313},"min":{"1min":0.248,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.439,"5min":0.54000000000000004,"15min":0.65400000000000003},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.35599999999999998,"15min":0.35699999999999998},"min":{"1min":0.27700000000000002,"5min":0.23400000000000001,"15min":0.188},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":1.196},"last":0.30499999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.40200000000000002,"15min":0.38400000000000001},"min":{"1min":0.27700000000000002,"5min":0.23400000000000001,"15min":0.19600000000000001},"max":{"1min":0.45300000000000001,"5min":4.601,"15min":4.601},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.437,"15min":0.41799999999999998},"min":{"1min":0.32500000000000001,"5min":0.29899999999999999,"15min":0.26100000000000001},"max":{"1min":0.63200000000000001,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.35999999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.54500000000000004,"15min":0.54700000000000004},"min":{"1min":0.378,"5min":0.32100000000000001,"15min":0.311},"max":{"1min":0.75900000000000001,"5min":0.88500000000000001,"15min":1.694},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54500000000000004,"15min":0.53900000000000003},"min":{"1min":0.46300000000000002,"5min":0.32600000000000001,"15min":0.30199999999999999},"max":{"1min":0.68700000000000006,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.47399999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.434,"5min":0.34100000000000003,"15min":0.29399999999999998},"max":{"1min":0.63800000000000001,"5min":0.86399999999999999,"15min":0.878},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.36599999999999999,"5min":0.35699999999999998,"15min":0.29699999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":1.165},"last":0.46500000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.44400000000000001,"5min":0.372,"15min":0.36699999999999999},"max":{"1min":0.78700000000000003,"5min":0.79200000000000004,"15min":1.1359999999999999},"last":0.502},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57699999999999996,"15min":0.58499999999999996},"min":{"1min":0.443,"5min":0.36799999999999999,"15min":0.34399999999999997},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":1.7470000000000001},"last":0.48399999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56499999999999995,"15min":0.57399999999999995},"min":{"1min":0.39600000000000002,"5min":0.35699999999999998,"15min":0.35599999999999998},"max":{"1min":0.80300000000000005,"5min":0.89900000000000002,"15min":1.657},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57899999999999996,"15min":0.57299999999999995},"min":{"1min":0.48399999999999999,"5min":0.38,"15min":0.35499999999999998},"max":{"1min":0.71599999999999997,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.49299999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574992,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303188,"kb_used_data":1804,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068652,"statfs":{"total":96636764160,"available":96326299648,"internally_reserved":0,"allocated":1847296,"data_stored":848223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.47999999999999998,"15min":0.51600000000000001},"min":{"1min":0.30099999999999999,"5min":0.20799999999999999,"15min":0.19500000000000001},"max":{"1min":0.76800000000000002,"5min":0.82099999999999995,"15min":2.6619999999999999},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.504,"15min":0.49199999999999999},"min":{"1min":0.28999999999999998,"5min":0.224,"15min":0.215},"max":{"1min":0.81499999999999995,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.38300000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.498,"15min":0.53600000000000003},"min":{"1min":0.27600000000000002,"5min":0.26200000000000001,"15min":0.23300000000000001},"max":{"1min":0.72899999999999998,"5min":1,"15min":2.8650000000000002},"last":0.308},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.497,"15min":0.54200000000000004},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.25800000000000001},"max":{"1min":0.70699999999999996,"5min":1.2869999999999999,"15min":2.7610000000000001},"last":0.47999999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.52300000000000002,"15min":0.53300000000000003},"min":{"1min":0.36899999999999999,"5min":0.28499999999999998,"15min":0.23100000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":1.6910000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57199999999999995,"15min":0.57999999999999996},"min":{"1min":0.40999999999999998,"5min":0.31,"15min":0.30599999999999999},"max":{"1min":0.82799999999999996,"5min":0.93899999999999995,"15min":1.718},"last":0.501}]},{"osd":3,"last update":"Fri Oct 6 11:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58099999999999996,"15min":0.58599999999999997},"min":{"1min":0.38600000000000001,"5min":0.32000000000000001,"15min":0.26700000000000002},"max":{"1min":0.78800000000000003,"5min":2.387,"15min":2.677},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.55000000000000004,"15min":0.52700000000000002},"min":{"1min":0.42499999999999999,"5min":0.29299999999999998,"15min":0.27500000000000002},"max":{"1min":0.77700000000000002,"5min":1.784,"15min":1.784},"last":0.437}]},{"osd":5,"last update":"Fri Oct 6 11:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.378,"5min":0.28499999999999998,"15min":0.23200000000000001},"max":{"1min":0.68300000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.51500000000000001,"15min":0.52500000000000002},"min":{"1min":0.39400000000000002,"5min":0.28899999999999998,"15min":0.28399999999999997},"max":{"1min":0.749,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.59299999999999997}]},{"osd":6,"last update":"Fri Oct 6 11:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.35799999999999998,"5min":0.31,"15min":0.252},"max":{"1min":0.72999999999999998,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55200000000000005,"15min":0.55900000000000005},"min":{"1min":0.41199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80200000000000005,"5min":0.85799999999999998,"15min":1.165},"last":0.53800000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.56599999999999995,"15min":0.55800000000000005},"min":{"1min":0.40799999999999997,"5min":0.34200000000000003,"15min":0.313},"max":{"1min":0.84999999999999998,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.58899999999999997,"15min":0.59099999999999997},"min":{"1min":0.41999999999999998,"5min":0.318,"15min":0.317},"max":{"1min":0.86399999999999999,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.58399999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574995,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311436,"kb_used_data":1860,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060404,"statfs":{"total":96636764160,"available":96317853696,"internally_reserved":0,"allocated":1904640,"data_stored":874870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.48499999999999999,"15min":0.57499999999999996},"min":{"1min":0.26000000000000001,"5min":0.23300000000000001,"15min":0.20499999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":5.0490000000000004},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.48599999999999999,"15min":0.55500000000000005},"min":{"1min":0.34599999999999997,"5min":0.253,"15min":0.22900000000000001},"max":{"1min":0.71299999999999997,"5min":0.78100000000000003,"15min":5.1449999999999996},"last":0.45000000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.48899999999999999,"15min":0.48299999999999998},"min":{"1min":0.27800000000000002,"5min":0.25700000000000001,"15min":0.25},"max":{"1min":0.68400000000000005,"5min":0.81399999999999995,"15min":0.97199999999999998},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.505,"15min":0.51000000000000001},"min":{"1min":0.29799999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.69299999999999995,"5min":0.74099999999999999,"15min":1.8799999999999999},"last":0.57699999999999996}]},{"osd":2,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.52800000000000002,"15min":0.54600000000000004},"min":{"1min":0.36799999999999999,"5min":0.30099999999999999,"15min":0.28299999999999997},"max":{"1min":0.748,"5min":0.79800000000000004,"15min":4.234},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56200000000000006,"15min":0.56000000000000005},"min":{"1min":0.436,"5min":0.315,"15min":0.315},"max":{"1min":0.79200000000000004,"5min":0.81000000000000005,"15min":1.0369999999999999},"last":0.54400000000000004}]},{"osd":3,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51000000000000001,"15min":0.59299999999999997},"min":{"1min":0.311,"5min":0.29499999999999998,"15min":0.27700000000000002},"max":{"1min":0.70499999999999996,"5min":0.82299999999999995,"15min":5.2169999999999996},"last":0.5},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53100000000000003,"15min":0.53800000000000003},"min":{"1min":0.38700000000000001,"5min":0.29999999999999999,"15min":0.29699999999999999},"max":{"1min":0.73699999999999999,"5min":0.75600000000000001,"15min":1.008},"last":0.47799999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48399999999999999,"15min":0.504},"min":{"1min":0.33700000000000002,"5min":0.25600000000000001,"15min":0.23999999999999999},"max":{"1min":0.65900000000000003,"5min":0.83399999999999996,"15min":1.917},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.48999999999999999,"15min":0.51400000000000001},"min":{"1min":0.29999999999999999,"5min":0.251,"15min":0.23899999999999999},"max":{"1min":0.65500000000000003,"5min":0.69199999999999995,"15min":0.87},"last":0.56599999999999995}]},{"osd":6,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51100000000000001,"15min":0.54300000000000004},"min":{"1min":0.34799999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.67200000000000004,"5min":0.76800000000000002,"15min":2.0139999999999998},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57399999999999995,"15min":0.59399999999999997},"min":{"1min":0.33200000000000002,"5min":0.30299999999999999,"15min":0.29999999999999999},"max":{"1min":0.72599999999999998,"5min":0.82899999999999996,"15min":1.9470000000000001},"last":0.65100000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53600000000000003,"15min":0.56299999999999994},"min":{"1min":0.376,"5min":0.28799999999999998,"15min":0.27700000000000002},"max":{"1min":0.64600000000000002,"5min":0.81000000000000005,"15min":0.96499999999999997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56899999999999995,"15min":0.59299999999999997},"min":{"1min":0.42599999999999999,"5min":0.29199999999999998,"15min":0.28799999999999998},"max":{"1min":0.746,"5min":0.77300000000000002,"15min":1.4119999999999999},"last":0.63900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:17:28.628 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:17:28.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.771+0000 7fb8c6277700 1 Processor -- start 2023-10-06T11:17:28.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.771+0000 7fb8c6277700 1 -- start start 2023-10-06T11:17:28.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.772+0000 7fb8c6277700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb8c0068ba0 0x7fb8c015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:28.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.772+0000 7fb8c6277700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb8c0153e80 0x7fb8c00b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:28.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.772+0000 7fb8c6277700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8c015ac30 con 0x7fb8c0153ab0 2023-10-06T11:17:28.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.772+0000 7fb8c6277700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8c00b4510 con 0x7fb8c0068ba0 2023-10-06T11:17:28.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.772+0000 7fb8c6277700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8c00b6530 con 0x7fb8c0153e80 2023-10-06T11:17:28.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.772+0000 7fb8bffff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb8c0153ab0 0x7fb8c0068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39712/0 (socket says 172.21.15.146:39712) 2023-10-06T11:17:28.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.772+0000 7fb8bffff700 1 -- 172.21.15.146:0/1729819372 learned_addr learned my addr 172.21.15.146:0/1729819372 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:17:28.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.772+0000 7fb8bf7fe700 1 --2- 172.21.15.146:0/1729819372 >> v2:172.21.15.146:3300/0 conn(0x7fb8c0068ba0 0x7fb8c015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:28.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.773+0000 7fb8beffd700 1 -- 172.21.15.146:0/1729819372 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1102142450 0 0) 0x7fb8b0001110 con 0x7fb8c0153ab0 2023-10-06T11:17:28.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.773+0000 7fb8beffd700 1 -- 172.21.15.146:0/1729819372 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8a8003570 con 0x7fb8c0153ab0 2023-10-06T11:17:28.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.773+0000 7fb8c4814700 1 --2- 172.21.15.146:0/1729819372 >> v2:172.21.15.151:3300/0 conn(0x7fb8c0153e80 0x7fb8c00b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:28.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.773+0000 7fb8bf7fe700 1 -- 172.21.15.146:0/1729819372 >> v2:172.21.15.151:3300/0 conn(0x7fb8c0153e80 msgr2=0x7fb8c00b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:28.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.773+0000 7fb8bf7fe700 1 --2- 172.21.15.146:0/1729819372 >> v2:172.21.15.151:3300/0 conn(0x7fb8c0153e80 0x7fb8c00b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:28.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.773+0000 7fb8bf7fe700 1 -- 172.21.15.146:0/1729819372 >> v1:172.21.15.146:6789/0 conn(0x7fb8c0153ab0 legacy=0x7fb8c0068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:28.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.773+0000 7fb8bf7fe700 1 -- 172.21.15.146:0/1729819372 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c00b5c50 con 0x7fb8c0068ba0 2023-10-06T11:17:28.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.773+0000 7fb8bf7fe700 1 --2- 172.21.15.146:0/1729819372 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8c0068ba0 0x7fb8c015a6f0 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7fb8c00d12a0 tx=0x7fb8b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=250093aafdbbd9af server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:28.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.773+0000 7fb8beffd700 1 -- 172.21.15.146:0/1729819372 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b4011630 con 0x7fb8c0068ba0 2023-10-06T11:17:28.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.773+0000 7fb8beffd700 1 -- 172.21.15.146:0/1729819372 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b4011790 con 0x7fb8c0068ba0 2023-10-06T11:17:28.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.773+0000 7fb8beffd700 1 -- 172.21.15.146:0/1729819372 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b4011b30 con 0x7fb8c0068ba0 2023-10-06T11:17:28.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.773+0000 7fb8c6277700 1 -- 172.21.15.146:0/1729819372 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8c0068ba0 msgr2=0x7fb8c015a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:28.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.773+0000 7fb8c6277700 1 --2- 172.21.15.146:0/1729819372 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8c0068ba0 0x7fb8c015a6f0 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7fb8c00d12a0 tx=0x7fb8b40091a0 comp rx=0 tx=0).stop 2023-10-06T11:17:28.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.773+0000 7fb8c6277700 1 -- 172.21.15.146:0/1729819372 shutdown_connections 2023-10-06T11:17:28.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.773+0000 7fb8c6277700 1 --2- 172.21.15.146:0/1729819372 >> v2:172.21.15.151:3300/0 conn(0x7fb8c0153e80 0x7fb8c00b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:28.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.773+0000 7fb8c6277700 1 --2- 172.21.15.146:0/1729819372 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8c0068ba0 0x7fb8c015a6f0 unknown :-1 s=CLOSED pgs=1951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:28.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.773+0000 7fb8c6277700 1 -- 172.21.15.146:0/1729819372 >> 172.21.15.146:0/1729819372 conn(0x7fb8c006eba0 msgr2=0x7fb8c006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:28.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.773+0000 7fb8c6277700 1 -- 172.21.15.146:0/1729819372 shutdown_connections 2023-10-06T11:17:28.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.774+0000 7fb8c6277700 1 -- 172.21.15.146:0/1729819372 wait complete. 2023-10-06T11:17:28.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.775+0000 7fb8c6277700 1 Processor -- start 2023-10-06T11:17:28.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.775+0000 7fb8c6277700 1 -- start start 2023-10-06T11:17:28.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.775+0000 7fb8c6277700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8c0068ba0 0x7fb8c0158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:28.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.775+0000 7fb8c6277700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8c0153ab0 0x7fb8c0140f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:28.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.775+0000 7fb8c6277700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb8c0153e80 0x7fb8c01571e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:28.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.775+0000 7fb8c6277700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c01591a0 con 0x7fb8c0068ba0 2023-10-06T11:17:28.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.775+0000 7fb8c6277700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c01587d0 con 0x7fb8c0153e80 2023-10-06T11:17:28.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.775+0000 7fb8c6277700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c0157bc0 con 0x7fb8c0153ab0 2023-10-06T11:17:28.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.776+0000 7fb8bffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8c0068ba0 0x7fb8c0158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:28.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.776+0000 7fb8bffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8c0068ba0 0x7fb8c0158c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49734/0 (socket says 172.21.15.146:49734) 2023-10-06T11:17:28.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.776+0000 7fb8bffff700 1 -- 172.21.15.146:0/1256686411 learned_addr learned my addr 172.21.15.146:0/1256686411 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:28.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.776+0000 7fb8bffff700 1 -- 172.21.15.146:0/1256686411 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8c0153ab0 msgr2=0x7fb8c0140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:28.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.776+0000 7fb8bf7fe700 1 --2- 172.21.15.146:0/1256686411 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8c0153ab0 0x7fb8c0140f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:28.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.776+0000 7fb8bffff700 1 --2- 172.21.15.146:0/1256686411 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8c0153ab0 0x7fb8c0140f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:28.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.776+0000 7fb8bffff700 1 -- 172.21.15.146:0/1256686411 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb8c0153e80 msgr2=0x7fb8c01571e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:28.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.776+0000 7fb8c4814700 1 --2- 172.21.15.146:0/1256686411 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb8c0153e80 0x7fb8c01571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:28.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.776+0000 7fb8bffff700 1 --2- 172.21.15.146:0/1256686411 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb8c0153e80 0x7fb8c01571e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:28.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.776+0000 7fb8bffff700 1 -- 172.21.15.146:0/1256686411 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b4009420 con 0x7fb8c0068ba0 2023-10-06T11:17:28.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.776+0000 7fb8bffff700 1 --2- 172.21.15.146:0/1256686411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8c0068ba0 0x7fb8c0158c60 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7fb8b000c7c0 tx=0x7fb8b0007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:28.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.776+0000 7fb8a7fff700 1 -- 172.21.15.146:0/1256686411 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b0005b30 con 0x7fb8c0068ba0 2023-10-06T11:17:28.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.776+0000 7fb8a7fff700 1 -- 172.21.15.146:0/1256686411 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b0005c90 con 0x7fb8c0068ba0 2023-10-06T11:17:28.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.776+0000 7fb8c6277700 1 -- 172.21.15.146:0/1256686411 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c0157ea0 con 0x7fb8c0068ba0 2023-10-06T11:17:28.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.776+0000 7fb8a7fff700 1 -- 172.21.15.146:0/1256686411 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b0007340 con 0x7fb8c0068ba0 2023-10-06T11:17:28.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.776+0000 7fb8c6277700 1 -- 172.21.15.146:0/1256686411 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8c0158460 con 0x7fb8c0068ba0 2023-10-06T11:17:28.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.777+0000 7fb8c6277700 1 -- 172.21.15.146:0/1256686411 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8c0158ab0 con 0x7fb8c0068ba0 2023-10-06T11:17:28.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.777+0000 7fb8a7fff700 1 -- 172.21.15.146:0/1256686411 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb8b001b400 con 0x7fb8c0068ba0 2023-10-06T11:17:28.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.778+0000 7fb8a7fff700 1 --2- 172.21.15.146:0/1256686411 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb8ac066f30 0x7fb8ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:28.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.778+0000 7fb8a7fff700 1 -- 172.21.15.146:0/1256686411 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb8b0084050 con 0x7fb8c0068ba0 2023-10-06T11:17:28.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.778+0000 7fb8bf7fe700 1 --2- 172.21.15.146:0/1256686411 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb8ac066f30 0x7fb8ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:28.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.778+0000 7fb8bf7fe700 1 --2- 172.21.15.146:0/1256686411 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb8ac066f30 0x7fb8ac0693e0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0068fa0 tx=0x7fb8b4017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:28.783 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.782+0000 7fb8a7fff700 1 -- 172.21.15.146:0/1256686411 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb8b0051160 con 0x7fb8c0068ba0 2023-10-06T11:17:28.855 INFO:tasks.ceph.mds.c.smithi146.stderr:2023-10-06T11:17:28.853+0000 7f96e7aeb700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T11:17:28.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.963+0000 7fb8c6277700 1 -- 172.21.15.146:0/1256686411 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb8c0158910 con 0x7fb8ac066f30 2023-10-06T11:17:28.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.971+0000 7fb8a7fff700 1 -- 172.21.15.146:0/1256686411 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+306887 (secure 0 0 0) 0x7fb8b4000cb0 con 0x7fb8ac066f30 2023-10-06T11:17:28.980 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:28.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.974+0000 7fb8c6277700 1 -- 172.21.15.146:0/1256686411 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb8ac066f30 msgr2=0x7fb8ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:28.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.974+0000 7fb8c6277700 1 --2- 172.21.15.146:0/1256686411 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb8ac066f30 0x7fb8ac0693e0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fb8c0068fa0 tx=0x7fb8b4017000 comp rx=0 tx=0).stop 2023-10-06T11:17:28.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.974+0000 7fb8c6277700 1 -- 172.21.15.146:0/1256686411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8c0068ba0 msgr2=0x7fb8c0158c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:28.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.974+0000 7fb8c6277700 1 --2- 172.21.15.146:0/1256686411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8c0068ba0 0x7fb8c0158c60 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7fb8b000c7c0 tx=0x7fb8b0007c70 comp rx=0 tx=0).stop 2023-10-06T11:17:28.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.974+0000 7fb8c6277700 1 -- 172.21.15.146:0/1256686411 shutdown_connections 2023-10-06T11:17:28.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.974+0000 7fb8c6277700 1 --2- 172.21.15.146:0/1256686411 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb8ac066f30 0x7fb8ac0693e0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:28.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.974+0000 7fb8c6277700 1 --2- 172.21.15.146:0/1256686411 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb8c0153e80 0x7fb8c01571e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:28.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.974+0000 7fb8c6277700 1 --2- 172.21.15.146:0/1256686411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb8c0068ba0 0x7fb8c0158c60 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:28.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.974+0000 7fb8c6277700 1 --2- 172.21.15.146:0/1256686411 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8c0153ab0 0x7fb8c0140f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:28.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.974+0000 7fb8c6277700 1 -- 172.21.15.146:0/1256686411 >> 172.21.15.146:0/1256686411 conn(0x7fb8c006eba0 msgr2=0x7fb8c0063790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:28.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.974+0000 7fb8c6277700 1 -- 172.21.15.146:0/1256686411 shutdown_connections 2023-10-06T11:17:28.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:28.974+0000 7fb8c6277700 1 -- 172.21.15.146:0/1256686411 wait complete. 2023-10-06T11:17:28.984 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:17:28.988 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":499,"stamp":"2023-10-06T11:17:27.292223+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592030,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":180,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":150,"acting":150,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":93,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2443296,"kb_used_data":15840,"kb_used_omap":0,"kb_used_meta":2427392,"kb_avail":752531424,"statfs":{"total":773094113280,"available":770592178176,"internally_reserved":0,"allocated":16220160,"data_stored":8089422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2485649408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1662,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.745508"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:23.546397+0000","last_change":"2023-10-06T11:17:23.546397+0000","last_active":"2023-10-06T11:17:23.546397+0000","last_peered":"2023-10-06T11:17:23.546397+0000","last_clean":"2023-10-06T11:17:23.546397+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:23.546397+0000","last_undegraded":"2023-10-06T11:17:23.546397+0000","last_fullsized":"2023-10-06T11:17:23.546397+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575584+0000","last_change":"2023-10-06T11:17:24.574790+0000","last_active":"2023-10-06T11:17:24.575584+0000","last_peered":"2023-10-06T11:17:24.575584+0000","last_clean":"2023-10-06T11:17:24.575584+0000","last_became_active":"2023-10-06T11:17:24.574475+0000","last_became_peered":"2023-10-06T11:17:24.574475+0000","last_unstale":"2023-10-06T11:17:24.575584+0000","last_undegraded":"2023-10-06T11:17:24.575584+0000","last_fullsized":"2023-10-06T11:17:24.575584+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:20.201597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:23.546397+0000","last_change":"2023-10-06T11:17:23.546397+0000","last_active":"2023-10-06T11:17:23.546397+0000","last_peered":"2023-10-06T11:17:23.546397+0000","last_clean":"2023-10-06T11:17:23.546397+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:23.546397+0000","last_undegraded":"2023-10-06T11:17:23.546397+0000","last_fullsized":"2023-10-06T11:17:23.546397+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:23.546397+0000","last_change":"2023-10-06T11:17:23.546397+0000","last_active":"2023-10-06T11:17:23.546397+0000","last_peered":"2023-10-06T11:17:23.546397+0000","last_clean":"2023-10-06T11:17:23.546397+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:23.546397+0000","last_undegraded":"2023-10-06T11:17:23.546397+0000","last_fullsized":"2023-10-06T11:17:23.546397+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.576344+0000","last_change":"2023-10-06T11:17:24.570249+0000","last_active":"2023-10-06T11:17:24.576344+0000","last_peered":"2023-10-06T11:17:24.576344+0000","last_clean":"2023-10-06T11:17:24.576344+0000","last_became_active":"2023-10-06T11:17:24.570080+0000","last_became_peered":"2023-10-06T11:17:24.570080+0000","last_unstale":"2023-10-06T11:17:24.576344+0000","last_undegraded":"2023-10-06T11:17:24.576344+0000","last_fullsized":"2023-10-06T11:17:24.576344+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:32:08.893601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.569849+0000","last_change":"2023-10-06T11:17:24.568112+0000","last_active":"2023-10-06T11:17:24.569849+0000","last_peered":"2023-10-06T11:17:24.569849+0000","last_clean":"2023-10-06T11:17:24.569849+0000","last_became_active":"2023-10-06T11:17:24.567855+0000","last_became_peered":"2023-10-06T11:17:24.567855+0000","last_unstale":"2023-10-06T11:17:24.569849+0000","last_undegraded":"2023-10-06T11:17:24.569849+0000","last_fullsized":"2023-10-06T11:17:24.569849+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:11:12.692922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:23.546397+0000","last_change":"2023-10-06T11:17:23.546397+0000","last_active":"2023-10-06T11:17:23.546397+0000","last_peered":"2023-10-06T11:17:23.546397+0000","last_clean":"2023-10-06T11:17:23.546397+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:23.546397+0000","last_undegraded":"2023-10-06T11:17:23.546397+0000","last_fullsized":"2023-10-06T11:17:23.546397+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:23.546397+0000","last_change":"2023-10-06T11:17:23.546397+0000","last_active":"2023-10-06T11:17:23.546397+0000","last_peered":"2023-10-06T11:17:23.546397+0000","last_clean":"2023-10-06T11:17:23.546397+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:23.546397+0000","last_undegraded":"2023-10-06T11:17:23.546397+0000","last_fullsized":"2023-10-06T11:17:23.546397+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:23.546397+0000","last_change":"2023-10-06T11:17:23.546397+0000","last_active":"2023-10-06T11:17:23.546397+0000","last_peered":"2023-10-06T11:17:23.546397+0000","last_clean":"2023-10-06T11:17:23.546397+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:23.546397+0000","last_undegraded":"2023-10-06T11:17:23.546397+0000","last_fullsized":"2023-10-06T11:17:23.546397+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:23.546397+0000","last_change":"2023-10-06T11:17:23.546397+0000","last_active":"2023-10-06T11:17:23.546397+0000","last_peered":"2023-10-06T11:17:23.546397+0000","last_clean":"2023-10-06T11:17:23.546397+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:23.546397+0000","last_undegraded":"2023-10-06T11:17:23.546397+0000","last_fullsized":"2023-10-06T11:17:23.546397+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.570755+0000","last_change":"2023-10-06T11:17:24.568848+0000","last_active":"2023-10-06T11:17:24.570755+0000","last_peered":"2023-10-06T11:17:24.570755+0000","last_clean":"2023-10-06T11:17:24.570755+0000","last_became_active":"2023-10-06T11:17:24.567763+0000","last_became_peered":"2023-10-06T11:17:24.567763+0000","last_unstale":"2023-10-06T11:17:24.570755+0000","last_undegraded":"2023-10-06T11:17:24.570755+0000","last_fullsized":"2023-10-06T11:17:24.570755+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:56.951675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575114+0000","last_change":"2023-10-06T11:17:24.573144+0000","last_active":"2023-10-06T11:17:24.575114+0000","last_peered":"2023-10-06T11:17:24.575114+0000","last_clean":"2023-10-06T11:17:24.575114+0000","last_became_active":"2023-10-06T11:17:24.572892+0000","last_became_peered":"2023-10-06T11:17:24.572892+0000","last_unstale":"2023-10-06T11:17:24.575114+0000","last_undegraded":"2023-10-06T11:17:24.575114+0000","last_fullsized":"2023-10-06T11:17:24.575114+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:15:52.609098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.580555+0000","last_change":"2023-10-06T11:17:24.571121+0000","last_active":"2023-10-06T11:17:24.580555+0000","last_peered":"2023-10-06T11:17:24.580555+0000","last_clean":"2023-10-06T11:17:24.580555+0000","last_became_active":"2023-10-06T11:17:24.570858+0000","last_became_peered":"2023-10-06T11:17:24.570858+0000","last_unstale":"2023-10-06T11:17:24.580555+0000","last_undegraded":"2023-10-06T11:17:24.580555+0000","last_fullsized":"2023-10-06T11:17:24.580555+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:32:17.113391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.573663+0000","last_change":"2023-10-06T11:17:24.568783+0000","last_active":"2023-10-06T11:17:24.573663+0000","last_peered":"2023-10-06T11:17:24.573663+0000","last_clean":"2023-10-06T11:17:24.573663+0000","last_became_active":"2023-10-06T11:17:24.565857+0000","last_became_peered":"2023-10-06T11:17:24.565857+0000","last_unstale":"2023-10-06T11:17:24.573663+0000","last_undegraded":"2023-10-06T11:17:24.573663+0000","last_fullsized":"2023-10-06T11:17:24.573663+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:11:22.690663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.574923+0000","last_change":"2023-10-06T11:17:24.571861+0000","last_active":"2023-10-06T11:17:24.574923+0000","last_peered":"2023-10-06T11:17:24.574923+0000","last_clean":"2023-10-06T11:17:24.574923+0000","last_became_active":"2023-10-06T11:17:24.571607+0000","last_became_peered":"2023-10-06T11:17:24.571607+0000","last_unstale":"2023-10-06T11:17:24.574923+0000","last_undegraded":"2023-10-06T11:17:24.574923+0000","last_fullsized":"2023-10-06T11:17:24.574923+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:55:29.624889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:23.546397+0000","last_change":"2023-10-06T11:17:23.546397+0000","last_active":"2023-10-06T11:17:23.546397+0000","last_peered":"2023-10-06T11:17:23.546397+0000","last_clean":"2023-10-06T11:17:23.546397+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:23.546397+0000","last_undegraded":"2023-10-06T11:17:23.546397+0000","last_fullsized":"2023-10-06T11:17:23.546397+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:23.546397+0000","last_change":"2023-10-06T11:17:23.546397+0000","last_active":"2023-10-06T11:17:23.546397+0000","last_peered":"2023-10-06T11:17:23.546397+0000","last_clean":"2023-10-06T11:17:23.546397+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:23.546397+0000","last_undegraded":"2023-10-06T11:17:23.546397+0000","last_fullsized":"2023-10-06T11:17:23.546397+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:23.546397+0000","last_change":"2023-10-06T11:17:23.546397+0000","last_active":"2023-10-06T11:17:23.546397+0000","last_peered":"2023-10-06T11:17:23.546397+0000","last_clean":"2023-10-06T11:17:23.546397+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:23.546397+0000","last_undegraded":"2023-10-06T11:17:23.546397+0000","last_fullsized":"2023-10-06T11:17:23.546397+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.574906+0000","last_change":"2023-10-06T11:17:24.571935+0000","last_active":"2023-10-06T11:17:24.574906+0000","last_peered":"2023-10-06T11:17:24.574906+0000","last_clean":"2023-10-06T11:17:24.574906+0000","last_became_active":"2023-10-06T11:17:24.571681+0000","last_became_peered":"2023-10-06T11:17:24.571681+0000","last_unstale":"2023-10-06T11:17:24.574906+0000","last_undegraded":"2023-10-06T11:17:24.574906+0000","last_fullsized":"2023-10-06T11:17:24.574906+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:56:17.624615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575898+0000","last_change":"2023-10-06T11:17:24.568125+0000","last_active":"2023-10-06T11:17:24.575898+0000","last_peered":"2023-10-06T11:17:24.575898+0000","last_clean":"2023-10-06T11:17:24.575898+0000","last_became_active":"2023-10-06T11:17:24.567809+0000","last_became_peered":"2023-10-06T11:17:24.567809+0000","last_unstale":"2023-10-06T11:17:24.575898+0000","last_undegraded":"2023-10-06T11:17:24.575898+0000","last_fullsized":"2023-10-06T11:17:24.575898+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:32:27.294341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.565724+0000","last_change":"2023-10-06T11:17:24.561075+0000","last_active":"2023-10-06T11:17:24.565724+0000","last_peered":"2023-10-06T11:17:24.565724+0000","last_clean":"2023-10-06T11:17:24.565724+0000","last_became_active":"2023-10-06T11:17:24.560699+0000","last_became_peered":"2023-10-06T11:17:24.560699+0000","last_unstale":"2023-10-06T11:17:24.565724+0000","last_undegraded":"2023-10-06T11:17:24.565724+0000","last_fullsized":"2023-10-06T11:17:24.565724+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:06:27.406680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.574973+0000","last_change":"2023-10-06T11:17:24.572835+0000","last_active":"2023-10-06T11:17:24.574973+0000","last_peered":"2023-10-06T11:17:24.574973+0000","last_clean":"2023-10-06T11:17:24.574973+0000","last_became_active":"2023-10-06T11:17:24.570204+0000","last_became_peered":"2023-10-06T11:17:24.570204+0000","last_unstale":"2023-10-06T11:17:24.574973+0000","last_undegraded":"2023-10-06T11:17:24.574973+0000","last_fullsized":"2023-10-06T11:17:24.574973+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:18.748550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.570377+0000","last_change":"2023-10-06T11:17:24.567291+0000","last_active":"2023-10-06T11:17:24.570377+0000","last_peered":"2023-10-06T11:17:24.570377+0000","last_clean":"2023-10-06T11:17:24.570377+0000","last_became_active":"2023-10-06T11:17:24.566984+0000","last_became_peered":"2023-10-06T11:17:24.566984+0000","last_unstale":"2023-10-06T11:17:24.570377+0000","last_undegraded":"2023-10-06T11:17:24.570377+0000","last_fullsized":"2023-10-06T11:17:24.570377+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:42:04.095734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:23.546397+0000","last_change":"2023-10-06T11:17:23.546397+0000","last_active":"2023-10-06T11:17:23.546397+0000","last_peered":"2023-10-06T11:17:23.546397+0000","last_clean":"2023-10-06T11:17:23.546397+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:23.546397+0000","last_undegraded":"2023-10-06T11:17:23.546397+0000","last_fullsized":"2023-10-06T11:17:23.546397+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.565288+0000","last_change":"2023-10-06T11:17:24.561095+0000","last_active":"2023-10-06T11:17:24.565288+0000","last_peered":"2023-10-06T11:17:24.565288+0000","last_clean":"2023-10-06T11:17:24.565288+0000","last_became_active":"2023-10-06T11:17:24.560834+0000","last_became_peered":"2023-10-06T11:17:24.560834+0000","last_unstale":"2023-10-06T11:17:24.565288+0000","last_undegraded":"2023-10-06T11:17:24.565288+0000","last_fullsized":"2023-10-06T11:17:24.565288+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:33:05.816585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.570099+0000","last_change":"2023-10-06T11:17:24.566087+0000","last_active":"2023-10-06T11:17:24.570099+0000","last_peered":"2023-10-06T11:17:24.570099+0000","last_clean":"2023-10-06T11:17:24.570099+0000","last_became_active":"2023-10-06T11:17:24.565836+0000","last_became_peered":"2023-10-06T11:17:24.565836+0000","last_unstale":"2023-10-06T11:17:24.570099+0000","last_undegraded":"2023-10-06T11:17:24.570099+0000","last_fullsized":"2023-10-06T11:17:24.570099+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:32:22.601435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575177+0000","last_change":"2023-10-06T11:17:24.574344+0000","last_active":"2023-10-06T11:17:24.575177+0000","last_peered":"2023-10-06T11:17:24.575177+0000","last_clean":"2023-10-06T11:17:24.575177+0000","last_became_active":"2023-10-06T11:17:24.570258+0000","last_became_peered":"2023-10-06T11:17:24.570258+0000","last_unstale":"2023-10-06T11:17:24.575177+0000","last_undegraded":"2023-10-06T11:17:24.575177+0000","last_fullsized":"2023-10-06T11:17:24.575177+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:56.951675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.565509+0000","last_change":"2023-10-06T11:17:24.561410+0000","last_active":"2023-10-06T11:17:24.565509+0000","last_peered":"2023-10-06T11:17:24.565509+0000","last_clean":"2023-10-06T11:17:24.565509+0000","last_became_active":"2023-10-06T11:17:24.561150+0000","last_became_peered":"2023-10-06T11:17:24.561150+0000","last_unstale":"2023-10-06T11:17:24.565509+0000","last_undegraded":"2023-10-06T11:17:24.565509+0000","last_fullsized":"2023-10-06T11:17:24.565509+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:03:32.754632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.579321+0000","last_change":"2023-10-06T11:17:24.576372+0000","last_active":"2023-10-06T11:17:24.579321+0000","last_peered":"2023-10-06T11:17:24.579321+0000","last_clean":"2023-10-06T11:17:24.579321+0000","last_became_active":"2023-10-06T11:17:24.575959+0000","last_became_peered":"2023-10-06T11:17:24.575959+0000","last_unstale":"2023-10-06T11:17:24.579321+0000","last_undegraded":"2023-10-06T11:17:24.579321+0000","last_fullsized":"2023-10-06T11:17:24.579321+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:01:59.076681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:23.546397+0000","last_change":"2023-10-06T11:17:23.546397+0000","last_active":"2023-10-06T11:17:23.546397+0000","last_peered":"2023-10-06T11:17:23.546397+0000","last_clean":"2023-10-06T11:17:23.546397+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:23.546397+0000","last_undegraded":"2023-10-06T11:17:23.546397+0000","last_fullsized":"2023-10-06T11:17:23.546397+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.571340+0000","last_change":"2023-10-06T11:17:24.567865+0000","last_active":"2023-10-06T11:17:24.571340+0000","last_peered":"2023-10-06T11:17:24.571340+0000","last_clean":"2023-10-06T11:17:24.571340+0000","last_became_active":"2023-10-06T11:17:24.567577+0000","last_became_peered":"2023-10-06T11:17:24.567577+0000","last_unstale":"2023-10-06T11:17:24.571340+0000","last_undegraded":"2023-10-06T11:17:24.571340+0000","last_fullsized":"2023-10-06T11:17:24.571340+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:38.610243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:23.546397+0000","last_change":"2023-10-06T11:17:23.546397+0000","last_active":"2023-10-06T11:17:23.546397+0000","last_peered":"2023-10-06T11:17:23.546397+0000","last_clean":"2023-10-06T11:17:23.546397+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:23.546397+0000","last_undegraded":"2023-10-06T11:17:23.546397+0000","last_fullsized":"2023-10-06T11:17:23.546397+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.579569+0000","last_change":"2023-10-06T11:17:24.577831+0000","last_active":"2023-10-06T11:17:24.579569+0000","last_peered":"2023-10-06T11:17:24.579569+0000","last_clean":"2023-10-06T11:17:24.579569+0000","last_became_active":"2023-10-06T11:17:24.577572+0000","last_became_peered":"2023-10-06T11:17:24.577572+0000","last_unstale":"2023-10-06T11:17:24.579569+0000","last_undegraded":"2023-10-06T11:17:24.579569+0000","last_fullsized":"2023-10-06T11:17:24.579569+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:48.792063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:22.540743+0000","last_change":"2023-10-06T11:17:22.540743+0000","last_active":"2023-10-06T11:17:22.540743+0000","last_peered":"2023-10-06T11:17:22.540743+0000","last_clean":"2023-10-06T11:17:22.540743+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:22.540743+0000","last_undegraded":"2023-10-06T11:17:22.540743+0000","last_fullsized":"2023-10-06T11:17:22.540743+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.573070+0000","last_change":"2023-10-06T11:17:24.565982+0000","last_active":"2023-10-06T11:17:24.573070+0000","last_peered":"2023-10-06T11:17:24.573070+0000","last_clean":"2023-10-06T11:17:24.573070+0000","last_became_active":"2023-10-06T11:17:24.565734+0000","last_became_peered":"2023-10-06T11:17:24.565734+0000","last_unstale":"2023-10-06T11:17:24.573070+0000","last_undegraded":"2023-10-06T11:17:24.573070+0000","last_fullsized":"2023-10-06T11:17:24.573070+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:33.751143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.582526+0000","last_change":"2023-10-06T11:17:23.569143+0000","last_active":"2023-10-06T11:17:24.582526+0000","last_peered":"2023-10-06T11:17:24.582526+0000","last_clean":"2023-10-06T11:17:24.582526+0000","last_became_active":"2023-10-06T11:17:23.568883+0000","last_became_peered":"2023-10-06T11:17:23.568883+0000","last_unstale":"2023-10-06T11:17:24.582526+0000","last_undegraded":"2023-10-06T11:17:24.582526+0000","last_fullsized":"2023-10-06T11:17:24.582526+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:33:04.810931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.569717+0000","last_change":"2023-10-06T11:17:24.565660+0000","last_active":"2023-10-06T11:17:24.569717+0000","last_peered":"2023-10-06T11:17:24.569717+0000","last_clean":"2023-10-06T11:17:24.569717+0000","last_became_active":"2023-10-06T11:17:24.564786+0000","last_became_peered":"2023-10-06T11:17:24.564786+0000","last_unstale":"2023-10-06T11:17:24.569717+0000","last_undegraded":"2023-10-06T11:17:24.569717+0000","last_fullsized":"2023-10-06T11:17:24.569717+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:51:39.405314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.581331+0000","last_change":"2023-10-06T11:17:23.567167+0000","last_active":"2023-10-06T11:17:24.581331+0000","last_peered":"2023-10-06T11:17:24.581331+0000","last_clean":"2023-10-06T11:17:24.581331+0000","last_became_active":"2023-10-06T11:17:23.566837+0000","last_became_peered":"2023-10-06T11:17:23.566837+0000","last_unstale":"2023-10-06T11:17:24.581331+0000","last_undegraded":"2023-10-06T11:17:24.581331+0000","last_fullsized":"2023-10-06T11:17:24.581331+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:02:19.001747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.579437+0000","last_change":"2023-10-06T11:17:24.576887+0000","last_active":"2023-10-06T11:17:24.579437+0000","last_peered":"2023-10-06T11:17:24.579437+0000","last_clean":"2023-10-06T11:17:24.579437+0000","last_became_active":"2023-10-06T11:17:24.576611+0000","last_became_peered":"2023-10-06T11:17:24.576611+0000","last_unstale":"2023-10-06T11:17:24.579437+0000","last_undegraded":"2023-10-06T11:17:24.579437+0000","last_fullsized":"2023-10-06T11:17:24.579437+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:08:07.693719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.580673+0000","last_change":"2023-10-06T11:17:23.569167+0000","last_active":"2023-10-06T11:17:24.580673+0000","last_peered":"2023-10-06T11:17:24.580673+0000","last_clean":"2023-10-06T11:17:24.580673+0000","last_became_active":"2023-10-06T11:17:23.568918+0000","last_became_peered":"2023-10-06T11:17:23.568918+0000","last_unstale":"2023-10-06T11:17:24.580673+0000","last_undegraded":"2023-10-06T11:17:24.580673+0000","last_fullsized":"2023-10-06T11:17:24.580673+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:36:10.273812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:23.546397+0000","last_change":"2023-10-06T11:17:23.546397+0000","last_active":"2023-10-06T11:17:23.546397+0000","last_peered":"2023-10-06T11:17:23.546397+0000","last_clean":"2023-10-06T11:17:23.546397+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:23.546397+0000","last_undegraded":"2023-10-06T11:17:23.546397+0000","last_fullsized":"2023-10-06T11:17:23.546397+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:22.540743+0000","last_change":"2023-10-06T11:17:22.540743+0000","last_active":"2023-10-06T11:17:22.540743+0000","last_peered":"2023-10-06T11:17:22.540743+0000","last_clean":"2023-10-06T11:17:22.540743+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:22.540743+0000","last_undegraded":"2023-10-06T11:17:22.540743+0000","last_fullsized":"2023-10-06T11:17:22.540743+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.570073+0000","last_change":"2023-10-06T11:17:24.565604+0000","last_active":"2023-10-06T11:17:24.570073+0000","last_peered":"2023-10-06T11:17:24.570073+0000","last_clean":"2023-10-06T11:17:24.570073+0000","last_became_active":"2023-10-06T11:17:24.565350+0000","last_became_peered":"2023-10-06T11:17:24.565350+0000","last_unstale":"2023-10-06T11:17:24.570073+0000","last_undegraded":"2023-10-06T11:17:24.570073+0000","last_fullsized":"2023-10-06T11:17:24.570073+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:15:45.424139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.582384+0000","last_change":"2023-10-06T11:17:23.574166+0000","last_active":"2023-10-06T11:17:24.582384+0000","last_peered":"2023-10-06T11:17:24.582384+0000","last_clean":"2023-10-06T11:17:24.582384+0000","last_became_active":"2023-10-06T11:17:23.573890+0000","last_became_peered":"2023-10-06T11:17:23.573890+0000","last_unstale":"2023-10-06T11:17:24.582384+0000","last_undegraded":"2023-10-06T11:17:24.582384+0000","last_fullsized":"2023-10-06T11:17:24.582384+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:03:31.748977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.576106+0000","last_change":"2023-10-06T11:17:24.568162+0000","last_active":"2023-10-06T11:17:24.576106+0000","last_peered":"2023-10-06T11:17:24.576106+0000","last_clean":"2023-10-06T11:17:24.576106+0000","last_became_active":"2023-10-06T11:17:24.567852+0000","last_became_peered":"2023-10-06T11:17:24.567852+0000","last_unstale":"2023-10-06T11:17:24.576106+0000","last_undegraded":"2023-10-06T11:17:24.576106+0000","last_fullsized":"2023-10-06T11:17:24.576106+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:55.042996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.559880+0000","last_change":"2023-10-06T11:17:23.564753+0000","last_active":"2023-10-06T11:17:24.559880+0000","last_peered":"2023-10-06T11:17:24.559880+0000","last_clean":"2023-10-06T11:17:24.559880+0000","last_became_active":"2023-10-06T11:17:23.564344+0000","last_became_peered":"2023-10-06T11:17:23.564344+0000","last_unstale":"2023-10-06T11:17:24.559880+0000","last_undegraded":"2023-10-06T11:17:24.559880+0000","last_fullsized":"2023-10-06T11:17:24.559880+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:16:28.786528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:23.546397+0000","last_change":"2023-10-06T11:17:23.546397+0000","last_active":"2023-10-06T11:17:23.546397+0000","last_peered":"2023-10-06T11:17:23.546397+0000","last_clean":"2023-10-06T11:17:23.546397+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:23.546397+0000","last_undegraded":"2023-10-06T11:17:23.546397+0000","last_fullsized":"2023-10-06T11:17:23.546397+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:22.540743+0000","last_change":"2023-10-06T11:17:22.540743+0000","last_active":"2023-10-06T11:17:22.540743+0000","last_peered":"2023-10-06T11:17:22.540743+0000","last_clean":"2023-10-06T11:17:22.540743+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:22.540743+0000","last_undegraded":"2023-10-06T11:17:22.540743+0000","last_fullsized":"2023-10-06T11:17:22.540743+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:23.546397+0000","last_change":"2023-10-06T11:17:23.546397+0000","last_active":"2023-10-06T11:17:23.546397+0000","last_peered":"2023-10-06T11:17:23.546397+0000","last_clean":"2023-10-06T11:17:23.546397+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:23.546397+0000","last_undegraded":"2023-10-06T11:17:23.546397+0000","last_fullsized":"2023-10-06T11:17:23.546397+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.f","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.584220+0000","last_change":"2023-10-06T11:17:23.570528+0000","last_active":"2023-10-06T11:17:24.584220+0000","last_peered":"2023-10-06T11:17:24.584220+0000","last_clean":"2023-10-06T11:17:24.584220+0000","last_became_active":"2023-10-06T11:17:23.569805+0000","last_became_peered":"2023-10-06T11:17:23.569805+0000","last_unstale":"2023-10-06T11:17:24.584220+0000","last_undegraded":"2023-10-06T11:17:24.584220+0000","last_fullsized":"2023-10-06T11:17:24.584220+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:47.786408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:23.546397+0000","last_change":"2023-10-06T11:17:23.546397+0000","last_active":"2023-10-06T11:17:23.546397+0000","last_peered":"2023-10-06T11:17:23.546397+0000","last_clean":"2023-10-06T11:17:23.546397+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:23.546397+0000","last_undegraded":"2023-10-06T11:17:23.546397+0000","last_fullsized":"2023-10-06T11:17:23.546397+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:22.540743+0000","last_change":"2023-10-06T11:17:22.540743+0000","last_active":"2023-10-06T11:17:22.540743+0000","last_peered":"2023-10-06T11:17:22.540743+0000","last_clean":"2023-10-06T11:17:22.540743+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:22.540743+0000","last_undegraded":"2023-10-06T11:17:22.540743+0000","last_fullsized":"2023-10-06T11:17:22.540743+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.566193+0000","last_change":"2023-10-06T11:17:24.560745+0000","last_active":"2023-10-06T11:17:24.566193+0000","last_peered":"2023-10-06T11:17:24.566193+0000","last_clean":"2023-10-06T11:17:24.566193+0000","last_became_active":"2023-10-06T11:17:24.560494+0000","last_became_peered":"2023-10-06T11:17:24.560494+0000","last_unstale":"2023-10-06T11:17:24.566193+0000","last_undegraded":"2023-10-06T11:17:24.566193+0000","last_fullsized":"2023-10-06T11:17:24.566193+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:36:51.480975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.584634+0000","last_change":"2023-10-06T11:17:23.567691+0000","last_active":"2023-10-06T11:17:24.584634+0000","last_peered":"2023-10-06T11:17:24.584634+0000","last_clean":"2023-10-06T11:17:24.584634+0000","last_became_active":"2023-10-06T11:17:23.567421+0000","last_became_peered":"2023-10-06T11:17:23.567421+0000","last_unstale":"2023-10-06T11:17:24.584634+0000","last_undegraded":"2023-10-06T11:17:24.584634+0000","last_fullsized":"2023-10-06T11:17:24.584634+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:04:18.984996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.570793+0000","last_change":"2023-10-06T11:17:24.568416+0000","last_active":"2023-10-06T11:17:24.570793+0000","last_peered":"2023-10-06T11:17:24.570793+0000","last_clean":"2023-10-06T11:17:24.570793+0000","last_became_active":"2023-10-06T11:17:24.568134+0000","last_became_peered":"2023-10-06T11:17:24.568134+0000","last_unstale":"2023-10-06T11:17:24.570793+0000","last_undegraded":"2023-10-06T11:17:24.570793+0000","last_fullsized":"2023-10-06T11:17:24.570793+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:09.705291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:22.540743+0000","last_change":"2023-10-06T11:17:22.540743+0000","last_active":"2023-10-06T11:17:22.540743+0000","last_peered":"2023-10-06T11:17:22.540743+0000","last_clean":"2023-10-06T11:17:22.540743+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:22.540743+0000","last_undegraded":"2023-10-06T11:17:22.540743+0000","last_fullsized":"2023-10-06T11:17:22.540743+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.565528+0000","last_change":"2023-10-06T11:17:24.563167+0000","last_active":"2023-10-06T11:17:24.565528+0000","last_peered":"2023-10-06T11:17:24.565528+0000","last_clean":"2023-10-06T11:17:24.565528+0000","last_became_active":"2023-10-06T11:17:24.562916+0000","last_became_peered":"2023-10-06T11:17:24.562916+0000","last_unstale":"2023-10-06T11:17:24.565528+0000","last_undegraded":"2023-10-06T11:17:24.565528+0000","last_fullsized":"2023-10-06T11:17:24.565528+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:07.151312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.582310+0000","last_change":"2023-10-06T11:17:23.564393+0000","last_active":"2023-10-06T11:17:24.582310+0000","last_peered":"2023-10-06T11:17:24.582310+0000","last_clean":"2023-10-06T11:17:24.582310+0000","last_became_active":"2023-10-06T11:17:23.564170+0000","last_became_peered":"2023-10-06T11:17:23.564170+0000","last_unstale":"2023-10-06T11:17:24.582310+0000","last_undegraded":"2023-10-06T11:17:24.582310+0000","last_fullsized":"2023-10-06T11:17:24.582310+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:06:26.401026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.576850+0000","last_change":"2023-10-06T11:17:24.573793+0000","last_active":"2023-10-06T11:17:24.576850+0000","last_peered":"2023-10-06T11:17:24.576850+0000","last_clean":"2023-10-06T11:17:24.576850+0000","last_became_active":"2023-10-06T11:17:24.572324+0000","last_became_peered":"2023-10-06T11:17:24.572324+0000","last_unstale":"2023-10-06T11:17:24.576850+0000","last_undegraded":"2023-10-06T11:17:24.576850+0000","last_fullsized":"2023-10-06T11:17:24.576850+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:46:42.885085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.557151+0000","last_change":"2023-10-06T11:17:23.574712+0000","last_active":"2023-10-06T11:17:24.557151+0000","last_peered":"2023-10-06T11:17:24.557151+0000","last_clean":"2023-10-06T11:17:24.557151+0000","last_became_active":"2023-10-06T11:17:23.574435+0000","last_became_peered":"2023-10-06T11:17:23.574435+0000","last_unstale":"2023-10-06T11:17:24.557151+0000","last_undegraded":"2023-10-06T11:17:24.557151+0000","last_fullsized":"2023-10-06T11:17:24.557151+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:22:25.530859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.576306+0000","last_change":"2023-10-06T11:17:24.571701+0000","last_active":"2023-10-06T11:17:24.576306+0000","last_peered":"2023-10-06T11:17:24.576306+0000","last_clean":"2023-10-06T11:17:24.576306+0000","last_became_active":"2023-10-06T11:17:24.571457+0000","last_became_peered":"2023-10-06T11:17:24.571457+0000","last_unstale":"2023-10-06T11:17:24.576306+0000","last_undegraded":"2023-10-06T11:17:24.576306+0000","last_fullsized":"2023-10-06T11:17:24.576306+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:45:28.551838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.559974+0000","last_change":"2023-10-06T11:17:23.564865+0000","last_active":"2023-10-06T11:17:24.559974+0000","last_peered":"2023-10-06T11:17:24.559974+0000","last_clean":"2023-10-06T11:17:24.559974+0000","last_became_active":"2023-10-06T11:17:23.564694+0000","last_became_peered":"2023-10-06T11:17:23.564694+0000","last_unstale":"2023-10-06T11:17:24.559974+0000","last_undegraded":"2023-10-06T11:17:24.559974+0000","last_fullsized":"2023-10-06T11:17:24.559974+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:11.629965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.576583+0000","last_change":"2023-10-06T11:17:24.575646+0000","last_active":"2023-10-06T11:17:24.576583+0000","last_peered":"2023-10-06T11:17:24.576583+0000","last_clean":"2023-10-06T11:17:24.576583+0000","last_became_active":"2023-10-06T11:17:24.570344+0000","last_became_peered":"2023-10-06T11:17:24.570344+0000","last_unstale":"2023-10-06T11:17:24.576583+0000","last_undegraded":"2023-10-06T11:17:24.576583+0000","last_fullsized":"2023-10-06T11:17:24.576583+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:38.610243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.566184+0000","last_change":"2023-10-06T11:17:23.574083+0000","last_active":"2023-10-06T11:17:24.566184+0000","last_peered":"2023-10-06T11:17:24.566184+0000","last_clean":"2023-10-06T11:17:24.566184+0000","last_became_active":"2023-10-06T11:17:23.573768+0000","last_became_peered":"2023-10-06T11:17:23.573768+0000","last_unstale":"2023-10-06T11:17:24.566184+0000","last_undegraded":"2023-10-06T11:17:24.566184+0000","last_fullsized":"2023-10-06T11:17:24.566184+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:32:36.073066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.570609+0000","last_change":"2023-10-06T11:17:24.567062+0000","last_active":"2023-10-06T11:17:24.570609+0000","last_peered":"2023-10-06T11:17:24.570609+0000","last_clean":"2023-10-06T11:17:24.570609+0000","last_became_active":"2023-10-06T11:17:24.566801+0000","last_became_peered":"2023-10-06T11:17:24.566801+0000","last_unstale":"2023-10-06T11:17:24.570609+0000","last_undegraded":"2023-10-06T11:17:24.570609+0000","last_fullsized":"2023-10-06T11:17:24.570609+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:31:49.318112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.584283+0000","last_change":"2023-10-06T11:17:23.564402+0000","last_active":"2023-10-06T11:17:24.584283+0000","last_peered":"2023-10-06T11:17:24.584283+0000","last_clean":"2023-10-06T11:17:24.584283+0000","last_became_active":"2023-10-06T11:17:23.564113+0000","last_became_peered":"2023-10-06T11:17:23.564113+0000","last_unstale":"2023-10-06T11:17:24.584283+0000","last_undegraded":"2023-10-06T11:17:24.584283+0000","last_fullsized":"2023-10-06T11:17:24.584283+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:53:59.261371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:23.546397+0000","last_change":"2023-10-06T11:17:23.546397+0000","last_active":"2023-10-06T11:17:23.546397+0000","last_peered":"2023-10-06T11:17:23.546397+0000","last_clean":"2023-10-06T11:17:23.546397+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:23.546397+0000","last_undegraded":"2023-10-06T11:17:23.546397+0000","last_fullsized":"2023-10-06T11:17:23.546397+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.555158+0000","last_change":"2023-10-06T11:17:23.570514+0000","last_active":"2023-10-06T11:17:24.555158+0000","last_peered":"2023-10-06T11:17:24.555158+0000","last_clean":"2023-10-06T11:17:24.555158+0000","last_became_active":"2023-10-06T11:17:23.570179+0000","last_became_peered":"2023-10-06T11:17:23.570179+0000","last_unstale":"2023-10-06T11:17:24.555158+0000","last_undegraded":"2023-10-06T11:17:24.555158+0000","last_fullsized":"2023-10-06T11:17:24.555158+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:08:06.688065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575970+0000","last_change":"2023-10-06T11:17:24.566933+0000","last_active":"2023-10-06T11:17:24.575970+0000","last_peered":"2023-10-06T11:17:24.575970+0000","last_clean":"2023-10-06T11:17:24.575970+0000","last_became_active":"2023-10-06T11:17:24.566764+0000","last_became_peered":"2023-10-06T11:17:24.566764+0000","last_unstale":"2023-10-06T11:17:24.575970+0000","last_undegraded":"2023-10-06T11:17:24.575970+0000","last_fullsized":"2023-10-06T11:17:24.575970+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:21:32.239463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.554770+0000","last_change":"2023-10-06T11:17:23.571952+0000","last_active":"2023-10-06T11:17:24.554770+0000","last_peered":"2023-10-06T11:17:24.554770+0000","last_clean":"2023-10-06T11:17:24.554770+0000","last_became_active":"2023-10-06T11:17:23.565102+0000","last_became_peered":"2023-10-06T11:17:23.565102+0000","last_unstale":"2023-10-06T11:17:24.554770+0000","last_undegraded":"2023-10-06T11:17:24.554770+0000","last_fullsized":"2023-10-06T11:17:24.554770+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:11:11.687267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:23.546397+0000","last_change":"2023-10-06T11:17:23.546397+0000","last_active":"2023-10-06T11:17:23.546397+0000","last_peered":"2023-10-06T11:17:23.546397+0000","last_clean":"2023-10-06T11:17:23.546397+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:23.546397+0000","last_undegraded":"2023-10-06T11:17:23.546397+0000","last_fullsized":"2023-10-06T11:17:23.546397+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.560119+0000","last_change":"2023-10-06T11:17:23.569219+0000","last_active":"2023-10-06T11:17:24.560119+0000","last_peered":"2023-10-06T11:17:24.560119+0000","last_clean":"2023-10-06T11:17:24.560119+0000","last_became_active":"2023-10-06T11:17:23.568946+0000","last_became_peered":"2023-10-06T11:17:23.568946+0000","last_unstale":"2023-10-06T11:17:24.560119+0000","last_undegraded":"2023-10-06T11:17:24.560119+0000","last_fullsized":"2023-10-06T11:17:24.560119+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:12:28.041975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:23.546397+0000","last_change":"2023-10-06T11:17:23.546397+0000","last_active":"2023-10-06T11:17:23.546397+0000","last_peered":"2023-10-06T11:17:23.546397+0000","last_clean":"2023-10-06T11:17:23.546397+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:23.546397+0000","last_undegraded":"2023-10-06T11:17:23.546397+0000","last_fullsized":"2023-10-06T11:17:23.546397+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:22.540743+0000","last_change":"2023-10-06T11:17:22.540743+0000","last_active":"2023-10-06T11:17:22.540743+0000","last_peered":"2023-10-06T11:17:22.540743+0000","last_clean":"2023-10-06T11:17:22.540743+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:22.540743+0000","last_undegraded":"2023-10-06T11:17:22.540743+0000","last_fullsized":"2023-10-06T11:17:22.540743+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.579474+0000","last_change":"2023-10-06T11:17:24.577355+0000","last_active":"2023-10-06T11:17:24.579474+0000","last_peered":"2023-10-06T11:17:24.579474+0000","last_clean":"2023-10-06T11:17:24.579474+0000","last_became_active":"2023-10-06T11:17:24.577095+0000","last_became_peered":"2023-10-06T11:17:24.577095+0000","last_unstale":"2023-10-06T11:17:24.579474+0000","last_undegraded":"2023-10-06T11:17:24.579474+0000","last_fullsized":"2023-10-06T11:17:24.579474+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:15:11.263158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.554819+0000","last_change":"2023-10-06T11:17:23.562075+0000","last_active":"2023-10-06T11:17:24.554819+0000","last_peered":"2023-10-06T11:17:24.554819+0000","last_clean":"2023-10-06T11:17:24.554819+0000","last_became_active":"2023-10-06T11:17:23.561792+0000","last_became_peered":"2023-10-06T11:17:23.561792+0000","last_unstale":"2023-10-06T11:17:24.554819+0000","last_undegraded":"2023-10-06T11:17:24.554819+0000","last_fullsized":"2023-10-06T11:17:24.554819+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:08.699637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.567434+0000","last_change":"2023-10-06T11:17:24.560966+0000","last_active":"2023-10-06T11:17:24.567434+0000","last_peered":"2023-10-06T11:17:24.567434+0000","last_clean":"2023-10-06T11:17:24.567434+0000","last_became_active":"2023-10-06T11:17:24.560664+0000","last_became_peered":"2023-10-06T11:17:24.560664+0000","last_unstale":"2023-10-06T11:17:24.567434+0000","last_undegraded":"2023-10-06T11:17:24.567434+0000","last_fullsized":"2023-10-06T11:17:24.567434+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:41:38.833103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.558951+0000","last_change":"2023-10-06T11:17:23.567100+0000","last_active":"2023-10-06T11:17:24.558951+0000","last_peered":"2023-10-06T11:17:24.558951+0000","last_clean":"2023-10-06T11:17:24.558951+0000","last_became_active":"2023-10-06T11:17:23.566811+0000","last_became_peered":"2023-10-06T11:17:23.566811+0000","last_unstale":"2023-10-06T11:17:24.558951+0000","last_undegraded":"2023-10-06T11:17:24.558951+0000","last_fullsized":"2023-10-06T11:17:24.558951+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:11:04.566108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575944+0000","last_change":"2023-10-06T11:17:24.567836+0000","last_active":"2023-10-06T11:17:24.575944+0000","last_peered":"2023-10-06T11:17:24.575944+0000","last_clean":"2023-10-06T11:17:24.575944+0000","last_became_active":"2023-10-06T11:17:24.567579+0000","last_became_peered":"2023-10-06T11:17:24.567579+0000","last_unstale":"2023-10-06T11:17:24.575944+0000","last_undegraded":"2023-10-06T11:17:24.575944+0000","last_fullsized":"2023-10-06T11:17:24.575944+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:02:58.843409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.558726+0000","last_change":"2023-10-06T11:17:23.569068+0000","last_active":"2023-10-06T11:17:24.558726+0000","last_peered":"2023-10-06T11:17:24.558726+0000","last_clean":"2023-10-06T11:17:24.558726+0000","last_became_active":"2023-10-06T11:17:23.568821+0000","last_became_peered":"2023-10-06T11:17:23.568821+0000","last_unstale":"2023-10-06T11:17:24.558726+0000","last_undegraded":"2023-10-06T11:17:24.558726+0000","last_fullsized":"2023-10-06T11:17:24.558726+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:08:53.820378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:23.546397+0000","last_change":"2023-10-06T11:17:23.546397+0000","last_active":"2023-10-06T11:17:23.546397+0000","last_peered":"2023-10-06T11:17:23.546397+0000","last_clean":"2023-10-06T11:17:23.546397+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:23.546397+0000","last_undegraded":"2023-10-06T11:17:23.546397+0000","last_fullsized":"2023-10-06T11:17:23.546397+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.13","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.587184+0000","last_change":"2023-10-06T11:17:23.567296+0000","last_active":"2023-10-06T11:17:24.587184+0000","last_peered":"2023-10-06T11:17:24.587184+0000","last_clean":"2023-10-06T11:17:24.587184+0000","last_became_active":"2023-10-06T11:17:23.566993+0000","last_became_peered":"2023-10-06T11:17:23.566993+0000","last_unstale":"2023-10-06T11:17:24.587184+0000","last_undegraded":"2023-10-06T11:17:24.587184+0000","last_fullsized":"2023-10-06T11:17:24.587184+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:06.145658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":127,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-06T11:17:18.537687+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:17:18.537687+0000","last_peered":"2023-10-06T11:17:18.537687+0000","last_clean":"2023-10-06T11:17:18.537687+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:17:18.537687+0000","last_undegraded":"2023-10-06T11:17:18.537687+0000","last_fullsized":"2023-10-06T11:17:18.537687+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:23.546397+0000","last_change":"2023-10-06T11:17:23.546397+0000","last_active":"2023-10-06T11:17:23.546397+0000","last_peered":"2023-10-06T11:17:23.546397+0000","last_clean":"2023-10-06T11:17:23.546397+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:23.546397+0000","last_undegraded":"2023-10-06T11:17:23.546397+0000","last_fullsized":"2023-10-06T11:17:23.546397+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.554724+0000","last_change":"2023-10-06T11:17:23.564126+0000","last_active":"2023-10-06T11:17:24.554724+0000","last_peered":"2023-10-06T11:17:24.554724+0000","last_clean":"2023-10-06T11:17:24.554724+0000","last_became_active":"2023-10-06T11:17:23.563881+0000","last_became_peered":"2023-10-06T11:17:23.563881+0000","last_unstale":"2023-10-06T11:17:24.554724+0000","last_undegraded":"2023-10-06T11:17:24.554724+0000","last_fullsized":"2023-10-06T11:17:24.554724+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:55.946021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":124,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.555311+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:17:24.555311+0000","last_peered":"2023-10-06T11:17:24.555311+0000","last_clean":"2023-10-06T11:17:24.555311+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:17:24.555311+0000","last_undegraded":"2023-10-06T11:17:24.555311+0000","last_fullsized":"2023-10-06T11:17:24.555311+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.580493+0000","last_change":"2023-10-06T11:17:24.569576+0000","last_active":"2023-10-06T11:17:24.580493+0000","last_peered":"2023-10-06T11:17:24.580493+0000","last_clean":"2023-10-06T11:17:24.580493+0000","last_became_active":"2023-10-06T11:17:24.569315+0000","last_became_peered":"2023-10-06T11:17:24.569315+0000","last_unstale":"2023-10-06T11:17:24.580493+0000","last_undegraded":"2023-10-06T11:17:24.580493+0000","last_fullsized":"2023-10-06T11:17:24.580493+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:23.035153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:22.540743+0000","last_change":"2023-10-06T11:17:22.540743+0000","last_active":"2023-10-06T11:17:22.540743+0000","last_peered":"2023-10-06T11:17:22.540743+0000","last_clean":"2023-10-06T11:17:22.540743+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:22.540743+0000","last_undegraded":"2023-10-06T11:17:22.540743+0000","last_fullsized":"2023-10-06T11:17:22.540743+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":118,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-06T11:17:19.175847+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:17:19.175847+0000","last_peered":"2023-10-06T11:17:19.175847+0000","last_clean":"2023-10-06T11:17:19.175847+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:17:19.175847+0000","last_undegraded":"2023-10-06T11:17:19.175847+0000","last_fullsized":"2023-10-06T11:17:19.175847+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":267,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.566276+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:17:24.566276+0000","last_peered":"2023-10-06T11:17:24.566276+0000","last_clean":"2023-10-06T11:17:24.566276+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:17:24.566276+0000","last_undegraded":"2023-10-06T11:17:24.566276+0000","last_fullsized":"2023-10-06T11:17:24.566276+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575929+0000","last_change":"2023-10-06T11:17:24.567759+0000","last_active":"2023-10-06T11:17:24.575929+0000","last_peered":"2023-10-06T11:17:24.575929+0000","last_clean":"2023-10-06T11:17:24.575929+0000","last_became_active":"2023-10-06T11:17:24.567496+0000","last_became_peered":"2023-10-06T11:17:24.567496+0000","last_unstale":"2023-10-06T11:17:24.575929+0000","last_undegraded":"2023-10-06T11:17:24.575929+0000","last_fullsized":"2023-10-06T11:17:24.575929+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:25:25.920939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"150'6","reported_seq":16,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.586312+0000","last_change":"2023-10-06T11:17:23.570090+0000","last_active":"2023-10-06T11:17:24.586312+0000","last_peered":"2023-10-06T11:17:24.586312+0000","last_clean":"2023-10-06T11:17:24.586312+0000","last_became_active":"2023-10-06T11:17:23.569829+0000","last_became_peered":"2023-10-06T11:17:23.569829+0000","last_unstale":"2023-10-06T11:17:24.586312+0000","last_undegraded":"2023-10-06T11:17:24.586312+0000","last_fullsized":"2023-10-06T11:17:24.586312+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:15:10.257503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":117,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.563929+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:17:24.563929+0000","last_peered":"2023-10-06T11:17:24.563929+0000","last_clean":"2023-10-06T11:17:24.563929+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:17:24.563929+0000","last_undegraded":"2023-10-06T11:17:24.563929+0000","last_fullsized":"2023-10-06T11:17:24.563929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.579240+0000","last_change":"2023-10-06T11:17:24.575811+0000","last_active":"2023-10-06T11:17:24.579240+0000","last_peered":"2023-10-06T11:17:24.579240+0000","last_clean":"2023-10-06T11:17:24.579240+0000","last_became_active":"2023-10-06T11:17:24.570303+0000","last_became_peered":"2023-10-06T11:17:24.570303+0000","last_unstale":"2023-10-06T11:17:24.579240+0000","last_undegraded":"2023-10-06T11:17:24.579240+0000","last_fullsized":"2023-10-06T11:17:24.579240+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:59:56.385931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.555042+0000","last_change":"2023-10-06T11:17:23.570382+0000","last_active":"2023-10-06T11:17:24.555042+0000","last_peered":"2023-10-06T11:17:24.555042+0000","last_clean":"2023-10-06T11:17:24.555042+0000","last_became_active":"2023-10-06T11:17:23.569847+0000","last_became_peered":"2023-10-06T11:17:23.569847+0000","last_unstale":"2023-10-06T11:17:24.555042+0000","last_undegraded":"2023-10-06T11:17:24.555042+0000","last_fullsized":"2023-10-06T11:17:24.555042+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:15:11.795033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":117,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.566358+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:17:24.566358+0000","last_peered":"2023-10-06T11:17:24.566358+0000","last_clean":"2023-10-06T11:17:24.566358+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:17:24.566358+0000","last_undegraded":"2023-10-06T11:17:24.566358+0000","last_fullsized":"2023-10-06T11:17:24.566358+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.579416+0000","last_change":"2023-10-06T11:17:24.576816+0000","last_active":"2023-10-06T11:17:24.579416+0000","last_peered":"2023-10-06T11:17:24.579416+0000","last_clean":"2023-10-06T11:17:24.579416+0000","last_became_active":"2023-10-06T11:17:24.576459+0000","last_became_peered":"2023-10-06T11:17:24.576459+0000","last_unstale":"2023-10-06T11:17:24.579416+0000","last_undegraded":"2023-10-06T11:17:24.579416+0000","last_fullsized":"2023-10-06T11:17:24.579416+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:15:12.800687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.555532+0000","last_change":"2023-10-06T11:17:23.570674+0000","last_active":"2023-10-06T11:17:24.555532+0000","last_peered":"2023-10-06T11:17:24.555532+0000","last_clean":"2023-10-06T11:17:24.555532+0000","last_became_active":"2023-10-06T11:17:23.570308+0000","last_became_peered":"2023-10-06T11:17:23.570308+0000","last_unstale":"2023-10-06T11:17:24.555532+0000","last_undegraded":"2023-10-06T11:17:24.555532+0000","last_fullsized":"2023-10-06T11:17:24.555532+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:59:55.380277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":140,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.559017+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:17:24.559017+0000","last_peered":"2023-10-06T11:17:24.559017+0000","last_clean":"2023-10-06T11:17:24.559017+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:17:24.559017+0000","last_undegraded":"2023-10-06T11:17:24.559017+0000","last_fullsized":"2023-10-06T11:17:24.559017+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575922+0000","last_change":"2023-10-06T11:17:24.566665+0000","last_active":"2023-10-06T11:17:24.575922+0000","last_peered":"2023-10-06T11:17:24.575922+0000","last_clean":"2023-10-06T11:17:24.575922+0000","last_became_active":"2023-10-06T11:17:24.566426+0000","last_became_peered":"2023-10-06T11:17:24.566426+0000","last_unstale":"2023-10-06T11:17:24.575922+0000","last_undegraded":"2023-10-06T11:17:24.575922+0000","last_fullsized":"2023-10-06T11:17:24.575922+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:29:19.469513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:17:22.540743+0000","last_change":"2023-10-06T11:17:22.540743+0000","last_active":"2023-10-06T11:17:22.540743+0000","last_peered":"2023-10-06T11:17:22.540743+0000","last_clean":"2023-10-06T11:17:22.540743+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:17:22.540743+0000","last_undegraded":"2023-10-06T11:17:22.540743+0000","last_fullsized":"2023-10-06T11:17:22.540743+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":120,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-06T11:17:19.175644+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:17:19.175644+0000","last_peered":"2023-10-06T11:17:19.175644+0000","last_clean":"2023-10-06T11:17:19.175644+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:17:19.175644+0000","last_undegraded":"2023-10-06T11:17:19.175644+0000","last_fullsized":"2023-10-06T11:17:19.175644+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.570686+0000","last_change":"2023-10-06T11:17:24.567445+0000","last_active":"2023-10-06T11:17:24.570686+0000","last_peered":"2023-10-06T11:17:24.570686+0000","last_clean":"2023-10-06T11:17:24.570686+0000","last_became_active":"2023-10-06T11:17:24.567192+0000","last_became_peered":"2023-10-06T11:17:24.567192+0000","last_unstale":"2023-10-06T11:17:24.570686+0000","last_undegraded":"2023-10-06T11:17:24.570686+0000","last_fullsized":"2023-10-06T11:17:24.570686+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:20.201597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.558847+0000","last_change":"2023-10-06T11:17:23.565830+0000","last_active":"2023-10-06T11:17:24.558847+0000","last_peered":"2023-10-06T11:17:24.558847+0000","last_clean":"2023-10-06T11:17:24.558847+0000","last_became_active":"2023-10-06T11:17:23.565544+0000","last_became_peered":"2023-10-06T11:17:23.565544+0000","last_unstale":"2023-10-06T11:17:24.558847+0000","last_undegraded":"2023-10-06T11:17:24.558847+0000","last_fullsized":"2023-10-06T11:17:24.558847+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:45.678850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":120,"reported_epoch":146,"state":"active+clean","last_fresh":"2023-10-06T11:17:19.175649+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:17:19.175649+0000","last_peered":"2023-10-06T11:17:19.175649+0000","last_clean":"2023-10-06T11:17:19.175649+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:17:19.175649+0000","last_undegraded":"2023-10-06T11:17:19.175649+0000","last_fullsized":"2023-10-06T11:17:19.175649+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":84,"acting":84,"num_store_stats":5},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":1662,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":48,"acting":48,"num_store_stats":5},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574993,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303816,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068024,"statfs":{"total":96636764160,"available":96325656576,"internally_reserved":0,"allocated":2490368,"data_stored":1465114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.54300000000000004,"15min":0.626},"min":{"1min":0.35699999999999998,"5min":0.252,"15min":0.21199999999999999},"max":{"1min":0.71699999999999997,"5min":4.407,"15min":23.908999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.51400000000000001,"15min":0.57499999999999996},"min":{"1min":0.33200000000000002,"5min":0.26900000000000002,"15min":0.22500000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":9.3230000000000004},"last":0.628}]},{"osd":1,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53700000000000003,"15min":0.56000000000000005},"min":{"1min":0.28799999999999998,"5min":0.28399999999999997,"15min":0.26000000000000001},"max":{"1min":0.77700000000000002,"5min":2.4689999999999999,"15min":9.2360000000000007},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.502,"15min":0.504},"min":{"1min":0.40999999999999998,"5min":0.33100000000000002,"15min":0.25900000000000001},"max":{"1min":0.70899999999999996,"5min":0.78900000000000003,"15min":4.327},"last":0.499}]},{"osd":2,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56899999999999995,"15min":0.51900000000000002},"min":{"1min":0.40100000000000002,"5min":0.33000000000000002,"15min":0.26500000000000001},"max":{"1min":0.69999999999999996,"5min":4.3120000000000003,"15min":4.3120000000000003},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55900000000000005,"15min":0.55600000000000005},"min":{"1min":0.372,"5min":0.31,"15min":0.29999999999999999},"max":{"1min":0.74099999999999999,"5min":3.0600000000000001,"15min":4.7309999999999999},"last":0.56699999999999995}]},{"osd":3,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.56899999999999995,"15min":0.54100000000000004},"min":{"1min":0.35299999999999998,"5min":0.32600000000000001,"15min":0.27900000000000003},"max":{"1min":0.72299999999999998,"5min":4.5190000000000001,"15min":4.5190000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.59499999999999997,"15min":0.59999999999999998},"min":{"1min":0.42799999999999999,"5min":0.36599999999999999,"15min":0.29699999999999999},"max":{"1min":0.76200000000000001,"5min":3.0070000000000001,"15min":9.3879999999999999},"last":0.60099999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.53400000000000003,"15min":0.49299999999999999},"min":{"1min":0.32000000000000001,"5min":0.29799999999999999,"15min":0.24399999999999999},"max":{"1min":0.69199999999999995,"5min":4.6639999999999997,"15min":4.6639999999999997},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.57299999999999995,"15min":0.53600000000000003},"min":{"1min":0.35399999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.70899999999999996,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":0.45600000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.56000000000000005},"min":{"1min":0.39200000000000002,"5min":0.32900000000000001,"15min":0.26000000000000001},"max":{"1min":0.66100000000000003,"5min":0.77000000000000002,"15min":9.3499999999999996},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.53100000000000003,"15min":0.54200000000000004},"min":{"1min":0.377,"5min":0.30099999999999999,"15min":0.26800000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":4.444},"last":0.54300000000000004}]},{"osd":6,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57099999999999995,"15min":0.59699999999999998},"min":{"1min":0.41399999999999998,"5min":0.38100000000000001,"15min":0.29199999999999998},"max":{"1min":0.73699999999999999,"5min":0.82099999999999995,"15min":9.4969999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.64000000000000001,"15min":0.62},"min":{"1min":0.44,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.75600000000000001,"5min":4.4669999999999996,"15min":7.2039999999999997},"last":0.51700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574994,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299088,"kb_used_data":1800,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072752,"statfs":{"total":96636764160,"available":96330498048,"internally_reserved":0,"allocated":1843200,"data_stored":846870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.60199999999999998,"15min":0.52400000000000002},"min":{"1min":0.35199999999999998,"5min":0.247,"15min":0.187},"max":{"1min":0.80500000000000005,"5min":9.5549999999999997,"15min":9.5549999999999997},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.65600000000000003,"15min":0.56699999999999995},"min":{"1min":0.44400000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.78400000000000003,"5min":9.4659999999999993,"15min":9.4659999999999993},"last":0.72799999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.49299999999999999,"15min":0.48399999999999999},"min":{"1min":0.33500000000000002,"5min":0.26800000000000002,"15min":0.23300000000000001},"max":{"1min":0.74299999999999999,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.622},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.57699999999999996,"15min":0.51600000000000001},"min":{"1min":0.34399999999999997,"5min":0.216,"15min":0.216},"max":{"1min":0.71399999999999997,"5min":5.2670000000000003,"15min":5.2670000000000003},"last":0.77300000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.5,"15min":0.503},"min":{"1min":0.33700000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.77100000000000002,"5min":0.93200000000000005,"15min":7.0659999999999998},"last":0.745},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.51300000000000001,"15min":0.51900000000000002},"min":{"1min":0.41199999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.69199999999999995,"5min":1.0069999999999999,"15min":7.0819999999999999},"last":0.71499999999999997}]},{"osd":3,"last update":"Fri Oct 6 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.56000000000000005,"15min":0.52000000000000002},"min":{"1min":0.39700000000000002,"5min":0.317,"15min":0.25800000000000001},"max":{"1min":0.75700000000000001,"5min":3.871,"15min":3.871},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.54000000000000004,"15min":0.53200000000000003},"min":{"1min":0.43099999999999999,"5min":0.32100000000000001,"15min":0.312},"max":{"1min":0.72799999999999998,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.80700000000000005}]},{"osd":4,"last update":"Fri Oct 6 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.48099999999999998,"15min":0.47799999999999998},"min":{"1min":0.34899999999999998,"5min":0.26800000000000002,"15min":0.24299999999999999},"max":{"1min":0.68600000000000005,"5min":0.88,"15min":0.88},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53600000000000003,"15min":0.53300000000000003},"min":{"1min":0.378,"5min":0.29699999999999999,"15min":0.27900000000000003},"max":{"1min":0.71199999999999997,"5min":0.82399999999999995,"15min":1.0680000000000001},"last":0.59699999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52100000000000002,"15min":0.51700000000000002},"min":{"1min":0.38400000000000001,"5min":0.32000000000000001,"15min":0.28399999999999997},"max":{"1min":0.73399999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.627,"15min":0.57999999999999996},"min":{"1min":0.39500000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.745,"5min":7.1379999999999999,"15min":7.1379999999999999},"last":0.67200000000000004}]},{"osd":7,"last update":"Fri Oct 6 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58599999999999997,"15min":0.56799999999999995},"min":{"1min":0.42499999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.748,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59099999999999997,"15min":0.58499999999999996},"min":{"1min":0.45800000000000002,"5min":0.36399999999999999,"15min":0.30199999999999999},"max":{"1min":0.82099999999999995,"5min":0.86899999999999999,"15min":0.88400000000000001},"last":0.82999999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574993,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311960,"kb_used_data":2384,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059880,"statfs":{"total":96636764160,"available":96317317120,"internally_reserved":0,"allocated":2441216,"data_stored":1438591,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:59 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.47099999999999997,"15min":0.377},"min":{"1min":0.247,"5min":0.20499999999999999,"15min":0.186},"max":{"1min":0.49399999999999999,"5min":13.393000000000001,"15min":13.393000000000001},"last":0.438},{"interface":"front","average":{"1min":0.374,"5min":0.46899999999999997,"15min":0.38600000000000001},"min":{"1min":0.254,"5min":0.22500000000000001,"15min":0.19700000000000001},"max":{"1min":0.53900000000000003,"5min":11.462,"15min":11.462},"last":0.247}]},{"osd":2,"last update":"Fri Oct 6 11:16:59 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.41399999999999998,"15min":0.36099999999999999},"min":{"1min":0.25800000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.48099999999999998,"5min":8.0470000000000006,"15min":8.0470000000000006},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.44900000000000001,"15min":0.40799999999999997},"min":{"1min":0.32100000000000001,"5min":0.215,"15min":0.20999999999999999},"max":{"1min":0.58399999999999996,"5min":4.8630000000000004,"15min":4.8630000000000004},"last":0.36199999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:16:59 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46700000000000003,"15min":0.42599999999999999},"min":{"1min":0.28599999999999998,"5min":0.255,"15min":0.252},"max":{"1min":0.64800000000000002,"5min":4.8029999999999999,"15min":4.8029999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.45100000000000001,"15min":0.39700000000000002},"min":{"1min":0.29699999999999999,"5min":0.23400000000000001,"15min":0.217},"max":{"1min":0.749,"5min":5.8700000000000001,"15min":5.8700000000000001},"last":0.38100000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:16:59 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.54500000000000004,"15min":0.52500000000000002},"min":{"1min":0.39900000000000002,"5min":0.28299999999999997,"15min":0.28199999999999997},"max":{"1min":0.88400000000000001,"5min":1.264,"15min":1.264},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.625,"15min":0.57299999999999995},"min":{"1min":0.41199999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.89400000000000002,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.58099999999999996}]},{"osd":5,"last update":"Fri Oct 6 11:16:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.61299999999999999,"15min":0.57199999999999995},"min":{"1min":0.45600000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78600000000000003,"5min":3.4390000000000001,"15min":3.4390000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.68500000000000005,"15min":0.59299999999999997},"min":{"1min":0.42999999999999999,"5min":0.36799999999999999,"15min":0.29499999999999998},"max":{"1min":0.84499999999999997,"5min":9.3829999999999991,"15min":9.3829999999999991},"last":0.75800000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:16:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.64200000000000002,"15min":0.59299999999999997},"min":{"1min":0.42099999999999999,"5min":0.35999999999999999,"15min":0.315},"max":{"1min":0.83599999999999997,"5min":3.4750000000000001,"15min":3.4750000000000001},"last":0.748},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.64000000000000001,"15min":0.60099999999999998},"min":{"1min":0.36599999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.872,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.64600000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:16:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66200000000000003,"15min":0.61499999999999999},"min":{"1min":0.46600000000000003,"5min":0.39800000000000002,"15min":0.38500000000000001},"max":{"1min":0.82999999999999996,"5min":4.7290000000000001,"15min":4.7290000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.627,"15min":0.59599999999999997},"min":{"1min":0.48599999999999999,"5min":0.38900000000000001,"15min":0.374},"max":{"1min":0.81100000000000005,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.68400000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574993,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303240,"kb_used_data":1856,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068600,"statfs":{"total":96636764160,"available":96326246400,"internally_reserved":0,"allocated":1900544,"data_stored":873497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.34799999999999998,"15min":0.47099999999999997},"min":{"1min":0.248,"5min":0.20399999999999999,"15min":0.184},"max":{"1min":0.59599999999999997,"5min":0.64900000000000002,"15min":36.097999999999999},"last":0.436},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.371,"15min":0.38300000000000001},"min":{"1min":0.29899999999999999,"5min":0.22,"15min":0.182},"max":{"1min":0.497,"5min":0.92400000000000004,"15min":7.2990000000000004},"last":0.26400000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.37,"15min":0.503},"min":{"1min":0.223,"5min":0.223,"15min":0.217},"max":{"1min":0.49099999999999999,"5min":0.82599999999999996,"15min":36.07},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.39800000000000002,"15min":0.40999999999999998},"min":{"1min":0.26800000000000002,"5min":0.25600000000000001,"15min":0.219},"max":{"1min":0.57099999999999995,"5min":0.94899999999999995,"15min":6.7800000000000002},"last":0.41899999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.36899999999999999,"15min":0.39500000000000002},"min":{"1min":0.27500000000000002,"5min":0.255,"15min":0.223},"max":{"1min":0.53800000000000003,"5min":0.64100000000000001,"15min":8.4130000000000003},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.43099999999999999,"15min":0.56000000000000005},"min":{"1min":0.315,"5min":0.25800000000000001,"15min":0.249},"max":{"1min":0.59999999999999998,"5min":1.9079999999999999,"15min":35.959000000000003},"last":0.40600000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.57999999999999996,"15min":0.56699999999999995},"min":{"1min":0.39100000000000001,"5min":0.33800000000000002,"15min":0.29599999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":2.427},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.60199999999999998,"15min":0.73199999999999998},"min":{"1min":0.42899999999999999,"5min":0.374,"15min":0.29299999999999998},"max":{"1min":0.84999999999999998,"5min":0.94999999999999996,"15min":36.005000000000003},"last":0.82699999999999996}]},{"osd":5,"last update":"Fri Oct 6 11:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.58599999999999997,"15min":0.58499999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.32900000000000001},"max":{"1min":0.95299999999999996,"5min":0.999,"15min":6.6699999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58099999999999996,"15min":0.56000000000000005},"min":{"1min":0.41299999999999998,"5min":0.372,"15min":0.315},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":2.0600000000000001},"last":0.71399999999999997}]},{"osd":6,"last update":"Fri Oct 6 11:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.61299999999999999,"15min":0.73399999999999999},"min":{"1min":0.50600000000000001,"5min":0.39200000000000002,"15min":0.317},"max":{"1min":0.89600000000000002,"5min":0.98699999999999999,"15min":36.037999999999997},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.63100000000000001,"15min":0.64000000000000001},"min":{"1min":0.41299999999999998,"5min":0.40999999999999998,"15min":0.36399999999999999},"max":{"1min":0.89200000000000002,"5min":1.028,"15min":6.7110000000000003},"last":0.74099999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61499999999999999,"15min":0.624},"min":{"1min":0.432,"5min":0.40999999999999998,"15min":0.371},"max":{"1min":0.86599999999999999,"5min":1.054,"15min":6.742},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.58999999999999997,"15min":0.57399999999999995},"min":{"1min":0.42799999999999999,"5min":0.41399999999999998,"15min":0.34499999999999997},"max":{"1min":0.86699999999999999,"5min":0.96199999999999997,"15min":1.917},"last":0.628}]}]},{"osd":2,"up_from":13,"seq":55834574994,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299124,"kb_used_data":1836,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072716,"statfs":{"total":96636764160,"available":96330461184,"internally_reserved":0,"allocated":1880064,"data_stored":866752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":0.46700000000000003,"15min":0.36299999999999999},"min":{"1min":0.248,"5min":0.214,"15min":0.17999999999999999},"max":{"1min":15.228,"5min":15.228,"15min":15.228},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.503,"5min":0.40600000000000003,"15min":0.38900000000000001},"min":{"1min":0.32900000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":0.36599999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.38200000000000001,"15min":0.375},"min":{"1min":0.28899999999999998,"5min":0.23599999999999999,"15min":0.19900000000000001},"max":{"1min":0.56200000000000006,"5min":0.57499999999999996,"15min":0.745},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.36199999999999999,"15min":0.35399999999999998},"min":{"1min":0.23200000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.35699999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.36899999999999999,"15min":0.36799999999999999},"min":{"1min":0.27900000000000003,"5min":0.23699999999999999,"15min":0.23200000000000001},"max":{"1min":0.621,"5min":0.621,"15min":0.629},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.378,"15min":0.36799999999999999},"min":{"1min":0.27500000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.64400000000000002},"last":0.313}]},{"osd":4,"last update":"Fri Oct 6 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.46700000000000003,"5min":0.30599999999999999,"15min":0.30299999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":1.3200000000000001,"5min":0.69199999999999995,"15min":0.59499999999999997},"min":{"1min":0.42799999999999999,"5min":0.28199999999999997,"15min":0.27900000000000003},"max":{"1min":15.26,"5min":15.26,"15min":15.26},"last":0.65400000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":0.69999999999999996,"15min":0.59399999999999997},"min":{"1min":0.38200000000000001,"5min":0.35799999999999998,"15min":0.32400000000000001},"max":{"1min":15.186,"5min":15.186,"15min":15.186},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.57599999999999996,"15min":0.55900000000000005},"min":{"1min":0.44600000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.64200000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.60099999999999998,"15min":0.58499999999999996},"min":{"1min":0.48899999999999999,"5min":0.38200000000000001,"15min":0.32600000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.60199999999999998,"15min":0.57899999999999996},"min":{"1min":0.47099999999999997,"5min":0.40699999999999997,"15min":0.34200000000000003},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.67400000000000004}]},{"osd":7,"last update":"Fri Oct 6 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":0.68200000000000005,"15min":0.59799999999999998},"min":{"1min":0.46600000000000003,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":10.977,"5min":10.977,"15min":10.977},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.58599999999999997,"15min":0.57399999999999995},"min":{"1min":0.52100000000000002,"5min":0.38800000000000001,"15min":0.38200000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.66500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574994,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311444,"kb_used_data":1868,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060396,"statfs":{"total":96636764160,"available":96317845504,"internally_reserved":0,"allocated":1912832,"data_stored":875505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.34399999999999997,"15min":0.32500000000000001},"min":{"1min":0.248,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.46899999999999997,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.41199999999999998,"15min":0.39100000000000001},"min":{"1min":0.313,"5min":0.23000000000000001,"15min":0.22700000000000001},"max":{"1min":0.55100000000000005,"5min":4.4820000000000002,"15min":4.4820000000000002},"last":0.32800000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.32100000000000001,"15min":0.313},"min":{"1min":0.248,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.439,"5min":0.54000000000000004,"15min":0.65400000000000003},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.35599999999999998,"15min":0.35699999999999998},"min":{"1min":0.27700000000000002,"5min":0.23400000000000001,"15min":0.188},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":1.196},"last":0.30499999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.40200000000000002,"15min":0.38400000000000001},"min":{"1min":0.27700000000000002,"5min":0.23400000000000001,"15min":0.19600000000000001},"max":{"1min":0.45300000000000001,"5min":4.601,"15min":4.601},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.437,"15min":0.41799999999999998},"min":{"1min":0.32500000000000001,"5min":0.29899999999999999,"15min":0.26100000000000001},"max":{"1min":0.63200000000000001,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.35999999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.54500000000000004,"15min":0.54700000000000004},"min":{"1min":0.378,"5min":0.32100000000000001,"15min":0.311},"max":{"1min":0.75900000000000001,"5min":0.88500000000000001,"15min":1.694},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54500000000000004,"15min":0.53900000000000003},"min":{"1min":0.46300000000000002,"5min":0.32600000000000001,"15min":0.30199999999999999},"max":{"1min":0.68700000000000006,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.47399999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.434,"5min":0.34100000000000003,"15min":0.29399999999999998},"max":{"1min":0.63800000000000001,"5min":0.86399999999999999,"15min":0.878},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.36599999999999999,"5min":0.35699999999999998,"15min":0.29699999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":1.165},"last":0.46500000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.44400000000000001,"5min":0.372,"15min":0.36699999999999999},"max":{"1min":0.78700000000000003,"5min":0.79200000000000004,"15min":1.1359999999999999},"last":0.502},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57699999999999996,"15min":0.58499999999999996},"min":{"1min":0.443,"5min":0.36799999999999999,"15min":0.34399999999999997},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":1.7470000000000001},"last":0.48399999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56499999999999995,"15min":0.57399999999999995},"min":{"1min":0.39600000000000002,"5min":0.35699999999999998,"15min":0.35599999999999998},"max":{"1min":0.80300000000000005,"5min":0.89900000000000002,"15min":1.657},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57899999999999996,"15min":0.57299999999999995},"min":{"1min":0.48399999999999999,"5min":0.38,"15min":0.35499999999999998},"max":{"1min":0.71599999999999997,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.49299999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574992,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303188,"kb_used_data":1804,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068652,"statfs":{"total":96636764160,"available":96326299648,"internally_reserved":0,"allocated":1847296,"data_stored":848223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.47999999999999998,"15min":0.51600000000000001},"min":{"1min":0.30099999999999999,"5min":0.20799999999999999,"15min":0.19500000000000001},"max":{"1min":0.76800000000000002,"5min":0.82099999999999995,"15min":2.6619999999999999},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.504,"15min":0.49199999999999999},"min":{"1min":0.28999999999999998,"5min":0.224,"15min":0.215},"max":{"1min":0.81499999999999995,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.38300000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.498,"15min":0.53600000000000003},"min":{"1min":0.27600000000000002,"5min":0.26200000000000001,"15min":0.23300000000000001},"max":{"1min":0.72899999999999998,"5min":1,"15min":2.8650000000000002},"last":0.308},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.497,"15min":0.54200000000000004},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.25800000000000001},"max":{"1min":0.70699999999999996,"5min":1.2869999999999999,"15min":2.7610000000000001},"last":0.47999999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.52300000000000002,"15min":0.53300000000000003},"min":{"1min":0.36899999999999999,"5min":0.28499999999999998,"15min":0.23100000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":1.6910000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57199999999999995,"15min":0.57999999999999996},"min":{"1min":0.40999999999999998,"5min":0.31,"15min":0.30599999999999999},"max":{"1min":0.82799999999999996,"5min":0.93899999999999995,"15min":1.718},"last":0.501}]},{"osd":3,"last update":"Fri Oct 6 11:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58099999999999996,"15min":0.58599999999999997},"min":{"1min":0.38600000000000001,"5min":0.32000000000000001,"15min":0.26700000000000002},"max":{"1min":0.78800000000000003,"5min":2.387,"15min":2.677},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.55000000000000004,"15min":0.52700000000000002},"min":{"1min":0.42499999999999999,"5min":0.29299999999999998,"15min":0.27500000000000002},"max":{"1min":0.77700000000000002,"5min":1.784,"15min":1.784},"last":0.437}]},{"osd":5,"last update":"Fri Oct 6 11:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.378,"5min":0.28499999999999998,"15min":0.23200000000000001},"max":{"1min":0.68300000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.51500000000000001,"15min":0.52500000000000002},"min":{"1min":0.39400000000000002,"5min":0.28899999999999998,"15min":0.28399999999999997},"max":{"1min":0.749,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.59299999999999997}]},{"osd":6,"last update":"Fri Oct 6 11:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.35799999999999998,"5min":0.31,"15min":0.252},"max":{"1min":0.72999999999999998,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55200000000000005,"15min":0.55900000000000005},"min":{"1min":0.41199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80200000000000005,"5min":0.85799999999999998,"15min":1.165},"last":0.53800000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.56599999999999995,"15min":0.55800000000000005},"min":{"1min":0.40799999999999997,"5min":0.34200000000000003,"15min":0.313},"max":{"1min":0.84999999999999998,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.58899999999999997,"15min":0.59099999999999997},"min":{"1min":0.41999999999999998,"5min":0.318,"15min":0.317},"max":{"1min":0.86399999999999999,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.58399999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574995,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311436,"kb_used_data":1860,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060404,"statfs":{"total":96636764160,"available":96317853696,"internally_reserved":0,"allocated":1904640,"data_stored":874870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.48499999999999999,"15min":0.57499999999999996},"min":{"1min":0.26000000000000001,"5min":0.23300000000000001,"15min":0.20499999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":5.0490000000000004},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.48599999999999999,"15min":0.55500000000000005},"min":{"1min":0.34599999999999997,"5min":0.253,"15min":0.22900000000000001},"max":{"1min":0.71299999999999997,"5min":0.78100000000000003,"15min":5.1449999999999996},"last":0.45000000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.48899999999999999,"15min":0.48299999999999998},"min":{"1min":0.27800000000000002,"5min":0.25700000000000001,"15min":0.25},"max":{"1min":0.68400000000000005,"5min":0.81399999999999995,"15min":0.97199999999999998},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.505,"15min":0.51000000000000001},"min":{"1min":0.29799999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.69299999999999995,"5min":0.74099999999999999,"15min":1.8799999999999999},"last":0.57699999999999996}]},{"osd":2,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.52800000000000002,"15min":0.54600000000000004},"min":{"1min":0.36799999999999999,"5min":0.30099999999999999,"15min":0.28299999999999997},"max":{"1min":0.748,"5min":0.79800000000000004,"15min":4.234},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56200000000000006,"15min":0.56000000000000005},"min":{"1min":0.436,"5min":0.315,"15min":0.315},"max":{"1min":0.79200000000000004,"5min":0.81000000000000005,"15min":1.0369999999999999},"last":0.54400000000000004}]},{"osd":3,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51000000000000001,"15min":0.59299999999999997},"min":{"1min":0.311,"5min":0.29499999999999998,"15min":0.27700000000000002},"max":{"1min":0.70499999999999996,"5min":0.82299999999999995,"15min":5.2169999999999996},"last":0.5},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53100000000000003,"15min":0.53800000000000003},"min":{"1min":0.38700000000000001,"5min":0.29999999999999999,"15min":0.29699999999999999},"max":{"1min":0.73699999999999999,"5min":0.75600000000000001,"15min":1.008},"last":0.47799999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48399999999999999,"15min":0.504},"min":{"1min":0.33700000000000002,"5min":0.25600000000000001,"15min":0.23999999999999999},"max":{"1min":0.65900000000000003,"5min":0.83399999999999996,"15min":1.917},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.48999999999999999,"15min":0.51400000000000001},"min":{"1min":0.29999999999999999,"5min":0.251,"15min":0.23899999999999999},"max":{"1min":0.65500000000000003,"5min":0.69199999999999995,"15min":0.87},"last":0.56599999999999995}]},{"osd":6,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51100000000000001,"15min":0.54300000000000004},"min":{"1min":0.34799999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.67200000000000004,"5min":0.76800000000000002,"15min":2.0139999999999998},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57399999999999995,"15min":0.59399999999999997},"min":{"1min":0.33200000000000002,"5min":0.30299999999999999,"15min":0.29999999999999999},"max":{"1min":0.72599999999999998,"5min":0.82899999999999996,"15min":1.9470000000000001},"last":0.65100000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53600000000000003,"15min":0.56299999999999994},"min":{"1min":0.376,"5min":0.28799999999999998,"15min":0.27700000000000002},"max":{"1min":0.64600000000000002,"5min":0.81000000000000005,"15min":0.96499999999999997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56899999999999995,"15min":0.59299999999999997},"min":{"1min":0.42599999999999999,"5min":0.29199999999999998,"15min":0.28799999999999998},"max":{"1min":0.746,"5min":0.77300000000000002,"15min":1.4119999999999999},"last":0.63900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:17:29.000 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:17:29.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.141+0000 7f4531830700 1 Processor -- start 2023-10-06T11:17:29.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.141+0000 7f4531830700 1 -- start start 2023-10-06T11:17:29.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.142+0000 7f4531830700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f452c153e80 0x7f452c15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:29.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.142+0000 7f4531830700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f452c15ac30 con 0x7f452c153ab0 2023-10-06T11:17:29.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.142+0000 7f4531830700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f452c0b4510 con 0x7f452c068ba0 2023-10-06T11:17:29.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.142+0000 7f4531830700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f452c0b6530 con 0x7f452c153e80 2023-10-06T11:17:29.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.142+0000 7f452b7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f452c153e80 0x7f452c15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:29.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.142+0000 7f452affd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f452c153ab0 0x7f452c068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39728/0 (socket says 172.21.15.146:39728) 2023-10-06T11:17:29.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.142+0000 7f452affd700 1 -- 172.21.15.146:0/2280094941 learned_addr learned my addr 172.21.15.146:0/2280094941 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:17:29.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.142+0000 7f452b7fe700 1 -- 172.21.15.146:0/2280094941 >> v1:172.21.15.151:6789/0 conn(0x7f452c068ba0 legacy=0x7f452c0b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:29.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.142+0000 7f452b7fe700 1 -- 172.21.15.146:0/2280094941 >> v1:172.21.15.146:6789/0 conn(0x7f452c153ab0 legacy=0x7f452c068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:29.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.142+0000 7f452b7fe700 1 -- 172.21.15.146:0/2280094941 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f452c0b5c50 con 0x7f452c153e80 2023-10-06T11:17:29.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.142+0000 7f4529ffb700 1 -- 172.21.15.146:0/2280094941 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2343877354 0 0) 0x7f4524001490 con 0x7f452c153ab0 2023-10-06T11:17:29.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.142+0000 7f452b7fe700 1 --2- 172.21.15.146:0/2280094941 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f452c153e80 0x7f452c15a6f0 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7f451c0098e0 tx=0x7f451c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94faaa85d5ba4118 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:29.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.142+0000 7f4529ffb700 1 -- 172.21.15.146:0/2280094941 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451c009e80 con 0x7f452c153e80 2023-10-06T11:17:29.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.142+0000 7f4529ffb700 1 -- 172.21.15.146:0/2280094941 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451c00b860 con 0x7f452c153e80 2023-10-06T11:17:29.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.142+0000 7f4529ffb700 1 -- 172.21.15.146:0/2280094941 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451c00bbe0 con 0x7f452c153e80 2023-10-06T11:17:29.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.143+0000 7f4531830700 1 -- 172.21.15.146:0/2280094941 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f452c153e80 msgr2=0x7f452c15a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:29.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.143+0000 7f4531830700 1 --2- 172.21.15.146:0/2280094941 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f452c153e80 0x7f452c15a6f0 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7f451c0098e0 tx=0x7f451c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:17:29.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.143+0000 7f4531830700 1 -- 172.21.15.146:0/2280094941 shutdown_connections 2023-10-06T11:17:29.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.143+0000 7f4531830700 1 --2- 172.21.15.146:0/2280094941 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f452c153e80 0x7f452c15a6f0 unknown :-1 s=CLOSED pgs=1954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:29.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.143+0000 7f4531830700 1 -- 172.21.15.146:0/2280094941 >> 172.21.15.146:0/2280094941 conn(0x7f452c06eba0 msgr2=0x7f452c06efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:29.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.143+0000 7f4531830700 1 -- 172.21.15.146:0/2280094941 shutdown_connections 2023-10-06T11:17:29.146 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.143+0000 7f4531830700 1 -- 172.21.15.146:0/2280094941 wait complete. 2023-10-06T11:17:29.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.144+0000 7f4531830700 1 Processor -- start 2023-10-06T11:17:29.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.144+0000 7f4531830700 1 -- start start 2023-10-06T11:17:29.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.145+0000 7f4531830700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f452c068ba0 0x7f452c151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:29.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.145+0000 7f4531830700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f452c153ab0 0x7f452c15c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:29.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.145+0000 7f4531830700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f452c153e80 0x7f452c15c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:29.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.145+0000 7f4531830700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f452c1698b0 con 0x7f452c153e80 2023-10-06T11:17:29.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.145+0000 7f4531830700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f452c1516c0 con 0x7f452c153ab0 2023-10-06T11:17:29.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.145+0000 7f4531830700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f452c169b00 con 0x7f452c068ba0 2023-10-06T11:17:29.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.145+0000 7f452b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f452c153e80 0x7f452c15c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:29.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.145+0000 7f452b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f452c153e80 0x7f452c15c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49748/0 (socket says 172.21.15.146:49748) 2023-10-06T11:17:29.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.145+0000 7f452b7fe700 1 -- 172.21.15.146:0/516111238 learned_addr learned my addr 172.21.15.146:0/516111238 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:29.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.145+0000 7f452a7fc700 1 --2- 172.21.15.146:0/516111238 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f452c153ab0 0x7f452c15c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:29.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.145+0000 7f452affd700 1 --2- 172.21.15.146:0/516111238 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f452c068ba0 0x7f452c151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:29.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.145+0000 7f452b7fe700 1 -- 172.21.15.146:0/516111238 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f452c068ba0 msgr2=0x7f452c151180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:29.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.145+0000 7f452b7fe700 1 --2- 172.21.15.146:0/516111238 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f452c068ba0 0x7f452c151180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:29.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.145+0000 7f452b7fe700 1 -- 172.21.15.146:0/516111238 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f452c153ab0 msgr2=0x7f452c15c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:29.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.145+0000 7f452b7fe700 1 --2- 172.21.15.146:0/516111238 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f452c153ab0 0x7f452c15c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:29.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.145+0000 7f452b7fe700 1 -- 172.21.15.146:0/516111238 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f451c009420 con 0x7f452c153e80 2023-10-06T11:17:29.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.145+0000 7f452affd700 1 --2- 172.21.15.146:0/516111238 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f452c068ba0 0x7f452c151180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:17:29.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.146+0000 7f452b7fe700 1 --2- 172.21.15.146:0/516111238 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f452c153e80 0x7f452c15c770 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7f451c0030c0 tx=0x7f451c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:29.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.146+0000 7f4512ffd700 1 -- 172.21.15.146:0/516111238 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451c00bb50 con 0x7f452c153e80 2023-10-06T11:17:29.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.146+0000 7f4512ffd700 1 -- 172.21.15.146:0/516111238 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451c020070 con 0x7f452c153e80 2023-10-06T11:17:29.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.146+0000 7f4531830700 1 -- 172.21.15.146:0/516111238 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f452c169de0 con 0x7f452c153e80 2023-10-06T11:17:29.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.146+0000 7f4512ffd700 1 -- 172.21.15.146:0/516111238 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451c01b680 con 0x7f452c153e80 2023-10-06T11:17:29.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.146+0000 7f4531830700 1 -- 172.21.15.146:0/516111238 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f452c16a3a0 con 0x7f452c153e80 2023-10-06T11:17:29.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.147+0000 7f4531830700 1 -- 172.21.15.146:0/516111238 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f452c04c380 con 0x7f452c153e80 2023-10-06T11:17:29.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.147+0000 7f4512ffd700 1 -- 172.21.15.146:0/516111238 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f451c022030 con 0x7f452c153e80 2023-10-06T11:17:29.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.148+0000 7f4512ffd700 1 --2- 172.21.15.146:0/516111238 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4518067000 0x7f45180694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:29.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.148+0000 7f4512ffd700 1 -- 172.21.15.146:0/516111238 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f451c086780 con 0x7f452c153e80 2023-10-06T11:17:29.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.148+0000 7f452affd700 1 --2- 172.21.15.146:0/516111238 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4518067000 0x7f45180694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:29.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.148+0000 7f452affd700 1 --2- 172.21.15.146:0/516111238 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4518067000 0x7f45180694b0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f452400e280 tx=0x7f4524009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:29.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.152+0000 7f4512ffd700 1 -- 172.21.15.146:0/516111238 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f451c053910 con 0x7f452c153e80 2023-10-06T11:17:29.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.331+0000 7f4531830700 1 -- 172.21.15.146:0/516111238 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f452c04c380 con 0x7f4518067000 2023-10-06T11:17:29.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.339+0000 7f4512ffd700 1 -- 172.21.15.146:0/516111238 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311913 (secure 0 0 0) 0x7f452c04c380 con 0x7f4518067000 2023-10-06T11:17:29.344 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:29.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.343+0000 7f4531830700 1 -- 172.21.15.146:0/516111238 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4518067000 msgr2=0x7f45180694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:29.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.343+0000 7f4531830700 1 --2- 172.21.15.146:0/516111238 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4518067000 0x7f45180694b0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f452400e280 tx=0x7f4524009040 comp rx=0 tx=0).stop 2023-10-06T11:17:29.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.343+0000 7f4531830700 1 -- 172.21.15.146:0/516111238 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f452c153e80 msgr2=0x7f452c15c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:29.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.343+0000 7f4531830700 1 --2- 172.21.15.146:0/516111238 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f452c153e80 0x7f452c15c770 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7f451c0030c0 tx=0x7f451c016000 comp rx=0 tx=0).stop 2023-10-06T11:17:29.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.343+0000 7f4531830700 1 -- 172.21.15.146:0/516111238 shutdown_connections 2023-10-06T11:17:29.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.343+0000 7f4531830700 1 --2- 172.21.15.146:0/516111238 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4518067000 0x7f45180694b0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:29.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.343+0000 7f4531830700 1 --2- 172.21.15.146:0/516111238 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f452c153e80 0x7f452c15c770 unknown :-1 s=CLOSED pgs=1955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:29.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.343+0000 7f4531830700 1 --2- 172.21.15.146:0/516111238 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f452c068ba0 0x7f452c151180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:29.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.343+0000 7f4531830700 1 --2- 172.21.15.146:0/516111238 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f452c153ab0 0x7f452c15c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:29.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.343+0000 7f4531830700 1 -- 172.21.15.146:0/516111238 >> 172.21.15.146:0/516111238 conn(0x7f452c06eba0 msgr2=0x7f452c0ce950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:29.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.343+0000 7f4531830700 1 -- 172.21.15.146:0/516111238 shutdown_connections 2023-10-06T11:17:29.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.343+0000 7f4531830700 1 -- 172.21.15.146:0/516111238 wait complete. 2023-10-06T11:17:29.348 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:17:29.357 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":500,"stamp":"2023-10-06T11:17:29.292684+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":163,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2443468,"kb_used_data":16012,"kb_used_omap":0,"kb_used_meta":2427392,"kb_avail":752531252,"statfs":{"total":773094113280,"available":770592002048,"internally_reserved":0,"allocated":16396288,"data_stored":8171263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2485649408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001162"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.570754+0000","last_change":"2023-10-06T11:17:24.567490+0000","last_active":"2023-10-06T11:17:24.570754+0000","last_peered":"2023-10-06T11:17:24.570754+0000","last_clean":"2023-10-06T11:17:24.570754+0000","last_became_active":"2023-10-06T11:17:24.565793+0000","last_became_peered":"2023-10-06T11:17:24.565793+0000","last_unstale":"2023-10-06T11:17:24.570754+0000","last_undegraded":"2023-10-06T11:17:24.570754+0000","last_fullsized":"2023-10-06T11:17:24.570754+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:15:11.263158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575584+0000","last_change":"2023-10-06T11:17:24.574790+0000","last_active":"2023-10-06T11:17:24.575584+0000","last_peered":"2023-10-06T11:17:24.575584+0000","last_clean":"2023-10-06T11:17:24.575584+0000","last_became_active":"2023-10-06T11:17:24.574475+0000","last_became_peered":"2023-10-06T11:17:24.574475+0000","last_unstale":"2023-10-06T11:17:24.575584+0000","last_undegraded":"2023-10-06T11:17:24.575584+0000","last_fullsized":"2023-10-06T11:17:24.575584+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:20.201597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.568092+0000","last_change":"2023-10-06T11:17:24.565515+0000","last_active":"2023-10-06T11:17:24.568092+0000","last_peered":"2023-10-06T11:17:24.568092+0000","last_clean":"2023-10-06T11:17:24.568092+0000","last_became_active":"2023-10-06T11:17:24.565217+0000","last_became_peered":"2023-10-06T11:17:24.565217+0000","last_unstale":"2023-10-06T11:17:24.568092+0000","last_undegraded":"2023-10-06T11:17:24.568092+0000","last_fullsized":"2023-10-06T11:17:24.568092+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:22:20.066646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.571884+0000","last_change":"2023-10-06T11:17:24.569633+0000","last_active":"2023-10-06T11:17:24.571884+0000","last_peered":"2023-10-06T11:17:24.571884+0000","last_clean":"2023-10-06T11:17:24.571884+0000","last_became_active":"2023-10-06T11:17:24.569056+0000","last_became_peered":"2023-10-06T11:17:24.569056+0000","last_unstale":"2023-10-06T11:17:24.571884+0000","last_undegraded":"2023-10-06T11:17:24.571884+0000","last_fullsized":"2023-10-06T11:17:24.571884+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:11:12.692922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.576344+0000","last_change":"2023-10-06T11:17:24.570249+0000","last_active":"2023-10-06T11:17:24.576344+0000","last_peered":"2023-10-06T11:17:24.576344+0000","last_clean":"2023-10-06T11:17:24.576344+0000","last_became_active":"2023-10-06T11:17:24.570080+0000","last_became_peered":"2023-10-06T11:17:24.570080+0000","last_unstale":"2023-10-06T11:17:24.576344+0000","last_undegraded":"2023-10-06T11:17:24.576344+0000","last_fullsized":"2023-10-06T11:17:24.576344+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:32:08.893601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.569849+0000","last_change":"2023-10-06T11:17:24.568112+0000","last_active":"2023-10-06T11:17:24.569849+0000","last_peered":"2023-10-06T11:17:24.569849+0000","last_clean":"2023-10-06T11:17:24.569849+0000","last_became_active":"2023-10-06T11:17:24.567855+0000","last_became_peered":"2023-10-06T11:17:24.567855+0000","last_unstale":"2023-10-06T11:17:24.569849+0000","last_undegraded":"2023-10-06T11:17:24.569849+0000","last_fullsized":"2023-10-06T11:17:24.569849+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:11:12.692922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575807+0000","last_change":"2023-10-06T11:17:24.570311+0000","last_active":"2023-10-06T11:17:24.575807+0000","last_peered":"2023-10-06T11:17:24.575807+0000","last_clean":"2023-10-06T11:17:24.575807+0000","last_became_active":"2023-10-06T11:17:24.569843+0000","last_became_peered":"2023-10-06T11:17:24.569843+0000","last_unstale":"2023-10-06T11:17:24.575807+0000","last_undegraded":"2023-10-06T11:17:24.575807+0000","last_fullsized":"2023-10-06T11:17:24.575807+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:18.748550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575984+0000","last_change":"2023-10-06T11:17:24.571846+0000","last_active":"2023-10-06T11:17:24.575984+0000","last_peered":"2023-10-06T11:17:24.575984+0000","last_clean":"2023-10-06T11:17:24.575984+0000","last_became_active":"2023-10-06T11:17:24.571569+0000","last_became_peered":"2023-10-06T11:17:24.571569+0000","last_unstale":"2023-10-06T11:17:24.575984+0000","last_undegraded":"2023-10-06T11:17:24.575984+0000","last_fullsized":"2023-10-06T11:17:24.575984+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:08:07.693719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575834+0000","last_change":"2023-10-06T11:17:24.570976+0000","last_active":"2023-10-06T11:17:24.575834+0000","last_peered":"2023-10-06T11:17:24.575834+0000","last_clean":"2023-10-06T11:17:24.575834+0000","last_became_active":"2023-10-06T11:17:24.570681+0000","last_became_peered":"2023-10-06T11:17:24.570681+0000","last_unstale":"2023-10-06T11:17:24.575834+0000","last_undegraded":"2023-10-06T11:17:24.575834+0000","last_fullsized":"2023-10-06T11:17:24.575834+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:48.792063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.576026+0000","last_change":"2023-10-06T11:17:24.571439+0000","last_active":"2023-10-06T11:17:24.576026+0000","last_peered":"2023-10-06T11:17:24.576026+0000","last_clean":"2023-10-06T11:17:24.576026+0000","last_became_active":"2023-10-06T11:17:24.570809+0000","last_became_peered":"2023-10-06T11:17:24.570809+0000","last_unstale":"2023-10-06T11:17:24.576026+0000","last_undegraded":"2023-10-06T11:17:24.576026+0000","last_fullsized":"2023-10-06T11:17:24.576026+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:20.201597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.570755+0000","last_change":"2023-10-06T11:17:24.568848+0000","last_active":"2023-10-06T11:17:24.570755+0000","last_peered":"2023-10-06T11:17:24.570755+0000","last_clean":"2023-10-06T11:17:24.570755+0000","last_became_active":"2023-10-06T11:17:24.567763+0000","last_became_peered":"2023-10-06T11:17:24.567763+0000","last_unstale":"2023-10-06T11:17:24.570755+0000","last_undegraded":"2023-10-06T11:17:24.570755+0000","last_fullsized":"2023-10-06T11:17:24.570755+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:56.951675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575114+0000","last_change":"2023-10-06T11:17:24.573144+0000","last_active":"2023-10-06T11:17:24.575114+0000","last_peered":"2023-10-06T11:17:24.575114+0000","last_clean":"2023-10-06T11:17:24.575114+0000","last_became_active":"2023-10-06T11:17:24.572892+0000","last_became_peered":"2023-10-06T11:17:24.572892+0000","last_unstale":"2023-10-06T11:17:24.575114+0000","last_undegraded":"2023-10-06T11:17:24.575114+0000","last_fullsized":"2023-10-06T11:17:24.575114+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:15:52.609098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.580555+0000","last_change":"2023-10-06T11:17:24.571121+0000","last_active":"2023-10-06T11:17:24.580555+0000","last_peered":"2023-10-06T11:17:24.580555+0000","last_clean":"2023-10-06T11:17:24.580555+0000","last_became_active":"2023-10-06T11:17:24.570858+0000","last_became_peered":"2023-10-06T11:17:24.570858+0000","last_unstale":"2023-10-06T11:17:24.580555+0000","last_undegraded":"2023-10-06T11:17:24.580555+0000","last_fullsized":"2023-10-06T11:17:24.580555+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:32:17.113391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.573663+0000","last_change":"2023-10-06T11:17:24.568783+0000","last_active":"2023-10-06T11:17:24.573663+0000","last_peered":"2023-10-06T11:17:24.573663+0000","last_clean":"2023-10-06T11:17:24.573663+0000","last_became_active":"2023-10-06T11:17:24.565857+0000","last_became_peered":"2023-10-06T11:17:24.565857+0000","last_unstale":"2023-10-06T11:17:24.573663+0000","last_undegraded":"2023-10-06T11:17:24.573663+0000","last_fullsized":"2023-10-06T11:17:24.573663+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:11:22.690663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.574923+0000","last_change":"2023-10-06T11:17:24.571861+0000","last_active":"2023-10-06T11:17:24.574923+0000","last_peered":"2023-10-06T11:17:24.574923+0000","last_clean":"2023-10-06T11:17:24.574923+0000","last_became_active":"2023-10-06T11:17:24.571607+0000","last_became_peered":"2023-10-06T11:17:24.571607+0000","last_unstale":"2023-10-06T11:17:24.574923+0000","last_undegraded":"2023-10-06T11:17:24.574923+0000","last_fullsized":"2023-10-06T11:17:24.574923+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:55:29.624889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.568335+0000","last_change":"2023-10-06T11:17:24.567062+0000","last_active":"2023-10-06T11:17:24.568335+0000","last_peered":"2023-10-06T11:17:24.568335+0000","last_clean":"2023-10-06T11:17:24.568335+0000","last_became_active":"2023-10-06T11:17:24.566777+0000","last_became_peered":"2023-10-06T11:17:24.566777+0000","last_unstale":"2023-10-06T11:17:24.568335+0000","last_undegraded":"2023-10-06T11:17:24.568335+0000","last_fullsized":"2023-10-06T11:17:24.568335+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:20.201597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575852+0000","last_change":"2023-10-06T11:17:24.571498+0000","last_active":"2023-10-06T11:17:24.575852+0000","last_peered":"2023-10-06T11:17:24.575852+0000","last_clean":"2023-10-06T11:17:24.575852+0000","last_became_active":"2023-10-06T11:17:24.571243+0000","last_became_peered":"2023-10-06T11:17:24.571243+0000","last_unstale":"2023-10-06T11:17:24.575852+0000","last_undegraded":"2023-10-06T11:17:24.575852+0000","last_fullsized":"2023-10-06T11:17:24.575852+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:15:12.800687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575232+0000","last_change":"2023-10-06T11:17:24.574498+0000","last_active":"2023-10-06T11:17:24.575232+0000","last_peered":"2023-10-06T11:17:24.575232+0000","last_clean":"2023-10-06T11:17:24.575232+0000","last_became_active":"2023-10-06T11:17:24.574246+0000","last_became_peered":"2023-10-06T11:17:24.574246+0000","last_unstale":"2023-10-06T11:17:24.575232+0000","last_undegraded":"2023-10-06T11:17:24.575232+0000","last_fullsized":"2023-10-06T11:17:24.575232+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:07:54.294932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.574906+0000","last_change":"2023-10-06T11:17:24.571935+0000","last_active":"2023-10-06T11:17:24.574906+0000","last_peered":"2023-10-06T11:17:24.574906+0000","last_clean":"2023-10-06T11:17:24.574906+0000","last_became_active":"2023-10-06T11:17:24.571681+0000","last_became_peered":"2023-10-06T11:17:24.571681+0000","last_unstale":"2023-10-06T11:17:24.574906+0000","last_undegraded":"2023-10-06T11:17:24.574906+0000","last_fullsized":"2023-10-06T11:17:24.574906+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:56:17.624615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575898+0000","last_change":"2023-10-06T11:17:24.568125+0000","last_active":"2023-10-06T11:17:24.575898+0000","last_peered":"2023-10-06T11:17:24.575898+0000","last_clean":"2023-10-06T11:17:24.575898+0000","last_became_active":"2023-10-06T11:17:24.567809+0000","last_became_peered":"2023-10-06T11:17:24.567809+0000","last_unstale":"2023-10-06T11:17:24.575898+0000","last_undegraded":"2023-10-06T11:17:24.575898+0000","last_fullsized":"2023-10-06T11:17:24.575898+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:32:27.294341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.565724+0000","last_change":"2023-10-06T11:17:24.561075+0000","last_active":"2023-10-06T11:17:24.565724+0000","last_peered":"2023-10-06T11:17:24.565724+0000","last_clean":"2023-10-06T11:17:24.565724+0000","last_became_active":"2023-10-06T11:17:24.560699+0000","last_became_peered":"2023-10-06T11:17:24.560699+0000","last_unstale":"2023-10-06T11:17:24.565724+0000","last_undegraded":"2023-10-06T11:17:24.565724+0000","last_fullsized":"2023-10-06T11:17:24.565724+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:06:27.406680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.574973+0000","last_change":"2023-10-06T11:17:24.572835+0000","last_active":"2023-10-06T11:17:24.574973+0000","last_peered":"2023-10-06T11:17:24.574973+0000","last_clean":"2023-10-06T11:17:24.574973+0000","last_became_active":"2023-10-06T11:17:24.570204+0000","last_became_peered":"2023-10-06T11:17:24.570204+0000","last_unstale":"2023-10-06T11:17:24.574973+0000","last_undegraded":"2023-10-06T11:17:24.574973+0000","last_fullsized":"2023-10-06T11:17:24.574973+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:18.748550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.570377+0000","last_change":"2023-10-06T11:17:24.567291+0000","last_active":"2023-10-06T11:17:24.570377+0000","last_peered":"2023-10-06T11:17:24.570377+0000","last_clean":"2023-10-06T11:17:24.570377+0000","last_became_active":"2023-10-06T11:17:24.566984+0000","last_became_peered":"2023-10-06T11:17:24.566984+0000","last_unstale":"2023-10-06T11:17:24.570377+0000","last_undegraded":"2023-10-06T11:17:24.570377+0000","last_fullsized":"2023-10-06T11:17:24.570377+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:42:04.095734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.571794+0000","last_change":"2023-10-06T11:17:24.568240+0000","last_active":"2023-10-06T11:17:24.571794+0000","last_peered":"2023-10-06T11:17:24.571794+0000","last_clean":"2023-10-06T11:17:24.571794+0000","last_became_active":"2023-10-06T11:17:24.567647+0000","last_became_peered":"2023-10-06T11:17:24.567647+0000","last_unstale":"2023-10-06T11:17:24.571794+0000","last_undegraded":"2023-10-06T11:17:24.571794+0000","last_fullsized":"2023-10-06T11:17:24.571794+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:38.610243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.565288+0000","last_change":"2023-10-06T11:17:24.561095+0000","last_active":"2023-10-06T11:17:24.565288+0000","last_peered":"2023-10-06T11:17:24.565288+0000","last_clean":"2023-10-06T11:17:24.565288+0000","last_became_active":"2023-10-06T11:17:24.560834+0000","last_became_peered":"2023-10-06T11:17:24.560834+0000","last_unstale":"2023-10-06T11:17:24.565288+0000","last_undegraded":"2023-10-06T11:17:24.565288+0000","last_fullsized":"2023-10-06T11:17:24.565288+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:33:05.816585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.570099+0000","last_change":"2023-10-06T11:17:24.566087+0000","last_active":"2023-10-06T11:17:24.570099+0000","last_peered":"2023-10-06T11:17:24.570099+0000","last_clean":"2023-10-06T11:17:24.570099+0000","last_became_active":"2023-10-06T11:17:24.565836+0000","last_became_peered":"2023-10-06T11:17:24.565836+0000","last_unstale":"2023-10-06T11:17:24.570099+0000","last_undegraded":"2023-10-06T11:17:24.570099+0000","last_fullsized":"2023-10-06T11:17:24.570099+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:32:22.601435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575177+0000","last_change":"2023-10-06T11:17:24.574344+0000","last_active":"2023-10-06T11:17:24.575177+0000","last_peered":"2023-10-06T11:17:24.575177+0000","last_clean":"2023-10-06T11:17:24.575177+0000","last_became_active":"2023-10-06T11:17:24.570258+0000","last_became_peered":"2023-10-06T11:17:24.570258+0000","last_unstale":"2023-10-06T11:17:24.575177+0000","last_undegraded":"2023-10-06T11:17:24.575177+0000","last_fullsized":"2023-10-06T11:17:24.575177+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:56.951675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.565509+0000","last_change":"2023-10-06T11:17:24.561410+0000","last_active":"2023-10-06T11:17:24.565509+0000","last_peered":"2023-10-06T11:17:24.565509+0000","last_clean":"2023-10-06T11:17:24.565509+0000","last_became_active":"2023-10-06T11:17:24.561150+0000","last_became_peered":"2023-10-06T11:17:24.561150+0000","last_unstale":"2023-10-06T11:17:24.565509+0000","last_undegraded":"2023-10-06T11:17:24.565509+0000","last_fullsized":"2023-10-06T11:17:24.565509+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:03:32.754632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.579321+0000","last_change":"2023-10-06T11:17:24.576372+0000","last_active":"2023-10-06T11:17:24.579321+0000","last_peered":"2023-10-06T11:17:24.579321+0000","last_clean":"2023-10-06T11:17:24.579321+0000","last_became_active":"2023-10-06T11:17:24.575959+0000","last_became_peered":"2023-10-06T11:17:24.575959+0000","last_unstale":"2023-10-06T11:17:24.579321+0000","last_undegraded":"2023-10-06T11:17:24.579321+0000","last_fullsized":"2023-10-06T11:17:24.579321+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:01:59.076681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.572200+0000","last_change":"2023-10-06T11:17:24.570445+0000","last_active":"2023-10-06T11:17:24.572200+0000","last_peered":"2023-10-06T11:17:24.572200+0000","last_clean":"2023-10-06T11:17:24.572200+0000","last_became_active":"2023-10-06T11:17:24.569571+0000","last_became_peered":"2023-10-06T11:17:24.569571+0000","last_unstale":"2023-10-06T11:17:24.572200+0000","last_undegraded":"2023-10-06T11:17:24.572200+0000","last_fullsized":"2023-10-06T11:17:24.572200+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:13:56.199292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.571340+0000","last_change":"2023-10-06T11:17:24.567865+0000","last_active":"2023-10-06T11:17:24.571340+0000","last_peered":"2023-10-06T11:17:24.571340+0000","last_clean":"2023-10-06T11:17:24.571340+0000","last_became_active":"2023-10-06T11:17:24.567577+0000","last_became_peered":"2023-10-06T11:17:24.567577+0000","last_unstale":"2023-10-06T11:17:24.571340+0000","last_undegraded":"2023-10-06T11:17:24.571340+0000","last_fullsized":"2023-10-06T11:17:24.571340+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:38.610243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.573375+0000","last_change":"2023-10-06T11:17:24.571614+0000","last_active":"2023-10-06T11:17:24.573375+0000","last_peered":"2023-10-06T11:17:24.573375+0000","last_clean":"2023-10-06T11:17:24.573375+0000","last_became_active":"2023-10-06T11:17:24.571337+0000","last_became_peered":"2023-10-06T11:17:24.571337+0000","last_unstale":"2023-10-06T11:17:24.573375+0000","last_undegraded":"2023-10-06T11:17:24.573375+0000","last_fullsized":"2023-10-06T11:17:24.573375+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:06:16.172673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.579569+0000","last_change":"2023-10-06T11:17:24.577831+0000","last_active":"2023-10-06T11:17:24.579569+0000","last_peered":"2023-10-06T11:17:24.579569+0000","last_clean":"2023-10-06T11:17:24.579569+0000","last_became_active":"2023-10-06T11:17:24.577572+0000","last_became_peered":"2023-10-06T11:17:24.577572+0000","last_unstale":"2023-10-06T11:17:24.579569+0000","last_undegraded":"2023-10-06T11:17:24.579569+0000","last_fullsized":"2023-10-06T11:17:24.579569+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:48.792063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"150'4","reported_seq":14,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.584433+0000","last_change":"2023-10-06T11:17:23.564693+0000","last_active":"2023-10-06T11:17:24.584433+0000","last_peered":"2023-10-06T11:17:24.584433+0000","last_clean":"2023-10-06T11:17:24.584433+0000","last_became_active":"2023-10-06T11:17:23.564436+0000","last_became_peered":"2023-10-06T11:17:23.564436+0000","last_unstale":"2023-10-06T11:17:24.584433+0000","last_undegraded":"2023-10-06T11:17:24.584433+0000","last_fullsized":"2023-10-06T11:17:24.584433+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:01:34.348343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.573070+0000","last_change":"2023-10-06T11:17:24.565982+0000","last_active":"2023-10-06T11:17:24.573070+0000","last_peered":"2023-10-06T11:17:24.573070+0000","last_clean":"2023-10-06T11:17:24.573070+0000","last_became_active":"2023-10-06T11:17:24.565734+0000","last_became_peered":"2023-10-06T11:17:24.565734+0000","last_unstale":"2023-10-06T11:17:24.573070+0000","last_undegraded":"2023-10-06T11:17:24.573070+0000","last_fullsized":"2023-10-06T11:17:24.573070+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:33.751143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.582526+0000","last_change":"2023-10-06T11:17:23.569143+0000","last_active":"2023-10-06T11:17:24.582526+0000","last_peered":"2023-10-06T11:17:24.582526+0000","last_clean":"2023-10-06T11:17:24.582526+0000","last_became_active":"2023-10-06T11:17:23.568883+0000","last_became_peered":"2023-10-06T11:17:23.568883+0000","last_unstale":"2023-10-06T11:17:24.582526+0000","last_undegraded":"2023-10-06T11:17:24.582526+0000","last_fullsized":"2023-10-06T11:17:24.582526+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:33:04.810931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.569717+0000","last_change":"2023-10-06T11:17:24.565660+0000","last_active":"2023-10-06T11:17:24.569717+0000","last_peered":"2023-10-06T11:17:24.569717+0000","last_clean":"2023-10-06T11:17:24.569717+0000","last_became_active":"2023-10-06T11:17:24.564786+0000","last_became_peered":"2023-10-06T11:17:24.564786+0000","last_unstale":"2023-10-06T11:17:24.569717+0000","last_undegraded":"2023-10-06T11:17:24.569717+0000","last_fullsized":"2023-10-06T11:17:24.569717+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:51:39.405314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.581331+0000","last_change":"2023-10-06T11:17:23.567167+0000","last_active":"2023-10-06T11:17:24.581331+0000","last_peered":"2023-10-06T11:17:24.581331+0000","last_clean":"2023-10-06T11:17:24.581331+0000","last_became_active":"2023-10-06T11:17:23.566837+0000","last_became_peered":"2023-10-06T11:17:23.566837+0000","last_unstale":"2023-10-06T11:17:24.581331+0000","last_undegraded":"2023-10-06T11:17:24.581331+0000","last_fullsized":"2023-10-06T11:17:24.581331+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:02:19.001747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.579437+0000","last_change":"2023-10-06T11:17:24.576887+0000","last_active":"2023-10-06T11:17:24.579437+0000","last_peered":"2023-10-06T11:17:24.579437+0000","last_clean":"2023-10-06T11:17:24.579437+0000","last_became_active":"2023-10-06T11:17:24.576611+0000","last_became_peered":"2023-10-06T11:17:24.576611+0000","last_unstale":"2023-10-06T11:17:24.579437+0000","last_undegraded":"2023-10-06T11:17:24.579437+0000","last_fullsized":"2023-10-06T11:17:24.579437+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:08:07.693719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.580673+0000","last_change":"2023-10-06T11:17:23.569167+0000","last_active":"2023-10-06T11:17:24.580673+0000","last_peered":"2023-10-06T11:17:24.580673+0000","last_clean":"2023-10-06T11:17:24.580673+0000","last_became_active":"2023-10-06T11:17:23.568918+0000","last_became_peered":"2023-10-06T11:17:23.568918+0000","last_unstale":"2023-10-06T11:17:24.580673+0000","last_undegraded":"2023-10-06T11:17:24.580673+0000","last_fullsized":"2023-10-06T11:17:24.580673+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:36:10.273812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.576021+0000","last_change":"2023-10-06T11:17:24.572189+0000","last_active":"2023-10-06T11:17:24.576021+0000","last_peered":"2023-10-06T11:17:24.576021+0000","last_clean":"2023-10-06T11:17:24.576021+0000","last_became_active":"2023-10-06T11:17:24.571887+0000","last_became_peered":"2023-10-06T11:17:24.571887+0000","last_unstale":"2023-10-06T11:17:24.576021+0000","last_undegraded":"2023-10-06T11:17:24.576021+0000","last_fullsized":"2023-10-06T11:17:24.576021+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:15:11.263158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.582600+0000","last_change":"2023-10-06T11:17:23.571211+0000","last_active":"2023-10-06T11:17:24.582600+0000","last_peered":"2023-10-06T11:17:24.582600+0000","last_clean":"2023-10-06T11:17:24.582600+0000","last_became_active":"2023-10-06T11:17:23.570950+0000","last_became_peered":"2023-10-06T11:17:23.570950+0000","last_unstale":"2023-10-06T11:17:24.582600+0000","last_undegraded":"2023-10-06T11:17:24.582600+0000","last_fullsized":"2023-10-06T11:17:24.582600+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:55:05.030229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.570073+0000","last_change":"2023-10-06T11:17:24.565604+0000","last_active":"2023-10-06T11:17:24.570073+0000","last_peered":"2023-10-06T11:17:24.570073+0000","last_clean":"2023-10-06T11:17:24.570073+0000","last_became_active":"2023-10-06T11:17:24.565350+0000","last_became_peered":"2023-10-06T11:17:24.565350+0000","last_unstale":"2023-10-06T11:17:24.570073+0000","last_undegraded":"2023-10-06T11:17:24.570073+0000","last_fullsized":"2023-10-06T11:17:24.570073+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:15:45.424139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.582384+0000","last_change":"2023-10-06T11:17:23.574166+0000","last_active":"2023-10-06T11:17:24.582384+0000","last_peered":"2023-10-06T11:17:24.582384+0000","last_clean":"2023-10-06T11:17:24.582384+0000","last_became_active":"2023-10-06T11:17:23.573890+0000","last_became_peered":"2023-10-06T11:17:23.573890+0000","last_unstale":"2023-10-06T11:17:24.582384+0000","last_undegraded":"2023-10-06T11:17:24.582384+0000","last_fullsized":"2023-10-06T11:17:24.582384+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:03:31.748977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.576106+0000","last_change":"2023-10-06T11:17:24.568162+0000","last_active":"2023-10-06T11:17:24.576106+0000","last_peered":"2023-10-06T11:17:24.576106+0000","last_clean":"2023-10-06T11:17:24.576106+0000","last_became_active":"2023-10-06T11:17:24.567852+0000","last_became_peered":"2023-10-06T11:17:24.567852+0000","last_unstale":"2023-10-06T11:17:24.576106+0000","last_undegraded":"2023-10-06T11:17:24.576106+0000","last_fullsized":"2023-10-06T11:17:24.576106+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:55.042996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.559880+0000","last_change":"2023-10-06T11:17:23.564753+0000","last_active":"2023-10-06T11:17:24.559880+0000","last_peered":"2023-10-06T11:17:24.559880+0000","last_clean":"2023-10-06T11:17:24.559880+0000","last_became_active":"2023-10-06T11:17:23.564344+0000","last_became_peered":"2023-10-06T11:17:23.564344+0000","last_unstale":"2023-10-06T11:17:24.559880+0000","last_undegraded":"2023-10-06T11:17:24.559880+0000","last_fullsized":"2023-10-06T11:17:24.559880+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:16:28.786528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.571431+0000","last_change":"2023-10-06T11:17:24.568900+0000","last_active":"2023-10-06T11:17:24.571431+0000","last_peered":"2023-10-06T11:17:24.571431+0000","last_clean":"2023-10-06T11:17:24.571431+0000","last_became_active":"2023-10-06T11:17:24.568618+0000","last_became_peered":"2023-10-06T11:17:24.568618+0000","last_unstale":"2023-10-06T11:17:24.571431+0000","last_undegraded":"2023-10-06T11:17:24.571431+0000","last_fullsized":"2023-10-06T11:17:24.571431+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:31:49.318112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.562967+0000","last_change":"2023-10-06T11:17:23.569866+0000","last_active":"2023-10-06T11:17:24.562967+0000","last_peered":"2023-10-06T11:17:24.562967+0000","last_clean":"2023-10-06T11:17:24.562967+0000","last_became_active":"2023-10-06T11:17:23.569610+0000","last_became_peered":"2023-10-06T11:17:23.569610+0000","last_unstale":"2023-10-06T11:17:24.562967+0000","last_undegraded":"2023-10-06T11:17:24.562967+0000","last_fullsized":"2023-10-06T11:17:24.562967+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:48:47.471367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.571421+0000","last_change":"2023-10-06T11:17:24.567485+0000","last_active":"2023-10-06T11:17:24.571421+0000","last_peered":"2023-10-06T11:17:24.571421+0000","last_clean":"2023-10-06T11:17:24.571421+0000","last_became_active":"2023-10-06T11:17:24.567206+0000","last_became_peered":"2023-10-06T11:17:24.567206+0000","last_unstale":"2023-10-06T11:17:24.571421+0000","last_undegraded":"2023-10-06T11:17:24.571421+0000","last_fullsized":"2023-10-06T11:17:24.571421+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:11:12.692922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.584220+0000","last_change":"2023-10-06T11:17:23.570528+0000","last_active":"2023-10-06T11:17:24.584220+0000","last_peered":"2023-10-06T11:17:24.584220+0000","last_clean":"2023-10-06T11:17:24.584220+0000","last_became_active":"2023-10-06T11:17:23.569805+0000","last_became_peered":"2023-10-06T11:17:23.569805+0000","last_unstale":"2023-10-06T11:17:24.584220+0000","last_undegraded":"2023-10-06T11:17:24.584220+0000","last_fullsized":"2023-10-06T11:17:24.584220+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:47.786408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.573731+0000","last_change":"2023-10-06T11:17:24.572752+0000","last_active":"2023-10-06T11:17:24.573731+0000","last_peered":"2023-10-06T11:17:24.573731+0000","last_clean":"2023-10-06T11:17:24.573731+0000","last_became_active":"2023-10-06T11:17:24.572505+0000","last_became_peered":"2023-10-06T11:17:24.572505+0000","last_unstale":"2023-10-06T11:17:24.573731+0000","last_undegraded":"2023-10-06T11:17:24.573731+0000","last_fullsized":"2023-10-06T11:17:24.573731+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:56:46.796339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.582411+0000","last_change":"2023-10-06T11:17:23.569885+0000","last_active":"2023-10-06T11:17:24.582411+0000","last_peered":"2023-10-06T11:17:24.582411+0000","last_clean":"2023-10-06T11:17:24.582411+0000","last_became_active":"2023-10-06T11:17:23.569403+0000","last_became_peered":"2023-10-06T11:17:23.569403+0000","last_unstale":"2023-10-06T11:17:24.582411+0000","last_undegraded":"2023-10-06T11:17:24.582411+0000","last_fullsized":"2023-10-06T11:17:24.582411+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:58:24.567254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.566193+0000","last_change":"2023-10-06T11:17:24.560745+0000","last_active":"2023-10-06T11:17:24.566193+0000","last_peered":"2023-10-06T11:17:24.566193+0000","last_clean":"2023-10-06T11:17:24.566193+0000","last_became_active":"2023-10-06T11:17:24.560494+0000","last_became_peered":"2023-10-06T11:17:24.560494+0000","last_unstale":"2023-10-06T11:17:24.566193+0000","last_undegraded":"2023-10-06T11:17:24.566193+0000","last_fullsized":"2023-10-06T11:17:24.566193+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:36:51.480975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.584634+0000","last_change":"2023-10-06T11:17:23.567691+0000","last_active":"2023-10-06T11:17:24.584634+0000","last_peered":"2023-10-06T11:17:24.584634+0000","last_clean":"2023-10-06T11:17:24.584634+0000","last_became_active":"2023-10-06T11:17:23.567421+0000","last_became_peered":"2023-10-06T11:17:23.567421+0000","last_unstale":"2023-10-06T11:17:24.584634+0000","last_undegraded":"2023-10-06T11:17:24.584634+0000","last_fullsized":"2023-10-06T11:17:24.584634+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:04:18.984996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.570793+0000","last_change":"2023-10-06T11:17:24.568416+0000","last_active":"2023-10-06T11:17:24.570793+0000","last_peered":"2023-10-06T11:17:24.570793+0000","last_clean":"2023-10-06T11:17:24.570793+0000","last_became_active":"2023-10-06T11:17:24.568134+0000","last_became_peered":"2023-10-06T11:17:24.568134+0000","last_unstale":"2023-10-06T11:17:24.570793+0000","last_undegraded":"2023-10-06T11:17:24.570793+0000","last_fullsized":"2023-10-06T11:17:24.570793+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:09.705291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.563087+0000","last_change":"2023-10-06T11:17:23.565748+0000","last_active":"2023-10-06T11:17:24.563087+0000","last_peered":"2023-10-06T11:17:24.563087+0000","last_clean":"2023-10-06T11:17:24.563087+0000","last_became_active":"2023-10-06T11:17:23.565303+0000","last_became_peered":"2023-10-06T11:17:23.565303+0000","last_unstale":"2023-10-06T11:17:24.563087+0000","last_undegraded":"2023-10-06T11:17:24.563087+0000","last_fullsized":"2023-10-06T11:17:24.563087+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:22:25.530859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.565528+0000","last_change":"2023-10-06T11:17:24.563167+0000","last_active":"2023-10-06T11:17:24.565528+0000","last_peered":"2023-10-06T11:17:24.565528+0000","last_clean":"2023-10-06T11:17:24.565528+0000","last_became_active":"2023-10-06T11:17:24.562916+0000","last_became_peered":"2023-10-06T11:17:24.562916+0000","last_unstale":"2023-10-06T11:17:24.565528+0000","last_undegraded":"2023-10-06T11:17:24.565528+0000","last_fullsized":"2023-10-06T11:17:24.565528+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:07.151312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.582310+0000","last_change":"2023-10-06T11:17:23.564393+0000","last_active":"2023-10-06T11:17:24.582310+0000","last_peered":"2023-10-06T11:17:24.582310+0000","last_clean":"2023-10-06T11:17:24.582310+0000","last_became_active":"2023-10-06T11:17:23.564170+0000","last_became_peered":"2023-10-06T11:17:23.564170+0000","last_unstale":"2023-10-06T11:17:24.582310+0000","last_undegraded":"2023-10-06T11:17:24.582310+0000","last_fullsized":"2023-10-06T11:17:24.582310+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:06:26.401026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.576850+0000","last_change":"2023-10-06T11:17:24.573793+0000","last_active":"2023-10-06T11:17:24.576850+0000","last_peered":"2023-10-06T11:17:24.576850+0000","last_clean":"2023-10-06T11:17:24.576850+0000","last_became_active":"2023-10-06T11:17:24.572324+0000","last_became_peered":"2023-10-06T11:17:24.572324+0000","last_unstale":"2023-10-06T11:17:24.576850+0000","last_undegraded":"2023-10-06T11:17:24.576850+0000","last_fullsized":"2023-10-06T11:17:24.576850+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:46:42.885085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.557151+0000","last_change":"2023-10-06T11:17:23.574712+0000","last_active":"2023-10-06T11:17:24.557151+0000","last_peered":"2023-10-06T11:17:24.557151+0000","last_clean":"2023-10-06T11:17:24.557151+0000","last_became_active":"2023-10-06T11:17:23.574435+0000","last_became_peered":"2023-10-06T11:17:23.574435+0000","last_unstale":"2023-10-06T11:17:24.557151+0000","last_undegraded":"2023-10-06T11:17:24.557151+0000","last_fullsized":"2023-10-06T11:17:24.557151+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:22:25.530859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.576306+0000","last_change":"2023-10-06T11:17:24.571701+0000","last_active":"2023-10-06T11:17:24.576306+0000","last_peered":"2023-10-06T11:17:24.576306+0000","last_clean":"2023-10-06T11:17:24.576306+0000","last_became_active":"2023-10-06T11:17:24.571457+0000","last_became_peered":"2023-10-06T11:17:24.571457+0000","last_unstale":"2023-10-06T11:17:24.576306+0000","last_undegraded":"2023-10-06T11:17:24.576306+0000","last_fullsized":"2023-10-06T11:17:24.576306+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:45:28.551838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.559974+0000","last_change":"2023-10-06T11:17:23.564865+0000","last_active":"2023-10-06T11:17:24.559974+0000","last_peered":"2023-10-06T11:17:24.559974+0000","last_clean":"2023-10-06T11:17:24.559974+0000","last_became_active":"2023-10-06T11:17:23.564694+0000","last_became_peered":"2023-10-06T11:17:23.564694+0000","last_unstale":"2023-10-06T11:17:24.559974+0000","last_undegraded":"2023-10-06T11:17:24.559974+0000","last_fullsized":"2023-10-06T11:17:24.559974+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:11.629965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.576583+0000","last_change":"2023-10-06T11:17:24.575646+0000","last_active":"2023-10-06T11:17:24.576583+0000","last_peered":"2023-10-06T11:17:24.576583+0000","last_clean":"2023-10-06T11:17:24.576583+0000","last_became_active":"2023-10-06T11:17:24.570344+0000","last_became_peered":"2023-10-06T11:17:24.570344+0000","last_unstale":"2023-10-06T11:17:24.576583+0000","last_undegraded":"2023-10-06T11:17:24.576583+0000","last_fullsized":"2023-10-06T11:17:24.576583+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:38.610243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.566184+0000","last_change":"2023-10-06T11:17:23.574083+0000","last_active":"2023-10-06T11:17:24.566184+0000","last_peered":"2023-10-06T11:17:24.566184+0000","last_clean":"2023-10-06T11:17:24.566184+0000","last_became_active":"2023-10-06T11:17:23.573768+0000","last_became_peered":"2023-10-06T11:17:23.573768+0000","last_unstale":"2023-10-06T11:17:24.566184+0000","last_undegraded":"2023-10-06T11:17:24.566184+0000","last_fullsized":"2023-10-06T11:17:24.566184+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:32:36.073066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.570609+0000","last_change":"2023-10-06T11:17:24.567062+0000","last_active":"2023-10-06T11:17:24.570609+0000","last_peered":"2023-10-06T11:17:24.570609+0000","last_clean":"2023-10-06T11:17:24.570609+0000","last_became_active":"2023-10-06T11:17:24.566801+0000","last_became_peered":"2023-10-06T11:17:24.566801+0000","last_unstale":"2023-10-06T11:17:24.570609+0000","last_undegraded":"2023-10-06T11:17:24.570609+0000","last_fullsized":"2023-10-06T11:17:24.570609+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:31:49.318112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.584283+0000","last_change":"2023-10-06T11:17:23.564402+0000","last_active":"2023-10-06T11:17:24.584283+0000","last_peered":"2023-10-06T11:17:24.584283+0000","last_clean":"2023-10-06T11:17:24.584283+0000","last_became_active":"2023-10-06T11:17:23.564113+0000","last_became_peered":"2023-10-06T11:17:23.564113+0000","last_unstale":"2023-10-06T11:17:24.584283+0000","last_undegraded":"2023-10-06T11:17:24.584283+0000","last_fullsized":"2023-10-06T11:17:24.584283+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:53:59.261371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575789+0000","last_change":"2023-10-06T11:17:24.570147+0000","last_active":"2023-10-06T11:17:24.575789+0000","last_peered":"2023-10-06T11:17:24.575789+0000","last_clean":"2023-10-06T11:17:24.575789+0000","last_became_active":"2023-10-06T11:17:24.569601+0000","last_became_peered":"2023-10-06T11:17:24.569601+0000","last_unstale":"2023-10-06T11:17:24.575789+0000","last_undegraded":"2023-10-06T11:17:24.575789+0000","last_fullsized":"2023-10-06T11:17:24.575789+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:22:20.066646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.555158+0000","last_change":"2023-10-06T11:17:23.570514+0000","last_active":"2023-10-06T11:17:24.555158+0000","last_peered":"2023-10-06T11:17:24.555158+0000","last_clean":"2023-10-06T11:17:24.555158+0000","last_became_active":"2023-10-06T11:17:23.570179+0000","last_became_peered":"2023-10-06T11:17:23.570179+0000","last_unstale":"2023-10-06T11:17:24.555158+0000","last_undegraded":"2023-10-06T11:17:24.555158+0000","last_fullsized":"2023-10-06T11:17:24.555158+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:08:06.688065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575970+0000","last_change":"2023-10-06T11:17:24.566933+0000","last_active":"2023-10-06T11:17:24.575970+0000","last_peered":"2023-10-06T11:17:24.575970+0000","last_clean":"2023-10-06T11:17:24.575970+0000","last_became_active":"2023-10-06T11:17:24.566764+0000","last_became_peered":"2023-10-06T11:17:24.566764+0000","last_unstale":"2023-10-06T11:17:24.575970+0000","last_undegraded":"2023-10-06T11:17:24.575970+0000","last_fullsized":"2023-10-06T11:17:24.575970+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:21:32.239463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.554770+0000","last_change":"2023-10-06T11:17:23.571952+0000","last_active":"2023-10-06T11:17:24.554770+0000","last_peered":"2023-10-06T11:17:24.554770+0000","last_clean":"2023-10-06T11:17:24.554770+0000","last_became_active":"2023-10-06T11:17:23.565102+0000","last_became_peered":"2023-10-06T11:17:23.565102+0000","last_unstale":"2023-10-06T11:17:24.554770+0000","last_undegraded":"2023-10-06T11:17:24.554770+0000","last_fullsized":"2023-10-06T11:17:24.554770+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:11:11.687267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.572885+0000","last_change":"2023-10-06T11:17:24.569341+0000","last_active":"2023-10-06T11:17:24.572885+0000","last_peered":"2023-10-06T11:17:24.572885+0000","last_clean":"2023-10-06T11:17:24.572885+0000","last_became_active":"2023-10-06T11:17:24.569094+0000","last_became_peered":"2023-10-06T11:17:24.569094+0000","last_unstale":"2023-10-06T11:17:24.572885+0000","last_undegraded":"2023-10-06T11:17:24.572885+0000","last_fullsized":"2023-10-06T11:17:24.572885+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:15:52.609098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.560119+0000","last_change":"2023-10-06T11:17:23.569219+0000","last_active":"2023-10-06T11:17:24.560119+0000","last_peered":"2023-10-06T11:17:24.560119+0000","last_clean":"2023-10-06T11:17:24.560119+0000","last_became_active":"2023-10-06T11:17:23.568946+0000","last_became_peered":"2023-10-06T11:17:23.568946+0000","last_unstale":"2023-10-06T11:17:24.560119+0000","last_undegraded":"2023-10-06T11:17:24.560119+0000","last_fullsized":"2023-10-06T11:17:24.560119+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:12:28.041975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.571902+0000","last_change":"2023-10-06T11:17:24.569808+0000","last_active":"2023-10-06T11:17:24.571902+0000","last_peered":"2023-10-06T11:17:24.571902+0000","last_clean":"2023-10-06T11:17:24.571902+0000","last_became_active":"2023-10-06T11:17:24.569380+0000","last_became_peered":"2023-10-06T11:17:24.569380+0000","last_unstale":"2023-10-06T11:17:24.571902+0000","last_undegraded":"2023-10-06T11:17:24.571902+0000","last_fullsized":"2023-10-06T11:17:24.571902+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:18.748550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.558165+0000","last_change":"2023-10-06T11:17:23.564135+0000","last_active":"2023-10-06T11:17:24.558165+0000","last_peered":"2023-10-06T11:17:24.558165+0000","last_clean":"2023-10-06T11:17:24.558165+0000","last_became_active":"2023-10-06T11:17:23.563797+0000","last_became_peered":"2023-10-06T11:17:23.563797+0000","last_unstale":"2023-10-06T11:17:24.558165+0000","last_undegraded":"2023-10-06T11:17:24.558165+0000","last_fullsized":"2023-10-06T11:17:24.558165+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:09.701424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.579474+0000","last_change":"2023-10-06T11:17:24.577355+0000","last_active":"2023-10-06T11:17:24.579474+0000","last_peered":"2023-10-06T11:17:24.579474+0000","last_clean":"2023-10-06T11:17:24.579474+0000","last_became_active":"2023-10-06T11:17:24.577095+0000","last_became_peered":"2023-10-06T11:17:24.577095+0000","last_unstale":"2023-10-06T11:17:24.579474+0000","last_undegraded":"2023-10-06T11:17:24.579474+0000","last_fullsized":"2023-10-06T11:17:24.579474+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:15:11.263158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.554819+0000","last_change":"2023-10-06T11:17:23.562075+0000","last_active":"2023-10-06T11:17:24.554819+0000","last_peered":"2023-10-06T11:17:24.554819+0000","last_clean":"2023-10-06T11:17:24.554819+0000","last_became_active":"2023-10-06T11:17:23.561792+0000","last_became_peered":"2023-10-06T11:17:23.561792+0000","last_unstale":"2023-10-06T11:17:24.554819+0000","last_undegraded":"2023-10-06T11:17:24.554819+0000","last_fullsized":"2023-10-06T11:17:24.554819+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:08.699637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.567434+0000","last_change":"2023-10-06T11:17:24.560966+0000","last_active":"2023-10-06T11:17:24.567434+0000","last_peered":"2023-10-06T11:17:24.567434+0000","last_clean":"2023-10-06T11:17:24.567434+0000","last_became_active":"2023-10-06T11:17:24.560664+0000","last_became_peered":"2023-10-06T11:17:24.560664+0000","last_unstale":"2023-10-06T11:17:24.567434+0000","last_undegraded":"2023-10-06T11:17:24.567434+0000","last_fullsized":"2023-10-06T11:17:24.567434+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:41:38.833103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.558951+0000","last_change":"2023-10-06T11:17:23.567100+0000","last_active":"2023-10-06T11:17:24.558951+0000","last_peered":"2023-10-06T11:17:24.558951+0000","last_clean":"2023-10-06T11:17:24.558951+0000","last_became_active":"2023-10-06T11:17:23.566811+0000","last_became_peered":"2023-10-06T11:17:23.566811+0000","last_unstale":"2023-10-06T11:17:24.558951+0000","last_undegraded":"2023-10-06T11:17:24.558951+0000","last_fullsized":"2023-10-06T11:17:24.558951+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:11:04.566108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575944+0000","last_change":"2023-10-06T11:17:24.567836+0000","last_active":"2023-10-06T11:17:24.575944+0000","last_peered":"2023-10-06T11:17:24.575944+0000","last_clean":"2023-10-06T11:17:24.575944+0000","last_became_active":"2023-10-06T11:17:24.567579+0000","last_became_peered":"2023-10-06T11:17:24.567579+0000","last_unstale":"2023-10-06T11:17:24.575944+0000","last_undegraded":"2023-10-06T11:17:24.575944+0000","last_fullsized":"2023-10-06T11:17:24.575944+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:02:58.843409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.558726+0000","last_change":"2023-10-06T11:17:23.569068+0000","last_active":"2023-10-06T11:17:24.558726+0000","last_peered":"2023-10-06T11:17:24.558726+0000","last_clean":"2023-10-06T11:17:24.558726+0000","last_became_active":"2023-10-06T11:17:23.568821+0000","last_became_peered":"2023-10-06T11:17:23.568821+0000","last_unstale":"2023-10-06T11:17:24.558726+0000","last_undegraded":"2023-10-06T11:17:24.558726+0000","last_fullsized":"2023-10-06T11:17:24.558726+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:08:53.820378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.573345+0000","last_change":"2023-10-06T11:17:24.571813+0000","last_active":"2023-10-06T11:17:24.573345+0000","last_peered":"2023-10-06T11:17:24.573345+0000","last_clean":"2023-10-06T11:17:24.573345+0000","last_became_active":"2023-10-06T11:17:24.571369+0000","last_became_peered":"2023-10-06T11:17:24.571369+0000","last_unstale":"2023-10-06T11:17:24.573345+0000","last_undegraded":"2023-10-06T11:17:24.573345+0000","last_fullsized":"2023-10-06T11:17:24.573345+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:42:22.093331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.587184+0000","last_change":"2023-10-06T11:17:23.567296+0000","last_active":"2023-10-06T11:17:24.587184+0000","last_peered":"2023-10-06T11:17:24.587184+0000","last_clean":"2023-10-06T11:17:24.587184+0000","last_became_active":"2023-10-06T11:17:23.566993+0000","last_became_peered":"2023-10-06T11:17:23.566993+0000","last_unstale":"2023-10-06T11:17:24.587184+0000","last_undegraded":"2023-10-06T11:17:24.587184+0000","last_fullsized":"2023-10-06T11:17:24.587184+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:06.145658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":131,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.557891+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:17:24.557891+0000","last_peered":"2023-10-06T11:17:24.557891+0000","last_clean":"2023-10-06T11:17:24.557891+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:17:24.557891+0000","last_undegraded":"2023-10-06T11:17:24.557891+0000","last_fullsized":"2023-10-06T11:17:24.557891+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575891+0000","last_change":"2023-10-06T11:17:24.570948+0000","last_active":"2023-10-06T11:17:24.575891+0000","last_peered":"2023-10-06T11:17:24.575891+0000","last_clean":"2023-10-06T11:17:24.575891+0000","last_became_active":"2023-10-06T11:17:24.570719+0000","last_became_peered":"2023-10-06T11:17:24.570719+0000","last_unstale":"2023-10-06T11:17:24.575891+0000","last_undegraded":"2023-10-06T11:17:24.575891+0000","last_fullsized":"2023-10-06T11:17:24.575891+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:56:17.624615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.554724+0000","last_change":"2023-10-06T11:17:23.564126+0000","last_active":"2023-10-06T11:17:24.554724+0000","last_peered":"2023-10-06T11:17:24.554724+0000","last_clean":"2023-10-06T11:17:24.554724+0000","last_became_active":"2023-10-06T11:17:23.563881+0000","last_became_peered":"2023-10-06T11:17:23.563881+0000","last_unstale":"2023-10-06T11:17:24.554724+0000","last_undegraded":"2023-10-06T11:17:24.554724+0000","last_fullsized":"2023-10-06T11:17:24.554724+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:55.946021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":124,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.555311+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:17:24.555311+0000","last_peered":"2023-10-06T11:17:24.555311+0000","last_clean":"2023-10-06T11:17:24.555311+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:17:24.555311+0000","last_undegraded":"2023-10-06T11:17:24.555311+0000","last_fullsized":"2023-10-06T11:17:24.555311+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.580493+0000","last_change":"2023-10-06T11:17:24.569576+0000","last_active":"2023-10-06T11:17:24.580493+0000","last_peered":"2023-10-06T11:17:24.580493+0000","last_clean":"2023-10-06T11:17:24.580493+0000","last_became_active":"2023-10-06T11:17:24.569315+0000","last_became_peered":"2023-10-06T11:17:24.569315+0000","last_unstale":"2023-10-06T11:17:24.580493+0000","last_undegraded":"2023-10-06T11:17:24.580493+0000","last_fullsized":"2023-10-06T11:17:24.580493+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:23.035153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"150'3","reported_seq":13,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.584410+0000","last_change":"2023-10-06T11:17:23.564149+0000","last_active":"2023-10-06T11:17:24.584410+0000","last_peered":"2023-10-06T11:17:24.584410+0000","last_clean":"2023-10-06T11:17:24.584410+0000","last_became_active":"2023-10-06T11:17:23.563857+0000","last_became_peered":"2023-10-06T11:17:23.563857+0000","last_unstale":"2023-10-06T11:17:24.584410+0000","last_undegraded":"2023-10-06T11:17:24.584410+0000","last_fullsized":"2023-10-06T11:17:24.584410+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:55:05.030229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":122,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.562938+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:17:24.562938+0000","last_peered":"2023-10-06T11:17:24.562938+0000","last_clean":"2023-10-06T11:17:24.562938+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:17:24.562938+0000","last_undegraded":"2023-10-06T11:17:24.562938+0000","last_fullsized":"2023-10-06T11:17:24.562938+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":267,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.566276+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:17:24.566276+0000","last_peered":"2023-10-06T11:17:24.566276+0000","last_clean":"2023-10-06T11:17:24.566276+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:17:24.566276+0000","last_undegraded":"2023-10-06T11:17:24.566276+0000","last_fullsized":"2023-10-06T11:17:24.566276+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575929+0000","last_change":"2023-10-06T11:17:24.567759+0000","last_active":"2023-10-06T11:17:24.575929+0000","last_peered":"2023-10-06T11:17:24.575929+0000","last_clean":"2023-10-06T11:17:24.575929+0000","last_became_active":"2023-10-06T11:17:24.567496+0000","last_became_peered":"2023-10-06T11:17:24.567496+0000","last_unstale":"2023-10-06T11:17:24.575929+0000","last_undegraded":"2023-10-06T11:17:24.575929+0000","last_fullsized":"2023-10-06T11:17:24.575929+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:25:25.920939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"150'6","reported_seq":16,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.586312+0000","last_change":"2023-10-06T11:17:23.570090+0000","last_active":"2023-10-06T11:17:24.586312+0000","last_peered":"2023-10-06T11:17:24.586312+0000","last_clean":"2023-10-06T11:17:24.586312+0000","last_became_active":"2023-10-06T11:17:23.569829+0000","last_became_peered":"2023-10-06T11:17:23.569829+0000","last_unstale":"2023-10-06T11:17:24.586312+0000","last_undegraded":"2023-10-06T11:17:24.586312+0000","last_fullsized":"2023-10-06T11:17:24.586312+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:15:10.257503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":117,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.563929+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:17:24.563929+0000","last_peered":"2023-10-06T11:17:24.563929+0000","last_clean":"2023-10-06T11:17:24.563929+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:17:24.563929+0000","last_undegraded":"2023-10-06T11:17:24.563929+0000","last_fullsized":"2023-10-06T11:17:24.563929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.579240+0000","last_change":"2023-10-06T11:17:24.575811+0000","last_active":"2023-10-06T11:17:24.579240+0000","last_peered":"2023-10-06T11:17:24.579240+0000","last_clean":"2023-10-06T11:17:24.579240+0000","last_became_active":"2023-10-06T11:17:24.570303+0000","last_became_peered":"2023-10-06T11:17:24.570303+0000","last_unstale":"2023-10-06T11:17:24.579240+0000","last_undegraded":"2023-10-06T11:17:24.579240+0000","last_fullsized":"2023-10-06T11:17:24.579240+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:59:56.385931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.555042+0000","last_change":"2023-10-06T11:17:23.570382+0000","last_active":"2023-10-06T11:17:24.555042+0000","last_peered":"2023-10-06T11:17:24.555042+0000","last_clean":"2023-10-06T11:17:24.555042+0000","last_became_active":"2023-10-06T11:17:23.569847+0000","last_became_peered":"2023-10-06T11:17:23.569847+0000","last_unstale":"2023-10-06T11:17:24.555042+0000","last_undegraded":"2023-10-06T11:17:24.555042+0000","last_fullsized":"2023-10-06T11:17:24.555042+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:15:11.795033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":117,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.566358+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:17:24.566358+0000","last_peered":"2023-10-06T11:17:24.566358+0000","last_clean":"2023-10-06T11:17:24.566358+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:17:24.566358+0000","last_undegraded":"2023-10-06T11:17:24.566358+0000","last_fullsized":"2023-10-06T11:17:24.566358+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.579416+0000","last_change":"2023-10-06T11:17:24.576816+0000","last_active":"2023-10-06T11:17:24.579416+0000","last_peered":"2023-10-06T11:17:24.579416+0000","last_clean":"2023-10-06T11:17:24.579416+0000","last_became_active":"2023-10-06T11:17:24.576459+0000","last_became_peered":"2023-10-06T11:17:24.576459+0000","last_unstale":"2023-10-06T11:17:24.579416+0000","last_undegraded":"2023-10-06T11:17:24.579416+0000","last_fullsized":"2023-10-06T11:17:24.579416+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:15:12.800687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.555532+0000","last_change":"2023-10-06T11:17:23.570674+0000","last_active":"2023-10-06T11:17:24.555532+0000","last_peered":"2023-10-06T11:17:24.555532+0000","last_clean":"2023-10-06T11:17:24.555532+0000","last_became_active":"2023-10-06T11:17:23.570308+0000","last_became_peered":"2023-10-06T11:17:23.570308+0000","last_unstale":"2023-10-06T11:17:24.555532+0000","last_undegraded":"2023-10-06T11:17:24.555532+0000","last_fullsized":"2023-10-06T11:17:24.555532+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:59:55.380277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":140,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.559017+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:17:24.559017+0000","last_peered":"2023-10-06T11:17:24.559017+0000","last_clean":"2023-10-06T11:17:24.559017+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:17:24.559017+0000","last_undegraded":"2023-10-06T11:17:24.559017+0000","last_fullsized":"2023-10-06T11:17:24.559017+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575922+0000","last_change":"2023-10-06T11:17:24.566665+0000","last_active":"2023-10-06T11:17:24.575922+0000","last_peered":"2023-10-06T11:17:24.575922+0000","last_clean":"2023-10-06T11:17:24.575922+0000","last_became_active":"2023-10-06T11:17:24.566426+0000","last_became_peered":"2023-10-06T11:17:24.566426+0000","last_unstale":"2023-10-06T11:17:24.575922+0000","last_undegraded":"2023-10-06T11:17:24.575922+0000","last_fullsized":"2023-10-06T11:17:24.575922+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:29:19.469513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"150'8","reported_seq":18,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.587514+0000","last_change":"2023-10-06T11:17:23.568131+0000","last_active":"2023-10-06T11:17:24.587514+0000","last_peered":"2023-10-06T11:17:24.587514+0000","last_clean":"2023-10-06T11:17:24.587514+0000","last_became_active":"2023-10-06T11:17:23.567954+0000","last_became_peered":"2023-10-06T11:17:23.567954+0000","last_unstale":"2023-10-06T11:17:24.587514+0000","last_undegraded":"2023-10-06T11:17:24.587514+0000","last_fullsized":"2023-10-06T11:17:24.587514+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:45.678850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":124,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.566824+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:17:24.566824+0000","last_peered":"2023-10-06T11:17:24.566824+0000","last_clean":"2023-10-06T11:17:24.566824+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:17:24.566824+0000","last_undegraded":"2023-10-06T11:17:24.566824+0000","last_fullsized":"2023-10-06T11:17:24.566824+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.570686+0000","last_change":"2023-10-06T11:17:24.567445+0000","last_active":"2023-10-06T11:17:24.570686+0000","last_peered":"2023-10-06T11:17:24.570686+0000","last_clean":"2023-10-06T11:17:24.570686+0000","last_became_active":"2023-10-06T11:17:24.567192+0000","last_became_peered":"2023-10-06T11:17:24.567192+0000","last_unstale":"2023-10-06T11:17:24.570686+0000","last_undegraded":"2023-10-06T11:17:24.570686+0000","last_fullsized":"2023-10-06T11:17:24.570686+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:20.201597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.558847+0000","last_change":"2023-10-06T11:17:23.565830+0000","last_active":"2023-10-06T11:17:24.558847+0000","last_peered":"2023-10-06T11:17:24.558847+0000","last_clean":"2023-10-06T11:17:24.558847+0000","last_became_active":"2023-10-06T11:17:23.565544+0000","last_became_peered":"2023-10-06T11:17:23.565544+0000","last_unstale":"2023-10-06T11:17:24.558847+0000","last_undegraded":"2023-10-06T11:17:24.558847+0000","last_fullsized":"2023-10-06T11:17:24.558847+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:45.678850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":124,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.566899+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:17:24.566899+0000","last_peered":"2023-10-06T11:17:24.566899+0000","last_clean":"2023-10-06T11:17:24.566899+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:17:24.566899+0000","last_undegraded":"2023-10-06T11:17:24.566899+0000","last_fullsized":"2023-10-06T11:17:24.566899+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574993,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303816,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068024,"statfs":{"total":96636764160,"available":96325656576,"internally_reserved":0,"allocated":2490368,"data_stored":1465114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.54300000000000004,"15min":0.626},"min":{"1min":0.35699999999999998,"5min":0.252,"15min":0.21199999999999999},"max":{"1min":0.71699999999999997,"5min":4.407,"15min":23.908999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.51400000000000001,"15min":0.57499999999999996},"min":{"1min":0.33200000000000002,"5min":0.26900000000000002,"15min":0.22500000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":9.3230000000000004},"last":0.628}]},{"osd":1,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53700000000000003,"15min":0.56000000000000005},"min":{"1min":0.28799999999999998,"5min":0.28399999999999997,"15min":0.26000000000000001},"max":{"1min":0.77700000000000002,"5min":2.4689999999999999,"15min":9.2360000000000007},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.502,"15min":0.504},"min":{"1min":0.40999999999999998,"5min":0.33100000000000002,"15min":0.25900000000000001},"max":{"1min":0.70899999999999996,"5min":0.78900000000000003,"15min":4.327},"last":0.499}]},{"osd":2,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56899999999999995,"15min":0.51900000000000002},"min":{"1min":0.40100000000000002,"5min":0.33000000000000002,"15min":0.26500000000000001},"max":{"1min":0.69999999999999996,"5min":4.3120000000000003,"15min":4.3120000000000003},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55900000000000005,"15min":0.55600000000000005},"min":{"1min":0.372,"5min":0.31,"15min":0.29999999999999999},"max":{"1min":0.74099999999999999,"5min":3.0600000000000001,"15min":4.7309999999999999},"last":0.56699999999999995}]},{"osd":3,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.56899999999999995,"15min":0.54100000000000004},"min":{"1min":0.35299999999999998,"5min":0.32600000000000001,"15min":0.27900000000000003},"max":{"1min":0.72299999999999998,"5min":4.5190000000000001,"15min":4.5190000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.59499999999999997,"15min":0.59999999999999998},"min":{"1min":0.42799999999999999,"5min":0.36599999999999999,"15min":0.29699999999999999},"max":{"1min":0.76200000000000001,"5min":3.0070000000000001,"15min":9.3879999999999999},"last":0.60099999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.53400000000000003,"15min":0.49299999999999999},"min":{"1min":0.32000000000000001,"5min":0.29799999999999999,"15min":0.24399999999999999},"max":{"1min":0.69199999999999995,"5min":4.6639999999999997,"15min":4.6639999999999997},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.57299999999999995,"15min":0.53600000000000003},"min":{"1min":0.35399999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.70899999999999996,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":0.45600000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.56000000000000005},"min":{"1min":0.39200000000000002,"5min":0.32900000000000001,"15min":0.26000000000000001},"max":{"1min":0.66100000000000003,"5min":0.77000000000000002,"15min":9.3499999999999996},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.53100000000000003,"15min":0.54200000000000004},"min":{"1min":0.377,"5min":0.30099999999999999,"15min":0.26800000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":4.444},"last":0.54300000000000004}]},{"osd":6,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57099999999999995,"15min":0.59699999999999998},"min":{"1min":0.41399999999999998,"5min":0.38100000000000001,"15min":0.29199999999999998},"max":{"1min":0.73699999999999999,"5min":0.82099999999999995,"15min":9.4969999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.64000000000000001,"15min":0.62},"min":{"1min":0.44,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.75600000000000001,"5min":4.4669999999999996,"15min":7.2039999999999997},"last":0.51700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574995,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299136,"kb_used_data":1848,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072704,"statfs":{"total":96636764160,"available":96330448896,"internally_reserved":0,"allocated":1892352,"data_stored":873393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.60199999999999998,"15min":0.52400000000000002},"min":{"1min":0.35199999999999998,"5min":0.247,"15min":0.187},"max":{"1min":0.80500000000000005,"5min":9.5549999999999997,"15min":9.5549999999999997},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.65600000000000003,"15min":0.56699999999999995},"min":{"1min":0.44400000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.78400000000000003,"5min":9.4659999999999993,"15min":9.4659999999999993},"last":0.57099999999999995}]},{"osd":1,"last update":"Fri Oct 6 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.49299999999999999,"15min":0.48399999999999999},"min":{"1min":0.33500000000000002,"5min":0.26800000000000002,"15min":0.23300000000000001},"max":{"1min":0.74299999999999999,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.57699999999999996,"15min":0.51600000000000001},"min":{"1min":0.34399999999999997,"5min":0.216,"15min":0.216},"max":{"1min":0.71399999999999997,"5min":5.2670000000000003,"15min":5.2670000000000003},"last":0.45300000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.5,"15min":0.503},"min":{"1min":0.33700000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.77100000000000002,"5min":0.93200000000000005,"15min":7.0659999999999998},"last":0.371},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.51300000000000001,"15min":0.51900000000000002},"min":{"1min":0.41199999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.69199999999999995,"5min":1.0069999999999999,"15min":7.0819999999999999},"last":0.48799999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.56000000000000005,"15min":0.52000000000000002},"min":{"1min":0.39700000000000002,"5min":0.317,"15min":0.25800000000000001},"max":{"1min":0.75700000000000001,"5min":3.871,"15min":3.871},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.54000000000000004,"15min":0.53200000000000003},"min":{"1min":0.43099999999999999,"5min":0.32100000000000001,"15min":0.312},"max":{"1min":0.72799999999999998,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.47299999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.48099999999999998,"15min":0.47799999999999998},"min":{"1min":0.34899999999999998,"5min":0.26800000000000002,"15min":0.24299999999999999},"max":{"1min":0.68600000000000005,"5min":0.88,"15min":0.88},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53600000000000003,"15min":0.53300000000000003},"min":{"1min":0.378,"5min":0.29699999999999999,"15min":0.27900000000000003},"max":{"1min":0.71199999999999997,"5min":0.82399999999999995,"15min":1.0680000000000001},"last":0.61599999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52100000000000002,"15min":0.51700000000000002},"min":{"1min":0.38400000000000001,"5min":0.32000000000000001,"15min":0.28399999999999997},"max":{"1min":0.73399999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.627,"15min":0.57999999999999996},"min":{"1min":0.39500000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.745,"5min":7.1379999999999999,"15min":7.1379999999999999},"last":0.59699999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58599999999999997,"15min":0.56799999999999995},"min":{"1min":0.42499999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.748,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59099999999999997,"15min":0.58499999999999996},"min":{"1min":0.45800000000000002,"5min":0.36399999999999999,"15min":0.30199999999999999},"max":{"1min":0.82099999999999995,"5min":0.86899999999999999,"15min":0.88400000000000001},"last":0.58799999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574994,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312020,"kb_used_data":2444,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059820,"statfs":{"total":96636764160,"available":96317255680,"internally_reserved":0,"allocated":2502656,"data_stored":1466650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:59 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.47099999999999997,"15min":0.377},"min":{"1min":0.247,"5min":0.20499999999999999,"15min":0.186},"max":{"1min":0.49399999999999999,"5min":13.393000000000001,"15min":13.393000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.374,"5min":0.46899999999999997,"15min":0.38600000000000001},"min":{"1min":0.254,"5min":0.22500000000000001,"15min":0.19700000000000001},"max":{"1min":0.53900000000000003,"5min":11.462,"15min":11.462},"last":0.44600000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:16:59 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.41399999999999998,"15min":0.36099999999999999},"min":{"1min":0.25800000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.48099999999999998,"5min":8.0470000000000006,"15min":8.0470000000000006},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.44900000000000001,"15min":0.40799999999999997},"min":{"1min":0.32100000000000001,"5min":0.215,"15min":0.20999999999999999},"max":{"1min":0.58399999999999996,"5min":4.8630000000000004,"15min":4.8630000000000004},"last":0.50800000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:16:59 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46700000000000003,"15min":0.42599999999999999},"min":{"1min":0.28599999999999998,"5min":0.255,"15min":0.252},"max":{"1min":0.64800000000000002,"5min":4.8029999999999999,"15min":4.8029999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.435,"5min":0.45100000000000001,"15min":0.39700000000000002},"min":{"1min":0.29699999999999999,"5min":0.23400000000000001,"15min":0.217},"max":{"1min":0.749,"5min":5.8700000000000001,"15min":5.8700000000000001},"last":0.497}]},{"osd":4,"last update":"Fri Oct 6 11:16:59 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.54500000000000004,"15min":0.52500000000000002},"min":{"1min":0.39900000000000002,"5min":0.28299999999999997,"15min":0.28199999999999997},"max":{"1min":0.88400000000000001,"5min":1.264,"15min":1.264},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.625,"15min":0.57299999999999995},"min":{"1min":0.41199999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.89400000000000002,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.70999999999999996}]},{"osd":5,"last update":"Fri Oct 6 11:16:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.61299999999999999,"15min":0.57199999999999995},"min":{"1min":0.45600000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78600000000000003,"5min":3.4390000000000001,"15min":3.4390000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.68500000000000005,"15min":0.59299999999999997},"min":{"1min":0.42999999999999999,"5min":0.36799999999999999,"15min":0.29499999999999998},"max":{"1min":0.84499999999999997,"5min":9.3829999999999991,"15min":9.3829999999999991},"last":0.72299999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:16:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.64200000000000002,"15min":0.59299999999999997},"min":{"1min":0.42099999999999999,"5min":0.35999999999999999,"15min":0.315},"max":{"1min":0.83599999999999997,"5min":3.4750000000000001,"15min":3.4750000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.64000000000000001,"15min":0.60099999999999998},"min":{"1min":0.36599999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.872,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.76000000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:16:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66200000000000003,"15min":0.61499999999999999},"min":{"1min":0.46600000000000003,"5min":0.39800000000000002,"15min":0.38500000000000001},"max":{"1min":0.82999999999999996,"5min":4.7290000000000001,"15min":4.7290000000000001},"last":0.749},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.627,"15min":0.59599999999999997},"min":{"1min":0.48599999999999999,"5min":0.38900000000000001,"15min":0.374},"max":{"1min":0.81100000000000005,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.63700000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574993,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303240,"kb_used_data":1856,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068600,"statfs":{"total":96636764160,"available":96326246400,"internally_reserved":0,"allocated":1900544,"data_stored":873497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.34799999999999998,"15min":0.47099999999999997},"min":{"1min":0.248,"5min":0.20399999999999999,"15min":0.184},"max":{"1min":0.59599999999999997,"5min":0.64900000000000002,"15min":36.097999999999999},"last":0.436},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.371,"15min":0.38300000000000001},"min":{"1min":0.29899999999999999,"5min":0.22,"15min":0.182},"max":{"1min":0.497,"5min":0.92400000000000004,"15min":7.2990000000000004},"last":0.26400000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.37,"15min":0.503},"min":{"1min":0.223,"5min":0.223,"15min":0.217},"max":{"1min":0.49099999999999999,"5min":0.82599999999999996,"15min":36.07},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.39800000000000002,"15min":0.40999999999999998},"min":{"1min":0.26800000000000002,"5min":0.25600000000000001,"15min":0.219},"max":{"1min":0.57099999999999995,"5min":0.94899999999999995,"15min":6.7800000000000002},"last":0.41899999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.36899999999999999,"15min":0.39500000000000002},"min":{"1min":0.27500000000000002,"5min":0.255,"15min":0.223},"max":{"1min":0.53800000000000003,"5min":0.64100000000000001,"15min":8.4130000000000003},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.43099999999999999,"15min":0.56000000000000005},"min":{"1min":0.315,"5min":0.25800000000000001,"15min":0.249},"max":{"1min":0.59999999999999998,"5min":1.9079999999999999,"15min":35.959000000000003},"last":0.40600000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.57999999999999996,"15min":0.56699999999999995},"min":{"1min":0.39100000000000001,"5min":0.33800000000000002,"15min":0.29599999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":2.427},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.60199999999999998,"15min":0.73199999999999998},"min":{"1min":0.42899999999999999,"5min":0.374,"15min":0.29299999999999998},"max":{"1min":0.84999999999999998,"5min":0.94999999999999996,"15min":36.005000000000003},"last":0.82699999999999996}]},{"osd":5,"last update":"Fri Oct 6 11:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.58599999999999997,"15min":0.58499999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.32900000000000001},"max":{"1min":0.95299999999999996,"5min":0.999,"15min":6.6699999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58099999999999996,"15min":0.56000000000000005},"min":{"1min":0.41299999999999998,"5min":0.372,"15min":0.315},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":2.0600000000000001},"last":0.71399999999999997}]},{"osd":6,"last update":"Fri Oct 6 11:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.61299999999999999,"15min":0.73399999999999999},"min":{"1min":0.50600000000000001,"5min":0.39200000000000002,"15min":0.317},"max":{"1min":0.89600000000000002,"5min":0.98699999999999999,"15min":36.037999999999997},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.63100000000000001,"15min":0.64000000000000001},"min":{"1min":0.41299999999999998,"5min":0.40999999999999998,"15min":0.36399999999999999},"max":{"1min":0.89200000000000002,"5min":1.028,"15min":6.7110000000000003},"last":0.74099999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61499999999999999,"15min":0.624},"min":{"1min":0.432,"5min":0.40999999999999998,"15min":0.371},"max":{"1min":0.86599999999999999,"5min":1.054,"15min":6.742},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.58999999999999997,"15min":0.57399999999999995},"min":{"1min":0.42799999999999999,"5min":0.41399999999999998,"15min":0.34499999999999997},"max":{"1min":0.86699999999999999,"5min":0.96199999999999997,"15min":1.917},"last":0.628}]}]},{"osd":2,"up_from":13,"seq":55834574994,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299124,"kb_used_data":1836,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072716,"statfs":{"total":96636764160,"available":96330461184,"internally_reserved":0,"allocated":1880064,"data_stored":866752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":0.46700000000000003,"15min":0.36299999999999999},"min":{"1min":0.248,"5min":0.214,"15min":0.17999999999999999},"max":{"1min":15.228,"5min":15.228,"15min":15.228},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.503,"5min":0.40600000000000003,"15min":0.38900000000000001},"min":{"1min":0.32900000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":0.36599999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.38200000000000001,"15min":0.375},"min":{"1min":0.28899999999999998,"5min":0.23599999999999999,"15min":0.19900000000000001},"max":{"1min":0.56200000000000006,"5min":0.57499999999999996,"15min":0.745},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.36199999999999999,"15min":0.35399999999999998},"min":{"1min":0.23200000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.35699999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.36899999999999999,"15min":0.36799999999999999},"min":{"1min":0.27900000000000003,"5min":0.23699999999999999,"15min":0.23200000000000001},"max":{"1min":0.621,"5min":0.621,"15min":0.629},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.378,"15min":0.36799999999999999},"min":{"1min":0.27500000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.64400000000000002},"last":0.313}]},{"osd":4,"last update":"Fri Oct 6 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.46700000000000003,"5min":0.30599999999999999,"15min":0.30299999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":1.3200000000000001,"5min":0.69199999999999995,"15min":0.59499999999999997},"min":{"1min":0.42799999999999999,"5min":0.28199999999999997,"15min":0.27900000000000003},"max":{"1min":15.26,"5min":15.26,"15min":15.26},"last":0.65400000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":0.69999999999999996,"15min":0.59399999999999997},"min":{"1min":0.38200000000000001,"5min":0.35799999999999998,"15min":0.32400000000000001},"max":{"1min":15.186,"5min":15.186,"15min":15.186},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.57599999999999996,"15min":0.55900000000000005},"min":{"1min":0.44600000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.64200000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.60099999999999998,"15min":0.58499999999999996},"min":{"1min":0.48899999999999999,"5min":0.38200000000000001,"15min":0.32600000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.60199999999999998,"15min":0.57899999999999996},"min":{"1min":0.47099999999999997,"5min":0.40699999999999997,"15min":0.34200000000000003},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.67400000000000004}]},{"osd":7,"last update":"Fri Oct 6 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":0.68200000000000005,"15min":0.59799999999999998},"min":{"1min":0.46600000000000003,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":10.977,"5min":10.977,"15min":10.977},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.58599999999999997,"15min":0.57399999999999995},"min":{"1min":0.52100000000000002,"5min":0.38800000000000001,"15min":0.38200000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.66500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574994,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311444,"kb_used_data":1868,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060396,"statfs":{"total":96636764160,"available":96317845504,"internally_reserved":0,"allocated":1912832,"data_stored":875505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.34399999999999997,"15min":0.32500000000000001},"min":{"1min":0.248,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.46899999999999997,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.41199999999999998,"15min":0.39100000000000001},"min":{"1min":0.313,"5min":0.23000000000000001,"15min":0.22700000000000001},"max":{"1min":0.55100000000000005,"5min":4.4820000000000002,"15min":4.4820000000000002},"last":0.32800000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.32100000000000001,"15min":0.313},"min":{"1min":0.248,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.439,"5min":0.54000000000000004,"15min":0.65400000000000003},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.35599999999999998,"15min":0.35699999999999998},"min":{"1min":0.27700000000000002,"5min":0.23400000000000001,"15min":0.188},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":1.196},"last":0.30499999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.40200000000000002,"15min":0.38400000000000001},"min":{"1min":0.27700000000000002,"5min":0.23400000000000001,"15min":0.19600000000000001},"max":{"1min":0.45300000000000001,"5min":4.601,"15min":4.601},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.437,"15min":0.41799999999999998},"min":{"1min":0.32500000000000001,"5min":0.29899999999999999,"15min":0.26100000000000001},"max":{"1min":0.63200000000000001,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.35999999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.54500000000000004,"15min":0.54700000000000004},"min":{"1min":0.378,"5min":0.32100000000000001,"15min":0.311},"max":{"1min":0.75900000000000001,"5min":0.88500000000000001,"15min":1.694},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54500000000000004,"15min":0.53900000000000003},"min":{"1min":0.46300000000000002,"5min":0.32600000000000001,"15min":0.30199999999999999},"max":{"1min":0.68700000000000006,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.47399999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.434,"5min":0.34100000000000003,"15min":0.29399999999999998},"max":{"1min":0.63800000000000001,"5min":0.86399999999999999,"15min":0.878},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.36599999999999999,"5min":0.35699999999999998,"15min":0.29699999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":1.165},"last":0.46500000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.44400000000000001,"5min":0.372,"15min":0.36699999999999999},"max":{"1min":0.78700000000000003,"5min":0.79200000000000004,"15min":1.1359999999999999},"last":0.502},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57699999999999996,"15min":0.58499999999999996},"min":{"1min":0.443,"5min":0.36799999999999999,"15min":0.34399999999999997},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":1.7470000000000001},"last":0.48399999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56499999999999995,"15min":0.57399999999999995},"min":{"1min":0.39600000000000002,"5min":0.35699999999999998,"15min":0.35599999999999998},"max":{"1min":0.80300000000000005,"5min":0.89900000000000002,"15min":1.657},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57899999999999996,"15min":0.57299999999999995},"min":{"1min":0.48399999999999999,"5min":0.38,"15min":0.35499999999999998},"max":{"1min":0.71599999999999997,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.49299999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574993,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303252,"kb_used_data":1868,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068588,"statfs":{"total":96636764160,"available":96326234112,"internally_reserved":0,"allocated":1912832,"data_stored":875482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.47999999999999998,"15min":0.51600000000000001},"min":{"1min":0.30099999999999999,"5min":0.20799999999999999,"15min":0.19500000000000001},"max":{"1min":0.76800000000000002,"5min":0.82099999999999995,"15min":2.6619999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.504,"15min":0.49199999999999999},"min":{"1min":0.28999999999999998,"5min":0.224,"15min":0.215},"max":{"1min":0.81499999999999995,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.55600000000000005}]},{"osd":1,"last update":"Fri Oct 6 11:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.498,"15min":0.53600000000000003},"min":{"1min":0.27600000000000002,"5min":0.26200000000000001,"15min":0.23300000000000001},"max":{"1min":0.72899999999999998,"5min":1,"15min":2.8650000000000002},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.497,"15min":0.54200000000000004},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.25800000000000001},"max":{"1min":0.70699999999999996,"5min":1.2869999999999999,"15min":2.7610000000000001},"last":0.54400000000000004}]},{"osd":2,"last update":"Fri Oct 6 11:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.52300000000000002,"15min":0.53300000000000003},"min":{"1min":0.36899999999999999,"5min":0.28499999999999998,"15min":0.23100000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":1.6910000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57199999999999995,"15min":0.57999999999999996},"min":{"1min":0.40999999999999998,"5min":0.31,"15min":0.30599999999999999},"max":{"1min":0.82799999999999996,"5min":0.93899999999999995,"15min":1.718},"last":0.52200000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58099999999999996,"15min":0.58599999999999997},"min":{"1min":0.38600000000000001,"5min":0.32000000000000001,"15min":0.26700000000000002},"max":{"1min":0.78800000000000003,"5min":2.387,"15min":2.677},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.55000000000000004,"15min":0.52700000000000002},"min":{"1min":0.42499999999999999,"5min":0.29299999999999998,"15min":0.27500000000000002},"max":{"1min":0.77700000000000002,"5min":1.784,"15min":1.784},"last":0.60699999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.378,"5min":0.28499999999999998,"15min":0.23200000000000001},"max":{"1min":0.68300000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.51500000000000001,"15min":0.52500000000000002},"min":{"1min":0.39400000000000002,"5min":0.28899999999999998,"15min":0.28399999999999997},"max":{"1min":0.749,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.502}]},{"osd":6,"last update":"Fri Oct 6 11:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.35799999999999998,"5min":0.31,"15min":0.252},"max":{"1min":0.72999999999999998,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55200000000000005,"15min":0.55900000000000005},"min":{"1min":0.41199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80200000000000005,"5min":0.85799999999999998,"15min":1.165},"last":0.48799999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.56599999999999995,"15min":0.55800000000000005},"min":{"1min":0.40799999999999997,"5min":0.34200000000000003,"15min":0.313},"max":{"1min":0.84999999999999998,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.58899999999999997,"15min":0.59099999999999997},"min":{"1min":0.41999999999999998,"5min":0.318,"15min":0.317},"max":{"1min":0.86399999999999999,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.46300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574995,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311436,"kb_used_data":1860,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060404,"statfs":{"total":96636764160,"available":96317853696,"internally_reserved":0,"allocated":1904640,"data_stored":874870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.48499999999999999,"15min":0.57499999999999996},"min":{"1min":0.26000000000000001,"5min":0.23300000000000001,"15min":0.20499999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":5.0490000000000004},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.48599999999999999,"15min":0.55500000000000005},"min":{"1min":0.34599999999999997,"5min":0.253,"15min":0.22900000000000001},"max":{"1min":0.71299999999999997,"5min":0.78100000000000003,"15min":5.1449999999999996},"last":0.45000000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.48899999999999999,"15min":0.48299999999999998},"min":{"1min":0.27800000000000002,"5min":0.25700000000000001,"15min":0.25},"max":{"1min":0.68400000000000005,"5min":0.81399999999999995,"15min":0.97199999999999998},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.505,"15min":0.51000000000000001},"min":{"1min":0.29799999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.69299999999999995,"5min":0.74099999999999999,"15min":1.8799999999999999},"last":0.57699999999999996}]},{"osd":2,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.52800000000000002,"15min":0.54600000000000004},"min":{"1min":0.36799999999999999,"5min":0.30099999999999999,"15min":0.28299999999999997},"max":{"1min":0.748,"5min":0.79800000000000004,"15min":4.234},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56200000000000006,"15min":0.56000000000000005},"min":{"1min":0.436,"5min":0.315,"15min":0.315},"max":{"1min":0.79200000000000004,"5min":0.81000000000000005,"15min":1.0369999999999999},"last":0.54400000000000004}]},{"osd":3,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51000000000000001,"15min":0.59299999999999997},"min":{"1min":0.311,"5min":0.29499999999999998,"15min":0.27700000000000002},"max":{"1min":0.70499999999999996,"5min":0.82299999999999995,"15min":5.2169999999999996},"last":0.5},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53100000000000003,"15min":0.53800000000000003},"min":{"1min":0.38700000000000001,"5min":0.29999999999999999,"15min":0.29699999999999999},"max":{"1min":0.73699999999999999,"5min":0.75600000000000001,"15min":1.008},"last":0.47799999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48399999999999999,"15min":0.504},"min":{"1min":0.33700000000000002,"5min":0.25600000000000001,"15min":0.23999999999999999},"max":{"1min":0.65900000000000003,"5min":0.83399999999999996,"15min":1.917},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.48999999999999999,"15min":0.51400000000000001},"min":{"1min":0.29999999999999999,"5min":0.251,"15min":0.23899999999999999},"max":{"1min":0.65500000000000003,"5min":0.69199999999999995,"15min":0.87},"last":0.56599999999999995}]},{"osd":6,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51100000000000001,"15min":0.54300000000000004},"min":{"1min":0.34799999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.67200000000000004,"5min":0.76800000000000002,"15min":2.0139999999999998},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57399999999999995,"15min":0.59399999999999997},"min":{"1min":0.33200000000000002,"5min":0.30299999999999999,"15min":0.29999999999999999},"max":{"1min":0.72599999999999998,"5min":0.82899999999999996,"15min":1.9470000000000001},"last":0.65100000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53600000000000003,"15min":0.56299999999999994},"min":{"1min":0.376,"5min":0.28799999999999998,"15min":0.27700000000000002},"max":{"1min":0.64600000000000002,"5min":0.81000000000000005,"15min":0.96499999999999997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56899999999999995,"15min":0.59299999999999997},"min":{"1min":0.42599999999999999,"5min":0.29199999999999998,"15min":0.28799999999999998},"max":{"1min":0.746,"5min":0.77300000000000002,"15min":1.4119999999999999},"last":0.63900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:17:29.365 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T11:17:29.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.509+0000 7fe9e115f700 1 Processor -- start 2023-10-06T11:17:29.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.509+0000 7fe9e115f700 1 -- start start 2023-10-06T11:17:29.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.510+0000 7fe9e115f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9dc0cbac0 0x7fe9dc15a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:29.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.510+0000 7fe9e115f700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe9dc0ccb20 0x7fe9dc0c5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:29.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.510+0000 7fe9e115f700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9dc0c5990 con 0x7fe9dc153b00 2023-10-06T11:17:29.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.510+0000 7fe9e115f700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9dc15ac10 con 0x7fe9dc0ccb20 2023-10-06T11:17:29.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.510+0000 7fe9e115f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc0cd2a0 con 0x7fe9dc0cbac0 2023-10-06T11:17:29.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.510+0000 7fe9db7fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9dc0cbac0 0x7fe9dc15a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:29.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.510+0000 7fe9e095e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe9dc0ccb20 0x7fe9dc0c5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:29.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.510+0000 7fe9db7fe700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9dc0cbac0 0x7fe9dc15a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:47350/0 (socket says 172.21.15.146:47350) 2023-10-06T11:17:29.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.510+0000 7fe9db7fe700 1 -- 172.21.15.146:0/121817935 learned_addr learned my addr 172.21.15.146:0/121817935 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:29.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.511+0000 7fe9daffd700 1 -- 172.21.15.146:0/121817935 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 100020388 0 0) 0x7fe9dc0c5990 con 0x7fe9dc153b00 2023-10-06T11:17:29.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.511+0000 7fe9daffd700 1 -- 172.21.15.146:0/121817935 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9c4003570 con 0x7fe9dc153b00 2023-10-06T11:17:29.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.511+0000 7fe9e095e700 1 -- 172.21.15.146:0/121817935 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9dc0cbac0 msgr2=0x7fe9dc15a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:29.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.511+0000 7fe9e095e700 1 --2- 172.21.15.146:0/121817935 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9dc0cbac0 0x7fe9dc15a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:29.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.511+0000 7fe9e095e700 1 -- 172.21.15.146:0/121817935 >> v1:172.21.15.151:6789/0 conn(0x7fe9dc153b00 legacy=0x7fe9dc0cb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:29.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.511+0000 7fe9e095e700 1 -- 172.21.15.146:0/121817935 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9dc0cd580 con 0x7fe9dc0ccb20 2023-10-06T11:17:29.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.511+0000 7fe9db7fe700 1 --2- 172.21.15.146:0/121817935 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9dc0cbac0 0x7fe9dc15a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:17:29.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.511+0000 7fe9e095e700 1 --2- 172.21.15.146:0/121817935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9dc0ccb20 0x7fe9dc0c5e20 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4009e60 tx=0x7fe9d4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adb6b745b69c49f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:29.514 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.511+0000 7fe9daffd700 1 -- 172.21.15.146:0/121817935 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d400e070 con 0x7fe9dc0ccb20 2023-10-06T11:17:29.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.511+0000 7fe9daffd700 1 -- 172.21.15.146:0/121817935 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d400bab0 con 0x7fe9dc0ccb20 2023-10-06T11:17:29.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.511+0000 7fe9daffd700 1 -- 172.21.15.146:0/121817935 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d400be50 con 0x7fe9dc0ccb20 2023-10-06T11:17:29.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.512+0000 7fe9e115f700 1 -- 172.21.15.146:0/121817935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9dc0ccb20 msgr2=0x7fe9dc0c5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:29.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.512+0000 7fe9e115f700 1 --2- 172.21.15.146:0/121817935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9dc0ccb20 0x7fe9dc0c5e20 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4009e60 tx=0x7fe9d4009780 comp rx=0 tx=0).stop 2023-10-06T11:17:29.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.512+0000 7fe9e115f700 1 -- 172.21.15.146:0/121817935 shutdown_connections 2023-10-06T11:17:29.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.512+0000 7fe9e115f700 1 --2- 172.21.15.146:0/121817935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9dc0ccb20 0x7fe9dc0c5e20 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:29.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.512+0000 7fe9e115f700 1 --2- 172.21.15.146:0/121817935 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9dc0cbac0 0x7fe9dc15a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:29.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.512+0000 7fe9e115f700 1 -- 172.21.15.146:0/121817935 >> 172.21.15.146:0/121817935 conn(0x7fe9dc06eba0 msgr2=0x7fe9dc06ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:29.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.512+0000 7fe9e115f700 1 -- 172.21.15.146:0/121817935 shutdown_connections 2023-10-06T11:17:29.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.512+0000 7fe9e115f700 1 -- 172.21.15.146:0/121817935 wait complete. 2023-10-06T11:17:29.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.513+0000 7fe9e115f700 1 Processor -- start 2023-10-06T11:17:29.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.513+0000 7fe9e115f700 1 -- start start 2023-10-06T11:17:29.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.514+0000 7fe9e115f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9dc0cbac0 0x7fe9dc16d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:29.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.514+0000 7fe9e115f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9dc0ccb20 0x7fe9dc0c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:29.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.514+0000 7fe9e115f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9dc153b00 0x7fe9dc0b31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:29.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.514+0000 7fe9e115f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc13e900 con 0x7fe9dc0cbac0 2023-10-06T11:17:29.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.514+0000 7fe9e115f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc0b3980 con 0x7fe9dc0ccb20 2023-10-06T11:17:29.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.514+0000 7fe9e115f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc0b4e60 con 0x7fe9dc153b00 2023-10-06T11:17:29.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.514+0000 7fe9dbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9dc0cbac0 0x7fe9dc16d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:29.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.514+0000 7fe9dbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9dc0cbac0 0x7fe9dc16d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49760/0 (socket says 172.21.15.146:49760) 2023-10-06T11:17:29.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.514+0000 7fe9dbfff700 1 -- 172.21.15.146:0/1075034137 learned_addr learned my addr 172.21.15.146:0/1075034137 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:29.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.514+0000 7fe9db7fe700 1 --2- 172.21.15.146:0/1075034137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9dc0ccb20 0x7fe9dc0c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:29.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.514+0000 7fe9e095e700 1 --2- 172.21.15.146:0/1075034137 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9dc153b00 0x7fe9dc0b31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:29.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.514+0000 7fe9dbfff700 1 -- 172.21.15.146:0/1075034137 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9dc153b00 msgr2=0x7fe9dc0b31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:29.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.514+0000 7fe9dbfff700 1 --2- 172.21.15.146:0/1075034137 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9dc153b00 0x7fe9dc0b31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:29.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.514+0000 7fe9dbfff700 1 -- 172.21.15.146:0/1075034137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9dc0ccb20 msgr2=0x7fe9dc0c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:29.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.514+0000 7fe9dbfff700 1 --2- 172.21.15.146:0/1075034137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9dc0ccb20 0x7fe9dc0c9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:29.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.514+0000 7fe9dbfff700 1 -- 172.21.15.146:0/1075034137 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d00094f0 con 0x7fe9dc0cbac0 2023-10-06T11:17:29.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.515+0000 7fe9dbfff700 1 --2- 172.21.15.146:0/1075034137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9dc0cbac0 0x7fe9dc16d710 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc00c5c0 tx=0x7fe9cc007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:29.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.515+0000 7fe9c3fff700 1 -- 172.21.15.146:0/1075034137 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc010510 con 0x7fe9dc0cbac0 2023-10-06T11:17:29.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.515+0000 7fe9c3fff700 1 -- 172.21.15.146:0/1075034137 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9cc010670 con 0x7fe9dc0cbac0 2023-10-06T11:17:29.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.515+0000 7fe9e115f700 1 -- 172.21.15.146:0/1075034137 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9d4009a20 con 0x7fe9dc0cbac0 2023-10-06T11:17:29.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.515+0000 7fe9c3fff700 1 -- 172.21.15.146:0/1075034137 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc010a30 con 0x7fe9dc0cbac0 2023-10-06T11:17:29.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.515+0000 7fe9e115f700 1 -- 172.21.15.146:0/1075034137 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9dc0b59c0 con 0x7fe9dc0cbac0 2023-10-06T11:17:29.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.516+0000 7fe9e115f700 1 -- 172.21.15.146:0/1075034137 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9dc0cdfd0 con 0x7fe9dc0cbac0 2023-10-06T11:17:29.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.516+0000 7fe9c3fff700 1 -- 172.21.15.146:0/1075034137 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe9cc01b400 con 0x7fe9dc0cbac0 2023-10-06T11:17:29.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.516+0000 7fe9c3fff700 1 --2- 172.21.15.146:0/1075034137 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe9c8066f30 0x7fe9c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:29.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.516+0000 7fe9c3fff700 1 -- 172.21.15.146:0/1075034137 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe9cc0841a0 con 0x7fe9dc0cbac0 2023-10-06T11:17:29.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.516+0000 7fe9db7fe700 1 --2- 172.21.15.146:0/1075034137 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe9c8066f30 0x7fe9c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:29.521 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.517+0000 7fe9db7fe700 1 --2- 172.21.15.146:0/1075034137 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe9c8066f30 0x7fe9c80693e0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc16cb40 tx=0x7fe9d0009250 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:29.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.521+0000 7fe9c3fff700 1 -- 172.21.15.146:0/1075034137 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe9cc0512b0 con 0x7fe9dc0cbac0 2023-10-06T11:17:29.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.780+0000 7fe9e115f700 1 -- 172.21.15.146:0/1075034137 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe9dc04bb40 con 0x7fe9dc0cbac0 2023-10-06T11:17:29.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.780+0000 7fe9c3fff700 1 -- 172.21.15.146:0/1075034137 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1183 (secure 0 0 0) 0x7fe9cc0548d0 con 0x7fe9dc0cbac0 2023-10-06T11:17:29.782 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:29.782 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":724,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":151,"num_osds":8,"num_up_osds":8,"osd_up_since":1696590336,"num_in_osds":8,"osd_in_since":1696590327,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":23,"data_bytes":592674,"bytes_used":2502111232,"bytes_avail":770592002048,"bytes_total":773094113280,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":128,"id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"c","status":"up:active","gid":9648}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":26,"modified":"2023-10-06T11:16:07.275107+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T11:17:29.784 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.782+0000 7fe9e115f700 1 -- 172.21.15.146:0/1075034137 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe9c8066f30 msgr2=0x7fe9c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:29.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.782+0000 7fe9e115f700 1 --2- 172.21.15.146:0/1075034137 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe9c8066f30 0x7fe9c80693e0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc16cb40 tx=0x7fe9d0009250 comp rx=0 tx=0).stop 2023-10-06T11:17:29.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.782+0000 7fe9e115f700 1 -- 172.21.15.146:0/1075034137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9dc0cbac0 msgr2=0x7fe9dc16d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:29.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.782+0000 7fe9e115f700 1 --2- 172.21.15.146:0/1075034137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9dc0cbac0 0x7fe9dc16d710 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc00c5c0 tx=0x7fe9cc007dc0 comp rx=0 tx=0).stop 2023-10-06T11:17:29.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.782+0000 7fe9e115f700 1 -- 172.21.15.146:0/1075034137 shutdown_connections 2023-10-06T11:17:29.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.782+0000 7fe9e115f700 1 --2- 172.21.15.146:0/1075034137 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe9c8066f30 0x7fe9c80693e0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:29.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.782+0000 7fe9e115f700 1 --2- 172.21.15.146:0/1075034137 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9dc153b00 0x7fe9dc0b31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:29.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.782+0000 7fe9e115f700 1 --2- 172.21.15.146:0/1075034137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe9dc0cbac0 0x7fe9dc16d710 unknown :-1 s=CLOSED pgs=1956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:29.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.782+0000 7fe9e115f700 1 --2- 172.21.15.146:0/1075034137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9dc0ccb20 0x7fe9dc0c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:29.785 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.782+0000 7fe9e115f700 1 -- 172.21.15.146:0/1075034137 >> 172.21.15.146:0/1075034137 conn(0x7fe9dc06eba0 msgr2=0x7fe9dc0c5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:29.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.782+0000 7fe9e115f700 1 -- 172.21.15.146:0/1075034137 shutdown_connections 2023-10-06T11:17:29.786 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.782+0000 7fe9e115f700 1 -- 172.21.15.146:0/1075034137 wait complete. 2023-10-06T11:17:29.797 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-06T11:17:29.797 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:17:29.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.909+0000 7f001e156700 1 Processor -- start 2023-10-06T11:17:29.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.909+0000 7f001e156700 1 -- start start 2023-10-06T11:17:29.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.910+0000 7f001e156700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0018153ab0 0x7f001815a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:29.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.910+0000 7f001e156700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f001815ac30 con 0x7f0018068ba0 2023-10-06T11:17:29.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.910+0000 7f001e156700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00180b4510 con 0x7f0018153e80 2023-10-06T11:17:29.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.910+0000 7f001e156700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00180b6530 con 0x7f0018153ab0 2023-10-06T11:17:29.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.910+0000 7f0017fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0018068ba0 0x7f00180b49a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39738/0 (socket says 172.21.15.146:39738) 2023-10-06T11:17:29.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.910+0000 7f0017fff700 1 -- 172.21.15.146:0/2172595275 learned_addr learned my addr 172.21.15.146:0/2172595275 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:17:29.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.911+0000 7f00177fe700 1 --2- 172.21.15.146:0/2172595275 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0018153ab0 0x7f001815a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:29.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.911+0000 7f00167fc700 1 -- 172.21.15.146:0/2172595275 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 916982208 0 0) 0x7f0010001110 con 0x7f0018068ba0 2023-10-06T11:17:29.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.911+0000 7f00167fc700 1 -- 172.21.15.146:0/2172595275 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0000003570 con 0x7f0018068ba0 2023-10-06T11:17:29.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.911+0000 7f00167fc700 1 -- 172.21.15.146:0/2172595275 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3417466483 0 0) 0x7f0000003570 con 0x7f0018068ba0 2023-10-06T11:17:29.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.911+0000 7f00167fc700 1 -- 172.21.15.146:0/2172595275 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0018153ab0 msgr2=0x7f001815a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:29.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.911+0000 7f00167fc700 1 --2- 172.21.15.146:0/2172595275 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0018153ab0 0x7f001815a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:29.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.911+0000 7f00167fc700 1 -- 172.21.15.146:0/2172595275 >> v1:172.21.15.151:6789/0 conn(0x7f0018153e80 legacy=0x7f0018068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:29.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.911+0000 7f00167fc700 1 -- 172.21.15.146:0/2172595275 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00180b5c50 con 0x7f0018068ba0 2023-10-06T11:17:29.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.911+0000 7f00167fc700 1 -- 172.21.15.146:0/2172595275 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f0010001600 con 0x7f0018068ba0 2023-10-06T11:17:29.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.911+0000 7f00167fc700 1 -- 172.21.15.146:0/2172595275 >> v1:172.21.15.146:6789/0 conn(0x7f0018068ba0 legacy=0x7f00180b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:29.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.911+0000 7f00167fc700 1 --2- 172.21.15.146:0/2172595275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0000003a90 0x7f0000003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:29.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.911+0000 7f00167fc700 1 --2- 172.21.15.146:0/2172595275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0000004810 0x7f0000004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:29.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.911+0000 7f00167fc700 1 --2- 172.21.15.146:0/2172595275 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0018153ab0 0x7f00000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:29.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.911+0000 7f00167fc700 1 -- 172.21.15.146:0/2172595275 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00180b6530 con 0x7f0000003a90 2023-10-06T11:17:29.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.911+0000 7f00167fc700 1 -- 172.21.15.146:0/2172595275 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000000bb10 con 0x7f0000004810 2023-10-06T11:17:29.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.911+0000 7f00167fc700 1 -- 172.21.15.146:0/2172595275 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f000000bcd0 con 0x7f0018153ab0 2023-10-06T11:17:29.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.911+0000 7f00177fe700 1 --2- 172.21.15.146:0/2172595275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0000003a90 0x7f0000003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:29.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.911+0000 7f0016ffd700 1 --2- 172.21.15.146:0/2172595275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0000004810 0x7f0000004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:29.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.911+0000 7f0017fff700 1 --2- 172.21.15.146:0/2172595275 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0018153ab0 0x7f00000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:29.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.911+0000 7f00177fe700 1 -- 172.21.15.146:0/2172595275 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0018153ab0 msgr2=0x7f00000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:29.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.911+0000 7f00177fe700 1 --2- 172.21.15.146:0/2172595275 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0018153ab0 0x7f00000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:29.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.911+0000 7f00177fe700 1 -- 172.21.15.146:0/2172595275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0000004810 msgr2=0x7f0000004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:29.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.911+0000 7f00177fe700 1 --2- 172.21.15.146:0/2172595275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0000004810 0x7f0000004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:29.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.911+0000 7f00177fe700 1 -- 172.21.15.146:0/2172595275 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0000003570 con 0x7f0000003a90 2023-10-06T11:17:29.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.912+0000 7f00177fe700 1 --2- 172.21.15.146:0/2172595275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0000003a90 0x7f0000003e60 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7f000800e210 tx=0x7f000800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e003c74e30183e77 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:29.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.912+0000 7f00167fc700 1 -- 172.21.15.146:0/2172595275 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000800eac0 con 0x7f0000003a90 2023-10-06T11:17:29.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.912+0000 7f00167fc700 1 -- 172.21.15.146:0/2172595275 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f000800f040 con 0x7f0000003a90 2023-10-06T11:17:29.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.912+0000 7f00167fc700 1 -- 172.21.15.146:0/2172595275 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000800ee70 con 0x7f0000003a90 2023-10-06T11:17:29.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.912+0000 7f001e156700 1 -- 172.21.15.146:0/2172595275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0000003a90 msgr2=0x7f0000003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:29.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.912+0000 7f001e156700 1 --2- 172.21.15.146:0/2172595275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0000003a90 0x7f0000003e60 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7f000800e210 tx=0x7f000800b040 comp rx=0 tx=0).stop 2023-10-06T11:17:29.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.912+0000 7f0017fff700 1 -- 172.21.15.146:0/2172595275 reap_dead start 2023-10-06T11:17:29.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.912+0000 7f001e156700 1 -- 172.21.15.146:0/2172595275 shutdown_connections 2023-10-06T11:17:29.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.912+0000 7f001e156700 1 -- 172.21.15.146:0/2172595275 >> 172.21.15.146:0/2172595275 conn(0x7f001806eba0 msgr2=0x7f001806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:29.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.912+0000 7f001e156700 1 -- 172.21.15.146:0/2172595275 shutdown_connections 2023-10-06T11:17:29.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.912+0000 7f001e156700 1 -- 172.21.15.146:0/2172595275 wait complete. 2023-10-06T11:17:29.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.913+0000 7f001e156700 1 Processor -- start 2023-10-06T11:17:29.919 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.913+0000 7f001e156700 1 -- start start 2023-10-06T11:17:29.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.914+0000 7f001e156700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0000003a90 0x7f001813fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:29.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.914+0000 7f001e156700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0018154320 0x7f00180ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:29.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.914+0000 7f001e156700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0018154790 0x7f00180cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:29.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.914+0000 7f001e156700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001816d060 con 0x7f0018154320 2023-10-06T11:17:29.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.914+0000 7f001e156700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001816d340 con 0x7f0000003a90 2023-10-06T11:17:29.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.914+0000 7f001e156700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f001816d620 con 0x7f0018154790 2023-10-06T11:17:29.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.914+0000 7f0016ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0018154320 0x7f00180ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:29.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.914+0000 7f0016ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0018154320 0x7f00180ceca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:49788/0 (socket says 172.21.15.146:49788) 2023-10-06T11:17:29.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.914+0000 7f0016ffd700 1 -- 172.21.15.146:0/546687435 learned_addr learned my addr 172.21.15.146:0/546687435 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:29.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.915+0000 7f0017fff700 1 --2- 172.21.15.146:0/546687435 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0018154790 0x7f00180cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:29.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.915+0000 7f0016ffd700 1 -- 172.21.15.146:0/546687435 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0018154790 msgr2=0x7f00180cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:29.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.915+0000 7f0016ffd700 1 --2- 172.21.15.146:0/546687435 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0018154790 0x7f00180cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:29.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.915+0000 7f0016ffd700 1 -- 172.21.15.146:0/546687435 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0000003a90 msgr2=0x7f001813fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:29.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.915+0000 7f0016ffd700 1 --2- 172.21.15.146:0/546687435 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0000003a90 0x7f001813fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:29.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.915+0000 7f0016ffd700 1 -- 172.21.15.146:0/546687435 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f001816d900 con 0x7f0018154320 2023-10-06T11:17:29.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.915+0000 7f0016ffd700 1 --2- 172.21.15.146:0/546687435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0018154320 0x7f00180ceca0 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7f000c00e860 tx=0x7f000c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:29.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.915+0000 7effff7fe700 1 -- 172.21.15.146:0/546687435 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000c013630 con 0x7f0018154320 2023-10-06T11:17:29.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.915+0000 7effff7fe700 1 -- 172.21.15.146:0/546687435 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f000c013790 con 0x7f0018154320 2023-10-06T11:17:29.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.915+0000 7f001e156700 1 -- 172.21.15.146:0/546687435 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f001816dbe0 con 0x7f0018154320 2023-10-06T11:17:29.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.915+0000 7effff7fe700 1 -- 172.21.15.146:0/546687435 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000c013b50 con 0x7f0018154320 2023-10-06T11:17:29.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.915+0000 7f001e156700 1 -- 172.21.15.146:0/546687435 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0018140410 con 0x7f0018154320 2023-10-06T11:17:29.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.916+0000 7f001e156700 1 -- 172.21.15.146:0/546687435 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f001816de20 con 0x7f0018154320 2023-10-06T11:17:29.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.916+0000 7effff7fe700 1 -- 172.21.15.146:0/546687435 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f000c01c400 con 0x7f0018154320 2023-10-06T11:17:29.923 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.916+0000 7effff7fe700 1 --2- 172.21.15.146:0/546687435 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0004066f30 0x7f00040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:29.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.917+0000 7effff7fe700 1 -- 172.21.15.146:0/546687435 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f000c084c70 con 0x7f0018154320 2023-10-06T11:17:29.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.917+0000 7f00177fe700 1 --2- 172.21.15.146:0/546687435 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0004066f30 0x7f00040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:29.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.917+0000 7f00177fe700 1 --2- 172.21.15.146:0/546687435 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0004066f30 0x7f00040693e0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f000800afd0 tx=0x7f000801a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:29.924 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:29.921+0000 7effff7fe700 1 -- 172.21.15.146:0/546687435 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f001816de20 con 0x7f0018154320 2023-10-06T11:17:30.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:30.100+0000 7f001e156700 1 -- 172.21.15.146:0/546687435 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f001816de20 con 0x7f0004066f30 2023-10-06T11:17:30.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:30.108+0000 7effff7fe700 1 -- 172.21.15.146:0/546687435 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311913 (secure 0 0 0) 0x7f001816de20 con 0x7f0004066f30 2023-10-06T11:17:30.113 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:30.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:30.111+0000 7f001e156700 1 -- 172.21.15.146:0/546687435 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0004066f30 msgr2=0x7f00040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:30.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:30.111+0000 7f001e156700 1 --2- 172.21.15.146:0/546687435 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0004066f30 0x7f00040693e0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f000800afd0 tx=0x7f000801a000 comp rx=0 tx=0).stop 2023-10-06T11:17:30.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:30.111+0000 7f001e156700 1 -- 172.21.15.146:0/546687435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0018154320 msgr2=0x7f00180ceca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:30.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:30.111+0000 7f001e156700 1 --2- 172.21.15.146:0/546687435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0018154320 0x7f00180ceca0 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7f000c00e860 tx=0x7f000c009040 comp rx=0 tx=0).stop 2023-10-06T11:17:30.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:30.111+0000 7f001e156700 1 -- 172.21.15.146:0/546687435 shutdown_connections 2023-10-06T11:17:30.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:30.111+0000 7f001e156700 1 --2- 172.21.15.146:0/546687435 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0004066f30 0x7f00040693e0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:30.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:30.111+0000 7f001e156700 1 --2- 172.21.15.146:0/546687435 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0018154790 0x7f00180cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:30.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:30.111+0000 7f001e156700 1 --2- 172.21.15.146:0/546687435 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0000003a90 0x7f001813fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:30.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:30.111+0000 7f001e156700 1 --2- 172.21.15.146:0/546687435 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0018154320 0x7f00180ceca0 unknown :-1 s=CLOSED pgs=1959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:30.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:30.111+0000 7f001e156700 1 -- 172.21.15.146:0/546687435 >> 172.21.15.146:0/546687435 conn(0x7f001806eba0 msgr2=0x7f001815c670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:30.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:30.112+0000 7f001e156700 1 -- 172.21.15.146:0/546687435 shutdown_connections 2023-10-06T11:17:30.117 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:30.112+0000 7f001e156700 1 -- 172.21.15.146:0/546687435 wait complete. 2023-10-06T11:17:30.117 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:17:30.126 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":500,"stamp":"2023-10-06T11:17:29.292684+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":163,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2443468,"kb_used_data":16012,"kb_used_omap":0,"kb_used_meta":2427392,"kb_avail":752531252,"statfs":{"total":773094113280,"available":770592002048,"internally_reserved":0,"allocated":16396288,"data_stored":8171263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2485649408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001162"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.570754+0000","last_change":"2023-10-06T11:17:24.567490+0000","last_active":"2023-10-06T11:17:24.570754+0000","last_peered":"2023-10-06T11:17:24.570754+0000","last_clean":"2023-10-06T11:17:24.570754+0000","last_became_active":"2023-10-06T11:17:24.565793+0000","last_became_peered":"2023-10-06T11:17:24.565793+0000","last_unstale":"2023-10-06T11:17:24.570754+0000","last_undegraded":"2023-10-06T11:17:24.570754+0000","last_fullsized":"2023-10-06T11:17:24.570754+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:15:11.263158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575584+0000","last_change":"2023-10-06T11:17:24.574790+0000","last_active":"2023-10-06T11:17:24.575584+0000","last_peered":"2023-10-06T11:17:24.575584+0000","last_clean":"2023-10-06T11:17:24.575584+0000","last_became_active":"2023-10-06T11:17:24.574475+0000","last_became_peered":"2023-10-06T11:17:24.574475+0000","last_unstale":"2023-10-06T11:17:24.575584+0000","last_undegraded":"2023-10-06T11:17:24.575584+0000","last_fullsized":"2023-10-06T11:17:24.575584+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:20.201597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.568092+0000","last_change":"2023-10-06T11:17:24.565515+0000","last_active":"2023-10-06T11:17:24.568092+0000","last_peered":"2023-10-06T11:17:24.568092+0000","last_clean":"2023-10-06T11:17:24.568092+0000","last_became_active":"2023-10-06T11:17:24.565217+0000","last_became_peered":"2023-10-06T11:17:24.565217+0000","last_unstale":"2023-10-06T11:17:24.568092+0000","last_undegraded":"2023-10-06T11:17:24.568092+0000","last_fullsized":"2023-10-06T11:17:24.568092+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:22:20.066646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.571884+0000","last_change":"2023-10-06T11:17:24.569633+0000","last_active":"2023-10-06T11:17:24.571884+0000","last_peered":"2023-10-06T11:17:24.571884+0000","last_clean":"2023-10-06T11:17:24.571884+0000","last_became_active":"2023-10-06T11:17:24.569056+0000","last_became_peered":"2023-10-06T11:17:24.569056+0000","last_unstale":"2023-10-06T11:17:24.571884+0000","last_undegraded":"2023-10-06T11:17:24.571884+0000","last_fullsized":"2023-10-06T11:17:24.571884+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:11:12.692922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.576344+0000","last_change":"2023-10-06T11:17:24.570249+0000","last_active":"2023-10-06T11:17:24.576344+0000","last_peered":"2023-10-06T11:17:24.576344+0000","last_clean":"2023-10-06T11:17:24.576344+0000","last_became_active":"2023-10-06T11:17:24.570080+0000","last_became_peered":"2023-10-06T11:17:24.570080+0000","last_unstale":"2023-10-06T11:17:24.576344+0000","last_undegraded":"2023-10-06T11:17:24.576344+0000","last_fullsized":"2023-10-06T11:17:24.576344+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:32:08.893601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.569849+0000","last_change":"2023-10-06T11:17:24.568112+0000","last_active":"2023-10-06T11:17:24.569849+0000","last_peered":"2023-10-06T11:17:24.569849+0000","last_clean":"2023-10-06T11:17:24.569849+0000","last_became_active":"2023-10-06T11:17:24.567855+0000","last_became_peered":"2023-10-06T11:17:24.567855+0000","last_unstale":"2023-10-06T11:17:24.569849+0000","last_undegraded":"2023-10-06T11:17:24.569849+0000","last_fullsized":"2023-10-06T11:17:24.569849+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:11:12.692922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575807+0000","last_change":"2023-10-06T11:17:24.570311+0000","last_active":"2023-10-06T11:17:24.575807+0000","last_peered":"2023-10-06T11:17:24.575807+0000","last_clean":"2023-10-06T11:17:24.575807+0000","last_became_active":"2023-10-06T11:17:24.569843+0000","last_became_peered":"2023-10-06T11:17:24.569843+0000","last_unstale":"2023-10-06T11:17:24.575807+0000","last_undegraded":"2023-10-06T11:17:24.575807+0000","last_fullsized":"2023-10-06T11:17:24.575807+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:18.748550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575984+0000","last_change":"2023-10-06T11:17:24.571846+0000","last_active":"2023-10-06T11:17:24.575984+0000","last_peered":"2023-10-06T11:17:24.575984+0000","last_clean":"2023-10-06T11:17:24.575984+0000","last_became_active":"2023-10-06T11:17:24.571569+0000","last_became_peered":"2023-10-06T11:17:24.571569+0000","last_unstale":"2023-10-06T11:17:24.575984+0000","last_undegraded":"2023-10-06T11:17:24.575984+0000","last_fullsized":"2023-10-06T11:17:24.575984+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:08:07.693719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575834+0000","last_change":"2023-10-06T11:17:24.570976+0000","last_active":"2023-10-06T11:17:24.575834+0000","last_peered":"2023-10-06T11:17:24.575834+0000","last_clean":"2023-10-06T11:17:24.575834+0000","last_became_active":"2023-10-06T11:17:24.570681+0000","last_became_peered":"2023-10-06T11:17:24.570681+0000","last_unstale":"2023-10-06T11:17:24.575834+0000","last_undegraded":"2023-10-06T11:17:24.575834+0000","last_fullsized":"2023-10-06T11:17:24.575834+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:48.792063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.576026+0000","last_change":"2023-10-06T11:17:24.571439+0000","last_active":"2023-10-06T11:17:24.576026+0000","last_peered":"2023-10-06T11:17:24.576026+0000","last_clean":"2023-10-06T11:17:24.576026+0000","last_became_active":"2023-10-06T11:17:24.570809+0000","last_became_peered":"2023-10-06T11:17:24.570809+0000","last_unstale":"2023-10-06T11:17:24.576026+0000","last_undegraded":"2023-10-06T11:17:24.576026+0000","last_fullsized":"2023-10-06T11:17:24.576026+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:20.201597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.570755+0000","last_change":"2023-10-06T11:17:24.568848+0000","last_active":"2023-10-06T11:17:24.570755+0000","last_peered":"2023-10-06T11:17:24.570755+0000","last_clean":"2023-10-06T11:17:24.570755+0000","last_became_active":"2023-10-06T11:17:24.567763+0000","last_became_peered":"2023-10-06T11:17:24.567763+0000","last_unstale":"2023-10-06T11:17:24.570755+0000","last_undegraded":"2023-10-06T11:17:24.570755+0000","last_fullsized":"2023-10-06T11:17:24.570755+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:56.951675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575114+0000","last_change":"2023-10-06T11:17:24.573144+0000","last_active":"2023-10-06T11:17:24.575114+0000","last_peered":"2023-10-06T11:17:24.575114+0000","last_clean":"2023-10-06T11:17:24.575114+0000","last_became_active":"2023-10-06T11:17:24.572892+0000","last_became_peered":"2023-10-06T11:17:24.572892+0000","last_unstale":"2023-10-06T11:17:24.575114+0000","last_undegraded":"2023-10-06T11:17:24.575114+0000","last_fullsized":"2023-10-06T11:17:24.575114+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:15:52.609098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.580555+0000","last_change":"2023-10-06T11:17:24.571121+0000","last_active":"2023-10-06T11:17:24.580555+0000","last_peered":"2023-10-06T11:17:24.580555+0000","last_clean":"2023-10-06T11:17:24.580555+0000","last_became_active":"2023-10-06T11:17:24.570858+0000","last_became_peered":"2023-10-06T11:17:24.570858+0000","last_unstale":"2023-10-06T11:17:24.580555+0000","last_undegraded":"2023-10-06T11:17:24.580555+0000","last_fullsized":"2023-10-06T11:17:24.580555+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:32:17.113391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.573663+0000","last_change":"2023-10-06T11:17:24.568783+0000","last_active":"2023-10-06T11:17:24.573663+0000","last_peered":"2023-10-06T11:17:24.573663+0000","last_clean":"2023-10-06T11:17:24.573663+0000","last_became_active":"2023-10-06T11:17:24.565857+0000","last_became_peered":"2023-10-06T11:17:24.565857+0000","last_unstale":"2023-10-06T11:17:24.573663+0000","last_undegraded":"2023-10-06T11:17:24.573663+0000","last_fullsized":"2023-10-06T11:17:24.573663+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:11:22.690663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.574923+0000","last_change":"2023-10-06T11:17:24.571861+0000","last_active":"2023-10-06T11:17:24.574923+0000","last_peered":"2023-10-06T11:17:24.574923+0000","last_clean":"2023-10-06T11:17:24.574923+0000","last_became_active":"2023-10-06T11:17:24.571607+0000","last_became_peered":"2023-10-06T11:17:24.571607+0000","last_unstale":"2023-10-06T11:17:24.574923+0000","last_undegraded":"2023-10-06T11:17:24.574923+0000","last_fullsized":"2023-10-06T11:17:24.574923+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:55:29.624889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.568335+0000","last_change":"2023-10-06T11:17:24.567062+0000","last_active":"2023-10-06T11:17:24.568335+0000","last_peered":"2023-10-06T11:17:24.568335+0000","last_clean":"2023-10-06T11:17:24.568335+0000","last_became_active":"2023-10-06T11:17:24.566777+0000","last_became_peered":"2023-10-06T11:17:24.566777+0000","last_unstale":"2023-10-06T11:17:24.568335+0000","last_undegraded":"2023-10-06T11:17:24.568335+0000","last_fullsized":"2023-10-06T11:17:24.568335+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:20.201597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575852+0000","last_change":"2023-10-06T11:17:24.571498+0000","last_active":"2023-10-06T11:17:24.575852+0000","last_peered":"2023-10-06T11:17:24.575852+0000","last_clean":"2023-10-06T11:17:24.575852+0000","last_became_active":"2023-10-06T11:17:24.571243+0000","last_became_peered":"2023-10-06T11:17:24.571243+0000","last_unstale":"2023-10-06T11:17:24.575852+0000","last_undegraded":"2023-10-06T11:17:24.575852+0000","last_fullsized":"2023-10-06T11:17:24.575852+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:15:12.800687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575232+0000","last_change":"2023-10-06T11:17:24.574498+0000","last_active":"2023-10-06T11:17:24.575232+0000","last_peered":"2023-10-06T11:17:24.575232+0000","last_clean":"2023-10-06T11:17:24.575232+0000","last_became_active":"2023-10-06T11:17:24.574246+0000","last_became_peered":"2023-10-06T11:17:24.574246+0000","last_unstale":"2023-10-06T11:17:24.575232+0000","last_undegraded":"2023-10-06T11:17:24.575232+0000","last_fullsized":"2023-10-06T11:17:24.575232+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:07:54.294932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.574906+0000","last_change":"2023-10-06T11:17:24.571935+0000","last_active":"2023-10-06T11:17:24.574906+0000","last_peered":"2023-10-06T11:17:24.574906+0000","last_clean":"2023-10-06T11:17:24.574906+0000","last_became_active":"2023-10-06T11:17:24.571681+0000","last_became_peered":"2023-10-06T11:17:24.571681+0000","last_unstale":"2023-10-06T11:17:24.574906+0000","last_undegraded":"2023-10-06T11:17:24.574906+0000","last_fullsized":"2023-10-06T11:17:24.574906+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:56:17.624615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575898+0000","last_change":"2023-10-06T11:17:24.568125+0000","last_active":"2023-10-06T11:17:24.575898+0000","last_peered":"2023-10-06T11:17:24.575898+0000","last_clean":"2023-10-06T11:17:24.575898+0000","last_became_active":"2023-10-06T11:17:24.567809+0000","last_became_peered":"2023-10-06T11:17:24.567809+0000","last_unstale":"2023-10-06T11:17:24.575898+0000","last_undegraded":"2023-10-06T11:17:24.575898+0000","last_fullsized":"2023-10-06T11:17:24.575898+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:32:27.294341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.565724+0000","last_change":"2023-10-06T11:17:24.561075+0000","last_active":"2023-10-06T11:17:24.565724+0000","last_peered":"2023-10-06T11:17:24.565724+0000","last_clean":"2023-10-06T11:17:24.565724+0000","last_became_active":"2023-10-06T11:17:24.560699+0000","last_became_peered":"2023-10-06T11:17:24.560699+0000","last_unstale":"2023-10-06T11:17:24.565724+0000","last_undegraded":"2023-10-06T11:17:24.565724+0000","last_fullsized":"2023-10-06T11:17:24.565724+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:06:27.406680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.574973+0000","last_change":"2023-10-06T11:17:24.572835+0000","last_active":"2023-10-06T11:17:24.574973+0000","last_peered":"2023-10-06T11:17:24.574973+0000","last_clean":"2023-10-06T11:17:24.574973+0000","last_became_active":"2023-10-06T11:17:24.570204+0000","last_became_peered":"2023-10-06T11:17:24.570204+0000","last_unstale":"2023-10-06T11:17:24.574973+0000","last_undegraded":"2023-10-06T11:17:24.574973+0000","last_fullsized":"2023-10-06T11:17:24.574973+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:18.748550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.570377+0000","last_change":"2023-10-06T11:17:24.567291+0000","last_active":"2023-10-06T11:17:24.570377+0000","last_peered":"2023-10-06T11:17:24.570377+0000","last_clean":"2023-10-06T11:17:24.570377+0000","last_became_active":"2023-10-06T11:17:24.566984+0000","last_became_peered":"2023-10-06T11:17:24.566984+0000","last_unstale":"2023-10-06T11:17:24.570377+0000","last_undegraded":"2023-10-06T11:17:24.570377+0000","last_fullsized":"2023-10-06T11:17:24.570377+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:42:04.095734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.571794+0000","last_change":"2023-10-06T11:17:24.568240+0000","last_active":"2023-10-06T11:17:24.571794+0000","last_peered":"2023-10-06T11:17:24.571794+0000","last_clean":"2023-10-06T11:17:24.571794+0000","last_became_active":"2023-10-06T11:17:24.567647+0000","last_became_peered":"2023-10-06T11:17:24.567647+0000","last_unstale":"2023-10-06T11:17:24.571794+0000","last_undegraded":"2023-10-06T11:17:24.571794+0000","last_fullsized":"2023-10-06T11:17:24.571794+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:38.610243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.565288+0000","last_change":"2023-10-06T11:17:24.561095+0000","last_active":"2023-10-06T11:17:24.565288+0000","last_peered":"2023-10-06T11:17:24.565288+0000","last_clean":"2023-10-06T11:17:24.565288+0000","last_became_active":"2023-10-06T11:17:24.560834+0000","last_became_peered":"2023-10-06T11:17:24.560834+0000","last_unstale":"2023-10-06T11:17:24.565288+0000","last_undegraded":"2023-10-06T11:17:24.565288+0000","last_fullsized":"2023-10-06T11:17:24.565288+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:33:05.816585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.570099+0000","last_change":"2023-10-06T11:17:24.566087+0000","last_active":"2023-10-06T11:17:24.570099+0000","last_peered":"2023-10-06T11:17:24.570099+0000","last_clean":"2023-10-06T11:17:24.570099+0000","last_became_active":"2023-10-06T11:17:24.565836+0000","last_became_peered":"2023-10-06T11:17:24.565836+0000","last_unstale":"2023-10-06T11:17:24.570099+0000","last_undegraded":"2023-10-06T11:17:24.570099+0000","last_fullsized":"2023-10-06T11:17:24.570099+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:32:22.601435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575177+0000","last_change":"2023-10-06T11:17:24.574344+0000","last_active":"2023-10-06T11:17:24.575177+0000","last_peered":"2023-10-06T11:17:24.575177+0000","last_clean":"2023-10-06T11:17:24.575177+0000","last_became_active":"2023-10-06T11:17:24.570258+0000","last_became_peered":"2023-10-06T11:17:24.570258+0000","last_unstale":"2023-10-06T11:17:24.575177+0000","last_undegraded":"2023-10-06T11:17:24.575177+0000","last_fullsized":"2023-10-06T11:17:24.575177+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:56.951675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.565509+0000","last_change":"2023-10-06T11:17:24.561410+0000","last_active":"2023-10-06T11:17:24.565509+0000","last_peered":"2023-10-06T11:17:24.565509+0000","last_clean":"2023-10-06T11:17:24.565509+0000","last_became_active":"2023-10-06T11:17:24.561150+0000","last_became_peered":"2023-10-06T11:17:24.561150+0000","last_unstale":"2023-10-06T11:17:24.565509+0000","last_undegraded":"2023-10-06T11:17:24.565509+0000","last_fullsized":"2023-10-06T11:17:24.565509+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:03:32.754632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.579321+0000","last_change":"2023-10-06T11:17:24.576372+0000","last_active":"2023-10-06T11:17:24.579321+0000","last_peered":"2023-10-06T11:17:24.579321+0000","last_clean":"2023-10-06T11:17:24.579321+0000","last_became_active":"2023-10-06T11:17:24.575959+0000","last_became_peered":"2023-10-06T11:17:24.575959+0000","last_unstale":"2023-10-06T11:17:24.579321+0000","last_undegraded":"2023-10-06T11:17:24.579321+0000","last_fullsized":"2023-10-06T11:17:24.579321+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:01:59.076681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.572200+0000","last_change":"2023-10-06T11:17:24.570445+0000","last_active":"2023-10-06T11:17:24.572200+0000","last_peered":"2023-10-06T11:17:24.572200+0000","last_clean":"2023-10-06T11:17:24.572200+0000","last_became_active":"2023-10-06T11:17:24.569571+0000","last_became_peered":"2023-10-06T11:17:24.569571+0000","last_unstale":"2023-10-06T11:17:24.572200+0000","last_undegraded":"2023-10-06T11:17:24.572200+0000","last_fullsized":"2023-10-06T11:17:24.572200+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:13:56.199292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.571340+0000","last_change":"2023-10-06T11:17:24.567865+0000","last_active":"2023-10-06T11:17:24.571340+0000","last_peered":"2023-10-06T11:17:24.571340+0000","last_clean":"2023-10-06T11:17:24.571340+0000","last_became_active":"2023-10-06T11:17:24.567577+0000","last_became_peered":"2023-10-06T11:17:24.567577+0000","last_unstale":"2023-10-06T11:17:24.571340+0000","last_undegraded":"2023-10-06T11:17:24.571340+0000","last_fullsized":"2023-10-06T11:17:24.571340+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:38.610243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.573375+0000","last_change":"2023-10-06T11:17:24.571614+0000","last_active":"2023-10-06T11:17:24.573375+0000","last_peered":"2023-10-06T11:17:24.573375+0000","last_clean":"2023-10-06T11:17:24.573375+0000","last_became_active":"2023-10-06T11:17:24.571337+0000","last_became_peered":"2023-10-06T11:17:24.571337+0000","last_unstale":"2023-10-06T11:17:24.573375+0000","last_undegraded":"2023-10-06T11:17:24.573375+0000","last_fullsized":"2023-10-06T11:17:24.573375+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:06:16.172673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.579569+0000","last_change":"2023-10-06T11:17:24.577831+0000","last_active":"2023-10-06T11:17:24.579569+0000","last_peered":"2023-10-06T11:17:24.579569+0000","last_clean":"2023-10-06T11:17:24.579569+0000","last_became_active":"2023-10-06T11:17:24.577572+0000","last_became_peered":"2023-10-06T11:17:24.577572+0000","last_unstale":"2023-10-06T11:17:24.579569+0000","last_undegraded":"2023-10-06T11:17:24.579569+0000","last_fullsized":"2023-10-06T11:17:24.579569+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:48.792063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"150'4","reported_seq":14,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.584433+0000","last_change":"2023-10-06T11:17:23.564693+0000","last_active":"2023-10-06T11:17:24.584433+0000","last_peered":"2023-10-06T11:17:24.584433+0000","last_clean":"2023-10-06T11:17:24.584433+0000","last_became_active":"2023-10-06T11:17:23.564436+0000","last_became_peered":"2023-10-06T11:17:23.564436+0000","last_unstale":"2023-10-06T11:17:24.584433+0000","last_undegraded":"2023-10-06T11:17:24.584433+0000","last_fullsized":"2023-10-06T11:17:24.584433+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:01:34.348343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.573070+0000","last_change":"2023-10-06T11:17:24.565982+0000","last_active":"2023-10-06T11:17:24.573070+0000","last_peered":"2023-10-06T11:17:24.573070+0000","last_clean":"2023-10-06T11:17:24.573070+0000","last_became_active":"2023-10-06T11:17:24.565734+0000","last_became_peered":"2023-10-06T11:17:24.565734+0000","last_unstale":"2023-10-06T11:17:24.573070+0000","last_undegraded":"2023-10-06T11:17:24.573070+0000","last_fullsized":"2023-10-06T11:17:24.573070+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:33.751143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.582526+0000","last_change":"2023-10-06T11:17:23.569143+0000","last_active":"2023-10-06T11:17:24.582526+0000","last_peered":"2023-10-06T11:17:24.582526+0000","last_clean":"2023-10-06T11:17:24.582526+0000","last_became_active":"2023-10-06T11:17:23.568883+0000","last_became_peered":"2023-10-06T11:17:23.568883+0000","last_unstale":"2023-10-06T11:17:24.582526+0000","last_undegraded":"2023-10-06T11:17:24.582526+0000","last_fullsized":"2023-10-06T11:17:24.582526+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:33:04.810931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.569717+0000","last_change":"2023-10-06T11:17:24.565660+0000","last_active":"2023-10-06T11:17:24.569717+0000","last_peered":"2023-10-06T11:17:24.569717+0000","last_clean":"2023-10-06T11:17:24.569717+0000","last_became_active":"2023-10-06T11:17:24.564786+0000","last_became_peered":"2023-10-06T11:17:24.564786+0000","last_unstale":"2023-10-06T11:17:24.569717+0000","last_undegraded":"2023-10-06T11:17:24.569717+0000","last_fullsized":"2023-10-06T11:17:24.569717+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:51:39.405314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.581331+0000","last_change":"2023-10-06T11:17:23.567167+0000","last_active":"2023-10-06T11:17:24.581331+0000","last_peered":"2023-10-06T11:17:24.581331+0000","last_clean":"2023-10-06T11:17:24.581331+0000","last_became_active":"2023-10-06T11:17:23.566837+0000","last_became_peered":"2023-10-06T11:17:23.566837+0000","last_unstale":"2023-10-06T11:17:24.581331+0000","last_undegraded":"2023-10-06T11:17:24.581331+0000","last_fullsized":"2023-10-06T11:17:24.581331+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:02:19.001747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.579437+0000","last_change":"2023-10-06T11:17:24.576887+0000","last_active":"2023-10-06T11:17:24.579437+0000","last_peered":"2023-10-06T11:17:24.579437+0000","last_clean":"2023-10-06T11:17:24.579437+0000","last_became_active":"2023-10-06T11:17:24.576611+0000","last_became_peered":"2023-10-06T11:17:24.576611+0000","last_unstale":"2023-10-06T11:17:24.579437+0000","last_undegraded":"2023-10-06T11:17:24.579437+0000","last_fullsized":"2023-10-06T11:17:24.579437+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:08:07.693719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.580673+0000","last_change":"2023-10-06T11:17:23.569167+0000","last_active":"2023-10-06T11:17:24.580673+0000","last_peered":"2023-10-06T11:17:24.580673+0000","last_clean":"2023-10-06T11:17:24.580673+0000","last_became_active":"2023-10-06T11:17:23.568918+0000","last_became_peered":"2023-10-06T11:17:23.568918+0000","last_unstale":"2023-10-06T11:17:24.580673+0000","last_undegraded":"2023-10-06T11:17:24.580673+0000","last_fullsized":"2023-10-06T11:17:24.580673+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:36:10.273812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.576021+0000","last_change":"2023-10-06T11:17:24.572189+0000","last_active":"2023-10-06T11:17:24.576021+0000","last_peered":"2023-10-06T11:17:24.576021+0000","last_clean":"2023-10-06T11:17:24.576021+0000","last_became_active":"2023-10-06T11:17:24.571887+0000","last_became_peered":"2023-10-06T11:17:24.571887+0000","last_unstale":"2023-10-06T11:17:24.576021+0000","last_undegraded":"2023-10-06T11:17:24.576021+0000","last_fullsized":"2023-10-06T11:17:24.576021+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:15:11.263158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.582600+0000","last_change":"2023-10-06T11:17:23.571211+0000","last_active":"2023-10-06T11:17:24.582600+0000","last_peered":"2023-10-06T11:17:24.582600+0000","last_clean":"2023-10-06T11:17:24.582600+0000","last_became_active":"2023-10-06T11:17:23.570950+0000","last_became_peered":"2023-10-06T11:17:23.570950+0000","last_unstale":"2023-10-06T11:17:24.582600+0000","last_undegraded":"2023-10-06T11:17:24.582600+0000","last_fullsized":"2023-10-06T11:17:24.582600+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:55:05.030229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.570073+0000","last_change":"2023-10-06T11:17:24.565604+0000","last_active":"2023-10-06T11:17:24.570073+0000","last_peered":"2023-10-06T11:17:24.570073+0000","last_clean":"2023-10-06T11:17:24.570073+0000","last_became_active":"2023-10-06T11:17:24.565350+0000","last_became_peered":"2023-10-06T11:17:24.565350+0000","last_unstale":"2023-10-06T11:17:24.570073+0000","last_undegraded":"2023-10-06T11:17:24.570073+0000","last_fullsized":"2023-10-06T11:17:24.570073+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:15:45.424139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.582384+0000","last_change":"2023-10-06T11:17:23.574166+0000","last_active":"2023-10-06T11:17:24.582384+0000","last_peered":"2023-10-06T11:17:24.582384+0000","last_clean":"2023-10-06T11:17:24.582384+0000","last_became_active":"2023-10-06T11:17:23.573890+0000","last_became_peered":"2023-10-06T11:17:23.573890+0000","last_unstale":"2023-10-06T11:17:24.582384+0000","last_undegraded":"2023-10-06T11:17:24.582384+0000","last_fullsized":"2023-10-06T11:17:24.582384+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:03:31.748977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.576106+0000","last_change":"2023-10-06T11:17:24.568162+0000","last_active":"2023-10-06T11:17:24.576106+0000","last_peered":"2023-10-06T11:17:24.576106+0000","last_clean":"2023-10-06T11:17:24.576106+0000","last_became_active":"2023-10-06T11:17:24.567852+0000","last_became_peered":"2023-10-06T11:17:24.567852+0000","last_unstale":"2023-10-06T11:17:24.576106+0000","last_undegraded":"2023-10-06T11:17:24.576106+0000","last_fullsized":"2023-10-06T11:17:24.576106+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:55.042996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.559880+0000","last_change":"2023-10-06T11:17:23.564753+0000","last_active":"2023-10-06T11:17:24.559880+0000","last_peered":"2023-10-06T11:17:24.559880+0000","last_clean":"2023-10-06T11:17:24.559880+0000","last_became_active":"2023-10-06T11:17:23.564344+0000","last_became_peered":"2023-10-06T11:17:23.564344+0000","last_unstale":"2023-10-06T11:17:24.559880+0000","last_undegraded":"2023-10-06T11:17:24.559880+0000","last_fullsized":"2023-10-06T11:17:24.559880+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:16:28.786528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.571431+0000","last_change":"2023-10-06T11:17:24.568900+0000","last_active":"2023-10-06T11:17:24.571431+0000","last_peered":"2023-10-06T11:17:24.571431+0000","last_clean":"2023-10-06T11:17:24.571431+0000","last_became_active":"2023-10-06T11:17:24.568618+0000","last_became_peered":"2023-10-06T11:17:24.568618+0000","last_unstale":"2023-10-06T11:17:24.571431+0000","last_undegraded":"2023-10-06T11:17:24.571431+0000","last_fullsized":"2023-10-06T11:17:24.571431+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:31:49.318112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.562967+0000","last_change":"2023-10-06T11:17:23.569866+0000","last_active":"2023-10-06T11:17:24.562967+0000","last_peered":"2023-10-06T11:17:24.562967+0000","last_clean":"2023-10-06T11:17:24.562967+0000","last_became_active":"2023-10-06T11:17:23.569610+0000","last_became_peered":"2023-10-06T11:17:23.569610+0000","last_unstale":"2023-10-06T11:17:24.562967+0000","last_undegraded":"2023-10-06T11:17:24.562967+0000","last_fullsized":"2023-10-06T11:17:24.562967+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:48:47.471367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.571421+0000","last_change":"2023-10-06T11:17:24.567485+0000","last_active":"2023-10-06T11:17:24.571421+0000","last_peered":"2023-10-06T11:17:24.571421+0000","last_clean":"2023-10-06T11:17:24.571421+0000","last_became_active":"2023-10-06T11:17:24.567206+0000","last_became_peered":"2023-10-06T11:17:24.567206+0000","last_unstale":"2023-10-06T11:17:24.571421+0000","last_undegraded":"2023-10-06T11:17:24.571421+0000","last_fullsized":"2023-10-06T11:17:24.571421+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:11:12.692922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.584220+0000","last_change":"2023-10-06T11:17:23.570528+0000","last_active":"2023-10-06T11:17:24.584220+0000","last_peered":"2023-10-06T11:17:24.584220+0000","last_clean":"2023-10-06T11:17:24.584220+0000","last_became_active":"2023-10-06T11:17:23.569805+0000","last_became_peered":"2023-10-06T11:17:23.569805+0000","last_unstale":"2023-10-06T11:17:24.584220+0000","last_undegraded":"2023-10-06T11:17:24.584220+0000","last_fullsized":"2023-10-06T11:17:24.584220+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:47.786408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.573731+0000","last_change":"2023-10-06T11:17:24.572752+0000","last_active":"2023-10-06T11:17:24.573731+0000","last_peered":"2023-10-06T11:17:24.573731+0000","last_clean":"2023-10-06T11:17:24.573731+0000","last_became_active":"2023-10-06T11:17:24.572505+0000","last_became_peered":"2023-10-06T11:17:24.572505+0000","last_unstale":"2023-10-06T11:17:24.573731+0000","last_undegraded":"2023-10-06T11:17:24.573731+0000","last_fullsized":"2023-10-06T11:17:24.573731+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:56:46.796339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.582411+0000","last_change":"2023-10-06T11:17:23.569885+0000","last_active":"2023-10-06T11:17:24.582411+0000","last_peered":"2023-10-06T11:17:24.582411+0000","last_clean":"2023-10-06T11:17:24.582411+0000","last_became_active":"2023-10-06T11:17:23.569403+0000","last_became_peered":"2023-10-06T11:17:23.569403+0000","last_unstale":"2023-10-06T11:17:24.582411+0000","last_undegraded":"2023-10-06T11:17:24.582411+0000","last_fullsized":"2023-10-06T11:17:24.582411+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:58:24.567254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.566193+0000","last_change":"2023-10-06T11:17:24.560745+0000","last_active":"2023-10-06T11:17:24.566193+0000","last_peered":"2023-10-06T11:17:24.566193+0000","last_clean":"2023-10-06T11:17:24.566193+0000","last_became_active":"2023-10-06T11:17:24.560494+0000","last_became_peered":"2023-10-06T11:17:24.560494+0000","last_unstale":"2023-10-06T11:17:24.566193+0000","last_undegraded":"2023-10-06T11:17:24.566193+0000","last_fullsized":"2023-10-06T11:17:24.566193+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:36:51.480975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.584634+0000","last_change":"2023-10-06T11:17:23.567691+0000","last_active":"2023-10-06T11:17:24.584634+0000","last_peered":"2023-10-06T11:17:24.584634+0000","last_clean":"2023-10-06T11:17:24.584634+0000","last_became_active":"2023-10-06T11:17:23.567421+0000","last_became_peered":"2023-10-06T11:17:23.567421+0000","last_unstale":"2023-10-06T11:17:24.584634+0000","last_undegraded":"2023-10-06T11:17:24.584634+0000","last_fullsized":"2023-10-06T11:17:24.584634+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:04:18.984996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.570793+0000","last_change":"2023-10-06T11:17:24.568416+0000","last_active":"2023-10-06T11:17:24.570793+0000","last_peered":"2023-10-06T11:17:24.570793+0000","last_clean":"2023-10-06T11:17:24.570793+0000","last_became_active":"2023-10-06T11:17:24.568134+0000","last_became_peered":"2023-10-06T11:17:24.568134+0000","last_unstale":"2023-10-06T11:17:24.570793+0000","last_undegraded":"2023-10-06T11:17:24.570793+0000","last_fullsized":"2023-10-06T11:17:24.570793+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:09.705291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.563087+0000","last_change":"2023-10-06T11:17:23.565748+0000","last_active":"2023-10-06T11:17:24.563087+0000","last_peered":"2023-10-06T11:17:24.563087+0000","last_clean":"2023-10-06T11:17:24.563087+0000","last_became_active":"2023-10-06T11:17:23.565303+0000","last_became_peered":"2023-10-06T11:17:23.565303+0000","last_unstale":"2023-10-06T11:17:24.563087+0000","last_undegraded":"2023-10-06T11:17:24.563087+0000","last_fullsized":"2023-10-06T11:17:24.563087+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:22:25.530859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.565528+0000","last_change":"2023-10-06T11:17:24.563167+0000","last_active":"2023-10-06T11:17:24.565528+0000","last_peered":"2023-10-06T11:17:24.565528+0000","last_clean":"2023-10-06T11:17:24.565528+0000","last_became_active":"2023-10-06T11:17:24.562916+0000","last_became_peered":"2023-10-06T11:17:24.562916+0000","last_unstale":"2023-10-06T11:17:24.565528+0000","last_undegraded":"2023-10-06T11:17:24.565528+0000","last_fullsized":"2023-10-06T11:17:24.565528+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:07.151312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.582310+0000","last_change":"2023-10-06T11:17:23.564393+0000","last_active":"2023-10-06T11:17:24.582310+0000","last_peered":"2023-10-06T11:17:24.582310+0000","last_clean":"2023-10-06T11:17:24.582310+0000","last_became_active":"2023-10-06T11:17:23.564170+0000","last_became_peered":"2023-10-06T11:17:23.564170+0000","last_unstale":"2023-10-06T11:17:24.582310+0000","last_undegraded":"2023-10-06T11:17:24.582310+0000","last_fullsized":"2023-10-06T11:17:24.582310+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:06:26.401026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.576850+0000","last_change":"2023-10-06T11:17:24.573793+0000","last_active":"2023-10-06T11:17:24.576850+0000","last_peered":"2023-10-06T11:17:24.576850+0000","last_clean":"2023-10-06T11:17:24.576850+0000","last_became_active":"2023-10-06T11:17:24.572324+0000","last_became_peered":"2023-10-06T11:17:24.572324+0000","last_unstale":"2023-10-06T11:17:24.576850+0000","last_undegraded":"2023-10-06T11:17:24.576850+0000","last_fullsized":"2023-10-06T11:17:24.576850+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:46:42.885085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.557151+0000","last_change":"2023-10-06T11:17:23.574712+0000","last_active":"2023-10-06T11:17:24.557151+0000","last_peered":"2023-10-06T11:17:24.557151+0000","last_clean":"2023-10-06T11:17:24.557151+0000","last_became_active":"2023-10-06T11:17:23.574435+0000","last_became_peered":"2023-10-06T11:17:23.574435+0000","last_unstale":"2023-10-06T11:17:24.557151+0000","last_undegraded":"2023-10-06T11:17:24.557151+0000","last_fullsized":"2023-10-06T11:17:24.557151+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:22:25.530859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.576306+0000","last_change":"2023-10-06T11:17:24.571701+0000","last_active":"2023-10-06T11:17:24.576306+0000","last_peered":"2023-10-06T11:17:24.576306+0000","last_clean":"2023-10-06T11:17:24.576306+0000","last_became_active":"2023-10-06T11:17:24.571457+0000","last_became_peered":"2023-10-06T11:17:24.571457+0000","last_unstale":"2023-10-06T11:17:24.576306+0000","last_undegraded":"2023-10-06T11:17:24.576306+0000","last_fullsized":"2023-10-06T11:17:24.576306+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:45:28.551838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.559974+0000","last_change":"2023-10-06T11:17:23.564865+0000","last_active":"2023-10-06T11:17:24.559974+0000","last_peered":"2023-10-06T11:17:24.559974+0000","last_clean":"2023-10-06T11:17:24.559974+0000","last_became_active":"2023-10-06T11:17:23.564694+0000","last_became_peered":"2023-10-06T11:17:23.564694+0000","last_unstale":"2023-10-06T11:17:24.559974+0000","last_undegraded":"2023-10-06T11:17:24.559974+0000","last_fullsized":"2023-10-06T11:17:24.559974+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:11.629965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.576583+0000","last_change":"2023-10-06T11:17:24.575646+0000","last_active":"2023-10-06T11:17:24.576583+0000","last_peered":"2023-10-06T11:17:24.576583+0000","last_clean":"2023-10-06T11:17:24.576583+0000","last_became_active":"2023-10-06T11:17:24.570344+0000","last_became_peered":"2023-10-06T11:17:24.570344+0000","last_unstale":"2023-10-06T11:17:24.576583+0000","last_undegraded":"2023-10-06T11:17:24.576583+0000","last_fullsized":"2023-10-06T11:17:24.576583+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:38.610243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.566184+0000","last_change":"2023-10-06T11:17:23.574083+0000","last_active":"2023-10-06T11:17:24.566184+0000","last_peered":"2023-10-06T11:17:24.566184+0000","last_clean":"2023-10-06T11:17:24.566184+0000","last_became_active":"2023-10-06T11:17:23.573768+0000","last_became_peered":"2023-10-06T11:17:23.573768+0000","last_unstale":"2023-10-06T11:17:24.566184+0000","last_undegraded":"2023-10-06T11:17:24.566184+0000","last_fullsized":"2023-10-06T11:17:24.566184+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:32:36.073066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.570609+0000","last_change":"2023-10-06T11:17:24.567062+0000","last_active":"2023-10-06T11:17:24.570609+0000","last_peered":"2023-10-06T11:17:24.570609+0000","last_clean":"2023-10-06T11:17:24.570609+0000","last_became_active":"2023-10-06T11:17:24.566801+0000","last_became_peered":"2023-10-06T11:17:24.566801+0000","last_unstale":"2023-10-06T11:17:24.570609+0000","last_undegraded":"2023-10-06T11:17:24.570609+0000","last_fullsized":"2023-10-06T11:17:24.570609+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:31:49.318112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.584283+0000","last_change":"2023-10-06T11:17:23.564402+0000","last_active":"2023-10-06T11:17:24.584283+0000","last_peered":"2023-10-06T11:17:24.584283+0000","last_clean":"2023-10-06T11:17:24.584283+0000","last_became_active":"2023-10-06T11:17:23.564113+0000","last_became_peered":"2023-10-06T11:17:23.564113+0000","last_unstale":"2023-10-06T11:17:24.584283+0000","last_undegraded":"2023-10-06T11:17:24.584283+0000","last_fullsized":"2023-10-06T11:17:24.584283+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:53:59.261371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575789+0000","last_change":"2023-10-06T11:17:24.570147+0000","last_active":"2023-10-06T11:17:24.575789+0000","last_peered":"2023-10-06T11:17:24.575789+0000","last_clean":"2023-10-06T11:17:24.575789+0000","last_became_active":"2023-10-06T11:17:24.569601+0000","last_became_peered":"2023-10-06T11:17:24.569601+0000","last_unstale":"2023-10-06T11:17:24.575789+0000","last_undegraded":"2023-10-06T11:17:24.575789+0000","last_fullsized":"2023-10-06T11:17:24.575789+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:22:20.066646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.555158+0000","last_change":"2023-10-06T11:17:23.570514+0000","last_active":"2023-10-06T11:17:24.555158+0000","last_peered":"2023-10-06T11:17:24.555158+0000","last_clean":"2023-10-06T11:17:24.555158+0000","last_became_active":"2023-10-06T11:17:23.570179+0000","last_became_peered":"2023-10-06T11:17:23.570179+0000","last_unstale":"2023-10-06T11:17:24.555158+0000","last_undegraded":"2023-10-06T11:17:24.555158+0000","last_fullsized":"2023-10-06T11:17:24.555158+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:08:06.688065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575970+0000","last_change":"2023-10-06T11:17:24.566933+0000","last_active":"2023-10-06T11:17:24.575970+0000","last_peered":"2023-10-06T11:17:24.575970+0000","last_clean":"2023-10-06T11:17:24.575970+0000","last_became_active":"2023-10-06T11:17:24.566764+0000","last_became_peered":"2023-10-06T11:17:24.566764+0000","last_unstale":"2023-10-06T11:17:24.575970+0000","last_undegraded":"2023-10-06T11:17:24.575970+0000","last_fullsized":"2023-10-06T11:17:24.575970+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:21:32.239463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.554770+0000","last_change":"2023-10-06T11:17:23.571952+0000","last_active":"2023-10-06T11:17:24.554770+0000","last_peered":"2023-10-06T11:17:24.554770+0000","last_clean":"2023-10-06T11:17:24.554770+0000","last_became_active":"2023-10-06T11:17:23.565102+0000","last_became_peered":"2023-10-06T11:17:23.565102+0000","last_unstale":"2023-10-06T11:17:24.554770+0000","last_undegraded":"2023-10-06T11:17:24.554770+0000","last_fullsized":"2023-10-06T11:17:24.554770+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:11:11.687267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.572885+0000","last_change":"2023-10-06T11:17:24.569341+0000","last_active":"2023-10-06T11:17:24.572885+0000","last_peered":"2023-10-06T11:17:24.572885+0000","last_clean":"2023-10-06T11:17:24.572885+0000","last_became_active":"2023-10-06T11:17:24.569094+0000","last_became_peered":"2023-10-06T11:17:24.569094+0000","last_unstale":"2023-10-06T11:17:24.572885+0000","last_undegraded":"2023-10-06T11:17:24.572885+0000","last_fullsized":"2023-10-06T11:17:24.572885+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:15:52.609098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.560119+0000","last_change":"2023-10-06T11:17:23.569219+0000","last_active":"2023-10-06T11:17:24.560119+0000","last_peered":"2023-10-06T11:17:24.560119+0000","last_clean":"2023-10-06T11:17:24.560119+0000","last_became_active":"2023-10-06T11:17:23.568946+0000","last_became_peered":"2023-10-06T11:17:23.568946+0000","last_unstale":"2023-10-06T11:17:24.560119+0000","last_undegraded":"2023-10-06T11:17:24.560119+0000","last_fullsized":"2023-10-06T11:17:24.560119+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:12:28.041975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.571902+0000","last_change":"2023-10-06T11:17:24.569808+0000","last_active":"2023-10-06T11:17:24.571902+0000","last_peered":"2023-10-06T11:17:24.571902+0000","last_clean":"2023-10-06T11:17:24.571902+0000","last_became_active":"2023-10-06T11:17:24.569380+0000","last_became_peered":"2023-10-06T11:17:24.569380+0000","last_unstale":"2023-10-06T11:17:24.571902+0000","last_undegraded":"2023-10-06T11:17:24.571902+0000","last_fullsized":"2023-10-06T11:17:24.571902+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:18.748550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.558165+0000","last_change":"2023-10-06T11:17:23.564135+0000","last_active":"2023-10-06T11:17:24.558165+0000","last_peered":"2023-10-06T11:17:24.558165+0000","last_clean":"2023-10-06T11:17:24.558165+0000","last_became_active":"2023-10-06T11:17:23.563797+0000","last_became_peered":"2023-10-06T11:17:23.563797+0000","last_unstale":"2023-10-06T11:17:24.558165+0000","last_undegraded":"2023-10-06T11:17:24.558165+0000","last_fullsized":"2023-10-06T11:17:24.558165+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:09.701424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.579474+0000","last_change":"2023-10-06T11:17:24.577355+0000","last_active":"2023-10-06T11:17:24.579474+0000","last_peered":"2023-10-06T11:17:24.579474+0000","last_clean":"2023-10-06T11:17:24.579474+0000","last_became_active":"2023-10-06T11:17:24.577095+0000","last_became_peered":"2023-10-06T11:17:24.577095+0000","last_unstale":"2023-10-06T11:17:24.579474+0000","last_undegraded":"2023-10-06T11:17:24.579474+0000","last_fullsized":"2023-10-06T11:17:24.579474+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:15:11.263158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.554819+0000","last_change":"2023-10-06T11:17:23.562075+0000","last_active":"2023-10-06T11:17:24.554819+0000","last_peered":"2023-10-06T11:17:24.554819+0000","last_clean":"2023-10-06T11:17:24.554819+0000","last_became_active":"2023-10-06T11:17:23.561792+0000","last_became_peered":"2023-10-06T11:17:23.561792+0000","last_unstale":"2023-10-06T11:17:24.554819+0000","last_undegraded":"2023-10-06T11:17:24.554819+0000","last_fullsized":"2023-10-06T11:17:24.554819+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:08.699637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.567434+0000","last_change":"2023-10-06T11:17:24.560966+0000","last_active":"2023-10-06T11:17:24.567434+0000","last_peered":"2023-10-06T11:17:24.567434+0000","last_clean":"2023-10-06T11:17:24.567434+0000","last_became_active":"2023-10-06T11:17:24.560664+0000","last_became_peered":"2023-10-06T11:17:24.560664+0000","last_unstale":"2023-10-06T11:17:24.567434+0000","last_undegraded":"2023-10-06T11:17:24.567434+0000","last_fullsized":"2023-10-06T11:17:24.567434+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:41:38.833103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.558951+0000","last_change":"2023-10-06T11:17:23.567100+0000","last_active":"2023-10-06T11:17:24.558951+0000","last_peered":"2023-10-06T11:17:24.558951+0000","last_clean":"2023-10-06T11:17:24.558951+0000","last_became_active":"2023-10-06T11:17:23.566811+0000","last_became_peered":"2023-10-06T11:17:23.566811+0000","last_unstale":"2023-10-06T11:17:24.558951+0000","last_undegraded":"2023-10-06T11:17:24.558951+0000","last_fullsized":"2023-10-06T11:17:24.558951+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:11:04.566108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575944+0000","last_change":"2023-10-06T11:17:24.567836+0000","last_active":"2023-10-06T11:17:24.575944+0000","last_peered":"2023-10-06T11:17:24.575944+0000","last_clean":"2023-10-06T11:17:24.575944+0000","last_became_active":"2023-10-06T11:17:24.567579+0000","last_became_peered":"2023-10-06T11:17:24.567579+0000","last_unstale":"2023-10-06T11:17:24.575944+0000","last_undegraded":"2023-10-06T11:17:24.575944+0000","last_fullsized":"2023-10-06T11:17:24.575944+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:02:58.843409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.558726+0000","last_change":"2023-10-06T11:17:23.569068+0000","last_active":"2023-10-06T11:17:24.558726+0000","last_peered":"2023-10-06T11:17:24.558726+0000","last_clean":"2023-10-06T11:17:24.558726+0000","last_became_active":"2023-10-06T11:17:23.568821+0000","last_became_peered":"2023-10-06T11:17:23.568821+0000","last_unstale":"2023-10-06T11:17:24.558726+0000","last_undegraded":"2023-10-06T11:17:24.558726+0000","last_fullsized":"2023-10-06T11:17:24.558726+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:08:53.820378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.573345+0000","last_change":"2023-10-06T11:17:24.571813+0000","last_active":"2023-10-06T11:17:24.573345+0000","last_peered":"2023-10-06T11:17:24.573345+0000","last_clean":"2023-10-06T11:17:24.573345+0000","last_became_active":"2023-10-06T11:17:24.571369+0000","last_became_peered":"2023-10-06T11:17:24.571369+0000","last_unstale":"2023-10-06T11:17:24.573345+0000","last_undegraded":"2023-10-06T11:17:24.573345+0000","last_fullsized":"2023-10-06T11:17:24.573345+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:42:22.093331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.587184+0000","last_change":"2023-10-06T11:17:23.567296+0000","last_active":"2023-10-06T11:17:24.587184+0000","last_peered":"2023-10-06T11:17:24.587184+0000","last_clean":"2023-10-06T11:17:24.587184+0000","last_became_active":"2023-10-06T11:17:23.566993+0000","last_became_peered":"2023-10-06T11:17:23.566993+0000","last_unstale":"2023-10-06T11:17:24.587184+0000","last_undegraded":"2023-10-06T11:17:24.587184+0000","last_fullsized":"2023-10-06T11:17:24.587184+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:06.145658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":131,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.557891+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:17:24.557891+0000","last_peered":"2023-10-06T11:17:24.557891+0000","last_clean":"2023-10-06T11:17:24.557891+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:17:24.557891+0000","last_undegraded":"2023-10-06T11:17:24.557891+0000","last_fullsized":"2023-10-06T11:17:24.557891+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575891+0000","last_change":"2023-10-06T11:17:24.570948+0000","last_active":"2023-10-06T11:17:24.575891+0000","last_peered":"2023-10-06T11:17:24.575891+0000","last_clean":"2023-10-06T11:17:24.575891+0000","last_became_active":"2023-10-06T11:17:24.570719+0000","last_became_peered":"2023-10-06T11:17:24.570719+0000","last_unstale":"2023-10-06T11:17:24.575891+0000","last_undegraded":"2023-10-06T11:17:24.575891+0000","last_fullsized":"2023-10-06T11:17:24.575891+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:56:17.624615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.554724+0000","last_change":"2023-10-06T11:17:23.564126+0000","last_active":"2023-10-06T11:17:24.554724+0000","last_peered":"2023-10-06T11:17:24.554724+0000","last_clean":"2023-10-06T11:17:24.554724+0000","last_became_active":"2023-10-06T11:17:23.563881+0000","last_became_peered":"2023-10-06T11:17:23.563881+0000","last_unstale":"2023-10-06T11:17:24.554724+0000","last_undegraded":"2023-10-06T11:17:24.554724+0000","last_fullsized":"2023-10-06T11:17:24.554724+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:55.946021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":124,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.555311+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:17:24.555311+0000","last_peered":"2023-10-06T11:17:24.555311+0000","last_clean":"2023-10-06T11:17:24.555311+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:17:24.555311+0000","last_undegraded":"2023-10-06T11:17:24.555311+0000","last_fullsized":"2023-10-06T11:17:24.555311+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.580493+0000","last_change":"2023-10-06T11:17:24.569576+0000","last_active":"2023-10-06T11:17:24.580493+0000","last_peered":"2023-10-06T11:17:24.580493+0000","last_clean":"2023-10-06T11:17:24.580493+0000","last_became_active":"2023-10-06T11:17:24.569315+0000","last_became_peered":"2023-10-06T11:17:24.569315+0000","last_unstale":"2023-10-06T11:17:24.580493+0000","last_undegraded":"2023-10-06T11:17:24.580493+0000","last_fullsized":"2023-10-06T11:17:24.580493+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:23.035153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"150'3","reported_seq":13,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.584410+0000","last_change":"2023-10-06T11:17:23.564149+0000","last_active":"2023-10-06T11:17:24.584410+0000","last_peered":"2023-10-06T11:17:24.584410+0000","last_clean":"2023-10-06T11:17:24.584410+0000","last_became_active":"2023-10-06T11:17:23.563857+0000","last_became_peered":"2023-10-06T11:17:23.563857+0000","last_unstale":"2023-10-06T11:17:24.584410+0000","last_undegraded":"2023-10-06T11:17:24.584410+0000","last_fullsized":"2023-10-06T11:17:24.584410+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:55:05.030229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":122,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.562938+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:17:24.562938+0000","last_peered":"2023-10-06T11:17:24.562938+0000","last_clean":"2023-10-06T11:17:24.562938+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:17:24.562938+0000","last_undegraded":"2023-10-06T11:17:24.562938+0000","last_fullsized":"2023-10-06T11:17:24.562938+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":267,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.566276+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:17:24.566276+0000","last_peered":"2023-10-06T11:17:24.566276+0000","last_clean":"2023-10-06T11:17:24.566276+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:17:24.566276+0000","last_undegraded":"2023-10-06T11:17:24.566276+0000","last_fullsized":"2023-10-06T11:17:24.566276+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575929+0000","last_change":"2023-10-06T11:17:24.567759+0000","last_active":"2023-10-06T11:17:24.575929+0000","last_peered":"2023-10-06T11:17:24.575929+0000","last_clean":"2023-10-06T11:17:24.575929+0000","last_became_active":"2023-10-06T11:17:24.567496+0000","last_became_peered":"2023-10-06T11:17:24.567496+0000","last_unstale":"2023-10-06T11:17:24.575929+0000","last_undegraded":"2023-10-06T11:17:24.575929+0000","last_fullsized":"2023-10-06T11:17:24.575929+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:25:25.920939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"150'6","reported_seq":16,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.586312+0000","last_change":"2023-10-06T11:17:23.570090+0000","last_active":"2023-10-06T11:17:24.586312+0000","last_peered":"2023-10-06T11:17:24.586312+0000","last_clean":"2023-10-06T11:17:24.586312+0000","last_became_active":"2023-10-06T11:17:23.569829+0000","last_became_peered":"2023-10-06T11:17:23.569829+0000","last_unstale":"2023-10-06T11:17:24.586312+0000","last_undegraded":"2023-10-06T11:17:24.586312+0000","last_fullsized":"2023-10-06T11:17:24.586312+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:15:10.257503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":117,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.563929+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:17:24.563929+0000","last_peered":"2023-10-06T11:17:24.563929+0000","last_clean":"2023-10-06T11:17:24.563929+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:17:24.563929+0000","last_undegraded":"2023-10-06T11:17:24.563929+0000","last_fullsized":"2023-10-06T11:17:24.563929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.579240+0000","last_change":"2023-10-06T11:17:24.575811+0000","last_active":"2023-10-06T11:17:24.579240+0000","last_peered":"2023-10-06T11:17:24.579240+0000","last_clean":"2023-10-06T11:17:24.579240+0000","last_became_active":"2023-10-06T11:17:24.570303+0000","last_became_peered":"2023-10-06T11:17:24.570303+0000","last_unstale":"2023-10-06T11:17:24.579240+0000","last_undegraded":"2023-10-06T11:17:24.579240+0000","last_fullsized":"2023-10-06T11:17:24.579240+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:59:56.385931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.555042+0000","last_change":"2023-10-06T11:17:23.570382+0000","last_active":"2023-10-06T11:17:24.555042+0000","last_peered":"2023-10-06T11:17:24.555042+0000","last_clean":"2023-10-06T11:17:24.555042+0000","last_became_active":"2023-10-06T11:17:23.569847+0000","last_became_peered":"2023-10-06T11:17:23.569847+0000","last_unstale":"2023-10-06T11:17:24.555042+0000","last_undegraded":"2023-10-06T11:17:24.555042+0000","last_fullsized":"2023-10-06T11:17:24.555042+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:15:11.795033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":117,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.566358+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:17:24.566358+0000","last_peered":"2023-10-06T11:17:24.566358+0000","last_clean":"2023-10-06T11:17:24.566358+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:17:24.566358+0000","last_undegraded":"2023-10-06T11:17:24.566358+0000","last_fullsized":"2023-10-06T11:17:24.566358+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.579416+0000","last_change":"2023-10-06T11:17:24.576816+0000","last_active":"2023-10-06T11:17:24.579416+0000","last_peered":"2023-10-06T11:17:24.579416+0000","last_clean":"2023-10-06T11:17:24.579416+0000","last_became_active":"2023-10-06T11:17:24.576459+0000","last_became_peered":"2023-10-06T11:17:24.576459+0000","last_unstale":"2023-10-06T11:17:24.579416+0000","last_undegraded":"2023-10-06T11:17:24.579416+0000","last_fullsized":"2023-10-06T11:17:24.579416+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:15:12.800687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.555532+0000","last_change":"2023-10-06T11:17:23.570674+0000","last_active":"2023-10-06T11:17:24.555532+0000","last_peered":"2023-10-06T11:17:24.555532+0000","last_clean":"2023-10-06T11:17:24.555532+0000","last_became_active":"2023-10-06T11:17:23.570308+0000","last_became_peered":"2023-10-06T11:17:23.570308+0000","last_unstale":"2023-10-06T11:17:24.555532+0000","last_undegraded":"2023-10-06T11:17:24.555532+0000","last_fullsized":"2023-10-06T11:17:24.555532+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:59:55.380277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":140,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.559017+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:17:24.559017+0000","last_peered":"2023-10-06T11:17:24.559017+0000","last_clean":"2023-10-06T11:17:24.559017+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:17:24.559017+0000","last_undegraded":"2023-10-06T11:17:24.559017+0000","last_fullsized":"2023-10-06T11:17:24.559017+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575922+0000","last_change":"2023-10-06T11:17:24.566665+0000","last_active":"2023-10-06T11:17:24.575922+0000","last_peered":"2023-10-06T11:17:24.575922+0000","last_clean":"2023-10-06T11:17:24.575922+0000","last_became_active":"2023-10-06T11:17:24.566426+0000","last_became_peered":"2023-10-06T11:17:24.566426+0000","last_unstale":"2023-10-06T11:17:24.575922+0000","last_undegraded":"2023-10-06T11:17:24.575922+0000","last_fullsized":"2023-10-06T11:17:24.575922+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:29:19.469513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"150'8","reported_seq":18,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.587514+0000","last_change":"2023-10-06T11:17:23.568131+0000","last_active":"2023-10-06T11:17:24.587514+0000","last_peered":"2023-10-06T11:17:24.587514+0000","last_clean":"2023-10-06T11:17:24.587514+0000","last_became_active":"2023-10-06T11:17:23.567954+0000","last_became_peered":"2023-10-06T11:17:23.567954+0000","last_unstale":"2023-10-06T11:17:24.587514+0000","last_undegraded":"2023-10-06T11:17:24.587514+0000","last_fullsized":"2023-10-06T11:17:24.587514+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:45.678850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":124,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.566824+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:17:24.566824+0000","last_peered":"2023-10-06T11:17:24.566824+0000","last_clean":"2023-10-06T11:17:24.566824+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:17:24.566824+0000","last_undegraded":"2023-10-06T11:17:24.566824+0000","last_fullsized":"2023-10-06T11:17:24.566824+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.570686+0000","last_change":"2023-10-06T11:17:24.567445+0000","last_active":"2023-10-06T11:17:24.570686+0000","last_peered":"2023-10-06T11:17:24.570686+0000","last_clean":"2023-10-06T11:17:24.570686+0000","last_became_active":"2023-10-06T11:17:24.567192+0000","last_became_peered":"2023-10-06T11:17:24.567192+0000","last_unstale":"2023-10-06T11:17:24.570686+0000","last_undegraded":"2023-10-06T11:17:24.570686+0000","last_fullsized":"2023-10-06T11:17:24.570686+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:20.201597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.558847+0000","last_change":"2023-10-06T11:17:23.565830+0000","last_active":"2023-10-06T11:17:24.558847+0000","last_peered":"2023-10-06T11:17:24.558847+0000","last_clean":"2023-10-06T11:17:24.558847+0000","last_became_active":"2023-10-06T11:17:23.565544+0000","last_became_peered":"2023-10-06T11:17:23.565544+0000","last_unstale":"2023-10-06T11:17:24.558847+0000","last_undegraded":"2023-10-06T11:17:24.558847+0000","last_fullsized":"2023-10-06T11:17:24.558847+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:45.678850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":124,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.566899+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:17:24.566899+0000","last_peered":"2023-10-06T11:17:24.566899+0000","last_clean":"2023-10-06T11:17:24.566899+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:17:24.566899+0000","last_undegraded":"2023-10-06T11:17:24.566899+0000","last_fullsized":"2023-10-06T11:17:24.566899+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574993,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303816,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068024,"statfs":{"total":96636764160,"available":96325656576,"internally_reserved":0,"allocated":2490368,"data_stored":1465114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.54300000000000004,"15min":0.626},"min":{"1min":0.35699999999999998,"5min":0.252,"15min":0.21199999999999999},"max":{"1min":0.71699999999999997,"5min":4.407,"15min":23.908999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.51400000000000001,"15min":0.57499999999999996},"min":{"1min":0.33200000000000002,"5min":0.26900000000000002,"15min":0.22500000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":9.3230000000000004},"last":0.628}]},{"osd":1,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53700000000000003,"15min":0.56000000000000005},"min":{"1min":0.28799999999999998,"5min":0.28399999999999997,"15min":0.26000000000000001},"max":{"1min":0.77700000000000002,"5min":2.4689999999999999,"15min":9.2360000000000007},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.502,"15min":0.504},"min":{"1min":0.40999999999999998,"5min":0.33100000000000002,"15min":0.25900000000000001},"max":{"1min":0.70899999999999996,"5min":0.78900000000000003,"15min":4.327},"last":0.499}]},{"osd":2,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56899999999999995,"15min":0.51900000000000002},"min":{"1min":0.40100000000000002,"5min":0.33000000000000002,"15min":0.26500000000000001},"max":{"1min":0.69999999999999996,"5min":4.3120000000000003,"15min":4.3120000000000003},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55900000000000005,"15min":0.55600000000000005},"min":{"1min":0.372,"5min":0.31,"15min":0.29999999999999999},"max":{"1min":0.74099999999999999,"5min":3.0600000000000001,"15min":4.7309999999999999},"last":0.56699999999999995}]},{"osd":3,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.56899999999999995,"15min":0.54100000000000004},"min":{"1min":0.35299999999999998,"5min":0.32600000000000001,"15min":0.27900000000000003},"max":{"1min":0.72299999999999998,"5min":4.5190000000000001,"15min":4.5190000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.59499999999999997,"15min":0.59999999999999998},"min":{"1min":0.42799999999999999,"5min":0.36599999999999999,"15min":0.29699999999999999},"max":{"1min":0.76200000000000001,"5min":3.0070000000000001,"15min":9.3879999999999999},"last":0.60099999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.53400000000000003,"15min":0.49299999999999999},"min":{"1min":0.32000000000000001,"5min":0.29799999999999999,"15min":0.24399999999999999},"max":{"1min":0.69199999999999995,"5min":4.6639999999999997,"15min":4.6639999999999997},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.57299999999999995,"15min":0.53600000000000003},"min":{"1min":0.35399999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.70899999999999996,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":0.45600000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.56000000000000005},"min":{"1min":0.39200000000000002,"5min":0.32900000000000001,"15min":0.26000000000000001},"max":{"1min":0.66100000000000003,"5min":0.77000000000000002,"15min":9.3499999999999996},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.53100000000000003,"15min":0.54200000000000004},"min":{"1min":0.377,"5min":0.30099999999999999,"15min":0.26800000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":4.444},"last":0.54300000000000004}]},{"osd":6,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57099999999999995,"15min":0.59699999999999998},"min":{"1min":0.41399999999999998,"5min":0.38100000000000001,"15min":0.29199999999999998},"max":{"1min":0.73699999999999999,"5min":0.82099999999999995,"15min":9.4969999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.64000000000000001,"15min":0.62},"min":{"1min":0.44,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.75600000000000001,"5min":4.4669999999999996,"15min":7.2039999999999997},"last":0.51700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574995,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299136,"kb_used_data":1848,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072704,"statfs":{"total":96636764160,"available":96330448896,"internally_reserved":0,"allocated":1892352,"data_stored":873393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.60199999999999998,"15min":0.52400000000000002},"min":{"1min":0.35199999999999998,"5min":0.247,"15min":0.187},"max":{"1min":0.80500000000000005,"5min":9.5549999999999997,"15min":9.5549999999999997},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.65600000000000003,"15min":0.56699999999999995},"min":{"1min":0.44400000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.78400000000000003,"5min":9.4659999999999993,"15min":9.4659999999999993},"last":0.57099999999999995}]},{"osd":1,"last update":"Fri Oct 6 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.49299999999999999,"15min":0.48399999999999999},"min":{"1min":0.33500000000000002,"5min":0.26800000000000002,"15min":0.23300000000000001},"max":{"1min":0.74299999999999999,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.57699999999999996,"15min":0.51600000000000001},"min":{"1min":0.34399999999999997,"5min":0.216,"15min":0.216},"max":{"1min":0.71399999999999997,"5min":5.2670000000000003,"15min":5.2670000000000003},"last":0.45300000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.5,"15min":0.503},"min":{"1min":0.33700000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.77100000000000002,"5min":0.93200000000000005,"15min":7.0659999999999998},"last":0.371},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.51300000000000001,"15min":0.51900000000000002},"min":{"1min":0.41199999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.69199999999999995,"5min":1.0069999999999999,"15min":7.0819999999999999},"last":0.48799999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.56000000000000005,"15min":0.52000000000000002},"min":{"1min":0.39700000000000002,"5min":0.317,"15min":0.25800000000000001},"max":{"1min":0.75700000000000001,"5min":3.871,"15min":3.871},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.54000000000000004,"15min":0.53200000000000003},"min":{"1min":0.43099999999999999,"5min":0.32100000000000001,"15min":0.312},"max":{"1min":0.72799999999999998,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.47299999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.48099999999999998,"15min":0.47799999999999998},"min":{"1min":0.34899999999999998,"5min":0.26800000000000002,"15min":0.24299999999999999},"max":{"1min":0.68600000000000005,"5min":0.88,"15min":0.88},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53600000000000003,"15min":0.53300000000000003},"min":{"1min":0.378,"5min":0.29699999999999999,"15min":0.27900000000000003},"max":{"1min":0.71199999999999997,"5min":0.82399999999999995,"15min":1.0680000000000001},"last":0.61599999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52100000000000002,"15min":0.51700000000000002},"min":{"1min":0.38400000000000001,"5min":0.32000000000000001,"15min":0.28399999999999997},"max":{"1min":0.73399999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.627,"15min":0.57999999999999996},"min":{"1min":0.39500000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.745,"5min":7.1379999999999999,"15min":7.1379999999999999},"last":0.59699999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58599999999999997,"15min":0.56799999999999995},"min":{"1min":0.42499999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.748,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59099999999999997,"15min":0.58499999999999996},"min":{"1min":0.45800000000000002,"5min":0.36399999999999999,"15min":0.30199999999999999},"max":{"1min":0.82099999999999995,"5min":0.86899999999999999,"15min":0.88400000000000001},"last":0.58799999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574994,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312020,"kb_used_data":2444,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059820,"statfs":{"total":96636764160,"available":96317255680,"internally_reserved":0,"allocated":2502656,"data_stored":1466650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:59 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.47099999999999997,"15min":0.377},"min":{"1min":0.247,"5min":0.20499999999999999,"15min":0.186},"max":{"1min":0.49399999999999999,"5min":13.393000000000001,"15min":13.393000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.374,"5min":0.46899999999999997,"15min":0.38600000000000001},"min":{"1min":0.254,"5min":0.22500000000000001,"15min":0.19700000000000001},"max":{"1min":0.53900000000000003,"5min":11.462,"15min":11.462},"last":0.44600000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:16:59 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.41399999999999998,"15min":0.36099999999999999},"min":{"1min":0.25800000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.48099999999999998,"5min":8.0470000000000006,"15min":8.0470000000000006},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.44900000000000001,"15min":0.40799999999999997},"min":{"1min":0.32100000000000001,"5min":0.215,"15min":0.20999999999999999},"max":{"1min":0.58399999999999996,"5min":4.8630000000000004,"15min":4.8630000000000004},"last":0.50800000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:16:59 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46700000000000003,"15min":0.42599999999999999},"min":{"1min":0.28599999999999998,"5min":0.255,"15min":0.252},"max":{"1min":0.64800000000000002,"5min":4.8029999999999999,"15min":4.8029999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.435,"5min":0.45100000000000001,"15min":0.39700000000000002},"min":{"1min":0.29699999999999999,"5min":0.23400000000000001,"15min":0.217},"max":{"1min":0.749,"5min":5.8700000000000001,"15min":5.8700000000000001},"last":0.497}]},{"osd":4,"last update":"Fri Oct 6 11:16:59 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.54500000000000004,"15min":0.52500000000000002},"min":{"1min":0.39900000000000002,"5min":0.28299999999999997,"15min":0.28199999999999997},"max":{"1min":0.88400000000000001,"5min":1.264,"15min":1.264},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.625,"15min":0.57299999999999995},"min":{"1min":0.41199999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.89400000000000002,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.70999999999999996}]},{"osd":5,"last update":"Fri Oct 6 11:16:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.61299999999999999,"15min":0.57199999999999995},"min":{"1min":0.45600000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78600000000000003,"5min":3.4390000000000001,"15min":3.4390000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.68500000000000005,"15min":0.59299999999999997},"min":{"1min":0.42999999999999999,"5min":0.36799999999999999,"15min":0.29499999999999998},"max":{"1min":0.84499999999999997,"5min":9.3829999999999991,"15min":9.3829999999999991},"last":0.72299999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:16:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.64200000000000002,"15min":0.59299999999999997},"min":{"1min":0.42099999999999999,"5min":0.35999999999999999,"15min":0.315},"max":{"1min":0.83599999999999997,"5min":3.4750000000000001,"15min":3.4750000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.64000000000000001,"15min":0.60099999999999998},"min":{"1min":0.36599999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.872,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.76000000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:16:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66200000000000003,"15min":0.61499999999999999},"min":{"1min":0.46600000000000003,"5min":0.39800000000000002,"15min":0.38500000000000001},"max":{"1min":0.82999999999999996,"5min":4.7290000000000001,"15min":4.7290000000000001},"last":0.749},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.627,"15min":0.59599999999999997},"min":{"1min":0.48599999999999999,"5min":0.38900000000000001,"15min":0.374},"max":{"1min":0.81100000000000005,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.63700000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574993,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303240,"kb_used_data":1856,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068600,"statfs":{"total":96636764160,"available":96326246400,"internally_reserved":0,"allocated":1900544,"data_stored":873497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.34799999999999998,"15min":0.47099999999999997},"min":{"1min":0.248,"5min":0.20399999999999999,"15min":0.184},"max":{"1min":0.59599999999999997,"5min":0.64900000000000002,"15min":36.097999999999999},"last":0.436},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.371,"15min":0.38300000000000001},"min":{"1min":0.29899999999999999,"5min":0.22,"15min":0.182},"max":{"1min":0.497,"5min":0.92400000000000004,"15min":7.2990000000000004},"last":0.26400000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.37,"15min":0.503},"min":{"1min":0.223,"5min":0.223,"15min":0.217},"max":{"1min":0.49099999999999999,"5min":0.82599999999999996,"15min":36.07},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.39800000000000002,"15min":0.40999999999999998},"min":{"1min":0.26800000000000002,"5min":0.25600000000000001,"15min":0.219},"max":{"1min":0.57099999999999995,"5min":0.94899999999999995,"15min":6.7800000000000002},"last":0.41899999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.36899999999999999,"15min":0.39500000000000002},"min":{"1min":0.27500000000000002,"5min":0.255,"15min":0.223},"max":{"1min":0.53800000000000003,"5min":0.64100000000000001,"15min":8.4130000000000003},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.43099999999999999,"15min":0.56000000000000005},"min":{"1min":0.315,"5min":0.25800000000000001,"15min":0.249},"max":{"1min":0.59999999999999998,"5min":1.9079999999999999,"15min":35.959000000000003},"last":0.40600000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.57999999999999996,"15min":0.56699999999999995},"min":{"1min":0.39100000000000001,"5min":0.33800000000000002,"15min":0.29599999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":2.427},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.60199999999999998,"15min":0.73199999999999998},"min":{"1min":0.42899999999999999,"5min":0.374,"15min":0.29299999999999998},"max":{"1min":0.84999999999999998,"5min":0.94999999999999996,"15min":36.005000000000003},"last":0.82699999999999996}]},{"osd":5,"last update":"Fri Oct 6 11:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.58599999999999997,"15min":0.58499999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.32900000000000001},"max":{"1min":0.95299999999999996,"5min":0.999,"15min":6.6699999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58099999999999996,"15min":0.56000000000000005},"min":{"1min":0.41299999999999998,"5min":0.372,"15min":0.315},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":2.0600000000000001},"last":0.71399999999999997}]},{"osd":6,"last update":"Fri Oct 6 11:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.61299999999999999,"15min":0.73399999999999999},"min":{"1min":0.50600000000000001,"5min":0.39200000000000002,"15min":0.317},"max":{"1min":0.89600000000000002,"5min":0.98699999999999999,"15min":36.037999999999997},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.63100000000000001,"15min":0.64000000000000001},"min":{"1min":0.41299999999999998,"5min":0.40999999999999998,"15min":0.36399999999999999},"max":{"1min":0.89200000000000002,"5min":1.028,"15min":6.7110000000000003},"last":0.74099999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61499999999999999,"15min":0.624},"min":{"1min":0.432,"5min":0.40999999999999998,"15min":0.371},"max":{"1min":0.86599999999999999,"5min":1.054,"15min":6.742},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.58999999999999997,"15min":0.57399999999999995},"min":{"1min":0.42799999999999999,"5min":0.41399999999999998,"15min":0.34499999999999997},"max":{"1min":0.86699999999999999,"5min":0.96199999999999997,"15min":1.917},"last":0.628}]}]},{"osd":2,"up_from":13,"seq":55834574994,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299124,"kb_used_data":1836,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072716,"statfs":{"total":96636764160,"available":96330461184,"internally_reserved":0,"allocated":1880064,"data_stored":866752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":0.46700000000000003,"15min":0.36299999999999999},"min":{"1min":0.248,"5min":0.214,"15min":0.17999999999999999},"max":{"1min":15.228,"5min":15.228,"15min":15.228},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.503,"5min":0.40600000000000003,"15min":0.38900000000000001},"min":{"1min":0.32900000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":0.36599999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.38200000000000001,"15min":0.375},"min":{"1min":0.28899999999999998,"5min":0.23599999999999999,"15min":0.19900000000000001},"max":{"1min":0.56200000000000006,"5min":0.57499999999999996,"15min":0.745},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.36199999999999999,"15min":0.35399999999999998},"min":{"1min":0.23200000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.35699999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.36899999999999999,"15min":0.36799999999999999},"min":{"1min":0.27900000000000003,"5min":0.23699999999999999,"15min":0.23200000000000001},"max":{"1min":0.621,"5min":0.621,"15min":0.629},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.378,"15min":0.36799999999999999},"min":{"1min":0.27500000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.64400000000000002},"last":0.313}]},{"osd":4,"last update":"Fri Oct 6 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.46700000000000003,"5min":0.30599999999999999,"15min":0.30299999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":1.3200000000000001,"5min":0.69199999999999995,"15min":0.59499999999999997},"min":{"1min":0.42799999999999999,"5min":0.28199999999999997,"15min":0.27900000000000003},"max":{"1min":15.26,"5min":15.26,"15min":15.26},"last":0.65400000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":0.69999999999999996,"15min":0.59399999999999997},"min":{"1min":0.38200000000000001,"5min":0.35799999999999998,"15min":0.32400000000000001},"max":{"1min":15.186,"5min":15.186,"15min":15.186},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.57599999999999996,"15min":0.55900000000000005},"min":{"1min":0.44600000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.64200000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.60099999999999998,"15min":0.58499999999999996},"min":{"1min":0.48899999999999999,"5min":0.38200000000000001,"15min":0.32600000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.60199999999999998,"15min":0.57899999999999996},"min":{"1min":0.47099999999999997,"5min":0.40699999999999997,"15min":0.34200000000000003},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.67400000000000004}]},{"osd":7,"last update":"Fri Oct 6 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":0.68200000000000005,"15min":0.59799999999999998},"min":{"1min":0.46600000000000003,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":10.977,"5min":10.977,"15min":10.977},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.58599999999999997,"15min":0.57399999999999995},"min":{"1min":0.52100000000000002,"5min":0.38800000000000001,"15min":0.38200000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.66500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574994,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311444,"kb_used_data":1868,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060396,"statfs":{"total":96636764160,"available":96317845504,"internally_reserved":0,"allocated":1912832,"data_stored":875505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.34399999999999997,"15min":0.32500000000000001},"min":{"1min":0.248,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.46899999999999997,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.41199999999999998,"15min":0.39100000000000001},"min":{"1min":0.313,"5min":0.23000000000000001,"15min":0.22700000000000001},"max":{"1min":0.55100000000000005,"5min":4.4820000000000002,"15min":4.4820000000000002},"last":0.32800000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.32100000000000001,"15min":0.313},"min":{"1min":0.248,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.439,"5min":0.54000000000000004,"15min":0.65400000000000003},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.35599999999999998,"15min":0.35699999999999998},"min":{"1min":0.27700000000000002,"5min":0.23400000000000001,"15min":0.188},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":1.196},"last":0.30499999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.40200000000000002,"15min":0.38400000000000001},"min":{"1min":0.27700000000000002,"5min":0.23400000000000001,"15min":0.19600000000000001},"max":{"1min":0.45300000000000001,"5min":4.601,"15min":4.601},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.437,"15min":0.41799999999999998},"min":{"1min":0.32500000000000001,"5min":0.29899999999999999,"15min":0.26100000000000001},"max":{"1min":0.63200000000000001,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.35999999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.54500000000000004,"15min":0.54700000000000004},"min":{"1min":0.378,"5min":0.32100000000000001,"15min":0.311},"max":{"1min":0.75900000000000001,"5min":0.88500000000000001,"15min":1.694},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54500000000000004,"15min":0.53900000000000003},"min":{"1min":0.46300000000000002,"5min":0.32600000000000001,"15min":0.30199999999999999},"max":{"1min":0.68700000000000006,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.47399999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.434,"5min":0.34100000000000003,"15min":0.29399999999999998},"max":{"1min":0.63800000000000001,"5min":0.86399999999999999,"15min":0.878},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.36599999999999999,"5min":0.35699999999999998,"15min":0.29699999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":1.165},"last":0.46500000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.44400000000000001,"5min":0.372,"15min":0.36699999999999999},"max":{"1min":0.78700000000000003,"5min":0.79200000000000004,"15min":1.1359999999999999},"last":0.502},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57699999999999996,"15min":0.58499999999999996},"min":{"1min":0.443,"5min":0.36799999999999999,"15min":0.34399999999999997},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":1.7470000000000001},"last":0.48399999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56499999999999995,"15min":0.57399999999999995},"min":{"1min":0.39600000000000002,"5min":0.35699999999999998,"15min":0.35599999999999998},"max":{"1min":0.80300000000000005,"5min":0.89900000000000002,"15min":1.657},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57899999999999996,"15min":0.57299999999999995},"min":{"1min":0.48399999999999999,"5min":0.38,"15min":0.35499999999999998},"max":{"1min":0.71599999999999997,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.49299999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574993,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303252,"kb_used_data":1868,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068588,"statfs":{"total":96636764160,"available":96326234112,"internally_reserved":0,"allocated":1912832,"data_stored":875482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.47999999999999998,"15min":0.51600000000000001},"min":{"1min":0.30099999999999999,"5min":0.20799999999999999,"15min":0.19500000000000001},"max":{"1min":0.76800000000000002,"5min":0.82099999999999995,"15min":2.6619999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.504,"15min":0.49199999999999999},"min":{"1min":0.28999999999999998,"5min":0.224,"15min":0.215},"max":{"1min":0.81499999999999995,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.55600000000000005}]},{"osd":1,"last update":"Fri Oct 6 11:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.498,"15min":0.53600000000000003},"min":{"1min":0.27600000000000002,"5min":0.26200000000000001,"15min":0.23300000000000001},"max":{"1min":0.72899999999999998,"5min":1,"15min":2.8650000000000002},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.497,"15min":0.54200000000000004},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.25800000000000001},"max":{"1min":0.70699999999999996,"5min":1.2869999999999999,"15min":2.7610000000000001},"last":0.54400000000000004}]},{"osd":2,"last update":"Fri Oct 6 11:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.52300000000000002,"15min":0.53300000000000003},"min":{"1min":0.36899999999999999,"5min":0.28499999999999998,"15min":0.23100000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":1.6910000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57199999999999995,"15min":0.57999999999999996},"min":{"1min":0.40999999999999998,"5min":0.31,"15min":0.30599999999999999},"max":{"1min":0.82799999999999996,"5min":0.93899999999999995,"15min":1.718},"last":0.52200000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58099999999999996,"15min":0.58599999999999997},"min":{"1min":0.38600000000000001,"5min":0.32000000000000001,"15min":0.26700000000000002},"max":{"1min":0.78800000000000003,"5min":2.387,"15min":2.677},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.55000000000000004,"15min":0.52700000000000002},"min":{"1min":0.42499999999999999,"5min":0.29299999999999998,"15min":0.27500000000000002},"max":{"1min":0.77700000000000002,"5min":1.784,"15min":1.784},"last":0.60699999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.378,"5min":0.28499999999999998,"15min":0.23200000000000001},"max":{"1min":0.68300000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.51500000000000001,"15min":0.52500000000000002},"min":{"1min":0.39400000000000002,"5min":0.28899999999999998,"15min":0.28399999999999997},"max":{"1min":0.749,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.502}]},{"osd":6,"last update":"Fri Oct 6 11:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.35799999999999998,"5min":0.31,"15min":0.252},"max":{"1min":0.72999999999999998,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55200000000000005,"15min":0.55900000000000005},"min":{"1min":0.41199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80200000000000005,"5min":0.85799999999999998,"15min":1.165},"last":0.48799999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.56599999999999995,"15min":0.55800000000000005},"min":{"1min":0.40799999999999997,"5min":0.34200000000000003,"15min":0.313},"max":{"1min":0.84999999999999998,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.58899999999999997,"15min":0.59099999999999997},"min":{"1min":0.41999999999999998,"5min":0.318,"15min":0.317},"max":{"1min":0.86399999999999999,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.46300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574995,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311436,"kb_used_data":1860,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060404,"statfs":{"total":96636764160,"available":96317853696,"internally_reserved":0,"allocated":1904640,"data_stored":874870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.48499999999999999,"15min":0.57499999999999996},"min":{"1min":0.26000000000000001,"5min":0.23300000000000001,"15min":0.20499999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":5.0490000000000004},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.48599999999999999,"15min":0.55500000000000005},"min":{"1min":0.34599999999999997,"5min":0.253,"15min":0.22900000000000001},"max":{"1min":0.71299999999999997,"5min":0.78100000000000003,"15min":5.1449999999999996},"last":0.45000000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.48899999999999999,"15min":0.48299999999999998},"min":{"1min":0.27800000000000002,"5min":0.25700000000000001,"15min":0.25},"max":{"1min":0.68400000000000005,"5min":0.81399999999999995,"15min":0.97199999999999998},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.505,"15min":0.51000000000000001},"min":{"1min":0.29799999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.69299999999999995,"5min":0.74099999999999999,"15min":1.8799999999999999},"last":0.57699999999999996}]},{"osd":2,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.52800000000000002,"15min":0.54600000000000004},"min":{"1min":0.36799999999999999,"5min":0.30099999999999999,"15min":0.28299999999999997},"max":{"1min":0.748,"5min":0.79800000000000004,"15min":4.234},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56200000000000006,"15min":0.56000000000000005},"min":{"1min":0.436,"5min":0.315,"15min":0.315},"max":{"1min":0.79200000000000004,"5min":0.81000000000000005,"15min":1.0369999999999999},"last":0.54400000000000004}]},{"osd":3,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51000000000000001,"15min":0.59299999999999997},"min":{"1min":0.311,"5min":0.29499999999999998,"15min":0.27700000000000002},"max":{"1min":0.70499999999999996,"5min":0.82299999999999995,"15min":5.2169999999999996},"last":0.5},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53100000000000003,"15min":0.53800000000000003},"min":{"1min":0.38700000000000001,"5min":0.29999999999999999,"15min":0.29699999999999999},"max":{"1min":0.73699999999999999,"5min":0.75600000000000001,"15min":1.008},"last":0.47799999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48399999999999999,"15min":0.504},"min":{"1min":0.33700000000000002,"5min":0.25600000000000001,"15min":0.23999999999999999},"max":{"1min":0.65900000000000003,"5min":0.83399999999999996,"15min":1.917},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.48999999999999999,"15min":0.51400000000000001},"min":{"1min":0.29999999999999999,"5min":0.251,"15min":0.23899999999999999},"max":{"1min":0.65500000000000003,"5min":0.69199999999999995,"15min":0.87},"last":0.56599999999999995}]},{"osd":6,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51100000000000001,"15min":0.54300000000000004},"min":{"1min":0.34799999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.67200000000000004,"5min":0.76800000000000002,"15min":2.0139999999999998},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57399999999999995,"15min":0.59399999999999997},"min":{"1min":0.33200000000000002,"5min":0.30299999999999999,"15min":0.29999999999999999},"max":{"1min":0.72599999999999998,"5min":0.82899999999999996,"15min":1.9470000000000001},"last":0.65100000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53600000000000003,"15min":0.56299999999999994},"min":{"1min":0.376,"5min":0.28799999999999998,"15min":0.27700000000000002},"max":{"1min":0.64600000000000002,"5min":0.81000000000000005,"15min":0.96499999999999997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56899999999999995,"15min":0.59299999999999997},"min":{"1min":0.42599999999999999,"5min":0.29199999999999998,"15min":0.28799999999999998},"max":{"1min":0.746,"5min":0.77300000000000002,"15min":1.4119999999999999},"last":0.63900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:17:33.134 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:17:33.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.260+0000 7f83e78c2700 1 Processor -- start 2023-10-06T11:17:33.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.260+0000 7f83e78c2700 1 -- start start 2023-10-06T11:17:33.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.261+0000 7f83e78c2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f83e0147190 0x7f83e00b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:33.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.261+0000 7f83e78c2700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83e0162060 con 0x7f83e00b5fb0 2023-10-06T11:17:33.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.261+0000 7f83e78c2700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83e00b6420 con 0x7f83e015e9d0 2023-10-06T11:17:33.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.261+0000 7f83e78c2700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83e0161730 con 0x7f83e0147190 2023-10-06T11:17:33.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.261+0000 7f83e565e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f83e0147190 0x7f83e00b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:33.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.261+0000 7f83e4e5d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f83e00b5fb0 0x7f83e015e2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:37318/0 (socket says 172.21.15.146:37318) 2023-10-06T11:17:33.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.261+0000 7f83e4e5d700 1 -- 172.21.15.146:0/3860302935 learned_addr learned my addr 172.21.15.146:0/3860302935 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:17:33.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.262+0000 7f83e565e700 1 -- 172.21.15.146:0/3860302935 >> v1:172.21.15.151:6789/0 conn(0x7f83e015e9d0 legacy=0x7f83e00ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:33.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.262+0000 7f83e565e700 1 -- 172.21.15.146:0/3860302935 >> v1:172.21.15.146:6789/0 conn(0x7f83e00b5fb0 legacy=0x7f83e015e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:33.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.262+0000 7f83e565e700 1 -- 172.21.15.146:0/3860302935 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e0161a10 con 0x7f83e0147190 2023-10-06T11:17:33.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.262+0000 7f83d7fff700 1 -- 172.21.15.146:0/3860302935 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3799205995 0 0) 0x7f83e0162060 con 0x7f83e00b5fb0 2023-10-06T11:17:33.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.262+0000 7f83e565e700 1 --2- 172.21.15.146:0/3860302935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83e0147190 0x7f83e00b5a70 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7f83dc009e60 tx=0x7f83dc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c07a5261bb870a9b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:33.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.262+0000 7f83d7fff700 1 -- 172.21.15.146:0/3860302935 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83dc00e070 con 0x7f83e0147190 2023-10-06T11:17:33.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.262+0000 7f83d7fff700 1 -- 172.21.15.146:0/3860302935 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83dc00bc30 con 0x7f83e0147190 2023-10-06T11:17:33.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.262+0000 7f83d7fff700 1 -- 172.21.15.146:0/3860302935 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83dc012430 con 0x7f83e0147190 2023-10-06T11:17:33.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.263+0000 7f83e78c2700 1 -- 172.21.15.146:0/3860302935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83e0147190 msgr2=0x7f83e00b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:33.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.263+0000 7f83e78c2700 1 --2- 172.21.15.146:0/3860302935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83e0147190 0x7f83e00b5a70 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7f83dc009e60 tx=0x7f83dc009780 comp rx=0 tx=0).stop 2023-10-06T11:17:33.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.263+0000 7f83e78c2700 1 -- 172.21.15.146:0/3860302935 shutdown_connections 2023-10-06T11:17:33.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.263+0000 7f83e78c2700 1 --2- 172.21.15.146:0/3860302935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83e0147190 0x7f83e00b5a70 unknown :-1 s=CLOSED pgs=1961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:33.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.263+0000 7f83e78c2700 1 -- 172.21.15.146:0/3860302935 >> 172.21.15.146:0/3860302935 conn(0x7f83e006eba0 msgr2=0x7f83e006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:33.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.263+0000 7f83e78c2700 1 -- 172.21.15.146:0/3860302935 shutdown_connections 2023-10-06T11:17:33.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.263+0000 7f83e78c2700 1 -- 172.21.15.146:0/3860302935 wait complete. 2023-10-06T11:17:33.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.264+0000 7f83e78c2700 1 Processor -- start 2023-10-06T11:17:33.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.264+0000 7f83e78c2700 1 -- start start 2023-10-06T11:17:33.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.265+0000 7f83e78c2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83e00b5fb0 0x7f83e01439b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:33.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.265+0000 7f83e78c2700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f83e0147190 0x7f83e015cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:33.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.265+0000 7f83e78c2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83e015e9d0 0x7f83e015d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:33.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.265+0000 7f83e78c2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e00affa0 con 0x7f83e00b5fb0 2023-10-06T11:17:33.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.265+0000 7f83e78c2700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e016eb30 con 0x7f83e015e9d0 2023-10-06T11:17:33.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.265+0000 7f83e78c2700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e00b01f0 con 0x7f83e0147190 2023-10-06T11:17:33.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.265+0000 7f83e565e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83e00b5fb0 0x7f83e01439b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:33.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.265+0000 7f83e565e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83e00b5fb0 0x7f83e01439b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45898/0 (socket says 172.21.15.146:45898) 2023-10-06T11:17:33.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.265+0000 7f83e565e700 1 -- 172.21.15.146:0/1848019032 learned_addr learned my addr 172.21.15.146:0/1848019032 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:33.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.265+0000 7f83e5e5f700 1 --2- 172.21.15.146:0/1848019032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83e015e9d0 0x7f83e015d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:33.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.265+0000 7f83e4e5d700 1 --2- 172.21.15.146:0/1848019032 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f83e0147190 0x7f83e015cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:33.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.265+0000 7f83e565e700 1 -- 172.21.15.146:0/1848019032 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f83e0147190 msgr2=0x7f83e015cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:33.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.265+0000 7f83e565e700 1 --2- 172.21.15.146:0/1848019032 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f83e0147190 0x7f83e015cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:33.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.265+0000 7f83e565e700 1 -- 172.21.15.146:0/1848019032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83e015e9d0 msgr2=0x7f83e015d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:33.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.265+0000 7f83e565e700 1 --2- 172.21.15.146:0/1848019032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83e015e9d0 0x7f83e015d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:33.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.265+0000 7f83e565e700 1 -- 172.21.15.146:0/1848019032 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83dc009a20 con 0x7f83e00b5fb0 2023-10-06T11:17:33.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.265+0000 7f83e565e700 1 --2- 172.21.15.146:0/1848019032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83e00b5fb0 0x7f83e01439b0 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7f83dc0099f0 tx=0x7f83dc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:33.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.266+0000 7f83d57fa700 1 -- 172.21.15.146:0/1848019032 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83dc01b420 con 0x7f83e00b5fb0 2023-10-06T11:17:33.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.266+0000 7f83d57fa700 1 -- 172.21.15.146:0/1848019032 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83dc01b5a0 con 0x7f83e00b5fb0 2023-10-06T11:17:33.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.266+0000 7f83e78c2700 1 -- 172.21.15.146:0/1848019032 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83e00b04d0 con 0x7f83e00b5fb0 2023-10-06T11:17:33.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.266+0000 7f83d57fa700 1 -- 172.21.15.146:0/1848019032 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83dc01b960 con 0x7f83e00b5fb0 2023-10-06T11:17:33.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.266+0000 7f83e78c2700 1 -- 172.21.15.146:0/1848019032 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83e0143ef0 con 0x7f83e00b5fb0 2023-10-06T11:17:33.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.266+0000 7f83e78c2700 1 -- 172.21.15.146:0/1848019032 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83e00b09d0 con 0x7f83e00b5fb0 2023-10-06T11:17:33.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.267+0000 7f83d57fa700 1 -- 172.21.15.146:0/1848019032 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f83dc01bd10 con 0x7f83e00b5fb0 2023-10-06T11:17:33.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.267+0000 7f83d57fa700 1 --2- 172.21.15.146:0/1848019032 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f83c4066f30 0x7f83c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:33.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.267+0000 7f83d57fa700 1 -- 172.21.15.146:0/1848019032 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f83dc0862e0 con 0x7f83e00b5fb0 2023-10-06T11:17:33.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.267+0000 7f83e4e5d700 1 --2- 172.21.15.146:0/1848019032 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f83c4066f30 0x7f83c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:33.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.268+0000 7f83e4e5d700 1 --2- 172.21.15.146:0/1848019032 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f83c4066f30 0x7f83c40693e0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f83e00cd100 tx=0x7f83d0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:33.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.272+0000 7f83d57fa700 1 -- 172.21.15.146:0/1848019032 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f83dc0533f0 con 0x7f83e00b5fb0 2023-10-06T11:17:33.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.452+0000 7f83e78c2700 1 -- 172.21.15.146:0/1848019032 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f83e004c380 con 0x7f83c4066f30 2023-10-06T11:17:33.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.460+0000 7f83d57fa700 1 -- 172.21.15.146:0/1848019032 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311692 (secure 0 0 0) 0x7f83e004c380 con 0x7f83c4066f30 2023-10-06T11:17:33.465 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:33.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.463+0000 7f83e78c2700 1 -- 172.21.15.146:0/1848019032 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f83c4066f30 msgr2=0x7f83c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:33.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.463+0000 7f83e78c2700 1 --2- 172.21.15.146:0/1848019032 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f83c4066f30 0x7f83c40693e0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f83e00cd100 tx=0x7f83d0009040 comp rx=0 tx=0).stop 2023-10-06T11:17:33.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.463+0000 7f83e78c2700 1 -- 172.21.15.146:0/1848019032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83e00b5fb0 msgr2=0x7f83e01439b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:33.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.463+0000 7f83e78c2700 1 --2- 172.21.15.146:0/1848019032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83e00b5fb0 0x7f83e01439b0 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7f83dc0099f0 tx=0x7f83dc019000 comp rx=0 tx=0).stop 2023-10-06T11:17:33.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.464+0000 7f83e78c2700 1 -- 172.21.15.146:0/1848019032 shutdown_connections 2023-10-06T11:17:33.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.464+0000 7f83e78c2700 1 --2- 172.21.15.146:0/1848019032 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f83c4066f30 0x7f83c40693e0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:33.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.464+0000 7f83e78c2700 1 --2- 172.21.15.146:0/1848019032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83e015e9d0 0x7f83e015d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:33.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.464+0000 7f83e78c2700 1 --2- 172.21.15.146:0/1848019032 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f83e00b5fb0 0x7f83e01439b0 unknown :-1 s=CLOSED pgs=1962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:33.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.464+0000 7f83e78c2700 1 --2- 172.21.15.146:0/1848019032 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f83e0147190 0x7f83e015cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:33.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.464+0000 7f83e78c2700 1 -- 172.21.15.146:0/1848019032 >> 172.21.15.146:0/1848019032 conn(0x7f83e006eba0 msgr2=0x7f83e015eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:33.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.464+0000 7f83e78c2700 1 -- 172.21.15.146:0/1848019032 shutdown_connections 2023-10-06T11:17:33.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.464+0000 7f83e78c2700 1 -- 172.21.15.146:0/1848019032 wait complete. 2023-10-06T11:17:33.469 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:17:33.477 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":502,"stamp":"2023-10-06T11:17:33.293478+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2443480,"kb_used_data":16024,"kb_used_omap":0,"kb_used_meta":2427392,"kb_avail":752531240,"statfs":{"total":773094113280,"available":770591989760,"internally_reserved":0,"allocated":16408576,"data_stored":8177904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2485649408},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.739551"},"pg_stats":[{"pgid":"24.3f","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.570754+0000","last_change":"2023-10-06T11:17:24.567490+0000","last_active":"2023-10-06T11:17:24.570754+0000","last_peered":"2023-10-06T11:17:24.570754+0000","last_clean":"2023-10-06T11:17:24.570754+0000","last_became_active":"2023-10-06T11:17:24.565793+0000","last_became_peered":"2023-10-06T11:17:24.565793+0000","last_unstale":"2023-10-06T11:17:24.570754+0000","last_undegraded":"2023-10-06T11:17:24.570754+0000","last_fullsized":"2023-10-06T11:17:24.570754+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:15:11.263158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3e","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575584+0000","last_change":"2023-10-06T11:17:24.574790+0000","last_active":"2023-10-06T11:17:24.575584+0000","last_peered":"2023-10-06T11:17:24.575584+0000","last_clean":"2023-10-06T11:17:24.575584+0000","last_became_active":"2023-10-06T11:17:24.574475+0000","last_became_peered":"2023-10-06T11:17:24.574475+0000","last_unstale":"2023-10-06T11:17:24.575584+0000","last_undegraded":"2023-10-06T11:17:24.575584+0000","last_fullsized":"2023-10-06T11:17:24.575584+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:20.201597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3d","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.568092+0000","last_change":"2023-10-06T11:17:24.565515+0000","last_active":"2023-10-06T11:17:24.568092+0000","last_peered":"2023-10-06T11:17:24.568092+0000","last_clean":"2023-10-06T11:17:24.568092+0000","last_became_active":"2023-10-06T11:17:24.565217+0000","last_became_peered":"2023-10-06T11:17:24.565217+0000","last_unstale":"2023-10-06T11:17:24.568092+0000","last_undegraded":"2023-10-06T11:17:24.568092+0000","last_fullsized":"2023-10-06T11:17:24.568092+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:22:20.066646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3c","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.571884+0000","last_change":"2023-10-06T11:17:24.569633+0000","last_active":"2023-10-06T11:17:24.571884+0000","last_peered":"2023-10-06T11:17:24.571884+0000","last_clean":"2023-10-06T11:17:24.571884+0000","last_became_active":"2023-10-06T11:17:24.569056+0000","last_became_peered":"2023-10-06T11:17:24.569056+0000","last_unstale":"2023-10-06T11:17:24.571884+0000","last_undegraded":"2023-10-06T11:17:24.571884+0000","last_fullsized":"2023-10-06T11:17:24.571884+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:11:12.692922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.3b","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.576344+0000","last_change":"2023-10-06T11:17:24.570249+0000","last_active":"2023-10-06T11:17:24.576344+0000","last_peered":"2023-10-06T11:17:24.576344+0000","last_clean":"2023-10-06T11:17:24.576344+0000","last_became_active":"2023-10-06T11:17:24.570080+0000","last_became_peered":"2023-10-06T11:17:24.570080+0000","last_unstale":"2023-10-06T11:17:24.576344+0000","last_undegraded":"2023-10-06T11:17:24.576344+0000","last_fullsized":"2023-10-06T11:17:24.576344+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:32:08.893601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.569849+0000","last_change":"2023-10-06T11:17:24.568112+0000","last_active":"2023-10-06T11:17:24.569849+0000","last_peered":"2023-10-06T11:17:24.569849+0000","last_clean":"2023-10-06T11:17:24.569849+0000","last_became_active":"2023-10-06T11:17:24.567855+0000","last_became_peered":"2023-10-06T11:17:24.567855+0000","last_unstale":"2023-10-06T11:17:24.569849+0000","last_undegraded":"2023-10-06T11:17:24.569849+0000","last_fullsized":"2023-10-06T11:17:24.569849+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:11:12.692922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.39","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575807+0000","last_change":"2023-10-06T11:17:24.570311+0000","last_active":"2023-10-06T11:17:24.575807+0000","last_peered":"2023-10-06T11:17:24.575807+0000","last_clean":"2023-10-06T11:17:24.575807+0000","last_became_active":"2023-10-06T11:17:24.569843+0000","last_became_peered":"2023-10-06T11:17:24.569843+0000","last_unstale":"2023-10-06T11:17:24.575807+0000","last_undegraded":"2023-10-06T11:17:24.575807+0000","last_fullsized":"2023-10-06T11:17:24.575807+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:18.748550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.38","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575984+0000","last_change":"2023-10-06T11:17:24.571846+0000","last_active":"2023-10-06T11:17:24.575984+0000","last_peered":"2023-10-06T11:17:24.575984+0000","last_clean":"2023-10-06T11:17:24.575984+0000","last_became_active":"2023-10-06T11:17:24.571569+0000","last_became_peered":"2023-10-06T11:17:24.571569+0000","last_unstale":"2023-10-06T11:17:24.575984+0000","last_undegraded":"2023-10-06T11:17:24.575984+0000","last_fullsized":"2023-10-06T11:17:24.575984+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:08:07.693719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.37","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575834+0000","last_change":"2023-10-06T11:17:24.570976+0000","last_active":"2023-10-06T11:17:24.575834+0000","last_peered":"2023-10-06T11:17:24.575834+0000","last_clean":"2023-10-06T11:17:24.575834+0000","last_became_active":"2023-10-06T11:17:24.570681+0000","last_became_peered":"2023-10-06T11:17:24.570681+0000","last_unstale":"2023-10-06T11:17:24.575834+0000","last_undegraded":"2023-10-06T11:17:24.575834+0000","last_fullsized":"2023-10-06T11:17:24.575834+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:48.792063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.36","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.576026+0000","last_change":"2023-10-06T11:17:24.571439+0000","last_active":"2023-10-06T11:17:24.576026+0000","last_peered":"2023-10-06T11:17:24.576026+0000","last_clean":"2023-10-06T11:17:24.576026+0000","last_became_active":"2023-10-06T11:17:24.570809+0000","last_became_peered":"2023-10-06T11:17:24.570809+0000","last_unstale":"2023-10-06T11:17:24.576026+0000","last_undegraded":"2023-10-06T11:17:24.576026+0000","last_fullsized":"2023-10-06T11:17:24.576026+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:20.201597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.35","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.570755+0000","last_change":"2023-10-06T11:17:24.568848+0000","last_active":"2023-10-06T11:17:24.570755+0000","last_peered":"2023-10-06T11:17:24.570755+0000","last_clean":"2023-10-06T11:17:24.570755+0000","last_became_active":"2023-10-06T11:17:24.567763+0000","last_became_peered":"2023-10-06T11:17:24.567763+0000","last_unstale":"2023-10-06T11:17:24.570755+0000","last_undegraded":"2023-10-06T11:17:24.570755+0000","last_fullsized":"2023-10-06T11:17:24.570755+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:56.951675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.34","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575114+0000","last_change":"2023-10-06T11:17:24.573144+0000","last_active":"2023-10-06T11:17:24.575114+0000","last_peered":"2023-10-06T11:17:24.575114+0000","last_clean":"2023-10-06T11:17:24.575114+0000","last_became_active":"2023-10-06T11:17:24.572892+0000","last_became_peered":"2023-10-06T11:17:24.572892+0000","last_unstale":"2023-10-06T11:17:24.575114+0000","last_undegraded":"2023-10-06T11:17:24.575114+0000","last_fullsized":"2023-10-06T11:17:24.575114+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:15:52.609098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.33","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.580555+0000","last_change":"2023-10-06T11:17:24.571121+0000","last_active":"2023-10-06T11:17:24.580555+0000","last_peered":"2023-10-06T11:17:24.580555+0000","last_clean":"2023-10-06T11:17:24.580555+0000","last_became_active":"2023-10-06T11:17:24.570858+0000","last_became_peered":"2023-10-06T11:17:24.570858+0000","last_unstale":"2023-10-06T11:17:24.580555+0000","last_undegraded":"2023-10-06T11:17:24.580555+0000","last_fullsized":"2023-10-06T11:17:24.580555+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:32:17.113391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.32","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.573663+0000","last_change":"2023-10-06T11:17:24.568783+0000","last_active":"2023-10-06T11:17:24.573663+0000","last_peered":"2023-10-06T11:17:24.573663+0000","last_clean":"2023-10-06T11:17:24.573663+0000","last_became_active":"2023-10-06T11:17:24.565857+0000","last_became_peered":"2023-10-06T11:17:24.565857+0000","last_unstale":"2023-10-06T11:17:24.573663+0000","last_undegraded":"2023-10-06T11:17:24.573663+0000","last_fullsized":"2023-10-06T11:17:24.573663+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:11:22.690663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.31","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.574923+0000","last_change":"2023-10-06T11:17:24.571861+0000","last_active":"2023-10-06T11:17:24.574923+0000","last_peered":"2023-10-06T11:17:24.574923+0000","last_clean":"2023-10-06T11:17:24.574923+0000","last_became_active":"2023-10-06T11:17:24.571607+0000","last_became_peered":"2023-10-06T11:17:24.571607+0000","last_unstale":"2023-10-06T11:17:24.574923+0000","last_undegraded":"2023-10-06T11:17:24.574923+0000","last_fullsized":"2023-10-06T11:17:24.574923+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:55:29.624889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.30","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.568335+0000","last_change":"2023-10-06T11:17:24.567062+0000","last_active":"2023-10-06T11:17:24.568335+0000","last_peered":"2023-10-06T11:17:24.568335+0000","last_clean":"2023-10-06T11:17:24.568335+0000","last_became_active":"2023-10-06T11:17:24.566777+0000","last_became_peered":"2023-10-06T11:17:24.566777+0000","last_unstale":"2023-10-06T11:17:24.568335+0000","last_undegraded":"2023-10-06T11:17:24.568335+0000","last_fullsized":"2023-10-06T11:17:24.568335+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:20.201597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.2f","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575852+0000","last_change":"2023-10-06T11:17:24.571498+0000","last_active":"2023-10-06T11:17:24.575852+0000","last_peered":"2023-10-06T11:17:24.575852+0000","last_clean":"2023-10-06T11:17:24.575852+0000","last_became_active":"2023-10-06T11:17:24.571243+0000","last_became_peered":"2023-10-06T11:17:24.571243+0000","last_unstale":"2023-10-06T11:17:24.575852+0000","last_undegraded":"2023-10-06T11:17:24.575852+0000","last_fullsized":"2023-10-06T11:17:24.575852+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:15:12.800687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2e","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575232+0000","last_change":"2023-10-06T11:17:24.574498+0000","last_active":"2023-10-06T11:17:24.575232+0000","last_peered":"2023-10-06T11:17:24.575232+0000","last_clean":"2023-10-06T11:17:24.575232+0000","last_became_active":"2023-10-06T11:17:24.574246+0000","last_became_peered":"2023-10-06T11:17:24.574246+0000","last_unstale":"2023-10-06T11:17:24.575232+0000","last_undegraded":"2023-10-06T11:17:24.575232+0000","last_fullsized":"2023-10-06T11:17:24.575232+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:07:54.294932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.2d","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.574906+0000","last_change":"2023-10-06T11:17:24.571935+0000","last_active":"2023-10-06T11:17:24.574906+0000","last_peered":"2023-10-06T11:17:24.574906+0000","last_clean":"2023-10-06T11:17:24.574906+0000","last_became_active":"2023-10-06T11:17:24.571681+0000","last_became_peered":"2023-10-06T11:17:24.571681+0000","last_unstale":"2023-10-06T11:17:24.574906+0000","last_undegraded":"2023-10-06T11:17:24.574906+0000","last_fullsized":"2023-10-06T11:17:24.574906+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:56:17.624615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.2c","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575898+0000","last_change":"2023-10-06T11:17:24.568125+0000","last_active":"2023-10-06T11:17:24.575898+0000","last_peered":"2023-10-06T11:17:24.575898+0000","last_clean":"2023-10-06T11:17:24.575898+0000","last_became_active":"2023-10-06T11:17:24.567809+0000","last_became_peered":"2023-10-06T11:17:24.567809+0000","last_unstale":"2023-10-06T11:17:24.575898+0000","last_undegraded":"2023-10-06T11:17:24.575898+0000","last_fullsized":"2023-10-06T11:17:24.575898+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:32:27.294341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.2b","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.565724+0000","last_change":"2023-10-06T11:17:24.561075+0000","last_active":"2023-10-06T11:17:24.565724+0000","last_peered":"2023-10-06T11:17:24.565724+0000","last_clean":"2023-10-06T11:17:24.565724+0000","last_became_active":"2023-10-06T11:17:24.560699+0000","last_became_peered":"2023-10-06T11:17:24.560699+0000","last_unstale":"2023-10-06T11:17:24.565724+0000","last_undegraded":"2023-10-06T11:17:24.565724+0000","last_fullsized":"2023-10-06T11:17:24.565724+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:06:27.406680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.2a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.574973+0000","last_change":"2023-10-06T11:17:24.572835+0000","last_active":"2023-10-06T11:17:24.574973+0000","last_peered":"2023-10-06T11:17:24.574973+0000","last_clean":"2023-10-06T11:17:24.574973+0000","last_became_active":"2023-10-06T11:17:24.570204+0000","last_became_peered":"2023-10-06T11:17:24.570204+0000","last_unstale":"2023-10-06T11:17:24.574973+0000","last_undegraded":"2023-10-06T11:17:24.574973+0000","last_fullsized":"2023-10-06T11:17:24.574973+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:18.748550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.29","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.570377+0000","last_change":"2023-10-06T11:17:24.567291+0000","last_active":"2023-10-06T11:17:24.570377+0000","last_peered":"2023-10-06T11:17:24.570377+0000","last_clean":"2023-10-06T11:17:24.570377+0000","last_became_active":"2023-10-06T11:17:24.566984+0000","last_became_peered":"2023-10-06T11:17:24.566984+0000","last_unstale":"2023-10-06T11:17:24.570377+0000","last_undegraded":"2023-10-06T11:17:24.570377+0000","last_fullsized":"2023-10-06T11:17:24.570377+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:42:04.095734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.28","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.571794+0000","last_change":"2023-10-06T11:17:24.568240+0000","last_active":"2023-10-06T11:17:24.571794+0000","last_peered":"2023-10-06T11:17:24.571794+0000","last_clean":"2023-10-06T11:17:24.571794+0000","last_became_active":"2023-10-06T11:17:24.567647+0000","last_became_peered":"2023-10-06T11:17:24.567647+0000","last_unstale":"2023-10-06T11:17:24.571794+0000","last_undegraded":"2023-10-06T11:17:24.571794+0000","last_fullsized":"2023-10-06T11:17:24.571794+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:38.610243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.27","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.565288+0000","last_change":"2023-10-06T11:17:24.561095+0000","last_active":"2023-10-06T11:17:24.565288+0000","last_peered":"2023-10-06T11:17:24.565288+0000","last_clean":"2023-10-06T11:17:24.565288+0000","last_became_active":"2023-10-06T11:17:24.560834+0000","last_became_peered":"2023-10-06T11:17:24.560834+0000","last_unstale":"2023-10-06T11:17:24.565288+0000","last_undegraded":"2023-10-06T11:17:24.565288+0000","last_fullsized":"2023-10-06T11:17:24.565288+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:33:05.816585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.26","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.570099+0000","last_change":"2023-10-06T11:17:24.566087+0000","last_active":"2023-10-06T11:17:24.570099+0000","last_peered":"2023-10-06T11:17:24.570099+0000","last_clean":"2023-10-06T11:17:24.570099+0000","last_became_active":"2023-10-06T11:17:24.565836+0000","last_became_peered":"2023-10-06T11:17:24.565836+0000","last_unstale":"2023-10-06T11:17:24.570099+0000","last_undegraded":"2023-10-06T11:17:24.570099+0000","last_fullsized":"2023-10-06T11:17:24.570099+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:32:22.601435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.25","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575177+0000","last_change":"2023-10-06T11:17:24.574344+0000","last_active":"2023-10-06T11:17:24.575177+0000","last_peered":"2023-10-06T11:17:24.575177+0000","last_clean":"2023-10-06T11:17:24.575177+0000","last_became_active":"2023-10-06T11:17:24.570258+0000","last_became_peered":"2023-10-06T11:17:24.570258+0000","last_unstale":"2023-10-06T11:17:24.575177+0000","last_undegraded":"2023-10-06T11:17:24.575177+0000","last_fullsized":"2023-10-06T11:17:24.575177+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:56.951675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.24","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.565509+0000","last_change":"2023-10-06T11:17:24.561410+0000","last_active":"2023-10-06T11:17:24.565509+0000","last_peered":"2023-10-06T11:17:24.565509+0000","last_clean":"2023-10-06T11:17:24.565509+0000","last_became_active":"2023-10-06T11:17:24.561150+0000","last_became_peered":"2023-10-06T11:17:24.561150+0000","last_unstale":"2023-10-06T11:17:24.565509+0000","last_undegraded":"2023-10-06T11:17:24.565509+0000","last_fullsized":"2023-10-06T11:17:24.565509+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:03:32.754632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.23","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.579321+0000","last_change":"2023-10-06T11:17:24.576372+0000","last_active":"2023-10-06T11:17:24.579321+0000","last_peered":"2023-10-06T11:17:24.579321+0000","last_clean":"2023-10-06T11:17:24.579321+0000","last_became_active":"2023-10-06T11:17:24.575959+0000","last_became_peered":"2023-10-06T11:17:24.575959+0000","last_unstale":"2023-10-06T11:17:24.579321+0000","last_undegraded":"2023-10-06T11:17:24.579321+0000","last_fullsized":"2023-10-06T11:17:24.579321+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:01:59.076681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.22","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.572200+0000","last_change":"2023-10-06T11:17:24.570445+0000","last_active":"2023-10-06T11:17:24.572200+0000","last_peered":"2023-10-06T11:17:24.572200+0000","last_clean":"2023-10-06T11:17:24.572200+0000","last_became_active":"2023-10-06T11:17:24.569571+0000","last_became_peered":"2023-10-06T11:17:24.569571+0000","last_unstale":"2023-10-06T11:17:24.572200+0000","last_undegraded":"2023-10-06T11:17:24.572200+0000","last_fullsized":"2023-10-06T11:17:24.572200+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:13:56.199292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.21","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.571340+0000","last_change":"2023-10-06T11:17:24.567865+0000","last_active":"2023-10-06T11:17:24.571340+0000","last_peered":"2023-10-06T11:17:24.571340+0000","last_clean":"2023-10-06T11:17:24.571340+0000","last_became_active":"2023-10-06T11:17:24.567577+0000","last_became_peered":"2023-10-06T11:17:24.567577+0000","last_unstale":"2023-10-06T11:17:24.571340+0000","last_undegraded":"2023-10-06T11:17:24.571340+0000","last_fullsized":"2023-10-06T11:17:24.571340+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:38.610243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.20","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.573375+0000","last_change":"2023-10-06T11:17:24.571614+0000","last_active":"2023-10-06T11:17:24.573375+0000","last_peered":"2023-10-06T11:17:24.573375+0000","last_clean":"2023-10-06T11:17:24.573375+0000","last_became_active":"2023-10-06T11:17:24.571337+0000","last_became_peered":"2023-10-06T11:17:24.571337+0000","last_unstale":"2023-10-06T11:17:24.573375+0000","last_undegraded":"2023-10-06T11:17:24.573375+0000","last_fullsized":"2023-10-06T11:17:24.573375+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:06:16.172673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.579569+0000","last_change":"2023-10-06T11:17:24.577831+0000","last_active":"2023-10-06T11:17:24.579569+0000","last_peered":"2023-10-06T11:17:24.579569+0000","last_clean":"2023-10-06T11:17:24.579569+0000","last_became_active":"2023-10-06T11:17:24.577572+0000","last_became_peered":"2023-10-06T11:17:24.577572+0000","last_unstale":"2023-10-06T11:17:24.579569+0000","last_undegraded":"2023-10-06T11:17:24.579569+0000","last_fullsized":"2023-10-06T11:17:24.579569+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:48.792063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"150'4","reported_seq":14,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.584433+0000","last_change":"2023-10-06T11:17:23.564693+0000","last_active":"2023-10-06T11:17:24.584433+0000","last_peered":"2023-10-06T11:17:24.584433+0000","last_clean":"2023-10-06T11:17:24.584433+0000","last_became_active":"2023-10-06T11:17:23.564436+0000","last_became_peered":"2023-10-06T11:17:23.564436+0000","last_unstale":"2023-10-06T11:17:24.584433+0000","last_undegraded":"2023-10-06T11:17:24.584433+0000","last_fullsized":"2023-10-06T11:17:24.584433+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:01:34.348343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.573070+0000","last_change":"2023-10-06T11:17:24.565982+0000","last_active":"2023-10-06T11:17:24.573070+0000","last_peered":"2023-10-06T11:17:24.573070+0000","last_clean":"2023-10-06T11:17:24.573070+0000","last_became_active":"2023-10-06T11:17:24.565734+0000","last_became_peered":"2023-10-06T11:17:24.565734+0000","last_unstale":"2023-10-06T11:17:24.573070+0000","last_undegraded":"2023-10-06T11:17:24.573070+0000","last_fullsized":"2023-10-06T11:17:24.573070+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:52:33.751143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.582526+0000","last_change":"2023-10-06T11:17:23.569143+0000","last_active":"2023-10-06T11:17:24.582526+0000","last_peered":"2023-10-06T11:17:24.582526+0000","last_clean":"2023-10-06T11:17:24.582526+0000","last_became_active":"2023-10-06T11:17:23.568883+0000","last_became_peered":"2023-10-06T11:17:23.568883+0000","last_unstale":"2023-10-06T11:17:24.582526+0000","last_undegraded":"2023-10-06T11:17:24.582526+0000","last_fullsized":"2023-10-06T11:17:24.582526+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:33:04.810931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.569717+0000","last_change":"2023-10-06T11:17:24.565660+0000","last_active":"2023-10-06T11:17:24.569717+0000","last_peered":"2023-10-06T11:17:24.569717+0000","last_clean":"2023-10-06T11:17:24.569717+0000","last_became_active":"2023-10-06T11:17:24.564786+0000","last_became_peered":"2023-10-06T11:17:24.564786+0000","last_unstale":"2023-10-06T11:17:24.569717+0000","last_undegraded":"2023-10-06T11:17:24.569717+0000","last_fullsized":"2023-10-06T11:17:24.569717+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:51:39.405314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1d","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.581331+0000","last_change":"2023-10-06T11:17:23.567167+0000","last_active":"2023-10-06T11:17:24.581331+0000","last_peered":"2023-10-06T11:17:24.581331+0000","last_clean":"2023-10-06T11:17:24.581331+0000","last_became_active":"2023-10-06T11:17:23.566837+0000","last_became_peered":"2023-10-06T11:17:23.566837+0000","last_unstale":"2023-10-06T11:17:24.581331+0000","last_undegraded":"2023-10-06T11:17:24.581331+0000","last_fullsized":"2023-10-06T11:17:24.581331+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:02:19.001747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.579437+0000","last_change":"2023-10-06T11:17:24.576887+0000","last_active":"2023-10-06T11:17:24.579437+0000","last_peered":"2023-10-06T11:17:24.579437+0000","last_clean":"2023-10-06T11:17:24.579437+0000","last_became_active":"2023-10-06T11:17:24.576611+0000","last_became_peered":"2023-10-06T11:17:24.576611+0000","last_unstale":"2023-10-06T11:17:24.579437+0000","last_undegraded":"2023-10-06T11:17:24.579437+0000","last_fullsized":"2023-10-06T11:17:24.579437+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:08:07.693719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1c","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.580673+0000","last_change":"2023-10-06T11:17:23.569167+0000","last_active":"2023-10-06T11:17:24.580673+0000","last_peered":"2023-10-06T11:17:24.580673+0000","last_clean":"2023-10-06T11:17:24.580673+0000","last_became_active":"2023-10-06T11:17:23.568918+0000","last_became_peered":"2023-10-06T11:17:23.568918+0000","last_unstale":"2023-10-06T11:17:24.580673+0000","last_undegraded":"2023-10-06T11:17:24.580673+0000","last_fullsized":"2023-10-06T11:17:24.580673+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:36:10.273812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.576021+0000","last_change":"2023-10-06T11:17:24.572189+0000","last_active":"2023-10-06T11:17:24.576021+0000","last_peered":"2023-10-06T11:17:24.576021+0000","last_clean":"2023-10-06T11:17:24.576021+0000","last_became_active":"2023-10-06T11:17:24.571887+0000","last_became_peered":"2023-10-06T11:17:24.571887+0000","last_unstale":"2023-10-06T11:17:24.576021+0000","last_undegraded":"2023-10-06T11:17:24.576021+0000","last_fullsized":"2023-10-06T11:17:24.576021+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:15:11.263158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1b","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.582600+0000","last_change":"2023-10-06T11:17:23.571211+0000","last_active":"2023-10-06T11:17:24.582600+0000","last_peered":"2023-10-06T11:17:24.582600+0000","last_clean":"2023-10-06T11:17:24.582600+0000","last_became_active":"2023-10-06T11:17:23.570950+0000","last_became_peered":"2023-10-06T11:17:23.570950+0000","last_unstale":"2023-10-06T11:17:24.582600+0000","last_undegraded":"2023-10-06T11:17:24.582600+0000","last_fullsized":"2023-10-06T11:17:24.582600+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:55:05.030229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.570073+0000","last_change":"2023-10-06T11:17:24.565604+0000","last_active":"2023-10-06T11:17:24.570073+0000","last_peered":"2023-10-06T11:17:24.570073+0000","last_clean":"2023-10-06T11:17:24.570073+0000","last_became_active":"2023-10-06T11:17:24.565350+0000","last_became_peered":"2023-10-06T11:17:24.565350+0000","last_unstale":"2023-10-06T11:17:24.570073+0000","last_undegraded":"2023-10-06T11:17:24.570073+0000","last_fullsized":"2023-10-06T11:17:24.570073+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:15:45.424139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1a","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.582384+0000","last_change":"2023-10-06T11:17:23.574166+0000","last_active":"2023-10-06T11:17:24.582384+0000","last_peered":"2023-10-06T11:17:24.582384+0000","last_clean":"2023-10-06T11:17:24.582384+0000","last_became_active":"2023-10-06T11:17:23.573890+0000","last_became_peered":"2023-10-06T11:17:23.573890+0000","last_unstale":"2023-10-06T11:17:24.582384+0000","last_undegraded":"2023-10-06T11:17:24.582384+0000","last_fullsized":"2023-10-06T11:17:24.582384+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:03:31.748977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.576106+0000","last_change":"2023-10-06T11:17:24.568162+0000","last_active":"2023-10-06T11:17:24.576106+0000","last_peered":"2023-10-06T11:17:24.576106+0000","last_clean":"2023-10-06T11:17:24.576106+0000","last_became_active":"2023-10-06T11:17:24.567852+0000","last_became_peered":"2023-10-06T11:17:24.567852+0000","last_unstale":"2023-10-06T11:17:24.576106+0000","last_undegraded":"2023-10-06T11:17:24.576106+0000","last_fullsized":"2023-10-06T11:17:24.576106+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:55.042996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.559880+0000","last_change":"2023-10-06T11:17:23.564753+0000","last_active":"2023-10-06T11:17:24.559880+0000","last_peered":"2023-10-06T11:17:24.559880+0000","last_clean":"2023-10-06T11:17:24.559880+0000","last_became_active":"2023-10-06T11:17:23.564344+0000","last_became_peered":"2023-10-06T11:17:23.564344+0000","last_unstale":"2023-10-06T11:17:24.559880+0000","last_undegraded":"2023-10-06T11:17:24.559880+0000","last_fullsized":"2023-10-06T11:17:24.559880+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:16:28.786528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.571431+0000","last_change":"2023-10-06T11:17:24.568900+0000","last_active":"2023-10-06T11:17:24.571431+0000","last_peered":"2023-10-06T11:17:24.571431+0000","last_clean":"2023-10-06T11:17:24.571431+0000","last_became_active":"2023-10-06T11:17:24.568618+0000","last_became_peered":"2023-10-06T11:17:24.568618+0000","last_unstale":"2023-10-06T11:17:24.571431+0000","last_undegraded":"2023-10-06T11:17:24.571431+0000","last_fullsized":"2023-10-06T11:17:24.571431+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:31:49.318112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.562967+0000","last_change":"2023-10-06T11:17:23.569866+0000","last_active":"2023-10-06T11:17:24.562967+0000","last_peered":"2023-10-06T11:17:24.562967+0000","last_clean":"2023-10-06T11:17:24.562967+0000","last_became_active":"2023-10-06T11:17:23.569610+0000","last_became_peered":"2023-10-06T11:17:23.569610+0000","last_unstale":"2023-10-06T11:17:24.562967+0000","last_undegraded":"2023-10-06T11:17:24.562967+0000","last_fullsized":"2023-10-06T11:17:24.562967+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:48:47.471367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.571421+0000","last_change":"2023-10-06T11:17:24.567485+0000","last_active":"2023-10-06T11:17:24.571421+0000","last_peered":"2023-10-06T11:17:24.571421+0000","last_clean":"2023-10-06T11:17:24.571421+0000","last_became_active":"2023-10-06T11:17:24.567206+0000","last_became_peered":"2023-10-06T11:17:24.567206+0000","last_unstale":"2023-10-06T11:17:24.571421+0000","last_undegraded":"2023-10-06T11:17:24.571421+0000","last_fullsized":"2023-10-06T11:17:24.571421+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:11:12.692922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.584220+0000","last_change":"2023-10-06T11:17:23.570528+0000","last_active":"2023-10-06T11:17:24.584220+0000","last_peered":"2023-10-06T11:17:24.584220+0000","last_clean":"2023-10-06T11:17:24.584220+0000","last_became_active":"2023-10-06T11:17:23.569805+0000","last_became_peered":"2023-10-06T11:17:23.569805+0000","last_unstale":"2023-10-06T11:17:24.584220+0000","last_undegraded":"2023-10-06T11:17:24.584220+0000","last_fullsized":"2023-10-06T11:17:24.584220+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:51:47.786408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.573731+0000","last_change":"2023-10-06T11:17:24.572752+0000","last_active":"2023-10-06T11:17:24.573731+0000","last_peered":"2023-10-06T11:17:24.573731+0000","last_clean":"2023-10-06T11:17:24.573731+0000","last_became_active":"2023-10-06T11:17:24.572505+0000","last_became_peered":"2023-10-06T11:17:24.572505+0000","last_unstale":"2023-10-06T11:17:24.573731+0000","last_undegraded":"2023-10-06T11:17:24.573731+0000","last_fullsized":"2023-10-06T11:17:24.573731+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:56:46.796339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.e","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.582411+0000","last_change":"2023-10-06T11:17:23.569885+0000","last_active":"2023-10-06T11:17:24.582411+0000","last_peered":"2023-10-06T11:17:24.582411+0000","last_clean":"2023-10-06T11:17:24.582411+0000","last_became_active":"2023-10-06T11:17:23.569403+0000","last_became_peered":"2023-10-06T11:17:23.569403+0000","last_unstale":"2023-10-06T11:17:24.582411+0000","last_undegraded":"2023-10-06T11:17:24.582411+0000","last_fullsized":"2023-10-06T11:17:24.582411+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:58:24.567254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.566193+0000","last_change":"2023-10-06T11:17:24.560745+0000","last_active":"2023-10-06T11:17:24.566193+0000","last_peered":"2023-10-06T11:17:24.566193+0000","last_clean":"2023-10-06T11:17:24.566193+0000","last_became_active":"2023-10-06T11:17:24.560494+0000","last_became_peered":"2023-10-06T11:17:24.560494+0000","last_unstale":"2023-10-06T11:17:24.566193+0000","last_undegraded":"2023-10-06T11:17:24.566193+0000","last_fullsized":"2023-10-06T11:17:24.566193+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:36:51.480975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.d","version":"150'1","reported_seq":11,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.584634+0000","last_change":"2023-10-06T11:17:23.567691+0000","last_active":"2023-10-06T11:17:24.584634+0000","last_peered":"2023-10-06T11:17:24.584634+0000","last_clean":"2023-10-06T11:17:24.584634+0000","last_became_active":"2023-10-06T11:17:23.567421+0000","last_became_peered":"2023-10-06T11:17:23.567421+0000","last_unstale":"2023-10-06T11:17:24.584634+0000","last_undegraded":"2023-10-06T11:17:24.584634+0000","last_fullsized":"2023-10-06T11:17:24.584634+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:04:18.984996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.570793+0000","last_change":"2023-10-06T11:17:24.568416+0000","last_active":"2023-10-06T11:17:24.570793+0000","last_peered":"2023-10-06T11:17:24.570793+0000","last_clean":"2023-10-06T11:17:24.570793+0000","last_became_active":"2023-10-06T11:17:24.568134+0000","last_became_peered":"2023-10-06T11:17:24.568134+0000","last_unstale":"2023-10-06T11:17:24.570793+0000","last_undegraded":"2023-10-06T11:17:24.570793+0000","last_fullsized":"2023-10-06T11:17:24.570793+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:09.705291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.563087+0000","last_change":"2023-10-06T11:17:23.565748+0000","last_active":"2023-10-06T11:17:24.563087+0000","last_peered":"2023-10-06T11:17:24.563087+0000","last_clean":"2023-10-06T11:17:24.563087+0000","last_became_active":"2023-10-06T11:17:23.565303+0000","last_became_peered":"2023-10-06T11:17:23.565303+0000","last_unstale":"2023-10-06T11:17:24.563087+0000","last_undegraded":"2023-10-06T11:17:24.563087+0000","last_fullsized":"2023-10-06T11:17:24.563087+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:22:25.530859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.565528+0000","last_change":"2023-10-06T11:17:24.563167+0000","last_active":"2023-10-06T11:17:24.565528+0000","last_peered":"2023-10-06T11:17:24.565528+0000","last_clean":"2023-10-06T11:17:24.565528+0000","last_became_active":"2023-10-06T11:17:24.562916+0000","last_became_peered":"2023-10-06T11:17:24.562916+0000","last_unstale":"2023-10-06T11:17:24.565528+0000","last_undegraded":"2023-10-06T11:17:24.565528+0000","last_fullsized":"2023-10-06T11:17:24.565528+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:07.151312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.b","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.582310+0000","last_change":"2023-10-06T11:17:23.564393+0000","last_active":"2023-10-06T11:17:24.582310+0000","last_peered":"2023-10-06T11:17:24.582310+0000","last_clean":"2023-10-06T11:17:24.582310+0000","last_became_active":"2023-10-06T11:17:23.564170+0000","last_became_peered":"2023-10-06T11:17:23.564170+0000","last_unstale":"2023-10-06T11:17:24.582310+0000","last_undegraded":"2023-10-06T11:17:24.582310+0000","last_fullsized":"2023-10-06T11:17:24.582310+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:06:26.401026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.576850+0000","last_change":"2023-10-06T11:17:24.573793+0000","last_active":"2023-10-06T11:17:24.576850+0000","last_peered":"2023-10-06T11:17:24.576850+0000","last_clean":"2023-10-06T11:17:24.576850+0000","last_became_active":"2023-10-06T11:17:24.572324+0000","last_became_peered":"2023-10-06T11:17:24.572324+0000","last_unstale":"2023-10-06T11:17:24.576850+0000","last_undegraded":"2023-10-06T11:17:24.576850+0000","last_fullsized":"2023-10-06T11:17:24.576850+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:46:42.885085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.557151+0000","last_change":"2023-10-06T11:17:23.574712+0000","last_active":"2023-10-06T11:17:24.557151+0000","last_peered":"2023-10-06T11:17:24.557151+0000","last_clean":"2023-10-06T11:17:24.557151+0000","last_became_active":"2023-10-06T11:17:23.574435+0000","last_became_peered":"2023-10-06T11:17:23.574435+0000","last_unstale":"2023-10-06T11:17:24.557151+0000","last_undegraded":"2023-10-06T11:17:24.557151+0000","last_fullsized":"2023-10-06T11:17:24.557151+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:22:25.530859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.576306+0000","last_change":"2023-10-06T11:17:24.571701+0000","last_active":"2023-10-06T11:17:24.576306+0000","last_peered":"2023-10-06T11:17:24.576306+0000","last_clean":"2023-10-06T11:17:24.576306+0000","last_became_active":"2023-10-06T11:17:24.571457+0000","last_became_peered":"2023-10-06T11:17:24.571457+0000","last_unstale":"2023-10-06T11:17:24.576306+0000","last_undegraded":"2023-10-06T11:17:24.576306+0000","last_fullsized":"2023-10-06T11:17:24.576306+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:45:28.551838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.559974+0000","last_change":"2023-10-06T11:17:23.564865+0000","last_active":"2023-10-06T11:17:24.559974+0000","last_peered":"2023-10-06T11:17:24.559974+0000","last_clean":"2023-10-06T11:17:24.559974+0000","last_became_active":"2023-10-06T11:17:23.564694+0000","last_became_peered":"2023-10-06T11:17:23.564694+0000","last_unstale":"2023-10-06T11:17:24.559974+0000","last_undegraded":"2023-10-06T11:17:24.559974+0000","last_fullsized":"2023-10-06T11:17:24.559974+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:37:11.629965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.576583+0000","last_change":"2023-10-06T11:17:24.575646+0000","last_active":"2023-10-06T11:17:24.576583+0000","last_peered":"2023-10-06T11:17:24.576583+0000","last_clean":"2023-10-06T11:17:24.576583+0000","last_became_active":"2023-10-06T11:17:24.570344+0000","last_became_peered":"2023-10-06T11:17:24.570344+0000","last_unstale":"2023-10-06T11:17:24.576583+0000","last_undegraded":"2023-10-06T11:17:24.576583+0000","last_fullsized":"2023-10-06T11:17:24.576583+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:38.610243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.566184+0000","last_change":"2023-10-06T11:17:23.574083+0000","last_active":"2023-10-06T11:17:24.566184+0000","last_peered":"2023-10-06T11:17:24.566184+0000","last_clean":"2023-10-06T11:17:24.566184+0000","last_became_active":"2023-10-06T11:17:23.573768+0000","last_became_peered":"2023-10-06T11:17:23.573768+0000","last_unstale":"2023-10-06T11:17:24.566184+0000","last_undegraded":"2023-10-06T11:17:24.566184+0000","last_fullsized":"2023-10-06T11:17:24.566184+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:32:36.073066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.570609+0000","last_change":"2023-10-06T11:17:24.567062+0000","last_active":"2023-10-06T11:17:24.570609+0000","last_peered":"2023-10-06T11:17:24.570609+0000","last_clean":"2023-10-06T11:17:24.570609+0000","last_became_active":"2023-10-06T11:17:24.566801+0000","last_became_peered":"2023-10-06T11:17:24.566801+0000","last_unstale":"2023-10-06T11:17:24.570609+0000","last_undegraded":"2023-10-06T11:17:24.570609+0000","last_fullsized":"2023-10-06T11:17:24.570609+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:31:49.318112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.7","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.584283+0000","last_change":"2023-10-06T11:17:23.564402+0000","last_active":"2023-10-06T11:17:24.584283+0000","last_peered":"2023-10-06T11:17:24.584283+0000","last_clean":"2023-10-06T11:17:24.584283+0000","last_became_active":"2023-10-06T11:17:23.564113+0000","last_became_peered":"2023-10-06T11:17:23.564113+0000","last_unstale":"2023-10-06T11:17:24.584283+0000","last_undegraded":"2023-10-06T11:17:24.584283+0000","last_fullsized":"2023-10-06T11:17:24.584283+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:53:59.261371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575789+0000","last_change":"2023-10-06T11:17:24.570147+0000","last_active":"2023-10-06T11:17:24.575789+0000","last_peered":"2023-10-06T11:17:24.575789+0000","last_clean":"2023-10-06T11:17:24.575789+0000","last_became_active":"2023-10-06T11:17:24.569601+0000","last_became_peered":"2023-10-06T11:17:24.569601+0000","last_unstale":"2023-10-06T11:17:24.575789+0000","last_undegraded":"2023-10-06T11:17:24.575789+0000","last_fullsized":"2023-10-06T11:17:24.575789+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:22:20.066646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.6","version":"151'1","reported_seq":11,"reported_epoch":151,"state":"active+clean","last_fresh":"2023-10-06T11:17:25.638385+0000","last_change":"2023-10-06T11:17:23.570514+0000","last_active":"2023-10-06T11:17:25.638385+0000","last_peered":"2023-10-06T11:17:25.638385+0000","last_clean":"2023-10-06T11:17:25.638385+0000","last_became_active":"2023-10-06T11:17:23.570179+0000","last_became_peered":"2023-10-06T11:17:23.570179+0000","last_unstale":"2023-10-06T11:17:25.638385+0000","last_undegraded":"2023-10-06T11:17:25.638385+0000","last_fullsized":"2023-10-06T11:17:25.638385+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:08:06.688065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575970+0000","last_change":"2023-10-06T11:17:24.566933+0000","last_active":"2023-10-06T11:17:24.575970+0000","last_peered":"2023-10-06T11:17:24.575970+0000","last_clean":"2023-10-06T11:17:24.575970+0000","last_became_active":"2023-10-06T11:17:24.566764+0000","last_became_peered":"2023-10-06T11:17:24.566764+0000","last_unstale":"2023-10-06T11:17:24.575970+0000","last_undegraded":"2023-10-06T11:17:24.575970+0000","last_fullsized":"2023-10-06T11:17:24.575970+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:21:32.239463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.554770+0000","last_change":"2023-10-06T11:17:23.571952+0000","last_active":"2023-10-06T11:17:24.554770+0000","last_peered":"2023-10-06T11:17:24.554770+0000","last_clean":"2023-10-06T11:17:24.554770+0000","last_became_active":"2023-10-06T11:17:23.565102+0000","last_became_peered":"2023-10-06T11:17:23.565102+0000","last_unstale":"2023-10-06T11:17:24.554770+0000","last_undegraded":"2023-10-06T11:17:24.554770+0000","last_fullsized":"2023-10-06T11:17:24.554770+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:11:11.687267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.572885+0000","last_change":"2023-10-06T11:17:24.569341+0000","last_active":"2023-10-06T11:17:24.572885+0000","last_peered":"2023-10-06T11:17:24.572885+0000","last_clean":"2023-10-06T11:17:24.572885+0000","last_became_active":"2023-10-06T11:17:24.569094+0000","last_became_peered":"2023-10-06T11:17:24.569094+0000","last_unstale":"2023-10-06T11:17:24.572885+0000","last_undegraded":"2023-10-06T11:17:24.572885+0000","last_fullsized":"2023-10-06T11:17:24.572885+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:15:52.609098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.560119+0000","last_change":"2023-10-06T11:17:23.569219+0000","last_active":"2023-10-06T11:17:24.560119+0000","last_peered":"2023-10-06T11:17:24.560119+0000","last_clean":"2023-10-06T11:17:24.560119+0000","last_became_active":"2023-10-06T11:17:23.568946+0000","last_became_peered":"2023-10-06T11:17:23.568946+0000","last_unstale":"2023-10-06T11:17:24.560119+0000","last_undegraded":"2023-10-06T11:17:24.560119+0000","last_fullsized":"2023-10-06T11:17:24.560119+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:12:28.041975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.571902+0000","last_change":"2023-10-06T11:17:24.569808+0000","last_active":"2023-10-06T11:17:24.571902+0000","last_peered":"2023-10-06T11:17:24.571902+0000","last_clean":"2023-10-06T11:17:24.571902+0000","last_became_active":"2023-10-06T11:17:24.569380+0000","last_became_peered":"2023-10-06T11:17:24.569380+0000","last_unstale":"2023-10-06T11:17:24.571902+0000","last_undegraded":"2023-10-06T11:17:24.571902+0000","last_fullsized":"2023-10-06T11:17:24.571902+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:18.748550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.558165+0000","last_change":"2023-10-06T11:17:23.564135+0000","last_active":"2023-10-06T11:17:24.558165+0000","last_peered":"2023-10-06T11:17:24.558165+0000","last_clean":"2023-10-06T11:17:24.558165+0000","last_became_active":"2023-10-06T11:17:23.563797+0000","last_became_peered":"2023-10-06T11:17:23.563797+0000","last_unstale":"2023-10-06T11:17:24.558165+0000","last_undegraded":"2023-10-06T11:17:24.558165+0000","last_fullsized":"2023-10-06T11:17:24.558165+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:09.701424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.579474+0000","last_change":"2023-10-06T11:17:24.577355+0000","last_active":"2023-10-06T11:17:24.579474+0000","last_peered":"2023-10-06T11:17:24.579474+0000","last_clean":"2023-10-06T11:17:24.579474+0000","last_became_active":"2023-10-06T11:17:24.577095+0000","last_became_peered":"2023-10-06T11:17:24.577095+0000","last_unstale":"2023-10-06T11:17:24.579474+0000","last_undegraded":"2023-10-06T11:17:24.579474+0000","last_fullsized":"2023-10-06T11:17:24.579474+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:15:11.263158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.554819+0000","last_change":"2023-10-06T11:17:23.562075+0000","last_active":"2023-10-06T11:17:24.554819+0000","last_peered":"2023-10-06T11:17:24.554819+0000","last_clean":"2023-10-06T11:17:24.554819+0000","last_became_active":"2023-10-06T11:17:23.561792+0000","last_became_peered":"2023-10-06T11:17:23.561792+0000","last_unstale":"2023-10-06T11:17:24.554819+0000","last_undegraded":"2023-10-06T11:17:24.554819+0000","last_fullsized":"2023-10-06T11:17:24.554819+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:37:08.699637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.567434+0000","last_change":"2023-10-06T11:17:24.560966+0000","last_active":"2023-10-06T11:17:24.567434+0000","last_peered":"2023-10-06T11:17:24.567434+0000","last_clean":"2023-10-06T11:17:24.567434+0000","last_became_active":"2023-10-06T11:17:24.560664+0000","last_became_peered":"2023-10-06T11:17:24.560664+0000","last_unstale":"2023-10-06T11:17:24.567434+0000","last_undegraded":"2023-10-06T11:17:24.567434+0000","last_fullsized":"2023-10-06T11:17:24.567434+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:41:38.833103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.558951+0000","last_change":"2023-10-06T11:17:23.567100+0000","last_active":"2023-10-06T11:17:24.558951+0000","last_peered":"2023-10-06T11:17:24.558951+0000","last_clean":"2023-10-06T11:17:24.558951+0000","last_became_active":"2023-10-06T11:17:23.566811+0000","last_became_peered":"2023-10-06T11:17:23.566811+0000","last_unstale":"2023-10-06T11:17:24.558951+0000","last_undegraded":"2023-10-06T11:17:24.558951+0000","last_fullsized":"2023-10-06T11:17:24.558951+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:11:04.566108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575944+0000","last_change":"2023-10-06T11:17:24.567836+0000","last_active":"2023-10-06T11:17:24.575944+0000","last_peered":"2023-10-06T11:17:24.575944+0000","last_clean":"2023-10-06T11:17:24.575944+0000","last_became_active":"2023-10-06T11:17:24.567579+0000","last_became_peered":"2023-10-06T11:17:24.567579+0000","last_unstale":"2023-10-06T11:17:24.575944+0000","last_undegraded":"2023-10-06T11:17:24.575944+0000","last_fullsized":"2023-10-06T11:17:24.575944+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:02:58.843409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.558726+0000","last_change":"2023-10-06T11:17:23.569068+0000","last_active":"2023-10-06T11:17:24.558726+0000","last_peered":"2023-10-06T11:17:24.558726+0000","last_clean":"2023-10-06T11:17:24.558726+0000","last_became_active":"2023-10-06T11:17:23.568821+0000","last_became_peered":"2023-10-06T11:17:23.568821+0000","last_unstale":"2023-10-06T11:17:24.558726+0000","last_undegraded":"2023-10-06T11:17:24.558726+0000","last_fullsized":"2023-10-06T11:17:24.558726+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:08:53.820378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.573345+0000","last_change":"2023-10-06T11:17:24.571813+0000","last_active":"2023-10-06T11:17:24.573345+0000","last_peered":"2023-10-06T11:17:24.573345+0000","last_clean":"2023-10-06T11:17:24.573345+0000","last_became_active":"2023-10-06T11:17:24.571369+0000","last_became_peered":"2023-10-06T11:17:24.571369+0000","last_unstale":"2023-10-06T11:17:24.573345+0000","last_undegraded":"2023-10-06T11:17:24.573345+0000","last_fullsized":"2023-10-06T11:17:24.573345+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:42:22.093331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.13","version":"150'2","reported_seq":12,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.587184+0000","last_change":"2023-10-06T11:17:23.567296+0000","last_active":"2023-10-06T11:17:24.587184+0000","last_peered":"2023-10-06T11:17:24.587184+0000","last_clean":"2023-10-06T11:17:24.587184+0000","last_became_active":"2023-10-06T11:17:23.566993+0000","last_became_peered":"2023-10-06T11:17:23.566993+0000","last_unstale":"2023-10-06T11:17:24.587184+0000","last_undegraded":"2023-10-06T11:17:24.587184+0000","last_fullsized":"2023-10-06T11:17:24.587184+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:11:06.145658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":131,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.557891+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:17:24.557891+0000","last_peered":"2023-10-06T11:17:24.557891+0000","last_clean":"2023-10-06T11:17:24.557891+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:17:24.557891+0000","last_undegraded":"2023-10-06T11:17:24.557891+0000","last_fullsized":"2023-10-06T11:17:24.557891+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575891+0000","last_change":"2023-10-06T11:17:24.570948+0000","last_active":"2023-10-06T11:17:24.575891+0000","last_peered":"2023-10-06T11:17:24.575891+0000","last_clean":"2023-10-06T11:17:24.575891+0000","last_became_active":"2023-10-06T11:17:24.570719+0000","last_became_peered":"2023-10-06T11:17:24.570719+0000","last_unstale":"2023-10-06T11:17:24.575891+0000","last_undegraded":"2023-10-06T11:17:24.575891+0000","last_fullsized":"2023-10-06T11:17:24.575891+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:56:17.624615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.554724+0000","last_change":"2023-10-06T11:17:23.564126+0000","last_active":"2023-10-06T11:17:24.554724+0000","last_peered":"2023-10-06T11:17:24.554724+0000","last_clean":"2023-10-06T11:17:24.554724+0000","last_became_active":"2023-10-06T11:17:23.563881+0000","last_became_peered":"2023-10-06T11:17:23.563881+0000","last_unstale":"2023-10-06T11:17:24.554724+0000","last_undegraded":"2023-10-06T11:17:24.554724+0000","last_fullsized":"2023-10-06T11:17:24.554724+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:22:55.946021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":124,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.555311+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:17:24.555311+0000","last_peered":"2023-10-06T11:17:24.555311+0000","last_clean":"2023-10-06T11:17:24.555311+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:17:24.555311+0000","last_undegraded":"2023-10-06T11:17:24.555311+0000","last_fullsized":"2023-10-06T11:17:24.555311+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.580493+0000","last_change":"2023-10-06T11:17:24.569576+0000","last_active":"2023-10-06T11:17:24.580493+0000","last_peered":"2023-10-06T11:17:24.580493+0000","last_clean":"2023-10-06T11:17:24.580493+0000","last_became_active":"2023-10-06T11:17:24.569315+0000","last_became_peered":"2023-10-06T11:17:24.569315+0000","last_unstale":"2023-10-06T11:17:24.580493+0000","last_undegraded":"2023-10-06T11:17:24.580493+0000","last_fullsized":"2023-10-06T11:17:24.580493+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:53:23.035153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.15","version":"150'3","reported_seq":13,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.584410+0000","last_change":"2023-10-06T11:17:23.564149+0000","last_active":"2023-10-06T11:17:24.584410+0000","last_peered":"2023-10-06T11:17:24.584410+0000","last_clean":"2023-10-06T11:17:24.584410+0000","last_became_active":"2023-10-06T11:17:23.563857+0000","last_became_peered":"2023-10-06T11:17:23.563857+0000","last_unstale":"2023-10-06T11:17:24.584410+0000","last_undegraded":"2023-10-06T11:17:24.584410+0000","last_fullsized":"2023-10-06T11:17:24.584410+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:55:05.030229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":122,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.562938+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:17:24.562938+0000","last_peered":"2023-10-06T11:17:24.562938+0000","last_clean":"2023-10-06T11:17:24.562938+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:17:24.562938+0000","last_undegraded":"2023-10-06T11:17:24.562938+0000","last_fullsized":"2023-10-06T11:17:24.562938+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":267,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.566276+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:17:24.566276+0000","last_peered":"2023-10-06T11:17:24.566276+0000","last_clean":"2023-10-06T11:17:24.566276+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:17:24.566276+0000","last_undegraded":"2023-10-06T11:17:24.566276+0000","last_fullsized":"2023-10-06T11:17:24.566276+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575929+0000","last_change":"2023-10-06T11:17:24.567759+0000","last_active":"2023-10-06T11:17:24.575929+0000","last_peered":"2023-10-06T11:17:24.575929+0000","last_clean":"2023-10-06T11:17:24.575929+0000","last_became_active":"2023-10-06T11:17:24.567496+0000","last_became_peered":"2023-10-06T11:17:24.567496+0000","last_unstale":"2023-10-06T11:17:24.575929+0000","last_undegraded":"2023-10-06T11:17:24.575929+0000","last_fullsized":"2023-10-06T11:17:24.575929+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:25:25.920939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"150'6","reported_seq":16,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.586312+0000","last_change":"2023-10-06T11:17:23.570090+0000","last_active":"2023-10-06T11:17:24.586312+0000","last_peered":"2023-10-06T11:17:24.586312+0000","last_clean":"2023-10-06T11:17:24.586312+0000","last_became_active":"2023-10-06T11:17:23.569829+0000","last_became_peered":"2023-10-06T11:17:23.569829+0000","last_unstale":"2023-10-06T11:17:24.586312+0000","last_undegraded":"2023-10-06T11:17:24.586312+0000","last_fullsized":"2023-10-06T11:17:24.586312+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:15:10.257503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":117,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.563929+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:17:24.563929+0000","last_peered":"2023-10-06T11:17:24.563929+0000","last_clean":"2023-10-06T11:17:24.563929+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:17:24.563929+0000","last_undegraded":"2023-10-06T11:17:24.563929+0000","last_fullsized":"2023-10-06T11:17:24.563929+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.579240+0000","last_change":"2023-10-06T11:17:24.575811+0000","last_active":"2023-10-06T11:17:24.579240+0000","last_peered":"2023-10-06T11:17:24.579240+0000","last_clean":"2023-10-06T11:17:24.579240+0000","last_became_active":"2023-10-06T11:17:24.570303+0000","last_became_peered":"2023-10-06T11:17:24.570303+0000","last_unstale":"2023-10-06T11:17:24.579240+0000","last_undegraded":"2023-10-06T11:17:24.579240+0000","last_fullsized":"2023-10-06T11:17:24.579240+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:59:56.385931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.555042+0000","last_change":"2023-10-06T11:17:23.570382+0000","last_active":"2023-10-06T11:17:24.555042+0000","last_peered":"2023-10-06T11:17:24.555042+0000","last_clean":"2023-10-06T11:17:24.555042+0000","last_became_active":"2023-10-06T11:17:23.569847+0000","last_became_peered":"2023-10-06T11:17:23.569847+0000","last_unstale":"2023-10-06T11:17:24.555042+0000","last_undegraded":"2023-10-06T11:17:24.555042+0000","last_fullsized":"2023-10-06T11:17:24.555042+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:15:11.795033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":117,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.566358+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:17:24.566358+0000","last_peered":"2023-10-06T11:17:24.566358+0000","last_clean":"2023-10-06T11:17:24.566358+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:17:24.566358+0000","last_undegraded":"2023-10-06T11:17:24.566358+0000","last_fullsized":"2023-10-06T11:17:24.566358+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.579416+0000","last_change":"2023-10-06T11:17:24.576816+0000","last_active":"2023-10-06T11:17:24.579416+0000","last_peered":"2023-10-06T11:17:24.579416+0000","last_clean":"2023-10-06T11:17:24.579416+0000","last_became_active":"2023-10-06T11:17:24.576459+0000","last_became_peered":"2023-10-06T11:17:24.576459+0000","last_unstale":"2023-10-06T11:17:24.579416+0000","last_undegraded":"2023-10-06T11:17:24.579416+0000","last_fullsized":"2023-10-06T11:17:24.579416+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:15:12.800687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.555532+0000","last_change":"2023-10-06T11:17:23.570674+0000","last_active":"2023-10-06T11:17:24.555532+0000","last_peered":"2023-10-06T11:17:24.555532+0000","last_clean":"2023-10-06T11:17:24.555532+0000","last_became_active":"2023-10-06T11:17:23.570308+0000","last_became_peered":"2023-10-06T11:17:23.570308+0000","last_unstale":"2023-10-06T11:17:24.555532+0000","last_undegraded":"2023-10-06T11:17:24.555532+0000","last_fullsized":"2023-10-06T11:17:24.555532+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:59:55.380277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":140,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.559017+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:17:24.559017+0000","last_peered":"2023-10-06T11:17:24.559017+0000","last_clean":"2023-10-06T11:17:24.559017+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:17:24.559017+0000","last_undegraded":"2023-10-06T11:17:24.559017+0000","last_fullsized":"2023-10-06T11:17:24.559017+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.575922+0000","last_change":"2023-10-06T11:17:24.566665+0000","last_active":"2023-10-06T11:17:24.575922+0000","last_peered":"2023-10-06T11:17:24.575922+0000","last_clean":"2023-10-06T11:17:24.575922+0000","last_became_active":"2023-10-06T11:17:24.566426+0000","last_became_peered":"2023-10-06T11:17:24.566426+0000","last_unstale":"2023-10-06T11:17:24.575922+0000","last_undegraded":"2023-10-06T11:17:24.575922+0000","last_fullsized":"2023-10-06T11:17:24.575922+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:29:19.469513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.10","version":"150'8","reported_seq":18,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.587514+0000","last_change":"2023-10-06T11:17:23.568131+0000","last_active":"2023-10-06T11:17:24.587514+0000","last_peered":"2023-10-06T11:17:24.587514+0000","last_clean":"2023-10-06T11:17:24.587514+0000","last_became_active":"2023-10-06T11:17:23.567954+0000","last_became_peered":"2023-10-06T11:17:23.567954+0000","last_unstale":"2023-10-06T11:17:24.587514+0000","last_undegraded":"2023-10-06T11:17:24.587514+0000","last_fullsized":"2023-10-06T11:17:24.587514+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:45.678850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":124,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.566824+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:17:24.566824+0000","last_peered":"2023-10-06T11:17:24.566824+0000","last_clean":"2023-10-06T11:17:24.566824+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:17:24.566824+0000","last_undegraded":"2023-10-06T11:17:24.566824+0000","last_fullsized":"2023-10-06T11:17:24.566824+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":9,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.570686+0000","last_change":"2023-10-06T11:17:24.567445+0000","last_active":"2023-10-06T11:17:24.570686+0000","last_peered":"2023-10-06T11:17:24.570686+0000","last_clean":"2023-10-06T11:17:24.570686+0000","last_became_active":"2023-10-06T11:17:24.567192+0000","last_became_peered":"2023-10-06T11:17:24.567192+0000","last_unstale":"2023-10-06T11:17:24.570686+0000","last_undegraded":"2023-10-06T11:17:24.570686+0000","last_fullsized":"2023-10-06T11:17:24.570686+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:23.546397+0000","last_clean_scrub_stamp":"2023-10-06T11:17:23.546397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:20.201597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":10,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.558847+0000","last_change":"2023-10-06T11:17:23.565830+0000","last_active":"2023-10-06T11:17:24.558847+0000","last_peered":"2023-10-06T11:17:24.558847+0000","last_clean":"2023-10-06T11:17:24.558847+0000","last_became_active":"2023-10-06T11:17:23.565544+0000","last_became_peered":"2023-10-06T11:17:23.565544+0000","last_unstale":"2023-10-06T11:17:24.558847+0000","last_undegraded":"2023-10-06T11:17:24.558847+0000","last_fullsized":"2023-10-06T11:17:24.558847+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:17:22.540743+0000","last_clean_scrub_stamp":"2023-10-06T11:17:22.540743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:31:45.678850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":124,"reported_epoch":150,"state":"active+clean","last_fresh":"2023-10-06T11:17:24.566899+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:17:24.566899+0000","last_peered":"2023-10-06T11:17:24.566899+0000","last_clean":"2023-10-06T11:17:24.566899+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:17:24.566899+0000","last_undegraded":"2023-10-06T11:17:24.566899+0000","last_fullsized":"2023-10-06T11:17:24.566899+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":24,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":23,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574994,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303816,"kb_used_data":2432,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068024,"statfs":{"total":96636764160,"available":96325656576,"internally_reserved":0,"allocated":2490368,"data_stored":1465114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.54300000000000004,"15min":0.626},"min":{"1min":0.35699999999999998,"5min":0.252,"15min":0.21199999999999999},"max":{"1min":0.71699999999999997,"5min":4.407,"15min":23.908999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.51400000000000001,"15min":0.57499999999999996},"min":{"1min":0.33200000000000002,"5min":0.26900000000000002,"15min":0.22500000000000001},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":9.3230000000000004},"last":0.42099999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53700000000000003,"15min":0.56000000000000005},"min":{"1min":0.28799999999999998,"5min":0.28399999999999997,"15min":0.26000000000000001},"max":{"1min":0.77700000000000002,"5min":2.4689999999999999,"15min":9.2360000000000007},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.502,"15min":0.504},"min":{"1min":0.40999999999999998,"5min":0.33100000000000002,"15min":0.25900000000000001},"max":{"1min":0.70899999999999996,"5min":0.78900000000000003,"15min":4.327},"last":0.373}]},{"osd":2,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.56899999999999995,"15min":0.51900000000000002},"min":{"1min":0.40100000000000002,"5min":0.33000000000000002,"15min":0.26500000000000001},"max":{"1min":0.69999999999999996,"5min":4.3120000000000003,"15min":4.3120000000000003},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.55900000000000005,"15min":0.55600000000000005},"min":{"1min":0.372,"5min":0.31,"15min":0.29999999999999999},"max":{"1min":0.74099999999999999,"5min":3.0600000000000001,"15min":4.7309999999999999},"last":0.57599999999999996}]},{"osd":3,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.56899999999999995,"15min":0.54100000000000004},"min":{"1min":0.35299999999999998,"5min":0.32600000000000001,"15min":0.27900000000000003},"max":{"1min":0.72299999999999998,"5min":4.5190000000000001,"15min":4.5190000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.59499999999999997,"15min":0.59999999999999998},"min":{"1min":0.42799999999999999,"5min":0.36599999999999999,"15min":0.29699999999999999},"max":{"1min":0.76200000000000001,"5min":3.0070000000000001,"15min":9.3879999999999999},"last":0.60199999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.53400000000000003,"15min":0.49299999999999999},"min":{"1min":0.32000000000000001,"5min":0.29799999999999999,"15min":0.24399999999999999},"max":{"1min":0.69199999999999995,"5min":4.6639999999999997,"15min":4.6639999999999997},"last":0.442},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.57299999999999995,"15min":0.53600000000000003},"min":{"1min":0.35399999999999998,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.70899999999999996,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":0.58999999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53900000000000003,"15min":0.56000000000000005},"min":{"1min":0.39200000000000002,"5min":0.32900000000000001,"15min":0.26000000000000001},"max":{"1min":0.66100000000000003,"5min":0.77000000000000002,"15min":9.3499999999999996},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.53100000000000003,"15min":0.54200000000000004},"min":{"1min":0.377,"5min":0.30099999999999999,"15min":0.26800000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":4.444},"last":0.53000000000000003}]},{"osd":6,"last update":"Fri Oct 6 11:17:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57099999999999995,"15min":0.59699999999999998},"min":{"1min":0.41399999999999998,"5min":0.38100000000000001,"15min":0.29199999999999998},"max":{"1min":0.73699999999999999,"5min":0.82099999999999995,"15min":9.4969999999999999},"last":0.498},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.64000000000000001,"15min":0.62},"min":{"1min":0.44,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.75600000000000001,"5min":4.4669999999999996,"15min":7.2039999999999997},"last":0.55600000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574996,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299136,"kb_used_data":1848,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072704,"statfs":{"total":96636764160,"available":96330448896,"internally_reserved":0,"allocated":1892352,"data_stored":873393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.60199999999999998,"15min":0.52400000000000002},"min":{"1min":0.35199999999999998,"5min":0.247,"15min":0.187},"max":{"1min":0.80500000000000005,"5min":9.5549999999999997,"15min":9.5549999999999997},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.65600000000000003,"15min":0.56699999999999995},"min":{"1min":0.44400000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.78400000000000003,"5min":9.4659999999999993,"15min":9.4659999999999993},"last":0.67900000000000005}]},{"osd":1,"last update":"Fri Oct 6 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.49299999999999999,"15min":0.48399999999999999},"min":{"1min":0.33500000000000002,"5min":0.26800000000000002,"15min":0.23300000000000001},"max":{"1min":0.74299999999999999,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.57699999999999996,"15min":0.51600000000000001},"min":{"1min":0.34399999999999997,"5min":0.216,"15min":0.216},"max":{"1min":0.71399999999999997,"5min":5.2670000000000003,"15min":5.2670000000000003},"last":0.63900000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.5,"15min":0.503},"min":{"1min":0.33700000000000002,"5min":0.252,"15min":0.252},"max":{"1min":0.77100000000000002,"5min":0.93200000000000005,"15min":7.0659999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.51300000000000001,"15min":0.51900000000000002},"min":{"1min":0.41199999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.69199999999999995,"5min":1.0069999999999999,"15min":7.0819999999999999},"last":0.624}]},{"osd":3,"last update":"Fri Oct 6 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.56000000000000005,"15min":0.52000000000000002},"min":{"1min":0.39700000000000002,"5min":0.317,"15min":0.25800000000000001},"max":{"1min":0.75700000000000001,"5min":3.871,"15min":3.871},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.54000000000000004,"15min":0.53200000000000003},"min":{"1min":0.43099999999999999,"5min":0.32100000000000001,"15min":0.312},"max":{"1min":0.72799999999999998,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.60599999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.48099999999999998,"15min":0.47799999999999998},"min":{"1min":0.34899999999999998,"5min":0.26800000000000002,"15min":0.24299999999999999},"max":{"1min":0.68600000000000005,"5min":0.88,"15min":0.88},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53600000000000003,"15min":0.53300000000000003},"min":{"1min":0.378,"5min":0.29699999999999999,"15min":0.27900000000000003},"max":{"1min":0.71199999999999997,"5min":0.82399999999999995,"15min":1.0680000000000001},"last":0.47299999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52100000000000002,"15min":0.51700000000000002},"min":{"1min":0.38400000000000001,"5min":0.32000000000000001,"15min":0.28399999999999997},"max":{"1min":0.73399999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.627,"15min":0.57999999999999996},"min":{"1min":0.39500000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.745,"5min":7.1379999999999999,"15min":7.1379999999999999},"last":0.42499999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:16:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58599999999999997,"15min":0.56799999999999995},"min":{"1min":0.42499999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.748,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59099999999999997,"15min":0.58499999999999996},"min":{"1min":0.45800000000000002,"5min":0.36399999999999999,"15min":0.30199999999999999},"max":{"1min":0.82099999999999995,"5min":0.86899999999999999,"15min":0.88400000000000001},"last":0.499}]}]},{"osd":1,"up_from":13,"seq":55834574995,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312020,"kb_used_data":2444,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059820,"statfs":{"total":96636764160,"available":96317255680,"internally_reserved":0,"allocated":2502656,"data_stored":1466650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:59 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.47099999999999997,"15min":0.377},"min":{"1min":0.247,"5min":0.20499999999999999,"15min":0.186},"max":{"1min":0.49399999999999999,"5min":13.393000000000001,"15min":13.393000000000001},"last":0.20499999999999999},{"interface":"front","average":{"1min":0.374,"5min":0.46899999999999997,"15min":0.38600000000000001},"min":{"1min":0.254,"5min":0.22500000000000001,"15min":0.19700000000000001},"max":{"1min":0.53900000000000003,"5min":11.462,"15min":11.462},"last":0.29499999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:16:59 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.41399999999999998,"15min":0.36099999999999999},"min":{"1min":0.25800000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.48099999999999998,"5min":8.0470000000000006,"15min":8.0470000000000006},"last":0.217},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.44900000000000001,"15min":0.40799999999999997},"min":{"1min":0.32100000000000001,"5min":0.215,"15min":0.20999999999999999},"max":{"1min":0.58399999999999996,"5min":4.8630000000000004,"15min":4.8630000000000004},"last":0.27100000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:16:59 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46700000000000003,"15min":0.42599999999999999},"min":{"1min":0.28599999999999998,"5min":0.255,"15min":0.252},"max":{"1min":0.64800000000000002,"5min":4.8029999999999999,"15min":4.8029999999999999},"last":0.311},{"interface":"front","average":{"1min":0.435,"5min":0.45100000000000001,"15min":0.39700000000000002},"min":{"1min":0.29699999999999999,"5min":0.23400000000000001,"15min":0.217},"max":{"1min":0.749,"5min":5.8700000000000001,"15min":5.8700000000000001},"last":0.23799999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:16:59 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.54500000000000004,"15min":0.52500000000000002},"min":{"1min":0.39900000000000002,"5min":0.28299999999999997,"15min":0.28199999999999997},"max":{"1min":0.88400000000000001,"5min":1.264,"15min":1.264},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.625,"15min":0.57299999999999995},"min":{"1min":0.41199999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.89400000000000002,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.48699999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:16:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.61299999999999999,"15min":0.57199999999999995},"min":{"1min":0.45600000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.78600000000000003,"5min":3.4390000000000001,"15min":3.4390000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.68500000000000005,"15min":0.59299999999999997},"min":{"1min":0.42999999999999999,"5min":0.36799999999999999,"15min":0.29499999999999998},"max":{"1min":0.84499999999999997,"5min":9.3829999999999991,"15min":9.3829999999999991},"last":0.53800000000000003}]},{"osd":6,"last update":"Fri Oct 6 11:16:59 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.64200000000000002,"15min":0.59299999999999997},"min":{"1min":0.42099999999999999,"5min":0.35999999999999999,"15min":0.315},"max":{"1min":0.83599999999999997,"5min":3.4750000000000001,"15min":3.4750000000000001},"last":0.496},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.64000000000000001,"15min":0.60099999999999998},"min":{"1min":0.36599999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.872,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.69199999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:16:59 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.66200000000000003,"15min":0.61499999999999999},"min":{"1min":0.46600000000000003,"5min":0.39800000000000002,"15min":0.38500000000000001},"max":{"1min":0.82999999999999996,"5min":4.7290000000000001,"15min":4.7290000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.627,"15min":0.59599999999999997},"min":{"1min":0.48599999999999999,"5min":0.38900000000000001,"15min":0.374},"max":{"1min":0.81100000000000005,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.54900000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574994,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303240,"kb_used_data":1856,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068600,"statfs":{"total":96636764160,"available":96326246400,"internally_reserved":0,"allocated":1900544,"data_stored":873497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.34799999999999998,"15min":0.47099999999999997},"min":{"1min":0.248,"5min":0.20399999999999999,"15min":0.184},"max":{"1min":0.59599999999999997,"5min":0.64900000000000002,"15min":36.097999999999999},"last":0.436},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.371,"15min":0.38300000000000001},"min":{"1min":0.29899999999999999,"5min":0.22,"15min":0.182},"max":{"1min":0.497,"5min":0.92400000000000004,"15min":7.2990000000000004},"last":0.26400000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.37,"15min":0.503},"min":{"1min":0.223,"5min":0.223,"15min":0.217},"max":{"1min":0.49099999999999999,"5min":0.82599999999999996,"15min":36.07},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.39800000000000002,"15min":0.40999999999999998},"min":{"1min":0.26800000000000002,"5min":0.25600000000000001,"15min":0.219},"max":{"1min":0.57099999999999995,"5min":0.94899999999999995,"15min":6.7800000000000002},"last":0.41899999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.36899999999999999,"15min":0.39500000000000002},"min":{"1min":0.27500000000000002,"5min":0.255,"15min":0.223},"max":{"1min":0.53800000000000003,"5min":0.64100000000000001,"15min":8.4130000000000003},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.43099999999999999,"15min":0.56000000000000005},"min":{"1min":0.315,"5min":0.25800000000000001,"15min":0.249},"max":{"1min":0.59999999999999998,"5min":1.9079999999999999,"15min":35.959000000000003},"last":0.40600000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.57999999999999996,"15min":0.56699999999999995},"min":{"1min":0.39100000000000001,"5min":0.33800000000000002,"15min":0.29599999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":2.427},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.60199999999999998,"15min":0.73199999999999998},"min":{"1min":0.42899999999999999,"5min":0.374,"15min":0.29299999999999998},"max":{"1min":0.84999999999999998,"5min":0.94999999999999996,"15min":36.005000000000003},"last":0.82699999999999996}]},{"osd":5,"last update":"Fri Oct 6 11:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.58599999999999997,"15min":0.58499999999999996},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.32900000000000001},"max":{"1min":0.95299999999999996,"5min":0.999,"15min":6.6699999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58099999999999996,"15min":0.56000000000000005},"min":{"1min":0.41299999999999998,"5min":0.372,"15min":0.315},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":2.0600000000000001},"last":0.71399999999999997}]},{"osd":6,"last update":"Fri Oct 6 11:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.61299999999999999,"15min":0.73399999999999999},"min":{"1min":0.50600000000000001,"5min":0.39200000000000002,"15min":0.317},"max":{"1min":0.89600000000000002,"5min":0.98699999999999999,"15min":36.037999999999997},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.63100000000000001,"15min":0.64000000000000001},"min":{"1min":0.41299999999999998,"5min":0.40999999999999998,"15min":0.36399999999999999},"max":{"1min":0.89200000000000002,"5min":1.028,"15min":6.7110000000000003},"last":0.74099999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.61499999999999999,"15min":0.624},"min":{"1min":0.432,"5min":0.40999999999999998,"15min":0.371},"max":{"1min":0.86599999999999999,"5min":1.054,"15min":6.742},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.58999999999999997,"15min":0.57399999999999995},"min":{"1min":0.42799999999999999,"5min":0.41399999999999998,"15min":0.34499999999999997},"max":{"1min":0.86699999999999999,"5min":0.96199999999999997,"15min":1.917},"last":0.628}]}]},{"osd":2,"up_from":13,"seq":55834574995,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299136,"kb_used_data":1848,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072704,"statfs":{"total":96636764160,"available":96330448896,"internally_reserved":0,"allocated":1892352,"data_stored":873393,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":0.46700000000000003,"15min":0.36299999999999999},"min":{"1min":0.248,"5min":0.214,"15min":0.17999999999999999},"max":{"1min":15.228,"5min":15.228,"15min":15.228},"last":0.37},{"interface":"front","average":{"1min":0.503,"5min":0.40600000000000003,"15min":0.38900000000000001},"min":{"1min":0.32900000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":0.45500000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.38200000000000001,"15min":0.375},"min":{"1min":0.28899999999999998,"5min":0.23599999999999999,"15min":0.19900000000000001},"max":{"1min":0.56200000000000006,"5min":0.57499999999999996,"15min":0.745},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.36199999999999999,"15min":0.35399999999999998},"min":{"1min":0.23200000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.42499999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.36899999999999999,"15min":0.36799999999999999},"min":{"1min":0.27900000000000003,"5min":0.23699999999999999,"15min":0.23200000000000001},"max":{"1min":0.621,"5min":0.621,"15min":0.629},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.378,"15min":0.36799999999999999},"min":{"1min":0.27500000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.64400000000000002},"last":0.46500000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.46700000000000003,"5min":0.30599999999999999,"15min":0.30299999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.53700000000000003},{"interface":"front","average":{"1min":1.3200000000000001,"5min":0.69199999999999995,"15min":0.59499999999999997},"min":{"1min":0.42799999999999999,"5min":0.28199999999999997,"15min":0.27900000000000003},"max":{"1min":15.26,"5min":15.26,"15min":15.26},"last":0.58099999999999996}]},{"osd":5,"last update":"Fri Oct 6 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":0.69999999999999996,"15min":0.59399999999999997},"min":{"1min":0.38200000000000001,"5min":0.35799999999999998,"15min":0.32400000000000001},"max":{"1min":15.186,"5min":15.186,"15min":15.186},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.57599999999999996,"15min":0.55900000000000005},"min":{"1min":0.44600000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.63200000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.60099999999999998,"15min":0.58499999999999996},"min":{"1min":0.48899999999999999,"5min":0.38200000000000001,"15min":0.32600000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.60199999999999998,"15min":0.57899999999999996},"min":{"1min":0.47099999999999997,"5min":0.40699999999999997,"15min":0.34200000000000003},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.59399999999999997}]},{"osd":7,"last update":"Fri Oct 6 11:17:05 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":0.68200000000000005,"15min":0.59799999999999998},"min":{"1min":0.46600000000000003,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":10.977,"5min":10.977,"15min":10.977},"last":0.624},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.58599999999999997,"15min":0.57399999999999995},"min":{"1min":0.52100000000000002,"5min":0.38800000000000001,"15min":0.38200000000000001},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.61299999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574995,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311444,"kb_used_data":1868,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060396,"statfs":{"total":96636764160,"available":96317845504,"internally_reserved":0,"allocated":1912832,"data_stored":875505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.34399999999999997,"15min":0.32500000000000001},"min":{"1min":0.248,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.46899999999999997,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.41199999999999998,"15min":0.39100000000000001},"min":{"1min":0.313,"5min":0.23000000000000001,"15min":0.22700000000000001},"max":{"1min":0.55100000000000005,"5min":4.4820000000000002,"15min":4.4820000000000002},"last":0.307}]},{"osd":1,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.32100000000000001,"15min":0.313},"min":{"1min":0.248,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.439,"5min":0.54000000000000004,"15min":0.65400000000000003},"last":0.318},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.35599999999999998,"15min":0.35699999999999998},"min":{"1min":0.27700000000000002,"5min":0.23400000000000001,"15min":0.188},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":1.196},"last":0.28899999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.40200000000000002,"15min":0.38400000000000001},"min":{"1min":0.27700000000000002,"5min":0.23400000000000001,"15min":0.19600000000000001},"max":{"1min":0.45300000000000001,"5min":4.601,"15min":4.601},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.437,"15min":0.41799999999999998},"min":{"1min":0.32500000000000001,"5min":0.29899999999999999,"15min":0.26100000000000001},"max":{"1min":0.63200000000000001,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.39500000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.54500000000000004,"15min":0.54700000000000004},"min":{"1min":0.378,"5min":0.32100000000000001,"15min":0.311},"max":{"1min":0.75900000000000001,"5min":0.88500000000000001,"15min":1.694},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.54500000000000004,"15min":0.53900000000000003},"min":{"1min":0.46300000000000002,"5min":0.32600000000000001,"15min":0.30199999999999999},"max":{"1min":0.68700000000000006,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.496}]},{"osd":5,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.434,"5min":0.34100000000000003,"15min":0.29399999999999998},"max":{"1min":0.63800000000000001,"5min":0.86399999999999999,"15min":0.878},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.36599999999999999,"5min":0.35699999999999998,"15min":0.29699999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":1.165},"last":0.48399999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.44400000000000001,"5min":0.372,"15min":0.36699999999999999},"max":{"1min":0.78700000000000003,"5min":0.79200000000000004,"15min":1.1359999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.57699999999999996,"15min":0.58499999999999996},"min":{"1min":0.443,"5min":0.36799999999999999,"15min":0.34399999999999997},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":1.7470000000000001},"last":0.60499999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56499999999999995,"15min":0.57399999999999995},"min":{"1min":0.39600000000000002,"5min":0.35699999999999998,"15min":0.35599999999999998},"max":{"1min":0.80300000000000005,"5min":0.89900000000000002,"15min":1.657},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57899999999999996,"15min":0.57299999999999995},"min":{"1min":0.48399999999999999,"5min":0.38,"15min":0.35499999999999998},"max":{"1min":0.71599999999999997,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.47799999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574994,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303252,"kb_used_data":1868,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068588,"statfs":{"total":96636764160,"available":96326234112,"internally_reserved":0,"allocated":1912832,"data_stored":875482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.47999999999999998,"15min":0.51600000000000001},"min":{"1min":0.30099999999999999,"5min":0.20799999999999999,"15min":0.19500000000000001},"max":{"1min":0.76800000000000002,"5min":0.82099999999999995,"15min":2.6619999999999999},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.504,"15min":0.49199999999999999},"min":{"1min":0.28999999999999998,"5min":0.224,"15min":0.215},"max":{"1min":0.81499999999999995,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.55500000000000005}]},{"osd":1,"last update":"Fri Oct 6 11:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.498,"15min":0.53600000000000003},"min":{"1min":0.27600000000000002,"5min":0.26200000000000001,"15min":0.23300000000000001},"max":{"1min":0.72899999999999998,"5min":1,"15min":2.8650000000000002},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.497,"15min":0.54200000000000004},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.25800000000000001},"max":{"1min":0.70699999999999996,"5min":1.2869999999999999,"15min":2.7610000000000001},"last":0.57799999999999996}]},{"osd":2,"last update":"Fri Oct 6 11:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.52300000000000002,"15min":0.53300000000000003},"min":{"1min":0.36899999999999999,"5min":0.28499999999999998,"15min":0.23100000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":1.6910000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57199999999999995,"15min":0.57999999999999996},"min":{"1min":0.40999999999999998,"5min":0.31,"15min":0.30599999999999999},"max":{"1min":0.82799999999999996,"5min":0.93899999999999995,"15min":1.718},"last":0.46500000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58099999999999996,"15min":0.58599999999999997},"min":{"1min":0.38600000000000001,"5min":0.32000000000000001,"15min":0.26700000000000002},"max":{"1min":0.78800000000000003,"5min":2.387,"15min":2.677},"last":0.501},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.55000000000000004,"15min":0.52700000000000002},"min":{"1min":0.42499999999999999,"5min":0.29299999999999998,"15min":0.27500000000000002},"max":{"1min":0.77700000000000002,"5min":1.784,"15min":1.784},"last":0.52900000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.378,"5min":0.28499999999999998,"15min":0.23200000000000001},"max":{"1min":0.68300000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.51500000000000001,"15min":0.52500000000000002},"min":{"1min":0.39400000000000002,"5min":0.28899999999999998,"15min":0.28399999999999997},"max":{"1min":0.749,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.64200000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.35799999999999998,"5min":0.31,"15min":0.252},"max":{"1min":0.72999999999999998,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.55200000000000005,"15min":0.55900000000000005},"min":{"1min":0.41199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.80200000000000005,"5min":0.85799999999999998,"15min":1.165},"last":0.51300000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.56599999999999995,"15min":0.55800000000000005},"min":{"1min":0.40799999999999997,"5min":0.34200000000000003,"15min":0.313},"max":{"1min":0.84999999999999998,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.58899999999999997,"15min":0.59099999999999997},"min":{"1min":0.41999999999999998,"5min":0.318,"15min":0.317},"max":{"1min":0.86399999999999999,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.65800000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574996,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311436,"kb_used_data":1860,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060404,"statfs":{"total":96636764160,"available":96317853696,"internally_reserved":0,"allocated":1904640,"data_stored":874870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.48499999999999999,"15min":0.57499999999999996},"min":{"1min":0.26000000000000001,"5min":0.23300000000000001,"15min":0.20499999999999999},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":5.0490000000000004},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.48599999999999999,"15min":0.55500000000000005},"min":{"1min":0.34599999999999997,"5min":0.253,"15min":0.22900000000000001},"max":{"1min":0.71299999999999997,"5min":0.78100000000000003,"15min":5.1449999999999996},"last":0.48799999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.48899999999999999,"15min":0.48299999999999998},"min":{"1min":0.27800000000000002,"5min":0.25700000000000001,"15min":0.25},"max":{"1min":0.68400000000000005,"5min":0.81399999999999995,"15min":0.97199999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.505,"15min":0.51000000000000001},"min":{"1min":0.29799999999999999,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.69299999999999995,"5min":0.74099999999999999,"15min":1.8799999999999999},"last":0.45000000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.52800000000000002,"15min":0.54600000000000004},"min":{"1min":0.36799999999999999,"5min":0.30099999999999999,"15min":0.28299999999999997},"max":{"1min":0.748,"5min":0.79800000000000004,"15min":4.234},"last":0.5},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56200000000000006,"15min":0.56000000000000005},"min":{"1min":0.436,"5min":0.315,"15min":0.315},"max":{"1min":0.79200000000000004,"5min":0.81000000000000005,"15min":1.0369999999999999},"last":0.59899999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51000000000000001,"15min":0.59299999999999997},"min":{"1min":0.311,"5min":0.29499999999999998,"15min":0.27700000000000002},"max":{"1min":0.70499999999999996,"5min":0.82299999999999995,"15min":5.2169999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.53100000000000003,"15min":0.53800000000000003},"min":{"1min":0.38700000000000001,"5min":0.29999999999999999,"15min":0.29699999999999999},"max":{"1min":0.73699999999999999,"5min":0.75600000000000001,"15min":1.008},"last":0.55400000000000005}]},{"osd":4,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48399999999999999,"15min":0.504},"min":{"1min":0.33700000000000002,"5min":0.25600000000000001,"15min":0.23999999999999999},"max":{"1min":0.65900000000000003,"5min":0.83399999999999996,"15min":1.917},"last":0.375},{"interface":"front","average":{"1min":0.496,"5min":0.48999999999999999,"15min":0.51400000000000001},"min":{"1min":0.29999999999999999,"5min":0.251,"15min":0.23899999999999999},"max":{"1min":0.65500000000000003,"5min":0.69199999999999995,"15min":0.87},"last":0.58499999999999996}]},{"osd":6,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51100000000000001,"15min":0.54300000000000004},"min":{"1min":0.34799999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.67200000000000004,"5min":0.76800000000000002,"15min":2.0139999999999998},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57399999999999995,"15min":0.59399999999999997},"min":{"1min":0.33200000000000002,"5min":0.30299999999999999,"15min":0.29999999999999999},"max":{"1min":0.72599999999999998,"5min":0.82899999999999996,"15min":1.9470000000000001},"last":0.56799999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:17:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53600000000000003,"15min":0.56299999999999994},"min":{"1min":0.376,"5min":0.28799999999999998,"15min":0.27700000000000002},"max":{"1min":0.64600000000000002,"5min":0.81000000000000005,"15min":0.96499999999999997},"last":0.434},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.56899999999999995,"15min":0.59299999999999997},"min":{"1min":0.42599999999999999,"5min":0.29199999999999998,"15min":0.28799999999999998},"max":{"1min":0.746,"5min":0.77300000000000002,"15min":1.4119999999999999},"last":0.46800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:17:33.485 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T11:17:33.485 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T11:17:33.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.638+0000 7f233804f700 1 Processor -- start 2023-10-06T11:17:33.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.638+0000 7f233804f700 1 -- start start 2023-10-06T11:17:33.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.639+0000 7f233804f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2330159f60 0x7f23300c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:33.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.639+0000 7f233804f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23300cc760 0x7f23300c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:33.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.639+0000 7f233804f700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f23300c7200 0x7f23300b35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:33.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.639+0000 7f233804f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23300b3260 con 0x7f2330159f60 2023-10-06T11:17:33.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.639+0000 7f233804f700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23300c5c20 con 0x7f23300c7200 2023-10-06T11:17:33.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.639+0000 7f233804f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23300c5f00 con 0x7f23300cc760 2023-10-06T11:17:33.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.639+0000 7f2335deb700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2330159f60 0x7f23300c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:33.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.639+0000 7f2335deb700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2330159f60 0x7f23300c55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45908/0 (socket says 172.21.15.146:45908) 2023-10-06T11:17:33.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.639+0000 7f2335deb700 1 -- 172.21.15.146:0/601362356 learned_addr learned my addr 172.21.15.146:0/601362356 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:33.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.639+0000 7f23355ea700 1 --2- 172.21.15.146:0/601362356 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23300cc760 0x7f23300c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:33.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.639+0000 7f23365ec700 1 --2- 172.21.15.146:0/601362356 >> v2:172.21.15.151:3300/0 conn(0x7f23300c7200 0x7f23300b35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:33.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.639+0000 7f2335deb700 1 -- 172.21.15.146:0/601362356 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23300cc760 msgr2=0x7f23300c6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:33.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.639+0000 7f2335deb700 1 --2- 172.21.15.146:0/601362356 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23300cc760 0x7f23300c6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:33.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.639+0000 7f2335deb700 1 -- 172.21.15.146:0/601362356 >> v2:172.21.15.151:3300/0 conn(0x7f23300c7200 msgr2=0x7f23300b35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:33.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.639+0000 7f2335deb700 1 --2- 172.21.15.146:0/601362356 >> v2:172.21.15.151:3300/0 conn(0x7f23300c7200 0x7f23300b35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:33.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.639+0000 7f2335deb700 1 -- 172.21.15.146:0/601362356 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23300c61e0 con 0x7f2330159f60 2023-10-06T11:17:33.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.639+0000 7f2335deb700 1 --2- 172.21.15.146:0/601362356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2330159f60 0x7f23300c55d0 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f2330088860 tx=0x7f232c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c46963e6b4992e16 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:33.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.639+0000 7f2334de9700 1 -- 172.21.15.146:0/601362356 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232c005c10 con 0x7f2330159f60 2023-10-06T11:17:33.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.639+0000 7f2334de9700 1 -- 172.21.15.146:0/601362356 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232c005d70 con 0x7f2330159f60 2023-10-06T11:17:33.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.639+0000 7f2334de9700 1 -- 172.21.15.146:0/601362356 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232c006260 con 0x7f2330159f60 2023-10-06T11:17:33.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.640+0000 7f233804f700 1 -- 172.21.15.146:0/601362356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2330159f60 msgr2=0x7f23300c55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:33.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.640+0000 7f233804f700 1 --2- 172.21.15.146:0/601362356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2330159f60 0x7f23300c55d0 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f2330088860 tx=0x7f232c009220 comp rx=0 tx=0).stop 2023-10-06T11:17:33.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.640+0000 7f233804f700 1 -- 172.21.15.146:0/601362356 shutdown_connections 2023-10-06T11:17:33.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.640+0000 7f233804f700 1 --2- 172.21.15.146:0/601362356 >> v2:172.21.15.151:3300/0 conn(0x7f23300c7200 0x7f23300b35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:33.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.640+0000 7f233804f700 1 --2- 172.21.15.146:0/601362356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2330159f60 0x7f23300c55d0 unknown :-1 s=CLOSED pgs=1963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:33.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.640+0000 7f233804f700 1 --2- 172.21.15.146:0/601362356 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23300cc760 0x7f23300c6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:33.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.640+0000 7f233804f700 1 -- 172.21.15.146:0/601362356 >> 172.21.15.146:0/601362356 conn(0x7f233006f380 msgr2=0x7f23300d0830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:33.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.640+0000 7f233804f700 1 -- 172.21.15.146:0/601362356 shutdown_connections 2023-10-06T11:17:33.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.640+0000 7f233804f700 1 -- 172.21.15.146:0/601362356 wait complete. 2023-10-06T11:17:33.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.641+0000 7f233804f700 1 Processor -- start 2023-10-06T11:17:33.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.641+0000 7f233804f700 1 -- start start 2023-10-06T11:17:33.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.642+0000 7f233804f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23300c7200 0x7f233014a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:33.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.642+0000 7f233804f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23300cc760 0x7f23300c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:33.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.642+0000 7f233804f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2330159f60 0x7f23300cd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:33.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.642+0000 7f233804f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233015d1e0 con 0x7f2330159f60 2023-10-06T11:17:33.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.642+0000 7f233804f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233015c5d0 con 0x7f23300c7200 2023-10-06T11:17:33.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.642+0000 7f233804f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f233015c8b0 con 0x7f23300cc760 2023-10-06T11:17:33.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.642+0000 7f23365ec700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2330159f60 0x7f23300cd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:33.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.642+0000 7f23365ec700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2330159f60 0x7f23300cd0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45912/0 (socket says 172.21.15.146:45912) 2023-10-06T11:17:33.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.642+0000 7f23365ec700 1 -- 172.21.15.146:0/537157883 learned_addr learned my addr 172.21.15.146:0/537157883 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:33.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.642+0000 7f2335deb700 1 --2- 172.21.15.146:0/537157883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23300c7200 0x7f233014a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:33.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.642+0000 7f23355ea700 1 --2- 172.21.15.146:0/537157883 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23300cc760 0x7f23300c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:33.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.642+0000 7f23365ec700 1 -- 172.21.15.146:0/537157883 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23300cc760 msgr2=0x7f23300c78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:33.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.642+0000 7f23365ec700 1 --2- 172.21.15.146:0/537157883 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23300cc760 0x7f23300c78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:33.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.642+0000 7f23365ec700 1 -- 172.21.15.146:0/537157883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23300c7200 msgr2=0x7f233014a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:33.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.642+0000 7f23365ec700 1 --2- 172.21.15.146:0/537157883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23300c7200 0x7f233014a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:33.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.642+0000 7f23365ec700 1 -- 172.21.15.146:0/537157883 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f232c009480 con 0x7f2330159f60 2023-10-06T11:17:33.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.642+0000 7f2335deb700 1 --2- 172.21.15.146:0/537157883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23300c7200 0x7f233014a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:17:33.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.642+0000 7f23365ec700 1 --2- 172.21.15.146:0/537157883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2330159f60 0x7f23300cd0d0 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f2328009ec0 tx=0x7f232800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:33.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.643+0000 7f2325ffb700 1 -- 172.21.15.146:0/537157883 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232800cc20 con 0x7f2330159f60 2023-10-06T11:17:33.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.643+0000 7f2325ffb700 1 -- 172.21.15.146:0/537157883 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232800f040 con 0x7f2330159f60 2023-10-06T11:17:33.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.643+0000 7f233804f700 1 -- 172.21.15.146:0/537157883 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f233015cb90 con 0x7f2330159f60 2023-10-06T11:17:33.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.643+0000 7f2325ffb700 1 -- 172.21.15.146:0/537157883 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2328014480 con 0x7f2330159f60 2023-10-06T11:17:33.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.643+0000 7f233804f700 1 -- 172.21.15.146:0/537157883 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23300ca860 con 0x7f2330159f60 2023-10-06T11:17:33.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.644+0000 7f233804f700 1 -- 172.21.15.146:0/537157883 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2330068390 con 0x7f2330159f60 2023-10-06T11:17:33.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.644+0000 7f2325ffb700 1 -- 172.21.15.146:0/537157883 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2328014810 con 0x7f2330159f60 2023-10-06T11:17:33.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.644+0000 7f2325ffb700 1 --2- 172.21.15.146:0/537157883 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2314066f30 0x7f23140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:33.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.645+0000 7f2325ffb700 1 -- 172.21.15.146:0/537157883 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2328085450 con 0x7f2330159f60 2023-10-06T11:17:33.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.645+0000 7f2335deb700 1 --2- 172.21.15.146:0/537157883 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2314066f30 0x7f23140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:33.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.645+0000 7f2335deb700 1 --2- 172.21.15.146:0/537157883 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2314066f30 0x7f23140693e0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f232c009260 tx=0x7f232c016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:33.650 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.649+0000 7f2325ffb700 1 -- 172.21.15.146:0/537157883 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2328052560 con 0x7f2330159f60 2023-10-06T11:17:33.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.909+0000 7f233804f700 1 -- 172.21.15.146:0/537157883 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f233004c380 con 0x7f2330159f60 2023-10-06T11:17:33.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.913+0000 7f2325ffb700 1 -- 172.21.15.146:0/537157883 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v24) v1 ==== 190+0+0 (secure 0 0 0) 0x7f2328055b80 con 0x7f2330159f60 2023-10-06T11:17:33.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.915+0000 7f233804f700 1 -- 172.21.15.146:0/537157883 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2314066f30 msgr2=0x7f23140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:33.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.915+0000 7f233804f700 1 --2- 172.21.15.146:0/537157883 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2314066f30 0x7f23140693e0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f232c009260 tx=0x7f232c016000 comp rx=0 tx=0).stop 2023-10-06T11:17:33.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.915+0000 7f233804f700 1 -- 172.21.15.146:0/537157883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2330159f60 msgr2=0x7f23300cd0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:33.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.915+0000 7f233804f700 1 --2- 172.21.15.146:0/537157883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2330159f60 0x7f23300cd0d0 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f2328009ec0 tx=0x7f232800b040 comp rx=0 tx=0).stop 2023-10-06T11:17:33.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.915+0000 7f233804f700 1 -- 172.21.15.146:0/537157883 shutdown_connections 2023-10-06T11:17:33.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.915+0000 7f233804f700 1 --2- 172.21.15.146:0/537157883 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2314066f30 0x7f23140693e0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:33.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.915+0000 7f233804f700 1 --2- 172.21.15.146:0/537157883 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2330159f60 0x7f23300cd0d0 unknown :-1 s=CLOSED pgs=1964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:33.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.915+0000 7f233804f700 1 --2- 172.21.15.146:0/537157883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23300c7200 0x7f233014a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:33.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.915+0000 7f233804f700 1 --2- 172.21.15.146:0/537157883 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23300cc760 0x7f23300c78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:33.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.915+0000 7f233804f700 1 -- 172.21.15.146:0/537157883 >> 172.21.15.146:0/537157883 conn(0x7f233006f380 msgr2=0x7f2330069c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:33.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.915+0000 7f233804f700 1 -- 172.21.15.146:0/537157883 shutdown_connections 2023-10-06T11:17:33.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:33.915+0000 7f233804f700 1 -- 172.21.15.146:0/537157883 wait complete. 2023-10-06T11:17:33.918 INFO:teuthology.orchestra.run.smithi146.stderr:updated caps for client.0 2023-10-06T11:17:33.929 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:17:34.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.041+0000 7f0f1d2cc700 1 Processor -- start 2023-10-06T11:17:34.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.041+0000 7f0f1d2cc700 1 -- start start 2023-10-06T11:17:34.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.042+0000 7f0f1d2cc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0f1815a420 0x7f0f1815cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:34.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.042+0000 7f0f1d2cc700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f1815a7f0 0x7f0f180b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:34.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.042+0000 7f0f1d2cc700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f1815c630 con 0x7f0f180b2360 2023-10-06T11:17:34.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.042+0000 7f0f1d2cc700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f180ce040 con 0x7f0f1815a420 2023-10-06T11:17:34.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.042+0000 7f0f1d2cc700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f180b27e0 con 0x7f0f1815a7f0 2023-10-06T11:17:34.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.042+0000 7f0f17fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0f1815a420 0x7f0f1815cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:34.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.042+0000 7f0f17fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0f1815a420 0x7f0f1815cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45918/0 (socket says 172.21.15.146:45918) 2023-10-06T11:17:34.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.042+0000 7f0f17fff700 1 -- 172.21.15.146:0/1494892648 learned_addr learned my addr 172.21.15.146:0/1494892648 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:34.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.042+0000 7f0f177fe700 1 --2- 172.21.15.146:0/1494892648 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f1815a7f0 0x7f0f180b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:34.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.042+0000 7f0f17fff700 1 -- 172.21.15.146:0/1494892648 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f1815a7f0 msgr2=0x7f0f180b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:34.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.043+0000 7f0f17fff700 1 --2- 172.21.15.146:0/1494892648 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f1815a7f0 0x7f0f180b1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.043+0000 7f0f17fff700 1 -- 172.21.15.146:0/1494892648 >> v1:172.21.15.151:6789/0 conn(0x7f0f180b2360 legacy=0x7f0f1815acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:34.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.043+0000 7f0f17fff700 1 -- 172.21.15.146:0/1494892648 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f1815ba20 con 0x7f0f1815a420 2023-10-06T11:17:34.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.043+0000 7f0f177fe700 1 --2- 172.21.15.146:0/1494892648 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f1815a7f0 0x7f0f180b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:17:34.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.043+0000 7f0f17fff700 1 --2- 172.21.15.146:0/1494892648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f1815a420 0x7f0f1815cac0 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7f0f080099e0 tx=0x7f0f08009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a22953f2064519 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:34.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.043+0000 7f0f16ffd700 1 -- 172.21.15.146:0/1494892648 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0800b7e0 con 0x7f0f1815a420 2023-10-06T11:17:34.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.043+0000 7f0f16ffd700 1 -- 172.21.15.146:0/1494892648 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f0800b940 con 0x7f0f1815a420 2023-10-06T11:17:34.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.043+0000 7f0f16ffd700 1 -- 172.21.15.146:0/1494892648 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0800bce0 con 0x7f0f1815a420 2023-10-06T11:17:34.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.043+0000 7f0f1d2cc700 1 -- 172.21.15.146:0/1494892648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f1815a420 msgr2=0x7f0f1815cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:34.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.043+0000 7f0f1d2cc700 1 --2- 172.21.15.146:0/1494892648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f1815a420 0x7f0f1815cac0 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7f0f080099e0 tx=0x7f0f08009250 comp rx=0 tx=0).stop 2023-10-06T11:17:34.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.043+0000 7f0f1d2cc700 1 -- 172.21.15.146:0/1494892648 shutdown_connections 2023-10-06T11:17:34.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.043+0000 7f0f1d2cc700 1 --2- 172.21.15.146:0/1494892648 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f1815a420 0x7f0f1815cac0 unknown :-1 s=CLOSED pgs=1965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.043+0000 7f0f1d2cc700 1 --2- 172.21.15.146:0/1494892648 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f1815a7f0 0x7f0f180b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.043+0000 7f0f1d2cc700 1 -- 172.21.15.146:0/1494892648 >> 172.21.15.146:0/1494892648 conn(0x7f0f1806eba0 msgr2=0x7f0f1806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:34.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.043+0000 7f0f1d2cc700 1 -- 172.21.15.146:0/1494892648 shutdown_connections 2023-10-06T11:17:34.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.043+0000 7f0f1d2cc700 1 -- 172.21.15.146:0/1494892648 wait complete. 2023-10-06T11:17:34.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.044+0000 7f0f1d2cc700 1 Processor -- start 2023-10-06T11:17:34.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.045+0000 7f0f1d2cc700 1 -- start start 2023-10-06T11:17:34.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.045+0000 7f0f1d2cc700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f180b2360 0x7f0f181530b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:34.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.045+0000 7f0f1d2cc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f1815a420 0x7f0f1814ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:34.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.045+0000 7f0f1d2cc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f1815a7f0 0x7f0f181540d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:34.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.045+0000 7f0f1d2cc700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f18157a70 con 0x7f0f1815a7f0 2023-10-06T11:17:34.055 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.045+0000 7f0f1d2cc700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f18159e40 con 0x7f0f1815a420 2023-10-06T11:17:34.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.045+0000 7f0f1d2cc700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f18157d10 con 0x7f0f180b2360 2023-10-06T11:17:34.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.046+0000 7f0f1cacb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f1815a7f0 0x7f0f181540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:34.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.046+0000 7f0f1cacb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f1815a7f0 0x7f0f181540d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45928/0 (socket says 172.21.15.146:45928) 2023-10-06T11:17:34.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.046+0000 7f0f1cacb700 1 -- 172.21.15.146:0/1395411563 learned_addr learned my addr 172.21.15.146:0/1395411563 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:34.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.046+0000 7f0f177fe700 1 --2- 172.21.15.146:0/1395411563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f1815a420 0x7f0f1814ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:34.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.046+0000 7f0f17fff700 1 --2- 172.21.15.146:0/1395411563 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f180b2360 0x7f0f181530b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:34.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.046+0000 7f0f1cacb700 1 -- 172.21.15.146:0/1395411563 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f180b2360 msgr2=0x7f0f181530b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:34.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.046+0000 7f0f1cacb700 1 --2- 172.21.15.146:0/1395411563 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f180b2360 0x7f0f181530b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.046+0000 7f0f1cacb700 1 -- 172.21.15.146:0/1395411563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f1815a420 msgr2=0x7f0f1814ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:34.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.046+0000 7f0f1cacb700 1 --2- 172.21.15.146:0/1395411563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f1815a420 0x7f0f1814ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.046+0000 7f0f1cacb700 1 -- 172.21.15.146:0/1395411563 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f080094f0 con 0x7f0f1815a7f0 2023-10-06T11:17:34.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.046+0000 7f0f17fff700 1 --2- 172.21.15.146:0/1395411563 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f180b2360 0x7f0f181530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:17:34.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.046+0000 7f0f177fe700 1 --2- 172.21.15.146:0/1395411563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f1815a420 0x7f0f1814ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:17:34.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.046+0000 7f0f1cacb700 1 --2- 172.21.15.146:0/1395411563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f1815a7f0 0x7f0f181540d0 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7f0f1000c930 tx=0x7f0f100026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:34.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.046+0000 7f0efffff700 1 -- 172.21.15.146:0/1395411563 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1000ce70 con 0x7f0f1815a7f0 2023-10-06T11:17:34.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.046+0000 7f0efffff700 1 -- 172.21.15.146:0/1395411563 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f1000a7e0 con 0x7f0f1815a7f0 2023-10-06T11:17:34.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.046+0000 7f0f1d2cc700 1 -- 172.21.15.146:0/1395411563 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f18153740 con 0x7f0f1815a7f0 2023-10-06T11:17:34.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.046+0000 7f0efffff700 1 -- 172.21.15.146:0/1395411563 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1000aba0 con 0x7f0f1815a7f0 2023-10-06T11:17:34.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.046+0000 7f0f1d2cc700 1 -- 172.21.15.146:0/1395411563 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f18159b60 con 0x7f0f1815a7f0 2023-10-06T11:17:34.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.047+0000 7f0f1d2cc700 1 -- 172.21.15.146:0/1395411563 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f180afae0 con 0x7f0f1815a7f0 2023-10-06T11:17:34.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.048+0000 7f0efffff700 1 -- 172.21.15.146:0/1395411563 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0f10012420 con 0x7f0f1815a7f0 2023-10-06T11:17:34.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.048+0000 7f0efffff700 1 --2- 172.21.15.146:0/1395411563 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0f04066f30 0x7f0f040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:34.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.048+0000 7f0efffff700 1 -- 172.21.15.146:0/1395411563 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0f10084ad0 con 0x7f0f1815a7f0 2023-10-06T11:17:34.058 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.048+0000 7f0f17fff700 1 --2- 172.21.15.146:0/1395411563 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0f04066f30 0x7f0f040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:34.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.048+0000 7f0f17fff700 1 --2- 172.21.15.146:0/1395411563 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0f04066f30 0x7f0f040693e0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f0f080099e0 tx=0x7f0f08016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:34.059 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.052+0000 7f0efffff700 1 -- 172.21.15.146:0/1395411563 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0f10051c90 con 0x7f0f1815a7f0 2023-10-06T11:17:34.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.277+0000 7f0f1d2cc700 1 -- 172.21.15.146:0/1395411563 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0f1815bd00 con 0x7f0f1815a7f0 2023-10-06T11:17:34.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.277+0000 7f0efffff700 1 -- 172.21.15.146:0/1395411563 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 128 v128) v1 ==== 95+0+4619 (secure 0 0 0) 0x7f0f10016090 con 0x7f0f1815a7f0 2023-10-06T11:17:34.279 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:34.280 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":128,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7433,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3681774523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3681774523},{"type":"v1","addr":"172.21.15.151:6834","nonce":3681774523}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":124},{"gid":7436,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/3243480101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":3243480101},{"type":"v1","addr":"172.21.15.151:6835","nonce":3243480101}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":124},{"gid":9645,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/1871572981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1871572981},{"type":"v1","addr":"172.21.15.146:6836","nonce":1871572981}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":124}],"filesystems":[{"mdsmap":{"epoch":128,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:17:23.939322+0000","modified":"2023-10-06T11:17:27.570448+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9648},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9648":{"gid":9648,"name":"c","rank":0,"incarnation":125,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/2875253990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2875253990},{"type":"v1","addr":"172.21.15.146:6837","nonce":2875253990}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-06T11:17:34.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.279+0000 7f0f1d2cc700 1 -- 172.21.15.146:0/1395411563 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0f04066f30 msgr2=0x7f0f040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:34.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.279+0000 7f0f1d2cc700 1 --2- 172.21.15.146:0/1395411563 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0f04066f30 0x7f0f040693e0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f0f080099e0 tx=0x7f0f08016000 comp rx=0 tx=0).stop 2023-10-06T11:17:34.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.279+0000 7f0f1d2cc700 1 -- 172.21.15.146:0/1395411563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f1815a7f0 msgr2=0x7f0f181540d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:34.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.279+0000 7f0f1d2cc700 1 --2- 172.21.15.146:0/1395411563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f1815a7f0 0x7f0f181540d0 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7f0f1000c930 tx=0x7f0f100026e0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.279+0000 7f0f1d2cc700 1 -- 172.21.15.146:0/1395411563 shutdown_connections 2023-10-06T11:17:34.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.279+0000 7f0f1d2cc700 1 --2- 172.21.15.146:0/1395411563 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0f04066f30 0x7f0f040693e0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.279+0000 7f0f1d2cc700 1 --2- 172.21.15.146:0/1395411563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0f1815a7f0 0x7f0f181540d0 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.280+0000 7f0f1d2cc700 1 --2- 172.21.15.146:0/1395411563 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f180b2360 0x7f0f181530b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.280+0000 7f0f1d2cc700 1 --2- 172.21.15.146:0/1395411563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f1815a420 0x7f0f1814ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.280+0000 7f0f1d2cc700 1 -- 172.21.15.146:0/1395411563 >> 172.21.15.146:0/1395411563 conn(0x7f0f1806eba0 msgr2=0x7f0f180cec30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:34.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.280+0000 7f0f1d2cc700 1 -- 172.21.15.146:0/1395411563 shutdown_connections 2023-10-06T11:17:34.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.280+0000 7f0f1d2cc700 1 -- 172.21.15.146:0/1395411563 wait complete. 2023-10-06T11:17:34.283 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 128 2023-10-06T11:17:34.696 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 128, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T11:17:23.939322+0000', 'modified': '2023-10-06T11:17:27.570448+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9648}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9648': {'gid': 9648, 'name': 'c', 'rank': 0, 'incarnation': 125, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.146:6837/2875253990', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6835', 'nonce': 2875253990}, {'type': 'v1', 'addr': '172.21.15.146:6837', 'nonce': 2875253990}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [24], 'metadata_pool': 23, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T11:17:34.696 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T11:17:34.696 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T11:17:34.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.812+0000 7ff95ddc5700 1 Processor -- start 2023-10-06T11:17:34.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.812+0000 7ff95ddc5700 1 -- start start 2023-10-06T11:17:34.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.813+0000 7ff95ddc5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff9580b2060 0x7ff9580ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:34.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.813+0000 7ff95ddc5700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff9580b3cf0 0x7ff9580ce860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:34.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.813+0000 7ff95ddc5700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9580b4ec0 con 0x7ff9580b2430 2023-10-06T11:17:34.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.813+0000 7ff95ddc5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9580b42b0 con 0x7ff9580b2060 2023-10-06T11:17:34.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.813+0000 7ff95ddc5700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9580b4590 con 0x7ff9580b3cf0 2023-10-06T11:17:34.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.813+0000 7ff95cdc3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff9580b2060 0x7ff9580ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:34.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.813+0000 7ff95cdc3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff9580b2060 0x7ff9580ccd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45932/0 (socket says 172.21.15.146:45932) 2023-10-06T11:17:34.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.813+0000 7ff95cdc3700 1 -- 172.21.15.146:0/2346090566 learned_addr learned my addr 172.21.15.146:0/2346090566 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:34.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.813+0000 7ff95cdc3700 1 -- 172.21.15.146:0/2346090566 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff9580b3cf0 msgr2=0x7ff9580ce860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:34.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.813+0000 7ff957fff700 1 --2- 172.21.15.146:0/2346090566 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff9580b3cf0 0x7ff9580ce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:34.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.813+0000 7ff95cdc3700 1 --2- 172.21.15.146:0/2346090566 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff9580b3cf0 0x7ff9580ce860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.813+0000 7ff95cdc3700 1 -- 172.21.15.146:0/2346090566 >> v1:172.21.15.151:6789/0 conn(0x7ff9580b2430 legacy=0x7ff9580b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:34.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.813+0000 7ff95cdc3700 1 -- 172.21.15.146:0/2346090566 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9580b4870 con 0x7ff9580b2060 2023-10-06T11:17:34.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.813+0000 7ff95cdc3700 1 --2- 172.21.15.146:0/2346090566 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9580b2060 0x7ff9580ccd60 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7ff9500099b0 tx=0x7ff950009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=504fdbc8948e7a6f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:34.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.813+0000 7ff9577fe700 1 -- 172.21.15.146:0/2346090566 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95000b820 con 0x7ff9580b2060 2023-10-06T11:17:34.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.814+0000 7ff9577fe700 1 -- 172.21.15.146:0/2346090566 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95000b980 con 0x7ff9580b2060 2023-10-06T11:17:34.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.814+0000 7ff9577fe700 1 -- 172.21.15.146:0/2346090566 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95000bd20 con 0x7ff9580b2060 2023-10-06T11:17:34.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.814+0000 7ff95ddc5700 1 -- 172.21.15.146:0/2346090566 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9580b2060 msgr2=0x7ff9580ccd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:34.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.814+0000 7ff95ddc5700 1 --2- 172.21.15.146:0/2346090566 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9580b2060 0x7ff9580ccd60 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7ff9500099b0 tx=0x7ff950009250 comp rx=0 tx=0).stop 2023-10-06T11:17:34.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.814+0000 7ff95ddc5700 1 -- 172.21.15.146:0/2346090566 shutdown_connections 2023-10-06T11:17:34.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.814+0000 7ff95ddc5700 1 --2- 172.21.15.146:0/2346090566 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9580b2060 0x7ff9580ccd60 unknown :-1 s=CLOSED pgs=1967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.814+0000 7ff95ddc5700 1 --2- 172.21.15.146:0/2346090566 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff9580b3cf0 0x7ff9580ce860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.814+0000 7ff95ddc5700 1 -- 172.21.15.146:0/2346090566 >> 172.21.15.146:0/2346090566 conn(0x7ff95806eba0 msgr2=0x7ff95806efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:34.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.814+0000 7ff95ddc5700 1 -- 172.21.15.146:0/2346090566 shutdown_connections 2023-10-06T11:17:34.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.814+0000 7ff95ddc5700 1 -- 172.21.15.146:0/2346090566 wait complete. 2023-10-06T11:17:34.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.815+0000 7ff95ddc5700 1 Processor -- start 2023-10-06T11:17:34.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.815+0000 7ff95ddc5700 1 -- start start 2023-10-06T11:17:34.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.816+0000 7ff95ddc5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9580b2060 0x7ff9580a90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:34.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.816+0000 7ff95ddc5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9580b2430 0x7ff95816a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:34.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.816+0000 7ff95ddc5700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff9580b3cf0 0x7ff95815b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:34.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.816+0000 7ff95ddc5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff958159e60 con 0x7ff9580b2430 2023-10-06T11:17:34.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.816+0000 7ff95ddc5700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95815a0b0 con 0x7ff9580b2060 2023-10-06T11:17:34.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.816+0000 7ff95ddc5700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff95815a390 con 0x7ff9580b3cf0 2023-10-06T11:17:34.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.816+0000 7ff957fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9580b2430 0x7ff95816a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:34.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.816+0000 7ff957fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9580b2430 0x7ff95816a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45936/0 (socket says 172.21.15.146:45936) 2023-10-06T11:17:34.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.816+0000 7ff957fff700 1 -- 172.21.15.146:0/3223454542 learned_addr learned my addr 172.21.15.146:0/3223454542 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:34.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.816+0000 7ff95cdc3700 1 --2- 172.21.15.146:0/3223454542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9580b2060 0x7ff9580a90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:34.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.816+0000 7ff95d5c4700 1 --2- 172.21.15.146:0/3223454542 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff9580b3cf0 0x7ff95815b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:34.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.816+0000 7ff957fff700 1 -- 172.21.15.146:0/3223454542 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff9580b3cf0 msgr2=0x7ff95815b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:34.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.816+0000 7ff957fff700 1 --2- 172.21.15.146:0/3223454542 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff9580b3cf0 0x7ff95815b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.816+0000 7ff957fff700 1 -- 172.21.15.146:0/3223454542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9580b2060 msgr2=0x7ff9580a90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:34.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.816+0000 7ff957fff700 1 --2- 172.21.15.146:0/3223454542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9580b2060 0x7ff9580a90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.816+0000 7ff957fff700 1 -- 172.21.15.146:0/3223454542 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9500094f0 con 0x7ff9580b2430 2023-10-06T11:17:34.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.817+0000 7ff957fff700 1 --2- 172.21.15.146:0/3223454542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9580b2430 0x7ff95816a460 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7ff94800ce10 tx=0x7ff948007810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:34.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.817+0000 7ff954ff9700 1 -- 172.21.15.146:0/3223454542 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94800aa10 con 0x7ff9580b2430 2023-10-06T11:17:34.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.817+0000 7ff954ff9700 1 -- 172.21.15.146:0/3223454542 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94800ab70 con 0x7ff9580b2430 2023-10-06T11:17:34.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.817+0000 7ff95ddc5700 1 -- 172.21.15.146:0/3223454542 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff95815a670 con 0x7ff9580b2430 2023-10-06T11:17:34.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.817+0000 7ff954ff9700 1 -- 172.21.15.146:0/3223454542 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff948017430 con 0x7ff9580b2430 2023-10-06T11:17:34.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.817+0000 7ff95ddc5700 1 -- 172.21.15.146:0/3223454542 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff95815ac30 con 0x7ff9580b2430 2023-10-06T11:17:34.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.818+0000 7ff954ff9700 1 -- 172.21.15.146:0/3223454542 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff948003020 con 0x7ff9580b2430 2023-10-06T11:17:34.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.818+0000 7ff954ff9700 1 --2- 172.21.15.146:0/3223454542 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff938066f30 0x7ff9380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:34.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.819+0000 7ff954ff9700 1 -- 172.21.15.146:0/3223454542 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff948013070 con 0x7ff9580b2430 2023-10-06T11:17:34.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.819+0000 7ff95cdc3700 1 --2- 172.21.15.146:0/3223454542 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff938066f30 0x7ff9380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:34.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.819+0000 7ff95cdc3700 1 --2- 172.21.15.146:0/3223454542 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff938066f30 0x7ff9380693e0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7ff9500099b0 tx=0x7ff950016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:34.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.820+0000 7ff96831fb80 1 Processor -- start 2023-10-06T11:17:34.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.821+0000 7ff96831fb80 1 -- start start 2023-10-06T11:17:34.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.821+0000 7ff96831fb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bf634a3950 0x55bf634a3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:34.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.821+0000 7ff96831fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf634edbc0 0x55bf634cc920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:34.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.821+0000 7ff96831fb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bf634cce60 0x55bf6349f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:34.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.821+0000 7ff96831fb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf63423c80 con 0x55bf634cce60 2023-10-06T11:17:34.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.821+0000 7ff96831fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf633faa70 con 0x55bf634edbc0 2023-10-06T11:17:34.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.821+0000 7ff96831fb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bf633f8270 con 0x55bf634a3950 2023-10-06T11:17:34.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.821+0000 7ff95d5c4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bf634cce60 0x55bf6349f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:34.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.821+0000 7ff95d5c4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bf634cce60 0x55bf6349f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45948/0 (socket says 172.21.15.146:45948) 2023-10-06T11:17:34.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.821+0000 7ff95d5c4700 1 -- 172.21.15.146:0/1614623142 learned_addr learned my addr 172.21.15.146:0/1614623142 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:34.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.822+0000 7ff95cdc3700 1 --2- 172.21.15.146:0/1614623142 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bf634a3950 0x55bf634a3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:34.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.822+0000 7ff957fff700 1 --2- 172.21.15.146:0/1614623142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf634edbc0 0x55bf634cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:34.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.822+0000 7ff95d5c4700 1 -- 172.21.15.146:0/1614623142 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bf634a3950 msgr2=0x55bf634a3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:34.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.822+0000 7ff95d5c4700 1 --2- 172.21.15.146:0/1614623142 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bf634a3950 0x55bf634a3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.822+0000 7ff95d5c4700 1 -- 172.21.15.146:0/1614623142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf634edbc0 msgr2=0x55bf634cc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:34.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.822+0000 7ff95d5c4700 1 --2- 172.21.15.146:0/1614623142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf634edbc0 0x55bf634cc920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.822+0000 7ff95d5c4700 1 -- 172.21.15.146:0/1614623142 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bf6328e270 con 0x55bf634cce60 2023-10-06T11:17:34.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.822+0000 7ff95d5c4700 1 --2- 172.21.15.146:0/1614623142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bf634cce60 0x55bf6349f990 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7ff940003920 tx=0x7ff940007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eac295ef6f0fa2b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:34.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.822+0000 7ff94dffb700 1 -- 172.21.15.146:0/1614623142 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94000f8d0 con 0x55bf634cce60 2023-10-06T11:17:34.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.822+0000 7ff94dffb700 1 -- 172.21.15.146:0/1614623142 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94000fa30 con 0x55bf634cce60 2023-10-06T11:17:34.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.822+0000 7ff94dffb700 1 -- 172.21.15.146:0/1614623142 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94000fdb0 con 0x55bf634cce60 2023-10-06T11:17:34.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.822+0000 7ff96831fb80 1 -- 172.21.15.146:0/1614623142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bf634cce60 msgr2=0x55bf6349f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:34.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.822+0000 7ff96831fb80 1 --2- 172.21.15.146:0/1614623142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bf634cce60 0x55bf6349f990 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7ff940003920 tx=0x7ff940007ea0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.822+0000 7ff96831fb80 1 -- 172.21.15.146:0/1614623142 shutdown_connections 2023-10-06T11:17:34.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.822+0000 7ff96831fb80 1 --2- 172.21.15.146:0/1614623142 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bf634cce60 0x55bf6349f990 unknown :-1 s=CLOSED pgs=1969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.822+0000 7ff96831fb80 1 --2- 172.21.15.146:0/1614623142 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bf634a3950 0x55bf634a3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.822+0000 7ff96831fb80 1 --2- 172.21.15.146:0/1614623142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf634edbc0 0x55bf634cc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.822+0000 7ff96831fb80 1 -- 172.21.15.146:0/1614623142 >> 172.21.15.146:0/1614623142 conn(0x55bf634a5270 msgr2=0x55bf634a5640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:34.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.823+0000 7ff96831fb80 1 -- 172.21.15.146:0/1614623142 shutdown_connections 2023-10-06T11:17:34.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.823+0000 7ff96831fb80 1 -- 172.21.15.146:0/1614623142 wait complete. 2023-10-06T11:17:34.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.823+0000 7ff96831fb80 1 -- start start 2023-10-06T11:17:34.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.823+0000 7ff96831fb80 1 Processor -- start 2023-10-06T11:17:34.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.824+0000 7ff96831fb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bf634a3950 0x55bf634fa430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:34.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.824+0000 7ff96831fb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bf634cce60 0x55bf634e1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:34.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.824+0000 7ff96831fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf634edbc0 0x55bf634e2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:34.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.824+0000 7ff96831fb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf633f4060 con 0x55bf634a3950 2023-10-06T11:17:34.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.824+0000 7ff96831fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf6339f890 con 0x55bf634edbc0 2023-10-06T11:17:34.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.824+0000 7ff96831fb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bf633baea0 con 0x55bf634cce60 2023-10-06T11:17:34.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.824+0000 7ff96831fb80 10 client.0 _ll_register_callbacks cb 0x55bf63290f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:17:34.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.824+0000 7ff95cdc3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bf634a3950 0x55bf634fa430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:34.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.824+0000 7ff95cdc3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bf634a3950 0x55bf634fa430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45954/0 (socket says 172.21.15.146:45954) 2023-10-06T11:17:34.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.824+0000 7ff95cdc3700 1 -- 172.21.15.146:0/215579568 learned_addr learned my addr 172.21.15.146:0/215579568 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:34.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.824+0000 7ff957fff700 1 --2- 172.21.15.146:0/215579568 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bf634cce60 0x55bf634e1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:34.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.824+0000 7ff95d5c4700 1 --2- 172.21.15.146:0/215579568 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf634edbc0 0x55bf634e2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:34.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.824+0000 7ff95cdc3700 1 -- 172.21.15.146:0/215579568 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bf634cce60 msgr2=0x55bf634e1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:34.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.824+0000 7ff95cdc3700 1 --2- 172.21.15.146:0/215579568 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bf634cce60 0x55bf634e1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.824+0000 7ff95cdc3700 1 -- 172.21.15.146:0/215579568 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf634edbc0 msgr2=0x55bf634e2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:34.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.824+0000 7ff95cdc3700 1 --2- 172.21.15.146:0/215579568 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf634edbc0 0x55bf634e2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.824+0000 7ff95cdc3700 1 -- 172.21.15.146:0/215579568 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff940003580 con 0x55bf634a3950 2023-10-06T11:17:34.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.825+0000 7ff95cdc3700 1 --2- 172.21.15.146:0/215579568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bf634a3950 0x55bf634fa430 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7ff950006fd0 tx=0x7ff950021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d06706c0f6518d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:34.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.825+0000 7ff936ffd700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:17:34.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.825+0000 7ff936ffd700 1 -- 172.21.15.146:0/215579568 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95002f070 con 0x55bf634a3950 2023-10-06T11:17:34.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.825+0000 7ff936ffd700 1 -- 172.21.15.146:0/215579568 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff950011ca0 con 0x55bf634a3950 2023-10-06T11:17:34.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.825+0000 7ff96831fb80 1 -- 172.21.15.146:0/215579568 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bf63498690 con 0x55bf634a3950 2023-10-06T11:17:34.840 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.825+0000 7ff936ffd700 1 -- 172.21.15.146:0/215579568 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=128) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff950021070 con 0x55bf634a3950 2023-10-06T11:17:34.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.825+0000 7ff96831fb80 10 client.9831 fetch_fsmap learned FSMap version 128 2023-10-06T11:17:34.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.825+0000 7ff96831fb80 1 -- 172.21.15.146:0/215579568 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=128,monmap=2+}) v3 -- 0x55bf63230fe0 con 0x55bf634a3950 2023-10-06T11:17:34.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.825+0000 7ff936ffd700 1 -- 172.21.15.146:0/215579568 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bf63498690 con 0x55bf634a3950 2023-10-06T11:17:34.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.826+0000 7ff936ffd700 1 -- 172.21.15.146:0/215579568 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 128) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff95001b650 con 0x55bf634a3950 2023-10-06T11:17:34.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.826+0000 7ff96831fb80 10 client.9831 fetch_fsmap finished waiting for FSMap version 128 2023-10-06T11:17:34.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.826+0000 7ff96831fb80 10 client.9831 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T11:17:34.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.826+0000 7ff96831fb80 20 client.9831 populate_metadata read hostname 'smithi146' 2023-10-06T11:17:34.841 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.826+0000 7ff96831fb80 1 --2- 172.21.15.146:0/215579568 >> [v2:172.21.15.146:6835/2875253990,v1:172.21.15.146:6837/2875253990] conn(0x55bf634ca840 0x55bf634cac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:34.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.826+0000 7ff96831fb80 4 client.9831 mds_command: new command op to 9648 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:17:34.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.826+0000 7ff96831fb80 1 -- 172.21.15.146:0/215579568 --> [v2:172.21.15.146:6835/2875253990,v1:172.21.15.146:6837/2875253990] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bf634755c0 con 0x55bf634ca840 2023-10-06T11:17:34.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.826+0000 7ff957fff700 1 --2- 172.21.15.146:0/215579568 >> [v2:172.21.15.146:6835/2875253990,v1:172.21.15.146:6837/2875253990] conn(0x55bf634ca840 0x55bf634cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:34.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.826+0000 7ff936ffd700 10 client.9831 ms_handle_connect on v2:172.21.15.146:6835/2875253990 2023-10-06T11:17:34.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.826+0000 7ff957fff700 1 --2- 172.21.15.146:0/215579568 >> [v2:172.21.15.146:6835/2875253990,v1:172.21.15.146:6837/2875253990] conn(0x55bf634ca840 0x55bf634cac10 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd8ab68f45870398 server_cookie=7f8b8efac88390a1 in_seq=0 out_seq=0 2023-10-06T11:17:34.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.827+0000 7ff936ffd700 1 -- 172.21.15.146:0/215579568 <== mds.0 v2:172.21.15.146:6835/2875253990 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55bf634755c0 con 0x55bf634ca840 2023-10-06T11:17:34.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.827+0000 7ff936ffd700 10 client.9831 handle_command_reply: tid=0 2023-10-06T11:17:34.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.827+0000 7ff96831fb80 1 client.9831 shutdown 2023-10-06T11:17:34.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.827+0000 7ff96831fb80 1 -- 172.21.15.146:0/215579568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bf634a3950 msgr2=0x55bf634fa430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:34.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.827+0000 7ff96831fb80 1 --2- 172.21.15.146:0/215579568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bf634a3950 0x55bf634fa430 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7ff950006fd0 tx=0x7ff950021000 comp rx=0 tx=0).stop 2023-10-06T11:17:34.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.827+0000 7ff96831fb80 1 -- 172.21.15.146:0/215579568 shutdown_connections 2023-10-06T11:17:34.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.827+0000 7ff96831fb80 1 --2- 172.21.15.146:0/215579568 >> [v2:172.21.15.146:6835/2875253990,v1:172.21.15.146:6837/2875253990] conn(0x55bf634ca840 0x55bf634cac10 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.827+0000 7ff96831fb80 1 --2- 172.21.15.146:0/215579568 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf634edbc0 0x55bf634e2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.827+0000 7ff96831fb80 1 --2- 172.21.15.146:0/215579568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bf634a3950 0x55bf634fa430 unknown :-1 s=CLOSED pgs=1970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.827+0000 7ff936ffd700 0 client.9831 ms_handle_reset on v2:172.21.15.146:6835/2875253990 2023-10-06T11:17:34.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.827+0000 7ff96831fb80 1 --2- 172.21.15.146:0/215579568 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bf634cce60 0x55bf634e1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.827+0000 7ff96831fb80 1 -- 172.21.15.146:0/215579568 >> 172.21.15.146:0/215579568 conn(0x55bf634a5270 msgr2=0x55bf6349a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:34.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.827+0000 7ff96831fb80 1 -- 172.21.15.146:0/215579568 shutdown_connections 2023-10-06T11:17:34.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.827+0000 7ff96831fb80 1 -- 172.21.15.146:0/215579568 wait complete. 2023-10-06T11:17:34.844 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.827+0000 7ff96831fb80 20 client.9831 trim_cache size 0 max 16384 2023-10-06T11:17:34.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.844+0000 7ff96831fb80 1 Processor -- start 2023-10-06T11:17:34.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.844+0000 7ff96831fb80 1 -- start start 2023-10-06T11:17:34.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.844+0000 7ff96831fb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bf634a5270 0x55bf6349a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:34.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.844+0000 7ff96831fb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bf634a3950 0x55bf6349a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:34.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.844+0000 7ff96831fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf634cce60 0x55bf6349f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:34.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.844+0000 7ff96831fb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf634a2c40 con 0x55bf634a5270 2023-10-06T11:17:34.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.844+0000 7ff96831fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf63276e30 con 0x55bf634cce60 2023-10-06T11:17:34.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.844+0000 7ff96831fb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bf634e2870 con 0x55bf634a3950 2023-10-06T11:17:34.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.845+0000 7ff95cdc3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bf634a5270 0x55bf6349a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:34.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.845+0000 7ff95cdc3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bf634a5270 0x55bf6349a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45960/0 (socket says 172.21.15.146:45960) 2023-10-06T11:17:34.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.845+0000 7ff95cdc3700 1 -- 172.21.15.146:0/2393234996 learned_addr learned my addr 172.21.15.146:0/2393234996 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:34.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.845+0000 7ff957fff700 1 --2- 172.21.15.146:0/2393234996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bf634a3950 0x55bf6349a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:34.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.845+0000 7ff95d5c4700 1 --2- 172.21.15.146:0/2393234996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf634cce60 0x55bf6349f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:34.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.845+0000 7ff95cdc3700 1 -- 172.21.15.146:0/2393234996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bf634a3950 msgr2=0x55bf6349a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:34.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.845+0000 7ff95cdc3700 1 --2- 172.21.15.146:0/2393234996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bf634a3950 0x55bf6349a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.845+0000 7ff95cdc3700 1 -- 172.21.15.146:0/2393234996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf634cce60 msgr2=0x55bf6349f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:34.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.845+0000 7ff95cdc3700 1 --2- 172.21.15.146:0/2393234996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf634cce60 0x55bf6349f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.845+0000 7ff95cdc3700 1 -- 172.21.15.146:0/2393234996 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bf634e4db0 con 0x55bf634a5270 2023-10-06T11:17:34.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.845+0000 7ff957fff700 1 --2- 172.21.15.146:0/2393234996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bf634a3950 0x55bf6349a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:17:34.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.845+0000 7ff95d5c4700 1 --2- 172.21.15.146:0/2393234996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf634cce60 0x55bf6349f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:17:34.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.845+0000 7ff95cdc3700 1 --2- 172.21.15.146:0/2393234996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bf634a5270 0x55bf6349a370 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7ff950011940 tx=0x7ff95002f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4370a77a246e2ad server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:34.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.845+0000 7ff94e7fc700 1 -- 172.21.15.146:0/2393234996 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff950021040 con 0x55bf634a5270 2023-10-06T11:17:34.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.845+0000 7ff94e7fc700 1 -- 172.21.15.146:0/2393234996 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95000bba0 con 0x55bf634a5270 2023-10-06T11:17:34.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.845+0000 7ff94e7fc700 1 -- 172.21.15.146:0/2393234996 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95001b650 con 0x55bf634a5270 2023-10-06T11:17:34.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.846+0000 7ff96831fb80 1 -- 172.21.15.146:0/2393234996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bf634a5270 msgr2=0x55bf6349a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:34.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.846+0000 7ff96831fb80 1 --2- 172.21.15.146:0/2393234996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bf634a5270 0x55bf6349a370 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7ff950011940 tx=0x7ff95002f000 comp rx=0 tx=0).stop 2023-10-06T11:17:34.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.846+0000 7ff96831fb80 1 -- 172.21.15.146:0/2393234996 shutdown_connections 2023-10-06T11:17:34.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.846+0000 7ff96831fb80 1 --2- 172.21.15.146:0/2393234996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf634cce60 0x55bf6349f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.846+0000 7ff96831fb80 1 --2- 172.21.15.146:0/2393234996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bf634a5270 0x55bf6349a370 unknown :-1 s=CLOSED pgs=1971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.846+0000 7ff96831fb80 1 --2- 172.21.15.146:0/2393234996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bf634a3950 0x55bf6349a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.846+0000 7ff96831fb80 1 -- 172.21.15.146:0/2393234996 >> 172.21.15.146:0/2393234996 conn(0x55bf634c9120 msgr2=0x55bf634e1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:34.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.846+0000 7ff96831fb80 1 -- 172.21.15.146:0/2393234996 shutdown_connections 2023-10-06T11:17:34.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.846+0000 7ff96831fb80 1 -- 172.21.15.146:0/2393234996 wait complete. 2023-10-06T11:17:34.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.846+0000 7ff96831fb80 1 -- start start 2023-10-06T11:17:34.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.846+0000 7ff96831fb80 1 Processor -- start 2023-10-06T11:17:34.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.847+0000 7ff96831fb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bf634a3950 0x55bf6349f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:34.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.847+0000 7ff96831fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf634a5270 0x55bf6354fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:34.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.847+0000 7ff96831fb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bf634cce60 0x55bf634ea9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:34.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.847+0000 7ff96831fb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf634a0100 con 0x55bf634a3950 2023-10-06T11:17:34.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.847+0000 7ff96831fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf634c7e70 con 0x55bf634a5270 2023-10-06T11:17:34.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.847+0000 7ff96831fb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bf6354f6f0 con 0x55bf634cce60 2023-10-06T11:17:34.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.847+0000 7ff96831fb80 10 client.0 _ll_register_callbacks cb 0x55bf63290f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:17:34.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.847+0000 7ff95cdc3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bf634a3950 0x55bf6349f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:34.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.847+0000 7ff95cdc3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bf634a3950 0x55bf6349f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45976/0 (socket says 172.21.15.146:45976) 2023-10-06T11:17:34.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.847+0000 7ff95cdc3700 1 -- 172.21.15.146:0/4191398041 learned_addr learned my addr 172.21.15.146:0/4191398041 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:34.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.847+0000 7ff95d5c4700 1 --2- 172.21.15.146:0/4191398041 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bf634cce60 0x55bf634ea9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:34.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.847+0000 7ff957fff700 1 --2- 172.21.15.146:0/4191398041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf634a5270 0x55bf6354fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:34.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.847+0000 7ff95cdc3700 1 -- 172.21.15.146:0/4191398041 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bf634cce60 msgr2=0x55bf634ea9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:34.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.847+0000 7ff95cdc3700 1 --2- 172.21.15.146:0/4191398041 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bf634cce60 0x55bf634ea9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.847+0000 7ff95cdc3700 1 -- 172.21.15.146:0/4191398041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf634a5270 msgr2=0x55bf6354fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:34.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.847+0000 7ff95cdc3700 1 --2- 172.21.15.146:0/4191398041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf634a5270 0x55bf6354fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.847+0000 7ff95cdc3700 1 -- 172.21.15.146:0/4191398041 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bf63230fe0 con 0x55bf634a3950 2023-10-06T11:17:34.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.848+0000 7ff95cdc3700 1 --2- 172.21.15.146:0/4191398041 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bf634a3950 0x55bf6349f820 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7ff950006fd0 tx=0x7ff950038000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ec73105b3ac5a16 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:34.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.848+0000 7ff936ffd700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:17:34.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.848+0000 7ff936ffd700 1 -- 172.21.15.146:0/4191398041 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff950021070 con 0x55bf634a3950 2023-10-06T11:17:34.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.848+0000 7ff936ffd700 1 -- 172.21.15.146:0/4191398041 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff950011a20 con 0x55bf634a3950 2023-10-06T11:17:34.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.848+0000 7ff96831fb80 1 -- 172.21.15.146:0/4191398041 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff94000fa30 con 0x55bf634a3950 2023-10-06T11:17:34.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.848+0000 7ff936ffd700 1 -- 172.21.15.146:0/4191398041 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=128) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff95002f040 con 0x55bf634a3950 2023-10-06T11:17:34.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.848+0000 7ff96831fb80 10 client.9837 fetch_fsmap learned FSMap version 128 2023-10-06T11:17:34.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.848+0000 7ff96831fb80 1 -- 172.21.15.146:0/4191398041 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=128,monmap=2+}) v3 -- 0x55bf633c2780 con 0x55bf634a3950 2023-10-06T11:17:34.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.848+0000 7ff936ffd700 1 -- 172.21.15.146:0/4191398041 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94000fa30 con 0x55bf634a3950 2023-10-06T11:17:34.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.848+0000 7ff936ffd700 1 -- 172.21.15.146:0/4191398041 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 128) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff950029420 con 0x55bf634a3950 2023-10-06T11:17:34.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.848+0000 7ff96831fb80 10 client.9837 fetch_fsmap finished waiting for FSMap version 128 2023-10-06T11:17:34.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.848+0000 7ff96831fb80 10 client.9837 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T11:17:34.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.848+0000 7ff96831fb80 20 client.9837 populate_metadata read hostname 'smithi146' 2023-10-06T11:17:34.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.848+0000 7ff96831fb80 1 --2- 172.21.15.146:0/4191398041 >> [v2:172.21.15.146:6835/2875253990,v1:172.21.15.146:6837/2875253990] conn(0x55bf634edbc0 0x55bf634eaef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:34.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.848+0000 7ff96831fb80 4 client.9837 mds_command: new command op to 9648 tid=0[{"prefix": "status"}] 2023-10-06T11:17:34.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.848+0000 7ff96831fb80 1 -- 172.21.15.146:0/4191398041 --> [v2:172.21.15.146:6835/2875253990,v1:172.21.15.146:6837/2875253990] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55bf63396e00 con 0x55bf634edbc0 2023-10-06T11:17:34.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.848+0000 7ff957fff700 1 --2- 172.21.15.146:0/4191398041 >> [v2:172.21.15.146:6835/2875253990,v1:172.21.15.146:6837/2875253990] conn(0x55bf634edbc0 0x55bf634eaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:34.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.849+0000 7ff936ffd700 10 client.9837 ms_handle_connect on v2:172.21.15.146:6835/2875253990 2023-10-06T11:17:34.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.849+0000 7ff957fff700 1 --2- 172.21.15.146:0/4191398041 >> [v2:172.21.15.146:6835/2875253990,v1:172.21.15.146:6837/2875253990] conn(0x55bf634edbc0 0x55bf634eaef0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fe8623863711947 server_cookie=88f4b7de50d61832 in_seq=0 out_seq=0 2023-10-06T11:17:34.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.849+0000 7ff936ffd700 1 -- 172.21.15.146:0/4191398041 <== mds.0 v2:172.21.15.146:6835/2875253990 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x55bf63396e00 con 0x55bf634edbc0 2023-10-06T11:17:34.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.849+0000 7ff936ffd700 10 client.9837 handle_command_reply: tid=0 2023-10-06T11:17:34.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.849+0000 7ff96831fb80 1 client.9837 shutdown 2023-10-06T11:17:34.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.849+0000 7ff96831fb80 1 -- 172.21.15.146:0/4191398041 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bf634a3950 msgr2=0x55bf6349f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:34.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.849+0000 7ff96831fb80 1 --2- 172.21.15.146:0/4191398041 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bf634a3950 0x55bf6349f820 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7ff950006fd0 tx=0x7ff950038000 comp rx=0 tx=0).stop 2023-10-06T11:17:34.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.849+0000 7ff96831fb80 1 -- 172.21.15.146:0/4191398041 shutdown_connections 2023-10-06T11:17:34.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.849+0000 7ff96831fb80 1 --2- 172.21.15.146:0/4191398041 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55bf634cce60 0x55bf634ea9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.849+0000 7ff96831fb80 1 --2- 172.21.15.146:0/4191398041 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55bf634a3950 0x55bf6349f820 unknown :-1 s=CLOSED pgs=1972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.849+0000 7ff96831fb80 1 --2- 172.21.15.146:0/4191398041 >> [v2:172.21.15.146:6835/2875253990,v1:172.21.15.146:6837/2875253990] conn(0x55bf634edbc0 0x55bf634eaef0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.849+0000 7ff96831fb80 1 --2- 172.21.15.146:0/4191398041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bf634a5270 0x55bf6354fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.849+0000 7ff96831fb80 1 -- 172.21.15.146:0/4191398041 >> 172.21.15.146:0/4191398041 conn(0x55bf634c9120 msgr2=0x55bf6349a370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:34.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.849+0000 7ff936ffd700 0 client.9837 ms_handle_reset on v2:172.21.15.146:6835/2875253990 2023-10-06T11:17:34.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.849+0000 7ff96831fb80 1 -- 172.21.15.146:0/4191398041 shutdown_connections 2023-10-06T11:17:34.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.849+0000 7ff96831fb80 1 -- 172.21.15.146:0/4191398041 wait complete. 2023-10-06T11:17:34.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.849+0000 7ff96831fb80 20 client.9837 trim_cache size 0 max 16384 2023-10-06T11:17:34.860 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:17:34.860 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1", 2023-10-06T11:17:34.860 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2023-10-06T11:17:34.860 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 9648, 2023-10-06T11:17:34.860 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2023-10-06T11:17:34.861 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2023-10-06T11:17:34.861 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2023-10-06T11:17:34.861 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 10.278696755, 2023-10-06T11:17:34.861 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 128, 2023-10-06T11:17:34.861 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 151, 2023-10-06T11:17:34.861 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 151, 2023-10-06T11:17:34.861 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 16.408789113000001 2023-10-06T11:17:34.861 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:17:34.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.850+0000 7ff95ddc5700 1 -- 172.21.15.146:0/3223454542 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff938066f30 msgr2=0x7ff9380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:34.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.850+0000 7ff95ddc5700 1 --2- 172.21.15.146:0/3223454542 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff938066f30 0x7ff9380693e0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7ff9500099b0 tx=0x7ff950016000 comp rx=0 tx=0).stop 2023-10-06T11:17:34.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.850+0000 7ff95ddc5700 1 -- 172.21.15.146:0/3223454542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9580b2430 msgr2=0x7ff95816a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:34.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.850+0000 7ff95ddc5700 1 --2- 172.21.15.146:0/3223454542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9580b2430 0x7ff95816a460 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7ff94800ce10 tx=0x7ff948007810 comp rx=0 tx=0).stop 2023-10-06T11:17:34.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.850+0000 7ff95ddc5700 1 -- 172.21.15.146:0/3223454542 shutdown_connections 2023-10-06T11:17:34.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.850+0000 7ff95ddc5700 1 --2- 172.21.15.146:0/3223454542 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff938066f30 0x7ff9380693e0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.850+0000 7ff95ddc5700 1 --2- 172.21.15.146:0/3223454542 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff9580b3cf0 0x7ff95815b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.850+0000 7ff95ddc5700 1 --2- 172.21.15.146:0/3223454542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9580b2060 0x7ff9580a90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.850+0000 7ff95ddc5700 1 --2- 172.21.15.146:0/3223454542 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9580b2430 0x7ff95816a460 unknown :-1 s=CLOSED pgs=1968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.850+0000 7ff95ddc5700 1 -- 172.21.15.146:0/3223454542 >> 172.21.15.146:0/3223454542 conn(0x7ff95806eba0 msgr2=0x7ff958158460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:34.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.850+0000 7ff95ddc5700 1 -- 172.21.15.146:0/3223454542 shutdown_connections 2023-10-06T11:17:34.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.850+0000 7ff95ddc5700 1 -- 172.21.15.146:0/3223454542 wait complete. 2023-10-06T11:17:34.864 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T11:17:34.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.977+0000 7fcb97178700 1 Processor -- start 2023-10-06T11:17:34.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.977+0000 7fcb97178700 1 -- start start 2023-10-06T11:17:34.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.978+0000 7fcb97178700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcb90153ab0 0x7fcb9015a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:34.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.978+0000 7fcb97178700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb90068ba0 0x7fcb900b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:34.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.978+0000 7fcb97178700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb9015ac30 con 0x7fcb90153e80 2023-10-06T11:17:34.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.978+0000 7fcb97178700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb900b4510 con 0x7fcb90153ab0 2023-10-06T11:17:34.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.978+0000 7fcb97178700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb900b6530 con 0x7fcb90068ba0 2023-10-06T11:17:34.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.978+0000 7fcb8ffff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fcb90153e80 0x7fcb90068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:37326/0 (socket says 172.21.15.146:37326) 2023-10-06T11:17:34.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.978+0000 7fcb8ffff700 1 -- 172.21.15.146:0/1443555412 learned_addr learned my addr 172.21.15.146:0/1443555412 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:17:34.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.978+0000 7fcb8f7fe700 1 -- 172.21.15.146:0/1443555412 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4078889279 0 0) 0x7fcb7c001110 con 0x7fcb90153e80 2023-10-06T11:17:34.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.978+0000 7fcb8f7fe700 1 -- 172.21.15.146:0/1443555412 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb80003570 con 0x7fcb90153e80 2023-10-06T11:17:34.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.978+0000 7fcb95715700 1 --2- 172.21.15.146:0/1443555412 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb90068ba0 0x7fcb900b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:34.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.978+0000 7fcb94f14700 1 --2- 172.21.15.146:0/1443555412 >> v2:172.21.15.151:3300/0 conn(0x7fcb90153ab0 0x7fcb9015a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:34.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.978+0000 7fcb8f7fe700 1 -- 172.21.15.146:0/1443555412 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4252053105 0 0) 0x7fcb80003570 con 0x7fcb90153e80 2023-10-06T11:17:34.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.978+0000 7fcb8f7fe700 1 -- 172.21.15.146:0/1443555412 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb90068ba0 msgr2=0x7fcb900b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:34.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.978+0000 7fcb8f7fe700 1 --2- 172.21.15.146:0/1443555412 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb90068ba0 0x7fcb900b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.978+0000 7fcb8f7fe700 1 -- 172.21.15.146:0/1443555412 >> v2:172.21.15.151:3300/0 conn(0x7fcb90153ab0 msgr2=0x7fcb9015a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:34.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.978+0000 7fcb8f7fe700 1 --2- 172.21.15.146:0/1443555412 >> v2:172.21.15.151:3300/0 conn(0x7fcb90153ab0 0x7fcb9015a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.978+0000 7fcb8f7fe700 1 -- 172.21.15.146:0/1443555412 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb900b5c50 con 0x7fcb90153e80 2023-10-06T11:17:34.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.978+0000 7fcb8f7fe700 1 -- 172.21.15.146:0/1443555412 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fcb7c001600 con 0x7fcb90153e80 2023-10-06T11:17:34.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.978+0000 7fcb95715700 1 --2- 172.21.15.146:0/1443555412 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb90068ba0 0x7fcb900b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:17:34.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.979+0000 7fcb8f7fe700 1 -- 172.21.15.146:0/1443555412 >> v1:172.21.15.146:6789/0 conn(0x7fcb90153e80 legacy=0x7fcb90068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:34.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.979+0000 7fcb8f7fe700 1 --2- 172.21.15.146:0/1443555412 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb80003a60 0x7fcb80003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:34.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.979+0000 7fcb8f7fe700 1 --2- 172.21.15.146:0/1443555412 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb90068ba0 0x7fcb80004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:34.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.979+0000 7fcb8f7fe700 1 --2- 172.21.15.146:0/1443555412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb80004d50 0x7fcb800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:34.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.979+0000 7fcb8f7fe700 1 -- 172.21.15.146:0/1443555412 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb900b4510 con 0x7fcb80004d50 2023-10-06T11:17:34.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.979+0000 7fcb8f7fe700 1 -- 172.21.15.146:0/1443555412 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb900b6530 con 0x7fcb80003a60 2023-10-06T11:17:34.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.979+0000 7fcb8f7fe700 1 -- 172.21.15.146:0/1443555412 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8000bab0 con 0x7fcb90068ba0 2023-10-06T11:17:34.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.979+0000 7fcb95715700 1 --2- 172.21.15.146:0/1443555412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb80004d50 0x7fcb800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:34.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.979+0000 7fcb8ffff700 1 --2- 172.21.15.146:0/1443555412 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb90068ba0 0x7fcb80004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:34.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.979+0000 7fcb94f14700 1 --2- 172.21.15.146:0/1443555412 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb80003a60 0x7fcb80003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:34.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.979+0000 7fcb95715700 1 -- 172.21.15.146:0/1443555412 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb90068ba0 msgr2=0x7fcb80004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:34.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.979+0000 7fcb95715700 1 --2- 172.21.15.146:0/1443555412 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb90068ba0 0x7fcb80004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.979+0000 7fcb95715700 1 -- 172.21.15.146:0/1443555412 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb80003a60 msgr2=0x7fcb80003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:34.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.979+0000 7fcb95715700 1 --2- 172.21.15.146:0/1443555412 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb80003a60 0x7fcb80003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.979+0000 7fcb95715700 1 -- 172.21.15.146:0/1443555412 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb80003570 con 0x7fcb80004d50 2023-10-06T11:17:34.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.979+0000 7fcb95715700 1 --2- 172.21.15.146:0/1443555412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb80004d50 0x7fcb800051c0 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7fcb9006fa90 tx=0x7fcb880097f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c961bade38e2fd3a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:34.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.979+0000 7fcb8f7fe700 1 -- 172.21.15.146:0/1443555412 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb88007d70 con 0x7fcb80004d50 2023-10-06T11:17:34.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.979+0000 7fcb8f7fe700 1 -- 172.21.15.146:0/1443555412 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb88014400 con 0x7fcb80004d50 2023-10-06T11:17:34.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.979+0000 7fcb8f7fe700 1 -- 172.21.15.146:0/1443555412 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb880147a0 con 0x7fcb80004d50 2023-10-06T11:17:34.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.980+0000 7fcb97178700 1 -- 172.21.15.146:0/1443555412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb80004d50 msgr2=0x7fcb800051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:34.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.980+0000 7fcb97178700 1 --2- 172.21.15.146:0/1443555412 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb80004d50 0x7fcb800051c0 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7fcb9006fa90 tx=0x7fcb880097f0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.980+0000 7fcb95715700 1 -- 172.21.15.146:0/1443555412 reap_dead start 2023-10-06T11:17:34.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.980+0000 7fcb97178700 1 -- 172.21.15.146:0/1443555412 shutdown_connections 2023-10-06T11:17:34.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.980+0000 7fcb97178700 1 -- 172.21.15.146:0/1443555412 >> 172.21.15.146:0/1443555412 conn(0x7fcb9006eba0 msgr2=0x7fcb9006efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:34.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.980+0000 7fcb97178700 1 -- 172.21.15.146:0/1443555412 shutdown_connections 2023-10-06T11:17:34.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.980+0000 7fcb97178700 1 -- 172.21.15.146:0/1443555412 wait complete. 2023-10-06T11:17:34.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.981+0000 7fcb97178700 1 Processor -- start 2023-10-06T11:17:34.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.981+0000 7fcb97178700 1 -- start start 2023-10-06T11:17:34.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.982+0000 7fcb97178700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb80004d50 0x7fcb901518d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:34.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.982+0000 7fcb97178700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb90155560 0x7fcb901559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:34.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.982+0000 7fcb97178700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb900b0e90 0x7fcb900b1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:34.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.982+0000 7fcb97178700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb900b1850 con 0x7fcb90155560 2023-10-06T11:17:34.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.982+0000 7fcb97178700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb90158dd0 con 0x7fcb80004d50 2023-10-06T11:17:34.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.982+0000 7fcb97178700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb901581c0 con 0x7fcb900b0e90 2023-10-06T11:17:34.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.982+0000 7fcb8ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb90155560 0x7fcb901559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:34.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.982+0000 7fcb8ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb90155560 0x7fcb901559d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45988/0 (socket says 172.21.15.146:45988) 2023-10-06T11:17:34.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.982+0000 7fcb8ffff700 1 -- 172.21.15.146:0/789790267 learned_addr learned my addr 172.21.15.146:0/789790267 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:34.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.982+0000 7fcb94f14700 1 --2- 172.21.15.146:0/789790267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb80004d50 0x7fcb901518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:34.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.982+0000 7fcb95715700 1 --2- 172.21.15.146:0/789790267 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb900b0e90 0x7fcb900b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:34.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.982+0000 7fcb8ffff700 1 -- 172.21.15.146:0/789790267 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb900b0e90 msgr2=0x7fcb900b1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:34.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.982+0000 7fcb8ffff700 1 --2- 172.21.15.146:0/789790267 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb900b0e90 0x7fcb900b1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.982+0000 7fcb8ffff700 1 -- 172.21.15.146:0/789790267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb80004d50 msgr2=0x7fcb901518d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:34.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.982+0000 7fcb8ffff700 1 --2- 172.21.15.146:0/789790267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb80004d50 0x7fcb901518d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:34.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.982+0000 7fcb8ffff700 1 -- 172.21.15.146:0/789790267 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb901584a0 con 0x7fcb90155560 2023-10-06T11:17:34.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.982+0000 7fcb95715700 1 --2- 172.21.15.146:0/789790267 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb900b0e90 0x7fcb900b1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:17:34.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.982+0000 7fcb94f14700 1 --2- 172.21.15.146:0/789790267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb80004d50 0x7fcb901518d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:17:34.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.982+0000 7fcb8ffff700 1 --2- 172.21.15.146:0/789790267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb90155560 0x7fcb901559d0 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c0073c0 tx=0x7fcb7c007a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:34.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.982+0000 7fcb8cff9700 1 -- 172.21.15.146:0/789790267 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c018030 con 0x7fcb90155560 2023-10-06T11:17:34.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.982+0000 7fcb8cff9700 1 -- 172.21.15.146:0/789790267 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb7c00f870 con 0x7fcb90155560 2023-10-06T11:17:34.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.982+0000 7fcb97178700 1 -- 172.21.15.146:0/789790267 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb90158780 con 0x7fcb90155560 2023-10-06T11:17:34.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.983+0000 7fcb8cff9700 1 -- 172.21.15.146:0/789790267 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c00fc10 con 0x7fcb90155560 2023-10-06T11:17:34.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.983+0000 7fcb97178700 1 -- 172.21.15.146:0/789790267 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb901695d0 con 0x7fcb90155560 2023-10-06T11:17:34.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.983+0000 7fcb97178700 1 -- 172.21.15.146:0/789790267 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb90158f80 con 0x7fcb90155560 2023-10-06T11:17:34.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.984+0000 7fcb8cff9700 1 -- 172.21.15.146:0/789790267 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcb7c01b070 con 0x7fcb90155560 2023-10-06T11:17:34.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.984+0000 7fcb8cff9700 1 --2- 172.21.15.146:0/789790267 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcb74066f30 0x7fcb740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:34.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.984+0000 7fcb8cff9700 1 -- 172.21.15.146:0/789790267 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcb7c019070 con 0x7fcb90155560 2023-10-06T11:17:34.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.984+0000 7fcb94f14700 1 --2- 172.21.15.146:0/789790267 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcb74066f30 0x7fcb740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:34.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.985+0000 7fcb94f14700 1 --2- 172.21.15.146:0/789790267 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcb74066f30 0x7fcb740693e0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fcb84006f00 tx=0x7fcb84008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:34.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:34.989+0000 7fcb8cff9700 1 -- 172.21.15.146:0/789790267 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb90158f80 con 0x7fcb90155560 2023-10-06T11:17:35.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:35.216+0000 7fcb97178700 1 -- 172.21.15.146:0/789790267 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcb9015ac30 con 0x7fcb90155560 2023-10-06T11:17:35.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:35.216+0000 7fcb8cff9700 1 -- 172.21.15.146:0/789790267 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v128) v1 ==== 53+0+73 (secure 0 0 0) 0x7fcb9015ac30 con 0x7fcb90155560 2023-10-06T11:17:35.218 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T11:17:35.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:35.218+0000 7fcb97178700 1 -- 172.21.15.146:0/789790267 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcb74066f30 msgr2=0x7fcb740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:35.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:35.218+0000 7fcb97178700 1 --2- 172.21.15.146:0/789790267 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcb74066f30 0x7fcb740693e0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fcb84006f00 tx=0x7fcb84008040 comp rx=0 tx=0).stop 2023-10-06T11:17:35.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:35.218+0000 7fcb97178700 1 -- 172.21.15.146:0/789790267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb90155560 msgr2=0x7fcb901559d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:35.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:35.218+0000 7fcb97178700 1 --2- 172.21.15.146:0/789790267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb90155560 0x7fcb901559d0 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c0073c0 tx=0x7fcb7c007a80 comp rx=0 tx=0).stop 2023-10-06T11:17:35.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:35.218+0000 7fcb97178700 1 -- 172.21.15.146:0/789790267 shutdown_connections 2023-10-06T11:17:35.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:35.218+0000 7fcb97178700 1 --2- 172.21.15.146:0/789790267 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcb74066f30 0x7fcb740693e0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:35.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:35.218+0000 7fcb97178700 1 --2- 172.21.15.146:0/789790267 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb900b0e90 0x7fcb900b1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:35.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:35.218+0000 7fcb97178700 1 --2- 172.21.15.146:0/789790267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb80004d50 0x7fcb901518d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:35.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:35.218+0000 7fcb97178700 1 --2- 172.21.15.146:0/789790267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcb90155560 0x7fcb901559d0 unknown :-1 s=CLOSED pgs=1975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:35.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:35.218+0000 7fcb97178700 1 -- 172.21.15.146:0/789790267 >> 172.21.15.146:0/789790267 conn(0x7fcb9006eba0 msgr2=0x7fcb90152f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:35.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:35.218+0000 7fcb97178700 1 -- 172.21.15.146:0/789790267 shutdown_connections 2023-10-06T11:17:35.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:35.218+0000 7fcb97178700 1 -- 172.21.15.146:0/789790267 wait complete. 2023-10-06T11:17:35.232 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T11:17:35.233 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T11:17:35.233 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2023-10-06T11:17:35.233 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T11:17:35.233 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T11:17:35.233 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T11:17:35.233 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T11:17:35.233 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T11:17:35.233 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:17:35.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:17:35.234 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2023-10-06T11:17:35.249 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:17:35.249 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:17:35.249 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:17:35.249 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:17:35.249 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2023-10-06T11:17:35.249 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:17:35.249 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:17:35.249 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2023-10-06T11:17:35.249 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2023-10-06T11:17:35.250 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:17:35.250 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2023-10-06T11:17:35.250 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2023-10-06T11:17:35.250 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:17:35.250 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2023-10-06T11:17:35.250 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T11:17:35.250 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2023-10-06T11:17:35.250 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T11:17:35.250 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 41802sec preferred_lft 41802sec 2023-10-06T11:17:35.250 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link noprefixroute 2023-10-06T11:17:35.250 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:17:35.250 INFO:teuthology.orchestra.run.smithi146.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T11:17:35.251 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0e:4f:33:80:c4:0e brd ff:ff:ff:ff:ff:ff 2023-10-06T11:17:35.251 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T11:17:35.251 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:17:35.251 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3884:6eff:fefc:ffc7/64 scope link 2023-10-06T11:17:35.251 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:17:35.251 INFO:teuthology.orchestra.run.smithi146.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:17:35.251 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0e:4f:33:80:c4:0e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T11:17:35.251 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::c4f:33ff:fe80:c40e/64 scope link 2023-10-06T11:17:35.251 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:17:35.251 INFO:teuthology.orchestra.run.smithi146.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:17:35.251 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 36:96:28:73:57:c4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T11:17:35.251 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3496:28ff:fe73:57c4/64 scope link 2023-10-06T11:17:35.252 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:17:35.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:17:35.252 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T11:17:35.311 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-06T11:17:35.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:17:35.313 DEBUG:teuthology.orchestra.run.smithi146:> route 2023-10-06T11:17:35.368 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2023-10-06T11:17:35.369 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T11:17:35.369 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T11:17:35.369 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T11:17:35.369 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T11:17:35.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:17:35.369 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-10-06T11:17:35.369 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:17:35.369 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T11:17:35.370 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T11:17:35.370 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T11:17:35.370 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:17:35.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:17:35.470 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-10-06T11:17:35.484 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T11:17:35.485 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T11:17:35.485 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:17:35.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:17:35.485 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2023-10-06T11:17:35.550 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T11:17:35.550 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:17:35.550 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T11:17:35.604 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:17:35.604 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:17:35.604 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:17:35.659 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-06T11:17:35.724 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:17:35.724 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:17:35.788 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:17:35.789 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:17:35.789 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:17:35.790 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-06T11:17:35.844 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T11:17:35.844 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T11:17:35.887 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-06T11:17:35.911 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:17:35.911 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:17:35.969 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:2023-10-06T11:17:35.967+0000 7fd63ddc3540 -1 init, newargv = 0x555a0484fd90 newargc=15 2023-10-06T11:17:35.969 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[154261]: starting ceph client 2023-10-06T11:17:35.973 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[154261]: starting fuse 2023-10-06T11:17:35.977 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:17:35.978 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:17:35.979 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:17:35.979 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-06T11:17:36.035 INFO:teuthology.orchestra.run.smithi146.stdout:46 2023-10-06T11:17:36.035 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-06T11:17:36.036 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T11:17:36.036 DEBUG:teuthology.orchestra.run.smithi146:> import glob 2023-10-06T11:17:36.036 DEBUG:teuthology.orchestra.run.smithi146:> import re 2023-10-06T11:17:36.036 DEBUG:teuthology.orchestra.run.smithi146:> import os 2023-10-06T11:17:36.036 DEBUG:teuthology.orchestra.run.smithi146:> import subprocess 2023-10-06T11:17:36.036 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:17:36.037 DEBUG:teuthology.orchestra.run.smithi146:> def _find_admin_socket(client_name): 2023-10-06T11:17:36.037 DEBUG:teuthology.orchestra.run.smithi146:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T11:17:36.037 DEBUG:teuthology.orchestra.run.smithi146:> files = glob.glob(asok_path) 2023-10-06T11:17:36.037 DEBUG:teuthology.orchestra.run.smithi146:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T11:17:36.037 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:17:36.037 DEBUG:teuthology.orchestra.run.smithi146:> # Given a non-glob path, it better be there 2023-10-06T11:17:36.037 DEBUG:teuthology.orchestra.run.smithi146:> if "*" not in asok_path: 2023-10-06T11:17:36.037 DEBUG:teuthology.orchestra.run.smithi146:> assert(len(files) == 1) 2023-10-06T11:17:36.038 DEBUG:teuthology.orchestra.run.smithi146:> return files[0] 2023-10-06T11:17:36.038 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:17:36.038 DEBUG:teuthology.orchestra.run.smithi146:> for f in files: 2023-10-06T11:17:36.038 DEBUG:teuthology.orchestra.run.smithi146:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T11:17:36.038 DEBUG:teuthology.orchestra.run.smithi146:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T11:17:36.038 DEBUG:teuthology.orchestra.run.smithi146:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T11:17:36.038 DEBUG:teuthology.orchestra.run.smithi146:> contents = proc_f.read() 2023-10-06T11:17:36.038 DEBUG:teuthology.orchestra.run.smithi146:> if mountpoint in contents: 2023-10-06T11:17:36.039 DEBUG:teuthology.orchestra.run.smithi146:> return f 2023-10-06T11:17:36.039 DEBUG:teuthology.orchestra.run.smithi146:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T11:17:36.039 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:17:36.039 DEBUG:teuthology.orchestra.run.smithi146:> print(_find_admin_socket("client.0")) 2023-10-06T11:17:36.039 DEBUG:teuthology.orchestra.run.smithi146:> ' 2023-10-06T11:17:36.156 INFO:teuthology.orchestra.run.smithi146.stdout:/var/run/ceph/ceph-client.0.154261.asok 2023-10-06T11:17:36.338 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.154261.asok 2023-10-06T11:17:36.339 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:17:36.339 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.154261.asok status 2023-10-06T11:17:36.489 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:17:36.489 INFO:teuthology.orchestra.run.smithi146.stdout: "metadata": { 2023-10-06T11:17:36.489 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T11:17:36.490 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T11:17:36.490 INFO:teuthology.orchestra.run.smithi146.stdout: "entity_id": "0", 2023-10-06T11:17:36.490 INFO:teuthology.orchestra.run.smithi146.stdout: "hostname": "smithi146", 2023-10-06T11:17:36.490 INFO:teuthology.orchestra.run.smithi146.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T11:17:36.490 INFO:teuthology.orchestra.run.smithi146.stdout: "pid": "154261", 2023-10-06T11:17:36.490 INFO:teuthology.orchestra.run.smithi146.stdout: "root": "/" 2023-10-06T11:17:36.490 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:17:36.490 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_count": 0, 2023-10-06T11:17:36.490 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_pinned_count": 0, 2023-10-06T11:17:36.490 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 9849, 2023-10-06T11:17:36.490 INFO:teuthology.orchestra.run.smithi146.stdout: "inst": { 2023-10-06T11:17:36.491 INFO:teuthology.orchestra.run.smithi146.stdout: "name": { 2023-10-06T11:17:36.491 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "client", 2023-10-06T11:17:36.491 INFO:teuthology.orchestra.run.smithi146.stdout: "num": 9849 2023-10-06T11:17:36.491 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:17:36.491 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-06T11:17:36.491 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-06T11:17:36.491 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:17:36.491 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 822094422 2023-10-06T11:17:36.491 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:17:36.491 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:17:36.491 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-06T11:17:36.491 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-06T11:17:36.492 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:17:36.492 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 822094422 2023-10-06T11:17:36.492 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:17:36.492 INFO:teuthology.orchestra.run.smithi146.stdout: "inst_str": "client.9849 192.168.0.1:0/822094422", 2023-10-06T11:17:36.492 INFO:teuthology.orchestra.run.smithi146.stdout: "addr_str": "192.168.0.1:0/822094422", 2023-10-06T11:17:36.492 INFO:teuthology.orchestra.run.smithi146.stdout: "inode_count": 1, 2023-10-06T11:17:36.492 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_epoch": 128, 2023-10-06T11:17:36.492 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch": 151, 2023-10-06T11:17:36.492 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch_barrier": 0, 2023-10-06T11:17:36.492 INFO:teuthology.orchestra.run.smithi146.stdout: "blocklisted": false, 2023-10-06T11:17:36.492 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs" 2023-10-06T11:17:36.493 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:17:36.499 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:17:36.499 DEBUG:teuthology.orchestra.run.smithi146:> stat --file-system '--printf=%T 2023-10-06T11:17:36.500 DEBUG:teuthology.orchestra.run.smithi146:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T11:17:36.514 INFO:teuthology.orchestra.run.smithi146.stdout:fuseblk 2023-10-06T11:17:36.515 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T11:17:36.515 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:17:36.515 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:17:36.579 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:17:36.580 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2023-10-06T11:17:36.639 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:17:36.640 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=subdir/sixmegs bs=1M conv=fdatasync count=6 seek=0) 2023-10-06T11:17:36.752 INFO:teuthology.orchestra.run.smithi146.stderr:6+0 records in 2023-10-06T11:17:36.752 INFO:teuthology.orchestra.run.smithi146.stderr:6+0 records out 2023-10-06T11:17:36.752 INFO:teuthology.orchestra.run.smithi146.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0554214 s, 114 MB/s 2023-10-06T11:17:36.754 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T11:17:36.756 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T11:17:36.797 INFO:teuthology.orchestra.run.smithi146.stdout:[global] 2023-10-06T11:17:36.797 INFO:teuthology.orchestra.run.smithi146.stdout: chdir = "" 2023-10-06T11:17:36.797 INFO:teuthology.orchestra.run.smithi146.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T11:17:36.797 INFO:teuthology.orchestra.run.smithi146.stdout: auth supported = cephx 2023-10-06T11:17:36.798 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.798 INFO:teuthology.orchestra.run.smithi146.stdout: filestore xattr use omap = true 2023-10-06T11:17:36.798 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.798 INFO:teuthology.orchestra.run.smithi146.stdout: mon clock drift allowed = 1.000 2023-10-06T11:17:36.798 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.798 INFO:teuthology.orchestra.run.smithi146.stdout: osd crush chooseleaf type = 0 2023-10-06T11:17:36.798 INFO:teuthology.orchestra.run.smithi146.stdout: auth debug = true 2023-10-06T11:17:36.798 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.798 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on old message = true 2023-10-06T11:17:36.799 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on bug = true 2023-10-06T11:17:36.799 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.799 INFO:teuthology.orchestra.run.smithi146.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T11:17:36.799 INFO:teuthology.orchestra.run.smithi146.stdout: mon pg warn max object skew = 0 2023-10-06T11:17:36.799 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.799 INFO:teuthology.orchestra.run.smithi146.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T11:17:36.799 INFO:teuthology.orchestra.run.smithi146.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T11:17:36.799 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.799 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default size = 2 2023-10-06T11:17:36.799 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.800 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow primary affinity = true 2023-10-06T11:17:36.800 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow pg remap = true 2023-10-06T11:17:36.800 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on legacy crush tunables = false 2023-10-06T11:17:36.800 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on crush straw calc version zero = false 2023-10-06T11:17:36.800 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on no sortbitwise = false 2023-10-06T11:17:36.800 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on osd down out interval zero = false 2023-10-06T11:17:36.800 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on too few osds = false 2023-10-06T11:17:36.800 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T11:17:36.800 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T11:17:36.800 INFO:teuthology.orchestra.run.smithi146.stdout: mon_allow_pool_size_one = true 2023-10-06T11:17:36.801 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.801 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T11:17:36.801 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.801 INFO:teuthology.orchestra.run.smithi146.stdout: osd default data pool replay window = 5 2023-10-06T11:17:36.801 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.801 INFO:teuthology.orchestra.run.smithi146.stdout: mon allow pool delete = true 2023-10-06T11:17:36.801 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.801 INFO:teuthology.orchestra.run.smithi146.stdout: mon cluster log file level = debug 2023-10-06T11:17:36.801 INFO:teuthology.orchestra.run.smithi146.stdout: debug asserts on shutdown = true 2023-10-06T11:17:36.801 INFO:teuthology.orchestra.run.smithi146.stdout: mon health detail to clog = false 2023-10-06T11:17:36.801 INFO:teuthology.orchestra.run.smithi146.stdout: mon host = "172.21.15.146,172.21.15.151,[v2:172.21.15.151:3301,v1:172.21.15.151:6790]" 2023-10-06T11:17:36.802 INFO:teuthology.orchestra.run.smithi146.stdout: fsid = c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1 2023-10-06T11:17:36.802 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.802 INFO:teuthology.orchestra.run.smithi146.stdout:[osd] 2023-10-06T11:17:36.802 INFO:teuthology.orchestra.run.smithi146.stdout: osd journal size = 100 2023-10-06T11:17:36.802 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.802 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub load threshold = 5.0 2023-10-06T11:17:36.802 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub max interval = 600 2023-10-06T11:17:36.802 INFO:teuthology.orchestra.run.smithi146.stdout: osd mclock profile = high_recovery_ops 2023-10-06T11:17:36.802 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.802 INFO:teuthology.orchestra.run.smithi146.stdout: osd recover clone overlap = true 2023-10-06T11:17:36.802 INFO:teuthology.orchestra.run.smithi146.stdout: osd recovery max chunk = 1048576 2023-10-06T11:17:36.803 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.803 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug shutdown = true 2023-10-06T11:17:36.803 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug op order = true 2023-10-06T11:17:36.803 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug verify stray on activate = true 2023-10-06T11:17:36.803 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.803 INFO:teuthology.orchestra.run.smithi146.stdout: osd open classes on start = true 2023-10-06T11:17:36.803 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug pg log writeout = true 2023-10-06T11:17:36.803 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.803 INFO:teuthology.orchestra.run.smithi146.stdout: osd deep scrub update digest min age = 30 2023-10-06T11:17:36.803 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.803 INFO:teuthology.orchestra.run.smithi146.stdout: osd map max advance = 10 2023-10-06T11:17:36.804 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.804 INFO:teuthology.orchestra.run.smithi146.stdout: journal zero on create = true 2023-10-06T11:17:36.804 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.804 INFO:teuthology.orchestra.run.smithi146.stdout: filestore ondisk finisher threads = 3 2023-10-06T11:17:36.804 INFO:teuthology.orchestra.run.smithi146.stdout: filestore apply finisher threads = 3 2023-10-06T11:17:36.804 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.804 INFO:teuthology.orchestra.run.smithi146.stdout: bdev debug aio = true 2023-10-06T11:17:36.804 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug misdirected ops = true 2023-10-06T11:17:36.804 INFO:teuthology.orchestra.run.smithi146.stdout: bdev async discard = True 2023-10-06T11:17:36.804 INFO:teuthology.orchestra.run.smithi146.stdout: bdev enable discard = True 2023-10-06T11:17:36.805 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore allocator = bitmap 2023-10-06T11:17:36.805 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore block size = 96636764160 2023-10-06T11:17:36.805 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore fsck on mount = True 2023-10-06T11:17:36.805 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluefs = 1/20 2023-10-06T11:17:36.805 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluestore = 1/20 2023-10-06T11:17:36.805 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-10-06T11:17:36.805 INFO:teuthology.orchestra.run.smithi146.stdout: debug osd = 20 2023-10-06T11:17:36.806 INFO:teuthology.orchestra.run.smithi146.stdout: debug rocksdb = 4/10 2023-10-06T11:17:36.806 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T11:17:36.806 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd full ratio = 0.9 2023-10-06T11:17:36.806 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd nearfull ratio = 0.8 2023-10-06T11:17:36.806 INFO:teuthology.orchestra.run.smithi146.stdout: osd failsafe full ratio = 0.95 2023-10-06T11:17:36.806 INFO:teuthology.orchestra.run.smithi146.stdout: osd objectstore = bluestore 2023-10-06T11:17:36.806 INFO:teuthology.orchestra.run.smithi146.stdout: osd op complaint time = 180 2023-10-06T11:17:36.806 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.807 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr] 2023-10-06T11:17:36.807 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-10-06T11:17:36.807 INFO:teuthology.orchestra.run.smithi146.stdout: debug mgr = 20 2023-10-06T11:17:36.807 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2023-10-06T11:17:36.807 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2023-10-06T11:17:36.807 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2023-10-06T11:17:36.807 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2023-10-06T11:17:36.807 INFO:teuthology.orchestra.run.smithi146.stdout: mgr/telemetry/nag = false 2023-10-06T11:17:36.808 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.808 INFO:teuthology.orchestra.run.smithi146.stdout:[mon] 2023-10-06T11:17:36.808 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-10-06T11:17:36.808 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2023-10-06T11:17:36.808 INFO:teuthology.orchestra.run.smithi146.stdout: debug paxos = 20 2023-10-06T11:17:36.808 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2023-10-06T11:17:36.808 INFO:teuthology.orchestra.run.smithi146.stdout: mon data avail warn = 5 2023-10-06T11:17:36.808 INFO:teuthology.orchestra.run.smithi146.stdout: mon mgr mkfs grace = 240 2023-10-06T11:17:36.808 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2023-10-06T11:17:36.808 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd reporter subtree level = osd 2023-10-06T11:17:36.809 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd prime pg temp = true 2023-10-06T11:17:36.809 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2023-10-06T11:17:36.809 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.809 INFO:teuthology.orchestra.run.smithi146.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T11:17:36.809 INFO:teuthology.orchestra.run.smithi146.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T11:17:36.809 INFO:teuthology.orchestra.run.smithi146.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T11:17:36.809 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.809 INFO:teuthology.orchestra.run.smithi146.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T11:17:36.809 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T11:17:36.809 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T11:17:36.810 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.810 INFO:teuthology.orchestra.run.smithi146.stdout: # 1m isn't quite enough 2023-10-06T11:17:36.810 INFO:teuthology.orchestra.run.smithi146.stdout: mon_down_mkfs_grace = 2m 2023-10-06T11:17:36.810 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.811 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_filestore_osds = false 2023-10-06T11:17:36.811 INFO:teuthology.orchestra.run.smithi146.stdout: mon op complaint time = 120 2023-10-06T11:17:36.811 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.811 INFO:teuthology.orchestra.run.smithi146.stdout:[client] 2023-10-06T11:17:36.811 INFO:teuthology.orchestra.run.smithi146.stdout: rgw cache enabled = true 2023-10-06T11:17:36.811 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable ops log = true 2023-10-06T11:17:36.811 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable usage log = true 2023-10-06T11:17:36.811 INFO:teuthology.orchestra.run.smithi146.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T11:17:36.811 INFO:teuthology.orchestra.run.smithi146.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T11:17:36.811 INFO:teuthology.orchestra.run.smithi146.stdout: client mount timeout = 600 2023-10-06T11:17:36.811 INFO:teuthology.orchestra.run.smithi146.stdout: debug client = 20 2023-10-06T11:17:36.812 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-10-06T11:17:36.812 INFO:teuthology.orchestra.run.smithi146.stdout: pid file = "" 2023-10-06T11:17:36.812 INFO:teuthology.orchestra.run.smithi146.stdout: rados mon op timeout = 900 2023-10-06T11:17:36.812 INFO:teuthology.orchestra.run.smithi146.stdout: rados osd op timeout = 900 2023-10-06T11:17:36.812 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.a] 2023-10-06T11:17:36.812 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.b] 2023-10-06T11:17:36.812 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.c] 2023-10-06T11:17:36.813 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.a] 2023-10-06T11:17:36.813 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.c] 2023-10-06T11:17:36.814 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.b] 2023-10-06T11:17:36.814 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.d] 2023-10-06T11:17:36.814 INFO:teuthology.orchestra.run.smithi146.stdout:[mds] 2023-10-06T11:17:36.815 INFO:teuthology.orchestra.run.smithi146.stdout: debug mds = 20 2023-10-06T11:17:36.815 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-10-06T11:17:36.816 INFO:teuthology.orchestra.run.smithi146.stdout: mds cache max size = 1000 2023-10-06T11:17:36.816 INFO:teuthology.orchestra.run.smithi146.stdout: mds debug frag = True 2023-10-06T11:17:36.816 INFO:teuthology.orchestra.run.smithi146.stdout: mds debug scatterstat = True 2023-10-06T11:17:36.817 INFO:teuthology.orchestra.run.smithi146.stdout: mds log max segments = 1 2023-10-06T11:17:36.818 INFO:teuthology.orchestra.run.smithi146.stdout: mds op complaint time = 180 2023-10-06T11:17:36.818 INFO:teuthology.orchestra.run.smithi146.stdout: mds verify scatter = False 2023-10-06T11:17:36.818 INFO:teuthology.orchestra.run.smithi146.stdout: osd op complaint time = 180 2023-10-06T11:17:36.818 INFO:teuthology.orchestra.run.smithi146.stdout: rados mon op timeout = 900 2023-10-06T11:17:36.819 INFO:teuthology.orchestra.run.smithi146.stdout: rados osd op timeout = 900 2023-10-06T11:17:36.821 INFO:teuthology.orchestra.run.smithi151.stdout:[global] 2023-10-06T11:17:36.822 INFO:teuthology.orchestra.run.smithi151.stdout: chdir = "" 2023-10-06T11:17:36.822 INFO:teuthology.orchestra.run.smithi151.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T11:17:36.822 INFO:teuthology.orchestra.run.smithi151.stdout: auth supported = cephx 2023-10-06T11:17:36.822 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.822 INFO:teuthology.orchestra.run.smithi151.stdout: filestore xattr use omap = true 2023-10-06T11:17:36.822 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.822 INFO:teuthology.orchestra.run.smithi151.stdout: mon clock drift allowed = 1.000 2023-10-06T11:17:36.822 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.822 INFO:teuthology.orchestra.run.smithi151.stdout: osd crush chooseleaf type = 0 2023-10-06T11:17:36.822 INFO:teuthology.orchestra.run.smithi151.stdout: auth debug = true 2023-10-06T11:17:36.823 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.823 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on old message = true 2023-10-06T11:17:36.823 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on bug = true 2023-10-06T11:17:36.823 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.823 INFO:teuthology.orchestra.run.smithi151.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T11:17:36.823 INFO:teuthology.orchestra.run.smithi151.stdout: mon pg warn max object skew = 0 2023-10-06T11:17:36.823 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.823 INFO:teuthology.orchestra.run.smithi151.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T11:17:36.823 INFO:teuthology.orchestra.run.smithi151.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T11:17:36.823 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.823 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default size = 2 2023-10-06T11:17:36.824 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.824 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow primary affinity = true 2023-10-06T11:17:36.824 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow pg remap = true 2023-10-06T11:17:36.824 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on legacy crush tunables = false 2023-10-06T11:17:36.824 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on crush straw calc version zero = false 2023-10-06T11:17:36.824 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on no sortbitwise = false 2023-10-06T11:17:36.824 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on osd down out interval zero = false 2023-10-06T11:17:36.824 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on too few osds = false 2023-10-06T11:17:36.824 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T11:17:36.824 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T11:17:36.824 INFO:teuthology.orchestra.run.smithi151.stdout: mon_allow_pool_size_one = true 2023-10-06T11:17:36.824 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.825 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T11:17:36.825 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.825 INFO:teuthology.orchestra.run.smithi151.stdout: osd default data pool replay window = 5 2023-10-06T11:17:36.825 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.825 INFO:teuthology.orchestra.run.smithi151.stdout: mon allow pool delete = true 2023-10-06T11:17:36.825 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.825 INFO:teuthology.orchestra.run.smithi151.stdout: mon cluster log file level = debug 2023-10-06T11:17:36.825 INFO:teuthology.orchestra.run.smithi151.stdout: debug asserts on shutdown = true 2023-10-06T11:17:36.825 INFO:teuthology.orchestra.run.smithi151.stdout: mon health detail to clog = false 2023-10-06T11:17:36.825 INFO:teuthology.orchestra.run.smithi151.stdout: mon host = "172.21.15.146,172.21.15.151,[v2:172.21.15.151:3301,v1:172.21.15.151:6790]" 2023-10-06T11:17:36.826 INFO:teuthology.orchestra.run.smithi151.stdout: fsid = c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1 2023-10-06T11:17:36.826 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.826 INFO:teuthology.orchestra.run.smithi151.stdout:[osd] 2023-10-06T11:17:36.826 INFO:teuthology.orchestra.run.smithi151.stdout: osd journal size = 100 2023-10-06T11:17:36.826 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.826 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub load threshold = 5.0 2023-10-06T11:17:36.826 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub max interval = 600 2023-10-06T11:17:36.826 INFO:teuthology.orchestra.run.smithi151.stdout: osd mclock profile = high_recovery_ops 2023-10-06T11:17:36.827 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.827 INFO:teuthology.orchestra.run.smithi151.stdout: osd recover clone overlap = true 2023-10-06T11:17:36.827 INFO:teuthology.orchestra.run.smithi151.stdout: osd recovery max chunk = 1048576 2023-10-06T11:17:36.827 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.827 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug shutdown = true 2023-10-06T11:17:36.827 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug op order = true 2023-10-06T11:17:36.827 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug verify stray on activate = true 2023-10-06T11:17:36.827 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.827 INFO:teuthology.orchestra.run.smithi151.stdout: osd open classes on start = true 2023-10-06T11:17:36.827 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug pg log writeout = true 2023-10-06T11:17:36.828 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.828 INFO:teuthology.orchestra.run.smithi151.stdout: osd deep scrub update digest min age = 30 2023-10-06T11:17:36.828 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.828 INFO:teuthology.orchestra.run.smithi151.stdout: osd map max advance = 10 2023-10-06T11:17:36.828 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.828 INFO:teuthology.orchestra.run.smithi151.stdout: journal zero on create = true 2023-10-06T11:17:36.828 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.829 INFO:teuthology.orchestra.run.smithi151.stdout: filestore ondisk finisher threads = 3 2023-10-06T11:17:36.829 INFO:teuthology.orchestra.run.smithi151.stdout: filestore apply finisher threads = 3 2023-10-06T11:17:36.829 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.829 INFO:teuthology.orchestra.run.smithi151.stdout: bdev debug aio = true 2023-10-06T11:17:36.829 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug misdirected ops = true 2023-10-06T11:17:36.829 INFO:teuthology.orchestra.run.smithi151.stdout: bdev async discard = True 2023-10-06T11:17:36.829 INFO:teuthology.orchestra.run.smithi151.stdout: bdev enable discard = True 2023-10-06T11:17:36.829 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore allocator = bitmap 2023-10-06T11:17:36.829 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore block size = 96636764160 2023-10-06T11:17:36.829 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore fsck on mount = True 2023-10-06T11:17:36.830 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluefs = 1/20 2023-10-06T11:17:36.830 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluestore = 1/20 2023-10-06T11:17:36.830 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-10-06T11:17:36.830 INFO:teuthology.orchestra.run.smithi151.stdout: debug osd = 20 2023-10-06T11:17:36.830 INFO:teuthology.orchestra.run.smithi151.stdout: debug rocksdb = 4/10 2023-10-06T11:17:36.830 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T11:17:36.830 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd full ratio = 0.9 2023-10-06T11:17:36.830 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd nearfull ratio = 0.8 2023-10-06T11:17:36.830 INFO:teuthology.orchestra.run.smithi151.stdout: osd failsafe full ratio = 0.95 2023-10-06T11:17:36.830 INFO:teuthology.orchestra.run.smithi151.stdout: osd objectstore = bluestore 2023-10-06T11:17:36.830 INFO:teuthology.orchestra.run.smithi151.stdout: osd op complaint time = 180 2023-10-06T11:17:36.830 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.831 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr] 2023-10-06T11:17:36.831 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-10-06T11:17:36.831 INFO:teuthology.orchestra.run.smithi151.stdout: debug mgr = 20 2023-10-06T11:17:36.831 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2023-10-06T11:17:36.831 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2023-10-06T11:17:36.831 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2023-10-06T11:17:36.831 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2023-10-06T11:17:36.831 INFO:teuthology.orchestra.run.smithi151.stdout: mgr/telemetry/nag = false 2023-10-06T11:17:36.831 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.832 INFO:teuthology.orchestra.run.smithi151.stdout:[mon] 2023-10-06T11:17:36.832 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-10-06T11:17:36.832 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2023-10-06T11:17:36.832 INFO:teuthology.orchestra.run.smithi151.stdout: debug paxos = 20 2023-10-06T11:17:36.832 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2023-10-06T11:17:36.832 INFO:teuthology.orchestra.run.smithi151.stdout: mon data avail warn = 5 2023-10-06T11:17:36.832 INFO:teuthology.orchestra.run.smithi151.stdout: mon mgr mkfs grace = 240 2023-10-06T11:17:36.832 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2023-10-06T11:17:36.832 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd reporter subtree level = osd 2023-10-06T11:17:36.832 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd prime pg temp = true 2023-10-06T11:17:36.833 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2023-10-06T11:17:36.833 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.833 INFO:teuthology.orchestra.run.smithi151.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T11:17:36.833 INFO:teuthology.orchestra.run.smithi151.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T11:17:36.833 INFO:teuthology.orchestra.run.smithi151.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T11:17:36.833 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.833 INFO:teuthology.orchestra.run.smithi151.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T11:17:36.833 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T11:17:36.833 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T11:17:36.833 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.834 INFO:teuthology.orchestra.run.smithi151.stdout: # 1m isn't quite enough 2023-10-06T11:17:36.834 INFO:teuthology.orchestra.run.smithi151.stdout: mon_down_mkfs_grace = 2m 2023-10-06T11:17:36.834 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.834 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_filestore_osds = false 2023-10-06T11:17:36.834 INFO:teuthology.orchestra.run.smithi151.stdout: mon op complaint time = 120 2023-10-06T11:17:36.834 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.834 INFO:teuthology.orchestra.run.smithi151.stdout:[client] 2023-10-06T11:17:36.834 INFO:teuthology.orchestra.run.smithi151.stdout: rgw cache enabled = true 2023-10-06T11:17:36.834 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable ops log = true 2023-10-06T11:17:36.834 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable usage log = true 2023-10-06T11:17:36.834 INFO:teuthology.orchestra.run.smithi151.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T11:17:36.834 INFO:teuthology.orchestra.run.smithi151.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T11:17:36.835 INFO:teuthology.orchestra.run.smithi151.stdout: client mount timeout = 600 2023-10-06T11:17:36.835 INFO:teuthology.orchestra.run.smithi151.stdout: debug client = 20 2023-10-06T11:17:36.835 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-10-06T11:17:36.835 INFO:teuthology.orchestra.run.smithi151.stdout: pid file = "" 2023-10-06T11:17:36.835 INFO:teuthology.orchestra.run.smithi151.stdout: rados mon op timeout = 900 2023-10-06T11:17:36.835 INFO:teuthology.orchestra.run.smithi151.stdout: rados osd op timeout = 900 2023-10-06T11:17:36.835 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.a] 2023-10-06T11:17:36.835 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.b] 2023-10-06T11:17:36.835 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.c] 2023-10-06T11:17:36.835 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.a] 2023-10-06T11:17:36.835 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.c] 2023-10-06T11:17:36.835 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.b] 2023-10-06T11:17:36.836 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.d] 2023-10-06T11:17:36.836 INFO:teuthology.orchestra.run.smithi151.stdout:[mds] 2023-10-06T11:17:36.836 INFO:teuthology.orchestra.run.smithi151.stdout: debug mds = 20 2023-10-06T11:17:36.836 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-10-06T11:17:36.836 INFO:teuthology.orchestra.run.smithi151.stdout: mds cache max size = 1000 2023-10-06T11:17:36.836 INFO:teuthology.orchestra.run.smithi151.stdout: mds debug frag = True 2023-10-06T11:17:36.836 INFO:teuthology.orchestra.run.smithi151.stdout: mds debug scatterstat = True 2023-10-06T11:17:36.836 INFO:teuthology.orchestra.run.smithi151.stdout: mds log max segments = 1 2023-10-06T11:17:36.836 INFO:teuthology.orchestra.run.smithi151.stdout: mds op complaint time = 180 2023-10-06T11:17:36.836 INFO:teuthology.orchestra.run.smithi151.stdout: mds verify scatter = False 2023-10-06T11:17:36.836 INFO:teuthology.orchestra.run.smithi151.stdout: osd op complaint time = 180 2023-10-06T11:17:36.836 INFO:teuthology.orchestra.run.smithi151.stdout: rados mon op timeout = 900 2023-10-06T11:17:36.836 INFO:teuthology.orchestra.run.smithi151.stdout: rados osd op timeout = 900 2023-10-06T11:17:36.838 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T11:17:36.864 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T11:17:36.905 INFO:teuthology.orchestra.run.smithi146.stdout:[global] 2023-10-06T11:17:36.905 INFO:teuthology.orchestra.run.smithi146.stdout: chdir = "" 2023-10-06T11:17:36.905 INFO:teuthology.orchestra.run.smithi146.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T11:17:36.905 INFO:teuthology.orchestra.run.smithi146.stdout: auth supported = cephx 2023-10-06T11:17:36.906 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.906 INFO:teuthology.orchestra.run.smithi146.stdout: filestore xattr use omap = true 2023-10-06T11:17:36.906 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.906 INFO:teuthology.orchestra.run.smithi146.stdout: mon clock drift allowed = 1.000 2023-10-06T11:17:36.906 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.906 INFO:teuthology.orchestra.run.smithi146.stdout: osd crush chooseleaf type = 0 2023-10-06T11:17:36.906 INFO:teuthology.orchestra.run.smithi146.stdout: auth debug = true 2023-10-06T11:17:36.906 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.906 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on old message = true 2023-10-06T11:17:36.906 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on bug = true 2023-10-06T11:17:36.906 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.906 INFO:teuthology.orchestra.run.smithi146.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T11:17:36.907 INFO:teuthology.orchestra.run.smithi146.stdout: mon pg warn max object skew = 0 2023-10-06T11:17:36.907 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.907 INFO:teuthology.orchestra.run.smithi146.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T11:17:36.907 INFO:teuthology.orchestra.run.smithi146.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T11:17:36.907 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.907 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default size = 2 2023-10-06T11:17:36.907 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.907 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow primary affinity = true 2023-10-06T11:17:36.907 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow pg remap = true 2023-10-06T11:17:36.907 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on legacy crush tunables = false 2023-10-06T11:17:36.907 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on crush straw calc version zero = false 2023-10-06T11:17:36.907 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on no sortbitwise = false 2023-10-06T11:17:36.908 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on osd down out interval zero = false 2023-10-06T11:17:36.908 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on too few osds = false 2023-10-06T11:17:36.908 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T11:17:36.908 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T11:17:36.908 INFO:teuthology.orchestra.run.smithi146.stdout: mon_allow_pool_size_one = true 2023-10-06T11:17:36.908 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.908 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T11:17:36.908 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.908 INFO:teuthology.orchestra.run.smithi146.stdout: osd default data pool replay window = 5 2023-10-06T11:17:36.908 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.908 INFO:teuthology.orchestra.run.smithi146.stdout: mon allow pool delete = true 2023-10-06T11:17:36.908 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.908 INFO:teuthology.orchestra.run.smithi146.stdout: mon cluster log file level = debug 2023-10-06T11:17:36.909 INFO:teuthology.orchestra.run.smithi146.stdout: debug asserts on shutdown = true 2023-10-06T11:17:36.909 INFO:teuthology.orchestra.run.smithi146.stdout: mon health detail to clog = false 2023-10-06T11:17:36.909 INFO:teuthology.orchestra.run.smithi146.stdout: mon host = "172.21.15.146,172.21.15.151,[v2:172.21.15.151:3301,v1:172.21.15.151:6790]" 2023-10-06T11:17:36.909 INFO:teuthology.orchestra.run.smithi146.stdout: fsid = c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1 2023-10-06T11:17:36.909 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.909 INFO:teuthology.orchestra.run.smithi146.stdout:[osd] 2023-10-06T11:17:36.909 INFO:teuthology.orchestra.run.smithi146.stdout: osd journal size = 100 2023-10-06T11:17:36.909 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.909 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub load threshold = 5.0 2023-10-06T11:17:36.909 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub max interval = 600 2023-10-06T11:17:36.909 INFO:teuthology.orchestra.run.smithi146.stdout: osd mclock profile = high_recovery_ops 2023-10-06T11:17:36.909 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.909 INFO:teuthology.orchestra.run.smithi146.stdout: osd recover clone overlap = true 2023-10-06T11:17:36.910 INFO:teuthology.orchestra.run.smithi146.stdout: osd recovery max chunk = 1048576 2023-10-06T11:17:36.910 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.910 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug shutdown = true 2023-10-06T11:17:36.910 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug op order = true 2023-10-06T11:17:36.910 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug verify stray on activate = true 2023-10-06T11:17:36.910 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.910 INFO:teuthology.orchestra.run.smithi146.stdout: osd open classes on start = true 2023-10-06T11:17:36.910 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug pg log writeout = true 2023-10-06T11:17:36.910 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.910 INFO:teuthology.orchestra.run.smithi146.stdout: osd deep scrub update digest min age = 30 2023-10-06T11:17:36.910 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.910 INFO:teuthology.orchestra.run.smithi146.stdout: osd map max advance = 10 2023-10-06T11:17:36.910 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.911 INFO:teuthology.orchestra.run.smithi146.stdout: journal zero on create = true 2023-10-06T11:17:36.911 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.911 INFO:teuthology.orchestra.run.smithi146.stdout: filestore ondisk finisher threads = 3 2023-10-06T11:17:36.911 INFO:teuthology.orchestra.run.smithi146.stdout: filestore apply finisher threads = 3 2023-10-06T11:17:36.911 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.911 INFO:teuthology.orchestra.run.smithi146.stdout: bdev debug aio = true 2023-10-06T11:17:36.911 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug misdirected ops = true 2023-10-06T11:17:36.911 INFO:teuthology.orchestra.run.smithi146.stdout: bdev async discard = True 2023-10-06T11:17:36.911 INFO:teuthology.orchestra.run.smithi146.stdout: bdev enable discard = True 2023-10-06T11:17:36.911 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore allocator = bitmap 2023-10-06T11:17:36.911 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore block size = 96636764160 2023-10-06T11:17:36.911 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore fsck on mount = True 2023-10-06T11:17:36.911 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluefs = 1/20 2023-10-06T11:17:36.912 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluestore = 1/20 2023-10-06T11:17:36.912 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-10-06T11:17:36.912 INFO:teuthology.orchestra.run.smithi146.stdout: debug osd = 20 2023-10-06T11:17:36.912 INFO:teuthology.orchestra.run.smithi146.stdout: debug rocksdb = 4/10 2023-10-06T11:17:36.912 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T11:17:36.912 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd full ratio = 0.9 2023-10-06T11:17:36.912 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd nearfull ratio = 0.8 2023-10-06T11:17:36.912 INFO:teuthology.orchestra.run.smithi146.stdout: osd failsafe full ratio = 0.95 2023-10-06T11:17:36.912 INFO:teuthology.orchestra.run.smithi146.stdout: osd objectstore = bluestore 2023-10-06T11:17:36.912 INFO:teuthology.orchestra.run.smithi146.stdout: osd op complaint time = 180 2023-10-06T11:17:36.912 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.912 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr] 2023-10-06T11:17:36.912 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-10-06T11:17:36.913 INFO:teuthology.orchestra.run.smithi146.stdout: debug mgr = 20 2023-10-06T11:17:36.913 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2023-10-06T11:17:36.913 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2023-10-06T11:17:36.913 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2023-10-06T11:17:36.913 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2023-10-06T11:17:36.913 INFO:teuthology.orchestra.run.smithi146.stdout: mgr/telemetry/nag = false 2023-10-06T11:17:36.913 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.913 INFO:teuthology.orchestra.run.smithi146.stdout:[mon] 2023-10-06T11:17:36.913 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-10-06T11:17:36.913 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2023-10-06T11:17:36.913 INFO:teuthology.orchestra.run.smithi146.stdout: debug paxos = 20 2023-10-06T11:17:36.913 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2023-10-06T11:17:36.913 INFO:teuthology.orchestra.run.smithi146.stdout: mon data avail warn = 5 2023-10-06T11:17:36.914 INFO:teuthology.orchestra.run.smithi146.stdout: mon mgr mkfs grace = 240 2023-10-06T11:17:36.914 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2023-10-06T11:17:36.914 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd reporter subtree level = osd 2023-10-06T11:17:36.914 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd prime pg temp = true 2023-10-06T11:17:36.914 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2023-10-06T11:17:36.914 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.914 INFO:teuthology.orchestra.run.smithi146.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T11:17:36.914 INFO:teuthology.orchestra.run.smithi146.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T11:17:36.914 INFO:teuthology.orchestra.run.smithi146.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T11:17:36.914 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.914 INFO:teuthology.orchestra.run.smithi146.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T11:17:36.914 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T11:17:36.915 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T11:17:36.915 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.915 INFO:teuthology.orchestra.run.smithi146.stdout: # 1m isn't quite enough 2023-10-06T11:17:36.915 INFO:teuthology.orchestra.run.smithi146.stdout: mon_down_mkfs_grace = 2m 2023-10-06T11:17:36.915 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.915 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_filestore_osds = false 2023-10-06T11:17:36.915 INFO:teuthology.orchestra.run.smithi146.stdout: mon op complaint time = 120 2023-10-06T11:17:36.915 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:36.915 INFO:teuthology.orchestra.run.smithi146.stdout:[client] 2023-10-06T11:17:36.915 INFO:teuthology.orchestra.run.smithi146.stdout: rgw cache enabled = true 2023-10-06T11:17:36.915 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable ops log = true 2023-10-06T11:17:36.915 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable usage log = true 2023-10-06T11:17:36.915 INFO:teuthology.orchestra.run.smithi146.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T11:17:36.916 INFO:teuthology.orchestra.run.smithi146.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T11:17:36.916 INFO:teuthology.orchestra.run.smithi146.stdout: client mount timeout = 600 2023-10-06T11:17:36.916 INFO:teuthology.orchestra.run.smithi146.stdout: debug client = 20 2023-10-06T11:17:36.916 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-10-06T11:17:36.916 INFO:teuthology.orchestra.run.smithi146.stdout: pid file = "" 2023-10-06T11:17:36.916 INFO:teuthology.orchestra.run.smithi146.stdout: rados mon op timeout = 900 2023-10-06T11:17:36.916 INFO:teuthology.orchestra.run.smithi146.stdout: rados osd op timeout = 900 2023-10-06T11:17:36.916 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.a] 2023-10-06T11:17:36.916 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.b] 2023-10-06T11:17:36.916 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.c] 2023-10-06T11:17:36.916 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.a] 2023-10-06T11:17:36.916 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.c] 2023-10-06T11:17:36.916 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.b] 2023-10-06T11:17:36.917 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.d] 2023-10-06T11:17:36.917 INFO:teuthology.orchestra.run.smithi146.stdout:[mds] 2023-10-06T11:17:36.917 INFO:teuthology.orchestra.run.smithi146.stdout: debug mds = 20 2023-10-06T11:17:36.917 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-10-06T11:17:36.917 INFO:teuthology.orchestra.run.smithi146.stdout: mds cache max size = 1000 2023-10-06T11:17:36.917 INFO:teuthology.orchestra.run.smithi146.stdout: mds debug frag = True 2023-10-06T11:17:36.917 INFO:teuthology.orchestra.run.smithi146.stdout: mds debug scatterstat = False 2023-10-06T11:17:36.917 INFO:teuthology.orchestra.run.smithi146.stdout: mds log max segments = 1 2023-10-06T11:17:36.917 INFO:teuthology.orchestra.run.smithi146.stdout: mds op complaint time = 180 2023-10-06T11:17:36.917 INFO:teuthology.orchestra.run.smithi146.stdout: mds verify scatter = False 2023-10-06T11:17:36.917 INFO:teuthology.orchestra.run.smithi146.stdout: osd op complaint time = 180 2023-10-06T11:17:36.917 INFO:teuthology.orchestra.run.smithi146.stdout: rados mon op timeout = 900 2023-10-06T11:17:36.917 INFO:teuthology.orchestra.run.smithi146.stdout: rados osd op timeout = 900 2023-10-06T11:17:36.918 INFO:teuthology.orchestra.run.smithi151.stdout:[global] 2023-10-06T11:17:36.918 INFO:teuthology.orchestra.run.smithi151.stdout: chdir = "" 2023-10-06T11:17:36.918 INFO:teuthology.orchestra.run.smithi151.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T11:17:36.919 INFO:teuthology.orchestra.run.smithi151.stdout: auth supported = cephx 2023-10-06T11:17:36.919 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.919 INFO:teuthology.orchestra.run.smithi151.stdout: filestore xattr use omap = true 2023-10-06T11:17:36.919 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.919 INFO:teuthology.orchestra.run.smithi151.stdout: mon clock drift allowed = 1.000 2023-10-06T11:17:36.919 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.919 INFO:teuthology.orchestra.run.smithi151.stdout: osd crush chooseleaf type = 0 2023-10-06T11:17:36.919 INFO:teuthology.orchestra.run.smithi151.stdout: auth debug = true 2023-10-06T11:17:36.919 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.919 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on old message = true 2023-10-06T11:17:36.919 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on bug = true 2023-10-06T11:17:36.919 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.919 INFO:teuthology.orchestra.run.smithi151.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T11:17:36.920 INFO:teuthology.orchestra.run.smithi151.stdout: mon pg warn max object skew = 0 2023-10-06T11:17:36.920 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.920 INFO:teuthology.orchestra.run.smithi151.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T11:17:36.920 INFO:teuthology.orchestra.run.smithi151.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T11:17:36.920 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.920 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default size = 2 2023-10-06T11:17:36.920 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.920 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow primary affinity = true 2023-10-06T11:17:36.920 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow pg remap = true 2023-10-06T11:17:36.920 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on legacy crush tunables = false 2023-10-06T11:17:36.920 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on crush straw calc version zero = false 2023-10-06T11:17:36.920 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on no sortbitwise = false 2023-10-06T11:17:36.921 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on osd down out interval zero = false 2023-10-06T11:17:36.921 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on too few osds = false 2023-10-06T11:17:36.921 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T11:17:36.921 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T11:17:36.921 INFO:teuthology.orchestra.run.smithi151.stdout: mon_allow_pool_size_one = true 2023-10-06T11:17:36.921 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.921 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T11:17:36.921 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.921 INFO:teuthology.orchestra.run.smithi151.stdout: osd default data pool replay window = 5 2023-10-06T11:17:36.921 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.921 INFO:teuthology.orchestra.run.smithi151.stdout: mon allow pool delete = true 2023-10-06T11:17:36.921 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.921 INFO:teuthology.orchestra.run.smithi151.stdout: mon cluster log file level = debug 2023-10-06T11:17:36.922 INFO:teuthology.orchestra.run.smithi151.stdout: debug asserts on shutdown = true 2023-10-06T11:17:36.922 INFO:teuthology.orchestra.run.smithi151.stdout: mon health detail to clog = false 2023-10-06T11:17:36.922 INFO:teuthology.orchestra.run.smithi151.stdout: mon host = "172.21.15.146,172.21.15.151,[v2:172.21.15.151:3301,v1:172.21.15.151:6790]" 2023-10-06T11:17:36.922 INFO:teuthology.orchestra.run.smithi151.stdout: fsid = c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1 2023-10-06T11:17:36.922 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.922 INFO:teuthology.orchestra.run.smithi151.stdout:[osd] 2023-10-06T11:17:36.922 INFO:teuthology.orchestra.run.smithi151.stdout: osd journal size = 100 2023-10-06T11:17:36.922 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.922 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub load threshold = 5.0 2023-10-06T11:17:36.922 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub max interval = 600 2023-10-06T11:17:36.922 INFO:teuthology.orchestra.run.smithi151.stdout: osd mclock profile = high_recovery_ops 2023-10-06T11:17:36.922 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.923 INFO:teuthology.orchestra.run.smithi151.stdout: osd recover clone overlap = true 2023-10-06T11:17:36.923 INFO:teuthology.orchestra.run.smithi151.stdout: osd recovery max chunk = 1048576 2023-10-06T11:17:36.923 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.923 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug shutdown = true 2023-10-06T11:17:36.923 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug op order = true 2023-10-06T11:17:36.923 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug verify stray on activate = true 2023-10-06T11:17:36.923 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.923 INFO:teuthology.orchestra.run.smithi151.stdout: osd open classes on start = true 2023-10-06T11:17:36.923 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug pg log writeout = true 2023-10-06T11:17:36.923 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.923 INFO:teuthology.orchestra.run.smithi151.stdout: osd deep scrub update digest min age = 30 2023-10-06T11:17:36.923 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.923 INFO:teuthology.orchestra.run.smithi151.stdout: osd map max advance = 10 2023-10-06T11:17:36.924 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.924 INFO:teuthology.orchestra.run.smithi151.stdout: journal zero on create = true 2023-10-06T11:17:36.924 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.924 INFO:teuthology.orchestra.run.smithi151.stdout: filestore ondisk finisher threads = 3 2023-10-06T11:17:36.924 INFO:teuthology.orchestra.run.smithi151.stdout: filestore apply finisher threads = 3 2023-10-06T11:17:36.924 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.924 INFO:teuthology.orchestra.run.smithi151.stdout: bdev debug aio = true 2023-10-06T11:17:36.924 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug misdirected ops = true 2023-10-06T11:17:36.924 INFO:teuthology.orchestra.run.smithi151.stdout: bdev async discard = True 2023-10-06T11:17:36.924 INFO:teuthology.orchestra.run.smithi151.stdout: bdev enable discard = True 2023-10-06T11:17:36.924 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore allocator = bitmap 2023-10-06T11:17:36.924 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore block size = 96636764160 2023-10-06T11:17:36.925 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore fsck on mount = True 2023-10-06T11:17:36.925 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluefs = 1/20 2023-10-06T11:17:36.925 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluestore = 1/20 2023-10-06T11:17:36.925 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-10-06T11:17:36.925 INFO:teuthology.orchestra.run.smithi151.stdout: debug osd = 20 2023-10-06T11:17:36.925 INFO:teuthology.orchestra.run.smithi151.stdout: debug rocksdb = 4/10 2023-10-06T11:17:36.925 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T11:17:36.925 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd full ratio = 0.9 2023-10-06T11:17:36.925 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd nearfull ratio = 0.8 2023-10-06T11:17:36.925 INFO:teuthology.orchestra.run.smithi151.stdout: osd failsafe full ratio = 0.95 2023-10-06T11:17:36.925 INFO:teuthology.orchestra.run.smithi151.stdout: osd objectstore = bluestore 2023-10-06T11:17:36.925 INFO:teuthology.orchestra.run.smithi151.stdout: osd op complaint time = 180 2023-10-06T11:17:36.925 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.926 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr] 2023-10-06T11:17:36.926 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-10-06T11:17:36.926 INFO:teuthology.orchestra.run.smithi151.stdout: debug mgr = 20 2023-10-06T11:17:36.926 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2023-10-06T11:17:36.926 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2023-10-06T11:17:36.926 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2023-10-06T11:17:36.926 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2023-10-06T11:17:36.926 INFO:teuthology.orchestra.run.smithi151.stdout: mgr/telemetry/nag = false 2023-10-06T11:17:36.926 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.926 INFO:teuthology.orchestra.run.smithi151.stdout:[mon] 2023-10-06T11:17:36.926 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-10-06T11:17:36.926 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2023-10-06T11:17:36.927 INFO:teuthology.orchestra.run.smithi151.stdout: debug paxos = 20 2023-10-06T11:17:36.927 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2023-10-06T11:17:36.927 INFO:teuthology.orchestra.run.smithi151.stdout: mon data avail warn = 5 2023-10-06T11:17:36.927 INFO:teuthology.orchestra.run.smithi151.stdout: mon mgr mkfs grace = 240 2023-10-06T11:17:36.927 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2023-10-06T11:17:36.927 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd reporter subtree level = osd 2023-10-06T11:17:36.927 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd prime pg temp = true 2023-10-06T11:17:36.927 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2023-10-06T11:17:36.927 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.927 INFO:teuthology.orchestra.run.smithi151.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T11:17:36.927 INFO:teuthology.orchestra.run.smithi151.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T11:17:36.927 INFO:teuthology.orchestra.run.smithi151.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T11:17:36.927 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.928 INFO:teuthology.orchestra.run.smithi151.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T11:17:36.928 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T11:17:36.928 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T11:17:36.928 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.928 INFO:teuthology.orchestra.run.smithi151.stdout: # 1m isn't quite enough 2023-10-06T11:17:36.928 INFO:teuthology.orchestra.run.smithi151.stdout: mon_down_mkfs_grace = 2m 2023-10-06T11:17:36.928 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.928 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_filestore_osds = false 2023-10-06T11:17:36.928 INFO:teuthology.orchestra.run.smithi151.stdout: mon op complaint time = 120 2023-10-06T11:17:36.928 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:17:36.928 INFO:teuthology.orchestra.run.smithi151.stdout:[client] 2023-10-06T11:17:36.928 INFO:teuthology.orchestra.run.smithi151.stdout: rgw cache enabled = true 2023-10-06T11:17:36.928 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable ops log = true 2023-10-06T11:17:36.929 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable usage log = true 2023-10-06T11:17:36.929 INFO:teuthology.orchestra.run.smithi151.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T11:17:36.929 INFO:teuthology.orchestra.run.smithi151.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T11:17:36.929 INFO:teuthology.orchestra.run.smithi151.stdout: client mount timeout = 600 2023-10-06T11:17:36.929 INFO:teuthology.orchestra.run.smithi151.stdout: debug client = 20 2023-10-06T11:17:36.929 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-10-06T11:17:36.929 INFO:teuthology.orchestra.run.smithi151.stdout: pid file = "" 2023-10-06T11:17:36.929 INFO:teuthology.orchestra.run.smithi151.stdout: rados mon op timeout = 900 2023-10-06T11:17:36.929 INFO:teuthology.orchestra.run.smithi151.stdout: rados osd op timeout = 900 2023-10-06T11:17:36.929 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.a] 2023-10-06T11:17:36.929 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.b] 2023-10-06T11:17:36.929 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.c] 2023-10-06T11:17:36.930 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.a] 2023-10-06T11:17:36.930 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.c] 2023-10-06T11:17:36.930 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.b] 2023-10-06T11:17:36.930 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.d] 2023-10-06T11:17:36.930 INFO:teuthology.orchestra.run.smithi151.stdout:[mds] 2023-10-06T11:17:36.930 INFO:teuthology.orchestra.run.smithi151.stdout: debug mds = 20 2023-10-06T11:17:36.930 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-10-06T11:17:36.930 INFO:teuthology.orchestra.run.smithi151.stdout: mds cache max size = 1000 2023-10-06T11:17:36.930 INFO:teuthology.orchestra.run.smithi151.stdout: mds debug frag = True 2023-10-06T11:17:36.930 INFO:teuthology.orchestra.run.smithi151.stdout: mds debug scatterstat = False 2023-10-06T11:17:36.930 INFO:teuthology.orchestra.run.smithi151.stdout: mds log max segments = 1 2023-10-06T11:17:36.930 INFO:teuthology.orchestra.run.smithi151.stdout: mds op complaint time = 180 2023-10-06T11:17:36.930 INFO:teuthology.orchestra.run.smithi151.stdout: mds verify scatter = False 2023-10-06T11:17:36.931 INFO:teuthology.orchestra.run.smithi151.stdout: osd op complaint time = 180 2023-10-06T11:17:36.931 INFO:teuthology.orchestra.run.smithi151.stdout: rados mon op timeout = 900 2023-10-06T11:17:36.931 INFO:teuthology.orchestra.run.smithi151.stdout: rados osd op timeout = 900 2023-10-06T11:17:36.932 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T11:17:36.932 DEBUG:teuthology.orchestra.run.smithi146:> import os 2023-10-06T11:17:36.932 DEBUG:teuthology.orchestra.run.smithi146:> import stat 2023-10-06T11:17:36.932 DEBUG:teuthology.orchestra.run.smithi146:> import json 2023-10-06T11:17:36.933 DEBUG:teuthology.orchestra.run.smithi146:> import sys 2023-10-06T11:17:36.933 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:17:36.933 DEBUG:teuthology.orchestra.run.smithi146:> try: 2023-10-06T11:17:36.933 DEBUG:teuthology.orchestra.run.smithi146:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/sixmegs'"'"') 2023-10-06T11:17:36.933 DEBUG:teuthology.orchestra.run.smithi146:> except OSError as e: 2023-10-06T11:17:36.933 DEBUG:teuthology.orchestra.run.smithi146:> sys.exit(e.errno) 2023-10-06T11:17:36.933 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:17:36.933 DEBUG:teuthology.orchestra.run.smithi146:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2023-10-06T11:17:36.933 DEBUG:teuthology.orchestra.run.smithi146:> print(json.dumps( 2023-10-06T11:17:36.933 DEBUG:teuthology.orchestra.run.smithi146:> dict([(a, getattr(s, a)) for a in attrs]), 2023-10-06T11:17:36.933 DEBUG:teuthology.orchestra.run.smithi146:> indent=2)) 2023-10-06T11:17:36.933 DEBUG:teuthology.orchestra.run.smithi146:> ' 2023-10-06T11:17:37.040 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:17:37.040 INFO:teuthology.orchestra.run.smithi146.stdout: "st_mode": 33204, 2023-10-06T11:17:37.040 INFO:teuthology.orchestra.run.smithi146.stdout: "st_ino": 1099511627777, 2023-10-06T11:17:37.040 INFO:teuthology.orchestra.run.smithi146.stdout: "st_dev": 46, 2023-10-06T11:17:37.040 INFO:teuthology.orchestra.run.smithi146.stdout: "st_nlink": 1, 2023-10-06T11:17:37.040 INFO:teuthology.orchestra.run.smithi146.stdout: "st_uid": 1000, 2023-10-06T11:17:37.041 INFO:teuthology.orchestra.run.smithi146.stdout: "st_gid": 1275, 2023-10-06T11:17:37.041 INFO:teuthology.orchestra.run.smithi146.stdout: "st_size": 6291456, 2023-10-06T11:17:37.041 INFO:teuthology.orchestra.run.smithi146.stdout: "st_atime": 1696591056.6947634, 2023-10-06T11:17:37.041 INFO:teuthology.orchestra.run.smithi146.stdout: "st_mtime": 1696591056.732844, 2023-10-06T11:17:37.041 INFO:teuthology.orchestra.run.smithi146.stdout: "st_ctime": 1696591056.732844 2023-10-06T11:17:37.041 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:17:37.225 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:17:37.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.379+0000 7fa8a63a2700 1 Processor -- start 2023-10-06T11:17:37.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.379+0000 7fa8a63a2700 1 -- start start 2023-10-06T11:17:37.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.380+0000 7fa8a63a2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa8a0143040 0x7fa8a00b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:37.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.380+0000 7fa8a63a2700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa8a00b5430 0x7fa8a00b2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:37.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.380+0000 7fa8a63a2700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a00cf100 con 0x7fa8a0143410 2023-10-06T11:17:37.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.380+0000 7fa8a63a2700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8a00b4170 con 0x7fa8a0143040 2023-10-06T11:17:37.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.380+0000 7fa8a63a2700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8a00b5f50 con 0x7fa8a00b5430 2023-10-06T11:17:37.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.380+0000 7fa8a53a0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa8a0143040 0x7fa8a00b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:37.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.380+0000 7fa8a4b9f700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa8a0143410 0x7fa8a00b4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:37328/0 (socket says 172.21.15.146:37328) 2023-10-06T11:17:37.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.380+0000 7fa8a4b9f700 1 -- 172.21.15.146:0/3177964773 learned_addr learned my addr 172.21.15.146:0/3177964773 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:17:37.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.380+0000 7fa8a53a0700 1 --2- 172.21.15.146:0/3177964773 >> v2:172.21.15.146:3300/0 conn(0x7fa8a0143040 0x7fa8a00b1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46004/0 (socket says 172.21.15.146:46004) 2023-10-06T11:17:37.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.380+0000 7fa8a5ba1700 1 --2- 172.21.15.146:0/3177964773 >> v2:172.21.15.151:3300/0 conn(0x7fa8a00b5430 0x7fa8a00b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:37.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.380+0000 7fa8a53a0700 1 -- 172.21.15.146:0/3177964773 >> v2:172.21.15.151:3300/0 conn(0x7fa8a00b5430 msgr2=0x7fa8a00b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:37.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.380+0000 7fa8a53a0700 1 --2- 172.21.15.146:0/3177964773 >> v2:172.21.15.151:3300/0 conn(0x7fa8a00b5430 0x7fa8a00b2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:37.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.380+0000 7fa8a53a0700 1 -- 172.21.15.146:0/3177964773 >> v1:172.21.15.146:6789/0 conn(0x7fa8a0143410 legacy=0x7fa8a00b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:37.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.380+0000 7fa8a53a0700 1 -- 172.21.15.146:0/3177964773 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a00ceb30 con 0x7fa8a0143040 2023-10-06T11:17:37.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.380+0000 7fa897fff700 1 -- 172.21.15.146:0/3177964773 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 612540062 0 0) 0x7fa8a00cf100 con 0x7fa8a0143410 2023-10-06T11:17:37.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.380+0000 7fa8a5ba1700 1 --2- 172.21.15.146:0/3177964773 >> v2:172.21.15.151:3300/0 conn(0x7fa8a00b5430 0x7fa8a00b2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:17:37.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.380+0000 7fa8a53a0700 1 --2- 172.21.15.146:0/3177964773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8a0143040 0x7fa8a00b1e20 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0159d50 tx=0x7fa89c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34d25e646b1d7008 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:37.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.380+0000 7fa897fff700 1 -- 172.21.15.146:0/3177964773 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89c00b6b0 con 0x7fa8a0143040 2023-10-06T11:17:37.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.381+0000 7fa897fff700 1 -- 172.21.15.146:0/3177964773 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89c00b810 con 0x7fa8a0143040 2023-10-06T11:17:37.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.381+0000 7fa897fff700 1 -- 172.21.15.146:0/3177964773 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89c00bbb0 con 0x7fa8a0143040 2023-10-06T11:17:37.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.381+0000 7fa8a63a2700 1 -- 172.21.15.146:0/3177964773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8a0143040 msgr2=0x7fa8a00b1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:37.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.381+0000 7fa8a63a2700 1 --2- 172.21.15.146:0/3177964773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8a0143040 0x7fa8a00b1e20 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0159d50 tx=0x7fa89c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:17:37.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.381+0000 7fa8a63a2700 1 -- 172.21.15.146:0/3177964773 shutdown_connections 2023-10-06T11:17:37.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.381+0000 7fa8a63a2700 1 --2- 172.21.15.146:0/3177964773 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8a0143040 0x7fa8a00b1e20 unknown :-1 s=CLOSED pgs=1980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:37.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.381+0000 7fa8a63a2700 1 --2- 172.21.15.146:0/3177964773 >> v2:172.21.15.151:3300/0 conn(0x7fa8a00b5430 0x7fa8a00b2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:37.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.381+0000 7fa8a63a2700 1 -- 172.21.15.146:0/3177964773 >> 172.21.15.146:0/3177964773 conn(0x7fa8a006eb10 msgr2=0x7fa8a006ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:37.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.381+0000 7fa8a63a2700 1 -- 172.21.15.146:0/3177964773 shutdown_connections 2023-10-06T11:17:37.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.381+0000 7fa8a63a2700 1 -- 172.21.15.146:0/3177964773 wait complete. 2023-10-06T11:17:37.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.382+0000 7fa8a63a2700 1 Processor -- start 2023-10-06T11:17:37.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.382+0000 7fa8a63a2700 1 -- start start 2023-10-06T11:17:37.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.383+0000 7fa8a63a2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8a00b5430 0x7fa8a015e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:37.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.383+0000 7fa8a63a2700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8a0143040 0x7fa8a0169d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:37.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.383+0000 7fa8a63a2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8a0143410 0x7fa8a015c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:37.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.383+0000 7fa8a63a2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a015c350 con 0x7fa8a0143410 2023-10-06T11:17:37.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.383+0000 7fa8a63a2700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a015c020 con 0x7fa8a00b5430 2023-10-06T11:17:37.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.383+0000 7fa8a63a2700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a016a700 con 0x7fa8a0143040 2023-10-06T11:17:37.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.383+0000 7fa8a5ba1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8a0143410 0x7fa8a015c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:37.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.383+0000 7fa8a5ba1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8a0143410 0x7fa8a015c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46012/0 (socket says 172.21.15.146:46012) 2023-10-06T11:17:37.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.383+0000 7fa8a5ba1700 1 -- 172.21.15.146:0/3519440063 learned_addr learned my addr 172.21.15.146:0/3519440063 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:37.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.383+0000 7fa8a53a0700 1 --2- 172.21.15.146:0/3519440063 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8a00b5430 0x7fa8a015e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:37.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.383+0000 7fa8a4b9f700 1 --2- 172.21.15.146:0/3519440063 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8a0143040 0x7fa8a0169d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:37.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.383+0000 7fa8a5ba1700 1 -- 172.21.15.146:0/3519440063 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8a0143040 msgr2=0x7fa8a0169d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:37.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.383+0000 7fa8a5ba1700 1 --2- 172.21.15.146:0/3519440063 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8a0143040 0x7fa8a0169d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:37.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.383+0000 7fa8a5ba1700 1 -- 172.21.15.146:0/3519440063 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8a00b5430 msgr2=0x7fa8a015e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:37.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.383+0000 7fa8a5ba1700 1 --2- 172.21.15.146:0/3519440063 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8a00b5430 0x7fa8a015e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:37.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.383+0000 7fa8a5ba1700 1 -- 172.21.15.146:0/3519440063 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa89c009420 con 0x7fa8a0143410 2023-10-06T11:17:37.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.384+0000 7fa8a5ba1700 1 --2- 172.21.15.146:0/3519440063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8a0143410 0x7fa8a015c7e0 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7fa89800a380 tx=0x7fa898007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:37.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.384+0000 7fa8957fa700 1 -- 172.21.15.146:0/3519440063 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89800ae10 con 0x7fa8a0143410 2023-10-06T11:17:37.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.384+0000 7fa8957fa700 1 -- 172.21.15.146:0/3519440063 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89800d650 con 0x7fa8a0143410 2023-10-06T11:17:37.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.384+0000 7fa8a63a2700 1 -- 172.21.15.146:0/3519440063 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a016a9e0 con 0x7fa8a0143410 2023-10-06T11:17:37.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.384+0000 7fa8957fa700 1 -- 172.21.15.146:0/3519440063 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89800da10 con 0x7fa8a0143410 2023-10-06T11:17:37.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.384+0000 7fa8a63a2700 1 -- 172.21.15.146:0/3519440063 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8a016a2d0 con 0x7fa8a0143410 2023-10-06T11:17:37.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.385+0000 7fa8a63a2700 1 -- 172.21.15.146:0/3519440063 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8a015c4c0 con 0x7fa8a0143410 2023-10-06T11:17:37.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.385+0000 7fa8957fa700 1 -- 172.21.15.146:0/3519440063 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa89801e3b0 con 0x7fa8a0143410 2023-10-06T11:17:37.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.386+0000 7fa8957fa700 1 --2- 172.21.15.146:0/3519440063 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa884066f30 0x7fa8840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:37.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.386+0000 7fa8a53a0700 1 --2- 172.21.15.146:0/3519440063 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa884066f30 0x7fa8840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:37.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.386+0000 7fa8957fa700 1 -- 172.21.15.146:0/3519440063 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa8980850e0 con 0x7fa8a0143410 2023-10-06T11:17:37.397 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.386+0000 7fa8a53a0700 1 --2- 172.21.15.146:0/3519440063 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa884066f30 0x7fa8840693e0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fa89c0091e0 tx=0x7fa89c017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:37.398 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.390+0000 7fa8957fa700 1 -- 172.21.15.146:0/3519440063 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa8980521f0 con 0x7fa8a0143410 2023-10-06T11:17:37.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.620+0000 7fa8a63a2700 1 -- 172.21.15.146:0/3519440063 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa8a004bb40 con 0x7fa8a0143410 2023-10-06T11:17:37.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.621+0000 7fa8957fa700 1 -- 172.21.15.146:0/3519440063 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 128 v128) v1 ==== 95+0+4619 (secure 0 0 0) 0x7fa898055810 con 0x7fa8a0143410 2023-10-06T11:17:37.624 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:17:37.624 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":128,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7433,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3681774523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3681774523},{"type":"v1","addr":"172.21.15.151:6834","nonce":3681774523}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":124},{"gid":7436,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/3243480101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":3243480101},{"type":"v1","addr":"172.21.15.151:6835","nonce":3243480101}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":124},{"gid":9645,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/1871572981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1871572981},{"type":"v1","addr":"172.21.15.146:6836","nonce":1871572981}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":124}],"filesystems":[{"mdsmap":{"epoch":128,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:17:23.939322+0000","modified":"2023-10-06T11:17:27.570448+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9648},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9648":{"gid":9648,"name":"c","rank":0,"incarnation":125,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/2875253990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2875253990},{"type":"v1","addr":"172.21.15.146:6837","nonce":2875253990}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-06T11:17:37.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.623+0000 7fa8a63a2700 1 -- 172.21.15.146:0/3519440063 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa884066f30 msgr2=0x7fa8840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:37.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.623+0000 7fa8a63a2700 1 --2- 172.21.15.146:0/3519440063 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa884066f30 0x7fa8840693e0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fa89c0091e0 tx=0x7fa89c017000 comp rx=0 tx=0).stop 2023-10-06T11:17:37.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.623+0000 7fa8a63a2700 1 -- 172.21.15.146:0/3519440063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8a0143410 msgr2=0x7fa8a015c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:37.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.623+0000 7fa8a63a2700 1 --2- 172.21.15.146:0/3519440063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8a0143410 0x7fa8a015c7e0 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7fa89800a380 tx=0x7fa898007900 comp rx=0 tx=0).stop 2023-10-06T11:17:37.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.623+0000 7fa8a63a2700 1 -- 172.21.15.146:0/3519440063 shutdown_connections 2023-10-06T11:17:37.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.623+0000 7fa8a63a2700 1 --2- 172.21.15.146:0/3519440063 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa884066f30 0x7fa8840693e0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:37.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.623+0000 7fa8a63a2700 1 --2- 172.21.15.146:0/3519440063 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa8a0143410 0x7fa8a015c7e0 unknown :-1 s=CLOSED pgs=1981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:37.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.623+0000 7fa8a63a2700 1 --2- 172.21.15.146:0/3519440063 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8a00b5430 0x7fa8a015e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:37.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.623+0000 7fa8a63a2700 1 --2- 172.21.15.146:0/3519440063 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa8a0143040 0x7fa8a0169d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:37.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.623+0000 7fa8a63a2700 1 -- 172.21.15.146:0/3519440063 >> 172.21.15.146:0/3519440063 conn(0x7fa8a006eb10 msgr2=0x7fa8a01420f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:37.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.623+0000 7fa8a63a2700 1 -- 172.21.15.146:0/3519440063 shutdown_connections 2023-10-06T11:17:37.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.623+0000 7fa8a63a2700 1 -- 172.21.15.146:0/3519440063 wait complete. 2023-10-06T11:17:37.627 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 128 2023-10-06T11:17:37.638 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2023-10-06T11:17:37.779 INFO:teuthology.orchestra.run.smithi146.stdout:{"message":"","return_code":0} 2023-10-06T11:17:37.779 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-10-06T11:17:37.780 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent '' 2023-10-06T11:17:37.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.817+0000 7f6a16918000 1 Processor -- start 2023-10-06T11:17:37.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.817+0000 7f6a16918000 1 -- start start 2023-10-06T11:17:37.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.818+0000 7f6a16918000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69f8002300 0x55f07ce98f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:37.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.818+0000 7f6a16918000 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f07ce98ad0 0x55f07ce9b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:37.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.818+0000 7f6a16918000 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f07ce9bd50 0x55f07cea3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:37.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.818+0000 7f6a16918000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f07cd13980 con 0x7f69f8002300 2023-10-06T11:17:37.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.818+0000 7f6a16918000 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f07cd13620 con 0x55f07ce9bd50 2023-10-06T11:17:37.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.818+0000 7f6a16918000 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f07cd0a400 con 0x55f07ce98ad0 2023-10-06T11:17:37.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.818+0000 7f6a0fb53700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69f8002300 0x55f07ce98f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:37.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.818+0000 7f6a0fb53700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69f8002300 0x55f07ce98f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46028/0 (socket says 172.21.15.146:46028) 2023-10-06T11:17:37.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.818+0000 7f6a0fb53700 1 -- 172.21.15.146:0/3545758712 learned_addr learned my addr 172.21.15.146:0/3545758712 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:37.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.818+0000 7f6a0f352700 1 --2- 172.21.15.146:0/3545758712 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f07ce98ad0 0x55f07ce9b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:37.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.818+0000 7f6a10354700 1 --2- 172.21.15.146:0/3545758712 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f07ce9bd50 0x55f07cea3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:37.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.818+0000 7f6a0fb53700 1 -- 172.21.15.146:0/3545758712 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f07ce98ad0 msgr2=0x55f07ce9b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:37.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.818+0000 7f6a0fb53700 1 --2- 172.21.15.146:0/3545758712 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f07ce98ad0 0x55f07ce9b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:37.824 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.818+0000 7f6a0fb53700 1 -- 172.21.15.146:0/3545758712 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f07ce9bd50 msgr2=0x55f07cea3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:37.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.818+0000 7f6a0fb53700 1 --2- 172.21.15.146:0/3545758712 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f07ce9bd50 0x55f07cea3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:37.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.818+0000 7f6a0fb53700 1 -- 172.21.15.146:0/3545758712 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f07cd223d0 con 0x7f69f8002300 2023-10-06T11:17:37.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.818+0000 7f6a0fb53700 1 --2- 172.21.15.146:0/3545758712 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69f8002300 0x55f07ce98f80 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7f6a000096e0 tx=0x7f6a00018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e63fbaacaaf5f9ad server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:37.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.818+0000 7f6a0e350700 1 -- 172.21.15.146:0/3545758712 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0000e030 con 0x7f69f8002300 2023-10-06T11:17:37.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.818+0000 7f6a0e350700 1 -- 172.21.15.146:0/3545758712 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a00000bc0 con 0x7f69f8002300 2023-10-06T11:17:37.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.818+0000 7f6a0e350700 1 -- 172.21.15.146:0/3545758712 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a00008850 con 0x7f69f8002300 2023-10-06T11:17:37.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.819+0000 7f6a16918000 1 -- 172.21.15.146:0/3545758712 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69f8002300 msgr2=0x55f07ce98f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:37.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.819+0000 7f6a16918000 1 --2- 172.21.15.146:0/3545758712 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69f8002300 0x55f07ce98f80 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7f6a000096e0 tx=0x7f6a00018000 comp rx=0 tx=0).stop 2023-10-06T11:17:37.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.819+0000 7f6a16918000 1 -- 172.21.15.146:0/3545758712 shutdown_connections 2023-10-06T11:17:37.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.819+0000 7f6a16918000 1 --2- 172.21.15.146:0/3545758712 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f07ce9bd50 0x55f07cea3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:37.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.819+0000 7f6a16918000 1 --2- 172.21.15.146:0/3545758712 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f69f8002300 0x55f07ce98f80 unknown :-1 s=CLOSED pgs=1984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:37.825 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.819+0000 7f6a16918000 1 --2- 172.21.15.146:0/3545758712 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f07ce98ad0 0x55f07ce9b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:37.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.819+0000 7f6a16918000 1 -- 172.21.15.146:0/3545758712 >> 172.21.15.146:0/3545758712 conn(0x55f07cdf5680 msgr2=0x55f07cdf5a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:37.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.819+0000 7f6a16918000 1 -- 172.21.15.146:0/3545758712 shutdown_connections 2023-10-06T11:17:37.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.819+0000 7f6a16918000 1 -- 172.21.15.146:0/3545758712 wait complete. 2023-10-06T11:17:37.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.819+0000 7f6a16918000 1 Processor -- start 2023-10-06T11:17:37.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.819+0000 7f6a16918000 1 -- start start 2023-10-06T11:17:37.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.820+0000 7f6a16918000 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f07ce98ad0 0x55f07ce9fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:37.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.820+0000 7f6a16918000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f07ce9bd50 0x55f07ce9d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:37.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.820+0000 7f6a16918000 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69f8002300 0x55f07ce9d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:37.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.820+0000 7f6a16918000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f07cea06e0 con 0x55f07ce9bd50 2023-10-06T11:17:37.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.820+0000 7f6a16918000 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f07ce95850 con 0x7f69f8002300 2023-10-06T11:17:37.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.820+0000 7f6a16918000 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f07ce95af0 con 0x55f07ce98ad0 2023-10-06T11:17:37.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.820+0000 7f6a0f352700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f07ce9bd50 0x55f07ce9d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:37.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.820+0000 7f6a0f352700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f07ce9bd50 0x55f07ce9d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46030/0 (socket says 172.21.15.146:46030) 2023-10-06T11:17:37.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.820+0000 7f6a0f352700 1 -- 172.21.15.146:0/2440799896 learned_addr learned my addr 172.21.15.146:0/2440799896 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:37.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.820+0000 7f6a0fb53700 1 --2- 172.21.15.146:0/2440799896 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f07ce98ad0 0x55f07ce9fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:37.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.820+0000 7f6a10354700 1 --2- 172.21.15.146:0/2440799896 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69f8002300 0x55f07ce9d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:37.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.820+0000 7f6a0f352700 1 -- 172.21.15.146:0/2440799896 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f07ce98ad0 msgr2=0x55f07ce9fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:37.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.821+0000 7f6a0f352700 1 --2- 172.21.15.146:0/2440799896 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f07ce98ad0 0x55f07ce9fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:37.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.821+0000 7f6a0f352700 1 -- 172.21.15.146:0/2440799896 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69f8002300 msgr2=0x55f07ce9d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:37.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.821+0000 7f6a0f352700 1 --2- 172.21.15.146:0/2440799896 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69f8002300 0x55f07ce9d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:37.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.821+0000 7f6a0f352700 1 -- 172.21.15.146:0/2440799896 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f8001e10 con 0x55f07ce9bd50 2023-10-06T11:17:37.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.821+0000 7f6a0fb53700 1 --2- 172.21.15.146:0/2440799896 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f07ce98ad0 0x55f07ce9fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:17:37.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.821+0000 7f6a0f352700 1 --2- 172.21.15.146:0/2440799896 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f07ce9bd50 0x55f07ce9d390 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7f6a04007b90 tx=0x7f6a0400c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:37.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.821+0000 7f6a0cb4d700 1 -- 172.21.15.146:0/2440799896 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0400f070 con 0x55f07ce9bd50 2023-10-06T11:17:37.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.821+0000 7f6a0cb4d700 1 -- 172.21.15.146:0/2440799896 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a04010040 con 0x55f07ce9bd50 2023-10-06T11:17:37.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.821+0000 7f6a16918000 1 -- 172.21.15.146:0/2440799896 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f07cd15ae0 con 0x55f07ce9bd50 2023-10-06T11:17:37.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.821+0000 7f6a0cb4d700 1 -- 172.21.15.146:0/2440799896 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a04006da0 con 0x55f07ce9bd50 2023-10-06T11:17:37.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.821+0000 7f6a16918000 1 -- 172.21.15.146:0/2440799896 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f07cd15540 con 0x55f07ce9bd50 2023-10-06T11:17:37.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.822+0000 7f6a0cb4d700 1 -- 172.21.15.146:0/2440799896 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6a04016660 con 0x55f07ce9bd50 2023-10-06T11:17:37.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.822+0000 7f6a0cb4d700 1 --2- 172.21.15.146:0/2440799896 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f69fc065890 0x7f69fc067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:37.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.823+0000 7f6a0cb4d700 1 -- 172.21.15.146:0/2440799896 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6a04084150 con 0x55f07ce9bd50 2023-10-06T11:17:37.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.823+0000 7f6a0fb53700 1 --2- 172.21.15.146:0/2440799896 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f69fc065890 0x7f69fc067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:37.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.823+0000 7f6a16918000 1 --2- 172.21.15.146:0/2440799896 >> [v2:172.21.15.151:6808/90890,v1:172.21.15.151:6809/90890] conn(0x55f07ce964d0 0x55f07ce968d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:37.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.823+0000 7f6a16918000 1 -- 172.21.15.146:0/2440799896 --> [v2:172.21.15.151:6808/90890,v1:172.21.15.151:6809/90890] -- osd_op(unknown.0.0:1 24.7 24:e2e07930:::10000000001.00000000:head [setxattr parent in=6b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e151) v8 -- 0x55f07ce96e10 con 0x55f07ce964d0 2023-10-06T11:17:37.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.823+0000 7f6a0fb53700 1 --2- 172.21.15.146:0/2440799896 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f69fc065890 0x7f69fc067d40 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f6a00024000 tx=0x7f6a0001f070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:37.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.823+0000 7f6a10354700 1 --2- 172.21.15.146:0/2440799896 >> [v2:172.21.15.151:6808/90890,v1:172.21.15.151:6809/90890] conn(0x55f07ce964d0 0x55f07ce968d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:37.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.823+0000 7f6a10354700 1 --2- 172.21.15.146:0/2440799896 >> [v2:172.21.15.151:6808/90890,v1:172.21.15.151:6809/90890] conn(0x55f07ce964d0 0x55f07ce968d0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:37.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.824+0000 7f6a10354700 1 -- 172.21.15.146:0/2440799896 <== osd.7 v2:172.21.15.151:6808/90890 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr] v151'4 uv4 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f6a08003ab0 con 0x55f07ce964d0 2023-10-06T11:17:37.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.824+0000 7f6a16918000 1 -- 172.21.15.146:0/2440799896 >> [v2:172.21.15.151:6808/90890,v1:172.21.15.151:6809/90890] conn(0x55f07ce964d0 msgr2=0x55f07ce968d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:37.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.824+0000 7f6a16918000 1 --2- 172.21.15.146:0/2440799896 >> [v2:172.21.15.151:6808/90890,v1:172.21.15.151:6809/90890] conn(0x55f07ce964d0 0x55f07ce968d0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:37.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.825+0000 7f6a16918000 1 -- 172.21.15.146:0/2440799896 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f69fc065890 msgr2=0x7f69fc067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:37.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.825+0000 7f6a16918000 1 --2- 172.21.15.146:0/2440799896 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f69fc065890 0x7f69fc067d40 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f6a00024000 tx=0x7f6a0001f070 comp rx=0 tx=0).stop 2023-10-06T11:17:37.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.825+0000 7f6a16918000 1 -- 172.21.15.146:0/2440799896 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f07ce9bd50 msgr2=0x55f07ce9d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:37.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.825+0000 7f6a16918000 1 --2- 172.21.15.146:0/2440799896 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f07ce9bd50 0x55f07ce9d390 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7f6a04007b90 tx=0x7f6a0400c040 comp rx=0 tx=0).stop 2023-10-06T11:17:37.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.825+0000 7f6a10354700 1 -- 172.21.15.146:0/2440799896 reap_dead start 2023-10-06T11:17:37.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.825+0000 7f6a16918000 1 -- 172.21.15.146:0/2440799896 shutdown_connections 2023-10-06T11:17:37.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.825+0000 7f6a16918000 1 -- 172.21.15.146:0/2440799896 >> 172.21.15.146:0/2440799896 conn(0x55f07cdf5680 msgr2=0x55f07ce9a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:37.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.825+0000 7f6a16918000 1 -- 172.21.15.146:0/2440799896 shutdown_connections 2023-10-06T11:17:37.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.825+0000 7f6a16918000 1 -- 172.21.15.146:0/2440799896 wait complete. 2023-10-06T11:17:37.833 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.11:0 scrub start / recursive,repair 2023-10-06T11:17:37.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.988+0000 7fe66ad33700 1 Processor -- start 2023-10-06T11:17:37.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.989+0000 7fe66ad33700 1 -- start start 2023-10-06T11:17:37.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.989+0000 7fe66ad33700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe66406b740 0x7fe66406bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:37.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.989+0000 7fe66ad33700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe66406c0d0 con 0x7fe664142ea0 2023-10-06T11:17:37.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.989+0000 7fe66ad33700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe66415e2b0 con 0x7fe6640c8d10 2023-10-06T11:17:37.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.989+0000 7fe66ad33700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe66415d3c0 con 0x7fe66406b740 2023-10-06T11:17:37.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.990+0000 7fe668acf700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe664142ea0 0x7fe6640cc630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:37338/0 (socket says 172.21.15.146:37338) 2023-10-06T11:17:37.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.990+0000 7fe668acf700 1 -- 172.21.15.146:0/3037049955 learned_addr learned my addr 172.21.15.146:0/3037049955 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:17:37.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.990+0000 7fe65bfff700 1 --2- 172.21.15.146:0/3037049955 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe66406b740 0x7fe66406bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:37.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.990+0000 7fe65b7fe700 1 -- 172.21.15.146:0/3037049955 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3447773472 0 0) 0x7fe66406c0d0 con 0x7fe664142ea0 2023-10-06T11:17:37.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.990+0000 7fe65b7fe700 1 -- 172.21.15.146:0/3037049955 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe64c003570 con 0x7fe664142ea0 2023-10-06T11:17:37.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.990+0000 7fe65b7fe700 1 -- 172.21.15.146:0/3037049955 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 198596366 0 0) 0x7fe66415e2b0 con 0x7fe6640c8d10 2023-10-06T11:17:37.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.990+0000 7fe65b7fe700 1 -- 172.21.15.146:0/3037049955 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe66406c0d0 con 0x7fe6640c8d10 2023-10-06T11:17:37.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.990+0000 7fe65bfff700 1 -- 172.21.15.146:0/3037049955 >> v1:172.21.15.151:6789/0 conn(0x7fe6640c8d10 legacy=0x7fe6640c9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:37.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.990+0000 7fe65bfff700 1 -- 172.21.15.146:0/3037049955 >> v1:172.21.15.146:6789/0 conn(0x7fe664142ea0 legacy=0x7fe6640cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:37.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.990+0000 7fe65b7fe700 1 -- 172.21.15.146:0/3037049955 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2340503082 0 0) 0x7fe64c003570 con 0x7fe664142ea0 2023-10-06T11:17:37.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.990+0000 7fe65bfff700 1 -- 172.21.15.146:0/3037049955 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe66415d6a0 con 0x7fe66406b740 2023-10-06T11:17:37.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.990+0000 7fe65bfff700 1 --2- 172.21.15.146:0/3037049955 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe66406b740 0x7fe66406bb90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe654009910 tx=0x7fe6540091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86f399a4aa0bed05 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:37.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.990+0000 7fe65b7fe700 1 -- 172.21.15.146:0/3037049955 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe660001470 con 0x7fe66406b740 2023-10-06T11:17:37.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.990+0000 7fe65b7fe700 1 -- 172.21.15.146:0/3037049955 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe654011420 con 0x7fe66406b740 2023-10-06T11:17:37.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.990+0000 7fe65b7fe700 1 -- 172.21.15.146:0/3037049955 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6540117c0 con 0x7fe66406b740 2023-10-06T11:17:37.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.991+0000 7fe66ad33700 1 -- 172.21.15.146:0/3037049955 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe66406b740 msgr2=0x7fe66406bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:37.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.991+0000 7fe66ad33700 1 --2- 172.21.15.146:0/3037049955 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe66406b740 0x7fe66406bb90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe654009910 tx=0x7fe6540091a0 comp rx=0 tx=0).stop 2023-10-06T11:17:37.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.991+0000 7fe66ad33700 1 -- 172.21.15.146:0/3037049955 shutdown_connections 2023-10-06T11:17:37.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.991+0000 7fe66ad33700 1 --2- 172.21.15.146:0/3037049955 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe66406b740 0x7fe66406bb90 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:37.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.991+0000 7fe66ad33700 1 -- 172.21.15.146:0/3037049955 >> 172.21.15.146:0/3037049955 conn(0x7fe6640ce430 msgr2=0x7fe6640ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:37.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.991+0000 7fe66ad33700 1 -- 172.21.15.146:0/3037049955 shutdown_connections 2023-10-06T11:17:37.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.991+0000 7fe66ad33700 1 -- 172.21.15.146:0/3037049955 wait complete. 2023-10-06T11:17:37.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.992+0000 7fe66ad33700 1 Processor -- start 2023-10-06T11:17:37.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.992+0000 7fe66ad33700 1 -- start start 2023-10-06T11:17:37.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.993+0000 7fe66ad33700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe66406b740 0x7fe6641566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:37.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.993+0000 7fe66ad33700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6640c8d10 0x7fe664141020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:37.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.993+0000 7fe66ad33700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe664142ea0 0x7fe664155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:37.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.993+0000 7fe66ad33700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe664157290 con 0x7fe6640c8d10 2023-10-06T11:17:37.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.993+0000 7fe66ad33700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe664156cd0 con 0x7fe664142ea0 2023-10-06T11:17:37.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.993+0000 7fe66ad33700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe664156fb0 con 0x7fe66406b740 2023-10-06T11:17:37.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.993+0000 7fe65bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6640c8d10 0x7fe664141020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:37.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.993+0000 7fe65bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6640c8d10 0x7fe664141020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46042/0 (socket says 172.21.15.146:46042) 2023-10-06T11:17:37.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.993+0000 7fe65bfff700 1 -- 172.21.15.146:0/1032829927 learned_addr learned my addr 172.21.15.146:0/1032829927 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:37.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.993+0000 7fe65bfff700 1 -- 172.21.15.146:0/1032829927 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe66406b740 msgr2=0x7fe6641566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:37.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.993+0000 7fe668acf700 1 --2- 172.21.15.146:0/1032829927 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe66406b740 0x7fe6641566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:37.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.993+0000 7fe6692d0700 1 --2- 172.21.15.146:0/1032829927 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe664142ea0 0x7fe664155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:37.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.993+0000 7fe65bfff700 1 --2- 172.21.15.146:0/1032829927 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe66406b740 0x7fe6641566f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:37.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.993+0000 7fe65bfff700 1 -- 172.21.15.146:0/1032829927 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe664142ea0 msgr2=0x7fe664155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:37.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.993+0000 7fe65bfff700 1 --2- 172.21.15.146:0/1032829927 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe664142ea0 0x7fe664155240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:37.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.993+0000 7fe65bfff700 1 -- 172.21.15.146:0/1032829927 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe654009420 con 0x7fe6640c8d10 2023-10-06T11:17:37.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.994+0000 7fe65bfff700 1 --2- 172.21.15.146:0/1032829927 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6640c8d10 0x7fe664141020 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7fe6540091e0 tx=0x7fe654016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:37.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.994+0000 7fe658ff9700 1 -- 172.21.15.146:0/1032829927 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65401cc90 con 0x7fe6640c8d10 2023-10-06T11:17:37.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.994+0000 7fe658ff9700 1 -- 172.21.15.146:0/1032829927 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65401cdf0 con 0x7fe6640c8d10 2023-10-06T11:17:38.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.994+0000 7fe66ad33700 1 -- 172.21.15.146:0/1032829927 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe664154a40 con 0x7fe6640c8d10 2023-10-06T11:17:38.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.994+0000 7fe658ff9700 1 -- 172.21.15.146:0/1032829927 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65401a6a0 con 0x7fe6640c8d10 2023-10-06T11:17:38.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.994+0000 7fe66ad33700 1 -- 172.21.15.146:0/1032829927 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe664154520 con 0x7fe6640c8d10 2023-10-06T11:17:38.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.995+0000 7fe658ff9700 1 -- 172.21.15.146:0/1032829927 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe65401aa90 con 0x7fe6640c8d10 2023-10-06T11:17:38.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.995+0000 7fe658ff9700 1 --2- 172.21.15.146:0/1032829927 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe650066f30 0x7fe6500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:38.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.996+0000 7fe658ff9700 1 -- 172.21.15.146:0/1032829927 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe6540865b0 con 0x7fe6640c8d10 2023-10-06T11:17:38.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.996+0000 7fe668acf700 1 --2- 172.21.15.146:0/1032829927 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe650066f30 0x7fe6500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:38.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.996+0000 7fe668acf700 1 --2- 172.21.15.146:0/1032829927 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe650066f30 0x7fe6500693e0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fe660007ba0 tx=0x7fe660009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:38.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.997+0000 7fe67402bb80 1 Processor -- start 2023-10-06T11:17:38.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.997+0000 7fe67402bb80 1 -- start start 2023-10-06T11:17:38.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.998+0000 7fe67402bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565158eb1b60 0x565158eb1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:38.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.998+0000 7fe67402bb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x565158e6da70 0x565158e6a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:38.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.998+0000 7fe67402bb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565158e6bca0 0x565158e6ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:38.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.998+0000 7fe67402bb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x565158dead50 con 0x565158e6bca0 2023-10-06T11:17:38.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.998+0000 7fe67402bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x565158dc1b40 con 0x565158eb1b60 2023-10-06T11:17:38.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.998+0000 7fe67402bb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x565158dbf340 con 0x565158e6da70 2023-10-06T11:17:38.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.998+0000 7fe6692d0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565158e6bca0 0x565158e6ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:38.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.998+0000 7fe6692d0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565158e6bca0 0x565158e6ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46058/0 (socket says 172.21.15.146:46058) 2023-10-06T11:17:38.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.998+0000 7fe6692d0700 1 -- 172.21.15.146:0/1853903563 learned_addr learned my addr 172.21.15.146:0/1853903563 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:38.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.998+0000 7fe65bfff700 1 --2- 172.21.15.146:0/1853903563 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x565158e6da70 0x565158e6a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:38.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.998+0000 7fe668acf700 1 --2- 172.21.15.146:0/1853903563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565158eb1b60 0x565158eb1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:38.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.998+0000 7fe6692d0700 1 -- 172.21.15.146:0/1853903563 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x565158e6da70 msgr2=0x565158e6a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:38.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.998+0000 7fe6692d0700 1 --2- 172.21.15.146:0/1853903563 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x565158e6da70 0x565158e6a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.998+0000 7fe6692d0700 1 -- 172.21.15.146:0/1853903563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565158eb1b60 msgr2=0x565158eb1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:38.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.998+0000 7fe6692d0700 1 --2- 172.21.15.146:0/1853903563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565158eb1b60 0x565158eb1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.998+0000 7fe6692d0700 1 -- 172.21.15.146:0/1853903563 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565158c55340 con 0x565158e6bca0 2023-10-06T11:17:38.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.999+0000 7fe6692d0700 1 --2- 172.21.15.146:0/1853903563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565158e6bca0 0x565158e6ab90 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7fe65c002d30 tx=0x7fe65c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b879089b4287ee9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:38.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.999+0000 7fe649ffb700 1 -- 172.21.15.146:0/1853903563 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65c00d920 con 0x565158e6bca0 2023-10-06T11:17:38.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.999+0000 7fe649ffb700 1 -- 172.21.15.146:0/1853903563 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65c00da80 con 0x565158e6bca0 2023-10-06T11:17:38.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.999+0000 7fe649ffb700 1 -- 172.21.15.146:0/1853903563 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65c00de20 con 0x565158e6bca0 2023-10-06T11:17:38.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.999+0000 7fe67402bb80 1 -- 172.21.15.146:0/1853903563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565158e6bca0 msgr2=0x565158e6ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:38.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.999+0000 7fe67402bb80 1 --2- 172.21.15.146:0/1853903563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565158e6bca0 0x565158e6ab90 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7fe65c002d30 tx=0x7fe65c009040 comp rx=0 tx=0).stop 2023-10-06T11:17:38.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.999+0000 7fe67402bb80 1 -- 172.21.15.146:0/1853903563 shutdown_connections 2023-10-06T11:17:38.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.999+0000 7fe67402bb80 1 --2- 172.21.15.146:0/1853903563 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565158e6bca0 0x565158e6ab90 unknown :-1 s=CLOSED pgs=1988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.999+0000 7fe67402bb80 1 --2- 172.21.15.146:0/1853903563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565158eb1b60 0x565158eb1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.999+0000 7fe67402bb80 1 --2- 172.21.15.146:0/1853903563 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x565158e6da70 0x565158e6a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.999+0000 7fe67402bb80 1 -- 172.21.15.146:0/1853903563 >> 172.21.15.146:0/1853903563 conn(0x565158e6c140 msgr2=0x565158e6c510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:38.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.999+0000 7fe67402bb80 1 -- 172.21.15.146:0/1853903563 shutdown_connections 2023-10-06T11:17:38.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:37.999+0000 7fe67402bb80 1 -- 172.21.15.146:0/1853903563 wait complete. 2023-10-06T11:17:38.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.000+0000 7fe67402bb80 1 -- start start 2023-10-06T11:17:38.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.000+0000 7fe67402bb80 1 Processor -- start 2023-10-06T11:17:38.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.001+0000 7fe67402bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565158e6bca0 0x565158e95960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:38.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.001+0000 7fe67402bb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x565158e6da70 0x565158e93060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:38.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.001+0000 7fe67402bb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565158eb1b60 0x565158eadbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:38.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.001+0000 7fe67402bb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x565158dbb130 con 0x565158eb1b60 2023-10-06T11:17:38.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.001+0000 7fe67402bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x565158d66960 con 0x565158e6bca0 2023-10-06T11:17:38.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.001+0000 7fe67402bb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x565158d81f70 con 0x565158e6da70 2023-10-06T11:17:38.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.001+0000 7fe67402bb80 10 client.0 _ll_register_callbacks cb 0x565158c58000 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:17:38.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.001+0000 7fe6692d0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565158eb1b60 0x565158eadbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:38.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.001+0000 7fe6692d0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565158eb1b60 0x565158eadbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46062/0 (socket says 172.21.15.146:46062) 2023-10-06T11:17:38.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.001+0000 7fe6692d0700 1 -- 172.21.15.146:0/2660060472 learned_addr learned my addr 172.21.15.146:0/2660060472 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:38.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.001+0000 7fe6692d0700 1 -- 172.21.15.146:0/2660060472 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x565158e6da70 msgr2=0x565158e93060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:38.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.001+0000 7fe6692d0700 1 --2- 172.21.15.146:0/2660060472 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x565158e6da70 0x565158e93060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.001+0000 7fe668acf700 1 --2- 172.21.15.146:0/2660060472 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565158e6bca0 0x565158e95960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:38.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.001+0000 7fe6692d0700 1 -- 172.21.15.146:0/2660060472 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565158e6bca0 msgr2=0x565158e95960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:38.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.001+0000 7fe6692d0700 1 --2- 172.21.15.146:0/2660060472 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565158e6bca0 0x565158e95960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.001+0000 7fe6692d0700 1 -- 172.21.15.146:0/2660060472 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe66406c0d0 con 0x565158eb1b60 2023-10-06T11:17:38.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.001+0000 7fe6692d0700 1 --2- 172.21.15.146:0/2660060472 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565158eb1b60 0x565158eadbb0 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7fe65c002cd0 tx=0x7fe65c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0dc2097a452ab14 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:38.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.001+0000 7fe642ffd700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:17:38.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.002+0000 7fe642ffd700 1 -- 172.21.15.146:0/2660060472 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65c006e80 con 0x565158eb1b60 2023-10-06T11:17:38.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.002+0000 7fe642ffd700 1 -- 172.21.15.146:0/2660060472 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe65c012b90 con 0x565158eb1b60 2023-10-06T11:17:38.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.002+0000 7fe67402bb80 1 -- 172.21.15.146:0/2660060472 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565158e5f760 con 0x565158eb1b60 2023-10-06T11:17:38.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.002+0000 7fe642ffd700 1 -- 172.21.15.146:0/2660060472 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=128) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe65c01b420 con 0x565158eb1b60 2023-10-06T11:17:38.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.002+0000 7fe67402bb80 10 client.9879 fetch_fsmap learned FSMap version 128 2023-10-06T11:17:38.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.002+0000 7fe67402bb80 1 -- 172.21.15.146:0/2660060472 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=128,monmap=2+}) v3 -- 0x565158bf80b0 con 0x565158eb1b60 2023-10-06T11:17:38.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.002+0000 7fe642ffd700 1 -- 172.21.15.146:0/2660060472 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x565158e5f760 con 0x565158eb1b60 2023-10-06T11:17:38.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.002+0000 7fe642ffd700 1 -- 172.21.15.146:0/2660060472 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 128) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fe65c01b580 con 0x565158eb1b60 2023-10-06T11:17:38.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.002+0000 7fe67402bb80 10 client.9879 fetch_fsmap finished waiting for FSMap version 128 2023-10-06T11:17:38.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.002+0000 7fe67402bb80 10 client.9879 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.c 2023-10-06T11:17:38.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.002+0000 7fe67402bb80 20 client.9879 populate_metadata read hostname 'smithi146' 2023-10-06T11:17:38.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.002+0000 7fe67402bb80 1 --2- 172.21.15.146:0/2660060472 >> [v2:172.21.15.146:6835/2875253990,v1:172.21.15.146:6837/2875253990] conn(0x565158e98000 0x565158e90fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:38.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.002+0000 7fe67402bb80 4 client.9879 mds_command: new command op to 9648 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:17:38.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.002+0000 7fe67402bb80 1 -- 172.21.15.146:0/2660060472 --> [v2:172.21.15.146:6835/2875253990,v1:172.21.15.146:6837/2875253990] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x565158e3c690 con 0x565158e98000 2023-10-06T11:17:38.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.002+0000 7fe668acf700 1 --2- 172.21.15.146:0/2660060472 >> [v2:172.21.15.146:6835/2875253990,v1:172.21.15.146:6837/2875253990] conn(0x565158e98000 0x565158e90fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:38.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.002+0000 7fe642ffd700 10 client.9879 ms_handle_connect on v2:172.21.15.146:6835/2875253990 2023-10-06T11:17:38.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.002+0000 7fe668acf700 1 --2- 172.21.15.146:0/2660060472 >> [v2:172.21.15.146:6835/2875253990,v1:172.21.15.146:6837/2875253990] conn(0x565158e98000 0x565158e90fd0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=473d30f467be93d9 server_cookie=1ce1191688e82347 in_seq=0 out_seq=0 2023-10-06T11:17:38.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.003+0000 7fe642ffd700 1 -- 172.21.15.146:0/2660060472 <== mds.0 v2:172.21.15.146:6835/2875253990 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x565158e3c690 con 0x565158e98000 2023-10-06T11:17:38.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.003+0000 7fe642ffd700 10 client.9879 handle_command_reply: tid=0 2023-10-06T11:17:38.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.003+0000 7fe67402bb80 1 client.9879 shutdown 2023-10-06T11:17:38.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.003+0000 7fe67402bb80 1 -- 172.21.15.146:0/2660060472 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565158eb1b60 msgr2=0x565158eadbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:38.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.003+0000 7fe67402bb80 1 --2- 172.21.15.146:0/2660060472 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565158eb1b60 0x565158eadbb0 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7fe65c002cd0 tx=0x7fe65c01a000 comp rx=0 tx=0).stop 2023-10-06T11:17:38.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.003+0000 7fe67402bb80 1 -- 172.21.15.146:0/2660060472 shutdown_connections 2023-10-06T11:17:38.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.003+0000 7fe67402bb80 1 --2- 172.21.15.146:0/2660060472 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565158eb1b60 0x565158eadbb0 unknown :-1 s=CLOSED pgs=1989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.003+0000 7fe67402bb80 1 --2- 172.21.15.146:0/2660060472 >> [v2:172.21.15.146:6835/2875253990,v1:172.21.15.146:6837/2875253990] conn(0x565158e98000 0x565158e90fd0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.003+0000 7fe67402bb80 1 --2- 172.21.15.146:0/2660060472 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565158e6bca0 0x565158e95960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.003+0000 7fe67402bb80 1 --2- 172.21.15.146:0/2660060472 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x565158e6da70 0x565158e93060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.003+0000 7fe642ffd700 0 client.9879 ms_handle_reset on v2:172.21.15.146:6835/2875253990 2023-10-06T11:17:38.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.003+0000 7fe67402bb80 1 -- 172.21.15.146:0/2660060472 >> 172.21.15.146:0/2660060472 conn(0x565158e6c140 msgr2=0x565158eaf3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:38.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.003+0000 7fe67402bb80 1 -- 172.21.15.146:0/2660060472 shutdown_connections 2023-10-06T11:17:38.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.003+0000 7fe67402bb80 1 -- 172.21.15.146:0/2660060472 wait complete. 2023-10-06T11:17:38.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.003+0000 7fe67402bb80 20 client.9879 trim_cache size 0 max 16384 2023-10-06T11:17:38.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.020+0000 7fe67402bb80 1 Processor -- start 2023-10-06T11:17:38.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.020+0000 7fe67402bb80 1 -- start start 2023-10-06T11:17:38.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.020+0000 7fe67402bb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565158e6bca0 0x565158eb1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:38.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.020+0000 7fe67402bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565158e6da70 0x565158eacc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:38.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.020+0000 7fe67402bb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x565158eb1b60 0x565158e66a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:38.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.020+0000 7fe67402bb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x565158c3df00 con 0x565158e6bca0 2023-10-06T11:17:38.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.020+0000 7fe67402bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x565158e5f6c0 con 0x565158e6da70 2023-10-06T11:17:38.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.020+0000 7fe67402bb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x565158ec0620 con 0x565158eb1b60 2023-10-06T11:17:38.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.020+0000 7fe668acf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565158e6bca0 0x565158eb1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:38.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.020+0000 7fe668acf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565158e6bca0 0x565158eb1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46078/0 (socket says 172.21.15.146:46078) 2023-10-06T11:17:38.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.020+0000 7fe668acf700 1 -- 172.21.15.146:0/3682064527 learned_addr learned my addr 172.21.15.146:0/3682064527 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:38.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.021+0000 7fe668acf700 1 -- 172.21.15.146:0/3682064527 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x565158eb1b60 msgr2=0x565158e66a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:38.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.021+0000 7fe668acf700 1 --2- 172.21.15.146:0/3682064527 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x565158eb1b60 0x565158e66a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.021+0000 7fe668acf700 1 -- 172.21.15.146:0/3682064527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565158e6da70 msgr2=0x565158eacc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:38.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.021+0000 7fe668acf700 1 --2- 172.21.15.146:0/3682064527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565158e6da70 0x565158eacc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.021+0000 7fe668acf700 1 -- 172.21.15.146:0/3682064527 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565158e63370 con 0x565158e6bca0 2023-10-06T11:17:38.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.021+0000 7fe668acf700 1 --2- 172.21.15.146:0/3682064527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565158e6bca0 0x565158eb1f30 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7fe660005d70 tx=0x7fe660019040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eee05ce45c678eb7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:38.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.021+0000 7fe64a7fc700 1 -- 172.21.15.146:0/3682064527 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe660005e50 con 0x565158e6bca0 2023-10-06T11:17:38.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.021+0000 7fe64a7fc700 1 -- 172.21.15.146:0/3682064527 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe660004830 con 0x565158e6bca0 2023-10-06T11:17:38.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.021+0000 7fe64a7fc700 1 -- 172.21.15.146:0/3682064527 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe660004bb0 con 0x565158e6bca0 2023-10-06T11:17:38.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.021+0000 7fe67402bb80 1 -- 172.21.15.146:0/3682064527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565158e6bca0 msgr2=0x565158eb1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:38.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.021+0000 7fe67402bb80 1 --2- 172.21.15.146:0/3682064527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565158e6bca0 0x565158eb1f30 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7fe660005d70 tx=0x7fe660019040 comp rx=0 tx=0).stop 2023-10-06T11:17:38.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.021+0000 7fe67402bb80 1 -- 172.21.15.146:0/3682064527 shutdown_connections 2023-10-06T11:17:38.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.021+0000 7fe67402bb80 1 --2- 172.21.15.146:0/3682064527 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x565158eb1b60 0x565158e66a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.021+0000 7fe67402bb80 1 --2- 172.21.15.146:0/3682064527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565158e6bca0 0x565158eb1f30 unknown :-1 s=CLOSED pgs=1990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.021+0000 7fe67402bb80 1 --2- 172.21.15.146:0/3682064527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565158e6da70 0x565158eacc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.021+0000 7fe67402bb80 1 -- 172.21.15.146:0/3682064527 >> 172.21.15.146:0/3682064527 conn(0x565158e6c140 msgr2=0x565158eb0840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:38.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.022+0000 7fe67402bb80 1 -- 172.21.15.146:0/3682064527 shutdown_connections 2023-10-06T11:17:38.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.022+0000 7fe67402bb80 1 -- 172.21.15.146:0/3682064527 wait complete. 2023-10-06T11:17:38.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.022+0000 7fe67402bb80 1 -- start start 2023-10-06T11:17:38.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.022+0000 7fe67402bb80 1 Processor -- start 2023-10-06T11:17:38.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.023+0000 7fe67402bb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565158e6bca0 0x565158e906f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:38.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.023+0000 7fe67402bb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x565158e6da70 0x565158f11130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:38.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.023+0000 7fe67402bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565158eb1b60 0x565158f11670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:38.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.023+0000 7fe67402bb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x565158f17580 con 0x565158e6bca0 2023-10-06T11:17:38.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.023+0000 7fe67402bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x565158eb6590 con 0x565158eb1b60 2023-10-06T11:17:38.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.023+0000 7fe67402bb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x565158e92520 con 0x565158e6da70 2023-10-06T11:17:38.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.023+0000 7fe67402bb80 10 client.0 _ll_register_callbacks cb 0x565158c58000 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:17:38.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.023+0000 7fe668acf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565158e6bca0 0x565158e906f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:38.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.023+0000 7fe668acf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565158e6bca0 0x565158e906f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46080/0 (socket says 172.21.15.146:46080) 2023-10-06T11:17:38.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.023+0000 7fe668acf700 1 -- 172.21.15.146:0/4294799065 learned_addr learned my addr 172.21.15.146:0/4294799065 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:38.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.023+0000 7fe668acf700 1 -- 172.21.15.146:0/4294799065 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x565158e6da70 msgr2=0x565158f11130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:38.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.023+0000 7fe668acf700 1 --2- 172.21.15.146:0/4294799065 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x565158e6da70 0x565158f11130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.023+0000 7fe668acf700 1 -- 172.21.15.146:0/4294799065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565158eb1b60 msgr2=0x565158f11670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:38.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.023+0000 7fe668acf700 1 --2- 172.21.15.146:0/4294799065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565158eb1b60 0x565158f11670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.023+0000 7fe668acf700 1 -- 172.21.15.146:0/4294799065 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe660005a10 con 0x565158e6bca0 2023-10-06T11:17:38.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.023+0000 7fe668acf700 1 --2- 172.21.15.146:0/4294799065 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565158e6bca0 0x565158e906f0 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7fe660001500 tx=0x7fe660020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a831b9ee10874283 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:38.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.023+0000 7fe642ffd700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:17:38.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.024+0000 7fe642ffd700 1 -- 172.21.15.146:0/4294799065 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe660030070 con 0x565158e6bca0 2023-10-06T11:17:38.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.024+0000 7fe642ffd700 1 -- 172.21.15.146:0/4294799065 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe660014870 con 0x565158e6bca0 2023-10-06T11:17:38.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.024+0000 7fe67402bb80 1 -- 172.21.15.146:0/4294799065 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe65c00da80 con 0x565158e6bca0 2023-10-06T11:17:38.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.024+0000 7fe642ffd700 1 -- 172.21.15.146:0/4294799065 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=128) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe660014c40 con 0x565158e6bca0 2023-10-06T11:17:38.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.024+0000 7fe67402bb80 10 client.9885 fetch_fsmap learned FSMap version 128 2023-10-06T11:17:38.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.024+0000 7fe67402bb80 1 -- 172.21.15.146:0/4294799065 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=128,monmap=2+}) v3 -- 0x565158d89850 con 0x565158e6bca0 2023-10-06T11:17:38.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.024+0000 7fe642ffd700 1 -- 172.21.15.146:0/4294799065 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65c00da80 con 0x565158e6bca0 2023-10-06T11:17:38.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.024+0000 7fe642ffd700 1 -- 172.21.15.146:0/4294799065 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 128) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fe660033020 con 0x565158e6bca0 2023-10-06T11:17:38.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.024+0000 7fe67402bb80 10 client.9885 fetch_fsmap finished waiting for FSMap version 128 2023-10-06T11:17:38.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.024+0000 7fe67402bb80 10 client.9885 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.c 2023-10-06T11:17:38.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.024+0000 7fe67402bb80 20 client.9885 populate_metadata read hostname 'smithi146' 2023-10-06T11:17:38.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.024+0000 7fe67402bb80 1 --2- 172.21.15.146:0/4294799065 >> [v2:172.21.15.146:6835/2875253990,v1:172.21.15.146:6837/2875253990] conn(0x565158eace40 0x565158ead230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:38.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.024+0000 7fe67402bb80 4 client.9885 mds_command: new command op to 9648 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}] 2023-10-06T11:17:38.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.024+0000 7fe67402bb80 1 -- 172.21.15.146:0/4294799065 --> [v2:172.21.15.146:6835/2875253990,v1:172.21.15.146:6837/2875253990] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}) v1 -- 0x565158d5ded0 con 0x565158eace40 2023-10-06T11:17:38.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.024+0000 7fe65bfff700 1 --2- 172.21.15.146:0/4294799065 >> [v2:172.21.15.146:6835/2875253990,v1:172.21.15.146:6837/2875253990] conn(0x565158eace40 0x565158ead230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:38.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.024+0000 7fe642ffd700 10 client.9885 ms_handle_connect on v2:172.21.15.146:6835/2875253990 2023-10-06T11:17:38.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.024+0000 7fe65bfff700 1 --2- 172.21.15.146:0/4294799065 >> [v2:172.21.15.146:6835/2875253990,v1:172.21.15.146:6837/2875253990] conn(0x565158eace40 0x565158ead230 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb6f3d017a632a91 server_cookie=9cecfc1ca18623e5 in_seq=0 out_seq=0 2023-10-06T11:17:38.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.025+0000 7fe642ffd700 1 -- 172.21.15.146:0/4294799065 <== mds.0 v2:172.21.15.146:6835/2875253990 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x565158d5ded0 con 0x565158eace40 2023-10-06T11:17:38.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.025+0000 7fe642ffd700 10 client.9885 handle_command_reply: tid=0 2023-10-06T11:17:38.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.025+0000 7fe67402bb80 1 client.9885 shutdown 2023-10-06T11:17:38.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.025+0000 7fe67402bb80 1 -- 172.21.15.146:0/4294799065 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565158e6bca0 msgr2=0x565158e906f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:38.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.025+0000 7fe67402bb80 1 --2- 172.21.15.146:0/4294799065 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565158e6bca0 0x565158e906f0 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7fe660001500 tx=0x7fe660020000 comp rx=0 tx=0).stop 2023-10-06T11:17:38.033 INFO:tasks.ceph.mds.c.smithi146.stderr:2023-10-06T11:17:38.025+0000 7f96e42e4700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /subdir/sixmegs auth v6 ap=1 DIRTYPARENT s=5242880 n(v0 rc2023-10-06T11:17:36.726911+0000 b5242880 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={9849=0-12582912@1} caps={9849=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@4},l=9849 | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x556132035080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(24)0x10000000001:[<0x10000000000/sixmegs v6>,<0x1/subdir v8>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-06T11:17:38.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.025+0000 7fe67402bb80 1 -- 172.21.15.146:0/4294799065 shutdown_connections 2023-10-06T11:17:38.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.025+0000 7fe67402bb80 1 --2- 172.21.15.146:0/4294799065 >> [v2:172.21.15.146:6835/2875253990,v1:172.21.15.146:6837/2875253990] conn(0x565158eace40 0x565158ead230 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.025+0000 7fe67402bb80 1 --2- 172.21.15.146:0/4294799065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565158eb1b60 0x565158f11670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.025+0000 7fe67402bb80 1 --2- 172.21.15.146:0/4294799065 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x565158e6bca0 0x565158e906f0 unknown :-1 s=CLOSED pgs=1991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.025+0000 7fe642ffd700 0 client.9885 ms_handle_reset on v2:172.21.15.146:6835/2875253990 2023-10-06T11:17:38.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.025+0000 7fe67402bb80 1 --2- 172.21.15.146:0/4294799065 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x565158e6da70 0x565158f11130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.025+0000 7fe67402bb80 1 -- 172.21.15.146:0/4294799065 >> 172.21.15.146:0/4294799065 conn(0x565158e6c140 msgr2=0x565158e958f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:38.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.026+0000 7fe67402bb80 1 -- 172.21.15.146:0/4294799065 shutdown_connections 2023-10-06T11:17:38.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.026+0000 7fe67402bb80 1 -- 172.21.15.146:0/4294799065 wait complete. 2023-10-06T11:17:38.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.026+0000 7fe67402bb80 20 client.9885 trim_cache size 0 max 16384 2023-10-06T11:17:38.035 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:17:38.035 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0, 2023-10-06T11:17:38.035 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_tag": "9be3bf16-72ac-4e41-915a-82f55086dc4c", 2023-10-06T11:17:38.035 INFO:teuthology.orchestra.run.smithi146.stdout: "mode": "asynchronous" 2023-10-06T11:17:38.035 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:17:38.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.026+0000 7fe66ad33700 1 -- 172.21.15.146:0/1032829927 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe650066f30 msgr2=0x7fe6500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:38.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.026+0000 7fe66ad33700 1 --2- 172.21.15.146:0/1032829927 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe650066f30 0x7fe6500693e0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fe660007ba0 tx=0x7fe660009040 comp rx=0 tx=0).stop 2023-10-06T11:17:38.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.026+0000 7fe66ad33700 1 -- 172.21.15.146:0/1032829927 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6640c8d10 msgr2=0x7fe664141020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:38.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.026+0000 7fe66ad33700 1 --2- 172.21.15.146:0/1032829927 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6640c8d10 0x7fe664141020 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7fe6540091e0 tx=0x7fe654016000 comp rx=0 tx=0).stop 2023-10-06T11:17:38.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.026+0000 7fe66ad33700 1 -- 172.21.15.146:0/1032829927 shutdown_connections 2023-10-06T11:17:38.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.026+0000 7fe66ad33700 1 --2- 172.21.15.146:0/1032829927 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe650066f30 0x7fe6500693e0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.026+0000 7fe66ad33700 1 --2- 172.21.15.146:0/1032829927 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe664142ea0 0x7fe664155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.026+0000 7fe66ad33700 1 --2- 172.21.15.146:0/1032829927 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe66406b740 0x7fe6641566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.026+0000 7fe66ad33700 1 --2- 172.21.15.146:0/1032829927 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe6640c8d10 0x7fe664141020 unknown :-1 s=CLOSED pgs=1987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.026+0000 7fe66ad33700 1 -- 172.21.15.146:0/1032829927 >> 172.21.15.146:0/1032829927 conn(0x7fe6640ce430 msgr2=0x7fe6640693c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:38.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.026+0000 7fe66ad33700 1 -- 172.21.15.146:0/1032829927 shutdown_connections 2023-10-06T11:17:38.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.026+0000 7fe66ad33700 1 -- 172.21.15.146:0/1032829927 wait complete. 2023-10-06T11:17:38.040 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.11:0 scrub status 2023-10-06T11:17:38.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.155+0000 7fc437e2a700 1 Processor -- start 2023-10-06T11:17:38.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.155+0000 7fc437e2a700 1 -- start start 2023-10-06T11:17:38.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.156+0000 7fc437e2a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc430159450 0x7fc430159820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:38.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.156+0000 7fc437e2a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4300cb8a0 con 0x7fc43015dd70 2023-10-06T11:17:38.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.156+0000 7fc437e2a700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4300b2960 con 0x7fc4300b0930 2023-10-06T11:17:38.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.156+0000 7fc437e2a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4300b2f20 con 0x7fc430159450 2023-10-06T11:17:38.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.156+0000 7fc435bc6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc430159450 0x7fc430159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:38.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.156+0000 7fc435bc6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc430159450 0x7fc430159820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46094/0 (socket says 172.21.15.146:46094) 2023-10-06T11:17:38.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.156+0000 7fc435bc6700 1 -- 172.21.15.146:0/319390804 learned_addr learned my addr 172.21.15.146:0/319390804 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:38.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.156+0000 7fc4353c5700 1 --1- 172.21.15.146:0/319390804 >> v1:172.21.15.146:6789/0 conn(0x7fc43015dd70 0x7fc4300b0220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:37346/0 (socket says 172.21.15.146:37346) 2023-10-06T11:17:38.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.157+0000 7fc435bc6700 1 -- 172.21.15.146:0/319390804 >> v1:172.21.15.151:6789/0 conn(0x7fc4300b0930 legacy=0x7fc4300aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:38.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.157+0000 7fc434bc4700 1 -- 172.21.15.146:0/319390804 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 438238277 0 0) 0x7fc4300cb8a0 con 0x7fc43015dd70 2023-10-06T11:17:38.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.157+0000 7fc435bc6700 1 -- 172.21.15.146:0/319390804 >> v1:172.21.15.146:6789/0 conn(0x7fc43015dd70 legacy=0x7fc4300b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:38.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.157+0000 7fc435bc6700 1 -- 172.21.15.146:0/319390804 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4300b2c40 con 0x7fc430159450 2023-10-06T11:17:38.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.157+0000 7fc435bc6700 1 --2- 172.21.15.146:0/319390804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc430159450 0x7fc430159820 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7fc42c0099b0 tx=0x7fc42c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27910dd7aa03f2ad server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:38.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.157+0000 7fc434bc4700 1 -- 172.21.15.146:0/319390804 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42c00b820 con 0x7fc430159450 2023-10-06T11:17:38.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.157+0000 7fc434bc4700 1 -- 172.21.15.146:0/319390804 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc42c00b980 con 0x7fc430159450 2023-10-06T11:17:38.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.157+0000 7fc434bc4700 1 -- 172.21.15.146:0/319390804 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42c00bd20 con 0x7fc430159450 2023-10-06T11:17:38.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.157+0000 7fc437e2a700 1 -- 172.21.15.146:0/319390804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc430159450 msgr2=0x7fc430159820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:38.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.157+0000 7fc437e2a700 1 --2- 172.21.15.146:0/319390804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc430159450 0x7fc430159820 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7fc42c0099b0 tx=0x7fc42c009250 comp rx=0 tx=0).stop 2023-10-06T11:17:38.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.158+0000 7fc437e2a700 1 -- 172.21.15.146:0/319390804 shutdown_connections 2023-10-06T11:17:38.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.158+0000 7fc437e2a700 1 --2- 172.21.15.146:0/319390804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc430159450 0x7fc430159820 unknown :-1 s=CLOSED pgs=1993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.158+0000 7fc437e2a700 1 -- 172.21.15.146:0/319390804 >> 172.21.15.146:0/319390804 conn(0x7fc43006eb10 msgr2=0x7fc43006ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:38.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.158+0000 7fc437e2a700 1 -- 172.21.15.146:0/319390804 shutdown_connections 2023-10-06T11:17:38.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.158+0000 7fc437e2a700 1 -- 172.21.15.146:0/319390804 wait complete. 2023-10-06T11:17:38.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.159+0000 7fc437e2a700 1 Processor -- start 2023-10-06T11:17:38.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.159+0000 7fc437e2a700 1 -- start start 2023-10-06T11:17:38.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.160+0000 7fc437e2a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4300b0930 0x7fc43015c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:38.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.160+0000 7fc437e2a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc430159450 0x7fc4300c4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:38.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.160+0000 7fc437e2a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc43015dd70 0x7fc4300c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:38.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.160+0000 7fc437e2a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4300c7480 con 0x7fc43015dd70 2023-10-06T11:17:38.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.160+0000 7fc437e2a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4300c52d0 con 0x7fc430159450 2023-10-06T11:17:38.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.160+0000 7fc437e2a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc43015c360 con 0x7fc4300b0930 2023-10-06T11:17:38.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.160+0000 7fc4363c7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc43015dd70 0x7fc4300c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:38.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.160+0000 7fc4363c7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc43015dd70 0x7fc4300c4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46100/0 (socket says 172.21.15.146:46100) 2023-10-06T11:17:38.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.160+0000 7fc4363c7700 1 -- 172.21.15.146:0/3958221006 learned_addr learned my addr 172.21.15.146:0/3958221006 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:38.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.160+0000 7fc4353c5700 1 --2- 172.21.15.146:0/3958221006 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc430159450 0x7fc4300c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:38.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.160+0000 7fc435bc6700 1 --2- 172.21.15.146:0/3958221006 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4300b0930 0x7fc43015c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:38.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.160+0000 7fc4363c7700 1 -- 172.21.15.146:0/3958221006 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4300b0930 msgr2=0x7fc43015c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:38.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.160+0000 7fc4363c7700 1 --2- 172.21.15.146:0/3958221006 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4300b0930 0x7fc43015c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.160+0000 7fc4363c7700 1 -- 172.21.15.146:0/3958221006 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc430159450 msgr2=0x7fc4300c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:38.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.160+0000 7fc4363c7700 1 --2- 172.21.15.146:0/3958221006 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc430159450 0x7fc4300c4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.160+0000 7fc4363c7700 1 -- 172.21.15.146:0/3958221006 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc42c0094f0 con 0x7fc43015dd70 2023-10-06T11:17:38.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.160+0000 7fc4363c7700 1 --2- 172.21.15.146:0/3958221006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc43015dd70 0x7fc4300c4d90 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7fc42800c930 tx=0x7fc4280026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:38.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.160+0000 7fc425ffb700 1 -- 172.21.15.146:0/3958221006 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc428012630 con 0x7fc43015dd70 2023-10-06T11:17:38.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.160+0000 7fc425ffb700 1 -- 172.21.15.146:0/3958221006 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4280127d0 con 0x7fc43015dd70 2023-10-06T11:17:38.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.160+0000 7fc437e2a700 1 -- 172.21.15.146:0/3958221006 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc43015ba30 con 0x7fc43015dd70 2023-10-06T11:17:38.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.160+0000 7fc425ffb700 1 -- 172.21.15.146:0/3958221006 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc428012b90 con 0x7fc43015dd70 2023-10-06T11:17:38.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.161+0000 7fc437e2a700 1 -- 172.21.15.146:0/3958221006 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc43015cd30 con 0x7fc43015dd70 2023-10-06T11:17:38.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.162+0000 7fc425ffb700 1 -- 172.21.15.146:0/3958221006 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc42801b400 con 0x7fc43015dd70 2023-10-06T11:17:38.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.162+0000 7fc425ffb700 1 --2- 172.21.15.146:0/3958221006 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc414066f30 0x7fc4140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:38.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.162+0000 7fc425ffb700 1 -- 172.21.15.146:0/3958221006 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc428084a10 con 0x7fc43015dd70 2023-10-06T11:17:38.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.162+0000 7fc435bc6700 1 --2- 172.21.15.146:0/3958221006 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc414066f30 0x7fc4140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:38.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.163+0000 7fc435bc6700 1 --2- 172.21.15.146:0/3958221006 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc414066f30 0x7fc4140693e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fc42c0099b0 tx=0x7fc42c016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:38.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.164+0000 7fc441122b80 1 Processor -- start 2023-10-06T11:17:38.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.164+0000 7fc441122b80 1 -- start start 2023-10-06T11:17:38.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.165+0000 7fc441122b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4fdf63ae0 0x55f4fdf63eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:38.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.165+0000 7fc441122b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f4fdf1f9f0 0x55f4fdf1c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:38.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.165+0000 7fc441122b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f4fdf1dc20 0x55f4fdf1cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:38.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.165+0000 7fc441122b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4fde9ccd0 con 0x55f4fdf1f9f0 2023-10-06T11:17:38.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.165+0000 7fc441122b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4fde73ac0 con 0x55f4fdf63ae0 2023-10-06T11:17:38.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.165+0000 7fc441122b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f4fde712c0 con 0x55f4fdf1dc20 2023-10-06T11:17:38.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.165+0000 7fc4353c5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f4fdf1f9f0 0x55f4fdf1c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:38.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.165+0000 7fc4353c5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f4fdf1f9f0 0x55f4fdf1c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46102/0 (socket says 172.21.15.146:46102) 2023-10-06T11:17:38.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.165+0000 7fc4353c5700 1 -- 172.21.15.146:0/403609940 learned_addr learned my addr 172.21.15.146:0/403609940 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:38.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.165+0000 7fc4353c5700 1 -- 172.21.15.146:0/403609940 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f4fdf1dc20 msgr2=0x55f4fdf1cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:38.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.165+0000 7fc4353c5700 1 --2- 172.21.15.146:0/403609940 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f4fdf1dc20 0x55f4fdf1cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.165+0000 7fc4353c5700 1 -- 172.21.15.146:0/403609940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4fdf63ae0 msgr2=0x55f4fdf63eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:38.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.165+0000 7fc4353c5700 1 --2- 172.21.15.146:0/403609940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4fdf63ae0 0x55f4fdf63eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.165+0000 7fc4353c5700 1 -- 172.21.15.146:0/403609940 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f4fdd072c0 con 0x55f4fdf1f9f0 2023-10-06T11:17:38.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.166+0000 7fc4353c5700 1 --2- 172.21.15.146:0/403609940 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f4fdf1f9f0 0x55f4fdf1c5d0 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7fc420004fc0 tx=0x7fc420007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d36d6cdf1c5afed2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:38.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.166+0000 7fc41affd700 1 -- 172.21.15.146:0/403609940 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc420004a00 con 0x55f4fdf1f9f0 2023-10-06T11:17:38.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.166+0000 7fc41affd700 1 -- 172.21.15.146:0/403609940 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc420001630 con 0x55f4fdf1f9f0 2023-10-06T11:17:38.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.166+0000 7fc41affd700 1 -- 172.21.15.146:0/403609940 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4200019b0 con 0x55f4fdf1f9f0 2023-10-06T11:17:38.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.166+0000 7fc441122b80 1 -- 172.21.15.146:0/403609940 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f4fdf1f9f0 msgr2=0x55f4fdf1c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:38.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.166+0000 7fc441122b80 1 --2- 172.21.15.146:0/403609940 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f4fdf1f9f0 0x55f4fdf1c5d0 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7fc420004fc0 tx=0x7fc420007ef0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.166+0000 7fc441122b80 1 -- 172.21.15.146:0/403609940 shutdown_connections 2023-10-06T11:17:38.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.166+0000 7fc441122b80 1 --2- 172.21.15.146:0/403609940 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f4fdf1dc20 0x55f4fdf1cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.166+0000 7fc441122b80 1 --2- 172.21.15.146:0/403609940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4fdf63ae0 0x55f4fdf63eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.166+0000 7fc441122b80 1 --2- 172.21.15.146:0/403609940 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f4fdf1f9f0 0x55f4fdf1c5d0 unknown :-1 s=CLOSED pgs=1995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.166+0000 7fc441122b80 1 -- 172.21.15.146:0/403609940 >> 172.21.15.146:0/403609940 conn(0x55f4fdf1e0c0 msgr2=0x55f4fdf1e490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:38.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.166+0000 7fc441122b80 1 -- 172.21.15.146:0/403609940 shutdown_connections 2023-10-06T11:17:38.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.166+0000 7fc441122b80 1 -- 172.21.15.146:0/403609940 wait complete. 2023-10-06T11:17:38.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.167+0000 7fc441122b80 1 -- start start 2023-10-06T11:17:38.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.167+0000 7fc441122b80 1 Processor -- start 2023-10-06T11:17:38.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.168+0000 7fc441122b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4fdf1dc20 0x55f4fdf47900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:38.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.168+0000 7fc441122b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f4fdf1f9f0 0x55f4fdf44a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:38.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.168+0000 7fc441122b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f4fdf63ae0 0x55f4fdf44fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:38.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.168+0000 7fc441122b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4fde6d0b0 con 0x55f4fdf63ae0 2023-10-06T11:17:38.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.168+0000 7fc441122b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4fde188e0 con 0x55f4fdf1dc20 2023-10-06T11:17:38.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.168+0000 7fc441122b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f4fde33ef0 con 0x55f4fdf1f9f0 2023-10-06T11:17:38.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.168+0000 7fc441122b80 10 client.0 _ll_register_callbacks cb 0x55f4fdd09f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:17:38.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.168+0000 7fc4363c7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f4fdf63ae0 0x55f4fdf44fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:38.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.168+0000 7fc4363c7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f4fdf63ae0 0x55f4fdf44fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46108/0 (socket says 172.21.15.146:46108) 2023-10-06T11:17:38.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.168+0000 7fc4363c7700 1 -- 172.21.15.146:0/474993530 learned_addr learned my addr 172.21.15.146:0/474993530 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:38.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.168+0000 7fc435bc6700 1 --2- 172.21.15.146:0/474993530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4fdf1dc20 0x55f4fdf47900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:38.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.168+0000 7fc4353c5700 1 --2- 172.21.15.146:0/474993530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f4fdf1f9f0 0x55f4fdf44a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:38.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.168+0000 7fc4363c7700 1 -- 172.21.15.146:0/474993530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f4fdf1f9f0 msgr2=0x55f4fdf44a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:38.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.168+0000 7fc4363c7700 1 --2- 172.21.15.146:0/474993530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f4fdf1f9f0 0x55f4fdf44a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.168+0000 7fc4363c7700 1 -- 172.21.15.146:0/474993530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4fdf1dc20 msgr2=0x55f4fdf47900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:38.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.168+0000 7fc4363c7700 1 --2- 172.21.15.146:0/474993530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4fdf1dc20 0x55f4fdf47900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.168+0000 7fc4363c7700 1 -- 172.21.15.146:0/474993530 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc420004bf0 con 0x55f4fdf63ae0 2023-10-06T11:17:38.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.168+0000 7fc435bc6700 1 --2- 172.21.15.146:0/474993530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4fdf1dc20 0x55f4fdf47900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:17:38.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.169+0000 7fc4363c7700 1 --2- 172.21.15.146:0/474993530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f4fdf63ae0 0x55f4fdf44fa0 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7fc428055440 tx=0x7fc428082c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cae309e153b25ea3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:38.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.169+0000 7fc40ffff700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:17:38.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.169+0000 7fc40ffff700 1 -- 172.21.15.146:0/474993530 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc428055510 con 0x55f4fdf63ae0 2023-10-06T11:17:38.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.169+0000 7fc40ffff700 1 -- 172.21.15.146:0/474993530 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc428084040 con 0x55f4fdf63ae0 2023-10-06T11:17:38.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.169+0000 7fc441122b80 1 -- 172.21.15.146:0/474993530 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f4fdf116e0 con 0x55f4fdf63ae0 2023-10-06T11:17:38.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.169+0000 7fc40ffff700 1 -- 172.21.15.146:0/474993530 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=128) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc42805c6e0 con 0x55f4fdf63ae0 2023-10-06T11:17:38.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.169+0000 7fc441122b80 10 client.9900 fetch_fsmap learned FSMap version 128 2023-10-06T11:17:38.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.169+0000 7fc441122b80 1 -- 172.21.15.146:0/474993530 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=128,monmap=2+}) v3 -- 0x55f4fdcaa030 con 0x55f4fdf63ae0 2023-10-06T11:17:38.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.169+0000 7fc40ffff700 1 -- 172.21.15.146:0/474993530 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f4fdf116e0 con 0x55f4fdf63ae0 2023-10-06T11:17:38.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.169+0000 7fc40ffff700 1 -- 172.21.15.146:0/474993530 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 128) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc428071250 con 0x55f4fdf63ae0 2023-10-06T11:17:38.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.169+0000 7fc441122b80 10 client.9900 fetch_fsmap finished waiting for FSMap version 128 2023-10-06T11:17:38.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.169+0000 7fc441122b80 10 client.9900 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.c 2023-10-06T11:17:38.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.169+0000 7fc441122b80 20 client.9900 populate_metadata read hostname 'smithi146' 2023-10-06T11:17:38.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.169+0000 7fc441122b80 1 --2- 172.21.15.146:0/474993530 >> [v2:172.21.15.146:6835/2875253990,v1:172.21.15.146:6837/2875253990] conn(0x55f4fdf60bf0 0x55f4fdf46bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:38.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.169+0000 7fc441122b80 4 client.9900 mds_command: new command op to 9648 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:17:38.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.169+0000 7fc441122b80 1 -- 172.21.15.146:0/474993530 --> [v2:172.21.15.146:6835/2875253990,v1:172.21.15.146:6837/2875253990] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f4fdeee610 con 0x55f4fdf60bf0 2023-10-06T11:17:38.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.169+0000 7fc435bc6700 1 --2- 172.21.15.146:0/474993530 >> [v2:172.21.15.146:6835/2875253990,v1:172.21.15.146:6837/2875253990] conn(0x55f4fdf60bf0 0x55f4fdf46bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:38.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.169+0000 7fc40ffff700 10 client.9900 ms_handle_connect on v2:172.21.15.146:6835/2875253990 2023-10-06T11:17:38.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.169+0000 7fc435bc6700 1 --2- 172.21.15.146:0/474993530 >> [v2:172.21.15.146:6835/2875253990,v1:172.21.15.146:6837/2875253990] conn(0x55f4fdf60bf0 0x55f4fdf46bb0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cd3892e545a3b3a server_cookie=2015f95d84f591bd in_seq=0 out_seq=0 2023-10-06T11:17:38.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.170+0000 7fc40ffff700 1 -- 172.21.15.146:0/474993530 <== mds.0 v2:172.21.15.146:6835/2875253990 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55f4fdeee610 con 0x55f4fdf60bf0 2023-10-06T11:17:38.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.170+0000 7fc40ffff700 10 client.9900 handle_command_reply: tid=0 2023-10-06T11:17:38.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.170+0000 7fc441122b80 1 client.9900 shutdown 2023-10-06T11:17:38.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.170+0000 7fc441122b80 1 -- 172.21.15.146:0/474993530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f4fdf63ae0 msgr2=0x55f4fdf44fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:38.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.170+0000 7fc441122b80 1 --2- 172.21.15.146:0/474993530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f4fdf63ae0 0x55f4fdf44fa0 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7fc428055440 tx=0x7fc428082c90 comp rx=0 tx=0).stop 2023-10-06T11:17:38.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.170+0000 7fc441122b80 1 -- 172.21.15.146:0/474993530 shutdown_connections 2023-10-06T11:17:38.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.170+0000 7fc441122b80 1 --2- 172.21.15.146:0/474993530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f4fdf63ae0 0x55f4fdf44fa0 unknown :-1 s=CLOSED pgs=1996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.170+0000 7fc441122b80 1 --2- 172.21.15.146:0/474993530 >> [v2:172.21.15.146:6835/2875253990,v1:172.21.15.146:6837/2875253990] conn(0x55f4fdf60bf0 0x55f4fdf46bb0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.170+0000 7fc441122b80 1 --2- 172.21.15.146:0/474993530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4fdf1dc20 0x55f4fdf47900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.170+0000 7fc40ffff700 0 client.9900 ms_handle_reset on v2:172.21.15.146:6835/2875253990 2023-10-06T11:17:38.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.170+0000 7fc441122b80 1 --2- 172.21.15.146:0/474993530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f4fdf1f9f0 0x55f4fdf44a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.170+0000 7fc441122b80 1 -- 172.21.15.146:0/474993530 >> 172.21.15.146:0/474993530 conn(0x55f4fdf1e0c0 msgr2=0x55f4fdf61550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:38.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.170+0000 7fc441122b80 1 -- 172.21.15.146:0/474993530 shutdown_connections 2023-10-06T11:17:38.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.170+0000 7fc441122b80 1 -- 172.21.15.146:0/474993530 wait complete. 2023-10-06T11:17:38.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.170+0000 7fc441122b80 20 client.9900 trim_cache size 0 max 16384 2023-10-06T11:17:38.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.186+0000 7fc441122b80 1 Processor -- start 2023-10-06T11:17:38.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.186+0000 7fc441122b80 1 -- start start 2023-10-06T11:17:38.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.187+0000 7fc441122b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4fdf1e0c0 0x55f4fdf7c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:38.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.187+0000 7fc441122b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f4fdf1dc20 0x55f4fdf7ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:38.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.187+0000 7fc441122b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f4fdf1f9f0 0x55f4fdf18820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:38.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.187+0000 7fc441122b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4fdcefe80 con 0x55f4fdf1dc20 2023-10-06T11:17:38.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.187+0000 7fc441122b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4fdf85640 con 0x55f4fdf1e0c0 2023-10-06T11:17:38.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.187+0000 7fc441122b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f4fdf1ba50 con 0x55f4fdf1f9f0 2023-10-06T11:17:38.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.187+0000 7fc4353c5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f4fdf1dc20 0x55f4fdf7ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:38.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.187+0000 7fc4353c5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f4fdf1dc20 0x55f4fdf7ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46114/0 (socket says 172.21.15.146:46114) 2023-10-06T11:17:38.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.187+0000 7fc4353c5700 1 -- 172.21.15.146:0/1594666064 learned_addr learned my addr 172.21.15.146:0/1594666064 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:38.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.187+0000 7fc4363c7700 1 --2- 172.21.15.146:0/1594666064 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f4fdf1f9f0 0x55f4fdf18820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:38.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.187+0000 7fc435bc6700 1 --2- 172.21.15.146:0/1594666064 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4fdf1e0c0 0x55f4fdf7c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:38.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.187+0000 7fc4353c5700 1 -- 172.21.15.146:0/1594666064 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f4fdf1f9f0 msgr2=0x55f4fdf18820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:38.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.187+0000 7fc4353c5700 1 --2- 172.21.15.146:0/1594666064 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f4fdf1f9f0 0x55f4fdf18820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.187+0000 7fc4353c5700 1 -- 172.21.15.146:0/1594666064 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4fdf1e0c0 msgr2=0x55f4fdf7c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:38.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.187+0000 7fc4353c5700 1 --2- 172.21.15.146:0/1594666064 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4fdf1e0c0 0x55f4fdf7c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.187+0000 7fc4353c5700 1 -- 172.21.15.146:0/1594666064 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f4fde3b7d0 con 0x55f4fdf1dc20 2023-10-06T11:17:38.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.187+0000 7fc435bc6700 1 --2- 172.21.15.146:0/1594666064 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4fdf1e0c0 0x55f4fdf7c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:17:38.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.187+0000 7fc4363c7700 1 --2- 172.21.15.146:0/1594666064 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f4fdf1f9f0 0x55f4fdf18820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:17:38.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.188+0000 7fc4353c5700 1 --2- 172.21.15.146:0/1594666064 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f4fdf1dc20 0x55f4fdf7ccf0 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7fc420007780 tx=0x7fc420018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee1e5a525d18aad server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:38.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.188+0000 7fc41b7fe700 1 -- 172.21.15.146:0/1594666064 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc420024070 con 0x55f4fdf1dc20 2023-10-06T11:17:38.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.188+0000 7fc41b7fe700 1 -- 172.21.15.146:0/1594666064 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4200049e0 con 0x55f4fdf1dc20 2023-10-06T11:17:38.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.188+0000 7fc41b7fe700 1 -- 172.21.15.146:0/1594666064 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4200017a0 con 0x55f4fdf1dc20 2023-10-06T11:17:38.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.188+0000 7fc441122b80 1 -- 172.21.15.146:0/1594666064 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f4fdf1dc20 msgr2=0x55f4fdf7ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:38.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.188+0000 7fc441122b80 1 --2- 172.21.15.146:0/1594666064 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f4fdf1dc20 0x55f4fdf7ccf0 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7fc420007780 tx=0x7fc420018000 comp rx=0 tx=0).stop 2023-10-06T11:17:38.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.188+0000 7fc441122b80 1 -- 172.21.15.146:0/1594666064 shutdown_connections 2023-10-06T11:17:38.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.188+0000 7fc441122b80 1 --2- 172.21.15.146:0/1594666064 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f4fdf1f9f0 0x55f4fdf18820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.188+0000 7fc441122b80 1 --2- 172.21.15.146:0/1594666064 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4fdf1e0c0 0x55f4fdf7c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.188+0000 7fc441122b80 1 --2- 172.21.15.146:0/1594666064 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f4fdf1dc20 0x55f4fdf7ccf0 unknown :-1 s=CLOSED pgs=1997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.188+0000 7fc441122b80 1 -- 172.21.15.146:0/1594666064 >> 172.21.15.146:0/1594666064 conn(0x55f4fdf1a8f0 msgr2=0x55f4fdf4c420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:38.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.188+0000 7fc441122b80 1 -- 172.21.15.146:0/1594666064 shutdown_connections 2023-10-06T11:17:38.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.188+0000 7fc441122b80 1 -- 172.21.15.146:0/1594666064 wait complete. 2023-10-06T11:17:38.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.189+0000 7fc441122b80 1 -- start start 2023-10-06T11:17:38.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.189+0000 7fc441122b80 1 Processor -- start 2023-10-06T11:17:38.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.190+0000 7fc441122b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f4fdf1dc20 0x55f4fdf19610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:38.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.190+0000 7fc441122b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4fdf1e0c0 0x55f4fdf69570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:38.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.190+0000 7fc441122b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f4fdf1f9f0 0x55f4fdf1ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:38.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.190+0000 7fc441122b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4fdf191e0 con 0x55f4fdf1dc20 2023-10-06T11:17:38.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.190+0000 7fc441122b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4fdf59b50 con 0x55f4fdf1e0c0 2023-10-06T11:17:38.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.190+0000 7fc441122b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f4fdf19b50 con 0x55f4fdf1f9f0 2023-10-06T11:17:38.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.190+0000 7fc441122b80 10 client.0 _ll_register_callbacks cb 0x55f4fdd09f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:17:38.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.190+0000 7fc435bc6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f4fdf1dc20 0x55f4fdf19610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:38.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.190+0000 7fc435bc6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f4fdf1dc20 0x55f4fdf19610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:46122/0 (socket says 172.21.15.146:46122) 2023-10-06T11:17:38.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.190+0000 7fc435bc6700 1 -- 172.21.15.146:0/3277387026 learned_addr learned my addr 172.21.15.146:0/3277387026 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:17:38.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.190+0000 7fc4353c5700 1 --2- 172.21.15.146:0/3277387026 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4fdf1e0c0 0x55f4fdf69570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:38.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.190+0000 7fc4363c7700 1 --2- 172.21.15.146:0/3277387026 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f4fdf1f9f0 0x55f4fdf1ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:38.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.190+0000 7fc435bc6700 1 -- 172.21.15.146:0/3277387026 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f4fdf1f9f0 msgr2=0x55f4fdf1ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:38.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.190+0000 7fc435bc6700 1 --2- 172.21.15.146:0/3277387026 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f4fdf1f9f0 0x55f4fdf1ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.190+0000 7fc435bc6700 1 -- 172.21.15.146:0/3277387026 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4fdf1e0c0 msgr2=0x55f4fdf69570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:17:38.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.190+0000 7fc435bc6700 1 --2- 172.21.15.146:0/3277387026 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4fdf1e0c0 0x55f4fdf69570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.190+0000 7fc435bc6700 1 -- 172.21.15.146:0/3277387026 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f4fdd072c0 con 0x55f4fdf1dc20 2023-10-06T11:17:38.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.190+0000 7fc4353c5700 1 --2- 172.21.15.146:0/3277387026 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4fdf1e0c0 0x55f4fdf69570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:17:38.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.190+0000 7fc435bc6700 1 --2- 172.21.15.146:0/3277387026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f4fdf1dc20 0x55f4fdf19610 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7fc42c00b3c0 tx=0x7fc42c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38d5a48140f08f88 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:17:38.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.190+0000 7fc40ffff700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:17:38.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.190+0000 7fc40ffff700 1 -- 172.21.15.146:0/3277387026 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc42c02f040 con 0x55f4fdf1dc20 2023-10-06T11:17:38.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.190+0000 7fc40ffff700 1 -- 172.21.15.146:0/3277387026 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc42c011b10 con 0x55f4fdf1dc20 2023-10-06T11:17:38.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.190+0000 7fc441122b80 1 -- 172.21.15.146:0/3277387026 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc420001630 con 0x55f4fdf1dc20 2023-10-06T11:17:38.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.190+0000 7fc40ffff700 1 -- 172.21.15.146:0/3277387026 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=128) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc42c021070 con 0x55f4fdf1dc20 2023-10-06T11:17:38.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.190+0000 7fc441122b80 10 client.9906 fetch_fsmap learned FSMap version 128 2023-10-06T11:17:38.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.190+0000 7fc441122b80 1 -- 172.21.15.146:0/3277387026 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=128,monmap=2+}) v3 -- 0x55f4fde224c0 con 0x55f4fdf1dc20 2023-10-06T11:17:38.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.191+0000 7fc40ffff700 1 -- 172.21.15.146:0/3277387026 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc420001630 con 0x55f4fdf1dc20 2023-10-06T11:17:38.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.191+0000 7fc40ffff700 1 -- 172.21.15.146:0/3277387026 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 128) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc42c034420 con 0x55f4fdf1dc20 2023-10-06T11:17:38.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.191+0000 7fc441122b80 10 client.9906 fetch_fsmap finished waiting for FSMap version 128 2023-10-06T11:17:38.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.191+0000 7fc441122b80 10 client.9906 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.c 2023-10-06T11:17:38.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.191+0000 7fc441122b80 20 client.9906 populate_metadata read hostname 'smithi146' 2023-10-06T11:17:38.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.191+0000 7fc441122b80 1 --2- 172.21.15.146:0/3277387026 >> [v2:172.21.15.146:6835/2875253990,v1:172.21.15.146:6837/2875253990] conn(0x55f4fdf63ae0 0x55f4fdf1cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:17:38.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.191+0000 7fc441122b80 4 client.9906 mds_command: new command op to 9648 tid=0[{"prefix": "scrub status"}] 2023-10-06T11:17:38.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.191+0000 7fc441122b80 1 -- 172.21.15.146:0/3277387026 --> [v2:172.21.15.146:6835/2875253990,v1:172.21.15.146:6837/2875253990] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f4fde0fe50 con 0x55f4fdf63ae0 2023-10-06T11:17:38.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.191+0000 7fc4353c5700 1 --2- 172.21.15.146:0/3277387026 >> [v2:172.21.15.146:6835/2875253990,v1:172.21.15.146:6837/2875253990] conn(0x55f4fdf63ae0 0x55f4fdf1cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:17:38.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.191+0000 7fc40ffff700 10 client.9906 ms_handle_connect on v2:172.21.15.146:6835/2875253990 2023-10-06T11:17:38.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.191+0000 7fc4353c5700 1 --2- 172.21.15.146:0/3277387026 >> [v2:172.21.15.146:6835/2875253990,v1:172.21.15.146:6837/2875253990] conn(0x55f4fdf63ae0 0x55f4fdf1cf70 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=524d3de8d1037b5f server_cookie=40f7e4dda1c6c9c4 in_seq=0 out_seq=0 2023-10-06T11:17:38.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.191+0000 7fc40ffff700 1 -- 172.21.15.146:0/3277387026 <== mds.0 v2:172.21.15.146:6835/2875253990 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+260 (crc 0 0 0) 0x55f4fde0fe50 con 0x55f4fdf63ae0 2023-10-06T11:17:38.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.191+0000 7fc40ffff700 10 client.9906 handle_command_reply: tid=0 2023-10-06T11:17:38.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.191+0000 7fc441122b80 1 client.9906 shutdown 2023-10-06T11:17:38.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.191+0000 7fc441122b80 1 -- 172.21.15.146:0/3277387026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f4fdf1dc20 msgr2=0x55f4fdf19610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:38.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.191+0000 7fc441122b80 1 --2- 172.21.15.146:0/3277387026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f4fdf1dc20 0x55f4fdf19610 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7fc42c00b3c0 tx=0x7fc42c013000 comp rx=0 tx=0).stop 2023-10-06T11:17:38.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.191+0000 7fc441122b80 1 -- 172.21.15.146:0/3277387026 shutdown_connections 2023-10-06T11:17:38.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.191+0000 7fc441122b80 1 --2- 172.21.15.146:0/3277387026 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f4fdf1f9f0 0x55f4fdf1ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.191+0000 7fc441122b80 1 --2- 172.21.15.146:0/3277387026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f4fdf1dc20 0x55f4fdf19610 unknown :-1 s=CLOSED pgs=1998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.191+0000 7fc441122b80 1 --2- 172.21.15.146:0/3277387026 >> [v2:172.21.15.146:6835/2875253990,v1:172.21.15.146:6837/2875253990] conn(0x55f4fdf63ae0 0x55f4fdf1cf70 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.192+0000 7fc441122b80 1 --2- 172.21.15.146:0/3277387026 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f4fdf1e0c0 0x55f4fdf69570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.192+0000 7fc40ffff700 0 client.9906 ms_handle_reset on v2:172.21.15.146:6835/2875253990 2023-10-06T11:17:38.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.192+0000 7fc441122b80 1 -- 172.21.15.146:0/3277387026 >> 172.21.15.146:0/3277387026 conn(0x55f4fdf1a8f0 msgr2=0x55f4fdf44a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:38.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.192+0000 7fc441122b80 1 -- 172.21.15.146:0/3277387026 shutdown_connections 2023-10-06T11:17:38.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.192+0000 7fc441122b80 1 -- 172.21.15.146:0/3277387026 wait complete. 2023-10-06T11:17:38.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.192+0000 7fc441122b80 20 client.9906 trim_cache size 0 max 16384 2023-10-06T11:17:38.203 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:17:38.203 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-06T11:17:38.203 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": { 2023-10-06T11:17:38.203 INFO:teuthology.orchestra.run.smithi146.stdout: "9be3bf16-72ac-4e41-915a-82f55086dc4c": { 2023-10-06T11:17:38.203 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/", 2023-10-06T11:17:38.203 INFO:teuthology.orchestra.run.smithi146.stdout: "tag": "9be3bf16-72ac-4e41-915a-82f55086dc4c", 2023-10-06T11:17:38.203 INFO:teuthology.orchestra.run.smithi146.stdout: "options": "recursive,repair" 2023-10-06T11:17:38.203 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:17:38.203 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:17:38.203 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:17:38.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.192+0000 7fc437e2a700 1 -- 172.21.15.146:0/3958221006 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc414066f30 msgr2=0x7fc4140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:38.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.192+0000 7fc437e2a700 1 --2- 172.21.15.146:0/3958221006 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc414066f30 0x7fc4140693e0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fc42c0099b0 tx=0x7fc42c016000 comp rx=0 tx=0).stop 2023-10-06T11:17:38.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.192+0000 7fc437e2a700 1 -- 172.21.15.146:0/3958221006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc43015dd70 msgr2=0x7fc4300c4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:17:38.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.192+0000 7fc437e2a700 1 --2- 172.21.15.146:0/3958221006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc43015dd70 0x7fc4300c4d90 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7fc42800c930 tx=0x7fc4280026e0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.192+0000 7fc437e2a700 1 -- 172.21.15.146:0/3958221006 shutdown_connections 2023-10-06T11:17:38.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.192+0000 7fc437e2a700 1 --2- 172.21.15.146:0/3958221006 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc414066f30 0x7fc4140693e0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.192+0000 7fc437e2a700 1 --2- 172.21.15.146:0/3958221006 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc43015dd70 0x7fc4300c4d90 unknown :-1 s=CLOSED pgs=1994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.192+0000 7fc437e2a700 1 --2- 172.21.15.146:0/3958221006 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4300b0930 0x7fc43015c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.192+0000 7fc437e2a700 1 --2- 172.21.15.146:0/3958221006 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc430159450 0x7fc4300c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:17:38.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.192+0000 7fc437e2a700 1 -- 172.21.15.146:0/3958221006 >> 172.21.15.146:0/3958221006 conn(0x7fc43006eb10 msgr2=0x7fc4300cf300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:17:38.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.192+0000 7fc437e2a700 1 -- 172.21.15.146:0/3958221006 shutdown_connections 2023-10-06T11:17:38.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:17:38.192+0000 7fc437e2a700 1 -- 172.21.15.146:0/3958221006 wait complete. 2023-10-06T11:17:38.206 INFO:tasks.cephfs.filesystem:scrub status for tag:9be3bf16-72ac-4e41-915a-82f55086dc4c - {'path': '/', 'tag': '9be3bf16-72ac-4e41-915a-82f55086dc4c', 'options': 'recursive,repair'} 2023-10-06T11:17:51.597 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:17:51.599 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:18:08.207 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.11:0 scrub status 2023-10-06T11:18:08.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.336+0000 7ff4cb1cd700 1 Processor -- start 2023-10-06T11:18:08.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.337+0000 7ff4cb1cd700 1 -- start start 2023-10-06T11:18:08.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.337+0000 7ff4cb1cd700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff4c4157870 0x7ff4c415b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:08.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.337+0000 7ff4cb1cd700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4c40b0320 con 0x7ff4c41574a0 2023-10-06T11:18:08.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.337+0000 7ff4cb1cd700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4c40afd40 con 0x7ff4c415b740 2023-10-06T11:18:08.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.337+0000 7ff4cb1cd700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4c415bb90 con 0x7ff4c4157870 2023-10-06T11:18:08.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.338+0000 7ff4c8f69700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff4c41574a0 0x7ff4c40b07b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39722/0 (socket says 172.21.15.146:39722) 2023-10-06T11:18:08.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.338+0000 7ff4c8f69700 1 -- 172.21.15.146:0/1901501319 learned_addr learned my addr 172.21.15.146:0/1901501319 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:08.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.338+0000 7ff4c3fff700 1 --2- 172.21.15.146:0/1901501319 >> v2:172.21.15.151:3300/0 conn(0x7ff4c4157870 0x7ff4c415b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:08.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.338+0000 7ff4c37fe700 1 -- 172.21.15.146:0/1901501319 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 67569417 0 0) 0x7ff4c40b0320 con 0x7ff4c41574a0 2023-10-06T11:18:08.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.338+0000 7ff4c37fe700 1 -- 172.21.15.146:0/1901501319 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4ac003570 con 0x7ff4c41574a0 2023-10-06T11:18:08.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.338+0000 7ff4c37fe700 1 -- 172.21.15.146:0/1901501319 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1661334214 0 0) 0x7ff4c40afd40 con 0x7ff4c415b740 2023-10-06T11:18:08.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.338+0000 7ff4c37fe700 1 -- 172.21.15.146:0/1901501319 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4c40b0320 con 0x7ff4c415b740 2023-10-06T11:18:08.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.338+0000 7ff4c3fff700 1 -- 172.21.15.146:0/1901501319 >> v1:172.21.15.151:6789/0 conn(0x7ff4c415b740 legacy=0x7ff4c40adcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:08.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.338+0000 7ff4c3fff700 1 -- 172.21.15.146:0/1901501319 >> v1:172.21.15.146:6789/0 conn(0x7ff4c41574a0 legacy=0x7ff4c40b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:08.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.338+0000 7ff4c37fe700 1 -- 172.21.15.146:0/1901501319 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1547879041 0 0) 0x7ff4ac003570 con 0x7ff4c41574a0 2023-10-06T11:18:08.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.338+0000 7ff4c3fff700 1 -- 172.21.15.146:0/1901501319 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c40b3df0 con 0x7ff4c4157870 2023-10-06T11:18:08.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.338+0000 7ff4c3fff700 1 --2- 172.21.15.146:0/1901501319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4c4157870 0x7ff4c415b200 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ff4b80098e0 tx=0x7ff4b80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3985ad32087a386 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:08.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.338+0000 7ff4c37fe700 1 -- 172.21.15.146:0/1901501319 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b40017f0 con 0x7ff4c4157870 2023-10-06T11:18:08.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.338+0000 7ff4c37fe700 1 -- 172.21.15.146:0/1901501319 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b8011420 con 0x7ff4c4157870 2023-10-06T11:18:08.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.339+0000 7ff4c37fe700 1 -- 172.21.15.146:0/1901501319 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b80117c0 con 0x7ff4c4157870 2023-10-06T11:18:08.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.339+0000 7ff4cb1cd700 1 -- 172.21.15.146:0/1901501319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4c4157870 msgr2=0x7ff4c415b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:08.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.339+0000 7ff4cb1cd700 1 --2- 172.21.15.146:0/1901501319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4c4157870 0x7ff4c415b200 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ff4b80098e0 tx=0x7ff4b80091a0 comp rx=0 tx=0).stop 2023-10-06T11:18:08.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.339+0000 7ff4cb1cd700 1 -- 172.21.15.146:0/1901501319 shutdown_connections 2023-10-06T11:18:08.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.339+0000 7ff4cb1cd700 1 --2- 172.21.15.146:0/1901501319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4c4157870 0x7ff4c415b200 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:08.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.339+0000 7ff4cb1cd700 1 -- 172.21.15.146:0/1901501319 >> 172.21.15.146:0/1901501319 conn(0x7ff4c4067ea0 msgr2=0x7ff4c40ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:08.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.339+0000 7ff4cb1cd700 1 -- 172.21.15.146:0/1901501319 shutdown_connections 2023-10-06T11:18:08.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.339+0000 7ff4cb1cd700 1 -- 172.21.15.146:0/1901501319 wait complete. 2023-10-06T11:18:08.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.340+0000 7ff4cb1cd700 1 Processor -- start 2023-10-06T11:18:08.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.340+0000 7ff4cb1cd700 1 -- start start 2023-10-06T11:18:08.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.341+0000 7ff4cb1cd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4c41574a0 0x7ff4c416ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:08.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.341+0000 7ff4cb1cd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4c4157870 0x7ff4c40c9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:08.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.341+0000 7ff4cb1cd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4c415b740 0x7ff4c4168170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:08.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.341+0000 7ff4cb1cd700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c4154180 con 0x7ff4c41574a0 2023-10-06T11:18:08.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.341+0000 7ff4cb1cd700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c41686b0 con 0x7ff4c4157870 2023-10-06T11:18:08.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.341+0000 7ff4cb1cd700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c40c55a0 con 0x7ff4c415b740 2023-10-06T11:18:08.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.341+0000 7ff4c8f69700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4c41574a0 0x7ff4c416ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:08.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.341+0000 7ff4c8f69700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4c41574a0 0x7ff4c416ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47788/0 (socket says 172.21.15.146:47788) 2023-10-06T11:18:08.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.341+0000 7ff4c8f69700 1 -- 172.21.15.146:0/3286637167 learned_addr learned my addr 172.21.15.146:0/3286637167 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:08.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.341+0000 7ff4c8f69700 1 -- 172.21.15.146:0/3286637167 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4c415b740 msgr2=0x7ff4c4168170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:08.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.341+0000 7ff4c976a700 1 --2- 172.21.15.146:0/3286637167 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4c415b740 0x7ff4c4168170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:08.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.341+0000 7ff4c3fff700 1 --2- 172.21.15.146:0/3286637167 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4c4157870 0x7ff4c40c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:08.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.341+0000 7ff4c8f69700 1 --2- 172.21.15.146:0/3286637167 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4c415b740 0x7ff4c4168170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:08.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.341+0000 7ff4c8f69700 1 -- 172.21.15.146:0/3286637167 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4c4157870 msgr2=0x7ff4c40c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:08.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.341+0000 7ff4c8f69700 1 --2- 172.21.15.146:0/3286637167 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4c4157870 0x7ff4c40c9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:08.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.342+0000 7ff4c8f69700 1 -- 172.21.15.146:0/3286637167 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b8009420 con 0x7ff4c41574a0 2023-10-06T11:18:08.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.342+0000 7ff4c8f69700 1 --2- 172.21.15.146:0/3286637167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4c41574a0 0x7ff4c416ad50 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7ff4b400ccc0 tx=0x7ff4b4007da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:08.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.342+0000 7ff4c0ff9700 1 -- 172.21.15.146:0/3286637167 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4004dc0 con 0x7ff4c41574a0 2023-10-06T11:18:08.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.342+0000 7ff4c0ff9700 1 -- 172.21.15.146:0/3286637167 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b400a920 con 0x7ff4c41574a0 2023-10-06T11:18:08.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.342+0000 7ff4cb1cd700 1 -- 172.21.15.146:0/3286637167 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4c416b330 con 0x7ff4c41574a0 2023-10-06T11:18:08.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.342+0000 7ff4c0ff9700 1 -- 172.21.15.146:0/3286637167 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b400ace0 con 0x7ff4c41574a0 2023-10-06T11:18:08.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.342+0000 7ff4cb1cd700 1 -- 172.21.15.146:0/3286637167 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c416b8f0 con 0x7ff4c41574a0 2023-10-06T11:18:08.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.343+0000 7ff4c0ff9700 1 -- 172.21.15.146:0/3286637167 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff4b4007360 con 0x7ff4c41574a0 2023-10-06T11:18:08.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.343+0000 7ff4c0ff9700 1 --2- 172.21.15.146:0/3286637167 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff4b0066f30 0x7ff4b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:08.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.344+0000 7ff4c0ff9700 1 -- 172.21.15.146:0/3286637167 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff4b40841d0 con 0x7ff4c41574a0 2023-10-06T11:18:08.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.344+0000 7ff4c3fff700 1 --2- 172.21.15.146:0/3286637167 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff4b0066f30 0x7ff4b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:08.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.344+0000 7ff4c3fff700 1 --2- 172.21.15.146:0/3286637167 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff4b0066f30 0x7ff4b00693e0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7ff4c40c4fb0 tx=0x7ff4b8016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:08.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.346+0000 7ff4d44c5b80 1 Processor -- start 2023-10-06T11:18:08.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.346+0000 7ff4d44c5b80 1 -- start start 2023-10-06T11:18:08.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.346+0000 7ff4d44c5b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593206e4ae0 0x5593206e4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:08.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.346+0000 7ff4d44c5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5593206a09f0 0x55932069d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:08.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.346+0000 7ff4d44c5b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55932069ec20 0x55932069db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:08.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.346+0000 7ff4d44c5b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55932061dcd0 con 0x5593206e4ae0 2023-10-06T11:18:08.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.346+0000 7ff4d44c5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593205f4ac0 con 0x5593206a09f0 2023-10-06T11:18:08.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.346+0000 7ff4d44c5b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5593205f22c0 con 0x55932069ec20 2023-10-06T11:18:08.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.346+0000 7ff4c8f69700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593206e4ae0 0x5593206e4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:08.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.346+0000 7ff4c8f69700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593206e4ae0 0x5593206e4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47804/0 (socket says 172.21.15.146:47804) 2023-10-06T11:18:08.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.346+0000 7ff4c8f69700 1 -- 172.21.15.146:0/4266239039 learned_addr learned my addr 172.21.15.146:0/4266239039 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:08.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.347+0000 7ff4c8f69700 1 -- 172.21.15.146:0/4266239039 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55932069ec20 msgr2=0x55932069db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:08.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.347+0000 7ff4c8f69700 1 --2- 172.21.15.146:0/4266239039 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55932069ec20 0x55932069db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:08.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.347+0000 7ff4c8f69700 1 -- 172.21.15.146:0/4266239039 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5593206a09f0 msgr2=0x55932069d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:08.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.347+0000 7ff4c8f69700 1 --2- 172.21.15.146:0/4266239039 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5593206a09f0 0x55932069d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:08.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.347+0000 7ff4c8f69700 1 -- 172.21.15.146:0/4266239039 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5593204882c0 con 0x5593206e4ae0 2023-10-06T11:18:08.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.347+0000 7ff4c8f69700 1 --2- 172.21.15.146:0/4266239039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593206e4ae0 0x5593206e4eb0 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4082560 tx=0x7ff4b40824f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80ceafe6ffc72fa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:08.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.347+0000 7ff4a9ffb700 1 -- 172.21.15.146:0/4266239039 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b400ae40 con 0x5593206e4ae0 2023-10-06T11:18:08.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.347+0000 7ff4a9ffb700 1 -- 172.21.15.146:0/4266239039 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b4055720 con 0x5593206e4ae0 2023-10-06T11:18:08.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.347+0000 7ff4a9ffb700 1 -- 172.21.15.146:0/4266239039 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4055020 con 0x5593206e4ae0 2023-10-06T11:18:08.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.348+0000 7ff4d44c5b80 1 -- 172.21.15.146:0/4266239039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593206e4ae0 msgr2=0x5593206e4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:08.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.348+0000 7ff4d44c5b80 1 --2- 172.21.15.146:0/4266239039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593206e4ae0 0x5593206e4eb0 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4082560 tx=0x7ff4b40824f0 comp rx=0 tx=0).stop 2023-10-06T11:18:08.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.348+0000 7ff4d44c5b80 1 -- 172.21.15.146:0/4266239039 shutdown_connections 2023-10-06T11:18:08.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.348+0000 7ff4d44c5b80 1 --2- 172.21.15.146:0/4266239039 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55932069ec20 0x55932069db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:08.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.348+0000 7ff4d44c5b80 1 --2- 172.21.15.146:0/4266239039 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593206e4ae0 0x5593206e4eb0 unknown :-1 s=CLOSED pgs=2001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:08.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.348+0000 7ff4d44c5b80 1 --2- 172.21.15.146:0/4266239039 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5593206a09f0 0x55932069d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:08.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.348+0000 7ff4d44c5b80 1 -- 172.21.15.146:0/4266239039 >> 172.21.15.146:0/4266239039 conn(0x55932069f0c0 msgr2=0x55932069f490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:08.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.348+0000 7ff4d44c5b80 1 -- 172.21.15.146:0/4266239039 shutdown_connections 2023-10-06T11:18:08.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.348+0000 7ff4d44c5b80 1 -- 172.21.15.146:0/4266239039 wait complete. 2023-10-06T11:18:08.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.348+0000 7ff4d44c5b80 1 -- start start 2023-10-06T11:18:08.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.348+0000 7ff4d44c5b80 1 Processor -- start 2023-10-06T11:18:08.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.349+0000 7ff4d44c5b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55932069ec20 0x5593206c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:08.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.349+0000 7ff4d44c5b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5593206a09f0 0x5593206f4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:08.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.349+0000 7ff4d44c5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5593206e4ae0 0x5593206c5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:08.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.349+0000 7ff4d44c5b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593205ee0b0 con 0x55932069ec20 2023-10-06T11:18:08.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.349+0000 7ff4d44c5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593205998e0 con 0x5593206e4ae0 2023-10-06T11:18:08.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.349+0000 7ff4d44c5b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5593205b4ef0 con 0x5593206a09f0 2023-10-06T11:18:08.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.349+0000 7ff4d44c5b80 10 client.0 _ll_register_callbacks cb 0x55932048af80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:18:08.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.349+0000 7ff4c8f69700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55932069ec20 0x5593206c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:08.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.349+0000 7ff4c8f69700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55932069ec20 0x5593206c8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47808/0 (socket says 172.21.15.146:47808) 2023-10-06T11:18:08.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.349+0000 7ff4c8f69700 1 -- 172.21.15.146:0/1472829678 learned_addr learned my addr 172.21.15.146:0/1472829678 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:08.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.350+0000 7ff4c8f69700 1 -- 172.21.15.146:0/1472829678 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5593206a09f0 msgr2=0x5593206f4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:08.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.350+0000 7ff4c976a700 1 --2- 172.21.15.146:0/1472829678 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5593206e4ae0 0x5593206c5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:08.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.350+0000 7ff4c3fff700 1 --2- 172.21.15.146:0/1472829678 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5593206a09f0 0x5593206f4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:08.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.350+0000 7ff4c8f69700 1 --2- 172.21.15.146:0/1472829678 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5593206a09f0 0x5593206f4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:08.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.350+0000 7ff4c8f69700 1 -- 172.21.15.146:0/1472829678 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5593206e4ae0 msgr2=0x5593206c5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:08.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.350+0000 7ff4c8f69700 1 --2- 172.21.15.146:0/1472829678 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5593206e4ae0 0x5593206c5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:08.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.350+0000 7ff4c8f69700 1 -- 172.21.15.146:0/1472829678 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4c416b8f0 con 0x55932069ec20 2023-10-06T11:18:08.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.350+0000 7ff4c8f69700 1 --2- 172.21.15.146:0/1472829678 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55932069ec20 0x5593206c8b20 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4058fd0 tx=0x7ff4b406b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71f1fef9c56f5f64 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:08.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.350+0000 7ff4a2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:18:08.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.350+0000 7ff4a2ffd700 1 -- 172.21.15.146:0/1472829678 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4081070 con 0x55932069ec20 2023-10-06T11:18:08.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.350+0000 7ff4a2ffd700 1 -- 172.21.15.146:0/1472829678 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff4b4058270 con 0x55932069ec20 2023-10-06T11:18:08.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.350+0000 7ff4d44c5b80 1 -- 172.21.15.146:0/1472829678 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5593206926e0 con 0x55932069ec20 2023-10-06T11:18:08.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.350+0000 7ff4a2ffd700 1 -- 172.21.15.146:0/1472829678 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=128) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff4b405bfc0 con 0x55932069ec20 2023-10-06T11:18:08.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.350+0000 7ff4d44c5b80 10 client.9918 fetch_fsmap learned FSMap version 128 2023-10-06T11:18:08.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.350+0000 7ff4d44c5b80 1 -- 172.21.15.146:0/1472829678 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=128,monmap=2+}) v3 -- 0x55932042b030 con 0x55932069ec20 2023-10-06T11:18:08.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.350+0000 7ff4a2ffd700 1 -- 172.21.15.146:0/1472829678 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5593206926e0 con 0x55932069ec20 2023-10-06T11:18:08.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.350+0000 7ff4a2ffd700 1 -- 172.21.15.146:0/1472829678 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 128) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff4b405bb30 con 0x55932069ec20 2023-10-06T11:18:08.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.350+0000 7ff4d44c5b80 10 client.9918 fetch_fsmap finished waiting for FSMap version 128 2023-10-06T11:18:08.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.350+0000 7ff4d44c5b80 10 client.9918 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.c 2023-10-06T11:18:08.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.350+0000 7ff4d44c5b80 20 client.9918 populate_metadata read hostname 'smithi146' 2023-10-06T11:18:08.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.350+0000 7ff4d44c5b80 1 --2- 172.21.15.146:0/1472829678 >> [v2:172.21.15.146:6835/2875253990,v1:172.21.15.146:6837/2875253990] conn(0x5593206de4b0 0x5593206c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:08.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.350+0000 7ff4d44c5b80 4 client.9918 mds_command: new command op to 9648 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:18:08.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.350+0000 7ff4d44c5b80 1 -- 172.21.15.146:0/1472829678 --> [v2:172.21.15.146:6835/2875253990,v1:172.21.15.146:6837/2875253990] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55932066f610 con 0x5593206de4b0 2023-10-06T11:18:08.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.350+0000 7ff4c3fff700 1 --2- 172.21.15.146:0/1472829678 >> [v2:172.21.15.146:6835/2875253990,v1:172.21.15.146:6837/2875253990] conn(0x5593206de4b0 0x5593206c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:08.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.351+0000 7ff4a2ffd700 10 client.9918 ms_handle_connect on v2:172.21.15.146:6835/2875253990 2023-10-06T11:18:08.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.351+0000 7ff4c3fff700 1 --2- 172.21.15.146:0/1472829678 >> [v2:172.21.15.146:6835/2875253990,v1:172.21.15.146:6837/2875253990] conn(0x5593206de4b0 0x5593206c93e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97806c8282a992d server_cookie=fcc2d1384164393d in_seq=0 out_seq=0 2023-10-06T11:18:08.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.351+0000 7ff4a2ffd700 1 -- 172.21.15.146:0/1472829678 <== mds.0 v2:172.21.15.146:6835/2875253990 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55932066f610 con 0x5593206de4b0 2023-10-06T11:18:08.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.351+0000 7ff4a2ffd700 10 client.9918 handle_command_reply: tid=0 2023-10-06T11:18:08.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.351+0000 7ff4d44c5b80 1 client.9918 shutdown 2023-10-06T11:18:08.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.351+0000 7ff4d44c5b80 1 -- 172.21.15.146:0/1472829678 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55932069ec20 msgr2=0x5593206c8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:08.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.351+0000 7ff4d44c5b80 1 --2- 172.21.15.146:0/1472829678 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55932069ec20 0x5593206c8b20 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4058fd0 tx=0x7ff4b406b000 comp rx=0 tx=0).stop 2023-10-06T11:18:08.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.351+0000 7ff4d44c5b80 1 -- 172.21.15.146:0/1472829678 shutdown_connections 2023-10-06T11:18:08.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.351+0000 7ff4d44c5b80 1 --2- 172.21.15.146:0/1472829678 >> [v2:172.21.15.146:6835/2875253990,v1:172.21.15.146:6837/2875253990] conn(0x5593206de4b0 0x5593206c93e0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:08.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.352+0000 7ff4d44c5b80 1 --2- 172.21.15.146:0/1472829678 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5593206e4ae0 0x5593206c5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:08.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.352+0000 7ff4d44c5b80 1 --2- 172.21.15.146:0/1472829678 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55932069ec20 0x5593206c8b20 unknown :-1 s=CLOSED pgs=2002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:08.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.352+0000 7ff4a2ffd700 0 client.9918 ms_handle_reset on v2:172.21.15.146:6835/2875253990 2023-10-06T11:18:08.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.352+0000 7ff4d44c5b80 1 --2- 172.21.15.146:0/1472829678 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5593206a09f0 0x5593206f4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:08.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.352+0000 7ff4d44c5b80 1 -- 172.21.15.146:0/1472829678 >> 172.21.15.146:0/1472829678 conn(0x55932069f0c0 msgr2=0x5593206e25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:08.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.352+0000 7ff4d44c5b80 1 -- 172.21.15.146:0/1472829678 shutdown_connections 2023-10-06T11:18:08.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.352+0000 7ff4d44c5b80 1 -- 172.21.15.146:0/1472829678 wait complete. 2023-10-06T11:18:08.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.352+0000 7ff4d44c5b80 20 client.9918 trim_cache size 0 max 16384 2023-10-06T11:18:08.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.368+0000 7ff4d44c5b80 1 Processor -- start 2023-10-06T11:18:08.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.368+0000 7ff4d44c5b80 1 -- start start 2023-10-06T11:18:08.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.369+0000 7ff4d44c5b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55932069ec20 0x5593206c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:08.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.369+0000 7ff4d44c5b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5593206a09f0 0x5593206e7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:08.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.369+0000 7ff4d44c5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5593206e4ae0 0x5593206e83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:08.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.369+0000 7ff4d44c5b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x559320470e80 con 0x55932069ec20 2023-10-06T11:18:08.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.369+0000 7ff4d44c5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593206e7c60 con 0x5593206e4ae0 2023-10-06T11:18:08.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.369+0000 7ff4d44c5b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x559320698110 con 0x5593206a09f0 2023-10-06T11:18:08.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.369+0000 7ff4c8f69700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55932069ec20 0x5593206c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:08.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.369+0000 7ff4c8f69700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55932069ec20 0x5593206c6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47824/0 (socket says 172.21.15.146:47824) 2023-10-06T11:18:08.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.369+0000 7ff4c8f69700 1 -- 172.21.15.146:0/4020919183 learned_addr learned my addr 172.21.15.146:0/4020919183 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:08.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.369+0000 7ff4c976a700 1 --2- 172.21.15.146:0/4020919183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5593206e4ae0 0x5593206e83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:08.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.369+0000 7ff4c3fff700 1 --2- 172.21.15.146:0/4020919183 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5593206a09f0 0x5593206e7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:08.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.369+0000 7ff4c8f69700 1 -- 172.21.15.146:0/4020919183 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5593206a09f0 msgr2=0x5593206e7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:08.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.369+0000 7ff4c8f69700 1 --2- 172.21.15.146:0/4020919183 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5593206a09f0 0x5593206e7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:08.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.369+0000 7ff4c8f69700 1 -- 172.21.15.146:0/4020919183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5593206e4ae0 msgr2=0x5593206e83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:08.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.369+0000 7ff4c8f69700 1 --2- 172.21.15.146:0/4020919183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5593206e4ae0 0x5593206e83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:08.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.369+0000 7ff4c8f69700 1 -- 172.21.15.146:0/4020919183 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5593205bc7d0 con 0x55932069ec20 2023-10-06T11:18:08.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.369+0000 7ff4c8f69700 1 --2- 172.21.15.146:0/4020919183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55932069ec20 0x5593206c6a00 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4055560 tx=0x7ff4b4081000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84ada303349ec08 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:08.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.369+0000 7ff4aa7fc700 1 -- 172.21.15.146:0/4020919183 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b400ae40 con 0x55932069ec20 2023-10-06T11:18:08.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.369+0000 7ff4aa7fc700 1 -- 172.21.15.146:0/4020919183 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b4055070 con 0x55932069ec20 2023-10-06T11:18:08.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.369+0000 7ff4aa7fc700 1 -- 172.21.15.146:0/4020919183 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b4058270 con 0x55932069ec20 2023-10-06T11:18:08.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.370+0000 7ff4d44c5b80 1 -- 172.21.15.146:0/4020919183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55932069ec20 msgr2=0x5593206c6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:08.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.370+0000 7ff4d44c5b80 1 --2- 172.21.15.146:0/4020919183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55932069ec20 0x5593206c6a00 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4055560 tx=0x7ff4b4081000 comp rx=0 tx=0).stop 2023-10-06T11:18:08.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.370+0000 7ff4d44c5b80 1 -- 172.21.15.146:0/4020919183 shutdown_connections 2023-10-06T11:18:08.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.370+0000 7ff4d44c5b80 1 --2- 172.21.15.146:0/4020919183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5593206e4ae0 0x5593206e83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:08.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.370+0000 7ff4d44c5b80 1 --2- 172.21.15.146:0/4020919183 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55932069ec20 0x5593206c6a00 unknown :-1 s=CLOSED pgs=2003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:08.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.370+0000 7ff4d44c5b80 1 --2- 172.21.15.146:0/4020919183 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5593206a09f0 0x5593206e7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:08.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.370+0000 7ff4d44c5b80 1 -- 172.21.15.146:0/4020919183 >> 172.21.15.146:0/4020919183 conn(0x55932069f0c0 msgr2=0x55932069a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:08.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.370+0000 7ff4d44c5b80 1 -- 172.21.15.146:0/4020919183 shutdown_connections 2023-10-06T11:18:08.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.370+0000 7ff4d44c5b80 1 -- 172.21.15.146:0/4020919183 wait complete. 2023-10-06T11:18:08.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.370+0000 7ff4d44c5b80 1 -- start start 2023-10-06T11:18:08.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.371+0000 7ff4d44c5b80 1 Processor -- start 2023-10-06T11:18:08.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.371+0000 7ff4d44c5b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55932069ec20 0x559320748bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:08.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.371+0000 7ff4d44c5b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593206a09f0 0x5593206f6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:08.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.371+0000 7ff4d44c5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5593206e4ae0 0x5593206e7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:08.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.371+0000 7ff4d44c5b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593206c59d0 con 0x5593206a09f0 2023-10-06T11:18:08.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.371+0000 7ff4d44c5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593206f68e0 con 0x5593206e4ae0 2023-10-06T11:18:08.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.371+0000 7ff4d44c5b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5593206dad60 con 0x55932069ec20 2023-10-06T11:18:08.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.372+0000 7ff4d44c5b80 10 client.0 _ll_register_callbacks cb 0x55932048af80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:18:08.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.372+0000 7ff4c3fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593206a09f0 0x5593206f6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:08.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.372+0000 7ff4c3fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593206a09f0 0x5593206f6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47828/0 (socket says 172.21.15.146:47828) 2023-10-06T11:18:08.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.372+0000 7ff4c3fff700 1 -- 172.21.15.146:0/981024093 learned_addr learned my addr 172.21.15.146:0/981024093 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:08.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.372+0000 7ff4c8f69700 1 --2- 172.21.15.146:0/981024093 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55932069ec20 0x559320748bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:08.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.372+0000 7ff4c976a700 1 --2- 172.21.15.146:0/981024093 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5593206e4ae0 0x5593206e7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:08.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.372+0000 7ff4c3fff700 1 -- 172.21.15.146:0/981024093 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55932069ec20 msgr2=0x559320748bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:08.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.372+0000 7ff4c3fff700 1 --2- 172.21.15.146:0/981024093 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55932069ec20 0x559320748bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:08.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.372+0000 7ff4c3fff700 1 -- 172.21.15.146:0/981024093 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5593206e4ae0 msgr2=0x5593206e7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:08.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.372+0000 7ff4c3fff700 1 --2- 172.21.15.146:0/981024093 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5593206e4ae0 0x5593206e7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:08.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.372+0000 7ff4c3fff700 1 -- 172.21.15.146:0/981024093 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55932042b030 con 0x5593206a09f0 2023-10-06T11:18:08.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.372+0000 7ff4c3fff700 1 --2- 172.21.15.146:0/981024093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593206a09f0 0x5593206f6070 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7ff4c406f080 tx=0x7ff4b8030250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f451cce7fb83bfcf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:08.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.372+0000 7ff4a2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:18:08.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.372+0000 7ff4a2ffd700 1 -- 172.21.15.146:0/981024093 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b8006a90 con 0x5593206a09f0 2023-10-06T11:18:08.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.372+0000 7ff4a2ffd700 1 -- 172.21.15.146:0/981024093 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff4b801db00 con 0x5593206a09f0 2023-10-06T11:18:08.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.372+0000 7ff4d44c5b80 1 -- 172.21.15.146:0/981024093 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff4b4055720 con 0x5593206a09f0 2023-10-06T11:18:08.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.372+0000 7ff4a2ffd700 1 -- 172.21.15.146:0/981024093 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=128) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff4b8033480 con 0x5593206a09f0 2023-10-06T11:18:08.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.372+0000 7ff4d44c5b80 10 client.9924 fetch_fsmap learned FSMap version 128 2023-10-06T11:18:08.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.372+0000 7ff4d44c5b80 1 -- 172.21.15.146:0/981024093 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=128,monmap=2+}) v3 -- 0x5593205a34c0 con 0x5593206a09f0 2023-10-06T11:18:08.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.372+0000 7ff4a2ffd700 1 -- 172.21.15.146:0/981024093 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b4055720 con 0x5593206a09f0 2023-10-06T11:18:08.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.372+0000 7ff4a2ffd700 1 -- 172.21.15.146:0/981024093 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 128) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ff4b80335e0 con 0x5593206a09f0 2023-10-06T11:18:08.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.372+0000 7ff4d44c5b80 10 client.9924 fetch_fsmap finished waiting for FSMap version 128 2023-10-06T11:18:08.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.372+0000 7ff4d44c5b80 10 client.9924 resolve_mds: resolved 11:0 to role '11:0' aka daemon mds.c 2023-10-06T11:18:08.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.372+0000 7ff4d44c5b80 20 client.9924 populate_metadata read hostname 'smithi146' 2023-10-06T11:18:08.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.372+0000 7ff4d44c5b80 1 --2- 172.21.15.146:0/981024093 >> [v2:172.21.15.146:6835/2875253990,v1:172.21.15.146:6837/2875253990] conn(0x5593206e83e0 0x5593206c4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:08.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.373+0000 7ff4d44c5b80 4 client.9924 mds_command: new command op to 9648 tid=0[{"prefix": "scrub status"}] 2023-10-06T11:18:08.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.373+0000 7ff4d44c5b80 1 -- 172.21.15.146:0/981024093 --> [v2:172.21.15.146:6835/2875253990,v1:172.21.15.146:6837/2875253990] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559320590e50 con 0x5593206e83e0 2023-10-06T11:18:08.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.373+0000 7ff4c8f69700 1 --2- 172.21.15.146:0/981024093 >> [v2:172.21.15.146:6835/2875253990,v1:172.21.15.146:6837/2875253990] conn(0x5593206e83e0 0x5593206c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:08.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.373+0000 7ff4c8f69700 1 --2- 172.21.15.146:0/981024093 >> [v2:172.21.15.146:6835/2875253990,v1:172.21.15.146:6837/2875253990] conn(0x5593206e83e0 0x5593206c4970 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0fb12f14348231a server_cookie=3807d655b4f2b3a2 in_seq=0 out_seq=0 2023-10-06T11:18:08.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.373+0000 7ff4a2ffd700 10 client.9924 ms_handle_connect on v2:172.21.15.146:6835/2875253990 2023-10-06T11:18:08.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.373+0000 7ff4a2ffd700 1 -- 172.21.15.146:0/981024093 <== mds.0 v2:172.21.15.146:6835/2875253990 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x559320590e50 con 0x5593206e83e0 2023-10-06T11:18:08.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.373+0000 7ff4a2ffd700 10 client.9924 handle_command_reply: tid=0 2023-10-06T11:18:08.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.373+0000 7ff4d44c5b80 1 client.9924 shutdown 2023-10-06T11:18:08.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.373+0000 7ff4d44c5b80 1 -- 172.21.15.146:0/981024093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593206a09f0 msgr2=0x5593206f6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:08.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.373+0000 7ff4d44c5b80 1 --2- 172.21.15.146:0/981024093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593206a09f0 0x5593206f6070 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7ff4c406f080 tx=0x7ff4b8030250 comp rx=0 tx=0).stop 2023-10-06T11:18:08.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.373+0000 7ff4d44c5b80 1 -- 172.21.15.146:0/981024093 shutdown_connections 2023-10-06T11:18:08.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.373+0000 7ff4d44c5b80 1 --2- 172.21.15.146:0/981024093 >> [v2:172.21.15.146:6835/2875253990,v1:172.21.15.146:6837/2875253990] conn(0x5593206e83e0 0x5593206c4970 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:08.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.373+0000 7ff4d44c5b80 1 --2- 172.21.15.146:0/981024093 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5593206e4ae0 0x5593206e7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:08.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.373+0000 7ff4d44c5b80 1 --2- 172.21.15.146:0/981024093 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55932069ec20 0x559320748bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:08.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.373+0000 7ff4d44c5b80 1 --2- 172.21.15.146:0/981024093 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5593206a09f0 0x5593206f6070 unknown :-1 s=CLOSED pgs=2004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:08.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.373+0000 7ff4a2ffd700 0 client.9924 ms_handle_reset on v2:172.21.15.146:6835/2875253990 2023-10-06T11:18:08.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.373+0000 7ff4d44c5b80 1 -- 172.21.15.146:0/981024093 >> 172.21.15.146:0/981024093 conn(0x55932069f0c0 msgr2=0x559320699d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:08.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.373+0000 7ff4d44c5b80 1 -- 172.21.15.146:0/981024093 shutdown_connections 2023-10-06T11:18:08.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.373+0000 7ff4d44c5b80 1 -- 172.21.15.146:0/981024093 wait complete. 2023-10-06T11:18:08.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.373+0000 7ff4d44c5b80 20 client.9924 trim_cache size 0 max 16384 2023-10-06T11:18:08.383 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:18:08.383 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "no active scrubs running", 2023-10-06T11:18:08.383 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": {} 2023-10-06T11:18:08.383 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:18:08.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.374+0000 7ff4cb1cd700 1 -- 172.21.15.146:0/3286637167 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff4b0066f30 msgr2=0x7ff4b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:08.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.374+0000 7ff4cb1cd700 1 --2- 172.21.15.146:0/3286637167 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff4b0066f30 0x7ff4b00693e0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7ff4c40c4fb0 tx=0x7ff4b8016000 comp rx=0 tx=0).stop 2023-10-06T11:18:08.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.374+0000 7ff4cb1cd700 1 -- 172.21.15.146:0/3286637167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4c41574a0 msgr2=0x7ff4c416ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:08.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.374+0000 7ff4cb1cd700 1 --2- 172.21.15.146:0/3286637167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4c41574a0 0x7ff4c416ad50 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7ff4b400ccc0 tx=0x7ff4b4007da0 comp rx=0 tx=0).stop 2023-10-06T11:18:08.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.374+0000 7ff4cb1cd700 1 -- 172.21.15.146:0/3286637167 shutdown_connections 2023-10-06T11:18:08.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.374+0000 7ff4cb1cd700 1 --2- 172.21.15.146:0/3286637167 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff4b0066f30 0x7ff4b00693e0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:08.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.374+0000 7ff4cb1cd700 1 --2- 172.21.15.146:0/3286637167 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4c415b740 0x7ff4c4168170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:08.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.374+0000 7ff4cb1cd700 1 --2- 172.21.15.146:0/3286637167 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4c41574a0 0x7ff4c416ad50 unknown :-1 s=CLOSED pgs=2000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:08.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.374+0000 7ff4cb1cd700 1 --2- 172.21.15.146:0/3286637167 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4c4157870 0x7ff4c40c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:08.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.374+0000 7ff4cb1cd700 1 -- 172.21.15.146:0/3286637167 >> 172.21.15.146:0/3286637167 conn(0x7ff4c4067ea0 msgr2=0x7ff4c406b690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:08.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.374+0000 7ff4cb1cd700 1 -- 172.21.15.146:0/3286637167 shutdown_connections 2023-10-06T11:18:08.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.374+0000 7ff4cb1cd700 1 -- 172.21.15.146:0/3286637167 wait complete. 2023-10-06T11:18:08.388 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-06T11:18:08.388 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T11:18:08.388 DEBUG:teuthology.orchestra.run.smithi146:> import os 2023-10-06T11:18:08.388 DEBUG:teuthology.orchestra.run.smithi146:> import stat 2023-10-06T11:18:08.388 DEBUG:teuthology.orchestra.run.smithi146:> import json 2023-10-06T11:18:08.388 DEBUG:teuthology.orchestra.run.smithi146:> import sys 2023-10-06T11:18:08.388 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:18:08.388 DEBUG:teuthology.orchestra.run.smithi146:> try: 2023-10-06T11:18:08.388 DEBUG:teuthology.orchestra.run.smithi146:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/sixmegs'"'"') 2023-10-06T11:18:08.389 DEBUG:teuthology.orchestra.run.smithi146:> except OSError as e: 2023-10-06T11:18:08.389 DEBUG:teuthology.orchestra.run.smithi146:> sys.exit(e.errno) 2023-10-06T11:18:08.389 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:18:08.389 DEBUG:teuthology.orchestra.run.smithi146:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2023-10-06T11:18:08.389 DEBUG:teuthology.orchestra.run.smithi146:> print(json.dumps( 2023-10-06T11:18:08.389 DEBUG:teuthology.orchestra.run.smithi146:> dict([(a, getattr(s, a)) for a in attrs]), 2023-10-06T11:18:08.389 DEBUG:teuthology.orchestra.run.smithi146:> indent=2)) 2023-10-06T11:18:08.389 DEBUG:teuthology.orchestra.run.smithi146:> ' 2023-10-06T11:18:08.458 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:18:08.458 INFO:teuthology.orchestra.run.smithi146.stdout: "st_mode": 33204, 2023-10-06T11:18:08.458 INFO:teuthology.orchestra.run.smithi146.stdout: "st_ino": 1099511627777, 2023-10-06T11:18:08.459 INFO:teuthology.orchestra.run.smithi146.stdout: "st_dev": 46, 2023-10-06T11:18:08.459 INFO:teuthology.orchestra.run.smithi146.stdout: "st_nlink": 1, 2023-10-06T11:18:08.459 INFO:teuthology.orchestra.run.smithi146.stdout: "st_uid": 1000, 2023-10-06T11:18:08.459 INFO:teuthology.orchestra.run.smithi146.stdout: "st_gid": 1275, 2023-10-06T11:18:08.459 INFO:teuthology.orchestra.run.smithi146.stdout: "st_size": 6291456, 2023-10-06T11:18:08.459 INFO:teuthology.orchestra.run.smithi146.stdout: "st_atime": 1696591056.6947634, 2023-10-06T11:18:08.459 INFO:teuthology.orchestra.run.smithi146.stdout: "st_mtime": 1696591056.732844, 2023-10-06T11:18:08.459 INFO:teuthology.orchestra.run.smithi146.stdout: "st_ctime": 1696591056.732844 2023-10-06T11:18:08.460 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:18:08.642 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:18:08.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.796+0000 7fa97c94a700 1 Processor -- start 2023-10-06T11:18:08.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.796+0000 7fa97c94a700 1 -- start start 2023-10-06T11:18:08.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.797+0000 7fa97c94a700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa97815cd50 0x7fa978068330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:08.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.797+0000 7fa97c94a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa97815d7e0 0x7fa97815dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:08.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.797+0000 7fa97c94a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa978069200 con 0x7fa97815c980 2023-10-06T11:18:08.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.797+0000 7fa97c94a700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa97815e1a0 con 0x7fa97815cd50 2023-10-06T11:18:08.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.797+0000 7fa97c94a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa97815d350 con 0x7fa97815d7e0 2023-10-06T11:18:08.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.797+0000 7fa97659c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa97815c980 0x7fa9780cfec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39734/0 (socket says 172.21.15.146:39734) 2023-10-06T11:18:08.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.797+0000 7fa97659c700 1 -- 172.21.15.146:0/1466438445 learned_addr learned my addr 172.21.15.146:0/1466438445 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:08.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.797+0000 7fa97559a700 1 -- 172.21.15.146:0/1466438445 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2281624331 0 0) 0x7fa978069200 con 0x7fa97815c980 2023-10-06T11:18:08.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.797+0000 7fa975d9b700 1 --2- 172.21.15.146:0/1466438445 >> v2:172.21.15.151:3300/0 conn(0x7fa97815cd50 0x7fa978068330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:08.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.797+0000 7fa976d9d700 1 --2- 172.21.15.146:0/1466438445 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa97815d7e0 0x7fa97815dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:08.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.797+0000 7fa97559a700 1 -- 172.21.15.146:0/1466438445 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa960003570 con 0x7fa97815c980 2023-10-06T11:18:08.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.797+0000 7fa97559a700 1 -- 172.21.15.146:0/1466438445 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3674792712 0 0) 0x7fa960003570 con 0x7fa97815c980 2023-10-06T11:18:08.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.797+0000 7fa97559a700 1 -- 172.21.15.146:0/1466438445 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa97815d7e0 msgr2=0x7fa97815dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:08.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.797+0000 7fa97559a700 1 --2- 172.21.15.146:0/1466438445 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa97815d7e0 0x7fa97815dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:08.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.797+0000 7fa97559a700 1 -- 172.21.15.146:0/1466438445 >> v2:172.21.15.151:3300/0 conn(0x7fa97815cd50 msgr2=0x7fa978068330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:08.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.797+0000 7fa97559a700 1 --2- 172.21.15.146:0/1466438445 >> v2:172.21.15.151:3300/0 conn(0x7fa97815cd50 0x7fa978068330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:08.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.797+0000 7fa97559a700 1 -- 172.21.15.146:0/1466438445 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa978068960 con 0x7fa97815c980 2023-10-06T11:18:08.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.797+0000 7fa97559a700 1 -- 172.21.15.146:0/1466438445 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fa968001470 con 0x7fa97815c980 2023-10-06T11:18:08.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.797+0000 7fa97559a700 1 -- 172.21.15.146:0/1466438445 >> v1:172.21.15.146:6789/0 conn(0x7fa97815c980 legacy=0x7fa9780cfec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:08.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.797+0000 7fa97559a700 1 --2- 172.21.15.146:0/1466438445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa960003a60 0x7fa960003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:08.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.797+0000 7fa97559a700 1 --2- 172.21.15.146:0/1466438445 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa960004810 0x7fa960004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:08.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.797+0000 7fa97559a700 1 --2- 172.21.15.146:0/1466438445 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa97815d7e0 0x7fa9600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:08.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.798+0000 7fa97559a700 1 -- 172.21.15.146:0/1466438445 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97815d350 con 0x7fa960003a60 2023-10-06T11:18:08.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.798+0000 7fa97559a700 1 -- 172.21.15.146:0/1466438445 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96000ba60 con 0x7fa960004810 2023-10-06T11:18:08.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.798+0000 7fa97559a700 1 -- 172.21.15.146:0/1466438445 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa96000bc20 con 0x7fa97815d7e0 2023-10-06T11:18:08.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.798+0000 7fa97659c700 1 --2- 172.21.15.146:0/1466438445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa960003a60 0x7fa960003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:08.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.798+0000 7fa975d9b700 1 --2- 172.21.15.146:0/1466438445 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa960004810 0x7fa960004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:08.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.798+0000 7fa976d9d700 1 --2- 172.21.15.146:0/1466438445 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa97815d7e0 0x7fa9600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:08.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.798+0000 7fa97659c700 1 -- 172.21.15.146:0/1466438445 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa97815d7e0 msgr2=0x7fa9600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:08.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.798+0000 7fa97659c700 1 --2- 172.21.15.146:0/1466438445 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa97815d7e0 0x7fa9600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:08.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.798+0000 7fa97659c700 1 -- 172.21.15.146:0/1466438445 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa960004810 msgr2=0x7fa960004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:08.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.798+0000 7fa97659c700 1 --2- 172.21.15.146:0/1466438445 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa960004810 0x7fa960004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:08.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.798+0000 7fa97659c700 1 -- 172.21.15.146:0/1466438445 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa960003570 con 0x7fa960003a60 2023-10-06T11:18:08.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.798+0000 7fa976d9d700 1 --2- 172.21.15.146:0/1466438445 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa97815d7e0 0x7fa9600051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:18:08.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.798+0000 7fa97659c700 1 --2- 172.21.15.146:0/1466438445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa960003a60 0x7fa960003e70 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7fa96800c3c0 tx=0x7fa9780cc760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53504c54ac46a9fb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:08.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.798+0000 7fa97559a700 1 -- 172.21.15.146:0/1466438445 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96800cc90 con 0x7fa960003a60 2023-10-06T11:18:08.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.798+0000 7fa97559a700 1 -- 172.21.15.146:0/1466438445 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa96800cdf0 con 0x7fa960003a60 2023-10-06T11:18:08.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.798+0000 7fa97559a700 1 -- 172.21.15.146:0/1466438445 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa968005b70 con 0x7fa960003a60 2023-10-06T11:18:08.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.799+0000 7fa97c94a700 1 -- 172.21.15.146:0/1466438445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa960003a60 msgr2=0x7fa960003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:08.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.799+0000 7fa97c94a700 1 --2- 172.21.15.146:0/1466438445 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa960003a60 0x7fa960003e70 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7fa96800c3c0 tx=0x7fa9780cc760 comp rx=0 tx=0).stop 2023-10-06T11:18:08.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.799+0000 7fa976d9d700 1 -- 172.21.15.146:0/1466438445 reap_dead start 2023-10-06T11:18:08.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.799+0000 7fa97c94a700 1 -- 172.21.15.146:0/1466438445 shutdown_connections 2023-10-06T11:18:08.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.799+0000 7fa97c94a700 1 -- 172.21.15.146:0/1466438445 >> 172.21.15.146:0/1466438445 conn(0x7fa97806eb10 msgr2=0x7fa97806ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:08.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.799+0000 7fa97c94a700 1 -- 172.21.15.146:0/1466438445 shutdown_connections 2023-10-06T11:18:08.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.799+0000 7fa97c94a700 1 -- 172.21.15.146:0/1466438445 wait complete. 2023-10-06T11:18:08.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.800+0000 7fa97c94a700 1 Processor -- start 2023-10-06T11:18:08.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.800+0000 7fa97c94a700 1 -- start start 2023-10-06T11:18:08.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.801+0000 7fa97c94a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa960003a60 0x7fa9780b4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:08.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.801+0000 7fa97c94a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9780c9200 0x7fa9780c9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:08.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.801+0000 7fa97c94a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa97816d090 0x7fa97816d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:08.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.801+0000 7fa97c94a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9780c9bb0 con 0x7fa960003a60 2023-10-06T11:18:08.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.801+0000 7fa97c94a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97816a3b0 con 0x7fa9780c9200 2023-10-06T11:18:08.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.801+0000 7fa97c94a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa978169a80 con 0x7fa97816d090 2023-10-06T11:18:08.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.801+0000 7fa97659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa960003a60 0x7fa9780b4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:08.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.801+0000 7fa97659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa960003a60 0x7fa9780b4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47848/0 (socket says 172.21.15.146:47848) 2023-10-06T11:18:08.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.801+0000 7fa97659c700 1 -- 172.21.15.146:0/3010235136 learned_addr learned my addr 172.21.15.146:0/3010235136 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:08.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.801+0000 7fa975d9b700 1 --2- 172.21.15.146:0/3010235136 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9780c9200 0x7fa9780c9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:08.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.801+0000 7fa976d9d700 1 --2- 172.21.15.146:0/3010235136 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa97816d090 0x7fa97816d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:08.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.801+0000 7fa97659c700 1 -- 172.21.15.146:0/3010235136 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa97816d090 msgr2=0x7fa97816d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:08.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.801+0000 7fa97659c700 1 --2- 172.21.15.146:0/3010235136 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa97816d090 0x7fa97816d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:08.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.801+0000 7fa97659c700 1 -- 172.21.15.146:0/3010235136 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9780c9200 msgr2=0x7fa9780c9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:08.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.801+0000 7fa97659c700 1 --2- 172.21.15.146:0/3010235136 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9780c9200 0x7fa9780c9670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:08.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.801+0000 7fa97659c700 1 -- 172.21.15.146:0/3010235136 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa978169d60 con 0x7fa960003a60 2023-10-06T11:18:08.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.801+0000 7fa97659c700 1 --2- 172.21.15.146:0/3010235136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa960003a60 0x7fa9780b4b40 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7fa9600057d0 tx=0x7fa968015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:08.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.801+0000 7fa9667fc700 1 -- 172.21.15.146:0/3010235136 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa968000fe0 con 0x7fa960003a60 2023-10-06T11:18:08.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.801+0000 7fa9667fc700 1 -- 172.21.15.146:0/3010235136 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9680072e0 con 0x7fa960003a60 2023-10-06T11:18:08.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.801+0000 7fa97c94a700 1 -- 172.21.15.146:0/3010235136 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa97816a040 con 0x7fa960003a60 2023-10-06T11:18:08.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.801+0000 7fa9667fc700 1 -- 172.21.15.146:0/3010235136 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9680076a0 con 0x7fa960003a60 2023-10-06T11:18:08.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.801+0000 7fa97c94a700 1 -- 172.21.15.146:0/3010235136 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa97816da50 con 0x7fa960003a60 2023-10-06T11:18:08.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.802+0000 7fa97c94a700 1 -- 172.21.15.146:0/3010235136 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa978063df0 con 0x7fa960003a60 2023-10-06T11:18:08.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.803+0000 7fa9667fc700 1 -- 172.21.15.146:0/3010235136 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa968019030 con 0x7fa960003a60 2023-10-06T11:18:08.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.803+0000 7fa9667fc700 1 --2- 172.21.15.146:0/3010235136 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa958066f30 0x7fa9580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:08.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.803+0000 7fa9667fc700 1 -- 172.21.15.146:0/3010235136 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa9680850d0 con 0x7fa960003a60 2023-10-06T11:18:08.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.803+0000 7fa975d9b700 1 --2- 172.21.15.146:0/3010235136 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa958066f30 0x7fa9580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:08.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.804+0000 7fa975d9b700 1 --2- 172.21.15.146:0/3010235136 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa958066f30 0x7fa9580693e0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fa96c0093f0 tx=0x7fa96c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:08.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:08.808+0000 7fa9667fc700 1 -- 172.21.15.146:0/3010235136 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa9680521e0 con 0x7fa960003a60 2023-10-06T11:18:09.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.039+0000 7fa97c94a700 1 -- 172.21.15.146:0/3010235136 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa97804c380 con 0x7fa960003a60 2023-10-06T11:18:09.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.039+0000 7fa9667fc700 1 -- 172.21.15.146:0/3010235136 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 128 v128) v1 ==== 95+0+4619 (secure 0 0 0) 0x7fa968055800 con 0x7fa960003a60 2023-10-06T11:18:09.041 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:18:09.041 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":128,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7433,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3681774523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3681774523},{"type":"v1","addr":"172.21.15.151:6834","nonce":3681774523}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":124},{"gid":7436,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/3243480101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":3243480101},{"type":"v1","addr":"172.21.15.151:6835","nonce":3243480101}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":124},{"gid":9645,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/1871572981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1871572981},{"type":"v1","addr":"172.21.15.146:6836","nonce":1871572981}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":124}],"filesystems":[{"mdsmap":{"epoch":128,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:17:23.939322+0000","modified":"2023-10-06T11:17:27.570448+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9648},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9648":{"gid":9648,"name":"c","rank":0,"incarnation":125,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/2875253990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2875253990},{"type":"v1","addr":"172.21.15.146:6837","nonce":2875253990}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-06T11:18:09.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.041+0000 7fa97c94a700 1 -- 172.21.15.146:0/3010235136 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa958066f30 msgr2=0x7fa9580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:09.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.041+0000 7fa97c94a700 1 --2- 172.21.15.146:0/3010235136 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa958066f30 0x7fa9580693e0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fa96c0093f0 tx=0x7fa96c008040 comp rx=0 tx=0).stop 2023-10-06T11:18:09.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.041+0000 7fa97c94a700 1 -- 172.21.15.146:0/3010235136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa960003a60 msgr2=0x7fa9780b4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:09.043 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.041+0000 7fa97c94a700 1 --2- 172.21.15.146:0/3010235136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa960003a60 0x7fa9780b4b40 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7fa9600057d0 tx=0x7fa968015000 comp rx=0 tx=0).stop 2023-10-06T11:18:09.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.041+0000 7fa97c94a700 1 -- 172.21.15.146:0/3010235136 shutdown_connections 2023-10-06T11:18:09.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.041+0000 7fa97c94a700 1 --2- 172.21.15.146:0/3010235136 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa958066f30 0x7fa9580693e0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:09.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.041+0000 7fa97c94a700 1 --2- 172.21.15.146:0/3010235136 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa97816d090 0x7fa97816d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:09.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.041+0000 7fa97c94a700 1 --2- 172.21.15.146:0/3010235136 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa960003a60 0x7fa9780b4b40 unknown :-1 s=CLOSED pgs=2007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:09.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.041+0000 7fa97c94a700 1 --2- 172.21.15.146:0/3010235136 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9780c9200 0x7fa9780c9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:09.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.041+0000 7fa97c94a700 1 -- 172.21.15.146:0/3010235136 >> 172.21.15.146:0/3010235136 conn(0x7fa97806eb10 msgr2=0x7fa9780cf760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:09.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.041+0000 7fa97c94a700 1 -- 172.21.15.146:0/3010235136 shutdown_connections 2023-10-06T11:18:09.044 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.041+0000 7fa97c94a700 1 -- 172.21.15.146:0/3010235136 wait complete. 2023-10-06T11:18:09.044 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 128 2023-10-06T11:18:09.056 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2023-10-06T11:18:09.198 INFO:teuthology.orchestra.run.smithi146.stdout:{"message":"","return_code":0} 2023-10-06T11:18:09.198 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-10-06T11:18:09.199 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2023-10-06T11:18:09.236 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.235+0000 7f87dd6b3000 1 Processor -- start 2023-10-06T11:18:09.237 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.235+0000 7f87dd6b3000 1 -- start start 2023-10-06T11:18:09.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.235+0000 7f87dd6b3000 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5601836b0020 0x5601836a5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:09.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.235+0000 7f87dd6b3000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5601836b03f0 0x5601836aeb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:09.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.235+0000 7f87dd6b3000 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5601836c7220 0x5601836af080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:09.244 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.235+0000 7f87dd6b3000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x56018353e980 con 0x5601836b03f0 2023-10-06T11:18:09.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.235+0000 7f87dd6b3000 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56018353e620 con 0x5601836c7220 2023-10-06T11:18:09.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.235+0000 7f87dd6b3000 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x560183535400 con 0x5601836b0020 2023-10-06T11:18:09.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.235+0000 7f87d60ed700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5601836b03f0 0x5601836aeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:09.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.235+0000 7f87d60ed700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5601836b03f0 0x5601836aeb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47852/0 (socket says 172.21.15.146:47852) 2023-10-06T11:18:09.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.235+0000 7f87d60ed700 1 -- 172.21.15.146:0/1877187456 learned_addr learned my addr 172.21.15.146:0/1877187456 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:09.245 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.236+0000 7f87d70ef700 1 --2- 172.21.15.146:0/1877187456 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5601836c7220 0x5601836af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:09.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.236+0000 7f87d68ee700 1 --2- 172.21.15.146:0/1877187456 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5601836b0020 0x5601836a5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:09.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.236+0000 7f87d60ed700 1 -- 172.21.15.146:0/1877187456 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5601836b0020 msgr2=0x5601836a5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:09.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.236+0000 7f87d60ed700 1 --2- 172.21.15.146:0/1877187456 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5601836b0020 0x5601836a5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:09.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.236+0000 7f87d60ed700 1 -- 172.21.15.146:0/1877187456 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5601836c7220 msgr2=0x5601836af080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:09.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.236+0000 7f87d60ed700 1 --2- 172.21.15.146:0/1877187456 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5601836c7220 0x5601836af080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:09.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.236+0000 7f87d60ed700 1 -- 172.21.15.146:0/1877187456 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87cc005cf0 con 0x5601836b03f0 2023-10-06T11:18:09.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.236+0000 7f87d60ed700 1 --2- 172.21.15.146:0/1877187456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5601836b03f0 0x5601836aeb40 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7f87cc009aa0 tx=0x7f87cc00c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a57f1f48e3c3db67 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:09.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.236+0000 7f87d50eb700 1 -- 172.21.15.146:0/1877187456 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87cc00f040 con 0x5601836b03f0 2023-10-06T11:18:09.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.236+0000 7f87d50eb700 1 -- 172.21.15.146:0/1877187456 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87cc008ac0 con 0x5601836b03f0 2023-10-06T11:18:09.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.236+0000 7f87d50eb700 1 -- 172.21.15.146:0/1877187456 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87cc008e60 con 0x5601836b03f0 2023-10-06T11:18:09.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.236+0000 7f87dd6b3000 1 -- 172.21.15.146:0/1877187456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5601836b03f0 msgr2=0x5601836aeb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:09.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.236+0000 7f87dd6b3000 1 --2- 172.21.15.146:0/1877187456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5601836b03f0 0x5601836aeb40 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7f87cc009aa0 tx=0x7f87cc00c040 comp rx=0 tx=0).stop 2023-10-06T11:18:09.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.236+0000 7f87dd6b3000 1 -- 172.21.15.146:0/1877187456 shutdown_connections 2023-10-06T11:18:09.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.236+0000 7f87dd6b3000 1 --2- 172.21.15.146:0/1877187456 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5601836c7220 0x5601836af080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:09.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.236+0000 7f87dd6b3000 1 --2- 172.21.15.146:0/1877187456 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5601836b0020 0x5601836a5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:09.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.236+0000 7f87dd6b3000 1 --2- 172.21.15.146:0/1877187456 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5601836b03f0 0x5601836aeb40 unknown :-1 s=CLOSED pgs=2008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:09.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.237+0000 7f87dd6b3000 1 -- 172.21.15.146:0/1877187456 >> 172.21.15.146:0/1877187456 conn(0x5601835f47e0 msgr2=0x5601835f5930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:09.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.237+0000 7f87dd6b3000 1 -- 172.21.15.146:0/1877187456 shutdown_connections 2023-10-06T11:18:09.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.237+0000 7f87dd6b3000 1 -- 172.21.15.146:0/1877187456 wait complete. 2023-10-06T11:18:09.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.237+0000 7f87dd6b3000 1 Processor -- start 2023-10-06T11:18:09.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.237+0000 7f87dd6b3000 1 -- start start 2023-10-06T11:18:09.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.238+0000 7f87dd6b3000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5601836b0020 0x5601836aa5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:09.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.238+0000 7f87dd6b3000 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5601836b03f0 0x5601836d9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:09.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.238+0000 7f87dd6b3000 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5601836c7220 0x5601836c40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:09.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.238+0000 7f87dd6b3000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601836c4fe0 con 0x5601836b0020 2023-10-06T11:18:09.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.238+0000 7f87dd6b3000 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601836c4aa0 con 0x5601836c7220 2023-10-06T11:18:09.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.238+0000 7f87dd6b3000 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5601836c4d40 con 0x5601836b03f0 2023-10-06T11:18:09.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.238+0000 7f87d68ee700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5601836b0020 0x5601836aa5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:09.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.238+0000 7f87d68ee700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5601836b0020 0x5601836aa5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47856/0 (socket says 172.21.15.146:47856) 2023-10-06T11:18:09.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.238+0000 7f87d68ee700 1 -- 172.21.15.146:0/4107442125 learned_addr learned my addr 172.21.15.146:0/4107442125 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:09.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.238+0000 7f87d70ef700 1 --2- 172.21.15.146:0/4107442125 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5601836c7220 0x5601836c40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:09.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.238+0000 7f87d60ed700 1 --2- 172.21.15.146:0/4107442125 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5601836b03f0 0x5601836d9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:09.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.238+0000 7f87d68ee700 1 -- 172.21.15.146:0/4107442125 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5601836b03f0 msgr2=0x5601836d9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:09.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.238+0000 7f87d68ee700 1 --2- 172.21.15.146:0/4107442125 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5601836b03f0 0x5601836d9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:09.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.238+0000 7f87d68ee700 1 -- 172.21.15.146:0/4107442125 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5601836c7220 msgr2=0x5601836c40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:09.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.238+0000 7f87d68ee700 1 --2- 172.21.15.146:0/4107442125 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5601836c7220 0x5601836c40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:09.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.238+0000 7f87d68ee700 1 -- 172.21.15.146:0/4107442125 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87cc009670 con 0x5601836b0020 2023-10-06T11:18:09.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.238+0000 7f87d68ee700 1 --2- 172.21.15.146:0/4107442125 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5601836b0020 0x5601836aa5e0 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f87c800e530 tx=0x7f87c8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:09.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.238+0000 7f87c77fe700 1 -- 172.21.15.146:0/4107442125 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c80060d0 con 0x5601836b0020 2023-10-06T11:18:09.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.238+0000 7f87c77fe700 1 -- 172.21.15.146:0/4107442125 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c8006230 con 0x5601836b0020 2023-10-06T11:18:09.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.238+0000 7f87c77fe700 1 -- 172.21.15.146:0/4107442125 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c8004730 con 0x5601836b0020 2023-10-06T11:18:09.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.238+0000 7f87dd6b3000 1 -- 172.21.15.146:0/4107442125 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87d0005cf0 con 0x5601836b0020 2023-10-06T11:18:09.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.239+0000 7f87dd6b3000 1 -- 172.21.15.146:0/4107442125 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56018354d3d0 con 0x5601836b0020 2023-10-06T11:18:09.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.240+0000 7f87c77fe700 1 -- 172.21.15.146:0/4107442125 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f87c8004ae0 con 0x5601836b0020 2023-10-06T11:18:09.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.240+0000 7f87c77fe700 1 --2- 172.21.15.146:0/4107442125 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f87bc065890 0x7f87bc067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:09.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.240+0000 7f87c77fe700 1 -- 172.21.15.146:0/4107442125 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f87c80830f0 con 0x5601836b0020 2023-10-06T11:18:09.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.240+0000 7f87d60ed700 1 --2- 172.21.15.146:0/4107442125 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f87bc065890 0x7f87bc067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:09.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.240+0000 7f87dd6b3000 1 --2- 172.21.15.146:0/4107442125 >> [v2:172.21.15.151:6808/90890,v1:172.21.15.151:6809/90890] conn(0x5601836c45f0 0x5601836abd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:09.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.240+0000 7f87dd6b3000 1 -- 172.21.15.146:0/4107442125 --> [v2:172.21.15.151:6808/90890,v1:172.21.15.151:6809/90890] -- osd_op(unknown.0.0:1 24.7 24:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e151) v8 -- 0x5601836ac2b0 con 0x5601836c45f0 2023-10-06T11:18:09.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.240+0000 7f87d70ef700 1 --2- 172.21.15.146:0/4107442125 >> [v2:172.21.15.151:6808/90890,v1:172.21.15.151:6809/90890] conn(0x5601836c45f0 0x5601836abd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:09.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.241+0000 7f87d60ed700 1 --2- 172.21.15.146:0/4107442125 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f87bc065890 0x7f87bc067d40 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f87cc009640 tx=0x7f87cc017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:09.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.241+0000 7f87d70ef700 1 --2- 172.21.15.146:0/4107442125 >> [v2:172.21.15.151:6808/90890,v1:172.21.15.151:6809/90890] conn(0x5601836c45f0 0x5601836abd70 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:09.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.241+0000 7f87d70ef700 1 -- 172.21.15.146:0/4107442125 <== osd.7 v2:172.21.15.151:6808/90890 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+95 (crc 0 0 0) 0x7f87d0012410 con 0x5601836c45f0 2023-10-06T11:18:09.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.241+0000 7f87dd6b3000 1 -- 172.21.15.146:0/4107442125 >> [v2:172.21.15.151:6808/90890,v1:172.21.15.151:6809/90890] conn(0x5601836c45f0 msgr2=0x5601836abd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:09.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.241+0000 7f87dd6b3000 1 --2- 172.21.15.146:0/4107442125 >> [v2:172.21.15.151:6808/90890,v1:172.21.15.151:6809/90890] conn(0x5601836c45f0 0x5601836abd70 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:09.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.241+0000 7f87dd6b3000 1 -- 172.21.15.146:0/4107442125 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f87bc065890 msgr2=0x7f87bc067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:09.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.241+0000 7f87dd6b3000 1 --2- 172.21.15.146:0/4107442125 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f87bc065890 0x7f87bc067d40 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f87cc009640 tx=0x7f87cc017000 comp rx=0 tx=0).stop 2023-10-06T11:18:09.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.241+0000 7f87dd6b3000 1 -- 172.21.15.146:0/4107442125 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5601836b0020 msgr2=0x5601836aa5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:09.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.241+0000 7f87dd6b3000 1 --2- 172.21.15.146:0/4107442125 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5601836b0020 0x5601836aa5e0 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f87c800e530 tx=0x7f87c8008040 comp rx=0 tx=0).stop 2023-10-06T11:18:09.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.241+0000 7f87d70ef700 1 -- 172.21.15.146:0/4107442125 reap_dead start 2023-10-06T11:18:09.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.241+0000 7f87dd6b3000 1 -- 172.21.15.146:0/4107442125 shutdown_connections 2023-10-06T11:18:09.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.241+0000 7f87dd6b3000 1 -- 172.21.15.146:0/4107442125 >> 172.21.15.146:0/4107442125 conn(0x5601835f47e0 msgr2=0x5601836bfbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:09.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.241+0000 7f87dd6b3000 1 -- 172.21.15.146:0/4107442125 shutdown_connections 2023-10-06T11:18:09.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.241+0000 7f87dd6b3000 1 -- 172.21.15.146:0/4107442125 wait complete. 2023-10-06T11:18:09.253 INFO:teuthology.orchestra.run.smithi146.stdout:Ysixmegssubdir  2023-10-06T11:18:09.254 DEBUG:teuthology.orchestra.run.smithi146:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2023-10-06T11:18:09.391 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:18:09.392 INFO:teuthology.orchestra.run.smithi146.stdout: "ino": 1099511627777, 2023-10-06T11:18:09.392 INFO:teuthology.orchestra.run.smithi146.stdout: "ancestors": [ 2023-10-06T11:18:09.392 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:18:09.392 INFO:teuthology.orchestra.run.smithi146.stdout: "dirino": 1099511627776, 2023-10-06T11:18:09.392 INFO:teuthology.orchestra.run.smithi146.stdout: "dname": "sixmegs", 2023-10-06T11:18:09.392 INFO:teuthology.orchestra.run.smithi146.stdout: "version": 8 2023-10-06T11:18:09.392 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:18:09.392 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:18:09.392 INFO:teuthology.orchestra.run.smithi146.stdout: "dirino": 1, 2023-10-06T11:18:09.392 INFO:teuthology.orchestra.run.smithi146.stdout: "dname": "subdir", 2023-10-06T11:18:09.392 INFO:teuthology.orchestra.run.smithi146.stdout: "version": 11 2023-10-06T11:18:09.393 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:18:09.393 INFO:teuthology.orchestra.run.smithi146.stdout: ], 2023-10-06T11:18:09.393 INFO:teuthology.orchestra.run.smithi146.stdout: "pool": 24, 2023-10-06T11:18:09.393 INFO:teuthology.orchestra.run.smithi146.stdout: "old_pools": [] 2023-10-06T11:18:09.393 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:18:09.393 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:18:09.394 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T11:18:09.394 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:18:09.434 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:18:09.478 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T11:18:09.478 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi146.front.sepia.ceph.com... 2023-10-06T11:18:09.479 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T11:18:09.479 DEBUG:teuthology.orchestra.run.smithi146:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T11:18:09.522 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[154261]: fuse finished with error 0 and tester_r 0 2023-10-06T11:18:09.524 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-10-06T11:18:09.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:18:09.524 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T11:18:09.605 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-10-06T11:18:09.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:18:09.605 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T11:18:09.621 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:18:09.622 INFO:teuthology.orchestra.run.smithi151.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-06T11:18:09.622 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-10-06T11:18:09.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:18:09.622 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T11:18:09.637 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:18:09.637 INFO:teuthology.orchestra.run.smithi146.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-06T11:18:09.637 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-10-06T11:18:09.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:18:09.638 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T11:18:09.677 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:18:09.678 INFO:teuthology.orchestra.run.smithi151.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-06T11:18:09.678 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:18:09.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.793+0000 7f6d02ec6700 1 Processor -- start 2023-10-06T11:18:09.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.793+0000 7f6d02ec6700 1 -- start start 2023-10-06T11:18:09.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.793+0000 7f6d02ec6700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6cfc06be70 0x7f6cfc1626b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:09.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.793+0000 7f6d02ec6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cfc15b440 con 0x7f6cfc1584a0 2023-10-06T11:18:09.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.793+0000 7f6d02ec6700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cfc15b720 con 0x7f6cfc158870 2023-10-06T11:18:09.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.793+0000 7f6d02ec6700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cfc158d10 con 0x7f6cfc06be70 2023-10-06T11:18:09.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.794+0000 7f6d00c62700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6cfc1584a0 0x7f6cfc0c8a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39744/0 (socket says 172.21.15.146:39744) 2023-10-06T11:18:09.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.794+0000 7f6d00c62700 1 -- 172.21.15.146:0/137852832 learned_addr learned my addr 172.21.15.146:0/137852832 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:09.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.794+0000 7f6d01463700 1 --2- 172.21.15.146:0/137852832 >> v2:172.21.15.151:3300/0 conn(0x7f6cfc06be70 0x7f6cfc1626b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:09.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.794+0000 7f6cf37fe700 1 -- 172.21.15.146:0/137852832 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3138383275 0 0) 0x7f6cfc15b440 con 0x7f6cfc1584a0 2023-10-06T11:18:09.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.794+0000 7f6cf37fe700 1 -- 172.21.15.146:0/137852832 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ce4003570 con 0x7f6cfc1584a0 2023-10-06T11:18:09.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.794+0000 7f6cf37fe700 1 -- 172.21.15.146:0/137852832 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1554851754 0 0) 0x7f6ce4003570 con 0x7f6cfc1584a0 2023-10-06T11:18:09.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.794+0000 7f6cf37fe700 1 -- 172.21.15.146:0/137852832 >> v2:172.21.15.151:3300/0 conn(0x7f6cfc06be70 msgr2=0x7f6cfc1626b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:09.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.794+0000 7f6cf37fe700 1 --2- 172.21.15.146:0/137852832 >> v2:172.21.15.151:3300/0 conn(0x7f6cfc06be70 0x7f6cfc1626b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:09.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.794+0000 7f6cf37fe700 1 -- 172.21.15.146:0/137852832 >> v1:172.21.15.151:6789/0 conn(0x7f6cfc158870 legacy=0x7f6cfc06b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:09.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.794+0000 7f6cf37fe700 1 -- 172.21.15.146:0/137852832 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cfc15ba00 con 0x7f6cfc1584a0 2023-10-06T11:18:09.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.794+0000 7f6cf37fe700 1 -- 172.21.15.146:0/137852832 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f6cf8001470 con 0x7f6cfc1584a0 2023-10-06T11:18:09.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.794+0000 7f6cf37fe700 1 -- 172.21.15.146:0/137852832 >> v1:172.21.15.146:6789/0 conn(0x7f6cfc1584a0 legacy=0x7f6cfc0c8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:09.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.794+0000 7f6cf37fe700 1 --2- 172.21.15.146:0/137852832 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ce4003a60 0x7f6ce4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:09.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.794+0000 7f6cf37fe700 1 --2- 172.21.15.146:0/137852832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ce4004810 0x7f6ce4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:09.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.794+0000 7f6cf37fe700 1 --2- 172.21.15.146:0/137852832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ce40051c0 0x7f6ce400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:09.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.794+0000 7f6cf37fe700 1 -- 172.21.15.146:0/137852832 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cfc158d10 con 0x7f6ce4004810 2023-10-06T11:18:09.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.794+0000 7f6cf37fe700 1 -- 172.21.15.146:0/137852832 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce400c160 con 0x7f6ce40051c0 2023-10-06T11:18:09.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.794+0000 7f6cf37fe700 1 -- 172.21.15.146:0/137852832 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce400c320 con 0x7f6ce4003a60 2023-10-06T11:18:09.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.794+0000 7f6cf3fff700 1 --2- 172.21.15.146:0/137852832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ce4004810 0x7f6ce4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:09.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.794+0000 7f6d00c62700 1 --2- 172.21.15.146:0/137852832 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ce4003a60 0x7f6ce4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:09.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.794+0000 7f6d01463700 1 --2- 172.21.15.146:0/137852832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ce40051c0 0x7f6ce400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:09.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.795+0000 7f6cf3fff700 1 -- 172.21.15.146:0/137852832 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ce4003a60 msgr2=0x7f6ce4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:09.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.795+0000 7f6cf3fff700 1 --2- 172.21.15.146:0/137852832 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ce4003a60 0x7f6ce4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:09.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.795+0000 7f6cf3fff700 1 -- 172.21.15.146:0/137852832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ce40051c0 msgr2=0x7f6ce400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:09.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.795+0000 7f6cf3fff700 1 --2- 172.21.15.146:0/137852832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ce40051c0 0x7f6ce400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:09.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.795+0000 7f6d01463700 1 -- 172.21.15.146:0/137852832 reap_dead start 2023-10-06T11:18:09.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.795+0000 7f6cf3fff700 1 -- 172.21.15.146:0/137852832 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce4003570 con 0x7f6ce4004810 2023-10-06T11:18:09.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.795+0000 7f6cf3fff700 1 --2- 172.21.15.146:0/137852832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ce4004810 0x7f6ce4004c80 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7f6cec0018b0 tx=0x7f6cec007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88712794d7f8c5ec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:09.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.795+0000 7f6cf37fe700 1 -- 172.21.15.146:0/137852832 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cec012420 con 0x7f6ce4004810 2023-10-06T11:18:09.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.795+0000 7f6cf37fe700 1 -- 172.21.15.146:0/137852832 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cec0125a0 con 0x7f6ce4004810 2023-10-06T11:18:09.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.795+0000 7f6cf37fe700 1 -- 172.21.15.146:0/137852832 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cec012960 con 0x7f6ce4004810 2023-10-06T11:18:09.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.795+0000 7f6d02ec6700 1 -- 172.21.15.146:0/137852832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ce4004810 msgr2=0x7f6ce4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:09.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.795+0000 7f6d02ec6700 1 --2- 172.21.15.146:0/137852832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ce4004810 0x7f6ce4004c80 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7f6cec0018b0 tx=0x7f6cec007d30 comp rx=0 tx=0).stop 2023-10-06T11:18:09.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.795+0000 7f6d02ec6700 1 -- 172.21.15.146:0/137852832 shutdown_connections 2023-10-06T11:18:09.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.795+0000 7f6d02ec6700 1 --2- 172.21.15.146:0/137852832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ce4004810 0x7f6ce4004c80 unknown :-1 s=CLOSED pgs=2011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:09.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.795+0000 7f6d02ec6700 1 -- 172.21.15.146:0/137852832 >> 172.21.15.146:0/137852832 conn(0x7f6cfc067eb0 msgr2=0x7f6cfc0ce450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:09.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.795+0000 7f6d02ec6700 1 -- 172.21.15.146:0/137852832 shutdown_connections 2023-10-06T11:18:09.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.795+0000 7f6d02ec6700 1 -- 172.21.15.146:0/137852832 wait complete. 2023-10-06T11:18:09.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.796+0000 7f6d02ec6700 1 Processor -- start 2023-10-06T11:18:09.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.797+0000 7f6d02ec6700 1 -- start start 2023-10-06T11:18:09.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.797+0000 7f6d02ec6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ce4004810 0x7f6cfc0c7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:09.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.797+0000 7f6d02ec6700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6cfc156d60 0x7f6cfc167860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:09.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.797+0000 7f6d02ec6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6cfc167da0 0x7f6cfc0b2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:09.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.797+0000 7f6d02ec6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cfc150a90 con 0x7f6ce4004810 2023-10-06T11:18:09.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.797+0000 7f6d02ec6700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cfc1681f0 con 0x7f6cfc156d60 2023-10-06T11:18:09.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.797+0000 7f6d02ec6700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cfc0c6bc0 con 0x7f6cfc167da0 2023-10-06T11:18:09.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.798+0000 7f6d00c62700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ce4004810 0x7f6cfc0c7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:09.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.798+0000 7f6d00c62700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ce4004810 0x7f6cfc0c7050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47882/0 (socket says 172.21.15.146:47882) 2023-10-06T11:18:09.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.798+0000 7f6d00c62700 1 -- 172.21.15.146:0/1682021865 learned_addr learned my addr 172.21.15.146:0/1682021865 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:09.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.798+0000 7f6cf3fff700 1 --2- 172.21.15.146:0/1682021865 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6cfc156d60 0x7f6cfc167860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:09.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.798+0000 7f6d01463700 1 --2- 172.21.15.146:0/1682021865 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6cfc167da0 0x7f6cfc0b2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:09.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.798+0000 7f6d00c62700 1 -- 172.21.15.146:0/1682021865 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6cfc167da0 msgr2=0x7f6cfc0b2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:09.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.798+0000 7f6d00c62700 1 --2- 172.21.15.146:0/1682021865 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6cfc167da0 0x7f6cfc0b2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:09.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.798+0000 7f6d00c62700 1 -- 172.21.15.146:0/1682021865 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6cfc156d60 msgr2=0x7f6cfc167860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:09.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.798+0000 7f6d00c62700 1 --2- 172.21.15.146:0/1682021865 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6cfc156d60 0x7f6cfc167860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:09.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.798+0000 7f6d00c62700 1 -- 172.21.15.146:0/1682021865 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cfc168430 con 0x7f6ce4004810 2023-10-06T11:18:09.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.798+0000 7f6d00c62700 1 --2- 172.21.15.146:0/1682021865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ce4004810 0x7f6cfc0c7050 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8007370 tx=0x7f6cf8001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:09.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.798+0000 7f6cf0ff9700 1 -- 172.21.15.146:0/1682021865 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf800f870 con 0x7f6ce4004810 2023-10-06T11:18:09.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.798+0000 7f6cf0ff9700 1 -- 172.21.15.146:0/1682021865 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cf800f9f0 con 0x7f6ce4004810 2023-10-06T11:18:09.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.798+0000 7f6d02ec6700 1 -- 172.21.15.146:0/1682021865 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cfc168710 con 0x7f6ce4004810 2023-10-06T11:18:09.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.798+0000 7f6cf0ff9700 1 -- 172.21.15.146:0/1682021865 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf800fdb0 con 0x7f6ce4004810 2023-10-06T11:18:09.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.798+0000 7f6d02ec6700 1 -- 172.21.15.146:0/1682021865 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cfc0c6850 con 0x7f6ce4004810 2023-10-06T11:18:09.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.799+0000 7f6d02ec6700 1 -- 172.21.15.146:0/1682021865 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cfc04c380 con 0x7f6ce4004810 2023-10-06T11:18:09.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.799+0000 7f6cf0ff9700 1 -- 172.21.15.146:0/1682021865 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6cf80135c0 con 0x7f6ce4004810 2023-10-06T11:18:09.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.800+0000 7f6cf0ff9700 1 --2- 172.21.15.146:0/1682021865 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6ce8066f30 0x7f6ce80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:09.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.800+0000 7f6cf0ff9700 1 -- 172.21.15.146:0/1682021865 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6cf8084390 con 0x7f6ce4004810 2023-10-06T11:18:09.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.800+0000 7f6cf3fff700 1 --2- 172.21.15.146:0/1682021865 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6ce8066f30 0x7f6ce80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:09.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.800+0000 7f6cf3fff700 1 --2- 172.21.15.146:0/1682021865 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6ce8066f30 0x7f6ce80693e0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc0b3d90 tx=0x7f6cec015000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:09.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:09.804+0000 7f6cf0ff9700 1 -- 172.21.15.146:0/1682021865 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6cf80514a0 con 0x7f6ce4004810 2023-10-06T11:18:10.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.027+0000 7f6d02ec6700 1 -- 172.21.15.146:0/1682021865 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6cfc15bce0 con 0x7f6ce4004810 2023-10-06T11:18:10.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.027+0000 7f6cf0ff9700 1 -- 172.21.15.146:0/1682021865 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 128 v128) v1 ==== 95+0+4619 (secure 0 0 0) 0x7f6cf801a090 con 0x7f6ce4004810 2023-10-06T11:18:10.029 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:18:10.030 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":128,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7433,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3681774523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3681774523},{"type":"v1","addr":"172.21.15.151:6834","nonce":3681774523}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":124},{"gid":7436,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/3243480101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":3243480101},{"type":"v1","addr":"172.21.15.151:6835","nonce":3243480101}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":124},{"gid":9645,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/1871572981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1871572981},{"type":"v1","addr":"172.21.15.146:6836","nonce":1871572981}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":124}],"filesystems":[{"mdsmap":{"epoch":128,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:17:23.939322+0000","modified":"2023-10-06T11:17:27.570448+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9648},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9648":{"gid":9648,"name":"c","rank":0,"incarnation":125,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/2875253990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2875253990},{"type":"v1","addr":"172.21.15.146:6837","nonce":2875253990}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-06T11:18:10.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.029+0000 7f6d02ec6700 1 -- 172.21.15.146:0/1682021865 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6ce8066f30 msgr2=0x7f6ce80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:10.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.029+0000 7f6d02ec6700 1 --2- 172.21.15.146:0/1682021865 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6ce8066f30 0x7f6ce80693e0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc0b3d90 tx=0x7f6cec015000 comp rx=0 tx=0).stop 2023-10-06T11:18:10.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.029+0000 7f6d02ec6700 1 -- 172.21.15.146:0/1682021865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ce4004810 msgr2=0x7f6cfc0c7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:10.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.029+0000 7f6d02ec6700 1 --2- 172.21.15.146:0/1682021865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ce4004810 0x7f6cfc0c7050 secure :-1 s=READY pgs=2012 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8007370 tx=0x7f6cf8001e50 comp rx=0 tx=0).stop 2023-10-06T11:18:10.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.029+0000 7f6d02ec6700 1 -- 172.21.15.146:0/1682021865 shutdown_connections 2023-10-06T11:18:10.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.029+0000 7f6d02ec6700 1 --2- 172.21.15.146:0/1682021865 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6ce8066f30 0x7f6ce80693e0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:10.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.029+0000 7f6d02ec6700 1 --2- 172.21.15.146:0/1682021865 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6cfc167da0 0x7f6cfc0b2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:10.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.029+0000 7f6d02ec6700 1 --2- 172.21.15.146:0/1682021865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6ce4004810 0x7f6cfc0c7050 unknown :-1 s=CLOSED pgs=2012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:10.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.029+0000 7f6d02ec6700 1 --2- 172.21.15.146:0/1682021865 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6cfc156d60 0x7f6cfc167860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:10.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.029+0000 7f6d02ec6700 1 -- 172.21.15.146:0/1682021865 >> 172.21.15.146:0/1682021865 conn(0x7f6cfc067eb0 msgr2=0x7f6cfc151bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:10.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.029+0000 7f6d02ec6700 1 -- 172.21.15.146:0/1682021865 shutdown_connections 2023-10-06T11:18:10.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.029+0000 7f6d02ec6700 1 -- 172.21.15.146:0/1682021865 wait complete. 2023-10-06T11:18:10.034 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 128 2023-10-06T11:18:10.044 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:18:10.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.157+0000 7f86f407e700 1 Processor -- start 2023-10-06T11:18:10.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.157+0000 7f86f407e700 1 -- start start 2023-10-06T11:18:10.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.158+0000 7f86f407e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f86ec1538c0 0x7f86ec153c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:10.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.158+0000 7f86f407e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f86ec15dcc0 0x7f86ec0ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:10.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.158+0000 7f86f407e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86ec15d270 con 0x7f86ec15a940 2023-10-06T11:18:10.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.158+0000 7f86f407e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86ec15d830 con 0x7f86ec1538c0 2023-10-06T11:18:10.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.158+0000 7f86f407e700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86ec15e110 con 0x7f86ec15dcc0 2023-10-06T11:18:10.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.158+0000 7f86f1e1a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f86ec1538c0 0x7f86ec153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:10.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.158+0000 7f86f1e1a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f86ec1538c0 0x7f86ec153c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47898/0 (socket says 172.21.15.146:47898) 2023-10-06T11:18:10.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.158+0000 7f86f1e1a700 1 -- 172.21.15.146:0/3747443126 learned_addr learned my addr 172.21.15.146:0/3747443126 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:10.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.158+0000 7f86f261b700 1 --2- 172.21.15.146:0/3747443126 >> v2:172.21.15.151:3300/0 conn(0x7f86ec15dcc0 0x7f86ec0ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:10.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.158+0000 7f86f1e1a700 1 -- 172.21.15.146:0/3747443126 >> v2:172.21.15.151:3300/0 conn(0x7f86ec15dcc0 msgr2=0x7f86ec0ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:10.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.158+0000 7f86f1e1a700 1 --2- 172.21.15.146:0/3747443126 >> v2:172.21.15.151:3300/0 conn(0x7f86ec15dcc0 0x7f86ec0ce610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:10.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.158+0000 7f86f1e1a700 1 -- 172.21.15.146:0/3747443126 >> v1:172.21.15.151:6789/0 conn(0x7f86ec15a940 legacy=0x7f86ec0cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:10.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.158+0000 7f86f1e1a700 1 -- 172.21.15.146:0/3747443126 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ec0cb810 con 0x7f86ec1538c0 2023-10-06T11:18:10.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.158+0000 7f86f1e1a700 1 --2- 172.21.15.146:0/3747443126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86ec1538c0 0x7f86ec153c90 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7f86ec15d1a0 tx=0x7f86e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fd057db4f3020d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:10.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.158+0000 7f86f0e18700 1 -- 172.21.15.146:0/3747443126 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e800b820 con 0x7f86ec1538c0 2023-10-06T11:18:10.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.158+0000 7f86f0e18700 1 -- 172.21.15.146:0/3747443126 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e800b980 con 0x7f86ec1538c0 2023-10-06T11:18:10.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.158+0000 7f86f0e18700 1 -- 172.21.15.146:0/3747443126 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e800bd20 con 0x7f86ec1538c0 2023-10-06T11:18:10.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.159+0000 7f86f407e700 1 -- 172.21.15.146:0/3747443126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86ec1538c0 msgr2=0x7f86ec153c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:10.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.159+0000 7f86f407e700 1 --2- 172.21.15.146:0/3747443126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86ec1538c0 0x7f86ec153c90 secure :-1 s=READY pgs=2013 cs=0 l=1 rev1=1 crypto rx=0x7f86ec15d1a0 tx=0x7f86e8009250 comp rx=0 tx=0).stop 2023-10-06T11:18:10.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.159+0000 7f86f407e700 1 -- 172.21.15.146:0/3747443126 shutdown_connections 2023-10-06T11:18:10.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.159+0000 7f86f407e700 1 --2- 172.21.15.146:0/3747443126 >> v2:172.21.15.151:3300/0 conn(0x7f86ec15dcc0 0x7f86ec0ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:10.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.159+0000 7f86f407e700 1 --2- 172.21.15.146:0/3747443126 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86ec1538c0 0x7f86ec153c90 unknown :-1 s=CLOSED pgs=2013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:10.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.159+0000 7f86f407e700 1 -- 172.21.15.146:0/3747443126 >> 172.21.15.146:0/3747443126 conn(0x7f86ec06eb10 msgr2=0x7f86ec06ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:10.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.159+0000 7f86f407e700 1 -- 172.21.15.146:0/3747443126 shutdown_connections 2023-10-06T11:18:10.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.159+0000 7f86f407e700 1 -- 172.21.15.146:0/3747443126 wait complete. 2023-10-06T11:18:10.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.160+0000 7f86f407e700 1 Processor -- start 2023-10-06T11:18:10.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.160+0000 7f86f407e700 1 -- start start 2023-10-06T11:18:10.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.161+0000 7f86f407e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86ec1538c0 0x7f86ec150050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:10.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.161+0000 7f86f407e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86ec15a940 0x7f86ec0c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:10.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.161+0000 7f86f407e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86ec15dcc0 0x7f86ec152c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:10.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.161+0000 7f86f407e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec0c8dc0 con 0x7f86ec15a940 2023-10-06T11:18:10.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.161+0000 7f86f407e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec0b4890 con 0x7f86ec15dcc0 2023-10-06T11:18:10.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.161+0000 7f86f407e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86ec0b4b50 con 0x7f86ec1538c0 2023-10-06T11:18:10.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.161+0000 7f86f1619700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86ec15a940 0x7f86ec0c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:10.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.161+0000 7f86f1619700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86ec15a940 0x7f86ec0c9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47908/0 (socket says 172.21.15.146:47908) 2023-10-06T11:18:10.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.161+0000 7f86f1619700 1 -- 172.21.15.146:0/1254022917 learned_addr learned my addr 172.21.15.146:0/1254022917 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:10.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.161+0000 7f86f1e1a700 1 --2- 172.21.15.146:0/1254022917 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86ec1538c0 0x7f86ec150050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:10.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.161+0000 7f86f261b700 1 --2- 172.21.15.146:0/1254022917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86ec15dcc0 0x7f86ec152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:10.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.161+0000 7f86f1619700 1 -- 172.21.15.146:0/1254022917 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86ec1538c0 msgr2=0x7f86ec150050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:10.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.161+0000 7f86f1619700 1 --2- 172.21.15.146:0/1254022917 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86ec1538c0 0x7f86ec150050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:10.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.161+0000 7f86f1619700 1 -- 172.21.15.146:0/1254022917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86ec15dcc0 msgr2=0x7f86ec152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:10.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.161+0000 7f86f1619700 1 --2- 172.21.15.146:0/1254022917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86ec15dcc0 0x7f86ec152c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:10.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.161+0000 7f86f1619700 1 -- 172.21.15.146:0/1254022917 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e80094f0 con 0x7f86ec15a940 2023-10-06T11:18:10.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.161+0000 7f86f1619700 1 --2- 172.21.15.146:0/1254022917 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86ec15a940 0x7f86ec0c9ce0 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7f86dc00c5d0 tx=0x7f86dc007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:10.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.161+0000 7f86e1ffb700 1 -- 172.21.15.146:0/1254022917 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc011590 con 0x7f86ec15a940 2023-10-06T11:18:10.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.161+0000 7f86e1ffb700 1 -- 172.21.15.146:0/1254022917 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86dc011710 con 0x7f86ec15a940 2023-10-06T11:18:10.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.161+0000 7f86f407e700 1 -- 172.21.15.146:0/1254022917 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86ec0c8520 con 0x7f86ec15a940 2023-10-06T11:18:10.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.162+0000 7f86e1ffb700 1 -- 172.21.15.146:0/1254022917 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc011ad0 con 0x7f86ec15a940 2023-10-06T11:18:10.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.162+0000 7f86f407e700 1 -- 172.21.15.146:0/1254022917 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86ec0c8ae0 con 0x7f86ec15a940 2023-10-06T11:18:10.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.163+0000 7f86f407e700 1 -- 172.21.15.146:0/1254022917 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86ec0b4ce0 con 0x7f86ec15a940 2023-10-06T11:18:10.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.163+0000 7f86e1ffb700 1 -- 172.21.15.146:0/1254022917 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f86dc01c460 con 0x7f86ec15a940 2023-10-06T11:18:10.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.163+0000 7f86e1ffb700 1 --2- 172.21.15.146:0/1254022917 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f86d0066f30 0x7f86d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:10.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.164+0000 7f86e1ffb700 1 -- 172.21.15.146:0/1254022917 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f86dc084350 con 0x7f86ec15a940 2023-10-06T11:18:10.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.164+0000 7f86f1e1a700 1 --2- 172.21.15.146:0/1254022917 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f86d0066f30 0x7f86d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:10.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.164+0000 7f86f1e1a700 1 --2- 172.21.15.146:0/1254022917 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f86d0066f30 0x7f86d00693e0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f86ec15d1a0 tx=0x7f86e8016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:10.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.168+0000 7f86e1ffb700 1 -- 172.21.15.146:0/1254022917 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f86dc051460 con 0x7f86ec15a940 2023-10-06T11:18:10.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.355+0000 7f86f407e700 1 -- 172.21.15.146:0/1254022917 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86ec04c380 con 0x7f86ec15a940 2023-10-06T11:18:10.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.356+0000 7f86e1ffb700 1 -- 172.21.15.146:0/1254022917 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v151) v1 ==== 74+0+16928 (secure 0 0 0) 0x7f86dc054a80 con 0x7f86ec15a940 2023-10-06T11:18:10.358 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:18:10.358 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":151,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:17:25.552935+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:17:21.595161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-10-06T11:17:23.009401+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:18:10.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.358+0000 7f86f407e700 1 -- 172.21.15.146:0/1254022917 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f86d0066f30 msgr2=0x7f86d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:10.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.358+0000 7f86f407e700 1 --2- 172.21.15.146:0/1254022917 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f86d0066f30 0x7f86d00693e0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f86ec15d1a0 tx=0x7f86e8016000 comp rx=0 tx=0).stop 2023-10-06T11:18:10.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.358+0000 7f86f407e700 1 -- 172.21.15.146:0/1254022917 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86ec15a940 msgr2=0x7f86ec0c9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:10.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.358+0000 7f86f407e700 1 --2- 172.21.15.146:0/1254022917 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86ec15a940 0x7f86ec0c9ce0 secure :-1 s=READY pgs=2014 cs=0 l=1 rev1=1 crypto rx=0x7f86dc00c5d0 tx=0x7f86dc007f60 comp rx=0 tx=0).stop 2023-10-06T11:18:10.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.358+0000 7f86f407e700 1 -- 172.21.15.146:0/1254022917 shutdown_connections 2023-10-06T11:18:10.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.358+0000 7f86f407e700 1 --2- 172.21.15.146:0/1254022917 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f86d0066f30 0x7f86d00693e0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:10.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.358+0000 7f86f407e700 1 --2- 172.21.15.146:0/1254022917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86ec15dcc0 0x7f86ec152c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:10.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.358+0000 7f86f407e700 1 --2- 172.21.15.146:0/1254022917 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f86ec1538c0 0x7f86ec150050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:10.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.358+0000 7f86f407e700 1 --2- 172.21.15.146:0/1254022917 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f86ec15a940 0x7f86ec0c9ce0 unknown :-1 s=CLOSED pgs=2014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:10.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.358+0000 7f86f407e700 1 -- 172.21.15.146:0/1254022917 >> 172.21.15.146:0/1254022917 conn(0x7f86ec06eb10 msgr2=0x7f86ec06eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:10.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.358+0000 7f86f407e700 1 -- 172.21.15.146:0/1254022917 shutdown_connections 2023-10-06T11:18:10.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.358+0000 7f86f407e700 1 -- 172.21.15.146:0/1254022917 wait complete. 2023-10-06T11:18:10.373 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:05:36.687307+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:05:37.171199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 23, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T11:17:21.595161+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '150', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 24, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T11:17:23.009401+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '151', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T11:18:10.373 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:18:10.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.490+0000 7f8c72114700 1 Processor -- start 2023-10-06T11:18:10.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.490+0000 7f8c72114700 1 -- start start 2023-10-06T11:18:10.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.491+0000 7f8c72114700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8c6c0685c0 0x7f8c6c0b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:10.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.491+0000 7f8c72114700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8c6c068990 0x7f8c6c15a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:10.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.491+0000 7f8c72114700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c6c0b4f10 con 0x7f8c6c0b53a0 2023-10-06T11:18:10.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.491+0000 7f8c72114700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c6c15ac20 con 0x7f8c6c0685c0 2023-10-06T11:18:10.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.491+0000 7f8c72114700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c6c0b4300 con 0x7f8c6c068990 2023-10-06T11:18:10.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.491+0000 7f8c6b7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8c6c0685c0 0x7f8c6c0b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:10.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.491+0000 7f8c6b7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8c6c0685c0 0x7f8c6c0b3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47922/0 (socket says 172.21.15.146:47922) 2023-10-06T11:18:10.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.491+0000 7f8c6b7fe700 1 -- 172.21.15.146:0/3249064708 learned_addr learned my addr 172.21.15.146:0/3249064708 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:10.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.491+0000 7f8c6affd700 1 --2- 172.21.15.146:0/3249064708 >> v2:172.21.15.151:3300/0 conn(0x7f8c6c068990 0x7f8c6c15a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:10.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.492+0000 7f8c6b7fe700 1 -- 172.21.15.146:0/3249064708 >> v2:172.21.15.151:3300/0 conn(0x7f8c6c068990 msgr2=0x7f8c6c15a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:10.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.492+0000 7f8c6b7fe700 1 --2- 172.21.15.146:0/3249064708 >> v2:172.21.15.151:3300/0 conn(0x7f8c6c068990 0x7f8c6c15a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:10.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.492+0000 7f8c6b7fe700 1 -- 172.21.15.146:0/3249064708 >> v1:172.21.15.151:6789/0 conn(0x7f8c6c0b53a0 legacy=0x7f8c6c15adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:10.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.492+0000 7f8c6b7fe700 1 -- 172.21.15.146:0/3249064708 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c6c0b45e0 con 0x7f8c6c0685c0 2023-10-06T11:18:10.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.492+0000 7f8c6b7fe700 1 --2- 172.21.15.146:0/3249064708 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c6c0685c0 0x7f8c6c0b3c00 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c009f20 tx=0x7f8c5c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2ea48f29b0ff24f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:10.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.492+0000 7f8c6a7fc700 1 -- 172.21.15.146:0/3249064708 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c00e070 con 0x7f8c6c0685c0 2023-10-06T11:18:10.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.492+0000 7f8c6a7fc700 1 -- 172.21.15.146:0/3249064708 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c5c00ba00 con 0x7f8c6c0685c0 2023-10-06T11:18:10.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.492+0000 7f8c6a7fc700 1 -- 172.21.15.146:0/3249064708 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c0092e0 con 0x7f8c6c0685c0 2023-10-06T11:18:10.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.492+0000 7f8c72114700 1 -- 172.21.15.146:0/3249064708 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c6c0685c0 msgr2=0x7f8c6c0b3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:10.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.492+0000 7f8c72114700 1 --2- 172.21.15.146:0/3249064708 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c6c0685c0 0x7f8c6c0b3c00 secure :-1 s=READY pgs=2015 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c009f20 tx=0x7f8c5c009840 comp rx=0 tx=0).stop 2023-10-06T11:18:10.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.492+0000 7f8c72114700 1 -- 172.21.15.146:0/3249064708 shutdown_connections 2023-10-06T11:18:10.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.492+0000 7f8c72114700 1 --2- 172.21.15.146:0/3249064708 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c6c0685c0 0x7f8c6c0b3c00 unknown :-1 s=CLOSED pgs=2015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:10.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.492+0000 7f8c72114700 1 --2- 172.21.15.146:0/3249064708 >> v2:172.21.15.151:3300/0 conn(0x7f8c6c068990 0x7f8c6c15a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:10.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.492+0000 7f8c72114700 1 -- 172.21.15.146:0/3249064708 >> 172.21.15.146:0/3249064708 conn(0x7f8c6c06eb10 msgr2=0x7f8c6c06ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:10.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.492+0000 7f8c72114700 1 -- 172.21.15.146:0/3249064708 shutdown_connections 2023-10-06T11:18:10.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.492+0000 7f8c72114700 1 -- 172.21.15.146:0/3249064708 wait complete. 2023-10-06T11:18:10.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.494+0000 7f8c72114700 1 Processor -- start 2023-10-06T11:18:10.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.494+0000 7f8c72114700 1 -- start start 2023-10-06T11:18:10.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.494+0000 7f8c72114700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c6c0685c0 0x7f8c6c141720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:10.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.494+0000 7f8c72114700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8c6c068990 0x7f8c6c0d0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:10.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.494+0000 7f8c72114700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c6c0b53a0 0x7f8c6c0d0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:10.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.494+0000 7f8c72114700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c0cd080 con 0x7f8c6c0685c0 2023-10-06T11:18:10.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.494+0000 7f8c72114700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c0cc470 con 0x7f8c6c0b53a0 2023-10-06T11:18:10.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.494+0000 7f8c72114700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6c0cc750 con 0x7f8c6c068990 2023-10-06T11:18:10.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.494+0000 7f8c6b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c6c0685c0 0x7f8c6c141720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:10.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.494+0000 7f8c6b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c6c0685c0 0x7f8c6c141720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47924/0 (socket says 172.21.15.146:47924) 2023-10-06T11:18:10.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.495+0000 7f8c6b7fe700 1 -- 172.21.15.146:0/545537277 learned_addr learned my addr 172.21.15.146:0/545537277 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:10.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.495+0000 7f8c6bfff700 1 --2- 172.21.15.146:0/545537277 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c6c0b53a0 0x7f8c6c0d0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:10.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.495+0000 7f8c6affd700 1 --2- 172.21.15.146:0/545537277 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8c6c068990 0x7f8c6c0d0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:10.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.495+0000 7f8c6b7fe700 1 -- 172.21.15.146:0/545537277 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8c6c068990 msgr2=0x7f8c6c0d0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:10.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.495+0000 7f8c6b7fe700 1 --2- 172.21.15.146:0/545537277 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8c6c068990 0x7f8c6c0d0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:10.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.495+0000 7f8c6b7fe700 1 -- 172.21.15.146:0/545537277 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c6c0b53a0 msgr2=0x7f8c6c0d0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:10.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.495+0000 7f8c6b7fe700 1 --2- 172.21.15.146:0/545537277 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c6c0b53a0 0x7f8c6c0d0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:10.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.495+0000 7f8c6b7fe700 1 -- 172.21.15.146:0/545537277 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c5c009ae0 con 0x7f8c6c0685c0 2023-10-06T11:18:10.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.495+0000 7f8c6b7fe700 1 --2- 172.21.15.146:0/545537277 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c6c0685c0 0x7f8c6c141720 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c06a4a0 tx=0x7f8c5c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:10.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.495+0000 7f8c537fe700 1 -- 172.21.15.146:0/545537277 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c012850 con 0x7f8c6c0685c0 2023-10-06T11:18:10.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.495+0000 7f8c537fe700 1 -- 172.21.15.146:0/545537277 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c5c0129b0 con 0x7f8c6c0685c0 2023-10-06T11:18:10.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.495+0000 7f8c72114700 1 -- 172.21.15.146:0/545537277 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c6c0cca30 con 0x7f8c6c0685c0 2023-10-06T11:18:10.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.495+0000 7f8c537fe700 1 -- 172.21.15.146:0/545537277 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c012d50 con 0x7f8c6c0685c0 2023-10-06T11:18:10.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.495+0000 7f8c72114700 1 -- 172.21.15.146:0/545537277 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c6c155730 con 0x7f8c6c0685c0 2023-10-06T11:18:10.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.496+0000 7f8c72114700 1 -- 172.21.15.146:0/545537277 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c6c0889b0 con 0x7f8c6c0685c0 2023-10-06T11:18:10.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.496+0000 7f8c537fe700 1 -- 172.21.15.146:0/545537277 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8c5c01d630 con 0x7f8c6c0685c0 2023-10-06T11:18:10.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.497+0000 7f8c537fe700 1 --2- 172.21.15.146:0/545537277 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8c58066f30 0x7f8c580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:10.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.497+0000 7f8c6affd700 1 --2- 172.21.15.146:0/545537277 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8c58066f30 0x7f8c580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:10.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.497+0000 7f8c537fe700 1 -- 172.21.15.146:0/545537277 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8c5c085b60 con 0x7f8c6c0685c0 2023-10-06T11:18:10.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.497+0000 7f8c6affd700 1 --2- 172.21.15.146:0/545537277 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8c58066f30 0x7f8c580693e0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f8c60006fd0 tx=0x7f8c60008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:10.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.501+0000 7f8c537fe700 1 -- 172.21.15.146:0/545537277 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8c5c052c70 con 0x7f8c6c0685c0 2023-10-06T11:18:10.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.686+0000 7f8c72114700 1 -- 172.21.15.146:0/545537277 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8c6c04bb40 con 0x7f8c6c0685c0 2023-10-06T11:18:10.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.687+0000 7f8c537fe700 1 -- 172.21.15.146:0/545537277 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v151) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8c5c056290 con 0x7f8c6c0685c0 2023-10-06T11:18:10.689 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-10-06T11:18:10.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.689+0000 7f8c72114700 1 -- 172.21.15.146:0/545537277 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8c58066f30 msgr2=0x7f8c580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:10.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.689+0000 7f8c72114700 1 --2- 172.21.15.146:0/545537277 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8c58066f30 0x7f8c580693e0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f8c60006fd0 tx=0x7f8c60008040 comp rx=0 tx=0).stop 2023-10-06T11:18:10.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.689+0000 7f8c72114700 1 -- 172.21.15.146:0/545537277 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c6c0685c0 msgr2=0x7f8c6c141720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:10.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.689+0000 7f8c72114700 1 --2- 172.21.15.146:0/545537277 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c6c0685c0 0x7f8c6c141720 secure :-1 s=READY pgs=2016 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c06a4a0 tx=0x7f8c5c017000 comp rx=0 tx=0).stop 2023-10-06T11:18:10.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.689+0000 7f8c72114700 1 -- 172.21.15.146:0/545537277 shutdown_connections 2023-10-06T11:18:10.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.689+0000 7f8c72114700 1 --2- 172.21.15.146:0/545537277 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8c58066f30 0x7f8c580693e0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:10.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.689+0000 7f8c72114700 1 --2- 172.21.15.146:0/545537277 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c6c0b53a0 0x7f8c6c0d0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:10.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.689+0000 7f8c72114700 1 --2- 172.21.15.146:0/545537277 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8c6c0685c0 0x7f8c6c141720 unknown :-1 s=CLOSED pgs=2016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:10.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.689+0000 7f8c72114700 1 --2- 172.21.15.146:0/545537277 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8c6c068990 0x7f8c6c0d0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:10.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.689+0000 7f8c72114700 1 -- 172.21.15.146:0/545537277 >> 172.21.15.146:0/545537277 conn(0x7f8c6c06eb10 msgr2=0x7f8c6c1591d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:10.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.689+0000 7f8c72114700 1 -- 172.21.15.146:0/545537277 shutdown_connections 2023-10-06T11:18:10.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.689+0000 7f8c72114700 1 -- 172.21.15.146:0/545537277 wait complete. 2023-10-06T11:18:10.703 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:18:10.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.820+0000 7ff503034700 1 Processor -- start 2023-10-06T11:18:10.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.820+0000 7ff503034700 1 -- start start 2023-10-06T11:18:10.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.821+0000 7ff503034700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4fc0b2530 0x7ff4fc1646b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:10.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.821+0000 7ff503034700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4fc0cf100 con 0x7ff4fc143410 2023-10-06T11:18:10.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.821+0000 7ff503034700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4fc0ceb30 con 0x7ff4fc143040 2023-10-06T11:18:10.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.821+0000 7ff503034700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4fc0b4170 con 0x7ff4fc0b2530 2023-10-06T11:18:10.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.821+0000 7ff501831700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff4fc143410 0x7ff4fc0b4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39758/0 (socket says 172.21.15.146:39758) 2023-10-06T11:18:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.821+0000 7ff501831700 1 -- 172.21.15.146:0/1207147634 learned_addr learned my addr 172.21.15.146:0/1207147634 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.821+0000 7ff502833700 1 --2- 172.21.15.146:0/1207147634 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4fc0b2530 0x7ff4fc1646b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.821+0000 7ff501030700 1 -- 172.21.15.146:0/1207147634 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3697842096 0 0) 0x7ff4fc0cf100 con 0x7ff4fc143410 2023-10-06T11:18:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.821+0000 7ff501030700 1 -- 172.21.15.146:0/1207147634 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4e8003570 con 0x7ff4fc143410 2023-10-06T11:18:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.822+0000 7ff501030700 1 -- 172.21.15.146:0/1207147634 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 166946788 0 0) 0x7ff4fc0ceb30 con 0x7ff4fc143040 2023-10-06T11:18:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.822+0000 7ff501030700 1 -- 172.21.15.146:0/1207147634 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4fc0cf100 con 0x7ff4fc143040 2023-10-06T11:18:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.822+0000 7ff501030700 1 -- 172.21.15.146:0/1207147634 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4228315697 0 0) 0x7ff4e8003570 con 0x7ff4fc143410 2023-10-06T11:18:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.822+0000 7ff501030700 1 -- 172.21.15.146:0/1207147634 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4fc0b2530 msgr2=0x7ff4fc1646b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.822+0000 7ff501030700 1 --2- 172.21.15.146:0/1207147634 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4fc0b2530 0x7ff4fc1646b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.822+0000 7ff501030700 1 -- 172.21.15.146:0/1207147634 >> v1:172.21.15.151:6789/0 conn(0x7ff4fc143040 legacy=0x7ff4fc0b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:10.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.822+0000 7ff501030700 1 -- 172.21.15.146:0/1207147634 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4fc0cedd0 con 0x7ff4fc143410 2023-10-06T11:18:10.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.822+0000 7ff501030700 1 -- 172.21.15.146:0/1207147634 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7ff4ec0013f0 con 0x7ff4fc143410 2023-10-06T11:18:10.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.822+0000 7ff501030700 1 -- 172.21.15.146:0/1207147634 >> v1:172.21.15.146:6789/0 conn(0x7ff4fc143410 legacy=0x7ff4fc0b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:10.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.822+0000 7ff501030700 1 --2- 172.21.15.146:0/1207147634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4e8003c20 0x7ff4e8004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:10.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.822+0000 7ff501030700 1 --2- 172.21.15.146:0/1207147634 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4fc0b2530 0x7ff4e8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:10.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.822+0000 7ff501030700 1 --2- 172.21.15.146:0/1207147634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4e8004d50 0x7ff4e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:10.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.822+0000 7ff501030700 1 -- 172.21.15.146:0/1207147634 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4fc0b4170 con 0x7ff4e8004d50 2023-10-06T11:18:10.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.822+0000 7ff501030700 1 -- 172.21.15.146:0/1207147634 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e800bbf0 con 0x7ff4e8003c20 2023-10-06T11:18:10.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.822+0000 7ff501030700 1 -- 172.21.15.146:0/1207147634 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e800bd60 con 0x7ff4fc0b2530 2023-10-06T11:18:10.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.822+0000 7ff502833700 1 --2- 172.21.15.146:0/1207147634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4e8004d50 0x7ff4e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:10.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.822+0000 7ff501831700 1 --2- 172.21.15.146:0/1207147634 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4fc0b2530 0x7ff4e8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:10.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.822+0000 7ff502032700 1 --2- 172.21.15.146:0/1207147634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4e8003c20 0x7ff4e8004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:10.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.822+0000 7ff502833700 1 -- 172.21.15.146:0/1207147634 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4fc0b2530 msgr2=0x7ff4e8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:10.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.822+0000 7ff502833700 1 --2- 172.21.15.146:0/1207147634 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4fc0b2530 0x7ff4e8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:10.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.822+0000 7ff502833700 1 -- 172.21.15.146:0/1207147634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4e8003c20 msgr2=0x7ff4e8004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:10.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.822+0000 7ff502833700 1 --2- 172.21.15.146:0/1207147634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4e8003c20 0x7ff4e8004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:10.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.822+0000 7ff502833700 1 -- 172.21.15.146:0/1207147634 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e8003570 con 0x7ff4e8004d50 2023-10-06T11:18:10.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.822+0000 7ff501831700 1 --2- 172.21.15.146:0/1207147634 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4fc0b2530 0x7ff4e8004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:18:10.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.822+0000 7ff502833700 1 --2- 172.21.15.146:0/1207147634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4e8004d50 0x7ff4e80051c0 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4006f00 tx=0x7ff4f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=504d189aa9e18520 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:10.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.822+0000 7ff501030700 1 -- 172.21.15.146:0/1207147634 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f400e6e0 con 0x7ff4e8004d50 2023-10-06T11:18:10.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.822+0000 7ff501030700 1 -- 172.21.15.146:0/1207147634 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f400e840 con 0x7ff4e8004d50 2023-10-06T11:18:10.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.822+0000 7ff501030700 1 -- 172.21.15.146:0/1207147634 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f400ec00 con 0x7ff4e8004d50 2023-10-06T11:18:10.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.823+0000 7ff503034700 1 -- 172.21.15.146:0/1207147634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4e8004d50 msgr2=0x7ff4e80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:10.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.823+0000 7ff503034700 1 --2- 172.21.15.146:0/1207147634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4e8004d50 0x7ff4e80051c0 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7ff4f4006f00 tx=0x7ff4f40091a0 comp rx=0 tx=0).stop 2023-10-06T11:18:10.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.823+0000 7ff502833700 1 -- 172.21.15.146:0/1207147634 reap_dead start 2023-10-06T11:18:10.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.823+0000 7ff503034700 1 -- 172.21.15.146:0/1207147634 shutdown_connections 2023-10-06T11:18:10.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.823+0000 7ff503034700 1 -- 172.21.15.146:0/1207147634 >> 172.21.15.146:0/1207147634 conn(0x7ff4fc06eb10 msgr2=0x7ff4fc06ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:10.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.823+0000 7ff503034700 1 -- 172.21.15.146:0/1207147634 shutdown_connections 2023-10-06T11:18:10.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.823+0000 7ff503034700 1 -- 172.21.15.146:0/1207147634 wait complete. 2023-10-06T11:18:10.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.824+0000 7ff503034700 1 Processor -- start 2023-10-06T11:18:10.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.824+0000 7ff503034700 1 -- start start 2023-10-06T11:18:10.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.825+0000 7ff503034700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4e8004d50 0x7ff4fc15e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:10.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.825+0000 7ff503034700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4fc16ad20 0x7ff4fc159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:10.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.825+0000 7ff503034700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4fc0cf500 0x7ff4fc0cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:10.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.825+0000 7ff503034700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4fc0cfee0 con 0x7ff4e8004d50 2023-10-06T11:18:10.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.825+0000 7ff503034700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4fc0cce70 con 0x7ff4fc0cf500 2023-10-06T11:18:10.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.825+0000 7ff503034700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4fc16a890 con 0x7ff4fc16ad20 2023-10-06T11:18:10.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.825+0000 7ff502032700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4e8004d50 0x7ff4fc15e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:10.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.825+0000 7ff502032700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4e8004d50 0x7ff4fc15e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47938/0 (socket says 172.21.15.146:47938) 2023-10-06T11:18:10.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.825+0000 7ff502032700 1 -- 172.21.15.146:0/3513937796 learned_addr learned my addr 172.21.15.146:0/3513937796 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:10.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.825+0000 7ff501831700 1 --2- 172.21.15.146:0/3513937796 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4fc16ad20 0x7ff4fc159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:10.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.825+0000 7ff502833700 1 --2- 172.21.15.146:0/3513937796 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4fc0cf500 0x7ff4fc0cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:10.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.825+0000 7ff502032700 1 -- 172.21.15.146:0/3513937796 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4fc16ad20 msgr2=0x7ff4fc159430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:10.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.825+0000 7ff502032700 1 --2- 172.21.15.146:0/3513937796 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4fc16ad20 0x7ff4fc159430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:10.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.825+0000 7ff502032700 1 -- 172.21.15.146:0/3513937796 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4fc0cf500 msgr2=0x7ff4fc0cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:10.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.825+0000 7ff502032700 1 --2- 172.21.15.146:0/3513937796 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4fc0cf500 0x7ff4fc0cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:10.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.825+0000 7ff502032700 1 -- 172.21.15.146:0/3513937796 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4fc15ed60 con 0x7ff4e8004d50 2023-10-06T11:18:10.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.825+0000 7ff502032700 1 --2- 172.21.15.146:0/3513937796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4e8004d50 0x7ff4fc15e820 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7ff4f800eb90 tx=0x7ff4f80017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:10.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.825+0000 7ff4f27fc700 1 -- 172.21.15.146:0/3513937796 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f8006db0 con 0x7ff4e8004d50 2023-10-06T11:18:10.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.826+0000 7ff4f27fc700 1 -- 172.21.15.146:0/3513937796 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f800c700 con 0x7ff4e8004d50 2023-10-06T11:18:10.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.826+0000 7ff503034700 1 -- 172.21.15.146:0/3513937796 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4fc16a280 con 0x7ff4e8004d50 2023-10-06T11:18:10.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.826+0000 7ff4f27fc700 1 -- 172.21.15.146:0/3513937796 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f800cac0 con 0x7ff4e8004d50 2023-10-06T11:18:10.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.826+0000 7ff503034700 1 -- 172.21.15.146:0/3513937796 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4fc16a520 con 0x7ff4e8004d50 2023-10-06T11:18:10.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.826+0000 7ff503034700 1 -- 172.21.15.146:0/3513937796 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4fc16a0e0 con 0x7ff4e8004d50 2023-10-06T11:18:10.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.827+0000 7ff4f27fc700 1 -- 172.21.15.146:0/3513937796 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff4f8014480 con 0x7ff4e8004d50 2023-10-06T11:18:10.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.827+0000 7ff4f27fc700 1 --2- 172.21.15.146:0/3513937796 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff4e0066f30 0x7ff4e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:10.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.827+0000 7ff4f27fc700 1 -- 172.21.15.146:0/3513937796 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff4f8084d50 con 0x7ff4e8004d50 2023-10-06T11:18:10.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.827+0000 7ff501831700 1 --2- 172.21.15.146:0/3513937796 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff4e0066f30 0x7ff4e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:10.834 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.828+0000 7ff501831700 1 --2- 172.21.15.146:0/3513937796 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff4e0066f30 0x7ff4e00693e0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec001200 tx=0x7ff4ec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:10.835 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:10.831+0000 7ff4f27fc700 1 -- 172.21.15.146:0/3513937796 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff4fc16a0e0 con 0x7ff4e8004d50 2023-10-06T11:18:11.018 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.016+0000 7ff503034700 1 -- 172.21.15.146:0/3513937796 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff4fc16a0e0 con 0x7ff4e8004d50 2023-10-06T11:18:11.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.017+0000 7ff4f27fc700 1 -- 172.21.15.146:0/3513937796 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v151) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff4fc16a0e0 con 0x7ff4e8004d50 2023-10-06T11:18:11.019 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-10-06T11:18:11.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.019+0000 7ff503034700 1 -- 172.21.15.146:0/3513937796 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff4e0066f30 msgr2=0x7ff4e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:11.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.019+0000 7ff503034700 1 --2- 172.21.15.146:0/3513937796 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff4e0066f30 0x7ff4e00693e0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec001200 tx=0x7ff4ec009040 comp rx=0 tx=0).stop 2023-10-06T11:18:11.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.019+0000 7ff503034700 1 -- 172.21.15.146:0/3513937796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4e8004d50 msgr2=0x7ff4fc15e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:11.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.019+0000 7ff503034700 1 --2- 172.21.15.146:0/3513937796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4e8004d50 0x7ff4fc15e820 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7ff4f800eb90 tx=0x7ff4f80017a0 comp rx=0 tx=0).stop 2023-10-06T11:18:11.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.019+0000 7ff503034700 1 -- 172.21.15.146:0/3513937796 shutdown_connections 2023-10-06T11:18:11.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.019+0000 7ff503034700 1 --2- 172.21.15.146:0/3513937796 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff4e0066f30 0x7ff4e00693e0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:11.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.019+0000 7ff503034700 1 --2- 172.21.15.146:0/3513937796 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4fc0cf500 0x7ff4fc0cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:11.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.019+0000 7ff503034700 1 --2- 172.21.15.146:0/3513937796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4e8004d50 0x7ff4fc15e820 unknown :-1 s=CLOSED pgs=2019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:11.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.019+0000 7ff503034700 1 --2- 172.21.15.146:0/3513937796 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff4fc16ad20 0x7ff4fc159430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:11.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.019+0000 7ff503034700 1 -- 172.21.15.146:0/3513937796 >> 172.21.15.146:0/3513937796 conn(0x7ff4fc06eb10 msgr2=0x7ff4fc141fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:11.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.019+0000 7ff503034700 1 -- 172.21.15.146:0/3513937796 shutdown_connections 2023-10-06T11:18:11.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.019+0000 7ff503034700 1 -- 172.21.15.146:0/3513937796 wait complete. 2023-10-06T11:18:11.033 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T11:18:11.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.149+0000 7f9a6fd81700 1 Processor -- start 2023-10-06T11:18:11.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.149+0000 7f9a6fd81700 1 -- start start 2023-10-06T11:18:11.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.150+0000 7f9a6fd81700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9a68159450 0x7f9a68159820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:11.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.150+0000 7f9a6fd81700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9a680b0930 0x7f9a680aef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:11.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.150+0000 7f9a6fd81700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a680cb8a0 con 0x7f9a6815dd70 2023-10-06T11:18:11.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.150+0000 7f9a6fd81700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a680b2f20 con 0x7f9a680b0930 2023-10-06T11:18:11.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.150+0000 7f9a6fd81700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a680b2960 con 0x7f9a68159450 2023-10-06T11:18:11.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.150+0000 7f9a6e31e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9a680b0930 0x7f9a680aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:11.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.150+0000 7f9a6e31e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9a680b0930 0x7f9a680aef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47940/0 (socket says 172.21.15.146:47940) 2023-10-06T11:18:11.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.150+0000 7f9a6e31e700 1 -- 172.21.15.146:0/1842049180 learned_addr learned my addr 172.21.15.146:0/1842049180 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:11.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.150+0000 7f9a6db1d700 1 --2- 172.21.15.146:0/1842049180 >> v2:172.21.15.151:3300/0 conn(0x7f9a68159450 0x7f9a68159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:11.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.151+0000 7f9a6e31e700 1 -- 172.21.15.146:0/1842049180 >> v2:172.21.15.151:3300/0 conn(0x7f9a68159450 msgr2=0x7f9a68159820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:11.154 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.151+0000 7f9a6e31e700 1 --2- 172.21.15.146:0/1842049180 >> v2:172.21.15.151:3300/0 conn(0x7f9a68159450 0x7f9a68159820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:11.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.151+0000 7f9a6e31e700 1 -- 172.21.15.146:0/1842049180 >> v1:172.21.15.151:6789/0 conn(0x7f9a6815dd70 legacy=0x7f9a680b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:11.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.151+0000 7f9a6e31e700 1 -- 172.21.15.146:0/1842049180 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a680b2c40 con 0x7f9a680b0930 2023-10-06T11:18:11.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.151+0000 7f9a6e31e700 1 --2- 172.21.15.146:0/1842049180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a680b0930 0x7f9a680aef90 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f9a680ce120 tx=0x7f9a60009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=689ef07d13032eb1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:11.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.151+0000 7f9a6cb1b700 1 -- 172.21.15.146:0/1842049180 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a6000e070 con 0x7f9a680b0930 2023-10-06T11:18:11.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.151+0000 7f9a6cb1b700 1 -- 172.21.15.146:0/1842049180 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a6000ba20 con 0x7f9a680b0930 2023-10-06T11:18:11.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.151+0000 7f9a6cb1b700 1 -- 172.21.15.146:0/1842049180 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a600092e0 con 0x7f9a680b0930 2023-10-06T11:18:11.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.152+0000 7f9a6fd81700 1 -- 172.21.15.146:0/1842049180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a680b0930 msgr2=0x7f9a680aef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:11.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.152+0000 7f9a6fd81700 1 --2- 172.21.15.146:0/1842049180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a680b0930 0x7f9a680aef90 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f9a680ce120 tx=0x7f9a60009840 comp rx=0 tx=0).stop 2023-10-06T11:18:11.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.152+0000 7f9a6fd81700 1 -- 172.21.15.146:0/1842049180 shutdown_connections 2023-10-06T11:18:11.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.152+0000 7f9a6fd81700 1 --2- 172.21.15.146:0/1842049180 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a680b0930 0x7f9a680aef90 unknown :-1 s=CLOSED pgs=2020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:11.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.152+0000 7f9a6fd81700 1 --2- 172.21.15.146:0/1842049180 >> v2:172.21.15.151:3300/0 conn(0x7f9a68159450 0x7f9a68159820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:11.155 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.152+0000 7f9a6fd81700 1 -- 172.21.15.146:0/1842049180 >> 172.21.15.146:0/1842049180 conn(0x7f9a6806eb10 msgr2=0x7f9a6806ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:11.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.152+0000 7f9a6fd81700 1 -- 172.21.15.146:0/1842049180 shutdown_connections 2023-10-06T11:18:11.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.152+0000 7f9a6fd81700 1 -- 172.21.15.146:0/1842049180 wait complete. 2023-10-06T11:18:11.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.153+0000 7f9a6fd81700 1 Processor -- start 2023-10-06T11:18:11.158 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.153+0000 7f9a6fd81700 1 -- start start 2023-10-06T11:18:11.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.153+0000 7f9a6fd81700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a680b0930 0x7f9a680c6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:11.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.153+0000 7f9a6fd81700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a68159450 0x7f9a680ae530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:11.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.153+0000 7f9a6fd81700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a6815dd70 0x7f9a680c3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:11.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.154+0000 7f9a6fd81700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a680c99a0 con 0x7f9a6815dd70 2023-10-06T11:18:11.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.154+0000 7f9a6fd81700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a680c8d90 con 0x7f9a680b0930 2023-10-06T11:18:11.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.154+0000 7f9a6fd81700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a680c9070 con 0x7f9a68159450 2023-10-06T11:18:11.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.154+0000 7f9a6e31e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a6815dd70 0x7f9a680c3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:11.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.154+0000 7f9a6e31e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a6815dd70 0x7f9a680c3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:47956/0 (socket says 172.21.15.146:47956) 2023-10-06T11:18:11.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.154+0000 7f9a6e31e700 1 -- 172.21.15.146:0/1806760067 learned_addr learned my addr 172.21.15.146:0/1806760067 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:11.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.154+0000 7f9a6db1d700 1 --2- 172.21.15.146:0/1806760067 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a680b0930 0x7f9a680c6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:11.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.154+0000 7f9a6d31c700 1 --2- 172.21.15.146:0/1806760067 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a68159450 0x7f9a680ae530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:11.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.154+0000 7f9a6e31e700 1 -- 172.21.15.146:0/1806760067 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a68159450 msgr2=0x7f9a680ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:11.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.154+0000 7f9a6e31e700 1 --2- 172.21.15.146:0/1806760067 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a68159450 0x7f9a680ae530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:11.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.154+0000 7f9a6e31e700 1 -- 172.21.15.146:0/1806760067 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a680b0930 msgr2=0x7f9a680c6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:11.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.154+0000 7f9a6e31e700 1 --2- 172.21.15.146:0/1806760067 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a680b0930 0x7f9a680c6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:11.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.154+0000 7f9a6e31e700 1 -- 172.21.15.146:0/1806760067 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a60009ae0 con 0x7f9a6815dd70 2023-10-06T11:18:11.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.154+0000 7f9a6db1d700 1 --2- 172.21.15.146:0/1806760067 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a680b0930 0x7f9a680c6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:18:11.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.154+0000 7f9a6e31e700 1 --2- 172.21.15.146:0/1806760067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a6815dd70 0x7f9a680c3e40 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f9a60009880 tx=0x7f9a60018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:11.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.154+0000 7f9a65ffb700 1 -- 172.21.15.146:0/1806760067 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a60008be0 con 0x7f9a6815dd70 2023-10-06T11:18:11.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.154+0000 7f9a65ffb700 1 -- 172.21.15.146:0/1806760067 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a60008d40 con 0x7f9a6815dd70 2023-10-06T11:18:11.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.154+0000 7f9a6fd81700 1 -- 172.21.15.146:0/1806760067 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a680c9350 con 0x7f9a6815dd70 2023-10-06T11:18:11.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.154+0000 7f9a65ffb700 1 -- 172.21.15.146:0/1806760067 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a600266b0 con 0x7f9a6815dd70 2023-10-06T11:18:11.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.154+0000 7f9a6fd81700 1 -- 172.21.15.146:0/1806760067 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a680c72b0 con 0x7f9a6815dd70 2023-10-06T11:18:11.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.155+0000 7f9a6fd81700 1 -- 172.21.15.146:0/1806760067 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a680c9b10 con 0x7f9a6815dd70 2023-10-06T11:18:11.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.156+0000 7f9a65ffb700 1 -- 172.21.15.146:0/1806760067 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9a60003040 con 0x7f9a6815dd70 2023-10-06T11:18:11.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.156+0000 7f9a65ffb700 1 --2- 172.21.15.146:0/1806760067 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9a54066f30 0x7f9a540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:11.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.156+0000 7f9a65ffb700 1 -- 172.21.15.146:0/1806760067 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9a60086650 con 0x7f9a6815dd70 2023-10-06T11:18:11.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.156+0000 7f9a6db1d700 1 --2- 172.21.15.146:0/1806760067 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9a54066f30 0x7f9a540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:11.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.157+0000 7f9a6db1d700 1 --2- 172.21.15.146:0/1806760067 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9a54066f30 0x7f9a540693e0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f9a58009d80 tx=0x7f9a58008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:11.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.161+0000 7f9a65ffb700 1 -- 172.21.15.146:0/1806760067 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9a60053810 con 0x7f9a6815dd70 2023-10-06T11:18:11.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.344+0000 7f9a6fd81700 1 -- 172.21.15.146:0/1806760067 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9a6804c380 con 0x7f9a6815dd70 2023-10-06T11:18:11.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.344+0000 7f9a65ffb700 1 -- 172.21.15.146:0/1806760067 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v151) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9a60056e30 con 0x7f9a6815dd70 2023-10-06T11:18:11.346 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2023-10-06T11:18:11.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.347+0000 7f9a6fd81700 1 -- 172.21.15.146:0/1806760067 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9a54066f30 msgr2=0x7f9a540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:11.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.347+0000 7f9a6fd81700 1 --2- 172.21.15.146:0/1806760067 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9a54066f30 0x7f9a540693e0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f9a58009d80 tx=0x7f9a58008040 comp rx=0 tx=0).stop 2023-10-06T11:18:11.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.347+0000 7f9a6fd81700 1 -- 172.21.15.146:0/1806760067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a6815dd70 msgr2=0x7f9a680c3e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:11.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.347+0000 7f9a6fd81700 1 --2- 172.21.15.146:0/1806760067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a6815dd70 0x7f9a680c3e40 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f9a60009880 tx=0x7f9a60018000 comp rx=0 tx=0).stop 2023-10-06T11:18:11.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.347+0000 7f9a6fd81700 1 -- 172.21.15.146:0/1806760067 shutdown_connections 2023-10-06T11:18:11.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.347+0000 7f9a6fd81700 1 --2- 172.21.15.146:0/1806760067 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9a54066f30 0x7f9a540693e0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:11.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.347+0000 7f9a6fd81700 1 --2- 172.21.15.146:0/1806760067 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a6815dd70 0x7f9a680c3e40 unknown :-1 s=CLOSED pgs=2021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:11.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.347+0000 7f9a6fd81700 1 --2- 172.21.15.146:0/1806760067 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a680b0930 0x7f9a680c6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:11.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.347+0000 7f9a6fd81700 1 --2- 172.21.15.146:0/1806760067 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a68159450 0x7f9a680ae530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:11.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.347+0000 7f9a6fd81700 1 -- 172.21.15.146:0/1806760067 >> 172.21.15.146:0/1806760067 conn(0x7f9a6806eb10 msgr2=0x7f9a68158a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:11.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.347+0000 7f9a6fd81700 1 -- 172.21.15.146:0/1806760067 shutdown_connections 2023-10-06T11:18:11.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.347+0000 7f9a6fd81700 1 -- 172.21.15.146:0/1806760067 wait complete. 2023-10-06T11:18:11.361 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T11:18:11.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.478+0000 7feeea25a700 1 Processor -- start 2023-10-06T11:18:11.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.478+0000 7feeea25a700 1 -- start start 2023-10-06T11:18:11.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.479+0000 7feeea25a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7feee4159450 0x7feee4159820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:11.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.479+0000 7feeea25a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feee40cb8a0 con 0x7feee40b0930 2023-10-06T11:18:11.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.479+0000 7feeea25a700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feee40b2960 con 0x7feee415dd70 2023-10-06T11:18:11.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.479+0000 7feeea25a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feee40b2f20 con 0x7feee4159450 2023-10-06T11:18:11.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.479+0000 7feee37fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7feee4159450 0x7feee4159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:11.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.479+0000 7feee3fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7feee40b0930 0x7feee40aef90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33810/0 (socket says 172.21.15.146:33810) 2023-10-06T11:18:11.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.479+0000 7feee3fff700 1 -- 172.21.15.146:0/368488930 learned_addr learned my addr 172.21.15.146:0/368488930 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:11.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.480+0000 7feee37fe700 1 -- 172.21.15.146:0/368488930 >> v1:172.21.15.151:6789/0 conn(0x7feee415dd70 legacy=0x7feee40b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:11.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.480+0000 7feee37fe700 1 -- 172.21.15.146:0/368488930 >> v1:172.21.15.146:6789/0 conn(0x7feee40b0930 legacy=0x7feee40aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:11.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.480+0000 7feee37fe700 1 -- 172.21.15.146:0/368488930 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee40b2c40 con 0x7feee4159450 2023-10-06T11:18:11.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.480+0000 7feee27fc700 1 -- 172.21.15.146:0/368488930 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2312893611 0 0) 0x7feee40cb8a0 con 0x7feee40b0930 2023-10-06T11:18:11.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.480+0000 7feee37fe700 1 --2- 172.21.15.146:0/368488930 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feee4159450 0x7feee4159820 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7feed4009e60 tx=0x7feed4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f7ef74e73580e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:11.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.480+0000 7feee27fc700 1 -- 172.21.15.146:0/368488930 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed400e070 con 0x7feee4159450 2023-10-06T11:18:11.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.480+0000 7feee27fc700 1 -- 172.21.15.146:0/368488930 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed400bbf0 con 0x7feee4159450 2023-10-06T11:18:11.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.480+0000 7feee27fc700 1 -- 172.21.15.146:0/368488930 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed4012430 con 0x7feee4159450 2023-10-06T11:18:11.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.480+0000 7feeea25a700 1 -- 172.21.15.146:0/368488930 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feee4159450 msgr2=0x7feee4159820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:11.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.480+0000 7feeea25a700 1 --2- 172.21.15.146:0/368488930 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feee4159450 0x7feee4159820 secure :-1 s=READY pgs=2023 cs=0 l=1 rev1=1 crypto rx=0x7feed4009e60 tx=0x7feed4009780 comp rx=0 tx=0).stop 2023-10-06T11:18:11.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.481+0000 7feeea25a700 1 -- 172.21.15.146:0/368488930 shutdown_connections 2023-10-06T11:18:11.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.481+0000 7feeea25a700 1 --2- 172.21.15.146:0/368488930 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feee4159450 0x7feee4159820 unknown :-1 s=CLOSED pgs=2023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:11.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.481+0000 7feeea25a700 1 -- 172.21.15.146:0/368488930 >> 172.21.15.146:0/368488930 conn(0x7feee406eb10 msgr2=0x7feee406ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:11.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.481+0000 7feeea25a700 1 -- 172.21.15.146:0/368488930 shutdown_connections 2023-10-06T11:18:11.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.481+0000 7feeea25a700 1 -- 172.21.15.146:0/368488930 wait complete. 2023-10-06T11:18:11.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.482+0000 7feeea25a700 1 Processor -- start 2023-10-06T11:18:11.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.482+0000 7feeea25a700 1 -- start start 2023-10-06T11:18:11.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.483+0000 7feeea25a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feee40b0930 0x7feee40ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:11.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.483+0000 7feeea25a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feee4159450 0x7feee4158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:11.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.483+0000 7feeea25a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feee415dd70 0x7feee415bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:11.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.483+0000 7feeea25a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee40c7650 con 0x7feee4159450 2023-10-06T11:18:11.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.483+0000 7feeea25a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee40c4680 con 0x7feee415dd70 2023-10-06T11:18:11.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.483+0000 7feeea25a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee40c4020 con 0x7feee40b0930 2023-10-06T11:18:11.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.483+0000 7feee2ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feee4159450 0x7feee4158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:11.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.483+0000 7feee2ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feee4159450 0x7feee4158120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40448/0 (socket says 172.21.15.146:40448) 2023-10-06T11:18:11.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.483+0000 7feee2ffd700 1 -- 172.21.15.146:0/2505560237 learned_addr learned my addr 172.21.15.146:0/2505560237 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:11.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.483+0000 7feee3fff700 1 --2- 172.21.15.146:0/2505560237 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feee415dd70 0x7feee415bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:11.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.483+0000 7feee37fe700 1 --2- 172.21.15.146:0/2505560237 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feee40b0930 0x7feee40ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:11.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.483+0000 7feee2ffd700 1 -- 172.21.15.146:0/2505560237 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feee40b0930 msgr2=0x7feee40ae880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:11.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.483+0000 7feee2ffd700 1 --2- 172.21.15.146:0/2505560237 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feee40b0930 0x7feee40ae880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:11.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.483+0000 7feee2ffd700 1 -- 172.21.15.146:0/2505560237 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feee415dd70 msgr2=0x7feee415bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:11.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.483+0000 7feee2ffd700 1 --2- 172.21.15.146:0/2505560237 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feee415dd70 0x7feee415bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:11.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.483+0000 7feee2ffd700 1 -- 172.21.15.146:0/2505560237 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed4009a20 con 0x7feee4159450 2023-10-06T11:18:11.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.483+0000 7feee2ffd700 1 --2- 172.21.15.146:0/2505560237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feee4159450 0x7feee4158120 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7feed800b5e0 tx=0x7feed8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:11.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.483+0000 7feecb7fe700 1 -- 172.21.15.146:0/2505560237 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed800f510 con 0x7feee4159450 2023-10-06T11:18:11.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.483+0000 7feecb7fe700 1 -- 172.21.15.146:0/2505560237 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed800f670 con 0x7feee4159450 2023-10-06T11:18:11.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.483+0000 7feeea25a700 1 -- 172.21.15.146:0/2505560237 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feee40c71d0 con 0x7feee4159450 2023-10-06T11:18:11.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.483+0000 7feecb7fe700 1 -- 172.21.15.146:0/2505560237 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed800fa30 con 0x7feee4159450 2023-10-06T11:18:11.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.483+0000 7feeea25a700 1 -- 172.21.15.146:0/2505560237 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee40c4b70 con 0x7feee4159450 2023-10-06T11:18:11.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.484+0000 7feeea25a700 1 -- 172.21.15.146:0/2505560237 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feee40c7790 con 0x7feee4159450 2023-10-06T11:18:11.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.485+0000 7feecb7fe700 1 -- 172.21.15.146:0/2505560237 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feed801a400 con 0x7feee4159450 2023-10-06T11:18:11.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.485+0000 7feecb7fe700 1 --2- 172.21.15.146:0/2505560237 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feed0066f30 0x7feed00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:11.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.485+0000 7feecb7fe700 1 -- 172.21.15.146:0/2505560237 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7feed8084030 con 0x7feee4159450 2023-10-06T11:18:11.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.485+0000 7feee37fe700 1 --2- 172.21.15.146:0/2505560237 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feed0066f30 0x7feed00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:11.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.486+0000 7feee37fe700 1 --2- 172.21.15.146:0/2505560237 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feed0066f30 0x7feed00693e0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7feed40099f0 tx=0x7feed4018000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:11.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.489+0000 7feecb7fe700 1 -- 172.21.15.146:0/2505560237 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feee40c7790 con 0x7feee4159450 2023-10-06T11:18:11.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.679+0000 7feeea25a700 1 -- 172.21.15.146:0/2505560237 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7feee40c7790 con 0x7feee4159450 2023-10-06T11:18:11.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.679+0000 7feecb7fe700 1 -- 172.21.15.146:0/2505560237 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v151) v1 ==== 100+0+11 (secure 0 0 0) 0x7feee40c7790 con 0x7feee4159450 2023-10-06T11:18:11.681 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2023-10-06T11:18:11.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.681+0000 7feeea25a700 1 -- 172.21.15.146:0/2505560237 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feed0066f30 msgr2=0x7feed00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:11.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.681+0000 7feeea25a700 1 --2- 172.21.15.146:0/2505560237 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feed0066f30 0x7feed00693e0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7feed40099f0 tx=0x7feed4018000 comp rx=0 tx=0).stop 2023-10-06T11:18:11.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.681+0000 7feeea25a700 1 -- 172.21.15.146:0/2505560237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feee4159450 msgr2=0x7feee4158120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:11.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.681+0000 7feeea25a700 1 --2- 172.21.15.146:0/2505560237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feee4159450 0x7feee4158120 secure :-1 s=READY pgs=2024 cs=0 l=1 rev1=1 crypto rx=0x7feed800b5e0 tx=0x7feed8009120 comp rx=0 tx=0).stop 2023-10-06T11:18:11.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.681+0000 7feeea25a700 1 -- 172.21.15.146:0/2505560237 shutdown_connections 2023-10-06T11:18:11.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.681+0000 7feeea25a700 1 --2- 172.21.15.146:0/2505560237 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feed0066f30 0x7feed00693e0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:11.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.681+0000 7feeea25a700 1 --2- 172.21.15.146:0/2505560237 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feee415dd70 0x7feee415bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:11.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.681+0000 7feeea25a700 1 --2- 172.21.15.146:0/2505560237 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feee40b0930 0x7feee40ae880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:11.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.681+0000 7feeea25a700 1 --2- 172.21.15.146:0/2505560237 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feee4159450 0x7feee4158120 unknown :-1 s=CLOSED pgs=2024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:11.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.681+0000 7feeea25a700 1 -- 172.21.15.146:0/2505560237 >> 172.21.15.146:0/2505560237 conn(0x7feee406eb10 msgr2=0x7feee415d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:11.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.682+0000 7feeea25a700 1 -- 172.21.15.146:0/2505560237 shutdown_connections 2023-10-06T11:18:11.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.682+0000 7feeea25a700 1 -- 172.21.15.146:0/2505560237 wait complete. 2023-10-06T11:18:11.696 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:18:11.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.809+0000 7fcda575c700 1 Processor -- start 2023-10-06T11:18:11.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.809+0000 7fcda575c700 1 -- start start 2023-10-06T11:18:11.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.810+0000 7fcda575c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcda0157290 0x7fcda00af6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:11.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.810+0000 7fcda575c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcda015a460 0x7fcda00673e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:11.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.810+0000 7fcda575c700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcda00ac970 con 0x7fcda0156ec0 2023-10-06T11:18:11.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.810+0000 7fcda575c700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcda0159fd0 con 0x7fcda0157290 2023-10-06T11:18:11.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.810+0000 7fcda575c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda00ac3b0 con 0x7fcda015a460 2023-10-06T11:18:11.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.811+0000 7fcd9f7fe700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcda0157290 0x7fcda00af6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:11.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.811+0000 7fcda4f5b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcda015a460 0x7fcda00673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:11.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.811+0000 7fcda4f5b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcda015a460 0x7fcda00673e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:42240/0 (socket says 172.21.15.146:42240) 2023-10-06T11:18:11.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.811+0000 7fcd9ffff700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fcda0156ec0 0x7fcda00abb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:34346/0 (socket says 172.21.15.146:34346) 2023-10-06T11:18:11.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.811+0000 7fcda4f5b700 1 -- 172.21.15.146:0/4119600917 learned_addr learned my addr 172.21.15.146:0/4119600917 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:11.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.811+0000 7fcd9f7fe700 1 -- 172.21.15.146:0/4119600917 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcda015a460 msgr2=0x7fcda00673e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:11.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.811+0000 7fcd9f7fe700 1 --2- 172.21.15.146:0/4119600917 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcda015a460 0x7fcda00673e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:11.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.811+0000 7fcd9f7fe700 1 -- 172.21.15.146:0/4119600917 >> v1:172.21.15.151:6789/0 conn(0x7fcda0156ec0 legacy=0x7fcda00abb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:11.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.811+0000 7fcd9f7fe700 1 -- 172.21.15.146:0/4119600917 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda00ac690 con 0x7fcda0157290 2023-10-06T11:18:11.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.811+0000 7fcda4f5b700 1 --2- 172.21.15.146:0/4119600917 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcda015a460 0x7fcda00673e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:18:11.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.811+0000 7fcd9f7fe700 1 --2- 172.21.15.146:0/4119600917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcda0157290 0x7fcda00af6f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fcd940098e0 tx=0x7fcd940091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6efba302d95be6c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:11.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.811+0000 7fcd9effd700 1 -- 172.21.15.146:0/4119600917 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9400b640 con 0x7fcda0157290 2023-10-06T11:18:11.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.811+0000 7fcd9effd700 1 -- 172.21.15.146:0/4119600917 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9400b7a0 con 0x7fcda0157290 2023-10-06T11:18:11.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.811+0000 7fcd9effd700 1 -- 172.21.15.146:0/4119600917 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9400bb40 con 0x7fcda0157290 2023-10-06T11:18:11.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.812+0000 7fcda575c700 1 -- 172.21.15.146:0/4119600917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcda0157290 msgr2=0x7fcda00af6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:11.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.812+0000 7fcda575c700 1 --2- 172.21.15.146:0/4119600917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcda0157290 0x7fcda00af6f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fcd940098e0 tx=0x7fcd940091a0 comp rx=0 tx=0).stop 2023-10-06T11:18:11.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.812+0000 7fcda575c700 1 -- 172.21.15.146:0/4119600917 shutdown_connections 2023-10-06T11:18:11.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.812+0000 7fcda575c700 1 --2- 172.21.15.146:0/4119600917 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcda015a460 0x7fcda00673e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:11.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.812+0000 7fcda575c700 1 --2- 172.21.15.146:0/4119600917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcda0157290 0x7fcda00af6f0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:11.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.812+0000 7fcda575c700 1 -- 172.21.15.146:0/4119600917 >> 172.21.15.146:0/4119600917 conn(0x7fcda006aca0 msgr2=0x7fcda00aeb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:11.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.812+0000 7fcda575c700 1 -- 172.21.15.146:0/4119600917 shutdown_connections 2023-10-06T11:18:11.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.812+0000 7fcda575c700 1 -- 172.21.15.146:0/4119600917 wait complete. 2023-10-06T11:18:11.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.813+0000 7fcda575c700 1 Processor -- start 2023-10-06T11:18:11.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.813+0000 7fcda575c700 1 -- start start 2023-10-06T11:18:11.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.814+0000 7fcda575c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcda0156ec0 0x7fcda0143c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:11.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.814+0000 7fcda575c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcda0157290 0x7fcda01556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:11.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.814+0000 7fcda575c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcda015a460 0x7fcda0155c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:11.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.814+0000 7fcda575c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda01441c0 con 0x7fcda015a460 2023-10-06T11:18:11.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.814+0000 7fcda575c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda00b2810 con 0x7fcda0157290 2023-10-06T11:18:11.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.814+0000 7fcda575c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda00b1ee0 con 0x7fcda0156ec0 2023-10-06T11:18:11.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.814+0000 7fcda4f5b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcda015a460 0x7fcda0155c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:11.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.814+0000 7fcda4f5b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcda015a460 0x7fcda0155c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40462/0 (socket says 172.21.15.146:40462) 2023-10-06T11:18:11.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.814+0000 7fcda4f5b700 1 -- 172.21.15.146:0/4017210698 learned_addr learned my addr 172.21.15.146:0/4017210698 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:11.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.814+0000 7fcd9ffff700 1 --2- 172.21.15.146:0/4017210698 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcda0156ec0 0x7fcda0143c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:11.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.814+0000 7fcd9f7fe700 1 --2- 172.21.15.146:0/4017210698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcda0157290 0x7fcda01556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:11.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.814+0000 7fcda4f5b700 1 -- 172.21.15.146:0/4017210698 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcda0156ec0 msgr2=0x7fcda0143c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:11.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.814+0000 7fcda4f5b700 1 --2- 172.21.15.146:0/4017210698 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcda0156ec0 0x7fcda0143c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:11.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.814+0000 7fcda4f5b700 1 -- 172.21.15.146:0/4017210698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcda0157290 msgr2=0x7fcda01556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:11.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.814+0000 7fcda4f5b700 1 --2- 172.21.15.146:0/4017210698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcda0157290 0x7fcda01556e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:11.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.814+0000 7fcda4f5b700 1 -- 172.21.15.146:0/4017210698 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd98009ae0 con 0x7fcda015a460 2023-10-06T11:18:11.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.814+0000 7fcd9ffff700 1 --2- 172.21.15.146:0/4017210698 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcda0156ec0 0x7fcda0143c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:18:11.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.814+0000 7fcd9f7fe700 1 --2- 172.21.15.146:0/4017210698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcda0157290 0x7fcda01556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:18:11.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.815+0000 7fcda4f5b700 1 --2- 172.21.15.146:0/4017210698 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcda015a460 0x7fcda0155c20 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7fcd98009f30 tx=0x7fcd9800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:11.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.815+0000 7fcd87fff700 1 -- 172.21.15.146:0/4017210698 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd98018070 con 0x7fcda015a460 2023-10-06T11:18:11.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.815+0000 7fcd87fff700 1 -- 172.21.15.146:0/4017210698 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9800f040 con 0x7fcda015a460 2023-10-06T11:18:11.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.815+0000 7fcda575c700 1 -- 172.21.15.146:0/4017210698 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd94009420 con 0x7fcda015a460 2023-10-06T11:18:11.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.815+0000 7fcd87fff700 1 -- 172.21.15.146:0/4017210698 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9800ccd0 con 0x7fcda015a460 2023-10-06T11:18:11.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.815+0000 7fcda575c700 1 -- 172.21.15.146:0/4017210698 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcda00b24a0 con 0x7fcda015a460 2023-10-06T11:18:11.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.816+0000 7fcda575c700 1 -- 172.21.15.146:0/4017210698 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcda006d060 con 0x7fcda015a460 2023-10-06T11:18:11.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.816+0000 7fcd87fff700 1 -- 172.21.15.146:0/4017210698 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcd98003020 con 0x7fcda015a460 2023-10-06T11:18:11.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.816+0000 7fcd87fff700 1 --2- 172.21.15.146:0/4017210698 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcd8c066f60 0x7fcd8c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:11.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.816+0000 7fcd87fff700 1 -- 172.21.15.146:0/4017210698 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcd98084660 con 0x7fcda015a460 2023-10-06T11:18:11.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.817+0000 7fcd9ffff700 1 --2- 172.21.15.146:0/4017210698 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcd8c066f60 0x7fcd8c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:11.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.817+0000 7fcd9ffff700 1 --2- 172.21.15.146:0/4017210698 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcd8c066f60 0x7fcd8c069410 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fcd90007120 tx=0x7fcd90007d80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:11.822 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:11.821+0000 7fcd87fff700 1 -- 172.21.15.146:0/4017210698 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcd98055200 con 0x7fcda015a460 2023-10-06T11:18:12.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.045+0000 7fcda575c700 1 -- 172.21.15.146:0/4017210698 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcda0067c70 con 0x7fcda015a460 2023-10-06T11:18:12.047 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.045+0000 7fcd87fff700 1 -- 172.21.15.146:0/4017210698 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 128 v128) v1 ==== 95+0+4619 (secure 0 0 0) 0x7fcd98054d90 con 0x7fcda015a460 2023-10-06T11:18:12.047 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:18:12.047 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":128,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7433,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3681774523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3681774523},{"type":"v1","addr":"172.21.15.151:6834","nonce":3681774523}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":124},{"gid":7436,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/3243480101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":3243480101},{"type":"v1","addr":"172.21.15.151:6835","nonce":3243480101}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":124},{"gid":9645,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/1871572981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1871572981},{"type":"v1","addr":"172.21.15.146:6836","nonce":1871572981}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":124}],"filesystems":[{"mdsmap":{"epoch":128,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:17:23.939322+0000","modified":"2023-10-06T11:17:27.570448+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9648},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9648":{"gid":9648,"name":"c","rank":0,"incarnation":125,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/2875253990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2875253990},{"type":"v1","addr":"172.21.15.146:6837","nonce":2875253990}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-06T11:18:12.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.047+0000 7fcda575c700 1 -- 172.21.15.146:0/4017210698 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcd8c066f60 msgr2=0x7fcd8c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:12.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.047+0000 7fcda575c700 1 --2- 172.21.15.146:0/4017210698 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcd8c066f60 0x7fcd8c069410 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fcd90007120 tx=0x7fcd90007d80 comp rx=0 tx=0).stop 2023-10-06T11:18:12.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.047+0000 7fcda575c700 1 -- 172.21.15.146:0/4017210698 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcda015a460 msgr2=0x7fcda0155c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:12.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.047+0000 7fcda575c700 1 --2- 172.21.15.146:0/4017210698 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcda015a460 0x7fcda0155c20 secure :-1 s=READY pgs=2025 cs=0 l=1 rev1=1 crypto rx=0x7fcd98009f30 tx=0x7fcd9800b040 comp rx=0 tx=0).stop 2023-10-06T11:18:12.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.047+0000 7fcda575c700 1 -- 172.21.15.146:0/4017210698 shutdown_connections 2023-10-06T11:18:12.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.047+0000 7fcda575c700 1 --2- 172.21.15.146:0/4017210698 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcd8c066f60 0x7fcd8c069410 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:12.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.047+0000 7fcda575c700 1 --2- 172.21.15.146:0/4017210698 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcda015a460 0x7fcda0155c20 unknown :-1 s=CLOSED pgs=2025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:12.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.047+0000 7fcda575c700 1 --2- 172.21.15.146:0/4017210698 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcda0156ec0 0x7fcda0143c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:12.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.047+0000 7fcda575c700 1 --2- 172.21.15.146:0/4017210698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcda0157290 0x7fcda01556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:12.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.047+0000 7fcda575c700 1 -- 172.21.15.146:0/4017210698 >> 172.21.15.146:0/4017210698 conn(0x7fcda006aca0 msgr2=0x7fcda0154cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:12.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.047+0000 7fcda575c700 1 -- 172.21.15.146:0/4017210698 shutdown_connections 2023-10-06T11:18:12.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.047+0000 7fcda575c700 1 -- 172.21.15.146:0/4017210698 wait complete. 2023-10-06T11:18:12.050 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 128 2023-10-06T11:18:12.061 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:18:12.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.175+0000 7faae9290700 1 Processor -- start 2023-10-06T11:18:12.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.175+0000 7faae9290700 1 -- start start 2023-10-06T11:18:12.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.175+0000 7faae9290700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faae415a940 0x7faae4153c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:12.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.175+0000 7faae9290700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7faae415dcc0 0x7faae40ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:12.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.175+0000 7faae9290700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faae415e140 con 0x7faae41538c0 2023-10-06T11:18:12.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.175+0000 7faae9290700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faae415d270 con 0x7faae415dcc0 2023-10-06T11:18:12.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.175+0000 7faae9290700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae415d830 con 0x7faae415a940 2023-10-06T11:18:12.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.176+0000 7faae2ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7faae41538c0 0x7faae40cac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33816/0 (socket says 172.21.15.146:33816) 2023-10-06T11:18:12.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.176+0000 7faae2ffd700 1 -- 172.21.15.146:0/1570537357 learned_addr learned my addr 172.21.15.146:0/1570537357 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:12.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.176+0000 7faae27fc700 1 --2- 172.21.15.146:0/1570537357 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faae415a940 0x7faae4153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:12.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.176+0000 7faae1ffb700 1 -- 172.21.15.146:0/1570537357 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1093190126 0 0) 0x7faadc001110 con 0x7faae41538c0 2023-10-06T11:18:12.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.176+0000 7faae1ffb700 1 -- 172.21.15.146:0/1570537357 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faacc003570 con 0x7faae41538c0 2023-10-06T11:18:12.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.176+0000 7faae37fe700 1 --2- 172.21.15.146:0/1570537357 >> v2:172.21.15.151:3300/0 conn(0x7faae415dcc0 0x7faae40ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:12.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.176+0000 7faae1ffb700 1 -- 172.21.15.146:0/1570537357 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3334590756 0 0) 0x7faacc003570 con 0x7faae41538c0 2023-10-06T11:18:12.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.176+0000 7faae1ffb700 1 -- 172.21.15.146:0/1570537357 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faae415a940 msgr2=0x7faae4153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:12.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.176+0000 7faae1ffb700 1 --2- 172.21.15.146:0/1570537357 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faae415a940 0x7faae4153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:12.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.176+0000 7faae1ffb700 1 -- 172.21.15.146:0/1570537357 >> v2:172.21.15.151:3300/0 conn(0x7faae415dcc0 msgr2=0x7faae40ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:12.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.176+0000 7faae1ffb700 1 --2- 172.21.15.146:0/1570537357 >> v2:172.21.15.151:3300/0 conn(0x7faae415dcc0 0x7faae40ce610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:12.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.176+0000 7faae1ffb700 1 -- 172.21.15.146:0/1570537357 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae40cb810 con 0x7faae41538c0 2023-10-06T11:18:12.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.176+0000 7faae1ffb700 1 -- 172.21.15.146:0/1570537357 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7faadc001600 con 0x7faae41538c0 2023-10-06T11:18:12.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.176+0000 7faae1ffb700 1 -- 172.21.15.146:0/1570537357 >> v1:172.21.15.146:6789/0 conn(0x7faae41538c0 legacy=0x7faae40cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:12.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.176+0000 7faae1ffb700 1 --2- 172.21.15.146:0/1570537357 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faae415a940 0x7faacc003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:12.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.176+0000 7faae1ffb700 1 --2- 172.21.15.146:0/1570537357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faacc003fe0 0x7faacc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:12.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.176+0000 7faae1ffb700 1 --2- 172.21.15.146:0/1570537357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faacc004d50 0x7faacc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:12.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.176+0000 7faae1ffb700 1 -- 172.21.15.146:0/1570537357 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae415d270 con 0x7faacc004d50 2023-10-06T11:18:12.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.176+0000 7faae1ffb700 1 -- 172.21.15.146:0/1570537357 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae415d830 con 0x7faacc003fe0 2023-10-06T11:18:12.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.176+0000 7faae1ffb700 1 -- 172.21.15.146:0/1570537357 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faacc00ba90 con 0x7faae415a940 2023-10-06T11:18:12.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.176+0000 7faae37fe700 1 --2- 172.21.15.146:0/1570537357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faacc004d50 0x7faacc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:12.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.176+0000 7faae2ffd700 1 --2- 172.21.15.146:0/1570537357 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faae415a940 0x7faacc003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:12.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.176+0000 7faae27fc700 1 --2- 172.21.15.146:0/1570537357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faacc003fe0 0x7faacc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:12.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.177+0000 7faae37fe700 1 -- 172.21.15.146:0/1570537357 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faae415a940 msgr2=0x7faacc003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:12.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.177+0000 7faae37fe700 1 --2- 172.21.15.146:0/1570537357 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faae415a940 0x7faacc003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:12.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.177+0000 7faae37fe700 1 -- 172.21.15.146:0/1570537357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faacc003fe0 msgr2=0x7faacc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:12.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.177+0000 7faae37fe700 1 --2- 172.21.15.146:0/1570537357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faacc003fe0 0x7faacc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:12.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.177+0000 7faae37fe700 1 -- 172.21.15.146:0/1570537357 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faacc003570 con 0x7faacc004d50 2023-10-06T11:18:12.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.177+0000 7faae37fe700 1 --2- 172.21.15.146:0/1570537357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faacc004d50 0x7faacc0051c0 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7faad4009c00 tx=0x7faad40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73317a1a9dca9990 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:12.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.177+0000 7faae1ffb700 1 -- 172.21.15.146:0/1570537357 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad400e6b0 con 0x7faacc004d50 2023-10-06T11:18:12.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.177+0000 7faae1ffb700 1 -- 172.21.15.146:0/1570537357 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad400e810 con 0x7faacc004d50 2023-10-06T11:18:12.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.177+0000 7faae1ffb700 1 -- 172.21.15.146:0/1570537357 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad400ebd0 con 0x7faacc004d50 2023-10-06T11:18:12.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.177+0000 7faae9290700 1 -- 172.21.15.146:0/1570537357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faacc004d50 msgr2=0x7faacc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:12.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.177+0000 7faae9290700 1 --2- 172.21.15.146:0/1570537357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faacc004d50 0x7faacc0051c0 secure :-1 s=READY pgs=2027 cs=0 l=1 rev1=1 crypto rx=0x7faad4009c00 tx=0x7faad40091a0 comp rx=0 tx=0).stop 2023-10-06T11:18:12.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.177+0000 7faae37fe700 1 -- 172.21.15.146:0/1570537357 reap_dead start 2023-10-06T11:18:12.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.177+0000 7faae9290700 1 -- 172.21.15.146:0/1570537357 shutdown_connections 2023-10-06T11:18:12.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.177+0000 7faae9290700 1 -- 172.21.15.146:0/1570537357 >> 172.21.15.146:0/1570537357 conn(0x7faae406eb10 msgr2=0x7faae406ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:12.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.177+0000 7faae9290700 1 -- 172.21.15.146:0/1570537357 shutdown_connections 2023-10-06T11:18:12.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.178+0000 7faae9290700 1 -- 172.21.15.146:0/1570537357 wait complete. 2023-10-06T11:18:12.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.179+0000 7faae9290700 1 Processor -- start 2023-10-06T11:18:12.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.179+0000 7faae9290700 1 -- start start 2023-10-06T11:18:12.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.179+0000 7faae9290700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faacc004d50 0x7faae4158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:12.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.179+0000 7faae9290700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faae40b60a0 0x7faae40b5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:12.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.179+0000 7faae9290700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faae40b56b0 0x7faae40c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:12.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.179+0000 7faae9290700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae40c8810 con 0x7faae40b60a0 2023-10-06T11:18:12.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.179+0000 7faae9290700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae40c8230 con 0x7faacc004d50 2023-10-06T11:18:12.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.179+0000 7faae9290700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae4152c40 con 0x7faae40b56b0 2023-10-06T11:18:12.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.180+0000 7faae27fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faae40b60a0 0x7faae40b5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:12.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.180+0000 7faae27fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faae40b60a0 0x7faae40b5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40490/0 (socket says 172.21.15.146:40490) 2023-10-06T11:18:12.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.180+0000 7faae27fc700 1 -- 172.21.15.146:0/3184199516 learned_addr learned my addr 172.21.15.146:0/3184199516 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:12.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.180+0000 7faae2ffd700 1 --2- 172.21.15.146:0/3184199516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faacc004d50 0x7faae4158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:12.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.180+0000 7faae37fe700 1 --2- 172.21.15.146:0/3184199516 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faae40b56b0 0x7faae40c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:12.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.180+0000 7faae27fc700 1 -- 172.21.15.146:0/3184199516 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faae40b56b0 msgr2=0x7faae40c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:12.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.180+0000 7faae27fc700 1 --2- 172.21.15.146:0/3184199516 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faae40b56b0 0x7faae40c8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:12.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.180+0000 7faae27fc700 1 -- 172.21.15.146:0/3184199516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faacc004d50 msgr2=0x7faae4158fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:12.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.180+0000 7faae27fc700 1 --2- 172.21.15.146:0/3184199516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faacc004d50 0x7faae4158fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:12.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.180+0000 7faae27fc700 1 -- 172.21.15.146:0/3184199516 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae40c84a0 con 0x7faae40b60a0 2023-10-06T11:18:12.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.180+0000 7faae27fc700 1 --2- 172.21.15.146:0/3184199516 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faae40b60a0 0x7faae40b5170 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7faad8011f00 tx=0x7faad800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:12.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.180+0000 7faacaffd700 1 -- 172.21.15.146:0/3184199516 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad800e040 con 0x7faae40b60a0 2023-10-06T11:18:12.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.180+0000 7faacaffd700 1 -- 172.21.15.146:0/3184199516 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad800f040 con 0x7faae40b60a0 2023-10-06T11:18:12.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.180+0000 7faae9290700 1 -- 172.21.15.146:0/3184199516 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faae40b5b20 con 0x7faae40b60a0 2023-10-06T11:18:12.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.180+0000 7faacaffd700 1 -- 172.21.15.146:0/3184199516 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad800fe70 con 0x7faae40b60a0 2023-10-06T11:18:12.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.180+0000 7faae9290700 1 -- 172.21.15.146:0/3184199516 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faae41594e0 con 0x7faae40b60a0 2023-10-06T11:18:12.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.181+0000 7faae9290700 1 -- 172.21.15.146:0/3184199516 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faae40c8980 con 0x7faae40b60a0 2023-10-06T11:18:12.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.182+0000 7faacaffd700 1 -- 172.21.15.146:0/3184199516 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faad8015640 con 0x7faae40b60a0 2023-10-06T11:18:12.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.182+0000 7faacaffd700 1 --2- 172.21.15.146:0/3184199516 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faad0066f60 0x7faad0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:12.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.182+0000 7faacaffd700 1 -- 172.21.15.146:0/3184199516 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7faad8085200 con 0x7faae40b60a0 2023-10-06T11:18:12.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.182+0000 7faae2ffd700 1 --2- 172.21.15.146:0/3184199516 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faad0066f60 0x7faad0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:12.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.182+0000 7faae2ffd700 1 --2- 172.21.15.146:0/3184199516 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faad0066f60 0x7faad0069410 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7faadc007b70 tx=0x7faadc007a80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:12.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.186+0000 7faacaffd700 1 -- 172.21.15.146:0/3184199516 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faad8055da0 con 0x7faae40b60a0 2023-10-06T11:18:12.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.369+0000 7faae9290700 1 -- 172.21.15.146:0/3184199516 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faae404c380 con 0x7faae40b60a0 2023-10-06T11:18:12.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.370+0000 7faacaffd700 1 -- 172.21.15.146:0/3184199516 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v151) v1 ==== 74+0+16928 (secure 0 0 0) 0x7faad8055930 con 0x7faae40b60a0 2023-10-06T11:18:12.372 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:18:12.372 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":151,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:17:25.552935+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:17:21.595161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-10-06T11:17:23.009401+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:18:12.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.372+0000 7faae9290700 1 -- 172.21.15.146:0/3184199516 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faad0066f60 msgr2=0x7faad0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:12.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.372+0000 7faae9290700 1 --2- 172.21.15.146:0/3184199516 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faad0066f60 0x7faad0069410 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7faadc007b70 tx=0x7faadc007a80 comp rx=0 tx=0).stop 2023-10-06T11:18:12.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.372+0000 7faae9290700 1 -- 172.21.15.146:0/3184199516 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faae40b60a0 msgr2=0x7faae40b5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:12.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.372+0000 7faae9290700 1 --2- 172.21.15.146:0/3184199516 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faae40b60a0 0x7faae40b5170 secure :-1 s=READY pgs=2028 cs=0 l=1 rev1=1 crypto rx=0x7faad8011f00 tx=0x7faad800b040 comp rx=0 tx=0).stop 2023-10-06T11:18:12.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.372+0000 7faae9290700 1 -- 172.21.15.146:0/3184199516 shutdown_connections 2023-10-06T11:18:12.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.372+0000 7faae9290700 1 --2- 172.21.15.146:0/3184199516 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faad0066f60 0x7faad0069410 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:12.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.372+0000 7faae9290700 1 --2- 172.21.15.146:0/3184199516 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faae40b56b0 0x7faae40c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:12.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.372+0000 7faae9290700 1 --2- 172.21.15.146:0/3184199516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faacc004d50 0x7faae4158fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:12.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.372+0000 7faae9290700 1 --2- 172.21.15.146:0/3184199516 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faae40b60a0 0x7faae40b5170 unknown :-1 s=CLOSED pgs=2028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:12.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.372+0000 7faae9290700 1 -- 172.21.15.146:0/3184199516 >> 172.21.15.146:0/3184199516 conn(0x7faae406eb10 msgr2=0x7faae40d0330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:12.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.372+0000 7faae9290700 1 -- 172.21.15.146:0/3184199516 shutdown_connections 2023-10-06T11:18:12.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.372+0000 7faae9290700 1 -- 172.21.15.146:0/3184199516 wait complete. 2023-10-06T11:18:12.386 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T11:18:12.387 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:18:12.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.500+0000 7f46ee16f700 1 Processor -- start 2023-10-06T11:18:12.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.500+0000 7f46ee16f700 1 -- start start 2023-10-06T11:18:12.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.501+0000 7f46ee16f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f46e81584a0 0x7f46e8158870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:12.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.501+0000 7f46ee16f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f46e80c8a90 0x7f46e80c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:12.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.501+0000 7f46ee16f700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f46e806b760 0x7f46e806bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:12.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.501+0000 7f46ee16f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46e806c100 con 0x7f46e81584a0 2023-10-06T11:18:12.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.501+0000 7f46ee16f700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46e815b440 con 0x7f46e806b760 2023-10-06T11:18:12.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.501+0000 7f46ee16f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e815b720 con 0x7f46e80c8a90 2023-10-06T11:18:12.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.501+0000 7f46e77fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f46e81584a0 0x7f46e8158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:12.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.501+0000 7f46e77fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f46e81584a0 0x7f46e8158870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40498/0 (socket says 172.21.15.146:40498) 2023-10-06T11:18:12.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.501+0000 7f46e77fe700 1 -- 172.21.15.146:0/2360929822 learned_addr learned my addr 172.21.15.146:0/2360929822 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:12.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.502+0000 7f46e77fe700 1 -- 172.21.15.146:0/2360929822 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f46e80c8a90 msgr2=0x7f46e80c8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:12.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.502+0000 7f46e77fe700 1 --2- 172.21.15.146:0/2360929822 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f46e80c8a90 0x7f46e80c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:12.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.502+0000 7f46e77fe700 1 -- 172.21.15.146:0/2360929822 >> v2:172.21.15.151:3300/0 conn(0x7f46e806b760 msgr2=0x7f46e806bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:12.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.502+0000 7f46e7fff700 1 --2- 172.21.15.146:0/2360929822 >> v2:172.21.15.151:3300/0 conn(0x7f46e806b760 0x7f46e806bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:12.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.502+0000 7f46e77fe700 1 --2- 172.21.15.146:0/2360929822 >> v2:172.21.15.151:3300/0 conn(0x7f46e806b760 0x7f46e806bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:12.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.502+0000 7f46e77fe700 1 -- 172.21.15.146:0/2360929822 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e815ba00 con 0x7f46e81584a0 2023-10-06T11:18:12.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.502+0000 7f46e77fe700 1 --2- 172.21.15.146:0/2360929822 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46e81584a0 0x7f46e8158870 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7f46e80b0eb0 tx=0x7f46d8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c80702db6b0783 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:12.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.502+0000 7f46e67fc700 1 -- 172.21.15.146:0/2360929822 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d800e070 con 0x7f46e81584a0 2023-10-06T11:18:12.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.502+0000 7f46e67fc700 1 -- 172.21.15.146:0/2360929822 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d800ba50 con 0x7f46e81584a0 2023-10-06T11:18:12.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.502+0000 7f46e67fc700 1 -- 172.21.15.146:0/2360929822 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d80092e0 con 0x7f46e81584a0 2023-10-06T11:18:12.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.502+0000 7f46ee16f700 1 -- 172.21.15.146:0/2360929822 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46e81584a0 msgr2=0x7f46e8158870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:12.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.502+0000 7f46ee16f700 1 --2- 172.21.15.146:0/2360929822 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46e81584a0 0x7f46e8158870 secure :-1 s=READY pgs=2029 cs=0 l=1 rev1=1 crypto rx=0x7f46e80b0eb0 tx=0x7f46d8009840 comp rx=0 tx=0).stop 2023-10-06T11:18:12.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.502+0000 7f46ee16f700 1 -- 172.21.15.146:0/2360929822 shutdown_connections 2023-10-06T11:18:12.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.502+0000 7f46ee16f700 1 --2- 172.21.15.146:0/2360929822 >> v2:172.21.15.151:3300/0 conn(0x7f46e806b760 0x7f46e806bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:12.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.502+0000 7f46ee16f700 1 --2- 172.21.15.146:0/2360929822 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46e81584a0 0x7f46e8158870 unknown :-1 s=CLOSED pgs=2029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:12.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.502+0000 7f46ee16f700 1 --2- 172.21.15.146:0/2360929822 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f46e80c8a90 0x7f46e80c8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:12.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.502+0000 7f46ee16f700 1 -- 172.21.15.146:0/2360929822 >> 172.21.15.146:0/2360929822 conn(0x7f46e8067eb0 msgr2=0x7f46e80ce450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:12.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.502+0000 7f46ee16f700 1 -- 172.21.15.146:0/2360929822 shutdown_connections 2023-10-06T11:18:12.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.503+0000 7f46ee16f700 1 -- 172.21.15.146:0/2360929822 wait complete. 2023-10-06T11:18:12.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.504+0000 7f46ee16f700 1 Processor -- start 2023-10-06T11:18:12.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.504+0000 7f46ee16f700 1 -- start start 2023-10-06T11:18:12.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.504+0000 7f46ee16f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f46e806b760 0x7f46e81513d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:12.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.504+0000 7f46ee16f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f46e80c8a90 0x7f46e80c7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:12.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.504+0000 7f46ee16f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46e81584a0 0x7f46e80c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:12.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.504+0000 7f46ee16f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e81567d0 con 0x7f46e81584a0 2023-10-06T11:18:12.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.504+0000 7f46ee16f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e81575f0 con 0x7f46e806b760 2023-10-06T11:18:12.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.504+0000 7f46ee16f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e81569e0 con 0x7f46e80c8a90 2023-10-06T11:18:12.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.505+0000 7f46e7fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46e81584a0 0x7f46e80c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:12.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.505+0000 7f46e7fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46e81584a0 0x7f46e80c7a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40504/0 (socket says 172.21.15.146:40504) 2023-10-06T11:18:12.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.505+0000 7f46e7fff700 1 -- 172.21.15.146:0/2692295829 learned_addr learned my addr 172.21.15.146:0/2692295829 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:12.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.505+0000 7f46e77fe700 1 --2- 172.21.15.146:0/2692295829 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f46e806b760 0x7f46e81513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:12.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.505+0000 7f46e6ffd700 1 --2- 172.21.15.146:0/2692295829 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f46e80c8a90 0x7f46e80c7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:12.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.505+0000 7f46e7fff700 1 -- 172.21.15.146:0/2692295829 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f46e80c8a90 msgr2=0x7f46e80c7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:12.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.505+0000 7f46e7fff700 1 --2- 172.21.15.146:0/2692295829 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f46e80c8a90 0x7f46e80c7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:12.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.505+0000 7f46e7fff700 1 -- 172.21.15.146:0/2692295829 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f46e806b760 msgr2=0x7f46e81513d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:12.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.505+0000 7f46e7fff700 1 --2- 172.21.15.146:0/2692295829 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f46e806b760 0x7f46e81513d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:12.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.505+0000 7f46e7fff700 1 -- 172.21.15.146:0/2692295829 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d8009ae0 con 0x7f46e81584a0 2023-10-06T11:18:12.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.505+0000 7f46e7fff700 1 --2- 172.21.15.146:0/2692295829 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46e81584a0 0x7f46e80c7a50 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7f46e000c8b0 tx=0x7f46e0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:12.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.505+0000 7f46cf7fe700 1 -- 172.21.15.146:0/2692295829 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e0011660 con 0x7f46e81584a0 2023-10-06T11:18:12.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.505+0000 7f46cf7fe700 1 -- 172.21.15.146:0/2692295829 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46e00117c0 con 0x7f46e81584a0 2023-10-06T11:18:12.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.505+0000 7f46ee16f700 1 -- 172.21.15.146:0/2692295829 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46e8156cc0 con 0x7f46e81584a0 2023-10-06T11:18:12.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.505+0000 7f46cf7fe700 1 -- 172.21.15.146:0/2692295829 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46e0011b40 con 0x7f46e81584a0 2023-10-06T11:18:12.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.505+0000 7f46ee16f700 1 -- 172.21.15.146:0/2692295829 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46e8157280 con 0x7f46e81584a0 2023-10-06T11:18:12.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.506+0000 7f46ee16f700 1 -- 172.21.15.146:0/2692295829 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46e804c380 con 0x7f46e81584a0 2023-10-06T11:18:12.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.507+0000 7f46cf7fe700 1 -- 172.21.15.146:0/2692295829 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f46e00193f0 con 0x7f46e81584a0 2023-10-06T11:18:12.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.507+0000 7f46cf7fe700 1 --2- 172.21.15.146:0/2692295829 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f46d4066f30 0x7f46d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:12.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.507+0000 7f46cf7fe700 1 -- 172.21.15.146:0/2692295829 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f46e0084930 con 0x7f46e81584a0 2023-10-06T11:18:12.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.507+0000 7f46e77fe700 1 --2- 172.21.15.146:0/2692295829 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f46d4066f30 0x7f46d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:12.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.507+0000 7f46e77fe700 1 --2- 172.21.15.146:0/2692295829 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f46d4066f30 0x7f46d40693e0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f46d8009880 tx=0x7f46d8018000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:12.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.511+0000 7f46cf7fe700 1 -- 172.21.15.146:0/2692295829 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f46e00554d0 con 0x7f46e81584a0 2023-10-06T11:18:12.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.741+0000 7f46ee16f700 1 -- 172.21.15.146:0/2692295829 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46e8157730 con 0x7f46e81584a0 2023-10-06T11:18:12.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.742+0000 7f46cf7fe700 1 -- 172.21.15.146:0/2692295829 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 128 v128) v1 ==== 95+0+4619 (secure 0 0 0) 0x7f46e8157730 con 0x7f46e81584a0 2023-10-06T11:18:12.744 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:18:12.744 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":128,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7433,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3681774523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3681774523},{"type":"v1","addr":"172.21.15.151:6834","nonce":3681774523}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":124},{"gid":7436,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/3243480101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":3243480101},{"type":"v1","addr":"172.21.15.151:6835","nonce":3243480101}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":124},{"gid":9645,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/1871572981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1871572981},{"type":"v1","addr":"172.21.15.146:6836","nonce":1871572981}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":124}],"filesystems":[{"mdsmap":{"epoch":128,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:17:23.939322+0000","modified":"2023-10-06T11:17:27.570448+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9648},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9648":{"gid":9648,"name":"c","rank":0,"incarnation":125,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/2875253990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2875253990},{"type":"v1","addr":"172.21.15.146:6837","nonce":2875253990}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-06T11:18:12.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.744+0000 7f46ee16f700 1 -- 172.21.15.146:0/2692295829 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f46d4066f30 msgr2=0x7f46d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:12.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.744+0000 7f46ee16f700 1 --2- 172.21.15.146:0/2692295829 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f46d4066f30 0x7f46d40693e0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f46d8009880 tx=0x7f46d8018000 comp rx=0 tx=0).stop 2023-10-06T11:18:12.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.744+0000 7f46ee16f700 1 -- 172.21.15.146:0/2692295829 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46e81584a0 msgr2=0x7f46e80c7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:12.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.744+0000 7f46ee16f700 1 --2- 172.21.15.146:0/2692295829 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46e81584a0 0x7f46e80c7a50 secure :-1 s=READY pgs=2030 cs=0 l=1 rev1=1 crypto rx=0x7f46e000c8b0 tx=0x7f46e0008040 comp rx=0 tx=0).stop 2023-10-06T11:18:12.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.744+0000 7f46ee16f700 1 -- 172.21.15.146:0/2692295829 shutdown_connections 2023-10-06T11:18:12.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.744+0000 7f46ee16f700 1 --2- 172.21.15.146:0/2692295829 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f46d4066f30 0x7f46d40693e0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:12.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.744+0000 7f46ee16f700 1 --2- 172.21.15.146:0/2692295829 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f46e81584a0 0x7f46e80c7a50 unknown :-1 s=CLOSED pgs=2030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:12.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.744+0000 7f46ee16f700 1 --2- 172.21.15.146:0/2692295829 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f46e806b760 0x7f46e81513d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:12.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.744+0000 7f46ee16f700 1 --2- 172.21.15.146:0/2692295829 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f46e80c8a90 0x7f46e80c7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:12.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.744+0000 7f46ee16f700 1 -- 172.21.15.146:0/2692295829 >> 172.21.15.146:0/2692295829 conn(0x7f46e8067eb0 msgr2=0x7f46e80c3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:12.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.744+0000 7f46ee16f700 1 -- 172.21.15.146:0/2692295829 shutdown_connections 2023-10-06T11:18:12.747 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.744+0000 7f46ee16f700 1 -- 172.21.15.146:0/2692295829 wait complete. 2023-10-06T11:18:12.747 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 128 2023-10-06T11:18:12.758 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:18:12.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.873+0000 7effd2d5a700 1 Processor -- start 2023-10-06T11:18:12.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.873+0000 7effd2d5a700 1 -- start start 2023-10-06T11:18:12.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.874+0000 7effd2d5a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7effcc0cd480 0x7effcc15abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:12.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.874+0000 7effd2d5a700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7effcc0b09f0 0x7effcc0b0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:12.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.874+0000 7effd2d5a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effcc0b6070 con 0x7effcc0cd0b0 2023-10-06T11:18:12.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.874+0000 7effd2d5a700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effcc0b0280 con 0x7effcc0b09f0 2023-10-06T11:18:12.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.874+0000 7effd2d5a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effcc15ddf0 con 0x7effcc0cd480 2023-10-06T11:18:12.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.874+0000 7effd0af6700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7effcc0cd0b0 0x7effcc15d610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33826/0 (socket says 172.21.15.146:33826) 2023-10-06T11:18:12.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.874+0000 7effd0af6700 1 -- 172.21.15.146:0/3524761827 learned_addr learned my addr 172.21.15.146:0/3524761827 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:12.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.874+0000 7effd12f7700 1 --2- 172.21.15.146:0/3524761827 >> v2:172.21.15.151:3300/0 conn(0x7effcc0b09f0 0x7effcc0b0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:12.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.874+0000 7effc3fff700 1 --2- 172.21.15.146:0/3524761827 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7effcc0cd480 0x7effcc15abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:12.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.875+0000 7effc37fe700 1 -- 172.21.15.146:0/3524761827 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3391450455 0 0) 0x7effcc0b6070 con 0x7effcc0cd0b0 2023-10-06T11:18:12.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.875+0000 7effc37fe700 1 -- 172.21.15.146:0/3524761827 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effb4003570 con 0x7effcc0cd0b0 2023-10-06T11:18:12.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.875+0000 7effc37fe700 1 -- 172.21.15.146:0/3524761827 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1325747582 0 0) 0x7effb4003570 con 0x7effcc0cd0b0 2023-10-06T11:18:12.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.875+0000 7effc37fe700 1 -- 172.21.15.146:0/3524761827 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7effcc0cd480 msgr2=0x7effcc15abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:12.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.875+0000 7effc37fe700 1 --2- 172.21.15.146:0/3524761827 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7effcc0cd480 0x7effcc15abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:12.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.875+0000 7effc37fe700 1 -- 172.21.15.146:0/3524761827 >> v2:172.21.15.151:3300/0 conn(0x7effcc0b09f0 msgr2=0x7effcc0b0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:12.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.875+0000 7effc37fe700 1 --2- 172.21.15.146:0/3524761827 >> v2:172.21.15.151:3300/0 conn(0x7effcc0b09f0 0x7effcc0b0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:12.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.875+0000 7effc37fe700 1 -- 172.21.15.146:0/3524761827 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effcc15e0d0 con 0x7effcc0cd0b0 2023-10-06T11:18:12.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.875+0000 7effc37fe700 1 -- 172.21.15.146:0/3524761827 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7effc80017f0 con 0x7effcc0cd0b0 2023-10-06T11:18:12.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.875+0000 7effc37fe700 1 -- 172.21.15.146:0/3524761827 >> v1:172.21.15.146:6789/0 conn(0x7effcc0cd0b0 legacy=0x7effcc15d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:12.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.875+0000 7effc37fe700 1 --2- 172.21.15.146:0/3524761827 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7effb4003a60 0x7effb4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:12.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.875+0000 7effc37fe700 1 --2- 172.21.15.146:0/3524761827 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7effcc0cd480 0x7effb4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:12.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.875+0000 7effc37fe700 1 --2- 172.21.15.146:0/3524761827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effb4004d50 0x7effb40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:12.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.875+0000 7effc37fe700 1 -- 172.21.15.146:0/3524761827 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effcc0b0280 con 0x7effb4004d50 2023-10-06T11:18:12.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.875+0000 7effc37fe700 1 -- 172.21.15.146:0/3524761827 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effcc15ddf0 con 0x7effb4003a60 2023-10-06T11:18:12.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.875+0000 7effc37fe700 1 -- 172.21.15.146:0/3524761827 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb400ba60 con 0x7effcc0cd480 2023-10-06T11:18:12.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.875+0000 7effd12f7700 1 --2- 172.21.15.146:0/3524761827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effb4004d50 0x7effb40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:12.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.875+0000 7effd0af6700 1 --2- 172.21.15.146:0/3524761827 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7effb4003a60 0x7effb4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:12.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.875+0000 7effc3fff700 1 --2- 172.21.15.146:0/3524761827 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7effcc0cd480 0x7effb4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:12.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.875+0000 7effd12f7700 1 -- 172.21.15.146:0/3524761827 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7effcc0cd480 msgr2=0x7effb4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:12.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.875+0000 7effd12f7700 1 --2- 172.21.15.146:0/3524761827 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7effcc0cd480 0x7effb4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:12.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.875+0000 7effd12f7700 1 -- 172.21.15.146:0/3524761827 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7effb4003a60 msgr2=0x7effb4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:12.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.875+0000 7effd12f7700 1 --2- 172.21.15.146:0/3524761827 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7effb4003a60 0x7effb4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:12.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.875+0000 7effd12f7700 1 -- 172.21.15.146:0/3524761827 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb4003570 con 0x7effb4004d50 2023-10-06T11:18:12.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.875+0000 7effd12f7700 1 --2- 172.21.15.146:0/3524761827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effb4004d50 0x7effb40051c0 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7effc4009c00 tx=0x7effc40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9254dfb43b046952 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:12.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.876+0000 7effc37fe700 1 -- 172.21.15.146:0/3524761827 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc400e6b0 con 0x7effb4004d50 2023-10-06T11:18:12.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.876+0000 7effc37fe700 1 -- 172.21.15.146:0/3524761827 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc400e810 con 0x7effb4004d50 2023-10-06T11:18:12.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.876+0000 7effc37fe700 1 -- 172.21.15.146:0/3524761827 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc400ebd0 con 0x7effb4004d50 2023-10-06T11:18:12.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.876+0000 7effd2d5a700 1 -- 172.21.15.146:0/3524761827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effb4004d50 msgr2=0x7effb40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:12.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.876+0000 7effd2d5a700 1 --2- 172.21.15.146:0/3524761827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effb4004d50 0x7effb40051c0 secure :-1 s=READY pgs=2032 cs=0 l=1 rev1=1 crypto rx=0x7effc4009c00 tx=0x7effc40091a0 comp rx=0 tx=0).stop 2023-10-06T11:18:12.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.876+0000 7effd12f7700 1 -- 172.21.15.146:0/3524761827 reap_dead start 2023-10-06T11:18:12.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.876+0000 7effd2d5a700 1 -- 172.21.15.146:0/3524761827 shutdown_connections 2023-10-06T11:18:12.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.876+0000 7effd2d5a700 1 -- 172.21.15.146:0/3524761827 >> 172.21.15.146:0/3524761827 conn(0x7effcc06eb10 msgr2=0x7effcc06ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:12.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.876+0000 7effd2d5a700 1 -- 172.21.15.146:0/3524761827 shutdown_connections 2023-10-06T11:18:12.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.876+0000 7effd2d5a700 1 -- 172.21.15.146:0/3524761827 wait complete. 2023-10-06T11:18:12.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.877+0000 7effd2d5a700 1 Processor -- start 2023-10-06T11:18:12.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.877+0000 7effd2d5a700 1 -- start start 2023-10-06T11:18:12.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.878+0000 7effd2d5a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7effcc0c6080 0x7effcc169ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:12.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.878+0000 7effd2d5a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effcc0c6450 0x7effcc14d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:12.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.878+0000 7effd2d5a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7effcc14dab0 0x7effcc0c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:12.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.878+0000 7effd2d5a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effcc0c9c60 con 0x7effcc0c6450 2023-10-06T11:18:12.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.878+0000 7effd2d5a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effcc0c3dc0 con 0x7effcc14dab0 2023-10-06T11:18:12.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.878+0000 7effd2d5a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effcc0c40a0 con 0x7effcc0c6080 2023-10-06T11:18:12.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.878+0000 7effc3fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effcc0c6450 0x7effcc14d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:12.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.878+0000 7effc3fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effcc0c6450 0x7effcc14d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40530/0 (socket says 172.21.15.146:40530) 2023-10-06T11:18:12.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.878+0000 7effc3fff700 1 -- 172.21.15.146:0/1946149319 learned_addr learned my addr 172.21.15.146:0/1946149319 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:12.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.878+0000 7effd12f7700 1 --2- 172.21.15.146:0/1946149319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7effcc14dab0 0x7effcc0c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:12.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.878+0000 7effd0af6700 1 --2- 172.21.15.146:0/1946149319 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7effcc0c6080 0x7effcc169ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:12.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.879+0000 7effc3fff700 1 -- 172.21.15.146:0/1946149319 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7effcc0c6080 msgr2=0x7effcc169ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:12.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.879+0000 7effc3fff700 1 --2- 172.21.15.146:0/1946149319 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7effcc0c6080 0x7effcc169ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:12.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.879+0000 7effc3fff700 1 -- 172.21.15.146:0/1946149319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7effcc14dab0 msgr2=0x7effcc0c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:12.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.879+0000 7effc3fff700 1 --2- 172.21.15.146:0/1946149319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7effcc14dab0 0x7effcc0c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:12.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.879+0000 7effc3fff700 1 -- 172.21.15.146:0/1946149319 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effcc0c4380 con 0x7effcc0c6450 2023-10-06T11:18:12.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.879+0000 7effc3fff700 1 --2- 172.21.15.146:0/1946149319 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effcc0c6450 0x7effcc14d570 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7effbc006ac0 tx=0x7effbc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:12.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.879+0000 7effc0ff9700 1 -- 172.21.15.146:0/1946149319 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effbc00fa10 con 0x7effcc0c6450 2023-10-06T11:18:12.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.879+0000 7effc0ff9700 1 -- 172.21.15.146:0/1946149319 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effbc00fb70 con 0x7effcc0c6450 2023-10-06T11:18:12.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.879+0000 7effd2d5a700 1 -- 172.21.15.146:0/1946149319 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effcc0c4660 con 0x7effcc0c6450 2023-10-06T11:18:12.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.879+0000 7effc0ff9700 1 -- 172.21.15.146:0/1946149319 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effbc014440 con 0x7effcc0c6450 2023-10-06T11:18:12.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.879+0000 7effd2d5a700 1 -- 172.21.15.146:0/1946149319 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effcc16a020 con 0x7effcc0c6450 2023-10-06T11:18:12.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.880+0000 7effd2d5a700 1 -- 172.21.15.146:0/1946149319 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effcc070ec0 con 0x7effcc0c6450 2023-10-06T11:18:12.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.880+0000 7effc0ff9700 1 -- 172.21.15.146:0/1946149319 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7effbc014870 con 0x7effcc0c6450 2023-10-06T11:18:12.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.880+0000 7effc0ff9700 1 --2- 172.21.15.146:0/1946149319 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7effb8066f30 0x7effb80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:12.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.881+0000 7effc0ff9700 1 -- 172.21.15.146:0/1946149319 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7effbc018030 con 0x7effcc0c6450 2023-10-06T11:18:12.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.881+0000 7effd0af6700 1 --2- 172.21.15.146:0/1946149319 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7effb8066f30 0x7effb80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:12.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.881+0000 7effd0af6700 1 --2- 172.21.15.146:0/1946149319 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7effb8066f30 0x7effb80693e0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7effc800a100 tx=0x7effc8006040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:12.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:12.885+0000 7effc0ff9700 1 -- 172.21.15.146:0/1946149319 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7effbc052320 con 0x7effcc0c6450 2023-10-06T11:18:13.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.110+0000 7effd2d5a700 1 -- 172.21.15.146:0/1946149319 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7effcc0c4850 con 0x7effcc0c6450 2023-10-06T11:18:13.112 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.111+0000 7effc0ff9700 1 -- 172.21.15.146:0/1946149319 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 128 v128) v1 ==== 95+0+4619 (secure 0 0 0) 0x7effbc055940 con 0x7effcc0c6450 2023-10-06T11:18:13.112 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:18:13.113 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":128,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7433,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3681774523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3681774523},{"type":"v1","addr":"172.21.15.151:6834","nonce":3681774523}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":124},{"gid":7436,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/3243480101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":3243480101},{"type":"v1","addr":"172.21.15.151:6835","nonce":3243480101}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":124},{"gid":9645,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/1871572981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1871572981},{"type":"v1","addr":"172.21.15.146:6836","nonce":1871572981}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":124}],"filesystems":[{"mdsmap":{"epoch":128,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:17:23.939322+0000","modified":"2023-10-06T11:17:27.570448+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9648},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9648":{"gid":9648,"name":"c","rank":0,"incarnation":125,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/2875253990","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2875253990},{"type":"v1","addr":"172.21.15.146:6837","nonce":2875253990}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[24],"metadata_pool":23,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":11}]} 2023-10-06T11:18:13.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.113+0000 7effd2d5a700 1 -- 172.21.15.146:0/1946149319 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7effb8066f30 msgr2=0x7effb80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:13.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.113+0000 7effd2d5a700 1 --2- 172.21.15.146:0/1946149319 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7effb8066f30 0x7effb80693e0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7effc800a100 tx=0x7effc8006040 comp rx=0 tx=0).stop 2023-10-06T11:18:13.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.113+0000 7effd2d5a700 1 -- 172.21.15.146:0/1946149319 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effcc0c6450 msgr2=0x7effcc14d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:13.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.113+0000 7effd2d5a700 1 --2- 172.21.15.146:0/1946149319 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effcc0c6450 0x7effcc14d570 secure :-1 s=READY pgs=2033 cs=0 l=1 rev1=1 crypto rx=0x7effbc006ac0 tx=0x7effbc0091a0 comp rx=0 tx=0).stop 2023-10-06T11:18:13.115 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.113+0000 7effd2d5a700 1 -- 172.21.15.146:0/1946149319 shutdown_connections 2023-10-06T11:18:13.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.113+0000 7effd2d5a700 1 --2- 172.21.15.146:0/1946149319 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7effb8066f30 0x7effb80693e0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:13.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.113+0000 7effd2d5a700 1 --2- 172.21.15.146:0/1946149319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7effcc14dab0 0x7effcc0c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:13.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.113+0000 7effd2d5a700 1 --2- 172.21.15.146:0/1946149319 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7effcc0c6080 0x7effcc169ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:13.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.113+0000 7effd2d5a700 1 --2- 172.21.15.146:0/1946149319 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7effcc0c6450 0x7effcc14d570 unknown :-1 s=CLOSED pgs=2033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:13.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.113+0000 7effd2d5a700 1 -- 172.21.15.146:0/1946149319 >> 172.21.15.146:0/1946149319 conn(0x7effcc06eb10 msgr2=0x7effcc159c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:13.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.113+0000 7effd2d5a700 1 -- 172.21.15.146:0/1946149319 shutdown_connections 2023-10-06T11:18:13.116 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.113+0000 7effd2d5a700 1 -- 172.21.15.146:0/1946149319 wait complete. 2023-10-06T11:18:13.117 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 128 2023-10-06T11:18:13.127 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:18:13.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.240+0000 7f81e5591700 1 Processor -- start 2023-10-06T11:18:13.242 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.241+0000 7f81e5591700 1 -- start start 2023-10-06T11:18:13.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.241+0000 7f81e5591700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f81e015a940 0x7f81e0153c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:13.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.241+0000 7f81e5591700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f81e015dcc0 0x7f81e00ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:13.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.241+0000 7f81e5591700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81e015d270 con 0x7f81e01538c0 2023-10-06T11:18:13.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.241+0000 7f81e5591700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81e015d830 con 0x7f81e015a940 2023-10-06T11:18:13.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.241+0000 7f81e5591700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e015e110 con 0x7f81e015dcc0 2023-10-06T11:18:13.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.241+0000 7f81deffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f81e01538c0 0x7f81e00cac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33832/0 (socket says 172.21.15.146:33832) 2023-10-06T11:18:13.246 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.241+0000 7f81deffd700 1 -- 172.21.15.146:0/1104148993 learned_addr learned my addr 172.21.15.146:0/1104148993 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:13.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.242+0000 7f81df7fe700 1 --2- 172.21.15.146:0/1104148993 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f81e015dcc0 0x7f81e00ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:13.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.242+0000 7f81de7fc700 1 --2- 172.21.15.146:0/1104148993 >> v2:172.21.15.151:3300/0 conn(0x7f81e015a940 0x7f81e0153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:13.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.242+0000 7f81ddffb700 1 -- 172.21.15.146:0/1104148993 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3402611218 0 0) 0x7f81e015d270 con 0x7f81e01538c0 2023-10-06T11:18:13.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.242+0000 7f81ddffb700 1 -- 172.21.15.146:0/1104148993 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81c8003570 con 0x7f81e01538c0 2023-10-06T11:18:13.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.242+0000 7f81ddffb700 1 -- 172.21.15.146:0/1104148993 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3041389572 0 0) 0x7f81c8003570 con 0x7f81e01538c0 2023-10-06T11:18:13.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.242+0000 7f81ddffb700 1 -- 172.21.15.146:0/1104148993 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f81e015dcc0 msgr2=0x7f81e00ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:13.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.242+0000 7f81ddffb700 1 --2- 172.21.15.146:0/1104148993 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f81e015dcc0 0x7f81e00ce610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:13.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.242+0000 7f81ddffb700 1 -- 172.21.15.146:0/1104148993 >> v2:172.21.15.151:3300/0 conn(0x7f81e015a940 msgr2=0x7f81e0153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:13.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.242+0000 7f81ddffb700 1 --2- 172.21.15.146:0/1104148993 >> v2:172.21.15.151:3300/0 conn(0x7f81e015a940 0x7f81e0153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:13.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.242+0000 7f81ddffb700 1 -- 172.21.15.146:0/1104148993 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e00cb810 con 0x7f81e01538c0 2023-10-06T11:18:13.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.242+0000 7f81ddffb700 1 -- 172.21.15.146:0/1104148993 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f81d00017f0 con 0x7f81e01538c0 2023-10-06T11:18:13.247 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.242+0000 7f81ddffb700 1 -- 172.21.15.146:0/1104148993 >> v1:172.21.15.146:6789/0 conn(0x7f81e01538c0 legacy=0x7f81e00cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:13.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.242+0000 7f81ddffb700 1 --2- 172.21.15.146:0/1104148993 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f81e015dcc0 0x7f81c8003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:13.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.242+0000 7f81ddffb700 1 --2- 172.21.15.146:0/1104148993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81c8003fe0 0x7f81c8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:13.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.242+0000 7f81ddffb700 1 --2- 172.21.15.146:0/1104148993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81c8004d50 0x7f81c80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:13.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.242+0000 7f81ddffb700 1 -- 172.21.15.146:0/1104148993 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e015d830 con 0x7f81c8003fe0 2023-10-06T11:18:13.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.242+0000 7f81ddffb700 1 -- 172.21.15.146:0/1104148993 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e015e110 con 0x7f81c8004d50 2023-10-06T11:18:13.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.242+0000 7f81ddffb700 1 -- 172.21.15.146:0/1104148993 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c800ba90 con 0x7f81e015dcc0 2023-10-06T11:18:13.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.242+0000 7f81de7fc700 1 --2- 172.21.15.146:0/1104148993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81c8003fe0 0x7f81c8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:13.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.242+0000 7f81deffd700 1 --2- 172.21.15.146:0/1104148993 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f81e015dcc0 0x7f81c8003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:13.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.242+0000 7f81df7fe700 1 --2- 172.21.15.146:0/1104148993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81c8004d50 0x7f81c80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:13.248 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.242+0000 7f81de7fc700 1 -- 172.21.15.146:0/1104148993 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f81e015dcc0 msgr2=0x7f81c8003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:13.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.242+0000 7f81de7fc700 1 --2- 172.21.15.146:0/1104148993 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f81e015dcc0 0x7f81c8003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:13.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.242+0000 7f81de7fc700 1 -- 172.21.15.146:0/1104148993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81c8004d50 msgr2=0x7f81c80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:13.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.243+0000 7f81de7fc700 1 --2- 172.21.15.146:0/1104148993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81c8004d50 0x7f81c80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:13.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.243+0000 7f81de7fc700 1 -- 172.21.15.146:0/1104148993 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c8003570 con 0x7f81c8003fe0 2023-10-06T11:18:13.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.243+0000 7f81de7fc700 1 --2- 172.21.15.146:0/1104148993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81c8003fe0 0x7f81c8004810 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7f81d4009c00 tx=0x7f81d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb8adac424194c66 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:13.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.243+0000 7f81ddffb700 1 -- 172.21.15.146:0/1104148993 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d400e6b0 con 0x7f81c8003fe0 2023-10-06T11:18:13.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.243+0000 7f81ddffb700 1 -- 172.21.15.146:0/1104148993 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d400e810 con 0x7f81c8003fe0 2023-10-06T11:18:13.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.243+0000 7f81ddffb700 1 -- 172.21.15.146:0/1104148993 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d400ebd0 con 0x7f81c8003fe0 2023-10-06T11:18:13.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.243+0000 7f81e5591700 1 -- 172.21.15.146:0/1104148993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81c8003fe0 msgr2=0x7f81c8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:13.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.243+0000 7f81e5591700 1 --2- 172.21.15.146:0/1104148993 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81c8003fe0 0x7f81c8004810 secure :-1 s=READY pgs=2035 cs=0 l=1 rev1=1 crypto rx=0x7f81d4009c00 tx=0x7f81d40091a0 comp rx=0 tx=0).stop 2023-10-06T11:18:13.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.243+0000 7f81df7fe700 1 -- 172.21.15.146:0/1104148993 reap_dead start 2023-10-06T11:18:13.249 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.243+0000 7f81e5591700 1 -- 172.21.15.146:0/1104148993 shutdown_connections 2023-10-06T11:18:13.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.243+0000 7f81e5591700 1 -- 172.21.15.146:0/1104148993 >> 172.21.15.146:0/1104148993 conn(0x7f81e006eb10 msgr2=0x7f81e006ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:13.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.243+0000 7f81e5591700 1 -- 172.21.15.146:0/1104148993 shutdown_connections 2023-10-06T11:18:13.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.243+0000 7f81e5591700 1 -- 172.21.15.146:0/1104148993 wait complete. 2023-10-06T11:18:13.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.245+0000 7f81e5591700 1 Processor -- start 2023-10-06T11:18:13.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.245+0000 7f81e5591700 1 -- start start 2023-10-06T11:18:13.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.245+0000 7f81e5591700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81c8003fe0 0x7f81e00c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:13.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.245+0000 7f81e5591700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81e0150810 0x7f81e0147a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:13.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.245+0000 7f81e5591700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f81e00b13c0 0x7f81e00b1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:13.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.245+0000 7f81e5591700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e00b1d70 con 0x7f81c8003fe0 2023-10-06T11:18:13.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.245+0000 7f81e5591700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e00c93f0 con 0x7f81e0150810 2023-10-06T11:18:13.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.245+0000 7f81e5591700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e00c9880 con 0x7f81e00b13c0 2023-10-06T11:18:13.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.245+0000 7f81deffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81c8003fe0 0x7f81e00c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:13.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.245+0000 7f81deffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81c8003fe0 0x7f81e00c8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40536/0 (socket says 172.21.15.146:40536) 2023-10-06T11:18:13.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.245+0000 7f81deffd700 1 -- 172.21.15.146:0/586277335 learned_addr learned my addr 172.21.15.146:0/586277335 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:13.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.246+0000 7f81de7fc700 1 --2- 172.21.15.146:0/586277335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81e0150810 0x7f81e0147a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:13.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.246+0000 7f81df7fe700 1 --2- 172.21.15.146:0/586277335 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f81e00b13c0 0x7f81e00b1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:13.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.246+0000 7f81deffd700 1 -- 172.21.15.146:0/586277335 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f81e00b13c0 msgr2=0x7f81e00b1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:13.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.246+0000 7f81deffd700 1 --2- 172.21.15.146:0/586277335 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f81e00b13c0 0x7f81e00b1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:13.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.246+0000 7f81deffd700 1 -- 172.21.15.146:0/586277335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81e0150810 msgr2=0x7f81e0147a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:13.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.246+0000 7f81deffd700 1 --2- 172.21.15.146:0/586277335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81e0150810 0x7f81e0147a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:13.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.246+0000 7f81deffd700 1 -- 172.21.15.146:0/586277335 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e014fcf0 con 0x7f81c8003fe0 2023-10-06T11:18:13.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.246+0000 7f81df7fe700 1 --2- 172.21.15.146:0/586277335 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f81e00b13c0 0x7f81e00b1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:18:13.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.246+0000 7f81deffd700 1 --2- 172.21.15.146:0/586277335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81c8003fe0 0x7f81e00c8200 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7f81d00020a0 tx=0x7f81d0002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:13.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.246+0000 7f81c6ffd700 1 -- 172.21.15.146:0/586277335 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d000ad80 con 0x7f81c8003fe0 2023-10-06T11:18:13.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.246+0000 7f81c6ffd700 1 -- 172.21.15.146:0/586277335 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d00133f0 con 0x7f81c8003fe0 2023-10-06T11:18:13.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.246+0000 7f81e5591700 1 -- 172.21.15.146:0/586277335 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81e00c87e0 con 0x7f81c8003fe0 2023-10-06T11:18:13.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.246+0000 7f81c6ffd700 1 -- 172.21.15.146:0/586277335 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d00137b0 con 0x7f81c8003fe0 2023-10-06T11:18:13.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.246+0000 7f81e5591700 1 -- 172.21.15.146:0/586277335 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e00c8da0 con 0x7f81c8003fe0 2023-10-06T11:18:13.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.247+0000 7f81e5591700 1 -- 172.21.15.146:0/586277335 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81e004c380 con 0x7f81c8003fe0 2023-10-06T11:18:13.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.247+0000 7f81c6ffd700 1 -- 172.21.15.146:0/586277335 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f81d0013b60 con 0x7f81c8003fe0 2023-10-06T11:18:13.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.248+0000 7f81c6ffd700 1 --2- 172.21.15.146:0/586277335 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f81cc066f30 0x7f81cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:13.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.248+0000 7f81c6ffd700 1 -- 172.21.15.146:0/586277335 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f81d0085430 con 0x7f81c8003fe0 2023-10-06T11:18:13.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.248+0000 7f81de7fc700 1 --2- 172.21.15.146:0/586277335 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f81cc066f30 0x7f81cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:13.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.248+0000 7f81de7fc700 1 --2- 172.21.15.146:0/586277335 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f81cc066f30 0x7f81cc0693e0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f81d40091e0 tx=0x7f81d401a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:13.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.252+0000 7f81c6ffd700 1 -- 172.21.15.146:0/586277335 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f81d00524a0 con 0x7f81c8003fe0 2023-10-06T11:18:13.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.438+0000 7f81e5591700 1 -- 172.21.15.146:0/586277335 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81e00cbaf0 con 0x7f81c8003fe0 2023-10-06T11:18:13.440 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.439+0000 7f81c6ffd700 1 -- 172.21.15.146:0/586277335 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v151) v1 ==== 74+0+16928 (secure 0 0 0) 0x7f81d0055ac0 con 0x7f81c8003fe0 2023-10-06T11:18:13.441 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:18:13.441 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":151,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:17:25.552935+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":23,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:17:21.595161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":24,"pool_name":"cephfs_data","create_time":"2023-10-06T11:17:23.009401+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:18:13.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.441+0000 7f81e5591700 1 -- 172.21.15.146:0/586277335 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f81cc066f30 msgr2=0x7f81cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:13.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.441+0000 7f81e5591700 1 --2- 172.21.15.146:0/586277335 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f81cc066f30 0x7f81cc0693e0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f81d40091e0 tx=0x7f81d401a000 comp rx=0 tx=0).stop 2023-10-06T11:18:13.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.441+0000 7f81e5591700 1 -- 172.21.15.146:0/586277335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81c8003fe0 msgr2=0x7f81e00c8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:13.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.441+0000 7f81e5591700 1 --2- 172.21.15.146:0/586277335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81c8003fe0 0x7f81e00c8200 secure :-1 s=READY pgs=2036 cs=0 l=1 rev1=1 crypto rx=0x7f81d00020a0 tx=0x7f81d0002210 comp rx=0 tx=0).stop 2023-10-06T11:18:13.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.441+0000 7f81e5591700 1 -- 172.21.15.146:0/586277335 shutdown_connections 2023-10-06T11:18:13.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.441+0000 7f81e5591700 1 --2- 172.21.15.146:0/586277335 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f81cc066f30 0x7f81cc0693e0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:13.443 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.441+0000 7f81e5591700 1 --2- 172.21.15.146:0/586277335 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f81e00b13c0 0x7f81e00b1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:13.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.441+0000 7f81e5591700 1 --2- 172.21.15.146:0/586277335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f81c8003fe0 0x7f81e00c8200 unknown :-1 s=CLOSED pgs=2036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:13.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.441+0000 7f81e5591700 1 --2- 172.21.15.146:0/586277335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81e0150810 0x7f81e0147a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:13.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.441+0000 7f81e5591700 1 -- 172.21.15.146:0/586277335 >> 172.21.15.146:0/586277335 conn(0x7f81e006eb10 msgr2=0x7f81e00c53e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:13.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.441+0000 7f81e5591700 1 -- 172.21.15.146:0/586277335 shutdown_connections 2023-10-06T11:18:13.444 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.441+0000 7f81e5591700 1 -- 172.21.15.146:0/586277335 wait complete. 2023-10-06T11:18:13.456 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T11:18:13.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.570+0000 7ff02adae700 1 Processor -- start 2023-10-06T11:18:13.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.570+0000 7ff02adae700 1 -- start start 2023-10-06T11:18:13.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.571+0000 7ff02adae700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff02406b920 0x7ff02406bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:13.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.571+0000 7ff02adae700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff024159ea0 0x7ff0240cc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:13.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.571+0000 7ff02adae700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff02415ae10 con 0x7ff0240ca990 2023-10-06T11:18:13.576 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.571+0000 7ff02adae700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff02415a850 con 0x7ff02406b920 2023-10-06T11:18:13.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.571+0000 7ff02adae700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff02415ab30 con 0x7ff024159ea0 2023-10-06T11:18:13.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.571+0000 7ff01bfff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff0240ca990 0x7ff02415de10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33840/0 (socket says 172.21.15.146:33840) 2023-10-06T11:18:13.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.571+0000 7ff01bfff700 1 -- 172.21.15.146:0/4057953951 learned_addr learned my addr 172.21.15.146:0/4057953951 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:13.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.572+0000 7ff028b4a700 1 --2- 172.21.15.146:0/4057953951 >> v2:172.21.15.151:3300/0 conn(0x7ff02406b920 0x7ff02406bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:13.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.572+0000 7ff02934b700 1 --2- 172.21.15.146:0/4057953951 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff024159ea0 0x7ff0240cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:13.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.572+0000 7ff01b7fe700 1 -- 172.21.15.146:0/4057953951 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3291922937 0 0) 0x7ff02415ae10 con 0x7ff0240ca990 2023-10-06T11:18:13.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.572+0000 7ff01b7fe700 1 -- 172.21.15.146:0/4057953951 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff00c003570 con 0x7ff0240ca990 2023-10-06T11:18:13.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.572+0000 7ff01b7fe700 1 -- 172.21.15.146:0/4057953951 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2426229915 0 0) 0x7ff00c003570 con 0x7ff0240ca990 2023-10-06T11:18:13.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.572+0000 7ff01b7fe700 1 -- 172.21.15.146:0/4057953951 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff024159ea0 msgr2=0x7ff0240cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:13.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.572+0000 7ff01b7fe700 1 --2- 172.21.15.146:0/4057953951 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff024159ea0 0x7ff0240cc460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:13.577 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.572+0000 7ff01b7fe700 1 -- 172.21.15.146:0/4057953951 >> v2:172.21.15.151:3300/0 conn(0x7ff02406b920 msgr2=0x7ff02406bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:13.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.572+0000 7ff01b7fe700 1 --2- 172.21.15.146:0/4057953951 >> v2:172.21.15.151:3300/0 conn(0x7ff02406b920 0x7ff02406bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:13.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.572+0000 7ff01b7fe700 1 -- 172.21.15.146:0/4057953951 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff02415d610 con 0x7ff0240ca990 2023-10-06T11:18:13.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.572+0000 7ff01b7fe700 1 -- 172.21.15.146:0/4057953951 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7ff014001470 con 0x7ff0240ca990 2023-10-06T11:18:13.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.572+0000 7ff028b4a700 1 --2- 172.21.15.146:0/4057953951 >> v2:172.21.15.151:3300/0 conn(0x7ff02406b920 0x7ff02406bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:18:13.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.572+0000 7ff01b7fe700 1 -- 172.21.15.146:0/4057953951 >> v1:172.21.15.146:6789/0 conn(0x7ff0240ca990 legacy=0x7ff02415de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:13.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.572+0000 7ff01b7fe700 1 --2- 172.21.15.146:0/4057953951 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff00c003a60 0x7ff00c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:13.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.572+0000 7ff01b7fe700 1 --2- 172.21.15.146:0/4057953951 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff024159ea0 0x7ff00c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:13.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.572+0000 7ff01b7fe700 1 --2- 172.21.15.146:0/4057953951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff00c004d50 0x7ff00c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:13.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.572+0000 7ff01b7fe700 1 -- 172.21.15.146:0/4057953951 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff02415a850 con 0x7ff00c004d50 2023-10-06T11:18:13.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.572+0000 7ff01b7fe700 1 -- 172.21.15.146:0/4057953951 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff02415ab30 con 0x7ff00c003a60 2023-10-06T11:18:13.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.572+0000 7ff01b7fe700 1 -- 172.21.15.146:0/4057953951 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff00c00ba60 con 0x7ff024159ea0 2023-10-06T11:18:13.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.572+0000 7ff02934b700 1 --2- 172.21.15.146:0/4057953951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff00c004d50 0x7ff00c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:13.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.572+0000 7ff028b4a700 1 --2- 172.21.15.146:0/4057953951 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff00c003a60 0x7ff00c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:13.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.572+0000 7ff01bfff700 1 --2- 172.21.15.146:0/4057953951 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff024159ea0 0x7ff00c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:13.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.572+0000 7ff02934b700 1 -- 172.21.15.146:0/4057953951 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff024159ea0 msgr2=0x7ff00c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:13.579 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.572+0000 7ff02934b700 1 --2- 172.21.15.146:0/4057953951 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff024159ea0 0x7ff00c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:13.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.572+0000 7ff02934b700 1 -- 172.21.15.146:0/4057953951 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff00c003a60 msgr2=0x7ff00c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:13.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.572+0000 7ff02934b700 1 --2- 172.21.15.146:0/4057953951 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff00c003a60 0x7ff00c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:13.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.572+0000 7ff02934b700 1 -- 172.21.15.146:0/4057953951 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff00c003570 con 0x7ff00c004d50 2023-10-06T11:18:13.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.573+0000 7ff02934b700 1 --2- 172.21.15.146:0/4057953951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff00c004d50 0x7ff00c0051c0 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7ff01c009c00 tx=0x7ff01c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4867d71511153bf0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:13.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.573+0000 7ff01b7fe700 1 -- 172.21.15.146:0/4057953951 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c00e6b0 con 0x7ff00c004d50 2023-10-06T11:18:13.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.573+0000 7ff01b7fe700 1 -- 172.21.15.146:0/4057953951 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01c00e810 con 0x7ff00c004d50 2023-10-06T11:18:13.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.573+0000 7ff01b7fe700 1 -- 172.21.15.146:0/4057953951 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c00ebd0 con 0x7ff00c004d50 2023-10-06T11:18:13.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.573+0000 7ff02adae700 1 -- 172.21.15.146:0/4057953951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff00c004d50 msgr2=0x7ff00c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:13.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.573+0000 7ff02adae700 1 --2- 172.21.15.146:0/4057953951 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff00c004d50 0x7ff00c0051c0 secure :-1 s=READY pgs=2038 cs=0 l=1 rev1=1 crypto rx=0x7ff01c009c00 tx=0x7ff01c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:18:13.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.573+0000 7ff02934b700 1 -- 172.21.15.146:0/4057953951 reap_dead start 2023-10-06T11:18:13.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.573+0000 7ff02adae700 1 -- 172.21.15.146:0/4057953951 shutdown_connections 2023-10-06T11:18:13.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.573+0000 7ff02adae700 1 -- 172.21.15.146:0/4057953951 >> 172.21.15.146:0/4057953951 conn(0x7ff024067eb0 msgr2=0x7ff0240ce450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:13.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.573+0000 7ff02adae700 1 -- 172.21.15.146:0/4057953951 shutdown_connections 2023-10-06T11:18:13.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.573+0000 7ff02adae700 1 -- 172.21.15.146:0/4057953951 wait complete. 2023-10-06T11:18:13.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.574+0000 7ff02adae700 1 Processor -- start 2023-10-06T11:18:13.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.575+0000 7ff02adae700 1 -- start start 2023-10-06T11:18:13.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.575+0000 7ff02adae700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff024154170 0x7ff0240c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:13.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.575+0000 7ff02adae700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0240c5500 0x7ff02406cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:13.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.575+0000 7ff02adae700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff024154540 0x7ff02406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:13.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.575+0000 7ff02adae700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0240c6580 con 0x7ff024154540 2023-10-06T11:18:13.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.575+0000 7ff02adae700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0240c6a10 con 0x7ff0240c5500 2023-10-06T11:18:13.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.575+0000 7ff02adae700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0240c5970 con 0x7ff024154170 2023-10-06T11:18:13.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.575+0000 7ff02934b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff024154540 0x7ff02406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:13.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.575+0000 7ff02934b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff024154540 0x7ff02406d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40556/0 (socket says 172.21.15.146:40556) 2023-10-06T11:18:13.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.575+0000 7ff02934b700 1 -- 172.21.15.146:0/3335300881 learned_addr learned my addr 172.21.15.146:0/3335300881 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:13.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.575+0000 7ff01bfff700 1 --2- 172.21.15.146:0/3335300881 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0240c5500 0x7ff02406cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:13.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.576+0000 7ff028b4a700 1 --2- 172.21.15.146:0/3335300881 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff024154170 0x7ff0240c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:13.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.576+0000 7ff02934b700 1 -- 172.21.15.146:0/3335300881 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff024154170 msgr2=0x7ff0240c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:13.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.576+0000 7ff02934b700 1 --2- 172.21.15.146:0/3335300881 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff024154170 0x7ff0240c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:13.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.576+0000 7ff02934b700 1 -- 172.21.15.146:0/3335300881 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0240c5500 msgr2=0x7ff02406cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:13.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.576+0000 7ff02934b700 1 --2- 172.21.15.146:0/3335300881 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0240c5500 0x7ff02406cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:13.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.576+0000 7ff02934b700 1 -- 172.21.15.146:0/3335300881 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0240c5c50 con 0x7ff024154540 2023-10-06T11:18:13.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.576+0000 7ff02934b700 1 --2- 172.21.15.146:0/3335300881 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff024154540 0x7ff02406d1c0 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7ff00c004730 tx=0x7ff01c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:13.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.576+0000 7ff018ff9700 1 -- 172.21.15.146:0/3335300881 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c022070 con 0x7ff024154540 2023-10-06T11:18:13.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.576+0000 7ff018ff9700 1 -- 172.21.15.146:0/3335300881 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01c00eb90 con 0x7ff024154540 2023-10-06T11:18:13.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.576+0000 7ff02adae700 1 -- 172.21.15.146:0/3335300881 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0240c5f30 con 0x7ff024154540 2023-10-06T11:18:13.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.576+0000 7ff018ff9700 1 -- 172.21.15.146:0/3335300881 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c00e6b0 con 0x7ff024154540 2023-10-06T11:18:13.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.576+0000 7ff02adae700 1 -- 172.21.15.146:0/3335300881 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0240c91c0 con 0x7ff024154540 2023-10-06T11:18:13.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.577+0000 7ff02adae700 1 -- 172.21.15.146:0/3335300881 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0240c93e0 con 0x7ff024154540 2023-10-06T11:18:13.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.577+0000 7ff018ff9700 1 -- 172.21.15.146:0/3335300881 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff01c01c930 con 0x7ff024154540 2023-10-06T11:18:13.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.578+0000 7ff018ff9700 1 --2- 172.21.15.146:0/3335300881 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff010066f30 0x7ff0100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:13.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.578+0000 7ff018ff9700 1 -- 172.21.15.146:0/3335300881 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff01c000e40 con 0x7ff024154540 2023-10-06T11:18:13.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.578+0000 7ff028b4a700 1 --2- 172.21.15.146:0/3335300881 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff010066f30 0x7ff0100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:13.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.578+0000 7ff028b4a700 1 --2- 172.21.15.146:0/3335300881 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff010066f30 0x7ff0100693e0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7ff0200094d0 tx=0x7ff02000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:13.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.582+0000 7ff018ff9700 1 -- 172.21.15.146:0/3335300881 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff0240c93e0 con 0x7ff024154540 2023-10-06T11:18:13.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.810+0000 7ff02adae700 1 -- 172.21.15.146:0/3335300881 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff0240c93e0 con 0x7ff024154540 2023-10-06T11:18:13.812 INFO:tasks.ceph.mon.a.smithi146.stderr:2023-10-06T11:18:13.811+0000 7f011baa1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T11:18:13.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.815+0000 7ff018ff9700 1 -- 172.21.15.146:0/3335300881 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v129) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff0240c93e0 con 0x7ff024154540 2023-10-06T11:18:13.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.817+0000 7ff02adae700 1 -- 172.21.15.146:0/3335300881 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff010066f30 msgr2=0x7ff0100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:13.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.817+0000 7ff02adae700 1 --2- 172.21.15.146:0/3335300881 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff010066f30 0x7ff0100693e0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7ff0200094d0 tx=0x7ff02000b040 comp rx=0 tx=0).stop 2023-10-06T11:18:13.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.817+0000 7ff02adae700 1 -- 172.21.15.146:0/3335300881 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff024154540 msgr2=0x7ff02406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:13.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.817+0000 7ff02adae700 1 --2- 172.21.15.146:0/3335300881 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff024154540 0x7ff02406d1c0 secure :-1 s=READY pgs=2039 cs=0 l=1 rev1=1 crypto rx=0x7ff00c004730 tx=0x7ff01c01a000 comp rx=0 tx=0).stop 2023-10-06T11:18:13.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.817+0000 7ff02adae700 1 -- 172.21.15.146:0/3335300881 shutdown_connections 2023-10-06T11:18:13.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.817+0000 7ff02adae700 1 --2- 172.21.15.146:0/3335300881 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff010066f30 0x7ff0100693e0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:13.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.817+0000 7ff02adae700 1 --2- 172.21.15.146:0/3335300881 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff024154540 0x7ff02406d1c0 unknown :-1 s=CLOSED pgs=2039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:13.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.817+0000 7ff02adae700 1 --2- 172.21.15.146:0/3335300881 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff024154170 0x7ff0240c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:13.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.817+0000 7ff02adae700 1 --2- 172.21.15.146:0/3335300881 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0240c5500 0x7ff02406cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:13.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.817+0000 7ff02adae700 1 -- 172.21.15.146:0/3335300881 >> 172.21.15.146:0/3335300881 conn(0x7ff024067eb0 msgr2=0x7ff0240c4a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:13.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.817+0000 7ff02adae700 1 -- 172.21.15.146:0/3335300881 shutdown_connections 2023-10-06T11:18:13.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.817+0000 7ff02adae700 1 -- 172.21.15.146:0/3335300881 wait complete. 2023-10-06T11:18:13.821 INFO:tasks.ceph.mds.c.smithi146.stderr: -4852> 2023-10-06T11:17:28.853+0000 7f96e7aeb700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T11:18:13.822 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T11:18:13.822 INFO:tasks.ceph.mds.c.smithi146.stderr: -2941> 2023-10-06T11:17:38.025+0000 7f96e42e4700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /subdir/sixmegs auth v6 ap=1 DIRTYPARENT s=5242880 n(v0 rc2023-10-06T11:17:36.726911+0000 b5242880 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={9849=0-12582912@1} caps={9849=pAsxLsXsxFsxcrwb/pAsxXsxFxcwb@4},l=9849 | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x556132035080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(24)0x10000000001:[<0x10000000000/sixmegs v6>,<0x1/subdir v8>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-10-06T11:18:13.832 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T11:18:13.845 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2023-10-06T11:18:13.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.950+0000 7f4a5c879700 1 Processor -- start 2023-10-06T11:18:13.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.950+0000 7f4a5c879700 1 -- start start 2023-10-06T11:18:13.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.951+0000 7f4a5c879700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4a58069e30 0x7f4a58159890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:13.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.951+0000 7f4a5c879700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4a58159dd0 0x7f4a5806b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:13.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.951+0000 7f4a5c879700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a5815d410 con 0x7f4a581594c0 2023-10-06T11:18:13.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.951+0000 7f4a5c879700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a580690d0 con 0x7f4a58069e30 2023-10-06T11:18:13.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.951+0000 7f4a5c879700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5815a310 con 0x7f4a58159dd0 2023-10-06T11:18:13.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.951+0000 7f4a4dd9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4a58069e30 0x7f4a58159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:13.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.951+0000 7f4a4dd9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f4a58069e30 0x7f4a58159890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40582/0 (socket says 172.21.15.146:40582) 2023-10-06T11:18:13.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.951+0000 7f4a4dd9b700 1 -- 172.21.15.146:0/4294292362 learned_addr learned my addr 172.21.15.146:0/4294292362 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:13.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.951+0000 7f4a56d9d700 1 --2- 172.21.15.146:0/4294292362 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4a58159dd0 0x7f4a5806b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:13.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.952+0000 7f4a4dd9b700 1 -- 172.21.15.146:0/4294292362 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4a58159dd0 msgr2=0x7f4a5806b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:13.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.952+0000 7f4a4dd9b700 1 --2- 172.21.15.146:0/4294292362 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4a58159dd0 0x7f4a5806b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:13.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.952+0000 7f4a4dd9b700 1 -- 172.21.15.146:0/4294292362 >> v1:172.21.15.151:6789/0 conn(0x7f4a581594c0 legacy=0x7f4a580689c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:13.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.952+0000 7f4a4dd9b700 1 -- 172.21.15.146:0/4294292362 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a5815a5f0 con 0x7f4a58069e30 2023-10-06T11:18:13.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.952+0000 7f4a4dd9b700 1 --2- 172.21.15.146:0/4294292362 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a58069e30 0x7f4a58159890 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7f4a400099b0 tx=0x7f4a40009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=835ea8b069b1252b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:13.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.952+0000 7f4a55d9b700 1 -- 172.21.15.146:0/4294292362 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a40009ea0 con 0x7f4a58069e30 2023-10-06T11:18:13.956 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.952+0000 7f4a55d9b700 1 -- 172.21.15.146:0/4294292362 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4000b860 con 0x7f4a58069e30 2023-10-06T11:18:13.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.952+0000 7f4a55d9b700 1 -- 172.21.15.146:0/4294292362 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4000bc00 con 0x7f4a58069e30 2023-10-06T11:18:13.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.952+0000 7f4a5c879700 1 -- 172.21.15.146:0/4294292362 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a58069e30 msgr2=0x7f4a58159890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:13.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.952+0000 7f4a5c879700 1 --2- 172.21.15.146:0/4294292362 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a58069e30 0x7f4a58159890 secure :-1 s=READY pgs=2041 cs=0 l=1 rev1=1 crypto rx=0x7f4a400099b0 tx=0x7f4a40009250 comp rx=0 tx=0).stop 2023-10-06T11:18:13.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.953+0000 7f4a5c879700 1 -- 172.21.15.146:0/4294292362 shutdown_connections 2023-10-06T11:18:13.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.953+0000 7f4a5c879700 1 --2- 172.21.15.146:0/4294292362 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4a58159dd0 0x7f4a5806b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:13.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.953+0000 7f4a5c879700 1 --2- 172.21.15.146:0/4294292362 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a58069e30 0x7f4a58159890 unknown :-1 s=CLOSED pgs=2041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:13.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.953+0000 7f4a5c879700 1 -- 172.21.15.146:0/4294292362 >> 172.21.15.146:0/4294292362 conn(0x7f4a58067ea0 msgr2=0x7f4a580ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:13.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.953+0000 7f4a5c879700 1 -- 172.21.15.146:0/4294292362 shutdown_connections 2023-10-06T11:18:13.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.953+0000 7f4a5c879700 1 -- 172.21.15.146:0/4294292362 wait complete. 2023-10-06T11:18:13.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.954+0000 7f4a5c879700 1 Processor -- start 2023-10-06T11:18:13.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.954+0000 7f4a5c879700 1 -- start start 2023-10-06T11:18:13.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.954+0000 7f4a5c879700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a58069e30 0x7f4a580c1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:13.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.954+0000 7f4a5c879700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a581594c0 0x7f4a580c7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:13.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.954+0000 7f4a5c879700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4a58159dd0 0x7f4a580c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:13.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.954+0000 7f4a5c879700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a580c4650 con 0x7f4a581594c0 2023-10-06T11:18:13.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.955+0000 7f4a5c879700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a580c2660 con 0x7f4a58069e30 2023-10-06T11:18:13.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.955+0000 7f4a5c879700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a580c2400 con 0x7f4a58159dd0 2023-10-06T11:18:13.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.955+0000 7f4a4dd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a581594c0 0x7f4a580c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:13.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.955+0000 7f4a4dd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a581594c0 0x7f4a580c7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40586/0 (socket says 172.21.15.146:40586) 2023-10-06T11:18:13.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.955+0000 7f4a4dd9b700 1 -- 172.21.15.146:0/2902131683 learned_addr learned my addr 172.21.15.146:0/2902131683 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:13.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.955+0000 7f4a5659c700 1 --2- 172.21.15.146:0/2902131683 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a58069e30 0x7f4a580c1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:13.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.955+0000 7f4a56d9d700 1 --2- 172.21.15.146:0/2902131683 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4a58159dd0 0x7f4a580c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:13.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.955+0000 7f4a4dd9b700 1 -- 172.21.15.146:0/2902131683 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4a58159dd0 msgr2=0x7f4a580c79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:13.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.955+0000 7f4a4dd9b700 1 --2- 172.21.15.146:0/2902131683 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4a58159dd0 0x7f4a580c79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:13.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.955+0000 7f4a4dd9b700 1 -- 172.21.15.146:0/2902131683 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a58069e30 msgr2=0x7f4a580c1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:13.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.955+0000 7f4a4dd9b700 1 --2- 172.21.15.146:0/2902131683 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a58069e30 0x7f4a580c1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:13.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.955+0000 7f4a4dd9b700 1 -- 172.21.15.146:0/2902131683 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a400094f0 con 0x7f4a581594c0 2023-10-06T11:18:13.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.955+0000 7f4a4dd9b700 1 --2- 172.21.15.146:0/2902131683 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a581594c0 0x7f4a580c7480 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7f4a5806f080 tx=0x7f4a40017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:13.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.955+0000 7f4a4effd700 1 -- 172.21.15.146:0/2902131683 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a40000d10 con 0x7f4a581594c0 2023-10-06T11:18:13.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.955+0000 7f4a4effd700 1 -- 172.21.15.146:0/2902131683 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4000bbe0 con 0x7f4a581594c0 2023-10-06T11:18:13.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.955+0000 7f4a5c879700 1 -- 172.21.15.146:0/2902131683 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a580c3aa0 con 0x7f4a581594c0 2023-10-06T11:18:13.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.955+0000 7f4a4effd700 1 -- 172.21.15.146:0/2902131683 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a40011670 con 0x7f4a581594c0 2023-10-06T11:18:13.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.955+0000 7f4a5c879700 1 -- 172.21.15.146:0/2902131683 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a580c4000 con 0x7f4a581594c0 2023-10-06T11:18:13.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.956+0000 7f4a5c879700 1 -- 172.21.15.146:0/2902131683 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a580c47c0 con 0x7f4a581594c0 2023-10-06T11:18:13.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.957+0000 7f4a4effd700 1 -- 172.21.15.146:0/2902131683 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4a40011aa0 con 0x7f4a581594c0 2023-10-06T11:18:13.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.957+0000 7f4a4effd700 1 --2- 172.21.15.146:0/2902131683 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4a38066f30 0x7f4a380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:13.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.957+0000 7f4a4effd700 1 -- 172.21.15.146:0/2902131683 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f4a40085f40 con 0x7f4a581594c0 2023-10-06T11:18:13.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.957+0000 7f4a5659c700 1 --2- 172.21.15.146:0/2902131683 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4a38066f30 0x7f4a380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:13.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.957+0000 7f4a5659c700 1 --2- 172.21.15.146:0/2902131683 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4a38066f30 0x7f4a380693e0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f4a48007fd0 tx=0x7f4a480016f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:13.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:13.961+0000 7f4a4effd700 1 -- 172.21.15.146:0/2902131683 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4a40053000 con 0x7f4a581594c0 2023-10-06T11:18:14.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.186+0000 7f4a5c879700 1 -- 172.21.15.146:0/2902131683 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4a5804c380 con 0x7f4a581594c0 2023-10-06T11:18:14.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.814+0000 7f4a4effd700 1 -- 172.21.15.146:0/2902131683 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v130) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4a40056620 con 0x7f4a581594c0 2023-10-06T11:18:14.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.817+0000 7f4a5c879700 1 -- 172.21.15.146:0/2902131683 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4a38066f30 msgr2=0x7f4a380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:14.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.817+0000 7f4a5c879700 1 --2- 172.21.15.146:0/2902131683 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4a38066f30 0x7f4a380693e0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f4a48007fd0 tx=0x7f4a480016f0 comp rx=0 tx=0).stop 2023-10-06T11:18:14.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.817+0000 7f4a5c879700 1 -- 172.21.15.146:0/2902131683 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a581594c0 msgr2=0x7f4a580c7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:14.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.817+0000 7f4a5c879700 1 --2- 172.21.15.146:0/2902131683 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a581594c0 0x7f4a580c7480 secure :-1 s=READY pgs=2042 cs=0 l=1 rev1=1 crypto rx=0x7f4a5806f080 tx=0x7f4a40017000 comp rx=0 tx=0).stop 2023-10-06T11:18:14.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.817+0000 7f4a5c879700 1 -- 172.21.15.146:0/2902131683 shutdown_connections 2023-10-06T11:18:14.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.817+0000 7f4a5c879700 1 --2- 172.21.15.146:0/2902131683 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4a38066f30 0x7f4a380693e0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:14.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.817+0000 7f4a5c879700 1 --2- 172.21.15.146:0/2902131683 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4a58159dd0 0x7f4a580c79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:14.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.817+0000 7f4a5c879700 1 --2- 172.21.15.146:0/2902131683 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a58069e30 0x7f4a580c1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:14.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.817+0000 7f4a5c879700 1 --2- 172.21.15.146:0/2902131683 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4a581594c0 0x7f4a580c7480 unknown :-1 s=CLOSED pgs=2042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:14.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.817+0000 7f4a5c879700 1 -- 172.21.15.146:0/2902131683 >> 172.21.15.146:0/2902131683 conn(0x7f4a58067ea0 msgr2=0x7f4a58158af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:14.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.817+0000 7f4a5c879700 1 -- 172.21.15.146:0/2902131683 shutdown_connections 2023-10-06T11:18:14.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.817+0000 7f4a5c879700 1 -- 172.21.15.146:0/2902131683 wait complete. 2023-10-06T11:18:14.832 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T11:18:14.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.993+0000 7f0c3d070700 1 Processor -- start 2023-10-06T11:18:14.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.993+0000 7f0c3d070700 1 -- start start 2023-10-06T11:18:14.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.994+0000 7f0c3d070700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0c38140d60 0x7f0c3806b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:14.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.994+0000 7f0c3d070700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c38141130 0x7f0c3806bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:14.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.994+0000 7f0c3d070700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c380cc000 con 0x7f0c380b11f0 2023-10-06T11:18:14.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.994+0000 7f0c3d070700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c380ccb80 con 0x7f0c38140d60 2023-10-06T11:18:14.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.994+0000 7f0c3d070700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c380cc250 con 0x7f0c38141130 2023-10-06T11:18:14.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.994+0000 7f0c36d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0c38140d60 0x7f0c3806b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:14.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.994+0000 7f0c3759e700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f0c380b11f0 0x7f0c380c8a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33842/0 (socket says 172.21.15.146:33842) 2023-10-06T11:18:14.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.994+0000 7f0c3759e700 1 -- 172.21.15.146:0/3696574832 learned_addr learned my addr 172.21.15.146:0/3696574832 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:14.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.994+0000 7f0c3659c700 1 --2- 172.21.15.146:0/3696574832 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c38141130 0x7f0c3806bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:14.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.994+0000 7f0c36d9d700 1 -- 172.21.15.146:0/3696574832 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c38141130 msgr2=0x7f0c3806bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:14.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.994+0000 7f0c36d9d700 1 --2- 172.21.15.146:0/3696574832 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c38141130 0x7f0c3806bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:14.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.994+0000 7f0c36d9d700 1 -- 172.21.15.146:0/3696574832 >> v1:172.21.15.146:6789/0 conn(0x7f0c380b11f0 legacy=0x7f0c380c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:14.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.995+0000 7f0c35d9b700 1 -- 172.21.15.146:0/3696574832 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 507970308 0 0) 0x7f0c380cc000 con 0x7f0c380b11f0 2023-10-06T11:18:14.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.995+0000 7f0c36d9d700 1 -- 172.21.15.146:0/3696574832 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c380cc530 con 0x7f0c38140d60 2023-10-06T11:18:14.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.995+0000 7f0c36d9d700 1 --2- 172.21.15.146:0/3696574832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c38140d60 0x7f0c3806b740 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7f0c28009e60 tx=0x7f0c28009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b39eadde1efd887 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:14.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.995+0000 7f0c35d9b700 1 -- 172.21.15.146:0/3696574832 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2800e070 con 0x7f0c38140d60 2023-10-06T11:18:14.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.995+0000 7f0c35d9b700 1 -- 172.21.15.146:0/3696574832 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c2800bc30 con 0x7f0c38140d60 2023-10-06T11:18:14.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.995+0000 7f0c35d9b700 1 -- 172.21.15.146:0/3696574832 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c28012430 con 0x7f0c38140d60 2023-10-06T11:18:14.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.995+0000 7f0c3d070700 1 -- 172.21.15.146:0/3696574832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c38140d60 msgr2=0x7f0c3806b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:14.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.995+0000 7f0c3d070700 1 --2- 172.21.15.146:0/3696574832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c38140d60 0x7f0c3806b740 secure :-1 s=READY pgs=2044 cs=0 l=1 rev1=1 crypto rx=0x7f0c28009e60 tx=0x7f0c28009780 comp rx=0 tx=0).stop 2023-10-06T11:18:14.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.995+0000 7f0c3d070700 1 -- 172.21.15.146:0/3696574832 shutdown_connections 2023-10-06T11:18:14.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.995+0000 7f0c3d070700 1 --2- 172.21.15.146:0/3696574832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c38140d60 0x7f0c3806b740 unknown :-1 s=CLOSED pgs=2044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:15.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.995+0000 7f0c3d070700 1 --2- 172.21.15.146:0/3696574832 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c38141130 0x7f0c3806bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:15.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.995+0000 7f0c3d070700 1 -- 172.21.15.146:0/3696574832 >> 172.21.15.146:0/3696574832 conn(0x7f0c380ce430 msgr2=0x7f0c380ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:15.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.995+0000 7f0c3d070700 1 -- 172.21.15.146:0/3696574832 shutdown_connections 2023-10-06T11:18:15.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.995+0000 7f0c3d070700 1 -- 172.21.15.146:0/3696574832 wait complete. 2023-10-06T11:18:15.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.997+0000 7f0c3d070700 1 Processor -- start 2023-10-06T11:18:15.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.997+0000 7f0c3d070700 1 -- start start 2023-10-06T11:18:15.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.997+0000 7f0c3d070700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c380b11f0 0x7f0c3815b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:15.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.997+0000 7f0c3d070700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c38140d60 0x7f0c380cb090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:15.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.997+0000 7f0c3d070700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c38141130 0x7f0c380cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:15.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.997+0000 7f0c3d070700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c38156d40 con 0x7f0c380b11f0 2023-10-06T11:18:15.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.997+0000 7f0c3d070700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3816ac30 con 0x7f0c38140d60 2023-10-06T11:18:15.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.997+0000 7f0c3d070700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3816a020 con 0x7f0c38141130 2023-10-06T11:18:15.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.997+0000 7f0c36d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c380b11f0 0x7f0c3815b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:15.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.997+0000 7f0c36d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c380b11f0 0x7f0c3815b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40606/0 (socket says 172.21.15.146:40606) 2023-10-06T11:18:15.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.997+0000 7f0c36d9d700 1 -- 172.21.15.146:0/849023989 learned_addr learned my addr 172.21.15.146:0/849023989 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:15.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.997+0000 7f0c3759e700 1 --2- 172.21.15.146:0/849023989 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c38141130 0x7f0c380cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:15.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.998+0000 7f0c3659c700 1 --2- 172.21.15.146:0/849023989 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c38140d60 0x7f0c380cb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:15.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.998+0000 7f0c36d9d700 1 -- 172.21.15.146:0/849023989 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c38141130 msgr2=0x7f0c380cb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:15.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.998+0000 7f0c36d9d700 1 --2- 172.21.15.146:0/849023989 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c38141130 0x7f0c380cb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:15.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.998+0000 7f0c36d9d700 1 -- 172.21.15.146:0/849023989 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c38140d60 msgr2=0x7f0c380cb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:15.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.998+0000 7f0c36d9d700 1 --2- 172.21.15.146:0/849023989 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c38140d60 0x7f0c380cb090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:15.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.998+0000 7f0c36d9d700 1 -- 172.21.15.146:0/849023989 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c28009a20 con 0x7f0c380b11f0 2023-10-06T11:18:15.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.998+0000 7f0c3759e700 1 --2- 172.21.15.146:0/849023989 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c38141130 0x7f0c380cb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:18:15.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.998+0000 7f0c3659c700 1 --2- 172.21.15.146:0/849023989 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c38140d60 0x7f0c380cb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:18:15.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.998+0000 7f0c36d9d700 1 --2- 172.21.15.146:0/849023989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c380b11f0 0x7f0c3815b320 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7f0c3806f180 tx=0x7f0c28019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:15.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.998+0000 7f0c1effd700 1 -- 172.21.15.146:0/849023989 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c28012e80 con 0x7f0c380b11f0 2023-10-06T11:18:15.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.998+0000 7f0c1effd700 1 -- 172.21.15.146:0/849023989 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c28027470 con 0x7f0c380b11f0 2023-10-06T11:18:15.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.998+0000 7f0c3d070700 1 -- 172.21.15.146:0/849023989 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c3816a300 con 0x7f0c380b11f0 2023-10-06T11:18:15.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.998+0000 7f0c1effd700 1 -- 172.21.15.146:0/849023989 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c28027810 con 0x7f0c380b11f0 2023-10-06T11:18:15.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.998+0000 7f0c3d070700 1 -- 172.21.15.146:0/849023989 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c3816a8c0 con 0x7f0c380b11f0 2023-10-06T11:18:15.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.999+0000 7f0c3d070700 1 -- 172.21.15.146:0/849023989 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c3804c380 con 0x7f0c380b11f0 2023-10-06T11:18:15.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:14.999+0000 7f0c1effd700 1 -- 172.21.15.146:0/849023989 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0c28024070 con 0x7f0c380b11f0 2023-10-06T11:18:15.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.000+0000 7f0c1effd700 1 --2- 172.21.15.146:0/849023989 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0c24066f30 0x7f0c240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:15.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.000+0000 7f0c1effd700 1 -- 172.21.15.146:0/849023989 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f0c280871b0 con 0x7f0c380b11f0 2023-10-06T11:18:15.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.000+0000 7f0c3659c700 1 --2- 172.21.15.146:0/849023989 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0c24066f30 0x7f0c240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:15.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.000+0000 7f0c3659c700 1 --2- 172.21.15.146:0/849023989 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0c24066f30 0x7f0c240693e0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f0c380afbd0 tx=0x7f0c2c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:15.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.005+0000 7f0c1effd700 1 -- 172.21.15.146:0/849023989 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0c28054270 con 0x7f0c380b11f0 2023-10-06T11:18:15.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.187+0000 7f0c3d070700 1 -- 172.21.15.146:0/849023989 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0c380cc810 con 0x7f0c380b11f0 2023-10-06T11:18:15.820 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.818+0000 7f0c1effd700 1 -- 172.21.15.146:0/849023989 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v153) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0c28057890 con 0x7f0c380b11f0 2023-10-06T11:18:15.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.822+0000 7f0c3d070700 1 -- 172.21.15.146:0/849023989 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0c24066f30 msgr2=0x7f0c240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:15.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.822+0000 7f0c3d070700 1 --2- 172.21.15.146:0/849023989 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0c24066f30 0x7f0c240693e0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f0c380afbd0 tx=0x7f0c2c008040 comp rx=0 tx=0).stop 2023-10-06T11:18:15.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.822+0000 7f0c3d070700 1 -- 172.21.15.146:0/849023989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c380b11f0 msgr2=0x7f0c3815b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:15.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.822+0000 7f0c3d070700 1 --2- 172.21.15.146:0/849023989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c380b11f0 0x7f0c3815b320 secure :-1 s=READY pgs=2045 cs=0 l=1 rev1=1 crypto rx=0x7f0c3806f180 tx=0x7f0c28019000 comp rx=0 tx=0).stop 2023-10-06T11:18:15.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.822+0000 7f0c3d070700 1 -- 172.21.15.146:0/849023989 shutdown_connections 2023-10-06T11:18:15.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.822+0000 7f0c3d070700 1 --2- 172.21.15.146:0/849023989 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0c24066f30 0x7f0c240693e0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:15.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.822+0000 7f0c3d070700 1 --2- 172.21.15.146:0/849023989 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c38141130 0x7f0c380cb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:15.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.822+0000 7f0c3d070700 1 --2- 172.21.15.146:0/849023989 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c380b11f0 0x7f0c3815b320 unknown :-1 s=CLOSED pgs=2045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:15.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.822+0000 7f0c3d070700 1 --2- 172.21.15.146:0/849023989 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c38140d60 0x7f0c380cb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:15.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.822+0000 7f0c3d070700 1 -- 172.21.15.146:0/849023989 >> 172.21.15.146:0/849023989 conn(0x7f0c380ce430 msgr2=0x7f0c38156fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:15.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.822+0000 7f0c3d070700 1 -- 172.21.15.146:0/849023989 shutdown_connections 2023-10-06T11:18:15.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.822+0000 7f0c3d070700 1 -- 172.21.15.146:0/849023989 wait complete. 2023-10-06T11:18:15.827 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' removed 2023-10-06T11:18:15.840 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T11:18:15.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.958+0000 7f2f8513a700 1 Processor -- start 2023-10-06T11:18:15.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.958+0000 7f2f8513a700 1 -- start start 2023-10-06T11:18:15.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.958+0000 7f2f8513a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2f80143040 0x7f2f800b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:15.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.958+0000 7f2f8513a700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2f80143410 0x7f2f800b2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:15.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.958+0000 7f2f8513a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f800cf100 con 0x7f2f800b4d20 2023-10-06T11:18:15.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.958+0000 7f2f8513a700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f800b4170 con 0x7f2f80143040 2023-10-06T11:18:15.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.958+0000 7f2f8513a700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f800b5f50 con 0x7f2f80143410 2023-10-06T11:18:15.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.958+0000 7f2f7ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2f80143040 0x7f2f800b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:15.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.958+0000 7f2f84939700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2f800b4d20 0x7f2f800b51c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33846/0 (socket says 172.21.15.146:33846) 2023-10-06T11:18:15.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.958+0000 7f2f84939700 1 -- 172.21.15.146:0/2107821689 learned_addr learned my addr 172.21.15.146:0/2107821689 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:15.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.958+0000 7f2f7f7fe700 1 --2- 172.21.15.146:0/2107821689 >> v2:172.21.15.151:3300/0 conn(0x7f2f80143410 0x7f2f800b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:15.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.958+0000 7f2f7ffff700 1 -- 172.21.15.146:0/2107821689 >> v2:172.21.15.151:3300/0 conn(0x7f2f80143410 msgr2=0x7f2f800b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:15.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.958+0000 7f2f7ffff700 1 --2- 172.21.15.146:0/2107821689 >> v2:172.21.15.151:3300/0 conn(0x7f2f80143410 0x7f2f800b2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:15.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.958+0000 7f2f7ffff700 1 -- 172.21.15.146:0/2107821689 >> v1:172.21.15.146:6789/0 conn(0x7f2f800b4d20 legacy=0x7f2f800b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:15.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.958+0000 7f2f7ffff700 1 -- 172.21.15.146:0/2107821689 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f800ceb30 con 0x7f2f80143040 2023-10-06T11:18:15.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.958+0000 7f2f7ffff700 1 --2- 172.21.15.146:0/2107821689 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f80143040 0x7f2f800b1e20 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7f2f800ce670 tx=0x7f2f740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=578aef4de69f76f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:15.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.958+0000 7f2f7effd700 1 -- 172.21.15.146:0/2107821689 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f74011630 con 0x7f2f80143040 2023-10-06T11:18:15.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.958+0000 7f2f7effd700 1 -- 172.21.15.146:0/2107821689 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f74011790 con 0x7f2f80143040 2023-10-06T11:18:15.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.958+0000 7f2f7effd700 1 -- 172.21.15.146:0/2107821689 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f74011b30 con 0x7f2f80143040 2023-10-06T11:18:15.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.959+0000 7f2f8513a700 1 -- 172.21.15.146:0/2107821689 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f80143040 msgr2=0x7f2f800b1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:15.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.959+0000 7f2f8513a700 1 --2- 172.21.15.146:0/2107821689 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f80143040 0x7f2f800b1e20 secure :-1 s=READY pgs=2047 cs=0 l=1 rev1=1 crypto rx=0x7f2f800ce670 tx=0x7f2f740091a0 comp rx=0 tx=0).stop 2023-10-06T11:18:15.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.959+0000 7f2f8513a700 1 -- 172.21.15.146:0/2107821689 shutdown_connections 2023-10-06T11:18:15.962 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.959+0000 7f2f8513a700 1 --2- 172.21.15.146:0/2107821689 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f80143040 0x7f2f800b1e20 unknown :-1 s=CLOSED pgs=2047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:15.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.959+0000 7f2f8513a700 1 --2- 172.21.15.146:0/2107821689 >> v2:172.21.15.151:3300/0 conn(0x7f2f80143410 0x7f2f800b2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:15.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.959+0000 7f2f8513a700 1 -- 172.21.15.146:0/2107821689 >> 172.21.15.146:0/2107821689 conn(0x7f2f8006eb10 msgr2=0x7f2f8006ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:15.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.959+0000 7f2f8513a700 1 -- 172.21.15.146:0/2107821689 shutdown_connections 2023-10-06T11:18:15.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.959+0000 7f2f8513a700 1 -- 172.21.15.146:0/2107821689 wait complete. 2023-10-06T11:18:15.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.960+0000 7f2f8513a700 1 Processor -- start 2023-10-06T11:18:15.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.960+0000 7f2f8513a700 1 -- start start 2023-10-06T11:18:15.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.961+0000 7f2f8513a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2f800b4d20 0x7f2f8013d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:15.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.961+0000 7f2f8513a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f80143040 0x7f2f8013f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:15.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.961+0000 7f2f8513a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f80143410 0x7f2f8013e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:15.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.961+0000 7f2f8513a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f800c5ae0 con 0x7f2f80143040 2023-10-06T11:18:15.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.961+0000 7f2f8513a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8013dc30 con 0x7f2f80143410 2023-10-06T11:18:15.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.961+0000 7f2f8513a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8013fd10 con 0x7f2f800b4d20 2023-10-06T11:18:15.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.961+0000 7f2f7f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f80143040 0x7f2f8013f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:15.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.961+0000 7f2f7f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f80143040 0x7f2f8013f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40636/0 (socket says 172.21.15.146:40636) 2023-10-06T11:18:15.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.961+0000 7f2f7f7fe700 1 -- 172.21.15.146:0/2167625099 learned_addr learned my addr 172.21.15.146:0/2167625099 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:15.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.961+0000 7f2f7ffff700 1 --2- 172.21.15.146:0/2167625099 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2f800b4d20 0x7f2f8013d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:15.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.961+0000 7f2f84939700 1 --2- 172.21.15.146:0/2167625099 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f80143410 0x7f2f8013e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:15.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.961+0000 7f2f7f7fe700 1 -- 172.21.15.146:0/2167625099 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2f800b4d20 msgr2=0x7f2f8013d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:15.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.961+0000 7f2f7f7fe700 1 --2- 172.21.15.146:0/2167625099 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2f800b4d20 0x7f2f8013d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:15.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.961+0000 7f2f7f7fe700 1 -- 172.21.15.146:0/2167625099 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f80143410 msgr2=0x7f2f8013e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:15.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.961+0000 7f2f7f7fe700 1 --2- 172.21.15.146:0/2167625099 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f80143410 0x7f2f8013e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:15.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.961+0000 7f2f7f7fe700 1 -- 172.21.15.146:0/2167625099 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f74009420 con 0x7f2f80143040 2023-10-06T11:18:15.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.961+0000 7f2f7f7fe700 1 --2- 172.21.15.146:0/2167625099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f80143040 0x7f2f8013f410 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7f2f7000c880 tx=0x7f2f70008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:15.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.961+0000 7f2f67fff700 1 -- 172.21.15.146:0/2167625099 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f70011600 con 0x7f2f80143040 2023-10-06T11:18:15.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.961+0000 7f2f67fff700 1 -- 172.21.15.146:0/2167625099 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f70011760 con 0x7f2f80143040 2023-10-06T11:18:15.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.961+0000 7f2f8513a700 1 -- 172.21.15.146:0/2167625099 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f8013fff0 con 0x7f2f80143040 2023-10-06T11:18:15.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.961+0000 7f2f67fff700 1 -- 172.21.15.146:0/2167625099 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f70011b00 con 0x7f2f80143040 2023-10-06T11:18:15.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.962+0000 7f2f8513a700 1 -- 172.21.15.146:0/2167625099 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f80140890 con 0x7f2f80143040 2023-10-06T11:18:15.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.962+0000 7f2f8513a700 1 -- 172.21.15.146:0/2167625099 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f8015f470 con 0x7f2f80143040 2023-10-06T11:18:15.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.963+0000 7f2f67fff700 1 -- 172.21.15.146:0/2167625099 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2f700223a0 con 0x7f2f80143040 2023-10-06T11:18:15.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.963+0000 7f2f67fff700 1 --2- 172.21.15.146:0/2167625099 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2f6c066f30 0x7f2f6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:15.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.963+0000 7f2f67fff700 1 -- 172.21.15.146:0/2167625099 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f2f70084620 con 0x7f2f80143040 2023-10-06T11:18:15.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.963+0000 7f2f7ffff700 1 --2- 172.21.15.146:0/2167625099 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2f6c066f30 0x7f2f6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:15.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.964+0000 7f2f7ffff700 1 --2- 172.21.15.146:0/2167625099 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2f6c066f30 0x7f2f6c0693e0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f2f740030c0 tx=0x7f2f74016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:15.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:15.968+0000 7f2f67fff700 1 -- 172.21.15.146:0/2167625099 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f70051890 con 0x7f2f80143040 2023-10-06T11:18:16.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.150+0000 7f2f8513a700 1 -- 172.21.15.146:0/2167625099 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2f8004bb40 con 0x7f2f80143040 2023-10-06T11:18:16.823 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.822+0000 7f2f67fff700 1 -- 172.21.15.146:0/2167625099 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v154) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2f70054eb0 con 0x7f2f80143040 2023-10-06T11:18:16.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.826+0000 7f2f8513a700 1 -- 172.21.15.146:0/2167625099 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2f6c066f30 msgr2=0x7f2f6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:16.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.826+0000 7f2f8513a700 1 --2- 172.21.15.146:0/2167625099 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2f6c066f30 0x7f2f6c0693e0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f2f740030c0 tx=0x7f2f74016000 comp rx=0 tx=0).stop 2023-10-06T11:18:16.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.826+0000 7f2f8513a700 1 -- 172.21.15.146:0/2167625099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f80143040 msgr2=0x7f2f8013f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:16.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.826+0000 7f2f8513a700 1 --2- 172.21.15.146:0/2167625099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f80143040 0x7f2f8013f410 secure :-1 s=READY pgs=2048 cs=0 l=1 rev1=1 crypto rx=0x7f2f7000c880 tx=0x7f2f70008040 comp rx=0 tx=0).stop 2023-10-06T11:18:16.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.826+0000 7f2f8513a700 1 -- 172.21.15.146:0/2167625099 shutdown_connections 2023-10-06T11:18:16.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.826+0000 7f2f8513a700 1 --2- 172.21.15.146:0/2167625099 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2f6c066f30 0x7f2f6c0693e0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:16.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.826+0000 7f2f8513a700 1 --2- 172.21.15.146:0/2167625099 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f80143410 0x7f2f8013e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:16.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.826+0000 7f2f8513a700 1 --2- 172.21.15.146:0/2167625099 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2f800b4d20 0x7f2f8013d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:16.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.826+0000 7f2f8513a700 1 --2- 172.21.15.146:0/2167625099 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2f80143040 0x7f2f8013f410 unknown :-1 s=CLOSED pgs=2048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:16.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.826+0000 7f2f8513a700 1 -- 172.21.15.146:0/2167625099 >> 172.21.15.146:0/2167625099 conn(0x7f2f8006eb10 msgr2=0x7f2f800ccf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:16.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.826+0000 7f2f8513a700 1 -- 172.21.15.146:0/2167625099 shutdown_connections 2023-10-06T11:18:16.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.826+0000 7f2f8513a700 1 -- 172.21.15.146:0/2167625099 wait complete. 2023-10-06T11:18:16.829 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' removed 2023-10-06T11:18:16.842 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T11:18:16.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.958+0000 7f1c02720700 1 Processor -- start 2023-10-06T11:18:16.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.958+0000 7f1c02720700 1 -- start start 2023-10-06T11:18:16.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.959+0000 7f1c02720700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1bfc159840 0x7f1bfc0d0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:16.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.959+0000 7f1c02720700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bfc0cdeb0 con 0x7f1bfc159470 2023-10-06T11:18:16.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.959+0000 7f1c02720700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bfc0cd2a0 con 0x7f1bfc0d0ad0 2023-10-06T11:18:16.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.959+0000 7f1c02720700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bfc0d0f50 con 0x7f1bfc159840 2023-10-06T11:18:16.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.959+0000 7f1bfbfff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f1bfc159470 0x7f1bfc0cb630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33860/0 (socket says 172.21.15.146:33860) 2023-10-06T11:18:16.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.959+0000 7f1bfbfff700 1 -- 172.21.15.146:0/1745852576 learned_addr learned my addr 172.21.15.146:0/1745852576 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:16.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.960+0000 7f1bfb7fe700 1 --2- 172.21.15.146:0/1745852576 >> v2:172.21.15.151:3300/0 conn(0x7f1bfc159840 0x7f1bfc0d0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:16.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.960+0000 7f1bfaffd700 1 -- 172.21.15.146:0/1745852576 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2784636613 0 0) 0x7f1bfc0cdeb0 con 0x7f1bfc159470 2023-10-06T11:18:16.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.960+0000 7f1bfaffd700 1 -- 172.21.15.146:0/1745852576 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1be4003570 con 0x7f1bfc159470 2023-10-06T11:18:16.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.960+0000 7f1bfaffd700 1 -- 172.21.15.146:0/1745852576 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4027246888 0 0) 0x7f1bfc0cd2a0 con 0x7f1bfc0d0ad0 2023-10-06T11:18:16.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.960+0000 7f1bfaffd700 1 -- 172.21.15.146:0/1745852576 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bfc0cdeb0 con 0x7f1bfc0d0ad0 2023-10-06T11:18:16.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.960+0000 7f1bfaffd700 1 -- 172.21.15.146:0/1745852576 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 624914601 0 0) 0x7f1be4003570 con 0x7f1bfc159470 2023-10-06T11:18:16.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.960+0000 7f1bfaffd700 1 -- 172.21.15.146:0/1745852576 >> v2:172.21.15.151:3300/0 conn(0x7f1bfc159840 msgr2=0x7f1bfc0d0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:16.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.960+0000 7f1bfaffd700 1 --2- 172.21.15.146:0/1745852576 >> v2:172.21.15.151:3300/0 conn(0x7f1bfc159840 0x7f1bfc0d0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:16.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.960+0000 7f1bfaffd700 1 -- 172.21.15.146:0/1745852576 >> v1:172.21.15.151:6789/0 conn(0x7f1bfc0d0ad0 legacy=0x7f1bfc0ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:16.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.960+0000 7f1bfaffd700 1 -- 172.21.15.146:0/1745852576 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bfc0cd580 con 0x7f1bfc159470 2023-10-06T11:18:16.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.960+0000 7f1bfaffd700 1 -- 172.21.15.146:0/1745852576 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f1bec001470 con 0x7f1bfc159470 2023-10-06T11:18:16.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.960+0000 7f1bfaffd700 1 -- 172.21.15.146:0/1745852576 >> v1:172.21.15.146:6789/0 conn(0x7f1bfc159470 legacy=0x7f1bfc0cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:16.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.960+0000 7f1bfaffd700 1 --2- 172.21.15.146:0/1745852576 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1be4003bf0 0x7f1be4003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:16.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.960+0000 7f1bfaffd700 1 --2- 172.21.15.146:0/1745852576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1be4004810 0x7f1be4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:16.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.960+0000 7f1bfaffd700 1 --2- 172.21.15.146:0/1745852576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1be40051c0 0x7f1be400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:16.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.960+0000 7f1bfaffd700 1 -- 172.21.15.146:0/1745852576 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc0d0f50 con 0x7f1be40051c0 2023-10-06T11:18:16.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.960+0000 7f1bfaffd700 1 -- 172.21.15.146:0/1745852576 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be400c160 con 0x7f1be4004810 2023-10-06T11:18:16.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.960+0000 7f1bfaffd700 1 -- 172.21.15.146:0/1745852576 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be400c320 con 0x7f1be4003bf0 2023-10-06T11:18:16.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.960+0000 7f1c00cbd700 1 --2- 172.21.15.146:0/1745852576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1be40051c0 0x7f1be400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:16.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.960+0000 7f1bfb7fe700 1 --2- 172.21.15.146:0/1745852576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1be4004810 0x7f1be4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:16.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.960+0000 7f1bfbfff700 1 --2- 172.21.15.146:0/1745852576 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1be4003bf0 0x7f1be4003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:16.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.960+0000 7f1c00cbd700 1 -- 172.21.15.146:0/1745852576 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1be4003bf0 msgr2=0x7f1be4003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:16.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.960+0000 7f1c00cbd700 1 --2- 172.21.15.146:0/1745852576 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1be4003bf0 0x7f1be4003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:16.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.960+0000 7f1c00cbd700 1 -- 172.21.15.146:0/1745852576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1be4004810 msgr2=0x7f1be4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:16.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.960+0000 7f1c00cbd700 1 --2- 172.21.15.146:0/1745852576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1be4004810 0x7f1be4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:16.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.960+0000 7f1c00cbd700 1 -- 172.21.15.146:0/1745852576 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be4003570 con 0x7f1be40051c0 2023-10-06T11:18:16.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.961+0000 7f1c00cbd700 1 -- 172.21.15.146:0/1745852576 reap_dead start 2023-10-06T11:18:16.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.961+0000 7f1c00cbd700 1 --2- 172.21.15.146:0/1745852576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1be40051c0 0x7f1be400ba60 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7f1bf40020f0 tx=0x7f1bf40017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc6ecd59ab1f387e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:16.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.961+0000 7f1bfaffd700 1 -- 172.21.15.146:0/1745852576 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf4001ab0 con 0x7f1be40051c0 2023-10-06T11:18:16.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.961+0000 7f1bfaffd700 1 -- 172.21.15.146:0/1745852576 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf400c8b0 con 0x7f1be40051c0 2023-10-06T11:18:16.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.961+0000 7f1bfaffd700 1 -- 172.21.15.146:0/1745852576 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf400cc70 con 0x7f1be40051c0 2023-10-06T11:18:16.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.961+0000 7f1c02720700 1 -- 172.21.15.146:0/1745852576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1be40051c0 msgr2=0x7f1be400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:16.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.961+0000 7f1c02720700 1 --2- 172.21.15.146:0/1745852576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1be40051c0 0x7f1be400ba60 secure :-1 s=READY pgs=2050 cs=0 l=1 rev1=1 crypto rx=0x7f1bf40020f0 tx=0x7f1bf40017a0 comp rx=0 tx=0).stop 2023-10-06T11:18:16.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.961+0000 7f1c02720700 1 -- 172.21.15.146:0/1745852576 shutdown_connections 2023-10-06T11:18:16.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.961+0000 7f1c02720700 1 --2- 172.21.15.146:0/1745852576 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1be40051c0 0x7f1be400ba60 unknown :-1 s=CLOSED pgs=2050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:16.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.961+0000 7f1c02720700 1 -- 172.21.15.146:0/1745852576 >> 172.21.15.146:0/1745852576 conn(0x7f1bfc06eb10 msgr2=0x7f1bfc06ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:16.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.961+0000 7f1c02720700 1 -- 172.21.15.146:0/1745852576 shutdown_connections 2023-10-06T11:18:16.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.961+0000 7f1c02720700 1 -- 172.21.15.146:0/1745852576 wait complete. 2023-10-06T11:18:16.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.962+0000 7f1c02720700 1 Processor -- start 2023-10-06T11:18:16.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.963+0000 7f1c02720700 1 -- start start 2023-10-06T11:18:16.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.963+0000 7f1c02720700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1be40051c0 0x7f1bfc14ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:16.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.963+0000 7f1c02720700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bfc150f40 0x7f1bfc14b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:16.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.963+0000 7f1c02720700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bfc14c9b0 0x7f1bfc14ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:16.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.963+0000 7f1c02720700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc1513b0 con 0x7f1bfc14c9b0 2023-10-06T11:18:16.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.963+0000 7f1c02720700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc14d360 con 0x7f1be40051c0 2023-10-06T11:18:16.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.963+0000 7f1c02720700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bfc0b4250 con 0x7f1bfc150f40 2023-10-06T11:18:16.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.963+0000 7f1c00cbd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bfc14c9b0 0x7f1bfc14ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:16.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.963+0000 7f1c00cbd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bfc14c9b0 0x7f1bfc14ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40652/0 (socket says 172.21.15.146:40652) 2023-10-06T11:18:16.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.963+0000 7f1c00cbd700 1 -- 172.21.15.146:0/795942377 learned_addr learned my addr 172.21.15.146:0/795942377 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:16.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.963+0000 7f1bfbfff700 1 --2- 172.21.15.146:0/795942377 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1be40051c0 0x7f1bfc14ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:16.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.963+0000 7f1bfb7fe700 1 --2- 172.21.15.146:0/795942377 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bfc150f40 0x7f1bfc14b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:16.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.964+0000 7f1c00cbd700 1 -- 172.21.15.146:0/795942377 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bfc150f40 msgr2=0x7f1bfc14b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:16.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.964+0000 7f1c00cbd700 1 --2- 172.21.15.146:0/795942377 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bfc150f40 0x7f1bfc14b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:16.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.964+0000 7f1c00cbd700 1 -- 172.21.15.146:0/795942377 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1be40051c0 msgr2=0x7f1bfc14ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:16.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.964+0000 7f1c00cbd700 1 --2- 172.21.15.146:0/795942377 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1be40051c0 0x7f1bfc14ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:16.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.964+0000 7f1c00cbd700 1 -- 172.21.15.146:0/795942377 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bfc0b33a0 con 0x7f1bfc14c9b0 2023-10-06T11:18:16.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.964+0000 7f1c00cbd700 1 --2- 172.21.15.146:0/795942377 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bfc14c9b0 0x7f1bfc14ce20 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7f1bf400c6a0 tx=0x7f1bf4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:16.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.964+0000 7f1be3fff700 1 -- 172.21.15.146:0/795942377 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf400c6d0 con 0x7f1bfc14c9b0 2023-10-06T11:18:16.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.964+0000 7f1be3fff700 1 -- 172.21.15.146:0/795942377 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf4012ae0 con 0x7f1bfc14c9b0 2023-10-06T11:18:16.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.964+0000 7f1c02720700 1 -- 172.21.15.146:0/795942377 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bfc0b3640 con 0x7f1bfc14c9b0 2023-10-06T11:18:16.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.964+0000 7f1be3fff700 1 -- 172.21.15.146:0/795942377 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf4012ea0 con 0x7f1bfc14c9b0 2023-10-06T11:18:16.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.964+0000 7f1c02720700 1 -- 172.21.15.146:0/795942377 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bfc0b3c00 con 0x7f1bfc14c9b0 2023-10-06T11:18:16.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.965+0000 7f1c02720700 1 -- 172.21.15.146:0/795942377 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bfc04c380 con 0x7f1bfc14c9b0 2023-10-06T11:18:16.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.965+0000 7f1be3fff700 1 -- 172.21.15.146:0/795942377 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1bf401e640 con 0x7f1bfc14c9b0 2023-10-06T11:18:16.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.965+0000 7f1be3fff700 1 --2- 172.21.15.146:0/795942377 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1be8066f30 0x7f1be80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:16.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.966+0000 7f1be3fff700 1 -- 172.21.15.146:0/795942377 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f1bf4086220 con 0x7f1bfc14c9b0 2023-10-06T11:18:16.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.966+0000 7f1bfbfff700 1 --2- 172.21.15.146:0/795942377 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1be8066f30 0x7f1be80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:16.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.966+0000 7f1bfbfff700 1 --2- 172.21.15.146:0/795942377 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1be8066f30 0x7f1be80693e0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f1bec000c20 tx=0x7f1bec001df0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:16.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:16.970+0000 7f1be3fff700 1 -- 172.21.15.146:0/795942377 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1bf4053630 con 0x7f1bfc14c9b0 2023-10-06T11:18:17.153 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.153+0000 7f1c02720700 1 -- 172.21.15.146:0/795942377 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f1bfc0b4390 con 0x7f1bfc14c9b0 2023-10-06T11:18:17.157 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.156+0000 7f1be3fff700 1 -- 172.21.15.146:0/795942377 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v29) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1bf4056c50 con 0x7f1bfc14c9b0 2023-10-06T11:18:17.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.158+0000 7f1c02720700 1 -- 172.21.15.146:0/795942377 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1be8066f30 msgr2=0x7f1be80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:17.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.158+0000 7f1c02720700 1 --2- 172.21.15.146:0/795942377 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1be8066f30 0x7f1be80693e0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f1bec000c20 tx=0x7f1bec001df0 comp rx=0 tx=0).stop 2023-10-06T11:18:17.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.158+0000 7f1c02720700 1 -- 172.21.15.146:0/795942377 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bfc14c9b0 msgr2=0x7f1bfc14ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:17.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.158+0000 7f1c02720700 1 --2- 172.21.15.146:0/795942377 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bfc14c9b0 0x7f1bfc14ce20 secure :-1 s=READY pgs=2051 cs=0 l=1 rev1=1 crypto rx=0x7f1bf400c6a0 tx=0x7f1bf4016000 comp rx=0 tx=0).stop 2023-10-06T11:18:17.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.159+0000 7f1c02720700 1 -- 172.21.15.146:0/795942377 shutdown_connections 2023-10-06T11:18:17.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.159+0000 7f1c02720700 1 --2- 172.21.15.146:0/795942377 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1be8066f30 0x7f1be80693e0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:17.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.159+0000 7f1c02720700 1 --2- 172.21.15.146:0/795942377 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1bfc14c9b0 0x7f1bfc14ce20 unknown :-1 s=CLOSED pgs=2051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:17.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.159+0000 7f1c02720700 1 --2- 172.21.15.146:0/795942377 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1be40051c0 0x7f1bfc14ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:17.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.159+0000 7f1c02720700 1 --2- 172.21.15.146:0/795942377 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1bfc150f40 0x7f1bfc14b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:17.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.159+0000 7f1c02720700 1 -- 172.21.15.146:0/795942377 >> 172.21.15.146:0/795942377 conn(0x7f1bfc06eb10 msgr2=0x7f1bfc14df20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:17.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.159+0000 7f1c02720700 1 -- 172.21.15.146:0/795942377 shutdown_connections 2023-10-06T11:18:17.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.159+0000 7f1c02720700 1 -- 172.21.15.146:0/795942377 wait complete. 2023-10-06T11:18:17.172 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace' 2023-10-06T11:18:17.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.286+0000 7ff01de8e700 1 Processor -- start 2023-10-06T11:18:17.288 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.287+0000 7ff01de8e700 1 -- start start 2023-10-06T11:18:17.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.287+0000 7ff01de8e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff018158140 0x7ff018158510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:17.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.287+0000 7ff01de8e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff018069450 0x7ff0180698c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:17.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.287+0000 7ff01de8e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff018158a50 con 0x7ff01806d210 2023-10-06T11:18:17.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.287+0000 7ff01de8e700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff018069f10 con 0x7ff018158140 2023-10-06T11:18:17.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.287+0000 7ff01de8e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff01806a1f0 con 0x7ff018069450 2023-10-06T11:18:17.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.288+0000 7ff0177fe700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff018158140 0x7ff018158510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:17.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.288+0000 7ff016ffd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff018069450 0x7ff0180698c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:17.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.288+0000 7ff017fff700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7ff01806d210 0x7ff01815b0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:34370/0 (socket says 172.21.15.146:34370) 2023-10-06T11:18:17.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.288+0000 7ff017fff700 1 -- 172.21.15.146:0/3089162886 learned_addr learned my addr 172.21.15.146:0/3089162886 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:17.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.288+0000 7ff016ffd700 1 --2- 172.21.15.146:0/3089162886 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff018069450 0x7ff0180698c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:42464/0 (socket says 172.21.15.146:42464) 2023-10-06T11:18:17.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.288+0000 7ff0167fc700 1 -- 172.21.15.146:0/3089162886 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1600196619 0 0) 0x7ff018158a50 con 0x7ff01806d210 2023-10-06T11:18:17.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.288+0000 7ff0167fc700 1 -- 172.21.15.146:0/3089162886 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff000003570 con 0x7ff01806d210 2023-10-06T11:18:17.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.288+0000 7ff016ffd700 1 -- 172.21.15.146:0/3089162886 >> v2:172.21.15.151:3300/0 conn(0x7ff018158140 msgr2=0x7ff018158510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:17.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.288+0000 7ff016ffd700 1 --2- 172.21.15.146:0/3089162886 >> v2:172.21.15.151:3300/0 conn(0x7ff018158140 0x7ff018158510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:17.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.288+0000 7ff016ffd700 1 -- 172.21.15.146:0/3089162886 >> v1:172.21.15.151:6789/0 conn(0x7ff01806d210 legacy=0x7ff01815b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:17.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.288+0000 7ff016ffd700 1 -- 172.21.15.146:0/3089162886 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff01806a4d0 con 0x7ff018069450 2023-10-06T11:18:17.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.288+0000 7ff0177fe700 1 --2- 172.21.15.146:0/3089162886 >> v2:172.21.15.151:3300/0 conn(0x7ff018158140 0x7ff018158510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:18:17.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.288+0000 7ff016ffd700 1 --2- 172.21.15.146:0/3089162886 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff018069450 0x7ff0180698c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff00c0098e0 tx=0x7ff00c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3dbcb796ea801946 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:17.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.289+0000 7ff0167fc700 1 -- 172.21.15.146:0/3089162886 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00c011630 con 0x7ff018069450 2023-10-06T11:18:17.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.289+0000 7ff0167fc700 1 -- 172.21.15.146:0/3089162886 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff00c011790 con 0x7ff018069450 2023-10-06T11:18:17.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.289+0000 7ff0167fc700 1 -- 172.21.15.146:0/3089162886 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00c011b30 con 0x7ff018069450 2023-10-06T11:18:17.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.289+0000 7ff01de8e700 1 -- 172.21.15.146:0/3089162886 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff018069450 msgr2=0x7ff0180698c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:17.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.289+0000 7ff01de8e700 1 --2- 172.21.15.146:0/3089162886 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff018069450 0x7ff0180698c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff00c0098e0 tx=0x7ff00c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:18:17.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.289+0000 7ff01de8e700 1 -- 172.21.15.146:0/3089162886 shutdown_connections 2023-10-06T11:18:17.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.289+0000 7ff01de8e700 1 --2- 172.21.15.146:0/3089162886 >> v2:172.21.15.151:3300/0 conn(0x7ff018158140 0x7ff018158510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:17.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.289+0000 7ff01de8e700 1 --2- 172.21.15.146:0/3089162886 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff018069450 0x7ff0180698c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:17.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.289+0000 7ff01de8e700 1 -- 172.21.15.146:0/3089162886 >> 172.21.15.146:0/3089162886 conn(0x7ff0180cc1c0 msgr2=0x7ff0180cc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:17.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.289+0000 7ff01de8e700 1 -- 172.21.15.146:0/3089162886 shutdown_connections 2023-10-06T11:18:17.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.289+0000 7ff01de8e700 1 -- 172.21.15.146:0/3089162886 wait complete. 2023-10-06T11:18:17.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.290+0000 7ff01de8e700 1 Processor -- start 2023-10-06T11:18:17.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.290+0000 7ff01de8e700 1 -- start start 2023-10-06T11:18:17.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.291+0000 7ff01de8e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff018069450 0x7ff0180c2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:17.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.291+0000 7ff01de8e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff01806d210 0x7ff0180c34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:17.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.291+0000 7ff01de8e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff018158140 0x7ff0180c3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:17.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.291+0000 7ff01de8e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01814f930 con 0x7ff018069450 2023-10-06T11:18:17.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.291+0000 7ff01de8e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0180c4260 con 0x7ff018158140 2023-10-06T11:18:17.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.291+0000 7ff01de8e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff01814fbf0 con 0x7ff01806d210 2023-10-06T11:18:17.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.291+0000 7ff0177fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff018069450 0x7ff0180c2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:17.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.291+0000 7ff0177fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff018069450 0x7ff0180c2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40668/0 (socket says 172.21.15.146:40668) 2023-10-06T11:18:17.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.291+0000 7ff0177fe700 1 -- 172.21.15.146:0/548331534 learned_addr learned my addr 172.21.15.146:0/548331534 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:17.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.291+0000 7ff016ffd700 1 --2- 172.21.15.146:0/548331534 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff01806d210 0x7ff0180c34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:17.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.291+0000 7ff017fff700 1 --2- 172.21.15.146:0/548331534 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff018158140 0x7ff0180c3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:17.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.292+0000 7ff0177fe700 1 -- 172.21.15.146:0/548331534 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff01806d210 msgr2=0x7ff0180c34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:17.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.292+0000 7ff0177fe700 1 --2- 172.21.15.146:0/548331534 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff01806d210 0x7ff0180c34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:17.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.292+0000 7ff0177fe700 1 -- 172.21.15.146:0/548331534 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff018158140 msgr2=0x7ff0180c3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:17.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.292+0000 7ff0177fe700 1 --2- 172.21.15.146:0/548331534 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff018158140 0x7ff0180c3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:17.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.292+0000 7ff0177fe700 1 -- 172.21.15.146:0/548331534 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff008009420 con 0x7ff018069450 2023-10-06T11:18:17.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.292+0000 7ff0177fe700 1 --2- 172.21.15.146:0/548331534 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff018069450 0x7ff0180c2330 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7ff00800ec80 tx=0x7ff0080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:17.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.292+0000 7fefff7fe700 1 -- 172.21.15.146:0/548331534 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00800c9d0 con 0x7ff018069450 2023-10-06T11:18:17.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.292+0000 7fefff7fe700 1 -- 172.21.15.146:0/548331534 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff00800cb30 con 0x7ff018069450 2023-10-06T11:18:17.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.292+0000 7fefff7fe700 1 -- 172.21.15.146:0/548331534 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00800ceb0 con 0x7ff018069450 2023-10-06T11:18:17.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.292+0000 7ff01de8e700 1 -- 172.21.15.146:0/548331534 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff00c009420 con 0x7ff018069450 2023-10-06T11:18:17.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.292+0000 7ff01de8e700 1 -- 172.21.15.146:0/548331534 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0180c3f70 con 0x7ff018069450 2023-10-06T11:18:17.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.293+0000 7ff01de8e700 1 -- 172.21.15.146:0/548331534 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff018150520 con 0x7ff018069450 2023-10-06T11:18:17.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.293+0000 7fefff7fe700 1 -- 172.21.15.146:0/548331534 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff008013680 con 0x7ff018069450 2023-10-06T11:18:17.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.294+0000 7fefff7fe700 1 --2- 172.21.15.146:0/548331534 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff004066f30 0x7ff0040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:17.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.294+0000 7fefff7fe700 1 -- 172.21.15.146:0/548331534 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5292+0+0 (secure 0 0 0) 0x7ff0080847a0 con 0x7ff018069450 2023-10-06T11:18:17.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.294+0000 7ff016ffd700 1 --2- 172.21.15.146:0/548331534 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff004066f30 0x7ff0040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:17.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.294+0000 7ff016ffd700 1 --2- 172.21.15.146:0/548331534 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff004066f30 0x7ff0040693e0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7ff00c0091e0 tx=0x7ff00c017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:17.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.298+0000 7fefff7fe700 1 -- 172.21.15.146:0/548331534 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff008051bb0 con 0x7ff018069450 2023-10-06T11:18:17.556 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.555+0000 7ff01de8e700 1 -- 172.21.15.146:0/548331534 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]} v 0) v1 -- 0x7ff01814fff0 con 0x7ff018069450 2023-10-06T11:18:17.826 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.825+0000 7fefff7fe700 1 -- 172.21.15.146:0/548331534 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace"]}]=0 v584) v1 ==== 133+0+0 (secure 0 0 0) 0x7ff0080551d0 con 0x7ff018069450 2023-10-06T11:18:17.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.827+0000 7ff01de8e700 1 -- 172.21.15.146:0/548331534 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff004066f30 msgr2=0x7ff0040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:17.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.827+0000 7ff01de8e700 1 --2- 172.21.15.146:0/548331534 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff004066f30 0x7ff0040693e0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7ff00c0091e0 tx=0x7ff00c017000 comp rx=0 tx=0).stop 2023-10-06T11:18:17.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.827+0000 7ff01de8e700 1 -- 172.21.15.146:0/548331534 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff018069450 msgr2=0x7ff0180c2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:17.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.827+0000 7ff01de8e700 1 --2- 172.21.15.146:0/548331534 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff018069450 0x7ff0180c2330 secure :-1 s=READY pgs=2052 cs=0 l=1 rev1=1 crypto rx=0x7ff00800ec80 tx=0x7ff0080091a0 comp rx=0 tx=0).stop 2023-10-06T11:18:17.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.827+0000 7ff01de8e700 1 -- 172.21.15.146:0/548331534 shutdown_connections 2023-10-06T11:18:17.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.827+0000 7ff01de8e700 1 --2- 172.21.15.146:0/548331534 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff004066f30 0x7ff0040693e0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:17.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.827+0000 7ff01de8e700 1 --2- 172.21.15.146:0/548331534 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff018158140 0x7ff0180c3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:17.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.827+0000 7ff01de8e700 1 --2- 172.21.15.146:0/548331534 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff018069450 0x7ff0180c2330 unknown :-1 s=CLOSED pgs=2052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:17.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.827+0000 7ff01de8e700 1 --2- 172.21.15.146:0/548331534 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff01806d210 0x7ff0180c34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:17.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.827+0000 7ff01de8e700 1 -- 172.21.15.146:0/548331534 >> 172.21.15.146:0/548331534 conn(0x7ff0180cc1c0 msgr2=0x7ff0180af100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:17.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.828+0000 7ff01de8e700 1 -- 172.21.15.146:0/548331534 shutdown_connections 2023-10-06T11:18:17.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.828+0000 7ff01de8e700 1 -- 172.21.15.146:0/548331534 wait complete. 2023-10-06T11:18:17.841 INFO:tasks.cephfs_test_runner:test_scrub_backtrace (tasks.cephfs.test_scrub.TestScrub) ... ok 2023-10-06T11:18:17.841 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_backtrace_for_new_files (tasks.cephfs.test_scrub.TestScrub) 2023-10-06T11:18:17.841 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace_for_new_files' 2023-10-06T11:18:17.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.954+0000 7f9b90ed2700 1 Processor -- start 2023-10-06T11:18:17.955 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.954+0000 7f9b90ed2700 1 -- start start 2023-10-06T11:18:17.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.955+0000 7f9b90ed2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9b8c15a940 0x7f9b8c153c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:17.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.955+0000 7f9b90ed2700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b8c15d270 con 0x7f9b8c1538c0 2023-10-06T11:18:17.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.955+0000 7f9b90ed2700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b8c15d830 con 0x7f9b8c15dcc0 2023-10-06T11:18:17.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.955+0000 7f9b90ed2700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b8c15e110 con 0x7f9b8c15a940 2023-10-06T11:18:17.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.955+0000 7f9b81d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9b8c15a940 0x7f9b8c153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:17.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.955+0000 7f9b8a59c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f9b8c1538c0 0x7f9b8c0cac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33868/0 (socket says 172.21.15.146:33868) 2023-10-06T11:18:17.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.955+0000 7f9b81d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9b8c15a940 0x7f9b8c153c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40684/0 (socket says 172.21.15.146:40684) 2023-10-06T11:18:17.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.955+0000 7f9b8a59c700 1 -- 172.21.15.146:0/431702927 learned_addr learned my addr 172.21.15.146:0/431702927 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:17.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.955+0000 7f9b81d9b700 1 -- 172.21.15.146:0/431702927 >> v1:172.21.15.151:6789/0 conn(0x7f9b8c15dcc0 legacy=0x7f9b8c0ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:17.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.955+0000 7f9b81d9b700 1 -- 172.21.15.146:0/431702927 >> v1:172.21.15.146:6789/0 conn(0x7f9b8c1538c0 legacy=0x7f9b8c0cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:17.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.955+0000 7f9b81d9b700 1 -- 172.21.15.146:0/431702927 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b8c0cb810 con 0x7f9b8c15a940 2023-10-06T11:18:17.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.955+0000 7f9b81d9b700 1 --2- 172.21.15.146:0/431702927 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b8c15a940 0x7f9b8c153c90 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7f9b740098e0 tx=0x7f9b740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f8d1821b2247cf9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:17.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.955+0000 7f9b89d9b700 1 -- 172.21.15.146:0/431702927 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b74009e80 con 0x7f9b8c15a940 2023-10-06T11:18:17.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.956+0000 7f9b89d9b700 1 -- 172.21.15.146:0/431702927 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b7400b820 con 0x7f9b8c15a940 2023-10-06T11:18:17.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.956+0000 7f9b89d9b700 1 -- 172.21.15.146:0/431702927 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7400bba0 con 0x7f9b8c15a940 2023-10-06T11:18:17.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.956+0000 7f9b90ed2700 1 -- 172.21.15.146:0/431702927 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b8c15a940 msgr2=0x7f9b8c153c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:17.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.956+0000 7f9b90ed2700 1 --2- 172.21.15.146:0/431702927 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b8c15a940 0x7f9b8c153c90 secure :-1 s=READY pgs=2054 cs=0 l=1 rev1=1 crypto rx=0x7f9b740098e0 tx=0x7f9b740091a0 comp rx=0 tx=0).stop 2023-10-06T11:18:17.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.956+0000 7f9b90ed2700 1 -- 172.21.15.146:0/431702927 shutdown_connections 2023-10-06T11:18:17.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.956+0000 7f9b90ed2700 1 --2- 172.21.15.146:0/431702927 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b8c15a940 0x7f9b8c153c90 unknown :-1 s=CLOSED pgs=2054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:17.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.956+0000 7f9b90ed2700 1 -- 172.21.15.146:0/431702927 >> 172.21.15.146:0/431702927 conn(0x7f9b8c06eb10 msgr2=0x7f9b8c06ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:17.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.956+0000 7f9b90ed2700 1 -- 172.21.15.146:0/431702927 shutdown_connections 2023-10-06T11:18:17.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.956+0000 7f9b90ed2700 1 -- 172.21.15.146:0/431702927 wait complete. 2023-10-06T11:18:17.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.957+0000 7f9b90ed2700 1 Processor -- start 2023-10-06T11:18:17.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.957+0000 7f9b90ed2700 1 -- start start 2023-10-06T11:18:17.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.958+0000 7f9b90ed2700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9b8c1538c0 0x7f9b8c159200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:17.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.958+0000 7f9b90ed2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b8c15a940 0x7f9b8c0c9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:17.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.958+0000 7f9b90ed2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b8c15dcc0 0x7f9b8c151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:17.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.958+0000 7f9b90ed2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8c0b33e0 con 0x7f9b8c15a940 2023-10-06T11:18:17.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.958+0000 7f9b90ed2700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8c0c95c0 con 0x7f9b8c15dcc0 2023-10-06T11:18:17.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.958+0000 7f9b90ed2700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8c0c97d0 con 0x7f9b8c1538c0 2023-10-06T11:18:17.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.958+0000 7f9b81d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b8c15a940 0x7f9b8c0c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:17.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.958+0000 7f9b81d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b8c15a940 0x7f9b8c0c9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40692/0 (socket says 172.21.15.146:40692) 2023-10-06T11:18:17.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.958+0000 7f9b81d9b700 1 -- 172.21.15.146:0/3634231013 learned_addr learned my addr 172.21.15.146:0/3634231013 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:17.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.959+0000 7f9b81d9b700 1 -- 172.21.15.146:0/3634231013 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9b8c1538c0 msgr2=0x7f9b8c159200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:17.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.959+0000 7f9b81d9b700 1 --2- 172.21.15.146:0/3634231013 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9b8c1538c0 0x7f9b8c159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:17.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.959+0000 7f9b81d9b700 1 -- 172.21.15.146:0/3634231013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b8c15dcc0 msgr2=0x7f9b8c151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:17.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.959+0000 7f9b81d9b700 1 --2- 172.21.15.146:0/3634231013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b8c15dcc0 0x7f9b8c151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:17.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.959+0000 7f9b81d9b700 1 -- 172.21.15.146:0/3634231013 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b74009420 con 0x7f9b8c15a940 2023-10-06T11:18:17.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.959+0000 7f9b81d9b700 1 --2- 172.21.15.146:0/3634231013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b8c15a940 0x7f9b8c0c9080 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7f9b740030c0 tx=0x7f9b74016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:17.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.959+0000 7f9b82ffd700 1 -- 172.21.15.146:0/3634231013 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7401b470 con 0x7f9b8c15a940 2023-10-06T11:18:17.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.959+0000 7f9b82ffd700 1 -- 172.21.15.146:0/3634231013 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b7401b5f0 con 0x7f9b8c15a940 2023-10-06T11:18:17.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.959+0000 7f9b90ed2700 1 -- 172.21.15.146:0/3634231013 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b8c0c9ab0 con 0x7f9b8c15a940 2023-10-06T11:18:17.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.959+0000 7f9b82ffd700 1 -- 172.21.15.146:0/3634231013 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b7401b9b0 con 0x7f9b8c15a940 2023-10-06T11:18:17.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.959+0000 7f9b90ed2700 1 -- 172.21.15.146:0/3634231013 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b8c0ca070 con 0x7f9b8c15a940 2023-10-06T11:18:17.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.960+0000 7f9b90ed2700 1 -- 172.21.15.146:0/3634231013 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b8c04c380 con 0x7f9b8c15a940 2023-10-06T11:18:17.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.960+0000 7f9b82ffd700 1 -- 172.21.15.146:0/3634231013 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9b7401c450 con 0x7f9b8c15a940 2023-10-06T11:18:17.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.960+0000 7f9b82ffd700 1 --2- 172.21.15.146:0/3634231013 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9b6c066f30 0x7f9b6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:17.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.961+0000 7f9b82ffd700 1 -- 172.21.15.146:0/3634231013 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f9b740860c0 con 0x7f9b8c15a940 2023-10-06T11:18:17.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.961+0000 7f9b8a59c700 1 --2- 172.21.15.146:0/3634231013 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9b6c066f30 0x7f9b6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:17.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.961+0000 7f9b8a59c700 1 --2- 172.21.15.146:0/3634231013 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9b6c066f30 0x7f9b6c0693e0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c007fd0 tx=0x7f9b7c007b90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:17.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:17.965+0000 7f9b82ffd700 1 -- 172.21.15.146:0/3634231013 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9b740534d0 con 0x7f9b8c15a940 2023-10-06T11:18:18.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.223+0000 7f9b90ed2700 1 -- 172.21.15.146:0/3634231013 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace_for_new_files"]} v 0) v1 -- 0x7f9b8c0cbaf0 con 0x7f9b8c15a940 2023-10-06T11:18:18.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.826+0000 7f9b82ffd700 1 -- 172.21.15.146:0/3634231013 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace_for_new_files"]}]=0 v585) v1 ==== 150+0+0 (secure 0 0 0) 0x7f9b74056af0 con 0x7f9b8c15a940 2023-10-06T11:18:18.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.829+0000 7f9b90ed2700 1 -- 172.21.15.146:0/3634231013 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9b6c066f30 msgr2=0x7f9b6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:18.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.829+0000 7f9b90ed2700 1 --2- 172.21.15.146:0/3634231013 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9b6c066f30 0x7f9b6c0693e0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f9b7c007fd0 tx=0x7f9b7c007b90 comp rx=0 tx=0).stop 2023-10-06T11:18:18.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.829+0000 7f9b90ed2700 1 -- 172.21.15.146:0/3634231013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b8c15a940 msgr2=0x7f9b8c0c9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:18.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.829+0000 7f9b90ed2700 1 --2- 172.21.15.146:0/3634231013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b8c15a940 0x7f9b8c0c9080 secure :-1 s=READY pgs=2055 cs=0 l=1 rev1=1 crypto rx=0x7f9b740030c0 tx=0x7f9b74016000 comp rx=0 tx=0).stop 2023-10-06T11:18:18.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.829+0000 7f9b90ed2700 1 -- 172.21.15.146:0/3634231013 shutdown_connections 2023-10-06T11:18:18.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.829+0000 7f9b90ed2700 1 --2- 172.21.15.146:0/3634231013 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9b6c066f30 0x7f9b6c0693e0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:18.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.829+0000 7f9b90ed2700 1 --2- 172.21.15.146:0/3634231013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b8c15dcc0 0x7f9b8c151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:18.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.829+0000 7f9b90ed2700 1 --2- 172.21.15.146:0/3634231013 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9b8c1538c0 0x7f9b8c159200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:18.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.829+0000 7f9b90ed2700 1 --2- 172.21.15.146:0/3634231013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9b8c15a940 0x7f9b8c0c9080 unknown :-1 s=CLOSED pgs=2055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:18.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.829+0000 7f9b90ed2700 1 -- 172.21.15.146:0/3634231013 >> 172.21.15.146:0/3634231013 conn(0x7f9b8c06eb10 msgr2=0x7f9b8c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:18.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.829+0000 7f9b90ed2700 1 -- 172.21.15.146:0/3634231013 shutdown_connections 2023-10-06T11:18:18.832 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.829+0000 7f9b90ed2700 1 -- 172.21.15.146:0/3634231013 wait complete. 2023-10-06T11:18:18.842 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T11:18:18.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.960+0000 7f6db8280700 1 Processor -- start 2023-10-06T11:18:18.961 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.960+0000 7f6db8280700 1 -- start start 2023-10-06T11:18:18.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.961+0000 7f6db8280700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6db01400a0 0x7f6db00caec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:18.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.961+0000 7f6db8280700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6db0067cb0 0x7f6db00cb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:18.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.961+0000 7f6db8280700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6db006c1d0 con 0x7f6db013fcd0 2023-10-06T11:18:18.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.961+0000 7f6db8280700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6db00c7a60 con 0x7f6db01400a0 2023-10-06T11:18:18.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.961+0000 7f6db8280700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db006c420 con 0x7f6db0067cb0 2023-10-06T11:18:18.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.961+0000 7f6db581b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6db01400a0 0x7f6db00caec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:18.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.961+0000 7f6db581b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6db01400a0 0x7f6db00caec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40706/0 (socket says 172.21.15.146:40706) 2023-10-06T11:18:18.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.961+0000 7f6db581b700 1 -- 172.21.15.146:0/1293222281 learned_addr learned my addr 172.21.15.146:0/1293222281 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:18.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.962+0000 7f6db681d700 1 --2- 172.21.15.146:0/1293222281 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6db0067cb0 0x7f6db00cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:18.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.962+0000 7f6db581b700 1 -- 172.21.15.146:0/1293222281 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6db0067cb0 msgr2=0x7f6db00cb400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:18.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.962+0000 7f6db581b700 1 --2- 172.21.15.146:0/1293222281 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6db0067cb0 0x7f6db00cb400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:18.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.962+0000 7f6db581b700 1 -- 172.21.15.146:0/1293222281 >> v1:172.21.15.151:6789/0 conn(0x7f6db013fcd0 legacy=0x7f6db00675a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:18.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.962+0000 7f6db581b700 1 -- 172.21.15.146:0/1293222281 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db006c700 con 0x7f6db01400a0 2023-10-06T11:18:18.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.962+0000 7f6db581b700 1 --2- 172.21.15.146:0/1293222281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6db01400a0 0x7f6db00caec0 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 crypto rx=0x7f6da00099b0 tx=0x7f6da0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=307af752701b6a60 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:18.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.962+0000 7f6db501a700 1 -- 172.21.15.146:0/1293222281 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da000b820 con 0x7f6db01400a0 2023-10-06T11:18:18.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.962+0000 7f6db501a700 1 -- 172.21.15.146:0/1293222281 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da000b980 con 0x7f6db01400a0 2023-10-06T11:18:18.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.962+0000 7f6db501a700 1 -- 172.21.15.146:0/1293222281 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da000bd20 con 0x7f6db01400a0 2023-10-06T11:18:18.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.962+0000 7f6db8280700 1 -- 172.21.15.146:0/1293222281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6db01400a0 msgr2=0x7f6db00caec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:18.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.962+0000 7f6db8280700 1 --2- 172.21.15.146:0/1293222281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6db01400a0 0x7f6db00caec0 secure :-1 s=READY pgs=2056 cs=0 l=1 rev1=1 crypto rx=0x7f6da00099b0 tx=0x7f6da0009250 comp rx=0 tx=0).stop 2023-10-06T11:18:18.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.963+0000 7f6db8280700 1 -- 172.21.15.146:0/1293222281 shutdown_connections 2023-10-06T11:18:18.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.963+0000 7f6db8280700 1 --2- 172.21.15.146:0/1293222281 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6db0067cb0 0x7f6db00cb400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:18.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.963+0000 7f6db8280700 1 --2- 172.21.15.146:0/1293222281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6db01400a0 0x7f6db00caec0 unknown :-1 s=CLOSED pgs=2056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:18.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.963+0000 7f6db8280700 1 -- 172.21.15.146:0/1293222281 >> 172.21.15.146:0/1293222281 conn(0x7f6db006af80 msgr2=0x7f6db00cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:18.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.963+0000 7f6db8280700 1 -- 172.21.15.146:0/1293222281 shutdown_connections 2023-10-06T11:18:18.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.963+0000 7f6db8280700 1 -- 172.21.15.146:0/1293222281 wait complete. 2023-10-06T11:18:18.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.964+0000 7f6db8280700 1 Processor -- start 2023-10-06T11:18:18.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.964+0000 7f6db8280700 1 -- start start 2023-10-06T11:18:18.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.964+0000 7f6db8280700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6db0067cb0 0x7f6db00a98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:18.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.964+0000 7f6db8280700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6db013fcd0 0x7f6db013d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:18.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.964+0000 7f6db8280700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6db01400a0 0x7f6db006e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:18.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.964+0000 7f6db8280700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db00a9e10 con 0x7f6db01400a0 2023-10-06T11:18:18.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.964+0000 7f6db8280700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db016d370 con 0x7f6db0067cb0 2023-10-06T11:18:18.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.964+0000 7f6db8280700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db016d5c0 con 0x7f6db013fcd0 2023-10-06T11:18:18.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.964+0000 7f6db681d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6db01400a0 0x7f6db006e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:18.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.964+0000 7f6db681d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6db01400a0 0x7f6db006e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40718/0 (socket says 172.21.15.146:40718) 2023-10-06T11:18:18.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.965+0000 7f6db681d700 1 -- 172.21.15.146:0/3755406832 learned_addr learned my addr 172.21.15.146:0/3755406832 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:18.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.965+0000 7f6db601c700 1 --2- 172.21.15.146:0/3755406832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6db0067cb0 0x7f6db00a98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:18.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.965+0000 7f6db581b700 1 --2- 172.21.15.146:0/3755406832 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6db013fcd0 0x7f6db013d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:18.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.965+0000 7f6db681d700 1 -- 172.21.15.146:0/3755406832 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6db013fcd0 msgr2=0x7f6db013d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:18.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.965+0000 7f6db681d700 1 --2- 172.21.15.146:0/3755406832 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6db013fcd0 0x7f6db013d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:18.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.965+0000 7f6db681d700 1 -- 172.21.15.146:0/3755406832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6db0067cb0 msgr2=0x7f6db00a98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:18.969 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.965+0000 7f6db681d700 1 --2- 172.21.15.146:0/3755406832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6db0067cb0 0x7f6db00a98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:18.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.965+0000 7f6db681d700 1 -- 172.21.15.146:0/3755406832 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da00094f0 con 0x7f6db01400a0 2023-10-06T11:18:18.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.965+0000 7f6db681d700 1 --2- 172.21.15.146:0/3755406832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6db01400a0 0x7f6db006e5c0 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7f6da800c850 tx=0x7f6da8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:18.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.965+0000 7f6da67fc700 1 -- 172.21.15.146:0/3755406832 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da8011660 con 0x7f6db01400a0 2023-10-06T11:18:18.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.965+0000 7f6da67fc700 1 -- 172.21.15.146:0/3755406832 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da80117c0 con 0x7f6db01400a0 2023-10-06T11:18:18.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.965+0000 7f6db8280700 1 -- 172.21.15.146:0/3755406832 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6db016d8a0 con 0x7f6db01400a0 2023-10-06T11:18:18.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.965+0000 7f6da67fc700 1 -- 172.21.15.146:0/3755406832 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da8011b80 con 0x7f6db01400a0 2023-10-06T11:18:18.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.965+0000 7f6db8280700 1 -- 172.21.15.146:0/3755406832 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6db016de60 con 0x7f6db01400a0 2023-10-06T11:18:18.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.966+0000 7f6db8280700 1 -- 172.21.15.146:0/3755406832 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6db0169de0 con 0x7f6db01400a0 2023-10-06T11:18:18.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.966+0000 7f6da67fc700 1 -- 172.21.15.146:0/3755406832 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6da80193f0 con 0x7f6db01400a0 2023-10-06T11:18:18.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.967+0000 7f6da67fc700 1 --2- 172.21.15.146:0/3755406832 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6d94066f30 0x7f6d940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:18.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.967+0000 7f6da67fc700 1 -- 172.21.15.146:0/3755406832 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f6da8084630 con 0x7f6db01400a0 2023-10-06T11:18:18.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.967+0000 7f6db601c700 1 --2- 172.21.15.146:0/3755406832 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6d94066f30 0x7f6d940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:18.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.967+0000 7f6db601c700 1 --2- 172.21.15.146:0/3755406832 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6d94066f30 0x7f6d940693e0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f6dac007fd0 tx=0x7f6dac0026a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:18.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:18.971+0000 7f6da67fc700 1 -- 172.21.15.146:0/3755406832 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6da80554d0 con 0x7f6db01400a0 2023-10-06T11:18:19.156 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.155+0000 7f6db8280700 1 -- 172.21.15.146:0/3755406832 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6db016e230 con 0x7f6db01400a0 2023-10-06T11:18:19.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.161+0000 7f6da67fc700 1 -- 172.21.15.146:0/3755406832 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v30)=0 v30) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6da8055060 con 0x7f6db01400a0 2023-10-06T11:18:19.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.163+0000 7f6db8280700 1 -- 172.21.15.146:0/3755406832 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6d94066f30 msgr2=0x7f6d940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:19.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.163+0000 7f6db8280700 1 --2- 172.21.15.146:0/3755406832 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6d94066f30 0x7f6d940693e0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f6dac007fd0 tx=0x7f6dac0026a0 comp rx=0 tx=0).stop 2023-10-06T11:18:19.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.163+0000 7f6db8280700 1 -- 172.21.15.146:0/3755406832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6db01400a0 msgr2=0x7f6db006e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:19.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.163+0000 7f6db8280700 1 --2- 172.21.15.146:0/3755406832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6db01400a0 0x7f6db006e5c0 secure :-1 s=READY pgs=2057 cs=0 l=1 rev1=1 crypto rx=0x7f6da800c850 tx=0x7f6da8008040 comp rx=0 tx=0).stop 2023-10-06T11:18:19.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.163+0000 7f6db8280700 1 -- 172.21.15.146:0/3755406832 shutdown_connections 2023-10-06T11:18:19.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.163+0000 7f6db8280700 1 --2- 172.21.15.146:0/3755406832 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6d94066f30 0x7f6d940693e0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:19.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.163+0000 7f6db8280700 1 --2- 172.21.15.146:0/3755406832 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6db01400a0 0x7f6db006e5c0 unknown :-1 s=CLOSED pgs=2057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:19.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.163+0000 7f6db8280700 1 --2- 172.21.15.146:0/3755406832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6db0067cb0 0x7f6db00a98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:19.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.163+0000 7f6db8280700 1 --2- 172.21.15.146:0/3755406832 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6db013fcd0 0x7f6db013d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:19.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.163+0000 7f6db8280700 1 -- 172.21.15.146:0/3755406832 >> 172.21.15.146:0/3755406832 conn(0x7f6db006af80 msgr2=0x7f6db00c26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:19.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.163+0000 7f6db8280700 1 -- 172.21.15.146:0/3755406832 shutdown_connections 2023-10-06T11:18:19.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.163+0000 7f6db8280700 1 -- 172.21.15.146:0/3755406832 wait complete. 2023-10-06T11:18:19.176 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T11:18:19.177 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:18:19.215 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:18:19.257 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T11:18:19.257 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T11:18:19.258 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:18:19.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.371+0000 7faa67456700 1 Processor -- start 2023-10-06T11:18:19.372 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.371+0000 7faa67456700 1 -- start start 2023-10-06T11:18:19.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.372+0000 7faa67456700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa601538c0 0x7faa60153c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:19.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.372+0000 7faa67456700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa6015e140 con 0x7faa6015dcc0 2023-10-06T11:18:19.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.372+0000 7faa67456700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa6015d270 con 0x7faa6015a940 2023-10-06T11:18:19.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.372+0000 7faa67456700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa6015d830 con 0x7faa601538c0 2023-10-06T11:18:19.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.372+0000 7faa659f3700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7faa6015dcc0 0x7faa600ce610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33872/0 (socket says 172.21.15.146:33872) 2023-10-06T11:18:19.373 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.372+0000 7faa659f3700 1 -- 172.21.15.146:0/2413680605 learned_addr learned my addr 172.21.15.146:0/2413680605 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:19.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.373+0000 7faa57fff700 1 -- 172.21.15.146:0/2413680605 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2546164894 0 0) 0x7faa58001110 con 0x7faa6015dcc0 2023-10-06T11:18:19.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.373+0000 7faa651f2700 1 --2- 172.21.15.146:0/2413680605 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa601538c0 0x7faa60153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:19.376 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.373+0000 7faa57fff700 1 -- 172.21.15.146:0/2413680605 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa4c003570 con 0x7faa6015dcc0 2023-10-06T11:18:19.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.373+0000 7faa57fff700 1 -- 172.21.15.146:0/2413680605 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4245512714 0 0) 0x7faa4c003570 con 0x7faa6015dcc0 2023-10-06T11:18:19.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.373+0000 7faa57fff700 1 -- 172.21.15.146:0/2413680605 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa601538c0 msgr2=0x7faa60153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:19.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.373+0000 7faa57fff700 1 --2- 172.21.15.146:0/2413680605 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa601538c0 0x7faa60153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:19.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.373+0000 7faa57fff700 1 -- 172.21.15.146:0/2413680605 >> v1:172.21.15.151:6789/0 conn(0x7faa6015a940 legacy=0x7faa600cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:19.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.373+0000 7faa57fff700 1 -- 172.21.15.146:0/2413680605 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa600cb810 con 0x7faa6015dcc0 2023-10-06T11:18:19.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.373+0000 7faa57fff700 1 -- 172.21.15.146:0/2413680605 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7faa58001600 con 0x7faa6015dcc0 2023-10-06T11:18:19.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.373+0000 7faa57fff700 1 -- 172.21.15.146:0/2413680605 >> v1:172.21.15.146:6789/0 conn(0x7faa6015dcc0 legacy=0x7faa600ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:19.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.373+0000 7faa57fff700 1 --2- 172.21.15.146:0/2413680605 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa601538c0 0x7faa4c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:19.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.373+0000 7faa57fff700 1 --2- 172.21.15.146:0/2413680605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa4c0040c0 0x7faa4c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:19.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.373+0000 7faa57fff700 1 --2- 172.21.15.146:0/2413680605 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa4c004da0 0x7faa4c0051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:19.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.373+0000 7faa57fff700 1 -- 172.21.15.146:0/2413680605 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6015d830 con 0x7faa4c0040c0 2023-10-06T11:18:19.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.373+0000 7faa57fff700 1 -- 172.21.15.146:0/2413680605 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c00bc70 con 0x7faa4c004da0 2023-10-06T11:18:19.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.373+0000 7faa57fff700 1 -- 172.21.15.146:0/2413680605 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa4c00be30 con 0x7faa601538c0 2023-10-06T11:18:19.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.373+0000 7faa649f1700 1 --2- 172.21.15.146:0/2413680605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa4c0040c0 0x7faa4c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:19.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.373+0000 7faa651f2700 1 --2- 172.21.15.146:0/2413680605 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa601538c0 0x7faa4c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:19.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.373+0000 7faa659f3700 1 --2- 172.21.15.146:0/2413680605 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa4c004da0 0x7faa4c0051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:19.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.373+0000 7faa649f1700 1 -- 172.21.15.146:0/2413680605 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa601538c0 msgr2=0x7faa4c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:19.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.373+0000 7faa649f1700 1 --2- 172.21.15.146:0/2413680605 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa601538c0 0x7faa4c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:19.378 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.373+0000 7faa649f1700 1 -- 172.21.15.146:0/2413680605 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa4c004da0 msgr2=0x7faa4c0051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:19.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.373+0000 7faa649f1700 1 --2- 172.21.15.146:0/2413680605 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa4c004da0 0x7faa4c0051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:19.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.373+0000 7faa649f1700 1 -- 172.21.15.146:0/2413680605 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4c003570 con 0x7faa4c0040c0 2023-10-06T11:18:19.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.373+0000 7faa659f3700 1 --2- 172.21.15.146:0/2413680605 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa4c004da0 0x7faa4c0051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:18:19.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.374+0000 7faa649f1700 1 --2- 172.21.15.146:0/2413680605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa4c0040c0 0x7faa4c004810 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7faa500018b0 tx=0x7faa50007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=473581e6f6f2116a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:19.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.374+0000 7faa57fff700 1 -- 172.21.15.146:0/2413680605 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa50012420 con 0x7faa4c0040c0 2023-10-06T11:18:19.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.374+0000 7faa57fff700 1 -- 172.21.15.146:0/2413680605 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa50012580 con 0x7faa4c0040c0 2023-10-06T11:18:19.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.374+0000 7faa57fff700 1 -- 172.21.15.146:0/2413680605 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa50012920 con 0x7faa4c0040c0 2023-10-06T11:18:19.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.374+0000 7faa67456700 1 -- 172.21.15.146:0/2413680605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa4c0040c0 msgr2=0x7faa4c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:19.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.374+0000 7faa67456700 1 --2- 172.21.15.146:0/2413680605 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa4c0040c0 0x7faa4c004810 secure :-1 s=READY pgs=2059 cs=0 l=1 rev1=1 crypto rx=0x7faa500018b0 tx=0x7faa50007d30 comp rx=0 tx=0).stop 2023-10-06T11:18:19.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.374+0000 7faa659f3700 1 -- 172.21.15.146:0/2413680605 reap_dead start 2023-10-06T11:18:19.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.374+0000 7faa67456700 1 -- 172.21.15.146:0/2413680605 shutdown_connections 2023-10-06T11:18:19.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.374+0000 7faa67456700 1 -- 172.21.15.146:0/2413680605 >> 172.21.15.146:0/2413680605 conn(0x7faa6006eb10 msgr2=0x7faa6006ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:19.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.374+0000 7faa67456700 1 -- 172.21.15.146:0/2413680605 shutdown_connections 2023-10-06T11:18:19.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.374+0000 7faa67456700 1 -- 172.21.15.146:0/2413680605 wait complete. 2023-10-06T11:18:19.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.375+0000 7faa67456700 1 Processor -- start 2023-10-06T11:18:19.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.375+0000 7faa67456700 1 -- start start 2023-10-06T11:18:19.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.376+0000 7faa67456700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa4c0040c0 0x7faa60146140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:19.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.376+0000 7faa67456700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa600c8910 0x7faa600b11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:19.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.376+0000 7faa67456700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa600c8d80 0x7faa600b1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:19.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.376+0000 7faa67456700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa60146680 con 0x7faa600c8910 2023-10-06T11:18:19.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.376+0000 7faa67456700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa600ca3e0 con 0x7faa600c8d80 2023-10-06T11:18:19.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.376+0000 7faa67456700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa600c9f50 con 0x7faa4c0040c0 2023-10-06T11:18:19.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.376+0000 7faa649f1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa600c8910 0x7faa600b11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:19.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.376+0000 7faa649f1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa600c8910 0x7faa600b11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40726/0 (socket says 172.21.15.146:40726) 2023-10-06T11:18:19.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.376+0000 7faa649f1700 1 -- 172.21.15.146:0/1895901419 learned_addr learned my addr 172.21.15.146:0/1895901419 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:19.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.377+0000 7faa651f2700 1 --2- 172.21.15.146:0/1895901419 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa4c0040c0 0x7faa60146140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:19.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.377+0000 7faa659f3700 1 --2- 172.21.15.146:0/1895901419 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa600c8d80 0x7faa600b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:19.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.377+0000 7faa649f1700 1 -- 172.21.15.146:0/1895901419 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa4c0040c0 msgr2=0x7faa60146140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:19.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.377+0000 7faa649f1700 1 --2- 172.21.15.146:0/1895901419 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa4c0040c0 0x7faa60146140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:19.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.377+0000 7faa649f1700 1 -- 172.21.15.146:0/1895901419 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa600c8d80 msgr2=0x7faa600b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:19.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.377+0000 7faa649f1700 1 --2- 172.21.15.146:0/1895901419 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa600c8d80 0x7faa600b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:19.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.377+0000 7faa649f1700 1 -- 172.21.15.146:0/1895901419 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa600c9340 con 0x7faa600c8910 2023-10-06T11:18:19.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.377+0000 7faa651f2700 1 --2- 172.21.15.146:0/1895901419 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa4c0040c0 0x7faa60146140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:18:19.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.377+0000 7faa649f1700 1 --2- 172.21.15.146:0/1895901419 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa600c8910 0x7faa600b11d0 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7faa50007db0 tx=0x7faa50015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:19.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.377+0000 7faa557fa700 1 -- 172.21.15.146:0/1895901419 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa50006b00 con 0x7faa600c8910 2023-10-06T11:18:19.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.377+0000 7faa557fa700 1 -- 172.21.15.146:0/1895901419 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa50006c60 con 0x7faa600c8910 2023-10-06T11:18:19.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.377+0000 7faa67456700 1 -- 172.21.15.146:0/1895901419 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa600c9620 con 0x7faa600c8910 2023-10-06T11:18:19.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.377+0000 7faa557fa700 1 -- 172.21.15.146:0/1895901419 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa50007030 con 0x7faa600c8910 2023-10-06T11:18:19.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.377+0000 7faa67456700 1 -- 172.21.15.146:0/1895901419 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa600c9be0 con 0x7faa600c8910 2023-10-06T11:18:19.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.378+0000 7faa67456700 1 -- 172.21.15.146:0/1895901419 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa6004c380 con 0x7faa600c8910 2023-10-06T11:18:19.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.378+0000 7faa557fa700 1 -- 172.21.15.146:0/1895901419 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faa50007420 con 0x7faa600c8910 2023-10-06T11:18:19.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.379+0000 7faa557fa700 1 --2- 172.21.15.146:0/1895901419 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faa44066f30 0x7faa440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:19.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.379+0000 7faa651f2700 1 --2- 172.21.15.146:0/1895901419 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faa44066f30 0x7faa440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:19.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.379+0000 7faa557fa700 1 -- 172.21.15.146:0/1895901419 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5292+0+0 (secure 0 0 0) 0x7faa50085280 con 0x7faa600c8910 2023-10-06T11:18:19.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.379+0000 7faa651f2700 1 --2- 172.21.15.146:0/1895901419 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faa44066f30 0x7faa440693e0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7faa5c009fd0 tx=0x7faa5c009710 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:19.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.383+0000 7faa557fa700 1 -- 172.21.15.146:0/1895901419 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faa50052690 con 0x7faa600c8910 2023-10-06T11:18:19.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.612+0000 7faa67456700 1 -- 172.21.15.146:0/1895901419 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faa600cbaf0 con 0x7faa600c8910 2023-10-06T11:18:19.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.613+0000 7faa557fa700 1 -- 172.21.15.146:0/1895901419 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 130 v130) v1 ==== 95+0+3546 (secure 0 0 0) 0x7faa50055cb0 con 0x7faa600c8910 2023-10-06T11:18:19.614 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:18:19.614 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":130,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7433,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3681774523","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3681774523},{"type":"v1","addr":"172.21.15.151:6834","nonce":3681774523}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":124},{"gid":7436,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/3243480101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":3243480101},{"type":"v1","addr":"172.21.15.151:6835","nonce":3243480101}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":124},{"gid":7649,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/2907976399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2907976399},{"type":"v1","addr":"172.21.15.146:6837","nonce":2907976399}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":130},{"gid":9645,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/1871572981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":1871572981},{"type":"v1","addr":"172.21.15.146:6836","nonce":1871572981}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":124}],"filesystems":[]} 2023-10-06T11:18:19.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.615+0000 7faa67456700 1 -- 172.21.15.146:0/1895901419 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faa44066f30 msgr2=0x7faa440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:19.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.615+0000 7faa67456700 1 --2- 172.21.15.146:0/1895901419 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faa44066f30 0x7faa440693e0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7faa5c009fd0 tx=0x7faa5c009710 comp rx=0 tx=0).stop 2023-10-06T11:18:19.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.615+0000 7faa67456700 1 -- 172.21.15.146:0/1895901419 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa600c8910 msgr2=0x7faa600b11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:19.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.615+0000 7faa67456700 1 --2- 172.21.15.146:0/1895901419 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa600c8910 0x7faa600b11d0 secure :-1 s=READY pgs=2060 cs=0 l=1 rev1=1 crypto rx=0x7faa50007db0 tx=0x7faa50015000 comp rx=0 tx=0).stop 2023-10-06T11:18:19.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.615+0000 7faa67456700 1 -- 172.21.15.146:0/1895901419 shutdown_connections 2023-10-06T11:18:19.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.615+0000 7faa67456700 1 --2- 172.21.15.146:0/1895901419 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7faa44066f30 0x7faa440693e0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:19.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.615+0000 7faa67456700 1 --2- 172.21.15.146:0/1895901419 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa600c8d80 0x7faa600b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:19.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.615+0000 7faa67456700 1 --2- 172.21.15.146:0/1895901419 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa4c0040c0 0x7faa60146140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:19.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.615+0000 7faa67456700 1 --2- 172.21.15.146:0/1895901419 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7faa600c8910 0x7faa600b11d0 unknown :-1 s=CLOSED pgs=2060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:19.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.615+0000 7faa67456700 1 -- 172.21.15.146:0/1895901419 >> 172.21.15.146:0/1895901419 conn(0x7faa6006eb10 msgr2=0x7faa60152390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:19.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.615+0000 7faa67456700 1 -- 172.21.15.146:0/1895901419 shutdown_connections 2023-10-06T11:18:19.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.615+0000 7faa67456700 1 -- 172.21.15.146:0/1895901419 wait complete. 2023-10-06T11:18:19.618 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 130 2023-10-06T11:18:19.629 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T11:18:19.629 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T11:18:19.629 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T11:18:19.629 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:18:19.629 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T11:18:19.629 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T11:18:19.630 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T11:18:19.630 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:18:19.630 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T11:18:19.630 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T11:18:19.630 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T11:18:19.630 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:18:19.630 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T11:18:19.630 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T11:18:19.631 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T11:18:19.631 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:18:19.638 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T11:18:19.638 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T11:18:19.639 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T11:18:19.639 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T11:18:19.641 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T11:18:19.641 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T11:18:19.641 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T11:18:19.642 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T11:18:19.681 INFO:tasks.ceph.mds.a:Started 2023-10-06T11:18:19.681 DEBUG:teuthology.parallel:result is None 2023-10-06T11:18:19.682 INFO:tasks.ceph.mds.c:Started 2023-10-06T11:18:19.683 DEBUG:teuthology.parallel:result is None 2023-10-06T11:18:19.683 INFO:tasks.ceph.mds.b:Started 2023-10-06T11:18:19.683 DEBUG:teuthology.parallel:result is None 2023-10-06T11:18:19.684 INFO:tasks.ceph.mds.d:Started 2023-10-06T11:18:19.684 DEBUG:teuthology.parallel:result is None 2023-10-06T11:18:19.684 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T11:18:19.756 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2023-10-06T11:18:19.756 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2023-10-06T11:18:19.764 INFO:tasks.ceph.mds.b.smithi151.stdout:starting mds.b at 2023-10-06T11:18:19.764 INFO:tasks.ceph.mds.d.smithi151.stdout:starting mds.d at 2023-10-06T11:18:19.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.804+0000 7fb6b071c700 1 Processor -- start 2023-10-06T11:18:19.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.804+0000 7fb6b071c700 1 -- start start 2023-10-06T11:18:19.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.805+0000 7fb6b071c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6a80b25f0 0x7fb6a8067af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:19.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.805+0000 7fb6b071c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb6a80cb140 0x7fb6a8154a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:19.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.805+0000 7fb6b071c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb6a8068030 0x7fb6a8154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:19.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.805+0000 7fb6b071c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6a8155500 con 0x7fb6a80cb140 2023-10-06T11:18:19.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.805+0000 7fb6b071c700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6a8157bc0 con 0x7fb6a8068030 2023-10-06T11:18:19.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.805+0000 7fb6b071c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a8157ea0 con 0x7fb6a80b25f0 2023-10-06T11:18:19.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.805+0000 7fb6adcb7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb6a80cb140 0x7fb6a8154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:19.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.805+0000 7fb6adcb7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb6a80cb140 0x7fb6a8154a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40758/0 (socket says 172.21.15.146:40758) 2023-10-06T11:18:19.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.805+0000 7fb6adcb7700 1 -- 172.21.15.146:0/3539794447 learned_addr learned my addr 172.21.15.146:0/3539794447 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:19.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.806+0000 7fb6aecb9700 1 --2- 172.21.15.146:0/3539794447 >> v2:172.21.15.151:3300/0 conn(0x7fb6a8068030 0x7fb6a8154fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:19.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.806+0000 7fb6ae4b8700 1 --2- 172.21.15.146:0/3539794447 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6a80b25f0 0x7fb6a8067af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:19.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.806+0000 7fb6adcb7700 1 -- 172.21.15.146:0/3539794447 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6a80b25f0 msgr2=0x7fb6a8067af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:19.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.806+0000 7fb6adcb7700 1 --2- 172.21.15.146:0/3539794447 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6a80b25f0 0x7fb6a8067af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:19.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.806+0000 7fb6adcb7700 1 -- 172.21.15.146:0/3539794447 >> v2:172.21.15.151:3300/0 conn(0x7fb6a8068030 msgr2=0x7fb6a8154fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:19.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.806+0000 7fb6adcb7700 1 --2- 172.21.15.146:0/3539794447 >> v2:172.21.15.151:3300/0 conn(0x7fb6a8068030 0x7fb6a8154fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:19.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.806+0000 7fb6adcb7700 1 -- 172.21.15.146:0/3539794447 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a8158180 con 0x7fb6a80cb140 2023-10-06T11:18:19.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.806+0000 7fb6ae4b8700 1 --2- 172.21.15.146:0/3539794447 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6a80b25f0 0x7fb6a8067af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:18:19.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.806+0000 7fb6aecb9700 1 --2- 172.21.15.146:0/3539794447 >> v2:172.21.15.151:3300/0 conn(0x7fb6a8068030 0x7fb6a8154fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:18:19.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.806+0000 7fb6adcb7700 1 --2- 172.21.15.146:0/3539794447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6a80cb140 0x7fb6a8154a80 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7fb6a80c9e20 tx=0x7fb698009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58c5b266537166c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:19.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.806+0000 7fb6ad4b6700 1 -- 172.21.15.146:0/3539794447 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69800b860 con 0x7fb6a80cb140 2023-10-06T11:18:19.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.806+0000 7fb6ad4b6700 1 -- 172.21.15.146:0/3539794447 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb69800b9c0 con 0x7fb6a80cb140 2023-10-06T11:18:19.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.806+0000 7fb6ad4b6700 1 -- 172.21.15.146:0/3539794447 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb69800bd60 con 0x7fb6a80cb140 2023-10-06T11:18:19.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.806+0000 7fb6b071c700 1 -- 172.21.15.146:0/3539794447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6a80cb140 msgr2=0x7fb6a8154a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:19.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.806+0000 7fb6b071c700 1 --2- 172.21.15.146:0/3539794447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6a80cb140 0x7fb6a8154a80 secure :-1 s=READY pgs=2067 cs=0 l=1 rev1=1 crypto rx=0x7fb6a80c9e20 tx=0x7fb698009250 comp rx=0 tx=0).stop 2023-10-06T11:18:19.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.807+0000 7fb6b071c700 1 -- 172.21.15.146:0/3539794447 shutdown_connections 2023-10-06T11:18:19.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.807+0000 7fb6b071c700 1 --2- 172.21.15.146:0/3539794447 >> v2:172.21.15.151:3300/0 conn(0x7fb6a8068030 0x7fb6a8154fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:19.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.807+0000 7fb6b071c700 1 --2- 172.21.15.146:0/3539794447 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6a80b25f0 0x7fb6a8067af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:19.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.807+0000 7fb6b071c700 1 --2- 172.21.15.146:0/3539794447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6a80cb140 0x7fb6a8154a80 unknown :-1 s=CLOSED pgs=2067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:19.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.807+0000 7fb6b071c700 1 -- 172.21.15.146:0/3539794447 >> 172.21.15.146:0/3539794447 conn(0x7fb6a80684f0 msgr2=0x7fb6a80688f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:19.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.807+0000 7fb6b071c700 1 -- 172.21.15.146:0/3539794447 shutdown_connections 2023-10-06T11:18:19.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.807+0000 7fb6b071c700 1 -- 172.21.15.146:0/3539794447 wait complete. 2023-10-06T11:18:19.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.808+0000 7fb6b071c700 1 Processor -- start 2023-10-06T11:18:19.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.808+0000 7fb6b071c700 1 -- start start 2023-10-06T11:18:19.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.808+0000 7fb6b071c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6a8068030 0x7fb6a816dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:19.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.808+0000 7fb6b071c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6a80b25f0 0x7fb6a80c8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:19.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.808+0000 7fb6b071c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6a80cb140 0x7fb6a80c65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:19.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.808+0000 7fb6b071c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a80c9090 con 0x7fb6a80b25f0 2023-10-06T11:18:19.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.808+0000 7fb6b071c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a80b03a0 con 0x7fb6a8068030 2023-10-06T11:18:19.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.808+0000 7fb6b071c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6a80c8550 con 0x7fb6a80cb140 2023-10-06T11:18:19.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.808+0000 7fb6adcb7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6a80b25f0 0x7fb6a80c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:19.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.809+0000 7fb6adcb7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6a80b25f0 0x7fb6a80c8010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40772/0 (socket says 172.21.15.146:40772) 2023-10-06T11:18:19.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.809+0000 7fb6adcb7700 1 -- 172.21.15.146:0/23303335 learned_addr learned my addr 172.21.15.146:0/23303335 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:19.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.809+0000 7fb6ae4b8700 1 --2- 172.21.15.146:0/23303335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6a8068030 0x7fb6a816dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:19.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.809+0000 7fb6aecb9700 1 --2- 172.21.15.146:0/23303335 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6a80cb140 0x7fb6a80c65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:19.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.809+0000 7fb6adcb7700 1 -- 172.21.15.146:0/23303335 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6a80cb140 msgr2=0x7fb6a80c65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:19.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.809+0000 7fb6adcb7700 1 --2- 172.21.15.146:0/23303335 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6a80cb140 0x7fb6a80c65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:19.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.809+0000 7fb6adcb7700 1 -- 172.21.15.146:0/23303335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6a8068030 msgr2=0x7fb6a816dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:19.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.809+0000 7fb6adcb7700 1 --2- 172.21.15.146:0/23303335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6a8068030 0x7fb6a816dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:19.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.809+0000 7fb6adcb7700 1 -- 172.21.15.146:0/23303335 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6980094f0 con 0x7fb6a80b25f0 2023-10-06T11:18:19.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.809+0000 7fb6aecb9700 1 --2- 172.21.15.146:0/23303335 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6a80cb140 0x7fb6a80c65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:18:19.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.809+0000 7fb6adcb7700 1 --2- 172.21.15.146:0/23303335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6a80b25f0 0x7fb6a80c8010 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7fb6980090b0 tx=0x7fb698017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:19.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.809+0000 7fb69e7fc700 1 -- 172.21.15.146:0/23303335 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb698024440 con 0x7fb6a80b25f0 2023-10-06T11:18:19.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.809+0000 7fb69e7fc700 1 -- 172.21.15.146:0/23303335 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6980245e0 con 0x7fb6a80b25f0 2023-10-06T11:18:19.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.809+0000 7fb6b071c700 1 -- 172.21.15.146:0/23303335 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6a80c87f0 con 0x7fb6a80b25f0 2023-10-06T11:18:19.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.809+0000 7fb69e7fc700 1 -- 172.21.15.146:0/23303335 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6980249a0 con 0x7fb6a80b25f0 2023-10-06T11:18:19.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.809+0000 7fb6b071c700 1 -- 172.21.15.146:0/23303335 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6a80c8db0 con 0x7fb6a80b25f0 2023-10-06T11:18:19.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.810+0000 7fb6b071c700 1 -- 172.21.15.146:0/23303335 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6a80b0530 con 0x7fb6a80b25f0 2023-10-06T11:18:19.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.810+0000 7fb69e7fc700 1 -- 172.21.15.146:0/23303335 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb69801a420 con 0x7fb6a80b25f0 2023-10-06T11:18:19.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.811+0000 7fb69e7fc700 1 --2- 172.21.15.146:0/23303335 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb68c066f30 0x7fb68c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:19.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.811+0000 7fb69e7fc700 1 -- 172.21.15.146:0/23303335 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fb698086050 con 0x7fb6a80b25f0 2023-10-06T11:18:19.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.811+0000 7fb6ae4b8700 1 --2- 172.21.15.146:0/23303335 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb68c066f30 0x7fb68c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:19.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.811+0000 7fb6ae4b8700 1 --2- 172.21.15.146:0/23303335 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb68c066f30 0x7fb68c0693e0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4006fd0 tx=0x7fb6a4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:19.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:19.815+0000 7fb69e7fc700 1 -- 172.21.15.146:0/23303335 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb698053460 con 0x7fb6a80b25f0 2023-10-06T11:18:20.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.015+0000 7fb6b071c700 1 -- 172.21.15.146:0/23303335 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fb6a804c380 con 0x7fb6a80b25f0 2023-10-06T11:18:20.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.850+0000 7fb69e7fc700 1 -- 172.21.15.146:0/23303335 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v159) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb698056a80 con 0x7fb6a80b25f0 2023-10-06T11:18:20.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.853+0000 7fb6b071c700 1 -- 172.21.15.146:0/23303335 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb68c066f30 msgr2=0x7fb68c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:20.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.853+0000 7fb6b071c700 1 --2- 172.21.15.146:0/23303335 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb68c066f30 0x7fb68c0693e0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4006fd0 tx=0x7fb6a4008040 comp rx=0 tx=0).stop 2023-10-06T11:18:20.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.853+0000 7fb6b071c700 1 -- 172.21.15.146:0/23303335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6a80b25f0 msgr2=0x7fb6a80c8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:20.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.853+0000 7fb6b071c700 1 --2- 172.21.15.146:0/23303335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6a80b25f0 0x7fb6a80c8010 secure :-1 s=READY pgs=2068 cs=0 l=1 rev1=1 crypto rx=0x7fb6980090b0 tx=0x7fb698017000 comp rx=0 tx=0).stop 2023-10-06T11:18:20.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.853+0000 7fb6b071c700 1 -- 172.21.15.146:0/23303335 shutdown_connections 2023-10-06T11:18:20.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.853+0000 7fb6b071c700 1 --2- 172.21.15.146:0/23303335 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb68c066f30 0x7fb68c0693e0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:20.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.853+0000 7fb6b071c700 1 --2- 172.21.15.146:0/23303335 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6a80cb140 0x7fb6a80c65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:20.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.853+0000 7fb6b071c700 1 --2- 172.21.15.146:0/23303335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6a8068030 0x7fb6a816dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:20.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.853+0000 7fb6b071c700 1 --2- 172.21.15.146:0/23303335 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6a80b25f0 0x7fb6a80c8010 unknown :-1 s=CLOSED pgs=2068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:20.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.853+0000 7fb6b071c700 1 -- 172.21.15.146:0/23303335 >> 172.21.15.146:0/23303335 conn(0x7fb6a80684f0 msgr2=0x7fb6a815a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:20.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.853+0000 7fb6b071c700 1 -- 172.21.15.146:0/23303335 shutdown_connections 2023-10-06T11:18:20.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.853+0000 7fb6b071c700 1 -- 172.21.15.146:0/23303335 wait complete. 2023-10-06T11:18:20.857 INFO:teuthology.orchestra.run.smithi146.stderr: removed all blocklist entries 2023-10-06T11:18:20.868 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T11:18:20.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.981+0000 7f43f313f700 1 Processor -- start 2023-10-06T11:18:20.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.981+0000 7f43f313f700 1 -- start start 2023-10-06T11:18:20.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.982+0000 7f43f313f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f43ec06b920 0x7f43ec06bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:20.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.982+0000 7f43f313f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43ec15ae10 con 0x7f43ec159ea0 2023-10-06T11:18:20.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.982+0000 7f43f313f700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43ec15a850 con 0x7f43ec0ca990 2023-10-06T11:18:20.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.982+0000 7f43f313f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43ec15ab30 con 0x7f43ec06b920 2023-10-06T11:18:20.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.982+0000 7f43f0edb700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f43ec06b920 0x7f43ec06bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:20.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.982+0000 7f43f16dc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f43ec159ea0 0x7f43ec0cc460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:33892/0 (socket says 172.21.15.146:33892) 2023-10-06T11:18:20.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.982+0000 7f43f16dc700 1 -- 172.21.15.146:0/127058568 learned_addr learned my addr 172.21.15.146:0/127058568 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:20.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.983+0000 7f43f0edb700 1 -- 172.21.15.146:0/127058568 >> v1:172.21.15.151:6789/0 conn(0x7f43ec0ca990 legacy=0x7f43ec15de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:20.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.983+0000 7f43f0edb700 1 -- 172.21.15.146:0/127058568 >> v1:172.21.15.146:6789/0 conn(0x7f43ec159ea0 legacy=0x7f43ec0cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:20.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.983+0000 7f43f0edb700 1 -- 172.21.15.146:0/127058568 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ec15d610 con 0x7f43ec06b920 2023-10-06T11:18:20.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.983+0000 7f43eb7fe700 1 -- 172.21.15.146:0/127058568 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 58168982 0 0) 0x7f43ec15ae10 con 0x7f43ec159ea0 2023-10-06T11:18:20.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.983+0000 7f43f0edb700 1 --2- 172.21.15.146:0/127058568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43ec06b920 0x7f43ec06bcf0 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7f43dc009e60 tx=0x7f43dc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c985068352d16b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:20.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.983+0000 7f43eb7fe700 1 -- 172.21.15.146:0/127058568 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc00e070 con 0x7f43ec06b920 2023-10-06T11:18:20.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.983+0000 7f43eb7fe700 1 -- 172.21.15.146:0/127058568 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43dc00bc30 con 0x7f43ec06b920 2023-10-06T11:18:20.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.983+0000 7f43eb7fe700 1 -- 172.21.15.146:0/127058568 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc012430 con 0x7f43ec06b920 2023-10-06T11:18:20.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.984+0000 7f43f313f700 1 -- 172.21.15.146:0/127058568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43ec06b920 msgr2=0x7f43ec06bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:20.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.984+0000 7f43f313f700 1 --2- 172.21.15.146:0/127058568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43ec06b920 0x7f43ec06bcf0 secure :-1 s=READY pgs=2070 cs=0 l=1 rev1=1 crypto rx=0x7f43dc009e60 tx=0x7f43dc009780 comp rx=0 tx=0).stop 2023-10-06T11:18:20.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.984+0000 7f43f313f700 1 -- 172.21.15.146:0/127058568 shutdown_connections 2023-10-06T11:18:20.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.984+0000 7f43f313f700 1 --2- 172.21.15.146:0/127058568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43ec06b920 0x7f43ec06bcf0 unknown :-1 s=CLOSED pgs=2070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:20.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.984+0000 7f43f313f700 1 -- 172.21.15.146:0/127058568 >> 172.21.15.146:0/127058568 conn(0x7f43ec067eb0 msgr2=0x7f43ec0ce450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:20.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.984+0000 7f43f313f700 1 -- 172.21.15.146:0/127058568 shutdown_connections 2023-10-06T11:18:20.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.984+0000 7f43f313f700 1 -- 172.21.15.146:0/127058568 wait complete. 2023-10-06T11:18:20.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.985+0000 7f43f313f700 1 Processor -- start 2023-10-06T11:18:20.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.985+0000 7f43f313f700 1 -- start start 2023-10-06T11:18:20.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.986+0000 7f43f313f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43ec06b920 0x7f43ec15b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:20.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.986+0000 7f43f313f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43ec0ca990 0x7f43ec1529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:20.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.986+0000 7f43f313f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43ec159ea0 0x7f43ec1570d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:20.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.986+0000 7f43f313f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec157610 con 0x7f43ec0ca990 2023-10-06T11:18:20.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.986+0000 7f43f313f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec15b6a0 con 0x7f43ec06b920 2023-10-06T11:18:20.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.986+0000 7f43f313f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43ec15b980 con 0x7f43ec159ea0 2023-10-06T11:18:20.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.986+0000 7f43ebfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43ec0ca990 0x7f43ec1529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:20.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.986+0000 7f43ebfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43ec0ca990 0x7f43ec1529b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40786/0 (socket says 172.21.15.146:40786) 2023-10-06T11:18:20.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.986+0000 7f43ebfff700 1 -- 172.21.15.146:0/3152508388 learned_addr learned my addr 172.21.15.146:0/3152508388 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:20.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.986+0000 7f43f0edb700 1 --2- 172.21.15.146:0/3152508388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43ec06b920 0x7f43ec15b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:20.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.986+0000 7f43f16dc700 1 --2- 172.21.15.146:0/3152508388 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43ec159ea0 0x7f43ec1570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:20.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.986+0000 7f43ebfff700 1 -- 172.21.15.146:0/3152508388 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43ec159ea0 msgr2=0x7f43ec1570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:20.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.986+0000 7f43ebfff700 1 --2- 172.21.15.146:0/3152508388 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43ec159ea0 0x7f43ec1570d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:20.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.986+0000 7f43ebfff700 1 -- 172.21.15.146:0/3152508388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43ec06b920 msgr2=0x7f43ec15b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:20.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.986+0000 7f43ebfff700 1 --2- 172.21.15.146:0/3152508388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43ec06b920 0x7f43ec15b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:20.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.986+0000 7f43ebfff700 1 -- 172.21.15.146:0/3152508388 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43dc009a20 con 0x7f43ec0ca990 2023-10-06T11:18:20.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.986+0000 7f43ebfff700 1 --2- 172.21.15.146:0/3152508388 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43ec0ca990 0x7f43ec1529b0 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 crypto rx=0x7f43d400c790 tx=0x7f43d4007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:20.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.986+0000 7f43e8ff9700 1 -- 172.21.15.146:0/3152508388 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d4011590 con 0x7f43ec0ca990 2023-10-06T11:18:20.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.986+0000 7f43e8ff9700 1 -- 172.21.15.146:0/3152508388 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d40116f0 con 0x7f43ec0ca990 2023-10-06T11:18:20.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.986+0000 7f43f313f700 1 -- 172.21.15.146:0/3152508388 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43ec15bc60 con 0x7f43ec0ca990 2023-10-06T11:18:20.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.986+0000 7f43e8ff9700 1 -- 172.21.15.146:0/3152508388 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d4011ab0 con 0x7f43ec0ca990 2023-10-06T11:18:20.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.986+0000 7f43f313f700 1 -- 172.21.15.146:0/3152508388 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43ec150c30 con 0x7f43ec0ca990 2023-10-06T11:18:20.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.987+0000 7f43f313f700 1 -- 172.21.15.146:0/3152508388 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43ec04c380 con 0x7f43ec0ca990 2023-10-06T11:18:20.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.988+0000 7f43e8ff9700 1 -- 172.21.15.146:0/3152508388 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f43d401b3b0 con 0x7f43ec0ca990 2023-10-06T11:18:20.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.988+0000 7f43e8ff9700 1 --2- 172.21.15.146:0/3152508388 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f43cc066f30 0x7f43cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:20.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.988+0000 7f43e8ff9700 1 -- 172.21.15.146:0/3152508388 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f43d4083790 con 0x7f43ec0ca990 2023-10-06T11:18:20.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.988+0000 7f43f0edb700 1 --2- 172.21.15.146:0/3152508388 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f43cc066f30 0x7f43cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:20.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.988+0000 7f43f0edb700 1 --2- 172.21.15.146:0/3152508388 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f43cc066f30 0x7f43cc0693e0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f43dc009e60 tx=0x7f43dc019000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:20.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:20.992+0000 7f43e8ff9700 1 -- 172.21.15.146:0/3152508388 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f43d4050bf0 con 0x7f43ec0ca990 2023-10-06T11:18:21.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.251+0000 7f43f313f700 1 -- 172.21.15.146:0/3152508388 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f43ec15d8f0 con 0x7f43ec0ca990 2023-10-06T11:18:21.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.251+0000 7f43e8ff9700 1 -- 172.21.15.146:0/3152508388 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v24) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f43d4017020 con 0x7f43ec0ca990 2023-10-06T11:18:21.253 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:18:21.254 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:18:21.254 INFO:teuthology.orchestra.run.smithi146.stdout: "auth_dump": [ 2023-10-06T11:18:21.254 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:18:21.254 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.a", 2023-10-06T11:18:21.254 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lG4F8DBAAp5A4Dtfzvv8n9ORgkmiP9g==", 2023-10-06T11:18:21.254 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:18:21.254 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:18:21.255 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:18:21.255 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:18:21.255 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:18:21.255 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:18:21.255 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:18:21.255 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:18:21.255 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.b", 2023-10-06T11:18:21.255 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lDIceGBAA4cr0oGVaXiy5hrruKY5DGw==", 2023-10-06T11:18:21.255 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:18:21.256 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:18:21.256 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:18:21.256 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:18:21.256 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:18:21.256 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:18:21.256 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:18:21.256 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:18:21.257 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.c", 2023-10-06T11:18:21.257 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lbYA7ExAAAopKjS7+WMUE5fuVQygILQ==", 2023-10-06T11:18:21.257 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:18:21.257 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:18:21.257 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:18:21.257 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:18:21.257 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:18:21.257 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:18:21.257 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:18:21.257 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:18:21.257 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.d", 2023-10-06T11:18:21.258 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9laygiHxAAasUUn7Wk9EwLa36ggsZtHw==", 2023-10-06T11:18:21.258 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:18:21.258 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:18:21.258 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:18:21.258 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:18:21.258 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:18:21.258 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:18:21.258 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:18:21.259 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:18:21.259 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.0", 2023-10-06T11:18:21.259 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDX6R9lLGo9NhAAcWJuUeOdEUsdDw84W9nLPw==", 2023-10-06T11:18:21.259 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:18:21.259 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:18:21.259 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:18:21.259 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:18:21.259 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:18:21.259 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:18:21.259 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:18:21.260 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.1", 2023-10-06T11:18:21.260 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDa6R9lk02gNBAA9YqWT2/Xds20lv0sGtBApg==", 2023-10-06T11:18:21.260 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:18:21.260 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:18:21.260 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:18:21.260 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:18:21.260 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:18:21.260 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:18:21.260 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:18:21.261 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.2", 2023-10-06T11:18:21.261 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDd6R9lrA6xMxAAmH8r6m2p4Jpa82xfYNcq+g==", 2023-10-06T11:18:21.261 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:18:21.261 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:18:21.261 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:18:21.261 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:18:21.261 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:18:21.261 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:18:21.261 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:18:21.262 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.3", 2023-10-06T11:18:21.262 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDg6R9ltlHXNBAAvhfI1yjlaWCIE9Xr/4F/PA==", 2023-10-06T11:18:21.262 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:18:21.262 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:18:21.262 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:18:21.262 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:18:21.262 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:18:21.262 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:18:21.262 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:18:21.262 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.4", 2023-10-06T11:18:21.263 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDm6R9lPUCvMhAAGbUNfpoFi9SvYdelpnL1jA==", 2023-10-06T11:18:21.263 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:18:21.263 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:18:21.263 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:18:21.263 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:18:21.263 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:18:21.263 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:18:21.263 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:18:21.263 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.5", 2023-10-06T11:18:21.264 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDp6R9lMfrMMBAAUEtnXDNr7+L3dQm4QE9qDw==", 2023-10-06T11:18:21.264 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:18:21.264 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:18:21.264 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:18:21.264 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:18:21.264 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:18:21.265 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:18:21.265 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:18:21.265 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.6", 2023-10-06T11:18:21.265 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDs6R9lAmSDMBAArPp+6dVt/NyH9is46tL49g==", 2023-10-06T11:18:21.265 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:18:21.265 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:18:21.266 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:18:21.266 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:18:21.266 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:18:21.266 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:18:21.266 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:18:21.267 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.7", 2023-10-06T11:18:21.267 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDv6R9lnunMLRAA3o5ZtAyYDUoXTzjX9H8FCw==", 2023-10-06T11:18:21.267 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:18:21.267 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:18:21.267 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:18:21.267 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:18:21.268 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:18:21.268 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:18:21.268 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:18:21.268 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.0", 2023-10-06T11:18:21.268 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lCrPrIhAARrzj2VxVFkzF5L/ifIAqmw==", 2023-10-06T11:18:21.268 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:18:21.269 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:18:21.269 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow r", 2023-10-06T11:18:21.269 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T11:18:21.269 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:18:21.270 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:18:21.270 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:18:21.270 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.1", 2023-10-06T11:18:21.270 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9l10VSKxAA0HmXejgRRCQ7XpsMB7ljkQ==", 2023-10-06T11:18:21.270 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:18:21.270 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:18:21.271 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2023-10-06T11:18:21.271 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2023-10-06T11:18:21.271 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2023-10-06T11:18:21.271 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:18:21.271 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:18:21.271 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:18:21.272 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.2", 2023-10-06T11:18:21.272 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lpLpJKBAAF/vLDkBg9/VBqMK4pVVIkg==", 2023-10-06T11:18:21.272 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:18:21.272 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:18:21.272 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2023-10-06T11:18:21.273 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2023-10-06T11:18:21.273 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2023-10-06T11:18:21.273 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:18:21.273 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:18:21.273 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:18:21.273 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.3", 2023-10-06T11:18:21.274 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9luMqwMBAA4Y4I9hWTk2IqAzYwVQ13Pw==", 2023-10-06T11:18:21.274 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:18:21.274 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:18:21.274 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2023-10-06T11:18:21.274 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2023-10-06T11:18:21.274 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2023-10-06T11:18:21.275 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:18:21.275 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:18:21.275 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:18:21.275 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.admin", 2023-10-06T11:18:21.275 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDT6R9lSr9qIhAAiNEN9xFWUwFGsB+oUE1cXw==", 2023-10-06T11:18:21.275 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:18:21.276 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2023-10-06T11:18:21.276 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:18:21.276 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:18:21.276 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:18:21.276 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:18:21.276 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:18:21.277 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:18:21.277 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.x", 2023-10-06T11:18:21.277 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9llLpwCRAA4UH9Uqli2de9HIJR2fZ9xg==", 2023-10-06T11:18:21.277 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:18:21.277 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2023-10-06T11:18:21.277 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2023-10-06T11:18:21.278 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:18:21.278 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:18:21.278 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:18:21.278 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:18:21.278 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.y", 2023-10-06T11:18:21.279 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDT6R9l2uQxNxAAVSMhKVzbf2vC4opL7YCLdg==", 2023-10-06T11:18:21.279 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:18:21.279 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2023-10-06T11:18:21.279 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2023-10-06T11:18:21.279 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:18:21.279 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:18:21.280 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:18:21.280 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2023-10-06T11:18:21.280 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:18:21.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.254+0000 7f43f313f700 1 -- 172.21.15.146:0/3152508388 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f43cc066f30 msgr2=0x7f43cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:21.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.254+0000 7f43f313f700 1 --2- 172.21.15.146:0/3152508388 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f43cc066f30 0x7f43cc0693e0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f43dc009e60 tx=0x7f43dc019000 comp rx=0 tx=0).stop 2023-10-06T11:18:21.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.254+0000 7f43f313f700 1 -- 172.21.15.146:0/3152508388 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43ec0ca990 msgr2=0x7f43ec1529b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:21.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.254+0000 7f43f313f700 1 --2- 172.21.15.146:0/3152508388 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43ec0ca990 0x7f43ec1529b0 secure :-1 s=READY pgs=2071 cs=0 l=1 rev1=1 crypto rx=0x7f43d400c790 tx=0x7f43d4007f40 comp rx=0 tx=0).stop 2023-10-06T11:18:21.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.254+0000 7f43f313f700 1 -- 172.21.15.146:0/3152508388 shutdown_connections 2023-10-06T11:18:21.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.254+0000 7f43f313f700 1 --2- 172.21.15.146:0/3152508388 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f43cc066f30 0x7f43cc0693e0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:21.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.254+0000 7f43f313f700 1 --2- 172.21.15.146:0/3152508388 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f43ec159ea0 0x7f43ec1570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:21.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.254+0000 7f43f313f700 1 --2- 172.21.15.146:0/3152508388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43ec06b920 0x7f43ec15b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:21.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.254+0000 7f43f313f700 1 --2- 172.21.15.146:0/3152508388 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f43ec0ca990 0x7f43ec1529b0 unknown :-1 s=CLOSED pgs=2071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:21.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.254+0000 7f43f313f700 1 -- 172.21.15.146:0/3152508388 >> 172.21.15.146:0/3152508388 conn(0x7f43ec067eb0 msgr2=0x7f43ec15dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:21.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.254+0000 7f43f313f700 1 -- 172.21.15.146:0/3152508388 shutdown_connections 2023-10-06T11:18:21.285 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.254+0000 7f43f313f700 1 -- 172.21.15.146:0/3152508388 wait complete. 2023-10-06T11:18:21.286 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:18:21.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.400+0000 7fd29deb6700 1 Processor -- start 2023-10-06T11:18:21.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.400+0000 7fd29deb6700 1 -- start start 2023-10-06T11:18:21.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.400+0000 7fd29deb6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd29815a940 0x7fd298153c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:21.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.400+0000 7fd29deb6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd29815dcc0 0x7fd2980ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:21.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.400+0000 7fd29deb6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd29815e140 con 0x7fd2981538c0 2023-10-06T11:18:21.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.400+0000 7fd29deb6700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd29815d270 con 0x7fd29815dcc0 2023-10-06T11:18:21.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.400+0000 7fd29deb6700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd29815d830 con 0x7fd29815a940 2023-10-06T11:18:21.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.401+0000 7fd297fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd29815dcc0 0x7fd2980ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:21.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.401+0000 7fd2977fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd2981538c0 0x7fd2980cac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55284/0 (socket says 172.21.15.146:55284) 2023-10-06T11:18:21.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.401+0000 7fd2977fe700 1 -- 172.21.15.146:0/3116430799 learned_addr learned my addr 172.21.15.146:0/3116430799 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:21.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.401+0000 7fd28effd700 1 --2- 172.21.15.146:0/3116430799 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd29815a940 0x7fd298153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:21.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.401+0000 7fd297fff700 1 -- 172.21.15.146:0/3116430799 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd29815a940 msgr2=0x7fd298153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:21.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.401+0000 7fd297fff700 1 --2- 172.21.15.146:0/3116430799 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd29815a940 0x7fd298153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:21.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.401+0000 7fd297fff700 1 -- 172.21.15.146:0/3116430799 >> v1:172.21.15.146:6789/0 conn(0x7fd2981538c0 legacy=0x7fd2980cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:21.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.401+0000 7fd297fff700 1 -- 172.21.15.146:0/3116430799 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2980cb810 con 0x7fd29815dcc0 2023-10-06T11:18:21.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.401+0000 7fd296ffd700 1 -- 172.21.15.146:0/3116430799 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1772697508 0 0) 0x7fd288001110 con 0x7fd2981538c0 2023-10-06T11:18:21.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.401+0000 7fd297fff700 1 --2- 172.21.15.146:0/3116430799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd29815dcc0 0x7fd2980ce610 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 crypto rx=0x7fd290009e60 tx=0x7fd290009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd712fe0ae3ac98d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:21.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.401+0000 7fd296ffd700 1 -- 172.21.15.146:0/3116430799 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29000e070 con 0x7fd29815dcc0 2023-10-06T11:18:21.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.401+0000 7fd296ffd700 1 -- 172.21.15.146:0/3116430799 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd29000bc30 con 0x7fd29815dcc0 2023-10-06T11:18:21.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.401+0000 7fd296ffd700 1 -- 172.21.15.146:0/3116430799 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd290012430 con 0x7fd29815dcc0 2023-10-06T11:18:21.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.402+0000 7fd29deb6700 1 -- 172.21.15.146:0/3116430799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd29815dcc0 msgr2=0x7fd2980ce610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:21.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.402+0000 7fd29deb6700 1 --2- 172.21.15.146:0/3116430799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd29815dcc0 0x7fd2980ce610 secure :-1 s=READY pgs=2073 cs=0 l=1 rev1=1 crypto rx=0x7fd290009e60 tx=0x7fd290009780 comp rx=0 tx=0).stop 2023-10-06T11:18:21.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.402+0000 7fd29deb6700 1 -- 172.21.15.146:0/3116430799 shutdown_connections 2023-10-06T11:18:21.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.402+0000 7fd29deb6700 1 --2- 172.21.15.146:0/3116430799 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd29815dcc0 0x7fd2980ce610 unknown :-1 s=CLOSED pgs=2073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:21.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.402+0000 7fd29deb6700 1 --2- 172.21.15.146:0/3116430799 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd29815a940 0x7fd298153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:21.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.402+0000 7fd29deb6700 1 -- 172.21.15.146:0/3116430799 >> 172.21.15.146:0/3116430799 conn(0x7fd29806eb10 msgr2=0x7fd29806ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:21.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.402+0000 7fd29deb6700 1 -- 172.21.15.146:0/3116430799 shutdown_connections 2023-10-06T11:18:21.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.402+0000 7fd29deb6700 1 -- 172.21.15.146:0/3116430799 wait complete. 2023-10-06T11:18:21.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.403+0000 7fd29deb6700 1 Processor -- start 2023-10-06T11:18:21.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.403+0000 7fd29deb6700 1 -- start start 2023-10-06T11:18:21.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.404+0000 7fd29deb6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2981538c0 0x7fd29814e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:21.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.404+0000 7fd29deb6700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd29815a940 0x7fd29814d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:21.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.404+0000 7fd29deb6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd29815dcc0 0x7fd2980b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:21.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.404+0000 7fd29deb6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd29814d670 con 0x7fd29815dcc0 2023-10-06T11:18:21.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.404+0000 7fd29deb6700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd29814d900 con 0x7fd29815a940 2023-10-06T11:18:21.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.404+0000 7fd29deb6700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd29814e1a0 con 0x7fd2981538c0 2023-10-06T11:18:21.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.404+0000 7fd297fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd29815dcc0 0x7fd2980b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:21.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.404+0000 7fd297fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd29815dcc0 0x7fd2980b1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56760/0 (socket says 172.21.15.146:56760) 2023-10-06T11:18:21.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.404+0000 7fd297fff700 1 -- 172.21.15.146:0/4197253671 learned_addr learned my addr 172.21.15.146:0/4197253671 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:21.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.404+0000 7fd2977fe700 1 --2- 172.21.15.146:0/4197253671 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2981538c0 0x7fd29814e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:21.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.404+0000 7fd28effd700 1 --2- 172.21.15.146:0/4197253671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd29815a940 0x7fd29814d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:21.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.404+0000 7fd297fff700 1 -- 172.21.15.146:0/4197253671 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2981538c0 msgr2=0x7fd29814e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:21.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.404+0000 7fd297fff700 1 --2- 172.21.15.146:0/4197253671 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2981538c0 0x7fd29814e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:21.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.404+0000 7fd297fff700 1 -- 172.21.15.146:0/4197253671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd29815a940 msgr2=0x7fd29814d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:21.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.404+0000 7fd297fff700 1 --2- 172.21.15.146:0/4197253671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd29815a940 0x7fd29814d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:21.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.404+0000 7fd297fff700 1 -- 172.21.15.146:0/4197253671 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd290009a20 con 0x7fd29815dcc0 2023-10-06T11:18:21.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.404+0000 7fd28effd700 1 --2- 172.21.15.146:0/4197253671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd29815a940 0x7fd29814d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:18:21.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.404+0000 7fd2977fe700 1 --2- 172.21.15.146:0/4197253671 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2981538c0 0x7fd29814e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:18:21.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.404+0000 7fd297fff700 1 --2- 172.21.15.146:0/4197253671 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd29815dcc0 0x7fd2980b1af0 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7fd2980c7450 tx=0x7fd290019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:21.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.404+0000 7fd28ffff700 1 -- 172.21.15.146:0/4197253671 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd290012e10 con 0x7fd29815dcc0 2023-10-06T11:18:21.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.404+0000 7fd28ffff700 1 -- 172.21.15.146:0/4197253671 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd29001d630 con 0x7fd29815dcc0 2023-10-06T11:18:21.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.404+0000 7fd29deb6700 1 -- 172.21.15.146:0/4197253671 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2980b24b0 con 0x7fd29815dcc0 2023-10-06T11:18:21.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.404+0000 7fd28ffff700 1 -- 172.21.15.146:0/4197253671 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29001d9f0 con 0x7fd29815dcc0 2023-10-06T11:18:21.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.404+0000 7fd29deb6700 1 -- 172.21.15.146:0/4197253671 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd29814deb0 con 0x7fd29815dcc0 2023-10-06T11:18:21.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.405+0000 7fd29deb6700 1 -- 172.21.15.146:0/4197253671 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd29804c380 con 0x7fd29815dcc0 2023-10-06T11:18:21.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.406+0000 7fd28ffff700 1 -- 172.21.15.146:0/4197253671 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd290024070 con 0x7fd29815dcc0 2023-10-06T11:18:21.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.406+0000 7fd28ffff700 1 --2- 172.21.15.146:0/4197253671 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd278066f30 0x7fd2780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:21.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.406+0000 7fd28ffff700 1 -- 172.21.15.146:0/4197253671 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fd290086b40 con 0x7fd29815dcc0 2023-10-06T11:18:21.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.406+0000 7fd2977fe700 1 --2- 172.21.15.146:0/4197253671 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd278066f30 0x7fd2780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:21.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.407+0000 7fd2977fe700 1 --2- 172.21.15.146:0/4197253671 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd278066f30 0x7fd2780693e0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fd288001810 tx=0x7fd288009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:21.415 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.410+0000 7fd28ffff700 1 -- 172.21.15.146:0/4197253671 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd290053fa0 con 0x7fd29815dcc0 2023-10-06T11:18:21.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.592+0000 7fd29deb6700 1 -- 172.21.15.146:0/4197253671 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd29814e2e0 con 0x7fd29815dcc0 2023-10-06T11:18:21.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.593+0000 7fd28ffff700 1 -- 172.21.15.146:0/4197253671 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) v1 ==== 74+0+13708 (secure 0 0 0) 0x7fd2900575c0 con 0x7fd29815dcc0 2023-10-06T11:18:21.595 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:18:21.595 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":159,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:18:20.849409+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:18:21.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.595+0000 7fd29deb6700 1 -- 172.21.15.146:0/4197253671 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd278066f30 msgr2=0x7fd2780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:21.597 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.595+0000 7fd29deb6700 1 --2- 172.21.15.146:0/4197253671 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd278066f30 0x7fd2780693e0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fd288001810 tx=0x7fd288009040 comp rx=0 tx=0).stop 2023-10-06T11:18:21.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.595+0000 7fd29deb6700 1 -- 172.21.15.146:0/4197253671 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd29815dcc0 msgr2=0x7fd2980b1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:21.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.595+0000 7fd29deb6700 1 --2- 172.21.15.146:0/4197253671 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd29815dcc0 0x7fd2980b1af0 secure :-1 s=READY pgs=2074 cs=0 l=1 rev1=1 crypto rx=0x7fd2980c7450 tx=0x7fd290019000 comp rx=0 tx=0).stop 2023-10-06T11:18:21.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.595+0000 7fd29deb6700 1 -- 172.21.15.146:0/4197253671 shutdown_connections 2023-10-06T11:18:21.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.595+0000 7fd29deb6700 1 --2- 172.21.15.146:0/4197253671 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd278066f30 0x7fd2780693e0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:21.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.595+0000 7fd29deb6700 1 --2- 172.21.15.146:0/4197253671 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd29815dcc0 0x7fd2980b1af0 unknown :-1 s=CLOSED pgs=2074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:21.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.595+0000 7fd29deb6700 1 --2- 172.21.15.146:0/4197253671 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2981538c0 0x7fd29814e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:21.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.595+0000 7fd29deb6700 1 --2- 172.21.15.146:0/4197253671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd29815a940 0x7fd29814d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:21.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.595+0000 7fd29deb6700 1 -- 172.21.15.146:0/4197253671 >> 172.21.15.146:0/4197253671 conn(0x7fd29806eb10 msgr2=0x7fd29806eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:21.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.595+0000 7fd29deb6700 1 -- 172.21.15.146:0/4197253671 shutdown_connections 2023-10-06T11:18:21.598 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.595+0000 7fd29deb6700 1 -- 172.21.15.146:0/4197253671 wait complete. 2023-10-06T11:18:21.609 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:05:36.687307+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:05:37.171199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T11:18:21.610 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:18:21.666 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:18:21.668 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:18:21.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.730+0000 7f5470945700 1 Processor -- start 2023-10-06T11:18:21.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.730+0000 7f5470945700 1 -- start start 2023-10-06T11:18:21.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.731+0000 7f5470945700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f546c1574a0 0x7f546c0b07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:21.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.731+0000 7f5470945700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f546c0adcf0 0x7f546c0ae140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:21.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.731+0000 7f5470945700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f546c0b0320 con 0x7f546c157870 2023-10-06T11:18:21.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.731+0000 7f5470945700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f546c0afd40 con 0x7f546c0adcf0 2023-10-06T11:18:21.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.731+0000 7f5470945700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f546c0ae680 con 0x7f546c1574a0 2023-10-06T11:18:21.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.731+0000 7f5461d9b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f546c157870 0x7f546c15b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55290/0 (socket says 172.21.15.146:55290) 2023-10-06T11:18:21.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.731+0000 7f5461d9b700 1 -- 172.21.15.146:0/3844513192 learned_addr learned my addr 172.21.15.146:0/3844513192 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:21.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.731+0000 7f546ad9d700 1 --2- 172.21.15.146:0/3844513192 >> v2:172.21.15.146:3300/0 conn(0x7f546c0adcf0 0x7f546c0ae140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:21.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.731+0000 7f546a59c700 1 --2- 172.21.15.146:0/3844513192 >> v2:172.21.15.151:3300/0 conn(0x7f546c1574a0 0x7f546c0b07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:21.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.732+0000 7f5469d9b700 1 -- 172.21.15.146:0/3844513192 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 328829353 0 0) 0x7f546c0b0320 con 0x7f546c157870 2023-10-06T11:18:21.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.732+0000 7f5469d9b700 1 -- 172.21.15.146:0/3844513192 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5458003570 con 0x7f546c157870 2023-10-06T11:18:21.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.732+0000 7f546ad9d700 1 -- 172.21.15.146:0/3844513192 >> v2:172.21.15.151:3300/0 conn(0x7f546c1574a0 msgr2=0x7f546c0b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:21.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.732+0000 7f546ad9d700 1 --2- 172.21.15.146:0/3844513192 >> v2:172.21.15.151:3300/0 conn(0x7f546c1574a0 0x7f546c0b07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:21.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.732+0000 7f546ad9d700 1 -- 172.21.15.146:0/3844513192 >> v1:172.21.15.146:6789/0 conn(0x7f546c157870 legacy=0x7f546c15b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:21.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.732+0000 7f546ad9d700 1 -- 172.21.15.146:0/3844513192 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f546c0b3df0 con 0x7f546c0adcf0 2023-10-06T11:18:21.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.732+0000 7f546ad9d700 1 --2- 172.21.15.146:0/3844513192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f546c0adcf0 0x7f546c0ae140 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7f546c06f050 tx=0x7f5464009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d977994010017c0e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:21.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.732+0000 7f5469d9b700 1 -- 172.21.15.146:0/3844513192 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546400e070 con 0x7f546c0adcf0 2023-10-06T11:18:21.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.732+0000 7f5469d9b700 1 -- 172.21.15.146:0/3844513192 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546400bab0 con 0x7f546c0adcf0 2023-10-06T11:18:21.736 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.732+0000 7f5469d9b700 1 -- 172.21.15.146:0/3844513192 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546400be70 con 0x7f546c0adcf0 2023-10-06T11:18:21.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.732+0000 7f5470945700 1 -- 172.21.15.146:0/3844513192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f546c0adcf0 msgr2=0x7f546c0ae140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:21.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.732+0000 7f5470945700 1 --2- 172.21.15.146:0/3844513192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f546c0adcf0 0x7f546c0ae140 secure :-1 s=READY pgs=2076 cs=0 l=1 rev1=1 crypto rx=0x7f546c06f050 tx=0x7f5464009780 comp rx=0 tx=0).stop 2023-10-06T11:18:21.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.732+0000 7f5470945700 1 -- 172.21.15.146:0/3844513192 shutdown_connections 2023-10-06T11:18:21.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.732+0000 7f5470945700 1 --2- 172.21.15.146:0/3844513192 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f546c0adcf0 0x7f546c0ae140 unknown :-1 s=CLOSED pgs=2076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:21.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.732+0000 7f5470945700 1 --2- 172.21.15.146:0/3844513192 >> v2:172.21.15.151:3300/0 conn(0x7f546c1574a0 0x7f546c0b07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:21.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.732+0000 7f5470945700 1 -- 172.21.15.146:0/3844513192 >> 172.21.15.146:0/3844513192 conn(0x7f546c067ea0 msgr2=0x7f546c0ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:21.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.733+0000 7f5470945700 1 -- 172.21.15.146:0/3844513192 shutdown_connections 2023-10-06T11:18:21.737 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.733+0000 7f5470945700 1 -- 172.21.15.146:0/3844513192 wait complete. 2023-10-06T11:18:21.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.734+0000 7f5470945700 1 Processor -- start 2023-10-06T11:18:21.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.734+0000 7f5470945700 1 -- start start 2023-10-06T11:18:21.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.734+0000 7f5470945700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f546c0adcf0 0x7f546c0c7810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:21.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.734+0000 7f5470945700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f546c1574a0 0x7f546c0c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:21.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.734+0000 7f5470945700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f546c157870 0x7f546c14c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:21.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.734+0000 7f5470945700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546c159800 con 0x7f546c0adcf0 2023-10-06T11:18:21.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.734+0000 7f5470945700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546c159ae0 con 0x7f546c1574a0 2023-10-06T11:18:21.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.734+0000 7f5470945700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f546c159dc0 con 0x7f546c157870 2023-10-06T11:18:21.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.735+0000 7f546a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f546c0adcf0 0x7f546c0c7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:21.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.735+0000 7f546a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f546c0adcf0 0x7f546c0c7810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56784/0 (socket says 172.21.15.146:56784) 2023-10-06T11:18:21.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.735+0000 7f546a59c700 1 -- 172.21.15.146:0/1925122793 learned_addr learned my addr 172.21.15.146:0/1925122793 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:21.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.735+0000 7f5461d9b700 1 --2- 172.21.15.146:0/1925122793 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f546c1574a0 0x7f546c0c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:21.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.735+0000 7f546a59c700 1 -- 172.21.15.146:0/1925122793 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f546c157870 msgr2=0x7f546c14c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:21.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.735+0000 7f546a59c700 1 --2- 172.21.15.146:0/1925122793 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f546c157870 0x7f546c14c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:21.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.735+0000 7f546a59c700 1 -- 172.21.15.146:0/1925122793 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f546c1574a0 msgr2=0x7f546c0c9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:21.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.735+0000 7f546a59c700 1 --2- 172.21.15.146:0/1925122793 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f546c1574a0 0x7f546c0c9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:21.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.735+0000 7f546a59c700 1 -- 172.21.15.146:0/1925122793 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5464009a20 con 0x7f546c0adcf0 2023-10-06T11:18:21.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.735+0000 7f5461d9b700 1 --2- 172.21.15.146:0/1925122793 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f546c1574a0 0x7f546c0c9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:18:21.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.735+0000 7f546a59c700 1 --2- 172.21.15.146:0/1925122793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f546c0adcf0 0x7f546c0c7810 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 crypto rx=0x7f545c00ec80 tx=0x7f545c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:21.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.735+0000 7f5462ffd700 1 -- 172.21.15.146:0/1925122793 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545c00c9d0 con 0x7f546c0adcf0 2023-10-06T11:18:21.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.735+0000 7f5462ffd700 1 -- 172.21.15.146:0/1925122793 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545c00cb30 con 0x7f546c0adcf0 2023-10-06T11:18:21.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.735+0000 7f5470945700 1 -- 172.21.15.146:0/1925122793 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f546c15a0a0 con 0x7f546c0adcf0 2023-10-06T11:18:21.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.735+0000 7f5462ffd700 1 -- 172.21.15.146:0/1925122793 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545c013470 con 0x7f546c0adcf0 2023-10-06T11:18:21.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.735+0000 7f5470945700 1 -- 172.21.15.146:0/1925122793 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f546c0c7d50 con 0x7f546c0adcf0 2023-10-06T11:18:21.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.736+0000 7f5470945700 1 -- 172.21.15.146:0/1925122793 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f546c15a5c0 con 0x7f546c0adcf0 2023-10-06T11:18:21.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.736+0000 7f5462ffd700 1 -- 172.21.15.146:0/1925122793 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f545c013820 con 0x7f546c0adcf0 2023-10-06T11:18:21.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.737+0000 7f5462ffd700 1 --2- 172.21.15.146:0/1925122793 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f544c066f30 0x7f544c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:21.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.737+0000 7f5462ffd700 1 -- 172.21.15.146:0/1925122793 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f545c0846d0 con 0x7f546c0adcf0 2023-10-06T11:18:21.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.737+0000 7f5461d9b700 1 --2- 172.21.15.146:0/1925122793 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f544c066f30 0x7f544c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:21.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.737+0000 7f5461d9b700 1 --2- 172.21.15.146:0/1925122793 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f544c066f30 0x7f544c0693e0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f5454007fd0 tx=0x7f5454009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:21.746 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.741+0000 7f5462ffd700 1 -- 172.21.15.146:0/1925122793 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f546c15a5c0 con 0x7f546c0adcf0 2023-10-06T11:18:21.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.923+0000 7f5470945700 1 -- 172.21.15.146:0/1925122793 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f546c15a5c0 con 0x7f546c0adcf0 2023-10-06T11:18:21.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.924+0000 7f5462ffd700 1 -- 172.21.15.146:0/1925122793 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v159) v1 ==== 92+0+10 (secure 0 0 0) 0x7f546c15a5c0 con 0x7f546c0adcf0 2023-10-06T11:18:21.926 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-10-06T11:18:21.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.926+0000 7f5470945700 1 -- 172.21.15.146:0/1925122793 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f544c066f30 msgr2=0x7f544c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:21.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.926+0000 7f5470945700 1 --2- 172.21.15.146:0/1925122793 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f544c066f30 0x7f544c0693e0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f5454007fd0 tx=0x7f5454009040 comp rx=0 tx=0).stop 2023-10-06T11:18:21.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.926+0000 7f5470945700 1 -- 172.21.15.146:0/1925122793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f546c0adcf0 msgr2=0x7f546c0c7810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:21.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.926+0000 7f5470945700 1 --2- 172.21.15.146:0/1925122793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f546c0adcf0 0x7f546c0c7810 secure :-1 s=READY pgs=2077 cs=0 l=1 rev1=1 crypto rx=0x7f545c00ec80 tx=0x7f545c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:18:21.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.926+0000 7f5470945700 1 -- 172.21.15.146:0/1925122793 shutdown_connections 2023-10-06T11:18:21.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.926+0000 7f5470945700 1 --2- 172.21.15.146:0/1925122793 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f544c066f30 0x7f544c0693e0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:21.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.926+0000 7f5470945700 1 --2- 172.21.15.146:0/1925122793 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f546c157870 0x7f546c14c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:21.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.926+0000 7f5470945700 1 --2- 172.21.15.146:0/1925122793 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f546c0adcf0 0x7f546c0c7810 unknown :-1 s=CLOSED pgs=2077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:21.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.926+0000 7f5470945700 1 --2- 172.21.15.146:0/1925122793 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f546c1574a0 0x7f546c0c9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:21.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.926+0000 7f5470945700 1 -- 172.21.15.146:0/1925122793 >> 172.21.15.146:0/1925122793 conn(0x7f546c067ea0 msgr2=0x7f546c0b2820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:21.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.926+0000 7f5470945700 1 -- 172.21.15.146:0/1925122793 shutdown_connections 2023-10-06T11:18:21.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:21.926+0000 7f5470945700 1 -- 172.21.15.146:0/1925122793 wait complete. 2023-10-06T11:18:21.940 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:18:22.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.095+0000 7f981359e700 1 Processor -- start 2023-10-06T11:18:22.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.095+0000 7f981359e700 1 -- start start 2023-10-06T11:18:22.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.096+0000 7f981359e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f98140b3960 0x7f98140b5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:22.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.096+0000 7f981359e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f981409a130 con 0x7f981409b5d0 2023-10-06T11:18:22.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.096+0000 7f981359e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98140b23e0 con 0x7f981415cd20 2023-10-06T11:18:22.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.096+0000 7f981359e700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98140b26c0 con 0x7f98140b3960 2023-10-06T11:18:22.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.096+0000 7f9812d9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f981409b5d0 0x7f98140b0e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55294/0 (socket says 172.21.15.146:55294) 2023-10-06T11:18:22.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.096+0000 7f9812d9d700 1 -- 172.21.15.146:0/2785464573 learned_addr learned my addr 172.21.15.146:0/2785464573 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:22.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.096+0000 7f9811d9b700 1 -- 172.21.15.146:0/2785464573 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 897820766 0 0) 0x7f981409a130 con 0x7f981409b5d0 2023-10-06T11:18:22.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.096+0000 7f9809d9b700 1 --2- 172.21.15.146:0/2785464573 >> v2:172.21.15.151:3300/0 conn(0x7f98140b3960 0x7f98140b5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:22.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.096+0000 7f9811d9b700 1 -- 172.21.15.146:0/2785464573 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9800003570 con 0x7f981409b5d0 2023-10-06T11:18:22.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.097+0000 7f9811d9b700 1 -- 172.21.15.146:0/2785464573 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1689113211 0 0) 0x7f9800003570 con 0x7f981409b5d0 2023-10-06T11:18:22.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.097+0000 7f9811d9b700 1 -- 172.21.15.146:0/2785464573 >> v2:172.21.15.151:3300/0 conn(0x7f98140b3960 msgr2=0x7f98140b5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:22.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.097+0000 7f9811d9b700 1 --2- 172.21.15.146:0/2785464573 >> v2:172.21.15.151:3300/0 conn(0x7f98140b3960 0x7f98140b5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:22.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.097+0000 7f9811d9b700 1 -- 172.21.15.146:0/2785464573 >> v1:172.21.15.151:6789/0 conn(0x7f981415cd20 legacy=0x7f98140b3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:22.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.097+0000 7f9811d9b700 1 -- 172.21.15.146:0/2785464573 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98140b29a0 con 0x7f981409b5d0 2023-10-06T11:18:22.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.097+0000 7f9811d9b700 1 -- 172.21.15.146:0/2785464573 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f980c001470 con 0x7f981409b5d0 2023-10-06T11:18:22.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.097+0000 7f9811d9b700 1 -- 172.21.15.146:0/2785464573 >> v1:172.21.15.146:6789/0 conn(0x7f981409b5d0 legacy=0x7f98140b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:22.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.097+0000 7f9811d9b700 1 --2- 172.21.15.146:0/2785464573 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9800003a60 0x7f9800003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:22.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.097+0000 7f9811d9b700 1 --2- 172.21.15.146:0/2785464573 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9800004810 0x7f9800004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:22.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.097+0000 7f9811d9b700 1 --2- 172.21.15.146:0/2785464573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98000051c0 0x7f980000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:22.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.097+0000 7f9811d9b700 1 -- 172.21.15.146:0/2785464573 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98140b26c0 con 0x7f98000051c0 2023-10-06T11:18:22.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.097+0000 7f9811d9b700 1 -- 172.21.15.146:0/2785464573 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980000c0d0 con 0x7f9800004810 2023-10-06T11:18:22.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.097+0000 7f9811d9b700 1 -- 172.21.15.146:0/2785464573 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f980000c290 con 0x7f9800003a60 2023-10-06T11:18:22.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.097+0000 7f9812d9d700 1 --2- 172.21.15.146:0/2785464573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98000051c0 0x7f980000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:22.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.097+0000 7f981259c700 1 --2- 172.21.15.146:0/2785464573 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9800003a60 0x7f9800003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:22.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.097+0000 7f9809d9b700 1 --2- 172.21.15.146:0/2785464573 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9800004810 0x7f9800004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:22.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.097+0000 7f9812d9d700 1 -- 172.21.15.146:0/2785464573 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9800003a60 msgr2=0x7f9800003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:22.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.097+0000 7f9812d9d700 1 --2- 172.21.15.146:0/2785464573 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9800003a60 0x7f9800003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:22.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.097+0000 7f9812d9d700 1 -- 172.21.15.146:0/2785464573 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9800004810 msgr2=0x7f9800004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:22.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.097+0000 7f9812d9d700 1 --2- 172.21.15.146:0/2785464573 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9800004810 0x7f9800004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:22.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.097+0000 7f9812d9d700 1 -- 172.21.15.146:0/2785464573 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9800003570 con 0x7f98000051c0 2023-10-06T11:18:22.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.097+0000 7f9812d9d700 1 -- 172.21.15.146:0/2785464573 reap_dead start 2023-10-06T11:18:22.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.097+0000 7f9812d9d700 1 --2- 172.21.15.146:0/2785464573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98000051c0 0x7f980000ba60 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7f980c00c3c0 tx=0x7f980c001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62361ad513606d8e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:22.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.097+0000 7f9811d9b700 1 -- 172.21.15.146:0/2785464573 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c00cc90 con 0x7f98000051c0 2023-10-06T11:18:22.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.097+0000 7f9811d9b700 1 -- 172.21.15.146:0/2785464573 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980c00cdf0 con 0x7f98000051c0 2023-10-06T11:18:22.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.097+0000 7f9811d9b700 1 -- 172.21.15.146:0/2785464573 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c005b50 con 0x7f98000051c0 2023-10-06T11:18:22.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.098+0000 7f981359e700 1 -- 172.21.15.146:0/2785464573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98000051c0 msgr2=0x7f980000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:22.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.098+0000 7f981359e700 1 --2- 172.21.15.146:0/2785464573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98000051c0 0x7f980000ba60 secure :-1 s=READY pgs=2079 cs=0 l=1 rev1=1 crypto rx=0x7f980c00c3c0 tx=0x7f980c001e50 comp rx=0 tx=0).stop 2023-10-06T11:18:22.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.098+0000 7f981359e700 1 -- 172.21.15.146:0/2785464573 shutdown_connections 2023-10-06T11:18:22.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.098+0000 7f981359e700 1 --2- 172.21.15.146:0/2785464573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98000051c0 0x7f980000ba60 unknown :-1 s=CLOSED pgs=2079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:22.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.098+0000 7f981359e700 1 -- 172.21.15.146:0/2785464573 >> 172.21.15.146:0/2785464573 conn(0x7f981406f2f0 msgr2=0x7f98140d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:22.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.098+0000 7f981359e700 1 -- 172.21.15.146:0/2785464573 shutdown_connections 2023-10-06T11:18:22.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.098+0000 7f981359e700 1 -- 172.21.15.146:0/2785464573 wait complete. 2023-10-06T11:18:22.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.099+0000 7f981359e700 1 Processor -- start 2023-10-06T11:18:22.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.099+0000 7f981359e700 1 -- start start 2023-10-06T11:18:22.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.100+0000 7f981359e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98000051c0 0x7f98140af380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:22.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.100+0000 7f981359e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98141461e0 0x7f981409ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.100+0000 7f981359e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9814146650 0x7f981409cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.100+0000 7f981359e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98140af8c0 con 0x7f98141461e0 2023-10-06T11:18:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.100+0000 7f981359e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98140ac3c0 con 0x7f98000051c0 2023-10-06T11:18:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.100+0000 7f981359e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98140ab4d0 con 0x7f9814146650 2023-10-06T11:18:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.100+0000 7f9809d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98141461e0 0x7f981409ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.100+0000 7f9809d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98141461e0 0x7f981409ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56808/0 (socket says 172.21.15.146:56808) 2023-10-06T11:18:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.100+0000 7f9809d9b700 1 -- 172.21.15.146:0/2727463450 learned_addr learned my addr 172.21.15.146:0/2727463450 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.100+0000 7f9809d9b700 1 -- 172.21.15.146:0/2727463450 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9814146650 msgr2=0x7f981409cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.100+0000 7f9809d9b700 1 --2- 172.21.15.146:0/2727463450 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9814146650 0x7f981409cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.100+0000 7f9809d9b700 1 -- 172.21.15.146:0/2727463450 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98000051c0 msgr2=0x7f98140af380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.100+0000 7f981259c700 1 --2- 172.21.15.146:0/2727463450 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98000051c0 0x7f98140af380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:22.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.100+0000 7f9809d9b700 1 --2- 172.21.15.146:0/2727463450 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98000051c0 0x7f98140af380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:22.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.100+0000 7f9809d9b700 1 -- 172.21.15.146:0/2727463450 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98140ab7b0 con 0x7f98141461e0 2023-10-06T11:18:22.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.101+0000 7f9809d9b700 1 --2- 172.21.15.146:0/2727463450 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98141461e0 0x7f981409ca10 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 crypto rx=0x7f97fc006ac0 tx=0x7f97fc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:22.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.101+0000 7f980affd700 1 -- 172.21.15.146:0/2727463450 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc00fa10 con 0x7f98141461e0 2023-10-06T11:18:22.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.101+0000 7f980affd700 1 -- 172.21.15.146:0/2727463450 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97fc00fb70 con 0x7f98141461e0 2023-10-06T11:18:22.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.101+0000 7f981359e700 1 -- 172.21.15.146:0/2727463450 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98140aba90 con 0x7f98141461e0 2023-10-06T11:18:22.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.101+0000 7f980affd700 1 -- 172.21.15.146:0/2727463450 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc014440 con 0x7f98141461e0 2023-10-06T11:18:22.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.101+0000 7f981359e700 1 -- 172.21.15.146:0/2727463450 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98140ac050 con 0x7f98141461e0 2023-10-06T11:18:22.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.102+0000 7f981359e700 1 -- 172.21.15.146:0/2727463450 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98140b2c80 con 0x7f98141461e0 2023-10-06T11:18:22.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.102+0000 7f980affd700 1 -- 172.21.15.146:0/2727463450 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f97fc014830 con 0x7f98141461e0 2023-10-06T11:18:22.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.102+0000 7f980affd700 1 --2- 172.21.15.146:0/2727463450 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f97f4066f30 0x7f97f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:22.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.102+0000 7f980affd700 1 -- 172.21.15.146:0/2727463450 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f97fc018030 con 0x7f98141461e0 2023-10-06T11:18:22.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.102+0000 7f981259c700 1 --2- 172.21.15.146:0/2727463450 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f97f4066f30 0x7f97f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:22.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.103+0000 7f981259c700 1 --2- 172.21.15.146:0/2727463450 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f97f4066f30 0x7f97f40693e0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f9804000f80 tx=0x7f9804001640 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:22.111 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.107+0000 7f980affd700 1 -- 172.21.15.146:0/2727463450 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f97fc052210 con 0x7f98141461e0 2023-10-06T11:18:22.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.291+0000 7f981359e700 1 -- 172.21.15.146:0/2727463450 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9814069dd0 con 0x7f98141461e0 2023-10-06T11:18:22.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.291+0000 7f980affd700 1 -- 172.21.15.146:0/2727463450 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v159) v1 ==== 93+0+10 (secure 0 0 0) 0x7f97fc059e60 con 0x7f98141461e0 2023-10-06T11:18:22.293 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-10-06T11:18:22.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.293+0000 7f981359e700 1 -- 172.21.15.146:0/2727463450 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f97f4066f30 msgr2=0x7f97f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:22.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.293+0000 7f981359e700 1 --2- 172.21.15.146:0/2727463450 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f97f4066f30 0x7f97f40693e0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f9804000f80 tx=0x7f9804001640 comp rx=0 tx=0).stop 2023-10-06T11:18:22.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.293+0000 7f981359e700 1 -- 172.21.15.146:0/2727463450 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98141461e0 msgr2=0x7f981409ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:22.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.293+0000 7f981359e700 1 --2- 172.21.15.146:0/2727463450 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98141461e0 0x7f981409ca10 secure :-1 s=READY pgs=2080 cs=0 l=1 rev1=1 crypto rx=0x7f97fc006ac0 tx=0x7f97fc0091a0 comp rx=0 tx=0).stop 2023-10-06T11:18:22.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.293+0000 7f981359e700 1 -- 172.21.15.146:0/2727463450 shutdown_connections 2023-10-06T11:18:22.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.293+0000 7f981359e700 1 --2- 172.21.15.146:0/2727463450 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f97f4066f30 0x7f97f40693e0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:22.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.293+0000 7f981359e700 1 --2- 172.21.15.146:0/2727463450 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9814146650 0x7f981409cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:22.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.293+0000 7f981359e700 1 --2- 172.21.15.146:0/2727463450 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98000051c0 0x7f98140af380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:22.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.293+0000 7f981359e700 1 --2- 172.21.15.146:0/2727463450 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f98141461e0 0x7f981409ca10 unknown :-1 s=CLOSED pgs=2080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:22.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.293+0000 7f981359e700 1 -- 172.21.15.146:0/2727463450 >> 172.21.15.146:0/2727463450 conn(0x7f981406f2f0 msgr2=0x7f9814069580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:22.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.293+0000 7f981359e700 1 -- 172.21.15.146:0/2727463450 shutdown_connections 2023-10-06T11:18:22.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.293+0000 7f981359e700 1 -- 172.21.15.146:0/2727463450 wait complete. 2023-10-06T11:18:22.307 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T11:18:22.422 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.421+0000 7f48c955c700 1 Processor -- start 2023-10-06T11:18:22.423 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.421+0000 7f48c955c700 1 -- start start 2023-10-06T11:18:22.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.422+0000 7f48c955c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f48c41538c0 0x7f48c4153c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:22.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.422+0000 7f48c955c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f48c415dcc0 0x7f48c40ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:22.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.422+0000 7f48c955c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48c415d270 con 0x7f48c415a940 2023-10-06T11:18:22.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.422+0000 7f48c955c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48c415d830 con 0x7f48c41538c0 2023-10-06T11:18:22.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.422+0000 7f48c955c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48c415e110 con 0x7f48c415dcc0 2023-10-06T11:18:22.425 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.422+0000 7f48c2ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f48c41538c0 0x7f48c4153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:22.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.422+0000 7f48c27fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f48c415a940 0x7f48c40cac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55304/0 (socket says 172.21.15.146:55304) 2023-10-06T11:18:22.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.422+0000 7f48c27fc700 1 -- 172.21.15.146:0/1972792097 learned_addr learned my addr 172.21.15.146:0/1972792097 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:22.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.422+0000 7f48c37fe700 1 --2- 172.21.15.146:0/1972792097 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f48c415dcc0 0x7f48c40ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:22.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.422+0000 7f48c2ffd700 1 -- 172.21.15.146:0/1972792097 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f48c415dcc0 msgr2=0x7f48c40ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:22.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.422+0000 7f48c2ffd700 1 --2- 172.21.15.146:0/1972792097 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f48c415dcc0 0x7f48c40ce610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:22.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.422+0000 7f48c2ffd700 1 -- 172.21.15.146:0/1972792097 >> v1:172.21.15.146:6789/0 conn(0x7f48c415a940 legacy=0x7f48c40cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:22.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.422+0000 7f48c1ffb700 1 -- 172.21.15.146:0/1972792097 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2474390382 0 0) 0x7f48c415d270 con 0x7f48c415a940 2023-10-06T11:18:22.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.422+0000 7f48c2ffd700 1 -- 172.21.15.146:0/1972792097 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c40cb810 con 0x7f48c41538c0 2023-10-06T11:18:22.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.422+0000 7f48c2ffd700 1 --2- 172.21.15.146:0/1972792097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48c41538c0 0x7f48c4153c90 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x7f48bc009e60 tx=0x7f48bc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6198cf5be8496f4d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:22.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.422+0000 7f48c1ffb700 1 -- 172.21.15.146:0/1972792097 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48bc00e070 con 0x7f48c41538c0 2023-10-06T11:18:22.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.422+0000 7f48c1ffb700 1 -- 172.21.15.146:0/1972792097 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48bc00bb60 con 0x7f48c41538c0 2023-10-06T11:18:22.426 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.422+0000 7f48c1ffb700 1 -- 172.21.15.146:0/1972792097 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48bc012430 con 0x7f48c41538c0 2023-10-06T11:18:22.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.423+0000 7f48c955c700 1 -- 172.21.15.146:0/1972792097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48c41538c0 msgr2=0x7f48c4153c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:22.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.423+0000 7f48c955c700 1 --2- 172.21.15.146:0/1972792097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48c41538c0 0x7f48c4153c90 secure :-1 s=READY pgs=2082 cs=0 l=1 rev1=1 crypto rx=0x7f48bc009e60 tx=0x7f48bc009780 comp rx=0 tx=0).stop 2023-10-06T11:18:22.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.423+0000 7f48c955c700 1 -- 172.21.15.146:0/1972792097 shutdown_connections 2023-10-06T11:18:22.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.423+0000 7f48c955c700 1 --2- 172.21.15.146:0/1972792097 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f48c415dcc0 0x7f48c40ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:22.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.423+0000 7f48c955c700 1 --2- 172.21.15.146:0/1972792097 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48c41538c0 0x7f48c4153c90 unknown :-1 s=CLOSED pgs=2082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:22.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.423+0000 7f48c955c700 1 -- 172.21.15.146:0/1972792097 >> 172.21.15.146:0/1972792097 conn(0x7f48c406eb10 msgr2=0x7f48c406ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:22.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.423+0000 7f48c955c700 1 -- 172.21.15.146:0/1972792097 shutdown_connections 2023-10-06T11:18:22.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.423+0000 7f48c955c700 1 -- 172.21.15.146:0/1972792097 wait complete. 2023-10-06T11:18:22.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.424+0000 7f48c955c700 1 Processor -- start 2023-10-06T11:18:22.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.424+0000 7f48c955c700 1 -- start start 2023-10-06T11:18:22.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.425+0000 7f48c955c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48c41538c0 0x7f48c416d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:22.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.425+0000 7f48c955c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f48c415a940 0x7f48c416d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:22.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.425+0000 7f48c955c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48c415dcc0 0x7f48c414f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:22.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.425+0000 7f48c955c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c415b6d0 con 0x7f48c415dcc0 2023-10-06T11:18:22.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.425+0000 7f48c955c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48c4150600 con 0x7f48c41538c0 2023-10-06T11:18:22.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.425+0000 7f48c955c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48c415ada0 con 0x7f48c415a940 2023-10-06T11:18:22.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.425+0000 7f48c37fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48c415dcc0 0x7f48c414f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:22.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.425+0000 7f48c37fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48c415dcc0 0x7f48c414f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56830/0 (socket says 172.21.15.146:56830) 2023-10-06T11:18:22.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.425+0000 7f48c37fe700 1 -- 172.21.15.146:0/1216097659 learned_addr learned my addr 172.21.15.146:0/1216097659 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:22.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.425+0000 7f48c2ffd700 1 --2- 172.21.15.146:0/1216097659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48c41538c0 0x7f48c416d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:22.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.425+0000 7f48c27fc700 1 --2- 172.21.15.146:0/1216097659 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f48c415a940 0x7f48c416d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:22.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.425+0000 7f48c37fe700 1 -- 172.21.15.146:0/1216097659 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f48c415a940 msgr2=0x7f48c416d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:22.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.425+0000 7f48c37fe700 1 --2- 172.21.15.146:0/1216097659 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f48c415a940 0x7f48c416d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:22.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.425+0000 7f48c37fe700 1 -- 172.21.15.146:0/1216097659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48c41538c0 msgr2=0x7f48c416d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:22.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.425+0000 7f48c37fe700 1 --2- 172.21.15.146:0/1216097659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48c41538c0 0x7f48c416d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:22.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.425+0000 7f48c37fe700 1 -- 172.21.15.146:0/1216097659 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48bc009a20 con 0x7f48c415dcc0 2023-10-06T11:18:22.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.425+0000 7f48c27fc700 1 --2- 172.21.15.146:0/1216097659 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f48c415a940 0x7f48c416d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:18:22.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.425+0000 7f48c37fe700 1 --2- 172.21.15.146:0/1216097659 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48c415dcc0 0x7f48c414f950 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7f48b400ea50 tx=0x7f48b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:22.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.426+0000 7f48aaffd700 1 -- 172.21.15.146:0/1216097659 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b400c920 con 0x7f48c415dcc0 2023-10-06T11:18:22.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.426+0000 7f48aaffd700 1 -- 172.21.15.146:0/1216097659 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b400caa0 con 0x7f48c415dcc0 2023-10-06T11:18:22.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.426+0000 7f48c955c700 1 -- 172.21.15.146:0/1216097659 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48c415b080 con 0x7f48c415dcc0 2023-10-06T11:18:22.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.426+0000 7f48aaffd700 1 -- 172.21.15.146:0/1216097659 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b400ce60 con 0x7f48c415dcc0 2023-10-06T11:18:22.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.426+0000 7f48c955c700 1 -- 172.21.15.146:0/1216097659 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48c40b6290 con 0x7f48c415dcc0 2023-10-06T11:18:22.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.426+0000 7f48c955c700 1 -- 172.21.15.146:0/1216097659 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48c415b840 con 0x7f48c415dcc0 2023-10-06T11:18:22.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.427+0000 7f48aaffd700 1 -- 172.21.15.146:0/1216097659 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f48b4013680 con 0x7f48c415dcc0 2023-10-06T11:18:22.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.427+0000 7f48aaffd700 1 --2- 172.21.15.146:0/1216097659 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f48b0066f30 0x7f48b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:22.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.427+0000 7f48aaffd700 1 -- 172.21.15.146:0/1216097659 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f48b4084720 con 0x7f48c415dcc0 2023-10-06T11:18:22.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.427+0000 7f48c2ffd700 1 --2- 172.21.15.146:0/1216097659 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f48b0066f30 0x7f48b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:22.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.428+0000 7f48c2ffd700 1 --2- 172.21.15.146:0/1216097659 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f48b0066f30 0x7f48b00693e0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f48bc0097c0 tx=0x7f48bc019000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:22.433 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.432+0000 7f48aaffd700 1 -- 172.21.15.146:0/1216097659 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f48b4051b80 con 0x7f48c415dcc0 2023-10-06T11:18:22.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.616+0000 7f48c955c700 1 -- 172.21.15.146:0/1216097659 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f48c404c380 con 0x7f48c415dcc0 2023-10-06T11:18:22.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.616+0000 7f48aaffd700 1 -- 172.21.15.146:0/1216097659 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v159) v1 ==== 84+0+126 (secure 0 0 0) 0x7f48b40551a0 con 0x7f48c415dcc0 2023-10-06T11:18:22.618 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:18:22.618 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2023-10-06T11:18:22.618 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:18:22.618 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 1, 2023-10-06T11:18:22.618 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": "rbd" 2023-10-06T11:18:22.618 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:18:22.619 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:18:22.619 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 2, 2023-10-06T11:18:22.619 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": ".mgr" 2023-10-06T11:18:22.619 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:18:22.619 INFO:teuthology.orchestra.run.smithi146.stdout:] 2023-10-06T11:18:22.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.618+0000 7f48c955c700 1 -- 172.21.15.146:0/1216097659 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f48b0066f30 msgr2=0x7f48b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:22.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.618+0000 7f48c955c700 1 --2- 172.21.15.146:0/1216097659 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f48b0066f30 0x7f48b00693e0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f48bc0097c0 tx=0x7f48bc019000 comp rx=0 tx=0).stop 2023-10-06T11:18:22.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.618+0000 7f48c955c700 1 -- 172.21.15.146:0/1216097659 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48c415dcc0 msgr2=0x7f48c414f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:22.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.618+0000 7f48c955c700 1 --2- 172.21.15.146:0/1216097659 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48c415dcc0 0x7f48c414f950 secure :-1 s=READY pgs=2083 cs=0 l=1 rev1=1 crypto rx=0x7f48b400ea50 tx=0x7f48b40091a0 comp rx=0 tx=0).stop 2023-10-06T11:18:22.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.618+0000 7f48c955c700 1 -- 172.21.15.146:0/1216097659 shutdown_connections 2023-10-06T11:18:22.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.618+0000 7f48c955c700 1 --2- 172.21.15.146:0/1216097659 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f48b0066f30 0x7f48b00693e0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:22.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.618+0000 7f48c955c700 1 --2- 172.21.15.146:0/1216097659 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f48c415dcc0 0x7f48c414f950 unknown :-1 s=CLOSED pgs=2083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:22.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.618+0000 7f48c955c700 1 --2- 172.21.15.146:0/1216097659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48c41538c0 0x7f48c416d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:22.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.618+0000 7f48c955c700 1 --2- 172.21.15.146:0/1216097659 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f48c415a940 0x7f48c416d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:22.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.618+0000 7f48c955c700 1 -- 172.21.15.146:0/1216097659 >> 172.21.15.146:0/1216097659 conn(0x7f48c406eb10 msgr2=0x7f48c41479a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:22.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.618+0000 7f48c955c700 1 -- 172.21.15.146:0/1216097659 shutdown_connections 2023-10-06T11:18:22.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.618+0000 7f48c955c700 1 -- 172.21.15.146:0/1216097659 wait complete. 2023-10-06T11:18:22.632 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T11:18:22.633 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T11:18:22.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.750+0000 7f8eb2517700 1 Processor -- start 2023-10-06T11:18:22.752 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.750+0000 7f8eb2517700 1 -- start start 2023-10-06T11:18:22.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.751+0000 7f8eb2517700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8eac15d520 0x7f8eac0d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:22.755 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.751+0000 7f8eb2517700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8eac15d8f0 0x7f8eac0cf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:22.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.751+0000 7f8eb2517700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eac0d0770 con 0x7f8eac0cf5d0 2023-10-06T11:18:22.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.751+0000 7f8eb2517700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eac0cfb60 con 0x7f8eac15d520 2023-10-06T11:18:22.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.751+0000 7f8eb2517700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac0cfe40 con 0x7f8eac15d8f0 2023-10-06T11:18:22.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.751+0000 7f8eabfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8eac15d520 0x7f8eac0d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:22.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.751+0000 7f8eb0ab4700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8eac0cf5d0 0x7f8eac1590d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55316/0 (socket says 172.21.15.146:55316) 2023-10-06T11:18:22.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.751+0000 7f8eb0ab4700 1 -- 172.21.15.146:0/712153506 learned_addr learned my addr 172.21.15.146:0/712153506 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:22.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.751+0000 7f8eab7fe700 1 --2- 172.21.15.146:0/712153506 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8eac15d8f0 0x7f8eac0cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:22.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.751+0000 7f8eaaffd700 1 -- 172.21.15.146:0/712153506 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2144944630 0 0) 0x7f8eac0d0770 con 0x7f8eac0cf5d0 2023-10-06T11:18:22.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.751+0000 7f8eaaffd700 1 -- 172.21.15.146:0/712153506 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e94003570 con 0x7f8eac0cf5d0 2023-10-06T11:18:22.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.751+0000 7f8eabfff700 1 -- 172.21.15.146:0/712153506 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8eac15d8f0 msgr2=0x7f8eac0cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:22.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.751+0000 7f8eabfff700 1 --2- 172.21.15.146:0/712153506 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8eac15d8f0 0x7f8eac0cf090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:22.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.751+0000 7f8eabfff700 1 -- 172.21.15.146:0/712153506 >> v1:172.21.15.146:6789/0 conn(0x7f8eac0cf5d0 legacy=0x7f8eac1590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:22.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.751+0000 7f8eabfff700 1 -- 172.21.15.146:0/712153506 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eac0d0120 con 0x7f8eac15d520 2023-10-06T11:18:22.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.752+0000 7f8eabfff700 1 --2- 172.21.15.146:0/712153506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8eac15d520 0x7f8eac0d0c00 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c0098e0 tx=0x7f8e9c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d97384faf8745118 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:22.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.752+0000 7f8eaaffd700 1 -- 172.21.15.146:0/712153506 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c011630 con 0x7f8eac15d520 2023-10-06T11:18:22.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.752+0000 7f8eaaffd700 1 -- 172.21.15.146:0/712153506 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9c011790 con 0x7f8eac15d520 2023-10-06T11:18:22.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.752+0000 7f8eaaffd700 1 -- 172.21.15.146:0/712153506 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9c011b30 con 0x7f8eac15d520 2023-10-06T11:18:22.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.752+0000 7f8eb2517700 1 -- 172.21.15.146:0/712153506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8eac15d520 msgr2=0x7f8eac0d0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:22.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.752+0000 7f8eb2517700 1 --2- 172.21.15.146:0/712153506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8eac15d520 0x7f8eac0d0c00 secure :-1 s=READY pgs=2085 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c0098e0 tx=0x7f8e9c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:18:22.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.752+0000 7f8eb2517700 1 -- 172.21.15.146:0/712153506 shutdown_connections 2023-10-06T11:18:22.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.752+0000 7f8eb2517700 1 --2- 172.21.15.146:0/712153506 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8eac15d520 0x7f8eac0d0c00 unknown :-1 s=CLOSED pgs=2085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:22.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.752+0000 7f8eb2517700 1 --2- 172.21.15.146:0/712153506 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8eac15d8f0 0x7f8eac0cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:22.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.752+0000 7f8eb2517700 1 -- 172.21.15.146:0/712153506 >> 172.21.15.146:0/712153506 conn(0x7f8eac06eb10 msgr2=0x7f8eac06ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:22.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.752+0000 7f8eb2517700 1 -- 172.21.15.146:0/712153506 shutdown_connections 2023-10-06T11:18:22.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.752+0000 7f8eb2517700 1 -- 172.21.15.146:0/712153506 wait complete. 2023-10-06T11:18:22.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.753+0000 7f8eb2517700 1 Processor -- start 2023-10-06T11:18:22.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.754+0000 7f8eb2517700 1 -- start start 2023-10-06T11:18:22.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.754+0000 7f8eb2517700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8eac0cf5d0 0x7f8eac0c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:22.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.754+0000 7f8eb2517700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8eac15d520 0x7f8eac1504b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:22.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.754+0000 7f8eb2517700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8eac15d8f0 0x7f8eac0c6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:22.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.754+0000 7f8eb2517700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac0b4e30 con 0x7f8eac15d8f0 2023-10-06T11:18:22.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.754+0000 7f8eb2517700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac0ca4c0 con 0x7f8eac15d520 2023-10-06T11:18:22.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.754+0000 7f8eb2517700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eac0c60b0 con 0x7f8eac0cf5d0 2023-10-06T11:18:22.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.754+0000 7f8eb0ab4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8eac15d8f0 0x7f8eac0c6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:22.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.754+0000 7f8eb0ab4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8eac15d8f0 0x7f8eac0c6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56854/0 (socket says 172.21.15.146:56854) 2023-10-06T11:18:22.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.754+0000 7f8eb0ab4700 1 -- 172.21.15.146:0/3811736283 learned_addr learned my addr 172.21.15.146:0/3811736283 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:22.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.755+0000 7f8eab7fe700 1 --2- 172.21.15.146:0/3811736283 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8eac15d520 0x7f8eac1504b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:22.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.755+0000 7f8eabfff700 1 --2- 172.21.15.146:0/3811736283 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8eac0cf5d0 0x7f8eac0c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:22.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.755+0000 7f8eb0ab4700 1 -- 172.21.15.146:0/3811736283 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8eac0cf5d0 msgr2=0x7f8eac0c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:22.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.755+0000 7f8eb0ab4700 1 --2- 172.21.15.146:0/3811736283 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8eac0cf5d0 0x7f8eac0c9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:22.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.755+0000 7f8eb0ab4700 1 -- 172.21.15.146:0/3811736283 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8eac15d520 msgr2=0x7f8eac1504b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:22.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.755+0000 7f8eb0ab4700 1 --2- 172.21.15.146:0/3811736283 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8eac15d520 0x7f8eac1504b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:22.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.755+0000 7f8eb0ab4700 1 -- 172.21.15.146:0/3811736283 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e9c009420 con 0x7f8eac15d8f0 2023-10-06T11:18:22.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.755+0000 7f8eb0ab4700 1 --2- 172.21.15.146:0/3811736283 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8eac15d8f0 0x7f8eac0c6540 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4001460 tx=0x7f8ea4001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:22.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.755+0000 7f8e93fff700 1 -- 172.21.15.146:0/3811736283 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea400ce80 con 0x7f8eac15d8f0 2023-10-06T11:18:22.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.755+0000 7f8e93fff700 1 -- 172.21.15.146:0/3811736283 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea400ab70 con 0x7f8eac15d8f0 2023-10-06T11:18:22.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.755+0000 7f8eb2517700 1 -- 172.21.15.146:0/3811736283 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eac0c54a0 con 0x7f8eac15d8f0 2023-10-06T11:18:22.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.755+0000 7f8e93fff700 1 -- 172.21.15.146:0/3811736283 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea40070f0 con 0x7f8eac15d8f0 2023-10-06T11:18:22.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.755+0000 7f8eb2517700 1 -- 172.21.15.146:0/3811736283 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eac0c5830 con 0x7f8eac15d8f0 2023-10-06T11:18:22.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.756+0000 7f8eb2517700 1 -- 172.21.15.146:0/3811736283 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eac0c5e60 con 0x7f8eac15d8f0 2023-10-06T11:18:22.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.756+0000 7f8e93fff700 1 -- 172.21.15.146:0/3811736283 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ea4007520 con 0x7f8eac15d8f0 2023-10-06T11:18:22.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.757+0000 7f8e93fff700 1 --2- 172.21.15.146:0/3811736283 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8e98066f30 0x7f8e980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:22.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.757+0000 7f8e93fff700 1 -- 172.21.15.146:0/3811736283 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f8ea4084830 con 0x7f8eac15d8f0 2023-10-06T11:18:22.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.757+0000 7f8eabfff700 1 --2- 172.21.15.146:0/3811736283 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8e98066f30 0x7f8e980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:22.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.757+0000 7f8eabfff700 1 --2- 172.21.15.146:0/3811736283 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8e98066f30 0x7f8e980693e0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c0091e0 tx=0x7f8e9c017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:22.769 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.761+0000 7f8e93fff700 1 -- 172.21.15.146:0/3811736283 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ea4051d10 con 0x7f8eac15d8f0 2023-10-06T11:18:22.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:22.945+0000 7f8eb2517700 1 -- 172.21.15.146:0/3811736283 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f8eac04c380 con 0x7f8eac15d8f0 2023-10-06T11:18:23.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:23.862+0000 7f8e93fff700 1 -- 172.21.15.146:0/3811736283 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v160) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8ea4055330 con 0x7f8eac15d8f0 2023-10-06T11:18:23.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:23.867+0000 7f8eb2517700 1 -- 172.21.15.146:0/3811736283 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8e98066f30 msgr2=0x7f8e980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:23.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:23.867+0000 7f8eb2517700 1 --2- 172.21.15.146:0/3811736283 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8e98066f30 0x7f8e980693e0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c0091e0 tx=0x7f8e9c017000 comp rx=0 tx=0).stop 2023-10-06T11:18:23.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:23.867+0000 7f8eb2517700 1 -- 172.21.15.146:0/3811736283 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8eac15d8f0 msgr2=0x7f8eac0c6540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:23.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:23.867+0000 7f8eb2517700 1 --2- 172.21.15.146:0/3811736283 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8eac15d8f0 0x7f8eac0c6540 secure :-1 s=READY pgs=2086 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4001460 tx=0x7f8ea4001ae0 comp rx=0 tx=0).stop 2023-10-06T11:18:23.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:23.867+0000 7f8eb2517700 1 -- 172.21.15.146:0/3811736283 shutdown_connections 2023-10-06T11:18:23.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:23.867+0000 7f8eb2517700 1 --2- 172.21.15.146:0/3811736283 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8e98066f30 0x7f8e980693e0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:23.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:23.868+0000 7f8eb2517700 1 --2- 172.21.15.146:0/3811736283 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8eac15d8f0 0x7f8eac0c6540 unknown :-1 s=CLOSED pgs=2086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:23.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:23.868+0000 7f8eb2517700 1 --2- 172.21.15.146:0/3811736283 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8eac0cf5d0 0x7f8eac0c9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:23.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:23.868+0000 7f8eb2517700 1 --2- 172.21.15.146:0/3811736283 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8eac15d520 0x7f8eac1504b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:23.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:23.868+0000 7f8eb2517700 1 -- 172.21.15.146:0/3811736283 >> 172.21.15.146:0/3811736283 conn(0x7f8eac06eb10 msgr2=0x7f8eac0cd920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:23.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:23.868+0000 7f8eb2517700 1 -- 172.21.15.146:0/3811736283 shutdown_connections 2023-10-06T11:18:23.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:23.869+0000 7f8eb2517700 1 -- 172.21.15.146:0/3811736283 wait complete. 2023-10-06T11:18:23.872 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' created 2023-10-06T11:18:23.886 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T11:18:24.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.010+0000 7fe29359e700 1 Processor -- start 2023-10-06T11:18:24.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.010+0000 7fe29359e700 1 -- start start 2023-10-06T11:18:24.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.011+0000 7fe29359e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe29415d160 0x7fe294068700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:24.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.011+0000 7fe29359e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2941598f0 0x7fe29406b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:24.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.011+0000 7fe29359e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe29415d660 con 0x7fe294159520 2023-10-06T11:18:24.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.011+0000 7fe29359e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe29415d940 con 0x7fe29415d160 2023-10-06T11:18:24.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.011+0000 7fe29359e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe29415dc20 con 0x7fe2941598f0 2023-10-06T11:18:24.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.011+0000 7fe289d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe29415d160 0x7fe294068700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:24.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.011+0000 7fe29259c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe294159520 0x7fe294069f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55330/0 (socket says 172.21.15.146:55330) 2023-10-06T11:18:24.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.011+0000 7fe29259c700 1 -- 172.21.15.146:0/1390914008 learned_addr learned my addr 172.21.15.146:0/1390914008 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:24.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.011+0000 7fe292d9d700 1 --2- 172.21.15.146:0/1390914008 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2941598f0 0x7fe29406b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:24.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.011+0000 7fe289d9b700 1 -- 172.21.15.146:0/1390914008 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2941598f0 msgr2=0x7fe29406b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:24.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.011+0000 7fe289d9b700 1 --2- 172.21.15.146:0/1390914008 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2941598f0 0x7fe29406b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:24.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.011+0000 7fe289d9b700 1 -- 172.21.15.146:0/1390914008 >> v1:172.21.15.146:6789/0 conn(0x7fe294159520 legacy=0x7fe294069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:24.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.011+0000 7fe289d9b700 1 -- 172.21.15.146:0/1390914008 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe29415df00 con 0x7fe29415d160 2023-10-06T11:18:24.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.011+0000 7fe291d9b700 1 -- 172.21.15.146:0/1390914008 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1731081524 0 0) 0x7fe29415d660 con 0x7fe294159520 2023-10-06T11:18:24.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.011+0000 7fe289d9b700 1 --2- 172.21.15.146:0/1390914008 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe29415d160 0x7fe294068700 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 crypto rx=0x7fe27c0098e0 tx=0x7fe27c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46efb03ba878b30f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:24.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.012+0000 7fe291d9b700 1 -- 172.21.15.146:0/1390914008 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c009e80 con 0x7fe29415d160 2023-10-06T11:18:24.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.012+0000 7fe291d9b700 1 -- 172.21.15.146:0/1390914008 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe27c00b860 con 0x7fe29415d160 2023-10-06T11:18:24.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.012+0000 7fe291d9b700 1 -- 172.21.15.146:0/1390914008 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe27c00bbe0 con 0x7fe29415d160 2023-10-06T11:18:24.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.012+0000 7fe29359e700 1 -- 172.21.15.146:0/1390914008 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe29415d160 msgr2=0x7fe294068700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:24.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.012+0000 7fe29359e700 1 --2- 172.21.15.146:0/1390914008 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe29415d160 0x7fe294068700 secure :-1 s=READY pgs=2088 cs=0 l=1 rev1=1 crypto rx=0x7fe27c0098e0 tx=0x7fe27c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:18:24.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.012+0000 7fe29359e700 1 -- 172.21.15.146:0/1390914008 shutdown_connections 2023-10-06T11:18:24.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.012+0000 7fe29359e700 1 --2- 172.21.15.146:0/1390914008 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2941598f0 0x7fe29406b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:24.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.012+0000 7fe29359e700 1 --2- 172.21.15.146:0/1390914008 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe29415d160 0x7fe294068700 unknown :-1 s=CLOSED pgs=2088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:24.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.012+0000 7fe29359e700 1 -- 172.21.15.146:0/1390914008 >> 172.21.15.146:0/1390914008 conn(0x7fe2940ce270 msgr2=0x7fe2940ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:24.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.012+0000 7fe29359e700 1 -- 172.21.15.146:0/1390914008 shutdown_connections 2023-10-06T11:18:24.017 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.012+0000 7fe29359e700 1 -- 172.21.15.146:0/1390914008 wait complete. 2023-10-06T11:18:24.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.013+0000 7fe29359e700 1 Processor -- start 2023-10-06T11:18:24.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.013+0000 7fe29359e700 1 -- start start 2023-10-06T11:18:24.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.014+0000 7fe29359e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe294159520 0x7fe29416dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:24.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.014+0000 7fe29359e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2941598f0 0x7fe2940c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:24.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.014+0000 7fe29359e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe29415d160 0x7fe29415b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:24.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.014+0000 7fe29359e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29416e400 con 0x7fe294159520 2023-10-06T11:18:24.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.014+0000 7fe29359e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2940aea60 con 0x7fe29415d160 2023-10-06T11:18:24.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.014+0000 7fe29359e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2940adbf0 con 0x7fe2941598f0 2023-10-06T11:18:24.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.014+0000 7fe29259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe294159520 0x7fe29416dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:24.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.014+0000 7fe29259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe294159520 0x7fe29416dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56868/0 (socket says 172.21.15.146:56868) 2023-10-06T11:18:24.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.014+0000 7fe29259c700 1 -- 172.21.15.146:0/3445362215 learned_addr learned my addr 172.21.15.146:0/3445362215 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:24.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.014+0000 7fe289d9b700 1 --2- 172.21.15.146:0/3445362215 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2941598f0 0x7fe2940c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:24.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.014+0000 7fe292d9d700 1 --2- 172.21.15.146:0/3445362215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe29415d160 0x7fe29415b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:24.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.015+0000 7fe29259c700 1 -- 172.21.15.146:0/3445362215 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2941598f0 msgr2=0x7fe2940c44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:24.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.015+0000 7fe29259c700 1 --2- 172.21.15.146:0/3445362215 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2941598f0 0x7fe2940c44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:24.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.015+0000 7fe29259c700 1 -- 172.21.15.146:0/3445362215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe29415d160 msgr2=0x7fe29415b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:24.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.015+0000 7fe29259c700 1 --2- 172.21.15.146:0/3445362215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe29415d160 0x7fe29415b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:24.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.015+0000 7fe29259c700 1 -- 172.21.15.146:0/3445362215 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe27c009420 con 0x7fe294159520 2023-10-06T11:18:24.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.015+0000 7fe292d9d700 1 --2- 172.21.15.146:0/3445362215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe29415d160 0x7fe29415b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:18:24.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.015+0000 7fe29259c700 1 --2- 172.21.15.146:0/3445362215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe294159520 0x7fe29416dec0 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7fe28400c5b0 tx=0x7fe284001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:24.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.015+0000 7fe28affd700 1 -- 172.21.15.146:0/3445362215 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe284005b30 con 0x7fe294159520 2023-10-06T11:18:24.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.015+0000 7fe28affd700 1 -- 172.21.15.146:0/3445362215 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe284005c90 con 0x7fe294159520 2023-10-06T11:18:24.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.015+0000 7fe29359e700 1 -- 172.21.15.146:0/3445362215 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2940ade50 con 0x7fe294159520 2023-10-06T11:18:24.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.015+0000 7fe28affd700 1 -- 172.21.15.146:0/3445362215 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe284007320 con 0x7fe294159520 2023-10-06T11:18:24.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.015+0000 7fe29359e700 1 -- 172.21.15.146:0/3445362215 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2940ae410 con 0x7fe294159520 2023-10-06T11:18:24.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.016+0000 7fe29359e700 1 -- 172.21.15.146:0/3445362215 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe29406e460 con 0x7fe294159520 2023-10-06T11:18:24.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.016+0000 7fe28affd700 1 -- 172.21.15.146:0/3445362215 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe28401b400 con 0x7fe294159520 2023-10-06T11:18:24.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.017+0000 7fe28affd700 1 --2- 172.21.15.146:0/3445362215 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe274066f30 0x7fe2740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:24.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.017+0000 7fe28affd700 1 -- 172.21.15.146:0/3445362215 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 5576+0+0 (secure 0 0 0) 0x7fe284083fd0 con 0x7fe294159520 2023-10-06T11:18:24.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.017+0000 7fe289d9b700 1 --2- 172.21.15.146:0/3445362215 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe274066f30 0x7fe2740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:24.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.017+0000 7fe289d9b700 1 --2- 172.21.15.146:0/3445362215 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe274066f30 0x7fe2740693e0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fe27c0091e0 tx=0x7fe27c017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:24.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.021+0000 7fe28affd700 1 -- 172.21.15.146:0/3445362215 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe284051340 con 0x7fe294159520 2023-10-06T11:18:24.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.204+0000 7fe29359e700 1 -- 172.21.15.146:0/3445362215 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe294068c40 con 0x7fe294159520 2023-10-06T11:18:24.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.874+0000 7fe28affd700 1 -- 172.21.15.146:0/3445362215 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v161) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe284054960 con 0x7fe294159520 2023-10-06T11:18:24.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.886+0000 7fe29359e700 1 -- 172.21.15.146:0/3445362215 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe274066f30 msgr2=0x7fe2740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:24.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.886+0000 7fe29359e700 1 --2- 172.21.15.146:0/3445362215 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe274066f30 0x7fe2740693e0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fe27c0091e0 tx=0x7fe27c017000 comp rx=0 tx=0).stop 2023-10-06T11:18:24.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.886+0000 7fe29359e700 1 -- 172.21.15.146:0/3445362215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe294159520 msgr2=0x7fe29416dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:24.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.886+0000 7fe29359e700 1 --2- 172.21.15.146:0/3445362215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe294159520 0x7fe29416dec0 secure :-1 s=READY pgs=2089 cs=0 l=1 rev1=1 crypto rx=0x7fe28400c5b0 tx=0x7fe284001070 comp rx=0 tx=0).stop 2023-10-06T11:18:24.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.888+0000 7fe29359e700 1 -- 172.21.15.146:0/3445362215 shutdown_connections 2023-10-06T11:18:24.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.888+0000 7fe29359e700 1 --2- 172.21.15.146:0/3445362215 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe274066f30 0x7fe2740693e0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:24.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.888+0000 7fe29359e700 1 --2- 172.21.15.146:0/3445362215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe29415d160 0x7fe29415b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:24.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.888+0000 7fe29359e700 1 --2- 172.21.15.146:0/3445362215 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe294159520 0x7fe29416dec0 unknown :-1 s=CLOSED pgs=2089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:24.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.888+0000 7fe29359e700 1 --2- 172.21.15.146:0/3445362215 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe2941598f0 0x7fe2940c44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:24.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.888+0000 7fe29359e700 1 -- 172.21.15.146:0/3445362215 >> 172.21.15.146:0/3445362215 conn(0x7fe2940ce270 msgr2=0x7fe2940ce640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:24.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.888+0000 7fe29359e700 1 -- 172.21.15.146:0/3445362215 shutdown_connections 2023-10-06T11:18:24.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:24.889+0000 7fe29359e700 1 -- 172.21.15.146:0/3445362215 wait complete. 2023-10-06T11:18:24.892 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' created 2023-10-06T11:18:24.904 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T11:18:25.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.020+0000 7fd054348700 1 Processor -- start 2023-10-06T11:18:25.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.020+0000 7fd054348700 1 -- start start 2023-10-06T11:18:25.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.021+0000 7fd054348700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd04c159450 0x7fd04c159820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:25.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.021+0000 7fd054348700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd04c0cb8a0 con 0x7fd04c0b0930 2023-10-06T11:18:25.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.021+0000 7fd054348700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd04c0b2960 con 0x7fd04c15dd70 2023-10-06T11:18:25.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.021+0000 7fd054348700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd04c0b2f20 con 0x7fd04c159450 2023-10-06T11:18:25.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.021+0000 7fd0528e5700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd04c0b0930 0x7fd04c0aef90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55342/0 (socket says 172.21.15.146:55342) 2023-10-06T11:18:25.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.021+0000 7fd0528e5700 1 -- 172.21.15.146:0/487176080 learned_addr learned my addr 172.21.15.146:0/487176080 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:25.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.021+0000 7fd0520e4700 1 --2- 172.21.15.146:0/487176080 >> v2:172.21.15.151:3300/0 conn(0x7fd04c159450 0x7fd04c159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:25.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.021+0000 7fd0510e2700 1 -- 172.21.15.146:0/487176080 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3427798744 0 0) 0x7fd04c0cb8a0 con 0x7fd04c0b0930 2023-10-06T11:18:25.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.021+0000 7fd0510e2700 1 -- 172.21.15.146:0/487176080 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd038003570 con 0x7fd04c0b0930 2023-10-06T11:18:25.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.021+0000 7fd0510e2700 1 -- 172.21.15.146:0/487176080 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1668145792 0 0) 0x7fd04c0b2960 con 0x7fd04c15dd70 2023-10-06T11:18:25.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.021+0000 7fd0510e2700 1 -- 172.21.15.146:0/487176080 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd04c0cb8a0 con 0x7fd04c15dd70 2023-10-06T11:18:25.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.021+0000 7fd0510e2700 1 -- 172.21.15.146:0/487176080 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4041161356 0 0) 0x7fd038003570 con 0x7fd04c0b0930 2023-10-06T11:18:25.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.021+0000 7fd0510e2700 1 -- 172.21.15.146:0/487176080 >> v2:172.21.15.151:3300/0 conn(0x7fd04c159450 msgr2=0x7fd04c159820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:25.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.021+0000 7fd0510e2700 1 --2- 172.21.15.146:0/487176080 >> v2:172.21.15.151:3300/0 conn(0x7fd04c159450 0x7fd04c159820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:25.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.021+0000 7fd0510e2700 1 -- 172.21.15.146:0/487176080 >> v1:172.21.15.151:6789/0 conn(0x7fd04c15dd70 legacy=0x7fd04c0b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:25.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.021+0000 7fd0510e2700 1 -- 172.21.15.146:0/487176080 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd04c0b2c40 con 0x7fd04c0b0930 2023-10-06T11:18:25.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.021+0000 7fd0510e2700 1 -- 172.21.15.146:0/487176080 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fd048001470 con 0x7fd04c0b0930 2023-10-06T11:18:25.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.021+0000 7fd0520e4700 1 --2- 172.21.15.146:0/487176080 >> v2:172.21.15.151:3300/0 conn(0x7fd04c159450 0x7fd04c159820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:18:25.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.021+0000 7fd0510e2700 1 -- 172.21.15.146:0/487176080 >> v1:172.21.15.146:6789/0 conn(0x7fd04c0b0930 legacy=0x7fd04c0aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:25.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.022+0000 7fd0510e2700 1 --2- 172.21.15.146:0/487176080 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd038003c40 0x7fd038004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:25.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.022+0000 7fd0510e2700 1 --2- 172.21.15.146:0/487176080 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd038004810 0x7fd038004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:25.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.022+0000 7fd0510e2700 1 --2- 172.21.15.146:0/487176080 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd038005210 0x7fd03800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:25.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.022+0000 7fd0510e2700 1 -- 172.21.15.146:0/487176080 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c0b2f20 con 0x7fd038003c40 2023-10-06T11:18:25.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.022+0000 7fd0510e2700 1 -- 172.21.15.146:0/487176080 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd03800c1b0 con 0x7fd038004810 2023-10-06T11:18:25.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.022+0000 7fd0510e2700 1 -- 172.21.15.146:0/487176080 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd03800c370 con 0x7fd038005210 2023-10-06T11:18:25.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.022+0000 7fd0520e4700 1 --2- 172.21.15.146:0/487176080 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd038003c40 0x7fd038004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:25.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.022+0000 7fd0518e3700 1 --2- 172.21.15.146:0/487176080 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd038004810 0x7fd038004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:25.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.022+0000 7fd0528e5700 1 --2- 172.21.15.146:0/487176080 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd038005210 0x7fd03800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:25.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.022+0000 7fd0520e4700 1 -- 172.21.15.146:0/487176080 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd038005210 msgr2=0x7fd03800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:25.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.022+0000 7fd0520e4700 1 --2- 172.21.15.146:0/487176080 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd038005210 0x7fd03800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:25.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.022+0000 7fd0520e4700 1 -- 172.21.15.146:0/487176080 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd038004810 msgr2=0x7fd038004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:25.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.022+0000 7fd0520e4700 1 --2- 172.21.15.146:0/487176080 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd038004810 0x7fd038004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:25.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.022+0000 7fd0520e4700 1 -- 172.21.15.146:0/487176080 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd038003570 con 0x7fd038003c40 2023-10-06T11:18:25.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.022+0000 7fd0528e5700 1 -- 172.21.15.146:0/487176080 reap_dead start 2023-10-06T11:18:25.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.022+0000 7fd0520e4700 1 --2- 172.21.15.146:0/487176080 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd038003c40 0x7fd038004030 secure :-1 s=READY pgs=2091 cs=0 l=1 rev1=1 crypto rx=0x7fd0440094d0 tx=0x7fd04400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eacfefabc7c3cd11 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:25.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.022+0000 7fd0510e2700 1 -- 172.21.15.146:0/487176080 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04400ebe0 con 0x7fd038003c40 2023-10-06T11:18:25.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.022+0000 7fd0510e2700 1 -- 172.21.15.146:0/487176080 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd04400f040 con 0x7fd038003c40 2023-10-06T11:18:25.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.022+0000 7fd0510e2700 1 -- 172.21.15.146:0/487176080 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd044014480 con 0x7fd038003c40 2023-10-06T11:18:25.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.023+0000 7fd054348700 1 -- 172.21.15.146:0/487176080 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd038003c40 msgr2=0x7fd038004030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:25.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.023+0000 7fd054348700 1 --2- 172.21.15.146:0/487176080 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd038003c40 0x7fd038004030 secure :-1 s=READY pgs=2091 cs=0 l=1 rev1=1 crypto rx=0x7fd0440094d0 tx=0x7fd04400b040 comp rx=0 tx=0).stop 2023-10-06T11:18:25.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.023+0000 7fd054348700 1 -- 172.21.15.146:0/487176080 shutdown_connections 2023-10-06T11:18:25.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.023+0000 7fd054348700 1 --2- 172.21.15.146:0/487176080 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd038003c40 0x7fd038004030 unknown :-1 s=CLOSED pgs=2091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:25.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.023+0000 7fd054348700 1 -- 172.21.15.146:0/487176080 >> 172.21.15.146:0/487176080 conn(0x7fd04c06eb10 msgr2=0x7fd04c06ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:25.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.023+0000 7fd054348700 1 -- 172.21.15.146:0/487176080 shutdown_connections 2023-10-06T11:18:25.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.023+0000 7fd054348700 1 -- 172.21.15.146:0/487176080 wait complete. 2023-10-06T11:18:25.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.024+0000 7fd054348700 1 Processor -- start 2023-10-06T11:18:25.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.024+0000 7fd054348700 1 -- start start 2023-10-06T11:18:25.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.025+0000 7fd054348700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd038003c40 0x7fd04c0c5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:25.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.025+0000 7fd054348700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd04c0c7650 0x7fd04c0af130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:25.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.025+0000 7fd054348700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd04c0c7ac0 0x7fd04c0af670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:25.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.025+0000 7fd054348700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c158650 con 0x7fd038003c40 2023-10-06T11:18:25.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.025+0000 7fd054348700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c0c3d00 con 0x7fd04c0c7650 2023-10-06T11:18:25.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.025+0000 7fd054348700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c16df80 con 0x7fd04c0c7ac0 2023-10-06T11:18:25.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.025+0000 7fd0520e4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd038003c40 0x7fd04c0c5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:25.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.025+0000 7fd0520e4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd038003c40 0x7fd04c0c5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56886/0 (socket says 172.21.15.146:56886) 2023-10-06T11:18:25.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.025+0000 7fd0520e4700 1 -- 172.21.15.146:0/1312227960 learned_addr learned my addr 172.21.15.146:0/1312227960 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:25.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.025+0000 7fd0518e3700 1 --2- 172.21.15.146:0/1312227960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd04c0c7650 0x7fd04c0af130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:25.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.025+0000 7fd0528e5700 1 --2- 172.21.15.146:0/1312227960 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd04c0c7ac0 0x7fd04c0af670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:25.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.025+0000 7fd0520e4700 1 -- 172.21.15.146:0/1312227960 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd04c0c7ac0 msgr2=0x7fd04c0af670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:25.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.025+0000 7fd0520e4700 1 --2- 172.21.15.146:0/1312227960 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd04c0c7ac0 0x7fd04c0af670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:25.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.025+0000 7fd0520e4700 1 -- 172.21.15.146:0/1312227960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd04c0c7650 msgr2=0x7fd04c0af130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:25.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.025+0000 7fd0520e4700 1 --2- 172.21.15.146:0/1312227960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd04c0c7650 0x7fd04c0af130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:25.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.025+0000 7fd0520e4700 1 -- 172.21.15.146:0/1312227960 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd04c16e260 con 0x7fd038003c40 2023-10-06T11:18:25.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.025+0000 7fd0520e4700 1 --2- 172.21.15.146:0/1312227960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd038003c40 0x7fd04c0c5770 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x7fd0440099f0 tx=0x7fd04401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:25.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.025+0000 7fd0427fc700 1 -- 172.21.15.146:0/1312227960 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd044029480 con 0x7fd038003c40 2023-10-06T11:18:25.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.025+0000 7fd0427fc700 1 -- 172.21.15.146:0/1312227960 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0440295e0 con 0x7fd038003c40 2023-10-06T11:18:25.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.025+0000 7fd0427fc700 1 -- 172.21.15.146:0/1312227960 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0440299a0 con 0x7fd038003c40 2023-10-06T11:18:25.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.025+0000 7fd054348700 1 -- 172.21.15.146:0/1312227960 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd04c16e540 con 0x7fd038003c40 2023-10-06T11:18:25.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.025+0000 7fd054348700 1 -- 172.21.15.146:0/1312227960 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd04c16eb00 con 0x7fd038003c40 2023-10-06T11:18:25.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.026+0000 7fd054348700 1 -- 172.21.15.146:0/1312227960 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd04c04c380 con 0x7fd038003c40 2023-10-06T11:18:25.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.027+0000 7fd0427fc700 1 -- 172.21.15.146:0/1312227960 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd044003040 con 0x7fd038003c40 2023-10-06T11:18:25.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.027+0000 7fd0427fc700 1 --2- 172.21.15.146:0/1312227960 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd030066f30 0x7fd0300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:25.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.028+0000 7fd0518e3700 1 --2- 172.21.15.146:0/1312227960 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd030066f30 0x7fd0300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:25.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.028+0000 7fd0427fc700 1 -- 172.21.15.146:0/1312227960 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 5958+0+0 (secure 0 0 0) 0x7fd044086950 con 0x7fd038003c40 2023-10-06T11:18:25.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.028+0000 7fd0518e3700 1 --2- 172.21.15.146:0/1312227960 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd030066f30 0x7fd0300693e0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fd03c000c00 tx=0x7fd03c007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:25.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.032+0000 7fd0427fc700 1 -- 172.21.15.146:0/1312227960 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd044053b80 con 0x7fd038003c40 2023-10-06T11:18:25.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.256+0000 7fd054348700 1 -- 172.21.15.146:0/1312227960 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd04c0cb530 con 0x7fd038003c40 2023-10-06T11:18:25.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.875+0000 7fd0427fc700 1 -- 172.21.15.146:0/1312227960 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 25 and data pool 26 v132) v1 ==== 174+0+0 (secure 0 0 0) 0x7fd0440571a0 con 0x7fd038003c40 2023-10-06T11:18:25.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.879+0000 7fd054348700 1 -- 172.21.15.146:0/1312227960 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd030066f30 msgr2=0x7fd0300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:25.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.879+0000 7fd054348700 1 --2- 172.21.15.146:0/1312227960 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd030066f30 0x7fd0300693e0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fd03c000c00 tx=0x7fd03c007d30 comp rx=0 tx=0).stop 2023-10-06T11:18:25.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.879+0000 7fd054348700 1 -- 172.21.15.146:0/1312227960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd038003c40 msgr2=0x7fd04c0c5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:25.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.879+0000 7fd054348700 1 --2- 172.21.15.146:0/1312227960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd038003c40 0x7fd04c0c5770 secure :-1 s=READY pgs=2092 cs=0 l=1 rev1=1 crypto rx=0x7fd0440099f0 tx=0x7fd04401a000 comp rx=0 tx=0).stop 2023-10-06T11:18:25.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.879+0000 7fd054348700 1 -- 172.21.15.146:0/1312227960 shutdown_connections 2023-10-06T11:18:25.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.879+0000 7fd054348700 1 --2- 172.21.15.146:0/1312227960 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd030066f30 0x7fd0300693e0 secure :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fd03c000c00 tx=0x7fd03c007d30 comp rx=0 tx=0).stop 2023-10-06T11:18:25.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.879+0000 7fd054348700 1 --2- 172.21.15.146:0/1312227960 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd04c0c7ac0 0x7fd04c0af670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:25.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.879+0000 7fd054348700 1 --2- 172.21.15.146:0/1312227960 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd038003c40 0x7fd04c0c5770 unknown :-1 s=CLOSED pgs=2092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:25.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.879+0000 7fd054348700 1 --2- 172.21.15.146:0/1312227960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd04c0c7650 0x7fd04c0af130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:25.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.879+0000 7fd054348700 1 -- 172.21.15.146:0/1312227960 >> 172.21.15.146:0/1312227960 conn(0x7fd04c06eb10 msgr2=0x7fd04c0b5500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:25.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.880+0000 7fd054348700 1 -- 172.21.15.146:0/1312227960 shutdown_connections 2023-10-06T11:18:25.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:25.880+0000 7fd054348700 1 -- 172.21.15.146:0/1312227960 wait complete. 2023-10-06T11:18:25.883 INFO:teuthology.orchestra.run.smithi146.stderr:new fs with metadata pool 25 and data pool 26 2023-10-06T11:18:25.895 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:18:26.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.008+0000 7f33e6637700 1 Processor -- start 2023-10-06T11:18:26.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.008+0000 7f33e6637700 1 -- start start 2023-10-06T11:18:26.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.009+0000 7f33e6637700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f33e006eb20 0x7f33e006c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:26.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.009+0000 7f33e6637700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f33e00c8960 0x7f33e00683f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:26.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.009+0000 7f33e6637700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e00c84d0 con 0x7f33e006bd60 2023-10-06T11:18:26.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.009+0000 7f33e6637700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33e00c76d0 con 0x7f33e006eb20 2023-10-06T11:18:26.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.009+0000 7f33e6637700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33e00c8d80 con 0x7f33e00c8960 2023-10-06T11:18:26.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.009+0000 7f33df7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f33e006eb20 0x7f33e006c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:26.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.009+0000 7f33df7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f33e006eb20 0x7f33e006c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56894/0 (socket says 172.21.15.146:56894) 2023-10-06T11:18:26.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.009+0000 7f33df7fe700 1 -- 172.21.15.146:0/1197468721 learned_addr learned my addr 172.21.15.146:0/1197468721 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:26.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.009+0000 7f33e4bd4700 1 --2- 172.21.15.146:0/1197468721 >> v2:172.21.15.151:3300/0 conn(0x7f33e00c8960 0x7f33e00683f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:26.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.010+0000 7f33df7fe700 1 -- 172.21.15.146:0/1197468721 >> v2:172.21.15.151:3300/0 conn(0x7f33e00c8960 msgr2=0x7f33e00683f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:26.013 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.010+0000 7f33df7fe700 1 --2- 172.21.15.146:0/1197468721 >> v2:172.21.15.151:3300/0 conn(0x7f33e00c8960 0x7f33e00683f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:26.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.010+0000 7f33df7fe700 1 -- 172.21.15.146:0/1197468721 >> v1:172.21.15.151:6789/0 conn(0x7f33e006bd60 legacy=0x7f33e00c6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:26.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.010+0000 7f33df7fe700 1 -- 172.21.15.146:0/1197468721 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e00c78c0 con 0x7f33e006eb20 2023-10-06T11:18:26.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.010+0000 7f33df7fe700 1 --2- 172.21.15.146:0/1197468721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33e006eb20 0x7f33e006c130 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 crypto rx=0x7f33e00af610 tx=0x7f33d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d741c0f8decbce7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:26.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.010+0000 7f33deffd700 1 -- 172.21.15.146:0/1197468721 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d400b860 con 0x7f33e006eb20 2023-10-06T11:18:26.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.010+0000 7f33deffd700 1 -- 172.21.15.146:0/1197468721 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d400b9c0 con 0x7f33e006eb20 2023-10-06T11:18:26.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.010+0000 7f33deffd700 1 -- 172.21.15.146:0/1197468721 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d400bd60 con 0x7f33e006eb20 2023-10-06T11:18:26.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.010+0000 7f33e6637700 1 -- 172.21.15.146:0/1197468721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33e006eb20 msgr2=0x7f33e006c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:26.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.010+0000 7f33e6637700 1 --2- 172.21.15.146:0/1197468721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33e006eb20 0x7f33e006c130 secure :-1 s=READY pgs=2093 cs=0 l=1 rev1=1 crypto rx=0x7f33e00af610 tx=0x7f33d4009250 comp rx=0 tx=0).stop 2023-10-06T11:18:26.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.011+0000 7f33e6637700 1 -- 172.21.15.146:0/1197468721 shutdown_connections 2023-10-06T11:18:26.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.011+0000 7f33e6637700 1 --2- 172.21.15.146:0/1197468721 >> v2:172.21.15.151:3300/0 conn(0x7f33e00c8960 0x7f33e00683f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:26.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.011+0000 7f33e6637700 1 --2- 172.21.15.146:0/1197468721 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33e006eb20 0x7f33e006c130 unknown :-1 s=CLOSED pgs=2093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:26.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.011+0000 7f33e6637700 1 -- 172.21.15.146:0/1197468721 >> 172.21.15.146:0/1197468721 conn(0x7f33e00c9f50 msgr2=0x7f33e006dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:26.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.011+0000 7f33e6637700 1 -- 172.21.15.146:0/1197468721 shutdown_connections 2023-10-06T11:18:26.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.011+0000 7f33e6637700 1 -- 172.21.15.146:0/1197468721 wait complete. 2023-10-06T11:18:26.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.012+0000 7f33e6637700 1 Processor -- start 2023-10-06T11:18:26.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.012+0000 7f33e6637700 1 -- start start 2023-10-06T11:18:26.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.013+0000 7f33e6637700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f33e006bd60 0x7f33e016d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:26.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.013+0000 7f33e6637700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f33e006eb20 0x7f33e00c1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:26.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.013+0000 7f33e6637700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33e00c8960 0x7f33e0158f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:26.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.013+0000 7f33e6637700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e00b0250 con 0x7f33e00c8960 2023-10-06T11:18:26.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.013+0000 7f33e6637700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e00c1ac0 con 0x7f33e006eb20 2023-10-06T11:18:26.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.013+0000 7f33e6637700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e01594c0 con 0x7f33e006bd60 2023-10-06T11:18:26.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.013+0000 7f33e4bd4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33e00c8960 0x7f33e0158f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:26.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.013+0000 7f33e4bd4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33e00c8960 0x7f33e0158f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56908/0 (socket says 172.21.15.146:56908) 2023-10-06T11:18:26.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.013+0000 7f33e4bd4700 1 -- 172.21.15.146:0/4185942678 learned_addr learned my addr 172.21.15.146:0/4185942678 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:26.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.013+0000 7f33df7fe700 1 --2- 172.21.15.146:0/4185942678 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f33e006eb20 0x7f33e00c1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:26.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.013+0000 7f33dffff700 1 --2- 172.21.15.146:0/4185942678 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f33e006bd60 0x7f33e016d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:26.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.013+0000 7f33e4bd4700 1 -- 172.21.15.146:0/4185942678 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f33e006bd60 msgr2=0x7f33e016d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:26.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.013+0000 7f33e4bd4700 1 --2- 172.21.15.146:0/4185942678 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f33e006bd60 0x7f33e016d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:26.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.013+0000 7f33e4bd4700 1 -- 172.21.15.146:0/4185942678 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f33e006eb20 msgr2=0x7f33e00c1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:26.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.013+0000 7f33e4bd4700 1 --2- 172.21.15.146:0/4185942678 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f33e006eb20 0x7f33e00c1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:26.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.013+0000 7f33e4bd4700 1 -- 172.21.15.146:0/4185942678 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d40094f0 con 0x7f33e00c8960 2023-10-06T11:18:26.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.013+0000 7f33e4bd4700 1 --2- 172.21.15.146:0/4185942678 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33e00c8960 0x7f33e0158f80 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7f33d8009fa0 tx=0x7f33d8009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:26.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.013+0000 7f33c7fff700 1 -- 172.21.15.146:0/4185942678 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d800ebc0 con 0x7f33e00c8960 2023-10-06T11:18:26.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.013+0000 7f33c7fff700 1 -- 172.21.15.146:0/4185942678 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d800ed20 con 0x7f33e00c8960 2023-10-06T11:18:26.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.013+0000 7f33e6637700 1 -- 172.21.15.146:0/4185942678 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33e016da30 con 0x7f33e00c8960 2023-10-06T11:18:26.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.013+0000 7f33c7fff700 1 -- 172.21.15.146:0/4185942678 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d8014670 con 0x7f33e00c8960 2023-10-06T11:18:26.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.013+0000 7f33e6637700 1 -- 172.21.15.146:0/4185942678 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e016dff0 con 0x7f33e00c8960 2023-10-06T11:18:26.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.014+0000 7f33e6637700 1 -- 172.21.15.146:0/4185942678 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33e00b0020 con 0x7f33e00c8960 2023-10-06T11:18:26.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.015+0000 7f33c7fff700 1 -- 172.21.15.146:0/4185942678 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f33d80149e0 con 0x7f33e00c8960 2023-10-06T11:18:26.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.015+0000 7f33c7fff700 1 --2- 172.21.15.146:0/4185942678 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f33cc066f30 0x7f33cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:26.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.015+0000 7f33c7fff700 1 -- 172.21.15.146:0/4185942678 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f33d8084dc0 con 0x7f33e00c8960 2023-10-06T11:18:26.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.015+0000 7f33dffff700 1 --2- 172.21.15.146:0/4185942678 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f33cc066f30 0x7f33cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:26.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.016+0000 7f33dffff700 1 --2- 172.21.15.146:0/4185942678 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f33cc066f30 0x7f33cc0693e0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f33d00039e0 tx=0x7f33d0007ec0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:26.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.019+0000 7f33c7fff700 1 -- 172.21.15.146:0/4185942678 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f33e00b0020 con 0x7f33e00c8960 2023-10-06T11:18:26.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.203+0000 7f33e6637700 1 -- 172.21.15.146:0/4185942678 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33e00b0020 con 0x7f33e00c8960 2023-10-06T11:18:26.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.204+0000 7f33c7fff700 1 -- 172.21.15.146:0/4185942678 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) v1 ==== 74+0+16941 (secure 0 0 0) 0x7f33e00b0020 con 0x7f33e00c8960 2023-10-06T11:18:26.206 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:18:26.206 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":162,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:18:25.258369+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:18:22.963878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-10-06T11:18:24.222990+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:18:26.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.206+0000 7f33e6637700 1 -- 172.21.15.146:0/4185942678 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f33cc066f30 msgr2=0x7f33cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:26.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.206+0000 7f33e6637700 1 --2- 172.21.15.146:0/4185942678 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f33cc066f30 0x7f33cc0693e0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f33d00039e0 tx=0x7f33d0007ec0 comp rx=0 tx=0).stop 2023-10-06T11:18:26.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.206+0000 7f33e6637700 1 -- 172.21.15.146:0/4185942678 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33e00c8960 msgr2=0x7f33e0158f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:26.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.206+0000 7f33e6637700 1 --2- 172.21.15.146:0/4185942678 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33e00c8960 0x7f33e0158f80 secure :-1 s=READY pgs=2094 cs=0 l=1 rev1=1 crypto rx=0x7f33d8009fa0 tx=0x7f33d8009900 comp rx=0 tx=0).stop 2023-10-06T11:18:26.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.206+0000 7f33e6637700 1 -- 172.21.15.146:0/4185942678 shutdown_connections 2023-10-06T11:18:26.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.206+0000 7f33e6637700 1 --2- 172.21.15.146:0/4185942678 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f33cc066f30 0x7f33cc0693e0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:26.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.206+0000 7f33e6637700 1 --2- 172.21.15.146:0/4185942678 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f33e00c8960 0x7f33e0158f80 unknown :-1 s=CLOSED pgs=2094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:26.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.206+0000 7f33e6637700 1 --2- 172.21.15.146:0/4185942678 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f33e006bd60 0x7f33e016d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:26.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.206+0000 7f33e6637700 1 --2- 172.21.15.146:0/4185942678 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f33e006eb20 0x7f33e00c1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:26.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.206+0000 7f33e6637700 1 -- 172.21.15.146:0/4185942678 >> 172.21.15.146:0/4185942678 conn(0x7f33e00c9f50 msgr2=0x7f33e00b2150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:26.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.206+0000 7f33e6637700 1 -- 172.21.15.146:0/4185942678 shutdown_connections 2023-10-06T11:18:26.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.206+0000 7f33e6637700 1 -- 172.21.15.146:0/4185942678 wait complete. 2023-10-06T11:18:26.220 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:18:26.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.334+0000 7fdc9a57a700 1 Processor -- start 2023-10-06T11:18:26.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.334+0000 7fdc9a57a700 1 -- start start 2023-10-06T11:18:26.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.334+0000 7fdc9a57a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc941538c0 0x7fdc94153c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:26.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.334+0000 7fdc9a57a700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc9415e140 con 0x7fdc9415dcc0 2023-10-06T11:18:26.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.334+0000 7fdc9a57a700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc9415d270 con 0x7fdc9415a940 2023-10-06T11:18:26.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.334+0000 7fdc9a57a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9415d830 con 0x7fdc941538c0 2023-10-06T11:18:26.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.335+0000 7fdc98b17700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fdc9415dcc0 0x7fdc940ce610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55358/0 (socket says 172.21.15.146:55358) 2023-10-06T11:18:26.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.335+0000 7fdc98b17700 1 -- 172.21.15.146:0/1702227715 learned_addr learned my addr 172.21.15.146:0/1702227715 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:26.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.335+0000 7fdc93fff700 1 --2- 172.21.15.146:0/1702227715 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc941538c0 0x7fdc94153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:26.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.335+0000 7fdc937fe700 1 -- 172.21.15.146:0/1702227715 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2237754136 0 0) 0x7fdc8c001490 con 0x7fdc9415dcc0 2023-10-06T11:18:26.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.335+0000 7fdc937fe700 1 -- 172.21.15.146:0/1702227715 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc80003570 con 0x7fdc9415dcc0 2023-10-06T11:18:26.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.335+0000 7fdc93fff700 1 -- 172.21.15.146:0/1702227715 >> v1:172.21.15.151:6789/0 conn(0x7fdc9415a940 legacy=0x7fdc940cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:26.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.335+0000 7fdc937fe700 1 -- 172.21.15.146:0/1702227715 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1972294534 0 0) 0x7fdc9415d270 con 0x7fdc9415a940 2023-10-06T11:18:26.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.335+0000 7fdc93fff700 1 -- 172.21.15.146:0/1702227715 >> v1:172.21.15.146:6789/0 conn(0x7fdc9415dcc0 legacy=0x7fdc940ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:26.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.335+0000 7fdc93fff700 1 -- 172.21.15.146:0/1702227715 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc940cb810 con 0x7fdc941538c0 2023-10-06T11:18:26.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.335+0000 7fdc93fff700 1 --2- 172.21.15.146:0/1702227715 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc941538c0 0x7fdc94153c90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdc84009910 tx=0x7fdc840091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d550aac3f0d242b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:26.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.335+0000 7fdc937fe700 1 -- 172.21.15.146:0/1702227715 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8400b680 con 0x7fdc941538c0 2023-10-06T11:18:26.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.336+0000 7fdc937fe700 1 -- 172.21.15.146:0/1702227715 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8400b7e0 con 0x7fdc941538c0 2023-10-06T11:18:26.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.336+0000 7fdc937fe700 1 -- 172.21.15.146:0/1702227715 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8400bba0 con 0x7fdc941538c0 2023-10-06T11:18:26.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.336+0000 7fdc9a57a700 1 -- 172.21.15.146:0/1702227715 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc941538c0 msgr2=0x7fdc94153c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:26.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.336+0000 7fdc9a57a700 1 --2- 172.21.15.146:0/1702227715 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc941538c0 0x7fdc94153c90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdc84009910 tx=0x7fdc840091a0 comp rx=0 tx=0).stop 2023-10-06T11:18:26.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.336+0000 7fdc9a57a700 1 -- 172.21.15.146:0/1702227715 shutdown_connections 2023-10-06T11:18:26.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.336+0000 7fdc9a57a700 1 --2- 172.21.15.146:0/1702227715 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc941538c0 0x7fdc94153c90 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:26.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.336+0000 7fdc9a57a700 1 -- 172.21.15.146:0/1702227715 >> 172.21.15.146:0/1702227715 conn(0x7fdc9406eb10 msgr2=0x7fdc9406ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:26.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.336+0000 7fdc9a57a700 1 -- 172.21.15.146:0/1702227715 shutdown_connections 2023-10-06T11:18:26.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.336+0000 7fdc9a57a700 1 -- 172.21.15.146:0/1702227715 wait complete. 2023-10-06T11:18:26.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.337+0000 7fdc9a57a700 1 Processor -- start 2023-10-06T11:18:26.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.337+0000 7fdc9a57a700 1 -- start start 2023-10-06T11:18:26.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.338+0000 7fdc9a57a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc941538c0 0x7fdc940b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:26.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.338+0000 7fdc9a57a700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc9415a940 0x7fdc9416d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:26.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.338+0000 7fdc9a57a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc9415dcc0 0x7fdc94148fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:26.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.338+0000 7fdc9a57a700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9416dd60 con 0x7fdc9415dcc0 2023-10-06T11:18:26.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.338+0000 7fdc9a57a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9415afd0 con 0x7fdc941538c0 2023-10-06T11:18:26.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.338+0000 7fdc9a57a700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc9416df90 con 0x7fdc9415a940 2023-10-06T11:18:26.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.338+0000 7fdc98b17700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc9415dcc0 0x7fdc94148fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:26.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.338+0000 7fdc98b17700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc9415dcc0 0x7fdc94148fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56922/0 (socket says 172.21.15.146:56922) 2023-10-06T11:18:26.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.338+0000 7fdc98b17700 1 -- 172.21.15.146:0/2343743267 learned_addr learned my addr 172.21.15.146:0/2343743267 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:26.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.338+0000 7fdc8bfff700 1 --2- 172.21.15.146:0/2343743267 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc9415a940 0x7fdc9416d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:26.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.338+0000 7fdc98b17700 1 -- 172.21.15.146:0/2343743267 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc9415a940 msgr2=0x7fdc9416d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:26.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.338+0000 7fdc93fff700 1 --2- 172.21.15.146:0/2343743267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc941538c0 0x7fdc940b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:26.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.338+0000 7fdc98b17700 1 --2- 172.21.15.146:0/2343743267 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc9415a940 0x7fdc9416d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:26.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.338+0000 7fdc98b17700 1 -- 172.21.15.146:0/2343743267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc941538c0 msgr2=0x7fdc940b0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:26.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.338+0000 7fdc98b17700 1 --2- 172.21.15.146:0/2343743267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc941538c0 0x7fdc940b0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:26.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.338+0000 7fdc98b17700 1 -- 172.21.15.146:0/2343743267 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc84009420 con 0x7fdc9415dcc0 2023-10-06T11:18:26.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.338+0000 7fdc98b17700 1 --2- 172.21.15.146:0/2343743267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc9415dcc0 0x7fdc94148fc0 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c00cc40 tx=0x7fdc8c001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:26.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.339+0000 7fdc90ff9700 1 -- 172.21.15.146:0/2343743267 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c00a960 con 0x7fdc9415dcc0 2023-10-06T11:18:26.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.339+0000 7fdc90ff9700 1 -- 172.21.15.146:0/2343743267 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8c00aac0 con 0x7fdc9415dcc0 2023-10-06T11:18:26.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.339+0000 7fdc90ff9700 1 -- 172.21.15.146:0/2343743267 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c00ae40 con 0x7fdc9415dcc0 2023-10-06T11:18:26.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.339+0000 7fdc9a57a700 1 -- 172.21.15.146:0/2343743267 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc9416e270 con 0x7fdc9415dcc0 2023-10-06T11:18:26.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.339+0000 7fdc9a57a700 1 -- 172.21.15.146:0/2343743267 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc94149500 con 0x7fdc9415dcc0 2023-10-06T11:18:26.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.339+0000 7fdc9a57a700 1 -- 172.21.15.146:0/2343743267 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc9416e790 con 0x7fdc9415dcc0 2023-10-06T11:18:26.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.340+0000 7fdc90ff9700 1 -- 172.21.15.146:0/2343743267 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdc8c007300 con 0x7fdc9415dcc0 2023-10-06T11:18:26.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.340+0000 7fdc90ff9700 1 --2- 172.21.15.146:0/2343743267 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdc74066f30 0x7fdc740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:26.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.340+0000 7fdc90ff9700 1 -- 172.21.15.146:0/2343743267 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdc8c0848c0 con 0x7fdc9415dcc0 2023-10-06T11:18:26.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.340+0000 7fdc93fff700 1 --2- 172.21.15.146:0/2343743267 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdc74066f30 0x7fdc740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:26.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.341+0000 7fdc93fff700 1 --2- 172.21.15.146:0/2343743267 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdc74066f30 0x7fdc740693e0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fdc84009860 tx=0x7fdc84017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:26.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.345+0000 7fdc90ff9700 1 -- 172.21.15.146:0/2343743267 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdc9416e790 con 0x7fdc9415dcc0 2023-10-06T11:18:26.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.530+0000 7fdc9a57a700 1 -- 172.21.15.146:0/2343743267 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc9415e140 con 0x7fdc9415dcc0 2023-10-06T11:18:26.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.531+0000 7fdc90ff9700 1 -- 172.21.15.146:0/2343743267 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v163) v1 ==== 74+0+16928 (secure 0 0 0) 0x7fdc9415e140 con 0x7fdc9415dcc0 2023-10-06T11:18:26.533 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:18:26.533 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":163,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:18:26.432530+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:18:22.963878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-10-06T11:18:24.222990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:18:26.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.533+0000 7fdc9a57a700 1 -- 172.21.15.146:0/2343743267 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdc74066f30 msgr2=0x7fdc740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:26.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.533+0000 7fdc9a57a700 1 --2- 172.21.15.146:0/2343743267 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdc74066f30 0x7fdc740693e0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fdc84009860 tx=0x7fdc84017000 comp rx=0 tx=0).stop 2023-10-06T11:18:26.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.533+0000 7fdc9a57a700 1 -- 172.21.15.146:0/2343743267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc9415dcc0 msgr2=0x7fdc94148fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:26.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.533+0000 7fdc9a57a700 1 --2- 172.21.15.146:0/2343743267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc9415dcc0 0x7fdc94148fc0 secure :-1 s=READY pgs=2096 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c00cc40 tx=0x7fdc8c001a30 comp rx=0 tx=0).stop 2023-10-06T11:18:26.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.533+0000 7fdc9a57a700 1 -- 172.21.15.146:0/2343743267 shutdown_connections 2023-10-06T11:18:26.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.533+0000 7fdc9a57a700 1 --2- 172.21.15.146:0/2343743267 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdc74066f30 0x7fdc740693e0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:26.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.533+0000 7fdc9a57a700 1 --2- 172.21.15.146:0/2343743267 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdc9415dcc0 0x7fdc94148fc0 unknown :-1 s=CLOSED pgs=2096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:26.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.533+0000 7fdc9a57a700 1 --2- 172.21.15.146:0/2343743267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc941538c0 0x7fdc940b0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:26.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.533+0000 7fdc9a57a700 1 --2- 172.21.15.146:0/2343743267 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc9415a940 0x7fdc9416d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:26.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.533+0000 7fdc9a57a700 1 -- 172.21.15.146:0/2343743267 >> 172.21.15.146:0/2343743267 conn(0x7fdc9406eb10 msgr2=0x7fdc940689e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:26.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.533+0000 7fdc9a57a700 1 -- 172.21.15.146:0/2343743267 shutdown_connections 2023-10-06T11:18:26.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.533+0000 7fdc9a57a700 1 -- 172.21.15.146:0/2343743267 wait complete. 2023-10-06T11:18:26.547 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T11:18:26.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.666+0000 7ff80359e700 1 Processor -- start 2023-10-06T11:18:26.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.666+0000 7ff80359e700 1 -- start start 2023-10-06T11:18:26.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.667+0000 7ff80359e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff804143040 0x7ff8040b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:26.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.667+0000 7ff80359e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff8040b5430 0x7ff8040b2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:26.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.667+0000 7ff80359e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8040cf100 con 0x7ff804143410 2023-10-06T11:18:26.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.667+0000 7ff80359e700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8040b4170 con 0x7ff8040b5430 2023-10-06T11:18:26.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.667+0000 7ff80359e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8040b5f50 con 0x7ff804143040 2023-10-06T11:18:26.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.667+0000 7ff80259c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff804143040 0x7ff8040b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:26.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.667+0000 7ff802d9d700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff8040b5430 0x7ff8040b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:26.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.667+0000 7ff80259c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff804143040 0x7ff8040b1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:52660/0 (socket says 172.21.15.146:52660) 2023-10-06T11:18:26.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.667+0000 7ff80259c700 1 -- 172.21.15.146:0/3265052491 learned_addr learned my addr 172.21.15.146:0/3265052491 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:26.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.668+0000 7ff80259c700 1 -- 172.21.15.146:0/3265052491 >> v2:172.21.15.151:3300/0 conn(0x7ff8040b5430 msgr2=0x7ff8040b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:26.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.668+0000 7ff80259c700 1 --2- 172.21.15.146:0/3265052491 >> v2:172.21.15.151:3300/0 conn(0x7ff8040b5430 0x7ff8040b2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:26.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.668+0000 7ff80259c700 1 -- 172.21.15.146:0/3265052491 >> v1:172.21.15.151:6789/0 conn(0x7ff804143410 legacy=0x7ff8040b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:26.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.668+0000 7ff80259c700 1 -- 172.21.15.146:0/3265052491 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8040ceb30 con 0x7ff804143040 2023-10-06T11:18:26.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.668+0000 7ff801d9b700 1 -- 172.21.15.146:0/3265052491 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3142918760 0 0) 0x7ff8040cf100 con 0x7ff804143410 2023-10-06T11:18:26.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.668+0000 7ff802d9d700 1 --2- 172.21.15.146:0/3265052491 >> v2:172.21.15.151:3300/0 conn(0x7ff8040b5430 0x7ff8040b2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:18:26.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.668+0000 7ff80259c700 1 --2- 172.21.15.146:0/3265052491 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff804143040 0x7ff8040b1e20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff7f40099b0 tx=0x7ff7f4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=982692ba383e4106 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:26.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.668+0000 7ff801d9b700 1 -- 172.21.15.146:0/3265052491 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f4009ea0 con 0x7ff804143040 2023-10-06T11:18:26.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.668+0000 7ff801d9b700 1 -- 172.21.15.146:0/3265052491 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f400b860 con 0x7ff804143040 2023-10-06T11:18:26.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.668+0000 7ff801d9b700 1 -- 172.21.15.146:0/3265052491 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f400bc00 con 0x7ff804143040 2023-10-06T11:18:26.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.668+0000 7ff80359e700 1 -- 172.21.15.146:0/3265052491 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff804143040 msgr2=0x7ff8040b1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:26.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.668+0000 7ff80359e700 1 --2- 172.21.15.146:0/3265052491 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff804143040 0x7ff8040b1e20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff7f40099b0 tx=0x7ff7f4009250 comp rx=0 tx=0).stop 2023-10-06T11:18:26.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.668+0000 7ff80359e700 1 -- 172.21.15.146:0/3265052491 shutdown_connections 2023-10-06T11:18:26.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.668+0000 7ff80359e700 1 --2- 172.21.15.146:0/3265052491 >> v2:172.21.15.151:3300/0 conn(0x7ff8040b5430 0x7ff8040b2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:26.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.668+0000 7ff80359e700 1 --2- 172.21.15.146:0/3265052491 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff804143040 0x7ff8040b1e20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:26.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.668+0000 7ff80359e700 1 -- 172.21.15.146:0/3265052491 >> 172.21.15.146:0/3265052491 conn(0x7ff80406eb10 msgr2=0x7ff80406ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:26.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.668+0000 7ff80359e700 1 -- 172.21.15.146:0/3265052491 shutdown_connections 2023-10-06T11:18:26.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.669+0000 7ff80359e700 1 -- 172.21.15.146:0/3265052491 wait complete. 2023-10-06T11:18:26.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.670+0000 7ff80359e700 1 Processor -- start 2023-10-06T11:18:26.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.670+0000 7ff80359e700 1 -- start start 2023-10-06T11:18:26.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.670+0000 7ff80359e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8040b5430 0x7ff804130570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:26.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.670+0000 7ff80359e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff804143040 0x7ff8040cac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:26.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.670+0000 7ff80359e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff804143410 0x7ff80416cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:26.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.670+0000 7ff80359e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8040cc2b0 con 0x7ff804143040 2023-10-06T11:18:26.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.670+0000 7ff80359e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8040cb630 con 0x7ff804143410 2023-10-06T11:18:26.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.670+0000 7ff80359e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8040cb910 con 0x7ff8040b5430 2023-10-06T11:18:26.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.671+0000 7ff7f9d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff804143040 0x7ff8040cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:26.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.671+0000 7ff7f9d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff804143040 0x7ff8040cac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56932/0 (socket says 172.21.15.146:56932) 2023-10-06T11:18:26.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.671+0000 7ff7f9d9b700 1 -- 172.21.15.146:0/2960278212 learned_addr learned my addr 172.21.15.146:0/2960278212 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:26.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.671+0000 7ff80259c700 1 --2- 172.21.15.146:0/2960278212 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8040b5430 0x7ff804130570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:26.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.671+0000 7ff802d9d700 1 --2- 172.21.15.146:0/2960278212 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff804143410 0x7ff80416cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:26.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.671+0000 7ff7f9d9b700 1 -- 172.21.15.146:0/2960278212 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8040b5430 msgr2=0x7ff804130570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:26.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.671+0000 7ff7f9d9b700 1 --2- 172.21.15.146:0/2960278212 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8040b5430 0x7ff804130570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:26.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.671+0000 7ff7f9d9b700 1 -- 172.21.15.146:0/2960278212 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff804143410 msgr2=0x7ff80416cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:26.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.671+0000 7ff7f9d9b700 1 --2- 172.21.15.146:0/2960278212 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff804143410 0x7ff80416cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:26.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.671+0000 7ff7f9d9b700 1 -- 172.21.15.146:0/2960278212 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7fc009a20 con 0x7ff804143040 2023-10-06T11:18:26.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.671+0000 7ff7f9d9b700 1 --2- 172.21.15.146:0/2960278212 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff804143040 0x7ff8040cac00 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec00c530 tx=0x7ff7ec00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:26.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.671+0000 7ff7faffd700 1 -- 172.21.15.146:0/2960278212 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ec011590 con 0x7ff804143040 2023-10-06T11:18:26.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.671+0000 7ff7faffd700 1 -- 172.21.15.146:0/2960278212 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7ec011710 con 0x7ff804143040 2023-10-06T11:18:26.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.671+0000 7ff80359e700 1 -- 172.21.15.146:0/2960278212 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7f40094f0 con 0x7ff804143040 2023-10-06T11:18:26.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.671+0000 7ff7faffd700 1 -- 172.21.15.146:0/2960278212 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ec011ad0 con 0x7ff804143040 2023-10-06T11:18:26.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.671+0000 7ff80359e700 1 -- 172.21.15.146:0/2960278212 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8040cbed0 con 0x7ff804143040 2023-10-06T11:18:26.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.672+0000 7ff80359e700 1 -- 172.21.15.146:0/2960278212 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8040cc3f0 con 0x7ff804143040 2023-10-06T11:18:26.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.672+0000 7ff7faffd700 1 -- 172.21.15.146:0/2960278212 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff7ec01b3b0 con 0x7ff804143040 2023-10-06T11:18:26.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.673+0000 7ff7faffd700 1 --2- 172.21.15.146:0/2960278212 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff7e4066f30 0x7ff7e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:26.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.673+0000 7ff7faffd700 1 -- 172.21.15.146:0/2960278212 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff7ec083b10 con 0x7ff804143040 2023-10-06T11:18:26.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.673+0000 7ff80259c700 1 --2- 172.21.15.146:0/2960278212 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff7e4066f30 0x7ff7e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:26.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.673+0000 7ff80259c700 1 --2- 172.21.15.146:0/2960278212 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff7e4066f30 0x7ff7e40693e0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7ff7f40099b0 tx=0x7ff7f4017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:26.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.677+0000 7ff7faffd700 1 -- 172.21.15.146:0/2960278212 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff8040cc3f0 con 0x7ff804143040 2023-10-06T11:18:26.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:26.903+0000 7ff80359e700 1 -- 172.21.15.146:0/2960278212 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff8040cc3f0 con 0x7ff804143040 2023-10-06T11:18:27.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:27.884+0000 7ff7faffd700 1 -- 172.21.15.146:0/2960278212 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v135) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff8040cc3f0 con 0x7ff804143040 2023-10-06T11:18:27.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:27.887+0000 7ff80359e700 1 -- 172.21.15.146:0/2960278212 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff7e4066f30 msgr2=0x7ff7e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:27.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:27.887+0000 7ff80359e700 1 --2- 172.21.15.146:0/2960278212 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff7e4066f30 0x7ff7e40693e0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7ff7f40099b0 tx=0x7ff7f4017000 comp rx=0 tx=0).stop 2023-10-06T11:18:27.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:27.887+0000 7ff80359e700 1 -- 172.21.15.146:0/2960278212 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff804143040 msgr2=0x7ff8040cac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:27.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:27.887+0000 7ff80359e700 1 --2- 172.21.15.146:0/2960278212 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff804143040 0x7ff8040cac00 secure :-1 s=READY pgs=2097 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec00c530 tx=0x7ff7ec00c840 comp rx=0 tx=0).stop 2023-10-06T11:18:27.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:27.887+0000 7ff80359e700 1 -- 172.21.15.146:0/2960278212 shutdown_connections 2023-10-06T11:18:27.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:27.887+0000 7ff80359e700 1 --2- 172.21.15.146:0/2960278212 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff7e4066f30 0x7ff7e40693e0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:27.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:27.887+0000 7ff80359e700 1 --2- 172.21.15.146:0/2960278212 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff804143410 0x7ff80416cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:27.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:27.887+0000 7ff80359e700 1 --2- 172.21.15.146:0/2960278212 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8040b5430 0x7ff804130570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:27.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:27.887+0000 7ff80359e700 1 --2- 172.21.15.146:0/2960278212 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff804143040 0x7ff8040cac00 unknown :-1 s=CLOSED pgs=2097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:27.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:27.887+0000 7ff80359e700 1 -- 172.21.15.146:0/2960278212 >> 172.21.15.146:0/2960278212 conn(0x7ff80406eb10 msgr2=0x7ff8040b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:27.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:27.887+0000 7ff80359e700 1 -- 172.21.15.146:0/2960278212 shutdown_connections 2023-10-06T11:18:27.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:27.887+0000 7ff80359e700 1 -- 172.21.15.146:0/2960278212 wait complete. 2023-10-06T11:18:27.901 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T11:18:28.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.018+0000 7fae22068700 1 Processor -- start 2023-10-06T11:18:28.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.018+0000 7fae22068700 1 -- start start 2023-10-06T11:18:28.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.019+0000 7fae22068700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae1c159840 0x7fae1c0d0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:28.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.019+0000 7fae22068700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fae1c0d0ad0 0x7fae1c0ce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:28.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.019+0000 7fae22068700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae1c0d0f20 con 0x7fae1c159470 2023-10-06T11:18:28.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.019+0000 7fae22068700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae1c0cdeb0 con 0x7fae1c0d0ad0 2023-10-06T11:18:28.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.019+0000 7fae22068700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c0cd2a0 con 0x7fae1c159840 2023-10-06T11:18:28.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.019+0000 7fae1bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fae1c0d0ad0 0x7fae1c0ce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:28.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.019+0000 7fae1b7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fae1c159470 0x7fae1c0cb630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55370/0 (socket says 172.21.15.146:55370) 2023-10-06T11:18:28.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.019+0000 7fae1b7fe700 1 -- 172.21.15.146:0/1327044768 learned_addr learned my addr 172.21.15.146:0/1327044768 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:28.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.019+0000 7fae1affd700 1 --2- 172.21.15.146:0/1327044768 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae1c159840 0x7fae1c0d0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:28.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.019+0000 7fae1bfff700 1 -- 172.21.15.146:0/1327044768 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae1c159840 msgr2=0x7fae1c0d0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:28.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.019+0000 7fae1bfff700 1 --2- 172.21.15.146:0/1327044768 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae1c159840 0x7fae1c0d0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:28.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.019+0000 7fae1bfff700 1 -- 172.21.15.146:0/1327044768 >> v1:172.21.15.146:6789/0 conn(0x7fae1c159470 legacy=0x7fae1c0cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:28.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.019+0000 7fae1a7fc700 1 -- 172.21.15.146:0/1327044768 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1193747146 0 0) 0x7fae1c0d0f20 con 0x7fae1c159470 2023-10-06T11:18:28.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.019+0000 7fae1bfff700 1 -- 172.21.15.146:0/1327044768 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae1c0cd580 con 0x7fae1c0d0ad0 2023-10-06T11:18:28.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.019+0000 7fae1bfff700 1 --2- 172.21.15.146:0/1327044768 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae1c0d0ad0 0x7fae1c0ce9a0 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 crypto rx=0x7fae14009e60 tx=0x7fae14009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4974118fa08ad3ec server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:28.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.019+0000 7fae1a7fc700 1 -- 172.21.15.146:0/1327044768 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1400e070 con 0x7fae1c0d0ad0 2023-10-06T11:18:28.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.019+0000 7fae1a7fc700 1 -- 172.21.15.146:0/1327044768 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae1400bb60 con 0x7fae1c0d0ad0 2023-10-06T11:18:28.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.019+0000 7fae1a7fc700 1 -- 172.21.15.146:0/1327044768 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae14012430 con 0x7fae1c0d0ad0 2023-10-06T11:18:28.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.020+0000 7fae22068700 1 -- 172.21.15.146:0/1327044768 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae1c0d0ad0 msgr2=0x7fae1c0ce9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:28.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.020+0000 7fae22068700 1 --2- 172.21.15.146:0/1327044768 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae1c0d0ad0 0x7fae1c0ce9a0 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 crypto rx=0x7fae14009e60 tx=0x7fae14009780 comp rx=0 tx=0).stop 2023-10-06T11:18:28.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.020+0000 7fae22068700 1 -- 172.21.15.146:0/1327044768 shutdown_connections 2023-10-06T11:18:28.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.020+0000 7fae22068700 1 --2- 172.21.15.146:0/1327044768 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae1c0d0ad0 0x7fae1c0ce9a0 unknown :-1 s=CLOSED pgs=2099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:28.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.020+0000 7fae22068700 1 --2- 172.21.15.146:0/1327044768 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae1c159840 0x7fae1c0d0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:28.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.020+0000 7fae22068700 1 -- 172.21.15.146:0/1327044768 >> 172.21.15.146:0/1327044768 conn(0x7fae1c06eb10 msgr2=0x7fae1c06ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:28.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.020+0000 7fae22068700 1 -- 172.21.15.146:0/1327044768 shutdown_connections 2023-10-06T11:18:28.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.020+0000 7fae22068700 1 -- 172.21.15.146:0/1327044768 wait complete. 2023-10-06T11:18:28.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.021+0000 7fae22068700 1 Processor -- start 2023-10-06T11:18:28.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.021+0000 7fae22068700 1 -- start start 2023-10-06T11:18:28.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.022+0000 7fae22068700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae1c0d0ad0 0x7fae1c155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:28.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.022+0000 7fae22068700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae1c159470 0x7fae1c16d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:28.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.022+0000 7fae22068700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae1c159840 0x7fae1c16c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:28.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.022+0000 7fae22068700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c1568a0 con 0x7fae1c159840 2023-10-06T11:18:28.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.022+0000 7fae22068700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c155c90 con 0x7fae1c0d0ad0 2023-10-06T11:18:28.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.022+0000 7fae22068700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c155f70 con 0x7fae1c159470 2023-10-06T11:18:28.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.022+0000 7fae1bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae1c159840 0x7fae1c16c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:28.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.022+0000 7fae1bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae1c159840 0x7fae1c16c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56958/0 (socket says 172.21.15.146:56958) 2023-10-06T11:18:28.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.022+0000 7fae1bfff700 1 -- 172.21.15.146:0/3728606713 learned_addr learned my addr 172.21.15.146:0/3728606713 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:28.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.022+0000 7fae1b7fe700 1 --2- 172.21.15.146:0/3728606713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae1c0d0ad0 0x7fae1c155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:28.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.022+0000 7fae1affd700 1 --2- 172.21.15.146:0/3728606713 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae1c159470 0x7fae1c16d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:28.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.022+0000 7fae1bfff700 1 -- 172.21.15.146:0/3728606713 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae1c159470 msgr2=0x7fae1c16d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:28.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.022+0000 7fae1bfff700 1 --2- 172.21.15.146:0/3728606713 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae1c159470 0x7fae1c16d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:28.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.022+0000 7fae1bfff700 1 -- 172.21.15.146:0/3728606713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae1c0d0ad0 msgr2=0x7fae1c155600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:28.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.022+0000 7fae1bfff700 1 --2- 172.21.15.146:0/3728606713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae1c0d0ad0 0x7fae1c155600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:28.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.022+0000 7fae1bfff700 1 -- 172.21.15.146:0/3728606713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae14009a20 con 0x7fae1c159840 2023-10-06T11:18:28.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.023+0000 7fae1bfff700 1 --2- 172.21.15.146:0/3728606713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae1c159840 0x7fae1c16c6f0 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7fae1c0696b0 tx=0x7fae14019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:28.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.023+0000 7fae037fe700 1 -- 172.21.15.146:0/3728606713 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae14027470 con 0x7fae1c159840 2023-10-06T11:18:28.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.023+0000 7fae037fe700 1 -- 172.21.15.146:0/3728606713 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae14027610 con 0x7fae1c159840 2023-10-06T11:18:28.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.023+0000 7fae22068700 1 -- 172.21.15.146:0/3728606713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae1c156250 con 0x7fae1c159840 2023-10-06T11:18:28.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.023+0000 7fae037fe700 1 -- 172.21.15.146:0/3728606713 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae140279d0 con 0x7fae1c159840 2023-10-06T11:18:28.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.023+0000 7fae22068700 1 -- 172.21.15.146:0/3728606713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae1c16cc30 con 0x7fae1c159840 2023-10-06T11:18:28.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.024+0000 7fae22068700 1 -- 172.21.15.146:0/3728606713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae1c04c380 con 0x7fae1c159840 2023-10-06T11:18:28.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.024+0000 7fae037fe700 1 -- 172.21.15.146:0/3728606713 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fae14024070 con 0x7fae1c159840 2023-10-06T11:18:28.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.024+0000 7fae037fe700 1 --2- 172.21.15.146:0/3728606713 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fae08066f30 0x7fae080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:28.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.025+0000 7fae037fe700 1 -- 172.21.15.146:0/3728606713 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fae14087140 con 0x7fae1c159840 2023-10-06T11:18:28.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.025+0000 7fae1b7fe700 1 --2- 172.21.15.146:0/3728606713 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fae08066f30 0x7fae080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:28.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.025+0000 7fae1b7fe700 1 --2- 172.21.15.146:0/3728606713 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fae08066f30 0x7fae080693e0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fae0c0011e0 tx=0x7fae0c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:28.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.029+0000 7fae037fe700 1 -- 172.21.15.146:0/3728606713 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fae14054250 con 0x7fae1c159840 2023-10-06T11:18:28.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.258+0000 7fae22068700 1 -- 172.21.15.146:0/3728606713 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fae1c0ca4c0 con 0x7fae1c159840 2023-10-06T11:18:28.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.889+0000 7fae037fe700 1 -- 172.21.15.146:0/3728606713 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v136) v1 ==== 122+0+0 (secure 0 0 0) 0x7fae14057870 con 0x7fae1c159840 2023-10-06T11:18:28.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.891+0000 7fae22068700 1 -- 172.21.15.146:0/3728606713 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fae08066f30 msgr2=0x7fae080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:28.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.891+0000 7fae22068700 1 --2- 172.21.15.146:0/3728606713 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fae08066f30 0x7fae080693e0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fae0c0011e0 tx=0x7fae0c009040 comp rx=0 tx=0).stop 2023-10-06T11:18:28.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.891+0000 7fae22068700 1 -- 172.21.15.146:0/3728606713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae1c159840 msgr2=0x7fae1c16c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:28.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.891+0000 7fae22068700 1 --2- 172.21.15.146:0/3728606713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae1c159840 0x7fae1c16c6f0 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7fae1c0696b0 tx=0x7fae14019000 comp rx=0 tx=0).stop 2023-10-06T11:18:28.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.891+0000 7fae22068700 1 -- 172.21.15.146:0/3728606713 shutdown_connections 2023-10-06T11:18:28.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.891+0000 7fae22068700 1 --2- 172.21.15.146:0/3728606713 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fae08066f30 0x7fae080693e0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:28.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.891+0000 7fae22068700 1 --2- 172.21.15.146:0/3728606713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fae1c159840 0x7fae1c16c6f0 unknown :-1 s=CLOSED pgs=2100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:28.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.891+0000 7fae22068700 1 --2- 172.21.15.146:0/3728606713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae1c0d0ad0 0x7fae1c155600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:28.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.891+0000 7fae22068700 1 --2- 172.21.15.146:0/3728606713 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fae1c159470 0x7fae1c16d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:28.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.891+0000 7fae22068700 1 -- 172.21.15.146:0/3728606713 >> 172.21.15.146:0/3728606713 conn(0x7fae1c06eb10 msgr2=0x7fae1c154c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:28.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.891+0000 7fae22068700 1 -- 172.21.15.146:0/3728606713 shutdown_connections 2023-10-06T11:18:28.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:28.891+0000 7fae22068700 1 -- 172.21.15.146:0/3728606713 wait complete. 2023-10-06T11:18:28.906 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:18:29.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.020+0000 7f300e41b700 1 Processor -- start 2023-10-06T11:18:29.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.020+0000 7f300e41b700 1 -- start start 2023-10-06T11:18:29.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.021+0000 7f300e41b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f30080b08e0 0x7f30080b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:29.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.021+0000 7f300e41b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f30080b25a0 0x7f30080b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:29.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.021+0000 7f300e41b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30080b1bd0 con 0x7f30081596e0 2023-10-06T11:18:29.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.021+0000 7f300e41b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30080b0d50 con 0x7f30080b25a0 2023-10-06T11:18:29.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.021+0000 7f300e41b700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30080b4aa0 con 0x7f30080b08e0 2023-10-06T11:18:29.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.021+0000 7f300c9b8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f30080b25a0 0x7f30080b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:29.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.021+0000 7f3007fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f30081596e0 0x7f3008159ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55374/0 (socket says 172.21.15.146:55374) 2023-10-06T11:18:29.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.021+0000 7f3007fff700 1 -- 172.21.15.146:0/1650581606 learned_addr learned my addr 172.21.15.146:0/1650581606 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:29.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.021+0000 7f300c9b8700 1 -- 172.21.15.146:0/1650581606 >> v2:172.21.15.151:3300/0 conn(0x7f30080b08e0 msgr2=0x7f30080b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:29.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.021+0000 7f300c9b8700 1 --2- 172.21.15.146:0/1650581606 >> v2:172.21.15.151:3300/0 conn(0x7f30080b08e0 0x7f30080b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:29.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.021+0000 7f300c9b8700 1 -- 172.21.15.146:0/1650581606 >> v1:172.21.15.146:6789/0 conn(0x7f30081596e0 legacy=0x7f3008159ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:29.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.021+0000 7f300c9b8700 1 -- 172.21.15.146:0/1650581606 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30080b2f20 con 0x7f30080b25a0 2023-10-06T11:18:29.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.022+0000 7f300c9b8700 1 --2- 172.21.15.146:0/1650581606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30080b25a0 0x7f30080b29e0 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7f3008088980 tx=0x7f3000009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=807eac4df6cb430 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:29.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.022+0000 7f3006ffd700 1 -- 172.21.15.146:0/1650581606 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300000e070 con 0x7f30080b25a0 2023-10-06T11:18:29.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.022+0000 7f3006ffd700 1 -- 172.21.15.146:0/1650581606 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f300000bc30 con 0x7f30080b25a0 2023-10-06T11:18:29.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.022+0000 7f3006ffd700 1 -- 172.21.15.146:0/1650581606 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3000012430 con 0x7f30080b25a0 2023-10-06T11:18:29.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.022+0000 7f300e41b700 1 -- 172.21.15.146:0/1650581606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30080b25a0 msgr2=0x7f30080b29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:29.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.022+0000 7f300e41b700 1 --2- 172.21.15.146:0/1650581606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30080b25a0 0x7f30080b29e0 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7f3008088980 tx=0x7f3000009780 comp rx=0 tx=0).stop 2023-10-06T11:18:29.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.022+0000 7f300e41b700 1 -- 172.21.15.146:0/1650581606 shutdown_connections 2023-10-06T11:18:29.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.022+0000 7f300e41b700 1 --2- 172.21.15.146:0/1650581606 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30080b25a0 0x7f30080b29e0 unknown :-1 s=CLOSED pgs=2102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:29.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.022+0000 7f300e41b700 1 --2- 172.21.15.146:0/1650581606 >> v2:172.21.15.151:3300/0 conn(0x7f30080b08e0 0x7f30080b2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:29.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.022+0000 7f300e41b700 1 -- 172.21.15.146:0/1650581606 >> 172.21.15.146:0/1650581606 conn(0x7f300808a030 msgr2=0x7f3008099950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:29.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.022+0000 7f300e41b700 1 -- 172.21.15.146:0/1650581606 shutdown_connections 2023-10-06T11:18:29.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.022+0000 7f300e41b700 1 -- 172.21.15.146:0/1650581606 wait complete. 2023-10-06T11:18:29.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.023+0000 7f300e41b700 1 Processor -- start 2023-10-06T11:18:29.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.024+0000 7f300e41b700 1 -- start start 2023-10-06T11:18:29.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.024+0000 7f300e41b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30080b08e0 0x7f30080d0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:29.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.024+0000 7f300e41b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30080b25a0 0x7f30080d0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:29.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.024+0000 7f300e41b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30081596e0 0x7f30080ad4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:29.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.024+0000 7f300e41b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30080ae1e0 con 0x7f30080b25a0 2023-10-06T11:18:29.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.024+0000 7f300e41b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30080ae4c0 con 0x7f30081596e0 2023-10-06T11:18:29.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.024+0000 7f300e41b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30080ae7a0 con 0x7f30080b08e0 2023-10-06T11:18:29.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.024+0000 7f30077fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30080b25a0 0x7f30080d0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:29.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.024+0000 7f30077fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30080b25a0 0x7f30080d0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56970/0 (socket says 172.21.15.146:56970) 2023-10-06T11:18:29.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.024+0000 7f30077fe700 1 -- 172.21.15.146:0/1406112531 learned_addr learned my addr 172.21.15.146:0/1406112531 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:29.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.024+0000 7f3007fff700 1 --2- 172.21.15.146:0/1406112531 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30080b08e0 0x7f30080d0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:29.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.024+0000 7f300c9b8700 1 --2- 172.21.15.146:0/1406112531 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30081596e0 0x7f30080ad4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:29.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.025+0000 7f30077fe700 1 -- 172.21.15.146:0/1406112531 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30080b08e0 msgr2=0x7f30080d0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:29.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.025+0000 7f30077fe700 1 --2- 172.21.15.146:0/1406112531 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30080b08e0 0x7f30080d0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:29.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.025+0000 7f30077fe700 1 -- 172.21.15.146:0/1406112531 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30081596e0 msgr2=0x7f30080ad4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:29.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.025+0000 7f30077fe700 1 --2- 172.21.15.146:0/1406112531 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30081596e0 0x7f30080ad4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:29.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.025+0000 7f30077fe700 1 -- 172.21.15.146:0/1406112531 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3000009a20 con 0x7f30080b25a0 2023-10-06T11:18:29.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.025+0000 7f300c9b8700 1 --2- 172.21.15.146:0/1406112531 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30081596e0 0x7f30080ad4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:18:29.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.025+0000 7f30077fe700 1 --2- 172.21.15.146:0/1406112531 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30080b25a0 0x7f30080d0da0 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc00b810 tx=0x7f2ffc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:29.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.025+0000 7f2feffff700 1 -- 172.21.15.146:0/1406112531 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc00f510 con 0x7f30080b25a0 2023-10-06T11:18:29.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.025+0000 7f2feffff700 1 -- 172.21.15.146:0/1406112531 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ffc00f690 con 0x7f30080b25a0 2023-10-06T11:18:29.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.025+0000 7f300e41b700 1 -- 172.21.15.146:0/1406112531 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30080aea80 con 0x7f30080b25a0 2023-10-06T11:18:29.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.025+0000 7f2feffff700 1 -- 172.21.15.146:0/1406112531 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc00fa50 con 0x7f30080b25a0 2023-10-06T11:18:29.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.025+0000 7f300e41b700 1 -- 172.21.15.146:0/1406112531 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3008157ed0 con 0x7f30080b25a0 2023-10-06T11:18:29.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.026+0000 7f300e41b700 1 -- 172.21.15.146:0/1406112531 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30080aefa0 con 0x7f30080b25a0 2023-10-06T11:18:29.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.027+0000 7f2feffff700 1 -- 172.21.15.146:0/1406112531 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2ffc01a400 con 0x7f30080b25a0 2023-10-06T11:18:29.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.027+0000 7f2feffff700 1 --2- 172.21.15.146:0/1406112531 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2ff4066f30 0x7f2ff40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:29.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.027+0000 7f2feffff700 1 -- 172.21.15.146:0/1406112531 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2ffc084220 con 0x7f30080b25a0 2023-10-06T11:18:29.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.027+0000 7f3007fff700 1 --2- 172.21.15.146:0/1406112531 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2ff4066f30 0x7f2ff40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:29.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.027+0000 7f3007fff700 1 --2- 172.21.15.146:0/1406112531 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2ff4066f30 0x7f2ff40693e0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8002950 tx=0x7f2ff8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:29.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.031+0000 7f2feffff700 1 -- 172.21.15.146:0/1406112531 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f30080aefa0 con 0x7f30080b25a0 2023-10-06T11:18:29.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.256+0000 7f300e41b700 1 -- 172.21.15.146:0/1406112531 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f30080aefa0 con 0x7f30080b25a0 2023-10-06T11:18:29.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.256+0000 7f2feffff700 1 -- 172.21.15.146:0/1406112531 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 136 v136) v1 ==== 95+0+4620 (secure 0 0 0) 0x7f30080aefa0 con 0x7f30080b25a0 2023-10-06T11:18:29.259 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:18:29.259 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":136,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7694,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3150776091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3150776091},{"type":"v1","addr":"172.21.15.151:6834","nonce":3150776091}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":131},{"gid":8836,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/731448405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":731448405},{"type":"v1","addr":"172.21.15.151:6835","nonce":731448405}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":131},{"gid":10077,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2392749618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2392749618},{"type":"v1","addr":"172.21.15.146:6836","nonce":2392749618}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":131}],"filesystems":[{"mdsmap":{"epoch":136,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:18:25.258682+0000","modified":"2023-10-06T11:18:28.884125+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10080},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10080":{"gid":10080,"name":"a","rank":0,"incarnation":132,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/1340411581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":1340411581},{"type":"v1","addr":"172.21.15.146:6837","nonce":1340411581}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-06T11:18:29.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.258+0000 7f300e41b700 1 -- 172.21.15.146:0/1406112531 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2ff4066f30 msgr2=0x7f2ff40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:29.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.258+0000 7f300e41b700 1 --2- 172.21.15.146:0/1406112531 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2ff4066f30 0x7f2ff40693e0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f2ff8002950 tx=0x7f2ff8009040 comp rx=0 tx=0).stop 2023-10-06T11:18:29.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.258+0000 7f300e41b700 1 -- 172.21.15.146:0/1406112531 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30080b25a0 msgr2=0x7f30080d0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:29.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.258+0000 7f300e41b700 1 --2- 172.21.15.146:0/1406112531 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30080b25a0 0x7f30080d0da0 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc00b810 tx=0x7f2ffc009250 comp rx=0 tx=0).stop 2023-10-06T11:18:29.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.258+0000 7f300e41b700 1 -- 172.21.15.146:0/1406112531 shutdown_connections 2023-10-06T11:18:29.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.258+0000 7f300e41b700 1 --2- 172.21.15.146:0/1406112531 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2ff4066f30 0x7f2ff40693e0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:29.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.258+0000 7f300e41b700 1 --2- 172.21.15.146:0/1406112531 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30081596e0 0x7f30080ad4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:29.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.258+0000 7f300e41b700 1 --2- 172.21.15.146:0/1406112531 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f30080b08e0 0x7f30080d0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:29.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.258+0000 7f300e41b700 1 --2- 172.21.15.146:0/1406112531 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f30080b25a0 0x7f30080d0da0 unknown :-1 s=CLOSED pgs=2103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:29.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.258+0000 7f300e41b700 1 -- 172.21.15.146:0/1406112531 >> 172.21.15.146:0/1406112531 conn(0x7f300808a030 msgr2=0x7f3008158970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:29.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.258+0000 7f300e41b700 1 -- 172.21.15.146:0/1406112531 shutdown_connections 2023-10-06T11:18:29.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.259+0000 7f300e41b700 1 -- 172.21.15.146:0/1406112531 wait complete. 2023-10-06T11:18:29.262 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 136 2023-10-06T11:18:29.273 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:18:29.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.386+0000 7fad36206700 1 Processor -- start 2023-10-06T11:18:29.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.386+0000 7fad36206700 1 -- start start 2023-10-06T11:18:29.391 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.387+0000 7fad36206700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad300cd0b0 0x7fad3015abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:29.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.387+0000 7fad36206700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad300b6070 con 0x7fad300cd480 2023-10-06T11:18:29.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.387+0000 7fad36206700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad300b0280 con 0x7fad300b09f0 2023-10-06T11:18:29.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.387+0000 7fad36206700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad3015ddf0 con 0x7fad300cd0b0 2023-10-06T11:18:29.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.387+0000 7fad2effd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fad300cd480 0x7fad3015d610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55386/0 (socket says 172.21.15.146:55386) 2023-10-06T11:18:29.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.387+0000 7fad2effd700 1 -- 172.21.15.146:0/2338045943 learned_addr learned my addr 172.21.15.146:0/2338045943 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:29.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.387+0000 7fad2f7fe700 1 --2- 172.21.15.146:0/2338045943 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad300cd0b0 0x7fad3015abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:29.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.387+0000 7fad2e7fc700 1 -- 172.21.15.146:0/2338045943 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1164016961 0 0) 0x7fad300b6070 con 0x7fad300cd480 2023-10-06T11:18:29.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.387+0000 7fad2e7fc700 1 -- 172.21.15.146:0/2338045943 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad18003570 con 0x7fad300cd480 2023-10-06T11:18:29.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.387+0000 7fad2e7fc700 1 -- 172.21.15.146:0/2338045943 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4156520807 0 0) 0x7fad18003570 con 0x7fad300cd480 2023-10-06T11:18:29.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.387+0000 7fad2e7fc700 1 -- 172.21.15.146:0/2338045943 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad300cd0b0 msgr2=0x7fad3015abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:29.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.387+0000 7fad2e7fc700 1 --2- 172.21.15.146:0/2338045943 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad300cd0b0 0x7fad3015abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:29.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.387+0000 7fad2e7fc700 1 -- 172.21.15.146:0/2338045943 >> v1:172.21.15.151:6789/0 conn(0x7fad300b09f0 legacy=0x7fad300b0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:29.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.387+0000 7fad2e7fc700 1 -- 172.21.15.146:0/2338045943 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad3015e0d0 con 0x7fad300cd480 2023-10-06T11:18:29.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.387+0000 7fad2e7fc700 1 -- 172.21.15.146:0/2338045943 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fad24001470 con 0x7fad300cd480 2023-10-06T11:18:29.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.387+0000 7fad2e7fc700 1 -- 172.21.15.146:0/2338045943 >> v1:172.21.15.146:6789/0 conn(0x7fad300cd480 legacy=0x7fad3015d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:29.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.387+0000 7fad2e7fc700 1 --2- 172.21.15.146:0/2338045943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad18003a90 0x7fad18003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:29.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.388+0000 7fad2e7fc700 1 --2- 172.21.15.146:0/2338045943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad18004810 0x7fad18004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:29.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.388+0000 7fad2e7fc700 1 --2- 172.21.15.146:0/2338045943 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad300cd0b0 0x7fad18005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:29.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.388+0000 7fad2e7fc700 1 -- 172.21.15.146:0/2338045943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad3015ddf0 con 0x7fad18004810 2023-10-06T11:18:29.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.388+0000 7fad2e7fc700 1 -- 172.21.15.146:0/2338045943 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1800bc20 con 0x7fad18003a90 2023-10-06T11:18:29.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.388+0000 7fad2e7fc700 1 -- 172.21.15.146:0/2338045943 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad1800bde0 con 0x7fad300cd0b0 2023-10-06T11:18:29.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.388+0000 7fad2effd700 1 --2- 172.21.15.146:0/2338045943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad18004810 0x7fad18004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:29.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.388+0000 7fad2f7fe700 1 --2- 172.21.15.146:0/2338045943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad18003a90 0x7fad18003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:29.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.388+0000 7fad2ffff700 1 --2- 172.21.15.146:0/2338045943 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad300cd0b0 0x7fad18005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:29.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.388+0000 7fad2effd700 1 -- 172.21.15.146:0/2338045943 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad300cd0b0 msgr2=0x7fad18005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:29.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.388+0000 7fad2effd700 1 --2- 172.21.15.146:0/2338045943 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad300cd0b0 0x7fad18005290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:29.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.388+0000 7fad2effd700 1 -- 172.21.15.146:0/2338045943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad18003a90 msgr2=0x7fad18003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:29.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.388+0000 7fad2effd700 1 --2- 172.21.15.146:0/2338045943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad18003a90 0x7fad18003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:29.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.388+0000 7fad2effd700 1 -- 172.21.15.146:0/2338045943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad18003570 con 0x7fad18004810 2023-10-06T11:18:29.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.388+0000 7fad2f7fe700 1 --2- 172.21.15.146:0/2338045943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad18003a90 0x7fad18003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:18:29.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.388+0000 7fad2effd700 1 --2- 172.21.15.146:0/2338045943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad18004810 0x7fad18004c80 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 crypto rx=0x7fad3015dd20 tx=0x7fad24001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c217c296437d110 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:29.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.388+0000 7fad2e7fc700 1 -- 172.21.15.146:0/2338045943 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2400cc30 con 0x7fad18004810 2023-10-06T11:18:29.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.388+0000 7fad2e7fc700 1 -- 172.21.15.146:0/2338045943 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad2400cd90 con 0x7fad18004810 2023-10-06T11:18:29.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.388+0000 7fad2e7fc700 1 -- 172.21.15.146:0/2338045943 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad24005b50 con 0x7fad18004810 2023-10-06T11:18:29.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.389+0000 7fad36206700 1 -- 172.21.15.146:0/2338045943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad18004810 msgr2=0x7fad18004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:29.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.389+0000 7fad36206700 1 --2- 172.21.15.146:0/2338045943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad18004810 0x7fad18004c80 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 crypto rx=0x7fad3015dd20 tx=0x7fad24001e50 comp rx=0 tx=0).stop 2023-10-06T11:18:29.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.389+0000 7fad2ffff700 1 -- 172.21.15.146:0/2338045943 reap_dead start 2023-10-06T11:18:29.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.389+0000 7fad36206700 1 -- 172.21.15.146:0/2338045943 shutdown_connections 2023-10-06T11:18:29.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.389+0000 7fad36206700 1 -- 172.21.15.146:0/2338045943 >> 172.21.15.146:0/2338045943 conn(0x7fad3006eb10 msgr2=0x7fad3006ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:29.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.389+0000 7fad36206700 1 -- 172.21.15.146:0/2338045943 shutdown_connections 2023-10-06T11:18:29.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.389+0000 7fad36206700 1 -- 172.21.15.146:0/2338045943 wait complete. 2023-10-06T11:18:29.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.390+0000 7fad36206700 1 Processor -- start 2023-10-06T11:18:29.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.390+0000 7fad36206700 1 -- start start 2023-10-06T11:18:29.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.391+0000 7fad36206700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad18004810 0x7fad30169db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:29.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.391+0000 7fad36206700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad300ca380 0x7fad3014a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:29.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.391+0000 7fad36206700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad300c3c20 0x7fad300c4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:29.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.391+0000 7fad36206700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad3016aca0 con 0x7fad300ca380 2023-10-06T11:18:29.399 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.391+0000 7fad36206700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad3016a400 con 0x7fad18004810 2023-10-06T11:18:29.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.391+0000 7fad36206700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad3016a6e0 con 0x7fad300c3c20 2023-10-06T11:18:29.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.391+0000 7fad2effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad300ca380 0x7fad3014a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:29.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.391+0000 7fad2effd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad300ca380 0x7fad3014a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56986/0 (socket says 172.21.15.146:56986) 2023-10-06T11:18:29.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.391+0000 7fad2effd700 1 -- 172.21.15.146:0/1146054819 learned_addr learned my addr 172.21.15.146:0/1146054819 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:29.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.391+0000 7fad2ffff700 1 --2- 172.21.15.146:0/1146054819 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad300c3c20 0x7fad300c4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:29.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.391+0000 7fad2f7fe700 1 --2- 172.21.15.146:0/1146054819 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad18004810 0x7fad30169db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:29.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.391+0000 7fad2effd700 1 -- 172.21.15.146:0/1146054819 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad300c3c20 msgr2=0x7fad300c4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:29.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.391+0000 7fad2effd700 1 --2- 172.21.15.146:0/1146054819 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad300c3c20 0x7fad300c4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:29.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.391+0000 7fad2effd700 1 -- 172.21.15.146:0/1146054819 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad18004810 msgr2=0x7fad30169db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:29.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.391+0000 7fad2effd700 1 --2- 172.21.15.146:0/1146054819 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad18004810 0x7fad30169db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:29.400 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.391+0000 7fad2effd700 1 -- 172.21.15.146:0/1146054819 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad3016a9c0 con 0x7fad300ca380 2023-10-06T11:18:29.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.391+0000 7fad2effd700 1 --2- 172.21.15.146:0/1146054819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad300ca380 0x7fad3014a910 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 crypto rx=0x7fad1800bbf0 tx=0x7fad24015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:29.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.391+0000 7fad177fe700 1 -- 172.21.15.146:0/1146054819 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad240070d0 con 0x7fad300ca380 2023-10-06T11:18:29.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.391+0000 7fad177fe700 1 -- 172.21.15.146:0/1146054819 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad24007230 con 0x7fad300ca380 2023-10-06T11:18:29.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.391+0000 7fad177fe700 1 -- 172.21.15.146:0/1146054819 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad240075f0 con 0x7fad300ca380 2023-10-06T11:18:29.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.391+0000 7fad36206700 1 -- 172.21.15.146:0/1146054819 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad3016d4c0 con 0x7fad300ca380 2023-10-06T11:18:29.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.391+0000 7fad36206700 1 -- 172.21.15.146:0/1146054819 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad3014ae50 con 0x7fad300ca380 2023-10-06T11:18:29.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.392+0000 7fad36206700 1 -- 172.21.15.146:0/1146054819 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad30070ec0 con 0x7fad300ca380 2023-10-06T11:18:29.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.393+0000 7fad177fe700 1 -- 172.21.15.146:0/1146054819 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fad24019030 con 0x7fad300ca380 2023-10-06T11:18:29.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.393+0000 7fad177fe700 1 --2- 172.21.15.146:0/1146054819 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fad1c066f60 0x7fad1c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:29.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.393+0000 7fad177fe700 1 -- 172.21.15.146:0/1146054819 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fad24085cd0 con 0x7fad300ca380 2023-10-06T11:18:29.401 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.393+0000 7fad2f7fe700 1 --2- 172.21.15.146:0/1146054819 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fad1c066f60 0x7fad1c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:29.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.394+0000 7fad2f7fe700 1 --2- 172.21.15.146:0/1146054819 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fad1c066f60 0x7fad1c069410 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fad200077e0 tx=0x7fad2000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:29.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.398+0000 7fad177fe700 1 -- 172.21.15.146:0/1146054819 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad24052d40 con 0x7fad300ca380 2023-10-06T11:18:29.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.582+0000 7fad36206700 1 -- 172.21.15.146:0/1146054819 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad3004c380 con 0x7fad300ca380 2023-10-06T11:18:29.584 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.583+0000 7fad177fe700 1 -- 172.21.15.146:0/1146054819 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v163) v1 ==== 74+0+16928 (secure 0 0 0) 0x7fad24017090 con 0x7fad300ca380 2023-10-06T11:18:29.584 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:18:29.585 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":163,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:18:26.432530+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:18:22.963878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-10-06T11:18:24.222990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:18:29.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.584+0000 7fad36206700 1 -- 172.21.15.146:0/1146054819 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fad1c066f60 msgr2=0x7fad1c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:29.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.584+0000 7fad36206700 1 --2- 172.21.15.146:0/1146054819 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fad1c066f60 0x7fad1c069410 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fad200077e0 tx=0x7fad2000b040 comp rx=0 tx=0).stop 2023-10-06T11:18:29.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.584+0000 7fad36206700 1 -- 172.21.15.146:0/1146054819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad300ca380 msgr2=0x7fad3014a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:29.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.584+0000 7fad36206700 1 --2- 172.21.15.146:0/1146054819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad300ca380 0x7fad3014a910 secure :-1 s=READY pgs=2106 cs=0 l=1 rev1=1 crypto rx=0x7fad1800bbf0 tx=0x7fad24015000 comp rx=0 tx=0).stop 2023-10-06T11:18:29.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.584+0000 7fad36206700 1 -- 172.21.15.146:0/1146054819 shutdown_connections 2023-10-06T11:18:29.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.584+0000 7fad36206700 1 --2- 172.21.15.146:0/1146054819 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fad1c066f60 0x7fad1c069410 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:29.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.584+0000 7fad36206700 1 --2- 172.21.15.146:0/1146054819 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad300c3c20 0x7fad300c4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:29.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.584+0000 7fad36206700 1 --2- 172.21.15.146:0/1146054819 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad18004810 0x7fad30169db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:29.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.584+0000 7fad36206700 1 --2- 172.21.15.146:0/1146054819 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fad300ca380 0x7fad3014a910 unknown :-1 s=CLOSED pgs=2106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:29.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.584+0000 7fad36206700 1 -- 172.21.15.146:0/1146054819 >> 172.21.15.146:0/1146054819 conn(0x7fad3006eb10 msgr2=0x7fad300cf000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:29.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.585+0000 7fad36206700 1 -- 172.21.15.146:0/1146054819 shutdown_connections 2023-10-06T11:18:29.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.585+0000 7fad36206700 1 -- 172.21.15.146:0/1146054819 wait complete. 2023-10-06T11:18:29.599 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T11:18:29.599 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:18:29.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.713+0000 7fc84ffff700 1 Processor -- start 2023-10-06T11:18:29.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.713+0000 7fc84ffff700 1 -- start start 2023-10-06T11:18:29.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.714+0000 7fc84ffff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc850143410 0x7fc8500b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:29.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.714+0000 7fc84ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc8500b2530 0x7fc8500b5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:29.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.714+0000 7fc84ffff700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8500cf100 con 0x7fc850143040 2023-10-06T11:18:29.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.714+0000 7fc84ffff700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8500b57a0 con 0x7fc8500b2530 2023-10-06T11:18:29.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.714+0000 7fc84ffff700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8500b4170 con 0x7fc850143410 2023-10-06T11:18:29.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.714+0000 7fc84f7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc8500b2530 0x7fc8500b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:29.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.714+0000 7fc84f7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc8500b2530 0x7fc8500b5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56988/0 (socket says 172.21.15.146:56988) 2023-10-06T11:18:29.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.714+0000 7fc84f7fe700 1 -- 172.21.15.146:0/2763529850 learned_addr learned my addr 172.21.15.146:0/2763529850 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:29.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.714+0000 7fc8467fc700 1 --2- 172.21.15.146:0/2763529850 >> v2:172.21.15.151:3300/0 conn(0x7fc850143410 0x7fc8500b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:29.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.714+0000 7fc84f7fe700 1 -- 172.21.15.146:0/2763529850 >> v2:172.21.15.151:3300/0 conn(0x7fc850143410 msgr2=0x7fc8500b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:29.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.714+0000 7fc84f7fe700 1 --2- 172.21.15.146:0/2763529850 >> v2:172.21.15.151:3300/0 conn(0x7fc850143410 0x7fc8500b4d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:29.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.714+0000 7fc84f7fe700 1 -- 172.21.15.146:0/2763529850 >> v1:172.21.15.151:6789/0 conn(0x7fc850143040 legacy=0x7fc8500b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:29.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.714+0000 7fc84f7fe700 1 -- 172.21.15.146:0/2763529850 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8500ceb30 con 0x7fc8500b2530 2023-10-06T11:18:29.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.715+0000 7fc84f7fe700 1 --2- 172.21.15.146:0/2763529850 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8500b2530 0x7fc8500b5260 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 crypto rx=0x7fc848009f50 tx=0x7fc848009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=916e4c457aebfd4f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:29.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.715+0000 7fc84e7fc700 1 -- 172.21.15.146:0/2763529850 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84800e070 con 0x7fc8500b2530 2023-10-06T11:18:29.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.715+0000 7fc84e7fc700 1 -- 172.21.15.146:0/2763529850 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc84800ba30 con 0x7fc8500b2530 2023-10-06T11:18:29.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.715+0000 7fc84e7fc700 1 -- 172.21.15.146:0/2763529850 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8480092e0 con 0x7fc8500b2530 2023-10-06T11:18:29.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.715+0000 7fc84ffff700 1 -- 172.21.15.146:0/2763529850 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8500b2530 msgr2=0x7fc8500b5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:29.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.715+0000 7fc84ffff700 1 --2- 172.21.15.146:0/2763529850 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8500b2530 0x7fc8500b5260 secure :-1 s=READY pgs=2107 cs=0 l=1 rev1=1 crypto rx=0x7fc848009f50 tx=0x7fc848009840 comp rx=0 tx=0).stop 2023-10-06T11:18:29.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.715+0000 7fc84ffff700 1 -- 172.21.15.146:0/2763529850 shutdown_connections 2023-10-06T11:18:29.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.715+0000 7fc84ffff700 1 --2- 172.21.15.146:0/2763529850 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc8500b2530 0x7fc8500b5260 unknown :-1 s=CLOSED pgs=2107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:29.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.715+0000 7fc84ffff700 1 --2- 172.21.15.146:0/2763529850 >> v2:172.21.15.151:3300/0 conn(0x7fc850143410 0x7fc8500b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:29.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.715+0000 7fc84ffff700 1 -- 172.21.15.146:0/2763529850 >> 172.21.15.146:0/2763529850 conn(0x7fc85006eb10 msgr2=0x7fc85006ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:29.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.715+0000 7fc84ffff700 1 -- 172.21.15.146:0/2763529850 shutdown_connections 2023-10-06T11:18:29.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.715+0000 7fc84ffff700 1 -- 172.21.15.146:0/2763529850 wait complete. 2023-10-06T11:18:29.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.716+0000 7fc84ffff700 1 Processor -- start 2023-10-06T11:18:29.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.717+0000 7fc84ffff700 1 -- start start 2023-10-06T11:18:29.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.717+0000 7fc84ffff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8500b2530 0x7fc85016ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:29.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.717+0000 7fc84ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc850143040 0x7fc8500c95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:29.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.717+0000 7fc84ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc850143410 0x7fc8500cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:29.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.717+0000 7fc84ffff700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8500c85a0 con 0x7fc850143410 2023-10-06T11:18:29.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.717+0000 7fc84ffff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8500c9120 con 0x7fc850143040 2023-10-06T11:18:29.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.717+0000 7fc84ffff700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8500c87f0 con 0x7fc8500b2530 2023-10-06T11:18:29.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.717+0000 7fc84f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc850143410 0x7fc8500cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:29.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.717+0000 7fc84f7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc850143410 0x7fc8500cc6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:56998/0 (socket says 172.21.15.146:56998) 2023-10-06T11:18:29.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.717+0000 7fc84f7fe700 1 -- 172.21.15.146:0/2515154143 learned_addr learned my addr 172.21.15.146:0/2515154143 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:29.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.718+0000 7fc8467fc700 1 --2- 172.21.15.146:0/2515154143 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc850143040 0x7fc8500c95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:29.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.718+0000 7fc84effd700 1 --2- 172.21.15.146:0/2515154143 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8500b2530 0x7fc85016ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:29.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.718+0000 7fc84f7fe700 1 -- 172.21.15.146:0/2515154143 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8500b2530 msgr2=0x7fc85016ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:29.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.718+0000 7fc84f7fe700 1 --2- 172.21.15.146:0/2515154143 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8500b2530 0x7fc85016ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:29.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.718+0000 7fc84f7fe700 1 -- 172.21.15.146:0/2515154143 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc850143040 msgr2=0x7fc8500c95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:29.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.718+0000 7fc84f7fe700 1 --2- 172.21.15.146:0/2515154143 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc850143040 0x7fc8500c95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:29.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.718+0000 7fc84f7fe700 1 -- 172.21.15.146:0/2515154143 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc848009ae0 con 0x7fc850143410 2023-10-06T11:18:29.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.718+0000 7fc84f7fe700 1 --2- 172.21.15.146:0/2515154143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc850143410 0x7fc8500cc6d0 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 crypto rx=0x7fc848009ab0 tx=0x7fc848017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:29.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.718+0000 7fc8477fe700 1 -- 172.21.15.146:0/2515154143 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc848012cd0 con 0x7fc850143410 2023-10-06T11:18:29.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.718+0000 7fc8477fe700 1 -- 172.21.15.146:0/2515154143 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc848012e30 con 0x7fc850143410 2023-10-06T11:18:29.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.718+0000 7fc8477fe700 1 -- 172.21.15.146:0/2515154143 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84801d670 con 0x7fc850143410 2023-10-06T11:18:29.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.718+0000 7fc84ffff700 1 -- 172.21.15.146:0/2515154143 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8500c8ad0 con 0x7fc850143410 2023-10-06T11:18:29.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.718+0000 7fc84ffff700 1 -- 172.21.15.146:0/2515154143 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8500c6450 con 0x7fc850143410 2023-10-06T11:18:29.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.719+0000 7fc84ffff700 1 -- 172.21.15.146:0/2515154143 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8500c92d0 con 0x7fc850143410 2023-10-06T11:18:29.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.719+0000 7fc8477fe700 1 -- 172.21.15.146:0/2515154143 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc84801daa0 con 0x7fc850143410 2023-10-06T11:18:29.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.720+0000 7fc8477fe700 1 --2- 172.21.15.146:0/2515154143 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc830066f30 0x7fc8300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:29.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.720+0000 7fc8477fe700 1 -- 172.21.15.146:0/2515154143 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc848086010 con 0x7fc850143410 2023-10-06T11:18:29.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.720+0000 7fc84effd700 1 --2- 172.21.15.146:0/2515154143 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc830066f30 0x7fc8300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:29.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.720+0000 7fc84effd700 1 --2- 172.21.15.146:0/2515154143 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc830066f30 0x7fc8300693e0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fc850159d10 tx=0x7fc840008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:29.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.724+0000 7fc8477fe700 1 -- 172.21.15.146:0/2515154143 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc8500c92d0 con 0x7fc850143410 2023-10-06T11:18:29.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.908+0000 7fc84ffff700 1 -- 172.21.15.146:0/2515154143 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc8500c9290 con 0x7fc830066f30 2023-10-06T11:18:29.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.916+0000 7fc8477fe700 1 -- 172.21.15.146:0/2515154143 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311858 (secure 0 0 0) 0x7fc8500c9290 con 0x7fc830066f30 2023-10-06T11:18:29.922 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:18:29.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.920+0000 7fc84ffff700 1 -- 172.21.15.146:0/2515154143 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc830066f30 msgr2=0x7fc8300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:29.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.920+0000 7fc84ffff700 1 --2- 172.21.15.146:0/2515154143 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc830066f30 0x7fc8300693e0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fc850159d10 tx=0x7fc840008040 comp rx=0 tx=0).stop 2023-10-06T11:18:29.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.920+0000 7fc84ffff700 1 -- 172.21.15.146:0/2515154143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc850143410 msgr2=0x7fc8500cc6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:29.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.920+0000 7fc84ffff700 1 --2- 172.21.15.146:0/2515154143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc850143410 0x7fc8500cc6d0 secure :-1 s=READY pgs=2108 cs=0 l=1 rev1=1 crypto rx=0x7fc848009ab0 tx=0x7fc848017000 comp rx=0 tx=0).stop 2023-10-06T11:18:29.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.920+0000 7fc84ffff700 1 -- 172.21.15.146:0/2515154143 shutdown_connections 2023-10-06T11:18:29.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.920+0000 7fc84ffff700 1 --2- 172.21.15.146:0/2515154143 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc830066f30 0x7fc8300693e0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:29.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.920+0000 7fc84ffff700 1 --2- 172.21.15.146:0/2515154143 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc850143410 0x7fc8500cc6d0 unknown :-1 s=CLOSED pgs=2108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:29.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.920+0000 7fc84ffff700 1 --2- 172.21.15.146:0/2515154143 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8500b2530 0x7fc85016ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:29.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.920+0000 7fc84ffff700 1 --2- 172.21.15.146:0/2515154143 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc850143040 0x7fc8500c95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:29.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.920+0000 7fc84ffff700 1 -- 172.21.15.146:0/2515154143 >> 172.21.15.146:0/2515154143 conn(0x7fc85006eb10 msgr2=0x7fc8500b1530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:29.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.920+0000 7fc84ffff700 1 -- 172.21.15.146:0/2515154143 shutdown_connections 2023-10-06T11:18:29.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:29.920+0000 7fc84ffff700 1 -- 172.21.15.146:0/2515154143 wait complete. 2023-10-06T11:18:29.926 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:18:29.934 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":542,"stamp":"2023-10-06T11:18:29.306989+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":109,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2448680,"kb_used_data":17128,"kb_used_omap":0,"kb_used_meta":2431488,"kb_avail":752526040,"statfs":{"total":773094113280,"available":770586664960,"internally_reserved":0,"allocated":17539072,"data_stored":8709051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2489843712},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.441548"},"pg_stats":[{"pgid":"26.3f","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.454403+0000","last_change":"2023-10-06T11:18:25.452543+0000","last_active":"2023-10-06T11:18:25.454403+0000","last_peered":"2023-10-06T11:18:25.454403+0000","last_clean":"2023-10-06T11:18:25.454403+0000","last_became_active":"2023-10-06T11:18:25.452217+0000","last_became_peered":"2023-10-06T11:18:25.452217+0000","last_unstale":"2023-10-06T11:18:25.454403+0000","last_undegraded":"2023-10-06T11:18:25.454403+0000","last_fullsized":"2023-10-06T11:18:25.454403+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:48.110179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.452269+0000","last_change":"2023-10-06T11:18:25.448714+0000","last_active":"2023-10-06T11:18:25.452269+0000","last_peered":"2023-10-06T11:18:25.452269+0000","last_clean":"2023-10-06T11:18:25.452269+0000","last_became_active":"2023-10-06T11:18:25.448457+0000","last_became_peered":"2023-10-06T11:18:25.448457+0000","last_unstale":"2023-10-06T11:18:25.452269+0000","last_undegraded":"2023-10-06T11:18:25.452269+0000","last_fullsized":"2023-10-06T11:18:25.452269+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:19:27.356843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.450914+0000","last_change":"2023-10-06T11:18:25.448473+0000","last_active":"2023-10-06T11:18:25.450914+0000","last_peered":"2023-10-06T11:18:25.450914+0000","last_clean":"2023-10-06T11:18:25.450914+0000","last_became_active":"2023-10-06T11:18:25.447650+0000","last_became_peered":"2023-10-06T11:18:25.447650+0000","last_unstale":"2023-10-06T11:18:25.450914+0000","last_undegraded":"2023-10-06T11:18:25.450914+0000","last_fullsized":"2023-10-06T11:18:25.450914+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:24:08.855788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3c","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.444060+0000","last_change":"2023-10-06T11:18:25.444060+0000","last_active":"2023-10-06T11:18:25.444060+0000","last_peered":"2023-10-06T11:18:25.444060+0000","last_clean":"2023-10-06T11:18:25.444060+0000","last_became_active":"2023-10-06T11:18:25.443788+0000","last_became_peered":"2023-10-06T11:18:25.443788+0000","last_unstale":"2023-10-06T11:18:25.444060+0000","last_undegraded":"2023-10-06T11:18:25.444060+0000","last_fullsized":"2023-10-06T11:18:25.444060+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:51:39.902370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.444792+0000","last_change":"2023-10-06T11:18:25.444792+0000","last_active":"2023-10-06T11:18:25.444792+0000","last_peered":"2023-10-06T11:18:25.444792+0000","last_clean":"2023-10-06T11:18:25.444792+0000","last_became_active":"2023-10-06T11:18:25.444515+0000","last_became_peered":"2023-10-06T11:18:25.444515+0000","last_unstale":"2023-10-06T11:18:25.444792+0000","last_undegraded":"2023-10-06T11:18:25.444792+0000","last_fullsized":"2023-10-06T11:18:25.444792+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:40:27.559023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.449825+0000","last_change":"2023-10-06T11:18:25.449825+0000","last_active":"2023-10-06T11:18:25.449825+0000","last_peered":"2023-10-06T11:18:25.449825+0000","last_clean":"2023-10-06T11:18:25.449825+0000","last_became_active":"2023-10-06T11:18:25.449585+0000","last_became_peered":"2023-10-06T11:18:25.449585+0000","last_unstale":"2023-10-06T11:18:25.449825+0000","last_undegraded":"2023-10-06T11:18:25.449825+0000","last_fullsized":"2023-10-06T11:18:25.449825+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:16:43.722738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.450734+0000","last_change":"2023-10-06T11:18:25.450734+0000","last_active":"2023-10-06T11:18:25.450734+0000","last_peered":"2023-10-06T11:18:25.450734+0000","last_clean":"2023-10-06T11:18:25.450734+0000","last_became_active":"2023-10-06T11:18:25.450474+0000","last_became_peered":"2023-10-06T11:18:25.450474+0000","last_unstale":"2023-10-06T11:18:25.450734+0000","last_undegraded":"2023-10-06T11:18:25.450734+0000","last_fullsized":"2023-10-06T11:18:25.450734+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:26:27.027249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.452099+0000","last_change":"2023-10-06T11:18:25.452099+0000","last_active":"2023-10-06T11:18:25.452099+0000","last_peered":"2023-10-06T11:18:25.452099+0000","last_clean":"2023-10-06T11:18:25.452099+0000","last_became_active":"2023-10-06T11:18:25.451826+0000","last_became_peered":"2023-10-06T11:18:25.451826+0000","last_unstale":"2023-10-06T11:18:25.452099+0000","last_undegraded":"2023-10-06T11:18:25.452099+0000","last_fullsized":"2023-10-06T11:18:25.452099+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:53:44.215297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.452461+0000","last_change":"2023-10-06T11:18:25.449272+0000","last_active":"2023-10-06T11:18:25.452461+0000","last_peered":"2023-10-06T11:18:25.452461+0000","last_clean":"2023-10-06T11:18:25.452461+0000","last_became_active":"2023-10-06T11:18:25.449002+0000","last_became_peered":"2023-10-06T11:18:25.449002+0000","last_unstale":"2023-10-06T11:18:25.452461+0000","last_undegraded":"2023-10-06T11:18:25.452461+0000","last_fullsized":"2023-10-06T11:18:25.452461+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:02.747570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.443860+0000","last_change":"2023-10-06T11:18:25.443860+0000","last_active":"2023-10-06T11:18:25.443860+0000","last_peered":"2023-10-06T11:18:25.443860+0000","last_clean":"2023-10-06T11:18:25.443860+0000","last_became_active":"2023-10-06T11:18:25.443596+0000","last_became_peered":"2023-10-06T11:18:25.443596+0000","last_unstale":"2023-10-06T11:18:25.443860+0000","last_undegraded":"2023-10-06T11:18:25.443860+0000","last_fullsized":"2023-10-06T11:18:25.443860+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:34:11.549704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.449480+0000","last_change":"2023-10-06T11:18:25.449480+0000","last_active":"2023-10-06T11:18:25.449480+0000","last_peered":"2023-10-06T11:18:25.449480+0000","last_clean":"2023-10-06T11:18:25.449480+0000","last_became_active":"2023-10-06T11:18:25.449206+0000","last_became_peered":"2023-10-06T11:18:25.449206+0000","last_unstale":"2023-10-06T11:18:25.449480+0000","last_undegraded":"2023-10-06T11:18:25.449480+0000","last_fullsized":"2023-10-06T11:18:25.449480+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:52.828500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.445152+0000","last_change":"2023-10-06T11:18:25.445152+0000","last_active":"2023-10-06T11:18:25.445152+0000","last_peered":"2023-10-06T11:18:25.445152+0000","last_clean":"2023-10-06T11:18:25.445152+0000","last_became_active":"2023-10-06T11:18:25.444830+0000","last_became_peered":"2023-10-06T11:18:25.444830+0000","last_unstale":"2023-10-06T11:18:25.445152+0000","last_undegraded":"2023-10-06T11:18:25.445152+0000","last_fullsized":"2023-10-06T11:18:25.445152+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:08:39.929677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.452877+0000","last_change":"2023-10-06T11:18:25.448543+0000","last_active":"2023-10-06T11:18:25.452877+0000","last_peered":"2023-10-06T11:18:25.452877+0000","last_clean":"2023-10-06T11:18:25.452877+0000","last_became_active":"2023-10-06T11:18:25.448303+0000","last_became_peered":"2023-10-06T11:18:25.448303+0000","last_unstale":"2023-10-06T11:18:25.452877+0000","last_undegraded":"2023-10-06T11:18:25.452877+0000","last_fullsized":"2023-10-06T11:18:25.452877+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:30:11.645547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.444730+0000","last_change":"2023-10-06T11:18:25.444730+0000","last_active":"2023-10-06T11:18:25.444730+0000","last_peered":"2023-10-06T11:18:25.444730+0000","last_clean":"2023-10-06T11:18:25.444730+0000","last_became_active":"2023-10-06T11:18:25.444477+0000","last_became_peered":"2023-10-06T11:18:25.444477+0000","last_unstale":"2023-10-06T11:18:25.444730+0000","last_undegraded":"2023-10-06T11:18:25.444730+0000","last_fullsized":"2023-10-06T11:18:25.444730+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:11:28.064418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.451803+0000","last_change":"2023-10-06T11:18:25.449445+0000","last_active":"2023-10-06T11:18:25.451803+0000","last_peered":"2023-10-06T11:18:25.451803+0000","last_clean":"2023-10-06T11:18:25.451803+0000","last_became_active":"2023-10-06T11:18:25.449192+0000","last_became_peered":"2023-10-06T11:18:25.449192+0000","last_unstale":"2023-10-06T11:18:25.451803+0000","last_undegraded":"2023-10-06T11:18:25.451803+0000","last_fullsized":"2023-10-06T11:18:25.451803+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:02:57.348824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.449114+0000","last_change":"2023-10-06T11:18:25.449114+0000","last_active":"2023-10-06T11:18:25.449114+0000","last_peered":"2023-10-06T11:18:25.449114+0000","last_clean":"2023-10-06T11:18:25.449114+0000","last_became_active":"2023-10-06T11:18:25.447716+0000","last_became_peered":"2023-10-06T11:18:25.447716+0000","last_unstale":"2023-10-06T11:18:25.449114+0000","last_undegraded":"2023-10-06T11:18:25.449114+0000","last_fullsized":"2023-10-06T11:18:25.449114+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:51:39.902370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.452258+0000","last_change":"2023-10-06T11:18:25.452258+0000","last_active":"2023-10-06T11:18:25.452258+0000","last_peered":"2023-10-06T11:18:25.452258+0000","last_clean":"2023-10-06T11:18:25.452258+0000","last_became_active":"2023-10-06T11:18:25.452012+0000","last_became_peered":"2023-10-06T11:18:25.452012+0000","last_unstale":"2023-10-06T11:18:25.452258+0000","last_undegraded":"2023-10-06T11:18:25.452258+0000","last_fullsized":"2023-10-06T11:18:25.452258+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:49:39.061894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.454986+0000","last_change":"2023-10-06T11:18:25.452135+0000","last_active":"2023-10-06T11:18:25.454986+0000","last_peered":"2023-10-06T11:18:25.454986+0000","last_clean":"2023-10-06T11:18:25.454986+0000","last_became_active":"2023-10-06T11:18:25.451801+0000","last_became_peered":"2023-10-06T11:18:25.451801+0000","last_unstale":"2023-10-06T11:18:25.454986+0000","last_undegraded":"2023-10-06T11:18:25.454986+0000","last_fullsized":"2023-10-06T11:18:25.454986+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:45:30.016969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.451782+0000","last_change":"2023-10-06T11:18:25.445659+0000","last_active":"2023-10-06T11:18:25.451782+0000","last_peered":"2023-10-06T11:18:25.451782+0000","last_clean":"2023-10-06T11:18:25.451782+0000","last_became_active":"2023-10-06T11:18:25.445376+0000","last_became_peered":"2023-10-06T11:18:25.445376+0000","last_unstale":"2023-10-06T11:18:25.451782+0000","last_undegraded":"2023-10-06T11:18:25.451782+0000","last_fullsized":"2023-10-06T11:18:25.451782+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:43:21.947851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.452227+0000","last_change":"2023-10-06T11:18:25.452227+0000","last_active":"2023-10-06T11:18:25.452227+0000","last_peered":"2023-10-06T11:18:25.452227+0000","last_clean":"2023-10-06T11:18:25.452227+0000","last_became_active":"2023-10-06T11:18:25.451972+0000","last_became_peered":"2023-10-06T11:18:25.451972+0000","last_unstale":"2023-10-06T11:18:25.452227+0000","last_undegraded":"2023-10-06T11:18:25.452227+0000","last_fullsized":"2023-10-06T11:18:25.452227+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:41:44.516509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.451797+0000","last_change":"2023-10-06T11:18:25.449234+0000","last_active":"2023-10-06T11:18:25.451797+0000","last_peered":"2023-10-06T11:18:25.451797+0000","last_clean":"2023-10-06T11:18:25.451797+0000","last_became_active":"2023-10-06T11:18:25.448683+0000","last_became_peered":"2023-10-06T11:18:25.448683+0000","last_unstale":"2023-10-06T11:18:25.451797+0000","last_undegraded":"2023-10-06T11:18:25.451797+0000","last_fullsized":"2023-10-06T11:18:25.451797+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:53:44.215297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.451774+0000","last_change":"2023-10-06T11:18:25.448985+0000","last_active":"2023-10-06T11:18:25.451774+0000","last_peered":"2023-10-06T11:18:25.451774+0000","last_clean":"2023-10-06T11:18:25.451774+0000","last_became_active":"2023-10-06T11:18:25.448737+0000","last_became_peered":"2023-10-06T11:18:25.448737+0000","last_unstale":"2023-10-06T11:18:25.451774+0000","last_undegraded":"2023-10-06T11:18:25.451774+0000","last_fullsized":"2023-10-06T11:18:25.451774+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:39:14.365034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.452888+0000","last_change":"2023-10-06T11:18:25.452888+0000","last_active":"2023-10-06T11:18:25.452888+0000","last_peered":"2023-10-06T11:18:25.452888+0000","last_clean":"2023-10-06T11:18:25.452888+0000","last_became_active":"2023-10-06T11:18:25.452615+0000","last_became_peered":"2023-10-06T11:18:25.452615+0000","last_unstale":"2023-10-06T11:18:25.452888+0000","last_undegraded":"2023-10-06T11:18:25.452888+0000","last_fullsized":"2023-10-06T11:18:25.452888+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:39:14.365034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.452824+0000","last_change":"2023-10-06T11:18:25.452384+0000","last_active":"2023-10-06T11:18:25.452824+0000","last_peered":"2023-10-06T11:18:25.452824+0000","last_clean":"2023-10-06T11:18:25.452824+0000","last_became_active":"2023-10-06T11:18:25.452126+0000","last_became_peered":"2023-10-06T11:18:25.452126+0000","last_unstale":"2023-10-06T11:18:25.452824+0000","last_undegraded":"2023-10-06T11:18:25.452824+0000","last_fullsized":"2023-10-06T11:18:25.452824+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:53:51.275843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.448302+0000","last_change":"2023-10-06T11:18:25.448302+0000","last_active":"2023-10-06T11:18:25.448302+0000","last_peered":"2023-10-06T11:18:25.448302+0000","last_clean":"2023-10-06T11:18:25.448302+0000","last_became_active":"2023-10-06T11:18:25.447969+0000","last_became_peered":"2023-10-06T11:18:25.447969+0000","last_unstale":"2023-10-06T11:18:25.448302+0000","last_undegraded":"2023-10-06T11:18:25.448302+0000","last_fullsized":"2023-10-06T11:18:25.448302+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:16:20.117101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.443087+0000","last_change":"2023-10-06T11:18:25.443087+0000","last_active":"2023-10-06T11:18:25.443087+0000","last_peered":"2023-10-06T11:18:25.443087+0000","last_clean":"2023-10-06T11:18:25.443087+0000","last_became_active":"2023-10-06T11:18:25.442839+0000","last_became_peered":"2023-10-06T11:18:25.442839+0000","last_unstale":"2023-10-06T11:18:25.443087+0000","last_undegraded":"2023-10-06T11:18:25.443087+0000","last_fullsized":"2023-10-06T11:18:25.443087+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:01:14.172955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.452935+0000","last_change":"2023-10-06T11:18:25.452935+0000","last_active":"2023-10-06T11:18:25.452935+0000","last_peered":"2023-10-06T11:18:25.452935+0000","last_clean":"2023-10-06T11:18:25.452935+0000","last_became_active":"2023-10-06T11:18:25.452670+0000","last_became_peered":"2023-10-06T11:18:25.452670+0000","last_unstale":"2023-10-06T11:18:25.452935+0000","last_undegraded":"2023-10-06T11:18:25.452935+0000","last_fullsized":"2023-10-06T11:18:25.452935+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:49:35.453520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.444765+0000","last_change":"2023-10-06T11:18:25.444765+0000","last_active":"2023-10-06T11:18:25.444765+0000","last_peered":"2023-10-06T11:18:25.444765+0000","last_clean":"2023-10-06T11:18:25.444765+0000","last_became_active":"2023-10-06T11:18:25.444463+0000","last_became_peered":"2023-10-06T11:18:25.444463+0000","last_unstale":"2023-10-06T11:18:25.444765+0000","last_undegraded":"2023-10-06T11:18:25.444765+0000","last_fullsized":"2023-10-06T11:18:25.444765+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:49.672466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.444880+0000","last_change":"2023-10-06T11:18:25.444880+0000","last_active":"2023-10-06T11:18:25.444880+0000","last_peered":"2023-10-06T11:18:25.444880+0000","last_clean":"2023-10-06T11:18:25.444880+0000","last_became_active":"2023-10-06T11:18:25.444584+0000","last_became_peered":"2023-10-06T11:18:25.444584+0000","last_unstale":"2023-10-06T11:18:25.444880+0000","last_undegraded":"2023-10-06T11:18:25.444880+0000","last_fullsized":"2023-10-06T11:18:25.444880+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:20:26.026270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.444673+0000","last_change":"2023-10-06T11:18:25.444673+0000","last_active":"2023-10-06T11:18:25.444673+0000","last_peered":"2023-10-06T11:18:25.444673+0000","last_clean":"2023-10-06T11:18:25.444673+0000","last_became_active":"2023-10-06T11:18:25.444440+0000","last_became_peered":"2023-10-06T11:18:25.444440+0000","last_unstale":"2023-10-06T11:18:25.444673+0000","last_undegraded":"2023-10-06T11:18:25.444673+0000","last_fullsized":"2023-10-06T11:18:25.444673+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:14:20.677130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.445782+0000","last_change":"2023-10-06T11:18:25.445782+0000","last_active":"2023-10-06T11:18:25.445782+0000","last_peered":"2023-10-06T11:18:25.445782+0000","last_clean":"2023-10-06T11:18:25.445782+0000","last_became_active":"2023-10-06T11:18:25.445534+0000","last_became_peered":"2023-10-06T11:18:25.445534+0000","last_unstale":"2023-10-06T11:18:25.445782+0000","last_undegraded":"2023-10-06T11:18:25.445782+0000","last_fullsized":"2023-10-06T11:18:25.445782+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:00:13.601884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.449115+0000","last_change":"2023-10-06T11:18:25.449115+0000","last_active":"2023-10-06T11:18:25.449115+0000","last_peered":"2023-10-06T11:18:25.449115+0000","last_clean":"2023-10-06T11:18:25.449115+0000","last_became_active":"2023-10-06T11:18:25.447102+0000","last_became_peered":"2023-10-06T11:18:25.447102+0000","last_unstale":"2023-10-06T11:18:25.449115+0000","last_undegraded":"2023-10-06T11:18:25.449115+0000","last_fullsized":"2023-10-06T11:18:25.449115+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:58:44.300561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.453797+0000","last_change":"2023-10-06T11:18:25.453797+0000","last_active":"2023-10-06T11:18:25.453797+0000","last_peered":"2023-10-06T11:18:25.453797+0000","last_clean":"2023-10-06T11:18:25.453797+0000","last_became_active":"2023-10-06T11:18:25.453530+0000","last_became_peered":"2023-10-06T11:18:25.453530+0000","last_unstale":"2023-10-06T11:18:25.453797+0000","last_undegraded":"2023-10-06T11:18:25.453797+0000","last_fullsized":"2023-10-06T11:18:25.453797+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:02:57.348824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-06T11:18:24.892142+0000","last_change":"2023-10-06T11:18:24.885061+0000","last_active":"2023-10-06T11:18:24.892142+0000","last_peered":"2023-10-06T11:18:24.892142+0000","last_clean":"2023-10-06T11:18:24.892142+0000","last_became_active":"2023-10-06T11:18:24.884763+0000","last_became_peered":"2023-10-06T11:18:24.884763+0000","last_unstale":"2023-10-06T11:18:24.892142+0000","last_undegraded":"2023-10-06T11:18:24.892142+0000","last_fullsized":"2023-10-06T11:18:24.892142+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:19:26.351990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.444174+0000","last_change":"2023-10-06T11:18:25.444174+0000","last_active":"2023-10-06T11:18:25.444174+0000","last_peered":"2023-10-06T11:18:25.444174+0000","last_clean":"2023-10-06T11:18:25.444174+0000","last_became_active":"2023-10-06T11:18:25.443761+0000","last_became_peered":"2023-10-06T11:18:25.443761+0000","last_unstale":"2023-10-06T11:18:25.444174+0000","last_undegraded":"2023-10-06T11:18:25.444174+0000","last_fullsized":"2023-10-06T11:18:25.444174+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:59.283961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.439236+0000","last_change":"2023-10-06T11:18:24.886350+0000","last_active":"2023-10-06T11:18:25.439236+0000","last_peered":"2023-10-06T11:18:25.439236+0000","last_clean":"2023-10-06T11:18:25.439236+0000","last_became_active":"2023-10-06T11:18:24.886107+0000","last_became_peered":"2023-10-06T11:18:24.886107+0000","last_unstale":"2023-10-06T11:18:25.439236+0000","last_undegraded":"2023-10-06T11:18:25.439236+0000","last_fullsized":"2023-10-06T11:18:25.439236+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:13:55.717930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.452220+0000","last_change":"2023-10-06T11:18:25.446653+0000","last_active":"2023-10-06T11:18:25.452220+0000","last_peered":"2023-10-06T11:18:25.452220+0000","last_clean":"2023-10-06T11:18:25.452220+0000","last_became_active":"2023-10-06T11:18:25.446379+0000","last_became_peered":"2023-10-06T11:18:25.446379+0000","last_unstale":"2023-10-06T11:18:25.452220+0000","last_undegraded":"2023-10-06T11:18:25.452220+0000","last_fullsized":"2023-10-06T11:18:25.452220+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:02:57.348824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.15","version":"162'3","reported_seq":12,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.881181+0000","last_change":"2023-10-06T11:18:24.892693+0000","last_active":"2023-10-06T11:18:25.881181+0000","last_peered":"2023-10-06T11:18:25.881181+0000","last_clean":"2023-10-06T11:18:25.881181+0000","last_became_active":"2023-10-06T11:18:24.892434+0000","last_became_peered":"2023-10-06T11:18:24.892434+0000","last_unstale":"2023-10-06T11:18:25.881181+0000","last_undegraded":"2023-10-06T11:18:25.881181+0000","last_fullsized":"2023-10-06T11:18:25.881181+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:11:08.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.452435+0000","last_change":"2023-10-06T11:18:25.449185+0000","last_active":"2023-10-06T11:18:25.452435+0000","last_peered":"2023-10-06T11:18:25.452435+0000","last_clean":"2023-10-06T11:18:25.452435+0000","last_became_active":"2023-10-06T11:18:25.448577+0000","last_became_peered":"2023-10-06T11:18:25.448577+0000","last_unstale":"2023-10-06T11:18:25.452435+0000","last_undegraded":"2023-10-06T11:18:25.452435+0000","last_fullsized":"2023-10-06T11:18:25.452435+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:43:28.681381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.14","version":"162'6","reported_seq":16,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.889198+0000","last_change":"2023-10-06T11:18:24.883110+0000","last_active":"2023-10-06T11:18:25.889198+0000","last_peered":"2023-10-06T11:18:25.889198+0000","last_clean":"2023-10-06T11:18:25.889198+0000","last_became_active":"2023-10-06T11:18:24.882846+0000","last_became_peered":"2023-10-06T11:18:24.882846+0000","last_unstale":"2023-10-06T11:18:25.889198+0000","last_undegraded":"2023-10-06T11:18:25.889198+0000","last_fullsized":"2023-10-06T11:18:25.889198+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:58:45.228119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.451047+0000","last_change":"2023-10-06T11:18:25.451047+0000","last_active":"2023-10-06T11:18:25.451047+0000","last_peered":"2023-10-06T11:18:25.451047+0000","last_clean":"2023-10-06T11:18:25.451047+0000","last_became_active":"2023-10-06T11:18:25.450811+0000","last_became_peered":"2023-10-06T11:18:25.450811+0000","last_unstale":"2023-10-06T11:18:25.451047+0000","last_undegraded":"2023-10-06T11:18:25.451047+0000","last_fullsized":"2023-10-06T11:18:25.451047+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:21:49.544019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.13","version":"162'2","reported_seq":12,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.885292+0000","last_change":"2023-10-06T11:18:24.878767+0000","last_active":"2023-10-06T11:18:25.885292+0000","last_peered":"2023-10-06T11:18:25.885292+0000","last_clean":"2023-10-06T11:18:25.885292+0000","last_became_active":"2023-10-06T11:18:24.878481+0000","last_became_peered":"2023-10-06T11:18:24.878481+0000","last_unstale":"2023-10-06T11:18:25.885292+0000","last_undegraded":"2023-10-06T11:18:25.885292+0000","last_fullsized":"2023-10-06T11:18:25.885292+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:13:55.717930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.447519+0000","last_change":"2023-10-06T11:18:25.447519+0000","last_active":"2023-10-06T11:18:25.447519+0000","last_peered":"2023-10-06T11:18:25.447519+0000","last_clean":"2023-10-06T11:18:25.447519+0000","last_became_active":"2023-10-06T11:18:25.447261+0000","last_became_peered":"2023-10-06T11:18:25.447261+0000","last_unstale":"2023-10-06T11:18:25.447519+0000","last_undegraded":"2023-10-06T11:18:25.447519+0000","last_fullsized":"2023-10-06T11:18:25.447519+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:37:29.337170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.441765+0000","last_change":"2023-10-06T11:18:24.887006+0000","last_active":"2023-10-06T11:18:25.441765+0000","last_peered":"2023-10-06T11:18:25.441765+0000","last_clean":"2023-10-06T11:18:25.441765+0000","last_became_active":"2023-10-06T11:18:24.886750+0000","last_became_peered":"2023-10-06T11:18:24.886750+0000","last_unstale":"2023-10-06T11:18:25.441765+0000","last_undegraded":"2023-10-06T11:18:25.441765+0000","last_fullsized":"2023-10-06T11:18:25.441765+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:18:01.491609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.450881+0000","last_change":"2023-10-06T11:18:25.443713+0000","last_active":"2023-10-06T11:18:25.450881+0000","last_peered":"2023-10-06T11:18:25.450881+0000","last_clean":"2023-10-06T11:18:25.450881+0000","last_became_active":"2023-10-06T11:18:25.443453+0000","last_became_peered":"2023-10-06T11:18:25.443453+0000","last_unstale":"2023-10-06T11:18:25.450881+0000","last_undegraded":"2023-10-06T11:18:25.450881+0000","last_fullsized":"2023-10-06T11:18:25.450881+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:49:35.453520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-06T11:18:24.885691+0000","last_change":"2023-10-06T11:18:24.883820+0000","last_active":"2023-10-06T11:18:24.885691+0000","last_peered":"2023-10-06T11:18:24.885691+0000","last_clean":"2023-10-06T11:18:24.885691+0000","last_became_active":"2023-10-06T11:18:24.883563+0000","last_became_peered":"2023-10-06T11:18:24.883563+0000","last_unstale":"2023-10-06T11:18:24.885691+0000","last_undegraded":"2023-10-06T11:18:24.885691+0000","last_fullsized":"2023-10-06T11:18:24.885691+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:27:56.957822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.451925+0000","last_change":"2023-10-06T11:18:25.444566+0000","last_active":"2023-10-06T11:18:25.451925+0000","last_peered":"2023-10-06T11:18:25.451925+0000","last_clean":"2023-10-06T11:18:25.451925+0000","last_became_active":"2023-10-06T11:18:25.444307+0000","last_became_peered":"2023-10-06T11:18:25.444307+0000","last_unstale":"2023-10-06T11:18:25.451925+0000","last_undegraded":"2023-10-06T11:18:25.451925+0000","last_fullsized":"2023-10-06T11:18:25.451925+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:48:59.452585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.10","version":"162'8","reported_seq":17,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.889065+0000","last_change":"2023-10-06T11:18:24.886305+0000","last_active":"2023-10-06T11:18:25.889065+0000","last_peered":"2023-10-06T11:18:25.889065+0000","last_clean":"2023-10-06T11:18:25.889065+0000","last_became_active":"2023-10-06T11:18:24.886021+0000","last_became_peered":"2023-10-06T11:18:24.886021+0000","last_unstale":"2023-10-06T11:18:25.889065+0000","last_undegraded":"2023-10-06T11:18:25.889065+0000","last_fullsized":"2023-10-06T11:18:25.889065+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:58:45.228119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.444857+0000","last_change":"2023-10-06T11:18:25.444857+0000","last_active":"2023-10-06T11:18:25.444857+0000","last_peered":"2023-10-06T11:18:25.444857+0000","last_clean":"2023-10-06T11:18:25.444857+0000","last_became_active":"2023-10-06T11:18:25.444585+0000","last_became_peered":"2023-10-06T11:18:25.444585+0000","last_unstale":"2023-10-06T11:18:25.444857+0000","last_undegraded":"2023-10-06T11:18:25.444857+0000","last_fullsized":"2023-10-06T11:18:25.444857+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:06:08.019626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"162'1","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.435647+0000","last_change":"2023-10-06T11:18:24.886511+0000","last_active":"2023-10-06T11:18:25.435647+0000","last_peered":"2023-10-06T11:18:25.435647+0000","last_clean":"2023-10-06T11:18:25.435647+0000","last_became_active":"2023-10-06T11:18:24.886262+0000","last_became_peered":"2023-10-06T11:18:24.886262+0000","last_unstale":"2023-10-06T11:18:25.435647+0000","last_undegraded":"2023-10-06T11:18:25.435647+0000","last_fullsized":"2023-10-06T11:18:25.435647+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:43:27.992473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.444007+0000","last_change":"2023-10-06T11:18:25.444007+0000","last_active":"2023-10-06T11:18:25.444007+0000","last_peered":"2023-10-06T11:18:25.444007+0000","last_clean":"2023-10-06T11:18:25.444007+0000","last_became_active":"2023-10-06T11:18:25.443429+0000","last_became_peered":"2023-10-06T11:18:25.443429+0000","last_unstale":"2023-10-06T11:18:25.444007+0000","last_undegraded":"2023-10-06T11:18:25.444007+0000","last_fullsized":"2023-10-06T11:18:25.444007+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:11:34.152327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.e","version":"162'2","reported_seq":11,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.880568+0000","last_change":"2023-10-06T11:18:24.887926+0000","last_active":"2023-10-06T11:18:25.880568+0000","last_peered":"2023-10-06T11:18:25.880568+0000","last_clean":"2023-10-06T11:18:25.880568+0000","last_became_active":"2023-10-06T11:18:24.887678+0000","last_became_peered":"2023-10-06T11:18:24.887678+0000","last_unstale":"2023-10-06T11:18:25.880568+0000","last_undegraded":"2023-10-06T11:18:25.880568+0000","last_fullsized":"2023-10-06T11:18:25.880568+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:00:44.460945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.442744+0000","last_change":"2023-10-06T11:18:25.442744+0000","last_active":"2023-10-06T11:18:25.442744+0000","last_peered":"2023-10-06T11:18:25.442744+0000","last_clean":"2023-10-06T11:18:25.442744+0000","last_became_active":"2023-10-06T11:18:25.442494+0000","last_became_peered":"2023-10-06T11:18:25.442494+0000","last_unstale":"2023-10-06T11:18:25.442744+0000","last_undegraded":"2023-10-06T11:18:25.442744+0000","last_fullsized":"2023-10-06T11:18:25.442744+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:29:29.559735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.d","version":"162'1","reported_seq":11,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.883611+0000","last_change":"2023-10-06T11:18:24.892580+0000","last_active":"2023-10-06T11:18:25.883611+0000","last_peered":"2023-10-06T11:18:25.883611+0000","last_clean":"2023-10-06T11:18:25.883611+0000","last_became_active":"2023-10-06T11:18:24.892328+0000","last_became_peered":"2023-10-06T11:18:24.892328+0000","last_unstale":"2023-10-06T11:18:25.883611+0000","last_undegraded":"2023-10-06T11:18:25.883611+0000","last_fullsized":"2023-10-06T11:18:25.883611+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:48:51.581617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.444240+0000","last_change":"2023-10-06T11:18:25.442425+0000","last_active":"2023-10-06T11:18:25.444240+0000","last_peered":"2023-10-06T11:18:25.444240+0000","last_clean":"2023-10-06T11:18:25.444240+0000","last_became_active":"2023-10-06T11:18:25.442070+0000","last_became_peered":"2023-10-06T11:18:25.442070+0000","last_unstale":"2023-10-06T11:18:25.444240+0000","last_undegraded":"2023-10-06T11:18:25.444240+0000","last_fullsized":"2023-10-06T11:18:25.444240+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:35:53.213679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-06T11:18:24.885324+0000","last_change":"2023-10-06T11:18:24.882979+0000","last_active":"2023-10-06T11:18:24.885324+0000","last_peered":"2023-10-06T11:18:24.885324+0000","last_clean":"2023-10-06T11:18:24.885324+0000","last_became_active":"2023-10-06T11:18:24.882687+0000","last_became_peered":"2023-10-06T11:18:24.882687+0000","last_unstale":"2023-10-06T11:18:24.885324+0000","last_undegraded":"2023-10-06T11:18:24.885324+0000","last_fullsized":"2023-10-06T11:18:24.885324+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:40.058892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.444289+0000","last_change":"2023-10-06T11:18:25.442587+0000","last_active":"2023-10-06T11:18:25.444289+0000","last_peered":"2023-10-06T11:18:25.444289+0000","last_clean":"2023-10-06T11:18:25.444289+0000","last_became_active":"2023-10-06T11:18:25.442302+0000","last_became_peered":"2023-10-06T11:18:25.442302+0000","last_unstale":"2023-10-06T11:18:25.444289+0000","last_undegraded":"2023-10-06T11:18:25.444289+0000","last_fullsized":"2023-10-06T11:18:25.444289+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:44:52.093444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"162'2","reported_seq":12,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.883540+0000","last_change":"2023-10-06T11:18:24.883229+0000","last_active":"2023-10-06T11:18:25.883540+0000","last_peered":"2023-10-06T11:18:25.883540+0000","last_clean":"2023-10-06T11:18:25.883540+0000","last_became_active":"2023-10-06T11:18:24.882532+0000","last_became_peered":"2023-10-06T11:18:24.882532+0000","last_unstale":"2023-10-06T11:18:25.883540+0000","last_undegraded":"2023-10-06T11:18:25.883540+0000","last_fullsized":"2023-10-06T11:18:25.883540+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:40:03.670182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.443158+0000","last_change":"2023-10-06T11:18:25.443158+0000","last_active":"2023-10-06T11:18:25.443158+0000","last_peered":"2023-10-06T11:18:25.443158+0000","last_clean":"2023-10-06T11:18:25.443158+0000","last_became_active":"2023-10-06T11:18:25.442882+0000","last_became_peered":"2023-10-06T11:18:25.442882+0000","last_unstale":"2023-10-06T11:18:25.443158+0000","last_undegraded":"2023-10-06T11:18:25.443158+0000","last_fullsized":"2023-10-06T11:18:25.443158+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:59.283961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-06T11:18:24.893712+0000","last_change":"2023-10-06T11:18:24.890804+0000","last_active":"2023-10-06T11:18:24.893712+0000","last_peered":"2023-10-06T11:18:24.893712+0000","last_clean":"2023-10-06T11:18:24.893712+0000","last_became_active":"2023-10-06T11:18:24.887960+0000","last_became_peered":"2023-10-06T11:18:24.887960+0000","last_unstale":"2023-10-06T11:18:24.893712+0000","last_undegraded":"2023-10-06T11:18:24.893712+0000","last_fullsized":"2023-10-06T11:18:24.893712+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:50:28.990335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.441415+0000","last_change":"2023-10-06T11:18:25.441415+0000","last_active":"2023-10-06T11:18:25.441415+0000","last_peered":"2023-10-06T11:18:25.441415+0000","last_clean":"2023-10-06T11:18:25.441415+0000","last_became_active":"2023-10-06T11:18:25.441176+0000","last_became_peered":"2023-10-06T11:18:25.441176+0000","last_unstale":"2023-10-06T11:18:25.441415+0000","last_undegraded":"2023-10-06T11:18:25.441415+0000","last_fullsized":"2023-10-06T11:18:25.441415+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:40:27.559023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-06T11:18:24.890370+0000","last_change":"2023-10-06T11:18:24.888647+0000","last_active":"2023-10-06T11:18:24.890370+0000","last_peered":"2023-10-06T11:18:24.890370+0000","last_clean":"2023-10-06T11:18:24.890370+0000","last_became_active":"2023-10-06T11:18:24.888128+0000","last_became_peered":"2023-10-06T11:18:24.888128+0000","last_unstale":"2023-10-06T11:18:24.890370+0000","last_undegraded":"2023-10-06T11:18:24.890370+0000","last_fullsized":"2023-10-06T11:18:24.890370+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:13:20.219819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.444384+0000","last_change":"2023-10-06T11:18:25.444384+0000","last_active":"2023-10-06T11:18:25.444384+0000","last_peered":"2023-10-06T11:18:25.444384+0000","last_clean":"2023-10-06T11:18:25.444384+0000","last_became_active":"2023-10-06T11:18:25.444020+0000","last_became_peered":"2023-10-06T11:18:25.444020+0000","last_unstale":"2023-10-06T11:18:25.444384+0000","last_undegraded":"2023-10-06T11:18:25.444384+0000","last_fullsized":"2023-10-06T11:18:25.444384+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:08:39.929677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.440470+0000","last_change":"2023-10-06T11:18:24.884230+0000","last_active":"2023-10-06T11:18:25.440470+0000","last_peered":"2023-10-06T11:18:25.440470+0000","last_clean":"2023-10-06T11:18:25.440470+0000","last_became_active":"2023-10-06T11:18:24.883949+0000","last_became_peered":"2023-10-06T11:18:24.883949+0000","last_unstale":"2023-10-06T11:18:25.440470+0000","last_undegraded":"2023-10-06T11:18:25.440470+0000","last_fullsized":"2023-10-06T11:18:25.440470+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:36.159413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.442126+0000","last_change":"2023-10-06T11:18:25.442126+0000","last_active":"2023-10-06T11:18:25.442126+0000","last_peered":"2023-10-06T11:18:25.442126+0000","last_clean":"2023-10-06T11:18:25.442126+0000","last_became_active":"2023-10-06T11:18:25.441882+0000","last_became_peered":"2023-10-06T11:18:25.441882+0000","last_unstale":"2023-10-06T11:18:25.442126+0000","last_undegraded":"2023-10-06T11:18:25.442126+0000","last_fullsized":"2023-10-06T11:18:25.442126+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:27:32.796087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.7","version":"162'2","reported_seq":11,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.880234+0000","last_change":"2023-10-06T11:18:24.887656+0000","last_active":"2023-10-06T11:18:25.880234+0000","last_peered":"2023-10-06T11:18:25.880234+0000","last_clean":"2023-10-06T11:18:25.880234+0000","last_became_active":"2023-10-06T11:18:24.887404+0000","last_became_peered":"2023-10-06T11:18:24.887404+0000","last_unstale":"2023-10-06T11:18:25.880234+0000","last_undegraded":"2023-10-06T11:18:25.880234+0000","last_fullsized":"2023-10-06T11:18:25.880234+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:50:18.275532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.446010+0000","last_change":"2023-10-06T11:18:25.445104+0000","last_active":"2023-10-06T11:18:25.446010+0000","last_peered":"2023-10-06T11:18:25.446010+0000","last_clean":"2023-10-06T11:18:25.446010+0000","last_became_active":"2023-10-06T11:18:25.444702+0000","last_became_peered":"2023-10-06T11:18:25.444702+0000","last_unstale":"2023-10-06T11:18:25.446010+0000","last_undegraded":"2023-10-06T11:18:25.446010+0000","last_fullsized":"2023-10-06T11:18:25.446010+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:09:08.296176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-06T11:18:24.888155+0000","last_change":"2023-10-06T11:18:24.887697+0000","last_active":"2023-10-06T11:18:24.888155+0000","last_peered":"2023-10-06T11:18:24.888155+0000","last_clean":"2023-10-06T11:18:24.888155+0000","last_became_active":"2023-10-06T11:18:24.887414+0000","last_became_peered":"2023-10-06T11:18:24.887414+0000","last_unstale":"2023-10-06T11:18:24.888155+0000","last_undegraded":"2023-10-06T11:18:24.888155+0000","last_fullsized":"2023-10-06T11:18:24.888155+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:48:12.548143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.451874+0000","last_change":"2023-10-06T11:18:25.451874+0000","last_active":"2023-10-06T11:18:25.451874+0000","last_peered":"2023-10-06T11:18:25.451874+0000","last_clean":"2023-10-06T11:18:25.451874+0000","last_became_active":"2023-10-06T11:18:25.451602+0000","last_became_peered":"2023-10-06T11:18:25.451602+0000","last_unstale":"2023-10-06T11:18:25.451874+0000","last_undegraded":"2023-10-06T11:18:25.451874+0000","last_fullsized":"2023-10-06T11:18:25.451874+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:35:53.213679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-06T11:18:24.893474+0000","last_change":"2023-10-06T11:18:24.888941+0000","last_active":"2023-10-06T11:18:24.893474+0000","last_peered":"2023-10-06T11:18:24.893474+0000","last_clean":"2023-10-06T11:18:24.893474+0000","last_became_active":"2023-10-06T11:18:24.888692+0000","last_became_peered":"2023-10-06T11:18:24.888692+0000","last_unstale":"2023-10-06T11:18:24.893474+0000","last_undegraded":"2023-10-06T11:18:24.893474+0000","last_fullsized":"2023-10-06T11:18:24.893474+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:39:13.360180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.443580+0000","last_change":"2023-10-06T11:18:25.443580+0000","last_active":"2023-10-06T11:18:25.443580+0000","last_peered":"2023-10-06T11:18:25.443580+0000","last_clean":"2023-10-06T11:18:25.443580+0000","last_became_active":"2023-10-06T11:18:25.443339+0000","last_became_peered":"2023-10-06T11:18:25.443339+0000","last_unstale":"2023-10-06T11:18:25.443580+0000","last_undegraded":"2023-10-06T11:18:25.443580+0000","last_fullsized":"2023-10-06T11:18:25.443580+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:10:53.067979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-06T11:18:24.893427+0000","last_change":"2023-10-06T11:18:24.889366+0000","last_active":"2023-10-06T11:18:24.893427+0000","last_peered":"2023-10-06T11:18:24.893427+0000","last_clean":"2023-10-06T11:18:24.893427+0000","last_became_active":"2023-10-06T11:18:24.889129+0000","last_became_peered":"2023-10-06T11:18:24.889129+0000","last_unstale":"2023-10-06T11:18:24.893427+0000","last_undegraded":"2023-10-06T11:18:24.893427+0000","last_fullsized":"2023-10-06T11:18:24.893427+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:09:07.291323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.448935+0000","last_change":"2023-10-06T11:18:25.446430+0000","last_active":"2023-10-06T11:18:25.448935+0000","last_peered":"2023-10-06T11:18:25.448935+0000","last_clean":"2023-10-06T11:18:25.448935+0000","last_became_active":"2023-10-06T11:18:25.446136+0000","last_became_peered":"2023-10-06T11:18:25.446136+0000","last_unstale":"2023-10-06T11:18:25.448935+0000","last_undegraded":"2023-10-06T11:18:25.448935+0000","last_fullsized":"2023-10-06T11:18:25.448935+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:31:31.365208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-06T11:18:24.892441+0000","last_change":"2023-10-06T11:18:24.888193+0000","last_active":"2023-10-06T11:18:24.892441+0000","last_peered":"2023-10-06T11:18:24.892441+0000","last_clean":"2023-10-06T11:18:24.892441+0000","last_became_active":"2023-10-06T11:18:24.887917+0000","last_became_peered":"2023-10-06T11:18:24.887917+0000","last_unstale":"2023-10-06T11:18:24.892441+0000","last_undegraded":"2023-10-06T11:18:24.892441+0000","last_fullsized":"2023-10-06T11:18:24.892441+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:51.823646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.450784+0000","last_change":"2023-10-06T11:18:25.443486+0000","last_active":"2023-10-06T11:18:25.450784+0000","last_peered":"2023-10-06T11:18:25.450784+0000","last_clean":"2023-10-06T11:18:25.450784+0000","last_became_active":"2023-10-06T11:18:25.443007+0000","last_became_peered":"2023-10-06T11:18:25.443007+0000","last_unstale":"2023-10-06T11:18:25.450784+0000","last_undegraded":"2023-10-06T11:18:25.450784+0000","last_fullsized":"2023-10-06T11:18:25.450784+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:17:44.642541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-06T11:18:24.895267+0000","last_change":"2023-10-06T11:18:24.892740+0000","last_active":"2023-10-06T11:18:24.895267+0000","last_peered":"2023-10-06T11:18:24.895267+0000","last_clean":"2023-10-06T11:18:24.895267+0000","last_became_active":"2023-10-06T11:18:24.892419+0000","last_became_peered":"2023-10-06T11:18:24.892419+0000","last_unstale":"2023-10-06T11:18:24.895267+0000","last_undegraded":"2023-10-06T11:18:24.895267+0000","last_fullsized":"2023-10-06T11:18:24.895267+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:01:13.168101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.450923+0000","last_change":"2023-10-06T11:18:25.447669+0000","last_active":"2023-10-06T11:18:25.450923+0000","last_peered":"2023-10-06T11:18:25.450923+0000","last_clean":"2023-10-06T11:18:25.450923+0000","last_became_active":"2023-10-06T11:18:25.447347+0000","last_became_peered":"2023-10-06T11:18:25.447347+0000","last_unstale":"2023-10-06T11:18:25.450923+0000","last_undegraded":"2023-10-06T11:18:25.450923+0000","last_fullsized":"2023-10-06T11:18:25.450923+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:59:26.364232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-06T11:18:24.889782+0000","last_change":"2023-10-06T11:18:24.886527+0000","last_active":"2023-10-06T11:18:24.889782+0000","last_peered":"2023-10-06T11:18:24.889782+0000","last_clean":"2023-10-06T11:18:24.889782+0000","last_became_active":"2023-10-06T11:18:24.886276+0000","last_became_peered":"2023-10-06T11:18:24.886276+0000","last_unstale":"2023-10-06T11:18:24.889782+0000","last_undegraded":"2023-10-06T11:18:24.889782+0000","last_fullsized":"2023-10-06T11:18:24.889782+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:33:17.423153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.452486+0000","last_change":"2023-10-06T11:18:25.452486+0000","last_active":"2023-10-06T11:18:25.452486+0000","last_peered":"2023-10-06T11:18:25.452486+0000","last_clean":"2023-10-06T11:18:25.452486+0000","last_became_active":"2023-10-06T11:18:25.452244+0000","last_became_peered":"2023-10-06T11:18:25.452244+0000","last_unstale":"2023-10-06T11:18:25.452486+0000","last_undegraded":"2023-10-06T11:18:25.452486+0000","last_fullsized":"2023-10-06T11:18:25.452486+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:43:28.681381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.440471+0000","last_change":"2023-10-06T11:18:24.887846+0000","last_active":"2023-10-06T11:18:25.440471+0000","last_peered":"2023-10-06T11:18:25.440471+0000","last_clean":"2023-10-06T11:18:25.440471+0000","last_became_active":"2023-10-06T11:18:24.887521+0000","last_became_peered":"2023-10-06T11:18:24.887521+0000","last_unstale":"2023-10-06T11:18:25.440471+0000","last_undegraded":"2023-10-06T11:18:25.440471+0000","last_fullsized":"2023-10-06T11:18:25.440471+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:06:59.458337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.452466+0000","last_change":"2023-10-06T11:18:25.452466+0000","last_active":"2023-10-06T11:18:25.452466+0000","last_peered":"2023-10-06T11:18:25.452466+0000","last_clean":"2023-10-06T11:18:25.452466+0000","last_became_active":"2023-10-06T11:18:25.452188+0000","last_became_peered":"2023-10-06T11:18:25.452188+0000","last_unstale":"2023-10-06T11:18:25.452466+0000","last_undegraded":"2023-10-06T11:18:25.452466+0000","last_fullsized":"2023-10-06T11:18:25.452466+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:01:36.823275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1d","version":"162'2","reported_seq":11,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.884098+0000","last_change":"2023-10-06T11:18:24.882635+0000","last_active":"2023-10-06T11:18:25.884098+0000","last_peered":"2023-10-06T11:18:25.884098+0000","last_clean":"2023-10-06T11:18:25.884098+0000","last_became_active":"2023-10-06T11:18:24.882293+0000","last_became_peered":"2023-10-06T11:18:24.882293+0000","last_unstale":"2023-10-06T11:18:25.884098+0000","last_undegraded":"2023-10-06T11:18:25.884098+0000","last_fullsized":"2023-10-06T11:18:25.884098+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:07:56.630675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":143,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.438949+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:18:25.438949+0000","last_peered":"2023-10-06T11:18:25.438949+0000","last_clean":"2023-10-06T11:18:25.438949+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:18:25.438949+0000","last_undegraded":"2023-10-06T11:18:25.438949+0000","last_fullsized":"2023-10-06T11:18:25.438949+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.447833+0000","last_change":"2023-10-06T11:18:25.443617+0000","last_active":"2023-10-06T11:18:25.447833+0000","last_peered":"2023-10-06T11:18:25.447833+0000","last_clean":"2023-10-06T11:18:25.447833+0000","last_became_active":"2023-10-06T11:18:25.443350+0000","last_became_peered":"2023-10-06T11:18:25.443350+0000","last_unstale":"2023-10-06T11:18:25.447833+0000","last_undegraded":"2023-10-06T11:18:25.447833+0000","last_fullsized":"2023-10-06T11:18:25.447833+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:25:03.060786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1c","version":"162'2","reported_seq":12,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.885335+0000","last_change":"2023-10-06T11:18:24.887627+0000","last_active":"2023-10-06T11:18:25.885335+0000","last_peered":"2023-10-06T11:18:25.885335+0000","last_clean":"2023-10-06T11:18:25.885335+0000","last_became_active":"2023-10-06T11:18:24.887340+0000","last_became_peered":"2023-10-06T11:18:24.887340+0000","last_unstale":"2023-10-06T11:18:25.885335+0000","last_undegraded":"2023-10-06T11:18:25.885335+0000","last_fullsized":"2023-10-06T11:18:25.885335+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:18:01.491609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":133,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-06T11:18:24.874989+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:18:24.874989+0000","last_peered":"2023-10-06T11:18:24.874989+0000","last_clean":"2023-10-06T11:18:24.874989+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:18:24.874989+0000","last_undegraded":"2023-10-06T11:18:24.874989+0000","last_fullsized":"2023-10-06T11:18:24.874989+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.450408+0000","last_change":"2023-10-06T11:18:25.442651+0000","last_active":"2023-10-06T11:18:25.450408+0000","last_peered":"2023-10-06T11:18:25.450408+0000","last_clean":"2023-10-06T11:18:25.450408+0000","last_became_active":"2023-10-06T11:18:25.442391+0000","last_became_peered":"2023-10-06T11:18:25.442391+0000","last_unstale":"2023-10-06T11:18:25.450408+0000","last_undegraded":"2023-10-06T11:18:25.450408+0000","last_fullsized":"2023-10-06T11:18:25.450408+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:52.828500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1b","version":"162'1","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.438336+0000","last_change":"2023-10-06T11:18:24.888943+0000","last_active":"2023-10-06T11:18:25.438336+0000","last_peered":"2023-10-06T11:18:25.438336+0000","last_clean":"2023-10-06T11:18:25.438336+0000","last_became_active":"2023-10-06T11:18:24.888320+0000","last_became_peered":"2023-10-06T11:18:24.888320+0000","last_unstale":"2023-10-06T11:18:25.438336+0000","last_undegraded":"2023-10-06T11:18:25.438336+0000","last_fullsized":"2023-10-06T11:18:25.438336+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:44:51.088591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":132,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.438070+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:18:25.438070+0000","last_peered":"2023-10-06T11:18:25.438070+0000","last_clean":"2023-10-06T11:18:25.438070+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:18:25.438070+0000","last_undegraded":"2023-10-06T11:18:25.438070+0000","last_fullsized":"2023-10-06T11:18:25.438070+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":276,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-06T11:18:24.881219+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:18:24.881219+0000","last_peered":"2023-10-06T11:18:24.881219+0000","last_clean":"2023-10-06T11:18:24.881219+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:18:24.881219+0000","last_undegraded":"2023-10-06T11:18:24.881219+0000","last_fullsized":"2023-10-06T11:18:24.881219+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.450640+0000","last_change":"2023-10-06T11:18:25.447447+0000","last_active":"2023-10-06T11:18:25.450640+0000","last_peered":"2023-10-06T11:18:25.450640+0000","last_clean":"2023-10-06T11:18:25.450640+0000","last_became_active":"2023-10-06T11:18:25.447192+0000","last_became_peered":"2023-10-06T11:18:25.447192+0000","last_unstale":"2023-10-06T11:18:25.450640+0000","last_undegraded":"2023-10-06T11:18:25.450640+0000","last_fullsized":"2023-10-06T11:18:25.450640+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:59:48.728783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1a","version":"162'1","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.434528+0000","last_change":"2023-10-06T11:18:24.893031+0000","last_active":"2023-10-06T11:18:25.434528+0000","last_peered":"2023-10-06T11:18:25.434528+0000","last_clean":"2023-10-06T11:18:25.434528+0000","last_became_active":"2023-10-06T11:18:24.892718+0000","last_became_peered":"2023-10-06T11:18:24.892718+0000","last_unstale":"2023-10-06T11:18:25.434528+0000","last_undegraded":"2023-10-06T11:18:25.434528+0000","last_fullsized":"2023-10-06T11:18:25.434528+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:12:31.245499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":126,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-06T11:18:24.881316+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:18:24.881316+0000","last_peered":"2023-10-06T11:18:24.881316+0000","last_clean":"2023-10-06T11:18:24.881316+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:18:24.881316+0000","last_undegraded":"2023-10-06T11:18:24.881316+0000","last_fullsized":"2023-10-06T11:18:24.881316+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.449068+0000","last_change":"2023-10-06T11:18:25.446139+0000","last_active":"2023-10-06T11:18:25.449068+0000","last_peered":"2023-10-06T11:18:25.449068+0000","last_clean":"2023-10-06T11:18:25.449068+0000","last_became_active":"2023-10-06T11:18:25.445839+0000","last_became_peered":"2023-10-06T11:18:25.445839+0000","last_unstale":"2023-10-06T11:18:25.449068+0000","last_undegraded":"2023-10-06T11:18:25.449068+0000","last_fullsized":"2023-10-06T11:18:25.449068+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:10.480310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-06T11:18:24.890414+0000","last_change":"2023-10-06T11:18:24.885372+0000","last_active":"2023-10-06T11:18:24.890414+0000","last_peered":"2023-10-06T11:18:24.890414+0000","last_clean":"2023-10-06T11:18:24.890414+0000","last_became_active":"2023-10-06T11:18:24.885067+0000","last_became_peered":"2023-10-06T11:18:24.885067+0000","last_unstale":"2023-10-06T11:18:24.890414+0000","last_undegraded":"2023-10-06T11:18:24.890414+0000","last_fullsized":"2023-10-06T11:18:24.890414+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:54:22.459395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":126,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-06T11:18:24.881256+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:18:24.881256+0000","last_peered":"2023-10-06T11:18:24.881256+0000","last_clean":"2023-10-06T11:18:24.881256+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:18:24.881256+0000","last_undegraded":"2023-10-06T11:18:24.881256+0000","last_fullsized":"2023-10-06T11:18:24.881256+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.452617+0000","last_change":"2023-10-06T11:18:25.451678+0000","last_active":"2023-10-06T11:18:25.452617+0000","last_peered":"2023-10-06T11:18:25.452617+0000","last_clean":"2023-10-06T11:18:25.452617+0000","last_became_active":"2023-10-06T11:18:25.451400+0000","last_became_peered":"2023-10-06T11:18:25.451400+0000","last_unstale":"2023-10-06T11:18:25.452617+0000","last_undegraded":"2023-10-06T11:18:25.452617+0000","last_fullsized":"2023-10-06T11:18:25.452617+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:47.139530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.438374+0000","last_change":"2023-10-06T11:18:24.883813+0000","last_active":"2023-10-06T11:18:25.438374+0000","last_peered":"2023-10-06T11:18:25.438374+0000","last_clean":"2023-10-06T11:18:25.438374+0000","last_became_active":"2023-10-06T11:18:24.883561+0000","last_became_peered":"2023-10-06T11:18:24.883561+0000","last_unstale":"2023-10-06T11:18:25.438374+0000","last_undegraded":"2023-10-06T11:18:25.438374+0000","last_fullsized":"2023-10-06T11:18:25.438374+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:43:27.992473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":149,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-06T11:18:24.872774+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:18:24.872774+0000","last_peered":"2023-10-06T11:18:24.872774+0000","last_clean":"2023-10-06T11:18:24.872774+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:18:24.872774+0000","last_undegraded":"2023-10-06T11:18:24.872774+0000","last_fullsized":"2023-10-06T11:18:24.872774+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.450459+0000","last_change":"2023-10-06T11:18:25.450459+0000","last_active":"2023-10-06T11:18:25.450459+0000","last_peered":"2023-10-06T11:18:25.450459+0000","last_clean":"2023-10-06T11:18:25.450459+0000","last_became_active":"2023-10-06T11:18:25.450197+0000","last_became_peered":"2023-10-06T11:18:25.450197+0000","last_unstale":"2023-10-06T11:18:25.450459+0000","last_undegraded":"2023-10-06T11:18:25.450459+0000","last_fullsized":"2023-10-06T11:18:25.450459+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:46:29.866454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"162'1","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.436914+0000","last_change":"2023-10-06T11:18:24.889394+0000","last_active":"2023-10-06T11:18:25.436914+0000","last_peered":"2023-10-06T11:18:25.436914+0000","last_clean":"2023-10-06T11:18:25.436914+0000","last_became_active":"2023-10-06T11:18:24.889173+0000","last_became_peered":"2023-10-06T11:18:24.889173+0000","last_unstale":"2023-10-06T11:18:25.436914+0000","last_undegraded":"2023-10-06T11:18:25.436914+0000","last_fullsized":"2023-10-06T11:18:25.436914+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:46.134676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":133,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.439787+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:18:25.439787+0000","last_peered":"2023-10-06T11:18:25.439787+0000","last_clean":"2023-10-06T11:18:25.439787+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:18:25.439787+0000","last_undegraded":"2023-10-06T11:18:25.439787+0000","last_fullsized":"2023-10-06T11:18:25.439787+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.453602+0000","last_change":"2023-10-06T11:18:25.453602+0000","last_active":"2023-10-06T11:18:25.453602+0000","last_peered":"2023-10-06T11:18:25.453602+0000","last_clean":"2023-10-06T11:18:25.453602+0000","last_became_active":"2023-10-06T11:18:25.453307+0000","last_became_peered":"2023-10-06T11:18:25.453307+0000","last_unstale":"2023-10-06T11:18:25.453602+0000","last_undegraded":"2023-10-06T11:18:25.453602+0000","last_fullsized":"2023-10-06T11:18:25.453602+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:02.747570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1f","version":"162'4","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.893660+0000","last_change":"2023-10-06T11:18:24.890390+0000","last_active":"2023-10-06T11:18:25.893660+0000","last_peered":"2023-10-06T11:18:25.893660+0000","last_clean":"2023-10-06T11:18:25.893660+0000","last_became_active":"2023-10-06T11:18:24.887907+0000","last_became_peered":"2023-10-06T11:18:24.887907+0000","last_unstale":"2023-10-06T11:18:25.893660+0000","last_undegraded":"2023-10-06T11:18:25.893660+0000","last_fullsized":"2023-10-06T11:18:25.893660+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:58:43.295708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":133,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.439903+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:18:25.439903+0000","last_peered":"2023-10-06T11:18:25.439903+0000","last_clean":"2023-10-06T11:18:25.439903+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:18:25.439903+0000","last_undegraded":"2023-10-06T11:18:25.439903+0000","last_fullsized":"2023-10-06T11:18:25.439903+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":25,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575005,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303956,"kb_used_data":2572,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067884,"statfs":{"total":96636764160,"available":96325513216,"internally_reserved":0,"allocated":2633728,"data_stored":1531080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54400000000000004,"15min":0.629},"min":{"1min":0.35899999999999999,"5min":0.252,"15min":0.21199999999999999},"max":{"1min":0.70999999999999996,"5min":4.407,"15min":23.908999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.52500000000000002,"15min":0.57799999999999996},"min":{"1min":0.38200000000000001,"5min":0.26900000000000002,"15min":0.22500000000000001},"max":{"1min":0.71699999999999997,"5min":0.76800000000000002,"15min":9.3230000000000004},"last":0.39200000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54500000000000004,"15min":0.55900000000000005},"min":{"1min":0.439,"5min":0.28399999999999997,"15min":0.26000000000000001},"max":{"1min":0.72699999999999998,"5min":2.4689999999999999,"15min":9.2360000000000007},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.5,"15min":0.505},"min":{"1min":0.373,"5min":0.33100000000000002,"15min":0.25900000000000001},"max":{"1min":0.63900000000000001,"5min":0.70899999999999996,"15min":4.327},"last":0.373}]},{"osd":2,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56499999999999995,"15min":0.52100000000000002},"min":{"1min":0.379,"5min":0.34399999999999997,"15min":0.26500000000000001},"max":{"1min":0.67000000000000004,"5min":4.3120000000000003,"15min":4.3120000000000003},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56299999999999994,"15min":0.55800000000000005},"min":{"1min":0.46300000000000002,"5min":0.311,"15min":0.29999999999999999},"max":{"1min":0.65400000000000003,"5min":3.0600000000000001,"15min":4.7309999999999999},"last":0.34799999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56899999999999995,"15min":0.54500000000000004},"min":{"1min":0.45300000000000001,"5min":0.32600000000000001,"15min":0.27900000000000003},"max":{"1min":0.69899999999999995,"5min":4.5190000000000001,"15min":4.5190000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.44800000000000001,"5min":0.374,"15min":0.29699999999999999},"max":{"1min":0.73199999999999998,"5min":3.0070000000000001,"15min":9.3879999999999999},"last":0.48899999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.52600000000000002,"15min":0.49299999999999999},"min":{"1min":0.32600000000000001,"5min":0.29799999999999999,"15min":0.24399999999999999},"max":{"1min":0.59099999999999997,"5min":4.6639999999999997,"15min":4.6639999999999997},"last":0.434},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.56799999999999995,"15min":0.53500000000000003},"min":{"1min":0.41999999999999998,"5min":0.28499999999999998,"15min":0.27300000000000002},"max":{"1min":0.64700000000000002,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":0.57999999999999996}]},{"osd":5,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.53200000000000003,"15min":0.55700000000000005},"min":{"1min":0.33100000000000002,"5min":0.32900000000000001,"15min":0.26000000000000001},"max":{"1min":0.72399999999999998,"5min":0.77000000000000002,"15min":9.3499999999999996},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.502,"5min":0.52500000000000002,"15min":0.53800000000000003},"min":{"1min":0.371,"5min":0.30099999999999999,"15min":0.26800000000000002},"max":{"1min":0.71399999999999997,"5min":0.89100000000000001,"15min":4.444},"last":0.502}]},{"osd":6,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.56699999999999995,"15min":0.59299999999999997},"min":{"1min":0.39500000000000002,"5min":0.38100000000000001,"15min":0.29199999999999998},"max":{"1min":0.68600000000000005,"5min":0.82099999999999995,"15min":9.4969999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.63200000000000001,"15min":0.61899999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.74199999999999999,"5min":4.4669999999999996,"15min":7.2039999999999997},"last":0.55100000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575007,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299292,"kb_used_data":2004,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072548,"statfs":{"total":96636764160,"available":96330289152,"internally_reserved":0,"allocated":2052096,"data_stored":946070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.60999999999999999,"15min":0.52700000000000002},"min":{"1min":0.307,"5min":0.247,"15min":0.187},"max":{"1min":0.78300000000000003,"5min":9.5549999999999997,"15min":9.5549999999999997},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.63,"5min":0.66900000000000004,"15min":0.57299999999999995},"min":{"1min":0.47299999999999998,"5min":0.30399999999999999,"15min":0.254},"max":{"1min":0.81999999999999995,"5min":9.4659999999999993,"15min":9.4659999999999993},"last":0.53200000000000003}]},{"osd":1,"last update":"Fri Oct 6 11:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.497,"15min":0.48699999999999999},"min":{"1min":0.372,"5min":0.27500000000000002,"15min":0.23300000000000001},"max":{"1min":0.71399999999999997,"5min":0.80300000000000005,"15min":0.91700000000000004},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.53200000000000003,"15min":0.52100000000000002},"min":{"1min":0.34599999999999997,"5min":0.32900000000000001,"15min":0.216},"max":{"1min":0.84199999999999997,"5min":2.238,"15min":5.2670000000000003},"last":0.57899999999999996}]},{"osd":2,"last update":"Fri Oct 6 11:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.51000000000000001,"15min":0.50700000000000001},"min":{"1min":0.30199999999999999,"5min":0.255,"15min":0.252},"max":{"1min":0.753,"5min":0.93200000000000005,"15min":7.0659999999999998},"last":0.503},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.52100000000000002,"15min":0.52300000000000002},"min":{"1min":0.40300000000000002,"5min":0.32200000000000001,"15min":0.26600000000000001},"max":{"1min":0.77600000000000002,"5min":0.78600000000000003,"15min":7.0819999999999999},"last":0.55500000000000005}]},{"osd":3,"last update":"Fri Oct 6 11:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57799999999999996,"15min":0.52700000000000002},"min":{"1min":0.39400000000000002,"5min":0.32600000000000001,"15min":0.25800000000000001},"max":{"1min":0.91300000000000003,"5min":3.871,"15min":3.871},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.55200000000000005,"15min":0.53700000000000003},"min":{"1min":0.47199999999999998,"5min":0.32100000000000001,"15min":0.312},"max":{"1min":0.80700000000000005,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.76400000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.48399999999999999,"15min":0.47699999999999998},"min":{"1min":0.35899999999999999,"5min":0.26800000000000002,"15min":0.24299999999999999},"max":{"1min":0.72999999999999998,"5min":0.76000000000000001,"15min":0.88},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54200000000000004,"15min":0.53200000000000003},"min":{"1min":0.38600000000000001,"5min":0.29699999999999999,"15min":0.27900000000000003},"max":{"1min":0.77600000000000002,"5min":0.82399999999999995,"15min":1.0680000000000001},"last":0.747}]},{"osd":5,"last update":"Fri Oct 6 11:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52700000000000002,"15min":0.51600000000000001},"min":{"1min":0.36599999999999999,"5min":0.32000000000000001,"15min":0.28399999999999997},"max":{"1min":0.69999999999999996,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63400000000000001,"15min":0.58099999999999996},"min":{"1min":0.42499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.88700000000000001,"5min":7.1379999999999999,"15min":7.1379999999999999},"last":0.80200000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59399999999999997,"15min":0.57099999999999995},"min":{"1min":0.38400000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.83899999999999997,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.59999999999999998,"15min":0.58599999999999997},"min":{"1min":0.40999999999999998,"5min":0.36399999999999999,"15min":0.30199999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.86399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575006,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312160,"kb_used_data":2584,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059680,"statfs":{"total":96636764160,"available":96317112320,"internally_reserved":0,"allocated":2646016,"data_stored":1537721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.47799999999999998,"15min":0.377},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.186},"max":{"1min":0.54000000000000004,"5min":13.393000000000001,"15min":13.393000000000001},"last":0.19900000000000001},{"interface":"front","average":{"1min":0.374,"5min":0.47599999999999998,"15min":0.38800000000000001},"min":{"1min":0.247,"5min":0.22700000000000001,"15min":0.19700000000000001},"max":{"1min":0.52100000000000002,"5min":11.462,"15min":11.462},"last":0.214}]},{"osd":2,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.41999999999999998,"15min":0.36299999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.216},"max":{"1min":0.56000000000000005,"5min":8.0470000000000006,"15min":8.0470000000000006},"last":0.249},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.45900000000000002,"15min":0.41099999999999998},"min":{"1min":0.27100000000000002,"5min":0.215,"15min":0.20999999999999999},"max":{"1min":0.66700000000000004,"5min":4.8630000000000004,"15min":4.8630000000000004},"last":0.26600000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.47599999999999998,"15min":0.42799999999999999},"min":{"1min":0.311,"5min":0.255,"15min":0.252},"max":{"1min":0.63700000000000001,"5min":4.8029999999999999,"15min":4.8029999999999999},"last":0.315},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.46100000000000002,"15min":0.40200000000000002},"min":{"1min":0.23799999999999999,"5min":0.23400000000000001,"15min":0.217},"max":{"1min":0.61799999999999999,"5min":5.8700000000000001,"15min":5.8700000000000001},"last":0.29199999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56399999999999995,"15min":0.53200000000000003},"min":{"1min":0.42499999999999999,"5min":0.28299999999999997,"15min":0.28199999999999997},"max":{"1min":0.83099999999999996,"5min":1.264,"15min":1.264},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.64200000000000002,"15min":0.57999999999999996},"min":{"1min":0.46700000000000003,"5min":0.317,"15min":0.317},"max":{"1min":0.85299999999999998,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.46000000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.624,"15min":0.57599999999999996},"min":{"1min":0.432,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.79900000000000004,"5min":3.4390000000000001,"15min":3.4390000000000001},"last":0.502},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.70799999999999996,"15min":0.60199999999999998},"min":{"1min":0.47599999999999998,"5min":0.36799999999999999,"15min":0.29499999999999998},"max":{"1min":0.92000000000000004,"5min":9.3829999999999991,"15min":9.3829999999999991},"last":0.44900000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.66500000000000004,"15min":0.60199999999999998},"min":{"1min":0.47799999999999998,"5min":0.35999999999999999,"15min":0.315},"max":{"1min":0.90800000000000003,"5min":3.4750000000000001,"15min":3.4750000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.66400000000000003,"15min":0.60999999999999999},"min":{"1min":0.45400000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.89700000000000002,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.55700000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68200000000000005,"15min":0.621},"min":{"1min":0.44400000000000001,"5min":0.39800000000000002,"15min":0.38500000000000001},"max":{"1min":0.90300000000000002,"5min":4.7290000000000001,"15min":4.7290000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.64300000000000002,"15min":0.60199999999999998},"min":{"1min":0.47399999999999998,"5min":0.38900000000000001,"15min":0.374},"max":{"1min":0.871,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.57899999999999996}]}]},{"osd":0,"up_from":13,"seq":55834575005,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303388,"kb_used_data":2004,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068452,"statfs":{"total":96636764160,"available":96326094848,"internally_reserved":0,"allocated":2052096,"data_stored":940059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.34599999999999997,"15min":0.47299999999999998},"min":{"1min":0.23999999999999999,"5min":0.20399999999999999,"15min":0.184},"max":{"1min":0.55500000000000005,"5min":0.60199999999999998,"15min":36.097999999999999},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.36499999999999999,"15min":0.38600000000000001},"min":{"1min":0.26400000000000001,"5min":0.22,"15min":0.182},"max":{"1min":0.51400000000000001,"5min":0.92400000000000004,"15min":7.2990000000000004},"last":0.435}]},{"osd":2,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.36599999999999999,"15min":0.50600000000000001},"min":{"1min":0.315,"5min":0.223,"15min":0.217},"max":{"1min":0.56100000000000005,"5min":0.61699999999999999,"15min":36.07},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.39400000000000002,"15min":0.41299999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.219},"max":{"1min":0.60799999999999998,"5min":0.94899999999999995,"15min":6.7800000000000002},"last":0.35699999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.36299999999999999,"15min":0.39600000000000002},"min":{"1min":0.28100000000000003,"5min":0.255,"15min":0.223},"max":{"1min":0.504,"5min":0.55000000000000004,"15min":8.4130000000000003},"last":0.372},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.42799999999999999,"15min":0.56000000000000005},"min":{"1min":0.28599999999999998,"5min":0.25800000000000001,"15min":0.249},"max":{"1min":0.59099999999999997,"5min":1.9079999999999999,"15min":35.959000000000003},"last":0.52500000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.59199999999999997,"15min":0.57299999999999995},"min":{"1min":0.496,"5min":0.33800000000000002,"15min":0.29599999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":2.427},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.60799999999999998,"15min":0.73399999999999999},"min":{"1min":0.496,"5min":0.374,"15min":0.29299999999999998},"max":{"1min":0.91100000000000003,"5min":0.94999999999999996,"15min":36.005000000000003},"last":0.68300000000000005}]},{"osd":5,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.39400000000000002,"5min":0.38400000000000001,"15min":0.32900000000000001},"max":{"1min":0.86199999999999999,"5min":0.999,"15min":6.6699999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57699999999999996,"15min":0.56299999999999994},"min":{"1min":0.41399999999999998,"5min":0.372,"15min":0.315},"max":{"1min":0.77200000000000002,"5min":0.99399999999999999,"15min":2.0600000000000001},"last":0.58499999999999996}]},{"osd":6,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.61299999999999999,"15min":0.73499999999999999},"min":{"1min":0.45800000000000002,"5min":0.39200000000000002,"15min":0.317},"max":{"1min":0.878,"5min":0.98699999999999999,"15min":36.037999999999997},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.63100000000000001,"15min":0.64400000000000002},"min":{"1min":0.45800000000000002,"5min":0.40999999999999998,"15min":0.36399999999999999},"max":{"1min":0.88800000000000001,"5min":1.028,"15min":6.7110000000000003},"last":0.751}]},{"osd":7,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.47399999999999998,"5min":0.432,"15min":0.371},"max":{"1min":0.80400000000000005,"5min":1.054,"15min":6.742},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.58799999999999997,"15min":0.57799999999999996},"min":{"1min":0.46200000000000002,"5min":0.41399999999999998,"15min":0.34499999999999997},"max":{"1min":0.89300000000000002,"5min":0.96199999999999997,"15min":1.917},"last":0.72899999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575006,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299264,"kb_used_data":1976,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072576,"statfs":{"total":96636764160,"available":96330317824,"internally_reserved":0,"allocated":2023424,"data_stored":932243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.47499999999999998,"15min":0.36599999999999999},"min":{"1min":0.24399999999999999,"5min":0.214,"15min":0.17999999999999999},"max":{"1min":0.622,"5min":15.228,"15min":15.228},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.40699999999999997,"15min":0.39200000000000002},"min":{"1min":0.32000000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.72599999999999998,"5min":1.714,"15min":1.714},"last":0.377}]},{"osd":1,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.379,"15min":0.376},"min":{"1min":0.253,"5min":0.23599999999999999,"15min":0.19900000000000001},"max":{"1min":0.56999999999999995,"5min":0.57499999999999996,"15min":0.745},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.36599999999999999,"15min":0.35699999999999998},"min":{"1min":0.26000000000000001,"5min":0.23200000000000001,"15min":0.216},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.36099999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.36699999999999999,"15min":0.36899999999999999},"min":{"1min":0.27000000000000002,"5min":0.23699999999999999,"15min":0.23200000000000001},"max":{"1min":0.60899999999999999,"5min":0.621,"15min":0.629},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.38800000000000001,"15min":0.371},"min":{"1min":0.29499999999999998,"5min":0.254,"15min":0.251},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.32200000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54500000000000004,"15min":0.53400000000000003},"min":{"1min":0.439,"5min":0.30599999999999999,"15min":0.30299999999999999},"max":{"1min":0.69699999999999995,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.502},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.68799999999999994,"15min":0.59399999999999997},"min":{"1min":0.374,"5min":0.28199999999999997,"15min":0.27900000000000003},"max":{"1min":0.70999999999999996,"5min":15.26,"15min":15.26},"last":0.61299999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.69799999999999995,"15min":0.59599999999999997},"min":{"1min":0.39700000000000002,"5min":0.35799999999999998,"15min":0.32400000000000001},"max":{"1min":0.73699999999999999,"5min":15.186,"15min":15.186},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56799999999999995,"15min":0.56100000000000005},"min":{"1min":0.42999999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72199999999999998,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.52800000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59299999999999997,"15min":0.58599999999999997},"min":{"1min":0.48299999999999998,"5min":0.38200000000000001,"15min":0.32600000000000001},"max":{"1min":0.76900000000000002,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59599999999999997,"15min":0.57999999999999996},"min":{"1min":0.438,"5min":0.40699999999999997,"15min":0.34200000000000003},"max":{"1min":0.80500000000000005,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.59499999999999997}]},{"osd":7,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.67300000000000004,"15min":0.59999999999999998},"min":{"1min":0.41699999999999998,"5min":0.37,"15min":0.34499999999999997},"max":{"1min":0.69399999999999995,"5min":10.977,"15min":10.977},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57799999999999996,"15min":0.57399999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.38200000000000001},"max":{"1min":0.79400000000000004,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.56399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575006,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311564,"kb_used_data":1988,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060276,"statfs":{"total":96636764160,"available":96317722624,"internally_reserved":0,"allocated":2035712,"data_stored":939359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.34799999999999998,"15min":0.32800000000000001},"min":{"1min":0.20799999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.55200000000000005,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.41999999999999998,"15min":0.39100000000000001},"min":{"1min":0.26800000000000002,"5min":0.23000000000000001,"15min":0.22700000000000001},"max":{"1min":0.61099999999999999,"5min":4.4820000000000002,"15min":4.4820000000000002},"last":0.29899999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.32100000000000001,"15min":0.315},"min":{"1min":0.22800000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.48199999999999998,"5min":0.54000000000000004,"15min":0.65400000000000003},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.36499999999999999,"15min":0.35799999999999998},"min":{"1min":0.28899999999999998,"5min":0.254,"15min":0.188},"max":{"1min":0.52300000000000002,"5min":0.53600000000000003,"15min":1.196},"last":0.314}]},{"osd":2,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.39900000000000002,"15min":0.38200000000000001},"min":{"1min":0.25,"5min":0.245,"15min":0.19600000000000001},"max":{"1min":0.52100000000000002,"5min":4.601,"15min":4.601},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.44400000000000001,"15min":0.41999999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.26100000000000001},"max":{"1min":0.60599999999999998,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.35499999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55300000000000005,"15min":0.54700000000000004},"min":{"1min":0.38800000000000001,"5min":0.32100000000000001,"15min":0.311},"max":{"1min":0.76500000000000001,"5min":0.88500000000000001,"15min":1.694},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55500000000000005,"15min":0.54200000000000004},"min":{"1min":0.438,"5min":0.32600000000000001,"15min":0.30199999999999999},"max":{"1min":0.71699999999999997,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.57899999999999996}]},{"osd":5,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.55800000000000005,"15min":0.54100000000000004},"min":{"1min":0.42199999999999999,"5min":0.34100000000000003,"15min":0.29399999999999998},"max":{"1min":0.83999999999999997,"5min":0.86399999999999999,"15min":0.878},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.56200000000000006,"15min":0.55600000000000005},"min":{"1min":0.40899999999999997,"5min":0.35699999999999998,"15min":0.29699999999999999},"max":{"1min":0.877,"5min":0.877,"15min":1.165},"last":0.498}]},{"osd":6,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.59499999999999997,"15min":0.58099999999999996},"min":{"1min":0.501,"5min":0.372,"15min":0.36699999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":1.1359999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.58999999999999997,"15min":0.58699999999999997},"min":{"1min":0.45500000000000002,"5min":0.36799999999999999,"15min":0.34399999999999997},"max":{"1min":0.80600000000000005,"5min":0.82999999999999996,"15min":1.7470000000000001},"last":0.54500000000000004}]},{"osd":7,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.57499999999999996,"15min":0.57599999999999996},"min":{"1min":0.41599999999999998,"5min":0.38900000000000001,"15min":0.35599999999999998},"max":{"1min":0.79300000000000004,"5min":0.89900000000000002,"15min":1.657},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.58699999999999997,"15min":0.57599999999999996},"min":{"1min":0.46300000000000002,"5min":0.38,"15min":0.35499999999999998},"max":{"1min":0.86199999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.55100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575005,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307500,"kb_used_data":2020,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064340,"statfs":{"total":96636764160,"available":96321884160,"internally_reserved":0,"allocated":2068480,"data_stored":948923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.47899999999999998,"15min":0.50700000000000001},"min":{"1min":0.24199999999999999,"5min":0.216,"15min":0.19500000000000001},"max":{"1min":0.68700000000000006,"5min":0.82099999999999995,"15min":2.6619999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.499,"15min":0.49399999999999999},"min":{"1min":0.28899999999999998,"5min":0.224,"15min":0.215},"max":{"1min":0.76200000000000001,"5min":0.81499999999999995,"15min":0.91200000000000003},"last":0.42599999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.50700000000000001,"15min":0.53000000000000003},"min":{"1min":0.308,"5min":0.27300000000000002,"15min":0.23300000000000001},"max":{"1min":0.77300000000000002,"5min":1,"15min":2.8650000000000002},"last":0.499},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.505,"15min":0.53500000000000003},"min":{"1min":0.35299999999999998,"5min":0.27000000000000002,"15min":0.25800000000000001},"max":{"1min":0.79800000000000004,"5min":1.2869999999999999,"15min":2.7610000000000001},"last":0.66700000000000004}]},{"osd":2,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.52900000000000003,"15min":0.53000000000000003},"min":{"1min":0.44500000000000001,"5min":0.28499999999999998,"15min":0.23100000000000001},"max":{"1min":0.70399999999999996,"5min":0.77400000000000002,"15min":1.6910000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56699999999999995,"15min":0.57699999999999996},"min":{"1min":0.44800000000000001,"5min":0.33100000000000002,"15min":0.30599999999999999},"max":{"1min":0.82099999999999995,"5min":0.82799999999999996,"15min":1.718},"last":0.64300000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.57399999999999995,"15min":0.57799999999999996},"min":{"1min":0.38800000000000001,"5min":0.32000000000000001,"15min":0.26700000000000002},"max":{"1min":0.67500000000000004,"5min":2.387,"15min":2.677},"last":0.629},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.54600000000000004,"15min":0.52800000000000002},"min":{"1min":0.40100000000000002,"5min":0.29299999999999998,"15min":0.27500000000000002},"max":{"1min":0.77700000000000002,"5min":1.784,"15min":1.784},"last":0.57699999999999996}]},{"osd":5,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47799999999999998,"15min":0.47999999999999998},"min":{"1min":0.36499999999999999,"5min":0.28499999999999998,"15min":0.23200000000000001},"max":{"1min":0.60299999999999998,"5min":0.73199999999999998,"15min":0.80200000000000005},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.51700000000000002,"15min":0.52300000000000002},"min":{"1min":0.317,"5min":0.28899999999999998,"15min":0.28399999999999997},"max":{"1min":0.752,"5min":0.752,"15min":0.82799999999999996},"last":0.55600000000000005}]},{"osd":6,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.252},"max":{"1min":0.79500000000000004,"5min":0.83499999999999996,"15min":0.89000000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54500000000000004,"15min":0.55400000000000005},"min":{"1min":0.38700000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.72899999999999998,"5min":0.80200000000000005,"15min":1.165},"last":0.52500000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55300000000000005,"15min":0.55700000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.71199999999999997,"5min":0.84999999999999998,"15min":0.90500000000000003},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58499999999999996,"15min":0.58899999999999997},"min":{"1min":0.34399999999999997,"5min":0.318,"15min":0.317},"max":{"1min":0.81299999999999994,"5min":0.875,"15min":0.95499999999999996},"last":0.69399999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575007,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311556,"kb_used_data":1980,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060284,"statfs":{"total":96636764160,"available":96317730816,"internally_reserved":0,"allocated":2027520,"data_stored":933596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.48199999999999998,"15min":0.55900000000000005},"min":{"1min":0.32800000000000001,"5min":0.23300000000000001,"15min":0.20499999999999999},"max":{"1min":0.752,"5min":0.752,"15min":5.0490000000000004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.47799999999999998,"15min":0.54100000000000004},"min":{"1min":0.34699999999999998,"5min":0.253,"15min":0.22900000000000001},"max":{"1min":0.626,"5min":0.71299999999999997,"15min":5.1449999999999996},"last":0.59899999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.48099999999999998,"15min":0.48499999999999999},"min":{"1min":0.34699999999999998,"5min":0.25700000000000001,"15min":0.25},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.97199999999999998},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.502,"15min":0.51000000000000001},"min":{"1min":0.373,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.73599999999999999,"5min":0.74099999999999999,"15min":1.8799999999999999},"last":0.436}]},{"osd":2,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.52600000000000002,"15min":0.54700000000000004},"min":{"1min":0.42999999999999999,"5min":0.30099999999999999,"15min":0.28299999999999997},"max":{"1min":0.73399999999999999,"5min":0.76600000000000001,"15min":4.234},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.55800000000000005,"15min":0.56100000000000005},"min":{"1min":0.41699999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.78700000000000003,"5min":0.79200000000000004,"15min":1.0369999999999999},"last":0.46899999999999997}]},{"osd":3,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.497,"15min":0.57499999999999996},"min":{"1min":0.39700000000000002,"5min":0.29499999999999998,"15min":0.27700000000000002},"max":{"1min":0.67400000000000004,"5min":0.72799999999999998,"15min":5.2169999999999996},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.52600000000000002,"15min":0.53800000000000003},"min":{"1min":0.42599999999999999,"5min":0.29999999999999999,"15min":0.29699999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":1.008},"last":0.61299999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.47999999999999998,"15min":0.5},"min":{"1min":0.36399999999999999,"5min":0.25600000000000001,"15min":0.23999999999999999},"max":{"1min":0.61699999999999999,"5min":0.83399999999999996,"15min":1.917},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.495,"15min":0.51100000000000001},"min":{"1min":0.38200000000000001,"5min":0.251,"15min":0.23899999999999999},"max":{"1min":0.64900000000000002,"5min":0.69199999999999995,"15min":0.87},"last":0.64600000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51000000000000001,"15min":0.53700000000000003},"min":{"1min":0.41099999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63700000000000001,"5min":0.76800000000000002,"15min":2.0139999999999998},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57399999999999995,"15min":0.59099999999999997},"min":{"1min":0.46200000000000002,"5min":0.30299999999999999,"15min":0.29999999999999999},"max":{"1min":0.68600000000000005,"5min":0.80800000000000005,"15min":1.9470000000000001},"last":0.628}]},{"osd":7,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53300000000000003,"15min":0.55900000000000005},"min":{"1min":0.42099999999999999,"5min":0.28799999999999998,"15min":0.27700000000000002},"max":{"1min":0.628,"5min":0.81000000000000005,"15min":0.96499999999999997},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57199999999999995,"15min":0.59099999999999997},"min":{"1min":0.46800000000000003,"5min":0.29199999999999998,"15min":0.28799999999999998},"max":{"1min":0.69199999999999995,"5min":0.77300000000000002,"15min":1.4119999999999999},"last":0.65800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:18:29.946 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:18:30.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.087+0000 7f74a3808700 1 Processor -- start 2023-10-06T11:18:30.089 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.087+0000 7f74a3808700 1 -- start start 2023-10-06T11:18:30.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.088+0000 7f74a3808700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f749c15a940 0x7f749c153c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:30.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.088+0000 7f74a3808700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f749c15dcc0 0x7f749c0ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:30.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.088+0000 7f74a3808700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f749c15d270 con 0x7f749c1538c0 2023-10-06T11:18:30.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.088+0000 7f74a3808700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f749c15d830 con 0x7f749c15dcc0 2023-10-06T11:18:30.091 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.088+0000 7f74a3808700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f749c15e110 con 0x7f749c15a940 2023-10-06T11:18:30.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.088+0000 7f74a1da5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f749c15dcc0 0x7f749c0ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:30.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.088+0000 7f74a1da5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f749c15dcc0 0x7f749c0ce610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57000/0 (socket says 172.21.15.146:57000) 2023-10-06T11:18:30.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.088+0000 7f74a1da5700 1 -- 172.21.15.146:0/2360177713 learned_addr learned my addr 172.21.15.146:0/2360177713 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:30.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.088+0000 7f74a0da3700 1 --2- 172.21.15.146:0/2360177713 >> v2:172.21.15.151:3300/0 conn(0x7f749c15a940 0x7f749c153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:30.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.089+0000 7f74a1da5700 1 -- 172.21.15.146:0/2360177713 >> v2:172.21.15.151:3300/0 conn(0x7f749c15a940 msgr2=0x7f749c153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:30.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.089+0000 7f74a1da5700 1 --2- 172.21.15.146:0/2360177713 >> v2:172.21.15.151:3300/0 conn(0x7f749c15a940 0x7f749c153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:30.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.089+0000 7f74a1da5700 1 -- 172.21.15.146:0/2360177713 >> v1:172.21.15.151:6789/0 conn(0x7f749c1538c0 legacy=0x7f749c0cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:30.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.089+0000 7f74a1da5700 1 -- 172.21.15.146:0/2360177713 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f749c0cb810 con 0x7f749c15dcc0 2023-10-06T11:18:30.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.089+0000 7f74a1da5700 1 --2- 172.21.15.146:0/2360177713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f749c15dcc0 0x7f749c0ce610 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 crypto rx=0x7f749c0ce180 tx=0x7f7494009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d2dd6a86419ac62 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:30.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.089+0000 7f7493fff700 1 -- 172.21.15.146:0/2360177713 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749400b820 con 0x7f749c15dcc0 2023-10-06T11:18:30.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.089+0000 7f7493fff700 1 -- 172.21.15.146:0/2360177713 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f749400b980 con 0x7f749c15dcc0 2023-10-06T11:18:30.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.089+0000 7f7493fff700 1 -- 172.21.15.146:0/2360177713 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749400bd20 con 0x7f749c15dcc0 2023-10-06T11:18:30.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.089+0000 7f74a3808700 1 -- 172.21.15.146:0/2360177713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f749c15dcc0 msgr2=0x7f749c0ce610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:30.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.089+0000 7f74a3808700 1 --2- 172.21.15.146:0/2360177713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f749c15dcc0 0x7f749c0ce610 secure :-1 s=READY pgs=2109 cs=0 l=1 rev1=1 crypto rx=0x7f749c0ce180 tx=0x7f7494009250 comp rx=0 tx=0).stop 2023-10-06T11:18:30.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.089+0000 7f74a3808700 1 -- 172.21.15.146:0/2360177713 shutdown_connections 2023-10-06T11:18:30.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.089+0000 7f74a3808700 1 --2- 172.21.15.146:0/2360177713 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f749c15dcc0 0x7f749c0ce610 unknown :-1 s=CLOSED pgs=2109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:30.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.089+0000 7f74a3808700 1 --2- 172.21.15.146:0/2360177713 >> v2:172.21.15.151:3300/0 conn(0x7f749c15a940 0x7f749c153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:30.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.089+0000 7f74a3808700 1 -- 172.21.15.146:0/2360177713 >> 172.21.15.146:0/2360177713 conn(0x7f749c06eb10 msgr2=0x7f749c06ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:30.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.090+0000 7f74a3808700 1 -- 172.21.15.146:0/2360177713 shutdown_connections 2023-10-06T11:18:30.093 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.090+0000 7f74a3808700 1 -- 172.21.15.146:0/2360177713 wait complete. 2023-10-06T11:18:30.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.091+0000 7f74a3808700 1 Processor -- start 2023-10-06T11:18:30.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.091+0000 7f74a3808700 1 -- start start 2023-10-06T11:18:30.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.091+0000 7f74a3808700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f749c1538c0 0x7f749c0c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:30.096 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.091+0000 7f74a3808700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f749c15a940 0x7f749c0c7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:30.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.091+0000 7f74a3808700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f749c15dcc0 0x7f749c16d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:30.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.091+0000 7f74a3808700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749c16d300 con 0x7f749c15a940 2023-10-06T11:18:30.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.091+0000 7f74a3808700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f749c147680 con 0x7f749c15dcc0 2023-10-06T11:18:30.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.091+0000 7f74a3808700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f749c0c9c00 con 0x7f749c1538c0 2023-10-06T11:18:30.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.092+0000 7f74a0da3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f749c15a940 0x7f749c0c7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:30.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.092+0000 7f74a0da3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f749c15a940 0x7f749c0c7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57006/0 (socket says 172.21.15.146:57006) 2023-10-06T11:18:30.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.092+0000 7f74a0da3700 1 -- 172.21.15.146:0/4203147596 learned_addr learned my addr 172.21.15.146:0/4203147596 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:30.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.092+0000 7f74a1da5700 1 --2- 172.21.15.146:0/4203147596 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f749c15dcc0 0x7f749c16d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:30.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.092+0000 7f74a15a4700 1 --2- 172.21.15.146:0/4203147596 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f749c1538c0 0x7f749c0c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:30.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.092+0000 7f74a0da3700 1 -- 172.21.15.146:0/4203147596 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f749c1538c0 msgr2=0x7f749c0c96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:30.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.092+0000 7f74a0da3700 1 --2- 172.21.15.146:0/4203147596 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f749c1538c0 0x7f749c0c96c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:30.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.092+0000 7f74a0da3700 1 -- 172.21.15.146:0/4203147596 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f749c15dcc0 msgr2=0x7f749c16d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:30.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.092+0000 7f74a0da3700 1 --2- 172.21.15.146:0/4203147596 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f749c15dcc0 0x7f749c16d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:30.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.092+0000 7f74a0da3700 1 -- 172.21.15.146:0/4203147596 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74940094f0 con 0x7f749c15a940 2023-10-06T11:18:30.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.092+0000 7f74a1da5700 1 --2- 172.21.15.146:0/4203147596 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f749c15dcc0 0x7f749c16d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:18:30.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.092+0000 7f74a15a4700 1 --2- 172.21.15.146:0/4203147596 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f749c1538c0 0x7f749c0c96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:18:30.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.092+0000 7f74a0da3700 1 --2- 172.21.15.146:0/4203147596 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f749c15a940 0x7f749c0c7ca0 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 crypto rx=0x7f748c00d890 tx=0x7f748c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:30.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.092+0000 7f74917fa700 1 -- 172.21.15.146:0/4203147596 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c00b600 con 0x7f749c15a940 2023-10-06T11:18:30.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.092+0000 7f74917fa700 1 -- 172.21.15.146:0/4203147596 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f748c00b760 con 0x7f749c15a940 2023-10-06T11:18:30.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.092+0000 7f74a3808700 1 -- 172.21.15.146:0/4203147596 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f749c0c9ea0 con 0x7f749c15a940 2023-10-06T11:18:30.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.092+0000 7f74917fa700 1 -- 172.21.15.146:0/4203147596 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748c00bae0 con 0x7f749c15a940 2023-10-06T11:18:30.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.092+0000 7f74a3808700 1 -- 172.21.15.146:0/4203147596 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f749c0ca460 con 0x7f749c15a940 2023-10-06T11:18:30.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.093+0000 7f74a3808700 1 -- 172.21.15.146:0/4203147596 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f749c04c380 con 0x7f749c15a940 2023-10-06T11:18:30.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.093+0000 7f74917fa700 1 -- 172.21.15.146:0/4203147596 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f748c01e460 con 0x7f749c15a940 2023-10-06T11:18:30.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.094+0000 7f74917fa700 1 --2- 172.21.15.146:0/4203147596 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7480066f30 0x7f74800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:30.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.094+0000 7f74917fa700 1 -- 172.21.15.146:0/4203147596 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f748c084d40 con 0x7f749c15a940 2023-10-06T11:18:30.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.094+0000 7f74a15a4700 1 --2- 172.21.15.146:0/4203147596 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7480066f30 0x7f74800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:30.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.094+0000 7f74a15a4700 1 --2- 172.21.15.146:0/4203147596 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7480066f30 0x7f74800693e0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f7498001370 tx=0x7f7498009680 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:30.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.098+0000 7f74917fa700 1 -- 172.21.15.146:0/4203147596 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f748c051e50 con 0x7f749c15a940 2023-10-06T11:18:30.171 INFO:tasks.ceph.mds.a.smithi146.stderr:2023-10-06T11:18:30.169+0000 7fc9f5375700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T11:18:30.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.277+0000 7f74a3808700 1 -- 172.21.15.146:0/4203147596 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f749c0ce3f0 con 0x7f7480066f30 2023-10-06T11:18:30.287 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.286+0000 7f74917fa700 1 -- 172.21.15.146:0/4203147596 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311858 (secure 0 0 0) 0x7f749c0ce3f0 con 0x7f7480066f30 2023-10-06T11:18:30.291 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:18:30.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.289+0000 7f74a3808700 1 -- 172.21.15.146:0/4203147596 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7480066f30 msgr2=0x7f74800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:30.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.289+0000 7f74a3808700 1 --2- 172.21.15.146:0/4203147596 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7480066f30 0x7f74800693e0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f7498001370 tx=0x7f7498009680 comp rx=0 tx=0).stop 2023-10-06T11:18:30.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.289+0000 7f74a3808700 1 -- 172.21.15.146:0/4203147596 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f749c15a940 msgr2=0x7f749c0c7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:30.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.289+0000 7f74a3808700 1 --2- 172.21.15.146:0/4203147596 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f749c15a940 0x7f749c0c7ca0 secure :-1 s=READY pgs=2110 cs=0 l=1 rev1=1 crypto rx=0x7f748c00d890 tx=0x7f748c008040 comp rx=0 tx=0).stop 2023-10-06T11:18:30.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.289+0000 7f74a3808700 1 -- 172.21.15.146:0/4203147596 shutdown_connections 2023-10-06T11:18:30.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.289+0000 7f74a3808700 1 --2- 172.21.15.146:0/4203147596 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7480066f30 0x7f74800693e0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:30.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.289+0000 7f74a3808700 1 --2- 172.21.15.146:0/4203147596 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f749c15dcc0 0x7f749c16d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:30.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.289+0000 7f74a3808700 1 --2- 172.21.15.146:0/4203147596 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f749c1538c0 0x7f749c0c96c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:30.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.289+0000 7f74a3808700 1 --2- 172.21.15.146:0/4203147596 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f749c15a940 0x7f749c0c7ca0 unknown :-1 s=CLOSED pgs=2110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:30.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.289+0000 7f74a3808700 1 -- 172.21.15.146:0/4203147596 >> 172.21.15.146:0/4203147596 conn(0x7f749c06eb10 msgr2=0x7f749c0c53e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:30.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.289+0000 7f74a3808700 1 -- 172.21.15.146:0/4203147596 shutdown_connections 2023-10-06T11:18:30.294 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.289+0000 7f74a3808700 1 -- 172.21.15.146:0/4203147596 wait complete. 2023-10-06T11:18:30.294 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:18:30.303 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":542,"stamp":"2023-10-06T11:18:29.306989+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":109,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2448680,"kb_used_data":17128,"kb_used_omap":0,"kb_used_meta":2431488,"kb_avail":752526040,"statfs":{"total":773094113280,"available":770586664960,"internally_reserved":0,"allocated":17539072,"data_stored":8709051,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2489843712},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.441548"},"pg_stats":[{"pgid":"26.3f","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.454403+0000","last_change":"2023-10-06T11:18:25.452543+0000","last_active":"2023-10-06T11:18:25.454403+0000","last_peered":"2023-10-06T11:18:25.454403+0000","last_clean":"2023-10-06T11:18:25.454403+0000","last_became_active":"2023-10-06T11:18:25.452217+0000","last_became_peered":"2023-10-06T11:18:25.452217+0000","last_unstale":"2023-10-06T11:18:25.454403+0000","last_undegraded":"2023-10-06T11:18:25.454403+0000","last_fullsized":"2023-10-06T11:18:25.454403+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:30:48.110179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3e","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.452269+0000","last_change":"2023-10-06T11:18:25.448714+0000","last_active":"2023-10-06T11:18:25.452269+0000","last_peered":"2023-10-06T11:18:25.452269+0000","last_clean":"2023-10-06T11:18:25.452269+0000","last_became_active":"2023-10-06T11:18:25.448457+0000","last_became_peered":"2023-10-06T11:18:25.448457+0000","last_unstale":"2023-10-06T11:18:25.452269+0000","last_undegraded":"2023-10-06T11:18:25.452269+0000","last_fullsized":"2023-10-06T11:18:25.452269+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:19:27.356843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.3d","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.450914+0000","last_change":"2023-10-06T11:18:25.448473+0000","last_active":"2023-10-06T11:18:25.450914+0000","last_peered":"2023-10-06T11:18:25.450914+0000","last_clean":"2023-10-06T11:18:25.450914+0000","last_became_active":"2023-10-06T11:18:25.447650+0000","last_became_peered":"2023-10-06T11:18:25.447650+0000","last_unstale":"2023-10-06T11:18:25.450914+0000","last_undegraded":"2023-10-06T11:18:25.450914+0000","last_fullsized":"2023-10-06T11:18:25.450914+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:24:08.855788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.3c","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.444060+0000","last_change":"2023-10-06T11:18:25.444060+0000","last_active":"2023-10-06T11:18:25.444060+0000","last_peered":"2023-10-06T11:18:25.444060+0000","last_clean":"2023-10-06T11:18:25.444060+0000","last_became_active":"2023-10-06T11:18:25.443788+0000","last_became_peered":"2023-10-06T11:18:25.443788+0000","last_unstale":"2023-10-06T11:18:25.444060+0000","last_undegraded":"2023-10-06T11:18:25.444060+0000","last_fullsized":"2023-10-06T11:18:25.444060+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:51:39.902370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3b","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.444792+0000","last_change":"2023-10-06T11:18:25.444792+0000","last_active":"2023-10-06T11:18:25.444792+0000","last_peered":"2023-10-06T11:18:25.444792+0000","last_clean":"2023-10-06T11:18:25.444792+0000","last_became_active":"2023-10-06T11:18:25.444515+0000","last_became_peered":"2023-10-06T11:18:25.444515+0000","last_unstale":"2023-10-06T11:18:25.444792+0000","last_undegraded":"2023-10-06T11:18:25.444792+0000","last_fullsized":"2023-10-06T11:18:25.444792+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:40:27.559023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.3a","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.449825+0000","last_change":"2023-10-06T11:18:25.449825+0000","last_active":"2023-10-06T11:18:25.449825+0000","last_peered":"2023-10-06T11:18:25.449825+0000","last_clean":"2023-10-06T11:18:25.449825+0000","last_became_active":"2023-10-06T11:18:25.449585+0000","last_became_peered":"2023-10-06T11:18:25.449585+0000","last_unstale":"2023-10-06T11:18:25.449825+0000","last_undegraded":"2023-10-06T11:18:25.449825+0000","last_fullsized":"2023-10-06T11:18:25.449825+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:16:43.722738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.39","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.450734+0000","last_change":"2023-10-06T11:18:25.450734+0000","last_active":"2023-10-06T11:18:25.450734+0000","last_peered":"2023-10-06T11:18:25.450734+0000","last_clean":"2023-10-06T11:18:25.450734+0000","last_became_active":"2023-10-06T11:18:25.450474+0000","last_became_peered":"2023-10-06T11:18:25.450474+0000","last_unstale":"2023-10-06T11:18:25.450734+0000","last_undegraded":"2023-10-06T11:18:25.450734+0000","last_fullsized":"2023-10-06T11:18:25.450734+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:26:27.027249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.38","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.452099+0000","last_change":"2023-10-06T11:18:25.452099+0000","last_active":"2023-10-06T11:18:25.452099+0000","last_peered":"2023-10-06T11:18:25.452099+0000","last_clean":"2023-10-06T11:18:25.452099+0000","last_became_active":"2023-10-06T11:18:25.451826+0000","last_became_peered":"2023-10-06T11:18:25.451826+0000","last_unstale":"2023-10-06T11:18:25.452099+0000","last_undegraded":"2023-10-06T11:18:25.452099+0000","last_fullsized":"2023-10-06T11:18:25.452099+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:53:44.215297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.37","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.452461+0000","last_change":"2023-10-06T11:18:25.449272+0000","last_active":"2023-10-06T11:18:25.452461+0000","last_peered":"2023-10-06T11:18:25.452461+0000","last_clean":"2023-10-06T11:18:25.452461+0000","last_became_active":"2023-10-06T11:18:25.449002+0000","last_became_peered":"2023-10-06T11:18:25.449002+0000","last_unstale":"2023-10-06T11:18:25.452461+0000","last_undegraded":"2023-10-06T11:18:25.452461+0000","last_fullsized":"2023-10-06T11:18:25.452461+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:02.747570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.36","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.443860+0000","last_change":"2023-10-06T11:18:25.443860+0000","last_active":"2023-10-06T11:18:25.443860+0000","last_peered":"2023-10-06T11:18:25.443860+0000","last_clean":"2023-10-06T11:18:25.443860+0000","last_became_active":"2023-10-06T11:18:25.443596+0000","last_became_peered":"2023-10-06T11:18:25.443596+0000","last_unstale":"2023-10-06T11:18:25.443860+0000","last_undegraded":"2023-10-06T11:18:25.443860+0000","last_fullsized":"2023-10-06T11:18:25.443860+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:34:11.549704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.35","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.449480+0000","last_change":"2023-10-06T11:18:25.449480+0000","last_active":"2023-10-06T11:18:25.449480+0000","last_peered":"2023-10-06T11:18:25.449480+0000","last_clean":"2023-10-06T11:18:25.449480+0000","last_became_active":"2023-10-06T11:18:25.449206+0000","last_became_peered":"2023-10-06T11:18:25.449206+0000","last_unstale":"2023-10-06T11:18:25.449480+0000","last_undegraded":"2023-10-06T11:18:25.449480+0000","last_fullsized":"2023-10-06T11:18:25.449480+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:52.828500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.34","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.445152+0000","last_change":"2023-10-06T11:18:25.445152+0000","last_active":"2023-10-06T11:18:25.445152+0000","last_peered":"2023-10-06T11:18:25.445152+0000","last_clean":"2023-10-06T11:18:25.445152+0000","last_became_active":"2023-10-06T11:18:25.444830+0000","last_became_peered":"2023-10-06T11:18:25.444830+0000","last_unstale":"2023-10-06T11:18:25.445152+0000","last_undegraded":"2023-10-06T11:18:25.445152+0000","last_fullsized":"2023-10-06T11:18:25.445152+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:08:39.929677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.33","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.452877+0000","last_change":"2023-10-06T11:18:25.448543+0000","last_active":"2023-10-06T11:18:25.452877+0000","last_peered":"2023-10-06T11:18:25.452877+0000","last_clean":"2023-10-06T11:18:25.452877+0000","last_became_active":"2023-10-06T11:18:25.448303+0000","last_became_peered":"2023-10-06T11:18:25.448303+0000","last_unstale":"2023-10-06T11:18:25.452877+0000","last_undegraded":"2023-10-06T11:18:25.452877+0000","last_fullsized":"2023-10-06T11:18:25.452877+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:30:11.645547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.32","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.444730+0000","last_change":"2023-10-06T11:18:25.444730+0000","last_active":"2023-10-06T11:18:25.444730+0000","last_peered":"2023-10-06T11:18:25.444730+0000","last_clean":"2023-10-06T11:18:25.444730+0000","last_became_active":"2023-10-06T11:18:25.444477+0000","last_became_peered":"2023-10-06T11:18:25.444477+0000","last_unstale":"2023-10-06T11:18:25.444730+0000","last_undegraded":"2023-10-06T11:18:25.444730+0000","last_fullsized":"2023-10-06T11:18:25.444730+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:11:28.064418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.31","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.451803+0000","last_change":"2023-10-06T11:18:25.449445+0000","last_active":"2023-10-06T11:18:25.451803+0000","last_peered":"2023-10-06T11:18:25.451803+0000","last_clean":"2023-10-06T11:18:25.451803+0000","last_became_active":"2023-10-06T11:18:25.449192+0000","last_became_peered":"2023-10-06T11:18:25.449192+0000","last_unstale":"2023-10-06T11:18:25.451803+0000","last_undegraded":"2023-10-06T11:18:25.451803+0000","last_fullsized":"2023-10-06T11:18:25.451803+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:02:57.348824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.30","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.449114+0000","last_change":"2023-10-06T11:18:25.449114+0000","last_active":"2023-10-06T11:18:25.449114+0000","last_peered":"2023-10-06T11:18:25.449114+0000","last_clean":"2023-10-06T11:18:25.449114+0000","last_became_active":"2023-10-06T11:18:25.447716+0000","last_became_peered":"2023-10-06T11:18:25.447716+0000","last_unstale":"2023-10-06T11:18:25.449114+0000","last_undegraded":"2023-10-06T11:18:25.449114+0000","last_fullsized":"2023-10-06T11:18:25.449114+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:51:39.902370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2f","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.452258+0000","last_change":"2023-10-06T11:18:25.452258+0000","last_active":"2023-10-06T11:18:25.452258+0000","last_peered":"2023-10-06T11:18:25.452258+0000","last_clean":"2023-10-06T11:18:25.452258+0000","last_became_active":"2023-10-06T11:18:25.452012+0000","last_became_peered":"2023-10-06T11:18:25.452012+0000","last_unstale":"2023-10-06T11:18:25.452258+0000","last_undegraded":"2023-10-06T11:18:25.452258+0000","last_fullsized":"2023-10-06T11:18:25.452258+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:49:39.061894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2e","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.454986+0000","last_change":"2023-10-06T11:18:25.452135+0000","last_active":"2023-10-06T11:18:25.454986+0000","last_peered":"2023-10-06T11:18:25.454986+0000","last_clean":"2023-10-06T11:18:25.454986+0000","last_became_active":"2023-10-06T11:18:25.451801+0000","last_became_peered":"2023-10-06T11:18:25.451801+0000","last_unstale":"2023-10-06T11:18:25.454986+0000","last_undegraded":"2023-10-06T11:18:25.454986+0000","last_fullsized":"2023-10-06T11:18:25.454986+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:45:30.016969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2d","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.451782+0000","last_change":"2023-10-06T11:18:25.445659+0000","last_active":"2023-10-06T11:18:25.451782+0000","last_peered":"2023-10-06T11:18:25.451782+0000","last_clean":"2023-10-06T11:18:25.451782+0000","last_became_active":"2023-10-06T11:18:25.445376+0000","last_became_peered":"2023-10-06T11:18:25.445376+0000","last_unstale":"2023-10-06T11:18:25.451782+0000","last_undegraded":"2023-10-06T11:18:25.451782+0000","last_fullsized":"2023-10-06T11:18:25.451782+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:43:21.947851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.2c","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.452227+0000","last_change":"2023-10-06T11:18:25.452227+0000","last_active":"2023-10-06T11:18:25.452227+0000","last_peered":"2023-10-06T11:18:25.452227+0000","last_clean":"2023-10-06T11:18:25.452227+0000","last_became_active":"2023-10-06T11:18:25.451972+0000","last_became_peered":"2023-10-06T11:18:25.451972+0000","last_unstale":"2023-10-06T11:18:25.452227+0000","last_undegraded":"2023-10-06T11:18:25.452227+0000","last_fullsized":"2023-10-06T11:18:25.452227+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:41:44.516509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.2b","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.451797+0000","last_change":"2023-10-06T11:18:25.449234+0000","last_active":"2023-10-06T11:18:25.451797+0000","last_peered":"2023-10-06T11:18:25.451797+0000","last_clean":"2023-10-06T11:18:25.451797+0000","last_became_active":"2023-10-06T11:18:25.448683+0000","last_became_peered":"2023-10-06T11:18:25.448683+0000","last_unstale":"2023-10-06T11:18:25.451797+0000","last_undegraded":"2023-10-06T11:18:25.451797+0000","last_fullsized":"2023-10-06T11:18:25.451797+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:53:44.215297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.2a","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.451774+0000","last_change":"2023-10-06T11:18:25.448985+0000","last_active":"2023-10-06T11:18:25.451774+0000","last_peered":"2023-10-06T11:18:25.451774+0000","last_clean":"2023-10-06T11:18:25.451774+0000","last_became_active":"2023-10-06T11:18:25.448737+0000","last_became_peered":"2023-10-06T11:18:25.448737+0000","last_unstale":"2023-10-06T11:18:25.451774+0000","last_undegraded":"2023-10-06T11:18:25.451774+0000","last_fullsized":"2023-10-06T11:18:25.451774+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:39:14.365034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.29","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.452888+0000","last_change":"2023-10-06T11:18:25.452888+0000","last_active":"2023-10-06T11:18:25.452888+0000","last_peered":"2023-10-06T11:18:25.452888+0000","last_clean":"2023-10-06T11:18:25.452888+0000","last_became_active":"2023-10-06T11:18:25.452615+0000","last_became_peered":"2023-10-06T11:18:25.452615+0000","last_unstale":"2023-10-06T11:18:25.452888+0000","last_undegraded":"2023-10-06T11:18:25.452888+0000","last_fullsized":"2023-10-06T11:18:25.452888+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:39:14.365034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.28","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.452824+0000","last_change":"2023-10-06T11:18:25.452384+0000","last_active":"2023-10-06T11:18:25.452824+0000","last_peered":"2023-10-06T11:18:25.452824+0000","last_clean":"2023-10-06T11:18:25.452824+0000","last_became_active":"2023-10-06T11:18:25.452126+0000","last_became_peered":"2023-10-06T11:18:25.452126+0000","last_unstale":"2023-10-06T11:18:25.452824+0000","last_undegraded":"2023-10-06T11:18:25.452824+0000","last_fullsized":"2023-10-06T11:18:25.452824+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:53:51.275843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.27","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.448302+0000","last_change":"2023-10-06T11:18:25.448302+0000","last_active":"2023-10-06T11:18:25.448302+0000","last_peered":"2023-10-06T11:18:25.448302+0000","last_clean":"2023-10-06T11:18:25.448302+0000","last_became_active":"2023-10-06T11:18:25.447969+0000","last_became_peered":"2023-10-06T11:18:25.447969+0000","last_unstale":"2023-10-06T11:18:25.448302+0000","last_undegraded":"2023-10-06T11:18:25.448302+0000","last_fullsized":"2023-10-06T11:18:25.448302+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:16:20.117101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.26","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.443087+0000","last_change":"2023-10-06T11:18:25.443087+0000","last_active":"2023-10-06T11:18:25.443087+0000","last_peered":"2023-10-06T11:18:25.443087+0000","last_clean":"2023-10-06T11:18:25.443087+0000","last_became_active":"2023-10-06T11:18:25.442839+0000","last_became_peered":"2023-10-06T11:18:25.442839+0000","last_unstale":"2023-10-06T11:18:25.443087+0000","last_undegraded":"2023-10-06T11:18:25.443087+0000","last_fullsized":"2023-10-06T11:18:25.443087+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:01:14.172955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.25","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.452935+0000","last_change":"2023-10-06T11:18:25.452935+0000","last_active":"2023-10-06T11:18:25.452935+0000","last_peered":"2023-10-06T11:18:25.452935+0000","last_clean":"2023-10-06T11:18:25.452935+0000","last_became_active":"2023-10-06T11:18:25.452670+0000","last_became_peered":"2023-10-06T11:18:25.452670+0000","last_unstale":"2023-10-06T11:18:25.452935+0000","last_undegraded":"2023-10-06T11:18:25.452935+0000","last_fullsized":"2023-10-06T11:18:25.452935+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:49:35.453520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.24","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.444765+0000","last_change":"2023-10-06T11:18:25.444765+0000","last_active":"2023-10-06T11:18:25.444765+0000","last_peered":"2023-10-06T11:18:25.444765+0000","last_clean":"2023-10-06T11:18:25.444765+0000","last_became_active":"2023-10-06T11:18:25.444463+0000","last_became_peered":"2023-10-06T11:18:25.444463+0000","last_unstale":"2023-10-06T11:18:25.444765+0000","last_undegraded":"2023-10-06T11:18:25.444765+0000","last_fullsized":"2023-10-06T11:18:25.444765+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:08:49.672466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.23","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.444880+0000","last_change":"2023-10-06T11:18:25.444880+0000","last_active":"2023-10-06T11:18:25.444880+0000","last_peered":"2023-10-06T11:18:25.444880+0000","last_clean":"2023-10-06T11:18:25.444880+0000","last_became_active":"2023-10-06T11:18:25.444584+0000","last_became_peered":"2023-10-06T11:18:25.444584+0000","last_unstale":"2023-10-06T11:18:25.444880+0000","last_undegraded":"2023-10-06T11:18:25.444880+0000","last_fullsized":"2023-10-06T11:18:25.444880+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:20:26.026270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.22","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.444673+0000","last_change":"2023-10-06T11:18:25.444673+0000","last_active":"2023-10-06T11:18:25.444673+0000","last_peered":"2023-10-06T11:18:25.444673+0000","last_clean":"2023-10-06T11:18:25.444673+0000","last_became_active":"2023-10-06T11:18:25.444440+0000","last_became_peered":"2023-10-06T11:18:25.444440+0000","last_unstale":"2023-10-06T11:18:25.444673+0000","last_undegraded":"2023-10-06T11:18:25.444673+0000","last_fullsized":"2023-10-06T11:18:25.444673+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:14:20.677130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.21","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.445782+0000","last_change":"2023-10-06T11:18:25.445782+0000","last_active":"2023-10-06T11:18:25.445782+0000","last_peered":"2023-10-06T11:18:25.445782+0000","last_clean":"2023-10-06T11:18:25.445782+0000","last_became_active":"2023-10-06T11:18:25.445534+0000","last_became_peered":"2023-10-06T11:18:25.445534+0000","last_unstale":"2023-10-06T11:18:25.445782+0000","last_undegraded":"2023-10-06T11:18:25.445782+0000","last_fullsized":"2023-10-06T11:18:25.445782+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:00:13.601884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.20","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.449115+0000","last_change":"2023-10-06T11:18:25.449115+0000","last_active":"2023-10-06T11:18:25.449115+0000","last_peered":"2023-10-06T11:18:25.449115+0000","last_clean":"2023-10-06T11:18:25.449115+0000","last_became_active":"2023-10-06T11:18:25.447102+0000","last_became_peered":"2023-10-06T11:18:25.447102+0000","last_unstale":"2023-10-06T11:18:25.449115+0000","last_undegraded":"2023-10-06T11:18:25.449115+0000","last_fullsized":"2023-10-06T11:18:25.449115+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:58:44.300561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.14","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.453797+0000","last_change":"2023-10-06T11:18:25.453797+0000","last_active":"2023-10-06T11:18:25.453797+0000","last_peered":"2023-10-06T11:18:25.453797+0000","last_clean":"2023-10-06T11:18:25.453797+0000","last_became_active":"2023-10-06T11:18:25.453530+0000","last_became_peered":"2023-10-06T11:18:25.453530+0000","last_unstale":"2023-10-06T11:18:25.453797+0000","last_undegraded":"2023-10-06T11:18:25.453797+0000","last_fullsized":"2023-10-06T11:18:25.453797+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:02:57.348824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-06T11:18:24.892142+0000","last_change":"2023-10-06T11:18:24.885061+0000","last_active":"2023-10-06T11:18:24.892142+0000","last_peered":"2023-10-06T11:18:24.892142+0000","last_clean":"2023-10-06T11:18:24.892142+0000","last_became_active":"2023-10-06T11:18:24.884763+0000","last_became_peered":"2023-10-06T11:18:24.884763+0000","last_unstale":"2023-10-06T11:18:24.892142+0000","last_undegraded":"2023-10-06T11:18:24.892142+0000","last_fullsized":"2023-10-06T11:18:24.892142+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:19:26.351990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.15","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.444174+0000","last_change":"2023-10-06T11:18:25.444174+0000","last_active":"2023-10-06T11:18:25.444174+0000","last_peered":"2023-10-06T11:18:25.444174+0000","last_clean":"2023-10-06T11:18:25.444174+0000","last_became_active":"2023-10-06T11:18:25.443761+0000","last_became_peered":"2023-10-06T11:18:25.443761+0000","last_unstale":"2023-10-06T11:18:25.444174+0000","last_undegraded":"2023-10-06T11:18:25.444174+0000","last_fullsized":"2023-10-06T11:18:25.444174+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:59.283961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.439236+0000","last_change":"2023-10-06T11:18:24.886350+0000","last_active":"2023-10-06T11:18:25.439236+0000","last_peered":"2023-10-06T11:18:25.439236+0000","last_clean":"2023-10-06T11:18:25.439236+0000","last_became_active":"2023-10-06T11:18:24.886107+0000","last_became_peered":"2023-10-06T11:18:24.886107+0000","last_unstale":"2023-10-06T11:18:25.439236+0000","last_undegraded":"2023-10-06T11:18:25.439236+0000","last_fullsized":"2023-10-06T11:18:25.439236+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:13:55.717930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.452220+0000","last_change":"2023-10-06T11:18:25.446653+0000","last_active":"2023-10-06T11:18:25.452220+0000","last_peered":"2023-10-06T11:18:25.452220+0000","last_clean":"2023-10-06T11:18:25.452220+0000","last_became_active":"2023-10-06T11:18:25.446379+0000","last_became_peered":"2023-10-06T11:18:25.446379+0000","last_unstale":"2023-10-06T11:18:25.452220+0000","last_undegraded":"2023-10-06T11:18:25.452220+0000","last_fullsized":"2023-10-06T11:18:25.452220+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:02:57.348824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.15","version":"162'3","reported_seq":12,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.881181+0000","last_change":"2023-10-06T11:18:24.892693+0000","last_active":"2023-10-06T11:18:25.881181+0000","last_peered":"2023-10-06T11:18:25.881181+0000","last_clean":"2023-10-06T11:18:25.881181+0000","last_became_active":"2023-10-06T11:18:24.892434+0000","last_became_peered":"2023-10-06T11:18:24.892434+0000","last_unstale":"2023-10-06T11:18:25.881181+0000","last_undegraded":"2023-10-06T11:18:25.881181+0000","last_fullsized":"2023-10-06T11:18:25.881181+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:11:08.920084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.452435+0000","last_change":"2023-10-06T11:18:25.449185+0000","last_active":"2023-10-06T11:18:25.452435+0000","last_peered":"2023-10-06T11:18:25.452435+0000","last_clean":"2023-10-06T11:18:25.452435+0000","last_became_active":"2023-10-06T11:18:25.448577+0000","last_became_peered":"2023-10-06T11:18:25.448577+0000","last_unstale":"2023-10-06T11:18:25.452435+0000","last_undegraded":"2023-10-06T11:18:25.452435+0000","last_fullsized":"2023-10-06T11:18:25.452435+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:43:28.681381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.14","version":"162'6","reported_seq":16,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.889198+0000","last_change":"2023-10-06T11:18:24.883110+0000","last_active":"2023-10-06T11:18:25.889198+0000","last_peered":"2023-10-06T11:18:25.889198+0000","last_clean":"2023-10-06T11:18:25.889198+0000","last_became_active":"2023-10-06T11:18:24.882846+0000","last_became_peered":"2023-10-06T11:18:24.882846+0000","last_unstale":"2023-10-06T11:18:25.889198+0000","last_undegraded":"2023-10-06T11:18:25.889198+0000","last_fullsized":"2023-10-06T11:18:25.889198+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:58:45.228119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.10","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.451047+0000","last_change":"2023-10-06T11:18:25.451047+0000","last_active":"2023-10-06T11:18:25.451047+0000","last_peered":"2023-10-06T11:18:25.451047+0000","last_clean":"2023-10-06T11:18:25.451047+0000","last_became_active":"2023-10-06T11:18:25.450811+0000","last_became_peered":"2023-10-06T11:18:25.450811+0000","last_unstale":"2023-10-06T11:18:25.451047+0000","last_undegraded":"2023-10-06T11:18:25.451047+0000","last_fullsized":"2023-10-06T11:18:25.451047+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:21:49.544019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.13","version":"162'2","reported_seq":12,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.885292+0000","last_change":"2023-10-06T11:18:24.878767+0000","last_active":"2023-10-06T11:18:25.885292+0000","last_peered":"2023-10-06T11:18:25.885292+0000","last_clean":"2023-10-06T11:18:25.885292+0000","last_became_active":"2023-10-06T11:18:24.878481+0000","last_became_peered":"2023-10-06T11:18:24.878481+0000","last_unstale":"2023-10-06T11:18:25.885292+0000","last_undegraded":"2023-10-06T11:18:25.885292+0000","last_fullsized":"2023-10-06T11:18:25.885292+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:13:55.717930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.447519+0000","last_change":"2023-10-06T11:18:25.447519+0000","last_active":"2023-10-06T11:18:25.447519+0000","last_peered":"2023-10-06T11:18:25.447519+0000","last_clean":"2023-10-06T11:18:25.447519+0000","last_became_active":"2023-10-06T11:18:25.447261+0000","last_became_peered":"2023-10-06T11:18:25.447261+0000","last_unstale":"2023-10-06T11:18:25.447519+0000","last_undegraded":"2023-10-06T11:18:25.447519+0000","last_fullsized":"2023-10-06T11:18:25.447519+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:37:29.337170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.441765+0000","last_change":"2023-10-06T11:18:24.887006+0000","last_active":"2023-10-06T11:18:25.441765+0000","last_peered":"2023-10-06T11:18:25.441765+0000","last_clean":"2023-10-06T11:18:25.441765+0000","last_became_active":"2023-10-06T11:18:24.886750+0000","last_became_peered":"2023-10-06T11:18:24.886750+0000","last_unstale":"2023-10-06T11:18:25.441765+0000","last_undegraded":"2023-10-06T11:18:25.441765+0000","last_fullsized":"2023-10-06T11:18:25.441765+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:18:01.491609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.450881+0000","last_change":"2023-10-06T11:18:25.443713+0000","last_active":"2023-10-06T11:18:25.450881+0000","last_peered":"2023-10-06T11:18:25.450881+0000","last_clean":"2023-10-06T11:18:25.450881+0000","last_became_active":"2023-10-06T11:18:25.443453+0000","last_became_peered":"2023-10-06T11:18:25.443453+0000","last_unstale":"2023-10-06T11:18:25.450881+0000","last_undegraded":"2023-10-06T11:18:25.450881+0000","last_fullsized":"2023-10-06T11:18:25.450881+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:49:35.453520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-06T11:18:24.885691+0000","last_change":"2023-10-06T11:18:24.883820+0000","last_active":"2023-10-06T11:18:24.885691+0000","last_peered":"2023-10-06T11:18:24.885691+0000","last_clean":"2023-10-06T11:18:24.885691+0000","last_became_active":"2023-10-06T11:18:24.883563+0000","last_became_peered":"2023-10-06T11:18:24.883563+0000","last_unstale":"2023-10-06T11:18:24.885691+0000","last_undegraded":"2023-10-06T11:18:24.885691+0000","last_fullsized":"2023-10-06T11:18:24.885691+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:27:56.957822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.13","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.451925+0000","last_change":"2023-10-06T11:18:25.444566+0000","last_active":"2023-10-06T11:18:25.451925+0000","last_peered":"2023-10-06T11:18:25.451925+0000","last_clean":"2023-10-06T11:18:25.451925+0000","last_became_active":"2023-10-06T11:18:25.444307+0000","last_became_peered":"2023-10-06T11:18:25.444307+0000","last_unstale":"2023-10-06T11:18:25.451925+0000","last_undegraded":"2023-10-06T11:18:25.451925+0000","last_fullsized":"2023-10-06T11:18:25.451925+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:48:59.452585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.10","version":"162'8","reported_seq":17,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.889065+0000","last_change":"2023-10-06T11:18:24.886305+0000","last_active":"2023-10-06T11:18:25.889065+0000","last_peered":"2023-10-06T11:18:25.889065+0000","last_clean":"2023-10-06T11:18:25.889065+0000","last_became_active":"2023-10-06T11:18:24.886021+0000","last_became_peered":"2023-10-06T11:18:24.886021+0000","last_unstale":"2023-10-06T11:18:25.889065+0000","last_undegraded":"2023-10-06T11:18:25.889065+0000","last_fullsized":"2023-10-06T11:18:25.889065+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:58:45.228119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.444857+0000","last_change":"2023-10-06T11:18:25.444857+0000","last_active":"2023-10-06T11:18:25.444857+0000","last_peered":"2023-10-06T11:18:25.444857+0000","last_clean":"2023-10-06T11:18:25.444857+0000","last_became_active":"2023-10-06T11:18:25.444585+0000","last_became_peered":"2023-10-06T11:18:25.444585+0000","last_unstale":"2023-10-06T11:18:25.444857+0000","last_undegraded":"2023-10-06T11:18:25.444857+0000","last_fullsized":"2023-10-06T11:18:25.444857+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:06:08.019626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"162'1","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.435647+0000","last_change":"2023-10-06T11:18:24.886511+0000","last_active":"2023-10-06T11:18:25.435647+0000","last_peered":"2023-10-06T11:18:25.435647+0000","last_clean":"2023-10-06T11:18:25.435647+0000","last_became_active":"2023-10-06T11:18:24.886262+0000","last_became_peered":"2023-10-06T11:18:24.886262+0000","last_unstale":"2023-10-06T11:18:25.435647+0000","last_undegraded":"2023-10-06T11:18:25.435647+0000","last_fullsized":"2023-10-06T11:18:25.435647+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:43:27.992473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.d","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.444007+0000","last_change":"2023-10-06T11:18:25.444007+0000","last_active":"2023-10-06T11:18:25.444007+0000","last_peered":"2023-10-06T11:18:25.444007+0000","last_clean":"2023-10-06T11:18:25.444007+0000","last_became_active":"2023-10-06T11:18:25.443429+0000","last_became_peered":"2023-10-06T11:18:25.443429+0000","last_unstale":"2023-10-06T11:18:25.444007+0000","last_undegraded":"2023-10-06T11:18:25.444007+0000","last_fullsized":"2023-10-06T11:18:25.444007+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:11:34.152327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.e","version":"162'2","reported_seq":11,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.880568+0000","last_change":"2023-10-06T11:18:24.887926+0000","last_active":"2023-10-06T11:18:25.880568+0000","last_peered":"2023-10-06T11:18:25.880568+0000","last_clean":"2023-10-06T11:18:25.880568+0000","last_became_active":"2023-10-06T11:18:24.887678+0000","last_became_peered":"2023-10-06T11:18:24.887678+0000","last_unstale":"2023-10-06T11:18:25.880568+0000","last_undegraded":"2023-10-06T11:18:25.880568+0000","last_fullsized":"2023-10-06T11:18:25.880568+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:00:44.460945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.e","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.442744+0000","last_change":"2023-10-06T11:18:25.442744+0000","last_active":"2023-10-06T11:18:25.442744+0000","last_peered":"2023-10-06T11:18:25.442744+0000","last_clean":"2023-10-06T11:18:25.442744+0000","last_became_active":"2023-10-06T11:18:25.442494+0000","last_became_peered":"2023-10-06T11:18:25.442494+0000","last_unstale":"2023-10-06T11:18:25.442744+0000","last_undegraded":"2023-10-06T11:18:25.442744+0000","last_fullsized":"2023-10-06T11:18:25.442744+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:29:29.559735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.d","version":"162'1","reported_seq":11,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.883611+0000","last_change":"2023-10-06T11:18:24.892580+0000","last_active":"2023-10-06T11:18:25.883611+0000","last_peered":"2023-10-06T11:18:25.883611+0000","last_clean":"2023-10-06T11:18:25.883611+0000","last_became_active":"2023-10-06T11:18:24.892328+0000","last_became_peered":"2023-10-06T11:18:24.892328+0000","last_unstale":"2023-10-06T11:18:25.883611+0000","last_undegraded":"2023-10-06T11:18:25.883611+0000","last_fullsized":"2023-10-06T11:18:25.883611+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:48:51.581617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.f","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.444240+0000","last_change":"2023-10-06T11:18:25.442425+0000","last_active":"2023-10-06T11:18:25.444240+0000","last_peered":"2023-10-06T11:18:25.444240+0000","last_clean":"2023-10-06T11:18:25.444240+0000","last_became_active":"2023-10-06T11:18:25.442070+0000","last_became_peered":"2023-10-06T11:18:25.442070+0000","last_unstale":"2023-10-06T11:18:25.444240+0000","last_undegraded":"2023-10-06T11:18:25.444240+0000","last_fullsized":"2023-10-06T11:18:25.444240+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:35:53.213679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-06T11:18:24.885324+0000","last_change":"2023-10-06T11:18:24.882979+0000","last_active":"2023-10-06T11:18:24.885324+0000","last_peered":"2023-10-06T11:18:24.885324+0000","last_clean":"2023-10-06T11:18:24.885324+0000","last_became_active":"2023-10-06T11:18:24.882687+0000","last_became_peered":"2023-10-06T11:18:24.882687+0000","last_unstale":"2023-10-06T11:18:24.885324+0000","last_undegraded":"2023-10-06T11:18:24.885324+0000","last_fullsized":"2023-10-06T11:18:24.885324+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:42:40.058892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.444289+0000","last_change":"2023-10-06T11:18:25.442587+0000","last_active":"2023-10-06T11:18:25.444289+0000","last_peered":"2023-10-06T11:18:25.444289+0000","last_clean":"2023-10-06T11:18:25.444289+0000","last_became_active":"2023-10-06T11:18:25.442302+0000","last_became_peered":"2023-10-06T11:18:25.442302+0000","last_unstale":"2023-10-06T11:18:25.444289+0000","last_undegraded":"2023-10-06T11:18:25.444289+0000","last_fullsized":"2023-10-06T11:18:25.444289+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:44:52.093444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"162'2","reported_seq":12,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.883540+0000","last_change":"2023-10-06T11:18:24.883229+0000","last_active":"2023-10-06T11:18:25.883540+0000","last_peered":"2023-10-06T11:18:25.883540+0000","last_clean":"2023-10-06T11:18:25.883540+0000","last_became_active":"2023-10-06T11:18:24.882532+0000","last_became_peered":"2023-10-06T11:18:24.882532+0000","last_unstale":"2023-10-06T11:18:25.883540+0000","last_undegraded":"2023-10-06T11:18:25.883540+0000","last_fullsized":"2023-10-06T11:18:25.883540+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:40:03.670182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.443158+0000","last_change":"2023-10-06T11:18:25.443158+0000","last_active":"2023-10-06T11:18:25.443158+0000","last_peered":"2023-10-06T11:18:25.443158+0000","last_clean":"2023-10-06T11:18:25.443158+0000","last_became_active":"2023-10-06T11:18:25.442882+0000","last_became_peered":"2023-10-06T11:18:25.442882+0000","last_unstale":"2023-10-06T11:18:25.443158+0000","last_undegraded":"2023-10-06T11:18:25.443158+0000","last_fullsized":"2023-10-06T11:18:25.443158+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:59.283961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-06T11:18:24.893712+0000","last_change":"2023-10-06T11:18:24.890804+0000","last_active":"2023-10-06T11:18:24.893712+0000","last_peered":"2023-10-06T11:18:24.893712+0000","last_clean":"2023-10-06T11:18:24.893712+0000","last_became_active":"2023-10-06T11:18:24.887960+0000","last_became_peered":"2023-10-06T11:18:24.887960+0000","last_unstale":"2023-10-06T11:18:24.893712+0000","last_undegraded":"2023-10-06T11:18:24.893712+0000","last_fullsized":"2023-10-06T11:18:24.893712+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:50:28.990335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.441415+0000","last_change":"2023-10-06T11:18:25.441415+0000","last_active":"2023-10-06T11:18:25.441415+0000","last_peered":"2023-10-06T11:18:25.441415+0000","last_clean":"2023-10-06T11:18:25.441415+0000","last_became_active":"2023-10-06T11:18:25.441176+0000","last_became_peered":"2023-10-06T11:18:25.441176+0000","last_unstale":"2023-10-06T11:18:25.441415+0000","last_undegraded":"2023-10-06T11:18:25.441415+0000","last_fullsized":"2023-10-06T11:18:25.441415+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:40:27.559023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-06T11:18:24.890370+0000","last_change":"2023-10-06T11:18:24.888647+0000","last_active":"2023-10-06T11:18:24.890370+0000","last_peered":"2023-10-06T11:18:24.890370+0000","last_clean":"2023-10-06T11:18:24.890370+0000","last_became_active":"2023-10-06T11:18:24.888128+0000","last_became_peered":"2023-10-06T11:18:24.888128+0000","last_unstale":"2023-10-06T11:18:24.890370+0000","last_undegraded":"2023-10-06T11:18:24.890370+0000","last_fullsized":"2023-10-06T11:18:24.890370+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:13:20.219819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.b","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.444384+0000","last_change":"2023-10-06T11:18:25.444384+0000","last_active":"2023-10-06T11:18:25.444384+0000","last_peered":"2023-10-06T11:18:25.444384+0000","last_clean":"2023-10-06T11:18:25.444384+0000","last_became_active":"2023-10-06T11:18:25.444020+0000","last_became_peered":"2023-10-06T11:18:25.444020+0000","last_unstale":"2023-10-06T11:18:25.444384+0000","last_undegraded":"2023-10-06T11:18:25.444384+0000","last_fullsized":"2023-10-06T11:18:25.444384+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:08:39.929677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.440470+0000","last_change":"2023-10-06T11:18:24.884230+0000","last_active":"2023-10-06T11:18:25.440470+0000","last_peered":"2023-10-06T11:18:25.440470+0000","last_clean":"2023-10-06T11:18:25.440470+0000","last_became_active":"2023-10-06T11:18:24.883949+0000","last_became_peered":"2023-10-06T11:18:24.883949+0000","last_unstale":"2023-10-06T11:18:25.440470+0000","last_undegraded":"2023-10-06T11:18:25.440470+0000","last_fullsized":"2023-10-06T11:18:25.440470+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:45:36.159413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.442126+0000","last_change":"2023-10-06T11:18:25.442126+0000","last_active":"2023-10-06T11:18:25.442126+0000","last_peered":"2023-10-06T11:18:25.442126+0000","last_clean":"2023-10-06T11:18:25.442126+0000","last_became_active":"2023-10-06T11:18:25.441882+0000","last_became_peered":"2023-10-06T11:18:25.441882+0000","last_unstale":"2023-10-06T11:18:25.442126+0000","last_undegraded":"2023-10-06T11:18:25.442126+0000","last_fullsized":"2023-10-06T11:18:25.442126+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:27:32.796087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.7","version":"162'2","reported_seq":11,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.880234+0000","last_change":"2023-10-06T11:18:24.887656+0000","last_active":"2023-10-06T11:18:25.880234+0000","last_peered":"2023-10-06T11:18:25.880234+0000","last_clean":"2023-10-06T11:18:25.880234+0000","last_became_active":"2023-10-06T11:18:24.887404+0000","last_became_peered":"2023-10-06T11:18:24.887404+0000","last_unstale":"2023-10-06T11:18:25.880234+0000","last_undegraded":"2023-10-06T11:18:25.880234+0000","last_fullsized":"2023-10-06T11:18:25.880234+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:50:18.275532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.446010+0000","last_change":"2023-10-06T11:18:25.445104+0000","last_active":"2023-10-06T11:18:25.446010+0000","last_peered":"2023-10-06T11:18:25.446010+0000","last_clean":"2023-10-06T11:18:25.446010+0000","last_became_active":"2023-10-06T11:18:25.444702+0000","last_became_peered":"2023-10-06T11:18:25.444702+0000","last_unstale":"2023-10-06T11:18:25.446010+0000","last_undegraded":"2023-10-06T11:18:25.446010+0000","last_fullsized":"2023-10-06T11:18:25.446010+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:09:08.296176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-06T11:18:24.888155+0000","last_change":"2023-10-06T11:18:24.887697+0000","last_active":"2023-10-06T11:18:24.888155+0000","last_peered":"2023-10-06T11:18:24.888155+0000","last_clean":"2023-10-06T11:18:24.888155+0000","last_became_active":"2023-10-06T11:18:24.887414+0000","last_became_peered":"2023-10-06T11:18:24.887414+0000","last_unstale":"2023-10-06T11:18:24.888155+0000","last_undegraded":"2023-10-06T11:18:24.888155+0000","last_fullsized":"2023-10-06T11:18:24.888155+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:48:12.548143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.451874+0000","last_change":"2023-10-06T11:18:25.451874+0000","last_active":"2023-10-06T11:18:25.451874+0000","last_peered":"2023-10-06T11:18:25.451874+0000","last_clean":"2023-10-06T11:18:25.451874+0000","last_became_active":"2023-10-06T11:18:25.451602+0000","last_became_peered":"2023-10-06T11:18:25.451602+0000","last_unstale":"2023-10-06T11:18:25.451874+0000","last_undegraded":"2023-10-06T11:18:25.451874+0000","last_fullsized":"2023-10-06T11:18:25.451874+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:35:53.213679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-06T11:18:24.893474+0000","last_change":"2023-10-06T11:18:24.888941+0000","last_active":"2023-10-06T11:18:24.893474+0000","last_peered":"2023-10-06T11:18:24.893474+0000","last_clean":"2023-10-06T11:18:24.893474+0000","last_became_active":"2023-10-06T11:18:24.888692+0000","last_became_peered":"2023-10-06T11:18:24.888692+0000","last_unstale":"2023-10-06T11:18:24.893474+0000","last_undegraded":"2023-10-06T11:18:24.893474+0000","last_fullsized":"2023-10-06T11:18:24.893474+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:39:13.360180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.7","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.443580+0000","last_change":"2023-10-06T11:18:25.443580+0000","last_active":"2023-10-06T11:18:25.443580+0000","last_peered":"2023-10-06T11:18:25.443580+0000","last_clean":"2023-10-06T11:18:25.443580+0000","last_became_active":"2023-10-06T11:18:25.443339+0000","last_became_peered":"2023-10-06T11:18:25.443339+0000","last_unstale":"2023-10-06T11:18:25.443580+0000","last_undegraded":"2023-10-06T11:18:25.443580+0000","last_fullsized":"2023-10-06T11:18:25.443580+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:10:53.067979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-06T11:18:24.893427+0000","last_change":"2023-10-06T11:18:24.889366+0000","last_active":"2023-10-06T11:18:24.893427+0000","last_peered":"2023-10-06T11:18:24.893427+0000","last_clean":"2023-10-06T11:18:24.893427+0000","last_became_active":"2023-10-06T11:18:24.889129+0000","last_became_peered":"2023-10-06T11:18:24.889129+0000","last_unstale":"2023-10-06T11:18:24.893427+0000","last_undegraded":"2023-10-06T11:18:24.893427+0000","last_fullsized":"2023-10-06T11:18:24.893427+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:09:07.291323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.448935+0000","last_change":"2023-10-06T11:18:25.446430+0000","last_active":"2023-10-06T11:18:25.448935+0000","last_peered":"2023-10-06T11:18:25.448935+0000","last_clean":"2023-10-06T11:18:25.448935+0000","last_became_active":"2023-10-06T11:18:25.446136+0000","last_became_peered":"2023-10-06T11:18:25.446136+0000","last_unstale":"2023-10-06T11:18:25.448935+0000","last_undegraded":"2023-10-06T11:18:25.448935+0000","last_fullsized":"2023-10-06T11:18:25.448935+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:31:31.365208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-06T11:18:24.892441+0000","last_change":"2023-10-06T11:18:24.888193+0000","last_active":"2023-10-06T11:18:24.892441+0000","last_peered":"2023-10-06T11:18:24.892441+0000","last_clean":"2023-10-06T11:18:24.892441+0000","last_became_active":"2023-10-06T11:18:24.887917+0000","last_became_peered":"2023-10-06T11:18:24.887917+0000","last_unstale":"2023-10-06T11:18:24.892441+0000","last_undegraded":"2023-10-06T11:18:24.892441+0000","last_fullsized":"2023-10-06T11:18:24.892441+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:51.823646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.450784+0000","last_change":"2023-10-06T11:18:25.443486+0000","last_active":"2023-10-06T11:18:25.450784+0000","last_peered":"2023-10-06T11:18:25.450784+0000","last_clean":"2023-10-06T11:18:25.450784+0000","last_became_active":"2023-10-06T11:18:25.443007+0000","last_became_peered":"2023-10-06T11:18:25.443007+0000","last_unstale":"2023-10-06T11:18:25.450784+0000","last_undegraded":"2023-10-06T11:18:25.450784+0000","last_fullsized":"2023-10-06T11:18:25.450784+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:17:44.642541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-06T11:18:24.895267+0000","last_change":"2023-10-06T11:18:24.892740+0000","last_active":"2023-10-06T11:18:24.895267+0000","last_peered":"2023-10-06T11:18:24.895267+0000","last_clean":"2023-10-06T11:18:24.895267+0000","last_became_active":"2023-10-06T11:18:24.892419+0000","last_became_peered":"2023-10-06T11:18:24.892419+0000","last_unstale":"2023-10-06T11:18:24.895267+0000","last_undegraded":"2023-10-06T11:18:24.895267+0000","last_fullsized":"2023-10-06T11:18:24.895267+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:01:13.168101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.450923+0000","last_change":"2023-10-06T11:18:25.447669+0000","last_active":"2023-10-06T11:18:25.450923+0000","last_peered":"2023-10-06T11:18:25.450923+0000","last_clean":"2023-10-06T11:18:25.450923+0000","last_became_active":"2023-10-06T11:18:25.447347+0000","last_became_peered":"2023-10-06T11:18:25.447347+0000","last_unstale":"2023-10-06T11:18:25.450923+0000","last_undegraded":"2023-10-06T11:18:25.450923+0000","last_fullsized":"2023-10-06T11:18:25.450923+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:59:26.364232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-06T11:18:24.889782+0000","last_change":"2023-10-06T11:18:24.886527+0000","last_active":"2023-10-06T11:18:24.889782+0000","last_peered":"2023-10-06T11:18:24.889782+0000","last_clean":"2023-10-06T11:18:24.889782+0000","last_became_active":"2023-10-06T11:18:24.886276+0000","last_became_peered":"2023-10-06T11:18:24.886276+0000","last_unstale":"2023-10-06T11:18:24.889782+0000","last_undegraded":"2023-10-06T11:18:24.889782+0000","last_fullsized":"2023-10-06T11:18:24.889782+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:33:17.423153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.452486+0000","last_change":"2023-10-06T11:18:25.452486+0000","last_active":"2023-10-06T11:18:25.452486+0000","last_peered":"2023-10-06T11:18:25.452486+0000","last_clean":"2023-10-06T11:18:25.452486+0000","last_became_active":"2023-10-06T11:18:25.452244+0000","last_became_peered":"2023-10-06T11:18:25.452244+0000","last_unstale":"2023-10-06T11:18:25.452486+0000","last_undegraded":"2023-10-06T11:18:25.452486+0000","last_fullsized":"2023-10-06T11:18:25.452486+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:43:28.681381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.440471+0000","last_change":"2023-10-06T11:18:24.887846+0000","last_active":"2023-10-06T11:18:25.440471+0000","last_peered":"2023-10-06T11:18:25.440471+0000","last_clean":"2023-10-06T11:18:25.440471+0000","last_became_active":"2023-10-06T11:18:24.887521+0000","last_became_peered":"2023-10-06T11:18:24.887521+0000","last_unstale":"2023-10-06T11:18:25.440471+0000","last_undegraded":"2023-10-06T11:18:25.440471+0000","last_fullsized":"2023-10-06T11:18:25.440471+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:06:59.458337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1e","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.452466+0000","last_change":"2023-10-06T11:18:25.452466+0000","last_active":"2023-10-06T11:18:25.452466+0000","last_peered":"2023-10-06T11:18:25.452466+0000","last_clean":"2023-10-06T11:18:25.452466+0000","last_became_active":"2023-10-06T11:18:25.452188+0000","last_became_peered":"2023-10-06T11:18:25.452188+0000","last_unstale":"2023-10-06T11:18:25.452466+0000","last_undegraded":"2023-10-06T11:18:25.452466+0000","last_fullsized":"2023-10-06T11:18:25.452466+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:01:36.823275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1d","version":"162'2","reported_seq":11,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.884098+0000","last_change":"2023-10-06T11:18:24.882635+0000","last_active":"2023-10-06T11:18:25.884098+0000","last_peered":"2023-10-06T11:18:25.884098+0000","last_clean":"2023-10-06T11:18:25.884098+0000","last_became_active":"2023-10-06T11:18:24.882293+0000","last_became_peered":"2023-10-06T11:18:24.882293+0000","last_unstale":"2023-10-06T11:18:25.884098+0000","last_undegraded":"2023-10-06T11:18:25.884098+0000","last_fullsized":"2023-10-06T11:18:25.884098+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:07:56.630675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":143,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.438949+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:18:25.438949+0000","last_peered":"2023-10-06T11:18:25.438949+0000","last_clean":"2023-10-06T11:18:25.438949+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:18:25.438949+0000","last_undegraded":"2023-10-06T11:18:25.438949+0000","last_fullsized":"2023-10-06T11:18:25.438949+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1f","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.447833+0000","last_change":"2023-10-06T11:18:25.443617+0000","last_active":"2023-10-06T11:18:25.447833+0000","last_peered":"2023-10-06T11:18:25.447833+0000","last_clean":"2023-10-06T11:18:25.447833+0000","last_became_active":"2023-10-06T11:18:25.443350+0000","last_became_peered":"2023-10-06T11:18:25.443350+0000","last_unstale":"2023-10-06T11:18:25.447833+0000","last_undegraded":"2023-10-06T11:18:25.447833+0000","last_fullsized":"2023-10-06T11:18:25.447833+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:25:03.060786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1c","version":"162'2","reported_seq":12,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.885335+0000","last_change":"2023-10-06T11:18:24.887627+0000","last_active":"2023-10-06T11:18:25.885335+0000","last_peered":"2023-10-06T11:18:25.885335+0000","last_clean":"2023-10-06T11:18:25.885335+0000","last_became_active":"2023-10-06T11:18:24.887340+0000","last_became_peered":"2023-10-06T11:18:24.887340+0000","last_unstale":"2023-10-06T11:18:25.885335+0000","last_undegraded":"2023-10-06T11:18:25.885335+0000","last_fullsized":"2023-10-06T11:18:25.885335+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:18:01.491609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":133,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-06T11:18:24.874989+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:18:24.874989+0000","last_peered":"2023-10-06T11:18:24.874989+0000","last_clean":"2023-10-06T11:18:24.874989+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:18:24.874989+0000","last_undegraded":"2023-10-06T11:18:24.874989+0000","last_fullsized":"2023-10-06T11:18:24.874989+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.450408+0000","last_change":"2023-10-06T11:18:25.442651+0000","last_active":"2023-10-06T11:18:25.450408+0000","last_peered":"2023-10-06T11:18:25.450408+0000","last_clean":"2023-10-06T11:18:25.450408+0000","last_became_active":"2023-10-06T11:18:25.442391+0000","last_became_peered":"2023-10-06T11:18:25.442391+0000","last_unstale":"2023-10-06T11:18:25.450408+0000","last_undegraded":"2023-10-06T11:18:25.450408+0000","last_fullsized":"2023-10-06T11:18:25.450408+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:55:52.828500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.1b","version":"162'1","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.438336+0000","last_change":"2023-10-06T11:18:24.888943+0000","last_active":"2023-10-06T11:18:25.438336+0000","last_peered":"2023-10-06T11:18:25.438336+0000","last_clean":"2023-10-06T11:18:25.438336+0000","last_became_active":"2023-10-06T11:18:24.888320+0000","last_became_peered":"2023-10-06T11:18:24.888320+0000","last_unstale":"2023-10-06T11:18:25.438336+0000","last_undegraded":"2023-10-06T11:18:25.438336+0000","last_fullsized":"2023-10-06T11:18:25.438336+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:44:51.088591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":132,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.438070+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:18:25.438070+0000","last_peered":"2023-10-06T11:18:25.438070+0000","last_clean":"2023-10-06T11:18:25.438070+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:18:25.438070+0000","last_undegraded":"2023-10-06T11:18:25.438070+0000","last_fullsized":"2023-10-06T11:18:25.438070+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":276,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-06T11:18:24.881219+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:18:24.881219+0000","last_peered":"2023-10-06T11:18:24.881219+0000","last_clean":"2023-10-06T11:18:24.881219+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:18:24.881219+0000","last_undegraded":"2023-10-06T11:18:24.881219+0000","last_fullsized":"2023-10-06T11:18:24.881219+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.450640+0000","last_change":"2023-10-06T11:18:25.447447+0000","last_active":"2023-10-06T11:18:25.450640+0000","last_peered":"2023-10-06T11:18:25.450640+0000","last_clean":"2023-10-06T11:18:25.450640+0000","last_became_active":"2023-10-06T11:18:25.447192+0000","last_became_peered":"2023-10-06T11:18:25.447192+0000","last_unstale":"2023-10-06T11:18:25.450640+0000","last_undegraded":"2023-10-06T11:18:25.450640+0000","last_fullsized":"2023-10-06T11:18:25.450640+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:59:48.728783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1a","version":"162'1","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.434528+0000","last_change":"2023-10-06T11:18:24.893031+0000","last_active":"2023-10-06T11:18:25.434528+0000","last_peered":"2023-10-06T11:18:25.434528+0000","last_clean":"2023-10-06T11:18:25.434528+0000","last_became_active":"2023-10-06T11:18:24.892718+0000","last_became_peered":"2023-10-06T11:18:24.892718+0000","last_unstale":"2023-10-06T11:18:25.434528+0000","last_undegraded":"2023-10-06T11:18:25.434528+0000","last_fullsized":"2023-10-06T11:18:25.434528+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:12:31.245499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":126,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-06T11:18:24.881316+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:18:24.881316+0000","last_peered":"2023-10-06T11:18:24.881316+0000","last_clean":"2023-10-06T11:18:24.881316+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:18:24.881316+0000","last_undegraded":"2023-10-06T11:18:24.881316+0000","last_fullsized":"2023-10-06T11:18:24.881316+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1b","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.449068+0000","last_change":"2023-10-06T11:18:25.446139+0000","last_active":"2023-10-06T11:18:25.449068+0000","last_peered":"2023-10-06T11:18:25.449068+0000","last_clean":"2023-10-06T11:18:25.449068+0000","last_became_active":"2023-10-06T11:18:25.445839+0000","last_became_peered":"2023-10-06T11:18:25.445839+0000","last_unstale":"2023-10-06T11:18:25.449068+0000","last_undegraded":"2023-10-06T11:18:25.449068+0000","last_fullsized":"2023-10-06T11:18:25.449068+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:10.480310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":9,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-06T11:18:24.890414+0000","last_change":"2023-10-06T11:18:24.885372+0000","last_active":"2023-10-06T11:18:24.890414+0000","last_peered":"2023-10-06T11:18:24.890414+0000","last_clean":"2023-10-06T11:18:24.890414+0000","last_became_active":"2023-10-06T11:18:24.885067+0000","last_became_peered":"2023-10-06T11:18:24.885067+0000","last_unstale":"2023-10-06T11:18:24.890414+0000","last_undegraded":"2023-10-06T11:18:24.890414+0000","last_fullsized":"2023-10-06T11:18:24.890414+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:54:22.459395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":126,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-06T11:18:24.881256+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:18:24.881256+0000","last_peered":"2023-10-06T11:18:24.881256+0000","last_clean":"2023-10-06T11:18:24.881256+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:18:24.881256+0000","last_undegraded":"2023-10-06T11:18:24.881256+0000","last_fullsized":"2023-10-06T11:18:24.881256+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1a","version":"0'0","reported_seq":9,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.452617+0000","last_change":"2023-10-06T11:18:25.451678+0000","last_active":"2023-10-06T11:18:25.452617+0000","last_peered":"2023-10-06T11:18:25.452617+0000","last_clean":"2023-10-06T11:18:25.452617+0000","last_became_active":"2023-10-06T11:18:25.451400+0000","last_became_peered":"2023-10-06T11:18:25.451400+0000","last_unstale":"2023-10-06T11:18:25.452617+0000","last_undegraded":"2023-10-06T11:18:25.452617+0000","last_fullsized":"2023-10-06T11:18:25.452617+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:47.139530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.438374+0000","last_change":"2023-10-06T11:18:24.883813+0000","last_active":"2023-10-06T11:18:25.438374+0000","last_peered":"2023-10-06T11:18:25.438374+0000","last_clean":"2023-10-06T11:18:25.438374+0000","last_became_active":"2023-10-06T11:18:24.883561+0000","last_became_peered":"2023-10-06T11:18:24.883561+0000","last_unstale":"2023-10-06T11:18:25.438374+0000","last_undegraded":"2023-10-06T11:18:25.438374+0000","last_fullsized":"2023-10-06T11:18:25.438374+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:43:27.992473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":149,"reported_epoch":161,"state":"active+clean","last_fresh":"2023-10-06T11:18:24.872774+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:18:24.872774+0000","last_peered":"2023-10-06T11:18:24.872774+0000","last_clean":"2023-10-06T11:18:24.872774+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:18:24.872774+0000","last_undegraded":"2023-10-06T11:18:24.872774+0000","last_fullsized":"2023-10-06T11:18:24.872774+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1d","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.450459+0000","last_change":"2023-10-06T11:18:25.450459+0000","last_active":"2023-10-06T11:18:25.450459+0000","last_peered":"2023-10-06T11:18:25.450459+0000","last_clean":"2023-10-06T11:18:25.450459+0000","last_became_active":"2023-10-06T11:18:25.450197+0000","last_became_peered":"2023-10-06T11:18:25.450197+0000","last_unstale":"2023-10-06T11:18:25.450459+0000","last_undegraded":"2023-10-06T11:18:25.450459+0000","last_fullsized":"2023-10-06T11:18:25.450459+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:46:29.866454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"162'1","reported_seq":10,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.436914+0000","last_change":"2023-10-06T11:18:24.889394+0000","last_active":"2023-10-06T11:18:25.436914+0000","last_peered":"2023-10-06T11:18:25.436914+0000","last_clean":"2023-10-06T11:18:25.436914+0000","last_became_active":"2023-10-06T11:18:24.889173+0000","last_became_peered":"2023-10-06T11:18:24.889173+0000","last_unstale":"2023-10-06T11:18:25.436914+0000","last_undegraded":"2023-10-06T11:18:25.436914+0000","last_fullsized":"2023-10-06T11:18:25.436914+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:28:46.134676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":133,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.439787+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:18:25.439787+0000","last_peered":"2023-10-06T11:18:25.439787+0000","last_clean":"2023-10-06T11:18:25.439787+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:18:25.439787+0000","last_undegraded":"2023-10-06T11:18:25.439787+0000","last_fullsized":"2023-10-06T11:18:25.439787+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.1c","version":"0'0","reported_seq":8,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.453602+0000","last_change":"2023-10-06T11:18:25.453602+0000","last_active":"2023-10-06T11:18:25.453602+0000","last_peered":"2023-10-06T11:18:25.453602+0000","last_clean":"2023-10-06T11:18:25.453602+0000","last_became_active":"2023-10-06T11:18:25.453307+0000","last_became_peered":"2023-10-06T11:18:25.453307+0000","last_unstale":"2023-10-06T11:18:25.453602+0000","last_undegraded":"2023-10-06T11:18:25.453602+0000","last_fullsized":"2023-10-06T11:18:25.453602+0000","mapping_epoch":161,"log_start":"0'0","ondisk_log_start":"0'0","created":161,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:24.861013+0000","last_clean_scrub_stamp":"2023-10-06T11:18:24.861013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:02.747570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.1f","version":"162'4","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.893660+0000","last_change":"2023-10-06T11:18:24.890390+0000","last_active":"2023-10-06T11:18:25.893660+0000","last_peered":"2023-10-06T11:18:25.893660+0000","last_clean":"2023-10-06T11:18:25.893660+0000","last_became_active":"2023-10-06T11:18:24.887907+0000","last_became_peered":"2023-10-06T11:18:24.887907+0000","last_unstale":"2023-10-06T11:18:25.893660+0000","last_undegraded":"2023-10-06T11:18:25.893660+0000","last_fullsized":"2023-10-06T11:18:25.893660+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:23.856159+0000","last_clean_scrub_stamp":"2023-10-06T11:18:23.856159+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:58:43.295708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":133,"reported_epoch":162,"state":"active+clean","last_fresh":"2023-10-06T11:18:25.439903+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:18:25.439903+0000","last_peered":"2023-10-06T11:18:25.439903+0000","last_clean":"2023-10-06T11:18:25.439903+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:18:25.439903+0000","last_undegraded":"2023-10-06T11:18:25.439903+0000","last_fullsized":"2023-10-06T11:18:25.439903+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":25,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575005,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303956,"kb_used_data":2572,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067884,"statfs":{"total":96636764160,"available":96325513216,"internally_reserved":0,"allocated":2633728,"data_stored":1531080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54400000000000004,"15min":0.629},"min":{"1min":0.35899999999999999,"5min":0.252,"15min":0.21199999999999999},"max":{"1min":0.70999999999999996,"5min":4.407,"15min":23.908999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.52500000000000002,"15min":0.57799999999999996},"min":{"1min":0.38200000000000001,"5min":0.26900000000000002,"15min":0.22500000000000001},"max":{"1min":0.71699999999999997,"5min":0.76800000000000002,"15min":9.3230000000000004},"last":0.39200000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54500000000000004,"15min":0.55900000000000005},"min":{"1min":0.439,"5min":0.28399999999999997,"15min":0.26000000000000001},"max":{"1min":0.72699999999999998,"5min":2.4689999999999999,"15min":9.2360000000000007},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.5,"15min":0.505},"min":{"1min":0.373,"5min":0.33100000000000002,"15min":0.25900000000000001},"max":{"1min":0.63900000000000001,"5min":0.70899999999999996,"15min":4.327},"last":0.373}]},{"osd":2,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56499999999999995,"15min":0.52100000000000002},"min":{"1min":0.379,"5min":0.34399999999999997,"15min":0.26500000000000001},"max":{"1min":0.67000000000000004,"5min":4.3120000000000003,"15min":4.3120000000000003},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56299999999999994,"15min":0.55800000000000005},"min":{"1min":0.46300000000000002,"5min":0.311,"15min":0.29999999999999999},"max":{"1min":0.65400000000000003,"5min":3.0600000000000001,"15min":4.7309999999999999},"last":0.34799999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56899999999999995,"15min":0.54500000000000004},"min":{"1min":0.45300000000000001,"5min":0.32600000000000001,"15min":0.27900000000000003},"max":{"1min":0.69899999999999995,"5min":4.5190000000000001,"15min":4.5190000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.44800000000000001,"5min":0.374,"15min":0.29699999999999999},"max":{"1min":0.73199999999999998,"5min":3.0070000000000001,"15min":9.3879999999999999},"last":0.48899999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.52600000000000002,"15min":0.49299999999999999},"min":{"1min":0.32600000000000001,"5min":0.29799999999999999,"15min":0.24399999999999999},"max":{"1min":0.59099999999999997,"5min":4.6639999999999997,"15min":4.6639999999999997},"last":0.434},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.56799999999999995,"15min":0.53500000000000003},"min":{"1min":0.41999999999999998,"5min":0.28499999999999998,"15min":0.27300000000000002},"max":{"1min":0.64700000000000002,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":0.57999999999999996}]},{"osd":5,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.53200000000000003,"15min":0.55700000000000005},"min":{"1min":0.33100000000000002,"5min":0.32900000000000001,"15min":0.26000000000000001},"max":{"1min":0.72399999999999998,"5min":0.77000000000000002,"15min":9.3499999999999996},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.502,"5min":0.52500000000000002,"15min":0.53800000000000003},"min":{"1min":0.371,"5min":0.30099999999999999,"15min":0.26800000000000002},"max":{"1min":0.71399999999999997,"5min":0.89100000000000001,"15min":4.444},"last":0.502}]},{"osd":6,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.56699999999999995,"15min":0.59299999999999997},"min":{"1min":0.39500000000000002,"5min":0.38100000000000001,"15min":0.29199999999999998},"max":{"1min":0.68600000000000005,"5min":0.82099999999999995,"15min":9.4969999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.63200000000000001,"15min":0.61899999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.74199999999999999,"5min":4.4669999999999996,"15min":7.2039999999999997},"last":0.55100000000000005}]}]},{"osd":6,"up_from":13,"seq":55834575007,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299292,"kb_used_data":2004,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072548,"statfs":{"total":96636764160,"available":96330289152,"internally_reserved":0,"allocated":2052096,"data_stored":946070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.60999999999999999,"15min":0.52700000000000002},"min":{"1min":0.307,"5min":0.247,"15min":0.187},"max":{"1min":0.78300000000000003,"5min":9.5549999999999997,"15min":9.5549999999999997},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.63,"5min":0.66900000000000004,"15min":0.57299999999999995},"min":{"1min":0.47299999999999998,"5min":0.30399999999999999,"15min":0.254},"max":{"1min":0.81999999999999995,"5min":9.4659999999999993,"15min":9.4659999999999993},"last":0.53200000000000003}]},{"osd":1,"last update":"Fri Oct 6 11:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.497,"15min":0.48699999999999999},"min":{"1min":0.372,"5min":0.27500000000000002,"15min":0.23300000000000001},"max":{"1min":0.71399999999999997,"5min":0.80300000000000005,"15min":0.91700000000000004},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.53200000000000003,"15min":0.52100000000000002},"min":{"1min":0.34599999999999997,"5min":0.32900000000000001,"15min":0.216},"max":{"1min":0.84199999999999997,"5min":2.238,"15min":5.2670000000000003},"last":0.57899999999999996}]},{"osd":2,"last update":"Fri Oct 6 11:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.51000000000000001,"15min":0.50700000000000001},"min":{"1min":0.30199999999999999,"5min":0.255,"15min":0.252},"max":{"1min":0.753,"5min":0.93200000000000005,"15min":7.0659999999999998},"last":0.503},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.52100000000000002,"15min":0.52300000000000002},"min":{"1min":0.40300000000000002,"5min":0.32200000000000001,"15min":0.26600000000000001},"max":{"1min":0.77600000000000002,"5min":0.78600000000000003,"15min":7.0819999999999999},"last":0.55500000000000005}]},{"osd":3,"last update":"Fri Oct 6 11:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57799999999999996,"15min":0.52700000000000002},"min":{"1min":0.39400000000000002,"5min":0.32600000000000001,"15min":0.25800000000000001},"max":{"1min":0.91300000000000003,"5min":3.871,"15min":3.871},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.55200000000000005,"15min":0.53700000000000003},"min":{"1min":0.47199999999999998,"5min":0.32100000000000001,"15min":0.312},"max":{"1min":0.80700000000000005,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.76400000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.48399999999999999,"15min":0.47699999999999998},"min":{"1min":0.35899999999999999,"5min":0.26800000000000002,"15min":0.24299999999999999},"max":{"1min":0.72999999999999998,"5min":0.76000000000000001,"15min":0.88},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54200000000000004,"15min":0.53200000000000003},"min":{"1min":0.38600000000000001,"5min":0.29699999999999999,"15min":0.27900000000000003},"max":{"1min":0.77600000000000002,"5min":0.82399999999999995,"15min":1.0680000000000001},"last":0.747}]},{"osd":5,"last update":"Fri Oct 6 11:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52700000000000002,"15min":0.51600000000000001},"min":{"1min":0.36599999999999999,"5min":0.32000000000000001,"15min":0.28399999999999997},"max":{"1min":0.69999999999999996,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63400000000000001,"15min":0.58099999999999996},"min":{"1min":0.42499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.88700000000000001,"5min":7.1379999999999999,"15min":7.1379999999999999},"last":0.80200000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59399999999999997,"15min":0.57099999999999995},"min":{"1min":0.38400000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.83899999999999997,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.59999999999999998,"15min":0.58599999999999997},"min":{"1min":0.40999999999999998,"5min":0.36399999999999999,"15min":0.30199999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.86399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575006,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":312160,"kb_used_data":2584,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94059680,"statfs":{"total":96636764160,"available":96317112320,"internally_reserved":0,"allocated":2646016,"data_stored":1537721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.47799999999999998,"15min":0.377},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.186},"max":{"1min":0.54000000000000004,"5min":13.393000000000001,"15min":13.393000000000001},"last":0.19900000000000001},{"interface":"front","average":{"1min":0.374,"5min":0.47599999999999998,"15min":0.38800000000000001},"min":{"1min":0.247,"5min":0.22700000000000001,"15min":0.19700000000000001},"max":{"1min":0.52100000000000002,"5min":11.462,"15min":11.462},"last":0.214}]},{"osd":2,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.41999999999999998,"15min":0.36299999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.216},"max":{"1min":0.56000000000000005,"5min":8.0470000000000006,"15min":8.0470000000000006},"last":0.249},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.45900000000000002,"15min":0.41099999999999998},"min":{"1min":0.27100000000000002,"5min":0.215,"15min":0.20999999999999999},"max":{"1min":0.66700000000000004,"5min":4.8630000000000004,"15min":4.8630000000000004},"last":0.26600000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.47599999999999998,"15min":0.42799999999999999},"min":{"1min":0.311,"5min":0.255,"15min":0.252},"max":{"1min":0.63700000000000001,"5min":4.8029999999999999,"15min":4.8029999999999999},"last":0.315},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.46100000000000002,"15min":0.40200000000000002},"min":{"1min":0.23799999999999999,"5min":0.23400000000000001,"15min":0.217},"max":{"1min":0.61799999999999999,"5min":5.8700000000000001,"15min":5.8700000000000001},"last":0.29199999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56399999999999995,"15min":0.53200000000000003},"min":{"1min":0.42499999999999999,"5min":0.28299999999999997,"15min":0.28199999999999997},"max":{"1min":0.83099999999999996,"5min":1.264,"15min":1.264},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.64200000000000002,"15min":0.57999999999999996},"min":{"1min":0.46700000000000003,"5min":0.317,"15min":0.317},"max":{"1min":0.85299999999999998,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.46000000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.624,"15min":0.57599999999999996},"min":{"1min":0.432,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.79900000000000004,"5min":3.4390000000000001,"15min":3.4390000000000001},"last":0.502},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.70799999999999996,"15min":0.60199999999999998},"min":{"1min":0.47599999999999998,"5min":0.36799999999999999,"15min":0.29499999999999998},"max":{"1min":0.92000000000000004,"5min":9.3829999999999991,"15min":9.3829999999999991},"last":0.44900000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.66500000000000004,"15min":0.60199999999999998},"min":{"1min":0.47799999999999998,"5min":0.35999999999999999,"15min":0.315},"max":{"1min":0.90800000000000003,"5min":3.4750000000000001,"15min":3.4750000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.66400000000000003,"15min":0.60999999999999999},"min":{"1min":0.45400000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.89700000000000002,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.55700000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68200000000000005,"15min":0.621},"min":{"1min":0.44400000000000001,"5min":0.39800000000000002,"15min":0.38500000000000001},"max":{"1min":0.90300000000000002,"5min":4.7290000000000001,"15min":4.7290000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.64300000000000002,"15min":0.60199999999999998},"min":{"1min":0.47399999999999998,"5min":0.38900000000000001,"15min":0.374},"max":{"1min":0.871,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.57899999999999996}]}]},{"osd":0,"up_from":13,"seq":55834575005,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303388,"kb_used_data":2004,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068452,"statfs":{"total":96636764160,"available":96326094848,"internally_reserved":0,"allocated":2052096,"data_stored":940059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.34599999999999997,"15min":0.47299999999999998},"min":{"1min":0.23999999999999999,"5min":0.20399999999999999,"15min":0.184},"max":{"1min":0.55500000000000005,"5min":0.60199999999999998,"15min":36.097999999999999},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.36499999999999999,"15min":0.38600000000000001},"min":{"1min":0.26400000000000001,"5min":0.22,"15min":0.182},"max":{"1min":0.51400000000000001,"5min":0.92400000000000004,"15min":7.2990000000000004},"last":0.435}]},{"osd":2,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.36599999999999999,"15min":0.50600000000000001},"min":{"1min":0.315,"5min":0.223,"15min":0.217},"max":{"1min":0.56100000000000005,"5min":0.61699999999999999,"15min":36.07},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.39400000000000002,"15min":0.41299999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.219},"max":{"1min":0.60799999999999998,"5min":0.94899999999999995,"15min":6.7800000000000002},"last":0.35699999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.36299999999999999,"15min":0.39600000000000002},"min":{"1min":0.28100000000000003,"5min":0.255,"15min":0.223},"max":{"1min":0.504,"5min":0.55000000000000004,"15min":8.4130000000000003},"last":0.372},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.42799999999999999,"15min":0.56000000000000005},"min":{"1min":0.28599999999999998,"5min":0.25800000000000001,"15min":0.249},"max":{"1min":0.59099999999999997,"5min":1.9079999999999999,"15min":35.959000000000003},"last":0.52500000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.59199999999999997,"15min":0.57299999999999995},"min":{"1min":0.496,"5min":0.33800000000000002,"15min":0.29599999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":2.427},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.60799999999999998,"15min":0.73399999999999999},"min":{"1min":0.496,"5min":0.374,"15min":0.29299999999999998},"max":{"1min":0.91100000000000003,"5min":0.94999999999999996,"15min":36.005000000000003},"last":0.68300000000000005}]},{"osd":5,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.39400000000000002,"5min":0.38400000000000001,"15min":0.32900000000000001},"max":{"1min":0.86199999999999999,"5min":0.999,"15min":6.6699999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57699999999999996,"15min":0.56299999999999994},"min":{"1min":0.41399999999999998,"5min":0.372,"15min":0.315},"max":{"1min":0.77200000000000002,"5min":0.99399999999999999,"15min":2.0600000000000001},"last":0.58499999999999996}]},{"osd":6,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.61299999999999999,"15min":0.73499999999999999},"min":{"1min":0.45800000000000002,"5min":0.39200000000000002,"15min":0.317},"max":{"1min":0.878,"5min":0.98699999999999999,"15min":36.037999999999997},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.63100000000000001,"15min":0.64400000000000002},"min":{"1min":0.45800000000000002,"5min":0.40999999999999998,"15min":0.36399999999999999},"max":{"1min":0.88800000000000001,"5min":1.028,"15min":6.7110000000000003},"last":0.751}]},{"osd":7,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.47399999999999998,"5min":0.432,"15min":0.371},"max":{"1min":0.80400000000000005,"5min":1.054,"15min":6.742},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.58799999999999997,"15min":0.57799999999999996},"min":{"1min":0.46200000000000002,"5min":0.41399999999999998,"15min":0.34499999999999997},"max":{"1min":0.89300000000000002,"5min":0.96199999999999997,"15min":1.917},"last":0.72899999999999998}]}]},{"osd":2,"up_from":13,"seq":55834575006,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299264,"kb_used_data":1976,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072576,"statfs":{"total":96636764160,"available":96330317824,"internally_reserved":0,"allocated":2023424,"data_stored":932243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.47499999999999998,"15min":0.36599999999999999},"min":{"1min":0.24399999999999999,"5min":0.214,"15min":0.17999999999999999},"max":{"1min":0.622,"5min":15.228,"15min":15.228},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.40699999999999997,"15min":0.39200000000000002},"min":{"1min":0.32000000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.72599999999999998,"5min":1.714,"15min":1.714},"last":0.377}]},{"osd":1,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.379,"15min":0.376},"min":{"1min":0.253,"5min":0.23599999999999999,"15min":0.19900000000000001},"max":{"1min":0.56999999999999995,"5min":0.57499999999999996,"15min":0.745},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.36599999999999999,"15min":0.35699999999999998},"min":{"1min":0.26000000000000001,"5min":0.23200000000000001,"15min":0.216},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.36099999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.36699999999999999,"15min":0.36899999999999999},"min":{"1min":0.27000000000000002,"5min":0.23699999999999999,"15min":0.23200000000000001},"max":{"1min":0.60899999999999999,"5min":0.621,"15min":0.629},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.38800000000000001,"15min":0.371},"min":{"1min":0.29499999999999998,"5min":0.254,"15min":0.251},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.32200000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54500000000000004,"15min":0.53400000000000003},"min":{"1min":0.439,"5min":0.30599999999999999,"15min":0.30299999999999999},"max":{"1min":0.69699999999999995,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.502},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.68799999999999994,"15min":0.59399999999999997},"min":{"1min":0.374,"5min":0.28199999999999997,"15min":0.27900000000000003},"max":{"1min":0.70999999999999996,"5min":15.26,"15min":15.26},"last":0.61299999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.69799999999999995,"15min":0.59599999999999997},"min":{"1min":0.39700000000000002,"5min":0.35799999999999998,"15min":0.32400000000000001},"max":{"1min":0.73699999999999999,"5min":15.186,"15min":15.186},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56799999999999995,"15min":0.56100000000000005},"min":{"1min":0.42999999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72199999999999998,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.52800000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59299999999999997,"15min":0.58599999999999997},"min":{"1min":0.48299999999999998,"5min":0.38200000000000001,"15min":0.32600000000000001},"max":{"1min":0.76900000000000002,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59599999999999997,"15min":0.57999999999999996},"min":{"1min":0.438,"5min":0.40699999999999997,"15min":0.34200000000000003},"max":{"1min":0.80500000000000005,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.59499999999999997}]},{"osd":7,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.67300000000000004,"15min":0.59999999999999998},"min":{"1min":0.41699999999999998,"5min":0.37,"15min":0.34499999999999997},"max":{"1min":0.69399999999999995,"5min":10.977,"15min":10.977},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57799999999999996,"15min":0.57399999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.38200000000000001},"max":{"1min":0.79400000000000004,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.56399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834575006,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311564,"kb_used_data":1988,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060276,"statfs":{"total":96636764160,"available":96317722624,"internally_reserved":0,"allocated":2035712,"data_stored":939359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.34799999999999998,"15min":0.32800000000000001},"min":{"1min":0.20799999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.55200000000000005,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.41999999999999998,"15min":0.39100000000000001},"min":{"1min":0.26800000000000002,"5min":0.23000000000000001,"15min":0.22700000000000001},"max":{"1min":0.61099999999999999,"5min":4.4820000000000002,"15min":4.4820000000000002},"last":0.29899999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.32100000000000001,"15min":0.315},"min":{"1min":0.22800000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.48199999999999998,"5min":0.54000000000000004,"15min":0.65400000000000003},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.36499999999999999,"15min":0.35799999999999998},"min":{"1min":0.28899999999999998,"5min":0.254,"15min":0.188},"max":{"1min":0.52300000000000002,"5min":0.53600000000000003,"15min":1.196},"last":0.314}]},{"osd":2,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.39900000000000002,"15min":0.38200000000000001},"min":{"1min":0.25,"5min":0.245,"15min":0.19600000000000001},"max":{"1min":0.52100000000000002,"5min":4.601,"15min":4.601},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.44400000000000001,"15min":0.41999999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.26100000000000001},"max":{"1min":0.60599999999999998,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.35499999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55300000000000005,"15min":0.54700000000000004},"min":{"1min":0.38800000000000001,"5min":0.32100000000000001,"15min":0.311},"max":{"1min":0.76500000000000001,"5min":0.88500000000000001,"15min":1.694},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55500000000000005,"15min":0.54200000000000004},"min":{"1min":0.438,"5min":0.32600000000000001,"15min":0.30199999999999999},"max":{"1min":0.71699999999999997,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.57899999999999996}]},{"osd":5,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.55800000000000005,"15min":0.54100000000000004},"min":{"1min":0.42199999999999999,"5min":0.34100000000000003,"15min":0.29399999999999998},"max":{"1min":0.83999999999999997,"5min":0.86399999999999999,"15min":0.878},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.56200000000000006,"15min":0.55600000000000005},"min":{"1min":0.40899999999999997,"5min":0.35699999999999998,"15min":0.29699999999999999},"max":{"1min":0.877,"5min":0.877,"15min":1.165},"last":0.498}]},{"osd":6,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.59499999999999997,"15min":0.58099999999999996},"min":{"1min":0.501,"5min":0.372,"15min":0.36699999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":1.1359999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.58999999999999997,"15min":0.58699999999999997},"min":{"1min":0.45500000000000002,"5min":0.36799999999999999,"15min":0.34399999999999997},"max":{"1min":0.80600000000000005,"5min":0.82999999999999996,"15min":1.7470000000000001},"last":0.54500000000000004}]},{"osd":7,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.57499999999999996,"15min":0.57599999999999996},"min":{"1min":0.41599999999999998,"5min":0.38900000000000001,"15min":0.35599999999999998},"max":{"1min":0.79300000000000004,"5min":0.89900000000000002,"15min":1.657},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.58699999999999997,"15min":0.57599999999999996},"min":{"1min":0.46300000000000002,"5min":0.38,"15min":0.35499999999999998},"max":{"1min":0.86199999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.55100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834575005,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307500,"kb_used_data":2020,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064340,"statfs":{"total":96636764160,"available":96321884160,"internally_reserved":0,"allocated":2068480,"data_stored":948923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.47899999999999998,"15min":0.50700000000000001},"min":{"1min":0.24199999999999999,"5min":0.216,"15min":0.19500000000000001},"max":{"1min":0.68700000000000006,"5min":0.82099999999999995,"15min":2.6619999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.499,"15min":0.49399999999999999},"min":{"1min":0.28899999999999998,"5min":0.224,"15min":0.215},"max":{"1min":0.76200000000000001,"5min":0.81499999999999995,"15min":0.91200000000000003},"last":0.42599999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.50700000000000001,"15min":0.53000000000000003},"min":{"1min":0.308,"5min":0.27300000000000002,"15min":0.23300000000000001},"max":{"1min":0.77300000000000002,"5min":1,"15min":2.8650000000000002},"last":0.499},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.505,"15min":0.53500000000000003},"min":{"1min":0.35299999999999998,"5min":0.27000000000000002,"15min":0.25800000000000001},"max":{"1min":0.79800000000000004,"5min":1.2869999999999999,"15min":2.7610000000000001},"last":0.66700000000000004}]},{"osd":2,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.52900000000000003,"15min":0.53000000000000003},"min":{"1min":0.44500000000000001,"5min":0.28499999999999998,"15min":0.23100000000000001},"max":{"1min":0.70399999999999996,"5min":0.77400000000000002,"15min":1.6910000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56699999999999995,"15min":0.57699999999999996},"min":{"1min":0.44800000000000001,"5min":0.33100000000000002,"15min":0.30599999999999999},"max":{"1min":0.82099999999999995,"5min":0.82799999999999996,"15min":1.718},"last":0.64300000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.57399999999999995,"15min":0.57799999999999996},"min":{"1min":0.38800000000000001,"5min":0.32000000000000001,"15min":0.26700000000000002},"max":{"1min":0.67500000000000004,"5min":2.387,"15min":2.677},"last":0.629},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.54600000000000004,"15min":0.52800000000000002},"min":{"1min":0.40100000000000002,"5min":0.29299999999999998,"15min":0.27500000000000002},"max":{"1min":0.77700000000000002,"5min":1.784,"15min":1.784},"last":0.57699999999999996}]},{"osd":5,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47799999999999998,"15min":0.47999999999999998},"min":{"1min":0.36499999999999999,"5min":0.28499999999999998,"15min":0.23200000000000001},"max":{"1min":0.60299999999999998,"5min":0.73199999999999998,"15min":0.80200000000000005},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.51700000000000002,"15min":0.52300000000000002},"min":{"1min":0.317,"5min":0.28899999999999998,"15min":0.28399999999999997},"max":{"1min":0.752,"5min":0.752,"15min":0.82799999999999996},"last":0.55600000000000005}]},{"osd":6,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.252},"max":{"1min":0.79500000000000004,"5min":0.83499999999999996,"15min":0.89000000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54500000000000004,"15min":0.55400000000000005},"min":{"1min":0.38700000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.72899999999999998,"5min":0.80200000000000005,"15min":1.165},"last":0.52500000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55300000000000005,"15min":0.55700000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.71199999999999997,"5min":0.84999999999999998,"15min":0.90500000000000003},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58499999999999996,"15min":0.58899999999999997},"min":{"1min":0.34399999999999997,"5min":0.318,"15min":0.317},"max":{"1min":0.81299999999999994,"5min":0.875,"15min":0.95499999999999996},"last":0.69399999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575007,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311556,"kb_used_data":1980,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060284,"statfs":{"total":96636764160,"available":96317730816,"internally_reserved":0,"allocated":2027520,"data_stored":933596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.48199999999999998,"15min":0.55900000000000005},"min":{"1min":0.32800000000000001,"5min":0.23300000000000001,"15min":0.20499999999999999},"max":{"1min":0.752,"5min":0.752,"15min":5.0490000000000004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.47799999999999998,"15min":0.54100000000000004},"min":{"1min":0.34699999999999998,"5min":0.253,"15min":0.22900000000000001},"max":{"1min":0.626,"5min":0.71299999999999997,"15min":5.1449999999999996},"last":0.59899999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.48099999999999998,"15min":0.48499999999999999},"min":{"1min":0.34699999999999998,"5min":0.25700000000000001,"15min":0.25},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.97199999999999998},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.502,"15min":0.51000000000000001},"min":{"1min":0.373,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.73599999999999999,"5min":0.74099999999999999,"15min":1.8799999999999999},"last":0.436}]},{"osd":2,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.52600000000000002,"15min":0.54700000000000004},"min":{"1min":0.42999999999999999,"5min":0.30099999999999999,"15min":0.28299999999999997},"max":{"1min":0.73399999999999999,"5min":0.76600000000000001,"15min":4.234},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.55800000000000005,"15min":0.56100000000000005},"min":{"1min":0.41699999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.78700000000000003,"5min":0.79200000000000004,"15min":1.0369999999999999},"last":0.46899999999999997}]},{"osd":3,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.497,"15min":0.57499999999999996},"min":{"1min":0.39700000000000002,"5min":0.29499999999999998,"15min":0.27700000000000002},"max":{"1min":0.67400000000000004,"5min":0.72799999999999998,"15min":5.2169999999999996},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.52600000000000002,"15min":0.53800000000000003},"min":{"1min":0.42599999999999999,"5min":0.29999999999999999,"15min":0.29699999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":1.008},"last":0.61299999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.47999999999999998,"15min":0.5},"min":{"1min":0.36399999999999999,"5min":0.25600000000000001,"15min":0.23999999999999999},"max":{"1min":0.61699999999999999,"5min":0.83399999999999996,"15min":1.917},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.495,"15min":0.51100000000000001},"min":{"1min":0.38200000000000001,"5min":0.251,"15min":0.23899999999999999},"max":{"1min":0.64900000000000002,"5min":0.69199999999999995,"15min":0.87},"last":0.64600000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51000000000000001,"15min":0.53700000000000003},"min":{"1min":0.41099999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63700000000000001,"5min":0.76800000000000002,"15min":2.0139999999999998},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57399999999999995,"15min":0.59099999999999997},"min":{"1min":0.46200000000000002,"5min":0.30299999999999999,"15min":0.29999999999999999},"max":{"1min":0.68600000000000005,"5min":0.80800000000000005,"15min":1.9470000000000001},"last":0.628}]},{"osd":7,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53300000000000003,"15min":0.55900000000000005},"min":{"1min":0.42099999999999999,"5min":0.28799999999999998,"15min":0.27700000000000002},"max":{"1min":0.628,"5min":0.81000000000000005,"15min":0.96499999999999997},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57199999999999995,"15min":0.59099999999999997},"min":{"1min":0.46800000000000003,"5min":0.29199999999999998,"15min":0.28799999999999998},"max":{"1min":0.69199999999999995,"5min":0.77300000000000002,"15min":1.4119999999999999},"last":0.65800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:18:30.312 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T11:18:30.312 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T11:18:30.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.464+0000 7f142ed4e700 1 Processor -- start 2023-10-06T11:18:30.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.464+0000 7f142ed4e700 1 -- start start 2023-10-06T11:18:30.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.465+0000 7f142ed4e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f142815a9c0 0x7f14280cd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:30.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.465+0000 7f142ed4e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1428069100 0x7f1428069580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:30.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.465+0000 7f142ed4e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1428068c70 con 0x7f14280ccfb0 2023-10-06T11:18:30.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.465+0000 7f142ed4e700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14280cc2a0 con 0x7f142815a9c0 2023-10-06T11:18:30.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.465+0000 7f142ed4e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14281578e0 con 0x7f1428069100 2023-10-06T11:18:30.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.465+0000 7f142caea700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f14280ccfb0 0x7f14280cb800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55402/0 (socket says 172.21.15.146:55402) 2023-10-06T11:18:30.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.465+0000 7f142caea700 1 -- 172.21.15.146:0/2639204378 learned_addr learned my addr 172.21.15.146:0/2639204378 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:30.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.465+0000 7f141ffff700 1 --2- 172.21.15.146:0/2639204378 >> v2:172.21.15.151:3300/0 conn(0x7f142815a9c0 0x7f14280cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:30.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.465+0000 7f142d2eb700 1 --2- 172.21.15.146:0/2639204378 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1428069100 0x7f1428069580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:30.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.466+0000 7f141f7fe700 1 -- 172.21.15.146:0/2639204378 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1493824163 0 0) 0x7f1428068c70 con 0x7f14280ccfb0 2023-10-06T11:18:30.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.466+0000 7f141f7fe700 1 -- 172.21.15.146:0/2639204378 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1410003570 con 0x7f14280ccfb0 2023-10-06T11:18:30.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.466+0000 7f141f7fe700 1 -- 172.21.15.146:0/2639204378 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3526141225 0 0) 0x7f1410003570 con 0x7f14280ccfb0 2023-10-06T11:18:30.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.466+0000 7f141f7fe700 1 -- 172.21.15.146:0/2639204378 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1428069100 msgr2=0x7f1428069580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:30.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.466+0000 7f141f7fe700 1 --2- 172.21.15.146:0/2639204378 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1428069100 0x7f1428069580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:30.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.466+0000 7f141f7fe700 1 -- 172.21.15.146:0/2639204378 >> v2:172.21.15.151:3300/0 conn(0x7f142815a9c0 msgr2=0x7f14280cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:30.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.466+0000 7f141f7fe700 1 --2- 172.21.15.146:0/2639204378 >> v2:172.21.15.151:3300/0 conn(0x7f142815a9c0 0x7f14280cd380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:30.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.466+0000 7f141f7fe700 1 -- 172.21.15.146:0/2639204378 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f142815ae60 con 0x7f14280ccfb0 2023-10-06T11:18:30.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.466+0000 7f141f7fe700 1 -- 172.21.15.146:0/2639204378 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f14240015f0 con 0x7f14280ccfb0 2023-10-06T11:18:30.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.466+0000 7f141f7fe700 1 -- 172.21.15.146:0/2639204378 >> v1:172.21.15.146:6789/0 conn(0x7f14280ccfb0 legacy=0x7f14280cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:30.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.466+0000 7f141f7fe700 1 --2- 172.21.15.146:0/2639204378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1410003a60 0x7f1410003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:30.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.466+0000 7f141f7fe700 1 --2- 172.21.15.146:0/2639204378 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1428069100 0x7f1410004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:30.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.466+0000 7f141f7fe700 1 --2- 172.21.15.146:0/2639204378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1410004d50 0x7f14100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:30.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.466+0000 7f141f7fe700 1 -- 172.21.15.146:0/2639204378 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14280cc2a0 con 0x7f1410004d50 2023-10-06T11:18:30.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.466+0000 7f141f7fe700 1 -- 172.21.15.146:0/2639204378 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14281578e0 con 0x7f1410003a60 2023-10-06T11:18:30.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.466+0000 7f141f7fe700 1 -- 172.21.15.146:0/2639204378 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f141000ba60 con 0x7f1428069100 2023-10-06T11:18:30.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.466+0000 7f142d2eb700 1 --2- 172.21.15.146:0/2639204378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1410004d50 0x7f14100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:30.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.466+0000 7f142caea700 1 --2- 172.21.15.146:0/2639204378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1410003a60 0x7f1410003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:30.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.466+0000 7f141ffff700 1 --2- 172.21.15.146:0/2639204378 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1428069100 0x7f1410004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:30.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.466+0000 7f142d2eb700 1 -- 172.21.15.146:0/2639204378 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1428069100 msgr2=0x7f1410004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:30.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.466+0000 7f142d2eb700 1 --2- 172.21.15.146:0/2639204378 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1428069100 0x7f1410004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:30.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.466+0000 7f142d2eb700 1 -- 172.21.15.146:0/2639204378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1410003a60 msgr2=0x7f1410003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:30.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.466+0000 7f142d2eb700 1 --2- 172.21.15.146:0/2639204378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1410003a60 0x7f1410003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:30.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.466+0000 7f142d2eb700 1 -- 172.21.15.146:0/2639204378 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1410003570 con 0x7f1410004d50 2023-10-06T11:18:30.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.466+0000 7f142d2eb700 1 --2- 172.21.15.146:0/2639204378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1410004d50 0x7f14100051c0 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 crypto rx=0x7f142000e210 tx=0x7f142000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd8f07403c118de6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:30.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.467+0000 7f141f7fe700 1 -- 172.21.15.146:0/2639204378 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142000ea60 con 0x7f1410004d50 2023-10-06T11:18:30.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.467+0000 7f141f7fe700 1 -- 172.21.15.146:0/2639204378 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142000f040 con 0x7f1410004d50 2023-10-06T11:18:30.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.467+0000 7f141f7fe700 1 -- 172.21.15.146:0/2639204378 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142000ee10 con 0x7f1410004d50 2023-10-06T11:18:30.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.467+0000 7f142ed4e700 1 -- 172.21.15.146:0/2639204378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1410004d50 msgr2=0x7f14100051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:30.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.467+0000 7f142ed4e700 1 --2- 172.21.15.146:0/2639204378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1410004d50 0x7f14100051c0 secure :-1 s=READY pgs=2112 cs=0 l=1 rev1=1 crypto rx=0x7f142000e210 tx=0x7f142000b040 comp rx=0 tx=0).stop 2023-10-06T11:18:30.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.467+0000 7f142d2eb700 1 -- 172.21.15.146:0/2639204378 reap_dead start 2023-10-06T11:18:30.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.467+0000 7f142ed4e700 1 -- 172.21.15.146:0/2639204378 shutdown_connections 2023-10-06T11:18:30.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.467+0000 7f142ed4e700 1 -- 172.21.15.146:0/2639204378 >> 172.21.15.146:0/2639204378 conn(0x7f1428087ff0 msgr2=0x7f14280998f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:30.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.467+0000 7f142ed4e700 1 -- 172.21.15.146:0/2639204378 shutdown_connections 2023-10-06T11:18:30.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.467+0000 7f142ed4e700 1 -- 172.21.15.146:0/2639204378 wait complete. 2023-10-06T11:18:30.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.468+0000 7f142ed4e700 1 Processor -- start 2023-10-06T11:18:30.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.468+0000 7f142ed4e700 1 -- start start 2023-10-06T11:18:30.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.469+0000 7f142ed4e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f142816a050 0x7f14280c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:30.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.469+0000 7f142ed4e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14280c7df0 0x7f142816a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:30.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.469+0000 7f142ed4e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f142816a960 0x7f142816bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:30.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.469+0000 7f142ed4e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14280ca3a0 con 0x7f14280c7df0 2023-10-06T11:18:30.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.469+0000 7f142ed4e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14280c8af0 con 0x7f142816a960 2023-10-06T11:18:30.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.469+0000 7f142ed4e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f142816b1b0 con 0x7f142816a050 2023-10-06T11:18:30.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.469+0000 7f141ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14280c7df0 0x7f142816a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:30.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.469+0000 7f141ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14280c7df0 0x7f142816a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57018/0 (socket says 172.21.15.146:57018) 2023-10-06T11:18:30.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.469+0000 7f141ffff700 1 -- 172.21.15.146:0/140818499 learned_addr learned my addr 172.21.15.146:0/140818499 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:30.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.469+0000 7f142d2eb700 1 --2- 172.21.15.146:0/140818499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f142816a960 0x7f142816bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:30.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.469+0000 7f142caea700 1 --2- 172.21.15.146:0/140818499 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f142816a050 0x7f14280c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:30.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.469+0000 7f141ffff700 1 -- 172.21.15.146:0/140818499 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f142816a050 msgr2=0x7f14280c78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:30.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.469+0000 7f141ffff700 1 --2- 172.21.15.146:0/140818499 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f142816a050 0x7f14280c78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:30.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.469+0000 7f141ffff700 1 -- 172.21.15.146:0/140818499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f142816a960 msgr2=0x7f142816bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:30.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.469+0000 7f141ffff700 1 --2- 172.21.15.146:0/140818499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f142816a960 0x7f142816bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:30.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.469+0000 7f141ffff700 1 -- 172.21.15.146:0/140818499 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f142816b730 con 0x7f14280c7df0 2023-10-06T11:18:30.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.469+0000 7f142d2eb700 1 --2- 172.21.15.146:0/140818499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f142816a960 0x7f142816bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:18:30.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.470+0000 7f141ffff700 1 --2- 172.21.15.146:0/140818499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14280c7df0 0x7f142816a420 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 crypto rx=0x7f1418011a40 tx=0x7f1418009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:30.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.470+0000 7f141cff9700 1 -- 172.21.15.146:0/140818499 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1418005c10 con 0x7f14280c7df0 2023-10-06T11:18:30.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.470+0000 7f141cff9700 1 -- 172.21.15.146:0/140818499 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1418005d70 con 0x7f14280c7df0 2023-10-06T11:18:30.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.470+0000 7f142ed4e700 1 -- 172.21.15.146:0/140818499 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14280c8260 con 0x7f14280c7df0 2023-10-06T11:18:30.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.470+0000 7f141cff9700 1 -- 172.21.15.146:0/140818499 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141800f960 con 0x7f14280c7df0 2023-10-06T11:18:30.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.470+0000 7f142ed4e700 1 -- 172.21.15.146:0/140818499 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14280c85e0 con 0x7f14280c7df0 2023-10-06T11:18:30.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.471+0000 7f142ed4e700 1 -- 172.21.15.146:0/140818499 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f142816b8c0 con 0x7f14280c7df0 2023-10-06T11:18:30.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.471+0000 7f141cff9700 1 -- 172.21.15.146:0/140818499 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f141800fd90 con 0x7f14280c7df0 2023-10-06T11:18:30.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.472+0000 7f141cff9700 1 --2- 172.21.15.146:0/140818499 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1414066f30 0x7f14140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:30.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.472+0000 7f142caea700 1 --2- 172.21.15.146:0/140818499 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1414066f30 0x7f14140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:30.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.472+0000 7f141cff9700 1 -- 172.21.15.146:0/140818499 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1418084ff0 con 0x7f14280c7df0 2023-10-06T11:18:30.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.472+0000 7f142caea700 1 --2- 172.21.15.146:0/140818499 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1414066f30 0x7f14140693e0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f1424001150 tx=0x7f1424009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:30.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.476+0000 7f141cff9700 1 -- 172.21.15.146:0/140818499 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1418052100 con 0x7f14280c7df0 2023-10-06T11:18:30.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.733+0000 7f142ed4e700 1 -- 172.21.15.146:0/140818499 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f142804c380 con 0x7f14280c7df0 2023-10-06T11:18:30.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.736+0000 7f141cff9700 1 -- 172.21.15.146:0/140818499 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v25) v1 ==== 190+0+0 (secure 0 0 0) 0x7f1418055720 con 0x7f14280c7df0 2023-10-06T11:18:30.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.738+0000 7f142ed4e700 1 -- 172.21.15.146:0/140818499 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1414066f30 msgr2=0x7f14140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:30.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.738+0000 7f142ed4e700 1 --2- 172.21.15.146:0/140818499 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1414066f30 0x7f14140693e0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f1424001150 tx=0x7f1424009040 comp rx=0 tx=0).stop 2023-10-06T11:18:30.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.738+0000 7f142ed4e700 1 -- 172.21.15.146:0/140818499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14280c7df0 msgr2=0x7f142816a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:30.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.738+0000 7f142ed4e700 1 --2- 172.21.15.146:0/140818499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14280c7df0 0x7f142816a420 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 crypto rx=0x7f1418011a40 tx=0x7f1418009120 comp rx=0 tx=0).stop 2023-10-06T11:18:30.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.739+0000 7f142ed4e700 1 -- 172.21.15.146:0/140818499 shutdown_connections 2023-10-06T11:18:30.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.739+0000 7f142ed4e700 1 --2- 172.21.15.146:0/140818499 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1414066f30 0x7f14140693e0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:30.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.739+0000 7f142ed4e700 1 --2- 172.21.15.146:0/140818499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f142816a960 0x7f142816bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:30.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.739+0000 7f142ed4e700 1 --2- 172.21.15.146:0/140818499 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f142816a050 0x7f14280c78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:30.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.739+0000 7f142ed4e700 1 --2- 172.21.15.146:0/140818499 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f14280c7df0 0x7f142816a420 unknown :-1 s=CLOSED pgs=2113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:30.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.739+0000 7f142ed4e700 1 -- 172.21.15.146:0/140818499 >> 172.21.15.146:0/140818499 conn(0x7f1428087ff0 msgr2=0x7f1428159370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:30.741 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.739+0000 7f142ed4e700 1 -- 172.21.15.146:0/140818499 shutdown_connections 2023-10-06T11:18:30.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.739+0000 7f142ed4e700 1 -- 172.21.15.146:0/140818499 wait complete. 2023-10-06T11:18:30.742 INFO:teuthology.orchestra.run.smithi146.stderr:updated caps for client.0 2023-10-06T11:18:30.753 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:18:30.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.865+0000 7f7eeeabc700 1 Processor -- start 2023-10-06T11:18:30.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.865+0000 7f7eeeabc700 1 -- start start 2023-10-06T11:18:30.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.866+0000 7f7eeeabc700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7ee81538c0 0x7f7ee8153c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:30.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.866+0000 7f7eeeabc700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ee815dcc0 0x7f7ee80ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:30.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.866+0000 7f7eeeabc700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee815d270 con 0x7f7ee815a940 2023-10-06T11:18:30.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.866+0000 7f7eeeabc700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ee815d830 con 0x7f7ee81538c0 2023-10-06T11:18:30.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.866+0000 7f7eeeabc700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee815e110 con 0x7f7ee815dcc0 2023-10-06T11:18:30.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.866+0000 7f7edffff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7ee815a940 0x7f7ee80cac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:55412/0 (socket says 172.21.15.146:55412) 2023-10-06T11:18:30.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.866+0000 7f7edffff700 1 -- 172.21.15.146:0/3794588804 learned_addr learned my addr 172.21.15.146:0/3794588804 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:30.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.866+0000 7f7eed059700 1 --2- 172.21.15.146:0/3794588804 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ee815dcc0 0x7f7ee80ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:30.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.866+0000 7f7eec858700 1 --2- 172.21.15.146:0/3794588804 >> v2:172.21.15.151:3300/0 conn(0x7f7ee81538c0 0x7f7ee8153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:30.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.867+0000 7f7edf7fe700 1 -- 172.21.15.146:0/3794588804 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 779975137 0 0) 0x7f7ee815d270 con 0x7f7ee815a940 2023-10-06T11:18:30.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.867+0000 7f7edf7fe700 1 -- 172.21.15.146:0/3794588804 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ed0003570 con 0x7f7ee815a940 2023-10-06T11:18:30.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.867+0000 7f7edf7fe700 1 -- 172.21.15.146:0/3794588804 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2981854136 0 0) 0x7f7ed0003570 con 0x7f7ee815a940 2023-10-06T11:18:30.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.867+0000 7f7edf7fe700 1 -- 172.21.15.146:0/3794588804 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ee815dcc0 msgr2=0x7f7ee80ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:30.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.867+0000 7f7edf7fe700 1 --2- 172.21.15.146:0/3794588804 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ee815dcc0 0x7f7ee80ce610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:30.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.867+0000 7f7edf7fe700 1 -- 172.21.15.146:0/3794588804 >> v2:172.21.15.151:3300/0 conn(0x7f7ee81538c0 msgr2=0x7f7ee8153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:30.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.867+0000 7f7edf7fe700 1 --2- 172.21.15.146:0/3794588804 >> v2:172.21.15.151:3300/0 conn(0x7f7ee81538c0 0x7f7ee8153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:30.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.867+0000 7f7edf7fe700 1 -- 172.21.15.146:0/3794588804 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee80cb810 con 0x7f7ee815a940 2023-10-06T11:18:30.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.867+0000 7f7edf7fe700 1 -- 172.21.15.146:0/3794588804 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f7ed8001470 con 0x7f7ee815a940 2023-10-06T11:18:30.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.867+0000 7f7eed059700 1 --2- 172.21.15.146:0/3794588804 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ee815dcc0 0x7f7ee80ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:18:30.879 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.867+0000 7f7edf7fe700 1 -- 172.21.15.146:0/3794588804 >> v1:172.21.15.146:6789/0 conn(0x7f7ee815a940 legacy=0x7f7ee80cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:30.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.867+0000 7f7edf7fe700 1 --2- 172.21.15.146:0/3794588804 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ed0003a60 0x7f7ed0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:30.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.867+0000 7f7edf7fe700 1 --2- 172.21.15.146:0/3794588804 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ee815dcc0 0x7f7ed0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:30.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.867+0000 7f7edf7fe700 1 --2- 172.21.15.146:0/3794588804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ed0004d50 0x7f7ed00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:30.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.867+0000 7f7edf7fe700 1 -- 172.21.15.146:0/3794588804 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee815d830 con 0x7f7ed0004d50 2023-10-06T11:18:30.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.867+0000 7f7edf7fe700 1 -- 172.21.15.146:0/3794588804 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee815e110 con 0x7f7ed0003a60 2023-10-06T11:18:30.880 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.867+0000 7f7edf7fe700 1 -- 172.21.15.146:0/3794588804 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed000ba60 con 0x7f7ee815dcc0 2023-10-06T11:18:30.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.867+0000 7f7eec858700 1 --2- 172.21.15.146:0/3794588804 >> v2:172.21.15.151:3300/0 conn(0x7f7ee81538c0 0x7f7ee8153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:18:30.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.867+0000 7f7eed059700 1 --2- 172.21.15.146:0/3794588804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ed0004d50 0x7f7ed00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:30.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.867+0000 7f7edffff700 1 --2- 172.21.15.146:0/3794588804 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ee815dcc0 0x7f7ed0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:30.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.867+0000 7f7eec858700 1 --2- 172.21.15.146:0/3794588804 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ed0003a60 0x7f7ed0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:30.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.867+0000 7f7eed059700 1 -- 172.21.15.146:0/3794588804 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ee815dcc0 msgr2=0x7f7ed0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:30.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.867+0000 7f7eed059700 1 --2- 172.21.15.146:0/3794588804 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ee815dcc0 0x7f7ed0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:30.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.867+0000 7f7eed059700 1 -- 172.21.15.146:0/3794588804 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ed0003a60 msgr2=0x7f7ed0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:30.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.867+0000 7f7eed059700 1 --2- 172.21.15.146:0/3794588804 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ed0003a60 0x7f7ed0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:30.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.867+0000 7f7eed059700 1 -- 172.21.15.146:0/3794588804 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee0009420 con 0x7f7ed0004d50 2023-10-06T11:18:30.881 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.867+0000 7f7eec858700 1 --2- 172.21.15.146:0/3794588804 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ed0003a60 0x7f7ed0003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:18:30.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.868+0000 7f7eed059700 1 --2- 172.21.15.146:0/3794588804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ed0004d50 0x7f7ed00051c0 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0009e20 tx=0x7f7ee00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1b3a0e44945399d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:30.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.868+0000 7f7edf7fe700 1 -- 172.21.15.146:0/3794588804 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee0009740 con 0x7f7ed0004d50 2023-10-06T11:18:30.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.868+0000 7f7edf7fe700 1 -- 172.21.15.146:0/3794588804 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee000e8c0 con 0x7f7ed0004d50 2023-10-06T11:18:30.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.868+0000 7f7edf7fe700 1 -- 172.21.15.146:0/3794588804 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee000ec80 con 0x7f7ed0004d50 2023-10-06T11:18:30.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.868+0000 7f7eeeabc700 1 -- 172.21.15.146:0/3794588804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ed0004d50 msgr2=0x7f7ed00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:30.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.868+0000 7f7eeeabc700 1 --2- 172.21.15.146:0/3794588804 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ed0004d50 0x7f7ed00051c0 secure :-1 s=READY pgs=2115 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0009e20 tx=0x7f7ee00091a0 comp rx=0 tx=0).stop 2023-10-06T11:18:30.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.868+0000 7f7eed059700 1 -- 172.21.15.146:0/3794588804 reap_dead start 2023-10-06T11:18:30.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.868+0000 7f7eeeabc700 1 -- 172.21.15.146:0/3794588804 shutdown_connections 2023-10-06T11:18:30.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.868+0000 7f7eeeabc700 1 -- 172.21.15.146:0/3794588804 >> 172.21.15.146:0/3794588804 conn(0x7f7ee806eb10 msgr2=0x7f7ee806ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:30.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.868+0000 7f7eeeabc700 1 -- 172.21.15.146:0/3794588804 shutdown_connections 2023-10-06T11:18:30.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.868+0000 7f7eeeabc700 1 -- 172.21.15.146:0/3794588804 wait complete. 2023-10-06T11:18:30.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.869+0000 7f7eeeabc700 1 Processor -- start 2023-10-06T11:18:30.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.869+0000 7f7eeeabc700 1 -- start start 2023-10-06T11:18:30.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.870+0000 7f7eeeabc700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ee814bdf0 0x7f7ee815c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:30.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.870+0000 7f7eeeabc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ee816d9e0 0x7f7ee81513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:30.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.870+0000 7f7eeeabc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ee8151930 0x7f7ee8169a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:30.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.870+0000 7f7eeeabc700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee815ada0 con 0x7f7ee8151930 2023-10-06T11:18:30.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.870+0000 7f7eeeabc700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee8151db0 con 0x7f7ee816d9e0 2023-10-06T11:18:30.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.870+0000 7f7eeeabc700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee815b8e0 con 0x7f7ee814bdf0 2023-10-06T11:18:30.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.870+0000 7f7eed059700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ee8151930 0x7f7ee8169a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:30.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.870+0000 7f7eed059700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ee8151930 0x7f7ee8169a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57024/0 (socket says 172.21.15.146:57024) 2023-10-06T11:18:30.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.870+0000 7f7eed059700 1 -- 172.21.15.146:0/1143378803 learned_addr learned my addr 172.21.15.146:0/1143378803 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:30.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.870+0000 7f7edffff700 1 --2- 172.21.15.146:0/1143378803 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ee816d9e0 0x7f7ee81513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:30.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.870+0000 7f7eec858700 1 --2- 172.21.15.146:0/1143378803 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ee814bdf0 0x7f7ee815c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:30.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.871+0000 7f7eed059700 1 -- 172.21.15.146:0/1143378803 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ee814bdf0 msgr2=0x7f7ee815c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:30.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.871+0000 7f7eed059700 1 --2- 172.21.15.146:0/1143378803 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ee814bdf0 0x7f7ee815c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:30.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.871+0000 7f7eed059700 1 -- 172.21.15.146:0/1143378803 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ee816d9e0 msgr2=0x7f7ee81513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:30.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.871+0000 7f7eed059700 1 --2- 172.21.15.146:0/1143378803 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ee816d9e0 0x7f7ee81513f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:30.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.871+0000 7f7eed059700 1 -- 172.21.15.146:0/1143378803 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee814c930 con 0x7f7ee8151930 2023-10-06T11:18:30.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.871+0000 7f7eed059700 1 --2- 172.21.15.146:0/1143378803 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ee8151930 0x7f7ee8169a50 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0004720 tx=0x7f7ee001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:30.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.871+0000 7f7edcff9700 1 -- 172.21.15.146:0/1143378803 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee0022070 con 0x7f7ee8151930 2023-10-06T11:18:30.886 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.871+0000 7f7edcff9700 1 -- 172.21.15.146:0/1143378803 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee000ec40 con 0x7f7ee8151930 2023-10-06T11:18:30.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.871+0000 7f7eeeabc700 1 -- 172.21.15.146:0/1143378803 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee815afb0 con 0x7f7ee8151930 2023-10-06T11:18:30.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.871+0000 7f7edcff9700 1 -- 172.21.15.146:0/1143378803 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee0027670 con 0x7f7ee8151930 2023-10-06T11:18:30.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.871+0000 7f7eeeabc700 1 -- 172.21.15.146:0/1143378803 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ee815b570 con 0x7f7ee8151930 2023-10-06T11:18:30.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.872+0000 7f7eeeabc700 1 -- 172.21.15.146:0/1143378803 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ee815ba90 con 0x7f7ee8151930 2023-10-06T11:18:30.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.872+0000 7f7edcff9700 1 -- 172.21.15.146:0/1143378803 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7ee0027aa0 con 0x7f7ee8151930 2023-10-06T11:18:30.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.873+0000 7f7edcff9700 1 --2- 172.21.15.146:0/1143378803 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7ed4066f30 0x7f7ed40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:30.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.873+0000 7f7edcff9700 1 -- 172.21.15.146:0/1143378803 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7ee0000e40 con 0x7f7ee8151930 2023-10-06T11:18:30.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.873+0000 7f7eec858700 1 --2- 172.21.15.146:0/1143378803 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7ed4066f30 0x7f7ed40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:30.888 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.873+0000 7f7eec858700 1 --2- 172.21.15.146:0/1143378803 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7ed4066f30 0x7f7ed40693e0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f7ee40099f0 tx=0x7f7ee400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:30.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:30.877+0000 7f7edcff9700 1 -- 172.21.15.146:0/1143378803 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7ee815ba90 con 0x7f7ee8151930 2023-10-06T11:18:31.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.104+0000 7f7eeeabc700 1 -- 172.21.15.146:0/1143378803 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ee815ba50 con 0x7f7ee8151930 2023-10-06T11:18:31.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.105+0000 7f7edcff9700 1 -- 172.21.15.146:0/1143378803 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 136 v136) v1 ==== 95+0+4620 (secure 0 0 0) 0x7f7ee0017020 con 0x7f7ee8151930 2023-10-06T11:18:31.107 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:18:31.107 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":136,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7694,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3150776091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3150776091},{"type":"v1","addr":"172.21.15.151:6834","nonce":3150776091}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":131},{"gid":8836,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/731448405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":731448405},{"type":"v1","addr":"172.21.15.151:6835","nonce":731448405}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":131},{"gid":10077,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2392749618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2392749618},{"type":"v1","addr":"172.21.15.146:6836","nonce":2392749618}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":131}],"filesystems":[{"mdsmap":{"epoch":136,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:18:25.258682+0000","modified":"2023-10-06T11:18:28.884125+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10080},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10080":{"gid":10080,"name":"a","rank":0,"incarnation":132,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/1340411581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":1340411581},{"type":"v1","addr":"172.21.15.146:6837","nonce":1340411581}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-06T11:18:31.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.107+0000 7f7eeeabc700 1 -- 172.21.15.146:0/1143378803 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7ed4066f30 msgr2=0x7f7ed40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:31.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.107+0000 7f7eeeabc700 1 --2- 172.21.15.146:0/1143378803 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7ed4066f30 0x7f7ed40693e0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f7ee40099f0 tx=0x7f7ee400b040 comp rx=0 tx=0).stop 2023-10-06T11:18:31.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.107+0000 7f7eeeabc700 1 -- 172.21.15.146:0/1143378803 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ee8151930 msgr2=0x7f7ee8169a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:31.109 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.107+0000 7f7eeeabc700 1 --2- 172.21.15.146:0/1143378803 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ee8151930 0x7f7ee8169a50 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0004720 tx=0x7f7ee001a000 comp rx=0 tx=0).stop 2023-10-06T11:18:31.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.107+0000 7f7eeeabc700 1 -- 172.21.15.146:0/1143378803 shutdown_connections 2023-10-06T11:18:31.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.107+0000 7f7eeeabc700 1 --2- 172.21.15.146:0/1143378803 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7ed4066f30 0x7f7ed40693e0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:31.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.107+0000 7f7eeeabc700 1 --2- 172.21.15.146:0/1143378803 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7ee8151930 0x7f7ee8169a50 unknown :-1 s=CLOSED pgs=2116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:31.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.107+0000 7f7eeeabc700 1 --2- 172.21.15.146:0/1143378803 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7ee814bdf0 0x7f7ee815c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:31.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.107+0000 7f7eeeabc700 1 --2- 172.21.15.146:0/1143378803 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ee816d9e0 0x7f7ee81513f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:31.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.107+0000 7f7eeeabc700 1 -- 172.21.15.146:0/1143378803 >> 172.21.15.146:0/1143378803 conn(0x7f7ee806eb10 msgr2=0x7f7ee80cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:31.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.107+0000 7f7eeeabc700 1 -- 172.21.15.146:0/1143378803 shutdown_connections 2023-10-06T11:18:31.110 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.107+0000 7f7eeeabc700 1 -- 172.21.15.146:0/1143378803 wait complete. 2023-10-06T11:18:31.110 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 136 2023-10-06T11:18:31.525 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 136, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T11:18:25.258682+0000', 'modified': '2023-10-06T11:18:28.884125+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10080}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10080': {'gid': 10080, 'name': 'a', 'rank': 0, 'incarnation': 132, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.146:6837/1340411581', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6835', 'nonce': 1340411581}, {'type': 'v1', 'addr': '172.21.15.146:6837', 'nonce': 1340411581}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T11:18:31.525 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T11:18:31.525 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-06T11:18:31.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.639+0000 7f557025b700 1 Processor -- start 2023-10-06T11:18:31.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.639+0000 7f557025b700 1 -- start start 2023-10-06T11:18:31.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.640+0000 7f557025b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f556815a940 0x7f5568153c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:31.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.640+0000 7f557025b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f556815e140 con 0x7f55681538c0 2023-10-06T11:18:31.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.640+0000 7f557025b700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f556815d270 con 0x7f556815dcc0 2023-10-06T11:18:31.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.640+0000 7f557025b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f556815d830 con 0x7f556815a940 2023-10-06T11:18:31.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.640+0000 7f556dff7700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f55681538c0 0x7f55680cac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52154/0 (socket says 172.21.15.146:52154) 2023-10-06T11:18:31.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.640+0000 7f556dff7700 1 -- 172.21.15.146:0/670688059 learned_addr learned my addr 172.21.15.146:0/670688059 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:31.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.641+0000 7f556cff5700 1 -- 172.21.15.146:0/670688059 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 366624262 0 0) 0x7f5564001110 con 0x7f55681538c0 2023-10-06T11:18:31.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.641+0000 7f556cff5700 1 -- 172.21.15.146:0/670688059 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5554003570 con 0x7f55681538c0 2023-10-06T11:18:31.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.641+0000 7f556d7f6700 1 --2- 172.21.15.146:0/670688059 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f556815a940 0x7f5568153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:31.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.641+0000 7f556cff5700 1 -- 172.21.15.146:0/670688059 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1482625011 0 0) 0x7f5554003570 con 0x7f55681538c0 2023-10-06T11:18:31.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.641+0000 7f556cff5700 1 -- 172.21.15.146:0/670688059 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f556815a940 msgr2=0x7f5568153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:31.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.641+0000 7f556cff5700 1 --2- 172.21.15.146:0/670688059 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f556815a940 0x7f5568153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:31.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.641+0000 7f556cff5700 1 -- 172.21.15.146:0/670688059 >> v1:172.21.15.151:6789/0 conn(0x7f556815dcc0 legacy=0x7f55680ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:31.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.641+0000 7f556cff5700 1 -- 172.21.15.146:0/670688059 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55680cb810 con 0x7f55681538c0 2023-10-06T11:18:31.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.641+0000 7f556cff5700 1 -- 172.21.15.146:0/670688059 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f5564001600 con 0x7f55681538c0 2023-10-06T11:18:31.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.641+0000 7f556cff5700 1 -- 172.21.15.146:0/670688059 >> v1:172.21.15.146:6789/0 conn(0x7f55681538c0 legacy=0x7f55680cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:31.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.641+0000 7f556cff5700 1 --2- 172.21.15.146:0/670688059 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f556815a940 0x7f5554003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:31.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.641+0000 7f556cff5700 1 --2- 172.21.15.146:0/670688059 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5554004010 0x7f5554004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:31.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.641+0000 7f556cff5700 1 --2- 172.21.15.146:0/670688059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5554004d50 0x7f55540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:31.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.641+0000 7f556cff5700 1 -- 172.21.15.146:0/670688059 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f556815d830 con 0x7f5554004d50 2023-10-06T11:18:31.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.641+0000 7f556cff5700 1 -- 172.21.15.146:0/670688059 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555400bbf0 con 0x7f5554004010 2023-10-06T11:18:31.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.641+0000 7f556cff5700 1 -- 172.21.15.146:0/670688059 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f555400bdb0 con 0x7f556815a940 2023-10-06T11:18:31.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.641+0000 7f556e7f8700 1 --2- 172.21.15.146:0/670688059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5554004d50 0x7f55540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:31.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.641+0000 7f556dff7700 1 --2- 172.21.15.146:0/670688059 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f556815a940 0x7f5554003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:31.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.641+0000 7f556d7f6700 1 --2- 172.21.15.146:0/670688059 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5554004010 0x7f5554004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:31.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.641+0000 7f556e7f8700 1 -- 172.21.15.146:0/670688059 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f556815a940 msgr2=0x7f5554003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:31.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.641+0000 7f556e7f8700 1 --2- 172.21.15.146:0/670688059 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f556815a940 0x7f5554003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:31.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.641+0000 7f556e7f8700 1 -- 172.21.15.146:0/670688059 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5554004010 msgr2=0x7f5554004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:31.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.641+0000 7f556e7f8700 1 --2- 172.21.15.146:0/670688059 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5554004010 0x7f5554004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:31.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.641+0000 7f556e7f8700 1 -- 172.21.15.146:0/670688059 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5554003570 con 0x7f5554004d50 2023-10-06T11:18:31.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.641+0000 7f556e7f8700 1 --2- 172.21.15.146:0/670688059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5554004d50 0x7f55540051c0 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7f5560001f90 tx=0x7f5560001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6072a9398dbf024c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:31.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.642+0000 7f556cff5700 1 -- 172.21.15.146:0/670688059 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5560001950 con 0x7f5554004d50 2023-10-06T11:18:31.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.642+0000 7f556cff5700 1 -- 172.21.15.146:0/670688059 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f556000c8b0 con 0x7f5554004d50 2023-10-06T11:18:31.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.642+0000 7f556cff5700 1 -- 172.21.15.146:0/670688059 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556000cc70 con 0x7f5554004d50 2023-10-06T11:18:31.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.642+0000 7f557025b700 1 -- 172.21.15.146:0/670688059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5554004d50 msgr2=0x7f55540051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:31.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.642+0000 7f557025b700 1 --2- 172.21.15.146:0/670688059 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5554004d50 0x7f55540051c0 secure :-1 s=READY pgs=2118 cs=0 l=1 rev1=1 crypto rx=0x7f5560001f90 tx=0x7f5560001640 comp rx=0 tx=0).stop 2023-10-06T11:18:31.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.642+0000 7f556e7f8700 1 -- 172.21.15.146:0/670688059 reap_dead start 2023-10-06T11:18:31.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.642+0000 7f557025b700 1 -- 172.21.15.146:0/670688059 shutdown_connections 2023-10-06T11:18:31.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.642+0000 7f557025b700 1 -- 172.21.15.146:0/670688059 >> 172.21.15.146:0/670688059 conn(0x7f556806eb10 msgr2=0x7f556806ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:31.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.642+0000 7f557025b700 1 -- 172.21.15.146:0/670688059 shutdown_connections 2023-10-06T11:18:31.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.642+0000 7f557025b700 1 -- 172.21.15.146:0/670688059 wait complete. 2023-10-06T11:18:31.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.643+0000 7f557025b700 1 Processor -- start 2023-10-06T11:18:31.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.643+0000 7f557025b700 1 -- start start 2023-10-06T11:18:31.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.644+0000 7f557025b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5554004d50 0x7f55680c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:31.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.644+0000 7f557025b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55680b0200 0x7f55680b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:31.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.644+0000 7f557025b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55680b17f0 0x7f556816d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:31.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.644+0000 7f557025b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55680b1360 con 0x7f55680b0200 2023-10-06T11:18:31.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.644+0000 7f557025b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55680b0750 con 0x7f55680b17f0 2023-10-06T11:18:31.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.644+0000 7f557025b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55680b0a30 con 0x7f5554004d50 2023-10-06T11:18:31.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.644+0000 7f556d7f6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55680b0200 0x7f55680b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:31.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.644+0000 7f556d7f6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55680b0200 0x7f55680b5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40840/0 (socket says 172.21.15.146:40840) 2023-10-06T11:18:31.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.644+0000 7f556d7f6700 1 -- 172.21.15.146:0/3535274530 learned_addr learned my addr 172.21.15.146:0/3535274530 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:31.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.644+0000 7f556dff7700 1 --2- 172.21.15.146:0/3535274530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5554004d50 0x7f55680c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:31.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.644+0000 7f556e7f8700 1 --2- 172.21.15.146:0/3535274530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55680b17f0 0x7f556816d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:31.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.644+0000 7f556d7f6700 1 -- 172.21.15.146:0/3535274530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5554004d50 msgr2=0x7f55680c9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:31.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.644+0000 7f556d7f6700 1 --2- 172.21.15.146:0/3535274530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5554004d50 0x7f55680c9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:31.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.644+0000 7f556d7f6700 1 -- 172.21.15.146:0/3535274530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55680b17f0 msgr2=0x7f556816d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:31.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.644+0000 7f556d7f6700 1 --2- 172.21.15.146:0/3535274530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55680b17f0 0x7f556816d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:31.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.644+0000 7f556d7f6700 1 -- 172.21.15.146:0/3535274530 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55680b0d10 con 0x7f55680b0200 2023-10-06T11:18:31.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.644+0000 7f556e7f8700 1 --2- 172.21.15.146:0/3535274530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55680b17f0 0x7f556816d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:18:31.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.645+0000 7f556d7f6700 1 --2- 172.21.15.146:0/3535274530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55680b0200 0x7f55680b5d30 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 crypto rx=0x7f5558006ac0 tx=0x7f55580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:31.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.645+0000 7f555dffb700 1 -- 172.21.15.146:0/3535274530 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555800fa10 con 0x7f55680b0200 2023-10-06T11:18:31.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.645+0000 7f555dffb700 1 -- 172.21.15.146:0/3535274530 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f555800fb70 con 0x7f55680b0200 2023-10-06T11:18:31.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.645+0000 7f557025b700 1 -- 172.21.15.146:0/3535274530 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55680b0ff0 con 0x7f55680b0200 2023-10-06T11:18:31.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.645+0000 7f555dffb700 1 -- 172.21.15.146:0/3535274530 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5558014440 con 0x7f55680b0200 2023-10-06T11:18:31.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.645+0000 7f557025b700 1 -- 172.21.15.146:0/3535274530 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55680b6270 con 0x7f55680b0200 2023-10-06T11:18:31.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.647+0000 7f555dffb700 1 -- 172.21.15.146:0/3535274530 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5558014870 con 0x7f55680b0200 2023-10-06T11:18:31.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.647+0000 7f555dffb700 1 --2- 172.21.15.146:0/3535274530 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f554c066f30 0x7f554c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:31.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.647+0000 7f555dffb700 1 -- 172.21.15.146:0/3535274530 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5558018030 con 0x7f55680b0200 2023-10-06T11:18:31.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.647+0000 7f556dff7700 1 --2- 172.21.15.146:0/3535274530 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f554c066f30 0x7f554c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:31.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.648+0000 7f556dff7700 1 --2- 172.21.15.146:0/3535274530 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f554c066f30 0x7f554c0693e0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f5564007fd0 tx=0x7f5564009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:31.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.649+0000 7f5579553b80 1 Processor -- start 2023-10-06T11:18:31.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.649+0000 7f5579553b80 1 -- start start 2023-10-06T11:18:31.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.649+0000 7f5579553b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d7af9cea90 0x55d7af9cee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:31.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.649+0000 7f5579553b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7af98a9a0 0x55d7af987580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:31.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.649+0000 7f5579553b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d7af988bd0 0x55d7af987ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:31.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.649+0000 7f5579553b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7af907c80 con 0x55d7af988bd0 2023-10-06T11:18:31.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.650+0000 7f5579553b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7af8dea70 con 0x55d7af98a9a0 2023-10-06T11:18:31.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.650+0000 7f5579553b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d7af8dc270 con 0x55d7af9cea90 2023-10-06T11:18:31.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.650+0000 7f556e7f8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d7af988bd0 0x55d7af987ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:31.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.650+0000 7f556e7f8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d7af988bd0 0x55d7af987ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40852/0 (socket says 172.21.15.146:40852) 2023-10-06T11:18:31.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.650+0000 7f556e7f8700 1 -- 172.21.15.146:0/1633599247 learned_addr learned my addr 172.21.15.146:0/1633599247 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:31.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.650+0000 7f556e7f8700 1 -- 172.21.15.146:0/1633599247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d7af9cea90 msgr2=0x55d7af9cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:31.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.650+0000 7f556e7f8700 1 --2- 172.21.15.146:0/1633599247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d7af9cea90 0x55d7af9cee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:31.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.650+0000 7f556e7f8700 1 -- 172.21.15.146:0/1633599247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7af98a9a0 msgr2=0x55d7af987580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:31.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.650+0000 7f556e7f8700 1 --2- 172.21.15.146:0/1633599247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7af98a9a0 0x55d7af987580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:31.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.650+0000 7f556e7f8700 1 -- 172.21.15.146:0/1633599247 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d7af772270 con 0x55d7af988bd0 2023-10-06T11:18:31.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.650+0000 7f556e7f8700 1 --2- 172.21.15.146:0/1633599247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d7af988bd0 0x55d7af987ac0 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 crypto rx=0x7f55540057d0 tx=0x7f5560015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b806853289f416 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:31.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.650+0000 7f5552ffd700 1 -- 172.21.15.146:0/1633599247 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5560001950 con 0x55d7af988bd0 2023-10-06T11:18:31.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.650+0000 7f5552ffd700 1 -- 172.21.15.146:0/1633599247 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f556000c6d0 con 0x55d7af988bd0 2023-10-06T11:18:31.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.650+0000 7f5552ffd700 1 -- 172.21.15.146:0/1633599247 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556000ca20 con 0x55d7af988bd0 2023-10-06T11:18:31.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.651+0000 7f5579553b80 1 -- 172.21.15.146:0/1633599247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d7af988bd0 msgr2=0x55d7af987ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:31.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.651+0000 7f5579553b80 1 --2- 172.21.15.146:0/1633599247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d7af988bd0 0x55d7af987ac0 secure :-1 s=READY pgs=2120 cs=0 l=1 rev1=1 crypto rx=0x7f55540057d0 tx=0x7f5560015000 comp rx=0 tx=0).stop 2023-10-06T11:18:31.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.651+0000 7f5579553b80 1 -- 172.21.15.146:0/1633599247 shutdown_connections 2023-10-06T11:18:31.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.651+0000 7f5579553b80 1 --2- 172.21.15.146:0/1633599247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d7af988bd0 0x55d7af987ac0 unknown :-1 s=CLOSED pgs=2120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:31.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.651+0000 7f5579553b80 1 --2- 172.21.15.146:0/1633599247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d7af9cea90 0x55d7af9cee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:31.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.651+0000 7f5579553b80 1 --2- 172.21.15.146:0/1633599247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7af98a9a0 0x55d7af987580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:31.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.651+0000 7f5579553b80 1 -- 172.21.15.146:0/1633599247 >> 172.21.15.146:0/1633599247 conn(0x55d7af989070 msgr2=0x55d7af989440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:31.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.651+0000 7f5579553b80 1 -- 172.21.15.146:0/1633599247 shutdown_connections 2023-10-06T11:18:31.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.651+0000 7f5579553b80 1 -- 172.21.15.146:0/1633599247 wait complete. 2023-10-06T11:18:31.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.651+0000 7f5579553b80 1 -- start start 2023-10-06T11:18:31.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.651+0000 7f5579553b80 1 Processor -- start 2023-10-06T11:18:31.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.652+0000 7f5579553b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d7af988bd0 0x55d7af9caf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:31.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.652+0000 7f5579553b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7af98a9a0 0x55d7af9b2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:31.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.652+0000 7f5579553b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d7af9cea90 0x55d7af9ae340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:31.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.652+0000 7f5579553b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7af8d8060 con 0x55d7af9cea90 2023-10-06T11:18:31.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.652+0000 7f5579553b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7af883890 con 0x55d7af98a9a0 2023-10-06T11:18:31.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.652+0000 7f5579553b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d7af89eea0 con 0x55d7af988bd0 2023-10-06T11:18:31.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.652+0000 7f5579553b80 10 client.0 _ll_register_callbacks cb 0x55d7af774f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:18:31.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.652+0000 7f556e7f8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d7af9cea90 0x55d7af9ae340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:31.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.652+0000 7f556e7f8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d7af9cea90 0x55d7af9ae340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40868/0 (socket says 172.21.15.146:40868) 2023-10-06T11:18:31.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.652+0000 7f556e7f8700 1 -- 172.21.15.146:0/118842011 learned_addr learned my addr 172.21.15.146:0/118842011 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:31.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.653+0000 7f556d7f6700 1 --2- 172.21.15.146:0/118842011 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7af98a9a0 0x55d7af9b2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:31.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.653+0000 7f556dff7700 1 --2- 172.21.15.146:0/118842011 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d7af988bd0 0x55d7af9caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:31.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.653+0000 7f556e7f8700 1 -- 172.21.15.146:0/118842011 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d7af988bd0 msgr2=0x55d7af9caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:31.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.653+0000 7f556e7f8700 1 --2- 172.21.15.146:0/118842011 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d7af988bd0 0x55d7af9caf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:31.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.653+0000 7f556e7f8700 1 -- 172.21.15.146:0/118842011 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7af98a9a0 msgr2=0x55d7af9b2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:31.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.653+0000 7f556e7f8700 1 --2- 172.21.15.146:0/118842011 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7af98a9a0 0x55d7af9b2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:31.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.653+0000 7f556e7f8700 1 -- 172.21.15.146:0/118842011 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5554003570 con 0x55d7af9cea90 2023-10-06T11:18:31.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.653+0000 7f556e7f8700 1 --2- 172.21.15.146:0/118842011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d7af9cea90 0x55d7af9ae340 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x55d7af98aef0 tx=0x7f5560021070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce4b797d40ff793a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:31.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.653+0000 7f5547fff700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:18:31.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.653+0000 7f5547fff700 1 -- 172.21.15.146:0/118842011 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556000ca20 con 0x55d7af9cea90 2023-10-06T11:18:31.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.653+0000 7f5547fff700 1 -- 172.21.15.146:0/118842011 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(163..163 src has 1..163) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f556000cdb0 con 0x55d7af9cea90 2023-10-06T11:18:31.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.653+0000 7f5579553b80 1 -- 172.21.15.146:0/118842011 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d7af9595c0 con 0x55d7af9cea90 2023-10-06T11:18:31.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.653+0000 7f5547fff700 1 -- 172.21.15.146:0/118842011 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5560030430 con 0x55d7af9cea90 2023-10-06T11:18:31.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.653+0000 7f5579553b80 10 client.10242 fetch_fsmap learned FSMap version 136 2023-10-06T11:18:31.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.653+0000 7f5579553b80 1 -- 172.21.15.146:0/118842011 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=2+}) v3 -- 0x55d7af714fe0 con 0x55d7af9cea90 2023-10-06T11:18:31.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.653+0000 7f5547fff700 1 -- 172.21.15.146:0/118842011 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d7af9595c0 con 0x55d7af9cea90 2023-10-06T11:18:31.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.653+0000 7f5547fff700 1 -- 172.21.15.146:0/118842011 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 136) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5560030590 con 0x55d7af9cea90 2023-10-06T11:18:31.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.654+0000 7f5579553b80 10 client.10242 fetch_fsmap finished waiting for FSMap version 136 2023-10-06T11:18:31.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.654+0000 7f5579553b80 10 client.10242 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T11:18:31.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.654+0000 7f5579553b80 20 client.10242 populate_metadata read hostname 'smithi146' 2023-10-06T11:18:31.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.654+0000 7f5579553b80 1 --2- 172.21.15.146:0/118842011 >> [v2:172.21.15.146:6835/1340411581,v1:172.21.15.146:6837/1340411581] conn(0x55d7af9b5130 0x55d7af9846f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:31.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.654+0000 7f5579553b80 4 client.10242 mds_command: new command op to 10080 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:18:31.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.654+0000 7f5579553b80 1 -- 172.21.15.146:0/118842011 --> [v2:172.21.15.146:6835/1340411581,v1:172.21.15.146:6837/1340411581] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d7af87ae00 con 0x55d7af9b5130 2023-10-06T11:18:31.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.654+0000 7f556dff7700 1 --2- 172.21.15.146:0/118842011 >> [v2:172.21.15.146:6835/1340411581,v1:172.21.15.146:6837/1340411581] conn(0x55d7af9b5130 0x55d7af9846f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:31.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.654+0000 7f5547fff700 10 client.10242 ms_handle_connect on v2:172.21.15.146:6835/1340411581 2023-10-06T11:18:31.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.654+0000 7f556dff7700 1 --2- 172.21.15.146:0/118842011 >> [v2:172.21.15.146:6835/1340411581,v1:172.21.15.146:6837/1340411581] conn(0x55d7af9b5130 0x55d7af9846f0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff3476779dcd7e9a server_cookie=c4c6429255634e88 in_seq=0 out_seq=0 2023-10-06T11:18:31.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.655+0000 7f5547fff700 1 -- 172.21.15.146:0/118842011 <== mds.0 v2:172.21.15.146:6835/1340411581 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55d7af87ae00 con 0x55d7af9b5130 2023-10-06T11:18:31.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.655+0000 7f5547fff700 10 client.10242 handle_command_reply: tid=0 2023-10-06T11:18:31.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.655+0000 7f5579553b80 1 client.10242 shutdown 2023-10-06T11:18:31.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.655+0000 7f5579553b80 1 -- 172.21.15.146:0/118842011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d7af9cea90 msgr2=0x55d7af9ae340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:31.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.655+0000 7f5579553b80 1 --2- 172.21.15.146:0/118842011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d7af9cea90 0x55d7af9ae340 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x55d7af98aef0 tx=0x7f5560021070 comp rx=0 tx=0).stop 2023-10-06T11:18:31.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.655+0000 7f5579553b80 1 -- 172.21.15.146:0/118842011 shutdown_connections 2023-10-06T11:18:31.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.655+0000 7f5579553b80 1 --2- 172.21.15.146:0/118842011 >> [v2:172.21.15.146:6835/1340411581,v1:172.21.15.146:6837/1340411581] conn(0x55d7af9b5130 0x55d7af9846f0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:31.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.655+0000 7f5579553b80 1 --2- 172.21.15.146:0/118842011 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d7af9cea90 0x55d7af9ae340 unknown :-1 s=CLOSED pgs=2121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:31.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.655+0000 7f5547fff700 0 client.10242 ms_handle_reset on v2:172.21.15.146:6835/1340411581 2023-10-06T11:18:31.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.655+0000 7f5579553b80 1 --2- 172.21.15.146:0/118842011 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d7af988bd0 0x55d7af9caf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:31.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.655+0000 7f5579553b80 1 --2- 172.21.15.146:0/118842011 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7af98a9a0 0x55d7af9b2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:31.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.655+0000 7f5579553b80 1 -- 172.21.15.146:0/118842011 >> 172.21.15.146:0/118842011 conn(0x55d7af989070 msgr2=0x55d7af982740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:31.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.655+0000 7f5579553b80 1 -- 172.21.15.146:0/118842011 shutdown_connections 2023-10-06T11:18:31.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.655+0000 7f5579553b80 1 -- 172.21.15.146:0/118842011 wait complete. 2023-10-06T11:18:31.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.655+0000 7f5579553b80 20 client.10242 trim_cache size 0 max 16384 2023-10-06T11:18:31.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.672+0000 7f5579553b80 1 Processor -- start 2023-10-06T11:18:31.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.672+0000 7f5579553b80 1 -- start start 2023-10-06T11:18:31.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.673+0000 7f5579553b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d7af988bd0 0x55d7af9e7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:31.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.673+0000 7f5579553b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d7af98a9a0 0x55d7af982b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:31.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.673+0000 7f5579553b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7af9cea90 0x55d7af9cd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:31.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.673+0000 7f5579553b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7af75ae30 con 0x55d7af98a9a0 2023-10-06T11:18:31.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.673+0000 7f5579553b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7af9b7db0 con 0x55d7af9cea90 2023-10-06T11:18:31.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.673+0000 7f5579553b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d7af9670d0 con 0x55d7af988bd0 2023-10-06T11:18:31.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.673+0000 7f556d7f6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d7af98a9a0 0x55d7af982b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:31.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.673+0000 7f556d7f6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d7af98a9a0 0x55d7af982b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40884/0 (socket says 172.21.15.146:40884) 2023-10-06T11:18:31.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.673+0000 7f556d7f6700 1 -- 172.21.15.146:0/1075352528 learned_addr learned my addr 172.21.15.146:0/1075352528 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:31.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.673+0000 7f556dff7700 1 --2- 172.21.15.146:0/1075352528 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d7af988bd0 0x55d7af9e7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:31.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.673+0000 7f556e7f8700 1 --2- 172.21.15.146:0/1075352528 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7af9cea90 0x55d7af9cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:31.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.673+0000 7f556d7f6700 1 -- 172.21.15.146:0/1075352528 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d7af988bd0 msgr2=0x55d7af9e7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:31.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.673+0000 7f556d7f6700 1 --2- 172.21.15.146:0/1075352528 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d7af988bd0 0x55d7af9e7d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:31.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.673+0000 7f556d7f6700 1 -- 172.21.15.146:0/1075352528 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7af9cea90 msgr2=0x55d7af9cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:31.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.673+0000 7f556d7f6700 1 --2- 172.21.15.146:0/1075352528 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7af9cea90 0x55d7af9cd280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:31.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.673+0000 7f556d7f6700 1 -- 172.21.15.146:0/1075352528 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d7af8a6780 con 0x55d7af98a9a0 2023-10-06T11:18:31.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.673+0000 7f556d7f6700 1 --2- 172.21.15.146:0/1075352528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d7af98a9a0 0x55d7af982b40 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7f5558055c30 tx=0x7f555805b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d40791a929bcffd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:31.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.673+0000 7f55537fe700 1 -- 172.21.15.146:0/1075352528 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5558055f30 con 0x55d7af98a9a0 2023-10-06T11:18:31.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.673+0000 7f55537fe700 1 -- 172.21.15.146:0/1075352528 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5558059180 con 0x55d7af98a9a0 2023-10-06T11:18:31.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.673+0000 7f55537fe700 1 -- 172.21.15.146:0/1075352528 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555805ced0 con 0x55d7af98a9a0 2023-10-06T11:18:31.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.674+0000 7f5579553b80 1 -- 172.21.15.146:0/1075352528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d7af98a9a0 msgr2=0x55d7af982b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:31.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.674+0000 7f5579553b80 1 --2- 172.21.15.146:0/1075352528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d7af98a9a0 0x55d7af982b40 secure :-1 s=READY pgs=2122 cs=0 l=1 rev1=1 crypto rx=0x7f5558055c30 tx=0x7f555805b040 comp rx=0 tx=0).stop 2023-10-06T11:18:31.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.674+0000 7f5579553b80 1 -- 172.21.15.146:0/1075352528 shutdown_connections 2023-10-06T11:18:31.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.674+0000 7f5579553b80 1 --2- 172.21.15.146:0/1075352528 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7af9cea90 0x55d7af9cd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:31.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.674+0000 7f5579553b80 1 --2- 172.21.15.146:0/1075352528 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d7af988bd0 0x55d7af9e7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:31.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.674+0000 7f5579553b80 1 --2- 172.21.15.146:0/1075352528 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d7af98a9a0 0x55d7af982b40 unknown :-1 s=CLOSED pgs=2122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:31.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.674+0000 7f5579553b80 1 -- 172.21.15.146:0/1075352528 >> 172.21.15.146:0/1075352528 conn(0x55d7af989070 msgr2=0x55d7af983420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:31.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.674+0000 7f5579553b80 1 -- 172.21.15.146:0/1075352528 shutdown_connections 2023-10-06T11:18:31.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.674+0000 7f5579553b80 1 -- 172.21.15.146:0/1075352528 wait complete. 2023-10-06T11:18:31.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.675+0000 7f5579553b80 1 -- start start 2023-10-06T11:18:31.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.675+0000 7f5579553b80 1 Processor -- start 2023-10-06T11:18:31.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.675+0000 7f5579553b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d7af988bd0 0x55d7af984540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:31.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.675+0000 7f5579553b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d7af98a9a0 0x55d7af984a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:31.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.675+0000 7f5579553b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7af9cea90 0x55d7af9cd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:31.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.675+0000 7f5579553b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7af9dc240 con 0x55d7af988bd0 2023-10-06T11:18:31.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.675+0000 7f5579553b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7af9cb8a0 con 0x55d7af9cea90 2023-10-06T11:18:31.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.675+0000 7f5579553b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d7af9dc8f0 con 0x55d7af98a9a0 2023-10-06T11:18:31.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.676+0000 7f5579553b80 10 client.0 _ll_register_callbacks cb 0x55d7af774f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:18:31.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.676+0000 7f556dff7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d7af988bd0 0x55d7af984540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:31.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.676+0000 7f556dff7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d7af988bd0 0x55d7af984540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40900/0 (socket says 172.21.15.146:40900) 2023-10-06T11:18:31.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.676+0000 7f556dff7700 1 -- 172.21.15.146:0/3847962601 learned_addr learned my addr 172.21.15.146:0/3847962601 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:31.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.676+0000 7f556d7f6700 1 --2- 172.21.15.146:0/3847962601 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d7af98a9a0 0x55d7af984a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:31.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.676+0000 7f556e7f8700 1 --2- 172.21.15.146:0/3847962601 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7af9cea90 0x55d7af9cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:31.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.676+0000 7f556dff7700 1 -- 172.21.15.146:0/3847962601 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d7af98a9a0 msgr2=0x55d7af984a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:31.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.676+0000 7f556dff7700 1 --2- 172.21.15.146:0/3847962601 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d7af98a9a0 0x55d7af984a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:31.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.676+0000 7f556dff7700 1 -- 172.21.15.146:0/3847962601 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7af9cea90 msgr2=0x55d7af9cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:31.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.676+0000 7f556dff7700 1 --2- 172.21.15.146:0/3847962601 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7af9cea90 0x55d7af9cd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:31.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.676+0000 7f556dff7700 1 -- 172.21.15.146:0/3847962601 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55680b6270 con 0x55d7af988bd0 2023-10-06T11:18:31.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.676+0000 7f556d7f6700 1 --2- 172.21.15.146:0/3847962601 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d7af98a9a0 0x55d7af984a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:18:31.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.676+0000 7f556dff7700 1 --2- 172.21.15.146:0/3847962601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d7af988bd0 0x55d7af984540 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 crypto rx=0x7f5564007b60 tx=0x7f5564029040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86b5959d5c0eec1a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:31.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.676+0000 7f5547fff700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:18:31.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.676+0000 7f5547fff700 1 -- 172.21.15.146:0/3847962601 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5564015470 con 0x55d7af988bd0 2023-10-06T11:18:31.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.676+0000 7f5547fff700 1 -- 172.21.15.146:0/3847962601 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(163..163 src has 1..163) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f556401d040 con 0x55d7af988bd0 2023-10-06T11:18:31.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.676+0000 7f5579553b80 1 -- 172.21.15.146:0/3847962601 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d7af97c690 con 0x55d7af988bd0 2023-10-06T11:18:31.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.676+0000 7f5547fff700 1 -- 172.21.15.146:0/3847962601 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) v2 ==== 24+0+0 (secure 0 0 0) 0x7f55640157e0 con 0x55d7af988bd0 2023-10-06T11:18:31.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.676+0000 7f5579553b80 10 client.10248 fetch_fsmap learned FSMap version 136 2023-10-06T11:18:31.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.676+0000 7f5579553b80 1 -- 172.21.15.146:0/3847962601 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=2+}) v3 -- 0x55d7af88d470 con 0x55d7af988bd0 2023-10-06T11:18:31.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.676+0000 7f5547fff700 1 -- 172.21.15.146:0/3847962601 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d7af97c690 con 0x55d7af988bd0 2023-10-06T11:18:31.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.676+0000 7f5547fff700 1 -- 172.21.15.146:0/3847962601 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 136) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f5564015c10 con 0x55d7af988bd0 2023-10-06T11:18:31.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.676+0000 7f5579553b80 10 client.10248 fetch_fsmap finished waiting for FSMap version 136 2023-10-06T11:18:31.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.676+0000 7f5579553b80 10 client.10248 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-06T11:18:31.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.676+0000 7f5579553b80 20 client.10248 populate_metadata read hostname 'smithi146' 2023-10-06T11:18:31.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.677+0000 7f5579553b80 1 --2- 172.21.15.146:0/3847962601 >> [v2:172.21.15.146:6835/1340411581,v1:172.21.15.146:6837/1340411581] conn(0x55d7af9cd9d0 0x55d7af9ca560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:31.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.677+0000 7f5579553b80 4 client.10248 mds_command: new command op to 10080 tid=0[{"prefix": "status"}] 2023-10-06T11:18:31.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.677+0000 7f5579553b80 1 -- 172.21.15.146:0/3847962601 --> [v2:172.21.15.146:6835/1340411581,v1:172.21.15.146:6837/1340411581] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d7af87ab20 con 0x55d7af9cd9d0 2023-10-06T11:18:31.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.677+0000 7f556d7f6700 1 --2- 172.21.15.146:0/3847962601 >> [v2:172.21.15.146:6835/1340411581,v1:172.21.15.146:6837/1340411581] conn(0x55d7af9cd9d0 0x55d7af9ca560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:31.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.677+0000 7f5547fff700 10 client.10248 ms_handle_connect on v2:172.21.15.146:6835/1340411581 2023-10-06T11:18:31.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.677+0000 7f556d7f6700 1 --2- 172.21.15.146:0/3847962601 >> [v2:172.21.15.146:6835/1340411581,v1:172.21.15.146:6837/1340411581] conn(0x55d7af9cd9d0 0x55d7af9ca560 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53e352e313217b43 server_cookie=8f6bf51833a27f98 in_seq=0 out_seq=0 2023-10-06T11:18:31.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.677+0000 7f5547fff700 1 -- 172.21.15.146:0/3847962601 <== mds.0 v2:172.21.15.146:6835/1340411581 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55d7af87ab20 con 0x55d7af9cd9d0 2023-10-06T11:18:31.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.677+0000 7f5547fff700 10 client.10248 handle_command_reply: tid=0 2023-10-06T11:18:31.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.677+0000 7f5579553b80 1 client.10248 shutdown 2023-10-06T11:18:31.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.677+0000 7f5579553b80 1 -- 172.21.15.146:0/3847962601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d7af988bd0 msgr2=0x55d7af984540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:31.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.677+0000 7f5579553b80 1 --2- 172.21.15.146:0/3847962601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d7af988bd0 0x55d7af984540 secure :-1 s=READY pgs=2123 cs=0 l=1 rev1=1 crypto rx=0x7f5564007b60 tx=0x7f5564029040 comp rx=0 tx=0).stop 2023-10-06T11:18:31.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.677+0000 7f5579553b80 1 -- 172.21.15.146:0/3847962601 shutdown_connections 2023-10-06T11:18:31.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.677+0000 7f5579553b80 1 --2- 172.21.15.146:0/3847962601 >> [v2:172.21.15.146:6835/1340411581,v1:172.21.15.146:6837/1340411581] conn(0x55d7af9cd9d0 0x55d7af9ca560 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:31.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.677+0000 7f5579553b80 1 --2- 172.21.15.146:0/3847962601 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7af9cea90 0x55d7af9cd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:31.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.677+0000 7f5547fff700 0 client.10248 ms_handle_reset on v2:172.21.15.146:6835/1340411581 2023-10-06T11:18:31.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.677+0000 7f5579553b80 1 --2- 172.21.15.146:0/3847962601 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55d7af988bd0 0x55d7af984540 unknown :-1 s=CLOSED pgs=2123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:31.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.677+0000 7f5579553b80 1 --2- 172.21.15.146:0/3847962601 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55d7af98a9a0 0x55d7af984a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:31.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.677+0000 7f5579553b80 1 -- 172.21.15.146:0/3847962601 >> 172.21.15.146:0/3847962601 conn(0x55d7af989070 msgr2=0x55d7af9b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:31.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.677+0000 7f5579553b80 1 -- 172.21.15.146:0/3847962601 shutdown_connections 2023-10-06T11:18:31.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.677+0000 7f5579553b80 1 -- 172.21.15.146:0/3847962601 wait complete. 2023-10-06T11:18:31.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.678+0000 7f5579553b80 20 client.10248 trim_cache size 0 max 16384 2023-10-06T11:18:31.687 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:18:31.687 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1", 2023-10-06T11:18:31.687 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2023-10-06T11:18:31.687 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 10080, 2023-10-06T11:18:31.688 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2023-10-06T11:18:31.688 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2023-10-06T11:18:31.688 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2023-10-06T11:18:31.688 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 5.8038021530000004, 2023-10-06T11:18:31.688 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 136, 2023-10-06T11:18:31.688 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 163, 2023-10-06T11:18:31.688 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 163, 2023-10-06T11:18:31.688 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 11.9213808 2023-10-06T11:18:31.688 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:18:31.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.678+0000 7f557025b700 1 -- 172.21.15.146:0/3535274530 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f554c066f30 msgr2=0x7f554c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:31.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.678+0000 7f557025b700 1 --2- 172.21.15.146:0/3535274530 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f554c066f30 0x7f554c0693e0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f5564007fd0 tx=0x7f5564009040 comp rx=0 tx=0).stop 2023-10-06T11:18:31.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.678+0000 7f557025b700 1 -- 172.21.15.146:0/3535274530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55680b0200 msgr2=0x7f55680b5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:31.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.678+0000 7f557025b700 1 --2- 172.21.15.146:0/3535274530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55680b0200 0x7f55680b5d30 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 crypto rx=0x7f5558006ac0 tx=0x7f55580091a0 comp rx=0 tx=0).stop 2023-10-06T11:18:31.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.678+0000 7f557025b700 1 -- 172.21.15.146:0/3535274530 shutdown_connections 2023-10-06T11:18:31.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.678+0000 7f557025b700 1 --2- 172.21.15.146:0/3535274530 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f554c066f30 0x7f554c0693e0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:31.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.678+0000 7f557025b700 1 --2- 172.21.15.146:0/3535274530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55680b17f0 0x7f556816d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:31.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.678+0000 7f557025b700 1 --2- 172.21.15.146:0/3535274530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5554004d50 0x7f55680c9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:31.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.678+0000 7f557025b700 1 --2- 172.21.15.146:0/3535274530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f55680b0200 0x7f55680b5d30 unknown :-1 s=CLOSED pgs=2119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:31.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.678+0000 7f557025b700 1 -- 172.21.15.146:0/3535274530 >> 172.21.15.146:0/3535274530 conn(0x7f556806eb10 msgr2=0x7f55680ce610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:31.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.678+0000 7f557025b700 1 -- 172.21.15.146:0/3535274530 shutdown_connections 2023-10-06T11:18:31.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.678+0000 7f557025b700 1 -- 172.21.15.146:0/3535274530 wait complete. 2023-10-06T11:18:31.692 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T11:18:31.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.807+0000 7fa58d67f700 1 Processor -- start 2023-10-06T11:18:31.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.807+0000 7fa58d67f700 1 -- start start 2023-10-06T11:18:31.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.808+0000 7fa58d67f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa5880ced20 0x7fa588153c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:31.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.808+0000 7fa58d67f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa58815d270 con 0x7fa58815a940 2023-10-06T11:18:31.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.808+0000 7fa58d67f700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa58815d830 con 0x7fa5881538c0 2023-10-06T11:18:31.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.808+0000 7fa58d67f700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5880cb810 con 0x7fa5880ced20 2023-10-06T11:18:31.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.808+0000 7fa5877fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa5880ced20 0x7fa588153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:31.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.808+0000 7fa57e7fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fa58815a940 0x7fa5880ce610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52158/0 (socket says 172.21.15.146:52158) 2023-10-06T11:18:31.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.808+0000 7fa57e7fc700 1 -- 172.21.15.146:0/596055530 learned_addr learned my addr 172.21.15.146:0/596055530 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:31.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.808+0000 7fa5877fe700 1 -- 172.21.15.146:0/596055530 >> v1:172.21.15.151:6789/0 conn(0x7fa5881538c0 legacy=0x7fa5880cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:31.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.808+0000 7fa5877fe700 1 -- 172.21.15.146:0/596055530 >> v1:172.21.15.146:6789/0 conn(0x7fa58815a940 legacy=0x7fa5880ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:31.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.808+0000 7fa5877fe700 1 -- 172.21.15.146:0/596055530 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5880cbaf0 con 0x7fa5880ced20 2023-10-06T11:18:31.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.808+0000 7fa5877fe700 1 --2- 172.21.15.146:0/596055530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5880ced20 0x7fa588153c90 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7fa580009e60 tx=0x7fa580009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d00d3289e4b09fca server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:31.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.808+0000 7fa5867fc700 1 -- 172.21.15.146:0/596055530 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58000e070 con 0x7fa5880ced20 2023-10-06T11:18:31.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.809+0000 7fa5867fc700 1 -- 172.21.15.146:0/596055530 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa58000bc30 con 0x7fa5880ced20 2023-10-06T11:18:31.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.809+0000 7fa5867fc700 1 -- 172.21.15.146:0/596055530 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa580012430 con 0x7fa5880ced20 2023-10-06T11:18:31.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.809+0000 7fa58d67f700 1 -- 172.21.15.146:0/596055530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5880ced20 msgr2=0x7fa588153c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:31.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.809+0000 7fa58d67f700 1 --2- 172.21.15.146:0/596055530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5880ced20 0x7fa588153c90 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7fa580009e60 tx=0x7fa580009780 comp rx=0 tx=0).stop 2023-10-06T11:18:31.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.809+0000 7fa58d67f700 1 -- 172.21.15.146:0/596055530 shutdown_connections 2023-10-06T11:18:31.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.809+0000 7fa58d67f700 1 --2- 172.21.15.146:0/596055530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5880ced20 0x7fa588153c90 unknown :-1 s=CLOSED pgs=2125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:31.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.809+0000 7fa58d67f700 1 -- 172.21.15.146:0/596055530 >> 172.21.15.146:0/596055530 conn(0x7fa58806eb10 msgr2=0x7fa58806ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:31.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.809+0000 7fa58d67f700 1 -- 172.21.15.146:0/596055530 shutdown_connections 2023-10-06T11:18:31.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.809+0000 7fa58d67f700 1 -- 172.21.15.146:0/596055530 wait complete. 2023-10-06T11:18:31.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.810+0000 7fa58d67f700 1 Processor -- start 2023-10-06T11:18:31.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.810+0000 7fa58d67f700 1 -- start start 2023-10-06T11:18:31.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.811+0000 7fa58d67f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5880ced20 0x7fa58816cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:31.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.811+0000 7fa58d67f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5881538c0 0x7fa5880b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:31.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.811+0000 7fa58d67f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa58815a940 0x7fa588145fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:31.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.811+0000 7fa58d67f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa58816de40 con 0x7fa58815a940 2023-10-06T11:18:31.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.811+0000 7fa58d67f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5880c8950 con 0x7fa5881538c0 2023-10-06T11:18:31.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.811+0000 7fa58d67f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5880b6350 con 0x7fa5880ced20 2023-10-06T11:18:31.816 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.811+0000 7fa5877fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa58815a940 0x7fa588145fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:31.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.811+0000 7fa5877fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa58815a940 0x7fa588145fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40924/0 (socket says 172.21.15.146:40924) 2023-10-06T11:18:31.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.811+0000 7fa5877fe700 1 -- 172.21.15.146:0/602520891 learned_addr learned my addr 172.21.15.146:0/602520891 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:31.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.811+0000 7fa57e7fc700 1 --2- 172.21.15.146:0/602520891 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5881538c0 0x7fa5880b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:31.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.811+0000 7fa586ffd700 1 --2- 172.21.15.146:0/602520891 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5880ced20 0x7fa58816cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:31.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.811+0000 7fa5877fe700 1 -- 172.21.15.146:0/602520891 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5880ced20 msgr2=0x7fa58816cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:31.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.811+0000 7fa5877fe700 1 --2- 172.21.15.146:0/602520891 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5880ced20 0x7fa58816cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:31.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.811+0000 7fa5877fe700 1 -- 172.21.15.146:0/602520891 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5881538c0 msgr2=0x7fa5880b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:31.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.811+0000 7fa5877fe700 1 --2- 172.21.15.146:0/602520891 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5881538c0 0x7fa5880b5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:31.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.811+0000 7fa5877fe700 1 -- 172.21.15.146:0/602520891 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa580009a20 con 0x7fa58815a940 2023-10-06T11:18:31.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.812+0000 7fa5877fe700 1 --2- 172.21.15.146:0/602520891 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa58815a940 0x7fa588145fa0 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 crypto rx=0x7fa5800097c0 tx=0x7fa580019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:31.817 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.812+0000 7fa57f7fe700 1 -- 172.21.15.146:0/602520891 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58001e630 con 0x7fa58815a940 2023-10-06T11:18:31.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.812+0000 7fa57f7fe700 1 -- 172.21.15.146:0/602520891 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa58001e790 con 0x7fa58815a940 2023-10-06T11:18:31.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.812+0000 7fa58d67f700 1 -- 172.21.15.146:0/602520891 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa58816d5a0 con 0x7fa58815a940 2023-10-06T11:18:31.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.812+0000 7fa57f7fe700 1 -- 172.21.15.146:0/602520891 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58001eb50 con 0x7fa58815a940 2023-10-06T11:18:31.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.812+0000 7fa58d67f700 1 -- 172.21.15.146:0/602520891 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa58816db60 con 0x7fa58815a940 2023-10-06T11:18:31.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.813+0000 7fa58d67f700 1 -- 172.21.15.146:0/602520891 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa58804c380 con 0x7fa58815a940 2023-10-06T11:18:31.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.813+0000 7fa57f7fe700 1 -- 172.21.15.146:0/602520891 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa580024070 con 0x7fa58815a940 2023-10-06T11:18:31.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.813+0000 7fa57f7fe700 1 --2- 172.21.15.146:0/602520891 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa568066f30 0x7fa5680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:31.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.814+0000 7fa57f7fe700 1 -- 172.21.15.146:0/602520891 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa580086f60 con 0x7fa58815a940 2023-10-06T11:18:31.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.814+0000 7fa586ffd700 1 --2- 172.21.15.146:0/602520891 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa568066f30 0x7fa5680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:31.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.814+0000 7fa586ffd700 1 --2- 172.21.15.146:0/602520891 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa568066f30 0x7fa5680693e0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fa578003880 tx=0x7fa578009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:31.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:31.818+0000 7fa57f7fe700 1 -- 172.21.15.146:0/602520891 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa580054070 con 0x7fa58815a940 2023-10-06T11:18:32.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:32.044+0000 7fa58d67f700 1 -- 172.21.15.146:0/602520891 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa58815d4c0 con 0x7fa58815a940 2023-10-06T11:18:32.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:32.044+0000 7fa57f7fe700 1 -- 172.21.15.146:0/602520891 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v136) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa580057690 con 0x7fa58815a940 2023-10-06T11:18:32.046 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T11:18:32.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:32.047+0000 7fa58d67f700 1 -- 172.21.15.146:0/602520891 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa568066f30 msgr2=0x7fa5680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:32.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:32.047+0000 7fa58d67f700 1 --2- 172.21.15.146:0/602520891 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa568066f30 0x7fa5680693e0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fa578003880 tx=0x7fa578009040 comp rx=0 tx=0).stop 2023-10-06T11:18:32.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:32.047+0000 7fa58d67f700 1 -- 172.21.15.146:0/602520891 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa58815a940 msgr2=0x7fa588145fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:32.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:32.047+0000 7fa58d67f700 1 --2- 172.21.15.146:0/602520891 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa58815a940 0x7fa588145fa0 secure :-1 s=READY pgs=2126 cs=0 l=1 rev1=1 crypto rx=0x7fa5800097c0 tx=0x7fa580019000 comp rx=0 tx=0).stop 2023-10-06T11:18:32.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:32.047+0000 7fa58d67f700 1 -- 172.21.15.146:0/602520891 shutdown_connections 2023-10-06T11:18:32.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:32.047+0000 7fa58d67f700 1 --2- 172.21.15.146:0/602520891 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa568066f30 0x7fa5680693e0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:32.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:32.047+0000 7fa58d67f700 1 --2- 172.21.15.146:0/602520891 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa58815a940 0x7fa588145fa0 unknown :-1 s=CLOSED pgs=2126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:32.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:32.047+0000 7fa58d67f700 1 --2- 172.21.15.146:0/602520891 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5880ced20 0x7fa58816cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:32.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:32.047+0000 7fa58d67f700 1 --2- 172.21.15.146:0/602520891 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5881538c0 0x7fa5880b5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:32.049 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:32.047+0000 7fa58d67f700 1 -- 172.21.15.146:0/602520891 >> 172.21.15.146:0/602520891 conn(0x7fa58806eb10 msgr2=0x7fa5880ce610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:32.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:32.047+0000 7fa58d67f700 1 -- 172.21.15.146:0/602520891 shutdown_connections 2023-10-06T11:18:32.050 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:32.047+0000 7fa58d67f700 1 -- 172.21.15.146:0/602520891 wait complete. 2023-10-06T11:18:32.061 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T11:18:32.061 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T11:18:32.061 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2023-10-06T11:18:32.061 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T11:18:32.061 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T11:18:32.061 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T11:18:32.061 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T11:18:32.061 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T11:18:32.061 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:18:32.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:18:32.062 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2023-10-06T11:18:32.077 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:18:32.077 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:18:32.077 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:18:32.077 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:18:32.077 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2023-10-06T11:18:32.077 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:18:32.077 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:18:32.077 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2023-10-06T11:18:32.078 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2023-10-06T11:18:32.078 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:18:32.078 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2023-10-06T11:18:32.078 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2023-10-06T11:18:32.078 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:18:32.078 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2023-10-06T11:18:32.078 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T11:18:32.078 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2023-10-06T11:18:32.078 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T11:18:32.078 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 41745sec preferred_lft 41745sec 2023-10-06T11:18:32.078 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link noprefixroute 2023-10-06T11:18:32.079 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:18:32.079 INFO:teuthology.orchestra.run.smithi146.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T11:18:32.079 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0e:4f:33:80:c4:0e brd ff:ff:ff:ff:ff:ff 2023-10-06T11:18:32.079 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T11:18:32.079 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:18:32.079 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3884:6eff:fefc:ffc7/64 scope link 2023-10-06T11:18:32.079 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:18:32.079 INFO:teuthology.orchestra.run.smithi146.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:18:32.079 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0e:4f:33:80:c4:0e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T11:18:32.079 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::c4f:33ff:fe80:c40e/64 scope link 2023-10-06T11:18:32.079 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:18:32.080 INFO:teuthology.orchestra.run.smithi146.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:18:32.080 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 36:96:28:73:57:c4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T11:18:32.080 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3496:28ff:fe73:57c4/64 scope link 2023-10-06T11:18:32.080 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:18:32.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:18:32.081 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T11:18:32.139 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-06T11:18:32.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:18:32.141 DEBUG:teuthology.orchestra.run.smithi146:> route 2023-10-06T11:18:32.196 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2023-10-06T11:18:32.197 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T11:18:32.197 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T11:18:32.197 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T11:18:32.197 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T11:18:32.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:18:32.197 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-10-06T11:18:32.198 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:18:32.198 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T11:18:32.198 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T11:18:32.198 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T11:18:32.198 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:18:32.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:18:32.297 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-10-06T11:18:32.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T11:18:32.311 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T11:18:32.312 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:18:32.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:18:32.312 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2023-10-06T11:18:32.376 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T11:18:32.376 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:18:32.376 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T11:18:32.430 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:18:32.431 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:18:32.431 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:18:32.485 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-06T11:18:32.550 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:18:32.550 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:18:32.614 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:18:32.615 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:18:32.615 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:18:32.616 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-06T11:18:32.670 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T11:18:32.671 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T11:18:32.713 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-06T11:18:32.737 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:18:32.737 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:18:32.797 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:2023-10-06T11:18:32.795+0000 7f7d23b2c540 -1 init, newargv = 0x555b86bf1d40 newargc=15 2023-10-06T11:18:32.797 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[157151]: starting ceph client 2023-10-06T11:18:32.801 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[157151]: starting fuse 2023-10-06T11:18:32.802 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:18:32.803 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:18:32.804 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:18:32.804 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-06T11:18:32.859 INFO:teuthology.orchestra.run.smithi146.stdout:46 2023-10-06T11:18:32.860 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-06T11:18:32.860 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T11:18:32.860 DEBUG:teuthology.orchestra.run.smithi146:> import glob 2023-10-06T11:18:32.860 DEBUG:teuthology.orchestra.run.smithi146:> import re 2023-10-06T11:18:32.860 DEBUG:teuthology.orchestra.run.smithi146:> import os 2023-10-06T11:18:32.861 DEBUG:teuthology.orchestra.run.smithi146:> import subprocess 2023-10-06T11:18:32.861 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:18:32.861 DEBUG:teuthology.orchestra.run.smithi146:> def _find_admin_socket(client_name): 2023-10-06T11:18:32.861 DEBUG:teuthology.orchestra.run.smithi146:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T11:18:32.861 DEBUG:teuthology.orchestra.run.smithi146:> files = glob.glob(asok_path) 2023-10-06T11:18:32.861 DEBUG:teuthology.orchestra.run.smithi146:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T11:18:32.861 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:18:32.861 DEBUG:teuthology.orchestra.run.smithi146:> # Given a non-glob path, it better be there 2023-10-06T11:18:32.861 DEBUG:teuthology.orchestra.run.smithi146:> if "*" not in asok_path: 2023-10-06T11:18:32.861 DEBUG:teuthology.orchestra.run.smithi146:> assert(len(files) == 1) 2023-10-06T11:18:32.861 DEBUG:teuthology.orchestra.run.smithi146:> return files[0] 2023-10-06T11:18:32.861 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:18:32.862 DEBUG:teuthology.orchestra.run.smithi146:> for f in files: 2023-10-06T11:18:32.862 DEBUG:teuthology.orchestra.run.smithi146:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T11:18:32.862 DEBUG:teuthology.orchestra.run.smithi146:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T11:18:32.862 DEBUG:teuthology.orchestra.run.smithi146:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T11:18:32.862 DEBUG:teuthology.orchestra.run.smithi146:> contents = proc_f.read() 2023-10-06T11:18:32.862 DEBUG:teuthology.orchestra.run.smithi146:> if mountpoint in contents: 2023-10-06T11:18:32.862 DEBUG:teuthology.orchestra.run.smithi146:> return f 2023-10-06T11:18:32.862 DEBUG:teuthology.orchestra.run.smithi146:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T11:18:32.862 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:18:32.862 DEBUG:teuthology.orchestra.run.smithi146:> print(_find_admin_socket("client.0")) 2023-10-06T11:18:32.862 DEBUG:teuthology.orchestra.run.smithi146:> ' 2023-10-06T11:18:32.981 INFO:teuthology.orchestra.run.smithi146.stdout:/var/run/ceph/ceph-client.0.157151.asok 2023-10-06T11:18:33.163 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.157151.asok 2023-10-06T11:18:33.164 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:18:33.164 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.157151.asok status 2023-10-06T11:18:33.314 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:18:33.314 INFO:teuthology.orchestra.run.smithi146.stdout: "metadata": { 2023-10-06T11:18:33.314 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T11:18:33.314 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T11:18:33.314 INFO:teuthology.orchestra.run.smithi146.stdout: "entity_id": "0", 2023-10-06T11:18:33.314 INFO:teuthology.orchestra.run.smithi146.stdout: "hostname": "smithi146", 2023-10-06T11:18:33.315 INFO:teuthology.orchestra.run.smithi146.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T11:18:33.315 INFO:teuthology.orchestra.run.smithi146.stdout: "pid": "157151", 2023-10-06T11:18:33.315 INFO:teuthology.orchestra.run.smithi146.stdout: "root": "/" 2023-10-06T11:18:33.315 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:18:33.315 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_count": 0, 2023-10-06T11:18:33.315 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_pinned_count": 0, 2023-10-06T11:18:33.315 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 10263, 2023-10-06T11:18:33.315 INFO:teuthology.orchestra.run.smithi146.stdout: "inst": { 2023-10-06T11:18:33.315 INFO:teuthology.orchestra.run.smithi146.stdout: "name": { 2023-10-06T11:18:33.315 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "client", 2023-10-06T11:18:33.315 INFO:teuthology.orchestra.run.smithi146.stdout: "num": 10263 2023-10-06T11:18:33.315 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:18:33.315 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-06T11:18:33.316 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-06T11:18:33.316 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:18:33.316 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 2869722169 2023-10-06T11:18:33.316 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:18:33.316 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:18:33.316 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-06T11:18:33.316 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-06T11:18:33.316 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:18:33.316 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 2869722169 2023-10-06T11:18:33.316 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:18:33.316 INFO:teuthology.orchestra.run.smithi146.stdout: "inst_str": "client.10263 192.168.0.1:0/2869722169", 2023-10-06T11:18:33.317 INFO:teuthology.orchestra.run.smithi146.stdout: "addr_str": "192.168.0.1:0/2869722169", 2023-10-06T11:18:33.317 INFO:teuthology.orchestra.run.smithi146.stdout: "inode_count": 1, 2023-10-06T11:18:33.317 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_epoch": 136, 2023-10-06T11:18:33.317 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch": 164, 2023-10-06T11:18:33.317 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch_barrier": 0, 2023-10-06T11:18:33.317 INFO:teuthology.orchestra.run.smithi146.stdout: "blocklisted": false, 2023-10-06T11:18:33.317 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs" 2023-10-06T11:18:33.317 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:18:33.324 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:18:33.324 DEBUG:teuthology.orchestra.run.smithi146:> stat --file-system '--printf=%T 2023-10-06T11:18:33.324 DEBUG:teuthology.orchestra.run.smithi146:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T11:18:33.339 INFO:teuthology.orchestra.run.smithi146.stdout:fuseblk 2023-10-06T11:18:33.340 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T11:18:33.340 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:18:33.340 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:18:33.404 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T11:18:33.405 DEBUG:teuthology.orchestra.run.smithi146:> import os 2023-10-06T11:18:33.405 DEBUG:teuthology.orchestra.run.smithi146:> import uuid 2023-10-06T11:18:33.405 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:18:33.405 DEBUG:teuthology.orchestra.run.smithi146:> n = 1000 2023-10-06T11:18:33.405 DEBUG:teuthology.orchestra.run.smithi146:> create_hard_links = False 2023-10-06T11:18:33.405 DEBUG:teuthology.orchestra.run.smithi146:> if 0 > 0: 2023-10-06T11:18:33.405 DEBUG:teuthology.orchestra.run.smithi146:> create_hard_links = True 2023-10-06T11:18:33.405 DEBUG:teuthology.orchestra.run.smithi146:> path = "/home/ubuntu/cephtest/mnt.0/scrub-new-files/file" 2023-10-06T11:18:33.405 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:18:33.405 DEBUG:teuthology.orchestra.run.smithi146:> dpath = os.path.dirname(path) 2023-10-06T11:18:33.405 DEBUG:teuthology.orchestra.run.smithi146:> fnameprefix = os.path.basename(path) 2023-10-06T11:18:33.405 DEBUG:teuthology.orchestra.run.smithi146:> os.makedirs(dpath, exist_ok=True) 2023-10-06T11:18:33.405 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:18:33.406 DEBUG:teuthology.orchestra.run.smithi146:> try: 2023-10-06T11:18:33.406 DEBUG:teuthology.orchestra.run.smithi146:> dirfd = os.open(dpath, os.O_DIRECTORY) 2023-10-06T11:18:33.406 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:18:33.406 DEBUG:teuthology.orchestra.run.smithi146:> for i in range(n): 2023-10-06T11:18:33.406 DEBUG:teuthology.orchestra.run.smithi146:> fpath = os.path.join(dpath, f"{fnameprefix}_{i}") 2023-10-06T11:18:33.406 DEBUG:teuthology.orchestra.run.smithi146:> with open(fpath, '"'"'w'"'"') as f: 2023-10-06T11:18:33.406 DEBUG:teuthology.orchestra.run.smithi146:> f.write(f"{i}") 2023-10-06T11:18:33.406 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2023-10-06T11:18:33.406 DEBUG:teuthology.orchestra.run.smithi146:> f.flush() 2023-10-06T11:18:33.406 DEBUG:teuthology.orchestra.run.smithi146:> os.fsync(f.fileno()) 2023-10-06T11:18:33.406 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2023-10-06T11:18:33.406 DEBUG:teuthology.orchestra.run.smithi146:> os.unlink(fpath) 2023-10-06T11:18:33.406 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2023-10-06T11:18:33.407 DEBUG:teuthology.orchestra.run.smithi146:> os.fsync(dirfd) 2023-10-06T11:18:33.407 DEBUG:teuthology.orchestra.run.smithi146:> if create_hard_links: 2023-10-06T11:18:33.407 DEBUG:teuthology.orchestra.run.smithi146:> for j in range(0): 2023-10-06T11:18:33.407 DEBUG:teuthology.orchestra.run.smithi146:> os.system(f"ln {fpath} {dpath}/{fnameprefix}_{i}_{uuid.uuid4()}") 2023-10-06T11:18:33.407 DEBUG:teuthology.orchestra.run.smithi146:> if False: 2023-10-06T11:18:33.407 DEBUG:teuthology.orchestra.run.smithi146:> os.fsync(dirfd) 2023-10-06T11:18:33.407 DEBUG:teuthology.orchestra.run.smithi146:> finally: 2023-10-06T11:18:33.407 DEBUG:teuthology.orchestra.run.smithi146:> os.close(dirfd) 2023-10-06T11:18:33.407 DEBUG:teuthology.orchestra.run.smithi146:> ' 2023-10-06T11:18:35.299 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.12:0 scrub status 2023-10-06T11:18:35.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.454+0000 7f7813216700 1 Processor -- start 2023-10-06T11:18:35.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.454+0000 7f7813216700 1 -- start start 2023-10-06T11:18:35.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.455+0000 7f7813216700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f780c0b0930 0x7f780c0aef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:35.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.455+0000 7f7813216700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f780c0cb8a0 con 0x7f780c159450 2023-10-06T11:18:35.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.455+0000 7f7813216700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f780c159c70 con 0x7f780c159820 2023-10-06T11:18:35.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.455+0000 7f7813216700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f780c0b2f20 con 0x7f780c0b0930 2023-10-06T11:18:35.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.455+0000 7f7810fb2700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f780c159450 0x7f780c15dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52162/0 (socket says 172.21.15.146:52162) 2023-10-06T11:18:35.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.455+0000 7f7810fb2700 1 -- 172.21.15.146:0/3261571701 learned_addr learned my addr 172.21.15.146:0/3261571701 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:35.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.456+0000 7f78117b3700 1 --2- 172.21.15.146:0/3261571701 >> v2:172.21.15.151:3300/0 conn(0x7f780c0b0930 0x7f780c0aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:35.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.456+0000 7f780b7fe700 1 -- 172.21.15.146:0/3261571701 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1854301870 0 0) 0x7f780c0cb8a0 con 0x7f780c159450 2023-10-06T11:18:35.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.456+0000 7f780b7fe700 1 -- 172.21.15.146:0/3261571701 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77f8003570 con 0x7f780c159450 2023-10-06T11:18:35.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.456+0000 7f78117b3700 1 -- 172.21.15.146:0/3261571701 >> v1:172.21.15.151:6789/0 conn(0x7f780c159820 legacy=0x7f780c0b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:35.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.456+0000 7f78117b3700 1 -- 172.21.15.146:0/3261571701 >> v1:172.21.15.146:6789/0 conn(0x7f780c159450 legacy=0x7f780c15dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:35.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.456+0000 7f78117b3700 1 -- 172.21.15.146:0/3261571701 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f780c0b2960 con 0x7f780c0b0930 2023-10-06T11:18:35.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.456+0000 7f78117b3700 1 --2- 172.21.15.146:0/3261571701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f780c0b0930 0x7f780c0aef90 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f78040098e0 tx=0x7f78040091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=171a566827d4cd0f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:35.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.456+0000 7f780b7fe700 1 -- 172.21.15.146:0/3261571701 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780400b640 con 0x7f780c0b0930 2023-10-06T11:18:35.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.456+0000 7f780b7fe700 1 -- 172.21.15.146:0/3261571701 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780400b7a0 con 0x7f780c0b0930 2023-10-06T11:18:35.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.456+0000 7f780b7fe700 1 -- 172.21.15.146:0/3261571701 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780400bb40 con 0x7f780c0b0930 2023-10-06T11:18:35.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.457+0000 7f7813216700 1 -- 172.21.15.146:0/3261571701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f780c0b0930 msgr2=0x7f780c0aef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:35.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.457+0000 7f7813216700 1 --2- 172.21.15.146:0/3261571701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f780c0b0930 0x7f780c0aef90 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f78040098e0 tx=0x7f78040091a0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.457+0000 7f7813216700 1 -- 172.21.15.146:0/3261571701 shutdown_connections 2023-10-06T11:18:35.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.457+0000 7f7813216700 1 --2- 172.21.15.146:0/3261571701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f780c0b0930 0x7f780c0aef90 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.457+0000 7f7813216700 1 -- 172.21.15.146:0/3261571701 >> 172.21.15.146:0/3261571701 conn(0x7f780c06eb10 msgr2=0x7f780c06ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:35.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.457+0000 7f7813216700 1 -- 172.21.15.146:0/3261571701 shutdown_connections 2023-10-06T11:18:35.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.457+0000 7f7813216700 1 -- 172.21.15.146:0/3261571701 wait complete. 2023-10-06T11:18:35.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.458+0000 7f7813216700 1 Processor -- start 2023-10-06T11:18:35.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.458+0000 7f7813216700 1 -- start start 2023-10-06T11:18:35.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.459+0000 7f7813216700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f780c0b0930 0x7f780c159e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:35.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.459+0000 7f7813216700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f780c159450 0x7f780c15c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:35.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.459+0000 7f7813216700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f780c159820 0x7f780c1586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:35.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.459+0000 7f7813216700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780c15a730 con 0x7f780c0b0930 2023-10-06T11:18:35.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.459+0000 7f7813216700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780c15aa10 con 0x7f780c159820 2023-10-06T11:18:35.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.459+0000 7f7813216700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780c15acf0 con 0x7f780c159450 2023-10-06T11:18:35.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.459+0000 7f7810fb2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f780c0b0930 0x7f780c159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:35.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.459+0000 7f7810fb2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f780c0b0930 0x7f780c159e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40932/0 (socket says 172.21.15.146:40932) 2023-10-06T11:18:35.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.459+0000 7f78117b3700 1 --2- 172.21.15.146:0/884941331 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f780c159820 0x7f780c1586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:35.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.459+0000 7f7810fb2700 1 -- 172.21.15.146:0/884941331 learned_addr learned my addr 172.21.15.146:0/884941331 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:35.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.459+0000 7f780bfff700 1 --2- 172.21.15.146:0/884941331 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f780c159450 0x7f780c15c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:35.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.459+0000 7f7810fb2700 1 -- 172.21.15.146:0/884941331 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f780c159450 msgr2=0x7f780c15c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:35.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.459+0000 7f7810fb2700 1 --2- 172.21.15.146:0/884941331 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f780c159450 0x7f780c15c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.459+0000 7f7810fb2700 1 -- 172.21.15.146:0/884941331 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f780c159820 msgr2=0x7f780c1586e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:35.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.459+0000 7f7810fb2700 1 --2- 172.21.15.146:0/884941331 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f780c159820 0x7f780c1586e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.459+0000 7f7810fb2700 1 -- 172.21.15.146:0/884941331 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7804009420 con 0x7f780c0b0930 2023-10-06T11:18:35.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.459+0000 7f78117b3700 1 --2- 172.21.15.146:0/884941331 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f780c159820 0x7f780c1586e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:18:35.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.459+0000 7f7810fb2700 1 --2- 172.21.15.146:0/884941331 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f780c0b0930 0x7f780c159e30 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 crypto rx=0x7f77fc00cd30 tx=0x7f77fc001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:35.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.459+0000 7f7808ff9700 1 -- 172.21.15.146:0/884941331 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc00ce90 con 0x7f780c0b0930 2023-10-06T11:18:35.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.459+0000 7f7808ff9700 1 -- 172.21.15.146:0/884941331 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77fc00aac0 con 0x7f780c0b0930 2023-10-06T11:18:35.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.459+0000 7f7813216700 1 -- 172.21.15.146:0/884941331 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f780c15afd0 con 0x7f780c0b0930 2023-10-06T11:18:35.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.459+0000 7f7808ff9700 1 -- 172.21.15.146:0/884941331 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc00aea0 con 0x7f780c0b0930 2023-10-06T11:18:35.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.459+0000 7f7813216700 1 -- 172.21.15.146:0/884941331 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f780c15a370 con 0x7f780c0b0930 2023-10-06T11:18:35.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.461+0000 7f7808ff9700 1 -- 172.21.15.146:0/884941331 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f77fc007300 con 0x7f780c0b0930 2023-10-06T11:18:35.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.461+0000 7f7808ff9700 1 --2- 172.21.15.146:0/884941331 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f77ec066f30 0x7f77ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:35.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.461+0000 7f7808ff9700 1 -- 172.21.15.146:0/884941331 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f77fc084a80 con 0x7f780c0b0930 2023-10-06T11:18:35.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.462+0000 7f780bfff700 1 --2- 172.21.15.146:0/884941331 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f77ec066f30 0x7f77ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:35.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.462+0000 7f780bfff700 1 --2- 172.21.15.146:0/884941331 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f77ec066f30 0x7f77ec0693e0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f780c06f9b0 tx=0x7f77f4007ec0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:35.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.463+0000 7f781c50eb80 1 Processor -- start 2023-10-06T11:18:35.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.463+0000 7f781c50eb80 1 -- start start 2023-10-06T11:18:35.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.464+0000 7f781c50eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d9e631ae0 0x564d9e631eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:35.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.464+0000 7f781c50eb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d9e5ed9f0 0x564d9e5ea5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:35.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.464+0000 7f781c50eb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564d9e5ebc20 0x564d9e5eab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:35.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.464+0000 7f781c50eb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d9e56acd0 con 0x564d9e5ed9f0 2023-10-06T11:18:35.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.464+0000 7f781c50eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d9e541ac0 con 0x564d9e631ae0 2023-10-06T11:18:35.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.464+0000 7f781c50eb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x564d9e53f2c0 con 0x564d9e5ebc20 2023-10-06T11:18:35.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.464+0000 7f780bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d9e5ed9f0 0x564d9e5ea5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:35.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.464+0000 7f780bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d9e5ed9f0 0x564d9e5ea5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40944/0 (socket says 172.21.15.146:40944) 2023-10-06T11:18:35.481 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.464+0000 7f780bfff700 1 -- 172.21.15.146:0/171323523 learned_addr learned my addr 172.21.15.146:0/171323523 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:35.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.464+0000 7f780bfff700 1 -- 172.21.15.146:0/171323523 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564d9e5ebc20 msgr2=0x564d9e5eab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:35.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.464+0000 7f780bfff700 1 --2- 172.21.15.146:0/171323523 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564d9e5ebc20 0x564d9e5eab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.464+0000 7f7810fb2700 1 --2- 172.21.15.146:0/171323523 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d9e631ae0 0x564d9e631eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:35.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.464+0000 7f780bfff700 1 -- 172.21.15.146:0/171323523 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d9e631ae0 msgr2=0x564d9e631eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:35.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.464+0000 7f780bfff700 1 --2- 172.21.15.146:0/171323523 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d9e631ae0 0x564d9e631eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.482 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.464+0000 7f780bfff700 1 -- 172.21.15.146:0/171323523 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d9e3d52c0 con 0x564d9e5ed9f0 2023-10-06T11:18:35.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.465+0000 7f780bfff700 1 --2- 172.21.15.146:0/171323523 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d9e5ed9f0 0x564d9e5ea5d0 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 crypto rx=0x7f77f40028f0 tx=0x7f77f4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3efe1308392f9ddf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:35.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.465+0000 7f7801ffb700 1 -- 172.21.15.146:0/171323523 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f4003670 con 0x564d9e5ed9f0 2023-10-06T11:18:35.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.465+0000 7f7801ffb700 1 -- 172.21.15.146:0/171323523 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f4014660 con 0x564d9e5ed9f0 2023-10-06T11:18:35.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.465+0000 7f7801ffb700 1 -- 172.21.15.146:0/171323523 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f40149e0 con 0x564d9e5ed9f0 2023-10-06T11:18:35.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.465+0000 7f781c50eb80 1 -- 172.21.15.146:0/171323523 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d9e5ed9f0 msgr2=0x564d9e5ea5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:35.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.465+0000 7f781c50eb80 1 --2- 172.21.15.146:0/171323523 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d9e5ed9f0 0x564d9e5ea5d0 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 crypto rx=0x7f77f40028f0 tx=0x7f77f4015000 comp rx=0 tx=0).stop 2023-10-06T11:18:35.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.465+0000 7f781c50eb80 1 -- 172.21.15.146:0/171323523 shutdown_connections 2023-10-06T11:18:35.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.465+0000 7f781c50eb80 1 --2- 172.21.15.146:0/171323523 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564d9e5ebc20 0x564d9e5eab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.465+0000 7f781c50eb80 1 --2- 172.21.15.146:0/171323523 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d9e631ae0 0x564d9e631eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.465+0000 7f781c50eb80 1 --2- 172.21.15.146:0/171323523 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d9e5ed9f0 0x564d9e5ea5d0 unknown :-1 s=CLOSED pgs=2131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.465+0000 7f781c50eb80 1 -- 172.21.15.146:0/171323523 >> 172.21.15.146:0/171323523 conn(0x564d9e5ec0c0 msgr2=0x564d9e5ec490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:35.484 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.465+0000 7f781c50eb80 1 -- 172.21.15.146:0/171323523 shutdown_connections 2023-10-06T11:18:35.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.465+0000 7f781c50eb80 1 -- 172.21.15.146:0/171323523 wait complete. 2023-10-06T11:18:35.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.466+0000 7f781c50eb80 1 -- start start 2023-10-06T11:18:35.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.466+0000 7f781c50eb80 1 Processor -- start 2023-10-06T11:18:35.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.467+0000 7f781c50eb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d9e5ebc20 0x564d9e62e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:35.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.467+0000 7f781c50eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d9e5ed9f0 0x564d9e628a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:35.485 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.467+0000 7f781c50eb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564d9e631ae0 0x564d9e628f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:35.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.467+0000 7f781c50eb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d9e53b0b0 con 0x564d9e5ebc20 2023-10-06T11:18:35.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.467+0000 7f781c50eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d9e4e68e0 con 0x564d9e5ed9f0 2023-10-06T11:18:35.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.467+0000 7f781c50eb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x564d9e501ef0 con 0x564d9e631ae0 2023-10-06T11:18:35.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.467+0000 7f781c50eb80 10 client.0 _ll_register_callbacks cb 0x564d9e3d7f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:18:35.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.467+0000 7f7810fb2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d9e5ebc20 0x564d9e62e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:35.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.467+0000 7f7810fb2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d9e5ebc20 0x564d9e62e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40958/0 (socket says 172.21.15.146:40958) 2023-10-06T11:18:35.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.467+0000 7f7810fb2700 1 -- 172.21.15.146:0/2089789348 learned_addr learned my addr 172.21.15.146:0/2089789348 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:35.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.467+0000 7f7810fb2700 1 -- 172.21.15.146:0/2089789348 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564d9e631ae0 msgr2=0x564d9e628f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:35.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.467+0000 7f7810fb2700 1 --2- 172.21.15.146:0/2089789348 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564d9e631ae0 0x564d9e628f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.467+0000 7f7810fb2700 1 -- 172.21.15.146:0/2089789348 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d9e5ed9f0 msgr2=0x564d9e628a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:35.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.467+0000 7f7810fb2700 1 --2- 172.21.15.146:0/2089789348 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d9e5ed9f0 0x564d9e628a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.467+0000 7f7810fb2700 1 -- 172.21.15.146:0/2089789348 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f780c159c70 con 0x564d9e5ebc20 2023-10-06T11:18:35.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.467+0000 7f7810fb2700 1 --2- 172.21.15.146:0/2089789348 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d9e5ebc20 0x564d9e62e490 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7f77fc051d70 tx=0x7f77fc082d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33e6d02b9d3f279c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:35.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.467+0000 7f77eaffd700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:18:35.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.467+0000 7f77eaffd700 1 -- 172.21.15.146:0/2089789348 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc081070 con 0x564d9e5ebc20 2023-10-06T11:18:35.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.468+0000 7f781c50eb80 1 -- 172.21.15.146:0/2089789348 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564d9e5df6e0 con 0x564d9e5ebc20 2023-10-06T11:18:35.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.468+0000 7f77eaffd700 1 -- 172.21.15.146:0/2089789348 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(165..165 src has 1..165) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f77fc054d60 con 0x564d9e5ebc20 2023-10-06T11:18:35.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.468+0000 7f77eaffd700 1 -- 172.21.15.146:0/2089789348 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77fc0553b0 con 0x564d9e5ebc20 2023-10-06T11:18:35.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.468+0000 7f781c50eb80 10 client.10275 fetch_fsmap learned FSMap version 136 2023-10-06T11:18:35.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.468+0000 7f781c50eb80 1 -- 172.21.15.146:0/2089789348 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=2+}) v3 -- 0x564d9e378030 con 0x564d9e5ebc20 2023-10-06T11:18:35.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.468+0000 7f77eaffd700 1 -- 172.21.15.146:0/2089789348 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564d9e5df6e0 con 0x564d9e5ebc20 2023-10-06T11:18:35.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.468+0000 7f77eaffd700 1 -- 172.21.15.146:0/2089789348 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 136) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f77fc05c380 con 0x564d9e5ebc20 2023-10-06T11:18:35.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.468+0000 7f781c50eb80 10 client.10275 fetch_fsmap finished waiting for FSMap version 136 2023-10-06T11:18:35.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.468+0000 7f781c50eb80 10 client.10275 resolve_mds: resolved 12:0 to role '12:0' aka daemon mds.a 2023-10-06T11:18:35.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.468+0000 7f781c50eb80 20 client.10275 populate_metadata read hostname 'smithi146' 2023-10-06T11:18:35.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.468+0000 7f781c50eb80 1 --2- 172.21.15.146:0/2089789348 >> [v2:172.21.15.146:6835/1340411581,v1:172.21.15.146:6837/1340411581] conn(0x564d9e612c80 0x564d9e613070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:35.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.468+0000 7f781c50eb80 4 client.10275 mds_command: new command op to 10080 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:18:35.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.468+0000 7f781c50eb80 1 -- 172.21.15.146:0/2089789348 --> [v2:172.21.15.146:6835/1340411581,v1:172.21.15.146:6837/1340411581] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564d9e5bc610 con 0x564d9e612c80 2023-10-06T11:18:35.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.468+0000 7f780bfff700 1 --2- 172.21.15.146:0/2089789348 >> [v2:172.21.15.146:6835/1340411581,v1:172.21.15.146:6837/1340411581] conn(0x564d9e612c80 0x564d9e613070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:35.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.468+0000 7f77eaffd700 10 client.10275 ms_handle_connect on v2:172.21.15.146:6835/1340411581 2023-10-06T11:18:35.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.468+0000 7f780bfff700 1 --2- 172.21.15.146:0/2089789348 >> [v2:172.21.15.146:6835/1340411581,v1:172.21.15.146:6837/1340411581] conn(0x564d9e612c80 0x564d9e613070 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f58bf79d1a2eb863 server_cookie=318d02157ad450d7 in_seq=0 out_seq=0 2023-10-06T11:18:35.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.469+0000 7f77eaffd700 1 -- 172.21.15.146:0/2089789348 <== mds.0 v2:172.21.15.146:6835/1340411581 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x564d9e5bc610 con 0x564d9e612c80 2023-10-06T11:18:35.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.469+0000 7f77eaffd700 10 client.10275 handle_command_reply: tid=0 2023-10-06T11:18:35.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.469+0000 7f781c50eb80 1 client.10275 shutdown 2023-10-06T11:18:35.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.469+0000 7f781c50eb80 1 -- 172.21.15.146:0/2089789348 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d9e5ebc20 msgr2=0x564d9e62e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:35.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.469+0000 7f781c50eb80 1 --2- 172.21.15.146:0/2089789348 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d9e5ebc20 0x564d9e62e490 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7f77fc051d70 tx=0x7f77fc082d40 comp rx=0 tx=0).stop 2023-10-06T11:18:35.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.469+0000 7f781c50eb80 1 -- 172.21.15.146:0/2089789348 shutdown_connections 2023-10-06T11:18:35.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.469+0000 7f781c50eb80 1 --2- 172.21.15.146:0/2089789348 >> [v2:172.21.15.146:6835/1340411581,v1:172.21.15.146:6837/1340411581] conn(0x564d9e612c80 0x564d9e613070 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.469+0000 7f781c50eb80 1 --2- 172.21.15.146:0/2089789348 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564d9e631ae0 0x564d9e628f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.469+0000 7f77eaffd700 0 client.10275 ms_handle_reset on v2:172.21.15.146:6835/1340411581 2023-10-06T11:18:35.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.469+0000 7f781c50eb80 1 --2- 172.21.15.146:0/2089789348 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d9e5ebc20 0x564d9e62e490 unknown :-1 s=CLOSED pgs=2132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.469+0000 7f781c50eb80 1 --2- 172.21.15.146:0/2089789348 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d9e5ed9f0 0x564d9e628a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.469+0000 7f781c50eb80 1 -- 172.21.15.146:0/2089789348 >> 172.21.15.146:0/2089789348 conn(0x564d9e5ec0c0 msgr2=0x564d9e631050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:35.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.469+0000 7f781c50eb80 1 -- 172.21.15.146:0/2089789348 shutdown_connections 2023-10-06T11:18:35.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.469+0000 7f781c50eb80 1 -- 172.21.15.146:0/2089789348 wait complete. 2023-10-06T11:18:35.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.469+0000 7f781c50eb80 20 client.10275 trim_cache size 0 max 16384 2023-10-06T11:18:35.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.485+0000 7f781c50eb80 1 Processor -- start 2023-10-06T11:18:35.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.485+0000 7f781c50eb80 1 -- start start 2023-10-06T11:18:35.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.486+0000 7f781c50eb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564d9e5ebc20 0x564d9e6160d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:35.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.486+0000 7f781c50eb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d9e5ed9f0 0x564d9e6304a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:35.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.486+0000 7f781c50eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d9e631ae0 0x564d9e6272b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:35.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.486+0000 7f781c50eb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d9e3bde80 con 0x564d9e5ed9f0 2023-10-06T11:18:35.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.486+0000 7f781c50eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d9e5ecd50 con 0x564d9e631ae0 2023-10-06T11:18:35.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.486+0000 7f781c50eb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x564d9e628830 con 0x564d9e5ebc20 2023-10-06T11:18:35.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.486+0000 7f780bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d9e5ed9f0 0x564d9e6304a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:35.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.486+0000 7f780bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d9e5ed9f0 0x564d9e6304a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40970/0 (socket says 172.21.15.146:40970) 2023-10-06T11:18:35.502 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.486+0000 7f780bfff700 1 -- 172.21.15.146:0/2381637996 learned_addr learned my addr 172.21.15.146:0/2381637996 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:35.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.486+0000 7f780bfff700 1 -- 172.21.15.146:0/2381637996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564d9e5ebc20 msgr2=0x564d9e6160d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:35.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.486+0000 7f780bfff700 1 --2- 172.21.15.146:0/2381637996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564d9e5ebc20 0x564d9e6160d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.486+0000 7f780bfff700 1 -- 172.21.15.146:0/2381637996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d9e631ae0 msgr2=0x564d9e6272b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:35.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.486+0000 7f780bfff700 1 --2- 172.21.15.146:0/2381637996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d9e631ae0 0x564d9e6272b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.486+0000 7f780bfff700 1 -- 172.21.15.146:0/2381637996 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564d9e62b840 con 0x564d9e5ed9f0 2023-10-06T11:18:35.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.486+0000 7f780bfff700 1 --2- 172.21.15.146:0/2381637996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d9e5ed9f0 0x564d9e6304a0 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 crypto rx=0x7f77f40028f0 tx=0x7f77f4031250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fcc9c5ec52b28ea server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:35.503 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.487+0000 7f78027fc700 1 -- 172.21.15.146:0/2381637996 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f40036f0 con 0x564d9e5ed9f0 2023-10-06T11:18:35.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.487+0000 7f78027fc700 1 -- 172.21.15.146:0/2381637996 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f4031040 con 0x564d9e5ed9f0 2023-10-06T11:18:35.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.487+0000 7f78027fc700 1 -- 172.21.15.146:0/2381637996 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f40147d0 con 0x564d9e5ed9f0 2023-10-06T11:18:35.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.487+0000 7f781c50eb80 1 -- 172.21.15.146:0/2381637996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d9e5ed9f0 msgr2=0x564d9e6304a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:35.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.487+0000 7f781c50eb80 1 --2- 172.21.15.146:0/2381637996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d9e5ed9f0 0x564d9e6304a0 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 crypto rx=0x7f77f40028f0 tx=0x7f77f4031250 comp rx=0 tx=0).stop 2023-10-06T11:18:35.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.487+0000 7f781c50eb80 1 -- 172.21.15.146:0/2381637996 shutdown_connections 2023-10-06T11:18:35.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.487+0000 7f781c50eb80 1 --2- 172.21.15.146:0/2381637996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d9e631ae0 0x564d9e6272b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.504 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.487+0000 7f781c50eb80 1 --2- 172.21.15.146:0/2381637996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564d9e5ebc20 0x564d9e6160d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.487+0000 7f781c50eb80 1 --2- 172.21.15.146:0/2381637996 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d9e5ed9f0 0x564d9e6304a0 unknown :-1 s=CLOSED pgs=2133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.487+0000 7f781c50eb80 1 -- 172.21.15.146:0/2381637996 >> 172.21.15.146:0/2381637996 conn(0x564d9e5ec0c0 msgr2=0x564d9e628d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:35.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.487+0000 7f781c50eb80 1 -- 172.21.15.146:0/2381637996 shutdown_connections 2023-10-06T11:18:35.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.487+0000 7f781c50eb80 1 -- 172.21.15.146:0/2381637996 wait complete. 2023-10-06T11:18:35.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.488+0000 7f781c50eb80 1 -- start start 2023-10-06T11:18:35.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.488+0000 7f781c50eb80 1 Processor -- start 2023-10-06T11:18:35.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.489+0000 7f781c50eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d9e5ebc20 0x564d9e62c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:35.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.489+0000 7f781c50eb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564d9e5ed9f0 0x564d9e611740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:35.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.489+0000 7f781c50eb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d9e631ae0 0x564d9e690250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:35.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.489+0000 7f781c50eb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d9e61ad60 con 0x564d9e631ae0 2023-10-06T11:18:35.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.489+0000 7f781c50eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x564d9e5eb460 con 0x564d9e5ebc20 2023-10-06T11:18:35.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.489+0000 7f781c50eb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x564d9e61ab50 con 0x564d9e5ed9f0 2023-10-06T11:18:35.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.489+0000 7f781c50eb80 10 client.0 _ll_register_callbacks cb 0x564d9e3d7f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:18:35.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.489+0000 7f78117b3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d9e631ae0 0x564d9e690250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:35.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.489+0000 7f7810fb2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d9e5ebc20 0x564d9e62c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:35.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.489+0000 7f78117b3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d9e631ae0 0x564d9e690250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40978/0 (socket says 172.21.15.146:40978) 2023-10-06T11:18:35.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.489+0000 7f78117b3700 1 -- 172.21.15.146:0/1684347269 learned_addr learned my addr 172.21.15.146:0/1684347269 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:35.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.489+0000 7f780bfff700 1 --2- 172.21.15.146:0/1684347269 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564d9e5ed9f0 0x564d9e611740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:35.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.489+0000 7f78117b3700 1 -- 172.21.15.146:0/1684347269 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564d9e5ed9f0 msgr2=0x564d9e611740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:35.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.489+0000 7f78117b3700 1 --2- 172.21.15.146:0/1684347269 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564d9e5ed9f0 0x564d9e611740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.489+0000 7f78117b3700 1 -- 172.21.15.146:0/1684347269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d9e5ebc20 msgr2=0x564d9e62c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:35.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.489+0000 7f78117b3700 1 --2- 172.21.15.146:0/1684347269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d9e5ebc20 0x564d9e62c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.489+0000 7f78117b3700 1 -- 172.21.15.146:0/1684347269 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564d9e3d52c0 con 0x564d9e631ae0 2023-10-06T11:18:35.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.489+0000 7f7810fb2700 1 --2- 172.21.15.146:0/1684347269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d9e5ebc20 0x564d9e62c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:18:35.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.489+0000 7f78117b3700 1 --2- 172.21.15.146:0/1684347269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d9e631ae0 0x564d9e690250 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7f7804013000 tx=0x7f7804017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9d3cf787a675db9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:35.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.489+0000 7f77eaffd700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:18:35.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.489+0000 7f77eaffd700 1 -- 172.21.15.146:0/1684347269 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7804021070 con 0x564d9e631ae0 2023-10-06T11:18:35.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.489+0000 7f77eaffd700 1 -- 172.21.15.146:0/1684347269 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(165..165 src has 1..165) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f780401ba00 con 0x564d9e631ae0 2023-10-06T11:18:35.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.489+0000 7f781c50eb80 1 -- 172.21.15.146:0/1684347269 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f77f4014660 con 0x564d9e631ae0 2023-10-06T11:18:35.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.490+0000 7f77eaffd700 1 -- 172.21.15.146:0/1684347269 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) v2 ==== 24+0+0 (secure 0 0 0) 0x7f780401bdd0 con 0x564d9e631ae0 2023-10-06T11:18:35.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.490+0000 7f781c50eb80 10 client.10281 fetch_fsmap learned FSMap version 136 2023-10-06T11:18:35.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.490+0000 7f781c50eb80 1 -- 172.21.15.146:0/1684347269 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=2+}) v3 -- 0x564d9e5097d0 con 0x564d9e631ae0 2023-10-06T11:18:35.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.490+0000 7f77eaffd700 1 -- 172.21.15.146:0/1684347269 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f4014660 con 0x564d9e631ae0 2023-10-06T11:18:35.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.490+0000 7f77eaffd700 1 -- 172.21.15.146:0/1684347269 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 136) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f7804025430 con 0x564d9e631ae0 2023-10-06T11:18:35.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.490+0000 7f781c50eb80 10 client.10281 fetch_fsmap finished waiting for FSMap version 136 2023-10-06T11:18:35.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.490+0000 7f781c50eb80 10 client.10281 resolve_mds: resolved 12:0 to role '12:0' aka daemon mds.a 2023-10-06T11:18:35.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.490+0000 7f781c50eb80 20 client.10281 populate_metadata read hostname 'smithi146' 2023-10-06T11:18:35.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.490+0000 7f781c50eb80 1 --2- 172.21.15.146:0/1684347269 >> [v2:172.21.15.146:6835/1340411581,v1:172.21.15.146:6837/1340411581] conn(0x564d9e6348b0 0x564d9e690790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:35.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.490+0000 7f781c50eb80 4 client.10281 mds_command: new command op to 10080 tid=0[{"prefix": "scrub status"}] 2023-10-06T11:18:35.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.490+0000 7f781c50eb80 1 -- 172.21.15.146:0/1684347269 --> [v2:172.21.15.146:6835/1340411581,v1:172.21.15.146:6837/1340411581] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564d9e4dde50 con 0x564d9e6348b0 2023-10-06T11:18:35.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.490+0000 7f7810fb2700 1 --2- 172.21.15.146:0/1684347269 >> [v2:172.21.15.146:6835/1340411581,v1:172.21.15.146:6837/1340411581] conn(0x564d9e6348b0 0x564d9e690790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:35.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.490+0000 7f77eaffd700 10 client.10281 ms_handle_connect on v2:172.21.15.146:6835/1340411581 2023-10-06T11:18:35.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.490+0000 7f7810fb2700 1 --2- 172.21.15.146:0/1684347269 >> [v2:172.21.15.146:6835/1340411581,v1:172.21.15.146:6837/1340411581] conn(0x564d9e6348b0 0x564d9e690790 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea5e8f7ba2c56ebd server_cookie=11743f2587eac4e5 in_seq=0 out_seq=0 2023-10-06T11:18:35.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.490+0000 7f77eaffd700 1 -- 172.21.15.146:0/1684347269 <== mds.0 v2:172.21.15.146:6835/1340411581 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x564d9e4dde50 con 0x564d9e6348b0 2023-10-06T11:18:35.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.490+0000 7f77eaffd700 10 client.10281 handle_command_reply: tid=0 2023-10-06T11:18:35.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.490+0000 7f781c50eb80 1 client.10281 shutdown 2023-10-06T11:18:35.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.491+0000 7f781c50eb80 1 -- 172.21.15.146:0/1684347269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d9e631ae0 msgr2=0x564d9e690250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:35.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.491+0000 7f781c50eb80 1 --2- 172.21.15.146:0/1684347269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d9e631ae0 0x564d9e690250 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7f7804013000 tx=0x7f7804017000 comp rx=0 tx=0).stop 2023-10-06T11:18:35.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.491+0000 7f781c50eb80 1 -- 172.21.15.146:0/1684347269 shutdown_connections 2023-10-06T11:18:35.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.491+0000 7f781c50eb80 1 --2- 172.21.15.146:0/1684347269 >> [v2:172.21.15.146:6835/1340411581,v1:172.21.15.146:6837/1340411581] conn(0x564d9e6348b0 0x564d9e690790 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.491+0000 7f781c50eb80 1 --2- 172.21.15.146:0/1684347269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x564d9e631ae0 0x564d9e690250 unknown :-1 s=CLOSED pgs=2134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.491+0000 7f781c50eb80 1 --2- 172.21.15.146:0/1684347269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564d9e5ebc20 0x564d9e62c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.491+0000 7f77eaffd700 0 client.10281 ms_handle_reset on v2:172.21.15.146:6835/1340411581 2023-10-06T11:18:35.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.491+0000 7f781c50eb80 1 --2- 172.21.15.146:0/1684347269 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x564d9e5ed9f0 0x564d9e611740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.491+0000 7f781c50eb80 1 -- 172.21.15.146:0/1684347269 >> 172.21.15.146:0/1684347269 conn(0x564d9e5ec0c0 msgr2=0x564d9e630660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:35.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.491+0000 7f781c50eb80 1 -- 172.21.15.146:0/1684347269 shutdown_connections 2023-10-06T11:18:35.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.491+0000 7f781c50eb80 1 -- 172.21.15.146:0/1684347269 wait complete. 2023-10-06T11:18:35.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.491+0000 7f781c50eb80 20 client.10281 trim_cache size 0 max 16384 2023-10-06T11:18:35.512 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:18:35.513 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "no active scrubs running", 2023-10-06T11:18:35.513 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": {} 2023-10-06T11:18:35.513 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:18:35.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.491+0000 7f7813216700 1 -- 172.21.15.146:0/884941331 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f77ec066f30 msgr2=0x7f77ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:35.515 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.491+0000 7f7813216700 1 --2- 172.21.15.146:0/884941331 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f77ec066f30 0x7f77ec0693e0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f780c06f9b0 tx=0x7f77f4007ec0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.491+0000 7f7813216700 1 -- 172.21.15.146:0/884941331 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f780c0b0930 msgr2=0x7f780c159e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:35.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.491+0000 7f7813216700 1 --2- 172.21.15.146:0/884941331 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f780c0b0930 0x7f780c159e30 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 crypto rx=0x7f77fc00cd30 tx=0x7f77fc001b10 comp rx=0 tx=0).stop 2023-10-06T11:18:35.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.491+0000 7f7813216700 1 -- 172.21.15.146:0/884941331 shutdown_connections 2023-10-06T11:18:35.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.491+0000 7f7813216700 1 --2- 172.21.15.146:0/884941331 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f77ec066f30 0x7f77ec0693e0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.491+0000 7f7813216700 1 --2- 172.21.15.146:0/884941331 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f780c159820 0x7f780c1586e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.491+0000 7f7813216700 1 --2- 172.21.15.146:0/884941331 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f780c0b0930 0x7f780c159e30 unknown :-1 s=CLOSED pgs=2130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.491+0000 7f7813216700 1 --2- 172.21.15.146:0/884941331 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f780c159450 0x7f780c15c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.491+0000 7f7813216700 1 -- 172.21.15.146:0/884941331 >> 172.21.15.146:0/884941331 conn(0x7f780c06eb10 msgr2=0x7f780c15d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:35.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.491+0000 7f7813216700 1 -- 172.21.15.146:0/884941331 shutdown_connections 2023-10-06T11:18:35.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.491+0000 7f7813216700 1 -- 172.21.15.146:0/884941331 wait complete. 2023-10-06T11:18:35.517 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-06T11:18:35.518 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.12:0 damage ls 2023-10-06T11:18:35.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.632+0000 7f452c8ad700 1 Processor -- start 2023-10-06T11:18:35.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.632+0000 7f452c8ad700 1 -- start start 2023-10-06T11:18:35.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.633+0000 7f452c8ad700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4528159820 0x7f45280b0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:35.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.633+0000 7f452c8ad700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45280cb8a0 con 0x7f45280b0760 2023-10-06T11:18:35.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.633+0000 7f452c8ad700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4528159c70 con 0x7f4528159450 2023-10-06T11:18:35.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.633+0000 7f452c8ad700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45280b2f20 con 0x7f4528159820 2023-10-06T11:18:35.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.633+0000 7f4526d9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f45280b0760 0x7f45280aef90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52166/0 (socket says 172.21.15.146:52166) 2023-10-06T11:18:35.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.633+0000 7f4526d9d700 1 -- 172.21.15.146:0/1944612920 learned_addr learned my addr 172.21.15.146:0/1944612920 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:35.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.633+0000 7f4525d9b700 1 --2- 172.21.15.146:0/1944612920 >> v2:172.21.15.151:3300/0 conn(0x7f4528159820 0x7f45280b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:35.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.633+0000 7f452559a700 1 -- 172.21.15.146:0/1944612920 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 296530702 0 0) 0x7f45280cb8a0 con 0x7f45280b0760 2023-10-06T11:18:35.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.633+0000 7f452559a700 1 -- 172.21.15.146:0/1944612920 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4510003570 con 0x7f45280b0760 2023-10-06T11:18:35.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.633+0000 7f452559a700 1 -- 172.21.15.146:0/1944612920 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3568204087 0 0) 0x7f4510003570 con 0x7f45280b0760 2023-10-06T11:18:35.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.633+0000 7f452559a700 1 -- 172.21.15.146:0/1944612920 >> v2:172.21.15.151:3300/0 conn(0x7f4528159820 msgr2=0x7f45280b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:35.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.633+0000 7f452559a700 1 --2- 172.21.15.146:0/1944612920 >> v2:172.21.15.151:3300/0 conn(0x7f4528159820 0x7f45280b0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.633+0000 7f452559a700 1 -- 172.21.15.146:0/1944612920 >> v1:172.21.15.151:6789/0 conn(0x7f4528159450 legacy=0x7f452815dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:35.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.633+0000 7f452559a700 1 -- 172.21.15.146:0/1944612920 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45280b0b90 con 0x7f45280b0760 2023-10-06T11:18:35.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.633+0000 7f452559a700 1 -- 172.21.15.146:0/1944612920 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f45200017f0 con 0x7f45280b0760 2023-10-06T11:18:35.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.633+0000 7f452559a700 1 -- 172.21.15.146:0/1944612920 >> v1:172.21.15.146:6789/0 conn(0x7f45280b0760 legacy=0x7f45280aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:35.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.633+0000 7f452559a700 1 --2- 172.21.15.146:0/1944612920 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4510003a60 0x7f4510003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:35.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.633+0000 7f452559a700 1 --2- 172.21.15.146:0/1944612920 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4510004810 0x7f4510004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:35.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.633+0000 7f452559a700 1 --2- 172.21.15.146:0/1944612920 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f45100051c0 0x7f451000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:35.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.633+0000 7f452559a700 1 -- 172.21.15.146:0/1944612920 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45280b2f20 con 0x7f4510003a60 2023-10-06T11:18:35.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.633+0000 7f452559a700 1 -- 172.21.15.146:0/1944612920 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451000c160 con 0x7f4510004810 2023-10-06T11:18:35.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.633+0000 7f452559a700 1 -- 172.21.15.146:0/1944612920 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f451000c320 con 0x7f45100051c0 2023-10-06T11:18:35.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.633+0000 7f452659c700 1 --2- 172.21.15.146:0/1944612920 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4510003a60 0x7f4510003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:35.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.633+0000 7f4525d9b700 1 --2- 172.21.15.146:0/1944612920 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4510004810 0x7f4510004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:35.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.634+0000 7f4526d9d700 1 --2- 172.21.15.146:0/1944612920 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f45100051c0 0x7f451000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:35.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.634+0000 7f452659c700 1 -- 172.21.15.146:0/1944612920 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f45100051c0 msgr2=0x7f451000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:35.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.634+0000 7f452659c700 1 --2- 172.21.15.146:0/1944612920 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f45100051c0 0x7f451000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.634+0000 7f452659c700 1 -- 172.21.15.146:0/1944612920 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4510004810 msgr2=0x7f4510004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:35.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.634+0000 7f452659c700 1 --2- 172.21.15.146:0/1944612920 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4510004810 0x7f4510004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.634+0000 7f452659c700 1 -- 172.21.15.146:0/1944612920 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4510003570 con 0x7f4510003a60 2023-10-06T11:18:35.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.634+0000 7f4526d9d700 1 -- 172.21.15.146:0/1944612920 reap_dead start 2023-10-06T11:18:35.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.634+0000 7f452659c700 1 --2- 172.21.15.146:0/1944612920 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4510003a60 0x7f4510003e70 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 crypto rx=0x7f45180018b0 tx=0x7f4518007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=835244190ea2cc79 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:35.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.634+0000 7f452559a700 1 -- 172.21.15.146:0/1944612920 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4518012420 con 0x7f4510003a60 2023-10-06T11:18:35.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.634+0000 7f452559a700 1 -- 172.21.15.146:0/1944612920 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45180125a0 con 0x7f4510003a60 2023-10-06T11:18:35.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.634+0000 7f452559a700 1 -- 172.21.15.146:0/1944612920 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4518012960 con 0x7f4510003a60 2023-10-06T11:18:35.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.634+0000 7f452c8ad700 1 -- 172.21.15.146:0/1944612920 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4510003a60 msgr2=0x7f4510003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:35.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.634+0000 7f452c8ad700 1 --2- 172.21.15.146:0/1944612920 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4510003a60 0x7f4510003e70 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 crypto rx=0x7f45180018b0 tx=0x7f4518007d30 comp rx=0 tx=0).stop 2023-10-06T11:18:35.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.635+0000 7f452c8ad700 1 -- 172.21.15.146:0/1944612920 shutdown_connections 2023-10-06T11:18:35.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.635+0000 7f452c8ad700 1 --2- 172.21.15.146:0/1944612920 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4510003a60 0x7f4510003e70 unknown :-1 s=CLOSED pgs=2136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.635+0000 7f452c8ad700 1 -- 172.21.15.146:0/1944612920 >> 172.21.15.146:0/1944612920 conn(0x7f452806eb10 msgr2=0x7f452806ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:35.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.635+0000 7f452c8ad700 1 -- 172.21.15.146:0/1944612920 shutdown_connections 2023-10-06T11:18:35.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.635+0000 7f452c8ad700 1 -- 172.21.15.146:0/1944612920 wait complete. 2023-10-06T11:18:35.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.636+0000 7f452c8ad700 1 Processor -- start 2023-10-06T11:18:35.641 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.636+0000 7f452c8ad700 1 -- start start 2023-10-06T11:18:35.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.636+0000 7f452c8ad700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4510003a60 0x7f45281697a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:35.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.636+0000 7f452c8ad700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f452816d500 0x7f452816d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:35.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.636+0000 7f452c8ad700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f45280cbb80 0x7f45280cc020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:35.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.636+0000 7f452c8ad700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45280c8080 con 0x7f4510003a60 2023-10-06T11:18:35.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.636+0000 7f452c8ad700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f452816deb0 con 0x7f45280cbb80 2023-10-06T11:18:35.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.636+0000 7f452c8ad700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45280cd450 con 0x7f452816d500 2023-10-06T11:18:35.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.637+0000 7f452659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4510003a60 0x7f45281697a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:35.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.637+0000 7f452659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4510003a60 0x7f45281697a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40998/0 (socket says 172.21.15.146:40998) 2023-10-06T11:18:35.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.637+0000 7f452659c700 1 -- 172.21.15.146:0/1443081352 learned_addr learned my addr 172.21.15.146:0/1443081352 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:35.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.637+0000 7f4525d9b700 1 --2- 172.21.15.146:0/1443081352 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f452816d500 0x7f452816d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:35.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.637+0000 7f4526d9d700 1 --2- 172.21.15.146:0/1443081352 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f45280cbb80 0x7f45280cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:35.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.637+0000 7f452659c700 1 -- 172.21.15.146:0/1443081352 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f452816d500 msgr2=0x7f452816d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:35.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.637+0000 7f452659c700 1 --2- 172.21.15.146:0/1443081352 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f452816d500 0x7f452816d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.637+0000 7f452659c700 1 -- 172.21.15.146:0/1443081352 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f45280cbb80 msgr2=0x7f45280cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:35.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.637+0000 7f452659c700 1 --2- 172.21.15.146:0/1443081352 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f45280cbb80 0x7f45280cc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.637+0000 7f452659c700 1 -- 172.21.15.146:0/1443081352 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45280cc840 con 0x7f4510003a60 2023-10-06T11:18:35.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.637+0000 7f452659c700 1 --2- 172.21.15.146:0/1443081352 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4510003a60 0x7f45281697a0 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 crypto rx=0x7f451000c130 tx=0x7f4518015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:35.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.637+0000 7f45167fc700 1 -- 172.21.15.146:0/1443081352 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451801f6f0 con 0x7f4510003a60 2023-10-06T11:18:35.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.637+0000 7f45167fc700 1 -- 172.21.15.146:0/1443081352 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451801f850 con 0x7f4510003a60 2023-10-06T11:18:35.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.637+0000 7f452c8ad700 1 -- 172.21.15.146:0/1443081352 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45280ccb20 con 0x7f4510003a60 2023-10-06T11:18:35.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.637+0000 7f45167fc700 1 -- 172.21.15.146:0/1443081352 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451801fbd0 con 0x7f4510003a60 2023-10-06T11:18:35.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.637+0000 7f452c8ad700 1 -- 172.21.15.146:0/1443081352 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45280cd0e0 con 0x7f4510003a60 2023-10-06T11:18:35.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.639+0000 7f45167fc700 1 -- 172.21.15.146:0/1443081352 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f451800c420 con 0x7f4510003a60 2023-10-06T11:18:35.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.639+0000 7f45167fc700 1 --2- 172.21.15.146:0/1443081352 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4508066f30 0x7f45080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:35.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.639+0000 7f45167fc700 1 -- 172.21.15.146:0/1443081352 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f4518085e30 con 0x7f4510003a60 2023-10-06T11:18:35.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.639+0000 7f4525d9b700 1 --2- 172.21.15.146:0/1443081352 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4508066f30 0x7f45080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:35.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.640+0000 7f4525d9b700 1 --2- 172.21.15.146:0/1443081352 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4508066f30 0x7f45080693e0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f45280caa80 tx=0x7f451c0091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:35.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.641+0000 7f4535ba5b80 1 Processor -- start 2023-10-06T11:18:35.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.641+0000 7f4535ba5b80 1 -- start start 2023-10-06T11:18:35.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.642+0000 7f4535ba5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557803dffae0 0x557803dffeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:35.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.642+0000 7f4535ba5b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557803dbb9f0 0x557803db85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:35.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.642+0000 7f4535ba5b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557803db9c20 0x557803db8b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:35.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.642+0000 7f4535ba5b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x557803d38cd0 con 0x557803db9c20 2023-10-06T11:18:35.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.642+0000 7f4535ba5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557803d0fac0 con 0x557803dffae0 2023-10-06T11:18:35.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.642+0000 7f4535ba5b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x557803d0d2c0 con 0x557803dbb9f0 2023-10-06T11:18:35.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.642+0000 7f4526d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557803db9c20 0x557803db8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:35.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.642+0000 7f4526d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557803db9c20 0x557803db8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41014/0 (socket says 172.21.15.146:41014) 2023-10-06T11:18:35.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.642+0000 7f4526d9d700 1 -- 172.21.15.146:0/3037623022 learned_addr learned my addr 172.21.15.146:0/3037623022 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:35.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.642+0000 7f4525d9b700 1 --2- 172.21.15.146:0/3037623022 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557803dbb9f0 0x557803db85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:35.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.642+0000 7f452659c700 1 --2- 172.21.15.146:0/3037623022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557803dffae0 0x557803dffeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:35.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.642+0000 7f4526d9d700 1 -- 172.21.15.146:0/3037623022 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557803dbb9f0 msgr2=0x557803db85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:35.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.642+0000 7f4526d9d700 1 --2- 172.21.15.146:0/3037623022 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557803dbb9f0 0x557803db85d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.642+0000 7f4526d9d700 1 -- 172.21.15.146:0/3037623022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557803dffae0 msgr2=0x557803dffeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:35.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.642+0000 7f4526d9d700 1 --2- 172.21.15.146:0/3037623022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557803dffae0 0x557803dffeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.642+0000 7f4526d9d700 1 -- 172.21.15.146:0/3037623022 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557803ba32c0 con 0x557803db9c20 2023-10-06T11:18:35.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.642+0000 7f452659c700 1 --2- 172.21.15.146:0/3037623022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557803dffae0 0x557803dffeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:18:35.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.643+0000 7f4526d9d700 1 --2- 172.21.15.146:0/3037623022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557803db9c20 0x557803db8b10 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 crypto rx=0x7f45280b1500 tx=0x7f4520006040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa9ab8c87d4abfa5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:35.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.643+0000 7f45077fe700 1 -- 172.21.15.146:0/3037623022 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4520007960 con 0x557803db9c20 2023-10-06T11:18:35.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.643+0000 7f45077fe700 1 -- 172.21.15.146:0/3037623022 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4520007ac0 con 0x557803db9c20 2023-10-06T11:18:35.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.643+0000 7f45077fe700 1 -- 172.21.15.146:0/3037623022 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4520015670 con 0x557803db9c20 2023-10-06T11:18:35.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.643+0000 7f4535ba5b80 1 -- 172.21.15.146:0/3037623022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557803db9c20 msgr2=0x557803db8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:35.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.643+0000 7f4535ba5b80 1 --2- 172.21.15.146:0/3037623022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557803db9c20 0x557803db8b10 secure :-1 s=READY pgs=2138 cs=0 l=1 rev1=1 crypto rx=0x7f45280b1500 tx=0x7f4520006040 comp rx=0 tx=0).stop 2023-10-06T11:18:35.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.643+0000 7f4535ba5b80 1 -- 172.21.15.146:0/3037623022 shutdown_connections 2023-10-06T11:18:35.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.643+0000 7f4535ba5b80 1 --2- 172.21.15.146:0/3037623022 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557803db9c20 0x557803db8b10 unknown :-1 s=CLOSED pgs=2138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.643+0000 7f4535ba5b80 1 --2- 172.21.15.146:0/3037623022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557803dffae0 0x557803dffeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.643+0000 7f4535ba5b80 1 --2- 172.21.15.146:0/3037623022 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557803dbb9f0 0x557803db85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.643+0000 7f4535ba5b80 1 -- 172.21.15.146:0/3037623022 >> 172.21.15.146:0/3037623022 conn(0x557803dba0c0 msgr2=0x557803dba490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:35.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.644+0000 7f4535ba5b80 1 -- 172.21.15.146:0/3037623022 shutdown_connections 2023-10-06T11:18:35.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.644+0000 7f4535ba5b80 1 -- 172.21.15.146:0/3037623022 wait complete. 2023-10-06T11:18:35.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.644+0000 7f4535ba5b80 1 -- start start 2023-10-06T11:18:35.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.644+0000 7f4535ba5b80 1 Processor -- start 2023-10-06T11:18:35.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.645+0000 7f4535ba5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557803db9c20 0x557803ddf380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:35.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.645+0000 7f4535ba5b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557803dbb9f0 0x557803dfc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:35.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.645+0000 7f4535ba5b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557803dffae0 0x557803db3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:35.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.645+0000 7f4535ba5b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x557803d090b0 con 0x557803dbb9f0 2023-10-06T11:18:35.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.645+0000 7f4535ba5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557803cb48e0 con 0x557803db9c20 2023-10-06T11:18:35.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.645+0000 7f4535ba5b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x557803ccfef0 con 0x557803dffae0 2023-10-06T11:18:35.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.645+0000 7f4525d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557803dbb9f0 0x557803dfc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:35.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.645+0000 7f4535ba5b80 10 client.0 _ll_register_callbacks cb 0x557803ba5f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:18:35.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.645+0000 7f4525d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557803dbb9f0 0x557803dfc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41026/0 (socket says 172.21.15.146:41026) 2023-10-06T11:18:35.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.645+0000 7f4525d9b700 1 -- 172.21.15.146:0/2150005378 learned_addr learned my addr 172.21.15.146:0/2150005378 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:35.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.645+0000 7f4526d9d700 1 --2- 172.21.15.146:0/2150005378 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557803dffae0 0x557803db3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:35.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.645+0000 7f452659c700 1 --2- 172.21.15.146:0/2150005378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557803db9c20 0x557803ddf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:35.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.645+0000 7f4525d9b700 1 -- 172.21.15.146:0/2150005378 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557803dffae0 msgr2=0x557803db3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:35.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.645+0000 7f4525d9b700 1 --2- 172.21.15.146:0/2150005378 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557803dffae0 0x557803db3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.645+0000 7f4525d9b700 1 -- 172.21.15.146:0/2150005378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557803db9c20 msgr2=0x557803ddf380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:35.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.645+0000 7f4525d9b700 1 --2- 172.21.15.146:0/2150005378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557803db9c20 0x557803ddf380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.646+0000 7f4525d9b700 1 -- 172.21.15.146:0/2150005378 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45280cd0e0 con 0x557803dbb9f0 2023-10-06T11:18:35.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.646+0000 7f4525d9b700 1 --2- 172.21.15.146:0/2150005378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557803dbb9f0 0x557803dfc890 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 crypto rx=0x7f4528061120 tx=0x7f451c01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb8a8ee21d2e0289 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:35.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.646+0000 7f4504ff9700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:18:35.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.646+0000 7f4504ff9700 1 -- 172.21.15.146:0/2150005378 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451c015d80 con 0x557803dbb9f0 2023-10-06T11:18:35.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.646+0000 7f4504ff9700 1 -- 172.21.15.146:0/2150005378 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(165..165 src has 1..165) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f451c02dcb0 con 0x557803dbb9f0 2023-10-06T11:18:35.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.646+0000 7f4535ba5b80 1 -- 172.21.15.146:0/2150005378 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557803dad6e0 con 0x557803dbb9f0 2023-10-06T11:18:35.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.646+0000 7f4504ff9700 1 -- 172.21.15.146:0/2150005378 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) v2 ==== 24+0+0 (secure 0 0 0) 0x7f451c02de70 con 0x557803dbb9f0 2023-10-06T11:18:35.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.646+0000 7f4535ba5b80 10 client.10293 fetch_fsmap learned FSMap version 136 2023-10-06T11:18:35.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.646+0000 7f4535ba5b80 1 -- 172.21.15.146:0/2150005378 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=2+}) v3 -- 0x7f45280b0b90 con 0x557803dbb9f0 2023-10-06T11:18:35.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.646+0000 7f4504ff9700 1 -- 172.21.15.146:0/2150005378 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557803dad6e0 con 0x557803dbb9f0 2023-10-06T11:18:35.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.646+0000 7f4504ff9700 1 -- 172.21.15.146:0/2150005378 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 136) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f451c01d070 con 0x557803dbb9f0 2023-10-06T11:18:35.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.646+0000 7f4535ba5b80 10 client.10293 fetch_fsmap finished waiting for FSMap version 136 2023-10-06T11:18:35.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.646+0000 7f4535ba5b80 10 client.10293 resolve_mds: resolved 12:0 to role '12:0' aka daemon mds.a 2023-10-06T11:18:35.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.646+0000 7f4535ba5b80 20 client.10293 populate_metadata read hostname 'smithi146' 2023-10-06T11:18:35.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.646+0000 7f4535ba5b80 1 --2- 172.21.15.146:0/2150005378 >> [v2:172.21.15.146:6835/1340411581,v1:172.21.15.146:6837/1340411581] conn(0x557803de5a90 0x557803de2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:35.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.646+0000 7f4535ba5b80 4 client.10293 mds_command: new command op to 10080 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:18:35.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.646+0000 7f4535ba5b80 1 -- 172.21.15.146:0/2150005378 --> [v2:172.21.15.146:6835/1340411581,v1:172.21.15.146:6837/1340411581] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557803d8a610 con 0x557803de5a90 2023-10-06T11:18:35.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.646+0000 7f452659c700 1 --2- 172.21.15.146:0/2150005378 >> [v2:172.21.15.146:6835/1340411581,v1:172.21.15.146:6837/1340411581] conn(0x557803de5a90 0x557803de2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:35.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.647+0000 7f4504ff9700 10 client.10293 ms_handle_connect on v2:172.21.15.146:6835/1340411581 2023-10-06T11:18:35.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.647+0000 7f452659c700 1 --2- 172.21.15.146:0/2150005378 >> [v2:172.21.15.146:6835/1340411581,v1:172.21.15.146:6837/1340411581] conn(0x557803de5a90 0x557803de2ec0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d4b2c29af560ae8 server_cookie=d7514a4fd689d87a in_seq=0 out_seq=0 2023-10-06T11:18:35.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.647+0000 7f4504ff9700 1 -- 172.21.15.146:0/2150005378 <== mds.0 v2:172.21.15.146:6835/1340411581 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x557803d8a610 con 0x557803de5a90 2023-10-06T11:18:35.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.647+0000 7f4504ff9700 10 client.10293 handle_command_reply: tid=0 2023-10-06T11:18:35.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.647+0000 7f4535ba5b80 1 client.10293 shutdown 2023-10-06T11:18:35.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.647+0000 7f4535ba5b80 1 -- 172.21.15.146:0/2150005378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557803dbb9f0 msgr2=0x557803dfc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:35.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.647+0000 7f4535ba5b80 1 --2- 172.21.15.146:0/2150005378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557803dbb9f0 0x557803dfc890 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 crypto rx=0x7f4528061120 tx=0x7f451c01c000 comp rx=0 tx=0).stop 2023-10-06T11:18:35.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.647+0000 7f4535ba5b80 1 -- 172.21.15.146:0/2150005378 shutdown_connections 2023-10-06T11:18:35.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.647+0000 7f4535ba5b80 1 --2- 172.21.15.146:0/2150005378 >> [v2:172.21.15.146:6835/1340411581,v1:172.21.15.146:6837/1340411581] conn(0x557803de5a90 0x557803de2ec0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.647+0000 7f4535ba5b80 1 --2- 172.21.15.146:0/2150005378 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557803dffae0 0x557803db3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.647+0000 7f4504ff9700 0 client.10293 ms_handle_reset on v2:172.21.15.146:6835/1340411581 2023-10-06T11:18:35.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.647+0000 7f4535ba5b80 1 --2- 172.21.15.146:0/2150005378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557803db9c20 0x557803ddf380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.647+0000 7f4535ba5b80 1 --2- 172.21.15.146:0/2150005378 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557803dbb9f0 0x557803dfc890 unknown :-1 s=CLOSED pgs=2139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.647+0000 7f4535ba5b80 1 -- 172.21.15.146:0/2150005378 >> 172.21.15.146:0/2150005378 conn(0x557803dba0c0 msgr2=0x557803dfefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:35.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.647+0000 7f4535ba5b80 1 -- 172.21.15.146:0/2150005378 shutdown_connections 2023-10-06T11:18:35.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.648+0000 7f4535ba5b80 1 -- 172.21.15.146:0/2150005378 wait complete. 2023-10-06T11:18:35.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.648+0000 7f4535ba5b80 20 client.10293 trim_cache size 0 max 16384 2023-10-06T11:18:35.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.660+0000 7f4535ba5b80 1 Processor -- start 2023-10-06T11:18:35.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.660+0000 7f4535ba5b80 1 -- start start 2023-10-06T11:18:35.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.661+0000 7f4535ba5b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557803db9c20 0x557803de8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:35.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.661+0000 7f4535ba5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557803dbb9f0 0x557803e0dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:35.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.661+0000 7f4535ba5b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557803dffae0 0x557803dde3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:35.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.661+0000 7f4535ba5b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x557803b8be80 con 0x557803db9c20 2023-10-06T11:18:35.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.661+0000 7f4535ba5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557803dfd3c0 con 0x557803dbb9f0 2023-10-06T11:18:35.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.661+0000 7f4535ba5b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x557803db43e0 con 0x557803dffae0 2023-10-06T11:18:35.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.661+0000 7f452659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557803db9c20 0x557803de8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:35.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.661+0000 7f452659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557803db9c20 0x557803de8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41040/0 (socket says 172.21.15.146:41040) 2023-10-06T11:18:35.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.661+0000 7f452659c700 1 -- 172.21.15.146:0/2213334888 learned_addr learned my addr 172.21.15.146:0/2213334888 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:35.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.661+0000 7f4526d9d700 1 --2- 172.21.15.146:0/2213334888 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557803dffae0 0x557803dde3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:35.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.661+0000 7f4525d9b700 1 --2- 172.21.15.146:0/2213334888 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557803dbb9f0 0x557803e0dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:35.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.661+0000 7f452659c700 1 -- 172.21.15.146:0/2213334888 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557803dffae0 msgr2=0x557803dde3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:35.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.661+0000 7f452659c700 1 --2- 172.21.15.146:0/2213334888 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557803dffae0 0x557803dde3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.661+0000 7f452659c700 1 -- 172.21.15.146:0/2213334888 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557803dbb9f0 msgr2=0x557803e0dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:35.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.661+0000 7f452659c700 1 --2- 172.21.15.146:0/2213334888 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557803dbb9f0 0x557803e0dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.661+0000 7f452659c700 1 -- 172.21.15.146:0/2213334888 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557803b46030 con 0x557803db9c20 2023-10-06T11:18:35.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.661+0000 7f452659c700 1 --2- 172.21.15.146:0/2213334888 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557803db9c20 0x557803de8220 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7f451800c3f0 tx=0x7f4518059040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8d28f168c189a5d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:35.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.661+0000 7f4507fff700 1 -- 172.21.15.146:0/2213334888 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45180572c0 con 0x557803db9c20 2023-10-06T11:18:35.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.661+0000 7f4507fff700 1 -- 172.21.15.146:0/2213334888 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4518056bc0 con 0x557803db9c20 2023-10-06T11:18:35.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.661+0000 7f4507fff700 1 -- 172.21.15.146:0/2213334888 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4518059e10 con 0x557803db9c20 2023-10-06T11:18:35.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.662+0000 7f4535ba5b80 1 -- 172.21.15.146:0/2213334888 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557803db9c20 msgr2=0x557803de8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:35.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.662+0000 7f4535ba5b80 1 --2- 172.21.15.146:0/2213334888 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557803db9c20 0x557803de8220 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7f451800c3f0 tx=0x7f4518059040 comp rx=0 tx=0).stop 2023-10-06T11:18:35.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.662+0000 7f4535ba5b80 1 -- 172.21.15.146:0/2213334888 shutdown_connections 2023-10-06T11:18:35.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.662+0000 7f4535ba5b80 1 --2- 172.21.15.146:0/2213334888 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557803dffae0 0x557803dde3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.662+0000 7f4535ba5b80 1 --2- 172.21.15.146:0/2213334888 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557803db9c20 0x557803de8220 unknown :-1 s=CLOSED pgs=2140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.662+0000 7f4535ba5b80 1 --2- 172.21.15.146:0/2213334888 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557803dbb9f0 0x557803e0dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.662+0000 7f4535ba5b80 1 -- 172.21.15.146:0/2213334888 >> 172.21.15.146:0/2213334888 conn(0x557803dba0c0 msgr2=0x557803de1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:35.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.662+0000 7f4535ba5b80 1 -- 172.21.15.146:0/2213334888 shutdown_connections 2023-10-06T11:18:35.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.662+0000 7f4535ba5b80 1 -- 172.21.15.146:0/2213334888 wait complete. 2023-10-06T11:18:35.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.662+0000 7f4535ba5b80 1 -- start start 2023-10-06T11:18:35.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.662+0000 7f4535ba5b80 1 Processor -- start 2023-10-06T11:18:35.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.663+0000 7f4535ba5b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557803db9c20 0x557803dfe2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:35.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.663+0000 7f4535ba5b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557803dbb9f0 0x557803dfe810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:35.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.663+0000 7f4535ba5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557803dffae0 0x557803dfed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:35.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.663+0000 7f4535ba5b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x557803de3c60 con 0x557803db9c20 2023-10-06T11:18:35.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.663+0000 7f4535ba5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557803dfb720 con 0x557803dffae0 2023-10-06T11:18:35.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.663+0000 7f4535ba5b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x557803e65850 con 0x557803dbb9f0 2023-10-06T11:18:35.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.663+0000 7f4535ba5b80 10 client.0 _ll_register_callbacks cb 0x557803ba5f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:18:35.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.663+0000 7f452659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557803db9c20 0x557803dfe2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:35.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.663+0000 7f452659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557803db9c20 0x557803dfe2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41044/0 (socket says 172.21.15.146:41044) 2023-10-06T11:18:35.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.664+0000 7f452659c700 1 -- 172.21.15.146:0/4044808071 learned_addr learned my addr 172.21.15.146:0/4044808071 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:35.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.664+0000 7f4525d9b700 1 --2- 172.21.15.146:0/4044808071 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557803dbb9f0 0x557803dfe810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:35.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.664+0000 7f4526d9d700 1 --2- 172.21.15.146:0/4044808071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557803dffae0 0x557803dfed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:35.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.664+0000 7f452659c700 1 -- 172.21.15.146:0/4044808071 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557803dbb9f0 msgr2=0x557803dfe810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:35.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.664+0000 7f452659c700 1 --2- 172.21.15.146:0/4044808071 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557803dbb9f0 0x557803dfe810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.664+0000 7f452659c700 1 -- 172.21.15.146:0/4044808071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557803dffae0 msgr2=0x557803dfed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:35.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.664+0000 7f452659c700 1 --2- 172.21.15.146:0/4044808071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557803dffae0 0x557803dfed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.664+0000 7f452659c700 1 -- 172.21.15.146:0/4044808071 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45280ccb20 con 0x557803db9c20 2023-10-06T11:18:35.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.664+0000 7f452659c700 1 --2- 172.21.15.146:0/4044808071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557803db9c20 0x557803dfe2d0 secure :-1 s=READY pgs=2141 cs=0 l=1 rev1=1 crypto rx=0x7f451800c3f0 tx=0x7f4518070000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17f2776e7f346ba8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:35.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.664+0000 7f4504ff9700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:18:35.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.664+0000 7f4504ff9700 1 -- 172.21.15.146:0/4044808071 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451805db60 con 0x557803db9c20 2023-10-06T11:18:35.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.664+0000 7f4504ff9700 1 -- 172.21.15.146:0/4044808071 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(165..165 src has 1..165) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f4518059e10 con 0x557803db9c20 2023-10-06T11:18:35.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.664+0000 7f4535ba5b80 1 -- 172.21.15.146:0/4044808071 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4520007ac0 con 0x557803db9c20 2023-10-06T11:18:35.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.664+0000 7f4504ff9700 1 -- 172.21.15.146:0/4044808071 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=136) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4518057030 con 0x557803db9c20 2023-10-06T11:18:35.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.664+0000 7f4535ba5b80 10 client.10299 fetch_fsmap learned FSMap version 136 2023-10-06T11:18:35.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.664+0000 7f4535ba5b80 1 -- 172.21.15.146:0/4044808071 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=136,monmap=2+}) v3 -- 0x557803cd77d0 con 0x557803db9c20 2023-10-06T11:18:35.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.664+0000 7f4504ff9700 1 -- 172.21.15.146:0/4044808071 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4518061080 con 0x557803db9c20 2023-10-06T11:18:35.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.664+0000 7f4504ff9700 1 -- 172.21.15.146:0/4044808071 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 136) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f45180560b0 con 0x557803db9c20 2023-10-06T11:18:35.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.664+0000 7f4535ba5b80 10 client.10299 fetch_fsmap finished waiting for FSMap version 136 2023-10-06T11:18:35.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.664+0000 7f4535ba5b80 10 client.10299 resolve_mds: resolved 12:0 to role '12:0' aka daemon mds.a 2023-10-06T11:18:35.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.664+0000 7f4535ba5b80 20 client.10299 populate_metadata read hostname 'smithi146' 2023-10-06T11:18:35.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.664+0000 7f4535ba5b80 1 --2- 172.21.15.146:0/4044808071 >> [v2:172.21.15.146:6835/1340411581,v1:172.21.15.146:6837/1340411581] conn(0x557803e5ede0 0x557803df8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:35.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.664+0000 7f4535ba5b80 4 client.10299 mds_command: new command op to 10080 tid=0[{"prefix": "damage ls"}] 2023-10-06T11:18:35.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.664+0000 7f4535ba5b80 1 -- 172.21.15.146:0/4044808071 --> [v2:172.21.15.146:6835/1340411581,v1:172.21.15.146:6837/1340411581] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x557803cabe50 con 0x557803e5ede0 2023-10-06T11:18:35.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.665+0000 7f4525d9b700 1 --2- 172.21.15.146:0/4044808071 >> [v2:172.21.15.146:6835/1340411581,v1:172.21.15.146:6837/1340411581] conn(0x557803e5ede0 0x557803df8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:35.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.665+0000 7f4504ff9700 10 client.10299 ms_handle_connect on v2:172.21.15.146:6835/1340411581 2023-10-06T11:18:35.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.665+0000 7f4525d9b700 1 --2- 172.21.15.146:0/4044808071 >> [v2:172.21.15.146:6835/1340411581,v1:172.21.15.146:6837/1340411581] conn(0x557803e5ede0 0x557803df8f70 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=465f73df2fe7816 server_cookie=c74e0ec20e20e701 in_seq=0 out_seq=0 2023-10-06T11:18:35.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.665+0000 7f4504ff9700 1 -- 172.21.15.146:0/4044808071 <== mds.0 v2:172.21.15.146:6835/1340411581 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x557803cabe50 con 0x557803e5ede0 2023-10-06T11:18:35.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.665+0000 7f4504ff9700 10 client.10299 handle_command_reply: tid=0 2023-10-06T11:18:35.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.665+0000 7f4535ba5b80 1 client.10299 shutdown 2023-10-06T11:18:35.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.665+0000 7f4535ba5b80 1 -- 172.21.15.146:0/4044808071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557803db9c20 msgr2=0x557803dfe2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:35.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.665+0000 7f4535ba5b80 1 --2- 172.21.15.146:0/4044808071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557803db9c20 0x557803dfe2d0 secure :-1 s=READY pgs=2141 cs=0 l=1 rev1=1 crypto rx=0x7f451800c3f0 tx=0x7f4518070000 comp rx=0 tx=0).stop 2023-10-06T11:18:35.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.665+0000 7f4535ba5b80 1 -- 172.21.15.146:0/4044808071 shutdown_connections 2023-10-06T11:18:35.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.665+0000 7f4535ba5b80 1 --2- 172.21.15.146:0/4044808071 >> [v2:172.21.15.146:6835/1340411581,v1:172.21.15.146:6837/1340411581] conn(0x557803e5ede0 0x557803df8f70 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.665+0000 7f4535ba5b80 1 --2- 172.21.15.146:0/4044808071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557803dffae0 0x557803dfed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.665+0000 7f4504ff9700 0 client.10299 ms_handle_reset on v2:172.21.15.146:6835/1340411581 2023-10-06T11:18:35.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.665+0000 7f4535ba5b80 1 --2- 172.21.15.146:0/4044808071 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557803db9c20 0x557803dfe2d0 unknown :-1 s=CLOSED pgs=2141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.665+0000 7f4535ba5b80 1 --2- 172.21.15.146:0/4044808071 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557803dbb9f0 0x557803dfe810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.665+0000 7f4535ba5b80 1 -- 172.21.15.146:0/4044808071 >> 172.21.15.146:0/4044808071 conn(0x557803dba0c0 msgr2=0x557803dde3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:35.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.665+0000 7f4535ba5b80 1 -- 172.21.15.146:0/4044808071 shutdown_connections 2023-10-06T11:18:35.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.665+0000 7f4535ba5b80 1 -- 172.21.15.146:0/4044808071 wait complete. 2023-10-06T11:18:35.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.665+0000 7f4535ba5b80 20 client.10299 trim_cache size 0 max 16384 2023-10-06T11:18:35.676 INFO:teuthology.orchestra.run.smithi146.stdout:[] 2023-10-06T11:18:35.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.666+0000 7f452c8ad700 1 -- 172.21.15.146:0/1443081352 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4508066f30 msgr2=0x7f45080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:35.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.666+0000 7f452c8ad700 1 --2- 172.21.15.146:0/1443081352 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4508066f30 0x7f45080693e0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f45280caa80 tx=0x7f451c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.666+0000 7f452c8ad700 1 -- 172.21.15.146:0/1443081352 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4510003a60 msgr2=0x7f45281697a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:35.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.666+0000 7f452c8ad700 1 --2- 172.21.15.146:0/1443081352 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4510003a60 0x7f45281697a0 secure :-1 s=READY pgs=2137 cs=0 l=1 rev1=1 crypto rx=0x7f451000c130 tx=0x7f4518015000 comp rx=0 tx=0).stop 2023-10-06T11:18:35.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.666+0000 7f452c8ad700 1 -- 172.21.15.146:0/1443081352 shutdown_connections 2023-10-06T11:18:35.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.666+0000 7f452c8ad700 1 --2- 172.21.15.146:0/1443081352 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4508066f30 0x7f45080693e0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.666+0000 7f452c8ad700 1 --2- 172.21.15.146:0/1443081352 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f45280cbb80 0x7f45280cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.666+0000 7f452c8ad700 1 --2- 172.21.15.146:0/1443081352 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4510003a60 0x7f45281697a0 unknown :-1 s=CLOSED pgs=2137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.666+0000 7f452c8ad700 1 --2- 172.21.15.146:0/1443081352 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f452816d500 0x7f452816d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:35.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.666+0000 7f452c8ad700 1 -- 172.21.15.146:0/1443081352 >> 172.21.15.146:0/1443081352 conn(0x7f452806eb10 msgr2=0x7f45280d0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:35.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.666+0000 7f452c8ad700 1 -- 172.21.15.146:0/1443081352 shutdown_connections 2023-10-06T11:18:35.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:35.666+0000 7f452c8ad700 1 -- 172.21.15.146:0/1443081352 wait complete. 2023-10-06T11:18:35.679 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T11:18:35.680 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:18:35.718 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:18:35.757 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T11:18:35.757 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi146.front.sepia.ceph.com... 2023-10-06T11:18:35.758 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T11:18:35.758 DEBUG:teuthology.orchestra.run.smithi146:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T11:18:35.790 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[157151]: fuse finished with error 0 and tester_r 0 2023-10-06T11:18:35.793 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-10-06T11:18:35.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:18:35.794 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T11:18:35.963 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-10-06T11:18:35.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:18:35.964 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T11:18:35.978 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:18:35.978 INFO:teuthology.orchestra.run.smithi151.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-06T11:18:35.979 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-10-06T11:18:35.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:18:35.979 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T11:18:36.018 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:18:36.018 INFO:teuthology.orchestra.run.smithi146.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-06T11:18:36.019 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-10-06T11:18:36.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:18:36.019 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T11:18:36.033 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:18:36.034 INFO:teuthology.orchestra.run.smithi151.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-06T11:18:36.034 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:18:36.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.174+0000 7f1ad2b8c700 1 Processor -- start 2023-10-06T11:18:36.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.174+0000 7f1ad2b8c700 1 -- start start 2023-10-06T11:18:36.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.175+0000 7f1ad2b8c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1acc0b1950 0x7f1acc06eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:36.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.175+0000 7f1ad2b8c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1acc0c9d70 con 0x7f1acc153dd0 2023-10-06T11:18:36.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.175+0000 7f1ad2b8c700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1acc1541a0 con 0x7f1acc157970 2023-10-06T11:18:36.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.175+0000 7f1ad2b8c700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1acc0b0d40 con 0x7f1acc0b1950 2023-10-06T11:18:36.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.175+0000 7f1ad1b8a700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f1acc153dd0 0x7f1acc0b1240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52168/0 (socket says 172.21.15.146:52168) 2023-10-06T11:18:36.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.175+0000 7f1ad1b8a700 1 -- 172.21.15.146:0/2301562900 learned_addr learned my addr 172.21.15.146:0/2301562900 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:36.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.175+0000 7f1ad1389700 1 --2- 172.21.15.146:0/2301562900 >> v2:172.21.15.151:3300/0 conn(0x7f1acc0b1950 0x7f1acc06eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:36.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.175+0000 7f1ad0b88700 1 -- 172.21.15.146:0/2301562900 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1601945381 0 0) 0x7f1acc0c9d70 con 0x7f1acc153dd0 2023-10-06T11:18:36.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.175+0000 7f1ad0b88700 1 -- 172.21.15.146:0/2301562900 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ab8003570 con 0x7f1acc153dd0 2023-10-06T11:18:36.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.175+0000 7f1ad1389700 1 -- 172.21.15.146:0/2301562900 >> v1:172.21.15.151:6789/0 conn(0x7f1acc157970 legacy=0x7f1acc156910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:36.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.175+0000 7f1ad1389700 1 -- 172.21.15.146:0/2301562900 >> v1:172.21.15.146:6789/0 conn(0x7f1acc153dd0 legacy=0x7f1acc0b1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:36.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.175+0000 7f1ad1389700 1 -- 172.21.15.146:0/2301562900 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1acc0b00c0 con 0x7f1acc0b1950 2023-10-06T11:18:36.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.176+0000 7f1ad1389700 1 --2- 172.21.15.146:0/2301562900 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1acc0b1950 0x7f1acc06eb10 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f1abc0098e0 tx=0x7f1abc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2259645f2c3446fe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:36.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.176+0000 7f1ad0b88700 1 -- 172.21.15.146:0/2301562900 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc00b640 con 0x7f1acc0b1950 2023-10-06T11:18:36.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.176+0000 7f1ad0b88700 1 -- 172.21.15.146:0/2301562900 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1abc00b7a0 con 0x7f1acc0b1950 2023-10-06T11:18:36.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.176+0000 7f1ad0b88700 1 -- 172.21.15.146:0/2301562900 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc00bb40 con 0x7f1acc0b1950 2023-10-06T11:18:36.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.176+0000 7f1ad2b8c700 1 -- 172.21.15.146:0/2301562900 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1acc0b1950 msgr2=0x7f1acc06eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:36.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.176+0000 7f1ad2b8c700 1 --2- 172.21.15.146:0/2301562900 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1acc0b1950 0x7f1acc06eb10 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f1abc0098e0 tx=0x7f1abc0091a0 comp rx=0 tx=0).stop 2023-10-06T11:18:36.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.176+0000 7f1ad2b8c700 1 -- 172.21.15.146:0/2301562900 shutdown_connections 2023-10-06T11:18:36.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.176+0000 7f1ad2b8c700 1 --2- 172.21.15.146:0/2301562900 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1acc0b1950 0x7f1acc06eb10 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:36.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.176+0000 7f1ad2b8c700 1 -- 172.21.15.146:0/2301562900 >> 172.21.15.146:0/2301562900 conn(0x7f1acc06aca0 msgr2=0x7f1acc0aeb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:36.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.176+0000 7f1ad2b8c700 1 -- 172.21.15.146:0/2301562900 shutdown_connections 2023-10-06T11:18:36.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.176+0000 7f1ad2b8c700 1 -- 172.21.15.146:0/2301562900 wait complete. 2023-10-06T11:18:36.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.178+0000 7f1ad2b8c700 1 Processor -- start 2023-10-06T11:18:36.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.178+0000 7f1ad2b8c700 1 -- start start 2023-10-06T11:18:36.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.178+0000 7f1ad2b8c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1acc0b1950 0x7f1acc168090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:36.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.178+0000 7f1ad2b8c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1acc153dd0 0x7f1acc146200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:36.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.178+0000 7f1ad2b8c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1acc157970 0x7f1acc154da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:36.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.178+0000 7f1ad2b8c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1acc167c00 con 0x7f1acc153dd0 2023-10-06T11:18:36.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.178+0000 7f1ad2b8c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1acc1675d0 con 0x7f1acc0b1950 2023-10-06T11:18:36.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.178+0000 7f1ad2b8c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1acc14b7b0 con 0x7f1acc157970 2023-10-06T11:18:36.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.178+0000 7f1ad1389700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1acc153dd0 0x7f1acc146200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:36.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.178+0000 7f1ad1389700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1acc153dd0 0x7f1acc146200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41050/0 (socket says 172.21.15.146:41050) 2023-10-06T11:18:36.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.179+0000 7f1ad1389700 1 -- 172.21.15.146:0/2086993608 learned_addr learned my addr 172.21.15.146:0/2086993608 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:36.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.179+0000 7f1ad1b8a700 1 --2- 172.21.15.146:0/2086993608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1acc0b1950 0x7f1acc168090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:36.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.179+0000 7f1ad238b700 1 --2- 172.21.15.146:0/2086993608 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1acc157970 0x7f1acc154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:36.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.179+0000 7f1ad1389700 1 -- 172.21.15.146:0/2086993608 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1acc157970 msgr2=0x7f1acc154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:36.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.179+0000 7f1ad1389700 1 --2- 172.21.15.146:0/2086993608 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1acc157970 0x7f1acc154da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:36.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.179+0000 7f1ad1389700 1 -- 172.21.15.146:0/2086993608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1acc0b1950 msgr2=0x7f1acc168090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:36.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.179+0000 7f1ad1389700 1 --2- 172.21.15.146:0/2086993608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1acc0b1950 0x7f1acc168090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:36.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.179+0000 7f1ad1389700 1 -- 172.21.15.146:0/2086993608 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1abc009420 con 0x7f1acc153dd0 2023-10-06T11:18:36.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.179+0000 7f1ad1b8a700 1 --2- 172.21.15.146:0/2086993608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1acc0b1950 0x7f1acc168090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:18:36.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.179+0000 7f1ad1389700 1 --2- 172.21.15.146:0/2086993608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1acc153dd0 0x7f1acc146200 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 crypto rx=0x7f1abc013000 tx=0x7f1abc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:36.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.179+0000 7f1ac1ffb700 1 -- 172.21.15.146:0/2086993608 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc000d10 con 0x7f1acc153dd0 2023-10-06T11:18:36.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.179+0000 7f1ac1ffb700 1 -- 172.21.15.146:0/2086993608 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1abc00bb20 con 0x7f1acc153dd0 2023-10-06T11:18:36.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.179+0000 7f1ad2b8c700 1 -- 172.21.15.146:0/2086993608 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1acc14ba90 con 0x7f1acc153dd0 2023-10-06T11:18:36.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.179+0000 7f1ac1ffb700 1 -- 172.21.15.146:0/2086993608 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc011650 con 0x7f1acc153dd0 2023-10-06T11:18:36.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.179+0000 7f1ad2b8c700 1 -- 172.21.15.146:0/2086993608 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1acc167890 con 0x7f1acc153dd0 2023-10-06T11:18:36.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.180+0000 7f1ad2b8c700 1 -- 172.21.15.146:0/2086993608 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1acc06f1d0 con 0x7f1acc153dd0 2023-10-06T11:18:36.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.181+0000 7f1ac1ffb700 1 -- 172.21.15.146:0/2086993608 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1abc0119c0 con 0x7f1acc153dd0 2023-10-06T11:18:36.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.181+0000 7f1ac1ffb700 1 --2- 172.21.15.146:0/2086993608 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1ab0066fb0 0x7f1ab0069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:36.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.181+0000 7f1ac1ffb700 1 -- 172.21.15.146:0/2086993608 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f1abc085e30 con 0x7f1acc153dd0 2023-10-06T11:18:36.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.181+0000 7f1ad1b8a700 1 --2- 172.21.15.146:0/2086993608 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1ab0066fb0 0x7f1ab0069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:36.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.182+0000 7f1ad1b8a700 1 --2- 172.21.15.146:0/2086993608 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1ab0066fb0 0x7f1ab0069460 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8007fd0 tx=0x7f1ac8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:36.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.189+0000 7f1ac1ffb700 1 -- 172.21.15.146:0/2086993608 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1abc052ec0 con 0x7f1acc153dd0 2023-10-06T11:18:36.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.425+0000 7f1ad2b8c700 1 -- 172.21.15.146:0/2086993608 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1acc167d40 con 0x7f1acc153dd0 2023-10-06T11:18:36.427 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.426+0000 7f1ac1ffb700 1 -- 172.21.15.146:0/2086993608 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 136 v136) v1 ==== 95+0+4620 (secure 0 0 0) 0x7f1abc0564e0 con 0x7f1acc153dd0 2023-10-06T11:18:36.428 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:18:36.428 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":136,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7694,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3150776091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3150776091},{"type":"v1","addr":"172.21.15.151:6834","nonce":3150776091}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":131},{"gid":8836,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/731448405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":731448405},{"type":"v1","addr":"172.21.15.151:6835","nonce":731448405}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":131},{"gid":10077,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2392749618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2392749618},{"type":"v1","addr":"172.21.15.146:6836","nonce":2392749618}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":131}],"filesystems":[{"mdsmap":{"epoch":136,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:18:25.258682+0000","modified":"2023-10-06T11:18:28.884125+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10080},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10080":{"gid":10080,"name":"a","rank":0,"incarnation":132,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/1340411581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":1340411581},{"type":"v1","addr":"172.21.15.146:6837","nonce":1340411581}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-06T11:18:36.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.428+0000 7f1ad2b8c700 1 -- 172.21.15.146:0/2086993608 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1ab0066fb0 msgr2=0x7f1ab0069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:36.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.428+0000 7f1ad2b8c700 1 --2- 172.21.15.146:0/2086993608 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1ab0066fb0 0x7f1ab0069460 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8007fd0 tx=0x7f1ac8009040 comp rx=0 tx=0).stop 2023-10-06T11:18:36.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.428+0000 7f1ad2b8c700 1 -- 172.21.15.146:0/2086993608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1acc153dd0 msgr2=0x7f1acc146200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:36.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.428+0000 7f1ad2b8c700 1 --2- 172.21.15.146:0/2086993608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1acc153dd0 0x7f1acc146200 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 crypto rx=0x7f1abc013000 tx=0x7f1abc017000 comp rx=0 tx=0).stop 2023-10-06T11:18:36.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.428+0000 7f1ad2b8c700 1 -- 172.21.15.146:0/2086993608 shutdown_connections 2023-10-06T11:18:36.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.428+0000 7f1ad2b8c700 1 --2- 172.21.15.146:0/2086993608 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1ab0066fb0 0x7f1ab0069460 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:36.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.428+0000 7f1ad2b8c700 1 --2- 172.21.15.146:0/2086993608 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1acc157970 0x7f1acc154da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:36.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.428+0000 7f1ad2b8c700 1 --2- 172.21.15.146:0/2086993608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1acc0b1950 0x7f1acc168090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:36.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.428+0000 7f1ad2b8c700 1 --2- 172.21.15.146:0/2086993608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1acc153dd0 0x7f1acc146200 unknown :-1 s=CLOSED pgs=2143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:36.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.428+0000 7f1ad2b8c700 1 -- 172.21.15.146:0/2086993608 >> 172.21.15.146:0/2086993608 conn(0x7f1acc06aca0 msgr2=0x7f1acc1545c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:36.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.428+0000 7f1ad2b8c700 1 -- 172.21.15.146:0/2086993608 shutdown_connections 2023-10-06T11:18:36.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.428+0000 7f1ad2b8c700 1 -- 172.21.15.146:0/2086993608 wait complete. 2023-10-06T11:18:36.432 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 136 2023-10-06T11:18:36.442 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:18:36.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.555+0000 7f00c2d97700 1 Processor -- start 2023-10-06T11:18:36.557 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.555+0000 7f00c2d97700 1 -- start start 2023-10-06T11:18:36.565 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.556+0000 7f00c2d97700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f00bc143040 0x7f00bc0b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:36.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.556+0000 7f00c2d97700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f00bc0b5430 0x7f00bc0b2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:36.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.556+0000 7f00c2d97700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00bc0cf100 con 0x7f00bc143410 2023-10-06T11:18:36.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.556+0000 7f00c2d97700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00bc0b4170 con 0x7f00bc0b5430 2023-10-06T11:18:36.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.556+0000 7f00c2d97700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00bc0b5f50 con 0x7f00bc143040 2023-10-06T11:18:36.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.556+0000 7f00c2596700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f00bc0b5430 0x7f00bc0b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:36.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.556+0000 7f00c2596700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f00bc0b5430 0x7f00bc0b2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41052/0 (socket says 172.21.15.146:41052) 2023-10-06T11:18:36.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.556+0000 7f00c2596700 1 -- 172.21.15.146:0/3755221251 learned_addr learned my addr 172.21.15.146:0/3755221251 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:36.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.556+0000 7f00c1d95700 1 --2- 172.21.15.146:0/3755221251 >> v2:172.21.15.151:3300/0 conn(0x7f00bc143040 0x7f00bc0b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:36.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.556+0000 7f00c2596700 1 -- 172.21.15.146:0/3755221251 >> v2:172.21.15.151:3300/0 conn(0x7f00bc143040 msgr2=0x7f00bc0b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:36.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.556+0000 7f00c2596700 1 --2- 172.21.15.146:0/3755221251 >> v2:172.21.15.151:3300/0 conn(0x7f00bc143040 0x7f00bc0b1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:36.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.556+0000 7f00c2596700 1 -- 172.21.15.146:0/3755221251 >> v1:172.21.15.151:6789/0 conn(0x7f00bc143410 legacy=0x7f00bc0b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:36.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.557+0000 7f00c2596700 1 -- 172.21.15.146:0/3755221251 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00bc0ceb30 con 0x7f00bc0b5430 2023-10-06T11:18:36.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.557+0000 7f00c2596700 1 --2- 172.21.15.146:0/3755221251 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00bc0b5430 0x7f00bc0b2360 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7f00bc06fb40 tx=0x7f00b4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d97ff5bb59dffbb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:36.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.557+0000 7f00c0d93700 1 -- 172.21.15.146:0/3755221251 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b400e070 con 0x7f00bc0b5430 2023-10-06T11:18:36.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.557+0000 7f00c0d93700 1 -- 172.21.15.146:0/3755221251 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b400ba20 con 0x7f00bc0b5430 2023-10-06T11:18:36.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.557+0000 7f00c0d93700 1 -- 172.21.15.146:0/3755221251 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b40092e0 con 0x7f00bc0b5430 2023-10-06T11:18:36.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.557+0000 7f00c2d97700 1 -- 172.21.15.146:0/3755221251 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00bc0b5430 msgr2=0x7f00bc0b2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:36.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.557+0000 7f00c2d97700 1 --2- 172.21.15.146:0/3755221251 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00bc0b5430 0x7f00bc0b2360 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7f00bc06fb40 tx=0x7f00b4009840 comp rx=0 tx=0).stop 2023-10-06T11:18:36.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.557+0000 7f00c2d97700 1 -- 172.21.15.146:0/3755221251 shutdown_connections 2023-10-06T11:18:36.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.557+0000 7f00c2d97700 1 --2- 172.21.15.146:0/3755221251 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00bc0b5430 0x7f00bc0b2360 unknown :-1 s=CLOSED pgs=2144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:36.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.557+0000 7f00c2d97700 1 --2- 172.21.15.146:0/3755221251 >> v2:172.21.15.151:3300/0 conn(0x7f00bc143040 0x7f00bc0b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:36.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.557+0000 7f00c2d97700 1 -- 172.21.15.146:0/3755221251 >> 172.21.15.146:0/3755221251 conn(0x7f00bc06eb10 msgr2=0x7f00bc06ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:36.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.557+0000 7f00c2d97700 1 -- 172.21.15.146:0/3755221251 shutdown_connections 2023-10-06T11:18:36.570 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.557+0000 7f00c2d97700 1 -- 172.21.15.146:0/3755221251 wait complete. 2023-10-06T11:18:36.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.558+0000 7f00c2d97700 1 Processor -- start 2023-10-06T11:18:36.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.559+0000 7f00c2d97700 1 -- start start 2023-10-06T11:18:36.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.559+0000 7f00c2d97700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00bc0b5430 0x7f00bc1563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:36.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.559+0000 7f00c2d97700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00bc143040 0x7f00bc13f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:36.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.559+0000 7f00c2d97700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00bc143410 0x7f00bc157ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:36.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.559+0000 7f00c2d97700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00bc15ce10 con 0x7f00bc0b5430 2023-10-06T11:18:36.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.559+0000 7f00c2d97700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00bc156930 con 0x7f00bc143410 2023-10-06T11:18:36.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.559+0000 7f00c2d97700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00bc15c200 con 0x7f00bc143040 2023-10-06T11:18:36.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.559+0000 7f00c1d95700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00bc0b5430 0x7f00bc1563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:36.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.559+0000 7f00c1d95700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00bc0b5430 0x7f00bc1563f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41058/0 (socket says 172.21.15.146:41058) 2023-10-06T11:18:36.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.559+0000 7f00c1d95700 1 -- 172.21.15.146:0/4265446884 learned_addr learned my addr 172.21.15.146:0/4265446884 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:36.571 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.559+0000 7f00c2596700 1 --2- 172.21.15.146:0/4265446884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00bc143410 0x7f00bc157ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:36.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.559+0000 7f00c1594700 1 --2- 172.21.15.146:0/4265446884 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00bc143040 0x7f00bc13f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:36.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.560+0000 7f00c1d95700 1 -- 172.21.15.146:0/4265446884 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00bc143040 msgr2=0x7f00bc13f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:36.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.560+0000 7f00c1d95700 1 --2- 172.21.15.146:0/4265446884 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00bc143040 0x7f00bc13f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:36.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.560+0000 7f00c1d95700 1 -- 172.21.15.146:0/4265446884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00bc143410 msgr2=0x7f00bc157ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:36.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.560+0000 7f00c1d95700 1 --2- 172.21.15.146:0/4265446884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00bc143410 0x7f00bc157ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:36.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.560+0000 7f00c1d95700 1 -- 172.21.15.146:0/4265446884 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b4009ae0 con 0x7f00bc0b5430 2023-10-06T11:18:36.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.560+0000 7f00c1d95700 1 --2- 172.21.15.146:0/4265446884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00bc0b5430 0x7f00bc1563f0 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 crypto rx=0x7f00b800ec80 tx=0x7f00b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:36.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.560+0000 7f00b1ffb700 1 -- 172.21.15.146:0/4265446884 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b800c850 con 0x7f00bc0b5430 2023-10-06T11:18:36.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.560+0000 7f00b1ffb700 1 -- 172.21.15.146:0/4265446884 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b800c9b0 con 0x7f00bc0b5430 2023-10-06T11:18:36.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.560+0000 7f00c2d97700 1 -- 172.21.15.146:0/4265446884 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00bc15c4e0 con 0x7f00bc0b5430 2023-10-06T11:18:36.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.560+0000 7f00b1ffb700 1 -- 172.21.15.146:0/4265446884 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b800cd50 con 0x7f00bc0b5430 2023-10-06T11:18:36.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.560+0000 7f00c2d97700 1 -- 172.21.15.146:0/4265446884 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00bc15caa0 con 0x7f00bc0b5430 2023-10-06T11:18:36.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.561+0000 7f00c2d97700 1 -- 172.21.15.146:0/4265446884 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00bc088a80 con 0x7f00bc0b5430 2023-10-06T11:18:36.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.562+0000 7f00b1ffb700 1 -- 172.21.15.146:0/4265446884 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f00b8013680 con 0x7f00bc0b5430 2023-10-06T11:18:36.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.562+0000 7f00b1ffb700 1 --2- 172.21.15.146:0/4265446884 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f00a0066f30 0x7f00a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:36.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.562+0000 7f00c1594700 1 --2- 172.21.15.146:0/4265446884 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f00a0066f30 0x7f00a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:36.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.562+0000 7f00b1ffb700 1 -- 172.21.15.146:0/4265446884 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f00b80848e0 con 0x7f00bc0b5430 2023-10-06T11:18:36.573 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.562+0000 7f00c1594700 1 --2- 172.21.15.146:0/4265446884 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f00a0066f30 0x7f00a00693e0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f00bc15ec80 tx=0x7f00ac007ec0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:36.574 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.566+0000 7f00b1ffb700 1 -- 172.21.15.146:0/4265446884 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f00b8051990 con 0x7f00bc0b5430 2023-10-06T11:18:36.753 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.751+0000 7f00c2d97700 1 -- 172.21.15.146:0/4265446884 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00bc0ccc30 con 0x7f00bc0b5430 2023-10-06T11:18:36.754 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.752+0000 7f00b1ffb700 1 -- 172.21.15.146:0/4265446884 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v165) v1 ==== 74+0+17073 (secure 0 0 0) 0x7f00b8054fb0 con 0x7f00bc0b5430 2023-10-06T11:18:36.754 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:18:36.754 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":165,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:18:33.746877+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:18:22.963878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-10-06T11:18:24.222990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"26.8","mappings":[{"from":1,"to":0}]},{"pgid":"26.1a","mappings":[{"from":1,"to":0}]},{"pgid":"26.3a","mappings":[{"from":3,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:18:36.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.754+0000 7f00c2d97700 1 -- 172.21.15.146:0/4265446884 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f00a0066f30 msgr2=0x7f00a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:36.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.754+0000 7f00c2d97700 1 --2- 172.21.15.146:0/4265446884 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f00a0066f30 0x7f00a00693e0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f00bc15ec80 tx=0x7f00ac007ec0 comp rx=0 tx=0).stop 2023-10-06T11:18:36.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.754+0000 7f00c2d97700 1 -- 172.21.15.146:0/4265446884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00bc0b5430 msgr2=0x7f00bc1563f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:36.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.754+0000 7f00c2d97700 1 --2- 172.21.15.146:0/4265446884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00bc0b5430 0x7f00bc1563f0 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 crypto rx=0x7f00b800ec80 tx=0x7f00b80091a0 comp rx=0 tx=0).stop 2023-10-06T11:18:36.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.754+0000 7f00c2d97700 1 -- 172.21.15.146:0/4265446884 shutdown_connections 2023-10-06T11:18:36.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.754+0000 7f00c2d97700 1 --2- 172.21.15.146:0/4265446884 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f00a0066f30 0x7f00a00693e0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:36.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.754+0000 7f00c2d97700 1 --2- 172.21.15.146:0/4265446884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00bc143410 0x7f00bc157ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:36.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.754+0000 7f00c2d97700 1 --2- 172.21.15.146:0/4265446884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f00bc0b5430 0x7f00bc1563f0 unknown :-1 s=CLOSED pgs=2145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:36.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.754+0000 7f00c2d97700 1 --2- 172.21.15.146:0/4265446884 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f00bc143040 0x7f00bc13f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:36.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.754+0000 7f00c2d97700 1 -- 172.21.15.146:0/4265446884 >> 172.21.15.146:0/4265446884 conn(0x7f00bc06eb10 msgr2=0x7f00bc1593d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:36.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.754+0000 7f00c2d97700 1 -- 172.21.15.146:0/4265446884 shutdown_connections 2023-10-06T11:18:36.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.754+0000 7f00c2d97700 1 -- 172.21.15.146:0/4265446884 wait complete. 2023-10-06T11:18:36.769 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:05:36.687307+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:05:37.171199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T11:18:22.963878+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '162', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T11:18:24.222990+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '163', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T11:18:36.769 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:18:36.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.886+0000 7f3d30e90700 1 Processor -- start 2023-10-06T11:18:36.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.886+0000 7f3d30e90700 1 -- start start 2023-10-06T11:18:36.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.887+0000 7f3d30e90700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3d2c143040 0x7f3d2c0b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:36.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.887+0000 7f3d30e90700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3d2c0b5430 0x7f3d2c0b2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:36.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.887+0000 7f3d30e90700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d2c0cf100 con 0x7f3d2c143410 2023-10-06T11:18:36.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.887+0000 7f3d30e90700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d2c0b4170 con 0x7f3d2c0b5430 2023-10-06T11:18:36.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.887+0000 7f3d30e90700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d2c0b5f50 con 0x7f3d2c143040 2023-10-06T11:18:36.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.887+0000 7f3d23fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f3d2c143410 0x7f3d2c0b4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52174/0 (socket says 172.21.15.146:52174) 2023-10-06T11:18:36.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.887+0000 7f3d23fff700 1 -- 172.21.15.146:0/3357257984 learned_addr learned my addr 172.21.15.146:0/3357257984 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:36.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.887+0000 7f3d2bfff700 1 --2- 172.21.15.146:0/3357257984 >> v2:172.21.15.146:3300/0 conn(0x7f3d2c0b5430 0x7f3d2c0b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:36.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.887+0000 7f3d2b7fe700 1 --2- 172.21.15.146:0/3357257984 >> v2:172.21.15.151:3300/0 conn(0x7f3d2c143040 0x7f3d2c0b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:36.892 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.887+0000 7f3d2bfff700 1 -- 172.21.15.146:0/3357257984 >> v2:172.21.15.151:3300/0 conn(0x7f3d2c143040 msgr2=0x7f3d2c0b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:36.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.887+0000 7f3d2bfff700 1 --2- 172.21.15.146:0/3357257984 >> v2:172.21.15.151:3300/0 conn(0x7f3d2c143040 0x7f3d2c0b1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:36.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.888+0000 7f3d2bfff700 1 -- 172.21.15.146:0/3357257984 >> v1:172.21.15.146:6789/0 conn(0x7f3d2c143410 legacy=0x7f3d2c0b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:36.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.888+0000 7f3d2bfff700 1 -- 172.21.15.146:0/3357257984 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d2c0ceb30 con 0x7f3d2c0b5430 2023-10-06T11:18:36.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.888+0000 7f3d2affd700 1 -- 172.21.15.146:0/3357257984 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4216640965 0 0) 0x7f3d2c0cf100 con 0x7f3d2c143410 2023-10-06T11:18:36.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.888+0000 7f3d2bfff700 1 --2- 172.21.15.146:0/3357257984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d2c0b5430 0x7f3d2c0b2360 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c06fb40 tx=0x7f3d24009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4099874f3c9fd2b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:36.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.888+0000 7f3d2affd700 1 -- 172.21.15.146:0/3357257984 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d2400e070 con 0x7f3d2c0b5430 2023-10-06T11:18:36.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.888+0000 7f3d2affd700 1 -- 172.21.15.146:0/3357257984 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d2400bb60 con 0x7f3d2c0b5430 2023-10-06T11:18:36.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.888+0000 7f3d2affd700 1 -- 172.21.15.146:0/3357257984 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d24012430 con 0x7f3d2c0b5430 2023-10-06T11:18:36.893 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.888+0000 7f3d30e90700 1 -- 172.21.15.146:0/3357257984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d2c0b5430 msgr2=0x7f3d2c0b2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:36.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.888+0000 7f3d30e90700 1 --2- 172.21.15.146:0/3357257984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d2c0b5430 0x7f3d2c0b2360 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c06fb40 tx=0x7f3d24009780 comp rx=0 tx=0).stop 2023-10-06T11:18:36.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.888+0000 7f3d30e90700 1 -- 172.21.15.146:0/3357257984 shutdown_connections 2023-10-06T11:18:36.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.888+0000 7f3d30e90700 1 --2- 172.21.15.146:0/3357257984 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d2c0b5430 0x7f3d2c0b2360 unknown :-1 s=CLOSED pgs=2147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:36.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.888+0000 7f3d30e90700 1 --2- 172.21.15.146:0/3357257984 >> v2:172.21.15.151:3300/0 conn(0x7f3d2c143040 0x7f3d2c0b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:36.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.888+0000 7f3d30e90700 1 -- 172.21.15.146:0/3357257984 >> 172.21.15.146:0/3357257984 conn(0x7f3d2c06eb10 msgr2=0x7f3d2c06ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:36.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.888+0000 7f3d30e90700 1 -- 172.21.15.146:0/3357257984 shutdown_connections 2023-10-06T11:18:36.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.888+0000 7f3d30e90700 1 -- 172.21.15.146:0/3357257984 wait complete. 2023-10-06T11:18:36.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.889+0000 7f3d30e90700 1 Processor -- start 2023-10-06T11:18:36.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.890+0000 7f3d30e90700 1 -- start start 2023-10-06T11:18:36.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.890+0000 7f3d30e90700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d2c0b5430 0x7f3d2c15d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:36.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.890+0000 7f3d30e90700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d2c143040 0x7f3d2c15d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:36.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.890+0000 7f3d30e90700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d2c143410 0x7f3d2c16cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:36.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.890+0000 7f3d30e90700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c1422b0 con 0x7f3d2c143410 2023-10-06T11:18:36.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.890+0000 7f3d30e90700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c15ec80 con 0x7f3d2c143040 2023-10-06T11:18:36.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.890+0000 7f3d30e90700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c15e070 con 0x7f3d2c0b5430 2023-10-06T11:18:36.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.890+0000 7f3d2bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d2c143410 0x7f3d2c16cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:36.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.890+0000 7f3d2bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d2c143410 0x7f3d2c16cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41078/0 (socket says 172.21.15.146:41078) 2023-10-06T11:18:36.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.890+0000 7f3d2bfff700 1 -- 172.21.15.146:0/2439787293 learned_addr learned my addr 172.21.15.146:0/2439787293 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:36.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.890+0000 7f3d23fff700 1 --2- 172.21.15.146:0/2439787293 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d2c143040 0x7f3d2c15d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:36.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.890+0000 7f3d2b7fe700 1 --2- 172.21.15.146:0/2439787293 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d2c0b5430 0x7f3d2c15d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:36.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.891+0000 7f3d2bfff700 1 -- 172.21.15.146:0/2439787293 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d2c0b5430 msgr2=0x7f3d2c15d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:36.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.891+0000 7f3d2bfff700 1 --2- 172.21.15.146:0/2439787293 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d2c0b5430 0x7f3d2c15d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:36.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.891+0000 7f3d2bfff700 1 -- 172.21.15.146:0/2439787293 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d2c143040 msgr2=0x7f3d2c15d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:36.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.891+0000 7f3d2bfff700 1 --2- 172.21.15.146:0/2439787293 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d2c143040 0x7f3d2c15d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:36.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.891+0000 7f3d2bfff700 1 -- 172.21.15.146:0/2439787293 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d24009a20 con 0x7f3d2c143410 2023-10-06T11:18:36.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.891+0000 7f3d2bfff700 1 --2- 172.21.15.146:0/2439787293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d2c143410 0x7f3d2c16cd60 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 crypto rx=0x7f3d24009fd0 tx=0x7f3d24019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:36.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.891+0000 7f3d237fe700 1 -- 172.21.15.146:0/2439787293 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d24027470 con 0x7f3d2c143410 2023-10-06T11:18:36.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.891+0000 7f3d237fe700 1 -- 172.21.15.146:0/2439787293 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d240275f0 con 0x7f3d2c143410 2023-10-06T11:18:36.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.891+0000 7f3d30e90700 1 -- 172.21.15.146:0/2439787293 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d2c15e350 con 0x7f3d2c143410 2023-10-06T11:18:36.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.891+0000 7f3d237fe700 1 -- 172.21.15.146:0/2439787293 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d240279b0 con 0x7f3d2c143410 2023-10-06T11:18:36.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.891+0000 7f3d30e90700 1 -- 172.21.15.146:0/2439787293 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d2c15e910 con 0x7f3d2c143410 2023-10-06T11:18:36.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.892+0000 7f3d30e90700 1 -- 172.21.15.146:0/2439787293 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d2c088a80 con 0x7f3d2c143410 2023-10-06T11:18:36.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.892+0000 7f3d237fe700 1 -- 172.21.15.146:0/2439787293 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3d24024070 con 0x7f3d2c143410 2023-10-06T11:18:36.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.893+0000 7f3d237fe700 1 --2- 172.21.15.146:0/2439787293 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3d0c066f30 0x7f3d0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:36.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.893+0000 7f3d237fe700 1 -- 172.21.15.146:0/2439787293 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f3d24087090 con 0x7f3d2c143410 2023-10-06T11:18:36.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.893+0000 7f3d2b7fe700 1 --2- 172.21.15.146:0/2439787293 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3d0c066f30 0x7f3d0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:36.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.893+0000 7f3d2b7fe700 1 --2- 172.21.15.146:0/2439787293 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3d0c066f30 0x7f3d0c0693e0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c009db0 tx=0x7f3d1c0091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:36.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:36.897+0000 7f3d237fe700 1 -- 172.21.15.146:0/2439787293 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d24054140 con 0x7f3d2c143410 2023-10-06T11:18:37.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.076+0000 7f3d30e90700 1 -- 172.21.15.146:0/2439787293 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3d2c15edc0 con 0x7f3d2c143410 2023-10-06T11:18:37.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.076+0000 7f3d237fe700 1 -- 172.21.15.146:0/2439787293 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v165) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3d24057760 con 0x7f3d2c143410 2023-10-06T11:18:37.079 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-10-06T11:18:37.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.078+0000 7f3d30e90700 1 -- 172.21.15.146:0/2439787293 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3d0c066f30 msgr2=0x7f3d0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:37.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.078+0000 7f3d30e90700 1 --2- 172.21.15.146:0/2439787293 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3d0c066f30 0x7f3d0c0693e0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c009db0 tx=0x7f3d1c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:18:37.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.078+0000 7f3d30e90700 1 -- 172.21.15.146:0/2439787293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d2c143410 msgr2=0x7f3d2c16cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:37.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.078+0000 7f3d30e90700 1 --2- 172.21.15.146:0/2439787293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d2c143410 0x7f3d2c16cd60 secure :-1 s=READY pgs=2148 cs=0 l=1 rev1=1 crypto rx=0x7f3d24009fd0 tx=0x7f3d24019000 comp rx=0 tx=0).stop 2023-10-06T11:18:37.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.079+0000 7f3d30e90700 1 -- 172.21.15.146:0/2439787293 shutdown_connections 2023-10-06T11:18:37.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.079+0000 7f3d30e90700 1 --2- 172.21.15.146:0/2439787293 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3d0c066f30 0x7f3d0c0693e0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:37.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.079+0000 7f3d30e90700 1 --2- 172.21.15.146:0/2439787293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3d2c143410 0x7f3d2c16cd60 unknown :-1 s=CLOSED pgs=2148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:37.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.079+0000 7f3d30e90700 1 --2- 172.21.15.146:0/2439787293 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3d2c0b5430 0x7f3d2c15d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:37.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.079+0000 7f3d30e90700 1 --2- 172.21.15.146:0/2439787293 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3d2c143040 0x7f3d2c15d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:37.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.079+0000 7f3d30e90700 1 -- 172.21.15.146:0/2439787293 >> 172.21.15.146:0/2439787293 conn(0x7f3d2c06eb10 msgr2=0x7f3d2c1592f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:37.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.079+0000 7f3d30e90700 1 -- 172.21.15.146:0/2439787293 shutdown_connections 2023-10-06T11:18:37.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.079+0000 7f3d30e90700 1 -- 172.21.15.146:0/2439787293 wait complete. 2023-10-06T11:18:37.092 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:18:37.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.208+0000 7f9a86d1d700 1 Processor -- start 2023-10-06T11:18:37.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.208+0000 7f9a86d1d700 1 -- start start 2023-10-06T11:18:37.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.209+0000 7f9a86d1d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9a80159820 0x7f9a800b0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:37.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.209+0000 7f9a86d1d700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9a800b0760 0x7f9a800aef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:37.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.209+0000 7f9a86d1d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a800cb8a0 con 0x7f9a80159450 2023-10-06T11:18:37.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.209+0000 7f9a86d1d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a800b2f20 con 0x7f9a80159820 2023-10-06T11:18:37.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.209+0000 7f9a86d1d700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a80159c70 con 0x7f9a800b0760 2023-10-06T11:18:37.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.209+0000 7f9a84ab9700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f9a80159450 0x7f9a8015dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52186/0 (socket says 172.21.15.146:52186) 2023-10-06T11:18:37.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.209+0000 7f9a84ab9700 1 -- 172.21.15.146:0/43262 learned_addr learned my addr 172.21.15.146:0/43262 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:37.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.209+0000 7f9a77fff700 1 --2- 172.21.15.146:0/43262 >> v2:172.21.15.146:3300/0 conn(0x7f9a80159820 0x7f9a800b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:37.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.209+0000 7f9a852ba700 1 --2- 172.21.15.146:0/43262 >> v2:172.21.15.151:3300/0 conn(0x7f9a800b0760 0x7f9a800aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:37.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.209+0000 7f9a777fe700 1 -- 172.21.15.146:0/43262 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1906068846 0 0) 0x7f9a800cb8a0 con 0x7f9a80159450 2023-10-06T11:18:37.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.209+0000 7f9a777fe700 1 -- 172.21.15.146:0/43262 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a68003570 con 0x7f9a80159450 2023-10-06T11:18:37.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.210+0000 7f9a77fff700 1 -- 172.21.15.146:0/43262 >> v2:172.21.15.151:3300/0 conn(0x7f9a800b0760 msgr2=0x7f9a800aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:37.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.210+0000 7f9a77fff700 1 --2- 172.21.15.146:0/43262 >> v2:172.21.15.151:3300/0 conn(0x7f9a800b0760 0x7f9a800aef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:37.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.210+0000 7f9a77fff700 1 -- 172.21.15.146:0/43262 >> v1:172.21.15.146:6789/0 conn(0x7f9a80159450 legacy=0x7f9a8015dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:37.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.210+0000 7f9a77fff700 1 -- 172.21.15.146:0/43262 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a800b0b90 con 0x7f9a80159820 2023-10-06T11:18:37.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.210+0000 7f9a77fff700 1 --2- 172.21.15.146:0/43262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a80159820 0x7f9a800b0220 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7f9a800b5e80 tx=0x7f9a700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffebe2652f0d3a7d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:37.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.210+0000 7f9a777fe700 1 -- 172.21.15.146:0/43262 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a70011630 con 0x7f9a80159820 2023-10-06T11:18:37.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.210+0000 7f9a777fe700 1 -- 172.21.15.146:0/43262 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a700117b0 con 0x7f9a80159820 2023-10-06T11:18:37.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.210+0000 7f9a777fe700 1 -- 172.21.15.146:0/43262 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a70011b70 con 0x7f9a80159820 2023-10-06T11:18:37.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.210+0000 7f9a86d1d700 1 -- 172.21.15.146:0/43262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a80159820 msgr2=0x7f9a800b0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:37.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.210+0000 7f9a86d1d700 1 --2- 172.21.15.146:0/43262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a80159820 0x7f9a800b0220 secure :-1 s=READY pgs=2150 cs=0 l=1 rev1=1 crypto rx=0x7f9a800b5e80 tx=0x7f9a700091a0 comp rx=0 tx=0).stop 2023-10-06T11:18:37.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.210+0000 7f9a86d1d700 1 -- 172.21.15.146:0/43262 shutdown_connections 2023-10-06T11:18:37.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.210+0000 7f9a86d1d700 1 --2- 172.21.15.146:0/43262 >> v2:172.21.15.151:3300/0 conn(0x7f9a800b0760 0x7f9a800aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:37.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.210+0000 7f9a86d1d700 1 --2- 172.21.15.146:0/43262 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a80159820 0x7f9a800b0220 unknown :-1 s=CLOSED pgs=2150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:37.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.210+0000 7f9a86d1d700 1 -- 172.21.15.146:0/43262 >> 172.21.15.146:0/43262 conn(0x7f9a8006eb10 msgr2=0x7f9a8006ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:37.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.210+0000 7f9a86d1d700 1 -- 172.21.15.146:0/43262 shutdown_connections 2023-10-06T11:18:37.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.210+0000 7f9a86d1d700 1 -- 172.21.15.146:0/43262 wait complete. 2023-10-06T11:18:37.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.211+0000 7f9a86d1d700 1 Processor -- start 2023-10-06T11:18:37.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.212+0000 7f9a86d1d700 1 -- start start 2023-10-06T11:18:37.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.212+0000 7f9a86d1d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a800b0760 0x7f9a80169c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:37.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.212+0000 7f9a86d1d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a80159450 0x7f9a8016ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:37.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.212+0000 7f9a86d1d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a80159820 0x7f9a800c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:37.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.212+0000 7f9a86d1d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a800c9860 con 0x7f9a80159450 2023-10-06T11:18:37.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.212+0000 7f9a86d1d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8016cfd0 con 0x7f9a80159820 2023-10-06T11:18:37.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.212+0000 7f9a86d1d700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a800c4e20 con 0x7f9a800b0760 2023-10-06T11:18:37.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.213+0000 7f9a77fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a80159450 0x7f9a8016ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:37.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.213+0000 7f9a77fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a80159450 0x7f9a8016ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41084/0 (socket says 172.21.15.146:41084) 2023-10-06T11:18:37.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.213+0000 7f9a77fff700 1 -- 172.21.15.146:0/3825355124 learned_addr learned my addr 172.21.15.146:0/3825355124 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:37.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.213+0000 7f9a84ab9700 1 --2- 172.21.15.146:0/3825355124 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a800b0760 0x7f9a80169c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:37.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.213+0000 7f9a852ba700 1 --2- 172.21.15.146:0/3825355124 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a80159820 0x7f9a800c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:37.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.213+0000 7f9a77fff700 1 -- 172.21.15.146:0/3825355124 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a800b0760 msgr2=0x7f9a80169c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:37.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.213+0000 7f9a77fff700 1 --2- 172.21.15.146:0/3825355124 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a800b0760 0x7f9a80169c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:37.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.213+0000 7f9a77fff700 1 -- 172.21.15.146:0/3825355124 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a80159820 msgr2=0x7f9a800c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:37.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.213+0000 7f9a77fff700 1 --2- 172.21.15.146:0/3825355124 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a80159820 0x7f9a800c6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:37.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.213+0000 7f9a77fff700 1 -- 172.21.15.146:0/3825355124 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a70009420 con 0x7f9a80159450 2023-10-06T11:18:37.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.213+0000 7f9a77fff700 1 --2- 172.21.15.146:0/3825355124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a80159450 0x7f9a8016ca90 secure :-1 s=READY pgs=2151 cs=0 l=1 rev1=1 crypto rx=0x7f9a80070e70 tx=0x7f9a70017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:37.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.213+0000 7f9a74ff9700 1 -- 172.21.15.146:0/3825355124 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7001f070 con 0x7f9a80159450 2023-10-06T11:18:37.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.213+0000 7f9a74ff9700 1 -- 172.21.15.146:0/3825355124 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a70011920 con 0x7f9a80159450 2023-10-06T11:18:37.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.213+0000 7f9a74ff9700 1 -- 172.21.15.146:0/3825355124 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a70023410 con 0x7f9a80159450 2023-10-06T11:18:37.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.213+0000 7f9a86d1d700 1 -- 172.21.15.146:0/3825355124 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a800c4b40 con 0x7f9a80159450 2023-10-06T11:18:37.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.213+0000 7f9a86d1d700 1 -- 172.21.15.146:0/3825355124 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a800c94f0 con 0x7f9a80159450 2023-10-06T11:18:37.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.214+0000 7f9a86d1d700 1 -- 172.21.15.146:0/3825355124 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a800c9070 con 0x7f9a80159450 2023-10-06T11:18:37.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.214+0000 7f9a74ff9700 1 -- 172.21.15.146:0/3825355124 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9a7002c3b0 con 0x7f9a80159450 2023-10-06T11:18:37.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.215+0000 7f9a74ff9700 1 --2- 172.21.15.146:0/3825355124 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9a6c066f30 0x7f9a6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:37.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.215+0000 7f9a74ff9700 1 -- 172.21.15.146:0/3825355124 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f9a70085a10 con 0x7f9a80159450 2023-10-06T11:18:37.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.215+0000 7f9a84ab9700 1 --2- 172.21.15.146:0/3825355124 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9a6c066f30 0x7f9a6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:37.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.215+0000 7f9a84ab9700 1 --2- 172.21.15.146:0/3825355124 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9a6c066f30 0x7f9a6c0693e0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c0058d0 tx=0x7f9a7c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:37.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.219+0000 7f9a74ff9700 1 -- 172.21.15.146:0/3825355124 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9a800c9070 con 0x7f9a80159450 2023-10-06T11:18:37.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.400+0000 7f9a86d1d700 1 -- 172.21.15.146:0/3825355124 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9a800c9070 con 0x7f9a80159450 2023-10-06T11:18:37.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.400+0000 7f9a74ff9700 1 -- 172.21.15.146:0/3825355124 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v165) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9a800c9070 con 0x7f9a80159450 2023-10-06T11:18:37.402 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-10-06T11:18:37.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.402+0000 7f9a86d1d700 1 -- 172.21.15.146:0/3825355124 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9a6c066f30 msgr2=0x7f9a6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:37.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.402+0000 7f9a86d1d700 1 --2- 172.21.15.146:0/3825355124 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9a6c066f30 0x7f9a6c0693e0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c0058d0 tx=0x7f9a7c009040 comp rx=0 tx=0).stop 2023-10-06T11:18:37.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.402+0000 7f9a86d1d700 1 -- 172.21.15.146:0/3825355124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a80159450 msgr2=0x7f9a8016ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:37.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.402+0000 7f9a86d1d700 1 --2- 172.21.15.146:0/3825355124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a80159450 0x7f9a8016ca90 secure :-1 s=READY pgs=2151 cs=0 l=1 rev1=1 crypto rx=0x7f9a80070e70 tx=0x7f9a70017000 comp rx=0 tx=0).stop 2023-10-06T11:18:37.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.402+0000 7f9a86d1d700 1 -- 172.21.15.146:0/3825355124 shutdown_connections 2023-10-06T11:18:37.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.402+0000 7f9a86d1d700 1 --2- 172.21.15.146:0/3825355124 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9a6c066f30 0x7f9a6c0693e0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:37.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.402+0000 7f9a86d1d700 1 --2- 172.21.15.146:0/3825355124 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a80159820 0x7f9a800c6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:37.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.402+0000 7f9a86d1d700 1 --2- 172.21.15.146:0/3825355124 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a800b0760 0x7f9a80169c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:37.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.402+0000 7f9a86d1d700 1 --2- 172.21.15.146:0/3825355124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9a80159450 0x7f9a8016ca90 unknown :-1 s=CLOSED pgs=2151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:37.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.402+0000 7f9a86d1d700 1 -- 172.21.15.146:0/3825355124 >> 172.21.15.146:0/3825355124 conn(0x7f9a8006eb10 msgr2=0x7f9a800ce910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:37.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.402+0000 7f9a86d1d700 1 -- 172.21.15.146:0/3825355124 shutdown_connections 2023-10-06T11:18:37.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.402+0000 7f9a86d1d700 1 -- 172.21.15.146:0/3825355124 wait complete. 2023-10-06T11:18:37.417 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T11:18:37.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.534+0000 7f1d08864700 1 Processor -- start 2023-10-06T11:18:37.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.534+0000 7f1d08864700 1 -- start start 2023-10-06T11:18:37.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.535+0000 7f1d08864700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1d040d0ca0 0x7f1d041646b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:37.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.535+0000 7f1d08864700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d040cdeb0 con 0x7f1d04159470 2023-10-06T11:18:37.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.535+0000 7f1d08864700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d040cd2a0 con 0x7f1d04159840 2023-10-06T11:18:37.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.535+0000 7f1d08864700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d040cd580 con 0x7f1d040d0ca0 2023-10-06T11:18:37.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.535+0000 7f1d02d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1d040d0ca0 0x7f1d041646b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:37.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.535+0000 7f1d0259c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f1d04159470 0x7f1d040cb630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52202/0 (socket says 172.21.15.146:52202) 2023-10-06T11:18:37.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.535+0000 7f1d0259c700 1 -- 172.21.15.146:0/3379440929 learned_addr learned my addr 172.21.15.146:0/3379440929 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:37.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.535+0000 7f1d02d9d700 1 -- 172.21.15.146:0/3379440929 >> v1:172.21.15.151:6789/0 conn(0x7f1d04159840 legacy=0x7f1d040d0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:37.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.535+0000 7f1d02d9d700 1 -- 172.21.15.146:0/3379440929 >> v1:172.21.15.146:6789/0 conn(0x7f1d04159470 legacy=0x7f1d040cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:37.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.535+0000 7f1d01d9b700 1 -- 172.21.15.146:0/3379440929 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3843577401 0 0) 0x7f1d040cdeb0 con 0x7f1d04159470 2023-10-06T11:18:37.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.535+0000 7f1d02d9d700 1 -- 172.21.15.146:0/3379440929 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d040cd860 con 0x7f1d040d0ca0 2023-10-06T11:18:37.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.535+0000 7f1d02d9d700 1 --2- 172.21.15.146:0/3379440929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d040d0ca0 0x7f1d041646b0 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc009e60 tx=0x7f1cfc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c25e0c67cf8be447 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:37.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.535+0000 7f1d01d9b700 1 -- 172.21.15.146:0/3379440929 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc00e070 con 0x7f1d040d0ca0 2023-10-06T11:18:37.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.535+0000 7f1d01d9b700 1 -- 172.21.15.146:0/3379440929 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cfc00bbf0 con 0x7f1d040d0ca0 2023-10-06T11:18:37.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.535+0000 7f1d01d9b700 1 -- 172.21.15.146:0/3379440929 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc012430 con 0x7f1d040d0ca0 2023-10-06T11:18:37.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.536+0000 7f1d08864700 1 -- 172.21.15.146:0/3379440929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d040d0ca0 msgr2=0x7f1d041646b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:37.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.536+0000 7f1d08864700 1 --2- 172.21.15.146:0/3379440929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d040d0ca0 0x7f1d041646b0 secure :-1 s=READY pgs=2153 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc009e60 tx=0x7f1cfc009780 comp rx=0 tx=0).stop 2023-10-06T11:18:37.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.536+0000 7f1d08864700 1 -- 172.21.15.146:0/3379440929 shutdown_connections 2023-10-06T11:18:37.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.536+0000 7f1d08864700 1 --2- 172.21.15.146:0/3379440929 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d040d0ca0 0x7f1d041646b0 unknown :-1 s=CLOSED pgs=2153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:37.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.536+0000 7f1d08864700 1 -- 172.21.15.146:0/3379440929 >> 172.21.15.146:0/3379440929 conn(0x7f1d0406eb10 msgr2=0x7f1d0406ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:37.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.536+0000 7f1d08864700 1 -- 172.21.15.146:0/3379440929 shutdown_connections 2023-10-06T11:18:37.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.536+0000 7f1d08864700 1 -- 172.21.15.146:0/3379440929 wait complete. 2023-10-06T11:18:37.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.537+0000 7f1d08864700 1 Processor -- start 2023-10-06T11:18:37.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.537+0000 7f1d08864700 1 -- start start 2023-10-06T11:18:37.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.538+0000 7f1d08864700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d040d0ca0 0x7f1d0414cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:37.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.538+0000 7f1d08864700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d04159470 0x7f1d04156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:37.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.538+0000 7f1d08864700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d04159840 0x7f1d0414e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:37.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.538+0000 7f1d08864700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d04150ce0 con 0x7f1d04159470 2023-10-06T11:18:37.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.538+0000 7f1d08864700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d040b33a0 con 0x7f1d040d0ca0 2023-10-06T11:18:37.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.538+0000 7f1d08864700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d040b4200 con 0x7f1d04159840 2023-10-06T11:18:37.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.538+0000 7f1cf9d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d04159470 0x7f1d04156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:37.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.538+0000 7f1cf9d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d04159470 0x7f1d04156230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41094/0 (socket says 172.21.15.146:41094) 2023-10-06T11:18:37.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.538+0000 7f1cf9d9b700 1 -- 172.21.15.146:0/4190352269 learned_addr learned my addr 172.21.15.146:0/4190352269 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:37.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.538+0000 7f1d0259c700 1 --2- 172.21.15.146:0/4190352269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d040d0ca0 0x7f1d0414cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:37.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.538+0000 7f1d02d9d700 1 --2- 172.21.15.146:0/4190352269 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d04159840 0x7f1d0414e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:37.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.538+0000 7f1cf9d9b700 1 -- 172.21.15.146:0/4190352269 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d04159840 msgr2=0x7f1d0414e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:37.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.538+0000 7f1cf9d9b700 1 --2- 172.21.15.146:0/4190352269 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d04159840 0x7f1d0414e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:37.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.538+0000 7f1cf9d9b700 1 -- 172.21.15.146:0/4190352269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d040d0ca0 msgr2=0x7f1d0414cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:37.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.538+0000 7f1cf9d9b700 1 --2- 172.21.15.146:0/4190352269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d040d0ca0 0x7f1d0414cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:37.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.538+0000 7f1cf9d9b700 1 -- 172.21.15.146:0/4190352269 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cfc009a20 con 0x7f1d04159470 2023-10-06T11:18:37.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.538+0000 7f1cf9d9b700 1 --2- 172.21.15.146:0/4190352269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d04159470 0x7f1d04156230 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 crypto rx=0x7f1cec00b5e0 tx=0x7f1cec009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:37.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.539+0000 7f1cfaffd700 1 -- 172.21.15.146:0/4190352269 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cec00f510 con 0x7f1d04159470 2023-10-06T11:18:37.549 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.539+0000 7f1cfaffd700 1 -- 172.21.15.146:0/4190352269 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cec00f670 con 0x7f1d04159470 2023-10-06T11:18:37.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.539+0000 7f1cfaffd700 1 -- 172.21.15.146:0/4190352269 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cec00fa30 con 0x7f1d04159470 2023-10-06T11:18:37.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.539+0000 7f1d08864700 1 -- 172.21.15.146:0/4190352269 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d040b35f0 con 0x7f1d04159470 2023-10-06T11:18:37.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.539+0000 7f1d08864700 1 -- 172.21.15.146:0/4190352269 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d040b3e90 con 0x7f1d04159470 2023-10-06T11:18:37.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.539+0000 7f1d08864700 1 -- 172.21.15.146:0/4190352269 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d040b39f0 con 0x7f1d04159470 2023-10-06T11:18:37.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.540+0000 7f1cfaffd700 1 -- 172.21.15.146:0/4190352269 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1cec01a400 con 0x7f1d04159470 2023-10-06T11:18:37.550 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.540+0000 7f1cfaffd700 1 --2- 172.21.15.146:0/4190352269 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1ce4066f30 0x7f1ce40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:37.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.540+0000 7f1cfaffd700 1 -- 172.21.15.146:0/4190352269 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f1cec084040 con 0x7f1d04159470 2023-10-06T11:18:37.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.540+0000 7f1d0259c700 1 --2- 172.21.15.146:0/4190352269 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1ce4066f30 0x7f1ce40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:37.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.541+0000 7f1d0259c700 1 --2- 172.21.15.146:0/4190352269 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1ce4066f30 0x7f1ce40693e0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4007fd0 tx=0x7f1cf4007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:37.551 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.545+0000 7f1cfaffd700 1 -- 172.21.15.146:0/4190352269 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1cec051170 con 0x7f1d04159470 2023-10-06T11:18:37.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.729+0000 7f1d08864700 1 -- 172.21.15.146:0/4190352269 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1d040b4370 con 0x7f1d04159470 2023-10-06T11:18:37.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.730+0000 7f1cfaffd700 1 -- 172.21.15.146:0/4190352269 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v165) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1cec054790 con 0x7f1d04159470 2023-10-06T11:18:37.732 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2023-10-06T11:18:37.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.732+0000 7f1d08864700 1 -- 172.21.15.146:0/4190352269 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1ce4066f30 msgr2=0x7f1ce40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:37.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.732+0000 7f1d08864700 1 --2- 172.21.15.146:0/4190352269 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1ce4066f30 0x7f1ce40693e0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f1cf4007fd0 tx=0x7f1cf4007d30 comp rx=0 tx=0).stop 2023-10-06T11:18:37.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.732+0000 7f1d08864700 1 -- 172.21.15.146:0/4190352269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d04159470 msgr2=0x7f1d04156230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:37.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.732+0000 7f1d08864700 1 --2- 172.21.15.146:0/4190352269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d04159470 0x7f1d04156230 secure :-1 s=READY pgs=2154 cs=0 l=1 rev1=1 crypto rx=0x7f1cec00b5e0 tx=0x7f1cec009120 comp rx=0 tx=0).stop 2023-10-06T11:18:37.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.732+0000 7f1d08864700 1 -- 172.21.15.146:0/4190352269 shutdown_connections 2023-10-06T11:18:37.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.732+0000 7f1d08864700 1 --2- 172.21.15.146:0/4190352269 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1ce4066f30 0x7f1ce40693e0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:37.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.732+0000 7f1d08864700 1 --2- 172.21.15.146:0/4190352269 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d04159840 0x7f1d0414e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:37.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.732+0000 7f1d08864700 1 --2- 172.21.15.146:0/4190352269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d040d0ca0 0x7f1d0414cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:37.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.732+0000 7f1d08864700 1 --2- 172.21.15.146:0/4190352269 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1d04159470 0x7f1d04156230 unknown :-1 s=CLOSED pgs=2154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:37.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.732+0000 7f1d08864700 1 -- 172.21.15.146:0/4190352269 >> 172.21.15.146:0/4190352269 conn(0x7f1d0406eb10 msgr2=0x7f1d0414df20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:37.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.732+0000 7f1d08864700 1 -- 172.21.15.146:0/4190352269 shutdown_connections 2023-10-06T11:18:37.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.732+0000 7f1d08864700 1 -- 172.21.15.146:0/4190352269 wait complete. 2023-10-06T11:18:37.746 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T11:18:37.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.862+0000 7f179f00e700 1 Processor -- start 2023-10-06T11:18:37.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.862+0000 7f179f00e700 1 -- start start 2023-10-06T11:18:37.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.863+0000 7f179f00e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1798157300 0x7f179806b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:37.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.863+0000 7f179f00e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17980b17c0 con 0x7f17980cc870 2023-10-06T11:18:37.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.863+0000 7f179f00e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17980cce70 con 0x7f17981576d0 2023-10-06T11:18:37.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.863+0000 7f179f00e700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f179815b530 con 0x7f1798157300 2023-10-06T11:18:37.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.863+0000 7f179e80d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f17980cc870 0x7f17980b1c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52204/0 (socket says 172.21.15.146:52204) 2023-10-06T11:18:37.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.863+0000 7f179e80d700 1 -- 172.21.15.146:0/450825473 learned_addr learned my addr 172.21.15.146:0/450825473 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:37.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.864+0000 7f179d00a700 1 -- 172.21.15.146:0/450825473 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2550292120 0 0) 0x7f17980b17c0 con 0x7f17980cc870 2023-10-06T11:18:37.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.864+0000 7f179e00c700 1 --2- 172.21.15.146:0/450825473 >> v2:172.21.15.151:3300/0 conn(0x7f1798157300 0x7f179806b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:37.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.864+0000 7f179d00a700 1 -- 172.21.15.146:0/450825473 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1784003570 con 0x7f17980cc870 2023-10-06T11:18:37.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.864+0000 7f179d00a700 1 -- 172.21.15.146:0/450825473 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4248702994 0 0) 0x7f1784003570 con 0x7f17980cc870 2023-10-06T11:18:37.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.864+0000 7f179d00a700 1 -- 172.21.15.146:0/450825473 >> v2:172.21.15.151:3300/0 conn(0x7f1798157300 msgr2=0x7f179806b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:37.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.864+0000 7f179d00a700 1 --2- 172.21.15.146:0/450825473 >> v2:172.21.15.151:3300/0 conn(0x7f1798157300 0x7f179806b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:37.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.864+0000 7f179d00a700 1 -- 172.21.15.146:0/450825473 >> v1:172.21.15.151:6789/0 conn(0x7f17981576d0 legacy=0x7f17980cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:37.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.864+0000 7f179d00a700 1 -- 172.21.15.146:0/450825473 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17980cd150 con 0x7f17980cc870 2023-10-06T11:18:37.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.864+0000 7f179d00a700 1 -- 172.21.15.146:0/450825473 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f1790001470 con 0x7f17980cc870 2023-10-06T11:18:37.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.864+0000 7f179d00a700 1 -- 172.21.15.146:0/450825473 >> v1:172.21.15.146:6789/0 conn(0x7f17980cc870 legacy=0x7f17980b1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:37.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.864+0000 7f179d00a700 1 --2- 172.21.15.146:0/450825473 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1784003a60 0x7f1784003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:37.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.864+0000 7f179d00a700 1 --2- 172.21.15.146:0/450825473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1784004810 0x7f1784004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:37.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.864+0000 7f179d00a700 1 --2- 172.21.15.146:0/450825473 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17840051c0 0x7f178400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:37.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.864+0000 7f179d00a700 1 -- 172.21.15.146:0/450825473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179815b530 con 0x7f1784004810 2023-10-06T11:18:37.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.864+0000 7f179d00a700 1 -- 172.21.15.146:0/450825473 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178400c160 con 0x7f1784003a60 2023-10-06T11:18:37.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.864+0000 7f179d00a700 1 -- 172.21.15.146:0/450825473 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f178400c320 con 0x7f17840051c0 2023-10-06T11:18:37.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.864+0000 7f179d80b700 1 --2- 172.21.15.146:0/450825473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1784004810 0x7f1784004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:37.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.864+0000 7f179e00c700 1 --2- 172.21.15.146:0/450825473 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1784003a60 0x7f1784003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:37.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.864+0000 7f179e80d700 1 --2- 172.21.15.146:0/450825473 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17840051c0 0x7f178400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:37.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.864+0000 7f179d80b700 1 -- 172.21.15.146:0/450825473 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17840051c0 msgr2=0x7f178400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:37.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.864+0000 7f179d80b700 1 --2- 172.21.15.146:0/450825473 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f17840051c0 0x7f178400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:37.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.864+0000 7f179d80b700 1 -- 172.21.15.146:0/450825473 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1784003a60 msgr2=0x7f1784003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:37.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.864+0000 7f179d80b700 1 --2- 172.21.15.146:0/450825473 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1784003a60 0x7f1784003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:37.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.864+0000 7f179d80b700 1 -- 172.21.15.146:0/450825473 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1784003570 con 0x7f1784004810 2023-10-06T11:18:37.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.864+0000 7f179e80d700 1 -- 172.21.15.146:0/450825473 reap_dead start 2023-10-06T11:18:37.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.865+0000 7f179d80b700 1 --2- 172.21.15.146:0/450825473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1784004810 0x7f1784004c80 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7f17880018b0 tx=0x7f1788007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75dbf53a201351e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:37.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.865+0000 7f179d00a700 1 -- 172.21.15.146:0/450825473 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1788012420 con 0x7f1784004810 2023-10-06T11:18:37.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.865+0000 7f179d00a700 1 -- 172.21.15.146:0/450825473 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1788012580 con 0x7f1784004810 2023-10-06T11:18:37.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.865+0000 7f179d00a700 1 -- 172.21.15.146:0/450825473 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1788012920 con 0x7f1784004810 2023-10-06T11:18:37.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.865+0000 7f179f00e700 1 -- 172.21.15.146:0/450825473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1784004810 msgr2=0x7f1784004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:37.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.865+0000 7f179f00e700 1 --2- 172.21.15.146:0/450825473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1784004810 0x7f1784004c80 secure :-1 s=READY pgs=2156 cs=0 l=1 rev1=1 crypto rx=0x7f17880018b0 tx=0x7f1788007d30 comp rx=0 tx=0).stop 2023-10-06T11:18:37.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.865+0000 7f179f00e700 1 -- 172.21.15.146:0/450825473 shutdown_connections 2023-10-06T11:18:37.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.865+0000 7f179f00e700 1 --2- 172.21.15.146:0/450825473 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1784004810 0x7f1784004c80 unknown :-1 s=CLOSED pgs=2156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:37.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.865+0000 7f179f00e700 1 -- 172.21.15.146:0/450825473 >> 172.21.15.146:0/450825473 conn(0x7f17980703f0 msgr2=0x7f17980707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:37.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.865+0000 7f179f00e700 1 -- 172.21.15.146:0/450825473 shutdown_connections 2023-10-06T11:18:37.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.865+0000 7f179f00e700 1 -- 172.21.15.146:0/450825473 wait complete. 2023-10-06T11:18:37.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.866+0000 7f179f00e700 1 Processor -- start 2023-10-06T11:18:37.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.866+0000 7f179f00e700 1 -- start start 2023-10-06T11:18:37.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.867+0000 7f179f00e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1784004810 0x7f17980aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:37.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.867+0000 7f179f00e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f179814efe0 0x7f17980af330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:37.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.867+0000 7f179f00e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17980684f0 0x7f1798068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:37.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.867+0000 7f179f00e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1798069a30 con 0x7f17980684f0 2023-10-06T11:18:37.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.867+0000 7f179f00e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179815b830 con 0x7f1784004810 2023-10-06T11:18:37.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.867+0000 7f179f00e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1798069190 con 0x7f179814efe0 2023-10-06T11:18:37.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.867+0000 7f179e80d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17980684f0 0x7f1798068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:37.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.867+0000 7f179e80d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17980684f0 0x7f1798068960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41108/0 (socket says 172.21.15.146:41108) 2023-10-06T11:18:37.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.867+0000 7f179e80d700 1 -- 172.21.15.146:0/480692820 learned_addr learned my addr 172.21.15.146:0/480692820 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:37.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.867+0000 7f179d80b700 1 --2- 172.21.15.146:0/480692820 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f179814efe0 0x7f17980af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:37.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.867+0000 7f179e00c700 1 --2- 172.21.15.146:0/480692820 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1784004810 0x7f17980aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:37.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.867+0000 7f179e80d700 1 -- 172.21.15.146:0/480692820 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f179814efe0 msgr2=0x7f17980af330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:37.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.867+0000 7f179e80d700 1 --2- 172.21.15.146:0/480692820 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f179814efe0 0x7f17980af330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:37.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.867+0000 7f179e80d700 1 -- 172.21.15.146:0/480692820 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1784004810 msgr2=0x7f17980aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:37.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.867+0000 7f179e80d700 1 --2- 172.21.15.146:0/480692820 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1784004810 0x7f17980aedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:37.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.867+0000 7f179e80d700 1 -- 172.21.15.146:0/480692820 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1798069470 con 0x7f17980684f0 2023-10-06T11:18:37.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.867+0000 7f179d80b700 1 --2- 172.21.15.146:0/480692820 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f179814efe0 0x7f17980af330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:18:37.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.868+0000 7f179e80d700 1 --2- 172.21.15.146:0/480692820 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17980684f0 0x7f1798068960 secure :-1 s=READY pgs=2157 cs=0 l=1 rev1=1 crypto rx=0x7f17980ce6f0 tx=0x7f1790001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:37.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.868+0000 7f178e7fc700 1 -- 172.21.15.146:0/480692820 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179000f690 con 0x7f17980684f0 2023-10-06T11:18:37.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.868+0000 7f178e7fc700 1 -- 172.21.15.146:0/480692820 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f179000f810 con 0x7f17980684f0 2023-10-06T11:18:37.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.868+0000 7f179f00e700 1 -- 172.21.15.146:0/480692820 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1798069750 con 0x7f17980684f0 2023-10-06T11:18:37.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.868+0000 7f178e7fc700 1 -- 172.21.15.146:0/480692820 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f179000fbd0 con 0x7f17980684f0 2023-10-06T11:18:37.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.868+0000 7f179f00e700 1 -- 172.21.15.146:0/480692820 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f179815bcc0 con 0x7f17980684f0 2023-10-06T11:18:37.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.869+0000 7f179f00e700 1 -- 172.21.15.146:0/480692820 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17980631f0 con 0x7f17980684f0 2023-10-06T11:18:37.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.869+0000 7f178e7fc700 1 -- 172.21.15.146:0/480692820 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1790014450 con 0x7f17980684f0 2023-10-06T11:18:37.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.869+0000 7f178e7fc700 1 --2- 172.21.15.146:0/480692820 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f177c066f30 0x7f177c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:37.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.870+0000 7f178e7fc700 1 -- 172.21.15.146:0/480692820 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f1790083fe0 con 0x7f17980684f0 2023-10-06T11:18:37.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.870+0000 7f179e00c700 1 --2- 172.21.15.146:0/480692820 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f177c066f30 0x7f177c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:37.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.870+0000 7f179e00c700 1 --2- 172.21.15.146:0/480692820 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f177c066f30 0x7f177c0693e0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f17940094d0 tx=0x7f179400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:37.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:37.874+0000 7f178e7fc700 1 -- 172.21.15.146:0/480692820 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f179004d5a0 con 0x7f17980684f0 2023-10-06T11:18:38.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.060+0000 7f179f00e700 1 -- 172.21.15.146:0/480692820 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f17980cd430 con 0x7f17980684f0 2023-10-06T11:18:38.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.060+0000 7f178e7fc700 1 -- 172.21.15.146:0/480692820 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v165) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1790019070 con 0x7f17980684f0 2023-10-06T11:18:38.063 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2023-10-06T11:18:38.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.063+0000 7f179f00e700 1 -- 172.21.15.146:0/480692820 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f177c066f30 msgr2=0x7f177c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:38.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.063+0000 7f179f00e700 1 --2- 172.21.15.146:0/480692820 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f177c066f30 0x7f177c0693e0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f17940094d0 tx=0x7f179400b040 comp rx=0 tx=0).stop 2023-10-06T11:18:38.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.063+0000 7f179f00e700 1 -- 172.21.15.146:0/480692820 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17980684f0 msgr2=0x7f1798068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:38.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.063+0000 7f179f00e700 1 --2- 172.21.15.146:0/480692820 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17980684f0 0x7f1798068960 secure :-1 s=READY pgs=2157 cs=0 l=1 rev1=1 crypto rx=0x7f17980ce6f0 tx=0x7f1790001e50 comp rx=0 tx=0).stop 2023-10-06T11:18:38.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.063+0000 7f179f00e700 1 -- 172.21.15.146:0/480692820 shutdown_connections 2023-10-06T11:18:38.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.063+0000 7f179f00e700 1 --2- 172.21.15.146:0/480692820 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f177c066f30 0x7f177c0693e0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:38.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.063+0000 7f179f00e700 1 --2- 172.21.15.146:0/480692820 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f17980684f0 0x7f1798068960 unknown :-1 s=CLOSED pgs=2157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:38.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.063+0000 7f179f00e700 1 --2- 172.21.15.146:0/480692820 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1784004810 0x7f17980aedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:38.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.063+0000 7f179f00e700 1 --2- 172.21.15.146:0/480692820 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f179814efe0 0x7f17980af330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:38.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.063+0000 7f179f00e700 1 -- 172.21.15.146:0/480692820 >> 172.21.15.146:0/480692820 conn(0x7f17980703f0 msgr2=0x7f179806b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:38.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.063+0000 7f179f00e700 1 -- 172.21.15.146:0/480692820 shutdown_connections 2023-10-06T11:18:38.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.063+0000 7f179f00e700 1 -- 172.21.15.146:0/480692820 wait complete. 2023-10-06T11:18:38.077 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:18:38.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.189+0000 7f56ac4db700 1 Processor -- start 2023-10-06T11:18:38.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.189+0000 7f56ac4db700 1 -- start start 2023-10-06T11:18:38.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.190+0000 7f56ac4db700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f56a415a940 0x7f56a4153c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:38.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.190+0000 7f56ac4db700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f56a415dcc0 0x7f56a40ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:38.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.190+0000 7f56ac4db700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56a415d270 con 0x7f56a41538c0 2023-10-06T11:18:38.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.190+0000 7f56ac4db700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56a415d830 con 0x7f56a415a940 2023-10-06T11:18:38.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.190+0000 7f56ac4db700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56a415e110 con 0x7f56a415dcc0 2023-10-06T11:18:38.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.190+0000 7f56aa277700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f56a41538c0 0x7f56a40cac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52218/0 (socket says 172.21.15.146:52218) 2023-10-06T11:18:38.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.190+0000 7f56aa277700 1 -- 172.21.15.146:0/1079041238 learned_addr learned my addr 172.21.15.146:0/1079041238 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:38.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.190+0000 7f56a9a76700 1 --2- 172.21.15.146:0/1079041238 >> v2:172.21.15.146:3300/0 conn(0x7f56a415a940 0x7f56a4153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:38.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.191+0000 7f56aaa78700 1 --2- 172.21.15.146:0/1079041238 >> v2:172.21.15.151:3300/0 conn(0x7f56a415dcc0 0x7f56a40ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:38.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.191+0000 7f56a9275700 1 -- 172.21.15.146:0/1079041238 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3311249687 0 0) 0x7f56a415d270 con 0x7f56a41538c0 2023-10-06T11:18:38.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.191+0000 7f56a9275700 1 -- 172.21.15.146:0/1079041238 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5690003570 con 0x7f56a41538c0 2023-10-06T11:18:38.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.191+0000 7f56a9a76700 1 -- 172.21.15.146:0/1079041238 >> v2:172.21.15.151:3300/0 conn(0x7f56a415dcc0 msgr2=0x7f56a40ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:38.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.191+0000 7f56a9a76700 1 --2- 172.21.15.146:0/1079041238 >> v2:172.21.15.151:3300/0 conn(0x7f56a415dcc0 0x7f56a40ce610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:38.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.191+0000 7f56a9a76700 1 -- 172.21.15.146:0/1079041238 >> v1:172.21.15.146:6789/0 conn(0x7f56a41538c0 legacy=0x7f56a40cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:38.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.191+0000 7f56a9a76700 1 -- 172.21.15.146:0/1079041238 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a40cb810 con 0x7f56a415a940 2023-10-06T11:18:38.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.191+0000 7f56aaa78700 1 --2- 172.21.15.146:0/1079041238 >> v2:172.21.15.151:3300/0 conn(0x7f56a415dcc0 0x7f56a40ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:18:38.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.191+0000 7f56a9a76700 1 --2- 172.21.15.146:0/1079041238 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56a415a940 0x7f56a4153c90 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7f56a415d1a0 tx=0x7f56940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1793ee5e03bd5b02 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:38.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.191+0000 7f56a9275700 1 -- 172.21.15.146:0/1079041238 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5694011630 con 0x7f56a415a940 2023-10-06T11:18:38.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.191+0000 7f56a9275700 1 -- 172.21.15.146:0/1079041238 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5694011790 con 0x7f56a415a940 2023-10-06T11:18:38.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.191+0000 7f56a9275700 1 -- 172.21.15.146:0/1079041238 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5694011b10 con 0x7f56a415a940 2023-10-06T11:18:38.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.192+0000 7f56ac4db700 1 -- 172.21.15.146:0/1079041238 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56a415a940 msgr2=0x7f56a4153c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:38.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.192+0000 7f56ac4db700 1 --2- 172.21.15.146:0/1079041238 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56a415a940 0x7f56a4153c90 secure :-1 s=READY pgs=2159 cs=0 l=1 rev1=1 crypto rx=0x7f56a415d1a0 tx=0x7f56940091a0 comp rx=0 tx=0).stop 2023-10-06T11:18:38.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.192+0000 7f56ac4db700 1 -- 172.21.15.146:0/1079041238 shutdown_connections 2023-10-06T11:18:38.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.192+0000 7f56ac4db700 1 --2- 172.21.15.146:0/1079041238 >> v2:172.21.15.151:3300/0 conn(0x7f56a415dcc0 0x7f56a40ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:38.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.192+0000 7f56ac4db700 1 --2- 172.21.15.146:0/1079041238 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56a415a940 0x7f56a4153c90 unknown :-1 s=CLOSED pgs=2159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:38.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.192+0000 7f56ac4db700 1 -- 172.21.15.146:0/1079041238 >> 172.21.15.146:0/1079041238 conn(0x7f56a406eb10 msgr2=0x7f56a406ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:38.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.192+0000 7f56ac4db700 1 -- 172.21.15.146:0/1079041238 shutdown_connections 2023-10-06T11:18:38.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.192+0000 7f56ac4db700 1 -- 172.21.15.146:0/1079041238 wait complete. 2023-10-06T11:18:38.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.193+0000 7f56ac4db700 1 Processor -- start 2023-10-06T11:18:38.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.193+0000 7f56ac4db700 1 -- start start 2023-10-06T11:18:38.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.193+0000 7f56ac4db700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56a41538c0 0x7f56a40c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:38.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.193+0000 7f56ac4db700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56a415a940 0x7f56a40b02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:38.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.193+0000 7f56ac4db700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56a415dcc0 0x7f56a416a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:38.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.193+0000 7f56ac4db700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a414f7d0 con 0x7f56a415a940 2023-10-06T11:18:38.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.193+0000 7f56ac4db700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a40c8790 con 0x7f56a41538c0 2023-10-06T11:18:38.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.193+0000 7f56ac4db700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a416ae90 con 0x7f56a415dcc0 2023-10-06T11:18:38.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.194+0000 7f56a9a76700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56a415a940 0x7f56a40b02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:38.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.194+0000 7f56a9a76700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56a415a940 0x7f56a40b02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41116/0 (socket says 172.21.15.146:41116) 2023-10-06T11:18:38.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.194+0000 7f56a9a76700 1 -- 172.21.15.146:0/2172137357 learned_addr learned my addr 172.21.15.146:0/2172137357 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:38.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.194+0000 7f56a9a76700 1 -- 172.21.15.146:0/2172137357 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56a415dcc0 msgr2=0x7f56a416a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:38.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.194+0000 7f56aa277700 1 --2- 172.21.15.146:0/2172137357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56a41538c0 0x7f56a40c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:38.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.194+0000 7f56a9a76700 1 --2- 172.21.15.146:0/2172137357 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56a415dcc0 0x7f56a416a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:38.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.194+0000 7f56a9a76700 1 -- 172.21.15.146:0/2172137357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56a41538c0 msgr2=0x7f56a40c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:38.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.194+0000 7f56a9a76700 1 --2- 172.21.15.146:0/2172137357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56a41538c0 0x7f56a40c9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:38.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.194+0000 7f56a9a76700 1 -- 172.21.15.146:0/2172137357 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5694009420 con 0x7f56a415a940 2023-10-06T11:18:38.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.194+0000 7f56a9a76700 1 --2- 172.21.15.146:0/2172137357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56a415a940 0x7f56a40b02b0 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x7f56a40c7450 tx=0x7f5694017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:38.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.194+0000 7f569a7fc700 1 -- 172.21.15.146:0/2172137357 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5694011b10 con 0x7f56a415a940 2023-10-06T11:18:38.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.194+0000 7f569a7fc700 1 -- 172.21.15.146:0/2172137357 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5694000cc0 con 0x7f56a415a940 2023-10-06T11:18:38.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.194+0000 7f56ac4db700 1 -- 172.21.15.146:0/2172137357 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56a40ca2c0 con 0x7f56a415a940 2023-10-06T11:18:38.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.194+0000 7f569a7fc700 1 -- 172.21.15.146:0/2172137357 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5694025630 con 0x7f56a415a940 2023-10-06T11:18:38.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.194+0000 7f56ac4db700 1 -- 172.21.15.146:0/2172137357 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56a414f3f0 con 0x7f56a415a940 2023-10-06T11:18:38.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.195+0000 7f56ac4db700 1 -- 172.21.15.146:0/2172137357 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56a414ef70 con 0x7f56a415a940 2023-10-06T11:18:38.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.196+0000 7f569a7fc700 1 -- 172.21.15.146:0/2172137357 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5694025a20 con 0x7f56a415a940 2023-10-06T11:18:38.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.196+0000 7f569a7fc700 1 --2- 172.21.15.146:0/2172137357 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5688066f30 0x7f56880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:38.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.196+0000 7f569a7fc700 1 -- 172.21.15.146:0/2172137357 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f5694086200 con 0x7f56a415a940 2023-10-06T11:18:38.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.196+0000 7f56aa277700 1 --2- 172.21.15.146:0/2172137357 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5688066f30 0x7f56880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:38.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.196+0000 7f56aa277700 1 --2- 172.21.15.146:0/2172137357 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5688066f30 0x7f56880693e0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f56a0005c50 tx=0x7f56a0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:38.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.200+0000 7f569a7fc700 1 -- 172.21.15.146:0/2172137357 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f56a414ef70 con 0x7f56a415a940 2023-10-06T11:18:38.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.429+0000 7f56ac4db700 1 -- 172.21.15.146:0/2172137357 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f56a414f910 con 0x7f56a415a940 2023-10-06T11:18:38.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.430+0000 7f569a7fc700 1 -- 172.21.15.146:0/2172137357 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 136 v136) v1 ==== 95+0+4620 (secure 0 0 0) 0x7f56a414f910 con 0x7f56a415a940 2023-10-06T11:18:38.432 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:18:38.432 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":136,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7694,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3150776091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3150776091},{"type":"v1","addr":"172.21.15.151:6834","nonce":3150776091}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":131},{"gid":8836,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/731448405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":731448405},{"type":"v1","addr":"172.21.15.151:6835","nonce":731448405}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":131},{"gid":10077,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2392749618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2392749618},{"type":"v1","addr":"172.21.15.146:6836","nonce":2392749618}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":131}],"filesystems":[{"mdsmap":{"epoch":136,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:18:25.258682+0000","modified":"2023-10-06T11:18:28.884125+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10080},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10080":{"gid":10080,"name":"a","rank":0,"incarnation":132,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/1340411581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":1340411581},{"type":"v1","addr":"172.21.15.146:6837","nonce":1340411581}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-06T11:18:38.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.432+0000 7f56ac4db700 1 -- 172.21.15.146:0/2172137357 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5688066f30 msgr2=0x7f56880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:38.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.432+0000 7f56ac4db700 1 --2- 172.21.15.146:0/2172137357 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5688066f30 0x7f56880693e0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f56a0005c50 tx=0x7f56a0009040 comp rx=0 tx=0).stop 2023-10-06T11:18:38.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.432+0000 7f56ac4db700 1 -- 172.21.15.146:0/2172137357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56a415a940 msgr2=0x7f56a40b02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:38.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.432+0000 7f56ac4db700 1 --2- 172.21.15.146:0/2172137357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56a415a940 0x7f56a40b02b0 secure :-1 s=READY pgs=2160 cs=0 l=1 rev1=1 crypto rx=0x7f56a40c7450 tx=0x7f5694017000 comp rx=0 tx=0).stop 2023-10-06T11:18:38.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.432+0000 7f56ac4db700 1 -- 172.21.15.146:0/2172137357 shutdown_connections 2023-10-06T11:18:38.434 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.432+0000 7f56ac4db700 1 --2- 172.21.15.146:0/2172137357 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5688066f30 0x7f56880693e0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:38.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.432+0000 7f56ac4db700 1 --2- 172.21.15.146:0/2172137357 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56a415dcc0 0x7f56a416a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:38.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.432+0000 7f56ac4db700 1 --2- 172.21.15.146:0/2172137357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56a41538c0 0x7f56a40c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:38.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.432+0000 7f56ac4db700 1 --2- 172.21.15.146:0/2172137357 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f56a415a940 0x7f56a40b02b0 unknown :-1 s=CLOSED pgs=2160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:38.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.432+0000 7f56ac4db700 1 -- 172.21.15.146:0/2172137357 >> 172.21.15.146:0/2172137357 conn(0x7f56a406eb10 msgr2=0x7f56a40c53e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:38.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.432+0000 7f56ac4db700 1 -- 172.21.15.146:0/2172137357 shutdown_connections 2023-10-06T11:18:38.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.432+0000 7f56ac4db700 1 -- 172.21.15.146:0/2172137357 wait complete. 2023-10-06T11:18:38.435 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 136 2023-10-06T11:18:38.446 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:18:38.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.558+0000 7f8d05dea700 1 Processor -- start 2023-10-06T11:18:38.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.558+0000 7f8d05dea700 1 -- start start 2023-10-06T11:18:38.561 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.558+0000 7f8d05dea700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8d001538c0 0x7f8d00153c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:38.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.559+0000 7f8d05dea700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d0015d270 con 0x7f8d0015dcc0 2023-10-06T11:18:38.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.559+0000 7f8d05dea700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d0015d830 con 0x7f8d0015a940 2023-10-06T11:18:38.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.559+0000 7f8d05dea700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d0015e110 con 0x7f8d001538c0 2023-10-06T11:18:38.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.559+0000 7f8cff7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8d001538c0 0x7f8d00153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:38.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.559+0000 7f8cfffff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8d0015dcc0 0x7f8d000ce610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52220/0 (socket says 172.21.15.146:52220) 2023-10-06T11:18:38.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.559+0000 7f8cfffff700 1 -- 172.21.15.146:0/330785723 learned_addr learned my addr 172.21.15.146:0/330785723 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:38.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.559+0000 7f8cff7fe700 1 -- 172.21.15.146:0/330785723 >> v1:172.21.15.151:6789/0 conn(0x7f8d0015a940 legacy=0x7f8d000cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:38.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.559+0000 7f8cff7fe700 1 -- 172.21.15.146:0/330785723 >> v1:172.21.15.146:6789/0 conn(0x7f8d0015dcc0 legacy=0x7f8d000ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:38.562 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.559+0000 7f8cff7fe700 1 -- 172.21.15.146:0/330785723 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d000cb810 con 0x7f8d001538c0 2023-10-06T11:18:38.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.559+0000 7f8cfe7fc700 1 -- 172.21.15.146:0/330785723 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2704774074 0 0) 0x7f8d0015d270 con 0x7f8d0015dcc0 2023-10-06T11:18:38.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.559+0000 7f8cff7fe700 1 --2- 172.21.15.146:0/330785723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d001538c0 0x7f8d00153c90 secure :-1 s=READY pgs=2162 cs=0 l=1 rev1=1 crypto rx=0x7f8cf00098e0 tx=0x7f8cf00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=906860c627b3aae7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:38.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.559+0000 7f8cfe7fc700 1 -- 172.21.15.146:0/330785723 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf0009e80 con 0x7f8d001538c0 2023-10-06T11:18:38.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.559+0000 7f8cfe7fc700 1 -- 172.21.15.146:0/330785723 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf000b820 con 0x7f8d001538c0 2023-10-06T11:18:38.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.559+0000 7f8cfe7fc700 1 -- 172.21.15.146:0/330785723 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf000bba0 con 0x7f8d001538c0 2023-10-06T11:18:38.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.560+0000 7f8d05dea700 1 -- 172.21.15.146:0/330785723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d001538c0 msgr2=0x7f8d00153c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:38.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.560+0000 7f8d05dea700 1 --2- 172.21.15.146:0/330785723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d001538c0 0x7f8d00153c90 secure :-1 s=READY pgs=2162 cs=0 l=1 rev1=1 crypto rx=0x7f8cf00098e0 tx=0x7f8cf00091a0 comp rx=0 tx=0).stop 2023-10-06T11:18:38.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.560+0000 7f8d05dea700 1 -- 172.21.15.146:0/330785723 shutdown_connections 2023-10-06T11:18:38.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.560+0000 7f8d05dea700 1 --2- 172.21.15.146:0/330785723 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d001538c0 0x7f8d00153c90 unknown :-1 s=CLOSED pgs=2162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:38.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.560+0000 7f8d05dea700 1 -- 172.21.15.146:0/330785723 >> 172.21.15.146:0/330785723 conn(0x7f8d0006eb10 msgr2=0x7f8d0006ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:38.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.560+0000 7f8d05dea700 1 -- 172.21.15.146:0/330785723 shutdown_connections 2023-10-06T11:18:38.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.560+0000 7f8d05dea700 1 -- 172.21.15.146:0/330785723 wait complete. 2023-10-06T11:18:38.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.561+0000 7f8d05dea700 1 Processor -- start 2023-10-06T11:18:38.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.561+0000 7f8d05dea700 1 -- start start 2023-10-06T11:18:38.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.562+0000 7f8d05dea700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d001538c0 0x7f8d00169f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:38.566 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.562+0000 7f8d05dea700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d0015a940 0x7f8d0014f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:38.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.562+0000 7f8d05dea700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d0015dcc0 0x7f8d0015caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:38.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.562+0000 7f8d05dea700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0015cfe0 con 0x7f8d0015dcc0 2023-10-06T11:18:38.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.562+0000 7f8d05dea700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0014f910 con 0x7f8d001538c0 2023-10-06T11:18:38.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.562+0000 7f8d05dea700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0014fbf0 con 0x7f8d0015a940 2023-10-06T11:18:38.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.562+0000 7f8cfffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d0015dcc0 0x7f8d0015caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:38.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.562+0000 7f8cfffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d0015dcc0 0x7f8d0015caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41126/0 (socket says 172.21.15.146:41126) 2023-10-06T11:18:38.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.562+0000 7f8cfffff700 1 -- 172.21.15.146:0/57778925 learned_addr learned my addr 172.21.15.146:0/57778925 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:38.567 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.562+0000 7f8cff7fe700 1 --2- 172.21.15.146:0/57778925 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d001538c0 0x7f8d00169f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:38.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.562+0000 7f8cfeffd700 1 --2- 172.21.15.146:0/57778925 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d0015a940 0x7f8d0014f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:38.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.562+0000 7f8cfffff700 1 -- 172.21.15.146:0/57778925 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d0015a940 msgr2=0x7f8d0014f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:38.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.562+0000 7f8cfffff700 1 --2- 172.21.15.146:0/57778925 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d0015a940 0x7f8d0014f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:38.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.562+0000 7f8cfffff700 1 -- 172.21.15.146:0/57778925 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d001538c0 msgr2=0x7f8d00169f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:38.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.562+0000 7f8cfffff700 1 --2- 172.21.15.146:0/57778925 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d001538c0 0x7f8d00169f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:38.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.562+0000 7f8cfffff700 1 -- 172.21.15.146:0/57778925 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf0009420 con 0x7f8d0015dcc0 2023-10-06T11:18:38.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.562+0000 7f8cfeffd700 1 --2- 172.21.15.146:0/57778925 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d0015a940 0x7f8d0014f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:18:38.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.562+0000 7f8cfffff700 1 --2- 172.21.15.146:0/57778925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d0015dcc0 0x7f8d0015caa0 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 crypto rx=0x7f8cf800cc90 tx=0x7f8cf8001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:38.568 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.562+0000 7f8ce77fe700 1 -- 172.21.15.146:0/57778925 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf800a960 con 0x7f8d0015dcc0 2023-10-06T11:18:38.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.562+0000 7f8ce77fe700 1 -- 172.21.15.146:0/57778925 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf800aac0 con 0x7f8d0015dcc0 2023-10-06T11:18:38.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.563+0000 7f8ce77fe700 1 -- 172.21.15.146:0/57778925 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf800ae80 con 0x7f8d0015dcc0 2023-10-06T11:18:38.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.563+0000 7f8d05dea700 1 -- 172.21.15.146:0/57778925 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d0014fed0 con 0x7f8d0015dcc0 2023-10-06T11:18:38.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.563+0000 7f8d05dea700 1 -- 172.21.15.146:0/57778925 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d00150490 con 0x7f8d0015dcc0 2023-10-06T11:18:38.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.564+0000 7f8d05dea700 1 -- 172.21.15.146:0/57778925 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d0004c380 con 0x7f8d0015dcc0 2023-10-06T11:18:38.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.564+0000 7f8ce77fe700 1 -- 172.21.15.146:0/57778925 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8cf8007300 con 0x7f8d0015dcc0 2023-10-06T11:18:38.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.564+0000 7f8ce77fe700 1 --2- 172.21.15.146:0/57778925 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8cec066f30 0x7f8cec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:38.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.564+0000 7f8ce77fe700 1 -- 172.21.15.146:0/57778925 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f8cf8084ad0 con 0x7f8d0015dcc0 2023-10-06T11:18:38.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.564+0000 7f8cff7fe700 1 --2- 172.21.15.146:0/57778925 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8cec066f30 0x7f8cec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:38.569 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.565+0000 7f8cff7fe700 1 --2- 172.21.15.146:0/57778925 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8cec066f30 0x7f8cec0693e0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f8cf00030c0 tx=0x7f8cf0016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:38.572 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.568+0000 7f8ce77fe700 1 -- 172.21.15.146:0/57778925 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8cf8051c00 con 0x7f8d0015dcc0 2023-10-06T11:18:38.756 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.754+0000 7f8d05dea700 1 -- 172.21.15.146:0/57778925 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d000cbaf0 con 0x7f8d0015dcc0 2023-10-06T11:18:38.757 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.755+0000 7f8ce77fe700 1 -- 172.21.15.146:0/57778925 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v165) v1 ==== 74+0+17073 (secure 0 0 0) 0x7f8cf8055220 con 0x7f8d0015dcc0 2023-10-06T11:18:38.757 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:18:38.757 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":165,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:18:33.746877+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:18:22.963878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-10-06T11:18:24.222990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"26.8","mappings":[{"from":1,"to":0}]},{"pgid":"26.1a","mappings":[{"from":1,"to":0}]},{"pgid":"26.3a","mappings":[{"from":3,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:18:38.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.757+0000 7f8d05dea700 1 -- 172.21.15.146:0/57778925 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8cec066f30 msgr2=0x7f8cec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:38.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.757+0000 7f8d05dea700 1 --2- 172.21.15.146:0/57778925 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8cec066f30 0x7f8cec0693e0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f8cf00030c0 tx=0x7f8cf0016000 comp rx=0 tx=0).stop 2023-10-06T11:18:38.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.757+0000 7f8d05dea700 1 -- 172.21.15.146:0/57778925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d0015dcc0 msgr2=0x7f8d0015caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:38.759 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.757+0000 7f8d05dea700 1 --2- 172.21.15.146:0/57778925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d0015dcc0 0x7f8d0015caa0 secure :-1 s=READY pgs=2163 cs=0 l=1 rev1=1 crypto rx=0x7f8cf800cc90 tx=0x7f8cf8001a80 comp rx=0 tx=0).stop 2023-10-06T11:18:38.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.757+0000 7f8d05dea700 1 -- 172.21.15.146:0/57778925 shutdown_connections 2023-10-06T11:18:38.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.757+0000 7f8d05dea700 1 --2- 172.21.15.146:0/57778925 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8cec066f30 0x7f8cec0693e0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:38.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.757+0000 7f8d05dea700 1 --2- 172.21.15.146:0/57778925 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d0015dcc0 0x7f8d0015caa0 unknown :-1 s=CLOSED pgs=2163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:38.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.757+0000 7f8d05dea700 1 --2- 172.21.15.146:0/57778925 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d001538c0 0x7f8d00169f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:38.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.757+0000 7f8d05dea700 1 --2- 172.21.15.146:0/57778925 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d0015a940 0x7f8d0014f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:38.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.757+0000 7f8d05dea700 1 -- 172.21.15.146:0/57778925 >> 172.21.15.146:0/57778925 conn(0x7f8d0006eb10 msgr2=0x7f8d0014b520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:38.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.757+0000 7f8d05dea700 1 -- 172.21.15.146:0/57778925 shutdown_connections 2023-10-06T11:18:38.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.757+0000 7f8d05dea700 1 -- 172.21.15.146:0/57778925 wait complete. 2023-10-06T11:18:38.772 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T11:18:38.772 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:18:38.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.885+0000 7ff6b4aa4700 1 Processor -- start 2023-10-06T11:18:38.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.885+0000 7ff6b4aa4700 1 -- start start 2023-10-06T11:18:38.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.886+0000 7ff6b4aa4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff6b00cd510 0x7ff6b0159350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:38.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.886+0000 7ff6b4aa4700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6b0159890 0x7ff6b015d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:38.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.886+0000 7ff6b4aa4700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6b00c7500 con 0x7ff6b00cd140 2023-10-06T11:18:38.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.886+0000 7ff6b4aa4700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6b00caed0 con 0x7ff6b00cd510 2023-10-06T11:18:38.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.886+0000 7ff6b4aa4700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b00cb770 con 0x7ff6b0159890 2023-10-06T11:18:38.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.886+0000 7ff6aeffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff6b00cd510 0x7ff6b0159350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:38.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.886+0000 7ff6aeffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff6b00cd510 0x7ff6b0159350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41130/0 (socket says 172.21.15.146:41130) 2023-10-06T11:18:38.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.886+0000 7ff6aeffd700 1 -- 172.21.15.146:0/2828754582 learned_addr learned my addr 172.21.15.146:0/2828754582 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:38.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.886+0000 7ff6affff700 1 --2- 172.21.15.146:0/2828754582 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6b0159890 0x7ff6b015d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:38.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.886+0000 7ff6aeffd700 1 -- 172.21.15.146:0/2828754582 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6b0159890 msgr2=0x7ff6b015d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:38.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.886+0000 7ff6aeffd700 1 --2- 172.21.15.146:0/2828754582 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6b0159890 0x7ff6b015d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:38.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.886+0000 7ff6aeffd700 1 -- 172.21.15.146:0/2828754582 >> v1:172.21.15.151:6789/0 conn(0x7ff6b00cd140 legacy=0x7ff6b00cc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:38.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.886+0000 7ff6aeffd700 1 -- 172.21.15.146:0/2828754582 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b00ccb70 con 0x7ff6b00cd510 2023-10-06T11:18:38.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.886+0000 7ff6aeffd700 1 --2- 172.21.15.146:0/2828754582 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6b00cd510 0x7ff6b0159350 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x7ff6a40099b0 tx=0x7ff6a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe03d6c3e4063759 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:38.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.886+0000 7ff6ae7fc700 1 -- 172.21.15.146:0/2828754582 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a400b820 con 0x7ff6b00cd510 2023-10-06T11:18:38.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.887+0000 7ff6ae7fc700 1 -- 172.21.15.146:0/2828754582 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a400b980 con 0x7ff6b00cd510 2023-10-06T11:18:38.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.887+0000 7ff6ae7fc700 1 -- 172.21.15.146:0/2828754582 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a400bd20 con 0x7ff6b00cd510 2023-10-06T11:18:38.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.887+0000 7ff6b4aa4700 1 -- 172.21.15.146:0/2828754582 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6b00cd510 msgr2=0x7ff6b0159350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:38.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.887+0000 7ff6b4aa4700 1 --2- 172.21.15.146:0/2828754582 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6b00cd510 0x7ff6b0159350 secure :-1 s=READY pgs=2164 cs=0 l=1 rev1=1 crypto rx=0x7ff6a40099b0 tx=0x7ff6a4009250 comp rx=0 tx=0).stop 2023-10-06T11:18:38.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.887+0000 7ff6b4aa4700 1 -- 172.21.15.146:0/2828754582 shutdown_connections 2023-10-06T11:18:38.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.887+0000 7ff6b4aa4700 1 --2- 172.21.15.146:0/2828754582 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6b0159890 0x7ff6b015d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:38.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.887+0000 7ff6b4aa4700 1 --2- 172.21.15.146:0/2828754582 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6b00cd510 0x7ff6b0159350 unknown :-1 s=CLOSED pgs=2164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:38.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.887+0000 7ff6b4aa4700 1 -- 172.21.15.146:0/2828754582 >> 172.21.15.146:0/2828754582 conn(0x7ff6b00705b0 msgr2=0x7ff6b006eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:38.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.887+0000 7ff6b4aa4700 1 -- 172.21.15.146:0/2828754582 shutdown_connections 2023-10-06T11:18:38.891 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.887+0000 7ff6b4aa4700 1 -- 172.21.15.146:0/2828754582 wait complete. 2023-10-06T11:18:38.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.888+0000 7ff6b4aa4700 1 Processor -- start 2023-10-06T11:18:38.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.888+0000 7ff6b4aa4700 1 -- start start 2023-10-06T11:18:38.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.889+0000 7ff6b4aa4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6b00cd140 0x7ff6b01678e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:38.894 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.889+0000 7ff6b4aa4700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6b00cd510 0x7ff6b016a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:38.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.889+0000 7ff6b4aa4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6b0159890 0x7ff6b00af550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:38.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.889+0000 7ff6b4aa4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b016bf10 con 0x7ff6b0159890 2023-10-06T11:18:38.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.889+0000 7ff6b4aa4700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b015f750 con 0x7ff6b00cd140 2023-10-06T11:18:38.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.889+0000 7ff6b4aa4700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b016b300 con 0x7ff6b00cd510 2023-10-06T11:18:38.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.889+0000 7ff6affff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6b0159890 0x7ff6b00af550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:38.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.889+0000 7ff6affff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6b0159890 0x7ff6b00af550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41144/0 (socket says 172.21.15.146:41144) 2023-10-06T11:18:38.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.889+0000 7ff6affff700 1 -- 172.21.15.146:0/35507570 learned_addr learned my addr 172.21.15.146:0/35507570 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:38.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.889+0000 7ff6aeffd700 1 --2- 172.21.15.146:0/35507570 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6b00cd510 0x7ff6b016a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:38.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.889+0000 7ff6af7fe700 1 --2- 172.21.15.146:0/35507570 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6b00cd140 0x7ff6b01678e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:38.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.889+0000 7ff6affff700 1 -- 172.21.15.146:0/35507570 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6b00cd510 msgr2=0x7ff6b016a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:38.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.889+0000 7ff6affff700 1 --2- 172.21.15.146:0/35507570 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6b00cd510 0x7ff6b016a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:38.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.889+0000 7ff6affff700 1 -- 172.21.15.146:0/35507570 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6b00cd140 msgr2=0x7ff6b01678e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:38.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.889+0000 7ff6affff700 1 --2- 172.21.15.146:0/35507570 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6b00cd140 0x7ff6b01678e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:38.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.889+0000 7ff6affff700 1 -- 172.21.15.146:0/35507570 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a40094f0 con 0x7ff6b0159890 2023-10-06T11:18:38.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.890+0000 7ff6affff700 1 --2- 172.21.15.146:0/35507570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6b0159890 0x7ff6b00af550 secure :-1 s=READY pgs=2165 cs=0 l=1 rev1=1 crypto rx=0x7ff6a800d890 tx=0x7ff6a8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:38.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.890+0000 7ff6977fe700 1 -- 172.21.15.146:0/35507570 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a80125f0 con 0x7ff6b0159890 2023-10-06T11:18:38.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.890+0000 7ff6977fe700 1 -- 172.21.15.146:0/35507570 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a8012770 con 0x7ff6b0159890 2023-10-06T11:18:38.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.890+0000 7ff6b4aa4700 1 -- 172.21.15.146:0/35507570 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b016b5e0 con 0x7ff6b0159890 2023-10-06T11:18:38.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.890+0000 7ff6977fe700 1 -- 172.21.15.146:0/35507570 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a8012b30 con 0x7ff6b0159890 2023-10-06T11:18:38.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.890+0000 7ff6b4aa4700 1 -- 172.21.15.146:0/35507570 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b016bba0 con 0x7ff6b0159890 2023-10-06T11:18:38.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.891+0000 7ff6b4aa4700 1 -- 172.21.15.146:0/35507570 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6b016c080 con 0x7ff6b0159890 2023-10-06T11:18:38.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.891+0000 7ff6977fe700 1 -- 172.21.15.146:0/35507570 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff6a801e460 con 0x7ff6b0159890 2023-10-06T11:18:38.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.891+0000 7ff6977fe700 1 --2- 172.21.15.146:0/35507570 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff69c066f30 0x7ff69c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:38.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.892+0000 7ff6977fe700 1 -- 172.21.15.146:0/35507570 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6145+0+0 (secure 0 0 0) 0x7ff6a8084da0 con 0x7ff6b0159890 2023-10-06T11:18:38.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.892+0000 7ff6af7fe700 1 --2- 172.21.15.146:0/35507570 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff69c066f30 0x7ff69c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:38.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.892+0000 7ff6af7fe700 1 --2- 172.21.15.146:0/35507570 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff69c066f30 0x7ff69c0693e0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0009fd0 tx=0x7ff6a0009600 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:38.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:38.896+0000 7ff6977fe700 1 -- 172.21.15.146:0/35507570 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff6a8051e50 con 0x7ff6b0159890 2023-10-06T11:18:39.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.119+0000 7ff6b4aa4700 1 -- 172.21.15.146:0/35507570 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff6b00d0030 con 0x7ff6b0159890 2023-10-06T11:18:39.121 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.120+0000 7ff6977fe700 1 -- 172.21.15.146:0/35507570 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 136 v136) v1 ==== 95+0+4620 (secure 0 0 0) 0x7ff6a8055470 con 0x7ff6b0159890 2023-10-06T11:18:39.122 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:18:39.122 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":136,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7694,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3150776091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3150776091},{"type":"v1","addr":"172.21.15.151:6834","nonce":3150776091}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":131},{"gid":8836,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/731448405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":731448405},{"type":"v1","addr":"172.21.15.151:6835","nonce":731448405}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":131},{"gid":10077,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2392749618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2392749618},{"type":"v1","addr":"172.21.15.146:6836","nonce":2392749618}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":131}],"filesystems":[{"mdsmap":{"epoch":136,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:18:25.258682+0000","modified":"2023-10-06T11:18:28.884125+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10080},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10080":{"gid":10080,"name":"a","rank":0,"incarnation":132,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/1340411581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":1340411581},{"type":"v1","addr":"172.21.15.146:6837","nonce":1340411581}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-06T11:18:39.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.122+0000 7ff6b4aa4700 1 -- 172.21.15.146:0/35507570 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff69c066f30 msgr2=0x7ff69c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:39.124 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.122+0000 7ff6b4aa4700 1 --2- 172.21.15.146:0/35507570 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff69c066f30 0x7ff69c0693e0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0009fd0 tx=0x7ff6a0009600 comp rx=0 tx=0).stop 2023-10-06T11:18:39.125 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.122+0000 7ff6b4aa4700 1 -- 172.21.15.146:0/35507570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6b0159890 msgr2=0x7ff6b00af550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:39.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.122+0000 7ff6b4aa4700 1 --2- 172.21.15.146:0/35507570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6b0159890 0x7ff6b00af550 secure :-1 s=READY pgs=2165 cs=0 l=1 rev1=1 crypto rx=0x7ff6a800d890 tx=0x7ff6a8008040 comp rx=0 tx=0).stop 2023-10-06T11:18:39.126 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.122+0000 7ff6b4aa4700 1 -- 172.21.15.146:0/35507570 shutdown_connections 2023-10-06T11:18:39.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.122+0000 7ff6b4aa4700 1 --2- 172.21.15.146:0/35507570 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff69c066f30 0x7ff69c0693e0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:39.127 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.122+0000 7ff6b4aa4700 1 --2- 172.21.15.146:0/35507570 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6b0159890 0x7ff6b00af550 unknown :-1 s=CLOSED pgs=2165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:39.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.122+0000 7ff6b4aa4700 1 --2- 172.21.15.146:0/35507570 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6b00cd140 0x7ff6b01678e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:39.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.122+0000 7ff6b4aa4700 1 --2- 172.21.15.146:0/35507570 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6b00cd510 0x7ff6b016a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:39.128 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.122+0000 7ff6b4aa4700 1 -- 172.21.15.146:0/35507570 >> 172.21.15.146:0/35507570 conn(0x7ff6b00705b0 msgr2=0x7ff6b00ce020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:39.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.122+0000 7ff6b4aa4700 1 -- 172.21.15.146:0/35507570 shutdown_connections 2023-10-06T11:18:39.129 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.122+0000 7ff6b4aa4700 1 -- 172.21.15.146:0/35507570 wait complete. 2023-10-06T11:18:39.129 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 136 2023-10-06T11:18:39.136 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:18:39.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.248+0000 7efcef59e700 1 Processor -- start 2023-10-06T11:18:39.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.248+0000 7efcef59e700 1 -- start start 2023-10-06T11:18:39.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.249+0000 7efcef59e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efcf015dd60 0x7efcf00c3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:39.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.249+0000 7efcef59e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7efcf015e130 0x7efcf00c2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:39.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.249+0000 7efcef59e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf00c2540 con 0x7efcf00673e0 2023-10-06T11:18:39.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.249+0000 7efcef59e700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcf0157930 con 0x7efcf015e130 2023-10-06T11:18:39.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.249+0000 7efcef59e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf00c2770 con 0x7efcf015dd60 2023-10-06T11:18:39.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.250+0000 7efcee59c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efcf015dd60 0x7efcf00c3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:39.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.250+0000 7efcedd9b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7efcf015e130 0x7efcf00c2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:39.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.250+0000 7efcedd9b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7efcf015e130 0x7efcf00c2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:45804/0 (socket says 172.21.15.146:45804) 2023-10-06T11:18:39.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.250+0000 7efcedd9b700 1 -- 172.21.15.146:0/4114470655 learned_addr learned my addr 172.21.15.146:0/4114470655 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:39.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.250+0000 7efcee59c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efcf015dd60 0x7efcf00c3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:36874/0 (socket says 172.21.15.146:36874) 2023-10-06T11:18:39.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.250+0000 7efceed9d700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7efcf00673e0 0x7efcf0069f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:45918/0 (socket says 172.21.15.146:45918) 2023-10-06T11:18:39.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.250+0000 7efcee59c700 1 -- 172.21.15.146:0/4114470655 >> v2:172.21.15.151:3300/0 conn(0x7efcf015e130 msgr2=0x7efcf00c2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:39.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.250+0000 7efcee59c700 1 --2- 172.21.15.146:0/4114470655 >> v2:172.21.15.151:3300/0 conn(0x7efcf015e130 0x7efcf00c2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:39.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.250+0000 7efcee59c700 1 -- 172.21.15.146:0/4114470655 >> v1:172.21.15.151:6789/0 conn(0x7efcf00673e0 legacy=0x7efcf0069f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:39.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.250+0000 7efcee59c700 1 -- 172.21.15.146:0/4114470655 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf015ae60 con 0x7efcf015dd60 2023-10-06T11:18:39.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.250+0000 7efcedd9b700 1 --2- 172.21.15.146:0/4114470655 >> v2:172.21.15.151:3300/0 conn(0x7efcf015e130 0x7efcf00c2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:18:39.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.250+0000 7efcee59c700 1 --2- 172.21.15.146:0/4114470655 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efcf015dd60 0x7efcf00c3c00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efce0009e60 tx=0x7efce0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a172ba04607d570 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:39.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.250+0000 7efced59a700 1 -- 172.21.15.146:0/4114470655 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce000e070 con 0x7efcf015dd60 2023-10-06T11:18:39.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.251+0000 7efced59a700 1 -- 172.21.15.146:0/4114470655 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce000bb60 con 0x7efcf015dd60 2023-10-06T11:18:39.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.251+0000 7efced59a700 1 -- 172.21.15.146:0/4114470655 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce0012430 con 0x7efcf015dd60 2023-10-06T11:18:39.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.251+0000 7efcef59e700 1 -- 172.21.15.146:0/4114470655 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efcf015dd60 msgr2=0x7efcf00c3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:39.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.251+0000 7efcef59e700 1 --2- 172.21.15.146:0/4114470655 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efcf015dd60 0x7efcf00c3c00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efce0009e60 tx=0x7efce0009780 comp rx=0 tx=0).stop 2023-10-06T11:18:39.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.251+0000 7efcef59e700 1 -- 172.21.15.146:0/4114470655 shutdown_connections 2023-10-06T11:18:39.255 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.251+0000 7efcef59e700 1 --2- 172.21.15.146:0/4114470655 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efcf015dd60 0x7efcf00c3c00 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:39.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.251+0000 7efcef59e700 1 --2- 172.21.15.146:0/4114470655 >> v2:172.21.15.151:3300/0 conn(0x7efcf015e130 0x7efcf00c2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:39.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.251+0000 7efcef59e700 1 -- 172.21.15.146:0/4114470655 >> 172.21.15.146:0/4114470655 conn(0x7efcf00cd260 msgr2=0x7efcf00cd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:39.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.251+0000 7efcef59e700 1 -- 172.21.15.146:0/4114470655 shutdown_connections 2023-10-06T11:18:39.256 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.251+0000 7efcef59e700 1 -- 172.21.15.146:0/4114470655 wait complete. 2023-10-06T11:18:39.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.252+0000 7efcef59e700 1 Processor -- start 2023-10-06T11:18:39.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.252+0000 7efcef59e700 1 -- start start 2023-10-06T11:18:39.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.253+0000 7efcef59e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efcf00673e0 0x7efcf0159890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:39.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.253+0000 7efcef59e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efcf015dd60 0x7efcf0159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:39.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.253+0000 7efcef59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcf015e130 0x7efcf016a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:39.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.253+0000 7efcef59e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf015a600 con 0x7efcf015e130 2023-10-06T11:18:39.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.253+0000 7efcef59e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf015a8e0 con 0x7efcf015dd60 2023-10-06T11:18:39.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.253+0000 7efcef59e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf015abc0 con 0x7efcf00673e0 2023-10-06T11:18:39.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.253+0000 7efceed9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcf015e130 0x7efcf016a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:39.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.253+0000 7efceed9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcf015e130 0x7efcf016a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41156/0 (socket says 172.21.15.146:41156) 2023-10-06T11:18:39.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.253+0000 7efceed9d700 1 -- 172.21.15.146:0/614781274 learned_addr learned my addr 172.21.15.146:0/614781274 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:39.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.253+0000 7efcee59c700 1 --2- 172.21.15.146:0/614781274 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efcf00673e0 0x7efcf0159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:39.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.253+0000 7efcedd9b700 1 --2- 172.21.15.146:0/614781274 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efcf015dd60 0x7efcf0159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:39.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.253+0000 7efceed9d700 1 -- 172.21.15.146:0/614781274 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efcf00673e0 msgr2=0x7efcf0159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:39.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.253+0000 7efceed9d700 1 --2- 172.21.15.146:0/614781274 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efcf00673e0 0x7efcf0159890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:39.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.253+0000 7efceed9d700 1 -- 172.21.15.146:0/614781274 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efcf015dd60 msgr2=0x7efcf0159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:39.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.253+0000 7efceed9d700 1 --2- 172.21.15.146:0/614781274 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efcf015dd60 0x7efcf0159dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:39.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.253+0000 7efceed9d700 1 -- 172.21.15.146:0/614781274 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd80094f0 con 0x7efcf015e130 2023-10-06T11:18:39.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.253+0000 7efceed9d700 1 --2- 172.21.15.146:0/614781274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcf015e130 0x7efcf016a280 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 crypto rx=0x7efce800c4e0 tx=0x7efce8007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:39.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.254+0000 7efce67fc700 1 -- 172.21.15.146:0/614781274 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce800ce90 con 0x7efcf015e130 2023-10-06T11:18:39.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.254+0000 7efce67fc700 1 -- 172.21.15.146:0/614781274 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce8005a70 con 0x7efcf015e130 2023-10-06T11:18:39.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.254+0000 7efcef59e700 1 -- 172.21.15.146:0/614781274 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efce0009a20 con 0x7efcf015e130 2023-10-06T11:18:39.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.254+0000 7efce67fc700 1 -- 172.21.15.146:0/614781274 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce8005e10 con 0x7efcf015e130 2023-10-06T11:18:39.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.254+0000 7efcef59e700 1 -- 172.21.15.146:0/614781274 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf00b05b0 con 0x7efcf015e130 2023-10-06T11:18:39.260 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.255+0000 7efcef59e700 1 -- 172.21.15.146:0/614781274 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf006d180 con 0x7efcf015e130 2023-10-06T11:18:39.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.255+0000 7efce67fc700 1 -- 172.21.15.146:0/614781274 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efce80072e0 con 0x7efcf015e130 2023-10-06T11:18:39.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.255+0000 7efce67fc700 1 --2- 172.21.15.146:0/614781274 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7efcd0066f30 0x7efcd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:39.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.255+0000 7efce67fc700 1 -- 172.21.15.146:0/614781274 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6145+0+0 (secure 0 0 0) 0x7efce8083a00 con 0x7efcf015e130 2023-10-06T11:18:39.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.255+0000 7efcee59c700 1 --2- 172.21.15.146:0/614781274 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7efcd0066f30 0x7efcd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:39.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.256+0000 7efcee59c700 1 --2- 172.21.15.146:0/614781274 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7efcd0066f30 0x7efcd00693e0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7efce00097c0 tx=0x7efce0019000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:39.261 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.260+0000 7efce67fc700 1 -- 172.21.15.146:0/614781274 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efce8050ab0 con 0x7efcf015e130 2023-10-06T11:18:39.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.486+0000 7efcef59e700 1 -- 172.21.15.146:0/614781274 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efcf015ce20 con 0x7efcf015e130 2023-10-06T11:18:39.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.487+0000 7efce67fc700 1 -- 172.21.15.146:0/614781274 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 136 v136) v1 ==== 95+0+4620 (secure 0 0 0) 0x7efce8017020 con 0x7efcf015e130 2023-10-06T11:18:39.489 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:18:39.489 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":136,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7694,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3150776091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3150776091},{"type":"v1","addr":"172.21.15.151:6834","nonce":3150776091}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":131},{"gid":8836,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/731448405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":731448405},{"type":"v1","addr":"172.21.15.151:6835","nonce":731448405}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":131},{"gid":10077,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2392749618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2392749618},{"type":"v1","addr":"172.21.15.146:6836","nonce":2392749618}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":131}],"filesystems":[{"mdsmap":{"epoch":136,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:18:25.258682+0000","modified":"2023-10-06T11:18:28.884125+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10080},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10080":{"gid":10080,"name":"a","rank":0,"incarnation":132,"state":"up:active","state_seq":3,"addr":"172.21.15.146:6837/1340411581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":1340411581},{"type":"v1","addr":"172.21.15.146:6837","nonce":1340411581}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-06T11:18:39.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.489+0000 7efcef59e700 1 -- 172.21.15.146:0/614781274 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7efcd0066f30 msgr2=0x7efcd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:39.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.489+0000 7efcef59e700 1 --2- 172.21.15.146:0/614781274 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7efcd0066f30 0x7efcd00693e0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7efce00097c0 tx=0x7efce0019000 comp rx=0 tx=0).stop 2023-10-06T11:18:39.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.489+0000 7efcef59e700 1 -- 172.21.15.146:0/614781274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcf015e130 msgr2=0x7efcf016a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:39.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.489+0000 7efcef59e700 1 --2- 172.21.15.146:0/614781274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcf015e130 0x7efcf016a280 secure :-1 s=READY pgs=2166 cs=0 l=1 rev1=1 crypto rx=0x7efce800c4e0 tx=0x7efce8007f50 comp rx=0 tx=0).stop 2023-10-06T11:18:39.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.489+0000 7efcef59e700 1 -- 172.21.15.146:0/614781274 shutdown_connections 2023-10-06T11:18:39.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.489+0000 7efcef59e700 1 --2- 172.21.15.146:0/614781274 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7efcd0066f30 0x7efcd00693e0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:39.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.489+0000 7efcef59e700 1 --2- 172.21.15.146:0/614781274 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efcf015e130 0x7efcf016a280 unknown :-1 s=CLOSED pgs=2166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:39.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.489+0000 7efcef59e700 1 --2- 172.21.15.146:0/614781274 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efcf00673e0 0x7efcf0159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:39.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.489+0000 7efcef59e700 1 --2- 172.21.15.146:0/614781274 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efcf015dd60 0x7efcf0159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:39.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.489+0000 7efcef59e700 1 -- 172.21.15.146:0/614781274 >> 172.21.15.146:0/614781274 conn(0x7efcf00cd260 msgr2=0x7efcf00cd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:39.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.489+0000 7efcef59e700 1 -- 172.21.15.146:0/614781274 shutdown_connections 2023-10-06T11:18:39.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.489+0000 7efcef59e700 1 -- 172.21.15.146:0/614781274 wait complete. 2023-10-06T11:18:39.492 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 136 2023-10-06T11:18:39.503 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:18:39.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.616+0000 7f2ee6fb4700 1 Processor -- start 2023-10-06T11:18:39.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.616+0000 7f2ee6fb4700 1 -- start start 2023-10-06T11:18:39.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.617+0000 7f2ee6fb4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2ee01584a0 0x7f2ee0158870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:39.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.617+0000 7f2ee6fb4700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2ee00c8a90 0x7f2ee00c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:39.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.617+0000 7f2ee6fb4700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ee006b760 0x7f2ee006bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:39.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.617+0000 7f2ee6fb4700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ee006c0e0 con 0x7f2ee01584a0 2023-10-06T11:18:39.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.617+0000 7f2ee6fb4700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ee015b440 con 0x7f2ee00c8a90 2023-10-06T11:18:39.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.617+0000 7f2ee6fb4700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee015b720 con 0x7f2ee006b760 2023-10-06T11:18:39.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.617+0000 7f2ee4d50700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2ee01584a0 0x7f2ee0158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:39.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.617+0000 7f2ee4d50700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2ee01584a0 0x7f2ee0158870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41158/0 (socket says 172.21.15.146:41158) 2023-10-06T11:18:39.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.617+0000 7f2ee4d50700 1 -- 172.21.15.146:0/555948112 learned_addr learned my addr 172.21.15.146:0/555948112 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:39.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.618+0000 7f2ee4d50700 1 -- 172.21.15.146:0/555948112 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ee006b760 msgr2=0x7f2ee006bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:39.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.618+0000 7f2ee4d50700 1 --2- 172.21.15.146:0/555948112 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ee006b760 0x7f2ee006bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:39.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.618+0000 7f2ee4d50700 1 -- 172.21.15.146:0/555948112 >> v2:172.21.15.151:3300/0 conn(0x7f2ee00c8a90 msgr2=0x7f2ee00c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:39.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.618+0000 7f2ee4d50700 1 --2- 172.21.15.146:0/555948112 >> v2:172.21.15.151:3300/0 conn(0x7f2ee00c8a90 0x7f2ee00c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:39.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.618+0000 7f2ee4d50700 1 -- 172.21.15.146:0/555948112 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee015ba00 con 0x7f2ee01584a0 2023-10-06T11:18:39.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.618+0000 7f2ee4d50700 1 --2- 172.21.15.146:0/555948112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ee01584a0 0x7f2ee0158870 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7f2ee00b0ca0 tx=0x7f2ed4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64c13a0b8090596b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:39.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.618+0000 7f2edf7fe700 1 -- 172.21.15.146:0/555948112 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed400b860 con 0x7f2ee01584a0 2023-10-06T11:18:39.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.618+0000 7f2edf7fe700 1 -- 172.21.15.146:0/555948112 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed400b9c0 con 0x7f2ee01584a0 2023-10-06T11:18:39.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.618+0000 7f2edf7fe700 1 -- 172.21.15.146:0/555948112 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed400bd60 con 0x7f2ee01584a0 2023-10-06T11:18:39.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.618+0000 7f2ee6fb4700 1 -- 172.21.15.146:0/555948112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ee01584a0 msgr2=0x7f2ee0158870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:39.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.618+0000 7f2ee6fb4700 1 --2- 172.21.15.146:0/555948112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ee01584a0 0x7f2ee0158870 secure :-1 s=READY pgs=2167 cs=0 l=1 rev1=1 crypto rx=0x7f2ee00b0ca0 tx=0x7f2ed4009250 comp rx=0 tx=0).stop 2023-10-06T11:18:39.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.618+0000 7f2ee6fb4700 1 -- 172.21.15.146:0/555948112 shutdown_connections 2023-10-06T11:18:39.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.618+0000 7f2ee6fb4700 1 --2- 172.21.15.146:0/555948112 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ee006b760 0x7f2ee006bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:39.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.618+0000 7f2ee6fb4700 1 --2- 172.21.15.146:0/555948112 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ee01584a0 0x7f2ee0158870 unknown :-1 s=CLOSED pgs=2167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:39.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.618+0000 7f2ee6fb4700 1 --2- 172.21.15.146:0/555948112 >> v2:172.21.15.151:3300/0 conn(0x7f2ee00c8a90 0x7f2ee00c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:39.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.618+0000 7f2ee6fb4700 1 -- 172.21.15.146:0/555948112 >> 172.21.15.146:0/555948112 conn(0x7f2ee0067eb0 msgr2=0x7f2ee00ce450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:39.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.618+0000 7f2ee6fb4700 1 -- 172.21.15.146:0/555948112 shutdown_connections 2023-10-06T11:18:39.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.619+0000 7f2ee6fb4700 1 -- 172.21.15.146:0/555948112 wait complete. 2023-10-06T11:18:39.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.620+0000 7f2ee6fb4700 1 Processor -- start 2023-10-06T11:18:39.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.620+0000 7f2ee6fb4700 1 -- start start 2023-10-06T11:18:39.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.620+0000 7f2ee6fb4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ee006b760 0x7f2ee00c3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:39.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.620+0000 7f2ee6fb4700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ee00c8a90 0x7f2ee0156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:39.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.620+0000 7f2ee6fb4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ee01584a0 0x7f2ee01571f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:39.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.620+0000 7f2ee6fb4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee0140190 con 0x7f2ee01584a0 2023-10-06T11:18:39.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.620+0000 7f2ee6fb4700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee0140750 con 0x7f2ee006b760 2023-10-06T11:18:39.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.620+0000 7f2ee6fb4700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee0151620 con 0x7f2ee00c8a90 2023-10-06T11:18:39.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.621+0000 7f2ee5551700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ee01584a0 0x7f2ee01571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:39.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.621+0000 7f2ee5551700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ee01584a0 0x7f2ee01571f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41168/0 (socket says 172.21.15.146:41168) 2023-10-06T11:18:39.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.621+0000 7f2ee5551700 1 -- 172.21.15.146:0/1579317884 learned_addr learned my addr 172.21.15.146:0/1579317884 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:39.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.621+0000 7f2ee4d50700 1 --2- 172.21.15.146:0/1579317884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ee006b760 0x7f2ee00c3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:39.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.621+0000 7f2ee5551700 1 -- 172.21.15.146:0/1579317884 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ee00c8a90 msgr2=0x7f2ee0156cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:39.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.621+0000 7f2edffff700 1 --2- 172.21.15.146:0/1579317884 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ee00c8a90 0x7f2ee0156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:39.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.621+0000 7f2ee5551700 1 --2- 172.21.15.146:0/1579317884 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ee00c8a90 0x7f2ee0156cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:39.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.621+0000 7f2ee5551700 1 -- 172.21.15.146:0/1579317884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ee006b760 msgr2=0x7f2ee00c3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:39.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.621+0000 7f2ee5551700 1 --2- 172.21.15.146:0/1579317884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ee006b760 0x7f2ee00c3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:39.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.621+0000 7f2ee5551700 1 -- 172.21.15.146:0/1579317884 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed40094f0 con 0x7f2ee01584a0 2023-10-06T11:18:39.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.621+0000 7f2ee4d50700 1 --2- 172.21.15.146:0/1579317884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ee006b760 0x7f2ee00c3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:18:39.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.621+0000 7f2edffff700 1 --2- 172.21.15.146:0/1579317884 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ee00c8a90 0x7f2ee0156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:18:39.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.621+0000 7f2ee5551700 1 --2- 172.21.15.146:0/1579317884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ee01584a0 0x7f2ee01571f0 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 crypto rx=0x7f2ed800bc60 tx=0x7f2ed8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:39.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.621+0000 7f2edcff9700 1 -- 172.21.15.146:0/1579317884 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed80092e0 con 0x7f2ee01584a0 2023-10-06T11:18:39.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.621+0000 7f2edcff9700 1 -- 172.21.15.146:0/1579317884 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ed800c7b0 con 0x7f2ee01584a0 2023-10-06T11:18:39.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.621+0000 7f2ee6fb4700 1 -- 172.21.15.146:0/1579317884 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ee01578c0 con 0x7f2ee01584a0 2023-10-06T11:18:39.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.621+0000 7f2edcff9700 1 -- 172.21.15.146:0/1579317884 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed800cb90 con 0x7f2ee01584a0 2023-10-06T11:18:39.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.621+0000 7f2ee6fb4700 1 -- 172.21.15.146:0/1579317884 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ee01403e0 con 0x7f2ee01584a0 2023-10-06T11:18:39.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.622+0000 7f2ee6fb4700 1 -- 172.21.15.146:0/1579317884 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ee004c380 con 0x7f2ee01584a0 2023-10-06T11:18:39.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.623+0000 7f2edcff9700 1 -- 172.21.15.146:0/1579317884 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2ed8012070 con 0x7f2ee01584a0 2023-10-06T11:18:39.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.623+0000 7f2edcff9700 1 --2- 172.21.15.146:0/1579317884 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2ec4066f30 0x7f2ec40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:39.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.623+0000 7f2edcff9700 1 -- 172.21.15.146:0/1579317884 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f2ed8084350 con 0x7f2ee01584a0 2023-10-06T11:18:39.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.623+0000 7f2ee4d50700 1 --2- 172.21.15.146:0/1579317884 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2ec4066f30 0x7f2ec40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:39.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.623+0000 7f2ee4d50700 1 --2- 172.21.15.146:0/1579317884 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2ec4066f30 0x7f2ec40693e0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f2ee00b0ca0 tx=0x7f2ed4017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:39.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.627+0000 7f2edcff9700 1 -- 172.21.15.146:0/1579317884 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ed8051400 con 0x7f2ee01584a0 2023-10-06T11:18:39.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.896+0000 7f2ee6fb4700 1 -- 172.21.15.146:0/1579317884 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ee015bce0 con 0x7f2ee01584a0 2023-10-06T11:18:39.899 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.897+0000 7f2edcff9700 1 -- 172.21.15.146:0/1579317884 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v165) v1 ==== 74+0+17073 (secure 0 0 0) 0x7f2ed8054a20 con 0x7f2ee01584a0 2023-10-06T11:18:39.899 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:18:39.899 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":165,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:18:33.746877+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:18:22.963878+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2023-10-06T11:18:24.222990+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"163","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"26.8","mappings":[{"from":1,"to":0}]},{"pgid":"26.1a","mappings":[{"from":1,"to":0}]},{"pgid":"26.3a","mappings":[{"from":3,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:18:39.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.899+0000 7f2ee6fb4700 1 -- 172.21.15.146:0/1579317884 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2ec4066f30 msgr2=0x7f2ec40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:39.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.899+0000 7f2ee6fb4700 1 --2- 172.21.15.146:0/1579317884 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2ec4066f30 0x7f2ec40693e0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f2ee00b0ca0 tx=0x7f2ed4017000 comp rx=0 tx=0).stop 2023-10-06T11:18:39.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.899+0000 7f2ee6fb4700 1 -- 172.21.15.146:0/1579317884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ee01584a0 msgr2=0x7f2ee01571f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:39.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.899+0000 7f2ee6fb4700 1 --2- 172.21.15.146:0/1579317884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ee01584a0 0x7f2ee01571f0 secure :-1 s=READY pgs=2168 cs=0 l=1 rev1=1 crypto rx=0x7f2ed800bc60 tx=0x7f2ed8009840 comp rx=0 tx=0).stop 2023-10-06T11:18:39.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.899+0000 7f2ee6fb4700 1 -- 172.21.15.146:0/1579317884 shutdown_connections 2023-10-06T11:18:39.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.899+0000 7f2ee6fb4700 1 --2- 172.21.15.146:0/1579317884 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2ec4066f30 0x7f2ec40693e0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:39.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.899+0000 7f2ee6fb4700 1 --2- 172.21.15.146:0/1579317884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2ee01584a0 0x7f2ee01571f0 unknown :-1 s=CLOSED pgs=2168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:39.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.899+0000 7f2ee6fb4700 1 --2- 172.21.15.146:0/1579317884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ee006b760 0x7f2ee00c3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:39.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.899+0000 7f2ee6fb4700 1 --2- 172.21.15.146:0/1579317884 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2ee00c8a90 0x7f2ee0156cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:39.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.899+0000 7f2ee6fb4700 1 -- 172.21.15.146:0/1579317884 >> 172.21.15.146:0/1579317884 conn(0x7f2ee0067eb0 msgr2=0x7f2ee00c4280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:39.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.900+0000 7f2ee6fb4700 1 -- 172.21.15.146:0/1579317884 shutdown_connections 2023-10-06T11:18:39.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:39.900+0000 7f2ee6fb4700 1 -- 172.21.15.146:0/1579317884 wait complete. 2023-10-06T11:18:39.914 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T11:18:40.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.028+0000 7f1fc5a18700 1 Processor -- start 2023-10-06T11:18:40.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.028+0000 7f1fc5a18700 1 -- start start 2023-10-06T11:18:40.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.028+0000 7f1fc5a18700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1fc00ced20 0x7f1fc0153c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:40.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.028+0000 7f1fc5a18700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fc015d270 con 0x7f1fc01538c0 2023-10-06T11:18:40.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.028+0000 7f1fc5a18700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fc015d830 con 0x7f1fc015a940 2023-10-06T11:18:40.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.028+0000 7f1fc5a18700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fc00cb810 con 0x7f1fc00ced20 2023-10-06T11:18:40.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.028+0000 7f1fbeffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f1fc01538c0 0x7f1fc00cac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52230/0 (socket says 172.21.15.146:52230) 2023-10-06T11:18:40.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.029+0000 7f1fbf7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f1fc00ced20 0x7f1fc0153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:40.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.029+0000 7f1fbeffd700 1 -- 172.21.15.146:0/3913454342 learned_addr learned my addr 172.21.15.146:0/3913454342 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:40.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.029+0000 7f1fbf7fe700 1 -- 172.21.15.146:0/3913454342 >> v1:172.21.15.151:6789/0 conn(0x7f1fc015a940 legacy=0x7f1fc00ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:40.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.029+0000 7f1fbf7fe700 1 -- 172.21.15.146:0/3913454342 >> v1:172.21.15.146:6789/0 conn(0x7f1fc01538c0 legacy=0x7f1fc00cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:40.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.029+0000 7f1fbf7fe700 1 -- 172.21.15.146:0/3913454342 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc00cbaf0 con 0x7f1fc00ced20 2023-10-06T11:18:40.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.029+0000 7f1fbdffb700 1 -- 172.21.15.146:0/3913454342 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 468124721 0 0) 0x7f1fc015d270 con 0x7f1fc01538c0 2023-10-06T11:18:40.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.029+0000 7f1fbf7fe700 1 --2- 172.21.15.146:0/3913454342 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fc00ced20 0x7f1fc0153c90 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7f1fb80098e0 tx=0x7f1fb80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52be369240ea1952 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:40.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.029+0000 7f1fbdffb700 1 -- 172.21.15.146:0/3913454342 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb8009e80 con 0x7f1fc00ced20 2023-10-06T11:18:40.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.029+0000 7f1fbdffb700 1 -- 172.21.15.146:0/3913454342 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb800b860 con 0x7f1fc00ced20 2023-10-06T11:18:40.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.029+0000 7f1fbdffb700 1 -- 172.21.15.146:0/3913454342 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb800bbe0 con 0x7f1fc00ced20 2023-10-06T11:18:40.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.030+0000 7f1fc5a18700 1 -- 172.21.15.146:0/3913454342 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fc00ced20 msgr2=0x7f1fc0153c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:40.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.030+0000 7f1fc5a18700 1 --2- 172.21.15.146:0/3913454342 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fc00ced20 0x7f1fc0153c90 secure :-1 s=READY pgs=2170 cs=0 l=1 rev1=1 crypto rx=0x7f1fb80098e0 tx=0x7f1fb80091a0 comp rx=0 tx=0).stop 2023-10-06T11:18:40.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.030+0000 7f1fc5a18700 1 -- 172.21.15.146:0/3913454342 shutdown_connections 2023-10-06T11:18:40.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.030+0000 7f1fc5a18700 1 --2- 172.21.15.146:0/3913454342 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fc00ced20 0x7f1fc0153c90 unknown :-1 s=CLOSED pgs=2170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:40.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.030+0000 7f1fc5a18700 1 -- 172.21.15.146:0/3913454342 >> 172.21.15.146:0/3913454342 conn(0x7f1fc006eb10 msgr2=0x7f1fc006ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:40.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.030+0000 7f1fc5a18700 1 -- 172.21.15.146:0/3913454342 shutdown_connections 2023-10-06T11:18:40.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.030+0000 7f1fc5a18700 1 -- 172.21.15.146:0/3913454342 wait complete. 2023-10-06T11:18:40.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.031+0000 7f1fc5a18700 1 Processor -- start 2023-10-06T11:18:40.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.031+0000 7f1fc5a18700 1 -- start start 2023-10-06T11:18:40.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.032+0000 7f1fc5a18700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1fc00ced20 0x7f1fc013e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:40.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.032+0000 7f1fc5a18700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fc01538c0 0x7f1fc00b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:40.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.032+0000 7f1fc5a18700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1fc015a940 0x7f1fc00b5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:40.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.032+0000 7f1fc5a18700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc00b58b0 con 0x7f1fc01538c0 2023-10-06T11:18:40.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.032+0000 7f1fc5a18700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc013eee0 con 0x7f1fc00ced20 2023-10-06T11:18:40.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.032+0000 7f1fc5a18700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc00b4f80 con 0x7f1fc015a940 2023-10-06T11:18:40.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.032+0000 7f1fbe7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fc01538c0 0x7f1fc00b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:40.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.032+0000 7f1fbe7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fc01538c0 0x7f1fc00b1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41186/0 (socket says 172.21.15.146:41186) 2023-10-06T11:18:40.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.032+0000 7f1fbe7fc700 1 -- 172.21.15.146:0/2061671205 learned_addr learned my addr 172.21.15.146:0/2061671205 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:40.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.032+0000 7f1fbeffd700 1 --2- 172.21.15.146:0/2061671205 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1fc00ced20 0x7f1fc013e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:40.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.032+0000 7f1fbf7fe700 1 --2- 172.21.15.146:0/2061671205 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1fc015a940 0x7f1fc00b5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:40.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.032+0000 7f1fbe7fc700 1 -- 172.21.15.146:0/2061671205 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1fc015a940 msgr2=0x7f1fc00b5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:40.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.032+0000 7f1fbe7fc700 1 --2- 172.21.15.146:0/2061671205 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1fc015a940 0x7f1fc00b5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:40.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.032+0000 7f1fbe7fc700 1 -- 172.21.15.146:0/2061671205 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1fc00ced20 msgr2=0x7f1fc013e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:40.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.032+0000 7f1fbe7fc700 1 --2- 172.21.15.146:0/2061671205 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1fc00ced20 0x7f1fc013e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:40.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.032+0000 7f1fbe7fc700 1 -- 172.21.15.146:0/2061671205 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb8009420 con 0x7f1fc01538c0 2023-10-06T11:18:40.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.032+0000 7f1fbe7fc700 1 --2- 172.21.15.146:0/2061671205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fc01538c0 0x7f1fc00b1b80 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 crypto rx=0x7f1fb400c590 tx=0x7f1fb400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:40.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.032+0000 7f1fa6ffd700 1 -- 172.21.15.146:0/2061671205 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb4011590 con 0x7f1fc01538c0 2023-10-06T11:18:40.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.032+0000 7f1fa6ffd700 1 -- 172.21.15.146:0/2061671205 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb4011710 con 0x7f1fc01538c0 2023-10-06T11:18:40.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.032+0000 7f1fc5a18700 1 -- 172.21.15.146:0/2061671205 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fc00b5260 con 0x7f1fc01538c0 2023-10-06T11:18:40.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.033+0000 7f1fa6ffd700 1 -- 172.21.15.146:0/2061671205 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb4011ad0 con 0x7f1fc01538c0 2023-10-06T11:18:40.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.033+0000 7f1fc5a18700 1 -- 172.21.15.146:0/2061671205 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fc00b4c30 con 0x7f1fc01538c0 2023-10-06T11:18:40.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.034+0000 7f1fc5a18700 1 -- 172.21.15.146:0/2061671205 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fc004c380 con 0x7f1fc01538c0 2023-10-06T11:18:40.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.034+0000 7f1fa6ffd700 1 -- 172.21.15.146:0/2061671205 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1fb401b3b0 con 0x7f1fc01538c0 2023-10-06T11:18:40.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.034+0000 7f1fa6ffd700 1 --2- 172.21.15.146:0/2061671205 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1fac066f30 0x7f1fac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:40.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.034+0000 7f1fa6ffd700 1 -- 172.21.15.146:0/2061671205 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 6145+0+0 (secure 0 0 0) 0x7f1fb4083b80 con 0x7f1fc01538c0 2023-10-06T11:18:40.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.035+0000 7f1fbeffd700 1 --2- 172.21.15.146:0/2061671205 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1fac066f30 0x7f1fac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:40.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.035+0000 7f1fbeffd700 1 --2- 172.21.15.146:0/2061671205 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1fac066f30 0x7f1fac0693e0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0002230 tx=0x7f1fb0001a00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:40.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.039+0000 7f1fa6ffd700 1 -- 172.21.15.146:0/2061671205 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1fb4050c30 con 0x7f1fc01538c0 2023-10-06T11:18:40.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.263+0000 7f1fc5a18700 1 -- 172.21.15.146:0/2061671205 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1fc00b59f0 con 0x7f1fc01538c0 2023-10-06T11:18:40.266 INFO:tasks.ceph.mon.a.smithi146.stderr:2023-10-06T11:18:40.264+0000 7f011baa1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T11:18:40.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.268+0000 7f1fa6ffd700 1 -- 172.21.15.146:0/2061671205 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v137) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1fb4017070 con 0x7f1fc01538c0 2023-10-06T11:18:40.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.270+0000 7f1fc5a18700 1 -- 172.21.15.146:0/2061671205 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1fac066f30 msgr2=0x7f1fac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:40.272 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.270+0000 7f1fc5a18700 1 --2- 172.21.15.146:0/2061671205 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1fac066f30 0x7f1fac0693e0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0002230 tx=0x7f1fb0001a00 comp rx=0 tx=0).stop 2023-10-06T11:18:40.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.270+0000 7f1fc5a18700 1 -- 172.21.15.146:0/2061671205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fc01538c0 msgr2=0x7f1fc00b1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:40.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.270+0000 7f1fc5a18700 1 --2- 172.21.15.146:0/2061671205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fc01538c0 0x7f1fc00b1b80 secure :-1 s=READY pgs=2171 cs=0 l=1 rev1=1 crypto rx=0x7f1fb400c590 tx=0x7f1fb400c8a0 comp rx=0 tx=0).stop 2023-10-06T11:18:40.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.271+0000 7f1fc5a18700 1 -- 172.21.15.146:0/2061671205 shutdown_connections 2023-10-06T11:18:40.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.271+0000 7f1fc5a18700 1 --2- 172.21.15.146:0/2061671205 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1fac066f30 0x7f1fac0693e0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:40.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.271+0000 7f1fc5a18700 1 --2- 172.21.15.146:0/2061671205 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1fc015a940 0x7f1fc00b5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:40.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.271+0000 7f1fc5a18700 1 --2- 172.21.15.146:0/2061671205 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1fc00ced20 0x7f1fc013e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:40.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.271+0000 7f1fc5a18700 1 --2- 172.21.15.146:0/2061671205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f1fc01538c0 0x7f1fc00b1b80 unknown :-1 s=CLOSED pgs=2171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:40.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.271+0000 7f1fc5a18700 1 -- 172.21.15.146:0/2061671205 >> 172.21.15.146:0/2061671205 conn(0x7f1fc006eb10 msgr2=0x7f1fc00c6480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:40.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.271+0000 7f1fc5a18700 1 -- 172.21.15.146:0/2061671205 shutdown_connections 2023-10-06T11:18:40.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.271+0000 7f1fc5a18700 1 -- 172.21.15.146:0/2061671205 wait complete. 2023-10-06T11:18:40.274 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T11:18:40.285 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T11:18:40.304 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2023-10-06T11:18:40.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.402+0000 7fc3b0b33700 1 Processor -- start 2023-10-06T11:18:40.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.402+0000 7fc3b0b33700 1 -- start start 2023-10-06T11:18:40.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.403+0000 7fc3b0b33700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc3ac0b2000 0x7fc3ac0b2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:40.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.403+0000 7fc3b0b33700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3ac15d2b0 0x7fc3ac15d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:40.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.403+0000 7fc3b0b33700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3ac0cf410 con 0x7fc3ac157030 2023-10-06T11:18:40.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.403+0000 7fc3b0b33700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3ac0ce230 con 0x7fc3ac0b2000 2023-10-06T11:18:40.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.403+0000 7fc3b0b33700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ac0b2990 con 0x7fc3ac15d2b0 2023-10-06T11:18:40.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.403+0000 7fc3a3fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc3ac0b2000 0x7fc3ac0b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:40.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.403+0000 7fc3aa59c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc3ac157030 0x7fc3ac15ad50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52238/0 (socket says 172.21.15.146:52238) 2023-10-06T11:18:40.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.403+0000 7fc3aa59c700 1 -- 172.21.15.146:0/2928805308 learned_addr learned my addr 172.21.15.146:0/2928805308 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:40.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.403+0000 7fc3aad9d700 1 --2- 172.21.15.146:0/2928805308 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3ac15d2b0 0x7fc3ac15d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:40.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.404+0000 7fc3a3fff700 1 -- 172.21.15.146:0/2928805308 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3ac15d2b0 msgr2=0x7fc3ac15d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:40.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.404+0000 7fc3a3fff700 1 --2- 172.21.15.146:0/2928805308 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3ac15d2b0 0x7fc3ac15d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:40.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.404+0000 7fc3a3fff700 1 -- 172.21.15.146:0/2928805308 >> v1:172.21.15.146:6789/0 conn(0x7fc3ac157030 legacy=0x7fc3ac15ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:40.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.404+0000 7fc3a9d9b700 1 -- 172.21.15.146:0/2928805308 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2683153002 0 0) 0x7fc3ac0cf410 con 0x7fc3ac157030 2023-10-06T11:18:40.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.404+0000 7fc3a3fff700 1 -- 172.21.15.146:0/2928805308 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ac15e020 con 0x7fc3ac0b2000 2023-10-06T11:18:40.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.404+0000 7fc3aad9d700 1 --2- 172.21.15.146:0/2928805308 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3ac15d2b0 0x7fc3ac15d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:18:40.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.404+0000 7fc3a3fff700 1 --2- 172.21.15.146:0/2928805308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3ac0b2000 0x7fc3ac0b2450 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x7fc3940098e0 tx=0x7fc3940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=136585150e728c9e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:40.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.404+0000 7fc3a9d9b700 1 -- 172.21.15.146:0/2928805308 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc394009e80 con 0x7fc3ac0b2000 2023-10-06T11:18:40.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.404+0000 7fc3a9d9b700 1 -- 172.21.15.146:0/2928805308 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc39400b860 con 0x7fc3ac0b2000 2023-10-06T11:18:40.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.404+0000 7fc3a9d9b700 1 -- 172.21.15.146:0/2928805308 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39400bbe0 con 0x7fc3ac0b2000 2023-10-06T11:18:40.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.404+0000 7fc3b0b33700 1 -- 172.21.15.146:0/2928805308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3ac0b2000 msgr2=0x7fc3ac0b2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:40.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.404+0000 7fc3b0b33700 1 --2- 172.21.15.146:0/2928805308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3ac0b2000 0x7fc3ac0b2450 secure :-1 s=READY pgs=2176 cs=0 l=1 rev1=1 crypto rx=0x7fc3940098e0 tx=0x7fc3940091a0 comp rx=0 tx=0).stop 2023-10-06T11:18:40.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.404+0000 7fc3b0b33700 1 -- 172.21.15.146:0/2928805308 shutdown_connections 2023-10-06T11:18:40.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.404+0000 7fc3b0b33700 1 --2- 172.21.15.146:0/2928805308 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3ac15d2b0 0x7fc3ac15d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:40.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.404+0000 7fc3b0b33700 1 --2- 172.21.15.146:0/2928805308 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3ac0b2000 0x7fc3ac0b2450 unknown :-1 s=CLOSED pgs=2176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:40.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.404+0000 7fc3b0b33700 1 -- 172.21.15.146:0/2928805308 >> 172.21.15.146:0/2928805308 conn(0x7fc3ac06eb10 msgr2=0x7fc3ac06ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:40.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.404+0000 7fc3b0b33700 1 -- 172.21.15.146:0/2928805308 shutdown_connections 2023-10-06T11:18:40.409 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.405+0000 7fc3b0b33700 1 -- 172.21.15.146:0/2928805308 wait complete. 2023-10-06T11:18:40.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.406+0000 7fc3b0b33700 1 Processor -- start 2023-10-06T11:18:40.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.406+0000 7fc3b0b33700 1 -- start start 2023-10-06T11:18:40.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.406+0000 7fc3b0b33700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3ac0b2000 0x7fc3ac14e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:40.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.406+0000 7fc3b0b33700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3ac157030 0x7fc3ac0b5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:40.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.406+0000 7fc3b0b33700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3ac15d2b0 0x7fc3ac0b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:40.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.406+0000 7fc3b0b33700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ac0b4bd0 con 0x7fc3ac157030 2023-10-06T11:18:40.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.406+0000 7fc3b0b33700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ac0b3fc0 con 0x7fc3ac15d2b0 2023-10-06T11:18:40.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.406+0000 7fc3b0b33700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ac0b42a0 con 0x7fc3ac0b2000 2023-10-06T11:18:40.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.406+0000 7fc3a3fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3ac157030 0x7fc3ac0b5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:40.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.406+0000 7fc3a3fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3ac157030 0x7fc3ac0b5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41234/0 (socket says 172.21.15.146:41234) 2023-10-06T11:18:40.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.406+0000 7fc3a3fff700 1 -- 172.21.15.146:0/4051556221 learned_addr learned my addr 172.21.15.146:0/4051556221 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:40.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.407+0000 7fc3aa59c700 1 --2- 172.21.15.146:0/4051556221 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3ac0b2000 0x7fc3ac14e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:40.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.407+0000 7fc3aad9d700 1 --2- 172.21.15.146:0/4051556221 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3ac15d2b0 0x7fc3ac0b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:40.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.407+0000 7fc3a3fff700 1 -- 172.21.15.146:0/4051556221 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3ac0b2000 msgr2=0x7fc3ac14e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:40.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.407+0000 7fc3a3fff700 1 --2- 172.21.15.146:0/4051556221 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3ac0b2000 0x7fc3ac14e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:40.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.407+0000 7fc3a3fff700 1 -- 172.21.15.146:0/4051556221 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3ac15d2b0 msgr2=0x7fc3ac0b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:40.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.407+0000 7fc3a3fff700 1 --2- 172.21.15.146:0/4051556221 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3ac15d2b0 0x7fc3ac0b5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:40.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.407+0000 7fc3a3fff700 1 -- 172.21.15.146:0/4051556221 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc394009420 con 0x7fc3ac157030 2023-10-06T11:18:40.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.407+0000 7fc3a3fff700 1 --2- 172.21.15.146:0/4051556221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3ac157030 0x7fc3ac0b5870 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac089280 tx=0x7fc394017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:40.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.407+0000 7fc3a27fc700 1 -- 172.21.15.146:0/4051556221 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39400bbe0 con 0x7fc3ac157030 2023-10-06T11:18:40.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.407+0000 7fc3a27fc700 1 -- 172.21.15.146:0/4051556221 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc394011420 con 0x7fc3ac157030 2023-10-06T11:18:40.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.407+0000 7fc3b0b33700 1 -- 172.21.15.146:0/4051556221 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3ac0b4580 con 0x7fc3ac157030 2023-10-06T11:18:40.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.407+0000 7fc3a27fc700 1 -- 172.21.15.146:0/4051556221 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3940117a0 con 0x7fc3ac157030 2023-10-06T11:18:40.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.407+0000 7fc3b0b33700 1 -- 172.21.15.146:0/4051556221 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3ac15a7d0 con 0x7fc3ac157030 2023-10-06T11:18:40.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.408+0000 7fc3b0b33700 1 -- 172.21.15.146:0/4051556221 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3ac04c380 con 0x7fc3ac157030 2023-10-06T11:18:40.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.408+0000 7fc3a27fc700 1 -- 172.21.15.146:0/4051556221 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc394011bd0 con 0x7fc3ac157030 2023-10-06T11:18:40.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.409+0000 7fc3a27fc700 1 --2- 172.21.15.146:0/4051556221 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc38c066f30 0x7fc38c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:40.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.409+0000 7fc3a27fc700 1 -- 172.21.15.146:0/4051556221 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6231+0+0 (secure 0 0 0) 0x7fc394085c60 con 0x7fc3ac157030 2023-10-06T11:18:40.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.409+0000 7fc3aa59c700 1 --2- 172.21.15.146:0/4051556221 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc38c066f30 0x7fc38c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:40.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.409+0000 7fc3aa59c700 1 --2- 172.21.15.146:0/4051556221 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc38c066f30 0x7fc38c0693e0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac15b430 tx=0x7fc39c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:40.414 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.413+0000 7fc3a27fc700 1 -- 172.21.15.146:0/4051556221 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc394052d70 con 0x7fc3ac157030 2023-10-06T11:18:40.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:40.644+0000 7fc3b0b33700 1 -- 172.21.15.146:0/4051556221 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc3ac0cedc0 con 0x7fc3ac157030 2023-10-06T11:18:41.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.268+0000 7fc3a27fc700 1 -- 172.21.15.146:0/4051556221 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v138) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc394056390 con 0x7fc3ac157030 2023-10-06T11:18:41.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.271+0000 7fc3b0b33700 1 -- 172.21.15.146:0/4051556221 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc38c066f30 msgr2=0x7fc38c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:41.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.271+0000 7fc3b0b33700 1 --2- 172.21.15.146:0/4051556221 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc38c066f30 0x7fc38c0693e0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac15b430 tx=0x7fc39c009040 comp rx=0 tx=0).stop 2023-10-06T11:18:41.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.271+0000 7fc3b0b33700 1 -- 172.21.15.146:0/4051556221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3ac157030 msgr2=0x7fc3ac0b5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:41.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.271+0000 7fc3b0b33700 1 --2- 172.21.15.146:0/4051556221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3ac157030 0x7fc3ac0b5870 secure :-1 s=READY pgs=2177 cs=0 l=1 rev1=1 crypto rx=0x7fc3ac089280 tx=0x7fc394017000 comp rx=0 tx=0).stop 2023-10-06T11:18:41.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.271+0000 7fc3b0b33700 1 -- 172.21.15.146:0/4051556221 shutdown_connections 2023-10-06T11:18:41.273 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.271+0000 7fc3b0b33700 1 --2- 172.21.15.146:0/4051556221 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc38c066f30 0x7fc38c0693e0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:41.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.271+0000 7fc3b0b33700 1 --2- 172.21.15.146:0/4051556221 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc3ac15d2b0 0x7fc3ac0b5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:41.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.271+0000 7fc3b0b33700 1 --2- 172.21.15.146:0/4051556221 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc3ac0b2000 0x7fc3ac14e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:41.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.271+0000 7fc3b0b33700 1 --2- 172.21.15.146:0/4051556221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc3ac157030 0x7fc3ac0b5870 unknown :-1 s=CLOSED pgs=2177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:41.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.271+0000 7fc3b0b33700 1 -- 172.21.15.146:0/4051556221 >> 172.21.15.146:0/4051556221 conn(0x7fc3ac06eb10 msgr2=0x7fc3ac150720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:41.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.271+0000 7fc3b0b33700 1 -- 172.21.15.146:0/4051556221 shutdown_connections 2023-10-06T11:18:41.274 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.271+0000 7fc3b0b33700 1 -- 172.21.15.146:0/4051556221 wait complete. 2023-10-06T11:18:41.286 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T11:18:41.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.446+0000 7f9e0fe47700 1 Processor -- start 2023-10-06T11:18:41.448 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.446+0000 7f9e0fe47700 1 -- start start 2023-10-06T11:18:41.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.447+0000 7f9e0fe47700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9e08142ea0 0x7f9e080cc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:41.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.447+0000 7f9e0fe47700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9e080c9d20 0x7f9e0806bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:41.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.447+0000 7f9e0fe47700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e0806c0d0 con 0x7f9e0806b740 2023-10-06T11:18:41.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.447+0000 7f9e0fe47700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e0815e2b0 con 0x7f9e080c9d20 2023-10-06T11:18:41.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.447+0000 7f9e0fe47700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e0815d3c0 con 0x7f9e08142ea0 2023-10-06T11:18:41.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.448+0000 7f9e0e3e4700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9e080c9d20 0x7f9e0806bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:41.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.448+0000 7f9e0d3e2700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f9e0806b740 0x7f9e0806cc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40180/0 (socket says 172.21.15.146:40180) 2023-10-06T11:18:41.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.448+0000 7f9e0d3e2700 1 -- 172.21.15.146:0/3091069575 learned_addr learned my addr 172.21.15.146:0/3091069575 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:41.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.448+0000 7f9e0dbe3700 1 --2- 172.21.15.146:0/3091069575 >> v2:172.21.15.151:3300/0 conn(0x7f9e08142ea0 0x7f9e080cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:41.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.448+0000 7f9e0cbe1700 1 -- 172.21.15.146:0/3091069575 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3232584836 0 0) 0x7f9e0806c0d0 con 0x7f9e0806b740 2023-10-06T11:18:41.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.448+0000 7f9e0cbe1700 1 -- 172.21.15.146:0/3091069575 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9df4003570 con 0x7f9e0806b740 2023-10-06T11:18:41.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.448+0000 7f9e0e3e4700 1 -- 172.21.15.146:0/3091069575 >> v2:172.21.15.151:3300/0 conn(0x7f9e08142ea0 msgr2=0x7f9e080cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:41.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.448+0000 7f9e0e3e4700 1 --2- 172.21.15.146:0/3091069575 >> v2:172.21.15.151:3300/0 conn(0x7f9e08142ea0 0x7f9e080cc630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:41.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.448+0000 7f9e0e3e4700 1 -- 172.21.15.146:0/3091069575 >> v1:172.21.15.146:6789/0 conn(0x7f9e0806b740 legacy=0x7f9e0806cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:41.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.448+0000 7f9e0e3e4700 1 -- 172.21.15.146:0/3091069575 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e0815d6a0 con 0x7f9e080c9d20 2023-10-06T11:18:41.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.448+0000 7f9e0e3e4700 1 --2- 172.21.15.146:0/3091069575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e080c9d20 0x7f9e0806bb90 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 crypto rx=0x7f9e0806f2c0 tx=0x7f9e00009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c94b92d9dc0d2bd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:41.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.449+0000 7f9e0cbe1700 1 -- 172.21.15.146:0/3091069575 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0000e070 con 0x7f9e080c9d20 2023-10-06T11:18:41.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.449+0000 7f9e0cbe1700 1 -- 172.21.15.146:0/3091069575 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e0000bab0 con 0x7f9e080c9d20 2023-10-06T11:18:41.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.449+0000 7f9e0cbe1700 1 -- 172.21.15.146:0/3091069575 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0000be70 con 0x7f9e080c9d20 2023-10-06T11:18:41.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.449+0000 7f9e0fe47700 1 -- 172.21.15.146:0/3091069575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e080c9d20 msgr2=0x7f9e0806bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:41.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.449+0000 7f9e0fe47700 1 --2- 172.21.15.146:0/3091069575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e080c9d20 0x7f9e0806bb90 secure :-1 s=READY pgs=2179 cs=0 l=1 rev1=1 crypto rx=0x7f9e0806f2c0 tx=0x7f9e00009780 comp rx=0 tx=0).stop 2023-10-06T11:18:41.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.449+0000 7f9e0fe47700 1 -- 172.21.15.146:0/3091069575 shutdown_connections 2023-10-06T11:18:41.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.449+0000 7f9e0fe47700 1 --2- 172.21.15.146:0/3091069575 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e080c9d20 0x7f9e0806bb90 unknown :-1 s=CLOSED pgs=2179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:41.454 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.449+0000 7f9e0fe47700 1 --2- 172.21.15.146:0/3091069575 >> v2:172.21.15.151:3300/0 conn(0x7f9e08142ea0 0x7f9e080cc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:41.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.449+0000 7f9e0fe47700 1 -- 172.21.15.146:0/3091069575 >> 172.21.15.146:0/3091069575 conn(0x7f9e080ce430 msgr2=0x7f9e080ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:41.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.449+0000 7f9e0fe47700 1 -- 172.21.15.146:0/3091069575 shutdown_connections 2023-10-06T11:18:41.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.450+0000 7f9e0fe47700 1 -- 172.21.15.146:0/3091069575 wait complete. 2023-10-06T11:18:41.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.451+0000 7f9e0fe47700 1 Processor -- start 2023-10-06T11:18:41.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.451+0000 7f9e0fe47700 1 -- start start 2023-10-06T11:18:41.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.451+0000 7f9e0fe47700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e0806b740 0x7f9e08140f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:41.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.451+0000 7f9e0fe47700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e080c9d20 0x7f9e080b1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:41.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.452+0000 7f9e0fe47700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e08142ea0 0x7f9e0816ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:41.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.452+0000 7f9e0fe47700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e08158e40 con 0x7f9e08142ea0 2023-10-06T11:18:41.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.452+0000 7f9e0fe47700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e080b1820 con 0x7f9e080c9d20 2023-10-06T11:18:41.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.452+0000 7f9e0fe47700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e0816d970 con 0x7f9e0806b740 2023-10-06T11:18:41.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.452+0000 7f9e0e3e4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e08142ea0 0x7f9e0816ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:41.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.452+0000 7f9e0e3e4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e08142ea0 0x7f9e0816ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48118/0 (socket says 172.21.15.146:48118) 2023-10-06T11:18:41.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.452+0000 7f9e0e3e4700 1 -- 172.21.15.146:0/2267793281 learned_addr learned my addr 172.21.15.146:0/2267793281 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:41.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.452+0000 7f9e0d3e2700 1 --2- 172.21.15.146:0/2267793281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e080c9d20 0x7f9e080b1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:41.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.452+0000 7f9e0dbe3700 1 --2- 172.21.15.146:0/2267793281 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e0806b740 0x7f9e08140f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:41.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.452+0000 7f9e0e3e4700 1 -- 172.21.15.146:0/2267793281 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e0806b740 msgr2=0x7f9e08140f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:41.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.452+0000 7f9e0e3e4700 1 --2- 172.21.15.146:0/2267793281 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e0806b740 0x7f9e08140f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:41.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.452+0000 7f9e0e3e4700 1 -- 172.21.15.146:0/2267793281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e080c9d20 msgr2=0x7f9e080b1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:41.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.452+0000 7f9e0e3e4700 1 --2- 172.21.15.146:0/2267793281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e080c9d20 0x7f9e080b1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:41.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.452+0000 7f9e0e3e4700 1 -- 172.21.15.146:0/2267793281 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e00009a20 con 0x7f9e08142ea0 2023-10-06T11:18:41.456 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.452+0000 7f9e0e3e4700 1 --2- 172.21.15.146:0/2267793281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e08142ea0 0x7f9e0816ce00 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x7f9e0806f180 tx=0x7f9e00019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:41.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.454+0000 7f9dfdffb700 1 -- 172.21.15.146:0/2267793281 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e00012dd0 con 0x7f9e08142ea0 2023-10-06T11:18:41.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.454+0000 7f9e0fe47700 1 -- 172.21.15.146:0/2267793281 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e0816dc50 con 0x7f9e08142ea0 2023-10-06T11:18:41.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.455+0000 7f9e0fe47700 1 -- 172.21.15.146:0/2267793281 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e080b14b0 con 0x7f9e08142ea0 2023-10-06T11:18:41.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.455+0000 7f9dfdffb700 1 -- 172.21.15.146:0/2267793281 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e00027680 con 0x7f9e08142ea0 2023-10-06T11:18:41.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.455+0000 7f9dfdffb700 1 -- 172.21.15.146:0/2267793281 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e000277f0 con 0x7f9e08142ea0 2023-10-06T11:18:41.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.456+0000 7f9e0fe47700 1 -- 172.21.15.146:0/2267793281 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e0804c380 con 0x7f9e08142ea0 2023-10-06T11:18:41.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.456+0000 7f9dfdffb700 1 -- 172.21.15.146:0/2267793281 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9e00024070 con 0x7f9e08142ea0 2023-10-06T11:18:41.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.456+0000 7f9dfdffb700 1 --2- 172.21.15.146:0/2267793281 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9dec066f30 0x7f9dec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:41.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.456+0000 7f9dfdffb700 1 -- 172.21.15.146:0/2267793281 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 6231+0+0 (secure 0 0 0) 0x7f9e00086dc0 con 0x7f9e08142ea0 2023-10-06T11:18:41.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.456+0000 7f9e0dbe3700 1 --2- 172.21.15.146:0/2267793281 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9dec066f30 0x7f9dec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:41.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.457+0000 7f9e0dbe3700 1 --2- 172.21.15.146:0/2267793281 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9dec066f30 0x7f9dec0693e0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f9df8009d10 tx=0x7f9df80091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:41.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.461+0000 7f9dfdffb700 1 -- 172.21.15.146:0/2267793281 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9e00053e20 con 0x7f9e08142ea0 2023-10-06T11:18:41.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:41.645+0000 7f9e0fe47700 1 -- 172.21.15.146:0/2267793281 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9e0815d980 con 0x7f9e08142ea0 2023-10-06T11:18:42.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.460+0000 7f9dfdffb700 1 -- 172.21.15.146:0/2267793281 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v167) v1 ==== 181+0+0 (secure 0 0 0) 0x7f9e00057440 con 0x7f9e08142ea0 2023-10-06T11:18:42.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.464+0000 7f9e0fe47700 1 -- 172.21.15.146:0/2267793281 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9dec066f30 msgr2=0x7f9dec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:42.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.464+0000 7f9e0fe47700 1 --2- 172.21.15.146:0/2267793281 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9dec066f30 0x7f9dec0693e0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f9df8009d10 tx=0x7f9df80091a0 comp rx=0 tx=0).stop 2023-10-06T11:18:42.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.464+0000 7f9e0fe47700 1 -- 172.21.15.146:0/2267793281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e08142ea0 msgr2=0x7f9e0816ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:42.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.464+0000 7f9e0fe47700 1 --2- 172.21.15.146:0/2267793281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e08142ea0 0x7f9e0816ce00 secure :-1 s=READY pgs=2180 cs=0 l=1 rev1=1 crypto rx=0x7f9e0806f180 tx=0x7f9e00019000 comp rx=0 tx=0).stop 2023-10-06T11:18:42.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.464+0000 7f9e0fe47700 1 -- 172.21.15.146:0/2267793281 shutdown_connections 2023-10-06T11:18:42.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.464+0000 7f9e0fe47700 1 --2- 172.21.15.146:0/2267793281 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9dec066f30 0x7f9dec0693e0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:42.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.464+0000 7f9e0fe47700 1 --2- 172.21.15.146:0/2267793281 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9e08142ea0 0x7f9e0816ce00 unknown :-1 s=CLOSED pgs=2180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:42.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.464+0000 7f9e0fe47700 1 --2- 172.21.15.146:0/2267793281 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9e0806b740 0x7f9e08140f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:42.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.464+0000 7f9e0fe47700 1 --2- 172.21.15.146:0/2267793281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e080c9d20 0x7f9e080b1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:42.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.464+0000 7f9e0fe47700 1 -- 172.21.15.146:0/2267793281 >> 172.21.15.146:0/2267793281 conn(0x7f9e080ce430 msgr2=0x7f9e0806d920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:42.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.464+0000 7f9e0fe47700 1 -- 172.21.15.146:0/2267793281 shutdown_connections 2023-10-06T11:18:42.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.464+0000 7f9e0fe47700 1 -- 172.21.15.146:0/2267793281 wait complete. 2023-10-06T11:18:42.469 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' removed 2023-10-06T11:18:42.481 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T11:18:42.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.603+0000 7f203f374700 1 Processor -- start 2023-10-06T11:18:42.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.603+0000 7f203f374700 1 -- start start 2023-10-06T11:18:42.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.604+0000 7f203f374700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f203815d520 0x7f20380d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:42.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.604+0000 7f203f374700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20380d0770 con 0x7f20381590d0 2023-10-06T11:18:42.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.604+0000 7f203f374700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20380cfb60 con 0x7f203815d8f0 2023-10-06T11:18:42.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.604+0000 7f203f374700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20380cfe40 con 0x7f203815d520 2023-10-06T11:18:42.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.604+0000 7f203d911700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f20381590d0 0x7f2038159530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40184/0 (socket says 172.21.15.146:40184) 2023-10-06T11:18:42.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.604+0000 7f203d911700 1 -- 172.21.15.146:0/2638093658 learned_addr learned my addr 172.21.15.146:0/2638093658 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:42.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.604+0000 7f202ffff700 1 -- 172.21.15.146:0/2638093658 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 497079279 0 0) 0x7f20380d0770 con 0x7f20381590d0 2023-10-06T11:18:42.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.604+0000 7f202ffff700 1 -- 172.21.15.146:0/2638093658 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2024003570 con 0x7f20381590d0 2023-10-06T11:18:42.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.604+0000 7f203d110700 1 --2- 172.21.15.146:0/2638093658 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f203815d520 0x7f20380d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:42.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.605+0000 7f202ffff700 1 -- 172.21.15.146:0/2638093658 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3413665019 0 0) 0x7f2024003570 con 0x7f20381590d0 2023-10-06T11:18:42.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.605+0000 7f202ffff700 1 -- 172.21.15.146:0/2638093658 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f203815d520 msgr2=0x7f20380d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:42.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.605+0000 7f202ffff700 1 --2- 172.21.15.146:0/2638093658 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f203815d520 0x7f20380d0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:42.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.605+0000 7f202ffff700 1 -- 172.21.15.146:0/2638093658 >> v1:172.21.15.151:6789/0 conn(0x7f203815d8f0 legacy=0x7f20380cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:42.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.605+0000 7f202ffff700 1 -- 172.21.15.146:0/2638093658 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20380d0120 con 0x7f20381590d0 2023-10-06T11:18:42.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.605+0000 7f202ffff700 1 -- 172.21.15.146:0/2638093658 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f2030001470 con 0x7f20381590d0 2023-10-06T11:18:42.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.605+0000 7f202ffff700 1 -- 172.21.15.146:0/2638093658 >> v1:172.21.15.146:6789/0 conn(0x7f20381590d0 legacy=0x7f2038159530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:42.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.605+0000 7f202ffff700 1 --2- 172.21.15.146:0/2638093658 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2024003a90 0x7f2024003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:42.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.605+0000 7f202ffff700 1 --2- 172.21.15.146:0/2638093658 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f203815d520 0x7f2024004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:42.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.605+0000 7f202ffff700 1 --2- 172.21.15.146:0/2638093658 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2024004d50 0x7f20240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:42.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.605+0000 7f202ffff700 1 -- 172.21.15.146:0/2638093658 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20380cfe40 con 0x7f2024003a90 2023-10-06T11:18:42.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.605+0000 7f202ffff700 1 -- 172.21.15.146:0/2638093658 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202400bb70 con 0x7f2024004d50 2023-10-06T11:18:42.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.605+0000 7f202ffff700 1 -- 172.21.15.146:0/2638093658 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f202400bd30 con 0x7f203815d520 2023-10-06T11:18:42.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.605+0000 7f203d110700 1 --2- 172.21.15.146:0/2638093658 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2024003a90 0x7f2024003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:42.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.605+0000 7f203c90f700 1 --2- 172.21.15.146:0/2638093658 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f203815d520 0x7f2024004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:42.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.605+0000 7f203d911700 1 --2- 172.21.15.146:0/2638093658 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2024004d50 0x7f20240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:42.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.605+0000 7f203d110700 1 -- 172.21.15.146:0/2638093658 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f203815d520 msgr2=0x7f2024004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:42.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.605+0000 7f203d110700 1 --2- 172.21.15.146:0/2638093658 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f203815d520 0x7f2024004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:42.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.605+0000 7f203d110700 1 -- 172.21.15.146:0/2638093658 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2024004d50 msgr2=0x7f20240051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:42.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.605+0000 7f203d110700 1 --2- 172.21.15.146:0/2638093658 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2024004d50 0x7f20240051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:42.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.605+0000 7f203d110700 1 -- 172.21.15.146:0/2638093658 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2024003570 con 0x7f2024003a90 2023-10-06T11:18:42.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.605+0000 7f203d911700 1 --2- 172.21.15.146:0/2638093658 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2024004d50 0x7f20240051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:18:42.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.605+0000 7f203d110700 1 --2- 172.21.15.146:0/2638093658 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2024003a90 0x7f2024003ea0 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7f203400e210 tx=0x7f203400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d0be9b21e0854f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:42.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.605+0000 7f202ffff700 1 -- 172.21.15.146:0/2638093658 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203400eac0 con 0x7f2024003a90 2023-10-06T11:18:42.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.605+0000 7f202ffff700 1 -- 172.21.15.146:0/2638093658 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203400f040 con 0x7f2024003a90 2023-10-06T11:18:42.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.605+0000 7f202ffff700 1 -- 172.21.15.146:0/2638093658 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203400ee70 con 0x7f2024003a90 2023-10-06T11:18:42.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.606+0000 7f203f374700 1 -- 172.21.15.146:0/2638093658 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2024003a90 msgr2=0x7f2024003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:42.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.606+0000 7f203f374700 1 --2- 172.21.15.146:0/2638093658 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2024003a90 0x7f2024003ea0 secure :-1 s=READY pgs=2182 cs=0 l=1 rev1=1 crypto rx=0x7f203400e210 tx=0x7f203400b040 comp rx=0 tx=0).stop 2023-10-06T11:18:42.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.606+0000 7f203d911700 1 -- 172.21.15.146:0/2638093658 reap_dead start 2023-10-06T11:18:42.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.606+0000 7f203f374700 1 -- 172.21.15.146:0/2638093658 shutdown_connections 2023-10-06T11:18:42.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.606+0000 7f203f374700 1 -- 172.21.15.146:0/2638093658 >> 172.21.15.146:0/2638093658 conn(0x7f203806eb10 msgr2=0x7f203806ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:42.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.606+0000 7f203f374700 1 -- 172.21.15.146:0/2638093658 shutdown_connections 2023-10-06T11:18:42.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.606+0000 7f203f374700 1 -- 172.21.15.146:0/2638093658 wait complete. 2023-10-06T11:18:42.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.607+0000 7f203f374700 1 Processor -- start 2023-10-06T11:18:42.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.607+0000 7f203f374700 1 -- start start 2023-10-06T11:18:42.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.608+0000 7f203f374700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2024003a90 0x7f20380b1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:42.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.608+0000 7f203f374700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f203816d530 0x7f20381551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:42.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.608+0000 7f203f374700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f203816a640 0x7f203816aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:42.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.608+0000 7f203f374700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203816a220 con 0x7f203816a640 2023-10-06T11:18:42.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.608+0000 7f203f374700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20380c9f10 con 0x7f203816d530 2023-10-06T11:18:42.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.608+0000 7f203f374700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f203816dcd0 con 0x7f2024003a90 2023-10-06T11:18:42.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.608+0000 7f203d911700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f203816a640 0x7f203816aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:42.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.608+0000 7f203d911700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f203816a640 0x7f203816aac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48124/0 (socket says 172.21.15.146:48124) 2023-10-06T11:18:42.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.608+0000 7f203d911700 1 -- 172.21.15.146:0/787052619 learned_addr learned my addr 172.21.15.146:0/787052619 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:42.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.608+0000 7f203d110700 1 --2- 172.21.15.146:0/787052619 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2024003a90 0x7f20380b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:42.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.608+0000 7f203c90f700 1 --2- 172.21.15.146:0/787052619 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f203816d530 0x7f20381551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:42.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.608+0000 7f203d911700 1 -- 172.21.15.146:0/787052619 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2024003a90 msgr2=0x7f20380b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:42.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.608+0000 7f203d911700 1 --2- 172.21.15.146:0/787052619 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2024003a90 0x7f20380b1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:42.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.608+0000 7f203d911700 1 -- 172.21.15.146:0/787052619 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f203816d530 msgr2=0x7f20381551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:42.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.608+0000 7f203d911700 1 --2- 172.21.15.146:0/787052619 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f203816d530 0x7f20381551a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:42.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.608+0000 7f203d911700 1 -- 172.21.15.146:0/787052619 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f203816dfb0 con 0x7f203816a640 2023-10-06T11:18:42.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.608+0000 7f203c90f700 1 --2- 172.21.15.146:0/787052619 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f203816d530 0x7f20381551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:18:42.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.609+0000 7f203d911700 1 --2- 172.21.15.146:0/787052619 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f203816a640 0x7f203816aac0 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 crypto rx=0x7f2030000fd0 tx=0x7f2030001de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:42.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.609+0000 7f202d7fa700 1 -- 172.21.15.146:0/787052619 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2030012590 con 0x7f203816a640 2023-10-06T11:18:42.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.609+0000 7f202d7fa700 1 -- 172.21.15.146:0/787052619 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20300126f0 con 0x7f203816a640 2023-10-06T11:18:42.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.609+0000 7f202d7fa700 1 -- 172.21.15.146:0/787052619 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2030012a90 con 0x7f203816a640 2023-10-06T11:18:42.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.609+0000 7f203f374700 1 -- 172.21.15.146:0/787052619 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f203816e290 con 0x7f203816a640 2023-10-06T11:18:42.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.609+0000 7f203f374700 1 -- 172.21.15.146:0/787052619 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20381556e0 con 0x7f203816a640 2023-10-06T11:18:42.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.610+0000 7f203f374700 1 -- 172.21.15.146:0/787052619 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f203816a360 con 0x7f203816a640 2023-10-06T11:18:42.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.610+0000 7f202d7fa700 1 -- 172.21.15.146:0/787052619 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f203001d460 con 0x7f203816a640 2023-10-06T11:18:42.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.610+0000 7f202d7fa700 1 --2- 172.21.15.146:0/787052619 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f201c066f60 0x7f201c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:42.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.611+0000 7f202d7fa700 1 -- 172.21.15.146:0/787052619 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5793+0+0 (secure 0 0 0) 0x7f2030084400 con 0x7f203816a640 2023-10-06T11:18:42.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.611+0000 7f203d110700 1 --2- 172.21.15.146:0/787052619 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f201c066f60 0x7f201c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:42.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.611+0000 7f203d110700 1 --2- 172.21.15.146:0/787052619 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f201c066f60 0x7f201c069410 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f203400afd0 tx=0x7f203401a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:42.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.615+0000 7f202d7fa700 1 -- 172.21.15.146:0/787052619 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f203816a360 con 0x7f203816a640 2023-10-06T11:18:42.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:42.798+0000 7f203f374700 1 -- 172.21.15.146:0/787052619 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f203816a360 con 0x7f203816a640 2023-10-06T11:18:43.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.464+0000 7f202d7fa700 1 -- 172.21.15.146:0/787052619 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v168) v1 ==== 169+0+0 (secure 0 0 0) 0x7f203816a360 con 0x7f203816a640 2023-10-06T11:18:43.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.467+0000 7f203f374700 1 -- 172.21.15.146:0/787052619 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f201c066f60 msgr2=0x7f201c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:43.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.467+0000 7f203f374700 1 --2- 172.21.15.146:0/787052619 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f201c066f60 0x7f201c069410 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f203400afd0 tx=0x7f203401a000 comp rx=0 tx=0).stop 2023-10-06T11:18:43.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.467+0000 7f203f374700 1 -- 172.21.15.146:0/787052619 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f203816a640 msgr2=0x7f203816aac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:43.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.467+0000 7f203f374700 1 --2- 172.21.15.146:0/787052619 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f203816a640 0x7f203816aac0 secure :-1 s=READY pgs=2183 cs=0 l=1 rev1=1 crypto rx=0x7f2030000fd0 tx=0x7f2030001de0 comp rx=0 tx=0).stop 2023-10-06T11:18:43.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.468+0000 7f203f374700 1 -- 172.21.15.146:0/787052619 shutdown_connections 2023-10-06T11:18:43.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.468+0000 7f203f374700 1 --2- 172.21.15.146:0/787052619 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f201c066f60 0x7f201c069410 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:43.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.468+0000 7f203f374700 1 --2- 172.21.15.146:0/787052619 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f203816a640 0x7f203816aac0 unknown :-1 s=CLOSED pgs=2183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:43.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.468+0000 7f203f374700 1 --2- 172.21.15.146:0/787052619 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2024003a90 0x7f20380b1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:43.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.468+0000 7f203f374700 1 --2- 172.21.15.146:0/787052619 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f203816d530 0x7f20381551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:43.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.468+0000 7f203f374700 1 -- 172.21.15.146:0/787052619 >> 172.21.15.146:0/787052619 conn(0x7f203806eb10 msgr2=0x7f20380cb7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:43.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.468+0000 7f203f374700 1 -- 172.21.15.146:0/787052619 shutdown_connections 2023-10-06T11:18:43.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.469+0000 7f203f374700 1 -- 172.21.15.146:0/787052619 wait complete. 2023-10-06T11:18:43.472 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' removed 2023-10-06T11:18:43.486 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T11:18:43.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.601+0000 7f8ff2434700 1 Processor -- start 2023-10-06T11:18:43.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.601+0000 7f8ff2434700 1 -- start start 2023-10-06T11:18:43.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.602+0000 7f8ff2434700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8fec159450 0x7f8fec159820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:43.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.602+0000 7f8ff2434700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8fec0b0930 0x7f8fec0aef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:43.606 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.602+0000 7f8ff2434700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fec0cb8a0 con 0x7f8fec15dd70 2023-10-06T11:18:43.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.602+0000 7f8ff2434700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fec0b2f20 con 0x7f8fec0b0930 2023-10-06T11:18:43.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.602+0000 7f8ff2434700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec0b2960 con 0x7f8fec159450 2023-10-06T11:18:43.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.602+0000 7f8ff09d1700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8fec0b0930 0x7f8fec0aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:43.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.602+0000 7f8ff09d1700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8fec0b0930 0x7f8fec0aef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48140/0 (socket says 172.21.15.146:48140) 2023-10-06T11:18:43.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.602+0000 7f8ff09d1700 1 -- 172.21.15.146:0/1135150162 learned_addr learned my addr 172.21.15.146:0/1135150162 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:43.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.602+0000 7f8febfff700 1 --2- 172.21.15.146:0/1135150162 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8fec159450 0x7f8fec159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:43.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.602+0000 7f8ff09d1700 1 -- 172.21.15.146:0/1135150162 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8fec159450 msgr2=0x7f8fec159820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:43.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.602+0000 7f8ff09d1700 1 --2- 172.21.15.146:0/1135150162 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8fec159450 0x7f8fec159820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:43.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.602+0000 7f8ff09d1700 1 -- 172.21.15.146:0/1135150162 >> v1:172.21.15.151:6789/0 conn(0x7f8fec15dd70 legacy=0x7f8fec0b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:43.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.602+0000 7f8ff09d1700 1 -- 172.21.15.146:0/1135150162 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fec0b2c40 con 0x7f8fec0b0930 2023-10-06T11:18:43.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.602+0000 7f8ff09d1700 1 --2- 172.21.15.146:0/1135150162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fec0b0930 0x7f8fec0aef90 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4009f20 tx=0x7f8fe4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a08d43adb27a0a87 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:43.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.602+0000 7f8feaffd700 1 -- 172.21.15.146:0/1135150162 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe400e070 con 0x7f8fec0b0930 2023-10-06T11:18:43.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.602+0000 7f8feaffd700 1 -- 172.21.15.146:0/1135150162 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fe400ba80 con 0x7f8fec0b0930 2023-10-06T11:18:43.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.602+0000 7f8feaffd700 1 -- 172.21.15.146:0/1135150162 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fe40092e0 con 0x7f8fec0b0930 2023-10-06T11:18:43.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.603+0000 7f8ff2434700 1 -- 172.21.15.146:0/1135150162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fec0b0930 msgr2=0x7f8fec0aef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:43.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.603+0000 7f8ff2434700 1 --2- 172.21.15.146:0/1135150162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fec0b0930 0x7f8fec0aef90 secure :-1 s=READY pgs=2184 cs=0 l=1 rev1=1 crypto rx=0x7f8fe4009f20 tx=0x7f8fe4009840 comp rx=0 tx=0).stop 2023-10-06T11:18:43.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.603+0000 7f8ff2434700 1 -- 172.21.15.146:0/1135150162 shutdown_connections 2023-10-06T11:18:43.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.603+0000 7f8ff2434700 1 --2- 172.21.15.146:0/1135150162 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fec0b0930 0x7f8fec0aef90 unknown :-1 s=CLOSED pgs=2184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:43.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.603+0000 7f8ff2434700 1 --2- 172.21.15.146:0/1135150162 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8fec159450 0x7f8fec159820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:43.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.603+0000 7f8ff2434700 1 -- 172.21.15.146:0/1135150162 >> 172.21.15.146:0/1135150162 conn(0x7f8fec06eb10 msgr2=0x7f8fec06ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:43.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.603+0000 7f8ff2434700 1 -- 172.21.15.146:0/1135150162 shutdown_connections 2023-10-06T11:18:43.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.603+0000 7f8ff2434700 1 -- 172.21.15.146:0/1135150162 wait complete. 2023-10-06T11:18:43.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.604+0000 7f8ff2434700 1 Processor -- start 2023-10-06T11:18:43.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.604+0000 7f8ff2434700 1 -- start start 2023-10-06T11:18:43.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.605+0000 7f8ff2434700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fec0b0930 0x7f8fec16dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:43.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.605+0000 7f8ff2434700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8fec159450 0x7f8fec15c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:43.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.605+0000 7f8ff2434700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8fec15dd70 0x7f8fec0c6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:43.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.605+0000 7f8ff2434700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec159df0 con 0x7f8fec0b0930 2023-10-06T11:18:43.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.605+0000 7f8ff2434700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec16e280 con 0x7f8fec15dd70 2023-10-06T11:18:43.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.605+0000 7f8ff2434700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fec0c4ad0 con 0x7f8fec159450 2023-10-06T11:18:43.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.605+0000 7f8febfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fec0b0930 0x7f8fec16dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:43.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.605+0000 7f8febfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fec0b0930 0x7f8fec16dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48154/0 (socket says 172.21.15.146:48154) 2023-10-06T11:18:43.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.605+0000 7f8febfff700 1 -- 172.21.15.146:0/2833131486 learned_addr learned my addr 172.21.15.146:0/2833131486 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:43.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.605+0000 7f8feb7fe700 1 --2- 172.21.15.146:0/2833131486 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8fec159450 0x7f8fec15c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:43.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.605+0000 7f8febfff700 1 -- 172.21.15.146:0/2833131486 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8fec159450 msgr2=0x7f8fec15c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:43.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.605+0000 7f8febfff700 1 --2- 172.21.15.146:0/2833131486 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8fec159450 0x7f8fec15c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:43.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.605+0000 7f8febfff700 1 -- 172.21.15.146:0/2833131486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8fec15dd70 msgr2=0x7f8fec0c6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:43.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.605+0000 7f8febfff700 1 --2- 172.21.15.146:0/2833131486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8fec15dd70 0x7f8fec0c6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:43.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.605+0000 7f8febfff700 1 -- 172.21.15.146:0/2833131486 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe4009ae0 con 0x7f8fec0b0930 2023-10-06T11:18:43.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.605+0000 7f8feb7fe700 1 --2- 172.21.15.146:0/2833131486 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8fec159450 0x7f8fec15c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:18:43.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.606+0000 7f8febfff700 1 --2- 172.21.15.146:0/2833131486 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fec0b0930 0x7f8fec16dd40 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc00d890 tx=0x7f8fdc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:43.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.606+0000 7f8fd3fff700 1 -- 172.21.15.146:0/2833131486 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc0125f0 con 0x7f8fec0b0930 2023-10-06T11:18:43.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.606+0000 7f8fd3fff700 1 -- 172.21.15.146:0/2833131486 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fdc012750 con 0x7f8fec0b0930 2023-10-06T11:18:43.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.606+0000 7f8ff2434700 1 -- 172.21.15.146:0/2833131486 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fec0ae920 con 0x7f8fec0b0930 2023-10-06T11:18:43.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.606+0000 7f8fd3fff700 1 -- 172.21.15.146:0/2833131486 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fdc012ad0 con 0x7f8fec0b0930 2023-10-06T11:18:43.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.606+0000 7f8ff2434700 1 -- 172.21.15.146:0/2833131486 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fec0c4780 con 0x7f8fec0b0930 2023-10-06T11:18:43.617 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.607+0000 7f8ff2434700 1 -- 172.21.15.146:0/2833131486 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fec0ae780 con 0x7f8fec0b0930 2023-10-06T11:18:43.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.607+0000 7f8fd3fff700 1 -- 172.21.15.146:0/2833131486 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8fdc01e460 con 0x7f8fec0b0930 2023-10-06T11:18:43.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.607+0000 7f8fd3fff700 1 --2- 172.21.15.146:0/2833131486 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8fd8066f60 0x7f8fd8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:43.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.608+0000 7f8feb7fe700 1 --2- 172.21.15.146:0/2833131486 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8fd8066f60 0x7f8fd8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:43.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.608+0000 7f8fd3fff700 1 -- 172.21.15.146:0/2833131486 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f8fdc084940 con 0x7f8fec0b0930 2023-10-06T11:18:43.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.608+0000 7f8feb7fe700 1 --2- 172.21.15.146:0/2833131486 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8fd8066f60 0x7f8fd8069410 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f8fec0b5f00 tx=0x7f8fe0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:43.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.612+0000 7f8fd3fff700 1 -- 172.21.15.146:0/2833131486 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8fec0ae780 con 0x7f8fec0b0930 2023-10-06T11:18:43.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.798+0000 7f8ff2434700 1 -- 172.21.15.146:0/2833131486 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f8fec0ae780 con 0x7f8fec0b0930 2023-10-06T11:18:43.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.802+0000 7f8fd3fff700 1 -- 172.21.15.146:0/2833131486 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v31) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8fec0ae780 con 0x7f8fec0b0930 2023-10-06T11:18:43.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.804+0000 7f8ff2434700 1 -- 172.21.15.146:0/2833131486 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8fd8066f60 msgr2=0x7f8fd8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:43.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.804+0000 7f8ff2434700 1 --2- 172.21.15.146:0/2833131486 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8fd8066f60 0x7f8fd8069410 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f8fec0b5f00 tx=0x7f8fe0009040 comp rx=0 tx=0).stop 2023-10-06T11:18:43.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.804+0000 7f8ff2434700 1 -- 172.21.15.146:0/2833131486 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fec0b0930 msgr2=0x7f8fec16dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:43.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.804+0000 7f8ff2434700 1 --2- 172.21.15.146:0/2833131486 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fec0b0930 0x7f8fec16dd40 secure :-1 s=READY pgs=2185 cs=0 l=1 rev1=1 crypto rx=0x7f8fdc00d890 tx=0x7f8fdc008040 comp rx=0 tx=0).stop 2023-10-06T11:18:43.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.804+0000 7f8ff2434700 1 -- 172.21.15.146:0/2833131486 shutdown_connections 2023-10-06T11:18:43.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.804+0000 7f8ff2434700 1 --2- 172.21.15.146:0/2833131486 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8fd8066f60 0x7f8fd8069410 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:43.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.804+0000 7f8ff2434700 1 --2- 172.21.15.146:0/2833131486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8fec15dd70 0x7f8fec0c6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:43.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.804+0000 7f8ff2434700 1 --2- 172.21.15.146:0/2833131486 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8fec0b0930 0x7f8fec16dd40 unknown :-1 s=CLOSED pgs=2185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:43.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.804+0000 7f8ff2434700 1 --2- 172.21.15.146:0/2833131486 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8fec159450 0x7f8fec15c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:43.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.804+0000 7f8ff2434700 1 -- 172.21.15.146:0/2833131486 >> 172.21.15.146:0/2833131486 conn(0x7f8fec06eb10 msgr2=0x7f8fec0cca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:43.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.804+0000 7f8ff2434700 1 -- 172.21.15.146:0/2833131486 shutdown_connections 2023-10-06T11:18:43.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.805+0000 7f8ff2434700 1 -- 172.21.15.146:0/2833131486 wait complete. 2023-10-06T11:18:43.818 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace_for_new_files' 2023-10-06T11:18:43.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.934+0000 7f8ee1a5e700 1 Processor -- start 2023-10-06T11:18:43.936 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.934+0000 7f8ee1a5e700 1 -- start start 2023-10-06T11:18:43.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.935+0000 7f8ee1a5e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8edc0af6c0 0x7f8edc0cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:43.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.935+0000 7f8ee1a5e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8edc0cc830 con 0x7f8edc0cf1c0 2023-10-06T11:18:43.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.935+0000 7f8ee1a5e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8edc0cbc20 con 0x7f8edc0cb610 2023-10-06T11:18:43.940 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.935+0000 7f8ee1a5e700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8edc0cbf00 con 0x7f8edc0af6c0 2023-10-06T11:18:43.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.935+0000 7f8edb7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8edc0cf1c0 0x7f8edc0c5300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40198/0 (socket says 172.21.15.146:40198) 2023-10-06T11:18:43.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.935+0000 7f8edb7fe700 1 -- 172.21.15.146:0/996234082 learned_addr learned my addr 172.21.15.146:0/996234082 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:43.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.936+0000 7f8ed9ffb700 1 -- 172.21.15.146:0/996234082 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3752726121 0 0) 0x7f8edc0cc830 con 0x7f8edc0cf1c0 2023-10-06T11:18:43.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.936+0000 7f8ed9ffb700 1 -- 172.21.15.146:0/996234082 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ec4003570 con 0x7f8edc0cf1c0 2023-10-06T11:18:43.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.936+0000 7f8edaffd700 1 --2- 172.21.15.146:0/996234082 >> v2:172.21.15.151:3300/0 conn(0x7f8edc0af6c0 0x7f8edc0cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:43.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.936+0000 7f8ed9ffb700 1 -- 172.21.15.146:0/996234082 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2940382745 0 0) 0x7f8ec4003570 con 0x7f8edc0cf1c0 2023-10-06T11:18:43.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.936+0000 7f8ed9ffb700 1 -- 172.21.15.146:0/996234082 >> v2:172.21.15.151:3300/0 conn(0x7f8edc0af6c0 msgr2=0x7f8edc0cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:43.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.936+0000 7f8ed9ffb700 1 --2- 172.21.15.146:0/996234082 >> v2:172.21.15.151:3300/0 conn(0x7f8edc0af6c0 0x7f8edc0cb0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:43.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.936+0000 7f8ed9ffb700 1 -- 172.21.15.146:0/996234082 >> v1:172.21.15.151:6789/0 conn(0x7f8edc0cb610 legacy=0x7f8edc0ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:43.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.936+0000 7f8ed9ffb700 1 -- 172.21.15.146:0/996234082 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8edc0cc1e0 con 0x7f8edc0cf1c0 2023-10-06T11:18:43.941 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.936+0000 7f8ed9ffb700 1 -- 172.21.15.146:0/996234082 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f8ed4001470 con 0x7f8edc0cf1c0 2023-10-06T11:18:43.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.936+0000 7f8ed9ffb700 1 -- 172.21.15.146:0/996234082 >> v1:172.21.15.146:6789/0 conn(0x7f8edc0cf1c0 legacy=0x7f8edc0c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:43.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.936+0000 7f8ed9ffb700 1 --2- 172.21.15.146:0/996234082 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ec4003a60 0x7f8ec4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:43.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.936+0000 7f8ed9ffb700 1 --2- 172.21.15.146:0/996234082 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ec4004810 0x7f8ec4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:43.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.936+0000 7f8ed9ffb700 1 --2- 172.21.15.146:0/996234082 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ec40051c0 0x7f8ec400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:43.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.936+0000 7f8ed9ffb700 1 -- 172.21.15.146:0/996234082 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc0cbf00 con 0x7f8ec40051c0 2023-10-06T11:18:43.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.936+0000 7f8ed9ffb700 1 -- 172.21.15.146:0/996234082 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec400c160 con 0x7f8ec4004810 2023-10-06T11:18:43.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.936+0000 7f8ed9ffb700 1 -- 172.21.15.146:0/996234082 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec400c320 con 0x7f8ec4003a60 2023-10-06T11:18:43.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.936+0000 7f8edb7fe700 1 --2- 172.21.15.146:0/996234082 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ec40051c0 0x7f8ec400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:43.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.936+0000 7f8eda7fc700 1 --2- 172.21.15.146:0/996234082 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ec4004810 0x7f8ec4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:43.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.936+0000 7f8edaffd700 1 --2- 172.21.15.146:0/996234082 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ec4003a60 0x7f8ec4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:43.942 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.936+0000 7f8edb7fe700 1 -- 172.21.15.146:0/996234082 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ec4003a60 msgr2=0x7f8ec4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:43.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.936+0000 7f8edb7fe700 1 --2- 172.21.15.146:0/996234082 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ec4003a60 0x7f8ec4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:43.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.937+0000 7f8edb7fe700 1 -- 172.21.15.146:0/996234082 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ec4004810 msgr2=0x7f8ec4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:43.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.937+0000 7f8edb7fe700 1 --2- 172.21.15.146:0/996234082 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ec4004810 0x7f8ec4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:43.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.937+0000 7f8edb7fe700 1 -- 172.21.15.146:0/996234082 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec4003570 con 0x7f8ec40051c0 2023-10-06T11:18:43.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.937+0000 7f8edb7fe700 1 -- 172.21.15.146:0/996234082 reap_dead start 2023-10-06T11:18:43.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.937+0000 7f8edb7fe700 1 --2- 172.21.15.146:0/996234082 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ec40051c0 0x7f8ec400ba60 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7f8ed400c390 tx=0x7f8ed4001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=487d09827003d82d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:43.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.937+0000 7f8ed9ffb700 1 -- 172.21.15.146:0/996234082 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed400cc60 con 0x7f8ec40051c0 2023-10-06T11:18:43.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.937+0000 7f8ed9ffb700 1 -- 172.21.15.146:0/996234082 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed400cdc0 con 0x7f8ec40051c0 2023-10-06T11:18:43.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.937+0000 7f8ed9ffb700 1 -- 172.21.15.146:0/996234082 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed4005b50 con 0x7f8ec40051c0 2023-10-06T11:18:43.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.937+0000 7f8ee1a5e700 1 -- 172.21.15.146:0/996234082 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ec40051c0 msgr2=0x7f8ec400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:43.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.937+0000 7f8ee1a5e700 1 --2- 172.21.15.146:0/996234082 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ec40051c0 0x7f8ec400ba60 secure :-1 s=READY pgs=2187 cs=0 l=1 rev1=1 crypto rx=0x7f8ed400c390 tx=0x7f8ed4001e50 comp rx=0 tx=0).stop 2023-10-06T11:18:43.943 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.937+0000 7f8ee1a5e700 1 -- 172.21.15.146:0/996234082 shutdown_connections 2023-10-06T11:18:43.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.937+0000 7f8ee1a5e700 1 --2- 172.21.15.146:0/996234082 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ec40051c0 0x7f8ec400ba60 unknown :-1 s=CLOSED pgs=2187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:43.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.937+0000 7f8ee1a5e700 1 -- 172.21.15.146:0/996234082 >> 172.21.15.146:0/996234082 conn(0x7f8edc0996f0 msgr2=0x7f8edc06f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:43.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.937+0000 7f8ee1a5e700 1 -- 172.21.15.146:0/996234082 shutdown_connections 2023-10-06T11:18:43.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.938+0000 7f8ee1a5e700 1 -- 172.21.15.146:0/996234082 wait complete. 2023-10-06T11:18:43.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.939+0000 7f8ee1a5e700 1 Processor -- start 2023-10-06T11:18:43.944 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.942+0000 7f8ee1a5e700 1 -- start start 2023-10-06T11:18:43.946 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.943+0000 7f8ee1a5e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ec40051c0 0x7f8edc0afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:43.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.943+0000 7f8ee1a5e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8edc179ec0 0x7f8edc17a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:43.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.943+0000 7f8ee1a5e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8edc156640 0x7f8edc156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:43.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.943+0000 7f8ee1a5e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc17a870 con 0x7f8edc179ec0 2023-10-06T11:18:43.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.943+0000 7f8ee1a5e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc0ca500 con 0x7f8ec40051c0 2023-10-06T11:18:43.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.943+0000 7f8ee1a5e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc0b1b50 con 0x7f8edc156640 2023-10-06T11:18:43.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.944+0000 7f8eda7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8edc179ec0 0x7f8edc17a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:43.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.944+0000 7f8eda7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8edc179ec0 0x7f8edc17a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48176/0 (socket says 172.21.15.146:48176) 2023-10-06T11:18:43.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.944+0000 7f8eda7fc700 1 -- 172.21.15.146:0/2629050710 learned_addr learned my addr 172.21.15.146:0/2629050710 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:43.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.944+0000 7f8edb7fe700 1 --2- 172.21.15.146:0/2629050710 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8edc156640 0x7f8edc156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:43.947 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.944+0000 7f8edaffd700 1 --2- 172.21.15.146:0/2629050710 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ec40051c0 0x7f8edc0afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:43.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.944+0000 7f8eda7fc700 1 -- 172.21.15.146:0/2629050710 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8edc156640 msgr2=0x7f8edc156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:43.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.944+0000 7f8eda7fc700 1 --2- 172.21.15.146:0/2629050710 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8edc156640 0x7f8edc156aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:43.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.944+0000 7f8eda7fc700 1 -- 172.21.15.146:0/2629050710 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ec40051c0 msgr2=0x7f8edc0afbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:43.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.944+0000 7f8eda7fc700 1 --2- 172.21.15.146:0/2629050710 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ec40051c0 0x7f8edc0afbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:43.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.944+0000 7f8eda7fc700 1 -- 172.21.15.146:0/2629050710 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8edc0b1e30 con 0x7f8edc179ec0 2023-10-06T11:18:43.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.944+0000 7f8edb7fe700 1 --2- 172.21.15.146:0/2629050710 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8edc156640 0x7f8edc156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:18:43.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.944+0000 7f8edaffd700 1 --2- 172.21.15.146:0/2629050710 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ec40051c0 0x7f8edc0afbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:18:43.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.944+0000 7f8eda7fc700 1 --2- 172.21.15.146:0/2629050710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8edc179ec0 0x7f8edc17a330 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7f8ed0002980 tx=0x7f8ed0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:43.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.944+0000 7f8ec2ffd700 1 -- 172.21.15.146:0/2629050710 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed000f870 con 0x7f8edc179ec0 2023-10-06T11:18:43.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.944+0000 7f8ec2ffd700 1 -- 172.21.15.146:0/2629050710 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ed000f9d0 con 0x7f8edc179ec0 2023-10-06T11:18:43.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.944+0000 7f8ec2ffd700 1 -- 172.21.15.146:0/2629050710 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ed000fd90 con 0x7f8edc179ec0 2023-10-06T11:18:43.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.944+0000 7f8ee1a5e700 1 -- 172.21.15.146:0/2629050710 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8edc0b2110 con 0x7f8edc179ec0 2023-10-06T11:18:43.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.944+0000 7f8ee1a5e700 1 -- 172.21.15.146:0/2629050710 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8edc0b1820 con 0x7f8edc179ec0 2023-10-06T11:18:43.949 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.946+0000 7f8ee1a5e700 1 -- 172.21.15.146:0/2629050710 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8edc0b25b0 con 0x7f8edc179ec0 2023-10-06T11:18:43.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.946+0000 7f8ec2ffd700 1 -- 172.21.15.146:0/2629050710 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ed0006a30 con 0x7f8edc179ec0 2023-10-06T11:18:43.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.947+0000 7f8ec2ffd700 1 --2- 172.21.15.146:0/2629050710 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8ec8066f30 0x7f8ec80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:43.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.947+0000 7f8ec2ffd700 1 -- 172.21.15.146:0/2629050710 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f8ed00846f0 con 0x7f8edc179ec0 2023-10-06T11:18:43.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.947+0000 7f8edaffd700 1 --2- 172.21.15.146:0/2629050710 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8ec8066f30 0x7f8ec80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:43.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.948+0000 7f8edaffd700 1 --2- 172.21.15.146:0/2629050710 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8ec8066f30 0x7f8ec80693e0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc0094a0 tx=0x7f8ecc00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:43.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:43.956+0000 7f8ec2ffd700 1 -- 172.21.15.146:0/2629050710 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ed0051b10 con 0x7f8edc179ec0 2023-10-06T11:18:44.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.219+0000 7f8ee1a5e700 1 -- 172.21.15.146:0/2629050710 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace_for_new_files"]} v 0) v1 -- 0x7f8edc0cc4c0 con 0x7f8edc179ec0 2023-10-06T11:18:44.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.465+0000 7f8ec2ffd700 1 -- 172.21.15.146:0/2629050710 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_backtrace_for_new_files"]}]=0 v609) v1 ==== 147+0+0 (secure 0 0 0) 0x7f8ed0084070 con 0x7f8edc179ec0 2023-10-06T11:18:44.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.467+0000 7f8ee1a5e700 1 -- 172.21.15.146:0/2629050710 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8ec8066f30 msgr2=0x7f8ec80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:44.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.467+0000 7f8ee1a5e700 1 --2- 172.21.15.146:0/2629050710 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8ec8066f30 0x7f8ec80693e0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f8ecc0094a0 tx=0x7f8ecc00b040 comp rx=0 tx=0).stop 2023-10-06T11:18:44.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.467+0000 7f8ee1a5e700 1 -- 172.21.15.146:0/2629050710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8edc179ec0 msgr2=0x7f8edc17a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:44.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.467+0000 7f8ee1a5e700 1 --2- 172.21.15.146:0/2629050710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8edc179ec0 0x7f8edc17a330 secure :-1 s=READY pgs=2188 cs=0 l=1 rev1=1 crypto rx=0x7f8ed0002980 tx=0x7f8ed0007d30 comp rx=0 tx=0).stop 2023-10-06T11:18:44.488 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.467+0000 7f8ee1a5e700 1 -- 172.21.15.146:0/2629050710 shutdown_connections 2023-10-06T11:18:44.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.467+0000 7f8ee1a5e700 1 --2- 172.21.15.146:0/2629050710 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8ec8066f30 0x7f8ec80693e0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:44.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.467+0000 7f8ee1a5e700 1 --2- 172.21.15.146:0/2629050710 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8edc156640 0x7f8edc156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:44.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.467+0000 7f8ee1a5e700 1 --2- 172.21.15.146:0/2629050710 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ec40051c0 0x7f8edc0afbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:44.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.467+0000 7f8ee1a5e700 1 --2- 172.21.15.146:0/2629050710 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8edc179ec0 0x7f8edc17a330 unknown :-1 s=CLOSED pgs=2188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:44.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.467+0000 7f8ee1a5e700 1 -- 172.21.15.146:0/2629050710 >> 172.21.15.146:0/2629050710 conn(0x7f8edc0996f0 msgr2=0x7f8edc06f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:44.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.467+0000 7f8ee1a5e700 1 -- 172.21.15.146:0/2629050710 shutdown_connections 2023-10-06T11:18:44.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.467+0000 7f8ee1a5e700 1 -- 172.21.15.146:0/2629050710 wait complete. 2023-10-06T11:18:44.489 INFO:tasks.cephfs_test_runner:test_scrub_backtrace_for_new_files (tasks.cephfs.test_scrub.TestScrub) ... ok 2023-10-06T11:18:44.490 INFO:tasks.cephfs_test_runner:Starting test: test_scrub_dup_inode (tasks.cephfs.test_scrub.TestScrub) 2023-10-06T11:18:44.490 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_dup_inode' 2023-10-06T11:18:44.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.603+0000 7f68c8899700 1 Processor -- start 2023-10-06T11:18:44.605 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.603+0000 7f68c8899700 1 -- start start 2023-10-06T11:18:44.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.604+0000 7f68c8899700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f68c41538c0 0x7f68c4153c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:44.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.604+0000 7f68c8899700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f68c415a940 0x7f68c415dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:44.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.604+0000 7f68c8899700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68c415d270 con 0x7f68c40cac80 2023-10-06T11:18:44.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.604+0000 7f68c8899700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68c415d830 con 0x7f68c415a940 2023-10-06T11:18:44.607 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.604+0000 7f68c8899700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68c40cb810 con 0x7f68c41538c0 2023-10-06T11:18:44.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.604+0000 7f68c2d9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f68c40cac80 0x7f68c40ce610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40202/0 (socket says 172.21.15.146:40202) 2023-10-06T11:18:44.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.604+0000 7f68c2d9d700 1 -- 172.21.15.146:0/1141936801 learned_addr learned my addr 172.21.15.146:0/1141936801 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:44.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.604+0000 7f68b9d9b700 1 --2- 172.21.15.146:0/1141936801 >> v2:172.21.15.146:3300/0 conn(0x7f68c415a940 0x7f68c415dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:44.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.604+0000 7f68c259c700 1 --2- 172.21.15.146:0/1141936801 >> v2:172.21.15.151:3300/0 conn(0x7f68c41538c0 0x7f68c4153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:44.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.604+0000 7f68c1d9b700 1 -- 172.21.15.146:0/1141936801 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2575390208 0 0) 0x7f68c415d270 con 0x7f68c40cac80 2023-10-06T11:18:44.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.604+0000 7f68c1d9b700 1 -- 172.21.15.146:0/1141936801 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68b0003570 con 0x7f68c40cac80 2023-10-06T11:18:44.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.605+0000 7f68b9d9b700 1 -- 172.21.15.146:0/1141936801 >> v2:172.21.15.151:3300/0 conn(0x7f68c41538c0 msgr2=0x7f68c4153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:44.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.605+0000 7f68b9d9b700 1 --2- 172.21.15.146:0/1141936801 >> v2:172.21.15.151:3300/0 conn(0x7f68c41538c0 0x7f68c4153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:44.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.605+0000 7f68b9d9b700 1 -- 172.21.15.146:0/1141936801 >> v1:172.21.15.146:6789/0 conn(0x7f68c40cac80 legacy=0x7f68c40ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:44.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.605+0000 7f68b9d9b700 1 -- 172.21.15.146:0/1141936801 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c40cbaf0 con 0x7f68c415a940 2023-10-06T11:18:44.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.605+0000 7f68b9d9b700 1 --2- 172.21.15.146:0/1141936801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68c415a940 0x7f68c415dcc0 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7f68c40d1230 tx=0x7f68ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0f873f72b2b9cb4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:44.608 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.605+0000 7f68c1d9b700 1 -- 172.21.15.146:0/1141936801 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ac011630 con 0x7f68c415a940 2023-10-06T11:18:44.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.605+0000 7f68c1d9b700 1 -- 172.21.15.146:0/1141936801 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68ac0117b0 con 0x7f68c415a940 2023-10-06T11:18:44.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.605+0000 7f68c1d9b700 1 -- 172.21.15.146:0/1141936801 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ac011b70 con 0x7f68c415a940 2023-10-06T11:18:44.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.605+0000 7f68c8899700 1 -- 172.21.15.146:0/1141936801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68c415a940 msgr2=0x7f68c415dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:44.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.605+0000 7f68c8899700 1 --2- 172.21.15.146:0/1141936801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68c415a940 0x7f68c415dcc0 secure :-1 s=READY pgs=2190 cs=0 l=1 rev1=1 crypto rx=0x7f68c40d1230 tx=0x7f68ac0091a0 comp rx=0 tx=0).stop 2023-10-06T11:18:44.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.605+0000 7f68c8899700 1 -- 172.21.15.146:0/1141936801 shutdown_connections 2023-10-06T11:18:44.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.605+0000 7f68c8899700 1 --2- 172.21.15.146:0/1141936801 >> v2:172.21.15.151:3300/0 conn(0x7f68c41538c0 0x7f68c4153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:44.609 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.605+0000 7f68c8899700 1 --2- 172.21.15.146:0/1141936801 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68c415a940 0x7f68c415dcc0 unknown :-1 s=CLOSED pgs=2190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:44.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.605+0000 7f68c8899700 1 -- 172.21.15.146:0/1141936801 >> 172.21.15.146:0/1141936801 conn(0x7f68c406eb10 msgr2=0x7f68c406ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:44.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.605+0000 7f68c8899700 1 -- 172.21.15.146:0/1141936801 shutdown_connections 2023-10-06T11:18:44.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.605+0000 7f68c8899700 1 -- 172.21.15.146:0/1141936801 wait complete. 2023-10-06T11:18:44.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.607+0000 7f68c8899700 1 Processor -- start 2023-10-06T11:18:44.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.607+0000 7f68c8899700 1 -- start start 2023-10-06T11:18:44.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.607+0000 7f68c8899700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68c40cac80 0x7f68c413f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:44.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.607+0000 7f68c8899700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68c41538c0 0x7f68c40b11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:44.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.607+0000 7f68c8899700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68c415a940 0x7f68c40b1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:44.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.607+0000 7f68c8899700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c416cf90 con 0x7f68c40cac80 2023-10-06T11:18:44.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.607+0000 7f68c8899700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c416d1a0 con 0x7f68c415a940 2023-10-06T11:18:44.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.607+0000 7f68c8899700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c416d480 con 0x7f68c41538c0 2023-10-06T11:18:44.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.607+0000 7f68c259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68c40cac80 0x7f68c413f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:44.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.607+0000 7f68c259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68c40cac80 0x7f68c413f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48196/0 (socket says 172.21.15.146:48196) 2023-10-06T11:18:44.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.607+0000 7f68c259c700 1 -- 172.21.15.146:0/945725310 learned_addr learned my addr 172.21.15.146:0/945725310 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:44.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.608+0000 7f68c2d9d700 1 --2- 172.21.15.146:0/945725310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68c415a940 0x7f68c40b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:44.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.608+0000 7f68b9d9b700 1 --2- 172.21.15.146:0/945725310 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68c41538c0 0x7f68c40b11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:44.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.608+0000 7f68c259c700 1 -- 172.21.15.146:0/945725310 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68c41538c0 msgr2=0x7f68c40b11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:44.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.608+0000 7f68c259c700 1 --2- 172.21.15.146:0/945725310 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68c41538c0 0x7f68c40b11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:44.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.608+0000 7f68c259c700 1 -- 172.21.15.146:0/945725310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68c415a940 msgr2=0x7f68c40b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:44.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.608+0000 7f68c259c700 1 --2- 172.21.15.146:0/945725310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68c415a940 0x7f68c40b1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:44.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.608+0000 7f68c259c700 1 -- 172.21.15.146:0/945725310 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ac009420 con 0x7f68c40cac80 2023-10-06T11:18:44.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.608+0000 7f68c259c700 1 --2- 172.21.15.146:0/945725310 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68c40cac80 0x7f68c413f410 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 crypto rx=0x7f68b400ec80 tx=0x7f68b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:44.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.608+0000 7f68baffd700 1 -- 172.21.15.146:0/945725310 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b400c9d0 con 0x7f68c40cac80 2023-10-06T11:18:44.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.608+0000 7f68baffd700 1 -- 172.21.15.146:0/945725310 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b400cb30 con 0x7f68c40cac80 2023-10-06T11:18:44.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.608+0000 7f68c8899700 1 -- 172.21.15.146:0/945725310 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c416d760 con 0x7f68c40cac80 2023-10-06T11:18:44.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.608+0000 7f68baffd700 1 -- 172.21.15.146:0/945725310 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b4013470 con 0x7f68c40cac80 2023-10-06T11:18:44.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.608+0000 7f68c8899700 1 -- 172.21.15.146:0/945725310 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c413f950 con 0x7f68c40cac80 2023-10-06T11:18:44.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.609+0000 7f68c8899700 1 -- 172.21.15.146:0/945725310 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68c40c7480 con 0x7f68c40cac80 2023-10-06T11:18:44.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.609+0000 7f68baffd700 1 -- 172.21.15.146:0/945725310 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f68b4013820 con 0x7f68c40cac80 2023-10-06T11:18:44.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.610+0000 7f68baffd700 1 --2- 172.21.15.146:0/945725310 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f68a4066f30 0x7f68a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:44.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.610+0000 7f68baffd700 1 -- 172.21.15.146:0/945725310 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f68b4084720 con 0x7f68c40cac80 2023-10-06T11:18:44.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.610+0000 7f68b9d9b700 1 --2- 172.21.15.146:0/945725310 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f68a4066f30 0x7f68a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:44.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.610+0000 7f68b9d9b700 1 --2- 172.21.15.146:0/945725310 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f68a4066f30 0x7f68a40693e0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f68c40d1230 tx=0x7f68ac017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:44.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.614+0000 7f68baffd700 1 -- 172.21.15.146:0/945725310 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f68b4051b30 con 0x7f68c40cac80 2023-10-06T11:18:44.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:44.873+0000 7f68c8899700 1 -- 172.21.15.146:0/945725310 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_dup_inode"]} v 0) v1 -- 0x7f68c415d9c0 con 0x7f68c40cac80 2023-10-06T11:18:45.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.468+0000 7f68baffd700 1 -- 172.21.15.146:0/945725310 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_scrub.TestScrub.test_scrub_dup_inode"]}]=0 v610) v1 ==== 136+0+0 (secure 0 0 0) 0x7f68b4055150 con 0x7f68c40cac80 2023-10-06T11:18:45.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.471+0000 7f68c8899700 1 -- 172.21.15.146:0/945725310 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f68a4066f30 msgr2=0x7f68a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:45.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.471+0000 7f68c8899700 1 --2- 172.21.15.146:0/945725310 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f68a4066f30 0x7f68a40693e0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f68c40d1230 tx=0x7f68ac017000 comp rx=0 tx=0).stop 2023-10-06T11:18:45.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.471+0000 7f68c8899700 1 -- 172.21.15.146:0/945725310 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68c40cac80 msgr2=0x7f68c413f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:45.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.471+0000 7f68c8899700 1 --2- 172.21.15.146:0/945725310 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68c40cac80 0x7f68c413f410 secure :-1 s=READY pgs=2191 cs=0 l=1 rev1=1 crypto rx=0x7f68b400ec80 tx=0x7f68b40091a0 comp rx=0 tx=0).stop 2023-10-06T11:18:45.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.471+0000 7f68c8899700 1 -- 172.21.15.146:0/945725310 shutdown_connections 2023-10-06T11:18:45.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.471+0000 7f68c8899700 1 --2- 172.21.15.146:0/945725310 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f68a4066f30 0x7f68a40693e0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:45.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.471+0000 7f68c8899700 1 --2- 172.21.15.146:0/945725310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68c415a940 0x7f68c40b1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:45.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.471+0000 7f68c8899700 1 --2- 172.21.15.146:0/945725310 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f68c40cac80 0x7f68c413f410 unknown :-1 s=CLOSED pgs=2191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:45.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.471+0000 7f68c8899700 1 --2- 172.21.15.146:0/945725310 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68c41538c0 0x7f68c40b11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:45.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.471+0000 7f68c8899700 1 -- 172.21.15.146:0/945725310 >> 172.21.15.146:0/945725310 conn(0x7f68c406eb10 msgr2=0x7f68c40c53e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:45.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.471+0000 7f68c8899700 1 -- 172.21.15.146:0/945725310 shutdown_connections 2023-10-06T11:18:45.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.471+0000 7f68c8899700 1 -- 172.21.15.146:0/945725310 wait complete. 2023-10-06T11:18:45.485 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T11:18:45.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.601+0000 7f40634ad700 1 Processor -- start 2023-10-06T11:18:45.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.601+0000 7f40634ad700 1 -- start start 2023-10-06T11:18:45.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.602+0000 7f40634ad700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f405c159820 0x7f405c0b0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:45.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.602+0000 7f40634ad700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f405c0b0760 0x7f405c0aef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:45.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.602+0000 7f40634ad700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f405c0b0bc0 con 0x7f405c159450 2023-10-06T11:18:45.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.602+0000 7f40634ad700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f405c0b2f20 con 0x7f405c0b0760 2023-10-06T11:18:45.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.602+0000 7f40634ad700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f405c0cb8a0 con 0x7f405c159820 2023-10-06T11:18:45.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.602+0000 7f4061249700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f405c159450 0x7f405c15dd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40210/0 (socket says 172.21.15.146:40210) 2023-10-06T11:18:45.604 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.602+0000 7f4061249700 1 -- 172.21.15.146:0/432119275 learned_addr learned my addr 172.21.15.146:0/432119275 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:45.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.602+0000 7f4053fff700 1 -- 172.21.15.146:0/432119275 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2022799122 0 0) 0x7f4058001490 con 0x7f405c159450 2023-10-06T11:18:45.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.603+0000 7f4060a48700 1 --2- 172.21.15.146:0/432119275 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f405c159820 0x7f405c0b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:45.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.603+0000 7f4053fff700 1 -- 172.21.15.146:0/432119275 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4048003570 con 0x7f405c159450 2023-10-06T11:18:45.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.603+0000 7f4061a4a700 1 --2- 172.21.15.146:0/432119275 >> v2:172.21.15.151:3300/0 conn(0x7f405c0b0760 0x7f405c0aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:45.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.603+0000 7f4053fff700 1 -- 172.21.15.146:0/432119275 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1558921186 0 0) 0x7f4048003570 con 0x7f405c159450 2023-10-06T11:18:45.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.603+0000 7f4053fff700 1 -- 172.21.15.146:0/432119275 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f405c159820 msgr2=0x7f405c0b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:45.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.603+0000 7f4053fff700 1 --2- 172.21.15.146:0/432119275 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f405c159820 0x7f405c0b0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:45.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.603+0000 7f4053fff700 1 -- 172.21.15.146:0/432119275 >> v2:172.21.15.151:3300/0 conn(0x7f405c0b0760 msgr2=0x7f405c0aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:45.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.603+0000 7f4053fff700 1 --2- 172.21.15.146:0/432119275 >> v2:172.21.15.151:3300/0 conn(0x7f405c0b0760 0x7f405c0aef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:45.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.603+0000 7f4053fff700 1 -- 172.21.15.146:0/432119275 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f405c159c70 con 0x7f405c159450 2023-10-06T11:18:45.610 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.603+0000 7f4053fff700 1 -- 172.21.15.146:0/432119275 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f4058001980 con 0x7f405c159450 2023-10-06T11:18:45.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.603+0000 7f4053fff700 1 -- 172.21.15.146:0/432119275 >> v1:172.21.15.146:6789/0 conn(0x7f405c159450 legacy=0x7f405c15dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:45.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.603+0000 7f4053fff700 1 --2- 172.21.15.146:0/432119275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4048003a60 0x7f4048003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:45.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.603+0000 7f4053fff700 1 --2- 172.21.15.146:0/432119275 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f405c159820 0x7f4048004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:45.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.603+0000 7f4053fff700 1 --2- 172.21.15.146:0/432119275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4048004d50 0x7f40480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:45.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.603+0000 7f4053fff700 1 -- 172.21.15.146:0/432119275 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405c0b2f20 con 0x7f4048003a60 2023-10-06T11:18:45.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.603+0000 7f4053fff700 1 -- 172.21.15.146:0/432119275 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405c0cb8a0 con 0x7f4048004d50 2023-10-06T11:18:45.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.603+0000 7f4053fff700 1 -- 172.21.15.146:0/432119275 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f404800ba60 con 0x7f405c159820 2023-10-06T11:18:45.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.603+0000 7f4061249700 1 --2- 172.21.15.146:0/432119275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4048003a60 0x7f4048003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:45.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.603+0000 7f4060a48700 1 --2- 172.21.15.146:0/432119275 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f405c159820 0x7f4048004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:45.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.603+0000 7f4061a4a700 1 --2- 172.21.15.146:0/432119275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4048004d50 0x7f40480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:45.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.603+0000 7f4061249700 1 -- 172.21.15.146:0/432119275 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f405c159820 msgr2=0x7f4048004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:45.611 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.603+0000 7f4061249700 1 --2- 172.21.15.146:0/432119275 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f405c159820 0x7f4048004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:45.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.603+0000 7f4061249700 1 -- 172.21.15.146:0/432119275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4048004d50 msgr2=0x7f40480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:45.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.603+0000 7f4061249700 1 --2- 172.21.15.146:0/432119275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4048004d50 0x7f40480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:45.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.603+0000 7f4061249700 1 -- 172.21.15.146:0/432119275 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4048003570 con 0x7f4048003a60 2023-10-06T11:18:45.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.603+0000 7f4061a4a700 1 --2- 172.21.15.146:0/432119275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4048004d50 0x7f40480051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:18:45.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.603+0000 7f4061249700 1 --2- 172.21.15.146:0/432119275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4048003a60 0x7f4048003e70 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7f405800ab00 tx=0x7f405800a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ce2849c23577e8e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:45.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.604+0000 7f4053fff700 1 -- 172.21.15.146:0/432119275 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405800a490 con 0x7f4048003a60 2023-10-06T11:18:45.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.604+0000 7f4053fff700 1 -- 172.21.15.146:0/432119275 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f405800c570 con 0x7f4048003a60 2023-10-06T11:18:45.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.604+0000 7f4053fff700 1 -- 172.21.15.146:0/432119275 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405800c910 con 0x7f4048003a60 2023-10-06T11:18:45.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.604+0000 7f40634ad700 1 -- 172.21.15.146:0/432119275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4048003a60 msgr2=0x7f4048003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:45.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.604+0000 7f40634ad700 1 --2- 172.21.15.146:0/432119275 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4048003a60 0x7f4048003e70 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7f405800ab00 tx=0x7f405800a1a0 comp rx=0 tx=0).stop 2023-10-06T11:18:45.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.604+0000 7f4061a4a700 1 -- 172.21.15.146:0/432119275 reap_dead start 2023-10-06T11:18:45.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.604+0000 7f40634ad700 1 -- 172.21.15.146:0/432119275 shutdown_connections 2023-10-06T11:18:45.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.604+0000 7f40634ad700 1 -- 172.21.15.146:0/432119275 >> 172.21.15.146:0/432119275 conn(0x7f405c06eb10 msgr2=0x7f405c06ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:45.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.604+0000 7f40634ad700 1 -- 172.21.15.146:0/432119275 shutdown_connections 2023-10-06T11:18:45.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.604+0000 7f40634ad700 1 -- 172.21.15.146:0/432119275 wait complete. 2023-10-06T11:18:45.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.605+0000 7f40634ad700 1 Processor -- start 2023-10-06T11:18:45.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.605+0000 7f40634ad700 1 -- start start 2023-10-06T11:18:45.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.606+0000 7f40634ad700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4048003a60 0x7f405c15a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:45.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.606+0000 7f40634ad700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f405c157aa0 0x7f405c157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:45.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.606+0000 7f40634ad700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f405c0c8400 0x7f405c0c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:45.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.606+0000 7f40634ad700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405c0cee20 con 0x7f405c157aa0 2023-10-06T11:18:45.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.606+0000 7f40634ad700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405c0ce210 con 0x7f4048003a60 2023-10-06T11:18:45.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.606+0000 7f40634ad700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f405c0ce4f0 con 0x7f405c0c8400 2023-10-06T11:18:45.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.606+0000 7f4060a48700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f405c157aa0 0x7f405c157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:45.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.606+0000 7f4060a48700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f405c157aa0 0x7f405c157f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48216/0 (socket says 172.21.15.146:48216) 2023-10-06T11:18:45.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.606+0000 7f4060a48700 1 -- 172.21.15.146:0/408429871 learned_addr learned my addr 172.21.15.146:0/408429871 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:45.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.606+0000 7f4061249700 1 --2- 172.21.15.146:0/408429871 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4048003a60 0x7f405c15a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:45.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.606+0000 7f4061a4a700 1 --2- 172.21.15.146:0/408429871 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f405c0c8400 0x7f405c0c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:45.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.607+0000 7f4060a48700 1 -- 172.21.15.146:0/408429871 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f405c0c8400 msgr2=0x7f405c0c8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:45.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.607+0000 7f4060a48700 1 --2- 172.21.15.146:0/408429871 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f405c0c8400 0x7f405c0c8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:45.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.607+0000 7f4060a48700 1 -- 172.21.15.146:0/408429871 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4048003a60 msgr2=0x7f405c15a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:45.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.607+0000 7f4060a48700 1 --2- 172.21.15.146:0/408429871 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4048003a60 0x7f405c15a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:45.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.607+0000 7f4060a48700 1 -- 172.21.15.146:0/408429871 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f405c0ce7d0 con 0x7f405c157aa0 2023-10-06T11:18:45.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.607+0000 7f4061249700 1 --2- 172.21.15.146:0/408429871 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4048003a60 0x7f405c15a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:18:45.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.607+0000 7f4061a4a700 1 --2- 172.21.15.146:0/408429871 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f405c0c8400 0x7f405c0c8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:18:45.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.607+0000 7f4060a48700 1 --2- 172.21.15.146:0/408429871 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f405c157aa0 0x7f405c157f10 secure :-1 s=READY pgs=2194 cs=0 l=1 rev1=1 crypto rx=0x7f404c011d40 tx=0x7f404c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:45.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.607+0000 7f40517fa700 1 -- 172.21.15.146:0/408429871 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404c00fac0 con 0x7f405c157aa0 2023-10-06T11:18:45.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.607+0000 7f40517fa700 1 -- 172.21.15.146:0/408429871 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f404c00fc20 con 0x7f405c157aa0 2023-10-06T11:18:45.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.607+0000 7f40634ad700 1 -- 172.21.15.146:0/408429871 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f405c0ceab0 con 0x7f405c157aa0 2023-10-06T11:18:45.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.607+0000 7f40517fa700 1 -- 172.21.15.146:0/408429871 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404c014440 con 0x7f405c157aa0 2023-10-06T11:18:45.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.607+0000 7f40634ad700 1 -- 172.21.15.146:0/408429871 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f405c15abf0 con 0x7f405c157aa0 2023-10-06T11:18:45.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.608+0000 7f40634ad700 1 -- 172.21.15.146:0/408429871 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f405c0cefd0 con 0x7f405c157aa0 2023-10-06T11:18:45.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.608+0000 7f40517fa700 1 -- 172.21.15.146:0/408429871 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f404c014870 con 0x7f405c157aa0 2023-10-06T11:18:45.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.609+0000 7f40517fa700 1 --2- 172.21.15.146:0/408429871 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4040066f30 0x7f40400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:45.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.609+0000 7f40517fa700 1 -- 172.21.15.146:0/408429871 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f404c018030 con 0x7f405c157aa0 2023-10-06T11:18:45.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.609+0000 7f4061249700 1 --2- 172.21.15.146:0/408429871 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4040066f30 0x7f40400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:45.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.609+0000 7f4061249700 1 --2- 172.21.15.146:0/408429871 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4040066f30 0x7f40400693e0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f405800a0b0 tx=0x7f4058016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:45.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.613+0000 7f40517fa700 1 -- 172.21.15.146:0/408429871 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f405c0cefd0 con 0x7f405c157aa0 2023-10-06T11:18:45.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.797+0000 7f40634ad700 1 -- 172.21.15.146:0/408429871 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f405c04c380 con 0x7f405c157aa0 2023-10-06T11:18:45.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.801+0000 7f40517fa700 1 -- 172.21.15.146:0/408429871 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v32)=0 v32) v1 ==== 122+0+0 (secure 0 0 0) 0x7f404c052350 con 0x7f405c157aa0 2023-10-06T11:18:45.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.803+0000 7f40634ad700 1 -- 172.21.15.146:0/408429871 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4040066f30 msgr2=0x7f40400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:45.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.803+0000 7f40634ad700 1 --2- 172.21.15.146:0/408429871 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4040066f30 0x7f40400693e0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f405800a0b0 tx=0x7f4058016000 comp rx=0 tx=0).stop 2023-10-06T11:18:45.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.803+0000 7f40634ad700 1 -- 172.21.15.146:0/408429871 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f405c157aa0 msgr2=0x7f405c157f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:45.805 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.803+0000 7f40634ad700 1 --2- 172.21.15.146:0/408429871 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f405c157aa0 0x7f405c157f10 secure :-1 s=READY pgs=2194 cs=0 l=1 rev1=1 crypto rx=0x7f404c011d40 tx=0x7f404c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:18:45.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.803+0000 7f40634ad700 1 -- 172.21.15.146:0/408429871 shutdown_connections 2023-10-06T11:18:45.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.803+0000 7f40634ad700 1 --2- 172.21.15.146:0/408429871 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4040066f30 0x7f40400693e0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:45.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.803+0000 7f40634ad700 1 --2- 172.21.15.146:0/408429871 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f405c0c8400 0x7f405c0c8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:45.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.803+0000 7f40634ad700 1 --2- 172.21.15.146:0/408429871 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4048003a60 0x7f405c15a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:45.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.803+0000 7f40634ad700 1 --2- 172.21.15.146:0/408429871 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f405c157aa0 0x7f405c157f10 unknown :-1 s=CLOSED pgs=2194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:45.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.803+0000 7f40634ad700 1 -- 172.21.15.146:0/408429871 >> 172.21.15.146:0/408429871 conn(0x7f405c06eb10 msgr2=0x7f405c0cc900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:45.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.803+0000 7f40634ad700 1 -- 172.21.15.146:0/408429871 shutdown_connections 2023-10-06T11:18:45.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:45.803+0000 7f40634ad700 1 -- 172.21.15.146:0/408429871 wait complete. 2023-10-06T11:18:45.817 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T11:18:45.818 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:18:45.868 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:18:45.913 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T11:18:45.913 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T11:18:45.914 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:18:46.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.026+0000 7ff449c50700 1 Processor -- start 2023-10-06T11:18:46.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.026+0000 7ff449c50700 1 -- start start 2023-10-06T11:18:46.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.027+0000 7ff449c50700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff444143040 0x7ff4440b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:46.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.027+0000 7ff449c50700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff444143410 0x7ff4440b2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:46.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.027+0000 7ff449c50700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4440cf100 con 0x7ff4440b4d20 2023-10-06T11:18:46.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.027+0000 7ff449c50700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4440b4170 con 0x7ff444143410 2023-10-06T11:18:46.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.027+0000 7ff449c50700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4440b5f50 con 0x7ff444143040 2023-10-06T11:18:46.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.027+0000 7ff443fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff444143410 0x7ff4440b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:46.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.027+0000 7ff443fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff444143410 0x7ff4440b2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48222/0 (socket says 172.21.15.146:48222) 2023-10-06T11:18:46.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.027+0000 7ff443fff700 1 -- 172.21.15.146:0/3827173680 learned_addr learned my addr 172.21.15.146:0/3827173680 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:46.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.027+0000 7ff443fff700 1 -- 172.21.15.146:0/3827173680 >> v2:172.21.15.151:3300/0 conn(0x7ff444143040 msgr2=0x7ff4440b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:46.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.027+0000 7ff448c4e700 1 --2- 172.21.15.146:0/3827173680 >> v2:172.21.15.151:3300/0 conn(0x7ff444143040 0x7ff4440b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:46.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.027+0000 7ff443fff700 1 --2- 172.21.15.146:0/3827173680 >> v2:172.21.15.151:3300/0 conn(0x7ff444143040 0x7ff4440b1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:46.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.027+0000 7ff443fff700 1 -- 172.21.15.146:0/3827173680 >> v1:172.21.15.151:6789/0 conn(0x7ff4440b4d20 legacy=0x7ff4440b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:46.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.027+0000 7ff443fff700 1 -- 172.21.15.146:0/3827173680 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4440ceb30 con 0x7ff444143410 2023-10-06T11:18:46.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.027+0000 7ff443fff700 1 --2- 172.21.15.146:0/3827173680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff444143410 0x7ff4440b2360 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7ff44406fb40 tx=0x7ff430009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ab82d74d8815610 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:46.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.028+0000 7ff4437fe700 1 -- 172.21.15.146:0/3827173680 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43000b820 con 0x7ff444143410 2023-10-06T11:18:46.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.028+0000 7ff4437fe700 1 -- 172.21.15.146:0/3827173680 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff43000b980 con 0x7ff444143410 2023-10-06T11:18:46.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.028+0000 7ff4437fe700 1 -- 172.21.15.146:0/3827173680 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff43000bd20 con 0x7ff444143410 2023-10-06T11:18:46.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.028+0000 7ff449c50700 1 -- 172.21.15.146:0/3827173680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff444143410 msgr2=0x7ff4440b2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:46.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.028+0000 7ff449c50700 1 --2- 172.21.15.146:0/3827173680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff444143410 0x7ff4440b2360 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7ff44406fb40 tx=0x7ff430009250 comp rx=0 tx=0).stop 2023-10-06T11:18:46.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.028+0000 7ff449c50700 1 -- 172.21.15.146:0/3827173680 shutdown_connections 2023-10-06T11:18:46.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.028+0000 7ff449c50700 1 --2- 172.21.15.146:0/3827173680 >> v2:172.21.15.151:3300/0 conn(0x7ff444143040 0x7ff4440b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:46.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.028+0000 7ff449c50700 1 --2- 172.21.15.146:0/3827173680 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff444143410 0x7ff4440b2360 unknown :-1 s=CLOSED pgs=2195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:46.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.028+0000 7ff449c50700 1 -- 172.21.15.146:0/3827173680 >> 172.21.15.146:0/3827173680 conn(0x7ff44406eb10 msgr2=0x7ff44406ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:46.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.028+0000 7ff449c50700 1 -- 172.21.15.146:0/3827173680 shutdown_connections 2023-10-06T11:18:46.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.028+0000 7ff449c50700 1 -- 172.21.15.146:0/3827173680 wait complete. 2023-10-06T11:18:46.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.029+0000 7ff449c50700 1 Processor -- start 2023-10-06T11:18:46.039 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.029+0000 7ff449c50700 1 -- start start 2023-10-06T11:18:46.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.030+0000 7ff449c50700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4440b4d20 0x7ff444158b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:46.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.030+0000 7ff449c50700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff444143040 0x7ff44413be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:46.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.030+0000 7ff449c50700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff444143410 0x7ff44413c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:46.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.030+0000 7ff449c50700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff444141a20 con 0x7ff4440b4d20 2023-10-06T11:18:46.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.030+0000 7ff449c50700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff44413f540 con 0x7ff444143040 2023-10-06T11:18:46.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.030+0000 7ff449c50700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff44413ea20 con 0x7ff444143410 2023-10-06T11:18:46.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.030+0000 7ff448c4e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4440b4d20 0x7ff444158b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:46.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.030+0000 7ff448c4e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4440b4d20 0x7ff444158b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48236/0 (socket says 172.21.15.146:48236) 2023-10-06T11:18:46.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.030+0000 7ff448c4e700 1 -- 172.21.15.146:0/3233008994 learned_addr learned my addr 172.21.15.146:0/3233008994 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:46.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.030+0000 7ff44944f700 1 --2- 172.21.15.146:0/3233008994 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff444143410 0x7ff44413c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:46.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.030+0000 7ff443fff700 1 --2- 172.21.15.146:0/3233008994 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff444143040 0x7ff44413be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:46.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.030+0000 7ff448c4e700 1 -- 172.21.15.146:0/3233008994 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff444143410 msgr2=0x7ff44413c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:46.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.030+0000 7ff448c4e700 1 --2- 172.21.15.146:0/3233008994 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff444143410 0x7ff44413c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:46.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.030+0000 7ff448c4e700 1 -- 172.21.15.146:0/3233008994 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff444143040 msgr2=0x7ff44413be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:46.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.030+0000 7ff448c4e700 1 --2- 172.21.15.146:0/3233008994 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff444143040 0x7ff44413be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:46.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.030+0000 7ff448c4e700 1 -- 172.21.15.146:0/3233008994 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4300094f0 con 0x7ff4440b4d20 2023-10-06T11:18:46.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.030+0000 7ff443fff700 1 --2- 172.21.15.146:0/3233008994 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff444143040 0x7ff44413be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:18:46.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.030+0000 7ff44944f700 1 --2- 172.21.15.146:0/3233008994 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff444143410 0x7ff44413c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:18:46.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.031+0000 7ff448c4e700 1 --2- 172.21.15.146:0/3233008994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4440b4d20 0x7ff444158b80 secure :-1 s=READY pgs=2196 cs=0 l=1 rev1=1 crypto rx=0x7ff43800c7d0 tx=0x7ff438008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:46.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.031+0000 7ff440ff9700 1 -- 172.21.15.146:0/3233008994 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff438011600 con 0x7ff4440b4d20 2023-10-06T11:18:46.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.031+0000 7ff440ff9700 1 -- 172.21.15.146:0/3233008994 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff438011760 con 0x7ff4440b4d20 2023-10-06T11:18:46.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.031+0000 7ff449c50700 1 -- 172.21.15.146:0/3233008994 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff44413f130 con 0x7ff4440b4d20 2023-10-06T11:18:46.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.031+0000 7ff440ff9700 1 -- 172.21.15.146:0/3233008994 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff438011b20 con 0x7ff4440b4d20 2023-10-06T11:18:46.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.031+0000 7ff449c50700 1 -- 172.21.15.146:0/3233008994 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff44413e740 con 0x7ff4440b4d20 2023-10-06T11:18:46.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.032+0000 7ff449c50700 1 -- 172.21.15.146:0/3233008994 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff444088a80 con 0x7ff4440b4d20 2023-10-06T11:18:46.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.032+0000 7ff440ff9700 1 -- 172.21.15.146:0/3233008994 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff4380193f0 con 0x7ff4440b4d20 2023-10-06T11:18:46.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.032+0000 7ff440ff9700 1 --2- 172.21.15.146:0/3233008994 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff428066f30 0x7ff4280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:46.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.033+0000 7ff440ff9700 1 -- 172.21.15.146:0/3233008994 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5292+0+0 (secure 0 0 0) 0x7ff438084790 con 0x7ff4440b4d20 2023-10-06T11:18:46.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.033+0000 7ff443fff700 1 --2- 172.21.15.146:0/3233008994 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff428066f30 0x7ff4280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:46.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.033+0000 7ff443fff700 1 --2- 172.21.15.146:0/3233008994 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff428066f30 0x7ff4280693e0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7ff44406fb40 tx=0x7ff430016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:46.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.037+0000 7ff440ff9700 1 -- 172.21.15.146:0/3233008994 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff438051ba0 con 0x7ff4440b4d20 2023-10-06T11:18:46.266 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.264+0000 7ff449c50700 1 -- 172.21.15.146:0/3233008994 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff44404bb40 con 0x7ff4440b4d20 2023-10-06T11:18:46.267 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.265+0000 7ff440ff9700 1 -- 172.21.15.146:0/3233008994 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 138 v138) v1 ==== 95+0+3545 (secure 0 0 0) 0x7ff4380551c0 con 0x7ff4440b4d20 2023-10-06T11:18:46.267 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:18:46.267 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":138,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7694,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3150776091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3150776091},{"type":"v1","addr":"172.21.15.151:6834","nonce":3150776091}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":131},{"gid":8836,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/731448405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":731448405},{"type":"v1","addr":"172.21.15.151:6835","nonce":731448405}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":131},{"gid":10077,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/2392749618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":2392749618},{"type":"v1","addr":"172.21.15.146:6836","nonce":2392749618}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":131},{"gid":10395,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3023509582","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":3023509582},{"type":"v1","addr":"172.21.15.146:6837","nonce":3023509582}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":138}],"filesystems":[]} 2023-10-06T11:18:46.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.267+0000 7ff449c50700 1 -- 172.21.15.146:0/3233008994 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff428066f30 msgr2=0x7ff4280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:46.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.267+0000 7ff449c50700 1 --2- 172.21.15.146:0/3233008994 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff428066f30 0x7ff4280693e0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7ff44406fb40 tx=0x7ff430016000 comp rx=0 tx=0).stop 2023-10-06T11:18:46.269 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.267+0000 7ff449c50700 1 -- 172.21.15.146:0/3233008994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4440b4d20 msgr2=0x7ff444158b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:46.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.267+0000 7ff449c50700 1 --2- 172.21.15.146:0/3233008994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4440b4d20 0x7ff444158b80 secure :-1 s=READY pgs=2196 cs=0 l=1 rev1=1 crypto rx=0x7ff43800c7d0 tx=0x7ff438008040 comp rx=0 tx=0).stop 2023-10-06T11:18:46.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.267+0000 7ff449c50700 1 -- 172.21.15.146:0/3233008994 shutdown_connections 2023-10-06T11:18:46.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.267+0000 7ff449c50700 1 --2- 172.21.15.146:0/3233008994 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff428066f30 0x7ff4280693e0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:46.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.267+0000 7ff449c50700 1 --2- 172.21.15.146:0/3233008994 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff444143410 0x7ff44413c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:46.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.267+0000 7ff449c50700 1 --2- 172.21.15.146:0/3233008994 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff4440b4d20 0x7ff444158b80 unknown :-1 s=CLOSED pgs=2196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:46.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.267+0000 7ff449c50700 1 --2- 172.21.15.146:0/3233008994 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff444143040 0x7ff44413be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:46.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.267+0000 7ff449c50700 1 -- 172.21.15.146:0/3233008994 >> 172.21.15.146:0/3233008994 conn(0x7ff44406eb10 msgr2=0x7ff4440cced0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:46.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.268+0000 7ff449c50700 1 -- 172.21.15.146:0/3233008994 shutdown_connections 2023-10-06T11:18:46.270 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.268+0000 7ff449c50700 1 -- 172.21.15.146:0/3233008994 wait complete. 2023-10-06T11:18:46.271 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 138 2023-10-06T11:18:46.282 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T11:18:46.282 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T11:18:46.282 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T11:18:46.282 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:18:46.283 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T11:18:46.283 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T11:18:46.283 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T11:18:46.283 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:18:46.283 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T11:18:46.283 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T11:18:46.283 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T11:18:46.283 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:18:46.284 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T11:18:46.284 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T11:18:46.284 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T11:18:46.284 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:18:46.291 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T11:18:46.292 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T11:18:46.292 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T11:18:46.293 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T11:18:46.294 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T11:18:46.295 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T11:18:46.295 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T11:18:46.295 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T11:18:46.334 INFO:tasks.ceph.mds.a:Started 2023-10-06T11:18:46.334 DEBUG:teuthology.parallel:result is None 2023-10-06T11:18:46.335 INFO:tasks.ceph.mds.c:Started 2023-10-06T11:18:46.335 DEBUG:teuthology.parallel:result is None 2023-10-06T11:18:46.337 INFO:tasks.ceph.mds.d:Started 2023-10-06T11:18:46.337 DEBUG:teuthology.parallel:result is None 2023-10-06T11:18:46.337 INFO:tasks.ceph.mds.b:Started 2023-10-06T11:18:46.337 DEBUG:teuthology.parallel:result is None 2023-10-06T11:18:46.338 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T11:18:46.408 INFO:tasks.ceph.mds.a.smithi146.stdout:starting mds.a at 2023-10-06T11:18:46.408 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2023-10-06T11:18:46.416 INFO:tasks.ceph.mds.d.smithi151.stdout:starting mds.d at 2023-10-06T11:18:46.416 INFO:tasks.ceph.mds.b.smithi151.stdout:starting mds.b at 2023-10-06T11:18:46.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.457+0000 7f929dd9c700 1 Processor -- start 2023-10-06T11:18:46.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.457+0000 7f929dd9c700 1 -- start start 2023-10-06T11:18:46.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.458+0000 7f929dd9c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9298158620 0x7f929815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:46.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.458+0000 7f929dd9c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92980cc5b0 con 0x7f9298158250 2023-10-06T11:18:46.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.458+0000 7f929dd9c700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9298158a90 con 0x7f929815b5e0 2023-10-06T11:18:46.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.458+0000 7f929dd9c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9298157da0 con 0x7f9298158620 2023-10-06T11:18:46.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.458+0000 7f929cd9a700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f9298158250 0x7f9298158c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40230/0 (socket says 172.21.15.146:40230) 2023-10-06T11:18:46.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.458+0000 7f929cd9a700 1 -- 172.21.15.146:0/1106955986 learned_addr learned my addr 172.21.15.146:0/1106955986 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:46.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.458+0000 7f928ffff700 1 --2- 172.21.15.146:0/1106955986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9298158620 0x7f929815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:46.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.458+0000 7f928f7fe700 1 -- 172.21.15.146:0/1106955986 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3861227305 0 0) 0x7f92980cc5b0 con 0x7f9298158250 2023-10-06T11:18:46.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.459+0000 7f928f7fe700 1 -- 172.21.15.146:0/1106955986 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9280003570 con 0x7f9298158250 2023-10-06T11:18:46.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.459+0000 7f928f7fe700 1 -- 172.21.15.146:0/1106955986 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2400750284 0 0) 0x7f9298158a90 con 0x7f929815b5e0 2023-10-06T11:18:46.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.459+0000 7f928f7fe700 1 -- 172.21.15.146:0/1106955986 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92980cc5b0 con 0x7f929815b5e0 2023-10-06T11:18:46.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.459+0000 7f928ffff700 1 -- 172.21.15.146:0/1106955986 >> v1:172.21.15.151:6789/0 conn(0x7f929815b5e0 legacy=0x7f92980ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:46.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.459+0000 7f928ffff700 1 -- 172.21.15.146:0/1106955986 >> v1:172.21.15.146:6789/0 conn(0x7f9298158250 legacy=0x7f9298158c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:46.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.459+0000 7f928ffff700 1 -- 172.21.15.146:0/1106955986 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f929815bb60 con 0x7f9298158620 2023-10-06T11:18:46.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.459+0000 7f928ffff700 1 --2- 172.21.15.146:0/1106955986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9298158620 0x7f929815b0a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9288009910 tx=0x7f92880091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=690973b632f3070 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:46.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.459+0000 7f928f7fe700 1 -- 172.21.15.146:0/1106955986 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9288011630 con 0x7f9298158620 2023-10-06T11:18:46.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.459+0000 7f928f7fe700 1 -- 172.21.15.146:0/1106955986 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9288011790 con 0x7f9298158620 2023-10-06T11:18:46.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.459+0000 7f928f7fe700 1 -- 172.21.15.146:0/1106955986 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9288011b30 con 0x7f9298158620 2023-10-06T11:18:46.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.459+0000 7f929dd9c700 1 -- 172.21.15.146:0/1106955986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9298158620 msgr2=0x7f929815b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:46.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.459+0000 7f929dd9c700 1 --2- 172.21.15.146:0/1106955986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9298158620 0x7f929815b0a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9288009910 tx=0x7f92880091a0 comp rx=0 tx=0).stop 2023-10-06T11:18:46.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.460+0000 7f929dd9c700 1 -- 172.21.15.146:0/1106955986 shutdown_connections 2023-10-06T11:18:46.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.460+0000 7f929dd9c700 1 --2- 172.21.15.146:0/1106955986 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9298158620 0x7f929815b0a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:46.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.460+0000 7f929dd9c700 1 -- 172.21.15.146:0/1106955986 >> 172.21.15.146:0/1106955986 conn(0x7f929806b2a0 msgr2=0x7f929806b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:46.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.460+0000 7f929dd9c700 1 -- 172.21.15.146:0/1106955986 shutdown_connections 2023-10-06T11:18:46.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.460+0000 7f929dd9c700 1 -- 172.21.15.146:0/1106955986 wait complete. 2023-10-06T11:18:46.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.461+0000 7f929dd9c700 1 Processor -- start 2023-10-06T11:18:46.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.461+0000 7f929dd9c700 1 -- start start 2023-10-06T11:18:46.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.462+0000 7f929dd9c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9298158250 0x7f92981491d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:46.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.462+0000 7f929dd9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9298158620 0x7f92980c73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:46.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.462+0000 7f929dd9c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f929815b5e0 0x7f92980aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:46.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.462+0000 7f929dd9c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92980c3d50 con 0x7f9298158250 2023-10-06T11:18:46.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.462+0000 7f929dd9c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92980c3180 con 0x7f9298158620 2023-10-06T11:18:46.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.462+0000 7f929dd9c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92980c3420 con 0x7f929815b5e0 2023-10-06T11:18:46.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.462+0000 7f929cd9a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9298158250 0x7f92981491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:46.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.462+0000 7f929cd9a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9298158250 0x7f92981491d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48258/0 (socket says 172.21.15.146:48258) 2023-10-06T11:18:46.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.462+0000 7f929cd9a700 1 -- 172.21.15.146:0/4034641137 learned_addr learned my addr 172.21.15.146:0/4034641137 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:46.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.462+0000 7f928ffff700 1 --2- 172.21.15.146:0/4034641137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9298158620 0x7f92980c73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:46.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.462+0000 7f929d59b700 1 --2- 172.21.15.146:0/4034641137 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f929815b5e0 0x7f92980aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:46.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.462+0000 7f929cd9a700 1 -- 172.21.15.146:0/4034641137 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f929815b5e0 msgr2=0x7f92980aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:46.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.462+0000 7f929cd9a700 1 --2- 172.21.15.146:0/4034641137 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f929815b5e0 0x7f92980aebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:46.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.462+0000 7f929cd9a700 1 -- 172.21.15.146:0/4034641137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9298158620 msgr2=0x7f92980c73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:46.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.462+0000 7f929cd9a700 1 --2- 172.21.15.146:0/4034641137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9298158620 0x7f92980c73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:46.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.462+0000 7f929cd9a700 1 -- 172.21.15.146:0/4034641137 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9288009420 con 0x7f9298158250 2023-10-06T11:18:46.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.462+0000 7f929cd9a700 1 --2- 172.21.15.146:0/4034641137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9298158250 0x7f92981491d0 secure :-1 s=READY pgs=2203 cs=0 l=1 rev1=1 crypto rx=0x7f929400c790 tx=0x7f9294007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:46.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.462+0000 7f928cff9700 1 -- 172.21.15.146:0/4034641137 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9294005b30 con 0x7f9298158250 2023-10-06T11:18:46.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.462+0000 7f928cff9700 1 -- 172.21.15.146:0/4034641137 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9294005c90 con 0x7f9298158250 2023-10-06T11:18:46.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.462+0000 7f928cff9700 1 -- 172.21.15.146:0/4034641137 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9294007300 con 0x7f9298158250 2023-10-06T11:18:46.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.462+0000 7f929dd9c700 1 -- 172.21.15.146:0/4034641137 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92980c3700 con 0x7f9298158250 2023-10-06T11:18:46.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.462+0000 7f929dd9c700 1 -- 172.21.15.146:0/4034641137 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92981543d0 con 0x7f9298158250 2023-10-06T11:18:46.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.463+0000 7f929dd9c700 1 -- 172.21.15.146:0/4034641137 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92980c3ba0 con 0x7f9298158250 2023-10-06T11:18:46.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.464+0000 7f928cff9700 1 -- 172.21.15.146:0/4034641137 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f929401b3b0 con 0x7f9298158250 2023-10-06T11:18:46.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.464+0000 7f928cff9700 1 --2- 172.21.15.146:0/4034641137 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9284066f30 0x7f92840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:46.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.464+0000 7f928cff9700 1 -- 172.21.15.146:0/4034641137 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f92940837e0 con 0x7f9298158250 2023-10-06T11:18:46.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.464+0000 7f928ffff700 1 --2- 172.21.15.146:0/4034641137 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9284066f30 0x7f92840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:46.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.464+0000 7f928ffff700 1 --2- 172.21.15.146:0/4034641137 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9284066f30 0x7f92840693e0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f9288009860 tx=0x7f9288017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:46.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.468+0000 7f928cff9700 1 -- 172.21.15.146:0/4034641137 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9294054680 con 0x7f9298158250 2023-10-06T11:18:46.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:46.666+0000 7f929dd9c700 1 -- 172.21.15.146:0/4034641137 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f929804bb40 con 0x7f9298158250 2023-10-06T11:18:47.483 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.481+0000 7f928cff9700 1 -- 172.21.15.146:0/4034641137 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v173) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9294017020 con 0x7f9298158250 2023-10-06T11:18:47.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.484+0000 7f929dd9c700 1 -- 172.21.15.146:0/4034641137 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9284066f30 msgr2=0x7f92840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:47.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.484+0000 7f929dd9c700 1 --2- 172.21.15.146:0/4034641137 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9284066f30 0x7f92840693e0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f9288009860 tx=0x7f9288017000 comp rx=0 tx=0).stop 2023-10-06T11:18:47.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.484+0000 7f929dd9c700 1 -- 172.21.15.146:0/4034641137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9298158250 msgr2=0x7f92981491d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:47.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.484+0000 7f929dd9c700 1 --2- 172.21.15.146:0/4034641137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9298158250 0x7f92981491d0 secure :-1 s=READY pgs=2203 cs=0 l=1 rev1=1 crypto rx=0x7f929400c790 tx=0x7f9294007ea0 comp rx=0 tx=0).stop 2023-10-06T11:18:47.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.484+0000 7f929dd9c700 1 -- 172.21.15.146:0/4034641137 shutdown_connections 2023-10-06T11:18:47.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.484+0000 7f929dd9c700 1 --2- 172.21.15.146:0/4034641137 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9284066f30 0x7f92840693e0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:47.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.484+0000 7f929dd9c700 1 --2- 172.21.15.146:0/4034641137 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f929815b5e0 0x7f92980aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:47.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.484+0000 7f929dd9c700 1 --2- 172.21.15.146:0/4034641137 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9298158250 0x7f92981491d0 unknown :-1 s=CLOSED pgs=2203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:47.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.484+0000 7f929dd9c700 1 --2- 172.21.15.146:0/4034641137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9298158620 0x7f92980c73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:47.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.484+0000 7f929dd9c700 1 -- 172.21.15.146:0/4034641137 >> 172.21.15.146:0/4034641137 conn(0x7f929806b2a0 msgr2=0x7f9298154ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:47.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.484+0000 7f929dd9c700 1 -- 172.21.15.146:0/4034641137 shutdown_connections 2023-10-06T11:18:47.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.484+0000 7f929dd9c700 1 -- 172.21.15.146:0/4034641137 wait complete. 2023-10-06T11:18:47.487 INFO:teuthology.orchestra.run.smithi146.stderr: removed all blocklist entries 2023-10-06T11:18:47.499 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T11:18:47.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.612+0000 7ff8ef3be700 1 Processor -- start 2023-10-06T11:18:47.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.612+0000 7ff8ef3be700 1 -- start start 2023-10-06T11:18:47.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.613+0000 7ff8ef3be700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff8e815a940 0x7ff8e8153c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:47.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.613+0000 7ff8ef3be700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff8e815dcc0 0x7ff8e80ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:47.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.613+0000 7ff8ef3be700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8e815d270 con 0x7ff8e81538c0 2023-10-06T11:18:47.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.613+0000 7ff8ef3be700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8e815d830 con 0x7ff8e815dcc0 2023-10-06T11:18:47.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.613+0000 7ff8ef3be700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8e815e110 con 0x7ff8e815a940 2023-10-06T11:18:47.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.613+0000 7ff8ed95b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff8e815dcc0 0x7ff8e80ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:47.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.613+0000 7ff8ed15a700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff8e81538c0 0x7ff8e80cac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40234/0 (socket says 172.21.15.146:40234) 2023-10-06T11:18:47.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.613+0000 7ff8ed95b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff8e815dcc0 0x7ff8e80ce610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48268/0 (socket says 172.21.15.146:48268) 2023-10-06T11:18:47.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.613+0000 7ff8ed15a700 1 -- 172.21.15.146:0/1495921221 learned_addr learned my addr 172.21.15.146:0/1495921221 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:47.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.613+0000 7ff8ec959700 1 --2- 172.21.15.146:0/1495921221 >> v2:172.21.15.151:3300/0 conn(0x7ff8e815a940 0x7ff8e8153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:47.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.614+0000 7ff8ed95b700 1 -- 172.21.15.146:0/1495921221 >> v2:172.21.15.151:3300/0 conn(0x7ff8e815a940 msgr2=0x7ff8e8153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:47.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.614+0000 7ff8ed95b700 1 --2- 172.21.15.146:0/1495921221 >> v2:172.21.15.151:3300/0 conn(0x7ff8e815a940 0x7ff8e8153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:47.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.614+0000 7ff8ed95b700 1 -- 172.21.15.146:0/1495921221 >> v1:172.21.15.146:6789/0 conn(0x7ff8e81538c0 legacy=0x7ff8e80cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:47.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.614+0000 7ff8ed95b700 1 -- 172.21.15.146:0/1495921221 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e80cb810 con 0x7ff8e815dcc0 2023-10-06T11:18:47.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.614+0000 7ff8e7fff700 1 -- 172.21.15.146:0/1495921221 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2184771331 0 0) 0x7ff8e815d270 con 0x7ff8e81538c0 2023-10-06T11:18:47.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.614+0000 7ff8ed95b700 1 --2- 172.21.15.146:0/1495921221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8e815dcc0 0x7ff8e80ce610 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7ff8e80ce180 tx=0x7ff8e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12ab416787f93338 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:47.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.614+0000 7ff8e7fff700 1 -- 172.21.15.146:0/1495921221 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e000b6b0 con 0x7ff8e815dcc0 2023-10-06T11:18:47.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.614+0000 7ff8e7fff700 1 -- 172.21.15.146:0/1495921221 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e000b810 con 0x7ff8e815dcc0 2023-10-06T11:18:47.625 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.614+0000 7ff8e7fff700 1 -- 172.21.15.146:0/1495921221 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e000bbb0 con 0x7ff8e815dcc0 2023-10-06T11:18:47.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.614+0000 7ff8ef3be700 1 -- 172.21.15.146:0/1495921221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8e815dcc0 msgr2=0x7ff8e80ce610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:47.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.614+0000 7ff8ef3be700 1 --2- 172.21.15.146:0/1495921221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8e815dcc0 0x7ff8e80ce610 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7ff8e80ce180 tx=0x7ff8e00091a0 comp rx=0 tx=0).stop 2023-10-06T11:18:47.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.614+0000 7ff8ef3be700 1 -- 172.21.15.146:0/1495921221 shutdown_connections 2023-10-06T11:18:47.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.614+0000 7ff8ef3be700 1 --2- 172.21.15.146:0/1495921221 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8e815dcc0 0x7ff8e80ce610 unknown :-1 s=CLOSED pgs=2205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:47.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.614+0000 7ff8ef3be700 1 --2- 172.21.15.146:0/1495921221 >> v2:172.21.15.151:3300/0 conn(0x7ff8e815a940 0x7ff8e8153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:47.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.614+0000 7ff8ef3be700 1 -- 172.21.15.146:0/1495921221 >> 172.21.15.146:0/1495921221 conn(0x7ff8e806eb10 msgr2=0x7ff8e806ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:47.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.615+0000 7ff8ef3be700 1 -- 172.21.15.146:0/1495921221 shutdown_connections 2023-10-06T11:18:47.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.615+0000 7ff8ef3be700 1 -- 172.21.15.146:0/1495921221 wait complete. 2023-10-06T11:18:47.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.616+0000 7ff8ef3be700 1 Processor -- start 2023-10-06T11:18:47.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.616+0000 7ff8ef3be700 1 -- start start 2023-10-06T11:18:47.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.616+0000 7ff8ef3be700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8e81538c0 0x7ff8e80c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:47.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.616+0000 7ff8ef3be700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8e815a940 0x7ff8e80b4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:47.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.616+0000 7ff8ef3be700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8e815dcc0 0x7ff8e80c95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:47.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.616+0000 7ff8ef3be700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e80c8ab0 con 0x7ff8e815a940 2023-10-06T11:18:47.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.616+0000 7ff8ef3be700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e80b4cd0 con 0x7ff8e81538c0 2023-10-06T11:18:47.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.616+0000 7ff8ef3be700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e80b4f70 con 0x7ff8e815dcc0 2023-10-06T11:18:47.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.617+0000 7ff8ec959700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8e815a940 0x7ff8e80b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:47.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.617+0000 7ff8ec959700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8e815a940 0x7ff8e80b4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48274/0 (socket says 172.21.15.146:48274) 2023-10-06T11:18:47.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.617+0000 7ff8ec959700 1 -- 172.21.15.146:0/3422268598 learned_addr learned my addr 172.21.15.146:0/3422268598 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:47.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.617+0000 7ff8ed15a700 1 --2- 172.21.15.146:0/3422268598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8e81538c0 0x7ff8e80c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:47.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.617+0000 7ff8ed95b700 1 --2- 172.21.15.146:0/3422268598 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8e815dcc0 0x7ff8e80c95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:47.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.617+0000 7ff8ec959700 1 -- 172.21.15.146:0/3422268598 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8e815dcc0 msgr2=0x7ff8e80c95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:47.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.617+0000 7ff8ec959700 1 --2- 172.21.15.146:0/3422268598 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8e815dcc0 0x7ff8e80c95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:47.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.617+0000 7ff8ec959700 1 -- 172.21.15.146:0/3422268598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8e81538c0 msgr2=0x7ff8e80c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:47.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.617+0000 7ff8ec959700 1 --2- 172.21.15.146:0/3422268598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8e81538c0 0x7ff8e80c8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:47.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.617+0000 7ff8ec959700 1 -- 172.21.15.146:0/3422268598 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e0009420 con 0x7ff8e815a940 2023-10-06T11:18:47.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.617+0000 7ff8ec959700 1 --2- 172.21.15.146:0/3422268598 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8e815a940 0x7ff8e80b4790 secure :-1 s=READY pgs=2206 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc00d890 tx=0x7ff8dc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:47.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.617+0000 7ff8e57fa700 1 -- 172.21.15.146:0/3422268598 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc0125f0 con 0x7ff8e815a940 2023-10-06T11:18:47.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.617+0000 7ff8e57fa700 1 -- 172.21.15.146:0/3422268598 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8dc012750 con 0x7ff8e815a940 2023-10-06T11:18:47.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.617+0000 7ff8ef3be700 1 -- 172.21.15.146:0/3422268598 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8e80b5250 con 0x7ff8e815a940 2023-10-06T11:18:47.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.617+0000 7ff8e57fa700 1 -- 172.21.15.146:0/3422268598 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc012ad0 con 0x7ff8e815a940 2023-10-06T11:18:47.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.617+0000 7ff8ef3be700 1 -- 172.21.15.146:0/3422268598 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8e80b55e0 con 0x7ff8e815a940 2023-10-06T11:18:47.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.618+0000 7ff8ef3be700 1 -- 172.21.15.146:0/3422268598 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8e804c380 con 0x7ff8e815a940 2023-10-06T11:18:47.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.618+0000 7ff8e57fa700 1 -- 172.21.15.146:0/3422268598 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff8dc01e460 con 0x7ff8e815a940 2023-10-06T11:18:47.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.619+0000 7ff8e57fa700 1 --2- 172.21.15.146:0/3422268598 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff8d4066f30 0x7ff8d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:47.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.619+0000 7ff8e57fa700 1 -- 172.21.15.146:0/3422268598 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5206+0+0 (secure 0 0 0) 0x7ff8dc084930 con 0x7ff8e815a940 2023-10-06T11:18:47.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.619+0000 7ff8ed15a700 1 --2- 172.21.15.146:0/3422268598 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff8d4066f30 0x7ff8d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:47.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.619+0000 7ff8ed15a700 1 --2- 172.21.15.146:0/3422268598 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff8d4066f30 0x7ff8d40693e0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8007240 tx=0x7ff8d8001970 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:47.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.623+0000 7ff8e57fa700 1 -- 172.21.15.146:0/3422268598 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff8dc051d90 con 0x7ff8e815a940 2023-10-06T11:18:47.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.881+0000 7ff8ef3be700 1 -- 172.21.15.146:0/3422268598 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff8e80cbaf0 con 0x7ff8e815a940 2023-10-06T11:18:47.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.881+0000 7ff8e57fa700 1 -- 172.21.15.146:0/3422268598 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v25) v1 ==== 80+0+5304 (secure 0 0 0) 0x7ff8dc0553b0 con 0x7ff8e815a940 2023-10-06T11:18:47.883 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:18:47.883 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:18:47.884 INFO:teuthology.orchestra.run.smithi146.stdout: "auth_dump": [ 2023-10-06T11:18:47.884 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:18:47.884 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.a", 2023-10-06T11:18:47.884 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lG4F8DBAAp5A4Dtfzvv8n9ORgkmiP9g==", 2023-10-06T11:18:47.884 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:18:47.884 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:18:47.884 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:18:47.884 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:18:47.884 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:18:47.884 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:18:47.884 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:18:47.884 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:18:47.885 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.b", 2023-10-06T11:18:47.885 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lDIceGBAA4cr0oGVaXiy5hrruKY5DGw==", 2023-10-06T11:18:47.885 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:18:47.885 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:18:47.885 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:18:47.885 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:18:47.885 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:18:47.885 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:18:47.885 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:18:47.885 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:18:47.885 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.c", 2023-10-06T11:18:47.885 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lbYA7ExAAAopKjS7+WMUE5fuVQygILQ==", 2023-10-06T11:18:47.886 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:18:47.886 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:18:47.886 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:18:47.886 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:18:47.886 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:18:47.886 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:18:47.886 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:18:47.886 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:18:47.886 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mds.d", 2023-10-06T11:18:47.886 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9laygiHxAAasUUn7Wk9EwLa36ggsZtHw==", 2023-10-06T11:18:47.886 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:18:47.886 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:18:47.887 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:18:47.887 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:18:47.887 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:18:47.887 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:18:47.887 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:18:47.887 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:18:47.887 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.0", 2023-10-06T11:18:47.887 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDX6R9lLGo9NhAAcWJuUeOdEUsdDw84W9nLPw==", 2023-10-06T11:18:47.887 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:18:47.887 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:18:47.888 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:18:47.888 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:18:47.888 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:18:47.888 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:18:47.888 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:18:47.888 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.1", 2023-10-06T11:18:47.888 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDa6R9lk02gNBAA9YqWT2/Xds20lv0sGtBApg==", 2023-10-06T11:18:47.888 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:18:47.888 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:18:47.888 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:18:47.888 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:18:47.888 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:18:47.889 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:18:47.889 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:18:47.889 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.2", 2023-10-06T11:18:47.889 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDd6R9lrA6xMxAAmH8r6m2p4Jpa82xfYNcq+g==", 2023-10-06T11:18:47.889 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:18:47.889 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:18:47.889 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:18:47.889 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:18:47.889 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:18:47.889 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:18:47.889 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:18:47.889 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.3", 2023-10-06T11:18:47.889 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDg6R9ltlHXNBAAvhfI1yjlaWCIE9Xr/4F/PA==", 2023-10-06T11:18:47.890 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:18:47.890 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:18:47.890 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:18:47.890 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:18:47.890 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:18:47.890 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:18:47.890 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:18:47.890 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.4", 2023-10-06T11:18:47.890 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDm6R9lPUCvMhAAGbUNfpoFi9SvYdelpnL1jA==", 2023-10-06T11:18:47.890 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:18:47.890 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:18:47.890 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:18:47.891 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:18:47.891 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:18:47.891 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:18:47.891 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:18:47.891 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.5", 2023-10-06T11:18:47.891 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDp6R9lMfrMMBAAUEtnXDNr7+L3dQm4QE9qDw==", 2023-10-06T11:18:47.891 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:18:47.891 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:18:47.891 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:18:47.891 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:18:47.891 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:18:47.891 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:18:47.892 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:18:47.892 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.6", 2023-10-06T11:18:47.892 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDs6R9lAmSDMBAArPp+6dVt/NyH9is46tL49g==", 2023-10-06T11:18:47.892 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:18:47.892 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:18:47.892 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:18:47.892 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:18:47.892 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:18:47.892 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:18:47.892 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:18:47.892 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "osd.7", 2023-10-06T11:18:47.892 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDv6R9lnunMLRAA3o5ZtAyYDUoXTzjX9H8FCw==", 2023-10-06T11:18:47.892 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:18:47.893 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow profile osd", 2023-10-06T11:18:47.893 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile osd", 2023-10-06T11:18:47.893 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:18:47.893 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:18:47.893 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:18:47.893 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:18:47.893 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.0", 2023-10-06T11:18:47.893 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lCrPrIhAARrzj2VxVFkzF5L/ifIAqmw==", 2023-10-06T11:18:47.893 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:18:47.893 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:18:47.893 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow r", 2023-10-06T11:18:47.893 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-06T11:18:47.894 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:18:47.894 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:18:47.894 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:18:47.894 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.1", 2023-10-06T11:18:47.894 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9l10VSKxAA0HmXejgRRCQ7XpsMB7ljkQ==", 2023-10-06T11:18:47.894 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:18:47.894 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:18:47.894 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2023-10-06T11:18:47.894 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2023-10-06T11:18:47.895 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2023-10-06T11:18:47.895 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:18:47.895 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:18:47.895 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:18:47.895 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.2", 2023-10-06T11:18:47.895 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9lpLpJKBAAF/vLDkBg9/VBqMK4pVVIkg==", 2023-10-06T11:18:47.895 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:18:47.895 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:18:47.895 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2023-10-06T11:18:47.895 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2023-10-06T11:18:47.895 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2023-10-06T11:18:47.895 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:18:47.896 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:18:47.896 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:18:47.896 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.3", 2023-10-06T11:18:47.896 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9luMqwMBAA4Y4I9hWTk2IqAzYwVQ13Pw==", 2023-10-06T11:18:47.896 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:18:47.896 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow", 2023-10-06T11:18:47.896 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow r", 2023-10-06T11:18:47.896 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow rw", 2023-10-06T11:18:47.896 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow rwx" 2023-10-06T11:18:47.896 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:18:47.896 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:18:47.896 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:18:47.897 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "client.admin", 2023-10-06T11:18:47.897 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDT6R9lSr9qIhAAiNEN9xFWUwFGsB+oUE1cXw==", 2023-10-06T11:18:47.897 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:18:47.897 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2023-10-06T11:18:47.897 INFO:teuthology.orchestra.run.smithi146.stdout: "mgr": "allow *", 2023-10-06T11:18:47.897 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow *", 2023-10-06T11:18:47.897 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:18:47.897 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:18:47.897 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:18:47.897 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:18:47.897 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.x", 2023-10-06T11:18:47.897 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDU6R9llLpwCRAA4UH9Uqli2de9HIJR2fZ9xg==", 2023-10-06T11:18:47.897 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:18:47.898 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2023-10-06T11:18:47.898 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2023-10-06T11:18:47.898 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:18:47.898 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:18:47.898 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:18:47.898 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:18:47.898 INFO:teuthology.orchestra.run.smithi146.stdout: "entity": "mgr.y", 2023-10-06T11:18:47.898 INFO:teuthology.orchestra.run.smithi146.stdout: "key": "AQDT6R9l2uQxNxAAVSMhKVzbf2vC4opL7YCLdg==", 2023-10-06T11:18:47.898 INFO:teuthology.orchestra.run.smithi146.stdout: "caps": { 2023-10-06T11:18:47.898 INFO:teuthology.orchestra.run.smithi146.stdout: "mds": "allow *", 2023-10-06T11:18:47.898 INFO:teuthology.orchestra.run.smithi146.stdout: "mon": "allow profile mgr", 2023-10-06T11:18:47.898 INFO:teuthology.orchestra.run.smithi146.stdout: "osd": "allow *" 2023-10-06T11:18:47.899 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:18:47.899 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:18:47.899 INFO:teuthology.orchestra.run.smithi146.stdout: ] 2023-10-06T11:18:47.899 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:18:47.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.883+0000 7ff8ef3be700 1 -- 172.21.15.146:0/3422268598 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff8d4066f30 msgr2=0x7ff8d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:47.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.883+0000 7ff8ef3be700 1 --2- 172.21.15.146:0/3422268598 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff8d4066f30 0x7ff8d40693e0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7ff8d8007240 tx=0x7ff8d8001970 comp rx=0 tx=0).stop 2023-10-06T11:18:47.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.883+0000 7ff8ef3be700 1 -- 172.21.15.146:0/3422268598 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8e815a940 msgr2=0x7ff8e80b4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:47.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.883+0000 7ff8ef3be700 1 --2- 172.21.15.146:0/3422268598 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8e815a940 0x7ff8e80b4790 secure :-1 s=READY pgs=2206 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc00d890 tx=0x7ff8dc008040 comp rx=0 tx=0).stop 2023-10-06T11:18:47.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.884+0000 7ff8ef3be700 1 -- 172.21.15.146:0/3422268598 shutdown_connections 2023-10-06T11:18:47.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.884+0000 7ff8ef3be700 1 --2- 172.21.15.146:0/3422268598 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff8d4066f30 0x7ff8d40693e0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:47.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.884+0000 7ff8ef3be700 1 --2- 172.21.15.146:0/3422268598 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8e815dcc0 0x7ff8e80c95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:47.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.884+0000 7ff8ef3be700 1 --2- 172.21.15.146:0/3422268598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8e81538c0 0x7ff8e80c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:47.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.884+0000 7ff8ef3be700 1 --2- 172.21.15.146:0/3422268598 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8e815a940 0x7ff8e80b4790 unknown :-1 s=CLOSED pgs=2206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:47.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.884+0000 7ff8ef3be700 1 -- 172.21.15.146:0/3422268598 >> 172.21.15.146:0/3422268598 conn(0x7ff8e806eb10 msgr2=0x7ff8e80c6b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:47.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.884+0000 7ff8ef3be700 1 -- 172.21.15.146:0/3422268598 shutdown_connections 2023-10-06T11:18:47.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:47.884+0000 7ff8ef3be700 1 -- 172.21.15.146:0/3422268598 wait complete. 2023-10-06T11:18:47.902 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:18:48.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.014+0000 7f6d4e950700 1 Processor -- start 2023-10-06T11:18:48.016 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.015+0000 7f6d4e950700 1 -- start start 2023-10-06T11:18:48.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.015+0000 7f6d4e950700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d480cd480 0x7f6d4815abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:48.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.015+0000 7f6d4e950700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6d480b09f0 0x7f6d480b0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:48.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.015+0000 7f6d4e950700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d480b6070 con 0x7f6d480cd0b0 2023-10-06T11:18:48.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.015+0000 7f6d4e950700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d480b0280 con 0x7f6d480b09f0 2023-10-06T11:18:48.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.015+0000 7f6d4e950700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4815ddf0 con 0x7f6d480cd480 2023-10-06T11:18:48.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.016+0000 7f6d4ceed700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6d480b09f0 0x7f6d480b0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:48.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.016+0000 7f6d47fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6d480cd0b0 0x7f6d4815d610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40238/0 (socket says 172.21.15.146:40238) 2023-10-06T11:18:48.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.016+0000 7f6d47fff700 1 -- 172.21.15.146:0/872486568 learned_addr learned my addr 172.21.15.146:0/872486568 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:48.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.016+0000 7f6d477fe700 1 --2- 172.21.15.146:0/872486568 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d480cd480 0x7f6d4815abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:48.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.016+0000 7f6d4ceed700 1 -- 172.21.15.146:0/872486568 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d480cd480 msgr2=0x7f6d4815abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:48.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.016+0000 7f6d4ceed700 1 --2- 172.21.15.146:0/872486568 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d480cd480 0x7f6d4815abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:48.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.016+0000 7f6d4ceed700 1 -- 172.21.15.146:0/872486568 >> v1:172.21.15.146:6789/0 conn(0x7f6d480cd0b0 legacy=0x7f6d4815d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:48.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.016+0000 7f6d46ffd700 1 -- 172.21.15.146:0/872486568 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1375264728 0 0) 0x7f6d480b6070 con 0x7f6d480cd0b0 2023-10-06T11:18:48.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.016+0000 7f6d4ceed700 1 -- 172.21.15.146:0/872486568 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d4815e0d0 con 0x7f6d480b09f0 2023-10-06T11:18:48.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.016+0000 7f6d477fe700 1 --2- 172.21.15.146:0/872486568 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d480cd480 0x7f6d4815abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:18:48.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.016+0000 7f6d4ceed700 1 --2- 172.21.15.146:0/872486568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d480b09f0 0x7f6d480b0e10 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 crypto rx=0x7f6d40009e60 tx=0x7f6d40009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b449c51ddd5801a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:48.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.016+0000 7f6d46ffd700 1 -- 172.21.15.146:0/872486568 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4000e070 con 0x7f6d480b09f0 2023-10-06T11:18:48.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.016+0000 7f6d46ffd700 1 -- 172.21.15.146:0/872486568 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4000bc30 con 0x7f6d480b09f0 2023-10-06T11:18:48.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.016+0000 7f6d46ffd700 1 -- 172.21.15.146:0/872486568 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d40012430 con 0x7f6d480b09f0 2023-10-06T11:18:48.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.017+0000 7f6d4e950700 1 -- 172.21.15.146:0/872486568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d480b09f0 msgr2=0x7f6d480b0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:48.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.017+0000 7f6d4e950700 1 --2- 172.21.15.146:0/872486568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d480b09f0 0x7f6d480b0e10 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 crypto rx=0x7f6d40009e60 tx=0x7f6d40009780 comp rx=0 tx=0).stop 2023-10-06T11:18:48.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.017+0000 7f6d4e950700 1 -- 172.21.15.146:0/872486568 shutdown_connections 2023-10-06T11:18:48.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.017+0000 7f6d4e950700 1 --2- 172.21.15.146:0/872486568 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d480b09f0 0x7f6d480b0e10 unknown :-1 s=CLOSED pgs=2208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:48.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.017+0000 7f6d4e950700 1 --2- 172.21.15.146:0/872486568 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d480cd480 0x7f6d4815abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:48.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.017+0000 7f6d4e950700 1 -- 172.21.15.146:0/872486568 >> 172.21.15.146:0/872486568 conn(0x7f6d4806eb10 msgr2=0x7f6d4806ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:48.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.017+0000 7f6d4e950700 1 -- 172.21.15.146:0/872486568 shutdown_connections 2023-10-06T11:18:48.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.017+0000 7f6d4e950700 1 -- 172.21.15.146:0/872486568 wait complete. 2023-10-06T11:18:48.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.018+0000 7f6d4e950700 1 Processor -- start 2023-10-06T11:18:48.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.018+0000 7f6d4e950700 1 -- start start 2023-10-06T11:18:48.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.019+0000 7f6d4e950700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d480b09f0 0x7f6d480c9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:48.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.019+0000 7f6d4e950700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d480cd0b0 0x7f6d48152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:48.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.019+0000 7f6d4e950700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d480cd480 0x7f6d480d0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:48.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.019+0000 7f6d4e950700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d48155c40 con 0x7f6d480cd480 2023-10-06T11:18:48.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.019+0000 7f6d4e950700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d48155680 con 0x7f6d480b09f0 2023-10-06T11:18:48.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.019+0000 7f6d4e950700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d48155960 con 0x7f6d480cd0b0 2023-10-06T11:18:48.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.019+0000 7f6d4ceed700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d480cd480 0x7f6d480d0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:48.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.019+0000 7f6d4ceed700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d480cd480 0x7f6d480d0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48298/0 (socket says 172.21.15.146:48298) 2023-10-06T11:18:48.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.019+0000 7f6d4ceed700 1 -- 172.21.15.146:0/3547954624 learned_addr learned my addr 172.21.15.146:0/3547954624 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:48.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.019+0000 7f6d47fff700 1 --2- 172.21.15.146:0/3547954624 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d480b09f0 0x7f6d480c9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:48.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.019+0000 7f6d477fe700 1 --2- 172.21.15.146:0/3547954624 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d480cd0b0 0x7f6d48152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:48.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.019+0000 7f6d4ceed700 1 -- 172.21.15.146:0/3547954624 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d480cd0b0 msgr2=0x7f6d48152a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:48.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.019+0000 7f6d4ceed700 1 --2- 172.21.15.146:0/3547954624 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d480cd0b0 0x7f6d48152a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:48.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.019+0000 7f6d4ceed700 1 -- 172.21.15.146:0/3547954624 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d480b09f0 msgr2=0x7f6d480c9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:48.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.019+0000 7f6d4ceed700 1 --2- 172.21.15.146:0/3547954624 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d480b09f0 0x7f6d480c9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:48.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.019+0000 7f6d4ceed700 1 -- 172.21.15.146:0/3547954624 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d40009a20 con 0x7f6d480cd480 2023-10-06T11:18:48.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.019+0000 7f6d47fff700 1 --2- 172.21.15.146:0/3547954624 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d480b09f0 0x7f6d480c9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:18:48.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.019+0000 7f6d4ceed700 1 --2- 172.21.15.146:0/3547954624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d480cd480 0x7f6d480d0190 secure :-1 s=READY pgs=2209 cs=0 l=1 rev1=1 crypto rx=0x7f6d400097c0 tx=0x7f6d40019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:48.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.019+0000 7f6d2ffff700 1 -- 172.21.15.146:0/3547954624 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d40012e50 con 0x7f6d480cd480 2023-10-06T11:18:48.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.020+0000 7f6d2ffff700 1 -- 172.21.15.146:0/3547954624 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d4001d630 con 0x7f6d480cd480 2023-10-06T11:18:48.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.020+0000 7f6d4e950700 1 -- 172.21.15.146:0/3547954624 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d480c7740 con 0x7f6d480cd480 2023-10-06T11:18:48.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.020+0000 7f6d2ffff700 1 -- 172.21.15.146:0/3547954624 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4001d9f0 con 0x7f6d480cd480 2023-10-06T11:18:48.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.020+0000 7f6d4e950700 1 -- 172.21.15.146:0/3547954624 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d480ca460 con 0x7f6d480cd480 2023-10-06T11:18:48.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.021+0000 7f6d4e950700 1 -- 172.21.15.146:0/3547954624 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d480c7c60 con 0x7f6d480cd480 2023-10-06T11:18:48.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.021+0000 7f6d2ffff700 1 -- 172.21.15.146:0/3547954624 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6d40024070 con 0x7f6d480cd480 2023-10-06T11:18:48.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.021+0000 7f6d2ffff700 1 --2- 172.21.15.146:0/3547954624 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6d34066f30 0x7f6d340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:48.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.021+0000 7f6d2ffff700 1 -- 172.21.15.146:0/3547954624 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f6d40086b40 con 0x7f6d480cd480 2023-10-06T11:18:48.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.021+0000 7f6d47fff700 1 --2- 172.21.15.146:0/3547954624 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6d34066f30 0x7f6d340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:48.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.022+0000 7f6d47fff700 1 --2- 172.21.15.146:0/3547954624 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6d34066f30 0x7f6d340693e0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f6d380011e0 tx=0x7f6d38009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:48.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.026+0000 7f6d2ffff700 1 -- 172.21.15.146:0/3547954624 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6d480c7c60 con 0x7f6d480cd480 2023-10-06T11:18:48.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.211+0000 7f6d4e950700 1 -- 172.21.15.146:0/3547954624 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d480c7c60 con 0x7f6d480cd480 2023-10-06T11:18:48.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.212+0000 7f6d2ffff700 1 -- 172.21.15.146:0/3547954624 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v173) v1 ==== 74+0+13708 (secure 0 0 0) 0x7f6d480c7c60 con 0x7f6d480cd480 2023-10-06T11:18:48.214 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:18:48.214 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":173,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:18:47.480262+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":164,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":161,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:18:48.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.214+0000 7f6d4e950700 1 -- 172.21.15.146:0/3547954624 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6d34066f30 msgr2=0x7f6d340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:48.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.214+0000 7f6d4e950700 1 --2- 172.21.15.146:0/3547954624 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6d34066f30 0x7f6d340693e0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f6d380011e0 tx=0x7f6d38009040 comp rx=0 tx=0).stop 2023-10-06T11:18:48.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.214+0000 7f6d4e950700 1 -- 172.21.15.146:0/3547954624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d480cd480 msgr2=0x7f6d480d0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:48.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.214+0000 7f6d4e950700 1 --2- 172.21.15.146:0/3547954624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d480cd480 0x7f6d480d0190 secure :-1 s=READY pgs=2209 cs=0 l=1 rev1=1 crypto rx=0x7f6d400097c0 tx=0x7f6d40019000 comp rx=0 tx=0).stop 2023-10-06T11:18:48.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.214+0000 7f6d4e950700 1 -- 172.21.15.146:0/3547954624 shutdown_connections 2023-10-06T11:18:48.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.214+0000 7f6d4e950700 1 --2- 172.21.15.146:0/3547954624 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6d34066f30 0x7f6d340693e0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:48.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.214+0000 7f6d4e950700 1 --2- 172.21.15.146:0/3547954624 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6d480cd480 0x7f6d480d0190 unknown :-1 s=CLOSED pgs=2209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:48.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.214+0000 7f6d4e950700 1 --2- 172.21.15.146:0/3547954624 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d480b09f0 0x7f6d480c9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:48.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.214+0000 7f6d4e950700 1 --2- 172.21.15.146:0/3547954624 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6d480cd0b0 0x7f6d48152a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:48.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.214+0000 7f6d4e950700 1 -- 172.21.15.146:0/3547954624 >> 172.21.15.146:0/3547954624 conn(0x7f6d4806eb10 msgr2=0x7f6d480ce130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:48.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.214+0000 7f6d4e950700 1 -- 172.21.15.146:0/3547954624 shutdown_connections 2023-10-06T11:18:48.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.214+0000 7f6d4e950700 1 -- 172.21.15.146:0/3547954624 wait complete. 2023-10-06T11:18:48.229 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:05:36.687307+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:05:37.171199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-06T11:18:48.229 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:18:48.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.344+0000 7fd5ad10c700 1 Processor -- start 2023-10-06T11:18:48.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.344+0000 7fd5ad10c700 1 -- start start 2023-10-06T11:18:48.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.345+0000 7fd5ad10c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5a8159820 0x7fd5a80b0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:48.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.345+0000 7fd5ad10c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5a80b0bc0 con 0x7fd5a80b0760 2023-10-06T11:18:48.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.345+0000 7fd5ad10c700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5a80cb8a0 con 0x7fd5a8159450 2023-10-06T11:18:48.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.345+0000 7fd5ad10c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a80b2f20 con 0x7fd5a8159820 2023-10-06T11:18:48.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.345+0000 7fd5a759e700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd5a80b0760 0x7fd5a80aef90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40244/0 (socket says 172.21.15.146:40244) 2023-10-06T11:18:48.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.345+0000 7fd5a759e700 1 -- 172.21.15.146:0/3577261595 learned_addr learned my addr 172.21.15.146:0/3577261595 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:48.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.345+0000 7fd59e59c700 1 --2- 172.21.15.146:0/3577261595 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5a8159820 0x7fd5a80b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:48.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.345+0000 7fd5a659c700 1 -- 172.21.15.146:0/3577261595 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3359818116 0 0) 0x7fd5a0001490 con 0x7fd5a80b0760 2023-10-06T11:18:48.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.345+0000 7fd5a659c700 1 -- 172.21.15.146:0/3577261595 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd594003570 con 0x7fd5a80b0760 2023-10-06T11:18:48.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.345+0000 7fd5a659c700 1 -- 172.21.15.146:0/3577261595 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 194545004 0 0) 0x7fd5a80cb8a0 con 0x7fd5a8159450 2023-10-06T11:18:48.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.345+0000 7fd5a659c700 1 -- 172.21.15.146:0/3577261595 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5a0001490 con 0x7fd5a8159450 2023-10-06T11:18:48.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.345+0000 7fd59e59c700 1 -- 172.21.15.146:0/3577261595 >> v1:172.21.15.151:6789/0 conn(0x7fd5a8159450 legacy=0x7fd5a815dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:48.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.345+0000 7fd59e59c700 1 -- 172.21.15.146:0/3577261595 >> v1:172.21.15.146:6789/0 conn(0x7fd5a80b0760 legacy=0x7fd5a80aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:48.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.345+0000 7fd5a659c700 1 -- 172.21.15.146:0/3577261595 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2306036170 0 0) 0x7fd594003570 con 0x7fd5a80b0760 2023-10-06T11:18:48.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.345+0000 7fd59e59c700 1 -- 172.21.15.146:0/3577261595 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a8159c70 con 0x7fd5a8159820 2023-10-06T11:18:48.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.346+0000 7fd59e59c700 1 --2- 172.21.15.146:0/3577261595 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5a8159820 0x7fd5a80b0220 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd590009910 tx=0x7fd5900091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a72d60c08bab24f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:48.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.346+0000 7fd5a659c700 1 -- 172.21.15.146:0/3577261595 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a0001980 con 0x7fd5a8159820 2023-10-06T11:18:48.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.346+0000 7fd5a659c700 1 -- 172.21.15.146:0/3577261595 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd590011420 con 0x7fd5a8159820 2023-10-06T11:18:48.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.346+0000 7fd5a659c700 1 -- 172.21.15.146:0/3577261595 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5900117a0 con 0x7fd5a8159820 2023-10-06T11:18:48.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.346+0000 7fd5ad10c700 1 -- 172.21.15.146:0/3577261595 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5a8159820 msgr2=0x7fd5a80b0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:48.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.346+0000 7fd5ad10c700 1 --2- 172.21.15.146:0/3577261595 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5a8159820 0x7fd5a80b0220 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd590009910 tx=0x7fd5900091a0 comp rx=0 tx=0).stop 2023-10-06T11:18:48.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.346+0000 7fd5ad10c700 1 -- 172.21.15.146:0/3577261595 shutdown_connections 2023-10-06T11:18:48.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.346+0000 7fd5ad10c700 1 --2- 172.21.15.146:0/3577261595 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5a8159820 0x7fd5a80b0220 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:48.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.346+0000 7fd5ad10c700 1 -- 172.21.15.146:0/3577261595 >> 172.21.15.146:0/3577261595 conn(0x7fd5a806eb10 msgr2=0x7fd5a806ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:48.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.346+0000 7fd5ad10c700 1 -- 172.21.15.146:0/3577261595 shutdown_connections 2023-10-06T11:18:48.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.346+0000 7fd5ad10c700 1 -- 172.21.15.146:0/3577261595 wait complete. 2023-10-06T11:18:48.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.348+0000 7fd5ad10c700 1 Processor -- start 2023-10-06T11:18:48.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.348+0000 7fd5ad10c700 1 -- start start 2023-10-06T11:18:48.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.348+0000 7fd5ad10c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a80b0760 0x7fd5a81463b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:48.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.348+0000 7fd5ad10c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5a8159450 0x7fd5a815d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:48.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.348+0000 7fd5ad10c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5a8159820 0x7fd5a815d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:48.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.348+0000 7fd5ad10c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a80d1430 con 0x7fd5a80b0760 2023-10-06T11:18:48.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.348+0000 7fd5ad10c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a80d1150 con 0x7fd5a8159450 2023-10-06T11:18:48.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.348+0000 7fd5ad10c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a80c86f0 con 0x7fd5a8159820 2023-10-06T11:18:48.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.348+0000 7fd5a6d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a80b0760 0x7fd5a81463b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:48.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.348+0000 7fd5a6d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a80b0760 0x7fd5a81463b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48302/0 (socket says 172.21.15.146:48302) 2023-10-06T11:18:48.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.348+0000 7fd5a6d9d700 1 -- 172.21.15.146:0/3863489507 learned_addr learned my addr 172.21.15.146:0/3863489507 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:48.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.349+0000 7fd59e59c700 1 --2- 172.21.15.146:0/3863489507 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5a8159450 0x7fd5a815d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:48.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.349+0000 7fd5a759e700 1 --2- 172.21.15.146:0/3863489507 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5a8159820 0x7fd5a815d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:48.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.349+0000 7fd5a6d9d700 1 -- 172.21.15.146:0/3863489507 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5a8159820 msgr2=0x7fd5a815d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:48.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.349+0000 7fd5a6d9d700 1 --2- 172.21.15.146:0/3863489507 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5a8159820 0x7fd5a815d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:48.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.349+0000 7fd5a6d9d700 1 -- 172.21.15.146:0/3863489507 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5a8159450 msgr2=0x7fd5a815d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:48.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.349+0000 7fd5a6d9d700 1 --2- 172.21.15.146:0/3863489507 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5a8159450 0x7fd5a815d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:48.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.349+0000 7fd5a6d9d700 1 -- 172.21.15.146:0/3863489507 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd590009420 con 0x7fd5a80b0760 2023-10-06T11:18:48.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.349+0000 7fd59e59c700 1 --2- 172.21.15.146:0/3863489507 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5a8159450 0x7fd5a815d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:18:48.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.349+0000 7fd5a759e700 1 --2- 172.21.15.146:0/3863489507 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5a8159820 0x7fd5a815d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:18:48.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.349+0000 7fd5a6d9d700 1 --2- 172.21.15.146:0/3863489507 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a80b0760 0x7fd5a81463b0 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7fd59800c790 tx=0x7fd598007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:48.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.349+0000 7fd59f7fe700 1 -- 172.21.15.146:0/3863489507 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd598010510 con 0x7fd5a80b0760 2023-10-06T11:18:48.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.349+0000 7fd59f7fe700 1 -- 172.21.15.146:0/3863489507 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd598010670 con 0x7fd5a80b0760 2023-10-06T11:18:48.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.349+0000 7fd5ad10c700 1 -- 172.21.15.146:0/3863489507 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5a80c89d0 con 0x7fd5a80b0760 2023-10-06T11:18:48.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.349+0000 7fd59f7fe700 1 -- 172.21.15.146:0/3863489507 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd598010a10 con 0x7fd5a80b0760 2023-10-06T11:18:48.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.349+0000 7fd5ad10c700 1 -- 172.21.15.146:0/3863489507 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5a81468f0 con 0x7fd5a80b0760 2023-10-06T11:18:48.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.350+0000 7fd5ad10c700 1 -- 172.21.15.146:0/3863489507 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5a804c380 con 0x7fd5a80b0760 2023-10-06T11:18:48.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.350+0000 7fd59f7fe700 1 -- 172.21.15.146:0/3863489507 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd59801b400 con 0x7fd5a80b0760 2023-10-06T11:18:48.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.351+0000 7fd59f7fe700 1 --2- 172.21.15.146:0/3863489507 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd588066f30 0x7fd5880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:48.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.351+0000 7fd59f7fe700 1 -- 172.21.15.146:0/3863489507 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fd598084200 con 0x7fd5a80b0760 2023-10-06T11:18:48.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.351+0000 7fd59e59c700 1 --2- 172.21.15.146:0/3863489507 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd588066f30 0x7fd5880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:48.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.351+0000 7fd59e59c700 1 --2- 172.21.15.146:0/3863489507 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd588066f30 0x7fd5880693e0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fd5a80c3ac0 tx=0x7fd590016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:48.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.355+0000 7fd59f7fe700 1 -- 172.21.15.146:0/3863489507 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd5980515c0 con 0x7fd5a80b0760 2023-10-06T11:18:48.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.540+0000 7fd5ad10c700 1 -- 172.21.15.146:0/3863489507 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd5a80b2960 con 0x7fd5a80b0760 2023-10-06T11:18:48.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.540+0000 7fd59f7fe700 1 -- 172.21.15.146:0/3863489507 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v173) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd598054be0 con 0x7fd5a80b0760 2023-10-06T11:18:48.542 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-10-06T11:18:48.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.542+0000 7fd5ad10c700 1 -- 172.21.15.146:0/3863489507 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd588066f30 msgr2=0x7fd5880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:48.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.542+0000 7fd5ad10c700 1 --2- 172.21.15.146:0/3863489507 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd588066f30 0x7fd5880693e0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fd5a80c3ac0 tx=0x7fd590016000 comp rx=0 tx=0).stop 2023-10-06T11:18:48.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.542+0000 7fd5ad10c700 1 -- 172.21.15.146:0/3863489507 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a80b0760 msgr2=0x7fd5a81463b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:48.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.542+0000 7fd5ad10c700 1 --2- 172.21.15.146:0/3863489507 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a80b0760 0x7fd5a81463b0 secure :-1 s=READY pgs=2211 cs=0 l=1 rev1=1 crypto rx=0x7fd59800c790 tx=0x7fd598007e10 comp rx=0 tx=0).stop 2023-10-06T11:18:48.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.542+0000 7fd5ad10c700 1 -- 172.21.15.146:0/3863489507 shutdown_connections 2023-10-06T11:18:48.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.542+0000 7fd5ad10c700 1 --2- 172.21.15.146:0/3863489507 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd588066f30 0x7fd5880693e0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:48.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.542+0000 7fd5ad10c700 1 --2- 172.21.15.146:0/3863489507 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5a8159820 0x7fd5a815d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:48.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.542+0000 7fd5ad10c700 1 --2- 172.21.15.146:0/3863489507 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5a80b0760 0x7fd5a81463b0 unknown :-1 s=CLOSED pgs=2211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:48.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.542+0000 7fd5ad10c700 1 --2- 172.21.15.146:0/3863489507 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5a8159450 0x7fd5a815d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:48.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.542+0000 7fd5ad10c700 1 -- 172.21.15.146:0/3863489507 >> 172.21.15.146:0/3863489507 conn(0x7fd5a806eb10 msgr2=0x7fd5a8158a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:48.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.542+0000 7fd5ad10c700 1 -- 172.21.15.146:0/3863489507 shutdown_connections 2023-10-06T11:18:48.546 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.542+0000 7fd5ad10c700 1 -- 172.21.15.146:0/3863489507 wait complete. 2023-10-06T11:18:48.556 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:18:48.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.672+0000 7facfc6e7700 1 Processor -- start 2023-10-06T11:18:48.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.672+0000 7facfc6e7700 1 -- start start 2023-10-06T11:18:48.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.673+0000 7facfc6e7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7facf4159820 0x7facf40b0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:48.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.673+0000 7facfc6e7700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facf40cb8a0 con 0x7facf40b0760 2023-10-06T11:18:48.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.673+0000 7facfc6e7700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facf4159c70 con 0x7facf4159450 2023-10-06T11:18:48.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.673+0000 7facfc6e7700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facf40b2f20 con 0x7facf4159820 2023-10-06T11:18:48.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.673+0000 7facf9c82700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7facf4159820 0x7facf40b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:48.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.673+0000 7facfac84700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7facf40b0760 0x7facf40aef90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40252/0 (socket says 172.21.15.146:40252) 2023-10-06T11:18:48.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.673+0000 7facfac84700 1 -- 172.21.15.146:0/2477943677 learned_addr learned my addr 172.21.15.146:0/2477943677 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:48.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.674+0000 7facf9c82700 1 -- 172.21.15.146:0/2477943677 >> v1:172.21.15.151:6789/0 conn(0x7facf4159450 legacy=0x7facf415dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:48.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.674+0000 7facf9c82700 1 -- 172.21.15.146:0/2477943677 >> v1:172.21.15.146:6789/0 conn(0x7facf40b0760 legacy=0x7facf40aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:48.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.674+0000 7facf9c82700 1 -- 172.21.15.146:0/2477943677 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf40b0b90 con 0x7facf4159820 2023-10-06T11:18:48.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.674+0000 7facf9481700 1 -- 172.21.15.146:0/2477943677 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1748841362 0 0) 0x7facf40cb8a0 con 0x7facf40b0760 2023-10-06T11:18:48.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.674+0000 7facf9c82700 1 --2- 172.21.15.146:0/2477943677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facf4159820 0x7facf40b0220 secure :-1 s=READY pgs=2213 cs=0 l=1 rev1=1 crypto rx=0x7face80098e0 tx=0x7face80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=180f509acaacf823 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:48.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.674+0000 7facf9481700 1 -- 172.21.15.146:0/2477943677 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face8009e80 con 0x7facf4159820 2023-10-06T11:18:48.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.674+0000 7facf9481700 1 -- 172.21.15.146:0/2477943677 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face800b860 con 0x7facf4159820 2023-10-06T11:18:48.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.674+0000 7facf9481700 1 -- 172.21.15.146:0/2477943677 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face800bbe0 con 0x7facf4159820 2023-10-06T11:18:48.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.675+0000 7facfc6e7700 1 -- 172.21.15.146:0/2477943677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facf4159820 msgr2=0x7facf40b0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:48.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.675+0000 7facfc6e7700 1 --2- 172.21.15.146:0/2477943677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facf4159820 0x7facf40b0220 secure :-1 s=READY pgs=2213 cs=0 l=1 rev1=1 crypto rx=0x7face80098e0 tx=0x7face80091a0 comp rx=0 tx=0).stop 2023-10-06T11:18:48.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.675+0000 7facfc6e7700 1 -- 172.21.15.146:0/2477943677 shutdown_connections 2023-10-06T11:18:48.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.675+0000 7facfc6e7700 1 --2- 172.21.15.146:0/2477943677 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facf4159820 0x7facf40b0220 unknown :-1 s=CLOSED pgs=2213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:48.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.675+0000 7facfc6e7700 1 -- 172.21.15.146:0/2477943677 >> 172.21.15.146:0/2477943677 conn(0x7facf406eb10 msgr2=0x7facf406ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:48.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.675+0000 7facfc6e7700 1 -- 172.21.15.146:0/2477943677 shutdown_connections 2023-10-06T11:18:48.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.675+0000 7facfc6e7700 1 -- 172.21.15.146:0/2477943677 wait complete. 2023-10-06T11:18:48.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.676+0000 7facfc6e7700 1 Processor -- start 2023-10-06T11:18:48.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.676+0000 7facfc6e7700 1 -- start start 2023-10-06T11:18:48.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.677+0000 7facfc6e7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facf40b0760 0x7facf415aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:48.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.677+0000 7facfc6e7700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7facf4159450 0x7facf4157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:48.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.677+0000 7facfc6e7700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7facf4159820 0x7facf40c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:48.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.677+0000 7facfc6e7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf415c130 con 0x7facf40b0760 2023-10-06T11:18:48.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.677+0000 7facfc6e7700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf415a590 con 0x7facf4159820 2023-10-06T11:18:48.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.677+0000 7facfc6e7700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facf415af60 con 0x7facf4159450 2023-10-06T11:18:48.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.677+0000 7facfa483700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facf40b0760 0x7facf415aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:48.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.677+0000 7facfa483700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facf40b0760 0x7facf415aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48320/0 (socket says 172.21.15.146:48320) 2023-10-06T11:18:48.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.677+0000 7facfa483700 1 -- 172.21.15.146:0/4047313319 learned_addr learned my addr 172.21.15.146:0/4047313319 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:48.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.677+0000 7facfac84700 1 --2- 172.21.15.146:0/4047313319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7facf4159820 0x7facf40c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:48.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.677+0000 7facf9c82700 1 --2- 172.21.15.146:0/4047313319 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7facf4159450 0x7facf4157f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:48.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.677+0000 7facfa483700 1 -- 172.21.15.146:0/4047313319 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7facf4159450 msgr2=0x7facf4157f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:48.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.677+0000 7facfa483700 1 --2- 172.21.15.146:0/4047313319 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7facf4159450 0x7facf4157f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:48.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.677+0000 7facfa483700 1 -- 172.21.15.146:0/4047313319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7facf4159820 msgr2=0x7facf40c9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:48.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.677+0000 7facfa483700 1 --2- 172.21.15.146:0/4047313319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7facf4159820 0x7facf40c9ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:48.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.677+0000 7facfa483700 1 -- 172.21.15.146:0/4047313319 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face8009420 con 0x7facf40b0760 2023-10-06T11:18:48.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.677+0000 7facfa483700 1 --2- 172.21.15.146:0/4047313319 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facf40b0760 0x7facf415aa20 secure :-1 s=READY pgs=2214 cs=0 l=1 rev1=1 crypto rx=0x7face400cb10 tx=0x7face40017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:48.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.677+0000 7facf27fc700 1 -- 172.21.15.146:0/4047313319 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face40020c0 con 0x7facf40b0760 2023-10-06T11:18:48.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.677+0000 7facf27fc700 1 -- 172.21.15.146:0/4047313319 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face400a7e0 con 0x7facf40b0760 2023-10-06T11:18:48.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.677+0000 7facfc6e7700 1 -- 172.21.15.146:0/4047313319 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facf40c5920 con 0x7facf40b0760 2023-10-06T11:18:48.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.677+0000 7facf27fc700 1 -- 172.21.15.146:0/4047313319 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face400ab80 con 0x7facf40b0760 2023-10-06T11:18:48.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.677+0000 7facfc6e7700 1 -- 172.21.15.146:0/4047313319 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facf415a2a0 con 0x7facf40b0760 2023-10-06T11:18:48.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.678+0000 7facfc6e7700 1 -- 172.21.15.146:0/4047313319 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facf415a870 con 0x7facf40b0760 2023-10-06T11:18:48.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.679+0000 7facf27fc700 1 -- 172.21.15.146:0/4047313319 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7face4003030 con 0x7facf40b0760 2023-10-06T11:18:48.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.679+0000 7facf27fc700 1 --2- 172.21.15.146:0/4047313319 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7face0066f30 0x7face00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:48.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.679+0000 7facf27fc700 1 -- 172.21.15.146:0/4047313319 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5206+0+0 (secure 0 0 0) 0x7face4084340 con 0x7facf40b0760 2023-10-06T11:18:48.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.679+0000 7facf9c82700 1 --2- 172.21.15.146:0/4047313319 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7face0066f30 0x7face00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:48.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.679+0000 7facf9c82700 1 --2- 172.21.15.146:0/4047313319 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7face0066f30 0x7face00693e0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7face80093f0 tx=0x7face8017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:48.694 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.683+0000 7facf27fc700 1 -- 172.21.15.146:0/4047313319 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7face40517a0 con 0x7facf40b0760 2023-10-06T11:18:48.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.864+0000 7facfc6e7700 1 -- 172.21.15.146:0/4047313319 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7facf404c380 con 0x7facf40b0760 2023-10-06T11:18:48.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.864+0000 7facf27fc700 1 -- 172.21.15.146:0/4047313319 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v173) v1 ==== 93+0+10 (secure 0 0 0) 0x7face4054dc0 con 0x7facf40b0760 2023-10-06T11:18:48.867 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-10-06T11:18:48.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.866+0000 7facfc6e7700 1 -- 172.21.15.146:0/4047313319 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7face0066f30 msgr2=0x7face00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:48.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.866+0000 7facfc6e7700 1 --2- 172.21.15.146:0/4047313319 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7face0066f30 0x7face00693e0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7face80093f0 tx=0x7face8017000 comp rx=0 tx=0).stop 2023-10-06T11:18:48.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.866+0000 7facfc6e7700 1 -- 172.21.15.146:0/4047313319 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facf40b0760 msgr2=0x7facf415aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:48.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.866+0000 7facfc6e7700 1 --2- 172.21.15.146:0/4047313319 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facf40b0760 0x7facf415aa20 secure :-1 s=READY pgs=2214 cs=0 l=1 rev1=1 crypto rx=0x7face400cb10 tx=0x7face40017b0 comp rx=0 tx=0).stop 2023-10-06T11:18:48.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.866+0000 7facfc6e7700 1 -- 172.21.15.146:0/4047313319 shutdown_connections 2023-10-06T11:18:48.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.866+0000 7facfc6e7700 1 --2- 172.21.15.146:0/4047313319 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7face0066f30 0x7face00693e0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:48.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.866+0000 7facfc6e7700 1 --2- 172.21.15.146:0/4047313319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7facf4159820 0x7facf40c9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:48.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.866+0000 7facfc6e7700 1 --2- 172.21.15.146:0/4047313319 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7facf40b0760 0x7facf415aa20 unknown :-1 s=CLOSED pgs=2214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:48.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.866+0000 7facfc6e7700 1 --2- 172.21.15.146:0/4047313319 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7facf4159450 0x7facf4157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:48.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.866+0000 7facfc6e7700 1 -- 172.21.15.146:0/4047313319 >> 172.21.15.146:0/4047313319 conn(0x7facf406eb10 msgr2=0x7facf41587c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:48.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.866+0000 7facfc6e7700 1 -- 172.21.15.146:0/4047313319 shutdown_connections 2023-10-06T11:18:48.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.866+0000 7facfc6e7700 1 -- 172.21.15.146:0/4047313319 wait complete. 2023-10-06T11:18:48.881 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T11:18:48.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.994+0000 7f8da40c9700 1 Processor -- start 2023-10-06T11:18:49.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.995+0000 7f8da40c9700 1 -- start start 2023-10-06T11:18:49.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.995+0000 7f8da40c9700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8d9c1538c0 0x7f8d9c153c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:49.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.995+0000 7f8da40c9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8d9c15a940 0x7f8d9c15dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:49.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.995+0000 7f8da40c9700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d9c15d270 con 0x7f8d9c0cac80 2023-10-06T11:18:49.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.995+0000 7f8da40c9700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d9c15d830 con 0x7f8d9c15a940 2023-10-06T11:18:49.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.995+0000 7f8da40c9700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d9c0cb810 con 0x7f8d9c1538c0 2023-10-06T11:18:49.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.995+0000 7f8da1664700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f8d9c15a940 0x7f8d9c15dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:49.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.995+0000 7f8da2666700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8d9c0cac80 0x7f8d9c0ce610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40262/0 (socket says 172.21.15.146:40262) 2023-10-06T11:18:49.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.996+0000 7f8da2666700 1 -- 172.21.15.146:0/1827870772 learned_addr learned my addr 172.21.15.146:0/1827870772 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:49.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.996+0000 7f8da1e65700 1 --2- 172.21.15.146:0/1827870772 >> v2:172.21.15.151:3300/0 conn(0x7f8d9c1538c0 0x7f8d9c153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:49.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.996+0000 7f8da1664700 1 -- 172.21.15.146:0/1827870772 >> v2:172.21.15.151:3300/0 conn(0x7f8d9c1538c0 msgr2=0x7f8d9c153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:49.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.996+0000 7f8da1664700 1 --2- 172.21.15.146:0/1827870772 >> v2:172.21.15.151:3300/0 conn(0x7f8d9c1538c0 0x7f8d9c153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:49.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.996+0000 7f8da1664700 1 -- 172.21.15.146:0/1827870772 >> v1:172.21.15.146:6789/0 conn(0x7f8d9c0cac80 legacy=0x7f8d9c0ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:49.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.996+0000 7f8da1664700 1 -- 172.21.15.146:0/1827870772 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d9c0cbaf0 con 0x7f8d9c15a940 2023-10-06T11:18:49.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.996+0000 7f8da0e63700 1 -- 172.21.15.146:0/1827870772 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 304271723 0 0) 0x7f8d9c15d270 con 0x7f8d9c0cac80 2023-10-06T11:18:49.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.996+0000 7f8da1664700 1 --2- 172.21.15.146:0/1827870772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d9c15a940 0x7f8d9c15dcc0 secure :-1 s=READY pgs=2216 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c0d1230 tx=0x7f8d8c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b941084dd428c0a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:49.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.996+0000 7f8da0e63700 1 -- 172.21.15.146:0/1827870772 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c011630 con 0x7f8d9c15a940 2023-10-06T11:18:49.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.996+0000 7f8da0e63700 1 -- 172.21.15.146:0/1827870772 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d8c011790 con 0x7f8d9c15a940 2023-10-06T11:18:49.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.996+0000 7f8da0e63700 1 -- 172.21.15.146:0/1827870772 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8c011b30 con 0x7f8d9c15a940 2023-10-06T11:18:49.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.997+0000 7f8da40c9700 1 -- 172.21.15.146:0/1827870772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d9c15a940 msgr2=0x7f8d9c15dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:49.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.997+0000 7f8da40c9700 1 --2- 172.21.15.146:0/1827870772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d9c15a940 0x7f8d9c15dcc0 secure :-1 s=READY pgs=2216 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c0d1230 tx=0x7f8d8c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:18:49.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.997+0000 7f8da40c9700 1 -- 172.21.15.146:0/1827870772 shutdown_connections 2023-10-06T11:18:49.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.997+0000 7f8da40c9700 1 --2- 172.21.15.146:0/1827870772 >> v2:172.21.15.151:3300/0 conn(0x7f8d9c1538c0 0x7f8d9c153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:49.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.997+0000 7f8da40c9700 1 --2- 172.21.15.146:0/1827870772 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d9c15a940 0x7f8d9c15dcc0 unknown :-1 s=CLOSED pgs=2216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:49.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.997+0000 7f8da40c9700 1 -- 172.21.15.146:0/1827870772 >> 172.21.15.146:0/1827870772 conn(0x7f8d9c06eb10 msgr2=0x7f8d9c06ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:49.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.997+0000 7f8da40c9700 1 -- 172.21.15.146:0/1827870772 shutdown_connections 2023-10-06T11:18:49.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.997+0000 7f8da40c9700 1 -- 172.21.15.146:0/1827870772 wait complete. 2023-10-06T11:18:49.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.998+0000 7f8da40c9700 1 Processor -- start 2023-10-06T11:18:49.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.998+0000 7f8da40c9700 1 -- start start 2023-10-06T11:18:49.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.999+0000 7f8da40c9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d9c0cac80 0x7f8d9c150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:49.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.999+0000 7f8da40c9700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d9c1538c0 0x7f8d9c0b1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:49.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.999+0000 7f8da40c9700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d9c15a940 0x7f8d9c0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:49.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.999+0000 7f8da40c9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c16a810 con 0x7f8d9c0cac80 2023-10-06T11:18:49.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.999+0000 7f8da40c9700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c16b190 con 0x7f8d9c1538c0 2023-10-06T11:18:49.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.999+0000 7f8da40c9700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c151260 con 0x7f8d9c15a940 2023-10-06T11:18:49.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.999+0000 7f8da1e65700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d9c0cac80 0x7f8d9c150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:49.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.999+0000 7f8da1e65700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d9c0cac80 0x7f8d9c150d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48348/0 (socket says 172.21.15.146:48348) 2023-10-06T11:18:49.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.999+0000 7f8da1e65700 1 -- 172.21.15.146:0/4180264460 learned_addr learned my addr 172.21.15.146:0/4180264460 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:49.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.999+0000 7f8da1664700 1 --2- 172.21.15.146:0/4180264460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d9c1538c0 0x7f8d9c0b1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:49.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.999+0000 7f8da2666700 1 --2- 172.21.15.146:0/4180264460 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d9c15a940 0x7f8d9c0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:49.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.999+0000 7f8da1e65700 1 -- 172.21.15.146:0/4180264460 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d9c15a940 msgr2=0x7f8d9c0b2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:49.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.999+0000 7f8da1e65700 1 --2- 172.21.15.146:0/4180264460 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d9c15a940 0x7f8d9c0b2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:49.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.999+0000 7f8da1e65700 1 -- 172.21.15.146:0/4180264460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d9c1538c0 msgr2=0x7f8d9c0b1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:49.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.999+0000 7f8da1e65700 1 --2- 172.21.15.146:0/4180264460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d9c1538c0 0x7f8d9c0b1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:49.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.999+0000 7f8da1e65700 1 -- 172.21.15.146:0/4180264460 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d8c009420 con 0x7f8d9c0cac80 2023-10-06T11:18:49.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.999+0000 7f8da2666700 1 --2- 172.21.15.146:0/4180264460 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d9c15a940 0x7f8d9c0b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:18:49.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.999+0000 7f8da1e65700 1 --2- 172.21.15.146:0/4180264460 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d9c0cac80 0x7f8d9c150d20 secure :-1 s=READY pgs=2217 cs=0 l=1 rev1=1 crypto rx=0x7f8d9800ec80 tx=0x7f8d980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:49.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.999+0000 7f8d91ffb700 1 -- 172.21.15.146:0/4180264460 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9800c9d0 con 0x7f8d9c0cac80 2023-10-06T11:18:49.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.999+0000 7f8d91ffb700 1 -- 172.21.15.146:0/4180264460 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d9800cb30 con 0x7f8d9c0cac80 2023-10-06T11:18:49.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.999+0000 7f8da40c9700 1 -- 172.21.15.146:0/4180264460 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d9c16a530 con 0x7f8d9c0cac80 2023-10-06T11:18:49.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.999+0000 7f8d91ffb700 1 -- 172.21.15.146:0/4180264460 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d98013470 con 0x7f8d9c0cac80 2023-10-06T11:18:49.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:48.999+0000 7f8da40c9700 1 -- 172.21.15.146:0/4180264460 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d9c16ae20 con 0x7f8d9c0cac80 2023-10-06T11:18:49.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.000+0000 7f8da40c9700 1 -- 172.21.15.146:0/4180264460 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d9c16a9a0 con 0x7f8d9c0cac80 2023-10-06T11:18:49.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.001+0000 7f8d91ffb700 1 -- 172.21.15.146:0/4180264460 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8d98013820 con 0x7f8d9c0cac80 2023-10-06T11:18:49.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.001+0000 7f8d91ffb700 1 --2- 172.21.15.146:0/4180264460 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8d80066f30 0x7f8d800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:49.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.001+0000 7f8d91ffb700 1 -- 172.21.15.146:0/4180264460 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f8d980846d0 con 0x7f8d9c0cac80 2023-10-06T11:18:49.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.001+0000 7f8da1664700 1 --2- 172.21.15.146:0/4180264460 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8d80066f30 0x7f8d800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:49.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.001+0000 7f8da1664700 1 --2- 172.21.15.146:0/4180264460 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8d80066f30 0x7f8d800693e0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c0091e0 tx=0x7f8d8c017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:49.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.005+0000 7f8d91ffb700 1 -- 172.21.15.146:0/4180264460 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8d9c16a9a0 con 0x7f8d9c0cac80 2023-10-06T11:18:49.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.189+0000 7f8da40c9700 1 -- 172.21.15.146:0/4180264460 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8d9c16a9a0 con 0x7f8d9c0cac80 2023-10-06T11:18:49.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.190+0000 7f8d91ffb700 1 -- 172.21.15.146:0/4180264460 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v173) v1 ==== 84+0+126 (secure 0 0 0) 0x7f8d9c16a9a0 con 0x7f8d9c0cac80 2023-10-06T11:18:49.192 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:18:49.192 INFO:teuthology.orchestra.run.smithi146.stdout:[ 2023-10-06T11:18:49.192 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:18:49.192 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 1, 2023-10-06T11:18:49.192 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": "rbd" 2023-10-06T11:18:49.192 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:18:49.192 INFO:teuthology.orchestra.run.smithi146.stdout: { 2023-10-06T11:18:49.193 INFO:teuthology.orchestra.run.smithi146.stdout: "poolnum": 2, 2023-10-06T11:18:49.193 INFO:teuthology.orchestra.run.smithi146.stdout: "poolname": ".mgr" 2023-10-06T11:18:49.193 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:18:49.193 INFO:teuthology.orchestra.run.smithi146.stdout:] 2023-10-06T11:18:49.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.191+0000 7f8da40c9700 1 -- 172.21.15.146:0/4180264460 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8d80066f30 msgr2=0x7f8d800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:49.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.191+0000 7f8da40c9700 1 --2- 172.21.15.146:0/4180264460 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8d80066f30 0x7f8d800693e0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c0091e0 tx=0x7f8d8c017000 comp rx=0 tx=0).stop 2023-10-06T11:18:49.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.192+0000 7f8da40c9700 1 -- 172.21.15.146:0/4180264460 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d9c0cac80 msgr2=0x7f8d9c150d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:49.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.192+0000 7f8da40c9700 1 --2- 172.21.15.146:0/4180264460 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d9c0cac80 0x7f8d9c150d20 secure :-1 s=READY pgs=2217 cs=0 l=1 rev1=1 crypto rx=0x7f8d9800ec80 tx=0x7f8d980091a0 comp rx=0 tx=0).stop 2023-10-06T11:18:49.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.192+0000 7f8da40c9700 1 -- 172.21.15.146:0/4180264460 shutdown_connections 2023-10-06T11:18:49.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.192+0000 7f8da40c9700 1 --2- 172.21.15.146:0/4180264460 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8d80066f30 0x7f8d800693e0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:49.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.192+0000 7f8da40c9700 1 --2- 172.21.15.146:0/4180264460 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d9c15a940 0x7f8d9c0b2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:49.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.192+0000 7f8da40c9700 1 --2- 172.21.15.146:0/4180264460 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8d9c0cac80 0x7f8d9c150d20 unknown :-1 s=CLOSED pgs=2217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:49.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.192+0000 7f8da40c9700 1 --2- 172.21.15.146:0/4180264460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d9c1538c0 0x7f8d9c0b1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:49.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.192+0000 7f8da40c9700 1 -- 172.21.15.146:0/4180264460 >> 172.21.15.146:0/4180264460 conn(0x7f8d9c06eb10 msgr2=0x7f8d9c151aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:49.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.192+0000 7f8da40c9700 1 -- 172.21.15.146:0/4180264460 shutdown_connections 2023-10-06T11:18:49.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.192+0000 7f8da40c9700 1 -- 172.21.15.146:0/4180264460 wait complete. 2023-10-06T11:18:49.206 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T11:18:49.207 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T11:18:49.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.324+0000 7f0688544700 1 Processor -- start 2023-10-06T11:18:49.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.324+0000 7f0688544700 1 -- start start 2023-10-06T11:18:49.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.325+0000 7f0688544700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f068015d8f0 0x7f06800d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:49.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.325+0000 7f0688544700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06800d0770 con 0x7f068015d520 2023-10-06T11:18:49.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.325+0000 7f0688544700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06800cfb60 con 0x7f06801590d0 2023-10-06T11:18:49.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.325+0000 7f0688544700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06800cfe40 con 0x7f068015d8f0 2023-10-06T11:18:49.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.325+0000 7f06862e0700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f068015d520 0x7f06800cf090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:40278/0 (socket says 172.21.15.146:40278) 2023-10-06T11:18:49.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.325+0000 7f06862e0700 1 -- 172.21.15.146:0/2099663205 learned_addr learned my addr 172.21.15.146:0/2099663205 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:49.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.325+0000 7f06852de700 1 -- 172.21.15.146:0/2099663205 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1357429075 0 0) 0x7f06800d0770 con 0x7f068015d520 2023-10-06T11:18:49.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.325+0000 7f06852de700 1 -- 172.21.15.146:0/2099663205 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f066c003570 con 0x7f068015d520 2023-10-06T11:18:49.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.325+0000 7f0685adf700 1 --2- 172.21.15.146:0/2099663205 >> v2:172.21.15.151:3300/0 conn(0x7f068015d8f0 0x7f06800d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:49.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.325+0000 7f06852de700 1 -- 172.21.15.146:0/2099663205 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1890545397 0 0) 0x7f066c003570 con 0x7f068015d520 2023-10-06T11:18:49.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.325+0000 7f06852de700 1 -- 172.21.15.146:0/2099663205 >> v2:172.21.15.151:3300/0 conn(0x7f068015d8f0 msgr2=0x7f06800d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:49.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.325+0000 7f06852de700 1 --2- 172.21.15.146:0/2099663205 >> v2:172.21.15.151:3300/0 conn(0x7f068015d8f0 0x7f06800d0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:49.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.325+0000 7f06852de700 1 -- 172.21.15.146:0/2099663205 >> v1:172.21.15.151:6789/0 conn(0x7f06801590d0 legacy=0x7f0680159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:49.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.325+0000 7f06852de700 1 -- 172.21.15.146:0/2099663205 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06800d0120 con 0x7f068015d520 2023-10-06T11:18:49.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.325+0000 7f06852de700 1 -- 172.21.15.146:0/2099663205 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f067c001470 con 0x7f068015d520 2023-10-06T11:18:49.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.325+0000 7f06852de700 1 -- 172.21.15.146:0/2099663205 >> v1:172.21.15.146:6789/0 conn(0x7f068015d520 legacy=0x7f06800cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:49.333 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.325+0000 7f06852de700 1 --2- 172.21.15.146:0/2099663205 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f066c003a60 0x7f066c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:49.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.325+0000 7f06852de700 1 --2- 172.21.15.146:0/2099663205 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f066c004810 0x7f066c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:49.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.325+0000 7f06852de700 1 --2- 172.21.15.146:0/2099663205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f066c005230 0x7f066c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:49.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.325+0000 7f06852de700 1 -- 172.21.15.146:0/2099663205 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06800cfe40 con 0x7f066c005230 2023-10-06T11:18:49.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.325+0000 7f06852de700 1 -- 172.21.15.146:0/2099663205 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066c00c160 con 0x7f066c003a60 2023-10-06T11:18:49.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.325+0000 7f06852de700 1 -- 172.21.15.146:0/2099663205 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f066c00c320 con 0x7f066c004810 2023-10-06T11:18:49.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.326+0000 7f06862e0700 1 --2- 172.21.15.146:0/2099663205 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f066c003a60 0x7f066c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:49.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.326+0000 7f0686ae1700 1 --2- 172.21.15.146:0/2099663205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f066c005230 0x7f066c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:49.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.326+0000 7f0685adf700 1 --2- 172.21.15.146:0/2099663205 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f066c004810 0x7f066c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:49.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.326+0000 7f0686ae1700 1 -- 172.21.15.146:0/2099663205 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f066c004810 msgr2=0x7f066c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:49.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.326+0000 7f0686ae1700 1 --2- 172.21.15.146:0/2099663205 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f066c004810 0x7f066c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:49.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.326+0000 7f0686ae1700 1 -- 172.21.15.146:0/2099663205 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f066c003a60 msgr2=0x7f066c003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:49.334 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.326+0000 7f0686ae1700 1 --2- 172.21.15.146:0/2099663205 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f066c003a60 0x7f066c003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:49.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.326+0000 7f0686ae1700 1 -- 172.21.15.146:0/2099663205 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f066c003570 con 0x7f066c005230 2023-10-06T11:18:49.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.326+0000 7f0686ae1700 1 -- 172.21.15.146:0/2099663205 reap_dead start 2023-10-06T11:18:49.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.326+0000 7f0686ae1700 1 --2- 172.21.15.146:0/2099663205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f066c005230 0x7f066c00ba60 secure :-1 s=READY pgs=2219 cs=0 l=1 rev1=1 crypto rx=0x7f0678002f00 tx=0x7f0678002530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9a89ba4b265dc73 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:49.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.326+0000 7f06852de700 1 -- 172.21.15.146:0/2099663205 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0678002840 con 0x7f066c005230 2023-10-06T11:18:49.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.326+0000 7f06852de700 1 -- 172.21.15.146:0/2099663205 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0678006ba0 con 0x7f066c005230 2023-10-06T11:18:49.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.326+0000 7f06852de700 1 -- 172.21.15.146:0/2099663205 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067800c680 con 0x7f066c005230 2023-10-06T11:18:49.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.327+0000 7f0688544700 1 -- 172.21.15.146:0/2099663205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f066c005230 msgr2=0x7f066c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:49.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.327+0000 7f0688544700 1 --2- 172.21.15.146:0/2099663205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f066c005230 0x7f066c00ba60 secure :-1 s=READY pgs=2219 cs=0 l=1 rev1=1 crypto rx=0x7f0678002f00 tx=0x7f0678002530 comp rx=0 tx=0).stop 2023-10-06T11:18:49.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.327+0000 7f0688544700 1 -- 172.21.15.146:0/2099663205 shutdown_connections 2023-10-06T11:18:49.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.327+0000 7f0688544700 1 --2- 172.21.15.146:0/2099663205 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f066c005230 0x7f066c00ba60 unknown :-1 s=CLOSED pgs=2219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:49.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.327+0000 7f0688544700 1 -- 172.21.15.146:0/2099663205 >> 172.21.15.146:0/2099663205 conn(0x7f068006eb10 msgr2=0x7f068006ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:49.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.327+0000 7f0688544700 1 -- 172.21.15.146:0/2099663205 shutdown_connections 2023-10-06T11:18:49.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.327+0000 7f0688544700 1 -- 172.21.15.146:0/2099663205 wait complete. 2023-10-06T11:18:49.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.328+0000 7f0688544700 1 Processor -- start 2023-10-06T11:18:49.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.328+0000 7f0688544700 1 -- start start 2023-10-06T11:18:49.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.329+0000 7f0688544700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f066c005230 0x7f06800af890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:49.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.329+0000 7f0688544700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0680157810 0x7f068015bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:49.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.329+0000 7f0688544700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06800b4440 0x7f0680159550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:49.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.329+0000 7f0688544700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06800b3fb0 con 0x7f06800b4440 2023-10-06T11:18:49.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.329+0000 7f0688544700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06800b3410 con 0x7f0680157810 2023-10-06T11:18:49.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.329+0000 7f0688544700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06800b3680 con 0x7f066c005230 2023-10-06T11:18:49.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.329+0000 7f0686ae1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06800b4440 0x7f0680159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:49.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.329+0000 7f0686ae1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06800b4440 0x7f0680159550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48358/0 (socket says 172.21.15.146:48358) 2023-10-06T11:18:49.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.329+0000 7f0686ae1700 1 -- 172.21.15.146:0/2155795403 learned_addr learned my addr 172.21.15.146:0/2155795403 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:49.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.329+0000 7f06862e0700 1 --2- 172.21.15.146:0/2155795403 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f066c005230 0x7f06800af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:49.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.329+0000 7f0685adf700 1 --2- 172.21.15.146:0/2155795403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0680157810 0x7f068015bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:49.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.329+0000 7f0686ae1700 1 -- 172.21.15.146:0/2155795403 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f066c005230 msgr2=0x7f06800af890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:49.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.329+0000 7f0686ae1700 1 --2- 172.21.15.146:0/2155795403 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f066c005230 0x7f06800af890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:49.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.329+0000 7f0686ae1700 1 -- 172.21.15.146:0/2155795403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0680157810 msgr2=0x7f068015bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:49.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.329+0000 7f0686ae1700 1 --2- 172.21.15.146:0/2155795403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0680157810 0x7f068015bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:49.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.329+0000 7f0686ae1700 1 -- 172.21.15.146:0/2155795403 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06800b3960 con 0x7f06800b4440 2023-10-06T11:18:49.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.329+0000 7f0686ae1700 1 --2- 172.21.15.146:0/2155795403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06800b4440 0x7f0680159550 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 crypto rx=0x7f06800b3110 tx=0x7f0678015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:49.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.329+0000 7f06767fc700 1 -- 172.21.15.146:0/2155795403 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06780136c0 con 0x7f06800b4440 2023-10-06T11:18:49.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.329+0000 7f06767fc700 1 -- 172.21.15.146:0/2155795403 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0678013840 con 0x7f06800b4440 2023-10-06T11:18:49.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.329+0000 7f0688544700 1 -- 172.21.15.146:0/2155795403 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06800b3c40 con 0x7f06800b4440 2023-10-06T11:18:49.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.329+0000 7f06767fc700 1 -- 172.21.15.146:0/2155795403 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0678013c00 con 0x7f06800b4440 2023-10-06T11:18:49.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.329+0000 7f0688544700 1 -- 172.21.15.146:0/2155795403 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f068015c090 con 0x7f06800b4440 2023-10-06T11:18:49.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.330+0000 7f0688544700 1 -- 172.21.15.146:0/2155795403 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06800b4120 con 0x7f06800b4440 2023-10-06T11:18:49.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.331+0000 7f06767fc700 1 -- 172.21.15.146:0/2155795403 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f067801d470 con 0x7f06800b4440 2023-10-06T11:18:49.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.331+0000 7f06767fc700 1 --2- 172.21.15.146:0/2155795403 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0664066f30 0x7f06640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:49.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.331+0000 7f06767fc700 1 -- 172.21.15.146:0/2155795403 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f0678085cd0 con 0x7f06800b4440 2023-10-06T11:18:49.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.331+0000 7f06862e0700 1 --2- 172.21.15.146:0/2155795403 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0664066f30 0x7f06640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:49.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.331+0000 7f06862e0700 1 --2- 172.21.15.146:0/2155795403 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0664066f30 0x7f06640693e0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f067c001050 tx=0x7f067c001e70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:49.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.335+0000 7f06767fc700 1 -- 172.21.15.146:0/2155795403 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0678053130 con 0x7f06800b4440 2023-10-06T11:18:49.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:49.521+0000 7f0688544700 1 -- 172.21.15.146:0/2155795403 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f068004c380 con 0x7f06800b4440 2023-10-06T11:18:50.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.490+0000 7f06767fc700 1 -- 172.21.15.146:0/2155795403 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v174) v1 ==== 138+0+0 (secure 0 0 0) 0x7f06780210b0 con 0x7f06800b4440 2023-10-06T11:18:50.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.493+0000 7f0688544700 1 -- 172.21.15.146:0/2155795403 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0664066f30 msgr2=0x7f06640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:50.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.493+0000 7f0688544700 1 --2- 172.21.15.146:0/2155795403 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0664066f30 0x7f06640693e0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f067c001050 tx=0x7f067c001e70 comp rx=0 tx=0).stop 2023-10-06T11:18:50.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.493+0000 7f0688544700 1 -- 172.21.15.146:0/2155795403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06800b4440 msgr2=0x7f0680159550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:50.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.493+0000 7f0688544700 1 --2- 172.21.15.146:0/2155795403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06800b4440 0x7f0680159550 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 crypto rx=0x7f06800b3110 tx=0x7f0678015000 comp rx=0 tx=0).stop 2023-10-06T11:18:50.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.494+0000 7f0688544700 1 -- 172.21.15.146:0/2155795403 shutdown_connections 2023-10-06T11:18:50.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.494+0000 7f0688544700 1 --2- 172.21.15.146:0/2155795403 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0664066f30 0x7f06640693e0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:50.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.494+0000 7f0688544700 1 --2- 172.21.15.146:0/2155795403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f06800b4440 0x7f0680159550 unknown :-1 s=CLOSED pgs=2220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:50.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.494+0000 7f0688544700 1 --2- 172.21.15.146:0/2155795403 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f066c005230 0x7f06800af890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:50.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.494+0000 7f0688544700 1 --2- 172.21.15.146:0/2155795403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0680157810 0x7f068015bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:50.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.494+0000 7f0688544700 1 -- 172.21.15.146:0/2155795403 >> 172.21.15.146:0/2155795403 conn(0x7f068006eb10 msgr2=0x7f06800d0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:50.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.496+0000 7f0688544700 1 -- 172.21.15.146:0/2155795403 shutdown_connections 2023-10-06T11:18:50.498 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.496+0000 7f0688544700 1 -- 172.21.15.146:0/2155795403 wait complete. 2023-10-06T11:18:50.498 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' created 2023-10-06T11:18:50.512 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T11:18:50.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.632+0000 7ff6bcfc2700 1 Processor -- start 2023-10-06T11:18:50.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.632+0000 7ff6bcfc2700 1 -- start start 2023-10-06T11:18:50.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.633+0000 7ff6bcfc2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff6b80ccfb0 0x7ff6b815a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:50.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.633+0000 7ff6bcfc2700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6b80cb800 0x7ff6b80cd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:50.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.633+0000 7ff6bcfc2700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6b8068c70 con 0x7ff6b815d470 2023-10-06T11:18:50.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.633+0000 7ff6bcfc2700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6b80cc2a0 con 0x7ff6b80ccfb0 2023-10-06T11:18:50.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.633+0000 7ff6bcfc2700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b815af00 con 0x7ff6b80cb800 2023-10-06T11:18:50.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.633+0000 7ff6b659c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff6b80ccfb0 0x7ff6b815a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:50.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.633+0000 7ff6b659c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff6b80ccfb0 0x7ff6b815a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48372/0 (socket says 172.21.15.146:48372) 2023-10-06T11:18:50.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.633+0000 7ff6b659c700 1 -- 172.21.15.146:0/1268152311 learned_addr learned my addr 172.21.15.146:0/1268152311 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:50.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.633+0000 7ff6b5d9b700 1 --2- 172.21.15.146:0/1268152311 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6b80cb800 0x7ff6b80cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:50.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.634+0000 7ff6b659c700 1 -- 172.21.15.146:0/1268152311 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6b80cb800 msgr2=0x7ff6b80cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:50.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.634+0000 7ff6b659c700 1 --2- 172.21.15.146:0/1268152311 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6b80cb800 0x7ff6b80cd380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:50.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.634+0000 7ff6b659c700 1 -- 172.21.15.146:0/1268152311 >> v1:172.21.15.151:6789/0 conn(0x7ff6b815d470 legacy=0x7ff6b815d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:50.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.634+0000 7ff6b659c700 1 -- 172.21.15.146:0/1268152311 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b81578e0 con 0x7ff6b80ccfb0 2023-10-06T11:18:50.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.634+0000 7ff6b5d9b700 1 --2- 172.21.15.146:0/1268152311 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6b80cb800 0x7ff6b80cd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:18:50.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.634+0000 7ff6b659c700 1 --2- 172.21.15.146:0/1268152311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6b80ccfb0 0x7ff6b815a9c0 secure :-1 s=READY pgs=2221 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8009990 tx=0x7ff6a8009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd858af5beb92ec4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:50.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.634+0000 7ff6b559a700 1 -- 172.21.15.146:0/1268152311 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a8005c10 con 0x7ff6b80ccfb0 2023-10-06T11:18:50.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.634+0000 7ff6b559a700 1 -- 172.21.15.146:0/1268152311 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a8005d70 con 0x7ff6b80ccfb0 2023-10-06T11:18:50.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.634+0000 7ff6b559a700 1 -- 172.21.15.146:0/1268152311 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a800b880 con 0x7ff6b80ccfb0 2023-10-06T11:18:50.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.634+0000 7ff6bcfc2700 1 -- 172.21.15.146:0/1268152311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6b80ccfb0 msgr2=0x7ff6b815a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:50.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.634+0000 7ff6bcfc2700 1 --2- 172.21.15.146:0/1268152311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6b80ccfb0 0x7ff6b815a9c0 secure :-1 s=READY pgs=2221 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8009990 tx=0x7ff6a8009220 comp rx=0 tx=0).stop 2023-10-06T11:18:50.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.634+0000 7ff6bcfc2700 1 -- 172.21.15.146:0/1268152311 shutdown_connections 2023-10-06T11:18:50.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.634+0000 7ff6bcfc2700 1 --2- 172.21.15.146:0/1268152311 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6b80ccfb0 0x7ff6b815a9c0 unknown :-1 s=CLOSED pgs=2221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:50.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.634+0000 7ff6bcfc2700 1 --2- 172.21.15.146:0/1268152311 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6b80cb800 0x7ff6b80cd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:50.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.634+0000 7ff6bcfc2700 1 -- 172.21.15.146:0/1268152311 >> 172.21.15.146:0/1268152311 conn(0x7ff6b8087ff0 msgr2=0x7ff6b80998f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:50.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.634+0000 7ff6bcfc2700 1 -- 172.21.15.146:0/1268152311 shutdown_connections 2023-10-06T11:18:50.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.634+0000 7ff6bcfc2700 1 -- 172.21.15.146:0/1268152311 wait complete. 2023-10-06T11:18:50.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.636+0000 7ff6bcfc2700 1 Processor -- start 2023-10-06T11:18:50.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.636+0000 7ff6bcfc2700 1 -- start start 2023-10-06T11:18:50.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.636+0000 7ff6bcfc2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6b80cb800 0x7ff6b80b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:50.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.636+0000 7ff6bcfc2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6b80ccfb0 0x7ff6b8155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:50.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.636+0000 7ff6bcfc2700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6b815d470 0x7ff6b815c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:50.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.636+0000 7ff6bcfc2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b816e720 con 0x7ff6b80cb800 2023-10-06T11:18:50.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.636+0000 7ff6bcfc2700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b81564f0 con 0x7ff6b80ccfb0 2023-10-06T11:18:50.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.636+0000 7ff6bcfc2700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b816db10 con 0x7ff6b815d470 2023-10-06T11:18:50.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.636+0000 7ff6b659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6b80cb800 0x7ff6b80b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:50.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.636+0000 7ff6b659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6b80cb800 0x7ff6b80b3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:48384/0 (socket says 172.21.15.146:48384) 2023-10-06T11:18:50.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.636+0000 7ff6b659c700 1 -- 172.21.15.146:0/2221186020 learned_addr learned my addr 172.21.15.146:0/2221186020 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:50.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.637+0000 7ff6b5d9b700 1 --2- 172.21.15.146:0/2221186020 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6b80ccfb0 0x7ff6b8155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:50.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.637+0000 7ff6b6d9d700 1 --2- 172.21.15.146:0/2221186020 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6b815d470 0x7ff6b815c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:50.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.637+0000 7ff6b659c700 1 -- 172.21.15.146:0/2221186020 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6b815d470 msgr2=0x7ff6b815c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:50.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.637+0000 7ff6b659c700 1 --2- 172.21.15.146:0/2221186020 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6b815d470 0x7ff6b815c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:50.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.637+0000 7ff6b659c700 1 -- 172.21.15.146:0/2221186020 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6b80ccfb0 msgr2=0x7ff6b8155fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:50.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.637+0000 7ff6b659c700 1 --2- 172.21.15.146:0/2221186020 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6b80ccfb0 0x7ff6b8155fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:50.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.637+0000 7ff6b659c700 1 -- 172.21.15.146:0/2221186020 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a8009480 con 0x7ff6b80cb800 2023-10-06T11:18:50.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.637+0000 7ff6b659c700 1 --2- 172.21.15.146:0/2221186020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6b80cb800 0x7ff6b80b3e20 secure :-1 s=READY pgs=2222 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8065930 tx=0x7ff6a8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:50.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.637+0000 7ff6a67fc700 1 -- 172.21.15.146:0/2221186020 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a8011740 con 0x7ff6b80cb800 2023-10-06T11:18:50.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.637+0000 7ff6a67fc700 1 -- 172.21.15.146:0/2221186020 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a8020070 con 0x7ff6b80cb800 2023-10-06T11:18:50.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.637+0000 7ff6bcfc2700 1 -- 172.21.15.146:0/2221186020 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6b816ddf0 con 0x7ff6b80cb800 2023-10-06T11:18:50.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.637+0000 7ff6a67fc700 1 -- 172.21.15.146:0/2221186020 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a8011b10 con 0x7ff6b80cb800 2023-10-06T11:18:50.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.637+0000 7ff6bcfc2700 1 -- 172.21.15.146:0/2221186020 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b816e3b0 con 0x7ff6b80cb800 2023-10-06T11:18:50.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.638+0000 7ff6bcfc2700 1 -- 172.21.15.146:0/2221186020 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6b804c380 con 0x7ff6b80cb800 2023-10-06T11:18:50.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.638+0000 7ff6a67fc700 1 -- 172.21.15.146:0/2221186020 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff6a8022030 con 0x7ff6b80cb800 2023-10-06T11:18:50.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.639+0000 7ff6a67fc700 1 --2- 172.21.15.146:0/2221186020 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff698066f30 0x7ff6980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:50.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.639+0000 7ff6a67fc700 1 -- 172.21.15.146:0/2221186020 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5576+0+0 (secure 0 0 0) 0x7ff6a8086070 con 0x7ff6b80cb800 2023-10-06T11:18:50.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.639+0000 7ff6b5d9b700 1 --2- 172.21.15.146:0/2221186020 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff698066f30 0x7ff6980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:50.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.639+0000 7ff6b5d9b700 1 --2- 172.21.15.146:0/2221186020 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff698066f30 0x7ff6980693e0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac006ea0 tx=0x7ff6ac008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:50.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.643+0000 7ff6a67fc700 1 -- 172.21.15.146:0/2221186020 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff6a8053360 con 0x7ff6b80cb800 2023-10-06T11:18:50.827 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:50.826+0000 7ff6bcfc2700 1 -- 172.21.15.146:0/2221186020 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff6b80b6490 con 0x7ff6b80cb800 2023-10-06T11:18:51.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.503+0000 7ff6a67fc700 1 -- 172.21.15.146:0/2221186020 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v175) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff6a8056980 con 0x7ff6b80cb800 2023-10-06T11:18:51.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.514+0000 7ff6bcfc2700 1 -- 172.21.15.146:0/2221186020 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff698066f30 msgr2=0x7ff6980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:51.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.514+0000 7ff6bcfc2700 1 --2- 172.21.15.146:0/2221186020 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff698066f30 0x7ff6980693e0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac006ea0 tx=0x7ff6ac008040 comp rx=0 tx=0).stop 2023-10-06T11:18:51.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.514+0000 7ff6bcfc2700 1 -- 172.21.15.146:0/2221186020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6b80cb800 msgr2=0x7ff6b80b3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:51.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.514+0000 7ff6bcfc2700 1 --2- 172.21.15.146:0/2221186020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6b80cb800 0x7ff6b80b3e20 secure :-1 s=READY pgs=2222 cs=0 l=1 rev1=1 crypto rx=0x7ff6b8065930 tx=0x7ff6a8016000 comp rx=0 tx=0).stop 2023-10-06T11:18:51.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.515+0000 7ff6bcfc2700 1 -- 172.21.15.146:0/2221186020 shutdown_connections 2023-10-06T11:18:51.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.515+0000 7ff6bcfc2700 1 --2- 172.21.15.146:0/2221186020 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff698066f30 0x7ff6980693e0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:51.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.515+0000 7ff6bcfc2700 1 --2- 172.21.15.146:0/2221186020 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6b815d470 0x7ff6b815c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:51.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.515+0000 7ff6bcfc2700 1 --2- 172.21.15.146:0/2221186020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff6b80cb800 0x7ff6b80b3e20 unknown :-1 s=CLOSED pgs=2222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:51.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.515+0000 7ff6bcfc2700 1 --2- 172.21.15.146:0/2221186020 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6b80ccfb0 0x7ff6b8155fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:51.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.515+0000 7ff6bcfc2700 1 -- 172.21.15.146:0/2221186020 >> 172.21.15.146:0/2221186020 conn(0x7ff6b8087ff0 msgr2=0x7ff6b80ce590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:51.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.516+0000 7ff6bcfc2700 1 -- 172.21.15.146:0/2221186020 shutdown_connections 2023-10-06T11:18:51.518 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.517+0000 7ff6bcfc2700 1 -- 172.21.15.146:0/2221186020 wait complete. 2023-10-06T11:18:51.520 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' created 2023-10-06T11:18:51.535 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T11:18:51.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.656+0000 7f8acb39b700 1 Processor -- start 2023-10-06T11:18:51.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.657+0000 7f8acb39b700 1 -- start start 2023-10-06T11:18:51.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.657+0000 7f8acb39b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ac4159450 0x7f8ac4159820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:51.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.657+0000 7f8acb39b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8ac40b0930 0x7f8ac40aef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:51.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.657+0000 7f8acb39b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ac40cb8a0 con 0x7f8ac415dd70 2023-10-06T11:18:51.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.657+0000 7f8acb39b700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ac40b2f20 con 0x7f8ac40b0930 2023-10-06T11:18:51.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.657+0000 7f8acb39b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac40b2960 con 0x7f8ac4159450 2023-10-06T11:18:51.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.658+0000 7f8ac8936700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f8ac415dd70 0x7f8ac40b0220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36204/0 (socket says 172.21.15.146:36204) 2023-10-06T11:18:51.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.658+0000 7f8ac8936700 1 -- 172.21.15.146:0/675402251 learned_addr learned my addr 172.21.15.146:0/675402251 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:51.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.658+0000 7f8ac3fff700 1 -- 172.21.15.146:0/675402251 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1517600846 0 0) 0x7f8ac40cb8a0 con 0x7f8ac415dd70 2023-10-06T11:18:51.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.658+0000 7f8ac9938700 1 --2- 172.21.15.146:0/675402251 >> v2:172.21.15.151:3300/0 conn(0x7f8ac40b0930 0x7f8ac40aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:51.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.658+0000 7f8ac9137700 1 --2- 172.21.15.146:0/675402251 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ac4159450 0x7f8ac4159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:51.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.658+0000 7f8ac3fff700 1 -- 172.21.15.146:0/675402251 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8aac003570 con 0x7f8ac415dd70 2023-10-06T11:18:51.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.658+0000 7f8ac3fff700 1 -- 172.21.15.146:0/675402251 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1023416026 0 0) 0x7f8aac003570 con 0x7f8ac415dd70 2023-10-06T11:18:51.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.658+0000 7f8ac3fff700 1 -- 172.21.15.146:0/675402251 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ac4159450 msgr2=0x7f8ac4159820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:51.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.658+0000 7f8ac3fff700 1 --2- 172.21.15.146:0/675402251 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ac4159450 0x7f8ac4159820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:51.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.658+0000 7f8ac3fff700 1 -- 172.21.15.146:0/675402251 >> v2:172.21.15.151:3300/0 conn(0x7f8ac40b0930 msgr2=0x7f8ac40aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:51.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.658+0000 7f8ac3fff700 1 --2- 172.21.15.146:0/675402251 >> v2:172.21.15.151:3300/0 conn(0x7f8ac40b0930 0x7f8ac40aef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:51.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.658+0000 7f8ac3fff700 1 -- 172.21.15.146:0/675402251 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac40b2c40 con 0x7f8ac415dd70 2023-10-06T11:18:51.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.658+0000 7f8ac3fff700 1 -- 172.21.15.146:0/675402251 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f8ab8001470 con 0x7f8ac415dd70 2023-10-06T11:18:51.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.658+0000 7f8ac3fff700 1 -- 172.21.15.146:0/675402251 >> v1:172.21.15.146:6789/0 conn(0x7f8ac415dd70 legacy=0x7f8ac40b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:51.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.658+0000 7f8ac3fff700 1 --2- 172.21.15.146:0/675402251 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8aac003a60 0x7f8aac003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:51.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.658+0000 7f8ac3fff700 1 --2- 172.21.15.146:0/675402251 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ac4159450 0x7f8aac004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:51.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.658+0000 7f8ac3fff700 1 --2- 172.21.15.146:0/675402251 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8aac004d50 0x7f8aac0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:51.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.658+0000 7f8ac3fff700 1 -- 172.21.15.146:0/675402251 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac40b2f20 con 0x7f8aac003a60 2023-10-06T11:18:51.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.658+0000 7f8ac3fff700 1 -- 172.21.15.146:0/675402251 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac40b2960 con 0x7f8aac004d50 2023-10-06T11:18:51.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.658+0000 7f8ac3fff700 1 -- 172.21.15.146:0/675402251 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aac00ba60 con 0x7f8ac4159450 2023-10-06T11:18:51.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.658+0000 7f8ac9137700 1 --2- 172.21.15.146:0/675402251 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8aac003a60 0x7f8aac003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:51.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.658+0000 7f8ac8936700 1 --2- 172.21.15.146:0/675402251 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ac4159450 0x7f8aac004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:51.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.658+0000 7f8ac9938700 1 --2- 172.21.15.146:0/675402251 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8aac004d50 0x7f8aac0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:51.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.658+0000 7f8ac9137700 1 -- 172.21.15.146:0/675402251 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ac4159450 msgr2=0x7f8aac004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:51.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.658+0000 7f8ac9137700 1 --2- 172.21.15.146:0/675402251 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ac4159450 0x7f8aac004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:51.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.658+0000 7f8ac9137700 1 -- 172.21.15.146:0/675402251 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8aac004d50 msgr2=0x7f8aac0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:51.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.658+0000 7f8ac9137700 1 --2- 172.21.15.146:0/675402251 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8aac004d50 0x7f8aac0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:51.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.659+0000 7f8ac9137700 1 -- 172.21.15.146:0/675402251 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aac003570 con 0x7f8aac003a60 2023-10-06T11:18:51.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.659+0000 7f8ac9938700 1 --2- 172.21.15.146:0/675402251 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8aac004d50 0x7f8aac0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:18:51.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.659+0000 7f8ac9137700 1 --2- 172.21.15.146:0/675402251 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8aac003a60 0x7f8aac003e70 secure :-1 s=READY pgs=2224 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400e210 tx=0x7f8ab400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adfb62d66e411528 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:51.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.659+0000 7f8ac3fff700 1 -- 172.21.15.146:0/675402251 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab400ea60 con 0x7f8aac003a60 2023-10-06T11:18:51.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.659+0000 7f8ac3fff700 1 -- 172.21.15.146:0/675402251 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab400f040 con 0x7f8aac003a60 2023-10-06T11:18:51.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.659+0000 7f8ac3fff700 1 -- 172.21.15.146:0/675402251 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab400ee10 con 0x7f8aac003a60 2023-10-06T11:18:51.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.659+0000 7f8acb39b700 1 -- 172.21.15.146:0/675402251 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8aac003a60 msgr2=0x7f8aac003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:51.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.659+0000 7f8acb39b700 1 --2- 172.21.15.146:0/675402251 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8aac003a60 0x7f8aac003e70 secure :-1 s=READY pgs=2224 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400e210 tx=0x7f8ab400b040 comp rx=0 tx=0).stop 2023-10-06T11:18:51.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.659+0000 7f8ac9938700 1 -- 172.21.15.146:0/675402251 reap_dead start 2023-10-06T11:18:51.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.659+0000 7f8acb39b700 1 -- 172.21.15.146:0/675402251 shutdown_connections 2023-10-06T11:18:51.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.659+0000 7f8acb39b700 1 -- 172.21.15.146:0/675402251 >> 172.21.15.146:0/675402251 conn(0x7f8ac406eb10 msgr2=0x7f8ac406ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:51.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.659+0000 7f8acb39b700 1 -- 172.21.15.146:0/675402251 shutdown_connections 2023-10-06T11:18:51.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.659+0000 7f8acb39b700 1 -- 172.21.15.146:0/675402251 wait complete. 2023-10-06T11:18:51.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.660+0000 7f8acb39b700 1 Processor -- start 2023-10-06T11:18:51.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.660+0000 7f8acb39b700 1 -- start start 2023-10-06T11:18:51.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.661+0000 7f8acb39b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8aac003a60 0x7f8ac4157e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:51.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.661+0000 7f8acb39b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ac40aeb90 0x7f8ac415c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:51.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.661+0000 7f8acb39b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ac415c570 0x7f8ac40c8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:51.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.661+0000 7f8acb39b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac415ca30 con 0x7f8ac415c570 2023-10-06T11:18:51.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.661+0000 7f8acb39b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac415cd10 con 0x7f8ac40aeb90 2023-10-06T11:18:51.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.661+0000 7f8acb39b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac415cff0 con 0x7f8aac003a60 2023-10-06T11:18:51.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.661+0000 7f8ac9938700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ac415c570 0x7f8ac40c8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:51.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.662+0000 7f8ac9938700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ac415c570 0x7f8ac40c8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58556/0 (socket says 172.21.15.146:58556) 2023-10-06T11:18:51.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.662+0000 7f8ac9938700 1 -- 172.21.15.146:0/3884645019 learned_addr learned my addr 172.21.15.146:0/3884645019 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:51.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.662+0000 7f8ac8936700 1 --2- 172.21.15.146:0/3884645019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ac40aeb90 0x7f8ac415c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:51.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.662+0000 7f8ac9137700 1 --2- 172.21.15.146:0/3884645019 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8aac003a60 0x7f8ac4157e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:51.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.662+0000 7f8ac9938700 1 -- 172.21.15.146:0/3884645019 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8aac003a60 msgr2=0x7f8ac4157e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:51.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.662+0000 7f8ac9938700 1 --2- 172.21.15.146:0/3884645019 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8aac003a60 0x7f8ac4157e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:51.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.662+0000 7f8ac9938700 1 -- 172.21.15.146:0/3884645019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ac40aeb90 msgr2=0x7f8ac415c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:51.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.662+0000 7f8ac9938700 1 --2- 172.21.15.146:0/3884645019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ac40aeb90 0x7f8ac415c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:51.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.662+0000 7f8ac9938700 1 -- 172.21.15.146:0/3884645019 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac40c54d0 con 0x7f8ac415c570 2023-10-06T11:18:51.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.662+0000 7f8ac9938700 1 --2- 172.21.15.146:0/3884645019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ac415c570 0x7f8ac40c8f70 secure :-1 s=READY pgs=2225 cs=0 l=1 rev1=1 crypto rx=0x7f8ac40cb810 tx=0x7f8abc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:51.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.662+0000 7f8ac17fa700 1 -- 172.21.15.146:0/3884645019 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8abc015670 con 0x7f8ac415c570 2023-10-06T11:18:51.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.662+0000 7f8ac17fa700 1 -- 172.21.15.146:0/3884645019 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8abc0157d0 con 0x7f8ac415c570 2023-10-06T11:18:51.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.662+0000 7f8acb39b700 1 -- 172.21.15.146:0/3884645019 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ac40c57b0 con 0x7f8ac415c570 2023-10-06T11:18:51.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.662+0000 7f8ac17fa700 1 -- 172.21.15.146:0/3884645019 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8abc015b90 con 0x7f8ac415c570 2023-10-06T11:18:51.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.662+0000 7f8acb39b700 1 -- 172.21.15.146:0/3884645019 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ac4158580 con 0x7f8ac415c570 2023-10-06T11:18:51.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.663+0000 7f8acb39b700 1 -- 172.21.15.146:0/3884645019 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ac404c380 con 0x7f8ac415c570 2023-10-06T11:18:51.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.664+0000 7f8ac17fa700 1 -- 172.21.15.146:0/3884645019 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8abc020460 con 0x7f8ac415c570 2023-10-06T11:18:51.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.664+0000 7f8ac17fa700 1 --2- 172.21.15.146:0/3884645019 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8ab0066f30 0x7f8ab00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:51.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.664+0000 7f8ac17fa700 1 -- 172.21.15.146:0/3884645019 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f8abc084720 con 0x7f8ac415c570 2023-10-06T11:18:51.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.664+0000 7f8ac9137700 1 --2- 172.21.15.146:0/3884645019 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8ab0066f30 0x7f8ab00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:51.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.664+0000 7f8ac9137700 1 --2- 172.21.15.146:0/3884645019 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8ab0066f30 0x7f8ab00693e0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400afd0 tx=0x7f8ab401a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:51.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.669+0000 7f8ac17fa700 1 -- 172.21.15.146:0/3884645019 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8abc051890 con 0x7f8ac415c570 2023-10-06T11:18:51.733 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:18:51.735 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:18:51.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:51.902+0000 7f8acb39b700 1 -- 172.21.15.146:0/3884645019 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8ac40cb530 con 0x7f8ac415c570 2023-10-06T11:18:52.505 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.504+0000 7f8ac17fa700 1 -- 172.21.15.146:0/3884645019 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 27 and data pool 28 v140) v1 ==== 174+0+0 (secure 0 0 0) 0x7f8abc054eb0 con 0x7f8ac415c570 2023-10-06T11:18:52.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.508+0000 7f8acb39b700 1 -- 172.21.15.146:0/3884645019 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8ab0066f30 msgr2=0x7f8ab00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:52.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.508+0000 7f8acb39b700 1 --2- 172.21.15.146:0/3884645019 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8ab0066f30 0x7f8ab00693e0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400afd0 tx=0x7f8ab401a000 comp rx=0 tx=0).stop 2023-10-06T11:18:52.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.508+0000 7f8acb39b700 1 -- 172.21.15.146:0/3884645019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ac415c570 msgr2=0x7f8ac40c8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:52.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.508+0000 7f8acb39b700 1 --2- 172.21.15.146:0/3884645019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ac415c570 0x7f8ac40c8f70 secure :-1 s=READY pgs=2225 cs=0 l=1 rev1=1 crypto rx=0x7f8ac40cb810 tx=0x7f8abc008040 comp rx=0 tx=0).stop 2023-10-06T11:18:52.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.509+0000 7f8acb39b700 1 -- 172.21.15.146:0/3884645019 shutdown_connections 2023-10-06T11:18:52.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.509+0000 7f8acb39b700 1 --2- 172.21.15.146:0/3884645019 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8ab0066f30 0x7f8ab00693e0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:52.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.509+0000 7f8acb39b700 1 --2- 172.21.15.146:0/3884645019 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ac415c570 0x7f8ac40c8f70 unknown :-1 s=CLOSED pgs=2225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:52.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.509+0000 7f8acb39b700 1 --2- 172.21.15.146:0/3884645019 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8aac003a60 0x7f8ac4157e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:52.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.509+0000 7f8acb39b700 1 --2- 172.21.15.146:0/3884645019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ac40aeb90 0x7f8ac415c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:52.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.509+0000 7f8acb39b700 1 -- 172.21.15.146:0/3884645019 >> 172.21.15.146:0/3884645019 conn(0x7f8ac406eb10 msgr2=0x7f8ac40b5b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:52.519 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.518+0000 7f8acb39b700 1 -- 172.21.15.146:0/3884645019 shutdown_connections 2023-10-06T11:18:52.520 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.519+0000 7f8acb39b700 1 -- 172.21.15.146:0/3884645019 wait complete. 2023-10-06T11:18:52.524 INFO:teuthology.orchestra.run.smithi146.stderr:new fs with metadata pool 27 and data pool 28 2023-10-06T11:18:52.539 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:18:52.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.652+0000 7ff1d7f0e700 1 Processor -- start 2023-10-06T11:18:52.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.653+0000 7ff1d7f0e700 1 -- start start 2023-10-06T11:18:52.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.653+0000 7ff1d7f0e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1d006be70 0x7ff1d01649c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:52.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.653+0000 7ff1d7f0e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1d00689c0 con 0x7ff1d015cd60 2023-10-06T11:18:52.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.653+0000 7ff1d7f0e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1d0068ca0 con 0x7ff1d015d130 2023-10-06T11:18:52.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.653+0000 7ff1d7f0e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d015de70 con 0x7ff1d006be70 2023-10-06T11:18:52.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.653+0000 7ff1d5caa700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff1d015cd60 0x7ff1d015d620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36210/0 (socket says 172.21.15.146:36210) 2023-10-06T11:18:52.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.654+0000 7ff1d5caa700 1 -- 172.21.15.146:0/1177064474 learned_addr learned my addr 172.21.15.146:0/1177064474 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:52.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.654+0000 7ff1d4ca8700 1 -- 172.21.15.146:0/1177064474 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3090292632 0 0) 0x7ff1d00689c0 con 0x7ff1d015cd60 2023-10-06T11:18:52.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.654+0000 7ff1d4ca8700 1 -- 172.21.15.146:0/1177064474 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1bc003570 con 0x7ff1d015cd60 2023-10-06T11:18:52.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.654+0000 7ff1d64ab700 1 --2- 172.21.15.146:0/1177064474 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1d006be70 0x7ff1d01649c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:52.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.654+0000 7ff1d4ca8700 1 -- 172.21.15.146:0/1177064474 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1081917907 0 0) 0x7ff1bc003570 con 0x7ff1d015cd60 2023-10-06T11:18:52.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.654+0000 7ff1d4ca8700 1 -- 172.21.15.146:0/1177064474 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1d006be70 msgr2=0x7ff1d01649c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:52.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.654+0000 7ff1d4ca8700 1 --2- 172.21.15.146:0/1177064474 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1d006be70 0x7ff1d01649c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:52.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.654+0000 7ff1d4ca8700 1 -- 172.21.15.146:0/1177064474 >> v1:172.21.15.151:6789/0 conn(0x7ff1d015d130 legacy=0x7ff1d006b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:52.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.654+0000 7ff1d4ca8700 1 -- 172.21.15.146:0/1177064474 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d015e150 con 0x7ff1d015cd60 2023-10-06T11:18:52.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.654+0000 7ff1d4ca8700 1 -- 172.21.15.146:0/1177064474 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7ff1c8001470 con 0x7ff1d015cd60 2023-10-06T11:18:52.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.654+0000 7ff1d4ca8700 1 -- 172.21.15.146:0/1177064474 >> v1:172.21.15.146:6789/0 conn(0x7ff1d015cd60 legacy=0x7ff1d015d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:52.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.654+0000 7ff1d4ca8700 1 --2- 172.21.15.146:0/1177064474 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1d006be70 0x7ff1bc003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:52.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.654+0000 7ff1d4ca8700 1 --2- 172.21.15.146:0/1177064474 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1bc004010 0x7ff1bc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:52.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.654+0000 7ff1d4ca8700 1 --2- 172.21.15.146:0/1177064474 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1bc004d50 0x7ff1bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:52.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.654+0000 7ff1d4ca8700 1 -- 172.21.15.146:0/1177064474 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d015de70 con 0x7ff1bc004010 2023-10-06T11:18:52.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.654+0000 7ff1d4ca8700 1 -- 172.21.15.146:0/1177064474 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1bc00bbf0 con 0x7ff1bc004d50 2023-10-06T11:18:52.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.654+0000 7ff1d4ca8700 1 -- 172.21.15.146:0/1177064474 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1bc00bdb0 con 0x7ff1d006be70 2023-10-06T11:18:52.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.654+0000 7ff1d54a9700 1 --2- 172.21.15.146:0/1177064474 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1bc004010 0x7ff1bc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:52.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.654+0000 7ff1d5caa700 1 --2- 172.21.15.146:0/1177064474 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1d006be70 0x7ff1bc003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:52.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.654+0000 7ff1d64ab700 1 --2- 172.21.15.146:0/1177064474 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1bc004d50 0x7ff1bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:52.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.655+0000 7ff1d54a9700 1 -- 172.21.15.146:0/1177064474 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1d006be70 msgr2=0x7ff1bc003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:52.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.655+0000 7ff1d54a9700 1 --2- 172.21.15.146:0/1177064474 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1d006be70 0x7ff1bc003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:52.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.655+0000 7ff1d54a9700 1 -- 172.21.15.146:0/1177064474 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1bc004d50 msgr2=0x7ff1bc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:52.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.655+0000 7ff1d54a9700 1 --2- 172.21.15.146:0/1177064474 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1bc004d50 0x7ff1bc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:52.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.655+0000 7ff1d54a9700 1 -- 172.21.15.146:0/1177064474 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1bc003570 con 0x7ff1bc004010 2023-10-06T11:18:52.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.655+0000 7ff1d54a9700 1 --2- 172.21.15.146:0/1177064474 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1bc004010 0x7ff1bc004810 secure :-1 s=READY pgs=2227 cs=0 l=1 rev1=1 crypto rx=0x7ff1d015d580 tx=0x7ff1c0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b690ac81ce1b2c09 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:52.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.655+0000 7ff1d4ca8700 1 -- 172.21.15.146:0/1177064474 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c0012420 con 0x7ff1bc004010 2023-10-06T11:18:52.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.655+0000 7ff1d4ca8700 1 -- 172.21.15.146:0/1177064474 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c0012580 con 0x7ff1bc004010 2023-10-06T11:18:52.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.655+0000 7ff1d4ca8700 1 -- 172.21.15.146:0/1177064474 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1c0012920 con 0x7ff1bc004010 2023-10-06T11:18:52.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.655+0000 7ff1d7f0e700 1 -- 172.21.15.146:0/1177064474 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1bc004010 msgr2=0x7ff1bc004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:52.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.655+0000 7ff1d7f0e700 1 --2- 172.21.15.146:0/1177064474 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1bc004010 0x7ff1bc004810 secure :-1 s=READY pgs=2227 cs=0 l=1 rev1=1 crypto rx=0x7ff1d015d580 tx=0x7ff1c0007d30 comp rx=0 tx=0).stop 2023-10-06T11:18:52.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.655+0000 7ff1d64ab700 1 -- 172.21.15.146:0/1177064474 reap_dead start 2023-10-06T11:18:52.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.655+0000 7ff1d7f0e700 1 -- 172.21.15.146:0/1177064474 shutdown_connections 2023-10-06T11:18:52.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.655+0000 7ff1d7f0e700 1 -- 172.21.15.146:0/1177064474 >> 172.21.15.146:0/1177064474 conn(0x7ff1d00ce420 msgr2=0x7ff1d00ce820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:52.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.655+0000 7ff1d7f0e700 1 -- 172.21.15.146:0/1177064474 shutdown_connections 2023-10-06T11:18:52.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.655+0000 7ff1d7f0e700 1 -- 172.21.15.146:0/1177064474 wait complete. 2023-10-06T11:18:52.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.656+0000 7ff1d7f0e700 1 Processor -- start 2023-10-06T11:18:52.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.657+0000 7ff1d7f0e700 1 -- start start 2023-10-06T11:18:52.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.657+0000 7ff1d7f0e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1bc004010 0x7ff1d00c6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:52.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.657+0000 7ff1d7f0e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1d00c6280 0x7ff1d0155930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:52.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.657+0000 7ff1d7f0e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1d0155e70 0x7ff1d00b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:52.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.657+0000 7ff1d7f0e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d00c66f0 con 0x7ff1d0155e70 2023-10-06T11:18:52.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.657+0000 7ff1d7f0e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d00c71d0 con 0x7ff1bc004010 2023-10-06T11:18:52.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.657+0000 7ff1d7f0e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d00c74b0 con 0x7ff1d00c6280 2023-10-06T11:18:52.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.657+0000 7ff1d64ab700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1d0155e70 0x7ff1d00b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:52.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.657+0000 7ff1d64ab700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1d0155e70 0x7ff1d00b31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58568/0 (socket says 172.21.15.146:58568) 2023-10-06T11:18:52.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.657+0000 7ff1d64ab700 1 -- 172.21.15.146:0/3837590818 learned_addr learned my addr 172.21.15.146:0/3837590818 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:52.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.657+0000 7ff1d54a9700 1 --2- 172.21.15.146:0/3837590818 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1d00c6280 0x7ff1d0155930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:52.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.657+0000 7ff1d5caa700 1 --2- 172.21.15.146:0/3837590818 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1bc004010 0x7ff1d00c6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:52.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.658+0000 7ff1d64ab700 1 -- 172.21.15.146:0/3837590818 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1d00c6280 msgr2=0x7ff1d0155930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:52.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.658+0000 7ff1d64ab700 1 --2- 172.21.15.146:0/3837590818 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1d00c6280 0x7ff1d0155930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:52.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.658+0000 7ff1d64ab700 1 -- 172.21.15.146:0/3837590818 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1bc004010 msgr2=0x7ff1d00c6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:52.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.658+0000 7ff1d64ab700 1 --2- 172.21.15.146:0/3837590818 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1bc004010 0x7ff1d00c6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:52.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.658+0000 7ff1d64ab700 1 -- 172.21.15.146:0/3837590818 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d00c7790 con 0x7ff1d0155e70 2023-10-06T11:18:52.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.658+0000 7ff1d64ab700 1 --2- 172.21.15.146:0/3837590818 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1d0155e70 0x7ff1d00b31e0 secure :-1 s=READY pgs=2228 cs=0 l=1 rev1=1 crypto rx=0x7ff1d00b4500 tx=0x7ff1cc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:52.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.658+0000 7ff1c5ffb700 1 -- 172.21.15.146:0/3837590818 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc00e040 con 0x7ff1d0155e70 2023-10-06T11:18:52.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.658+0000 7ff1c5ffb700 1 -- 172.21.15.146:0/3837590818 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1cc00f040 con 0x7ff1d0155e70 2023-10-06T11:18:52.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.658+0000 7ff1d7f0e700 1 -- 172.21.15.146:0/3837590818 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1d00c7a70 con 0x7ff1d0155e70 2023-10-06T11:18:52.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.658+0000 7ff1c5ffb700 1 -- 172.21.15.146:0/3837590818 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1cc00fd90 con 0x7ff1d0155e70 2023-10-06T11:18:52.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.658+0000 7ff1d7f0e700 1 -- 172.21.15.146:0/3837590818 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1d00c8270 con 0x7ff1d0155e70 2023-10-06T11:18:52.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.659+0000 7ff1d7f0e700 1 -- 172.21.15.146:0/3837590818 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1d00c7f90 con 0x7ff1d0155e70 2023-10-06T11:18:52.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.659+0000 7ff1c5ffb700 1 -- 172.21.15.146:0/3837590818 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff1cc015640 con 0x7ff1d0155e70 2023-10-06T11:18:52.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.660+0000 7ff1c5ffb700 1 --2- 172.21.15.146:0/3837590818 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff1b4066f30 0x7ff1b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:52.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.660+0000 7ff1c5ffb700 1 -- 172.21.15.146:0/3837590818 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff1cc084f90 con 0x7ff1d0155e70 2023-10-06T11:18:52.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.660+0000 7ff1d5caa700 1 --2- 172.21.15.146:0/3837590818 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff1b4066f30 0x7ff1b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:52.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.660+0000 7ff1d5caa700 1 --2- 172.21.15.146:0/3837590818 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff1b4066f30 0x7ff1b40693e0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8001ed0 tx=0x7ff1d00cf280 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:52.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.664+0000 7ff1c5ffb700 1 -- 172.21.15.146:0/3837590818 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff1d00c7f90 con 0x7ff1d0155e70 2023-10-06T11:18:52.848 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.847+0000 7ff1d7f0e700 1 -- 172.21.15.146:0/3837590818 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1d006af90 con 0x7ff1d0155e70 2023-10-06T11:18:52.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.848+0000 7ff1c5ffb700 1 -- 172.21.15.146:0/3837590818 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v176) v1 ==== 74+0+16941 (secure 0 0 0) 0x7ff1cc0520a0 con 0x7ff1d0155e70 2023-10-06T11:18:52.850 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:18:52.850 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":176,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:18:51.903602+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:18:49.540526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2023-10-06T11:18:50.844600+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:18:52.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.850+0000 7ff1d7f0e700 1 -- 172.21.15.146:0/3837590818 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff1b4066f30 msgr2=0x7ff1b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:52.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.850+0000 7ff1d7f0e700 1 --2- 172.21.15.146:0/3837590818 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff1b4066f30 0x7ff1b40693e0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7ff1c8001ed0 tx=0x7ff1d00cf280 comp rx=0 tx=0).stop 2023-10-06T11:18:52.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.850+0000 7ff1d7f0e700 1 -- 172.21.15.146:0/3837590818 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1d0155e70 msgr2=0x7ff1d00b31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:52.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.850+0000 7ff1d7f0e700 1 --2- 172.21.15.146:0/3837590818 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1d0155e70 0x7ff1d00b31e0 secure :-1 s=READY pgs=2228 cs=0 l=1 rev1=1 crypto rx=0x7ff1d00b4500 tx=0x7ff1cc00b040 comp rx=0 tx=0).stop 2023-10-06T11:18:52.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.850+0000 7ff1d7f0e700 1 -- 172.21.15.146:0/3837590818 shutdown_connections 2023-10-06T11:18:52.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.850+0000 7ff1d7f0e700 1 --2- 172.21.15.146:0/3837590818 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff1b4066f30 0x7ff1b40693e0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:52.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.850+0000 7ff1d7f0e700 1 --2- 172.21.15.146:0/3837590818 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff1d0155e70 0x7ff1d00b31e0 unknown :-1 s=CLOSED pgs=2228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:52.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.850+0000 7ff1d7f0e700 1 --2- 172.21.15.146:0/3837590818 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1bc004010 0x7ff1d00c6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:52.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.850+0000 7ff1d7f0e700 1 --2- 172.21.15.146:0/3837590818 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff1d00c6280 0x7ff1d0155930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:52.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.850+0000 7ff1d7f0e700 1 -- 172.21.15.146:0/3837590818 >> 172.21.15.146:0/3837590818 conn(0x7ff1d00ce420 msgr2=0x7ff1d006d670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:52.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.850+0000 7ff1d7f0e700 1 -- 172.21.15.146:0/3837590818 shutdown_connections 2023-10-06T11:18:52.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.850+0000 7ff1d7f0e700 1 -- 172.21.15.146:0/3837590818 wait complete. 2023-10-06T11:18:52.864 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:18:52.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.977+0000 7fc10547c700 1 Processor -- start 2023-10-06T11:18:52.979 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.977+0000 7fc10547c700 1 -- start start 2023-10-06T11:18:52.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.978+0000 7fc10547c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc100143040 0x7fc1000b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:52.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.978+0000 7fc10547c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc100143410 0x7fc1000b2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:52.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.978+0000 7fc10547c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1000cf100 con 0x7fc1000b4d20 2023-10-06T11:18:52.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.978+0000 7fc10547c700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1000b4170 con 0x7fc100143410 2023-10-06T11:18:52.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.978+0000 7fc10547c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1000b5f50 con 0x7fc100143040 2023-10-06T11:18:52.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.978+0000 7fc104c7b700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc1000b4d20 0x7fc1000b51a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36216/0 (socket says 172.21.15.146:36216) 2023-10-06T11:18:52.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.978+0000 7fc104c7b700 1 -- 172.21.15.146:0/3570126670 learned_addr learned my addr 172.21.15.146:0/3570126670 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:52.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.978+0000 7fc0fffff700 1 --2- 172.21.15.146:0/3570126670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc100143040 0x7fc1000b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:52.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.978+0000 7fc0ff7fe700 1 --2- 172.21.15.146:0/3570126670 >> v2:172.21.15.151:3300/0 conn(0x7fc100143410 0x7fc1000b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:52.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.978+0000 7fc0feffd700 1 -- 172.21.15.146:0/3570126670 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3416876277 0 0) 0x7fc1000cf100 con 0x7fc1000b4d20 2023-10-06T11:18:52.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.978+0000 7fc0feffd700 1 -- 172.21.15.146:0/3570126670 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0e8003570 con 0x7fc1000b4d20 2023-10-06T11:18:52.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.979+0000 7fc0ff7fe700 1 -- 172.21.15.146:0/3570126670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc100143040 msgr2=0x7fc1000b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:52.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.979+0000 7fc0ff7fe700 1 --2- 172.21.15.146:0/3570126670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc100143040 0x7fc1000b1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:52.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.979+0000 7fc0ff7fe700 1 -- 172.21.15.146:0/3570126670 >> v1:172.21.15.146:6789/0 conn(0x7fc1000b4d20 legacy=0x7fc1000b51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:52.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.979+0000 7fc0ff7fe700 1 -- 172.21.15.146:0/3570126670 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1000ceb30 con 0x7fc100143410 2023-10-06T11:18:52.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.979+0000 7fc0fffff700 1 --2- 172.21.15.146:0/3570126670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc100143040 0x7fc1000b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:18:52.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.979+0000 7fc0ff7fe700 1 --2- 172.21.15.146:0/3570126670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc100143410 0x7fc1000b2360 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fc0f00098e0 tx=0x7fc0f00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5363450b670833f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:52.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.979+0000 7fc0feffd700 1 -- 172.21.15.146:0/3570126670 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0011630 con 0x7fc100143410 2023-10-06T11:18:52.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.979+0000 7fc0feffd700 1 -- 172.21.15.146:0/3570126670 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f0011790 con 0x7fc100143410 2023-10-06T11:18:52.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.979+0000 7fc0feffd700 1 -- 172.21.15.146:0/3570126670 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0011b30 con 0x7fc100143410 2023-10-06T11:18:52.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.979+0000 7fc10547c700 1 -- 172.21.15.146:0/3570126670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc100143410 msgr2=0x7fc1000b2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:52.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.979+0000 7fc10547c700 1 --2- 172.21.15.146:0/3570126670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc100143410 0x7fc1000b2360 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fc0f00098e0 tx=0x7fc0f00091a0 comp rx=0 tx=0).stop 2023-10-06T11:18:52.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.979+0000 7fc10547c700 1 -- 172.21.15.146:0/3570126670 shutdown_connections 2023-10-06T11:18:52.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.979+0000 7fc10547c700 1 --2- 172.21.15.146:0/3570126670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc100143040 0x7fc1000b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:52.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.979+0000 7fc10547c700 1 --2- 172.21.15.146:0/3570126670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc100143410 0x7fc1000b2360 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:52.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.979+0000 7fc10547c700 1 -- 172.21.15.146:0/3570126670 >> 172.21.15.146:0/3570126670 conn(0x7fc10006eb10 msgr2=0x7fc10006ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:52.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.980+0000 7fc10547c700 1 -- 172.21.15.146:0/3570126670 shutdown_connections 2023-10-06T11:18:52.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.980+0000 7fc10547c700 1 -- 172.21.15.146:0/3570126670 wait complete. 2023-10-06T11:18:52.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.981+0000 7fc10547c700 1 Processor -- start 2023-10-06T11:18:52.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.981+0000 7fc10547c700 1 -- start start 2023-10-06T11:18:52.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.981+0000 7fc10547c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1000b4d20 0x7fc10016e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:52.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.981+0000 7fc10547c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc100143040 0x7fc100141fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:52.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.981+0000 7fc10547c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc100143410 0x7fc10013b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:52.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.981+0000 7fc10547c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc100141b30 con 0x7fc100143040 2023-10-06T11:18:52.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.982+0000 7fc10547c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10013b570 con 0x7fc1000b4d20 2023-10-06T11:18:52.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.982+0000 7fc10547c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1000b0610 con 0x7fc100143410 2023-10-06T11:18:52.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.982+0000 7fc0ff7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc100143040 0x7fc100141fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:52.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.982+0000 7fc0ff7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc100143040 0x7fc100141fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58570/0 (socket says 172.21.15.146:58570) 2023-10-06T11:18:52.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.982+0000 7fc0ff7fe700 1 -- 172.21.15.146:0/3412577884 learned_addr learned my addr 172.21.15.146:0/3412577884 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:52.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.982+0000 7fc0fffff700 1 --2- 172.21.15.146:0/3412577884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1000b4d20 0x7fc10016e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:52.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.982+0000 7fc104c7b700 1 --2- 172.21.15.146:0/3412577884 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc100143410 0x7fc10013b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:52.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.982+0000 7fc0ff7fe700 1 -- 172.21.15.146:0/3412577884 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc100143410 msgr2=0x7fc10013b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:52.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.982+0000 7fc0ff7fe700 1 --2- 172.21.15.146:0/3412577884 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc100143410 0x7fc10013b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:52.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.982+0000 7fc0ff7fe700 1 -- 172.21.15.146:0/3412577884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1000b4d20 msgr2=0x7fc10016e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:52.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.982+0000 7fc0ff7fe700 1 --2- 172.21.15.146:0/3412577884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1000b4d20 0x7fc10016e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:52.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.982+0000 7fc0ff7fe700 1 -- 172.21.15.146:0/3412577884 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f4009420 con 0x7fc100143040 2023-10-06T11:18:52.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.982+0000 7fc0fffff700 1 --2- 172.21.15.146:0/3412577884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1000b4d20 0x7fc10016e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:18:52.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.982+0000 7fc0ff7fe700 1 --2- 172.21.15.146:0/3412577884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc100143040 0x7fc100141fc0 secure :-1 s=READY pgs=2230 cs=0 l=1 rev1=1 crypto rx=0x7fc100065830 tx=0x7fc0f0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:52.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.982+0000 7fc0e7fff700 1 -- 172.21.15.146:0/3412577884 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0011b10 con 0x7fc100143040 2023-10-06T11:18:52.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.982+0000 7fc0e7fff700 1 -- 172.21.15.146:0/3412577884 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f00253f0 con 0x7fc100143040 2023-10-06T11:18:52.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.982+0000 7fc10547c700 1 -- 172.21.15.146:0/3412577884 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0f0009420 con 0x7fc100143040 2023-10-06T11:18:52.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.982+0000 7fc0e7fff700 1 -- 172.21.15.146:0/3412577884 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0025790 con 0x7fc100143040 2023-10-06T11:18:52.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.982+0000 7fc10547c700 1 -- 172.21.15.146:0/3412577884 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1001414e0 con 0x7fc100143040 2023-10-06T11:18:52.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.983+0000 7fc10547c700 1 -- 172.21.15.146:0/3412577884 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc100141340 con 0x7fc100143040 2023-10-06T11:18:52.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.984+0000 7fc0e7fff700 1 -- 172.21.15.146:0/3412577884 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc0f0025b80 con 0x7fc100143040 2023-10-06T11:18:52.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.984+0000 7fc0e7fff700 1 --2- 172.21.15.146:0/3412577884 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc0ec066f30 0x7fc0ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:52.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.984+0000 7fc0e7fff700 1 -- 172.21.15.146:0/3412577884 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc0f0085e50 con 0x7fc100143040 2023-10-06T11:18:52.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.984+0000 7fc0fffff700 1 --2- 172.21.15.146:0/3412577884 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc0ec066f30 0x7fc0ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:52.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.984+0000 7fc0fffff700 1 --2- 172.21.15.146:0/3412577884 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc0ec066f30 0x7fc0ec0693e0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fc0f40093f0 tx=0x7fc0f4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:52.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:52.988+0000 7fc0e7fff700 1 -- 172.21.15.146:0/3412577884 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc100141340 con 0x7fc100143040 2023-10-06T11:18:53.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.170+0000 7fc10547c700 1 -- 172.21.15.146:0/3412577884 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc100141340 con 0x7fc100143040 2023-10-06T11:18:53.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.171+0000 7fc0e7fff700 1 -- 172.21.15.146:0/3412577884 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v176) v1 ==== 74+0+16941 (secure 0 0 0) 0x7fc100141340 con 0x7fc100143040 2023-10-06T11:18:53.174 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:18:53.174 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":176,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:18:51.903602+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:18:49.540526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2023-10-06T11:18:50.844600+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:18:53.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.173+0000 7fc10547c700 1 -- 172.21.15.146:0/3412577884 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc0ec066f30 msgr2=0x7fc0ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:53.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.173+0000 7fc10547c700 1 --2- 172.21.15.146:0/3412577884 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc0ec066f30 0x7fc0ec0693e0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fc0f40093f0 tx=0x7fc0f4008040 comp rx=0 tx=0).stop 2023-10-06T11:18:53.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.173+0000 7fc10547c700 1 -- 172.21.15.146:0/3412577884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc100143040 msgr2=0x7fc100141fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:53.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.173+0000 7fc10547c700 1 --2- 172.21.15.146:0/3412577884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc100143040 0x7fc100141fc0 secure :-1 s=READY pgs=2230 cs=0 l=1 rev1=1 crypto rx=0x7fc100065830 tx=0x7fc0f0017000 comp rx=0 tx=0).stop 2023-10-06T11:18:53.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.173+0000 7fc10547c700 1 -- 172.21.15.146:0/3412577884 shutdown_connections 2023-10-06T11:18:53.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.173+0000 7fc10547c700 1 --2- 172.21.15.146:0/3412577884 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc0ec066f30 0x7fc0ec0693e0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:53.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.173+0000 7fc10547c700 1 --2- 172.21.15.146:0/3412577884 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc100143410 0x7fc10013b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:53.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.173+0000 7fc10547c700 1 --2- 172.21.15.146:0/3412577884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1000b4d20 0x7fc10016e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:53.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.173+0000 7fc10547c700 1 --2- 172.21.15.146:0/3412577884 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc100143040 0x7fc100141fc0 unknown :-1 s=CLOSED pgs=2230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:53.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.173+0000 7fc10547c700 1 -- 172.21.15.146:0/3412577884 >> 172.21.15.146:0/3412577884 conn(0x7fc10006eb10 msgr2=0x7fc1000b1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:53.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.174+0000 7fc10547c700 1 -- 172.21.15.146:0/3412577884 shutdown_connections 2023-10-06T11:18:53.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.174+0000 7fc10547c700 1 -- 172.21.15.146:0/3412577884 wait complete. 2023-10-06T11:18:53.188 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T11:18:53.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.303+0000 7fdff99a5700 1 Processor -- start 2023-10-06T11:18:53.305 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.303+0000 7fdff99a5700 1 -- start start 2023-10-06T11:18:53.309 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.304+0000 7fdff99a5700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdff4159450 0x7fdff4159820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:53.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.304+0000 7fdff99a5700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdff40cb8a0 con 0x7fdff415dd70 2023-10-06T11:18:53.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.304+0000 7fdff99a5700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdff40b2960 con 0x7fdff40b0930 2023-10-06T11:18:53.310 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.304+0000 7fdff99a5700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff40b2f20 con 0x7fdff4159450 2023-10-06T11:18:53.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.304+0000 7fdff27fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fdff415dd70 0x7fdff40b0220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36230/0 (socket says 172.21.15.146:36230) 2023-10-06T11:18:53.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.304+0000 7fdff27fc700 1 -- 172.21.15.146:0/1837175837 learned_addr learned my addr 172.21.15.146:0/1837175837 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:53.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.305+0000 7fdff2ffd700 1 --2- 172.21.15.146:0/1837175837 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdff4159450 0x7fdff4159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:53.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.305+0000 7fdff1ffb700 1 -- 172.21.15.146:0/1837175837 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1238230149 0 0) 0x7fdff40cb8a0 con 0x7fdff415dd70 2023-10-06T11:18:53.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.305+0000 7fdff1ffb700 1 -- 172.21.15.146:0/1837175837 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfdc003570 con 0x7fdff415dd70 2023-10-06T11:18:53.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.305+0000 7fdff1ffb700 1 -- 172.21.15.146:0/1837175837 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2331484693 0 0) 0x7fdff40b2960 con 0x7fdff40b0930 2023-10-06T11:18:53.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.305+0000 7fdff1ffb700 1 -- 172.21.15.146:0/1837175837 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdff40cb8a0 con 0x7fdff40b0930 2023-10-06T11:18:53.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.305+0000 7fdff1ffb700 1 -- 172.21.15.146:0/1837175837 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3706837775 0 0) 0x7fdfdc003570 con 0x7fdff415dd70 2023-10-06T11:18:53.311 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.305+0000 7fdff1ffb700 1 -- 172.21.15.146:0/1837175837 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdff4159450 msgr2=0x7fdff4159820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:53.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.305+0000 7fdff1ffb700 1 --2- 172.21.15.146:0/1837175837 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdff4159450 0x7fdff4159820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:53.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.305+0000 7fdff1ffb700 1 -- 172.21.15.146:0/1837175837 >> v1:172.21.15.151:6789/0 conn(0x7fdff40b0930 legacy=0x7fdff40aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:53.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.305+0000 7fdff1ffb700 1 -- 172.21.15.146:0/1837175837 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff40b2c40 con 0x7fdff415dd70 2023-10-06T11:18:53.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.305+0000 7fdff1ffb700 1 -- 172.21.15.146:0/1837175837 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fdfe8001470 con 0x7fdff415dd70 2023-10-06T11:18:53.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.305+0000 7fdff1ffb700 1 -- 172.21.15.146:0/1837175837 >> v1:172.21.15.146:6789/0 conn(0x7fdff415dd70 legacy=0x7fdff40b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:53.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.305+0000 7fdff1ffb700 1 --2- 172.21.15.146:0/1837175837 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfdc003c20 0x7fdfdc004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:53.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.305+0000 7fdff1ffb700 1 --2- 172.21.15.146:0/1837175837 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdff4159450 0x7fdfdc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:53.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.305+0000 7fdff1ffb700 1 --2- 172.21.15.146:0/1837175837 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdfdc004d50 0x7fdfdc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:53.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.305+0000 7fdff1ffb700 1 -- 172.21.15.146:0/1837175837 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff40b2f20 con 0x7fdfdc003c20 2023-10-06T11:18:53.312 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.305+0000 7fdff1ffb700 1 -- 172.21.15.146:0/1837175837 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc00bb40 con 0x7fdfdc004d50 2023-10-06T11:18:53.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.305+0000 7fdff1ffb700 1 -- 172.21.15.146:0/1837175837 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc00bd00 con 0x7fdff4159450 2023-10-06T11:18:53.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.305+0000 7fdff2ffd700 1 --2- 172.21.15.146:0/1837175837 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfdc003c20 0x7fdfdc004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:53.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.305+0000 7fdff27fc700 1 --2- 172.21.15.146:0/1837175837 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdff4159450 0x7fdfdc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:53.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.305+0000 7fdff37fe700 1 --2- 172.21.15.146:0/1837175837 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdfdc004d50 0x7fdfdc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:53.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.305+0000 7fdff2ffd700 1 -- 172.21.15.146:0/1837175837 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdff4159450 msgr2=0x7fdfdc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:53.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.305+0000 7fdff2ffd700 1 --2- 172.21.15.146:0/1837175837 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdff4159450 0x7fdfdc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:53.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.305+0000 7fdff2ffd700 1 -- 172.21.15.146:0/1837175837 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdfdc004d50 msgr2=0x7fdfdc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:53.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.305+0000 7fdff2ffd700 1 --2- 172.21.15.146:0/1837175837 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdfdc004d50 0x7fdfdc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:53.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.305+0000 7fdff2ffd700 1 -- 172.21.15.146:0/1837175837 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfdc003570 con 0x7fdfdc003c20 2023-10-06T11:18:53.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.305+0000 7fdff37fe700 1 --2- 172.21.15.146:0/1837175837 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdfdc004d50 0x7fdfdc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:18:53.313 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.306+0000 7fdff2ffd700 1 --2- 172.21.15.146:0/1837175837 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfdc003c20 0x7fdfdc004010 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 crypto rx=0x7fdfe400e210 tx=0x7fdfe400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c46af963048d1995 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:53.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.306+0000 7fdff1ffb700 1 -- 172.21.15.146:0/1837175837 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe400eac0 con 0x7fdfdc003c20 2023-10-06T11:18:53.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.306+0000 7fdff1ffb700 1 -- 172.21.15.146:0/1837175837 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe400f040 con 0x7fdfdc003c20 2023-10-06T11:18:53.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.306+0000 7fdff1ffb700 1 -- 172.21.15.146:0/1837175837 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe400ee70 con 0x7fdfdc003c20 2023-10-06T11:18:53.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.306+0000 7fdff99a5700 1 -- 172.21.15.146:0/1837175837 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfdc003c20 msgr2=0x7fdfdc004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:53.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.306+0000 7fdff99a5700 1 --2- 172.21.15.146:0/1837175837 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfdc003c20 0x7fdfdc004010 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 crypto rx=0x7fdfe400e210 tx=0x7fdfe400b040 comp rx=0 tx=0).stop 2023-10-06T11:18:53.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.306+0000 7fdff37fe700 1 -- 172.21.15.146:0/1837175837 reap_dead start 2023-10-06T11:18:53.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.306+0000 7fdff99a5700 1 -- 172.21.15.146:0/1837175837 shutdown_connections 2023-10-06T11:18:53.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.306+0000 7fdff99a5700 1 -- 172.21.15.146:0/1837175837 >> 172.21.15.146:0/1837175837 conn(0x7fdff406eb10 msgr2=0x7fdff406ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:53.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.306+0000 7fdff99a5700 1 -- 172.21.15.146:0/1837175837 shutdown_connections 2023-10-06T11:18:53.314 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.306+0000 7fdff99a5700 1 -- 172.21.15.146:0/1837175837 wait complete. 2023-10-06T11:18:53.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.307+0000 7fdff99a5700 1 Processor -- start 2023-10-06T11:18:53.315 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.307+0000 7fdff99a5700 1 -- start start 2023-10-06T11:18:53.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.308+0000 7fdff99a5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfdc003c20 0x7fdff416cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:53.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.308+0000 7fdff99a5700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdff40ae760 0x7fdff415a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:53.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.308+0000 7fdff99a5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdff415acc0 0x7fdff415c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:53.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.308+0000 7fdff99a5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff416be40 con 0x7fdfdc003c20 2023-10-06T11:18:53.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.308+0000 7fdff99a5700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff416c120 con 0x7fdff415acc0 2023-10-06T11:18:53.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.308+0000 7fdff99a5700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff416c400 con 0x7fdff40ae760 2023-10-06T11:18:53.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.308+0000 7fdff2ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfdc003c20 0x7fdff416cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:53.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.308+0000 7fdff2ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfdc003c20 0x7fdff416cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58590/0 (socket says 172.21.15.146:58590) 2023-10-06T11:18:53.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.308+0000 7fdff2ffd700 1 -- 172.21.15.146:0/2005011656 learned_addr learned my addr 172.21.15.146:0/2005011656 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:53.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.309+0000 7fdff27fc700 1 --2- 172.21.15.146:0/2005011656 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdff40ae760 0x7fdff415a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:53.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.309+0000 7fdff37fe700 1 --2- 172.21.15.146:0/2005011656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdff415acc0 0x7fdff415c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:53.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.309+0000 7fdff2ffd700 1 -- 172.21.15.146:0/2005011656 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdff40ae760 msgr2=0x7fdff415a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:53.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.309+0000 7fdff2ffd700 1 --2- 172.21.15.146:0/2005011656 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdff40ae760 0x7fdff415a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:53.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.309+0000 7fdff2ffd700 1 -- 172.21.15.146:0/2005011656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdff415acc0 msgr2=0x7fdff415c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:53.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.309+0000 7fdff2ffd700 1 --2- 172.21.15.146:0/2005011656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdff415acc0 0x7fdff415c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:53.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.309+0000 7fdff2ffd700 1 -- 172.21.15.146:0/2005011656 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff416c6e0 con 0x7fdfdc003c20 2023-10-06T11:18:53.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.309+0000 7fdff2ffd700 1 --2- 172.21.15.146:0/2005011656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfdc003c20 0x7fdff416cee0 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 crypto rx=0x7fdfe400afd0 tx=0x7fdfe401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:53.318 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.309+0000 7fdfdaffd700 1 -- 172.21.15.146:0/2005011656 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe4029450 con 0x7fdfdc003c20 2023-10-06T11:18:53.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.309+0000 7fdfdaffd700 1 -- 172.21.15.146:0/2005011656 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe40295b0 con 0x7fdfdc003c20 2023-10-06T11:18:53.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.309+0000 7fdff99a5700 1 -- 172.21.15.146:0/2005011656 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdff416c9c0 con 0x7fdfdc003c20 2023-10-06T11:18:53.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.309+0000 7fdfdaffd700 1 -- 172.21.15.146:0/2005011656 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe40299b0 con 0x7fdfdc003c20 2023-10-06T11:18:53.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.309+0000 7fdff99a5700 1 -- 172.21.15.146:0/2005011656 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdff40aebd0 con 0x7fdfdc003c20 2023-10-06T11:18:53.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.310+0000 7fdff99a5700 1 -- 172.21.15.146:0/2005011656 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdff404c380 con 0x7fdfdc003c20 2023-10-06T11:18:53.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.310+0000 7fdfdaffd700 1 -- 172.21.15.146:0/2005011656 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdfe4003040 con 0x7fdfdc003c20 2023-10-06T11:18:53.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.311+0000 7fdfdaffd700 1 --2- 172.21.15.146:0/2005011656 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdfe0066f30 0x7fdfe00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:53.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.311+0000 7fdff27fc700 1 --2- 172.21.15.146:0/2005011656 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdfe0066f30 0x7fdfe00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:53.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.311+0000 7fdfdaffd700 1 -- 172.21.15.146:0/2005011656 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdfe4086a70 con 0x7fdfdc003c20 2023-10-06T11:18:53.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.311+0000 7fdff27fc700 1 --2- 172.21.15.146:0/2005011656 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdfe0066f30 0x7fdfe00693e0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fdfe8001660 tx=0x7fdfe8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:53.319 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.315+0000 7fdfdaffd700 1 -- 172.21.15.146:0/2005011656 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdfe4053b80 con 0x7fdfdc003c20 2023-10-06T11:18:53.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:53.543+0000 7fdff99a5700 1 -- 172.21.15.146:0/2005011656 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fdff40cb530 con 0x7fdfdc003c20 2023-10-06T11:18:54.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.524+0000 7fdfdaffd700 1 -- 172.21.15.146:0/2005011656 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v143) v1 ==== 118+0+0 (secure 0 0 0) 0x7fdfe402e0b0 con 0x7fdfdc003c20 2023-10-06T11:18:54.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.527+0000 7fdff99a5700 1 -- 172.21.15.146:0/2005011656 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdfe0066f30 msgr2=0x7fdfe00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:54.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.527+0000 7fdff99a5700 1 --2- 172.21.15.146:0/2005011656 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdfe0066f30 0x7fdfe00693e0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fdfe8001660 tx=0x7fdfe8009040 comp rx=0 tx=0).stop 2023-10-06T11:18:54.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.527+0000 7fdff99a5700 1 -- 172.21.15.146:0/2005011656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfdc003c20 msgr2=0x7fdff416cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:54.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.527+0000 7fdff99a5700 1 --2- 172.21.15.146:0/2005011656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfdc003c20 0x7fdff416cee0 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 crypto rx=0x7fdfe400afd0 tx=0x7fdfe401a000 comp rx=0 tx=0).stop 2023-10-06T11:18:54.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.527+0000 7fdff99a5700 1 -- 172.21.15.146:0/2005011656 shutdown_connections 2023-10-06T11:18:54.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.527+0000 7fdff99a5700 1 --2- 172.21.15.146:0/2005011656 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdfe0066f30 0x7fdfe00693e0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:54.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.527+0000 7fdff99a5700 1 --2- 172.21.15.146:0/2005011656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdff415acc0 0x7fdff415c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:54.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.527+0000 7fdff99a5700 1 --2- 172.21.15.146:0/2005011656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdfdc003c20 0x7fdff416cee0 unknown :-1 s=CLOSED pgs=2233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:54.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.527+0000 7fdff99a5700 1 --2- 172.21.15.146:0/2005011656 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdff40ae760 0x7fdff415a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:54.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.527+0000 7fdff99a5700 1 -- 172.21.15.146:0/2005011656 >> 172.21.15.146:0/2005011656 conn(0x7fdff406eb10 msgr2=0x7fdff40ced40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:54.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.527+0000 7fdff99a5700 1 -- 172.21.15.146:0/2005011656 shutdown_connections 2023-10-06T11:18:54.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.527+0000 7fdff99a5700 1 -- 172.21.15.146:0/2005011656 wait complete. 2023-10-06T11:18:54.542 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T11:18:54.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.659+0000 7fc72962b700 1 Processor -- start 2023-10-06T11:18:54.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.659+0000 7fc72962b700 1 -- start start 2023-10-06T11:18:54.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.660+0000 7fc72962b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc7240b0930 0x7fc7240aef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:54.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.660+0000 7fc72962b700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7240cb8a0 con 0x7fc724159820 2023-10-06T11:18:54.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.660+0000 7fc72962b700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc724159c70 con 0x7fc724159450 2023-10-06T11:18:54.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.660+0000 7fc72962b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7240b2f20 con 0x7fc7240b0930 2023-10-06T11:18:54.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.660+0000 7fc7237fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc7240b0930 0x7fc7240aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:54.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.660+0000 7fc71a7fc700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc724159820 0x7fc7240b0220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36236/0 (socket says 172.21.15.146:36236) 2023-10-06T11:18:54.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.660+0000 7fc71a7fc700 1 -- 172.21.15.146:0/2898918646 learned_addr learned my addr 172.21.15.146:0/2898918646 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:54.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.660+0000 7fc7237fe700 1 -- 172.21.15.146:0/2898918646 >> v1:172.21.15.151:6789/0 conn(0x7fc724159450 legacy=0x7fc72415dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:54.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.660+0000 7fc7237fe700 1 -- 172.21.15.146:0/2898918646 >> v1:172.21.15.146:6789/0 conn(0x7fc724159820 legacy=0x7fc7240b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:54.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.660+0000 7fc7227fc700 1 -- 172.21.15.146:0/2898918646 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1134146818 0 0) 0x7fc7240cb8a0 con 0x7fc724159820 2023-10-06T11:18:54.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.661+0000 7fc7237fe700 1 -- 172.21.15.146:0/2898918646 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7240b2960 con 0x7fc7240b0930 2023-10-06T11:18:54.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.661+0000 7fc7237fe700 1 --2- 172.21.15.146:0/2898918646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7240b0930 0x7fc7240aef90 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 crypto rx=0x7fc71c009e60 tx=0x7fc71c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52fb32d487a0caa4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:54.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.661+0000 7fc7227fc700 1 -- 172.21.15.146:0/2898918646 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71c00e070 con 0x7fc7240b0930 2023-10-06T11:18:54.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.661+0000 7fc7227fc700 1 -- 172.21.15.146:0/2898918646 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc71c00bc30 con 0x7fc7240b0930 2023-10-06T11:18:54.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.661+0000 7fc7227fc700 1 -- 172.21.15.146:0/2898918646 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71c012430 con 0x7fc7240b0930 2023-10-06T11:18:54.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.661+0000 7fc72962b700 1 -- 172.21.15.146:0/2898918646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7240b0930 msgr2=0x7fc7240aef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:54.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.661+0000 7fc72962b700 1 --2- 172.21.15.146:0/2898918646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7240b0930 0x7fc7240aef90 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 crypto rx=0x7fc71c009e60 tx=0x7fc71c009780 comp rx=0 tx=0).stop 2023-10-06T11:18:54.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.661+0000 7fc72962b700 1 -- 172.21.15.146:0/2898918646 shutdown_connections 2023-10-06T11:18:54.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.661+0000 7fc72962b700 1 --2- 172.21.15.146:0/2898918646 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7240b0930 0x7fc7240aef90 unknown :-1 s=CLOSED pgs=2235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:54.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.661+0000 7fc72962b700 1 -- 172.21.15.146:0/2898918646 >> 172.21.15.146:0/2898918646 conn(0x7fc72406eb10 msgr2=0x7fc72406ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:54.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.661+0000 7fc72962b700 1 -- 172.21.15.146:0/2898918646 shutdown_connections 2023-10-06T11:18:54.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.661+0000 7fc72962b700 1 -- 172.21.15.146:0/2898918646 wait complete. 2023-10-06T11:18:54.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.663+0000 7fc72962b700 1 Processor -- start 2023-10-06T11:18:54.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.663+0000 7fc72962b700 1 -- start start 2023-10-06T11:18:54.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.663+0000 7fc72962b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7240b0930 0x7fc724153b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:54.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.663+0000 7fc72962b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc724159450 0x7fc7240b5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:54.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.663+0000 7fc72962b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc724159820 0x7fc7240b5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:54.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.663+0000 7fc72962b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7240c8120 con 0x7fc7240b0930 2023-10-06T11:18:54.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.663+0000 7fc72962b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7240c77f0 con 0x7fc724159450 2023-10-06T11:18:54.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.663+0000 7fc72962b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7240c7ad0 con 0x7fc724159820 2023-10-06T11:18:54.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.664+0000 7fc722ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7240b0930 0x7fc724153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:54.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.664+0000 7fc722ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7240b0930 0x7fc724153b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58598/0 (socket says 172.21.15.146:58598) 2023-10-06T11:18:54.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.664+0000 7fc722ffd700 1 -- 172.21.15.146:0/2563965860 learned_addr learned my addr 172.21.15.146:0/2563965860 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:54.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.664+0000 7fc71a7fc700 1 --2- 172.21.15.146:0/2563965860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc724159450 0x7fc7240b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:54.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.664+0000 7fc7237fe700 1 --2- 172.21.15.146:0/2563965860 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc724159820 0x7fc7240b5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:54.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.664+0000 7fc722ffd700 1 -- 172.21.15.146:0/2563965860 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc724159820 msgr2=0x7fc7240b5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:54.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.664+0000 7fc722ffd700 1 --2- 172.21.15.146:0/2563965860 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc724159820 0x7fc7240b5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:54.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.664+0000 7fc722ffd700 1 -- 172.21.15.146:0/2563965860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc724159450 msgr2=0x7fc7240b5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:54.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.664+0000 7fc722ffd700 1 --2- 172.21.15.146:0/2563965860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc724159450 0x7fc7240b5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:54.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.664+0000 7fc722ffd700 1 -- 172.21.15.146:0/2563965860 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc71c009a20 con 0x7fc7240b0930 2023-10-06T11:18:54.677 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.664+0000 7fc722ffd700 1 --2- 172.21.15.146:0/2563965860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7240b0930 0x7fc724153b80 secure :-1 s=READY pgs=2236 cs=0 l=1 rev1=1 crypto rx=0x7fc71400c590 tx=0x7fc71400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:54.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.664+0000 7fc71b7fe700 1 -- 172.21.15.146:0/2563965860 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc714011590 con 0x7fc7240b0930 2023-10-06T11:18:54.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.664+0000 7fc71b7fe700 1 -- 172.21.15.146:0/2563965860 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7140116f0 con 0x7fc7240b0930 2023-10-06T11:18:54.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.664+0000 7fc72962b700 1 -- 172.21.15.146:0/2563965860 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7240c7db0 con 0x7fc7240b0930 2023-10-06T11:18:54.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.664+0000 7fc71b7fe700 1 -- 172.21.15.146:0/2563965860 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc714011ab0 con 0x7fc7240b0930 2023-10-06T11:18:54.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.664+0000 7fc72962b700 1 -- 172.21.15.146:0/2563965860 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc724159ea0 con 0x7fc7240b0930 2023-10-06T11:18:54.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.665+0000 7fc72962b700 1 -- 172.21.15.146:0/2563965860 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc72404c380 con 0x7fc7240b0930 2023-10-06T11:18:54.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.666+0000 7fc71b7fe700 1 -- 172.21.15.146:0/2563965860 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc71401b3b0 con 0x7fc7240b0930 2023-10-06T11:18:54.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.666+0000 7fc71b7fe700 1 --2- 172.21.15.146:0/2563965860 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc704066f30 0x7fc7040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:54.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.666+0000 7fc71b7fe700 1 -- 172.21.15.146:0/2563965860 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc714083c80 con 0x7fc7240b0930 2023-10-06T11:18:54.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.666+0000 7fc71a7fc700 1 --2- 172.21.15.146:0/2563965860 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc704066f30 0x7fc7040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:54.678 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.666+0000 7fc71a7fc700 1 --2- 172.21.15.146:0/2563965860 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc704066f30 0x7fc7040693e0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fc7240cc5b0 tx=0x7fc70c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:54.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.670+0000 7fc71b7fe700 1 -- 172.21.15.146:0/2563965860 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc714050d90 con 0x7fc7240b0930 2023-10-06T11:18:54.895 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:54.894+0000 7fc72962b700 1 -- 172.21.15.146:0/2563965860 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc7240b2c40 con 0x7fc7240b0930 2023-10-06T11:18:55.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.528+0000 7fc71b7fe700 1 -- 172.21.15.146:0/2563965860 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v144) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc714017070 con 0x7fc7240b0930 2023-10-06T11:18:55.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.531+0000 7fc72962b700 1 -- 172.21.15.146:0/2563965860 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc704066f30 msgr2=0x7fc7040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:55.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.531+0000 7fc72962b700 1 --2- 172.21.15.146:0/2563965860 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc704066f30 0x7fc7040693e0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fc7240cc5b0 tx=0x7fc70c009040 comp rx=0 tx=0).stop 2023-10-06T11:18:55.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.531+0000 7fc72962b700 1 -- 172.21.15.146:0/2563965860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7240b0930 msgr2=0x7fc724153b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:55.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.531+0000 7fc72962b700 1 --2- 172.21.15.146:0/2563965860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7240b0930 0x7fc724153b80 secure :-1 s=READY pgs=2236 cs=0 l=1 rev1=1 crypto rx=0x7fc71400c590 tx=0x7fc71400c950 comp rx=0 tx=0).stop 2023-10-06T11:18:55.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.531+0000 7fc72962b700 1 -- 172.21.15.146:0/2563965860 shutdown_connections 2023-10-06T11:18:55.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.531+0000 7fc72962b700 1 --2- 172.21.15.146:0/2563965860 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc704066f30 0x7fc7040693e0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:55.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.531+0000 7fc72962b700 1 --2- 172.21.15.146:0/2563965860 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc724159820 0x7fc7240b5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:55.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.531+0000 7fc72962b700 1 --2- 172.21.15.146:0/2563965860 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7240b0930 0x7fc724153b80 unknown :-1 s=CLOSED pgs=2236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:55.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.531+0000 7fc72962b700 1 --2- 172.21.15.146:0/2563965860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc724159450 0x7fc7240b5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:55.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.531+0000 7fc72962b700 1 -- 172.21.15.146:0/2563965860 >> 172.21.15.146:0/2563965860 conn(0x7fc72406eb10 msgr2=0x7fc7240ccda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:55.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.531+0000 7fc72962b700 1 -- 172.21.15.146:0/2563965860 shutdown_connections 2023-10-06T11:18:55.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.531+0000 7fc72962b700 1 -- 172.21.15.146:0/2563965860 wait complete. 2023-10-06T11:18:55.546 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:18:55.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.659+0000 7fa568ab3700 1 Processor -- start 2023-10-06T11:18:55.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.659+0000 7fa568ab3700 1 -- start start 2023-10-06T11:18:55.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.660+0000 7fa568ab3700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa564067630 0x7fa5640c7860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:55.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.660+0000 7fa568ab3700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa564067a00 0x7fa5640ca6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:55.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.660+0000 7fa568ab3700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5640cac30 con 0x7fa5640a98e0 2023-10-06T11:18:55.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.660+0000 7fa568ab3700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5640c8b50 con 0x7fa564067630 2023-10-06T11:18:55.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.660+0000 7fa568ab3700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5640c7f40 con 0x7fa564067a00 2023-10-06T11:18:55.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.660+0000 7fa56259c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa564067630 0x7fa5640c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:55.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.660+0000 7fa56259c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa564067630 0x7fa5640c7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58602/0 (socket says 172.21.15.146:58602) 2023-10-06T11:18:55.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.660+0000 7fa56259c700 1 -- 172.21.15.146:0/927824957 learned_addr learned my addr 172.21.15.146:0/927824957 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:55.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.661+0000 7fa559d9b700 1 --2- 172.21.15.146:0/927824957 >> v2:172.21.15.151:3300/0 conn(0x7fa564067a00 0x7fa5640ca6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:55.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.661+0000 7fa56259c700 1 -- 172.21.15.146:0/927824957 >> v2:172.21.15.151:3300/0 conn(0x7fa564067a00 msgr2=0x7fa5640ca6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:55.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.661+0000 7fa56259c700 1 --2- 172.21.15.146:0/927824957 >> v2:172.21.15.151:3300/0 conn(0x7fa564067a00 0x7fa5640ca6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:55.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.661+0000 7fa56259c700 1 -- 172.21.15.146:0/927824957 >> v1:172.21.15.151:6789/0 conn(0x7fa5640a98e0 legacy=0x7fa5641594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:55.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.661+0000 7fa56259c700 1 -- 172.21.15.146:0/927824957 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5640c8220 con 0x7fa564067630 2023-10-06T11:18:55.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.661+0000 7fa56259c700 1 --2- 172.21.15.146:0/927824957 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa564067630 0x7fa5640c7860 secure :-1 s=READY pgs=2237 cs=0 l=1 rev1=1 crypto rx=0x7fa56406d460 tx=0x7fa554009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=280966936235cd81 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:55.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.661+0000 7fa561d9b700 1 -- 172.21.15.146:0/927824957 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55400b820 con 0x7fa564067630 2023-10-06T11:18:55.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.661+0000 7fa561d9b700 1 -- 172.21.15.146:0/927824957 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55400b980 con 0x7fa564067630 2023-10-06T11:18:55.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.661+0000 7fa561d9b700 1 -- 172.21.15.146:0/927824957 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55400bd20 con 0x7fa564067630 2023-10-06T11:18:55.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.661+0000 7fa568ab3700 1 -- 172.21.15.146:0/927824957 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa564067630 msgr2=0x7fa5640c7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:55.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.661+0000 7fa568ab3700 1 --2- 172.21.15.146:0/927824957 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa564067630 0x7fa5640c7860 secure :-1 s=READY pgs=2237 cs=0 l=1 rev1=1 crypto rx=0x7fa56406d460 tx=0x7fa554009250 comp rx=0 tx=0).stop 2023-10-06T11:18:55.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.661+0000 7fa568ab3700 1 -- 172.21.15.146:0/927824957 shutdown_connections 2023-10-06T11:18:55.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.661+0000 7fa568ab3700 1 --2- 172.21.15.146:0/927824957 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa564067630 0x7fa5640c7860 unknown :-1 s=CLOSED pgs=2237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:55.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.661+0000 7fa568ab3700 1 --2- 172.21.15.146:0/927824957 >> v2:172.21.15.151:3300/0 conn(0x7fa564067a00 0x7fa5640ca6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:55.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.661+0000 7fa568ab3700 1 -- 172.21.15.146:0/927824957 >> 172.21.15.146:0/927824957 conn(0x7fa5640cdd30 msgr2=0x7fa5640c9d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:55.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.662+0000 7fa568ab3700 1 -- 172.21.15.146:0/927824957 shutdown_connections 2023-10-06T11:18:55.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.662+0000 7fa568ab3700 1 -- 172.21.15.146:0/927824957 wait complete. 2023-10-06T11:18:55.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.663+0000 7fa568ab3700 1 Processor -- start 2023-10-06T11:18:55.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.663+0000 7fa568ab3700 1 -- start start 2023-10-06T11:18:55.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.663+0000 7fa568ab3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa564067630 0x7fa5640b25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:55.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.663+0000 7fa568ab3700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa564067a00 0x7fa5640c42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:55.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.663+0000 7fa568ab3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5640a98e0 0x7fa564154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:55.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.663+0000 7fa568ab3700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5640adc70 con 0x7fa5640a98e0 2023-10-06T11:18:55.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.663+0000 7fa568ab3700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5640adf50 con 0x7fa564067630 2023-10-06T11:18:55.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.663+0000 7fa568ab3700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5640ae230 con 0x7fa564067a00 2023-10-06T11:18:55.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.664+0000 7fa562d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5640a98e0 0x7fa564154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:55.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.664+0000 7fa562d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5640a98e0 0x7fa564154b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58604/0 (socket says 172.21.15.146:58604) 2023-10-06T11:18:55.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.664+0000 7fa562d9d700 1 -- 172.21.15.146:0/39781341 learned_addr learned my addr 172.21.15.146:0/39781341 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:55.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.664+0000 7fa56259c700 1 --2- 172.21.15.146:0/39781341 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa564067630 0x7fa5640b25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:55.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.664+0000 7fa559d9b700 1 --2- 172.21.15.146:0/39781341 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa564067a00 0x7fa5640c42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:55.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.664+0000 7fa562d9d700 1 -- 172.21.15.146:0/39781341 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa564067a00 msgr2=0x7fa5640c42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:55.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.664+0000 7fa562d9d700 1 --2- 172.21.15.146:0/39781341 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa564067a00 0x7fa5640c42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:55.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.664+0000 7fa562d9d700 1 -- 172.21.15.146:0/39781341 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa564067630 msgr2=0x7fa5640b25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:55.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.664+0000 7fa562d9d700 1 --2- 172.21.15.146:0/39781341 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa564067630 0x7fa5640b25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:55.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.664+0000 7fa562d9d700 1 -- 172.21.15.146:0/39781341 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5540094f0 con 0x7fa5640a98e0 2023-10-06T11:18:55.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.664+0000 7fa562d9d700 1 --2- 172.21.15.146:0/39781341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5640a98e0 0x7fa564154b70 secure :-1 s=READY pgs=2238 cs=0 l=1 rev1=1 crypto rx=0x7fa55c00bc30 tx=0x7fa55c009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:55.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.664+0000 7fa55affd700 1 -- 172.21.15.146:0/39781341 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c00c840 con 0x7fa5640a98e0 2023-10-06T11:18:55.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.664+0000 7fa55affd700 1 -- 172.21.15.146:0/39781341 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55c00c9e0 con 0x7fa5640a98e0 2023-10-06T11:18:55.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.664+0000 7fa55affd700 1 -- 172.21.15.146:0/39781341 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c00cda0 con 0x7fa5640a98e0 2023-10-06T11:18:55.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.664+0000 7fa568ab3700 1 -- 172.21.15.146:0/39781341 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5640ae510 con 0x7fa5640a98e0 2023-10-06T11:18:55.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.664+0000 7fa568ab3700 1 -- 172.21.15.146:0/39781341 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5641550b0 con 0x7fa5640a98e0 2023-10-06T11:18:55.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.665+0000 7fa568ab3700 1 -- 172.21.15.146:0/39781341 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa56404c380 con 0x7fa5640a98e0 2023-10-06T11:18:55.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.666+0000 7fa55affd700 1 -- 172.21.15.146:0/39781341 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa55c014620 con 0x7fa5640a98e0 2023-10-06T11:18:55.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.666+0000 7fa55affd700 1 --2- 172.21.15.146:0/39781341 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa544066f30 0x7fa5440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:55.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.666+0000 7fa55affd700 1 -- 172.21.15.146:0/39781341 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa55c0845e0 con 0x7fa5640a98e0 2023-10-06T11:18:55.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.666+0000 7fa56259c700 1 --2- 172.21.15.146:0/39781341 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa544066f30 0x7fa5440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:55.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.667+0000 7fa56259c700 1 --2- 172.21.15.146:0/39781341 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa544066f30 0x7fa5440693e0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fa56406d460 tx=0x7fa554016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:55.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.670+0000 7fa55affd700 1 -- 172.21.15.146:0/39781341 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa55c0516f0 con 0x7fa5640a98e0 2023-10-06T11:18:55.896 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.895+0000 7fa568ab3700 1 -- 172.21.15.146:0/39781341 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa5640c8500 con 0x7fa5640a98e0 2023-10-06T11:18:55.897 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.895+0000 7fa55affd700 1 -- 172.21.15.146:0/39781341 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 144 v144) v1 ==== 95+0+4623 (secure 0 0 0) 0x7fa55c054d10 con 0x7fa5640a98e0 2023-10-06T11:18:55.897 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:18:55.897 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":144,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9094,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/3426437100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3426437100},{"type":"v1","addr":"172.21.15.146:6836","nonce":3426437100}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":139},{"gid":9106,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/3275041097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":3275041097},{"type":"v1","addr":"172.21.15.151:6835","nonce":3275041097}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":139},{"gid":10461,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/2322816938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2322816938},{"type":"v1","addr":"172.21.15.146:6837","nonce":2322816938}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":139}],"filesystems":[{"mdsmap":{"epoch":144,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:18:51.903907+0000","modified":"2023-10-06T11:18:55.524407+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10476":{"gid":10476,"name":"d","rank":0,"incarnation":140,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6834/1134233840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1134233840},{"type":"v1","addr":"172.21.15.151:6834","nonce":1134233840}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-10-06T11:18:55.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.897+0000 7fa568ab3700 1 -- 172.21.15.146:0/39781341 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa544066f30 msgr2=0x7fa5440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:55.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.897+0000 7fa568ab3700 1 --2- 172.21.15.146:0/39781341 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa544066f30 0x7fa5440693e0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fa56406d460 tx=0x7fa554016000 comp rx=0 tx=0).stop 2023-10-06T11:18:55.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.897+0000 7fa568ab3700 1 -- 172.21.15.146:0/39781341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5640a98e0 msgr2=0x7fa564154b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:55.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.897+0000 7fa568ab3700 1 --2- 172.21.15.146:0/39781341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5640a98e0 0x7fa564154b70 secure :-1 s=READY pgs=2238 cs=0 l=1 rev1=1 crypto rx=0x7fa55c00bc30 tx=0x7fa55c009820 comp rx=0 tx=0).stop 2023-10-06T11:18:55.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.898+0000 7fa568ab3700 1 -- 172.21.15.146:0/39781341 shutdown_connections 2023-10-06T11:18:55.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.898+0000 7fa568ab3700 1 --2- 172.21.15.146:0/39781341 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa544066f30 0x7fa5440693e0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:55.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.898+0000 7fa568ab3700 1 --2- 172.21.15.146:0/39781341 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa5640a98e0 0x7fa564154b70 unknown :-1 s=CLOSED pgs=2238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:55.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.898+0000 7fa568ab3700 1 --2- 172.21.15.146:0/39781341 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa564067630 0x7fa5640b25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:55.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.898+0000 7fa568ab3700 1 --2- 172.21.15.146:0/39781341 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa564067a00 0x7fa5640c42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:55.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.898+0000 7fa568ab3700 1 -- 172.21.15.146:0/39781341 >> 172.21.15.146:0/39781341 conn(0x7fa5640cdd30 msgr2=0x7fa5640ccac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:55.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.898+0000 7fa568ab3700 1 -- 172.21.15.146:0/39781341 shutdown_connections 2023-10-06T11:18:55.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:55.898+0000 7fa568ab3700 1 -- 172.21.15.146:0/39781341 wait complete. 2023-10-06T11:18:55.901 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 144 2023-10-06T11:18:55.912 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:18:56.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.025+0000 7f7476d53700 1 Processor -- start 2023-10-06T11:18:56.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.025+0000 7f7476d53700 1 -- start start 2023-10-06T11:18:56.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.026+0000 7f7476d53700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f747006c890 0x7f74700b0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:56.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.026+0000 7f7476d53700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74700b21e0 con 0x7f7470150b70 2023-10-06T11:18:56.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.026+0000 7f7476d53700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7470159f70 con 0x7f74701507a0 2023-10-06T11:18:56.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.026+0000 7f7476d53700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74700c9f50 con 0x7f747006c890 2023-10-06T11:18:56.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.026+0000 7f746ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f747006c890 0x7f74700b0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:56.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.026+0000 7f74752f0700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f7470150b70 0x7f74700cd230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36238/0 (socket says 172.21.15.146:36238) 2023-10-06T11:18:56.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.026+0000 7f74752f0700 1 -- 172.21.15.146:0/3412122359 learned_addr learned my addr 172.21.15.146:0/3412122359 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:56.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.026+0000 7f746ffff700 1 -- 172.21.15.146:0/3412122359 >> v1:172.21.15.151:6789/0 conn(0x7f74701507a0 legacy=0x7f747006c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:56.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.026+0000 7f746ffff700 1 -- 172.21.15.146:0/3412122359 >> v1:172.21.15.146:6789/0 conn(0x7f7470150b70 legacy=0x7f74700cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:56.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.026+0000 7f746ffff700 1 -- 172.21.15.146:0/3412122359 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f747015a250 con 0x7f747006c890 2023-10-06T11:18:56.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.026+0000 7f746f7fe700 1 -- 172.21.15.146:0/3412122359 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2217243221 0 0) 0x7f74700b21e0 con 0x7f7470150b70 2023-10-06T11:18:56.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.026+0000 7f746ffff700 1 --2- 172.21.15.146:0/3412122359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f747006c890 0x7f74700b0090 secure :-1 s=READY pgs=2240 cs=0 l=1 rev1=1 crypto rx=0x7f745c009910 tx=0x7f745c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9502e0658bab323b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:56.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.027+0000 7f746f7fe700 1 -- 172.21.15.146:0/3412122359 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c00b7e0 con 0x7f747006c890 2023-10-06T11:18:56.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.027+0000 7f746f7fe700 1 -- 172.21.15.146:0/3412122359 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f745c00b940 con 0x7f747006c890 2023-10-06T11:18:56.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.027+0000 7f746f7fe700 1 -- 172.21.15.146:0/3412122359 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c00bce0 con 0x7f747006c890 2023-10-06T11:18:56.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.027+0000 7f7476d53700 1 -- 172.21.15.146:0/3412122359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f747006c890 msgr2=0x7f74700b0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:56.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.027+0000 7f7476d53700 1 --2- 172.21.15.146:0/3412122359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f747006c890 0x7f74700b0090 secure :-1 s=READY pgs=2240 cs=0 l=1 rev1=1 crypto rx=0x7f745c009910 tx=0x7f745c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:18:56.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.027+0000 7f7476d53700 1 -- 172.21.15.146:0/3412122359 shutdown_connections 2023-10-06T11:18:56.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.027+0000 7f7476d53700 1 --2- 172.21.15.146:0/3412122359 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f747006c890 0x7f74700b0090 unknown :-1 s=CLOSED pgs=2240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:56.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.027+0000 7f7476d53700 1 -- 172.21.15.146:0/3412122359 >> 172.21.15.146:0/3412122359 conn(0x7f747006a4d0 msgr2=0x7f747006a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:56.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.027+0000 7f7476d53700 1 -- 172.21.15.146:0/3412122359 shutdown_connections 2023-10-06T11:18:56.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.027+0000 7f7476d53700 1 -- 172.21.15.146:0/3412122359 wait complete. 2023-10-06T11:18:56.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.028+0000 7f7476d53700 1 Processor -- start 2023-10-06T11:18:56.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.028+0000 7f7476d53700 1 -- start start 2023-10-06T11:18:56.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.029+0000 7f7476d53700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f747006c890 0x7f747014e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:56.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.029+0000 7f7476d53700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74701507a0 0x7f74700673e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:56.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.029+0000 7f7476d53700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7470150b70 0x7f7470067920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:56.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.029+0000 7f7476d53700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7470153e80 con 0x7f747006c890 2023-10-06T11:18:56.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.029+0000 7f7476d53700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7470154160 con 0x7f7470150b70 2023-10-06T11:18:56.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.029+0000 7f7476d53700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7470154440 con 0x7f74701507a0 2023-10-06T11:18:56.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.029+0000 7f7474aef700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f747006c890 0x7f747014e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:56.035 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.029+0000 7f7474aef700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f747006c890 0x7f747014e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58614/0 (socket says 172.21.15.146:58614) 2023-10-06T11:18:56.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.029+0000 7f7474aef700 1 -- 172.21.15.146:0/374211637 learned_addr learned my addr 172.21.15.146:0/374211637 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:56.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.029+0000 7f746ffff700 1 --2- 172.21.15.146:0/374211637 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74701507a0 0x7f74700673e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:56.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.029+0000 7f74752f0700 1 --2- 172.21.15.146:0/374211637 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7470150b70 0x7f7470067920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:56.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.029+0000 7f7474aef700 1 -- 172.21.15.146:0/374211637 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74701507a0 msgr2=0x7f74700673e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:56.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.029+0000 7f7474aef700 1 --2- 172.21.15.146:0/374211637 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74701507a0 0x7f74700673e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:56.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.030+0000 7f7474aef700 1 -- 172.21.15.146:0/374211637 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7470150b70 msgr2=0x7f7470067920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:56.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.030+0000 7f7474aef700 1 --2- 172.21.15.146:0/374211637 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7470150b70 0x7f7470067920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:56.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.030+0000 7f7474aef700 1 -- 172.21.15.146:0/374211637 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f745c009420 con 0x7f747006c890 2023-10-06T11:18:56.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.030+0000 7f7474aef700 1 --2- 172.21.15.146:0/374211637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f747006c890 0x7f747014e530 secure :-1 s=READY pgs=2241 cs=0 l=1 rev1=1 crypto rx=0x7f746400c5d0 tx=0x7f7464007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:56.036 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.030+0000 7f746cff9700 1 -- 172.21.15.146:0/374211637 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7464011590 con 0x7f747006c890 2023-10-06T11:18:56.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.030+0000 7f746cff9700 1 -- 172.21.15.146:0/374211637 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7464011710 con 0x7f747006c890 2023-10-06T11:18:56.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.030+0000 7f7476d53700 1 -- 172.21.15.146:0/374211637 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7470154720 con 0x7f747006c890 2023-10-06T11:18:56.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.030+0000 7f746cff9700 1 -- 172.21.15.146:0/374211637 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7464011ad0 con 0x7f747006c890 2023-10-06T11:18:56.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.030+0000 7f7476d53700 1 -- 172.21.15.146:0/374211637 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74701678c0 con 0x7f747006c890 2023-10-06T11:18:56.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.031+0000 7f7476d53700 1 -- 172.21.15.146:0/374211637 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f747004c380 con 0x7f747006c890 2023-10-06T11:18:56.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.031+0000 7f746cff9700 1 -- 172.21.15.146:0/374211637 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f746401c460 con 0x7f747006c890 2023-10-06T11:18:56.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.031+0000 7f746cff9700 1 --2- 172.21.15.146:0/374211637 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7454066f30 0x7f74540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:56.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.032+0000 7f746cff9700 1 -- 172.21.15.146:0/374211637 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f74640843f0 con 0x7f747006c890 2023-10-06T11:18:56.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.032+0000 7f746ffff700 1 --2- 172.21.15.146:0/374211637 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7454066f30 0x7f74540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:56.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.032+0000 7f746ffff700 1 --2- 172.21.15.146:0/374211637 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7454066f30 0x7f74540693e0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f7470159ed0 tx=0x7f745c016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:56.038 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.036+0000 7f746cff9700 1 -- 172.21.15.146:0/374211637 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7464051500 con 0x7f747006c890 2023-10-06T11:18:56.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.219+0000 7f7476d53700 1 -- 172.21.15.146:0/374211637 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f747015a530 con 0x7f747006c890 2023-10-06T11:18:56.222 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.220+0000 7f746cff9700 1 -- 172.21.15.146:0/374211637 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v177) v1 ==== 74+0+16928 (secure 0 0 0) 0x7f7464054b20 con 0x7f747006c890 2023-10-06T11:18:56.222 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:18:56.222 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":177,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:18:53.500092+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:18:49.540526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2023-10-06T11:18:50.844600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:18:56.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.222+0000 7f7476d53700 1 -- 172.21.15.146:0/374211637 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7454066f30 msgr2=0x7f74540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:56.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.222+0000 7f7476d53700 1 --2- 172.21.15.146:0/374211637 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7454066f30 0x7f74540693e0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f7470159ed0 tx=0x7f745c016000 comp rx=0 tx=0).stop 2023-10-06T11:18:56.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.222+0000 7f7476d53700 1 -- 172.21.15.146:0/374211637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f747006c890 msgr2=0x7f747014e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:56.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.222+0000 7f7476d53700 1 --2- 172.21.15.146:0/374211637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f747006c890 0x7f747014e530 secure :-1 s=READY pgs=2241 cs=0 l=1 rev1=1 crypto rx=0x7f746400c5d0 tx=0x7f7464007f60 comp rx=0 tx=0).stop 2023-10-06T11:18:56.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.222+0000 7f7476d53700 1 -- 172.21.15.146:0/374211637 shutdown_connections 2023-10-06T11:18:56.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.222+0000 7f7476d53700 1 --2- 172.21.15.146:0/374211637 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7454066f30 0x7f74540693e0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:56.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.222+0000 7f7476d53700 1 --2- 172.21.15.146:0/374211637 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7470150b70 0x7f7470067920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:56.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.222+0000 7f7476d53700 1 --2- 172.21.15.146:0/374211637 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f747006c890 0x7f747014e530 unknown :-1 s=CLOSED pgs=2241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:56.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.222+0000 7f7476d53700 1 --2- 172.21.15.146:0/374211637 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f74701507a0 0x7f74700673e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:56.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.222+0000 7f7476d53700 1 -- 172.21.15.146:0/374211637 >> 172.21.15.146:0/374211637 conn(0x7f747006a4d0 msgr2=0x7f74700accf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:56.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.222+0000 7f7476d53700 1 -- 172.21.15.146:0/374211637 shutdown_connections 2023-10-06T11:18:56.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.222+0000 7f7476d53700 1 -- 172.21.15.146:0/374211637 wait complete. 2023-10-06T11:18:56.237 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T11:18:56.237 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:18:56.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.350+0000 7f50c7d74700 1 Processor -- start 2023-10-06T11:18:56.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.350+0000 7f50c7d74700 1 -- start start 2023-10-06T11:18:56.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.351+0000 7f50c7d74700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50c01538c0 0x7f50c0153c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:56.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.351+0000 7f50c7d74700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f50c015a940 0x7f50c015dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:56.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.351+0000 7f50c7d74700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50c015d270 con 0x7f50c00cac80 2023-10-06T11:18:56.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.351+0000 7f50c7d74700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50c015d830 con 0x7f50c015a940 2023-10-06T11:18:56.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.351+0000 7f50c7d74700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50c00cb810 con 0x7f50c01538c0 2023-10-06T11:18:56.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.351+0000 7f50c530f700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f50c015a940 0x7f50c015dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:56.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.351+0000 7f50c6311700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f50c00cac80 0x7f50c00ce610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36242/0 (socket says 172.21.15.146:36242) 2023-10-06T11:18:56.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.351+0000 7f50c6311700 1 -- 172.21.15.146:0/2425606429 learned_addr learned my addr 172.21.15.146:0/2425606429 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:18:56.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.351+0000 7f50c5b10700 1 --2- 172.21.15.146:0/2425606429 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50c01538c0 0x7f50c0153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:56.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.351+0000 7f50c530f700 1 -- 172.21.15.146:0/2425606429 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50c01538c0 msgr2=0x7f50c0153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:56.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.351+0000 7f50c530f700 1 --2- 172.21.15.146:0/2425606429 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50c01538c0 0x7f50c0153c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:56.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.351+0000 7f50c4b0e700 1 -- 172.21.15.146:0/2425606429 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1463896221 0 0) 0x7f50c015d270 con 0x7f50c00cac80 2023-10-06T11:18:56.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.351+0000 7f50c530f700 1 -- 172.21.15.146:0/2425606429 >> v1:172.21.15.146:6789/0 conn(0x7f50c00cac80 legacy=0x7f50c00ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:56.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.351+0000 7f50c530f700 1 -- 172.21.15.146:0/2425606429 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c00cbaf0 con 0x7f50c015a940 2023-10-06T11:18:56.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.352+0000 7f50c530f700 1 --2- 172.21.15.146:0/2425606429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50c015a940 0x7f50c015dcc0 secure :-1 s=READY pgs=2243 cs=0 l=1 rev1=1 crypto rx=0x7f50b00098e0 tx=0x7f50b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=416d6d4a688fbf19 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:56.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.352+0000 7f50c4b0e700 1 -- 172.21.15.146:0/2425606429 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b0009e80 con 0x7f50c015a940 2023-10-06T11:18:56.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.352+0000 7f50c4b0e700 1 -- 172.21.15.146:0/2425606429 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b000b860 con 0x7f50c015a940 2023-10-06T11:18:56.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.352+0000 7f50c4b0e700 1 -- 172.21.15.146:0/2425606429 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b000bbe0 con 0x7f50c015a940 2023-10-06T11:18:56.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.352+0000 7f50c7d74700 1 -- 172.21.15.146:0/2425606429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50c015a940 msgr2=0x7f50c015dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:56.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.352+0000 7f50c7d74700 1 --2- 172.21.15.146:0/2425606429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50c015a940 0x7f50c015dcc0 secure :-1 s=READY pgs=2243 cs=0 l=1 rev1=1 crypto rx=0x7f50b00098e0 tx=0x7f50b00091a0 comp rx=0 tx=0).stop 2023-10-06T11:18:56.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.352+0000 7f50c7d74700 1 -- 172.21.15.146:0/2425606429 shutdown_connections 2023-10-06T11:18:56.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.352+0000 7f50c7d74700 1 --2- 172.21.15.146:0/2425606429 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50c01538c0 0x7f50c0153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:56.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.352+0000 7f50c7d74700 1 --2- 172.21.15.146:0/2425606429 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50c015a940 0x7f50c015dcc0 unknown :-1 s=CLOSED pgs=2243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:56.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.352+0000 7f50c7d74700 1 -- 172.21.15.146:0/2425606429 >> 172.21.15.146:0/2425606429 conn(0x7f50c006eb10 msgr2=0x7f50c006ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:56.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.352+0000 7f50c7d74700 1 -- 172.21.15.146:0/2425606429 shutdown_connections 2023-10-06T11:18:56.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.352+0000 7f50c7d74700 1 -- 172.21.15.146:0/2425606429 wait complete. 2023-10-06T11:18:56.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.353+0000 7f50c7d74700 1 Processor -- start 2023-10-06T11:18:56.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.354+0000 7f50c7d74700 1 -- start start 2023-10-06T11:18:56.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.354+0000 7f50c7d74700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50c00cac80 0x7f50c01518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:56.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.354+0000 7f50c7d74700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50c01538c0 0x7f50c016a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:56.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.354+0000 7f50c7d74700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50c015a940 0x7f50c00c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:56.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.354+0000 7f50c7d74700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c00c96b0 con 0x7f50c00cac80 2023-10-06T11:18:56.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.354+0000 7f50c7d74700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c0151e20 con 0x7f50c015a940 2023-10-06T11:18:56.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.354+0000 7f50c7d74700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50c016a5c0 con 0x7f50c01538c0 2023-10-06T11:18:56.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.354+0000 7f50c5b10700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50c00cac80 0x7f50c01518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:56.359 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.354+0000 7f50c5b10700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50c00cac80 0x7f50c01518e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58634/0 (socket says 172.21.15.146:58634) 2023-10-06T11:18:56.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.354+0000 7f50c5b10700 1 -- 172.21.15.146:0/3751301249 learned_addr learned my addr 172.21.15.146:0/3751301249 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:56.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.355+0000 7f50c5b10700 1 -- 172.21.15.146:0/3751301249 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50c01538c0 msgr2=0x7f50c016a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:56.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.355+0000 7f50c5b10700 1 --2- 172.21.15.146:0/3751301249 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50c01538c0 0x7f50c016a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:56.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.355+0000 7f50c5b10700 1 -- 172.21.15.146:0/3751301249 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50c015a940 msgr2=0x7f50c00c9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:56.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.355+0000 7f50c5b10700 1 --2- 172.21.15.146:0/3751301249 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50c015a940 0x7f50c00c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:56.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.355+0000 7f50c5b10700 1 -- 172.21.15.146:0/3751301249 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b0009420 con 0x7f50c00cac80 2023-10-06T11:18:56.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.355+0000 7f50c5b10700 1 --2- 172.21.15.146:0/3751301249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50c00cac80 0x7f50c01518e0 secure :-1 s=READY pgs=2244 cs=0 l=1 rev1=1 crypto rx=0x7f50bc00c7d0 tx=0x7f50bc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:56.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.355+0000 7f50b5ffb700 1 -- 172.21.15.146:0/3751301249 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50bc011600 con 0x7f50c00cac80 2023-10-06T11:18:56.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.355+0000 7f50b5ffb700 1 -- 172.21.15.146:0/3751301249 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50bc011760 con 0x7f50c00cac80 2023-10-06T11:18:56.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.355+0000 7f50c7d74700 1 -- 172.21.15.146:0/3751301249 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c00c8aa0 con 0x7f50c00cac80 2023-10-06T11:18:56.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.355+0000 7f50b5ffb700 1 -- 172.21.15.146:0/3751301249 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50bc011b20 con 0x7f50c00cac80 2023-10-06T11:18:56.360 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.355+0000 7f50c7d74700 1 -- 172.21.15.146:0/3751301249 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c00c9060 con 0x7f50c00cac80 2023-10-06T11:18:56.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.356+0000 7f50c7d74700 1 -- 172.21.15.146:0/3751301249 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50c004c380 con 0x7f50c00cac80 2023-10-06T11:18:56.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.356+0000 7f50b5ffb700 1 -- 172.21.15.146:0/3751301249 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f50bc0193f0 con 0x7f50c00cac80 2023-10-06T11:18:56.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.357+0000 7f50b5ffb700 1 --2- 172.21.15.146:0/3751301249 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f50a4066f30 0x7f50a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:56.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.357+0000 7f50b5ffb700 1 -- 172.21.15.146:0/3751301249 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f50bc084b30 con 0x7f50c00cac80 2023-10-06T11:18:56.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.357+0000 7f50c530f700 1 --2- 172.21.15.146:0/3751301249 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f50a4066f30 0x7f50a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:56.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.357+0000 7f50c530f700 1 --2- 172.21.15.146:0/3751301249 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f50a4066f30 0x7f50a40693e0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f50c0069170 tx=0x7f50b0017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:56.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.361+0000 7f50b5ffb700 1 -- 172.21.15.146:0/3751301249 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f50bc051c40 con 0x7f50c00cac80 2023-10-06T11:18:56.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.543+0000 7f50c7d74700 1 -- 172.21.15.146:0/3751301249 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f50c00c97f0 con 0x7f50a4066f30 2023-10-06T11:18:56.552 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.551+0000 7f50b5ffb700 1 -- 172.21.15.146:0/3751301249 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303924 (secure 0 0 0) 0x7f50b000b9d0 con 0x7f50a4066f30 2023-10-06T11:18:56.556 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:18:56.558 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.554+0000 7f50c7d74700 1 -- 172.21.15.146:0/3751301249 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f50a4066f30 msgr2=0x7f50a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:56.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.554+0000 7f50c7d74700 1 --2- 172.21.15.146:0/3751301249 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f50a4066f30 0x7f50a40693e0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f50c0069170 tx=0x7f50b0017000 comp rx=0 tx=0).stop 2023-10-06T11:18:56.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.554+0000 7f50c7d74700 1 -- 172.21.15.146:0/3751301249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50c00cac80 msgr2=0x7f50c01518e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:56.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.554+0000 7f50c7d74700 1 --2- 172.21.15.146:0/3751301249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50c00cac80 0x7f50c01518e0 secure :-1 s=READY pgs=2244 cs=0 l=1 rev1=1 crypto rx=0x7f50bc00c7d0 tx=0x7f50bc008040 comp rx=0 tx=0).stop 2023-10-06T11:18:56.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.554+0000 7f50c7d74700 1 -- 172.21.15.146:0/3751301249 shutdown_connections 2023-10-06T11:18:56.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.554+0000 7f50c7d74700 1 --2- 172.21.15.146:0/3751301249 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f50a4066f30 0x7f50a40693e0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:56.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.554+0000 7f50c7d74700 1 --2- 172.21.15.146:0/3751301249 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50c015a940 0x7f50c00c9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:56.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.554+0000 7f50c7d74700 1 --2- 172.21.15.146:0/3751301249 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f50c00cac80 0x7f50c01518e0 unknown :-1 s=CLOSED pgs=2244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:56.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.554+0000 7f50c7d74700 1 --2- 172.21.15.146:0/3751301249 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50c01538c0 0x7f50c016a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:56.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.554+0000 7f50c7d74700 1 -- 172.21.15.146:0/3751301249 >> 172.21.15.146:0/3751301249 conn(0x7f50c006eb10 msgr2=0x7f50c00cfb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:56.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.554+0000 7f50c7d74700 1 -- 172.21.15.146:0/3751301249 shutdown_connections 2023-10-06T11:18:56.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.554+0000 7f50c7d74700 1 -- 172.21.15.146:0/3751301249 wait complete. 2023-10-06T11:18:56.559 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:18:56.568 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":569,"stamp":"2023-10-06T11:18:55.312215+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":134,"acting":134,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":24,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2441692,"kb_used_data":18332,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752533028,"statfs":{"total":773094113280,"available":770593820672,"internally_reserved":0,"allocated":18771968,"data_stored":9295820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.821153"},"pg_stats":[{"pgid":"28.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.513257+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:22.963604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.513115+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:48:06.231609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.511166+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:45:18.723193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.510745+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:06:33.866195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.511723+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:09:34.925925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.503126+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:30.662720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.508679+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:49:38.496675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.510774+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:43:55.311129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.511555+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:13.769278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.516145+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:11:36.554686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.511245+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:19:53.986592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.510274+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:58.152151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.503627+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:47:32.386139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.502870+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:40:38.219266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.495654+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:09:58.364738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.508575+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:19:32.976623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.497308+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:59:35.711896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.492630+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:22.454621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.497405+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:47:31.381968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.496441+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:12.235357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.507984+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:32:33.004446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-06T11:18:51.520772+0000","last_change":"2023-10-06T11:18:51.520772+0000","last_active":"2023-10-06T11:18:51.520772+0000","last_peered":"2023-10-06T11:18:51.520772+0000","last_clean":"2023-10-06T11:18:51.520772+0000","last_became_active":"2023-10-06T11:18:51.520462+0000","last_became_peered":"2023-10-06T11:18:51.520462+0000","last_unstale":"2023-10-06T11:18:51.520772+0000","last_undegraded":"2023-10-06T11:18:51.520772+0000","last_fullsized":"2023-10-06T11:18:51.520772+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:47:19.326917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.493251+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:08.422937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.496006+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:08:23.261106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.512690+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:20:06.857224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.493492+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:34:37.175282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.492889+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:37:54.962748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.495516+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:01:31.340000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.515476+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:50:45.910135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.496336+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:06.689323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.495790+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:49.162033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.496381+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:18:13.347927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-06T11:18:51.518577+0000","last_change":"2023-10-06T11:18:51.518577+0000","last_active":"2023-10-06T11:18:51.518577+0000","last_peered":"2023-10-06T11:18:51.518577+0000","last_clean":"2023-10-06T11:18:51.518577+0000","last_became_active":"2023-10-06T11:18:51.518267+0000","last_became_peered":"2023-10-06T11:18:51.518267+0000","last_unstale":"2023-10-06T11:18:51.518577+0000","last_undegraded":"2023-10-06T11:18:51.518577+0000","last_fullsized":"2023-10-06T11:18:51.518577+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:12:04.967138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.511802+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:00:15.358532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.492823+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:42:10.142087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.512226+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:14.739928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.492973+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:34:22.931418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.507932+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:56:53.432751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-06T11:18:51.515072+0000","last_change":"2023-10-06T11:18:51.515072+0000","last_active":"2023-10-06T11:18:51.515072+0000","last_peered":"2023-10-06T11:18:51.515072+0000","last_clean":"2023-10-06T11:18:51.515072+0000","last_became_active":"2023-10-06T11:18:51.514821+0000","last_became_peered":"2023-10-06T11:18:51.514821+0000","last_unstale":"2023-10-06T11:18:51.515072+0000","last_undegraded":"2023-10-06T11:18:51.515072+0000","last_fullsized":"2023-10-06T11:18:51.515072+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:36:18.839256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-06T11:18:51.519403+0000","last_change":"2023-10-06T11:18:51.519403+0000","last_active":"2023-10-06T11:18:51.519403+0000","last_peered":"2023-10-06T11:18:51.519403+0000","last_clean":"2023-10-06T11:18:51.519403+0000","last_became_active":"2023-10-06T11:18:51.519130+0000","last_became_peered":"2023-10-06T11:18:51.519130+0000","last_unstale":"2023-10-06T11:18:51.519403+0000","last_undegraded":"2023-10-06T11:18:51.519403+0000","last_fullsized":"2023-10-06T11:18:51.519403+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:18:11.844126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.494141+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:40:53.184600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.510476+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:39:40.994783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-06T11:18:51.521725+0000","last_change":"2023-10-06T11:18:51.521725+0000","last_active":"2023-10-06T11:18:51.521725+0000","last_peered":"2023-10-06T11:18:51.521725+0000","last_clean":"2023-10-06T11:18:51.521725+0000","last_became_active":"2023-10-06T11:18:51.521427+0000","last_became_peered":"2023-10-06T11:18:51.521427+0000","last_unstale":"2023-10-06T11:18:51.521725+0000","last_undegraded":"2023-10-06T11:18:51.521725+0000","last_fullsized":"2023-10-06T11:18:51.521725+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:01.079097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.492651+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:51:26.937096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.493704+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:09:05.555255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.509689+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:26:40.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.495516+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:08:02.104055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-06T11:18:51.518899+0000","last_change":"2023-10-06T11:18:51.518899+0000","last_active":"2023-10-06T11:18:51.518899+0000","last_peered":"2023-10-06T11:18:51.518899+0000","last_clean":"2023-10-06T11:18:51.518899+0000","last_became_active":"2023-10-06T11:18:51.517840+0000","last_became_peered":"2023-10-06T11:18:51.517840+0000","last_unstale":"2023-10-06T11:18:51.518899+0000","last_undegraded":"2023-10-06T11:18:51.518899+0000","last_fullsized":"2023-10-06T11:18:51.518899+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:01:35.577133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":154,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-06T11:18:50.494090+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:18:50.494090+0000","last_peered":"2023-10-06T11:18:50.494090+0000","last_clean":"2023-10-06T11:18:50.494090+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:18:50.494090+0000","last_undegraded":"2023-10-06T11:18:50.494090+0000","last_fullsized":"2023-10-06T11:18:50.494090+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.493576+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:09:15.298043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":144,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-06T11:18:47.532793+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:18:47.532793+0000","last_peered":"2023-10-06T11:18:47.532793+0000","last_clean":"2023-10-06T11:18:47.532793+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:18:47.532793+0000","last_undegraded":"2023-10-06T11:18:47.532793+0000","last_fullsized":"2023-10-06T11:18:47.532793+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.504457+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:15.196912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.497159+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:12:04.967138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":142,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-06T11:18:50.499036+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:18:50.499036+0000","last_peered":"2023-10-06T11:18:50.499036+0000","last_clean":"2023-10-06T11:18:50.499036+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:18:50.499036+0000","last_undegraded":"2023-10-06T11:18:50.499036+0000","last_fullsized":"2023-10-06T11:18:50.499036+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":285,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-06T11:18:47.532980+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:18:47.532980+0000","last_peered":"2023-10-06T11:18:47.532980+0000","last_clean":"2023-10-06T11:18:47.532980+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:18:47.532980+0000","last_undegraded":"2023-10-06T11:18:47.532980+0000","last_fullsized":"2023-10-06T11:18:47.532980+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-06T11:18:51.518700+0000","last_change":"2023-10-06T11:18:51.518700+0000","last_active":"2023-10-06T11:18:51.518700+0000","last_peered":"2023-10-06T11:18:51.518700+0000","last_clean":"2023-10-06T11:18:51.518700+0000","last_became_active":"2023-10-06T11:18:51.518426+0000","last_became_peered":"2023-10-06T11:18:51.518426+0000","last_unstale":"2023-10-06T11:18:51.518700+0000","last_undegraded":"2023-10-06T11:18:51.518700+0000","last_fullsized":"2023-10-06T11:18:51.518700+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:50:11.395470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":135,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-06T11:18:47.533108+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:18:47.533108+0000","last_peered":"2023-10-06T11:18:47.533108+0000","last_clean":"2023-10-06T11:18:47.533108+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:18:47.533108+0000","last_undegraded":"2023-10-06T11:18:47.533108+0000","last_fullsized":"2023-10-06T11:18:47.533108+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.493041+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:16:03.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":135,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-06T11:18:47.533069+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:18:47.533069+0000","last_peered":"2023-10-06T11:18:47.533069+0000","last_clean":"2023-10-06T11:18:47.533069+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:18:47.533069+0000","last_undegraded":"2023-10-06T11:18:47.533069+0000","last_fullsized":"2023-10-06T11:18:47.533069+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.502856+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:59.830470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.497225+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:01:35.577133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":161,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-06T11:18:47.484034+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:18:47.484034+0000","last_peered":"2023-10-06T11:18:47.484034+0000","last_clean":"2023-10-06T11:18:47.484034+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:18:47.484034+0000","last_undegraded":"2023-10-06T11:18:47.484034+0000","last_fullsized":"2023-10-06T11:18:47.484034+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.492571+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:20.989429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":143,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-06T11:18:50.496025+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:18:50.496025+0000","last_peered":"2023-10-06T11:18:50.496025+0000","last_clean":"2023-10-06T11:18:50.496025+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:18:50.496025+0000","last_undegraded":"2023-10-06T11:18:50.496025+0000","last_fullsized":"2023-10-06T11:18:50.496025+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.508306+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:54:10.845045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.495986+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:20.103244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":143,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-06T11:18:50.496047+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:18:50.496047+0000","last_peered":"2023-10-06T11:18:50.496047+0000","last_clean":"2023-10-06T11:18:50.496047+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:18:50.496047+0000","last_undegraded":"2023-10-06T11:18:50.496047+0000","last_fullsized":"2023-10-06T11:18:50.496047+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":28,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":52,"acting":52,"num_store_stats":3},{"poolid":27,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575010,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304108,"kb_used_data":2724,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067732,"statfs":{"total":96636764160,"available":96325357568,"internally_reserved":0,"allocated":2789376,"data_stored":1602949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54400000000000004,"15min":0.629},"min":{"1min":0.35899999999999999,"5min":0.252,"15min":0.21199999999999999},"max":{"1min":0.70999999999999996,"5min":4.407,"15min":23.908999999999999},"last":0.434},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.52500000000000002,"15min":0.57799999999999996},"min":{"1min":0.38200000000000001,"5min":0.26900000000000002,"15min":0.22500000000000001},"max":{"1min":0.71699999999999997,"5min":0.76800000000000002,"15min":9.3230000000000004},"last":0.56599999999999995}]},{"osd":1,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54500000000000004,"15min":0.55900000000000005},"min":{"1min":0.439,"5min":0.28399999999999997,"15min":0.26000000000000001},"max":{"1min":0.72699999999999998,"5min":2.4689999999999999,"15min":9.2360000000000007},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.5,"15min":0.505},"min":{"1min":0.373,"5min":0.33100000000000002,"15min":0.25900000000000001},"max":{"1min":0.63900000000000001,"5min":0.70899999999999996,"15min":4.327},"last":0.41999999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56499999999999995,"15min":0.52100000000000002},"min":{"1min":0.379,"5min":0.34399999999999997,"15min":0.26500000000000001},"max":{"1min":0.67000000000000004,"5min":4.3120000000000003,"15min":4.3120000000000003},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56299999999999994,"15min":0.55800000000000005},"min":{"1min":0.46300000000000002,"5min":0.311,"15min":0.29999999999999999},"max":{"1min":0.65400000000000003,"5min":3.0600000000000001,"15min":4.7309999999999999},"last":0.65200000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56899999999999995,"15min":0.54500000000000004},"min":{"1min":0.45300000000000001,"5min":0.32600000000000001,"15min":0.27900000000000003},"max":{"1min":0.69899999999999995,"5min":4.5190000000000001,"15min":4.5190000000000001},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.44800000000000001,"5min":0.374,"15min":0.29699999999999999},"max":{"1min":0.73199999999999998,"5min":3.0070000000000001,"15min":9.3879999999999999},"last":0.60699999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.52600000000000002,"15min":0.49299999999999999},"min":{"1min":0.32600000000000001,"5min":0.29799999999999999,"15min":0.24399999999999999},"max":{"1min":0.59099999999999997,"5min":4.6639999999999997,"15min":4.6639999999999997},"last":0.376},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.56799999999999995,"15min":0.53500000000000003},"min":{"1min":0.41999999999999998,"5min":0.28499999999999998,"15min":0.27300000000000002},"max":{"1min":0.64700000000000002,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":0.40100000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.53200000000000003,"15min":0.55700000000000005},"min":{"1min":0.33100000000000002,"5min":0.32900000000000001,"15min":0.26000000000000001},"max":{"1min":0.72399999999999998,"5min":0.77000000000000002,"15min":9.3499999999999996},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.52500000000000002,"15min":0.53800000000000003},"min":{"1min":0.371,"5min":0.30099999999999999,"15min":0.26800000000000002},"max":{"1min":0.71399999999999997,"5min":0.89100000000000001,"15min":4.444},"last":0.44600000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.56699999999999995,"15min":0.59299999999999997},"min":{"1min":0.39500000000000002,"5min":0.38100000000000001,"15min":0.29199999999999998},"max":{"1min":0.68600000000000005,"5min":0.82099999999999995,"15min":9.4969999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.63200000000000001,"15min":0.61899999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.74199999999999999,"5min":4.4669999999999996,"15min":7.2039999999999997},"last":0.52200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575012,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299440,"kb_used_data":2152,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072400,"statfs":{"total":96636764160,"available":96330137600,"internally_reserved":0,"allocated":2203648,"data_stored":1017844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.60999999999999999,"15min":0.52700000000000002},"min":{"1min":0.307,"5min":0.247,"15min":0.187},"max":{"1min":0.78300000000000003,"5min":9.5549999999999997,"15min":9.5549999999999997},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.66900000000000004,"15min":0.57299999999999995},"min":{"1min":0.47299999999999998,"5min":0.30399999999999999,"15min":0.254},"max":{"1min":0.81999999999999995,"5min":9.4659999999999993,"15min":9.4659999999999993},"last":0.70399999999999996}]},{"osd":1,"last update":"Fri Oct 6 11:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.497,"15min":0.48699999999999999},"min":{"1min":0.372,"5min":0.27500000000000002,"15min":0.23300000000000001},"max":{"1min":0.71399999999999997,"5min":0.80300000000000005,"15min":0.91700000000000004},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.53200000000000003,"15min":0.52100000000000002},"min":{"1min":0.34599999999999997,"5min":0.32900000000000001,"15min":0.216},"max":{"1min":0.84199999999999997,"5min":2.238,"15min":5.2670000000000003},"last":0.55900000000000005}]},{"osd":2,"last update":"Fri Oct 6 11:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.51000000000000001,"15min":0.50700000000000001},"min":{"1min":0.30199999999999999,"5min":0.255,"15min":0.252},"max":{"1min":0.753,"5min":0.93200000000000005,"15min":7.0659999999999998},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.52100000000000002,"15min":0.52300000000000002},"min":{"1min":0.40300000000000002,"5min":0.32200000000000001,"15min":0.26600000000000001},"max":{"1min":0.77600000000000002,"5min":0.78600000000000003,"15min":7.0819999999999999},"last":0.61199999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57799999999999996,"15min":0.52700000000000002},"min":{"1min":0.39400000000000002,"5min":0.32600000000000001,"15min":0.25800000000000001},"max":{"1min":0.91300000000000003,"5min":3.871,"15min":3.871},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.55200000000000005,"15min":0.53700000000000003},"min":{"1min":0.47199999999999998,"5min":0.32100000000000001,"15min":0.312},"max":{"1min":0.80700000000000005,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.71599999999999997}]},{"osd":4,"last update":"Fri Oct 6 11:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.48399999999999999,"15min":0.47699999999999998},"min":{"1min":0.35899999999999999,"5min":0.26800000000000002,"15min":0.24299999999999999},"max":{"1min":0.72999999999999998,"5min":0.76000000000000001,"15min":0.88},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54200000000000004,"15min":0.53200000000000003},"min":{"1min":0.38600000000000001,"5min":0.29699999999999999,"15min":0.27900000000000003},"max":{"1min":0.77600000000000002,"5min":0.82399999999999995,"15min":1.0680000000000001},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52700000000000002,"15min":0.51600000000000001},"min":{"1min":0.36599999999999999,"5min":0.32000000000000001,"15min":0.28399999999999997},"max":{"1min":0.69999999999999996,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63400000000000001,"15min":0.58099999999999996},"min":{"1min":0.42499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.88700000000000001,"5min":7.1379999999999999,"15min":7.1379999999999999},"last":0.69199999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59399999999999997,"15min":0.57099999999999995},"min":{"1min":0.38400000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.83899999999999997,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.59999999999999998,"15min":0.58599999999999997},"min":{"1min":0.40999999999999998,"5min":0.36399999999999999,"15min":0.30199999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.75}]}]},{"osd":1,"up_from":13,"seq":55834575011,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":300024,"kb_used_data":2736,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071816,"statfs":{"total":96636764160,"available":96329539584,"internally_reserved":0,"allocated":2801664,"data_stored":1609565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.47799999999999998,"15min":0.377},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.186},"max":{"1min":0.54000000000000004,"5min":13.393000000000001,"15min":13.393000000000001},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.374,"5min":0.47599999999999998,"15min":0.38800000000000001},"min":{"1min":0.247,"5min":0.22700000000000001,"15min":0.19700000000000001},"max":{"1min":0.52100000000000002,"5min":11.462,"15min":11.462},"last":0.34799999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.41999999999999998,"15min":0.36299999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.216},"max":{"1min":0.56000000000000005,"5min":8.0470000000000006,"15min":8.0470000000000006},"last":0.31},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.45900000000000002,"15min":0.41099999999999998},"min":{"1min":0.27100000000000002,"5min":0.215,"15min":0.20999999999999999},"max":{"1min":0.66700000000000004,"5min":4.8630000000000004,"15min":4.8630000000000004},"last":0.38700000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.47599999999999998,"15min":0.42799999999999999},"min":{"1min":0.311,"5min":0.255,"15min":0.252},"max":{"1min":0.63700000000000001,"5min":4.8029999999999999,"15min":4.8029999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.46100000000000002,"15min":0.40200000000000002},"min":{"1min":0.23799999999999999,"5min":0.23400000000000001,"15min":0.217},"max":{"1min":0.61799999999999999,"5min":5.8700000000000001,"15min":5.8700000000000001},"last":0.42699999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56399999999999995,"15min":0.53200000000000003},"min":{"1min":0.42499999999999999,"5min":0.28299999999999997,"15min":0.28199999999999997},"max":{"1min":0.83099999999999996,"5min":1.264,"15min":1.264},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.64200000000000002,"15min":0.57999999999999996},"min":{"1min":0.46700000000000003,"5min":0.317,"15min":0.317},"max":{"1min":0.85299999999999998,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.52500000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.624,"15min":0.57599999999999996},"min":{"1min":0.432,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.79900000000000004,"5min":3.4390000000000001,"15min":3.4390000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.70799999999999996,"15min":0.60199999999999998},"min":{"1min":0.47599999999999998,"5min":0.36799999999999999,"15min":0.29499999999999998},"max":{"1min":0.92000000000000004,"5min":9.3829999999999991,"15min":9.3829999999999991},"last":0.502}]},{"osd":6,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.66500000000000004,"15min":0.60199999999999998},"min":{"1min":0.47799999999999998,"5min":0.35999999999999999,"15min":0.315},"max":{"1min":0.90800000000000003,"5min":3.4750000000000001,"15min":3.4750000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.66400000000000003,"15min":0.60999999999999999},"min":{"1min":0.45400000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.89700000000000002,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.53800000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68200000000000005,"15min":0.621},"min":{"1min":0.44400000000000001,"5min":0.39800000000000002,"15min":0.38500000000000001},"max":{"1min":0.90300000000000002,"5min":4.7290000000000001,"15min":4.7290000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.64300000000000002,"15min":0.60199999999999998},"min":{"1min":0.47399999999999998,"5min":0.38900000000000001,"15min":0.374},"max":{"1min":0.871,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.57599999999999996}]}]},{"osd":0,"up_from":13,"seq":55834575010,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303524,"kb_used_data":2140,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068316,"statfs":{"total":96636764160,"available":96325955584,"internally_reserved":0,"allocated":2191360,"data_stored":1011228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.34599999999999997,"15min":0.47299999999999998},"min":{"1min":0.23999999999999999,"5min":0.20399999999999999,"15min":0.184},"max":{"1min":0.55500000000000005,"5min":0.60199999999999998,"15min":36.097999999999999},"last":0.308},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.36499999999999999,"15min":0.38600000000000001},"min":{"1min":0.26400000000000001,"5min":0.22,"15min":0.182},"max":{"1min":0.51400000000000001,"5min":0.92400000000000004,"15min":7.2990000000000004},"last":0.38900000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.36599999999999999,"15min":0.50600000000000001},"min":{"1min":0.315,"5min":0.223,"15min":0.217},"max":{"1min":0.56100000000000005,"5min":0.61699999999999999,"15min":36.07},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.39400000000000002,"15min":0.41299999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.219},"max":{"1min":0.60799999999999998,"5min":0.94899999999999995,"15min":6.7800000000000002},"last":0.33800000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.36299999999999999,"15min":0.39600000000000002},"min":{"1min":0.28100000000000003,"5min":0.255,"15min":0.223},"max":{"1min":0.504,"5min":0.55000000000000004,"15min":8.4130000000000003},"last":0.373},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.42799999999999999,"15min":0.56000000000000005},"min":{"1min":0.28599999999999998,"5min":0.25800000000000001,"15min":0.249},"max":{"1min":0.59099999999999997,"5min":1.9079999999999999,"15min":35.959000000000003},"last":0.40400000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.59199999999999997,"15min":0.57299999999999995},"min":{"1min":0.496,"5min":0.33800000000000002,"15min":0.29599999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":2.427},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.60799999999999998,"15min":0.73399999999999999},"min":{"1min":0.496,"5min":0.374,"15min":0.29299999999999998},"max":{"1min":0.91100000000000003,"5min":0.94999999999999996,"15min":36.005000000000003},"last":0.75}]},{"osd":5,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.39400000000000002,"5min":0.38400000000000001,"15min":0.32900000000000001},"max":{"1min":0.86199999999999999,"5min":0.999,"15min":6.6699999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57699999999999996,"15min":0.56299999999999994},"min":{"1min":0.41399999999999998,"5min":0.372,"15min":0.315},"max":{"1min":0.77200000000000002,"5min":0.99399999999999999,"15min":2.0600000000000001},"last":0.57099999999999995}]},{"osd":6,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.61299999999999999,"15min":0.73499999999999999},"min":{"1min":0.45800000000000002,"5min":0.39200000000000002,"15min":0.317},"max":{"1min":0.878,"5min":0.98699999999999999,"15min":36.037999999999997},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.63100000000000001,"15min":0.64400000000000002},"min":{"1min":0.45800000000000002,"5min":0.40999999999999998,"15min":0.36399999999999999},"max":{"1min":0.88800000000000001,"5min":1.028,"15min":6.7110000000000003},"last":0.69899999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.47399999999999998,"5min":0.432,"15min":0.371},"max":{"1min":0.80400000000000005,"5min":1.054,"15min":6.742},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.58799999999999997,"15min":0.57799999999999996},"min":{"1min":0.46200000000000002,"5min":0.41399999999999998,"15min":0.34499999999999997},"max":{"1min":0.89300000000000002,"5min":0.96199999999999997,"15min":1.917},"last":0.78600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575011,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299428,"kb_used_data":2140,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072412,"statfs":{"total":96636764160,"available":96330149888,"internally_reserved":0,"allocated":2191360,"data_stored":1011228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.47499999999999998,"15min":0.36599999999999999},"min":{"1min":0.24399999999999999,"5min":0.214,"15min":0.17999999999999999},"max":{"1min":0.622,"5min":15.228,"15min":15.228},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.40699999999999997,"15min":0.39200000000000002},"min":{"1min":0.32000000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.72599999999999998,"5min":1.714,"15min":1.714},"last":0.36599999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.379,"15min":0.376},"min":{"1min":0.253,"5min":0.23599999999999999,"15min":0.19900000000000001},"max":{"1min":0.56999999999999995,"5min":0.57499999999999996,"15min":0.745},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.36599999999999999,"15min":0.35699999999999998},"min":{"1min":0.26000000000000001,"5min":0.23200000000000001,"15min":0.216},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.33600000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.36699999999999999,"15min":0.36899999999999999},"min":{"1min":0.27000000000000002,"5min":0.23699999999999999,"15min":0.23200000000000001},"max":{"1min":0.60899999999999999,"5min":0.621,"15min":0.629},"last":0.317},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.38800000000000001,"15min":0.371},"min":{"1min":0.29499999999999998,"5min":0.254,"15min":0.251},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.38300000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54500000000000004,"15min":0.53400000000000003},"min":{"1min":0.439,"5min":0.30599999999999999,"15min":0.30299999999999999},"max":{"1min":0.69699999999999995,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.68799999999999994,"15min":0.59399999999999997},"min":{"1min":0.374,"5min":0.28199999999999997,"15min":0.27900000000000003},"max":{"1min":0.70999999999999996,"5min":15.26,"15min":15.26},"last":0.69699999999999995}]},{"osd":5,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.69799999999999995,"15min":0.59599999999999997},"min":{"1min":0.39700000000000002,"5min":0.35799999999999998,"15min":0.32400000000000001},"max":{"1min":0.73699999999999999,"5min":15.186,"15min":15.186},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56799999999999995,"15min":0.56100000000000005},"min":{"1min":0.42999999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72199999999999998,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.58099999999999996}]},{"osd":6,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59299999999999997,"15min":0.58599999999999997},"min":{"1min":0.48299999999999998,"5min":0.38200000000000001,"15min":0.32600000000000001},"max":{"1min":0.76900000000000002,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59599999999999997,"15min":0.57999999999999996},"min":{"1min":0.438,"5min":0.40699999999999997,"15min":0.34200000000000003},"max":{"1min":0.80500000000000005,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.68300000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.67300000000000004,"15min":0.59999999999999998},"min":{"1min":0.41699999999999998,"5min":0.37,"15min":0.34499999999999997},"max":{"1min":0.69399999999999995,"5min":10.977,"15min":10.977},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57799999999999996,"15min":0.57399999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.38200000000000001},"max":{"1min":0.79400000000000004,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.73999999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575011,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311716,"kb_used_data":2140,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060124,"statfs":{"total":96636764160,"available":96317566976,"internally_reserved":0,"allocated":2191360,"data_stored":1011228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.34799999999999998,"15min":0.32800000000000001},"min":{"1min":0.20799999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.55200000000000005,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.41999999999999998,"15min":0.39100000000000001},"min":{"1min":0.26800000000000002,"5min":0.23000000000000001,"15min":0.22700000000000001},"max":{"1min":0.61099999999999999,"5min":4.4820000000000002,"15min":4.4820000000000002},"last":0.33300000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.32100000000000001,"15min":0.315},"min":{"1min":0.22800000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.48199999999999998,"5min":0.54000000000000004,"15min":0.65400000000000003},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.36499999999999999,"15min":0.35799999999999998},"min":{"1min":0.28899999999999998,"5min":0.254,"15min":0.188},"max":{"1min":0.52300000000000002,"5min":0.53600000000000003,"15min":1.196},"last":0.251}]},{"osd":2,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.39900000000000002,"15min":0.38200000000000001},"min":{"1min":0.25,"5min":0.245,"15min":0.19600000000000001},"max":{"1min":0.52100000000000002,"5min":4.601,"15min":4.601},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.44400000000000001,"15min":0.41999999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.26100000000000001},"max":{"1min":0.60599999999999998,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.34499999999999997}]},{"osd":4,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55300000000000005,"15min":0.54700000000000004},"min":{"1min":0.38800000000000001,"5min":0.32100000000000001,"15min":0.311},"max":{"1min":0.76500000000000001,"5min":0.88500000000000001,"15min":1.694},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55500000000000005,"15min":0.54200000000000004},"min":{"1min":0.438,"5min":0.32600000000000001,"15min":0.30199999999999999},"max":{"1min":0.71699999999999997,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.52800000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.55800000000000005,"15min":0.54100000000000004},"min":{"1min":0.42199999999999999,"5min":0.34100000000000003,"15min":0.29399999999999998},"max":{"1min":0.83999999999999997,"5min":0.86399999999999999,"15min":0.878},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.56200000000000006,"15min":0.55600000000000005},"min":{"1min":0.40899999999999997,"5min":0.35699999999999998,"15min":0.29699999999999999},"max":{"1min":0.877,"5min":0.877,"15min":1.165},"last":0.59599999999999997}]},{"osd":6,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.59499999999999997,"15min":0.58099999999999996},"min":{"1min":0.501,"5min":0.372,"15min":0.36699999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":1.1359999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.58999999999999997,"15min":0.58699999999999997},"min":{"1min":0.45500000000000002,"5min":0.36799999999999999,"15min":0.34399999999999997},"max":{"1min":0.80600000000000005,"5min":0.82999999999999996,"15min":1.7470000000000001},"last":0.63}]},{"osd":7,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.57499999999999996,"15min":0.57599999999999996},"min":{"1min":0.41599999999999998,"5min":0.38900000000000001,"15min":0.35599999999999998},"max":{"1min":0.79300000000000004,"5min":0.89900000000000002,"15min":1.657},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.58699999999999997,"15min":0.57599999999999996},"min":{"1min":0.46300000000000002,"5min":0.38,"15min":0.35499999999999998},"max":{"1min":0.86199999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.54500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575010,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307636,"kb_used_data":2156,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064204,"statfs":{"total":96636764160,"available":96321744896,"internally_reserved":0,"allocated":2207744,"data_stored":1019197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.47899999999999998,"15min":0.50700000000000001},"min":{"1min":0.24199999999999999,"5min":0.216,"15min":0.19500000000000001},"max":{"1min":0.68700000000000006,"5min":0.82099999999999995,"15min":2.6619999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.499,"15min":0.49399999999999999},"min":{"1min":0.28899999999999998,"5min":0.224,"15min":0.215},"max":{"1min":0.76200000000000001,"5min":0.81499999999999995,"15min":0.91200000000000003},"last":0.40100000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.50700000000000001,"15min":0.53000000000000003},"min":{"1min":0.308,"5min":0.27300000000000002,"15min":0.23300000000000001},"max":{"1min":0.77300000000000002,"5min":1,"15min":2.8650000000000002},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.505,"15min":0.53500000000000003},"min":{"1min":0.35299999999999998,"5min":0.27000000000000002,"15min":0.25800000000000001},"max":{"1min":0.79800000000000004,"5min":1.2869999999999999,"15min":2.7610000000000001},"last":0.49299999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.52900000000000003,"15min":0.53000000000000003},"min":{"1min":0.44500000000000001,"5min":0.28499999999999998,"15min":0.23100000000000001},"max":{"1min":0.70399999999999996,"5min":0.77400000000000002,"15min":1.6910000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56699999999999995,"15min":0.57699999999999996},"min":{"1min":0.44800000000000001,"5min":0.33100000000000002,"15min":0.30599999999999999},"max":{"1min":0.82099999999999995,"5min":0.82799999999999996,"15min":1.718},"last":0.60599999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.57399999999999995,"15min":0.57799999999999996},"min":{"1min":0.38800000000000001,"5min":0.32000000000000001,"15min":0.26700000000000002},"max":{"1min":0.67500000000000004,"5min":2.387,"15min":2.677},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.54600000000000004,"15min":0.52800000000000002},"min":{"1min":0.40100000000000002,"5min":0.29299999999999998,"15min":0.27500000000000002},"max":{"1min":0.77700000000000002,"5min":1.784,"15min":1.784},"last":0.54300000000000004}]},{"osd":5,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47799999999999998,"15min":0.47999999999999998},"min":{"1min":0.36499999999999999,"5min":0.28499999999999998,"15min":0.23200000000000001},"max":{"1min":0.60299999999999998,"5min":0.73199999999999998,"15min":0.80200000000000005},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.51700000000000002,"15min":0.52300000000000002},"min":{"1min":0.317,"5min":0.28899999999999998,"15min":0.28399999999999997},"max":{"1min":0.752,"5min":0.752,"15min":0.82799999999999996},"last":0.64400000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.252},"max":{"1min":0.79500000000000004,"5min":0.83499999999999996,"15min":0.89000000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54500000000000004,"15min":0.55400000000000005},"min":{"1min":0.38700000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.72899999999999998,"5min":0.80200000000000005,"15min":1.165},"last":0.69599999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55300000000000005,"15min":0.55700000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.71199999999999997,"5min":0.84999999999999998,"15min":0.90500000000000003},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58499999999999996,"15min":0.58899999999999997},"min":{"1min":0.34399999999999997,"5min":0.318,"15min":0.317},"max":{"1min":0.81299999999999994,"5min":0.875,"15min":0.95499999999999996},"last":0.70799999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575012,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315816,"kb_used_data":2144,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94056024,"statfs":{"total":96636764160,"available":96313368576,"internally_reserved":0,"allocated":2195456,"data_stored":1012581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.48199999999999998,"15min":0.55900000000000005},"min":{"1min":0.32800000000000001,"5min":0.23300000000000001,"15min":0.20499999999999999},"max":{"1min":0.752,"5min":0.752,"15min":5.0490000000000004},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.47799999999999998,"15min":0.54100000000000004},"min":{"1min":0.34699999999999998,"5min":0.253,"15min":0.22900000000000001},"max":{"1min":0.626,"5min":0.71299999999999997,"15min":5.1449999999999996},"last":0.48199999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.48099999999999998,"15min":0.48499999999999999},"min":{"1min":0.34699999999999998,"5min":0.25700000000000001,"15min":0.25},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.97199999999999998},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.502,"15min":0.51000000000000001},"min":{"1min":0.373,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.73599999999999999,"5min":0.74099999999999999,"15min":1.8799999999999999},"last":0.65700000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.52600000000000002,"15min":0.54700000000000004},"min":{"1min":0.42999999999999999,"5min":0.30099999999999999,"15min":0.28299999999999997},"max":{"1min":0.73399999999999999,"5min":0.76600000000000001,"15min":4.234},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.55800000000000005,"15min":0.56100000000000005},"min":{"1min":0.41699999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.78700000000000003,"5min":0.79200000000000004,"15min":1.0369999999999999},"last":0.69299999999999995}]},{"osd":3,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.497,"15min":0.57499999999999996},"min":{"1min":0.39700000000000002,"5min":0.29499999999999998,"15min":0.27700000000000002},"max":{"1min":0.67400000000000004,"5min":0.72799999999999998,"15min":5.2169999999999996},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.52600000000000002,"15min":0.53800000000000003},"min":{"1min":0.42599999999999999,"5min":0.29999999999999999,"15min":0.29699999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":1.008},"last":0.63300000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.47999999999999998,"15min":0.5},"min":{"1min":0.36399999999999999,"5min":0.25600000000000001,"15min":0.23999999999999999},"max":{"1min":0.61699999999999999,"5min":0.83399999999999996,"15min":1.917},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.495,"15min":0.51100000000000001},"min":{"1min":0.38200000000000001,"5min":0.251,"15min":0.23899999999999999},"max":{"1min":0.64900000000000002,"5min":0.69199999999999995,"15min":0.87},"last":0.57099999999999995}]},{"osd":6,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51000000000000001,"15min":0.53700000000000003},"min":{"1min":0.41099999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63700000000000001,"5min":0.76800000000000002,"15min":2.0139999999999998},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57399999999999995,"15min":0.59099999999999997},"min":{"1min":0.46200000000000002,"5min":0.30299999999999999,"15min":0.29999999999999999},"max":{"1min":0.68600000000000005,"5min":0.80800000000000005,"15min":1.9470000000000001},"last":0.73899999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53300000000000003,"15min":0.55900000000000005},"min":{"1min":0.42099999999999999,"5min":0.28799999999999998,"15min":0.27700000000000002},"max":{"1min":0.628,"5min":0.81000000000000005,"15min":0.96499999999999997},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57199999999999995,"15min":0.59099999999999997},"min":{"1min":0.46800000000000003,"5min":0.29199999999999998,"15min":0.28799999999999998},"max":{"1min":0.69199999999999995,"5min":0.77300000000000002,"15min":1.4119999999999999},"last":0.755}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:18:56.586 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:18:56.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.721+0000 7f03e8161700 1 Processor -- start 2023-10-06T11:18:56.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.721+0000 7f03e8161700 1 -- start start 2023-10-06T11:18:56.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.722+0000 7f03e8161700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f03e015a940 0x7f03e0153c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:56.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.722+0000 7f03e8161700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03e015dcc0 0x7f03e00ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:56.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.722+0000 7f03e8161700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03e015d270 con 0x7f03e01538c0 2023-10-06T11:18:56.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.722+0000 7f03e8161700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03e015d830 con 0x7f03e015a940 2023-10-06T11:18:56.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.722+0000 7f03e8161700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03e015e110 con 0x7f03e015dcc0 2023-10-06T11:18:56.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.722+0000 7f03e56fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f03e015a940 0x7f03e0153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:56.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.722+0000 7f03e56fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f03e015a940 0x7f03e0153c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58638/0 (socket says 172.21.15.146:58638) 2023-10-06T11:18:56.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.722+0000 7f03e56fc700 1 -- 172.21.15.146:0/3397256850 learned_addr learned my addr 172.21.15.146:0/3397256850 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:56.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.723+0000 7f03e66fe700 1 --2- 172.21.15.146:0/3397256850 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03e015dcc0 0x7f03e00ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:56.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.723+0000 7f03e56fc700 1 -- 172.21.15.146:0/3397256850 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03e015dcc0 msgr2=0x7f03e00ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:56.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.723+0000 7f03e56fc700 1 --2- 172.21.15.146:0/3397256850 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03e015dcc0 0x7f03e00ce610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:56.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.723+0000 7f03e56fc700 1 -- 172.21.15.146:0/3397256850 >> v1:172.21.15.151:6789/0 conn(0x7f03e01538c0 legacy=0x7f03e00cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:56.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.723+0000 7f03e56fc700 1 -- 172.21.15.146:0/3397256850 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e00cb810 con 0x7f03e015a940 2023-10-06T11:18:56.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.723+0000 7f03e66fe700 1 --2- 172.21.15.146:0/3397256850 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03e015dcc0 0x7f03e00ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:18:56.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.723+0000 7f03e56fc700 1 --2- 172.21.15.146:0/3397256850 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03e015a940 0x7f03e0153c90 secure :-1 s=READY pgs=2245 cs=0 l=1 rev1=1 crypto rx=0x7f03d40099b0 tx=0x7f03d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=945bcc78dc2d69b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:56.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.723+0000 7f03e4efb700 1 -- 172.21.15.146:0/3397256850 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d400b820 con 0x7f03e015a940 2023-10-06T11:18:56.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.723+0000 7f03e4efb700 1 -- 172.21.15.146:0/3397256850 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d400b980 con 0x7f03e015a940 2023-10-06T11:18:56.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.723+0000 7f03e4efb700 1 -- 172.21.15.146:0/3397256850 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d400bd20 con 0x7f03e015a940 2023-10-06T11:18:56.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.723+0000 7f03e8161700 1 -- 172.21.15.146:0/3397256850 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03e015a940 msgr2=0x7f03e0153c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:56.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.723+0000 7f03e8161700 1 --2- 172.21.15.146:0/3397256850 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03e015a940 0x7f03e0153c90 secure :-1 s=READY pgs=2245 cs=0 l=1 rev1=1 crypto rx=0x7f03d40099b0 tx=0x7f03d4009250 comp rx=0 tx=0).stop 2023-10-06T11:18:56.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.723+0000 7f03e8161700 1 -- 172.21.15.146:0/3397256850 shutdown_connections 2023-10-06T11:18:56.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.723+0000 7f03e8161700 1 --2- 172.21.15.146:0/3397256850 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03e015dcc0 0x7f03e00ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:56.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.723+0000 7f03e8161700 1 --2- 172.21.15.146:0/3397256850 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03e015a940 0x7f03e0153c90 unknown :-1 s=CLOSED pgs=2245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:56.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.723+0000 7f03e8161700 1 -- 172.21.15.146:0/3397256850 >> 172.21.15.146:0/3397256850 conn(0x7f03e006eb10 msgr2=0x7f03e006ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:56.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.723+0000 7f03e8161700 1 -- 172.21.15.146:0/3397256850 shutdown_connections 2023-10-06T11:18:56.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.724+0000 7f03e8161700 1 -- 172.21.15.146:0/3397256850 wait complete. 2023-10-06T11:18:56.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.725+0000 7f03e8161700 1 Processor -- start 2023-10-06T11:18:56.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.725+0000 7f03e8161700 1 -- start start 2023-10-06T11:18:56.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.725+0000 7f03e8161700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03e01538c0 0x7f03e00b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:56.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.725+0000 7f03e8161700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03e015a940 0x7f03e00c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:56.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.725+0000 7f03e8161700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03e015dcc0 0x7f03e00c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:56.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.725+0000 7f03e8161700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e015bc20 con 0x7f03e01538c0 2023-10-06T11:18:56.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.725+0000 7f03e8161700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e015bf00 con 0x7f03e015a940 2023-10-06T11:18:56.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.725+0000 7f03e8161700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03e015c1e0 con 0x7f03e015dcc0 2023-10-06T11:18:56.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.725+0000 7f03e5efd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03e01538c0 0x7f03e00b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:56.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.725+0000 7f03e5efd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03e01538c0 0x7f03e00b59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58652/0 (socket says 172.21.15.146:58652) 2023-10-06T11:18:56.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.725+0000 7f03e5efd700 1 -- 172.21.15.146:0/4066536353 learned_addr learned my addr 172.21.15.146:0/4066536353 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:56.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.726+0000 7f03e56fc700 1 --2- 172.21.15.146:0/4066536353 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03e015a940 0x7f03e00c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:56.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.726+0000 7f03e66fe700 1 --2- 172.21.15.146:0/4066536353 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03e015dcc0 0x7f03e00c7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:56.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.726+0000 7f03e5efd700 1 -- 172.21.15.146:0/4066536353 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03e015dcc0 msgr2=0x7f03e00c7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:56.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.726+0000 7f03e5efd700 1 --2- 172.21.15.146:0/4066536353 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03e015dcc0 0x7f03e00c7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:56.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.726+0000 7f03e5efd700 1 -- 172.21.15.146:0/4066536353 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03e015a940 msgr2=0x7f03e00c9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:56.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.726+0000 7f03e5efd700 1 --2- 172.21.15.146:0/4066536353 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03e015a940 0x7f03e00c9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:56.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.726+0000 7f03e5efd700 1 -- 172.21.15.146:0/4066536353 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d40094f0 con 0x7f03e01538c0 2023-10-06T11:18:56.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.726+0000 7f03e66fe700 1 --2- 172.21.15.146:0/4066536353 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03e015dcc0 0x7f03e00c7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:18:56.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.726+0000 7f03e5efd700 1 --2- 172.21.15.146:0/4066536353 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03e01538c0 0x7f03e00b59a0 secure :-1 s=READY pgs=2246 cs=0 l=1 rev1=1 crypto rx=0x7f03d000bc30 tx=0x7f03d0009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:56.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.726+0000 7f03ddffb700 1 -- 172.21.15.146:0/4066536353 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d000c900 con 0x7f03e01538c0 2023-10-06T11:18:56.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.726+0000 7f03ddffb700 1 -- 172.21.15.146:0/4066536353 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03d000caa0 con 0x7f03e01538c0 2023-10-06T11:18:56.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.726+0000 7f03e8161700 1 -- 172.21.15.146:0/4066536353 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03e015c4c0 con 0x7f03e01538c0 2023-10-06T11:18:56.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.726+0000 7f03ddffb700 1 -- 172.21.15.146:0/4066536353 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03d000ce60 con 0x7f03e01538c0 2023-10-06T11:18:56.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.726+0000 7f03e8161700 1 -- 172.21.15.146:0/4066536353 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03e015b720 con 0x7f03e01538c0 2023-10-06T11:18:56.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.727+0000 7f03e8161700 1 -- 172.21.15.146:0/4066536353 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03e015b970 con 0x7f03e01538c0 2023-10-06T11:18:56.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.727+0000 7f03ddffb700 1 -- 172.21.15.146:0/4066536353 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f03d0014620 con 0x7f03e01538c0 2023-10-06T11:18:56.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.728+0000 7f03ddffb700 1 --2- 172.21.15.146:0/4066536353 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f03cc066f30 0x7f03cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:56.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.728+0000 7f03ddffb700 1 -- 172.21.15.146:0/4066536353 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f03d00846d0 con 0x7f03e01538c0 2023-10-06T11:18:56.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.728+0000 7f03e56fc700 1 --2- 172.21.15.146:0/4066536353 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f03cc066f30 0x7f03cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:56.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.728+0000 7f03e56fc700 1 --2- 172.21.15.146:0/4066536353 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f03cc066f30 0x7f03cc0693e0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f03d40099b0 tx=0x7f03d4016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:56.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.732+0000 7f03ddffb700 1 -- 172.21.15.146:0/4066536353 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f03d00517e0 con 0x7f03e01538c0 2023-10-06T11:18:56.807 INFO:tasks.ceph.mds.d.smithi151.stderr:2023-10-06T11:18:56.806+0000 7fce96bb0700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T11:18:56.914 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.912+0000 7f03e8161700 1 -- 172.21.15.146:0/4066536353 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f03e004c380 con 0x7f03cc066f30 2023-10-06T11:18:56.921 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.920+0000 7f03ddffb700 1 -- 172.21.15.146:0/4066536353 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303924 (secure 0 0 0) 0x7f03e004c380 con 0x7f03cc066f30 2023-10-06T11:18:56.925 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:18:56.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.924+0000 7f03e8161700 1 -- 172.21.15.146:0/4066536353 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f03cc066f30 msgr2=0x7f03cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:56.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.924+0000 7f03e8161700 1 --2- 172.21.15.146:0/4066536353 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f03cc066f30 0x7f03cc0693e0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f03d40099b0 tx=0x7f03d4016000 comp rx=0 tx=0).stop 2023-10-06T11:18:56.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.924+0000 7f03e8161700 1 -- 172.21.15.146:0/4066536353 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03e01538c0 msgr2=0x7f03e00b59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:56.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.924+0000 7f03e8161700 1 --2- 172.21.15.146:0/4066536353 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03e01538c0 0x7f03e00b59a0 secure :-1 s=READY pgs=2246 cs=0 l=1 rev1=1 crypto rx=0x7f03d000bc30 tx=0x7f03d0009820 comp rx=0 tx=0).stop 2023-10-06T11:18:56.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.924+0000 7f03e8161700 1 -- 172.21.15.146:0/4066536353 shutdown_connections 2023-10-06T11:18:56.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.924+0000 7f03e8161700 1 --2- 172.21.15.146:0/4066536353 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f03cc066f30 0x7f03cc0693e0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:56.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.924+0000 7f03e8161700 1 --2- 172.21.15.146:0/4066536353 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03e015dcc0 0x7f03e00c7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:56.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.924+0000 7f03e8161700 1 --2- 172.21.15.146:0/4066536353 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03e01538c0 0x7f03e00b59a0 unknown :-1 s=CLOSED pgs=2246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:56.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.924+0000 7f03e8161700 1 --2- 172.21.15.146:0/4066536353 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03e015a940 0x7f03e00c9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:56.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.924+0000 7f03e8161700 1 -- 172.21.15.146:0/4066536353 >> 172.21.15.146:0/4066536353 conn(0x7f03e006eb10 msgr2=0x7f03e0150e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:56.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.924+0000 7f03e8161700 1 -- 172.21.15.146:0/4066536353 shutdown_connections 2023-10-06T11:18:56.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:56.924+0000 7f03e8161700 1 -- 172.21.15.146:0/4066536353 wait complete. 2023-10-06T11:18:56.929 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:18:56.937 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":569,"stamp":"2023-10-06T11:18:55.312215+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":134,"acting":134,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":24,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2441692,"kb_used_data":18332,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752533028,"statfs":{"total":773094113280,"available":770593820672,"internally_reserved":0,"allocated":18771968,"data_stored":9295820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.821153"},"pg_stats":[{"pgid":"28.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.513257+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:22.963604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.513115+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:48:06.231609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.511166+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:45:18.723193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.510745+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:06:33.866195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.511723+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:09:34.925925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.503126+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:30.662720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.508679+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:49:38.496675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.510774+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:43:55.311129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.511555+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:13.769278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.516145+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:11:36.554686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.511245+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:19:53.986592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.510274+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:58.152151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.503627+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:47:32.386139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.502870+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:40:38.219266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.495654+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:09:58.364738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.508575+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:19:32.976623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.497308+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:59:35.711896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.492630+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:22.454621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.497405+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:47:31.381968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.496441+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:12.235357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.507984+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:32:33.004446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-06T11:18:51.520772+0000","last_change":"2023-10-06T11:18:51.520772+0000","last_active":"2023-10-06T11:18:51.520772+0000","last_peered":"2023-10-06T11:18:51.520772+0000","last_clean":"2023-10-06T11:18:51.520772+0000","last_became_active":"2023-10-06T11:18:51.520462+0000","last_became_peered":"2023-10-06T11:18:51.520462+0000","last_unstale":"2023-10-06T11:18:51.520772+0000","last_undegraded":"2023-10-06T11:18:51.520772+0000","last_fullsized":"2023-10-06T11:18:51.520772+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:47:19.326917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.493251+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:08.422937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.496006+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:08:23.261106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.512690+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:20:06.857224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.493492+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:34:37.175282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.492889+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:37:54.962748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.495516+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:01:31.340000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.515476+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:50:45.910135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.496336+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:06.689323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.495790+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:49.162033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.496381+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:18:13.347927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-06T11:18:51.518577+0000","last_change":"2023-10-06T11:18:51.518577+0000","last_active":"2023-10-06T11:18:51.518577+0000","last_peered":"2023-10-06T11:18:51.518577+0000","last_clean":"2023-10-06T11:18:51.518577+0000","last_became_active":"2023-10-06T11:18:51.518267+0000","last_became_peered":"2023-10-06T11:18:51.518267+0000","last_unstale":"2023-10-06T11:18:51.518577+0000","last_undegraded":"2023-10-06T11:18:51.518577+0000","last_fullsized":"2023-10-06T11:18:51.518577+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:12:04.967138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.511802+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:00:15.358532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.492823+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:42:10.142087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.512226+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:14.739928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.492973+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:34:22.931418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.507932+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:56:53.432751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-06T11:18:51.515072+0000","last_change":"2023-10-06T11:18:51.515072+0000","last_active":"2023-10-06T11:18:51.515072+0000","last_peered":"2023-10-06T11:18:51.515072+0000","last_clean":"2023-10-06T11:18:51.515072+0000","last_became_active":"2023-10-06T11:18:51.514821+0000","last_became_peered":"2023-10-06T11:18:51.514821+0000","last_unstale":"2023-10-06T11:18:51.515072+0000","last_undegraded":"2023-10-06T11:18:51.515072+0000","last_fullsized":"2023-10-06T11:18:51.515072+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:36:18.839256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-06T11:18:51.519403+0000","last_change":"2023-10-06T11:18:51.519403+0000","last_active":"2023-10-06T11:18:51.519403+0000","last_peered":"2023-10-06T11:18:51.519403+0000","last_clean":"2023-10-06T11:18:51.519403+0000","last_became_active":"2023-10-06T11:18:51.519130+0000","last_became_peered":"2023-10-06T11:18:51.519130+0000","last_unstale":"2023-10-06T11:18:51.519403+0000","last_undegraded":"2023-10-06T11:18:51.519403+0000","last_fullsized":"2023-10-06T11:18:51.519403+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:18:11.844126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.494141+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:40:53.184600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.510476+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:39:40.994783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-06T11:18:51.521725+0000","last_change":"2023-10-06T11:18:51.521725+0000","last_active":"2023-10-06T11:18:51.521725+0000","last_peered":"2023-10-06T11:18:51.521725+0000","last_clean":"2023-10-06T11:18:51.521725+0000","last_became_active":"2023-10-06T11:18:51.521427+0000","last_became_peered":"2023-10-06T11:18:51.521427+0000","last_unstale":"2023-10-06T11:18:51.521725+0000","last_undegraded":"2023-10-06T11:18:51.521725+0000","last_fullsized":"2023-10-06T11:18:51.521725+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:01.079097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.492651+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:51:26.937096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.493704+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:09:05.555255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.509689+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:26:40.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.495516+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:08:02.104055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-06T11:18:51.518899+0000","last_change":"2023-10-06T11:18:51.518899+0000","last_active":"2023-10-06T11:18:51.518899+0000","last_peered":"2023-10-06T11:18:51.518899+0000","last_clean":"2023-10-06T11:18:51.518899+0000","last_became_active":"2023-10-06T11:18:51.517840+0000","last_became_peered":"2023-10-06T11:18:51.517840+0000","last_unstale":"2023-10-06T11:18:51.518899+0000","last_undegraded":"2023-10-06T11:18:51.518899+0000","last_fullsized":"2023-10-06T11:18:51.518899+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:01:35.577133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":154,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-06T11:18:50.494090+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:18:50.494090+0000","last_peered":"2023-10-06T11:18:50.494090+0000","last_clean":"2023-10-06T11:18:50.494090+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:18:50.494090+0000","last_undegraded":"2023-10-06T11:18:50.494090+0000","last_fullsized":"2023-10-06T11:18:50.494090+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.493576+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:09:15.298043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":144,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-06T11:18:47.532793+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:18:47.532793+0000","last_peered":"2023-10-06T11:18:47.532793+0000","last_clean":"2023-10-06T11:18:47.532793+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:18:47.532793+0000","last_undegraded":"2023-10-06T11:18:47.532793+0000","last_fullsized":"2023-10-06T11:18:47.532793+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.504457+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:15.196912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.497159+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:12:04.967138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":142,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-06T11:18:50.499036+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:18:50.499036+0000","last_peered":"2023-10-06T11:18:50.499036+0000","last_clean":"2023-10-06T11:18:50.499036+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:18:50.499036+0000","last_undegraded":"2023-10-06T11:18:50.499036+0000","last_fullsized":"2023-10-06T11:18:50.499036+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":285,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-06T11:18:47.532980+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:18:47.532980+0000","last_peered":"2023-10-06T11:18:47.532980+0000","last_clean":"2023-10-06T11:18:47.532980+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:18:47.532980+0000","last_undegraded":"2023-10-06T11:18:47.532980+0000","last_fullsized":"2023-10-06T11:18:47.532980+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-06T11:18:51.518700+0000","last_change":"2023-10-06T11:18:51.518700+0000","last_active":"2023-10-06T11:18:51.518700+0000","last_peered":"2023-10-06T11:18:51.518700+0000","last_clean":"2023-10-06T11:18:51.518700+0000","last_became_active":"2023-10-06T11:18:51.518426+0000","last_became_peered":"2023-10-06T11:18:51.518426+0000","last_unstale":"2023-10-06T11:18:51.518700+0000","last_undegraded":"2023-10-06T11:18:51.518700+0000","last_fullsized":"2023-10-06T11:18:51.518700+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:50:11.395470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":135,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-06T11:18:47.533108+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:18:47.533108+0000","last_peered":"2023-10-06T11:18:47.533108+0000","last_clean":"2023-10-06T11:18:47.533108+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:18:47.533108+0000","last_undegraded":"2023-10-06T11:18:47.533108+0000","last_fullsized":"2023-10-06T11:18:47.533108+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.493041+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:16:03.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":135,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-06T11:18:47.533069+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:18:47.533069+0000","last_peered":"2023-10-06T11:18:47.533069+0000","last_clean":"2023-10-06T11:18:47.533069+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:18:47.533069+0000","last_undegraded":"2023-10-06T11:18:47.533069+0000","last_fullsized":"2023-10-06T11:18:47.533069+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.502856+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:59.830470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.497225+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:01:35.577133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":161,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-06T11:18:47.484034+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:18:47.484034+0000","last_peered":"2023-10-06T11:18:47.484034+0000","last_clean":"2023-10-06T11:18:47.484034+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:18:47.484034+0000","last_undegraded":"2023-10-06T11:18:47.484034+0000","last_fullsized":"2023-10-06T11:18:47.484034+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.492571+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:20.989429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":143,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-06T11:18:50.496025+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:18:50.496025+0000","last_peered":"2023-10-06T11:18:50.496025+0000","last_clean":"2023-10-06T11:18:50.496025+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:18:50.496025+0000","last_undegraded":"2023-10-06T11:18:50.496025+0000","last_fullsized":"2023-10-06T11:18:50.496025+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.508306+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:54:10.845045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.495986+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:20.103244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":143,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-06T11:18:50.496047+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:18:50.496047+0000","last_peered":"2023-10-06T11:18:50.496047+0000","last_clean":"2023-10-06T11:18:50.496047+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:18:50.496047+0000","last_undegraded":"2023-10-06T11:18:50.496047+0000","last_fullsized":"2023-10-06T11:18:50.496047+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":28,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":52,"acting":52,"num_store_stats":3},{"poolid":27,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575010,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304108,"kb_used_data":2724,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067732,"statfs":{"total":96636764160,"available":96325357568,"internally_reserved":0,"allocated":2789376,"data_stored":1602949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54400000000000004,"15min":0.629},"min":{"1min":0.35899999999999999,"5min":0.252,"15min":0.21199999999999999},"max":{"1min":0.70999999999999996,"5min":4.407,"15min":23.908999999999999},"last":0.434},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.52500000000000002,"15min":0.57799999999999996},"min":{"1min":0.38200000000000001,"5min":0.26900000000000002,"15min":0.22500000000000001},"max":{"1min":0.71699999999999997,"5min":0.76800000000000002,"15min":9.3230000000000004},"last":0.56599999999999995}]},{"osd":1,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54500000000000004,"15min":0.55900000000000005},"min":{"1min":0.439,"5min":0.28399999999999997,"15min":0.26000000000000001},"max":{"1min":0.72699999999999998,"5min":2.4689999999999999,"15min":9.2360000000000007},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.5,"15min":0.505},"min":{"1min":0.373,"5min":0.33100000000000002,"15min":0.25900000000000001},"max":{"1min":0.63900000000000001,"5min":0.70899999999999996,"15min":4.327},"last":0.41999999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56499999999999995,"15min":0.52100000000000002},"min":{"1min":0.379,"5min":0.34399999999999997,"15min":0.26500000000000001},"max":{"1min":0.67000000000000004,"5min":4.3120000000000003,"15min":4.3120000000000003},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56299999999999994,"15min":0.55800000000000005},"min":{"1min":0.46300000000000002,"5min":0.311,"15min":0.29999999999999999},"max":{"1min":0.65400000000000003,"5min":3.0600000000000001,"15min":4.7309999999999999},"last":0.65200000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56899999999999995,"15min":0.54500000000000004},"min":{"1min":0.45300000000000001,"5min":0.32600000000000001,"15min":0.27900000000000003},"max":{"1min":0.69899999999999995,"5min":4.5190000000000001,"15min":4.5190000000000001},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.44800000000000001,"5min":0.374,"15min":0.29699999999999999},"max":{"1min":0.73199999999999998,"5min":3.0070000000000001,"15min":9.3879999999999999},"last":0.60699999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.52600000000000002,"15min":0.49299999999999999},"min":{"1min":0.32600000000000001,"5min":0.29799999999999999,"15min":0.24399999999999999},"max":{"1min":0.59099999999999997,"5min":4.6639999999999997,"15min":4.6639999999999997},"last":0.376},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.56799999999999995,"15min":0.53500000000000003},"min":{"1min":0.41999999999999998,"5min":0.28499999999999998,"15min":0.27300000000000002},"max":{"1min":0.64700000000000002,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":0.40100000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.53200000000000003,"15min":0.55700000000000005},"min":{"1min":0.33100000000000002,"5min":0.32900000000000001,"15min":0.26000000000000001},"max":{"1min":0.72399999999999998,"5min":0.77000000000000002,"15min":9.3499999999999996},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.52500000000000002,"15min":0.53800000000000003},"min":{"1min":0.371,"5min":0.30099999999999999,"15min":0.26800000000000002},"max":{"1min":0.71399999999999997,"5min":0.89100000000000001,"15min":4.444},"last":0.44600000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.56699999999999995,"15min":0.59299999999999997},"min":{"1min":0.39500000000000002,"5min":0.38100000000000001,"15min":0.29199999999999998},"max":{"1min":0.68600000000000005,"5min":0.82099999999999995,"15min":9.4969999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.63200000000000001,"15min":0.61899999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.74199999999999999,"5min":4.4669999999999996,"15min":7.2039999999999997},"last":0.52200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575012,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299440,"kb_used_data":2152,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072400,"statfs":{"total":96636764160,"available":96330137600,"internally_reserved":0,"allocated":2203648,"data_stored":1017844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.60999999999999999,"15min":0.52700000000000002},"min":{"1min":0.307,"5min":0.247,"15min":0.187},"max":{"1min":0.78300000000000003,"5min":9.5549999999999997,"15min":9.5549999999999997},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.66900000000000004,"15min":0.57299999999999995},"min":{"1min":0.47299999999999998,"5min":0.30399999999999999,"15min":0.254},"max":{"1min":0.81999999999999995,"5min":9.4659999999999993,"15min":9.4659999999999993},"last":0.70399999999999996}]},{"osd":1,"last update":"Fri Oct 6 11:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.497,"15min":0.48699999999999999},"min":{"1min":0.372,"5min":0.27500000000000002,"15min":0.23300000000000001},"max":{"1min":0.71399999999999997,"5min":0.80300000000000005,"15min":0.91700000000000004},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.53200000000000003,"15min":0.52100000000000002},"min":{"1min":0.34599999999999997,"5min":0.32900000000000001,"15min":0.216},"max":{"1min":0.84199999999999997,"5min":2.238,"15min":5.2670000000000003},"last":0.55900000000000005}]},{"osd":2,"last update":"Fri Oct 6 11:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.51000000000000001,"15min":0.50700000000000001},"min":{"1min":0.30199999999999999,"5min":0.255,"15min":0.252},"max":{"1min":0.753,"5min":0.93200000000000005,"15min":7.0659999999999998},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.52100000000000002,"15min":0.52300000000000002},"min":{"1min":0.40300000000000002,"5min":0.32200000000000001,"15min":0.26600000000000001},"max":{"1min":0.77600000000000002,"5min":0.78600000000000003,"15min":7.0819999999999999},"last":0.61199999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57799999999999996,"15min":0.52700000000000002},"min":{"1min":0.39400000000000002,"5min":0.32600000000000001,"15min":0.25800000000000001},"max":{"1min":0.91300000000000003,"5min":3.871,"15min":3.871},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.55200000000000005,"15min":0.53700000000000003},"min":{"1min":0.47199999999999998,"5min":0.32100000000000001,"15min":0.312},"max":{"1min":0.80700000000000005,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.71599999999999997}]},{"osd":4,"last update":"Fri Oct 6 11:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.48399999999999999,"15min":0.47699999999999998},"min":{"1min":0.35899999999999999,"5min":0.26800000000000002,"15min":0.24299999999999999},"max":{"1min":0.72999999999999998,"5min":0.76000000000000001,"15min":0.88},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54200000000000004,"15min":0.53200000000000003},"min":{"1min":0.38600000000000001,"5min":0.29699999999999999,"15min":0.27900000000000003},"max":{"1min":0.77600000000000002,"5min":0.82399999999999995,"15min":1.0680000000000001},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52700000000000002,"15min":0.51600000000000001},"min":{"1min":0.36599999999999999,"5min":0.32000000000000001,"15min":0.28399999999999997},"max":{"1min":0.69999999999999996,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63400000000000001,"15min":0.58099999999999996},"min":{"1min":0.42499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.88700000000000001,"5min":7.1379999999999999,"15min":7.1379999999999999},"last":0.69199999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59399999999999997,"15min":0.57099999999999995},"min":{"1min":0.38400000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.83899999999999997,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.59999999999999998,"15min":0.58599999999999997},"min":{"1min":0.40999999999999998,"5min":0.36399999999999999,"15min":0.30199999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.75}]}]},{"osd":1,"up_from":13,"seq":55834575011,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":300024,"kb_used_data":2736,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071816,"statfs":{"total":96636764160,"available":96329539584,"internally_reserved":0,"allocated":2801664,"data_stored":1609565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.47799999999999998,"15min":0.377},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.186},"max":{"1min":0.54000000000000004,"5min":13.393000000000001,"15min":13.393000000000001},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.374,"5min":0.47599999999999998,"15min":0.38800000000000001},"min":{"1min":0.247,"5min":0.22700000000000001,"15min":0.19700000000000001},"max":{"1min":0.52100000000000002,"5min":11.462,"15min":11.462},"last":0.34799999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.41999999999999998,"15min":0.36299999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.216},"max":{"1min":0.56000000000000005,"5min":8.0470000000000006,"15min":8.0470000000000006},"last":0.31},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.45900000000000002,"15min":0.41099999999999998},"min":{"1min":0.27100000000000002,"5min":0.215,"15min":0.20999999999999999},"max":{"1min":0.66700000000000004,"5min":4.8630000000000004,"15min":4.8630000000000004},"last":0.38700000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.47599999999999998,"15min":0.42799999999999999},"min":{"1min":0.311,"5min":0.255,"15min":0.252},"max":{"1min":0.63700000000000001,"5min":4.8029999999999999,"15min":4.8029999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.46100000000000002,"15min":0.40200000000000002},"min":{"1min":0.23799999999999999,"5min":0.23400000000000001,"15min":0.217},"max":{"1min":0.61799999999999999,"5min":5.8700000000000001,"15min":5.8700000000000001},"last":0.42699999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56399999999999995,"15min":0.53200000000000003},"min":{"1min":0.42499999999999999,"5min":0.28299999999999997,"15min":0.28199999999999997},"max":{"1min":0.83099999999999996,"5min":1.264,"15min":1.264},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.64200000000000002,"15min":0.57999999999999996},"min":{"1min":0.46700000000000003,"5min":0.317,"15min":0.317},"max":{"1min":0.85299999999999998,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.52500000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.624,"15min":0.57599999999999996},"min":{"1min":0.432,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.79900000000000004,"5min":3.4390000000000001,"15min":3.4390000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.70799999999999996,"15min":0.60199999999999998},"min":{"1min":0.47599999999999998,"5min":0.36799999999999999,"15min":0.29499999999999998},"max":{"1min":0.92000000000000004,"5min":9.3829999999999991,"15min":9.3829999999999991},"last":0.502}]},{"osd":6,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.66500000000000004,"15min":0.60199999999999998},"min":{"1min":0.47799999999999998,"5min":0.35999999999999999,"15min":0.315},"max":{"1min":0.90800000000000003,"5min":3.4750000000000001,"15min":3.4750000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.66400000000000003,"15min":0.60999999999999999},"min":{"1min":0.45400000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.89700000000000002,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.53800000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68200000000000005,"15min":0.621},"min":{"1min":0.44400000000000001,"5min":0.39800000000000002,"15min":0.38500000000000001},"max":{"1min":0.90300000000000002,"5min":4.7290000000000001,"15min":4.7290000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.64300000000000002,"15min":0.60199999999999998},"min":{"1min":0.47399999999999998,"5min":0.38900000000000001,"15min":0.374},"max":{"1min":0.871,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.57599999999999996}]}]},{"osd":0,"up_from":13,"seq":55834575010,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303524,"kb_used_data":2140,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068316,"statfs":{"total":96636764160,"available":96325955584,"internally_reserved":0,"allocated":2191360,"data_stored":1011228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.34599999999999997,"15min":0.47299999999999998},"min":{"1min":0.23999999999999999,"5min":0.20399999999999999,"15min":0.184},"max":{"1min":0.55500000000000005,"5min":0.60199999999999998,"15min":36.097999999999999},"last":0.308},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.36499999999999999,"15min":0.38600000000000001},"min":{"1min":0.26400000000000001,"5min":0.22,"15min":0.182},"max":{"1min":0.51400000000000001,"5min":0.92400000000000004,"15min":7.2990000000000004},"last":0.38900000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.36599999999999999,"15min":0.50600000000000001},"min":{"1min":0.315,"5min":0.223,"15min":0.217},"max":{"1min":0.56100000000000005,"5min":0.61699999999999999,"15min":36.07},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.39400000000000002,"15min":0.41299999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.219},"max":{"1min":0.60799999999999998,"5min":0.94899999999999995,"15min":6.7800000000000002},"last":0.33800000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.36299999999999999,"15min":0.39600000000000002},"min":{"1min":0.28100000000000003,"5min":0.255,"15min":0.223},"max":{"1min":0.504,"5min":0.55000000000000004,"15min":8.4130000000000003},"last":0.373},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.42799999999999999,"15min":0.56000000000000005},"min":{"1min":0.28599999999999998,"5min":0.25800000000000001,"15min":0.249},"max":{"1min":0.59099999999999997,"5min":1.9079999999999999,"15min":35.959000000000003},"last":0.40400000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.59199999999999997,"15min":0.57299999999999995},"min":{"1min":0.496,"5min":0.33800000000000002,"15min":0.29599999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":2.427},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.60799999999999998,"15min":0.73399999999999999},"min":{"1min":0.496,"5min":0.374,"15min":0.29299999999999998},"max":{"1min":0.91100000000000003,"5min":0.94999999999999996,"15min":36.005000000000003},"last":0.75}]},{"osd":5,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.39400000000000002,"5min":0.38400000000000001,"15min":0.32900000000000001},"max":{"1min":0.86199999999999999,"5min":0.999,"15min":6.6699999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57699999999999996,"15min":0.56299999999999994},"min":{"1min":0.41399999999999998,"5min":0.372,"15min":0.315},"max":{"1min":0.77200000000000002,"5min":0.99399999999999999,"15min":2.0600000000000001},"last":0.57099999999999995}]},{"osd":6,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.61299999999999999,"15min":0.73499999999999999},"min":{"1min":0.45800000000000002,"5min":0.39200000000000002,"15min":0.317},"max":{"1min":0.878,"5min":0.98699999999999999,"15min":36.037999999999997},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.63100000000000001,"15min":0.64400000000000002},"min":{"1min":0.45800000000000002,"5min":0.40999999999999998,"15min":0.36399999999999999},"max":{"1min":0.88800000000000001,"5min":1.028,"15min":6.7110000000000003},"last":0.69899999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.47399999999999998,"5min":0.432,"15min":0.371},"max":{"1min":0.80400000000000005,"5min":1.054,"15min":6.742},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.58799999999999997,"15min":0.57799999999999996},"min":{"1min":0.46200000000000002,"5min":0.41399999999999998,"15min":0.34499999999999997},"max":{"1min":0.89300000000000002,"5min":0.96199999999999997,"15min":1.917},"last":0.78600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575011,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299428,"kb_used_data":2140,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072412,"statfs":{"total":96636764160,"available":96330149888,"internally_reserved":0,"allocated":2191360,"data_stored":1011228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.47499999999999998,"15min":0.36599999999999999},"min":{"1min":0.24399999999999999,"5min":0.214,"15min":0.17999999999999999},"max":{"1min":0.622,"5min":15.228,"15min":15.228},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.40699999999999997,"15min":0.39200000000000002},"min":{"1min":0.32000000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.72599999999999998,"5min":1.714,"15min":1.714},"last":0.36599999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.379,"15min":0.376},"min":{"1min":0.253,"5min":0.23599999999999999,"15min":0.19900000000000001},"max":{"1min":0.56999999999999995,"5min":0.57499999999999996,"15min":0.745},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.36599999999999999,"15min":0.35699999999999998},"min":{"1min":0.26000000000000001,"5min":0.23200000000000001,"15min":0.216},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.33600000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.36699999999999999,"15min":0.36899999999999999},"min":{"1min":0.27000000000000002,"5min":0.23699999999999999,"15min":0.23200000000000001},"max":{"1min":0.60899999999999999,"5min":0.621,"15min":0.629},"last":0.317},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.38800000000000001,"15min":0.371},"min":{"1min":0.29499999999999998,"5min":0.254,"15min":0.251},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.38300000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54500000000000004,"15min":0.53400000000000003},"min":{"1min":0.439,"5min":0.30599999999999999,"15min":0.30299999999999999},"max":{"1min":0.69699999999999995,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.68799999999999994,"15min":0.59399999999999997},"min":{"1min":0.374,"5min":0.28199999999999997,"15min":0.27900000000000003},"max":{"1min":0.70999999999999996,"5min":15.26,"15min":15.26},"last":0.69699999999999995}]},{"osd":5,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.69799999999999995,"15min":0.59599999999999997},"min":{"1min":0.39700000000000002,"5min":0.35799999999999998,"15min":0.32400000000000001},"max":{"1min":0.73699999999999999,"5min":15.186,"15min":15.186},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56799999999999995,"15min":0.56100000000000005},"min":{"1min":0.42999999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72199999999999998,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.58099999999999996}]},{"osd":6,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59299999999999997,"15min":0.58599999999999997},"min":{"1min":0.48299999999999998,"5min":0.38200000000000001,"15min":0.32600000000000001},"max":{"1min":0.76900000000000002,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59599999999999997,"15min":0.57999999999999996},"min":{"1min":0.438,"5min":0.40699999999999997,"15min":0.34200000000000003},"max":{"1min":0.80500000000000005,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.68300000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.67300000000000004,"15min":0.59999999999999998},"min":{"1min":0.41699999999999998,"5min":0.37,"15min":0.34499999999999997},"max":{"1min":0.69399999999999995,"5min":10.977,"15min":10.977},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57799999999999996,"15min":0.57399999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.38200000000000001},"max":{"1min":0.79400000000000004,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.73999999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575011,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311716,"kb_used_data":2140,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060124,"statfs":{"total":96636764160,"available":96317566976,"internally_reserved":0,"allocated":2191360,"data_stored":1011228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.34799999999999998,"15min":0.32800000000000001},"min":{"1min":0.20799999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.55200000000000005,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.41999999999999998,"15min":0.39100000000000001},"min":{"1min":0.26800000000000002,"5min":0.23000000000000001,"15min":0.22700000000000001},"max":{"1min":0.61099999999999999,"5min":4.4820000000000002,"15min":4.4820000000000002},"last":0.33300000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.32100000000000001,"15min":0.315},"min":{"1min":0.22800000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.48199999999999998,"5min":0.54000000000000004,"15min":0.65400000000000003},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.36499999999999999,"15min":0.35799999999999998},"min":{"1min":0.28899999999999998,"5min":0.254,"15min":0.188},"max":{"1min":0.52300000000000002,"5min":0.53600000000000003,"15min":1.196},"last":0.251}]},{"osd":2,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.39900000000000002,"15min":0.38200000000000001},"min":{"1min":0.25,"5min":0.245,"15min":0.19600000000000001},"max":{"1min":0.52100000000000002,"5min":4.601,"15min":4.601},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.44400000000000001,"15min":0.41999999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.26100000000000001},"max":{"1min":0.60599999999999998,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.34499999999999997}]},{"osd":4,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55300000000000005,"15min":0.54700000000000004},"min":{"1min":0.38800000000000001,"5min":0.32100000000000001,"15min":0.311},"max":{"1min":0.76500000000000001,"5min":0.88500000000000001,"15min":1.694},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55500000000000005,"15min":0.54200000000000004},"min":{"1min":0.438,"5min":0.32600000000000001,"15min":0.30199999999999999},"max":{"1min":0.71699999999999997,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.52800000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.55800000000000005,"15min":0.54100000000000004},"min":{"1min":0.42199999999999999,"5min":0.34100000000000003,"15min":0.29399999999999998},"max":{"1min":0.83999999999999997,"5min":0.86399999999999999,"15min":0.878},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.56200000000000006,"15min":0.55600000000000005},"min":{"1min":0.40899999999999997,"5min":0.35699999999999998,"15min":0.29699999999999999},"max":{"1min":0.877,"5min":0.877,"15min":1.165},"last":0.59599999999999997}]},{"osd":6,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.59499999999999997,"15min":0.58099999999999996},"min":{"1min":0.501,"5min":0.372,"15min":0.36699999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":1.1359999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.58999999999999997,"15min":0.58699999999999997},"min":{"1min":0.45500000000000002,"5min":0.36799999999999999,"15min":0.34399999999999997},"max":{"1min":0.80600000000000005,"5min":0.82999999999999996,"15min":1.7470000000000001},"last":0.63}]},{"osd":7,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.57499999999999996,"15min":0.57599999999999996},"min":{"1min":0.41599999999999998,"5min":0.38900000000000001,"15min":0.35599999999999998},"max":{"1min":0.79300000000000004,"5min":0.89900000000000002,"15min":1.657},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.58699999999999997,"15min":0.57599999999999996},"min":{"1min":0.46300000000000002,"5min":0.38,"15min":0.35499999999999998},"max":{"1min":0.86199999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.54500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575010,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307636,"kb_used_data":2156,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064204,"statfs":{"total":96636764160,"available":96321744896,"internally_reserved":0,"allocated":2207744,"data_stored":1019197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.47899999999999998,"15min":0.50700000000000001},"min":{"1min":0.24199999999999999,"5min":0.216,"15min":0.19500000000000001},"max":{"1min":0.68700000000000006,"5min":0.82099999999999995,"15min":2.6619999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.499,"15min":0.49399999999999999},"min":{"1min":0.28899999999999998,"5min":0.224,"15min":0.215},"max":{"1min":0.76200000000000001,"5min":0.81499999999999995,"15min":0.91200000000000003},"last":0.40100000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.50700000000000001,"15min":0.53000000000000003},"min":{"1min":0.308,"5min":0.27300000000000002,"15min":0.23300000000000001},"max":{"1min":0.77300000000000002,"5min":1,"15min":2.8650000000000002},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.505,"15min":0.53500000000000003},"min":{"1min":0.35299999999999998,"5min":0.27000000000000002,"15min":0.25800000000000001},"max":{"1min":0.79800000000000004,"5min":1.2869999999999999,"15min":2.7610000000000001},"last":0.49299999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.52900000000000003,"15min":0.53000000000000003},"min":{"1min":0.44500000000000001,"5min":0.28499999999999998,"15min":0.23100000000000001},"max":{"1min":0.70399999999999996,"5min":0.77400000000000002,"15min":1.6910000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56699999999999995,"15min":0.57699999999999996},"min":{"1min":0.44800000000000001,"5min":0.33100000000000002,"15min":0.30599999999999999},"max":{"1min":0.82099999999999995,"5min":0.82799999999999996,"15min":1.718},"last":0.60599999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.57399999999999995,"15min":0.57799999999999996},"min":{"1min":0.38800000000000001,"5min":0.32000000000000001,"15min":0.26700000000000002},"max":{"1min":0.67500000000000004,"5min":2.387,"15min":2.677},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.54600000000000004,"15min":0.52800000000000002},"min":{"1min":0.40100000000000002,"5min":0.29299999999999998,"15min":0.27500000000000002},"max":{"1min":0.77700000000000002,"5min":1.784,"15min":1.784},"last":0.54300000000000004}]},{"osd":5,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47799999999999998,"15min":0.47999999999999998},"min":{"1min":0.36499999999999999,"5min":0.28499999999999998,"15min":0.23200000000000001},"max":{"1min":0.60299999999999998,"5min":0.73199999999999998,"15min":0.80200000000000005},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.51700000000000002,"15min":0.52300000000000002},"min":{"1min":0.317,"5min":0.28899999999999998,"15min":0.28399999999999997},"max":{"1min":0.752,"5min":0.752,"15min":0.82799999999999996},"last":0.64400000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.252},"max":{"1min":0.79500000000000004,"5min":0.83499999999999996,"15min":0.89000000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54500000000000004,"15min":0.55400000000000005},"min":{"1min":0.38700000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.72899999999999998,"5min":0.80200000000000005,"15min":1.165},"last":0.69599999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55300000000000005,"15min":0.55700000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.71199999999999997,"5min":0.84999999999999998,"15min":0.90500000000000003},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58499999999999996,"15min":0.58899999999999997},"min":{"1min":0.34399999999999997,"5min":0.318,"15min":0.317},"max":{"1min":0.81299999999999994,"5min":0.875,"15min":0.95499999999999996},"last":0.70799999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575012,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315816,"kb_used_data":2144,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94056024,"statfs":{"total":96636764160,"available":96313368576,"internally_reserved":0,"allocated":2195456,"data_stored":1012581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.48199999999999998,"15min":0.55900000000000005},"min":{"1min":0.32800000000000001,"5min":0.23300000000000001,"15min":0.20499999999999999},"max":{"1min":0.752,"5min":0.752,"15min":5.0490000000000004},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.47799999999999998,"15min":0.54100000000000004},"min":{"1min":0.34699999999999998,"5min":0.253,"15min":0.22900000000000001},"max":{"1min":0.626,"5min":0.71299999999999997,"15min":5.1449999999999996},"last":0.48199999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.48099999999999998,"15min":0.48499999999999999},"min":{"1min":0.34699999999999998,"5min":0.25700000000000001,"15min":0.25},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.97199999999999998},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.502,"15min":0.51000000000000001},"min":{"1min":0.373,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.73599999999999999,"5min":0.74099999999999999,"15min":1.8799999999999999},"last":0.65700000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.52600000000000002,"15min":0.54700000000000004},"min":{"1min":0.42999999999999999,"5min":0.30099999999999999,"15min":0.28299999999999997},"max":{"1min":0.73399999999999999,"5min":0.76600000000000001,"15min":4.234},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.55800000000000005,"15min":0.56100000000000005},"min":{"1min":0.41699999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.78700000000000003,"5min":0.79200000000000004,"15min":1.0369999999999999},"last":0.69299999999999995}]},{"osd":3,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.497,"15min":0.57499999999999996},"min":{"1min":0.39700000000000002,"5min":0.29499999999999998,"15min":0.27700000000000002},"max":{"1min":0.67400000000000004,"5min":0.72799999999999998,"15min":5.2169999999999996},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.52600000000000002,"15min":0.53800000000000003},"min":{"1min":0.42599999999999999,"5min":0.29999999999999999,"15min":0.29699999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":1.008},"last":0.63300000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.47999999999999998,"15min":0.5},"min":{"1min":0.36399999999999999,"5min":0.25600000000000001,"15min":0.23999999999999999},"max":{"1min":0.61699999999999999,"5min":0.83399999999999996,"15min":1.917},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.495,"15min":0.51100000000000001},"min":{"1min":0.38200000000000001,"5min":0.251,"15min":0.23899999999999999},"max":{"1min":0.64900000000000002,"5min":0.69199999999999995,"15min":0.87},"last":0.57099999999999995}]},{"osd":6,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51000000000000001,"15min":0.53700000000000003},"min":{"1min":0.41099999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63700000000000001,"5min":0.76800000000000002,"15min":2.0139999999999998},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57399999999999995,"15min":0.59099999999999997},"min":{"1min":0.46200000000000002,"5min":0.30299999999999999,"15min":0.29999999999999999},"max":{"1min":0.68600000000000005,"5min":0.80800000000000005,"15min":1.9470000000000001},"last":0.73899999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53300000000000003,"15min":0.55900000000000005},"min":{"1min":0.42099999999999999,"5min":0.28799999999999998,"15min":0.27700000000000002},"max":{"1min":0.628,"5min":0.81000000000000005,"15min":0.96499999999999997},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57199999999999995,"15min":0.59099999999999997},"min":{"1min":0.46800000000000003,"5min":0.29199999999999998,"15min":0.28799999999999998},"max":{"1min":0.69199999999999995,"5min":0.77300000000000002,"15min":1.4119999999999999},"last":0.755}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:18:56.946 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:18:57.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.090+0000 7feb58ab8700 1 Processor -- start 2023-10-06T11:18:57.092 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.090+0000 7feb58ab8700 1 -- start start 2023-10-06T11:18:57.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.091+0000 7feb58ab8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7feb541538c0 0x7feb54153c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:57.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.091+0000 7feb58ab8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb5415a940 0x7feb5415dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:57.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.091+0000 7feb58ab8700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7feb540cac80 0x7feb540ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:57.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.091+0000 7feb58ab8700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb5415d270 con 0x7feb541538c0 2023-10-06T11:18:57.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.091+0000 7feb58ab8700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb5415d830 con 0x7feb540cac80 2023-10-06T11:18:57.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.091+0000 7feb58ab8700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb540cb810 con 0x7feb5415a940 2023-10-06T11:18:57.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.091+0000 7feb5259c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7feb541538c0 0x7feb54153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:57.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.091+0000 7feb5259c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7feb541538c0 0x7feb54153c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58668/0 (socket says 172.21.15.146:58668) 2023-10-06T11:18:57.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.091+0000 7feb5259c700 1 -- 172.21.15.146:0/3787169947 learned_addr learned my addr 172.21.15.146:0/3787169947 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:57.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.091+0000 7feb5259c700 1 -- 172.21.15.146:0/3787169947 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb5415a940 msgr2=0x7feb5415dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:57.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.091+0000 7feb52d9d700 1 --2- 172.21.15.146:0/3787169947 >> v2:172.21.15.151:3300/0 conn(0x7feb540cac80 0x7feb540ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:57.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.091+0000 7feb49d9b700 1 --2- 172.21.15.146:0/3787169947 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb5415a940 0x7feb5415dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:57.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.091+0000 7feb5259c700 1 --2- 172.21.15.146:0/3787169947 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb5415a940 0x7feb5415dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:57.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.091+0000 7feb5259c700 1 -- 172.21.15.146:0/3787169947 >> v2:172.21.15.151:3300/0 conn(0x7feb540cac80 msgr2=0x7feb540ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:57.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.091+0000 7feb5259c700 1 --2- 172.21.15.146:0/3787169947 >> v2:172.21.15.151:3300/0 conn(0x7feb540cac80 0x7feb540ce610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:57.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.091+0000 7feb5259c700 1 -- 172.21.15.146:0/3787169947 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb540cbaf0 con 0x7feb541538c0 2023-10-06T11:18:57.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.091+0000 7feb52d9d700 1 --2- 172.21.15.146:0/3787169947 >> v2:172.21.15.151:3300/0 conn(0x7feb540cac80 0x7feb540ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:18:57.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.091+0000 7feb49d9b700 1 --2- 172.21.15.146:0/3787169947 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb5415a940 0x7feb5415dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:18:57.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.092+0000 7feb5259c700 1 --2- 172.21.15.146:0/3787169947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb541538c0 0x7feb54153c90 secure :-1 s=READY pgs=2247 cs=0 l=1 rev1=1 crypto rx=0x7feb540cac10 tx=0x7feb44009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1efe6ed3286cb37 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:57.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.092+0000 7feb51d9b700 1 -- 172.21.15.146:0/3787169947 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4400b860 con 0x7feb541538c0 2023-10-06T11:18:57.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.092+0000 7feb51d9b700 1 -- 172.21.15.146:0/3787169947 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb4400b9c0 con 0x7feb541538c0 2023-10-06T11:18:57.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.092+0000 7feb51d9b700 1 -- 172.21.15.146:0/3787169947 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4400bd60 con 0x7feb541538c0 2023-10-06T11:18:57.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.092+0000 7feb58ab8700 1 -- 172.21.15.146:0/3787169947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb541538c0 msgr2=0x7feb54153c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:57.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.092+0000 7feb58ab8700 1 --2- 172.21.15.146:0/3787169947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb541538c0 0x7feb54153c90 secure :-1 s=READY pgs=2247 cs=0 l=1 rev1=1 crypto rx=0x7feb540cac10 tx=0x7feb44009250 comp rx=0 tx=0).stop 2023-10-06T11:18:57.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.092+0000 7feb58ab8700 1 -- 172.21.15.146:0/3787169947 shutdown_connections 2023-10-06T11:18:57.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.092+0000 7feb58ab8700 1 --2- 172.21.15.146:0/3787169947 >> v2:172.21.15.151:3300/0 conn(0x7feb540cac80 0x7feb540ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:57.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.092+0000 7feb58ab8700 1 --2- 172.21.15.146:0/3787169947 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb541538c0 0x7feb54153c90 unknown :-1 s=CLOSED pgs=2247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:57.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.092+0000 7feb58ab8700 1 --2- 172.21.15.146:0/3787169947 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb5415a940 0x7feb5415dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:57.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.092+0000 7feb58ab8700 1 -- 172.21.15.146:0/3787169947 >> 172.21.15.146:0/3787169947 conn(0x7feb5406eb10 msgr2=0x7feb5406ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:57.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.092+0000 7feb58ab8700 1 -- 172.21.15.146:0/3787169947 shutdown_connections 2023-10-06T11:18:57.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.092+0000 7feb58ab8700 1 -- 172.21.15.146:0/3787169947 wait complete. 2023-10-06T11:18:57.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.093+0000 7feb58ab8700 1 Processor -- start 2023-10-06T11:18:57.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.094+0000 7feb58ab8700 1 -- start start 2023-10-06T11:18:57.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.094+0000 7feb58ab8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb540cac80 0x7feb54158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:57.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.094+0000 7feb58ab8700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb541538c0 0x7feb5416ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:57.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.094+0000 7feb58ab8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb5415a940 0x7feb540b33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:57.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.094+0000 7feb58ab8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb540c76f0 con 0x7feb540cac80 2023-10-06T11:18:57.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.094+0000 7feb58ab8700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb540b22a0 con 0x7feb541538c0 2023-10-06T11:18:57.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.094+0000 7feb58ab8700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb5416d8c0 con 0x7feb5415a940 2023-10-06T11:18:57.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.094+0000 7feb5259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb540cac80 0x7feb54158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:57.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.094+0000 7feb5259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb540cac80 0x7feb54158950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58670/0 (socket says 172.21.15.146:58670) 2023-10-06T11:18:57.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.094+0000 7feb5259c700 1 -- 172.21.15.146:0/1500282260 learned_addr learned my addr 172.21.15.146:0/1500282260 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:57.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.094+0000 7feb52d9d700 1 --2- 172.21.15.146:0/1500282260 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb5415a940 0x7feb540b33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:57.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.094+0000 7feb5259c700 1 -- 172.21.15.146:0/1500282260 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb5415a940 msgr2=0x7feb540b33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:57.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.094+0000 7feb5259c700 1 --2- 172.21.15.146:0/1500282260 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb5415a940 0x7feb540b33e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:57.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.095+0000 7feb5259c700 1 -- 172.21.15.146:0/1500282260 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb541538c0 msgr2=0x7feb5416ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:57.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.095+0000 7feb5259c700 1 --2- 172.21.15.146:0/1500282260 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb541538c0 0x7feb5416ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:57.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.095+0000 7feb5259c700 1 -- 172.21.15.146:0/1500282260 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb440094f0 con 0x7feb540cac80 2023-10-06T11:18:57.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.095+0000 7feb5259c700 1 --2- 172.21.15.146:0/1500282260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb540cac80 0x7feb54158950 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 crypto rx=0x7feb540c7450 tx=0x7feb44017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:57.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.095+0000 7feb4affd700 1 -- 172.21.15.146:0/1500282260 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb44024440 con 0x7feb540cac80 2023-10-06T11:18:57.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.095+0000 7feb4affd700 1 -- 172.21.15.146:0/1500282260 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb440245a0 con 0x7feb540cac80 2023-10-06T11:18:57.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.095+0000 7feb58ab8700 1 -- 172.21.15.146:0/1500282260 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb5416dba0 con 0x7feb540cac80 2023-10-06T11:18:57.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.095+0000 7feb4affd700 1 -- 172.21.15.146:0/1500282260 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb44024960 con 0x7feb540cac80 2023-10-06T11:18:57.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.095+0000 7feb58ab8700 1 -- 172.21.15.146:0/1500282260 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb540c7c70 con 0x7feb540cac80 2023-10-06T11:18:57.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.096+0000 7feb58ab8700 1 -- 172.21.15.146:0/1500282260 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb5404c380 con 0x7feb540cac80 2023-10-06T11:18:57.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.096+0000 7feb4affd700 1 -- 172.21.15.146:0/1500282260 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feb4401a420 con 0x7feb540cac80 2023-10-06T11:18:57.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.097+0000 7feb4affd700 1 --2- 172.21.15.146:0/1500282260 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feb34066f30 0x7feb340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:57.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.097+0000 7feb4affd700 1 -- 172.21.15.146:0/1500282260 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6058+0+0 (secure 0 0 0) 0x7feb440865a0 con 0x7feb540cac80 2023-10-06T11:18:57.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.097+0000 7feb49d9b700 1 --2- 172.21.15.146:0/1500282260 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feb34066f30 0x7feb340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:57.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.097+0000 7feb49d9b700 1 --2- 172.21.15.146:0/1500282260 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feb34066f30 0x7feb340693e0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7feb3c006fd0 tx=0x7feb3c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:57.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.101+0000 7feb4affd700 1 -- 172.21.15.146:0/1500282260 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feb440536b0 con 0x7feb540cac80 2023-10-06T11:18:57.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.280+0000 7feb58ab8700 1 -- 172.21.15.146:0/1500282260 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feb5415d4c0 con 0x7feb34066f30 2023-10-06T11:18:57.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.288+0000 7feb4affd700 1 -- 172.21.15.146:0/1500282260 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+303924 (secure 0 0 0) 0x7feb5415d4c0 con 0x7feb34066f30 2023-10-06T11:18:57.293 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:18:57.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.291+0000 7feb58ab8700 1 -- 172.21.15.146:0/1500282260 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feb34066f30 msgr2=0x7feb340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:57.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.291+0000 7feb58ab8700 1 --2- 172.21.15.146:0/1500282260 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feb34066f30 0x7feb340693e0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7feb3c006fd0 tx=0x7feb3c008040 comp rx=0 tx=0).stop 2023-10-06T11:18:57.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.291+0000 7feb58ab8700 1 -- 172.21.15.146:0/1500282260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb540cac80 msgr2=0x7feb54158950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:57.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.291+0000 7feb58ab8700 1 --2- 172.21.15.146:0/1500282260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb540cac80 0x7feb54158950 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 crypto rx=0x7feb540c7450 tx=0x7feb44017000 comp rx=0 tx=0).stop 2023-10-06T11:18:57.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.292+0000 7feb58ab8700 1 -- 172.21.15.146:0/1500282260 shutdown_connections 2023-10-06T11:18:57.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.292+0000 7feb58ab8700 1 --2- 172.21.15.146:0/1500282260 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7feb34066f30 0x7feb340693e0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:57.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.292+0000 7feb58ab8700 1 --2- 172.21.15.146:0/1500282260 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb5415a940 0x7feb540b33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:57.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.292+0000 7feb58ab8700 1 --2- 172.21.15.146:0/1500282260 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7feb540cac80 0x7feb54158950 unknown :-1 s=CLOSED pgs=2248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:57.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.292+0000 7feb58ab8700 1 --2- 172.21.15.146:0/1500282260 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb541538c0 0x7feb5416ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:57.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.292+0000 7feb58ab8700 1 -- 172.21.15.146:0/1500282260 >> 172.21.15.146:0/1500282260 conn(0x7feb5406eb10 msgr2=0x7feb540cd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:57.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.292+0000 7feb58ab8700 1 -- 172.21.15.146:0/1500282260 shutdown_connections 2023-10-06T11:18:57.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.292+0000 7feb58ab8700 1 -- 172.21.15.146:0/1500282260 wait complete. 2023-10-06T11:18:57.297 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:18:57.305 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":569,"stamp":"2023-10-06T11:18:55.312215+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":134,"acting":134,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":24,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2441692,"kb_used_data":18332,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752533028,"statfs":{"total":773094113280,"available":770593820672,"internally_reserved":0,"allocated":18771968,"data_stored":9295820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.821153"},"pg_stats":[{"pgid":"28.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.513257+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:22.963604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.513115+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:48:06.231609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.511166+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:45:18.723193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.510745+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:06:33.866195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.511723+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:09:34.925925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.503126+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:30.662720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.508679+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:49:38.496675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.510774+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:43:55.311129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.511555+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:13.769278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.516145+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:11:36.554686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.511245+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:19:53.986592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.510274+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:58.152151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.503627+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:47:32.386139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.502870+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:40:38.219266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.495654+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:09:58.364738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.508575+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:19:32.976623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.497308+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:59:35.711896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.492630+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:02:22.454621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.497405+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:47:31.381968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.496441+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:30:12.235357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.507984+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:32:33.004446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-06T11:18:51.520772+0000","last_change":"2023-10-06T11:18:51.520772+0000","last_active":"2023-10-06T11:18:51.520772+0000","last_peered":"2023-10-06T11:18:51.520772+0000","last_clean":"2023-10-06T11:18:51.520772+0000","last_became_active":"2023-10-06T11:18:51.520462+0000","last_became_peered":"2023-10-06T11:18:51.520462+0000","last_unstale":"2023-10-06T11:18:51.520772+0000","last_undegraded":"2023-10-06T11:18:51.520772+0000","last_fullsized":"2023-10-06T11:18:51.520772+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:47:19.326917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.493251+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:08.422937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.496006+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:08:23.261106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.512690+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:20:06.857224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.493492+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:34:37.175282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.492889+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:37:54.962748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.495516+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:01:31.340000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.515476+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:50:45.910135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.496336+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:43:06.689323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.495790+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:54:49.162033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.496381+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:18:13.347927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-06T11:18:51.518577+0000","last_change":"2023-10-06T11:18:51.518577+0000","last_active":"2023-10-06T11:18:51.518577+0000","last_peered":"2023-10-06T11:18:51.518577+0000","last_clean":"2023-10-06T11:18:51.518577+0000","last_became_active":"2023-10-06T11:18:51.518267+0000","last_became_peered":"2023-10-06T11:18:51.518267+0000","last_unstale":"2023-10-06T11:18:51.518577+0000","last_undegraded":"2023-10-06T11:18:51.518577+0000","last_fullsized":"2023-10-06T11:18:51.518577+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:12:04.967138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.511802+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:00:15.358532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.492823+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:42:10.142087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.512226+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:14.739928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.492973+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:34:22.931418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.507932+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:56:53.432751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-06T11:18:51.515072+0000","last_change":"2023-10-06T11:18:51.515072+0000","last_active":"2023-10-06T11:18:51.515072+0000","last_peered":"2023-10-06T11:18:51.515072+0000","last_clean":"2023-10-06T11:18:51.515072+0000","last_became_active":"2023-10-06T11:18:51.514821+0000","last_became_peered":"2023-10-06T11:18:51.514821+0000","last_unstale":"2023-10-06T11:18:51.515072+0000","last_undegraded":"2023-10-06T11:18:51.515072+0000","last_fullsized":"2023-10-06T11:18:51.515072+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:36:18.839256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-06T11:18:51.519403+0000","last_change":"2023-10-06T11:18:51.519403+0000","last_active":"2023-10-06T11:18:51.519403+0000","last_peered":"2023-10-06T11:18:51.519403+0000","last_clean":"2023-10-06T11:18:51.519403+0000","last_became_active":"2023-10-06T11:18:51.519130+0000","last_became_peered":"2023-10-06T11:18:51.519130+0000","last_unstale":"2023-10-06T11:18:51.519403+0000","last_undegraded":"2023-10-06T11:18:51.519403+0000","last_fullsized":"2023-10-06T11:18:51.519403+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:18:11.844126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.494141+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:40:53.184600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.510476+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:39:40.994783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-06T11:18:51.521725+0000","last_change":"2023-10-06T11:18:51.521725+0000","last_active":"2023-10-06T11:18:51.521725+0000","last_peered":"2023-10-06T11:18:51.521725+0000","last_clean":"2023-10-06T11:18:51.521725+0000","last_became_active":"2023-10-06T11:18:51.521427+0000","last_became_peered":"2023-10-06T11:18:51.521427+0000","last_unstale":"2023-10-06T11:18:51.521725+0000","last_undegraded":"2023-10-06T11:18:51.521725+0000","last_fullsized":"2023-10-06T11:18:51.521725+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:01.079097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.492651+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:51:26.937096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.493704+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:09:05.555255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.509689+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:26:40.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.495516+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:08:02.104055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-06T11:18:51.518899+0000","last_change":"2023-10-06T11:18:51.518899+0000","last_active":"2023-10-06T11:18:51.518899+0000","last_peered":"2023-10-06T11:18:51.518899+0000","last_clean":"2023-10-06T11:18:51.518899+0000","last_became_active":"2023-10-06T11:18:51.517840+0000","last_became_peered":"2023-10-06T11:18:51.517840+0000","last_unstale":"2023-10-06T11:18:51.518899+0000","last_undegraded":"2023-10-06T11:18:51.518899+0000","last_fullsized":"2023-10-06T11:18:51.518899+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:01:35.577133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":154,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-06T11:18:50.494090+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:18:50.494090+0000","last_peered":"2023-10-06T11:18:50.494090+0000","last_clean":"2023-10-06T11:18:50.494090+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:18:50.494090+0000","last_undegraded":"2023-10-06T11:18:50.494090+0000","last_fullsized":"2023-10-06T11:18:50.494090+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.493576+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:09:15.298043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":144,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-06T11:18:47.532793+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:18:47.532793+0000","last_peered":"2023-10-06T11:18:47.532793+0000","last_clean":"2023-10-06T11:18:47.532793+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:18:47.532793+0000","last_undegraded":"2023-10-06T11:18:47.532793+0000","last_fullsized":"2023-10-06T11:18:47.532793+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.504457+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:15.196912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.497159+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:12:04.967138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":142,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-06T11:18:50.499036+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:18:50.499036+0000","last_peered":"2023-10-06T11:18:50.499036+0000","last_clean":"2023-10-06T11:18:50.499036+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:18:50.499036+0000","last_undegraded":"2023-10-06T11:18:50.499036+0000","last_fullsized":"2023-10-06T11:18:50.499036+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":285,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-06T11:18:47.532980+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:18:47.532980+0000","last_peered":"2023-10-06T11:18:47.532980+0000","last_clean":"2023-10-06T11:18:47.532980+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:18:47.532980+0000","last_undegraded":"2023-10-06T11:18:47.532980+0000","last_fullsized":"2023-10-06T11:18:47.532980+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-06T11:18:51.518700+0000","last_change":"2023-10-06T11:18:51.518700+0000","last_active":"2023-10-06T11:18:51.518700+0000","last_peered":"2023-10-06T11:18:51.518700+0000","last_clean":"2023-10-06T11:18:51.518700+0000","last_became_active":"2023-10-06T11:18:51.518426+0000","last_became_peered":"2023-10-06T11:18:51.518426+0000","last_unstale":"2023-10-06T11:18:51.518700+0000","last_undegraded":"2023-10-06T11:18:51.518700+0000","last_fullsized":"2023-10-06T11:18:51.518700+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:50:11.395470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":135,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-06T11:18:47.533108+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:18:47.533108+0000","last_peered":"2023-10-06T11:18:47.533108+0000","last_clean":"2023-10-06T11:18:47.533108+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:18:47.533108+0000","last_undegraded":"2023-10-06T11:18:47.533108+0000","last_fullsized":"2023-10-06T11:18:47.533108+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.493041+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:16:03.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":135,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-06T11:18:47.533069+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:18:47.533069+0000","last_peered":"2023-10-06T11:18:47.533069+0000","last_clean":"2023-10-06T11:18:47.533069+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:18:47.533069+0000","last_undegraded":"2023-10-06T11:18:47.533069+0000","last_fullsized":"2023-10-06T11:18:47.533069+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.502856+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:59.830470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.497225+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:01:35.577133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":161,"reported_epoch":173,"state":"active+clean","last_fresh":"2023-10-06T11:18:47.484034+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:18:47.484034+0000","last_peered":"2023-10-06T11:18:47.484034+0000","last_clean":"2023-10-06T11:18:47.484034+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:18:47.484034+0000","last_undegraded":"2023-10-06T11:18:47.484034+0000","last_fullsized":"2023-10-06T11:18:47.484034+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.490762+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.492571+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:56:20.989429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":143,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-06T11:18:50.496025+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:18:50.496025+0000","last_peered":"2023-10-06T11:18:50.496025+0000","last_clean":"2023-10-06T11:18:50.496025+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:18:50.496025+0000","last_undegraded":"2023-10-06T11:18:50.496025+0000","last_fullsized":"2023-10-06T11:18:50.496025+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.508306+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:54:10.845045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:50.486591+0000","last_change":"2023-10-06T11:18:50.495986+0000","last_active":"2023-10-06T11:18:50.486591+0000","last_peered":"2023-10-06T11:18:50.486591+0000","last_clean":"2023-10-06T11:18:50.486591+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:50.486591+0000","last_undegraded":"2023-10-06T11:18:50.486591+0000","last_fullsized":"2023-10-06T11:18:50.486591+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:20.103244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":143,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-06T11:18:50.496047+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:18:50.496047+0000","last_peered":"2023-10-06T11:18:50.496047+0000","last_clean":"2023-10-06T11:18:50.496047+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:18:50.496047+0000","last_undegraded":"2023-10-06T11:18:50.496047+0000","last_fullsized":"2023-10-06T11:18:50.496047+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":28,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":52,"acting":52,"num_store_stats":3},{"poolid":27,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575010,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304108,"kb_used_data":2724,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067732,"statfs":{"total":96636764160,"available":96325357568,"internally_reserved":0,"allocated":2789376,"data_stored":1602949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54400000000000004,"15min":0.629},"min":{"1min":0.35899999999999999,"5min":0.252,"15min":0.21199999999999999},"max":{"1min":0.70999999999999996,"5min":4.407,"15min":23.908999999999999},"last":0.434},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.52500000000000002,"15min":0.57799999999999996},"min":{"1min":0.38200000000000001,"5min":0.26900000000000002,"15min":0.22500000000000001},"max":{"1min":0.71699999999999997,"5min":0.76800000000000002,"15min":9.3230000000000004},"last":0.56599999999999995}]},{"osd":1,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54500000000000004,"15min":0.55900000000000005},"min":{"1min":0.439,"5min":0.28399999999999997,"15min":0.26000000000000001},"max":{"1min":0.72699999999999998,"5min":2.4689999999999999,"15min":9.2360000000000007},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.5,"15min":0.505},"min":{"1min":0.373,"5min":0.33100000000000002,"15min":0.25900000000000001},"max":{"1min":0.63900000000000001,"5min":0.70899999999999996,"15min":4.327},"last":0.41999999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56499999999999995,"15min":0.52100000000000002},"min":{"1min":0.379,"5min":0.34399999999999997,"15min":0.26500000000000001},"max":{"1min":0.67000000000000004,"5min":4.3120000000000003,"15min":4.3120000000000003},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56299999999999994,"15min":0.55800000000000005},"min":{"1min":0.46300000000000002,"5min":0.311,"15min":0.29999999999999999},"max":{"1min":0.65400000000000003,"5min":3.0600000000000001,"15min":4.7309999999999999},"last":0.65200000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56899999999999995,"15min":0.54500000000000004},"min":{"1min":0.45300000000000001,"5min":0.32600000000000001,"15min":0.27900000000000003},"max":{"1min":0.69899999999999995,"5min":4.5190000000000001,"15min":4.5190000000000001},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.44800000000000001,"5min":0.374,"15min":0.29699999999999999},"max":{"1min":0.73199999999999998,"5min":3.0070000000000001,"15min":9.3879999999999999},"last":0.60699999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.52600000000000002,"15min":0.49299999999999999},"min":{"1min":0.32600000000000001,"5min":0.29799999999999999,"15min":0.24399999999999999},"max":{"1min":0.59099999999999997,"5min":4.6639999999999997,"15min":4.6639999999999997},"last":0.376},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.56799999999999995,"15min":0.53500000000000003},"min":{"1min":0.41999999999999998,"5min":0.28499999999999998,"15min":0.27300000000000002},"max":{"1min":0.64700000000000002,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":0.40100000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.53200000000000003,"15min":0.55700000000000005},"min":{"1min":0.33100000000000002,"5min":0.32900000000000001,"15min":0.26000000000000001},"max":{"1min":0.72399999999999998,"5min":0.77000000000000002,"15min":9.3499999999999996},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.52500000000000002,"15min":0.53800000000000003},"min":{"1min":0.371,"5min":0.30099999999999999,"15min":0.26800000000000002},"max":{"1min":0.71399999999999997,"5min":0.89100000000000001,"15min":4.444},"last":0.44600000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.56699999999999995,"15min":0.59299999999999997},"min":{"1min":0.39500000000000002,"5min":0.38100000000000001,"15min":0.29199999999999998},"max":{"1min":0.68600000000000005,"5min":0.82099999999999995,"15min":9.4969999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.63200000000000001,"15min":0.61899999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.74199999999999999,"5min":4.4669999999999996,"15min":7.2039999999999997},"last":0.52200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575012,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299440,"kb_used_data":2152,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072400,"statfs":{"total":96636764160,"available":96330137600,"internally_reserved":0,"allocated":2203648,"data_stored":1017844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.60999999999999999,"15min":0.52700000000000002},"min":{"1min":0.307,"5min":0.247,"15min":0.187},"max":{"1min":0.78300000000000003,"5min":9.5549999999999997,"15min":9.5549999999999997},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.66900000000000004,"15min":0.57299999999999995},"min":{"1min":0.47299999999999998,"5min":0.30399999999999999,"15min":0.254},"max":{"1min":0.81999999999999995,"5min":9.4659999999999993,"15min":9.4659999999999993},"last":0.70399999999999996}]},{"osd":1,"last update":"Fri Oct 6 11:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.497,"15min":0.48699999999999999},"min":{"1min":0.372,"5min":0.27500000000000002,"15min":0.23300000000000001},"max":{"1min":0.71399999999999997,"5min":0.80300000000000005,"15min":0.91700000000000004},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.53200000000000003,"15min":0.52100000000000002},"min":{"1min":0.34599999999999997,"5min":0.32900000000000001,"15min":0.216},"max":{"1min":0.84199999999999997,"5min":2.238,"15min":5.2670000000000003},"last":0.55900000000000005}]},{"osd":2,"last update":"Fri Oct 6 11:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.51000000000000001,"15min":0.50700000000000001},"min":{"1min":0.30199999999999999,"5min":0.255,"15min":0.252},"max":{"1min":0.753,"5min":0.93200000000000005,"15min":7.0659999999999998},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.52100000000000002,"15min":0.52300000000000002},"min":{"1min":0.40300000000000002,"5min":0.32200000000000001,"15min":0.26600000000000001},"max":{"1min":0.77600000000000002,"5min":0.78600000000000003,"15min":7.0819999999999999},"last":0.61199999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57799999999999996,"15min":0.52700000000000002},"min":{"1min":0.39400000000000002,"5min":0.32600000000000001,"15min":0.25800000000000001},"max":{"1min":0.91300000000000003,"5min":3.871,"15min":3.871},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.55200000000000005,"15min":0.53700000000000003},"min":{"1min":0.47199999999999998,"5min":0.32100000000000001,"15min":0.312},"max":{"1min":0.80700000000000005,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.71599999999999997}]},{"osd":4,"last update":"Fri Oct 6 11:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.48399999999999999,"15min":0.47699999999999998},"min":{"1min":0.35899999999999999,"5min":0.26800000000000002,"15min":0.24299999999999999},"max":{"1min":0.72999999999999998,"5min":0.76000000000000001,"15min":0.88},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54200000000000004,"15min":0.53200000000000003},"min":{"1min":0.38600000000000001,"5min":0.29699999999999999,"15min":0.27900000000000003},"max":{"1min":0.77600000000000002,"5min":0.82399999999999995,"15min":1.0680000000000001},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52700000000000002,"15min":0.51600000000000001},"min":{"1min":0.36599999999999999,"5min":0.32000000000000001,"15min":0.28399999999999997},"max":{"1min":0.69999999999999996,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63400000000000001,"15min":0.58099999999999996},"min":{"1min":0.42499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.88700000000000001,"5min":7.1379999999999999,"15min":7.1379999999999999},"last":0.69199999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59399999999999997,"15min":0.57099999999999995},"min":{"1min":0.38400000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.83899999999999997,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.59999999999999998,"15min":0.58599999999999997},"min":{"1min":0.40999999999999998,"5min":0.36399999999999999,"15min":0.30199999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.75}]}]},{"osd":1,"up_from":13,"seq":55834575011,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":300024,"kb_used_data":2736,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071816,"statfs":{"total":96636764160,"available":96329539584,"internally_reserved":0,"allocated":2801664,"data_stored":1609565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.47799999999999998,"15min":0.377},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.186},"max":{"1min":0.54000000000000004,"5min":13.393000000000001,"15min":13.393000000000001},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.374,"5min":0.47599999999999998,"15min":0.38800000000000001},"min":{"1min":0.247,"5min":0.22700000000000001,"15min":0.19700000000000001},"max":{"1min":0.52100000000000002,"5min":11.462,"15min":11.462},"last":0.34799999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.41999999999999998,"15min":0.36299999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.216},"max":{"1min":0.56000000000000005,"5min":8.0470000000000006,"15min":8.0470000000000006},"last":0.31},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.45900000000000002,"15min":0.41099999999999998},"min":{"1min":0.27100000000000002,"5min":0.215,"15min":0.20999999999999999},"max":{"1min":0.66700000000000004,"5min":4.8630000000000004,"15min":4.8630000000000004},"last":0.38700000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.47599999999999998,"15min":0.42799999999999999},"min":{"1min":0.311,"5min":0.255,"15min":0.252},"max":{"1min":0.63700000000000001,"5min":4.8029999999999999,"15min":4.8029999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.46100000000000002,"15min":0.40200000000000002},"min":{"1min":0.23799999999999999,"5min":0.23400000000000001,"15min":0.217},"max":{"1min":0.61799999999999999,"5min":5.8700000000000001,"15min":5.8700000000000001},"last":0.42699999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56399999999999995,"15min":0.53200000000000003},"min":{"1min":0.42499999999999999,"5min":0.28299999999999997,"15min":0.28199999999999997},"max":{"1min":0.83099999999999996,"5min":1.264,"15min":1.264},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.64200000000000002,"15min":0.57999999999999996},"min":{"1min":0.46700000000000003,"5min":0.317,"15min":0.317},"max":{"1min":0.85299999999999998,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.52500000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.624,"15min":0.57599999999999996},"min":{"1min":0.432,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.79900000000000004,"5min":3.4390000000000001,"15min":3.4390000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.70799999999999996,"15min":0.60199999999999998},"min":{"1min":0.47599999999999998,"5min":0.36799999999999999,"15min":0.29499999999999998},"max":{"1min":0.92000000000000004,"5min":9.3829999999999991,"15min":9.3829999999999991},"last":0.502}]},{"osd":6,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.66500000000000004,"15min":0.60199999999999998},"min":{"1min":0.47799999999999998,"5min":0.35999999999999999,"15min":0.315},"max":{"1min":0.90800000000000003,"5min":3.4750000000000001,"15min":3.4750000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.66400000000000003,"15min":0.60999999999999999},"min":{"1min":0.45400000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.89700000000000002,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.53800000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68200000000000005,"15min":0.621},"min":{"1min":0.44400000000000001,"5min":0.39800000000000002,"15min":0.38500000000000001},"max":{"1min":0.90300000000000002,"5min":4.7290000000000001,"15min":4.7290000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.64300000000000002,"15min":0.60199999999999998},"min":{"1min":0.47399999999999998,"5min":0.38900000000000001,"15min":0.374},"max":{"1min":0.871,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.57599999999999996}]}]},{"osd":0,"up_from":13,"seq":55834575010,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303524,"kb_used_data":2140,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068316,"statfs":{"total":96636764160,"available":96325955584,"internally_reserved":0,"allocated":2191360,"data_stored":1011228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.34599999999999997,"15min":0.47299999999999998},"min":{"1min":0.23999999999999999,"5min":0.20399999999999999,"15min":0.184},"max":{"1min":0.55500000000000005,"5min":0.60199999999999998,"15min":36.097999999999999},"last":0.308},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.36499999999999999,"15min":0.38600000000000001},"min":{"1min":0.26400000000000001,"5min":0.22,"15min":0.182},"max":{"1min":0.51400000000000001,"5min":0.92400000000000004,"15min":7.2990000000000004},"last":0.38900000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.36599999999999999,"15min":0.50600000000000001},"min":{"1min":0.315,"5min":0.223,"15min":0.217},"max":{"1min":0.56100000000000005,"5min":0.61699999999999999,"15min":36.07},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.39400000000000002,"15min":0.41299999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.219},"max":{"1min":0.60799999999999998,"5min":0.94899999999999995,"15min":6.7800000000000002},"last":0.33800000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.36299999999999999,"15min":0.39600000000000002},"min":{"1min":0.28100000000000003,"5min":0.255,"15min":0.223},"max":{"1min":0.504,"5min":0.55000000000000004,"15min":8.4130000000000003},"last":0.373},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.42799999999999999,"15min":0.56000000000000005},"min":{"1min":0.28599999999999998,"5min":0.25800000000000001,"15min":0.249},"max":{"1min":0.59099999999999997,"5min":1.9079999999999999,"15min":35.959000000000003},"last":0.40400000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.59199999999999997,"15min":0.57299999999999995},"min":{"1min":0.496,"5min":0.33800000000000002,"15min":0.29599999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":2.427},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.60799999999999998,"15min":0.73399999999999999},"min":{"1min":0.496,"5min":0.374,"15min":0.29299999999999998},"max":{"1min":0.91100000000000003,"5min":0.94999999999999996,"15min":36.005000000000003},"last":0.75}]},{"osd":5,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.39400000000000002,"5min":0.38400000000000001,"15min":0.32900000000000001},"max":{"1min":0.86199999999999999,"5min":0.999,"15min":6.6699999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57699999999999996,"15min":0.56299999999999994},"min":{"1min":0.41399999999999998,"5min":0.372,"15min":0.315},"max":{"1min":0.77200000000000002,"5min":0.99399999999999999,"15min":2.0600000000000001},"last":0.57099999999999995}]},{"osd":6,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.61299999999999999,"15min":0.73499999999999999},"min":{"1min":0.45800000000000002,"5min":0.39200000000000002,"15min":0.317},"max":{"1min":0.878,"5min":0.98699999999999999,"15min":36.037999999999997},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.63100000000000001,"15min":0.64400000000000002},"min":{"1min":0.45800000000000002,"5min":0.40999999999999998,"15min":0.36399999999999999},"max":{"1min":0.88800000000000001,"5min":1.028,"15min":6.7110000000000003},"last":0.69899999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.47399999999999998,"5min":0.432,"15min":0.371},"max":{"1min":0.80400000000000005,"5min":1.054,"15min":6.742},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.58799999999999997,"15min":0.57799999999999996},"min":{"1min":0.46200000000000002,"5min":0.41399999999999998,"15min":0.34499999999999997},"max":{"1min":0.89300000000000002,"5min":0.96199999999999997,"15min":1.917},"last":0.78600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575011,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299428,"kb_used_data":2140,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072412,"statfs":{"total":96636764160,"available":96330149888,"internally_reserved":0,"allocated":2191360,"data_stored":1011228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.47499999999999998,"15min":0.36599999999999999},"min":{"1min":0.24399999999999999,"5min":0.214,"15min":0.17999999999999999},"max":{"1min":0.622,"5min":15.228,"15min":15.228},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.40699999999999997,"15min":0.39200000000000002},"min":{"1min":0.32000000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.72599999999999998,"5min":1.714,"15min":1.714},"last":0.36599999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.379,"15min":0.376},"min":{"1min":0.253,"5min":0.23599999999999999,"15min":0.19900000000000001},"max":{"1min":0.56999999999999995,"5min":0.57499999999999996,"15min":0.745},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.36599999999999999,"15min":0.35699999999999998},"min":{"1min":0.26000000000000001,"5min":0.23200000000000001,"15min":0.216},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.33600000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.36699999999999999,"15min":0.36899999999999999},"min":{"1min":0.27000000000000002,"5min":0.23699999999999999,"15min":0.23200000000000001},"max":{"1min":0.60899999999999999,"5min":0.621,"15min":0.629},"last":0.317},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.38800000000000001,"15min":0.371},"min":{"1min":0.29499999999999998,"5min":0.254,"15min":0.251},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.38300000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54500000000000004,"15min":0.53400000000000003},"min":{"1min":0.439,"5min":0.30599999999999999,"15min":0.30299999999999999},"max":{"1min":0.69699999999999995,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.68799999999999994,"15min":0.59399999999999997},"min":{"1min":0.374,"5min":0.28199999999999997,"15min":0.27900000000000003},"max":{"1min":0.70999999999999996,"5min":15.26,"15min":15.26},"last":0.69699999999999995}]},{"osd":5,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.69799999999999995,"15min":0.59599999999999997},"min":{"1min":0.39700000000000002,"5min":0.35799999999999998,"15min":0.32400000000000001},"max":{"1min":0.73699999999999999,"5min":15.186,"15min":15.186},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56799999999999995,"15min":0.56100000000000005},"min":{"1min":0.42999999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72199999999999998,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.58099999999999996}]},{"osd":6,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59299999999999997,"15min":0.58599999999999997},"min":{"1min":0.48299999999999998,"5min":0.38200000000000001,"15min":0.32600000000000001},"max":{"1min":0.76900000000000002,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59599999999999997,"15min":0.57999999999999996},"min":{"1min":0.438,"5min":0.40699999999999997,"15min":0.34200000000000003},"max":{"1min":0.80500000000000005,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.68300000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.67300000000000004,"15min":0.59999999999999998},"min":{"1min":0.41699999999999998,"5min":0.37,"15min":0.34499999999999997},"max":{"1min":0.69399999999999995,"5min":10.977,"15min":10.977},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57799999999999996,"15min":0.57399999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.38200000000000001},"max":{"1min":0.79400000000000004,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.73999999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575011,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311716,"kb_used_data":2140,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060124,"statfs":{"total":96636764160,"available":96317566976,"internally_reserved":0,"allocated":2191360,"data_stored":1011228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.34799999999999998,"15min":0.32800000000000001},"min":{"1min":0.20799999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.55200000000000005,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.41999999999999998,"15min":0.39100000000000001},"min":{"1min":0.26800000000000002,"5min":0.23000000000000001,"15min":0.22700000000000001},"max":{"1min":0.61099999999999999,"5min":4.4820000000000002,"15min":4.4820000000000002},"last":0.33300000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.32100000000000001,"15min":0.315},"min":{"1min":0.22800000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.48199999999999998,"5min":0.54000000000000004,"15min":0.65400000000000003},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.36499999999999999,"15min":0.35799999999999998},"min":{"1min":0.28899999999999998,"5min":0.254,"15min":0.188},"max":{"1min":0.52300000000000002,"5min":0.53600000000000003,"15min":1.196},"last":0.251}]},{"osd":2,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.39900000000000002,"15min":0.38200000000000001},"min":{"1min":0.25,"5min":0.245,"15min":0.19600000000000001},"max":{"1min":0.52100000000000002,"5min":4.601,"15min":4.601},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.44400000000000001,"15min":0.41999999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.26100000000000001},"max":{"1min":0.60599999999999998,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.34499999999999997}]},{"osd":4,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55300000000000005,"15min":0.54700000000000004},"min":{"1min":0.38800000000000001,"5min":0.32100000000000001,"15min":0.311},"max":{"1min":0.76500000000000001,"5min":0.88500000000000001,"15min":1.694},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55500000000000005,"15min":0.54200000000000004},"min":{"1min":0.438,"5min":0.32600000000000001,"15min":0.30199999999999999},"max":{"1min":0.71699999999999997,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.52800000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.55800000000000005,"15min":0.54100000000000004},"min":{"1min":0.42199999999999999,"5min":0.34100000000000003,"15min":0.29399999999999998},"max":{"1min":0.83999999999999997,"5min":0.86399999999999999,"15min":0.878},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.56200000000000006,"15min":0.55600000000000005},"min":{"1min":0.40899999999999997,"5min":0.35699999999999998,"15min":0.29699999999999999},"max":{"1min":0.877,"5min":0.877,"15min":1.165},"last":0.59599999999999997}]},{"osd":6,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.59499999999999997,"15min":0.58099999999999996},"min":{"1min":0.501,"5min":0.372,"15min":0.36699999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":1.1359999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.58999999999999997,"15min":0.58699999999999997},"min":{"1min":0.45500000000000002,"5min":0.36799999999999999,"15min":0.34399999999999997},"max":{"1min":0.80600000000000005,"5min":0.82999999999999996,"15min":1.7470000000000001},"last":0.63}]},{"osd":7,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.57499999999999996,"15min":0.57599999999999996},"min":{"1min":0.41599999999999998,"5min":0.38900000000000001,"15min":0.35599999999999998},"max":{"1min":0.79300000000000004,"5min":0.89900000000000002,"15min":1.657},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.628,"5min":0.58699999999999997,"15min":0.57599999999999996},"min":{"1min":0.46300000000000002,"5min":0.38,"15min":0.35499999999999998},"max":{"1min":0.86199999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.54500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575010,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307636,"kb_used_data":2156,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064204,"statfs":{"total":96636764160,"available":96321744896,"internally_reserved":0,"allocated":2207744,"data_stored":1019197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.47899999999999998,"15min":0.50700000000000001},"min":{"1min":0.24199999999999999,"5min":0.216,"15min":0.19500000000000001},"max":{"1min":0.68700000000000006,"5min":0.82099999999999995,"15min":2.6619999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.499,"15min":0.49399999999999999},"min":{"1min":0.28899999999999998,"5min":0.224,"15min":0.215},"max":{"1min":0.76200000000000001,"5min":0.81499999999999995,"15min":0.91200000000000003},"last":0.40100000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.50700000000000001,"15min":0.53000000000000003},"min":{"1min":0.308,"5min":0.27300000000000002,"15min":0.23300000000000001},"max":{"1min":0.77300000000000002,"5min":1,"15min":2.8650000000000002},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.505,"15min":0.53500000000000003},"min":{"1min":0.35299999999999998,"5min":0.27000000000000002,"15min":0.25800000000000001},"max":{"1min":0.79800000000000004,"5min":1.2869999999999999,"15min":2.7610000000000001},"last":0.49299999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.52900000000000003,"15min":0.53000000000000003},"min":{"1min":0.44500000000000001,"5min":0.28499999999999998,"15min":0.23100000000000001},"max":{"1min":0.70399999999999996,"5min":0.77400000000000002,"15min":1.6910000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56699999999999995,"15min":0.57699999999999996},"min":{"1min":0.44800000000000001,"5min":0.33100000000000002,"15min":0.30599999999999999},"max":{"1min":0.82099999999999995,"5min":0.82799999999999996,"15min":1.718},"last":0.60599999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.57399999999999995,"15min":0.57799999999999996},"min":{"1min":0.38800000000000001,"5min":0.32000000000000001,"15min":0.26700000000000002},"max":{"1min":0.67500000000000004,"5min":2.387,"15min":2.677},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.54600000000000004,"15min":0.52800000000000002},"min":{"1min":0.40100000000000002,"5min":0.29299999999999998,"15min":0.27500000000000002},"max":{"1min":0.77700000000000002,"5min":1.784,"15min":1.784},"last":0.54300000000000004}]},{"osd":5,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47799999999999998,"15min":0.47999999999999998},"min":{"1min":0.36499999999999999,"5min":0.28499999999999998,"15min":0.23200000000000001},"max":{"1min":0.60299999999999998,"5min":0.73199999999999998,"15min":0.80200000000000005},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.51700000000000002,"15min":0.52300000000000002},"min":{"1min":0.317,"5min":0.28899999999999998,"15min":0.28399999999999997},"max":{"1min":0.752,"5min":0.752,"15min":0.82799999999999996},"last":0.64400000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.252},"max":{"1min":0.79500000000000004,"5min":0.83499999999999996,"15min":0.89000000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54500000000000004,"15min":0.55400000000000005},"min":{"1min":0.38700000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.72899999999999998,"5min":0.80200000000000005,"15min":1.165},"last":0.69599999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55300000000000005,"15min":0.55700000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.71199999999999997,"5min":0.84999999999999998,"15min":0.90500000000000003},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58499999999999996,"15min":0.58899999999999997},"min":{"1min":0.34399999999999997,"5min":0.318,"15min":0.317},"max":{"1min":0.81299999999999994,"5min":0.875,"15min":0.95499999999999996},"last":0.70799999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575012,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315816,"kb_used_data":2144,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94056024,"statfs":{"total":96636764160,"available":96313368576,"internally_reserved":0,"allocated":2195456,"data_stored":1012581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.48199999999999998,"15min":0.55900000000000005},"min":{"1min":0.32800000000000001,"5min":0.23300000000000001,"15min":0.20499999999999999},"max":{"1min":0.752,"5min":0.752,"15min":5.0490000000000004},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.47799999999999998,"15min":0.54100000000000004},"min":{"1min":0.34699999999999998,"5min":0.253,"15min":0.22900000000000001},"max":{"1min":0.626,"5min":0.71299999999999997,"15min":5.1449999999999996},"last":0.48199999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.48099999999999998,"15min":0.48499999999999999},"min":{"1min":0.34699999999999998,"5min":0.25700000000000001,"15min":0.25},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.97199999999999998},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.502,"15min":0.51000000000000001},"min":{"1min":0.373,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.73599999999999999,"5min":0.74099999999999999,"15min":1.8799999999999999},"last":0.65700000000000003}]},{"osd":2,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.52600000000000002,"15min":0.54700000000000004},"min":{"1min":0.42999999999999999,"5min":0.30099999999999999,"15min":0.28299999999999997},"max":{"1min":0.73399999999999999,"5min":0.76600000000000001,"15min":4.234},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.55800000000000005,"15min":0.56100000000000005},"min":{"1min":0.41699999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.78700000000000003,"5min":0.79200000000000004,"15min":1.0369999999999999},"last":0.69299999999999995}]},{"osd":3,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.497,"15min":0.57499999999999996},"min":{"1min":0.39700000000000002,"5min":0.29499999999999998,"15min":0.27700000000000002},"max":{"1min":0.67400000000000004,"5min":0.72799999999999998,"15min":5.2169999999999996},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.52600000000000002,"15min":0.53800000000000003},"min":{"1min":0.42599999999999999,"5min":0.29999999999999999,"15min":0.29699999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":1.008},"last":0.63300000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.47999999999999998,"15min":0.5},"min":{"1min":0.36399999999999999,"5min":0.25600000000000001,"15min":0.23999999999999999},"max":{"1min":0.61699999999999999,"5min":0.83399999999999996,"15min":1.917},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.495,"15min":0.51100000000000001},"min":{"1min":0.38200000000000001,"5min":0.251,"15min":0.23899999999999999},"max":{"1min":0.64900000000000002,"5min":0.69199999999999995,"15min":0.87},"last":0.57099999999999995}]},{"osd":6,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51000000000000001,"15min":0.53700000000000003},"min":{"1min":0.41099999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63700000000000001,"5min":0.76800000000000002,"15min":2.0139999999999998},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57399999999999995,"15min":0.59099999999999997},"min":{"1min":0.46200000000000002,"5min":0.30299999999999999,"15min":0.29999999999999999},"max":{"1min":0.68600000000000005,"5min":0.80800000000000005,"15min":1.9470000000000001},"last":0.73899999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53300000000000003,"15min":0.55900000000000005},"min":{"1min":0.42099999999999999,"5min":0.28799999999999998,"15min":0.27700000000000002},"max":{"1min":0.628,"5min":0.81000000000000005,"15min":0.96499999999999997},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57199999999999995,"15min":0.59099999999999997},"min":{"1min":0.46800000000000003,"5min":0.29199999999999998,"15min":0.28799999999999998},"max":{"1min":0.69199999999999995,"5min":0.77300000000000002,"15min":1.4119999999999999},"last":0.755}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:18:57.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.3f is not active+clean 2023-10-06T11:18:57.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.490762+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:18:57.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.3e is not active+clean 2023-10-06T11:18:57.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.490762+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:18:57.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.3d is not active+clean 2023-10-06T11:18:57.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.513257+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:03:22.963604+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T11:18:57.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.3c is not active+clean 2023-10-06T11:18:57.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.490762+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:18:57.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.3b is not active+clean 2023-10-06T11:18:57.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.490762+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:18:57.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.3a is not active+clean 2023-10-06T11:18:57.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.490762+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:18:57.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.39 is not active+clean 2023-10-06T11:18:57.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.490762+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:18:57.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.38 is not active+clean 2023-10-06T11:18:57.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.513115+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T22:48:06.231609+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:18:57.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.37 is not active+clean 2023-10-06T11:18:57.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.490762+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:18:57.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.36 is not active+clean 2023-10-06T11:18:57.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.511166+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:45:18.723193+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:18:57.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.35 is not active+clean 2023-10-06T11:18:57.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.510745+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T18:06:33.866195+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T11:18:57.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.34 is not active+clean 2023-10-06T11:18:57.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.490762+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:18:57.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.33 is not active+clean 2023-10-06T11:18:57.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.490762+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:18:57.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.32 is not active+clean 2023-10-06T11:18:57.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.511723+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T18:09:34.925925+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:18:57.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.31 is not active+clean 2023-10-06T11:18:57.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.503126+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:18:30.662720+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T11:18:57.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.30 is not active+clean 2023-10-06T11:18:57.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.508679+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T18:49:38.496675+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T11:18:57.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.2f is not active+clean 2023-10-06T11:18:57.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.490762+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:18:57.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.2e is not active+clean 2023-10-06T11:18:57.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.490762+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:18:57.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.2d is not active+clean 2023-10-06T11:18:57.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.510774+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T18:43:55.311129+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:18:57.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.2c is not active+clean 2023-10-06T11:18:57.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.511555+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:29:13.769278+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:18:57.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.2b is not active+clean 2023-10-06T11:18:57.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.516145+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:11:36.554686+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:18:57.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.2a is not active+clean 2023-10-06T11:18:57.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.511245+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T22:19:53.986592+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:18:57.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.29 is not active+clean 2023-10-06T11:18:57.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.490762+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:18:57.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.28 is not active+clean 2023-10-06T11:18:57.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.490762+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:18:57.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.27 is not active+clean 2023-10-06T11:18:57.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.490762+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:18:57.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.26 is not active+clean 2023-10-06T11:18:57.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.490762+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:18:57.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.25 is not active+clean 2023-10-06T11:18:57.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.510274+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:12:58.152151+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T11:18:57.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.24 is not active+clean 2023-10-06T11:18:57.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.490762+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:18:57.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.23 is not active+clean 2023-10-06T11:18:57.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.490762+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:18:57.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.22 is not active+clean 2023-10-06T11:18:57.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.503627+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T21:47:32.386139+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T11:18:57.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.21 is not active+clean 2023-10-06T11:18:57.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.490762+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:18:57.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.20 is not active+clean 2023-10-06T11:18:57.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.490762+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:18:57.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.10 is not active+clean 2023-10-06T11:18:57.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.502870+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:40:38.219266+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T11:18:57.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.17 is not active+clean 2023-10-06T11:18:57.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:50.486591+0000', 'last_change': '2023-10-06T11:18:50.495654+0000', 'last_active': '2023-10-06T11:18:50.486591+0000', 'last_peered': '2023-10-06T11:18:50.486591+0000', 'last_clean': '2023-10-06T11:18:50.486591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:50.486591+0000', 'last_undegraded': '2023-10-06T11:18:50.486591+0000', 'last_fullsized': '2023-10-06T11:18:50.486591+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:09:58.364738+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T11:18:57.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.11 is not active+clean 2023-10-06T11:18:57.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.508575+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T19:19:32.976623+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T11:18:57.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.16 is not active+clean 2023-10-06T11:18:57.322 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:50.486591+0000', 'last_change': '2023-10-06T11:18:50.497308+0000', 'last_active': '2023-10-06T11:18:50.486591+0000', 'last_peered': '2023-10-06T11:18:50.486591+0000', 'last_clean': '2023-10-06T11:18:50.486591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:50.486591+0000', 'last_undegraded': '2023-10-06T11:18:50.486591+0000', 'last_fullsized': '2023-10-06T11:18:50.486591+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T21:59:35.711896+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T11:18:57.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.12 is not active+clean 2023-10-06T11:18:57.322 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.490762+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:18:57.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.15 is not active+clean 2023-10-06T11:18:57.322 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:50.486591+0000', 'last_change': '2023-10-06T11:18:50.492630+0000', 'last_active': '2023-10-06T11:18:50.486591+0000', 'last_peered': '2023-10-06T11:18:50.486591+0000', 'last_clean': '2023-10-06T11:18:50.486591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:50.486591+0000', 'last_undegraded': '2023-10-06T11:18:50.486591+0000', 'last_fullsized': '2023-10-06T11:18:50.486591+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:02:22.454621+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:18:57.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.13 is not active+clean 2023-10-06T11:18:57.322 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.490762+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:18:57.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.14 is not active+clean 2023-10-06T11:18:57.322 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:50.486591+0000', 'last_change': '2023-10-06T11:18:50.497405+0000', 'last_active': '2023-10-06T11:18:50.486591+0000', 'last_peered': '2023-10-06T11:18:50.486591+0000', 'last_clean': '2023-10-06T11:18:50.486591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:50.486591+0000', 'last_undegraded': '2023-10-06T11:18:50.486591+0000', 'last_fullsized': '2023-10-06T11:18:50.486591+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T21:47:31.381968+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T11:18:57.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.14 is not active+clean 2023-10-06T11:18:57.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.490762+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:18:57.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.13 is not active+clean 2023-10-06T11:18:57.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:50.486591+0000', 'last_change': '2023-10-06T11:18:50.496441+0000', 'last_active': '2023-10-06T11:18:50.486591+0000', 'last_peered': '2023-10-06T11:18:50.486591+0000', 'last_clean': '2023-10-06T11:18:50.486591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:50.486591+0000', 'last_undegraded': '2023-10-06T11:18:50.486591+0000', 'last_fullsized': '2023-10-06T11:18:50.486591+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T11:30:12.235357+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T11:18:57.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.15 is not active+clean 2023-10-06T11:18:57.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.507984+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T20:32:33.004446+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T11:18:57.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.16 is not active+clean 2023-10-06T11:18:57.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.490762+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:18:57.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.11 is not active+clean 2023-10-06T11:18:57.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:50.486591+0000', 'last_change': '2023-10-06T11:18:50.493251+0000', 'last_active': '2023-10-06T11:18:50.486591+0000', 'last_peered': '2023-10-06T11:18:50.486591+0000', 'last_clean': '2023-10-06T11:18:50.486591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:50.486591+0000', 'last_undegraded': '2023-10-06T11:18:50.486591+0000', 'last_fullsized': '2023-10-06T11:18:50.486591+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:52:08.422937+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:18:57.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.17 is not active+clean 2023-10-06T11:18:57.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.490762+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:18:57.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.10 is not active+clean 2023-10-06T11:18:57.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:50.486591+0000', 'last_change': '2023-10-06T11:18:50.496006+0000', 'last_active': '2023-10-06T11:18:50.486591+0000', 'last_peered': '2023-10-06T11:18:50.486591+0000', 'last_clean': '2023-10-06T11:18:50.486591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:50.486591+0000', 'last_undegraded': '2023-10-06T11:18:50.486591+0000', 'last_fullsized': '2023-10-06T11:18:50.486591+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:08:23.261106+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T11:18:57.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.8 is not active+clean 2023-10-06T11:18:57.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.512690+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T21:20:06.857224+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:18:57.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.f is not active+clean 2023-10-06T11:18:57.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:50.486591+0000', 'last_change': '2023-10-06T11:18:50.493492+0000', 'last_active': '2023-10-06T11:18:50.486591+0000', 'last_peered': '2023-10-06T11:18:50.486591+0000', 'last_clean': '2023-10-06T11:18:50.486591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:50.486591+0000', 'last_undegraded': '2023-10-06T11:18:50.486591+0000', 'last_fullsized': '2023-10-06T11:18:50.486591+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:34:37.175282+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T11:18:57.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.9 is not active+clean 2023-10-06T11:18:57.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.490762+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:18:57.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.e is not active+clean 2023-10-06T11:18:57.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:50.486591+0000', 'last_change': '2023-10-06T11:18:50.492889+0000', 'last_active': '2023-10-06T11:18:50.486591+0000', 'last_peered': '2023-10-06T11:18:50.486591+0000', 'last_clean': '2023-10-06T11:18:50.486591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:50.486591+0000', 'last_undegraded': '2023-10-06T11:18:50.486591+0000', 'last_fullsized': '2023-10-06T11:18:50.486591+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T19:37:54.962748+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T11:18:57.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.a is not active+clean 2023-10-06T11:18:57.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.490762+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:18:57.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.d is not active+clean 2023-10-06T11:18:57.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:50.486591+0000', 'last_change': '2023-10-06T11:18:50.495516+0000', 'last_active': '2023-10-06T11:18:50.486591+0000', 'last_peered': '2023-10-06T11:18:50.486591+0000', 'last_clean': '2023-10-06T11:18:50.486591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:50.486591+0000', 'last_undegraded': '2023-10-06T11:18:50.486591+0000', 'last_fullsized': '2023-10-06T11:18:50.486591+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:01:31.340000+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T11:18:57.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.b is not active+clean 2023-10-06T11:18:57.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.515476+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T21:50:45.910135+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:18:57.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.c is not active+clean 2023-10-06T11:18:57.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:50.486591+0000', 'last_change': '2023-10-06T11:18:50.496336+0000', 'last_active': '2023-10-06T11:18:50.486591+0000', 'last_peered': '2023-10-06T11:18:50.486591+0000', 'last_clean': '2023-10-06T11:18:50.486591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:50.486591+0000', 'last_undegraded': '2023-10-06T11:18:50.486591+0000', 'last_fullsized': '2023-10-06T11:18:50.486591+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:43:06.689323+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T11:18:57.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.c is not active+clean 2023-10-06T11:18:57.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.490762+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:18:57.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.b is not active+clean 2023-10-06T11:18:57.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:50.486591+0000', 'last_change': '2023-10-06T11:18:50.495790+0000', 'last_active': '2023-10-06T11:18:50.486591+0000', 'last_peered': '2023-10-06T11:18:50.486591+0000', 'last_clean': '2023-10-06T11:18:50.486591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:50.486591+0000', 'last_undegraded': '2023-10-06T11:18:50.486591+0000', 'last_fullsized': '2023-10-06T11:18:50.486591+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:54:49.162033+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T11:18:57.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.d is not active+clean 2023-10-06T11:18:57.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.490762+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:18:57.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.a is not active+clean 2023-10-06T11:18:57.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:50.486591+0000', 'last_change': '2023-10-06T11:18:50.496381+0000', 'last_active': '2023-10-06T11:18:50.486591+0000', 'last_peered': '2023-10-06T11:18:50.486591+0000', 'last_clean': '2023-10-06T11:18:50.486591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:50.486591+0000', 'last_undegraded': '2023-10-06T11:18:50.486591+0000', 'last_fullsized': '2023-10-06T11:18:50.486591+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T23:18:13.347927+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T11:18:57.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.e is not active+clean 2023-10-06T11:18:57.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.490762+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:18:57.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.f is not active+clean 2023-10-06T11:18:57.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.511802+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T18:00:15.358532+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:18:57.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.8 is not active+clean 2023-10-06T11:18:57.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:50.486591+0000', 'last_change': '2023-10-06T11:18:50.492823+0000', 'last_active': '2023-10-06T11:18:50.486591+0000', 'last_peered': '2023-10-06T11:18:50.486591+0000', 'last_clean': '2023-10-06T11:18:50.486591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:50.486591+0000', 'last_undegraded': '2023-10-06T11:18:50.486591+0000', 'last_fullsized': '2023-10-06T11:18:50.486591+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:42:10.142087+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T11:18:57.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.0 is not active+clean 2023-10-06T11:18:57.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.512226+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:31:14.739928+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:18:57.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.7 is not active+clean 2023-10-06T11:18:57.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:50.486591+0000', 'last_change': '2023-10-06T11:18:50.492973+0000', 'last_active': '2023-10-06T11:18:50.486591+0000', 'last_peered': '2023-10-06T11:18:50.486591+0000', 'last_clean': '2023-10-06T11:18:50.486591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:50.486591+0000', 'last_undegraded': '2023-10-06T11:18:50.486591+0000', 'last_fullsized': '2023-10-06T11:18:50.486591+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T20:34:22.931418+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:18:57.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.1 is not active+clean 2023-10-06T11:18:57.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.507932+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T17:56:53.432751+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T11:18:57.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.2 is not active+clean 2023-10-06T11:18:57.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.490762+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:18:57.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.3 is not active+clean 2023-10-06T11:18:57.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.490762+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:18:57.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.4 is not active+clean 2023-10-06T11:18:57.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:50.486591+0000', 'last_change': '2023-10-06T11:18:50.494141+0000', 'last_active': '2023-10-06T11:18:50.486591+0000', 'last_peered': '2023-10-06T11:18:50.486591+0000', 'last_clean': '2023-10-06T11:18:50.486591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:50.486591+0000', 'last_undegraded': '2023-10-06T11:18:50.486591+0000', 'last_fullsized': '2023-10-06T11:18:50.486591+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:40:53.184600+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T11:18:57.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.4 is not active+clean 2023-10-06T11:18:57.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.510476+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T20:39:40.994783+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:18:57.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.5 is not active+clean 2023-10-06T11:18:57.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.490762+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:18:57.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.2 is not active+clean 2023-10-06T11:18:57.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:50.486591+0000', 'last_change': '2023-10-06T11:18:50.492651+0000', 'last_active': '2023-10-06T11:18:50.486591+0000', 'last_peered': '2023-10-06T11:18:50.486591+0000', 'last_clean': '2023-10-06T11:18:50.486591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:50.486591+0000', 'last_undegraded': '2023-10-06T11:18:50.486591+0000', 'last_fullsized': '2023-10-06T11:18:50.486591+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T16:51:26.937096+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:18:57.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.6 is not active+clean 2023-10-06T11:18:57.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.490762+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:18:57.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.1 is not active+clean 2023-10-06T11:18:57.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:50.486591+0000', 'last_change': '2023-10-06T11:18:50.493704+0000', 'last_active': '2023-10-06T11:18:50.486591+0000', 'last_peered': '2023-10-06T11:18:50.486591+0000', 'last_clean': '2023-10-06T11:18:50.486591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:50.486591+0000', 'last_undegraded': '2023-10-06T11:18:50.486591+0000', 'last_fullsized': '2023-10-06T11:18:50.486591+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T22:09:05.555255+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T11:18:57.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.7 is not active+clean 2023-10-06T11:18:57.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.509689+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T20:26:40.393766+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-06T11:18:57.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.0 is not active+clean 2023-10-06T11:18:57.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:50.486591+0000', 'last_change': '2023-10-06T11:18:50.495516+0000', 'last_active': '2023-10-06T11:18:50.486591+0000', 'last_peered': '2023-10-06T11:18:50.486591+0000', 'last_clean': '2023-10-06T11:18:50.486591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:50.486591+0000', 'last_undegraded': '2023-10-06T11:18:50.486591+0000', 'last_fullsized': '2023-10-06T11:18:50.486591+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T19:08:02.104055+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-06T11:18:57.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.18 is not active+clean 2023-10-06T11:18:57.330 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.490762+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:18:57.330 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.19 is not active+clean 2023-10-06T11:18:57.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.490762+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:18:57.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.1e is not active+clean 2023-10-06T11:18:57.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:50.486591+0000', 'last_change': '2023-10-06T11:18:50.493576+0000', 'last_active': '2023-10-06T11:18:50.486591+0000', 'last_peered': '2023-10-06T11:18:50.486591+0000', 'last_clean': '2023-10-06T11:18:50.486591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:50.486591+0000', 'last_undegraded': '2023-10-06T11:18:50.486591+0000', 'last_fullsized': '2023-10-06T11:18:50.486591+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:09:15.298043+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-06T11:18:57.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.1e is not active+clean 2023-10-06T11:18:57.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.504457+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T12:15:15.196912+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T11:18:57.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.19 is not active+clean 2023-10-06T11:18:57.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:50.486591+0000', 'last_change': '2023-10-06T11:18:50.497159+0000', 'last_active': '2023-10-06T11:18:50.486591+0000', 'last_peered': '2023-10-06T11:18:50.486591+0000', 'last_clean': '2023-10-06T11:18:50.486591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:50.486591+0000', 'last_undegraded': '2023-10-06T11:18:50.486591+0000', 'last_fullsized': '2023-10-06T11:18:50.486591+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T15:12:04.967138+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T11:18:57.331 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.1f is not active+clean 2023-10-06T11:18:57.331 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.490762+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:18:57.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.1d is not active+clean 2023-10-06T11:18:57.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.490762+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:18:57.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.1a is not active+clean 2023-10-06T11:18:57.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:50.486591+0000', 'last_change': '2023-10-06T11:18:50.493041+0000', 'last_active': '2023-10-06T11:18:50.486591+0000', 'last_peered': '2023-10-06T11:18:50.486591+0000', 'last_clean': '2023-10-06T11:18:50.486591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:50.486591+0000', 'last_undegraded': '2023-10-06T11:18:50.486591+0000', 'last_fullsized': '2023-10-06T11:18:50.486591+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T21:16:03.968306+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:18:57.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.1c is not active+clean 2023-10-06T11:18:57.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.502856+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T14:13:59.830470+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-06T11:18:57.332 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.1b is not active+clean 2023-10-06T11:18:57.332 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:50.486591+0000', 'last_change': '2023-10-06T11:18:50.497225+0000', 'last_active': '2023-10-06T11:18:50.486591+0000', 'last_peered': '2023-10-06T11:18:50.486591+0000', 'last_clean': '2023-10-06T11:18:50.486591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:50.486591+0000', 'last_undegraded': '2023-10-06T11:18:50.486591+0000', 'last_fullsized': '2023-10-06T11:18:50.486591+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:01:35.577133+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-06T11:18:57.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.1b is not active+clean 2023-10-06T11:18:57.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.490762+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-06T11:18:57.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.1c is not active+clean 2023-10-06T11:18:57.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:50.486591+0000', 'last_change': '2023-10-06T11:18:50.492571+0000', 'last_active': '2023-10-06T11:18:50.486591+0000', 'last_peered': '2023-10-06T11:18:50.486591+0000', 'last_clean': '2023-10-06T11:18:50.486591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:50.486591+0000', 'last_undegraded': '2023-10-06T11:18:50.486591+0000', 'last_fullsized': '2023-10-06T11:18:50.486591+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:56:20.989429+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-06T11:18:57.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 28.1a is not active+clean 2023-10-06T11:18:57.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '28.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:51.490762+0000', 'last_change': '2023-10-06T11:18:51.508306+0000', 'last_active': '2023-10-06T11:18:51.490762+0000', 'last_peered': '2023-10-06T11:18:51.490762+0000', 'last_clean': '2023-10-06T11:18:51.490762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:51.490762+0000', 'last_undegraded': '2023-10-06T11:18:51.490762+0000', 'last_fullsized': '2023-10-06T11:18:51.490762+0000', 'mapping_epoch': 175, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 175, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:51.490762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:54:10.845045+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-06T11:18:57.333 INFO:tasks.cephfs.filesystem.ceph_manager:PG 27.1d is not active+clean 2023-10-06T11:18:57.333 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '27.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-06T11:18:50.486591+0000', 'last_change': '2023-10-06T11:18:50.495986+0000', 'last_active': '2023-10-06T11:18:50.486591+0000', 'last_peered': '2023-10-06T11:18:50.486591+0000', 'last_clean': '2023-10-06T11:18:50.486591+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-06T11:18:50.486591+0000', 'last_undegraded': '2023-10-06T11:18:50.486591+0000', 'last_fullsized': '2023-10-06T11:18:50.486591+0000', 'mapping_epoch': 174, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 174, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'last_clean_scrub_stamp': '2023-10-06T11:18:50.486591+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-07T13:36:20.103244+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-06T11:18:57.334 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T11:18:57.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.457+0000 7f787087c700 1 Processor -- start 2023-10-06T11:18:57.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.457+0000 7f787087c700 1 -- start start 2023-10-06T11:18:57.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.458+0000 7f787087c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f786c158140 0x7f786c158510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:57.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.458+0000 7f787087c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f786c069450 0x7f786c0698f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:57.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.458+0000 7f787087c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f786c06d210 0x7f786c06d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:57.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.458+0000 7f787087c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f786c06db90 con 0x7f786c069450 2023-10-06T11:18:57.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.458+0000 7f787087c700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f786c158a50 con 0x7f786c158140 2023-10-06T11:18:57.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.458+0000 7f787087c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f786c069f10 con 0x7f786c06d210 2023-10-06T11:18:57.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.458+0000 7f7861d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f786c069450 0x7f786c0698f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:57.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.458+0000 7f7861d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f786c069450 0x7f786c0698f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58678/0 (socket says 172.21.15.146:58678) 2023-10-06T11:18:57.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.458+0000 7f7861d9b700 1 -- 172.21.15.146:0/358971037 learned_addr learned my addr 172.21.15.146:0/358971037 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:57.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.458+0000 7f786a59c700 1 --2- 172.21.15.146:0/358971037 >> v2:172.21.15.151:3300/0 conn(0x7f786c158140 0x7f786c158510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:57.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.458+0000 7f786ad9d700 1 --2- 172.21.15.146:0/358971037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f786c06d210 0x7f786c06d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:57.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.459+0000 7f7861d9b700 1 -- 172.21.15.146:0/358971037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f786c06d210 msgr2=0x7f786c06d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:57.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.459+0000 7f7861d9b700 1 --2- 172.21.15.146:0/358971037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f786c06d210 0x7f786c06d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:57.462 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.459+0000 7f7861d9b700 1 -- 172.21.15.146:0/358971037 >> v2:172.21.15.151:3300/0 conn(0x7f786c158140 msgr2=0x7f786c158510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:57.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.459+0000 7f7861d9b700 1 --2- 172.21.15.146:0/358971037 >> v2:172.21.15.151:3300/0 conn(0x7f786c158140 0x7f786c158510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:57.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.459+0000 7f7861d9b700 1 -- 172.21.15.146:0/358971037 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f786c06a1f0 con 0x7f786c069450 2023-10-06T11:18:57.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.459+0000 7f7861d9b700 1 --2- 172.21.15.146:0/358971037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f786c069450 0x7f786c0698f0 secure :-1 s=READY pgs=2249 cs=0 l=1 rev1=1 crypto rx=0x7f786c06cc20 tx=0x7f7854009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=514e054aed4442ad server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:57.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.459+0000 7f7869d9b700 1 -- 172.21.15.146:0/358971037 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7854009e70 con 0x7f786c069450 2023-10-06T11:18:57.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.459+0000 7f7869d9b700 1 -- 172.21.15.146:0/358971037 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f785400b860 con 0x7f786c069450 2023-10-06T11:18:57.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.459+0000 7f7869d9b700 1 -- 172.21.15.146:0/358971037 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785400bc00 con 0x7f786c069450 2023-10-06T11:18:57.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.459+0000 7f787087c700 1 -- 172.21.15.146:0/358971037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f786c069450 msgr2=0x7f786c0698f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:57.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.459+0000 7f787087c700 1 --2- 172.21.15.146:0/358971037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f786c069450 0x7f786c0698f0 secure :-1 s=READY pgs=2249 cs=0 l=1 rev1=1 crypto rx=0x7f786c06cc20 tx=0x7f7854009250 comp rx=0 tx=0).stop 2023-10-06T11:18:57.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.459+0000 7f787087c700 1 -- 172.21.15.146:0/358971037 shutdown_connections 2023-10-06T11:18:57.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.459+0000 7f787087c700 1 --2- 172.21.15.146:0/358971037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f786c06d210 0x7f786c06d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:57.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.459+0000 7f787087c700 1 --2- 172.21.15.146:0/358971037 >> v2:172.21.15.151:3300/0 conn(0x7f786c158140 0x7f786c158510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:57.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.459+0000 7f787087c700 1 --2- 172.21.15.146:0/358971037 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f786c069450 0x7f786c0698f0 unknown :-1 s=CLOSED pgs=2249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:57.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.459+0000 7f787087c700 1 -- 172.21.15.146:0/358971037 >> 172.21.15.146:0/358971037 conn(0x7f786c0cc1c0 msgr2=0x7f786c0cc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:57.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.459+0000 7f787087c700 1 -- 172.21.15.146:0/358971037 shutdown_connections 2023-10-06T11:18:57.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.459+0000 7f787087c700 1 -- 172.21.15.146:0/358971037 wait complete. 2023-10-06T11:18:57.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.461+0000 7f787087c700 1 Processor -- start 2023-10-06T11:18:57.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.461+0000 7f787087c700 1 -- start start 2023-10-06T11:18:57.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.461+0000 7f787087c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f786c069450 0x7f786c0a5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:57.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.461+0000 7f787087c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f786c06d210 0x7f786c1387c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:57.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.461+0000 7f787087c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f786c158140 0x7f786c138d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:57.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.461+0000 7f787087c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786c169800 con 0x7f786c069450 2023-10-06T11:18:57.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.461+0000 7f787087c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f786c169a10 con 0x7f786c158140 2023-10-06T11:18:57.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.461+0000 7f787087c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f786c169cf0 con 0x7f786c06d210 2023-10-06T11:18:57.467 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.461+0000 7f786a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f786c069450 0x7f786c0a5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:57.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.462+0000 7f786a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f786c069450 0x7f786c0a5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58686/0 (socket says 172.21.15.146:58686) 2023-10-06T11:18:57.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.462+0000 7f786a59c700 1 -- 172.21.15.146:0/3730158410 learned_addr learned my addr 172.21.15.146:0/3730158410 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:57.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.462+0000 7f7861d9b700 1 --2- 172.21.15.146:0/3730158410 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f786c06d210 0x7f786c1387c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:57.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.462+0000 7f786ad9d700 1 --2- 172.21.15.146:0/3730158410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f786c158140 0x7f786c138d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:57.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.462+0000 7f786a59c700 1 -- 172.21.15.146:0/3730158410 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f786c06d210 msgr2=0x7f786c1387c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:57.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.462+0000 7f786a59c700 1 --2- 172.21.15.146:0/3730158410 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f786c06d210 0x7f786c1387c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:57.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.462+0000 7f786a59c700 1 -- 172.21.15.146:0/3730158410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f786c158140 msgr2=0x7f786c138d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:57.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.462+0000 7f786a59c700 1 --2- 172.21.15.146:0/3730158410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f786c158140 0x7f786c138d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:57.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.462+0000 7f786a59c700 1 -- 172.21.15.146:0/3730158410 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78540094f0 con 0x7f786c069450 2023-10-06T11:18:57.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.462+0000 7f786a59c700 1 --2- 172.21.15.146:0/3730158410 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f786c069450 0x7f786c0a5e80 secure :-1 s=READY pgs=2250 cs=0 l=1 rev1=1 crypto rx=0x7f785c00e930 tx=0x7f785c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:57.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.462+0000 7f7862ffd700 1 -- 172.21.15.146:0/3730158410 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785c00eed0 con 0x7f786c069450 2023-10-06T11:18:57.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.462+0000 7f7862ffd700 1 -- 172.21.15.146:0/3730158410 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f785c00c850 con 0x7f786c069450 2023-10-06T11:18:57.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.462+0000 7f7862ffd700 1 -- 172.21.15.146:0/3730158410 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785c00cbf0 con 0x7f786c069450 2023-10-06T11:18:57.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.462+0000 7f787087c700 1 -- 172.21.15.146:0/3730158410 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f786c169fd0 con 0x7f786c069450 2023-10-06T11:18:57.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.462+0000 7f787087c700 1 -- 172.21.15.146:0/3730158410 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f786c16a590 con 0x7f786c069450 2023-10-06T11:18:57.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.463+0000 7f787087c700 1 -- 172.21.15.146:0/3730158410 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f786c04c380 con 0x7f786c069450 2023-10-06T11:18:57.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.464+0000 7f7862ffd700 1 -- 172.21.15.146:0/3730158410 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f785c013470 con 0x7f786c069450 2023-10-06T11:18:57.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.464+0000 7f7862ffd700 1 --2- 172.21.15.146:0/3730158410 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f784c066f30 0x7f784c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:57.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.464+0000 7f7862ffd700 1 -- 172.21.15.146:0/3730158410 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f785c0848c0 con 0x7f786c069450 2023-10-06T11:18:57.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.464+0000 7f7861d9b700 1 --2- 172.21.15.146:0/3730158410 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f784c066f30 0x7f784c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:57.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.464+0000 7f7861d9b700 1 --2- 172.21.15.146:0/3730158410 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f784c066f30 0x7f784c0693e0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f786c06cc20 tx=0x7f7854017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:57.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.468+0000 7f7862ffd700 1 -- 172.21.15.146:0/3730158410 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f785c0519d0 con 0x7f786c069450 2023-10-06T11:18:57.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.728+0000 7f787087c700 1 -- 172.21.15.146:0/3730158410 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f786c06b3b0 con 0x7f786c069450 2023-10-06T11:18:57.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.728+0000 7f7862ffd700 1 -- 172.21.15.146:0/3730158410 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1269 (secure 0 0 0) 0x7f785c054ff0 con 0x7f786c069450 2023-10-06T11:18:57.730 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:18:57.730 INFO:teuthology.orchestra.run.smithi146.stdout:{"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":812,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":177,"num_osds":8,"num_up_osds":8,"osd_up_since":1696590336,"num_in_osds":8,"osd_in_since":1696590327,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":79},{"state_name":"creating+peering","count":26}],"num_pgs":105,"num_pools":4,"num_objects":21,"data_bytes":592120,"bytes_used":2500521984,"bytes_avail":770593591296,"bytes_total":773094113280,"inactive_pgs_ratio":0.24761904776096344,"write_bytes_sec":2047,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":144,"id":13,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":13,"rank":0,"name":"d","status":"up:active","gid":10476}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":27,"modified":"2023-10-06T11:18:19.304929+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T11:18:57.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.730+0000 7f787087c700 1 -- 172.21.15.146:0/3730158410 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f784c066f30 msgr2=0x7f784c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:57.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.730+0000 7f787087c700 1 --2- 172.21.15.146:0/3730158410 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f784c066f30 0x7f784c0693e0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f786c06cc20 tx=0x7f7854017000 comp rx=0 tx=0).stop 2023-10-06T11:18:57.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.730+0000 7f787087c700 1 -- 172.21.15.146:0/3730158410 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f786c069450 msgr2=0x7f786c0a5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:57.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.730+0000 7f787087c700 1 --2- 172.21.15.146:0/3730158410 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f786c069450 0x7f786c0a5e80 secure :-1 s=READY pgs=2250 cs=0 l=1 rev1=1 crypto rx=0x7f785c00e930 tx=0x7f785c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:18:57.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.730+0000 7f787087c700 1 -- 172.21.15.146:0/3730158410 shutdown_connections 2023-10-06T11:18:57.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.730+0000 7f787087c700 1 --2- 172.21.15.146:0/3730158410 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f784c066f30 0x7f784c0693e0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:57.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.730+0000 7f787087c700 1 --2- 172.21.15.146:0/3730158410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f786c158140 0x7f786c138d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:57.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.730+0000 7f787087c700 1 --2- 172.21.15.146:0/3730158410 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f786c069450 0x7f786c0a5e80 unknown :-1 s=CLOSED pgs=2250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:57.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.730+0000 7f787087c700 1 --2- 172.21.15.146:0/3730158410 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f786c06d210 0x7f786c1387c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:57.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.730+0000 7f787087c700 1 -- 172.21.15.146:0/3730158410 >> 172.21.15.146:0/3730158410 conn(0x7f786c0cc1c0 msgr2=0x7f786c0b0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:57.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.730+0000 7f787087c700 1 -- 172.21.15.146:0/3730158410 shutdown_connections 2023-10-06T11:18:57.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.730+0000 7f787087c700 1 -- 172.21.15.146:0/3730158410 wait complete. 2023-10-06T11:18:57.743 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-06T11:18:57.743 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:18:57.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.856+0000 7f646dbef700 1 Processor -- start 2023-10-06T11:18:57.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.856+0000 7f646dbef700 1 -- start start 2023-10-06T11:18:57.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.857+0000 7f646dbef700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6468143040 0x7f64680b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:57.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.857+0000 7f646dbef700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6468143410 0x7f64680b2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:57.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.857+0000 7f646dbef700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64680cf100 con 0x7f64680b4d20 2023-10-06T11:18:57.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.857+0000 7f646dbef700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64680b4170 con 0x7f6468143410 2023-10-06T11:18:57.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.857+0000 7f646dbef700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64680b5f50 con 0x7f6468143040 2023-10-06T11:18:57.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.857+0000 7f6467fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6468143410 0x7f64680b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:57.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.857+0000 7f6467fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6468143410 0x7f64680b2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58690/0 (socket says 172.21.15.146:58690) 2023-10-06T11:18:57.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.857+0000 7f6467fff700 1 -- 172.21.15.146:0/3761024521 learned_addr learned my addr 172.21.15.146:0/3761024521 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:57.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.857+0000 7f646cbed700 1 --2- 172.21.15.146:0/3761024521 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6468143040 0x7f64680b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:57.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.857+0000 7f6467fff700 1 -- 172.21.15.146:0/3761024521 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6468143040 msgr2=0x7f64680b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:57.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.857+0000 7f6467fff700 1 --2- 172.21.15.146:0/3761024521 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6468143040 0x7f64680b1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:57.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.857+0000 7f6467fff700 1 -- 172.21.15.146:0/3761024521 >> v1:172.21.15.151:6789/0 conn(0x7f64680b4d20 legacy=0x7f64680b51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:18:57.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.858+0000 7f6467fff700 1 -- 172.21.15.146:0/3761024521 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64680ceb30 con 0x7f6468143410 2023-10-06T11:18:57.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.858+0000 7f646cbed700 1 --2- 172.21.15.146:0/3761024521 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6468143040 0x7f64680b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:18:57.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.858+0000 7f6467fff700 1 --2- 172.21.15.146:0/3761024521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6468143410 0x7f64680b2360 secure :-1 s=READY pgs=2251 cs=0 l=1 rev1=1 crypto rx=0x7f645c009f20 tx=0x7f645c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6e69afe5ffcd876 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:57.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.858+0000 7f64677fe700 1 -- 172.21.15.146:0/3761024521 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c00e070 con 0x7f6468143410 2023-10-06T11:18:57.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.858+0000 7f64677fe700 1 -- 172.21.15.146:0/3761024521 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645c00ba80 con 0x7f6468143410 2023-10-06T11:18:57.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.858+0000 7f64677fe700 1 -- 172.21.15.146:0/3761024521 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c0092e0 con 0x7f6468143410 2023-10-06T11:18:57.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.858+0000 7f646dbef700 1 -- 172.21.15.146:0/3761024521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6468143410 msgr2=0x7f64680b2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:57.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.858+0000 7f646dbef700 1 --2- 172.21.15.146:0/3761024521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6468143410 0x7f64680b2360 secure :-1 s=READY pgs=2251 cs=0 l=1 rev1=1 crypto rx=0x7f645c009f20 tx=0x7f645c009840 comp rx=0 tx=0).stop 2023-10-06T11:18:57.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.858+0000 7f646dbef700 1 -- 172.21.15.146:0/3761024521 shutdown_connections 2023-10-06T11:18:57.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.858+0000 7f646dbef700 1 --2- 172.21.15.146:0/3761024521 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6468143040 0x7f64680b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:57.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.858+0000 7f646dbef700 1 --2- 172.21.15.146:0/3761024521 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6468143410 0x7f64680b2360 unknown :-1 s=CLOSED pgs=2251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:57.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.858+0000 7f646dbef700 1 -- 172.21.15.146:0/3761024521 >> 172.21.15.146:0/3761024521 conn(0x7f646806eb10 msgr2=0x7f646806ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:57.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.858+0000 7f646dbef700 1 -- 172.21.15.146:0/3761024521 shutdown_connections 2023-10-06T11:18:57.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.858+0000 7f646dbef700 1 -- 172.21.15.146:0/3761024521 wait complete. 2023-10-06T11:18:57.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.860+0000 7f646dbef700 1 Processor -- start 2023-10-06T11:18:57.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.860+0000 7f646dbef700 1 -- start start 2023-10-06T11:18:57.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.860+0000 7f646dbef700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64680b4d20 0x7f6468140ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:57.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.860+0000 7f646dbef700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6468143040 0x7f646813cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:57.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.860+0000 7f646dbef700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6468143410 0x7f646813d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:57.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.860+0000 7f646dbef700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646813f000 con 0x7f6468143040 2023-10-06T11:18:57.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.860+0000 7f646dbef700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646815c8c0 con 0x7f64680b4d20 2023-10-06T11:18:57.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.860+0000 7f646dbef700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6468141010 con 0x7f6468143410 2023-10-06T11:18:57.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.861+0000 7f6467fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6468143040 0x7f646813cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:57.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.861+0000 7f6467fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6468143040 0x7f646813cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58694/0 (socket says 172.21.15.146:58694) 2023-10-06T11:18:57.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.861+0000 7f6467fff700 1 -- 172.21.15.146:0/3665345602 learned_addr learned my addr 172.21.15.146:0/3665345602 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:18:57.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.861+0000 7f646cbed700 1 --2- 172.21.15.146:0/3665345602 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64680b4d20 0x7f6468140ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:57.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.861+0000 7f646d3ee700 1 --2- 172.21.15.146:0/3665345602 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6468143410 0x7f646813d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:57.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.861+0000 7f6467fff700 1 -- 172.21.15.146:0/3665345602 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6468143410 msgr2=0x7f646813d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:57.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.861+0000 7f6467fff700 1 --2- 172.21.15.146:0/3665345602 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6468143410 0x7f646813d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:57.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.861+0000 7f6467fff700 1 -- 172.21.15.146:0/3665345602 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64680b4d20 msgr2=0x7f6468140ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:57.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.861+0000 7f6467fff700 1 --2- 172.21.15.146:0/3665345602 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64680b4d20 0x7f6468140ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:57.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.861+0000 7f6467fff700 1 -- 172.21.15.146:0/3665345602 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f645c009ae0 con 0x7f6468143040 2023-10-06T11:18:57.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.861+0000 7f6467fff700 1 --2- 172.21.15.146:0/3665345602 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6468143040 0x7f646813cb90 secure :-1 s=READY pgs=2252 cs=0 l=1 rev1=1 crypto rx=0x7f645c00b6c0 tx=0x7f645c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:57.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.861+0000 7f6464ff9700 1 -- 172.21.15.146:0/3665345602 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c008a80 con 0x7f6468143040 2023-10-06T11:18:57.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.861+0000 7f6464ff9700 1 -- 172.21.15.146:0/3665345602 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645c008be0 con 0x7f6468143040 2023-10-06T11:18:57.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.861+0000 7f646dbef700 1 -- 172.21.15.146:0/3665345602 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f646813d730 con 0x7f6468143040 2023-10-06T11:18:57.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.861+0000 7f6464ff9700 1 -- 172.21.15.146:0/3665345602 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c025460 con 0x7f6468143040 2023-10-06T11:18:57.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.861+0000 7f646dbef700 1 -- 172.21.15.146:0/3665345602 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f646815cdf0 con 0x7f6468143040 2023-10-06T11:18:57.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.862+0000 7f646dbef700 1 -- 172.21.15.146:0/3665345602 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6468088a80 con 0x7f6468143040 2023-10-06T11:18:57.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.862+0000 7f6464ff9700 1 -- 172.21.15.146:0/3665345602 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f645c003040 con 0x7f6468143040 2023-10-06T11:18:57.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.863+0000 7f6464ff9700 1 --2- 172.21.15.146:0/3665345602 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6454066f30 0x7f64540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:18:57.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.863+0000 7f646cbed700 1 --2- 172.21.15.146:0/3665345602 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6454066f30 0x7f64540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:18:57.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.863+0000 7f6464ff9700 1 -- 172.21.15.146:0/3665345602 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f645c085ac0 con 0x7f6468143040 2023-10-06T11:18:57.873 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.863+0000 7f646cbed700 1 --2- 172.21.15.146:0/3665345602 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6454066f30 0x7f64540693e0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f645800ad30 tx=0x7f6458006f90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:18:57.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:57.867+0000 7f6464ff9700 1 -- 172.21.15.146:0/3665345602 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f645c052bd0 con 0x7f6468143040 2023-10-06T11:18:58.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:58.047+0000 7f646dbef700 1 -- 172.21.15.146:0/3665345602 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f646804bb40 con 0x7f6454066f30 2023-10-06T11:18:58.056 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:58.055+0000 7f6464ff9700 1 -- 172.21.15.146:0/3665345602 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310783 (secure 0 0 0) 0x7f646804bb40 con 0x7f6454066f30 2023-10-06T11:18:58.060 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:18:58.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:58.058+0000 7f646dbef700 1 -- 172.21.15.146:0/3665345602 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6454066f30 msgr2=0x7f64540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:58.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:58.058+0000 7f646dbef700 1 --2- 172.21.15.146:0/3665345602 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6454066f30 0x7f64540693e0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f645800ad30 tx=0x7f6458006f90 comp rx=0 tx=0).stop 2023-10-06T11:18:58.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:58.058+0000 7f646dbef700 1 -- 172.21.15.146:0/3665345602 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6468143040 msgr2=0x7f646813cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:18:58.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:58.058+0000 7f646dbef700 1 --2- 172.21.15.146:0/3665345602 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6468143040 0x7f646813cb90 secure :-1 s=READY pgs=2252 cs=0 l=1 rev1=1 crypto rx=0x7f645c00b6c0 tx=0x7f645c018000 comp rx=0 tx=0).stop 2023-10-06T11:18:58.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:58.058+0000 7f646dbef700 1 -- 172.21.15.146:0/3665345602 shutdown_connections 2023-10-06T11:18:58.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:58.058+0000 7f646dbef700 1 --2- 172.21.15.146:0/3665345602 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6454066f30 0x7f64540693e0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:58.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:58.058+0000 7f646dbef700 1 --2- 172.21.15.146:0/3665345602 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6468143410 0x7f646813d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:58.063 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:58.058+0000 7f646dbef700 1 --2- 172.21.15.146:0/3665345602 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64680b4d20 0x7f6468140ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:58.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:58.058+0000 7f646dbef700 1 --2- 172.21.15.146:0/3665345602 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6468143040 0x7f646813cb90 unknown :-1 s=CLOSED pgs=2252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:18:58.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:58.058+0000 7f646dbef700 1 -- 172.21.15.146:0/3665345602 >> 172.21.15.146:0/3665345602 conn(0x7f646806eb10 msgr2=0x7f64680b4530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:18:58.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:58.059+0000 7f646dbef700 1 -- 172.21.15.146:0/3665345602 shutdown_connections 2023-10-06T11:18:58.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:18:58.059+0000 7f646dbef700 1 -- 172.21.15.146:0/3665345602 wait complete. 2023-10-06T11:18:58.064 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:18:58.072 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":570,"stamp":"2023-10-06T11:18:57.312601+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592120,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":199,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":138,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2441916,"kb_used_data":18556,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752532804,"statfs":{"total":773094113280,"available":770593591296,"internally_reserved":0,"allocated":19001344,"data_stored":9399653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1752,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001017"},"pg_stats":[{"pgid":"28.3f","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.531406+0000","last_change":"2023-10-06T11:18:52.530544+0000","last_active":"2023-10-06T11:18:52.531406+0000","last_peered":"2023-10-06T11:18:52.531406+0000","last_clean":"2023-10-06T11:18:52.531406+0000","last_became_active":"2023-10-06T11:18:52.530251+0000","last_became_peered":"2023-10-06T11:18:52.530251+0000","last_unstale":"2023-10-06T11:18:52.531406+0000","last_undegraded":"2023-10-06T11:18:52.531406+0000","last_fullsized":"2023-10-06T11:18:52.531406+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:56:53.432751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.3e","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.528171+0000","last_change":"2023-10-06T11:18:52.527062+0000","last_active":"2023-10-06T11:18:52.528171+0000","last_peered":"2023-10-06T11:18:52.528171+0000","last_clean":"2023-10-06T11:18:52.528171+0000","last_became_active":"2023-10-06T11:18:52.526797+0000","last_became_peered":"2023-10-06T11:18:52.526797+0000","last_unstale":"2023-10-06T11:18:52.528171+0000","last_undegraded":"2023-10-06T11:18:52.528171+0000","last_fullsized":"2023-10-06T11:18:52.528171+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:16:04.972477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.513257+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:22.963604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3c","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.531640+0000","last_change":"2023-10-06T11:18:52.530627+0000","last_active":"2023-10-06T11:18:52.531640+0000","last_peered":"2023-10-06T11:18:52.531640+0000","last_clean":"2023-10-06T11:18:52.531640+0000","last_became_active":"2023-10-06T11:18:52.530366+0000","last_became_peered":"2023-10-06T11:18:52.530366+0000","last_unstale":"2023-10-06T11:18:52.531640+0000","last_undegraded":"2023-10-06T11:18:52.531640+0000","last_fullsized":"2023-10-06T11:18:52.531640+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:26:40.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.3b","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.523007+0000","last_change":"2023-10-06T11:18:52.520993+0000","last_active":"2023-10-06T11:18:52.523007+0000","last_peered":"2023-10-06T11:18:52.523007+0000","last_clean":"2023-10-06T11:18:52.523007+0000","last_became_active":"2023-10-06T11:18:52.520748+0000","last_became_peered":"2023-10-06T11:18:52.520748+0000","last_unstale":"2023-10-06T11:18:52.523007+0000","last_undegraded":"2023-10-06T11:18:52.523007+0000","last_fullsized":"2023-10-06T11:18:52.523007+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:03:23.978572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.3a","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.528368+0000","last_change":"2023-10-06T11:18:52.526067+0000","last_active":"2023-10-06T11:18:52.528368+0000","last_peered":"2023-10-06T11:18:52.528368+0000","last_clean":"2023-10-06T11:18:52.528368+0000","last_became_active":"2023-10-06T11:18:52.525793+0000","last_became_peered":"2023-10-06T11:18:52.525793+0000","last_unstale":"2023-10-06T11:18:52.528368+0000","last_undegraded":"2023-10-06T11:18:52.528368+0000","last_fullsized":"2023-10-06T11:18:52.528368+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:39:48.907532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.39","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.534135+0000","last_change":"2023-10-06T11:18:52.528505+0000","last_active":"2023-10-06T11:18:52.534135+0000","last_peered":"2023-10-06T11:18:52.534135+0000","last_clean":"2023-10-06T11:18:52.534135+0000","last_became_active":"2023-10-06T11:18:52.528218+0000","last_became_peered":"2023-10-06T11:18:52.528218+0000","last_unstale":"2023-10-06T11:18:52.534135+0000","last_undegraded":"2023-10-06T11:18:52.534135+0000","last_fullsized":"2023-10-06T11:18:52.534135+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:43:48.577600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.513115+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:48:06.231609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.37","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.519458+0000","last_change":"2023-10-06T11:18:52.516490+0000","last_active":"2023-10-06T11:18:52.519458+0000","last_peered":"2023-10-06T11:18:52.519458+0000","last_clean":"2023-10-06T11:18:52.519458+0000","last_became_active":"2023-10-06T11:18:52.516253+0000","last_became_peered":"2023-10-06T11:18:52.516253+0000","last_unstale":"2023-10-06T11:18:52.519458+0000","last_undegraded":"2023-10-06T11:18:52.519458+0000","last_fullsized":"2023-10-06T11:18:52.519458+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:26:54.298917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.511166+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:45:18.723193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.510745+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:06:33.866195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.34","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.522885+0000","last_change":"2023-10-06T11:18:52.520120+0000","last_active":"2023-10-06T11:18:52.522885+0000","last_peered":"2023-10-06T11:18:52.522885+0000","last_clean":"2023-10-06T11:18:52.522885+0000","last_became_active":"2023-10-06T11:18:52.519826+0000","last_became_peered":"2023-10-06T11:18:52.519826+0000","last_unstale":"2023-10-06T11:18:52.522885+0000","last_undegraded":"2023-10-06T11:18:52.522885+0000","last_fullsized":"2023-10-06T11:18:52.522885+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:18:11.272290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.33","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.529942+0000","last_change":"2023-10-06T11:18:52.528495+0000","last_active":"2023-10-06T11:18:52.529942+0000","last_peered":"2023-10-06T11:18:52.529942+0000","last_clean":"2023-10-06T11:18:52.529942+0000","last_became_active":"2023-10-06T11:18:52.527102+0000","last_became_peered":"2023-10-06T11:18:52.527102+0000","last_unstale":"2023-10-06T11:18:52.529942+0000","last_undegraded":"2023-10-06T11:18:52.529942+0000","last_fullsized":"2023-10-06T11:18:52.529942+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:35:59.938547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.511723+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:09:34.925925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.503126+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:30.662720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.508679+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:49:38.496675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2f","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.530289+0000","last_change":"2023-10-06T11:18:52.529748+0000","last_active":"2023-10-06T11:18:52.530289+0000","last_peered":"2023-10-06T11:18:52.530289+0000","last_clean":"2023-10-06T11:18:52.530289+0000","last_became_active":"2023-10-06T11:18:52.529502+0000","last_became_peered":"2023-10-06T11:18:52.529502+0000","last_unstale":"2023-10-06T11:18:52.530289+0000","last_undegraded":"2023-10-06T11:18:52.530289+0000","last_fullsized":"2023-10-06T11:18:52.530289+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:42.526347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2e","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.521093+0000","last_change":"2023-10-06T11:18:52.517211+0000","last_active":"2023-10-06T11:18:52.521093+0000","last_peered":"2023-10-06T11:18:52.521093+0000","last_clean":"2023-10-06T11:18:52.521093+0000","last_became_active":"2023-10-06T11:18:52.516783+0000","last_became_peered":"2023-10-06T11:18:52.516783+0000","last_unstale":"2023-10-06T11:18:52.521093+0000","last_undegraded":"2023-10-06T11:18:52.521093+0000","last_fullsized":"2023-10-06T11:18:52.521093+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:43:22.330867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.510774+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:43:55.311129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.511555+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:29:13.769278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.516145+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:11:36.554686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.511245+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:19:53.986592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.29","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.518134+0000","last_change":"2023-10-06T11:18:52.514449+0000","last_active":"2023-10-06T11:18:52.518134+0000","last_peered":"2023-10-06T11:18:52.518134+0000","last_clean":"2023-10-06T11:18:52.518134+0000","last_became_active":"2023-10-06T11:18:52.514204+0000","last_became_peered":"2023-10-06T11:18:52.514204+0000","last_unstale":"2023-10-06T11:18:52.518134+0000","last_undegraded":"2023-10-06T11:18:52.518134+0000","last_fullsized":"2023-10-06T11:18:52.518134+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:09.427108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.28","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.517721+0000","last_change":"2023-10-06T11:18:52.513586+0000","last_active":"2023-10-06T11:18:52.517721+0000","last_peered":"2023-10-06T11:18:52.517721+0000","last_clean":"2023-10-06T11:18:52.517721+0000","last_became_active":"2023-10-06T11:18:52.513308+0000","last_became_peered":"2023-10-06T11:18:52.513308+0000","last_unstale":"2023-10-06T11:18:52.517721+0000","last_undegraded":"2023-10-06T11:18:52.517721+0000","last_fullsized":"2023-10-06T11:18:52.517721+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:01:40.802704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.27","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.521607+0000","last_change":"2023-10-06T11:18:52.519560+0000","last_active":"2023-10-06T11:18:52.521607+0000","last_peered":"2023-10-06T11:18:52.521607+0000","last_clean":"2023-10-06T11:18:52.521607+0000","last_became_active":"2023-10-06T11:18:52.519291+0000","last_became_peered":"2023-10-06T11:18:52.519291+0000","last_unstale":"2023-10-06T11:18:52.521607+0000","last_undegraded":"2023-10-06T11:18:52.521607+0000","last_fullsized":"2023-10-06T11:18:52.521607+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:11.271696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.26","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.526063+0000","last_change":"2023-10-06T11:18:52.523407+0000","last_active":"2023-10-06T11:18:52.526063+0000","last_peered":"2023-10-06T11:18:52.526063+0000","last_clean":"2023-10-06T11:18:52.526063+0000","last_became_active":"2023-10-06T11:18:52.523116+0000","last_became_peered":"2023-10-06T11:18:52.523116+0000","last_unstale":"2023-10-06T11:18:52.526063+0000","last_undegraded":"2023-10-06T11:18:52.526063+0000","last_fullsized":"2023-10-06T11:18:52.526063+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:47:20.331088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.510274+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:12:58.152151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.24","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.534203+0000","last_change":"2023-10-06T11:18:52.530918+0000","last_active":"2023-10-06T11:18:52.534203+0000","last_peered":"2023-10-06T11:18:52.534203+0000","last_clean":"2023-10-06T11:18:52.534203+0000","last_became_active":"2023-10-06T11:18:52.530443+0000","last_became_peered":"2023-10-06T11:18:52.530443+0000","last_unstale":"2023-10-06T11:18:52.534203+0000","last_undegraded":"2023-10-06T11:18:52.534203+0000","last_fullsized":"2023-10-06T11:18:52.534203+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:30:38.275296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.23","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.521625+0000","last_change":"2023-10-06T11:18:52.519002+0000","last_active":"2023-10-06T11:18:52.521625+0000","last_peered":"2023-10-06T11:18:52.521625+0000","last_clean":"2023-10-06T11:18:52.521625+0000","last_became_active":"2023-10-06T11:18:52.518747+0000","last_became_peered":"2023-10-06T11:18:52.518747+0000","last_unstale":"2023-10-06T11:18:52.521625+0000","last_undegraded":"2023-10-06T11:18:52.521625+0000","last_fullsized":"2023-10-06T11:18:52.521625+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:42:02.837596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.503627+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:47:32.386139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.21","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.528665+0000","last_change":"2023-10-06T11:18:52.526500+0000","last_active":"2023-10-06T11:18:52.528665+0000","last_peered":"2023-10-06T11:18:52.528665+0000","last_clean":"2023-10-06T11:18:52.528665+0000","last_became_active":"2023-10-06T11:18:52.526263+0000","last_became_peered":"2023-10-06T11:18:52.526263+0000","last_unstale":"2023-10-06T11:18:52.528665+0000","last_undegraded":"2023-10-06T11:18:52.528665+0000","last_fullsized":"2023-10-06T11:18:52.528665+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:22.963604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.20","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.533540+0000","last_change":"2023-10-06T11:18:52.532931+0000","last_active":"2023-10-06T11:18:52.533540+0000","last_peered":"2023-10-06T11:18:52.533540+0000","last_clean":"2023-10-06T11:18:52.533540+0000","last_became_active":"2023-10-06T11:18:52.532669+0000","last_became_peered":"2023-10-06T11:18:52.532669+0000","last_unstale":"2023-10-06T11:18:52.533540+0000","last_undegraded":"2023-10-06T11:18:52.533540+0000","last_fullsized":"2023-10-06T11:18:52.533540+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:01:34.361494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.502870+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:40:38.219266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.510586+0000","last_change":"2023-10-06T11:18:51.518695+0000","last_active":"2023-10-06T11:18:52.510586+0000","last_peered":"2023-10-06T11:18:52.510586+0000","last_clean":"2023-10-06T11:18:52.510586+0000","last_became_active":"2023-10-06T11:18:51.518428+0000","last_became_peered":"2023-10-06T11:18:51.518428+0000","last_unstale":"2023-10-06T11:18:52.510586+0000","last_undegraded":"2023-10-06T11:18:52.510586+0000","last_fullsized":"2023-10-06T11:18:52.510586+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:43:54.622904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.508575+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:19:32.976623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.517662+0000","last_change":"2023-10-06T11:18:51.518871+0000","last_active":"2023-10-06T11:18:52.517662+0000","last_peered":"2023-10-06T11:18:52.517662+0000","last_clean":"2023-10-06T11:18:52.517662+0000","last_became_active":"2023-10-06T11:18:51.518328+0000","last_became_peered":"2023-10-06T11:18:51.518328+0000","last_unstale":"2023-10-06T11:18:52.517662+0000","last_undegraded":"2023-10-06T11:18:52.517662+0000","last_fullsized":"2023-10-06T11:18:52.517662+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:14.192741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.517746+0000","last_change":"2023-10-06T11:18:52.514691+0000","last_active":"2023-10-06T11:18:52.517746+0000","last_peered":"2023-10-06T11:18:52.517746+0000","last_clean":"2023-10-06T11:18:52.517746+0000","last_became_active":"2023-10-06T11:18:52.514448+0000","last_became_peered":"2023-10-06T11:18:52.514448+0000","last_unstale":"2023-10-06T11:18:52.517746+0000","last_undegraded":"2023-10-06T11:18:52.517746+0000","last_fullsized":"2023-10-06T11:18:52.517746+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:44:53.142370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.15","version":"176'3","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.522165+0000","last_change":"2023-10-06T11:18:51.507987+0000","last_active":"2023-10-06T11:18:52.522165+0000","last_peered":"2023-10-06T11:18:52.522165+0000","last_clean":"2023-10-06T11:18:52.522165+0000","last_became_active":"2023-10-06T11:18:51.507722+0000","last_became_peered":"2023-10-06T11:18:51.507722+0000","last_unstale":"2023-10-06T11:18:52.522165+0000","last_undegraded":"2023-10-06T11:18:52.522165+0000","last_fullsized":"2023-10-06T11:18:52.522165+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:11:46.485112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.525099+0000","last_change":"2023-10-06T11:18:52.524105+0000","last_active":"2023-10-06T11:18:52.525099+0000","last_peered":"2023-10-06T11:18:52.525099+0000","last_clean":"2023-10-06T11:18:52.525099+0000","last_became_active":"2023-10-06T11:18:52.523872+0000","last_became_peered":"2023-10-06T11:18:52.523872+0000","last_unstale":"2023-10-06T11:18:52.525099+0000","last_undegraded":"2023-10-06T11:18:52.525099+0000","last_fullsized":"2023-10-06T11:18:52.525099+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:49:26.082334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.14","version":"176'6","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.534883+0000","last_change":"2023-10-06T11:18:51.522857+0000","last_active":"2023-10-06T11:18:52.534883+0000","last_peered":"2023-10-06T11:18:52.534883+0000","last_clean":"2023-10-06T11:18:52.534883+0000","last_became_active":"2023-10-06T11:18:51.522595+0000","last_became_peered":"2023-10-06T11:18:51.522595+0000","last_unstale":"2023-10-06T11:18:52.534883+0000","last_undegraded":"2023-10-06T11:18:52.534883+0000","last_fullsized":"2023-10-06T11:18:52.534883+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:29.658549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.518431+0000","last_change":"2023-10-06T11:18:52.513711+0000","last_active":"2023-10-06T11:18:52.518431+0000","last_peered":"2023-10-06T11:18:52.518431+0000","last_clean":"2023-10-06T11:18:52.518431+0000","last_became_active":"2023-10-06T11:18:52.513450+0000","last_became_peered":"2023-10-06T11:18:52.513450+0000","last_unstale":"2023-10-06T11:18:52.518431+0000","last_undegraded":"2023-10-06T11:18:52.518431+0000","last_fullsized":"2023-10-06T11:18:52.518431+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:23:53.875461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.13","version":"176'2","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.521993+0000","last_change":"2023-10-06T11:18:51.516937+0000","last_active":"2023-10-06T11:18:52.521993+0000","last_peered":"2023-10-06T11:18:52.521993+0000","last_clean":"2023-10-06T11:18:52.521993+0000","last_became_active":"2023-10-06T11:18:51.516091+0000","last_became_peered":"2023-10-06T11:18:51.516091+0000","last_unstale":"2023-10-06T11:18:52.521993+0000","last_undegraded":"2023-10-06T11:18:52.521993+0000","last_fullsized":"2023-10-06T11:18:52.521993+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:40:00.076411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.507984+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:32:33.004446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-06T11:18:51.520772+0000","last_change":"2023-10-06T11:18:51.520772+0000","last_active":"2023-10-06T11:18:51.520772+0000","last_peered":"2023-10-06T11:18:51.520772+0000","last_clean":"2023-10-06T11:18:51.520772+0000","last_became_active":"2023-10-06T11:18:51.520462+0000","last_became_peered":"2023-10-06T11:18:51.520462+0000","last_unstale":"2023-10-06T11:18:51.520772+0000","last_undegraded":"2023-10-06T11:18:51.520772+0000","last_fullsized":"2023-10-06T11:18:51.520772+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:47:19.326917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.518475+0000","last_change":"2023-10-06T11:18:52.517027+0000","last_active":"2023-10-06T11:18:52.518475+0000","last_peered":"2023-10-06T11:18:52.518475+0000","last_clean":"2023-10-06T11:18:52.518475+0000","last_became_active":"2023-10-06T11:18:52.516444+0000","last_became_peered":"2023-10-06T11:18:52.516444+0000","last_unstale":"2023-10-06T11:18:52.518475+0000","last_undegraded":"2023-10-06T11:18:52.518475+0000","last_fullsized":"2023-10-06T11:18:52.518475+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:33:52.221626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.510008+0000","last_change":"2023-10-06T11:18:51.509346+0000","last_active":"2023-10-06T11:18:52.510008+0000","last_peered":"2023-10-06T11:18:52.510008+0000","last_clean":"2023-10-06T11:18:52.510008+0000","last_became_active":"2023-10-06T11:18:51.509056+0000","last_became_peered":"2023-10-06T11:18:51.509056+0000","last_unstale":"2023-10-06T11:18:52.510008+0000","last_undegraded":"2023-10-06T11:18:52.510008+0000","last_fullsized":"2023-10-06T11:18:52.510008+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:04.109678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.528375+0000","last_change":"2023-10-06T11:18:52.525692+0000","last_active":"2023-10-06T11:18:52.528375+0000","last_peered":"2023-10-06T11:18:52.528375+0000","last_clean":"2023-10-06T11:18:52.528375+0000","last_became_active":"2023-10-06T11:18:52.525420+0000","last_became_peered":"2023-10-06T11:18:52.525420+0000","last_unstale":"2023-10-06T11:18:52.528375+0000","last_undegraded":"2023-10-06T11:18:52.528375+0000","last_fullsized":"2023-10-06T11:18:52.528375+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:25:25.661614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.10","version":"176'8","reported_seq":18,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.531756+0000","last_change":"2023-10-06T11:18:51.518675+0000","last_active":"2023-10-06T11:18:52.531756+0000","last_peered":"2023-10-06T11:18:52.531756+0000","last_clean":"2023-10-06T11:18:52.531756+0000","last_became_active":"2023-10-06T11:18:51.518355+0000","last_became_peered":"2023-10-06T11:18:51.518355+0000","last_unstale":"2023-10-06T11:18:52.531756+0000","last_undegraded":"2023-10-06T11:18:52.531756+0000","last_fullsized":"2023-10-06T11:18:52.531756+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:18:28.122040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.512690+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:20:06.857224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.f","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.520341+0000","last_change":"2023-10-06T11:18:51.509974+0000","last_active":"2023-10-06T11:18:52.520341+0000","last_peered":"2023-10-06T11:18:52.520341+0000","last_clean":"2023-10-06T11:18:52.520341+0000","last_became_active":"2023-10-06T11:18:51.508881+0000","last_became_peered":"2023-10-06T11:18:51.508881+0000","last_unstale":"2023-10-06T11:18:52.520341+0000","last_undegraded":"2023-10-06T11:18:52.520341+0000","last_fullsized":"2023-10-06T11:18:52.520341+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:01:42.688601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.526578+0000","last_change":"2023-10-06T11:18:52.524019+0000","last_active":"2023-10-06T11:18:52.526578+0000","last_peered":"2023-10-06T11:18:52.526578+0000","last_clean":"2023-10-06T11:18:52.526578+0000","last_became_active":"2023-10-06T11:18:52.523773+0000","last_became_peered":"2023-10-06T11:18:52.523773+0000","last_unstale":"2023-10-06T11:18:52.526578+0000","last_undegraded":"2023-10-06T11:18:52.526578+0000","last_fullsized":"2023-10-06T11:18:52.526578+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:50:12.399641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.e","version":"176'2","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.528784+0000","last_change":"2023-10-06T11:18:51.516814+0000","last_active":"2023-10-06T11:18:52.528784+0000","last_peered":"2023-10-06T11:18:52.528784+0000","last_clean":"2023-10-06T11:18:52.528784+0000","last_became_active":"2023-10-06T11:18:51.516327+0000","last_became_peered":"2023-10-06T11:18:51.516327+0000","last_unstale":"2023-10-06T11:18:52.528784+0000","last_undegraded":"2023-10-06T11:18:52.528784+0000","last_fullsized":"2023-10-06T11:18:52.528784+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:18:11.844126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.523679+0000","last_change":"2023-10-06T11:18:52.515910+0000","last_active":"2023-10-06T11:18:52.523679+0000","last_peered":"2023-10-06T11:18:52.523679+0000","last_clean":"2023-10-06T11:18:52.523679+0000","last_became_active":"2023-10-06T11:18:52.515568+0000","last_became_peered":"2023-10-06T11:18:52.515568+0000","last_unstale":"2023-10-06T11:18:52.523679+0000","last_undegraded":"2023-10-06T11:18:52.523679+0000","last_fullsized":"2023-10-06T11:18:52.523679+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:15.196912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.d","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.528525+0000","last_change":"2023-10-06T11:18:51.516723+0000","last_active":"2023-10-06T11:18:52.528525+0000","last_peered":"2023-10-06T11:18:52.528525+0000","last_clean":"2023-10-06T11:18:52.528525+0000","last_became_active":"2023-10-06T11:18:51.516436+0000","last_became_peered":"2023-10-06T11:18:51.516436+0000","last_unstale":"2023-10-06T11:18:52.528525+0000","last_undegraded":"2023-10-06T11:18:52.528525+0000","last_fullsized":"2023-10-06T11:18:52.528525+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:29:51.407315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.515476+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:50:45.910135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.510647+0000","last_change":"2023-10-06T11:18:51.516285+0000","last_active":"2023-10-06T11:18:52.510647+0000","last_peered":"2023-10-06T11:18:52.510647+0000","last_clean":"2023-10-06T11:18:52.510647+0000","last_became_active":"2023-10-06T11:18:51.515952+0000","last_became_peered":"2023-10-06T11:18:51.515952+0000","last_unstale":"2023-10-06T11:18:52.510647+0000","last_undegraded":"2023-10-06T11:18:52.510647+0000","last_fullsized":"2023-10-06T11:18:52.510647+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:59:11.858550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.531211+0000","last_change":"2023-10-06T11:18:52.530819+0000","last_active":"2023-10-06T11:18:52.531211+0000","last_peered":"2023-10-06T11:18:52.531211+0000","last_clean":"2023-10-06T11:18:52.531211+0000","last_became_active":"2023-10-06T11:18:52.530572+0000","last_became_peered":"2023-10-06T11:18:52.530572+0000","last_unstale":"2023-10-06T11:18:52.531211+0000","last_undegraded":"2023-10-06T11:18:52.531211+0000","last_fullsized":"2023-10-06T11:18:52.531211+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:05.113850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"176'2","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.520923+0000","last_change":"2023-10-06T11:18:51.514639+0000","last_active":"2023-10-06T11:18:52.520923+0000","last_peered":"2023-10-06T11:18:52.520923+0000","last_clean":"2023-10-06T11:18:52.520923+0000","last_became_active":"2023-10-06T11:18:51.514262+0000","last_became_peered":"2023-10-06T11:18:51.514262+0000","last_unstale":"2023-10-06T11:18:52.520923+0000","last_undegraded":"2023-10-06T11:18:52.520923+0000","last_fullsized":"2023-10-06T11:18:52.520923+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:14:22.348361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.528442+0000","last_change":"2023-10-06T11:18:52.526104+0000","last_active":"2023-10-06T11:18:52.528442+0000","last_peered":"2023-10-06T11:18:52.528442+0000","last_clean":"2023-10-06T11:18:52.528442+0000","last_became_active":"2023-10-06T11:18:52.525432+0000","last_became_peered":"2023-10-06T11:18:52.525432+0000","last_unstale":"2023-10-06T11:18:52.528442+0000","last_undegraded":"2023-10-06T11:18:52.528442+0000","last_fullsized":"2023-10-06T11:18:52.528442+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:45:44.869903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.507473+0000","last_change":"2023-10-06T11:18:51.515349+0000","last_active":"2023-10-06T11:18:52.507473+0000","last_peered":"2023-10-06T11:18:52.507473+0000","last_clean":"2023-10-06T11:18:52.507473+0000","last_became_active":"2023-10-06T11:18:51.515067+0000","last_became_peered":"2023-10-06T11:18:51.515067+0000","last_unstale":"2023-10-06T11:18:52.507473+0000","last_undegraded":"2023-10-06T11:18:52.507473+0000","last_fullsized":"2023-10-06T11:18:52.507473+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:52.149123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.526638+0000","last_change":"2023-10-06T11:18:52.525862+0000","last_active":"2023-10-06T11:18:52.526638+0000","last_peered":"2023-10-06T11:18:52.526638+0000","last_clean":"2023-10-06T11:18:52.526638+0000","last_became_active":"2023-10-06T11:18:52.525576+0000","last_became_peered":"2023-10-06T11:18:52.525576+0000","last_unstale":"2023-10-06T11:18:52.526638+0000","last_undegraded":"2023-10-06T11:18:52.526638+0000","last_fullsized":"2023-10-06T11:18:52.526638+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:01.681875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-06T11:18:51.518577+0000","last_change":"2023-10-06T11:18:51.518577+0000","last_active":"2023-10-06T11:18:51.518577+0000","last_peered":"2023-10-06T11:18:51.518577+0000","last_clean":"2023-10-06T11:18:51.518577+0000","last_became_active":"2023-10-06T11:18:51.518267+0000","last_became_peered":"2023-10-06T11:18:51.518267+0000","last_unstale":"2023-10-06T11:18:51.518577+0000","last_undegraded":"2023-10-06T11:18:51.518577+0000","last_fullsized":"2023-10-06T11:18:51.518577+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:12:04.967138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.511802+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:00:15.358532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.505664+0000","last_change":"2023-10-06T11:18:51.509721+0000","last_active":"2023-10-06T11:18:52.505664+0000","last_peered":"2023-10-06T11:18:52.505664+0000","last_clean":"2023-10-06T11:18:52.505664+0000","last_became_active":"2023-10-06T11:18:51.509467+0000","last_became_peered":"2023-10-06T11:18:51.509467+0000","last_unstale":"2023-10-06T11:18:52.505664+0000","last_undegraded":"2023-10-06T11:18:52.505664+0000","last_fullsized":"2023-10-06T11:18:52.505664+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:52:05.527948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.512226+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:31:14.739928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.7","version":"176'2","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.529445+0000","last_change":"2023-10-06T11:18:51.519737+0000","last_active":"2023-10-06T11:18:52.529445+0000","last_peered":"2023-10-06T11:18:52.529445+0000","last_clean":"2023-10-06T11:18:52.529445+0000","last_became_active":"2023-10-06T11:18:51.519441+0000","last_became_peered":"2023-10-06T11:18:51.519441+0000","last_unstale":"2023-10-06T11:18:52.529445+0000","last_undegraded":"2023-10-06T11:18:52.529445+0000","last_fullsized":"2023-10-06T11:18:52.529445+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:59:16.598721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.507932+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:56:53.432751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-06T11:18:51.515072+0000","last_change":"2023-10-06T11:18:51.515072+0000","last_active":"2023-10-06T11:18:51.515072+0000","last_peered":"2023-10-06T11:18:51.515072+0000","last_clean":"2023-10-06T11:18:51.515072+0000","last_became_active":"2023-10-06T11:18:51.514821+0000","last_became_peered":"2023-10-06T11:18:51.514821+0000","last_unstale":"2023-10-06T11:18:51.515072+0000","last_undegraded":"2023-10-06T11:18:51.515072+0000","last_fullsized":"2023-10-06T11:18:51.515072+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:36:18.839256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.520421+0000","last_change":"2023-10-06T11:18:52.517301+0000","last_active":"2023-10-06T11:18:52.520421+0000","last_peered":"2023-10-06T11:18:52.520421+0000","last_clean":"2023-10-06T11:18:52.520421+0000","last_became_active":"2023-10-06T11:18:52.517017+0000","last_became_peered":"2023-10-06T11:18:52.517017+0000","last_unstale":"2023-10-06T11:18:52.520421+0000","last_undegraded":"2023-10-06T11:18:52.520421+0000","last_fullsized":"2023-10-06T11:18:52.520421+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:04:32.334758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-06T11:18:51.519403+0000","last_change":"2023-10-06T11:18:51.519403+0000","last_active":"2023-10-06T11:18:51.519403+0000","last_peered":"2023-10-06T11:18:51.519403+0000","last_clean":"2023-10-06T11:18:51.519403+0000","last_became_active":"2023-10-06T11:18:51.519130+0000","last_became_peered":"2023-10-06T11:18:51.519130+0000","last_unstale":"2023-10-06T11:18:51.519403+0000","last_undegraded":"2023-10-06T11:18:51.519403+0000","last_fullsized":"2023-10-06T11:18:51.519403+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:18:11.844126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.524603+0000","last_change":"2023-10-06T11:18:52.522834+0000","last_active":"2023-10-06T11:18:52.524603+0000","last_peered":"2023-10-06T11:18:52.524603+0000","last_clean":"2023-10-06T11:18:52.524603+0000","last_became_active":"2023-10-06T11:18:52.522527+0000","last_became_peered":"2023-10-06T11:18:52.522527+0000","last_unstale":"2023-10-06T11:18:52.524603+0000","last_undegraded":"2023-10-06T11:18:52.524603+0000","last_fullsized":"2023-10-06T11:18:52.524603+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:32:33.004446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.506225+0000","last_change":"2023-10-06T11:18:51.514269+0000","last_active":"2023-10-06T11:18:52.506225+0000","last_peered":"2023-10-06T11:18:52.506225+0000","last_clean":"2023-10-06T11:18:52.506225+0000","last_became_active":"2023-10-06T11:18:51.513894+0000","last_became_peered":"2023-10-06T11:18:51.513894+0000","last_unstale":"2023-10-06T11:18:52.506225+0000","last_undegraded":"2023-10-06T11:18:52.506225+0000","last_fullsized":"2023-10-06T11:18:52.506225+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:24.909538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.510476+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:39:40.994783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-06T11:18:51.521725+0000","last_change":"2023-10-06T11:18:51.521725+0000","last_active":"2023-10-06T11:18:51.521725+0000","last_peered":"2023-10-06T11:18:51.521725+0000","last_clean":"2023-10-06T11:18:51.521725+0000","last_became_active":"2023-10-06T11:18:51.521427+0000","last_became_peered":"2023-10-06T11:18:51.521427+0000","last_unstale":"2023-10-06T11:18:51.521725+0000","last_undegraded":"2023-10-06T11:18:51.521725+0000","last_fullsized":"2023-10-06T11:18:51.521725+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:01.079097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.528463+0000","last_change":"2023-10-06T11:18:52.526293+0000","last_active":"2023-10-06T11:18:52.528463+0000","last_peered":"2023-10-06T11:18:52.528463+0000","last_clean":"2023-10-06T11:18:52.528463+0000","last_became_active":"2023-10-06T11:18:52.525758+0000","last_became_peered":"2023-10-06T11:18:52.525758+0000","last_unstale":"2023-10-06T11:18:52.528463+0000","last_undegraded":"2023-10-06T11:18:52.528463+0000","last_fullsized":"2023-10-06T11:18:52.528463+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:06:33.866195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.510733+0000","last_change":"2023-10-06T11:18:51.509456+0000","last_active":"2023-10-06T11:18:52.510733+0000","last_peered":"2023-10-06T11:18:52.510733+0000","last_clean":"2023-10-06T11:18:52.510733+0000","last_became_active":"2023-10-06T11:18:51.509128+0000","last_became_peered":"2023-10-06T11:18:51.509128+0000","last_unstale":"2023-10-06T11:18:52.510733+0000","last_undegraded":"2023-10-06T11:18:52.510733+0000","last_fullsized":"2023-10-06T11:18:52.510733+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:23:52.871290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.528488+0000","last_change":"2023-10-06T11:18:52.526424+0000","last_active":"2023-10-06T11:18:52.528488+0000","last_peered":"2023-10-06T11:18:52.528488+0000","last_clean":"2023-10-06T11:18:52.528488+0000","last_became_active":"2023-10-06T11:18:52.526147+0000","last_became_peered":"2023-10-06T11:18:52.526147+0000","last_unstale":"2023-10-06T11:18:52.528488+0000","last_undegraded":"2023-10-06T11:18:52.528488+0000","last_fullsized":"2023-10-06T11:18:52.528488+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:19:32.976623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.506921+0000","last_change":"2023-10-06T11:18:51.517756+0000","last_active":"2023-10-06T11:18:52.506921+0000","last_peered":"2023-10-06T11:18:52.506921+0000","last_clean":"2023-10-06T11:18:52.506921+0000","last_became_active":"2023-10-06T11:18:51.517490+0000","last_became_peered":"2023-10-06T11:18:51.517490+0000","last_unstale":"2023-10-06T11:18:52.506921+0000","last_undegraded":"2023-10-06T11:18:52.506921+0000","last_fullsized":"2023-10-06T11:18:52.506921+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:17:09.348316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.509689+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:26:40.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.509694+0000","last_change":"2023-10-06T11:18:51.518706+0000","last_active":"2023-10-06T11:18:52.509694+0000","last_peered":"2023-10-06T11:18:52.509694+0000","last_clean":"2023-10-06T11:18:52.509694+0000","last_became_active":"2023-10-06T11:18:51.518437+0000","last_became_peered":"2023-10-06T11:18:51.518437+0000","last_unstale":"2023-10-06T11:18:52.509694+0000","last_undegraded":"2023-10-06T11:18:52.509694+0000","last_fullsized":"2023-10-06T11:18:52.509694+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:40:30.300613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.519733+0000","last_change":"2023-10-06T11:18:52.516550+0000","last_active":"2023-10-06T11:18:52.519733+0000","last_peered":"2023-10-06T11:18:52.519733+0000","last_clean":"2023-10-06T11:18:52.519733+0000","last_became_active":"2023-10-06T11:18:52.516068+0000","last_became_peered":"2023-10-06T11:18:52.516068+0000","last_unstale":"2023-10-06T11:18:52.519733+0000","last_undegraded":"2023-10-06T11:18:52.519733+0000","last_fullsized":"2023-10-06T11:18:52.519733+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:05:10.941482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-06T11:18:51.518899+0000","last_change":"2023-10-06T11:18:51.518899+0000","last_active":"2023-10-06T11:18:51.518899+0000","last_peered":"2023-10-06T11:18:51.518899+0000","last_clean":"2023-10-06T11:18:51.518899+0000","last_became_active":"2023-10-06T11:18:51.517840+0000","last_became_peered":"2023-10-06T11:18:51.517840+0000","last_unstale":"2023-10-06T11:18:51.518899+0000","last_undegraded":"2023-10-06T11:18:51.518899+0000","last_fullsized":"2023-10-06T11:18:51.518899+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:01:35.577133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":154,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-06T11:18:50.494090+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:18:50.494090+0000","last_peered":"2023-10-06T11:18:50.494090+0000","last_clean":"2023-10-06T11:18:50.494090+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:18:50.494090+0000","last_undegraded":"2023-10-06T11:18:50.494090+0000","last_fullsized":"2023-10-06T11:18:50.494090+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.529460+0000","last_change":"2023-10-06T11:18:52.528455+0000","last_active":"2023-10-06T11:18:52.529460+0000","last_peered":"2023-10-06T11:18:52.529460+0000","last_clean":"2023-10-06T11:18:52.529460+0000","last_became_active":"2023-10-06T11:18:52.528189+0000","last_became_peered":"2023-10-06T11:18:52.528189+0000","last_unstale":"2023-10-06T11:18:52.529460+0000","last_undegraded":"2023-10-06T11:18:52.529460+0000","last_fullsized":"2023-10-06T11:18:52.529460+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:11:39.954034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1e","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.521337+0000","last_change":"2023-10-06T11:18:51.514321+0000","last_active":"2023-10-06T11:18:52.521337+0000","last_peered":"2023-10-06T11:18:52.521337+0000","last_clean":"2023-10-06T11:18:52.521337+0000","last_became_active":"2023-10-06T11:18:51.514016+0000","last_became_peered":"2023-10-06T11:18:51.514016+0000","last_unstale":"2023-10-06T11:18:52.521337+0000","last_undegraded":"2023-10-06T11:18:52.521337+0000","last_fullsized":"2023-10-06T11:18:52.521337+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:10:52.141969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":147,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.510184+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:18:52.510184+0000","last_peered":"2023-10-06T11:18:52.510184+0000","last_clean":"2023-10-06T11:18:52.510184+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:18:52.510184+0000","last_undegraded":"2023-10-06T11:18:52.510184+0000","last_fullsized":"2023-10-06T11:18:52.510184+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.504457+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:15.196912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.514939+0000","last_change":"2023-10-06T11:18:51.518140+0000","last_active":"2023-10-06T11:18:52.514939+0000","last_peered":"2023-10-06T11:18:52.514939+0000","last_clean":"2023-10-06T11:18:52.514939+0000","last_became_active":"2023-10-06T11:18:51.517880+0000","last_became_peered":"2023-10-06T11:18:51.517880+0000","last_unstale":"2023-10-06T11:18:52.514939+0000","last_undegraded":"2023-10-06T11:18:52.514939+0000","last_fullsized":"2023-10-06T11:18:52.514939+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:40:37.215095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":142,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-06T11:18:50.499036+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:18:50.499036+0000","last_peered":"2023-10-06T11:18:50.499036+0000","last_clean":"2023-10-06T11:18:50.499036+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:18:50.499036+0000","last_undegraded":"2023-10-06T11:18:50.499036+0000","last_fullsized":"2023-10-06T11:18:50.499036+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":288,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.514431+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:18:52.514431+0000","last_peered":"2023-10-06T11:18:52.514431+0000","last_clean":"2023-10-06T11:18:52.514431+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:18:52.514431+0000","last_undegraded":"2023-10-06T11:18:52.514431+0000","last_fullsized":"2023-10-06T11:18:52.514431+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.528995+0000","last_change":"2023-10-06T11:18:52.527928+0000","last_active":"2023-10-06T11:18:52.528995+0000","last_peered":"2023-10-06T11:18:52.528995+0000","last_clean":"2023-10-06T11:18:52.528995+0000","last_became_active":"2023-10-06T11:18:52.527674+0000","last_became_peered":"2023-10-06T11:18:52.527674+0000","last_unstale":"2023-10-06T11:18:52.528995+0000","last_undegraded":"2023-10-06T11:18:52.528995+0000","last_fullsized":"2023-10-06T11:18:52.528995+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:21:18.976853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":8,"reported_epoch":175,"state":"active+clean","last_fresh":"2023-10-06T11:18:51.518700+0000","last_change":"2023-10-06T11:18:51.518700+0000","last_active":"2023-10-06T11:18:51.518700+0000","last_peered":"2023-10-06T11:18:51.518700+0000","last_clean":"2023-10-06T11:18:51.518700+0000","last_became_active":"2023-10-06T11:18:51.518426+0000","last_became_peered":"2023-10-06T11:18:51.518426+0000","last_unstale":"2023-10-06T11:18:51.518700+0000","last_undegraded":"2023-10-06T11:18:51.518700+0000","last_fullsized":"2023-10-06T11:18:51.518700+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:50:11.395470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":138,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.514265+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:18:52.514265+0000","last_peered":"2023-10-06T11:18:52.514265+0000","last_clean":"2023-10-06T11:18:52.514265+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:18:52.514265+0000","last_undegraded":"2023-10-06T11:18:52.514265+0000","last_fullsized":"2023-10-06T11:18:52.514265+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.526031+0000","last_change":"2023-10-06T11:18:52.521779+0000","last_active":"2023-10-06T11:18:52.526031+0000","last_peered":"2023-10-06T11:18:52.526031+0000","last_clean":"2023-10-06T11:18:52.526031+0000","last_became_active":"2023-10-06T11:18:52.521521+0000","last_became_peered":"2023-10-06T11:18:52.521521+0000","last_unstale":"2023-10-06T11:18:52.526031+0000","last_undegraded":"2023-10-06T11:18:52.526031+0000","last_fullsized":"2023-10-06T11:18:52.526031+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:47:38.557270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1a","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.519977+0000","last_change":"2023-10-06T11:18:51.516353+0000","last_active":"2023-10-06T11:18:52.519977+0000","last_peered":"2023-10-06T11:18:52.519977+0000","last_clean":"2023-10-06T11:18:52.519977+0000","last_became_active":"2023-10-06T11:18:51.515623+0000","last_became_peered":"2023-10-06T11:18:51.515623+0000","last_unstale":"2023-10-06T11:18:52.519977+0000","last_undegraded":"2023-10-06T11:18:52.519977+0000","last_fullsized":"2023-10-06T11:18:52.519977+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:50:46.250411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":138,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.514503+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:18:52.514503+0000","last_peered":"2023-10-06T11:18:52.514503+0000","last_clean":"2023-10-06T11:18:52.514503+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:18:52.514503+0000","last_undegraded":"2023-10-06T11:18:52.514503+0000","last_fullsized":"2023-10-06T11:18:52.514503+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.502856+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:59.830470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1b","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.532985+0000","last_change":"2023-10-06T11:18:51.521403+0000","last_active":"2023-10-06T11:18:52.532985+0000","last_peered":"2023-10-06T11:18:52.532985+0000","last_clean":"2023-10-06T11:18:52.532985+0000","last_became_active":"2023-10-06T11:18:51.521062+0000","last_became_peered":"2023-10-06T11:18:51.521062+0000","last_unstale":"2023-10-06T11:18:52.532985+0000","last_undegraded":"2023-10-06T11:18:52.532985+0000","last_fullsized":"2023-10-06T11:18:52.532985+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:58.826299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":164,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.506975+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:18:52.506975+0000","last_peered":"2023-10-06T11:18:52.506975+0000","last_clean":"2023-10-06T11:18:52.506975+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:18:52.506975+0000","last_undegraded":"2023-10-06T11:18:52.506975+0000","last_fullsized":"2023-10-06T11:18:52.506975+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.522988+0000","last_change":"2023-10-06T11:18:52.520697+0000","last_active":"2023-10-06T11:18:52.522988+0000","last_peered":"2023-10-06T11:18:52.522988+0000","last_clean":"2023-10-06T11:18:52.522988+0000","last_became_active":"2023-10-06T11:18:52.519884+0000","last_became_peered":"2023-10-06T11:18:52.519884+0000","last_unstale":"2023-10-06T11:18:52.522988+0000","last_undegraded":"2023-10-06T11:18:52.522988+0000","last_fullsized":"2023-10-06T11:18:52.522988+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:03.453023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1c","version":"176'2","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.527840+0000","last_change":"2023-10-06T11:18:51.509607+0000","last_active":"2023-10-06T11:18:52.527840+0000","last_peered":"2023-10-06T11:18:52.527840+0000","last_clean":"2023-10-06T11:18:52.527840+0000","last_became_active":"2023-10-06T11:18:51.509324+0000","last_became_peered":"2023-10-06T11:18:51.509324+0000","last_unstale":"2023-10-06T11:18:52.527840+0000","last_undegraded":"2023-10-06T11:18:52.527840+0000","last_fullsized":"2023-10-06T11:18:52.527840+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:05:09.937311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":143,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-06T11:18:50.496025+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:18:50.496025+0000","last_peered":"2023-10-06T11:18:50.496025+0000","last_clean":"2023-10-06T11:18:50.496025+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:18:50.496025+0000","last_undegraded":"2023-10-06T11:18:50.496025+0000","last_fullsized":"2023-10-06T11:18:50.496025+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-06T11:18:51.490762+0000","last_change":"2023-10-06T11:18:51.508306+0000","last_active":"2023-10-06T11:18:51.490762+0000","last_peered":"2023-10-06T11:18:51.490762+0000","last_clean":"2023-10-06T11:18:51.490762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T11:18:51.490762+0000","last_undegraded":"2023-10-06T11:18:51.490762+0000","last_fullsized":"2023-10-06T11:18:51.490762+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:54:10.845045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1d","version":"176'2","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.523276+0000","last_change":"2023-10-06T11:18:51.517858+0000","last_active":"2023-10-06T11:18:52.523276+0000","last_peered":"2023-10-06T11:18:52.523276+0000","last_clean":"2023-10-06T11:18:52.523276+0000","last_became_active":"2023-10-06T11:18:51.517572+0000","last_became_peered":"2023-10-06T11:18:51.517572+0000","last_unstale":"2023-10-06T11:18:52.523276+0000","last_undegraded":"2023-10-06T11:18:52.523276+0000","last_fullsized":"2023-10-06T11:18:52.523276+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:31:28.442952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":143,"reported_epoch":174,"state":"active+clean","last_fresh":"2023-10-06T11:18:50.496047+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:18:50.496047+0000","last_peered":"2023-10-06T11:18:50.496047+0000","last_clean":"2023-10-06T11:18:50.496047+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:18:50.496047+0000","last_undegraded":"2023-10-06T11:18:50.496047+0000","last_fullsized":"2023-10-06T11:18:50.496047+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":28,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":27,"num_pg":32,"stat_sum":{"num_bytes":1752,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34,"ondisk_log_size":34,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575011,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304160,"kb_used_data":2776,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067680,"statfs":{"total":96636764160,"available":96325304320,"internally_reserved":0,"allocated":2842624,"data_stored":1624928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54400000000000004,"15min":0.629},"min":{"1min":0.35899999999999999,"5min":0.252,"15min":0.21199999999999999},"max":{"1min":0.70999999999999996,"5min":4.407,"15min":23.908999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.52500000000000002,"15min":0.57799999999999996},"min":{"1min":0.38200000000000001,"5min":0.26900000000000002,"15min":0.22500000000000001},"max":{"1min":0.71699999999999997,"5min":0.76800000000000002,"15min":9.3230000000000004},"last":0.47099999999999997}]},{"osd":1,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54500000000000004,"15min":0.55900000000000005},"min":{"1min":0.439,"5min":0.28399999999999997,"15min":0.26000000000000001},"max":{"1min":0.72699999999999998,"5min":2.4689999999999999,"15min":9.2360000000000007},"last":0.379},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.5,"15min":0.505},"min":{"1min":0.373,"5min":0.33100000000000002,"15min":0.25900000000000001},"max":{"1min":0.63900000000000001,"5min":0.70899999999999996,"15min":4.327},"last":0.51000000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56499999999999995,"15min":0.52100000000000002},"min":{"1min":0.379,"5min":0.34399999999999997,"15min":0.26500000000000001},"max":{"1min":0.67000000000000004,"5min":4.3120000000000003,"15min":4.3120000000000003},"last":0.498},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56299999999999994,"15min":0.55800000000000005},"min":{"1min":0.46300000000000002,"5min":0.311,"15min":0.29999999999999999},"max":{"1min":0.65400000000000003,"5min":3.0600000000000001,"15min":4.7309999999999999},"last":0.53300000000000003}]},{"osd":3,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56899999999999995,"15min":0.54500000000000004},"min":{"1min":0.45300000000000001,"5min":0.32600000000000001,"15min":0.27900000000000003},"max":{"1min":0.69899999999999995,"5min":4.5190000000000001,"15min":4.5190000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.44800000000000001,"5min":0.374,"15min":0.29699999999999999},"max":{"1min":0.73199999999999998,"5min":3.0070000000000001,"15min":9.3879999999999999},"last":0.57499999999999996}]},{"osd":4,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.52600000000000002,"15min":0.49299999999999999},"min":{"1min":0.32600000000000001,"5min":0.29799999999999999,"15min":0.24399999999999999},"max":{"1min":0.59099999999999997,"5min":4.6639999999999997,"15min":4.6639999999999997},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.56799999999999995,"15min":0.53500000000000003},"min":{"1min":0.41999999999999998,"5min":0.28499999999999998,"15min":0.27300000000000002},"max":{"1min":0.64700000000000002,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":0.54700000000000004}]},{"osd":5,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.53200000000000003,"15min":0.55700000000000005},"min":{"1min":0.33100000000000002,"5min":0.32900000000000001,"15min":0.26000000000000001},"max":{"1min":0.72399999999999998,"5min":0.77000000000000002,"15min":9.3499999999999996},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.502,"5min":0.52500000000000002,"15min":0.53800000000000003},"min":{"1min":0.371,"5min":0.30099999999999999,"15min":0.26800000000000002},"max":{"1min":0.71399999999999997,"5min":0.89100000000000001,"15min":4.444},"last":0.56100000000000005}]},{"osd":6,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.56699999999999995,"15min":0.59299999999999997},"min":{"1min":0.39500000000000002,"5min":0.38100000000000001,"15min":0.29199999999999998},"max":{"1min":0.68600000000000005,"5min":0.82099999999999995,"15min":9.4969999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.63200000000000001,"15min":0.61899999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.74199999999999999,"5min":4.4669999999999996,"15min":7.2039999999999997},"last":0.621}]}]},{"osd":6,"up_from":13,"seq":55834575012,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299440,"kb_used_data":2152,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072400,"statfs":{"total":96636764160,"available":96330137600,"internally_reserved":0,"allocated":2203648,"data_stored":1017844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.60999999999999999,"15min":0.52700000000000002},"min":{"1min":0.307,"5min":0.247,"15min":0.187},"max":{"1min":0.78300000000000003,"5min":9.5549999999999997,"15min":9.5549999999999997},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.66900000000000004,"15min":0.57299999999999995},"min":{"1min":0.47299999999999998,"5min":0.30399999999999999,"15min":0.254},"max":{"1min":0.81999999999999995,"5min":9.4659999999999993,"15min":9.4659999999999993},"last":0.70399999999999996}]},{"osd":1,"last update":"Fri Oct 6 11:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.497,"15min":0.48699999999999999},"min":{"1min":0.372,"5min":0.27500000000000002,"15min":0.23300000000000001},"max":{"1min":0.71399999999999997,"5min":0.80300000000000005,"15min":0.91700000000000004},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.53200000000000003,"15min":0.52100000000000002},"min":{"1min":0.34599999999999997,"5min":0.32900000000000001,"15min":0.216},"max":{"1min":0.84199999999999997,"5min":2.238,"15min":5.2670000000000003},"last":0.55900000000000005}]},{"osd":2,"last update":"Fri Oct 6 11:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.51000000000000001,"15min":0.50700000000000001},"min":{"1min":0.30199999999999999,"5min":0.255,"15min":0.252},"max":{"1min":0.753,"5min":0.93200000000000005,"15min":7.0659999999999998},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.52100000000000002,"15min":0.52300000000000002},"min":{"1min":0.40300000000000002,"5min":0.32200000000000001,"15min":0.26600000000000001},"max":{"1min":0.77600000000000002,"5min":0.78600000000000003,"15min":7.0819999999999999},"last":0.61199999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57799999999999996,"15min":0.52700000000000002},"min":{"1min":0.39400000000000002,"5min":0.32600000000000001,"15min":0.25800000000000001},"max":{"1min":0.91300000000000003,"5min":3.871,"15min":3.871},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.55200000000000005,"15min":0.53700000000000003},"min":{"1min":0.47199999999999998,"5min":0.32100000000000001,"15min":0.312},"max":{"1min":0.80700000000000005,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.71599999999999997}]},{"osd":4,"last update":"Fri Oct 6 11:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.48399999999999999,"15min":0.47699999999999998},"min":{"1min":0.35899999999999999,"5min":0.26800000000000002,"15min":0.24299999999999999},"max":{"1min":0.72999999999999998,"5min":0.76000000000000001,"15min":0.88},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.54200000000000004,"15min":0.53200000000000003},"min":{"1min":0.38600000000000001,"5min":0.29699999999999999,"15min":0.27900000000000003},"max":{"1min":0.77600000000000002,"5min":0.82399999999999995,"15min":1.0680000000000001},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52700000000000002,"15min":0.51600000000000001},"min":{"1min":0.36599999999999999,"5min":0.32000000000000001,"15min":0.28399999999999997},"max":{"1min":0.69999999999999996,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.63400000000000001,"15min":0.58099999999999996},"min":{"1min":0.42499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.88700000000000001,"5min":7.1379999999999999,"15min":7.1379999999999999},"last":0.69199999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59399999999999997,"15min":0.57099999999999995},"min":{"1min":0.38400000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.83899999999999997,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.59999999999999998,"15min":0.58599999999999997},"min":{"1min":0.40999999999999998,"5min":0.36399999999999999,"15min":0.30199999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.75}]}]},{"osd":1,"up_from":13,"seq":55834575011,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":300024,"kb_used_data":2736,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071816,"statfs":{"total":96636764160,"available":96329539584,"internally_reserved":0,"allocated":2801664,"data_stored":1609565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.47799999999999998,"15min":0.377},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.186},"max":{"1min":0.54000000000000004,"5min":13.393000000000001,"15min":13.393000000000001},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.374,"5min":0.47599999999999998,"15min":0.38800000000000001},"min":{"1min":0.247,"5min":0.22700000000000001,"15min":0.19700000000000001},"max":{"1min":0.52100000000000002,"5min":11.462,"15min":11.462},"last":0.34799999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.41999999999999998,"15min":0.36299999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.216},"max":{"1min":0.56000000000000005,"5min":8.0470000000000006,"15min":8.0470000000000006},"last":0.31},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.45900000000000002,"15min":0.41099999999999998},"min":{"1min":0.27100000000000002,"5min":0.215,"15min":0.20999999999999999},"max":{"1min":0.66700000000000004,"5min":4.8630000000000004,"15min":4.8630000000000004},"last":0.38700000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.47599999999999998,"15min":0.42799999999999999},"min":{"1min":0.311,"5min":0.255,"15min":0.252},"max":{"1min":0.63700000000000001,"5min":4.8029999999999999,"15min":4.8029999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.46100000000000002,"15min":0.40200000000000002},"min":{"1min":0.23799999999999999,"5min":0.23400000000000001,"15min":0.217},"max":{"1min":0.61799999999999999,"5min":5.8700000000000001,"15min":5.8700000000000001},"last":0.42699999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56399999999999995,"15min":0.53200000000000003},"min":{"1min":0.42499999999999999,"5min":0.28299999999999997,"15min":0.28199999999999997},"max":{"1min":0.83099999999999996,"5min":1.264,"15min":1.264},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.64200000000000002,"15min":0.57999999999999996},"min":{"1min":0.46700000000000003,"5min":0.317,"15min":0.317},"max":{"1min":0.85299999999999998,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.52500000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.624,"15min":0.57599999999999996},"min":{"1min":0.432,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.79900000000000004,"5min":3.4390000000000001,"15min":3.4390000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.70799999999999996,"15min":0.60199999999999998},"min":{"1min":0.47599999999999998,"5min":0.36799999999999999,"15min":0.29499999999999998},"max":{"1min":0.92000000000000004,"5min":9.3829999999999991,"15min":9.3829999999999991},"last":0.502}]},{"osd":6,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.66500000000000004,"15min":0.60199999999999998},"min":{"1min":0.47799999999999998,"5min":0.35999999999999999,"15min":0.315},"max":{"1min":0.90800000000000003,"5min":3.4750000000000001,"15min":3.4750000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.66400000000000003,"15min":0.60999999999999999},"min":{"1min":0.45400000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.89700000000000002,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.53800000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68200000000000005,"15min":0.621},"min":{"1min":0.44400000000000001,"5min":0.39800000000000002,"15min":0.38500000000000001},"max":{"1min":0.90300000000000002,"5min":4.7290000000000001,"15min":4.7290000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.64300000000000002,"15min":0.60199999999999998},"min":{"1min":0.47399999999999998,"5min":0.38900000000000001,"15min":0.374},"max":{"1min":0.871,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.57599999999999996}]}]},{"osd":0,"up_from":13,"seq":55834575011,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303564,"kb_used_data":2180,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068276,"statfs":{"total":96636764160,"available":96325914624,"internally_reserved":0,"allocated":2232320,"data_stored":1031691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.34599999999999997,"15min":0.47299999999999998},"min":{"1min":0.23999999999999999,"5min":0.20399999999999999,"15min":0.184},"max":{"1min":0.55500000000000005,"5min":0.60199999999999998,"15min":36.097999999999999},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.36499999999999999,"15min":0.38600000000000001},"min":{"1min":0.26400000000000001,"5min":0.22,"15min":0.182},"max":{"1min":0.51400000000000001,"5min":0.92400000000000004,"15min":7.2990000000000004},"last":0.32300000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.36599999999999999,"15min":0.50600000000000001},"min":{"1min":0.315,"5min":0.223,"15min":0.217},"max":{"1min":0.56100000000000005,"5min":0.61699999999999999,"15min":36.07},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.39400000000000002,"15min":0.41299999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.219},"max":{"1min":0.60799999999999998,"5min":0.94899999999999995,"15min":6.7800000000000002},"last":0.39900000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.36299999999999999,"15min":0.39600000000000002},"min":{"1min":0.28100000000000003,"5min":0.255,"15min":0.223},"max":{"1min":0.504,"5min":0.55000000000000004,"15min":8.4130000000000003},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.42799999999999999,"15min":0.56000000000000005},"min":{"1min":0.28599999999999998,"5min":0.25800000000000001,"15min":0.249},"max":{"1min":0.59099999999999997,"5min":1.9079999999999999,"15min":35.959000000000003},"last":0.373}]},{"osd":4,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.59199999999999997,"15min":0.57299999999999995},"min":{"1min":0.496,"5min":0.33800000000000002,"15min":0.29599999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":2.427},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.60799999999999998,"15min":0.73399999999999999},"min":{"1min":0.496,"5min":0.374,"15min":0.29299999999999998},"max":{"1min":0.91100000000000003,"5min":0.94999999999999996,"15min":36.005000000000003},"last":0.627}]},{"osd":5,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.39400000000000002,"5min":0.38400000000000001,"15min":0.32900000000000001},"max":{"1min":0.86199999999999999,"5min":0.999,"15min":6.6699999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57699999999999996,"15min":0.56299999999999994},"min":{"1min":0.41399999999999998,"5min":0.372,"15min":0.315},"max":{"1min":0.77200000000000002,"5min":0.99399999999999999,"15min":2.0600000000000001},"last":0.61899999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.61299999999999999,"15min":0.73499999999999999},"min":{"1min":0.45800000000000002,"5min":0.39200000000000002,"15min":0.317},"max":{"1min":0.878,"5min":0.98699999999999999,"15min":36.037999999999997},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.63100000000000001,"15min":0.64400000000000002},"min":{"1min":0.45800000000000002,"5min":0.40999999999999998,"15min":0.36399999999999999},"max":{"1min":0.88800000000000001,"5min":1.028,"15min":6.7110000000000003},"last":0.67500000000000004}]},{"osd":7,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.47399999999999998,"5min":0.432,"15min":0.371},"max":{"1min":0.80400000000000005,"5min":1.054,"15min":6.742},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.58799999999999997,"15min":0.57799999999999996},"min":{"1min":0.46200000000000002,"5min":0.41399999999999998,"15min":0.34499999999999997},"max":{"1min":0.89300000000000002,"5min":0.96199999999999997,"15min":1.917},"last":0.56799999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575012,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299468,"kb_used_data":2180,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072372,"statfs":{"total":96636764160,"available":96330108928,"internally_reserved":0,"allocated":2232320,"data_stored":1031691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.47499999999999998,"15min":0.36599999999999999},"min":{"1min":0.24399999999999999,"5min":0.214,"15min":0.17999999999999999},"max":{"1min":0.622,"5min":15.228,"15min":15.228},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.40699999999999997,"15min":0.39200000000000002},"min":{"1min":0.32000000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.72599999999999998,"5min":1.714,"15min":1.714},"last":0.30199999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.379,"15min":0.376},"min":{"1min":0.253,"5min":0.23599999999999999,"15min":0.19900000000000001},"max":{"1min":0.56999999999999995,"5min":0.57499999999999996,"15min":0.745},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.36599999999999999,"15min":0.35699999999999998},"min":{"1min":0.26000000000000001,"5min":0.23200000000000001,"15min":0.216},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.246}]},{"osd":3,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.36699999999999999,"15min":0.36899999999999999},"min":{"1min":0.27000000000000002,"5min":0.23699999999999999,"15min":0.23200000000000001},"max":{"1min":0.60899999999999999,"5min":0.621,"15min":0.629},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.38800000000000001,"15min":0.371},"min":{"1min":0.29499999999999998,"5min":0.254,"15min":0.251},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.28299999999999997}]},{"osd":4,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54500000000000004,"15min":0.53400000000000003},"min":{"1min":0.439,"5min":0.30599999999999999,"15min":0.30299999999999999},"max":{"1min":0.69699999999999995,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.68799999999999994,"15min":0.59399999999999997},"min":{"1min":0.374,"5min":0.28199999999999997,"15min":0.27900000000000003},"max":{"1min":0.70999999999999996,"5min":15.26,"15min":15.26},"last":0.68000000000000005}]},{"osd":5,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.69799999999999995,"15min":0.59599999999999997},"min":{"1min":0.39700000000000002,"5min":0.35799999999999998,"15min":0.32400000000000001},"max":{"1min":0.73699999999999999,"5min":15.186,"15min":15.186},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56799999999999995,"15min":0.56100000000000005},"min":{"1min":0.42999999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72199999999999998,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.71099999999999997}]},{"osd":6,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59299999999999997,"15min":0.58599999999999997},"min":{"1min":0.48299999999999998,"5min":0.38200000000000001,"15min":0.32600000000000001},"max":{"1min":0.76900000000000002,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59599999999999997,"15min":0.57999999999999996},"min":{"1min":0.438,"5min":0.40699999999999997,"15min":0.34200000000000003},"max":{"1min":0.80500000000000005,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.68899999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.67300000000000004,"15min":0.59999999999999998},"min":{"1min":0.41699999999999998,"5min":0.37,"15min":0.34499999999999997},"max":{"1min":0.69399999999999995,"5min":10.977,"15min":10.977},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57799999999999996,"15min":0.57399999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.38200000000000001},"max":{"1min":0.79400000000000004,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.50700000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575012,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311764,"kb_used_data":2188,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060076,"statfs":{"total":96636764160,"available":96317517824,"internally_reserved":0,"allocated":2240512,"data_stored":1031727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.34799999999999998,"15min":0.32800000000000001},"min":{"1min":0.20799999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.55200000000000005,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.41999999999999998,"15min":0.39100000000000001},"min":{"1min":0.26800000000000002,"5min":0.23000000000000001,"15min":0.22700000000000001},"max":{"1min":0.61099999999999999,"5min":4.4820000000000002,"15min":4.4820000000000002},"last":0.28999999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.32100000000000001,"15min":0.315},"min":{"1min":0.22800000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.48199999999999998,"5min":0.54000000000000004,"15min":0.65400000000000003},"last":0.247},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.36499999999999999,"15min":0.35799999999999998},"min":{"1min":0.28899999999999998,"5min":0.254,"15min":0.188},"max":{"1min":0.52300000000000002,"5min":0.53600000000000003,"15min":1.196},"last":0.27200000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.39900000000000002,"15min":0.38200000000000001},"min":{"1min":0.25,"5min":0.245,"15min":0.19600000000000001},"max":{"1min":0.52100000000000002,"5min":4.601,"15min":4.601},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.44400000000000001,"15min":0.41999999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.26100000000000001},"max":{"1min":0.60599999999999998,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.33500000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55300000000000005,"15min":0.54700000000000004},"min":{"1min":0.38800000000000001,"5min":0.32100000000000001,"15min":0.311},"max":{"1min":0.76500000000000001,"5min":0.88500000000000001,"15min":1.694},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55500000000000005,"15min":0.54200000000000004},"min":{"1min":0.438,"5min":0.32600000000000001,"15min":0.30199999999999999},"max":{"1min":0.71699999999999997,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.63900000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.55800000000000005,"15min":0.54100000000000004},"min":{"1min":0.42199999999999999,"5min":0.34100000000000003,"15min":0.29399999999999998},"max":{"1min":0.83999999999999997,"5min":0.86399999999999999,"15min":0.878},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.56200000000000006,"15min":0.55600000000000005},"min":{"1min":0.40899999999999997,"5min":0.35699999999999998,"15min":0.29699999999999999},"max":{"1min":0.877,"5min":0.877,"15min":1.165},"last":0.625}]},{"osd":6,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.59499999999999997,"15min":0.58099999999999996},"min":{"1min":0.501,"5min":0.372,"15min":0.36699999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":1.1359999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.58999999999999997,"15min":0.58699999999999997},"min":{"1min":0.45500000000000002,"5min":0.36799999999999999,"15min":0.34399999999999997},"max":{"1min":0.80600000000000005,"5min":0.82999999999999996,"15min":1.7470000000000001},"last":0.82499999999999996}]},{"osd":7,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.57499999999999996,"15min":0.57599999999999996},"min":{"1min":0.41599999999999998,"5min":0.38900000000000001,"15min":0.35599999999999998},"max":{"1min":0.79300000000000004,"5min":0.89900000000000002,"15min":1.657},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.628,"5min":0.58699999999999997,"15min":0.57599999999999996},"min":{"1min":0.46300000000000002,"5min":0.38,"15min":0.35499999999999998},"max":{"1min":0.86199999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.68999999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575010,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307636,"kb_used_data":2156,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064204,"statfs":{"total":96636764160,"available":96321744896,"internally_reserved":0,"allocated":2207744,"data_stored":1019197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.47899999999999998,"15min":0.50700000000000001},"min":{"1min":0.24199999999999999,"5min":0.216,"15min":0.19500000000000001},"max":{"1min":0.68700000000000006,"5min":0.82099999999999995,"15min":2.6619999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.499,"15min":0.49399999999999999},"min":{"1min":0.28899999999999998,"5min":0.224,"15min":0.215},"max":{"1min":0.76200000000000001,"5min":0.81499999999999995,"15min":0.91200000000000003},"last":0.40100000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.50700000000000001,"15min":0.53000000000000003},"min":{"1min":0.308,"5min":0.27300000000000002,"15min":0.23300000000000001},"max":{"1min":0.77300000000000002,"5min":1,"15min":2.8650000000000002},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.505,"15min":0.53500000000000003},"min":{"1min":0.35299999999999998,"5min":0.27000000000000002,"15min":0.25800000000000001},"max":{"1min":0.79800000000000004,"5min":1.2869999999999999,"15min":2.7610000000000001},"last":0.49299999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.52900000000000003,"15min":0.53000000000000003},"min":{"1min":0.44500000000000001,"5min":0.28499999999999998,"15min":0.23100000000000001},"max":{"1min":0.70399999999999996,"5min":0.77400000000000002,"15min":1.6910000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56699999999999995,"15min":0.57699999999999996},"min":{"1min":0.44800000000000001,"5min":0.33100000000000002,"15min":0.30599999999999999},"max":{"1min":0.82099999999999995,"5min":0.82799999999999996,"15min":1.718},"last":0.60599999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.57399999999999995,"15min":0.57799999999999996},"min":{"1min":0.38800000000000001,"5min":0.32000000000000001,"15min":0.26700000000000002},"max":{"1min":0.67500000000000004,"5min":2.387,"15min":2.677},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.54600000000000004,"15min":0.52800000000000002},"min":{"1min":0.40100000000000002,"5min":0.29299999999999998,"15min":0.27500000000000002},"max":{"1min":0.77700000000000002,"5min":1.784,"15min":1.784},"last":0.54300000000000004}]},{"osd":5,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47799999999999998,"15min":0.47999999999999998},"min":{"1min":0.36499999999999999,"5min":0.28499999999999998,"15min":0.23200000000000001},"max":{"1min":0.60299999999999998,"5min":0.73199999999999998,"15min":0.80200000000000005},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.51700000000000002,"15min":0.52300000000000002},"min":{"1min":0.317,"5min":0.28899999999999998,"15min":0.28399999999999997},"max":{"1min":0.752,"5min":0.752,"15min":0.82799999999999996},"last":0.64400000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.252},"max":{"1min":0.79500000000000004,"5min":0.83499999999999996,"15min":0.89000000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54500000000000004,"15min":0.55400000000000005},"min":{"1min":0.38700000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.72899999999999998,"5min":0.80200000000000005,"15min":1.165},"last":0.69599999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55300000000000005,"15min":0.55700000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.71199999999999997,"5min":0.84999999999999998,"15min":0.90500000000000003},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58499999999999996,"15min":0.58899999999999997},"min":{"1min":0.34399999999999997,"5min":0.318,"15min":0.317},"max":{"1min":0.81299999999999994,"5min":0.875,"15min":0.95499999999999996},"last":0.70799999999999996}]}]},{"osd":5,"up_from":13,"seq":55834575013,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315860,"kb_used_data":2188,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055980,"statfs":{"total":96636764160,"available":96313323520,"internally_reserved":0,"allocated":2240512,"data_stored":1033010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.48199999999999998,"15min":0.55900000000000005},"min":{"1min":0.32800000000000001,"5min":0.23300000000000001,"15min":0.20499999999999999},"max":{"1min":0.752,"5min":0.752,"15min":5.0490000000000004},"last":0.624},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.47799999999999998,"15min":0.54100000000000004},"min":{"1min":0.34699999999999998,"5min":0.253,"15min":0.22900000000000001},"max":{"1min":0.626,"5min":0.71299999999999997,"15min":5.1449999999999996},"last":0.47599999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.48099999999999998,"15min":0.48499999999999999},"min":{"1min":0.34699999999999998,"5min":0.25700000000000001,"15min":0.25},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.97199999999999998},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.502,"15min":0.51000000000000001},"min":{"1min":0.373,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.73599999999999999,"5min":0.74099999999999999,"15min":1.8799999999999999},"last":0.54600000000000004}]},{"osd":2,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.52600000000000002,"15min":0.54700000000000004},"min":{"1min":0.42999999999999999,"5min":0.30099999999999999,"15min":0.28299999999999997},"max":{"1min":0.73399999999999999,"5min":0.76600000000000001,"15min":4.234},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.55800000000000005,"15min":0.56100000000000005},"min":{"1min":0.41699999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.78700000000000003,"5min":0.79200000000000004,"15min":1.0369999999999999},"last":0.60099999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.497,"15min":0.57499999999999996},"min":{"1min":0.39700000000000002,"5min":0.29499999999999998,"15min":0.27700000000000002},"max":{"1min":0.67400000000000004,"5min":0.72799999999999998,"15min":5.2169999999999996},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.52600000000000002,"15min":0.53800000000000003},"min":{"1min":0.42599999999999999,"5min":0.29999999999999999,"15min":0.29699999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":1.008},"last":0.76000000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.47999999999999998,"15min":0.5},"min":{"1min":0.36399999999999999,"5min":0.25600000000000001,"15min":0.23999999999999999},"max":{"1min":0.61699999999999999,"5min":0.83399999999999996,"15min":1.917},"last":0.748},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.495,"15min":0.51100000000000001},"min":{"1min":0.38200000000000001,"5min":0.251,"15min":0.23899999999999999},"max":{"1min":0.64900000000000002,"5min":0.69199999999999995,"15min":0.87},"last":0.65200000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51000000000000001,"15min":0.53700000000000003},"min":{"1min":0.41099999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63700000000000001,"5min":0.76800000000000002,"15min":2.0139999999999998},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57399999999999995,"15min":0.59099999999999997},"min":{"1min":0.46200000000000002,"5min":0.30299999999999999,"15min":0.29999999999999999},"max":{"1min":0.68600000000000005,"5min":0.80800000000000005,"15min":1.9470000000000001},"last":0.77600000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53300000000000003,"15min":0.55900000000000005},"min":{"1min":0.42099999999999999,"5min":0.28799999999999998,"15min":0.27700000000000002},"max":{"1min":0.628,"5min":0.81000000000000005,"15min":0.96499999999999997},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57199999999999995,"15min":0.59099999999999997},"min":{"1min":0.46800000000000003,"5min":0.29199999999999998,"15min":0.28799999999999998},"max":{"1min":0.69199999999999995,"5min":0.77300000000000002,"15min":1.4119999999999999},"last":0.78500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:19:01.080 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:19:01.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.205+0000 7f987f8d5700 1 Processor -- start 2023-10-06T11:19:01.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.205+0000 7f987f8d5700 1 -- start start 2023-10-06T11:19:01.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.206+0000 7f987f8d5700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f987815a940 0x7f9878153c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:01.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.206+0000 7f987f8d5700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f987815e140 con 0x7f987815dcc0 2023-10-06T11:19:01.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.206+0000 7f987f8d5700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f987815d270 con 0x7f98781538c0 2023-10-06T11:19:01.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.206+0000 7f987f8d5700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f987815d830 con 0x7f987815a940 2023-10-06T11:19:01.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.206+0000 7f987de72700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f987815dcc0 0x7f98780ce610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:36244/0 (socket says 172.21.15.146:36244) 2023-10-06T11:19:01.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.206+0000 7f987de72700 1 -- 172.21.15.146:0/2560121300 learned_addr learned my addr 172.21.15.146:0/2560121300 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:19:01.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.206+0000 7f986ffff700 1 -- 172.21.15.146:0/2560121300 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 857520816 0 0) 0x7f9870001490 con 0x7f987815dcc0 2023-10-06T11:19:01.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.206+0000 7f986ffff700 1 -- 172.21.15.146:0/2560121300 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9864003570 con 0x7f987815dcc0 2023-10-06T11:19:01.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.206+0000 7f987ce70700 1 --2- 172.21.15.146:0/2560121300 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f987815a940 0x7f9878153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:01.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.206+0000 7f986ffff700 1 -- 172.21.15.146:0/2560121300 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2376554797 0 0) 0x7f9864003570 con 0x7f987815dcc0 2023-10-06T11:19:01.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.206+0000 7f986ffff700 1 -- 172.21.15.146:0/2560121300 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f987815a940 msgr2=0x7f9878153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:01.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.206+0000 7f986ffff700 1 --2- 172.21.15.146:0/2560121300 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f987815a940 0x7f9878153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:01.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.206+0000 7f986ffff700 1 -- 172.21.15.146:0/2560121300 >> v1:172.21.15.151:6789/0 conn(0x7f98781538c0 legacy=0x7f98780cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:01.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.206+0000 7f986ffff700 1 -- 172.21.15.146:0/2560121300 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98780cb810 con 0x7f987815dcc0 2023-10-06T11:19:01.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.206+0000 7f986ffff700 1 -- 172.21.15.146:0/2560121300 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f9870001980 con 0x7f987815dcc0 2023-10-06T11:19:01.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.206+0000 7f986ffff700 1 -- 172.21.15.146:0/2560121300 >> v1:172.21.15.146:6789/0 conn(0x7f987815dcc0 legacy=0x7f98780ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:01.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.207+0000 7f986ffff700 1 --2- 172.21.15.146:0/2560121300 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9864003a90 0x7f9864003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:01.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.207+0000 7f986ffff700 1 --2- 172.21.15.146:0/2560121300 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9864004810 0x7f9864004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:01.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.207+0000 7f986ffff700 1 --2- 172.21.15.146:0/2560121300 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f987815a940 0x7f98640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:01.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.207+0000 7f986ffff700 1 -- 172.21.15.146:0/2560121300 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f987815d830 con 0x7f9864003a90 2023-10-06T11:19:01.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.207+0000 7f986ffff700 1 -- 172.21.15.146:0/2560121300 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986400bb10 con 0x7f9864004810 2023-10-06T11:19:01.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.207+0000 7f986ffff700 1 -- 172.21.15.146:0/2560121300 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f986400bcd0 con 0x7f987815a940 2023-10-06T11:19:01.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.207+0000 7f987d671700 1 --2- 172.21.15.146:0/2560121300 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9864003a90 0x7f9864003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:01.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.207+0000 7f987ce70700 1 --2- 172.21.15.146:0/2560121300 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9864004810 0x7f9864004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:01.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.207+0000 7f987de72700 1 --2- 172.21.15.146:0/2560121300 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f987815a940 0x7f98640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:01.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.207+0000 7f987d671700 1 -- 172.21.15.146:0/2560121300 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f987815a940 msgr2=0x7f98640051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:01.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.207+0000 7f987d671700 1 --2- 172.21.15.146:0/2560121300 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f987815a940 0x7f98640051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:01.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.207+0000 7f987d671700 1 -- 172.21.15.146:0/2560121300 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9864004810 msgr2=0x7f9864004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:01.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.207+0000 7f987d671700 1 --2- 172.21.15.146:0/2560121300 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9864004810 0x7f9864004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:01.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.207+0000 7f987d671700 1 -- 172.21.15.146:0/2560121300 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9864003570 con 0x7f9864003a90 2023-10-06T11:19:01.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.207+0000 7f987d671700 1 --2- 172.21.15.146:0/2560121300 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9864003a90 0x7f9864003e60 secure :-1 s=READY pgs=2254 cs=0 l=1 rev1=1 crypto rx=0x7f98740019a0 tx=0x7f9874007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f401f08486a7203a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:01.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.207+0000 7f986ffff700 1 -- 172.21.15.146:0/2560121300 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987400c5d0 con 0x7f9864003a90 2023-10-06T11:19:01.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.207+0000 7f986ffff700 1 -- 172.21.15.146:0/2560121300 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f987400c730 con 0x7f9864003a90 2023-10-06T11:19:01.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.207+0000 7f986ffff700 1 -- 172.21.15.146:0/2560121300 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987400cad0 con 0x7f9864003a90 2023-10-06T11:19:01.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.208+0000 7f987f8d5700 1 -- 172.21.15.146:0/2560121300 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9864003a90 msgr2=0x7f9864003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:01.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.208+0000 7f987f8d5700 1 --2- 172.21.15.146:0/2560121300 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9864003a90 0x7f9864003e60 secure :-1 s=READY pgs=2254 cs=0 l=1 rev1=1 crypto rx=0x7f98740019a0 tx=0x7f9874007d10 comp rx=0 tx=0).stop 2023-10-06T11:19:01.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.208+0000 7f987de72700 1 -- 172.21.15.146:0/2560121300 reap_dead start 2023-10-06T11:19:01.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.208+0000 7f987f8d5700 1 -- 172.21.15.146:0/2560121300 shutdown_connections 2023-10-06T11:19:01.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.208+0000 7f987f8d5700 1 -- 172.21.15.146:0/2560121300 >> 172.21.15.146:0/2560121300 conn(0x7f987806eb10 msgr2=0x7f987806ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:01.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.208+0000 7f987f8d5700 1 -- 172.21.15.146:0/2560121300 shutdown_connections 2023-10-06T11:19:01.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.208+0000 7f987f8d5700 1 -- 172.21.15.146:0/2560121300 wait complete. 2023-10-06T11:19:01.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.209+0000 7f987f8d5700 1 Processor -- start 2023-10-06T11:19:01.214 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.209+0000 7f987f8d5700 1 -- start start 2023-10-06T11:19:01.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.210+0000 7f987f8d5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9864003a90 0x7f98780ca180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:01.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.210+0000 7f987f8d5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f987816c660 0x7f98780c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:01.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.210+0000 7f987f8d5700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9878169740 0x7f98780c6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:01.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.210+0000 7f987f8d5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98780c9740 con 0x7f987816c660 2023-10-06T11:19:01.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.210+0000 7f987f8d5700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98780b35a0 con 0x7f9864003a90 2023-10-06T11:19:01.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.210+0000 7f987f8d5700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f987816cad0 con 0x7f9878169740 2023-10-06T11:19:01.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.210+0000 7f987ce70700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f987816c660 0x7f98780c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:01.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.210+0000 7f987ce70700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f987816c660 0x7f98780c86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58712/0 (socket says 172.21.15.146:58712) 2023-10-06T11:19:01.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.210+0000 7f987ce70700 1 -- 172.21.15.146:0/3077792421 learned_addr learned my addr 172.21.15.146:0/3077792421 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:01.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.210+0000 7f987de72700 1 --2- 172.21.15.146:0/3077792421 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9878169740 0x7f98780c6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:01.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.210+0000 7f987d671700 1 --2- 172.21.15.146:0/3077792421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9864003a90 0x7f98780ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:01.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.210+0000 7f987ce70700 1 -- 172.21.15.146:0/3077792421 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9878169740 msgr2=0x7f98780c6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:01.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.210+0000 7f987ce70700 1 --2- 172.21.15.146:0/3077792421 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9878169740 0x7f98780c6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:01.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.210+0000 7f987ce70700 1 -- 172.21.15.146:0/3077792421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9864003a90 msgr2=0x7f98780ca180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:01.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.210+0000 7f987ce70700 1 --2- 172.21.15.146:0/3077792421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9864003a90 0x7f98780ca180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:01.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.210+0000 7f987ce70700 1 -- 172.21.15.146:0/3077792421 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98780c8c00 con 0x7f987816c660 2023-10-06T11:19:01.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.210+0000 7f987ce70700 1 --2- 172.21.15.146:0/3077792421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f987816c660 0x7f98780c86c0 secure :-1 s=READY pgs=2255 cs=0 l=1 rev1=1 crypto rx=0x7f9868011d40 tx=0x7f98680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:01.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.211+0000 7f986d7fa700 1 -- 172.21.15.146:0/3077792421 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986800fac0 con 0x7f987816c660 2023-10-06T11:19:01.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.211+0000 7f986d7fa700 1 -- 172.21.15.146:0/3077792421 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f986800fc20 con 0x7f987816c660 2023-10-06T11:19:01.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.211+0000 7f986d7fa700 1 -- 172.21.15.146:0/3077792421 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9868014440 con 0x7f987816c660 2023-10-06T11:19:01.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.211+0000 7f987f8d5700 1 -- 172.21.15.146:0/3077792421 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98780c8ea0 con 0x7f987816c660 2023-10-06T11:19:01.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.211+0000 7f987f8d5700 1 -- 172.21.15.146:0/3077792421 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98780c9460 con 0x7f987816c660 2023-10-06T11:19:01.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.211+0000 7f987f8d5700 1 -- 172.21.15.146:0/3077792421 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98780b3730 con 0x7f987816c660 2023-10-06T11:19:01.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.212+0000 7f986d7fa700 1 -- 172.21.15.146:0/3077792421 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9868014a80 con 0x7f987816c660 2023-10-06T11:19:01.219 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.212+0000 7f986d7fa700 1 --2- 172.21.15.146:0/3077792421 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f985c066f30 0x7f985c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:01.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.212+0000 7f986d7fa700 1 -- 172.21.15.146:0/3077792421 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9868018030 con 0x7f987816c660 2023-10-06T11:19:01.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.212+0000 7f987d671700 1 --2- 172.21.15.146:0/3077792421 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f985c066f30 0x7f985c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:01.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.213+0000 7f987d671700 1 --2- 172.21.15.146:0/3077792421 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f985c066f30 0x7f985c0693e0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f9874000fd0 tx=0x7f9874015000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:01.220 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.217+0000 7f986d7fa700 1 -- 172.21.15.146:0/3077792421 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9868052410 con 0x7f987816c660 2023-10-06T11:19:01.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.395+0000 7f987f8d5700 1 -- 172.21.15.146:0/3077792421 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f987804c380 con 0x7f985c066f30 2023-10-06T11:19:01.404 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.403+0000 7f986d7fa700 1 -- 172.21.15.146:0/3077792421 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311928 (secure 0 0 0) 0x7f987804c380 con 0x7f985c066f30 2023-10-06T11:19:01.408 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:01.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.406+0000 7f987f8d5700 1 -- 172.21.15.146:0/3077792421 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f985c066f30 msgr2=0x7f985c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:01.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.406+0000 7f987f8d5700 1 --2- 172.21.15.146:0/3077792421 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f985c066f30 0x7f985c0693e0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f9874000fd0 tx=0x7f9874015000 comp rx=0 tx=0).stop 2023-10-06T11:19:01.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.406+0000 7f987f8d5700 1 -- 172.21.15.146:0/3077792421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f987816c660 msgr2=0x7f98780c86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:01.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.406+0000 7f987f8d5700 1 --2- 172.21.15.146:0/3077792421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f987816c660 0x7f98780c86c0 secure :-1 s=READY pgs=2255 cs=0 l=1 rev1=1 crypto rx=0x7f9868011d40 tx=0x7f98680091a0 comp rx=0 tx=0).stop 2023-10-06T11:19:01.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.407+0000 7f987f8d5700 1 -- 172.21.15.146:0/3077792421 shutdown_connections 2023-10-06T11:19:01.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.407+0000 7f987f8d5700 1 --2- 172.21.15.146:0/3077792421 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f985c066f30 0x7f985c0693e0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:01.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.407+0000 7f987f8d5700 1 --2- 172.21.15.146:0/3077792421 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9878169740 0x7f98780c6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:01.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.407+0000 7f987f8d5700 1 --2- 172.21.15.146:0/3077792421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9864003a90 0x7f98780ca180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:01.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.407+0000 7f987f8d5700 1 --2- 172.21.15.146:0/3077792421 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f987816c660 0x7f98780c86c0 unknown :-1 s=CLOSED pgs=2255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:01.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.407+0000 7f987f8d5700 1 -- 172.21.15.146:0/3077792421 >> 172.21.15.146:0/3077792421 conn(0x7f987806eb10 msgr2=0x7f987806ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:01.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.407+0000 7f987f8d5700 1 -- 172.21.15.146:0/3077792421 shutdown_connections 2023-10-06T11:19:01.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.407+0000 7f987f8d5700 1 -- 172.21.15.146:0/3077792421 wait complete. 2023-10-06T11:19:01.412 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:19:01.420 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":572,"stamp":"2023-10-06T11:19:01.313887+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2442008,"kb_used_data":18648,"kb_used_omap":0,"kb_used_meta":2423296,"kb_avail":752532712,"statfs":{"total":773094113280,"available":770593497088,"internally_reserved":0,"allocated":19095552,"data_stored":9443568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2481455104},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.810991"},"pg_stats":[{"pgid":"28.3f","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.531406+0000","last_change":"2023-10-06T11:18:52.530544+0000","last_active":"2023-10-06T11:18:52.531406+0000","last_peered":"2023-10-06T11:18:52.531406+0000","last_clean":"2023-10-06T11:18:52.531406+0000","last_became_active":"2023-10-06T11:18:52.530251+0000","last_became_peered":"2023-10-06T11:18:52.530251+0000","last_unstale":"2023-10-06T11:18:52.531406+0000","last_undegraded":"2023-10-06T11:18:52.531406+0000","last_fullsized":"2023-10-06T11:18:52.531406+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:56:53.432751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.3e","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.528171+0000","last_change":"2023-10-06T11:18:52.527062+0000","last_active":"2023-10-06T11:18:52.528171+0000","last_peered":"2023-10-06T11:18:52.528171+0000","last_clean":"2023-10-06T11:18:52.528171+0000","last_became_active":"2023-10-06T11:18:52.526797+0000","last_became_peered":"2023-10-06T11:18:52.526797+0000","last_unstale":"2023-10-06T11:18:52.528171+0000","last_undegraded":"2023-10-06T11:18:52.528171+0000","last_fullsized":"2023-10-06T11:18:52.528171+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:16:04.972477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.3d","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.523984+0000","last_change":"2023-10-06T11:18:52.523329+0000","last_active":"2023-10-06T11:18:52.523984+0000","last_peered":"2023-10-06T11:18:52.523984+0000","last_clean":"2023-10-06T11:18:52.523984+0000","last_became_active":"2023-10-06T11:18:52.523065+0000","last_became_peered":"2023-10-06T11:18:52.523065+0000","last_unstale":"2023-10-06T11:18:52.523984+0000","last_undegraded":"2023-10-06T11:18:52.523984+0000","last_fullsized":"2023-10-06T11:18:52.523984+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:01:34.361494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.3c","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.531640+0000","last_change":"2023-10-06T11:18:52.530627+0000","last_active":"2023-10-06T11:18:52.531640+0000","last_peered":"2023-10-06T11:18:52.531640+0000","last_clean":"2023-10-06T11:18:52.531640+0000","last_became_active":"2023-10-06T11:18:52.530366+0000","last_became_peered":"2023-10-06T11:18:52.530366+0000","last_unstale":"2023-10-06T11:18:52.531640+0000","last_undegraded":"2023-10-06T11:18:52.531640+0000","last_fullsized":"2023-10-06T11:18:52.531640+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:26:40.393766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.3b","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.523007+0000","last_change":"2023-10-06T11:18:52.520993+0000","last_active":"2023-10-06T11:18:52.523007+0000","last_peered":"2023-10-06T11:18:52.523007+0000","last_clean":"2023-10-06T11:18:52.523007+0000","last_became_active":"2023-10-06T11:18:52.520748+0000","last_became_peered":"2023-10-06T11:18:52.520748+0000","last_unstale":"2023-10-06T11:18:52.523007+0000","last_undegraded":"2023-10-06T11:18:52.523007+0000","last_fullsized":"2023-10-06T11:18:52.523007+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:03:23.978572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.3a","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.528368+0000","last_change":"2023-10-06T11:18:52.526067+0000","last_active":"2023-10-06T11:18:52.528368+0000","last_peered":"2023-10-06T11:18:52.528368+0000","last_clean":"2023-10-06T11:18:52.528368+0000","last_became_active":"2023-10-06T11:18:52.525793+0000","last_became_peered":"2023-10-06T11:18:52.525793+0000","last_unstale":"2023-10-06T11:18:52.528368+0000","last_undegraded":"2023-10-06T11:18:52.528368+0000","last_fullsized":"2023-10-06T11:18:52.528368+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:39:48.907532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.39","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.534135+0000","last_change":"2023-10-06T11:18:52.528505+0000","last_active":"2023-10-06T11:18:52.534135+0000","last_peered":"2023-10-06T11:18:52.534135+0000","last_clean":"2023-10-06T11:18:52.534135+0000","last_became_active":"2023-10-06T11:18:52.528218+0000","last_became_peered":"2023-10-06T11:18:52.528218+0000","last_unstale":"2023-10-06T11:18:52.534135+0000","last_undegraded":"2023-10-06T11:18:52.534135+0000","last_fullsized":"2023-10-06T11:18:52.534135+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:43:48.577600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.38","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.525630+0000","last_change":"2023-10-06T11:18:52.519053+0000","last_active":"2023-10-06T11:18:52.525630+0000","last_peered":"2023-10-06T11:18:52.525630+0000","last_clean":"2023-10-06T11:18:52.525630+0000","last_became_active":"2023-10-06T11:18:52.518797+0000","last_became_peered":"2023-10-06T11:18:52.518797+0000","last_unstale":"2023-10-06T11:18:52.525630+0000","last_undegraded":"2023-10-06T11:18:52.525630+0000","last_fullsized":"2023-10-06T11:18:52.525630+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:59:10.930310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.37","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.519458+0000","last_change":"2023-10-06T11:18:52.516490+0000","last_active":"2023-10-06T11:18:52.519458+0000","last_peered":"2023-10-06T11:18:52.519458+0000","last_clean":"2023-10-06T11:18:52.519458+0000","last_became_active":"2023-10-06T11:18:52.516253+0000","last_became_peered":"2023-10-06T11:18:52.516253+0000","last_unstale":"2023-10-06T11:18:52.519458+0000","last_undegraded":"2023-10-06T11:18:52.519458+0000","last_fullsized":"2023-10-06T11:18:52.519458+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T22:26:54.298917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.36","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.530561+0000","last_change":"2023-10-06T11:18:52.521029+0000","last_active":"2023-10-06T11:18:52.530561+0000","last_peered":"2023-10-06T11:18:52.530561+0000","last_clean":"2023-10-06T11:18:52.530561+0000","last_became_active":"2023-10-06T11:18:52.520719+0000","last_became_peered":"2023-10-06T11:18:52.520719+0000","last_unstale":"2023-10-06T11:18:52.530561+0000","last_undegraded":"2023-10-06T11:18:52.530561+0000","last_fullsized":"2023-10-06T11:18:52.530561+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:50:56.624938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.35","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.518041+0000","last_change":"2023-10-06T11:18:52.512543+0000","last_active":"2023-10-06T11:18:52.518041+0000","last_peered":"2023-10-06T11:18:52.518041+0000","last_clean":"2023-10-06T11:18:52.518041+0000","last_became_active":"2023-10-06T11:18:52.512230+0000","last_became_peered":"2023-10-06T11:18:52.512230+0000","last_unstale":"2023-10-06T11:18:52.518041+0000","last_undegraded":"2023-10-06T11:18:52.518041+0000","last_fullsized":"2023-10-06T11:18:52.518041+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:08:17.863644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.34","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.522885+0000","last_change":"2023-10-06T11:18:52.520120+0000","last_active":"2023-10-06T11:18:52.522885+0000","last_peered":"2023-10-06T11:18:52.522885+0000","last_clean":"2023-10-06T11:18:52.522885+0000","last_became_active":"2023-10-06T11:18:52.519826+0000","last_became_peered":"2023-10-06T11:18:52.519826+0000","last_unstale":"2023-10-06T11:18:52.522885+0000","last_undegraded":"2023-10-06T11:18:52.522885+0000","last_fullsized":"2023-10-06T11:18:52.522885+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:18:11.272290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.33","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.529942+0000","last_change":"2023-10-06T11:18:52.528495+0000","last_active":"2023-10-06T11:18:52.529942+0000","last_peered":"2023-10-06T11:18:52.529942+0000","last_clean":"2023-10-06T11:18:52.529942+0000","last_became_active":"2023-10-06T11:18:52.527102+0000","last_became_peered":"2023-10-06T11:18:52.527102+0000","last_unstale":"2023-10-06T11:18:52.529942+0000","last_undegraded":"2023-10-06T11:18:52.529942+0000","last_fullsized":"2023-10-06T11:18:52.529942+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:35:59.938547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.32","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.531012+0000","last_change":"2023-10-06T11:18:52.523326+0000","last_active":"2023-10-06T11:18:52.531012+0000","last_peered":"2023-10-06T11:18:52.531012+0000","last_clean":"2023-10-06T11:18:52.531012+0000","last_became_active":"2023-10-06T11:18:52.522946+0000","last_became_peered":"2023-10-06T11:18:52.522946+0000","last_unstale":"2023-10-06T11:18:52.531012+0000","last_undegraded":"2023-10-06T11:18:52.531012+0000","last_fullsized":"2023-10-06T11:18:52.531012+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:12:00.782076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.31","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.532846+0000","last_change":"2023-10-06T11:18:52.531805+0000","last_active":"2023-10-06T11:18:52.532846+0000","last_peered":"2023-10-06T11:18:52.532846+0000","last_clean":"2023-10-06T11:18:52.532846+0000","last_became_active":"2023-10-06T11:18:52.531537+0000","last_became_peered":"2023-10-06T11:18:52.531537+0000","last_unstale":"2023-10-06T11:18:52.532846+0000","last_undegraded":"2023-10-06T11:18:52.532846+0000","last_fullsized":"2023-10-06T11:18:52.532846+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:47:38.557270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.30","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.520642+0000","last_change":"2023-10-06T11:18:52.514443+0000","last_active":"2023-10-06T11:18:52.520642+0000","last_peered":"2023-10-06T11:18:52.520642+0000","last_clean":"2023-10-06T11:18:52.520642+0000","last_became_active":"2023-10-06T11:18:52.514197+0000","last_became_peered":"2023-10-06T11:18:52.514197+0000","last_unstale":"2023-10-06T11:18:52.520642+0000","last_undegraded":"2023-10-06T11:18:52.520642+0000","last_fullsized":"2023-10-06T11:18:52.520642+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:45:44.869903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.2f","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.530289+0000","last_change":"2023-10-06T11:18:52.529748+0000","last_active":"2023-10-06T11:18:52.530289+0000","last_peered":"2023-10-06T11:18:52.530289+0000","last_clean":"2023-10-06T11:18:52.530289+0000","last_became_active":"2023-10-06T11:18:52.529502+0000","last_became_peered":"2023-10-06T11:18:52.529502+0000","last_unstale":"2023-10-06T11:18:52.530289+0000","last_undegraded":"2023-10-06T11:18:52.530289+0000","last_fullsized":"2023-10-06T11:18:52.530289+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:48:42.526347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2e","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.521093+0000","last_change":"2023-10-06T11:18:52.517211+0000","last_active":"2023-10-06T11:18:52.521093+0000","last_peered":"2023-10-06T11:18:52.521093+0000","last_clean":"2023-10-06T11:18:52.521093+0000","last_became_active":"2023-10-06T11:18:52.516783+0000","last_became_peered":"2023-10-06T11:18:52.516783+0000","last_unstale":"2023-10-06T11:18:52.521093+0000","last_undegraded":"2023-10-06T11:18:52.521093+0000","last_fullsized":"2023-10-06T11:18:52.521093+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:43:22.330867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.2d","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.530504+0000","last_change":"2023-10-06T11:18:52.521014+0000","last_active":"2023-10-06T11:18:52.530504+0000","last_peered":"2023-10-06T11:18:52.530504+0000","last_clean":"2023-10-06T11:18:52.530504+0000","last_became_active":"2023-10-06T11:18:52.520757+0000","last_became_peered":"2023-10-06T11:18:52.520757+0000","last_unstale":"2023-10-06T11:18:52.530504+0000","last_undegraded":"2023-10-06T11:18:52.530504+0000","last_fullsized":"2023-10-06T11:18:52.530504+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:59:52.993981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2c","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.531817+0000","last_change":"2023-10-06T11:18:52.528801+0000","last_active":"2023-10-06T11:18:52.531817+0000","last_peered":"2023-10-06T11:18:52.531817+0000","last_clean":"2023-10-06T11:18:52.531817+0000","last_became_active":"2023-10-06T11:18:52.526423+0000","last_became_peered":"2023-10-06T11:18:52.526423+0000","last_unstale":"2023-10-06T11:18:52.531817+0000","last_undegraded":"2023-10-06T11:18:52.531817+0000","last_fullsized":"2023-10-06T11:18:52.531817+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:49:49.767343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2b","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.531609+0000","last_change":"2023-10-06T11:18:52.522932+0000","last_active":"2023-10-06T11:18:52.531609+0000","last_peered":"2023-10-06T11:18:52.531609+0000","last_clean":"2023-10-06T11:18:52.531609+0000","last_became_active":"2023-10-06T11:18:52.522381+0000","last_became_peered":"2023-10-06T11:18:52.522381+0000","last_unstale":"2023-10-06T11:18:52.531609+0000","last_undegraded":"2023-10-06T11:18:52.531609+0000","last_fullsized":"2023-10-06T11:18:52.531609+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:50:05.691643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2a","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.531143+0000","last_change":"2023-10-06T11:18:52.526460+0000","last_active":"2023-10-06T11:18:52.531143+0000","last_peered":"2023-10-06T11:18:52.531143+0000","last_clean":"2023-10-06T11:18:52.531143+0000","last_became_active":"2023-10-06T11:18:52.526215+0000","last_became_peered":"2023-10-06T11:18:52.526215+0000","last_unstale":"2023-10-06T11:18:52.531143+0000","last_undegraded":"2023-10-06T11:18:52.531143+0000","last_fullsized":"2023-10-06T11:18:52.531143+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:54:17.905592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.29","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.518134+0000","last_change":"2023-10-06T11:18:52.514449+0000","last_active":"2023-10-06T11:18:52.518134+0000","last_peered":"2023-10-06T11:18:52.518134+0000","last_clean":"2023-10-06T11:18:52.518134+0000","last_became_active":"2023-10-06T11:18:52.514204+0000","last_became_peered":"2023-10-06T11:18:52.514204+0000","last_unstale":"2023-10-06T11:18:52.518134+0000","last_undegraded":"2023-10-06T11:18:52.518134+0000","last_fullsized":"2023-10-06T11:18:52.518134+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:52:09.427108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.28","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.517721+0000","last_change":"2023-10-06T11:18:52.513586+0000","last_active":"2023-10-06T11:18:52.517721+0000","last_peered":"2023-10-06T11:18:52.517721+0000","last_clean":"2023-10-06T11:18:52.517721+0000","last_became_active":"2023-10-06T11:18:52.513308+0000","last_became_peered":"2023-10-06T11:18:52.513308+0000","last_unstale":"2023-10-06T11:18:52.517721+0000","last_undegraded":"2023-10-06T11:18:52.517721+0000","last_fullsized":"2023-10-06T11:18:52.517721+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:01:40.802704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.27","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.521607+0000","last_change":"2023-10-06T11:18:52.519560+0000","last_active":"2023-10-06T11:18:52.521607+0000","last_peered":"2023-10-06T11:18:52.521607+0000","last_clean":"2023-10-06T11:18:52.521607+0000","last_became_active":"2023-10-06T11:18:52.519291+0000","last_became_peered":"2023-10-06T11:18:52.519291+0000","last_unstale":"2023-10-06T11:18:52.521607+0000","last_undegraded":"2023-10-06T11:18:52.521607+0000","last_fullsized":"2023-10-06T11:18:52.521607+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:31:11.271696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.26","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.526063+0000","last_change":"2023-10-06T11:18:52.523407+0000","last_active":"2023-10-06T11:18:52.526063+0000","last_peered":"2023-10-06T11:18:52.526063+0000","last_clean":"2023-10-06T11:18:52.526063+0000","last_became_active":"2023-10-06T11:18:52.523116+0000","last_became_peered":"2023-10-06T11:18:52.523116+0000","last_unstale":"2023-10-06T11:18:52.526063+0000","last_undegraded":"2023-10-06T11:18:52.526063+0000","last_fullsized":"2023-10-06T11:18:52.526063+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:47:20.331088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.25","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.524484+0000","last_change":"2023-10-06T11:18:52.523872+0000","last_active":"2023-10-06T11:18:52.524484+0000","last_peered":"2023-10-06T11:18:52.524484+0000","last_clean":"2023-10-06T11:18:52.524484+0000","last_became_active":"2023-10-06T11:18:52.523592+0000","last_became_peered":"2023-10-06T11:18:52.523592+0000","last_unstale":"2023-10-06T11:18:52.524484+0000","last_undegraded":"2023-10-06T11:18:52.524484+0000","last_fullsized":"2023-10-06T11:18:52.524484+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:38:07.769257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.24","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.534203+0000","last_change":"2023-10-06T11:18:52.530918+0000","last_active":"2023-10-06T11:18:52.534203+0000","last_peered":"2023-10-06T11:18:52.534203+0000","last_clean":"2023-10-06T11:18:52.534203+0000","last_became_active":"2023-10-06T11:18:52.530443+0000","last_became_peered":"2023-10-06T11:18:52.530443+0000","last_unstale":"2023-10-06T11:18:52.534203+0000","last_undegraded":"2023-10-06T11:18:52.534203+0000","last_fullsized":"2023-10-06T11:18:52.534203+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:30:38.275296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.23","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.521625+0000","last_change":"2023-10-06T11:18:52.519002+0000","last_active":"2023-10-06T11:18:52.521625+0000","last_peered":"2023-10-06T11:18:52.521625+0000","last_clean":"2023-10-06T11:18:52.521625+0000","last_became_active":"2023-10-06T11:18:52.518747+0000","last_became_peered":"2023-10-06T11:18:52.518747+0000","last_unstale":"2023-10-06T11:18:52.521625+0000","last_undegraded":"2023-10-06T11:18:52.521625+0000","last_fullsized":"2023-10-06T11:18:52.521625+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:42:02.837596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.22","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.521092+0000","last_change":"2023-10-06T11:18:52.517833+0000","last_active":"2023-10-06T11:18:52.521092+0000","last_peered":"2023-10-06T11:18:52.521092+0000","last_clean":"2023-10-06T11:18:52.521092+0000","last_became_active":"2023-10-06T11:18:52.517564+0000","last_became_peered":"2023-10-06T11:18:52.517564+0000","last_unstale":"2023-10-06T11:18:52.521092+0000","last_undegraded":"2023-10-06T11:18:52.521092+0000","last_fullsized":"2023-10-06T11:18:52.521092+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:09:52.960093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.21","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.528665+0000","last_change":"2023-10-06T11:18:52.526500+0000","last_active":"2023-10-06T11:18:52.528665+0000","last_peered":"2023-10-06T11:18:52.528665+0000","last_clean":"2023-10-06T11:18:52.528665+0000","last_became_active":"2023-10-06T11:18:52.526263+0000","last_became_peered":"2023-10-06T11:18:52.526263+0000","last_unstale":"2023-10-06T11:18:52.528665+0000","last_undegraded":"2023-10-06T11:18:52.528665+0000","last_fullsized":"2023-10-06T11:18:52.528665+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:03:22.963604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.20","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.533540+0000","last_change":"2023-10-06T11:18:52.532931+0000","last_active":"2023-10-06T11:18:52.533540+0000","last_peered":"2023-10-06T11:18:52.533540+0000","last_clean":"2023-10-06T11:18:52.533540+0000","last_became_active":"2023-10-06T11:18:52.532669+0000","last_became_peered":"2023-10-06T11:18:52.532669+0000","last_unstale":"2023-10-06T11:18:52.533540+0000","last_undegraded":"2023-10-06T11:18:52.533540+0000","last_fullsized":"2023-10-06T11:18:52.533540+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:01:34.361494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.10","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.532809+0000","last_change":"2023-10-06T11:18:52.528229+0000","last_active":"2023-10-06T11:18:52.532809+0000","last_peered":"2023-10-06T11:18:52.532809+0000","last_clean":"2023-10-06T11:18:52.532809+0000","last_became_active":"2023-10-06T11:18:52.527966+0000","last_became_peered":"2023-10-06T11:18:52.527966+0000","last_unstale":"2023-10-06T11:18:52.532809+0000","last_undegraded":"2023-10-06T11:18:52.532809+0000","last_fullsized":"2023-10-06T11:18:52.532809+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:47:20.331088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.510586+0000","last_change":"2023-10-06T11:18:51.518695+0000","last_active":"2023-10-06T11:18:52.510586+0000","last_peered":"2023-10-06T11:18:52.510586+0000","last_clean":"2023-10-06T11:18:52.510586+0000","last_became_active":"2023-10-06T11:18:51.518428+0000","last_became_peered":"2023-10-06T11:18:51.518428+0000","last_unstale":"2023-10-06T11:18:52.510586+0000","last_undegraded":"2023-10-06T11:18:52.510586+0000","last_fullsized":"2023-10-06T11:18:52.510586+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:43:54.622904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.517645+0000","last_change":"2023-10-06T11:18:52.513178+0000","last_active":"2023-10-06T11:18:52.517645+0000","last_peered":"2023-10-06T11:18:52.517645+0000","last_clean":"2023-10-06T11:18:52.517645+0000","last_became_active":"2023-10-06T11:18:52.512930+0000","last_became_peered":"2023-10-06T11:18:52.512930+0000","last_unstale":"2023-10-06T11:18:52.517645+0000","last_undegraded":"2023-10-06T11:18:52.517645+0000","last_fullsized":"2023-10-06T11:18:52.517645+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:50:47.177504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.517662+0000","last_change":"2023-10-06T11:18:51.518871+0000","last_active":"2023-10-06T11:18:52.517662+0000","last_peered":"2023-10-06T11:18:52.517662+0000","last_clean":"2023-10-06T11:18:52.517662+0000","last_became_active":"2023-10-06T11:18:51.518328+0000","last_became_peered":"2023-10-06T11:18:51.518328+0000","last_unstale":"2023-10-06T11:18:52.517662+0000","last_undegraded":"2023-10-06T11:18:52.517662+0000","last_fullsized":"2023-10-06T11:18:52.517662+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:14.192741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.517746+0000","last_change":"2023-10-06T11:18:52.514691+0000","last_active":"2023-10-06T11:18:52.517746+0000","last_peered":"2023-10-06T11:18:52.517746+0000","last_clean":"2023-10-06T11:18:52.517746+0000","last_became_active":"2023-10-06T11:18:52.514448+0000","last_became_peered":"2023-10-06T11:18:52.514448+0000","last_unstale":"2023-10-06T11:18:52.517746+0000","last_undegraded":"2023-10-06T11:18:52.517746+0000","last_fullsized":"2023-10-06T11:18:52.517746+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:44:53.142370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.15","version":"176'3","reported_seq":13,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.522165+0000","last_change":"2023-10-06T11:18:51.507987+0000","last_active":"2023-10-06T11:18:52.522165+0000","last_peered":"2023-10-06T11:18:52.522165+0000","last_clean":"2023-10-06T11:18:52.522165+0000","last_became_active":"2023-10-06T11:18:51.507722+0000","last_became_peered":"2023-10-06T11:18:51.507722+0000","last_unstale":"2023-10-06T11:18:52.522165+0000","last_undegraded":"2023-10-06T11:18:52.522165+0000","last_fullsized":"2023-10-06T11:18:52.522165+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:11:46.485112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.525099+0000","last_change":"2023-10-06T11:18:52.524105+0000","last_active":"2023-10-06T11:18:52.525099+0000","last_peered":"2023-10-06T11:18:52.525099+0000","last_clean":"2023-10-06T11:18:52.525099+0000","last_became_active":"2023-10-06T11:18:52.523872+0000","last_became_peered":"2023-10-06T11:18:52.523872+0000","last_unstale":"2023-10-06T11:18:52.525099+0000","last_undegraded":"2023-10-06T11:18:52.525099+0000","last_fullsized":"2023-10-06T11:18:52.525099+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:49:26.082334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.14","version":"176'6","reported_seq":16,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.534883+0000","last_change":"2023-10-06T11:18:51.522857+0000","last_active":"2023-10-06T11:18:52.534883+0000","last_peered":"2023-10-06T11:18:52.534883+0000","last_clean":"2023-10-06T11:18:52.534883+0000","last_became_active":"2023-10-06T11:18:51.522595+0000","last_became_peered":"2023-10-06T11:18:51.522595+0000","last_unstale":"2023-10-06T11:18:52.534883+0000","last_undegraded":"2023-10-06T11:18:52.534883+0000","last_fullsized":"2023-10-06T11:18:52.534883+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:29.658549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.518431+0000","last_change":"2023-10-06T11:18:52.513711+0000","last_active":"2023-10-06T11:18:52.518431+0000","last_peered":"2023-10-06T11:18:52.518431+0000","last_clean":"2023-10-06T11:18:52.518431+0000","last_became_active":"2023-10-06T11:18:52.513450+0000","last_became_peered":"2023-10-06T11:18:52.513450+0000","last_unstale":"2023-10-06T11:18:52.518431+0000","last_undegraded":"2023-10-06T11:18:52.518431+0000","last_fullsized":"2023-10-06T11:18:52.518431+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:23:53.875461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.13","version":"176'2","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.521993+0000","last_change":"2023-10-06T11:18:51.516937+0000","last_active":"2023-10-06T11:18:52.521993+0000","last_peered":"2023-10-06T11:18:52.521993+0000","last_clean":"2023-10-06T11:18:52.521993+0000","last_became_active":"2023-10-06T11:18:51.516091+0000","last_became_peered":"2023-10-06T11:18:51.516091+0000","last_unstale":"2023-10-06T11:18:52.521993+0000","last_undegraded":"2023-10-06T11:18:52.521993+0000","last_fullsized":"2023-10-06T11:18:52.521993+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:40:00.076411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.15","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.518066+0000","last_change":"2023-10-06T11:18:52.512871+0000","last_active":"2023-10-06T11:18:52.518066+0000","last_peered":"2023-10-06T11:18:52.518066+0000","last_clean":"2023-10-06T11:18:52.518066+0000","last_became_active":"2023-10-06T11:18:52.512528+0000","last_became_peered":"2023-10-06T11:18:52.512528+0000","last_unstale":"2023-10-06T11:18:52.518066+0000","last_undegraded":"2023-10-06T11:18:52.518066+0000","last_fullsized":"2023-10-06T11:18:52.518066+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:39:48.907532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.504441+0000","last_change":"2023-10-06T11:18:51.520772+0000","last_active":"2023-10-06T11:18:52.504441+0000","last_peered":"2023-10-06T11:18:52.504441+0000","last_clean":"2023-10-06T11:18:52.504441+0000","last_became_active":"2023-10-06T11:18:51.520462+0000","last_became_peered":"2023-10-06T11:18:51.520462+0000","last_unstale":"2023-10-06T11:18:52.504441+0000","last_undegraded":"2023-10-06T11:18:52.504441+0000","last_fullsized":"2023-10-06T11:18:52.504441+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:47:19.326917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.518475+0000","last_change":"2023-10-06T11:18:52.517027+0000","last_active":"2023-10-06T11:18:52.518475+0000","last_peered":"2023-10-06T11:18:52.518475+0000","last_clean":"2023-10-06T11:18:52.518475+0000","last_became_active":"2023-10-06T11:18:52.516444+0000","last_became_peered":"2023-10-06T11:18:52.516444+0000","last_unstale":"2023-10-06T11:18:52.518475+0000","last_undegraded":"2023-10-06T11:18:52.518475+0000","last_fullsized":"2023-10-06T11:18:52.518475+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:33:52.221626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.510008+0000","last_change":"2023-10-06T11:18:51.509346+0000","last_active":"2023-10-06T11:18:52.510008+0000","last_peered":"2023-10-06T11:18:52.510008+0000","last_clean":"2023-10-06T11:18:52.510008+0000","last_became_active":"2023-10-06T11:18:51.509056+0000","last_became_peered":"2023-10-06T11:18:51.509056+0000","last_unstale":"2023-10-06T11:18:52.510008+0000","last_undegraded":"2023-10-06T11:18:52.510008+0000","last_fullsized":"2023-10-06T11:18:52.510008+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:04.109678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.528375+0000","last_change":"2023-10-06T11:18:52.525692+0000","last_active":"2023-10-06T11:18:52.528375+0000","last_peered":"2023-10-06T11:18:52.528375+0000","last_clean":"2023-10-06T11:18:52.528375+0000","last_became_active":"2023-10-06T11:18:52.525420+0000","last_became_peered":"2023-10-06T11:18:52.525420+0000","last_unstale":"2023-10-06T11:18:52.528375+0000","last_undegraded":"2023-10-06T11:18:52.528375+0000","last_fullsized":"2023-10-06T11:18:52.528375+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:25:25.661614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.10","version":"176'8","reported_seq":18,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.531756+0000","last_change":"2023-10-06T11:18:51.518675+0000","last_active":"2023-10-06T11:18:52.531756+0000","last_peered":"2023-10-06T11:18:52.531756+0000","last_clean":"2023-10-06T11:18:52.531756+0000","last_became_active":"2023-10-06T11:18:51.518355+0000","last_became_peered":"2023-10-06T11:18:51.518355+0000","last_unstale":"2023-10-06T11:18:52.531756+0000","last_undegraded":"2023-10-06T11:18:52.531756+0000","last_fullsized":"2023-10-06T11:18:52.531756+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:18:28.122040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.531046+0000","last_change":"2023-10-06T11:18:52.525800+0000","last_active":"2023-10-06T11:18:52.531046+0000","last_peered":"2023-10-06T11:18:52.531046+0000","last_clean":"2023-10-06T11:18:52.531046+0000","last_became_active":"2023-10-06T11:18:52.522619+0000","last_became_peered":"2023-10-06T11:18:52.522619+0000","last_unstale":"2023-10-06T11:18:52.531046+0000","last_undegraded":"2023-10-06T11:18:52.531046+0000","last_fullsized":"2023-10-06T11:18:52.531046+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T21:28:24.592425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.f","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.520341+0000","last_change":"2023-10-06T11:18:51.509974+0000","last_active":"2023-10-06T11:18:52.520341+0000","last_peered":"2023-10-06T11:18:52.520341+0000","last_clean":"2023-10-06T11:18:52.520341+0000","last_became_active":"2023-10-06T11:18:51.508881+0000","last_became_peered":"2023-10-06T11:18:51.508881+0000","last_unstale":"2023-10-06T11:18:52.520341+0000","last_undegraded":"2023-10-06T11:18:52.520341+0000","last_fullsized":"2023-10-06T11:18:52.520341+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:01:42.688601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.526578+0000","last_change":"2023-10-06T11:18:52.524019+0000","last_active":"2023-10-06T11:18:52.526578+0000","last_peered":"2023-10-06T11:18:52.526578+0000","last_clean":"2023-10-06T11:18:52.526578+0000","last_became_active":"2023-10-06T11:18:52.523773+0000","last_became_peered":"2023-10-06T11:18:52.523773+0000","last_unstale":"2023-10-06T11:18:52.526578+0000","last_undegraded":"2023-10-06T11:18:52.526578+0000","last_fullsized":"2023-10-06T11:18:52.526578+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:50:12.399641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.e","version":"176'2","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.528784+0000","last_change":"2023-10-06T11:18:51.516814+0000","last_active":"2023-10-06T11:18:52.528784+0000","last_peered":"2023-10-06T11:18:52.528784+0000","last_clean":"2023-10-06T11:18:52.528784+0000","last_became_active":"2023-10-06T11:18:51.516327+0000","last_became_peered":"2023-10-06T11:18:51.516327+0000","last_unstale":"2023-10-06T11:18:52.528784+0000","last_undegraded":"2023-10-06T11:18:52.528784+0000","last_fullsized":"2023-10-06T11:18:52.528784+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:18:11.844126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.523679+0000","last_change":"2023-10-06T11:18:52.515910+0000","last_active":"2023-10-06T11:18:52.523679+0000","last_peered":"2023-10-06T11:18:52.523679+0000","last_clean":"2023-10-06T11:18:52.523679+0000","last_became_active":"2023-10-06T11:18:52.515568+0000","last_became_peered":"2023-10-06T11:18:52.515568+0000","last_unstale":"2023-10-06T11:18:52.523679+0000","last_undegraded":"2023-10-06T11:18:52.523679+0000","last_fullsized":"2023-10-06T11:18:52.523679+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:15.196912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.d","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.528525+0000","last_change":"2023-10-06T11:18:51.516723+0000","last_active":"2023-10-06T11:18:52.528525+0000","last_peered":"2023-10-06T11:18:52.528525+0000","last_clean":"2023-10-06T11:18:52.528525+0000","last_became_active":"2023-10-06T11:18:51.516436+0000","last_became_peered":"2023-10-06T11:18:51.516436+0000","last_unstale":"2023-10-06T11:18:52.528525+0000","last_undegraded":"2023-10-06T11:18:52.528525+0000","last_fullsized":"2023-10-06T11:18:52.528525+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:29:51.407315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.b","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.531629+0000","last_change":"2023-10-06T11:18:52.526788+0000","last_active":"2023-10-06T11:18:52.531629+0000","last_peered":"2023-10-06T11:18:52.531629+0000","last_clean":"2023-10-06T11:18:52.531629+0000","last_became_active":"2023-10-06T11:18:52.522757+0000","last_became_peered":"2023-10-06T11:18:52.522757+0000","last_unstale":"2023-10-06T11:18:52.531629+0000","last_undegraded":"2023-10-06T11:18:52.531629+0000","last_fullsized":"2023-10-06T11:18:52.531629+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:42:11.146258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.510647+0000","last_change":"2023-10-06T11:18:51.516285+0000","last_active":"2023-10-06T11:18:52.510647+0000","last_peered":"2023-10-06T11:18:52.510647+0000","last_clean":"2023-10-06T11:18:52.510647+0000","last_became_active":"2023-10-06T11:18:51.515952+0000","last_became_peered":"2023-10-06T11:18:51.515952+0000","last_unstale":"2023-10-06T11:18:52.510647+0000","last_undegraded":"2023-10-06T11:18:52.510647+0000","last_fullsized":"2023-10-06T11:18:52.510647+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:59:11.858550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.531211+0000","last_change":"2023-10-06T11:18:52.530819+0000","last_active":"2023-10-06T11:18:52.531211+0000","last_peered":"2023-10-06T11:18:52.531211+0000","last_clean":"2023-10-06T11:18:52.531211+0000","last_became_active":"2023-10-06T11:18:52.530572+0000","last_became_peered":"2023-10-06T11:18:52.530572+0000","last_unstale":"2023-10-06T11:18:52.531211+0000","last_undegraded":"2023-10-06T11:18:52.531211+0000","last_fullsized":"2023-10-06T11:18:52.531211+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:24:05.113850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"176'2","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.520923+0000","last_change":"2023-10-06T11:18:51.514639+0000","last_active":"2023-10-06T11:18:52.520923+0000","last_peered":"2023-10-06T11:18:52.520923+0000","last_clean":"2023-10-06T11:18:52.520923+0000","last_became_active":"2023-10-06T11:18:51.514262+0000","last_became_peered":"2023-10-06T11:18:51.514262+0000","last_unstale":"2023-10-06T11:18:52.520923+0000","last_undegraded":"2023-10-06T11:18:52.520923+0000","last_fullsized":"2023-10-06T11:18:52.520923+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:14:22.348361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.d","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.528442+0000","last_change":"2023-10-06T11:18:52.526104+0000","last_active":"2023-10-06T11:18:52.528442+0000","last_peered":"2023-10-06T11:18:52.528442+0000","last_clean":"2023-10-06T11:18:52.528442+0000","last_became_active":"2023-10-06T11:18:52.525432+0000","last_became_peered":"2023-10-06T11:18:52.525432+0000","last_unstale":"2023-10-06T11:18:52.528442+0000","last_undegraded":"2023-10-06T11:18:52.528442+0000","last_fullsized":"2023-10-06T11:18:52.528442+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:45:44.869903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.507473+0000","last_change":"2023-10-06T11:18:51.515349+0000","last_active":"2023-10-06T11:18:52.507473+0000","last_peered":"2023-10-06T11:18:52.507473+0000","last_clean":"2023-10-06T11:18:52.507473+0000","last_became_active":"2023-10-06T11:18:51.515067+0000","last_became_peered":"2023-10-06T11:18:51.515067+0000","last_unstale":"2023-10-06T11:18:52.507473+0000","last_undegraded":"2023-10-06T11:18:52.507473+0000","last_fullsized":"2023-10-06T11:18:52.507473+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:27:52.149123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.526638+0000","last_change":"2023-10-06T11:18:52.525862+0000","last_active":"2023-10-06T11:18:52.526638+0000","last_peered":"2023-10-06T11:18:52.526638+0000","last_clean":"2023-10-06T11:18:52.526638+0000","last_became_active":"2023-10-06T11:18:52.525576+0000","last_became_peered":"2023-10-06T11:18:52.525576+0000","last_unstale":"2023-10-06T11:18:52.526638+0000","last_undegraded":"2023-10-06T11:18:52.526638+0000","last_fullsized":"2023-10-06T11:18:52.526638+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:10:01.681875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.518658+0000","last_change":"2023-10-06T11:18:51.518577+0000","last_active":"2023-10-06T11:18:52.518658+0000","last_peered":"2023-10-06T11:18:52.518658+0000","last_clean":"2023-10-06T11:18:52.518658+0000","last_became_active":"2023-10-06T11:18:51.518267+0000","last_became_peered":"2023-10-06T11:18:51.518267+0000","last_unstale":"2023-10-06T11:18:52.518658+0000","last_undegraded":"2023-10-06T11:18:52.518658+0000","last_fullsized":"2023-10-06T11:18:52.518658+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:12:04.967138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.f","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.527096+0000","last_change":"2023-10-06T11:18:52.519685+0000","last_active":"2023-10-06T11:18:52.527096+0000","last_peered":"2023-10-06T11:18:52.527096+0000","last_clean":"2023-10-06T11:18:52.527096+0000","last_became_active":"2023-10-06T11:18:52.519038+0000","last_became_peered":"2023-10-06T11:18:52.519038+0000","last_unstale":"2023-10-06T11:18:52.527096+0000","last_undegraded":"2023-10-06T11:18:52.527096+0000","last_fullsized":"2023-10-06T11:18:52.527096+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:37:55.966919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.505664+0000","last_change":"2023-10-06T11:18:51.509721+0000","last_active":"2023-10-06T11:18:52.505664+0000","last_peered":"2023-10-06T11:18:52.505664+0000","last_clean":"2023-10-06T11:18:52.505664+0000","last_became_active":"2023-10-06T11:18:51.509467+0000","last_became_peered":"2023-10-06T11:18:51.509467+0000","last_unstale":"2023-10-06T11:18:52.505664+0000","last_undegraded":"2023-10-06T11:18:52.505664+0000","last_fullsized":"2023-10-06T11:18:52.505664+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:52:05.527948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.531025+0000","last_change":"2023-10-06T11:18:52.525478+0000","last_active":"2023-10-06T11:18:52.531025+0000","last_peered":"2023-10-06T11:18:52.531025+0000","last_clean":"2023-10-06T11:18:52.531025+0000","last_became_active":"2023-10-06T11:18:52.522280+0000","last_became_peered":"2023-10-06T11:18:52.522280+0000","last_unstale":"2023-10-06T11:18:52.531025+0000","last_undegraded":"2023-10-06T11:18:52.531025+0000","last_fullsized":"2023-10-06T11:18:52.531025+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:54:50.093998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.7","version":"176'2","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.529445+0000","last_change":"2023-10-06T11:18:51.519737+0000","last_active":"2023-10-06T11:18:52.529445+0000","last_peered":"2023-10-06T11:18:52.529445+0000","last_clean":"2023-10-06T11:18:52.529445+0000","last_became_active":"2023-10-06T11:18:51.519441+0000","last_became_peered":"2023-10-06T11:18:51.519441+0000","last_unstale":"2023-10-06T11:18:52.529445+0000","last_undegraded":"2023-10-06T11:18:52.529445+0000","last_fullsized":"2023-10-06T11:18:52.529445+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:59:16.598721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.522467+0000","last_change":"2023-10-06T11:18:52.521193+0000","last_active":"2023-10-06T11:18:52.522467+0000","last_peered":"2023-10-06T11:18:52.522467+0000","last_clean":"2023-10-06T11:18:52.522467+0000","last_became_active":"2023-10-06T11:18:52.520957+0000","last_became_peered":"2023-10-06T11:18:52.520957+0000","last_unstale":"2023-10-06T11:18:52.522467+0000","last_undegraded":"2023-10-06T11:18:52.522467+0000","last_fullsized":"2023-10-06T11:18:52.522467+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:35:59.938547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"177'1","reported_seq":11,"reported_epoch":177,"state":"active+clean","last_fresh":"2023-10-06T11:18:53.842833+0000","last_change":"2023-10-06T11:18:51.515072+0000","last_active":"2023-10-06T11:18:53.842833+0000","last_peered":"2023-10-06T11:18:53.842833+0000","last_clean":"2023-10-06T11:18:53.842833+0000","last_became_active":"2023-10-06T11:18:51.514821+0000","last_became_peered":"2023-10-06T11:18:51.514821+0000","last_unstale":"2023-10-06T11:18:53.842833+0000","last_undegraded":"2023-10-06T11:18:53.842833+0000","last_fullsized":"2023-10-06T11:18:53.842833+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:36:18.839256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.520421+0000","last_change":"2023-10-06T11:18:52.517301+0000","last_active":"2023-10-06T11:18:52.520421+0000","last_peered":"2023-10-06T11:18:52.520421+0000","last_clean":"2023-10-06T11:18:52.520421+0000","last_became_active":"2023-10-06T11:18:52.517017+0000","last_became_peered":"2023-10-06T11:18:52.517017+0000","last_unstale":"2023-10-06T11:18:52.520421+0000","last_undegraded":"2023-10-06T11:18:52.520421+0000","last_fullsized":"2023-10-06T11:18:52.520421+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:04:32.334758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.518219+0000","last_change":"2023-10-06T11:18:51.519403+0000","last_active":"2023-10-06T11:18:52.518219+0000","last_peered":"2023-10-06T11:18:52.518219+0000","last_clean":"2023-10-06T11:18:52.518219+0000","last_became_active":"2023-10-06T11:18:51.519130+0000","last_became_peered":"2023-10-06T11:18:51.519130+0000","last_unstale":"2023-10-06T11:18:52.518219+0000","last_undegraded":"2023-10-06T11:18:52.518219+0000","last_fullsized":"2023-10-06T11:18:52.518219+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:18:11.844126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.524603+0000","last_change":"2023-10-06T11:18:52.522834+0000","last_active":"2023-10-06T11:18:52.524603+0000","last_peered":"2023-10-06T11:18:52.524603+0000","last_clean":"2023-10-06T11:18:52.524603+0000","last_became_active":"2023-10-06T11:18:52.522527+0000","last_became_peered":"2023-10-06T11:18:52.522527+0000","last_unstale":"2023-10-06T11:18:52.524603+0000","last_undegraded":"2023-10-06T11:18:52.524603+0000","last_fullsized":"2023-10-06T11:18:52.524603+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:32:33.004446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.506225+0000","last_change":"2023-10-06T11:18:51.514269+0000","last_active":"2023-10-06T11:18:52.506225+0000","last_peered":"2023-10-06T11:18:52.506225+0000","last_clean":"2023-10-06T11:18:52.506225+0000","last_became_active":"2023-10-06T11:18:51.513894+0000","last_became_peered":"2023-10-06T11:18:51.513894+0000","last_unstale":"2023-10-06T11:18:52.506225+0000","last_undegraded":"2023-10-06T11:18:52.506225+0000","last_fullsized":"2023-10-06T11:18:52.506225+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:44:24.909538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.525217+0000","last_change":"2023-10-06T11:18:52.519139+0000","last_active":"2023-10-06T11:18:52.525217+0000","last_peered":"2023-10-06T11:18:52.525217+0000","last_clean":"2023-10-06T11:18:52.525217+0000","last_became_active":"2023-10-06T11:18:52.518861+0000","last_became_peered":"2023-10-06T11:18:52.518861+0000","last_unstale":"2023-10-06T11:18:52.525217+0000","last_undegraded":"2023-10-06T11:18:52.525217+0000","last_fullsized":"2023-10-06T11:18:52.525217+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:01:12.095547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.508771+0000","last_change":"2023-10-06T11:18:51.521725+0000","last_active":"2023-10-06T11:18:52.508771+0000","last_peered":"2023-10-06T11:18:52.508771+0000","last_clean":"2023-10-06T11:18:52.508771+0000","last_became_active":"2023-10-06T11:18:51.521427+0000","last_became_peered":"2023-10-06T11:18:51.521427+0000","last_unstale":"2023-10-06T11:18:52.508771+0000","last_undegraded":"2023-10-06T11:18:52.508771+0000","last_fullsized":"2023-10-06T11:18:52.508771+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:50:01.079097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.528463+0000","last_change":"2023-10-06T11:18:52.526293+0000","last_active":"2023-10-06T11:18:52.528463+0000","last_peered":"2023-10-06T11:18:52.528463+0000","last_clean":"2023-10-06T11:18:52.528463+0000","last_became_active":"2023-10-06T11:18:52.525758+0000","last_became_peered":"2023-10-06T11:18:52.525758+0000","last_unstale":"2023-10-06T11:18:52.528463+0000","last_undegraded":"2023-10-06T11:18:52.528463+0000","last_fullsized":"2023-10-06T11:18:52.528463+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:06:33.866195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.510733+0000","last_change":"2023-10-06T11:18:51.509456+0000","last_active":"2023-10-06T11:18:52.510733+0000","last_peered":"2023-10-06T11:18:52.510733+0000","last_clean":"2023-10-06T11:18:52.510733+0000","last_became_active":"2023-10-06T11:18:51.509128+0000","last_became_peered":"2023-10-06T11:18:51.509128+0000","last_unstale":"2023-10-06T11:18:52.510733+0000","last_undegraded":"2023-10-06T11:18:52.510733+0000","last_fullsized":"2023-10-06T11:18:52.510733+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:23:52.871290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.528488+0000","last_change":"2023-10-06T11:18:52.526424+0000","last_active":"2023-10-06T11:18:52.528488+0000","last_peered":"2023-10-06T11:18:52.528488+0000","last_clean":"2023-10-06T11:18:52.528488+0000","last_became_active":"2023-10-06T11:18:52.526147+0000","last_became_peered":"2023-10-06T11:18:52.526147+0000","last_unstale":"2023-10-06T11:18:52.528488+0000","last_undegraded":"2023-10-06T11:18:52.528488+0000","last_fullsized":"2023-10-06T11:18:52.528488+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:19:32.976623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.506921+0000","last_change":"2023-10-06T11:18:51.517756+0000","last_active":"2023-10-06T11:18:52.506921+0000","last_peered":"2023-10-06T11:18:52.506921+0000","last_clean":"2023-10-06T11:18:52.506921+0000","last_became_active":"2023-10-06T11:18:51.517490+0000","last_became_peered":"2023-10-06T11:18:51.517490+0000","last_unstale":"2023-10-06T11:18:52.506921+0000","last_undegraded":"2023-10-06T11:18:52.506921+0000","last_fullsized":"2023-10-06T11:18:52.506921+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:17:09.348316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.7","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.528237+0000","last_change":"2023-10-06T11:18:52.527687+0000","last_active":"2023-10-06T11:18:52.528237+0000","last_peered":"2023-10-06T11:18:52.528237+0000","last_clean":"2023-10-06T11:18:52.528237+0000","last_became_active":"2023-10-06T11:18:52.527423+0000","last_became_peered":"2023-10-06T11:18:52.527423+0000","last_unstale":"2023-10-06T11:18:52.528237+0000","last_undegraded":"2023-10-06T11:18:52.528237+0000","last_fullsized":"2023-10-06T11:18:52.528237+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:25:25.661614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.509694+0000","last_change":"2023-10-06T11:18:51.518706+0000","last_active":"2023-10-06T11:18:52.509694+0000","last_peered":"2023-10-06T11:18:52.509694+0000","last_clean":"2023-10-06T11:18:52.509694+0000","last_became_active":"2023-10-06T11:18:51.518437+0000","last_became_peered":"2023-10-06T11:18:51.518437+0000","last_unstale":"2023-10-06T11:18:52.509694+0000","last_undegraded":"2023-10-06T11:18:52.509694+0000","last_fullsized":"2023-10-06T11:18:52.509694+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:40:30.300613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.519733+0000","last_change":"2023-10-06T11:18:52.516550+0000","last_active":"2023-10-06T11:18:52.519733+0000","last_peered":"2023-10-06T11:18:52.519733+0000","last_clean":"2023-10-06T11:18:52.519733+0000","last_became_active":"2023-10-06T11:18:52.516068+0000","last_became_peered":"2023-10-06T11:18:52.516068+0000","last_unstale":"2023-10-06T11:18:52.519733+0000","last_undegraded":"2023-10-06T11:18:52.519733+0000","last_fullsized":"2023-10-06T11:18:52.519733+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:05:10.941482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.1f","version":"176'4","reported_seq":14,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.532075+0000","last_change":"2023-10-06T11:18:51.518899+0000","last_active":"2023-10-06T11:18:52.532075+0000","last_peered":"2023-10-06T11:18:52.532075+0000","last_clean":"2023-10-06T11:18:52.532075+0000","last_became_active":"2023-10-06T11:18:51.517840+0000","last_became_peered":"2023-10-06T11:18:51.517840+0000","last_unstale":"2023-10-06T11:18:52.532075+0000","last_undegraded":"2023-10-06T11:18:52.532075+0000","last_fullsized":"2023-10-06T11:18:52.532075+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:01:35.577133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":156,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.518301+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:18:52.518301+0000","last_peered":"2023-10-06T11:18:52.518301+0000","last_clean":"2023-10-06T11:18:52.518301+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:18:52.518301+0000","last_undegraded":"2023-10-06T11:18:52.518301+0000","last_fullsized":"2023-10-06T11:18:52.518301+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.529460+0000","last_change":"2023-10-06T11:18:52.528455+0000","last_active":"2023-10-06T11:18:52.529460+0000","last_peered":"2023-10-06T11:18:52.529460+0000","last_clean":"2023-10-06T11:18:52.529460+0000","last_became_active":"2023-10-06T11:18:52.528189+0000","last_became_peered":"2023-10-06T11:18:52.528189+0000","last_unstale":"2023-10-06T11:18:52.529460+0000","last_undegraded":"2023-10-06T11:18:52.529460+0000","last_fullsized":"2023-10-06T11:18:52.529460+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:11:39.954034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1e","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.521337+0000","last_change":"2023-10-06T11:18:51.514321+0000","last_active":"2023-10-06T11:18:52.521337+0000","last_peered":"2023-10-06T11:18:52.521337+0000","last_clean":"2023-10-06T11:18:52.521337+0000","last_became_active":"2023-10-06T11:18:51.514016+0000","last_became_peered":"2023-10-06T11:18:51.514016+0000","last_unstale":"2023-10-06T11:18:52.521337+0000","last_undegraded":"2023-10-06T11:18:52.521337+0000","last_fullsized":"2023-10-06T11:18:52.521337+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:10:52.141969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":147,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.510184+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:18:52.510184+0000","last_peered":"2023-10-06T11:18:52.510184+0000","last_clean":"2023-10-06T11:18:52.510184+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:18:52.510184+0000","last_undegraded":"2023-10-06T11:18:52.510184+0000","last_fullsized":"2023-10-06T11:18:52.510184+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.1e","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.532775+0000","last_change":"2023-10-06T11:18:52.528081+0000","last_active":"2023-10-06T11:18:52.532775+0000","last_peered":"2023-10-06T11:18:52.532775+0000","last_clean":"2023-10-06T11:18:52.532775+0000","last_became_active":"2023-10-06T11:18:52.527894+0000","last_became_peered":"2023-10-06T11:18:52.527894+0000","last_unstale":"2023-10-06T11:18:52.532775+0000","last_undegraded":"2023-10-06T11:18:52.532775+0000","last_fullsized":"2023-10-06T11:18:52.532775+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:50:12.399641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.514939+0000","last_change":"2023-10-06T11:18:51.518140+0000","last_active":"2023-10-06T11:18:52.514939+0000","last_peered":"2023-10-06T11:18:52.514939+0000","last_clean":"2023-10-06T11:18:52.514939+0000","last_became_active":"2023-10-06T11:18:51.517880+0000","last_became_peered":"2023-10-06T11:18:51.517880+0000","last_unstale":"2023-10-06T11:18:52.514939+0000","last_undegraded":"2023-10-06T11:18:52.514939+0000","last_fullsized":"2023-10-06T11:18:52.514939+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:40:37.215095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":144,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.504529+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:18:52.504529+0000","last_peered":"2023-10-06T11:18:52.504529+0000","last_clean":"2023-10-06T11:18:52.504529+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:18:52.504529+0000","last_undegraded":"2023-10-06T11:18:52.504529+0000","last_fullsized":"2023-10-06T11:18:52.504529+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":288,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.514431+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:18:52.514431+0000","last_peered":"2023-10-06T11:18:52.514431+0000","last_clean":"2023-10-06T11:18:52.514431+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:18:52.514431+0000","last_undegraded":"2023-10-06T11:18:52.514431+0000","last_fullsized":"2023-10-06T11:18:52.514431+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1f","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.528995+0000","last_change":"2023-10-06T11:18:52.527928+0000","last_active":"2023-10-06T11:18:52.528995+0000","last_peered":"2023-10-06T11:18:52.528995+0000","last_clean":"2023-10-06T11:18:52.528995+0000","last_became_active":"2023-10-06T11:18:52.527674+0000","last_became_peered":"2023-10-06T11:18:52.527674+0000","last_unstale":"2023-10-06T11:18:52.528995+0000","last_undegraded":"2023-10-06T11:18:52.528995+0000","last_fullsized":"2023-10-06T11:18:52.528995+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:21:18.976853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":10,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.504354+0000","last_change":"2023-10-06T11:18:51.518700+0000","last_active":"2023-10-06T11:18:52.504354+0000","last_peered":"2023-10-06T11:18:52.504354+0000","last_clean":"2023-10-06T11:18:52.504354+0000","last_became_active":"2023-10-06T11:18:51.518426+0000","last_became_peered":"2023-10-06T11:18:51.518426+0000","last_unstale":"2023-10-06T11:18:52.504354+0000","last_undegraded":"2023-10-06T11:18:52.504354+0000","last_fullsized":"2023-10-06T11:18:52.504354+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:50:11.395470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":138,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.514265+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:18:52.514265+0000","last_peered":"2023-10-06T11:18:52.514265+0000","last_clean":"2023-10-06T11:18:52.514265+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:18:52.514265+0000","last_undegraded":"2023-10-06T11:18:52.514265+0000","last_fullsized":"2023-10-06T11:18:52.514265+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1d","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.526031+0000","last_change":"2023-10-06T11:18:52.521779+0000","last_active":"2023-10-06T11:18:52.526031+0000","last_peered":"2023-10-06T11:18:52.526031+0000","last_clean":"2023-10-06T11:18:52.526031+0000","last_became_active":"2023-10-06T11:18:52.521521+0000","last_became_peered":"2023-10-06T11:18:52.521521+0000","last_unstale":"2023-10-06T11:18:52.526031+0000","last_undegraded":"2023-10-06T11:18:52.526031+0000","last_fullsized":"2023-10-06T11:18:52.526031+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:47:38.557270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1a","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.519977+0000","last_change":"2023-10-06T11:18:51.516353+0000","last_active":"2023-10-06T11:18:52.519977+0000","last_peered":"2023-10-06T11:18:52.519977+0000","last_clean":"2023-10-06T11:18:52.519977+0000","last_became_active":"2023-10-06T11:18:51.515623+0000","last_became_peered":"2023-10-06T11:18:51.515623+0000","last_unstale":"2023-10-06T11:18:52.519977+0000","last_undegraded":"2023-10-06T11:18:52.519977+0000","last_fullsized":"2023-10-06T11:18:52.519977+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:50:46.250411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":138,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.514503+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:18:52.514503+0000","last_peered":"2023-10-06T11:18:52.514503+0000","last_clean":"2023-10-06T11:18:52.514503+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:18:52.514503+0000","last_undegraded":"2023-10-06T11:18:52.514503+0000","last_fullsized":"2023-10-06T11:18:52.514503+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1c","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.532684+0000","last_change":"2023-10-06T11:18:52.526513+0000","last_active":"2023-10-06T11:18:52.532684+0000","last_peered":"2023-10-06T11:18:52.532684+0000","last_clean":"2023-10-06T11:18:52.532684+0000","last_became_active":"2023-10-06T11:18:52.526089+0000","last_became_peered":"2023-10-06T11:18:52.526089+0000","last_unstale":"2023-10-06T11:18:52.532684+0000","last_undegraded":"2023-10-06T11:18:52.532684+0000","last_fullsized":"2023-10-06T11:18:52.532684+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:11:39.954034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1b","version":"176'1","reported_seq":11,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.532985+0000","last_change":"2023-10-06T11:18:51.521403+0000","last_active":"2023-10-06T11:18:52.532985+0000","last_peered":"2023-10-06T11:18:52.532985+0000","last_clean":"2023-10-06T11:18:52.532985+0000","last_became_active":"2023-10-06T11:18:51.521062+0000","last_became_peered":"2023-10-06T11:18:51.521062+0000","last_unstale":"2023-10-06T11:18:52.532985+0000","last_undegraded":"2023-10-06T11:18:52.532985+0000","last_fullsized":"2023-10-06T11:18:52.532985+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:13:58.826299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":164,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.506975+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:18:52.506975+0000","last_peered":"2023-10-06T11:18:52.506975+0000","last_clean":"2023-10-06T11:18:52.506975+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:18:52.506975+0000","last_undegraded":"2023-10-06T11:18:52.506975+0000","last_fullsized":"2023-10-06T11:18:52.506975+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1b","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.522988+0000","last_change":"2023-10-06T11:18:52.520697+0000","last_active":"2023-10-06T11:18:52.522988+0000","last_peered":"2023-10-06T11:18:52.522988+0000","last_clean":"2023-10-06T11:18:52.522988+0000","last_became_active":"2023-10-06T11:18:52.519884+0000","last_became_peered":"2023-10-06T11:18:52.519884+0000","last_unstale":"2023-10-06T11:18:52.522988+0000","last_undegraded":"2023-10-06T11:18:52.522988+0000","last_fullsized":"2023-10-06T11:18:52.522988+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:02:03.453023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1c","version":"176'2","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.527840+0000","last_change":"2023-10-06T11:18:51.509607+0000","last_active":"2023-10-06T11:18:52.527840+0000","last_peered":"2023-10-06T11:18:52.527840+0000","last_clean":"2023-10-06T11:18:52.527840+0000","last_became_active":"2023-10-06T11:18:51.509324+0000","last_became_peered":"2023-10-06T11:18:51.509324+0000","last_unstale":"2023-10-06T11:18:52.527840+0000","last_undegraded":"2023-10-06T11:18:52.527840+0000","last_fullsized":"2023-10-06T11:18:52.527840+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:05:09.937311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":145,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.506384+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:18:52.506384+0000","last_peered":"2023-10-06T11:18:52.506384+0000","last_clean":"2023-10-06T11:18:52.506384+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:18:52.506384+0000","last_undegraded":"2023-10-06T11:18:52.506384+0000","last_fullsized":"2023-10-06T11:18:52.506384+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1a","version":"0'0","reported_seq":9,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.523190+0000","last_change":"2023-10-06T11:18:52.515221+0000","last_active":"2023-10-06T11:18:52.523190+0000","last_peered":"2023-10-06T11:18:52.523190+0000","last_clean":"2023-10-06T11:18:52.523190+0000","last_became_active":"2023-10-06T11:18:52.514792+0000","last_became_peered":"2023-10-06T11:18:52.514792+0000","last_unstale":"2023-10-06T11:18:52.523190+0000","last_undegraded":"2023-10-06T11:18:52.523190+0000","last_fullsized":"2023-10-06T11:18:52.523190+0000","mapping_epoch":175,"log_start":"0'0","ondisk_log_start":"0'0","created":175,"last_epoch_clean":176,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:51.490762+0000","last_clean_scrub_stamp":"2023-10-06T11:18:51.490762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T23:12:58.880101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1d","version":"176'2","reported_seq":12,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.523276+0000","last_change":"2023-10-06T11:18:51.517858+0000","last_active":"2023-10-06T11:18:52.523276+0000","last_peered":"2023-10-06T11:18:52.523276+0000","last_clean":"2023-10-06T11:18:52.523276+0000","last_became_active":"2023-10-06T11:18:51.517572+0000","last_became_peered":"2023-10-06T11:18:51.517572+0000","last_unstale":"2023-10-06T11:18:52.523276+0000","last_undegraded":"2023-10-06T11:18:52.523276+0000","last_fullsized":"2023-10-06T11:18:52.523276+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":174,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:18:50.486591+0000","last_clean_scrub_stamp":"2023-10-06T11:18:50.486591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:31:28.442952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":145,"reported_epoch":176,"state":"active+clean","last_fresh":"2023-10-06T11:18:52.510504+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:18:52.510504+0000","last_peered":"2023-10-06T11:18:52.510504+0000","last_clean":"2023-10-06T11:18:52.510504+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:18:52.510504+0000","last_undegraded":"2023-10-06T11:18:52.510504+0000","last_fullsized":"2023-10-06T11:18:52.510504+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":28,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":27,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575011,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304160,"kb_used_data":2776,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067680,"statfs":{"total":96636764160,"available":96325304320,"internally_reserved":0,"allocated":2842624,"data_stored":1624928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.54400000000000004,"15min":0.629},"min":{"1min":0.35899999999999999,"5min":0.252,"15min":0.21199999999999999},"max":{"1min":0.70999999999999996,"5min":4.407,"15min":23.908999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.52500000000000002,"15min":0.57799999999999996},"min":{"1min":0.38200000000000001,"5min":0.26900000000000002,"15min":0.22500000000000001},"max":{"1min":0.71699999999999997,"5min":0.76800000000000002,"15min":9.3230000000000004},"last":0.47099999999999997}]},{"osd":1,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54500000000000004,"15min":0.55900000000000005},"min":{"1min":0.439,"5min":0.28399999999999997,"15min":0.26000000000000001},"max":{"1min":0.72699999999999998,"5min":2.4689999999999999,"15min":9.2360000000000007},"last":0.379},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.5,"15min":0.505},"min":{"1min":0.373,"5min":0.33100000000000002,"15min":0.25900000000000001},"max":{"1min":0.63900000000000001,"5min":0.70899999999999996,"15min":4.327},"last":0.51000000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.56499999999999995,"15min":0.52100000000000002},"min":{"1min":0.379,"5min":0.34399999999999997,"15min":0.26500000000000001},"max":{"1min":0.67000000000000004,"5min":4.3120000000000003,"15min":4.3120000000000003},"last":0.498},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56299999999999994,"15min":0.55800000000000005},"min":{"1min":0.46300000000000002,"5min":0.311,"15min":0.29999999999999999},"max":{"1min":0.65400000000000003,"5min":3.0600000000000001,"15min":4.7309999999999999},"last":0.53300000000000003}]},{"osd":3,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56899999999999995,"15min":0.54500000000000004},"min":{"1min":0.45300000000000001,"5min":0.32600000000000001,"15min":0.27900000000000003},"max":{"1min":0.69899999999999995,"5min":4.5190000000000001,"15min":4.5190000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.44800000000000001,"5min":0.374,"15min":0.29699999999999999},"max":{"1min":0.73199999999999998,"5min":3.0070000000000001,"15min":9.3879999999999999},"last":0.57499999999999996}]},{"osd":4,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.52600000000000002,"15min":0.49299999999999999},"min":{"1min":0.32600000000000001,"5min":0.29799999999999999,"15min":0.24399999999999999},"max":{"1min":0.59099999999999997,"5min":4.6639999999999997,"15min":4.6639999999999997},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.56799999999999995,"15min":0.53500000000000003},"min":{"1min":0.41999999999999998,"5min":0.28499999999999998,"15min":0.27300000000000002},"max":{"1min":0.64700000000000002,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":0.54700000000000004}]},{"osd":5,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.53200000000000003,"15min":0.55700000000000005},"min":{"1min":0.33100000000000002,"5min":0.32900000000000001,"15min":0.26000000000000001},"max":{"1min":0.72399999999999998,"5min":0.77000000000000002,"15min":9.3499999999999996},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.502,"5min":0.52500000000000002,"15min":0.53800000000000003},"min":{"1min":0.371,"5min":0.30099999999999999,"15min":0.26800000000000002},"max":{"1min":0.71399999999999997,"5min":0.89100000000000001,"15min":4.444},"last":0.56100000000000005}]},{"osd":6,"last update":"Fri Oct 6 11:18:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.56699999999999995,"15min":0.59299999999999997},"min":{"1min":0.39500000000000002,"5min":0.38100000000000001,"15min":0.29199999999999998},"max":{"1min":0.68600000000000005,"5min":0.82099999999999995,"15min":9.4969999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.63200000000000001,"15min":0.61899999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.74199999999999999,"5min":4.4669999999999996,"15min":7.2039999999999997},"last":0.621}]}]},{"osd":6,"up_from":13,"seq":55834575013,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299480,"kb_used_data":2192,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072360,"statfs":{"total":96636764160,"available":96330096640,"internally_reserved":0,"allocated":2244608,"data_stored":1033691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.625,"15min":0.52900000000000003},"min":{"1min":0.218,"5min":0.218,"15min":0.187},"max":{"1min":1.488,"5min":9.5549999999999997,"15min":9.5549999999999997},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.72099999999999997,"15min":0.59099999999999997},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.254},"max":{"1min":4.9930000000000003,"5min":9.4659999999999993,"15min":9.4659999999999993},"last":0.70999999999999996}]},{"osd":1,"last update":"Fri Oct 6 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.52300000000000002,"15min":0.49199999999999999},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23300000000000001},"max":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":1.6200000000000001,"5min":0.75700000000000001,"15min":0.59499999999999997},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.216},"max":{"1min":21.306000000000001,"5min":21.306000000000001,"15min":21.306000000000001},"last":0.65100000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.54700000000000004,"15min":0.52000000000000002},"min":{"1min":0.34300000000000003,"5min":0.255,"15min":0.252},"max":{"1min":2.8250000000000002,"5min":2.8250000000000002,"15min":7.0659999999999998},"last":0.52400000000000002},{"interface":"front","average":{"1min":1.4099999999999999,"5min":0.70299999999999996,"15min":0.58299999999999996},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.26600000000000001},"max":{"1min":17.216000000000001,"5min":17.216000000000001,"15min":17.216000000000001},"last":0.54700000000000004}]},{"osd":3,"last update":"Fri Oct 6 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.628,"15min":0.54700000000000004},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.25800000000000001},"max":{"1min":4.9400000000000004,"5min":4.9400000000000004,"15min":4.9400000000000004},"last":0.58599999999999997},{"interface":"front","average":{"1min":1.2070000000000001,"5min":0.68799999999999994,"15min":0.58099999999999996},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":12.159000000000001,"5min":12.159000000000001,"15min":12.159000000000001},"last":0.68500000000000005}]},{"osd":4,"last update":"Fri Oct 6 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.50800000000000001,"15min":0.48299999999999998},"min":{"1min":0.317,"5min":0.26800000000000002,"15min":0.24299999999999999},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.58899999999999997,"15min":0.54700000000000004},"min":{"1min":0.32900000000000001,"5min":0.29699999999999999,"15min":0.27900000000000003},"max":{"1min":4.8949999999999996,"5min":4.8949999999999996,"15min":4.8949999999999996},"last":0.752}]},{"osd":5,"last update":"Fri Oct 6 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.55200000000000005,"15min":0.52400000000000002},"min":{"1min":0.38500000000000001,"5min":0.33000000000000002,"15min":0.28399999999999997},"max":{"1min":1.9690000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.69299999999999995,"15min":0.59799999999999998},"min":{"1min":0.35999999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":4.7080000000000002,"5min":7.1379999999999999,"15min":7.1379999999999999},"last":0.72799999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:18:55 2023","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.65100000000000002,"15min":0.59099999999999997},"min":{"1min":0.38600000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":5.7709999999999999,"5min":5.7709999999999999,"15min":5.7709999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.64100000000000001,"15min":0.59799999999999998},"min":{"1min":0.40200000000000002,"5min":0.374,"15min":0.30199999999999999},"max":{"1min":3.5579999999999998,"5min":3.5579999999999998,"15min":3.5579999999999998},"last":0.74299999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575012,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":300048,"kb_used_data":2760,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071792,"statfs":{"total":96636764160,"available":96329515008,"internally_reserved":0,"allocated":2826240,"data_stored":1623322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.47799999999999998,"15min":0.377},"min":{"1min":0.20499999999999999,"5min":0.20499999999999999,"15min":0.186},"max":{"1min":0.54000000000000004,"5min":13.393000000000001,"15min":13.393000000000001},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.374,"5min":0.47599999999999998,"15min":0.38800000000000001},"min":{"1min":0.247,"5min":0.22700000000000001,"15min":0.19700000000000001},"max":{"1min":0.52100000000000002,"5min":11.462,"15min":11.462},"last":0.32300000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.41999999999999998,"15min":0.36299999999999999},"min":{"1min":0.217,"5min":0.217,"15min":0.216},"max":{"1min":0.56000000000000005,"5min":8.0470000000000006,"15min":8.0470000000000006},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.45900000000000002,"15min":0.41099999999999998},"min":{"1min":0.27100000000000002,"5min":0.215,"15min":0.20999999999999999},"max":{"1min":0.66700000000000004,"5min":4.8630000000000004,"15min":4.8630000000000004},"last":0.36699999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.47599999999999998,"15min":0.42799999999999999},"min":{"1min":0.311,"5min":0.255,"15min":0.252},"max":{"1min":0.63700000000000001,"5min":4.8029999999999999,"15min":4.8029999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.46100000000000002,"15min":0.40200000000000002},"min":{"1min":0.23799999999999999,"5min":0.23400000000000001,"15min":0.217},"max":{"1min":0.61799999999999999,"5min":5.8700000000000001,"15min":5.8700000000000001},"last":0.46999999999999997}]},{"osd":4,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56399999999999995,"15min":0.53200000000000003},"min":{"1min":0.42499999999999999,"5min":0.28299999999999997,"15min":0.28199999999999997},"max":{"1min":0.83099999999999996,"5min":1.264,"15min":1.264},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.64200000000000002,"15min":0.57999999999999996},"min":{"1min":0.46700000000000003,"5min":0.317,"15min":0.317},"max":{"1min":0.85299999999999998,"5min":4.7699999999999996,"15min":4.7699999999999996},"last":0.628}]},{"osd":5,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.624,"15min":0.57599999999999996},"min":{"1min":0.432,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.79900000000000004,"5min":3.4390000000000001,"15min":3.4390000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.70799999999999996,"15min":0.60199999999999998},"min":{"1min":0.47599999999999998,"5min":0.36799999999999999,"15min":0.29499999999999998},"max":{"1min":0.92000000000000004,"5min":9.3829999999999991,"15min":9.3829999999999991},"last":0.75900000000000001}]},{"osd":6,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.66500000000000004,"15min":0.60199999999999998},"min":{"1min":0.47799999999999998,"5min":0.35999999999999999,"15min":0.315},"max":{"1min":0.90800000000000003,"5min":3.4750000000000001,"15min":3.4750000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.66400000000000003,"15min":0.60999999999999999},"min":{"1min":0.45400000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.89700000000000002,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.70199999999999996}]},{"osd":7,"last update":"Fri Oct 6 11:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68200000000000005,"15min":0.621},"min":{"1min":0.44400000000000001,"5min":0.39800000000000002,"15min":0.38500000000000001},"max":{"1min":0.90300000000000002,"5min":4.7290000000000001,"15min":4.7290000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.64300000000000002,"15min":0.60199999999999998},"min":{"1min":0.47399999999999998,"5min":0.38900000000000001,"15min":0.374},"max":{"1min":0.871,"5min":2.4500000000000002,"15min":2.4500000000000002},"last":0.72299999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575011,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303564,"kb_used_data":2180,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068276,"statfs":{"total":96636764160,"available":96325914624,"internally_reserved":0,"allocated":2232320,"data_stored":1031691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.34599999999999997,"15min":0.47299999999999998},"min":{"1min":0.23999999999999999,"5min":0.20399999999999999,"15min":0.184},"max":{"1min":0.55500000000000005,"5min":0.60199999999999998,"15min":36.097999999999999},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.36499999999999999,"15min":0.38600000000000001},"min":{"1min":0.26400000000000001,"5min":0.22,"15min":0.182},"max":{"1min":0.51400000000000001,"5min":0.92400000000000004,"15min":7.2990000000000004},"last":0.32300000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.36599999999999999,"15min":0.50600000000000001},"min":{"1min":0.315,"5min":0.223,"15min":0.217},"max":{"1min":0.56100000000000005,"5min":0.61699999999999999,"15min":36.07},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.39400000000000002,"15min":0.41299999999999998},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.219},"max":{"1min":0.60799999999999998,"5min":0.94899999999999995,"15min":6.7800000000000002},"last":0.39900000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.36299999999999999,"15min":0.39600000000000002},"min":{"1min":0.28100000000000003,"5min":0.255,"15min":0.223},"max":{"1min":0.504,"5min":0.55000000000000004,"15min":8.4130000000000003},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.42799999999999999,"15min":0.56000000000000005},"min":{"1min":0.28599999999999998,"5min":0.25800000000000001,"15min":0.249},"max":{"1min":0.59099999999999997,"5min":1.9079999999999999,"15min":35.959000000000003},"last":0.373}]},{"osd":4,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.59199999999999997,"15min":0.57299999999999995},"min":{"1min":0.496,"5min":0.33800000000000002,"15min":0.29599999999999999},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":2.427},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.60799999999999998,"15min":0.73399999999999999},"min":{"1min":0.496,"5min":0.374,"15min":0.29299999999999998},"max":{"1min":0.91100000000000003,"5min":0.94999999999999996,"15min":36.005000000000003},"last":0.627}]},{"osd":5,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.39400000000000002,"5min":0.38400000000000001,"15min":0.32900000000000001},"max":{"1min":0.86199999999999999,"5min":0.999,"15min":6.6699999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57699999999999996,"15min":0.56299999999999994},"min":{"1min":0.41399999999999998,"5min":0.372,"15min":0.315},"max":{"1min":0.77200000000000002,"5min":0.99399999999999999,"15min":2.0600000000000001},"last":0.61899999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.61299999999999999,"15min":0.73499999999999999},"min":{"1min":0.45800000000000002,"5min":0.39200000000000002,"15min":0.317},"max":{"1min":0.878,"5min":0.98699999999999999,"15min":36.037999999999997},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.63100000000000001,"15min":0.64400000000000002},"min":{"1min":0.45800000000000002,"5min":0.40999999999999998,"15min":0.36399999999999999},"max":{"1min":0.88800000000000001,"5min":1.028,"15min":6.7110000000000003},"last":0.67500000000000004}]},{"osd":7,"last update":"Fri Oct 6 11:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.47399999999999998,"5min":0.432,"15min":0.371},"max":{"1min":0.80400000000000005,"5min":1.054,"15min":6.742},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.58799999999999997,"15min":0.57799999999999996},"min":{"1min":0.46200000000000002,"5min":0.41399999999999998,"15min":0.34499999999999997},"max":{"1min":0.89300000000000002,"5min":0.96199999999999997,"15min":1.917},"last":0.56799999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575012,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299468,"kb_used_data":2180,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072372,"statfs":{"total":96636764160,"available":96330108928,"internally_reserved":0,"allocated":2232320,"data_stored":1031691,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.47499999999999998,"15min":0.36599999999999999},"min":{"1min":0.24399999999999999,"5min":0.214,"15min":0.17999999999999999},"max":{"1min":0.622,"5min":15.228,"15min":15.228},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.40699999999999997,"15min":0.39200000000000002},"min":{"1min":0.32000000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.72599999999999998,"5min":1.714,"15min":1.714},"last":0.30199999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.379,"15min":0.376},"min":{"1min":0.253,"5min":0.23599999999999999,"15min":0.19900000000000001},"max":{"1min":0.56999999999999995,"5min":0.57499999999999996,"15min":0.745},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.36599999999999999,"15min":0.35699999999999998},"min":{"1min":0.26000000000000001,"5min":0.23200000000000001,"15min":0.216},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.246}]},{"osd":3,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.36699999999999999,"15min":0.36899999999999999},"min":{"1min":0.27000000000000002,"5min":0.23699999999999999,"15min":0.23200000000000001},"max":{"1min":0.60899999999999999,"5min":0.621,"15min":0.629},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.38800000000000001,"15min":0.371},"min":{"1min":0.29499999999999998,"5min":0.254,"15min":0.251},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.28299999999999997}]},{"osd":4,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.54500000000000004,"15min":0.53400000000000003},"min":{"1min":0.439,"5min":0.30599999999999999,"15min":0.30299999999999999},"max":{"1min":0.69699999999999995,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.68799999999999994,"15min":0.59399999999999997},"min":{"1min":0.374,"5min":0.28199999999999997,"15min":0.27900000000000003},"max":{"1min":0.70999999999999996,"5min":15.26,"15min":15.26},"last":0.68000000000000005}]},{"osd":5,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.69799999999999995,"15min":0.59599999999999997},"min":{"1min":0.39700000000000002,"5min":0.35799999999999998,"15min":0.32400000000000001},"max":{"1min":0.73699999999999999,"5min":15.186,"15min":15.186},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56799999999999995,"15min":0.56100000000000005},"min":{"1min":0.42999999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72199999999999998,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.71099999999999997}]},{"osd":6,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59299999999999997,"15min":0.58599999999999997},"min":{"1min":0.48299999999999998,"5min":0.38200000000000001,"15min":0.32600000000000001},"max":{"1min":0.76900000000000002,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59599999999999997,"15min":0.57999999999999996},"min":{"1min":0.438,"5min":0.40699999999999997,"15min":0.34200000000000003},"max":{"1min":0.80500000000000005,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.68899999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:18:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.67300000000000004,"15min":0.59999999999999998},"min":{"1min":0.41699999999999998,"5min":0.37,"15min":0.34499999999999997},"max":{"1min":0.69399999999999995,"5min":10.977,"15min":10.977},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57799999999999996,"15min":0.57399999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.38200000000000001},"max":{"1min":0.79400000000000004,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.50700000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575012,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311764,"kb_used_data":2188,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060076,"statfs":{"total":96636764160,"available":96317517824,"internally_reserved":0,"allocated":2240512,"data_stored":1031727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.34799999999999998,"15min":0.32800000000000001},"min":{"1min":0.20799999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.55200000000000005,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.41999999999999998,"15min":0.39100000000000001},"min":{"1min":0.26800000000000002,"5min":0.23000000000000001,"15min":0.22700000000000001},"max":{"1min":0.61099999999999999,"5min":4.4820000000000002,"15min":4.4820000000000002},"last":0.28999999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.32100000000000001,"15min":0.315},"min":{"1min":0.22800000000000001,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.48199999999999998,"5min":0.54000000000000004,"15min":0.65400000000000003},"last":0.247},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.36499999999999999,"15min":0.35799999999999998},"min":{"1min":0.28899999999999998,"5min":0.254,"15min":0.188},"max":{"1min":0.52300000000000002,"5min":0.53600000000000003,"15min":1.196},"last":0.27200000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.39900000000000002,"15min":0.38200000000000001},"min":{"1min":0.25,"5min":0.245,"15min":0.19600000000000001},"max":{"1min":0.52100000000000002,"5min":4.601,"15min":4.601},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.44400000000000001,"15min":0.41999999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.26100000000000001},"max":{"1min":0.60599999999999998,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.33500000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.55300000000000005,"15min":0.54700000000000004},"min":{"1min":0.38800000000000001,"5min":0.32100000000000001,"15min":0.311},"max":{"1min":0.76500000000000001,"5min":0.88500000000000001,"15min":1.694},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.55500000000000005,"15min":0.54200000000000004},"min":{"1min":0.438,"5min":0.32600000000000001,"15min":0.30199999999999999},"max":{"1min":0.71699999999999997,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.63900000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.55800000000000005,"15min":0.54100000000000004},"min":{"1min":0.42199999999999999,"5min":0.34100000000000003,"15min":0.29399999999999998},"max":{"1min":0.83999999999999997,"5min":0.86399999999999999,"15min":0.878},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.56200000000000006,"15min":0.55600000000000005},"min":{"1min":0.40899999999999997,"5min":0.35699999999999998,"15min":0.29699999999999999},"max":{"1min":0.877,"5min":0.877,"15min":1.165},"last":0.625}]},{"osd":6,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.59499999999999997,"15min":0.58099999999999996},"min":{"1min":0.501,"5min":0.372,"15min":0.36699999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":1.1359999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.58999999999999997,"15min":0.58699999999999997},"min":{"1min":0.45500000000000002,"5min":0.36799999999999999,"15min":0.34399999999999997},"max":{"1min":0.80600000000000005,"5min":0.82999999999999996,"15min":1.7470000000000001},"last":0.82499999999999996}]},{"osd":7,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.57499999999999996,"15min":0.57599999999999996},"min":{"1min":0.41599999999999998,"5min":0.38900000000000001,"15min":0.35599999999999998},"max":{"1min":0.79300000000000004,"5min":0.89900000000000002,"15min":1.657},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.628,"5min":0.58699999999999997,"15min":0.57599999999999996},"min":{"1min":0.46300000000000002,"5min":0.38,"15min":0.35499999999999998},"max":{"1min":0.86199999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.68999999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575011,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307664,"kb_used_data":2184,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064176,"statfs":{"total":96636764160,"available":96321716224,"internally_reserved":0,"allocated":2236416,"data_stored":1033508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.47899999999999998,"15min":0.50700000000000001},"min":{"1min":0.24199999999999999,"5min":0.216,"15min":0.19500000000000001},"max":{"1min":0.68700000000000006,"5min":0.82099999999999995,"15min":2.6619999999999999},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.499,"15min":0.49399999999999999},"min":{"1min":0.28899999999999998,"5min":0.224,"15min":0.215},"max":{"1min":0.76200000000000001,"5min":0.81499999999999995,"15min":0.91200000000000003},"last":0.63600000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.50700000000000001,"15min":0.53000000000000003},"min":{"1min":0.308,"5min":0.27300000000000002,"15min":0.23300000000000001},"max":{"1min":0.77300000000000002,"5min":1,"15min":2.8650000000000002},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.505,"15min":0.53500000000000003},"min":{"1min":0.35299999999999998,"5min":0.27000000000000002,"15min":0.25800000000000001},"max":{"1min":0.79800000000000004,"5min":1.2869999999999999,"15min":2.7610000000000001},"last":0.442}]},{"osd":2,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.52900000000000003,"15min":0.53000000000000003},"min":{"1min":0.44500000000000001,"5min":0.28499999999999998,"15min":0.23100000000000001},"max":{"1min":0.70399999999999996,"5min":0.77400000000000002,"15min":1.6910000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.56699999999999995,"15min":0.57699999999999996},"min":{"1min":0.44800000000000001,"5min":0.33100000000000002,"15min":0.30599999999999999},"max":{"1min":0.82099999999999995,"5min":0.82799999999999996,"15min":1.718},"last":0.501}]},{"osd":3,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.57399999999999995,"15min":0.57799999999999996},"min":{"1min":0.38800000000000001,"5min":0.32000000000000001,"15min":0.26700000000000002},"max":{"1min":0.67500000000000004,"5min":2.387,"15min":2.677},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.54600000000000004,"15min":0.52800000000000002},"min":{"1min":0.40100000000000002,"5min":0.29299999999999998,"15min":0.27500000000000002},"max":{"1min":0.77700000000000002,"5min":1.784,"15min":1.784},"last":0.46200000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.47799999999999998,"15min":0.47999999999999998},"min":{"1min":0.36499999999999999,"5min":0.28499999999999998,"15min":0.23200000000000001},"max":{"1min":0.60299999999999998,"5min":0.73199999999999998,"15min":0.80200000000000005},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.51700000000000002,"15min":0.52300000000000002},"min":{"1min":0.317,"5min":0.28899999999999998,"15min":0.28399999999999997},"max":{"1min":0.752,"5min":0.752,"15min":0.82799999999999996},"last":0.60799999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.252},"max":{"1min":0.79500000000000004,"5min":0.83499999999999996,"15min":0.89000000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54500000000000004,"15min":0.55400000000000005},"min":{"1min":0.38700000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.72899999999999998,"5min":0.80200000000000005,"15min":1.165},"last":0.48699999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:17:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55300000000000005,"15min":0.55700000000000005},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.71199999999999997,"5min":0.84999999999999998,"15min":0.90500000000000003},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58499999999999996,"15min":0.58899999999999997},"min":{"1min":0.34399999999999997,"5min":0.318,"15min":0.317},"max":{"1min":0.81299999999999994,"5min":0.875,"15min":0.95499999999999996},"last":0.53500000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575013,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":315860,"kb_used_data":2188,"kb_used_omap":0,"kb_used_meta":313664,"kb_avail":94055980,"statfs":{"total":96636764160,"available":96313323520,"internally_reserved":0,"allocated":2240512,"data_stored":1033010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":321191936},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.48199999999999998,"15min":0.55900000000000005},"min":{"1min":0.32800000000000001,"5min":0.23300000000000001,"15min":0.20499999999999999},"max":{"1min":0.752,"5min":0.752,"15min":5.0490000000000004},"last":0.624},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.47799999999999998,"15min":0.54100000000000004},"min":{"1min":0.34699999999999998,"5min":0.253,"15min":0.22900000000000001},"max":{"1min":0.626,"5min":0.71299999999999997,"15min":5.1449999999999996},"last":0.47599999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.48099999999999998,"15min":0.48499999999999999},"min":{"1min":0.34699999999999998,"5min":0.25700000000000001,"15min":0.25},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.97199999999999998},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.502,"15min":0.51000000000000001},"min":{"1min":0.373,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.73599999999999999,"5min":0.74099999999999999,"15min":1.8799999999999999},"last":0.54600000000000004}]},{"osd":2,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.52600000000000002,"15min":0.54700000000000004},"min":{"1min":0.42999999999999999,"5min":0.30099999999999999,"15min":0.28299999999999997},"max":{"1min":0.73399999999999999,"5min":0.76600000000000001,"15min":4.234},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.55800000000000005,"15min":0.56100000000000005},"min":{"1min":0.41699999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.78700000000000003,"5min":0.79200000000000004,"15min":1.0369999999999999},"last":0.60099999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.497,"15min":0.57499999999999996},"min":{"1min":0.39700000000000002,"5min":0.29499999999999998,"15min":0.27700000000000002},"max":{"1min":0.67400000000000004,"5min":0.72799999999999998,"15min":5.2169999999999996},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.52600000000000002,"15min":0.53800000000000003},"min":{"1min":0.42599999999999999,"5min":0.29999999999999999,"15min":0.29699999999999999},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":1.008},"last":0.76000000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.47999999999999998,"15min":0.5},"min":{"1min":0.36399999999999999,"5min":0.25600000000000001,"15min":0.23999999999999999},"max":{"1min":0.61699999999999999,"5min":0.83399999999999996,"15min":1.917},"last":0.748},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.495,"15min":0.51100000000000001},"min":{"1min":0.38200000000000001,"5min":0.251,"15min":0.23899999999999999},"max":{"1min":0.64900000000000002,"5min":0.69199999999999995,"15min":0.87},"last":0.65200000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.51000000000000001,"15min":0.53700000000000003},"min":{"1min":0.41099999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.63700000000000001,"5min":0.76800000000000002,"15min":2.0139999999999998},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.57399999999999995,"15min":0.59099999999999997},"min":{"1min":0.46200000000000002,"5min":0.30299999999999999,"15min":0.29999999999999999},"max":{"1min":0.68600000000000005,"5min":0.80800000000000005,"15min":1.9470000000000001},"last":0.77600000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53300000000000003,"15min":0.55900000000000005},"min":{"1min":0.42099999999999999,"5min":0.28799999999999998,"15min":0.27700000000000002},"max":{"1min":0.628,"5min":0.81000000000000005,"15min":0.96499999999999997},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.57199999999999995,"15min":0.59099999999999997},"min":{"1min":0.46800000000000003,"5min":0.29199999999999998,"15min":0.28799999999999998},"max":{"1min":0.69199999999999995,"5min":0.77300000000000002,"15min":1.4119999999999999},"last":0.78500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:19:01.428 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T11:19:01.428 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T11:19:01.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.581+0000 7fd24f1ab700 1 Processor -- start 2023-10-06T11:19:01.583 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.581+0000 7fd24f1ab700 1 -- start start 2023-10-06T11:19:01.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.582+0000 7fd24f1ab700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd24815a9c0 0x7fd2480cd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:01.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.582+0000 7fd24f1ab700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd248069100 0x7fd248069580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:01.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.582+0000 7fd24f1ab700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd248068c70 con 0x7fd2480ccfb0 2023-10-06T11:19:01.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.582+0000 7fd24f1ab700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2480cc2a0 con 0x7fd248069100 2023-10-06T11:19:01.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.582+0000 7fd24f1ab700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2481578e0 con 0x7fd24815a9c0 2023-10-06T11:19:01.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.582+0000 7fd247fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd24815a9c0 0x7fd2480cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:01.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.582+0000 7fd24d748700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd248069100 0x7fd248069580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:01.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.582+0000 7fd24cf47700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fd2480ccfb0 0x7fd2480cb800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:54126/0 (socket says 172.21.15.146:54126) 2023-10-06T11:19:01.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.582+0000 7fd247fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd24815a9c0 0x7fd2480cd380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:36518/0 (socket says 172.21.15.146:36518) 2023-10-06T11:19:01.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.582+0000 7fd24cf47700 1 -- 172.21.15.146:0/685026003 learned_addr learned my addr 172.21.15.146:0/685026003 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:19:01.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.583+0000 7fd247fff700 1 -- 172.21.15.146:0/685026003 >> v2:172.21.15.151:3300/0 conn(0x7fd248069100 msgr2=0x7fd248069580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:01.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.583+0000 7fd247fff700 1 --2- 172.21.15.146:0/685026003 >> v2:172.21.15.151:3300/0 conn(0x7fd248069100 0x7fd248069580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:01.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.583+0000 7fd247fff700 1 -- 172.21.15.146:0/685026003 >> v1:172.21.15.151:6789/0 conn(0x7fd2480ccfb0 legacy=0x7fd2480cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:01.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.583+0000 7fd247fff700 1 -- 172.21.15.146:0/685026003 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd24815ae30 con 0x7fd24815a9c0 2023-10-06T11:19:01.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.583+0000 7fd24d748700 1 --2- 172.21.15.146:0/685026003 >> v2:172.21.15.151:3300/0 conn(0x7fd248069100 0x7fd248069580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:19:01.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.583+0000 7fd247fff700 1 --2- 172.21.15.146:0/685026003 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd24815a9c0 0x7fd2480cd380 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd23c0098d0 tx=0x7fd23c009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce12ed18c0cf7673 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:01.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.583+0000 7fd2477fe700 1 -- 172.21.15.146:0/685026003 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c005c10 con 0x7fd24815a9c0 2023-10-06T11:19:01.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.583+0000 7fd2477fe700 1 -- 172.21.15.146:0/685026003 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23c005d70 con 0x7fd24815a9c0 2023-10-06T11:19:01.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.583+0000 7fd2477fe700 1 -- 172.21.15.146:0/685026003 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23c006280 con 0x7fd24815a9c0 2023-10-06T11:19:01.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.584+0000 7fd24f1ab700 1 -- 172.21.15.146:0/685026003 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd24815a9c0 msgr2=0x7fd2480cd380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:01.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.584+0000 7fd24f1ab700 1 --2- 172.21.15.146:0/685026003 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd24815a9c0 0x7fd2480cd380 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd23c0098d0 tx=0x7fd23c009120 comp rx=0 tx=0).stop 2023-10-06T11:19:01.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.584+0000 7fd24f1ab700 1 -- 172.21.15.146:0/685026003 shutdown_connections 2023-10-06T11:19:01.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.584+0000 7fd24f1ab700 1 --2- 172.21.15.146:0/685026003 >> v2:172.21.15.151:3300/0 conn(0x7fd248069100 0x7fd248069580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:01.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.584+0000 7fd24f1ab700 1 --2- 172.21.15.146:0/685026003 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd24815a9c0 0x7fd2480cd380 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:01.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.584+0000 7fd24f1ab700 1 -- 172.21.15.146:0/685026003 >> 172.21.15.146:0/685026003 conn(0x7fd248087ff0 msgr2=0x7fd2480998f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:01.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.584+0000 7fd24f1ab700 1 -- 172.21.15.146:0/685026003 shutdown_connections 2023-10-06T11:19:01.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.584+0000 7fd24f1ab700 1 -- 172.21.15.146:0/685026003 wait complete. 2023-10-06T11:19:01.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.585+0000 7fd24f1ab700 1 Processor -- start 2023-10-06T11:19:01.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.585+0000 7fd24f1ab700 1 -- start start 2023-10-06T11:19:01.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.586+0000 7fd24f1ab700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd248069100 0x7fd248156730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:01.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.586+0000 7fd24f1ab700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2480ccfb0 0x7fd2480c4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:01.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.586+0000 7fd24f1ab700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd24815a9c0 0x7fd2480c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:01.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.586+0000 7fd24f1ab700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd248156c70 con 0x7fd248069100 2023-10-06T11:19:01.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.586+0000 7fd24f1ab700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2480c83e0 con 0x7fd24815a9c0 2023-10-06T11:19:01.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.586+0000 7fd24f1ab700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2480c77d0 con 0x7fd2480ccfb0 2023-10-06T11:19:01.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.586+0000 7fd24cf47700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd248069100 0x7fd248156730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:01.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.586+0000 7fd24cf47700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd248069100 0x7fd248156730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41312/0 (socket says 172.21.15.146:41312) 2023-10-06T11:19:01.591 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.586+0000 7fd24cf47700 1 -- 172.21.15.146:0/4146284529 learned_addr learned my addr 172.21.15.146:0/4146284529 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:01.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.586+0000 7fd24d748700 1 --2- 172.21.15.146:0/4146284529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd24815a9c0 0x7fd2480c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:01.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.586+0000 7fd247fff700 1 --2- 172.21.15.146:0/4146284529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2480ccfb0 0x7fd2480c4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:01.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.586+0000 7fd24cf47700 1 -- 172.21.15.146:0/4146284529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2480ccfb0 msgr2=0x7fd2480c4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:01.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.586+0000 7fd24cf47700 1 --2- 172.21.15.146:0/4146284529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2480ccfb0 0x7fd2480c4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:01.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.586+0000 7fd24cf47700 1 -- 172.21.15.146:0/4146284529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd24815a9c0 msgr2=0x7fd2480c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:01.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.586+0000 7fd24cf47700 1 --2- 172.21.15.146:0/4146284529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd24815a9c0 0x7fd2480c8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:01.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.586+0000 7fd24cf47700 1 -- 172.21.15.146:0/4146284529 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd240009420 con 0x7fd248069100 2023-10-06T11:19:01.592 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.586+0000 7fd24cf47700 1 --2- 172.21.15.146:0/4146284529 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd248069100 0x7fd248156730 secure :-1 s=READY pgs=2256 cs=0 l=1 rev1=1 crypto rx=0x7fd23800cbc0 tx=0x7fd238001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:01.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.586+0000 7fd244ff9700 1 -- 172.21.15.146:0/4146284529 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23800a890 con 0x7fd248069100 2023-10-06T11:19:01.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.586+0000 7fd244ff9700 1 -- 172.21.15.146:0/4146284529 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23800a9f0 con 0x7fd248069100 2023-10-06T11:19:01.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.586+0000 7fd24f1ab700 1 -- 172.21.15.146:0/4146284529 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd23c0093c0 con 0x7fd248069100 2023-10-06T11:19:01.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.586+0000 7fd244ff9700 1 -- 172.21.15.146:0/4146284529 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23800adb0 con 0x7fd248069100 2023-10-06T11:19:01.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.586+0000 7fd24f1ab700 1 -- 172.21.15.146:0/4146284529 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2480c7d90 con 0x7fd248069100 2023-10-06T11:19:01.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.587+0000 7fd24f1ab700 1 -- 172.21.15.146:0/4146284529 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2480c86c0 con 0x7fd248069100 2023-10-06T11:19:01.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.588+0000 7fd244ff9700 1 -- 172.21.15.146:0/4146284529 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd238007300 con 0x7fd248069100 2023-10-06T11:19:01.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.588+0000 7fd244ff9700 1 --2- 172.21.15.146:0/4146284529 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd234066f30 0x7fd2340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:01.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.588+0000 7fd244ff9700 1 -- 172.21.15.146:0/4146284529 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd238084660 con 0x7fd248069100 2023-10-06T11:19:01.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.588+0000 7fd247fff700 1 --2- 172.21.15.146:0/4146284529 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd234066f30 0x7fd2340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:01.593 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.588+0000 7fd247fff700 1 --2- 172.21.15.146:0/4146284529 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd234066f30 0x7fd2340693e0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fd23c009160 tx=0x7fd23c016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:01.594 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.592+0000 7fd244ff9700 1 -- 172.21.15.146:0/4146284529 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd2380518b0 con 0x7fd248069100 2023-10-06T11:19:01.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.850+0000 7fd24f1ab700 1 -- 172.21.15.146:0/4146284529 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fd24804c380 con 0x7fd248069100 2023-10-06T11:19:01.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.855+0000 7fd244ff9700 1 -- 172.21.15.146:0/4146284529 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v26) v1 ==== 190+0+0 (secure 0 0 0) 0x7fd2380180e0 con 0x7fd248069100 2023-10-06T11:19:01.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.857+0000 7fd24f1ab700 1 -- 172.21.15.146:0/4146284529 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd234066f30 msgr2=0x7fd2340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:01.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.857+0000 7fd24f1ab700 1 --2- 172.21.15.146:0/4146284529 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd234066f30 0x7fd2340693e0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fd23c009160 tx=0x7fd23c016000 comp rx=0 tx=0).stop 2023-10-06T11:19:01.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.857+0000 7fd24f1ab700 1 -- 172.21.15.146:0/4146284529 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd248069100 msgr2=0x7fd248156730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:01.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.857+0000 7fd24f1ab700 1 --2- 172.21.15.146:0/4146284529 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd248069100 0x7fd248156730 secure :-1 s=READY pgs=2256 cs=0 l=1 rev1=1 crypto rx=0x7fd23800cbc0 tx=0x7fd238001a20 comp rx=0 tx=0).stop 2023-10-06T11:19:01.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.857+0000 7fd24f1ab700 1 -- 172.21.15.146:0/4146284529 shutdown_connections 2023-10-06T11:19:01.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.857+0000 7fd24f1ab700 1 --2- 172.21.15.146:0/4146284529 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd234066f30 0x7fd2340693e0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:01.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.857+0000 7fd24f1ab700 1 --2- 172.21.15.146:0/4146284529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd24815a9c0 0x7fd2480c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:01.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.857+0000 7fd24f1ab700 1 --2- 172.21.15.146:0/4146284529 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd248069100 0x7fd248156730 unknown :-1 s=CLOSED pgs=2256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:01.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.857+0000 7fd24f1ab700 1 --2- 172.21.15.146:0/4146284529 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2480ccfb0 0x7fd2480c4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:01.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.857+0000 7fd24f1ab700 1 -- 172.21.15.146:0/4146284529 >> 172.21.15.146:0/4146284529 conn(0x7fd248087ff0 msgr2=0x7fd248158860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:01.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.857+0000 7fd24f1ab700 1 -- 172.21.15.146:0/4146284529 shutdown_connections 2023-10-06T11:19:01.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.857+0000 7fd24f1ab700 1 -- 172.21.15.146:0/4146284529 wait complete. 2023-10-06T11:19:01.860 INFO:teuthology.orchestra.run.smithi146.stderr:updated caps for client.0 2023-10-06T11:19:01.871 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:19:01.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.984+0000 7fdbed977700 1 Processor -- start 2023-10-06T11:19:01.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.984+0000 7fdbed977700 1 -- start start 2023-10-06T11:19:01.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.985+0000 7fdbed977700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fdbe815a940 0x7fdbe8153c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:01.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.985+0000 7fdbed977700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbe815d270 con 0x7fdbe815dcc0 2023-10-06T11:19:01.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.985+0000 7fdbed977700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbe815d830 con 0x7fdbe81538c0 2023-10-06T11:19:01.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.985+0000 7fdbed977700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbe815e110 con 0x7fdbe815a940 2023-10-06T11:19:01.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.985+0000 7fdbe77fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fdbe815dcc0 0x7fdbe80ce610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52902/0 (socket says 172.21.15.146:52902) 2023-10-06T11:19:01.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.985+0000 7fdbe77fe700 1 -- 172.21.15.146:0/2464145711 learned_addr learned my addr 172.21.15.146:0/2464145711 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:19:01.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.986+0000 7fdbe5ffb700 1 -- 172.21.15.146:0/2464145711 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2089737415 0 0) 0x7fdbe815d270 con 0x7fdbe815dcc0 2023-10-06T11:19:01.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.986+0000 7fdbe67fc700 1 --2- 172.21.15.146:0/2464145711 >> v2:172.21.15.151:3300/0 conn(0x7fdbe815a940 0x7fdbe8153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:01.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.986+0000 7fdbe5ffb700 1 -- 172.21.15.146:0/2464145711 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbd0003570 con 0x7fdbe815dcc0 2023-10-06T11:19:01.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.986+0000 7fdbe5ffb700 1 -- 172.21.15.146:0/2464145711 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3126692837 0 0) 0x7fdbd0003570 con 0x7fdbe815dcc0 2023-10-06T11:19:01.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.986+0000 7fdbe5ffb700 1 -- 172.21.15.146:0/2464145711 >> v2:172.21.15.151:3300/0 conn(0x7fdbe815a940 msgr2=0x7fdbe8153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:01.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.986+0000 7fdbe5ffb700 1 --2- 172.21.15.146:0/2464145711 >> v2:172.21.15.151:3300/0 conn(0x7fdbe815a940 0x7fdbe8153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:01.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.986+0000 7fdbe5ffb700 1 -- 172.21.15.146:0/2464145711 >> v1:172.21.15.151:6789/0 conn(0x7fdbe81538c0 legacy=0x7fdbe80cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:01.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.986+0000 7fdbe5ffb700 1 -- 172.21.15.146:0/2464145711 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe80cb810 con 0x7fdbe815dcc0 2023-10-06T11:19:01.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.986+0000 7fdbe5ffb700 1 -- 172.21.15.146:0/2464145711 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fdbe0001470 con 0x7fdbe815dcc0 2023-10-06T11:19:01.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.986+0000 7fdbe5ffb700 1 -- 172.21.15.146:0/2464145711 >> v1:172.21.15.146:6789/0 conn(0x7fdbe815dcc0 legacy=0x7fdbe80ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:01.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.986+0000 7fdbe5ffb700 1 --2- 172.21.15.146:0/2464145711 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbd0003a60 0x7fdbd0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:01.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.986+0000 7fdbe5ffb700 1 --2- 172.21.15.146:0/2464145711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbd0004810 0x7fdbd0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:01.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.986+0000 7fdbe5ffb700 1 --2- 172.21.15.146:0/2464145711 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdbd00051c0 0x7fdbd000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:01.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.986+0000 7fdbe5ffb700 1 -- 172.21.15.146:0/2464145711 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe815e110 con 0x7fdbd0003a60 2023-10-06T11:19:01.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.986+0000 7fdbe5ffb700 1 -- 172.21.15.146:0/2464145711 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd000c160 con 0x7fdbd0004810 2023-10-06T11:19:01.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.986+0000 7fdbe5ffb700 1 -- 172.21.15.146:0/2464145711 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd000c320 con 0x7fdbd00051c0 2023-10-06T11:19:01.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.986+0000 7fdbe6ffd700 1 --2- 172.21.15.146:0/2464145711 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbd0003a60 0x7fdbd0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:01.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.986+0000 7fdbe67fc700 1 --2- 172.21.15.146:0/2464145711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbd0004810 0x7fdbd0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:01.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.986+0000 7fdbe77fe700 1 --2- 172.21.15.146:0/2464145711 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdbd00051c0 0x7fdbd000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:01.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.986+0000 7fdbe6ffd700 1 -- 172.21.15.146:0/2464145711 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdbd00051c0 msgr2=0x7fdbd000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:01.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.986+0000 7fdbe6ffd700 1 --2- 172.21.15.146:0/2464145711 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdbd00051c0 0x7fdbd000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:01.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.986+0000 7fdbe6ffd700 1 -- 172.21.15.146:0/2464145711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbd0004810 msgr2=0x7fdbd0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:01.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.986+0000 7fdbe6ffd700 1 --2- 172.21.15.146:0/2464145711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbd0004810 0x7fdbd0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:01.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.986+0000 7fdbe77fe700 1 -- 172.21.15.146:0/2464145711 reap_dead start 2023-10-06T11:19:01.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.986+0000 7fdbe6ffd700 1 -- 172.21.15.146:0/2464145711 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd0003570 con 0x7fdbd0003a60 2023-10-06T11:19:01.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.986+0000 7fdbe6ffd700 1 --2- 172.21.15.146:0/2464145711 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbd0003a60 0x7fdbd0003e70 secure :-1 s=READY pgs=2258 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8001fc0 tx=0x7fdbd8001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6322ba42ed5b8ca7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:01.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.987+0000 7fdbe5ffb700 1 -- 172.21.15.146:0/2464145711 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd8001950 con 0x7fdbd0003a60 2023-10-06T11:19:01.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.987+0000 7fdbe5ffb700 1 -- 172.21.15.146:0/2464145711 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd800c8b0 con 0x7fdbd0003a60 2023-10-06T11:19:01.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.987+0000 7fdbe5ffb700 1 -- 172.21.15.146:0/2464145711 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd800cc50 con 0x7fdbd0003a60 2023-10-06T11:19:01.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.987+0000 7fdbed977700 1 -- 172.21.15.146:0/2464145711 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbd0003a60 msgr2=0x7fdbd0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:01.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.987+0000 7fdbed977700 1 --2- 172.21.15.146:0/2464145711 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbd0003a60 0x7fdbd0003e70 secure :-1 s=READY pgs=2258 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8001fc0 tx=0x7fdbd8001640 comp rx=0 tx=0).stop 2023-10-06T11:19:01.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.987+0000 7fdbed977700 1 -- 172.21.15.146:0/2464145711 shutdown_connections 2023-10-06T11:19:01.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.987+0000 7fdbed977700 1 --2- 172.21.15.146:0/2464145711 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbd0003a60 0x7fdbd0003e70 unknown :-1 s=CLOSED pgs=2258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:01.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.987+0000 7fdbed977700 1 -- 172.21.15.146:0/2464145711 >> 172.21.15.146:0/2464145711 conn(0x7fdbe806eb10 msgr2=0x7fdbe806ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:01.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.987+0000 7fdbed977700 1 -- 172.21.15.146:0/2464145711 shutdown_connections 2023-10-06T11:19:01.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.987+0000 7fdbed977700 1 -- 172.21.15.146:0/2464145711 wait complete. 2023-10-06T11:19:01.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.988+0000 7fdbed977700 1 Processor -- start 2023-10-06T11:19:01.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.988+0000 7fdbed977700 1 -- start start 2023-10-06T11:19:01.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.989+0000 7fdbed977700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbd0003a60 0x7fdbe8158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:01.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.989+0000 7fdbed977700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbe80c7f90 0x7fdbe814d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:01.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.989+0000 7fdbed977700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdbe80b33e0 0x7fdbe8152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:01.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.989+0000 7fdbed977700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe80c87a0 con 0x7fdbe80c7f90 2023-10-06T11:19:01.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.989+0000 7fdbed977700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe80ca550 con 0x7fdbd0003a60 2023-10-06T11:19:01.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.989+0000 7fdbed977700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe80c9c60 con 0x7fdbe80b33e0 2023-10-06T11:19:01.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.989+0000 7fdbe67fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbe80c7f90 0x7fdbe814d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:01.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.989+0000 7fdbe67fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbe80c7f90 0x7fdbe814d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41338/0 (socket says 172.21.15.146:41338) 2023-10-06T11:19:01.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.989+0000 7fdbe67fc700 1 -- 172.21.15.146:0/3938296255 learned_addr learned my addr 172.21.15.146:0/3938296255 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:01.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.989+0000 7fdbe6ffd700 1 --2- 172.21.15.146:0/3938296255 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbd0003a60 0x7fdbe8158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:01.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.989+0000 7fdbe77fe700 1 --2- 172.21.15.146:0/3938296255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdbe80b33e0 0x7fdbe8152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:01.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.989+0000 7fdbe67fc700 1 -- 172.21.15.146:0/3938296255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdbe80b33e0 msgr2=0x7fdbe8152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:01.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.989+0000 7fdbe67fc700 1 --2- 172.21.15.146:0/3938296255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdbe80b33e0 0x7fdbe8152580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:01.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.989+0000 7fdbe67fc700 1 -- 172.21.15.146:0/3938296255 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbd0003a60 msgr2=0x7fdbe8158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:01.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.989+0000 7fdbe67fc700 1 --2- 172.21.15.146:0/3938296255 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbd0003a60 0x7fdbe8158fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:01.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.989+0000 7fdbe67fc700 1 -- 172.21.15.146:0/3938296255 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe80c84c0 con 0x7fdbe80c7f90 2023-10-06T11:19:01.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.990+0000 7fdbe77fe700 1 --2- 172.21.15.146:0/3938296255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdbe80b33e0 0x7fdbe8152580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:19:01.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.990+0000 7fdbe67fc700 1 --2- 172.21.15.146:0/3938296255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbe80c7f90 0x7fdbe814d3f0 secure :-1 s=READY pgs=2259 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc011a40 tx=0x7fdbdc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:01.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.990+0000 7fdbceffd700 1 -- 172.21.15.146:0/3938296255 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc00f940 con 0x7fdbe80c7f90 2023-10-06T11:19:01.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.990+0000 7fdbceffd700 1 -- 172.21.15.146:0/3938296255 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbdc00faa0 con 0x7fdbe80c7f90 2023-10-06T11:19:01.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.990+0000 7fdbed977700 1 -- 172.21.15.146:0/3938296255 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbe80c9f00 con 0x7fdbe80c7f90 2023-10-06T11:19:01.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.990+0000 7fdbceffd700 1 -- 172.21.15.146:0/3938296255 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc00fe20 con 0x7fdbe80c7f90 2023-10-06T11:19:01.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.990+0000 7fdbed977700 1 -- 172.21.15.146:0/3938296255 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbe8159510 con 0x7fdbe80c7f90 2023-10-06T11:19:01.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.991+0000 7fdbceffd700 1 -- 172.21.15.146:0/3938296255 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdbdc014650 con 0x7fdbe80c7f90 2023-10-06T11:19:01.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.991+0000 7fdbed977700 1 -- 172.21.15.146:0/3938296255 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbe804c380 con 0x7fdbe80c7f90 2023-10-06T11:19:01.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.992+0000 7fdbceffd700 1 --2- 172.21.15.146:0/3938296255 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdbd4066f30 0x7fdbd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:01.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.992+0000 7fdbceffd700 1 -- 172.21.15.146:0/3938296255 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fdbdc018030 con 0x7fdbe80c7f90 2023-10-06T11:19:01.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.992+0000 7fdbe6ffd700 1 --2- 172.21.15.146:0/3938296255 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdbd4066f30 0x7fdbd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:01.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.992+0000 7fdbe6ffd700 1 --2- 172.21.15.146:0/3938296255 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdbd4066f30 0x7fdbd40693e0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8001fc0 tx=0x7fdbd8015000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:01.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:01.996+0000 7fdbceffd700 1 -- 172.21.15.146:0/3938296255 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdbdc0520e0 con 0x7fdbe80c7f90 2023-10-06T11:19:02.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.219+0000 7fdbed977700 1 -- 172.21.15.146:0/3938296255 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdbe80cbaf0 con 0x7fdbe80c7f90 2023-10-06T11:19:02.221 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.220+0000 7fdbceffd700 1 -- 172.21.15.146:0/3938296255 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 144 v144) v1 ==== 95+0+4623 (secure 0 0 0) 0x7fdbdc055700 con 0x7fdbe80c7f90 2023-10-06T11:19:02.222 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:02.222 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":144,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9094,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/3426437100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3426437100},{"type":"v1","addr":"172.21.15.146:6836","nonce":3426437100}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":139},{"gid":9106,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/3275041097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":3275041097},{"type":"v1","addr":"172.21.15.151:6835","nonce":3275041097}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":139},{"gid":10461,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/2322816938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2322816938},{"type":"v1","addr":"172.21.15.146:6837","nonce":2322816938}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":139}],"filesystems":[{"mdsmap":{"epoch":144,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:18:51.903907+0000","modified":"2023-10-06T11:18:55.524407+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10476":{"gid":10476,"name":"d","rank":0,"incarnation":140,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6834/1134233840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1134233840},{"type":"v1","addr":"172.21.15.151:6834","nonce":1134233840}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-10-06T11:19:02.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.222+0000 7fdbed977700 1 -- 172.21.15.146:0/3938296255 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdbd4066f30 msgr2=0x7fdbd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:02.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.222+0000 7fdbed977700 1 --2- 172.21.15.146:0/3938296255 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdbd4066f30 0x7fdbd40693e0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8001fc0 tx=0x7fdbd8015000 comp rx=0 tx=0).stop 2023-10-06T11:19:02.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.222+0000 7fdbed977700 1 -- 172.21.15.146:0/3938296255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbe80c7f90 msgr2=0x7fdbe814d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:02.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.222+0000 7fdbed977700 1 --2- 172.21.15.146:0/3938296255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbe80c7f90 0x7fdbe814d3f0 secure :-1 s=READY pgs=2259 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc011a40 tx=0x7fdbdc0091a0 comp rx=0 tx=0).stop 2023-10-06T11:19:02.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.222+0000 7fdbed977700 1 -- 172.21.15.146:0/3938296255 shutdown_connections 2023-10-06T11:19:02.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.222+0000 7fdbed977700 1 --2- 172.21.15.146:0/3938296255 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fdbd4066f30 0x7fdbd40693e0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:02.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.222+0000 7fdbed977700 1 --2- 172.21.15.146:0/3938296255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdbe80b33e0 0x7fdbe8152580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:02.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.222+0000 7fdbed977700 1 --2- 172.21.15.146:0/3938296255 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbd0003a60 0x7fdbe8158fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:02.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.222+0000 7fdbed977700 1 --2- 172.21.15.146:0/3938296255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fdbe80c7f90 0x7fdbe814d3f0 unknown :-1 s=CLOSED pgs=2259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:02.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.222+0000 7fdbed977700 1 -- 172.21.15.146:0/3938296255 >> 172.21.15.146:0/3938296255 conn(0x7fdbe806eb10 msgr2=0x7fdbe814e340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:02.224 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.222+0000 7fdbed977700 1 -- 172.21.15.146:0/3938296255 shutdown_connections 2023-10-06T11:19:02.225 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.222+0000 7fdbed977700 1 -- 172.21.15.146:0/3938296255 wait complete. 2023-10-06T11:19:02.225 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 144 2023-10-06T11:19:02.639 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 144, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T11:18:51.903907+0000', 'modified': '2023-10-06T11:18:55.524407+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10476}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10476': {'gid': 10476, 'name': 'd', 'rank': 0, 'incarnation': 140, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.151:6834/1134233840', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6832', 'nonce': 1134233840}, {'type': 'v1', 'addr': '172.21.15.151:6834', 'nonce': 1134233840}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T11:19:02.639 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T11:19:02.640 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-06T11:19:02.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.756+0000 7f13fefcf700 1 Processor -- start 2023-10-06T11:19:02.758 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.756+0000 7f13fefcf700 1 -- start start 2023-10-06T11:19:02.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.757+0000 7f13fefcf700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f13f81584a0 0x7f13f8158870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:02.760 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.757+0000 7f13fefcf700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f13f80c8a90 0x7f13f80c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:02.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.757+0000 7f13fefcf700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13f815b440 con 0x7f13f806b760 2023-10-06T11:19:02.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.757+0000 7f13fefcf700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13f815b720 con 0x7f13f80c8a90 2023-10-06T11:19:02.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.757+0000 7f13fefcf700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13f815ba00 con 0x7f13f81584a0 2023-10-06T11:19:02.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.757+0000 7f13effff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f13f80c8a90 0x7f13f80c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:02.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.757+0000 7f13fd56c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f13f806b760 0x7f13f806bb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52918/0 (socket says 172.21.15.146:52918) 2023-10-06T11:19:02.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.757+0000 7f13fd56c700 1 -- 172.21.15.146:0/311829634 learned_addr learned my addr 172.21.15.146:0/311829634 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:19:02.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.757+0000 7f13fcd6b700 1 --2- 172.21.15.146:0/311829634 >> v2:172.21.15.151:3300/0 conn(0x7f13f81584a0 0x7f13f8158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:02.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.757+0000 7f13effff700 1 -- 172.21.15.146:0/311829634 >> v2:172.21.15.151:3300/0 conn(0x7f13f81584a0 msgr2=0x7f13f8158870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:02.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.757+0000 7f13effff700 1 --2- 172.21.15.146:0/311829634 >> v2:172.21.15.151:3300/0 conn(0x7f13f81584a0 0x7f13f8158870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:02.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.758+0000 7f13effff700 1 -- 172.21.15.146:0/311829634 >> v1:172.21.15.146:6789/0 conn(0x7f13f806b760 legacy=0x7f13f806bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:02.761 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.758+0000 7f13effff700 1 -- 172.21.15.146:0/311829634 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f815bce0 con 0x7f13f80c8a90 2023-10-06T11:19:02.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.758+0000 7f13ef7fe700 1 -- 172.21.15.146:0/311829634 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2766582590 0 0) 0x7f13f815b440 con 0x7f13f806b760 2023-10-06T11:19:02.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.758+0000 7f13effff700 1 --2- 172.21.15.146:0/311829634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13f80c8a90 0x7f13f80c8f30 secure :-1 s=READY pgs=2261 cs=0 l=1 rev1=1 crypto rx=0x7f13f806f2e0 tx=0x7f13e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb93bb3551834b90 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:02.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.758+0000 7f13ef7fe700 1 -- 172.21.15.146:0/311829634 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e800b6b0 con 0x7f13f80c8a90 2023-10-06T11:19:02.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.758+0000 7f13ef7fe700 1 -- 172.21.15.146:0/311829634 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e800b810 con 0x7f13f80c8a90 2023-10-06T11:19:02.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.758+0000 7f13ef7fe700 1 -- 172.21.15.146:0/311829634 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e800bbb0 con 0x7f13f80c8a90 2023-10-06T11:19:02.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.758+0000 7f13fefcf700 1 -- 172.21.15.146:0/311829634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13f80c8a90 msgr2=0x7f13f80c8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:02.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.758+0000 7f13fefcf700 1 --2- 172.21.15.146:0/311829634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13f80c8a90 0x7f13f80c8f30 secure :-1 s=READY pgs=2261 cs=0 l=1 rev1=1 crypto rx=0x7f13f806f2e0 tx=0x7f13e80091a0 comp rx=0 tx=0).stop 2023-10-06T11:19:02.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.758+0000 7f13fefcf700 1 -- 172.21.15.146:0/311829634 shutdown_connections 2023-10-06T11:19:02.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.758+0000 7f13fefcf700 1 --2- 172.21.15.146:0/311829634 >> v2:172.21.15.151:3300/0 conn(0x7f13f81584a0 0x7f13f8158870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:02.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.758+0000 7f13fefcf700 1 --2- 172.21.15.146:0/311829634 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13f80c8a90 0x7f13f80c8f30 unknown :-1 s=CLOSED pgs=2261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:02.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.758+0000 7f13fefcf700 1 -- 172.21.15.146:0/311829634 >> 172.21.15.146:0/311829634 conn(0x7f13f8067eb0 msgr2=0x7f13f80ce450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:02.762 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.758+0000 7f13fefcf700 1 -- 172.21.15.146:0/311829634 shutdown_connections 2023-10-06T11:19:02.763 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.758+0000 7f13fefcf700 1 -- 172.21.15.146:0/311829634 wait complete. 2023-10-06T11:19:02.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.759+0000 7f13fefcf700 1 Processor -- start 2023-10-06T11:19:02.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.760+0000 7f13fefcf700 1 -- start start 2023-10-06T11:19:02.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.760+0000 7f13fefcf700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13f806b760 0x7f13f814d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:02.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.760+0000 7f13fefcf700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f13f80c8a90 0x7f13f816b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:02.765 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.760+0000 7f13fefcf700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13f81584a0 0x7f13f816b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:02.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.760+0000 7f13fefcf700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f816c070 con 0x7f13f806b760 2023-10-06T11:19:02.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.760+0000 7f13fefcf700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f80c6560 con 0x7f13f81584a0 2023-10-06T11:19:02.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.760+0000 7f13fefcf700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13f80b1d30 con 0x7f13f80c8a90 2023-10-06T11:19:02.766 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.760+0000 7f13fcd6b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13f806b760 0x7f13f814d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:02.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.760+0000 7f13fcd6b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13f806b760 0x7f13f814d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41354/0 (socket says 172.21.15.146:41354) 2023-10-06T11:19:02.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.761+0000 7f13fcd6b700 1 -- 172.21.15.146:0/575700403 learned_addr learned my addr 172.21.15.146:0/575700403 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:02.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.761+0000 7f13fcd6b700 1 -- 172.21.15.146:0/575700403 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f13f80c8a90 msgr2=0x7f13f816b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:02.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.761+0000 7f13fcd6b700 1 --2- 172.21.15.146:0/575700403 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f13f80c8a90 0x7f13f816b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:02.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.761+0000 7f13fcd6b700 1 -- 172.21.15.146:0/575700403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13f81584a0 msgr2=0x7f13f816b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:02.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.761+0000 7f13fcd6b700 1 --2- 172.21.15.146:0/575700403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13f81584a0 0x7f13f816b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:02.767 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.761+0000 7f13fcd6b700 1 -- 172.21.15.146:0/575700403 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e8009420 con 0x7f13f806b760 2023-10-06T11:19:02.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.761+0000 7f13fcd6b700 1 --2- 172.21.15.146:0/575700403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13f806b760 0x7f13f814d8c0 secure :-1 s=READY pgs=2262 cs=0 l=1 rev1=1 crypto rx=0x7f13f4009fd0 tx=0x7f13f4009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:02.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.761+0000 7f13ecff9700 1 -- 172.21.15.146:0/575700403 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f400ed50 con 0x7f13f806b760 2023-10-06T11:19:02.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.761+0000 7f13ecff9700 1 -- 172.21.15.146:0/575700403 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f400eeb0 con 0x7f13f806b760 2023-10-06T11:19:02.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.761+0000 7f13fefcf700 1 -- 172.21.15.146:0/575700403 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13f80b2010 con 0x7f13f806b760 2023-10-06T11:19:02.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.761+0000 7f13ecff9700 1 -- 172.21.15.146:0/575700403 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f4014650 con 0x7f13f806b760 2023-10-06T11:19:02.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.761+0000 7f13fefcf700 1 -- 172.21.15.146:0/575700403 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13f80b25d0 con 0x7f13f806b760 2023-10-06T11:19:02.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.762+0000 7f13ecff9700 1 -- 172.21.15.146:0/575700403 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f13f40149c0 con 0x7f13f806b760 2023-10-06T11:19:02.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.763+0000 7f13ecff9700 1 --2- 172.21.15.146:0/575700403 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f13e4066f30 0x7f13e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:02.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.763+0000 7f13ecff9700 1 -- 172.21.15.146:0/575700403 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f13f4084d30 con 0x7f13f806b760 2023-10-06T11:19:02.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.763+0000 7f13effff700 1 --2- 172.21.15.146:0/575700403 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f13e4066f30 0x7f13e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:02.768 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.763+0000 7f13effff700 1 --2- 172.21.15.146:0/575700403 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f13e4066f30 0x7f13e40693e0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f13f80c92e0 tx=0x7f13e8017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:02.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.765+0000 7f14082c7b80 1 Processor -- start 2023-10-06T11:19:02.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.765+0000 7f14082c7b80 1 -- start start 2023-10-06T11:19:02.774 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.765+0000 7f14082c7b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f930b8aa90 0x55f930b8ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:02.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.765+0000 7f14082c7b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f930b469a0 0x55f930b43580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:02.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.765+0000 7f14082c7b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f930b44bd0 0x55f930b43ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:02.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.765+0000 7f14082c7b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f930ac3c80 con 0x55f930b469a0 2023-10-06T11:19:02.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.765+0000 7f14082c7b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f930a9aa70 con 0x55f930b8aa90 2023-10-06T11:19:02.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.765+0000 7f14082c7b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f930a98270 con 0x55f930b44bd0 2023-10-06T11:19:02.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.766+0000 7f13effff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f930b469a0 0x55f930b43580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:02.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.766+0000 7f13effff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f930b469a0 0x55f930b43580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41358/0 (socket says 172.21.15.146:41358) 2023-10-06T11:19:02.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.766+0000 7f13effff700 1 -- 172.21.15.146:0/2503563827 learned_addr learned my addr 172.21.15.146:0/2503563827 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:02.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.766+0000 7f13fd56c700 1 --2- 172.21.15.146:0/2503563827 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f930b44bd0 0x55f930b43ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:02.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.766+0000 7f13fcd6b700 1 --2- 172.21.15.146:0/2503563827 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f930b8aa90 0x55f930b8ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:02.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.766+0000 7f13effff700 1 -- 172.21.15.146:0/2503563827 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f930b44bd0 msgr2=0x55f930b43ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:02.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.766+0000 7f13effff700 1 --2- 172.21.15.146:0/2503563827 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f930b44bd0 0x55f930b43ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:02.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.766+0000 7f13effff700 1 -- 172.21.15.146:0/2503563827 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f930b8aa90 msgr2=0x55f930b8ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:02.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.766+0000 7f13effff700 1 --2- 172.21.15.146:0/2503563827 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f930b8aa90 0x55f930b8ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:02.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.766+0000 7f13effff700 1 -- 172.21.15.146:0/2503563827 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f93092e270 con 0x55f930b469a0 2023-10-06T11:19:02.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.766+0000 7f13fcd6b700 1 --2- 172.21.15.146:0/2503563827 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f930b8aa90 0x55f930b8ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:19:02.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.766+0000 7f13fd56c700 1 --2- 172.21.15.146:0/2503563827 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f930b44bd0 0x55f930b43ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:19:02.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.766+0000 7f13effff700 1 --2- 172.21.15.146:0/2503563827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f930b469a0 0x55f930b43580 secure :-1 s=READY pgs=2263 cs=0 l=1 rev1=1 crypto rx=0x7f13e800b980 tx=0x7f13e801d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af449864c3d27d2b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:02.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.766+0000 7f13ddffb700 1 -- 172.21.15.146:0/2503563827 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e800ba60 con 0x55f930b469a0 2023-10-06T11:19:02.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.766+0000 7f13ddffb700 1 -- 172.21.15.146:0/2503563827 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e801bc50 con 0x55f930b469a0 2023-10-06T11:19:02.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.766+0000 7f13ddffb700 1 -- 172.21.15.146:0/2503563827 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13e801bdc0 con 0x55f930b469a0 2023-10-06T11:19:02.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.767+0000 7f14082c7b80 1 -- 172.21.15.146:0/2503563827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f930b469a0 msgr2=0x55f930b43580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:02.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.767+0000 7f14082c7b80 1 --2- 172.21.15.146:0/2503563827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f930b469a0 0x55f930b43580 secure :-1 s=READY pgs=2263 cs=0 l=1 rev1=1 crypto rx=0x7f13e800b980 tx=0x7f13e801d040 comp rx=0 tx=0).stop 2023-10-06T11:19:02.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.767+0000 7f14082c7b80 1 -- 172.21.15.146:0/2503563827 shutdown_connections 2023-10-06T11:19:02.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.767+0000 7f14082c7b80 1 --2- 172.21.15.146:0/2503563827 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f930b44bd0 0x55f930b43ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:02.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.767+0000 7f14082c7b80 1 --2- 172.21.15.146:0/2503563827 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f930b8aa90 0x55f930b8ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:02.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.767+0000 7f14082c7b80 1 --2- 172.21.15.146:0/2503563827 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f930b469a0 0x55f930b43580 unknown :-1 s=CLOSED pgs=2263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:02.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.767+0000 7f14082c7b80 1 -- 172.21.15.146:0/2503563827 >> 172.21.15.146:0/2503563827 conn(0x55f930b45070 msgr2=0x55f930b45440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:02.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.767+0000 7f14082c7b80 1 -- 172.21.15.146:0/2503563827 shutdown_connections 2023-10-06T11:19:02.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.767+0000 7f14082c7b80 1 -- 172.21.15.146:0/2503563827 wait complete. 2023-10-06T11:19:02.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.767+0000 7f14082c7b80 1 -- start start 2023-10-06T11:19:02.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.768+0000 7f14082c7b80 1 Processor -- start 2023-10-06T11:19:02.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.768+0000 7f14082c7b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f930b44bd0 0x55f930b878b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:02.777 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.768+0000 7f14082c7b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f930b469a0 0x55f930b6bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:02.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.768+0000 7f14082c7b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f930b8aa90 0x55f930b6c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:02.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.768+0000 7f14082c7b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f930a94060 con 0x55f930b44bd0 2023-10-06T11:19:02.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.768+0000 7f14082c7b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f930a3f890 con 0x55f930b469a0 2023-10-06T11:19:02.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.768+0000 7f14082c7b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f930a5aea0 con 0x55f930b8aa90 2023-10-06T11:19:02.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.768+0000 7f14082c7b80 10 client.0 _ll_register_callbacks cb 0x55f930930f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:19:02.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.768+0000 7f13fcd6b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f930b44bd0 0x55f930b878b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:02.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.768+0000 7f13fcd6b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f930b44bd0 0x55f930b878b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41360/0 (socket says 172.21.15.146:41360) 2023-10-06T11:19:02.778 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.768+0000 7f13fcd6b700 1 -- 172.21.15.146:0/3012105880 learned_addr learned my addr 172.21.15.146:0/3012105880 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:02.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.769+0000 7f13effff700 1 --2- 172.21.15.146:0/3012105880 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f930b469a0 0x55f930b6bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:02.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.769+0000 7f13fd56c700 1 --2- 172.21.15.146:0/3012105880 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f930b8aa90 0x55f930b6c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:02.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.769+0000 7f13fcd6b700 1 -- 172.21.15.146:0/3012105880 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f930b8aa90 msgr2=0x55f930b6c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:02.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.769+0000 7f13fcd6b700 1 --2- 172.21.15.146:0/3012105880 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f930b8aa90 0x55f930b6c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:02.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.769+0000 7f13fcd6b700 1 -- 172.21.15.146:0/3012105880 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f930b469a0 msgr2=0x55f930b6bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:02.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.769+0000 7f13fcd6b700 1 --2- 172.21.15.146:0/3012105880 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f930b469a0 0x55f930b6bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:02.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.769+0000 7f13fcd6b700 1 -- 172.21.15.146:0/3012105880 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13e8021050 con 0x55f930b44bd0 2023-10-06T11:19:02.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.769+0000 7f13fcd6b700 1 --2- 172.21.15.146:0/3012105880 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f930b44bd0 0x55f930b878b0 secure :-1 s=READY pgs=2264 cs=0 l=1 rev1=1 crypto rx=0x7f13f40830f0 tx=0x7f13f4083050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48eeba39be4e9287 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:02.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.769+0000 7f13d6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:19:02.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.769+0000 7f13d6ffd700 1 -- 172.21.15.146:0/3012105880 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f4058d50 con 0x55f930b44bd0 2023-10-06T11:19:02.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.769+0000 7f13d6ffd700 1 -- 172.21.15.146:0/3012105880 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(177..177 src has 1..177) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f13f405caa0 con 0x55f930b44bd0 2023-10-06T11:19:02.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.769+0000 7f14082c7b80 1 -- 172.21.15.146:0/3012105880 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f930b38690 con 0x55f930b44bd0 2023-10-06T11:19:02.779 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.769+0000 7f13d6ffd700 1 -- 172.21.15.146:0/3012105880 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=144) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13f4054ff0 con 0x55f930b44bd0 2023-10-06T11:19:02.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.769+0000 7f14082c7b80 10 client.10650 fetch_fsmap learned FSMap version 144 2023-10-06T11:19:02.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.769+0000 7f14082c7b80 1 -- 172.21.15.146:0/3012105880 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=144,monmap=2+}) v3 -- 0x55f9308d0fe0 con 0x55f930b44bd0 2023-10-06T11:19:02.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.769+0000 7f13d6ffd700 1 -- 172.21.15.146:0/3012105880 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f930b38690 con 0x55f930b44bd0 2023-10-06T11:19:02.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.769+0000 7f13d6ffd700 1 -- 172.21.15.146:0/3012105880 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 144) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f13f405c610 con 0x55f930b44bd0 2023-10-06T11:19:02.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.769+0000 7f14082c7b80 10 client.10650 fetch_fsmap finished waiting for FSMap version 144 2023-10-06T11:19:02.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.769+0000 7f14082c7b80 10 client.10650 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T11:19:02.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.769+0000 7f14082c7b80 20 client.10650 populate_metadata read hostname 'smithi146' 2023-10-06T11:19:02.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.769+0000 7f14082c7b80 1 --2- 172.21.15.146:0/3012105880 >> [v2:172.21.15.151:6832/1134233840,v1:172.21.15.151:6834/1134233840] conn(0x55f930b6e140 0x55f930b6e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:02.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.769+0000 7f14082c7b80 4 client.10650 mds_command: new command op to 10476 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:19:02.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.769+0000 7f14082c7b80 1 -- 172.21.15.146:0/3012105880 --> [v2:172.21.15.151:6832/1134233840,v1:172.21.15.151:6834/1134233840] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f930b155c0 con 0x55f930b6e140 2023-10-06T11:19:02.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.770+0000 7f13effff700 1 --2- 172.21.15.146:0/3012105880 >> [v2:172.21.15.151:6832/1134233840,v1:172.21.15.151:6834/1134233840] conn(0x55f930b6e140 0x55f930b6e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:02.780 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.770+0000 7f13d6ffd700 10 client.10650 ms_handle_connect on v2:172.21.15.151:6832/1134233840 2023-10-06T11:19:02.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.770+0000 7f13effff700 1 --2- 172.21.15.146:0/3012105880 >> [v2:172.21.15.151:6832/1134233840,v1:172.21.15.151:6834/1134233840] conn(0x55f930b6e140 0x55f930b6e510 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2539df5b60403c1 server_cookie=1f18c1d72859b058 in_seq=0 out_seq=0 2023-10-06T11:19:02.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.771+0000 7f13d6ffd700 1 -- 172.21.15.146:0/3012105880 <== mds.0 v2:172.21.15.151:6832/1134233840 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55f930b155c0 con 0x55f930b6e140 2023-10-06T11:19:02.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.771+0000 7f13d6ffd700 10 client.10650 handle_command_reply: tid=0 2023-10-06T11:19:02.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.771+0000 7f14082c7b80 1 client.10650 shutdown 2023-10-06T11:19:02.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.771+0000 7f14082c7b80 1 -- 172.21.15.146:0/3012105880 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f930b44bd0 msgr2=0x55f930b878b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:02.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.771+0000 7f14082c7b80 1 --2- 172.21.15.146:0/3012105880 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f930b44bd0 0x55f930b878b0 secure :-1 s=READY pgs=2264 cs=0 l=1 rev1=1 crypto rx=0x7f13f40830f0 tx=0x7f13f4083050 comp rx=0 tx=0).stop 2023-10-06T11:19:02.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.771+0000 7f14082c7b80 1 -- 172.21.15.146:0/3012105880 shutdown_connections 2023-10-06T11:19:02.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.771+0000 7f14082c7b80 1 --2- 172.21.15.146:0/3012105880 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f930b8aa90 0x55f930b6c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:02.781 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.771+0000 7f14082c7b80 1 --2- 172.21.15.146:0/3012105880 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f930b44bd0 0x55f930b878b0 unknown :-1 s=CLOSED pgs=2264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:02.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.771+0000 7f14082c7b80 1 --2- 172.21.15.146:0/3012105880 >> [v2:172.21.15.151:6832/1134233840,v1:172.21.15.151:6834/1134233840] conn(0x55f930b6e140 0x55f930b6e510 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:02.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.771+0000 7f14082c7b80 1 --2- 172.21.15.146:0/3012105880 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f930b469a0 0x55f930b6bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:02.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.771+0000 7f13d6ffd700 0 client.10650 ms_handle_reset on v2:172.21.15.151:6832/1134233840 2023-10-06T11:19:02.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.771+0000 7f14082c7b80 1 -- 172.21.15.146:0/3012105880 >> 172.21.15.146:0/3012105880 conn(0x55f930b45070 msgr2=0x55f930b8a000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:02.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.771+0000 7f14082c7b80 1 -- 172.21.15.146:0/3012105880 shutdown_connections 2023-10-06T11:19:02.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.771+0000 7f14082c7b80 1 -- 172.21.15.146:0/3012105880 wait complete. 2023-10-06T11:19:02.782 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.771+0000 7f14082c7b80 20 client.10650 trim_cache size 0 max 16384 2023-10-06T11:19:02.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.788+0000 7f14082c7b80 1 Processor -- start 2023-10-06T11:19:02.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.788+0000 7f14082c7b80 1 -- start start 2023-10-06T11:19:02.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.788+0000 7f14082c7b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f930b44bd0 0x55f930b6bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:02.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.788+0000 7f14082c7b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f930b469a0 0x55f930b6c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:02.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.788+0000 7f14082c7b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f930b8aa90 0x55f930b40720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:02.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.788+0000 7f14082c7b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f930916e30 con 0x55f930b44bd0 2023-10-06T11:19:02.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.788+0000 7f14082c7b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f930b6def0 con 0x55f930b469a0 2023-10-06T11:19:02.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.788+0000 7f14082c7b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f930b6caa0 con 0x55f930b8aa90 2023-10-06T11:19:02.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.789+0000 7f13fcd6b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f930b44bd0 0x55f930b6bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:02.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.789+0000 7f13fcd6b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f930b44bd0 0x55f930b6bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41364/0 (socket says 172.21.15.146:41364) 2023-10-06T11:19:02.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.789+0000 7f13fcd6b700 1 -- 172.21.15.146:0/3074645644 learned_addr learned my addr 172.21.15.146:0/3074645644 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:02.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.789+0000 7f13effff700 1 --2- 172.21.15.146:0/3074645644 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f930b469a0 0x55f930b6c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:02.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.789+0000 7f13fd56c700 1 --2- 172.21.15.146:0/3074645644 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f930b8aa90 0x55f930b40720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:02.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.789+0000 7f13fcd6b700 1 -- 172.21.15.146:0/3074645644 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f930b8aa90 msgr2=0x55f930b40720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:02.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.789+0000 7f13fcd6b700 1 --2- 172.21.15.146:0/3074645644 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f930b8aa90 0x55f930b40720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:02.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.789+0000 7f13fcd6b700 1 -- 172.21.15.146:0/3074645644 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f930b469a0 msgr2=0x55f930b6c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:02.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.789+0000 7f13fcd6b700 1 --2- 172.21.15.146:0/3074645644 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f930b469a0 0x55f930b6c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:02.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.789+0000 7f13fcd6b700 1 -- 172.21.15.146:0/3074645644 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f930b41c80 con 0x55f930b44bd0 2023-10-06T11:19:02.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.789+0000 7f13effff700 1 --2- 172.21.15.146:0/3074645644 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f930b469a0 0x55f930b6c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:19:02.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.789+0000 7f13fd56c700 1 --2- 172.21.15.146:0/3074645644 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f930b8aa90 0x55f930b40720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:19:02.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.789+0000 7f13fcd6b700 1 --2- 172.21.15.146:0/3074645644 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f930b44bd0 0x55f930b6bc40 secure :-1 s=READY pgs=2265 cs=0 l=1 rev1=1 crypto rx=0x7f13f40557b0 tx=0x7f13f4070000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34754a10aeced506 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:02.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.789+0000 7f13de7fc700 1 -- 172.21.15.146:0/3074645644 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f4058d50 con 0x55f930b44bd0 2023-10-06T11:19:02.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.789+0000 7f13de7fc700 1 -- 172.21.15.146:0/3074645644 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f4051e40 con 0x55f930b44bd0 2023-10-06T11:19:02.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.789+0000 7f13de7fc700 1 -- 172.21.15.146:0/3074645644 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f405caa0 con 0x55f930b44bd0 2023-10-06T11:19:02.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.790+0000 7f14082c7b80 1 -- 172.21.15.146:0/3074645644 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f930b44bd0 msgr2=0x55f930b6bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:02.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.790+0000 7f14082c7b80 1 --2- 172.21.15.146:0/3074645644 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f930b44bd0 0x55f930b6bc40 secure :-1 s=READY pgs=2265 cs=0 l=1 rev1=1 crypto rx=0x7f13f40557b0 tx=0x7f13f4070000 comp rx=0 tx=0).stop 2023-10-06T11:19:02.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.790+0000 7f14082c7b80 1 -- 172.21.15.146:0/3074645644 shutdown_connections 2023-10-06T11:19:02.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.790+0000 7f14082c7b80 1 --2- 172.21.15.146:0/3074645644 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f930b8aa90 0x55f930b40720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:02.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.790+0000 7f14082c7b80 1 --2- 172.21.15.146:0/3074645644 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f930b44bd0 0x55f930b6bc40 unknown :-1 s=CLOSED pgs=2265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:02.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.790+0000 7f14082c7b80 1 --2- 172.21.15.146:0/3074645644 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f930b469a0 0x55f930b6c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:02.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.790+0000 7f14082c7b80 1 -- 172.21.15.146:0/3074645644 >> 172.21.15.146:0/3074645644 conn(0x55f930b45070 msgr2=0x55f930ba3880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:02.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.790+0000 7f14082c7b80 1 -- 172.21.15.146:0/3074645644 shutdown_connections 2023-10-06T11:19:02.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.790+0000 7f14082c7b80 1 -- 172.21.15.146:0/3074645644 wait complete. 2023-10-06T11:19:02.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.790+0000 7f14082c7b80 1 -- start start 2023-10-06T11:19:02.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.790+0000 7f14082c7b80 1 Processor -- start 2023-10-06T11:19:02.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.791+0000 7f14082c7b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f930b44bd0 0x55f930bec640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:02.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.791+0000 7f14082c7b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f930b469a0 0x55f930b40720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:02.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.791+0000 7f14082c7b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f930b8aa90 0x55f930b40c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:02.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.791+0000 7f14082c7b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f930becb80 con 0x55f930b44bd0 2023-10-06T11:19:02.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.791+0000 7f14082c7b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f930b8e5d0 con 0x55f930b8aa90 2023-10-06T11:19:02.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.791+0000 7f14082c7b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f930bf3600 con 0x55f930b469a0 2023-10-06T11:19:02.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.791+0000 7f14082c7b80 10 client.0 _ll_register_callbacks cb 0x55f930930f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:19:02.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.791+0000 7f13fcd6b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f930b44bd0 0x55f930bec640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:02.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.791+0000 7f13fcd6b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f930b44bd0 0x55f930bec640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41370/0 (socket says 172.21.15.146:41370) 2023-10-06T11:19:02.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.791+0000 7f13fcd6b700 1 -- 172.21.15.146:0/4269646797 learned_addr learned my addr 172.21.15.146:0/4269646797 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:02.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.792+0000 7f13fcd6b700 1 -- 172.21.15.146:0/4269646797 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f930b469a0 msgr2=0x55f930b40720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:02.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.792+0000 7f13fd56c700 1 --2- 172.21.15.146:0/4269646797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f930b8aa90 0x55f930b40c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:02.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.792+0000 7f13effff700 1 --2- 172.21.15.146:0/4269646797 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f930b469a0 0x55f930b40720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:02.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.792+0000 7f13fcd6b700 1 --2- 172.21.15.146:0/4269646797 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f930b469a0 0x55f930b40720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:02.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.792+0000 7f13fcd6b700 1 -- 172.21.15.146:0/4269646797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f930b8aa90 msgr2=0x55f930b40c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:02.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.792+0000 7f13fcd6b700 1 --2- 172.21.15.146:0/4269646797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f930b8aa90 0x55f930b40c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:02.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.792+0000 7f13fcd6b700 1 -- 172.21.15.146:0/4269646797 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f9308d0fe0 con 0x55f930b44bd0 2023-10-06T11:19:02.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.792+0000 7f13fcd6b700 1 --2- 172.21.15.146:0/4269646797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f930b44bd0 0x55f930bec640 secure :-1 s=READY pgs=2266 cs=0 l=1 rev1=1 crypto rx=0x7f13f4055a90 tx=0x7f13f4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c9da96a7345dde2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:02.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.792+0000 7f13d6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:19:02.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.792+0000 7f13d6ffd700 1 -- 172.21.15.146:0/4269646797 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f405caa0 con 0x55f930b44bd0 2023-10-06T11:19:02.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.792+0000 7f13d6ffd700 1 -- 172.21.15.146:0/4269646797 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(177..177 src has 1..177) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f13f4068020 con 0x55f930b44bd0 2023-10-06T11:19:02.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.792+0000 7f14082c7b80 1 -- 172.21.15.146:0/4269646797 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f13e801bc50 con 0x55f930b44bd0 2023-10-06T11:19:02.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.792+0000 7f13d6ffd700 1 -- 172.21.15.146:0/4269646797 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=144) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13f4054ff0 con 0x55f930b44bd0 2023-10-06T11:19:02.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.792+0000 7f14082c7b80 10 client.10656 fetch_fsmap learned FSMap version 144 2023-10-06T11:19:02.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.792+0000 7f14082c7b80 1 -- 172.21.15.146:0/4269646797 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=144,monmap=2+}) v3 -- 0x55f930a62780 con 0x55f930b44bd0 2023-10-06T11:19:02.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.792+0000 7f13d6ffd700 1 -- 172.21.15.146:0/4269646797 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f4076020 con 0x55f930b44bd0 2023-10-06T11:19:02.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.792+0000 7f13d6ffd700 1 -- 172.21.15.146:0/4269646797 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 144) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f13f4056b10 con 0x55f930b44bd0 2023-10-06T11:19:02.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.792+0000 7f14082c7b80 10 client.10656 fetch_fsmap finished waiting for FSMap version 144 2023-10-06T11:19:02.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.792+0000 7f14082c7b80 10 client.10656 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T11:19:02.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.792+0000 7f14082c7b80 20 client.10656 populate_metadata read hostname 'smithi146' 2023-10-06T11:19:02.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.792+0000 7f14082c7b80 1 --2- 172.21.15.146:0/4269646797 >> [v2:172.21.15.151:6832/1134233840,v1:172.21.15.151:6834/1134233840] conn(0x55f930bd7ac0 0x55f930bd7e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:02.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.792+0000 7f14082c7b80 4 client.10656 mds_command: new command op to 10476 tid=0[{"prefix": "status"}] 2023-10-06T11:19:02.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.792+0000 7f14082c7b80 1 -- 172.21.15.146:0/4269646797 --> [v2:172.21.15.151:6832/1134233840,v1:172.21.15.151:6834/1134233840] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f930a36e00 con 0x55f930bd7ac0 2023-10-06T11:19:02.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.793+0000 7f13effff700 1 --2- 172.21.15.146:0/4269646797 >> [v2:172.21.15.151:6832/1134233840,v1:172.21.15.151:6834/1134233840] conn(0x55f930bd7ac0 0x55f930bd7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:02.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.793+0000 7f13d6ffd700 10 client.10656 ms_handle_connect on v2:172.21.15.151:6832/1134233840 2023-10-06T11:19:02.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.793+0000 7f13effff700 1 --2- 172.21.15.146:0/4269646797 >> [v2:172.21.15.151:6832/1134233840,v1:172.21.15.151:6834/1134233840] conn(0x55f930bd7ac0 0x55f930bd7e90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8076096808f13f60 server_cookie=e720a0d601bfbf13 in_seq=0 out_seq=0 2023-10-06T11:19:02.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.793+0000 7f13d6ffd700 1 -- 172.21.15.146:0/4269646797 <== mds.0 v2:172.21.15.151:6832/1134233840 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+329 (crc 0 0 0) 0x55f930a36e00 con 0x55f930bd7ac0 2023-10-06T11:19:02.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.793+0000 7f13d6ffd700 10 client.10656 handle_command_reply: tid=0 2023-10-06T11:19:02.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.793+0000 7f14082c7b80 1 client.10656 shutdown 2023-10-06T11:19:02.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.793+0000 7f14082c7b80 1 -- 172.21.15.146:0/4269646797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f930b44bd0 msgr2=0x55f930bec640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:02.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.793+0000 7f14082c7b80 1 --2- 172.21.15.146:0/4269646797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f930b44bd0 0x55f930bec640 secure :-1 s=READY pgs=2266 cs=0 l=1 rev1=1 crypto rx=0x7f13f4055a90 tx=0x7f13f4016000 comp rx=0 tx=0).stop 2023-10-06T11:19:02.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.793+0000 7f14082c7b80 1 -- 172.21.15.146:0/4269646797 shutdown_connections 2023-10-06T11:19:02.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.793+0000 7f14082c7b80 1 --2- 172.21.15.146:0/4269646797 >> [v2:172.21.15.151:6832/1134233840,v1:172.21.15.151:6834/1134233840] conn(0x55f930bd7ac0 0x55f930bd7e90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:02.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.793+0000 7f14082c7b80 1 --2- 172.21.15.146:0/4269646797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f930b8aa90 0x55f930b40c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:02.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.793+0000 7f13d6ffd700 0 client.10656 ms_handle_reset on v2:172.21.15.151:6832/1134233840 2023-10-06T11:19:02.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.793+0000 7f14082c7b80 1 --2- 172.21.15.146:0/4269646797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55f930b44bd0 0x55f930bec640 unknown :-1 s=CLOSED pgs=2266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:02.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.793+0000 7f14082c7b80 1 --2- 172.21.15.146:0/4269646797 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55f930b469a0 0x55f930b40720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:02.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.793+0000 7f14082c7b80 1 -- 172.21.15.146:0/4269646797 >> 172.21.15.146:0/4269646797 conn(0x55f930b45070 msgr2=0x55f930b69710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:02.803 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.793+0000 7f14082c7b80 1 -- 172.21.15.146:0/4269646797 shutdown_connections 2023-10-06T11:19:02.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.793+0000 7f14082c7b80 1 -- 172.21.15.146:0/4269646797 wait complete. 2023-10-06T11:19:02.804 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.794+0000 7f14082c7b80 20 client.10656 trim_cache size 0 max 16384 2023-10-06T11:19:02.804 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:19:02.804 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1", 2023-10-06T11:19:02.804 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2023-10-06T11:19:02.804 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 10476, 2023-10-06T11:19:02.804 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2023-10-06T11:19:02.804 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2023-10-06T11:19:02.805 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2023-10-06T11:19:02.805 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 10.293962548, 2023-10-06T11:19:02.805 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 144, 2023-10-06T11:19:02.805 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 177, 2023-10-06T11:19:02.805 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 177, 2023-10-06T11:19:02.805 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 16.377137265000002 2023-10-06T11:19:02.805 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:19:02.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.794+0000 7f13fefcf700 1 -- 172.21.15.146:0/575700403 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f13e4066f30 msgr2=0x7f13e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:02.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.794+0000 7f13fefcf700 1 --2- 172.21.15.146:0/575700403 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f13e4066f30 0x7f13e40693e0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f13f80c92e0 tx=0x7f13e8017000 comp rx=0 tx=0).stop 2023-10-06T11:19:02.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.794+0000 7f13fefcf700 1 -- 172.21.15.146:0/575700403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13f806b760 msgr2=0x7f13f814d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:02.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.794+0000 7f13fefcf700 1 --2- 172.21.15.146:0/575700403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13f806b760 0x7f13f814d8c0 secure :-1 s=READY pgs=2262 cs=0 l=1 rev1=1 crypto rx=0x7f13f4009fd0 tx=0x7f13f4009880 comp rx=0 tx=0).stop 2023-10-06T11:19:02.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.794+0000 7f13fefcf700 1 -- 172.21.15.146:0/575700403 shutdown_connections 2023-10-06T11:19:02.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.794+0000 7f13fefcf700 1 --2- 172.21.15.146:0/575700403 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f13e4066f30 0x7f13e40693e0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:02.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.794+0000 7f13fefcf700 1 --2- 172.21.15.146:0/575700403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13f81584a0 0x7f13f816b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:02.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.794+0000 7f13fefcf700 1 --2- 172.21.15.146:0/575700403 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f13f806b760 0x7f13f814d8c0 unknown :-1 s=CLOSED pgs=2262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:02.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.794+0000 7f13fefcf700 1 --2- 172.21.15.146:0/575700403 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f13f80c8a90 0x7f13f816b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:02.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.794+0000 7f13fefcf700 1 -- 172.21.15.146:0/575700403 >> 172.21.15.146:0/575700403 conn(0x7f13f8067eb0 msgr2=0x7f13f814ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:02.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.794+0000 7f13fefcf700 1 -- 172.21.15.146:0/575700403 shutdown_connections 2023-10-06T11:19:02.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.794+0000 7f13fefcf700 1 -- 172.21.15.146:0/575700403 wait complete. 2023-10-06T11:19:02.808 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T11:19:02.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.920+0000 7f9dac831700 1 Processor -- start 2023-10-06T11:19:02.922 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.920+0000 7f9dac831700 1 -- start start 2023-10-06T11:19:02.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.921+0000 7f9dac831700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9da8143410 0x7f9da80b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:02.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.921+0000 7f9dac831700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9da80cf100 con 0x7f9da80b2530 2023-10-06T11:19:02.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.921+0000 7f9dac831700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9da80ceb30 con 0x7f9da8143040 2023-10-06T11:19:02.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.921+0000 7f9dac831700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9da80b4170 con 0x7f9da8143410 2023-10-06T11:19:02.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.921+0000 7f9da759e700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f9da80b2530 0x7f9da80cf590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52924/0 (socket says 172.21.15.146:52924) 2023-10-06T11:19:02.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.921+0000 7f9da759e700 1 -- 172.21.15.146:0/652381916 learned_addr learned my addr 172.21.15.146:0/652381916 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:19:02.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.921+0000 7f9da659c700 1 --2- 172.21.15.146:0/652381916 >> v2:172.21.15.151:3300/0 conn(0x7f9da8143410 0x7f9da80b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:02.925 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.921+0000 7f9da5d9b700 1 -- 172.21.15.146:0/652381916 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3817546053 0 0) 0x7f9da80cf100 con 0x7f9da80b2530 2023-10-06T11:19:02.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.921+0000 7f9da5d9b700 1 -- 172.21.15.146:0/652381916 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d90003570 con 0x7f9da80b2530 2023-10-06T11:19:02.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.921+0000 7f9da5d9b700 1 -- 172.21.15.146:0/652381916 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 860239882 0 0) 0x7f9d90003570 con 0x7f9da80b2530 2023-10-06T11:19:02.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.921+0000 7f9da659c700 1 -- 172.21.15.146:0/652381916 >> v1:172.21.15.151:6789/0 conn(0x7f9da8143040 legacy=0x7f9da80b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:02.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.921+0000 7f9da659c700 1 -- 172.21.15.146:0/652381916 >> v1:172.21.15.146:6789/0 conn(0x7f9da80b2530 legacy=0x7f9da80cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:02.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.921+0000 7f9da659c700 1 -- 172.21.15.146:0/652381916 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da80cedd0 con 0x7f9da8143410 2023-10-06T11:19:02.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.922+0000 7f9da659c700 1 --2- 172.21.15.146:0/652381916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9da8143410 0x7f9da80b4d20 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c009910 tx=0x7f9d9c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2f71629ebc74f07 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:02.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.922+0000 7f9da5d9b700 1 -- 172.21.15.146:0/652381916 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d980017f0 con 0x7f9da8143410 2023-10-06T11:19:02.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.922+0000 7f9da5d9b700 1 -- 172.21.15.146:0/652381916 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d9c011420 con 0x7f9da8143410 2023-10-06T11:19:02.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.922+0000 7f9da5d9b700 1 -- 172.21.15.146:0/652381916 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c0117c0 con 0x7f9da8143410 2023-10-06T11:19:02.926 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.922+0000 7f9dac831700 1 -- 172.21.15.146:0/652381916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9da8143410 msgr2=0x7f9da80b4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:02.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.922+0000 7f9dac831700 1 --2- 172.21.15.146:0/652381916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9da8143410 0x7f9da80b4d20 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c009910 tx=0x7f9d9c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:19:02.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.922+0000 7f9dac831700 1 -- 172.21.15.146:0/652381916 shutdown_connections 2023-10-06T11:19:02.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.922+0000 7f9dac831700 1 --2- 172.21.15.146:0/652381916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9da8143410 0x7f9da80b4d20 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:02.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.922+0000 7f9dac831700 1 -- 172.21.15.146:0/652381916 >> 172.21.15.146:0/652381916 conn(0x7f9da806eb10 msgr2=0x7f9da806ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:02.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.922+0000 7f9dac831700 1 -- 172.21.15.146:0/652381916 shutdown_connections 2023-10-06T11:19:02.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.922+0000 7f9dac831700 1 -- 172.21.15.146:0/652381916 wait complete. 2023-10-06T11:19:02.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.923+0000 7f9dac831700 1 Processor -- start 2023-10-06T11:19:02.927 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.923+0000 7f9dac831700 1 -- start start 2023-10-06T11:19:02.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.924+0000 7f9dac831700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9da80b2530 0x7f9da80c8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:02.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.924+0000 7f9dac831700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9da8143040 0x7f9da80c62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:02.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.924+0000 7f9dac831700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9da8143410 0x7f9da8133f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:02.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.924+0000 7f9dac831700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da80c6800 con 0x7f9da8143040 2023-10-06T11:19:02.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.924+0000 7f9dac831700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da80c6a30 con 0x7f9da80b2530 2023-10-06T11:19:02.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.924+0000 7f9dac831700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da80c6d10 con 0x7f9da8143410 2023-10-06T11:19:02.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.924+0000 7f9da659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9da8143040 0x7f9da80c62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:02.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.924+0000 7f9da659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9da8143040 0x7f9da80c62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:41380/0 (socket says 172.21.15.146:41380) 2023-10-06T11:19:02.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.924+0000 7f9da659c700 1 -- 172.21.15.146:0/2743066512 learned_addr learned my addr 172.21.15.146:0/2743066512 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:02.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.924+0000 7f9da759e700 1 --2- 172.21.15.146:0/2743066512 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9da8143410 0x7f9da8133f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:02.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.924+0000 7f9da6d9d700 1 --2- 172.21.15.146:0/2743066512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9da80b2530 0x7f9da80c8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:02.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.925+0000 7f9da659c700 1 -- 172.21.15.146:0/2743066512 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9da8143410 msgr2=0x7f9da8133f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:02.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.925+0000 7f9da659c700 1 --2- 172.21.15.146:0/2743066512 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9da8143410 0x7f9da8133f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:02.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.925+0000 7f9da659c700 1 -- 172.21.15.146:0/2743066512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9da80b2530 msgr2=0x7f9da80c8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:02.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.925+0000 7f9da659c700 1 --2- 172.21.15.146:0/2743066512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9da80b2530 0x7f9da80c8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:02.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.925+0000 7f9da659c700 1 -- 172.21.15.146:0/2743066512 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d9c009420 con 0x7f9da8143040 2023-10-06T11:19:02.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.925+0000 7f9da759e700 1 --2- 172.21.15.146:0/2743066512 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9da8143410 0x7f9da8133f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:19:02.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.925+0000 7f9da659c700 1 --2- 172.21.15.146:0/2743066512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9da8143040 0x7f9da80c62c0 secure :-1 s=READY pgs=2268 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c0030c0 tx=0x7f9d9c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:02.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.925+0000 7f9d8effd700 1 -- 172.21.15.146:0/2743066512 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c01cbe0 con 0x7f9da8143040 2023-10-06T11:19:02.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.925+0000 7f9d8effd700 1 -- 172.21.15.146:0/2743066512 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d9c01cd40 con 0x7f9da8143040 2023-10-06T11:19:02.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.925+0000 7f9dac831700 1 -- 172.21.15.146:0/2743066512 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9da80c6ff0 con 0x7f9da8143040 2023-10-06T11:19:02.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.925+0000 7f9d8effd700 1 -- 172.21.15.146:0/2743066512 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9c01a6a0 con 0x7f9da8143040 2023-10-06T11:19:02.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.925+0000 7f9dac831700 1 -- 172.21.15.146:0/2743066512 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9da80ca0c0 con 0x7f9da8143040 2023-10-06T11:19:02.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.926+0000 7f9dac831700 1 -- 172.21.15.146:0/2743066512 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9da8088a80 con 0x7f9da8143040 2023-10-06T11:19:02.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.926+0000 7f9d8effd700 1 -- 172.21.15.146:0/2743066512 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9d9c01aa10 con 0x7f9da8143040 2023-10-06T11:19:02.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.927+0000 7f9d8effd700 1 --2- 172.21.15.146:0/2743066512 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9d94066f30 0x7f9d940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:02.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.927+0000 7f9d8effd700 1 -- 172.21.15.146:0/2743066512 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9d9c085ef0 con 0x7f9da8143040 2023-10-06T11:19:02.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.927+0000 7f9da6d9d700 1 --2- 172.21.15.146:0/2743066512 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9d94066f30 0x7f9d940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:02.932 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.927+0000 7f9da6d9d700 1 --2- 172.21.15.146:0/2743066512 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9d94066f30 0x7f9d940693e0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f9da0003a80 tx=0x7f9da0007ec0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:02.933 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:02.931+0000 7f9d8effd700 1 -- 172.21.15.146:0/2743066512 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9d9c053000 con 0x7f9da8143040 2023-10-06T11:19:03.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:03.160+0000 7f9dac831700 1 -- 172.21.15.146:0/2743066512 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9da804bb40 con 0x7f9da8143040 2023-10-06T11:19:03.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:03.160+0000 7f9d8effd700 1 -- 172.21.15.146:0/2743066512 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v144) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9d9c056620 con 0x7f9da8143040 2023-10-06T11:19:03.162 INFO:teuthology.orchestra.run.smithi146.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T11:19:03.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:03.162+0000 7f9dac831700 1 -- 172.21.15.146:0/2743066512 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9d94066f30 msgr2=0x7f9d940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:03.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:03.162+0000 7f9dac831700 1 --2- 172.21.15.146:0/2743066512 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9d94066f30 0x7f9d940693e0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f9da0003a80 tx=0x7f9da0007ec0 comp rx=0 tx=0).stop 2023-10-06T11:19:03.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:03.162+0000 7f9dac831700 1 -- 172.21.15.146:0/2743066512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9da8143040 msgr2=0x7f9da80c62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:03.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:03.162+0000 7f9dac831700 1 --2- 172.21.15.146:0/2743066512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9da8143040 0x7f9da80c62c0 secure :-1 s=READY pgs=2268 cs=0 l=1 rev1=1 crypto rx=0x7f9d9c0030c0 tx=0x7f9d9c016000 comp rx=0 tx=0).stop 2023-10-06T11:19:03.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:03.162+0000 7f9dac831700 1 -- 172.21.15.146:0/2743066512 shutdown_connections 2023-10-06T11:19:03.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:03.162+0000 7f9dac831700 1 --2- 172.21.15.146:0/2743066512 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9d94066f30 0x7f9d940693e0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:03.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:03.162+0000 7f9dac831700 1 --2- 172.21.15.146:0/2743066512 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9da8143410 0x7f9da8133f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:03.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:03.162+0000 7f9dac831700 1 --2- 172.21.15.146:0/2743066512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9da80b2530 0x7f9da80c8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:03.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:03.162+0000 7f9dac831700 1 --2- 172.21.15.146:0/2743066512 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9da8143040 0x7f9da80c62c0 unknown :-1 s=CLOSED pgs=2268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:03.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:03.162+0000 7f9dac831700 1 -- 172.21.15.146:0/2743066512 >> 172.21.15.146:0/2743066512 conn(0x7f9da806eb10 msgr2=0x7f9da80b13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:03.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:03.162+0000 7f9dac831700 1 -- 172.21.15.146:0/2743066512 shutdown_connections 2023-10-06T11:19:03.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:03.162+0000 7f9dac831700 1 -- 172.21.15.146:0/2743066512 wait complete. 2023-10-06T11:19:03.176 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T11:19:03.176 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T11:19:03.176 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi146.front.sepia.ceph.com 2023-10-06T11:19:03.176 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T11:19:03.176 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T11:19:03.176 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T11:19:03.177 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T11:19:03.177 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T11:19:03.177 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:19:03.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:19:03.177 DEBUG:teuthology.orchestra.run.smithi146:> ip addr 2023-10-06T11:19:03.192 INFO:teuthology.orchestra.run.smithi146.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T11:19:03.192 INFO:teuthology.orchestra.run.smithi146.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T11:19:03.192 INFO:teuthology.orchestra.run.smithi146.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T11:19:03.192 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:19:03.192 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 ::1/128 scope host 2023-10-06T11:19:03.192 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:19:03.192 INFO:teuthology.orchestra.run.smithi146.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:19:03.192 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6e brd ff:ff:ff:ff:ff:ff 2023-10-06T11:19:03.192 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f0 2023-10-06T11:19:03.192 INFO:teuthology.orchestra.run.smithi146.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:19:03.193 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:d9:42:6f brd ff:ff:ff:ff:ff:ff 2023-10-06T11:19:03.193 INFO:teuthology.orchestra.run.smithi146.stdout: altname enp7s0f1 2023-10-06T11:19:03.193 INFO:teuthology.orchestra.run.smithi146.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T11:19:03.193 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fc brd ff:ff:ff:ff:ff:ff 2023-10-06T11:19:03.193 INFO:teuthology.orchestra.run.smithi146.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T11:19:03.193 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0c:c4:7a:88:76:fd brd ff:ff:ff:ff:ff:ff 2023-10-06T11:19:03.193 INFO:teuthology.orchestra.run.smithi146.stdout: inet 172.21.15.146/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T11:19:03.193 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft 41714sec preferred_lft 41714sec 2023-10-06T11:19:03.193 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::ec4:7aff:fe88:76fd/64 scope link noprefixroute 2023-10-06T11:19:03.193 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:19:03.193 INFO:teuthology.orchestra.run.smithi146.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T11:19:03.193 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0e:4f:33:80:c4:0e brd ff:ff:ff:ff:ff:ff 2023-10-06T11:19:03.194 INFO:teuthology.orchestra.run.smithi146.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T11:19:03.194 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:19:03.194 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3884:6eff:fefc:ffc7/64 scope link 2023-10-06T11:19:03.194 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:19:03.194 INFO:teuthology.orchestra.run.smithi146.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:19:03.194 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 0e:4f:33:80:c4:0e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T11:19:03.194 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::c4f:33ff:fe80:c40e/64 scope link 2023-10-06T11:19:03.194 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:19:03.194 INFO:teuthology.orchestra.run.smithi146.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T11:19:03.194 INFO:teuthology.orchestra.run.smithi146.stdout: link/ether 36:96:28:73:57:c4 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T11:19:03.194 INFO:teuthology.orchestra.run.smithi146.stdout: inet6 fe80::3496:28ff:fe73:57c4/64 scope link 2023-10-06T11:19:03.194 INFO:teuthology.orchestra.run.smithi146.stdout: valid_lft forever preferred_lft forever 2023-10-06T11:19:03.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:19:03.195 DEBUG:teuthology.orchestra.run.smithi146:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T11:19:03.256 INFO:teuthology.orchestra.run.smithi146.stdout:1 2023-10-06T11:19:03.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:19:03.257 DEBUG:teuthology.orchestra.run.smithi146:> route 2023-10-06T11:19:03.313 INFO:teuthology.orchestra.run.smithi146.stdout:Kernel IP routing table 2023-10-06T11:19:03.314 INFO:teuthology.orchestra.run.smithi146.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T11:19:03.314 INFO:teuthology.orchestra.run.smithi146.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T11:19:03.314 INFO:teuthology.orchestra.run.smithi146.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T11:19:03.314 INFO:teuthology.orchestra.run.smithi146.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T11:19:03.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:19:03.314 DEBUG:teuthology.orchestra.run.smithi146:> (cd / && exec bash -c ' 2023-10-06T11:19:03.314 DEBUG:teuthology.orchestra.run.smithi146:> set -e 2023-10-06T11:19:03.315 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T11:19:03.315 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T11:19:03.315 DEBUG:teuthology.orchestra.run.smithi146:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T11:19:03.315 DEBUG:teuthology.orchestra.run.smithi146:> ') 2023-10-06T11:19:03.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:19:03.414 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-10-06T11:19:03.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T11:19:03.428 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T11:19:03.428 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:19:03.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:19:03.429 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link set brx.0 up 2023-10-06T11:19:03.493 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-06T11:19:03.493 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:19:03.493 DEBUG:teuthology.orchestra.run.smithi146:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T11:19:03.563 INFO:teuthology.orchestra.run.smithi146.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T11:19:03.564 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T11:19:03.564 DEBUG:teuthology.orchestra.run.smithi146:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:19:03.619 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-06T11:19:03.683 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:19:03.683 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:19:03.747 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:19:03.748 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:19:03.748 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:19:03.749 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-06T11:19:03.803 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-06T11:19:03.803 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-06T11:19:03.846 DEBUG:teuthology.orchestra.run.smithi146:> sudo modprobe fuse 2023-10-06T11:19:03.870 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-10-06T11:19:03.870 DEBUG:teuthology.orchestra.run.smithi146:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-10-06T11:19:03.926 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:2023-10-06T11:19:03.925+0000 7f9abd743540 -1 init, newargv = 0x56353fe860e0 newargc=15 2023-10-06T11:19:03.927 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[159792]: starting ceph client 2023-10-06T11:19:03.931 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[159792]: starting fuse 2023-10-06T11:19:03.936 INFO:teuthology.orchestra.run.smithi146.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-10-06T11:19:03.937 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-10-06T11:19:03.938 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:19:03.938 DEBUG:teuthology.orchestra.run.smithi146:> ls /sys/fs/fuse/connections 2023-10-06T11:19:03.994 INFO:teuthology.orchestra.run.smithi146.stdout:46 2023-10-06T11:19:03.995 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-10-06T11:19:03.995 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-10-06T11:19:03.995 DEBUG:teuthology.orchestra.run.smithi146:> import glob 2023-10-06T11:19:03.995 DEBUG:teuthology.orchestra.run.smithi146:> import re 2023-10-06T11:19:03.995 DEBUG:teuthology.orchestra.run.smithi146:> import os 2023-10-06T11:19:03.995 DEBUG:teuthology.orchestra.run.smithi146:> import subprocess 2023-10-06T11:19:03.996 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:19:03.996 DEBUG:teuthology.orchestra.run.smithi146:> def _find_admin_socket(client_name): 2023-10-06T11:19:03.996 DEBUG:teuthology.orchestra.run.smithi146:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-06T11:19:03.996 DEBUG:teuthology.orchestra.run.smithi146:> files = glob.glob(asok_path) 2023-10-06T11:19:03.996 DEBUG:teuthology.orchestra.run.smithi146:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-06T11:19:03.996 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:19:03.996 DEBUG:teuthology.orchestra.run.smithi146:> # Given a non-glob path, it better be there 2023-10-06T11:19:03.996 DEBUG:teuthology.orchestra.run.smithi146:> if "*" not in asok_path: 2023-10-06T11:19:03.996 DEBUG:teuthology.orchestra.run.smithi146:> assert(len(files) == 1) 2023-10-06T11:19:03.996 DEBUG:teuthology.orchestra.run.smithi146:> return files[0] 2023-10-06T11:19:03.997 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:19:03.997 DEBUG:teuthology.orchestra.run.smithi146:> for f in files: 2023-10-06T11:19:03.997 DEBUG:teuthology.orchestra.run.smithi146:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-06T11:19:03.997 DEBUG:teuthology.orchestra.run.smithi146:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-06T11:19:03.997 DEBUG:teuthology.orchestra.run.smithi146:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-06T11:19:03.997 DEBUG:teuthology.orchestra.run.smithi146:> contents = proc_f.read() 2023-10-06T11:19:03.997 DEBUG:teuthology.orchestra.run.smithi146:> if mountpoint in contents: 2023-10-06T11:19:03.997 DEBUG:teuthology.orchestra.run.smithi146:> return f 2023-10-06T11:19:03.997 DEBUG:teuthology.orchestra.run.smithi146:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-06T11:19:03.997 DEBUG:teuthology.orchestra.run.smithi146:> 2023-10-06T11:19:03.997 DEBUG:teuthology.orchestra.run.smithi146:> print(_find_admin_socket("client.0")) 2023-10-06T11:19:03.998 DEBUG:teuthology.orchestra.run.smithi146:> ' 2023-10-06T11:19:04.115 INFO:teuthology.orchestra.run.smithi146.stdout:/var/run/ceph/ceph-client.0.159792.asok 2023-10-06T11:19:04.298 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.159792.asok 2023-10-06T11:19:04.299 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:19:04.299 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.159792.asok status 2023-10-06T11:19:04.448 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:19:04.449 INFO:teuthology.orchestra.run.smithi146.stdout: "metadata": { 2023-10-06T11:19:04.449 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_sha1": "68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564", 2023-10-06T11:19:04.449 INFO:teuthology.orchestra.run.smithi146.stdout: "ceph_version": "ceph version 17.2.6-1274-g68e53a4a (68e53a4a7d4ae06d4fc1a0a7cfef840d1d942564) quincy (stable)", 2023-10-06T11:19:04.449 INFO:teuthology.orchestra.run.smithi146.stdout: "entity_id": "0", 2023-10-06T11:19:04.449 INFO:teuthology.orchestra.run.smithi146.stdout: "hostname": "smithi146", 2023-10-06T11:19:04.449 INFO:teuthology.orchestra.run.smithi146.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-06T11:19:04.449 INFO:teuthology.orchestra.run.smithi146.stdout: "pid": "159792", 2023-10-06T11:19:04.449 INFO:teuthology.orchestra.run.smithi146.stdout: "root": "/" 2023-10-06T11:19:04.449 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:19:04.449 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_count": 0, 2023-10-06T11:19:04.449 INFO:teuthology.orchestra.run.smithi146.stdout: "dentry_pinned_count": 0, 2023-10-06T11:19:04.450 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 10668, 2023-10-06T11:19:04.450 INFO:teuthology.orchestra.run.smithi146.stdout: "inst": { 2023-10-06T11:19:04.450 INFO:teuthology.orchestra.run.smithi146.stdout: "name": { 2023-10-06T11:19:04.450 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "client", 2023-10-06T11:19:04.450 INFO:teuthology.orchestra.run.smithi146.stdout: "num": 10668 2023-10-06T11:19:04.450 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:19:04.450 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-06T11:19:04.450 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-06T11:19:04.450 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:19:04.450 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 2797669000 2023-10-06T11:19:04.450 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:19:04.451 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:19:04.451 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": { 2023-10-06T11:19:04.451 INFO:teuthology.orchestra.run.smithi146.stdout: "type": "v1", 2023-10-06T11:19:04.451 INFO:teuthology.orchestra.run.smithi146.stdout: "addr": "192.168.0.1:0", 2023-10-06T11:19:04.451 INFO:teuthology.orchestra.run.smithi146.stdout: "nonce": 2797669000 2023-10-06T11:19:04.451 INFO:teuthology.orchestra.run.smithi146.stdout: }, 2023-10-06T11:19:04.451 INFO:teuthology.orchestra.run.smithi146.stdout: "inst_str": "client.10668 192.168.0.1:0/2797669000", 2023-10-06T11:19:04.451 INFO:teuthology.orchestra.run.smithi146.stdout: "addr_str": "192.168.0.1:0/2797669000", 2023-10-06T11:19:04.451 INFO:teuthology.orchestra.run.smithi146.stdout: "inode_count": 1, 2023-10-06T11:19:04.451 INFO:teuthology.orchestra.run.smithi146.stdout: "mds_epoch": 144, 2023-10-06T11:19:04.451 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch": 177, 2023-10-06T11:19:04.451 INFO:teuthology.orchestra.run.smithi146.stdout: "osd_epoch_barrier": 0, 2023-10-06T11:19:04.452 INFO:teuthology.orchestra.run.smithi146.stdout: "blocklisted": false, 2023-10-06T11:19:04.452 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs" 2023-10-06T11:19:04.452 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:19:04.458 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:19:04.459 DEBUG:teuthology.orchestra.run.smithi146:> stat --file-system '--printf=%T 2023-10-06T11:19:04.459 DEBUG:teuthology.orchestra.run.smithi146:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-06T11:19:04.474 INFO:teuthology.orchestra.run.smithi146.stdout:fuseblk 2023-10-06T11:19:04.474 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-06T11:19:04.474 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:19:04.474 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T11:19:04.539 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:19:04.540 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent) 2023-10-06T11:19:04.603 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:19:04.603 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent/child) 2023-10-06T11:19:04.661 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:19:04.661 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=parent/parentfile bs=1M conv=fdatasync count=6 seek=0) 2023-10-06T11:19:04.768 INFO:teuthology.orchestra.run.smithi146.stderr:6+0 records in 2023-10-06T11:19:04.768 INFO:teuthology.orchestra.run.smithi146.stderr:6+0 records out 2023-10-06T11:19:04.769 INFO:teuthology.orchestra.run.smithi146.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0509951 s, 123 MB/s 2023-10-06T11:19:04.769 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T11:19:04.770 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=parent/child/childfile bs=1M conv=fdatasync count=6 seek=0) 2023-10-06T11:19:04.840 INFO:teuthology.orchestra.run.smithi146.stderr:6+0 records in 2023-10-06T11:19:04.841 INFO:teuthology.orchestra.run.smithi146.stderr:6+0 records out 2023-10-06T11:19:04.841 INFO:teuthology.orchestra.run.smithi146.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0532654 s, 118 MB/s 2023-10-06T11:19:04.842 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T11:19:04.844 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T11:19:04.885 INFO:teuthology.orchestra.run.smithi146.stdout:[global] 2023-10-06T11:19:04.885 INFO:teuthology.orchestra.run.smithi146.stdout: chdir = "" 2023-10-06T11:19:04.885 INFO:teuthology.orchestra.run.smithi146.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T11:19:04.885 INFO:teuthology.orchestra.run.smithi146.stdout: auth supported = cephx 2023-10-06T11:19:04.885 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:04.886 INFO:teuthology.orchestra.run.smithi146.stdout: filestore xattr use omap = true 2023-10-06T11:19:04.886 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:04.886 INFO:teuthology.orchestra.run.smithi146.stdout: mon clock drift allowed = 1.000 2023-10-06T11:19:04.886 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:04.886 INFO:teuthology.orchestra.run.smithi146.stdout: osd crush chooseleaf type = 0 2023-10-06T11:19:04.886 INFO:teuthology.orchestra.run.smithi146.stdout: auth debug = true 2023-10-06T11:19:04.886 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:04.886 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on old message = true 2023-10-06T11:19:04.886 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on bug = true 2023-10-06T11:19:04.886 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:04.886 INFO:teuthology.orchestra.run.smithi146.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T11:19:04.887 INFO:teuthology.orchestra.run.smithi146.stdout: mon pg warn max object skew = 0 2023-10-06T11:19:04.887 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:04.887 INFO:teuthology.orchestra.run.smithi146.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T11:19:04.887 INFO:teuthology.orchestra.run.smithi146.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T11:19:04.887 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:04.887 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default size = 2 2023-10-06T11:19:04.887 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:04.887 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow primary affinity = true 2023-10-06T11:19:04.887 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow pg remap = true 2023-10-06T11:19:04.887 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on legacy crush tunables = false 2023-10-06T11:19:04.887 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on crush straw calc version zero = false 2023-10-06T11:19:04.887 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on no sortbitwise = false 2023-10-06T11:19:04.887 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on osd down out interval zero = false 2023-10-06T11:19:04.888 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on too few osds = false 2023-10-06T11:19:04.888 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T11:19:04.888 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T11:19:04.888 INFO:teuthology.orchestra.run.smithi146.stdout: mon_allow_pool_size_one = true 2023-10-06T11:19:04.888 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:04.888 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T11:19:04.888 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:04.888 INFO:teuthology.orchestra.run.smithi146.stdout: osd default data pool replay window = 5 2023-10-06T11:19:04.888 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:04.888 INFO:teuthology.orchestra.run.smithi146.stdout: mon allow pool delete = true 2023-10-06T11:19:04.888 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:04.888 INFO:teuthology.orchestra.run.smithi146.stdout: mon cluster log file level = debug 2023-10-06T11:19:04.889 INFO:teuthology.orchestra.run.smithi146.stdout: debug asserts on shutdown = true 2023-10-06T11:19:04.889 INFO:teuthology.orchestra.run.smithi146.stdout: mon health detail to clog = false 2023-10-06T11:19:04.889 INFO:teuthology.orchestra.run.smithi146.stdout: mon host = "172.21.15.146,172.21.15.151,[v2:172.21.15.151:3301,v1:172.21.15.151:6790]" 2023-10-06T11:19:04.889 INFO:teuthology.orchestra.run.smithi146.stdout: fsid = c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1 2023-10-06T11:19:04.889 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:04.889 INFO:teuthology.orchestra.run.smithi146.stdout:[osd] 2023-10-06T11:19:04.889 INFO:teuthology.orchestra.run.smithi146.stdout: osd journal size = 100 2023-10-06T11:19:04.889 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:04.889 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub load threshold = 5.0 2023-10-06T11:19:04.889 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub max interval = 600 2023-10-06T11:19:04.889 INFO:teuthology.orchestra.run.smithi146.stdout: osd mclock profile = high_recovery_ops 2023-10-06T11:19:04.889 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:04.889 INFO:teuthology.orchestra.run.smithi146.stdout: osd recover clone overlap = true 2023-10-06T11:19:04.890 INFO:teuthology.orchestra.run.smithi146.stdout: osd recovery max chunk = 1048576 2023-10-06T11:19:04.890 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:04.890 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug shutdown = true 2023-10-06T11:19:04.890 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug op order = true 2023-10-06T11:19:04.890 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug verify stray on activate = true 2023-10-06T11:19:04.890 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:04.890 INFO:teuthology.orchestra.run.smithi146.stdout: osd open classes on start = true 2023-10-06T11:19:04.890 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug pg log writeout = true 2023-10-06T11:19:04.890 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:04.890 INFO:teuthology.orchestra.run.smithi146.stdout: osd deep scrub update digest min age = 30 2023-10-06T11:19:04.890 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:04.890 INFO:teuthology.orchestra.run.smithi146.stdout: osd map max advance = 10 2023-10-06T11:19:04.891 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:04.891 INFO:teuthology.orchestra.run.smithi146.stdout: journal zero on create = true 2023-10-06T11:19:04.891 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:04.891 INFO:teuthology.orchestra.run.smithi146.stdout: filestore ondisk finisher threads = 3 2023-10-06T11:19:04.891 INFO:teuthology.orchestra.run.smithi146.stdout: filestore apply finisher threads = 3 2023-10-06T11:19:04.891 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:04.891 INFO:teuthology.orchestra.run.smithi146.stdout: bdev debug aio = true 2023-10-06T11:19:04.891 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug misdirected ops = true 2023-10-06T11:19:04.891 INFO:teuthology.orchestra.run.smithi146.stdout: bdev async discard = True 2023-10-06T11:19:04.891 INFO:teuthology.orchestra.run.smithi146.stdout: bdev enable discard = True 2023-10-06T11:19:04.891 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore allocator = bitmap 2023-10-06T11:19:04.891 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore block size = 96636764160 2023-10-06T11:19:04.892 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore fsck on mount = True 2023-10-06T11:19:04.892 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluefs = 1/20 2023-10-06T11:19:04.892 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluestore = 1/20 2023-10-06T11:19:04.892 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-10-06T11:19:04.892 INFO:teuthology.orchestra.run.smithi146.stdout: debug osd = 20 2023-10-06T11:19:04.892 INFO:teuthology.orchestra.run.smithi146.stdout: debug rocksdb = 4/10 2023-10-06T11:19:04.892 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T11:19:04.892 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd full ratio = 0.9 2023-10-06T11:19:04.892 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd nearfull ratio = 0.8 2023-10-06T11:19:04.892 INFO:teuthology.orchestra.run.smithi146.stdout: osd failsafe full ratio = 0.95 2023-10-06T11:19:04.893 INFO:teuthology.orchestra.run.smithi146.stdout: osd objectstore = bluestore 2023-10-06T11:19:04.893 INFO:teuthology.orchestra.run.smithi146.stdout: osd op complaint time = 180 2023-10-06T11:19:04.893 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:04.893 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr] 2023-10-06T11:19:04.893 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-10-06T11:19:04.893 INFO:teuthology.orchestra.run.smithi146.stdout: debug mgr = 20 2023-10-06T11:19:04.893 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2023-10-06T11:19:04.893 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2023-10-06T11:19:04.893 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2023-10-06T11:19:04.893 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2023-10-06T11:19:04.893 INFO:teuthology.orchestra.run.smithi146.stdout: mgr/telemetry/nag = false 2023-10-06T11:19:04.893 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:04.893 INFO:teuthology.orchestra.run.smithi146.stdout:[mon] 2023-10-06T11:19:04.894 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-10-06T11:19:04.894 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2023-10-06T11:19:04.894 INFO:teuthology.orchestra.run.smithi146.stdout: debug paxos = 20 2023-10-06T11:19:04.894 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2023-10-06T11:19:04.894 INFO:teuthology.orchestra.run.smithi146.stdout: mon data avail warn = 5 2023-10-06T11:19:04.894 INFO:teuthology.orchestra.run.smithi146.stdout: mon mgr mkfs grace = 240 2023-10-06T11:19:04.894 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2023-10-06T11:19:04.894 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd reporter subtree level = osd 2023-10-06T11:19:04.894 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd prime pg temp = true 2023-10-06T11:19:04.894 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2023-10-06T11:19:04.894 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:04.895 INFO:teuthology.orchestra.run.smithi146.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T11:19:04.895 INFO:teuthology.orchestra.run.smithi146.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T11:19:04.895 INFO:teuthology.orchestra.run.smithi146.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T11:19:04.895 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:04.895 INFO:teuthology.orchestra.run.smithi146.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T11:19:04.895 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T11:19:04.895 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T11:19:04.895 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:04.895 INFO:teuthology.orchestra.run.smithi146.stdout: # 1m isn't quite enough 2023-10-06T11:19:04.895 INFO:teuthology.orchestra.run.smithi146.stdout: mon_down_mkfs_grace = 2m 2023-10-06T11:19:04.896 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:04.896 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_filestore_osds = false 2023-10-06T11:19:04.896 INFO:teuthology.orchestra.run.smithi146.stdout: mon op complaint time = 120 2023-10-06T11:19:04.896 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:04.896 INFO:teuthology.orchestra.run.smithi146.stdout:[client] 2023-10-06T11:19:04.896 INFO:teuthology.orchestra.run.smithi146.stdout: rgw cache enabled = true 2023-10-06T11:19:04.896 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable ops log = true 2023-10-06T11:19:04.896 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable usage log = true 2023-10-06T11:19:04.896 INFO:teuthology.orchestra.run.smithi146.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T11:19:04.896 INFO:teuthology.orchestra.run.smithi146.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T11:19:04.897 INFO:teuthology.orchestra.run.smithi146.stdout: client mount timeout = 600 2023-10-06T11:19:04.897 INFO:teuthology.orchestra.run.smithi146.stdout: debug client = 20 2023-10-06T11:19:04.897 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-10-06T11:19:04.897 INFO:teuthology.orchestra.run.smithi146.stdout: pid file = "" 2023-10-06T11:19:04.897 INFO:teuthology.orchestra.run.smithi146.stdout: rados mon op timeout = 900 2023-10-06T11:19:04.897 INFO:teuthology.orchestra.run.smithi146.stdout: rados osd op timeout = 900 2023-10-06T11:19:04.897 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.a] 2023-10-06T11:19:04.897 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.b] 2023-10-06T11:19:04.897 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.c] 2023-10-06T11:19:04.897 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.a] 2023-10-06T11:19:04.897 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.c] 2023-10-06T11:19:04.897 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.b] 2023-10-06T11:19:04.897 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.d] 2023-10-06T11:19:04.898 INFO:teuthology.orchestra.run.smithi146.stdout:[mds] 2023-10-06T11:19:04.898 INFO:teuthology.orchestra.run.smithi146.stdout: debug mds = 20 2023-10-06T11:19:04.898 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-10-06T11:19:04.898 INFO:teuthology.orchestra.run.smithi146.stdout: mds cache max size = 1000 2023-10-06T11:19:04.898 INFO:teuthology.orchestra.run.smithi146.stdout: mds debug frag = True 2023-10-06T11:19:04.898 INFO:teuthology.orchestra.run.smithi146.stdout: mds debug scatterstat = False 2023-10-06T11:19:04.898 INFO:teuthology.orchestra.run.smithi146.stdout: mds log max segments = 1 2023-10-06T11:19:04.898 INFO:teuthology.orchestra.run.smithi146.stdout: mds op complaint time = 180 2023-10-06T11:19:04.898 INFO:teuthology.orchestra.run.smithi146.stdout: mds verify scatter = False 2023-10-06T11:19:04.898 INFO:teuthology.orchestra.run.smithi146.stdout: osd op complaint time = 180 2023-10-06T11:19:04.898 INFO:teuthology.orchestra.run.smithi146.stdout: rados mon op timeout = 900 2023-10-06T11:19:04.898 INFO:teuthology.orchestra.run.smithi146.stdout: rados osd op timeout = 900 2023-10-06T11:19:04.899 INFO:teuthology.orchestra.run.smithi151.stdout:[global] 2023-10-06T11:19:04.899 INFO:teuthology.orchestra.run.smithi151.stdout: chdir = "" 2023-10-06T11:19:04.899 INFO:teuthology.orchestra.run.smithi151.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T11:19:04.899 INFO:teuthology.orchestra.run.smithi151.stdout: auth supported = cephx 2023-10-06T11:19:04.900 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:04.900 INFO:teuthology.orchestra.run.smithi151.stdout: filestore xattr use omap = true 2023-10-06T11:19:04.900 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:04.900 INFO:teuthology.orchestra.run.smithi151.stdout: mon clock drift allowed = 1.000 2023-10-06T11:19:04.900 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:04.900 INFO:teuthology.orchestra.run.smithi151.stdout: osd crush chooseleaf type = 0 2023-10-06T11:19:04.900 INFO:teuthology.orchestra.run.smithi151.stdout: auth debug = true 2023-10-06T11:19:04.900 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:04.900 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on old message = true 2023-10-06T11:19:04.900 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on bug = true 2023-10-06T11:19:04.900 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:04.900 INFO:teuthology.orchestra.run.smithi151.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T11:19:04.901 INFO:teuthology.orchestra.run.smithi151.stdout: mon pg warn max object skew = 0 2023-10-06T11:19:04.901 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:04.901 INFO:teuthology.orchestra.run.smithi151.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T11:19:04.901 INFO:teuthology.orchestra.run.smithi151.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T11:19:04.901 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:04.901 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default size = 2 2023-10-06T11:19:04.901 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:04.901 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow primary affinity = true 2023-10-06T11:19:04.901 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow pg remap = true 2023-10-06T11:19:04.901 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on legacy crush tunables = false 2023-10-06T11:19:04.901 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on crush straw calc version zero = false 2023-10-06T11:19:04.901 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on no sortbitwise = false 2023-10-06T11:19:04.901 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on osd down out interval zero = false 2023-10-06T11:19:04.902 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on too few osds = false 2023-10-06T11:19:04.902 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T11:19:04.902 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T11:19:04.902 INFO:teuthology.orchestra.run.smithi151.stdout: mon_allow_pool_size_one = true 2023-10-06T11:19:04.902 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:04.902 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T11:19:04.902 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:04.902 INFO:teuthology.orchestra.run.smithi151.stdout: osd default data pool replay window = 5 2023-10-06T11:19:04.902 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:04.902 INFO:teuthology.orchestra.run.smithi151.stdout: mon allow pool delete = true 2023-10-06T11:19:04.902 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:04.902 INFO:teuthology.orchestra.run.smithi151.stdout: mon cluster log file level = debug 2023-10-06T11:19:04.903 INFO:teuthology.orchestra.run.smithi151.stdout: debug asserts on shutdown = true 2023-10-06T11:19:04.903 INFO:teuthology.orchestra.run.smithi151.stdout: mon health detail to clog = false 2023-10-06T11:19:04.903 INFO:teuthology.orchestra.run.smithi151.stdout: mon host = "172.21.15.146,172.21.15.151,[v2:172.21.15.151:3301,v1:172.21.15.151:6790]" 2023-10-06T11:19:04.903 INFO:teuthology.orchestra.run.smithi151.stdout: fsid = c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1 2023-10-06T11:19:04.903 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:04.903 INFO:teuthology.orchestra.run.smithi151.stdout:[osd] 2023-10-06T11:19:04.903 INFO:teuthology.orchestra.run.smithi151.stdout: osd journal size = 100 2023-10-06T11:19:04.903 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:04.903 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub load threshold = 5.0 2023-10-06T11:19:04.903 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub max interval = 600 2023-10-06T11:19:04.903 INFO:teuthology.orchestra.run.smithi151.stdout: osd mclock profile = high_recovery_ops 2023-10-06T11:19:04.903 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:04.903 INFO:teuthology.orchestra.run.smithi151.stdout: osd recover clone overlap = true 2023-10-06T11:19:04.904 INFO:teuthology.orchestra.run.smithi151.stdout: osd recovery max chunk = 1048576 2023-10-06T11:19:04.904 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:04.904 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug shutdown = true 2023-10-06T11:19:04.904 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug op order = true 2023-10-06T11:19:04.904 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug verify stray on activate = true 2023-10-06T11:19:04.904 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:04.904 INFO:teuthology.orchestra.run.smithi151.stdout: osd open classes on start = true 2023-10-06T11:19:04.904 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug pg log writeout = true 2023-10-06T11:19:04.904 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:04.904 INFO:teuthology.orchestra.run.smithi151.stdout: osd deep scrub update digest min age = 30 2023-10-06T11:19:04.904 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:04.904 INFO:teuthology.orchestra.run.smithi151.stdout: osd map max advance = 10 2023-10-06T11:19:04.905 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:04.905 INFO:teuthology.orchestra.run.smithi151.stdout: journal zero on create = true 2023-10-06T11:19:04.905 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:04.905 INFO:teuthology.orchestra.run.smithi151.stdout: filestore ondisk finisher threads = 3 2023-10-06T11:19:04.905 INFO:teuthology.orchestra.run.smithi151.stdout: filestore apply finisher threads = 3 2023-10-06T11:19:04.905 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:04.905 INFO:teuthology.orchestra.run.smithi151.stdout: bdev debug aio = true 2023-10-06T11:19:04.905 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug misdirected ops = true 2023-10-06T11:19:04.905 INFO:teuthology.orchestra.run.smithi151.stdout: bdev async discard = True 2023-10-06T11:19:04.905 INFO:teuthology.orchestra.run.smithi151.stdout: bdev enable discard = True 2023-10-06T11:19:04.905 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore allocator = bitmap 2023-10-06T11:19:04.905 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore block size = 96636764160 2023-10-06T11:19:04.906 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore fsck on mount = True 2023-10-06T11:19:04.906 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluefs = 1/20 2023-10-06T11:19:04.906 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluestore = 1/20 2023-10-06T11:19:04.906 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-10-06T11:19:04.906 INFO:teuthology.orchestra.run.smithi151.stdout: debug osd = 20 2023-10-06T11:19:04.906 INFO:teuthology.orchestra.run.smithi151.stdout: debug rocksdb = 4/10 2023-10-06T11:19:04.906 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T11:19:04.906 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd full ratio = 0.9 2023-10-06T11:19:04.906 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd nearfull ratio = 0.8 2023-10-06T11:19:04.906 INFO:teuthology.orchestra.run.smithi151.stdout: osd failsafe full ratio = 0.95 2023-10-06T11:19:04.906 INFO:teuthology.orchestra.run.smithi151.stdout: osd objectstore = bluestore 2023-10-06T11:19:04.906 INFO:teuthology.orchestra.run.smithi151.stdout: osd op complaint time = 180 2023-10-06T11:19:04.907 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:04.907 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr] 2023-10-06T11:19:04.907 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-10-06T11:19:04.907 INFO:teuthology.orchestra.run.smithi151.stdout: debug mgr = 20 2023-10-06T11:19:04.907 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2023-10-06T11:19:04.907 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2023-10-06T11:19:04.907 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2023-10-06T11:19:04.907 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2023-10-06T11:19:04.907 INFO:teuthology.orchestra.run.smithi151.stdout: mgr/telemetry/nag = false 2023-10-06T11:19:04.907 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:04.907 INFO:teuthology.orchestra.run.smithi151.stdout:[mon] 2023-10-06T11:19:04.907 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-10-06T11:19:04.908 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2023-10-06T11:19:04.908 INFO:teuthology.orchestra.run.smithi151.stdout: debug paxos = 20 2023-10-06T11:19:04.908 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2023-10-06T11:19:04.908 INFO:teuthology.orchestra.run.smithi151.stdout: mon data avail warn = 5 2023-10-06T11:19:04.908 INFO:teuthology.orchestra.run.smithi151.stdout: mon mgr mkfs grace = 240 2023-10-06T11:19:04.908 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2023-10-06T11:19:04.908 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd reporter subtree level = osd 2023-10-06T11:19:04.908 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd prime pg temp = true 2023-10-06T11:19:04.908 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2023-10-06T11:19:04.908 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:04.908 INFO:teuthology.orchestra.run.smithi151.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T11:19:04.908 INFO:teuthology.orchestra.run.smithi151.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T11:19:04.909 INFO:teuthology.orchestra.run.smithi151.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T11:19:04.909 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:04.909 INFO:teuthology.orchestra.run.smithi151.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T11:19:04.909 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T11:19:04.909 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T11:19:04.909 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:04.909 INFO:teuthology.orchestra.run.smithi151.stdout: # 1m isn't quite enough 2023-10-06T11:19:04.909 INFO:teuthology.orchestra.run.smithi151.stdout: mon_down_mkfs_grace = 2m 2023-10-06T11:19:04.909 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:04.909 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_filestore_osds = false 2023-10-06T11:19:04.909 INFO:teuthology.orchestra.run.smithi151.stdout: mon op complaint time = 120 2023-10-06T11:19:04.909 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:04.909 INFO:teuthology.orchestra.run.smithi151.stdout:[client] 2023-10-06T11:19:04.910 INFO:teuthology.orchestra.run.smithi151.stdout: rgw cache enabled = true 2023-10-06T11:19:04.910 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable ops log = true 2023-10-06T11:19:04.910 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable usage log = true 2023-10-06T11:19:04.910 INFO:teuthology.orchestra.run.smithi151.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T11:19:04.910 INFO:teuthology.orchestra.run.smithi151.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T11:19:04.910 INFO:teuthology.orchestra.run.smithi151.stdout: client mount timeout = 600 2023-10-06T11:19:04.910 INFO:teuthology.orchestra.run.smithi151.stdout: debug client = 20 2023-10-06T11:19:04.910 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-10-06T11:19:04.910 INFO:teuthology.orchestra.run.smithi151.stdout: pid file = "" 2023-10-06T11:19:04.910 INFO:teuthology.orchestra.run.smithi151.stdout: rados mon op timeout = 900 2023-10-06T11:19:04.910 INFO:teuthology.orchestra.run.smithi151.stdout: rados osd op timeout = 900 2023-10-06T11:19:04.910 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.a] 2023-10-06T11:19:04.911 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.b] 2023-10-06T11:19:04.911 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.c] 2023-10-06T11:19:04.911 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.a] 2023-10-06T11:19:04.911 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.c] 2023-10-06T11:19:04.911 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.b] 2023-10-06T11:19:04.911 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.d] 2023-10-06T11:19:04.911 INFO:teuthology.orchestra.run.smithi151.stdout:[mds] 2023-10-06T11:19:04.911 INFO:teuthology.orchestra.run.smithi151.stdout: debug mds = 20 2023-10-06T11:19:04.911 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-10-06T11:19:04.911 INFO:teuthology.orchestra.run.smithi151.stdout: mds cache max size = 1000 2023-10-06T11:19:04.911 INFO:teuthology.orchestra.run.smithi151.stdout: mds debug frag = True 2023-10-06T11:19:04.912 INFO:teuthology.orchestra.run.smithi151.stdout: mds debug scatterstat = False 2023-10-06T11:19:04.912 INFO:teuthology.orchestra.run.smithi151.stdout: mds log max segments = 1 2023-10-06T11:19:04.912 INFO:teuthology.orchestra.run.smithi151.stdout: mds op complaint time = 180 2023-10-06T11:19:04.912 INFO:teuthology.orchestra.run.smithi151.stdout: mds verify scatter = False 2023-10-06T11:19:04.912 INFO:teuthology.orchestra.run.smithi151.stdout: osd op complaint time = 180 2023-10-06T11:19:04.912 INFO:teuthology.orchestra.run.smithi151.stdout: rados mon op timeout = 900 2023-10-06T11:19:04.912 INFO:teuthology.orchestra.run.smithi151.stdout: rados osd op timeout = 900 2023-10-06T11:19:04.914 DEBUG:teuthology.orchestra.run.smithi146:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T11:19:04.956 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T11:19:04.997 INFO:teuthology.orchestra.run.smithi146.stdout:[global] 2023-10-06T11:19:04.997 INFO:teuthology.orchestra.run.smithi146.stdout: chdir = "" 2023-10-06T11:19:04.997 INFO:teuthology.orchestra.run.smithi146.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T11:19:04.997 INFO:teuthology.orchestra.run.smithi146.stdout: auth supported = cephx 2023-10-06T11:19:04.997 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:04.998 INFO:teuthology.orchestra.run.smithi146.stdout: filestore xattr use omap = true 2023-10-06T11:19:04.998 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:04.998 INFO:teuthology.orchestra.run.smithi146.stdout: mon clock drift allowed = 1.000 2023-10-06T11:19:04.998 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:04.998 INFO:teuthology.orchestra.run.smithi146.stdout: osd crush chooseleaf type = 0 2023-10-06T11:19:04.998 INFO:teuthology.orchestra.run.smithi146.stdout: auth debug = true 2023-10-06T11:19:04.998 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:04.998 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on old message = true 2023-10-06T11:19:04.998 INFO:teuthology.orchestra.run.smithi146.stdout: ms die on bug = true 2023-10-06T11:19:04.998 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:04.998 INFO:teuthology.orchestra.run.smithi146.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T11:19:04.999 INFO:teuthology.orchestra.run.smithi146.stdout: mon pg warn max object skew = 0 2023-10-06T11:19:04.999 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:04.999 INFO:teuthology.orchestra.run.smithi146.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T11:19:04.999 INFO:teuthology.orchestra.run.smithi146.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T11:19:04.999 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:04.999 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default size = 2 2023-10-06T11:19:04.999 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:04.999 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow primary affinity = true 2023-10-06T11:19:04.999 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd allow pg remap = true 2023-10-06T11:19:04.999 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on legacy crush tunables = false 2023-10-06T11:19:04.999 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on crush straw calc version zero = false 2023-10-06T11:19:04.999 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on no sortbitwise = false 2023-10-06T11:19:05.000 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on osd down out interval zero = false 2023-10-06T11:19:05.000 INFO:teuthology.orchestra.run.smithi146.stdout: mon warn on too few osds = false 2023-10-06T11:19:05.000 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T11:19:05.000 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T11:19:05.000 INFO:teuthology.orchestra.run.smithi146.stdout: mon_allow_pool_size_one = true 2023-10-06T11:19:05.000 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:05.000 INFO:teuthology.orchestra.run.smithi146.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T11:19:05.000 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:05.000 INFO:teuthology.orchestra.run.smithi146.stdout: osd default data pool replay window = 5 2023-10-06T11:19:05.000 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:05.000 INFO:teuthology.orchestra.run.smithi146.stdout: mon allow pool delete = true 2023-10-06T11:19:05.001 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:05.001 INFO:teuthology.orchestra.run.smithi146.stdout: mon cluster log file level = debug 2023-10-06T11:19:05.001 INFO:teuthology.orchestra.run.smithi146.stdout: debug asserts on shutdown = true 2023-10-06T11:19:05.001 INFO:teuthology.orchestra.run.smithi146.stdout: mon health detail to clog = false 2023-10-06T11:19:05.001 INFO:teuthology.orchestra.run.smithi146.stdout: mon host = "172.21.15.146,172.21.15.151,[v2:172.21.15.151:3301,v1:172.21.15.151:6790]" 2023-10-06T11:19:05.001 INFO:teuthology.orchestra.run.smithi146.stdout: fsid = c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1 2023-10-06T11:19:05.001 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:05.001 INFO:teuthology.orchestra.run.smithi146.stdout:[osd] 2023-10-06T11:19:05.001 INFO:teuthology.orchestra.run.smithi146.stdout: osd journal size = 100 2023-10-06T11:19:05.001 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:05.001 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub load threshold = 5.0 2023-10-06T11:19:05.002 INFO:teuthology.orchestra.run.smithi146.stdout: osd scrub max interval = 600 2023-10-06T11:19:05.002 INFO:teuthology.orchestra.run.smithi146.stdout: osd mclock profile = high_recovery_ops 2023-10-06T11:19:05.002 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:05.002 INFO:teuthology.orchestra.run.smithi146.stdout: osd recover clone overlap = true 2023-10-06T11:19:05.002 INFO:teuthology.orchestra.run.smithi146.stdout: osd recovery max chunk = 1048576 2023-10-06T11:19:05.002 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:05.002 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug shutdown = true 2023-10-06T11:19:05.002 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug op order = true 2023-10-06T11:19:05.002 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug verify stray on activate = true 2023-10-06T11:19:05.002 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:05.002 INFO:teuthology.orchestra.run.smithi146.stdout: osd open classes on start = true 2023-10-06T11:19:05.002 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug pg log writeout = true 2023-10-06T11:19:05.003 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:05.003 INFO:teuthology.orchestra.run.smithi146.stdout: osd deep scrub update digest min age = 30 2023-10-06T11:19:05.003 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:05.003 INFO:teuthology.orchestra.run.smithi146.stdout: osd map max advance = 10 2023-10-06T11:19:05.003 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:05.003 INFO:teuthology.orchestra.run.smithi146.stdout: journal zero on create = true 2023-10-06T11:19:05.003 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:05.003 INFO:teuthology.orchestra.run.smithi146.stdout: filestore ondisk finisher threads = 3 2023-10-06T11:19:05.003 INFO:teuthology.orchestra.run.smithi146.stdout: filestore apply finisher threads = 3 2023-10-06T11:19:05.003 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:05.003 INFO:teuthology.orchestra.run.smithi146.stdout: bdev debug aio = true 2023-10-06T11:19:05.003 INFO:teuthology.orchestra.run.smithi146.stdout: osd debug misdirected ops = true 2023-10-06T11:19:05.003 INFO:teuthology.orchestra.run.smithi146.stdout: bdev async discard = True 2023-10-06T11:19:05.004 INFO:teuthology.orchestra.run.smithi146.stdout: bdev enable discard = True 2023-10-06T11:19:05.004 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore allocator = bitmap 2023-10-06T11:19:05.004 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore block size = 96636764160 2023-10-06T11:19:05.004 INFO:teuthology.orchestra.run.smithi146.stdout: bluestore fsck on mount = True 2023-10-06T11:19:05.004 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluefs = 1/20 2023-10-06T11:19:05.004 INFO:teuthology.orchestra.run.smithi146.stdout: debug bluestore = 1/20 2023-10-06T11:19:05.004 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-10-06T11:19:05.004 INFO:teuthology.orchestra.run.smithi146.stdout: debug osd = 20 2023-10-06T11:19:05.004 INFO:teuthology.orchestra.run.smithi146.stdout: debug rocksdb = 4/10 2023-10-06T11:19:05.004 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T11:19:05.004 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd full ratio = 0.9 2023-10-06T11:19:05.004 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd nearfull ratio = 0.8 2023-10-06T11:19:05.005 INFO:teuthology.orchestra.run.smithi146.stdout: osd failsafe full ratio = 0.95 2023-10-06T11:19:05.005 INFO:teuthology.orchestra.run.smithi146.stdout: osd objectstore = bluestore 2023-10-06T11:19:05.005 INFO:teuthology.orchestra.run.smithi146.stdout: osd op complaint time = 180 2023-10-06T11:19:05.005 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:05.005 INFO:teuthology.orchestra.run.smithi146.stdout:[mgr] 2023-10-06T11:19:05.005 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-10-06T11:19:05.005 INFO:teuthology.orchestra.run.smithi146.stdout: debug mgr = 20 2023-10-06T11:19:05.005 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2023-10-06T11:19:05.005 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2023-10-06T11:19:05.005 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2023-10-06T11:19:05.005 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2023-10-06T11:19:05.005 INFO:teuthology.orchestra.run.smithi146.stdout: mgr/telemetry/nag = false 2023-10-06T11:19:05.005 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:05.006 INFO:teuthology.orchestra.run.smithi146.stdout:[mon] 2023-10-06T11:19:05.006 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-10-06T11:19:05.006 INFO:teuthology.orchestra.run.smithi146.stdout: debug mon = 20 2023-10-06T11:19:05.006 INFO:teuthology.orchestra.run.smithi146.stdout: debug paxos = 20 2023-10-06T11:19:05.006 INFO:teuthology.orchestra.run.smithi146.stdout: debug auth = 20 2023-10-06T11:19:05.006 INFO:teuthology.orchestra.run.smithi146.stdout: mon data avail warn = 5 2023-10-06T11:19:05.006 INFO:teuthology.orchestra.run.smithi146.stdout: mon mgr mkfs grace = 240 2023-10-06T11:19:05.006 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min pgs per osd = 4 2023-10-06T11:19:05.006 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd reporter subtree level = osd 2023-10-06T11:19:05.006 INFO:teuthology.orchestra.run.smithi146.stdout: mon osd prime pg temp = true 2023-10-06T11:19:05.006 INFO:teuthology.orchestra.run.smithi146.stdout: mon reweight min bytes per osd = 10 2023-10-06T11:19:05.007 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:05.007 INFO:teuthology.orchestra.run.smithi146.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T11:19:05.007 INFO:teuthology.orchestra.run.smithi146.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T11:19:05.007 INFO:teuthology.orchestra.run.smithi146.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T11:19:05.007 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:05.007 INFO:teuthology.orchestra.run.smithi146.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T11:19:05.007 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T11:19:05.007 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T11:19:05.007 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:05.007 INFO:teuthology.orchestra.run.smithi146.stdout: # 1m isn't quite enough 2023-10-06T11:19:05.007 INFO:teuthology.orchestra.run.smithi146.stdout: mon_down_mkfs_grace = 2m 2023-10-06T11:19:05.007 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:05.008 INFO:teuthology.orchestra.run.smithi146.stdout: mon_warn_on_filestore_osds = false 2023-10-06T11:19:05.008 INFO:teuthology.orchestra.run.smithi146.stdout: mon op complaint time = 120 2023-10-06T11:19:05.008 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:05.008 INFO:teuthology.orchestra.run.smithi146.stdout:[client] 2023-10-06T11:19:05.008 INFO:teuthology.orchestra.run.smithi146.stdout: rgw cache enabled = true 2023-10-06T11:19:05.008 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable ops log = true 2023-10-06T11:19:05.008 INFO:teuthology.orchestra.run.smithi146.stdout: rgw enable usage log = true 2023-10-06T11:19:05.008 INFO:teuthology.orchestra.run.smithi146.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T11:19:05.008 INFO:teuthology.orchestra.run.smithi146.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T11:19:05.008 INFO:teuthology.orchestra.run.smithi146.stdout: client mount timeout = 600 2023-10-06T11:19:05.008 INFO:teuthology.orchestra.run.smithi146.stdout: debug client = 20 2023-10-06T11:19:05.008 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-10-06T11:19:05.008 INFO:teuthology.orchestra.run.smithi146.stdout: pid file = "" 2023-10-06T11:19:05.009 INFO:teuthology.orchestra.run.smithi146.stdout: rados mon op timeout = 900 2023-10-06T11:19:05.009 INFO:teuthology.orchestra.run.smithi146.stdout: rados osd op timeout = 900 2023-10-06T11:19:05.009 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.a] 2023-10-06T11:19:05.009 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.b] 2023-10-06T11:19:05.009 INFO:teuthology.orchestra.run.smithi146.stdout:[mon.c] 2023-10-06T11:19:05.009 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.a] 2023-10-06T11:19:05.009 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.c] 2023-10-06T11:19:05.009 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.b] 2023-10-06T11:19:05.009 INFO:teuthology.orchestra.run.smithi146.stdout:[mds.d] 2023-10-06T11:19:05.009 INFO:teuthology.orchestra.run.smithi146.stdout:[mds] 2023-10-06T11:19:05.009 INFO:teuthology.orchestra.run.smithi146.stdout: debug mds = 20 2023-10-06T11:19:05.010 INFO:teuthology.orchestra.run.smithi146.stdout: debug ms = 1 2023-10-06T11:19:05.010 INFO:teuthology.orchestra.run.smithi146.stdout: mds cache max size = 1000 2023-10-06T11:19:05.010 INFO:teuthology.orchestra.run.smithi146.stdout: mds debug frag = True 2023-10-06T11:19:05.010 INFO:teuthology.orchestra.run.smithi146.stdout: mds debug scatterstat = False 2023-10-06T11:19:05.010 INFO:teuthology.orchestra.run.smithi146.stdout: mds log max segments = 1 2023-10-06T11:19:05.010 INFO:teuthology.orchestra.run.smithi146.stdout: mds op complaint time = 180 2023-10-06T11:19:05.010 INFO:teuthology.orchestra.run.smithi146.stdout: mds verify scatter = False 2023-10-06T11:19:05.010 INFO:teuthology.orchestra.run.smithi146.stdout: osd op complaint time = 180 2023-10-06T11:19:05.011 INFO:teuthology.orchestra.run.smithi146.stdout: rados mon op timeout = 900 2023-10-06T11:19:05.011 INFO:teuthology.orchestra.run.smithi146.stdout: rados osd op timeout = 900 2023-10-06T11:19:05.012 INFO:teuthology.orchestra.run.smithi151.stdout:[global] 2023-10-06T11:19:05.013 INFO:teuthology.orchestra.run.smithi151.stdout: chdir = "" 2023-10-06T11:19:05.013 INFO:teuthology.orchestra.run.smithi151.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T11:19:05.013 INFO:teuthology.orchestra.run.smithi151.stdout: auth supported = cephx 2023-10-06T11:19:05.013 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:05.013 INFO:teuthology.orchestra.run.smithi151.stdout: filestore xattr use omap = true 2023-10-06T11:19:05.013 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:05.013 INFO:teuthology.orchestra.run.smithi151.stdout: mon clock drift allowed = 1.000 2023-10-06T11:19:05.013 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:05.013 INFO:teuthology.orchestra.run.smithi151.stdout: osd crush chooseleaf type = 0 2023-10-06T11:19:05.013 INFO:teuthology.orchestra.run.smithi151.stdout: auth debug = true 2023-10-06T11:19:05.014 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:05.014 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on old message = true 2023-10-06T11:19:05.014 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on bug = true 2023-10-06T11:19:05.014 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:05.014 INFO:teuthology.orchestra.run.smithi151.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T11:19:05.014 INFO:teuthology.orchestra.run.smithi151.stdout: mon pg warn max object skew = 0 2023-10-06T11:19:05.014 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:05.014 INFO:teuthology.orchestra.run.smithi151.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T11:19:05.014 INFO:teuthology.orchestra.run.smithi151.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T11:19:05.015 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:05.015 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default size = 2 2023-10-06T11:19:05.015 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:05.015 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow primary affinity = true 2023-10-06T11:19:05.015 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow pg remap = true 2023-10-06T11:19:05.015 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on legacy crush tunables = false 2023-10-06T11:19:05.015 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on crush straw calc version zero = false 2023-10-06T11:19:05.015 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on no sortbitwise = false 2023-10-06T11:19:05.015 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on osd down out interval zero = false 2023-10-06T11:19:05.015 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on too few osds = false 2023-10-06T11:19:05.016 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T11:19:05.016 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T11:19:05.016 INFO:teuthology.orchestra.run.smithi151.stdout: mon_allow_pool_size_one = true 2023-10-06T11:19:05.016 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:05.016 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T11:19:05.016 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:05.016 INFO:teuthology.orchestra.run.smithi151.stdout: osd default data pool replay window = 5 2023-10-06T11:19:05.016 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:05.016 INFO:teuthology.orchestra.run.smithi151.stdout: mon allow pool delete = true 2023-10-06T11:19:05.016 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:05.016 INFO:teuthology.orchestra.run.smithi151.stdout: mon cluster log file level = debug 2023-10-06T11:19:05.017 INFO:teuthology.orchestra.run.smithi151.stdout: debug asserts on shutdown = true 2023-10-06T11:19:05.017 INFO:teuthology.orchestra.run.smithi151.stdout: mon health detail to clog = false 2023-10-06T11:19:05.017 INFO:teuthology.orchestra.run.smithi151.stdout: mon host = "172.21.15.146,172.21.15.151,[v2:172.21.15.151:3301,v1:172.21.15.151:6790]" 2023-10-06T11:19:05.017 INFO:teuthology.orchestra.run.smithi151.stdout: fsid = c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1 2023-10-06T11:19:05.017 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:05.017 INFO:teuthology.orchestra.run.smithi151.stdout:[osd] 2023-10-06T11:19:05.017 INFO:teuthology.orchestra.run.smithi151.stdout: osd journal size = 100 2023-10-06T11:19:05.017 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:05.017 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub load threshold = 5.0 2023-10-06T11:19:05.017 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub max interval = 600 2023-10-06T11:19:05.017 INFO:teuthology.orchestra.run.smithi151.stdout: osd mclock profile = high_recovery_ops 2023-10-06T11:19:05.018 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:05.018 INFO:teuthology.orchestra.run.smithi151.stdout: osd recover clone overlap = true 2023-10-06T11:19:05.018 INFO:teuthology.orchestra.run.smithi151.stdout: osd recovery max chunk = 1048576 2023-10-06T11:19:05.018 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:05.018 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug shutdown = true 2023-10-06T11:19:05.018 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug op order = true 2023-10-06T11:19:05.018 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug verify stray on activate = true 2023-10-06T11:19:05.018 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:05.018 INFO:teuthology.orchestra.run.smithi151.stdout: osd open classes on start = true 2023-10-06T11:19:05.018 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug pg log writeout = true 2023-10-06T11:19:05.018 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:05.019 INFO:teuthology.orchestra.run.smithi151.stdout: osd deep scrub update digest min age = 30 2023-10-06T11:19:05.019 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:05.019 INFO:teuthology.orchestra.run.smithi151.stdout: osd map max advance = 10 2023-10-06T11:19:05.019 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:05.019 INFO:teuthology.orchestra.run.smithi151.stdout: journal zero on create = true 2023-10-06T11:19:05.019 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:05.019 INFO:teuthology.orchestra.run.smithi151.stdout: filestore ondisk finisher threads = 3 2023-10-06T11:19:05.019 INFO:teuthology.orchestra.run.smithi151.stdout: filestore apply finisher threads = 3 2023-10-06T11:19:05.019 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:05.019 INFO:teuthology.orchestra.run.smithi151.stdout: bdev debug aio = true 2023-10-06T11:19:05.019 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug misdirected ops = true 2023-10-06T11:19:05.019 INFO:teuthology.orchestra.run.smithi151.stdout: bdev async discard = True 2023-10-06T11:19:05.020 INFO:teuthology.orchestra.run.smithi151.stdout: bdev enable discard = True 2023-10-06T11:19:05.020 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore allocator = bitmap 2023-10-06T11:19:05.020 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore block size = 96636764160 2023-10-06T11:19:05.020 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore fsck on mount = True 2023-10-06T11:19:05.020 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluefs = 1/20 2023-10-06T11:19:05.020 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluestore = 1/20 2023-10-06T11:19:05.020 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-10-06T11:19:05.020 INFO:teuthology.orchestra.run.smithi151.stdout: debug osd = 20 2023-10-06T11:19:05.020 INFO:teuthology.orchestra.run.smithi151.stdout: debug rocksdb = 4/10 2023-10-06T11:19:05.020 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T11:19:05.020 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd full ratio = 0.9 2023-10-06T11:19:05.020 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd nearfull ratio = 0.8 2023-10-06T11:19:05.021 INFO:teuthology.orchestra.run.smithi151.stdout: osd failsafe full ratio = 0.95 2023-10-06T11:19:05.021 INFO:teuthology.orchestra.run.smithi151.stdout: osd objectstore = bluestore 2023-10-06T11:19:05.021 INFO:teuthology.orchestra.run.smithi151.stdout: osd op complaint time = 180 2023-10-06T11:19:05.021 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:05.021 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr] 2023-10-06T11:19:05.021 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-10-06T11:19:05.021 INFO:teuthology.orchestra.run.smithi151.stdout: debug mgr = 20 2023-10-06T11:19:05.023 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2023-10-06T11:19:05.023 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2023-10-06T11:19:05.023 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2023-10-06T11:19:05.023 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2023-10-06T11:19:05.024 INFO:teuthology.orchestra.run.smithi151.stdout: mgr/telemetry/nag = false 2023-10-06T11:19:05.024 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:05.024 INFO:teuthology.orchestra.run.smithi151.stdout:[mon] 2023-10-06T11:19:05.024 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-10-06T11:19:05.024 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2023-10-06T11:19:05.024 INFO:teuthology.orchestra.run.smithi151.stdout: debug paxos = 20 2023-10-06T11:19:05.024 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2023-10-06T11:19:05.024 INFO:teuthology.orchestra.run.smithi151.stdout: mon data avail warn = 5 2023-10-06T11:19:05.024 INFO:teuthology.orchestra.run.smithi151.stdout: mon mgr mkfs grace = 240 2023-10-06T11:19:05.024 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2023-10-06T11:19:05.025 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd reporter subtree level = osd 2023-10-06T11:19:05.025 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd prime pg temp = true 2023-10-06T11:19:05.025 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2023-10-06T11:19:05.025 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:05.025 INFO:teuthology.orchestra.run.smithi151.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T11:19:05.025 INFO:teuthology.orchestra.run.smithi151.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T11:19:05.025 INFO:teuthology.orchestra.run.smithi151.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T11:19:05.025 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:05.025 INFO:teuthology.orchestra.run.smithi151.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T11:19:05.025 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T11:19:05.025 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T11:19:05.026 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:05.026 INFO:teuthology.orchestra.run.smithi151.stdout: # 1m isn't quite enough 2023-10-06T11:19:05.026 INFO:teuthology.orchestra.run.smithi151.stdout: mon_down_mkfs_grace = 2m 2023-10-06T11:19:05.026 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:05.026 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_filestore_osds = false 2023-10-06T11:19:05.026 INFO:teuthology.orchestra.run.smithi151.stdout: mon op complaint time = 120 2023-10-06T11:19:05.026 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-10-06T11:19:05.026 INFO:teuthology.orchestra.run.smithi151.stdout:[client] 2023-10-06T11:19:05.026 INFO:teuthology.orchestra.run.smithi151.stdout: rgw cache enabled = true 2023-10-06T11:19:05.026 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable ops log = true 2023-10-06T11:19:05.026 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable usage log = true 2023-10-06T11:19:05.026 INFO:teuthology.orchestra.run.smithi151.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T11:19:05.027 INFO:teuthology.orchestra.run.smithi151.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T11:19:05.027 INFO:teuthology.orchestra.run.smithi151.stdout: client mount timeout = 600 2023-10-06T11:19:05.027 INFO:teuthology.orchestra.run.smithi151.stdout: debug client = 20 2023-10-06T11:19:05.027 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-10-06T11:19:05.027 INFO:teuthology.orchestra.run.smithi151.stdout: pid file = "" 2023-10-06T11:19:05.027 INFO:teuthology.orchestra.run.smithi151.stdout: rados mon op timeout = 900 2023-10-06T11:19:05.027 INFO:teuthology.orchestra.run.smithi151.stdout: rados osd op timeout = 900 2023-10-06T11:19:05.027 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.a] 2023-10-06T11:19:05.027 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.b] 2023-10-06T11:19:05.027 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.c] 2023-10-06T11:19:05.027 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.a] 2023-10-06T11:19:05.027 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.c] 2023-10-06T11:19:05.028 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.b] 2023-10-06T11:19:05.028 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.d] 2023-10-06T11:19:05.028 INFO:teuthology.orchestra.run.smithi151.stdout:[mds] 2023-10-06T11:19:05.028 INFO:teuthology.orchestra.run.smithi151.stdout: debug mds = 20 2023-10-06T11:19:05.028 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-10-06T11:19:05.028 INFO:teuthology.orchestra.run.smithi151.stdout: mds cache max size = 1000 2023-10-06T11:19:05.028 INFO:teuthology.orchestra.run.smithi151.stdout: mds debug frag = True 2023-10-06T11:19:05.028 INFO:teuthology.orchestra.run.smithi151.stdout: mds debug scatterstat = False 2023-10-06T11:19:05.028 INFO:teuthology.orchestra.run.smithi151.stdout: mds log max segments = 1 2023-10-06T11:19:05.028 INFO:teuthology.orchestra.run.smithi151.stdout: mds op complaint time = 180 2023-10-06T11:19:05.028 INFO:teuthology.orchestra.run.smithi151.stdout: mds verify scatter = False 2023-10-06T11:19:05.028 INFO:teuthology.orchestra.run.smithi151.stdout: osd op complaint time = 180 2023-10-06T11:19:05.029 INFO:teuthology.orchestra.run.smithi151.stdout: rados mon op timeout = 900 2023-10-06T11:19:05.029 INFO:teuthology.orchestra.run.smithi151.stdout: rados osd op timeout = 900 2023-10-06T11:19:05.029 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi146.front.sepia.ceph.com... 2023-10-06T11:19:05.029 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T11:19:05.029 DEBUG:teuthology.orchestra.run.smithi146:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-06T11:19:05.087 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi146.stderr:ceph-fuse[159792]: fuse finished with error 0 and tester_r 0 2023-10-06T11:19:05.090 INFO:teuthology.orchestra.run:waiting for 900 2023-10-06T11:19:11.192 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-10-06T11:19:11.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:19:11.192 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T11:19:11.211 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:19:11.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.375+0000 7fb6e98db700 1 Processor -- start 2023-10-06T11:19:11.377 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.375+0000 7fb6e98db700 1 -- start start 2023-10-06T11:19:11.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.376+0000 7fb6e98db700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6e4143040 0x7fb6e40b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:11.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.376+0000 7fb6e98db700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb6e4143410 0x7fb6e40b2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:11.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.376+0000 7fb6e98db700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb6e40b4d20 0x7fb6e40b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:11.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.376+0000 7fb6e98db700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6e40b4170 con 0x7fb6e4143410 2023-10-06T11:19:11.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.376+0000 7fb6e98db700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6e40b5f50 con 0x7fb6e40b4d20 2023-10-06T11:19:11.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.376+0000 7fb6e98db700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e40cf100 con 0x7fb6e4143040 2023-10-06T11:19:11.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.376+0000 7fb6e3fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb6e4143410 0x7fb6e40b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:11.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.376+0000 7fb6e3fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb6e4143410 0x7fb6e40b2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43016/0 (socket says 172.21.15.146:43016) 2023-10-06T11:19:11.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.376+0000 7fb6e3fff700 1 -- 172.21.15.146:0/3888252527 learned_addr learned my addr 172.21.15.146:0/3888252527 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:11.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.376+0000 7fb6e90da700 1 --2- 172.21.15.146:0/3888252527 >> v2:172.21.15.151:3300/0 conn(0x7fb6e40b4d20 0x7fb6e40b51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:11.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.376+0000 7fb6e88d9700 1 --2- 172.21.15.146:0/3888252527 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6e4143040 0x7fb6e40b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:11.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.376+0000 7fb6e3fff700 1 -- 172.21.15.146:0/3888252527 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6e4143040 msgr2=0x7fb6e40b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:11.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.376+0000 7fb6e3fff700 1 --2- 172.21.15.146:0/3888252527 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6e4143040 0x7fb6e40b1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:11.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.376+0000 7fb6e3fff700 1 -- 172.21.15.146:0/3888252527 >> v2:172.21.15.151:3300/0 conn(0x7fb6e40b4d20 msgr2=0x7fb6e40b51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:11.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.376+0000 7fb6e3fff700 1 --2- 172.21.15.146:0/3888252527 >> v2:172.21.15.151:3300/0 conn(0x7fb6e40b4d20 0x7fb6e40b51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:11.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.376+0000 7fb6e3fff700 1 -- 172.21.15.146:0/3888252527 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e40ceb30 con 0x7fb6e4143410 2023-10-06T11:19:11.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.376+0000 7fb6e88d9700 1 --2- 172.21.15.146:0/3888252527 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6e4143040 0x7fb6e40b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:19:11.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.376+0000 7fb6e90da700 1 --2- 172.21.15.146:0/3888252527 >> v2:172.21.15.151:3300/0 conn(0x7fb6e40b4d20 0x7fb6e40b51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:19:11.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.377+0000 7fb6e3fff700 1 --2- 172.21.15.146:0/3888252527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6e4143410 0x7fb6e40b2360 secure :-1 s=READY pgs=2272 cs=0 l=1 rev1=1 crypto rx=0x7fb6e40892f0 tx=0x7fb6d0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68e112bdfda858bf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:11.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.377+0000 7fb6e37fe700 1 -- 172.21.15.146:0/3888252527 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d000b860 con 0x7fb6e4143410 2023-10-06T11:19:11.381 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.377+0000 7fb6e37fe700 1 -- 172.21.15.146:0/3888252527 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d000b9c0 con 0x7fb6e4143410 2023-10-06T11:19:11.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.377+0000 7fb6e37fe700 1 -- 172.21.15.146:0/3888252527 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d000bd60 con 0x7fb6e4143410 2023-10-06T11:19:11.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.377+0000 7fb6e98db700 1 -- 172.21.15.146:0/3888252527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6e4143410 msgr2=0x7fb6e40b2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:11.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.377+0000 7fb6e98db700 1 --2- 172.21.15.146:0/3888252527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6e4143410 0x7fb6e40b2360 secure :-1 s=READY pgs=2272 cs=0 l=1 rev1=1 crypto rx=0x7fb6e40892f0 tx=0x7fb6d0009250 comp rx=0 tx=0).stop 2023-10-06T11:19:11.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.377+0000 7fb6e98db700 1 -- 172.21.15.146:0/3888252527 shutdown_connections 2023-10-06T11:19:11.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.377+0000 7fb6e98db700 1 --2- 172.21.15.146:0/3888252527 >> v2:172.21.15.151:3300/0 conn(0x7fb6e40b4d20 0x7fb6e40b51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:11.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.377+0000 7fb6e98db700 1 --2- 172.21.15.146:0/3888252527 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6e4143040 0x7fb6e40b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:11.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.377+0000 7fb6e98db700 1 --2- 172.21.15.146:0/3888252527 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6e4143410 0x7fb6e40b2360 unknown :-1 s=CLOSED pgs=2272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:11.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.377+0000 7fb6e98db700 1 -- 172.21.15.146:0/3888252527 >> 172.21.15.146:0/3888252527 conn(0x7fb6e406eb10 msgr2=0x7fb6e406ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:11.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.377+0000 7fb6e98db700 1 -- 172.21.15.146:0/3888252527 shutdown_connections 2023-10-06T11:19:11.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.377+0000 7fb6e98db700 1 -- 172.21.15.146:0/3888252527 wait complete. 2023-10-06T11:19:11.382 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.378+0000 7fb6e98db700 1 Processor -- start 2023-10-06T11:19:11.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.379+0000 7fb6e98db700 1 -- start start 2023-10-06T11:19:11.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.379+0000 7fb6e98db700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6e40b4d20 0x7fb6e4158b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:11.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.379+0000 7fb6e98db700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6e4143040 0x7fb6e40cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:11.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.379+0000 7fb6e98db700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6e4143410 0x7fb6e40c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:11.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.380+0000 7fb6e98db700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e40cca20 con 0x7fb6e40b4d20 2023-10-06T11:19:11.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.380+0000 7fb6e98db700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e40cbe10 con 0x7fb6e4143410 2023-10-06T11:19:11.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.380+0000 7fb6e98db700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e40cc0f0 con 0x7fb6e4143040 2023-10-06T11:19:11.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.380+0000 7fb6e88d9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6e40b4d20 0x7fb6e4158b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:11.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.380+0000 7fb6e88d9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6e40b4d20 0x7fb6e4158b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43024/0 (socket says 172.21.15.146:43024) 2023-10-06T11:19:11.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.380+0000 7fb6e88d9700 1 -- 172.21.15.146:0/3676351549 learned_addr learned my addr 172.21.15.146:0/3676351549 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:11.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.380+0000 7fb6e3fff700 1 --2- 172.21.15.146:0/3676351549 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6e4143040 0x7fb6e40cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:11.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.380+0000 7fb6e90da700 1 --2- 172.21.15.146:0/3676351549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6e4143410 0x7fb6e40c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:11.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.380+0000 7fb6e88d9700 1 -- 172.21.15.146:0/3676351549 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6e4143040 msgr2=0x7fb6e40cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:11.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.380+0000 7fb6e88d9700 1 --2- 172.21.15.146:0/3676351549 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6e4143040 0x7fb6e40cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:11.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.380+0000 7fb6e88d9700 1 -- 172.21.15.146:0/3676351549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6e4143410 msgr2=0x7fb6e40c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:11.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.380+0000 7fb6e88d9700 1 --2- 172.21.15.146:0/3676351549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6e4143410 0x7fb6e40c8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:11.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.380+0000 7fb6e88d9700 1 -- 172.21.15.146:0/3676351549 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d00094f0 con 0x7fb6e40b4d20 2023-10-06T11:19:11.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.380+0000 7fb6e88d9700 1 --2- 172.21.15.146:0/3676351549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6e40b4d20 0x7fb6e4158b60 secure :-1 s=READY pgs=2273 cs=0 l=1 rev1=1 crypto rx=0x7fb6d800e850 tx=0x7fb6d8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:11.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.380+0000 7fb6e0ff9700 1 -- 172.21.15.146:0/3676351549 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d8013410 con 0x7fb6e40b4d20 2023-10-06T11:19:11.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.380+0000 7fb6e0ff9700 1 -- 172.21.15.146:0/3676351549 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d8013570 con 0x7fb6e40b4d20 2023-10-06T11:19:11.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.380+0000 7fb6e98db700 1 -- 172.21.15.146:0/3676351549 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6e40cc3d0 con 0x7fb6e40b4d20 2023-10-06T11:19:11.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.380+0000 7fb6e0ff9700 1 -- 172.21.15.146:0/3676351549 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d8013910 con 0x7fb6e40b4d20 2023-10-06T11:19:11.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.380+0000 7fb6e98db700 1 -- 172.21.15.146:0/3676351549 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6e41590a0 con 0x7fb6e40b4d20 2023-10-06T11:19:11.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.381+0000 7fb6e98db700 1 -- 172.21.15.146:0/3676351549 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6e4088a80 con 0x7fb6e40b4d20 2023-10-06T11:19:11.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.382+0000 7fb6e0ff9700 1 -- 172.21.15.146:0/3676351549 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb6d8013d00 con 0x7fb6e40b4d20 2023-10-06T11:19:11.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.382+0000 7fb6e0ff9700 1 --2- 172.21.15.146:0/3676351549 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb6c8066f30 0x7fb6c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:11.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.382+0000 7fb6e0ff9700 1 -- 172.21.15.146:0/3676351549 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb6d80843e0 con 0x7fb6e40b4d20 2023-10-06T11:19:11.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.382+0000 7fb6e3fff700 1 --2- 172.21.15.146:0/3676351549 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb6c8066f30 0x7fb6c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:11.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.383+0000 7fb6e3fff700 1 --2- 172.21.15.146:0/3676351549 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb6c8066f30 0x7fb6c80693e0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fb6e40892f0 tx=0x7fb6d0017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:11.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.387+0000 7fb6e0ff9700 1 -- 172.21.15.146:0/3676351549 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb6d80514f0 con 0x7fb6e40b4d20 2023-10-06T11:19:11.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.611+0000 7fb6e98db700 1 -- 172.21.15.146:0/3676351549 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb6e404bb40 con 0x7fb6e40b4d20 2023-10-06T11:19:11.613 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.611+0000 7fb6e0ff9700 1 -- 172.21.15.146:0/3676351549 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 144 v144) v1 ==== 95+0+4623 (secure 0 0 0) 0x7fb6d8054b10 con 0x7fb6e40b4d20 2023-10-06T11:19:11.613 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:11.613 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":144,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9094,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/3426437100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3426437100},{"type":"v1","addr":"172.21.15.146:6836","nonce":3426437100}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":139},{"gid":9106,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/3275041097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":3275041097},{"type":"v1","addr":"172.21.15.151:6835","nonce":3275041097}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":139},{"gid":10461,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/2322816938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2322816938},{"type":"v1","addr":"172.21.15.146:6837","nonce":2322816938}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":139}],"filesystems":[{"mdsmap":{"epoch":144,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:18:51.903907+0000","modified":"2023-10-06T11:18:55.524407+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10476":{"gid":10476,"name":"d","rank":0,"incarnation":140,"state":"up:active","state_seq":3,"addr":"172.21.15.151:6834/1134233840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":1134233840},{"type":"v1","addr":"172.21.15.151:6834","nonce":1134233840}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-10-06T11:19:11.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.613+0000 7fb6e98db700 1 -- 172.21.15.146:0/3676351549 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb6c8066f30 msgr2=0x7fb6c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:11.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.613+0000 7fb6e98db700 1 --2- 172.21.15.146:0/3676351549 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb6c8066f30 0x7fb6c80693e0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fb6e40892f0 tx=0x7fb6d0017000 comp rx=0 tx=0).stop 2023-10-06T11:19:11.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.613+0000 7fb6e98db700 1 -- 172.21.15.146:0/3676351549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6e40b4d20 msgr2=0x7fb6e4158b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:11.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.613+0000 7fb6e98db700 1 --2- 172.21.15.146:0/3676351549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6e40b4d20 0x7fb6e4158b60 secure :-1 s=READY pgs=2273 cs=0 l=1 rev1=1 crypto rx=0x7fb6d800e850 tx=0x7fb6d8008040 comp rx=0 tx=0).stop 2023-10-06T11:19:11.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.613+0000 7fb6e98db700 1 -- 172.21.15.146:0/3676351549 shutdown_connections 2023-10-06T11:19:11.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.613+0000 7fb6e98db700 1 --2- 172.21.15.146:0/3676351549 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb6c8066f30 0x7fb6c80693e0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:11.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.613+0000 7fb6e98db700 1 --2- 172.21.15.146:0/3676351549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6e4143410 0x7fb6e40c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:11.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.613+0000 7fb6e98db700 1 --2- 172.21.15.146:0/3676351549 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb6e40b4d20 0x7fb6e4158b60 unknown :-1 s=CLOSED pgs=2273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:11.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.613+0000 7fb6e98db700 1 --2- 172.21.15.146:0/3676351549 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb6e4143040 0x7fb6e40cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:11.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.613+0000 7fb6e98db700 1 -- 172.21.15.146:0/3676351549 >> 172.21.15.146:0/3676351549 conn(0x7fb6e406eb10 msgr2=0x7fb6e4142050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:11.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.613+0000 7fb6e98db700 1 -- 172.21.15.146:0/3676351549 shutdown_connections 2023-10-06T11:19:11.616 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.613+0000 7fb6e98db700 1 -- 172.21.15.146:0/3676351549 wait complete. 2023-10-06T11:19:11.617 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 144 2023-10-06T11:19:11.628 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json flush journal 2023-10-06T11:19:11.781 INFO:teuthology.orchestra.run.smithi151.stdout:{"message":"","return_code":0} 2023-10-06T11:19:11.781 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-10-06T11:19:11.781 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T11:19:11.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.896+0000 7f6bc21b2700 1 Processor -- start 2023-10-06T11:19:11.898 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.896+0000 7f6bc21b2700 1 -- start start 2023-10-06T11:19:11.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.897+0000 7f6bc21b2700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6bbc15a940 0x7f6bbc153c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:11.900 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.897+0000 7f6bc21b2700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6bbc15dcc0 0x7f6bbc0ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:11.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.897+0000 7f6bc21b2700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bbc15d270 con 0x7f6bbc1538c0 2023-10-06T11:19:11.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.897+0000 7f6bc21b2700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bbc15d830 con 0x7f6bbc15dcc0 2023-10-06T11:19:11.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.897+0000 7f6bc21b2700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bbc15e110 con 0x7f6bbc15a940 2023-10-06T11:19:11.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.897+0000 7f6bbbfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6bbc15dcc0 0x7f6bbc0ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:11.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.897+0000 7f6bbb7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6bbc1538c0 0x7f6bbc0cac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39278/0 (socket says 172.21.15.146:39278) 2023-10-06T11:19:11.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.897+0000 7f6bbb7fe700 1 -- 172.21.15.146:0/3253782537 learned_addr learned my addr 172.21.15.146:0/3253782537 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:19:11.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.897+0000 7f6bbbfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6bbc15dcc0 0x7f6bbc0ce610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43034/0 (socket says 172.21.15.146:43034) 2023-10-06T11:19:11.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.897+0000 7f6bbaffd700 1 --2- 172.21.15.146:0/3253782537 >> v2:172.21.15.151:3300/0 conn(0x7f6bbc15a940 0x7f6bbc153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:11.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.898+0000 7f6bbbfff700 1 -- 172.21.15.146:0/3253782537 >> v2:172.21.15.151:3300/0 conn(0x7f6bbc15a940 msgr2=0x7f6bbc153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:11.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.898+0000 7f6bbbfff700 1 --2- 172.21.15.146:0/3253782537 >> v2:172.21.15.151:3300/0 conn(0x7f6bbc15a940 0x7f6bbc153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:11.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.898+0000 7f6bbbfff700 1 -- 172.21.15.146:0/3253782537 >> v1:172.21.15.146:6789/0 conn(0x7f6bbc1538c0 legacy=0x7f6bbc0cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:11.901 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.898+0000 7f6bbbfff700 1 -- 172.21.15.146:0/3253782537 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bbc0cb810 con 0x7f6bbc15dcc0 2023-10-06T11:19:11.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.898+0000 7f6bba7fc700 1 -- 172.21.15.146:0/3253782537 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1954019225 0 0) 0x7f6bbc15d270 con 0x7f6bbc1538c0 2023-10-06T11:19:11.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.898+0000 7f6bbbfff700 1 --2- 172.21.15.146:0/3253782537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6bbc15dcc0 0x7f6bbc0ce610 secure :-1 s=READY pgs=2275 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc0ce180 tx=0x7f6bb40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f5f6d9026a76193 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:11.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.898+0000 7f6bba7fc700 1 -- 172.21.15.146:0/3253782537 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4011630 con 0x7f6bbc15dcc0 2023-10-06T11:19:11.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.898+0000 7f6bba7fc700 1 -- 172.21.15.146:0/3253782537 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb4011790 con 0x7f6bbc15dcc0 2023-10-06T11:19:11.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.898+0000 7f6bba7fc700 1 -- 172.21.15.146:0/3253782537 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4011b30 con 0x7f6bbc15dcc0 2023-10-06T11:19:11.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.898+0000 7f6bc21b2700 1 -- 172.21.15.146:0/3253782537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6bbc15dcc0 msgr2=0x7f6bbc0ce610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:11.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.898+0000 7f6bc21b2700 1 --2- 172.21.15.146:0/3253782537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6bbc15dcc0 0x7f6bbc0ce610 secure :-1 s=READY pgs=2275 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc0ce180 tx=0x7f6bb40091a0 comp rx=0 tx=0).stop 2023-10-06T11:19:11.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.898+0000 7f6bc21b2700 1 -- 172.21.15.146:0/3253782537 shutdown_connections 2023-10-06T11:19:11.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.898+0000 7f6bc21b2700 1 --2- 172.21.15.146:0/3253782537 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6bbc15dcc0 0x7f6bbc0ce610 unknown :-1 s=CLOSED pgs=2275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:11.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.898+0000 7f6bc21b2700 1 --2- 172.21.15.146:0/3253782537 >> v2:172.21.15.151:3300/0 conn(0x7f6bbc15a940 0x7f6bbc153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:11.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.898+0000 7f6bc21b2700 1 -- 172.21.15.146:0/3253782537 >> 172.21.15.146:0/3253782537 conn(0x7f6bbc06eb10 msgr2=0x7f6bbc06ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:11.902 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.898+0000 7f6bc21b2700 1 -- 172.21.15.146:0/3253782537 shutdown_connections 2023-10-06T11:19:11.903 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.898+0000 7f6bc21b2700 1 -- 172.21.15.146:0/3253782537 wait complete. 2023-10-06T11:19:11.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.900+0000 7f6bc21b2700 1 Processor -- start 2023-10-06T11:19:11.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.900+0000 7f6bc21b2700 1 -- start start 2023-10-06T11:19:11.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.900+0000 7f6bc21b2700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6bbc1538c0 0x7f6bbc147800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:11.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.900+0000 7f6bc21b2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6bbc15a940 0x7f6bbc0c76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:11.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.900+0000 7f6bc21b2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6bbc15dcc0 0x7f6bbc0c8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:11.905 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.900+0000 7f6bc21b2700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc0b1330 con 0x7f6bbc15a940 2023-10-06T11:19:11.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.900+0000 7f6bc21b2700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc147d40 con 0x7f6bbc15dcc0 2023-10-06T11:19:11.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.900+0000 7f6bc21b2700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc0b37b0 con 0x7f6bbc1538c0 2023-10-06T11:19:11.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.900+0000 7f6bbaffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6bbc15a940 0x7f6bbc0c76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:11.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.901+0000 7f6bbaffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6bbc15a940 0x7f6bbc0c76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43038/0 (socket says 172.21.15.146:43038) 2023-10-06T11:19:11.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.901+0000 7f6bbaffd700 1 -- 172.21.15.146:0/2577058411 learned_addr learned my addr 172.21.15.146:0/2577058411 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:11.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.901+0000 7f6bbb7fe700 1 --2- 172.21.15.146:0/2577058411 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6bbc1538c0 0x7f6bbc147800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:11.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.901+0000 7f6bbbfff700 1 --2- 172.21.15.146:0/2577058411 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6bbc15dcc0 0x7f6bbc0c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:11.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.901+0000 7f6bbaffd700 1 -- 172.21.15.146:0/2577058411 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6bbc1538c0 msgr2=0x7f6bbc147800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:11.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.901+0000 7f6bbaffd700 1 --2- 172.21.15.146:0/2577058411 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6bbc1538c0 0x7f6bbc147800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:11.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.901+0000 7f6bbaffd700 1 -- 172.21.15.146:0/2577058411 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6bbc15dcc0 msgr2=0x7f6bbc0c8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:11.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.901+0000 7f6bbaffd700 1 --2- 172.21.15.146:0/2577058411 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6bbc15dcc0 0x7f6bbc0c8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:11.906 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.901+0000 7f6bbaffd700 1 -- 172.21.15.146:0/2577058411 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb4009420 con 0x7f6bbc15a940 2023-10-06T11:19:11.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.901+0000 7f6bbaffd700 1 --2- 172.21.15.146:0/2577058411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6bbc15a940 0x7f6bbc0c76f0 secure :-1 s=READY pgs=2276 cs=0 l=1 rev1=1 crypto rx=0x7f6bb000ec80 tx=0x7f6bb00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:11.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.901+0000 7f6ba37fe700 1 -- 172.21.15.146:0/2577058411 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb000c850 con 0x7f6bbc15a940 2023-10-06T11:19:11.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.901+0000 7f6ba37fe700 1 -- 172.21.15.146:0/2577058411 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb000c9b0 con 0x7f6bbc15a940 2023-10-06T11:19:11.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.901+0000 7f6bc21b2700 1 -- 172.21.15.146:0/2577058411 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bbc0b0a20 con 0x7f6bbc15a940 2023-10-06T11:19:11.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.901+0000 7f6ba37fe700 1 -- 172.21.15.146:0/2577058411 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb000cd50 con 0x7f6bbc15a940 2023-10-06T11:19:11.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.901+0000 7f6bc21b2700 1 -- 172.21.15.146:0/2577058411 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bbc0b0ce0 con 0x7f6bbc15a940 2023-10-06T11:19:11.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.902+0000 7f6bc21b2700 1 -- 172.21.15.146:0/2577058411 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bbc0b14a0 con 0x7f6bbc15a940 2023-10-06T11:19:11.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.902+0000 7f6ba37fe700 1 -- 172.21.15.146:0/2577058411 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6bb0013680 con 0x7f6bbc15a940 2023-10-06T11:19:11.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.903+0000 7f6ba37fe700 1 --2- 172.21.15.146:0/2577058411 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6ba8066f30 0x7f6ba80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:11.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.903+0000 7f6bbb7fe700 1 --2- 172.21.15.146:0/2577058411 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6ba8066f30 0x7f6ba80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:11.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.903+0000 7f6ba37fe700 1 -- 172.21.15.146:0/2577058411 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6bb00848c0 con 0x7f6bbc15a940 2023-10-06T11:19:11.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.903+0000 7f6bbb7fe700 1 --2- 172.21.15.146:0/2577058411 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6ba8066f30 0x7f6ba80693e0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f6bac007240 tx=0x7f6bac001970 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:11.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:11.907+0000 7f6ba37fe700 1 -- 172.21.15.146:0/2577058411 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6bb00519d0 con 0x7f6bbc15a940 2023-10-06T11:19:12.134 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.132+0000 7f6bc21b2700 1 -- 172.21.15.146:0/2577058411 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6bbc04c380 con 0x7f6bbc15a940 2023-10-06T11:19:12.135 INFO:tasks.ceph.mon.a.smithi146.stderr:2023-10-06T11:19:12.133+0000 7f011baa1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T11:19:12.138 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.137+0000 7f6ba37fe700 1 -- 172.21.15.146:0/2577058411 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v145) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6bb0054ff0 con 0x7f6bbc15a940 2023-10-06T11:19:12.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.139+0000 7f6bc21b2700 1 -- 172.21.15.146:0/2577058411 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6ba8066f30 msgr2=0x7f6ba80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:12.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.139+0000 7f6bc21b2700 1 --2- 172.21.15.146:0/2577058411 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6ba8066f30 0x7f6ba80693e0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f6bac007240 tx=0x7f6bac001970 comp rx=0 tx=0).stop 2023-10-06T11:19:12.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.139+0000 7f6bc21b2700 1 -- 172.21.15.146:0/2577058411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6bbc15a940 msgr2=0x7f6bbc0c76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:12.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.139+0000 7f6bc21b2700 1 --2- 172.21.15.146:0/2577058411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6bbc15a940 0x7f6bbc0c76f0 secure :-1 s=READY pgs=2276 cs=0 l=1 rev1=1 crypto rx=0x7f6bb000ec80 tx=0x7f6bb00091a0 comp rx=0 tx=0).stop 2023-10-06T11:19:12.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.139+0000 7f6bc21b2700 1 -- 172.21.15.146:0/2577058411 shutdown_connections 2023-10-06T11:19:12.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.139+0000 7f6bc21b2700 1 --2- 172.21.15.146:0/2577058411 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6ba8066f30 0x7f6ba80693e0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:12.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.139+0000 7f6bc21b2700 1 --2- 172.21.15.146:0/2577058411 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6bbc15dcc0 0x7f6bbc0c8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:12.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.139+0000 7f6bc21b2700 1 --2- 172.21.15.146:0/2577058411 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6bbc1538c0 0x7f6bbc147800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:12.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.139+0000 7f6bc21b2700 1 --2- 172.21.15.146:0/2577058411 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6bbc15a940 0x7f6bbc0c76f0 unknown :-1 s=CLOSED pgs=2276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:12.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.139+0000 7f6bc21b2700 1 -- 172.21.15.146:0/2577058411 >> 172.21.15.146:0/2577058411 conn(0x7f6bbc06eb10 msgr2=0x7f6bbc0683e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:12.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.139+0000 7f6bc21b2700 1 -- 172.21.15.146:0/2577058411 shutdown_connections 2023-10-06T11:19:12.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.139+0000 7f6bc21b2700 1 -- 172.21.15.146:0/2577058411 wait complete. 2023-10-06T11:19:12.142 INFO:tasks.ceph.mds.d.smithi151.stderr: -4306> 2023-10-06T11:18:56.806+0000 7fce96bb0700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T11:19:12.142 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T11:19:12.153 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getomapval 10000000000.00000000 parentfile_head - 2023-10-06T11:19:12.166 INFO:tasks.ceph.mds.d.smithi151.stdout:starting mds.d at 2023-10-06T11:19:12.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.190+0000 7fc238a96000 1 Processor -- start 2023-10-06T11:19:12.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.190+0000 7fc238a96000 1 -- start start 2023-10-06T11:19:12.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.191+0000 7fc238a96000 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556fa86a9350 0x556fa877be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:12.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.191+0000 7fc238a96000 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556fa8760310 0x556fa86a7c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:12.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.191+0000 7fc238a96000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556fa87606e0 0x556fa86a8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:12.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.191+0000 7fc238a96000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fa85f1980 con 0x556fa87606e0 2023-10-06T11:19:12.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.191+0000 7fc238a96000 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fa85f1620 con 0x556fa86a9350 2023-10-06T11:19:12.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.191+0000 7fc238a96000 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x556fa85e8400 con 0x556fa8760310 2023-10-06T11:19:12.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.191+0000 7fc2324d2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556fa87606e0 0x556fa86a8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:12.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.191+0000 7fc2324d2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556fa87606e0 0x556fa86a8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43048/0 (socket says 172.21.15.146:43048) 2023-10-06T11:19:12.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.191+0000 7fc2324d2700 1 -- 172.21.15.146:0/272125343 learned_addr learned my addr 172.21.15.146:0/272125343 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:12.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.191+0000 7fc231cd1700 1 --2- 172.21.15.146:0/272125343 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556fa86a9350 0x556fa877be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:12.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.191+0000 7fc2314d0700 1 --2- 172.21.15.146:0/272125343 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556fa8760310 0x556fa86a7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:12.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.191+0000 7fc2324d2700 1 -- 172.21.15.146:0/272125343 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556fa8760310 msgr2=0x556fa86a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:12.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.191+0000 7fc2324d2700 1 --2- 172.21.15.146:0/272125343 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556fa8760310 0x556fa86a7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:12.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.191+0000 7fc2324d2700 1 -- 172.21.15.146:0/272125343 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556fa86a9350 msgr2=0x556fa877be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:12.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.191+0000 7fc2324d2700 1 --2- 172.21.15.146:0/272125343 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556fa86a9350 0x556fa877be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:12.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.191+0000 7fc2324d2700 1 -- 172.21.15.146:0/272125343 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc22c005db0 con 0x556fa87606e0 2023-10-06T11:19:12.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.191+0000 7fc2324d2700 1 --2- 172.21.15.146:0/272125343 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556fa87606e0 0x556fa86a8140 secure :-1 s=READY pgs=2278 cs=0 l=1 rev1=1 crypto rx=0x7fc22c00adf0 tx=0x7fc22c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dce26331323673df server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:12.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.191+0000 7fc223fff700 1 -- 172.21.15.146:0/272125343 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22c008760 con 0x556fa87606e0 2023-10-06T11:19:12.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.191+0000 7fc223fff700 1 -- 172.21.15.146:0/272125343 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc22c008c40 con 0x556fa87606e0 2023-10-06T11:19:12.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.191+0000 7fc223fff700 1 -- 172.21.15.146:0/272125343 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22c012660 con 0x556fa87606e0 2023-10-06T11:19:12.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.192+0000 7fc238a96000 1 -- 172.21.15.146:0/272125343 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556fa87606e0 msgr2=0x556fa86a8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:12.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.192+0000 7fc238a96000 1 --2- 172.21.15.146:0/272125343 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556fa87606e0 0x556fa86a8140 secure :-1 s=READY pgs=2278 cs=0 l=1 rev1=1 crypto rx=0x7fc22c00adf0 tx=0x7fc22c015000 comp rx=0 tx=0).stop 2023-10-06T11:19:12.200 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.192+0000 7fc238a96000 1 -- 172.21.15.146:0/272125343 shutdown_connections 2023-10-06T11:19:12.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.192+0000 7fc238a96000 1 --2- 172.21.15.146:0/272125343 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556fa87606e0 0x556fa86a8140 unknown :-1 s=CLOSED pgs=2278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:12.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.192+0000 7fc238a96000 1 --2- 172.21.15.146:0/272125343 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556fa86a9350 0x556fa877be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:12.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.192+0000 7fc238a96000 1 --2- 172.21.15.146:0/272125343 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556fa8760310 0x556fa86a7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:12.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.192+0000 7fc238a96000 1 -- 172.21.15.146:0/272125343 >> 172.21.15.146:0/272125343 conn(0x556fa86a7830 msgr2=0x556fa86a8980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:12.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.192+0000 7fc238a96000 1 -- 172.21.15.146:0/272125343 shutdown_connections 2023-10-06T11:19:12.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.192+0000 7fc238a96000 1 -- 172.21.15.146:0/272125343 wait complete. 2023-10-06T11:19:12.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.192+0000 7fc238a96000 1 Processor -- start 2023-10-06T11:19:12.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.192+0000 7fc238a96000 1 -- start start 2023-10-06T11:19:12.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.193+0000 7fc238a96000 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556fa86a9350 0x556fa86d6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:12.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.193+0000 7fc238a96000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556fa8760310 0x556fa877b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:12.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.193+0000 7fc238a96000 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556fa87606e0 0x556fa877bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:12.201 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.193+0000 7fc238a96000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fa8791150 con 0x556fa8760310 2023-10-06T11:19:12.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.193+0000 7fc238a96000 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x556fa8778b20 con 0x556fa87606e0 2023-10-06T11:19:12.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.193+0000 7fc238a96000 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x556fa8778dc0 con 0x556fa86a9350 2023-10-06T11:19:12.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.193+0000 7fc2314d0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556fa8760310 0x556fa877b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:12.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.193+0000 7fc2314d0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556fa8760310 0x556fa877b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43054/0 (socket says 172.21.15.146:43054) 2023-10-06T11:19:12.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.193+0000 7fc2314d0700 1 -- 172.21.15.146:0/3782164656 learned_addr learned my addr 172.21.15.146:0/3782164656 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:12.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.193+0000 7fc2324d2700 1 --2- 172.21.15.146:0/3782164656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556fa87606e0 0x556fa877bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:12.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.193+0000 7fc231cd1700 1 --2- 172.21.15.146:0/3782164656 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556fa86a9350 0x556fa86d6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:12.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.193+0000 7fc2314d0700 1 -- 172.21.15.146:0/3782164656 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556fa86a9350 msgr2=0x556fa86d6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:12.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.193+0000 7fc2314d0700 1 --2- 172.21.15.146:0/3782164656 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x556fa86a9350 0x556fa86d6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:12.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.193+0000 7fc2314d0700 1 -- 172.21.15.146:0/3782164656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556fa87606e0 msgr2=0x556fa877bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:12.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.193+0000 7fc2314d0700 1 --2- 172.21.15.146:0/3782164656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556fa87606e0 0x556fa877bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:12.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.193+0000 7fc2314d0700 1 -- 172.21.15.146:0/3782164656 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556fa861a1c0 con 0x556fa8760310 2023-10-06T11:19:12.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.194+0000 7fc2314d0700 1 --2- 172.21.15.146:0/3782164656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556fa8760310 0x556fa877b9f0 secure :-1 s=READY pgs=2279 cs=0 l=1 rev1=1 crypto rx=0x7fc228008920 tx=0x7fc228005b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:12.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.194+0000 7fc2227fc700 1 -- 172.21.15.146:0/3782164656 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22800f050 con 0x556fa8760310 2023-10-06T11:19:12.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.194+0000 7fc2227fc700 1 -- 172.21.15.146:0/3782164656 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc228010040 con 0x556fa8760310 2023-10-06T11:19:12.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.194+0000 7fc238a96000 1 -- 172.21.15.146:0/3782164656 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556fa86003d0 con 0x556fa8760310 2023-10-06T11:19:12.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.194+0000 7fc2227fc700 1 -- 172.21.15.146:0/3782164656 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2280069f0 con 0x556fa8760310 2023-10-06T11:19:12.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.194+0000 7fc238a96000 1 -- 172.21.15.146:0/3782164656 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556fa85f3ae0 con 0x556fa8760310 2023-10-06T11:19:12.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.195+0000 7fc2227fc700 1 -- 172.21.15.146:0/3782164656 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc22801f460 con 0x556fa8760310 2023-10-06T11:19:12.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.195+0000 7fc2227fc700 1 --2- 172.21.15.146:0/3782164656 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc214065890 0x7fc214067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:12.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.196+0000 7fc2227fc700 1 -- 172.21.15.146:0/3782164656 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fc2280839d0 con 0x556fa8760310 2023-10-06T11:19:12.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.196+0000 7fc231cd1700 1 --2- 172.21.15.146:0/3782164656 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc214065890 0x7fc214067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:12.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.196+0000 7fc238a96000 1 --2- 172.21.15.146:0/3782164656 >> [v2:172.21.15.146:6816/90680,v1:172.21.15.146:6817/90680] conn(0x556fa86d4b00 0x556fa86d4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:12.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.196+0000 7fc238a96000 1 -- 172.21.15.146:0/3782164656 --> [v2:172.21.15.146:6816/90680,v1:172.21.15.146:6817/90680] -- osd_op(unknown.0.0:1 27.10 27:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e178) v8 -- 0x556fa878dd60 con 0x556fa86d4b00 2023-10-06T11:19:12.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.196+0000 7fc2324d2700 1 --2- 172.21.15.146:0/3782164656 >> [v2:172.21.15.146:6816/90680,v1:172.21.15.146:6817/90680] conn(0x556fa86d4b00 0x556fa86d4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:12.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.196+0000 7fc231cd1700 1 --2- 172.21.15.146:0/3782164656 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc214065890 0x7fc214067d40 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fc2240028f0 tx=0x7fc224006ac0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:12.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.196+0000 7fc2324d2700 1 --2- 172.21.15.146:0/3782164656 >> [v2:172.21.15.146:6816/90680,v1:172.21.15.146:6817/90680] conn(0x556fa86d4b00 0x556fa86d4f00 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:12.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.198+0000 7fc2324d2700 1 -- 172.21.15.146:0/3782164656 <== osd.2 v2:172.21.15.146:6816/90680 1 ==== osd_op_reply(1 10000000000.00000000 [omap-get-vals-by-keys out=515b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+515 (crc 0 0 0) 0x7fc22c022020 con 0x556fa86d4b00 2023-10-06T11:19:12.206 INFO:teuthology.orchestra.run.smithi146.stderr:Writing to - 2023-10-06T11:19:12.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.198+0000 7fc238a96000 1 -- 172.21.15.146:0/3782164656 >> [v2:172.21.15.146:6816/90680,v1:172.21.15.146:6817/90680] conn(0x556fa86d4b00 msgr2=0x556fa86d4f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:12.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.198+0000 7fc238a96000 1 --2- 172.21.15.146:0/3782164656 >> [v2:172.21.15.146:6816/90680,v1:172.21.15.146:6817/90680] conn(0x556fa86d4b00 0x556fa86d4f00 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:12.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.198+0000 7fc238a96000 1 -- 172.21.15.146:0/3782164656 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc214065890 msgr2=0x7fc214067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:12.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.198+0000 7fc238a96000 1 --2- 172.21.15.146:0/3782164656 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc214065890 0x7fc214067d40 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fc2240028f0 tx=0x7fc224006ac0 comp rx=0 tx=0).stop 2023-10-06T11:19:12.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.198+0000 7fc238a96000 1 -- 172.21.15.146:0/3782164656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556fa8760310 msgr2=0x556fa877b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:12.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.198+0000 7fc238a96000 1 --2- 172.21.15.146:0/3782164656 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x556fa8760310 0x556fa877b9f0 secure :-1 s=READY pgs=2279 cs=0 l=1 rev1=1 crypto rx=0x7fc228008920 tx=0x7fc228005b40 comp rx=0 tx=0).stop 2023-10-06T11:19:12.206 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.198+0000 7fc2324d2700 1 -- 172.21.15.146:0/3782164656 reap_dead start 2023-10-06T11:19:12.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.199+0000 7fc238a96000 1 -- 172.21.15.146:0/3782164656 shutdown_connections 2023-10-06T11:19:12.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.199+0000 7fc238a96000 1 -- 172.21.15.146:0/3782164656 >> 172.21.15.146:0/3782164656 conn(0x556fa86a7830 msgr2=0x556fa86d2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:12.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.199+0000 7fc238a96000 1 -- 172.21.15.146:0/3782164656 shutdown_connections 2023-10-06T11:19:12.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.199+0000 7fc238a96000 1 -- 172.21.15.146:0/3782164656 wait complete. 2023-10-06T11:19:12.207 INFO:teuthology.orchestra.run.smithi146.stdout:i���(�e˕�,����@@`��������(�e˕�,(�eY��*(8`(�e˕�,8`(�e˕�,��������(�eY��*0������������ 2023-10-06T11:19:12.207 DEBUG:teuthology.orchestra.run.smithi146:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 10000000000.00000000 shadow_head 2023-10-06T11:19:12.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.282+0000 7f14530d6000 1 Processor -- start 2023-10-06T11:19:12.284 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.282+0000 7f14530d6000 1 -- start start 2023-10-06T11:19:12.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.283+0000 7f14530d6000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56421b3b8540 0x56421b488880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:12.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.283+0000 7f14530d6000 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56421b3ffe70 0x56421b3b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:12.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.283+0000 7f14530d6000 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56421b48b0d0 0x56421b3b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:12.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.283+0000 7f14530d6000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x56421b301980 con 0x56421b3b8540 2023-10-06T11:19:12.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.283+0000 7f14530d6000 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56421b301620 con 0x56421b3ffe70 2023-10-06T11:19:12.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.283+0000 7f14530d6000 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x56421b2f8400 con 0x56421b48b0d0 2023-10-06T11:19:12.289 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.283+0000 7f144c311700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56421b3b8540 0x56421b488880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:12.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.283+0000 7f144c311700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56421b3b8540 0x56421b488880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43068/0 (socket says 172.21.15.146:43068) 2023-10-06T11:19:12.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.283+0000 7f144c311700 1 -- 172.21.15.146:0/1033565026 learned_addr learned my addr 172.21.15.146:0/1033565026 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:12.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.283+0000 7f144cb12700 1 --2- 172.21.15.146:0/1033565026 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56421b48b0d0 0x56421b3b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:12.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.283+0000 7f1443b10700 1 --2- 172.21.15.146:0/1033565026 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56421b3ffe70 0x56421b3b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:12.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.284+0000 7f144c311700 1 -- 172.21.15.146:0/1033565026 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56421b48b0d0 msgr2=0x56421b3b4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:12.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.284+0000 7f144c311700 1 --2- 172.21.15.146:0/1033565026 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56421b48b0d0 0x56421b3b4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:12.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.284+0000 7f144c311700 1 -- 172.21.15.146:0/1033565026 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56421b3ffe70 msgr2=0x56421b3b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:12.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.284+0000 7f144c311700 1 --2- 172.21.15.146:0/1033565026 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56421b3ffe70 0x56421b3b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:12.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.284+0000 7f144c311700 1 -- 172.21.15.146:0/1033565026 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1434005cf0 con 0x56421b3b8540 2023-10-06T11:19:12.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.284+0000 7f144cb12700 1 --2- 172.21.15.146:0/1033565026 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56421b48b0d0 0x56421b3b4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:19:12.290 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.284+0000 7f144c311700 1 --2- 172.21.15.146:0/1033565026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56421b3b8540 0x56421b488880 secure :-1 s=READY pgs=2280 cs=0 l=1 rev1=1 crypto rx=0x7f143c00ac40 tx=0x7f143c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8a23053dda0c574 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:12.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.284+0000 7f144b30f700 1 -- 172.21.15.146:0/1033565026 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143c007610 con 0x56421b3b8540 2023-10-06T11:19:12.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.284+0000 7f144b30f700 1 -- 172.21.15.146:0/1033565026 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f143c000bc0 con 0x56421b3b8540 2023-10-06T11:19:12.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.284+0000 7f144b30f700 1 -- 172.21.15.146:0/1033565026 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143c007b30 con 0x56421b3b8540 2023-10-06T11:19:12.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.284+0000 7f14530d6000 1 -- 172.21.15.146:0/1033565026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56421b3b8540 msgr2=0x56421b488880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:12.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.284+0000 7f14530d6000 1 --2- 172.21.15.146:0/1033565026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56421b3b8540 0x56421b488880 secure :-1 s=READY pgs=2280 cs=0 l=1 rev1=1 crypto rx=0x7f143c00ac40 tx=0x7f143c015000 comp rx=0 tx=0).stop 2023-10-06T11:19:12.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.284+0000 7f14530d6000 1 -- 172.21.15.146:0/1033565026 shutdown_connections 2023-10-06T11:19:12.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.284+0000 7f14530d6000 1 --2- 172.21.15.146:0/1033565026 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56421b48b0d0 0x56421b3b4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:12.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.284+0000 7f14530d6000 1 --2- 172.21.15.146:0/1033565026 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56421b3b8540 0x56421b488880 unknown :-1 s=CLOSED pgs=2280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:12.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.284+0000 7f14530d6000 1 --2- 172.21.15.146:0/1033565026 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56421b3ffe70 0x56421b3b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:12.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.284+0000 7f14530d6000 1 -- 172.21.15.146:0/1033565026 >> 172.21.15.146:0/1033565026 conn(0x56421b3e3240 msgr2=0x56421b3b5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:12.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.284+0000 7f14530d6000 1 -- 172.21.15.146:0/1033565026 shutdown_connections 2023-10-06T11:19:12.291 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.284+0000 7f14530d6000 1 -- 172.21.15.146:0/1033565026 wait complete. 2023-10-06T11:19:12.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.285+0000 7f14530d6000 1 Processor -- start 2023-10-06T11:19:12.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.285+0000 7f14530d6000 1 -- start start 2023-10-06T11:19:12.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.286+0000 7f14530d6000 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56421b3b8540 0x56421b45bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:12.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.286+0000 7f14530d6000 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56421b3ffe70 0x56421b4873d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:12.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.286+0000 7f14530d6000 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56421b48b0d0 0x56421b48b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:12.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.286+0000 7f14530d6000 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x56421b46d790 con 0x56421b48b0d0 2023-10-06T11:19:12.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.286+0000 7f14530d6000 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56421b45c1a0 con 0x56421b3b8540 2023-10-06T11:19:12.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.286+0000 7f14530d6000 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x56421b45ad40 con 0x56421b3ffe70 2023-10-06T11:19:12.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.286+0000 7f144cb12700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56421b48b0d0 0x56421b48b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:12.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.286+0000 7f144cb12700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56421b48b0d0 0x56421b48b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43070/0 (socket says 172.21.15.146:43070) 2023-10-06T11:19:12.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.286+0000 7f144cb12700 1 -- 172.21.15.146:0/4131802933 learned_addr learned my addr 172.21.15.146:0/4131802933 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:12.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.286+0000 7f144c311700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56421b3b8540 0x56421b45bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:12.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.286+0000 7f1443b10700 1 --2- 172.21.15.146:0/4131802933 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56421b3ffe70 0x56421b4873d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:12.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.286+0000 7f144cb12700 1 -- 172.21.15.146:0/4131802933 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56421b3ffe70 msgr2=0x56421b4873d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:12.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.286+0000 7f144cb12700 1 --2- 172.21.15.146:0/4131802933 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56421b3ffe70 0x56421b4873d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:12.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.286+0000 7f144cb12700 1 -- 172.21.15.146:0/4131802933 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56421b3b8540 msgr2=0x56421b45bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:12.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.286+0000 7f144cb12700 1 --2- 172.21.15.146:0/4131802933 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56421b3b8540 0x56421b45bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:12.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.286+0000 7f144cb12700 1 -- 172.21.15.146:0/4131802933 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1438001e10 con 0x56421b48b0d0 2023-10-06T11:19:12.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.286+0000 7f144cb12700 1 --2- 172.21.15.146:0/4131802933 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56421b48b0d0 0x56421b48b4a0 secure :-1 s=READY pgs=2281 cs=0 l=1 rev1=1 crypto rx=0x7f144400e500 tx=0x7f1444008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:12.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.286+0000 7f1449b0c700 1 -- 172.21.15.146:0/4131802933 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14440060d0 con 0x56421b48b0d0 2023-10-06T11:19:12.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.286+0000 7f1449b0c700 1 -- 172.21.15.146:0/4131802933 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1444006230 con 0x56421b48b0d0 2023-10-06T11:19:12.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.286+0000 7f14530d6000 1 -- 172.21.15.146:0/4131802933 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56421b32a1c0 con 0x56421b48b0d0 2023-10-06T11:19:12.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.286+0000 7f1449b0c700 1 -- 172.21.15.146:0/4131802933 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1444004770 con 0x56421b48b0d0 2023-10-06T11:19:12.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.286+0000 7f14530d6000 1 -- 172.21.15.146:0/4131802933 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f143c005cf0 con 0x56421b48b0d0 2023-10-06T11:19:12.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.288+0000 7f1449b0c700 1 -- 172.21.15.146:0/4131802933 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1444004ba0 con 0x56421b48b0d0 2023-10-06T11:19:12.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.288+0000 7f1449b0c700 1 --2- 172.21.15.146:0/4131802933 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f142c065890 0x7f142c067d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:12.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.288+0000 7f1449b0c700 1 -- 172.21.15.146:0/4131802933 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f1444083130 con 0x56421b48b0d0 2023-10-06T11:19:12.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.288+0000 7f144c311700 1 --2- 172.21.15.146:0/4131802933 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f142c065890 0x7f142c067d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:12.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.288+0000 7f14530d6000 1 --2- 172.21.15.146:0/4131802933 >> [v2:172.21.15.146:6816/90680,v1:172.21.15.146:6817/90680] conn(0x56421b46da20 0x56421b459320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:12.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.288+0000 7f14530d6000 1 -- 172.21.15.146:0/4131802933 --> [v2:172.21.15.146:6816/90680,v1:172.21.15.146:6817/90680] -- osd_op(unknown.0.0:1 27.10 27:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=511b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e178) v8 -- 0x56421b459860 con 0x56421b46da20 2023-10-06T11:19:12.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.288+0000 7f1443b10700 1 --2- 172.21.15.146:0/4131802933 >> [v2:172.21.15.146:6816/90680,v1:172.21.15.146:6817/90680] conn(0x56421b46da20 0x56421b459320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:12.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.289+0000 7f144c311700 1 --2- 172.21.15.146:0/4131802933 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f142c065890 0x7f142c067d40 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f143c00c010 tx=0x7f143c01c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:12.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.289+0000 7f1443b10700 1 --2- 172.21.15.146:0/4131802933 >> [v2:172.21.15.146:6816/90680,v1:172.21.15.146:6817/90680] conn(0x56421b46da20 0x56421b459320 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:12.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.290+0000 7f1443b10700 1 -- 172.21.15.146:0/4131802933 <== osd.2 v2:172.21.15.146:6816/90680 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-vals] v178'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f1434012040 con 0x56421b46da20 2023-10-06T11:19:12.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.290+0000 7f14530d6000 1 -- 172.21.15.146:0/4131802933 >> [v2:172.21.15.146:6816/90680,v1:172.21.15.146:6817/90680] conn(0x56421b46da20 msgr2=0x56421b459320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:12.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.290+0000 7f14530d6000 1 --2- 172.21.15.146:0/4131802933 >> [v2:172.21.15.146:6816/90680,v1:172.21.15.146:6817/90680] conn(0x56421b46da20 0x56421b459320 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:12.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.290+0000 7f14530d6000 1 -- 172.21.15.146:0/4131802933 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f142c065890 msgr2=0x7f142c067d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:12.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.290+0000 7f14530d6000 1 --2- 172.21.15.146:0/4131802933 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f142c065890 0x7f142c067d40 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f143c00c010 tx=0x7f143c01c000 comp rx=0 tx=0).stop 2023-10-06T11:19:12.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.290+0000 7f14530d6000 1 -- 172.21.15.146:0/4131802933 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56421b48b0d0 msgr2=0x56421b48b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:12.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.290+0000 7f14530d6000 1 --2- 172.21.15.146:0/4131802933 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56421b48b0d0 0x56421b48b4a0 secure :-1 s=READY pgs=2281 cs=0 l=1 rev1=1 crypto rx=0x7f144400e500 tx=0x7f1444008040 comp rx=0 tx=0).stop 2023-10-06T11:19:12.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.290+0000 7f144cb12700 1 -- 172.21.15.146:0/4131802933 reap_dead start 2023-10-06T11:19:12.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.290+0000 7f14530d6000 1 -- 172.21.15.146:0/4131802933 shutdown_connections 2023-10-06T11:19:12.297 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.290+0000 7f14530d6000 1 -- 172.21.15.146:0/4131802933 >> 172.21.15.146:0/4131802933 conn(0x56421b3e3240 msgr2=0x56421b3b5970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:12.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.290+0000 7f14530d6000 1 -- 172.21.15.146:0/4131802933 shutdown_connections 2023-10-06T11:19:12.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.290+0000 7f14530d6000 1 -- 172.21.15.146:0/4131802933 wait complete. 2023-10-06T11:19:12.298 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mds mds_hack_allow_loading_invalid_metadata True 2023-10-06T11:19:12.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.453+0000 7ff28dff4700 1 Processor -- start 2023-10-06T11:19:12.455 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.453+0000 7ff28dff4700 1 -- start start 2023-10-06T11:19:12.457 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.454+0000 7ff28dff4700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff288159450 0x7ff288159820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:12.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.454+0000 7ff28dff4700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff28815dd70 0x7ff2880b0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:12.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.454+0000 7ff28dff4700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2880b0bc0 con 0x7ff2880b0760 2023-10-06T11:19:12.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.454+0000 7ff28dff4700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2880b2f20 con 0x7ff288159450 2023-10-06T11:19:12.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.454+0000 7ff28dff4700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2880cb8a0 con 0x7ff28815dd70 2023-10-06T11:19:12.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.454+0000 7ff2877fe700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff288159450 0x7ff288159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:12.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.454+0000 7ff286ffd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff28815dd70 0x7ff2880b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:12.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.454+0000 7ff2877fe700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff288159450 0x7ff288159820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:44926/0 (socket says 172.21.15.146:44926) 2023-10-06T11:19:12.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.455+0000 7ff2877fe700 1 -- 172.21.15.146:0/4260173691 learned_addr learned my addr 172.21.15.146:0/4260173691 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:12.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.454+0000 7ff287fff700 1 --1- 172.21.15.146:0/4260173691 >> v1:172.21.15.151:6789/0 conn(0x7ff2880b0760 0x7ff2880aef90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:35274/0 (socket says 172.21.15.146:35274) 2023-10-06T11:19:12.458 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.455+0000 7ff2877fe700 1 -- 172.21.15.146:0/4260173691 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff28815dd70 msgr2=0x7ff2880b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:12.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.455+0000 7ff2877fe700 1 --2- 172.21.15.146:0/4260173691 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff28815dd70 0x7ff2880b0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:12.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.455+0000 7ff2877fe700 1 -- 172.21.15.146:0/4260173691 >> v1:172.21.15.151:6789/0 conn(0x7ff2880b0760 legacy=0x7ff2880aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:12.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.455+0000 7ff2867fc700 1 -- 172.21.15.146:0/4260173691 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3026016379 0 0) 0x7ff280001110 con 0x7ff2880b0760 2023-10-06T11:19:12.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.455+0000 7ff2877fe700 1 -- 172.21.15.146:0/4260173691 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2880b2960 con 0x7ff288159450 2023-10-06T11:19:12.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.455+0000 7ff2877fe700 1 --2- 172.21.15.146:0/4260173691 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff288159450 0x7ff288159820 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7ff278009f20 tx=0x7ff278009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67962293c5192ba2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:12.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.455+0000 7ff2867fc700 1 -- 172.21.15.146:0/4260173691 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27800e070 con 0x7ff288159450 2023-10-06T11:19:12.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.455+0000 7ff2867fc700 1 -- 172.21.15.146:0/4260173691 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27800b9d0 con 0x7ff288159450 2023-10-06T11:19:12.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.455+0000 7ff2867fc700 1 -- 172.21.15.146:0/4260173691 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2780092e0 con 0x7ff288159450 2023-10-06T11:19:12.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.456+0000 7ff28dff4700 1 -- 172.21.15.146:0/4260173691 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff288159450 msgr2=0x7ff288159820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:12.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.456+0000 7ff28dff4700 1 --2- 172.21.15.146:0/4260173691 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff288159450 0x7ff288159820 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7ff278009f20 tx=0x7ff278009840 comp rx=0 tx=0).stop 2023-10-06T11:19:12.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.456+0000 7ff28dff4700 1 -- 172.21.15.146:0/4260173691 shutdown_connections 2023-10-06T11:19:12.459 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.456+0000 7ff28dff4700 1 --2- 172.21.15.146:0/4260173691 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff288159450 0x7ff288159820 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:12.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.456+0000 7ff28dff4700 1 --2- 172.21.15.146:0/4260173691 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff28815dd70 0x7ff2880b0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:12.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.456+0000 7ff28dff4700 1 -- 172.21.15.146:0/4260173691 >> 172.21.15.146:0/4260173691 conn(0x7ff28806eb10 msgr2=0x7ff28806ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:12.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.456+0000 7ff28dff4700 1 -- 172.21.15.146:0/4260173691 shutdown_connections 2023-10-06T11:19:12.460 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.456+0000 7ff28dff4700 1 -- 172.21.15.146:0/4260173691 wait complete. 2023-10-06T11:19:12.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.457+0000 7ff28dff4700 1 Processor -- start 2023-10-06T11:19:12.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.457+0000 7ff28dff4700 1 -- start start 2023-10-06T11:19:12.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.458+0000 7ff28dff4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2880b0760 0x7ff28815a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:12.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.458+0000 7ff28dff4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff288159450 0x7ff288157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:12.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.458+0000 7ff28dff4700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff28815dd70 0x7ff2880cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:12.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.458+0000 7ff28dff4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2880c85d0 con 0x7ff288159450 2023-10-06T11:19:12.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.458+0000 7ff28dff4700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2880c79c0 con 0x7ff2880b0760 2023-10-06T11:19:12.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.458+0000 7ff28dff4700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2880c7ca0 con 0x7ff28815dd70 2023-10-06T11:19:12.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.458+0000 7ff286ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff288159450 0x7ff288157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:12.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.458+0000 7ff287fff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff28815dd70 0x7ff2880cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:12.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.458+0000 7ff2877fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2880b0760 0x7ff28815a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:12.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.458+0000 7ff286ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff288159450 0x7ff288157ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43084/0 (socket says 172.21.15.146:43084) 2023-10-06T11:19:12.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.458+0000 7ff286ffd700 1 -- 172.21.15.146:0/2374304462 learned_addr learned my addr 172.21.15.146:0/2374304462 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:12.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.458+0000 7ff2877fe700 1 -- 172.21.15.146:0/2374304462 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff28815dd70 msgr2=0x7ff2880cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:12.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.458+0000 7ff2877fe700 1 --2- 172.21.15.146:0/2374304462 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff28815dd70 0x7ff2880cc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:12.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.458+0000 7ff2877fe700 1 -- 172.21.15.146:0/2374304462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff288159450 msgr2=0x7ff288157ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:12.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.458+0000 7ff2877fe700 1 --2- 172.21.15.146:0/2374304462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff288159450 0x7ff288157ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:12.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.458+0000 7ff2877fe700 1 -- 172.21.15.146:0/2374304462 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff278009ae0 con 0x7ff2880b0760 2023-10-06T11:19:12.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.458+0000 7ff2877fe700 1 --2- 172.21.15.146:0/2374304462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2880b0760 0x7ff28815a7b0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7ff278015000 tx=0x7ff278018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:12.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.458+0000 7ff26f7fe700 1 -- 172.21.15.146:0/2374304462 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff278008870 con 0x7ff2880b0760 2023-10-06T11:19:12.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.459+0000 7ff26f7fe700 1 -- 172.21.15.146:0/2374304462 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2780089d0 con 0x7ff2880b0760 2023-10-06T11:19:12.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.459+0000 7ff28dff4700 1 -- 172.21.15.146:0/2374304462 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2880c7f80 con 0x7ff2880b0760 2023-10-06T11:19:12.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.459+0000 7ff26f7fe700 1 -- 172.21.15.146:0/2374304462 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff278008d90 con 0x7ff2880b0760 2023-10-06T11:19:12.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.459+0000 7ff28dff4700 1 -- 172.21.15.146:0/2374304462 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff288158430 con 0x7ff2880b0760 2023-10-06T11:19:12.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.460+0000 7ff28dff4700 1 -- 172.21.15.146:0/2374304462 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff28804c380 con 0x7ff2880b0760 2023-10-06T11:19:12.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.460+0000 7ff26f7fe700 1 -- 172.21.15.146:0/2374304462 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff278003040 con 0x7ff2880b0760 2023-10-06T11:19:12.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.460+0000 7ff26f7fe700 1 --2- 172.21.15.146:0/2374304462 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff274066f30 0x7ff2740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:12.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.460+0000 7ff26f7fe700 1 -- 172.21.15.146:0/2374304462 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6144+0+0 (secure 0 0 0) 0x7ff278086320 con 0x7ff2880b0760 2023-10-06T11:19:12.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.460+0000 7ff286ffd700 1 --2- 172.21.15.146:0/2374304462 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff274066f30 0x7ff2740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:12.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.461+0000 7ff286ffd700 1 --2- 172.21.15.146:0/2374304462 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff274066f30 0x7ff2740693e0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7ff2880c3ac0 tx=0x7ff27c0091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:12.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.465+0000 7ff26f7fe700 1 -- 172.21.15.146:0/2374304462 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff278053490 con 0x7ff2880b0760 2023-10-06T11:19:12.651 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.649+0000 7ff28dff4700 1 -- 172.21.15.146:0/2374304462 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command([{prefix=config set, name=mds_hack_allow_loading_invalid_metadata}] v 0) v1 -- 0x7ff2880b2c40 con 0x7ff2880b0760 2023-10-06T11:19:12.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.654+0000 7ff26f7fe700 1 -- 172.21.15.146:0/2374304462 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_hack_allow_loading_invalid_metadata}]=0 v33)=0 v33) v1 ==== 140+0+0 (secure 0 0 0) 0x7ff278056ab0 con 0x7ff2880b0760 2023-10-06T11:19:12.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.656+0000 7ff28dff4700 1 -- 172.21.15.146:0/2374304462 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff274066f30 msgr2=0x7ff2740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:12.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.656+0000 7ff28dff4700 1 --2- 172.21.15.146:0/2374304462 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff274066f30 0x7ff2740693e0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7ff2880c3ac0 tx=0x7ff27c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:19:12.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.656+0000 7ff28dff4700 1 -- 172.21.15.146:0/2374304462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2880b0760 msgr2=0x7ff28815a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:12.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.656+0000 7ff28dff4700 1 --2- 172.21.15.146:0/2374304462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2880b0760 0x7ff28815a7b0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7ff278015000 tx=0x7ff278018000 comp rx=0 tx=0).stop 2023-10-06T11:19:12.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.656+0000 7ff28dff4700 1 -- 172.21.15.146:0/2374304462 shutdown_connections 2023-10-06T11:19:12.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.656+0000 7ff28dff4700 1 --2- 172.21.15.146:0/2374304462 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff274066f30 0x7ff2740693e0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:12.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.656+0000 7ff28dff4700 1 --2- 172.21.15.146:0/2374304462 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff28815dd70 0x7ff2880cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:12.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.656+0000 7ff28dff4700 1 --2- 172.21.15.146:0/2374304462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2880b0760 0x7ff28815a7b0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:12.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.656+0000 7ff28dff4700 1 --2- 172.21.15.146:0/2374304462 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff288159450 0x7ff288157ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:12.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.656+0000 7ff28dff4700 1 -- 172.21.15.146:0/2374304462 >> 172.21.15.146:0/2374304462 conn(0x7ff28806eb10 msgr2=0x7ff2880af2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:12.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.656+0000 7ff28dff4700 1 -- 172.21.15.146:0/2374304462 shutdown_connections 2023-10-06T11:19:12.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.656+0000 7ff28dff4700 1 -- 172.21.15.146:0/2374304462 wait complete. 2023-10-06T11:19:12.670 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-10-06T11:19:12.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.787+0000 7f21d29d5700 1 Processor -- start 2023-10-06T11:19:12.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.787+0000 7f21d29d5700 1 -- start start 2023-10-06T11:19:12.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.788+0000 7f21d29d5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f21cc06b690 0x7f21cc06baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:12.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.788+0000 7f21d29d5700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21cc06c030 con 0x7f21cc1594c0 2023-10-06T11:19:12.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.788+0000 7f21d29d5700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21cc15d410 con 0x7f21cc069e30 2023-10-06T11:19:12.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.788+0000 7f21d29d5700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21cc0690d0 con 0x7f21cc06b690 2023-10-06T11:19:12.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.788+0000 7f21d0f72700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f21cc06b690 0x7f21cc06baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:12.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.788+0000 7f21cbfff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f21cc1594c0 0x7f21cc0689c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39288/0 (socket says 172.21.15.146:39288) 2023-10-06T11:19:12.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.788+0000 7f21cbfff700 1 -- 172.21.15.146:0/939243020 learned_addr learned my addr 172.21.15.146:0/939243020 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:19:12.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.789+0000 7f21d0f72700 1 -- 172.21.15.146:0/939243020 >> v1:172.21.15.151:6789/0 conn(0x7f21cc069e30 legacy=0x7f21cc159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:12.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.789+0000 7f21d0f72700 1 -- 172.21.15.146:0/939243020 >> v1:172.21.15.146:6789/0 conn(0x7f21cc1594c0 legacy=0x7f21cc0689c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:12.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.789+0000 7f21caffd700 1 -- 172.21.15.146:0/939243020 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2406030466 0 0) 0x7f21bc001110 con 0x7f21cc1594c0 2023-10-06T11:19:12.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.789+0000 7f21d0f72700 1 -- 172.21.15.146:0/939243020 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21cc15a310 con 0x7f21cc06b690 2023-10-06T11:19:12.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.789+0000 7f21d0f72700 1 --2- 172.21.15.146:0/939243020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21cc06b690 0x7f21cc06baf0 secure :-1 s=READY pgs=2283 cs=0 l=1 rev1=1 crypto rx=0x7f21c4009e60 tx=0x7f21c4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2196eca170b76f4a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:12.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.789+0000 7f21caffd700 1 -- 172.21.15.146:0/939243020 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c400e070 con 0x7f21cc06b690 2023-10-06T11:19:12.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.789+0000 7f21caffd700 1 -- 172.21.15.146:0/939243020 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c400bbf0 con 0x7f21cc06b690 2023-10-06T11:19:12.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.789+0000 7f21caffd700 1 -- 172.21.15.146:0/939243020 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c4012430 con 0x7f21cc06b690 2023-10-06T11:19:12.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.789+0000 7f21d29d5700 1 -- 172.21.15.146:0/939243020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21cc06b690 msgr2=0x7f21cc06baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:12.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.789+0000 7f21d29d5700 1 --2- 172.21.15.146:0/939243020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21cc06b690 0x7f21cc06baf0 secure :-1 s=READY pgs=2283 cs=0 l=1 rev1=1 crypto rx=0x7f21c4009e60 tx=0x7f21c4009780 comp rx=0 tx=0).stop 2023-10-06T11:19:12.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.790+0000 7f21d29d5700 1 -- 172.21.15.146:0/939243020 shutdown_connections 2023-10-06T11:19:12.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.790+0000 7f21d29d5700 1 --2- 172.21.15.146:0/939243020 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21cc06b690 0x7f21cc06baf0 unknown :-1 s=CLOSED pgs=2283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:12.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.790+0000 7f21d29d5700 1 -- 172.21.15.146:0/939243020 >> 172.21.15.146:0/939243020 conn(0x7f21cc067ea0 msgr2=0x7f21cc0ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:12.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.790+0000 7f21d29d5700 1 -- 172.21.15.146:0/939243020 shutdown_connections 2023-10-06T11:19:12.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.790+0000 7f21d29d5700 1 -- 172.21.15.146:0/939243020 wait complete. 2023-10-06T11:19:12.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.791+0000 7f21d29d5700 1 Processor -- start 2023-10-06T11:19:12.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.791+0000 7f21d29d5700 1 -- start start 2023-10-06T11:19:12.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.792+0000 7f21d29d5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21cc069e30 0x7f21cc14fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:12.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.792+0000 7f21d29d5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f21cc06b690 0x7f21cc0b2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:12.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.792+0000 7f21d29d5700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21cc1594c0 0x7f21cc0b3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:12.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.792+0000 7f21d29d5700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21cc150180 con 0x7f21cc069e30 2023-10-06T11:19:12.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.792+0000 7f21d29d5700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21cc0c6200 con 0x7f21cc06b690 2023-10-06T11:19:12.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.792+0000 7f21d29d5700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21cc0c55f0 con 0x7f21cc1594c0 2023-10-06T11:19:12.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.792+0000 7f21cbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21cc069e30 0x7f21cc14fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:12.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.792+0000 7f21cbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21cc069e30 0x7f21cc14fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43096/0 (socket says 172.21.15.146:43096) 2023-10-06T11:19:12.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.792+0000 7f21cbfff700 1 -- 172.21.15.146:0/360909393 learned_addr learned my addr 172.21.15.146:0/360909393 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:12.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.792+0000 7f21cb7fe700 1 --2- 172.21.15.146:0/360909393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f21cc06b690 0x7f21cc0b2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:12.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.792+0000 7f21d0f72700 1 --2- 172.21.15.146:0/360909393 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21cc1594c0 0x7f21cc0b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:12.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.792+0000 7f21cbfff700 1 -- 172.21.15.146:0/360909393 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21cc1594c0 msgr2=0x7f21cc0b3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:12.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.792+0000 7f21cbfff700 1 --2- 172.21.15.146:0/360909393 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21cc1594c0 0x7f21cc0b3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:12.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.792+0000 7f21cbfff700 1 -- 172.21.15.146:0/360909393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f21cc06b690 msgr2=0x7f21cc0b2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:12.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.792+0000 7f21cbfff700 1 --2- 172.21.15.146:0/360909393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f21cc06b690 0x7f21cc0b2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:12.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.792+0000 7f21cbfff700 1 -- 172.21.15.146:0/360909393 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c4009a20 con 0x7f21cc069e30 2023-10-06T11:19:12.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.792+0000 7f21cb7fe700 1 --2- 172.21.15.146:0/360909393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f21cc06b690 0x7f21cc0b2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:19:12.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.792+0000 7f21cbfff700 1 --2- 172.21.15.146:0/360909393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21cc069e30 0x7f21cc14fc40 secure :-1 s=READY pgs=2284 cs=0 l=1 rev1=1 crypto rx=0x7f21bc00c810 tx=0x7f21bc007c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:12.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.792+0000 7f21b3fff700 1 -- 172.21.15.146:0/360909393 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc005b30 con 0x7f21cc069e30 2023-10-06T11:19:12.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.792+0000 7f21b3fff700 1 -- 172.21.15.146:0/360909393 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21bc005c90 con 0x7f21cc069e30 2023-10-06T11:19:12.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.792+0000 7f21d29d5700 1 -- 172.21.15.146:0/360909393 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21cc0c58d0 con 0x7f21cc069e30 2023-10-06T11:19:12.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.792+0000 7f21b3fff700 1 -- 172.21.15.146:0/360909393 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc007300 con 0x7f21cc069e30 2023-10-06T11:19:12.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.792+0000 7f21d29d5700 1 -- 172.21.15.146:0/360909393 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21cc0c5e90 con 0x7f21cc069e30 2023-10-06T11:19:12.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.793+0000 7f21d29d5700 1 -- 172.21.15.146:0/360909393 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21cc04c380 con 0x7f21cc069e30 2023-10-06T11:19:12.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.793+0000 7f21b3fff700 1 -- 172.21.15.146:0/360909393 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f21bc0076b0 con 0x7f21cc069e30 2023-10-06T11:19:12.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.794+0000 7f21b3fff700 1 --2- 172.21.15.146:0/360909393 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f21b8066f30 0x7f21b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:12.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.794+0000 7f21b3fff700 1 -- 172.21.15.146:0/360909393 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f21bc0840d0 con 0x7f21cc069e30 2023-10-06T11:19:12.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.794+0000 7f21cb7fe700 1 --2- 172.21.15.146:0/360909393 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f21b8066f30 0x7f21b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:12.801 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.794+0000 7f21cb7fe700 1 --2- 172.21.15.146:0/360909393 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f21b8066f30 0x7f21b80693e0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f21c0006fd0 tx=0x7f21c0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:12.802 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:12.798+0000 7f21b3fff700 1 -- 172.21.15.146:0/360909393 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21bc054c20 con 0x7f21cc069e30 2023-10-06T11:19:13.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.026+0000 7f21d29d5700 1 -- 172.21.15.146:0/360909393 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f21cc0cef40 con 0x7f21cc069e30 2023-10-06T11:19:13.139 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.137+0000 7f21b3fff700 1 -- 172.21.15.146:0/360909393 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v146) v1 ==== 162+0+0 (secure 0 0 0) 0x7f21bc0547b0 con 0x7f21cc069e30 2023-10-06T11:19:13.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.140+0000 7f21d29d5700 1 -- 172.21.15.146:0/360909393 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f21b8066f30 msgr2=0x7f21b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:13.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.140+0000 7f21d29d5700 1 --2- 172.21.15.146:0/360909393 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f21b8066f30 0x7f21b80693e0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f21c0006fd0 tx=0x7f21c0008040 comp rx=0 tx=0).stop 2023-10-06T11:19:13.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.140+0000 7f21d29d5700 1 -- 172.21.15.146:0/360909393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21cc069e30 msgr2=0x7f21cc14fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:13.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.140+0000 7f21d29d5700 1 --2- 172.21.15.146:0/360909393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21cc069e30 0x7f21cc14fc40 secure :-1 s=READY pgs=2284 cs=0 l=1 rev1=1 crypto rx=0x7f21bc00c810 tx=0x7f21bc007c50 comp rx=0 tx=0).stop 2023-10-06T11:19:13.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.140+0000 7f21d29d5700 1 -- 172.21.15.146:0/360909393 shutdown_connections 2023-10-06T11:19:13.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.140+0000 7f21d29d5700 1 --2- 172.21.15.146:0/360909393 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f21b8066f30 0x7f21b80693e0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:13.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.140+0000 7f21d29d5700 1 --2- 172.21.15.146:0/360909393 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21cc1594c0 0x7f21cc0b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:13.142 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.140+0000 7f21d29d5700 1 --2- 172.21.15.146:0/360909393 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f21cc069e30 0x7f21cc14fc40 unknown :-1 s=CLOSED pgs=2284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:13.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.140+0000 7f21d29d5700 1 --2- 172.21.15.146:0/360909393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f21cc06b690 0x7f21cc0b2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:13.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.140+0000 7f21d29d5700 1 -- 172.21.15.146:0/360909393 >> 172.21.15.146:0/360909393 conn(0x7f21cc067ea0 msgr2=0x7f21cc150990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:13.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.140+0000 7f21d29d5700 1 -- 172.21.15.146:0/360909393 shutdown_connections 2023-10-06T11:19:13.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.140+0000 7f21d29d5700 1 -- 172.21.15.146:0/360909393 wait complete. 2023-10-06T11:19:13.143 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked joinable; MDS may join as newly active. 2023-10-06T11:19:13.157 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:19:13.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.269+0000 7fbd49087700 1 Processor -- start 2023-10-06T11:19:13.271 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.269+0000 7fbd49087700 1 -- start start 2023-10-06T11:19:13.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.270+0000 7fbd49087700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbd44159fc0 0x7fbd4415a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:13.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.270+0000 7fbd49087700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd440caa40 con 0x7fbd4413ff80 2023-10-06T11:19:13.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.270+0000 7fbd49087700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd4415a950 con 0x7fbd4413fbb0 2023-10-06T11:19:13.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.270+0000 7fbd49087700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd440c6f10 con 0x7fbd44159fc0 2023-10-06T11:19:13.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.270+0000 7fbd3bfff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fbd4413ff80 0x7fbd4406ed40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39290/0 (socket says 172.21.15.146:39290) 2023-10-06T11:19:13.275 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.270+0000 7fbd3bfff700 1 -- 172.21.15.146:0/768513257 learned_addr learned my addr 172.21.15.146:0/768513257 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:19:13.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.271+0000 7fbd4359e700 1 --2- 172.21.15.146:0/768513257 >> v2:172.21.15.151:3300/0 conn(0x7fbd44159fc0 0x7fbd4415a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:13.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.271+0000 7fbd4259c700 1 -- 172.21.15.146:0/768513257 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2790417621 0 0) 0x7fbd440caa40 con 0x7fbd4413ff80 2023-10-06T11:19:13.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.271+0000 7fbd4259c700 1 -- 172.21.15.146:0/768513257 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd30003570 con 0x7fbd4413ff80 2023-10-06T11:19:13.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.271+0000 7fbd4259c700 1 -- 172.21.15.146:0/768513257 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 903573606 0 0) 0x7fbd30003570 con 0x7fbd4413ff80 2023-10-06T11:19:13.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.271+0000 7fbd4259c700 1 -- 172.21.15.146:0/768513257 >> v2:172.21.15.151:3300/0 conn(0x7fbd44159fc0 msgr2=0x7fbd4415a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:13.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.271+0000 7fbd4259c700 1 --2- 172.21.15.146:0/768513257 >> v2:172.21.15.151:3300/0 conn(0x7fbd44159fc0 0x7fbd4415a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:13.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.271+0000 7fbd4259c700 1 -- 172.21.15.146:0/768513257 >> v1:172.21.15.151:6789/0 conn(0x7fbd4413fbb0 legacy=0x7fbd440c6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:13.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.271+0000 7fbd4259c700 1 -- 172.21.15.146:0/768513257 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4415adc0 con 0x7fbd4413ff80 2023-10-06T11:19:13.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.271+0000 7fbd4259c700 1 -- 172.21.15.146:0/768513257 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fbd2c001470 con 0x7fbd4413ff80 2023-10-06T11:19:13.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.271+0000 7fbd4259c700 1 -- 172.21.15.146:0/768513257 >> v1:172.21.15.146:6789/0 conn(0x7fbd4413ff80 legacy=0x7fbd4406ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:13.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.271+0000 7fbd4259c700 1 --2- 172.21.15.146:0/768513257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd30003a60 0x7fbd30003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:13.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.271+0000 7fbd4259c700 1 --2- 172.21.15.146:0/768513257 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd30004810 0x7fbd30004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:13.276 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.271+0000 7fbd4259c700 1 --2- 172.21.15.146:0/768513257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd300051c0 0x7fbd3000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:13.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.271+0000 7fbd4259c700 1 -- 172.21.15.146:0/768513257 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd440c6f10 con 0x7fbd30003a60 2023-10-06T11:19:13.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.271+0000 7fbd4259c700 1 -- 172.21.15.146:0/768513257 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3000c050 con 0x7fbd300051c0 2023-10-06T11:19:13.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.271+0000 7fbd4259c700 1 -- 172.21.15.146:0/768513257 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3000c210 con 0x7fbd30004810 2023-10-06T11:19:13.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.271+0000 7fbd42d9d700 1 --2- 172.21.15.146:0/768513257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd30003a60 0x7fbd30003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:13.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.271+0000 7fbd3bfff700 1 --2- 172.21.15.146:0/768513257 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd30004810 0x7fbd30004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:13.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.271+0000 7fbd4359e700 1 --2- 172.21.15.146:0/768513257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd300051c0 0x7fbd3000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:13.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.271+0000 7fbd42d9d700 1 -- 172.21.15.146:0/768513257 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd30004810 msgr2=0x7fbd30004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:13.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.271+0000 7fbd42d9d700 1 --2- 172.21.15.146:0/768513257 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd30004810 0x7fbd30004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:13.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.272+0000 7fbd42d9d700 1 -- 172.21.15.146:0/768513257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd300051c0 msgr2=0x7fbd3000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:13.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.272+0000 7fbd42d9d700 1 --2- 172.21.15.146:0/768513257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd300051c0 0x7fbd3000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:13.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.272+0000 7fbd42d9d700 1 -- 172.21.15.146:0/768513257 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd30003570 con 0x7fbd30003a60 2023-10-06T11:19:13.277 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.272+0000 7fbd4359e700 1 -- 172.21.15.146:0/768513257 reap_dead start 2023-10-06T11:19:13.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.272+0000 7fbd42d9d700 1 --2- 172.21.15.146:0/768513257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd30003a60 0x7fbd30003e30 secure :-1 s=READY pgs=2286 cs=0 l=1 rev1=1 crypto rx=0x7fbd340019a0 tx=0x7fbd34007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94250bb547b5a678 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:13.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.272+0000 7fbd4259c700 1 -- 172.21.15.146:0/768513257 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3400c5d0 con 0x7fbd30003a60 2023-10-06T11:19:13.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.272+0000 7fbd4259c700 1 -- 172.21.15.146:0/768513257 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3400c730 con 0x7fbd30003a60 2023-10-06T11:19:13.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.272+0000 7fbd4259c700 1 -- 172.21.15.146:0/768513257 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3400caf0 con 0x7fbd30003a60 2023-10-06T11:19:13.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.272+0000 7fbd49087700 1 -- 172.21.15.146:0/768513257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd30003a60 msgr2=0x7fbd30003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:13.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.272+0000 7fbd49087700 1 --2- 172.21.15.146:0/768513257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd30003a60 0x7fbd30003e30 secure :-1 s=READY pgs=2286 cs=0 l=1 rev1=1 crypto rx=0x7fbd340019a0 tx=0x7fbd34007d10 comp rx=0 tx=0).stop 2023-10-06T11:19:13.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.272+0000 7fbd49087700 1 -- 172.21.15.146:0/768513257 shutdown_connections 2023-10-06T11:19:13.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.272+0000 7fbd49087700 1 --2- 172.21.15.146:0/768513257 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd30003a60 0x7fbd30003e30 unknown :-1 s=CLOSED pgs=2286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:13.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.272+0000 7fbd49087700 1 -- 172.21.15.146:0/768513257 >> 172.21.15.146:0/768513257 conn(0x7fbd440cc1c0 msgr2=0x7fbd440cc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:13.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.272+0000 7fbd49087700 1 -- 172.21.15.146:0/768513257 shutdown_connections 2023-10-06T11:19:13.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.272+0000 7fbd49087700 1 -- 172.21.15.146:0/768513257 wait complete. 2023-10-06T11:19:13.278 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.273+0000 7fbd49087700 1 Processor -- start 2023-10-06T11:19:13.279 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.273+0000 7fbd49087700 1 -- start start 2023-10-06T11:19:13.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.274+0000 7fbd49087700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd30003a60 0x7fbd44157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:13.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.274+0000 7fbd49087700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd440c5c60 0x7fbd440ade00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:13.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.274+0000 7fbd49087700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd440c4600 0x7fbd4413e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:13.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.274+0000 7fbd49087700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd440c4bc0 con 0x7fbd440c4600 2023-10-06T11:19:13.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.274+0000 7fbd49087700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd440c4ea0 con 0x7fbd440c5c60 2023-10-06T11:19:13.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.274+0000 7fbd49087700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd440c5180 con 0x7fbd30003a60 2023-10-06T11:19:13.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.274+0000 7fbd4359e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd440c4600 0x7fbd4413e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:13.281 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.274+0000 7fbd4359e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd440c4600 0x7fbd4413e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43114/0 (socket says 172.21.15.146:43114) 2023-10-06T11:19:13.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.274+0000 7fbd4359e700 1 -- 172.21.15.146:0/2399056546 learned_addr learned my addr 172.21.15.146:0/2399056546 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:13.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.274+0000 7fbd42d9d700 1 --2- 172.21.15.146:0/2399056546 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd30003a60 0x7fbd44157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:13.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.274+0000 7fbd3bfff700 1 --2- 172.21.15.146:0/2399056546 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd440c5c60 0x7fbd440ade00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:13.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.275+0000 7fbd4359e700 1 -- 172.21.15.146:0/2399056546 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd30003a60 msgr2=0x7fbd44157360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:13.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.275+0000 7fbd4359e700 1 --2- 172.21.15.146:0/2399056546 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd30003a60 0x7fbd44157360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:13.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.275+0000 7fbd4359e700 1 -- 172.21.15.146:0/2399056546 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd440c5c60 msgr2=0x7fbd440ade00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:13.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.275+0000 7fbd4359e700 1 --2- 172.21.15.146:0/2399056546 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd440c5c60 0x7fbd440ade00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:13.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.275+0000 7fbd4359e700 1 -- 172.21.15.146:0/2399056546 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd440c5460 con 0x7fbd440c4600 2023-10-06T11:19:13.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.275+0000 7fbd4359e700 1 --2- 172.21.15.146:0/2399056546 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd440c4600 0x7fbd4413e670 secure :-1 s=READY pgs=2287 cs=0 l=1 rev1=1 crypto rx=0x7fbd4406cd60 tx=0x7fbd3c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:13.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.275+0000 7fbd3affd700 1 -- 172.21.15.146:0/2399056546 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c00e040 con 0x7fbd440c4600 2023-10-06T11:19:13.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.275+0000 7fbd3affd700 1 -- 172.21.15.146:0/2399056546 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3c00f040 con 0x7fbd440c4600 2023-10-06T11:19:13.282 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.275+0000 7fbd49087700 1 -- 172.21.15.146:0/2399056546 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd440c5740 con 0x7fbd440c4600 2023-10-06T11:19:13.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.275+0000 7fbd3affd700 1 -- 172.21.15.146:0/2399056546 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3c00fdc0 con 0x7fbd440c4600 2023-10-06T11:19:13.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.275+0000 7fbd49087700 1 -- 172.21.15.146:0/2399056546 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd440ae340 con 0x7fbd440c4600 2023-10-06T11:19:13.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.276+0000 7fbd49087700 1 -- 172.21.15.146:0/2399056546 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd440c5980 con 0x7fbd440c4600 2023-10-06T11:19:13.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.276+0000 7fbd3affd700 1 -- 172.21.15.146:0/2399056546 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbd3c015640 con 0x7fbd440c4600 2023-10-06T11:19:13.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.276+0000 7fbd3affd700 1 --2- 172.21.15.146:0/2399056546 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbd24066f30 0x7fbd240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:13.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.277+0000 7fbd3affd700 1 -- 172.21.15.146:0/2399056546 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fbd3c084d10 con 0x7fbd440c4600 2023-10-06T11:19:13.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.277+0000 7fbd42d9d700 1 --2- 172.21.15.146:0/2399056546 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbd24066f30 0x7fbd240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:13.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.277+0000 7fbd42d9d700 1 --2- 172.21.15.146:0/2399056546 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbd24066f30 0x7fbd240693e0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fbd34000fd0 tx=0x7fbd34015000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:13.283 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.281+0000 7fbd3affd700 1 -- 172.21.15.146:0/2399056546 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbd440c5980 con 0x7fbd440c4600 2023-10-06T11:19:13.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.508+0000 7fbd49087700 1 -- 172.21.15.146:0/2399056546 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbd440c5980 con 0x7fbd440c4600 2023-10-06T11:19:13.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.508+0000 7fbd3affd700 1 -- 172.21.15.146:0/2399056546 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 147 v147) v1 ==== 95+0+4621 (secure 0 0 0) 0x7fbd440c5980 con 0x7fbd440c4600 2023-10-06T11:19:13.510 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:13.510 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":147,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9094,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/3426437100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3426437100},{"type":"v1","addr":"172.21.15.146:6836","nonce":3426437100}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":139},{"gid":9106,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/3275041097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":3275041097},{"type":"v1","addr":"172.21.15.151:6835","nonce":3275041097}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":139},{"gid":9259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/959352692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":959352692},{"type":"v1","addr":"172.21.15.151:6834","nonce":959352692}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":146}],"filesystems":[{"mdsmap":{"epoch":147,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:18:51.903907+0000","modified":"2023-10-06T11:19:13.138864+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":178,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10461":{"gid":10461,"name":"c","rank":0,"incarnation":147,"state":"up:replay","state_seq":1,"addr":"172.21.15.146:6837/2322816938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2322816938},{"type":"v1","addr":"172.21.15.146:6837","nonce":2322816938}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-10-06T11:19:13.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.510+0000 7fbd49087700 1 -- 172.21.15.146:0/2399056546 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbd24066f30 msgr2=0x7fbd240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:13.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.510+0000 7fbd49087700 1 --2- 172.21.15.146:0/2399056546 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbd24066f30 0x7fbd240693e0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fbd34000fd0 tx=0x7fbd34015000 comp rx=0 tx=0).stop 2023-10-06T11:19:13.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.510+0000 7fbd49087700 1 -- 172.21.15.146:0/2399056546 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd440c4600 msgr2=0x7fbd4413e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:13.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.510+0000 7fbd49087700 1 --2- 172.21.15.146:0/2399056546 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd440c4600 0x7fbd4413e670 secure :-1 s=READY pgs=2287 cs=0 l=1 rev1=1 crypto rx=0x7fbd4406cd60 tx=0x7fbd3c00b040 comp rx=0 tx=0).stop 2023-10-06T11:19:13.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.510+0000 7fbd49087700 1 -- 172.21.15.146:0/2399056546 shutdown_connections 2023-10-06T11:19:13.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.510+0000 7fbd49087700 1 --2- 172.21.15.146:0/2399056546 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbd24066f30 0x7fbd240693e0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:13.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.510+0000 7fbd49087700 1 --2- 172.21.15.146:0/2399056546 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbd440c4600 0x7fbd4413e670 unknown :-1 s=CLOSED pgs=2287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:13.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.510+0000 7fbd49087700 1 --2- 172.21.15.146:0/2399056546 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbd30003a60 0x7fbd44157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:13.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.510+0000 7fbd49087700 1 --2- 172.21.15.146:0/2399056546 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd440c5c60 0x7fbd440ade00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:13.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.510+0000 7fbd49087700 1 -- 172.21.15.146:0/2399056546 >> 172.21.15.146:0/2399056546 conn(0x7fbd440cc1c0 msgr2=0x7fbd440c7e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:13.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.510+0000 7fbd49087700 1 -- 172.21.15.146:0/2399056546 shutdown_connections 2023-10-06T11:19:13.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:13.511+0000 7fbd49087700 1 -- 172.21.15.146:0/2399056546 wait complete. 2023-10-06T11:19:13.514 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 147 2023-10-06T11:19:13.927 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 147, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T11:18:51.903907+0000', 'modified': '2023-10-06T11:19:13.138864+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 178, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10461}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10461': {'gid': 10461, 'name': 'c', 'rank': 0, 'incarnation': 147, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.146:6837/2322816938', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6835', 'nonce': 2322816938}, {'type': 'v1', 'addr': '172.21.15.146:6837', 'nonce': 2322816938}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T11:19:13.927 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_10461:up:replay 2023-10-06T11:19:14.928 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:19:15.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.055+0000 7f6c7294c700 1 Processor -- start 2023-10-06T11:19:15.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.055+0000 7f6c7294c700 1 -- start start 2023-10-06T11:19:15.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.056+0000 7f6c7294c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6c6c159be0 0x7f6c6c0c7860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:15.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.056+0000 7f6c7294c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c6c0c8b50 con 0x7f6c6c067630 2023-10-06T11:19:15.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.056+0000 7f6c7294c700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c6c0c7f40 con 0x7f6c6c067a00 2023-10-06T11:19:15.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.056+0000 7f6c7294c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c6c0c8220 con 0x7f6c6c159be0 2023-10-06T11:19:15.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.056+0000 7f6c70ee9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f6c6c159be0 0x7f6c6c0c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:15.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.056+0000 7f6c6bfff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6c6c067630 0x7f6c6c0a98e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39300/0 (socket says 172.21.15.146:39300) 2023-10-06T11:19:15.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.056+0000 7f6c6bfff700 1 -- 172.21.15.146:0/3013507090 learned_addr learned my addr 172.21.15.146:0/3013507090 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:19:15.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.056+0000 7f6c6affd700 1 -- 172.21.15.146:0/3013507090 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1618365083 0 0) 0x7f6c6c0c8b50 con 0x7f6c6c067630 2023-10-06T11:19:15.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.056+0000 7f6c6affd700 1 -- 172.21.15.146:0/3013507090 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c54003570 con 0x7f6c6c067630 2023-10-06T11:19:15.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.056+0000 7f6c70ee9700 1 -- 172.21.15.146:0/3013507090 >> v1:172.21.15.151:6789/0 conn(0x7f6c6c067a00 legacy=0x7f6c6c1594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:15.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.056+0000 7f6c70ee9700 1 -- 172.21.15.146:0/3013507090 >> v1:172.21.15.146:6789/0 conn(0x7f6c6c067630 legacy=0x7f6c6c0a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:15.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.056+0000 7f6c70ee9700 1 -- 172.21.15.146:0/3013507090 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c6c0c8500 con 0x7f6c6c159be0 2023-10-06T11:19:15.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.056+0000 7f6c70ee9700 1 --2- 172.21.15.146:0/3013507090 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c6c159be0 0x7f6c6c0c7860 secure :-1 s=READY pgs=2289 cs=0 l=1 rev1=1 crypto rx=0x7f6c64009e60 tx=0x7f6c64009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de37fc3ee2469ba4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:15.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.056+0000 7f6c6affd700 1 -- 172.21.15.146:0/3013507090 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6400e070 con 0x7f6c6c159be0 2023-10-06T11:19:15.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.057+0000 7f6c6affd700 1 -- 172.21.15.146:0/3013507090 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c6400bb20 con 0x7f6c6c159be0 2023-10-06T11:19:15.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.057+0000 7f6c6affd700 1 -- 172.21.15.146:0/3013507090 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c64012430 con 0x7f6c6c159be0 2023-10-06T11:19:15.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.057+0000 7f6c7294c700 1 -- 172.21.15.146:0/3013507090 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c6c159be0 msgr2=0x7f6c6c0c7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:15.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.057+0000 7f6c7294c700 1 --2- 172.21.15.146:0/3013507090 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c6c159be0 0x7f6c6c0c7860 secure :-1 s=READY pgs=2289 cs=0 l=1 rev1=1 crypto rx=0x7f6c64009e60 tx=0x7f6c64009780 comp rx=0 tx=0).stop 2023-10-06T11:19:15.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.057+0000 7f6c7294c700 1 -- 172.21.15.146:0/3013507090 shutdown_connections 2023-10-06T11:19:15.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.057+0000 7f6c7294c700 1 --2- 172.21.15.146:0/3013507090 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c6c159be0 0x7f6c6c0c7860 unknown :-1 s=CLOSED pgs=2289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:15.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.057+0000 7f6c7294c700 1 -- 172.21.15.146:0/3013507090 >> 172.21.15.146:0/3013507090 conn(0x7f6c6c0cdd30 msgr2=0x7f6c6c0c9d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:15.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.057+0000 7f6c7294c700 1 -- 172.21.15.146:0/3013507090 shutdown_connections 2023-10-06T11:19:15.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.057+0000 7f6c7294c700 1 -- 172.21.15.146:0/3013507090 wait complete. 2023-10-06T11:19:15.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.058+0000 7f6c7294c700 1 Processor -- start 2023-10-06T11:19:15.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.058+0000 7f6c7294c700 1 -- start start 2023-10-06T11:19:15.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.059+0000 7f6c7294c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c6c067630 0x7f6c6c0af3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:15.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.059+0000 7f6c7294c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c6c067a00 0x7f6c6c0ad4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:15.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.059+0000 7f6c7294c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c6c159be0 0x7f6c6c155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:15.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.059+0000 7f6c7294c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6c0b0ca0 con 0x7f6c6c159be0 2023-10-06T11:19:15.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.059+0000 7f6c7294c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6c0ada10 con 0x7f6c6c067a00 2023-10-06T11:19:15.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.059+0000 7f6c7294c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6c0b0e30 con 0x7f6c6c067630 2023-10-06T11:19:15.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.059+0000 7f6c70ee9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c6c159be0 0x7f6c6c155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:15.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.059+0000 7f6c70ee9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c6c159be0 0x7f6c6c155750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43134/0 (socket says 172.21.15.146:43134) 2023-10-06T11:19:15.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.059+0000 7f6c70ee9700 1 -- 172.21.15.146:0/2454219617 learned_addr learned my addr 172.21.15.146:0/2454219617 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:15.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.059+0000 7f6c6b7fe700 1 --2- 172.21.15.146:0/2454219617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c6c067a00 0x7f6c6c0ad4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:15.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.059+0000 7f6c6bfff700 1 --2- 172.21.15.146:0/2454219617 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c6c067630 0x7f6c6c0af3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:15.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.060+0000 7f6c70ee9700 1 -- 172.21.15.146:0/2454219617 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c6c067630 msgr2=0x7f6c6c0af3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:15.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.060+0000 7f6c70ee9700 1 --2- 172.21.15.146:0/2454219617 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c6c067630 0x7f6c6c0af3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:15.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.060+0000 7f6c70ee9700 1 -- 172.21.15.146:0/2454219617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c6c067a00 msgr2=0x7f6c6c0ad4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:15.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.060+0000 7f6c70ee9700 1 --2- 172.21.15.146:0/2454219617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c6c067a00 0x7f6c6c0ad4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:15.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.060+0000 7f6c70ee9700 1 -- 172.21.15.146:0/2454219617 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c64009a20 con 0x7f6c6c159be0 2023-10-06T11:19:15.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.060+0000 7f6c6bfff700 1 --2- 172.21.15.146:0/2454219617 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c6c067630 0x7f6c6c0af3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:19:15.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.060+0000 7f6c70ee9700 1 --2- 172.21.15.146:0/2454219617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c6c159be0 0x7f6c6c155750 secure :-1 s=READY pgs=2290 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c064100 tx=0x7f6c64018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:15.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.060+0000 7f6c53fff700 1 -- 172.21.15.146:0/2454219617 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c64027470 con 0x7f6c6c159be0 2023-10-06T11:19:15.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.060+0000 7f6c53fff700 1 -- 172.21.15.146:0/2454219617 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c64027610 con 0x7f6c6c159be0 2023-10-06T11:19:15.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.060+0000 7f6c7294c700 1 -- 172.21.15.146:0/2454219617 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c6c0adc30 con 0x7f6c6c159be0 2023-10-06T11:19:15.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.060+0000 7f6c53fff700 1 -- 172.21.15.146:0/2454219617 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c640279d0 con 0x7f6c6c159be0 2023-10-06T11:19:15.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.060+0000 7f6c7294c700 1 -- 172.21.15.146:0/2454219617 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c6c0ae1f0 con 0x7f6c6c159be0 2023-10-06T11:19:15.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.061+0000 7f6c7294c700 1 -- 172.21.15.146:0/2454219617 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c6c0b0fa0 con 0x7f6c6c159be0 2023-10-06T11:19:15.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.061+0000 7f6c53fff700 1 -- 172.21.15.146:0/2454219617 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6c64024070 con 0x7f6c6c159be0 2023-10-06T11:19:15.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.062+0000 7f6c53fff700 1 --2- 172.21.15.146:0/2454219617 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6c58066f30 0x7f6c580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:15.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.062+0000 7f6c6bfff700 1 --2- 172.21.15.146:0/2454219617 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6c58066f30 0x7f6c580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:15.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.062+0000 7f6c53fff700 1 -- 172.21.15.146:0/2454219617 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f6c64086fd0 con 0x7f6c6c159be0 2023-10-06T11:19:15.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.062+0000 7f6c6bfff700 1 --2- 172.21.15.146:0/2454219617 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6c58066f30 0x7f6c580693e0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c0058d0 tx=0x7f6c5c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:15.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.066+0000 7f6c53fff700 1 -- 172.21.15.146:0/2454219617 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6c64054090 con 0x7f6c6c159be0 2023-10-06T11:19:15.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.294+0000 7f6c7294c700 1 -- 172.21.15.146:0/2454219617 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c6c04c380 con 0x7f6c6c159be0 2023-10-06T11:19:15.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.294+0000 7f6c53fff700 1 -- 172.21.15.146:0/2454219617 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 149 v149) v1 ==== 95+0+4621 (secure 0 0 0) 0x7f6c640576b0 con 0x7f6c6c159be0 2023-10-06T11:19:15.296 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:15.296 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":149,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9094,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/3426437100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3426437100},{"type":"v1","addr":"172.21.15.146:6836","nonce":3426437100}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":139},{"gid":9106,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/3275041097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":3275041097},{"type":"v1","addr":"172.21.15.151:6835","nonce":3275041097}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":139},{"gid":9259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/959352692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":959352692},{"type":"v1","addr":"172.21.15.151:6834","nonce":959352692}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":146}],"filesystems":[{"mdsmap":{"epoch":149,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:18:51.903907+0000","modified":"2023-10-06T11:19:15.144404+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":178,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10461":{"gid":10461,"name":"c","rank":0,"incarnation":147,"state":"up:rejoin","state_seq":9,"addr":"172.21.15.146:6837/2322816938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2322816938},{"type":"v1","addr":"172.21.15.146:6837","nonce":2322816938}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-10-06T11:19:15.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.296+0000 7f6c7294c700 1 -- 172.21.15.146:0/2454219617 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6c58066f30 msgr2=0x7f6c580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:15.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.296+0000 7f6c7294c700 1 --2- 172.21.15.146:0/2454219617 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6c58066f30 0x7f6c580693e0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c0058d0 tx=0x7f6c5c009040 comp rx=0 tx=0).stop 2023-10-06T11:19:15.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.296+0000 7f6c7294c700 1 -- 172.21.15.146:0/2454219617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c6c159be0 msgr2=0x7f6c6c155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:15.298 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.296+0000 7f6c7294c700 1 --2- 172.21.15.146:0/2454219617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c6c159be0 0x7f6c6c155750 secure :-1 s=READY pgs=2290 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c064100 tx=0x7f6c64018000 comp rx=0 tx=0).stop 2023-10-06T11:19:15.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.296+0000 7f6c7294c700 1 -- 172.21.15.146:0/2454219617 shutdown_connections 2023-10-06T11:19:15.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.296+0000 7f6c7294c700 1 --2- 172.21.15.146:0/2454219617 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6c58066f30 0x7f6c580693e0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:15.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.296+0000 7f6c7294c700 1 --2- 172.21.15.146:0/2454219617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6c6c159be0 0x7f6c6c155750 unknown :-1 s=CLOSED pgs=2290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:15.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.296+0000 7f6c7294c700 1 --2- 172.21.15.146:0/2454219617 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c6c067630 0x7f6c6c0af3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:15.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.296+0000 7f6c7294c700 1 --2- 172.21.15.146:0/2454219617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c6c067a00 0x7f6c6c0ad4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:15.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.296+0000 7f6c7294c700 1 -- 172.21.15.146:0/2454219617 >> 172.21.15.146:0/2454219617 conn(0x7f6c6c0cdd30 msgr2=0x7f6c6c0c8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:15.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.296+0000 7f6c7294c700 1 -- 172.21.15.146:0/2454219617 shutdown_connections 2023-10-06T11:19:15.299 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:15.296+0000 7f6c7294c700 1 -- 172.21.15.146:0/2454219617 wait complete. 2023-10-06T11:19:15.299 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 149 2023-10-06T11:19:15.713 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 149, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T11:18:51.903907+0000', 'modified': '2023-10-06T11:19:15.144404+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 178, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10461}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10461': {'gid': 10461, 'name': 'c', 'rank': 0, 'incarnation': 147, 'state': 'up:rejoin', 'state_seq': 9, 'addr': '172.21.15.146:6837/2322816938', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6835', 'nonce': 2322816938}, {'type': 'v1', 'addr': '172.21.15.146:6837', 'nonce': 2322816938}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T11:19:15.713 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_10461:up:rejoin 2023-10-06T11:19:16.714 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:19:16.807 INFO:tasks.ceph.mds.c.smithi146.stderr:2023-10-06T11:19:16.806+0000 7f0d54b40700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T11:19:16.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.841+0000 7fe87da92700 1 Processor -- start 2023-10-06T11:19:16.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.841+0000 7fe87da92700 1 -- start start 2023-10-06T11:19:16.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.841+0000 7fe87da92700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe8780cd480 0x7fe87815abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:16.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.841+0000 7fe87da92700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8780b09f0 0x7fe8780b0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:16.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.841+0000 7fe87da92700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8780b6070 con 0x7fe8780cd0b0 2023-10-06T11:19:16.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.842+0000 7fe87da92700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8780b0280 con 0x7fe8780cd480 2023-10-06T11:19:16.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.842+0000 7fe87da92700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe87815ddf0 con 0x7fe8780b09f0 2023-10-06T11:19:16.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.842+0000 7fe876ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe8780cd480 0x7fe87815abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:16.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.842+0000 7fe8777fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe8780cd0b0 0x7fe87815d610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39302/0 (socket says 172.21.15.146:39302) 2023-10-06T11:19:16.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.842+0000 7fe8777fe700 1 -- 172.21.15.146:0/3732563593 learned_addr learned my addr 172.21.15.146:0/3732563593 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:19:16.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.842+0000 7fe877fff700 1 --2- 172.21.15.146:0/3732563593 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8780b09f0 0x7fe8780b0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:16.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.842+0000 7fe876ffd700 1 -- 172.21.15.146:0/3732563593 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8780b09f0 msgr2=0x7fe8780b0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:16.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.842+0000 7fe876ffd700 1 --2- 172.21.15.146:0/3732563593 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8780b09f0 0x7fe8780b0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:16.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.842+0000 7fe876ffd700 1 -- 172.21.15.146:0/3732563593 >> v1:172.21.15.146:6789/0 conn(0x7fe8780cd0b0 legacy=0x7fe87815d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:16.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.842+0000 7fe8767fc700 1 -- 172.21.15.146:0/3732563593 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 912326449 0 0) 0x7fe8780b6070 con 0x7fe8780cd0b0 2023-10-06T11:19:16.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.842+0000 7fe876ffd700 1 -- 172.21.15.146:0/3732563593 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe87815e0d0 con 0x7fe8780cd480 2023-10-06T11:19:16.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.842+0000 7fe877fff700 1 --2- 172.21.15.146:0/3732563593 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8780b09f0 0x7fe8780b0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:19:16.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.842+0000 7fe876ffd700 1 --2- 172.21.15.146:0/3732563593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8780cd480 0x7fe87815abb0 secure :-1 s=READY pgs=2292 cs=0 l=1 rev1=1 crypto rx=0x7fe8680098e0 tx=0x7fe8680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c4ad8a2da806391 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:16.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.842+0000 7fe8767fc700 1 -- 172.21.15.146:0/3732563593 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe868009e80 con 0x7fe8780cd480 2023-10-06T11:19:16.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.842+0000 7fe8767fc700 1 -- 172.21.15.146:0/3732563593 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe86800b860 con 0x7fe8780cd480 2023-10-06T11:19:16.846 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.842+0000 7fe8767fc700 1 -- 172.21.15.146:0/3732563593 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86800bbe0 con 0x7fe8780cd480 2023-10-06T11:19:16.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.843+0000 7fe87da92700 1 -- 172.21.15.146:0/3732563593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8780cd480 msgr2=0x7fe87815abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:16.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.843+0000 7fe87da92700 1 --2- 172.21.15.146:0/3732563593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8780cd480 0x7fe87815abb0 secure :-1 s=READY pgs=2292 cs=0 l=1 rev1=1 crypto rx=0x7fe8680098e0 tx=0x7fe8680091a0 comp rx=0 tx=0).stop 2023-10-06T11:19:16.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.843+0000 7fe87da92700 1 -- 172.21.15.146:0/3732563593 shutdown_connections 2023-10-06T11:19:16.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.843+0000 7fe87da92700 1 --2- 172.21.15.146:0/3732563593 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8780b09f0 0x7fe8780b0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:16.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.843+0000 7fe87da92700 1 --2- 172.21.15.146:0/3732563593 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8780cd480 0x7fe87815abb0 unknown :-1 s=CLOSED pgs=2292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:16.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.843+0000 7fe87da92700 1 -- 172.21.15.146:0/3732563593 >> 172.21.15.146:0/3732563593 conn(0x7fe87806eb10 msgr2=0x7fe87806ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:16.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.843+0000 7fe87da92700 1 -- 172.21.15.146:0/3732563593 shutdown_connections 2023-10-06T11:19:16.847 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.843+0000 7fe87da92700 1 -- 172.21.15.146:0/3732563593 wait complete. 2023-10-06T11:19:16.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.844+0000 7fe87da92700 1 Processor -- start 2023-10-06T11:19:16.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.844+0000 7fe87da92700 1 -- start start 2023-10-06T11:19:16.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.845+0000 7fe87da92700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8780b09f0 0x7fe87814b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:16.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.845+0000 7fe87da92700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8780cd0b0 0x7fe8780c6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:16.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.845+0000 7fe87da92700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8780cd480 0x7fe8780cc220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:16.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.845+0000 7fe87da92700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8780c9bc0 con 0x7fe8780b09f0 2023-10-06T11:19:16.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.845+0000 7fe87da92700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8780c9ea0 con 0x7fe8780cd0b0 2023-10-06T11:19:16.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.845+0000 7fe87da92700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8780ca180 con 0x7fe8780cd480 2023-10-06T11:19:16.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.845+0000 7fe8777fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8780b09f0 0x7fe87814b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:16.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.845+0000 7fe8777fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8780b09f0 0x7fe87814b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43150/0 (socket says 172.21.15.146:43150) 2023-10-06T11:19:16.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.845+0000 7fe8777fe700 1 -- 172.21.15.146:0/2812234330 learned_addr learned my addr 172.21.15.146:0/2812234330 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:16.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.845+0000 7fe877fff700 1 --2- 172.21.15.146:0/2812234330 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8780cd480 0x7fe8780cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:16.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.845+0000 7fe876ffd700 1 --2- 172.21.15.146:0/2812234330 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8780cd0b0 0x7fe8780c6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:16.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.845+0000 7fe8777fe700 1 -- 172.21.15.146:0/2812234330 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8780cd480 msgr2=0x7fe8780cc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:16.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.845+0000 7fe8777fe700 1 --2- 172.21.15.146:0/2812234330 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8780cd480 0x7fe8780cc220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:16.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.845+0000 7fe8777fe700 1 -- 172.21.15.146:0/2812234330 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8780cd0b0 msgr2=0x7fe8780c6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:16.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.845+0000 7fe8777fe700 1 --2- 172.21.15.146:0/2812234330 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8780cd0b0 0x7fe8780c6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:16.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.845+0000 7fe8777fe700 1 -- 172.21.15.146:0/2812234330 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe868009420 con 0x7fe8780b09f0 2023-10-06T11:19:16.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.845+0000 7fe877fff700 1 --2- 172.21.15.146:0/2812234330 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8780cd480 0x7fe8780cc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:19:16.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.846+0000 7fe8777fe700 1 --2- 172.21.15.146:0/2812234330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8780b09f0 0x7fe87814b920 secure :-1 s=READY pgs=2293 cs=0 l=1 rev1=1 crypto rx=0x7fe86c00c7e0 tx=0x7fe86c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:16.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.846+0000 7fe85f7fe700 1 -- 172.21.15.146:0/2812234330 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86c005b30 con 0x7fe8780b09f0 2023-10-06T11:19:16.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.846+0000 7fe85f7fe700 1 -- 172.21.15.146:0/2812234330 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe86c005c90 con 0x7fe8780b09f0 2023-10-06T11:19:16.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.846+0000 7fe87da92700 1 -- 172.21.15.146:0/2812234330 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8780ca460 con 0x7fe8780b09f0 2023-10-06T11:19:16.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.846+0000 7fe85f7fe700 1 -- 172.21.15.146:0/2812234330 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86c007300 con 0x7fe8780b09f0 2023-10-06T11:19:16.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.846+0000 7fe87da92700 1 -- 172.21.15.146:0/2812234330 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe87814be60 con 0x7fe8780b09f0 2023-10-06T11:19:16.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.847+0000 7fe87da92700 1 -- 172.21.15.146:0/2812234330 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe878070ec0 con 0x7fe8780b09f0 2023-10-06T11:19:16.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.847+0000 7fe85f7fe700 1 -- 172.21.15.146:0/2812234330 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe86c01b400 con 0x7fe8780b09f0 2023-10-06T11:19:16.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.847+0000 7fe85f7fe700 1 --2- 172.21.15.146:0/2812234330 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe864066f30 0x7fe8640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:16.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.847+0000 7fe85f7fe700 1 -- 172.21.15.146:0/2812234330 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fe86c0841e0 con 0x7fe8780b09f0 2023-10-06T11:19:16.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.848+0000 7fe876ffd700 1 --2- 172.21.15.146:0/2812234330 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe864066f30 0x7fe8640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:16.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.848+0000 7fe876ffd700 1 --2- 172.21.15.146:0/2812234330 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe864066f30 0x7fe8640693e0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fe8680091e0 tx=0x7fe868017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:16.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:16.852+0000 7fe85f7fe700 1 -- 172.21.15.146:0/2812234330 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe86c051320 con 0x7fe8780b09f0 2023-10-06T11:19:17.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.076+0000 7fe87da92700 1 -- 172.21.15.146:0/2812234330 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe87804c380 con 0x7fe8780b09f0 2023-10-06T11:19:17.078 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.076+0000 7fe85f7fe700 1 -- 172.21.15.146:0/2812234330 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 150 v150) v1 ==== 95+0+4622 (secure 0 0 0) 0x7fe86c054940 con 0x7fe8780b09f0 2023-10-06T11:19:17.078 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:19:17.079 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":150,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9094,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/3426437100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3426437100},{"type":"v1","addr":"172.21.15.146:6836","nonce":3426437100}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":139},{"gid":9106,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/3275041097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":3275041097},{"type":"v1","addr":"172.21.15.151:6835","nonce":3275041097}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":139},{"gid":9259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/959352692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":959352692},{"type":"v1","addr":"172.21.15.151:6834","nonce":959352692}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":146}],"filesystems":[{"mdsmap":{"epoch":150,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:18:51.903907+0000","modified":"2023-10-06T11:19:16.147837+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":178,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10461":{"gid":10461,"name":"c","rank":0,"incarnation":147,"state":"up:active","state_seq":10,"addr":"172.21.15.146:6837/2322816938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2322816938},{"type":"v1","addr":"172.21.15.146:6837","nonce":2322816938}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-10-06T11:19:17.080 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.078+0000 7fe87da92700 1 -- 172.21.15.146:0/2812234330 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe864066f30 msgr2=0x7fe8640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:17.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.078+0000 7fe87da92700 1 --2- 172.21.15.146:0/2812234330 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe864066f30 0x7fe8640693e0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fe8680091e0 tx=0x7fe868017000 comp rx=0 tx=0).stop 2023-10-06T11:19:17.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.078+0000 7fe87da92700 1 -- 172.21.15.146:0/2812234330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8780b09f0 msgr2=0x7fe87814b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:17.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.078+0000 7fe87da92700 1 --2- 172.21.15.146:0/2812234330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8780b09f0 0x7fe87814b920 secure :-1 s=READY pgs=2293 cs=0 l=1 rev1=1 crypto rx=0x7fe86c00c7e0 tx=0x7fe86c007df0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.078+0000 7fe87da92700 1 -- 172.21.15.146:0/2812234330 shutdown_connections 2023-10-06T11:19:17.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.078+0000 7fe87da92700 1 --2- 172.21.15.146:0/2812234330 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe864066f30 0x7fe8640693e0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.078+0000 7fe87da92700 1 --2- 172.21.15.146:0/2812234330 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe8780cd480 0x7fe8780cc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.078+0000 7fe87da92700 1 --2- 172.21.15.146:0/2812234330 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8780b09f0 0x7fe87814b920 unknown :-1 s=CLOSED pgs=2293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.078+0000 7fe87da92700 1 --2- 172.21.15.146:0/2812234330 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8780cd0b0 0x7fe8780c6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.081 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.078+0000 7fe87da92700 1 -- 172.21.15.146:0/2812234330 >> 172.21.15.146:0/2812234330 conn(0x7fe87806eb10 msgr2=0x7fe8780ce4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:17.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.078+0000 7fe87da92700 1 -- 172.21.15.146:0/2812234330 shutdown_connections 2023-10-06T11:19:17.082 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.078+0000 7fe87da92700 1 -- 172.21.15.146:0/2812234330 wait complete. 2023-10-06T11:19:17.082 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 150 2023-10-06T11:19:17.495 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 150, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T11:18:51.903907+0000', 'modified': '2023-10-06T11:19:16.147837+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 178, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10461}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10461': {'gid': 10461, 'name': 'c', 'rank': 0, 'incarnation': 147, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.146:6837/2322816938', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6835', 'nonce': 2322816938}, {'type': 'v1', 'addr': '172.21.15.146:6837', 'nonce': 2322816938}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T11:19:17.495 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T11:19:17.496 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T11:19:17.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.610+0000 7fa7d6509700 1 Processor -- start 2023-10-06T11:19:17.612 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.610+0000 7fa7d6509700 1 -- start start 2023-10-06T11:19:17.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.611+0000 7fa7d6509700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa7d01538c0 0x7fa7d0153c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.611+0000 7fa7d6509700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa7d015dcc0 0x7fa7d00ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.611+0000 7fa7d6509700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7d015e140 con 0x7fa7d015a940 2023-10-06T11:19:17.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.611+0000 7fa7d6509700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7d015d270 con 0x7fa7d015dcc0 2023-10-06T11:19:17.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.611+0000 7fa7d6509700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d015d830 con 0x7fa7d01538c0 2023-10-06T11:19:17.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.611+0000 7fa7d4aa6700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa7d015dcc0 0x7fa7d00ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.611+0000 7fa7cffff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa7d01538c0 0x7fa7d0153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.614 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.611+0000 7fa7cf7fe700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fa7d015a940 0x7fa7d00cac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:35296/0 (socket says 172.21.15.146:35296) 2023-10-06T11:19:17.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.611+0000 7fa7cf7fe700 1 -- 172.21.15.146:0/674208172 learned_addr learned my addr 172.21.15.146:0/674208172 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:19:17.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.612+0000 7fa7cffff700 1 -- 172.21.15.146:0/674208172 >> v2:172.21.15.151:3300/0 conn(0x7fa7d015dcc0 msgr2=0x7fa7d00ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:17.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.612+0000 7fa7cffff700 1 --2- 172.21.15.146:0/674208172 >> v2:172.21.15.151:3300/0 conn(0x7fa7d015dcc0 0x7fa7d00ce610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.612+0000 7fa7cffff700 1 -- 172.21.15.146:0/674208172 >> v1:172.21.15.151:6789/0 conn(0x7fa7d015a940 legacy=0x7fa7d00cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:17.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.612+0000 7fa7cffff700 1 -- 172.21.15.146:0/674208172 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d00cb810 con 0x7fa7d01538c0 2023-10-06T11:19:17.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.612+0000 7fa7d4aa6700 1 --2- 172.21.15.146:0/674208172 >> v2:172.21.15.151:3300/0 conn(0x7fa7d015dcc0 0x7fa7d00ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:19:17.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.612+0000 7fa7cffff700 1 --2- 172.21.15.146:0/674208172 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa7d01538c0 0x7fa7d0153c90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa7c00098e0 tx=0x7fa7c00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a6f30e9ea2d3497 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:17.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.612+0000 7fa7ceffd700 1 -- 172.21.15.146:0/674208172 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c000b640 con 0x7fa7d01538c0 2023-10-06T11:19:17.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.612+0000 7fa7ceffd700 1 -- 172.21.15.146:0/674208172 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c000b7a0 con 0x7fa7d01538c0 2023-10-06T11:19:17.615 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.612+0000 7fa7ceffd700 1 -- 172.21.15.146:0/674208172 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c000bb40 con 0x7fa7d01538c0 2023-10-06T11:19:17.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.613+0000 7fa7d6509700 1 -- 172.21.15.146:0/674208172 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa7d01538c0 msgr2=0x7fa7d0153c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:17.618 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.613+0000 7fa7d6509700 1 --2- 172.21.15.146:0/674208172 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa7d01538c0 0x7fa7d0153c90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa7c00098e0 tx=0x7fa7c00091a0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.613+0000 7fa7d6509700 1 -- 172.21.15.146:0/674208172 shutdown_connections 2023-10-06T11:19:17.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.613+0000 7fa7d6509700 1 --2- 172.21.15.146:0/674208172 >> v2:172.21.15.151:3300/0 conn(0x7fa7d015dcc0 0x7fa7d00ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.613+0000 7fa7d6509700 1 --2- 172.21.15.146:0/674208172 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa7d01538c0 0x7fa7d0153c90 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.613+0000 7fa7d6509700 1 -- 172.21.15.146:0/674208172 >> 172.21.15.146:0/674208172 conn(0x7fa7d006eb10 msgr2=0x7fa7d006ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:17.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.613+0000 7fa7d6509700 1 -- 172.21.15.146:0/674208172 shutdown_connections 2023-10-06T11:19:17.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.613+0000 7fa7d6509700 1 -- 172.21.15.146:0/674208172 wait complete. 2023-10-06T11:19:17.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.614+0000 7fa7d6509700 1 Processor -- start 2023-10-06T11:19:17.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.614+0000 7fa7d6509700 1 -- start start 2023-10-06T11:19:17.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.615+0000 7fa7d6509700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa7d01538c0 0x7fa7d014b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.615+0000 7fa7d6509700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa7d015a940 0x7fa7d00b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.615+0000 7fa7d6509700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7d015dcc0 0x7fa7d016a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.615+0000 7fa7d6509700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d00b26c0 con 0x7fa7d015dcc0 2023-10-06T11:19:17.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.615+0000 7fa7d6509700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d00c7ea0 con 0x7fa7d015a940 2023-10-06T11:19:17.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.615+0000 7fa7d6509700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d016ad40 con 0x7fa7d01538c0 2023-10-06T11:19:17.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.615+0000 7fa7d4aa6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7d015dcc0 0x7fa7d016a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.620 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.615+0000 7fa7cffff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa7d01538c0 0x7fa7d014b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.615+0000 7fa7cffff700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa7d01538c0 0x7fa7d014b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:46874/0 (socket says 172.21.15.146:46874) 2023-10-06T11:19:17.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.615+0000 7fa7d4aa6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7d015dcc0 0x7fa7d016a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43164/0 (socket says 172.21.15.146:43164) 2023-10-06T11:19:17.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.615+0000 7fa7cffff700 1 -- 172.21.15.146:0/3214680909 learned_addr learned my addr 172.21.15.146:0/3214680909 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:17.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.615+0000 7fa7cf7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa7d015a940 0x7fa7d00b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.615+0000 7fa7d4aa6700 1 -- 172.21.15.146:0/3214680909 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa7d01538c0 msgr2=0x7fa7d014b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:17.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.615+0000 7fa7d4aa6700 1 --2- 172.21.15.146:0/3214680909 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa7d01538c0 0x7fa7d014b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.615+0000 7fa7d4aa6700 1 -- 172.21.15.146:0/3214680909 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa7d015a940 msgr2=0x7fa7d00b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:17.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.615+0000 7fa7d4aa6700 1 --2- 172.21.15.146:0/3214680909 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa7d015a940 0x7fa7d00b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.615+0000 7fa7d4aa6700 1 -- 172.21.15.146:0/3214680909 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c8009a20 con 0x7fa7d015dcc0 2023-10-06T11:19:17.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.615+0000 7fa7cffff700 1 --2- 172.21.15.146:0/3214680909 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa7d01538c0 0x7fa7d014b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:19:17.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.615+0000 7fa7cf7fe700 1 --2- 172.21.15.146:0/3214680909 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa7d015a940 0x7fa7d00b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:19:17.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.615+0000 7fa7d4aa6700 1 --2- 172.21.15.146:0/3214680909 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7d015dcc0 0x7fa7d016a800 secure :-1 s=READY pgs=2294 cs=0 l=1 rev1=1 crypto rx=0x7fa7c8009f40 tx=0x7fa7c800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:17.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.616+0000 7fa7b7fff700 1 -- 172.21.15.146:0/3214680909 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c800cb70 con 0x7fa7d015dcc0 2023-10-06T11:19:17.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.616+0000 7fa7b7fff700 1 -- 172.21.15.146:0/3214680909 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c800f040 con 0x7fa7d015dcc0 2023-10-06T11:19:17.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.616+0000 7fa7d6509700 1 -- 172.21.15.146:0/3214680909 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7c0009420 con 0x7fa7d015dcc0 2023-10-06T11:19:17.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.616+0000 7fa7b7fff700 1 -- 172.21.15.146:0/3214680909 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c8014480 con 0x7fa7d015dcc0 2023-10-06T11:19:17.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.616+0000 7fa7d6509700 1 -- 172.21.15.146:0/3214680909 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7d00b23e0 con 0x7fa7d015dcc0 2023-10-06T11:19:17.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.617+0000 7fa7b7fff700 1 -- 172.21.15.146:0/3214680909 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa7c8003020 con 0x7fa7d015dcc0 2023-10-06T11:19:17.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.617+0000 7fa7b7fff700 1 --2- 172.21.15.146:0/3214680909 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa7bc066f30 0x7fa7bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.617+0000 7fa7b7fff700 1 -- 172.21.15.146:0/3214680909 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fa7c8084f60 con 0x7fa7d015dcc0 2023-10-06T11:19:17.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.617+0000 7fa7cffff700 1 --2- 172.21.15.146:0/3214680909 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa7bc066f30 0x7fa7bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.618+0000 7fa7cffff700 1 --2- 172.21.15.146:0/3214680909 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa7bc066f30 0x7fa7bc0693e0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0003080 tx=0x7fa7c0017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:17.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.619+0000 7fa7df801b80 1 Processor -- start 2023-10-06T11:19:17.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.619+0000 7fa7df801b80 1 -- start start 2023-10-06T11:19:17.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.620+0000 7fa7df801b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561dba9aa90 0x5561dba9ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.620+0000 7fa7df801b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5561dba569a0 0x5561dba53580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.620+0000 7fa7df801b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5561dba54bd0 0x5561dba53ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.620+0000 7fa7df801b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561db9d3c80 con 0x5561dba9aa90 2023-10-06T11:19:17.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.620+0000 7fa7df801b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561db9aaa70 con 0x5561dba54bd0 2023-10-06T11:19:17.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.620+0000 7fa7df801b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5561db9a8270 con 0x5561dba569a0 2023-10-06T11:19:17.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.620+0000 7fa7cffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561dba9aa90 0x5561dba9ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.620+0000 7fa7cffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561dba9aa90 0x5561dba9ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43166/0 (socket says 172.21.15.146:43166) 2023-10-06T11:19:17.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.620+0000 7fa7cffff700 1 -- 172.21.15.146:0/1835916621 learned_addr learned my addr 172.21.15.146:0/1835916621 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:17.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.620+0000 7fa7cffff700 1 -- 172.21.15.146:0/1835916621 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5561dba569a0 msgr2=0x5561dba53580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:17.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.620+0000 7fa7cffff700 1 --2- 172.21.15.146:0/1835916621 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5561dba569a0 0x5561dba53580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.620+0000 7fa7cffff700 1 -- 172.21.15.146:0/1835916621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5561dba54bd0 msgr2=0x5561dba53ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:17.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.620+0000 7fa7cffff700 1 --2- 172.21.15.146:0/1835916621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5561dba54bd0 0x5561dba53ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.620+0000 7fa7cffff700 1 -- 172.21.15.146:0/1835916621 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561db83e270 con 0x5561dba9aa90 2023-10-06T11:19:17.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.621+0000 7fa7cffff700 1 --2- 172.21.15.146:0/1835916621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561dba9aa90 0x5561dba9ae60 secure :-1 s=READY pgs=2295 cs=0 l=1 rev1=1 crypto rx=0x7fa7d015d970 tx=0x7fa7c0021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2715dbd37c02792 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:17.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.621+0000 7fa7b57fa700 1 -- 172.21.15.146:0/1835916621 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c0021070 con 0x5561dba9aa90 2023-10-06T11:19:17.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.621+0000 7fa7b57fa700 1 -- 172.21.15.146:0/1835916621 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c0033480 con 0x5561dba9aa90 2023-10-06T11:19:17.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.621+0000 7fa7b57fa700 1 -- 172.21.15.146:0/1835916621 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c00335f0 con 0x5561dba9aa90 2023-10-06T11:19:17.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.621+0000 7fa7df801b80 1 -- 172.21.15.146:0/1835916621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561dba9aa90 msgr2=0x5561dba9ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:17.631 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.621+0000 7fa7df801b80 1 --2- 172.21.15.146:0/1835916621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561dba9aa90 0x5561dba9ae60 secure :-1 s=READY pgs=2295 cs=0 l=1 rev1=1 crypto rx=0x7fa7d015d970 tx=0x7fa7c0021000 comp rx=0 tx=0).stop 2023-10-06T11:19:17.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.621+0000 7fa7df801b80 1 -- 172.21.15.146:0/1835916621 shutdown_connections 2023-10-06T11:19:17.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.621+0000 7fa7df801b80 1 --2- 172.21.15.146:0/1835916621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5561dba54bd0 0x5561dba53ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.621+0000 7fa7df801b80 1 --2- 172.21.15.146:0/1835916621 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561dba9aa90 0x5561dba9ae60 unknown :-1 s=CLOSED pgs=2295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.621+0000 7fa7df801b80 1 --2- 172.21.15.146:0/1835916621 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5561dba569a0 0x5561dba53580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.621+0000 7fa7df801b80 1 -- 172.21.15.146:0/1835916621 >> 172.21.15.146:0/1835916621 conn(0x5561dba55070 msgr2=0x5561dba55440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:17.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.621+0000 7fa7df801b80 1 -- 172.21.15.146:0/1835916621 shutdown_connections 2023-10-06T11:19:17.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.621+0000 7fa7df801b80 1 -- 172.21.15.146:0/1835916621 wait complete. 2023-10-06T11:19:17.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.622+0000 7fa7df801b80 1 -- start start 2023-10-06T11:19:17.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.622+0000 7fa7df801b80 1 Processor -- start 2023-10-06T11:19:17.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.623+0000 7fa7df801b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561dba54bd0 0x5561dba7e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.623+0000 7fa7df801b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5561dba569a0 0x5561dba94ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.623+0000 7fa7df801b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5561dba9aa90 0x5561dba7be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.623+0000 7fa7df801b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561db9a4060 con 0x5561dba54bd0 2023-10-06T11:19:17.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.623+0000 7fa7df801b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561db94f890 con 0x5561dba9aa90 2023-10-06T11:19:17.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.623+0000 7fa7df801b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5561db96aea0 con 0x5561dba569a0 2023-10-06T11:19:17.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.623+0000 7fa7df801b80 10 client.0 _ll_register_callbacks cb 0x5561db840f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:19:17.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.623+0000 7fa7cffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561dba54bd0 0x5561dba7e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.623+0000 7fa7cffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561dba54bd0 0x5561dba7e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43182/0 (socket says 172.21.15.146:43182) 2023-10-06T11:19:17.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.623+0000 7fa7cffff700 1 -- 172.21.15.146:0/3055248749 learned_addr learned my addr 172.21.15.146:0/3055248749 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:17.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.623+0000 7fa7cf7fe700 1 --2- 172.21.15.146:0/3055248749 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5561dba569a0 0x5561dba94ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.623+0000 7fa7cffff700 1 -- 172.21.15.146:0/3055248749 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5561dba569a0 msgr2=0x5561dba94ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:17.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.623+0000 7fa7cffff700 1 --2- 172.21.15.146:0/3055248749 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5561dba569a0 0x5561dba94ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.623+0000 7fa7cffff700 1 -- 172.21.15.146:0/3055248749 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5561dba9aa90 msgr2=0x5561dba7be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:17.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.623+0000 7fa7d4aa6700 1 --2- 172.21.15.146:0/3055248749 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5561dba9aa90 0x5561dba7be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.623+0000 7fa7cffff700 1 --2- 172.21.15.146:0/3055248749 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5561dba9aa90 0x5561dba7be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.623+0000 7fa7cffff700 1 -- 172.21.15.146:0/3055248749 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7d00cb810 con 0x5561dba54bd0 2023-10-06T11:19:17.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.623+0000 7fa7cf7fe700 1 --2- 172.21.15.146:0/3055248749 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5561dba569a0 0x5561dba94ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:19:17.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.623+0000 7fa7cffff700 1 --2- 172.21.15.146:0/3055248749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561dba54bd0 0x5561dba7e050 secure :-1 s=READY pgs=2296 cs=0 l=1 rev1=1 crypto rx=0x5561dba56ef0 tx=0x7fa7c002c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c787a9b599124c1f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:17.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.623+0000 7fa7ae7fc700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:19:17.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.623+0000 7fa7ae7fc700 1 -- 172.21.15.146:0/3055248749 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c0021040 con 0x5561dba54bd0 2023-10-06T11:19:17.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.623+0000 7fa7ae7fc700 1 -- 172.21.15.146:0/3055248749 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(178..178 src has 1..178) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fa7c002ae40 con 0x5561dba54bd0 2023-10-06T11:19:17.636 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.623+0000 7fa7df801b80 1 -- 172.21.15.146:0/3055248749 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5561dba48690 con 0x5561dba54bd0 2023-10-06T11:19:17.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.624+0000 7fa7ae7fc700 1 -- 172.21.15.146:0/3055248749 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=150) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7c003de70 con 0x5561dba54bd0 2023-10-06T11:19:17.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.624+0000 7fa7df801b80 10 client.10746 fetch_fsmap learned FSMap version 150 2023-10-06T11:19:17.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.624+0000 7fa7df801b80 1 -- 172.21.15.146:0/3055248749 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=150,monmap=2+}) v3 -- 0x5561db7e0fe0 con 0x5561dba54bd0 2023-10-06T11:19:17.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.624+0000 7fa7ae7fc700 1 -- 172.21.15.146:0/3055248749 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5561dba48690 con 0x5561dba54bd0 2023-10-06T11:19:17.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.624+0000 7fa7ae7fc700 1 -- 172.21.15.146:0/3055248749 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 150) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa7c001a630 con 0x5561dba54bd0 2023-10-06T11:19:17.637 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.624+0000 7fa7df801b80 10 client.10746 fetch_fsmap finished waiting for FSMap version 150 2023-10-06T11:19:17.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.624+0000 7fa7df801b80 10 client.10746 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T11:19:17.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.624+0000 7fa7df801b80 20 client.10746 populate_metadata read hostname 'smithi146' 2023-10-06T11:19:17.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.624+0000 7fa7df801b80 1 --2- 172.21.15.146:0/3055248749 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x5561dba95c90 0x5561dba96060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.624+0000 7fa7df801b80 4 client.10746 mds_command: new command op to 10461 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:19:17.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.624+0000 7fa7df801b80 1 -- 172.21.15.146:0/3055248749 --> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5561dba255c0 con 0x5561dba95c90 2023-10-06T11:19:17.638 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.624+0000 7fa7cf7fe700 1 --2- 172.21.15.146:0/3055248749 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x5561dba95c90 0x5561dba96060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.624+0000 7fa7ae7fc700 10 client.10746 ms_handle_connect on v2:172.21.15.146:6835/2322816938 2023-10-06T11:19:17.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.624+0000 7fa7cf7fe700 1 --2- 172.21.15.146:0/3055248749 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x5561dba95c90 0x5561dba96060 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed0bd884953c2916 server_cookie=9c846b41012bafe1 in_seq=0 out_seq=0 2023-10-06T11:19:17.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.625+0000 7fa7ae7fc700 1 -- 172.21.15.146:0/3055248749 <== mds.0 v2:172.21.15.146:6835/2322816938 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5561dba255c0 con 0x5561dba95c90 2023-10-06T11:19:17.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.625+0000 7fa7ae7fc700 10 client.10746 handle_command_reply: tid=0 2023-10-06T11:19:17.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.625+0000 7fa7df801b80 1 client.10746 shutdown 2023-10-06T11:19:17.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.625+0000 7fa7df801b80 1 -- 172.21.15.146:0/3055248749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561dba54bd0 msgr2=0x5561dba7e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:17.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.625+0000 7fa7df801b80 1 --2- 172.21.15.146:0/3055248749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561dba54bd0 0x5561dba7e050 secure :-1 s=READY pgs=2296 cs=0 l=1 rev1=1 crypto rx=0x5561dba56ef0 tx=0x7fa7c002c040 comp rx=0 tx=0).stop 2023-10-06T11:19:17.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.625+0000 7fa7df801b80 1 -- 172.21.15.146:0/3055248749 shutdown_connections 2023-10-06T11:19:17.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.625+0000 7fa7df801b80 1 --2- 172.21.15.146:0/3055248749 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x5561dba95c90 0x5561dba96060 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.625+0000 7fa7df801b80 1 --2- 172.21.15.146:0/3055248749 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5561dba9aa90 0x5561dba7be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.639 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.625+0000 7fa7ae7fc700 0 client.10746 ms_handle_reset on v2:172.21.15.146:6835/2322816938 2023-10-06T11:19:17.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.625+0000 7fa7df801b80 1 --2- 172.21.15.146:0/3055248749 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561dba54bd0 0x5561dba7e050 unknown :-1 s=CLOSED pgs=2296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.625+0000 7fa7df801b80 1 --2- 172.21.15.146:0/3055248749 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5561dba569a0 0x5561dba94ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.625+0000 7fa7df801b80 1 -- 172.21.15.146:0/3055248749 >> 172.21.15.146:0/3055248749 conn(0x5561dba55070 msgr2=0x5561dba986f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:17.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.625+0000 7fa7df801b80 1 -- 172.21.15.146:0/3055248749 shutdown_connections 2023-10-06T11:19:17.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.625+0000 7fa7df801b80 1 -- 172.21.15.146:0/3055248749 wait complete. 2023-10-06T11:19:17.640 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.625+0000 7fa7df801b80 20 client.10746 trim_cache size 0 max 16384 2023-10-06T11:19:17.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.642+0000 7fa7df801b80 1 Processor -- start 2023-10-06T11:19:17.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.642+0000 7fa7df801b80 1 -- start start 2023-10-06T11:19:17.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.643+0000 7fa7df801b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561dba54bd0 0x5561dba99350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.643+0000 7fa7df801b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5561dba569a0 0x5561dba50950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.643+0000 7fa7df801b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5561dba9aa90 0x5561dba50e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.643+0000 7fa7df801b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561db826e30 con 0x5561dba54bd0 2023-10-06T11:19:17.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.643+0000 7fa7df801b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561dba513d0 con 0x5561dba9aa90 2023-10-06T11:19:17.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.643+0000 7fa7df801b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5561dba982c0 con 0x5561dba569a0 2023-10-06T11:19:17.652 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.643+0000 7fa7cffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561dba54bd0 0x5561dba99350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.643+0000 7fa7cffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561dba54bd0 0x5561dba99350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43192/0 (socket says 172.21.15.146:43192) 2023-10-06T11:19:17.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.643+0000 7fa7cffff700 1 -- 172.21.15.146:0/134128946 learned_addr learned my addr 172.21.15.146:0/134128946 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:17.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.643+0000 7fa7cffff700 1 -- 172.21.15.146:0/134128946 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5561dba569a0 msgr2=0x5561dba50950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:17.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.643+0000 7fa7cffff700 1 --2- 172.21.15.146:0/134128946 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5561dba569a0 0x5561dba50950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.643+0000 7fa7cffff700 1 -- 172.21.15.146:0/134128946 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5561dba9aa90 msgr2=0x5561dba50e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:17.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.643+0000 7fa7cffff700 1 --2- 172.21.15.146:0/134128946 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5561dba9aa90 0x5561dba50e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.643+0000 7fa7cffff700 1 -- 172.21.15.146:0/134128946 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561db972780 con 0x5561dba54bd0 2023-10-06T11:19:17.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.643+0000 7fa7cffff700 1 --2- 172.21.15.146:0/134128946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561dba54bd0 0x5561dba99350 secure :-1 s=READY pgs=2297 cs=0 l=1 rev1=1 crypto rx=0x7fa7c001adf0 tx=0x7fa7c0036070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff8a50a4a54396f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:17.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.643+0000 7fa7b5ffb700 1 -- 172.21.15.146:0/134128946 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c0021040 con 0x5561dba54bd0 2023-10-06T11:19:17.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.643+0000 7fa7b5ffb700 1 -- 172.21.15.146:0/134128946 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c001ab40 con 0x5561dba54bd0 2023-10-06T11:19:17.653 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.643+0000 7fa7b5ffb700 1 -- 172.21.15.146:0/134128946 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c00335f0 con 0x5561dba54bd0 2023-10-06T11:19:17.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.644+0000 7fa7df801b80 1 -- 172.21.15.146:0/134128946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561dba54bd0 msgr2=0x5561dba99350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:17.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.644+0000 7fa7df801b80 1 --2- 172.21.15.146:0/134128946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561dba54bd0 0x5561dba99350 secure :-1 s=READY pgs=2297 cs=0 l=1 rev1=1 crypto rx=0x7fa7c001adf0 tx=0x7fa7c0036070 comp rx=0 tx=0).stop 2023-10-06T11:19:17.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.644+0000 7fa7df801b80 1 -- 172.21.15.146:0/134128946 shutdown_connections 2023-10-06T11:19:17.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.644+0000 7fa7df801b80 1 --2- 172.21.15.146:0/134128946 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5561dba9aa90 0x5561dba50e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.644+0000 7fa7df801b80 1 --2- 172.21.15.146:0/134128946 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561dba54bd0 0x5561dba99350 unknown :-1 s=CLOSED pgs=2297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.644+0000 7fa7df801b80 1 --2- 172.21.15.146:0/134128946 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5561dba569a0 0x5561dba50950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.644+0000 7fa7df801b80 1 -- 172.21.15.146:0/134128946 >> 172.21.15.146:0/134128946 conn(0x5561dba55070 msgr2=0x5561dba96060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:17.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.644+0000 7fa7df801b80 1 -- 172.21.15.146:0/134128946 shutdown_connections 2023-10-06T11:19:17.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.644+0000 7fa7df801b80 1 -- 172.21.15.146:0/134128946 wait complete. 2023-10-06T11:19:17.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.645+0000 7fa7df801b80 1 -- start start 2023-10-06T11:19:17.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.645+0000 7fa7df801b80 1 Processor -- start 2023-10-06T11:19:17.654 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.645+0000 7fa7df801b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5561dba54bd0 0x5561dba506b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.645+0000 7fa7df801b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561dba569a0 0x5561dba50bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.645+0000 7fa7df801b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5561dba9aa90 0x5561dba939e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.655 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.645+0000 7fa7df801b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561dba99350 con 0x5561dba569a0 2023-10-06T11:19:17.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.645+0000 7fa7df801b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561dbb007d0 con 0x5561dba54bd0 2023-10-06T11:19:17.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.645+0000 7fa7df801b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5561dba548a0 con 0x5561dba9aa90 2023-10-06T11:19:17.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.645+0000 7fa7df801b80 10 client.0 _ll_register_callbacks cb 0x5561db840f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:19:17.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.646+0000 7fa7cf7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561dba569a0 0x5561dba50bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.646+0000 7fa7cf7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561dba569a0 0x5561dba50bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43196/0 (socket says 172.21.15.146:43196) 2023-10-06T11:19:17.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.646+0000 7fa7cf7fe700 1 -- 172.21.15.146:0/1508403023 learned_addr learned my addr 172.21.15.146:0/1508403023 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:17.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.646+0000 7fa7cffff700 1 --2- 172.21.15.146:0/1508403023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5561dba54bd0 0x5561dba506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.646+0000 7fa7d4aa6700 1 --2- 172.21.15.146:0/1508403023 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5561dba9aa90 0x5561dba939e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.646+0000 7fa7cf7fe700 1 -- 172.21.15.146:0/1508403023 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5561dba9aa90 msgr2=0x5561dba939e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:17.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.646+0000 7fa7cf7fe700 1 --2- 172.21.15.146:0/1508403023 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5561dba9aa90 0x5561dba939e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.646+0000 7fa7cf7fe700 1 -- 172.21.15.146:0/1508403023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5561dba54bd0 msgr2=0x5561dba506b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:17.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.646+0000 7fa7cf7fe700 1 --2- 172.21.15.146:0/1508403023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5561dba54bd0 0x5561dba506b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.646+0000 7fa7cf7fe700 1 -- 172.21.15.146:0/1508403023 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5561db7e0fe0 con 0x5561dba569a0 2023-10-06T11:19:17.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.646+0000 7fa7d4aa6700 1 --2- 172.21.15.146:0/1508403023 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5561dba9aa90 0x5561dba939e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:19:17.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.646+0000 7fa7cf7fe700 1 --2- 172.21.15.146:0/1508403023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561dba569a0 0x5561dba50bf0 secure :-1 s=READY pgs=2298 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4004b60 tx=0x7fa7c4019040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6c9f8e010c04f9e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:17.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.646+0000 7fa7ae7fc700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:19:17.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.646+0000 7fa7ae7fc700 1 -- 172.21.15.146:0/1508403023 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c4007710 con 0x5561dba569a0 2023-10-06T11:19:17.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.646+0000 7fa7ae7fc700 1 -- 172.21.15.146:0/1508403023 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(178..178 src has 1..178) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fa7c401eb30 con 0x5561dba569a0 2023-10-06T11:19:17.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.646+0000 7fa7df801b80 1 -- 172.21.15.146:0/1508403023 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5561dba53080 con 0x5561dba569a0 2023-10-06T11:19:17.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.646+0000 7fa7ae7fc700 1 -- 172.21.15.146:0/1508403023 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=150) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7c4017540 con 0x5561dba569a0 2023-10-06T11:19:17.659 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.646+0000 7fa7df801b80 10 client.10752 fetch_fsmap learned FSMap version 150 2023-10-06T11:19:17.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.646+0000 7fa7df801b80 1 -- 172.21.15.146:0/1508403023 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=150,monmap=2+}) v3 -- 0x5561db959470 con 0x5561dba569a0 2023-10-06T11:19:17.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.646+0000 7fa7ae7fc700 1 -- 172.21.15.146:0/1508403023 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5561dba53080 con 0x5561dba569a0 2023-10-06T11:19:17.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.646+0000 7fa7ae7fc700 1 -- 172.21.15.146:0/1508403023 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 150) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa7c40176a0 con 0x5561dba569a0 2023-10-06T11:19:17.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.647+0000 7fa7df801b80 10 client.10752 fetch_fsmap finished waiting for FSMap version 150 2023-10-06T11:19:17.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.647+0000 7fa7df801b80 10 client.10752 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T11:19:17.660 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.647+0000 7fa7df801b80 20 client.10752 populate_metadata read hostname 'smithi146' 2023-10-06T11:19:17.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.647+0000 7fa7df801b80 1 --2- 172.21.15.146:0/1508403023 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x5561dba93f90 0x5561dba94360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.647+0000 7fa7df801b80 4 client.10752 mds_command: new command op to 10461 tid=0[{"prefix": "status"}] 2023-10-06T11:19:17.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.647+0000 7fa7df801b80 1 -- 172.21.15.146:0/1508403023 --> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7fa7c0033480 con 0x5561dba93f90 2023-10-06T11:19:17.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.647+0000 7fa7cffff700 1 --2- 172.21.15.146:0/1508403023 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x5561dba93f90 0x5561dba94360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.647+0000 7fa7ae7fc700 10 client.10752 ms_handle_connect on v2:172.21.15.146:6835/2322816938 2023-10-06T11:19:17.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.647+0000 7fa7cffff700 1 --2- 172.21.15.146:0/1508403023 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x5561dba93f90 0x5561dba94360 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eeb327152cccd20d server_cookie=b88c5c2babbff336 in_seq=0 out_seq=0 2023-10-06T11:19:17.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.647+0000 7fa7ae7fc700 1 -- 172.21.15.146:0/1508403023 <== mds.0 v2:172.21.15.146:6835/2322816938 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+335 (crc 0 0 0) 0x7fa7c0033480 con 0x5561dba93f90 2023-10-06T11:19:17.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.647+0000 7fa7ae7fc700 10 client.10752 handle_command_reply: tid=0 2023-10-06T11:19:17.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.647+0000 7fa7df801b80 1 client.10752 shutdown 2023-10-06T11:19:17.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.647+0000 7fa7df801b80 1 -- 172.21.15.146:0/1508403023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561dba569a0 msgr2=0x5561dba50bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:17.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.647+0000 7fa7df801b80 1 --2- 172.21.15.146:0/1508403023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561dba569a0 0x5561dba50bf0 secure :-1 s=READY pgs=2298 cs=0 l=1 rev1=1 crypto rx=0x7fa7c4004b60 tx=0x7fa7c4019040 comp rx=0 tx=0).stop 2023-10-06T11:19:17.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.647+0000 7fa7df801b80 1 -- 172.21.15.146:0/1508403023 shutdown_connections 2023-10-06T11:19:17.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.647+0000 7fa7df801b80 1 --2- 172.21.15.146:0/1508403023 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x5561dba93f90 0x5561dba94360 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.647+0000 7fa7df801b80 1 --2- 172.21.15.146:0/1508403023 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5561dba9aa90 0x5561dba939e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.663 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.647+0000 7fa7df801b80 1 --2- 172.21.15.146:0/1508403023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5561dba54bd0 0x5561dba506b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.647+0000 7fa7ae7fc700 0 client.10752 ms_handle_reset on v2:172.21.15.146:6835/2322816938 2023-10-06T11:19:17.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.647+0000 7fa7df801b80 1 --2- 172.21.15.146:0/1508403023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5561dba569a0 0x5561dba50bf0 unknown :-1 s=CLOSED pgs=2298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.647+0000 7fa7df801b80 1 -- 172.21.15.146:0/1508403023 >> 172.21.15.146:0/1508403023 conn(0x5561dba55070 msgr2=0x5561dba98690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:17.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.647+0000 7fa7df801b80 1 -- 172.21.15.146:0/1508403023 shutdown_connections 2023-10-06T11:19:17.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.648+0000 7fa7df801b80 1 -- 172.21.15.146:0/1508403023 wait complete. 2023-10-06T11:19:17.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.648+0000 7fa7df801b80 20 client.10752 trim_cache size 0 max 16384 2023-10-06T11:19:17.665 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:19:17.665 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1", 2023-10-06T11:19:17.665 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2023-10-06T11:19:17.666 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 10461, 2023-10-06T11:19:17.666 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2023-10-06T11:19:17.666 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2023-10-06T11:19:17.666 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2023-10-06T11:19:17.666 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 4.5075268480000004, 2023-10-06T11:19:17.666 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 150, 2023-10-06T11:19:17.667 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 178, 2023-10-06T11:19:17.667 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 178, 2023-10-06T11:19:17.667 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 31.239507277000001 2023-10-06T11:19:17.667 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:19:17.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.648+0000 7fa7d6509700 1 -- 172.21.15.146:0/3214680909 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa7bc066f30 msgr2=0x7fa7bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:17.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.648+0000 7fa7d6509700 1 --2- 172.21.15.146:0/3214680909 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa7bc066f30 0x7fa7bc0693e0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0003080 tx=0x7fa7c0017000 comp rx=0 tx=0).stop 2023-10-06T11:19:17.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.648+0000 7fa7d6509700 1 -- 172.21.15.146:0/3214680909 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7d015dcc0 msgr2=0x7fa7d016a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:17.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.648+0000 7fa7d6509700 1 --2- 172.21.15.146:0/3214680909 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7d015dcc0 0x7fa7d016a800 secure :-1 s=READY pgs=2294 cs=0 l=1 rev1=1 crypto rx=0x7fa7c8009f40 tx=0x7fa7c800b040 comp rx=0 tx=0).stop 2023-10-06T11:19:17.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.648+0000 7fa7d6509700 1 -- 172.21.15.146:0/3214680909 shutdown_connections 2023-10-06T11:19:17.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.648+0000 7fa7d6509700 1 --2- 172.21.15.146:0/3214680909 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa7bc066f30 0x7fa7bc0693e0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.648+0000 7fa7d6509700 1 --2- 172.21.15.146:0/3214680909 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa7d015dcc0 0x7fa7d016a800 unknown :-1 s=CLOSED pgs=2294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.648+0000 7fa7d6509700 1 --2- 172.21.15.146:0/3214680909 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa7d01538c0 0x7fa7d014b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.648+0000 7fa7d6509700 1 --2- 172.21.15.146:0/3214680909 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa7d015a940 0x7fa7d00b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.648+0000 7fa7d6509700 1 -- 172.21.15.146:0/3214680909 >> 172.21.15.146:0/3214680909 conn(0x7fa7d006eb10 msgr2=0x7fa7d00c53e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:17.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.648+0000 7fa7d6509700 1 -- 172.21.15.146:0/3214680909 shutdown_connections 2023-10-06T11:19:17.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.648+0000 7fa7d6509700 1 -- 172.21.15.146:0/3214680909 wait complete. 2023-10-06T11:19:17.671 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.13:0 scrub start / recursive,repair 2023-10-06T11:19:17.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.789+0000 7fe222346700 1 Processor -- start 2023-10-06T11:19:17.791 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.789+0000 7fe222346700 1 -- start start 2023-10-06T11:19:17.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.789+0000 7fe222346700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe21c06f0f0 0x7fe21c0ac6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.789+0000 7fe222346700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe21c0b0b50 0x7fe21c06a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.789+0000 7fe222346700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe21c0b06c0 con 0x7fe21c06ed20 2023-10-06T11:19:17.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.789+0000 7fe222346700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe21c06a990 con 0x7fe21c06f0f0 2023-10-06T11:19:17.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.789+0000 7fe222346700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe21c0b0ff0 con 0x7fe21c0b0b50 2023-10-06T11:19:17.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.790+0000 7fe213fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe21c06f0f0 0x7fe21c0ac6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.790+0000 7fe213fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fe21c06f0f0 0x7fe21c0ac6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43210/0 (socket says 172.21.15.146:43210) 2023-10-06T11:19:17.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.790+0000 7fe213fff700 1 -- 172.21.15.146:0/2034148659 learned_addr learned my addr 172.21.15.146:0/2034148659 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:17.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.790+0000 7fe2208e3700 1 --2- 172.21.15.146:0/2034148659 >> v2:172.21.15.151:3300/0 conn(0x7fe21c0b0b50 0x7fe21c06a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.790+0000 7fe213fff700 1 -- 172.21.15.146:0/2034148659 >> v2:172.21.15.151:3300/0 conn(0x7fe21c0b0b50 msgr2=0x7fe21c06a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:17.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.790+0000 7fe213fff700 1 --2- 172.21.15.146:0/2034148659 >> v2:172.21.15.151:3300/0 conn(0x7fe21c0b0b50 0x7fe21c06a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.790+0000 7fe213fff700 1 -- 172.21.15.146:0/2034148659 >> v1:172.21.15.151:6789/0 conn(0x7fe21c06ed20 legacy=0x7fe21c159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:17.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.790+0000 7fe213fff700 1 -- 172.21.15.146:0/2034148659 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe21c0b0090 con 0x7fe21c06f0f0 2023-10-06T11:19:17.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.790+0000 7fe213fff700 1 --2- 172.21.15.146:0/2034148659 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe21c06f0f0 0x7fe21c0ac6e0 secure :-1 s=READY pgs=2299 cs=0 l=1 rev1=1 crypto rx=0x7fe21c0acc20 tx=0x7fe204009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2119510905c9acda server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:17.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.790+0000 7fe21b7fe700 1 -- 172.21.15.146:0/2034148659 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20400b820 con 0x7fe21c06f0f0 2023-10-06T11:19:17.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.790+0000 7fe21b7fe700 1 -- 172.21.15.146:0/2034148659 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe20400b980 con 0x7fe21c06f0f0 2023-10-06T11:19:17.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.790+0000 7fe21b7fe700 1 -- 172.21.15.146:0/2034148659 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20400bd20 con 0x7fe21c06f0f0 2023-10-06T11:19:17.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.791+0000 7fe222346700 1 -- 172.21.15.146:0/2034148659 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe21c06f0f0 msgr2=0x7fe21c0ac6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:17.794 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.791+0000 7fe222346700 1 --2- 172.21.15.146:0/2034148659 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe21c06f0f0 0x7fe21c0ac6e0 secure :-1 s=READY pgs=2299 cs=0 l=1 rev1=1 crypto rx=0x7fe21c0acc20 tx=0x7fe204009250 comp rx=0 tx=0).stop 2023-10-06T11:19:17.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.791+0000 7fe222346700 1 -- 172.21.15.146:0/2034148659 shutdown_connections 2023-10-06T11:19:17.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.791+0000 7fe222346700 1 --2- 172.21.15.146:0/2034148659 >> v2:172.21.15.151:3300/0 conn(0x7fe21c0b0b50 0x7fe21c06a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.791+0000 7fe222346700 1 --2- 172.21.15.146:0/2034148659 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe21c06f0f0 0x7fe21c0ac6e0 unknown :-1 s=CLOSED pgs=2299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.791+0000 7fe222346700 1 -- 172.21.15.146:0/2034148659 >> 172.21.15.146:0/2034148659 conn(0x7fe21c0684f0 msgr2=0x7fe21c0688f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:17.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.791+0000 7fe222346700 1 -- 172.21.15.146:0/2034148659 shutdown_connections 2023-10-06T11:19:17.795 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.791+0000 7fe222346700 1 -- 172.21.15.146:0/2034148659 wait complete. 2023-10-06T11:19:17.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.792+0000 7fe222346700 1 Processor -- start 2023-10-06T11:19:17.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.792+0000 7fe222346700 1 -- start start 2023-10-06T11:19:17.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.793+0000 7fe222346700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe21c06ed20 0x7fe21c149280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.793+0000 7fe222346700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe21c06f0f0 0x7fe21c166540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.793+0000 7fe222346700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe21c0b0b50 0x7fe21c1577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.793+0000 7fe222346700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe21c14bd40 con 0x7fe21c0b0b50 2023-10-06T11:19:17.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.793+0000 7fe222346700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe21c166a80 con 0x7fe21c06ed20 2023-10-06T11:19:17.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.793+0000 7fe222346700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe21c14bf90 con 0x7fe21c06f0f0 2023-10-06T11:19:17.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.793+0000 7fe2208e3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe21c0b0b50 0x7fe21c1577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.793+0000 7fe2208e3700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe21c0b0b50 0x7fe21c1577f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43218/0 (socket says 172.21.15.146:43218) 2023-10-06T11:19:17.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.793+0000 7fe2208e3700 1 -- 172.21.15.146:0/1461704158 learned_addr learned my addr 172.21.15.146:0/1461704158 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:17.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.793+0000 7fe21bfff700 1 --2- 172.21.15.146:0/1461704158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe21c06ed20 0x7fe21c149280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.793+0000 7fe213fff700 1 --2- 172.21.15.146:0/1461704158 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe21c06f0f0 0x7fe21c166540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.793+0000 7fe2208e3700 1 -- 172.21.15.146:0/1461704158 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe21c06f0f0 msgr2=0x7fe21c166540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:17.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.793+0000 7fe2208e3700 1 --2- 172.21.15.146:0/1461704158 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe21c06f0f0 0x7fe21c166540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.793+0000 7fe2208e3700 1 -- 172.21.15.146:0/1461704158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe21c06ed20 msgr2=0x7fe21c149280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:17.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.793+0000 7fe2208e3700 1 --2- 172.21.15.146:0/1461704158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe21c06ed20 0x7fe21c149280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.793+0000 7fe2208e3700 1 -- 172.21.15.146:0/1461704158 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2040094f0 con 0x7fe21c0b0b50 2023-10-06T11:19:17.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.793+0000 7fe2208e3700 1 --2- 172.21.15.146:0/1461704158 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe21c0b0b50 0x7fe21c1577f0 secure :-1 s=READY pgs=2300 cs=0 l=1 rev1=1 crypto rx=0x7fe214007f20 tx=0x7fe214009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:17.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.793+0000 7fe218ff9700 1 -- 172.21.15.146:0/1461704158 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21400eb90 con 0x7fe21c0b0b50 2023-10-06T11:19:17.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.793+0000 7fe218ff9700 1 -- 172.21.15.146:0/1461704158 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe21400ed10 con 0x7fe21c0b0b50 2023-10-06T11:19:17.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.793+0000 7fe222346700 1 -- 172.21.15.146:0/1461704158 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe21c14c270 con 0x7fe21c0b0b50 2023-10-06T11:19:17.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.793+0000 7fe218ff9700 1 -- 172.21.15.146:0/1461704158 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe214014670 con 0x7fe21c0b0b50 2023-10-06T11:19:17.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.793+0000 7fe222346700 1 -- 172.21.15.146:0/1461704158 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe21c1572d0 con 0x7fe21c0b0b50 2023-10-06T11:19:17.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.795+0000 7fe218ff9700 1 -- 172.21.15.146:0/1461704158 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe2140149e0 con 0x7fe21c0b0b50 2023-10-06T11:19:17.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.795+0000 7fe218ff9700 1 --2- 172.21.15.146:0/1461704158 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe1fc066f30 0x7fe1fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.795+0000 7fe218ff9700 1 -- 172.21.15.146:0/1461704158 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fe214084ce0 con 0x7fe21c0b0b50 2023-10-06T11:19:17.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.795+0000 7fe21bfff700 1 --2- 172.21.15.146:0/1461704158 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe1fc066f30 0x7fe1fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.800 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.796+0000 7fe21bfff700 1 --2- 172.21.15.146:0/1461704158 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe1fc066f30 0x7fe1fc0693e0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fe21c14c950 tx=0x7fe20c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:17.806 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.797+0000 7fe22b63eb80 1 Processor -- start 2023-10-06T11:19:17.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.797+0000 7fe22b63eb80 1 -- start start 2023-10-06T11:19:17.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.798+0000 7fe22b63eb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603674fdb60 0x5603674fdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.798+0000 7fe22b63eb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5603674b9a70 0x5603674b6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.798+0000 7fe22b63eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603674b7ca0 0x5603674b6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.798+0000 7fe22b63eb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x560367436d50 con 0x5603674fdb60 2023-10-06T11:19:17.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.798+0000 7fe22b63eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56036740db40 con 0x5603674b7ca0 2023-10-06T11:19:17.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.798+0000 7fe22b63eb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x56036740b340 con 0x5603674b9a70 2023-10-06T11:19:17.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.798+0000 7fe21bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603674fdb60 0x5603674fdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.798+0000 7fe21bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603674fdb60 0x5603674fdf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43222/0 (socket says 172.21.15.146:43222) 2023-10-06T11:19:17.807 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.798+0000 7fe21bfff700 1 -- 172.21.15.146:0/429832796 learned_addr learned my addr 172.21.15.146:0/429832796 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:17.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.798+0000 7fe21bfff700 1 -- 172.21.15.146:0/429832796 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5603674b9a70 msgr2=0x5603674b6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:17.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.798+0000 7fe21bfff700 1 --2- 172.21.15.146:0/429832796 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5603674b9a70 0x5603674b6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.799+0000 7fe21bfff700 1 -- 172.21.15.146:0/429832796 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603674b7ca0 msgr2=0x5603674b6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:17.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.799+0000 7fe2208e3700 1 --2- 172.21.15.146:0/429832796 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603674b7ca0 0x5603674b6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.799+0000 7fe21bfff700 1 --2- 172.21.15.146:0/429832796 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603674b7ca0 0x5603674b6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.799+0000 7fe21bfff700 1 -- 172.21.15.146:0/429832796 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5603672a1340 con 0x5603674fdb60 2023-10-06T11:19:17.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.799+0000 7fe2208e3700 1 --2- 172.21.15.146:0/429832796 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603674b7ca0 0x5603674b6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:19:17.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.799+0000 7fe21bfff700 1 --2- 172.21.15.146:0/429832796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603674fdb60 0x5603674fdf30 secure :-1 s=READY pgs=2301 cs=0 l=1 rev1=1 crypto rx=0x7fe20c00f9a0 tx=0x7fe20c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26b11a7acfbf01e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:17.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.799+0000 7fe2117fa700 1 -- 172.21.15.146:0/429832796 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20c014660 con 0x5603674fdb60 2023-10-06T11:19:17.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.799+0000 7fe2117fa700 1 -- 172.21.15.146:0/429832796 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe20c0147c0 con 0x5603674fdb60 2023-10-06T11:19:17.808 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.799+0000 7fe2117fa700 1 -- 172.21.15.146:0/429832796 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20c014b40 con 0x5603674fdb60 2023-10-06T11:19:17.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.799+0000 7fe22b63eb80 1 -- 172.21.15.146:0/429832796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603674fdb60 msgr2=0x5603674fdf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:17.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.799+0000 7fe22b63eb80 1 --2- 172.21.15.146:0/429832796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603674fdb60 0x5603674fdf30 secure :-1 s=READY pgs=2301 cs=0 l=1 rev1=1 crypto rx=0x7fe20c00f9a0 tx=0x7fe20c015000 comp rx=0 tx=0).stop 2023-10-06T11:19:17.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.800+0000 7fe22b63eb80 1 -- 172.21.15.146:0/429832796 shutdown_connections 2023-10-06T11:19:17.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.800+0000 7fe22b63eb80 1 --2- 172.21.15.146:0/429832796 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603674b7ca0 0x5603674b6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.800+0000 7fe22b63eb80 1 --2- 172.21.15.146:0/429832796 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603674fdb60 0x5603674fdf30 unknown :-1 s=CLOSED pgs=2301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.800+0000 7fe22b63eb80 1 --2- 172.21.15.146:0/429832796 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5603674b9a70 0x5603674b6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.800+0000 7fe22b63eb80 1 -- 172.21.15.146:0/429832796 >> 172.21.15.146:0/429832796 conn(0x5603674b8140 msgr2=0x5603674b8510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:17.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.800+0000 7fe22b63eb80 1 -- 172.21.15.146:0/429832796 shutdown_connections 2023-10-06T11:19:17.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.800+0000 7fe22b63eb80 1 -- 172.21.15.146:0/429832796 wait complete. 2023-10-06T11:19:17.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.800+0000 7fe22b63eb80 1 -- start start 2023-10-06T11:19:17.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.800+0000 7fe22b63eb80 1 Processor -- start 2023-10-06T11:19:17.809 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.801+0000 7fe22b63eb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603674b7ca0 0x56036750d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.801+0000 7fe22b63eb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5603674b9a70 0x560367500f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.801+0000 7fe22b63eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603674fdb60 0x560367501460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.801+0000 7fe22b63eb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x560367407130 con 0x5603674b7ca0 2023-10-06T11:19:17.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.801+0000 7fe22b63eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603673b2960 con 0x5603674fdb60 2023-10-06T11:19:17.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.801+0000 7fe22b63eb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5603673cdf70 con 0x5603674b9a70 2023-10-06T11:19:17.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.801+0000 7fe22b63eb80 10 client.0 _ll_register_callbacks cb 0x5603672a4000 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:19:17.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.801+0000 7fe21bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603674b7ca0 0x56036750d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.801+0000 7fe21bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603674b7ca0 0x56036750d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43230/0 (socket says 172.21.15.146:43230) 2023-10-06T11:19:17.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.801+0000 7fe21bfff700 1 -- 172.21.15.146:0/1622464204 learned_addr learned my addr 172.21.15.146:0/1622464204 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:17.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.801+0000 7fe2208e3700 1 --2- 172.21.15.146:0/1622464204 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603674fdb60 0x560367501460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.810 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.801+0000 7fe213fff700 1 --2- 172.21.15.146:0/1622464204 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5603674b9a70 0x560367500f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.801+0000 7fe21bfff700 1 -- 172.21.15.146:0/1622464204 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5603674b9a70 msgr2=0x560367500f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:17.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.801+0000 7fe21bfff700 1 --2- 172.21.15.146:0/1622464204 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5603674b9a70 0x560367500f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.801+0000 7fe21bfff700 1 -- 172.21.15.146:0/1622464204 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603674fdb60 msgr2=0x560367501460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:17.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.801+0000 7fe21bfff700 1 --2- 172.21.15.146:0/1622464204 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603674fdb60 0x560367501460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.801+0000 7fe21bfff700 1 -- 172.21.15.146:0/1622464204 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe21c0b06c0 con 0x5603674b7ca0 2023-10-06T11:19:17.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.801+0000 7fe213fff700 1 --2- 172.21.15.146:0/1622464204 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5603674b9a70 0x560367500f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:19:17.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.802+0000 7fe21bfff700 1 --2- 172.21.15.146:0/1622464204 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603674b7ca0 0x56036750d900 secure :-1 s=READY pgs=2302 cs=0 l=1 rev1=1 crypto rx=0x7fe20c023040 tx=0x7fe20c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=656457afa7e1d77a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:17.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.802+0000 7fe1fa7fc700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:19:17.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.802+0000 7fe1fa7fc700 1 -- 172.21.15.146:0/1622464204 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20c014660 con 0x5603674b7ca0 2023-10-06T11:19:17.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.802+0000 7fe1fa7fc700 1 -- 172.21.15.146:0/1622464204 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(178..178 src has 1..178) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fe20c01c040 con 0x5603674b7ca0 2023-10-06T11:19:17.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.802+0000 7fe22b63eb80 1 -- 172.21.15.146:0/1622464204 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5603674ab760 con 0x5603674b7ca0 2023-10-06T11:19:17.811 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.802+0000 7fe1fa7fc700 1 -- 172.21.15.146:0/1622464204 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=150) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe20c001670 con 0x5603674b7ca0 2023-10-06T11:19:17.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.802+0000 7fe22b63eb80 10 client.10764 fetch_fsmap learned FSMap version 150 2023-10-06T11:19:17.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.802+0000 7fe22b63eb80 1 -- 172.21.15.146:0/1622464204 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=150,monmap=2+}) v3 -- 0x5603672440b0 con 0x5603674b7ca0 2023-10-06T11:19:17.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.802+0000 7fe1fa7fc700 1 -- 172.21.15.146:0/1622464204 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5603674ab760 con 0x5603674b7ca0 2023-10-06T11:19:17.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.802+0000 7fe1fa7fc700 1 -- 172.21.15.146:0/1622464204 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 150) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fe20c033440 con 0x5603674b7ca0 2023-10-06T11:19:17.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.802+0000 7fe22b63eb80 10 client.10764 fetch_fsmap finished waiting for FSMap version 150 2023-10-06T11:19:17.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.802+0000 7fe22b63eb80 10 client.10764 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2023-10-06T11:19:17.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.802+0000 7fe22b63eb80 20 client.10764 populate_metadata read hostname 'smithi146' 2023-10-06T11:19:17.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.802+0000 7fe22b63eb80 1 --2- 172.21.15.146:0/1622464204 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x5603674e2fa0 0x560367510830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.802+0000 7fe22b63eb80 4 client.10764 mds_command: new command op to 10461 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:19:17.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.802+0000 7fe22b63eb80 1 -- 172.21.15.146:0/1622464204 --> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560367488690 con 0x5603674e2fa0 2023-10-06T11:19:17.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.802+0000 7fe213fff700 1 --2- 172.21.15.146:0/1622464204 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x5603674e2fa0 0x560367510830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.812 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.803+0000 7fe1fa7fc700 10 client.10764 ms_handle_connect on v2:172.21.15.146:6835/2322816938 2023-10-06T11:19:17.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.803+0000 7fe213fff700 1 --2- 172.21.15.146:0/1622464204 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x5603674e2fa0 0x560367510830 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0452347550c8b2b server_cookie=eeac7baf412a148a in_seq=0 out_seq=0 2023-10-06T11:19:17.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.803+0000 7fe1fa7fc700 1 -- 172.21.15.146:0/1622464204 <== mds.0 v2:172.21.15.146:6835/2322816938 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x560367488690 con 0x5603674e2fa0 2023-10-06T11:19:17.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.803+0000 7fe1fa7fc700 10 client.10764 handle_command_reply: tid=0 2023-10-06T11:19:17.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.803+0000 7fe22b63eb80 1 client.10764 shutdown 2023-10-06T11:19:17.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.803+0000 7fe22b63eb80 1 -- 172.21.15.146:0/1622464204 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603674b7ca0 msgr2=0x56036750d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:17.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.803+0000 7fe22b63eb80 1 --2- 172.21.15.146:0/1622464204 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603674b7ca0 0x56036750d900 secure :-1 s=READY pgs=2302 cs=0 l=1 rev1=1 crypto rx=0x7fe20c023040 tx=0x7fe20c019000 comp rx=0 tx=0).stop 2023-10-06T11:19:17.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.803+0000 7fe22b63eb80 1 -- 172.21.15.146:0/1622464204 shutdown_connections 2023-10-06T11:19:17.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.803+0000 7fe22b63eb80 1 --2- 172.21.15.146:0/1622464204 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x5603674e2fa0 0x560367510830 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.803+0000 7fe22b63eb80 1 --2- 172.21.15.146:0/1622464204 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603674fdb60 0x560367501460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.803+0000 7fe22b63eb80 1 --2- 172.21.15.146:0/1622464204 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603674b7ca0 0x56036750d900 unknown :-1 s=CLOSED pgs=2302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.803+0000 7fe22b63eb80 1 --2- 172.21.15.146:0/1622464204 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5603674b9a70 0x560367500f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.813 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.803+0000 7fe1fa7fc700 0 client.10764 ms_handle_reset on v2:172.21.15.146:6835/2322816938 2023-10-06T11:19:17.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.803+0000 7fe22b63eb80 1 -- 172.21.15.146:0/1622464204 >> 172.21.15.146:0/1622464204 conn(0x5603674b8140 msgr2=0x5603674fb630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:17.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.803+0000 7fe22b63eb80 1 -- 172.21.15.146:0/1622464204 shutdown_connections 2023-10-06T11:19:17.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.803+0000 7fe22b63eb80 1 -- 172.21.15.146:0/1622464204 wait complete. 2023-10-06T11:19:17.814 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.804+0000 7fe22b63eb80 20 client.10764 trim_cache size 0 max 16384 2023-10-06T11:19:17.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.819+0000 7fe22b63eb80 1 Processor -- start 2023-10-06T11:19:17.821 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.820+0000 7fe22b63eb80 1 -- start start 2023-10-06T11:19:17.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.820+0000 7fe22b63eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603674b7ca0 0x560367500ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.820+0000 7fe22b63eb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603674b9a70 0x5603674fc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.820+0000 7fe22b63eb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5603674fdb60 0x5603674deb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.820+0000 7fe22b63eb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x560367289f00 con 0x5603674b9a70 2023-10-06T11:19:17.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.820+0000 7fe22b63eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56036750daf0 con 0x5603674b7ca0 2023-10-06T11:19:17.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.820+0000 7fe22b63eb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5603674b1190 con 0x5603674fdb60 2023-10-06T11:19:17.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.820+0000 7fe213fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603674b9a70 0x5603674fc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.820+0000 7fe213fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603674b9a70 0x5603674fc520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43242/0 (socket says 172.21.15.146:43242) 2023-10-06T11:19:17.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.820+0000 7fe213fff700 1 -- 172.21.15.146:0/171146259 learned_addr learned my addr 172.21.15.146:0/171146259 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:17.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.821+0000 7fe21bfff700 1 --2- 172.21.15.146:0/171146259 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603674b7ca0 0x560367500ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.828 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.821+0000 7fe2208e3700 1 --2- 172.21.15.146:0/171146259 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5603674fdb60 0x5603674deb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.821+0000 7fe213fff700 1 -- 172.21.15.146:0/171146259 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5603674fdb60 msgr2=0x5603674deb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:17.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.821+0000 7fe213fff700 1 --2- 172.21.15.146:0/171146259 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5603674fdb60 0x5603674deb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.821+0000 7fe213fff700 1 -- 172.21.15.146:0/171146259 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603674b7ca0 msgr2=0x560367500ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:17.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.821+0000 7fe213fff700 1 --2- 172.21.15.146:0/171146259 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603674b7ca0 0x560367500ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.821+0000 7fe213fff700 1 -- 172.21.15.146:0/171146259 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5603674dd2b0 con 0x5603674b9a70 2023-10-06T11:19:17.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.821+0000 7fe21bfff700 1 --2- 172.21.15.146:0/171146259 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603674b7ca0 0x560367500ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:19:17.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.821+0000 7fe2208e3700 1 --2- 172.21.15.146:0/171146259 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5603674fdb60 0x5603674deb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:19:17.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.821+0000 7fe213fff700 1 --2- 172.21.15.146:0/171146259 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603674b9a70 0x5603674fc520 secure :-1 s=READY pgs=2303 cs=0 l=1 rev1=1 crypto rx=0x7fe204009290 tx=0x7fe20401b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=926f6e36d99e62a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:17.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.821+0000 7fe211ffb700 1 -- 172.21.15.146:0/171146259 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20401e040 con 0x5603674b9a70 2023-10-06T11:19:17.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.821+0000 7fe211ffb700 1 -- 172.21.15.146:0/171146259 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe204000c40 con 0x5603674b9a70 2023-10-06T11:19:17.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.821+0000 7fe211ffb700 1 -- 172.21.15.146:0/171146259 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20402a0f0 con 0x5603674b9a70 2023-10-06T11:19:17.829 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.822+0000 7fe22b63eb80 1 -- 172.21.15.146:0/171146259 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603674b9a70 msgr2=0x5603674fc520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:17.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.822+0000 7fe22b63eb80 1 --2- 172.21.15.146:0/171146259 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603674b9a70 0x5603674fc520 secure :-1 s=READY pgs=2303 cs=0 l=1 rev1=1 crypto rx=0x7fe204009290 tx=0x7fe20401b040 comp rx=0 tx=0).stop 2023-10-06T11:19:17.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.822+0000 7fe22b63eb80 1 -- 172.21.15.146:0/171146259 shutdown_connections 2023-10-06T11:19:17.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.822+0000 7fe22b63eb80 1 --2- 172.21.15.146:0/171146259 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5603674fdb60 0x5603674deb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.822+0000 7fe22b63eb80 1 --2- 172.21.15.146:0/171146259 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603674b7ca0 0x560367500ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.822+0000 7fe22b63eb80 1 --2- 172.21.15.146:0/171146259 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603674b9a70 0x5603674fc520 unknown :-1 s=CLOSED pgs=2303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.822+0000 7fe22b63eb80 1 -- 172.21.15.146:0/171146259 >> 172.21.15.146:0/171146259 conn(0x5603674b8140 msgr2=0x5603674dc850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:17.830 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.822+0000 7fe22b63eb80 1 -- 172.21.15.146:0/171146259 shutdown_connections 2023-10-06T11:19:17.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.822+0000 7fe22b63eb80 1 -- 172.21.15.146:0/171146259 wait complete. 2023-10-06T11:19:17.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.822+0000 7fe22b63eb80 1 -- start start 2023-10-06T11:19:17.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.822+0000 7fe22b63eb80 1 Processor -- start 2023-10-06T11:19:17.831 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.823+0000 7fe22b63eb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603674b7ca0 0x5603674e6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.823+0000 7fe22b63eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603674b9a70 0x5603674df4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.823+0000 7fe22b63eb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5603674fdb60 0x5603674b8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.823+0000 7fe22b63eb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x560367568380 con 0x5603674b7ca0 2023-10-06T11:19:17.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.823+0000 7fe22b63eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603675677f0 con 0x5603674b9a70 2023-10-06T11:19:17.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.823+0000 7fe22b63eb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5603674de980 con 0x5603674fdb60 2023-10-06T11:19:17.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.823+0000 7fe22b63eb80 10 client.0 _ll_register_callbacks cb 0x5603672a4000 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:19:17.833 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.823+0000 7fe21bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603674b7ca0 0x5603674e6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.823+0000 7fe21bfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603674b7ca0 0x5603674e6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43254/0 (socket says 172.21.15.146:43254) 2023-10-06T11:19:17.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.823+0000 7fe21bfff700 1 -- 172.21.15.146:0/3523027834 learned_addr learned my addr 172.21.15.146:0/3523027834 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:17.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.823+0000 7fe213fff700 1 --2- 172.21.15.146:0/3523027834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603674b9a70 0x5603674df4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.823+0000 7fe2208e3700 1 --2- 172.21.15.146:0/3523027834 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5603674fdb60 0x5603674b8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.823+0000 7fe21bfff700 1 -- 172.21.15.146:0/3523027834 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5603674fdb60 msgr2=0x5603674b8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:17.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.823+0000 7fe21bfff700 1 --2- 172.21.15.146:0/3523027834 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5603674fdb60 0x5603674b8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.823+0000 7fe21bfff700 1 -- 172.21.15.146:0/3523027834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603674b9a70 msgr2=0x5603674df4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:17.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.823+0000 7fe21bfff700 1 --2- 172.21.15.146:0/3523027834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603674b9a70 0x5603674df4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.823+0000 7fe21bfff700 1 -- 172.21.15.146:0/3523027834 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe21c0b0090 con 0x5603674b7ca0 2023-10-06T11:19:17.836 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.823+0000 7fe213fff700 1 --2- 172.21.15.146:0/3523027834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603674b9a70 0x5603674df4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:19:17.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.823+0000 7fe21bfff700 1 --2- 172.21.15.146:0/3523027834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603674b7ca0 0x5603674e6740 secure :-1 s=READY pgs=2304 cs=0 l=1 rev1=1 crypto rx=0x7fe20c000fd0 tx=0x7fe20c02a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3b31cf1f998e90f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:17.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.824+0000 7fe1fa7fc700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:19:17.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.824+0000 7fe1fa7fc700 1 -- 172.21.15.146:0/3523027834 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20c014450 con 0x5603674b7ca0 2023-10-06T11:19:17.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.824+0000 7fe1fa7fc700 1 -- 172.21.15.146:0/3523027834 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(178..178 src has 1..178) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fe20c0145b0 con 0x5603674b7ca0 2023-10-06T11:19:17.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.824+0000 7fe22b63eb80 1 -- 172.21.15.146:0/3523027834 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe20c0147c0 con 0x5603674b7ca0 2023-10-06T11:19:17.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.824+0000 7fe1fa7fc700 1 -- 172.21.15.146:0/3523027834 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=150) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe20c03ee70 con 0x5603674b7ca0 2023-10-06T11:19:17.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.824+0000 7fe22b63eb80 10 client.10770 fetch_fsmap learned FSMap version 150 2023-10-06T11:19:17.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.824+0000 7fe22b63eb80 1 -- 172.21.15.146:0/3523027834 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=150,monmap=2+}) v3 -- 0x5603674af370 con 0x5603674b7ca0 2023-10-06T11:19:17.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.824+0000 7fe1fa7fc700 1 -- 172.21.15.146:0/3523027834 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe20c0147c0 con 0x5603674b7ca0 2023-10-06T11:19:17.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.824+0000 7fe1fa7fc700 1 -- 172.21.15.146:0/3523027834 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 150) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fe20c033b60 con 0x5603674b7ca0 2023-10-06T11:19:17.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.824+0000 7fe22b63eb80 10 client.10770 fetch_fsmap finished waiting for FSMap version 150 2023-10-06T11:19:17.837 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.824+0000 7fe22b63eb80 10 client.10770 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2023-10-06T11:19:17.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.824+0000 7fe22b63eb80 20 client.10770 populate_metadata read hostname 'smithi146' 2023-10-06T11:19:17.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.824+0000 7fe22b63eb80 1 --2- 172.21.15.146:0/3523027834 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x5603674b21c0 0x5603674b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.824+0000 7fe22b63eb80 4 client.10770 mds_command: new command op to 10461 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}] 2023-10-06T11:19:17.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.824+0000 7fe22b63eb80 1 -- 172.21.15.146:0/3523027834 --> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}) v1 -- 0x5603673a9ed0 con 0x5603674b21c0 2023-10-06T11:19:17.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.824+0000 7fe213fff700 1 --2- 172.21.15.146:0/3523027834 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x5603674b21c0 0x5603674b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.824+0000 7fe1fa7fc700 10 client.10770 ms_handle_connect on v2:172.21.15.146:6835/2322816938 2023-10-06T11:19:17.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.824+0000 7fe213fff700 1 --2- 172.21.15.146:0/3523027834 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x5603674b21c0 0x5603674b8a50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5985e557654d345 server_cookie=45b17babf79811ce in_seq=0 out_seq=0 2023-10-06T11:19:17.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.825+0000 7fe1fa7fc700 1 -- 172.21.15.146:0/3523027834 <== mds.0 v2:172.21.15.146:6835/2322816938 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5603673a9ed0 con 0x5603674b21c0 2023-10-06T11:19:17.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.825+0000 7fe1fa7fc700 10 client.10770 handle_command_reply: tid=0 2023-10-06T11:19:17.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.825+0000 7fe22b63eb80 1 client.10770 shutdown 2023-10-06T11:19:17.838 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.825+0000 7fe22b63eb80 1 -- 172.21.15.146:0/3523027834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603674b7ca0 msgr2=0x5603674e6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:17.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.825+0000 7fe22b63eb80 1 --2- 172.21.15.146:0/3523027834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603674b7ca0 0x5603674e6740 secure :-1 s=READY pgs=2304 cs=0 l=1 rev1=1 crypto rx=0x7fe20c000fd0 tx=0x7fe20c02a000 comp rx=0 tx=0).stop 2023-10-06T11:19:17.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.825+0000 7fe22b63eb80 1 -- 172.21.15.146:0/3523027834 shutdown_connections 2023-10-06T11:19:17.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.825+0000 7fe22b63eb80 1 --2- 172.21.15.146:0/3523027834 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x5603674b21c0 0x5603674b8a50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.825+0000 7fe22b63eb80 1 --2- 172.21.15.146:0/3523027834 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5603674fdb60 0x5603674b8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.825+0000 7fe22b63eb80 1 --2- 172.21.15.146:0/3523027834 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5603674b7ca0 0x5603674e6740 unknown :-1 s=CLOSED pgs=2304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.825+0000 7fe22b63eb80 1 --2- 172.21.15.146:0/3523027834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603674b9a70 0x5603674df4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.825+0000 7fe1fa7fc700 0 client.10770 ms_handle_reset on v2:172.21.15.146:6835/2322816938 2023-10-06T11:19:17.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.825+0000 7fe22b63eb80 1 -- 172.21.15.146:0/3523027834 >> 172.21.15.146:0/3523027834 conn(0x5603674b8140 msgr2=0x560367500a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:17.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.825+0000 7fe22b63eb80 1 -- 172.21.15.146:0/3523027834 shutdown_connections 2023-10-06T11:19:17.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.825+0000 7fe22b63eb80 1 -- 172.21.15.146:0/3523027834 wait complete. 2023-10-06T11:19:17.839 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.825+0000 7fe22b63eb80 20 client.10770 trim_cache size 0 max 16384 2023-10-06T11:19:17.840 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:19:17.840 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0, 2023-10-06T11:19:17.840 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_tag": "e9c47bb8-df91-4e4e-8536-fcdb2a389cee", 2023-10-06T11:19:17.840 INFO:teuthology.orchestra.run.smithi146.stdout: "mode": "asynchronous" 2023-10-06T11:19:17.840 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:19:17.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.826+0000 7fe222346700 1 -- 172.21.15.146:0/1461704158 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe1fc066f30 msgr2=0x7fe1fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:17.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.826+0000 7fe222346700 1 --2- 172.21.15.146:0/1461704158 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe1fc066f30 0x7fe1fc0693e0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7fe21c14c950 tx=0x7fe20c009040 comp rx=0 tx=0).stop 2023-10-06T11:19:17.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.826+0000 7fe222346700 1 -- 172.21.15.146:0/1461704158 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe21c0b0b50 msgr2=0x7fe21c1577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:17.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.826+0000 7fe222346700 1 --2- 172.21.15.146:0/1461704158 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe21c0b0b50 0x7fe21c1577f0 secure :-1 s=READY pgs=2300 cs=0 l=1 rev1=1 crypto rx=0x7fe214007f20 tx=0x7fe214009860 comp rx=0 tx=0).stop 2023-10-06T11:19:17.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.826+0000 7fe222346700 1 -- 172.21.15.146:0/1461704158 shutdown_connections 2023-10-06T11:19:17.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.826+0000 7fe222346700 1 --2- 172.21.15.146:0/1461704158 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe1fc066f30 0x7fe1fc0693e0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.826+0000 7fe222346700 1 --2- 172.21.15.146:0/1461704158 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe21c0b0b50 0x7fe21c1577f0 unknown :-1 s=CLOSED pgs=2300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.826+0000 7fe222346700 1 --2- 172.21.15.146:0/1461704158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe21c06ed20 0x7fe21c149280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.842 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.826+0000 7fe222346700 1 --2- 172.21.15.146:0/1461704158 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe21c06f0f0 0x7fe21c166540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.826+0000 7fe222346700 1 -- 172.21.15.146:0/1461704158 >> 172.21.15.146:0/1461704158 conn(0x7fe21c0684f0 msgr2=0x7fe21c14f940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:17.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.826+0000 7fe222346700 1 -- 172.21.15.146:0/1461704158 shutdown_connections 2023-10-06T11:19:17.843 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.826+0000 7fe222346700 1 -- 172.21.15.146:0/1461704158 wait complete. 2023-10-06T11:19:17.843 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.13:0 scrub status 2023-10-06T11:19:17.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.958+0000 7f9bce676700 1 Processor -- start 2023-10-06T11:19:17.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.958+0000 7f9bce676700 1 -- start start 2023-10-06T11:19:17.963 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.959+0000 7f9bce676700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9bc8143410 0x7f9bc80b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.959+0000 7f9bce676700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9bc80b2530 0x7f9bc80b5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.959+0000 7f9bce676700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bc80cf100 con 0x7f9bc8143040 2023-10-06T11:19:17.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.959+0000 7f9bce676700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bc80b57a0 con 0x7f9bc80b2530 2023-10-06T11:19:17.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.959+0000 7f9bce676700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc80b4170 con 0x7f9bc8143410 2023-10-06T11:19:17.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.959+0000 7f9bcd674700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f9bc8143040 0x7f9bc80b1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39318/0 (socket says 172.21.15.146:39318) 2023-10-06T11:19:17.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.959+0000 7f9bcd674700 1 -- 172.21.15.146:0/2239009027 learned_addr learned my addr 172.21.15.146:0/2239009027 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:19:17.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.959+0000 7f9bcce73700 1 --2- 172.21.15.146:0/2239009027 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9bc8143410 0x7f9bc80b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.964 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.959+0000 7f9bcde75700 1 --2- 172.21.15.146:0/2239009027 >> v2:172.21.15.151:3300/0 conn(0x7f9bc80b2530 0x7f9bc80b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.959+0000 7f9bc7fff700 1 -- 172.21.15.146:0/2239009027 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1363044532 0 0) 0x7f9bc80cf100 con 0x7f9bc8143040 2023-10-06T11:19:17.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.959+0000 7f9bc7fff700 1 -- 172.21.15.146:0/2239009027 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bb0003570 con 0x7f9bc8143040 2023-10-06T11:19:17.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.960+0000 7f9bc7fff700 1 -- 172.21.15.146:0/2239009027 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2353903652 0 0) 0x7f9bb0003570 con 0x7f9bc8143040 2023-10-06T11:19:17.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.960+0000 7f9bcce73700 1 -- 172.21.15.146:0/2239009027 >> v2:172.21.15.151:3300/0 conn(0x7f9bc80b2530 msgr2=0x7f9bc80b5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:17.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.960+0000 7f9bcce73700 1 --2- 172.21.15.146:0/2239009027 >> v2:172.21.15.151:3300/0 conn(0x7f9bc80b2530 0x7f9bc80b5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.960+0000 7f9bcce73700 1 -- 172.21.15.146:0/2239009027 >> v1:172.21.15.146:6789/0 conn(0x7f9bc8143040 legacy=0x7f9bc80b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:17.965 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.960+0000 7f9bcce73700 1 -- 172.21.15.146:0/2239009027 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc80ceb30 con 0x7f9bc8143410 2023-10-06T11:19:17.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.960+0000 7f9bcce73700 1 --2- 172.21.15.146:0/2239009027 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9bc8143410 0x7f9bc80b4d20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc0098e0 tx=0x7f9bbc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5095d66ff8471d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:17.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.960+0000 7f9bc7fff700 1 -- 172.21.15.146:0/2239009027 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb80017f0 con 0x7f9bc8143410 2023-10-06T11:19:17.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.960+0000 7f9bc7fff700 1 -- 172.21.15.146:0/2239009027 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bbc011420 con 0x7f9bc8143410 2023-10-06T11:19:17.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.960+0000 7f9bc7fff700 1 -- 172.21.15.146:0/2239009027 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc0117c0 con 0x7f9bc8143410 2023-10-06T11:19:17.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.961+0000 7f9bce676700 1 -- 172.21.15.146:0/2239009027 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9bc8143410 msgr2=0x7f9bc80b4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:17.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.961+0000 7f9bce676700 1 --2- 172.21.15.146:0/2239009027 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9bc8143410 0x7f9bc80b4d20 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc0098e0 tx=0x7f9bbc0091a0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.961+0000 7f9bce676700 1 -- 172.21.15.146:0/2239009027 shutdown_connections 2023-10-06T11:19:17.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.961+0000 7f9bce676700 1 --2- 172.21.15.146:0/2239009027 >> v2:172.21.15.151:3300/0 conn(0x7f9bc80b2530 0x7f9bc80b5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.966 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.961+0000 7f9bce676700 1 --2- 172.21.15.146:0/2239009027 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9bc8143410 0x7f9bc80b4d20 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.961+0000 7f9bce676700 1 -- 172.21.15.146:0/2239009027 >> 172.21.15.146:0/2239009027 conn(0x7f9bc806eb10 msgr2=0x7f9bc806ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:17.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.961+0000 7f9bce676700 1 -- 172.21.15.146:0/2239009027 shutdown_connections 2023-10-06T11:19:17.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.961+0000 7f9bce676700 1 -- 172.21.15.146:0/2239009027 wait complete. 2023-10-06T11:19:17.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.962+0000 7f9bce676700 1 Processor -- start 2023-10-06T11:19:17.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.962+0000 7f9bce676700 1 -- start start 2023-10-06T11:19:17.980 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.963+0000 7f9bce676700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9bc80b2530 0x7f9bc815a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.963+0000 7f9bce676700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bc8143040 0x7f9bc80d0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.963+0000 7f9bce676700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9bc8143410 0x7f9bc815df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.963+0000 7f9bce676700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc815b4b0 con 0x7f9bc8143040 2023-10-06T11:19:17.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.963+0000 7f9bce676700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc8159fa0 con 0x7f9bc8143410 2023-10-06T11:19:17.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.963+0000 7f9bce676700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc815a8a0 con 0x7f9bc80b2530 2023-10-06T11:19:17.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.963+0000 7f9bcce73700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bc8143040 0x7f9bc80d0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.963+0000 7f9bcce73700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bc8143040 0x7f9bc80d0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43258/0 (socket says 172.21.15.146:43258) 2023-10-06T11:19:17.981 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.963+0000 7f9bcce73700 1 -- 172.21.15.146:0/3720971139 learned_addr learned my addr 172.21.15.146:0/3720971139 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:17.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.963+0000 7f9bcd674700 1 --2- 172.21.15.146:0/3720971139 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9bc80b2530 0x7f9bc815a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.963+0000 7f9bcde75700 1 --2- 172.21.15.146:0/3720971139 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9bc8143410 0x7f9bc815df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.963+0000 7f9bcce73700 1 -- 172.21.15.146:0/3720971139 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9bc80b2530 msgr2=0x7f9bc815a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:17.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.963+0000 7f9bcce73700 1 --2- 172.21.15.146:0/3720971139 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9bc80b2530 0x7f9bc815a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.963+0000 7f9bcce73700 1 -- 172.21.15.146:0/3720971139 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9bc8143410 msgr2=0x7f9bc815df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:17.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.963+0000 7f9bcce73700 1 --2- 172.21.15.146:0/3720971139 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9bc8143410 0x7f9bc815df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.963+0000 7f9bcce73700 1 -- 172.21.15.146:0/3720971139 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bbc009420 con 0x7f9bc8143040 2023-10-06T11:19:17.982 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.963+0000 7f9bcce73700 1 --2- 172.21.15.146:0/3720971139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bc8143040 0x7f9bc80d0770 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc0030c0 tx=0x7f9bbc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:17.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.963+0000 7f9bc57fa700 1 -- 172.21.15.146:0/3720971139 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc01cb30 con 0x7f9bc8143040 2023-10-06T11:19:17.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.963+0000 7f9bce676700 1 -- 172.21.15.146:0/3720971139 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bc815ab80 con 0x7f9bc8143040 2023-10-06T11:19:17.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.963+0000 7f9bc57fa700 1 -- 172.21.15.146:0/3720971139 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bbc01cc90 con 0x7f9bc8143040 2023-10-06T11:19:17.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.963+0000 7f9bc57fa700 1 -- 172.21.15.146:0/3720971139 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc01a6a0 con 0x7f9bc8143040 2023-10-06T11:19:17.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.963+0000 7f9bce676700 1 -- 172.21.15.146:0/3720971139 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bc815b140 con 0x7f9bc8143040 2023-10-06T11:19:17.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.965+0000 7f9bc57fa700 1 -- 172.21.15.146:0/3720971139 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9bbc01aad0 con 0x7f9bc8143040 2023-10-06T11:19:17.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.965+0000 7f9bc57fa700 1 --2- 172.21.15.146:0/3720971139 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9bb4066f30 0x7f9bb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.965+0000 7f9bc57fa700 1 -- 172.21.15.146:0/3720971139 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f9bbc085f10 con 0x7f9bc8143040 2023-10-06T11:19:17.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.965+0000 7f9bcd674700 1 --2- 172.21.15.146:0/3720971139 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9bb4066f30 0x7f9bb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.966+0000 7f9bcd674700 1 --2- 172.21.15.146:0/3720971139 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9bb4066f30 0x7f9bb40693e0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8001560 tx=0x7f9bb8001640 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:17.983 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.967+0000 7f9bd8bd0b80 1 Processor -- start 2023-10-06T11:19:17.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.967+0000 7f9bd8bd0b80 1 -- start start 2023-10-06T11:19:17.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.968+0000 7f9bd8bd0b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5578d5f1f9a0 0x5578d5f1fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.968+0000 7f9bd8bd0b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5578d5f69c10 0x5578d5f48970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.968+0000 7f9bd8bd0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578d5f48eb0 0x5578d5f1b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.968+0000 7f9bd8bd0b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578d5e9fcd0 con 0x5578d5f69c10 2023-10-06T11:19:17.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.968+0000 7f9bd8bd0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578d5e76ac0 con 0x5578d5f48eb0 2023-10-06T11:19:17.984 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.968+0000 7f9bd8bd0b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5578d5e742c0 con 0x5578d5f1f9a0 2023-10-06T11:19:17.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.968+0000 7f9bcce73700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5578d5f69c10 0x5578d5f48970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.968+0000 7f9bcce73700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5578d5f69c10 0x5578d5f48970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43262/0 (socket says 172.21.15.146:43262) 2023-10-06T11:19:17.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.968+0000 7f9bcce73700 1 -- 172.21.15.146:0/3828648134 learned_addr learned my addr 172.21.15.146:0/3828648134 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:17.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.968+0000 7f9bcce73700 1 -- 172.21.15.146:0/3828648134 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5578d5f1f9a0 msgr2=0x5578d5f1fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:17.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.968+0000 7f9bcd674700 1 --2- 172.21.15.146:0/3828648134 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5578d5f1f9a0 0x5578d5f1fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.985 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.968+0000 7f9bcde75700 1 --2- 172.21.15.146:0/3828648134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578d5f48eb0 0x5578d5f1b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.968+0000 7f9bcce73700 1 --2- 172.21.15.146:0/3828648134 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5578d5f1f9a0 0x5578d5f1fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.968+0000 7f9bcce73700 1 -- 172.21.15.146:0/3828648134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578d5f48eb0 msgr2=0x5578d5f1b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:17.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.968+0000 7f9bcce73700 1 --2- 172.21.15.146:0/3828648134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578d5f48eb0 0x5578d5f1b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.968+0000 7f9bcce73700 1 -- 172.21.15.146:0/3828648134 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5578d5d0a2c0 con 0x5578d5f69c10 2023-10-06T11:19:17.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.968+0000 7f9bcde75700 1 --2- 172.21.15.146:0/3828648134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578d5f48eb0 0x5578d5f1b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:19:17.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.968+0000 7f9bcd674700 1 --2- 172.21.15.146:0/3828648134 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5578d5f1f9a0 0x5578d5f1fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:19:17.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.968+0000 7f9bcce73700 1 --2- 172.21.15.146:0/3828648134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5578d5f69c10 0x5578d5f48970 secure :-1 s=READY pgs=2307 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc084280 tx=0x7f9bbc0841e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0b0e8d01a498526 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:17.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.969+0000 7f9bae7fc700 1 -- 172.21.15.146:0/3828648134 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc057390 con 0x5578d5f69c10 2023-10-06T11:19:17.986 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.969+0000 7f9bae7fc700 1 -- 172.21.15.146:0/3828648134 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bbc056c90 con 0x5578d5f69c10 2023-10-06T11:19:17.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.969+0000 7f9bae7fc700 1 -- 172.21.15.146:0/3828648134 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc059ee0 con 0x5578d5f69c10 2023-10-06T11:19:17.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.969+0000 7f9bd8bd0b80 1 -- 172.21.15.146:0/3828648134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5578d5f69c10 msgr2=0x5578d5f48970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:17.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.969+0000 7f9bd8bd0b80 1 --2- 172.21.15.146:0/3828648134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5578d5f69c10 0x5578d5f48970 secure :-1 s=READY pgs=2307 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc084280 tx=0x7f9bbc0841e0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.969+0000 7f9bd8bd0b80 1 -- 172.21.15.146:0/3828648134 shutdown_connections 2023-10-06T11:19:17.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.969+0000 7f9bd8bd0b80 1 --2- 172.21.15.146:0/3828648134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578d5f48eb0 0x5578d5f1b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.969+0000 7f9bd8bd0b80 1 --2- 172.21.15.146:0/3828648134 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5578d5f1f9a0 0x5578d5f1fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.969+0000 7f9bd8bd0b80 1 --2- 172.21.15.146:0/3828648134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5578d5f69c10 0x5578d5f48970 unknown :-1 s=CLOSED pgs=2307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.969+0000 7f9bd8bd0b80 1 -- 172.21.15.146:0/3828648134 >> 172.21.15.146:0/3828648134 conn(0x5578d5f212c0 msgr2=0x5578d5f21690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:17.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.969+0000 7f9bd8bd0b80 1 -- 172.21.15.146:0/3828648134 shutdown_connections 2023-10-06T11:19:17.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.969+0000 7f9bd8bd0b80 1 -- 172.21.15.146:0/3828648134 wait complete. 2023-10-06T11:19:17.987 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.970+0000 7f9bd8bd0b80 1 -- start start 2023-10-06T11:19:17.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.970+0000 7f9bd8bd0b80 1 Processor -- start 2023-10-06T11:19:17.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.971+0000 7f9bd8bd0b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5578d5f1f9a0 0x5578d5f75c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.971+0000 7f9bd8bd0b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5578d5f48eb0 0x5578d5f79d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.971+0000 7f9bd8bd0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578d5f69c10 0x5578d5f44ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.971+0000 7f9bd8bd0b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578d5e700b0 con 0x5578d5f1f9a0 2023-10-06T11:19:17.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.971+0000 7f9bd8bd0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578d5e1b8e0 con 0x5578d5f69c10 2023-10-06T11:19:17.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.971+0000 7f9bd8bd0b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5578d5e36ef0 con 0x5578d5f48eb0 2023-10-06T11:19:17.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.971+0000 7f9bd8bd0b80 10 client.0 _ll_register_callbacks cb 0x5578d5d0cf80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:19:17.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.971+0000 7f9bcd674700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5578d5f1f9a0 0x5578d5f75c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.971+0000 7f9bcd674700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5578d5f1f9a0 0x5578d5f75c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43264/0 (socket says 172.21.15.146:43264) 2023-10-06T11:19:17.988 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.971+0000 7f9bcd674700 1 -- 172.21.15.146:0/1279184681 learned_addr learned my addr 172.21.15.146:0/1279184681 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:17.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.971+0000 7f9bcce73700 1 --2- 172.21.15.146:0/1279184681 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5578d5f48eb0 0x5578d5f79d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.971+0000 7f9bcd674700 1 -- 172.21.15.146:0/1279184681 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5578d5f48eb0 msgr2=0x5578d5f79d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:17.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.971+0000 7f9bcd674700 1 --2- 172.21.15.146:0/1279184681 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5578d5f48eb0 0x5578d5f79d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.971+0000 7f9bcd674700 1 -- 172.21.15.146:0/1279184681 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578d5f69c10 msgr2=0x5578d5f44ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:17.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.971+0000 7f9bcde75700 1 --2- 172.21.15.146:0/1279184681 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578d5f69c10 0x5578d5f44ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.971+0000 7f9bcd674700 1 --2- 172.21.15.146:0/1279184681 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578d5f69c10 0x5578d5f44ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.971+0000 7f9bcd674700 1 -- 172.21.15.146:0/1279184681 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bc815b140 con 0x5578d5f1f9a0 2023-10-06T11:19:17.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.971+0000 7f9bcd674700 1 --2- 172.21.15.146:0/1279184681 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5578d5f1f9a0 0x5578d5f75c50 secure :-1 s=READY pgs=2308 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8013bd0 tx=0x7f9bb8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6a179c0cbfe71d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:17.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.971+0000 7f9ba77fe700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:19:17.989 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.971+0000 7f9ba77fe700 1 -- 172.21.15.146:0/1279184681 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb8012760 con 0x5578d5f1f9a0 2023-10-06T11:19:17.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.971+0000 7f9ba77fe700 1 -- 172.21.15.146:0/1279184681 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(178..178 src has 1..178) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f9bb801b040 con 0x5578d5f1f9a0 2023-10-06T11:19:17.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.971+0000 7f9bd8bd0b80 1 -- 172.21.15.146:0/1279184681 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5578d5f146e0 con 0x5578d5f1f9a0 2023-10-06T11:19:17.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.972+0000 7f9ba77fe700 1 -- 172.21.15.146:0/1279184681 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=150) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9bb8021e70 con 0x5578d5f1f9a0 2023-10-06T11:19:17.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.972+0000 7f9bd8bd0b80 10 client.10782 fetch_fsmap learned FSMap version 150 2023-10-06T11:19:17.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.972+0000 7f9bd8bd0b80 1 -- 172.21.15.146:0/1279184681 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=150,monmap=2+}) v3 -- 0x5578d5cad030 con 0x5578d5f1f9a0 2023-10-06T11:19:17.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.972+0000 7f9ba77fe700 1 -- 172.21.15.146:0/1279184681 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5578d5f146e0 con 0x5578d5f1f9a0 2023-10-06T11:19:17.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.972+0000 7f9ba77fe700 1 -- 172.21.15.146:0/1279184681 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 150) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9bb80128c0 con 0x5578d5f1f9a0 2023-10-06T11:19:17.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.972+0000 7f9bd8bd0b80 10 client.10782 fetch_fsmap finished waiting for FSMap version 150 2023-10-06T11:19:17.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.972+0000 7f9bd8bd0b80 10 client.10782 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2023-10-06T11:19:17.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.972+0000 7f9bd8bd0b80 20 client.10782 populate_metadata read hostname 'smithi146' 2023-10-06T11:19:17.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.972+0000 7f9bd8bd0b80 1 --2- 172.21.15.146:0/1279184681 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x5578d5f166e0 0x5578d5f635d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:17.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.972+0000 7f9bd8bd0b80 4 client.10782 mds_command: new command op to 10461 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:19:17.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.972+0000 7f9bd8bd0b80 1 -- 172.21.15.146:0/1279184681 --> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5578d5ef1610 con 0x5578d5f166e0 2023-10-06T11:19:17.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.972+0000 7f9bcce73700 1 --2- 172.21.15.146:0/1279184681 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x5578d5f166e0 0x5578d5f635d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:17.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.972+0000 7f9ba77fe700 10 client.10782 ms_handle_connect on v2:172.21.15.146:6835/2322816938 2023-10-06T11:19:17.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.972+0000 7f9bcce73700 1 --2- 172.21.15.146:0/1279184681 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x5578d5f166e0 0x5578d5f635d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18e15f8d050b20ee server_cookie=b095dd173b776ff8 in_seq=0 out_seq=0 2023-10-06T11:19:17.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.973+0000 7f9ba77fe700 1 -- 172.21.15.146:0/1279184681 <== mds.0 v2:172.21.15.146:6835/2322816938 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5578d5ef1610 con 0x5578d5f166e0 2023-10-06T11:19:17.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.973+0000 7f9ba77fe700 10 client.10782 handle_command_reply: tid=0 2023-10-06T11:19:17.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.973+0000 7f9bd8bd0b80 1 client.10782 shutdown 2023-10-06T11:19:17.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.973+0000 7f9bd8bd0b80 1 -- 172.21.15.146:0/1279184681 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5578d5f1f9a0 msgr2=0x5578d5f75c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:17.992 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.973+0000 7f9bd8bd0b80 1 --2- 172.21.15.146:0/1279184681 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5578d5f1f9a0 0x5578d5f75c50 secure :-1 s=READY pgs=2308 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8013bd0 tx=0x7f9bb8014000 comp rx=0 tx=0).stop 2023-10-06T11:19:17.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.973+0000 7f9bd8bd0b80 1 -- 172.21.15.146:0/1279184681 shutdown_connections 2023-10-06T11:19:17.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.973+0000 7f9bd8bd0b80 1 --2- 172.21.15.146:0/1279184681 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x5578d5f166e0 0x5578d5f635d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.973+0000 7f9bd8bd0b80 1 --2- 172.21.15.146:0/1279184681 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578d5f69c10 0x5578d5f44ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.973+0000 7f9bd8bd0b80 1 --2- 172.21.15.146:0/1279184681 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5578d5f1f9a0 0x5578d5f75c50 unknown :-1 s=CLOSED pgs=2308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.973+0000 7f9ba77fe700 0 client.10782 ms_handle_reset on v2:172.21.15.146:6835/2322816938 2023-10-06T11:19:17.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.973+0000 7f9bd8bd0b80 1 --2- 172.21.15.146:0/1279184681 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5578d5f48eb0 0x5578d5f79d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:17.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.973+0000 7f9bd8bd0b80 1 -- 172.21.15.146:0/1279184681 >> 172.21.15.146:0/1279184681 conn(0x5578d5f212c0 msgr2=0x5578d5f45840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:17.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.973+0000 7f9bd8bd0b80 1 -- 172.21.15.146:0/1279184681 shutdown_connections 2023-10-06T11:19:17.993 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.973+0000 7f9bd8bd0b80 1 -- 172.21.15.146:0/1279184681 wait complete. 2023-10-06T11:19:17.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.973+0000 7f9bd8bd0b80 20 client.10782 trim_cache size 0 max 16384 2023-10-06T11:19:18.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.989+0000 7f9bd8bd0b80 1 Processor -- start 2023-10-06T11:19:18.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.989+0000 7f9bd8bd0b80 1 -- start start 2023-10-06T11:19:18.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.990+0000 7f9bd8bd0b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5578d5f1f9a0 0x5578d5f1fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:18.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.990+0000 7f9bd8bd0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578d5f48eb0 0x5578d5f202b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:18.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.990+0000 7f9bd8bd0b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5578d5f69c10 0x5578d5f6a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:18.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.990+0000 7f9bd8bd0b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578d5cf2e80 con 0x5578d5f1f9a0 2023-10-06T11:19:18.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.990+0000 7f9bd8bd0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578d5f47f50 con 0x5578d5f48eb0 2023-10-06T11:19:18.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.990+0000 7f9bd8bd0b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5578d5eff080 con 0x5578d5f69c10 2023-10-06T11:19:18.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.990+0000 7f9bcd674700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5578d5f1f9a0 0x5578d5f1fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:18.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.990+0000 7f9bcd674700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5578d5f1f9a0 0x5578d5f1fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43276/0 (socket says 172.21.15.146:43276) 2023-10-06T11:19:18.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.990+0000 7f9bcd674700 1 -- 172.21.15.146:0/3221920978 learned_addr learned my addr 172.21.15.146:0/3221920978 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:18.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.990+0000 7f9bcde75700 1 --2- 172.21.15.146:0/3221920978 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5578d5f69c10 0x5578d5f6a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:18.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.990+0000 7f9bcce73700 1 --2- 172.21.15.146:0/3221920978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578d5f48eb0 0x5578d5f202b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:18.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.990+0000 7f9bcd674700 1 -- 172.21.15.146:0/3221920978 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5578d5f69c10 msgr2=0x5578d5f6a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:18.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.990+0000 7f9bcd674700 1 --2- 172.21.15.146:0/3221920978 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5578d5f69c10 0x5578d5f6a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:18.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.990+0000 7f9bcd674700 1 -- 172.21.15.146:0/3221920978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578d5f48eb0 msgr2=0x5578d5f202b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:18.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.990+0000 7f9bcd674700 1 --2- 172.21.15.146:0/3221920978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578d5f48eb0 0x5578d5f202b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:18.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.990+0000 7f9bcd674700 1 -- 172.21.15.146:0/3221920978 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5578d5f5f050 con 0x5578d5f1f9a0 2023-10-06T11:19:18.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.990+0000 7f9bcde75700 1 --2- 172.21.15.146:0/3221920978 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5578d5f69c10 0x5578d5f6a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:19:18.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.990+0000 7f9bcce73700 1 --2- 172.21.15.146:0/3221920978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578d5f48eb0 0x5578d5f202b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:19:18.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.990+0000 7f9bcd674700 1 --2- 172.21.15.146:0/3221920978 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5578d5f1f9a0 0x5578d5f1fd70 secure :-1 s=READY pgs=2309 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8004fd0 tx=0x7f9bb8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bdaf2aab7781511 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:18.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.991+0000 7f9baeffd700 1 -- 172.21.15.146:0/3221920978 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb8021e70 con 0x5578d5f1f9a0 2023-10-06T11:19:18.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.991+0000 7f9baeffd700 1 -- 172.21.15.146:0/3221920978 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb800b040 con 0x5578d5f1f9a0 2023-10-06T11:19:18.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.991+0000 7f9baeffd700 1 -- 172.21.15.146:0/3221920978 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb8012e20 con 0x5578d5f1f9a0 2023-10-06T11:19:18.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.991+0000 7f9bd8bd0b80 1 -- 172.21.15.146:0/3221920978 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5578d5f1f9a0 msgr2=0x5578d5f1fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:18.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.991+0000 7f9bd8bd0b80 1 --2- 172.21.15.146:0/3221920978 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5578d5f1f9a0 0x5578d5f1fd70 secure :-1 s=READY pgs=2309 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8004fd0 tx=0x7f9bb8019000 comp rx=0 tx=0).stop 2023-10-06T11:19:18.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.991+0000 7f9bd8bd0b80 1 -- 172.21.15.146:0/3221920978 shutdown_connections 2023-10-06T11:19:18.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.991+0000 7f9bd8bd0b80 1 --2- 172.21.15.146:0/3221920978 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5578d5f69c10 0x5578d5f6a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:18.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.991+0000 7f9bd8bd0b80 1 --2- 172.21.15.146:0/3221920978 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5578d5f1f9a0 0x5578d5f1fd70 unknown :-1 s=CLOSED pgs=2309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:18.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.991+0000 7f9bd8bd0b80 1 --2- 172.21.15.146:0/3221920978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578d5f48eb0 0x5578d5f202b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:18.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.991+0000 7f9bd8bd0b80 1 -- 172.21.15.146:0/3221920978 >> 172.21.15.146:0/3221920978 conn(0x5578d5f212c0 msgr2=0x5578d5f1d980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:18.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.991+0000 7f9bd8bd0b80 1 -- 172.21.15.146:0/3221920978 shutdown_connections 2023-10-06T11:19:18.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.991+0000 7f9bd8bd0b80 1 -- 172.21.15.146:0/3221920978 wait complete. 2023-10-06T11:19:18.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.992+0000 7f9bd8bd0b80 1 -- start start 2023-10-06T11:19:18.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.992+0000 7f9bd8bd0b80 1 Processor -- start 2023-10-06T11:19:18.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.993+0000 7f9bd8bd0b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5578d5f1f9a0 0x5578d5fcb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:18.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.993+0000 7f9bd8bd0b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5578d5f48eb0 0x5578d5f6a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:18.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.993+0000 7f9bd8bd0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578d5f69c10 0x5578d5f6a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:18.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.993+0000 7f9bd8bd0b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578d5f82d10 con 0x5578d5f1f9a0 2023-10-06T11:19:18.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.993+0000 7f9bd8bd0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578d5f826c0 con 0x5578d5f69c10 2023-10-06T11:19:18.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.993+0000 7f9bd8bd0b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5578d5f829a0 con 0x5578d5f48eb0 2023-10-06T11:19:18.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.993+0000 7f9bd8bd0b80 10 client.0 _ll_register_callbacks cb 0x5578d5d0cf80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:19:18.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.993+0000 7f9bcd674700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5578d5f1f9a0 0x5578d5fcb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:18.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.993+0000 7f9bcd674700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5578d5f1f9a0 0x5578d5fcb6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:43282/0 (socket says 172.21.15.146:43282) 2023-10-06T11:19:18.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.993+0000 7f9bcd674700 1 -- 172.21.15.146:0/3438900218 learned_addr learned my addr 172.21.15.146:0/3438900218 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:18.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.993+0000 7f9bcce73700 1 --2- 172.21.15.146:0/3438900218 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5578d5f48eb0 0x5578d5f6a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:18.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.993+0000 7f9bcde75700 1 --2- 172.21.15.146:0/3438900218 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578d5f69c10 0x5578d5f6a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:18.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.993+0000 7f9bcd674700 1 -- 172.21.15.146:0/3438900218 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5578d5f48eb0 msgr2=0x5578d5f6a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:18.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.993+0000 7f9bcd674700 1 --2- 172.21.15.146:0/3438900218 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5578d5f48eb0 0x5578d5f6a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:18.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.993+0000 7f9bcd674700 1 -- 172.21.15.146:0/3438900218 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578d5f69c10 msgr2=0x5578d5f6a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:18.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.993+0000 7f9bcd674700 1 --2- 172.21.15.146:0/3438900218 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578d5f69c10 0x5578d5f6a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:18.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.993+0000 7f9bcd674700 1 -- 172.21.15.146:0/3438900218 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5578d5cad030 con 0x5578d5f1f9a0 2023-10-06T11:19:18.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.993+0000 7f9bcd674700 1 --2- 172.21.15.146:0/3438900218 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5578d5f1f9a0 0x5578d5fcb6a0 secure :-1 s=READY pgs=2310 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8008fd0 tx=0x7f9bb8033000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34016b2fc2434485 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:18.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.993+0000 7f9ba77fe700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:19:18.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.993+0000 7f9ba77fe700 1 -- 172.21.15.146:0/3438900218 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb802c430 con 0x5578d5f1f9a0 2023-10-06T11:19:18.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.993+0000 7f9ba77fe700 1 -- 172.21.15.146:0/3438900218 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(178..178 src has 1..178) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f9bb803fc90 con 0x5578d5f1f9a0 2023-10-06T11:19:18.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.993+0000 7f9bd8bd0b80 1 -- 172.21.15.146:0/3438900218 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9bbc056c90 con 0x5578d5f1f9a0 2023-10-06T11:19:18.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.994+0000 7f9ba77fe700 1 -- 172.21.15.146:0/3438900218 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=150) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9bb803fe70 con 0x5578d5f1f9a0 2023-10-06T11:19:18.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.994+0000 7f9bd8bd0b80 10 client.10788 fetch_fsmap learned FSMap version 150 2023-10-06T11:19:18.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.994+0000 7f9bd8bd0b80 1 -- 172.21.15.146:0/3438900218 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=150,monmap=2+}) v3 -- 0x5578d5e3e7d0 con 0x5578d5f1f9a0 2023-10-06T11:19:18.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.994+0000 7f9ba77fe700 1 -- 172.21.15.146:0/3438900218 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bbc056c90 con 0x5578d5f1f9a0 2023-10-06T11:19:18.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.994+0000 7f9ba77fe700 1 -- 172.21.15.146:0/3438900218 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 150) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9bb8045020 con 0x5578d5f1f9a0 2023-10-06T11:19:18.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.994+0000 7f9bd8bd0b80 10 client.10788 fetch_fsmap finished waiting for FSMap version 150 2023-10-06T11:19:18.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.994+0000 7f9bd8bd0b80 10 client.10788 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2023-10-06T11:19:18.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.994+0000 7f9bd8bd0b80 20 client.10788 populate_metadata read hostname 'smithi146' 2023-10-06T11:19:18.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.994+0000 7f9bd8bd0b80 1 --2- 172.21.15.146:0/3438900218 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x5578d5f5c470 0x5578d5f831a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:18.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.994+0000 7f9bd8bd0b80 4 client.10788 mds_command: new command op to 10461 tid=0[{"prefix": "scrub status"}] 2023-10-06T11:19:18.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.994+0000 7f9bd8bd0b80 1 -- 172.21.15.146:0/3438900218 --> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5578d5e12e50 con 0x5578d5f5c470 2023-10-06T11:19:18.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.994+0000 7f9bcce73700 1 --2- 172.21.15.146:0/3438900218 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x5578d5f5c470 0x5578d5f831a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:18.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.994+0000 7f9ba77fe700 10 client.10788 ms_handle_connect on v2:172.21.15.146:6835/2322816938 2023-10-06T11:19:18.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.994+0000 7f9bcce73700 1 --2- 172.21.15.146:0/3438900218 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x5578d5f5c470 0x5578d5f831a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef70393723bb76a3 server_cookie=53515a6c36cb04ed in_seq=0 out_seq=0 2023-10-06T11:19:18.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.994+0000 7f9ba77fe700 1 -- 172.21.15.146:0/3438900218 <== mds.0 v2:172.21.15.146:6835/2322816938 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+260 (crc 0 0 0) 0x5578d5e12e50 con 0x5578d5f5c470 2023-10-06T11:19:18.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.994+0000 7f9ba77fe700 10 client.10788 handle_command_reply: tid=0 2023-10-06T11:19:18.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.994+0000 7f9bd8bd0b80 1 client.10788 shutdown 2023-10-06T11:19:18.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.995+0000 7f9bd8bd0b80 1 -- 172.21.15.146:0/3438900218 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5578d5f1f9a0 msgr2=0x5578d5fcb6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:18.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.995+0000 7f9bd8bd0b80 1 --2- 172.21.15.146:0/3438900218 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5578d5f1f9a0 0x5578d5fcb6a0 secure :-1 s=READY pgs=2310 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8008fd0 tx=0x7f9bb8033000 comp rx=0 tx=0).stop 2023-10-06T11:19:18.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.995+0000 7f9bd8bd0b80 1 -- 172.21.15.146:0/3438900218 shutdown_connections 2023-10-06T11:19:18.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.995+0000 7f9bd8bd0b80 1 --2- 172.21.15.146:0/3438900218 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x5578d5f5c470 0x5578d5f831a0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:18.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.995+0000 7f9bd8bd0b80 1 --2- 172.21.15.146:0/3438900218 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578d5f69c10 0x5578d5f6a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:18.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.995+0000 7f9bd8bd0b80 1 --2- 172.21.15.146:0/3438900218 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5578d5f1f9a0 0x5578d5fcb6a0 unknown :-1 s=CLOSED pgs=2310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:18.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.995+0000 7f9bd8bd0b80 1 --2- 172.21.15.146:0/3438900218 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5578d5f48eb0 0x5578d5f6a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:18.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.995+0000 7f9bd8bd0b80 1 -- 172.21.15.146:0/3438900218 >> 172.21.15.146:0/3438900218 conn(0x5578d5f212c0 msgr2=0x5578d5f21f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:18.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.995+0000 7f9ba77fe700 0 client.10788 ms_handle_reset on v2:172.21.15.146:6835/2322816938 2023-10-06T11:19:18.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.995+0000 7f9bd8bd0b80 1 -- 172.21.15.146:0/3438900218 shutdown_connections 2023-10-06T11:19:18.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.995+0000 7f9bd8bd0b80 1 -- 172.21.15.146:0/3438900218 wait complete. 2023-10-06T11:19:18.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.995+0000 7f9bd8bd0b80 20 client.10788 trim_cache size 0 max 16384 2023-10-06T11:19:18.008 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:19:18.008 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-06T11:19:18.008 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": { 2023-10-06T11:19:18.008 INFO:teuthology.orchestra.run.smithi146.stdout: "e9c47bb8-df91-4e4e-8536-fcdb2a389cee": { 2023-10-06T11:19:18.008 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/", 2023-10-06T11:19:18.008 INFO:teuthology.orchestra.run.smithi146.stdout: "tag": "e9c47bb8-df91-4e4e-8536-fcdb2a389cee", 2023-10-06T11:19:18.008 INFO:teuthology.orchestra.run.smithi146.stdout: "options": "recursive,repair" 2023-10-06T11:19:18.009 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:19:18.009 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:19:18.009 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:19:18.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.995+0000 7f9bce676700 1 -- 172.21.15.146:0/3720971139 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9bb4066f30 msgr2=0x7f9bb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:18.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.995+0000 7f9bce676700 1 --2- 172.21.15.146:0/3720971139 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9bb4066f30 0x7f9bb40693e0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8001560 tx=0x7f9bb8001640 comp rx=0 tx=0).stop 2023-10-06T11:19:18.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.995+0000 7f9bce676700 1 -- 172.21.15.146:0/3720971139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bc8143040 msgr2=0x7f9bc80d0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:18.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.995+0000 7f9bce676700 1 --2- 172.21.15.146:0/3720971139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bc8143040 0x7f9bc80d0770 secure :-1 s=READY pgs=2306 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc0030c0 tx=0x7f9bbc016000 comp rx=0 tx=0).stop 2023-10-06T11:19:18.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.995+0000 7f9bce676700 1 -- 172.21.15.146:0/3720971139 shutdown_connections 2023-10-06T11:19:18.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.995+0000 7f9bce676700 1 --2- 172.21.15.146:0/3720971139 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9bb4066f30 0x7f9bb40693e0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:18.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.995+0000 7f9bce676700 1 --2- 172.21.15.146:0/3720971139 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9bc8143410 0x7f9bc815df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:18.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.995+0000 7f9bce676700 1 --2- 172.21.15.146:0/3720971139 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9bc80b2530 0x7f9bc815a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:18.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.995+0000 7f9bce676700 1 --2- 172.21.15.146:0/3720971139 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9bc8143040 0x7f9bc80d0770 unknown :-1 s=CLOSED pgs=2306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:18.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.995+0000 7f9bce676700 1 -- 172.21.15.146:0/3720971139 >> 172.21.15.146:0/3720971139 conn(0x7f9bc806eb10 msgr2=0x7f9bc80cf590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:18.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.995+0000 7f9bce676700 1 -- 172.21.15.146:0/3720971139 shutdown_connections 2023-10-06T11:19:18.011 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:17.995+0000 7f9bce676700 1 -- 172.21.15.146:0/3720971139 wait complete. 2023-10-06T11:19:18.011 INFO:tasks.cephfs.filesystem:scrub status for tag:e9c47bb8-df91-4e4e-8536-fcdb2a389cee - {'path': '/', 'tag': 'e9c47bb8-df91-4e4e-8536-fcdb2a389cee', 'options': 'recursive,repair'} 2023-10-06T11:19:21.797 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:19:21.800 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:19:48.013 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.13:0 scrub status 2023-10-06T11:19:48.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.138+0000 7f1901107700 1 Processor -- start 2023-10-06T11:19:48.141 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.139+0000 7f1901107700 1 -- start start 2023-10-06T11:19:48.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.139+0000 7f1901107700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f18fc155960 0x7f18fc0c9540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.139+0000 7f1901107700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18fc1561d0 0x7f18fc0afe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.139+0000 7f1901107700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18fc0c9a80 con 0x7f18fc155d30 2023-10-06T11:19:48.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.139+0000 7f1901107700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18fc0b21a0 con 0x7f18fc155960 2023-10-06T11:19:48.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.139+0000 7f1901107700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18fc0ca8c0 con 0x7f18fc1561d0 2023-10-06T11:19:48.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.140+0000 7f18fb59e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18fc1561d0 0x7f18fc0afe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.140+0000 7f18fad9d700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f18fc155960 0x7f18fc0c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.140+0000 7f18f259c700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f18fc155d30 0x7f18fc0af6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:59158/0 (socket says 172.21.15.146:59158) 2023-10-06T11:19:48.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.140+0000 7f18f259c700 1 -- 172.21.15.146:0/2273099943 learned_addr learned my addr 172.21.15.146:0/2273099943 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:19:48.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.140+0000 7f18fb59e700 1 -- 172.21.15.146:0/2273099943 >> v2:172.21.15.151:3300/0 conn(0x7f18fc155960 msgr2=0x7f18fc0c9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:48.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.140+0000 7f18fb59e700 1 --2- 172.21.15.146:0/2273099943 >> v2:172.21.15.151:3300/0 conn(0x7f18fc155960 0x7f18fc0c9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.140+0000 7f18fb59e700 1 -- 172.21.15.146:0/2273099943 >> v1:172.21.15.151:6789/0 conn(0x7f18fc155d30 legacy=0x7f18fc0af6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:48.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.140+0000 7f18fb59e700 1 -- 172.21.15.146:0/2273099943 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18fc0c9cb0 con 0x7f18fc1561d0 2023-10-06T11:19:48.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.140+0000 7f18fa59c700 1 -- 172.21.15.146:0/2273099943 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2807199659 0 0) 0x7f18fc0c9a80 con 0x7f18fc155d30 2023-10-06T11:19:48.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.140+0000 7f18fad9d700 1 --2- 172.21.15.146:0/2273099943 >> v2:172.21.15.151:3300/0 conn(0x7f18fc155960 0x7f18fc0c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:19:48.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.140+0000 7f18fb59e700 1 --2- 172.21.15.146:0/2273099943 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18fc1561d0 0x7f18fc0afe00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f18f4009e60 tx=0x7f18f4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d1226a0f1044f7b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:48.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.141+0000 7f18fa59c700 1 -- 172.21.15.146:0/2273099943 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f400e070 con 0x7f18fc1561d0 2023-10-06T11:19:48.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.141+0000 7f18fa59c700 1 -- 172.21.15.146:0/2273099943 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f400bb60 con 0x7f18fc1561d0 2023-10-06T11:19:48.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.141+0000 7f18fa59c700 1 -- 172.21.15.146:0/2273099943 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f4012430 con 0x7f18fc1561d0 2023-10-06T11:19:48.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.141+0000 7f1901107700 1 -- 172.21.15.146:0/2273099943 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18fc1561d0 msgr2=0x7f18fc0afe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:48.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.141+0000 7f1901107700 1 --2- 172.21.15.146:0/2273099943 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18fc1561d0 0x7f18fc0afe00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f18f4009e60 tx=0x7f18f4009780 comp rx=0 tx=0).stop 2023-10-06T11:19:48.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.141+0000 7f1901107700 1 -- 172.21.15.146:0/2273099943 shutdown_connections 2023-10-06T11:19:48.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.141+0000 7f1901107700 1 --2- 172.21.15.146:0/2273099943 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18fc1561d0 0x7f18fc0afe00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.141+0000 7f1901107700 1 --2- 172.21.15.146:0/2273099943 >> v2:172.21.15.151:3300/0 conn(0x7f18fc155960 0x7f18fc0c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.141+0000 7f1901107700 1 -- 172.21.15.146:0/2273099943 >> 172.21.15.146:0/2273099943 conn(0x7f18fc0673e0 msgr2=0x7f18fc0677e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:48.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.141+0000 7f1901107700 1 -- 172.21.15.146:0/2273099943 shutdown_connections 2023-10-06T11:19:48.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.141+0000 7f1901107700 1 -- 172.21.15.146:0/2273099943 wait complete. 2023-10-06T11:19:48.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.142+0000 7f1901107700 1 Processor -- start 2023-10-06T11:19:48.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.142+0000 7f1901107700 1 -- start start 2023-10-06T11:19:48.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.143+0000 7f1901107700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18fc155960 0x7f18fc0c3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.143+0000 7f1901107700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18fc155d30 0x7f18fc159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.143+0000 7f1901107700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18fc1561d0 0x7f18fc159e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.143+0000 7f1901107700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18fc0c4090 con 0x7f18fc155d30 2023-10-06T11:19:48.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.143+0000 7f1901107700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18fc0c6b80 con 0x7f18fc1561d0 2023-10-06T11:19:48.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.143+0000 7f1901107700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18fc168410 con 0x7f18fc155960 2023-10-06T11:19:48.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.143+0000 7f18f259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18fc155d30 0x7f18fc159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.143+0000 7f18f259c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18fc155d30 0x7f18fc159920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37942/0 (socket says 172.21.15.146:37942) 2023-10-06T11:19:48.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.143+0000 7f18f259c700 1 -- 172.21.15.146:0/1599365930 learned_addr learned my addr 172.21.15.146:0/1599365930 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:48.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.143+0000 7f18fad9d700 1 --2- 172.21.15.146:0/1599365930 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18fc155960 0x7f18fc0c3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.143+0000 7f18fb59e700 1 --2- 172.21.15.146:0/1599365930 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18fc1561d0 0x7f18fc159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.144+0000 7f18f259c700 1 -- 172.21.15.146:0/1599365930 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18fc155960 msgr2=0x7f18fc0c3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:48.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.144+0000 7f18f259c700 1 --2- 172.21.15.146:0/1599365930 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18fc155960 0x7f18fc0c3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.144+0000 7f18f259c700 1 -- 172.21.15.146:0/1599365930 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18fc1561d0 msgr2=0x7f18fc159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:48.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.144+0000 7f18f259c700 1 --2- 172.21.15.146:0/1599365930 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18fc1561d0 0x7f18fc159e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.144+0000 7f18f259c700 1 -- 172.21.15.146:0/1599365930 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18ec00a5d0 con 0x7f18fc155d30 2023-10-06T11:19:48.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.144+0000 7f18f259c700 1 --2- 172.21.15.146:0/1599365930 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18fc155d30 0x7f18fc159920 secure :-1 s=READY pgs=2311 cs=0 l=1 rev1=1 crypto rx=0x7f18e400c7e0 tx=0x7f18e4007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:48.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.144+0000 7f18f37fe700 1 -- 172.21.15.146:0/1599365930 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e4005b30 con 0x7f18fc155d30 2023-10-06T11:19:48.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.144+0000 7f18f37fe700 1 -- 172.21.15.146:0/1599365930 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18e4005c90 con 0x7f18fc155d30 2023-10-06T11:19:48.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.144+0000 7f1901107700 1 -- 172.21.15.146:0/1599365930 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18f4009a20 con 0x7f18fc155d30 2023-10-06T11:19:48.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.144+0000 7f18f37fe700 1 -- 172.21.15.146:0/1599365930 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18e4007300 con 0x7f18fc155d30 2023-10-06T11:19:48.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.144+0000 7f1901107700 1 -- 172.21.15.146:0/1599365930 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18fc0c6810 con 0x7f18fc155d30 2023-10-06T11:19:48.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.145+0000 7f18f37fe700 1 -- 172.21.15.146:0/1599365930 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f18e401b3b0 con 0x7f18fc155d30 2023-10-06T11:19:48.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.146+0000 7f18f37fe700 1 --2- 172.21.15.146:0/1599365930 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f18dc066f30 0x7f18dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.146+0000 7f18f37fe700 1 -- 172.21.15.146:0/1599365930 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6231+0+0 (secure 0 0 0) 0x7f18e4083c60 con 0x7f18fc155d30 2023-10-06T11:19:48.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.146+0000 7f18fad9d700 1 --2- 172.21.15.146:0/1599365930 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f18dc066f30 0x7f18dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.146+0000 7f18fad9d700 1 --2- 172.21.15.146:0/1599365930 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f18dc066f30 0x7f18dc0693e0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f18fc06f760 tx=0x7f18ec00a330 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:48.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.148+0000 7f190a3ffb80 1 Processor -- start 2023-10-06T11:19:48.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.148+0000 7f190a3ffb80 1 -- start start 2023-10-06T11:19:48.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.149+0000 7f190a3ffb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56518a5fdae0 0x56518a5fdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.149+0000 7f190a3ffb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56518a5b99f0 0x56518a5b65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.149+0000 7f190a3ffb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56518a5b7c20 0x56518a5b6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.149+0000 7f190a3ffb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x56518a536cd0 con 0x56518a5fdae0 2023-10-06T11:19:48.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.149+0000 7f190a3ffb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56518a50dac0 con 0x56518a5b7c20 2023-10-06T11:19:48.159 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.149+0000 7f190a3ffb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x56518a50b2c0 con 0x56518a5b99f0 2023-10-06T11:19:48.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.149+0000 7f18fad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56518a5fdae0 0x56518a5fdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.149+0000 7f18fad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56518a5fdae0 0x56518a5fdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37946/0 (socket says 172.21.15.146:37946) 2023-10-06T11:19:48.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.149+0000 7f18fad9d700 1 -- 172.21.15.146:0/2027276324 learned_addr learned my addr 172.21.15.146:0/2027276324 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:48.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.149+0000 7f18fb59e700 1 --2- 172.21.15.146:0/2027276324 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56518a5b7c20 0x56518a5b6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.149+0000 7f18f259c700 1 --2- 172.21.15.146:0/2027276324 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56518a5b99f0 0x56518a5b65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.149+0000 7f18fad9d700 1 -- 172.21.15.146:0/2027276324 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56518a5b99f0 msgr2=0x56518a5b65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:48.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.149+0000 7f18fad9d700 1 --2- 172.21.15.146:0/2027276324 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56518a5b99f0 0x56518a5b65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.160 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.149+0000 7f18fad9d700 1 -- 172.21.15.146:0/2027276324 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56518a5b7c20 msgr2=0x56518a5b6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:48.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.149+0000 7f18fad9d700 1 --2- 172.21.15.146:0/2027276324 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56518a5b7c20 0x56518a5b6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.149+0000 7f18fad9d700 1 -- 172.21.15.146:0/2027276324 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56518a3a12c0 con 0x56518a5fdae0 2023-10-06T11:19:48.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.149+0000 7f18fad9d700 1 --2- 172.21.15.146:0/2027276324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56518a5fdae0 0x56518a5fdeb0 secure :-1 s=READY pgs=2312 cs=0 l=1 rev1=1 crypto rx=0x7f18ec012010 tx=0x7f18ec018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39d4bd0e943dd04f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:48.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.149+0000 7f18dbfff700 1 -- 172.21.15.146:0/2027276324 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ec013c60 con 0x56518a5fdae0 2023-10-06T11:19:48.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.150+0000 7f18dbfff700 1 -- 172.21.15.146:0/2027276324 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18ec013dc0 con 0x56518a5fdae0 2023-10-06T11:19:48.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.150+0000 7f18dbfff700 1 -- 172.21.15.146:0/2027276324 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ec0206a0 con 0x56518a5fdae0 2023-10-06T11:19:48.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.150+0000 7f190a3ffb80 1 -- 172.21.15.146:0/2027276324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56518a5fdae0 msgr2=0x56518a5fdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:48.161 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.150+0000 7f190a3ffb80 1 --2- 172.21.15.146:0/2027276324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56518a5fdae0 0x56518a5fdeb0 secure :-1 s=READY pgs=2312 cs=0 l=1 rev1=1 crypto rx=0x7f18ec012010 tx=0x7f18ec018000 comp rx=0 tx=0).stop 2023-10-06T11:19:48.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.150+0000 7f190a3ffb80 1 -- 172.21.15.146:0/2027276324 shutdown_connections 2023-10-06T11:19:48.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.150+0000 7f190a3ffb80 1 --2- 172.21.15.146:0/2027276324 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56518a5b7c20 0x56518a5b6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.150+0000 7f190a3ffb80 1 --2- 172.21.15.146:0/2027276324 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56518a5fdae0 0x56518a5fdeb0 unknown :-1 s=CLOSED pgs=2312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.150+0000 7f190a3ffb80 1 --2- 172.21.15.146:0/2027276324 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56518a5b99f0 0x56518a5b65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.150+0000 7f190a3ffb80 1 -- 172.21.15.146:0/2027276324 >> 172.21.15.146:0/2027276324 conn(0x56518a5b80c0 msgr2=0x56518a5b8490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:48.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.150+0000 7f190a3ffb80 1 -- 172.21.15.146:0/2027276324 shutdown_connections 2023-10-06T11:19:48.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.150+0000 7f190a3ffb80 1 -- 172.21.15.146:0/2027276324 wait complete. 2023-10-06T11:19:48.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.151+0000 7f190a3ffb80 1 -- start start 2023-10-06T11:19:48.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.151+0000 7f190a3ffb80 1 Processor -- start 2023-10-06T11:19:48.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.152+0000 7f190a3ffb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56518a5b7c20 0x56518a5e0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.152+0000 7f190a3ffb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56518a5b99f0 0x56518a5dec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.152+0000 7f190a3ffb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56518a5fdae0 0x56518a5df1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.152+0000 7f190a3ffb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x56518a5070b0 con 0x56518a5b7c20 2023-10-06T11:19:48.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.152+0000 7f190a3ffb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56518a4b28e0 con 0x56518a5fdae0 2023-10-06T11:19:48.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.152+0000 7f190a3ffb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x56518a4cdef0 con 0x56518a5b99f0 2023-10-06T11:19:48.163 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.152+0000 7f190a3ffb80 10 client.0 _ll_register_callbacks cb 0x56518a3a3f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:19:48.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.152+0000 7f18fad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56518a5b7c20 0x56518a5e0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.152+0000 7f18fad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56518a5b7c20 0x56518a5e0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37950/0 (socket says 172.21.15.146:37950) 2023-10-06T11:19:48.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.152+0000 7f18fad9d700 1 -- 172.21.15.146:0/2169551144 learned_addr learned my addr 172.21.15.146:0/2169551144 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:48.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.152+0000 7f18fad9d700 1 -- 172.21.15.146:0/2169551144 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56518a5b99f0 msgr2=0x56518a5dec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:48.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.152+0000 7f18fb59e700 1 --2- 172.21.15.146:0/2169551144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56518a5fdae0 0x56518a5df1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.152+0000 7f18f259c700 1 --2- 172.21.15.146:0/2169551144 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56518a5b99f0 0x56518a5dec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.164 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.152+0000 7f18fad9d700 1 --2- 172.21.15.146:0/2169551144 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56518a5b99f0 0x56518a5dec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.152+0000 7f18fad9d700 1 -- 172.21.15.146:0/2169551144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56518a5fdae0 msgr2=0x56518a5df1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:48.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.152+0000 7f18fad9d700 1 --2- 172.21.15.146:0/2169551144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56518a5fdae0 0x56518a5df1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.152+0000 7f18fad9d700 1 -- 172.21.15.146:0/2169551144 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18ec011c90 con 0x56518a5b7c20 2023-10-06T11:19:48.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.152+0000 7f18fb59e700 1 --2- 172.21.15.146:0/2169551144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56518a5fdae0 0x56518a5df1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:19:48.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.152+0000 7f18f259c700 1 --2- 172.21.15.146:0/2169551144 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56518a5b99f0 0x56518a5dec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:19:48.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.153+0000 7f18fad9d700 1 --2- 172.21.15.146:0/2169551144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56518a5b7c20 0x56518a5e0a70 secure :-1 s=READY pgs=2313 cs=0 l=1 rev1=1 crypto rx=0x56518a5b9f40 tx=0x7f18ec022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84398944a9e20e79 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:48.165 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.153+0000 7f18d97fa700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:19:48.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.153+0000 7f18d97fa700 1 -- 172.21.15.146:0/2169551144 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ec030070 con 0x56518a5b7c20 2023-10-06T11:19:48.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.153+0000 7f18d97fa700 1 -- 172.21.15.146:0/2169551144 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(180..180 src has 1..180) v4 ==== 6231+0+0 (secure 0 0 0) 0x7f18ec020a90 con 0x56518a5b7c20 2023-10-06T11:19:48.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.153+0000 7f190a3ffb80 1 -- 172.21.15.146:0/2169551144 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56518a5ab6e0 con 0x56518a5b7c20 2023-10-06T11:19:48.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.153+0000 7f18d97fa700 1 -- 172.21.15.146:0/2169551144 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=150) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18ec020e60 con 0x56518a5b7c20 2023-10-06T11:19:48.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.153+0000 7f190a3ffb80 10 client.10797 fetch_fsmap learned FSMap version 150 2023-10-06T11:19:48.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.153+0000 7f190a3ffb80 1 -- 172.21.15.146:0/2169551144 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=150,monmap=2+}) v3 -- 0x56518a344030 con 0x56518a5b7c20 2023-10-06T11:19:48.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.153+0000 7f18d97fa700 1 -- 172.21.15.146:0/2169551144 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56518a5ab6e0 con 0x56518a5b7c20 2023-10-06T11:19:48.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.153+0000 7f18d97fa700 1 -- 172.21.15.146:0/2169551144 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 150) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f18ec029450 con 0x56518a5b7c20 2023-10-06T11:19:48.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.153+0000 7f190a3ffb80 10 client.10797 fetch_fsmap finished waiting for FSMap version 150 2023-10-06T11:19:48.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.153+0000 7f190a3ffb80 10 client.10797 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2023-10-06T11:19:48.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.153+0000 7f190a3ffb80 20 client.10797 populate_metadata read hostname 'smithi146' 2023-10-06T11:19:48.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.153+0000 7f190a3ffb80 1 --2- 172.21.15.146:0/2169551144 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x56518a5fa5f0 0x56518a5dbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.153+0000 7f190a3ffb80 4 client.10797 mds_command: new command op to 10461 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:19:48.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.153+0000 7f190a3ffb80 1 -- 172.21.15.146:0/2169551144 --> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56518a588610 con 0x56518a5fa5f0 2023-10-06T11:19:48.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.153+0000 7f18f259c700 1 --2- 172.21.15.146:0/2169551144 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x56518a5fa5f0 0x56518a5dbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.154+0000 7f18d97fa700 10 client.10797 ms_handle_connect on v2:172.21.15.146:6835/2322816938 2023-10-06T11:19:48.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.154+0000 7f18f259c700 1 --2- 172.21.15.146:0/2169551144 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x56518a5fa5f0 0x56518a5dbda0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3d43f6c57d244a3 server_cookie=dca9f848c33292f0 in_seq=0 out_seq=0 2023-10-06T11:19:48.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.154+0000 7f18d97fa700 1 -- 172.21.15.146:0/2169551144 <== mds.0 v2:172.21.15.146:6835/2322816938 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x56518a588610 con 0x56518a5fa5f0 2023-10-06T11:19:48.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.154+0000 7f18d97fa700 10 client.10797 handle_command_reply: tid=0 2023-10-06T11:19:48.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.154+0000 7f190a3ffb80 1 client.10797 shutdown 2023-10-06T11:19:48.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.154+0000 7f190a3ffb80 1 -- 172.21.15.146:0/2169551144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56518a5b7c20 msgr2=0x56518a5e0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:48.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.154+0000 7f190a3ffb80 1 --2- 172.21.15.146:0/2169551144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56518a5b7c20 0x56518a5e0a70 secure :-1 s=READY pgs=2313 cs=0 l=1 rev1=1 crypto rx=0x56518a5b9f40 tx=0x7f18ec022000 comp rx=0 tx=0).stop 2023-10-06T11:19:48.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.154+0000 7f190a3ffb80 1 -- 172.21.15.146:0/2169551144 shutdown_connections 2023-10-06T11:19:48.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.154+0000 7f190a3ffb80 1 --2- 172.21.15.146:0/2169551144 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x56518a5fa5f0 0x56518a5dbda0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.154+0000 7f190a3ffb80 1 --2- 172.21.15.146:0/2169551144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56518a5fdae0 0x56518a5df1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.154+0000 7f18d97fa700 0 client.10797 ms_handle_reset on v2:172.21.15.146:6835/2322816938 2023-10-06T11:19:48.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.154+0000 7f190a3ffb80 1 --2- 172.21.15.146:0/2169551144 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56518a5b7c20 0x56518a5e0a70 unknown :-1 s=CLOSED pgs=2313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.154+0000 7f190a3ffb80 1 --2- 172.21.15.146:0/2169551144 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56518a5b99f0 0x56518a5dec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.154+0000 7f190a3ffb80 1 -- 172.21.15.146:0/2169551144 >> 172.21.15.146:0/2169551144 conn(0x56518a5b80c0 msgr2=0x56518a5fb340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:48.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.154+0000 7f190a3ffb80 1 -- 172.21.15.146:0/2169551144 shutdown_connections 2023-10-06T11:19:48.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.154+0000 7f190a3ffb80 1 -- 172.21.15.146:0/2169551144 wait complete. 2023-10-06T11:19:48.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.155+0000 7f190a3ffb80 20 client.10797 trim_cache size 0 max 16384 2023-10-06T11:19:48.172 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.171+0000 7f190a3ffb80 1 Processor -- start 2023-10-06T11:19:48.173 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.171+0000 7f190a3ffb80 1 -- start start 2023-10-06T11:19:48.180 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.171+0000 7f190a3ffb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56518a5b7c20 0x56518a615a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.171+0000 7f190a3ffb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56518a5b99f0 0x56518a5b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.171+0000 7f190a3ffb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56518a5fdae0 0x56518a5de2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.171+0000 7f190a3ffb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x56518a389e80 con 0x56518a5fdae0 2023-10-06T11:19:48.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.171+0000 7f190a3ffb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56518a5e34c0 con 0x56518a5b99f0 2023-10-06T11:19:48.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.171+0000 7f190a3ffb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x56518a5e2130 con 0x56518a5b7c20 2023-10-06T11:19:48.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.172+0000 7f18fb59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56518a5fdae0 0x56518a5de2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.172+0000 7f18fb59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56518a5fdae0 0x56518a5de2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37964/0 (socket says 172.21.15.146:37964) 2023-10-06T11:19:48.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.172+0000 7f18fb59e700 1 -- 172.21.15.146:0/1437766698 learned_addr learned my addr 172.21.15.146:0/1437766698 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:48.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.172+0000 7f18fad9d700 1 --2- 172.21.15.146:0/1437766698 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56518a5b7c20 0x56518a615a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.172+0000 7f18f259c700 1 --2- 172.21.15.146:0/1437766698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56518a5b99f0 0x56518a5b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.172+0000 7f18fb59e700 1 -- 172.21.15.146:0/1437766698 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56518a5b7c20 msgr2=0x56518a615a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:48.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.172+0000 7f18fb59e700 1 --2- 172.21.15.146:0/1437766698 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56518a5b7c20 0x56518a615a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.172+0000 7f18fb59e700 1 -- 172.21.15.146:0/1437766698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56518a5b99f0 msgr2=0x56518a5b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:48.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.172+0000 7f18fb59e700 1 --2- 172.21.15.146:0/1437766698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56518a5b99f0 0x56518a5b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.172+0000 7f18fb59e700 1 -- 172.21.15.146:0/1437766698 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56518a4d57d0 con 0x56518a5fdae0 2023-10-06T11:19:48.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.172+0000 7f18fad9d700 1 --2- 172.21.15.146:0/1437766698 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56518a5b7c20 0x56518a615a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:19:48.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.172+0000 7f18fb59e700 1 --2- 172.21.15.146:0/1437766698 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56518a5fdae0 0x56518a5de2f0 secure :-1 s=READY pgs=2314 cs=0 l=1 rev1=1 crypto rx=0x7f18f400b6c0 tx=0x7f18f4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=921a13589372427d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:48.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.172+0000 7f18f0d99700 1 -- 172.21.15.146:0/1437766698 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f4028070 con 0x56518a5fdae0 2023-10-06T11:19:48.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.172+0000 7f18f0d99700 1 -- 172.21.15.146:0/1437766698 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f400bcd0 con 0x56518a5fdae0 2023-10-06T11:19:48.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.172+0000 7f18f0d99700 1 -- 172.21.15.146:0/1437766698 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f4022a40 con 0x56518a5fdae0 2023-10-06T11:19:48.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.173+0000 7f190a3ffb80 1 -- 172.21.15.146:0/1437766698 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56518a5fdae0 msgr2=0x56518a5de2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:48.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.173+0000 7f190a3ffb80 1 --2- 172.21.15.146:0/1437766698 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56518a5fdae0 0x56518a5de2f0 secure :-1 s=READY pgs=2314 cs=0 l=1 rev1=1 crypto rx=0x7f18f400b6c0 tx=0x7f18f4019000 comp rx=0 tx=0).stop 2023-10-06T11:19:48.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.173+0000 7f190a3ffb80 1 -- 172.21.15.146:0/1437766698 shutdown_connections 2023-10-06T11:19:48.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.173+0000 7f190a3ffb80 1 --2- 172.21.15.146:0/1437766698 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56518a5fdae0 0x56518a5de2f0 unknown :-1 s=CLOSED pgs=2314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.173+0000 7f190a3ffb80 1 --2- 172.21.15.146:0/1437766698 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56518a5b7c20 0x56518a615a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.173+0000 7f190a3ffb80 1 --2- 172.21.15.146:0/1437766698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56518a5b99f0 0x56518a5b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.173+0000 7f190a3ffb80 1 -- 172.21.15.146:0/1437766698 >> 172.21.15.146:0/1437766698 conn(0x56518a5b80c0 msgr2=0x56518a5e2c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:48.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.173+0000 7f190a3ffb80 1 -- 172.21.15.146:0/1437766698 shutdown_connections 2023-10-06T11:19:48.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.173+0000 7f190a3ffb80 1 -- 172.21.15.146:0/1437766698 wait complete. 2023-10-06T11:19:48.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.173+0000 7f190a3ffb80 1 -- start start 2023-10-06T11:19:48.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.173+0000 7f190a3ffb80 1 Processor -- start 2023-10-06T11:19:48.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.174+0000 7f190a3ffb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56518a5b7c20 0x56518a614930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.174+0000 7f190a3ffb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56518a5b99f0 0x56518a5dcd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.174+0000 7f190a3ffb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56518a5fdae0 0x56518a5dd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.174+0000 7f190a3ffb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x56518a6156f0 con 0x56518a5b7c20 2023-10-06T11:19:48.186 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.174+0000 7f190a3ffb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56518a6154a0 con 0x56518a5b99f0 2023-10-06T11:19:48.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.174+0000 7f190a3ffb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x56518a5f3d10 con 0x56518a5fdae0 2023-10-06T11:19:48.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.174+0000 7f190a3ffb80 10 client.0 _ll_register_callbacks cb 0x56518a3a3f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:19:48.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.174+0000 7f18fad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56518a5b7c20 0x56518a614930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.174+0000 7f18fad9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56518a5b7c20 0x56518a614930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37974/0 (socket says 172.21.15.146:37974) 2023-10-06T11:19:48.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.174+0000 7f18fad9d700 1 -- 172.21.15.146:0/3757020935 learned_addr learned my addr 172.21.15.146:0/3757020935 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:48.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.174+0000 7f18fb59e700 1 --2- 172.21.15.146:0/3757020935 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56518a5fdae0 0x56518a5dd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.174+0000 7f18f259c700 1 --2- 172.21.15.146:0/3757020935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56518a5b99f0 0x56518a5dcd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.175+0000 7f18fad9d700 1 -- 172.21.15.146:0/3757020935 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56518a5fdae0 msgr2=0x56518a5dd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:48.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.175+0000 7f18fad9d700 1 --2- 172.21.15.146:0/3757020935 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56518a5fdae0 0x56518a5dd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.175+0000 7f18fad9d700 1 -- 172.21.15.146:0/3757020935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56518a5b99f0 msgr2=0x56518a5dcd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:48.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.175+0000 7f18fad9d700 1 --2- 172.21.15.146:0/3757020935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56518a5b99f0 0x56518a5dcd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.175+0000 7f18fad9d700 1 -- 172.21.15.146:0/3757020935 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18fc0c9cb0 con 0x56518a5b7c20 2023-10-06T11:19:48.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.175+0000 7f18fad9d700 1 --2- 172.21.15.146:0/3757020935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56518a5b7c20 0x56518a614930 secure :-1 s=READY pgs=2315 cs=0 l=1 rev1=1 crypto rx=0x7f18ec034c50 tx=0x7f18ec02d050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e14feea50860c92 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:48.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.175+0000 7f18d97fa700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:19:48.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.175+0000 7f18d97fa700 1 -- 172.21.15.146:0/3757020935 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ec030040 con 0x56518a5b7c20 2023-10-06T11:19:48.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.175+0000 7f18d97fa700 1 -- 172.21.15.146:0/3757020935 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(180..180 src has 1..180) v4 ==== 6231+0+0 (secure 0 0 0) 0x7f18ec020a90 con 0x56518a5b7c20 2023-10-06T11:19:48.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.175+0000 7f190a3ffb80 1 -- 172.21.15.146:0/3757020935 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f18ec013dc0 con 0x56518a5b7c20 2023-10-06T11:19:48.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.175+0000 7f18d97fa700 1 -- 172.21.15.146:0/3757020935 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=150) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18ec020e60 con 0x56518a5b7c20 2023-10-06T11:19:48.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.175+0000 7f190a3ffb80 10 client.10803 fetch_fsmap learned FSMap version 150 2023-10-06T11:19:48.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.175+0000 7f190a3ffb80 1 -- 172.21.15.146:0/3757020935 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=150,monmap=2+}) v3 -- 0x56518a4bc4c0 con 0x56518a5b7c20 2023-10-06T11:19:48.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.175+0000 7f18d97fa700 1 -- 172.21.15.146:0/3757020935 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18ec013dc0 con 0x56518a5b7c20 2023-10-06T11:19:48.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.175+0000 7f18d97fa700 1 -- 172.21.15.146:0/3757020935 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 150) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f18ec029450 con 0x56518a5b7c20 2023-10-06T11:19:48.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.175+0000 7f190a3ffb80 10 client.10803 fetch_fsmap finished waiting for FSMap version 150 2023-10-06T11:19:48.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.175+0000 7f190a3ffb80 10 client.10803 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2023-10-06T11:19:48.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.175+0000 7f190a3ffb80 20 client.10803 populate_metadata read hostname 'smithi146' 2023-10-06T11:19:48.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.175+0000 7f190a3ffb80 1 --2- 172.21.15.146:0/3757020935 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x56518a5e5890 0x56518a5e5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.175+0000 7f190a3ffb80 4 client.10803 mds_command: new command op to 10461 tid=0[{"prefix": "scrub status"}] 2023-10-06T11:19:48.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.175+0000 7f190a3ffb80 1 -- 172.21.15.146:0/3757020935 --> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56518a4a9e50 con 0x56518a5e5890 2023-10-06T11:19:48.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.175+0000 7f18f259c700 1 --2- 172.21.15.146:0/3757020935 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x56518a5e5890 0x56518a5e5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.176+0000 7f18f259c700 1 --2- 172.21.15.146:0/3757020935 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x56518a5e5890 0x56518a5e5c60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d42714fa530baa04 server_cookie=25660154022b07f1 in_seq=0 out_seq=0 2023-10-06T11:19:48.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.176+0000 7f18d97fa700 10 client.10803 ms_handle_connect on v2:172.21.15.146:6835/2322816938 2023-10-06T11:19:48.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.176+0000 7f18d97fa700 1 -- 172.21.15.146:0/3757020935 <== mds.0 v2:172.21.15.146:6835/2322816938 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x56518a4a9e50 con 0x56518a5e5890 2023-10-06T11:19:48.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.176+0000 7f18d97fa700 10 client.10803 handle_command_reply: tid=0 2023-10-06T11:19:48.191 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.176+0000 7f190a3ffb80 1 client.10803 shutdown 2023-10-06T11:19:48.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.176+0000 7f190a3ffb80 1 -- 172.21.15.146:0/3757020935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56518a5b7c20 msgr2=0x56518a614930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:48.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.176+0000 7f190a3ffb80 1 --2- 172.21.15.146:0/3757020935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56518a5b7c20 0x56518a614930 secure :-1 s=READY pgs=2315 cs=0 l=1 rev1=1 crypto rx=0x7f18ec034c50 tx=0x7f18ec02d050 comp rx=0 tx=0).stop 2023-10-06T11:19:48.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.176+0000 7f190a3ffb80 1 -- 172.21.15.146:0/3757020935 shutdown_connections 2023-10-06T11:19:48.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.176+0000 7f190a3ffb80 1 --2- 172.21.15.146:0/3757020935 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x56518a5e5890 0x56518a5e5c60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.176+0000 7f190a3ffb80 1 --2- 172.21.15.146:0/3757020935 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56518a5fdae0 0x56518a5dd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.176+0000 7f18d97fa700 0 client.10803 ms_handle_reset on v2:172.21.15.146:6835/2322816938 2023-10-06T11:19:48.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.176+0000 7f190a3ffb80 1 --2- 172.21.15.146:0/3757020935 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x56518a5b7c20 0x56518a614930 unknown :-1 s=CLOSED pgs=2315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.176+0000 7f190a3ffb80 1 --2- 172.21.15.146:0/3757020935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56518a5b99f0 0x56518a5dcd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.176+0000 7f190a3ffb80 1 -- 172.21.15.146:0/3757020935 >> 172.21.15.146:0/3757020935 conn(0x56518a5b80c0 msgr2=0x56518a5b3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:48.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.176+0000 7f190a3ffb80 1 -- 172.21.15.146:0/3757020935 shutdown_connections 2023-10-06T11:19:48.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.176+0000 7f190a3ffb80 1 -- 172.21.15.146:0/3757020935 wait complete. 2023-10-06T11:19:48.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.176+0000 7f190a3ffb80 20 client.10803 trim_cache size 0 max 16384 2023-10-06T11:19:48.194 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:19:48.194 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "no active scrubs running", 2023-10-06T11:19:48.194 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": {} 2023-10-06T11:19:48.194 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:19:48.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.177+0000 7f1901107700 1 -- 172.21.15.146:0/1599365930 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f18dc066f30 msgr2=0x7f18dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:48.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.177+0000 7f1901107700 1 --2- 172.21.15.146:0/1599365930 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f18dc066f30 0x7f18dc0693e0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f18fc06f760 tx=0x7f18ec00a330 comp rx=0 tx=0).stop 2023-10-06T11:19:48.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.177+0000 7f1901107700 1 -- 172.21.15.146:0/1599365930 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18fc155d30 msgr2=0x7f18fc159920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:48.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.177+0000 7f1901107700 1 --2- 172.21.15.146:0/1599365930 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18fc155d30 0x7f18fc159920 secure :-1 s=READY pgs=2311 cs=0 l=1 rev1=1 crypto rx=0x7f18e400c7e0 tx=0x7f18e4007df0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.177+0000 7f1901107700 1 -- 172.21.15.146:0/1599365930 shutdown_connections 2023-10-06T11:19:48.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.177+0000 7f1901107700 1 --2- 172.21.15.146:0/1599365930 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f18dc066f30 0x7f18dc0693e0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.196 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.177+0000 7f1901107700 1 --2- 172.21.15.146:0/1599365930 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18fc1561d0 0x7f18fc159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.177+0000 7f1901107700 1 --2- 172.21.15.146:0/1599365930 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18fc155960 0x7f18fc0c3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.177+0000 7f1901107700 1 --2- 172.21.15.146:0/1599365930 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18fc155d30 0x7f18fc159920 unknown :-1 s=CLOSED pgs=2311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.177+0000 7f1901107700 1 -- 172.21.15.146:0/1599365930 >> 172.21.15.146:0/1599365930 conn(0x7f18fc0673e0 msgr2=0x7f18fc06e240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:48.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.177+0000 7f1901107700 1 -- 172.21.15.146:0/1599365930 shutdown_connections 2023-10-06T11:19:48.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.177+0000 7f1901107700 1 -- 172.21.15.146:0/1599365930 wait complete. 2023-10-06T11:19:48.197 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-06T11:19:48.198 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.13:0 scrub start / recursive,repair 2023-10-06T11:19:48.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.315+0000 7fd6fd0da700 1 Processor -- start 2023-10-06T11:19:48.317 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.315+0000 7fd6fd0da700 1 -- start start 2023-10-06T11:19:48.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.316+0000 7fd6fd0da700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd6f806e320 0x7fd6f80b0890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.321 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.316+0000 7fd6fd0da700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6f8154000 0x7fd6f80b0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.316+0000 7fd6fd0da700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f815ac20 con 0x7fd6f8153c30 2023-10-06T11:19:48.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.316+0000 7fd6fd0da700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6f80b1310 con 0x7fd6f806e320 2023-10-06T11:19:48.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.316+0000 7fd6fd0da700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f815a050 con 0x7fd6f8154000 2023-10-06T11:19:48.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.316+0000 7fd6f6d9d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fd6f8153c30 0x7fd6f80b2780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:54236/0 (socket says 172.21.15.146:54236) 2023-10-06T11:19:48.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.316+0000 7fd6f6d9d700 1 -- 172.21.15.146:0/1278555147 learned_addr learned my addr 172.21.15.146:0/1278555147 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:19:48.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.317+0000 7fd6ee59c700 1 --2- 172.21.15.146:0/1278555147 >> v2:172.21.15.151:3300/0 conn(0x7fd6f806e320 0x7fd6f80b0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.317+0000 7fd6f759e700 1 --2- 172.21.15.146:0/1278555147 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6f8154000 0x7fd6f80b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.322 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.317+0000 7fd6f659c700 1 -- 172.21.15.146:0/1278555147 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2817409653 0 0) 0x7fd6f815ac20 con 0x7fd6f8153c30 2023-10-06T11:19:48.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.317+0000 7fd6f659c700 1 -- 172.21.15.146:0/1278555147 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6e4003570 con 0x7fd6f8153c30 2023-10-06T11:19:48.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.317+0000 7fd6f659c700 1 -- 172.21.15.146:0/1278555147 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3866540238 0 0) 0x7fd6e4003570 con 0x7fd6f8153c30 2023-10-06T11:19:48.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.317+0000 7fd6f659c700 1 -- 172.21.15.146:0/1278555147 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6f8154000 msgr2=0x7fd6f80b0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:48.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.317+0000 7fd6f659c700 1 --2- 172.21.15.146:0/1278555147 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6f8154000 0x7fd6f80b0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.317+0000 7fd6f659c700 1 -- 172.21.15.146:0/1278555147 >> v2:172.21.15.151:3300/0 conn(0x7fd6f806e320 msgr2=0x7fd6f80b0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:48.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.317+0000 7fd6f659c700 1 --2- 172.21.15.146:0/1278555147 >> v2:172.21.15.151:3300/0 conn(0x7fd6f806e320 0x7fd6f80b0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.317+0000 7fd6f659c700 1 -- 172.21.15.146:0/1278555147 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f815a2f0 con 0x7fd6f8153c30 2023-10-06T11:19:48.323 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.317+0000 7fd6f659c700 1 -- 172.21.15.146:0/1278555147 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fd6e8001470 con 0x7fd6f8153c30 2023-10-06T11:19:48.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.317+0000 7fd6f659c700 1 -- 172.21.15.146:0/1278555147 >> v1:172.21.15.146:6789/0 conn(0x7fd6f8153c30 legacy=0x7fd6f80b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:48.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.317+0000 7fd6f659c700 1 --2- 172.21.15.146:0/1278555147 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6e4003a60 0x7fd6e4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.317+0000 7fd6f659c700 1 --2- 172.21.15.146:0/1278555147 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6f8154000 0x7fd6e4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.317+0000 7fd6f659c700 1 --2- 172.21.15.146:0/1278555147 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6e4004d50 0x7fd6e40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.317+0000 7fd6f659c700 1 -- 172.21.15.146:0/1278555147 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f80b1310 con 0x7fd6e4003a60 2023-10-06T11:19:48.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.317+0000 7fd6f659c700 1 -- 172.21.15.146:0/1278555147 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f815a050 con 0x7fd6e4004d50 2023-10-06T11:19:48.324 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.317+0000 7fd6f659c700 1 -- 172.21.15.146:0/1278555147 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e400ba60 con 0x7fd6f8154000 2023-10-06T11:19:48.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.317+0000 7fd6f6d9d700 1 --2- 172.21.15.146:0/1278555147 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6e4003a60 0x7fd6e4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.317+0000 7fd6ee59c700 1 --2- 172.21.15.146:0/1278555147 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6f8154000 0x7fd6e4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.317+0000 7fd6f759e700 1 --2- 172.21.15.146:0/1278555147 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6e4004d50 0x7fd6e40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.317+0000 7fd6f6d9d700 1 -- 172.21.15.146:0/1278555147 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6f8154000 msgr2=0x7fd6e4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:48.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.317+0000 7fd6f6d9d700 1 --2- 172.21.15.146:0/1278555147 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6f8154000 0x7fd6e4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.317+0000 7fd6f6d9d700 1 -- 172.21.15.146:0/1278555147 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6e4004d50 msgr2=0x7fd6e40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:48.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.317+0000 7fd6f6d9d700 1 --2- 172.21.15.146:0/1278555147 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6e4004d50 0x7fd6e40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.325 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.317+0000 7fd6f6d9d700 1 -- 172.21.15.146:0/1278555147 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e4003570 con 0x7fd6e4003a60 2023-10-06T11:19:48.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.317+0000 7fd6f759e700 1 --2- 172.21.15.146:0/1278555147 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6e4004d50 0x7fd6e40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:19:48.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.318+0000 7fd6f6d9d700 1 --2- 172.21.15.146:0/1278555147 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6e4003a60 0x7fd6e4003e70 secure :-1 s=READY pgs=2317 cs=0 l=1 rev1=1 crypto rx=0x7fd6e800c3c0 tx=0x7fd6e8001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b054de98e673654a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:48.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.318+0000 7fd6f659c700 1 -- 172.21.15.146:0/1278555147 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e800cc30 con 0x7fd6e4003a60 2023-10-06T11:19:48.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.318+0000 7fd6f659c700 1 -- 172.21.15.146:0/1278555147 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e800cdb0 con 0x7fd6e4003a60 2023-10-06T11:19:48.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.318+0000 7fd6f659c700 1 -- 172.21.15.146:0/1278555147 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e8005b70 con 0x7fd6e4003a60 2023-10-06T11:19:48.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.318+0000 7fd6fd0da700 1 -- 172.21.15.146:0/1278555147 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6e4003a60 msgr2=0x7fd6e4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:48.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.318+0000 7fd6fd0da700 1 --2- 172.21.15.146:0/1278555147 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6e4003a60 0x7fd6e4003e70 secure :-1 s=READY pgs=2317 cs=0 l=1 rev1=1 crypto rx=0x7fd6e800c3c0 tx=0x7fd6e8001e90 comp rx=0 tx=0).stop 2023-10-06T11:19:48.326 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.318+0000 7fd6f759e700 1 -- 172.21.15.146:0/1278555147 reap_dead start 2023-10-06T11:19:48.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.318+0000 7fd6fd0da700 1 -- 172.21.15.146:0/1278555147 shutdown_connections 2023-10-06T11:19:48.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.318+0000 7fd6fd0da700 1 -- 172.21.15.146:0/1278555147 >> 172.21.15.146:0/1278555147 conn(0x7fd6f80cddc0 msgr2=0x7fd6f80aece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:48.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.318+0000 7fd6fd0da700 1 -- 172.21.15.146:0/1278555147 shutdown_connections 2023-10-06T11:19:48.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.318+0000 7fd6fd0da700 1 -- 172.21.15.146:0/1278555147 wait complete. 2023-10-06T11:19:48.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.319+0000 7fd6fd0da700 1 Processor -- start 2023-10-06T11:19:48.327 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.319+0000 7fd6fd0da700 1 -- start start 2023-10-06T11:19:48.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.320+0000 7fd6fd0da700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6e4003a60 0x7fd6f813c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.320+0000 7fd6fd0da700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6f80ae860 0x7fd6f81513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.320+0000 7fd6fd0da700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6f80aecd0 0x7fd6f8151930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.320+0000 7fd6fd0da700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f8150520 con 0x7fd6e4003a60 2023-10-06T11:19:48.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.320+0000 7fd6fd0da700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f80ae3d0 con 0x7fd6f80ae860 2023-10-06T11:19:48.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.320+0000 7fd6fd0da700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f80ad7c0 con 0x7fd6f80aecd0 2023-10-06T11:19:48.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.320+0000 7fd6f6d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6e4003a60 0x7fd6f813c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.320+0000 7fd6f6d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6e4003a60 0x7fd6f813c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:37996/0 (socket says 172.21.15.146:37996) 2023-10-06T11:19:48.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.320+0000 7fd6f6d9d700 1 -- 172.21.15.146:0/2179752730 learned_addr learned my addr 172.21.15.146:0/2179752730 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:48.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.320+0000 7fd6f759e700 1 --2- 172.21.15.146:0/2179752730 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6f80aecd0 0x7fd6f8151930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.337 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.320+0000 7fd6f6d9d700 1 -- 172.21.15.146:0/2179752730 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6f80aecd0 msgr2=0x7fd6f8151930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:48.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.320+0000 7fd6f6d9d700 1 --2- 172.21.15.146:0/2179752730 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6f80aecd0 0x7fd6f8151930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.320+0000 7fd6ee59c700 1 --2- 172.21.15.146:0/2179752730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6f80ae860 0x7fd6f81513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.320+0000 7fd6f6d9d700 1 -- 172.21.15.146:0/2179752730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6f80ae860 msgr2=0x7fd6f81513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:48.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.320+0000 7fd6f6d9d700 1 --2- 172.21.15.146:0/2179752730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6f80ae860 0x7fd6f81513f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.320+0000 7fd6f6d9d700 1 -- 172.21.15.146:0/2179752730 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f80adaa0 con 0x7fd6e4003a60 2023-10-06T11:19:48.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.321+0000 7fd6f6d9d700 1 --2- 172.21.15.146:0/2179752730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6e4003a60 0x7fd6f813c640 secure :-1 s=READY pgs=2318 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4004760 tx=0x7fd6e8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:48.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.321+0000 7fd6ef7fe700 1 -- 172.21.15.146:0/2179752730 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e800cc30 con 0x7fd6e4003a60 2023-10-06T11:19:48.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.321+0000 7fd6ef7fe700 1 -- 172.21.15.146:0/2179752730 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e800c9e0 con 0x7fd6e4003a60 2023-10-06T11:19:48.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.321+0000 7fd6ef7fe700 1 -- 172.21.15.146:0/2179752730 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e8007510 con 0x7fd6e4003a60 2023-10-06T11:19:48.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.321+0000 7fd6fd0da700 1 -- 172.21.15.146:0/2179752730 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f80add80 con 0x7fd6e4003a60 2023-10-06T11:19:48.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.321+0000 7fd6fd0da700 1 -- 172.21.15.146:0/2179752730 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f813cb80 con 0x7fd6e4003a60 2023-10-06T11:19:48.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.322+0000 7fd6ef7fe700 1 -- 172.21.15.146:0/2179752730 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd6e8019030 con 0x7fd6e4003a60 2023-10-06T11:19:48.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.323+0000 7fd6ef7fe700 1 --2- 172.21.15.146:0/2179752730 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd6d8066f30 0x7fd6d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.323+0000 7fd6ef7fe700 1 -- 172.21.15.146:0/2179752730 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6231+0+0 (secure 0 0 0) 0x7fd6e8085770 con 0x7fd6e4003a60 2023-10-06T11:19:48.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.323+0000 7fd6ee59c700 1 --2- 172.21.15.146:0/2179752730 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd6d8066f30 0x7fd6d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.323+0000 7fd6ee59c700 1 --2- 172.21.15.146:0/2179752730 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd6d8066f30 0x7fd6d80693e0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fd6e00093f0 tx=0x7fd6e0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:48.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.324+0000 7fd7063d2b80 1 Processor -- start 2023-10-06T11:19:48.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.325+0000 7fd7063d2b80 1 -- start start 2023-10-06T11:19:48.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.325+0000 7fd7063d2b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c056b6b60 0x557c056b6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.325+0000 7fd7063d2b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557c05672a70 0x557c0566f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.325+0000 7fd7063d2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c05670ca0 0x557c0566fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.325+0000 7fd7063d2b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c055efd50 con 0x557c056b6b60 2023-10-06T11:19:48.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.325+0000 7fd7063d2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c055c6b40 con 0x557c05670ca0 2023-10-06T11:19:48.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.325+0000 7fd7063d2b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x557c055c4340 con 0x557c05672a70 2023-10-06T11:19:48.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.325+0000 7fd6f6d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c056b6b60 0x557c056b6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.325+0000 7fd6f6d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c056b6b60 0x557c056b6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38010/0 (socket says 172.21.15.146:38010) 2023-10-06T11:19:48.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.325+0000 7fd6f6d9d700 1 -- 172.21.15.146:0/2054462618 learned_addr learned my addr 172.21.15.146:0/2054462618 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:48.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.326+0000 7fd6ee59c700 1 --2- 172.21.15.146:0/2054462618 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557c05672a70 0x557c0566f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.326+0000 7fd6f759e700 1 --2- 172.21.15.146:0/2054462618 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c05670ca0 0x557c0566fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.326+0000 7fd6f6d9d700 1 -- 172.21.15.146:0/2054462618 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557c05672a70 msgr2=0x557c0566f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:48.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.326+0000 7fd6f6d9d700 1 --2- 172.21.15.146:0/2054462618 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557c05672a70 0x557c0566f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.326+0000 7fd6f6d9d700 1 -- 172.21.15.146:0/2054462618 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c05670ca0 msgr2=0x557c0566fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:48.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.326+0000 7fd6f6d9d700 1 --2- 172.21.15.146:0/2054462618 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c05670ca0 0x557c0566fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.326+0000 7fd6f6d9d700 1 -- 172.21.15.146:0/2054462618 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c0545a340 con 0x557c056b6b60 2023-10-06T11:19:48.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.326+0000 7fd6f6d9d700 1 --2- 172.21.15.146:0/2054462618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c056b6b60 0x557c056b6f30 secure :-1 s=READY pgs=2319 cs=0 l=1 rev1=1 crypto rx=0x7fd6e80839b0 tx=0x7fd6e8083940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48af033a913f2f90 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:48.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.326+0000 7fd6d7fff700 1 -- 172.21.15.146:0/2054462618 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e8056af0 con 0x557c056b6b60 2023-10-06T11:19:48.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.326+0000 7fd6d7fff700 1 -- 172.21.15.146:0/2054462618 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e80563f0 con 0x557c056b6b60 2023-10-06T11:19:48.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.326+0000 7fd6d7fff700 1 -- 172.21.15.146:0/2054462618 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e8059640 con 0x557c056b6b60 2023-10-06T11:19:48.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.327+0000 7fd7063d2b80 1 -- 172.21.15.146:0/2054462618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c056b6b60 msgr2=0x557c056b6f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:48.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.327+0000 7fd7063d2b80 1 --2- 172.21.15.146:0/2054462618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c056b6b60 0x557c056b6f30 secure :-1 s=READY pgs=2319 cs=0 l=1 rev1=1 crypto rx=0x7fd6e80839b0 tx=0x7fd6e8083940 comp rx=0 tx=0).stop 2023-10-06T11:19:48.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.327+0000 7fd7063d2b80 1 -- 172.21.15.146:0/2054462618 shutdown_connections 2023-10-06T11:19:48.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.327+0000 7fd7063d2b80 1 --2- 172.21.15.146:0/2054462618 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c05670ca0 0x557c0566fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.327+0000 7fd7063d2b80 1 --2- 172.21.15.146:0/2054462618 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c056b6b60 0x557c056b6f30 unknown :-1 s=CLOSED pgs=2319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.327+0000 7fd7063d2b80 1 --2- 172.21.15.146:0/2054462618 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557c05672a70 0x557c0566f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.327+0000 7fd7063d2b80 1 -- 172.21.15.146:0/2054462618 >> 172.21.15.146:0/2054462618 conn(0x557c05671140 msgr2=0x557c05671510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:48.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.327+0000 7fd7063d2b80 1 -- 172.21.15.146:0/2054462618 shutdown_connections 2023-10-06T11:19:48.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.327+0000 7fd7063d2b80 1 -- 172.21.15.146:0/2054462618 wait complete. 2023-10-06T11:19:48.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.327+0000 7fd7063d2b80 1 -- start start 2023-10-06T11:19:48.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.328+0000 7fd7063d2b80 1 Processor -- start 2023-10-06T11:19:48.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.328+0000 7fd7063d2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c05670ca0 0x557c056b2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.328+0000 7fd7063d2b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c05672a70 0x557c056972f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.328+0000 7fd7063d2b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557c056b6b60 0x557c056b9f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.328+0000 7fd7063d2b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c055c0130 con 0x557c05672a70 2023-10-06T11:19:48.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.328+0000 7fd7063d2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c0556b960 con 0x557c05670ca0 2023-10-06T11:19:48.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.328+0000 7fd7063d2b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x557c05586f70 con 0x557c056b6b60 2023-10-06T11:19:48.342 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.328+0000 7fd7063d2b80 10 client.0 _ll_register_callbacks cb 0x557c0545d000 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:19:48.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.329+0000 7fd6ee59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c05672a70 0x557c056972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.329+0000 7fd6ee59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c05672a70 0x557c056972f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38026/0 (socket says 172.21.15.146:38026) 2023-10-06T11:19:48.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.329+0000 7fd6ee59c700 1 -- 172.21.15.146:0/2458279310 learned_addr learned my addr 172.21.15.146:0/2458279310 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:48.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.329+0000 7fd6f6d9d700 1 --2- 172.21.15.146:0/2458279310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c05670ca0 0x557c056b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.329+0000 7fd6f759e700 1 --2- 172.21.15.146:0/2458279310 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557c056b6b60 0x557c056b9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.329+0000 7fd6ee59c700 1 -- 172.21.15.146:0/2458279310 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557c056b6b60 msgr2=0x557c056b9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:48.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.329+0000 7fd6ee59c700 1 --2- 172.21.15.146:0/2458279310 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557c056b6b60 0x557c056b9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.329+0000 7fd6ee59c700 1 -- 172.21.15.146:0/2458279310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c05670ca0 msgr2=0x557c056b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:48.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.329+0000 7fd6ee59c700 1 --2- 172.21.15.146:0/2458279310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c05670ca0 0x557c056b2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.329+0000 7fd6ee59c700 1 -- 172.21.15.146:0/2458279310 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f813cb80 con 0x557c05672a70 2023-10-06T11:19:48.343 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.329+0000 7fd6ee59c700 1 --2- 172.21.15.146:0/2458279310 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c05672a70 0x557c056972f0 secure :-1 s=READY pgs=2320 cs=0 l=1 rev1=1 crypto rx=0x7fd6e00165b0 tx=0x7fd6e001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bd58b1711e7fbf8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:48.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.329+0000 7fd6d57fa700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:19:48.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.329+0000 7fd6d57fa700 1 -- 172.21.15.146:0/2458279310 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e0016e60 con 0x557c05672a70 2023-10-06T11:19:48.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.329+0000 7fd6d57fa700 1 -- 172.21.15.146:0/2458279310 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(180..180 src has 1..180) v4 ==== 6231+0+0 (secure 0 0 0) 0x7fd6e0023410 con 0x557c05672a70 2023-10-06T11:19:48.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.329+0000 7fd7063d2b80 1 -- 172.21.15.146:0/2458279310 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557c05664760 con 0x557c05672a70 2023-10-06T11:19:48.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.329+0000 7fd6d57fa700 1 -- 172.21.15.146:0/2458279310 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=150) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd6e00237e0 con 0x557c05672a70 2023-10-06T11:19:48.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.329+0000 7fd7063d2b80 10 client.10815 fetch_fsmap learned FSMap version 150 2023-10-06T11:19:48.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.329+0000 7fd7063d2b80 1 -- 172.21.15.146:0/2458279310 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=150,monmap=2+}) v3 -- 0x557c053fd0b0 con 0x557c05672a70 2023-10-06T11:19:48.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.329+0000 7fd6d57fa700 1 -- 172.21.15.146:0/2458279310 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557c05664760 con 0x557c05672a70 2023-10-06T11:19:48.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.330+0000 7fd6d57fa700 1 -- 172.21.15.146:0/2458279310 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 150) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd6e0023940 con 0x557c05672a70 2023-10-06T11:19:48.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.330+0000 7fd7063d2b80 10 client.10815 fetch_fsmap finished waiting for FSMap version 150 2023-10-06T11:19:48.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.330+0000 7fd7063d2b80 10 client.10815 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2023-10-06T11:19:48.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.330+0000 7fd7063d2b80 20 client.10815 populate_metadata read hostname 'smithi146' 2023-10-06T11:19:48.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.330+0000 7fd7063d2b80 1 --2- 172.21.15.146:0/2458279310 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x557c056b1d30 0x557c056b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.330+0000 7fd7063d2b80 4 client.10815 mds_command: new command op to 10461 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:19:48.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.330+0000 7fd7063d2b80 1 -- 172.21.15.146:0/2458279310 --> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557c05641690 con 0x557c056b1d30 2023-10-06T11:19:48.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.330+0000 7fd6f6d9d700 1 --2- 172.21.15.146:0/2458279310 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x557c056b1d30 0x557c056b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.330+0000 7fd6d57fa700 10 client.10815 ms_handle_connect on v2:172.21.15.146:6835/2322816938 2023-10-06T11:19:48.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.330+0000 7fd6f6d9d700 1 --2- 172.21.15.146:0/2458279310 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x557c056b1d30 0x557c056b2cc0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92d1396480db66b1 server_cookie=2c6168622c930326 in_seq=0 out_seq=0 2023-10-06T11:19:48.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.330+0000 7fd6d57fa700 1 -- 172.21.15.146:0/2458279310 <== mds.0 v2:172.21.15.146:6835/2322816938 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x557c05641690 con 0x557c056b1d30 2023-10-06T11:19:48.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.330+0000 7fd6d57fa700 10 client.10815 handle_command_reply: tid=0 2023-10-06T11:19:48.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.330+0000 7fd7063d2b80 1 client.10815 shutdown 2023-10-06T11:19:48.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.331+0000 7fd7063d2b80 1 -- 172.21.15.146:0/2458279310 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c05672a70 msgr2=0x557c056972f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:48.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.331+0000 7fd7063d2b80 1 --2- 172.21.15.146:0/2458279310 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c05672a70 0x557c056972f0 secure :-1 s=READY pgs=2320 cs=0 l=1 rev1=1 crypto rx=0x7fd6e00165b0 tx=0x7fd6e001a000 comp rx=0 tx=0).stop 2023-10-06T11:19:48.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.331+0000 7fd7063d2b80 1 -- 172.21.15.146:0/2458279310 shutdown_connections 2023-10-06T11:19:48.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.331+0000 7fd7063d2b80 1 --2- 172.21.15.146:0/2458279310 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x557c056b1d30 0x557c056b2cc0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.331+0000 7fd7063d2b80 1 --2- 172.21.15.146:0/2458279310 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557c056b6b60 0x557c056b9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.331+0000 7fd7063d2b80 1 --2- 172.21.15.146:0/2458279310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c05670ca0 0x557c056b2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.331+0000 7fd7063d2b80 1 --2- 172.21.15.146:0/2458279310 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c05672a70 0x557c056972f0 unknown :-1 s=CLOSED pgs=2320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.331+0000 7fd6d57fa700 0 client.10815 ms_handle_reset on v2:172.21.15.146:6835/2322816938 2023-10-06T11:19:48.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.331+0000 7fd7063d2b80 1 -- 172.21.15.146:0/2458279310 >> 172.21.15.146:0/2458279310 conn(0x557c05671140 msgr2=0x557c056b6010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:48.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.331+0000 7fd7063d2b80 1 -- 172.21.15.146:0/2458279310 shutdown_connections 2023-10-06T11:19:48.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.331+0000 7fd7063d2b80 1 -- 172.21.15.146:0/2458279310 wait complete. 2023-10-06T11:19:48.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.331+0000 7fd7063d2b80 20 client.10815 trim_cache size 0 max 16384 2023-10-06T11:19:48.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.347+0000 7fd7063d2b80 1 Processor -- start 2023-10-06T11:19:48.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.347+0000 7fd7063d2b80 1 -- start start 2023-10-06T11:19:48.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.348+0000 7fd7063d2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c05671140 0x557c0566bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.348+0000 7fd7063d2b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557c05670ca0 0x557c0569c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.348+0000 7fd7063d2b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c05672a70 0x557c0569cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.348+0000 7fd7063d2b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c05442f00 con 0x557c05672a70 2023-10-06T11:19:48.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.348+0000 7fd7063d2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c05671f10 con 0x557c05671140 2023-10-06T11:19:48.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.348+0000 7fd7063d2b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x557c0566a420 con 0x557c05670ca0 2023-10-06T11:19:48.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.348+0000 7fd6f759e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c05672a70 0x557c0569cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.348+0000 7fd6f759e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c05672a70 0x557c0569cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38040/0 (socket says 172.21.15.146:38040) 2023-10-06T11:19:48.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.348+0000 7fd6f759e700 1 -- 172.21.15.146:0/464963732 learned_addr learned my addr 172.21.15.146:0/464963732 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:48.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.348+0000 7fd6ee59c700 1 --2- 172.21.15.146:0/464963732 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557c05670ca0 0x557c0569c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.348+0000 7fd6f6d9d700 1 --2- 172.21.15.146:0/464963732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c05671140 0x557c0566bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.352 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.348+0000 7fd6f759e700 1 -- 172.21.15.146:0/464963732 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557c05670ca0 msgr2=0x557c0569c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:48.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.348+0000 7fd6f759e700 1 --2- 172.21.15.146:0/464963732 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557c05670ca0 0x557c0569c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.348+0000 7fd6f759e700 1 -- 172.21.15.146:0/464963732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c05671140 msgr2=0x557c0566bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:48.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.348+0000 7fd6f759e700 1 --2- 172.21.15.146:0/464963732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c05671140 0x557c0566bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.348+0000 7fd6f759e700 1 -- 172.21.15.146:0/464963732 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c0558e850 con 0x557c05672a70 2023-10-06T11:19:48.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.348+0000 7fd6ee59c700 1 --2- 172.21.15.146:0/464963732 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557c05670ca0 0x557c0569c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:19:48.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.348+0000 7fd6f759e700 1 --2- 172.21.15.146:0/464963732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c05672a70 0x557c0569cee0 secure :-1 s=READY pgs=2321 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8067f60 tx=0x7fd6f000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1053fb36b1d3d3a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:48.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.348+0000 7fd6ecd99700 1 -- 172.21.15.146:0/464963732 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f000e040 con 0x557c05672a70 2023-10-06T11:19:48.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.348+0000 7fd6ecd99700 1 -- 172.21.15.146:0/464963732 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f001a070 con 0x557c05672a70 2023-10-06T11:19:48.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.348+0000 7fd6ecd99700 1 -- 172.21.15.146:0/464963732 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f0016840 con 0x557c05672a70 2023-10-06T11:19:48.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.349+0000 7fd7063d2b80 1 -- 172.21.15.146:0/464963732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c05672a70 msgr2=0x557c0569cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:48.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.349+0000 7fd7063d2b80 1 --2- 172.21.15.146:0/464963732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c05672a70 0x557c0569cee0 secure :-1 s=READY pgs=2321 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8067f60 tx=0x7fd6f000b040 comp rx=0 tx=0).stop 2023-10-06T11:19:48.353 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.349+0000 7fd7063d2b80 1 -- 172.21.15.146:0/464963732 shutdown_connections 2023-10-06T11:19:48.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.349+0000 7fd7063d2b80 1 --2- 172.21.15.146:0/464963732 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c05672a70 0x557c0569cee0 unknown :-1 s=CLOSED pgs=2321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.349+0000 7fd7063d2b80 1 --2- 172.21.15.146:0/464963732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c05671140 0x557c0566bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.349+0000 7fd7063d2b80 1 --2- 172.21.15.146:0/464963732 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557c05670ca0 0x557c0569c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.349+0000 7fd7063d2b80 1 -- 172.21.15.146:0/464963732 >> 172.21.15.146:0/464963732 conn(0x557c056b7200 msgr2=0x557c056998d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:48.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.349+0000 7fd7063d2b80 1 -- 172.21.15.146:0/464963732 shutdown_connections 2023-10-06T11:19:48.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.349+0000 7fd7063d2b80 1 -- 172.21.15.146:0/464963732 wait complete. 2023-10-06T11:19:48.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.349+0000 7fd7063d2b80 1 -- start start 2023-10-06T11:19:48.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.350+0000 7fd7063d2b80 1 Processor -- start 2023-10-06T11:19:48.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.350+0000 7fd7063d2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c05670ca0 0x557c0571c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.350+0000 7fd7063d2b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c05671140 0x557c056ac330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.350+0000 7fd7063d2b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557c05672a70 0x557c056cf740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.350+0000 7fd7063d2b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c056acdb0 con 0x557c05671140 2023-10-06T11:19:48.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.350+0000 7fd7063d2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c056b0f80 con 0x557c05670ca0 2023-10-06T11:19:48.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.350+0000 7fd7063d2b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x557c056cefd0 con 0x557c05672a70 2023-10-06T11:19:48.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.351+0000 7fd7063d2b80 10 client.0 _ll_register_callbacks cb 0x557c0545d000 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:19:48.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.351+0000 7fd6ee59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c05671140 0x557c056ac330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.351+0000 7fd6ee59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c05671140 0x557c056ac330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38044/0 (socket says 172.21.15.146:38044) 2023-10-06T11:19:48.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.351+0000 7fd6ee59c700 1 -- 172.21.15.146:0/2036653255 learned_addr learned my addr 172.21.15.146:0/2036653255 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:48.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.351+0000 7fd6f759e700 1 --2- 172.21.15.146:0/2036653255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557c05672a70 0x557c056cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.351+0000 7fd6f6d9d700 1 --2- 172.21.15.146:0/2036653255 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c05670ca0 0x557c0571c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.351+0000 7fd6ee59c700 1 -- 172.21.15.146:0/2036653255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557c05672a70 msgr2=0x557c056cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:48.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.351+0000 7fd6ee59c700 1 --2- 172.21.15.146:0/2036653255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557c05672a70 0x557c056cf740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.351+0000 7fd6ee59c700 1 -- 172.21.15.146:0/2036653255 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c05670ca0 msgr2=0x557c0571c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:48.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.351+0000 7fd6ee59c700 1 --2- 172.21.15.146:0/2036653255 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c05670ca0 0x557c0571c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.351+0000 7fd6ee59c700 1 -- 172.21.15.146:0/2036653255 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f0015390 con 0x557c05671140 2023-10-06T11:19:48.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.351+0000 7fd6f759e700 1 --2- 172.21.15.146:0/2036653255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557c05672a70 0x557c056cf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:19:48.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.351+0000 7fd6ee59c700 1 --2- 172.21.15.146:0/2036653255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c05671140 0x557c056ac330 secure :-1 s=READY pgs=2322 cs=0 l=1 rev1=1 crypto rx=0x557c056bac10 tx=0x7fd6e001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14f472d8a56e533a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:48.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.351+0000 7fd6d57fa700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:19:48.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.351+0000 7fd6d57fa700 1 -- 172.21.15.146:0/2036653255 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e0023410 con 0x557c05671140 2023-10-06T11:19:48.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.351+0000 7fd6d57fa700 1 -- 172.21.15.146:0/2036653255 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(180..180 src has 1..180) v4 ==== 6231+0+0 (secure 0 0 0) 0x7fd6e002c440 con 0x557c05671140 2023-10-06T11:19:48.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.351+0000 7fd7063d2b80 1 -- 172.21.15.146:0/2036653255 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd6e80563f0 con 0x557c05671140 2023-10-06T11:19:48.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.351+0000 7fd6d57fa700 1 -- 172.21.15.146:0/2036653255 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=150) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd6e002c810 con 0x557c05671140 2023-10-06T11:19:48.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.351+0000 7fd7063d2b80 10 client.10821 fetch_fsmap learned FSMap version 150 2023-10-06T11:19:48.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.351+0000 7fd7063d2b80 1 -- 172.21.15.146:0/2036653255 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=150,monmap=2+}) v3 -- 0x557c05575540 con 0x557c05671140 2023-10-06T11:19:48.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.351+0000 7fd6d57fa700 1 -- 172.21.15.146:0/2036653255 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e0048070 con 0x557c05671140 2023-10-06T11:19:48.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.351+0000 7fd6d57fa700 1 -- 172.21.15.146:0/2036653255 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 150) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fd6e002c970 con 0x557c05671140 2023-10-06T11:19:48.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.351+0000 7fd7063d2b80 10 client.10821 fetch_fsmap finished waiting for FSMap version 150 2023-10-06T11:19:48.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.351+0000 7fd7063d2b80 10 client.10821 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2023-10-06T11:19:48.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.351+0000 7fd7063d2b80 20 client.10821 populate_metadata read hostname 'smithi146' 2023-10-06T11:19:48.365 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.351+0000 7fd7063d2b80 1 --2- 172.21.15.146:0/2036653255 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x557c056b6b60 0x557c056959e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.351+0000 7fd7063d2b80 4 client.10821 mds_command: new command op to 10461 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}] 2023-10-06T11:19:48.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.351+0000 7fd7063d2b80 1 -- 172.21.15.146:0/2036653255 --> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive", "repair"]}) v1 -- 0x557c05562ed0 con 0x557c056b6b60 2023-10-06T11:19:48.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.352+0000 7fd6f6d9d700 1 --2- 172.21.15.146:0/2036653255 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x557c056b6b60 0x557c056959e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.352+0000 7fd6d57fa700 10 client.10821 ms_handle_connect on v2:172.21.15.146:6835/2322816938 2023-10-06T11:19:48.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.352+0000 7fd6f6d9d700 1 --2- 172.21.15.146:0/2036653255 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x557c056b6b60 0x557c056959e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe33219124f8ff71 server_cookie=7101bd638e6c656c in_seq=0 out_seq=0 2023-10-06T11:19:48.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.352+0000 7fd6d57fa700 1 -- 172.21.15.146:0/2036653255 <== mds.0 v2:172.21.15.146:6835/2322816938 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x557c05562ed0 con 0x557c056b6b60 2023-10-06T11:19:48.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.352+0000 7fd6d57fa700 10 client.10821 handle_command_reply: tid=0 2023-10-06T11:19:48.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.352+0000 7fd7063d2b80 1 client.10821 shutdown 2023-10-06T11:19:48.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.353+0000 7fd7063d2b80 1 -- 172.21.15.146:0/2036653255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c05671140 msgr2=0x557c056ac330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:48.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.353+0000 7fd7063d2b80 1 --2- 172.21.15.146:0/2036653255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c05671140 0x557c056ac330 secure :-1 s=READY pgs=2322 cs=0 l=1 rev1=1 crypto rx=0x557c056bac10 tx=0x7fd6e001e000 comp rx=0 tx=0).stop 2023-10-06T11:19:48.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.353+0000 7fd7063d2b80 1 -- 172.21.15.146:0/2036653255 shutdown_connections 2023-10-06T11:19:48.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.353+0000 7fd7063d2b80 1 --2- 172.21.15.146:0/2036653255 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x557c056b6b60 0x557c056959e0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.353+0000 7fd7063d2b80 1 --2- 172.21.15.146:0/2036653255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x557c05672a70 0x557c056cf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.353+0000 7fd6d57fa700 0 client.10821 ms_handle_reset on v2:172.21.15.146:6835/2322816938 2023-10-06T11:19:48.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.353+0000 7fd7063d2b80 1 --2- 172.21.15.146:0/2036653255 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c05670ca0 0x557c0571c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.353+0000 7fd7063d2b80 1 --2- 172.21.15.146:0/2036653255 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x557c05671140 0x557c056ac330 unknown :-1 s=CLOSED pgs=2322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.353+0000 7fd7063d2b80 1 -- 172.21.15.146:0/2036653255 >> 172.21.15.146:0/2036653255 conn(0x557c056b7200 msgr2=0x557c0569c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:48.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.353+0000 7fd7063d2b80 1 -- 172.21.15.146:0/2036653255 shutdown_connections 2023-10-06T11:19:48.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.353+0000 7fd7063d2b80 1 -- 172.21.15.146:0/2036653255 wait complete. 2023-10-06T11:19:48.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.353+0000 7fd7063d2b80 20 client.10821 trim_cache size 0 max 16384 2023-10-06T11:19:48.368 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:19:48.368 INFO:teuthology.orchestra.run.smithi146.stdout: "return_code": 0, 2023-10-06T11:19:48.368 INFO:teuthology.orchestra.run.smithi146.stdout: "scrub_tag": "3bc026e5-e3ec-4ea0-ba32-62fb8dd0eb44", 2023-10-06T11:19:48.368 INFO:teuthology.orchestra.run.smithi146.stdout: "mode": "asynchronous" 2023-10-06T11:19:48.368 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:19:48.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.353+0000 7fd6fd0da700 1 -- 172.21.15.146:0/2179752730 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd6d8066f30 msgr2=0x7fd6d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:48.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.353+0000 7fd6fd0da700 1 --2- 172.21.15.146:0/2179752730 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd6d8066f30 0x7fd6d80693e0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fd6e00093f0 tx=0x7fd6e0008040 comp rx=0 tx=0).stop 2023-10-06T11:19:48.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.353+0000 7fd6fd0da700 1 -- 172.21.15.146:0/2179752730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6e4003a60 msgr2=0x7fd6f813c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:48.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.353+0000 7fd6fd0da700 1 --2- 172.21.15.146:0/2179752730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6e4003a60 0x7fd6f813c640 secure :-1 s=READY pgs=2318 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4004760 tx=0x7fd6e8015000 comp rx=0 tx=0).stop 2023-10-06T11:19:48.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.353+0000 7fd6fd0da700 1 -- 172.21.15.146:0/2179752730 shutdown_connections 2023-10-06T11:19:48.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.353+0000 7fd6fd0da700 1 --2- 172.21.15.146:0/2179752730 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd6d8066f30 0x7fd6d80693e0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.353+0000 7fd6fd0da700 1 --2- 172.21.15.146:0/2179752730 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd6f80aecd0 0x7fd6f8151930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.353+0000 7fd6fd0da700 1 --2- 172.21.15.146:0/2179752730 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd6e4003a60 0x7fd6f813c640 unknown :-1 s=CLOSED pgs=2318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.353+0000 7fd6fd0da700 1 --2- 172.21.15.146:0/2179752730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6f80ae860 0x7fd6f81513f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.353+0000 7fd6fd0da700 1 -- 172.21.15.146:0/2179752730 >> 172.21.15.146:0/2179752730 conn(0x7fd6f80cddc0 msgr2=0x7fd6f8150ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:48.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.354+0000 7fd6fd0da700 1 -- 172.21.15.146:0/2179752730 shutdown_connections 2023-10-06T11:19:48.370 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.354+0000 7fd6fd0da700 1 -- 172.21.15.146:0/2179752730 wait complete. 2023-10-06T11:19:48.370 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.13:0 scrub status 2023-10-06T11:19:48.486 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.485+0000 7fbb29091700 1 Processor -- start 2023-10-06T11:19:48.487 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.485+0000 7fbb29091700 1 -- start start 2023-10-06T11:19:48.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.485+0000 7fbb29091700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb24159450 0x7fbb24159820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.485+0000 7fbb29091700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbb2415dd70 0x7fbb240b0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.485+0000 7fbb29091700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb240b0bc0 con 0x7fbb240b0760 2023-10-06T11:19:48.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.485+0000 7fbb29091700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb240b2f20 con 0x7fbb2415dd70 2023-10-06T11:19:48.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.485+0000 7fbb29091700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb240cb8a0 con 0x7fbb24159450 2023-10-06T11:19:48.489 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.486+0000 7fbb1a59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbb2415dd70 0x7fbb240b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.486+0000 7fbb1a59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fbb2415dd70 0x7fbb240b0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38060/0 (socket says 172.21.15.146:38060) 2023-10-06T11:19:48.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.486+0000 7fbb1a59c700 1 -- 172.21.15.146:0/269427703 learned_addr learned my addr 172.21.15.146:0/269427703 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:48.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.486+0000 7fbb22d9d700 1 --2- 172.21.15.146:0/269427703 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb24159450 0x7fbb24159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.486+0000 7fbb1a59c700 1 -- 172.21.15.146:0/269427703 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb24159450 msgr2=0x7fbb24159820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:48.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.486+0000 7fbb1a59c700 1 --2- 172.21.15.146:0/269427703 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb24159450 0x7fbb24159820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.486+0000 7fbb1a59c700 1 -- 172.21.15.146:0/269427703 >> v1:172.21.15.151:6789/0 conn(0x7fbb240b0760 legacy=0x7fbb240aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:48.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.486+0000 7fbb1a59c700 1 -- 172.21.15.146:0/269427703 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb240b2960 con 0x7fbb2415dd70 2023-10-06T11:19:48.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.486+0000 7fbb1a59c700 1 --2- 172.21.15.146:0/269427703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb2415dd70 0x7fbb240b0220 secure :-1 s=READY pgs=2323 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c0099b0 tx=0x7fbb0c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f62b193e36641636 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:48.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.486+0000 7fbb2259c700 1 -- 172.21.15.146:0/269427703 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c00b820 con 0x7fbb2415dd70 2023-10-06T11:19:48.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.486+0000 7fbb2259c700 1 -- 172.21.15.146:0/269427703 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb0c00b980 con 0x7fbb2415dd70 2023-10-06T11:19:48.490 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.486+0000 7fbb2259c700 1 -- 172.21.15.146:0/269427703 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c00bd20 con 0x7fbb2415dd70 2023-10-06T11:19:48.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.487+0000 7fbb29091700 1 -- 172.21.15.146:0/269427703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb2415dd70 msgr2=0x7fbb240b0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:48.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.487+0000 7fbb29091700 1 --2- 172.21.15.146:0/269427703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb2415dd70 0x7fbb240b0220 secure :-1 s=READY pgs=2323 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c0099b0 tx=0x7fbb0c009250 comp rx=0 tx=0).stop 2023-10-06T11:19:48.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.487+0000 7fbb29091700 1 -- 172.21.15.146:0/269427703 shutdown_connections 2023-10-06T11:19:48.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.487+0000 7fbb29091700 1 --2- 172.21.15.146:0/269427703 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb24159450 0x7fbb24159820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.487+0000 7fbb29091700 1 --2- 172.21.15.146:0/269427703 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb2415dd70 0x7fbb240b0220 unknown :-1 s=CLOSED pgs=2323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.487+0000 7fbb29091700 1 -- 172.21.15.146:0/269427703 >> 172.21.15.146:0/269427703 conn(0x7fbb2406eb10 msgr2=0x7fbb2406ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:48.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.487+0000 7fbb29091700 1 -- 172.21.15.146:0/269427703 shutdown_connections 2023-10-06T11:19:48.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.487+0000 7fbb29091700 1 -- 172.21.15.146:0/269427703 wait complete. 2023-10-06T11:19:48.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.488+0000 7fbb29091700 1 Processor -- start 2023-10-06T11:19:48.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.488+0000 7fbb29091700 1 -- start start 2023-10-06T11:19:48.494 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.489+0000 7fbb29091700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbb240b0760 0x7fbb240c8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.489+0000 7fbb29091700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb24159450 0x7fbb240c8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.489+0000 7fbb29091700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb2415dd70 0x7fbb240c3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.489+0000 7fbb29091700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb241573e0 con 0x7fbb24159450 2023-10-06T11:19:48.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.489+0000 7fbb29091700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb241576c0 con 0x7fbb240b0760 2023-10-06T11:19:48.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.489+0000 7fbb29091700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb241579a0 con 0x7fbb2415dd70 2023-10-06T11:19:48.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.489+0000 7fbb1a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb24159450 0x7fbb240c8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.489+0000 7fbb1a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb24159450 0x7fbb240c8960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38064/0 (socket says 172.21.15.146:38064) 2023-10-06T11:19:48.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.489+0000 7fbb1a59c700 1 -- 172.21.15.146:0/3030775265 learned_addr learned my addr 172.21.15.146:0/3030775265 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:48.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.489+0000 7fbb22d9d700 1 --2- 172.21.15.146:0/3030775265 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbb240b0760 0x7fbb240c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.489+0000 7fbb2359e700 1 --2- 172.21.15.146:0/3030775265 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb2415dd70 0x7fbb240c3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.489+0000 7fbb1a59c700 1 -- 172.21.15.146:0/3030775265 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb2415dd70 msgr2=0x7fbb240c3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:48.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.489+0000 7fbb1a59c700 1 --2- 172.21.15.146:0/3030775265 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb2415dd70 0x7fbb240c3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.489+0000 7fbb1a59c700 1 -- 172.21.15.146:0/3030775265 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbb240b0760 msgr2=0x7fbb240c8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:48.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.489+0000 7fbb1a59c700 1 --2- 172.21.15.146:0/3030775265 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbb240b0760 0x7fbb240c8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.489+0000 7fbb1a59c700 1 -- 172.21.15.146:0/3030775265 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb0c0094f0 con 0x7fbb24159450 2023-10-06T11:19:48.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.489+0000 7fbb1a59c700 1 --2- 172.21.15.146:0/3030775265 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb24159450 0x7fbb240c8960 secure :-1 s=READY pgs=2324 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c009290 tx=0x7fbb0c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:48.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.489+0000 7fbb1b7fe700 1 -- 172.21.15.146:0/3030775265 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c011c10 con 0x7fbb24159450 2023-10-06T11:19:48.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.489+0000 7fbb1b7fe700 1 -- 172.21.15.146:0/3030775265 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb0c020070 con 0x7fbb24159450 2023-10-06T11:19:48.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.489+0000 7fbb29091700 1 -- 172.21.15.146:0/3030775265 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb24157c80 con 0x7fbb24159450 2023-10-06T11:19:48.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.489+0000 7fbb1b7fe700 1 -- 172.21.15.146:0/3030775265 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c01b450 con 0x7fbb24159450 2023-10-06T11:19:48.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.489+0000 7fbb29091700 1 -- 172.21.15.146:0/3030775265 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb240c4540 con 0x7fbb24159450 2023-10-06T11:19:48.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.491+0000 7fbb1b7fe700 1 -- 172.21.15.146:0/3030775265 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbb0c022030 con 0x7fbb24159450 2023-10-06T11:19:48.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.491+0000 7fbb1b7fe700 1 --2- 172.21.15.146:0/3030775265 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbb04066f30 0x7fbb040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.491+0000 7fbb1b7fe700 1 -- 172.21.15.146:0/3030775265 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6231+0+0 (secure 0 0 0) 0x7fbb0c0863b0 con 0x7fbb24159450 2023-10-06T11:19:48.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.491+0000 7fbb22d9d700 1 --2- 172.21.15.146:0/3030775265 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbb04066f30 0x7fbb040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.497 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.492+0000 7fbb22d9d700 1 --2- 172.21.15.146:0/3030775265 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbb04066f30 0x7fbb040693e0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fbb1400acb0 tx=0x7fbb14008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:48.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.493+0000 7fbb32389b80 1 Processor -- start 2023-10-06T11:19:48.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.493+0000 7fbb32389b80 1 -- start start 2023-10-06T11:19:48.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.494+0000 7fbb32389b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562394516ae0 0x562394516eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.494+0000 7fbb32389b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623944d29f0 0x5623944cf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.494+0000 7fbb32389b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5623944d0c20 0x5623944cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.494+0000 7fbb32389b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x56239444fcd0 con 0x562394516ae0 2023-10-06T11:19:48.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.494+0000 7fbb32389b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562394426ac0 con 0x5623944d29f0 2023-10-06T11:19:48.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.494+0000 7fbb32389b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5623944242c0 con 0x5623944d0c20 2023-10-06T11:19:48.499 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.494+0000 7fbb22d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562394516ae0 0x562394516eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.494+0000 7fbb22d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562394516ae0 0x562394516eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38074/0 (socket says 172.21.15.146:38074) 2023-10-06T11:19:48.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.494+0000 7fbb22d9d700 1 -- 172.21.15.146:0/1512432356 learned_addr learned my addr 172.21.15.146:0/1512432356 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:48.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.494+0000 7fbb2359e700 1 --2- 172.21.15.146:0/1512432356 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5623944d0c20 0x5623944cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.494+0000 7fbb1a59c700 1 --2- 172.21.15.146:0/1512432356 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623944d29f0 0x5623944cf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.500 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.494+0000 7fbb22d9d700 1 -- 172.21.15.146:0/1512432356 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5623944d0c20 msgr2=0x5623944cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:48.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.494+0000 7fbb22d9d700 1 --2- 172.21.15.146:0/1512432356 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5623944d0c20 0x5623944cfb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.494+0000 7fbb22d9d700 1 -- 172.21.15.146:0/1512432356 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623944d29f0 msgr2=0x5623944cf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:48.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.494+0000 7fbb22d9d700 1 --2- 172.21.15.146:0/1512432356 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623944d29f0 0x5623944cf5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.494+0000 7fbb22d9d700 1 -- 172.21.15.146:0/1512432356 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623942ba2c0 con 0x562394516ae0 2023-10-06T11:19:48.501 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.495+0000 7fbb22d9d700 1 --2- 172.21.15.146:0/1512432356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562394516ae0 0x562394516eb0 secure :-1 s=READY pgs=2325 cs=0 l=1 rev1=1 crypto rx=0x7fbb1400fe20 tx=0x7fbb14017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73bed3ac9b7c3455 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:48.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.498+0000 7fbb03fff700 1 -- 172.21.15.146:0/1512432356 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1400aea0 con 0x562394516ae0 2023-10-06T11:19:48.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.498+0000 7fbb03fff700 1 -- 172.21.15.146:0/1512432356 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1400c040 con 0x562394516ae0 2023-10-06T11:19:48.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.498+0000 7fbb03fff700 1 -- 172.21.15.146:0/1512432356 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb14015d40 con 0x562394516ae0 2023-10-06T11:19:48.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.499+0000 7fbb32389b80 1 -- 172.21.15.146:0/1512432356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562394516ae0 msgr2=0x562394516eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:48.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.499+0000 7fbb32389b80 1 --2- 172.21.15.146:0/1512432356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562394516ae0 0x562394516eb0 secure :-1 s=READY pgs=2325 cs=0 l=1 rev1=1 crypto rx=0x7fbb1400fe20 tx=0x7fbb14017000 comp rx=0 tx=0).stop 2023-10-06T11:19:48.506 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.499+0000 7fbb32389b80 1 -- 172.21.15.146:0/1512432356 shutdown_connections 2023-10-06T11:19:48.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.499+0000 7fbb32389b80 1 --2- 172.21.15.146:0/1512432356 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5623944d0c20 0x5623944cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.499+0000 7fbb32389b80 1 --2- 172.21.15.146:0/1512432356 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562394516ae0 0x562394516eb0 unknown :-1 s=CLOSED pgs=2325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.499+0000 7fbb32389b80 1 --2- 172.21.15.146:0/1512432356 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623944d29f0 0x5623944cf5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.499+0000 7fbb32389b80 1 -- 172.21.15.146:0/1512432356 >> 172.21.15.146:0/1512432356 conn(0x5623944d10c0 msgr2=0x5623944d1490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:48.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.499+0000 7fbb32389b80 1 -- 172.21.15.146:0/1512432356 shutdown_connections 2023-10-06T11:19:48.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.499+0000 7fbb32389b80 1 -- 172.21.15.146:0/1512432356 wait complete. 2023-10-06T11:19:48.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.500+0000 7fbb32389b80 1 -- start start 2023-10-06T11:19:48.507 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.500+0000 7fbb32389b80 1 Processor -- start 2023-10-06T11:19:48.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.501+0000 7fbb32389b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5623944d0c20 0x5623945128d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.501+0000 7fbb32389b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5623944d29f0 0x5623944fa080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.501+0000 7fbb32389b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562394516ae0 0x5623944fca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.501+0000 7fbb32389b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623944200b0 con 0x5623944d29f0 2023-10-06T11:19:48.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.501+0000 7fbb32389b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623943cb8e0 con 0x562394516ae0 2023-10-06T11:19:48.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.501+0000 7fbb32389b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5623943e6ef0 con 0x5623944d0c20 2023-10-06T11:19:48.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.501+0000 7fbb32389b80 10 client.0 _ll_register_callbacks cb 0x5623942bcf80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:19:48.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.501+0000 7fbb1a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5623944d29f0 0x5623944fa080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.508 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.501+0000 7fbb1a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5623944d29f0 0x5623944fa080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38088/0 (socket says 172.21.15.146:38088) 2023-10-06T11:19:48.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.501+0000 7fbb1a59c700 1 -- 172.21.15.146:0/686106774 learned_addr learned my addr 172.21.15.146:0/686106774 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:48.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.501+0000 7fbb2359e700 1 --2- 172.21.15.146:0/686106774 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562394516ae0 0x5623944fca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.501+0000 7fbb22d9d700 1 --2- 172.21.15.146:0/686106774 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5623944d0c20 0x5623945128d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.501+0000 7fbb1a59c700 1 -- 172.21.15.146:0/686106774 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5623944d0c20 msgr2=0x5623945128d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:48.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.501+0000 7fbb1a59c700 1 --2- 172.21.15.146:0/686106774 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5623944d0c20 0x5623945128d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.501+0000 7fbb1a59c700 1 -- 172.21.15.146:0/686106774 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562394516ae0 msgr2=0x5623944fca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:48.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.501+0000 7fbb1a59c700 1 --2- 172.21.15.146:0/686106774 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562394516ae0 0x5623944fca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.501+0000 7fbb1a59c700 1 -- 172.21.15.146:0/686106774 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb1400fa50 con 0x5623944d29f0 2023-10-06T11:19:48.509 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.501+0000 7fbb22d9d700 1 --2- 172.21.15.146:0/686106774 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5623944d0c20 0x5623945128d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:19:48.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.501+0000 7fbb2359e700 1 --2- 172.21.15.146:0/686106774 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562394516ae0 0x5623944fca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:19:48.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.501+0000 7fbb1a59c700 1 --2- 172.21.15.146:0/686106774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5623944d29f0 0x5623944fa080 secure :-1 s=READY pgs=2326 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c00b3c0 tx=0x7fbb0c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d23ad86561c1e5f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:48.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.501+0000 7fbb017fa700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:19:48.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.501+0000 7fbb017fa700 1 -- 172.21.15.146:0/686106774 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c05e0f0 con 0x5623944d29f0 2023-10-06T11:19:48.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.501+0000 7fbb017fa700 1 -- 172.21.15.146:0/686106774 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(180..180 src has 1..180) v4 ==== 6231+0+0 (secure 0 0 0) 0x7fbb0c055470 con 0x5623944d29f0 2023-10-06T11:19:48.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.501+0000 7fbb32389b80 1 -- 172.21.15.146:0/686106774 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5623944c46e0 con 0x5623944d29f0 2023-10-06T11:19:48.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.501+0000 7fbb017fa700 1 -- 172.21.15.146:0/686106774 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=150) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbb0c0537e0 con 0x5623944d29f0 2023-10-06T11:19:48.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.501+0000 7fbb32389b80 10 client.10833 fetch_fsmap learned FSMap version 150 2023-10-06T11:19:48.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.501+0000 7fbb32389b80 1 -- 172.21.15.146:0/686106774 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=150,monmap=2+}) v3 -- 0x56239425d030 con 0x5623944d29f0 2023-10-06T11:19:48.510 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.501+0000 7fbb017fa700 1 -- 172.21.15.146:0/686106774 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5623944c46e0 con 0x5623944d29f0 2023-10-06T11:19:48.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.502+0000 7fbb017fa700 1 -- 172.21.15.146:0/686106774 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 150) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fbb0c0842f0 con 0x5623944d29f0 2023-10-06T11:19:48.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.502+0000 7fbb32389b80 10 client.10833 fetch_fsmap finished waiting for FSMap version 150 2023-10-06T11:19:48.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.502+0000 7fbb32389b80 10 client.10833 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2023-10-06T11:19:48.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.502+0000 7fbb32389b80 20 client.10833 populate_metadata read hostname 'smithi146' 2023-10-06T11:19:48.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.502+0000 7fbb32389b80 1 --2- 172.21.15.146:0/686106774 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x5623944f65c0 0x5623944f7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.502+0000 7fbb32389b80 4 client.10833 mds_command: new command op to 10461 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:19:48.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.502+0000 7fbb32389b80 1 -- 172.21.15.146:0/686106774 --> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5623944a1610 con 0x5623944f65c0 2023-10-06T11:19:48.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.502+0000 7fbb22d9d700 1 --2- 172.21.15.146:0/686106774 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x5623944f65c0 0x5623944f7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.502+0000 7fbb22d9d700 1 --2- 172.21.15.146:0/686106774 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x5623944f65c0 0x5623944f7bf0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c89393577f35613 server_cookie=2f078a98741acd1f in_seq=0 out_seq=0 2023-10-06T11:19:48.511 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.502+0000 7fbb017fa700 10 client.10833 ms_handle_connect on v2:172.21.15.146:6835/2322816938 2023-10-06T11:19:48.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.502+0000 7fbb017fa700 1 -- 172.21.15.146:0/686106774 <== mds.0 v2:172.21.15.146:6835/2322816938 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5623944a1610 con 0x5623944f65c0 2023-10-06T11:19:48.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.502+0000 7fbb017fa700 10 client.10833 handle_command_reply: tid=0 2023-10-06T11:19:48.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.503+0000 7fbb32389b80 1 client.10833 shutdown 2023-10-06T11:19:48.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.503+0000 7fbb32389b80 1 -- 172.21.15.146:0/686106774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5623944d29f0 msgr2=0x5623944fa080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:48.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.503+0000 7fbb32389b80 1 --2- 172.21.15.146:0/686106774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5623944d29f0 0x5623944fa080 secure :-1 s=READY pgs=2326 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c00b3c0 tx=0x7fbb0c008040 comp rx=0 tx=0).stop 2023-10-06T11:19:48.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.503+0000 7fbb32389b80 1 -- 172.21.15.146:0/686106774 shutdown_connections 2023-10-06T11:19:48.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.503+0000 7fbb32389b80 1 --2- 172.21.15.146:0/686106774 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x5623944f65c0 0x5623944f7bf0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.503+0000 7fbb32389b80 1 --2- 172.21.15.146:0/686106774 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562394516ae0 0x5623944fca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.503+0000 7fbb32389b80 1 --2- 172.21.15.146:0/686106774 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5623944d0c20 0x5623945128d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.503+0000 7fbb017fa700 0 client.10833 ms_handle_reset on v2:172.21.15.146:6835/2322816938 2023-10-06T11:19:48.512 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.503+0000 7fbb32389b80 1 --2- 172.21.15.146:0/686106774 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5623944d29f0 0x5623944fa080 unknown :-1 s=CLOSED pgs=2326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.503+0000 7fbb32389b80 1 -- 172.21.15.146:0/686106774 >> 172.21.15.146:0/686106774 conn(0x5623944d10c0 msgr2=0x562394514340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:48.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.503+0000 7fbb32389b80 1 -- 172.21.15.146:0/686106774 shutdown_connections 2023-10-06T11:19:48.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.503+0000 7fbb32389b80 1 -- 172.21.15.146:0/686106774 wait complete. 2023-10-06T11:19:48.513 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.503+0000 7fbb32389b80 20 client.10833 trim_cache size 0 max 16384 2023-10-06T11:19:48.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.520+0000 7fbb32389b80 1 Processor -- start 2023-10-06T11:19:48.522 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.520+0000 7fbb32389b80 1 -- start start 2023-10-06T11:19:48.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.521+0000 7fbb32389b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5623944d0c20 0x5623944cbc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.521+0000 7fbb32389b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5623944d29f0 0x5623945142c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.521+0000 7fbb32389b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562394516ae0 0x5623944cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.521+0000 7fbb32389b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623944f1930 con 0x5623944d29f0 2023-10-06T11:19:48.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.521+0000 7fbb32389b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562394513ee0 con 0x562394516ae0 2023-10-06T11:19:48.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.521+0000 7fbb32389b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5623942a2e80 con 0x5623944d0c20 2023-10-06T11:19:48.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.521+0000 7fbb1a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5623944d29f0 0x5623945142c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.521+0000 7fbb1a59c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5623944d29f0 0x5623945142c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38098/0 (socket says 172.21.15.146:38098) 2023-10-06T11:19:48.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.521+0000 7fbb1a59c700 1 -- 172.21.15.146:0/2051821461 learned_addr learned my addr 172.21.15.146:0/2051821461 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:48.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.521+0000 7fbb22d9d700 1 --2- 172.21.15.146:0/2051821461 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5623944d0c20 0x5623944cbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.521+0000 7fbb2359e700 1 --2- 172.21.15.146:0/2051821461 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562394516ae0 0x5623944cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.521+0000 7fbb1a59c700 1 -- 172.21.15.146:0/2051821461 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5623944d0c20 msgr2=0x5623944cbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:48.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.521+0000 7fbb1a59c700 1 --2- 172.21.15.146:0/2051821461 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5623944d0c20 0x5623944cbc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.521+0000 7fbb1a59c700 1 -- 172.21.15.146:0/2051821461 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562394516ae0 msgr2=0x5623944cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:48.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.521+0000 7fbb1a59c700 1 --2- 172.21.15.146:0/2051821461 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562394516ae0 0x5623944cc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.521+0000 7fbb1a59c700 1 -- 172.21.15.146:0/2051821461 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623943ee7d0 con 0x5623944d29f0 2023-10-06T11:19:48.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.521+0000 7fbb1a59c700 1 --2- 172.21.15.146:0/2051821461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5623944d29f0 0x5623945142c0 secure :-1 s=READY pgs=2327 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c055420 tx=0x7fbb0c06a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14faaf4358268b2f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:48.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.521+0000 7fbb18d99700 1 -- 172.21.15.146:0/2051821461 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c0537e0 con 0x5623944d29f0 2023-10-06T11:19:48.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.521+0000 7fbb18d99700 1 -- 172.21.15.146:0/2051821461 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb0c006e90 con 0x5623944d29f0 2023-10-06T11:19:48.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.521+0000 7fbb18d99700 1 -- 172.21.15.146:0/2051821461 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0c053990 con 0x5623944d29f0 2023-10-06T11:19:48.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.522+0000 7fbb32389b80 1 -- 172.21.15.146:0/2051821461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5623944d29f0 msgr2=0x5623945142c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:48.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.522+0000 7fbb32389b80 1 --2- 172.21.15.146:0/2051821461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5623944d29f0 0x5623945142c0 secure :-1 s=READY pgs=2327 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c055420 tx=0x7fbb0c06a000 comp rx=0 tx=0).stop 2023-10-06T11:19:48.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.522+0000 7fbb32389b80 1 -- 172.21.15.146:0/2051821461 shutdown_connections 2023-10-06T11:19:48.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.522+0000 7fbb32389b80 1 --2- 172.21.15.146:0/2051821461 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562394516ae0 0x5623944cc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.522+0000 7fbb32389b80 1 --2- 172.21.15.146:0/2051821461 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5623944d0c20 0x5623944cbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.522+0000 7fbb32389b80 1 --2- 172.21.15.146:0/2051821461 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5623944d29f0 0x5623945142c0 unknown :-1 s=CLOSED pgs=2327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.522+0000 7fbb32389b80 1 -- 172.21.15.146:0/2051821461 >> 172.21.15.146:0/2051821461 conn(0x5623944d10c0 msgr2=0x5623944d1490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:48.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.522+0000 7fbb32389b80 1 -- 172.21.15.146:0/2051821461 shutdown_connections 2023-10-06T11:19:48.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.522+0000 7fbb32389b80 1 -- 172.21.15.146:0/2051821461 wait complete. 2023-10-06T11:19:48.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.523+0000 7fbb32389b80 1 -- start start 2023-10-06T11:19:48.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.523+0000 7fbb32389b80 1 Processor -- start 2023-10-06T11:19:48.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.524+0000 7fbb32389b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623944d0c20 0x56239457a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.524+0000 7fbb32389b80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5623944d29f0 0x5623944fc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.524+0000 7fbb32389b80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562394516ae0 0x5623944fc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.524+0000 7fbb32389b80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x56239450fa30 con 0x562394516ae0 2023-10-06T11:19:48.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.524+0000 7fbb32389b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623944f8900 con 0x5623944d0c20 2023-10-06T11:19:48.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.524+0000 7fbb32389b80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5623944f7a70 con 0x5623944d29f0 2023-10-06T11:19:48.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.524+0000 7fbb32389b80 10 client.0 _ll_register_callbacks cb 0x5623942bcf80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:19:48.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.524+0000 7fbb2359e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562394516ae0 0x5623944fc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.524+0000 7fbb2359e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562394516ae0 0x5623944fc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:38100/0 (socket says 172.21.15.146:38100) 2023-10-06T11:19:48.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.524+0000 7fbb1a59c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5623944d29f0 0x5623944fc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.524+0000 7fbb22d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623944d0c20 0x56239457a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.524+0000 7fbb2359e700 1 -- 172.21.15.146:0/3673486062 learned_addr learned my addr 172.21.15.146:0/3673486062 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:19:48.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.524+0000 7fbb2359e700 1 -- 172.21.15.146:0/3673486062 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5623944d29f0 msgr2=0x5623944fc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:48.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.524+0000 7fbb2359e700 1 --2- 172.21.15.146:0/3673486062 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5623944d29f0 0x5623944fc350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.524+0000 7fbb2359e700 1 -- 172.21.15.146:0/3673486062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623944d0c20 msgr2=0x56239457a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:19:48.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.524+0000 7fbb2359e700 1 --2- 172.21.15.146:0/3673486062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623944d0c20 0x56239457a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.524+0000 7fbb2359e700 1 -- 172.21.15.146:0/3673486062 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb1400fa50 con 0x562394516ae0 2023-10-06T11:19:48.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.524+0000 7fbb2359e700 1 --2- 172.21.15.146:0/3673486062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562394516ae0 0x5623944fc890 secure :-1 s=READY pgs=2328 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c016aa0 tx=0x7fbb1c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acd8d2e26a999b76 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:19:48.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.524+0000 7fbb017fa700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:19:48.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.524+0000 7fbb017fa700 1 -- 172.21.15.146:0/3673486062 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1c006ba0 con 0x562394516ae0 2023-10-06T11:19:48.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.524+0000 7fbb017fa700 1 -- 172.21.15.146:0/3673486062 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(180..180 src has 1..180) v4 ==== 6231+0+0 (secure 0 0 0) 0x7fbb1c006d00 con 0x562394516ae0 2023-10-06T11:19:48.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.524+0000 7fbb32389b80 1 -- 172.21.15.146:0/3673486062 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbb1400c040 con 0x562394516ae0 2023-10-06T11:19:48.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.525+0000 7fbb017fa700 1 -- 172.21.15.146:0/3673486062 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=150) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbb1c017770 con 0x562394516ae0 2023-10-06T11:19:48.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.525+0000 7fbb32389b80 10 client.10839 fetch_fsmap learned FSMap version 150 2023-10-06T11:19:48.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.525+0000 7fbb32389b80 1 -- 172.21.15.146:0/3673486062 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=150,monmap=2+}) v3 -- 0x5623943d54c0 con 0x562394516ae0 2023-10-06T11:19:48.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.525+0000 7fbb017fa700 1 -- 172.21.15.146:0/3673486062 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1400c040 con 0x562394516ae0 2023-10-06T11:19:48.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.525+0000 7fbb017fa700 1 -- 172.21.15.146:0/3673486062 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 150) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fbb1c0178d0 con 0x562394516ae0 2023-10-06T11:19:48.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.525+0000 7fbb32389b80 10 client.10839 fetch_fsmap finished waiting for FSMap version 150 2023-10-06T11:19:48.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.525+0000 7fbb32389b80 10 client.10839 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2023-10-06T11:19:48.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.525+0000 7fbb32389b80 20 client.10839 populate_metadata read hostname 'smithi146' 2023-10-06T11:19:48.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.525+0000 7fbb32389b80 1 --2- 172.21.15.146:0/3673486062 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x5623944cc700 0x5623944f69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:19:48.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.525+0000 7fbb32389b80 4 client.10839 mds_command: new command op to 10461 tid=0[{"prefix": "scrub status"}] 2023-10-06T11:19:48.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.525+0000 7fbb32389b80 1 -- 172.21.15.146:0/3673486062 --> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5623943c2e50 con 0x5623944cc700 2023-10-06T11:19:48.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.525+0000 7fbb22d9d700 1 --2- 172.21.15.146:0/3673486062 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x5623944cc700 0x5623944f69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:19:48.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.525+0000 7fbb22d9d700 1 --2- 172.21.15.146:0/3673486062 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x5623944cc700 0x5623944f69e0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8adc09a8bc8e5e2f server_cookie=ec57e25d4a40ca72 in_seq=0 out_seq=0 2023-10-06T11:19:48.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.525+0000 7fbb017fa700 10 client.10839 ms_handle_connect on v2:172.21.15.146:6835/2322816938 2023-10-06T11:19:48.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.525+0000 7fbb017fa700 1 -- 172.21.15.146:0/3673486062 <== mds.0 v2:172.21.15.146:6835/2322816938 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+260 (crc 0 0 0) 0x5623943c2e50 con 0x5623944cc700 2023-10-06T11:19:48.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.525+0000 7fbb017fa700 10 client.10839 handle_command_reply: tid=0 2023-10-06T11:19:48.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.526+0000 7fbb32389b80 1 client.10839 shutdown 2023-10-06T11:19:48.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.526+0000 7fbb32389b80 1 -- 172.21.15.146:0/3673486062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562394516ae0 msgr2=0x5623944fc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:48.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.526+0000 7fbb32389b80 1 --2- 172.21.15.146:0/3673486062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562394516ae0 0x5623944fc890 secure :-1 s=READY pgs=2328 cs=0 l=1 rev1=1 crypto rx=0x7fbb1c016aa0 tx=0x7fbb1c009040 comp rx=0 tx=0).stop 2023-10-06T11:19:48.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.526+0000 7fbb32389b80 1 -- 172.21.15.146:0/3673486062 shutdown_connections 2023-10-06T11:19:48.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.526+0000 7fbb32389b80 1 --2- 172.21.15.146:0/3673486062 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x5623944cc700 0x5623944f69e0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.526+0000 7fbb32389b80 1 --2- 172.21.15.146:0/3673486062 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x562394516ae0 0x5623944fc890 unknown :-1 s=CLOSED pgs=2328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.526+0000 7fbb32389b80 1 --2- 172.21.15.146:0/3673486062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623944d0c20 0x56239457a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.526+0000 7fbb017fa700 0 client.10839 ms_handle_reset on v2:172.21.15.146:6835/2322816938 2023-10-06T11:19:48.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.526+0000 7fbb32389b80 1 --2- 172.21.15.146:0/3673486062 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5623944d29f0 0x5623944fc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.526+0000 7fbb32389b80 1 -- 172.21.15.146:0/3673486062 >> 172.21.15.146:0/3673486062 conn(0x5623944d10c0 msgr2=0x562394515e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:48.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.526+0000 7fbb32389b80 1 -- 172.21.15.146:0/3673486062 shutdown_connections 2023-10-06T11:19:48.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.526+0000 7fbb32389b80 1 -- 172.21.15.146:0/3673486062 wait complete. 2023-10-06T11:19:48.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.526+0000 7fbb32389b80 20 client.10839 trim_cache size 0 max 16384 2023-10-06T11:19:48.539 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:19:48.539 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "IDLE (waiting for more scrubs)", 2023-10-06T11:19:48.539 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": { 2023-10-06T11:19:48.539 INFO:teuthology.orchestra.run.smithi146.stdout: "3bc026e5-e3ec-4ea0-ba32-62fb8dd0eb44": { 2023-10-06T11:19:48.539 INFO:teuthology.orchestra.run.smithi146.stdout: "path": "/", 2023-10-06T11:19:48.539 INFO:teuthology.orchestra.run.smithi146.stdout: "tag": "3bc026e5-e3ec-4ea0-ba32-62fb8dd0eb44", 2023-10-06T11:19:48.539 INFO:teuthology.orchestra.run.smithi146.stdout: "options": "recursive,repair" 2023-10-06T11:19:48.539 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:19:48.540 INFO:teuthology.orchestra.run.smithi146.stdout: } 2023-10-06T11:19:48.540 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:19:48.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.526+0000 7fbb29091700 1 -- 172.21.15.146:0/3030775265 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbb04066f30 msgr2=0x7fbb040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:48.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.526+0000 7fbb29091700 1 --2- 172.21.15.146:0/3030775265 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbb04066f30 0x7fbb040693e0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fbb1400acb0 tx=0x7fbb14008040 comp rx=0 tx=0).stop 2023-10-06T11:19:48.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.526+0000 7fbb29091700 1 -- 172.21.15.146:0/3030775265 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb24159450 msgr2=0x7fbb240c8960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:19:48.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.526+0000 7fbb29091700 1 --2- 172.21.15.146:0/3030775265 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb24159450 0x7fbb240c8960 secure :-1 s=READY pgs=2324 cs=0 l=1 rev1=1 crypto rx=0x7fbb0c009290 tx=0x7fbb0c016000 comp rx=0 tx=0).stop 2023-10-06T11:19:48.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.526+0000 7fbb29091700 1 -- 172.21.15.146:0/3030775265 shutdown_connections 2023-10-06T11:19:48.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.526+0000 7fbb29091700 1 --2- 172.21.15.146:0/3030775265 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fbb04066f30 0x7fbb040693e0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.526+0000 7fbb29091700 1 --2- 172.21.15.146:0/3030775265 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbb2415dd70 0x7fbb240c3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.526+0000 7fbb29091700 1 --2- 172.21.15.146:0/3030775265 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbb240b0760 0x7fbb240c8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.526+0000 7fbb29091700 1 --2- 172.21.15.146:0/3030775265 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fbb24159450 0x7fbb240c8960 unknown :-1 s=CLOSED pgs=2324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:19:48.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.526+0000 7fbb29091700 1 -- 172.21.15.146:0/3030775265 >> 172.21.15.146:0/3030775265 conn(0x7fbb2406eb10 msgr2=0x7fbb24063510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:19:48.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.527+0000 7fbb29091700 1 -- 172.21.15.146:0/3030775265 shutdown_connections 2023-10-06T11:19:48.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:19:48.527+0000 7fbb29091700 1 -- 172.21.15.146:0/3030775265 wait complete. 2023-10-06T11:19:48.542 INFO:tasks.cephfs.filesystem:scrub status for tag:3bc026e5-e3ec-4ea0-ba32-62fb8dd0eb44 - {'path': '/', 'tag': '3bc026e5-e3ec-4ea0-ba32-62fb8dd0eb44', 'options': 'recursive,repair'} 2023-10-06T11:19:51.853 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:19:51.856 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:20:18.543 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.13:0 scrub status 2023-10-06T11:20:18.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.681+0000 7fa46c967700 1 Processor -- start 2023-10-06T11:20:18.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.681+0000 7fa46c967700 1 -- start start 2023-10-06T11:20:18.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.682+0000 7fa46c967700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa468155960 0x7fa4680c9540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:18.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.682+0000 7fa46c967700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa4681561d0 0x7fa4680afe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:18.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.682+0000 7fa46c967700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4680c9a80 con 0x7fa468155d30 2023-10-06T11:20:18.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.682+0000 7fa46c967700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4680b21a0 con 0x7fa4681561d0 2023-10-06T11:20:18.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.682+0000 7fa46c967700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4680ca8c0 con 0x7fa468155960 2023-10-06T11:20:18.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.682+0000 7fa466d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa4681561d0 0x7fa4680afe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:18.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.682+0000 7fa466d9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fa4681561d0 0x7fa4680afe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57600/0 (socket says 172.21.15.146:57600) 2023-10-06T11:20:18.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.682+0000 7fa466d9d700 1 -- 172.21.15.146:0/2624277980 learned_addr learned my addr 172.21.15.146:0/2624277980 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:18.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.682+0000 7fa46659c700 1 --2- 172.21.15.146:0/2624277980 >> v2:172.21.15.151:3300/0 conn(0x7fa468155960 0x7fa4680c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:18.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.683+0000 7fa466d9d700 1 -- 172.21.15.146:0/2624277980 >> v2:172.21.15.151:3300/0 conn(0x7fa468155960 msgr2=0x7fa4680c9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:18.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.683+0000 7fa466d9d700 1 --2- 172.21.15.146:0/2624277980 >> v2:172.21.15.151:3300/0 conn(0x7fa468155960 0x7fa4680c9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:18.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.683+0000 7fa466d9d700 1 -- 172.21.15.146:0/2624277980 >> v1:172.21.15.151:6789/0 conn(0x7fa468155d30 legacy=0x7fa4680af6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:18.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.683+0000 7fa466d9d700 1 -- 172.21.15.146:0/2624277980 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4680c9cb0 con 0x7fa4681561d0 2023-10-06T11:20:18.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.683+0000 7fa466d9d700 1 --2- 172.21.15.146:0/2624277980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4681561d0 0x7fa4680afe00 secure :-1 s=READY pgs=2329 cs=0 l=1 rev1=1 crypto rx=0x7fa46806cb80 tx=0x7fa46000ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71d79cf9bda90b49 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:18.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.683+0000 7fa465d9b700 1 -- 172.21.15.146:0/2624277980 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa460010070 con 0x7fa4681561d0 2023-10-06T11:20:18.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.683+0000 7fa465d9b700 1 -- 172.21.15.146:0/2624277980 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46000dde0 con 0x7fa4681561d0 2023-10-06T11:20:18.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.683+0000 7fa465d9b700 1 -- 172.21.15.146:0/2624277980 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46000b320 con 0x7fa4681561d0 2023-10-06T11:20:18.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.683+0000 7fa46c967700 1 -- 172.21.15.146:0/2624277980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4681561d0 msgr2=0x7fa4680afe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:18.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.683+0000 7fa46c967700 1 --2- 172.21.15.146:0/2624277980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4681561d0 0x7fa4680afe00 secure :-1 s=READY pgs=2329 cs=0 l=1 rev1=1 crypto rx=0x7fa46806cb80 tx=0x7fa46000ba50 comp rx=0 tx=0).stop 2023-10-06T11:20:18.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.683+0000 7fa46c967700 1 -- 172.21.15.146:0/2624277980 shutdown_connections 2023-10-06T11:20:18.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.683+0000 7fa46c967700 1 --2- 172.21.15.146:0/2624277980 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa4681561d0 0x7fa4680afe00 unknown :-1 s=CLOSED pgs=2329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:18.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.683+0000 7fa46c967700 1 --2- 172.21.15.146:0/2624277980 >> v2:172.21.15.151:3300/0 conn(0x7fa468155960 0x7fa4680c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:18.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.683+0000 7fa46c967700 1 -- 172.21.15.146:0/2624277980 >> 172.21.15.146:0/2624277980 conn(0x7fa4680673e0 msgr2=0x7fa4680677e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:18.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.683+0000 7fa46c967700 1 -- 172.21.15.146:0/2624277980 shutdown_connections 2023-10-06T11:20:18.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.684+0000 7fa46c967700 1 -- 172.21.15.146:0/2624277980 wait complete. 2023-10-06T11:20:18.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.685+0000 7fa46c967700 1 Processor -- start 2023-10-06T11:20:18.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.685+0000 7fa46c967700 1 -- start start 2023-10-06T11:20:18.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.685+0000 7fa46c967700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa468155960 0x7fa468167fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:18.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.685+0000 7fa46c967700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa468155d30 0x7fa4680c3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:18.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.685+0000 7fa46c967700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4681561d0 0x7fa4680c3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:18.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.685+0000 7fa46c967700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46813e710 con 0x7fa468155d30 2023-10-06T11:20:18.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.685+0000 7fa46c967700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46814f420 con 0x7fa4681561d0 2023-10-06T11:20:18.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.685+0000 7fa46c967700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa46814f700 con 0x7fa468155960 2023-10-06T11:20:18.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.686+0000 7fa45dd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa468155d30 0x7fa4680c3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:18.691 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.686+0000 7fa45dd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa468155d30 0x7fa4680c3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57614/0 (socket says 172.21.15.146:57614) 2023-10-06T11:20:18.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.686+0000 7fa45dd9b700 1 -- 172.21.15.146:0/109903366 learned_addr learned my addr 172.21.15.146:0/109903366 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:18.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.686+0000 7fa466d9d700 1 --2- 172.21.15.146:0/109903366 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4681561d0 0x7fa4680c3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:18.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.686+0000 7fa45dd9b700 1 -- 172.21.15.146:0/109903366 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa468155960 msgr2=0x7fa468167fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:18.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.686+0000 7fa46659c700 1 --2- 172.21.15.146:0/109903366 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa468155960 0x7fa468167fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:18.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.686+0000 7fa45dd9b700 1 --2- 172.21.15.146:0/109903366 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa468155960 0x7fa468167fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:18.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.686+0000 7fa45dd9b700 1 -- 172.21.15.146:0/109903366 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4681561d0 msgr2=0x7fa4680c3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:18.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.686+0000 7fa45dd9b700 1 --2- 172.21.15.146:0/109903366 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4681561d0 0x7fa4680c3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:18.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.686+0000 7fa45dd9b700 1 -- 172.21.15.146:0/109903366 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa46000bcf0 con 0x7fa468155d30 2023-10-06T11:20:18.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.686+0000 7fa466d9d700 1 --2- 172.21.15.146:0/109903366 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4681561d0 0x7fa4680c3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:20:18.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.686+0000 7fa45dd9b700 1 --2- 172.21.15.146:0/109903366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa468155d30 0x7fa4680c3720 secure :-1 s=READY pgs=2330 cs=0 l=1 rev1=1 crypto rx=0x7fa45000c590 tx=0x7fa45000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:18.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.686+0000 7fa45effd700 1 -- 172.21.15.146:0/109903366 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa450011590 con 0x7fa468155d30 2023-10-06T11:20:18.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.686+0000 7fa45effd700 1 -- 172.21.15.146:0/109903366 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4500116f0 con 0x7fa468155d30 2023-10-06T11:20:18.692 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.686+0000 7fa46c967700 1 -- 172.21.15.146:0/109903366 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa46814f9e0 con 0x7fa468155d30 2023-10-06T11:20:18.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.686+0000 7fa45effd700 1 -- 172.21.15.146:0/109903366 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa450011ab0 con 0x7fa468155d30 2023-10-06T11:20:18.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.686+0000 7fa46c967700 1 -- 172.21.15.146:0/109903366 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4681684f0 con 0x7fa468155d30 2023-10-06T11:20:18.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.688+0000 7fa45effd700 1 -- 172.21.15.146:0/109903366 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa45001b3b0 con 0x7fa468155d30 2023-10-06T11:20:18.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.688+0000 7fa45effd700 1 --2- 172.21.15.146:0/109903366 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa448066f30 0x7fa4480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:18.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.688+0000 7fa45effd700 1 -- 172.21.15.146:0/109903366 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6231+0+0 (secure 0 0 0) 0x7fa450083cf0 con 0x7fa468155d30 2023-10-06T11:20:18.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.688+0000 7fa46659c700 1 --2- 172.21.15.146:0/109903366 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa448066f30 0x7fa4480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:18.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.688+0000 7fa46659c700 1 --2- 172.21.15.146:0/109903366 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa448066f30 0x7fa4480693e0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fa4580093f0 tx=0x7fa458008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:18.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.690+0000 7fa475c5fb80 1 Processor -- start 2023-10-06T11:20:18.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.690+0000 7fa475c5fb80 1 -- start start 2023-10-06T11:20:18.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.691+0000 7fa475c5fb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55760c173ae0 0x55760c173eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:18.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.691+0000 7fa475c5fb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760c12f9f0 0x55760c12c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:18.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.691+0000 7fa475c5fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55760c12dc20 0x55760c12cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:18.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.691+0000 7fa475c5fb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55760c0accd0 con 0x55760c12f9f0 2023-10-06T11:20:18.700 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.691+0000 7fa475c5fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55760c083ac0 con 0x55760c12dc20 2023-10-06T11:20:18.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.691+0000 7fa475c5fb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55760c0812c0 con 0x55760c173ae0 2023-10-06T11:20:18.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.691+0000 7fa45dd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760c12f9f0 0x55760c12c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:18.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.691+0000 7fa45dd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760c12f9f0 0x55760c12c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57616/0 (socket says 172.21.15.146:57616) 2023-10-06T11:20:18.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.691+0000 7fa45dd9b700 1 -- 172.21.15.146:0/1581967417 learned_addr learned my addr 172.21.15.146:0/1581967417 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:18.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.691+0000 7fa46659c700 1 --2- 172.21.15.146:0/1581967417 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55760c173ae0 0x55760c173eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:18.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.691+0000 7fa466d9d700 1 --2- 172.21.15.146:0/1581967417 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55760c12dc20 0x55760c12cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:18.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.691+0000 7fa45dd9b700 1 -- 172.21.15.146:0/1581967417 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55760c173ae0 msgr2=0x55760c173eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:18.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.691+0000 7fa45dd9b700 1 --2- 172.21.15.146:0/1581967417 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55760c173ae0 0x55760c173eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:18.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.691+0000 7fa45dd9b700 1 -- 172.21.15.146:0/1581967417 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55760c12dc20 msgr2=0x55760c12cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:18.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.691+0000 7fa45dd9b700 1 --2- 172.21.15.146:0/1581967417 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55760c12dc20 0x55760c12cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:18.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.691+0000 7fa45dd9b700 1 -- 172.21.15.146:0/1581967417 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55760bf172c0 con 0x55760c12f9f0 2023-10-06T11:20:18.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.691+0000 7fa46659c700 1 --2- 172.21.15.146:0/1581967417 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55760c173ae0 0x55760c173eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:20:18.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.691+0000 7fa466d9d700 1 --2- 172.21.15.146:0/1581967417 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55760c12dc20 0x55760c12cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:20:18.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.691+0000 7fa45dd9b700 1 --2- 172.21.15.146:0/1581967417 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760c12f9f0 0x55760c12c5d0 secure :-1 s=READY pgs=2331 cs=0 l=1 rev1=1 crypto rx=0x7fa450050f10 tx=0x7fa450081f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c4eae65b1fe633d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:18.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.691+0000 7fa4477fe700 1 -- 172.21.15.146:0/1581967417 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa450057c60 con 0x55760c12f9f0 2023-10-06T11:20:18.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.691+0000 7fa4477fe700 1 -- 172.21.15.146:0/1581967417 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa45005b9b0 con 0x55760c12f9f0 2023-10-06T11:20:18.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.691+0000 7fa4477fe700 1 -- 172.21.15.146:0/1581967417 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa450052b50 con 0x55760c12f9f0 2023-10-06T11:20:18.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.692+0000 7fa475c5fb80 1 -- 172.21.15.146:0/1581967417 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760c12f9f0 msgr2=0x55760c12c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:18.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.692+0000 7fa475c5fb80 1 --2- 172.21.15.146:0/1581967417 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760c12f9f0 0x55760c12c5d0 secure :-1 s=READY pgs=2331 cs=0 l=1 rev1=1 crypto rx=0x7fa450050f10 tx=0x7fa450081f60 comp rx=0 tx=0).stop 2023-10-06T11:20:18.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.692+0000 7fa475c5fb80 1 -- 172.21.15.146:0/1581967417 shutdown_connections 2023-10-06T11:20:18.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.692+0000 7fa475c5fb80 1 --2- 172.21.15.146:0/1581967417 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55760c12dc20 0x55760c12cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:18.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.692+0000 7fa475c5fb80 1 --2- 172.21.15.146:0/1581967417 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55760c173ae0 0x55760c173eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:18.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.692+0000 7fa475c5fb80 1 --2- 172.21.15.146:0/1581967417 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760c12f9f0 0x55760c12c5d0 unknown :-1 s=CLOSED pgs=2331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:18.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.692+0000 7fa475c5fb80 1 -- 172.21.15.146:0/1581967417 >> 172.21.15.146:0/1581967417 conn(0x55760c12e0c0 msgr2=0x55760c12e490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:18.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.692+0000 7fa475c5fb80 1 -- 172.21.15.146:0/1581967417 shutdown_connections 2023-10-06T11:20:18.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.692+0000 7fa475c5fb80 1 -- 172.21.15.146:0/1581967417 wait complete. 2023-10-06T11:20:18.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.693+0000 7fa475c5fb80 1 -- start start 2023-10-06T11:20:18.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.693+0000 7fa475c5fb80 1 Processor -- start 2023-10-06T11:20:18.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.694+0000 7fa475c5fb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55760c12dc20 0x55760c16aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:18.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.694+0000 7fa475c5fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55760c12f9f0 0x55760c157840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:18.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.694+0000 7fa475c5fb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760c173ae0 0x55760c12cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:18.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.694+0000 7fa475c5fb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55760c07d0b0 con 0x55760c173ae0 2023-10-06T11:20:18.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.694+0000 7fa475c5fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55760c0288e0 con 0x55760c12f9f0 2023-10-06T11:20:18.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.694+0000 7fa475c5fb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55760c043ef0 con 0x55760c12dc20 2023-10-06T11:20:18.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.694+0000 7fa475c5fb80 10 client.0 _ll_register_callbacks cb 0x55760bf19f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:20:18.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.694+0000 7fa466d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760c173ae0 0x55760c12cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:18.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.694+0000 7fa466d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760c173ae0 0x55760c12cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57620/0 (socket says 172.21.15.146:57620) 2023-10-06T11:20:18.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.694+0000 7fa466d9d700 1 -- 172.21.15.146:0/1052803124 learned_addr learned my addr 172.21.15.146:0/1052803124 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:18.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.694+0000 7fa45dd9b700 1 --2- 172.21.15.146:0/1052803124 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55760c12f9f0 0x55760c157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:18.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.694+0000 7fa46659c700 1 --2- 172.21.15.146:0/1052803124 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55760c12dc20 0x55760c16aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:18.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.694+0000 7fa466d9d700 1 -- 172.21.15.146:0/1052803124 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55760c12dc20 msgr2=0x55760c16aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:18.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.694+0000 7fa466d9d700 1 --2- 172.21.15.146:0/1052803124 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55760c12dc20 0x55760c16aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:18.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.694+0000 7fa466d9d700 1 -- 172.21.15.146:0/1052803124 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55760c12f9f0 msgr2=0x55760c157840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:18.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.694+0000 7fa466d9d700 1 --2- 172.21.15.146:0/1052803124 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55760c12f9f0 0x55760c157840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:18.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.694+0000 7fa466d9d700 1 -- 172.21.15.146:0/1052803124 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4681684f0 con 0x55760c173ae0 2023-10-06T11:20:18.705 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.694+0000 7fa466d9d700 1 --2- 172.21.15.146:0/1052803124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760c173ae0 0x55760c12cce0 secure :-1 s=READY pgs=2332 cs=0 l=1 rev1=1 crypto rx=0x7fa46000b7a0 tx=0x7fa46001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30f9ed4a8cac6c92 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:18.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.694+0000 7fa444ff9700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:20:18.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.694+0000 7fa444ff9700 1 -- 172.21.15.146:0/1052803124 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4600032f0 con 0x55760c173ae0 2023-10-06T11:20:18.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.694+0000 7fa444ff9700 1 -- 172.21.15.146:0/1052803124 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(180..180 src has 1..180) v4 ==== 6231+0+0 (secure 0 0 0) 0x7fa46000b4d0 con 0x55760c173ae0 2023-10-06T11:20:18.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.694+0000 7fa475c5fb80 1 -- 172.21.15.146:0/1052803124 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55760c1216e0 con 0x55760c173ae0 2023-10-06T11:20:18.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.694+0000 7fa444ff9700 1 -- 172.21.15.146:0/1052803124 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=150) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa460009e60 con 0x55760c173ae0 2023-10-06T11:20:18.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.694+0000 7fa475c5fb80 10 client.10851 fetch_fsmap learned FSMap version 150 2023-10-06T11:20:18.706 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.694+0000 7fa475c5fb80 1 -- 172.21.15.146:0/1052803124 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=150,monmap=2+}) v3 -- 0x55760beba030 con 0x55760c173ae0 2023-10-06T11:20:18.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.695+0000 7fa444ff9700 1 -- 172.21.15.146:0/1052803124 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55760c1216e0 con 0x55760c173ae0 2023-10-06T11:20:18.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.695+0000 7fa444ff9700 1 -- 172.21.15.146:0/1052803124 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 150) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa460026020 con 0x55760c173ae0 2023-10-06T11:20:18.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.695+0000 7fa475c5fb80 10 client.10851 fetch_fsmap finished waiting for FSMap version 150 2023-10-06T11:20:18.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.695+0000 7fa475c5fb80 10 client.10851 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2023-10-06T11:20:18.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.695+0000 7fa475c5fb80 20 client.10851 populate_metadata read hostname 'smithi146' 2023-10-06T11:20:18.707 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.695+0000 7fa475c5fb80 1 --2- 172.21.15.146:0/1052803124 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x55760c170960 0x55760c153060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:18.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.695+0000 7fa475c5fb80 4 client.10851 mds_command: new command op to 10461 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:20:18.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.695+0000 7fa475c5fb80 1 -- 172.21.15.146:0/1052803124 --> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55760c0fe610 con 0x55760c170960 2023-10-06T11:20:18.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.695+0000 7fa46659c700 1 --2- 172.21.15.146:0/1052803124 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x55760c170960 0x55760c153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:18.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.695+0000 7fa444ff9700 10 client.10851 ms_handle_connect on v2:172.21.15.146:6835/2322816938 2023-10-06T11:20:18.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.695+0000 7fa46659c700 1 --2- 172.21.15.146:0/1052803124 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x55760c170960 0x55760c153060 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4841dffc18aa038f server_cookie=d997a20f7dc636aa in_seq=0 out_seq=0 2023-10-06T11:20:18.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.696+0000 7fa444ff9700 1 -- 172.21.15.146:0/1052803124 <== mds.0 v2:172.21.15.146:6835/2322816938 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55760c0fe610 con 0x55760c170960 2023-10-06T11:20:18.708 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.696+0000 7fa444ff9700 10 client.10851 handle_command_reply: tid=0 2023-10-06T11:20:18.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.696+0000 7fa475c5fb80 1 client.10851 shutdown 2023-10-06T11:20:18.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.696+0000 7fa475c5fb80 1 -- 172.21.15.146:0/1052803124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760c173ae0 msgr2=0x55760c12cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:18.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.696+0000 7fa475c5fb80 1 --2- 172.21.15.146:0/1052803124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760c173ae0 0x55760c12cce0 secure :-1 s=READY pgs=2332 cs=0 l=1 rev1=1 crypto rx=0x7fa46000b7a0 tx=0x7fa46001a000 comp rx=0 tx=0).stop 2023-10-06T11:20:18.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.696+0000 7fa475c5fb80 1 -- 172.21.15.146:0/1052803124 shutdown_connections 2023-10-06T11:20:18.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.696+0000 7fa475c5fb80 1 --2- 172.21.15.146:0/1052803124 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x55760c170960 0x55760c153060 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:18.709 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.696+0000 7fa475c5fb80 1 --2- 172.21.15.146:0/1052803124 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760c173ae0 0x55760c12cce0 unknown :-1 s=CLOSED pgs=2332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:18.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.696+0000 7fa475c5fb80 1 --2- 172.21.15.146:0/1052803124 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55760c12dc20 0x55760c16aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:18.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.696+0000 7fa475c5fb80 1 --2- 172.21.15.146:0/1052803124 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55760c12f9f0 0x55760c157840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:18.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.696+0000 7fa444ff9700 0 client.10851 ms_handle_reset on v2:172.21.15.146:6835/2322816938 2023-10-06T11:20:18.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.696+0000 7fa475c5fb80 1 -- 172.21.15.146:0/1052803124 >> 172.21.15.146:0/1052803124 conn(0x55760c12e0c0 msgr2=0x55760c129770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:18.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.696+0000 7fa475c5fb80 1 -- 172.21.15.146:0/1052803124 shutdown_connections 2023-10-06T11:20:18.710 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.696+0000 7fa475c5fb80 1 -- 172.21.15.146:0/1052803124 wait complete. 2023-10-06T11:20:18.711 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.696+0000 7fa475c5fb80 20 client.10851 trim_cache size 0 max 16384 2023-10-06T11:20:18.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.712+0000 7fa475c5fb80 1 Processor -- start 2023-10-06T11:20:18.714 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.712+0000 7fa475c5fb80 1 -- start start 2023-10-06T11:20:18.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.713+0000 7fa475c5fb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55760c12dc20 0x55760c129a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:18.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.713+0000 7fa475c5fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55760c12f9f0 0x55760c1722d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:18.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.713+0000 7fa475c5fb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760c173ae0 0x55760c172810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:18.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.713+0000 7fa475c5fb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55760beffe80 con 0x55760c173ae0 2023-10-06T11:20:18.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.713+0000 7fa475c5fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55760c18ce00 con 0x55760c12f9f0 2023-10-06T11:20:18.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.713+0000 7fa475c5fb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55760c152b60 con 0x55760c12dc20 2023-10-06T11:20:18.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.713+0000 7fa466d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760c173ae0 0x55760c172810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:18.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.713+0000 7fa466d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760c173ae0 0x55760c172810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57634/0 (socket says 172.21.15.146:57634) 2023-10-06T11:20:18.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.713+0000 7fa466d9d700 1 -- 172.21.15.146:0/2447021140 learned_addr learned my addr 172.21.15.146:0/2447021140 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:18.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.713+0000 7fa46659c700 1 --2- 172.21.15.146:0/2447021140 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55760c12dc20 0x55760c129a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:18.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.713+0000 7fa45dd9b700 1 --2- 172.21.15.146:0/2447021140 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55760c12f9f0 0x55760c1722d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:18.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.713+0000 7fa466d9d700 1 -- 172.21.15.146:0/2447021140 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55760c12dc20 msgr2=0x55760c129a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:18.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.713+0000 7fa466d9d700 1 --2- 172.21.15.146:0/2447021140 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55760c12dc20 0x55760c129a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:18.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.713+0000 7fa466d9d700 1 -- 172.21.15.146:0/2447021140 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55760c12f9f0 msgr2=0x55760c1722d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:18.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.713+0000 7fa466d9d700 1 --2- 172.21.15.146:0/2447021140 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55760c12f9f0 0x55760c1722d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:18.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.713+0000 7fa466d9d700 1 -- 172.21.15.146:0/2447021140 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55760c04b7d0 con 0x55760c173ae0 2023-10-06T11:20:18.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.713+0000 7fa466d9d700 1 --2- 172.21.15.146:0/2447021140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760c173ae0 0x55760c172810 secure :-1 s=READY pgs=2333 cs=0 l=1 rev1=1 crypto rx=0x7fa460003370 tx=0x7fa460021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3d1f94c6d46fb41 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:18.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.713+0000 7fa447fff700 1 -- 172.21.15.146:0/2447021140 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4600095e0 con 0x55760c173ae0 2023-10-06T11:20:18.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.713+0000 7fa447fff700 1 -- 172.21.15.146:0/2447021140 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46000b4d0 con 0x55760c173ae0 2023-10-06T11:20:18.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.713+0000 7fa447fff700 1 -- 172.21.15.146:0/2447021140 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa460020730 con 0x55760c173ae0 2023-10-06T11:20:18.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.714+0000 7fa475c5fb80 1 -- 172.21.15.146:0/2447021140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760c173ae0 msgr2=0x55760c172810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:18.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.714+0000 7fa475c5fb80 1 --2- 172.21.15.146:0/2447021140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760c173ae0 0x55760c172810 secure :-1 s=READY pgs=2333 cs=0 l=1 rev1=1 crypto rx=0x7fa460003370 tx=0x7fa460021000 comp rx=0 tx=0).stop 2023-10-06T11:20:18.718 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.714+0000 7fa475c5fb80 1 -- 172.21.15.146:0/2447021140 shutdown_connections 2023-10-06T11:20:18.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.714+0000 7fa475c5fb80 1 --2- 172.21.15.146:0/2447021140 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760c173ae0 0x55760c172810 unknown :-1 s=CLOSED pgs=2333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:18.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.714+0000 7fa475c5fb80 1 --2- 172.21.15.146:0/2447021140 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55760c12dc20 0x55760c129a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:18.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.714+0000 7fa475c5fb80 1 --2- 172.21.15.146:0/2447021140 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55760c12f9f0 0x55760c1722d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:18.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.714+0000 7fa475c5fb80 1 -- 172.21.15.146:0/2447021140 >> 172.21.15.146:0/2447021140 conn(0x55760c12e0c0 msgr2=0x55760c16d450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:18.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.714+0000 7fa475c5fb80 1 -- 172.21.15.146:0/2447021140 shutdown_connections 2023-10-06T11:20:18.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.714+0000 7fa475c5fb80 1 -- 172.21.15.146:0/2447021140 wait complete. 2023-10-06T11:20:18.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.714+0000 7fa475c5fb80 1 -- start start 2023-10-06T11:20:18.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.714+0000 7fa475c5fb80 1 Processor -- start 2023-10-06T11:20:18.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.715+0000 7fa475c5fb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760c12dc20 0x55760c1e00b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:18.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.715+0000 7fa475c5fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55760c12f9f0 0x55760c1d3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:18.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.715+0000 7fa475c5fb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55760c173ae0 0x55760c17b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:18.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.715+0000 7fa475c5fb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x55760c1d3a40 con 0x55760c12dc20 2023-10-06T11:20:18.723 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.715+0000 7fa475c5fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55760c1e0940 con 0x55760c12f9f0 2023-10-06T11:20:18.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.715+0000 7fa475c5fb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x55760c128560 con 0x55760c173ae0 2023-10-06T11:20:18.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.715+0000 7fa46659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760c12dc20 0x55760c1e00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:18.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.715+0000 7fa475c5fb80 10 client.0 _ll_register_callbacks cb 0x55760bf19f80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:20:18.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.715+0000 7fa46659c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760c12dc20 0x55760c1e00b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57648/0 (socket says 172.21.15.146:57648) 2023-10-06T11:20:18.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.715+0000 7fa46659c700 1 -- 172.21.15.146:0/2854613518 learned_addr learned my addr 172.21.15.146:0/2854613518 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:18.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.716+0000 7fa45dd9b700 1 --2- 172.21.15.146:0/2854613518 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55760c12f9f0 0x55760c1d3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:18.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.716+0000 7fa466d9d700 1 --2- 172.21.15.146:0/2854613518 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55760c173ae0 0x55760c17b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:18.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.716+0000 7fa46659c700 1 -- 172.21.15.146:0/2854613518 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55760c173ae0 msgr2=0x55760c17b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:18.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.716+0000 7fa46659c700 1 --2- 172.21.15.146:0/2854613518 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55760c173ae0 0x55760c17b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:18.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.716+0000 7fa46659c700 1 -- 172.21.15.146:0/2854613518 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55760c12f9f0 msgr2=0x55760c1d3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:18.724 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.716+0000 7fa46659c700 1 --2- 172.21.15.146:0/2854613518 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55760c12f9f0 0x55760c1d3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:18.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.716+0000 7fa46659c700 1 -- 172.21.15.146:0/2854613518 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55760beba030 con 0x55760c12dc20 2023-10-06T11:20:18.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.716+0000 7fa45dd9b700 1 --2- 172.21.15.146:0/2854613518 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55760c12f9f0 0x55760c1d3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:20:18.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.716+0000 7fa46659c700 1 --2- 172.21.15.146:0/2854613518 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760c12dc20 0x55760c1e00b0 secure :-1 s=READY pgs=2334 cs=0 l=1 rev1=1 crypto rx=0x7fa458009aa0 tx=0x7fa458027040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a48ccbb11cf12a24 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:18.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.716+0000 7fa444ff9700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:20:18.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.716+0000 7fa444ff9700 1 -- 172.21.15.146:0/2854613518 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa458015c40 con 0x55760c12dc20 2023-10-06T11:20:18.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.716+0000 7fa444ff9700 1 -- 172.21.15.146:0/2854613518 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(180..180 src has 1..180) v4 ==== 6231+0+0 (secure 0 0 0) 0x7fa458015da0 con 0x55760c12dc20 2023-10-06T11:20:18.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.716+0000 7fa475c5fb80 1 -- 172.21.15.146:0/2854613518 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa45005b9b0 con 0x55760c12dc20 2023-10-06T11:20:18.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.716+0000 7fa444ff9700 1 -- 172.21.15.146:0/2854613518 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=150) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa45802d650 con 0x55760c12dc20 2023-10-06T11:20:18.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.716+0000 7fa475c5fb80 10 client.10857 fetch_fsmap learned FSMap version 150 2023-10-06T11:20:18.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.716+0000 7fa475c5fb80 1 -- 172.21.15.146:0/2854613518 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=150,monmap=2+}) v3 -- 0x55760c0324c0 con 0x55760c12dc20 2023-10-06T11:20:18.725 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.716+0000 7fa444ff9700 1 -- 172.21.15.146:0/2854613518 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa45005b9b0 con 0x55760c12dc20 2023-10-06T11:20:18.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.716+0000 7fa444ff9700 1 -- 172.21.15.146:0/2854613518 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 150) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa45802d7b0 con 0x55760c12dc20 2023-10-06T11:20:18.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.716+0000 7fa475c5fb80 10 client.10857 fetch_fsmap finished waiting for FSMap version 150 2023-10-06T11:20:18.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.716+0000 7fa475c5fb80 10 client.10857 resolve_mds: resolved 13:0 to role '13:0' aka daemon mds.c 2023-10-06T11:20:18.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.716+0000 7fa475c5fb80 20 client.10857 populate_metadata read hostname 'smithi146' 2023-10-06T11:20:18.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.716+0000 7fa475c5fb80 1 --2- 172.21.15.146:0/2854613518 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x55760c17bb30 0x55760c16d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:18.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.716+0000 7fa475c5fb80 4 client.10857 mds_command: new command op to 10461 tid=0[{"prefix": "scrub status"}] 2023-10-06T11:20:18.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.716+0000 7fa475c5fb80 1 -- 172.21.15.146:0/2854613518 --> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55760c01fe50 con 0x55760c17bb30 2023-10-06T11:20:18.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.717+0000 7fa45dd9b700 1 --2- 172.21.15.146:0/2854613518 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x55760c17bb30 0x55760c16d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:18.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.717+0000 7fa444ff9700 10 client.10857 ms_handle_connect on v2:172.21.15.146:6835/2322816938 2023-10-06T11:20:18.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.717+0000 7fa45dd9b700 1 --2- 172.21.15.146:0/2854613518 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x55760c17bb30 0x55760c16d450 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b36caa81f8ac94d0 server_cookie=437f9f8d518a9197 in_seq=0 out_seq=0 2023-10-06T11:20:18.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.717+0000 7fa444ff9700 1 -- 172.21.15.146:0/2854613518 <== mds.0 v2:172.21.15.146:6835/2322816938 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55760c01fe50 con 0x55760c17bb30 2023-10-06T11:20:18.726 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.717+0000 7fa444ff9700 10 client.10857 handle_command_reply: tid=0 2023-10-06T11:20:18.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.717+0000 7fa475c5fb80 1 client.10857 shutdown 2023-10-06T11:20:18.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.717+0000 7fa475c5fb80 1 -- 172.21.15.146:0/2854613518 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760c12dc20 msgr2=0x55760c1e00b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:18.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.717+0000 7fa475c5fb80 1 --2- 172.21.15.146:0/2854613518 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760c12dc20 0x55760c1e00b0 secure :-1 s=READY pgs=2334 cs=0 l=1 rev1=1 crypto rx=0x7fa458009aa0 tx=0x7fa458027040 comp rx=0 tx=0).stop 2023-10-06T11:20:18.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.717+0000 7fa475c5fb80 1 -- 172.21.15.146:0/2854613518 shutdown_connections 2023-10-06T11:20:18.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.717+0000 7fa475c5fb80 1 --2- 172.21.15.146:0/2854613518 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x55760c17bb30 0x55760c16d450 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:18.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.717+0000 7fa475c5fb80 1 --2- 172.21.15.146:0/2854613518 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x55760c173ae0 0x55760c17b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:18.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.717+0000 7fa475c5fb80 1 --2- 172.21.15.146:0/2854613518 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x55760c12dc20 0x55760c1e00b0 unknown :-1 s=CLOSED pgs=2334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:18.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.717+0000 7fa444ff9700 0 client.10857 ms_handle_reset on v2:172.21.15.146:6835/2322816938 2023-10-06T11:20:18.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.717+0000 7fa475c5fb80 1 --2- 172.21.15.146:0/2854613518 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55760c12f9f0 0x55760c1d3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:18.727 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.717+0000 7fa475c5fb80 1 -- 172.21.15.146:0/2854613518 >> 172.21.15.146:0/2854613518 conn(0x55760c12e0c0 msgr2=0x55760c16e700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:18.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.717+0000 7fa475c5fb80 1 -- 172.21.15.146:0/2854613518 shutdown_connections 2023-10-06T11:20:18.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.717+0000 7fa475c5fb80 1 -- 172.21.15.146:0/2854613518 wait complete. 2023-10-06T11:20:18.728 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.717+0000 7fa475c5fb80 20 client.10857 trim_cache size 0 max 16384 2023-10-06T11:20:18.728 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:20:18.728 INFO:teuthology.orchestra.run.smithi146.stdout: "status": "no active scrubs running", 2023-10-06T11:20:18.728 INFO:teuthology.orchestra.run.smithi146.stdout: "scrubs": {} 2023-10-06T11:20:18.728 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:20:18.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.718+0000 7fa46c967700 1 -- 172.21.15.146:0/109903366 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa448066f30 msgr2=0x7fa4480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:18.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.718+0000 7fa46c967700 1 --2- 172.21.15.146:0/109903366 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa448066f30 0x7fa4480693e0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fa4580093f0 tx=0x7fa458008040 comp rx=0 tx=0).stop 2023-10-06T11:20:18.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.718+0000 7fa46c967700 1 -- 172.21.15.146:0/109903366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa468155d30 msgr2=0x7fa4680c3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:18.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.718+0000 7fa46c967700 1 --2- 172.21.15.146:0/109903366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa468155d30 0x7fa4680c3720 secure :-1 s=READY pgs=2330 cs=0 l=1 rev1=1 crypto rx=0x7fa45000c590 tx=0x7fa45000c950 comp rx=0 tx=0).stop 2023-10-06T11:20:18.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.718+0000 7fa46c967700 1 -- 172.21.15.146:0/109903366 shutdown_connections 2023-10-06T11:20:18.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.718+0000 7fa46c967700 1 --2- 172.21.15.146:0/109903366 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fa448066f30 0x7fa4480693e0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:18.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.718+0000 7fa46c967700 1 --2- 172.21.15.146:0/109903366 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4681561d0 0x7fa4680c3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:18.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.718+0000 7fa46c967700 1 --2- 172.21.15.146:0/109903366 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa468155960 0x7fa468167fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:18.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.718+0000 7fa46c967700 1 --2- 172.21.15.146:0/109903366 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fa468155d30 0x7fa4680c3720 unknown :-1 s=CLOSED pgs=2330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:18.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.718+0000 7fa46c967700 1 -- 172.21.15.146:0/109903366 >> 172.21.15.146:0/109903366 conn(0x7fa4680673e0 msgr2=0x7fa46806e750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:18.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.718+0000 7fa46c967700 1 -- 172.21.15.146:0/109903366 shutdown_connections 2023-10-06T11:20:18.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:18.718+0000 7fa46c967700 1 -- 172.21.15.146:0/109903366 wait complete. 2023-10-06T11:20:18.733 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-10-06T11:20:19.137 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:20:19.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.252+0000 7ff88abad700 1 Processor -- start 2023-10-06T11:20:19.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.252+0000 7ff88abad700 1 -- start start 2023-10-06T11:20:19.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.253+0000 7ff88abad700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff8840cd480 0x7ff88415abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:19.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.253+0000 7ff88abad700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff8840b09f0 0x7ff8840b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:19.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.253+0000 7ff88abad700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8840b6070 con 0x7ff8840cd0b0 2023-10-06T11:20:19.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.253+0000 7ff88abad700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8840b0280 con 0x7ff8840b09f0 2023-10-06T11:20:19.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.253+0000 7ff88abad700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff88415ddf0 con 0x7ff8840cd480 2023-10-06T11:20:19.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.253+0000 7ff88914a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff8840b09f0 0x7ff8840b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:19.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.253+0000 7ff88914a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff8840b09f0 0x7ff8840b0dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57662/0 (socket says 172.21.15.146:57662) 2023-10-06T11:20:19.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.253+0000 7ff88914a700 1 -- 172.21.15.146:0/3689516597 learned_addr learned my addr 172.21.15.146:0/3689516597 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:19.257 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.254+0000 7ff883fff700 1 --2- 172.21.15.146:0/3689516597 >> v2:172.21.15.151:3300/0 conn(0x7ff8840cd480 0x7ff88415abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:19.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.254+0000 7ff88914a700 1 -- 172.21.15.146:0/3689516597 >> v2:172.21.15.151:3300/0 conn(0x7ff8840cd480 msgr2=0x7ff88415abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:19.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.254+0000 7ff88914a700 1 --2- 172.21.15.146:0/3689516597 >> v2:172.21.15.151:3300/0 conn(0x7ff8840cd480 0x7ff88415abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:19.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.254+0000 7ff88914a700 1 -- 172.21.15.146:0/3689516597 >> v1:172.21.15.151:6789/0 conn(0x7ff8840cd0b0 legacy=0x7ff88415d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:19.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.254+0000 7ff88914a700 1 -- 172.21.15.146:0/3689516597 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff88415e0d0 con 0x7ff8840b09f0 2023-10-06T11:20:19.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.254+0000 7ff883fff700 1 --2- 172.21.15.146:0/3689516597 >> v2:172.21.15.151:3300/0 conn(0x7ff8840cd480 0x7ff88415abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:20:19.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.254+0000 7ff88914a700 1 --2- 172.21.15.146:0/3689516597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8840b09f0 0x7ff8840b0dc0 secure :-1 s=READY pgs=2335 cs=0 l=1 rev1=1 crypto rx=0x7ff884069470 tx=0x7ff87c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be98f7f6df1de318 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:19.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.254+0000 7ff8837fe700 1 -- 172.21.15.146:0/3689516597 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87c00e070 con 0x7ff8840b09f0 2023-10-06T11:20:19.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.254+0000 7ff8837fe700 1 -- 172.21.15.146:0/3689516597 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff87c00ba50 con 0x7ff8840b09f0 2023-10-06T11:20:19.258 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.254+0000 7ff8837fe700 1 -- 172.21.15.146:0/3689516597 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff87c0092e0 con 0x7ff8840b09f0 2023-10-06T11:20:19.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.254+0000 7ff88abad700 1 -- 172.21.15.146:0/3689516597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8840b09f0 msgr2=0x7ff8840b0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:19.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.254+0000 7ff88abad700 1 --2- 172.21.15.146:0/3689516597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8840b09f0 0x7ff8840b0dc0 secure :-1 s=READY pgs=2335 cs=0 l=1 rev1=1 crypto rx=0x7ff884069470 tx=0x7ff87c009840 comp rx=0 tx=0).stop 2023-10-06T11:20:19.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.254+0000 7ff88abad700 1 -- 172.21.15.146:0/3689516597 shutdown_connections 2023-10-06T11:20:19.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.254+0000 7ff88abad700 1 --2- 172.21.15.146:0/3689516597 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8840b09f0 0x7ff8840b0dc0 unknown :-1 s=CLOSED pgs=2335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:19.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.254+0000 7ff88abad700 1 --2- 172.21.15.146:0/3689516597 >> v2:172.21.15.151:3300/0 conn(0x7ff8840cd480 0x7ff88415abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:19.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.255+0000 7ff88abad700 1 -- 172.21.15.146:0/3689516597 >> 172.21.15.146:0/3689516597 conn(0x7ff88406eb10 msgr2=0x7ff88406ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:19.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.255+0000 7ff88abad700 1 -- 172.21.15.146:0/3689516597 shutdown_connections 2023-10-06T11:20:19.259 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.255+0000 7ff88abad700 1 -- 172.21.15.146:0/3689516597 wait complete. 2023-10-06T11:20:19.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.256+0000 7ff88abad700 1 Processor -- start 2023-10-06T11:20:19.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.256+0000 7ff88abad700 1 -- start start 2023-10-06T11:20:19.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.256+0000 7ff88abad700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8840b09f0 0x7ff8841589f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:19.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.256+0000 7ff88abad700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8840cd0b0 0x7ff8840c4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:19.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.256+0000 7ff88abad700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8840cd480 0x7ff8840c9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:19.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.256+0000 7ff88abad700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff88415e7c0 con 0x7ff8840cd0b0 2023-10-06T11:20:19.262 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.256+0000 7ff88abad700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff884158f30 con 0x7ff8840cd480 2023-10-06T11:20:19.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.256+0000 7ff88abad700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff88415ea60 con 0x7ff8840b09f0 2023-10-06T11:20:19.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.257+0000 7ff883fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8840cd0b0 0x7ff8840c4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:19.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.257+0000 7ff883fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8840cd0b0 0x7ff8840c4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57664/0 (socket says 172.21.15.146:57664) 2023-10-06T11:20:19.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.257+0000 7ff883fff700 1 -- 172.21.15.146:0/1473233333 learned_addr learned my addr 172.21.15.146:0/1473233333 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:19.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.257+0000 7ff88914a700 1 --2- 172.21.15.146:0/1473233333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8840cd480 0x7ff8840c9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:19.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.257+0000 7ff888949700 1 --2- 172.21.15.146:0/1473233333 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8840b09f0 0x7ff8841589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:19.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.257+0000 7ff883fff700 1 -- 172.21.15.146:0/1473233333 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8840b09f0 msgr2=0x7ff8841589f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:19.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.257+0000 7ff883fff700 1 --2- 172.21.15.146:0/1473233333 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8840b09f0 0x7ff8841589f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:19.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.257+0000 7ff883fff700 1 -- 172.21.15.146:0/1473233333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8840cd480 msgr2=0x7ff8840c9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:19.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.257+0000 7ff883fff700 1 --2- 172.21.15.146:0/1473233333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8840cd480 0x7ff8840c9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:19.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.257+0000 7ff883fff700 1 -- 172.21.15.146:0/1473233333 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff87c009ae0 con 0x7ff8840cd0b0 2023-10-06T11:20:19.263 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.257+0000 7ff883fff700 1 --2- 172.21.15.146:0/1473233333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8840cd0b0 0x7ff8840c4cd0 secure :-1 s=READY pgs=2336 cs=0 l=1 rev1=1 crypto rx=0x7ff87000d860 tx=0x7ff870008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:19.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.257+0000 7ff880ff9700 1 -- 172.21.15.146:0/1473233333 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8700125f0 con 0x7ff8840cd0b0 2023-10-06T11:20:19.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.257+0000 7ff880ff9700 1 -- 172.21.15.146:0/1473233333 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff870012750 con 0x7ff8840cd0b0 2023-10-06T11:20:19.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.257+0000 7ff88abad700 1 -- 172.21.15.146:0/1473233333 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff88415ed40 con 0x7ff8840cd0b0 2023-10-06T11:20:19.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.257+0000 7ff880ff9700 1 -- 172.21.15.146:0/1473233333 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff870012af0 con 0x7ff8840cd0b0 2023-10-06T11:20:19.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.257+0000 7ff88abad700 1 -- 172.21.15.146:0/1473233333 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff88416a770 con 0x7ff8840cd0b0 2023-10-06T11:20:19.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.258+0000 7ff88abad700 1 -- 172.21.15.146:0/1473233333 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff884070ec0 con 0x7ff8840cd0b0 2023-10-06T11:20:19.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.259+0000 7ff880ff9700 1 -- 172.21.15.146:0/1473233333 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff870013480 con 0x7ff8840cd0b0 2023-10-06T11:20:19.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.259+0000 7ff880ff9700 1 --2- 172.21.15.146:0/1473233333 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff868066f30 0x7ff8680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:19.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.259+0000 7ff888949700 1 --2- 172.21.15.146:0/1473233333 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff868066f30 0x7ff8680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:19.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.259+0000 7ff880ff9700 1 -- 172.21.15.146:0/1473233333 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6231+0+0 (secure 0 0 0) 0x7ff870084880 con 0x7ff8840cd0b0 2023-10-06T11:20:19.264 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.260+0000 7ff888949700 1 --2- 172.21.15.146:0/1473233333 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff868066f30 0x7ff8680693e0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7ff8840cf7f0 tx=0x7ff878009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:19.265 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.264+0000 7ff880ff9700 1 -- 172.21.15.146:0/1473233333 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff8700518e0 con 0x7ff8840cd0b0 2023-10-06T11:20:19.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.490+0000 7ff88abad700 1 -- 172.21.15.146:0/1473233333 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff88404c380 con 0x7ff8840cd0b0 2023-10-06T11:20:19.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.491+0000 7ff880ff9700 1 -- 172.21.15.146:0/1473233333 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 150 v150) v1 ==== 95+0+4622 (secure 0 0 0) 0x7ff870054f00 con 0x7ff8840cd0b0 2023-10-06T11:20:19.493 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:20:19.493 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":150,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9094,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/3426437100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3426437100},{"type":"v1","addr":"172.21.15.146:6836","nonce":3426437100}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":139},{"gid":9106,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/3275041097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":3275041097},{"type":"v1","addr":"172.21.15.151:6835","nonce":3275041097}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":139},{"gid":9259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/959352692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":959352692},{"type":"v1","addr":"172.21.15.151:6834","nonce":959352692}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":146}],"filesystems":[{"mdsmap":{"epoch":150,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:18:51.903907+0000","modified":"2023-10-06T11:19:16.147837+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":178,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10461":{"gid":10461,"name":"c","rank":0,"incarnation":147,"state":"up:active","state_seq":10,"addr":"172.21.15.146:6837/2322816938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2322816938},{"type":"v1","addr":"172.21.15.146:6837","nonce":2322816938}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-10-06T11:20:19.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.493+0000 7ff88abad700 1 -- 172.21.15.146:0/1473233333 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff868066f30 msgr2=0x7ff8680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:19.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.493+0000 7ff88abad700 1 --2- 172.21.15.146:0/1473233333 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff868066f30 0x7ff8680693e0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7ff8840cf7f0 tx=0x7ff878009040 comp rx=0 tx=0).stop 2023-10-06T11:20:19.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.493+0000 7ff88abad700 1 -- 172.21.15.146:0/1473233333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8840cd0b0 msgr2=0x7ff8840c4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:19.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.493+0000 7ff88abad700 1 --2- 172.21.15.146:0/1473233333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8840cd0b0 0x7ff8840c4cd0 secure :-1 s=READY pgs=2336 cs=0 l=1 rev1=1 crypto rx=0x7ff87000d860 tx=0x7ff870008040 comp rx=0 tx=0).stop 2023-10-06T11:20:19.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.493+0000 7ff88abad700 1 -- 172.21.15.146:0/1473233333 shutdown_connections 2023-10-06T11:20:19.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.493+0000 7ff88abad700 1 --2- 172.21.15.146:0/1473233333 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff868066f30 0x7ff8680693e0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:19.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.493+0000 7ff88abad700 1 --2- 172.21.15.146:0/1473233333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8840cd480 0x7ff8840c9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:19.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.493+0000 7ff88abad700 1 --2- 172.21.15.146:0/1473233333 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff8840b09f0 0x7ff8841589f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:19.495 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.493+0000 7ff88abad700 1 --2- 172.21.15.146:0/1473233333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff8840cd0b0 0x7ff8840c4cd0 unknown :-1 s=CLOSED pgs=2336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:19.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.493+0000 7ff88abad700 1 -- 172.21.15.146:0/1473233333 >> 172.21.15.146:0/1473233333 conn(0x7ff88406eb10 msgr2=0x7ff88406eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:19.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.493+0000 7ff88abad700 1 -- 172.21.15.146:0/1473233333 shutdown_connections 2023-10-06T11:20:19.496 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.493+0000 7ff88abad700 1 -- 172.21.15.146:0/1473233333 wait complete. 2023-10-06T11:20:19.496 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 150 2023-10-06T11:20:19.507 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 150, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T11:18:51.903907+0000', 'modified': '2023-10-06T11:19:16.147837+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 178, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 10461}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_10461': {'gid': 10461, 'name': 'c', 'rank': 0, 'incarnation': 147, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.146:6837/2322816938', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.146:6835', 'nonce': 2322816938}, {'type': 'v1', 'addr': '172.21.15.146:6837', 'nonce': 2322816938}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T11:20:19.507 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T11:20:19.507 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-06T11:20:19.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.622+0000 7f9f49873700 1 Processor -- start 2023-10-06T11:20:19.624 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.622+0000 7f9f49873700 1 -- start start 2023-10-06T11:20:19.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.623+0000 7f9f49873700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9f44158870 0x7f9f4406b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:19.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.623+0000 7f9f49873700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9f4406bca0 0x7f9f440cc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:19.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.623+0000 7f9f49873700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f4406c0a0 con 0x7f9f441584a0 2023-10-06T11:20:19.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.623+0000 7f9f49873700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f44158d10 con 0x7f9f4406bca0 2023-10-06T11:20:19.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.623+0000 7f9f49873700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f4415b440 con 0x7f9f44158870 2023-10-06T11:20:19.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.623+0000 7f9f42ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f9f441584a0 0x7f9f440c8a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:37034/0 (socket says 172.21.15.146:37034) 2023-10-06T11:20:19.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.623+0000 7f9f437fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9f4406bca0 0x7f9f440cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:19.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.623+0000 7f9f42ffd700 1 -- 172.21.15.146:0/3335166013 learned_addr learned my addr 172.21.15.146:0/3335166013 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:20:19.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.624+0000 7f9f3a7fc700 1 --2- 172.21.15.146:0/3335166013 >> v2:172.21.15.151:3300/0 conn(0x7f9f44158870 0x7f9f4406b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:19.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.624+0000 7f9f437fe700 1 -- 172.21.15.146:0/3335166013 >> v2:172.21.15.151:3300/0 conn(0x7f9f44158870 msgr2=0x7f9f4406b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:19.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.624+0000 7f9f437fe700 1 --2- 172.21.15.146:0/3335166013 >> v2:172.21.15.151:3300/0 conn(0x7f9f44158870 0x7f9f4406b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:19.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.624+0000 7f9f437fe700 1 -- 172.21.15.146:0/3335166013 >> v1:172.21.15.146:6789/0 conn(0x7f9f441584a0 legacy=0x7f9f440c8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:19.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.624+0000 7f9f437fe700 1 -- 172.21.15.146:0/3335166013 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f4415b720 con 0x7f9f4406bca0 2023-10-06T11:20:19.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.624+0000 7f9f427fc700 1 -- 172.21.15.146:0/3335166013 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3449128313 0 0) 0x7f9f4406c0a0 con 0x7f9f441584a0 2023-10-06T11:20:19.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.624+0000 7f9f3a7fc700 1 --2- 172.21.15.146:0/3335166013 >> v2:172.21.15.151:3300/0 conn(0x7f9f44158870 0x7f9f4406b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:20:19.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.624+0000 7f9f437fe700 1 --2- 172.21.15.146:0/3335166013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f4406bca0 0x7f9f440cc020 secure :-1 s=READY pgs=2338 cs=0 l=1 rev1=1 crypto rx=0x7f9f440b0ca0 tx=0x7f9f3c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c63309d568cf463 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:19.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.624+0000 7f9f427fc700 1 -- 172.21.15.146:0/3335166013 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c00e070 con 0x7f9f4406bca0 2023-10-06T11:20:19.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.624+0000 7f9f427fc700 1 -- 172.21.15.146:0/3335166013 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3c00bc30 con 0x7f9f4406bca0 2023-10-06T11:20:19.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.624+0000 7f9f427fc700 1 -- 172.21.15.146:0/3335166013 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c012430 con 0x7f9f4406bca0 2023-10-06T11:20:19.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.624+0000 7f9f49873700 1 -- 172.21.15.146:0/3335166013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f4406bca0 msgr2=0x7f9f440cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:19.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.624+0000 7f9f49873700 1 --2- 172.21.15.146:0/3335166013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f4406bca0 0x7f9f440cc020 secure :-1 s=READY pgs=2338 cs=0 l=1 rev1=1 crypto rx=0x7f9f440b0ca0 tx=0x7f9f3c009780 comp rx=0 tx=0).stop 2023-10-06T11:20:19.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.625+0000 7f9f49873700 1 -- 172.21.15.146:0/3335166013 shutdown_connections 2023-10-06T11:20:19.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.625+0000 7f9f49873700 1 --2- 172.21.15.146:0/3335166013 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f4406bca0 0x7f9f440cc020 unknown :-1 s=CLOSED pgs=2338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:19.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.625+0000 7f9f49873700 1 --2- 172.21.15.146:0/3335166013 >> v2:172.21.15.151:3300/0 conn(0x7f9f44158870 0x7f9f4406b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:19.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.625+0000 7f9f49873700 1 -- 172.21.15.146:0/3335166013 >> 172.21.15.146:0/3335166013 conn(0x7f9f44067eb0 msgr2=0x7f9f440ce450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:19.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.625+0000 7f9f49873700 1 -- 172.21.15.146:0/3335166013 shutdown_connections 2023-10-06T11:20:19.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.625+0000 7f9f49873700 1 -- 172.21.15.146:0/3335166013 wait complete. 2023-10-06T11:20:19.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.626+0000 7f9f49873700 1 Processor -- start 2023-10-06T11:20:19.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.626+0000 7f9f49873700 1 -- start start 2023-10-06T11:20:19.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.627+0000 7f9f49873700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9f4406bca0 0x7f9f4414cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:19.632 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.627+0000 7f9f49873700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f441584a0 0x7f9f44169420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:19.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.627+0000 7f9f49873700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f44158870 0x7f9f440cc540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:19.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.627+0000 7f9f49873700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f44068a00 con 0x7f9f441584a0 2023-10-06T11:20:19.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.627+0000 7f9f49873700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f440b3630 con 0x7f9f44158870 2023-10-06T11:20:19.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.627+0000 7f9f49873700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f440b3910 con 0x7f9f4406bca0 2023-10-06T11:20:19.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.627+0000 7f9f3a7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f441584a0 0x7f9f44169420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:19.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.627+0000 7f9f3a7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f441584a0 0x7f9f44169420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57690/0 (socket says 172.21.15.146:57690) 2023-10-06T11:20:19.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.627+0000 7f9f3a7fc700 1 -- 172.21.15.146:0/3301868040 learned_addr learned my addr 172.21.15.146:0/3301868040 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:19.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.627+0000 7f9f437fe700 1 --2- 172.21.15.146:0/3301868040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f44158870 0x7f9f440cc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:19.633 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.627+0000 7f9f42ffd700 1 --2- 172.21.15.146:0/3301868040 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9f4406bca0 0x7f9f4414cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:19.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.627+0000 7f9f3a7fc700 1 -- 172.21.15.146:0/3301868040 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9f4406bca0 msgr2=0x7f9f4414cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:19.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.627+0000 7f9f3a7fc700 1 --2- 172.21.15.146:0/3301868040 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9f4406bca0 0x7f9f4414cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:19.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.627+0000 7f9f3a7fc700 1 -- 172.21.15.146:0/3301868040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f44158870 msgr2=0x7f9f440cc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:19.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.627+0000 7f9f3a7fc700 1 --2- 172.21.15.146:0/3301868040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f44158870 0x7f9f440cc540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:19.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.627+0000 7f9f3a7fc700 1 -- 172.21.15.146:0/3301868040 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f3c009a20 con 0x7f9f441584a0 2023-10-06T11:20:19.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.627+0000 7f9f437fe700 1 --2- 172.21.15.146:0/3301868040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f44158870 0x7f9f440cc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:20:19.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.627+0000 7f9f3a7fc700 1 --2- 172.21.15.146:0/3301868040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f441584a0 0x7f9f44169420 secure :-1 s=READY pgs=2339 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c00c850 tx=0x7f9f2c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:19.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.627+0000 7f9f3b7fe700 1 -- 172.21.15.146:0/3301868040 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c011600 con 0x7f9f441584a0 2023-10-06T11:20:19.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.627+0000 7f9f3b7fe700 1 -- 172.21.15.146:0/3301868040 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f2c011760 con 0x7f9f441584a0 2023-10-06T11:20:19.634 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.627+0000 7f9f49873700 1 -- 172.21.15.146:0/3301868040 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f440b3bf0 con 0x7f9f441584a0 2023-10-06T11:20:19.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.627+0000 7f9f3b7fe700 1 -- 172.21.15.146:0/3301868040 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c011b00 con 0x7f9f441584a0 2023-10-06T11:20:19.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.627+0000 7f9f49873700 1 -- 172.21.15.146:0/3301868040 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f4414d4a0 con 0x7f9f441584a0 2023-10-06T11:20:19.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.629+0000 7f9f3b7fe700 1 -- 172.21.15.146:0/3301868040 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9f2c0073b0 con 0x7f9f441584a0 2023-10-06T11:20:19.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.629+0000 7f9f3b7fe700 1 --2- 172.21.15.146:0/3301868040 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9f24066f60 0x7f9f24069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:19.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.629+0000 7f9f3b7fe700 1 -- 172.21.15.146:0/3301868040 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6231+0+0 (secure 0 0 0) 0x7f9f2c084740 con 0x7f9f441584a0 2023-10-06T11:20:19.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.629+0000 7f9f42ffd700 1 --2- 172.21.15.146:0/3301868040 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9f24066f60 0x7f9f24069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:19.635 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.629+0000 7f9f42ffd700 1 --2- 172.21.15.146:0/3301868040 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9f24066f60 0x7f9f24069410 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f9f340011e0 tx=0x7f9f34009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:19.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.631+0000 7f9f52b6bb80 1 Processor -- start 2023-10-06T11:20:19.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.631+0000 7f9f52b6bb80 1 -- start start 2023-10-06T11:20:19.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.632+0000 7f9f52b6bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5587a29afa90 0x5587a29afe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:19.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.632+0000 7f9f52b6bb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5587a296b9a0 0x5587a2968580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:19.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.632+0000 7f9f52b6bb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587a2969bd0 0x5587a2968ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:19.642 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.632+0000 7f9f52b6bb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587a28e8c80 con 0x5587a2969bd0 2023-10-06T11:20:19.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.632+0000 7f9f52b6bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587a28bfa70 con 0x5587a29afa90 2023-10-06T11:20:19.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.632+0000 7f9f52b6bb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5587a28bd270 con 0x5587a296b9a0 2023-10-06T11:20:19.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.632+0000 7f9f437fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587a2969bd0 0x5587a2968ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:19.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.632+0000 7f9f437fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587a2969bd0 0x5587a2968ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57696/0 (socket says 172.21.15.146:57696) 2023-10-06T11:20:19.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.632+0000 7f9f437fe700 1 -- 172.21.15.146:0/4183408487 learned_addr learned my addr 172.21.15.146:0/4183408487 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:19.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.632+0000 7f9f3a7fc700 1 --2- 172.21.15.146:0/4183408487 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5587a296b9a0 0x5587a2968580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:19.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.632+0000 7f9f42ffd700 1 --2- 172.21.15.146:0/4183408487 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5587a29afa90 0x5587a29afe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:19.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.632+0000 7f9f437fe700 1 -- 172.21.15.146:0/4183408487 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5587a296b9a0 msgr2=0x5587a2968580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:19.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.632+0000 7f9f437fe700 1 --2- 172.21.15.146:0/4183408487 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5587a296b9a0 0x5587a2968580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:19.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.632+0000 7f9f437fe700 1 -- 172.21.15.146:0/4183408487 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5587a29afa90 msgr2=0x5587a29afe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:19.643 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.632+0000 7f9f437fe700 1 --2- 172.21.15.146:0/4183408487 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5587a29afa90 0x5587a29afe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:19.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.632+0000 7f9f437fe700 1 -- 172.21.15.146:0/4183408487 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5587a2753270 con 0x5587a2969bd0 2023-10-06T11:20:19.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.632+0000 7f9f42ffd700 1 --2- 172.21.15.146:0/4183408487 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5587a29afa90 0x5587a29afe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:20:19.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.633+0000 7f9f437fe700 1 --2- 172.21.15.146:0/4183408487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587a2969bd0 0x5587a2968ac0 secure :-1 s=READY pgs=2340 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c0097c0 tx=0x7f9f3c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0de99d5e9136a6a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:19.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.633+0000 7f9f23fff700 1 -- 172.21.15.146:0/4183408487 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c012810 con 0x5587a2969bd0 2023-10-06T11:20:19.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.633+0000 7f9f23fff700 1 -- 172.21.15.146:0/4183408487 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3c012970 con 0x5587a2969bd0 2023-10-06T11:20:19.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.633+0000 7f9f23fff700 1 -- 172.21.15.146:0/4183408487 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c012cf0 con 0x5587a2969bd0 2023-10-06T11:20:19.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.633+0000 7f9f52b6bb80 1 -- 172.21.15.146:0/4183408487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587a2969bd0 msgr2=0x5587a2968ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:19.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.633+0000 7f9f52b6bb80 1 --2- 172.21.15.146:0/4183408487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587a2969bd0 0x5587a2968ac0 secure :-1 s=READY pgs=2340 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c0097c0 tx=0x7f9f3c019000 comp rx=0 tx=0).stop 2023-10-06T11:20:19.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.633+0000 7f9f52b6bb80 1 -- 172.21.15.146:0/4183408487 shutdown_connections 2023-10-06T11:20:19.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.633+0000 7f9f52b6bb80 1 --2- 172.21.15.146:0/4183408487 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587a2969bd0 0x5587a2968ac0 unknown :-1 s=CLOSED pgs=2340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:19.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.633+0000 7f9f52b6bb80 1 --2- 172.21.15.146:0/4183408487 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5587a29afa90 0x5587a29afe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:19.644 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.633+0000 7f9f52b6bb80 1 --2- 172.21.15.146:0/4183408487 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5587a296b9a0 0x5587a2968580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:19.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.633+0000 7f9f52b6bb80 1 -- 172.21.15.146:0/4183408487 >> 172.21.15.146:0/4183408487 conn(0x5587a296a070 msgr2=0x5587a296a440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:19.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.633+0000 7f9f52b6bb80 1 -- 172.21.15.146:0/4183408487 shutdown_connections 2023-10-06T11:20:19.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.633+0000 7f9f52b6bb80 1 -- 172.21.15.146:0/4183408487 wait complete. 2023-10-06T11:20:19.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.634+0000 7f9f52b6bb80 1 -- start start 2023-10-06T11:20:19.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.634+0000 7f9f52b6bb80 1 Processor -- start 2023-10-06T11:20:19.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.635+0000 7f9f52b6bb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5587a2969bd0 0x5587a298d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:19.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.635+0000 7f9f52b6bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5587a296b9a0 0x5587a29bf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:19.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.635+0000 7f9f52b6bb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587a29afa90 0x5587a29b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:19.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.635+0000 7f9f52b6bb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587a28b9060 con 0x5587a29afa90 2023-10-06T11:20:19.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.635+0000 7f9f52b6bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587a2864890 con 0x5587a296b9a0 2023-10-06T11:20:19.645 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.635+0000 7f9f52b6bb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5587a287fea0 con 0x5587a2969bd0 2023-10-06T11:20:19.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.635+0000 7f9f52b6bb80 10 client.0 _ll_register_callbacks cb 0x5587a2755f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:20:19.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.635+0000 7f9f437fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587a29afa90 0x5587a29b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:19.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.635+0000 7f9f437fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587a29afa90 0x5587a29b2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57706/0 (socket says 172.21.15.146:57706) 2023-10-06T11:20:19.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.635+0000 7f9f437fe700 1 -- 172.21.15.146:0/2918412328 learned_addr learned my addr 172.21.15.146:0/2918412328 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:19.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.635+0000 7f9f42ffd700 1 --2- 172.21.15.146:0/2918412328 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5587a2969bd0 0x5587a298d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:19.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.635+0000 7f9f3a7fc700 1 --2- 172.21.15.146:0/2918412328 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5587a296b9a0 0x5587a29bf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:19.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.635+0000 7f9f437fe700 1 -- 172.21.15.146:0/2918412328 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5587a2969bd0 msgr2=0x5587a298d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:19.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.635+0000 7f9f437fe700 1 --2- 172.21.15.146:0/2918412328 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5587a2969bd0 0x5587a298d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:19.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.635+0000 7f9f437fe700 1 -- 172.21.15.146:0/2918412328 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5587a296b9a0 msgr2=0x5587a29bf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:19.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.635+0000 7f9f437fe700 1 --2- 172.21.15.146:0/2918412328 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5587a296b9a0 0x5587a29bf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:19.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.635+0000 7f9f437fe700 1 -- 172.21.15.146:0/2918412328 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f4415b720 con 0x5587a29afa90 2023-10-06T11:20:19.646 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.635+0000 7f9f42ffd700 1 --2- 172.21.15.146:0/2918412328 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5587a2969bd0 0x5587a298d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:20:19.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.636+0000 7f9f437fe700 1 --2- 172.21.15.146:0/2918412328 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587a29afa90 0x5587a29b2e50 secure :-1 s=READY pgs=2341 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c00b6c0 tx=0x7f9f3c020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=853db7f518fbe009 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:19.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.636+0000 7f9f217fa700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:20:19.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.636+0000 7f9f217fa700 1 -- 172.21.15.146:0/2918412328 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c02b070 con 0x5587a29afa90 2023-10-06T11:20:19.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.636+0000 7f9f217fa700 1 -- 172.21.15.146:0/2918412328 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(180..180 src has 1..180) v4 ==== 6231+0+0 (secure 0 0 0) 0x7f9f3c012e00 con 0x5587a29afa90 2023-10-06T11:20:19.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.636+0000 7f9f52b6bb80 1 -- 172.21.15.146:0/2918412328 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5587a295d690 con 0x5587a29afa90 2023-10-06T11:20:19.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.636+0000 7f9f217fa700 1 -- 172.21.15.146:0/2918412328 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=150) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f3c026850 con 0x5587a29afa90 2023-10-06T11:20:19.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.636+0000 7f9f52b6bb80 10 client.10878 fetch_fsmap learned FSMap version 150 2023-10-06T11:20:19.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.636+0000 7f9f52b6bb80 1 -- 172.21.15.146:0/2918412328 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=150,monmap=2+}) v3 -- 0x5587a26f5fe0 con 0x5587a29afa90 2023-10-06T11:20:19.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.636+0000 7f9f217fa700 1 -- 172.21.15.146:0/2918412328 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5587a295d690 con 0x5587a29afa90 2023-10-06T11:20:19.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.636+0000 7f9f217fa700 1 -- 172.21.15.146:0/2918412328 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 150) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9f3c0269b0 con 0x5587a29afa90 2023-10-06T11:20:19.647 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.636+0000 7f9f52b6bb80 10 client.10878 fetch_fsmap finished waiting for FSMap version 150 2023-10-06T11:20:19.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.636+0000 7f9f52b6bb80 10 client.10878 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T11:20:19.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.636+0000 7f9f52b6bb80 20 client.10878 populate_metadata read hostname 'smithi146' 2023-10-06T11:20:19.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.636+0000 7f9f52b6bb80 1 --2- 172.21.15.146:0/2918412328 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x5587a29c14e0 0x5587a29c18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:19.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.636+0000 7f9f52b6bb80 4 client.10878 mds_command: new command op to 10461 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T11:20:19.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.636+0000 7f9f52b6bb80 1 -- 172.21.15.146:0/2918412328 --> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5587a293a5c0 con 0x5587a29c14e0 2023-10-06T11:20:19.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.636+0000 7f9f42ffd700 1 --2- 172.21.15.146:0/2918412328 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x5587a29c14e0 0x5587a29c18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:19.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.637+0000 7f9f217fa700 10 client.10878 ms_handle_connect on v2:172.21.15.146:6835/2322816938 2023-10-06T11:20:19.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.637+0000 7f9f42ffd700 1 --2- 172.21.15.146:0/2918412328 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x5587a29c14e0 0x5587a29c18b0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b0e44e71f63c56b server_cookie=589be77be486bf55 in_seq=0 out_seq=0 2023-10-06T11:20:19.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.637+0000 7f9f217fa700 1 -- 172.21.15.146:0/2918412328 <== mds.0 v2:172.21.15.146:6835/2322816938 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5587a293a5c0 con 0x5587a29c14e0 2023-10-06T11:20:19.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.637+0000 7f9f217fa700 10 client.10878 handle_command_reply: tid=0 2023-10-06T11:20:19.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.637+0000 7f9f52b6bb80 1 client.10878 shutdown 2023-10-06T11:20:19.648 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.637+0000 7f9f52b6bb80 1 -- 172.21.15.146:0/2918412328 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587a29afa90 msgr2=0x5587a29b2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:19.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.637+0000 7f9f52b6bb80 1 --2- 172.21.15.146:0/2918412328 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587a29afa90 0x5587a29b2e50 secure :-1 s=READY pgs=2341 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c00b6c0 tx=0x7f9f3c020040 comp rx=0 tx=0).stop 2023-10-06T11:20:19.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.637+0000 7f9f52b6bb80 1 -- 172.21.15.146:0/2918412328 shutdown_connections 2023-10-06T11:20:19.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.637+0000 7f9f52b6bb80 1 --2- 172.21.15.146:0/2918412328 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x5587a29c14e0 0x5587a29c18b0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:19.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.637+0000 7f9f52b6bb80 1 --2- 172.21.15.146:0/2918412328 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587a29afa90 0x5587a29b2e50 unknown :-1 s=CLOSED pgs=2341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:19.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.637+0000 7f9f52b6bb80 1 --2- 172.21.15.146:0/2918412328 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5587a2969bd0 0x5587a298d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:19.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.637+0000 7f9f217fa700 0 client.10878 ms_handle_reset on v2:172.21.15.146:6835/2322816938 2023-10-06T11:20:19.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.637+0000 7f9f52b6bb80 1 --2- 172.21.15.146:0/2918412328 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5587a296b9a0 0x5587a29bf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:19.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.637+0000 7f9f52b6bb80 1 -- 172.21.15.146:0/2918412328 >> 172.21.15.146:0/2918412328 conn(0x5587a296a070 msgr2=0x5587a29ad2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:19.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.637+0000 7f9f52b6bb80 1 -- 172.21.15.146:0/2918412328 shutdown_connections 2023-10-06T11:20:19.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.637+0000 7f9f52b6bb80 1 -- 172.21.15.146:0/2918412328 wait complete. 2023-10-06T11:20:19.649 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.638+0000 7f9f52b6bb80 20 client.10878 trim_cache size 0 max 16384 2023-10-06T11:20:19.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.654+0000 7f9f52b6bb80 1 Processor -- start 2023-10-06T11:20:19.656 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.654+0000 7f9f52b6bb80 1 -- start start 2023-10-06T11:20:19.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.655+0000 7f9f52b6bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5587a2969bd0 0x5587a29ad000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:19.664 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.655+0000 7f9f52b6bb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587a296b9a0 0x5587a29ad540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:19.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.655+0000 7f9f52b6bb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5587a29afa90 0x5587a298d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:19.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.655+0000 7f9f52b6bb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587a273be30 con 0x5587a296b9a0 2023-10-06T11:20:19.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.655+0000 7f9f52b6bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587a29c07e0 con 0x5587a2969bd0 2023-10-06T11:20:19.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.655+0000 7f9f52b6bb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5587a298c520 con 0x5587a29afa90 2023-10-06T11:20:19.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.655+0000 7f9f3a7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587a296b9a0 0x5587a29ad540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:19.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.655+0000 7f9f3a7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587a296b9a0 0x5587a29ad540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57714/0 (socket says 172.21.15.146:57714) 2023-10-06T11:20:19.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.655+0000 7f9f3a7fc700 1 -- 172.21.15.146:0/230123784 learned_addr learned my addr 172.21.15.146:0/230123784 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:19.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.655+0000 7f9f3a7fc700 1 -- 172.21.15.146:0/230123784 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5587a29afa90 msgr2=0x5587a298d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:19.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.655+0000 7f9f42ffd700 1 --2- 172.21.15.146:0/230123784 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5587a2969bd0 0x5587a29ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:19.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.655+0000 7f9f437fe700 1 --2- 172.21.15.146:0/230123784 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5587a29afa90 0x5587a298d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:19.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.655+0000 7f9f3a7fc700 1 --2- 172.21.15.146:0/230123784 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5587a29afa90 0x5587a298d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:19.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.655+0000 7f9f3a7fc700 1 -- 172.21.15.146:0/230123784 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5587a2969bd0 msgr2=0x5587a29ad000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:19.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.655+0000 7f9f3a7fc700 1 --2- 172.21.15.146:0/230123784 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5587a2969bd0 0x5587a29ad000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:19.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.655+0000 7f9f3a7fc700 1 -- 172.21.15.146:0/230123784 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5587a2993280 con 0x5587a296b9a0 2023-10-06T11:20:19.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.655+0000 7f9f3a7fc700 1 --2- 172.21.15.146:0/230123784 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587a296b9a0 0x5587a29ad540 secure :-1 s=READY pgs=2342 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c055160 tx=0x7f9f2c0829b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d3dacd3e346cdb4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:19.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.655+0000 7f9f38ff9700 1 -- 172.21.15.146:0/230123784 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c0586b0 con 0x5587a296b9a0 2023-10-06T11:20:19.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.655+0000 7f9f38ff9700 1 -- 172.21.15.146:0/230123784 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f2c05c400 con 0x5587a296b9a0 2023-10-06T11:20:19.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.655+0000 7f9f38ff9700 1 -- 172.21.15.146:0/230123784 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c053800 con 0x5587a296b9a0 2023-10-06T11:20:19.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.656+0000 7f9f52b6bb80 1 -- 172.21.15.146:0/230123784 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587a296b9a0 msgr2=0x5587a29ad540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:19.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.656+0000 7f9f52b6bb80 1 --2- 172.21.15.146:0/230123784 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587a296b9a0 0x5587a29ad540 secure :-1 s=READY pgs=2342 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c055160 tx=0x7f9f2c0829b0 comp rx=0 tx=0).stop 2023-10-06T11:20:19.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.656+0000 7f9f52b6bb80 1 -- 172.21.15.146:0/230123784 shutdown_connections 2023-10-06T11:20:19.666 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.656+0000 7f9f52b6bb80 1 --2- 172.21.15.146:0/230123784 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5587a29afa90 0x5587a298d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:19.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.656+0000 7f9f52b6bb80 1 --2- 172.21.15.146:0/230123784 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5587a2969bd0 0x5587a29ad000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:19.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.656+0000 7f9f52b6bb80 1 --2- 172.21.15.146:0/230123784 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587a296b9a0 0x5587a29ad540 unknown :-1 s=CLOSED pgs=2342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:19.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.656+0000 7f9f52b6bb80 1 -- 172.21.15.146:0/230123784 >> 172.21.15.146:0/230123784 conn(0x5587a296a070 msgr2=0x5587a29ac8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:19.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.656+0000 7f9f52b6bb80 1 -- 172.21.15.146:0/230123784 shutdown_connections 2023-10-06T11:20:19.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.656+0000 7f9f52b6bb80 1 -- 172.21.15.146:0/230123784 wait complete. 2023-10-06T11:20:19.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.657+0000 7f9f52b6bb80 1 -- start start 2023-10-06T11:20:19.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.657+0000 7f9f52b6bb80 1 Processor -- start 2023-10-06T11:20:19.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.657+0000 7f9f52b6bb80 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5587a2969bd0 0x5587a2a0e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:19.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.657+0000 7f9f52b6bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5587a296b9a0 0x5587a2a14110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:19.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.657+0000 7f9f52b6bb80 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587a29afa90 0x5587a29c8010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:19.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.657+0000 7f9f52b6bb80 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587a29653b0 con 0x5587a29afa90 2023-10-06T11:20:19.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.658+0000 7f9f52b6bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587a29c78e0 con 0x5587a296b9a0 2023-10-06T11:20:19.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.658+0000 7f9f52b6bb80 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5587a2992d90 con 0x5587a2969bd0 2023-10-06T11:20:19.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.658+0000 7f9f52b6bb80 10 client.0 _ll_register_callbacks cb 0x5587a2755f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T11:20:19.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.658+0000 7f9f437fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587a29afa90 0x5587a29c8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:19.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.658+0000 7f9f437fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587a29afa90 0x5587a29c8010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57730/0 (socket says 172.21.15.146:57730) 2023-10-06T11:20:19.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.658+0000 7f9f437fe700 1 -- 172.21.15.146:0/378029333 learned_addr learned my addr 172.21.15.146:0/378029333 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:19.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.658+0000 7f9f437fe700 1 -- 172.21.15.146:0/378029333 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5587a2969bd0 msgr2=0x5587a2a0e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:19.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.658+0000 7f9f42ffd700 1 --2- 172.21.15.146:0/378029333 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5587a2969bd0 0x5587a2a0e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:19.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.658+0000 7f9f3a7fc700 1 --2- 172.21.15.146:0/378029333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5587a296b9a0 0x5587a2a14110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:19.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.658+0000 7f9f437fe700 1 --2- 172.21.15.146:0/378029333 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5587a2969bd0 0x5587a2a0e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:19.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.658+0000 7f9f437fe700 1 -- 172.21.15.146:0/378029333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5587a296b9a0 msgr2=0x5587a2a14110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:19.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.658+0000 7f9f437fe700 1 --2- 172.21.15.146:0/378029333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5587a296b9a0 0x5587a2a14110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:19.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.658+0000 7f9f437fe700 1 -- 172.21.15.146:0/378029333 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f2c082e70 con 0x5587a29afa90 2023-10-06T11:20:19.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.658+0000 7f9f437fe700 1 --2- 172.21.15.146:0/378029333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587a29afa90 0x5587a29c8010 secure :-1 s=READY pgs=2343 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c026ed0 tx=0x7f9f3c028050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e0fa042af894bc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:19.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.658+0000 7f9f217fa700 10 client.0 ms_handle_connect on v2:172.21.15.146:3300/0 2023-10-06T11:20:19.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.658+0000 7f9f217fa700 1 -- 172.21.15.146:0/378029333 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f3c02b040 con 0x5587a29afa90 2023-10-06T11:20:19.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.658+0000 7f9f217fa700 1 -- 172.21.15.146:0/378029333 <== mon.0 v2:172.21.15.146:3300/0 2 ==== osd_map(180..180 src has 1..180) v4 ==== 6231+0+0 (secure 0 0 0) 0x7f9f3c026850 con 0x5587a29afa90 2023-10-06T11:20:19.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.658+0000 7f9f52b6bb80 1 -- 172.21.15.146:0/378029333 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9f3c012970 con 0x5587a29afa90 2023-10-06T11:20:19.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.658+0000 7f9f217fa700 1 -- 172.21.15.146:0/378029333 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_get_version_reply(handle=1 version=150) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f3c031420 con 0x5587a29afa90 2023-10-06T11:20:19.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.658+0000 7f9f52b6bb80 10 client.10884 fetch_fsmap learned FSMap version 150 2023-10-06T11:20:19.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.658+0000 7f9f52b6bb80 1 -- 172.21.15.146:0/378029333 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,fsmap=150,monmap=2+}) v3 -- 0x5587a2887780 con 0x5587a29afa90 2023-10-06T11:20:19.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.658+0000 7f9f217fa700 1 -- 172.21.15.146:0/378029333 <== mon.0 v2:172.21.15.146:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f3c012970 con 0x5587a29afa90 2023-10-06T11:20:19.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.659+0000 7f9f217fa700 1 -- 172.21.15.146:0/378029333 <== mon.0 v2:172.21.15.146:3300/0 5 ==== fsmap(e 150) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9f3c031580 con 0x5587a29afa90 2023-10-06T11:20:19.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.659+0000 7f9f52b6bb80 10 client.10884 fetch_fsmap finished waiting for FSMap version 150 2023-10-06T11:20:19.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.659+0000 7f9f52b6bb80 10 client.10884 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-06T11:20:19.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.659+0000 7f9f52b6bb80 20 client.10884 populate_metadata read hostname 'smithi146' 2023-10-06T11:20:19.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.659+0000 7f9f52b6bb80 1 --2- 172.21.15.146:0/378029333 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x5587a298d6b0 0x5587a298da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:19.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.659+0000 7f9f52b6bb80 4 client.10884 mds_command: new command op to 10461 tid=0[{"prefix": "status"}] 2023-10-06T11:20:19.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.659+0000 7f9f52b6bb80 1 -- 172.21.15.146:0/378029333 --> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5587a285be00 con 0x5587a298d6b0 2023-10-06T11:20:19.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.659+0000 7f9f42ffd700 1 --2- 172.21.15.146:0/378029333 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x5587a298d6b0 0x5587a298da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:19.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.659+0000 7f9f217fa700 10 client.10884 ms_handle_connect on v2:172.21.15.146:6835/2322816938 2023-10-06T11:20:19.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.659+0000 7f9f42ffd700 1 --2- 172.21.15.146:0/378029333 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x5587a298d6b0 0x5587a298da80 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97b65bababa1eae2 server_cookie=d9b5f5f30b77e10c in_seq=0 out_seq=0 2023-10-06T11:20:19.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.659+0000 7f9f217fa700 1 -- 172.21.15.146:0/378029333 <== mds.0 v2:172.21.15.146:6835/2322816938 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+335 (crc 0 0 0) 0x5587a285be00 con 0x5587a298d6b0 2023-10-06T11:20:19.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.659+0000 7f9f217fa700 10 client.10884 handle_command_reply: tid=0 2023-10-06T11:20:19.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.659+0000 7f9f52b6bb80 1 client.10884 shutdown 2023-10-06T11:20:19.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.659+0000 7f9f52b6bb80 1 -- 172.21.15.146:0/378029333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587a29afa90 msgr2=0x5587a29c8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:19.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.659+0000 7f9f52b6bb80 1 --2- 172.21.15.146:0/378029333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587a29afa90 0x5587a29c8010 secure :-1 s=READY pgs=2343 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c026ed0 tx=0x7f9f3c028050 comp rx=0 tx=0).stop 2023-10-06T11:20:19.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.659+0000 7f9f52b6bb80 1 -- 172.21.15.146:0/378029333 shutdown_connections 2023-10-06T11:20:19.670 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.659+0000 7f9f52b6bb80 1 --2- 172.21.15.146:0/378029333 >> [v2:172.21.15.146:6835/2322816938,v1:172.21.15.146:6837/2322816938] conn(0x5587a298d6b0 0x5587a298da80 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:19.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.659+0000 7f9f52b6bb80 1 --2- 172.21.15.146:0/378029333 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x5587a29afa90 0x5587a29c8010 unknown :-1 s=CLOSED pgs=2343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:19.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.659+0000 7f9f52b6bb80 1 --2- 172.21.15.146:0/378029333 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5587a2969bd0 0x5587a2a0e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:19.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.659+0000 7f9f52b6bb80 1 --2- 172.21.15.146:0/378029333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5587a296b9a0 0x5587a2a14110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:19.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.659+0000 7f9f217fa700 0 client.10884 ms_handle_reset on v2:172.21.15.146:6835/2322816938 2023-10-06T11:20:19.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.659+0000 7f9f52b6bb80 1 -- 172.21.15.146:0/378029333 >> 172.21.15.146:0/378029333 conn(0x5587a296a070 msgr2=0x5587a2992090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:19.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.659+0000 7f9f52b6bb80 1 -- 172.21.15.146:0/378029333 shutdown_connections 2023-10-06T11:20:19.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.659+0000 7f9f52b6bb80 1 -- 172.21.15.146:0/378029333 wait complete. 2023-10-06T11:20:19.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.660+0000 7f9f52b6bb80 20 client.10884 trim_cache size 0 max 16384 2023-10-06T11:20:19.671 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:20:19.671 INFO:teuthology.orchestra.run.smithi146.stdout: "cluster_fsid": "c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1", 2023-10-06T11:20:19.672 INFO:teuthology.orchestra.run.smithi146.stdout: "whoami": 0, 2023-10-06T11:20:19.672 INFO:teuthology.orchestra.run.smithi146.stdout: "id": 10461, 2023-10-06T11:20:19.672 INFO:teuthology.orchestra.run.smithi146.stdout: "want_state": "up:active", 2023-10-06T11:20:19.672 INFO:teuthology.orchestra.run.smithi146.stdout: "state": "up:active", 2023-10-06T11:20:19.672 INFO:teuthology.orchestra.run.smithi146.stdout: "fs_name": "cephfs", 2023-10-06T11:20:19.672 INFO:teuthology.orchestra.run.smithi146.stdout: "rank_uptime": 66.519553565999999, 2023-10-06T11:20:19.672 INFO:teuthology.orchestra.run.smithi146.stdout: "mdsmap_epoch": 150, 2023-10-06T11:20:19.672 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch": 180, 2023-10-06T11:20:19.672 INFO:teuthology.orchestra.run.smithi146.stdout: "osdmap_epoch_barrier": 178, 2023-10-06T11:20:19.672 INFO:teuthology.orchestra.run.smithi146.stdout: "uptime": 93.251535028999996 2023-10-06T11:20:19.672 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:20:19.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.660+0000 7f9f49873700 1 -- 172.21.15.146:0/3301868040 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9f24066f60 msgr2=0x7f9f24069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:19.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.660+0000 7f9f49873700 1 --2- 172.21.15.146:0/3301868040 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9f24066f60 0x7f9f24069410 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f9f340011e0 tx=0x7f9f34009040 comp rx=0 tx=0).stop 2023-10-06T11:20:19.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.660+0000 7f9f49873700 1 -- 172.21.15.146:0/3301868040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f441584a0 msgr2=0x7f9f44169420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:19.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.660+0000 7f9f49873700 1 --2- 172.21.15.146:0/3301868040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f441584a0 0x7f9f44169420 secure :-1 s=READY pgs=2339 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c00c850 tx=0x7f9f2c008040 comp rx=0 tx=0).stop 2023-10-06T11:20:19.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.660+0000 7f9f49873700 1 -- 172.21.15.146:0/3301868040 shutdown_connections 2023-10-06T11:20:19.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.660+0000 7f9f49873700 1 --2- 172.21.15.146:0/3301868040 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9f24066f60 0x7f9f24069410 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:19.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.660+0000 7f9f49873700 1 --2- 172.21.15.146:0/3301868040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f44158870 0x7f9f440cc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:19.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.660+0000 7f9f49873700 1 --2- 172.21.15.146:0/3301868040 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9f4406bca0 0x7f9f4414cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:19.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.660+0000 7f9f49873700 1 --2- 172.21.15.146:0/3301868040 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9f441584a0 0x7f9f44169420 unknown :-1 s=CLOSED pgs=2339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:19.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.660+0000 7f9f49873700 1 -- 172.21.15.146:0/3301868040 >> 172.21.15.146:0/3301868040 conn(0x7f9f44067eb0 msgr2=0x7f9f440c31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:19.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.660+0000 7f9f49873700 1 -- 172.21.15.146:0/3301868040 shutdown_connections 2023-10-06T11:20:19.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.660+0000 7f9f49873700 1 -- 172.21.15.146:0/3301868040 wait complete. 2023-10-06T11:20:19.675 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T11:20:19.675 DEBUG:teuthology.orchestra.run.smithi146:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:20:19.713 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T11:20:19.766 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T11:20:19.767 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-10-06T11:20:19.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:20:19.767 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T11:20:19.781 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:20:19.781 INFO:teuthology.orchestra.run.smithi146.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-10-06T11:20:19.782 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-10-06T11:20:19.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:20:19.782 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T11:20:19.797 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:20:19.798 INFO:teuthology.orchestra.run.smithi151.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-06T11:20:19.798 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi146.front.sepia.ceph.com 2023-10-06T11:20:19.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:20:19.799 DEBUG:teuthology.orchestra.run.smithi146:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T11:20:19.836 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:20:19.836 INFO:teuthology.orchestra.run.smithi146.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-06T11:20:19.837 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-10-06T11:20:19.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:20:19.837 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T11:20:19.853 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:20:19.854 INFO:teuthology.orchestra.run.smithi151.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-06T11:20:19.854 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:20:19.994 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.989+0000 7f7178d4d700 1 Processor -- start 2023-10-06T11:20:19.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.989+0000 7f7178d4d700 1 -- start start 2023-10-06T11:20:19.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.990+0000 7f7178d4d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7174143040 0x7f71740b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:19.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.990+0000 7f7178d4d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f71740b5430 0x7f71740b2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:19.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.990+0000 7f7178d4d700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71740cf100 con 0x7f7174143410 2023-10-06T11:20:19.995 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.990+0000 7f7178d4d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71740b4170 con 0x7f71740b5430 2023-10-06T11:20:19.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.990+0000 7f7178d4d700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71740b5f50 con 0x7f7174143040 2023-10-06T11:20:19.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.990+0000 7f7173fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f71740b5430 0x7f71740b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:19.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.990+0000 7f7173fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f71740b5430 0x7f71740b2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57744/0 (socket says 172.21.15.146:57744) 2023-10-06T11:20:19.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.990+0000 7f7173fff700 1 -- 172.21.15.146:0/228020687 learned_addr learned my addr 172.21.15.146:0/228020687 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:19.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.990+0000 7f71737fe700 1 --2- 172.21.15.146:0/228020687 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7174143040 0x7f71740b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:19.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.990+0000 7f7173fff700 1 -- 172.21.15.146:0/228020687 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7174143040 msgr2=0x7f71740b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:19.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.990+0000 7f7173fff700 1 --2- 172.21.15.146:0/228020687 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7174143040 0x7f71740b1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:19.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.990+0000 7f7173fff700 1 -- 172.21.15.146:0/228020687 >> v1:172.21.15.151:6789/0 conn(0x7f7174143410 legacy=0x7f71740b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:19.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.990+0000 7f7173fff700 1 -- 172.21.15.146:0/228020687 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71740ceb30 con 0x7f71740b5430 2023-10-06T11:20:19.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.991+0000 7f7173fff700 1 --2- 172.21.15.146:0/228020687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71740b5430 0x7f71740b2360 secure :-1 s=READY pgs=2344 cs=0 l=1 rev1=1 crypto rx=0x7f716c0099b0 tx=0x7f716c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6563e132eb1de1fd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:19.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.991+0000 7f71727fc700 1 -- 172.21.15.146:0/228020687 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c00b820 con 0x7f71740b5430 2023-10-06T11:20:19.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.991+0000 7f71727fc700 1 -- 172.21.15.146:0/228020687 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716c00b980 con 0x7f71740b5430 2023-10-06T11:20:19.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.991+0000 7f71727fc700 1 -- 172.21.15.146:0/228020687 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c00bd20 con 0x7f71740b5430 2023-10-06T11:20:19.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.991+0000 7f7178d4d700 1 -- 172.21.15.146:0/228020687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71740b5430 msgr2=0x7f71740b2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:19.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.991+0000 7f7178d4d700 1 --2- 172.21.15.146:0/228020687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71740b5430 0x7f71740b2360 secure :-1 s=READY pgs=2344 cs=0 l=1 rev1=1 crypto rx=0x7f716c0099b0 tx=0x7f716c009250 comp rx=0 tx=0).stop 2023-10-06T11:20:19.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.991+0000 7f7178d4d700 1 -- 172.21.15.146:0/228020687 shutdown_connections 2023-10-06T11:20:19.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.991+0000 7f7178d4d700 1 --2- 172.21.15.146:0/228020687 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f71740b5430 0x7f71740b2360 unknown :-1 s=CLOSED pgs=2344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:19.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.991+0000 7f7178d4d700 1 --2- 172.21.15.146:0/228020687 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7174143040 0x7f71740b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:19.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.991+0000 7f7178d4d700 1 -- 172.21.15.146:0/228020687 >> 172.21.15.146:0/228020687 conn(0x7f717406eb10 msgr2=0x7f717406ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:19.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.991+0000 7f7178d4d700 1 -- 172.21.15.146:0/228020687 shutdown_connections 2023-10-06T11:20:19.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.991+0000 7f7178d4d700 1 -- 172.21.15.146:0/228020687 wait complete. 2023-10-06T11:20:19.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.992+0000 7f7178d4d700 1 Processor -- start 2023-10-06T11:20:19.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.993+0000 7f7178d4d700 1 -- start start 2023-10-06T11:20:20.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.993+0000 7f7178d4d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71740b5430 0x7f717413c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:20.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.993+0000 7f7178d4d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7174143040 0x7f71740cc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:20.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.993+0000 7f7178d4d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7174143410 0x7f7174140940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:20.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.993+0000 7f7178d4d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717413d5e0 con 0x7f7174143410 2023-10-06T11:20:20.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.993+0000 7f7178d4d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717413cb30 con 0x7f7174143040 2023-10-06T11:20:20.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.993+0000 7f7178d4d700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7174169980 con 0x7f71740b5430 2023-10-06T11:20:20.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.993+0000 7f7173fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7174143410 0x7f7174140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:20.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.993+0000 7f7173fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7174143410 0x7f7174140940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57746/0 (socket says 172.21.15.146:57746) 2023-10-06T11:20:20.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.993+0000 7f7173fff700 1 -- 172.21.15.146:0/2864073166 learned_addr learned my addr 172.21.15.146:0/2864073166 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:20.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.994+0000 7f71737fe700 1 --2- 172.21.15.146:0/2864073166 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71740b5430 0x7f717413c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:20.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.994+0000 7f7172ffd700 1 --2- 172.21.15.146:0/2864073166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7174143040 0x7f71740cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:20.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.994+0000 7f7173fff700 1 -- 172.21.15.146:0/2864073166 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71740b5430 msgr2=0x7f717413c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:20.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.994+0000 7f7173fff700 1 --2- 172.21.15.146:0/2864073166 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71740b5430 0x7f717413c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:20.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.994+0000 7f7173fff700 1 -- 172.21.15.146:0/2864073166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7174143040 msgr2=0x7f71740cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:20.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.994+0000 7f7173fff700 1 --2- 172.21.15.146:0/2864073166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7174143040 0x7f71740cc330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:20.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.994+0000 7f7173fff700 1 -- 172.21.15.146:0/2864073166 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f716c0094f0 con 0x7f7174143410 2023-10-06T11:20:20.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.994+0000 7f7173fff700 1 --2- 172.21.15.146:0/2864073166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7174143410 0x7f7174140940 secure :-1 s=READY pgs=2345 cs=0 l=1 rev1=1 crypto rx=0x7f7174065830 tx=0x7f716c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:20.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.994+0000 7f715b7fe700 1 -- 172.21.15.146:0/2864073166 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c01b680 con 0x7f7174143410 2023-10-06T11:20:20.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.994+0000 7f715b7fe700 1 -- 172.21.15.146:0/2864073166 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716c01b7e0 con 0x7f7174143410 2023-10-06T11:20:20.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.994+0000 7f7178d4d700 1 -- 172.21.15.146:0/2864073166 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f717413cda0 con 0x7f7174143410 2023-10-06T11:20:20.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.994+0000 7f715b7fe700 1 -- 172.21.15.146:0/2864073166 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c01bb60 con 0x7f7174143410 2023-10-06T11:20:20.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.994+0000 7f7178d4d700 1 -- 172.21.15.146:0/2864073166 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7174169bf0 con 0x7f7174143410 2023-10-06T11:20:20.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.995+0000 7f7178d4d700 1 -- 172.21.15.146:0/2864073166 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7174088a80 con 0x7f7174143410 2023-10-06T11:20:20.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.995+0000 7f715b7fe700 1 -- 172.21.15.146:0/2864073166 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f716c01c450 con 0x7f7174143410 2023-10-06T11:20:20.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.995+0000 7f715b7fe700 1 --2- 172.21.15.146:0/2864073166 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7160066f30 0x7f71600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:20.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.996+0000 7f715b7fe700 1 -- 172.21.15.146:0/2864073166 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6231+0+0 (secure 0 0 0) 0x7f716c086610 con 0x7f7174143410 2023-10-06T11:20:20.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.996+0000 7f71737fe700 1 --2- 172.21.15.146:0/2864073166 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7160066f30 0x7f71600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:20.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:19.996+0000 7f71737fe700 1 --2- 172.21.15.146:0/2864073166 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7160066f30 0x7f71600693e0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f716400d390 tx=0x7f7164007510 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:20.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.000+0000 7f715b7fe700 1 -- 172.21.15.146:0/2864073166 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f716c053670 con 0x7f7174143410 2023-10-06T11:20:20.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.226+0000 7f7178d4d700 1 -- 172.21.15.146:0/2864073166 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7174169de0 con 0x7f7174143410 2023-10-06T11:20:20.228 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.227+0000 7f715b7fe700 1 -- 172.21.15.146:0/2864073166 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 150 v150) v1 ==== 95+0+4622 (secure 0 0 0) 0x7f716c056c90 con 0x7f7174143410 2023-10-06T11:20:20.229 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:20:20.229 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":150,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9094,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/3426437100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3426437100},{"type":"v1","addr":"172.21.15.146:6836","nonce":3426437100}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":139},{"gid":9106,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/3275041097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":3275041097},{"type":"v1","addr":"172.21.15.151:6835","nonce":3275041097}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":139},{"gid":9259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/959352692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":959352692},{"type":"v1","addr":"172.21.15.151:6834","nonce":959352692}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":146}],"filesystems":[{"mdsmap":{"epoch":150,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:18:51.903907+0000","modified":"2023-10-06T11:19:16.147837+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":178,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10461":{"gid":10461,"name":"c","rank":0,"incarnation":147,"state":"up:active","state_seq":10,"addr":"172.21.15.146:6837/2322816938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2322816938},{"type":"v1","addr":"172.21.15.146:6837","nonce":2322816938}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-10-06T11:20:20.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.228+0000 7f7178d4d700 1 -- 172.21.15.146:0/2864073166 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7160066f30 msgr2=0x7f71600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:20.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.228+0000 7f7178d4d700 1 --2- 172.21.15.146:0/2864073166 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7160066f30 0x7f71600693e0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f716400d390 tx=0x7f7164007510 comp rx=0 tx=0).stop 2023-10-06T11:20:20.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.228+0000 7f7178d4d700 1 -- 172.21.15.146:0/2864073166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7174143410 msgr2=0x7f7174140940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:20.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.228+0000 7f7178d4d700 1 --2- 172.21.15.146:0/2864073166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7174143410 0x7f7174140940 secure :-1 s=READY pgs=2345 cs=0 l=1 rev1=1 crypto rx=0x7f7174065830 tx=0x7f716c016000 comp rx=0 tx=0).stop 2023-10-06T11:20:20.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.228+0000 7f7178d4d700 1 -- 172.21.15.146:0/2864073166 shutdown_connections 2023-10-06T11:20:20.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.228+0000 7f7178d4d700 1 --2- 172.21.15.146:0/2864073166 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7160066f30 0x7f71600693e0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:20.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.228+0000 7f7178d4d700 1 --2- 172.21.15.146:0/2864073166 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7174143410 0x7f7174140940 unknown :-1 s=CLOSED pgs=2345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:20.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.228+0000 7f7178d4d700 1 --2- 172.21.15.146:0/2864073166 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f71740b5430 0x7f717413c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:20.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.228+0000 7f7178d4d700 1 --2- 172.21.15.146:0/2864073166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7174143040 0x7f71740cc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:20.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.228+0000 7f7178d4d700 1 -- 172.21.15.146:0/2864073166 >> 172.21.15.146:0/2864073166 conn(0x7f717406eb10 msgr2=0x7f717406eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:20.231 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.229+0000 7f7178d4d700 1 -- 172.21.15.146:0/2864073166 shutdown_connections 2023-10-06T11:20:20.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.229+0000 7f7178d4d700 1 -- 172.21.15.146:0/2864073166 wait complete. 2023-10-06T11:20:20.232 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 150 2023-10-06T11:20:20.243 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:20:20.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.356+0000 7fb082681700 1 Processor -- start 2023-10-06T11:20:20.358 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.356+0000 7fb082681700 1 -- start start 2023-10-06T11:20:20.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.357+0000 7fb082681700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb07c1538c0 0x7fb07c153c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:20.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.357+0000 7fb082681700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb07c15a940 0x7fb07c15dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:20.361 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.357+0000 7fb082681700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb07c0cac80 0x7fb07c0ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:20.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.357+0000 7fb082681700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb07c15d270 con 0x7fb07c1538c0 2023-10-06T11:20:20.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.357+0000 7fb082681700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb07c15d830 con 0x7fb07c0cac80 2023-10-06T11:20:20.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.357+0000 7fb082681700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c0cb810 con 0x7fb07c15a940 2023-10-06T11:20:20.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.357+0000 7fb07bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb07c1538c0 0x7fb07c153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:20.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.357+0000 7fb07bfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fb07c1538c0 0x7fb07c153c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57748/0 (socket says 172.21.15.146:57748) 2023-10-06T11:20:20.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.357+0000 7fb07bfff700 1 -- 172.21.15.146:0/3939374608 learned_addr learned my addr 172.21.15.146:0/3939374608 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:20.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.357+0000 7fb07bfff700 1 -- 172.21.15.146:0/3939374608 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb07c15a940 msgr2=0x7fb07c15dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:20.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.357+0000 7fb07bfff700 1 --2- 172.21.15.146:0/3939374608 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb07c15a940 0x7fb07c15dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:20.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.357+0000 7fb07bfff700 1 -- 172.21.15.146:0/3939374608 >> v2:172.21.15.151:3300/0 conn(0x7fb07c0cac80 msgr2=0x7fb07c0ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:20.362 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.357+0000 7fb080c1e700 1 --2- 172.21.15.146:0/3939374608 >> v2:172.21.15.151:3300/0 conn(0x7fb07c0cac80 0x7fb07c0ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:20.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.357+0000 7fb07bfff700 1 --2- 172.21.15.146:0/3939374608 >> v2:172.21.15.151:3300/0 conn(0x7fb07c0cac80 0x7fb07c0ce610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:20.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.357+0000 7fb07bfff700 1 -- 172.21.15.146:0/3939374608 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07c0cbaf0 con 0x7fb07c1538c0 2023-10-06T11:20:20.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.357+0000 7fb07bfff700 1 --2- 172.21.15.146:0/3939374608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb07c1538c0 0x7fb07c153c90 secure :-1 s=READY pgs=2346 cs=0 l=1 rev1=1 crypto rx=0x7fb07c0cac10 tx=0x7fb06c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63f8f9fc4de5e5a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:20.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.357+0000 7fb07affd700 1 -- 172.21.15.146:0/3939374608 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c00b860 con 0x7fb07c1538c0 2023-10-06T11:20:20.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.357+0000 7fb07affd700 1 -- 172.21.15.146:0/3939374608 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06c00b9c0 con 0x7fb07c1538c0 2023-10-06T11:20:20.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.357+0000 7fb07affd700 1 -- 172.21.15.146:0/3939374608 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c00bd60 con 0x7fb07c1538c0 2023-10-06T11:20:20.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.358+0000 7fb082681700 1 -- 172.21.15.146:0/3939374608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb07c1538c0 msgr2=0x7fb07c153c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:20.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.358+0000 7fb082681700 1 --2- 172.21.15.146:0/3939374608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb07c1538c0 0x7fb07c153c90 secure :-1 s=READY pgs=2346 cs=0 l=1 rev1=1 crypto rx=0x7fb07c0cac10 tx=0x7fb06c009250 comp rx=0 tx=0).stop 2023-10-06T11:20:20.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.358+0000 7fb082681700 1 -- 172.21.15.146:0/3939374608 shutdown_connections 2023-10-06T11:20:20.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.358+0000 7fb082681700 1 --2- 172.21.15.146:0/3939374608 >> v2:172.21.15.151:3300/0 conn(0x7fb07c0cac80 0x7fb07c0ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:20.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.358+0000 7fb082681700 1 --2- 172.21.15.146:0/3939374608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb07c1538c0 0x7fb07c153c90 unknown :-1 s=CLOSED pgs=2346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:20.363 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.358+0000 7fb082681700 1 --2- 172.21.15.146:0/3939374608 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb07c15a940 0x7fb07c15dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:20.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.358+0000 7fb082681700 1 -- 172.21.15.146:0/3939374608 >> 172.21.15.146:0/3939374608 conn(0x7fb07c06eb10 msgr2=0x7fb07c06ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:20.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.358+0000 7fb082681700 1 -- 172.21.15.146:0/3939374608 shutdown_connections 2023-10-06T11:20:20.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.358+0000 7fb082681700 1 -- 172.21.15.146:0/3939374608 wait complete. 2023-10-06T11:20:20.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.359+0000 7fb082681700 1 Processor -- start 2023-10-06T11:20:20.364 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.359+0000 7fb082681700 1 -- start start 2023-10-06T11:20:20.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.360+0000 7fb082681700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb07c0cac80 0x7fb07c0b1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:20.366 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.360+0000 7fb082681700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb07c1538c0 0x7fb07c145ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:20.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.360+0000 7fb082681700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb07c15a940 0x7fb07c145ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:20.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.360+0000 7fb082681700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c0cdcc0 con 0x7fb07c1538c0 2023-10-06T11:20:20.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.360+0000 7fb082681700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c0c8670 con 0x7fb07c0cac80 2023-10-06T11:20:20.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.360+0000 7fb082681700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c0c7a60 con 0x7fb07c15a940 2023-10-06T11:20:20.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.360+0000 7fb07b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb07c1538c0 0x7fb07c145ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:20.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.360+0000 7fb07b7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb07c1538c0 0x7fb07c145ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57756/0 (socket says 172.21.15.146:57756) 2023-10-06T11:20:20.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.360+0000 7fb07b7fe700 1 -- 172.21.15.146:0/4085268595 learned_addr learned my addr 172.21.15.146:0/4085268595 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:20.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.360+0000 7fb080c1e700 1 --2- 172.21.15.146:0/4085268595 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb07c15a940 0x7fb07c145ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:20.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.360+0000 7fb07bfff700 1 --2- 172.21.15.146:0/4085268595 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb07c0cac80 0x7fb07c0b1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:20.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.360+0000 7fb07b7fe700 1 -- 172.21.15.146:0/4085268595 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb07c15a940 msgr2=0x7fb07c145ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:20.367 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.360+0000 7fb07b7fe700 1 --2- 172.21.15.146:0/4085268595 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb07c15a940 0x7fb07c145ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:20.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.360+0000 7fb07b7fe700 1 -- 172.21.15.146:0/4085268595 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb07c0cac80 msgr2=0x7fb07c0b1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:20.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.360+0000 7fb07b7fe700 1 --2- 172.21.15.146:0/4085268595 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb07c0cac80 0x7fb07c0b1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:20.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.360+0000 7fb07b7fe700 1 -- 172.21.15.146:0/4085268595 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb06c0094f0 con 0x7fb07c1538c0 2023-10-06T11:20:20.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.361+0000 7fb07b7fe700 1 --2- 172.21.15.146:0/4085268595 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb07c1538c0 0x7fb07c145ab0 secure :-1 s=READY pgs=2347 cs=0 l=1 rev1=1 crypto rx=0x7fb07000b810 tx=0x7fb0700091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:20.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.361+0000 7fb063fff700 1 -- 172.21.15.146:0/4085268595 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07000f510 con 0x7fb07c1538c0 2023-10-06T11:20:20.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.361+0000 7fb063fff700 1 -- 172.21.15.146:0/4085268595 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07000f670 con 0x7fb07c1538c0 2023-10-06T11:20:20.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.361+0000 7fb082681700 1 -- 172.21.15.146:0/4085268595 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb07c0c7d40 con 0x7fb07c1538c0 2023-10-06T11:20:20.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.361+0000 7fb063fff700 1 -- 172.21.15.146:0/4085268595 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07000fa30 con 0x7fb07c1538c0 2023-10-06T11:20:20.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.361+0000 7fb082681700 1 -- 172.21.15.146:0/4085268595 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb07c0c8300 con 0x7fb07c1538c0 2023-10-06T11:20:20.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.362+0000 7fb082681700 1 -- 172.21.15.146:0/4085268595 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb07c0c8820 con 0x7fb07c1538c0 2023-10-06T11:20:20.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.362+0000 7fb063fff700 1 -- 172.21.15.146:0/4085268595 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb07001a400 con 0x7fb07c1538c0 2023-10-06T11:20:20.368 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.362+0000 7fb063fff700 1 --2- 172.21.15.146:0/4085268595 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb068066f30 0x7fb0680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:20.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.363+0000 7fb063fff700 1 -- 172.21.15.146:0/4085268595 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6231+0+0 (secure 0 0 0) 0x7fb0700841c0 con 0x7fb07c1538c0 2023-10-06T11:20:20.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.363+0000 7fb07bfff700 1 --2- 172.21.15.146:0/4085268595 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb068066f30 0x7fb0680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:20.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.363+0000 7fb07bfff700 1 --2- 172.21.15.146:0/4085268595 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb068066f30 0x7fb0680693e0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fb07c0cac10 tx=0x7fb06c017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:20.369 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.367+0000 7fb063fff700 1 -- 172.21.15.146:0/4085268595 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb07c0c8820 con 0x7fb07c1538c0 2023-10-06T11:20:20.559 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.558+0000 7fb082681700 1 -- 172.21.15.146:0/4085268595 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb07c0c87e0 con 0x7fb07c1538c0 2023-10-06T11:20:20.560 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.558+0000 7fb063fff700 1 -- 172.21.15.146:0/4085268595 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v180) v1 ==== 74+0+17205 (secure 0 0 0) 0x7fb070051200 con 0x7fb07c1538c0 2023-10-06T11:20:20.560 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:20:20.561 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":180,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:19:34.468624+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:18:49.540526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2023-10-06T11:18:50.844600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"28.13","mappings":[{"from":6,"to":1}]},{"pgid":"28.2b","mappings":[{"from":6,"to":4}]},{"pgid":"28.2d","mappings":[{"from":6,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.151:6834/1134233840":"2023-10-07T11:19:12.134281+0000","172.21.15.151:6832/1134233840":"2023-10-07T11:19:12.134281+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:20:20.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.561+0000 7fb082681700 1 -- 172.21.15.146:0/4085268595 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb068066f30 msgr2=0x7fb0680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:20.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.561+0000 7fb082681700 1 --2- 172.21.15.146:0/4085268595 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb068066f30 0x7fb0680693e0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fb07c0cac10 tx=0x7fb06c017000 comp rx=0 tx=0).stop 2023-10-06T11:20:20.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.561+0000 7fb082681700 1 -- 172.21.15.146:0/4085268595 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb07c1538c0 msgr2=0x7fb07c145ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:20.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.561+0000 7fb082681700 1 --2- 172.21.15.146:0/4085268595 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb07c1538c0 0x7fb07c145ab0 secure :-1 s=READY pgs=2347 cs=0 l=1 rev1=1 crypto rx=0x7fb07000b810 tx=0x7fb0700091d0 comp rx=0 tx=0).stop 2023-10-06T11:20:20.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.561+0000 7fb082681700 1 -- 172.21.15.146:0/4085268595 shutdown_connections 2023-10-06T11:20:20.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.561+0000 7fb082681700 1 --2- 172.21.15.146:0/4085268595 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb068066f30 0x7fb0680693e0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:20.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.561+0000 7fb082681700 1 --2- 172.21.15.146:0/4085268595 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb07c15a940 0x7fb07c145ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:20.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.561+0000 7fb082681700 1 --2- 172.21.15.146:0/4085268595 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb07c0cac80 0x7fb07c0b1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:20.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.561+0000 7fb082681700 1 --2- 172.21.15.146:0/4085268595 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb07c1538c0 0x7fb07c145ab0 unknown :-1 s=CLOSED pgs=2347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:20.563 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.561+0000 7fb082681700 1 -- 172.21.15.146:0/4085268595 >> 172.21.15.146:0/4085268595 conn(0x7fb07c06eb10 msgr2=0x7fb07c0d0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:20.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.561+0000 7fb082681700 1 -- 172.21.15.146:0/4085268595 shutdown_connections 2023-10-06T11:20:20.564 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.561+0000 7fb082681700 1 -- 172.21.15.146:0/4085268595 wait complete. 2023-10-06T11:20:20.575 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-10-06T11:05:36.687307+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-10-06T11:05:37.171199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 27, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T11:18:49.540526+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '176', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 28, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T11:18:50.844600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '177', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T11:20:20.575 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T11:20:20.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.691+0000 7fc41e9d6700 1 Processor -- start 2023-10-06T11:20:20.693 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.691+0000 7fc41e9d6700 1 -- start start 2023-10-06T11:20:20.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.692+0000 7fc41e9d6700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc418143410 0x7fc4180b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:20.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.692+0000 7fc41e9d6700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc4180b2530 0x7fc4180b5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:20.695 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.692+0000 7fc41e9d6700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4180cf100 con 0x7fc418143040 2023-10-06T11:20:20.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.692+0000 7fc41e9d6700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4180b57a0 con 0x7fc4180b2530 2023-10-06T11:20:20.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.692+0000 7fc41e9d6700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4180b4170 con 0x7fc418143410 2023-10-06T11:20:20.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.692+0000 7fc41e1d5700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc4180b2530 0x7fc4180b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:20.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.692+0000 7fc41d9d4700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc418143040 0x7fc4180b1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:37036/0 (socket says 172.21.15.146:37036) 2023-10-06T11:20:20.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.692+0000 7fc41d9d4700 1 -- 172.21.15.146:0/859147573 learned_addr learned my addr 172.21.15.146:0/859147573 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:20:20.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.692+0000 7fc41d1d3700 1 --2- 172.21.15.146:0/859147573 >> v2:172.21.15.151:3300/0 conn(0x7fc418143410 0x7fc4180b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:20.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.693+0000 7fc41e1d5700 1 -- 172.21.15.146:0/859147573 >> v2:172.21.15.151:3300/0 conn(0x7fc418143410 msgr2=0x7fc4180b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:20.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.693+0000 7fc41e1d5700 1 --2- 172.21.15.146:0/859147573 >> v2:172.21.15.151:3300/0 conn(0x7fc418143410 0x7fc4180b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:20.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.693+0000 7fc41e1d5700 1 -- 172.21.15.146:0/859147573 >> v1:172.21.15.146:6789/0 conn(0x7fc418143040 legacy=0x7fc4180b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:20.696 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.693+0000 7fc41c9d2700 1 -- 172.21.15.146:0/859147573 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3697865198 0 0) 0x7fc4180cf100 con 0x7fc418143040 2023-10-06T11:20:20.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.693+0000 7fc41e1d5700 1 -- 172.21.15.146:0/859147573 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4180ceb30 con 0x7fc4180b2530 2023-10-06T11:20:20.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.693+0000 7fc41e1d5700 1 --2- 172.21.15.146:0/859147573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4180b2530 0x7fc4180b5260 secure :-1 s=READY pgs=2349 cs=0 l=1 rev1=1 crypto rx=0x7fc410009e90 tx=0x7fc410009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2497112be176ad8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:20.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.693+0000 7fc41c9d2700 1 -- 172.21.15.146:0/859147573 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41000e070 con 0x7fc4180b2530 2023-10-06T11:20:20.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.693+0000 7fc41c9d2700 1 -- 172.21.15.146:0/859147573 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc41000bbb0 con 0x7fc4180b2530 2023-10-06T11:20:20.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.693+0000 7fc41c9d2700 1 -- 172.21.15.146:0/859147573 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc410012430 con 0x7fc4180b2530 2023-10-06T11:20:20.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.693+0000 7fc41e9d6700 1 -- 172.21.15.146:0/859147573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4180b2530 msgr2=0x7fc4180b5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:20.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.693+0000 7fc41e9d6700 1 --2- 172.21.15.146:0/859147573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4180b2530 0x7fc4180b5260 secure :-1 s=READY pgs=2349 cs=0 l=1 rev1=1 crypto rx=0x7fc410009e90 tx=0x7fc410009780 comp rx=0 tx=0).stop 2023-10-06T11:20:20.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.693+0000 7fc41e9d6700 1 -- 172.21.15.146:0/859147573 shutdown_connections 2023-10-06T11:20:20.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.693+0000 7fc41e9d6700 1 --2- 172.21.15.146:0/859147573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc4180b2530 0x7fc4180b5260 unknown :-1 s=CLOSED pgs=2349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:20.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.693+0000 7fc41e9d6700 1 --2- 172.21.15.146:0/859147573 >> v2:172.21.15.151:3300/0 conn(0x7fc418143410 0x7fc4180b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:20.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.693+0000 7fc41e9d6700 1 -- 172.21.15.146:0/859147573 >> 172.21.15.146:0/859147573 conn(0x7fc41806eb10 msgr2=0x7fc41806ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:20.697 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.693+0000 7fc41e9d6700 1 -- 172.21.15.146:0/859147573 shutdown_connections 2023-10-06T11:20:20.698 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.693+0000 7fc41e9d6700 1 -- 172.21.15.146:0/859147573 wait complete. 2023-10-06T11:20:20.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.694+0000 7fc41e9d6700 1 Processor -- start 2023-10-06T11:20:20.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.695+0000 7fc41e9d6700 1 -- start start 2023-10-06T11:20:20.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.695+0000 7fc41e9d6700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4180b2530 0x7fc41815dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:20.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.695+0000 7fc41e9d6700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc418143040 0x7fc4180ade30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:20.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.695+0000 7fc41e9d6700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc418143410 0x7fc4180a8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:20.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.695+0000 7fc41e9d6700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4180ad9a0 con 0x7fc418143410 2023-10-06T11:20:20.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.695+0000 7fc41e9d6700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4180ad070 con 0x7fc418143040 2023-10-06T11:20:20.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.695+0000 7fc41e9d6700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4180ad350 con 0x7fc4180b2530 2023-10-06T11:20:20.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.695+0000 7fc41e1d5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc418143410 0x7fc4180a8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:20.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.695+0000 7fc41e1d5700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc418143410 0x7fc4180a8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57772/0 (socket says 172.21.15.146:57772) 2023-10-06T11:20:20.701 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.695+0000 7fc41e1d5700 1 -- 172.21.15.146:0/1436468173 learned_addr learned my addr 172.21.15.146:0/1436468173 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:20.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.695+0000 7fc41d9d4700 1 --2- 172.21.15.146:0/1436468173 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4180b2530 0x7fc41815dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:20.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.695+0000 7fc41d1d3700 1 --2- 172.21.15.146:0/1436468173 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc418143040 0x7fc4180ade30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:20.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.696+0000 7fc41e1d5700 1 -- 172.21.15.146:0/1436468173 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4180b2530 msgr2=0x7fc41815dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:20.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.696+0000 7fc41e1d5700 1 --2- 172.21.15.146:0/1436468173 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4180b2530 0x7fc41815dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:20.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.696+0000 7fc41e1d5700 1 -- 172.21.15.146:0/1436468173 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc418143040 msgr2=0x7fc4180ade30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:20.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.696+0000 7fc41e1d5700 1 --2- 172.21.15.146:0/1436468173 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc418143040 0x7fc4180ade30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:20.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.696+0000 7fc41e1d5700 1 -- 172.21.15.146:0/1436468173 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc410009a20 con 0x7fc418143410 2023-10-06T11:20:20.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.696+0000 7fc41e1d5700 1 --2- 172.21.15.146:0/1436468173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc418143410 0x7fc4180a8310 secure :-1 s=READY pgs=2350 cs=0 l=1 rev1=1 crypto rx=0x7fc4100099f0 tx=0x7fc410019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:20.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.696+0000 7fc415ffb700 1 -- 172.21.15.146:0/1436468173 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc410027470 con 0x7fc418143410 2023-10-06T11:20:20.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.696+0000 7fc415ffb700 1 -- 172.21.15.146:0/1436468173 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc410027610 con 0x7fc418143410 2023-10-06T11:20:20.702 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.696+0000 7fc41e9d6700 1 -- 172.21.15.146:0/1436468173 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4180ad630 con 0x7fc418143410 2023-10-06T11:20:20.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.696+0000 7fc415ffb700 1 -- 172.21.15.146:0/1436468173 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4100279d0 con 0x7fc418143410 2023-10-06T11:20:20.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.696+0000 7fc41e9d6700 1 -- 172.21.15.146:0/1436468173 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc41815e0e0 con 0x7fc418143410 2023-10-06T11:20:20.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.697+0000 7fc41e9d6700 1 -- 172.21.15.146:0/1436468173 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc418088a80 con 0x7fc418143410 2023-10-06T11:20:20.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.698+0000 7fc415ffb700 1 -- 172.21.15.146:0/1436468173 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc410024070 con 0x7fc418143410 2023-10-06T11:20:20.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.698+0000 7fc415ffb700 1 --2- 172.21.15.146:0/1436468173 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc404066f30 0x7fc4040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:20.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.698+0000 7fc415ffb700 1 -- 172.21.15.146:0/1436468173 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6231+0+0 (secure 0 0 0) 0x7fc410086df0 con 0x7fc418143410 2023-10-06T11:20:20.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.698+0000 7fc41d9d4700 1 --2- 172.21.15.146:0/1436468173 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc404066f30 0x7fc4040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:20.703 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.698+0000 7fc41d9d4700 1 --2- 172.21.15.146:0/1436468173 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc404066f30 0x7fc4040693e0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fc408007fd0 tx=0x7fc408007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:20.704 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.702+0000 7fc415ffb700 1 -- 172.21.15.146:0/1436468173 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc410053e50 con 0x7fc418143410 2023-10-06T11:20:20.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.885+0000 7fc41e9d6700 1 -- 172.21.15.146:0/1436468173 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc4180b07e0 con 0x7fc418143410 2023-10-06T11:20:20.887 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.885+0000 7fc415ffb700 1 -- 172.21.15.146:0/1436468173 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v180) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc410057470 con 0x7fc418143410 2023-10-06T11:20:20.888 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 8 2023-10-06T11:20:20.889 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.887+0000 7fc41e9d6700 1 -- 172.21.15.146:0/1436468173 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc404066f30 msgr2=0x7fc4040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:20.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.887+0000 7fc41e9d6700 1 --2- 172.21.15.146:0/1436468173 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc404066f30 0x7fc4040693e0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fc408007fd0 tx=0x7fc408007d30 comp rx=0 tx=0).stop 2023-10-06T11:20:20.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.887+0000 7fc41e9d6700 1 -- 172.21.15.146:0/1436468173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc418143410 msgr2=0x7fc4180a8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:20.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.887+0000 7fc41e9d6700 1 --2- 172.21.15.146:0/1436468173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc418143410 0x7fc4180a8310 secure :-1 s=READY pgs=2350 cs=0 l=1 rev1=1 crypto rx=0x7fc4100099f0 tx=0x7fc410019000 comp rx=0 tx=0).stop 2023-10-06T11:20:20.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.887+0000 7fc41e9d6700 1 -- 172.21.15.146:0/1436468173 shutdown_connections 2023-10-06T11:20:20.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.887+0000 7fc41e9d6700 1 --2- 172.21.15.146:0/1436468173 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc404066f30 0x7fc4040693e0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:20.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.887+0000 7fc41e9d6700 1 --2- 172.21.15.146:0/1436468173 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc418143410 0x7fc4180a8310 unknown :-1 s=CLOSED pgs=2350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:20.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.887+0000 7fc41e9d6700 1 --2- 172.21.15.146:0/1436468173 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc4180b2530 0x7fc41815dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:20.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.887+0000 7fc41e9d6700 1 --2- 172.21.15.146:0/1436468173 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc418143040 0x7fc4180ade30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:20.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.887+0000 7fc41e9d6700 1 -- 172.21.15.146:0/1436468173 >> 172.21.15.146:0/1436468173 conn(0x7fc41806eb10 msgr2=0x7fc4180b1430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:20.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.887+0000 7fc41e9d6700 1 -- 172.21.15.146:0/1436468173 shutdown_connections 2023-10-06T11:20:20.890 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:20.888+0000 7fc41e9d6700 1 -- 172.21.15.146:0/1436468173 wait complete. 2023-10-06T11:20:20.901 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T11:20:21.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.018+0000 7f488da26700 1 Processor -- start 2023-10-06T11:20:21.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.018+0000 7f488da26700 1 -- start start 2023-10-06T11:20:21.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.018+0000 7f488da26700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4888153b70 0x7f48880ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:21.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.018+0000 7f488da26700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f48880d03e0 0x7f48880cb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:21.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.018+0000 7f488da26700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48880ce950 con 0x7f4888153f40 2023-10-06T11:20:21.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.018+0000 7f488da26700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48880ce620 con 0x7f48880d03e0 2023-10-06T11:20:21.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.018+0000 7f488da26700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48880cd6e0 con 0x7f4888153b70 2023-10-06T11:20:21.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.019+0000 7f48877fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f4888153f40 0x7f488815d2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:37042/0 (socket says 172.21.15.146:37042) 2023-10-06T11:20:21.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.019+0000 7f48877fe700 1 -- 172.21.15.146:0/650284530 learned_addr learned my addr 172.21.15.146:0/650284530 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:20:21.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.019+0000 7f4886ffd700 1 --2- 172.21.15.146:0/650284530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4888153b70 0x7f48880ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:21.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.019+0000 7f48867fc700 1 --2- 172.21.15.146:0/650284530 >> v2:172.21.15.151:3300/0 conn(0x7f48880d03e0 0x7f48880cb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:21.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.019+0000 7f4885ffb700 1 -- 172.21.15.146:0/650284530 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 574032785 0 0) 0x7f48880ce950 con 0x7f4888153f40 2023-10-06T11:20:21.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.019+0000 7f4885ffb700 1 -- 172.21.15.146:0/650284530 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4870003570 con 0x7f4888153f40 2023-10-06T11:20:21.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.019+0000 7f4885ffb700 1 -- 172.21.15.146:0/650284530 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3792266431 0 0) 0x7f4870003570 con 0x7f4888153f40 2023-10-06T11:20:21.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.019+0000 7f4885ffb700 1 -- 172.21.15.146:0/650284530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4888153b70 msgr2=0x7f48880ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:21.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.019+0000 7f4885ffb700 1 --2- 172.21.15.146:0/650284530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4888153b70 0x7f48880ccc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:21.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.019+0000 7f4885ffb700 1 -- 172.21.15.146:0/650284530 >> v2:172.21.15.151:3300/0 conn(0x7f48880d03e0 msgr2=0x7f48880cb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:21.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.019+0000 7f4885ffb700 1 --2- 172.21.15.146:0/650284530 >> v2:172.21.15.151:3300/0 conn(0x7f48880d03e0 0x7f48880cb2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:21.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.019+0000 7f4885ffb700 1 -- 172.21.15.146:0/650284530 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48880cd9c0 con 0x7f4888153f40 2023-10-06T11:20:21.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.019+0000 7f4885ffb700 1 -- 172.21.15.146:0/650284530 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f48800017f0 con 0x7f4888153f40 2023-10-06T11:20:21.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.019+0000 7f4885ffb700 1 -- 172.21.15.146:0/650284530 >> v1:172.21.15.146:6789/0 conn(0x7f4888153f40 legacy=0x7f488815d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:21.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.019+0000 7f4885ffb700 1 --2- 172.21.15.146:0/650284530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4888153b70 0x7f4870003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:21.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.019+0000 7f4885ffb700 1 --2- 172.21.15.146:0/650284530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4870003fe0 0x7f4870004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:21.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.019+0000 7f4885ffb700 1 --2- 172.21.15.146:0/650284530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4870004d50 0x7f48700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:21.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.019+0000 7f4885ffb700 1 -- 172.21.15.146:0/650284530 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48880ce620 con 0x7f4870003fe0 2023-10-06T11:20:21.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.019+0000 7f4885ffb700 1 -- 172.21.15.146:0/650284530 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48880cd6e0 con 0x7f4870004d50 2023-10-06T11:20:21.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.019+0000 7f4885ffb700 1 -- 172.21.15.146:0/650284530 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f487000ba90 con 0x7f4888153b70 2023-10-06T11:20:21.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.019+0000 7f48867fc700 1 --2- 172.21.15.146:0/650284530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4870003fe0 0x7f4870004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:21.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.019+0000 7f4886ffd700 1 --2- 172.21.15.146:0/650284530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4888153b70 0x7f4870003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:21.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.019+0000 7f48877fe700 1 --2- 172.21.15.146:0/650284530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4870004d50 0x7f48700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:21.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.020+0000 7f48867fc700 1 -- 172.21.15.146:0/650284530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4888153b70 msgr2=0x7f4870003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:21.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.020+0000 7f48867fc700 1 --2- 172.21.15.146:0/650284530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4888153b70 0x7f4870003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:21.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.020+0000 7f48867fc700 1 -- 172.21.15.146:0/650284530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4870004d50 msgr2=0x7f48700051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:21.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.020+0000 7f48867fc700 1 --2- 172.21.15.146:0/650284530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4870004d50 0x7f48700051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:21.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.020+0000 7f48867fc700 1 -- 172.21.15.146:0/650284530 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4870003570 con 0x7f4870003fe0 2023-10-06T11:20:21.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.020+0000 7f48877fe700 1 --2- 172.21.15.146:0/650284530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4870004d50 0x7f48700051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:20:21.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.020+0000 7f48867fc700 1 --2- 172.21.15.146:0/650284530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4870003fe0 0x7f4870004810 secure :-1 s=READY pgs=2352 cs=0 l=1 rev1=1 crypto rx=0x7f487c009c00 tx=0x7f487c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8be0881254c8b38 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:21.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.020+0000 7f4885ffb700 1 -- 172.21.15.146:0/650284530 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487c00e6b0 con 0x7f4870003fe0 2023-10-06T11:20:21.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.020+0000 7f4885ffb700 1 -- 172.21.15.146:0/650284530 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f487c00e810 con 0x7f4870003fe0 2023-10-06T11:20:21.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.020+0000 7f4885ffb700 1 -- 172.21.15.146:0/650284530 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487c00ebd0 con 0x7f4870003fe0 2023-10-06T11:20:21.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.020+0000 7f488da26700 1 -- 172.21.15.146:0/650284530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4870003fe0 msgr2=0x7f4870004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:21.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.020+0000 7f488da26700 1 --2- 172.21.15.146:0/650284530 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4870003fe0 0x7f4870004810 secure :-1 s=READY pgs=2352 cs=0 l=1 rev1=1 crypto rx=0x7f487c009c00 tx=0x7f487c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:20:21.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.020+0000 7f48877fe700 1 -- 172.21.15.146:0/650284530 reap_dead start 2023-10-06T11:20:21.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.020+0000 7f488da26700 1 -- 172.21.15.146:0/650284530 shutdown_connections 2023-10-06T11:20:21.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.020+0000 7f488da26700 1 -- 172.21.15.146:0/650284530 >> 172.21.15.146:0/650284530 conn(0x7f488806eb10 msgr2=0x7f488806ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:21.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.020+0000 7f488da26700 1 -- 172.21.15.146:0/650284530 shutdown_connections 2023-10-06T11:20:21.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.020+0000 7f488da26700 1 -- 172.21.15.146:0/650284530 wait complete. 2023-10-06T11:20:21.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.022+0000 7f488da26700 1 Processor -- start 2023-10-06T11:20:21.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.022+0000 7f488da26700 1 -- start start 2023-10-06T11:20:21.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.022+0000 7f488da26700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4870003fe0 0x7f488814def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:21.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.022+0000 7f488da26700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4888156b70 0x7f48880b1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:21.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.022+0000 7f488da26700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4888158c00 0x7f4888159070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:21.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.022+0000 7f488da26700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48881514a0 con 0x7f4888158c00 2023-10-06T11:20:21.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.022+0000 7f488da26700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48881595b0 con 0x7f4870003fe0 2023-10-06T11:20:21.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.022+0000 7f488da26700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f488816ad50 con 0x7f4888156b70 2023-10-06T11:20:21.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.023+0000 7f48877fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4888158c00 0x7f4888159070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:21.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.023+0000 7f48877fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4888158c00 0x7f4888159070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:57778/0 (socket says 172.21.15.146:57778) 2023-10-06T11:20:21.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.023+0000 7f48877fe700 1 -- 172.21.15.146:0/2690888355 learned_addr learned my addr 172.21.15.146:0/2690888355 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:21.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.023+0000 7f48867fc700 1 --2- 172.21.15.146:0/2690888355 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4888156b70 0x7f48880b1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:21.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.023+0000 7f4886ffd700 1 --2- 172.21.15.146:0/2690888355 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4870003fe0 0x7f488814def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:21.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.023+0000 7f48877fe700 1 -- 172.21.15.146:0/2690888355 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4888156b70 msgr2=0x7f48880b1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:21.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.023+0000 7f48877fe700 1 --2- 172.21.15.146:0/2690888355 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4888156b70 0x7f48880b1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:21.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.023+0000 7f48877fe700 1 -- 172.21.15.146:0/2690888355 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4870003fe0 msgr2=0x7f488814def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:21.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.023+0000 7f48877fe700 1 --2- 172.21.15.146:0/2690888355 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4870003fe0 0x7f488814def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:21.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.023+0000 7f48877fe700 1 -- 172.21.15.146:0/2690888355 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4888157110 con 0x7f4888158c00 2023-10-06T11:20:21.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.023+0000 7f48877fe700 1 --2- 172.21.15.146:0/2690888355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4888158c00 0x7f4888159070 secure :-1 s=READY pgs=2353 cs=0 l=1 rev1=1 crypto rx=0x7f48880ce8c0 tx=0x7f4880001280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:21.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.023+0000 7f486effd700 1 -- 172.21.15.146:0/2690888355 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4880017070 con 0x7f4888158c00 2023-10-06T11:20:21.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.023+0000 7f486effd700 1 -- 172.21.15.146:0/2690888355 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f488000eab0 con 0x7f4888158c00 2023-10-06T11:20:21.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.023+0000 7f486effd700 1 -- 172.21.15.146:0/2690888355 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488000ee70 con 0x7f4888158c00 2023-10-06T11:20:21.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.023+0000 7f488da26700 1 -- 172.21.15.146:0/2690888355 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f488816a420 con 0x7f4888158c00 2023-10-06T11:20:21.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.023+0000 7f488da26700 1 -- 172.21.15.146:0/2690888355 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f488816a9e0 con 0x7f4888158c00 2023-10-06T11:20:21.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.024+0000 7f488da26700 1 -- 172.21.15.146:0/2690888355 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f488816aee0 con 0x7f4888158c00 2023-10-06T11:20:21.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.025+0000 7f486effd700 1 -- 172.21.15.146:0/2690888355 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4880013630 con 0x7f4888158c00 2023-10-06T11:20:21.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.025+0000 7f486effd700 1 --2- 172.21.15.146:0/2690888355 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4874066f30 0x7f48740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:21.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.025+0000 7f486effd700 1 -- 172.21.15.146:0/2690888355 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6231+0+0 (secure 0 0 0) 0x7f4880084520 con 0x7f4888158c00 2023-10-06T11:20:21.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.025+0000 7f4886ffd700 1 --2- 172.21.15.146:0/2690888355 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4874066f30 0x7f48740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:21.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.025+0000 7f4886ffd700 1 --2- 172.21.15.146:0/2690888355 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4874066f30 0x7f48740693e0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f488815c690 tx=0x7f48780091a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:21.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.029+0000 7f486effd700 1 -- 172.21.15.146:0/2690888355 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4880051580 con 0x7f4888158c00 2023-10-06T11:20:21.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.213+0000 7f488da26700 1 -- 172.21.15.146:0/2690888355 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f48880cdca0 con 0x7f4888158c00 2023-10-06T11:20:21.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.213+0000 7f486effd700 1 -- 172.21.15.146:0/2690888355 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v180) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4880054ba0 con 0x7f4888158c00 2023-10-06T11:20:21.215 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 1 2023-10-06T11:20:21.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.215+0000 7f488da26700 1 -- 172.21.15.146:0/2690888355 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4874066f30 msgr2=0x7f48740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:21.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.215+0000 7f488da26700 1 --2- 172.21.15.146:0/2690888355 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4874066f30 0x7f48740693e0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f488815c690 tx=0x7f48780091a0 comp rx=0 tx=0).stop 2023-10-06T11:20:21.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.215+0000 7f488da26700 1 -- 172.21.15.146:0/2690888355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4888158c00 msgr2=0x7f4888159070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:21.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.215+0000 7f488da26700 1 --2- 172.21.15.146:0/2690888355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4888158c00 0x7f4888159070 secure :-1 s=READY pgs=2353 cs=0 l=1 rev1=1 crypto rx=0x7f48880ce8c0 tx=0x7f4880001280 comp rx=0 tx=0).stop 2023-10-06T11:20:21.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.215+0000 7f488da26700 1 -- 172.21.15.146:0/2690888355 shutdown_connections 2023-10-06T11:20:21.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.215+0000 7f488da26700 1 --2- 172.21.15.146:0/2690888355 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4874066f30 0x7f48740693e0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:21.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.215+0000 7f488da26700 1 --2- 172.21.15.146:0/2690888355 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f4888158c00 0x7f4888159070 unknown :-1 s=CLOSED pgs=2353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:21.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.215+0000 7f488da26700 1 --2- 172.21.15.146:0/2690888355 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4870003fe0 0x7f488814def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:21.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.215+0000 7f488da26700 1 --2- 172.21.15.146:0/2690888355 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4888156b70 0x7f48880b1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:21.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.215+0000 7f488da26700 1 -- 172.21.15.146:0/2690888355 >> 172.21.15.146:0/2690888355 conn(0x7f488806eb10 msgr2=0x7f48880b27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:21.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.215+0000 7f488da26700 1 -- 172.21.15.146:0/2690888355 shutdown_connections 2023-10-06T11:20:21.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.215+0000 7f488da26700 1 -- 172.21.15.146:0/2690888355 wait complete. 2023-10-06T11:20:21.229 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T11:20:21.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.344+0000 7fc775ae8700 1 Processor -- start 2023-10-06T11:20:21.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.344+0000 7fc775ae8700 1 -- start start 2023-10-06T11:20:21.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.345+0000 7fc775ae8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc770155960 0x7fc7700c9540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:21.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.345+0000 7fc775ae8700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc770155d30 0x7fc7700af6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:21.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.345+0000 7fc775ae8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7701561d0 0x7fc7700afc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:21.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.345+0000 7fc775ae8700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7700b21a0 con 0x7fc770155960 2023-10-06T11:20:21.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.345+0000 7fc775ae8700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7700c9a80 con 0x7fc770155d30 2023-10-06T11:20:21.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.345+0000 7fc775ae8700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7700ca8c0 con 0x7fc7701561d0 2023-10-06T11:20:21.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.345+0000 7fc76f7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc770155960 0x7fc7700c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:21.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.345+0000 7fc76f7fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc770155960 0x7fc7700c9540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45036/0 (socket says 172.21.15.146:45036) 2023-10-06T11:20:21.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.345+0000 7fc76f7fe700 1 -- 172.21.15.146:0/2519069089 learned_addr learned my addr 172.21.15.146:0/2519069089 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:21.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.346+0000 7fc76effd700 1 --2- 172.21.15.146:0/2519069089 >> v2:172.21.15.151:3300/0 conn(0x7fc770155d30 0x7fc7700af6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:21.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.346+0000 7fc76ffff700 1 --2- 172.21.15.146:0/2519069089 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7701561d0 0x7fc7700afc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:21.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.346+0000 7fc76f7fe700 1 -- 172.21.15.146:0/2519069089 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7701561d0 msgr2=0x7fc7700afc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:21.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.346+0000 7fc76f7fe700 1 --2- 172.21.15.146:0/2519069089 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7701561d0 0x7fc7700afc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:21.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.346+0000 7fc76f7fe700 1 -- 172.21.15.146:0/2519069089 >> v2:172.21.15.151:3300/0 conn(0x7fc770155d30 msgr2=0x7fc7700af6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:21.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.346+0000 7fc76f7fe700 1 --2- 172.21.15.146:0/2519069089 >> v2:172.21.15.151:3300/0 conn(0x7fc770155d30 0x7fc7700af6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:21.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.346+0000 7fc76f7fe700 1 -- 172.21.15.146:0/2519069089 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7700c9cb0 con 0x7fc770155960 2023-10-06T11:20:21.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.346+0000 7fc76f7fe700 1 --2- 172.21.15.146:0/2519069089 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc770155960 0x7fc7700c9540 secure :-1 s=READY pgs=2354 cs=0 l=1 rev1=1 crypto rx=0x7fc77006d180 tx=0x7fc760009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4860786c49c0efb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:21.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.346+0000 7fc76e7fc700 1 -- 172.21.15.146:0/2519069089 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76000e070 con 0x7fc770155960 2023-10-06T11:20:21.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.346+0000 7fc76e7fc700 1 -- 172.21.15.146:0/2519069089 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc76000ba50 con 0x7fc770155960 2023-10-06T11:20:21.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.346+0000 7fc76e7fc700 1 -- 172.21.15.146:0/2519069089 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7600092e0 con 0x7fc770155960 2023-10-06T11:20:21.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.346+0000 7fc775ae8700 1 -- 172.21.15.146:0/2519069089 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc770155960 msgr2=0x7fc7700c9540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:21.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.346+0000 7fc775ae8700 1 --2- 172.21.15.146:0/2519069089 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc770155960 0x7fc7700c9540 secure :-1 s=READY pgs=2354 cs=0 l=1 rev1=1 crypto rx=0x7fc77006d180 tx=0x7fc760009840 comp rx=0 tx=0).stop 2023-10-06T11:20:21.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.346+0000 7fc775ae8700 1 -- 172.21.15.146:0/2519069089 shutdown_connections 2023-10-06T11:20:21.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.346+0000 7fc775ae8700 1 --2- 172.21.15.146:0/2519069089 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7701561d0 0x7fc7700afc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:21.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.346+0000 7fc775ae8700 1 --2- 172.21.15.146:0/2519069089 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc770155960 0x7fc7700c9540 unknown :-1 s=CLOSED pgs=2354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:21.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.346+0000 7fc775ae8700 1 --2- 172.21.15.146:0/2519069089 >> v2:172.21.15.151:3300/0 conn(0x7fc770155d30 0x7fc7700af6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:21.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.346+0000 7fc775ae8700 1 -- 172.21.15.146:0/2519069089 >> 172.21.15.146:0/2519069089 conn(0x7fc7700673e0 msgr2=0x7fc7700677e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:21.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.347+0000 7fc775ae8700 1 -- 172.21.15.146:0/2519069089 shutdown_connections 2023-10-06T11:20:21.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.347+0000 7fc775ae8700 1 -- 172.21.15.146:0/2519069089 wait complete. 2023-10-06T11:20:21.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.348+0000 7fc775ae8700 1 Processor -- start 2023-10-06T11:20:21.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.348+0000 7fc775ae8700 1 -- start start 2023-10-06T11:20:21.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.348+0000 7fc775ae8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc770155960 0x7fc7700c4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:21.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.348+0000 7fc775ae8700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc770155d30 0x7fc7700c4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:21.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.348+0000 7fc775ae8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7701561d0 0x7fc770167500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:21.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.348+0000 7fc775ae8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7700c59b0 con 0x7fc7701561d0 2023-10-06T11:20:21.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.348+0000 7fc775ae8700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7700c6d60 con 0x7fc770155d30 2023-10-06T11:20:21.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.348+0000 7fc775ae8700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7700c4d30 con 0x7fc770155960 2023-10-06T11:20:21.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.349+0000 7fc76ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7701561d0 0x7fc770167500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:21.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.349+0000 7fc76ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7701561d0 0x7fc770167500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45050/0 (socket says 172.21.15.146:45050) 2023-10-06T11:20:21.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.349+0000 7fc76ffff700 1 -- 172.21.15.146:0/2917523761 learned_addr learned my addr 172.21.15.146:0/2917523761 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:21.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.349+0000 7fc76f7fe700 1 --2- 172.21.15.146:0/2917523761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc770155960 0x7fc7700c4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:21.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.349+0000 7fc76effd700 1 --2- 172.21.15.146:0/2917523761 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc770155d30 0x7fc7700c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:21.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.349+0000 7fc76ffff700 1 -- 172.21.15.146:0/2917523761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc770155960 msgr2=0x7fc7700c4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:21.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.349+0000 7fc76ffff700 1 --2- 172.21.15.146:0/2917523761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc770155960 0x7fc7700c4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:21.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.349+0000 7fc76ffff700 1 -- 172.21.15.146:0/2917523761 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc770155d30 msgr2=0x7fc7700c4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:21.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.349+0000 7fc76ffff700 1 --2- 172.21.15.146:0/2917523761 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc770155d30 0x7fc7700c4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:21.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.349+0000 7fc76ffff700 1 -- 172.21.15.146:0/2917523761 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc760009ae0 con 0x7fc7701561d0 2023-10-06T11:20:21.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.349+0000 7fc76ffff700 1 --2- 172.21.15.146:0/2917523761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7701561d0 0x7fc770167500 secure :-1 s=READY pgs=2355 cs=0 l=1 rev1=1 crypto rx=0x7fc76800d730 tx=0x7fc768008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:21.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.349+0000 7fc7577fe700 1 -- 172.21.15.146:0/2917523761 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc768011670 con 0x7fc7701561d0 2023-10-06T11:20:21.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.349+0000 7fc7577fe700 1 -- 172.21.15.146:0/2917523761 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7680117d0 con 0x7fc7701561d0 2023-10-06T11:20:21.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.349+0000 7fc775ae8700 1 -- 172.21.15.146:0/2917523761 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7700c5010 con 0x7fc7701561d0 2023-10-06T11:20:21.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.349+0000 7fc7577fe700 1 -- 172.21.15.146:0/2917523761 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc768011b90 con 0x7fc7701561d0 2023-10-06T11:20:21.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.349+0000 7fc775ae8700 1 -- 172.21.15.146:0/2917523761 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7700c55d0 con 0x7fc7701561d0 2023-10-06T11:20:21.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.350+0000 7fc775ae8700 1 -- 172.21.15.146:0/2917523761 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7700c5af0 con 0x7fc7701561d0 2023-10-06T11:20:21.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.351+0000 7fc7577fe700 1 -- 172.21.15.146:0/2917523761 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc76800f410 con 0x7fc7701561d0 2023-10-06T11:20:21.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.351+0000 7fc7577fe700 1 --2- 172.21.15.146:0/2917523761 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc75c066f30 0x7fc75c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:21.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.351+0000 7fc76f7fe700 1 --2- 172.21.15.146:0/2917523761 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc75c066f30 0x7fc75c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:21.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.351+0000 7fc7577fe700 1 -- 172.21.15.146:0/2917523761 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6231+0+0 (secure 0 0 0) 0x7fc7680846e0 con 0x7fc7701561d0 2023-10-06T11:20:21.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.351+0000 7fc76f7fe700 1 --2- 172.21.15.146:0/2917523761 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc75c066f30 0x7fc75c0693e0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fc760009880 tx=0x7fc760018000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:21.357 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.355+0000 7fc7577fe700 1 -- 172.21.15.146:0/2917523761 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc768051740 con 0x7fc7701561d0 2023-10-06T11:20:21.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.537+0000 7fc775ae8700 1 -- 172.21.15.146:0/2917523761 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc77004c380 con 0x7fc7701561d0 2023-10-06T11:20:21.539 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.538+0000 7fc7577fe700 1 -- 172.21.15.146:0/2917523761 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v180) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc76800b040 con 0x7fc7701561d0 2023-10-06T11:20:21.540 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 32 2023-10-06T11:20:21.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.540+0000 7fc775ae8700 1 -- 172.21.15.146:0/2917523761 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc75c066f30 msgr2=0x7fc75c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:21.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.540+0000 7fc775ae8700 1 --2- 172.21.15.146:0/2917523761 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc75c066f30 0x7fc75c0693e0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fc760009880 tx=0x7fc760018000 comp rx=0 tx=0).stop 2023-10-06T11:20:21.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.540+0000 7fc775ae8700 1 -- 172.21.15.146:0/2917523761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7701561d0 msgr2=0x7fc770167500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:21.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.540+0000 7fc775ae8700 1 --2- 172.21.15.146:0/2917523761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7701561d0 0x7fc770167500 secure :-1 s=READY pgs=2355 cs=0 l=1 rev1=1 crypto rx=0x7fc76800d730 tx=0x7fc768008040 comp rx=0 tx=0).stop 2023-10-06T11:20:21.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.540+0000 7fc775ae8700 1 -- 172.21.15.146:0/2917523761 shutdown_connections 2023-10-06T11:20:21.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.540+0000 7fc775ae8700 1 --2- 172.21.15.146:0/2917523761 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc75c066f30 0x7fc75c0693e0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:21.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.540+0000 7fc775ae8700 1 --2- 172.21.15.146:0/2917523761 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc7701561d0 0x7fc770167500 unknown :-1 s=CLOSED pgs=2355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:21.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.540+0000 7fc775ae8700 1 --2- 172.21.15.146:0/2917523761 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc770155960 0x7fc7700c4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:21.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.540+0000 7fc775ae8700 1 --2- 172.21.15.146:0/2917523761 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc770155d30 0x7fc7700c4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:21.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.540+0000 7fc775ae8700 1 -- 172.21.15.146:0/2917523761 >> 172.21.15.146:0/2917523761 conn(0x7fc7700673e0 msgr2=0x7fc7700afd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:21.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.540+0000 7fc775ae8700 1 -- 172.21.15.146:0/2917523761 shutdown_connections 2023-10-06T11:20:21.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.540+0000 7fc775ae8700 1 -- 172.21.15.146:0/2917523761 wait complete. 2023-10-06T11:20:21.554 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T11:20:21.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.669+0000 7fc6a96f8700 1 Processor -- start 2023-10-06T11:20:21.671 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.669+0000 7fc6a96f8700 1 -- start start 2023-10-06T11:20:21.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.670+0000 7fc6a96f8700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc6a4159450 0x7fc6a4159820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:21.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.670+0000 7fc6a96f8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6a415dd70 0x7fc6a40b0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:21.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.670+0000 7fc6a96f8700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6a40b0bc0 con 0x7fc6a40b0760 2023-10-06T11:20:21.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.670+0000 7fc6a96f8700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6a40b2f20 con 0x7fc6a4159450 2023-10-06T11:20:21.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.670+0000 7fc6a96f8700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a40cb8a0 con 0x7fc6a415dd70 2023-10-06T11:20:21.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.670+0000 7fc6a2ffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fc6a4159450 0x7fc6a4159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:21.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.670+0000 7fc6a37fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc6a40b0760 0x7fc6a40aef90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49356/0 (socket says 172.21.15.146:49356) 2023-10-06T11:20:21.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.670+0000 7fc6a37fe700 1 -- 172.21.15.146:0/3542988594 learned_addr learned my addr 172.21.15.146:0/3542988594 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:20:21.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.670+0000 7fc6a27fc700 1 --2- 172.21.15.146:0/3542988594 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6a415dd70 0x7fc6a40b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:21.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.670+0000 7fc6a2ffd700 1 -- 172.21.15.146:0/3542988594 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6a415dd70 msgr2=0x7fc6a40b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:21.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.670+0000 7fc6a2ffd700 1 --2- 172.21.15.146:0/3542988594 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6a415dd70 0x7fc6a40b0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:21.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.670+0000 7fc6a2ffd700 1 -- 172.21.15.146:0/3542988594 >> v1:172.21.15.146:6789/0 conn(0x7fc6a40b0760 legacy=0x7fc6a40aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:21.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.670+0000 7fc6a2ffd700 1 -- 172.21.15.146:0/3542988594 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a40b2960 con 0x7fc6a4159450 2023-10-06T11:20:21.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.670+0000 7fc6a1ffb700 1 -- 172.21.15.146:0/3542988594 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4185503264 0 0) 0x7fc694001110 con 0x7fc6a40b0760 2023-10-06T11:20:21.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.671+0000 7fc6a2ffd700 1 --2- 172.21.15.146:0/3542988594 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6a4159450 0x7fc6a4159820 secure :-1 s=READY pgs=2357 cs=0 l=1 rev1=1 crypto rx=0x7fc69c009e60 tx=0x7fc69c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b1e8d7cb93da3ab server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:21.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.671+0000 7fc6a1ffb700 1 -- 172.21.15.146:0/3542988594 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69c00e070 con 0x7fc6a4159450 2023-10-06T11:20:21.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.671+0000 7fc6a1ffb700 1 -- 172.21.15.146:0/3542988594 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc69c00bc30 con 0x7fc6a4159450 2023-10-06T11:20:21.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.671+0000 7fc6a1ffb700 1 -- 172.21.15.146:0/3542988594 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc69c012430 con 0x7fc6a4159450 2023-10-06T11:20:21.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.671+0000 7fc6a96f8700 1 -- 172.21.15.146:0/3542988594 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6a4159450 msgr2=0x7fc6a4159820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:21.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.671+0000 7fc6a96f8700 1 --2- 172.21.15.146:0/3542988594 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6a4159450 0x7fc6a4159820 secure :-1 s=READY pgs=2357 cs=0 l=1 rev1=1 crypto rx=0x7fc69c009e60 tx=0x7fc69c009780 comp rx=0 tx=0).stop 2023-10-06T11:20:21.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.671+0000 7fc6a96f8700 1 -- 172.21.15.146:0/3542988594 shutdown_connections 2023-10-06T11:20:21.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.671+0000 7fc6a96f8700 1 --2- 172.21.15.146:0/3542988594 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6a4159450 0x7fc6a4159820 unknown :-1 s=CLOSED pgs=2357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:21.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.671+0000 7fc6a96f8700 1 --2- 172.21.15.146:0/3542988594 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6a415dd70 0x7fc6a40b0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:21.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.671+0000 7fc6a96f8700 1 -- 172.21.15.146:0/3542988594 >> 172.21.15.146:0/3542988594 conn(0x7fc6a406eb10 msgr2=0x7fc6a406ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:21.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.671+0000 7fc6a96f8700 1 -- 172.21.15.146:0/3542988594 shutdown_connections 2023-10-06T11:20:21.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.671+0000 7fc6a96f8700 1 -- 172.21.15.146:0/3542988594 wait complete. 2023-10-06T11:20:21.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.673+0000 7fc6a96f8700 1 Processor -- start 2023-10-06T11:20:21.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.673+0000 7fc6a96f8700 1 -- start start 2023-10-06T11:20:21.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.673+0000 7fc6a96f8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6a40b0760 0x7fc6a40c7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:21.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.673+0000 7fc6a96f8700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6a4159450 0x7fc6a40d05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:21.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.673+0000 7fc6a96f8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6a415dd70 0x7fc6a40d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:21.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.673+0000 7fc6a96f8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a40ca710 con 0x7fc6a415dd70 2023-10-06T11:20:21.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.673+0000 7fc6a96f8700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a4146f80 con 0x7fc6a4159450 2023-10-06T11:20:21.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.673+0000 7fc6a96f8700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a40c9e70 con 0x7fc6a40b0760 2023-10-06T11:20:21.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.673+0000 7fc6a37fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6a415dd70 0x7fc6a40d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:21.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.673+0000 7fc6a37fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6a415dd70 0x7fc6a40d0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45060/0 (socket says 172.21.15.146:45060) 2023-10-06T11:20:21.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.673+0000 7fc6a37fe700 1 -- 172.21.15.146:0/3846227447 learned_addr learned my addr 172.21.15.146:0/3846227447 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:21.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.674+0000 7fc6a2ffd700 1 --2- 172.21.15.146:0/3846227447 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6a40b0760 0x7fc6a40c7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:21.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.674+0000 7fc6a27fc700 1 --2- 172.21.15.146:0/3846227447 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6a4159450 0x7fc6a40d05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:21.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.674+0000 7fc6a37fe700 1 -- 172.21.15.146:0/3846227447 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6a40b0760 msgr2=0x7fc6a40c7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:21.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.674+0000 7fc6a37fe700 1 --2- 172.21.15.146:0/3846227447 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6a40b0760 0x7fc6a40c7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:21.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.674+0000 7fc6a37fe700 1 -- 172.21.15.146:0/3846227447 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6a4159450 msgr2=0x7fc6a40d05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:21.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.674+0000 7fc6a37fe700 1 --2- 172.21.15.146:0/3846227447 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6a4159450 0x7fc6a40d05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:21.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.674+0000 7fc6a37fe700 1 -- 172.21.15.146:0/3846227447 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc69c009a20 con 0x7fc6a415dd70 2023-10-06T11:20:21.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.674+0000 7fc6a37fe700 1 --2- 172.21.15.146:0/3846227447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6a415dd70 0x7fc6a40d0b10 secure :-1 s=READY pgs=2358 cs=0 l=1 rev1=1 crypto rx=0x7fc69400c810 tx=0x7fc694007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:21.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.674+0000 7fc68affd700 1 -- 172.21.15.146:0/3846227447 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc694005b30 con 0x7fc6a415dd70 2023-10-06T11:20:21.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.674+0000 7fc68affd700 1 -- 172.21.15.146:0/3846227447 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc694005cb0 con 0x7fc6a415dd70 2023-10-06T11:20:21.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.674+0000 7fc6a96f8700 1 -- 172.21.15.146:0/3846227447 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6a40ca150 con 0x7fc6a415dd70 2023-10-06T11:20:21.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.674+0000 7fc68affd700 1 -- 172.21.15.146:0/3846227447 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc694004a80 con 0x7fc6a415dd70 2023-10-06T11:20:21.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.674+0000 7fc6a96f8700 1 -- 172.21.15.146:0/3846227447 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6a4146940 con 0x7fc6a415dd70 2023-10-06T11:20:21.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.675+0000 7fc6a96f8700 1 -- 172.21.15.146:0/3846227447 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6a404c380 con 0x7fc6a415dd70 2023-10-06T11:20:21.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.675+0000 7fc68affd700 1 -- 172.21.15.146:0/3846227447 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc694005030 con 0x7fc6a415dd70 2023-10-06T11:20:21.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.676+0000 7fc68affd700 1 --2- 172.21.15.146:0/3846227447 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc690066f30 0x7fc6900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:21.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.676+0000 7fc68affd700 1 -- 172.21.15.146:0/3846227447 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6231+0+0 (secure 0 0 0) 0x7fc6940839a0 con 0x7fc6a415dd70 2023-10-06T11:20:21.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.676+0000 7fc6a2ffd700 1 --2- 172.21.15.146:0/3846227447 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc690066f30 0x7fc6900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:21.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.676+0000 7fc6a2ffd700 1 --2- 172.21.15.146:0/3846227447 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc690066f30 0x7fc6900693e0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fc69c009e60 tx=0x7fc69c019000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:21.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.680+0000 7fc68affd700 1 -- 172.21.15.146:0/3846227447 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc694050a00 con 0x7fc6a415dd70 2023-10-06T11:20:21.863 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.862+0000 7fc6a96f8700 1 -- 172.21.15.146:0/3846227447 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc6a40b0bc0 con 0x7fc6a415dd70 2023-10-06T11:20:21.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.862+0000 7fc68affd700 1 -- 172.21.15.146:0/3846227447 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v180) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc6a40b0bc0 con 0x7fc6a415dd70 2023-10-06T11:20:21.864 INFO:teuthology.orchestra.run.smithi146.stdout:pg_num: 64 2023-10-06T11:20:21.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.864+0000 7fc6a96f8700 1 -- 172.21.15.146:0/3846227447 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc690066f30 msgr2=0x7fc6900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:21.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.864+0000 7fc6a96f8700 1 --2- 172.21.15.146:0/3846227447 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc690066f30 0x7fc6900693e0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fc69c009e60 tx=0x7fc69c019000 comp rx=0 tx=0).stop 2023-10-06T11:20:21.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.864+0000 7fc6a96f8700 1 -- 172.21.15.146:0/3846227447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6a415dd70 msgr2=0x7fc6a40d0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:21.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.864+0000 7fc6a96f8700 1 --2- 172.21.15.146:0/3846227447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6a415dd70 0x7fc6a40d0b10 secure :-1 s=READY pgs=2358 cs=0 l=1 rev1=1 crypto rx=0x7fc69400c810 tx=0x7fc694007bd0 comp rx=0 tx=0).stop 2023-10-06T11:20:21.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.864+0000 7fc6a96f8700 1 -- 172.21.15.146:0/3846227447 shutdown_connections 2023-10-06T11:20:21.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.864+0000 7fc6a96f8700 1 --2- 172.21.15.146:0/3846227447 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc690066f30 0x7fc6900693e0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:21.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.864+0000 7fc6a96f8700 1 --2- 172.21.15.146:0/3846227447 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc6a415dd70 0x7fc6a40d0b10 unknown :-1 s=CLOSED pgs=2358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:21.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.864+0000 7fc6a96f8700 1 --2- 172.21.15.146:0/3846227447 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6a40b0760 0x7fc6a40c7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:21.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.864+0000 7fc6a96f8700 1 --2- 172.21.15.146:0/3846227447 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6a4159450 0x7fc6a40d05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:21.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.864+0000 7fc6a96f8700 1 -- 172.21.15.146:0/3846227447 >> 172.21.15.146:0/3846227447 conn(0x7fc6a406eb10 msgr2=0x7fc6a40cef20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:21.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.864+0000 7fc6a96f8700 1 -- 172.21.15.146:0/3846227447 shutdown_connections 2023-10-06T11:20:21.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.864+0000 7fc6a96f8700 1 -- 172.21.15.146:0/3846227447 wait complete. 2023-10-06T11:20:21.878 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:20:21.926 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:20:21.929 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:20:21.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.994+0000 7ff04ff36700 1 Processor -- start 2023-10-06T11:20:21.996 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.994+0000 7ff04ff36700 1 -- start start 2023-10-06T11:20:22.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.995+0000 7ff04ff36700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff04806bd60 0x7ff04806c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:22.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.995+0000 7ff04ff36700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0480c8de0 con 0x7ff04806eb20 2023-10-06T11:20:22.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.995+0000 7ff04ff36700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0480c84d0 con 0x7ff0480c8960 2023-10-06T11:20:22.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.995+0000 7ff04ff36700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0480c76d0 con 0x7ff04806bd60 2023-10-06T11:20:22.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.995+0000 7ff04d4d1700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff04806eb20 0x7ff0480c6fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49362/0 (socket says 172.21.15.146:49362) 2023-10-06T11:20:22.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.995+0000 7ff04d4d1700 1 -- 172.21.15.146:0/1254537385 learned_addr learned my addr 172.21.15.146:0/1254537385 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:20:22.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.996+0000 7ff04ccd0700 1 -- 172.21.15.146:0/1254537385 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1397502732 0 0) 0x7ff038001110 con 0x7ff04806eb20 2023-10-06T11:20:22.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.996+0000 7ff04dcd2700 1 --2- 172.21.15.146:0/1254537385 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff04806bd60 0x7ff04806c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:22.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.996+0000 7ff04ccd0700 1 -- 172.21.15.146:0/1254537385 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff034003570 con 0x7ff04806eb20 2023-10-06T11:20:22.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.996+0000 7ff04ccd0700 1 -- 172.21.15.146:0/1254537385 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3355206079 0 0) 0x7ff034003570 con 0x7ff04806eb20 2023-10-06T11:20:22.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.996+0000 7ff04ccd0700 1 -- 172.21.15.146:0/1254537385 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff04806bd60 msgr2=0x7ff04806c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:22.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.996+0000 7ff04ccd0700 1 --2- 172.21.15.146:0/1254537385 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff04806bd60 0x7ff04806c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:22.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.996+0000 7ff04ccd0700 1 -- 172.21.15.146:0/1254537385 >> v1:172.21.15.151:6789/0 conn(0x7ff0480c8960 legacy=0x7ff0480683f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:22.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.996+0000 7ff04ccd0700 1 -- 172.21.15.146:0/1254537385 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0480c78c0 con 0x7ff04806eb20 2023-10-06T11:20:22.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.996+0000 7ff04ccd0700 1 -- 172.21.15.146:0/1254537385 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7ff038001600 con 0x7ff04806eb20 2023-10-06T11:20:22.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.996+0000 7ff04ccd0700 1 -- 172.21.15.146:0/1254537385 >> v1:172.21.15.146:6789/0 conn(0x7ff04806eb20 legacy=0x7ff0480c6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:22.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.996+0000 7ff04ccd0700 1 --2- 172.21.15.146:0/1254537385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff034003a90 0x7ff034003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:22.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.996+0000 7ff04ccd0700 1 --2- 172.21.15.146:0/1254537385 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff034004810 0x7ff034004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:22.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.996+0000 7ff04ccd0700 1 --2- 172.21.15.146:0/1254537385 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff04806bd60 0x7ff0340051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:22.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.996+0000 7ff04ccd0700 1 -- 172.21.15.146:0/1254537385 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff03400bb30 con 0x7ff034004810 2023-10-06T11:20:22.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.996+0000 7ff04ccd0700 1 -- 172.21.15.146:0/1254537385 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff03400bca0 con 0x7ff034003a90 2023-10-06T11:20:22.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.996+0000 7ff04ccd0700 1 -- 172.21.15.146:0/1254537385 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff03400be60 con 0x7ff04806bd60 2023-10-06T11:20:22.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.996+0000 7ff04d4d1700 1 --2- 172.21.15.146:0/1254537385 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff034004810 0x7ff034004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:22.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.996+0000 7ff04dcd2700 1 --2- 172.21.15.146:0/1254537385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff034003a90 0x7ff034003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:22.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.996+0000 7ff04e4d3700 1 --2- 172.21.15.146:0/1254537385 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff04806bd60 0x7ff0340051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:22.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.997+0000 7ff04d4d1700 1 -- 172.21.15.146:0/1254537385 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff04806bd60 msgr2=0x7ff0340051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:22.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.997+0000 7ff04d4d1700 1 --2- 172.21.15.146:0/1254537385 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff04806bd60 0x7ff0340051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:22.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.997+0000 7ff04d4d1700 1 -- 172.21.15.146:0/1254537385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff034003a90 msgr2=0x7ff034003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:22.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.997+0000 7ff04d4d1700 1 --2- 172.21.15.146:0/1254537385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff034003a90 0x7ff034003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:22.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.997+0000 7ff04d4d1700 1 -- 172.21.15.146:0/1254537385 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff034003570 con 0x7ff034004810 2023-10-06T11:20:22.005 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.997+0000 7ff04d4d1700 1 --2- 172.21.15.146:0/1254537385 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff034004810 0x7ff034004c80 secure :-1 s=READY pgs=2360 cs=0 l=1 rev1=1 crypto rx=0x7ff03800c5f0 tx=0x7ff0480c8440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d1154f585b51a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:22.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.997+0000 7ff04ccd0700 1 -- 172.21.15.146:0/1254537385 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03800cdf0 con 0x7ff034004810 2023-10-06T11:20:22.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.997+0000 7ff04ccd0700 1 -- 172.21.15.146:0/1254537385 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff038005920 con 0x7ff034004810 2023-10-06T11:20:22.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.997+0000 7ff04ccd0700 1 -- 172.21.15.146:0/1254537385 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff038005ce0 con 0x7ff034004810 2023-10-06T11:20:22.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.997+0000 7ff04ff36700 1 -- 172.21.15.146:0/1254537385 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff034004810 msgr2=0x7ff034004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:22.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.997+0000 7ff04ff36700 1 --2- 172.21.15.146:0/1254537385 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff034004810 0x7ff034004c80 secure :-1 s=READY pgs=2360 cs=0 l=1 rev1=1 crypto rx=0x7ff03800c5f0 tx=0x7ff0480c8440 comp rx=0 tx=0).stop 2023-10-06T11:20:22.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.997+0000 7ff04e4d3700 1 -- 172.21.15.146:0/1254537385 reap_dead start 2023-10-06T11:20:22.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.997+0000 7ff04ff36700 1 -- 172.21.15.146:0/1254537385 shutdown_connections 2023-10-06T11:20:22.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.997+0000 7ff04ff36700 1 -- 172.21.15.146:0/1254537385 >> 172.21.15.146:0/1254537385 conn(0x7ff0480c9f50 msgr2=0x7ff04806dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:22.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.997+0000 7ff04ff36700 1 -- 172.21.15.146:0/1254537385 shutdown_connections 2023-10-06T11:20:22.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.997+0000 7ff04ff36700 1 -- 172.21.15.146:0/1254537385 wait complete. 2023-10-06T11:20:22.006 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.998+0000 7ff04ff36700 1 Processor -- start 2023-10-06T11:20:22.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.999+0000 7ff04ff36700 1 -- start start 2023-10-06T11:20:22.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.999+0000 7ff04ff36700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff034004810 0x7ff04815e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:22.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.999+0000 7ff04ff36700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0480c0d10 0x7ff0480b0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:22.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.999+0000 7ff04ff36700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0480c2490 0x7ff0480c2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:22.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.999+0000 7ff04ff36700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04815ed50 con 0x7ff034004810 2023-10-06T11:20:22.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.999+0000 7ff04ff36700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0480b1dc0 con 0x7ff0480c0d10 2023-10-06T11:20:22.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.999+0000 7ff04ff36700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0480b11b0 con 0x7ff0480c2490 2023-10-06T11:20:22.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.999+0000 7ff04dcd2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff034004810 0x7ff04815e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:22.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.999+0000 7ff04dcd2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff034004810 0x7ff04815e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45084/0 (socket says 172.21.15.146:45084) 2023-10-06T11:20:22.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.999+0000 7ff04dcd2700 1 -- 172.21.15.146:0/1427130910 learned_addr learned my addr 172.21.15.146:0/1427130910 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:22.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:21.999+0000 7ff04d4d1700 1 --2- 172.21.15.146:0/1427130910 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0480c0d10 0x7ff0480b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:22.007 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.000+0000 7ff04e4d3700 1 --2- 172.21.15.146:0/1427130910 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0480c2490 0x7ff0480c2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:22.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.000+0000 7ff04dcd2700 1 -- 172.21.15.146:0/1427130910 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0480c2490 msgr2=0x7ff0480c2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:22.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.000+0000 7ff04dcd2700 1 --2- 172.21.15.146:0/1427130910 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0480c2490 0x7ff0480c2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:22.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.000+0000 7ff04dcd2700 1 -- 172.21.15.146:0/1427130910 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0480c0d10 msgr2=0x7ff0480b0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:22.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.000+0000 7ff04dcd2700 1 --2- 172.21.15.146:0/1427130910 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0480c0d10 0x7ff0480b0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:22.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.000+0000 7ff04dcd2700 1 -- 172.21.15.146:0/1427130910 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0480b1490 con 0x7ff034004810 2023-10-06T11:20:22.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.000+0000 7ff04d4d1700 1 --2- 172.21.15.146:0/1427130910 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0480c0d10 0x7ff0480b0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:20:22.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.000+0000 7ff04dcd2700 1 --2- 172.21.15.146:0/1427130910 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff034004810 0x7ff04815e810 secure :-1 s=READY pgs=2361 cs=0 l=1 rev1=1 crypto rx=0x7ff044011f80 tx=0x7ff04400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:22.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.000+0000 7ff03dffb700 1 -- 172.21.15.146:0/1427130910 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04400e040 con 0x7ff034004810 2023-10-06T11:20:22.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.000+0000 7ff03dffb700 1 -- 172.21.15.146:0/1427130910 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04400f040 con 0x7ff034004810 2023-10-06T11:20:22.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.000+0000 7ff04ff36700 1 -- 172.21.15.146:0/1427130910 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0480b1770 con 0x7ff034004810 2023-10-06T11:20:22.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.000+0000 7ff03dffb700 1 -- 172.21.15.146:0/1427130910 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff044015430 con 0x7ff034004810 2023-10-06T11:20:22.008 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.000+0000 7ff04ff36700 1 -- 172.21.15.146:0/1427130910 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0480c2e70 con 0x7ff034004810 2023-10-06T11:20:22.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.001+0000 7ff04ff36700 1 -- 172.21.15.146:0/1427130910 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff048070910 con 0x7ff034004810 2023-10-06T11:20:22.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.001+0000 7ff03dffb700 1 -- 172.21.15.146:0/1427130910 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff0440157e0 con 0x7ff034004810 2023-10-06T11:20:22.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.002+0000 7ff03dffb700 1 --2- 172.21.15.146:0/1427130910 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff02c066f30 0x7ff02c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:22.009 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.002+0000 7ff03dffb700 1 -- 172.21.15.146:0/1427130910 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6231+0+0 (secure 0 0 0) 0x7ff0440854e0 con 0x7ff034004810 2023-10-06T11:20:22.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.002+0000 7ff04d4d1700 1 --2- 172.21.15.146:0/1427130910 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff02c066f30 0x7ff02c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:22.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.002+0000 7ff04d4d1700 1 --2- 172.21.15.146:0/1427130910 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff02c066f30 0x7ff02c0693e0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7ff04815f090 tx=0x7ff038015000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:22.010 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.006+0000 7ff03dffb700 1 -- 172.21.15.146:0/1427130910 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff044055fd0 con 0x7ff034004810 2023-10-06T11:20:22.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.230+0000 7ff04ff36700 1 -- 172.21.15.146:0/1427130910 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff04804c380 con 0x7ff034004810 2023-10-06T11:20:22.232 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.230+0000 7ff03dffb700 1 -- 172.21.15.146:0/1427130910 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 150 v150) v1 ==== 95+0+4622 (secure 0 0 0) 0x7ff044055b60 con 0x7ff034004810 2023-10-06T11:20:22.232 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:20:22.232 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":150,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9094,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/3426437100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3426437100},{"type":"v1","addr":"172.21.15.146:6836","nonce":3426437100}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":139},{"gid":9106,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/3275041097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":3275041097},{"type":"v1","addr":"172.21.15.151:6835","nonce":3275041097}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":139},{"gid":9259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/959352692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":959352692},{"type":"v1","addr":"172.21.15.151:6834","nonce":959352692}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":146}],"filesystems":[{"mdsmap":{"epoch":150,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:18:51.903907+0000","modified":"2023-10-06T11:19:16.147837+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":178,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10461":{"gid":10461,"name":"c","rank":0,"incarnation":147,"state":"up:active","state_seq":10,"addr":"172.21.15.146:6837/2322816938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2322816938},{"type":"v1","addr":"172.21.15.146:6837","nonce":2322816938}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-10-06T11:20:22.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.232+0000 7ff04ff36700 1 -- 172.21.15.146:0/1427130910 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff02c066f30 msgr2=0x7ff02c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:22.234 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.232+0000 7ff04ff36700 1 --2- 172.21.15.146:0/1427130910 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff02c066f30 0x7ff02c0693e0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7ff04815f090 tx=0x7ff038015000 comp rx=0 tx=0).stop 2023-10-06T11:20:22.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.232+0000 7ff04ff36700 1 -- 172.21.15.146:0/1427130910 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff034004810 msgr2=0x7ff04815e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:22.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.232+0000 7ff04ff36700 1 --2- 172.21.15.146:0/1427130910 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff034004810 0x7ff04815e810 secure :-1 s=READY pgs=2361 cs=0 l=1 rev1=1 crypto rx=0x7ff044011f80 tx=0x7ff04400b040 comp rx=0 tx=0).stop 2023-10-06T11:20:22.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.232+0000 7ff04ff36700 1 -- 172.21.15.146:0/1427130910 shutdown_connections 2023-10-06T11:20:22.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.232+0000 7ff04ff36700 1 --2- 172.21.15.146:0/1427130910 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff02c066f30 0x7ff02c0693e0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:22.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.232+0000 7ff04ff36700 1 --2- 172.21.15.146:0/1427130910 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0480c2490 0x7ff0480c2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:22.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.232+0000 7ff04ff36700 1 --2- 172.21.15.146:0/1427130910 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff034004810 0x7ff04815e810 unknown :-1 s=CLOSED pgs=2361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:22.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.232+0000 7ff04ff36700 1 --2- 172.21.15.146:0/1427130910 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0480c0d10 0x7ff0480b0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:22.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.232+0000 7ff04ff36700 1 -- 172.21.15.146:0/1427130910 >> 172.21.15.146:0/1427130910 conn(0x7ff0480c9f50 msgr2=0x7ff048069b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:22.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.232+0000 7ff04ff36700 1 -- 172.21.15.146:0/1427130910 shutdown_connections 2023-10-06T11:20:22.235 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.232+0000 7ff04ff36700 1 -- 172.21.15.146:0/1427130910 wait complete. 2023-10-06T11:20:22.236 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 150 2023-10-06T11:20:22.246 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:20:22.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.401+0000 7fe751917700 1 Processor -- start 2023-10-06T11:20:22.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.401+0000 7fe751917700 1 -- start start 2023-10-06T11:20:22.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.401+0000 7fe751917700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe74c1538c0 0x7fe74c153c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:22.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.401+0000 7fe751917700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe74c15a940 0x7fe74c15dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:22.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.401+0000 7fe751917700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe74c15d270 con 0x7fe74c0cac80 2023-10-06T11:20:22.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.401+0000 7fe751917700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe74c15d830 con 0x7fe74c15a940 2023-10-06T11:20:22.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.401+0000 7fe751917700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c0cb810 con 0x7fe74c1538c0 2023-10-06T11:20:22.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.402+0000 7fe74b7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fe74c0cac80 0x7fe74c0ce610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49372/0 (socket says 172.21.15.146:49372) 2023-10-06T11:20:22.405 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.402+0000 7fe74b7fe700 1 -- 172.21.15.146:0/1010652824 learned_addr learned my addr 172.21.15.146:0/1010652824 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:20:22.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.402+0000 7fe74a7fc700 1 --2- 172.21.15.146:0/1010652824 >> v2:172.21.15.151:3300/0 conn(0x7fe74c15a940 0x7fe74c15dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:22.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.402+0000 7fe74affd700 1 --2- 172.21.15.146:0/1010652824 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe74c1538c0 0x7fe74c153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:22.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.402+0000 7fe749ffb700 1 -- 172.21.15.146:0/1010652824 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1432680013 0 0) 0x7fe74c15d270 con 0x7fe74c0cac80 2023-10-06T11:20:22.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.402+0000 7fe749ffb700 1 -- 172.21.15.146:0/1010652824 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe734003570 con 0x7fe74c0cac80 2023-10-06T11:20:22.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.402+0000 7fe74a7fc700 1 -- 172.21.15.146:0/1010652824 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe74c1538c0 msgr2=0x7fe74c153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:22.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.402+0000 7fe74a7fc700 1 --2- 172.21.15.146:0/1010652824 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe74c1538c0 0x7fe74c153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:22.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.402+0000 7fe74a7fc700 1 -- 172.21.15.146:0/1010652824 >> v1:172.21.15.146:6789/0 conn(0x7fe74c0cac80 legacy=0x7fe74c0ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:22.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.402+0000 7fe74a7fc700 1 -- 172.21.15.146:0/1010652824 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe74c0cbaf0 con 0x7fe74c15a940 2023-10-06T11:20:22.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.402+0000 7fe74affd700 1 --2- 172.21.15.146:0/1010652824 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe74c1538c0 0x7fe74c153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:20:22.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.402+0000 7fe74a7fc700 1 --2- 172.21.15.146:0/1010652824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe74c15a940 0x7fe74c15dcc0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fe7400098e0 tx=0x7fe7400091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a90637c90a7e1a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:22.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.402+0000 7fe749ffb700 1 -- 172.21.15.146:0/1010652824 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe740011630 con 0x7fe74c15a940 2023-10-06T11:20:22.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.402+0000 7fe749ffb700 1 -- 172.21.15.146:0/1010652824 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe740011790 con 0x7fe74c15a940 2023-10-06T11:20:22.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.402+0000 7fe749ffb700 1 -- 172.21.15.146:0/1010652824 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe740011b10 con 0x7fe74c15a940 2023-10-06T11:20:22.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.403+0000 7fe751917700 1 -- 172.21.15.146:0/1010652824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe74c15a940 msgr2=0x7fe74c15dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:22.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.403+0000 7fe751917700 1 --2- 172.21.15.146:0/1010652824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe74c15a940 0x7fe74c15dcc0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fe7400098e0 tx=0x7fe7400091a0 comp rx=0 tx=0).stop 2023-10-06T11:20:22.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.403+0000 7fe751917700 1 -- 172.21.15.146:0/1010652824 shutdown_connections 2023-10-06T11:20:22.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.403+0000 7fe751917700 1 --2- 172.21.15.146:0/1010652824 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe74c1538c0 0x7fe74c153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:22.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.403+0000 7fe751917700 1 --2- 172.21.15.146:0/1010652824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe74c15a940 0x7fe74c15dcc0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:22.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.403+0000 7fe751917700 1 -- 172.21.15.146:0/1010652824 >> 172.21.15.146:0/1010652824 conn(0x7fe74c06eb10 msgr2=0x7fe74c06ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:22.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.403+0000 7fe751917700 1 -- 172.21.15.146:0/1010652824 shutdown_connections 2023-10-06T11:20:22.407 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.403+0000 7fe751917700 1 -- 172.21.15.146:0/1010652824 wait complete. 2023-10-06T11:20:22.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.404+0000 7fe751917700 1 Processor -- start 2023-10-06T11:20:22.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.404+0000 7fe751917700 1 -- start start 2023-10-06T11:20:22.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.405+0000 7fe751917700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe74c0cac80 0x7fe74c16c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:22.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.405+0000 7fe751917700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe74c1538c0 0x7fe74c16a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:22.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.405+0000 7fe751917700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe74c15a940 0x7fe74c16a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:22.410 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.405+0000 7fe751917700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c16cc00 con 0x7fe74c0cac80 2023-10-06T11:20:22.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.405+0000 7fe751917700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c16a740 con 0x7fe74c1538c0 2023-10-06T11:20:22.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.405+0000 7fe751917700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe74c0b33e0 con 0x7fe74c15a940 2023-10-06T11:20:22.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.405+0000 7fe74affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe74c0cac80 0x7fe74c16c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:22.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.405+0000 7fe74affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe74c0cac80 0x7fe74c16c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45100/0 (socket says 172.21.15.146:45100) 2023-10-06T11:20:22.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.405+0000 7fe74affd700 1 -- 172.21.15.146:0/2565447467 learned_addr learned my addr 172.21.15.146:0/2565447467 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:22.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.405+0000 7fe74a7fc700 1 --2- 172.21.15.146:0/2565447467 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe74c1538c0 0x7fe74c16a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:22.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.405+0000 7fe74b7fe700 1 --2- 172.21.15.146:0/2565447467 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe74c15a940 0x7fe74c16a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:22.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.405+0000 7fe74affd700 1 -- 172.21.15.146:0/2565447467 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe74c15a940 msgr2=0x7fe74c16a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:22.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.405+0000 7fe74affd700 1 --2- 172.21.15.146:0/2565447467 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe74c15a940 0x7fe74c16a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:22.411 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.405+0000 7fe74affd700 1 -- 172.21.15.146:0/2565447467 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe74c1538c0 msgr2=0x7fe74c16a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:22.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.405+0000 7fe74affd700 1 --2- 172.21.15.146:0/2565447467 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe74c1538c0 0x7fe74c16a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:22.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.405+0000 7fe74affd700 1 -- 172.21.15.146:0/2565447467 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe744009a20 con 0x7fe74c0cac80 2023-10-06T11:20:22.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.405+0000 7fe74a7fc700 1 --2- 172.21.15.146:0/2565447467 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe74c1538c0 0x7fe74c16a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:20:22.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.406+0000 7fe74affd700 1 --2- 172.21.15.146:0/2565447467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe74c0cac80 0x7fe74c16c6c0 secure :-1 s=READY pgs=2363 cs=0 l=1 rev1=1 crypto rx=0x7fe74400c170 tx=0x7fe74400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:22.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.406+0000 7fe732ffd700 1 -- 172.21.15.146:0/2565447467 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74400ce10 con 0x7fe74c0cac80 2023-10-06T11:20:22.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.406+0000 7fe732ffd700 1 -- 172.21.15.146:0/2565447467 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe74400f040 con 0x7fe74c0cac80 2023-10-06T11:20:22.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.406+0000 7fe751917700 1 -- 172.21.15.146:0/2565447467 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe740009420 con 0x7fe74c0cac80 2023-10-06T11:20:22.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.406+0000 7fe732ffd700 1 -- 172.21.15.146:0/2565447467 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe744014690 con 0x7fe74c0cac80 2023-10-06T11:20:22.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.406+0000 7fe751917700 1 -- 172.21.15.146:0/2565447467 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe74c0c9db0 con 0x7fe74c0cac80 2023-10-06T11:20:22.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.407+0000 7fe751917700 1 -- 172.21.15.146:0/2565447467 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe74c0b3730 con 0x7fe74c0cac80 2023-10-06T11:20:22.412 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.407+0000 7fe732ffd700 1 -- 172.21.15.146:0/2565447467 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe744014a00 con 0x7fe74c0cac80 2023-10-06T11:20:22.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.407+0000 7fe732ffd700 1 --2- 172.21.15.146:0/2565447467 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe738066f30 0x7fe7380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:22.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.408+0000 7fe732ffd700 1 -- 172.21.15.146:0/2565447467 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6231+0+0 (secure 0 0 0) 0x7fe744085600 con 0x7fe74c0cac80 2023-10-06T11:20:22.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.408+0000 7fe74a7fc700 1 --2- 172.21.15.146:0/2565447467 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe738066f30 0x7fe7380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:22.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.408+0000 7fe74a7fc700 1 --2- 172.21.15.146:0/2565447467 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe738066f30 0x7fe7380693e0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fe74c0c90f0 tx=0x7fe740017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:22.413 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.412+0000 7fe732ffd700 1 -- 172.21.15.146:0/2565447467 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe744052660 con 0x7fe74c0cac80 2023-10-06T11:20:22.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.597+0000 7fe751917700 1 -- 172.21.15.146:0/2565447467 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe74c04c380 con 0x7fe74c0cac80 2023-10-06T11:20:22.599 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.598+0000 7fe732ffd700 1 -- 172.21.15.146:0/2565447467 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v180) v1 ==== 74+0+17205 (secure 0 0 0) 0x7fe744014cb0 con 0x7fe74c0cac80 2023-10-06T11:20:22.600 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:20:22.600 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":180,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:19:34.468624+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:18:49.540526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2023-10-06T11:18:50.844600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"28.13","mappings":[{"from":6,"to":1}]},{"pgid":"28.2b","mappings":[{"from":6,"to":4}]},{"pgid":"28.2d","mappings":[{"from":6,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.151:6834/1134233840":"2023-10-07T11:19:12.134281+0000","172.21.15.151:6832/1134233840":"2023-10-07T11:19:12.134281+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:20:22.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.600+0000 7fe751917700 1 -- 172.21.15.146:0/2565447467 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe738066f30 msgr2=0x7fe7380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:22.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.600+0000 7fe751917700 1 --2- 172.21.15.146:0/2565447467 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe738066f30 0x7fe7380693e0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fe74c0c90f0 tx=0x7fe740017000 comp rx=0 tx=0).stop 2023-10-06T11:20:22.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.600+0000 7fe751917700 1 -- 172.21.15.146:0/2565447467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe74c0cac80 msgr2=0x7fe74c16c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:22.602 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.600+0000 7fe751917700 1 --2- 172.21.15.146:0/2565447467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe74c0cac80 0x7fe74c16c6c0 secure :-1 s=READY pgs=2363 cs=0 l=1 rev1=1 crypto rx=0x7fe74400c170 tx=0x7fe74400b040 comp rx=0 tx=0).stop 2023-10-06T11:20:22.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.600+0000 7fe751917700 1 -- 172.21.15.146:0/2565447467 shutdown_connections 2023-10-06T11:20:22.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.600+0000 7fe751917700 1 --2- 172.21.15.146:0/2565447467 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe738066f30 0x7fe7380693e0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:22.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.600+0000 7fe751917700 1 --2- 172.21.15.146:0/2565447467 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe74c15a940 0x7fe74c16a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:22.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.600+0000 7fe751917700 1 --2- 172.21.15.146:0/2565447467 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe74c0cac80 0x7fe74c16c6c0 unknown :-1 s=CLOSED pgs=2363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:22.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.600+0000 7fe751917700 1 --2- 172.21.15.146:0/2565447467 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe74c1538c0 0x7fe74c16a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:22.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.600+0000 7fe751917700 1 -- 172.21.15.146:0/2565447467 >> 172.21.15.146:0/2565447467 conn(0x7fe74c06eb10 msgr2=0x7fe74c0c5620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:22.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.600+0000 7fe751917700 1 -- 172.21.15.146:0/2565447467 shutdown_connections 2023-10-06T11:20:22.603 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.600+0000 7fe751917700 1 -- 172.21.15.146:0/2565447467 wait complete. 2023-10-06T11:20:22.615 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T11:20:22.615 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:20:22.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.728+0000 7f1547ba4700 1 Processor -- start 2023-10-06T11:20:22.730 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.728+0000 7f1547ba4700 1 -- start start 2023-10-06T11:20:22.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.729+0000 7f1547ba4700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f15401538c0 0x7f1540153c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:22.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.729+0000 7f1547ba4700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f154015dcc0 0x7f15400ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:22.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.729+0000 7f1547ba4700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f154015e140 con 0x7f154015a940 2023-10-06T11:20:22.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.729+0000 7f1547ba4700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f154015d270 con 0x7f154015dcc0 2023-10-06T11:20:22.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.729+0000 7f1547ba4700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f154015d830 con 0x7f15401538c0 2023-10-06T11:20:22.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.729+0000 7f1545940700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f15401538c0 0x7f1540153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:22.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.729+0000 7f1546141700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f154015dcc0 0x7f15400ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:22.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.729+0000 7f1545940700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f15401538c0 0x7f1540153c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:50714/0 (socket says 172.21.15.146:50714) 2023-10-06T11:20:22.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.729+0000 7f1545940700 1 -- 172.21.15.146:0/386584720 learned_addr learned my addr 172.21.15.146:0/386584720 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:22.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.729+0000 7f154513f700 1 --1- 172.21.15.146:0/386584720 >> v1:172.21.15.151:6789/0 conn(0x7f154015a940 0x7f15400cac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:48880/0 (socket says 172.21.15.146:48880) 2023-10-06T11:20:22.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.729+0000 7f1545940700 1 -- 172.21.15.146:0/386584720 >> v2:172.21.15.151:3300/0 conn(0x7f154015dcc0 msgr2=0x7f15400ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:22.733 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.729+0000 7f1545940700 1 --2- 172.21.15.146:0/386584720 >> v2:172.21.15.151:3300/0 conn(0x7f154015dcc0 0x7f15400ce610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:22.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.729+0000 7f1545940700 1 -- 172.21.15.146:0/386584720 >> v1:172.21.15.151:6789/0 conn(0x7f154015a940 legacy=0x7f15400cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:22.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.729+0000 7f1545940700 1 -- 172.21.15.146:0/386584720 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15400cb810 con 0x7f15401538c0 2023-10-06T11:20:22.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.729+0000 7f1546141700 1 --2- 172.21.15.146:0/386584720 >> v2:172.21.15.151:3300/0 conn(0x7f154015dcc0 0x7f15400ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:20:22.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.730+0000 7f1545940700 1 --2- 172.21.15.146:0/386584720 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f15401538c0 0x7f1540153c90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f15380099b0 tx=0x7f1538009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd17af0c4772e8b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:22.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.730+0000 7f154493e700 1 -- 172.21.15.146:0/386584720 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1538009ea0 con 0x7f15401538c0 2023-10-06T11:20:22.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.730+0000 7f154493e700 1 -- 172.21.15.146:0/386584720 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f153800b860 con 0x7f15401538c0 2023-10-06T11:20:22.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.730+0000 7f154493e700 1 -- 172.21.15.146:0/386584720 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153800bc00 con 0x7f15401538c0 2023-10-06T11:20:22.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.730+0000 7f1547ba4700 1 -- 172.21.15.146:0/386584720 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f15401538c0 msgr2=0x7f1540153c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:22.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.730+0000 7f1547ba4700 1 --2- 172.21.15.146:0/386584720 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f15401538c0 0x7f1540153c90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f15380099b0 tx=0x7f1538009250 comp rx=0 tx=0).stop 2023-10-06T11:20:22.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.730+0000 7f1547ba4700 1 -- 172.21.15.146:0/386584720 shutdown_connections 2023-10-06T11:20:22.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.730+0000 7f1547ba4700 1 --2- 172.21.15.146:0/386584720 >> v2:172.21.15.151:3300/0 conn(0x7f154015dcc0 0x7f15400ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:22.734 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.730+0000 7f1547ba4700 1 --2- 172.21.15.146:0/386584720 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f15401538c0 0x7f1540153c90 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:22.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.730+0000 7f1547ba4700 1 -- 172.21.15.146:0/386584720 >> 172.21.15.146:0/386584720 conn(0x7f154006eb10 msgr2=0x7f154006ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:22.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.730+0000 7f1547ba4700 1 -- 172.21.15.146:0/386584720 shutdown_connections 2023-10-06T11:20:22.735 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.730+0000 7f1547ba4700 1 -- 172.21.15.146:0/386584720 wait complete. 2023-10-06T11:20:22.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.731+0000 7f1547ba4700 1 Processor -- start 2023-10-06T11:20:22.738 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.732+0000 7f1547ba4700 1 -- start start 2023-10-06T11:20:22.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.732+0000 7f1547ba4700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15401538c0 0x7f15400c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:22.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.732+0000 7f1547ba4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f154015a940 0x7f1540147fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:22.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.732+0000 7f1547ba4700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f154015dcc0 0x7f154015ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:22.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.732+0000 7f1547ba4700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f154014f1a0 con 0x7f15401538c0 2023-10-06T11:20:22.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.732+0000 7f1547ba4700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f154014f480 con 0x7f154015a940 2023-10-06T11:20:22.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.732+0000 7f1547ba4700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f154014f760 con 0x7f154015dcc0 2023-10-06T11:20:22.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.732+0000 7f1545940700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15401538c0 0x7f15400c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:22.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.732+0000 7f1545940700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15401538c0 0x7f15400c7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45106/0 (socket says 172.21.15.146:45106) 2023-10-06T11:20:22.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.732+0000 7f1545940700 1 -- 172.21.15.146:0/662817401 learned_addr learned my addr 172.21.15.146:0/662817401 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:22.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.732+0000 7f154513f700 1 --2- 172.21.15.146:0/662817401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f154015a940 0x7f1540147fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:22.739 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.733+0000 7f1546141700 1 --2- 172.21.15.146:0/662817401 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f154015dcc0 0x7f154015ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:22.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.733+0000 7f1545940700 1 -- 172.21.15.146:0/662817401 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f154015dcc0 msgr2=0x7f154015ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:22.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.733+0000 7f1545940700 1 --2- 172.21.15.146:0/662817401 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f154015dcc0 0x7f154015ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:22.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.733+0000 7f1545940700 1 -- 172.21.15.146:0/662817401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f154015a940 msgr2=0x7f1540147fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:22.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.733+0000 7f1545940700 1 --2- 172.21.15.146:0/662817401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f154015a940 0x7f1540147fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:22.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.733+0000 7f1545940700 1 -- 172.21.15.146:0/662817401 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f153c009a20 con 0x7f15401538c0 2023-10-06T11:20:22.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.733+0000 7f1545940700 1 --2- 172.21.15.146:0/662817401 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15401538c0 0x7f15400c7cb0 secure :-1 s=READY pgs=2364 cs=0 l=1 rev1=1 crypto rx=0x7f154015d970 tx=0x7f1538017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:22.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.733+0000 7f1535ffb700 1 -- 172.21.15.146:0/662817401 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f153800bbe0 con 0x7f15401538c0 2023-10-06T11:20:22.740 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.733+0000 7f1547ba4700 1 -- 172.21.15.146:0/662817401 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15380094f0 con 0x7f15401538c0 2023-10-06T11:20:22.742 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.733+0000 7f1535ffb700 1 -- 172.21.15.146:0/662817401 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1538011420 con 0x7f15401538c0 2023-10-06T11:20:22.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.733+0000 7f1535ffb700 1 -- 172.21.15.146:0/662817401 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15380117c0 con 0x7f15401538c0 2023-10-06T11:20:22.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.733+0000 7f1547ba4700 1 -- 172.21.15.146:0/662817401 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f154014fd20 con 0x7f15401538c0 2023-10-06T11:20:22.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.734+0000 7f1547ba4700 1 -- 172.21.15.146:0/662817401 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f154014ff40 con 0x7f15401538c0 2023-10-06T11:20:22.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.735+0000 7f1535ffb700 1 -- 172.21.15.146:0/662817401 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1538011bf0 con 0x7f15401538c0 2023-10-06T11:20:22.743 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.735+0000 7f1535ffb700 1 --2- 172.21.15.146:0/662817401 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1524066f30 0x7f15240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:22.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.735+0000 7f1535ffb700 1 -- 172.21.15.146:0/662817401 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6231+0+0 (secure 0 0 0) 0x7f1538085d30 con 0x7f15401538c0 2023-10-06T11:20:22.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.735+0000 7f154513f700 1 --2- 172.21.15.146:0/662817401 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1524066f30 0x7f15240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:22.744 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.736+0000 7f154513f700 1 --2- 172.21.15.146:0/662817401 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1524066f30 0x7f15240693e0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f1530007fd0 tx=0x7f1530007d70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:22.745 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.739+0000 7f1535ffb700 1 -- 172.21.15.146:0/662817401 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1538052d90 con 0x7f15401538c0 2023-10-06T11:20:22.967 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.966+0000 7f1547ba4700 1 -- 172.21.15.146:0/662817401 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f154004c380 con 0x7f15401538c0 2023-10-06T11:20:22.968 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.966+0000 7f1535ffb700 1 -- 172.21.15.146:0/662817401 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 150 v150) v1 ==== 95+0+4622 (secure 0 0 0) 0x7f1538028090 con 0x7f15401538c0 2023-10-06T11:20:22.968 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:20:22.968 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":150,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9094,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/3426437100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3426437100},{"type":"v1","addr":"172.21.15.146:6836","nonce":3426437100}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":139},{"gid":9106,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/3275041097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":3275041097},{"type":"v1","addr":"172.21.15.151:6835","nonce":3275041097}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":139},{"gid":9259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/959352692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":959352692},{"type":"v1","addr":"172.21.15.151:6834","nonce":959352692}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":146}],"filesystems":[{"mdsmap":{"epoch":150,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:18:51.903907+0000","modified":"2023-10-06T11:19:16.147837+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":178,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10461":{"gid":10461,"name":"c","rank":0,"incarnation":147,"state":"up:active","state_seq":10,"addr":"172.21.15.146:6837/2322816938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2322816938},{"type":"v1","addr":"172.21.15.146:6837","nonce":2322816938}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-10-06T11:20:22.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.968+0000 7f1547ba4700 1 -- 172.21.15.146:0/662817401 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1524066f30 msgr2=0x7f15240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:22.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.968+0000 7f1547ba4700 1 --2- 172.21.15.146:0/662817401 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1524066f30 0x7f15240693e0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f1530007fd0 tx=0x7f1530007d70 comp rx=0 tx=0).stop 2023-10-06T11:20:22.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.968+0000 7f1547ba4700 1 -- 172.21.15.146:0/662817401 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15401538c0 msgr2=0x7f15400c7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:22.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.968+0000 7f1547ba4700 1 --2- 172.21.15.146:0/662817401 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15401538c0 0x7f15400c7cb0 secure :-1 s=READY pgs=2364 cs=0 l=1 rev1=1 crypto rx=0x7f154015d970 tx=0x7f1538017000 comp rx=0 tx=0).stop 2023-10-06T11:20:22.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.968+0000 7f1547ba4700 1 -- 172.21.15.146:0/662817401 shutdown_connections 2023-10-06T11:20:22.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.968+0000 7f1547ba4700 1 --2- 172.21.15.146:0/662817401 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1524066f30 0x7f15240693e0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:22.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.968+0000 7f1547ba4700 1 --2- 172.21.15.146:0/662817401 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f154015dcc0 0x7f154015ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:22.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.968+0000 7f1547ba4700 1 --2- 172.21.15.146:0/662817401 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f15401538c0 0x7f15400c7cb0 unknown :-1 s=CLOSED pgs=2364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:22.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.968+0000 7f1547ba4700 1 --2- 172.21.15.146:0/662817401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f154015a940 0x7f1540147fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:22.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.968+0000 7f1547ba4700 1 -- 172.21.15.146:0/662817401 >> 172.21.15.146:0/662817401 conn(0x7f154006eb10 msgr2=0x7f154006eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:22.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.968+0000 7f1547ba4700 1 -- 172.21.15.146:0/662817401 shutdown_connections 2023-10-06T11:20:22.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:22.969+0000 7f1547ba4700 1 -- 172.21.15.146:0/662817401 wait complete. 2023-10-06T11:20:22.972 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 150 2023-10-06T11:20:22.982 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:20:23.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.095+0000 7f993c829700 1 Processor -- start 2023-10-06T11:20:23.097 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.095+0000 7f993c829700 1 -- start start 2023-10-06T11:20:23.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.096+0000 7f993c829700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f993815a940 0x7f9938153c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:23.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.096+0000 7f993c829700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f993815d270 con 0x7f99381538c0 2023-10-06T11:20:23.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.096+0000 7f993c829700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f993815d830 con 0x7f993815dcc0 2023-10-06T11:20:23.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.096+0000 7f993c829700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f993815e110 con 0x7f993815a940 2023-10-06T11:20:23.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.096+0000 7f993659c700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f99381538c0 0x7f99380cac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49374/0 (socket says 172.21.15.146:49374) 2023-10-06T11:20:23.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.096+0000 7f9935d9b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f993815a940 0x7f9938153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:23.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.096+0000 7f993659c700 1 -- 172.21.15.146:0/4197012198 learned_addr learned my addr 172.21.15.146:0/4197012198 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:20:23.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.096+0000 7f9935d9b700 1 -- 172.21.15.146:0/4197012198 >> v1:172.21.15.151:6789/0 conn(0x7f993815dcc0 legacy=0x7f99380ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:23.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.096+0000 7f9935d9b700 1 -- 172.21.15.146:0/4197012198 >> v1:172.21.15.146:6789/0 conn(0x7f99381538c0 legacy=0x7f99380cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:23.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.096+0000 7f993559a700 1 -- 172.21.15.146:0/4197012198 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 104360814 0 0) 0x7f993815d270 con 0x7f99381538c0 2023-10-06T11:20:23.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.096+0000 7f9935d9b700 1 -- 172.21.15.146:0/4197012198 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99380cb810 con 0x7f993815a940 2023-10-06T11:20:23.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.096+0000 7f9935d9b700 1 --2- 172.21.15.146:0/4197012198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f993815a940 0x7f9938153c90 secure :-1 s=READY pgs=2366 cs=0 l=1 rev1=1 crypto rx=0x7f992c009e60 tx=0x7f992c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f16f06d59a9b0400 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:23.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.096+0000 7f993559a700 1 -- 172.21.15.146:0/4197012198 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c00e070 con 0x7f993815a940 2023-10-06T11:20:23.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.097+0000 7f993559a700 1 -- 172.21.15.146:0/4197012198 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992c00bbf0 con 0x7f993815a940 2023-10-06T11:20:23.099 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.097+0000 7f993559a700 1 -- 172.21.15.146:0/4197012198 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c012430 con 0x7f993815a940 2023-10-06T11:20:23.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.097+0000 7f993c829700 1 -- 172.21.15.146:0/4197012198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f993815a940 msgr2=0x7f9938153c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:23.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.097+0000 7f993c829700 1 --2- 172.21.15.146:0/4197012198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f993815a940 0x7f9938153c90 secure :-1 s=READY pgs=2366 cs=0 l=1 rev1=1 crypto rx=0x7f992c009e60 tx=0x7f992c009780 comp rx=0 tx=0).stop 2023-10-06T11:20:23.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.097+0000 7f993c829700 1 -- 172.21.15.146:0/4197012198 shutdown_connections 2023-10-06T11:20:23.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.097+0000 7f993c829700 1 --2- 172.21.15.146:0/4197012198 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f993815a940 0x7f9938153c90 unknown :-1 s=CLOSED pgs=2366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:23.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.097+0000 7f993c829700 1 -- 172.21.15.146:0/4197012198 >> 172.21.15.146:0/4197012198 conn(0x7f993806eb10 msgr2=0x7f993806ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:23.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.097+0000 7f993c829700 1 -- 172.21.15.146:0/4197012198 shutdown_connections 2023-10-06T11:20:23.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.097+0000 7f993c829700 1 -- 172.21.15.146:0/4197012198 wait complete. 2023-10-06T11:20:23.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.098+0000 7f993c829700 1 Processor -- start 2023-10-06T11:20:23.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.098+0000 7f993c829700 1 -- start start 2023-10-06T11:20:23.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.099+0000 7f993c829700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f99381538c0 0x7f993814a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:23.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.099+0000 7f993c829700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f993815a940 0x7f99380c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:23.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.099+0000 7f993c829700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f993815dcc0 0x7f993816d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:23.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.099+0000 7f993c829700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993814f6b0 con 0x7f993815a940 2023-10-06T11:20:23.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.099+0000 7f993c829700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993814acc0 con 0x7f99381538c0 2023-10-06T11:20:23.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.099+0000 7f993c829700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f993815ca90 con 0x7f993815dcc0 2023-10-06T11:20:23.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.099+0000 7f9935d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f993815a940 0x7f99380c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:23.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.099+0000 7f9935d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f993815a940 0x7f99380c9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45132/0 (socket says 172.21.15.146:45132) 2023-10-06T11:20:23.103 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.099+0000 7f9935d9b700 1 -- 172.21.15.146:0/3848708936 learned_addr learned my addr 172.21.15.146:0/3848708936 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:23.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.099+0000 7f993659c700 1 --2- 172.21.15.146:0/3848708936 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f99381538c0 0x7f993814a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:23.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.099+0000 7f9936d9d700 1 --2- 172.21.15.146:0/3848708936 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f993815dcc0 0x7f993816d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:23.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.099+0000 7f9935d9b700 1 -- 172.21.15.146:0/3848708936 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f993815dcc0 msgr2=0x7f993816d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:23.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.099+0000 7f9935d9b700 1 --2- 172.21.15.146:0/3848708936 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f993815dcc0 0x7f993816d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:23.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.099+0000 7f9935d9b700 1 -- 172.21.15.146:0/3848708936 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f99381538c0 msgr2=0x7f993814a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:23.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.099+0000 7f9935d9b700 1 --2- 172.21.15.146:0/3848708936 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f99381538c0 0x7f993814a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:23.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.099+0000 7f9935d9b700 1 -- 172.21.15.146:0/3848708936 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f992c009a20 con 0x7f993815a940 2023-10-06T11:20:23.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.099+0000 7f9935d9b700 1 --2- 172.21.15.146:0/3848708936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f993815a940 0x7f99380c9f00 secure :-1 s=READY pgs=2367 cs=0 l=1 rev1=1 crypto rx=0x7f99380c7450 tx=0x7f992c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:23.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.100+0000 7f99267fc700 1 -- 172.21.15.146:0/3848708936 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c027470 con 0x7f993815a940 2023-10-06T11:20:23.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.100+0000 7f99267fc700 1 -- 172.21.15.146:0/3848708936 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992c027610 con 0x7f993815a940 2023-10-06T11:20:23.104 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.100+0000 7f993c829700 1 -- 172.21.15.146:0/3848708936 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f993815c1f0 con 0x7f993815a940 2023-10-06T11:20:23.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.100+0000 7f99267fc700 1 -- 172.21.15.146:0/3848708936 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c0279d0 con 0x7f993815a940 2023-10-06T11:20:23.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.100+0000 7f993c829700 1 -- 172.21.15.146:0/3848708936 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f993815c7b0 con 0x7f993815a940 2023-10-06T11:20:23.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.101+0000 7f993c829700 1 -- 172.21.15.146:0/3848708936 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99380692d0 con 0x7f993815a940 2023-10-06T11:20:23.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.101+0000 7f99267fc700 1 -- 172.21.15.146:0/3848708936 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f992c024070 con 0x7f993815a940 2023-10-06T11:20:23.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.101+0000 7f99267fc700 1 --2- 172.21.15.146:0/3848708936 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9918066f30 0x7f99180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:23.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.101+0000 7f99267fc700 1 -- 172.21.15.146:0/3848708936 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6231+0+0 (secure 0 0 0) 0x7f992c0871a0 con 0x7f993815a940 2023-10-06T11:20:23.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.101+0000 7f993659c700 1 --2- 172.21.15.146:0/3848708936 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9918066f30 0x7f99180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:23.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.102+0000 7f993659c700 1 --2- 172.21.15.146:0/3848708936 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9918066f30 0x7f99180693e0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f9930007160 tx=0x7f9930007f50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:23.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.106+0000 7f99267fc700 1 -- 172.21.15.146:0/3848708936 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f992c054200 con 0x7f993815a940 2023-10-06T11:20:23.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.330+0000 7f993c829700 1 -- 172.21.15.146:0/3848708936 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f993804c380 con 0x7f993815a940 2023-10-06T11:20:23.332 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.331+0000 7f99267fc700 1 -- 172.21.15.146:0/3848708936 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 150 v150) v1 ==== 95+0+4622 (secure 0 0 0) 0x7f992c057820 con 0x7f993815a940 2023-10-06T11:20:23.333 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:20:23.333 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":150,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9094,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/3426437100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3426437100},{"type":"v1","addr":"172.21.15.146:6836","nonce":3426437100}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":139},{"gid":9106,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/3275041097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":3275041097},{"type":"v1","addr":"172.21.15.151:6835","nonce":3275041097}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":139},{"gid":9259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/959352692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":959352692},{"type":"v1","addr":"172.21.15.151:6834","nonce":959352692}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":146}],"filesystems":[{"mdsmap":{"epoch":150,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T11:18:51.903907+0000","modified":"2023-10-06T11:19:16.147837+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":178,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":10461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_10461":{"gid":10461,"name":"c","rank":0,"incarnation":147,"state":"up:active","state_seq":10,"addr":"172.21.15.146:6837/2322816938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":2322816938},{"type":"v1","addr":"172.21.15.146:6837","nonce":2322816938}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-10-06T11:20:23.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.332+0000 7f993c829700 1 -- 172.21.15.146:0/3848708936 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9918066f30 msgr2=0x7f99180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:23.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.332+0000 7f993c829700 1 --2- 172.21.15.146:0/3848708936 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9918066f30 0x7f99180693e0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f9930007160 tx=0x7f9930007f50 comp rx=0 tx=0).stop 2023-10-06T11:20:23.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.332+0000 7f993c829700 1 -- 172.21.15.146:0/3848708936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f993815a940 msgr2=0x7f99380c9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:23.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.332+0000 7f993c829700 1 --2- 172.21.15.146:0/3848708936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f993815a940 0x7f99380c9f00 secure :-1 s=READY pgs=2367 cs=0 l=1 rev1=1 crypto rx=0x7f99380c7450 tx=0x7f992c018000 comp rx=0 tx=0).stop 2023-10-06T11:20:23.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.333+0000 7f993c829700 1 -- 172.21.15.146:0/3848708936 shutdown_connections 2023-10-06T11:20:23.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.333+0000 7f993c829700 1 --2- 172.21.15.146:0/3848708936 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9918066f30 0x7f99180693e0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:23.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.333+0000 7f993c829700 1 --2- 172.21.15.146:0/3848708936 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f993815dcc0 0x7f993816d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:23.335 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.333+0000 7f993c829700 1 --2- 172.21.15.146:0/3848708936 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f99381538c0 0x7f993814a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:23.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.333+0000 7f993c829700 1 --2- 172.21.15.146:0/3848708936 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f993815a940 0x7f99380c9f00 unknown :-1 s=CLOSED pgs=2367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:23.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.333+0000 7f993c829700 1 -- 172.21.15.146:0/3848708936 >> 172.21.15.146:0/3848708936 conn(0x7f993806eb10 msgr2=0x7f993814b590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:23.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.333+0000 7f993c829700 1 -- 172.21.15.146:0/3848708936 shutdown_connections 2023-10-06T11:20:23.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.333+0000 7f993c829700 1 -- 172.21.15.146:0/3848708936 wait complete. 2023-10-06T11:20:23.336 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 150 2023-10-06T11:20:23.347 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:20:23.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.459+0000 7f89972ce700 1 Processor -- start 2023-10-06T11:20:23.461 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.459+0000 7f89972ce700 1 -- start start 2023-10-06T11:20:23.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.460+0000 7f89972ce700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8990143040 0x7f89900b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:23.463 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.460+0000 7f89972ce700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8990143410 0x7f89900b2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:23.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.460+0000 7f89972ce700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89900cf100 con 0x7f89900b4d20 2023-10-06T11:20:23.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.460+0000 7f89972ce700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89900b4170 con 0x7f8990143040 2023-10-06T11:20:23.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.460+0000 7f89972ce700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89900b5f50 con 0x7f8990143410 2023-10-06T11:20:23.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.460+0000 7f8996acd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f89900b4d20 0x7f89900b51a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49382/0 (socket says 172.21.15.146:49382) 2023-10-06T11:20:23.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.460+0000 7f8996acd700 1 -- 172.21.15.146:0/1921513592 learned_addr learned my addr 172.21.15.146:0/1921513592 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:20:23.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.460+0000 7f89962cc700 1 --2- 172.21.15.146:0/1921513592 >> v2:172.21.15.151:3300/0 conn(0x7f8990143040 0x7f89900b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:23.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.460+0000 7f8995acb700 1 --2- 172.21.15.146:0/1921513592 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8990143410 0x7f89900b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:23.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.460+0000 7f89952ca700 1 -- 172.21.15.146:0/1921513592 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2347944986 0 0) 0x7f89900cf100 con 0x7f89900b4d20 2023-10-06T11:20:23.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.460+0000 7f89952ca700 1 -- 172.21.15.146:0/1921513592 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f897c003570 con 0x7f89900b4d20 2023-10-06T11:20:23.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.461+0000 7f89952ca700 1 -- 172.21.15.146:0/1921513592 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3778090638 0 0) 0x7f897c003570 con 0x7f89900b4d20 2023-10-06T11:20:23.464 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.461+0000 7f89962cc700 1 -- 172.21.15.146:0/1921513592 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8990143410 msgr2=0x7f89900b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:23.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.461+0000 7f89962cc700 1 --2- 172.21.15.146:0/1921513592 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8990143410 0x7f89900b2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:23.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.461+0000 7f89962cc700 1 -- 172.21.15.146:0/1921513592 >> v1:172.21.15.146:6789/0 conn(0x7f89900b4d20 legacy=0x7f89900b51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:23.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.461+0000 7f89962cc700 1 -- 172.21.15.146:0/1921513592 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89900ceb30 con 0x7f8990143040 2023-10-06T11:20:23.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.461+0000 7f89962cc700 1 --2- 172.21.15.146:0/1921513592 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8990143040 0x7f89900b1e20 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f898c0098e0 tx=0x7f898c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4101ab76253a3b63 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:23.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.461+0000 7f89952ca700 1 -- 172.21.15.146:0/1921513592 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89880017f0 con 0x7f8990143040 2023-10-06T11:20:23.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.461+0000 7f89952ca700 1 -- 172.21.15.146:0/1921513592 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f898c011420 con 0x7f8990143040 2023-10-06T11:20:23.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.461+0000 7f89952ca700 1 -- 172.21.15.146:0/1921513592 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898c0117a0 con 0x7f8990143040 2023-10-06T11:20:23.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.461+0000 7f89972ce700 1 -- 172.21.15.146:0/1921513592 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8990143040 msgr2=0x7f89900b1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:23.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.461+0000 7f89972ce700 1 --2- 172.21.15.146:0/1921513592 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8990143040 0x7f89900b1e20 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f898c0098e0 tx=0x7f898c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:20:23.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.462+0000 7f89972ce700 1 -- 172.21.15.146:0/1921513592 shutdown_connections 2023-10-06T11:20:23.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.462+0000 7f89972ce700 1 --2- 172.21.15.146:0/1921513592 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8990143040 0x7f89900b1e20 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:23.465 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.462+0000 7f89972ce700 1 --2- 172.21.15.146:0/1921513592 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8990143410 0x7f89900b2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:23.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.462+0000 7f89972ce700 1 -- 172.21.15.146:0/1921513592 >> 172.21.15.146:0/1921513592 conn(0x7f899006eb10 msgr2=0x7f899006ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:23.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.462+0000 7f89972ce700 1 -- 172.21.15.146:0/1921513592 shutdown_connections 2023-10-06T11:20:23.466 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.462+0000 7f89972ce700 1 -- 172.21.15.146:0/1921513592 wait complete. 2023-10-06T11:20:23.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.463+0000 7f89972ce700 1 Processor -- start 2023-10-06T11:20:23.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.463+0000 7f89972ce700 1 -- start start 2023-10-06T11:20:23.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.463+0000 7f89972ce700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89900b4d20 0x7f89900c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:23.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.463+0000 7f89972ce700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8990143040 0x7f8990140090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:23.468 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.463+0000 7f89972ce700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8990143410 0x7f89900c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:23.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.463+0000 7f89972ce700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899015a0c0 con 0x7f8990143410 2023-10-06T11:20:23.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.463+0000 7f89972ce700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899015a8f0 con 0x7f8990143040 2023-10-06T11:20:23.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.463+0000 7f89972ce700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89900cc390 con 0x7f89900b4d20 2023-10-06T11:20:23.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.463+0000 7f8996acd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8990143410 0x7f89900c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:23.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.463+0000 7f8996acd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8990143410 0x7f89900c8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45138/0 (socket says 172.21.15.146:45138) 2023-10-06T11:20:23.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.463+0000 7f8996acd700 1 -- 172.21.15.146:0/3824430955 learned_addr learned my addr 172.21.15.146:0/3824430955 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:23.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.464+0000 7f8995acb700 1 --2- 172.21.15.146:0/3824430955 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8990143040 0x7f8990140090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:23.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.464+0000 7f8996acd700 1 -- 172.21.15.146:0/3824430955 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89900b4d20 msgr2=0x7f89900c69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:23.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.464+0000 7f8996acd700 1 --2- 172.21.15.146:0/3824430955 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89900b4d20 0x7f89900c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:23.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.464+0000 7f8996acd700 1 -- 172.21.15.146:0/3824430955 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8990143040 msgr2=0x7f8990140090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:23.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.464+0000 7f8996acd700 1 --2- 172.21.15.146:0/3824430955 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8990143040 0x7f8990140090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:23.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.464+0000 7f8996acd700 1 -- 172.21.15.146:0/3824430955 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f898c009420 con 0x7f8990143410 2023-10-06T11:20:23.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.464+0000 7f8995acb700 1 --2- 172.21.15.146:0/3824430955 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8990143040 0x7f8990140090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:20:23.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.464+0000 7f8996acd700 1 --2- 172.21.15.146:0/3824430955 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8990143410 0x7f89900c8b30 secure :-1 s=READY pgs=2369 cs=0 l=1 rev1=1 crypto rx=0x7f898800cc20 tx=0x7f89880015b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:23.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.464+0000 7f89867fc700 1 -- 172.21.15.146:0/3824430955 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8988004dc0 con 0x7f8990143410 2023-10-06T11:20:23.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.464+0000 7f89867fc700 1 -- 172.21.15.146:0/3824430955 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f898800a7b0 con 0x7f8990143410 2023-10-06T11:20:23.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.464+0000 7f89972ce700 1 -- 172.21.15.146:0/3824430955 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f899015a2a0 con 0x7f8990143410 2023-10-06T11:20:23.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.464+0000 7f89867fc700 1 -- 172.21.15.146:0/3824430955 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898800ab70 con 0x7f8990143410 2023-10-06T11:20:23.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.464+0000 7f89972ce700 1 -- 172.21.15.146:0/3824430955 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89901405d0 con 0x7f8990143410 2023-10-06T11:20:23.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.465+0000 7f89972ce700 1 -- 172.21.15.146:0/3824430955 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8990088a80 con 0x7f8990143410 2023-10-06T11:20:23.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.465+0000 7f89867fc700 1 -- 172.21.15.146:0/3824430955 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8988007150 con 0x7f8990143410 2023-10-06T11:20:23.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.466+0000 7f89867fc700 1 --2- 172.21.15.146:0/3824430955 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8974066f30 0x7f89740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:23.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.466+0000 7f89867fc700 1 -- 172.21.15.146:0/3824430955 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6231+0+0 (secure 0 0 0) 0x7f8988084260 con 0x7f8990143410 2023-10-06T11:20:23.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.466+0000 7f89962cc700 1 --2- 172.21.15.146:0/3824430955 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8974066f30 0x7f89740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:23.471 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.466+0000 7f89962cc700 1 --2- 172.21.15.146:0/3824430955 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8974066f30 0x7f89740693e0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f8990067fa0 tx=0x7f898c016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:23.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.470+0000 7f89867fc700 1 -- 172.21.15.146:0/3824430955 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8988051340 con 0x7f8990143410 2023-10-06T11:20:23.657 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.656+0000 7f89972ce700 1 -- 172.21.15.146:0/3824430955 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f899015aa60 con 0x7f8990143410 2023-10-06T11:20:23.658 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.657+0000 7f89867fc700 1 -- 172.21.15.146:0/3824430955 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v180) v1 ==== 74+0+17205 (secure 0 0 0) 0x7f8988054960 con 0x7f8990143410 2023-10-06T11:20:23.658 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:20:23.659 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":180,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:19:34.468624+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2023-10-06T11:18:49.540526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2023-10-06T11:18:50.844600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"177","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"28.13","mappings":[{"from":6,"to":1}]},{"pgid":"28.2b","mappings":[{"from":6,"to":4}]},{"pgid":"28.2d","mappings":[{"from":6,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.151:6834/1134233840":"2023-10-07T11:19:12.134281+0000","172.21.15.151:6832/1134233840":"2023-10-07T11:19:12.134281+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:20:23.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.659+0000 7f89972ce700 1 -- 172.21.15.146:0/3824430955 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8974066f30 msgr2=0x7f89740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:23.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.659+0000 7f89972ce700 1 --2- 172.21.15.146:0/3824430955 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8974066f30 0x7f89740693e0 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f8990067fa0 tx=0x7f898c016000 comp rx=0 tx=0).stop 2023-10-06T11:20:23.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.659+0000 7f89972ce700 1 -- 172.21.15.146:0/3824430955 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8990143410 msgr2=0x7f89900c8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:23.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.659+0000 7f89972ce700 1 --2- 172.21.15.146:0/3824430955 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8990143410 0x7f89900c8b30 secure :-1 s=READY pgs=2369 cs=0 l=1 rev1=1 crypto rx=0x7f898800cc20 tx=0x7f89880015b0 comp rx=0 tx=0).stop 2023-10-06T11:20:23.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.659+0000 7f89972ce700 1 -- 172.21.15.146:0/3824430955 shutdown_connections 2023-10-06T11:20:23.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.659+0000 7f89972ce700 1 --2- 172.21.15.146:0/3824430955 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8974066f30 0x7f89740693e0 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:23.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.659+0000 7f89972ce700 1 --2- 172.21.15.146:0/3824430955 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8990143410 0x7f89900c8b30 unknown :-1 s=CLOSED pgs=2369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:23.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.659+0000 7f89972ce700 1 --2- 172.21.15.146:0/3824430955 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89900b4d20 0x7f89900c69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:23.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.659+0000 7f89972ce700 1 --2- 172.21.15.146:0/3824430955 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8990143040 0x7f8990140090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:23.661 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.659+0000 7f89972ce700 1 -- 172.21.15.146:0/3824430955 >> 172.21.15.146:0/3824430955 conn(0x7f899006eb10 msgr2=0x7f89900b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:23.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.659+0000 7f89972ce700 1 -- 172.21.15.146:0/3824430955 shutdown_connections 2023-10-06T11:20:23.662 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.659+0000 7f89972ce700 1 -- 172.21.15.146:0/3824430955 wait complete. 2023-10-06T11:20:23.673 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T11:20:23.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.786+0000 7f5e2451f700 1 Processor -- start 2023-10-06T11:20:23.788 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.786+0000 7f5e2451f700 1 -- start start 2023-10-06T11:20:23.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.787+0000 7f5e2451f700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5e1c1538c0 0x7f5e1c153c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:23.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.787+0000 7f5e2451f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e1c15dcc0 0x7f5e1c0ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:23.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.787+0000 7f5e2451f700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e1c15d270 con 0x7f5e1c15a940 2023-10-06T11:20:23.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.787+0000 7f5e2451f700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e1c15d830 con 0x7f5e1c1538c0 2023-10-06T11:20:23.789 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.787+0000 7f5e2451f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1c15e110 con 0x7f5e1c15dcc0 2023-10-06T11:20:23.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.787+0000 7f5e222bb700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5e1c1538c0 0x7f5e1c153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:23.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.787+0000 7f5e22abc700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e1c15dcc0 0x7f5e1c0ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:23.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.787+0000 7f5e21aba700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f5e1c15a940 0x7f5e1c0cac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:48892/0 (socket says 172.21.15.146:48892) 2023-10-06T11:20:23.790 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.788+0000 7f5e21aba700 1 -- 172.21.15.146:0/1274301522 learned_addr learned my addr 172.21.15.146:0/1274301522 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:20:23.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.788+0000 7f5e22abc700 1 -- 172.21.15.146:0/1274301522 >> v2:172.21.15.151:3300/0 conn(0x7f5e1c1538c0 msgr2=0x7f5e1c153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:23.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.788+0000 7f5e22abc700 1 --2- 172.21.15.146:0/1274301522 >> v2:172.21.15.151:3300/0 conn(0x7f5e1c1538c0 0x7f5e1c153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:23.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.788+0000 7f5e22abc700 1 -- 172.21.15.146:0/1274301522 >> v1:172.21.15.151:6789/0 conn(0x7f5e1c15a940 legacy=0x7f5e1c0cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:23.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.788+0000 7f5e22abc700 1 -- 172.21.15.146:0/1274301522 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e1c0cb810 con 0x7f5e1c15dcc0 2023-10-06T11:20:23.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.788+0000 7f5e222bb700 1 --2- 172.21.15.146:0/1274301522 >> v2:172.21.15.151:3300/0 conn(0x7f5e1c1538c0 0x7f5e1c153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:20:23.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.788+0000 7f5e22abc700 1 --2- 172.21.15.146:0/1274301522 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e1c15dcc0 0x7f5e1c0ce610 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5e14009e60 tx=0x7f5e14009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4263392ff6f36292 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:23.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.788+0000 7f5e212b9700 1 -- 172.21.15.146:0/1274301522 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1400e070 con 0x7f5e1c15dcc0 2023-10-06T11:20:23.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.788+0000 7f5e212b9700 1 -- 172.21.15.146:0/1274301522 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e1400bb60 con 0x7f5e1c15dcc0 2023-10-06T11:20:23.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.788+0000 7f5e212b9700 1 -- 172.21.15.146:0/1274301522 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e14012430 con 0x7f5e1c15dcc0 2023-10-06T11:20:23.792 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.789+0000 7f5e2451f700 1 -- 172.21.15.146:0/1274301522 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e1c15dcc0 msgr2=0x7f5e1c0ce610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:23.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.789+0000 7f5e2451f700 1 --2- 172.21.15.146:0/1274301522 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e1c15dcc0 0x7f5e1c0ce610 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5e14009e60 tx=0x7f5e14009780 comp rx=0 tx=0).stop 2023-10-06T11:20:23.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.789+0000 7f5e2451f700 1 -- 172.21.15.146:0/1274301522 shutdown_connections 2023-10-06T11:20:23.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.789+0000 7f5e2451f700 1 --2- 172.21.15.146:0/1274301522 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e1c15dcc0 0x7f5e1c0ce610 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:23.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.789+0000 7f5e2451f700 1 --2- 172.21.15.146:0/1274301522 >> v2:172.21.15.151:3300/0 conn(0x7f5e1c1538c0 0x7f5e1c153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:23.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.789+0000 7f5e2451f700 1 -- 172.21.15.146:0/1274301522 >> 172.21.15.146:0/1274301522 conn(0x7f5e1c06eb10 msgr2=0x7f5e1c06ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:23.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.789+0000 7f5e2451f700 1 -- 172.21.15.146:0/1274301522 shutdown_connections 2023-10-06T11:20:23.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.789+0000 7f5e2451f700 1 -- 172.21.15.146:0/1274301522 wait complete. 2023-10-06T11:20:23.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.790+0000 7f5e2451f700 1 Processor -- start 2023-10-06T11:20:23.793 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.790+0000 7f5e2451f700 1 -- start start 2023-10-06T11:20:23.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.790+0000 7f5e2451f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e1c1538c0 0x7f5e1c15c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:23.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.790+0000 7f5e2451f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e1c15a940 0x7f5e1c13f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:23.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.790+0000 7f5e2451f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e1c15dcc0 0x7f5e1c0b33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:23.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.790+0000 7f5e2451f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1c15cc20 con 0x7f5e1c1538c0 2023-10-06T11:20:23.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.790+0000 7f5e2451f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1c15ae30 con 0x7f5e1c15a940 2023-10-06T11:20:23.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.791+0000 7f5e2451f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1c13f690 con 0x7f5e1c15dcc0 2023-10-06T11:20:23.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.791+0000 7f5e222bb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e1c1538c0 0x7f5e1c15c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:23.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.791+0000 7f5e222bb700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e1c1538c0 0x7f5e1c15c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45144/0 (socket says 172.21.15.146:45144) 2023-10-06T11:20:23.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.791+0000 7f5e222bb700 1 -- 172.21.15.146:0/3421415153 learned_addr learned my addr 172.21.15.146:0/3421415153 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:23.796 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.791+0000 7f5e22abc700 1 --2- 172.21.15.146:0/3421415153 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e1c15dcc0 0x7f5e1c0b33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:23.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.791+0000 7f5e21aba700 1 --2- 172.21.15.146:0/3421415153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e1c15a940 0x7f5e1c13f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:23.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.791+0000 7f5e222bb700 1 -- 172.21.15.146:0/3421415153 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e1c15dcc0 msgr2=0x7f5e1c0b33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:23.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.791+0000 7f5e222bb700 1 --2- 172.21.15.146:0/3421415153 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e1c15dcc0 0x7f5e1c0b33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:23.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.791+0000 7f5e222bb700 1 -- 172.21.15.146:0/3421415153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e1c15a940 msgr2=0x7f5e1c13f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:23.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.791+0000 7f5e222bb700 1 --2- 172.21.15.146:0/3421415153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e1c15a940 0x7f5e1c13f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:23.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.791+0000 7f5e222bb700 1 -- 172.21.15.146:0/3421415153 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e18009420 con 0x7f5e1c1538c0 2023-10-06T11:20:23.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.791+0000 7f5e22abc700 1 --2- 172.21.15.146:0/3421415153 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e1c15dcc0 0x7f5e1c0b33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:20:23.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.791+0000 7f5e222bb700 1 --2- 172.21.15.146:0/3421415153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e1c1538c0 0x7f5e1c15c6e0 secure :-1 s=READY pgs=2370 cs=0 l=1 rev1=1 crypto rx=0x7f5e1800ecb0 tx=0x7f5e180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:23.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.791+0000 7f5e127fc700 1 -- 172.21.15.146:0/3421415153 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1800c920 con 0x7f5e1c1538c0 2023-10-06T11:20:23.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.791+0000 7f5e127fc700 1 -- 172.21.15.146:0/3421415153 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e1800ca80 con 0x7f5e1c1538c0 2023-10-06T11:20:23.797 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.791+0000 7f5e2451f700 1 -- 172.21.15.146:0/3421415153 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e14009a20 con 0x7f5e1c1538c0 2023-10-06T11:20:23.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.791+0000 7f5e127fc700 1 -- 172.21.15.146:0/3421415153 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1800ce20 con 0x7f5e1c1538c0 2023-10-06T11:20:23.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.791+0000 7f5e2451f700 1 -- 172.21.15.146:0/3421415153 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e1c150540 con 0x7f5e1c1538c0 2023-10-06T11:20:23.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.792+0000 7f5e2451f700 1 -- 172.21.15.146:0/3421415153 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e1c04c380 con 0x7f5e1c1538c0 2023-10-06T11:20:23.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.793+0000 7f5e127fc700 1 -- 172.21.15.146:0/3421415153 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5e18013680 con 0x7f5e1c1538c0 2023-10-06T11:20:23.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.793+0000 7f5e127fc700 1 --2- 172.21.15.146:0/3421415153 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5e00066f30 0x7f5e000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:23.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.793+0000 7f5e21aba700 1 --2- 172.21.15.146:0/3421415153 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5e00066f30 0x7f5e000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:23.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.793+0000 7f5e127fc700 1 -- 172.21.15.146:0/3421415153 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 6231+0+0 (secure 0 0 0) 0x7f5e180849f0 con 0x7f5e1c1538c0 2023-10-06T11:20:23.798 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.794+0000 7f5e21aba700 1 --2- 172.21.15.146:0/3421415153 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5e00066f30 0x7f5e000693e0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c16d0d0 tx=0x7f5e0c007eb0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:23.799 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:23.797+0000 7f5e127fc700 1 -- 172.21.15.146:0/3421415153 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5e18051a50 con 0x7f5e1c1538c0 2023-10-06T11:20:24.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.022+0000 7f5e2451f700 1 -- 172.21.15.146:0/3421415153 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5e1c0cbaf0 con 0x7f5e1c1538c0 2023-10-06T11:20:24.024 INFO:tasks.ceph.mon.a.smithi146.stderr:2023-10-06T11:20:24.022+0000 7f011baa1700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T11:20:24.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.028+0000 7f5e127fc700 1 -- 172.21.15.146:0/3421415153 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v151) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5e18055070 con 0x7f5e1c1538c0 2023-10-06T11:20:24.030 INFO:tasks.ceph.mds.c.smithi146.stderr: -2541> 2023-10-06T11:19:16.806+0000 7f0d54b40700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T11:20:24.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.031+0000 7f5e2451f700 1 -- 172.21.15.146:0/3421415153 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5e00066f30 msgr2=0x7f5e000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:24.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.031+0000 7f5e2451f700 1 --2- 172.21.15.146:0/3421415153 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5e00066f30 0x7f5e000693e0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c16d0d0 tx=0x7f5e0c007eb0 comp rx=0 tx=0).stop 2023-10-06T11:20:24.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.031+0000 7f5e2451f700 1 -- 172.21.15.146:0/3421415153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e1c1538c0 msgr2=0x7f5e1c15c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:24.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.031+0000 7f5e2451f700 1 --2- 172.21.15.146:0/3421415153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e1c1538c0 0x7f5e1c15c6e0 secure :-1 s=READY pgs=2370 cs=0 l=1 rev1=1 crypto rx=0x7f5e1800ecb0 tx=0x7f5e180091a0 comp rx=0 tx=0).stop 2023-10-06T11:20:24.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.031+0000 7f5e2451f700 1 -- 172.21.15.146:0/3421415153 shutdown_connections 2023-10-06T11:20:24.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.031+0000 7f5e2451f700 1 --2- 172.21.15.146:0/3421415153 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5e00066f30 0x7f5e000693e0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:24.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.031+0000 7f5e2451f700 1 --2- 172.21.15.146:0/3421415153 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e1c15dcc0 0x7f5e1c0b33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:24.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.031+0000 7f5e2451f700 1 --2- 172.21.15.146:0/3421415153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5e1c1538c0 0x7f5e1c15c6e0 unknown :-1 s=CLOSED pgs=2370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:24.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.031+0000 7f5e2451f700 1 --2- 172.21.15.146:0/3421415153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e1c15a940 0x7f5e1c13f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:24.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.031+0000 7f5e2451f700 1 -- 172.21.15.146:0/3421415153 >> 172.21.15.146:0/3421415153 conn(0x7f5e1c06eb10 msgr2=0x7f5e1c152f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:24.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.031+0000 7f5e2451f700 1 -- 172.21.15.146:0/3421415153 shutdown_connections 2023-10-06T11:20:24.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.031+0000 7f5e2451f700 1 -- 172.21.15.146:0/3421415153 wait complete. 2023-10-06T11:20:24.034 INFO:teuthology.orchestra.run.smithi146.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T11:20:24.046 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T11:20:24.053 INFO:tasks.ceph.mds.c.smithi146.stdout:starting mds.c at 2023-10-06T11:20:24.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.160+0000 7fc05a5c0700 1 Processor -- start 2023-10-06T11:20:24.162 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.160+0000 7fc05a5c0700 1 -- start start 2023-10-06T11:20:24.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.161+0000 7fc05a5c0700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc0540b2f30 0x7fc054159c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:24.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.161+0000 7fc05a5c0700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc05406f260 0x7fc0540b0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:24.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.161+0000 7fc05a5c0700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0540cd3e0 con 0x7fc0540b2b60 2023-10-06T11:20:24.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.161+0000 7fc05a5c0700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc05415a140 con 0x7fc0540b2f30 2023-10-06T11:20:24.166 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.161+0000 7fc05a5c0700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc05415abc0 con 0x7fc05406f260 2023-10-06T11:20:24.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.161+0000 7fc053fff700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc0540b2b60 0x7fc0540cd870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49404/0 (socket says 172.21.15.146:49404) 2023-10-06T11:20:24.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.161+0000 7fc053fff700 1 -- 172.21.15.146:0/2164079807 learned_addr learned my addr 172.21.15.146:0/2164079807 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:20:24.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.162+0000 7fc0537fe700 1 --2- 172.21.15.146:0/2164079807 >> v2:172.21.15.151:3300/0 conn(0x7fc0540b2f30 0x7fc054159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:24.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.162+0000 7fc058b5d700 1 --2- 172.21.15.146:0/2164079807 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc05406f260 0x7fc0540b0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:24.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.162+0000 7fc052ffd700 1 -- 172.21.15.146:0/2164079807 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3878137534 0 0) 0x7fc0540cd3e0 con 0x7fc0540b2b60 2023-10-06T11:20:24.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.162+0000 7fc052ffd700 1 -- 172.21.15.146:0/2164079807 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc03c003570 con 0x7fc0540b2b60 2023-10-06T11:20:24.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.162+0000 7fc052ffd700 1 -- 172.21.15.146:0/2164079807 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3877593901 0 0) 0x7fc03c003570 con 0x7fc0540b2b60 2023-10-06T11:20:24.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.162+0000 7fc052ffd700 1 -- 172.21.15.146:0/2164079807 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc05406f260 msgr2=0x7fc0540b0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:24.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.162+0000 7fc052ffd700 1 --2- 172.21.15.146:0/2164079807 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc05406f260 0x7fc0540b0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:24.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.162+0000 7fc052ffd700 1 -- 172.21.15.146:0/2164079807 >> v2:172.21.15.151:3300/0 conn(0x7fc0540b2f30 msgr2=0x7fc054159c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:24.167 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.162+0000 7fc052ffd700 1 --2- 172.21.15.146:0/2164079807 >> v2:172.21.15.151:3300/0 conn(0x7fc0540b2f30 0x7fc054159c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:24.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.162+0000 7fc052ffd700 1 -- 172.21.15.146:0/2164079807 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc05406f6e0 con 0x7fc0540b2b60 2023-10-06T11:20:24.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.162+0000 7fc052ffd700 1 -- 172.21.15.146:0/2164079807 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fc044001470 con 0x7fc0540b2b60 2023-10-06T11:20:24.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.162+0000 7fc052ffd700 1 -- 172.21.15.146:0/2164079807 >> v1:172.21.15.146:6789/0 conn(0x7fc0540b2b60 legacy=0x7fc0540cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:24.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.162+0000 7fc052ffd700 1 --2- 172.21.15.146:0/2164079807 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc05406f260 0x7fc03c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:24.168 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.162+0000 7fc052ffd700 1 --2- 172.21.15.146:0/2164079807 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc03c003fe0 0x7fc03c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:24.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.162+0000 7fc052ffd700 1 --2- 172.21.15.146:0/2164079807 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc03c004d50 0x7fc03c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:24.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.162+0000 7fc052ffd700 1 -- 172.21.15.146:0/2164079807 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05415a140 con 0x7fc03c003fe0 2023-10-06T11:20:24.169 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.162+0000 7fc052ffd700 1 -- 172.21.15.146:0/2164079807 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05415abc0 con 0x7fc03c004d50 2023-10-06T11:20:24.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.162+0000 7fc052ffd700 1 -- 172.21.15.146:0/2164079807 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc03c00ba90 con 0x7fc05406f260 2023-10-06T11:20:24.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.162+0000 7fc0537fe700 1 --2- 172.21.15.146:0/2164079807 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc03c003fe0 0x7fc03c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:24.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.162+0000 7fc053fff700 1 --2- 172.21.15.146:0/2164079807 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc05406f260 0x7fc03c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:24.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.162+0000 7fc058b5d700 1 --2- 172.21.15.146:0/2164079807 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc03c004d50 0x7fc03c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:24.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.162+0000 7fc0537fe700 1 -- 172.21.15.146:0/2164079807 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc05406f260 msgr2=0x7fc03c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:24.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.162+0000 7fc0537fe700 1 --2- 172.21.15.146:0/2164079807 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc05406f260 0x7fc03c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:24.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.162+0000 7fc0537fe700 1 -- 172.21.15.146:0/2164079807 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc03c004d50 msgr2=0x7fc03c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:24.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.162+0000 7fc0537fe700 1 --2- 172.21.15.146:0/2164079807 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc03c004d50 0x7fc03c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:24.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.162+0000 7fc0537fe700 1 -- 172.21.15.146:0/2164079807 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc03c003570 con 0x7fc03c003fe0 2023-10-06T11:20:24.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.162+0000 7fc058b5d700 1 --2- 172.21.15.146:0/2164079807 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc03c004d50 0x7fc03c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:20:24.170 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.162+0000 7fc0537fe700 1 --2- 172.21.15.146:0/2164079807 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc03c003fe0 0x7fc03c004810 secure :-1 s=READY pgs=2375 cs=0 l=1 rev1=1 crypto rx=0x7fc048009c00 tx=0x7fc0480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5f0e882dea20d47 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:24.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.163+0000 7fc052ffd700 1 -- 172.21.15.146:0/2164079807 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04800e6b0 con 0x7fc03c003fe0 2023-10-06T11:20:24.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.163+0000 7fc052ffd700 1 -- 172.21.15.146:0/2164079807 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc04800e810 con 0x7fc03c003fe0 2023-10-06T11:20:24.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.163+0000 7fc052ffd700 1 -- 172.21.15.146:0/2164079807 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04800ebd0 con 0x7fc03c003fe0 2023-10-06T11:20:24.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.163+0000 7fc05a5c0700 1 -- 172.21.15.146:0/2164079807 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc03c003fe0 msgr2=0x7fc03c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:24.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.163+0000 7fc05a5c0700 1 --2- 172.21.15.146:0/2164079807 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc03c003fe0 0x7fc03c004810 secure :-1 s=READY pgs=2375 cs=0 l=1 rev1=1 crypto rx=0x7fc048009c00 tx=0x7fc0480091a0 comp rx=0 tx=0).stop 2023-10-06T11:20:24.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.163+0000 7fc058b5d700 1 -- 172.21.15.146:0/2164079807 reap_dead start 2023-10-06T11:20:24.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.163+0000 7fc05a5c0700 1 -- 172.21.15.146:0/2164079807 shutdown_connections 2023-10-06T11:20:24.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.163+0000 7fc05a5c0700 1 -- 172.21.15.146:0/2164079807 >> 172.21.15.146:0/2164079807 conn(0x7fc05406a4d0 msgr2=0x7fc05406a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:24.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.163+0000 7fc05a5c0700 1 -- 172.21.15.146:0/2164079807 shutdown_connections 2023-10-06T11:20:24.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.163+0000 7fc05a5c0700 1 -- 172.21.15.146:0/2164079807 wait complete. 2023-10-06T11:20:24.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.164+0000 7fc05a5c0700 1 Processor -- start 2023-10-06T11:20:24.171 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.164+0000 7fc05a5c0700 1 -- start start 2023-10-06T11:20:24.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.165+0000 7fc05a5c0700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc03c003fe0 0x7fc05416a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:24.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.165+0000 7fc05a5c0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc054155b80 0x7fc054150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:24.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.165+0000 7fc05a5c0700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc054151400 0x7fc0540c2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:24.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.165+0000 7fc05a5c0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc054157fb0 con 0x7fc054155b80 2023-10-06T11:20:24.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.165+0000 7fc05a5c0700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc054156c70 con 0x7fc054151400 2023-10-06T11:20:24.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.165+0000 7fc05a5c0700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc054156060 con 0x7fc03c003fe0 2023-10-06T11:20:24.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.165+0000 7fc0537fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc054155b80 0x7fc054150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:24.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.165+0000 7fc0537fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc054155b80 0x7fc054150ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45178/0 (socket says 172.21.15.146:45178) 2023-10-06T11:20:24.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.165+0000 7fc0537fe700 1 -- 172.21.15.146:0/1052096247 learned_addr learned my addr 172.21.15.146:0/1052096247 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:24.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.165+0000 7fc058b5d700 1 --2- 172.21.15.146:0/1052096247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc054151400 0x7fc0540c2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:24.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.165+0000 7fc053fff700 1 --2- 172.21.15.146:0/1052096247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc03c003fe0 0x7fc05416a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:24.175 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.165+0000 7fc0537fe700 1 -- 172.21.15.146:0/1052096247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc03c003fe0 msgr2=0x7fc05416a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:24.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.165+0000 7fc0537fe700 1 --2- 172.21.15.146:0/1052096247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc03c003fe0 0x7fc05416a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:24.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.165+0000 7fc0537fe700 1 -- 172.21.15.146:0/1052096247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc054151400 msgr2=0x7fc0540c2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:24.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.165+0000 7fc0537fe700 1 --2- 172.21.15.146:0/1052096247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc054151400 0x7fc0540c2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:24.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.165+0000 7fc0537fe700 1 -- 172.21.15.146:0/1052096247 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc054156340 con 0x7fc054155b80 2023-10-06T11:20:24.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.165+0000 7fc058b5d700 1 --2- 172.21.15.146:0/1052096247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc054151400 0x7fc0540c2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:20:24.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.166+0000 7fc0537fe700 1 --2- 172.21.15.146:0/1052096247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc054155b80 0x7fc054150ec0 secure :-1 s=READY pgs=2376 cs=0 l=1 rev1=1 crypto rx=0x7fc03c004730 tx=0x7fc04801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:24.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.166+0000 7fc03bfff700 1 -- 172.21.15.146:0/1052096247 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc048022070 con 0x7fc054155b80 2023-10-06T11:20:24.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.166+0000 7fc03bfff700 1 -- 172.21.15.146:0/1052096247 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc04800e980 con 0x7fc054155b80 2023-10-06T11:20:24.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.166+0000 7fc05a5c0700 1 -- 172.21.15.146:0/1052096247 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc054156620 con 0x7fc054155b80 2023-10-06T11:20:24.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.166+0000 7fc03bfff700 1 -- 172.21.15.146:0/1052096247 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc048027470 con 0x7fc054155b80 2023-10-06T11:20:24.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.166+0000 7fc05a5c0700 1 -- 172.21.15.146:0/1052096247 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc05416a970 con 0x7fc054155b80 2023-10-06T11:20:24.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.167+0000 7fc05a5c0700 1 -- 172.21.15.146:0/1052096247 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc054156e20 con 0x7fc054155b80 2023-10-06T11:20:24.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.167+0000 7fc03bfff700 1 -- 172.21.15.146:0/1052096247 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc04801c450 con 0x7fc054155b80 2023-10-06T11:20:24.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.168+0000 7fc03bfff700 1 --2- 172.21.15.146:0/1052096247 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc040066f30 0x7fc0400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:24.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.168+0000 7fc053fff700 1 --2- 172.21.15.146:0/1052096247 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc040066f30 0x7fc0400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:24.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.168+0000 7fc03bfff700 1 -- 172.21.15.146:0/1052096247 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6317+0+0 (secure 0 0 0) 0x7fc0480863f0 con 0x7fc054155b80 2023-10-06T11:20:24.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.168+0000 7fc053fff700 1 --2- 172.21.15.146:0/1052096247 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc040066f30 0x7fc0400693e0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fc044000e10 tx=0x7fc044009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:24.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.172+0000 7fc03bfff700 1 -- 172.21.15.146:0/1052096247 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc054156e20 con 0x7fc054155b80 2023-10-06T11:20:24.403 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:24.402+0000 7fc05a5c0700 1 -- 172.21.15.146:0/1052096247 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc054156de0 con 0x7fc054155b80 2023-10-06T11:20:25.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.029+0000 7fc03bfff700 1 -- 172.21.15.146:0/1052096247 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v152) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc048053440 con 0x7fc054155b80 2023-10-06T11:20:25.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.031+0000 7fc05a5c0700 1 -- 172.21.15.146:0/1052096247 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc040066f30 msgr2=0x7fc0400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:25.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.031+0000 7fc05a5c0700 1 --2- 172.21.15.146:0/1052096247 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc040066f30 0x7fc0400693e0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fc044000e10 tx=0x7fc044009040 comp rx=0 tx=0).stop 2023-10-06T11:20:25.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.031+0000 7fc05a5c0700 1 -- 172.21.15.146:0/1052096247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc054155b80 msgr2=0x7fc054150ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:25.033 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.031+0000 7fc05a5c0700 1 --2- 172.21.15.146:0/1052096247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc054155b80 0x7fc054150ec0 secure :-1 s=READY pgs=2376 cs=0 l=1 rev1=1 crypto rx=0x7fc03c004730 tx=0x7fc04801a000 comp rx=0 tx=0).stop 2023-10-06T11:20:25.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.031+0000 7fc05a5c0700 1 -- 172.21.15.146:0/1052096247 shutdown_connections 2023-10-06T11:20:25.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.031+0000 7fc05a5c0700 1 --2- 172.21.15.146:0/1052096247 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc040066f30 0x7fc0400693e0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:25.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.031+0000 7fc05a5c0700 1 --2- 172.21.15.146:0/1052096247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc054151400 0x7fc0540c2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:25.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.031+0000 7fc05a5c0700 1 --2- 172.21.15.146:0/1052096247 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc03c003fe0 0x7fc05416a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:25.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.031+0000 7fc05a5c0700 1 --2- 172.21.15.146:0/1052096247 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc054155b80 0x7fc054150ec0 unknown :-1 s=CLOSED pgs=2376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:25.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.031+0000 7fc05a5c0700 1 -- 172.21.15.146:0/1052096247 >> 172.21.15.146:0/1052096247 conn(0x7fc05406a4d0 msgr2=0x7fc0540af670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:25.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.032+0000 7fc05a5c0700 1 -- 172.21.15.146:0/1052096247 shutdown_connections 2023-10-06T11:20:25.034 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.032+0000 7fc05a5c0700 1 -- 172.21.15.146:0/1052096247 wait complete. 2023-10-06T11:20:25.047 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T11:20:25.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.205+0000 7f9ed202c700 1 Processor -- start 2023-10-06T11:20:25.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.205+0000 7f9ed202c700 1 -- start start 2023-10-06T11:20:25.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.206+0000 7f9ed202c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9ecc0b29f0 0x7f9ecc0cb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:25.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.206+0000 7f9ed202c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ecc0c64a0 0x7f9ecc163230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:25.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.206+0000 7f9ed202c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ecc0cfef0 con 0x7f9ecc0cbb50 2023-10-06T11:20:25.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.206+0000 7f9ed202c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ecc0cbff0 con 0x7f9ecc0b29f0 2023-10-06T11:20:25.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.206+0000 7f9ed202c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc0cf2e0 con 0x7f9ecc0c64a0 2023-10-06T11:20:25.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.206+0000 7f9ed102a700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f9ecc0b29f0 0x7f9ecc0cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:25.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.206+0000 7f9ed0829700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f9ecc0cbb50 0x7f9ecc0ccd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49414/0 (socket says 172.21.15.146:49414) 2023-10-06T11:20:25.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.206+0000 7f9ed0829700 1 -- 172.21.15.146:0/1352902835 learned_addr learned my addr 172.21.15.146:0/1352902835 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:20:25.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.206+0000 7f9ed182b700 1 --2- 172.21.15.146:0/1352902835 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ecc0c64a0 0x7f9ecc163230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:25.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.206+0000 7f9ed102a700 1 -- 172.21.15.146:0/1352902835 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ecc0c64a0 msgr2=0x7f9ecc163230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:25.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.206+0000 7f9ed102a700 1 --2- 172.21.15.146:0/1352902835 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ecc0c64a0 0x7f9ecc163230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:25.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.206+0000 7f9ed102a700 1 -- 172.21.15.146:0/1352902835 >> v1:172.21.15.146:6789/0 conn(0x7f9ecc0cbb50 legacy=0x7f9ecc0ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:25.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.206+0000 7f9ed102a700 1 -- 172.21.15.146:0/1352902835 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ecc0cf5c0 con 0x7f9ecc0b29f0 2023-10-06T11:20:25.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.206+0000 7f9ec3fff700 1 -- 172.21.15.146:0/1352902835 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 939187185 0 0) 0x7f9ecc0cfef0 con 0x7f9ecc0cbb50 2023-10-06T11:20:25.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.206+0000 7f9ed102a700 1 --2- 172.21.15.146:0/1352902835 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ecc0b29f0 0x7f9ecc0cb610 secure :-1 s=READY pgs=2378 cs=0 l=1 rev1=1 crypto rx=0x7f9ec40098e0 tx=0x7f9ec40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e5f9ae3b3e5d2b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:25.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.206+0000 7f9ec3fff700 1 -- 172.21.15.146:0/1352902835 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec4009e80 con 0x7f9ecc0b29f0 2023-10-06T11:20:25.211 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.207+0000 7f9ec3fff700 1 -- 172.21.15.146:0/1352902835 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec400b860 con 0x7f9ecc0b29f0 2023-10-06T11:20:25.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.207+0000 7f9ec3fff700 1 -- 172.21.15.146:0/1352902835 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec400bbe0 con 0x7f9ecc0b29f0 2023-10-06T11:20:25.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.207+0000 7f9ed202c700 1 -- 172.21.15.146:0/1352902835 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ecc0b29f0 msgr2=0x7f9ecc0cb610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:25.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.207+0000 7f9ed202c700 1 --2- 172.21.15.146:0/1352902835 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ecc0b29f0 0x7f9ecc0cb610 secure :-1 s=READY pgs=2378 cs=0 l=1 rev1=1 crypto rx=0x7f9ec40098e0 tx=0x7f9ec40091a0 comp rx=0 tx=0).stop 2023-10-06T11:20:25.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.207+0000 7f9ed202c700 1 -- 172.21.15.146:0/1352902835 shutdown_connections 2023-10-06T11:20:25.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.207+0000 7f9ed202c700 1 --2- 172.21.15.146:0/1352902835 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ecc0c64a0 0x7f9ecc163230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:25.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.207+0000 7f9ed202c700 1 --2- 172.21.15.146:0/1352902835 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ecc0b29f0 0x7f9ecc0cb610 unknown :-1 s=CLOSED pgs=2378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:25.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.207+0000 7f9ed202c700 1 -- 172.21.15.146:0/1352902835 >> 172.21.15.146:0/1352902835 conn(0x7f9ecc0997f0 msgr2=0x7f9ecc06f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:25.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.207+0000 7f9ed202c700 1 -- 172.21.15.146:0/1352902835 shutdown_connections 2023-10-06T11:20:25.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.207+0000 7f9ed202c700 1 -- 172.21.15.146:0/1352902835 wait complete. 2023-10-06T11:20:25.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.208+0000 7f9ed202c700 1 Processor -- start 2023-10-06T11:20:25.212 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.208+0000 7f9ed202c700 1 -- start start 2023-10-06T11:20:25.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.209+0000 7f9ed202c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ecc0b29f0 0x7f9ecc09ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:25.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.209+0000 7f9ed202c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ecc0c64a0 0x7f9ecc1568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:25.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.209+0000 7f9ed202c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ecc0cbb50 0x7f9ecc0b5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:25.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.209+0000 7f9ed202c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc09c890 con 0x7f9ecc0b29f0 2023-10-06T11:20:25.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.209+0000 7f9ed202c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc09b060 con 0x7f9ecc0c64a0 2023-10-06T11:20:25.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.209+0000 7f9ed202c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ecc09bc80 con 0x7f9ecc0cbb50 2023-10-06T11:20:25.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.209+0000 7f9ed102a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ecc0b29f0 0x7f9ecc09ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:25.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.209+0000 7f9ed102a700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ecc0b29f0 0x7f9ecc09ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45186/0 (socket says 172.21.15.146:45186) 2023-10-06T11:20:25.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.209+0000 7f9ed102a700 1 -- 172.21.15.146:0/4209657155 learned_addr learned my addr 172.21.15.146:0/4209657155 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:25.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.209+0000 7f9ed182b700 1 --2- 172.21.15.146:0/4209657155 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ecc0cbb50 0x7f9ecc0b5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:25.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.209+0000 7f9ed102a700 1 -- 172.21.15.146:0/4209657155 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ecc0cbb50 msgr2=0x7f9ecc0b5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:25.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.209+0000 7f9ed102a700 1 --2- 172.21.15.146:0/4209657155 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ecc0cbb50 0x7f9ecc0b5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:25.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.209+0000 7f9ed102a700 1 -- 172.21.15.146:0/4209657155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ecc0c64a0 msgr2=0x7f9ecc1568b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:25.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.209+0000 7f9ed0829700 1 --2- 172.21.15.146:0/4209657155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ecc0c64a0 0x7f9ecc1568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:25.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.210+0000 7f9ed102a700 1 --2- 172.21.15.146:0/4209657155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ecc0c64a0 0x7f9ecc1568b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:25.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.210+0000 7f9ed102a700 1 -- 172.21.15.146:0/4209657155 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec4009420 con 0x7f9ecc0b29f0 2023-10-06T11:20:25.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.210+0000 7f9ed0829700 1 --2- 172.21.15.146:0/4209657155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ecc0c64a0 0x7f9ecc1568b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:20:25.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.210+0000 7f9ed102a700 1 --2- 172.21.15.146:0/4209657155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ecc0b29f0 0x7f9ecc09ab20 secure :-1 s=READY pgs=2379 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc0889c0 tx=0x7f9ec4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:25.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.210+0000 7f9ec17fa700 1 -- 172.21.15.146:0/4209657155 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec400bbe0 con 0x7f9ecc0b29f0 2023-10-06T11:20:25.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.210+0000 7f9ec17fa700 1 -- 172.21.15.146:0/4209657155 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec4011420 con 0x7f9ecc0b29f0 2023-10-06T11:20:25.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.210+0000 7f9ed202c700 1 -- 172.21.15.146:0/4209657155 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ecc09bf60 con 0x7f9ecc0b29f0 2023-10-06T11:20:25.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.210+0000 7f9ec17fa700 1 -- 172.21.15.146:0/4209657155 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec40117c0 con 0x7f9ecc0b29f0 2023-10-06T11:20:25.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.210+0000 7f9ed202c700 1 -- 172.21.15.146:0/4209657155 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ecc09c520 con 0x7f9ecc0b29f0 2023-10-06T11:20:25.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.211+0000 7f9ed202c700 1 -- 172.21.15.146:0/4209657155 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ecc06a400 con 0x7f9ecc0b29f0 2023-10-06T11:20:25.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.211+0000 7f9ec17fa700 1 -- 172.21.15.146:0/4209657155 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9ec4011bb0 con 0x7f9ecc0b29f0 2023-10-06T11:20:25.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.212+0000 7f9ec17fa700 1 --2- 172.21.15.146:0/4209657155 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9eb0066f30 0x7f9eb00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:25.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.212+0000 7f9ed0829700 1 --2- 172.21.15.146:0/4209657155 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9eb0066f30 0x7f9eb00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:25.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.212+0000 7f9ec17fa700 1 -- 172.21.15.146:0/4209657155 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 6317+0+0 (secure 0 0 0) 0x7f9ec4086150 con 0x7f9ecc0b29f0 2023-10-06T11:20:25.217 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.212+0000 7f9ed0829700 1 --2- 172.21.15.146:0/4209657155 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9eb0066f30 0x7f9eb00693e0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc15e980 tx=0x7f9ebc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:25.218 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.216+0000 7f9ec17fa700 1 -- 172.21.15.146:0/4209657155 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ec4053160 con 0x7f9ecc0b29f0 2023-10-06T11:20:25.402 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:25.400+0000 7f9ed202c700 1 -- 172.21.15.146:0/4209657155 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9ecc0b2250 con 0x7f9ecc0b29f0 2023-10-06T11:20:26.037 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.035+0000 7f9ec17fa700 1 -- 172.21.15.146:0/4209657155 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v182) v1 ==== 181+0+0 (secure 0 0 0) 0x7f9ec4011e60 con 0x7f9ecc0b29f0 2023-10-06T11:20:26.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.038+0000 7f9ed202c700 1 -- 172.21.15.146:0/4209657155 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9eb0066f30 msgr2=0x7f9eb00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:26.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.038+0000 7f9ed202c700 1 --2- 172.21.15.146:0/4209657155 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9eb0066f30 0x7f9eb00693e0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc15e980 tx=0x7f9ebc009040 comp rx=0 tx=0).stop 2023-10-06T11:20:26.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.038+0000 7f9ed202c700 1 -- 172.21.15.146:0/4209657155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ecc0b29f0 msgr2=0x7f9ecc09ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:26.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.038+0000 7f9ed202c700 1 --2- 172.21.15.146:0/4209657155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ecc0b29f0 0x7f9ecc09ab20 secure :-1 s=READY pgs=2379 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc0889c0 tx=0x7f9ec4017000 comp rx=0 tx=0).stop 2023-10-06T11:20:26.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.038+0000 7f9ed202c700 1 -- 172.21.15.146:0/4209657155 shutdown_connections 2023-10-06T11:20:26.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.038+0000 7f9ed202c700 1 --2- 172.21.15.146:0/4209657155 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9eb0066f30 0x7f9eb00693e0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:26.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.038+0000 7f9ed202c700 1 --2- 172.21.15.146:0/4209657155 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ecc0cbb50 0x7f9ecc0b5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:26.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.038+0000 7f9ed202c700 1 --2- 172.21.15.146:0/4209657155 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f9ecc0b29f0 0x7f9ecc09ab20 unknown :-1 s=CLOSED pgs=2379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:26.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.038+0000 7f9ed202c700 1 --2- 172.21.15.146:0/4209657155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ecc0c64a0 0x7f9ecc1568b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:26.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.038+0000 7f9ed202c700 1 -- 172.21.15.146:0/4209657155 >> 172.21.15.146:0/4209657155 conn(0x7f9ecc0997f0 msgr2=0x7f9ecc068f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:26.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.038+0000 7f9ed202c700 1 -- 172.21.15.146:0/4209657155 shutdown_connections 2023-10-06T11:20:26.041 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.038+0000 7f9ed202c700 1 -- 172.21.15.146:0/4209657155 wait complete. 2023-10-06T11:20:26.042 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_metadata' removed 2023-10-06T11:20:26.056 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T11:20:26.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.176+0000 7f2496e05700 1 Processor -- start 2023-10-06T11:20:26.179 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.177+0000 7f2496e05700 1 -- start start 2023-10-06T11:20:26.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.177+0000 7f2496e05700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f24900ca660 0x7f24900c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:26.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.177+0000 7f2496e05700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f249006be50 0x7f2490069870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:26.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.177+0000 7f2496e05700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24900693e0 con 0x7f249015dcf0 2023-10-06T11:20:26.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.177+0000 7f2496e05700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2490159b40 con 0x7f24900ca660 2023-10-06T11:20:26.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.177+0000 7f2496e05700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24900684f0 con 0x7f249006be50 2023-10-06T11:20:26.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.178+0000 7f24953a2700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f249006be50 0x7f2490069870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:26.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.178+0000 7f2494ba1700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f24900ca660 0x7f24900c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:26.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.178+0000 7f2487fff700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f249015dcf0 0x7f249006b740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:48906/0 (socket says 172.21.15.146:48906) 2023-10-06T11:20:26.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.178+0000 7f2487fff700 1 -- 172.21.15.146:0/50269583 learned_addr learned my addr 172.21.15.146:0/50269583 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:20:26.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.178+0000 7f24953a2700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f249006be50 0x7f2490069870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:50846/0 (socket says 172.21.15.146:50846) 2023-10-06T11:20:26.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.178+0000 7f2494ba1700 1 --2- 172.21.15.146:0/50269583 >> v2:172.21.15.151:3300/0 conn(0x7f24900ca660 0x7f24900c8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:52924/0 (socket says 172.21.15.146:52924) 2023-10-06T11:20:26.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.178+0000 7f24953a2700 1 -- 172.21.15.146:0/50269583 >> v2:172.21.15.151:3300/0 conn(0x7f24900ca660 msgr2=0x7f24900c8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:26.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.178+0000 7f24953a2700 1 --2- 172.21.15.146:0/50269583 >> v2:172.21.15.151:3300/0 conn(0x7f24900ca660 0x7f24900c8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:26.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.178+0000 7f24953a2700 1 -- 172.21.15.146:0/50269583 >> v1:172.21.15.151:6789/0 conn(0x7f249015dcf0 legacy=0x7f249006b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:26.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.178+0000 7f24953a2700 1 -- 172.21.15.146:0/50269583 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24900687d0 con 0x7f249006be50 2023-10-06T11:20:26.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.178+0000 7f2494ba1700 1 --2- 172.21.15.146:0/50269583 >> v2:172.21.15.151:3300/0 conn(0x7f24900ca660 0x7f24900c8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:20:26.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.178+0000 7f24953a2700 1 --2- 172.21.15.146:0/50269583 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f249006be50 0x7f2490069870 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f24880098e0 tx=0x7f24880091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bdb6e0116b951a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:26.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.178+0000 7f24877fe700 1 -- 172.21.15.146:0/50269583 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248800b640 con 0x7f249006be50 2023-10-06T11:20:26.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.178+0000 7f24877fe700 1 -- 172.21.15.146:0/50269583 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f248800b7a0 con 0x7f249006be50 2023-10-06T11:20:26.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.178+0000 7f24877fe700 1 -- 172.21.15.146:0/50269583 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248800bb40 con 0x7f249006be50 2023-10-06T11:20:26.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.179+0000 7f2496e05700 1 -- 172.21.15.146:0/50269583 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f249006be50 msgr2=0x7f2490069870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:26.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.179+0000 7f2496e05700 1 --2- 172.21.15.146:0/50269583 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f249006be50 0x7f2490069870 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f24880098e0 tx=0x7f24880091a0 comp rx=0 tx=0).stop 2023-10-06T11:20:26.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.179+0000 7f2496e05700 1 -- 172.21.15.146:0/50269583 shutdown_connections 2023-10-06T11:20:26.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.179+0000 7f2496e05700 1 --2- 172.21.15.146:0/50269583 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f249006be50 0x7f2490069870 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:26.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.179+0000 7f2496e05700 1 --2- 172.21.15.146:0/50269583 >> v2:172.21.15.151:3300/0 conn(0x7f24900ca660 0x7f24900c8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:26.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.179+0000 7f2496e05700 1 -- 172.21.15.146:0/50269583 >> 172.21.15.146:0/50269583 conn(0x7f2490067eb0 msgr2=0x7f24900ce450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:26.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.179+0000 7f2496e05700 1 -- 172.21.15.146:0/50269583 shutdown_connections 2023-10-06T11:20:26.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.179+0000 7f2496e05700 1 -- 172.21.15.146:0/50269583 wait complete. 2023-10-06T11:20:26.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.180+0000 7f2496e05700 1 Processor -- start 2023-10-06T11:20:26.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.180+0000 7f2496e05700 1 -- start start 2023-10-06T11:20:26.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.181+0000 7f2496e05700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f249006be50 0x7f249015bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:26.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.181+0000 7f2496e05700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24900ca660 0x7f249015c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:26.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.181+0000 7f2496e05700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f249015dcf0 0x7f249016d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:26.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.181+0000 7f2496e05700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2490146a80 con 0x7f249015dcf0 2023-10-06T11:20:26.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.181+0000 7f2496e05700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249016ad90 con 0x7f24900ca660 2023-10-06T11:20:26.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.181+0000 7f2496e05700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f249016b350 con 0x7f249006be50 2023-10-06T11:20:26.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.181+0000 7f24953a2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f249015dcf0 0x7f249016d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:26.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.181+0000 7f24953a2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f249015dcf0 0x7f249016d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45194/0 (socket says 172.21.15.146:45194) 2023-10-06T11:20:26.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.181+0000 7f24953a2700 1 -- 172.21.15.146:0/1366778381 learned_addr learned my addr 172.21.15.146:0/1366778381 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:26.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.181+0000 7f2487fff700 1 --2- 172.21.15.146:0/1366778381 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24900ca660 0x7f249015c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:26.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.181+0000 7f2494ba1700 1 --2- 172.21.15.146:0/1366778381 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f249006be50 0x7f249015bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:26.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.181+0000 7f24953a2700 1 -- 172.21.15.146:0/1366778381 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f249006be50 msgr2=0x7f249015bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:26.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.181+0000 7f24953a2700 1 --2- 172.21.15.146:0/1366778381 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f249006be50 0x7f249015bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:26.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.181+0000 7f24953a2700 1 -- 172.21.15.146:0/1366778381 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24900ca660 msgr2=0x7f249015c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:26.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.181+0000 7f24953a2700 1 --2- 172.21.15.146:0/1366778381 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24900ca660 0x7f249015c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:26.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.181+0000 7f24953a2700 1 -- 172.21.15.146:0/1366778381 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f248c009a20 con 0x7f249015dcf0 2023-10-06T11:20:26.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.181+0000 7f2487fff700 1 --2- 172.21.15.146:0/1366778381 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24900ca660 0x7f249015c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:20:26.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.182+0000 7f24953a2700 1 --2- 172.21.15.146:0/1366778381 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f249015dcf0 0x7f249016d1c0 secure :-1 s=READY pgs=2380 cs=0 l=1 rev1=1 crypto rx=0x7f2490068630 tx=0x7f2488017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:26.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.182+0000 7f2484ff9700 1 -- 172.21.15.146:0/1366778381 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f248801be00 con 0x7f249015dcf0 2023-10-06T11:20:26.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.182+0000 7f2484ff9700 1 -- 172.21.15.146:0/1366778381 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2488011630 con 0x7f249015dcf0 2023-10-06T11:20:26.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.182+0000 7f2496e05700 1 -- 172.21.15.146:0/1366778381 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2488009420 con 0x7f249015dcf0 2023-10-06T11:20:26.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.182+0000 7f2484ff9700 1 -- 172.21.15.146:0/1366778381 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24880119f0 con 0x7f249015dcf0 2023-10-06T11:20:26.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.182+0000 7f2496e05700 1 -- 172.21.15.146:0/1366778381 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f249015c7d0 con 0x7f249015dcf0 2023-10-06T11:20:26.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.183+0000 7f2496e05700 1 -- 172.21.15.146:0/1366778381 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f249004c380 con 0x7f249015dcf0 2023-10-06T11:20:26.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.183+0000 7f2484ff9700 1 -- 172.21.15.146:0/1366778381 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f248802e440 con 0x7f249015dcf0 2023-10-06T11:20:26.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.184+0000 7f2484ff9700 1 --2- 172.21.15.146:0/1366778381 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f247c066f30 0x7f247c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:26.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.184+0000 7f2494ba1700 1 --2- 172.21.15.146:0/1366778381 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f247c066f30 0x7f247c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:26.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.184+0000 7f2484ff9700 1 -- 172.21.15.146:0/1366778381 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 5879+0+0 (secure 0 0 0) 0x7f2488086300 con 0x7f249015dcf0 2023-10-06T11:20:26.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.184+0000 7f2494ba1700 1 --2- 172.21.15.146:0/1366778381 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f247c066f30 0x7f247c0693e0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f248c0099f0 tx=0x7f248c00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:26.190 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.188+0000 7f2484ff9700 1 -- 172.21.15.146:0/1366778381 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f24880534c0 con 0x7f249015dcf0 2023-10-06T11:20:26.380 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:26.378+0000 7f2496e05700 1 -- 172.21.15.146:0/1366778381 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2490068ab0 con 0x7f249015dcf0 2023-10-06T11:20:27.048 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.046+0000 7f2484ff9700 1 -- 172.21.15.146:0/1366778381 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v183) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2488056ae0 con 0x7f249015dcf0 2023-10-06T11:20:27.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.049+0000 7f2496e05700 1 -- 172.21.15.146:0/1366778381 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f247c066f30 msgr2=0x7f247c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:27.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.049+0000 7f2496e05700 1 --2- 172.21.15.146:0/1366778381 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f247c066f30 0x7f247c0693e0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f248c0099f0 tx=0x7f248c00b040 comp rx=0 tx=0).stop 2023-10-06T11:20:27.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.049+0000 7f2496e05700 1 -- 172.21.15.146:0/1366778381 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f249015dcf0 msgr2=0x7f249016d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:27.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.049+0000 7f2496e05700 1 --2- 172.21.15.146:0/1366778381 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f249015dcf0 0x7f249016d1c0 secure :-1 s=READY pgs=2380 cs=0 l=1 rev1=1 crypto rx=0x7f2490068630 tx=0x7f2488017000 comp rx=0 tx=0).stop 2023-10-06T11:20:27.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.049+0000 7f2496e05700 1 -- 172.21.15.146:0/1366778381 shutdown_connections 2023-10-06T11:20:27.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.049+0000 7f2496e05700 1 --2- 172.21.15.146:0/1366778381 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f247c066f30 0x7f247c0693e0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:27.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.049+0000 7f2496e05700 1 --2- 172.21.15.146:0/1366778381 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f249015dcf0 0x7f249016d1c0 unknown :-1 s=CLOSED pgs=2380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:27.051 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.049+0000 7f2496e05700 1 --2- 172.21.15.146:0/1366778381 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f249006be50 0x7f249015bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:27.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.049+0000 7f2496e05700 1 --2- 172.21.15.146:0/1366778381 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24900ca660 0x7f249015c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:27.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.049+0000 7f2496e05700 1 -- 172.21.15.146:0/1366778381 >> 172.21.15.146:0/1366778381 conn(0x7f2490067eb0 msgr2=0x7f249006cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:27.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.049+0000 7f2496e05700 1 -- 172.21.15.146:0/1366778381 shutdown_connections 2023-10-06T11:20:27.052 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.049+0000 7f2496e05700 1 -- 172.21.15.146:0/1366778381 wait complete. 2023-10-06T11:20:27.052 INFO:teuthology.orchestra.run.smithi146.stderr:pool 'cephfs_data' removed 2023-10-06T11:20:27.064 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mds mds_hack_allow_loading_invalid_metadata 2023-10-06T11:20:27.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.183+0000 7f116a80c700 1 Processor -- start 2023-10-06T11:20:27.185 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.183+0000 7f116a80c700 1 -- start start 2023-10-06T11:20:27.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.183+0000 7f116a80c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1164159450 0x7f1164159820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:27.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.184+0000 7f116a80c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f116415dd70 0x7f11640b0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:27.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.184+0000 7f116a80c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f11640b0760 0x7f11640aef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:27.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.184+0000 7f116a80c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11640b2f20 con 0x7f11640b0760 2023-10-06T11:20:27.187 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.184+0000 7f116a80c700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11640b0bc0 con 0x7f1164159450 2023-10-06T11:20:27.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.184+0000 7f116a80c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11640cb8a0 con 0x7f116415dd70 2023-10-06T11:20:27.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.184+0000 7f1168da9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f11640b0760 0x7f11640aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:27.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.184+0000 7f1168da9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f11640b0760 0x7f11640aef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45204/0 (socket says 172.21.15.146:45204) 2023-10-06T11:20:27.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.184+0000 7f1168da9700 1 -- 172.21.15.146:0/3130475316 learned_addr learned my addr 172.21.15.146:0/3130475316 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:27.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.184+0000 7f11637fe700 1 --2- 172.21.15.146:0/3130475316 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f116415dd70 0x7f11640b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:27.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.184+0000 7f1163fff700 1 --2- 172.21.15.146:0/3130475316 >> v2:172.21.15.151:3300/0 conn(0x7f1164159450 0x7f1164159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:27.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.184+0000 7f1168da9700 1 -- 172.21.15.146:0/3130475316 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f116415dd70 msgr2=0x7f11640b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:27.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.184+0000 7f1168da9700 1 --2- 172.21.15.146:0/3130475316 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f116415dd70 0x7f11640b0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:27.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.184+0000 7f1168da9700 1 -- 172.21.15.146:0/3130475316 >> v2:172.21.15.151:3300/0 conn(0x7f1164159450 msgr2=0x7f1164159820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:27.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.184+0000 7f1168da9700 1 --2- 172.21.15.146:0/3130475316 >> v2:172.21.15.151:3300/0 conn(0x7f1164159450 0x7f1164159820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:27.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.184+0000 7f1168da9700 1 -- 172.21.15.146:0/3130475316 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11640b2960 con 0x7f11640b0760 2023-10-06T11:20:27.188 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.184+0000 7f1168da9700 1 --2- 172.21.15.146:0/3130475316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11640b0760 0x7f11640aef90 secure :-1 s=READY pgs=2381 cs=0 l=1 rev1=1 crypto rx=0x7f11640ce120 tx=0x7f115c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72cdd2bf8258a7dc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:27.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.184+0000 7f1162ffd700 1 -- 172.21.15.146:0/3130475316 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c00e070 con 0x7f11640b0760 2023-10-06T11:20:27.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.184+0000 7f1162ffd700 1 -- 172.21.15.146:0/3130475316 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f115c00ba50 con 0x7f11640b0760 2023-10-06T11:20:27.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.184+0000 7f1162ffd700 1 -- 172.21.15.146:0/3130475316 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c0092e0 con 0x7f11640b0760 2023-10-06T11:20:27.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.185+0000 7f116a80c700 1 -- 172.21.15.146:0/3130475316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11640b0760 msgr2=0x7f11640aef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:27.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.185+0000 7f116a80c700 1 --2- 172.21.15.146:0/3130475316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11640b0760 0x7f11640aef90 secure :-1 s=READY pgs=2381 cs=0 l=1 rev1=1 crypto rx=0x7f11640ce120 tx=0x7f115c009840 comp rx=0 tx=0).stop 2023-10-06T11:20:27.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.185+0000 7f116a80c700 1 -- 172.21.15.146:0/3130475316 shutdown_connections 2023-10-06T11:20:27.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.185+0000 7f116a80c700 1 --2- 172.21.15.146:0/3130475316 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11640b0760 0x7f11640aef90 unknown :-1 s=CLOSED pgs=2381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:27.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.185+0000 7f116a80c700 1 --2- 172.21.15.146:0/3130475316 >> v2:172.21.15.151:3300/0 conn(0x7f1164159450 0x7f1164159820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:27.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.185+0000 7f116a80c700 1 --2- 172.21.15.146:0/3130475316 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f116415dd70 0x7f11640b0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:27.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.185+0000 7f116a80c700 1 -- 172.21.15.146:0/3130475316 >> 172.21.15.146:0/3130475316 conn(0x7f116406eb10 msgr2=0x7f116406ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:27.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.185+0000 7f116a80c700 1 -- 172.21.15.146:0/3130475316 shutdown_connections 2023-10-06T11:20:27.189 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.185+0000 7f116a80c700 1 -- 172.21.15.146:0/3130475316 wait complete. 2023-10-06T11:20:27.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.186+0000 7f116a80c700 1 Processor -- start 2023-10-06T11:20:27.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.186+0000 7f116a80c700 1 -- start start 2023-10-06T11:20:27.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.187+0000 7f116a80c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11640b0760 0x7f11641578c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:27.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.187+0000 7f116a80c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1164159450 0x7f11640c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:27.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.187+0000 7f116a80c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f116415dd70 0x7f116415b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:27.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.187+0000 7f116a80c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f116415cb40 con 0x7f11640b0760 2023-10-06T11:20:27.192 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.187+0000 7f116a80c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11640ca230 con 0x7f1164159450 2023-10-06T11:20:27.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.187+0000 7f116a80c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11640c7f90 con 0x7f116415dd70 2023-10-06T11:20:27.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.187+0000 7f1163fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11640b0760 0x7f11641578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:27.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.187+0000 7f1163fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11640b0760 0x7f11641578c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45208/0 (socket says 172.21.15.146:45208) 2023-10-06T11:20:27.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.187+0000 7f1163fff700 1 -- 172.21.15.146:0/3179438023 learned_addr learned my addr 172.21.15.146:0/3179438023 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:27.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.187+0000 7f1168da9700 1 --2- 172.21.15.146:0/3179438023 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f116415dd70 0x7f116415b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:27.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.187+0000 7f11637fe700 1 --2- 172.21.15.146:0/3179438023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1164159450 0x7f11640c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:27.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.187+0000 7f1163fff700 1 -- 172.21.15.146:0/3179438023 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f116415dd70 msgr2=0x7f116415b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:27.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.187+0000 7f1163fff700 1 --2- 172.21.15.146:0/3179438023 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f116415dd70 0x7f116415b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:27.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.187+0000 7f1163fff700 1 -- 172.21.15.146:0/3179438023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1164159450 msgr2=0x7f11640c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:27.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.187+0000 7f1163fff700 1 --2- 172.21.15.146:0/3179438023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1164159450 0x7f11640c8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:27.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.187+0000 7f1163fff700 1 -- 172.21.15.146:0/3179438023 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f115c009ae0 con 0x7f11640b0760 2023-10-06T11:20:27.193 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.187+0000 7f1168da9700 1 --2- 172.21.15.146:0/3179438023 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f116415dd70 0x7f116415b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:20:27.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.187+0000 7f11637fe700 1 --2- 172.21.15.146:0/3179438023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1164159450 0x7f11640c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:20:27.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.187+0000 7f1163fff700 1 --2- 172.21.15.146:0/3179438023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11640b0760 0x7f11641578c0 secure :-1 s=READY pgs=2382 cs=0 l=1 rev1=1 crypto rx=0x7f115400d8c0 tx=0x7f1154008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:27.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.187+0000 7f114bfff700 1 -- 172.21.15.146:0/3179438023 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115400de60 con 0x7f11640b0760 2023-10-06T11:20:27.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.188+0000 7f114bfff700 1 -- 172.21.15.146:0/3179438023 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f115400b780 con 0x7f11640b0760 2023-10-06T11:20:27.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.188+0000 7f116a80c700 1 -- 172.21.15.146:0/3179438023 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11640ca480 con 0x7f11640b0760 2023-10-06T11:20:27.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.188+0000 7f114bfff700 1 -- 172.21.15.146:0/3179438023 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115400bb20 con 0x7f11640b0760 2023-10-06T11:20:27.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.188+0000 7f116a80c700 1 -- 172.21.15.146:0/3179438023 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11640c7940 con 0x7f11640b0760 2023-10-06T11:20:27.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.188+0000 7f116a80c700 1 -- 172.21.15.146:0/3179438023 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f116404c380 con 0x7f11640b0760 2023-10-06T11:20:27.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.189+0000 7f114bfff700 1 -- 172.21.15.146:0/3179438023 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f115401e460 con 0x7f11640b0760 2023-10-06T11:20:27.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.189+0000 7f114bfff700 1 --2- 172.21.15.146:0/3179438023 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1150066f30 0x7f11500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:27.194 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.189+0000 7f114bfff700 1 -- 172.21.15.146:0/3179438023 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f1154084a90 con 0x7f11640b0760 2023-10-06T11:20:27.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.189+0000 7f11637fe700 1 --2- 172.21.15.146:0/3179438023 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1150066f30 0x7f11500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:27.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.190+0000 7f11637fe700 1 --2- 172.21.15.146:0/3179438023 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1150066f30 0x7f11500693e0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f11640d1690 tx=0x7f1158008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:27.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.193+0000 7f114bfff700 1 -- 172.21.15.146:0/3179438023 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1154051e40 con 0x7f11640b0760 2023-10-06T11:20:27.379 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.377+0000 7f116a80c700 1 -- 172.21.15.146:0/3179438023 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config rm", "who": "mds", "name": "mds_hack_allow_loading_invalid_metadata"} v 0) v1 -- 0x7f11640c8e10 con 0x7f11640b0760 2023-10-06T11:20:27.385 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.383+0000 7f114bfff700 1 -- 172.21.15.146:0/3179438023 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mds", "name": "mds_hack_allow_loading_invalid_metadata"}]=0 v34) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1154055460 con 0x7f11640b0760 2023-10-06T11:20:27.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.386+0000 7f116a80c700 1 -- 172.21.15.146:0/3179438023 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1150066f30 msgr2=0x7f11500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:27.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.386+0000 7f116a80c700 1 --2- 172.21.15.146:0/3179438023 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1150066f30 0x7f11500693e0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f11640d1690 tx=0x7f1158008040 comp rx=0 tx=0).stop 2023-10-06T11:20:27.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.386+0000 7f116a80c700 1 -- 172.21.15.146:0/3179438023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11640b0760 msgr2=0x7f11641578c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:27.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.386+0000 7f116a80c700 1 --2- 172.21.15.146:0/3179438023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11640b0760 0x7f11641578c0 secure :-1 s=READY pgs=2382 cs=0 l=1 rev1=1 crypto rx=0x7f115400d8c0 tx=0x7f1154008040 comp rx=0 tx=0).stop 2023-10-06T11:20:27.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.386+0000 7f116a80c700 1 -- 172.21.15.146:0/3179438023 shutdown_connections 2023-10-06T11:20:27.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.386+0000 7f116a80c700 1 --2- 172.21.15.146:0/3179438023 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f1150066f30 0x7f11500693e0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:27.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.386+0000 7f116a80c700 1 --2- 172.21.15.146:0/3179438023 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f116415dd70 0x7f116415b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:27.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.386+0000 7f116a80c700 1 --2- 172.21.15.146:0/3179438023 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f11640b0760 0x7f11641578c0 secure :-1 s=CLOSED pgs=2382 cs=0 l=1 rev1=1 crypto rx=0x7f115400d8c0 tx=0x7f1154008040 comp rx=0 tx=0).stop 2023-10-06T11:20:27.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.386+0000 7f116a80c700 1 --2- 172.21.15.146:0/3179438023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1164159450 0x7f11640c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:27.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.386+0000 7f116a80c700 1 -- 172.21.15.146:0/3179438023 >> 172.21.15.146:0/3179438023 conn(0x7f116406eb10 msgr2=0x7f11640b5630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:27.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.387+0000 7f116a80c700 1 -- 172.21.15.146:0/3179438023 shutdown_connections 2023-10-06T11:20:27.390 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.387+0000 7f116a80c700 1 -- 172.21.15.146:0/3179438023 wait complete. 2023-10-06T11:20:27.403 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T11:20:27.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.517+0000 7f349a5aa700 1 Processor -- start 2023-10-06T11:20:27.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.517+0000 7f349a5aa700 1 -- start start 2023-10-06T11:20:27.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.518+0000 7f349a5aa700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3494159820 0x7f34940b0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:27.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.518+0000 7f349a5aa700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f34940b0760 0x7f34940aef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:27.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.518+0000 7f349a5aa700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34940cb8a0 con 0x7f3494159450 2023-10-06T11:20:27.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.518+0000 7f349a5aa700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34940b2f20 con 0x7f3494159820 2023-10-06T11:20:27.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.518+0000 7f349a5aa700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3494159c70 con 0x7f34940b0760 2023-10-06T11:20:27.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.518+0000 7f34937fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3494159820 0x7f34940b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:27.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.518+0000 7f34937fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f3494159820 0x7f34940b0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45220/0 (socket says 172.21.15.146:45220) 2023-10-06T11:20:27.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.518+0000 7f34937fe700 1 -- 172.21.15.146:0/191174293 learned_addr learned my addr 172.21.15.146:0/191174293 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:27.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.518+0000 7f3498b47700 1 --2- 172.21.15.146:0/191174293 >> v2:172.21.15.151:3300/0 conn(0x7f34940b0760 0x7f34940aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:27.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.519+0000 7f34937fe700 1 -- 172.21.15.146:0/191174293 >> v2:172.21.15.151:3300/0 conn(0x7f34940b0760 msgr2=0x7f34940aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:27.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.519+0000 7f34937fe700 1 --2- 172.21.15.146:0/191174293 >> v2:172.21.15.151:3300/0 conn(0x7f34940b0760 0x7f34940aef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:27.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.519+0000 7f34937fe700 1 -- 172.21.15.146:0/191174293 >> v1:172.21.15.151:6789/0 conn(0x7f3494159450 legacy=0x7f349415dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:27.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.519+0000 7f34937fe700 1 -- 172.21.15.146:0/191174293 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34940b0b90 con 0x7f3494159820 2023-10-06T11:20:27.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.519+0000 7f34937fe700 1 --2- 172.21.15.146:0/191174293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3494159820 0x7f34940b0220 secure :-1 s=READY pgs=2383 cs=0 l=1 rev1=1 crypto rx=0x7f34940b5e80 tx=0x7f3488009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44caac7018d47589 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:27.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.519+0000 7f3492ffd700 1 -- 172.21.15.146:0/191174293 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3488009e70 con 0x7f3494159820 2023-10-06T11:20:27.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.519+0000 7f3492ffd700 1 -- 172.21.15.146:0/191174293 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348800b860 con 0x7f3494159820 2023-10-06T11:20:27.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.519+0000 7f3492ffd700 1 -- 172.21.15.146:0/191174293 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348800bc00 con 0x7f3494159820 2023-10-06T11:20:27.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.519+0000 7f349a5aa700 1 -- 172.21.15.146:0/191174293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3494159820 msgr2=0x7f34940b0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:27.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.519+0000 7f349a5aa700 1 --2- 172.21.15.146:0/191174293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3494159820 0x7f34940b0220 secure :-1 s=READY pgs=2383 cs=0 l=1 rev1=1 crypto rx=0x7f34940b5e80 tx=0x7f3488009250 comp rx=0 tx=0).stop 2023-10-06T11:20:27.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.520+0000 7f349a5aa700 1 -- 172.21.15.146:0/191174293 shutdown_connections 2023-10-06T11:20:27.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.520+0000 7f349a5aa700 1 --2- 172.21.15.146:0/191174293 >> v2:172.21.15.151:3300/0 conn(0x7f34940b0760 0x7f34940aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:27.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.520+0000 7f349a5aa700 1 --2- 172.21.15.146:0/191174293 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3494159820 0x7f34940b0220 unknown :-1 s=CLOSED pgs=2383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:27.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.520+0000 7f349a5aa700 1 -- 172.21.15.146:0/191174293 >> 172.21.15.146:0/191174293 conn(0x7f349406eb10 msgr2=0x7f349406ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:27.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.520+0000 7f349a5aa700 1 -- 172.21.15.146:0/191174293 shutdown_connections 2023-10-06T11:20:27.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.520+0000 7f349a5aa700 1 -- 172.21.15.146:0/191174293 wait complete. 2023-10-06T11:20:27.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.521+0000 7f349a5aa700 1 Processor -- start 2023-10-06T11:20:27.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.521+0000 7f349a5aa700 1 -- start start 2023-10-06T11:20:27.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.522+0000 7f349a5aa700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34940b0760 0x7f3494156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:27.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.522+0000 7f349a5aa700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3494159450 0x7f34940c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:27.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.522+0000 7f349a5aa700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3494159820 0x7f34940c6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:27.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.522+0000 7f349a5aa700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34940ca5f0 con 0x7f3494159450 2023-10-06T11:20:27.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.522+0000 7f349a5aa700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34940c3fc0 con 0x7f34940b0760 2023-10-06T11:20:27.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.522+0000 7f349a5aa700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34940cefe0 con 0x7f3494159820 2023-10-06T11:20:27.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.522+0000 7f34937fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3494159450 0x7f34940c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:27.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.522+0000 7f34937fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3494159450 0x7f34940c6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45236/0 (socket says 172.21.15.146:45236) 2023-10-06T11:20:27.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.522+0000 7f34937fe700 1 -- 172.21.15.146:0/1030032115 learned_addr learned my addr 172.21.15.146:0/1030032115 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:27.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.522+0000 7f3498b47700 1 --2- 172.21.15.146:0/1030032115 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3494159820 0x7f34940c6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:27.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.522+0000 7f3493fff700 1 --2- 172.21.15.146:0/1030032115 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34940b0760 0x7f3494156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:27.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.522+0000 7f34937fe700 1 -- 172.21.15.146:0/1030032115 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3494159820 msgr2=0x7f34940c6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:27.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.522+0000 7f34937fe700 1 --2- 172.21.15.146:0/1030032115 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3494159820 0x7f34940c6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:27.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.522+0000 7f34937fe700 1 -- 172.21.15.146:0/1030032115 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34940b0760 msgr2=0x7f3494156d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:27.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.522+0000 7f34937fe700 1 --2- 172.21.15.146:0/1030032115 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34940b0760 0x7f3494156d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:27.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.522+0000 7f34937fe700 1 -- 172.21.15.146:0/1030032115 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34880094f0 con 0x7f3494159450 2023-10-06T11:20:27.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.522+0000 7f3498b47700 1 --2- 172.21.15.146:0/1030032115 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3494159820 0x7f34940c6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:20:27.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.522+0000 7f3493fff700 1 --2- 172.21.15.146:0/1030032115 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34940b0760 0x7f3494156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:20:27.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.522+0000 7f34937fe700 1 --2- 172.21.15.146:0/1030032115 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3494159450 0x7f34940c6d30 secure :-1 s=READY pgs=2384 cs=0 l=1 rev1=1 crypto rx=0x7f3494070e70 tx=0x7f3488017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:27.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.522+0000 7f347bfff700 1 -- 172.21.15.146:0/1030032115 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3488011420 con 0x7f3494159450 2023-10-06T11:20:27.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.522+0000 7f347bfff700 1 -- 172.21.15.146:0/1030032115 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3488011580 con 0x7f3494159450 2023-10-06T11:20:27.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.522+0000 7f349a5aa700 1 -- 172.21.15.146:0/1030032115 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34940cf2c0 con 0x7f3494159450 2023-10-06T11:20:27.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.522+0000 7f347bfff700 1 -- 172.21.15.146:0/1030032115 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3488011940 con 0x7f3494159450 2023-10-06T11:20:27.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.522+0000 7f349a5aa700 1 -- 172.21.15.146:0/1030032115 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34940c9fa0 con 0x7f3494159450 2023-10-06T11:20:27.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.523+0000 7f349a5aa700 1 -- 172.21.15.146:0/1030032115 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f349404c380 con 0x7f3494159450 2023-10-06T11:20:27.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.524+0000 7f347bfff700 1 -- 172.21.15.146:0/1030032115 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f348802c3b0 con 0x7f3494159450 2023-10-06T11:20:27.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.524+0000 7f347bfff700 1 --2- 172.21.15.146:0/1030032115 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3480066f30 0x7f34800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:27.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.524+0000 7f347bfff700 1 -- 172.21.15.146:0/1030032115 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f34880859c0 con 0x7f3494159450 2023-10-06T11:20:27.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.524+0000 7f3493fff700 1 --2- 172.21.15.146:0/1030032115 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3480066f30 0x7f34800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:27.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.524+0000 7f3493fff700 1 --2- 172.21.15.146:0/1030032115 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3480066f30 0x7f34800693e0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f3484007fd0 tx=0x7f3484009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:27.531 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.528+0000 7f347bfff700 1 -- 172.21.15.146:0/1030032115 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3488052d70 con 0x7f3494159450 2023-10-06T11:20:27.713 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.711+0000 7f349a5aa700 1 -- 172.21.15.146:0/1030032115 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f34940b2960 con 0x7f3494159450 2023-10-06T11:20:27.716 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.714+0000 7f347bfff700 1 -- 172.21.15.146:0/1030032115 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v35) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3488056390 con 0x7f3494159450 2023-10-06T11:20:27.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.717+0000 7f349a5aa700 1 -- 172.21.15.146:0/1030032115 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3480066f30 msgr2=0x7f34800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:27.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.717+0000 7f349a5aa700 1 --2- 172.21.15.146:0/1030032115 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3480066f30 0x7f34800693e0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f3484007fd0 tx=0x7f3484009040 comp rx=0 tx=0).stop 2023-10-06T11:20:27.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.717+0000 7f349a5aa700 1 -- 172.21.15.146:0/1030032115 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3494159450 msgr2=0x7f34940c6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:27.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.717+0000 7f349a5aa700 1 --2- 172.21.15.146:0/1030032115 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3494159450 0x7f34940c6d30 secure :-1 s=READY pgs=2384 cs=0 l=1 rev1=1 crypto rx=0x7f3494070e70 tx=0x7f3488017000 comp rx=0 tx=0).stop 2023-10-06T11:20:27.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.717+0000 7f349a5aa700 1 -- 172.21.15.146:0/1030032115 shutdown_connections 2023-10-06T11:20:27.719 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.717+0000 7f349a5aa700 1 --2- 172.21.15.146:0/1030032115 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f3480066f30 0x7f34800693e0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:27.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.717+0000 7f349a5aa700 1 --2- 172.21.15.146:0/1030032115 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3494159820 0x7f34940c6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:27.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.717+0000 7f349a5aa700 1 --2- 172.21.15.146:0/1030032115 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f34940b0760 0x7f3494156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:27.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.717+0000 7f349a5aa700 1 --2- 172.21.15.146:0/1030032115 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f3494159450 0x7f34940c6d30 unknown :-1 s=CLOSED pgs=2384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:27.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.717+0000 7f349a5aa700 1 -- 172.21.15.146:0/1030032115 >> 172.21.15.146:0/1030032115 conn(0x7f349406eb10 msgr2=0x7f34940b5400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:27.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.717+0000 7f349a5aa700 1 -- 172.21.15.146:0/1030032115 shutdown_connections 2023-10-06T11:20:27.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.717+0000 7f349a5aa700 1 -- 172.21.15.146:0/1030032115 wait complete. 2023-10-06T11:20:27.731 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_dup_inode' 2023-10-06T11:20:27.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.843+0000 7fb9bff7d700 1 Processor -- start 2023-10-06T11:20:27.845 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.843+0000 7fb9bff7d700 1 -- start start 2023-10-06T11:20:27.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.844+0000 7fb9bff7d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9b8158870 0x7fb9b806b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:27.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.844+0000 7fb9bff7d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9b8158ce0 con 0x7fb9b81584a0 2023-10-06T11:20:27.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.844+0000 7fb9bff7d700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9b806c100 con 0x7fb9b806bca0 2023-10-06T11:20:27.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.844+0000 7fb9bff7d700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b815b440 con 0x7fb9b8158870 2023-10-06T11:20:27.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.844+0000 7fb9bdd19700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb9b81584a0 0x7fb9b80c8a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49428/0 (socket says 172.21.15.146:49428) 2023-10-06T11:20:27.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.844+0000 7fb9bdd19700 1 -- 172.21.15.146:0/1496090892 learned_addr learned my addr 172.21.15.146:0/1496090892 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:20:27.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.845+0000 7fb9bcd17700 1 -- 172.21.15.146:0/1496090892 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1923172199 0 0) 0x7fb9b8158ce0 con 0x7fb9b81584a0 2023-10-06T11:20:27.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.845+0000 7fb9bd518700 1 --2- 172.21.15.146:0/1496090892 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9b8158870 0x7fb9b806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:27.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.845+0000 7fb9bcd17700 1 -- 172.21.15.146:0/1496090892 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9a0003570 con 0x7fb9b81584a0 2023-10-06T11:20:27.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.845+0000 7fb9bcd17700 1 -- 172.21.15.146:0/1496090892 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1401407805 0 0) 0x7fb9a0003570 con 0x7fb9b81584a0 2023-10-06T11:20:27.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.845+0000 7fb9bcd17700 1 -- 172.21.15.146:0/1496090892 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9b8158870 msgr2=0x7fb9b806b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:27.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.845+0000 7fb9bcd17700 1 --2- 172.21.15.146:0/1496090892 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9b8158870 0x7fb9b806b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:27.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.845+0000 7fb9bcd17700 1 -- 172.21.15.146:0/1496090892 >> v1:172.21.15.151:6789/0 conn(0x7fb9b806bca0 legacy=0x7fb9b80cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:27.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.845+0000 7fb9bcd17700 1 -- 172.21.15.146:0/1496090892 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b815b720 con 0x7fb9b81584a0 2023-10-06T11:20:27.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.845+0000 7fb9bcd17700 1 -- 172.21.15.146:0/1496090892 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fb9a80017f0 con 0x7fb9b81584a0 2023-10-06T11:20:27.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.845+0000 7fb9bcd17700 1 -- 172.21.15.146:0/1496090892 >> v1:172.21.15.146:6789/0 conn(0x7fb9b81584a0 legacy=0x7fb9b80c8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:27.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.845+0000 7fb9bcd17700 1 --2- 172.21.15.146:0/1496090892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9a0003a90 0x7fb9a0003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:27.850 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.845+0000 7fb9bcd17700 1 --2- 172.21.15.146:0/1496090892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9a0004810 0x7fb9a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:27.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.845+0000 7fb9bcd17700 1 --2- 172.21.15.146:0/1496090892 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9b8158870 0x7fb9a00051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:27.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.845+0000 7fb9bcd17700 1 -- 172.21.15.146:0/1496090892 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b815b440 con 0x7fb9a0004810 2023-10-06T11:20:27.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.845+0000 7fb9bcd17700 1 -- 172.21.15.146:0/1496090892 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a000bb90 con 0x7fb9a0003a90 2023-10-06T11:20:27.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.845+0000 7fb9bcd17700 1 -- 172.21.15.146:0/1496090892 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a000bd50 con 0x7fb9b8158870 2023-10-06T11:20:27.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.845+0000 7fb9bd518700 1 --2- 172.21.15.146:0/1496090892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9a0004810 0x7fb9a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:27.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.845+0000 7fb9bdd19700 1 --2- 172.21.15.146:0/1496090892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9a0003a90 0x7fb9a0003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:27.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.845+0000 7fb9be51a700 1 --2- 172.21.15.146:0/1496090892 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9b8158870 0x7fb9a00051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:27.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.846+0000 7fb9bd518700 1 -- 172.21.15.146:0/1496090892 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9b8158870 msgr2=0x7fb9a00051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:27.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.846+0000 7fb9bd518700 1 --2- 172.21.15.146:0/1496090892 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9b8158870 0x7fb9a00051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:27.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.846+0000 7fb9bd518700 1 -- 172.21.15.146:0/1496090892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9a0003a90 msgr2=0x7fb9a0003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:27.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.846+0000 7fb9bd518700 1 --2- 172.21.15.146:0/1496090892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9a0003a90 0x7fb9a0003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:27.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.846+0000 7fb9bd518700 1 -- 172.21.15.146:0/1496090892 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a0003570 con 0x7fb9a0004810 2023-10-06T11:20:27.851 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.846+0000 7fb9bd518700 1 --2- 172.21.15.146:0/1496090892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9a0004810 0x7fb9a0004c80 secure :-1 s=READY pgs=2386 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac009c00 tx=0x7fb9ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4d52b18faaf9a9e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:27.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.846+0000 7fb9bcd17700 1 -- 172.21.15.146:0/1496090892 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac00e710 con 0x7fb9a0004810 2023-10-06T11:20:27.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.846+0000 7fb9bcd17700 1 -- 172.21.15.146:0/1496090892 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ac00e870 con 0x7fb9a0004810 2023-10-06T11:20:27.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.846+0000 7fb9bcd17700 1 -- 172.21.15.146:0/1496090892 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac00ec30 con 0x7fb9a0004810 2023-10-06T11:20:27.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.846+0000 7fb9bff7d700 1 -- 172.21.15.146:0/1496090892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9a0004810 msgr2=0x7fb9a0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:27.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.846+0000 7fb9bff7d700 1 --2- 172.21.15.146:0/1496090892 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9a0004810 0x7fb9a0004c80 secure :-1 s=READY pgs=2386 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac009c00 tx=0x7fb9ac0091a0 comp rx=0 tx=0).stop 2023-10-06T11:20:27.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.846+0000 7fb9be51a700 1 -- 172.21.15.146:0/1496090892 reap_dead start 2023-10-06T11:20:27.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.846+0000 7fb9bff7d700 1 -- 172.21.15.146:0/1496090892 shutdown_connections 2023-10-06T11:20:27.852 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.846+0000 7fb9bff7d700 1 -- 172.21.15.146:0/1496090892 >> 172.21.15.146:0/1496090892 conn(0x7fb9b8067eb0 msgr2=0x7fb9b80ce450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:27.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.846+0000 7fb9bff7d700 1 -- 172.21.15.146:0/1496090892 shutdown_connections 2023-10-06T11:20:27.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.846+0000 7fb9bff7d700 1 -- 172.21.15.146:0/1496090892 wait complete. 2023-10-06T11:20:27.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.848+0000 7fb9bff7d700 1 Processor -- start 2023-10-06T11:20:27.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.848+0000 7fb9bff7d700 1 -- start start 2023-10-06T11:20:27.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.848+0000 7fb9bff7d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9a0004810 0x7fb9b816bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:27.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.848+0000 7fb9bff7d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9b8157a90 0x7fb9b814eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:27.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.848+0000 7fb9bff7d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9b8168000 0x7fb9b80b3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:27.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.848+0000 7fb9bff7d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b816ba10 con 0x7fb9b8157a90 2023-10-06T11:20:27.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.848+0000 7fb9bff7d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b81688c0 con 0x7fb9a0004810 2023-10-06T11:20:27.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.848+0000 7fb9bff7d700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b8168ba0 con 0x7fb9b8168000 2023-10-06T11:20:27.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.848+0000 7fb9bd518700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9b8157a90 0x7fb9b814eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:27.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.848+0000 7fb9bd518700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9b8157a90 0x7fb9b814eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45258/0 (socket says 172.21.15.146:45258) 2023-10-06T11:20:27.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.848+0000 7fb9bd518700 1 -- 172.21.15.146:0/4233772638 learned_addr learned my addr 172.21.15.146:0/4233772638 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:27.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.848+0000 7fb9be51a700 1 --2- 172.21.15.146:0/4233772638 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9b8168000 0x7fb9b80b3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:27.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.848+0000 7fb9bdd19700 1 --2- 172.21.15.146:0/4233772638 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9a0004810 0x7fb9b816bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:27.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.849+0000 7fb9bd518700 1 -- 172.21.15.146:0/4233772638 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9b8168000 msgr2=0x7fb9b80b3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:27.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.849+0000 7fb9bd518700 1 --2- 172.21.15.146:0/4233772638 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9b8168000 0x7fb9b80b3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:27.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.849+0000 7fb9bd518700 1 -- 172.21.15.146:0/4233772638 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9a0004810 msgr2=0x7fb9b816bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:27.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.849+0000 7fb9bd518700 1 --2- 172.21.15.146:0/4233772638 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9a0004810 0x7fb9b816bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:27.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.849+0000 7fb9bd518700 1 -- 172.21.15.146:0/4233772638 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b8168e80 con 0x7fb9b8157a90 2023-10-06T11:20:27.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.849+0000 7fb9bd518700 1 --2- 172.21.15.146:0/4233772638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9b8157a90 0x7fb9b814eb20 secure :-1 s=READY pgs=2387 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac00e4b0 tx=0x7fb9ac01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:27.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.849+0000 7fb9b5ffb700 1 -- 172.21.15.146:0/4233772638 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac023070 con 0x7fb9b8157a90 2023-10-06T11:20:27.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.849+0000 7fb9b5ffb700 1 -- 172.21.15.146:0/4233772638 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9ac00e9e0 con 0x7fb9b8157a90 2023-10-06T11:20:27.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.849+0000 7fb9bff7d700 1 -- 172.21.15.146:0/4233772638 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9b816ba10 con 0x7fb9b8157a90 2023-10-06T11:20:27.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.849+0000 7fb9b5ffb700 1 -- 172.21.15.146:0/4233772638 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac01e030 con 0x7fb9b8157a90 2023-10-06T11:20:27.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.849+0000 7fb9bff7d700 1 -- 172.21.15.146:0/4233772638 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9b816c3e0 con 0x7fb9b8157a90 2023-10-06T11:20:27.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.850+0000 7fb9bff7d700 1 -- 172.21.15.146:0/4233772638 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9b816bba0 con 0x7fb9b8157a90 2023-10-06T11:20:27.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.851+0000 7fb9b5ffb700 1 -- 172.21.15.146:0/4233772638 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb9ac013470 con 0x7fb9b8157a90 2023-10-06T11:20:27.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.851+0000 7fb9b5ffb700 1 --2- 172.21.15.146:0/4233772638 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb9a4066f30 0x7fb9a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:27.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.851+0000 7fb9b5ffb700 1 -- 172.21.15.146:0/4233772638 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5378+0+0 (secure 0 0 0) 0x7fb9ac0859b0 con 0x7fb9b8157a90 2023-10-06T11:20:27.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.851+0000 7fb9bdd19700 1 --2- 172.21.15.146:0/4233772638 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb9a4066f30 0x7fb9a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:27.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.851+0000 7fb9bdd19700 1 --2- 172.21.15.146:0/4233772638 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb9a4066f30 0x7fb9a40693e0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fb9a80014a0 tx=0x7fb9a8006040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:27.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:27.855+0000 7fb9b5ffb700 1 -- 172.21.15.146:0/4233772638 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb9ac052ea0 con 0x7fb9b8157a90 2023-10-06T11:20:28.118 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:28.116+0000 7fb9bff7d700 1 -- 172.21.15.146:0/4233772638 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_dup_inode"]} v 0) v1 -- 0x7fb9b804c380 con 0x7fb9b8157a90 2023-10-06T11:20:29.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.055+0000 7fb9b5ffb700 1 -- 172.21.15.146:0/4233772638 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_scrub.TestScrub.test_scrub_dup_inode"]}]=0 v681) v1 ==== 133+0+0 (secure 0 0 0) 0x7fb9ac017020 con 0x7fb9b8157a90 2023-10-06T11:20:29.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.058+0000 7fb9bff7d700 1 -- 172.21.15.146:0/4233772638 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb9a4066f30 msgr2=0x7fb9a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:29.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.058+0000 7fb9bff7d700 1 --2- 172.21.15.146:0/4233772638 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb9a4066f30 0x7fb9a40693e0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fb9a80014a0 tx=0x7fb9a8006040 comp rx=0 tx=0).stop 2023-10-06T11:20:29.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.058+0000 7fb9bff7d700 1 -- 172.21.15.146:0/4233772638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9b8157a90 msgr2=0x7fb9b814eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:29.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.058+0000 7fb9bff7d700 1 --2- 172.21.15.146:0/4233772638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9b8157a90 0x7fb9b814eb20 secure :-1 s=READY pgs=2387 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac00e4b0 tx=0x7fb9ac01a000 comp rx=0 tx=0).stop 2023-10-06T11:20:29.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.058+0000 7fb9bff7d700 1 -- 172.21.15.146:0/4233772638 shutdown_connections 2023-10-06T11:20:29.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.058+0000 7fb9bff7d700 1 --2- 172.21.15.146:0/4233772638 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb9a4066f30 0x7fb9a40693e0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:29.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.058+0000 7fb9bff7d700 1 --2- 172.21.15.146:0/4233772638 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9b8168000 0x7fb9b80b3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:29.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.058+0000 7fb9bff7d700 1 --2- 172.21.15.146:0/4233772638 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9a0004810 0x7fb9b816bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:29.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.058+0000 7fb9bff7d700 1 --2- 172.21.15.146:0/4233772638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb9b8157a90 0x7fb9b814eb20 unknown :-1 s=CLOSED pgs=2387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:29.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.058+0000 7fb9bff7d700 1 -- 172.21.15.146:0/4233772638 >> 172.21.15.146:0/4233772638 conn(0x7fb9b8067eb0 msgr2=0x7fb9b80c3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:29.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.058+0000 7fb9bff7d700 1 -- 172.21.15.146:0/4233772638 shutdown_connections 2023-10-06T11:20:29.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.058+0000 7fb9bff7d700 1 -- 172.21.15.146:0/4233772638 wait complete. 2023-10-06T11:20:29.075 INFO:tasks.cephfs_test_runner:test_scrub_dup_inode (tasks.cephfs.test_scrub.TestScrub) ... ok 2023-10-06T11:20:29.075 INFO:tasks.cephfs_test_runner: 2023-10-06T11:20:29.076 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-06T11:20:29.076 INFO:tasks.cephfs_test_runner:Ran 12 tests in 849.927s 2023-10-06T11:20:29.076 INFO:tasks.cephfs_test_runner: 2023-10-06T11:20:29.076 INFO:tasks.cephfs_test_runner:OK 2023-10-06T11:20:29.076 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-06T11:20:29.090 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-10-06T11:20:29.183 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-10-06T11:20:29.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:20:29.184 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-10-06T11:20:29.202 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T11:20:29.202 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T11:20:29.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:20:29.203 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T11:20:29.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:20:29.278 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T11:20:29.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:20:29.358 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link delete ceph-brx 2023-10-06T11:20:29.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:20:29.452 DEBUG:teuthology.orchestra.run.smithi146:> ip netns list 2023-10-06T11:20:29.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T11:20:29.471 INFO:teuthology.orchestra.run.smithi146.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T11:20:29.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:20:29.471 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T11:20:29.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:20:29.547 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T11:20:29.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T11:20:29.631 DEBUG:teuthology.orchestra.run.smithi146:> sudo ip link delete ceph-brx 2023-10-06T11:20:29.739 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-06T11:20:29.748 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-06T11:20:29.748 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:20:29.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.864+0000 7efc4f036700 1 Processor -- start 2023-10-06T11:20:29.867 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.864+0000 7efc4f036700 1 -- start start 2023-10-06T11:20:29.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.865+0000 7efc4f036700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efc4813fbb0 0x7efc480c6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:29.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.865+0000 7efc4f036700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efc4813ff80 0x7efc4806ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:29.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.865+0000 7efc4f036700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc480caa40 con 0x7efc4806f280 2023-10-06T11:20:29.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.865+0000 7efc4f036700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc4815adc0 con 0x7efc4813ff80 2023-10-06T11:20:29.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.865+0000 7efc4f036700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc480c9e30 con 0x7efc4813fbb0 2023-10-06T11:20:29.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.865+0000 7efc3ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efc4813ff80 0x7efc4806ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:29.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.865+0000 7efc3ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7efc4813ff80 0x7efc4806ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45264/0 (socket says 172.21.15.146:45264) 2023-10-06T11:20:29.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.865+0000 7efc3ffff700 1 -- 172.21.15.146:0/4157758865 learned_addr learned my addr 172.21.15.146:0/4157758865 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:29.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.865+0000 7efc4cdd2700 1 --2- 172.21.15.146:0/4157758865 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efc4813fbb0 0x7efc480c6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:29.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.866+0000 7efc3ffff700 1 -- 172.21.15.146:0/4157758865 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efc4813fbb0 msgr2=0x7efc480c6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:29.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.866+0000 7efc3ffff700 1 --2- 172.21.15.146:0/4157758865 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efc4813fbb0 0x7efc480c6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:29.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.866+0000 7efc3ffff700 1 -- 172.21.15.146:0/4157758865 >> v1:172.21.15.151:6789/0 conn(0x7efc4806f280 legacy=0x7efc48159fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:29.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.866+0000 7efc3ffff700 1 -- 172.21.15.146:0/4157758865 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc480ca110 con 0x7efc4813ff80 2023-10-06T11:20:29.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.866+0000 7efc3ffff700 1 --2- 172.21.15.146:0/4157758865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc4813ff80 0x7efc4806ed40 secure :-1 s=READY pgs=2388 cs=0 l=1 rev1=1 crypto rx=0x7efc380099b0 tx=0x7efc38009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=473e9d52229bbf61 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:29.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.866+0000 7efc3f7fe700 1 -- 172.21.15.146:0/4157758865 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc38009ea0 con 0x7efc4813ff80 2023-10-06T11:20:29.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.866+0000 7efc3f7fe700 1 -- 172.21.15.146:0/4157758865 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc3800b860 con 0x7efc4813ff80 2023-10-06T11:20:29.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.866+0000 7efc3f7fe700 1 -- 172.21.15.146:0/4157758865 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3800bc00 con 0x7efc4813ff80 2023-10-06T11:20:29.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.866+0000 7efc4f036700 1 -- 172.21.15.146:0/4157758865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc4813ff80 msgr2=0x7efc4806ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:29.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.866+0000 7efc4f036700 1 --2- 172.21.15.146:0/4157758865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc4813ff80 0x7efc4806ed40 secure :-1 s=READY pgs=2388 cs=0 l=1 rev1=1 crypto rx=0x7efc380099b0 tx=0x7efc38009250 comp rx=0 tx=0).stop 2023-10-06T11:20:29.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.867+0000 7efc4f036700 1 -- 172.21.15.146:0/4157758865 shutdown_connections 2023-10-06T11:20:29.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.867+0000 7efc4f036700 1 --2- 172.21.15.146:0/4157758865 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efc4813fbb0 0x7efc480c6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:29.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.867+0000 7efc4f036700 1 --2- 172.21.15.146:0/4157758865 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc4813ff80 0x7efc4806ed40 unknown :-1 s=CLOSED pgs=2388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:29.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.867+0000 7efc4f036700 1 -- 172.21.15.146:0/4157758865 >> 172.21.15.146:0/4157758865 conn(0x7efc480cc1c0 msgr2=0x7efc480cc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:29.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.867+0000 7efc4f036700 1 -- 172.21.15.146:0/4157758865 shutdown_connections 2023-10-06T11:20:29.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.867+0000 7efc4f036700 1 -- 172.21.15.146:0/4157758865 wait complete. 2023-10-06T11:20:29.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.868+0000 7efc4f036700 1 Processor -- start 2023-10-06T11:20:29.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.868+0000 7efc4f036700 1 -- start start 2023-10-06T11:20:29.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.869+0000 7efc4f036700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc4806f280 0x7efc480c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:29.874 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.869+0000 7efc4f036700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efc4813fbb0 0x7efc480c8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:29.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.869+0000 7efc4f036700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc4813ff80 0x7efc480c56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:29.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.869+0000 7efc4f036700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc480c7e30 con 0x7efc4806f280 2023-10-06T11:20:29.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.869+0000 7efc4f036700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc480c7220 con 0x7efc4813ff80 2023-10-06T11:20:29.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.869+0000 7efc4f036700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc480c7500 con 0x7efc4813fbb0 2023-10-06T11:20:29.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.869+0000 7efc4cdd2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc4806f280 0x7efc480c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:29.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.869+0000 7efc4cdd2700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc4806f280 0x7efc480c82c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45280/0 (socket says 172.21.15.146:45280) 2023-10-06T11:20:29.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.869+0000 7efc4cdd2700 1 -- 172.21.15.146:0/1091659153 learned_addr learned my addr 172.21.15.146:0/1091659153 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:29.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.869+0000 7efc3ffff700 1 --2- 172.21.15.146:0/1091659153 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efc4813fbb0 0x7efc480c8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:29.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.869+0000 7efc4d5d3700 1 --2- 172.21.15.146:0/1091659153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc4813ff80 0x7efc480c56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:29.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.869+0000 7efc4cdd2700 1 -- 172.21.15.146:0/1091659153 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efc4813fbb0 msgr2=0x7efc480c8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:29.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.869+0000 7efc4cdd2700 1 --2- 172.21.15.146:0/1091659153 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efc4813fbb0 0x7efc480c8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:29.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.869+0000 7efc4cdd2700 1 -- 172.21.15.146:0/1091659153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc4813ff80 msgr2=0x7efc480c56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:29.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.869+0000 7efc4cdd2700 1 --2- 172.21.15.146:0/1091659153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc4813ff80 0x7efc480c56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:29.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.869+0000 7efc4cdd2700 1 -- 172.21.15.146:0/1091659153 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc380094f0 con 0x7efc4806f280 2023-10-06T11:20:29.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.869+0000 7efc4d5d3700 1 --2- 172.21.15.146:0/1091659153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc4813ff80 0x7efc480c56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:20:29.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.870+0000 7efc4cdd2700 1 --2- 172.21.15.146:0/1091659153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc4806f280 0x7efc480c82c0 secure :-1 s=READY pgs=2389 cs=0 l=1 rev1=1 crypto rx=0x7efc44010b40 tx=0x7efc440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:29.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.870+0000 7efc3cff9700 1 -- 172.21.15.146:0/1091659153 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4400eb90 con 0x7efc4806f280 2023-10-06T11:20:29.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.870+0000 7efc3cff9700 1 -- 172.21.15.146:0/1091659153 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4400ecf0 con 0x7efc4806f280 2023-10-06T11:20:29.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.870+0000 7efc4f036700 1 -- 172.21.15.146:0/1091659153 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc480c77e0 con 0x7efc4806f280 2023-10-06T11:20:29.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.870+0000 7efc3cff9700 1 -- 172.21.15.146:0/1091659153 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc44011680 con 0x7efc4806f280 2023-10-06T11:20:29.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.870+0000 7efc4f036700 1 -- 172.21.15.146:0/1091659153 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc480c9330 con 0x7efc4806f280 2023-10-06T11:20:29.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.871+0000 7efc4f036700 1 -- 172.21.15.146:0/1091659153 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc480c8800 con 0x7efc4806f280 2023-10-06T11:20:29.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.871+0000 7efc3cff9700 1 -- 172.21.15.146:0/1091659153 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efc44011a30 con 0x7efc4806f280 2023-10-06T11:20:29.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.872+0000 7efc3cff9700 1 --2- 172.21.15.146:0/1091659153 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7efc34066f30 0x7efc340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:29.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.872+0000 7efc3cff9700 1 -- 172.21.15.146:0/1091659153 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5378+0+0 (secure 0 0 0) 0x7efc44086b20 con 0x7efc4806f280 2023-10-06T11:20:29.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.872+0000 7efc3ffff700 1 --2- 172.21.15.146:0/1091659153 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7efc34066f30 0x7efc340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:29.877 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.872+0000 7efc3ffff700 1 --2- 172.21.15.146:0/1091659153 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7efc34066f30 0x7efc340693e0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7efc380099b0 tx=0x7efc38017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:29.878 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:29.875+0000 7efc3cff9700 1 -- 172.21.15.146:0/1091659153 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efc44053f50 con 0x7efc4806f280 2023-10-06T11:20:30.064 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.063+0000 7efc4f036700 1 -- 172.21.15.146:0/1091659153 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc4804c380 con 0x7efc4806f280 2023-10-06T11:20:30.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.064+0000 7efc3cff9700 1 -- 172.21.15.146:0/1091659153 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v183) v1 ==== 74+0+13971 (secure 0 0 0) 0x7efc4401e090 con 0x7efc4806f280 2023-10-06T11:20:30.065 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:20:30.066 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":183,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:20:27.042302+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6837/2322816938":"2023-10-07T11:20:24.023385+0000","172.21.15.146:6835/2322816938":"2023-10-07T11:20:24.023385+0000","172.21.15.151:6834/1134233840":"2023-10-07T11:19:12.134281+0000","172.21.15.151:6832/1134233840":"2023-10-07T11:19:12.134281+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:20:30.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.066+0000 7efc4f036700 1 -- 172.21.15.146:0/1091659153 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7efc34066f30 msgr2=0x7efc340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:30.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.066+0000 7efc4f036700 1 --2- 172.21.15.146:0/1091659153 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7efc34066f30 0x7efc340693e0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7efc380099b0 tx=0x7efc38017000 comp rx=0 tx=0).stop 2023-10-06T11:20:30.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.066+0000 7efc4f036700 1 -- 172.21.15.146:0/1091659153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc4806f280 msgr2=0x7efc480c82c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:30.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.066+0000 7efc4f036700 1 --2- 172.21.15.146:0/1091659153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc4806f280 0x7efc480c82c0 secure :-1 s=READY pgs=2389 cs=0 l=1 rev1=1 crypto rx=0x7efc44010b40 tx=0x7efc440091a0 comp rx=0 tx=0).stop 2023-10-06T11:20:30.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.066+0000 7efc4f036700 1 -- 172.21.15.146:0/1091659153 shutdown_connections 2023-10-06T11:20:30.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.066+0000 7efc4f036700 1 --2- 172.21.15.146:0/1091659153 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7efc34066f30 0x7efc340693e0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:30.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.066+0000 7efc4f036700 1 --2- 172.21.15.146:0/1091659153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc4813ff80 0x7efc480c56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:30.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.066+0000 7efc4f036700 1 --2- 172.21.15.146:0/1091659153 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7efc4806f280 0x7efc480c82c0 unknown :-1 s=CLOSED pgs=2389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:30.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.066+0000 7efc4f036700 1 --2- 172.21.15.146:0/1091659153 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efc4813fbb0 0x7efc480c8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:30.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.066+0000 7efc4f036700 1 -- 172.21.15.146:0/1091659153 >> 172.21.15.146:0/1091659153 conn(0x7efc480cc1c0 msgr2=0x7efc480cc590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:30.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.066+0000 7efc4f036700 1 -- 172.21.15.146:0/1091659153 shutdown_connections 2023-10-06T11:20:30.069 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.066+0000 7efc4f036700 1 -- 172.21.15.146:0/1091659153 wait complete. 2023-10-06T11:20:30.080 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T11:20:30.080 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:20:30.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.193+0000 7f80df2a7700 1 Processor -- start 2023-10-06T11:20:30.195 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.193+0000 7f80df2a7700 1 -- start start 2023-10-06T11:20:30.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.194+0000 7f80df2a7700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f80d81538c0 0x7f80d8153c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:30.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.194+0000 7f80df2a7700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80d815dcc0 0x7f80d80ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:30.197 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.194+0000 7f80df2a7700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80d815d270 con 0x7f80d815a940 2023-10-06T11:20:30.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.194+0000 7f80df2a7700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80d815d830 con 0x7f80d81538c0 2023-10-06T11:20:30.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.194+0000 7f80df2a7700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80d815e110 con 0x7f80d815dcc0 2023-10-06T11:20:30.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.194+0000 7f80dd043700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f80d81538c0 0x7f80d8153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:30.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.194+0000 7f80dd043700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f80d81538c0 0x7f80d8153c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45292/0 (socket says 172.21.15.146:45292) 2023-10-06T11:20:30.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.194+0000 7f80dd043700 1 -- 172.21.15.146:0/840843949 learned_addr learned my addr 172.21.15.146:0/840843949 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:30.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.195+0000 7f80dd043700 1 -- 172.21.15.146:0/840843949 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80d815dcc0 msgr2=0x7f80d80ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:30.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.195+0000 7f80dd043700 1 --2- 172.21.15.146:0/840843949 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80d815dcc0 0x7f80d80ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:30.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.195+0000 7f80dd043700 1 -- 172.21.15.146:0/840843949 >> v1:172.21.15.151:6789/0 conn(0x7f80d815a940 legacy=0x7f80d80cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:30.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.195+0000 7f80dd043700 1 -- 172.21.15.146:0/840843949 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d80cb810 con 0x7f80d81538c0 2023-10-06T11:20:30.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.195+0000 7f80dd043700 1 --2- 172.21.15.146:0/840843949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80d81538c0 0x7f80d8153c90 secure :-1 s=READY pgs=2390 cs=0 l=1 rev1=1 crypto rx=0x7f80d40099b0 tx=0x7f80d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89bd13c811c968a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:30.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.195+0000 7f80cffff700 1 -- 172.21.15.146:0/840843949 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d400b820 con 0x7f80d81538c0 2023-10-06T11:20:30.198 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.195+0000 7f80cffff700 1 -- 172.21.15.146:0/840843949 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d400b980 con 0x7f80d81538c0 2023-10-06T11:20:30.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.195+0000 7f80cffff700 1 -- 172.21.15.146:0/840843949 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d400bd20 con 0x7f80d81538c0 2023-10-06T11:20:30.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.195+0000 7f80df2a7700 1 -- 172.21.15.146:0/840843949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80d81538c0 msgr2=0x7f80d8153c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:30.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.195+0000 7f80df2a7700 1 --2- 172.21.15.146:0/840843949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80d81538c0 0x7f80d8153c90 secure :-1 s=READY pgs=2390 cs=0 l=1 rev1=1 crypto rx=0x7f80d40099b0 tx=0x7f80d4009250 comp rx=0 tx=0).stop 2023-10-06T11:20:30.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.195+0000 7f80df2a7700 1 -- 172.21.15.146:0/840843949 shutdown_connections 2023-10-06T11:20:30.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.195+0000 7f80df2a7700 1 --2- 172.21.15.146:0/840843949 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80d815dcc0 0x7f80d80ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:30.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.195+0000 7f80df2a7700 1 --2- 172.21.15.146:0/840843949 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80d81538c0 0x7f80d8153c90 unknown :-1 s=CLOSED pgs=2390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:30.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.195+0000 7f80df2a7700 1 -- 172.21.15.146:0/840843949 >> 172.21.15.146:0/840843949 conn(0x7f80d806eb10 msgr2=0x7f80d806ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:30.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.195+0000 7f80df2a7700 1 -- 172.21.15.146:0/840843949 shutdown_connections 2023-10-06T11:20:30.199 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.195+0000 7f80df2a7700 1 -- 172.21.15.146:0/840843949 wait complete. 2023-10-06T11:20:30.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.196+0000 7f80df2a7700 1 Processor -- start 2023-10-06T11:20:30.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.197+0000 7f80df2a7700 1 -- start start 2023-10-06T11:20:30.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.197+0000 7f80df2a7700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80d81538c0 0x7f80d81481e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:30.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.197+0000 7f80df2a7700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80d815a940 0x7f80d814bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:30.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.197+0000 7f80df2a7700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80d815dcc0 0x7f80d814f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:30.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.197+0000 7f80df2a7700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d80b0390 con 0x7f80d815dcc0 2023-10-06T11:20:30.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.197+0000 7f80df2a7700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d814c940 con 0x7f80d815a940 2023-10-06T11:20:30.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.197+0000 7f80df2a7700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80d814cc20 con 0x7f80d81538c0 2023-10-06T11:20:30.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.198+0000 7f80dd844700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80d815dcc0 0x7f80d814f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:30.202 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.198+0000 7f80dd844700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80d815dcc0 0x7f80d814f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45308/0 (socket says 172.21.15.146:45308) 2023-10-06T11:20:30.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.198+0000 7f80dd844700 1 -- 172.21.15.146:0/476446044 learned_addr learned my addr 172.21.15.146:0/476446044 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:30.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.198+0000 7f80dd043700 1 --2- 172.21.15.146:0/476446044 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80d81538c0 0x7f80d81481e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:30.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.198+0000 7f80dc842700 1 --2- 172.21.15.146:0/476446044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80d815a940 0x7f80d814bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:30.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.198+0000 7f80dd844700 1 -- 172.21.15.146:0/476446044 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80d81538c0 msgr2=0x7f80d81481e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:30.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.198+0000 7f80dd844700 1 --2- 172.21.15.146:0/476446044 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80d81538c0 0x7f80d81481e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:30.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.198+0000 7f80dd844700 1 -- 172.21.15.146:0/476446044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80d815a940 msgr2=0x7f80d814bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:30.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.198+0000 7f80dd844700 1 --2- 172.21.15.146:0/476446044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80d815a940 0x7f80d814bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:30.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.198+0000 7f80dd844700 1 -- 172.21.15.146:0/476446044 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d40094f0 con 0x7f80d815dcc0 2023-10-06T11:20:30.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.198+0000 7f80dd844700 1 --2- 172.21.15.146:0/476446044 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80d815dcc0 0x7f80d814f4f0 secure :-1 s=READY pgs=2391 cs=0 l=1 rev1=1 crypto rx=0x7f80d000bc30 tx=0x7f80d0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:30.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.198+0000 7f80cd7fa700 1 -- 172.21.15.146:0/476446044 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d00092e0 con 0x7f80d815dcc0 2023-10-06T11:20:30.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.198+0000 7f80cd7fa700 1 -- 172.21.15.146:0/476446044 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d000c630 con 0x7f80d815dcc0 2023-10-06T11:20:30.203 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.198+0000 7f80df2a7700 1 -- 172.21.15.146:0/476446044 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80d814cf00 con 0x7f80d815dcc0 2023-10-06T11:20:30.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.198+0000 7f80cd7fa700 1 -- 172.21.15.146:0/476446044 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d000ca10 con 0x7f80d815dcc0 2023-10-06T11:20:30.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.198+0000 7f80df2a7700 1 -- 172.21.15.146:0/476446044 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80d8148720 con 0x7f80d815dcc0 2023-10-06T11:20:30.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.199+0000 7f80df2a7700 1 -- 172.21.15.146:0/476446044 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80d80b0500 con 0x7f80d815dcc0 2023-10-06T11:20:30.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.199+0000 7f80cd7fa700 1 -- 172.21.15.146:0/476446044 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f80d0012070 con 0x7f80d815dcc0 2023-10-06T11:20:30.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.200+0000 7f80cd7fa700 1 --2- 172.21.15.146:0/476446044 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f80bc066f30 0x7f80bc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:30.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.200+0000 7f80cd7fa700 1 -- 172.21.15.146:0/476446044 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f80d0083f30 con 0x7f80d815dcc0 2023-10-06T11:20:30.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.200+0000 7f80dd043700 1 --2- 172.21.15.146:0/476446044 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f80bc066f30 0x7f80bc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:30.204 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.200+0000 7f80dd043700 1 --2- 172.21.15.146:0/476446044 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f80bc066f30 0x7f80bc0693e0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f80d40099b0 tx=0x7f80d4016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:30.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.205+0000 7f80cd7fa700 1 -- 172.21.15.146:0/476446044 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f80d80b0500 con 0x7f80d815dcc0 2023-10-06T11:20:30.389 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.388+0000 7f80df2a7700 1 -- 172.21.15.146:0/476446044 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f80d80b04d0 con 0x7f80bc066f30 2023-10-06T11:20:30.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.390+0000 7f80cd7fa700 1 -- 172.21.15.146:0/476446044 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73054 (secure 0 0 0) 0x7f80d80b04d0 con 0x7f80bc066f30 2023-10-06T11:20:30.393 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:20:30.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.394+0000 7f80df2a7700 1 -- 172.21.15.146:0/476446044 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f80bc066f30 msgr2=0x7f80bc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:30.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.394+0000 7f80df2a7700 1 --2- 172.21.15.146:0/476446044 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f80bc066f30 0x7f80bc0693e0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f80d40099b0 tx=0x7f80d4016000 comp rx=0 tx=0).stop 2023-10-06T11:20:30.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.394+0000 7f80df2a7700 1 -- 172.21.15.146:0/476446044 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80d815dcc0 msgr2=0x7f80d814f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:30.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.394+0000 7f80df2a7700 1 --2- 172.21.15.146:0/476446044 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80d815dcc0 0x7f80d814f4f0 secure :-1 s=READY pgs=2391 cs=0 l=1 rev1=1 crypto rx=0x7f80d000bc30 tx=0x7f80d0009840 comp rx=0 tx=0).stop 2023-10-06T11:20:30.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.394+0000 7f80df2a7700 1 -- 172.21.15.146:0/476446044 shutdown_connections 2023-10-06T11:20:30.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.394+0000 7f80df2a7700 1 --2- 172.21.15.146:0/476446044 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f80bc066f30 0x7f80bc0693e0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:30.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.394+0000 7f80df2a7700 1 --2- 172.21.15.146:0/476446044 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f80d815dcc0 0x7f80d814f4f0 unknown :-1 s=CLOSED pgs=2391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:30.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.394+0000 7f80df2a7700 1 --2- 172.21.15.146:0/476446044 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f80d81538c0 0x7f80d81481e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:30.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.394+0000 7f80df2a7700 1 --2- 172.21.15.146:0/476446044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80d815a940 0x7f80d814bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:30.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.394+0000 7f80df2a7700 1 -- 172.21.15.146:0/476446044 >> 172.21.15.146:0/476446044 conn(0x7f80d806eb10 msgr2=0x7f80d8150a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:30.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.394+0000 7f80df2a7700 1 -- 172.21.15.146:0/476446044 shutdown_connections 2023-10-06T11:20:30.396 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.394+0000 7f80df2a7700 1 -- 172.21.15.146:0/476446044 wait complete. 2023-10-06T11:20:30.396 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:20:30.407 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":622,"stamp":"2023-10-06T11:20:29.336234+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2450652,"kb_used_data":43676,"kb_used_omap":0,"kb_used_meta":2406912,"kb_avail":752524068,"statfs":{"total":773094113280,"available":770584645632,"internally_reserved":0,"allocated":44724224,"data_stored":34873071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2464677888},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12617801,"num_objects":-28,"num_object_clones":0,"num_object_copies":-56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-28,"num_whiteouts":0,"num_read":-66,"num_read_kb":-69,"num_write":-93,"num_write_kb":-12350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001127"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":162,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-06T11:20:26.038371+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:20:26.038371+0000","last_peered":"2023-10-06T11:20:26.038371+0000","last_clean":"2023-10-06T11:20:26.038371+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:20:26.038371+0000","last_undegraded":"2023-10-06T11:20:26.038371+0000","last_fullsized":"2023-10-06T11:20:26.038371+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":152,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-06T11:20:24.263432+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:20:24.263432+0000","last_peered":"2023-10-06T11:20:24.263432+0000","last_clean":"2023-10-06T11:20:24.263432+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:20:24.263432+0000","last_undegraded":"2023-10-06T11:20:24.263432+0000","last_fullsized":"2023-10-06T11:20:24.263432+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":150,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-06T11:20:26.347736+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:20:26.347736+0000","last_peered":"2023-10-06T11:20:26.347736+0000","last_clean":"2023-10-06T11:20:26.347736+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:20:26.347736+0000","last_undegraded":"2023-10-06T11:20:26.347736+0000","last_fullsized":"2023-10-06T11:20:26.347736+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":293,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-06T11:20:24.262733+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:20:24.262733+0000","last_peered":"2023-10-06T11:20:24.262733+0000","last_clean":"2023-10-06T11:20:24.262733+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:20:24.262733+0000","last_undegraded":"2023-10-06T11:20:24.262733+0000","last_fullsized":"2023-10-06T11:20:24.262733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":143,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-06T11:20:24.262978+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:20:24.262978+0000","last_peered":"2023-10-06T11:20:24.262978+0000","last_clean":"2023-10-06T11:20:24.262978+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:20:24.262978+0000","last_undegraded":"2023-10-06T11:20:24.262978+0000","last_fullsized":"2023-10-06T11:20:24.262978+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":143,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-06T11:20:24.262837+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:20:24.262837+0000","last_peered":"2023-10-06T11:20:24.262837+0000","last_clean":"2023-10-06T11:20:24.262837+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:20:24.262837+0000","last_undegraded":"2023-10-06T11:20:24.262837+0000","last_fullsized":"2023-10-06T11:20:24.262837+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":169,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-06T11:20:24.031145+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:20:24.031145+0000","last_peered":"2023-10-06T11:20:24.031145+0000","last_clean":"2023-10-06T11:20:24.031145+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:20:24.031145+0000","last_undegraded":"2023-10-06T11:20:24.031145+0000","last_fullsized":"2023-10-06T11:20:24.031145+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":151,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-06T11:20:26.346200+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:20:26.346200+0000","last_peered":"2023-10-06T11:20:26.346200+0000","last_clean":"2023-10-06T11:20:26.346200+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:20:26.346200+0000","last_undegraded":"2023-10-06T11:20:26.346200+0000","last_fullsized":"2023-10-06T11:20:26.346200+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":151,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-06T11:20:26.347708+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:20:26.347708+0000","last_peered":"2023-10-06T11:20:26.347708+0000","last_clean":"2023-10-06T11:20:26.347708+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:20:26.347708+0000","last_undegraded":"2023-10-06T11:20:26.347708+0000","last_fullsized":"2023-10-06T11:20:26.347708+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575029,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306288,"kb_used_data":4904,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94065552,"statfs":{"total":96636764160,"available":96323125248,"internally_reserved":0,"allocated":5021696,"data_stored":3780613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.51300000000000001,"15min":0.63300000000000001},"min":{"1min":0.37,"5min":0.27200000000000002,"15min":0.21199999999999999},"max":{"1min":0.68500000000000005,"5min":0.71899999999999997,"15min":23.908999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.54600000000000004,"15min":0.57999999999999996},"min":{"1min":0.35399999999999998,"5min":0.313,"15min":0.22500000000000001},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":9.3230000000000004},"last":0.72299999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.53200000000000003,"15min":0.55900000000000005},"min":{"1min":0.434,"5min":0.28799999999999998,"15min":0.26000000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":9.2360000000000007},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.52200000000000002,"15min":0.50900000000000001},"min":{"1min":0.41599999999999998,"5min":0.373,"15min":0.25900000000000001},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":4.327},"last":0.41599999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.39400000000000002,"5min":0.313,"15min":0.26500000000000001},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":4.3120000000000003},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.55900000000000005,"15min":0.56399999999999995},"min":{"1min":0.40899999999999997,"5min":0.34799999999999998,"15min":0.29999999999999999},"max":{"1min":1.109,"5min":1.109,"15min":4.7309999999999999},"last":0.67800000000000005}]},{"osd":3,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.55200000000000005,"15min":0.55600000000000005},"min":{"1min":0.47499999999999998,"5min":0.35299999999999998,"15min":0.27900000000000003},"max":{"1min":0.75900000000000001,"5min":0.77000000000000002,"15min":4.5190000000000001},"last":0.377},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58099999999999996,"15min":0.60399999999999998},"min":{"1min":0.45500000000000002,"5min":0.38100000000000001,"15min":0.29699999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":9.3879999999999999},"last":0.60699999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.48099999999999998,"15min":0.496},"min":{"1min":0.32000000000000001,"5min":0.26300000000000001,"15min":0.24399999999999999},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":4.6639999999999997},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.51100000000000001,"15min":0.53000000000000003},"min":{"1min":0.34599999999999997,"5min":0.33300000000000002,"15min":0.27300000000000002},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":4.3689999999999998},"last":0.58599999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.52700000000000002,"15min":0.55200000000000005},"min":{"1min":0.371,"5min":0.32600000000000001,"15min":0.26000000000000001},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":9.3499999999999996},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52400000000000002,"15min":0.53200000000000003},"min":{"1min":0.36899999999999999,"5min":0.36199999999999999,"15min":0.26800000000000002},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":4.444},"last":0.65500000000000003}]},{"osd":6,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56499999999999995,"15min":0.58699999999999997},"min":{"1min":0.41099999999999998,"5min":0.32400000000000001,"15min":0.29199999999999998},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":9.4969999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58799999999999997,"15min":0.61499999999999999},"min":{"1min":0.40500000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":7.2039999999999997},"last":0.624}]}]},{"osd":6,"up_from":13,"seq":55834575031,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305672,"kb_used_data":8384,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94066168,"statfs":{"total":96636764160,"available":96323756032,"internally_reserved":0,"allocated":8585216,"data_stored":7355540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.42299999999999999,"5min":0.218,"15min":0.187},"max":{"1min":0.71499999999999997,"5min":1.488,"15min":9.5549999999999997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.63200000000000001,"15min":0.59399999999999997},"min":{"1min":0.45600000000000002,"5min":0.29699999999999999,"15min":0.254},"max":{"1min":0.77200000000000002,"5min":4.9930000000000003,"15min":9.4659999999999993},"last":0.68300000000000005}]},{"osd":1,"last update":"Fri Oct 6 11:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52400000000000002,"15min":0.49199999999999999},"min":{"1min":0.35199999999999998,"5min":0.23699999999999999,"15min":0.23300000000000001},"max":{"1min":0.64300000000000002,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.75,"15min":0.59699999999999998},"min":{"1min":0.39400000000000002,"5min":0.25800000000000001,"15min":0.216},"max":{"1min":0.80200000000000005,"5min":21.306000000000001,"15min":21.306000000000001},"last":0.64900000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55500000000000005,"15min":0.52300000000000002},"min":{"1min":0.438,"5min":0.29399999999999998,"15min":0.252},"max":{"1min":0.68400000000000005,"5min":2.8250000000000002,"15min":7.0659999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.70699999999999996,"15min":0.58399999999999996},"min":{"1min":0.40600000000000003,"5min":0.27800000000000002,"15min":0.26600000000000001},"max":{"1min":0.69999999999999996,"5min":17.216000000000001,"15min":17.216000000000001},"last":0.49299999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.58999999999999997,"15min":0.54800000000000004},"min":{"1min":0.35499999999999998,"5min":0.29999999999999999,"15min":0.25800000000000001},"max":{"1min":0.72599999999999998,"5min":4.9400000000000004,"15min":4.9400000000000004},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.68700000000000006,"15min":0.58199999999999996},"min":{"1min":0.39300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.73799999999999999,"5min":12.159000000000001,"15min":12.159000000000001},"last":0.62}]},{"osd":4,"last update":"Fri Oct 6 11:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.498,"15min":0.47799999999999998},"min":{"1min":0.31,"5min":0.27400000000000002,"15min":0.24299999999999999},"max":{"1min":0.61299999999999999,"5min":1.669,"15min":1.669},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.58099999999999996,"15min":0.53900000000000003},"min":{"1min":0.33200000000000002,"5min":0.29699999999999999,"15min":0.27900000000000003},"max":{"1min":0.66600000000000004,"5min":4.8949999999999996,"15min":4.8949999999999996},"last":0.40400000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.53800000000000003,"15min":0.51800000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.28399999999999997},"max":{"1min":0.621,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.61399999999999999,"15min":0.59099999999999997},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.755,"5min":4.7080000000000002,"15min":7.1379999999999999},"last":0.44800000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.63800000000000001,"15min":0.58599999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.27900000000000003},"max":{"1min":0.66900000000000004,"5min":5.7709999999999999,"15min":5.7709999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.63100000000000001,"15min":0.59299999999999997},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.30199999999999999},"max":{"1min":0.69199999999999995,"5min":3.5579999999999998,"15min":3.5579999999999998},"last":0.434}]}]},{"osd":1,"up_from":13,"seq":55834575030,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":300112,"kb_used_data":2824,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071728,"statfs":{"total":96636764160,"available":96329449472,"internally_reserved":0,"allocated":2891776,"data_stored":1655805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.34599999999999997,"15min":0.379},"min":{"1min":0.27500000000000002,"5min":0.19900000000000001,"15min":0.186},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":13.393000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.36899999999999999,"15min":0.39000000000000001},"min":{"1min":0.26700000000000002,"5min":0.20599999999999999,"15min":0.19700000000000001},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":11.462},"last":0.36099999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.36099999999999999,"15min":0.37},"min":{"1min":0.30499999999999999,"5min":0.217,"15min":0.216},"max":{"1min":0.56699999999999995,"5min":0.72599999999999998,"15min":8.0470000000000006},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.40699999999999997,"15min":0.41199999999999998},"min":{"1min":0.30299999999999999,"5min":0.215,"15min":0.20999999999999999},"max":{"1min":0.61199999999999999,"5min":0.66700000000000004,"15min":4.8630000000000004},"last":0.41199999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.42399999999999999,"15min":0.42899999999999999},"min":{"1min":0.32100000000000001,"5min":0.255,"15min":0.252},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":4.8029999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.41399999999999998,"15min":0.40799999999999997},"min":{"1min":0.35099999999999998,"5min":0.23799999999999999,"15min":0.217},"max":{"1min":0.63600000000000001,"5min":0.749,"15min":5.8700000000000001},"last":0.46400000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58299999999999996,"15min":0.54400000000000004},"min":{"1min":0.435,"5min":0.28299999999999997,"15min":0.28199999999999997},"max":{"1min":0.82299999999999995,"5min":0.88400000000000001,"15min":1.264},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.59499999999999997,"15min":0.58699999999999997},"min":{"1min":0.41299999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.82499999999999996,"5min":0.92800000000000005,"15min":4.7699999999999996},"last":0.61099999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59499999999999997,"15min":0.58099999999999996},"min":{"1min":0.46100000000000002,"5min":0.378,"15min":0.32400000000000001},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":3.4390000000000001},"last":0.623},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.61399999999999999,"15min":0.61199999999999999},"min":{"1min":0.44900000000000001,"5min":0.39000000000000001,"15min":0.29499999999999998},"max":{"1min":0.88800000000000001,"5min":0.92000000000000004,"15min":9.3829999999999991},"last":0.59899999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63900000000000001,"15min":0.60999999999999999},"min":{"1min":0.51000000000000001,"5min":0.42099999999999999,"15min":0.315},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":3.4750000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65200000000000002,"15min":0.61799999999999999},"min":{"1min":0.54500000000000004,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":3.9180000000000001},"last":0.52100000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.63200000000000001,"15min":0.625},"min":{"1min":0.434,"5min":0.39800000000000002,"15min":0.38500000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":4.7290000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.63,"15min":0.60799999999999998},"min":{"1min":0.51600000000000001,"5min":0.41399999999999998,"15min":0.374},"max":{"1min":0.86099999999999999,"5min":0.89200000000000002,"15min":2.4500000000000002},"last":0.68600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575029,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307708,"kb_used_data":6324,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94064132,"statfs":{"total":96636764160,"available":96321671168,"internally_reserved":0,"allocated":6475776,"data_stored":5251961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.35699999999999998,"15min":0.47499999999999998},"min":{"1min":0.23000000000000001,"5min":0.20999999999999999,"15min":0.184},"max":{"1min":0.56799999999999995,"5min":0.60199999999999998,"15min":36.097999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.36599999999999999,"15min":0.38600000000000001},"min":{"1min":0.27700000000000002,"5min":0.23100000000000001,"15min":0.182},"max":{"1min":0.47199999999999998,"5min":0.92400000000000004,"15min":7.2990000000000004},"last":0.27100000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.372,"15min":0.504},"min":{"1min":0.29799999999999999,"5min":0.223,"15min":0.217},"max":{"1min":0.53000000000000003,"5min":0.56100000000000005,"15min":36.07},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.40600000000000003,"15min":0.41599999999999998},"min":{"1min":0.32500000000000001,"5min":0.26600000000000001,"15min":0.219},"max":{"1min":0.58799999999999997,"5min":0.94899999999999995,"15min":6.7800000000000002},"last":0.36699999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.376,"15min":0.39400000000000002},"min":{"1min":0.30599999999999999,"5min":0.253,"15min":0.223},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":8.4130000000000003},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.443,"15min":0.55800000000000005},"min":{"1min":0.34699999999999998,"5min":0.27800000000000002,"15min":0.249},"max":{"1min":0.55900000000000005,"5min":1.9079999999999999,"15min":35.959000000000003},"last":0.497}]},{"osd":4,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61399999999999999,"15min":0.57999999999999996},"min":{"1min":0.39500000000000002,"5min":0.36699999999999999,"15min":0.29599999999999999},"max":{"1min":0.88600000000000001,"5min":0.93500000000000005,"15min":2.427},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.61699999999999999,"15min":0.73299999999999998},"min":{"1min":0.42399999999999999,"5min":0.41299999999999998,"15min":0.29299999999999998},"max":{"1min":0.82999999999999996,"5min":0.91100000000000003,"15min":36.005000000000003},"last":0.68200000000000005}]},{"osd":5,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40400000000000003,"5min":0.374,"15min":0.32900000000000001},"max":{"1min":0.94199999999999995,"5min":0.999,"15min":6.6699999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58799999999999997,"15min":0.56699999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.315},"max":{"1min":0.90200000000000002,"5min":0.99399999999999999,"15min":2.0600000000000001},"last":0.47599999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.626,"15min":0.73699999999999999},"min":{"1min":0.498,"5min":0.39200000000000002,"15min":0.317},"max":{"1min":0.86299999999999999,"5min":0.89600000000000002,"15min":36.037999999999997},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.64300000000000002,"15min":0.64900000000000002},"min":{"1min":0.42599999999999999,"5min":0.41299999999999998,"15min":0.36399999999999999},"max":{"1min":0.89900000000000002,"5min":1.028,"15min":6.7110000000000003},"last":0.58599999999999997}]},{"osd":7,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.61899999999999999,"15min":0.627},"min":{"1min":0.44500000000000001,"5min":0.39400000000000002,"15min":0.371},"max":{"1min":0.84199999999999997,"5min":1.054,"15min":6.742},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.60999999999999999,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.39200000000000002,"15min":0.34499999999999997},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":1.917},"last":0.61099999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575030,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299516,"kb_used_data":2228,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072324,"statfs":{"total":96636764160,"available":96330059776,"internally_reserved":0,"allocated":2281472,"data_stored":1057657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.49099999999999999,"15min":0.37},"min":{"1min":0.247,"5min":0.22900000000000001,"15min":0.17999999999999999},"max":{"1min":0.443,"5min":15.228,"15min":15.228},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.433,"15min":0.39700000000000002},"min":{"1min":0.35399999999999998,"5min":0.28599999999999998,"15min":0.20999999999999999},"max":{"1min":0.58899999999999997,"5min":1.714,"15min":1.714},"last":0.376}]},{"osd":1,"last update":"Fri Oct 6 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.39700000000000002,"15min":0.379},"min":{"1min":0.35199999999999998,"5min":0.253,"15min":0.19900000000000001},"max":{"1min":0.55300000000000005,"5min":0.56999999999999995,"15min":0.745},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.39200000000000002,"15min":0.36599999999999999},"min":{"1min":0.29999999999999999,"5min":0.23200000000000001,"15min":0.216},"max":{"1min":0.52300000000000002,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.26500000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.39500000000000002,"15min":0.373},"min":{"1min":0.35999999999999999,"5min":0.255,"15min":0.23200000000000001},"max":{"1min":0.54300000000000004,"5min":0.621,"15min":0.629},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.40699999999999997,"15min":0.377},"min":{"1min":0.33800000000000002,"5min":0.26600000000000001,"15min":0.251},"max":{"1min":0.56100000000000005,"5min":0.754,"15min":0.754},"last":0.307}]},{"osd":4,"last update":"Fri Oct 6 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.58999999999999997,"15min":0.54300000000000004},"min":{"1min":0.52900000000000003,"5min":0.35799999999999998,"15min":0.30299999999999999},"max":{"1min":0.75700000000000001,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.72099999999999997,"15min":0.59899999999999998},"min":{"1min":0.38300000000000001,"5min":0.36499999999999999,"15min":0.27900000000000003},"max":{"1min":0.92400000000000004,"5min":15.26,"15min":15.26},"last":0.42799999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.72999999999999998,"15min":0.60199999999999998},"min":{"1min":0.45000000000000001,"5min":0.38200000000000001,"15min":0.32400000000000001},"max":{"1min":0.874,"5min":15.186,"15min":15.186},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.60099999999999998,"15min":0.56899999999999995},"min":{"1min":0.47399999999999998,"5min":0.40600000000000003,"15min":0.35099999999999998},"max":{"1min":0.78300000000000003,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.496}]},{"osd":6,"last update":"Fri Oct 6 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.624,"15min":0.59199999999999997},"min":{"1min":0.5,"5min":0.42599999999999999,"15min":0.32600000000000001},"max":{"1min":0.90400000000000003,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.63100000000000001,"15min":0.58899999999999997},"min":{"1min":0.505,"5min":0.438,"15min":0.34200000000000003},"max":{"1min":0.82099999999999995,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.50600000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.70699999999999996,"15min":0.60899999999999999},"min":{"1min":0.47499999999999998,"5min":0.41099999999999998,"15min":0.34499999999999997},"max":{"1min":0.83599999999999997,"5min":10.977,"15min":10.977},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.60699999999999998,"15min":0.57899999999999996},"min":{"1min":0.53700000000000003,"5min":0.39600000000000002,"15min":0.38200000000000001},"max":{"1min":0.75,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.438}]}]},{"osd":3,"up_from":13,"seq":55834575030,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":317956,"kb_used_data":8380,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94053884,"statfs":{"total":96636764160,"available":96311177216,"internally_reserved":0,"allocated":8581120,"data_stored":7349165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.375,"15min":0.33300000000000002},"min":{"1min":0.25900000000000001,"5min":0.19500000000000001,"15min":0.18099999999999999},"max":{"1min":0.58399999999999996,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.442,"15min":0.39100000000000001},"min":{"1min":0.36499999999999999,"5min":0.23000000000000001,"15min":0.22700000000000001},"max":{"1min":0.60899999999999999,"5min":4.4820000000000002,"15min":4.4820000000000002},"last":0.33700000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.34300000000000003,"15min":0.32300000000000001},"min":{"1min":0.308,"5min":0.22800000000000001,"15min":0.21299999999999999},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.65400000000000003},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.38200000000000001,"15min":0.36099999999999999},"min":{"1min":0.34100000000000003,"5min":0.251,"15min":0.188},"max":{"1min":0.52600000000000002,"5min":0.54100000000000004,"15min":1.196},"last":0.48199999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.41799999999999998,"15min":0.38},"min":{"1min":0.32900000000000001,"5min":0.23400000000000001,"15min":0.19600000000000001},"max":{"1min":0.56499999999999995,"5min":4.601,"15min":4.601},"last":0.375},{"interface":"front","average":{"1min":0.5,"5min":0.46600000000000003,"15min":0.42399999999999999},"min":{"1min":0.38800000000000001,"5min":0.28499999999999998,"15min":0.26100000000000001},"max":{"1min":0.66600000000000004,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.52000000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57999999999999996,"15min":0.54800000000000004},"min":{"1min":0.46300000000000002,"5min":0.378,"15min":0.311},"max":{"1min":0.79700000000000004,"5min":0.84099999999999997,"15min":1.694},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.58699999999999997,"15min":0.55000000000000004},"min":{"1min":0.40899999999999997,"5min":0.32600000000000001,"15min":0.30199999999999999},"max":{"1min":0.82299999999999995,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.38600000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.57899999999999996,"15min":0.55200000000000005},"min":{"1min":0.46899999999999997,"5min":0.34100000000000003,"15min":0.29399999999999998},"max":{"1min":0.77500000000000002,"5min":0.83999999999999997,"15min":0.878},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.58899999999999997,"15min":0.56200000000000006},"min":{"1min":0.45900000000000002,"5min":0.35699999999999998,"15min":0.29699999999999999},"max":{"1min":0.80800000000000005,"5min":0.91000000000000003,"15min":1.165},"last":0.71399999999999997}]},{"osd":6,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.622,"15min":0.58699999999999997},"min":{"1min":0.496,"5min":0.42499999999999999,"15min":0.36699999999999999},"max":{"1min":0.84099999999999997,"5min":0.95399999999999996,"15min":1.1359999999999999},"last":0.752},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.625,"15min":0.59299999999999997},"min":{"1min":0.49199999999999999,"5min":0.36799999999999999,"15min":0.34399999999999997},"max":{"1min":0.80500000000000005,"5min":1.012,"15min":1.7470000000000001},"last":0.40400000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.60899999999999999,"15min":0.57999999999999996},"min":{"1min":0.51200000000000001,"5min":0.39600000000000002,"15min":0.35599999999999998},"max":{"1min":0.83499999999999996,"5min":0.89900000000000002,"15min":1.657},"last":0.432},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.61099999999999999,"15min":0.58399999999999996},"min":{"1min":0.53500000000000003,"5min":0.40400000000000003,"15min":0.35499999999999998},"max":{"1min":0.86699999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.496}]}]},{"osd":4,"up_from":13,"seq":55834575029,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307724,"kb_used_data":2244,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064116,"statfs":{"total":96636764160,"available":96321654784,"internally_reserved":0,"allocated":2297856,"data_stored":1065437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:20:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.50600000000000001,"15min":0.49399999999999999},"min":{"1min":0.39000000000000001,"5min":0.24199999999999999,"15min":0.19500000000000001},"max":{"1min":0.67500000000000004,"5min":0.76800000000000002,"15min":2.6619999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52800000000000002,"15min":0.498},"min":{"1min":0.33900000000000002,"5min":0.28899999999999998,"15min":0.215},"max":{"1min":0.65400000000000003,"5min":0.81499999999999995,"15min":0.91200000000000003},"last":0.56999999999999995}]},{"osd":1,"last update":"Fri Oct 6 11:20:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52400000000000002,"15min":0.51300000000000001},"min":{"1min":0.35099999999999998,"5min":0.27600000000000002,"15min":0.23300000000000001},"max":{"1min":0.68000000000000005,"5min":0.94099999999999995,"15min":2.8650000000000002},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53200000000000003,"15min":0.52200000000000002},"min":{"1min":0.42599999999999999,"5min":0.27000000000000002,"15min":0.25800000000000001},"max":{"1min":0.63600000000000001,"5min":0.79800000000000004,"15min":2.7610000000000001},"last":0.63}]},{"osd":2,"last update":"Fri Oct 6 11:20:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55800000000000005,"15min":0.52600000000000002},"min":{"1min":0.32500000000000001,"5min":0.312,"15min":0.23100000000000001},"max":{"1min":0.72399999999999998,"5min":0.88800000000000001,"15min":1.6910000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58899999999999997,"15min":0.57199999999999995},"min":{"1min":0.40200000000000002,"5min":0.38700000000000001,"15min":0.30599999999999999},"max":{"1min":0.73399999999999999,"5min":0.84999999999999998,"15min":1.718},"last":0.378}]},{"osd":3,"last update":"Fri Oct 6 11:20:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56100000000000005,"15min":0.56399999999999995},"min":{"1min":0.46500000000000002,"5min":0.36699999999999999,"15min":0.26700000000000002},"max":{"1min":0.71799999999999997,"5min":0.79600000000000004,"15min":2.677},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56499999999999995,"15min":0.53500000000000003},"min":{"1min":0.435,"5min":0.35599999999999998,"15min":0.27500000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":1.784},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:20:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.48999999999999999,"15min":0.47699999999999998},"min":{"1min":0.34200000000000003,"5min":0.33700000000000002,"15min":0.23200000000000001},"max":{"1min":0.72899999999999998,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.54700000000000004,"15min":0.52200000000000002},"min":{"1min":0.378,"5min":0.29099999999999998,"15min":0.28399999999999997},"max":{"1min":0.76700000000000002,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.75}]},{"osd":6,"last update":"Fri Oct 6 11:20:02 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.54700000000000004,"15min":0.52100000000000002},"min":{"1min":0.36499999999999999,"5min":0.30199999999999999,"15min":0.252},"max":{"1min":0.86799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.56299999999999994,"15min":0.54900000000000004},"min":{"1min":0.40600000000000003,"5min":0.38700000000000001,"15min":0.29199999999999998},"max":{"1min":0.79400000000000004,"5min":0.90400000000000003,"15min":1.165},"last":0.66400000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:20:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57699999999999996,"15min":0.56100000000000005},"min":{"1min":0.438,"5min":0.312,"15min":0.312},"max":{"1min":0.80600000000000005,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.62},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.60899999999999999,"15min":0.58699999999999997},"min":{"1min":0.38500000000000001,"5min":0.34399999999999997,"15min":0.317},"max":{"1min":0.89600000000000002,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.64800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575031,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305676,"kb_used_data":8388,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94066164,"statfs":{"total":96636764160,"available":96323751936,"internally_reserved":0,"allocated":8589312,"data_stored":7356893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52000000000000002,"15min":0.53100000000000003},"min":{"1min":0.29299999999999998,"5min":0.26000000000000001,"15min":0.20499999999999999},"max":{"1min":0.72699999999999998,"5min":0.752,"15min":5.0490000000000004},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51800000000000002,"15min":0.51500000000000001},"min":{"1min":0.34599999999999997,"5min":0.26600000000000001,"15min":0.22900000000000001},"max":{"1min":0.69399999999999995,"5min":0.75,"15min":5.1449999999999996},"last":0.48599999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.52600000000000002,"15min":0.49199999999999999},"min":{"1min":0.35999999999999999,"5min":0.27800000000000002,"15min":0.25},"max":{"1min":0.70299999999999996,"5min":0.76400000000000001,"15min":0.97199999999999998},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54300000000000004,"15min":0.51400000000000001},"min":{"1min":0.33500000000000002,"5min":0.29799999999999999,"15min":0.27400000000000002},"max":{"1min":0.74199999999999999,"5min":0.752,"15min":1.8799999999999999},"last":0.61899999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56799999999999995,"15min":0.55200000000000005},"min":{"1min":0.36499999999999999,"5min":0.313,"15min":0.28299999999999997},"max":{"1min":0.755,"5min":0.80700000000000005,"15min":4.234},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59699999999999998,"15min":0.56299999999999994},"min":{"1min":0.438,"5min":0.35899999999999999,"15min":0.315},"max":{"1min":0.753,"5min":0.82099999999999995,"15min":1.0369999999999999},"last":0.51000000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52900000000000003,"15min":0.54200000000000004},"min":{"1min":0.34499999999999997,"5min":0.29499999999999998,"15min":0.27700000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":5.2169999999999996},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.55900000000000005,"15min":0.54000000000000004},"min":{"1min":0.372,"5min":0.32400000000000001,"15min":0.29699999999999999},"max":{"1min":0.72899999999999998,"5min":0.76000000000000001,"15min":1.008},"last":0.54800000000000004}]},{"osd":4,"last update":"Fri Oct 6 11:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.49099999999999999,"15min":0.49399999999999999},"min":{"1min":0.28699999999999998,"5min":0.26400000000000001,"15min":0.23999999999999999},"max":{"1min":0.52600000000000002,"5min":0.78000000000000003,"15min":1.917},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.50600000000000001,"15min":0.504},"min":{"1min":0.33300000000000002,"5min":0.251,"15min":0.23899999999999999},"max":{"1min":0.58299999999999996,"5min":0.77600000000000002,"15min":0.87},"last":0.56699999999999995}]},{"osd":6,"last update":"Fri Oct 6 11:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.52500000000000002,"15min":0.53000000000000003},"min":{"1min":0.372,"5min":0.32700000000000001,"15min":0.27600000000000002},"max":{"1min":0.55700000000000005,"5min":0.78800000000000003,"15min":2.0139999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.59499999999999997,"15min":0.58799999999999997},"min":{"1min":0.35599999999999998,"5min":0.30299999999999999,"15min":0.29999999999999999},"max":{"1min":0.79100000000000004,"5min":0.85099999999999998,"15min":1.9470000000000001},"last":0.68500000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.55000000000000004,"15min":0.55200000000000005},"min":{"1min":0.32900000000000001,"5min":0.311,"15min":0.27700000000000002},"max":{"1min":0.73699999999999999,"5min":0.79700000000000004,"15min":0.96499999999999997},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.39700000000000002,"5min":0.29199999999999998,"15min":0.28799999999999998},"max":{"1min":0.70299999999999996,"5min":0.81399999999999995,"15min":1.4119999999999999},"last":0.628}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:20:30.410 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:20:30.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.523+0000 7f8ef4ab8700 1 Processor -- start 2023-10-06T11:20:30.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.523+0000 7f8ef4ab8700 1 -- start start 2023-10-06T11:20:30.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.524+0000 7f8ef4ab8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ef013fbb0 0x7f8ef00c6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:30.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.524+0000 7f8ef4ab8700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8ef0159fc0 0x7f8ef015a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:30.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.524+0000 7f8ef4ab8700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ef015a960 con 0x7f8ef013ff80 2023-10-06T11:20:30.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.524+0000 7f8ef4ab8700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ef00caa40 con 0x7f8ef0159fc0 2023-10-06T11:20:30.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.524+0000 7f8ef4ab8700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef015adc0 con 0x7f8ef013fbb0 2023-10-06T11:20:30.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.524+0000 7f8eee59c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ef013fbb0 0x7f8ef00c6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:30.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.524+0000 7f8eeed9d700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8ef0159fc0 0x7f8ef015a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:30.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.524+0000 7f8eee59c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ef013fbb0 0x7f8ef00c6800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:50962/0 (socket says 172.21.15.146:50962) 2023-10-06T11:20:30.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.524+0000 7f8eeed9d700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8ef0159fc0 0x7f8ef015a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:52996/0 (socket says 172.21.15.146:52996) 2023-10-06T11:20:30.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.524+0000 7f8eedd9b700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f8ef013ff80 0x7f8ef006ed40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:48972/0 (socket says 172.21.15.146:48972) 2023-10-06T11:20:30.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.524+0000 7f8eee59c700 1 -- 172.21.15.146:0/2693341838 learned_addr learned my addr 172.21.15.146:0/2693341838 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:30.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.524+0000 7f8eee59c700 1 -- 172.21.15.146:0/2693341838 >> v2:172.21.15.151:3300/0 conn(0x7f8ef0159fc0 msgr2=0x7f8ef015a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:30.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.524+0000 7f8eee59c700 1 --2- 172.21.15.146:0/2693341838 >> v2:172.21.15.151:3300/0 conn(0x7f8ef0159fc0 0x7f8ef015a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:30.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.524+0000 7f8eee59c700 1 -- 172.21.15.146:0/2693341838 >> v1:172.21.15.151:6789/0 conn(0x7f8ef013ff80 legacy=0x7f8ef006ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:30.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.524+0000 7f8eee59c700 1 -- 172.21.15.146:0/2693341838 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef00c9e30 con 0x7f8ef013fbb0 2023-10-06T11:20:30.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.525+0000 7f8eee59c700 1 --2- 172.21.15.146:0/2693341838 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ef013fbb0 0x7f8ef00c6800 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8ee000bc50 tx=0x7f8ee000b4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=880e933ec991e2ab server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:30.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.525+0000 7f8eed59a700 1 -- 172.21.15.146:0/2693341838 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee000dbf0 con 0x7f8ef013fbb0 2023-10-06T11:20:30.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.525+0000 7f8eed59a700 1 -- 172.21.15.146:0/2693341838 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee000dd50 con 0x7f8ef013fbb0 2023-10-06T11:20:30.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.525+0000 7f8eed59a700 1 -- 172.21.15.146:0/2693341838 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee00196b0 con 0x7f8ef013fbb0 2023-10-06T11:20:30.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.525+0000 7f8ef4ab8700 1 -- 172.21.15.146:0/2693341838 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ef013fbb0 msgr2=0x7f8ef00c6800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:30.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.525+0000 7f8ef4ab8700 1 --2- 172.21.15.146:0/2693341838 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ef013fbb0 0x7f8ef00c6800 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8ee000bc50 tx=0x7f8ee000b4f0 comp rx=0 tx=0).stop 2023-10-06T11:20:30.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.525+0000 7f8ef4ab8700 1 -- 172.21.15.146:0/2693341838 shutdown_connections 2023-10-06T11:20:30.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.525+0000 7f8ef4ab8700 1 --2- 172.21.15.146:0/2693341838 >> v2:172.21.15.151:3300/0 conn(0x7f8ef0159fc0 0x7f8ef015a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:30.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.525+0000 7f8ef4ab8700 1 --2- 172.21.15.146:0/2693341838 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ef013fbb0 0x7f8ef00c6800 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:30.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.525+0000 7f8ef4ab8700 1 -- 172.21.15.146:0/2693341838 >> 172.21.15.146:0/2693341838 conn(0x7f8ef00cc1c0 msgr2=0x7f8ef00cc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:30.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.525+0000 7f8ef4ab8700 1 -- 172.21.15.146:0/2693341838 shutdown_connections 2023-10-06T11:20:30.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.525+0000 7f8ef4ab8700 1 -- 172.21.15.146:0/2693341838 wait complete. 2023-10-06T11:20:30.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.526+0000 7f8ef4ab8700 1 Processor -- start 2023-10-06T11:20:30.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.526+0000 7f8ef4ab8700 1 -- start start 2023-10-06T11:20:30.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.527+0000 7f8ef4ab8700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ef013fbb0 0x7f8ef0156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:30.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.527+0000 7f8ef4ab8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ef013ff80 0x7f8ef013d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:30.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.527+0000 7f8ef4ab8700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ef0159fc0 0x7f8ef013d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:30.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.527+0000 7f8ef4ab8700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef00c14e0 con 0x7f8ef013ff80 2023-10-06T11:20:30.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.527+0000 7f8ef4ab8700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef0157340 con 0x7f8ef013fbb0 2023-10-06T11:20:30.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.527+0000 7f8ef4ab8700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef00c2020 con 0x7f8ef0159fc0 2023-10-06T11:20:30.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.527+0000 7f8eedd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ef013ff80 0x7f8ef013d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:30.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.527+0000 7f8eedd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ef013ff80 0x7f8ef013d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45310/0 (socket says 172.21.15.146:45310) 2023-10-06T11:20:30.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.527+0000 7f8eedd9b700 1 -- 172.21.15.146:0/4282330931 learned_addr learned my addr 172.21.15.146:0/4282330931 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:30.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.527+0000 7f8eeed9d700 1 --2- 172.21.15.146:0/4282330931 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ef0159fc0 0x7f8ef013d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:30.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.527+0000 7f8eee59c700 1 --2- 172.21.15.146:0/4282330931 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ef013fbb0 0x7f8ef0156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:30.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.528+0000 7f8eedd9b700 1 -- 172.21.15.146:0/4282330931 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ef0159fc0 msgr2=0x7f8ef013d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:30.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.528+0000 7f8eedd9b700 1 --2- 172.21.15.146:0/4282330931 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ef0159fc0 0x7f8ef013d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:30.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.528+0000 7f8eedd9b700 1 -- 172.21.15.146:0/4282330931 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ef013fbb0 msgr2=0x7f8ef0156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:30.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.528+0000 7f8eedd9b700 1 --2- 172.21.15.146:0/4282330931 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ef013fbb0 0x7f8ef0156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:30.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.528+0000 7f8eedd9b700 1 -- 172.21.15.146:0/4282330931 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ee000b790 con 0x7f8ef013ff80 2023-10-06T11:20:30.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.528+0000 7f8eedd9b700 1 --2- 172.21.15.146:0/4282330931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ef013ff80 0x7f8ef013d3d0 secure :-1 s=READY pgs=2392 cs=0 l=1 rev1=1 crypto rx=0x7f8ee400c7c0 tx=0x7f8ee4007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:30.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.528+0000 7f8ede7fc700 1 -- 172.21.15.146:0/4282330931 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee4005a70 con 0x7f8ef013ff80 2023-10-06T11:20:30.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.528+0000 7f8ef4ab8700 1 -- 172.21.15.146:0/4282330931 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ef00afde0 con 0x7f8ef013ff80 2023-10-06T11:20:30.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.528+0000 7f8ede7fc700 1 -- 172.21.15.146:0/4282330931 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee4005bf0 con 0x7f8ef013ff80 2023-10-06T11:20:30.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.528+0000 7f8ede7fc700 1 -- 172.21.15.146:0/4282330931 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee40070d0 con 0x7f8ef013ff80 2023-10-06T11:20:30.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.528+0000 7f8ef4ab8700 1 -- 172.21.15.146:0/4282330931 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ef00c19d0 con 0x7f8ef013ff80 2023-10-06T11:20:30.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.529+0000 7f8ef4ab8700 1 -- 172.21.15.146:0/4282330931 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ef004c380 con 0x7f8ef013ff80 2023-10-06T11:20:30.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.529+0000 7f8ede7fc700 1 -- 172.21.15.146:0/4282330931 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ee4007480 con 0x7f8ef013ff80 2023-10-06T11:20:30.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.529+0000 7f8ede7fc700 1 --2- 172.21.15.146:0/4282330931 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8ed0066f30 0x7f8ed00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:30.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.530+0000 7f8ede7fc700 1 -- 172.21.15.146:0/4282330931 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f8ee40835e0 con 0x7f8ef013ff80 2023-10-06T11:20:30.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.530+0000 7f8eee59c700 1 --2- 172.21.15.146:0/4282330931 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8ed0066f30 0x7f8ed00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:30.534 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.530+0000 7f8eee59c700 1 --2- 172.21.15.146:0/4282330931 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8ed0066f30 0x7f8ed00693e0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f8ee000bc50 tx=0x7f8ee001b000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:30.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.535+0000 7f8ede7fc700 1 -- 172.21.15.146:0/4282330931 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ee4050990 con 0x7f8ef013ff80 2023-10-06T11:20:30.715 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.713+0000 7f8ef4ab8700 1 -- 172.21.15.146:0/4282330931 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8ef015a960 con 0x7f8ed0066f30 2023-10-06T11:20:30.717 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.716+0000 7f8ede7fc700 1 -- 172.21.15.146:0/4282330931 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73054 (secure 0 0 0) 0x7f8ef015a960 con 0x7f8ed0066f30 2023-10-06T11:20:30.718 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:20:30.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.718+0000 7f8ef4ab8700 1 -- 172.21.15.146:0/4282330931 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8ed0066f30 msgr2=0x7f8ed00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:30.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.718+0000 7f8ef4ab8700 1 --2- 172.21.15.146:0/4282330931 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8ed0066f30 0x7f8ed00693e0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f8ee000bc50 tx=0x7f8ee001b000 comp rx=0 tx=0).stop 2023-10-06T11:20:30.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.718+0000 7f8ef4ab8700 1 -- 172.21.15.146:0/4282330931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ef013ff80 msgr2=0x7f8ef013d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:30.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.718+0000 7f8ef4ab8700 1 --2- 172.21.15.146:0/4282330931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ef013ff80 0x7f8ef013d3d0 secure :-1 s=READY pgs=2392 cs=0 l=1 rev1=1 crypto rx=0x7f8ee400c7c0 tx=0x7f8ee4007f70 comp rx=0 tx=0).stop 2023-10-06T11:20:30.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.718+0000 7f8ef4ab8700 1 -- 172.21.15.146:0/4282330931 shutdown_connections 2023-10-06T11:20:30.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.718+0000 7f8ef4ab8700 1 --2- 172.21.15.146:0/4282330931 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f8ed0066f30 0x7f8ed00693e0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:30.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.718+0000 7f8ef4ab8700 1 --2- 172.21.15.146:0/4282330931 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ef0159fc0 0x7f8ef013d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:30.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.718+0000 7f8ef4ab8700 1 --2- 172.21.15.146:0/4282330931 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ef013fbb0 0x7f8ef0156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:30.720 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.718+0000 7f8ef4ab8700 1 --2- 172.21.15.146:0/4282330931 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f8ef013ff80 0x7f8ef013d3d0 unknown :-1 s=CLOSED pgs=2392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:30.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.718+0000 7f8ef4ab8700 1 -- 172.21.15.146:0/4282330931 >> 172.21.15.146:0/4282330931 conn(0x7f8ef00cc1c0 msgr2=0x7f8ef013e940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:30.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.718+0000 7f8ef4ab8700 1 -- 172.21.15.146:0/4282330931 shutdown_connections 2023-10-06T11:20:30.721 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.718+0000 7f8ef4ab8700 1 -- 172.21.15.146:0/4282330931 wait complete. 2023-10-06T11:20:30.721 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:20:30.732 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":622,"stamp":"2023-10-06T11:20:29.336234+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2450652,"kb_used_data":43676,"kb_used_omap":0,"kb_used_meta":2406912,"kb_avail":752524068,"statfs":{"total":773094113280,"available":770584645632,"internally_reserved":0,"allocated":44724224,"data_stored":34873071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2464677888},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12617801,"num_objects":-28,"num_object_clones":0,"num_object_copies":-56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-28,"num_whiteouts":0,"num_read":-66,"num_read_kb":-69,"num_write":-93,"num_write_kb":-12350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001127"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":162,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-06T11:20:26.038371+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:20:26.038371+0000","last_peered":"2023-10-06T11:20:26.038371+0000","last_clean":"2023-10-06T11:20:26.038371+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:20:26.038371+0000","last_undegraded":"2023-10-06T11:20:26.038371+0000","last_fullsized":"2023-10-06T11:20:26.038371+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":152,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-06T11:20:24.263432+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:20:24.263432+0000","last_peered":"2023-10-06T11:20:24.263432+0000","last_clean":"2023-10-06T11:20:24.263432+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:20:24.263432+0000","last_undegraded":"2023-10-06T11:20:24.263432+0000","last_fullsized":"2023-10-06T11:20:24.263432+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":150,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-06T11:20:26.347736+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:20:26.347736+0000","last_peered":"2023-10-06T11:20:26.347736+0000","last_clean":"2023-10-06T11:20:26.347736+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:20:26.347736+0000","last_undegraded":"2023-10-06T11:20:26.347736+0000","last_fullsized":"2023-10-06T11:20:26.347736+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":293,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-06T11:20:24.262733+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:20:24.262733+0000","last_peered":"2023-10-06T11:20:24.262733+0000","last_clean":"2023-10-06T11:20:24.262733+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:20:24.262733+0000","last_undegraded":"2023-10-06T11:20:24.262733+0000","last_fullsized":"2023-10-06T11:20:24.262733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":143,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-06T11:20:24.262978+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:20:24.262978+0000","last_peered":"2023-10-06T11:20:24.262978+0000","last_clean":"2023-10-06T11:20:24.262978+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:20:24.262978+0000","last_undegraded":"2023-10-06T11:20:24.262978+0000","last_fullsized":"2023-10-06T11:20:24.262978+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":143,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-06T11:20:24.262837+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:20:24.262837+0000","last_peered":"2023-10-06T11:20:24.262837+0000","last_clean":"2023-10-06T11:20:24.262837+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:20:24.262837+0000","last_undegraded":"2023-10-06T11:20:24.262837+0000","last_fullsized":"2023-10-06T11:20:24.262837+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":169,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-06T11:20:24.031145+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:20:24.031145+0000","last_peered":"2023-10-06T11:20:24.031145+0000","last_clean":"2023-10-06T11:20:24.031145+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:20:24.031145+0000","last_undegraded":"2023-10-06T11:20:24.031145+0000","last_fullsized":"2023-10-06T11:20:24.031145+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":151,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-06T11:20:26.346200+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:20:26.346200+0000","last_peered":"2023-10-06T11:20:26.346200+0000","last_clean":"2023-10-06T11:20:26.346200+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:20:26.346200+0000","last_undegraded":"2023-10-06T11:20:26.346200+0000","last_fullsized":"2023-10-06T11:20:26.346200+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":151,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-06T11:20:26.347708+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:20:26.347708+0000","last_peered":"2023-10-06T11:20:26.347708+0000","last_clean":"2023-10-06T11:20:26.347708+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:20:26.347708+0000","last_undegraded":"2023-10-06T11:20:26.347708+0000","last_fullsized":"2023-10-06T11:20:26.347708+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575029,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306288,"kb_used_data":4904,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94065552,"statfs":{"total":96636764160,"available":96323125248,"internally_reserved":0,"allocated":5021696,"data_stored":3780613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.51300000000000001,"15min":0.63300000000000001},"min":{"1min":0.37,"5min":0.27200000000000002,"15min":0.21199999999999999},"max":{"1min":0.68500000000000005,"5min":0.71899999999999997,"15min":23.908999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.54600000000000004,"15min":0.57999999999999996},"min":{"1min":0.35399999999999998,"5min":0.313,"15min":0.22500000000000001},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":9.3230000000000004},"last":0.72299999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.53200000000000003,"15min":0.55900000000000005},"min":{"1min":0.434,"5min":0.28799999999999998,"15min":0.26000000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":9.2360000000000007},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.52200000000000002,"15min":0.50900000000000001},"min":{"1min":0.41599999999999998,"5min":0.373,"15min":0.25900000000000001},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":4.327},"last":0.41599999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.39400000000000002,"5min":0.313,"15min":0.26500000000000001},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":4.3120000000000003},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.55900000000000005,"15min":0.56399999999999995},"min":{"1min":0.40899999999999997,"5min":0.34799999999999998,"15min":0.29999999999999999},"max":{"1min":1.109,"5min":1.109,"15min":4.7309999999999999},"last":0.67800000000000005}]},{"osd":3,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.55200000000000005,"15min":0.55600000000000005},"min":{"1min":0.47499999999999998,"5min":0.35299999999999998,"15min":0.27900000000000003},"max":{"1min":0.75900000000000001,"5min":0.77000000000000002,"15min":4.5190000000000001},"last":0.377},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58099999999999996,"15min":0.60399999999999998},"min":{"1min":0.45500000000000002,"5min":0.38100000000000001,"15min":0.29699999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":9.3879999999999999},"last":0.60699999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.48099999999999998,"15min":0.496},"min":{"1min":0.32000000000000001,"5min":0.26300000000000001,"15min":0.24399999999999999},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":4.6639999999999997},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.51100000000000001,"15min":0.53000000000000003},"min":{"1min":0.34599999999999997,"5min":0.33300000000000002,"15min":0.27300000000000002},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":4.3689999999999998},"last":0.58599999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.52700000000000002,"15min":0.55200000000000005},"min":{"1min":0.371,"5min":0.32600000000000001,"15min":0.26000000000000001},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":9.3499999999999996},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52400000000000002,"15min":0.53200000000000003},"min":{"1min":0.36899999999999999,"5min":0.36199999999999999,"15min":0.26800000000000002},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":4.444},"last":0.65500000000000003}]},{"osd":6,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56499999999999995,"15min":0.58699999999999997},"min":{"1min":0.41099999999999998,"5min":0.32400000000000001,"15min":0.29199999999999998},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":9.4969999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58799999999999997,"15min":0.61499999999999999},"min":{"1min":0.40500000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":7.2039999999999997},"last":0.624}]}]},{"osd":6,"up_from":13,"seq":55834575031,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305672,"kb_used_data":8384,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94066168,"statfs":{"total":96636764160,"available":96323756032,"internally_reserved":0,"allocated":8585216,"data_stored":7355540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.42299999999999999,"5min":0.218,"15min":0.187},"max":{"1min":0.71499999999999997,"5min":1.488,"15min":9.5549999999999997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.63200000000000001,"15min":0.59399999999999997},"min":{"1min":0.45600000000000002,"5min":0.29699999999999999,"15min":0.254},"max":{"1min":0.77200000000000002,"5min":4.9930000000000003,"15min":9.4659999999999993},"last":0.68300000000000005}]},{"osd":1,"last update":"Fri Oct 6 11:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52400000000000002,"15min":0.49199999999999999},"min":{"1min":0.35199999999999998,"5min":0.23699999999999999,"15min":0.23300000000000001},"max":{"1min":0.64300000000000002,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.75,"15min":0.59699999999999998},"min":{"1min":0.39400000000000002,"5min":0.25800000000000001,"15min":0.216},"max":{"1min":0.80200000000000005,"5min":21.306000000000001,"15min":21.306000000000001},"last":0.64900000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55500000000000005,"15min":0.52300000000000002},"min":{"1min":0.438,"5min":0.29399999999999998,"15min":0.252},"max":{"1min":0.68400000000000005,"5min":2.8250000000000002,"15min":7.0659999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.70699999999999996,"15min":0.58399999999999996},"min":{"1min":0.40600000000000003,"5min":0.27800000000000002,"15min":0.26600000000000001},"max":{"1min":0.69999999999999996,"5min":17.216000000000001,"15min":17.216000000000001},"last":0.49299999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.58999999999999997,"15min":0.54800000000000004},"min":{"1min":0.35499999999999998,"5min":0.29999999999999999,"15min":0.25800000000000001},"max":{"1min":0.72599999999999998,"5min":4.9400000000000004,"15min":4.9400000000000004},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.68700000000000006,"15min":0.58199999999999996},"min":{"1min":0.39300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.73799999999999999,"5min":12.159000000000001,"15min":12.159000000000001},"last":0.62}]},{"osd":4,"last update":"Fri Oct 6 11:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.498,"15min":0.47799999999999998},"min":{"1min":0.31,"5min":0.27400000000000002,"15min":0.24299999999999999},"max":{"1min":0.61299999999999999,"5min":1.669,"15min":1.669},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.58099999999999996,"15min":0.53900000000000003},"min":{"1min":0.33200000000000002,"5min":0.29699999999999999,"15min":0.27900000000000003},"max":{"1min":0.66600000000000004,"5min":4.8949999999999996,"15min":4.8949999999999996},"last":0.40400000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.53800000000000003,"15min":0.51800000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.28399999999999997},"max":{"1min":0.621,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.61399999999999999,"15min":0.59099999999999997},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.755,"5min":4.7080000000000002,"15min":7.1379999999999999},"last":0.44800000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.63800000000000001,"15min":0.58599999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.27900000000000003},"max":{"1min":0.66900000000000004,"5min":5.7709999999999999,"15min":5.7709999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.63100000000000001,"15min":0.59299999999999997},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.30199999999999999},"max":{"1min":0.69199999999999995,"5min":3.5579999999999998,"15min":3.5579999999999998},"last":0.434}]}]},{"osd":1,"up_from":13,"seq":55834575030,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":300112,"kb_used_data":2824,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071728,"statfs":{"total":96636764160,"available":96329449472,"internally_reserved":0,"allocated":2891776,"data_stored":1655805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.34599999999999997,"15min":0.379},"min":{"1min":0.27500000000000002,"5min":0.19900000000000001,"15min":0.186},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":13.393000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.36899999999999999,"15min":0.39000000000000001},"min":{"1min":0.26700000000000002,"5min":0.20599999999999999,"15min":0.19700000000000001},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":11.462},"last":0.36099999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.36099999999999999,"15min":0.37},"min":{"1min":0.30499999999999999,"5min":0.217,"15min":0.216},"max":{"1min":0.56699999999999995,"5min":0.72599999999999998,"15min":8.0470000000000006},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.40699999999999997,"15min":0.41199999999999998},"min":{"1min":0.30299999999999999,"5min":0.215,"15min":0.20999999999999999},"max":{"1min":0.61199999999999999,"5min":0.66700000000000004,"15min":4.8630000000000004},"last":0.41199999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.42399999999999999,"15min":0.42899999999999999},"min":{"1min":0.32100000000000001,"5min":0.255,"15min":0.252},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":4.8029999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.41399999999999998,"15min":0.40799999999999997},"min":{"1min":0.35099999999999998,"5min":0.23799999999999999,"15min":0.217},"max":{"1min":0.63600000000000001,"5min":0.749,"15min":5.8700000000000001},"last":0.46400000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58299999999999996,"15min":0.54400000000000004},"min":{"1min":0.435,"5min":0.28299999999999997,"15min":0.28199999999999997},"max":{"1min":0.82299999999999995,"5min":0.88400000000000001,"15min":1.264},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.59499999999999997,"15min":0.58699999999999997},"min":{"1min":0.41299999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.82499999999999996,"5min":0.92800000000000005,"15min":4.7699999999999996},"last":0.61099999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59499999999999997,"15min":0.58099999999999996},"min":{"1min":0.46100000000000002,"5min":0.378,"15min":0.32400000000000001},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":3.4390000000000001},"last":0.623},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.61399999999999999,"15min":0.61199999999999999},"min":{"1min":0.44900000000000001,"5min":0.39000000000000001,"15min":0.29499999999999998},"max":{"1min":0.88800000000000001,"5min":0.92000000000000004,"15min":9.3829999999999991},"last":0.59899999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63900000000000001,"15min":0.60999999999999999},"min":{"1min":0.51000000000000001,"5min":0.42099999999999999,"15min":0.315},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":3.4750000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65200000000000002,"15min":0.61799999999999999},"min":{"1min":0.54500000000000004,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":3.9180000000000001},"last":0.52100000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.63200000000000001,"15min":0.625},"min":{"1min":0.434,"5min":0.39800000000000002,"15min":0.38500000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":4.7290000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.63,"15min":0.60799999999999998},"min":{"1min":0.51600000000000001,"5min":0.41399999999999998,"15min":0.374},"max":{"1min":0.86099999999999999,"5min":0.89200000000000002,"15min":2.4500000000000002},"last":0.68600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575029,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307708,"kb_used_data":6324,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94064132,"statfs":{"total":96636764160,"available":96321671168,"internally_reserved":0,"allocated":6475776,"data_stored":5251961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.35699999999999998,"15min":0.47499999999999998},"min":{"1min":0.23000000000000001,"5min":0.20999999999999999,"15min":0.184},"max":{"1min":0.56799999999999995,"5min":0.60199999999999998,"15min":36.097999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.36599999999999999,"15min":0.38600000000000001},"min":{"1min":0.27700000000000002,"5min":0.23100000000000001,"15min":0.182},"max":{"1min":0.47199999999999998,"5min":0.92400000000000004,"15min":7.2990000000000004},"last":0.27100000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.372,"15min":0.504},"min":{"1min":0.29799999999999999,"5min":0.223,"15min":0.217},"max":{"1min":0.53000000000000003,"5min":0.56100000000000005,"15min":36.07},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.40600000000000003,"15min":0.41599999999999998},"min":{"1min":0.32500000000000001,"5min":0.26600000000000001,"15min":0.219},"max":{"1min":0.58799999999999997,"5min":0.94899999999999995,"15min":6.7800000000000002},"last":0.36699999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.376,"15min":0.39400000000000002},"min":{"1min":0.30599999999999999,"5min":0.253,"15min":0.223},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":8.4130000000000003},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.443,"15min":0.55800000000000005},"min":{"1min":0.34699999999999998,"5min":0.27800000000000002,"15min":0.249},"max":{"1min":0.55900000000000005,"5min":1.9079999999999999,"15min":35.959000000000003},"last":0.497}]},{"osd":4,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61399999999999999,"15min":0.57999999999999996},"min":{"1min":0.39500000000000002,"5min":0.36699999999999999,"15min":0.29599999999999999},"max":{"1min":0.88600000000000001,"5min":0.93500000000000005,"15min":2.427},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.61699999999999999,"15min":0.73299999999999998},"min":{"1min":0.42399999999999999,"5min":0.41299999999999998,"15min":0.29299999999999998},"max":{"1min":0.82999999999999996,"5min":0.91100000000000003,"15min":36.005000000000003},"last":0.68200000000000005}]},{"osd":5,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40400000000000003,"5min":0.374,"15min":0.32900000000000001},"max":{"1min":0.94199999999999995,"5min":0.999,"15min":6.6699999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58799999999999997,"15min":0.56699999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.315},"max":{"1min":0.90200000000000002,"5min":0.99399999999999999,"15min":2.0600000000000001},"last":0.47599999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.626,"15min":0.73699999999999999},"min":{"1min":0.498,"5min":0.39200000000000002,"15min":0.317},"max":{"1min":0.86299999999999999,"5min":0.89600000000000002,"15min":36.037999999999997},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.64300000000000002,"15min":0.64900000000000002},"min":{"1min":0.42599999999999999,"5min":0.41299999999999998,"15min":0.36399999999999999},"max":{"1min":0.89900000000000002,"5min":1.028,"15min":6.7110000000000003},"last":0.58599999999999997}]},{"osd":7,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.61899999999999999,"15min":0.627},"min":{"1min":0.44500000000000001,"5min":0.39400000000000002,"15min":0.371},"max":{"1min":0.84199999999999997,"5min":1.054,"15min":6.742},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.60999999999999999,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.39200000000000002,"15min":0.34499999999999997},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":1.917},"last":0.61099999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575030,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299516,"kb_used_data":2228,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072324,"statfs":{"total":96636764160,"available":96330059776,"internally_reserved":0,"allocated":2281472,"data_stored":1057657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.49099999999999999,"15min":0.37},"min":{"1min":0.247,"5min":0.22900000000000001,"15min":0.17999999999999999},"max":{"1min":0.443,"5min":15.228,"15min":15.228},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.433,"15min":0.39700000000000002},"min":{"1min":0.35399999999999998,"5min":0.28599999999999998,"15min":0.20999999999999999},"max":{"1min":0.58899999999999997,"5min":1.714,"15min":1.714},"last":0.376}]},{"osd":1,"last update":"Fri Oct 6 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.39700000000000002,"15min":0.379},"min":{"1min":0.35199999999999998,"5min":0.253,"15min":0.19900000000000001},"max":{"1min":0.55300000000000005,"5min":0.56999999999999995,"15min":0.745},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.39200000000000002,"15min":0.36599999999999999},"min":{"1min":0.29999999999999999,"5min":0.23200000000000001,"15min":0.216},"max":{"1min":0.52300000000000002,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.26500000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.39500000000000002,"15min":0.373},"min":{"1min":0.35999999999999999,"5min":0.255,"15min":0.23200000000000001},"max":{"1min":0.54300000000000004,"5min":0.621,"15min":0.629},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.40699999999999997,"15min":0.377},"min":{"1min":0.33800000000000002,"5min":0.26600000000000001,"15min":0.251},"max":{"1min":0.56100000000000005,"5min":0.754,"15min":0.754},"last":0.307}]},{"osd":4,"last update":"Fri Oct 6 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.58999999999999997,"15min":0.54300000000000004},"min":{"1min":0.52900000000000003,"5min":0.35799999999999998,"15min":0.30299999999999999},"max":{"1min":0.75700000000000001,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.72099999999999997,"15min":0.59899999999999998},"min":{"1min":0.38300000000000001,"5min":0.36499999999999999,"15min":0.27900000000000003},"max":{"1min":0.92400000000000004,"5min":15.26,"15min":15.26},"last":0.42799999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.72999999999999998,"15min":0.60199999999999998},"min":{"1min":0.45000000000000001,"5min":0.38200000000000001,"15min":0.32400000000000001},"max":{"1min":0.874,"5min":15.186,"15min":15.186},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.60099999999999998,"15min":0.56899999999999995},"min":{"1min":0.47399999999999998,"5min":0.40600000000000003,"15min":0.35099999999999998},"max":{"1min":0.78300000000000003,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.496}]},{"osd":6,"last update":"Fri Oct 6 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.624,"15min":0.59199999999999997},"min":{"1min":0.5,"5min":0.42599999999999999,"15min":0.32600000000000001},"max":{"1min":0.90400000000000003,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.63100000000000001,"15min":0.58899999999999997},"min":{"1min":0.505,"5min":0.438,"15min":0.34200000000000003},"max":{"1min":0.82099999999999995,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.50600000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.70699999999999996,"15min":0.60899999999999999},"min":{"1min":0.47499999999999998,"5min":0.41099999999999998,"15min":0.34499999999999997},"max":{"1min":0.83599999999999997,"5min":10.977,"15min":10.977},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.60699999999999998,"15min":0.57899999999999996},"min":{"1min":0.53700000000000003,"5min":0.39600000000000002,"15min":0.38200000000000001},"max":{"1min":0.75,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.438}]}]},{"osd":3,"up_from":13,"seq":55834575030,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":317956,"kb_used_data":8380,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94053884,"statfs":{"total":96636764160,"available":96311177216,"internally_reserved":0,"allocated":8581120,"data_stored":7349165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.375,"15min":0.33300000000000002},"min":{"1min":0.25900000000000001,"5min":0.19500000000000001,"15min":0.18099999999999999},"max":{"1min":0.58399999999999996,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.442,"15min":0.39100000000000001},"min":{"1min":0.36499999999999999,"5min":0.23000000000000001,"15min":0.22700000000000001},"max":{"1min":0.60899999999999999,"5min":4.4820000000000002,"15min":4.4820000000000002},"last":0.33700000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.34300000000000003,"15min":0.32300000000000001},"min":{"1min":0.308,"5min":0.22800000000000001,"15min":0.21299999999999999},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.65400000000000003},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.38200000000000001,"15min":0.36099999999999999},"min":{"1min":0.34100000000000003,"5min":0.251,"15min":0.188},"max":{"1min":0.52600000000000002,"5min":0.54100000000000004,"15min":1.196},"last":0.48199999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.41799999999999998,"15min":0.38},"min":{"1min":0.32900000000000001,"5min":0.23400000000000001,"15min":0.19600000000000001},"max":{"1min":0.56499999999999995,"5min":4.601,"15min":4.601},"last":0.375},{"interface":"front","average":{"1min":0.5,"5min":0.46600000000000003,"15min":0.42399999999999999},"min":{"1min":0.38800000000000001,"5min":0.28499999999999998,"15min":0.26100000000000001},"max":{"1min":0.66600000000000004,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.52000000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57999999999999996,"15min":0.54800000000000004},"min":{"1min":0.46300000000000002,"5min":0.378,"15min":0.311},"max":{"1min":0.79700000000000004,"5min":0.84099999999999997,"15min":1.694},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.58699999999999997,"15min":0.55000000000000004},"min":{"1min":0.40899999999999997,"5min":0.32600000000000001,"15min":0.30199999999999999},"max":{"1min":0.82299999999999995,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.38600000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.57899999999999996,"15min":0.55200000000000005},"min":{"1min":0.46899999999999997,"5min":0.34100000000000003,"15min":0.29399999999999998},"max":{"1min":0.77500000000000002,"5min":0.83999999999999997,"15min":0.878},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.58899999999999997,"15min":0.56200000000000006},"min":{"1min":0.45900000000000002,"5min":0.35699999999999998,"15min":0.29699999999999999},"max":{"1min":0.80800000000000005,"5min":0.91000000000000003,"15min":1.165},"last":0.71399999999999997}]},{"osd":6,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.622,"15min":0.58699999999999997},"min":{"1min":0.496,"5min":0.42499999999999999,"15min":0.36699999999999999},"max":{"1min":0.84099999999999997,"5min":0.95399999999999996,"15min":1.1359999999999999},"last":0.752},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.625,"15min":0.59299999999999997},"min":{"1min":0.49199999999999999,"5min":0.36799999999999999,"15min":0.34399999999999997},"max":{"1min":0.80500000000000005,"5min":1.012,"15min":1.7470000000000001},"last":0.40400000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.60899999999999999,"15min":0.57999999999999996},"min":{"1min":0.51200000000000001,"5min":0.39600000000000002,"15min":0.35599999999999998},"max":{"1min":0.83499999999999996,"5min":0.89900000000000002,"15min":1.657},"last":0.432},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.61099999999999999,"15min":0.58399999999999996},"min":{"1min":0.53500000000000003,"5min":0.40400000000000003,"15min":0.35499999999999998},"max":{"1min":0.86699999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.496}]}]},{"osd":4,"up_from":13,"seq":55834575029,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307724,"kb_used_data":2244,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064116,"statfs":{"total":96636764160,"available":96321654784,"internally_reserved":0,"allocated":2297856,"data_stored":1065437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:20:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.50600000000000001,"15min":0.49399999999999999},"min":{"1min":0.39000000000000001,"5min":0.24199999999999999,"15min":0.19500000000000001},"max":{"1min":0.67500000000000004,"5min":0.76800000000000002,"15min":2.6619999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52800000000000002,"15min":0.498},"min":{"1min":0.33900000000000002,"5min":0.28899999999999998,"15min":0.215},"max":{"1min":0.65400000000000003,"5min":0.81499999999999995,"15min":0.91200000000000003},"last":0.56999999999999995}]},{"osd":1,"last update":"Fri Oct 6 11:20:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52400000000000002,"15min":0.51300000000000001},"min":{"1min":0.35099999999999998,"5min":0.27600000000000002,"15min":0.23300000000000001},"max":{"1min":0.68000000000000005,"5min":0.94099999999999995,"15min":2.8650000000000002},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53200000000000003,"15min":0.52200000000000002},"min":{"1min":0.42599999999999999,"5min":0.27000000000000002,"15min":0.25800000000000001},"max":{"1min":0.63600000000000001,"5min":0.79800000000000004,"15min":2.7610000000000001},"last":0.63}]},{"osd":2,"last update":"Fri Oct 6 11:20:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55800000000000005,"15min":0.52600000000000002},"min":{"1min":0.32500000000000001,"5min":0.312,"15min":0.23100000000000001},"max":{"1min":0.72399999999999998,"5min":0.88800000000000001,"15min":1.6910000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58899999999999997,"15min":0.57199999999999995},"min":{"1min":0.40200000000000002,"5min":0.38700000000000001,"15min":0.30599999999999999},"max":{"1min":0.73399999999999999,"5min":0.84999999999999998,"15min":1.718},"last":0.378}]},{"osd":3,"last update":"Fri Oct 6 11:20:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56100000000000005,"15min":0.56399999999999995},"min":{"1min":0.46500000000000002,"5min":0.36699999999999999,"15min":0.26700000000000002},"max":{"1min":0.71799999999999997,"5min":0.79600000000000004,"15min":2.677},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56499999999999995,"15min":0.53500000000000003},"min":{"1min":0.435,"5min":0.35599999999999998,"15min":0.27500000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":1.784},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:20:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.48999999999999999,"15min":0.47699999999999998},"min":{"1min":0.34200000000000003,"5min":0.33700000000000002,"15min":0.23200000000000001},"max":{"1min":0.72899999999999998,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.54700000000000004,"15min":0.52200000000000002},"min":{"1min":0.378,"5min":0.29099999999999998,"15min":0.28399999999999997},"max":{"1min":0.76700000000000002,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.75}]},{"osd":6,"last update":"Fri Oct 6 11:20:02 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.54700000000000004,"15min":0.52100000000000002},"min":{"1min":0.36499999999999999,"5min":0.30199999999999999,"15min":0.252},"max":{"1min":0.86799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.56299999999999994,"15min":0.54900000000000004},"min":{"1min":0.40600000000000003,"5min":0.38700000000000001,"15min":0.29199999999999998},"max":{"1min":0.79400000000000004,"5min":0.90400000000000003,"15min":1.165},"last":0.66400000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:20:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57699999999999996,"15min":0.56100000000000005},"min":{"1min":0.438,"5min":0.312,"15min":0.312},"max":{"1min":0.80600000000000005,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.62},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.60899999999999999,"15min":0.58699999999999997},"min":{"1min":0.38500000000000001,"5min":0.34399999999999997,"15min":0.317},"max":{"1min":0.89600000000000002,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.64800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575031,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305676,"kb_used_data":8388,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94066164,"statfs":{"total":96636764160,"available":96323751936,"internally_reserved":0,"allocated":8589312,"data_stored":7356893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52000000000000002,"15min":0.53100000000000003},"min":{"1min":0.29299999999999998,"5min":0.26000000000000001,"15min":0.20499999999999999},"max":{"1min":0.72699999999999998,"5min":0.752,"15min":5.0490000000000004},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51800000000000002,"15min":0.51500000000000001},"min":{"1min":0.34599999999999997,"5min":0.26600000000000001,"15min":0.22900000000000001},"max":{"1min":0.69399999999999995,"5min":0.75,"15min":5.1449999999999996},"last":0.48599999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.52600000000000002,"15min":0.49199999999999999},"min":{"1min":0.35999999999999999,"5min":0.27800000000000002,"15min":0.25},"max":{"1min":0.70299999999999996,"5min":0.76400000000000001,"15min":0.97199999999999998},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54300000000000004,"15min":0.51400000000000001},"min":{"1min":0.33500000000000002,"5min":0.29799999999999999,"15min":0.27400000000000002},"max":{"1min":0.74199999999999999,"5min":0.752,"15min":1.8799999999999999},"last":0.61899999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56799999999999995,"15min":0.55200000000000005},"min":{"1min":0.36499999999999999,"5min":0.313,"15min":0.28299999999999997},"max":{"1min":0.755,"5min":0.80700000000000005,"15min":4.234},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59699999999999998,"15min":0.56299999999999994},"min":{"1min":0.438,"5min":0.35899999999999999,"15min":0.315},"max":{"1min":0.753,"5min":0.82099999999999995,"15min":1.0369999999999999},"last":0.51000000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52900000000000003,"15min":0.54200000000000004},"min":{"1min":0.34499999999999997,"5min":0.29499999999999998,"15min":0.27700000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":5.2169999999999996},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.55900000000000005,"15min":0.54000000000000004},"min":{"1min":0.372,"5min":0.32400000000000001,"15min":0.29699999999999999},"max":{"1min":0.72899999999999998,"5min":0.76000000000000001,"15min":1.008},"last":0.54800000000000004}]},{"osd":4,"last update":"Fri Oct 6 11:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.49099999999999999,"15min":0.49399999999999999},"min":{"1min":0.28699999999999998,"5min":0.26400000000000001,"15min":0.23999999999999999},"max":{"1min":0.52600000000000002,"5min":0.78000000000000003,"15min":1.917},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.50600000000000001,"15min":0.504},"min":{"1min":0.33300000000000002,"5min":0.251,"15min":0.23899999999999999},"max":{"1min":0.58299999999999996,"5min":0.77600000000000002,"15min":0.87},"last":0.56699999999999995}]},{"osd":6,"last update":"Fri Oct 6 11:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.52500000000000002,"15min":0.53000000000000003},"min":{"1min":0.372,"5min":0.32700000000000001,"15min":0.27600000000000002},"max":{"1min":0.55700000000000005,"5min":0.78800000000000003,"15min":2.0139999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.59499999999999997,"15min":0.58799999999999997},"min":{"1min":0.35599999999999998,"5min":0.30299999999999999,"15min":0.29999999999999999},"max":{"1min":0.79100000000000004,"5min":0.85099999999999998,"15min":1.9470000000000001},"last":0.68500000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.55000000000000004,"15min":0.55200000000000005},"min":{"1min":0.32900000000000001,"5min":0.311,"15min":0.27700000000000002},"max":{"1min":0.73699999999999999,"5min":0.79700000000000004,"15min":0.96499999999999997},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.39700000000000002,"5min":0.29199999999999998,"15min":0.28799999999999998},"max":{"1min":0.70299999999999996,"5min":0.81399999999999995,"15min":1.4119999999999999},"last":0.628}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:20:30.734 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T11:20:30.734 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:20:30.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.847+0000 7f9597b76700 1 Processor -- start 2023-10-06T11:20:30.849 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.847+0000 7f9597b76700 1 -- start start 2023-10-06T11:20:30.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.848+0000 7f9597b76700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f959015a940 0x7f9590153c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:30.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.848+0000 7f9597b76700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f959015dcc0 0x7f95900ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:30.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.848+0000 7f9597b76700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f959015d270 con 0x7f95901538c0 2023-10-06T11:20:30.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.848+0000 7f9597b76700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f959015d830 con 0x7f959015a940 2023-10-06T11:20:30.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.848+0000 7f9597b76700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f959015e110 con 0x7f959015dcc0 2023-10-06T11:20:30.853 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.848+0000 7f9595912700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f95901538c0 0x7f95900cac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49442/0 (socket says 172.21.15.146:49442) 2023-10-06T11:20:30.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.848+0000 7f9595912700 1 -- 172.21.15.146:0/2342291385 learned_addr learned my addr 172.21.15.146:0/2342291385 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:20:30.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.848+0000 7f9594910700 1 -- 172.21.15.146:0/2342291385 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2364562337 0 0) 0x7f959015d270 con 0x7f95901538c0 2023-10-06T11:20:30.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.848+0000 7f9594910700 1 -- 172.21.15.146:0/2342291385 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f957c003570 con 0x7f95901538c0 2023-10-06T11:20:30.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.848+0000 7f9595111700 1 --2- 172.21.15.146:0/2342291385 >> v2:172.21.15.151:3300/0 conn(0x7f959015a940 0x7f9590153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:30.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.848+0000 7f9596113700 1 --2- 172.21.15.146:0/2342291385 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f959015dcc0 0x7f95900ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:30.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.849+0000 7f9594910700 1 -- 172.21.15.146:0/2342291385 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2030755572 0 0) 0x7f957c003570 con 0x7f95901538c0 2023-10-06T11:20:30.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.849+0000 7f9594910700 1 -- 172.21.15.146:0/2342291385 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f959015dcc0 msgr2=0x7f95900ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:30.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.849+0000 7f9594910700 1 --2- 172.21.15.146:0/2342291385 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f959015dcc0 0x7f95900ce610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:30.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.849+0000 7f9594910700 1 -- 172.21.15.146:0/2342291385 >> v2:172.21.15.151:3300/0 conn(0x7f959015a940 msgr2=0x7f9590153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:30.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.849+0000 7f9594910700 1 --2- 172.21.15.146:0/2342291385 >> v2:172.21.15.151:3300/0 conn(0x7f959015a940 0x7f9590153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:30.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.849+0000 7f9594910700 1 -- 172.21.15.146:0/2342291385 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95900cb810 con 0x7f95901538c0 2023-10-06T11:20:30.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.849+0000 7f9594910700 1 -- 172.21.15.146:0/2342291385 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f958c001470 con 0x7f95901538c0 2023-10-06T11:20:30.854 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.849+0000 7f9596113700 1 --2- 172.21.15.146:0/2342291385 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f959015dcc0 0x7f95900ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:20:30.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.849+0000 7f9595111700 1 --2- 172.21.15.146:0/2342291385 >> v2:172.21.15.151:3300/0 conn(0x7f959015a940 0x7f9590153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:20:30.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.849+0000 7f9594910700 1 -- 172.21.15.146:0/2342291385 >> v1:172.21.15.146:6789/0 conn(0x7f95901538c0 legacy=0x7f95900cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:30.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.849+0000 7f9594910700 1 --2- 172.21.15.146:0/2342291385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f957c003a60 0x7f957c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:30.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.849+0000 7f9594910700 1 --2- 172.21.15.146:0/2342291385 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f959015dcc0 0x7f957c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:30.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.849+0000 7f9594910700 1 --2- 172.21.15.146:0/2342291385 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f957c004d50 0x7f957c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:30.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.849+0000 7f9594910700 1 -- 172.21.15.146:0/2342291385 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959015d830 con 0x7f957c004d50 2023-10-06T11:20:30.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.849+0000 7f9594910700 1 -- 172.21.15.146:0/2342291385 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959015e110 con 0x7f957c003a60 2023-10-06T11:20:30.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.849+0000 7f9594910700 1 -- 172.21.15.146:0/2342291385 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f957c00bb90 con 0x7f959015dcc0 2023-10-06T11:20:30.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.849+0000 7f9596113700 1 --2- 172.21.15.146:0/2342291385 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f957c004d50 0x7f957c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:30.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.849+0000 7f9595912700 1 --2- 172.21.15.146:0/2342291385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f957c003a60 0x7f957c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:30.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.849+0000 7f9595111700 1 --2- 172.21.15.146:0/2342291385 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f959015dcc0 0x7f957c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:30.855 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.849+0000 7f9596113700 1 -- 172.21.15.146:0/2342291385 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f959015dcc0 msgr2=0x7f957c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:30.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.849+0000 7f9596113700 1 --2- 172.21.15.146:0/2342291385 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f959015dcc0 0x7f957c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:30.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.849+0000 7f9596113700 1 -- 172.21.15.146:0/2342291385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f957c003a60 msgr2=0x7f957c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:30.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.849+0000 7f9596113700 1 --2- 172.21.15.146:0/2342291385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f957c003a60 0x7f957c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:30.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.849+0000 7f9596113700 1 -- 172.21.15.146:0/2342291385 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f957c003570 con 0x7f957c004d50 2023-10-06T11:20:30.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.849+0000 7f9596113700 1 --2- 172.21.15.146:0/2342291385 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f957c004d50 0x7f957c0051c0 secure :-1 s=READY pgs=2394 cs=0 l=1 rev1=1 crypto rx=0x7f9588007580 tx=0x7f95880097d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f65b541472709a43 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:30.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.849+0000 7f9594910700 1 -- 172.21.15.146:0/2342291385 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9588009ae0 con 0x7f957c004d50 2023-10-06T11:20:30.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.850+0000 7f9594910700 1 -- 172.21.15.146:0/2342291385 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9588007dd0 con 0x7f957c004d50 2023-10-06T11:20:30.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.850+0000 7f9594910700 1 -- 172.21.15.146:0/2342291385 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9588014630 con 0x7f957c004d50 2023-10-06T11:20:30.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.850+0000 7f9597b76700 1 -- 172.21.15.146:0/2342291385 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f957c004d50 msgr2=0x7f957c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:30.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.850+0000 7f9597b76700 1 --2- 172.21.15.146:0/2342291385 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f957c004d50 0x7f957c0051c0 secure :-1 s=READY pgs=2394 cs=0 l=1 rev1=1 crypto rx=0x7f9588007580 tx=0x7f95880097d0 comp rx=0 tx=0).stop 2023-10-06T11:20:30.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.850+0000 7f9596113700 1 -- 172.21.15.146:0/2342291385 reap_dead start 2023-10-06T11:20:30.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.850+0000 7f9597b76700 1 -- 172.21.15.146:0/2342291385 shutdown_connections 2023-10-06T11:20:30.856 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.850+0000 7f9597b76700 1 -- 172.21.15.146:0/2342291385 >> 172.21.15.146:0/2342291385 conn(0x7f959006eb10 msgr2=0x7f959006ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:30.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.850+0000 7f9597b76700 1 -- 172.21.15.146:0/2342291385 shutdown_connections 2023-10-06T11:20:30.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.850+0000 7f9597b76700 1 -- 172.21.15.146:0/2342291385 wait complete. 2023-10-06T11:20:30.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.851+0000 7f9597b76700 1 Processor -- start 2023-10-06T11:20:30.857 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.851+0000 7f9597b76700 1 -- start start 2023-10-06T11:20:30.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.853+0000 7f9597b76700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f957c004d50 0x7f95900ca170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:30.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.853+0000 7f9597b76700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95900c76f0 0x7f959013f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:30.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.853+0000 7f9597b76700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f959016a4e0 0x7f95901516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:30.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.853+0000 7f9597b76700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95900c8190 con 0x7f959016a4e0 2023-10-06T11:20:30.859 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.853+0000 7f9597b76700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95900c9ce0 con 0x7f95900c76f0 2023-10-06T11:20:30.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.853+0000 7f9597b76700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95900c9420 con 0x7f957c004d50 2023-10-06T11:20:30.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.853+0000 7f9596113700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f959016a4e0 0x7f95901516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:30.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.853+0000 7f9596113700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f959016a4e0 0x7f95901516c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45328/0 (socket says 172.21.15.146:45328) 2023-10-06T11:20:30.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.853+0000 7f9596113700 1 -- 172.21.15.146:0/3307842185 learned_addr learned my addr 172.21.15.146:0/3307842185 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:30.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.853+0000 7f9595912700 1 --2- 172.21.15.146:0/3307842185 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f957c004d50 0x7f95900ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:30.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.853+0000 7f9595111700 1 --2- 172.21.15.146:0/3307842185 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95900c76f0 0x7f959013f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:30.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.853+0000 7f9596113700 1 -- 172.21.15.146:0/3307842185 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f957c004d50 msgr2=0x7f95900ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:30.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.853+0000 7f9596113700 1 --2- 172.21.15.146:0/3307842185 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f957c004d50 0x7f95900ca170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:30.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.853+0000 7f9596113700 1 -- 172.21.15.146:0/3307842185 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95900c76f0 msgr2=0x7f959013f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:30.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.853+0000 7f9596113700 1 --2- 172.21.15.146:0/3307842185 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95900c76f0 0x7f959013f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:30.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.853+0000 7f9596113700 1 -- 172.21.15.146:0/3307842185 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95900c9690 con 0x7f959016a4e0 2023-10-06T11:20:30.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.853+0000 7f9595111700 1 --2- 172.21.15.146:0/3307842185 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95900c76f0 0x7f959013f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:20:30.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.853+0000 7f9596113700 1 --2- 172.21.15.146:0/3307842185 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f959016a4e0 0x7f95901516c0 secure :-1 s=READY pgs=2395 cs=0 l=1 rev1=1 crypto rx=0x7f9588007b70 tx=0x7f9588018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:30.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.853+0000 7f9585ffb700 1 -- 172.21.15.146:0/3307842185 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9588024070 con 0x7f959016a4e0 2023-10-06T11:20:30.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.853+0000 7f9585ffb700 1 -- 172.21.15.146:0/3307842185 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f958801f630 con 0x7f959016a4e0 2023-10-06T11:20:30.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.853+0000 7f9597b76700 1 -- 172.21.15.146:0/3307842185 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95900c9970 con 0x7f959016a4e0 2023-10-06T11:20:30.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.853+0000 7f9585ffb700 1 -- 172.21.15.146:0/3307842185 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958801f9d0 con 0x7f959016a4e0 2023-10-06T11:20:30.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.853+0000 7f9597b76700 1 -- 172.21.15.146:0/3307842185 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95900c7cb0 con 0x7f959016a4e0 2023-10-06T11:20:30.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.854+0000 7f9597b76700 1 -- 172.21.15.146:0/3307842185 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95900c9e90 con 0x7f959016a4e0 2023-10-06T11:20:30.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.854+0000 7f9585ffb700 1 -- 172.21.15.146:0/3307842185 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9588003020 con 0x7f959016a4e0 2023-10-06T11:20:30.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.854+0000 7f9585ffb700 1 --2- 172.21.15.146:0/3307842185 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9574066f30 0x7f95740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:30.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.855+0000 7f9585ffb700 1 -- 172.21.15.146:0/3307842185 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f9588086100 con 0x7f959016a4e0 2023-10-06T11:20:30.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.855+0000 7f9595912700 1 --2- 172.21.15.146:0/3307842185 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9574066f30 0x7f95740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:30.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.855+0000 7f9595912700 1 --2- 172.21.15.146:0/3307842185 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9574066f30 0x7f95740693e0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f9590150190 tx=0x7f958c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:30.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:30.859+0000 7f9585ffb700 1 -- 172.21.15.146:0/3307842185 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f95900c9e90 con 0x7f959016a4e0 2023-10-06T11:20:31.040 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.038+0000 7f9597b76700 1 -- 172.21.15.146:0/3307842185 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f95900c9e90 con 0x7f9574066f30 2023-10-06T11:20:31.042 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.040+0000 7f9585ffb700 1 -- 172.21.15.146:0/3307842185 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73054 (secure 0 0 0) 0x7f95900c9e90 con 0x7f9574066f30 2023-10-06T11:20:31.043 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:20:31.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.043+0000 7f9597b76700 1 -- 172.21.15.146:0/3307842185 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9574066f30 msgr2=0x7f95740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:31.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.043+0000 7f9597b76700 1 --2- 172.21.15.146:0/3307842185 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9574066f30 0x7f95740693e0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f9590150190 tx=0x7f958c009040 comp rx=0 tx=0).stop 2023-10-06T11:20:31.045 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.043+0000 7f9597b76700 1 -- 172.21.15.146:0/3307842185 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f959016a4e0 msgr2=0x7f95901516c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:31.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.043+0000 7f9597b76700 1 --2- 172.21.15.146:0/3307842185 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f959016a4e0 0x7f95901516c0 secure :-1 s=READY pgs=2395 cs=0 l=1 rev1=1 crypto rx=0x7f9588007b70 tx=0x7f9588018000 comp rx=0 tx=0).stop 2023-10-06T11:20:31.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.043+0000 7f9597b76700 1 -- 172.21.15.146:0/3307842185 shutdown_connections 2023-10-06T11:20:31.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.043+0000 7f9597b76700 1 --2- 172.21.15.146:0/3307842185 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f9574066f30 0x7f95740693e0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:31.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.043+0000 7f9597b76700 1 --2- 172.21.15.146:0/3307842185 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f959016a4e0 0x7f95901516c0 unknown :-1 s=CLOSED pgs=2395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:31.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.043+0000 7f9597b76700 1 --2- 172.21.15.146:0/3307842185 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f957c004d50 0x7f95900ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:31.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.043+0000 7f9597b76700 1 --2- 172.21.15.146:0/3307842185 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95900c76f0 0x7f959013f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:31.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.043+0000 7f9597b76700 1 -- 172.21.15.146:0/3307842185 >> 172.21.15.146:0/3307842185 conn(0x7f959006eb10 msgr2=0x7f959014e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:31.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.043+0000 7f9597b76700 1 -- 172.21.15.146:0/3307842185 shutdown_connections 2023-10-06T11:20:31.046 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.043+0000 7f9597b76700 1 -- 172.21.15.146:0/3307842185 wait complete. 2023-10-06T11:20:31.046 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:20:31.057 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":622,"stamp":"2023-10-06T11:20:29.336234+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2450652,"kb_used_data":43676,"kb_used_omap":0,"kb_used_meta":2406912,"kb_avail":752524068,"statfs":{"total":773094113280,"available":770584645632,"internally_reserved":0,"allocated":44724224,"data_stored":34873071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2464677888},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12617801,"num_objects":-28,"num_object_clones":0,"num_object_copies":-56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-28,"num_whiteouts":0,"num_read":-66,"num_read_kb":-69,"num_write":-93,"num_write_kb":-12350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001127"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":162,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-06T11:20:26.038371+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:20:26.038371+0000","last_peered":"2023-10-06T11:20:26.038371+0000","last_clean":"2023-10-06T11:20:26.038371+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:20:26.038371+0000","last_undegraded":"2023-10-06T11:20:26.038371+0000","last_fullsized":"2023-10-06T11:20:26.038371+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":152,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-06T11:20:24.263432+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:20:24.263432+0000","last_peered":"2023-10-06T11:20:24.263432+0000","last_clean":"2023-10-06T11:20:24.263432+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:20:24.263432+0000","last_undegraded":"2023-10-06T11:20:24.263432+0000","last_fullsized":"2023-10-06T11:20:24.263432+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":150,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-06T11:20:26.347736+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:20:26.347736+0000","last_peered":"2023-10-06T11:20:26.347736+0000","last_clean":"2023-10-06T11:20:26.347736+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:20:26.347736+0000","last_undegraded":"2023-10-06T11:20:26.347736+0000","last_fullsized":"2023-10-06T11:20:26.347736+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":293,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-06T11:20:24.262733+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:20:24.262733+0000","last_peered":"2023-10-06T11:20:24.262733+0000","last_clean":"2023-10-06T11:20:24.262733+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:20:24.262733+0000","last_undegraded":"2023-10-06T11:20:24.262733+0000","last_fullsized":"2023-10-06T11:20:24.262733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":143,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-06T11:20:24.262978+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:20:24.262978+0000","last_peered":"2023-10-06T11:20:24.262978+0000","last_clean":"2023-10-06T11:20:24.262978+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:20:24.262978+0000","last_undegraded":"2023-10-06T11:20:24.262978+0000","last_fullsized":"2023-10-06T11:20:24.262978+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":143,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-06T11:20:24.262837+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:20:24.262837+0000","last_peered":"2023-10-06T11:20:24.262837+0000","last_clean":"2023-10-06T11:20:24.262837+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:20:24.262837+0000","last_undegraded":"2023-10-06T11:20:24.262837+0000","last_fullsized":"2023-10-06T11:20:24.262837+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":169,"reported_epoch":181,"state":"active+clean","last_fresh":"2023-10-06T11:20:24.031145+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:20:24.031145+0000","last_peered":"2023-10-06T11:20:24.031145+0000","last_clean":"2023-10-06T11:20:24.031145+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:20:24.031145+0000","last_undegraded":"2023-10-06T11:20:24.031145+0000","last_fullsized":"2023-10-06T11:20:24.031145+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":151,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-06T11:20:26.346200+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:20:26.346200+0000","last_peered":"2023-10-06T11:20:26.346200+0000","last_clean":"2023-10-06T11:20:26.346200+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:20:26.346200+0000","last_undegraded":"2023-10-06T11:20:26.346200+0000","last_fullsized":"2023-10-06T11:20:26.346200+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":151,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-06T11:20:26.347708+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:20:26.347708+0000","last_peered":"2023-10-06T11:20:26.347708+0000","last_clean":"2023-10-06T11:20:26.347708+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:20:26.347708+0000","last_undegraded":"2023-10-06T11:20:26.347708+0000","last_fullsized":"2023-10-06T11:20:26.347708+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575029,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":306288,"kb_used_data":4904,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94065552,"statfs":{"total":96636764160,"available":96323125248,"internally_reserved":0,"allocated":5021696,"data_stored":3780613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.51300000000000001,"15min":0.63300000000000001},"min":{"1min":0.37,"5min":0.27200000000000002,"15min":0.21199999999999999},"max":{"1min":0.68500000000000005,"5min":0.71899999999999997,"15min":23.908999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.54600000000000004,"15min":0.57999999999999996},"min":{"1min":0.35399999999999998,"5min":0.313,"15min":0.22500000000000001},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":9.3230000000000004},"last":0.72299999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.53200000000000003,"15min":0.55900000000000005},"min":{"1min":0.434,"5min":0.28799999999999998,"15min":0.26000000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":9.2360000000000007},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.52200000000000002,"15min":0.50900000000000001},"min":{"1min":0.41599999999999998,"5min":0.373,"15min":0.25900000000000001},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":4.327},"last":0.41599999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.39400000000000002,"5min":0.313,"15min":0.26500000000000001},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":4.3120000000000003},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.55900000000000005,"15min":0.56399999999999995},"min":{"1min":0.40899999999999997,"5min":0.34799999999999998,"15min":0.29999999999999999},"max":{"1min":1.109,"5min":1.109,"15min":4.7309999999999999},"last":0.67800000000000005}]},{"osd":3,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.55200000000000005,"15min":0.55600000000000005},"min":{"1min":0.47499999999999998,"5min":0.35299999999999998,"15min":0.27900000000000003},"max":{"1min":0.75900000000000001,"5min":0.77000000000000002,"15min":4.5190000000000001},"last":0.377},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58099999999999996,"15min":0.60399999999999998},"min":{"1min":0.45500000000000002,"5min":0.38100000000000001,"15min":0.29699999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":9.3879999999999999},"last":0.60699999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.48099999999999998,"15min":0.496},"min":{"1min":0.32000000000000001,"5min":0.26300000000000001,"15min":0.24399999999999999},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":4.6639999999999997},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.51100000000000001,"15min":0.53000000000000003},"min":{"1min":0.34599999999999997,"5min":0.33300000000000002,"15min":0.27300000000000002},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":4.3689999999999998},"last":0.58599999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.52700000000000002,"15min":0.55200000000000005},"min":{"1min":0.371,"5min":0.32600000000000001,"15min":0.26000000000000001},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":9.3499999999999996},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52400000000000002,"15min":0.53200000000000003},"min":{"1min":0.36899999999999999,"5min":0.36199999999999999,"15min":0.26800000000000002},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":4.444},"last":0.65500000000000003}]},{"osd":6,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56499999999999995,"15min":0.58699999999999997},"min":{"1min":0.41099999999999998,"5min":0.32400000000000001,"15min":0.29199999999999998},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":9.4969999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58799999999999997,"15min":0.61499999999999999},"min":{"1min":0.40500000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":7.2039999999999997},"last":0.624}]}]},{"osd":6,"up_from":13,"seq":55834575031,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305672,"kb_used_data":8384,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94066168,"statfs":{"total":96636764160,"available":96323756032,"internally_reserved":0,"allocated":8585216,"data_stored":7355540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.42299999999999999,"5min":0.218,"15min":0.187},"max":{"1min":0.71499999999999997,"5min":1.488,"15min":9.5549999999999997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.63200000000000001,"15min":0.59399999999999997},"min":{"1min":0.45600000000000002,"5min":0.29699999999999999,"15min":0.254},"max":{"1min":0.77200000000000002,"5min":4.9930000000000003,"15min":9.4659999999999993},"last":0.68300000000000005}]},{"osd":1,"last update":"Fri Oct 6 11:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52400000000000002,"15min":0.49199999999999999},"min":{"1min":0.35199999999999998,"5min":0.23699999999999999,"15min":0.23300000000000001},"max":{"1min":0.64300000000000002,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.75,"15min":0.59699999999999998},"min":{"1min":0.39400000000000002,"5min":0.25800000000000001,"15min":0.216},"max":{"1min":0.80200000000000005,"5min":21.306000000000001,"15min":21.306000000000001},"last":0.64900000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55500000000000005,"15min":0.52300000000000002},"min":{"1min":0.438,"5min":0.29399999999999998,"15min":0.252},"max":{"1min":0.68400000000000005,"5min":2.8250000000000002,"15min":7.0659999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.70699999999999996,"15min":0.58399999999999996},"min":{"1min":0.40600000000000003,"5min":0.27800000000000002,"15min":0.26600000000000001},"max":{"1min":0.69999999999999996,"5min":17.216000000000001,"15min":17.216000000000001},"last":0.49299999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.58999999999999997,"15min":0.54800000000000004},"min":{"1min":0.35499999999999998,"5min":0.29999999999999999,"15min":0.25800000000000001},"max":{"1min":0.72599999999999998,"5min":4.9400000000000004,"15min":4.9400000000000004},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.68700000000000006,"15min":0.58199999999999996},"min":{"1min":0.39300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.73799999999999999,"5min":12.159000000000001,"15min":12.159000000000001},"last":0.62}]},{"osd":4,"last update":"Fri Oct 6 11:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.498,"15min":0.47799999999999998},"min":{"1min":0.31,"5min":0.27400000000000002,"15min":0.24299999999999999},"max":{"1min":0.61299999999999999,"5min":1.669,"15min":1.669},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.58099999999999996,"15min":0.53900000000000003},"min":{"1min":0.33200000000000002,"5min":0.29699999999999999,"15min":0.27900000000000003},"max":{"1min":0.66600000000000004,"5min":4.8949999999999996,"15min":4.8949999999999996},"last":0.40400000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.53800000000000003,"15min":0.51800000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.28399999999999997},"max":{"1min":0.621,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.61399999999999999,"15min":0.59099999999999997},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.755,"5min":4.7080000000000002,"15min":7.1379999999999999},"last":0.44800000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.63800000000000001,"15min":0.58599999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.27900000000000003},"max":{"1min":0.66900000000000004,"5min":5.7709999999999999,"15min":5.7709999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.63100000000000001,"15min":0.59299999999999997},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.30199999999999999},"max":{"1min":0.69199999999999995,"5min":3.5579999999999998,"15min":3.5579999999999998},"last":0.434}]}]},{"osd":1,"up_from":13,"seq":55834575030,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":300112,"kb_used_data":2824,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071728,"statfs":{"total":96636764160,"available":96329449472,"internally_reserved":0,"allocated":2891776,"data_stored":1655805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.34599999999999997,"15min":0.379},"min":{"1min":0.27500000000000002,"5min":0.19900000000000001,"15min":0.186},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":13.393000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.36899999999999999,"15min":0.39000000000000001},"min":{"1min":0.26700000000000002,"5min":0.20599999999999999,"15min":0.19700000000000001},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":11.462},"last":0.36099999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.36099999999999999,"15min":0.37},"min":{"1min":0.30499999999999999,"5min":0.217,"15min":0.216},"max":{"1min":0.56699999999999995,"5min":0.72599999999999998,"15min":8.0470000000000006},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.40699999999999997,"15min":0.41199999999999998},"min":{"1min":0.30299999999999999,"5min":0.215,"15min":0.20999999999999999},"max":{"1min":0.61199999999999999,"5min":0.66700000000000004,"15min":4.8630000000000004},"last":0.41199999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.42399999999999999,"15min":0.42899999999999999},"min":{"1min":0.32100000000000001,"5min":0.255,"15min":0.252},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":4.8029999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.41399999999999998,"15min":0.40799999999999997},"min":{"1min":0.35099999999999998,"5min":0.23799999999999999,"15min":0.217},"max":{"1min":0.63600000000000001,"5min":0.749,"15min":5.8700000000000001},"last":0.46400000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58299999999999996,"15min":0.54400000000000004},"min":{"1min":0.435,"5min":0.28299999999999997,"15min":0.28199999999999997},"max":{"1min":0.82299999999999995,"5min":0.88400000000000001,"15min":1.264},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.59499999999999997,"15min":0.58699999999999997},"min":{"1min":0.41299999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.82499999999999996,"5min":0.92800000000000005,"15min":4.7699999999999996},"last":0.61099999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59499999999999997,"15min":0.58099999999999996},"min":{"1min":0.46100000000000002,"5min":0.378,"15min":0.32400000000000001},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":3.4390000000000001},"last":0.623},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.61399999999999999,"15min":0.61199999999999999},"min":{"1min":0.44900000000000001,"5min":0.39000000000000001,"15min":0.29499999999999998},"max":{"1min":0.88800000000000001,"5min":0.92000000000000004,"15min":9.3829999999999991},"last":0.59899999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63900000000000001,"15min":0.60999999999999999},"min":{"1min":0.51000000000000001,"5min":0.42099999999999999,"15min":0.315},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":3.4750000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65200000000000002,"15min":0.61799999999999999},"min":{"1min":0.54500000000000004,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":3.9180000000000001},"last":0.52100000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.63200000000000001,"15min":0.625},"min":{"1min":0.434,"5min":0.39800000000000002,"15min":0.38500000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":4.7290000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.63,"15min":0.60799999999999998},"min":{"1min":0.51600000000000001,"5min":0.41399999999999998,"15min":0.374},"max":{"1min":0.86099999999999999,"5min":0.89200000000000002,"15min":2.4500000000000002},"last":0.68600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575029,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307708,"kb_used_data":6324,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94064132,"statfs":{"total":96636764160,"available":96321671168,"internally_reserved":0,"allocated":6475776,"data_stored":5251961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.35699999999999998,"15min":0.47499999999999998},"min":{"1min":0.23000000000000001,"5min":0.20999999999999999,"15min":0.184},"max":{"1min":0.56799999999999995,"5min":0.60199999999999998,"15min":36.097999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.36599999999999999,"15min":0.38600000000000001},"min":{"1min":0.27700000000000002,"5min":0.23100000000000001,"15min":0.182},"max":{"1min":0.47199999999999998,"5min":0.92400000000000004,"15min":7.2990000000000004},"last":0.27100000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.372,"15min":0.504},"min":{"1min":0.29799999999999999,"5min":0.223,"15min":0.217},"max":{"1min":0.53000000000000003,"5min":0.56100000000000005,"15min":36.07},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.40600000000000003,"15min":0.41599999999999998},"min":{"1min":0.32500000000000001,"5min":0.26600000000000001,"15min":0.219},"max":{"1min":0.58799999999999997,"5min":0.94899999999999995,"15min":6.7800000000000002},"last":0.36699999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.376,"15min":0.39400000000000002},"min":{"1min":0.30599999999999999,"5min":0.253,"15min":0.223},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":8.4130000000000003},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.443,"15min":0.55800000000000005},"min":{"1min":0.34699999999999998,"5min":0.27800000000000002,"15min":0.249},"max":{"1min":0.55900000000000005,"5min":1.9079999999999999,"15min":35.959000000000003},"last":0.497}]},{"osd":4,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61399999999999999,"15min":0.57999999999999996},"min":{"1min":0.39500000000000002,"5min":0.36699999999999999,"15min":0.29599999999999999},"max":{"1min":0.88600000000000001,"5min":0.93500000000000005,"15min":2.427},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.61699999999999999,"15min":0.73299999999999998},"min":{"1min":0.42399999999999999,"5min":0.41299999999999998,"15min":0.29299999999999998},"max":{"1min":0.82999999999999996,"5min":0.91100000000000003,"15min":36.005000000000003},"last":0.68200000000000005}]},{"osd":5,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40400000000000003,"5min":0.374,"15min":0.32900000000000001},"max":{"1min":0.94199999999999995,"5min":0.999,"15min":6.6699999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58799999999999997,"15min":0.56699999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.315},"max":{"1min":0.90200000000000002,"5min":0.99399999999999999,"15min":2.0600000000000001},"last":0.47599999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.626,"15min":0.73699999999999999},"min":{"1min":0.498,"5min":0.39200000000000002,"15min":0.317},"max":{"1min":0.86299999999999999,"5min":0.89600000000000002,"15min":36.037999999999997},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.64300000000000002,"15min":0.64900000000000002},"min":{"1min":0.42599999999999999,"5min":0.41299999999999998,"15min":0.36399999999999999},"max":{"1min":0.89900000000000002,"5min":1.028,"15min":6.7110000000000003},"last":0.58599999999999997}]},{"osd":7,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.61899999999999999,"15min":0.627},"min":{"1min":0.44500000000000001,"5min":0.39400000000000002,"15min":0.371},"max":{"1min":0.84199999999999997,"5min":1.054,"15min":6.742},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.60999999999999999,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.39200000000000002,"15min":0.34499999999999997},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":1.917},"last":0.61099999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575030,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299516,"kb_used_data":2228,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072324,"statfs":{"total":96636764160,"available":96330059776,"internally_reserved":0,"allocated":2281472,"data_stored":1057657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.49099999999999999,"15min":0.37},"min":{"1min":0.247,"5min":0.22900000000000001,"15min":0.17999999999999999},"max":{"1min":0.443,"5min":15.228,"15min":15.228},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.433,"15min":0.39700000000000002},"min":{"1min":0.35399999999999998,"5min":0.28599999999999998,"15min":0.20999999999999999},"max":{"1min":0.58899999999999997,"5min":1.714,"15min":1.714},"last":0.376}]},{"osd":1,"last update":"Fri Oct 6 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.39700000000000002,"15min":0.379},"min":{"1min":0.35199999999999998,"5min":0.253,"15min":0.19900000000000001},"max":{"1min":0.55300000000000005,"5min":0.56999999999999995,"15min":0.745},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.39200000000000002,"15min":0.36599999999999999},"min":{"1min":0.29999999999999999,"5min":0.23200000000000001,"15min":0.216},"max":{"1min":0.52300000000000002,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.26500000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.39500000000000002,"15min":0.373},"min":{"1min":0.35999999999999999,"5min":0.255,"15min":0.23200000000000001},"max":{"1min":0.54300000000000004,"5min":0.621,"15min":0.629},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.40699999999999997,"15min":0.377},"min":{"1min":0.33800000000000002,"5min":0.26600000000000001,"15min":0.251},"max":{"1min":0.56100000000000005,"5min":0.754,"15min":0.754},"last":0.307}]},{"osd":4,"last update":"Fri Oct 6 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.58999999999999997,"15min":0.54300000000000004},"min":{"1min":0.52900000000000003,"5min":0.35799999999999998,"15min":0.30299999999999999},"max":{"1min":0.75700000000000001,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.72099999999999997,"15min":0.59899999999999998},"min":{"1min":0.38300000000000001,"5min":0.36499999999999999,"15min":0.27900000000000003},"max":{"1min":0.92400000000000004,"5min":15.26,"15min":15.26},"last":0.42799999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.72999999999999998,"15min":0.60199999999999998},"min":{"1min":0.45000000000000001,"5min":0.38200000000000001,"15min":0.32400000000000001},"max":{"1min":0.874,"5min":15.186,"15min":15.186},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.60099999999999998,"15min":0.56899999999999995},"min":{"1min":0.47399999999999998,"5min":0.40600000000000003,"15min":0.35099999999999998},"max":{"1min":0.78300000000000003,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.496}]},{"osd":6,"last update":"Fri Oct 6 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.624,"15min":0.59199999999999997},"min":{"1min":0.5,"5min":0.42599999999999999,"15min":0.32600000000000001},"max":{"1min":0.90400000000000003,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.63100000000000001,"15min":0.58899999999999997},"min":{"1min":0.505,"5min":0.438,"15min":0.34200000000000003},"max":{"1min":0.82099999999999995,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.50600000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.70699999999999996,"15min":0.60899999999999999},"min":{"1min":0.47499999999999998,"5min":0.41099999999999998,"15min":0.34499999999999997},"max":{"1min":0.83599999999999997,"5min":10.977,"15min":10.977},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.60699999999999998,"15min":0.57899999999999996},"min":{"1min":0.53700000000000003,"5min":0.39600000000000002,"15min":0.38200000000000001},"max":{"1min":0.75,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.438}]}]},{"osd":3,"up_from":13,"seq":55834575030,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":317956,"kb_used_data":8380,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94053884,"statfs":{"total":96636764160,"available":96311177216,"internally_reserved":0,"allocated":8581120,"data_stored":7349165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.375,"15min":0.33300000000000002},"min":{"1min":0.25900000000000001,"5min":0.19500000000000001,"15min":0.18099999999999999},"max":{"1min":0.58399999999999996,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.442,"15min":0.39100000000000001},"min":{"1min":0.36499999999999999,"5min":0.23000000000000001,"15min":0.22700000000000001},"max":{"1min":0.60899999999999999,"5min":4.4820000000000002,"15min":4.4820000000000002},"last":0.33700000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.34300000000000003,"15min":0.32300000000000001},"min":{"1min":0.308,"5min":0.22800000000000001,"15min":0.21299999999999999},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.65400000000000003},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.38200000000000001,"15min":0.36099999999999999},"min":{"1min":0.34100000000000003,"5min":0.251,"15min":0.188},"max":{"1min":0.52600000000000002,"5min":0.54100000000000004,"15min":1.196},"last":0.48199999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.41799999999999998,"15min":0.38},"min":{"1min":0.32900000000000001,"5min":0.23400000000000001,"15min":0.19600000000000001},"max":{"1min":0.56499999999999995,"5min":4.601,"15min":4.601},"last":0.375},{"interface":"front","average":{"1min":0.5,"5min":0.46600000000000003,"15min":0.42399999999999999},"min":{"1min":0.38800000000000001,"5min":0.28499999999999998,"15min":0.26100000000000001},"max":{"1min":0.66600000000000004,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.52000000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57999999999999996,"15min":0.54800000000000004},"min":{"1min":0.46300000000000002,"5min":0.378,"15min":0.311},"max":{"1min":0.79700000000000004,"5min":0.84099999999999997,"15min":1.694},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.58699999999999997,"15min":0.55000000000000004},"min":{"1min":0.40899999999999997,"5min":0.32600000000000001,"15min":0.30199999999999999},"max":{"1min":0.82299999999999995,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.38600000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.57899999999999996,"15min":0.55200000000000005},"min":{"1min":0.46899999999999997,"5min":0.34100000000000003,"15min":0.29399999999999998},"max":{"1min":0.77500000000000002,"5min":0.83999999999999997,"15min":0.878},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.58899999999999997,"15min":0.56200000000000006},"min":{"1min":0.45900000000000002,"5min":0.35699999999999998,"15min":0.29699999999999999},"max":{"1min":0.80800000000000005,"5min":0.91000000000000003,"15min":1.165},"last":0.71399999999999997}]},{"osd":6,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.622,"15min":0.58699999999999997},"min":{"1min":0.496,"5min":0.42499999999999999,"15min":0.36699999999999999},"max":{"1min":0.84099999999999997,"5min":0.95399999999999996,"15min":1.1359999999999999},"last":0.752},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.625,"15min":0.59299999999999997},"min":{"1min":0.49199999999999999,"5min":0.36799999999999999,"15min":0.34399999999999997},"max":{"1min":0.80500000000000005,"5min":1.012,"15min":1.7470000000000001},"last":0.40400000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.60899999999999999,"15min":0.57999999999999996},"min":{"1min":0.51200000000000001,"5min":0.39600000000000002,"15min":0.35599999999999998},"max":{"1min":0.83499999999999996,"5min":0.89900000000000002,"15min":1.657},"last":0.432},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.61099999999999999,"15min":0.58399999999999996},"min":{"1min":0.53500000000000003,"5min":0.40400000000000003,"15min":0.35499999999999998},"max":{"1min":0.86699999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.496}]}]},{"osd":4,"up_from":13,"seq":55834575029,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307724,"kb_used_data":2244,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064116,"statfs":{"total":96636764160,"available":96321654784,"internally_reserved":0,"allocated":2297856,"data_stored":1065437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:20:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.50600000000000001,"15min":0.49399999999999999},"min":{"1min":0.39000000000000001,"5min":0.24199999999999999,"15min":0.19500000000000001},"max":{"1min":0.67500000000000004,"5min":0.76800000000000002,"15min":2.6619999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52800000000000002,"15min":0.498},"min":{"1min":0.33900000000000002,"5min":0.28899999999999998,"15min":0.215},"max":{"1min":0.65400000000000003,"5min":0.81499999999999995,"15min":0.91200000000000003},"last":0.56999999999999995}]},{"osd":1,"last update":"Fri Oct 6 11:20:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52400000000000002,"15min":0.51300000000000001},"min":{"1min":0.35099999999999998,"5min":0.27600000000000002,"15min":0.23300000000000001},"max":{"1min":0.68000000000000005,"5min":0.94099999999999995,"15min":2.8650000000000002},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53200000000000003,"15min":0.52200000000000002},"min":{"1min":0.42599999999999999,"5min":0.27000000000000002,"15min":0.25800000000000001},"max":{"1min":0.63600000000000001,"5min":0.79800000000000004,"15min":2.7610000000000001},"last":0.63}]},{"osd":2,"last update":"Fri Oct 6 11:20:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55800000000000005,"15min":0.52600000000000002},"min":{"1min":0.32500000000000001,"5min":0.312,"15min":0.23100000000000001},"max":{"1min":0.72399999999999998,"5min":0.88800000000000001,"15min":1.6910000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58899999999999997,"15min":0.57199999999999995},"min":{"1min":0.40200000000000002,"5min":0.38700000000000001,"15min":0.30599999999999999},"max":{"1min":0.73399999999999999,"5min":0.84999999999999998,"15min":1.718},"last":0.378}]},{"osd":3,"last update":"Fri Oct 6 11:20:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56100000000000005,"15min":0.56399999999999995},"min":{"1min":0.46500000000000002,"5min":0.36699999999999999,"15min":0.26700000000000002},"max":{"1min":0.71799999999999997,"5min":0.79600000000000004,"15min":2.677},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56499999999999995,"15min":0.53500000000000003},"min":{"1min":0.435,"5min":0.35599999999999998,"15min":0.27500000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":1.784},"last":0.59099999999999997}]},{"osd":5,"last update":"Fri Oct 6 11:20:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.48999999999999999,"15min":0.47699999999999998},"min":{"1min":0.34200000000000003,"5min":0.33700000000000002,"15min":0.23200000000000001},"max":{"1min":0.72899999999999998,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.54700000000000004,"15min":0.52200000000000002},"min":{"1min":0.378,"5min":0.29099999999999998,"15min":0.28399999999999997},"max":{"1min":0.76700000000000002,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.75}]},{"osd":6,"last update":"Fri Oct 6 11:20:02 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.54700000000000004,"15min":0.52100000000000002},"min":{"1min":0.36499999999999999,"5min":0.30199999999999999,"15min":0.252},"max":{"1min":0.86799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.56299999999999994,"15min":0.54900000000000004},"min":{"1min":0.40600000000000003,"5min":0.38700000000000001,"15min":0.29199999999999998},"max":{"1min":0.79400000000000004,"5min":0.90400000000000003,"15min":1.165},"last":0.66400000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:20:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57699999999999996,"15min":0.56100000000000005},"min":{"1min":0.438,"5min":0.312,"15min":0.312},"max":{"1min":0.80600000000000005,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.62},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.60899999999999999,"15min":0.58699999999999997},"min":{"1min":0.38500000000000001,"5min":0.34399999999999997,"15min":0.317},"max":{"1min":0.89600000000000002,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.64800000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575031,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":305676,"kb_used_data":8388,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94066164,"statfs":{"total":96636764160,"available":96323751936,"internally_reserved":0,"allocated":8589312,"data_stored":7356893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52000000000000002,"15min":0.53100000000000003},"min":{"1min":0.29299999999999998,"5min":0.26000000000000001,"15min":0.20499999999999999},"max":{"1min":0.72699999999999998,"5min":0.752,"15min":5.0490000000000004},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51800000000000002,"15min":0.51500000000000001},"min":{"1min":0.34599999999999997,"5min":0.26600000000000001,"15min":0.22900000000000001},"max":{"1min":0.69399999999999995,"5min":0.75,"15min":5.1449999999999996},"last":0.48599999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.52600000000000002,"15min":0.49199999999999999},"min":{"1min":0.35999999999999999,"5min":0.27800000000000002,"15min":0.25},"max":{"1min":0.70299999999999996,"5min":0.76400000000000001,"15min":0.97199999999999998},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54300000000000004,"15min":0.51400000000000001},"min":{"1min":0.33500000000000002,"5min":0.29799999999999999,"15min":0.27400000000000002},"max":{"1min":0.74199999999999999,"5min":0.752,"15min":1.8799999999999999},"last":0.61899999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56799999999999995,"15min":0.55200000000000005},"min":{"1min":0.36499999999999999,"5min":0.313,"15min":0.28299999999999997},"max":{"1min":0.755,"5min":0.80700000000000005,"15min":4.234},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59699999999999998,"15min":0.56299999999999994},"min":{"1min":0.438,"5min":0.35899999999999999,"15min":0.315},"max":{"1min":0.753,"5min":0.82099999999999995,"15min":1.0369999999999999},"last":0.51000000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52900000000000003,"15min":0.54200000000000004},"min":{"1min":0.34499999999999997,"5min":0.29499999999999998,"15min":0.27700000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":5.2169999999999996},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.55900000000000005,"15min":0.54000000000000004},"min":{"1min":0.372,"5min":0.32400000000000001,"15min":0.29699999999999999},"max":{"1min":0.72899999999999998,"5min":0.76000000000000001,"15min":1.008},"last":0.54800000000000004}]},{"osd":4,"last update":"Fri Oct 6 11:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.49099999999999999,"15min":0.49399999999999999},"min":{"1min":0.28699999999999998,"5min":0.26400000000000001,"15min":0.23999999999999999},"max":{"1min":0.52600000000000002,"5min":0.78000000000000003,"15min":1.917},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.50600000000000001,"15min":0.504},"min":{"1min":0.33300000000000002,"5min":0.251,"15min":0.23899999999999999},"max":{"1min":0.58299999999999996,"5min":0.77600000000000002,"15min":0.87},"last":0.56699999999999995}]},{"osd":6,"last update":"Fri Oct 6 11:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.52500000000000002,"15min":0.53000000000000003},"min":{"1min":0.372,"5min":0.32700000000000001,"15min":0.27600000000000002},"max":{"1min":0.55700000000000005,"5min":0.78800000000000003,"15min":2.0139999999999998},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.59499999999999997,"15min":0.58799999999999997},"min":{"1min":0.35599999999999998,"5min":0.30299999999999999,"15min":0.29999999999999999},"max":{"1min":0.79100000000000004,"5min":0.85099999999999998,"15min":1.9470000000000001},"last":0.68500000000000005}]},{"osd":7,"last update":"Fri Oct 6 11:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.55000000000000004,"15min":0.55200000000000005},"min":{"1min":0.32900000000000001,"5min":0.311,"15min":0.27700000000000002},"max":{"1min":0.73699999999999999,"5min":0.79700000000000004,"15min":0.96499999999999997},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.39700000000000002,"5min":0.29199999999999998,"15min":0.28799999999999998},"max":{"1min":0.70299999999999996,"5min":0.81399999999999995,"15min":1.4119999999999999},"last":0.628}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:20:31.059 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T11:20:31.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.172+0000 7f6168c5c700 1 Processor -- start 2023-10-06T11:20:31.174 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.172+0000 7f6168c5c700 1 -- start start 2023-10-06T11:20:31.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.174+0000 7f6168c5c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f61640b2530 0x7f61641646b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:31.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.174+0000 7f6168c5c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61640cf100 con 0x7f6164143410 2023-10-06T11:20:31.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.174+0000 7f6168c5c700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61640ceb30 con 0x7f6164143040 2023-10-06T11:20:31.176 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.174+0000 7f6168c5c700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61640b4170 con 0x7f61640b2530 2023-10-06T11:20:31.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.174+0000 7f6163fff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f61640b2530 0x7f61641646b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:31.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.174+0000 7f6162ffd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f6164143410 0x7f61640b4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:49452/0 (socket says 172.21.15.146:49452) 2023-10-06T11:20:31.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.174+0000 7f6162ffd700 1 -- 172.21.15.146:0/627677178 learned_addr learned my addr 172.21.15.146:0/627677178 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:20:31.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.174+0000 7f6163fff700 1 -- 172.21.15.146:0/627677178 >> v1:172.21.15.151:6789/0 conn(0x7f6164143040 legacy=0x7f61640b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:31.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.174+0000 7f6163fff700 1 -- 172.21.15.146:0/627677178 >> v1:172.21.15.146:6789/0 conn(0x7f6164143410 legacy=0x7f61640b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:31.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.174+0000 7f6163fff700 1 -- 172.21.15.146:0/627677178 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61640cedd0 con 0x7f61640b2530 2023-10-06T11:20:31.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.174+0000 7f61627fc700 1 -- 172.21.15.146:0/627677178 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1195661481 0 0) 0x7f61640cf100 con 0x7f6164143410 2023-10-06T11:20:31.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.174+0000 7f6163fff700 1 --2- 172.21.15.146:0/627677178 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61640b2530 0x7f61641646b0 secure :-1 s=READY pgs=2397 cs=0 l=1 rev1=1 crypto rx=0x7f615c009e90 tx=0x7f615c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=327039d7020a742f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:31.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.174+0000 7f61627fc700 1 -- 172.21.15.146:0/627677178 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615c00e070 con 0x7f61640b2530 2023-10-06T11:20:31.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.174+0000 7f61627fc700 1 -- 172.21.15.146:0/627677178 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f615c00bbb0 con 0x7f61640b2530 2023-10-06T11:20:31.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.174+0000 7f61627fc700 1 -- 172.21.15.146:0/627677178 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615c012430 con 0x7f61640b2530 2023-10-06T11:20:31.177 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.174+0000 7f6168c5c700 1 -- 172.21.15.146:0/627677178 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61640b2530 msgr2=0x7f61641646b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:31.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.174+0000 7f6168c5c700 1 --2- 172.21.15.146:0/627677178 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61640b2530 0x7f61641646b0 secure :-1 s=READY pgs=2397 cs=0 l=1 rev1=1 crypto rx=0x7f615c009e90 tx=0x7f615c009780 comp rx=0 tx=0).stop 2023-10-06T11:20:31.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.174+0000 7f6168c5c700 1 -- 172.21.15.146:0/627677178 shutdown_connections 2023-10-06T11:20:31.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.174+0000 7f6168c5c700 1 --2- 172.21.15.146:0/627677178 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f61640b2530 0x7f61641646b0 unknown :-1 s=CLOSED pgs=2397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:31.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.174+0000 7f6168c5c700 1 -- 172.21.15.146:0/627677178 >> 172.21.15.146:0/627677178 conn(0x7f616406eb10 msgr2=0x7f616406ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:31.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.174+0000 7f6168c5c700 1 -- 172.21.15.146:0/627677178 shutdown_connections 2023-10-06T11:20:31.178 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.174+0000 7f6168c5c700 1 -- 172.21.15.146:0/627677178 wait complete. 2023-10-06T11:20:31.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.175+0000 7f6168c5c700 1 Processor -- start 2023-10-06T11:20:31.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.175+0000 7f6168c5c700 1 -- start start 2023-10-06T11:20:31.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.176+0000 7f6168c5c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61640b2530 0x7f61641592a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:31.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.176+0000 7f6168c5c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6164143040 0x7f61640cc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:31.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.176+0000 7f6168c5c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6164143410 0x7f61640cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:31.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.176+0000 7f6168c5c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61641597e0 con 0x7f6164143040 2023-10-06T11:20:31.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.176+0000 7f6168c5c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616416dd20 con 0x7f6164143410 2023-10-06T11:20:31.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.176+0000 7f6168c5c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f616416d3f0 con 0x7f61640b2530 2023-10-06T11:20:31.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.176+0000 7f6162ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6164143040 0x7f61640cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:31.181 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.176+0000 7f6162ffd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6164143040 0x7f61640cc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:45354/0 (socket says 172.21.15.146:45354) 2023-10-06T11:20:31.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.176+0000 7f6162ffd700 1 -- 172.21.15.146:0/1205927831 learned_addr learned my addr 172.21.15.146:0/1205927831 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:31.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.176+0000 7f6163fff700 1 --2- 172.21.15.146:0/1205927831 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6164143410 0x7f61640cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:31.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.176+0000 7f61637fe700 1 --2- 172.21.15.146:0/1205927831 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61640b2530 0x7f61641592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:31.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.177+0000 7f6162ffd700 1 -- 172.21.15.146:0/1205927831 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61640b2530 msgr2=0x7f61641592a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:31.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.177+0000 7f6162ffd700 1 --2- 172.21.15.146:0/1205927831 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61640b2530 0x7f61641592a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:31.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.177+0000 7f6162ffd700 1 -- 172.21.15.146:0/1205927831 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6164143410 msgr2=0x7f61640cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:31.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.177+0000 7f6162ffd700 1 --2- 172.21.15.146:0/1205927831 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6164143410 0x7f61640cc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:31.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.177+0000 7f6162ffd700 1 -- 172.21.15.146:0/1205927831 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f615c009a20 con 0x7f6164143040 2023-10-06T11:20:31.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.177+0000 7f6162ffd700 1 --2- 172.21.15.146:0/1205927831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6164143040 0x7f61640cc260 secure :-1 s=READY pgs=2398 cs=0 l=1 rev1=1 crypto rx=0x7f615800c5b0 tx=0x7f6158000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:31.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.177+0000 7f614b7fe700 1 -- 172.21.15.146:0/1205927831 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6158005b30 con 0x7f6164143040 2023-10-06T11:20:31.182 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.177+0000 7f614b7fe700 1 -- 172.21.15.146:0/1205927831 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6158005c90 con 0x7f6164143040 2023-10-06T11:20:31.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.177+0000 7f6168c5c700 1 -- 172.21.15.146:0/1205927831 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f616416d6d0 con 0x7f6164143040 2023-10-06T11:20:31.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.177+0000 7f614b7fe700 1 -- 172.21.15.146:0/1205927831 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61580072e0 con 0x7f6164143040 2023-10-06T11:20:31.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.177+0000 7f6168c5c700 1 -- 172.21.15.146:0/1205927831 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61640c57b0 con 0x7f6164143040 2023-10-06T11:20:31.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.178+0000 7f6168c5c700 1 -- 172.21.15.146:0/1205927831 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f616416de90 con 0x7f6164143040 2023-10-06T11:20:31.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.178+0000 7f614b7fe700 1 -- 172.21.15.146:0/1205927831 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f615801b3b0 con 0x7f6164143040 2023-10-06T11:20:31.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.179+0000 7f614b7fe700 1 --2- 172.21.15.146:0/1205927831 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6150066f30 0x7f61500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:31.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.179+0000 7f61637fe700 1 --2- 172.21.15.146:0/1205927831 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6150066f30 0x7f61500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:31.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.179+0000 7f614b7fe700 1 -- 172.21.15.146:0/1205927831 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f61580837d0 con 0x7f6164143040 2023-10-06T11:20:31.183 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.179+0000 7f61637fe700 1 --2- 172.21.15.146:0/1205927831 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6150066f30 0x7f61500693e0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f6154006fd0 tx=0x7f6154008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:31.184 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.184+0000 7f614b7fe700 1 -- 172.21.15.146:0/1205927831 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f615804b5a0 con 0x7f6164143040 2023-10-06T11:20:31.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.369+0000 7f6168c5c700 1 -- 172.21.15.146:0/1205927831 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f616404bb40 con 0x7f6164143040 2023-10-06T11:20:31.371 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.370+0000 7f614b7fe700 1 -- 172.21.15.146:0/1205927831 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v183) v1 ==== 74+0+13971 (secure 0 0 0) 0x7f615806ae60 con 0x7f6164143040 2023-10-06T11:20:31.372 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:20:31.372 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":183,"fsid":"c26a2d96-d76d-4fc7-b9a0-b798eb6beeb1","created":"2023-10-06T11:05:25.539642+0000","modified":"2023-10-06T11:20:27.042302+0000","last_up_change":"2023-10-06T11:05:36.302744+0000","last_in_change":"2023-10-06T11:05:27.932211+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-10-06T11:05:36.687307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":".mgr","create_time":"2023-10-06T11:05:37.171199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"838fc683-c326-415a-b906-83cf8f3a396c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6808","nonce":90665},{"type":"v1","addr":"172.21.15.146:6809","nonce":90665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6810","nonce":90665},{"type":"v1","addr":"172.21.15.146:6811","nonce":90665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6814","nonce":90665},{"type":"v1","addr":"172.21.15.146:6815","nonce":90665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6812","nonce":90665},{"type":"v1","addr":"172.21.15.146:6813","nonce":90665}]},"public_addr":"172.21.15.146:6809/90665","cluster_addr":"172.21.15.146:6811/90665","heartbeat_back_addr":"172.21.15.146:6815/90665","heartbeat_front_addr":"172.21.15.146:6813/90665","state":["exists","up"]},{"osd":1,"uuid":"94f730ed-f906-4eaf-bec5-b878c4054a44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6800","nonce":90681},{"type":"v1","addr":"172.21.15.146:6801","nonce":90681}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6802","nonce":90681},{"type":"v1","addr":"172.21.15.146:6803","nonce":90681}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6806","nonce":90681},{"type":"v1","addr":"172.21.15.146:6807","nonce":90681}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6804","nonce":90681},{"type":"v1","addr":"172.21.15.146:6805","nonce":90681}]},"public_addr":"172.21.15.146:6801/90681","cluster_addr":"172.21.15.146:6803/90681","heartbeat_back_addr":"172.21.15.146:6807/90681","heartbeat_front_addr":"172.21.15.146:6805/90681","state":["exists","up"]},{"osd":2,"uuid":"3cd165bf-ccf7-44c3-96a9-c998febbefe0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6816","nonce":90680},{"type":"v1","addr":"172.21.15.146:6817","nonce":90680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6818","nonce":90680},{"type":"v1","addr":"172.21.15.146:6819","nonce":90680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6822","nonce":90680},{"type":"v1","addr":"172.21.15.146:6823","nonce":90680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6820","nonce":90680},{"type":"v1","addr":"172.21.15.146:6821","nonce":90680}]},"public_addr":"172.21.15.146:6817/90680","cluster_addr":"172.21.15.146:6819/90680","heartbeat_back_addr":"172.21.15.146:6823/90680","heartbeat_front_addr":"172.21.15.146:6821/90680","state":["exists","up"]},{"osd":3,"uuid":"6132b6d7-a09c-4a1f-824b-16983afa74e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6824","nonce":90682},{"type":"v1","addr":"172.21.15.146:6825","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6826","nonce":90682},{"type":"v1","addr":"172.21.15.146:6827","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6830","nonce":90682},{"type":"v1","addr":"172.21.15.146:6831","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6828","nonce":90682},{"type":"v1","addr":"172.21.15.146:6829","nonce":90682}]},"public_addr":"172.21.15.146:6825/90682","cluster_addr":"172.21.15.146:6827/90682","heartbeat_back_addr":"172.21.15.146:6831/90682","heartbeat_front_addr":"172.21.15.146:6829/90682","state":["exists","up"]},{"osd":4,"uuid":"27155e9b-fa1e-4960-bbf4-4a0bcea50e60","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":179,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":90899},{"type":"v1","addr":"172.21.15.151:6817","nonce":90899}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":90899},{"type":"v1","addr":"172.21.15.151:6819","nonce":90899}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":90899},{"type":"v1","addr":"172.21.15.151:6823","nonce":90899}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":90899},{"type":"v1","addr":"172.21.15.151:6821","nonce":90899}]},"public_addr":"172.21.15.151:6817/90899","cluster_addr":"172.21.15.151:6819/90899","heartbeat_back_addr":"172.21.15.151:6823/90899","heartbeat_front_addr":"172.21.15.151:6821/90899","state":["exists","up"]},{"osd":5,"uuid":"bafd6c93-ce73-47a5-b027-309ed5c9d9e0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":90889},{"type":"v1","addr":"172.21.15.151:6801","nonce":90889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":90889},{"type":"v1","addr":"172.21.15.151:6803","nonce":90889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":90889},{"type":"v1","addr":"172.21.15.151:6807","nonce":90889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":90889},{"type":"v1","addr":"172.21.15.151:6805","nonce":90889}]},"public_addr":"172.21.15.151:6801/90889","cluster_addr":"172.21.15.151:6803/90889","heartbeat_back_addr":"172.21.15.151:6807/90889","heartbeat_front_addr":"172.21.15.151:6805/90889","state":["exists","up"]},{"osd":6,"uuid":"ca086e64-8042-425c-80f1-cb31555b13fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":90920},{"type":"v1","addr":"172.21.15.151:6825","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":90920},{"type":"v1","addr":"172.21.15.151:6827","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":90920},{"type":"v1","addr":"172.21.15.151:6831","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":90920},{"type":"v1","addr":"172.21.15.151:6829","nonce":90920}]},"public_addr":"172.21.15.151:6825/90920","cluster_addr":"172.21.15.151:6827/90920","heartbeat_back_addr":"172.21.15.151:6831/90920","heartbeat_front_addr":"172.21.15.151:6829/90920","state":["exists","up"]},{"osd":7,"uuid":"911f8a63-3282-4197-9713-b484cc5a706f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":90890},{"type":"v1","addr":"172.21.15.151:6809","nonce":90890}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":90890},{"type":"v1","addr":"172.21.15.151:6811","nonce":90890}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":90890},{"type":"v1","addr":"172.21.15.151:6815","nonce":90890}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":90890},{"type":"v1","addr":"172.21.15.151:6813","nonce":90890}]},"public_addr":"172.21.15.151:6809/90890","cluster_addr":"172.21.15.151:6811/90890","heartbeat_back_addr":"172.21.15.151:6815/90890","heartbeat_front_addr":"172.21.15.151:6813/90890","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.154758+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:32.832043+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.040886+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.136723+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.157134+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.095586+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.117960+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T11:05:33.159069+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.146:6837/2322816938":"2023-10-07T11:20:24.023385+0000","172.21.15.146:6835/2322816938":"2023-10-07T11:20:24.023385+0000","172.21.15.151:6834/1134233840":"2023-10-07T11:19:12.134281+0000","172.21.15.151:6832/1134233840":"2023-10-07T11:19:12.134281+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T11:20:31.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.373+0000 7f6168c5c700 1 -- 172.21.15.146:0/1205927831 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6150066f30 msgr2=0x7f61500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:31.374 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.373+0000 7f6168c5c700 1 --2- 172.21.15.146:0/1205927831 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6150066f30 0x7f61500693e0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f6154006fd0 tx=0x7f6154008040 comp rx=0 tx=0).stop 2023-10-06T11:20:31.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.373+0000 7f6168c5c700 1 -- 172.21.15.146:0/1205927831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6164143040 msgr2=0x7f61640cc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:31.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.373+0000 7f6168c5c700 1 --2- 172.21.15.146:0/1205927831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6164143040 0x7f61640cc260 secure :-1 s=READY pgs=2398 cs=0 l=1 rev1=1 crypto rx=0x7f615800c5b0 tx=0x7f6158000fe0 comp rx=0 tx=0).stop 2023-10-06T11:20:31.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.373+0000 7f6168c5c700 1 -- 172.21.15.146:0/1205927831 shutdown_connections 2023-10-06T11:20:31.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.373+0000 7f6168c5c700 1 --2- 172.21.15.146:0/1205927831 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f6150066f30 0x7f61500693e0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:31.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.373+0000 7f6168c5c700 1 --2- 172.21.15.146:0/1205927831 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6164143410 0x7f61640cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:31.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.373+0000 7f6168c5c700 1 --2- 172.21.15.146:0/1205927831 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f61640b2530 0x7f61641592a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:31.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.373+0000 7f6168c5c700 1 --2- 172.21.15.146:0/1205927831 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f6164143040 0x7f61640cc260 unknown :-1 s=CLOSED pgs=2398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:31.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.373+0000 7f6168c5c700 1 -- 172.21.15.146:0/1205927831 >> 172.21.15.146:0/1205927831 conn(0x7f616406eb10 msgr2=0x7f61640cd090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:31.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.373+0000 7f6168c5c700 1 -- 172.21.15.146:0/1205927831 shutdown_connections 2023-10-06T11:20:31.375 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:31.373+0000 7f6168c5c700 1 -- 172.21.15.146:0/1205927831 wait complete. 2023-10-06T11:20:32.387 INFO:tasks.ceph:Scrubbing osd.0 2023-10-06T11:20:32.388 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-06T11:20:32.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.515+0000 7fc1cfb4c700 1 Processor -- start 2023-10-06T11:20:32.516 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.516+0000 7fc1cfb4c700 1 -- start start 2023-10-06T11:20:32.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.516+0000 7fc1cfb4c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc1c815d520 0x7fc1c80d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:32.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.516+0000 7fc1cfb4c700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1c80d0770 con 0x7fc1c81590d0 2023-10-06T11:20:32.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.516+0000 7fc1cfb4c700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1c80cfb60 con 0x7fc1c815d8f0 2023-10-06T11:20:32.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.516+0000 7fc1cfb4c700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1c80cfe40 con 0x7fc1c815d520 2023-10-06T11:20:32.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.516+0000 7fc1ce0e9700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fc1c81590d0 0x7fc1c8159530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52174/0 (socket says 172.21.15.146:52174) 2023-10-06T11:20:32.517 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.517+0000 7fc1ce0e9700 1 -- 172.21.15.146:0/2491103608 learned_addr learned my addr 172.21.15.146:0/2491103608 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:20:32.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.517+0000 7fc1cd8e8700 1 --2- 172.21.15.146:0/2491103608 >> v2:172.21.15.151:3300/0 conn(0x7fc1c815d520 0x7fc1c80d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:32.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.517+0000 7fc1cc8e6700 1 -- 172.21.15.146:0/2491103608 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3128514778 0 0) 0x7fc1c80d0770 con 0x7fc1c81590d0 2023-10-06T11:20:32.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.517+0000 7fc1cc8e6700 1 -- 172.21.15.146:0/2491103608 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1b0003570 con 0x7fc1c81590d0 2023-10-06T11:20:32.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.517+0000 7fc1cc8e6700 1 -- 172.21.15.146:0/2491103608 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 164866028 0 0) 0x7fc1b0003570 con 0x7fc1c81590d0 2023-10-06T11:20:32.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.517+0000 7fc1cc8e6700 1 -- 172.21.15.146:0/2491103608 >> v2:172.21.15.151:3300/0 conn(0x7fc1c815d520 msgr2=0x7fc1c80d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:32.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.517+0000 7fc1cc8e6700 1 --2- 172.21.15.146:0/2491103608 >> v2:172.21.15.151:3300/0 conn(0x7fc1c815d520 0x7fc1c80d0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:32.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.517+0000 7fc1cc8e6700 1 -- 172.21.15.146:0/2491103608 >> v1:172.21.15.151:6789/0 conn(0x7fc1c815d8f0 legacy=0x7fc1c80cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:32.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.517+0000 7fc1cc8e6700 1 -- 172.21.15.146:0/2491103608 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c80d0120 con 0x7fc1c81590d0 2023-10-06T11:20:32.523 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.517+0000 7fc1cc8e6700 1 -- 172.21.15.146:0/2491103608 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7fc1c0001470 con 0x7fc1c81590d0 2023-10-06T11:20:32.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.517+0000 7fc1cc8e6700 1 -- 172.21.15.146:0/2491103608 >> v1:172.21.15.146:6789/0 conn(0x7fc1c81590d0 legacy=0x7fc1c8159530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:32.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.517+0000 7fc1cc8e6700 1 --2- 172.21.15.146:0/2491103608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1b0003a60 0x7fc1b0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:32.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.517+0000 7fc1cc8e6700 1 --2- 172.21.15.146:0/2491103608 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc1b0004810 0x7fc1b0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:32.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.517+0000 7fc1cc8e6700 1 --2- 172.21.15.146:0/2491103608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1b00051c0 0x7fc1b000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:32.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.517+0000 7fc1cc8e6700 1 -- 172.21.15.146:0/2491103608 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c80cfe40 con 0x7fc1b0003a60 2023-10-06T11:20:32.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.517+0000 7fc1cc8e6700 1 -- 172.21.15.146:0/2491103608 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b000c0d0 con 0x7fc1b00051c0 2023-10-06T11:20:32.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.517+0000 7fc1cc8e6700 1 -- 172.21.15.146:0/2491103608 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b000c290 con 0x7fc1b0004810 2023-10-06T11:20:32.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.517+0000 7fc1cd8e8700 1 --2- 172.21.15.146:0/2491103608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1b0003a60 0x7fc1b0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:32.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.517+0000 7fc1ce0e9700 1 --2- 172.21.15.146:0/2491103608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1b00051c0 0x7fc1b000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:32.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.517+0000 7fc1cd0e7700 1 --2- 172.21.15.146:0/2491103608 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc1b0004810 0x7fc1b0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:32.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.517+0000 7fc1cd8e8700 1 -- 172.21.15.146:0/2491103608 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc1b0004810 msgr2=0x7fc1b0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:32.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.517+0000 7fc1cd8e8700 1 --2- 172.21.15.146:0/2491103608 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc1b0004810 0x7fc1b0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:32.524 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.517+0000 7fc1cd8e8700 1 -- 172.21.15.146:0/2491103608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1b00051c0 msgr2=0x7fc1b000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:32.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.517+0000 7fc1cd8e8700 1 --2- 172.21.15.146:0/2491103608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1b00051c0 0x7fc1b000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:32.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.518+0000 7fc1cd8e8700 1 -- 172.21.15.146:0/2491103608 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b0003570 con 0x7fc1b0003a60 2023-10-06T11:20:32.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.518+0000 7fc1ce0e9700 1 --2- 172.21.15.146:0/2491103608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1b00051c0 0x7fc1b000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:20:32.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.518+0000 7fc1cd0e7700 1 --2- 172.21.15.146:0/2491103608 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc1b0004810 0x7fc1b0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:20:32.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.518+0000 7fc1ce0e9700 1 -- 172.21.15.146:0/2491103608 reap_dead start 2023-10-06T11:20:32.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.518+0000 7fc1cd8e8700 1 --2- 172.21.15.146:0/2491103608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1b0003a60 0x7fc1b0003e70 secure :-1 s=READY pgs=2400 cs=0 l=1 rev1=1 crypto rx=0x7fc1b800e210 tx=0x7fc1b800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b222e41458cf2f57 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:32.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.518+0000 7fc1cc8e6700 1 -- 172.21.15.146:0/2491103608 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b800eac0 con 0x7fc1b0003a60 2023-10-06T11:20:32.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.518+0000 7fc1cc8e6700 1 -- 172.21.15.146:0/2491103608 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1b800f040 con 0x7fc1b0003a60 2023-10-06T11:20:32.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.518+0000 7fc1cc8e6700 1 -- 172.21.15.146:0/2491103608 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1b800ee70 con 0x7fc1b0003a60 2023-10-06T11:20:32.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.518+0000 7fc1cfb4c700 1 -- 172.21.15.146:0/2491103608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1b0003a60 msgr2=0x7fc1b0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:32.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.518+0000 7fc1cfb4c700 1 --2- 172.21.15.146:0/2491103608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1b0003a60 0x7fc1b0003e70 secure :-1 s=READY pgs=2400 cs=0 l=1 rev1=1 crypto rx=0x7fc1b800e210 tx=0x7fc1b800b040 comp rx=0 tx=0).stop 2023-10-06T11:20:32.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.518+0000 7fc1cfb4c700 1 -- 172.21.15.146:0/2491103608 shutdown_connections 2023-10-06T11:20:32.525 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.518+0000 7fc1cfb4c700 1 --2- 172.21.15.146:0/2491103608 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1b0003a60 0x7fc1b0003e70 unknown :-1 s=CLOSED pgs=2400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:32.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.518+0000 7fc1cfb4c700 1 -- 172.21.15.146:0/2491103608 >> 172.21.15.146:0/2491103608 conn(0x7fc1c806eb10 msgr2=0x7fc1c806ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:32.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.518+0000 7fc1cfb4c700 1 -- 172.21.15.146:0/2491103608 shutdown_connections 2023-10-06T11:20:32.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.518+0000 7fc1cfb4c700 1 -- 172.21.15.146:0/2491103608 wait complete. 2023-10-06T11:20:32.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.519+0000 7fc1cfb4c700 1 Processor -- start 2023-10-06T11:20:32.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.519+0000 7fc1cfb4c700 1 -- start start 2023-10-06T11:20:32.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.520+0000 7fc1cfb4c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc1b0003a60 0x7fc1c8149f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:32.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.520+0000 7fc1cfb4c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1c80b49c0 0x7fc1c80b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:32.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.520+0000 7fc1cfb4c700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1c80b0df0 0x7fc1c80b1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:32.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.520+0000 7fc1cfb4c700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c8159ba0 con 0x7fc1c80b0df0 2023-10-06T11:20:32.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.520+0000 7fc1cfb4c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c815a160 con 0x7fc1c80b49c0 2023-10-06T11:20:32.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.520+0000 7fc1cfb4c700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1c80b1760 con 0x7fc1b0003a60 2023-10-06T11:20:32.526 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.520+0000 7fc1ce0e9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1c80b0df0 0x7fc1c80b1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:32.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.520+0000 7fc1ce0e9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1c80b0df0 0x7fc1c80b1220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58038/0 (socket says 172.21.15.146:58038) 2023-10-06T11:20:32.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.520+0000 7fc1ce0e9700 1 -- 172.21.15.146:0/2313341948 learned_addr learned my addr 172.21.15.146:0/2313341948 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:32.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.520+0000 7fc1cd8e8700 1 --2- 172.21.15.146:0/2313341948 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc1b0003a60 0x7fc1c8149f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:32.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.520+0000 7fc1cd0e7700 1 --2- 172.21.15.146:0/2313341948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1c80b49c0 0x7fc1c80b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:32.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.521+0000 7fc1ce0e9700 1 -- 172.21.15.146:0/2313341948 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc1b0003a60 msgr2=0x7fc1c8149f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:32.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.521+0000 7fc1ce0e9700 1 --2- 172.21.15.146:0/2313341948 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc1b0003a60 0x7fc1c8149f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:32.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.521+0000 7fc1ce0e9700 1 -- 172.21.15.146:0/2313341948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1c80b49c0 msgr2=0x7fc1c80b4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:32.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.521+0000 7fc1ce0e9700 1 --2- 172.21.15.146:0/2313341948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1c80b49c0 0x7fc1c80b4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:32.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.521+0000 7fc1ce0e9700 1 -- 172.21.15.146:0/2313341948 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c80c6c70 con 0x7fc1c80b0df0 2023-10-06T11:20:32.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.521+0000 7fc1cd0e7700 1 --2- 172.21.15.146:0/2313341948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1c80b49c0 0x7fc1c80b4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:20:32.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.521+0000 7fc1ce0e9700 1 --2- 172.21.15.146:0/2313341948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1c80b0df0 0x7fc1c80b1220 secure :-1 s=READY pgs=2401 cs=0 l=1 rev1=1 crypto rx=0x7fc1c80b3110 tx=0x7fc1c0001470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:32.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.521+0000 7fc1c5ffb700 1 -- 172.21.15.146:0/2313341948 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c000c600 con 0x7fc1c80b0df0 2023-10-06T11:20:32.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.521+0000 7fc1c5ffb700 1 -- 172.21.15.146:0/2313341948 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c000c760 con 0x7fc1c80b0df0 2023-10-06T11:20:32.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.521+0000 7fc1c5ffb700 1 -- 172.21.15.146:0/2313341948 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c000cae0 con 0x7fc1c80b0df0 2023-10-06T11:20:32.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.521+0000 7fc1cfb4c700 1 -- 172.21.15.146:0/2313341948 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1c80c6f50 con 0x7fc1c80b0df0 2023-10-06T11:20:32.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.521+0000 7fc1cfb4c700 1 -- 172.21.15.146:0/2313341948 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1c814a440 con 0x7fc1c80b0df0 2023-10-06T11:20:32.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.522+0000 7fc1cfb4c700 1 -- 172.21.15.146:0/2313341948 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc1c814a630 con 0x7fc1c80b0df0 2023-10-06T11:20:32.528 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.522+0000 7fc1c5ffb700 1 -- 172.21.15.146:0/2313341948 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc1c00133e0 con 0x7fc1c80b0df0 2023-10-06T11:20:32.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.523+0000 7fc1c5ffb700 1 --2- 172.21.15.146:0/2313341948 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc1b4066f30 0x7fc1b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:32.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.523+0000 7fc1c5ffb700 1 -- 172.21.15.146:0/2313341948 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5378+0+0 (secure 0 0 0) 0x7fc1c0083d80 con 0x7fc1c80b0df0 2023-10-06T11:20:32.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.523+0000 7fc1cd8e8700 1 --2- 172.21.15.146:0/2313341948 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc1b4066f30 0x7fc1b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:32.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.523+0000 7fc1c5ffb700 1 --2- 172.21.15.146:0/2313341948 >> [v2:172.21.15.146:6808/90665,v1:172.21.15.146:6809/90665] conn(0x7fc1b406d440 0x7fc1b406f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:32.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.523+0000 7fc1c5ffb700 1 -- 172.21.15.146:0/2313341948 --> [v2:172.21.15.146:6808/90665,v1:172.21.15.146:6809/90665] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc1b406ff00 con 0x7fc1b406d440 2023-10-06T11:20:32.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.523+0000 7fc1c5ffb700 1 -- 172.21.15.146:0/2313341948 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=183) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc1c00863c0 con 0x7fc1c80b0df0 2023-10-06T11:20:32.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.523+0000 7fc1cd0e7700 1 --2- 172.21.15.146:0/2313341948 >> [v2:172.21.15.146:6808/90665,v1:172.21.15.146:6809/90665] conn(0x7fc1b406d440 0x7fc1b406f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:32.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.523+0000 7fc1cd8e8700 1 --2- 172.21.15.146:0/2313341948 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc1b4066f30 0x7fc1b40693e0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fc1b800afd0 tx=0x7fc1b801a000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:32.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.523+0000 7fc1cd0e7700 1 --2- 172.21.15.146:0/2313341948 >> [v2:172.21.15.146:6808/90665,v1:172.21.15.146:6809/90665] conn(0x7fc1b406d440 0x7fc1b406f850 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:32.530 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.524+0000 7fc1c5ffb700 1 -- 172.21.15.146:0/2313341948 <== osd.0 v2:172.21.15.146:6808/90665 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fc1b406ff00 con 0x7fc1b406d440 2023-10-06T11:20:32.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.538+0000 7fc1cfb4c700 1 -- 172.21.15.146:0/2313341948 --> [v2:172.21.15.146:6808/90665,v1:172.21.15.146:6809/90665] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc1c8158350 con 0x7fc1b406d440 2023-10-06T11:20:32.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.538+0000 7fc1c5ffb700 1 -- 172.21.15.146:0/2313341948 <== osd.0 v2:172.21.15.146:6808/90665 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc1c8158350 con 0x7fc1b406d440 2023-10-06T11:20:32.539 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:20:32.539 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T11:20:32.539 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:20:32.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.538+0000 7fc1cfb4c700 1 -- 172.21.15.146:0/2313341948 >> [v2:172.21.15.146:6808/90665,v1:172.21.15.146:6809/90665] conn(0x7fc1b406d440 msgr2=0x7fc1b406f850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:32.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.538+0000 7fc1cfb4c700 1 --2- 172.21.15.146:0/2313341948 >> [v2:172.21.15.146:6808/90665,v1:172.21.15.146:6809/90665] conn(0x7fc1b406d440 0x7fc1b406f850 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:32.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.538+0000 7fc1cfb4c700 1 -- 172.21.15.146:0/2313341948 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc1b4066f30 msgr2=0x7fc1b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:32.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.538+0000 7fc1cfb4c700 1 --2- 172.21.15.146:0/2313341948 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fc1b4066f30 0x7fc1b40693e0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fc1b800afd0 tx=0x7fc1b801a000 comp rx=0 tx=0).stop 2023-10-06T11:20:32.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.538+0000 7fc1cfb4c700 1 -- 172.21.15.146:0/2313341948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1c80b0df0 msgr2=0x7fc1c80b1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:32.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.538+0000 7fc1cfb4c700 1 --2- 172.21.15.146:0/2313341948 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fc1c80b0df0 0x7fc1c80b1220 secure :-1 s=READY pgs=2401 cs=0 l=1 rev1=1 crypto rx=0x7fc1c80b3110 tx=0x7fc1c0001470 comp rx=0 tx=0).stop 2023-10-06T11:20:32.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.538+0000 7fc1ce0e9700 1 -- 172.21.15.146:0/2313341948 reap_dead start 2023-10-06T11:20:32.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.538+0000 7fc1cfb4c700 1 -- 172.21.15.146:0/2313341948 shutdown_connections 2023-10-06T11:20:32.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.538+0000 7fc1cfb4c700 1 -- 172.21.15.146:0/2313341948 >> 172.21.15.146:0/2313341948 conn(0x7fc1c806eb10 msgr2=0x7fc1c8156230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:32.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.538+0000 7fc1cfb4c700 1 -- 172.21.15.146:0/2313341948 shutdown_connections 2023-10-06T11:20:32.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.538+0000 7fc1cfb4c700 1 -- 172.21.15.146:0/2313341948 wait complete. 2023-10-06T11:20:32.551 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-06T11:20:32.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.664+0000 7f7bd4d5b700 1 Processor -- start 2023-10-06T11:20:32.665 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.664+0000 7f7bd4d5b700 1 -- start start 2023-10-06T11:20:32.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.665+0000 7f7bd4d5b700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7bd00b2b60 0x7f7bd0159c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:32.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.665+0000 7f7bd4d5b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7bd00b2f30 0x7f7bd006f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:32.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.665+0000 7f7bd4d5b700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bd00cd3e0 con 0x7f7bd00cd870 2023-10-06T11:20:32.667 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.665+0000 7f7bd4d5b700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bd015a140 con 0x7f7bd00b2b60 2023-10-06T11:20:32.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.665+0000 7f7bd4d5b700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bd006f7a0 con 0x7f7bd00b2f30 2023-10-06T11:20:32.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.665+0000 7f7bce59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7bd00b2b60 0x7f7bd0159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:32.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.665+0000 7f7bce59c700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f7bd00b2b60 0x7f7bd0159c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58048/0 (socket says 172.21.15.146:58048) 2023-10-06T11:20:32.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.665+0000 7f7bce59c700 1 -- 172.21.15.146:0/132203070 learned_addr learned my addr 172.21.15.146:0/132203070 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:32.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.665+0000 7f7bc5d9b700 1 --2- 172.21.15.146:0/132203070 >> v2:172.21.15.151:3300/0 conn(0x7f7bd00b2f30 0x7f7bd006f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:32.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.665+0000 7f7bce59c700 1 -- 172.21.15.146:0/132203070 >> v2:172.21.15.151:3300/0 conn(0x7f7bd00b2f30 msgr2=0x7f7bd006f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:32.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.665+0000 7f7bce59c700 1 --2- 172.21.15.146:0/132203070 >> v2:172.21.15.151:3300/0 conn(0x7f7bd00b2f30 0x7f7bd006f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:32.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.666+0000 7f7bce59c700 1 -- 172.21.15.146:0/132203070 >> v1:172.21.15.151:6789/0 conn(0x7f7bd00cd870 legacy=0x7f7bd00b0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:32.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.666+0000 7f7bce59c700 1 -- 172.21.15.146:0/132203070 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd015abc0 con 0x7f7bd00b2b60 2023-10-06T11:20:32.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.666+0000 7f7bce59c700 1 --2- 172.21.15.146:0/132203070 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bd00b2b60 0x7f7bd0159c00 secure :-1 s=READY pgs=2402 cs=0 l=1 rev1=1 crypto rx=0x7f7bd00ce3e0 tx=0x7f7bc0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0652e6c24046787 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:32.668 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.666+0000 7f7bcdd9b700 1 -- 172.21.15.146:0/132203070 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc000b820 con 0x7f7bd00b2b60 2023-10-06T11:20:32.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.666+0000 7f7bcdd9b700 1 -- 172.21.15.146:0/132203070 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc000b980 con 0x7f7bd00b2b60 2023-10-06T11:20:32.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.666+0000 7f7bcdd9b700 1 -- 172.21.15.146:0/132203070 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc000bd20 con 0x7f7bd00b2b60 2023-10-06T11:20:32.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.666+0000 7f7bd4d5b700 1 -- 172.21.15.146:0/132203070 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bd00b2b60 msgr2=0x7f7bd0159c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:32.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.666+0000 7f7bd4d5b700 1 --2- 172.21.15.146:0/132203070 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bd00b2b60 0x7f7bd0159c00 secure :-1 s=READY pgs=2402 cs=0 l=1 rev1=1 crypto rx=0x7f7bd00ce3e0 tx=0x7f7bc0009250 comp rx=0 tx=0).stop 2023-10-06T11:20:32.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.666+0000 7f7bd4d5b700 1 -- 172.21.15.146:0/132203070 shutdown_connections 2023-10-06T11:20:32.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.666+0000 7f7bd4d5b700 1 --2- 172.21.15.146:0/132203070 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bd00b2b60 0x7f7bd0159c00 unknown :-1 s=CLOSED pgs=2402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:32.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.666+0000 7f7bd4d5b700 1 --2- 172.21.15.146:0/132203070 >> v2:172.21.15.151:3300/0 conn(0x7f7bd00b2f30 0x7f7bd006f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:32.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.666+0000 7f7bd4d5b700 1 -- 172.21.15.146:0/132203070 >> 172.21.15.146:0/132203070 conn(0x7f7bd006a4d0 msgr2=0x7f7bd006a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:32.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.666+0000 7f7bd4d5b700 1 -- 172.21.15.146:0/132203070 shutdown_connections 2023-10-06T11:20:32.669 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.666+0000 7f7bd4d5b700 1 -- 172.21.15.146:0/132203070 wait complete. 2023-10-06T11:20:32.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.668+0000 7f7bd4d5b700 1 Processor -- start 2023-10-06T11:20:32.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.668+0000 7f7bd4d5b700 1 -- start start 2023-10-06T11:20:32.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.668+0000 7f7bd4d5b700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7bd00b2b60 0x7f7bd0067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:32.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.668+0000 7f7bd4d5b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bd00b2f30 0x7f7bd00c2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:32.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.668+0000 7f7bd4d5b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7bd00cd870 0x7f7bd00c25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:32.672 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.668+0000 7f7bd4d5b700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd016e4e0 con 0x7f7bd00b2f30 2023-10-06T11:20:32.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.668+0000 7f7bd4d5b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd016a060 con 0x7f7bd00cd870 2023-10-06T11:20:32.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.668+0000 7f7bd4d5b700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd016a300 con 0x7f7bd00b2b60 2023-10-06T11:20:32.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.668+0000 7f7bc5d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bd00b2f30 0x7f7bd00c2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:32.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.668+0000 7f7bc5d9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bd00b2f30 0x7f7bd00c2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58058/0 (socket says 172.21.15.146:58058) 2023-10-06T11:20:32.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.668+0000 7f7bc5d9b700 1 -- 172.21.15.146:0/3702364943 learned_addr learned my addr 172.21.15.146:0/3702364943 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:32.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.669+0000 7f7bced9d700 1 --2- 172.21.15.146:0/3702364943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7bd00cd870 0x7f7bd00c25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:32.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.669+0000 7f7bce59c700 1 --2- 172.21.15.146:0/3702364943 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7bd00b2b60 0x7f7bd0067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:32.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.669+0000 7f7bc5d9b700 1 -- 172.21.15.146:0/3702364943 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7bd00b2b60 msgr2=0x7f7bd0067630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:32.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.669+0000 7f7bc5d9b700 1 --2- 172.21.15.146:0/3702364943 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7bd00b2b60 0x7f7bd0067630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:32.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.669+0000 7f7bc5d9b700 1 -- 172.21.15.146:0/3702364943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7bd00cd870 msgr2=0x7f7bd00c25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:32.673 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.669+0000 7f7bc5d9b700 1 --2- 172.21.15.146:0/3702364943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7bd00cd870 0x7f7bd00c25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:32.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.669+0000 7f7bc5d9b700 1 -- 172.21.15.146:0/3702364943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc00094f0 con 0x7f7bd00b2f30 2023-10-06T11:20:32.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.669+0000 7f7bced9d700 1 --2- 172.21.15.146:0/3702364943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7bd00cd870 0x7f7bd00c25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:20:32.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.669+0000 7f7bce59c700 1 --2- 172.21.15.146:0/3702364943 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7bd00b2b60 0x7f7bd0067630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:20:32.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.669+0000 7f7bc5d9b700 1 --2- 172.21.15.146:0/3702364943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bd00b2f30 0x7f7bd00c2070 secure :-1 s=READY pgs=2403 cs=0 l=1 rev1=1 crypto rx=0x7f7bb800c880 tx=0x7f7bb8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:32.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.669+0000 7f7bc6ffd700 1 -- 172.21.15.146:0/3702364943 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb8011600 con 0x7f7bd00b2f30 2023-10-06T11:20:32.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.669+0000 7f7bc6ffd700 1 -- 172.21.15.146:0/3702364943 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb80117a0 con 0x7f7bd00b2f30 2023-10-06T11:20:32.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.669+0000 7f7bd4d5b700 1 -- 172.21.15.146:0/3702364943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bd016a5e0 con 0x7f7bd00b2f30 2023-10-06T11:20:32.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.669+0000 7f7bc6ffd700 1 -- 172.21.15.146:0/3702364943 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb8011b60 con 0x7f7bd00b2f30 2023-10-06T11:20:32.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.669+0000 7f7bd4d5b700 1 -- 172.21.15.146:0/3702364943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bd016ade0 con 0x7f7bd00b2f30 2023-10-06T11:20:32.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.670+0000 7f7bd4d5b700 1 -- 172.21.15.146:0/3702364943 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bd004c380 con 0x7f7bd00b2f30 2023-10-06T11:20:32.674 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.670+0000 7f7bc6ffd700 1 -- 172.21.15.146:0/3702364943 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7bb8018360 con 0x7f7bd00b2f30 2023-10-06T11:20:32.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.671+0000 7f7bc6ffd700 1 --2- 172.21.15.146:0/3702364943 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7bb0066f30 0x7f7bb00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:32.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.671+0000 7f7bc6ffd700 1 -- 172.21.15.146:0/3702364943 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f7bb80841d0 con 0x7f7bd00b2f30 2023-10-06T11:20:32.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.671+0000 7f7bce59c700 1 --2- 172.21.15.146:0/3702364943 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7bb0066f30 0x7f7bb00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:32.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.671+0000 7f7bce59c700 1 --2- 172.21.15.146:0/3702364943 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7bb0066f30 0x7f7bb00693e0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f7bd00ce3e0 tx=0x7f7bc0016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:32.676 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.675+0000 7f7bc6ffd700 1 -- 172.21.15.146:0/3702364943 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7bb8051580 con 0x7f7bd00b2f30 2023-10-06T11:20:32.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.857+0000 7f7bd4d5b700 1 -- 172.21.15.146:0/3702364943 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f7bd015a320 con 0x7f7bb0066f30 2023-10-06T11:20:32.858 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.857+0000 7f7bc6ffd700 1 -- 172.21.15.146:0/3702364943 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7bd015a320 con 0x7f7bb0066f30 2023-10-06T11:20:32.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.859+0000 7f7bd4d5b700 1 -- 172.21.15.146:0/3702364943 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7bb0066f30 msgr2=0x7f7bb00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:32.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.859+0000 7f7bd4d5b700 1 --2- 172.21.15.146:0/3702364943 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7bb0066f30 0x7f7bb00693e0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f7bd00ce3e0 tx=0x7f7bc0016000 comp rx=0 tx=0).stop 2023-10-06T11:20:32.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.859+0000 7f7bd4d5b700 1 -- 172.21.15.146:0/3702364943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bd00b2f30 msgr2=0x7f7bd00c2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:32.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.859+0000 7f7bd4d5b700 1 --2- 172.21.15.146:0/3702364943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bd00b2f30 0x7f7bd00c2070 secure :-1 s=READY pgs=2403 cs=0 l=1 rev1=1 crypto rx=0x7f7bb800c880 tx=0x7f7bb8008040 comp rx=0 tx=0).stop 2023-10-06T11:20:32.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.859+0000 7f7bd4d5b700 1 -- 172.21.15.146:0/3702364943 shutdown_connections 2023-10-06T11:20:32.860 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.859+0000 7f7bd4d5b700 1 --2- 172.21.15.146:0/3702364943 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f7bb0066f30 0x7f7bb00693e0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:32.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.859+0000 7f7bd4d5b700 1 --2- 172.21.15.146:0/3702364943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7bd00cd870 0x7f7bd00c25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:32.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.859+0000 7f7bd4d5b700 1 --2- 172.21.15.146:0/3702364943 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7bd00b2b60 0x7f7bd0067630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:32.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.859+0000 7f7bd4d5b700 1 --2- 172.21.15.146:0/3702364943 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f7bd00b2f30 0x7f7bd00c2070 unknown :-1 s=CLOSED pgs=2403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:32.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.859+0000 7f7bd4d5b700 1 -- 172.21.15.146:0/3702364943 >> 172.21.15.146:0/3702364943 conn(0x7f7bd006a4d0 msgr2=0x7f7bd0158f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:32.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.859+0000 7f7bd4d5b700 1 -- 172.21.15.146:0/3702364943 shutdown_connections 2023-10-06T11:20:32.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.859+0000 7f7bd4d5b700 1 -- 172.21.15.146:0/3702364943 wait complete. 2023-10-06T11:20:32.861 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 0 to deep-scrub 2023-10-06T11:20:32.872 INFO:tasks.ceph:Scrubbing osd.1 2023-10-06T11:20:32.872 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-06T11:20:32.990 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.989+0000 7fb5e6c55700 1 Processor -- start 2023-10-06T11:20:32.991 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.989+0000 7fb5e6c55700 1 -- start start 2023-10-06T11:20:32.997 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.990+0000 7fb5e6c55700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb5e006bb90 0x7fb5e00ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:32.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.990+0000 7fb5e6c55700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5e015bcb0 con 0x7fb5e0151b30 2023-10-06T11:20:32.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.990+0000 7fb5e6c55700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5e015b380 con 0x7fb5e006b740 2023-10-06T11:20:32.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.990+0000 7fb5e6c55700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5e00c9530 con 0x7fb5e006bb90 2023-10-06T11:20:32.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.990+0000 7fb5e49f1700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb5e0151b30 0x7fb5e00c8a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52180/0 (socket says 172.21.15.146:52180) 2023-10-06T11:20:32.998 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.990+0000 7fb5e49f1700 1 -- 172.21.15.146:0/3098430166 learned_addr learned my addr 172.21.15.146:0/3098430166 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:20:32.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.990+0000 7fb5e51f2700 1 --2- 172.21.15.146:0/3098430166 >> v2:172.21.15.151:3300/0 conn(0x7fb5e006bb90 0x7fb5e00ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:32.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.991+0000 7fb5df7fe700 1 -- 172.21.15.146:0/3098430166 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 692923896 0 0) 0x7fb5e015bcb0 con 0x7fb5e0151b30 2023-10-06T11:20:32.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.991+0000 7fb5df7fe700 1 -- 172.21.15.146:0/3098430166 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5d0003570 con 0x7fb5e0151b30 2023-10-06T11:20:32.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.991+0000 7fb5e51f2700 1 -- 172.21.15.146:0/3098430166 >> v1:172.21.15.151:6789/0 conn(0x7fb5e006b740 legacy=0x7fb5e00cc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:32.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.991+0000 7fb5e51f2700 1 -- 172.21.15.146:0/3098430166 >> v1:172.21.15.146:6789/0 conn(0x7fb5e0151b30 legacy=0x7fb5e00c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:32.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.991+0000 7fb5e51f2700 1 -- 172.21.15.146:0/3098430166 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e015b660 con 0x7fb5e006bb90 2023-10-06T11:20:32.999 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.991+0000 7fb5e51f2700 1 --2- 172.21.15.146:0/3098430166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5e006bb90 0x7fb5e00ccc20 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8009e60 tx=0x7fb5d8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3334e4cd5e6003ba server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:33.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.991+0000 7fb5df7fe700 1 -- 172.21.15.146:0/3098430166 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d800e070 con 0x7fb5e006bb90 2023-10-06T11:20:33.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.991+0000 7fb5df7fe700 1 -- 172.21.15.146:0/3098430166 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d800bb60 con 0x7fb5e006bb90 2023-10-06T11:20:33.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.991+0000 7fb5df7fe700 1 -- 172.21.15.146:0/3098430166 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d8012430 con 0x7fb5e006bb90 2023-10-06T11:20:33.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.992+0000 7fb5e6c55700 1 -- 172.21.15.146:0/3098430166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5e006bb90 msgr2=0x7fb5e00ccc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:33.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.992+0000 7fb5e6c55700 1 --2- 172.21.15.146:0/3098430166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5e006bb90 0x7fb5e00ccc20 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8009e60 tx=0x7fb5d8009780 comp rx=0 tx=0).stop 2023-10-06T11:20:33.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.992+0000 7fb5e6c55700 1 -- 172.21.15.146:0/3098430166 shutdown_connections 2023-10-06T11:20:33.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.992+0000 7fb5e6c55700 1 --2- 172.21.15.146:0/3098430166 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5e006bb90 0x7fb5e00ccc20 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:33.000 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.992+0000 7fb5e6c55700 1 -- 172.21.15.146:0/3098430166 >> 172.21.15.146:0/3098430166 conn(0x7fb5e00ce430 msgr2=0x7fb5e00ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:33.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.992+0000 7fb5e6c55700 1 -- 172.21.15.146:0/3098430166 shutdown_connections 2023-10-06T11:20:33.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.992+0000 7fb5e6c55700 1 -- 172.21.15.146:0/3098430166 wait complete. 2023-10-06T11:20:33.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.993+0000 7fb5e6c55700 1 Processor -- start 2023-10-06T11:20:33.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.993+0000 7fb5e6c55700 1 -- start start 2023-10-06T11:20:33.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.994+0000 7fb5e6c55700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5e006b740 0x7fb5e0145f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:33.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.994+0000 7fb5e6c55700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5e006bb90 0x7fb5e00c7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:33.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.994+0000 7fb5e6c55700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5e0151b30 0x7fb5e00c4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:33.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.994+0000 7fb5e6c55700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e0151500 con 0x7fb5e006bb90 2023-10-06T11:20:33.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.994+0000 7fb5e6c55700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e0146480 con 0x7fb5e006b740 2023-10-06T11:20:33.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.994+0000 7fb5e6c55700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e0156120 con 0x7fb5e0151b30 2023-10-06T11:20:33.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.994+0000 7fb5dffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5e006bb90 0x7fb5e00c7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:33.001 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.994+0000 7fb5dffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5e006bb90 0x7fb5e00c7f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58070/0 (socket says 172.21.15.146:58070) 2023-10-06T11:20:33.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.994+0000 7fb5dffff700 1 -- 172.21.15.146:0/3843040387 learned_addr learned my addr 172.21.15.146:0/3843040387 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:33.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.994+0000 7fb5e49f1700 1 --2- 172.21.15.146:0/3843040387 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5e006b740 0x7fb5e0145f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:33.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.994+0000 7fb5e51f2700 1 --2- 172.21.15.146:0/3843040387 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5e0151b30 0x7fb5e00c4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:33.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.994+0000 7fb5dffff700 1 -- 172.21.15.146:0/3843040387 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5e0151b30 msgr2=0x7fb5e00c4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:33.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.994+0000 7fb5dffff700 1 --2- 172.21.15.146:0/3843040387 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb5e0151b30 0x7fb5e00c4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:33.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.994+0000 7fb5dffff700 1 -- 172.21.15.146:0/3843040387 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5e006b740 msgr2=0x7fb5e0145f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:33.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.994+0000 7fb5dffff700 1 --2- 172.21.15.146:0/3843040387 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb5e006b740 0x7fb5e0145f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:33.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.994+0000 7fb5dffff700 1 -- 172.21.15.146:0/3843040387 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d8009a20 con 0x7fb5e006bb90 2023-10-06T11:20:33.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.994+0000 7fb5dffff700 1 --2- 172.21.15.146:0/3843040387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5e006bb90 0x7fb5e00c7f50 secure :-1 s=READY pgs=2405 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc00c590 tx=0x7fb5cc00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:33.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.994+0000 7fb5dcff9700 1 -- 172.21.15.146:0/3843040387 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc011590 con 0x7fb5e006bb90 2023-10-06T11:20:33.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.994+0000 7fb5dcff9700 1 -- 172.21.15.146:0/3843040387 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5cc011710 con 0x7fb5e006bb90 2023-10-06T11:20:33.002 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.994+0000 7fb5e6c55700 1 -- 172.21.15.146:0/3843040387 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5e0156400 con 0x7fb5e006bb90 2023-10-06T11:20:33.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.994+0000 7fb5dcff9700 1 -- 172.21.15.146:0/3843040387 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc011ad0 con 0x7fb5e006bb90 2023-10-06T11:20:33.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.994+0000 7fb5e6c55700 1 -- 172.21.15.146:0/3843040387 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5e01569c0 con 0x7fb5e006bb90 2023-10-06T11:20:33.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.995+0000 7fb5e6c55700 1 -- 172.21.15.146:0/3843040387 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb5e0156d00 con 0x7fb5e006bb90 2023-10-06T11:20:33.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.996+0000 7fb5dcff9700 1 -- 172.21.15.146:0/3843040387 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb5cc01b3b0 con 0x7fb5e006bb90 2023-10-06T11:20:33.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.996+0000 7fb5dcff9700 1 --2- 172.21.15.146:0/3843040387 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb5c4066f30 0x7fb5c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:33.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.996+0000 7fb5dcff9700 1 -- 172.21.15.146:0/3843040387 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5378+0+0 (secure 0 0 0) 0x7fb5cc083820 con 0x7fb5e006bb90 2023-10-06T11:20:33.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.996+0000 7fb5e49f1700 1 --2- 172.21.15.146:0/3843040387 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb5c4066f30 0x7fb5c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:33.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.996+0000 7fb5dcff9700 1 --2- 172.21.15.146:0/3843040387 >> [v2:172.21.15.146:6800/90681,v1:172.21.15.146:6801/90681] conn(0x7fb5c406d440 0x7fb5c406f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:33.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.996+0000 7fb5dcff9700 1 -- 172.21.15.146:0/3843040387 --> [v2:172.21.15.146:6800/90681,v1:172.21.15.146:6801/90681] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb5c406ff00 con 0x7fb5c406d440 2023-10-06T11:20:33.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.996+0000 7fb5dcff9700 1 -- 172.21.15.146:0/3843040387 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=183) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb5cc085e00 con 0x7fb5e006bb90 2023-10-06T11:20:33.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.997+0000 7fb5e51f2700 1 --2- 172.21.15.146:0/3843040387 >> [v2:172.21.15.146:6800/90681,v1:172.21.15.146:6801/90681] conn(0x7fb5c406d440 0x7fb5c406f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:33.003 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.997+0000 7fb5e49f1700 1 --2- 172.21.15.146:0/3843040387 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb5c4066f30 0x7fb5c40693e0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4007fd0 tx=0x7fb5d4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:33.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.997+0000 7fb5e51f2700 1 --2- 172.21.15.146:0/3843040387 >> [v2:172.21.15.146:6800/90681,v1:172.21.15.146:6801/90681] conn(0x7fb5c406d440 0x7fb5c406f850 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:33.004 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:32.997+0000 7fb5dcff9700 1 -- 172.21.15.146:0/3843040387 <== osd.1 v2:172.21.15.146:6800/90681 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fb5c406ff00 con 0x7fb5c406d440 2023-10-06T11:20:33.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.011+0000 7fb5e6c55700 1 -- 172.21.15.146:0/3843040387 --> [v2:172.21.15.146:6800/90681,v1:172.21.15.146:6801/90681] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb5e004c380 con 0x7fb5c406d440 2023-10-06T11:20:33.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.011+0000 7fb5dcff9700 1 -- 172.21.15.146:0/3843040387 <== osd.1 v2:172.21.15.146:6800/90681 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb5e004c380 con 0x7fb5c406d440 2023-10-06T11:20:33.012 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:20:33.013 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T11:20:33.013 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:20:33.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.012+0000 7fb5e6c55700 1 -- 172.21.15.146:0/3843040387 >> [v2:172.21.15.146:6800/90681,v1:172.21.15.146:6801/90681] conn(0x7fb5c406d440 msgr2=0x7fb5c406f850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:33.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.012+0000 7fb5e6c55700 1 --2- 172.21.15.146:0/3843040387 >> [v2:172.21.15.146:6800/90681,v1:172.21.15.146:6801/90681] conn(0x7fb5c406d440 0x7fb5c406f850 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:33.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.012+0000 7fb5e6c55700 1 -- 172.21.15.146:0/3843040387 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb5c4066f30 msgr2=0x7fb5c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:33.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.012+0000 7fb5e6c55700 1 --2- 172.21.15.146:0/3843040387 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb5c4066f30 0x7fb5c40693e0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4007fd0 tx=0x7fb5d4009040 comp rx=0 tx=0).stop 2023-10-06T11:20:33.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.012+0000 7fb5e6c55700 1 -- 172.21.15.146:0/3843040387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5e006bb90 msgr2=0x7fb5e00c7f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:33.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.012+0000 7fb5e6c55700 1 --2- 172.21.15.146:0/3843040387 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb5e006bb90 0x7fb5e00c7f50 secure :-1 s=READY pgs=2405 cs=0 l=1 rev1=1 crypto rx=0x7fb5cc00c590 tx=0x7fb5cc00c8a0 comp rx=0 tx=0).stop 2023-10-06T11:20:33.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.012+0000 7fb5e51f2700 1 -- 172.21.15.146:0/3843040387 reap_dead start 2023-10-06T11:20:33.014 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.012+0000 7fb5e6c55700 1 -- 172.21.15.146:0/3843040387 shutdown_connections 2023-10-06T11:20:33.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.012+0000 7fb5e6c55700 1 -- 172.21.15.146:0/3843040387 >> 172.21.15.146:0/3843040387 conn(0x7fb5e00ce430 msgr2=0x7fb5e00cb610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:33.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.012+0000 7fb5e6c55700 1 -- 172.21.15.146:0/3843040387 shutdown_connections 2023-10-06T11:20:33.015 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.012+0000 7fb5e6c55700 1 -- 172.21.15.146:0/3843040387 wait complete. 2023-10-06T11:20:33.025 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-06T11:20:33.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.139+0000 7f5ccc9a1700 1 Processor -- start 2023-10-06T11:20:33.140 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.139+0000 7f5ccc9a1700 1 -- start start 2023-10-06T11:20:33.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.140+0000 7f5ccc9a1700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5cc81538d0 0x7f5cc80cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:33.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.140+0000 7f5ccc9a1700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5cc8153ca0 0x7f5cc815d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:33.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.140+0000 7f5ccc9a1700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5cc815d5b0 0x7f5cc8159a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:33.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.140+0000 7f5ccc9a1700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cc815b9f0 con 0x7f5cc81538d0 2023-10-06T11:20:33.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.140+0000 7f5ccc9a1700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cc815d9e0 con 0x7f5cc8153ca0 2023-10-06T11:20:33.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.140+0000 7f5ccc9a1700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc815ade0 con 0x7f5cc815d5b0 2023-10-06T11:20:33.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.140+0000 7f5cc77fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5cc81538d0 0x7f5cc80cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:33.143 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.141+0000 7f5cc77fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f5cc81538d0 0x7f5cc80cd5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58082/0 (socket says 172.21.15.146:58082) 2023-10-06T11:20:33.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.141+0000 7f5cc77fe700 1 -- 172.21.15.146:0/4103588362 learned_addr learned my addr 172.21.15.146:0/4103588362 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:33.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.141+0000 7f5cc7fff700 1 --2- 172.21.15.146:0/4103588362 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5cc815d5b0 0x7f5cc8159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:33.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.141+0000 7f5cbeffd700 1 --2- 172.21.15.146:0/4103588362 >> v2:172.21.15.151:3300/0 conn(0x7f5cc8153ca0 0x7f5cc815d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:33.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.141+0000 7f5cc77fe700 1 -- 172.21.15.146:0/4103588362 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5cc815d5b0 msgr2=0x7f5cc8159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:33.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.141+0000 7f5cc77fe700 1 --2- 172.21.15.146:0/4103588362 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5cc815d5b0 0x7f5cc8159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:33.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.141+0000 7f5cc77fe700 1 -- 172.21.15.146:0/4103588362 >> v2:172.21.15.151:3300/0 conn(0x7f5cc8153ca0 msgr2=0x7f5cc815d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:33.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.141+0000 7f5cc77fe700 1 --2- 172.21.15.146:0/4103588362 >> v2:172.21.15.151:3300/0 conn(0x7f5cc8153ca0 0x7f5cc815d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:33.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.141+0000 7f5cc77fe700 1 -- 172.21.15.146:0/4103588362 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc815b0c0 con 0x7f5cc81538d0 2023-10-06T11:20:33.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.141+0000 7f5cc7fff700 1 --2- 172.21.15.146:0/4103588362 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5cc815d5b0 0x7f5cc8159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:20:33.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.141+0000 7f5cc77fe700 1 --2- 172.21.15.146:0/4103588362 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cc81538d0 0x7f5cc80cd5e0 secure :-1 s=READY pgs=2406 cs=0 l=1 rev1=1 crypto rx=0x7f5cc8067860 tx=0x7f5cb8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8190e2fb180a5e00 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:33.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.141+0000 7f5cc6ffd700 1 -- 172.21.15.146:0/4103588362 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb800b860 con 0x7f5cc81538d0 2023-10-06T11:20:33.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.141+0000 7f5cc6ffd700 1 -- 172.21.15.146:0/4103588362 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cb800b9c0 con 0x7f5cc81538d0 2023-10-06T11:20:33.144 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.141+0000 7f5cc6ffd700 1 -- 172.21.15.146:0/4103588362 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb800bd60 con 0x7f5cc81538d0 2023-10-06T11:20:33.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.141+0000 7f5ccc9a1700 1 -- 172.21.15.146:0/4103588362 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cc81538d0 msgr2=0x7f5cc80cd5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:33.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.142+0000 7f5ccc9a1700 1 --2- 172.21.15.146:0/4103588362 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cc81538d0 0x7f5cc80cd5e0 secure :-1 s=READY pgs=2406 cs=0 l=1 rev1=1 crypto rx=0x7f5cc8067860 tx=0x7f5cb8009250 comp rx=0 tx=0).stop 2023-10-06T11:20:33.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.142+0000 7f5ccc9a1700 1 -- 172.21.15.146:0/4103588362 shutdown_connections 2023-10-06T11:20:33.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.142+0000 7f5ccc9a1700 1 --2- 172.21.15.146:0/4103588362 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5cc815d5b0 0x7f5cc8159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:33.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.142+0000 7f5ccc9a1700 1 --2- 172.21.15.146:0/4103588362 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cc81538d0 0x7f5cc80cd5e0 unknown :-1 s=CLOSED pgs=2406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:33.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.142+0000 7f5ccc9a1700 1 --2- 172.21.15.146:0/4103588362 >> v2:172.21.15.151:3300/0 conn(0x7f5cc8153ca0 0x7f5cc815d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:33.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.142+0000 7f5ccc9a1700 1 -- 172.21.15.146:0/4103588362 >> 172.21.15.146:0/4103588362 conn(0x7f5cc806eb10 msgr2=0x7f5cc806ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:33.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.142+0000 7f5ccc9a1700 1 -- 172.21.15.146:0/4103588362 shutdown_connections 2023-10-06T11:20:33.145 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.142+0000 7f5ccc9a1700 1 -- 172.21.15.146:0/4103588362 wait complete. 2023-10-06T11:20:33.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.143+0000 7f5ccc9a1700 1 Processor -- start 2023-10-06T11:20:33.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.143+0000 7f5ccc9a1700 1 -- start start 2023-10-06T11:20:33.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.144+0000 7f5ccc9a1700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cc81538d0 0x7f5cc814ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:33.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.144+0000 7f5ccc9a1700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5cc8153ca0 0x7f5cc814a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:33.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.144+0000 7f5ccc9a1700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5cc815d5b0 0x7f5cc80b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:33.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.144+0000 7f5ccc9a1700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc80b32d0 con 0x7f5cc81538d0 2023-10-06T11:20:33.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.144+0000 7f5ccc9a1700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc814f390 con 0x7f5cc8153ca0 2023-10-06T11:20:33.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.144+0000 7f5ccc9a1700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc814f660 con 0x7f5cc815d5b0 2023-10-06T11:20:33.148 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.144+0000 7f5cc77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cc81538d0 0x7f5cc814ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:33.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.144+0000 7f5cc77fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cc81538d0 0x7f5cc814ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58090/0 (socket says 172.21.15.146:58090) 2023-10-06T11:20:33.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.144+0000 7f5cc77fe700 1 -- 172.21.15.146:0/2486748873 learned_addr learned my addr 172.21.15.146:0/2486748873 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:33.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.144+0000 7f5cc77fe700 1 -- 172.21.15.146:0/2486748873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5cc815d5b0 msgr2=0x7f5cc80b00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:33.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.144+0000 7f5cc77fe700 1 --2- 172.21.15.146:0/2486748873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5cc815d5b0 0x7f5cc80b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:33.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.144+0000 7f5cc77fe700 1 -- 172.21.15.146:0/2486748873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5cc8153ca0 msgr2=0x7f5cc814a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:33.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.144+0000 7f5cc77fe700 1 --2- 172.21.15.146:0/2486748873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5cc8153ca0 0x7f5cc814a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:33.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.144+0000 7f5cc77fe700 1 -- 172.21.15.146:0/2486748873 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb80094f0 con 0x7f5cc81538d0 2023-10-06T11:20:33.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.144+0000 7f5cc77fe700 1 --2- 172.21.15.146:0/2486748873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cc81538d0 0x7f5cc814ee50 secure :-1 s=READY pgs=2407 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8009290 tx=0x7f5cb8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:33.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.144+0000 7f5cbffff700 1 -- 172.21.15.146:0/2486748873 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb8026480 con 0x7f5cc81538d0 2023-10-06T11:20:33.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.144+0000 7f5cbffff700 1 -- 172.21.15.146:0/2486748873 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cb801f070 con 0x7f5cc81538d0 2023-10-06T11:20:33.149 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.144+0000 7f5cbffff700 1 -- 172.21.15.146:0/2486748873 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb8026830 con 0x7f5cc81538d0 2023-10-06T11:20:33.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.144+0000 7f5ccc9a1700 1 -- 172.21.15.146:0/2486748873 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cc814f940 con 0x7f5cc81538d0 2023-10-06T11:20:33.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.144+0000 7f5ccc9a1700 1 -- 172.21.15.146:0/2486748873 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cc814ff00 con 0x7f5cc81538d0 2023-10-06T11:20:33.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.145+0000 7f5ccc9a1700 1 -- 172.21.15.146:0/2486748873 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cc8088a10 con 0x7f5cc81538d0 2023-10-06T11:20:33.150 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.145+0000 7f5cbffff700 1 -- 172.21.15.146:0/2486748873 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5cb8026ba0 con 0x7f5cc81538d0 2023-10-06T11:20:33.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.146+0000 7f5cbffff700 1 --2- 172.21.15.146:0/2486748873 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5ca8066f60 0x7f5ca8069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:33.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.146+0000 7f5cbffff700 1 -- 172.21.15.146:0/2486748873 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f5cb8021070 con 0x7f5cc81538d0 2023-10-06T11:20:33.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.146+0000 7f5cbeffd700 1 --2- 172.21.15.146:0/2486748873 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5ca8066f60 0x7f5ca8069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:33.151 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.146+0000 7f5cbeffd700 1 --2- 172.21.15.146:0/2486748873 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5ca8066f60 0x7f5ca8069410 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f5cc81534f0 tx=0x7f5cb0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:33.152 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.150+0000 7f5cbffff700 1 -- 172.21.15.146:0/2486748873 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5cb80535d0 con 0x7f5cc81538d0 2023-10-06T11:20:33.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.335+0000 7f5ccc9a1700 1 -- 172.21.15.146:0/2486748873 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f5cc80b3410 con 0x7f5ca8066f60 2023-10-06T11:20:33.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.335+0000 7f5cbffff700 1 -- 172.21.15.146:0/2486748873 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5cb0009640 con 0x7f5ca8066f60 2023-10-06T11:20:33.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.337+0000 7f5ccc9a1700 1 -- 172.21.15.146:0/2486748873 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5ca8066f60 msgr2=0x7f5ca8069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:33.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.337+0000 7f5ccc9a1700 1 --2- 172.21.15.146:0/2486748873 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5ca8066f60 0x7f5ca8069410 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f5cc81534f0 tx=0x7f5cb0008040 comp rx=0 tx=0).stop 2023-10-06T11:20:33.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.337+0000 7f5ccc9a1700 1 -- 172.21.15.146:0/2486748873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cc81538d0 msgr2=0x7f5cc814ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:33.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.337+0000 7f5ccc9a1700 1 --2- 172.21.15.146:0/2486748873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cc81538d0 0x7f5cc814ee50 secure :-1 s=READY pgs=2407 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8009290 tx=0x7f5cb8017000 comp rx=0 tx=0).stop 2023-10-06T11:20:33.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.337+0000 7f5ccc9a1700 1 -- 172.21.15.146:0/2486748873 shutdown_connections 2023-10-06T11:20:33.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.337+0000 7f5ccc9a1700 1 --2- 172.21.15.146:0/2486748873 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f5ca8066f60 0x7f5ca8069410 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:33.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.337+0000 7f5ccc9a1700 1 --2- 172.21.15.146:0/2486748873 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5cc815d5b0 0x7f5cc80b00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:33.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.337+0000 7f5ccc9a1700 1 --2- 172.21.15.146:0/2486748873 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f5cc81538d0 0x7f5cc814ee50 unknown :-1 s=CLOSED pgs=2407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:33.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.337+0000 7f5ccc9a1700 1 --2- 172.21.15.146:0/2486748873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5cc8153ca0 0x7f5cc814a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:33.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.337+0000 7f5ccc9a1700 1 -- 172.21.15.146:0/2486748873 >> 172.21.15.146:0/2486748873 conn(0x7f5cc806eb10 msgr2=0x7f5cc8151c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:33.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.337+0000 7f5ccc9a1700 1 -- 172.21.15.146:0/2486748873 shutdown_connections 2023-10-06T11:20:33.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.337+0000 7f5ccc9a1700 1 -- 172.21.15.146:0/2486748873 wait complete. 2023-10-06T11:20:33.340 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 1 to deep-scrub 2023-10-06T11:20:33.350 INFO:tasks.ceph:Scrubbing osd.2 2023-10-06T11:20:33.350 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-06T11:20:33.469 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.468+0000 7f2b73e1d700 1 Processor -- start 2023-10-06T11:20:33.470 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.468+0000 7f2b73e1d700 1 -- start start 2023-10-06T11:20:33.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.469+0000 7f2b73e1d700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2b6c151b30 0x7f2b6c0c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:33.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.469+0000 7f2b73e1d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2b6c06be50 0x7f2b6c0cc510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:33.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.469+0000 7f2b73e1d700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b6c15bcb0 con 0x7f2b6c0c8fb0 2023-10-06T11:20:33.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.469+0000 7f2b73e1d700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b6c0c9530 con 0x7f2b6c06be50 2023-10-06T11:20:33.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.469+0000 7f2b73e1d700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b6c15c140 con 0x7f2b6c151b30 2023-10-06T11:20:33.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.469+0000 7f2b723ba700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2b6c06be50 0x7f2b6c0cc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:33.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.469+0000 7f2b713b8700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f2b6c0c8fb0 0x7f2b6c06b740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52186/0 (socket says 172.21.15.146:52186) 2023-10-06T11:20:33.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.469+0000 7f2b713b8700 1 -- 172.21.15.146:0/2435607181 learned_addr learned my addr 172.21.15.146:0/2435607181 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:20:33.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.470+0000 7f2b71bb9700 1 --2- 172.21.15.146:0/2435607181 >> v2:172.21.15.151:3300/0 conn(0x7f2b6c151b30 0x7f2b6c0c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:33.472 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.470+0000 7f2b723ba700 1 -- 172.21.15.146:0/2435607181 >> v2:172.21.15.151:3300/0 conn(0x7f2b6c151b30 msgr2=0x7f2b6c0c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:33.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.470+0000 7f2b723ba700 1 --2- 172.21.15.146:0/2435607181 >> v2:172.21.15.151:3300/0 conn(0x7f2b6c151b30 0x7f2b6c0c8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:33.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.470+0000 7f2b723ba700 1 -- 172.21.15.146:0/2435607181 >> v1:172.21.15.146:6789/0 conn(0x7f2b6c0c8fb0 legacy=0x7f2b6c06b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:33.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.470+0000 7f2b723ba700 1 -- 172.21.15.146:0/2435607181 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b6c15b380 con 0x7f2b6c06be50 2023-10-06T11:20:33.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.470+0000 7f2b71bb9700 1 --2- 172.21.15.146:0/2435607181 >> v2:172.21.15.151:3300/0 conn(0x7f2b6c151b30 0x7f2b6c0c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:20:33.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.470+0000 7f2b70bb7700 1 -- 172.21.15.146:0/2435607181 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1365062740 0 0) 0x7f2b6c15bcb0 con 0x7f2b6c0c8fb0 2023-10-06T11:20:33.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.470+0000 7f2b723ba700 1 --2- 172.21.15.146:0/2435607181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b6c06be50 0x7f2b6c0cc510 secure :-1 s=READY pgs=2409 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c0cae00 tx=0x7f2b640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdb5128e1ed96a8a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:33.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.470+0000 7f2b70bb7700 1 -- 172.21.15.146:0/2435607181 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b64009e80 con 0x7f2b6c06be50 2023-10-06T11:20:33.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.470+0000 7f2b70bb7700 1 -- 172.21.15.146:0/2435607181 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b6400b820 con 0x7f2b6c06be50 2023-10-06T11:20:33.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.470+0000 7f2b70bb7700 1 -- 172.21.15.146:0/2435607181 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6400bba0 con 0x7f2b6c06be50 2023-10-06T11:20:33.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.470+0000 7f2b73e1d700 1 -- 172.21.15.146:0/2435607181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b6c06be50 msgr2=0x7f2b6c0cc510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:33.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.470+0000 7f2b73e1d700 1 --2- 172.21.15.146:0/2435607181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b6c06be50 0x7f2b6c0cc510 secure :-1 s=READY pgs=2409 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c0cae00 tx=0x7f2b640091a0 comp rx=0 tx=0).stop 2023-10-06T11:20:33.473 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.471+0000 7f2b73e1d700 1 -- 172.21.15.146:0/2435607181 shutdown_connections 2023-10-06T11:20:33.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.471+0000 7f2b73e1d700 1 --2- 172.21.15.146:0/2435607181 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b6c06be50 0x7f2b6c0cc510 unknown :-1 s=CLOSED pgs=2409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:33.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.471+0000 7f2b73e1d700 1 --2- 172.21.15.146:0/2435607181 >> v2:172.21.15.151:3300/0 conn(0x7f2b6c151b30 0x7f2b6c0c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:33.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.471+0000 7f2b73e1d700 1 -- 172.21.15.146:0/2435607181 >> 172.21.15.146:0/2435607181 conn(0x7f2b6c0ce430 msgr2=0x7f2b6c0ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:33.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.471+0000 7f2b73e1d700 1 -- 172.21.15.146:0/2435607181 shutdown_connections 2023-10-06T11:20:33.474 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.471+0000 7f2b73e1d700 1 -- 172.21.15.146:0/2435607181 wait complete. 2023-10-06T11:20:33.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.472+0000 7f2b73e1d700 1 Processor -- start 2023-10-06T11:20:33.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.472+0000 7f2b73e1d700 1 -- start start 2023-10-06T11:20:33.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.472+0000 7f2b73e1d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2b6c06be50 0x7f2b6c151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:33.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.472+0000 7f2b73e1d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b6c0c8fb0 0x7f2b6c0696f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:33.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.472+0000 7f2b73e1d700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2b6c151b30 0x7f2b6c169b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:33.477 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.472+0000 7f2b73e1d700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c069260 con 0x7f2b6c0c8fb0 2023-10-06T11:20:33.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.472+0000 7f2b73e1d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c068690 con 0x7f2b6c06be50 2023-10-06T11:20:33.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.472+0000 7f2b73e1d700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6c068930 con 0x7f2b6c151b30 2023-10-06T11:20:33.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.473+0000 7f2b713b8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b6c0c8fb0 0x7f2b6c0696f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:33.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.473+0000 7f2b713b8700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b6c0c8fb0 0x7f2b6c0696f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58108/0 (socket says 172.21.15.146:58108) 2023-10-06T11:20:33.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.473+0000 7f2b713b8700 1 -- 172.21.15.146:0/3115578643 learned_addr learned my addr 172.21.15.146:0/3115578643 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:33.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.473+0000 7f2b71bb9700 1 --2- 172.21.15.146:0/3115578643 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2b6c06be50 0x7f2b6c151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:33.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.473+0000 7f2b723ba700 1 --2- 172.21.15.146:0/3115578643 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2b6c151b30 0x7f2b6c169b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:33.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.473+0000 7f2b713b8700 1 -- 172.21.15.146:0/3115578643 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2b6c151b30 msgr2=0x7f2b6c169b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:33.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.473+0000 7f2b713b8700 1 --2- 172.21.15.146:0/3115578643 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2b6c151b30 0x7f2b6c169b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:33.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.473+0000 7f2b713b8700 1 -- 172.21.15.146:0/3115578643 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2b6c06be50 msgr2=0x7f2b6c151100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:33.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.473+0000 7f2b713b8700 1 --2- 172.21.15.146:0/3115578643 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2b6c06be50 0x7f2b6c151100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:33.478 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.473+0000 7f2b713b8700 1 -- 172.21.15.146:0/3115578643 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b64009420 con 0x7f2b6c0c8fb0 2023-10-06T11:20:33.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.473+0000 7f2b713b8700 1 --2- 172.21.15.146:0/3115578643 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b6c0c8fb0 0x7f2b6c0696f0 secure :-1 s=READY pgs=2410 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c00c7e0 tx=0x7f2b5c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:33.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.473+0000 7f2b61ffb700 1 -- 172.21.15.146:0/3115578643 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c005b30 con 0x7f2b6c0c8fb0 2023-10-06T11:20:33.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.473+0000 7f2b61ffb700 1 -- 172.21.15.146:0/3115578643 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b5c005c90 con 0x7f2b6c0c8fb0 2023-10-06T11:20:33.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.473+0000 7f2b73e1d700 1 -- 172.21.15.146:0/3115578643 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b6c068c10 con 0x7f2b6c0c8fb0 2023-10-06T11:20:33.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.473+0000 7f2b61ffb700 1 -- 172.21.15.146:0/3115578643 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5c007300 con 0x7f2b6c0c8fb0 2023-10-06T11:20:33.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.473+0000 7f2b73e1d700 1 -- 172.21.15.146:0/3115578643 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b6c0c8660 con 0x7f2b6c0c8fb0 2023-10-06T11:20:33.479 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.474+0000 7f2b73e1d700 1 -- 172.21.15.146:0/3115578643 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2b6c04c380 con 0x7f2b6c0c8fb0 2023-10-06T11:20:33.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.475+0000 7f2b61ffb700 1 -- 172.21.15.146:0/3115578643 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2b5c025430 con 0x7f2b6c0c8fb0 2023-10-06T11:20:33.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.475+0000 7f2b61ffb700 1 --2- 172.21.15.146:0/3115578643 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2b50066f30 0x7f2b500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:33.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.475+0000 7f2b61ffb700 1 -- 172.21.15.146:0/3115578643 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f2b5c084980 con 0x7f2b6c0c8fb0 2023-10-06T11:20:33.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.475+0000 7f2b71bb9700 1 --2- 172.21.15.146:0/3115578643 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2b50066f30 0x7f2b500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:33.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.475+0000 7f2b61ffb700 1 --2- 172.21.15.146:0/3115578643 >> [v2:172.21.15.146:6816/90680,v1:172.21.15.146:6817/90680] conn(0x7f2b5006d440 0x7f2b5006f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:33.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.475+0000 7f2b61ffb700 1 -- 172.21.15.146:0/3115578643 --> [v2:172.21.15.146:6816/90680,v1:172.21.15.146:6817/90680] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2b5006ff00 con 0x7f2b5006d440 2023-10-06T11:20:33.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.475+0000 7f2b61ffb700 1 -- 172.21.15.146:0/3115578643 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=183) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b5c084d50 con 0x7f2b6c0c8fb0 2023-10-06T11:20:33.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.475+0000 7f2b723ba700 1 --2- 172.21.15.146:0/3115578643 >> [v2:172.21.15.146:6816/90680,v1:172.21.15.146:6817/90680] conn(0x7f2b5006d440 0x7f2b5006f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:33.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.476+0000 7f2b71bb9700 1 --2- 172.21.15.146:0/3115578643 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2b50066f30 0x7f2b500693e0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f2b680076a0 tx=0x7f2b680098f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:33.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.476+0000 7f2b723ba700 1 --2- 172.21.15.146:0/3115578643 >> [v2:172.21.15.146:6816/90680,v1:172.21.15.146:6817/90680] conn(0x7f2b5006d440 0x7f2b5006f850 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:33.480 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.476+0000 7f2b61ffb700 1 -- 172.21.15.146:0/3115578643 <== osd.2 v2:172.21.15.146:6816/90680 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f2b5006ff00 con 0x7f2b5006d440 2023-10-06T11:20:33.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.490+0000 7f2b73e1d700 1 -- 172.21.15.146:0/3115578643 --> [v2:172.21.15.146:6816/90680,v1:172.21.15.146:6817/90680] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2b6c15b660 con 0x7f2b5006d440 2023-10-06T11:20:33.491 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.490+0000 7f2b61ffb700 1 -- 172.21.15.146:0/3115578643 <== osd.2 v2:172.21.15.146:6816/90680 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f2b6c15b660 con 0x7f2b5006d440 2023-10-06T11:20:33.491 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:20:33.491 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T11:20:33.491 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:20:33.492 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.490+0000 7f2b73e1d700 1 -- 172.21.15.146:0/3115578643 >> [v2:172.21.15.146:6816/90680,v1:172.21.15.146:6817/90680] conn(0x7f2b5006d440 msgr2=0x7f2b5006f850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:33.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.490+0000 7f2b73e1d700 1 --2- 172.21.15.146:0/3115578643 >> [v2:172.21.15.146:6816/90680,v1:172.21.15.146:6817/90680] conn(0x7f2b5006d440 0x7f2b5006f850 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:33.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.491+0000 7f2b73e1d700 1 -- 172.21.15.146:0/3115578643 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2b50066f30 msgr2=0x7f2b500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:33.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.491+0000 7f2b73e1d700 1 --2- 172.21.15.146:0/3115578643 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2b50066f30 0x7f2b500693e0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f2b680076a0 tx=0x7f2b680098f0 comp rx=0 tx=0).stop 2023-10-06T11:20:33.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.491+0000 7f2b73e1d700 1 -- 172.21.15.146:0/3115578643 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b6c0c8fb0 msgr2=0x7f2b6c0696f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:33.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.491+0000 7f2b73e1d700 1 --2- 172.21.15.146:0/3115578643 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2b6c0c8fb0 0x7f2b6c0696f0 secure :-1 s=READY pgs=2410 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c00c7e0 tx=0x7f2b5c007df0 comp rx=0 tx=0).stop 2023-10-06T11:20:33.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.491+0000 7f2b723ba700 1 -- 172.21.15.146:0/3115578643 reap_dead start 2023-10-06T11:20:33.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.491+0000 7f2b73e1d700 1 -- 172.21.15.146:0/3115578643 shutdown_connections 2023-10-06T11:20:33.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.491+0000 7f2b73e1d700 1 -- 172.21.15.146:0/3115578643 >> 172.21.15.146:0/3115578643 conn(0x7f2b6c0ce430 msgr2=0x7f2b6c0c4500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:33.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.491+0000 7f2b73e1d700 1 -- 172.21.15.146:0/3115578643 shutdown_connections 2023-10-06T11:20:33.493 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.491+0000 7f2b73e1d700 1 -- 172.21.15.146:0/3115578643 wait complete. 2023-10-06T11:20:33.503 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-06T11:20:33.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.618+0000 7fb3f94fd700 1 Processor -- start 2023-10-06T11:20:33.619 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.618+0000 7fb3f94fd700 1 -- start start 2023-10-06T11:20:33.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.619+0000 7fb3f94fd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb3f40cf000 0x7fb3f40cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:33.621 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.619+0000 7fb3f94fd700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3f415ae80 con 0x7fb3f40cc020 2023-10-06T11:20:33.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.619+0000 7fb3f94fd700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3f4068670 con 0x7fb3f40ce520 2023-10-06T11:20:33.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.619+0000 7fb3f94fd700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f40cc9e0 con 0x7fb3f40cf000 2023-10-06T11:20:33.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.619+0000 7fb3f37fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7fb3f40cc020 0x7fb3f40ce8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52200/0 (socket says 172.21.15.146:52200) 2023-10-06T11:20:33.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.619+0000 7fb3f37fe700 1 -- 172.21.15.146:0/2713117503 learned_addr learned my addr 172.21.15.146:0/2713117503 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:20:33.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.619+0000 7fb3f8cfc700 1 --2- 172.21.15.146:0/2713117503 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb3f40cf000 0x7fb3f40cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:33.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.619+0000 7fb3f2ffd700 1 -- 172.21.15.146:0/2713117503 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1866829025 0 0) 0x7fb3f415ae80 con 0x7fb3f40cc020 2023-10-06T11:20:33.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.619+0000 7fb3f2ffd700 1 -- 172.21.15.146:0/2713117503 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3dc003570 con 0x7fb3f40cc020 2023-10-06T11:20:33.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.619+0000 7fb3f2ffd700 1 -- 172.21.15.146:0/2713117503 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3661583575 0 0) 0x7fb3f4068670 con 0x7fb3f40ce520 2023-10-06T11:20:33.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.619+0000 7fb3f2ffd700 1 -- 172.21.15.146:0/2713117503 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3f415ae80 con 0x7fb3f40ce520 2023-10-06T11:20:33.622 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.619+0000 7fb3f8cfc700 1 -- 172.21.15.146:0/2713117503 >> v1:172.21.15.151:6789/0 conn(0x7fb3f40ce520 legacy=0x7fb3f415a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:33.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.619+0000 7fb3f8cfc700 1 -- 172.21.15.146:0/2713117503 >> v1:172.21.15.146:6789/0 conn(0x7fb3f40cc020 legacy=0x7fb3f40ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:33.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.619+0000 7fb3f8cfc700 1 -- 172.21.15.146:0/2713117503 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f4068950 con 0x7fb3f40cf000 2023-10-06T11:20:33.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.620+0000 7fb3f8cfc700 1 --2- 172.21.15.146:0/2713117503 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb3f40cf000 0x7fb3f40cc4a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec009e90 tx=0x7fb3ec009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d79ff0f32c96b57 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:33.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.620+0000 7fb3f2ffd700 1 -- 172.21.15.146:0/2713117503 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec00e070 con 0x7fb3f40cf000 2023-10-06T11:20:33.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.620+0000 7fb3f2ffd700 1 -- 172.21.15.146:0/2713117503 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3ec00bb80 con 0x7fb3f40cf000 2023-10-06T11:20:33.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.620+0000 7fb3f2ffd700 1 -- 172.21.15.146:0/2713117503 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3ec012430 con 0x7fb3f40cf000 2023-10-06T11:20:33.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.620+0000 7fb3f94fd700 1 -- 172.21.15.146:0/2713117503 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb3f40cf000 msgr2=0x7fb3f40cc4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:33.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.620+0000 7fb3f94fd700 1 --2- 172.21.15.146:0/2713117503 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb3f40cf000 0x7fb3f40cc4a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec009e90 tx=0x7fb3ec009780 comp rx=0 tx=0).stop 2023-10-06T11:20:33.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.620+0000 7fb3f94fd700 1 -- 172.21.15.146:0/2713117503 shutdown_connections 2023-10-06T11:20:33.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.620+0000 7fb3f94fd700 1 --2- 172.21.15.146:0/2713117503 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb3f40cf000 0x7fb3f40cc4a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:33.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.620+0000 7fb3f94fd700 1 -- 172.21.15.146:0/2713117503 >> 172.21.15.146:0/2713117503 conn(0x7fb3f40703f0 msgr2=0x7fb3f40707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:33.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.620+0000 7fb3f94fd700 1 -- 172.21.15.146:0/2713117503 shutdown_connections 2023-10-06T11:20:33.623 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.620+0000 7fb3f94fd700 1 -- 172.21.15.146:0/2713117503 wait complete. 2023-10-06T11:20:33.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.621+0000 7fb3f94fd700 1 Processor -- start 2023-10-06T11:20:33.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.622+0000 7fb3f94fd700 1 -- start start 2023-10-06T11:20:33.626 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.622+0000 7fb3f94fd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb3f40cc020 0x7fb3f4157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:33.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.622+0000 7fb3f94fd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3f40ce520 0x7fb3f414fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:33.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.622+0000 7fb3f94fd700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb3f40cf000 0x7fb3f4156260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:33.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.622+0000 7fb3f94fd700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f4157830 con 0x7fb3f40ce520 2023-10-06T11:20:33.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.622+0000 7fb3f94fd700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f4156c20 con 0x7fb3f40cc020 2023-10-06T11:20:33.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.622+0000 7fb3f94fd700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3f4156f00 con 0x7fb3f40cf000 2023-10-06T11:20:33.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.622+0000 7fb3f37fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3f40ce520 0x7fb3f414fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:33.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.623+0000 7fb3f37fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3f40ce520 0x7fb3f414fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58114/0 (socket says 172.21.15.146:58114) 2023-10-06T11:20:33.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.623+0000 7fb3f37fe700 1 -- 172.21.15.146:0/1493876573 learned_addr learned my addr 172.21.15.146:0/1493876573 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:33.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.623+0000 7fb3f8cfc700 1 --2- 172.21.15.146:0/1493876573 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb3f40cf000 0x7fb3f4156260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:33.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.623+0000 7fb3f3fff700 1 --2- 172.21.15.146:0/1493876573 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb3f40cc020 0x7fb3f4157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:33.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.623+0000 7fb3f37fe700 1 -- 172.21.15.146:0/1493876573 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb3f40cf000 msgr2=0x7fb3f4156260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:33.627 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.623+0000 7fb3f37fe700 1 --2- 172.21.15.146:0/1493876573 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb3f40cf000 0x7fb3f4156260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:33.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.623+0000 7fb3f37fe700 1 -- 172.21.15.146:0/1493876573 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb3f40cc020 msgr2=0x7fb3f4157cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:33.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.623+0000 7fb3f37fe700 1 --2- 172.21.15.146:0/1493876573 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb3f40cc020 0x7fb3f4157cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:33.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.623+0000 7fb3f37fe700 1 -- 172.21.15.146:0/1493876573 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3ec009a20 con 0x7fb3f40ce520 2023-10-06T11:20:33.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.623+0000 7fb3f37fe700 1 --2- 172.21.15.146:0/1493876573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3f40ce520 0x7fb3f414fe70 secure :-1 s=READY pgs=2412 cs=0 l=1 rev1=1 crypto rx=0x7fb3e800c790 tx=0x7fb3e8007e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:33.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.623+0000 7fb3dbfff700 1 -- 172.21.15.146:0/1493876573 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e8005b30 con 0x7fb3f40ce520 2023-10-06T11:20:33.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.623+0000 7fb3dbfff700 1 -- 172.21.15.146:0/1493876573 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e8005cd0 con 0x7fb3f40ce520 2023-10-06T11:20:33.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.623+0000 7fb3f94fd700 1 -- 172.21.15.146:0/1493876573 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3f41571e0 con 0x7fb3f40ce520 2023-10-06T11:20:33.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.623+0000 7fb3dbfff700 1 -- 172.21.15.146:0/1493876573 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e8007320 con 0x7fb3f40ce520 2023-10-06T11:20:33.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.623+0000 7fb3f94fd700 1 -- 172.21.15.146:0/1493876573 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3f41503b0 con 0x7fb3f40ce520 2023-10-06T11:20:33.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.624+0000 7fb3f94fd700 1 -- 172.21.15.146:0/1493876573 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3f41579e0 con 0x7fb3f40ce520 2023-10-06T11:20:33.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.624+0000 7fb3dbfff700 1 -- 172.21.15.146:0/1493876573 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb3e8012400 con 0x7fb3f40ce520 2023-10-06T11:20:33.628 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.625+0000 7fb3dbfff700 1 --2- 172.21.15.146:0/1493876573 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb3e0066f30 0x7fb3e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:33.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.625+0000 7fb3dbfff700 1 -- 172.21.15.146:0/1493876573 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5378+0+0 (secure 0 0 0) 0x7fb3e8083830 con 0x7fb3f40ce520 2023-10-06T11:20:33.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.625+0000 7fb3f3fff700 1 --2- 172.21.15.146:0/1493876573 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb3e0066f30 0x7fb3e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:33.629 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.625+0000 7fb3f3fff700 1 --2- 172.21.15.146:0/1493876573 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb3e0066f30 0x7fb3e00693e0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fb3e4007fd0 tx=0x7fb3e4007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:33.630 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.629+0000 7fb3dbfff700 1 -- 172.21.15.146:0/1493876573 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb3f41579e0 con 0x7fb3f40ce520 2023-10-06T11:20:33.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.814+0000 7fb3f94fd700 1 -- 172.21.15.146:0/1493876573 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fb3f4157970 con 0x7fb3e0066f30 2023-10-06T11:20:33.815 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.814+0000 7fb3dbfff700 1 -- 172.21.15.146:0/1493876573 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb3f4157970 con 0x7fb3e0066f30 2023-10-06T11:20:33.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.816+0000 7fb3f94fd700 1 -- 172.21.15.146:0/1493876573 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb3e0066f30 msgr2=0x7fb3e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:33.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.816+0000 7fb3f94fd700 1 --2- 172.21.15.146:0/1493876573 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb3e0066f30 0x7fb3e00693e0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fb3e4007fd0 tx=0x7fb3e4007d50 comp rx=0 tx=0).stop 2023-10-06T11:20:33.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.816+0000 7fb3f94fd700 1 -- 172.21.15.146:0/1493876573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3f40ce520 msgr2=0x7fb3f414fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:33.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.816+0000 7fb3f94fd700 1 --2- 172.21.15.146:0/1493876573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3f40ce520 0x7fb3f414fe70 secure :-1 s=READY pgs=2412 cs=0 l=1 rev1=1 crypto rx=0x7fb3e800c790 tx=0x7fb3e8007e80 comp rx=0 tx=0).stop 2023-10-06T11:20:33.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.816+0000 7fb3f94fd700 1 -- 172.21.15.146:0/1493876573 shutdown_connections 2023-10-06T11:20:33.818 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.816+0000 7fb3f94fd700 1 --2- 172.21.15.146:0/1493876573 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fb3e0066f30 0x7fb3e00693e0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:33.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.816+0000 7fb3f94fd700 1 --2- 172.21.15.146:0/1493876573 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb3f40cf000 0x7fb3f4156260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:33.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.816+0000 7fb3f94fd700 1 --2- 172.21.15.146:0/1493876573 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb3f40cc020 0x7fb3f4157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:33.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.816+0000 7fb3f94fd700 1 --2- 172.21.15.146:0/1493876573 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fb3f40ce520 0x7fb3f414fe70 unknown :-1 s=CLOSED pgs=2412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:33.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.816+0000 7fb3f94fd700 1 -- 172.21.15.146:0/1493876573 >> 172.21.15.146:0/1493876573 conn(0x7fb3f40703f0 msgr2=0x7fb3f40707c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:33.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.816+0000 7fb3f94fd700 1 -- 172.21.15.146:0/1493876573 shutdown_connections 2023-10-06T11:20:33.819 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.816+0000 7fb3f94fd700 1 -- 172.21.15.146:0/1493876573 wait complete. 2023-10-06T11:20:33.819 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 2 to deep-scrub 2023-10-06T11:20:33.829 INFO:tasks.ceph:Scrubbing osd.3 2023-10-06T11:20:33.829 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-06T11:20:33.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.947+0000 7fe87d453700 1 Processor -- start 2023-10-06T11:20:33.948 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.947+0000 7fe87d453700 1 -- start start 2023-10-06T11:20:33.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.948+0000 7fe87d453700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe87806b740 0x7fe87806bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:33.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.948+0000 7fe87d453700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe8780cc510 0x7fe8780cc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:33.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.948+0000 7fe87d453700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe87815bcb0 con 0x7fe878151b30 2023-10-06T11:20:33.950 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.948+0000 7fe87d453700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8780c9530 con 0x7fe8780cc510 2023-10-06T11:20:33.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.948+0000 7fe87d453700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe87815c140 con 0x7fe87806b740 2023-10-06T11:20:33.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.949+0000 7fe86e7fc700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe87806b740 0x7fe87806bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:33.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.949+0000 7fe8777fe700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe8780cc510 0x7fe8780cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:33.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.949+0000 7fe876ffd700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fe878151b30 0x7fe8780c8a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:34858/0 (socket says 172.21.15.146:34858) 2023-10-06T11:20:33.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.949+0000 7fe876ffd700 1 -- 172.21.15.146:0/3772864561 learned_addr learned my addr 172.21.15.146:0/3772864561 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:20:33.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.949+0000 7fe8777fe700 1 -- 172.21.15.146:0/3772864561 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe87806b740 msgr2=0x7fe87806bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:33.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.949+0000 7fe8777fe700 1 --2- 172.21.15.146:0/3772864561 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe87806b740 0x7fe87806bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:33.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.949+0000 7fe8777fe700 1 -- 172.21.15.146:0/3772864561 >> v1:172.21.15.151:6789/0 conn(0x7fe878151b30 legacy=0x7fe8780c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:33.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.949+0000 7fe8777fe700 1 -- 172.21.15.146:0/3772864561 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe87806c0d0 con 0x7fe8780cc510 2023-10-06T11:20:33.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.949+0000 7fe8767fc700 1 -- 172.21.15.146:0/3772864561 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3999937024 0 0) 0x7fe87815bcb0 con 0x7fe878151b30 2023-10-06T11:20:33.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.949+0000 7fe8777fe700 1 --2- 172.21.15.146:0/3772864561 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8780cc510 0x7fe8780cc990 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fe870009e90 tx=0x7fe870009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3be08319b1fcf43c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:33.951 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.949+0000 7fe8767fc700 1 -- 172.21.15.146:0/3772864561 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87000e070 con 0x7fe8780cc510 2023-10-06T11:20:33.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.949+0000 7fe8767fc700 1 -- 172.21.15.146:0/3772864561 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe87000bbf0 con 0x7fe8780cc510 2023-10-06T11:20:33.952 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.949+0000 7fe8767fc700 1 -- 172.21.15.146:0/3772864561 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe870012430 con 0x7fe8780cc510 2023-10-06T11:20:33.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.950+0000 7fe87d453700 1 -- 172.21.15.146:0/3772864561 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8780cc510 msgr2=0x7fe8780cc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:33.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.950+0000 7fe87d453700 1 --2- 172.21.15.146:0/3772864561 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8780cc510 0x7fe8780cc990 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fe870009e90 tx=0x7fe870009780 comp rx=0 tx=0).stop 2023-10-06T11:20:33.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.950+0000 7fe87d453700 1 -- 172.21.15.146:0/3772864561 shutdown_connections 2023-10-06T11:20:33.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.950+0000 7fe87d453700 1 --2- 172.21.15.146:0/3772864561 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8780cc510 0x7fe8780cc990 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:33.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.950+0000 7fe87d453700 1 --2- 172.21.15.146:0/3772864561 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe87806b740 0x7fe87806bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:33.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.950+0000 7fe87d453700 1 -- 172.21.15.146:0/3772864561 >> 172.21.15.146:0/3772864561 conn(0x7fe8780ce430 msgr2=0x7fe8780ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:33.957 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.950+0000 7fe87d453700 1 -- 172.21.15.146:0/3772864561 shutdown_connections 2023-10-06T11:20:33.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.950+0000 7fe87d453700 1 -- 172.21.15.146:0/3772864561 wait complete. 2023-10-06T11:20:33.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.951+0000 7fe87d453700 1 Processor -- start 2023-10-06T11:20:33.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.951+0000 7fe87d453700 1 -- start start 2023-10-06T11:20:33.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.952+0000 7fe87d453700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe87806b740 0x7fe878150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:33.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.952+0000 7fe87d453700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8780cc510 0x7fe8780b3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:33.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.952+0000 7fe87d453700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe878151b30 0x7fe8780c7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:33.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.952+0000 7fe87d453700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8780b40c0 con 0x7fe8780cc510 2023-10-06T11:20:33.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.952+0000 7fe87d453700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8781540f0 con 0x7fe878151b30 2023-10-06T11:20:33.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.952+0000 7fe87d453700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe878154370 con 0x7fe87806b740 2023-10-06T11:20:33.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.952+0000 7fe86e7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8780cc510 0x7fe8780b3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:33.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.952+0000 7fe86e7fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8780cc510 0x7fe8780b3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58130/0 (socket says 172.21.15.146:58130) 2023-10-06T11:20:33.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.952+0000 7fe86e7fc700 1 -- 172.21.15.146:0/2031115002 learned_addr learned my addr 172.21.15.146:0/2031115002 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:33.958 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.952+0000 7fe876ffd700 1 --2- 172.21.15.146:0/2031115002 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe87806b740 0x7fe878150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:33.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.952+0000 7fe8777fe700 1 --2- 172.21.15.146:0/2031115002 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe878151b30 0x7fe8780c7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:33.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.953+0000 7fe86e7fc700 1 -- 172.21.15.146:0/2031115002 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe87806b740 msgr2=0x7fe878150e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:33.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.953+0000 7fe86e7fc700 1 --2- 172.21.15.146:0/2031115002 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe87806b740 0x7fe878150e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:33.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.953+0000 7fe86e7fc700 1 -- 172.21.15.146:0/2031115002 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe878151b30 msgr2=0x7fe8780c7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:33.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.953+0000 7fe86e7fc700 1 --2- 172.21.15.146:0/2031115002 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe878151b30 0x7fe8780c7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:33.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.953+0000 7fe86e7fc700 1 -- 172.21.15.146:0/2031115002 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe870009a20 con 0x7fe8780cc510 2023-10-06T11:20:33.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.953+0000 7fe86e7fc700 1 --2- 172.21.15.146:0/2031115002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8780cc510 0x7fe8780b3b80 secure :-1 s=READY pgs=2413 cs=0 l=1 rev1=1 crypto rx=0x7fe86000ec80 tx=0x7fe8600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:33.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.953+0000 7fe86f7fe700 1 -- 172.21.15.146:0/2031115002 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86000c850 con 0x7fe8780cc510 2023-10-06T11:20:33.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.953+0000 7fe86f7fe700 1 -- 172.21.15.146:0/2031115002 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe86000c9b0 con 0x7fe8780cc510 2023-10-06T11:20:33.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.953+0000 7fe87d453700 1 -- 172.21.15.146:0/2031115002 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe878154610 con 0x7fe8780cc510 2023-10-06T11:20:33.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.953+0000 7fe86f7fe700 1 -- 172.21.15.146:0/2031115002 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86000cd50 con 0x7fe8780cc510 2023-10-06T11:20:33.959 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.953+0000 7fe87d453700 1 -- 172.21.15.146:0/2031115002 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe878154bd0 con 0x7fe8780cc510 2023-10-06T11:20:33.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.954+0000 7fe87d453700 1 -- 172.21.15.146:0/2031115002 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe87804c380 con 0x7fe8780cc510 2023-10-06T11:20:33.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.954+0000 7fe86f7fe700 1 -- 172.21.15.146:0/2031115002 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe860013680 con 0x7fe8780cc510 2023-10-06T11:20:33.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.955+0000 7fe86f7fe700 1 --2- 172.21.15.146:0/2031115002 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe858066f30 0x7fe8580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:33.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.955+0000 7fe86f7fe700 1 -- 172.21.15.146:0/2031115002 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5378+0+0 (secure 0 0 0) 0x7fe860084e50 con 0x7fe8780cc510 2023-10-06T11:20:33.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.955+0000 7fe876ffd700 1 --2- 172.21.15.146:0/2031115002 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe858066f30 0x7fe8580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:33.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.955+0000 7fe86f7fe700 1 --2- 172.21.15.146:0/2031115002 >> [v2:172.21.15.146:6824/90682,v1:172.21.15.146:6825/90682] conn(0x7fe85806d440 0x7fe85806f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:33.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.955+0000 7fe86f7fe700 1 -- 172.21.15.146:0/2031115002 --> [v2:172.21.15.146:6824/90682,v1:172.21.15.146:6825/90682] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe85806ff00 con 0x7fe85806d440 2023-10-06T11:20:33.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.955+0000 7fe86f7fe700 1 -- 172.21.15.146:0/2031115002 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=183) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe860085220 con 0x7fe8780cc510 2023-10-06T11:20:33.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.955+0000 7fe8777fe700 1 --2- 172.21.15.146:0/2031115002 >> [v2:172.21.15.146:6824/90682,v1:172.21.15.146:6825/90682] conn(0x7fe85806d440 0x7fe85806f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:33.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.955+0000 7fe876ffd700 1 --2- 172.21.15.146:0/2031115002 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe858066f30 0x7fe8580693e0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fe868007160 tx=0x7fe868007f50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:33.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.955+0000 7fe8777fe700 1 --2- 172.21.15.146:0/2031115002 >> [v2:172.21.15.146:6824/90682,v1:172.21.15.146:6825/90682] conn(0x7fe85806d440 0x7fe85806f850 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:33.960 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.956+0000 7fe86f7fe700 1 -- 172.21.15.146:0/2031115002 <== osd.3 v2:172.21.15.146:6824/90682 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fe85806ff00 con 0x7fe85806d440 2023-10-06T11:20:33.970 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.970+0000 7fe87d453700 1 -- 172.21.15.146:0/2031115002 --> [v2:172.21.15.146:6824/90682,v1:172.21.15.146:6825/90682] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe878154f70 con 0x7fe85806d440 2023-10-06T11:20:33.971 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.970+0000 7fe86f7fe700 1 -- 172.21.15.146:0/2031115002 <== osd.3 v2:172.21.15.146:6824/90682 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fe878154f70 con 0x7fe85806d440 2023-10-06T11:20:33.971 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:20:33.971 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T11:20:33.971 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:20:33.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.970+0000 7fe87d453700 1 -- 172.21.15.146:0/2031115002 >> [v2:172.21.15.146:6824/90682,v1:172.21.15.146:6825/90682] conn(0x7fe85806d440 msgr2=0x7fe85806f850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:33.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.970+0000 7fe87d453700 1 --2- 172.21.15.146:0/2031115002 >> [v2:172.21.15.146:6824/90682,v1:172.21.15.146:6825/90682] conn(0x7fe85806d440 0x7fe85806f850 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:33.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.970+0000 7fe87d453700 1 -- 172.21.15.146:0/2031115002 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe858066f30 msgr2=0x7fe8580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:33.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.970+0000 7fe87d453700 1 --2- 172.21.15.146:0/2031115002 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fe858066f30 0x7fe8580693e0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fe868007160 tx=0x7fe868007f50 comp rx=0 tx=0).stop 2023-10-06T11:20:33.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.970+0000 7fe87d453700 1 -- 172.21.15.146:0/2031115002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8780cc510 msgr2=0x7fe8780b3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:33.972 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.970+0000 7fe87d453700 1 --2- 172.21.15.146:0/2031115002 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fe8780cc510 0x7fe8780b3b80 secure :-1 s=READY pgs=2413 cs=0 l=1 rev1=1 crypto rx=0x7fe86000ec80 tx=0x7fe8600091a0 comp rx=0 tx=0).stop 2023-10-06T11:20:33.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.970+0000 7fe8777fe700 1 -- 172.21.15.146:0/2031115002 reap_dead start 2023-10-06T11:20:33.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.970+0000 7fe87d453700 1 -- 172.21.15.146:0/2031115002 shutdown_connections 2023-10-06T11:20:33.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.970+0000 7fe87d453700 1 -- 172.21.15.146:0/2031115002 >> 172.21.15.146:0/2031115002 conn(0x7fe8780ce430 msgr2=0x7fe8781589d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:33.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.971+0000 7fe87d453700 1 -- 172.21.15.146:0/2031115002 shutdown_connections 2023-10-06T11:20:33.973 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:33.971+0000 7fe87d453700 1 -- 172.21.15.146:0/2031115002 wait complete. 2023-10-06T11:20:33.983 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-06T11:20:34.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.097+0000 7f572d8db700 1 Processor -- start 2023-10-06T11:20:34.098 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.097+0000 7f572d8db700 1 -- start start 2023-10-06T11:20:34.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.098+0000 7f572d8db700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57280af470 0x7f572815a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:34.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.098+0000 7f572d8db700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f57280d0a30 0x7f57281568f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:34.100 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.098+0000 7f572d8db700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f572815ac40 con 0x7f57280ccc30 2023-10-06T11:20:34.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.098+0000 7f572d8db700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57280cdcc0 con 0x7f57280d0a30 2023-10-06T11:20:34.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.098+0000 7f572d8db700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57280cd0b0 con 0x7f57280af470 2023-10-06T11:20:34.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.098+0000 7f572d0da700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f57280d0a30 0x7f57281568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:34.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.098+0000 7f572d0da700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f57280d0a30 0x7f57281568f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58132/0 (socket says 172.21.15.146:58132) 2023-10-06T11:20:34.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.098+0000 7f572d0da700 1 -- 172.21.15.146:0/914412617 learned_addr learned my addr 172.21.15.146:0/914412617 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:34.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.098+0000 7f572c8d9700 1 --2- 172.21.15.146:0/914412617 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57280af470 0x7f572815a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:34.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.098+0000 7f572d0da700 1 -- 172.21.15.146:0/914412617 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57280af470 msgr2=0x7f572815a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:34.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.098+0000 7f572d0da700 1 --2- 172.21.15.146:0/914412617 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57280af470 0x7f572815a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:34.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.098+0000 7f572d0da700 1 -- 172.21.15.146:0/914412617 >> v1:172.21.15.151:6789/0 conn(0x7f57280ccc30 legacy=0x7f57280d0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:34.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.098+0000 7f572d0da700 1 -- 172.21.15.146:0/914412617 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57280cd390 con 0x7f57280d0a30 2023-10-06T11:20:34.101 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.098+0000 7f572c8d9700 1 --2- 172.21.15.146:0/914412617 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57280af470 0x7f572815a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:20:34.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.099+0000 7f572d0da700 1 --2- 172.21.15.146:0/914412617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57280d0a30 0x7f57281568f0 secure :-1 s=READY pgs=2414 cs=0 l=1 rev1=1 crypto rx=0x7f5720009f20 tx=0x7f5720009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=285a6ab06ebbd536 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:34.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.099+0000 7f57277fe700 1 -- 172.21.15.146:0/914412617 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572000e070 con 0x7f57280d0a30 2023-10-06T11:20:34.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.099+0000 7f57277fe700 1 -- 172.21.15.146:0/914412617 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572000ba40 con 0x7f57280d0a30 2023-10-06T11:20:34.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.099+0000 7f57277fe700 1 -- 172.21.15.146:0/914412617 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57200092e0 con 0x7f57280d0a30 2023-10-06T11:20:34.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.099+0000 7f572d8db700 1 -- 172.21.15.146:0/914412617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57280d0a30 msgr2=0x7f57281568f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:34.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.099+0000 7f572d8db700 1 --2- 172.21.15.146:0/914412617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57280d0a30 0x7f57281568f0 secure :-1 s=READY pgs=2414 cs=0 l=1 rev1=1 crypto rx=0x7f5720009f20 tx=0x7f5720009840 comp rx=0 tx=0).stop 2023-10-06T11:20:34.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.099+0000 7f572d8db700 1 -- 172.21.15.146:0/914412617 shutdown_connections 2023-10-06T11:20:34.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.099+0000 7f572d8db700 1 --2- 172.21.15.146:0/914412617 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57280d0a30 0x7f57281568f0 unknown :-1 s=CLOSED pgs=2414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:34.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.099+0000 7f572d8db700 1 --2- 172.21.15.146:0/914412617 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57280af470 0x7f572815a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:34.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.099+0000 7f572d8db700 1 -- 172.21.15.146:0/914412617 >> 172.21.15.146:0/914412617 conn(0x7f572806eb10 msgr2=0x7f572806ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:34.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.099+0000 7f572d8db700 1 -- 172.21.15.146:0/914412617 shutdown_connections 2023-10-06T11:20:34.102 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.099+0000 7f572d8db700 1 -- 172.21.15.146:0/914412617 wait complete. 2023-10-06T11:20:34.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.100+0000 7f572d8db700 1 Processor -- start 2023-10-06T11:20:34.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.101+0000 7f572d8db700 1 -- start start 2023-10-06T11:20:34.105 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.101+0000 7f572d8db700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57280af470 0x7f5728156820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:34.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.101+0000 7f572d8db700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57280d0a30 0x7f57280ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:34.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.101+0000 7f572d8db700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57280b4ea0 0x7f57280cecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:34.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.101+0000 7f572d8db700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57280b4a10 con 0x7f57280d0a30 2023-10-06T11:20:34.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.101+0000 7f572d8db700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5728156d60 con 0x7f57280af470 2023-10-06T11:20:34.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.101+0000 7f572d8db700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57280b40e0 con 0x7f57280b4ea0 2023-10-06T11:20:34.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.101+0000 7f5727fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57280d0a30 0x7f57280ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:34.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.101+0000 7f5727fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57280d0a30 0x7f57280ce7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58138/0 (socket says 172.21.15.146:58138) 2023-10-06T11:20:34.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.101+0000 7f5727fff700 1 -- 172.21.15.146:0/3288732268 learned_addr learned my addr 172.21.15.146:0/3288732268 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:34.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.102+0000 7f572c8d9700 1 --2- 172.21.15.146:0/3288732268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57280af470 0x7f5728156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:34.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.102+0000 7f572d0da700 1 --2- 172.21.15.146:0/3288732268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57280b4ea0 0x7f57280cecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:34.106 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.102+0000 7f5727fff700 1 -- 172.21.15.146:0/3288732268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57280b4ea0 msgr2=0x7f57280cecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:34.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.102+0000 7f5727fff700 1 --2- 172.21.15.146:0/3288732268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57280b4ea0 0x7f57280cecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:34.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.102+0000 7f5727fff700 1 -- 172.21.15.146:0/3288732268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57280af470 msgr2=0x7f5728156820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:34.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.102+0000 7f5727fff700 1 --2- 172.21.15.146:0/3288732268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57280af470 0x7f5728156820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:34.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.102+0000 7f5727fff700 1 -- 172.21.15.146:0/3288732268 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5720009ae0 con 0x7f57280d0a30 2023-10-06T11:20:34.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.102+0000 7f572c8d9700 1 --2- 172.21.15.146:0/3288732268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57280af470 0x7f5728156820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:20:34.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.102+0000 7f572d0da700 1 --2- 172.21.15.146:0/3288732268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57280b4ea0 0x7f57280cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:20:34.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.102+0000 7f5727fff700 1 --2- 172.21.15.146:0/3288732268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57280d0a30 0x7f57280ce7b0 secure :-1 s=READY pgs=2415 cs=0 l=1 rev1=1 crypto rx=0x7f571400c5d0 tx=0x7f5714007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:34.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.102+0000 7f5724ff9700 1 -- 172.21.15.146:0/3288732268 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5714012630 con 0x7f57280d0a30 2023-10-06T11:20:34.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.102+0000 7f5724ff9700 1 -- 172.21.15.146:0/3288732268 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5714012790 con 0x7f57280d0a30 2023-10-06T11:20:34.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.102+0000 7f572d8db700 1 -- 172.21.15.146:0/3288732268 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57280b43c0 con 0x7f57280d0a30 2023-10-06T11:20:34.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.102+0000 7f5724ff9700 1 -- 172.21.15.146:0/3288732268 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5714012b50 con 0x7f57280d0a30 2023-10-06T11:20:34.107 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.102+0000 7f572d8db700 1 -- 172.21.15.146:0/3288732268 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57280b3d90 con 0x7f57280d0a30 2023-10-06T11:20:34.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.103+0000 7f572d8db700 1 -- 172.21.15.146:0/3288732268 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57280b4860 con 0x7f57280d0a30 2023-10-06T11:20:34.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.103+0000 7f5724ff9700 1 -- 172.21.15.146:0/3288732268 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f571401b400 con 0x7f57280d0a30 2023-10-06T11:20:34.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.104+0000 7f5724ff9700 1 --2- 172.21.15.146:0/3288732268 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f570c066f30 0x7f570c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:34.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.104+0000 7f5724ff9700 1 -- 172.21.15.146:0/3288732268 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f5714084360 con 0x7f57280d0a30 2023-10-06T11:20:34.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.104+0000 7f572c8d9700 1 --2- 172.21.15.146:0/3288732268 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f570c066f30 0x7f570c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:34.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.104+0000 7f572c8d9700 1 --2- 172.21.15.146:0/3288732268 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f570c066f30 0x7f570c0693e0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f571c008b20 tx=0x7f571c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:34.108 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.108+0000 7f5724ff9700 1 -- 172.21.15.146:0/3288732268 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f57140517c0 con 0x7f57280d0a30 2023-10-06T11:20:34.292 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.292+0000 7f572d8db700 1 -- 172.21.15.146:0/3288732268 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f57280b4b50 con 0x7f570c066f30 2023-10-06T11:20:34.293 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.292+0000 7f5724ff9700 1 -- 172.21.15.146:0/3288732268 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f57280b4b50 con 0x7f570c066f30 2023-10-06T11:20:34.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.294+0000 7f572d8db700 1 -- 172.21.15.146:0/3288732268 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f570c066f30 msgr2=0x7f570c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:34.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.294+0000 7f572d8db700 1 --2- 172.21.15.146:0/3288732268 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f570c066f30 0x7f570c0693e0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f571c008b20 tx=0x7f571c008040 comp rx=0 tx=0).stop 2023-10-06T11:20:34.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.294+0000 7f572d8db700 1 -- 172.21.15.146:0/3288732268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57280d0a30 msgr2=0x7f57280ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:34.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.294+0000 7f572d8db700 1 --2- 172.21.15.146:0/3288732268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57280d0a30 0x7f57280ce7b0 secure :-1 s=READY pgs=2415 cs=0 l=1 rev1=1 crypto rx=0x7f571400c5d0 tx=0x7f5714007f60 comp rx=0 tx=0).stop 2023-10-06T11:20:34.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.294+0000 7f572d8db700 1 -- 172.21.15.146:0/3288732268 shutdown_connections 2023-10-06T11:20:34.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.294+0000 7f572d8db700 1 --2- 172.21.15.146:0/3288732268 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f570c066f30 0x7f570c0693e0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:34.295 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.294+0000 7f572d8db700 1 --2- 172.21.15.146:0/3288732268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57280b4ea0 0x7f57280cecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:34.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.294+0000 7f572d8db700 1 --2- 172.21.15.146:0/3288732268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57280af470 0x7f5728156820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:34.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.294+0000 7f572d8db700 1 --2- 172.21.15.146:0/3288732268 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f57280d0a30 0x7f57280ce7b0 unknown :-1 s=CLOSED pgs=2415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:34.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.294+0000 7f572d8db700 1 -- 172.21.15.146:0/3288732268 >> 172.21.15.146:0/3288732268 conn(0x7f572806eb10 msgr2=0x7f57280c5e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:34.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.294+0000 7f572d8db700 1 -- 172.21.15.146:0/3288732268 shutdown_connections 2023-10-06T11:20:34.296 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.294+0000 7f572d8db700 1 -- 172.21.15.146:0/3288732268 wait complete. 2023-10-06T11:20:34.296 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 3 to deep-scrub 2023-10-06T11:20:34.307 INFO:tasks.ceph:Scrubbing osd.4 2023-10-06T11:20:34.307 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-06T11:20:34.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.426+0000 7fcd3ca32700 1 Processor -- start 2023-10-06T11:20:34.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.426+0000 7fcd3ca32700 1 -- start start 2023-10-06T11:20:34.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.427+0000 7fcd3ca32700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd38153c30 0x7fcd380b2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:34.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.427+0000 7fcd3ca32700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcd3806e320 0x7fcd380b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:34.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.427+0000 7fcd3ca32700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd3815ac20 con 0x7fcd38154000 2023-10-06T11:20:34.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.427+0000 7fcd3ca32700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd380b3200 con 0x7fcd3806e320 2023-10-06T11:20:34.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.427+0000 7fcd3ca32700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3815a050 con 0x7fcd38153c30 2023-10-06T11:20:34.430 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.428+0000 7fcd35d9b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcd3806e320 0x7fcd380b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:34.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.428+0000 7fcd3659c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd38153c30 0x7fcd380b2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:34.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.428+0000 7fcd35d9b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcd3806e320 0x7fcd380b2cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.146:57268/0 (socket says 172.21.15.146:57268) 2023-10-06T11:20:34.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.428+0000 7fcd35d9b700 1 -- 172.21.15.146:0/1331897618 learned_addr learned my addr 172.21.15.146:0/1331897618 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:34.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.428+0000 7fcd3659c700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd38153c30 0x7fcd380b2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.146:51278/0 (socket says 172.21.15.146:51278) 2023-10-06T11:20:34.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.428+0000 7fcd36d9d700 1 --1- 172.21.15.146:0/1331897618 >> v1:172.21.15.151:6789/0 conn(0x7fcd38154000 0x7fcd380b0890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.146:34864/0 (socket says 172.21.15.146:34864) 2023-10-06T11:20:34.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.428+0000 7fcd35d9b700 1 -- 172.21.15.146:0/1331897618 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd38153c30 msgr2=0x7fcd380b2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:34.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.428+0000 7fcd35d9b700 1 --2- 172.21.15.146:0/1331897618 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd38153c30 0x7fcd380b2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:34.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.428+0000 7fcd35d9b700 1 -- 172.21.15.146:0/1331897618 >> v1:172.21.15.151:6789/0 conn(0x7fcd38154000 legacy=0x7fcd380b0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:34.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.428+0000 7fcd35d9b700 1 -- 172.21.15.146:0/1331897618 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3815a2f0 con 0x7fcd3806e320 2023-10-06T11:20:34.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.428+0000 7fcd3659c700 1 --2- 172.21.15.146:0/1331897618 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd38153c30 0x7fcd380b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:20:34.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.428+0000 7fcd35d9b700 1 --2- 172.21.15.146:0/1331897618 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd3806e320 0x7fcd380b2cc0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c0099b0 tx=0x7fcd2c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5170577a07681fc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:34.431 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.428+0000 7fcd3559a700 1 -- 172.21.15.146:0/1331897618 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c009ea0 con 0x7fcd3806e320 2023-10-06T11:20:34.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.428+0000 7fcd3559a700 1 -- 172.21.15.146:0/1331897618 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd2c00b860 con 0x7fcd3806e320 2023-10-06T11:20:34.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.428+0000 7fcd3559a700 1 -- 172.21.15.146:0/1331897618 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c00bc00 con 0x7fcd3806e320 2023-10-06T11:20:34.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.429+0000 7fcd3ca32700 1 -- 172.21.15.146:0/1331897618 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd3806e320 msgr2=0x7fcd380b2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:34.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.429+0000 7fcd3ca32700 1 --2- 172.21.15.146:0/1331897618 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd3806e320 0x7fcd380b2cc0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c0099b0 tx=0x7fcd2c009250 comp rx=0 tx=0).stop 2023-10-06T11:20:34.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.429+0000 7fcd3ca32700 1 -- 172.21.15.146:0/1331897618 shutdown_connections 2023-10-06T11:20:34.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.429+0000 7fcd3ca32700 1 --2- 172.21.15.146:0/1331897618 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd38153c30 0x7fcd380b2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:34.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.429+0000 7fcd3ca32700 1 --2- 172.21.15.146:0/1331897618 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd3806e320 0x7fcd380b2cc0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:34.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.429+0000 7fcd3ca32700 1 -- 172.21.15.146:0/1331897618 >> 172.21.15.146:0/1331897618 conn(0x7fcd380cddc0 msgr2=0x7fcd380aece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:34.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.429+0000 7fcd3ca32700 1 -- 172.21.15.146:0/1331897618 shutdown_connections 2023-10-06T11:20:34.432 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.429+0000 7fcd3ca32700 1 -- 172.21.15.146:0/1331897618 wait complete. 2023-10-06T11:20:34.435 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.430+0000 7fcd3ca32700 1 Processor -- start 2023-10-06T11:20:34.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.430+0000 7fcd3ca32700 1 -- start start 2023-10-06T11:20:34.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.431+0000 7fcd3ca32700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd3806e320 0x7fcd381507c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:34.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.431+0000 7fcd3ca32700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd38153c30 0x7fcd38147ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:34.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.431+0000 7fcd3ca32700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd38154000 0x7fcd38157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:34.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.431+0000 7fcd3ca32700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd38158dc0 con 0x7fcd38154000 2023-10-06T11:20:34.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.431+0000 7fcd3ca32700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd38157f80 con 0x7fcd3806e320 2023-10-06T11:20:34.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.431+0000 7fcd3ca32700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd381581b0 con 0x7fcd38153c30 2023-10-06T11:20:34.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.431+0000 7fcd36d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd38154000 0x7fcd38157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:34.436 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.431+0000 7fcd36d9d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd38154000 0x7fcd38157a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58150/0 (socket says 172.21.15.146:58150) 2023-10-06T11:20:34.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.431+0000 7fcd36d9d700 1 -- 172.21.15.146:0/3200717083 learned_addr learned my addr 172.21.15.146:0/3200717083 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:34.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.431+0000 7fcd3659c700 1 --2- 172.21.15.146:0/3200717083 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd3806e320 0x7fcd381507c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:34.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.431+0000 7fcd35d9b700 1 --2- 172.21.15.146:0/3200717083 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd38153c30 0x7fcd38147ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:34.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.431+0000 7fcd36d9d700 1 -- 172.21.15.146:0/3200717083 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd38153c30 msgr2=0x7fcd38147ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:34.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.431+0000 7fcd36d9d700 1 --2- 172.21.15.146:0/3200717083 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd38153c30 0x7fcd38147ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:34.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.431+0000 7fcd36d9d700 1 -- 172.21.15.146:0/3200717083 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd3806e320 msgr2=0x7fcd381507c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:34.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.431+0000 7fcd36d9d700 1 --2- 172.21.15.146:0/3200717083 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd3806e320 0x7fcd381507c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:34.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.431+0000 7fcd36d9d700 1 -- 172.21.15.146:0/3200717083 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd28009420 con 0x7fcd38154000 2023-10-06T11:20:34.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.431+0000 7fcd3659c700 1 --2- 172.21.15.146:0/3200717083 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd3806e320 0x7fcd381507c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:20:34.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.431+0000 7fcd36d9d700 1 --2- 172.21.15.146:0/3200717083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd38154000 0x7fcd38157a40 secure :-1 s=READY pgs=2416 cs=0 l=1 rev1=1 crypto rx=0x7fcd3000cc70 tx=0x7fcd30001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:34.437 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.431+0000 7fcd267fc700 1 -- 172.21.15.146:0/3200717083 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd30005df0 con 0x7fcd38154000 2023-10-06T11:20:34.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.431+0000 7fcd267fc700 1 -- 172.21.15.146:0/3200717083 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd3000a660 con 0x7fcd38154000 2023-10-06T11:20:34.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.431+0000 7fcd3ca32700 1 -- 172.21.15.146:0/3200717083 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd2c0094f0 con 0x7fcd38154000 2023-10-06T11:20:34.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.432+0000 7fcd267fc700 1 -- 172.21.15.146:0/3200717083 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3000a9e0 con 0x7fcd38154000 2023-10-06T11:20:34.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.432+0000 7fcd3ca32700 1 -- 172.21.15.146:0/3200717083 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd38158770 con 0x7fcd38154000 2023-10-06T11:20:34.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.432+0000 7fcd3ca32700 1 -- 172.21.15.146:0/3200717083 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcd3804c380 con 0x7fcd38154000 2023-10-06T11:20:34.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.433+0000 7fcd267fc700 1 -- 172.21.15.146:0/3200717083 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcd300070f0 con 0x7fcd38154000 2023-10-06T11:20:34.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.433+0000 7fcd267fc700 1 --2- 172.21.15.146:0/3200717083 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcd18066f30 0x7fcd180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:34.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.433+0000 7fcd267fc700 1 -- 172.21.15.146:0/3200717083 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5378+0+0 (secure 0 0 0) 0x7fcd30084410 con 0x7fcd38154000 2023-10-06T11:20:34.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.433+0000 7fcd3659c700 1 --2- 172.21.15.146:0/3200717083 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcd18066f30 0x7fcd180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:34.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.433+0000 7fcd267fc700 1 --2- 172.21.15.146:0/3200717083 >> [v2:172.21.15.151:6816/90899,v1:172.21.15.151:6817/90899] conn(0x7fcd1806d440 0x7fcd1806f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:34.438 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.433+0000 7fcd267fc700 1 -- 172.21.15.146:0/3200717083 --> [v2:172.21.15.151:6816/90899,v1:172.21.15.151:6817/90899] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcd1806ff00 con 0x7fcd1806d440 2023-10-06T11:20:34.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.433+0000 7fcd267fc700 1 -- 172.21.15.146:0/3200717083 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=183) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd30086a50 con 0x7fcd38154000 2023-10-06T11:20:34.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.434+0000 7fcd35d9b700 1 --2- 172.21.15.146:0/3200717083 >> [v2:172.21.15.151:6816/90899,v1:172.21.15.151:6817/90899] conn(0x7fcd1806d440 0x7fcd1806f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:34.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.434+0000 7fcd3659c700 1 --2- 172.21.15.146:0/3200717083 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcd18066f30 0x7fcd180693e0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fcd280093f0 tx=0x7fcd28008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:34.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.434+0000 7fcd35d9b700 1 --2- 172.21.15.146:0/3200717083 >> [v2:172.21.15.151:6816/90899,v1:172.21.15.151:6817/90899] conn(0x7fcd1806d440 0x7fcd1806f850 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:34.439 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.435+0000 7fcd267fc700 1 -- 172.21.15.146:0/3200717083 <== osd.4 v2:172.21.15.151:6816/90899 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fcd1806ff00 con 0x7fcd1806d440 2023-10-06T11:20:34.449 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.449+0000 7fcd3ca32700 1 -- 172.21.15.146:0/3200717083 --> [v2:172.21.15.151:6816/90899,v1:172.21.15.151:6817/90899] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcd3815a5d0 con 0x7fcd1806d440 2023-10-06T11:20:34.450 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.449+0000 7fcd267fc700 1 -- 172.21.15.146:0/3200717083 <== osd.4 v2:172.21.15.151:6816/90899 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fcd3815a5d0 con 0x7fcd1806d440 2023-10-06T11:20:34.450 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:20:34.450 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T11:20:34.450 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:20:34.451 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.450+0000 7fcd3ca32700 1 -- 172.21.15.146:0/3200717083 >> [v2:172.21.15.151:6816/90899,v1:172.21.15.151:6817/90899] conn(0x7fcd1806d440 msgr2=0x7fcd1806f850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:34.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.450+0000 7fcd3ca32700 1 --2- 172.21.15.146:0/3200717083 >> [v2:172.21.15.151:6816/90899,v1:172.21.15.151:6817/90899] conn(0x7fcd1806d440 0x7fcd1806f850 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:34.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.450+0000 7fcd3ca32700 1 -- 172.21.15.146:0/3200717083 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcd18066f30 msgr2=0x7fcd180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:34.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.450+0000 7fcd3ca32700 1 --2- 172.21.15.146:0/3200717083 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fcd18066f30 0x7fcd180693e0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fcd280093f0 tx=0x7fcd28008040 comp rx=0 tx=0).stop 2023-10-06T11:20:34.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.450+0000 7fcd3ca32700 1 -- 172.21.15.146:0/3200717083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd38154000 msgr2=0x7fcd38157a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:34.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.450+0000 7fcd3ca32700 1 --2- 172.21.15.146:0/3200717083 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fcd38154000 0x7fcd38157a40 secure :-1 s=READY pgs=2416 cs=0 l=1 rev1=1 crypto rx=0x7fcd3000cc70 tx=0x7fcd30001a70 comp rx=0 tx=0).stop 2023-10-06T11:20:34.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.450+0000 7fcd36d9d700 1 -- 172.21.15.146:0/3200717083 reap_dead start 2023-10-06T11:20:34.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.450+0000 7fcd3ca32700 1 -- 172.21.15.146:0/3200717083 shutdown_connections 2023-10-06T11:20:34.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.450+0000 7fcd3ca32700 1 -- 172.21.15.146:0/3200717083 >> 172.21.15.146:0/3200717083 conn(0x7fcd380cddc0 msgr2=0x7fcd3815b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:34.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.450+0000 7fcd3ca32700 1 -- 172.21.15.146:0/3200717083 shutdown_connections 2023-10-06T11:20:34.452 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.450+0000 7fcd3ca32700 1 -- 172.21.15.146:0/3200717083 wait complete. 2023-10-06T11:20:34.462 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-06T11:20:34.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.577+0000 7ff92197e700 1 Processor -- start 2023-10-06T11:20:34.578 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.577+0000 7ff92197e700 1 -- start start 2023-10-06T11:20:34.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.578+0000 7ff92197e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff91c158140 0x7ff91c158510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:34.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.578+0000 7ff92197e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff91c069450 0x7ff91c0698c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:34.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.578+0000 7ff92197e700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff91c158a50 con 0x7ff91c06d210 2023-10-06T11:20:34.580 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.578+0000 7ff92197e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff91c069f10 con 0x7ff91c069450 2023-10-06T11:20:34.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.578+0000 7ff92197e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff91c06a1f0 con 0x7ff91c158140 2023-10-06T11:20:34.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.578+0000 7ff91a7fc700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff91c069450 0x7ff91c0698c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:34.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.578+0000 7ff91b7fe700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7ff91c06d210 0x7ff91c15b0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52204/0 (socket says 172.21.15.146:52204) 2023-10-06T11:20:34.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.578+0000 7ff91b7fe700 1 -- 172.21.15.146:0/2614768340 learned_addr learned my addr 172.21.15.146:0/2614768340 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:20:34.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.578+0000 7ff91affd700 1 --2- 172.21.15.146:0/2614768340 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff91c158140 0x7ff91c158510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:34.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.578+0000 7ff91a7fc700 1 -- 172.21.15.146:0/2614768340 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff91c158140 msgr2=0x7ff91c158510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:34.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.578+0000 7ff91a7fc700 1 --2- 172.21.15.146:0/2614768340 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff91c158140 0x7ff91c158510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:34.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.578+0000 7ff91a7fc700 1 -- 172.21.15.146:0/2614768340 >> v1:172.21.15.146:6789/0 conn(0x7ff91c06d210 legacy=0x7ff91c15b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:34.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.578+0000 7ff91a7fc700 1 -- 172.21.15.146:0/2614768340 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff91c06a4d0 con 0x7ff91c069450 2023-10-06T11:20:34.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.578+0000 7ff919ffb700 1 -- 172.21.15.146:0/2614768340 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4213224897 0 0) 0x7ff91c158a50 con 0x7ff91c06d210 2023-10-06T11:20:34.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.578+0000 7ff91a7fc700 1 --2- 172.21.15.146:0/2614768340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff91c069450 0x7ff91c0698c0 secure :-1 s=READY pgs=2418 cs=0 l=1 rev1=1 crypto rx=0x7ff9100098e0 tx=0x7ff9100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=204b8b5bfe26bf5f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:34.581 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.578+0000 7ff919ffb700 1 -- 172.21.15.146:0/2614768340 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91000b640 con 0x7ff91c069450 2023-10-06T11:20:34.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.578+0000 7ff919ffb700 1 -- 172.21.15.146:0/2614768340 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff91000b7a0 con 0x7ff91c069450 2023-10-06T11:20:34.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.578+0000 7ff919ffb700 1 -- 172.21.15.146:0/2614768340 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff91000bb40 con 0x7ff91c069450 2023-10-06T11:20:34.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.579+0000 7ff92197e700 1 -- 172.21.15.146:0/2614768340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff91c069450 msgr2=0x7ff91c0698c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:34.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.579+0000 7ff92197e700 1 --2- 172.21.15.146:0/2614768340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff91c069450 0x7ff91c0698c0 secure :-1 s=READY pgs=2418 cs=0 l=1 rev1=1 crypto rx=0x7ff9100098e0 tx=0x7ff9100091a0 comp rx=0 tx=0).stop 2023-10-06T11:20:34.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.579+0000 7ff92197e700 1 -- 172.21.15.146:0/2614768340 shutdown_connections 2023-10-06T11:20:34.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.579+0000 7ff92197e700 1 --2- 172.21.15.146:0/2614768340 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff91c158140 0x7ff91c158510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:34.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.579+0000 7ff92197e700 1 --2- 172.21.15.146:0/2614768340 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff91c069450 0x7ff91c0698c0 unknown :-1 s=CLOSED pgs=2418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:34.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.579+0000 7ff92197e700 1 -- 172.21.15.146:0/2614768340 >> 172.21.15.146:0/2614768340 conn(0x7ff91c0cc1c0 msgr2=0x7ff91c0cc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:34.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.579+0000 7ff92197e700 1 -- 172.21.15.146:0/2614768340 shutdown_connections 2023-10-06T11:20:34.582 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.579+0000 7ff92197e700 1 -- 172.21.15.146:0/2614768340 wait complete. 2023-10-06T11:20:34.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.580+0000 7ff92197e700 1 Processor -- start 2023-10-06T11:20:34.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.580+0000 7ff92197e700 1 -- start start 2023-10-06T11:20:34.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.581+0000 7ff92197e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff91c069450 0x7ff91c139ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:34.585 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.581+0000 7ff92197e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff91c06d210 0x7ff91c0ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:34.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.581+0000 7ff92197e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff91c158140 0x7ff91c15bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:34.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.581+0000 7ff92197e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff91c151730 con 0x7ff91c069450 2023-10-06T11:20:34.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.581+0000 7ff92197e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff91c150b20 con 0x7ff91c158140 2023-10-06T11:20:34.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.581+0000 7ff92197e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff91c150e00 con 0x7ff91c06d210 2023-10-06T11:20:34.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.581+0000 7ff91affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff91c069450 0x7ff91c139ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:34.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.581+0000 7ff91affd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff91c069450 0x7ff91c139ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58164/0 (socket says 172.21.15.146:58164) 2023-10-06T11:20:34.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.581+0000 7ff91affd700 1 -- 172.21.15.146:0/1453830025 learned_addr learned my addr 172.21.15.146:0/1453830025 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:34.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.581+0000 7ff91a7fc700 1 --2- 172.21.15.146:0/1453830025 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff91c06d210 0x7ff91c0ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:34.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.581+0000 7ff91b7fe700 1 --2- 172.21.15.146:0/1453830025 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff91c158140 0x7ff91c15bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:34.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.582+0000 7ff91affd700 1 -- 172.21.15.146:0/1453830025 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff91c06d210 msgr2=0x7ff91c0ca3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:34.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.582+0000 7ff91affd700 1 --2- 172.21.15.146:0/1453830025 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff91c06d210 0x7ff91c0ca3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:34.586 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.582+0000 7ff91affd700 1 -- 172.21.15.146:0/1453830025 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff91c158140 msgr2=0x7ff91c15bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:34.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.582+0000 7ff91affd700 1 --2- 172.21.15.146:0/1453830025 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff91c158140 0x7ff91c15bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:34.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.582+0000 7ff91affd700 1 -- 172.21.15.146:0/1453830025 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff910009420 con 0x7ff91c069450 2023-10-06T11:20:34.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.582+0000 7ff91b7fe700 1 --2- 172.21.15.146:0/1453830025 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff91c158140 0x7ff91c15bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:20:34.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.582+0000 7ff91affd700 1 --2- 172.21.15.146:0/1453830025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff91c069450 0x7ff91c139ad0 secure :-1 s=READY pgs=2419 cs=0 l=1 rev1=1 crypto rx=0x7ff91400e930 tx=0x7ff9140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:34.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.582+0000 7ff902ffd700 1 -- 172.21.15.146:0/1453830025 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff914013680 con 0x7ff91c069450 2023-10-06T11:20:34.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.582+0000 7ff902ffd700 1 -- 172.21.15.146:0/1453830025 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9140137e0 con 0x7ff91c069450 2023-10-06T11:20:34.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.582+0000 7ff92197e700 1 -- 172.21.15.146:0/1453830025 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff91c1510e0 con 0x7ff91c069450 2023-10-06T11:20:34.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.582+0000 7ff902ffd700 1 -- 172.21.15.146:0/1453830025 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff914013b80 con 0x7ff91c069450 2023-10-06T11:20:34.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.582+0000 7ff92197e700 1 -- 172.21.15.146:0/1453830025 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff91c13a010 con 0x7ff91c069450 2023-10-06T11:20:34.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.583+0000 7ff92197e700 1 -- 172.21.15.146:0/1453830025 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff91c151a10 con 0x7ff91c069450 2023-10-06T11:20:34.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.583+0000 7ff902ffd700 1 -- 172.21.15.146:0/1453830025 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff91400c460 con 0x7ff91c069450 2023-10-06T11:20:34.587 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.584+0000 7ff902ffd700 1 --2- 172.21.15.146:0/1453830025 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff908066fb0 0x7ff908069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:34.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.584+0000 7ff902ffd700 1 -- 172.21.15.146:0/1453830025 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5378+0+0 (secure 0 0 0) 0x7ff914084600 con 0x7ff91c069450 2023-10-06T11:20:34.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.584+0000 7ff91a7fc700 1 --2- 172.21.15.146:0/1453830025 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff908066fb0 0x7ff908069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:34.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.584+0000 7ff91a7fc700 1 --2- 172.21.15.146:0/1453830025 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff908066fb0 0x7ff908069460 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7ff9100093f0 tx=0x7ff910017000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:34.588 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.588+0000 7ff902ffd700 1 -- 172.21.15.146:0/1453830025 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff914051910 con 0x7ff91c069450 2023-10-06T11:20:34.772 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.772+0000 7ff92197e700 1 -- 172.21.15.146:0/1453830025 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7ff91c151870 con 0x7ff908066fb0 2023-10-06T11:20:34.773 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.772+0000 7ff902ffd700 1 -- 172.21.15.146:0/1453830025 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff910006c50 con 0x7ff908066fb0 2023-10-06T11:20:34.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.774+0000 7ff92197e700 1 -- 172.21.15.146:0/1453830025 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff908066fb0 msgr2=0x7ff908069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:34.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.774+0000 7ff92197e700 1 --2- 172.21.15.146:0/1453830025 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff908066fb0 0x7ff908069460 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7ff9100093f0 tx=0x7ff910017000 comp rx=0 tx=0).stop 2023-10-06T11:20:34.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.774+0000 7ff92197e700 1 -- 172.21.15.146:0/1453830025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff91c069450 msgr2=0x7ff91c139ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:34.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.774+0000 7ff92197e700 1 --2- 172.21.15.146:0/1453830025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff91c069450 0x7ff91c139ad0 secure :-1 s=READY pgs=2419 cs=0 l=1 rev1=1 crypto rx=0x7ff91400e930 tx=0x7ff9140091a0 comp rx=0 tx=0).stop 2023-10-06T11:20:34.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.774+0000 7ff92197e700 1 -- 172.21.15.146:0/1453830025 shutdown_connections 2023-10-06T11:20:34.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.774+0000 7ff92197e700 1 --2- 172.21.15.146:0/1453830025 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff908066fb0 0x7ff908069460 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:34.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.774+0000 7ff92197e700 1 --2- 172.21.15.146:0/1453830025 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff91c158140 0x7ff91c15bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:34.775 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.774+0000 7ff92197e700 1 --2- 172.21.15.146:0/1453830025 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff91c069450 0x7ff91c139ad0 unknown :-1 s=CLOSED pgs=2419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:34.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.774+0000 7ff92197e700 1 --2- 172.21.15.146:0/1453830025 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff91c06d210 0x7ff91c0ca3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:34.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.774+0000 7ff92197e700 1 -- 172.21.15.146:0/1453830025 >> 172.21.15.146:0/1453830025 conn(0x7ff91c0cc1c0 msgr2=0x7ff91c0af290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:34.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.774+0000 7ff92197e700 1 -- 172.21.15.146:0/1453830025 shutdown_connections 2023-10-06T11:20:34.776 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.774+0000 7ff92197e700 1 -- 172.21.15.146:0/1453830025 wait complete. 2023-10-06T11:20:34.776 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 4 to deep-scrub 2023-10-06T11:20:34.787 INFO:tasks.ceph:Scrubbing osd.5 2023-10-06T11:20:34.787 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-06T11:20:34.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.906+0000 7f2ae1c91700 1 Processor -- start 2023-10-06T11:20:34.907 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.906+0000 7f2ae1c91700 1 -- start start 2023-10-06T11:20:34.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.907+0000 7f2ae1c91700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2adc15d520 0x7f2adc0d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:34.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.907+0000 7f2ae1c91700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2adc15d8f0 0x7f2adc0cf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:34.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.907+0000 7f2ae1c91700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2adc0cf5d0 0x7f2adc1590d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:34.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.907+0000 7f2ae1c91700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2adc0d0770 con 0x7f2adc0cf5d0 2023-10-06T11:20:34.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.907+0000 7f2ae1c91700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2adc0cfb60 con 0x7f2adc15d520 2023-10-06T11:20:34.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.907+0000 7f2ae1c91700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc0cfe40 con 0x7f2adc15d8f0 2023-10-06T11:20:34.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.907+0000 7f2adbfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2adc0cf5d0 0x7f2adc1590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:34.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.907+0000 7f2adbfff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2adc0cf5d0 0x7f2adc1590d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58170/0 (socket says 172.21.15.146:58170) 2023-10-06T11:20:34.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.907+0000 7f2adbfff700 1 -- 172.21.15.146:0/3859963890 learned_addr learned my addr 172.21.15.146:0/3859963890 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:34.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.907+0000 7f2adb7fe700 1 --2- 172.21.15.146:0/3859963890 >> v2:172.21.15.151:3300/0 conn(0x7f2adc15d520 0x7f2adc0d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:34.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.907+0000 7f2adbfff700 1 -- 172.21.15.146:0/3859963890 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2adc15d8f0 msgr2=0x7f2adc0cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:34.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.907+0000 7f2ad2ffd700 1 --2- 172.21.15.146:0/3859963890 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2adc15d8f0 0x7f2adc0cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:34.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.907+0000 7f2adbfff700 1 --2- 172.21.15.146:0/3859963890 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2adc15d8f0 0x7f2adc0cf090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:34.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.907+0000 7f2adbfff700 1 -- 172.21.15.146:0/3859963890 >> v2:172.21.15.151:3300/0 conn(0x7f2adc15d520 msgr2=0x7f2adc0d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:34.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.907+0000 7f2adbfff700 1 --2- 172.21.15.146:0/3859963890 >> v2:172.21.15.151:3300/0 conn(0x7f2adc15d520 0x7f2adc0d0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:34.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.907+0000 7f2adbfff700 1 -- 172.21.15.146:0/3859963890 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2adc0d0120 con 0x7f2adc0cf5d0 2023-10-06T11:20:34.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.907+0000 7f2adb7fe700 1 --2- 172.21.15.146:0/3859963890 >> v2:172.21.15.151:3300/0 conn(0x7f2adc15d520 0x7f2adc0d0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:20:34.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.907+0000 7f2adbfff700 1 --2- 172.21.15.146:0/3859963890 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2adc0cf5d0 0x7f2adc1590d0 secure :-1 s=READY pgs=2420 cs=0 l=1 rev1=1 crypto rx=0x7f2adc069710 tx=0x7f2ad4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6319c937576cfccb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:34.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.907+0000 7f2adaffd700 1 -- 172.21.15.146:0/3859963890 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad400e070 con 0x7f2adc0cf5d0 2023-10-06T11:20:34.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.908+0000 7f2adaffd700 1 -- 172.21.15.146:0/3859963890 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad400ba50 con 0x7f2adc0cf5d0 2023-10-06T11:20:34.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.908+0000 7f2adaffd700 1 -- 172.21.15.146:0/3859963890 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad40092e0 con 0x7f2adc0cf5d0 2023-10-06T11:20:34.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.908+0000 7f2ae1c91700 1 -- 172.21.15.146:0/3859963890 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2adc0cf5d0 msgr2=0x7f2adc1590d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:34.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.908+0000 7f2ae1c91700 1 --2- 172.21.15.146:0/3859963890 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2adc0cf5d0 0x7f2adc1590d0 secure :-1 s=READY pgs=2420 cs=0 l=1 rev1=1 crypto rx=0x7f2adc069710 tx=0x7f2ad4009840 comp rx=0 tx=0).stop 2023-10-06T11:20:34.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.908+0000 7f2ae1c91700 1 -- 172.21.15.146:0/3859963890 shutdown_connections 2023-10-06T11:20:34.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.908+0000 7f2ae1c91700 1 --2- 172.21.15.146:0/3859963890 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2adc0cf5d0 0x7f2adc1590d0 unknown :-1 s=CLOSED pgs=2420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:34.911 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.908+0000 7f2ae1c91700 1 --2- 172.21.15.146:0/3859963890 >> v2:172.21.15.151:3300/0 conn(0x7f2adc15d520 0x7f2adc0d0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:34.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.908+0000 7f2ae1c91700 1 --2- 172.21.15.146:0/3859963890 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2adc15d8f0 0x7f2adc0cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:34.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.908+0000 7f2ae1c91700 1 -- 172.21.15.146:0/3859963890 >> 172.21.15.146:0/3859963890 conn(0x7f2adc06eb10 msgr2=0x7f2adc06ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:34.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.908+0000 7f2ae1c91700 1 -- 172.21.15.146:0/3859963890 shutdown_connections 2023-10-06T11:20:34.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.908+0000 7f2ae1c91700 1 -- 172.21.15.146:0/3859963890 wait complete. 2023-10-06T11:20:34.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.909+0000 7f2ae1c91700 1 Processor -- start 2023-10-06T11:20:34.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.909+0000 7f2ae1c91700 1 -- start start 2023-10-06T11:20:34.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.910+0000 7f2ae1c91700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2adc0cf5d0 0x7f2adc0b59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:34.915 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.910+0000 7f2ae1c91700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2adc15d520 0x7f2adc0b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:34.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.910+0000 7f2ae1c91700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2adc15d8f0 0x7f2adc169ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:34.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.910+0000 7f2ae1c91700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc0b4020 con 0x7f2adc15d8f0 2023-10-06T11:20:34.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.910+0000 7f2ae1c91700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc0b44b0 con 0x7f2adc0cf5d0 2023-10-06T11:20:34.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.910+0000 7f2ae1c91700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc0b3410 con 0x7f2adc15d520 2023-10-06T11:20:34.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.910+0000 7f2adbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2adc15d8f0 0x7f2adc169ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:34.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.910+0000 7f2adbfff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2adc15d8f0 0x7f2adc169ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58174/0 (socket says 172.21.15.146:58174) 2023-10-06T11:20:34.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.910+0000 7f2adbfff700 1 -- 172.21.15.146:0/3741394342 learned_addr learned my addr 172.21.15.146:0/3741394342 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:34.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.910+0000 7f2adb7fe700 1 --2- 172.21.15.146:0/3741394342 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2adc0cf5d0 0x7f2adc0b59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:34.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.910+0000 7f2ad2ffd700 1 --2- 172.21.15.146:0/3741394342 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2adc15d520 0x7f2adc0b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:34.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.910+0000 7f2adbfff700 1 -- 172.21.15.146:0/3741394342 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2adc15d520 msgr2=0x7f2adc0b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:34.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.910+0000 7f2adbfff700 1 --2- 172.21.15.146:0/3741394342 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2adc15d520 0x7f2adc0b5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:34.916 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.910+0000 7f2adbfff700 1 -- 172.21.15.146:0/3741394342 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2adc0cf5d0 msgr2=0x7f2adc0b59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:34.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.910+0000 7f2adbfff700 1 --2- 172.21.15.146:0/3741394342 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2adc0cf5d0 0x7f2adc0b59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:34.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.910+0000 7f2adbfff700 1 -- 172.21.15.146:0/3741394342 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad4009ae0 con 0x7f2adc15d8f0 2023-10-06T11:20:34.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.910+0000 7f2adb7fe700 1 --2- 172.21.15.146:0/3741394342 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2adc0cf5d0 0x7f2adc0b59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:20:34.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.911+0000 7f2adbfff700 1 --2- 172.21.15.146:0/3741394342 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2adc15d8f0 0x7f2adc169ea0 secure :-1 s=READY pgs=2421 cs=0 l=1 rev1=1 crypto rx=0x7f2adc0883a0 tx=0x7f2ad4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:34.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.911+0000 7f2ad3fff700 1 -- 172.21.15.146:0/3741394342 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad40032f0 con 0x7f2adc15d8f0 2023-10-06T11:20:34.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.911+0000 7f2ad3fff700 1 -- 172.21.15.146:0/3741394342 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad4008e80 con 0x7f2adc15d8f0 2023-10-06T11:20:34.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.911+0000 7f2ae1c91700 1 -- 172.21.15.146:0/3741394342 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2adc0b36f0 con 0x7f2adc15d8f0 2023-10-06T11:20:34.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.911+0000 7f2ad3fff700 1 -- 172.21.15.146:0/3741394342 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad4026690 con 0x7f2adc15d8f0 2023-10-06T11:20:34.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.911+0000 7f2ae1c91700 1 -- 172.21.15.146:0/3741394342 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2adc0b3cb0 con 0x7f2adc15d8f0 2023-10-06T11:20:34.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.912+0000 7f2ae1c91700 1 -- 172.21.15.146:0/3741394342 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2adc04c380 con 0x7f2adc15d8f0 2023-10-06T11:20:34.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.912+0000 7f2ad3fff700 1 -- 172.21.15.146:0/3741394342 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2ad4003040 con 0x7f2adc15d8f0 2023-10-06T11:20:34.917 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.912+0000 7f2ad3fff700 1 --2- 172.21.15.146:0/3741394342 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2abc066f30 0x7f2abc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:34.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.913+0000 7f2ad3fff700 1 -- 172.21.15.146:0/3741394342 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f2ad4086860 con 0x7f2adc15d8f0 2023-10-06T11:20:34.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.913+0000 7f2adb7fe700 1 --2- 172.21.15.146:0/3741394342 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2abc066f30 0x7f2abc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:34.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.913+0000 7f2ad3fff700 1 --2- 172.21.15.146:0/3741394342 >> [v2:172.21.15.151:6800/90889,v1:172.21.15.151:6801/90889] conn(0x7f2abc06d440 0x7f2abc06f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:34.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.913+0000 7f2ad3fff700 1 -- 172.21.15.146:0/3741394342 --> [v2:172.21.15.151:6800/90889,v1:172.21.15.151:6801/90889] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2abc06ff00 con 0x7f2abc06d440 2023-10-06T11:20:34.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.913+0000 7f2ad3fff700 1 -- 172.21.15.146:0/3741394342 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=183) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ad4086c30 con 0x7f2adc15d8f0 2023-10-06T11:20:34.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.913+0000 7f2ad2ffd700 1 --2- 172.21.15.146:0/3741394342 >> [v2:172.21.15.151:6800/90889,v1:172.21.15.151:6801/90889] conn(0x7f2abc06d440 0x7f2abc06f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:34.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.913+0000 7f2adb7fe700 1 --2- 172.21.15.146:0/3741394342 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2abc066f30 0x7f2abc0693e0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f2adc150cc0 tx=0x7f2acc006f90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:34.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.913+0000 7f2ad2ffd700 1 --2- 172.21.15.146:0/3741394342 >> [v2:172.21.15.151:6800/90889,v1:172.21.15.151:6801/90889] conn(0x7f2abc06d440 0x7f2abc06f850 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:34.918 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.914+0000 7f2ad3fff700 1 -- 172.21.15.146:0/3741394342 <== osd.5 v2:172.21.15.151:6800/90889 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f2abc06ff00 con 0x7f2abc06d440 2023-10-06T11:20:34.928 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.928+0000 7f2ae1c91700 1 -- 172.21.15.146:0/3741394342 --> [v2:172.21.15.151:6800/90889,v1:172.21.15.151:6801/90889] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2adc0d0400 con 0x7f2abc06d440 2023-10-06T11:20:34.929 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.928+0000 7f2ad3fff700 1 -- 172.21.15.146:0/3741394342 <== osd.5 v2:172.21.15.151:6800/90889 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f2adc0d0400 con 0x7f2abc06d440 2023-10-06T11:20:34.929 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:20:34.929 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T11:20:34.929 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:20:34.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.928+0000 7f2ae1c91700 1 -- 172.21.15.146:0/3741394342 >> [v2:172.21.15.151:6800/90889,v1:172.21.15.151:6801/90889] conn(0x7f2abc06d440 msgr2=0x7f2abc06f850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:34.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.928+0000 7f2ae1c91700 1 --2- 172.21.15.146:0/3741394342 >> [v2:172.21.15.151:6800/90889,v1:172.21.15.151:6801/90889] conn(0x7f2abc06d440 0x7f2abc06f850 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:34.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.928+0000 7f2ae1c91700 1 -- 172.21.15.146:0/3741394342 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2abc066f30 msgr2=0x7f2abc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:34.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.928+0000 7f2ae1c91700 1 --2- 172.21.15.146:0/3741394342 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2abc066f30 0x7f2abc0693e0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f2adc150cc0 tx=0x7f2acc006f90 comp rx=0 tx=0).stop 2023-10-06T11:20:34.930 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.928+0000 7f2ae1c91700 1 -- 172.21.15.146:0/3741394342 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2adc15d8f0 msgr2=0x7f2adc169ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:34.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.928+0000 7f2ae1c91700 1 --2- 172.21.15.146:0/3741394342 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2adc15d8f0 0x7f2adc169ea0 secure :-1 s=READY pgs=2421 cs=0 l=1 rev1=1 crypto rx=0x7f2adc0883a0 tx=0x7f2ad4018000 comp rx=0 tx=0).stop 2023-10-06T11:20:34.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.928+0000 7f2adbfff700 1 -- 172.21.15.146:0/3741394342 reap_dead start 2023-10-06T11:20:34.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.928+0000 7f2ae1c91700 1 -- 172.21.15.146:0/3741394342 shutdown_connections 2023-10-06T11:20:34.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.928+0000 7f2ae1c91700 1 -- 172.21.15.146:0/3741394342 >> 172.21.15.146:0/3741394342 conn(0x7f2adc06eb10 msgr2=0x7f2adc0b0230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:34.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.929+0000 7f2ae1c91700 1 -- 172.21.15.146:0/3741394342 shutdown_connections 2023-10-06T11:20:34.931 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:34.929+0000 7f2ae1c91700 1 -- 172.21.15.146:0/3741394342 wait complete. 2023-10-06T11:20:34.941 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-06T11:20:35.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.055+0000 7ff9056d9700 1 Processor -- start 2023-10-06T11:20:35.057 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.056+0000 7ff9056d9700 1 -- start start 2023-10-06T11:20:35.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.056+0000 7ff9056d9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff9000ad390 0x7ff9000cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:35.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.056+0000 7ff9056d9700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff9000ad760 0x7ff9000ccdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:35.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.056+0000 7ff9056d9700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff9000c90b0 0x7ff9000c9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:35.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.056+0000 7ff9056d9700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9000cb000 con 0x7ff9000ad390 2023-10-06T11:20:35.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.056+0000 7ff9056d9700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff900157970 con 0x7ff9000c90b0 2023-10-06T11:20:35.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.056+0000 7ff9056d9700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9000c9d70 con 0x7ff9000ad760 2023-10-06T11:20:35.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.057+0000 7ff8feffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff9000ad390 0x7ff9000cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:35.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.057+0000 7ff8feffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7ff9000ad390 0x7ff9000cc8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58188/0 (socket says 172.21.15.146:58188) 2023-10-06T11:20:35.060 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.057+0000 7ff8feffd700 1 -- 172.21.15.146:0/502447738 learned_addr learned my addr 172.21.15.146:0/502447738 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:35.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.057+0000 7ff8ff7fe700 1 --2- 172.21.15.146:0/502447738 >> v2:172.21.15.151:3300/0 conn(0x7ff9000c90b0 0x7ff9000c9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:35.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.057+0000 7ff8f67fc700 1 --2- 172.21.15.146:0/502447738 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff9000ad760 0x7ff9000ccdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:35.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.057+0000 7ff8feffd700 1 -- 172.21.15.146:0/502447738 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff9000ad760 msgr2=0x7ff9000ccdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:35.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.057+0000 7ff8feffd700 1 --2- 172.21.15.146:0/502447738 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff9000ad760 0x7ff9000ccdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:35.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.057+0000 7ff8feffd700 1 -- 172.21.15.146:0/502447738 >> v2:172.21.15.151:3300/0 conn(0x7ff9000c90b0 msgr2=0x7ff9000c9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:35.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.057+0000 7ff8feffd700 1 --2- 172.21.15.146:0/502447738 >> v2:172.21.15.151:3300/0 conn(0x7ff9000c90b0 0x7ff9000c9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:35.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.057+0000 7ff8feffd700 1 -- 172.21.15.146:0/502447738 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9000ca050 con 0x7ff9000ad390 2023-10-06T11:20:35.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.057+0000 7ff8ff7fe700 1 --2- 172.21.15.146:0/502447738 >> v2:172.21.15.151:3300/0 conn(0x7ff9000c90b0 0x7ff9000c9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:20:35.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.057+0000 7ff8feffd700 1 --2- 172.21.15.146:0/502447738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9000ad390 0x7ff9000cc8b0 secure :-1 s=READY pgs=2422 cs=0 l=1 rev1=1 crypto rx=0x7ff9000c8910 tx=0x7ff8f0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=101d591c2d156846 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:35.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.057+0000 7ff8fe7fc700 1 -- 172.21.15.146:0/502447738 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f0005c10 con 0x7ff9000ad390 2023-10-06T11:20:35.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.057+0000 7ff8fe7fc700 1 -- 172.21.15.146:0/502447738 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8f0005d70 con 0x7ff9000ad390 2023-10-06T11:20:35.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.057+0000 7ff8fe7fc700 1 -- 172.21.15.146:0/502447738 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f000b840 con 0x7ff9000ad390 2023-10-06T11:20:35.061 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.058+0000 7ff9056d9700 1 -- 172.21.15.146:0/502447738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9000ad390 msgr2=0x7ff9000cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:35.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.058+0000 7ff9056d9700 1 --2- 172.21.15.146:0/502447738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9000ad390 0x7ff9000cc8b0 secure :-1 s=READY pgs=2422 cs=0 l=1 rev1=1 crypto rx=0x7ff9000c8910 tx=0x7ff8f0009220 comp rx=0 tx=0).stop 2023-10-06T11:20:35.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.058+0000 7ff9056d9700 1 -- 172.21.15.146:0/502447738 shutdown_connections 2023-10-06T11:20:35.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.058+0000 7ff9056d9700 1 --2- 172.21.15.146:0/502447738 >> v2:172.21.15.151:3300/0 conn(0x7ff9000c90b0 0x7ff9000c9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:35.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.058+0000 7ff9056d9700 1 --2- 172.21.15.146:0/502447738 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9000ad390 0x7ff9000cc8b0 unknown :-1 s=CLOSED pgs=2422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:35.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.058+0000 7ff9056d9700 1 --2- 172.21.15.146:0/502447738 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff9000ad760 0x7ff9000ccdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:35.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.058+0000 7ff9056d9700 1 -- 172.21.15.146:0/502447738 >> 172.21.15.146:0/502447738 conn(0x7ff900087ff0 msgr2=0x7ff900067bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:35.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.058+0000 7ff9056d9700 1 -- 172.21.15.146:0/502447738 shutdown_connections 2023-10-06T11:20:35.062 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.058+0000 7ff9056d9700 1 -- 172.21.15.146:0/502447738 wait complete. 2023-10-06T11:20:35.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.059+0000 7ff9056d9700 1 Processor -- start 2023-10-06T11:20:35.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.059+0000 7ff9056d9700 1 -- start start 2023-10-06T11:20:35.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.060+0000 7ff9056d9700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff9000ad390 0x7ff9000b2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:35.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.060+0000 7ff9056d9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9000ad760 0x7ff9000b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:35.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.060+0000 7ff9056d9700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9000c90b0 0x7ff90015a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:35.065 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.060+0000 7ff9056d9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9000b23f0 con 0x7ff9000ad760 2023-10-06T11:20:35.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.060+0000 7ff9056d9700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9000ae600 con 0x7ff9000c90b0 2023-10-06T11:20:35.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.060+0000 7ff9056d9700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9000adcd0 con 0x7ff9000ad390 2023-10-06T11:20:35.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.060+0000 7ff8f67fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9000ad760 0x7ff9000b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:35.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.060+0000 7ff8f67fc700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9000ad760 0x7ff9000b1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58204/0 (socket says 172.21.15.146:58204) 2023-10-06T11:20:35.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.060+0000 7ff8f67fc700 1 -- 172.21.15.146:0/862434636 learned_addr learned my addr 172.21.15.146:0/862434636 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:35.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.060+0000 7ff8feffd700 1 --2- 172.21.15.146:0/862434636 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff9000ad390 0x7ff9000b2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:35.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.060+0000 7ff8ff7fe700 1 --2- 172.21.15.146:0/862434636 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9000c90b0 0x7ff90015a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:35.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.060+0000 7ff8f67fc700 1 -- 172.21.15.146:0/862434636 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff9000ad390 msgr2=0x7ff9000b2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:35.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.060+0000 7ff8f67fc700 1 --2- 172.21.15.146:0/862434636 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff9000ad390 0x7ff9000b2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:35.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.060+0000 7ff8f67fc700 1 -- 172.21.15.146:0/862434636 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9000c90b0 msgr2=0x7ff90015a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:35.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.060+0000 7ff8f67fc700 1 --2- 172.21.15.146:0/862434636 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9000c90b0 0x7ff90015a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:35.066 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.060+0000 7ff8f67fc700 1 -- 172.21.15.146:0/862434636 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f0009480 con 0x7ff9000ad760 2023-10-06T11:20:35.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.060+0000 7ff8f67fc700 1 --2- 172.21.15.146:0/862434636 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9000ad760 0x7ff9000b1a30 secure :-1 s=READY pgs=2423 cs=0 l=1 rev1=1 crypto rx=0x7ff8e800c7d0 tx=0x7ff8e8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:35.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.060+0000 7ff8f77fe700 1 -- 172.21.15.146:0/862434636 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e8011600 con 0x7ff9000ad760 2023-10-06T11:20:35.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.060+0000 7ff8f77fe700 1 -- 172.21.15.146:0/862434636 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e8011760 con 0x7ff9000ad760 2023-10-06T11:20:35.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.060+0000 7ff9056d9700 1 -- 172.21.15.146:0/862434636 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9000adfb0 con 0x7ff9000ad760 2023-10-06T11:20:35.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.060+0000 7ff8f77fe700 1 -- 172.21.15.146:0/862434636 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e8011b20 con 0x7ff9000ad760 2023-10-06T11:20:35.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.060+0000 7ff9056d9700 1 -- 172.21.15.146:0/862434636 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9000b34f0 con 0x7ff9000ad760 2023-10-06T11:20:35.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.061+0000 7ff9056d9700 1 -- 172.21.15.146:0/862434636 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff90006d880 con 0x7ff9000ad760 2023-10-06T11:20:35.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.062+0000 7ff8f77fe700 1 -- 172.21.15.146:0/862434636 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff8e80193f0 con 0x7ff9000ad760 2023-10-06T11:20:35.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.062+0000 7ff8f77fe700 1 --2- 172.21.15.146:0/862434636 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff8e0066f30 0x7ff8e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:35.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.062+0000 7ff8f77fe700 1 -- 172.21.15.146:0/862434636 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5378+0+0 (secure 0 0 0) 0x7ff8e8084750 con 0x7ff9000ad760 2023-10-06T11:20:35.067 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.062+0000 7ff8feffd700 1 --2- 172.21.15.146:0/862434636 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff8e0066f30 0x7ff8e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:35.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.063+0000 7ff8feffd700 1 --2- 172.21.15.146:0/862434636 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff8e0066f30 0x7ff8e00693e0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0009260 tx=0x7ff8f0016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:35.068 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.067+0000 7ff8f77fe700 1 -- 172.21.15.146:0/862434636 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff8e8051a60 con 0x7ff9000ad760 2023-10-06T11:20:35.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.248+0000 7ff9056d9700 1 -- 172.21.15.146:0/862434636 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9000ca330 con 0x7ff8e0066f30 2023-10-06T11:20:35.250 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.248+0000 7ff8f77fe700 1 -- 172.21.15.146:0/862434636 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff9000ca330 con 0x7ff8e0066f30 2023-10-06T11:20:35.252 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.250+0000 7ff9056d9700 1 -- 172.21.15.146:0/862434636 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff8e0066f30 msgr2=0x7ff8e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:35.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.250+0000 7ff9056d9700 1 --2- 172.21.15.146:0/862434636 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff8e0066f30 0x7ff8e00693e0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0009260 tx=0x7ff8f0016000 comp rx=0 tx=0).stop 2023-10-06T11:20:35.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.250+0000 7ff9056d9700 1 -- 172.21.15.146:0/862434636 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9000ad760 msgr2=0x7ff9000b1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:35.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.250+0000 7ff9056d9700 1 --2- 172.21.15.146:0/862434636 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9000ad760 0x7ff9000b1a30 secure :-1 s=READY pgs=2423 cs=0 l=1 rev1=1 crypto rx=0x7ff8e800c7d0 tx=0x7ff8e8008040 comp rx=0 tx=0).stop 2023-10-06T11:20:35.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.250+0000 7ff9056d9700 1 -- 172.21.15.146:0/862434636 shutdown_connections 2023-10-06T11:20:35.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.250+0000 7ff9056d9700 1 --2- 172.21.15.146:0/862434636 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7ff8e0066f30 0x7ff8e00693e0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:35.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.250+0000 7ff9056d9700 1 --2- 172.21.15.146:0/862434636 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9000c90b0 0x7ff90015a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:35.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.250+0000 7ff9056d9700 1 --2- 172.21.15.146:0/862434636 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff9000ad390 0x7ff9000b2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:35.253 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.250+0000 7ff9056d9700 1 --2- 172.21.15.146:0/862434636 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7ff9000ad760 0x7ff9000b1a30 unknown :-1 s=CLOSED pgs=2423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:35.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.251+0000 7ff9056d9700 1 -- 172.21.15.146:0/862434636 >> 172.21.15.146:0/862434636 conn(0x7ff900087ff0 msgr2=0x7ff900156ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:35.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.251+0000 7ff9056d9700 1 -- 172.21.15.146:0/862434636 shutdown_connections 2023-10-06T11:20:35.254 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.251+0000 7ff9056d9700 1 -- 172.21.15.146:0/862434636 wait complete. 2023-10-06T11:20:35.254 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 5 to deep-scrub 2023-10-06T11:20:35.264 INFO:tasks.ceph:Scrubbing osd.6 2023-10-06T11:20:35.265 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-06T11:20:35.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.382+0000 7f40e4ad0700 1 Processor -- start 2023-10-06T11:20:35.384 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.382+0000 7f40e4ad0700 1 -- start start 2023-10-06T11:20:35.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.383+0000 7f40e4ad0700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f40e00aeb90 0x7f40e0159a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:35.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.383+0000 7f40e4ad0700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f40e00afbb0 0x7f40e00b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:35.386 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.383+0000 7f40e4ad0700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40e006a1c0 con 0x7f40e0159630 2023-10-06T11:20:35.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.383+0000 7f40e4ad0700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e00693d0 con 0x7f40e00aeb90 2023-10-06T11:20:35.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.383+0000 7f40e4ad0700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e00695b0 con 0x7f40e00afbb0 2023-10-06T11:20:35.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.383+0000 7f40deffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f40e00aeb90 0x7f40e0159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:35.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.383+0000 7f40deffd700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f40e00aeb90 0x7f40e0159a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58214/0 (socket says 172.21.15.146:58214) 2023-10-06T11:20:35.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.383+0000 7f40deffd700 1 -- 172.21.15.146:0/814486265 learned_addr learned my addr 172.21.15.146:0/814486265 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:35.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.383+0000 7f40dffff700 1 --2- 172.21.15.146:0/814486265 >> v2:172.21.15.151:3300/0 conn(0x7f40e00afbb0 0x7f40e00b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:35.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.383+0000 7f40deffd700 1 -- 172.21.15.146:0/814486265 >> v2:172.21.15.151:3300/0 conn(0x7f40e00afbb0 msgr2=0x7f40e00b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:35.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.383+0000 7f40deffd700 1 --2- 172.21.15.146:0/814486265 >> v2:172.21.15.151:3300/0 conn(0x7f40e00afbb0 0x7f40e00b19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:35.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.383+0000 7f40deffd700 1 -- 172.21.15.146:0/814486265 >> v1:172.21.15.151:6789/0 conn(0x7f40e0159630 legacy=0x7f40e00af4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:35.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.383+0000 7f40deffd700 1 -- 172.21.15.146:0/814486265 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e0069890 con 0x7f40e00aeb90 2023-10-06T11:20:35.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.384+0000 7f40deffd700 1 --2- 172.21.15.146:0/814486265 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40e00aeb90 0x7f40e0159a00 secure :-1 s=READY pgs=2424 cs=0 l=1 rev1=1 crypto rx=0x7f40e006aaa0 tx=0x7f40d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f912342e501e996 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:35.387 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.384+0000 7f40de7fc700 1 -- 172.21.15.146:0/814486265 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d400b820 con 0x7f40e00aeb90 2023-10-06T11:20:35.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.384+0000 7f40de7fc700 1 -- 172.21.15.146:0/814486265 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d400b980 con 0x7f40e00aeb90 2023-10-06T11:20:35.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.384+0000 7f40de7fc700 1 -- 172.21.15.146:0/814486265 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d400bd20 con 0x7f40e00aeb90 2023-10-06T11:20:35.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.384+0000 7f40e4ad0700 1 -- 172.21.15.146:0/814486265 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40e00aeb90 msgr2=0x7f40e0159a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:35.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.384+0000 7f40e4ad0700 1 --2- 172.21.15.146:0/814486265 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40e00aeb90 0x7f40e0159a00 secure :-1 s=READY pgs=2424 cs=0 l=1 rev1=1 crypto rx=0x7f40e006aaa0 tx=0x7f40d4009250 comp rx=0 tx=0).stop 2023-10-06T11:20:35.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.384+0000 7f40e4ad0700 1 -- 172.21.15.146:0/814486265 shutdown_connections 2023-10-06T11:20:35.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.384+0000 7f40e4ad0700 1 --2- 172.21.15.146:0/814486265 >> v2:172.21.15.151:3300/0 conn(0x7f40e00afbb0 0x7f40e00b19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:35.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.384+0000 7f40e4ad0700 1 --2- 172.21.15.146:0/814486265 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40e00aeb90 0x7f40e0159a00 unknown :-1 s=CLOSED pgs=2424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:35.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.384+0000 7f40e4ad0700 1 -- 172.21.15.146:0/814486265 >> 172.21.15.146:0/814486265 conn(0x7f40e00974e0 msgr2=0x7f40e0067bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:35.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.384+0000 7f40e4ad0700 1 -- 172.21.15.146:0/814486265 shutdown_connections 2023-10-06T11:20:35.388 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.384+0000 7f40e4ad0700 1 -- 172.21.15.146:0/814486265 wait complete. 2023-10-06T11:20:35.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.385+0000 7f40e4ad0700 1 Processor -- start 2023-10-06T11:20:35.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.386+0000 7f40e4ad0700 1 -- start start 2023-10-06T11:20:35.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.386+0000 7f40e4ad0700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40e00aeb90 0x7f40e0152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:35.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.386+0000 7f40e4ad0700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40e00afbb0 0x7f40e014fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:35.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.386+0000 7f40e4ad0700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f40e0159630 0x7f40e015ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:35.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.386+0000 7f40e4ad0700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e00ca370 con 0x7f40e00aeb90 2023-10-06T11:20:35.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.386+0000 7f40e4ad0700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e00caef0 con 0x7f40e00afbb0 2023-10-06T11:20:35.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.386+0000 7f40e4ad0700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e0153500 con 0x7f40e0159630 2023-10-06T11:20:35.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.386+0000 7f40df7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40e00aeb90 0x7f40e0152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:35.392 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.386+0000 7f40df7fe700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40e00aeb90 0x7f40e0152fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58230/0 (socket says 172.21.15.146:58230) 2023-10-06T11:20:35.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.386+0000 7f40df7fe700 1 -- 172.21.15.146:0/284973222 learned_addr learned my addr 172.21.15.146:0/284973222 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:35.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.386+0000 7f40deffd700 1 --2- 172.21.15.146:0/284973222 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40e00afbb0 0x7f40e014fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:35.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.386+0000 7f40dffff700 1 --2- 172.21.15.146:0/284973222 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f40e0159630 0x7f40e015ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:35.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.387+0000 7f40df7fe700 1 -- 172.21.15.146:0/284973222 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f40e0159630 msgr2=0x7f40e015ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:35.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.387+0000 7f40df7fe700 1 --2- 172.21.15.146:0/284973222 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f40e0159630 0x7f40e015ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:35.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.387+0000 7f40df7fe700 1 -- 172.21.15.146:0/284973222 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40e00afbb0 msgr2=0x7f40e014fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:35.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.387+0000 7f40df7fe700 1 --2- 172.21.15.146:0/284973222 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40e00afbb0 0x7f40e014fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:35.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.387+0000 7f40df7fe700 1 -- 172.21.15.146:0/284973222 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d40094f0 con 0x7f40e00aeb90 2023-10-06T11:20:35.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.387+0000 7f40df7fe700 1 --2- 172.21.15.146:0/284973222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40e00aeb90 0x7f40e0152fc0 secure :-1 s=READY pgs=2425 cs=0 l=1 rev1=1 crypto rx=0x7f40d000b610 tx=0x7f40d00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:35.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.387+0000 7f40c77fe700 1 -- 172.21.15.146:0/284973222 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d000f510 con 0x7f40e00aeb90 2023-10-06T11:20:35.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.387+0000 7f40c77fe700 1 -- 172.21.15.146:0/284973222 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d000f670 con 0x7f40e00aeb90 2023-10-06T11:20:35.393 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.387+0000 7f40e4ad0700 1 -- 172.21.15.146:0/284973222 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40e00ca5c0 con 0x7f40e00aeb90 2023-10-06T11:20:35.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.387+0000 7f40c77fe700 1 -- 172.21.15.146:0/284973222 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d000fa30 con 0x7f40e00aeb90 2023-10-06T11:20:35.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.387+0000 7f40e4ad0700 1 -- 172.21.15.146:0/284973222 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e00cab80 con 0x7f40e00aeb90 2023-10-06T11:20:35.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.388+0000 7f40e4ad0700 1 -- 172.21.15.146:0/284973222 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f40e0063310 con 0x7f40e00aeb90 2023-10-06T11:20:35.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.388+0000 7f40c77fe700 1 -- 172.21.15.146:0/284973222 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f40d001a400 con 0x7f40e00aeb90 2023-10-06T11:20:35.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.389+0000 7f40c77fe700 1 --2- 172.21.15.146:0/284973222 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f40cc066f30 0x7f40cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:35.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.389+0000 7f40c77fe700 1 -- 172.21.15.146:0/284973222 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f40d0083d90 con 0x7f40e00aeb90 2023-10-06T11:20:35.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.389+0000 7f40deffd700 1 --2- 172.21.15.146:0/284973222 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f40cc066f30 0x7f40cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:35.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.389+0000 7f40c77fe700 1 --2- 172.21.15.146:0/284973222 >> [v2:172.21.15.151:6824/90920,v1:172.21.15.151:6825/90920] conn(0x7f40cc06d440 0x7f40cc06f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:35.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.389+0000 7f40c77fe700 1 -- 172.21.15.146:0/284973222 --> [v2:172.21.15.151:6824/90920,v1:172.21.15.151:6825/90920] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f40cc06ff00 con 0x7f40cc06d440 2023-10-06T11:20:35.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.389+0000 7f40c77fe700 1 -- 172.21.15.146:0/284973222 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=183) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40d00863d0 con 0x7f40e00aeb90 2023-10-06T11:20:35.394 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.389+0000 7f40dffff700 1 --2- 172.21.15.146:0/284973222 >> [v2:172.21.15.151:6824/90920,v1:172.21.15.151:6825/90920] conn(0x7f40cc06d440 0x7f40cc06f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:35.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.389+0000 7f40deffd700 1 --2- 172.21.15.146:0/284973222 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f40cc066f30 0x7f40cc0693e0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f40e0159f40 tx=0x7f40d4016000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:35.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.390+0000 7f40dffff700 1 --2- 172.21.15.146:0/284973222 >> [v2:172.21.15.151:6824/90920,v1:172.21.15.151:6825/90920] conn(0x7f40cc06d440 0x7f40cc06f850 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:35.395 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.390+0000 7f40c77fe700 1 -- 172.21.15.146:0/284973222 <== osd.6 v2:172.21.15.151:6824/90920 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f40cc06ff00 con 0x7f40cc06d440 2023-10-06T11:20:35.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.404+0000 7f40e4ad0700 1 -- 172.21.15.146:0/284973222 --> [v2:172.21.15.151:6824/90920,v1:172.21.15.151:6825/90920] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f40e0069b70 con 0x7f40cc06d440 2023-10-06T11:20:35.406 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.405+0000 7f40c77fe700 1 -- 172.21.15.146:0/284973222 <== osd.6 v2:172.21.15.151:6824/90920 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f40e0069b70 con 0x7f40cc06d440 2023-10-06T11:20:35.407 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:20:35.407 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T11:20:35.407 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:20:35.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.405+0000 7f40e4ad0700 1 -- 172.21.15.146:0/284973222 >> [v2:172.21.15.151:6824/90920,v1:172.21.15.151:6825/90920] conn(0x7f40cc06d440 msgr2=0x7f40cc06f850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:35.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.405+0000 7f40e4ad0700 1 --2- 172.21.15.146:0/284973222 >> [v2:172.21.15.151:6824/90920,v1:172.21.15.151:6825/90920] conn(0x7f40cc06d440 0x7f40cc06f850 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:35.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.405+0000 7f40e4ad0700 1 -- 172.21.15.146:0/284973222 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f40cc066f30 msgr2=0x7f40cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:35.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.405+0000 7f40e4ad0700 1 --2- 172.21.15.146:0/284973222 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f40cc066f30 0x7f40cc0693e0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f40e0159f40 tx=0x7f40d4016000 comp rx=0 tx=0).stop 2023-10-06T11:20:35.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.405+0000 7f40e4ad0700 1 -- 172.21.15.146:0/284973222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40e00aeb90 msgr2=0x7f40e0152fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:35.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.405+0000 7f40e4ad0700 1 --2- 172.21.15.146:0/284973222 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f40e00aeb90 0x7f40e0152fc0 secure :-1 s=READY pgs=2425 cs=0 l=1 rev1=1 crypto rx=0x7f40d000b610 tx=0x7f40d00090f0 comp rx=0 tx=0).stop 2023-10-06T11:20:35.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.405+0000 7f40dffff700 1 -- 172.21.15.146:0/284973222 reap_dead start 2023-10-06T11:20:35.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.405+0000 7f40e4ad0700 1 -- 172.21.15.146:0/284973222 shutdown_connections 2023-10-06T11:20:35.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.405+0000 7f40e4ad0700 1 -- 172.21.15.146:0/284973222 >> 172.21.15.146:0/284973222 conn(0x7f40e00974e0 msgr2=0x7f40e00aef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:35.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.405+0000 7f40e4ad0700 1 -- 172.21.15.146:0/284973222 shutdown_connections 2023-10-06T11:20:35.408 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.405+0000 7f40e4ad0700 1 -- 172.21.15.146:0/284973222 wait complete. 2023-10-06T11:20:35.419 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-06T11:20:35.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.533+0000 7f2958661700 1 Processor -- start 2023-10-06T11:20:35.535 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.533+0000 7f2958661700 1 -- start start 2023-10-06T11:20:35.536 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.534+0000 7f2958661700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f29500ca990 0x7f295006bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:35.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.534+0000 7f2958661700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2950159ea0 0x7f29500cc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:35.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.534+0000 7f2958661700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f295015ae10 con 0x7f295006b920 2023-10-06T11:20:35.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.534+0000 7f2958661700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f295015a850 con 0x7f2950159ea0 2023-10-06T11:20:35.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.534+0000 7f2958661700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f295015ab30 con 0x7f29500ca990 2023-10-06T11:20:35.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.534+0000 7f29563fd700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f295006b920 0x7f295015de10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52214/0 (socket says 172.21.15.146:52214) 2023-10-06T11:20:35.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.534+0000 7f2956bfe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2950159ea0 0x7f29500cc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:35.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.534+0000 7f29563fd700 1 -- 172.21.15.146:0/2503363229 learned_addr learned my addr 172.21.15.146:0/2503363229 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:20:35.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.534+0000 7f2955bfc700 1 --2- 172.21.15.146:0/2503363229 >> v2:172.21.15.151:3300/0 conn(0x7f29500ca990 0x7f295006bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:35.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.534+0000 7f2956bfe700 1 -- 172.21.15.146:0/2503363229 >> v2:172.21.15.151:3300/0 conn(0x7f29500ca990 msgr2=0x7f295006bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:35.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.535+0000 7f2956bfe700 1 --2- 172.21.15.146:0/2503363229 >> v2:172.21.15.151:3300/0 conn(0x7f29500ca990 0x7f295006bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:35.537 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.535+0000 7f2956bfe700 1 -- 172.21.15.146:0/2503363229 >> v1:172.21.15.146:6789/0 conn(0x7f295006b920 legacy=0x7f295015de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:35.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.535+0000 7f2956bfe700 1 -- 172.21.15.146:0/2503363229 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f295015d610 con 0x7f2950159ea0 2023-10-06T11:20:35.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.535+0000 7f29553fb700 1 -- 172.21.15.146:0/2503363229 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2018856038 0 0) 0x7f295015ae10 con 0x7f295006b920 2023-10-06T11:20:35.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.535+0000 7f2956bfe700 1 --2- 172.21.15.146:0/2503363229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2950159ea0 0x7f29500cc460 secure :-1 s=READY pgs=2427 cs=0 l=1 rev1=1 crypto rx=0x7f295006f1d0 tx=0x7f2948009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cec1e4757bf78f09 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:35.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.535+0000 7f29553fb700 1 -- 172.21.15.146:0/2503363229 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294800e070 con 0x7f2950159ea0 2023-10-06T11:20:35.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.535+0000 7f29553fb700 1 -- 172.21.15.146:0/2503363229 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f294800bc30 con 0x7f2950159ea0 2023-10-06T11:20:35.538 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.535+0000 7f29553fb700 1 -- 172.21.15.146:0/2503363229 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2948012430 con 0x7f2950159ea0 2023-10-06T11:20:35.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.535+0000 7f2958661700 1 -- 172.21.15.146:0/2503363229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2950159ea0 msgr2=0x7f29500cc460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:35.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.535+0000 7f2958661700 1 --2- 172.21.15.146:0/2503363229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2950159ea0 0x7f29500cc460 secure :-1 s=READY pgs=2427 cs=0 l=1 rev1=1 crypto rx=0x7f295006f1d0 tx=0x7f2948009780 comp rx=0 tx=0).stop 2023-10-06T11:20:35.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.535+0000 7f2958661700 1 -- 172.21.15.146:0/2503363229 shutdown_connections 2023-10-06T11:20:35.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.535+0000 7f2958661700 1 --2- 172.21.15.146:0/2503363229 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2950159ea0 0x7f29500cc460 unknown :-1 s=CLOSED pgs=2427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:35.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.535+0000 7f2958661700 1 --2- 172.21.15.146:0/2503363229 >> v2:172.21.15.151:3300/0 conn(0x7f29500ca990 0x7f295006bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:35.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.535+0000 7f2958661700 1 -- 172.21.15.146:0/2503363229 >> 172.21.15.146:0/2503363229 conn(0x7f2950067eb0 msgr2=0x7f29500ce450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:35.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.536+0000 7f2958661700 1 -- 172.21.15.146:0/2503363229 shutdown_connections 2023-10-06T11:20:35.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.536+0000 7f2958661700 1 -- 172.21.15.146:0/2503363229 wait complete. 2023-10-06T11:20:35.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.537+0000 7f2958661700 1 Processor -- start 2023-10-06T11:20:35.541 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.537+0000 7f2958661700 1 -- start start 2023-10-06T11:20:35.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.537+0000 7f2958661700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f295006b920 0x7f29500c5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:35.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.537+0000 7f2958661700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29500ca990 0x7f29500c6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:35.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.537+0000 7f2958661700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2950159ea0 0x7f29500b26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:35.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.537+0000 7f2958661700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29500c67a0 con 0x7f295006b920 2023-10-06T11:20:35.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.537+0000 7f2958661700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29500c75c0 con 0x7f2950159ea0 2023-10-06T11:20:35.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.537+0000 7f2958661700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2950145650 con 0x7f29500ca990 2023-10-06T11:20:35.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.537+0000 7f29563fd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f295006b920 0x7f29500c5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:35.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.537+0000 7f29563fd700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f295006b920 0x7f29500c5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58248/0 (socket says 172.21.15.146:58248) 2023-10-06T11:20:35.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.537+0000 7f29563fd700 1 -- 172.21.15.146:0/1521563266 learned_addr learned my addr 172.21.15.146:0/1521563266 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:35.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.538+0000 7f2956bfe700 1 --2- 172.21.15.146:0/1521563266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2950159ea0 0x7f29500b26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:35.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.538+0000 7f29563fd700 1 -- 172.21.15.146:0/1521563266 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29500ca990 msgr2=0x7f29500c6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:35.542 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.538+0000 7f29563fd700 1 --2- 172.21.15.146:0/1521563266 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29500ca990 0x7f29500c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:35.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.538+0000 7f29563fd700 1 -- 172.21.15.146:0/1521563266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2950159ea0 msgr2=0x7f29500b26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:35.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.538+0000 7f29563fd700 1 --2- 172.21.15.146:0/1521563266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2950159ea0 0x7f29500b26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:35.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.538+0000 7f29563fd700 1 -- 172.21.15.146:0/1521563266 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2948009a20 con 0x7f295006b920 2023-10-06T11:20:35.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.538+0000 7f29563fd700 1 --2- 172.21.15.146:0/1521563266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f295006b920 0x7f29500c5aa0 secure :-1 s=READY pgs=2428 cs=0 l=1 rev1=1 crypto rx=0x7f294c00c7e0 tx=0x7f294c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:35.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.538+0000 7f29467fc700 1 -- 172.21.15.146:0/1521563266 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294c005b30 con 0x7f295006b920 2023-10-06T11:20:35.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.538+0000 7f29467fc700 1 -- 172.21.15.146:0/1521563266 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f294c005c90 con 0x7f295006b920 2023-10-06T11:20:35.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.538+0000 7f2958661700 1 -- 172.21.15.146:0/1521563266 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29500c69b0 con 0x7f295006b920 2023-10-06T11:20:35.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.538+0000 7f29467fc700 1 -- 172.21.15.146:0/1521563266 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294c007300 con 0x7f295006b920 2023-10-06T11:20:35.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.538+0000 7f2958661700 1 -- 172.21.15.146:0/1521563266 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29500c6f70 con 0x7f295006b920 2023-10-06T11:20:35.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.539+0000 7f2958661700 1 -- 172.21.15.146:0/1521563266 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f295004c380 con 0x7f295006b920 2023-10-06T11:20:35.543 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.539+0000 7f29467fc700 1 -- 172.21.15.146:0/1521563266 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f294c01b400 con 0x7f295006b920 2023-10-06T11:20:35.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.540+0000 7f29467fc700 1 --2- 172.21.15.146:0/1521563266 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2934066f30 0x7f29340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:35.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.540+0000 7f29467fc700 1 -- 172.21.15.146:0/1521563266 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f294c083f00 con 0x7f295006b920 2023-10-06T11:20:35.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.540+0000 7f2955bfc700 1 --2- 172.21.15.146:0/1521563266 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2934066f30 0x7f29340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:35.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.540+0000 7f2955bfc700 1 --2- 172.21.15.146:0/1521563266 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2934066f30 0x7f29340693e0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f29500ca160 tx=0x7f2940008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:35.545 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.544+0000 7f29467fc700 1 -- 172.21.15.146:0/1521563266 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f294c051330 con 0x7f295006b920 2023-10-06T11:20:35.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.727+0000 7f2958661700 1 -- 172.21.15.146:0/1521563266 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f295015d8f0 con 0x7f2934066f30 2023-10-06T11:20:35.729 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.727+0000 7f29467fc700 1 -- 172.21.15.146:0/1521563266 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f295015d8f0 con 0x7f2934066f30 2023-10-06T11:20:35.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.729+0000 7f2958661700 1 -- 172.21.15.146:0/1521563266 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2934066f30 msgr2=0x7f29340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:35.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.729+0000 7f2958661700 1 --2- 172.21.15.146:0/1521563266 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2934066f30 0x7f29340693e0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f29500ca160 tx=0x7f2940008040 comp rx=0 tx=0).stop 2023-10-06T11:20:35.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.729+0000 7f2958661700 1 -- 172.21.15.146:0/1521563266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f295006b920 msgr2=0x7f29500c5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:35.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.729+0000 7f2958661700 1 --2- 172.21.15.146:0/1521563266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f295006b920 0x7f29500c5aa0 secure :-1 s=READY pgs=2428 cs=0 l=1 rev1=1 crypto rx=0x7f294c00c7e0 tx=0x7f294c007df0 comp rx=0 tx=0).stop 2023-10-06T11:20:35.731 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.729+0000 7f2958661700 1 -- 172.21.15.146:0/1521563266 shutdown_connections 2023-10-06T11:20:35.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.729+0000 7f2958661700 1 --2- 172.21.15.146:0/1521563266 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2934066f30 0x7f29340693e0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:35.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.729+0000 7f2958661700 1 --2- 172.21.15.146:0/1521563266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2950159ea0 0x7f29500b26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:35.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.729+0000 7f2958661700 1 --2- 172.21.15.146:0/1521563266 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f295006b920 0x7f29500c5aa0 unknown :-1 s=CLOSED pgs=2428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:35.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.729+0000 7f2958661700 1 --2- 172.21.15.146:0/1521563266 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f29500ca990 0x7f29500c6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:35.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.729+0000 7f2958661700 1 -- 172.21.15.146:0/1521563266 >> 172.21.15.146:0/1521563266 conn(0x7f2950067eb0 msgr2=0x7f2950069fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:35.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.729+0000 7f2958661700 1 -- 172.21.15.146:0/1521563266 shutdown_connections 2023-10-06T11:20:35.732 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.729+0000 7f2958661700 1 -- 172.21.15.146:0/1521563266 wait complete. 2023-10-06T11:20:35.732 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 6 to deep-scrub 2023-10-06T11:20:35.743 INFO:tasks.ceph:Scrubbing osd.7 2023-10-06T11:20:35.743 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-06T11:20:35.861 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.859+0000 7fd5fdbf9700 1 Processor -- start 2023-10-06T11:20:35.862 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.860+0000 7fd5fdbf9700 1 -- start start 2023-10-06T11:20:35.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.860+0000 7fd5fdbf9700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd5f8151b30 0x7fd5f80c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:35.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.860+0000 7fd5fdbf9700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd5f806be50 0x7fd5f80cc510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:35.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.860+0000 7fd5fdbf9700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5f815bcb0 con 0x7fd5f80c8fb0 2023-10-06T11:20:35.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.860+0000 7fd5fdbf9700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5f80c9530 con 0x7fd5f8151b30 2023-10-06T11:20:35.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.860+0000 7fd5fdbf9700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5f815c140 con 0x7fd5f806be50 2023-10-06T11:20:35.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.861+0000 7fd5f77fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd5f8151b30 0x7fd5f80c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:35.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.861+0000 7fd5f77fe700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7fd5f8151b30 0x7fd5f80c8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58250/0 (socket says 172.21.15.146:58250) 2023-10-06T11:20:35.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.861+0000 7fd5f77fe700 1 -- 172.21.15.146:0/2143360337 learned_addr learned my addr 172.21.15.146:0/2143360337 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:35.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.861+0000 7fd5f7fff700 1 --2- 172.21.15.146:0/2143360337 >> v2:172.21.15.151:3300/0 conn(0x7fd5f806be50 0x7fd5f80cc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:35.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.861+0000 7fd5f77fe700 1 -- 172.21.15.146:0/2143360337 >> v2:172.21.15.151:3300/0 conn(0x7fd5f806be50 msgr2=0x7fd5f80cc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:35.864 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.861+0000 7fd5f77fe700 1 --2- 172.21.15.146:0/2143360337 >> v2:172.21.15.151:3300/0 conn(0x7fd5f806be50 0x7fd5f80cc510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:35.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.861+0000 7fd5f77fe700 1 -- 172.21.15.146:0/2143360337 >> v1:172.21.15.151:6789/0 conn(0x7fd5f80c8fb0 legacy=0x7fd5f806b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:35.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.861+0000 7fd5f77fe700 1 -- 172.21.15.146:0/2143360337 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f815b380 con 0x7fd5f8151b30 2023-10-06T11:20:35.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.861+0000 7fd5f77fe700 1 --2- 172.21.15.146:0/2143360337 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5f8151b30 0x7fd5f80c8a70 secure :-1 s=READY pgs=2429 cs=0 l=1 rev1=1 crypto rx=0x7fd5f81557b0 tx=0x7fd5e8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3447b6db4f4de6e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:35.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.861+0000 7fd5f67fc700 1 -- 172.21.15.146:0/2143360337 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e800e070 con 0x7fd5f8151b30 2023-10-06T11:20:35.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.861+0000 7fd5f67fc700 1 -- 172.21.15.146:0/2143360337 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5e800b990 con 0x7fd5f8151b30 2023-10-06T11:20:35.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.861+0000 7fd5f67fc700 1 -- 172.21.15.146:0/2143360337 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e80092e0 con 0x7fd5f8151b30 2023-10-06T11:20:35.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.862+0000 7fd5fdbf9700 1 -- 172.21.15.146:0/2143360337 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5f8151b30 msgr2=0x7fd5f80c8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:35.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.862+0000 7fd5fdbf9700 1 --2- 172.21.15.146:0/2143360337 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5f8151b30 0x7fd5f80c8a70 secure :-1 s=READY pgs=2429 cs=0 l=1 rev1=1 crypto rx=0x7fd5f81557b0 tx=0x7fd5e8009840 comp rx=0 tx=0).stop 2023-10-06T11:20:35.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.862+0000 7fd5fdbf9700 1 -- 172.21.15.146:0/2143360337 shutdown_connections 2023-10-06T11:20:35.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.862+0000 7fd5fdbf9700 1 --2- 172.21.15.146:0/2143360337 >> v2:172.21.15.151:3300/0 conn(0x7fd5f806be50 0x7fd5f80cc510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:35.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.862+0000 7fd5fdbf9700 1 --2- 172.21.15.146:0/2143360337 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5f8151b30 0x7fd5f80c8a70 unknown :-1 s=CLOSED pgs=2429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:35.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.862+0000 7fd5fdbf9700 1 -- 172.21.15.146:0/2143360337 >> 172.21.15.146:0/2143360337 conn(0x7fd5f80ce430 msgr2=0x7fd5f80ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:35.865 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.862+0000 7fd5fdbf9700 1 -- 172.21.15.146:0/2143360337 shutdown_connections 2023-10-06T11:20:35.866 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.862+0000 7fd5fdbf9700 1 -- 172.21.15.146:0/2143360337 wait complete. 2023-10-06T11:20:35.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.863+0000 7fd5fdbf9700 1 Processor -- start 2023-10-06T11:20:35.868 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.863+0000 7fd5fdbf9700 1 -- start start 2023-10-06T11:20:35.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.864+0000 7fd5fdbf9700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5f806be50 0x7fd5f80b11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:35.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.864+0000 7fd5fdbf9700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5f80c8fb0 0x7fd5f8154860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:35.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.864+0000 7fd5fdbf9700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5f8151b30 0x7fd5f8154da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:35.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.864+0000 7fd5fdbf9700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f81543d0 con 0x7fd5f8151b30 2023-10-06T11:20:35.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.864+0000 7fd5fdbf9700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f81537c0 con 0x7fd5f806be50 2023-10-06T11:20:35.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.864+0000 7fd5fdbf9700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f8153aa0 con 0x7fd5f80c8fb0 2023-10-06T11:20:35.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.864+0000 7fd5f7fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5f8151b30 0x7fd5f8154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:35.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.864+0000 7fd5f7fff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5f8151b30 0x7fd5f8154da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58258/0 (socket says 172.21.15.146:58258) 2023-10-06T11:20:35.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.864+0000 7fd5f7fff700 1 -- 172.21.15.146:0/1615174060 learned_addr learned my addr 172.21.15.146:0/1615174060 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:35.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.864+0000 7fd5f77fe700 1 --2- 172.21.15.146:0/1615174060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5f806be50 0x7fd5f80b11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:35.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.864+0000 7fd5f6ffd700 1 --2- 172.21.15.146:0/1615174060 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5f80c8fb0 0x7fd5f8154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:35.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.864+0000 7fd5f7fff700 1 -- 172.21.15.146:0/1615174060 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5f80c8fb0 msgr2=0x7fd5f8154860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:35.869 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.864+0000 7fd5f7fff700 1 --2- 172.21.15.146:0/1615174060 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd5f80c8fb0 0x7fd5f8154860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:35.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.864+0000 7fd5f7fff700 1 -- 172.21.15.146:0/1615174060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5f806be50 msgr2=0x7fd5f80b11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:35.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.864+0000 7fd5f7fff700 1 --2- 172.21.15.146:0/1615174060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5f806be50 0x7fd5f80b11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:35.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.864+0000 7fd5f7fff700 1 -- 172.21.15.146:0/1615174060 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e8009ae0 con 0x7fd5f8151b30 2023-10-06T11:20:35.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.864+0000 7fd5f7fff700 1 --2- 172.21.15.146:0/1615174060 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5f8151b30 0x7fd5f8154da0 secure :-1 s=READY pgs=2430 cs=0 l=1 rev1=1 crypto rx=0x7fd5f000e8d0 tx=0x7fd5f00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:35.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.864+0000 7fd5df7fe700 1 -- 172.21.15.146:0/1615174060 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f0013680 con 0x7fd5f8151b30 2023-10-06T11:20:35.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.864+0000 7fd5df7fe700 1 -- 172.21.15.146:0/1615174060 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f00137e0 con 0x7fd5f8151b30 2023-10-06T11:20:35.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.864+0000 7fd5fdbf9700 1 -- 172.21.15.146:0/1615174060 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5f8153d80 con 0x7fd5f8151b30 2023-10-06T11:20:35.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.864+0000 7fd5df7fe700 1 -- 172.21.15.146:0/1615174060 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f0013ba0 con 0x7fd5f8151b30 2023-10-06T11:20:35.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.865+0000 7fd5fdbf9700 1 -- 172.21.15.146:0/1615174060 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5f8153470 con 0x7fd5f8151b30 2023-10-06T11:20:35.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.865+0000 7fd5fdbf9700 1 -- 172.21.15.146:0/1615174060 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd5f80cd900 con 0x7fd5f8151b30 2023-10-06T11:20:35.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.866+0000 7fd5df7fe700 1 -- 172.21.15.146:0/1615174060 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd5f00123d0 con 0x7fd5f8151b30 2023-10-06T11:20:35.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.866+0000 7fd5df7fe700 1 --2- 172.21.15.146:0/1615174060 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd5e4066f30 0x7fd5e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:35.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.866+0000 7fd5df7fe700 1 -- 172.21.15.146:0/1615174060 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5378+0+0 (secure 0 0 0) 0x7fd5f00844f0 con 0x7fd5f8151b30 2023-10-06T11:20:35.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.866+0000 7fd5f77fe700 1 --2- 172.21.15.146:0/1615174060 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd5e4066f30 0x7fd5e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:35.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.866+0000 7fd5df7fe700 1 --2- 172.21.15.146:0/1615174060 >> [v2:172.21.15.151:6808/90890,v1:172.21.15.151:6809/90890] conn(0x7fd5e406d440 0x7fd5e406f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:35.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.866+0000 7fd5df7fe700 1 -- 172.21.15.146:0/1615174060 --> [v2:172.21.15.151:6808/90890,v1:172.21.15.151:6809/90890] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd5e406ff00 con 0x7fd5e406d440 2023-10-06T11:20:35.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.866+0000 7fd5df7fe700 1 -- 172.21.15.146:0/1615174060 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_get_version_reply(handle=1 version=183) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd5f0086b30 con 0x7fd5f8151b30 2023-10-06T11:20:35.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.867+0000 7fd5f6ffd700 1 --2- 172.21.15.146:0/1615174060 >> [v2:172.21.15.151:6808/90890,v1:172.21.15.151:6809/90890] conn(0x7fd5e406d440 0x7fd5e406f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:35.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.867+0000 7fd5f77fe700 1 --2- 172.21.15.146:0/1615174060 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd5e4066f30 0x7fd5e40693e0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8009ea0 tx=0x7fd5e8018000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:35.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.867+0000 7fd5f6ffd700 1 --2- 172.21.15.146:0/1615174060 >> [v2:172.21.15.151:6808/90890,v1:172.21.15.151:6809/90890] conn(0x7fd5e406d440 0x7fd5e406f850 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:35.871 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.868+0000 7fd5df7fe700 1 -- 172.21.15.146:0/1615174060 <== osd.7 v2:172.21.15.151:6808/90890 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fd5e406ff00 con 0x7fd5e406d440 2023-10-06T11:20:35.882 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.881+0000 7fd5fdbf9700 1 -- 172.21.15.146:0/1615174060 --> [v2:172.21.15.151:6808/90890,v1:172.21.15.151:6809/90890] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd5f804c380 con 0x7fd5e406d440 2023-10-06T11:20:35.883 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.881+0000 7fd5df7fe700 1 -- 172.21.15.146:0/1615174060 <== osd.7 v2:172.21.15.151:6808/90890 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd5f804c380 con 0x7fd5e406d440 2023-10-06T11:20:35.883 INFO:teuthology.orchestra.run.smithi146.stdout:{ 2023-10-06T11:20:35.883 INFO:teuthology.orchestra.run.smithi146.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T11:20:35.883 INFO:teuthology.orchestra.run.smithi146.stdout:} 2023-10-06T11:20:35.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.882+0000 7fd5fdbf9700 1 -- 172.21.15.146:0/1615174060 >> [v2:172.21.15.151:6808/90890,v1:172.21.15.151:6809/90890] conn(0x7fd5e406d440 msgr2=0x7fd5e406f850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:35.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.882+0000 7fd5fdbf9700 1 --2- 172.21.15.146:0/1615174060 >> [v2:172.21.15.151:6808/90890,v1:172.21.15.151:6809/90890] conn(0x7fd5e406d440 0x7fd5e406f850 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:35.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.882+0000 7fd5fdbf9700 1 -- 172.21.15.146:0/1615174060 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd5e4066f30 msgr2=0x7fd5e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:35.884 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.882+0000 7fd5fdbf9700 1 --2- 172.21.15.146:0/1615174060 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7fd5e4066f30 0x7fd5e40693e0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fd5e8009ea0 tx=0x7fd5e8018000 comp rx=0 tx=0).stop 2023-10-06T11:20:35.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.882+0000 7fd5fdbf9700 1 -- 172.21.15.146:0/1615174060 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5f8151b30 msgr2=0x7fd5f8154da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:35.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.882+0000 7fd5fdbf9700 1 --2- 172.21.15.146:0/1615174060 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7fd5f8151b30 0x7fd5f8154da0 secure :-1 s=READY pgs=2430 cs=0 l=1 rev1=1 crypto rx=0x7fd5f000e8d0 tx=0x7fd5f00091a0 comp rx=0 tx=0).stop 2023-10-06T11:20:35.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.882+0000 7fd5f7fff700 1 -- 172.21.15.146:0/1615174060 reap_dead start 2023-10-06T11:20:35.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.882+0000 7fd5fdbf9700 1 -- 172.21.15.146:0/1615174060 shutdown_connections 2023-10-06T11:20:35.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.882+0000 7fd5fdbf9700 1 -- 172.21.15.146:0/1615174060 >> 172.21.15.146:0/1615174060 conn(0x7fd5f80ce430 msgr2=0x7fd5f80c4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:35.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.882+0000 7fd5fdbf9700 1 -- 172.21.15.146:0/1615174060 shutdown_connections 2023-10-06T11:20:35.885 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:35.882+0000 7fd5fdbf9700 1 -- 172.21.15.146:0/1615174060 wait complete. 2023-10-06T11:20:35.895 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-06T11:20:36.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.010+0000 7f0355e63700 1 Processor -- start 2023-10-06T11:20:36.012 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.010+0000 7f0355e63700 1 -- start start 2023-10-06T11:20:36.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.011+0000 7f0355e63700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f03500c8ce0 0x7f03500cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:36.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.011+0000 7f0355e63700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f03500c90b0 0x7f0350156f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:36.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.011+0000 7f0355e63700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03500cc140 con 0x7f03501574a0 2023-10-06T11:20:36.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.011+0000 7f0355e63700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03500cccc0 con 0x7f03500c90b0 2023-10-06T11:20:36.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.011+0000 7f0355e63700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03500cd690 con 0x7f03500c8ce0 2023-10-06T11:20:36.019 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.011+0000 7f034ffff700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f03500c90b0 0x7f0350156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:36.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.011+0000 7f0355662700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f03501574a0 0x7f03500cabb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52216/0 (socket says 172.21.15.146:52216) 2023-10-06T11:20:36.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.011+0000 7f0355662700 1 -- 172.21.15.146:0/3463582319 learned_addr learned my addr 172.21.15.146:0/3463582319 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:20:36.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.011+0000 7f0354e61700 1 --2- 172.21.15.146:0/3463582319 >> v2:172.21.15.151:3300/0 conn(0x7f03500c8ce0 0x7f03500cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:36.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.011+0000 7f034ffff700 1 -- 172.21.15.146:0/3463582319 >> v2:172.21.15.151:3300/0 conn(0x7f03500c8ce0 msgr2=0x7f03500cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:36.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.011+0000 7f034ffff700 1 --2- 172.21.15.146:0/3463582319 >> v2:172.21.15.151:3300/0 conn(0x7f03500c8ce0 0x7f03500cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:36.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.011+0000 7f034ffff700 1 -- 172.21.15.146:0/3463582319 >> v1:172.21.15.146:6789/0 conn(0x7f03501574a0 legacy=0x7f03500cabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:36.020 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.011+0000 7f034ffff700 1 -- 172.21.15.146:0/3463582319 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03500cc390 con 0x7f03500c90b0 2023-10-06T11:20:36.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.011+0000 7f034f7fe700 1 -- 172.21.15.146:0/3463582319 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1194641252 0 0) 0x7f03500cc140 con 0x7f03501574a0 2023-10-06T11:20:36.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.011+0000 7f034ffff700 1 --2- 172.21.15.146:0/3463582319 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03500c90b0 0x7f0350156f60 secure :-1 s=READY pgs=2432 cs=0 l=1 rev1=1 crypto rx=0x7f03500c5220 tx=0x7f033c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f16dce10fa340db2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:36.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.011+0000 7f034f7fe700 1 -- 172.21.15.146:0/3463582319 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c00b6b0 con 0x7f03500c90b0 2023-10-06T11:20:36.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.012+0000 7f034f7fe700 1 -- 172.21.15.146:0/3463582319 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033c00b810 con 0x7f03500c90b0 2023-10-06T11:20:36.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.012+0000 7f034f7fe700 1 -- 172.21.15.146:0/3463582319 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c00bbb0 con 0x7f03500c90b0 2023-10-06T11:20:36.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.012+0000 7f0355e63700 1 -- 172.21.15.146:0/3463582319 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03500c90b0 msgr2=0x7f0350156f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:36.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.012+0000 7f0355e63700 1 --2- 172.21.15.146:0/3463582319 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03500c90b0 0x7f0350156f60 secure :-1 s=READY pgs=2432 cs=0 l=1 rev1=1 crypto rx=0x7f03500c5220 tx=0x7f033c0091a0 comp rx=0 tx=0).stop 2023-10-06T11:20:36.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.012+0000 7f0355e63700 1 -- 172.21.15.146:0/3463582319 shutdown_connections 2023-10-06T11:20:36.022 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.012+0000 7f0355e63700 1 --2- 172.21.15.146:0/3463582319 >> v2:172.21.15.151:3300/0 conn(0x7f03500c8ce0 0x7f03500cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:36.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.012+0000 7f0355e63700 1 --2- 172.21.15.146:0/3463582319 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03500c90b0 0x7f0350156f60 unknown :-1 s=CLOSED pgs=2432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:36.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.012+0000 7f0355e63700 1 -- 172.21.15.146:0/3463582319 >> 172.21.15.146:0/3463582319 conn(0x7f03500703f0 msgr2=0x7f03500707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:36.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.012+0000 7f0355e63700 1 -- 172.21.15.146:0/3463582319 shutdown_connections 2023-10-06T11:20:36.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.012+0000 7f0355e63700 1 -- 172.21.15.146:0/3463582319 wait complete. 2023-10-06T11:20:36.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.013+0000 7f0355e63700 1 Processor -- start 2023-10-06T11:20:36.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.013+0000 7f0355e63700 1 -- start start 2023-10-06T11:20:36.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.014+0000 7f0355e63700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03500c8ce0 0x7f0350141820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:36.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.014+0000 7f0355e63700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03500c90b0 0x7f03500c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:36.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.014+0000 7f0355e63700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03501574a0 0x7f03500c6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:36.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.014+0000 7f0355e63700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03500c6a40 con 0x7f03500c90b0 2023-10-06T11:20:36.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.014+0000 7f0355e63700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03500c6d20 con 0x7f03501574a0 2023-10-06T11:20:36.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.014+0000 7f0355e63700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0350159e40 con 0x7f03500c8ce0 2023-10-06T11:20:36.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.014+0000 7f034ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03500c90b0 0x7f03500c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:36.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.014+0000 7f034ffff700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03500c90b0 0x7f03500c5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58272/0 (socket says 172.21.15.146:58272) 2023-10-06T11:20:36.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.014+0000 7f034ffff700 1 -- 172.21.15.146:0/2163225134 learned_addr learned my addr 172.21.15.146:0/2163225134 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:36.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.014+0000 7f0355662700 1 --2- 172.21.15.146:0/2163225134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03501574a0 0x7f03500c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:36.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.014+0000 7f0354e61700 1 --2- 172.21.15.146:0/2163225134 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03500c8ce0 0x7f0350141820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:36.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.014+0000 7f034ffff700 1 -- 172.21.15.146:0/2163225134 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03500c8ce0 msgr2=0x7f0350141820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:36.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.014+0000 7f034ffff700 1 --2- 172.21.15.146:0/2163225134 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03500c8ce0 0x7f0350141820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:36.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.014+0000 7f034ffff700 1 -- 172.21.15.146:0/2163225134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03501574a0 msgr2=0x7f03500c6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:36.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.014+0000 7f034ffff700 1 --2- 172.21.15.146:0/2163225134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03501574a0 0x7f03500c6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:36.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.014+0000 7f034ffff700 1 -- 172.21.15.146:0/2163225134 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f033c009420 con 0x7f03500c90b0 2023-10-06T11:20:36.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.014+0000 7f0355662700 1 --2- 172.21.15.146:0/2163225134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03501574a0 0x7f03500c6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:20:36.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.015+0000 7f034ffff700 1 --2- 172.21.15.146:0/2163225134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03500c90b0 0x7f03500c5e30 secure :-1 s=READY pgs=2433 cs=0 l=1 rev1=1 crypto rx=0x7f03500c5480 tx=0x7f033c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:36.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.015+0000 7f034cff9700 1 -- 172.21.15.146:0/2163225134 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c011420 con 0x7f03500c90b0 2023-10-06T11:20:36.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.015+0000 7f034cff9700 1 -- 172.21.15.146:0/2163225134 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033c011580 con 0x7f03500c90b0 2023-10-06T11:20:36.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.015+0000 7f0355e63700 1 -- 172.21.15.146:0/2163225134 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f035015a120 con 0x7f03500c90b0 2023-10-06T11:20:36.026 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.015+0000 7f034cff9700 1 -- 172.21.15.146:0/2163225134 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c011940 con 0x7f03500c90b0 2023-10-06T11:20:36.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.015+0000 7f0355e63700 1 -- 172.21.15.146:0/2163225134 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0350141d60 con 0x7f03500c90b0 2023-10-06T11:20:36.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.016+0000 7f0355e63700 1 -- 172.21.15.146:0/2163225134 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f035015a640 con 0x7f03500c90b0 2023-10-06T11:20:36.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.016+0000 7f034cff9700 1 -- 172.21.15.146:0/2163225134 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f033c011d30 con 0x7f03500c90b0 2023-10-06T11:20:36.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.017+0000 7f034cff9700 1 --2- 172.21.15.146:0/2163225134 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0334066fb0 0x7f0334069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:36.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.017+0000 7f034cff9700 1 -- 172.21.15.146:0/2163225134 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f033c0858e0 con 0x7f03500c90b0 2023-10-06T11:20:36.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.017+0000 7f0354e61700 1 --2- 172.21.15.146:0/2163225134 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0334066fb0 0x7f0334069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:36.027 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.017+0000 7f0354e61700 1 --2- 172.21.15.146:0/2163225134 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0334066fb0 0x7f0334069460 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f0344006fd0 tx=0x7f0344008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:36.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.021+0000 7f034cff9700 1 -- 172.21.15.146:0/2163225134 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f035015a640 con 0x7f03500c90b0 2023-10-06T11:20:36.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.203+0000 7f0355e63700 1 -- 172.21.15.146:0/2163225134 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f035015a640 con 0x7f0334066fb0 2023-10-06T11:20:36.205 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.203+0000 7f034cff9700 1 -- 172.21.15.146:0/2163225134 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f035015a640 con 0x7f0334066fb0 2023-10-06T11:20:36.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.205+0000 7f0355e63700 1 -- 172.21.15.146:0/2163225134 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0334066fb0 msgr2=0x7f0334069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:36.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.205+0000 7f0355e63700 1 --2- 172.21.15.146:0/2163225134 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0334066fb0 0x7f0334069460 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f0344006fd0 tx=0x7f0344008040 comp rx=0 tx=0).stop 2023-10-06T11:20:36.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.205+0000 7f0355e63700 1 -- 172.21.15.146:0/2163225134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03500c90b0 msgr2=0x7f03500c5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:36.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.205+0000 7f0355e63700 1 --2- 172.21.15.146:0/2163225134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03500c90b0 0x7f03500c5e30 secure :-1 s=READY pgs=2433 cs=0 l=1 rev1=1 crypto rx=0x7f03500c5480 tx=0x7f033c017000 comp rx=0 tx=0).stop 2023-10-06T11:20:36.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.205+0000 7f0355e63700 1 -- 172.21.15.146:0/2163225134 shutdown_connections 2023-10-06T11:20:36.207 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.205+0000 7f0355e63700 1 --2- 172.21.15.146:0/2163225134 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0334066fb0 0x7f0334069460 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:36.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.205+0000 7f0355e63700 1 --2- 172.21.15.146:0/2163225134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03501574a0 0x7f03500c6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:36.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.205+0000 7f0355e63700 1 --2- 172.21.15.146:0/2163225134 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f03500c8ce0 0x7f0350141820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:36.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.205+0000 7f0355e63700 1 --2- 172.21.15.146:0/2163225134 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f03500c90b0 0x7f03500c5e30 unknown :-1 s=CLOSED pgs=2433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:36.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.205+0000 7f0355e63700 1 -- 172.21.15.146:0/2163225134 >> 172.21.15.146:0/2163225134 conn(0x7f03500703f0 msgr2=0x7f03500b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:36.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.205+0000 7f0355e63700 1 -- 172.21.15.146:0/2163225134 shutdown_connections 2023-10-06T11:20:36.208 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.205+0000 7f0355e63700 1 -- 172.21.15.146:0/2163225134 wait complete. 2023-10-06T11:20:36.208 INFO:teuthology.orchestra.run.smithi146.stderr:instructed osd(s) 7 to deep-scrub 2023-10-06T11:20:36.219 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:20:36.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.334+0000 7f18cb289700 1 Processor -- start 2023-10-06T11:20:36.336 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.334+0000 7f18cb289700 1 -- start start 2023-10-06T11:20:36.338 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.335+0000 7f18cb289700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f18c40cd480 0x7f18c415abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:36.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.335+0000 7f18cb289700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f18c40b09f0 0x7f18c40b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:36.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.335+0000 7f18cb289700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18c40b6070 con 0x7f18c40cd0b0 2023-10-06T11:20:36.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.335+0000 7f18cb289700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18c40b0280 con 0x7f18c40cd480 2023-10-06T11:20:36.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.335+0000 7f18cb289700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18c415ddf0 con 0x7f18c40b09f0 2023-10-06T11:20:36.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.335+0000 7f18c8824700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f18c40cd480 0x7f18c415abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:36.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.335+0000 7f18c9025700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f18c40cd0b0 0x7f18c415d610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:52230/0 (socket says 172.21.15.146:52230) 2023-10-06T11:20:36.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.335+0000 7f18c9025700 1 -- 172.21.15.146:0/2563318133 learned_addr learned my addr 172.21.15.146:0/2563318133 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:20:36.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.335+0000 7f18c9826700 1 --2- 172.21.15.146:0/2563318133 >> v2:172.21.15.151:3300/0 conn(0x7f18c40b09f0 0x7f18c40b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:36.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.336+0000 7f18c8824700 1 -- 172.21.15.146:0/2563318133 >> v2:172.21.15.151:3300/0 conn(0x7f18c40b09f0 msgr2=0x7f18c40b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:36.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.336+0000 7f18c8824700 1 --2- 172.21.15.146:0/2563318133 >> v2:172.21.15.151:3300/0 conn(0x7f18c40b09f0 0x7f18c40b0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:36.339 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.336+0000 7f18c8824700 1 -- 172.21.15.146:0/2563318133 >> v1:172.21.15.146:6789/0 conn(0x7f18c40cd0b0 legacy=0x7f18c415d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:36.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.336+0000 7f18bbfff700 1 -- 172.21.15.146:0/2563318133 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4098837296 0 0) 0x7f18c40b6070 con 0x7f18c40cd0b0 2023-10-06T11:20:36.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.336+0000 7f18c8824700 1 -- 172.21.15.146:0/2563318133 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c415e0d0 con 0x7f18c40cd480 2023-10-06T11:20:36.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.336+0000 7f18c8824700 1 --2- 172.21.15.146:0/2563318133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18c40cd480 0x7f18c415abb0 secure :-1 s=READY pgs=2435 cs=0 l=1 rev1=1 crypto rx=0x7f18c4069530 tx=0x7f18b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46bbb005fd5542e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:36.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.336+0000 7f18bbfff700 1 -- 172.21.15.146:0/2563318133 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b4011630 con 0x7f18c40cd480 2023-10-06T11:20:36.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.336+0000 7f18bbfff700 1 -- 172.21.15.146:0/2563318133 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b4011790 con 0x7f18c40cd480 2023-10-06T11:20:36.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.336+0000 7f18bbfff700 1 -- 172.21.15.146:0/2563318133 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b4011b30 con 0x7f18c40cd480 2023-10-06T11:20:36.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.336+0000 7f18cb289700 1 -- 172.21.15.146:0/2563318133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18c40cd480 msgr2=0x7f18c415abb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:36.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.336+0000 7f18cb289700 1 --2- 172.21.15.146:0/2563318133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18c40cd480 0x7f18c415abb0 secure :-1 s=READY pgs=2435 cs=0 l=1 rev1=1 crypto rx=0x7f18c4069530 tx=0x7f18b40091a0 comp rx=0 tx=0).stop 2023-10-06T11:20:36.340 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.336+0000 7f18cb289700 1 -- 172.21.15.146:0/2563318133 shutdown_connections 2023-10-06T11:20:36.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.336+0000 7f18cb289700 1 --2- 172.21.15.146:0/2563318133 >> v2:172.21.15.151:3300/0 conn(0x7f18c40b09f0 0x7f18c40b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:36.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.336+0000 7f18cb289700 1 --2- 172.21.15.146:0/2563318133 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18c40cd480 0x7f18c415abb0 unknown :-1 s=CLOSED pgs=2435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:36.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.336+0000 7f18cb289700 1 -- 172.21.15.146:0/2563318133 >> 172.21.15.146:0/2563318133 conn(0x7f18c406eb10 msgr2=0x7f18c406ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:36.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.337+0000 7f18cb289700 1 -- 172.21.15.146:0/2563318133 shutdown_connections 2023-10-06T11:20:36.341 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.337+0000 7f18cb289700 1 -- 172.21.15.146:0/2563318133 wait complete. 2023-10-06T11:20:36.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.338+0000 7f18cb289700 1 Processor -- start 2023-10-06T11:20:36.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.338+0000 7f18cb289700 1 -- start start 2023-10-06T11:20:36.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.338+0000 7f18cb289700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18c40b09f0 0x7f18c4159c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:36.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.338+0000 7f18cb289700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18c40cd0b0 0x7f18c40c9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:36.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.339+0000 7f18cb289700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18c40cd480 0x7f18c40b4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:36.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.339+0000 7f18cb289700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c40affa0 con 0x7f18c40cd0b0 2023-10-06T11:20:36.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.339+0000 7f18cb289700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c40c7610 con 0x7f18c40cd480 2023-10-06T11:20:36.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.339+0000 7f18cb289700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18c40c7290 con 0x7f18c40b09f0 2023-10-06T11:20:36.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.339+0000 7f18c8824700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18c40cd0b0 0x7f18c40c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:36.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.339+0000 7f18c8824700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18c40cd0b0 0x7f18c40c9100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:58286/0 (socket says 172.21.15.146:58286) 2023-10-06T11:20:36.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.339+0000 7f18c8824700 1 -- 172.21.15.146:0/3091852913 learned_addr learned my addr 172.21.15.146:0/3091852913 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:36.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.339+0000 7f18c9826700 1 --2- 172.21.15.146:0/3091852913 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18c40cd480 0x7f18c40b4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:36.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.339+0000 7f18c9025700 1 --2- 172.21.15.146:0/3091852913 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18c40b09f0 0x7f18c4159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:36.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.339+0000 7f18c8824700 1 -- 172.21.15.146:0/3091852913 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18c40b09f0 msgr2=0x7f18c4159c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:36.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.339+0000 7f18c8824700 1 --2- 172.21.15.146:0/3091852913 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18c40b09f0 0x7f18c4159c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:36.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.339+0000 7f18c8824700 1 -- 172.21.15.146:0/3091852913 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18c40cd480 msgr2=0x7f18c40b4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:36.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.339+0000 7f18c8824700 1 --2- 172.21.15.146:0/3091852913 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18c40cd480 0x7f18c40b4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:36.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.339+0000 7f18c8824700 1 -- 172.21.15.146:0/3091852913 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b4009420 con 0x7f18c40cd0b0 2023-10-06T11:20:36.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.339+0000 7f18c8824700 1 --2- 172.21.15.146:0/3091852913 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18c40cd0b0 0x7f18c40c9100 secure :-1 s=READY pgs=2436 cs=0 l=1 rev1=1 crypto rx=0x7f18c4069680 tx=0x7f18b4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:36.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.339+0000 7f18b97fa700 1 -- 172.21.15.146:0/3091852913 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b4000d10 con 0x7f18c40cd0b0 2023-10-06T11:20:36.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.339+0000 7f18b97fa700 1 -- 172.21.15.146:0/3091852913 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b4011b10 con 0x7f18c40cd0b0 2023-10-06T11:20:36.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.339+0000 7f18cb289700 1 -- 172.21.15.146:0/3091852913 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18c40c7860 con 0x7f18c40cd0b0 2023-10-06T11:20:36.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.339+0000 7f18b97fa700 1 -- 172.21.15.146:0/3091852913 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b4025640 con 0x7f18c40cd0b0 2023-10-06T11:20:36.345 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.339+0000 7f18cb289700 1 -- 172.21.15.146:0/3091852913 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18c40c7e20 con 0x7f18c40cd0b0 2023-10-06T11:20:36.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.340+0000 7f18cb289700 1 -- 172.21.15.146:0/3091852913 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18c4070ec0 con 0x7f18c40cd0b0 2023-10-06T11:20:36.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.341+0000 7f18b97fa700 1 -- 172.21.15.146:0/3091852913 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f18b4025a30 con 0x7f18c40cd0b0 2023-10-06T11:20:36.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.341+0000 7f18b97fa700 1 --2- 172.21.15.146:0/3091852913 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f18a8066f30 0x7f18a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:36.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.341+0000 7f18b97fa700 1 -- 172.21.15.146:0/3091852913 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f18b4085af0 con 0x7f18c40cd0b0 2023-10-06T11:20:36.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.341+0000 7f18c9025700 1 --2- 172.21.15.146:0/3091852913 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f18a8066f30 0x7f18a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:36.346 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.341+0000 7f18c9025700 1 --2- 172.21.15.146:0/3091852913 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f18a8066f30 0x7f18a80693e0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f18c0007fd0 tx=0x7f18c0007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:36.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.345+0000 7f18b97fa700 1 -- 172.21.15.146:0/3091852913 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f18b4052ea0 con 0x7f18c40cd0b0 2023-10-06T11:20:36.527 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.525+0000 7f18cb289700 1 -- 172.21.15.146:0/3091852913 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f18c404c380 con 0x7f18a8066f30 2023-10-06T11:20:36.529 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.528+0000 7f18b97fa700 1 -- 172.21.15.146:0/3091852913 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73031 (secure 0 0 0) 0x7f18c404c380 con 0x7f18a8066f30 2023-10-06T11:20:36.530 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:20:36.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.530+0000 7f18cb289700 1 -- 172.21.15.146:0/3091852913 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f18a8066f30 msgr2=0x7f18a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:36.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.530+0000 7f18cb289700 1 --2- 172.21.15.146:0/3091852913 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f18a8066f30 0x7f18a80693e0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f18c0007fd0 tx=0x7f18c0007d30 comp rx=0 tx=0).stop 2023-10-06T11:20:36.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.530+0000 7f18cb289700 1 -- 172.21.15.146:0/3091852913 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18c40cd0b0 msgr2=0x7f18c40c9100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:36.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.530+0000 7f18cb289700 1 --2- 172.21.15.146:0/3091852913 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18c40cd0b0 0x7f18c40c9100 secure :-1 s=READY pgs=2436 cs=0 l=1 rev1=1 crypto rx=0x7f18c4069680 tx=0x7f18b4017000 comp rx=0 tx=0).stop 2023-10-06T11:20:36.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.530+0000 7f18cb289700 1 -- 172.21.15.146:0/3091852913 shutdown_connections 2023-10-06T11:20:36.532 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.530+0000 7f18cb289700 1 --2- 172.21.15.146:0/3091852913 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f18a8066f30 0x7f18a80693e0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:36.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.530+0000 7f18cb289700 1 --2- 172.21.15.146:0/3091852913 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18c40cd480 0x7f18c40b4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:36.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.530+0000 7f18cb289700 1 --2- 172.21.15.146:0/3091852913 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18c40b09f0 0x7f18c4159c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:36.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.530+0000 7f18cb289700 1 --2- 172.21.15.146:0/3091852913 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f18c40cd0b0 0x7f18c40c9100 unknown :-1 s=CLOSED pgs=2436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:36.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.530+0000 7f18cb289700 1 -- 172.21.15.146:0/3091852913 >> 172.21.15.146:0/3091852913 conn(0x7f18c406eb10 msgr2=0x7f18c40ceeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:36.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.530+0000 7f18cb289700 1 -- 172.21.15.146:0/3091852913 shutdown_connections 2023-10-06T11:20:36.533 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:36.530+0000 7f18cb289700 1 -- 172.21.15.146:0/3091852913 wait complete. 2023-10-06T11:20:36.533 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:20:36.544 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":625,"stamp":"2023-10-06T11:20:35.337287+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2430296,"kb_used_data":19224,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752544424,"statfs":{"total":773094113280,"available":770605490176,"internally_reserved":0,"allocated":19685376,"data_stored":9747164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12582912,"num_objects":-4,"num_object_clones":0,"num_object_copies":-8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4,"num_whiteouts":0,"num_read":-2,"num_read_kb":-2,"num_write":-8,"num_write_kb":-12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.303018"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":162,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-06T11:20:26.038371+0000","last_change":"2023-10-06T11:05:38.456679+0000","last_active":"2023-10-06T11:20:26.038371+0000","last_peered":"2023-10-06T11:20:26.038371+0000","last_clean":"2023-10-06T11:20:26.038371+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:20:26.038371+0000","last_undegraded":"2023-10-06T11:20:26.038371+0000","last_fullsized":"2023-10-06T11:20:26.038371+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":153,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-06T11:20:26.348635+0000","last_change":"2023-10-06T11:05:38.322888+0000","last_active":"2023-10-06T11:20:26.348635+0000","last_peered":"2023-10-06T11:20:26.348635+0000","last_clean":"2023-10-06T11:20:26.348635+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:20:26.348635+0000","last_undegraded":"2023-10-06T11:20:26.348635+0000","last_fullsized":"2023-10-06T11:20:26.348635+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":150,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-06T11:20:26.347736+0000","last_change":"2023-10-06T11:05:38.323930+0000","last_active":"2023-10-06T11:20:26.347736+0000","last_peered":"2023-10-06T11:20:26.347736+0000","last_clean":"2023-10-06T11:20:26.347736+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:20:26.347736+0000","last_undegraded":"2023-10-06T11:20:26.347736+0000","last_fullsized":"2023-10-06T11:20:26.347736+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:34:48.852127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":294,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-06T11:20:26.284715+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:20:26.284715+0000","last_peered":"2023-10-06T11:20:26.284715+0000","last_clean":"2023-10-06T11:20:26.284715+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:20:26.284715+0000","last_undegraded":"2023-10-06T11:20:26.284715+0000","last_fullsized":"2023-10-06T11:20:26.284715+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:00.542646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":144,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-06T11:20:26.284711+0000","last_change":"2023-10-06T11:05:38.419874+0000","last_active":"2023-10-06T11:20:26.284711+0000","last_peered":"2023-10-06T11:20:26.284711+0000","last_clean":"2023-10-06T11:20:26.284711+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:20:26.284711+0000","last_undegraded":"2023-10-06T11:20:26.284711+0000","last_fullsized":"2023-10-06T11:20:26.284711+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":144,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-06T11:20:26.284849+0000","last_change":"2023-10-06T11:05:38.417117+0000","last_active":"2023-10-06T11:20:26.284849+0000","last_peered":"2023-10-06T11:20:26.284849+0000","last_clean":"2023-10-06T11:20:26.284849+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:20:26.284849+0000","last_undegraded":"2023-10-06T11:20:26.284849+0000","last_fullsized":"2023-10-06T11:20:26.284849+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:16:18.870048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":170,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-06T11:20:26.038292+0000","last_change":"2023-10-06T11:05:38.417259+0000","last_active":"2023-10-06T11:20:26.038292+0000","last_peered":"2023-10-06T11:20:26.038292+0000","last_clean":"2023-10-06T11:20:26.038292+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:20:26.038292+0000","last_undegraded":"2023-10-06T11:20:26.038292+0000","last_fullsized":"2023-10-06T11:20:26.038292+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T14:05:51.661822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":151,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-06T11:20:26.346200+0000","last_change":"2023-10-06T11:05:38.420069+0000","last_active":"2023-10-06T11:20:26.346200+0000","last_peered":"2023-10-06T11:20:26.346200+0000","last_clean":"2023-10-06T11:20:26.346200+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:20:26.346200+0000","last_undegraded":"2023-10-06T11:20:26.346200+0000","last_fullsized":"2023-10-06T11:20:26.346200+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T16:00:59.390320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":151,"reported_epoch":182,"state":"active+clean","last_fresh":"2023-10-06T11:20:26.347708+0000","last_change":"2023-10-06T11:05:38.321861+0000","last_active":"2023-10-06T11:20:26.347708+0000","last_peered":"2023-10-06T11:20:26.347708+0000","last_clean":"2023-10-06T11:20:26.347708+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:20:26.347708+0000","last_undegraded":"2023-10-06T11:20:26.347708+0000","last_fullsized":"2023-10-06T11:20:26.347708+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:58:42.774607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575030,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304224,"kb_used_data":2840,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067616,"statfs":{"total":96636764160,"available":96325238784,"internally_reserved":0,"allocated":2908160,"data_stored":1661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.51300000000000001,"15min":0.63300000000000001},"min":{"1min":0.37,"5min":0.27200000000000002,"15min":0.21199999999999999},"max":{"1min":0.68500000000000005,"5min":0.71899999999999997,"15min":23.908999999999999},"last":0.317},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.54600000000000004,"15min":0.57999999999999996},"min":{"1min":0.35399999999999998,"5min":0.313,"15min":0.22500000000000001},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":9.3230000000000004},"last":0.32900000000000001}]},{"osd":1,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.53200000000000003,"15min":0.55900000000000005},"min":{"1min":0.434,"5min":0.28799999999999998,"15min":0.26000000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":9.2360000000000007},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.52200000000000002,"15min":0.50900000000000001},"min":{"1min":0.41599999999999998,"5min":0.373,"15min":0.25900000000000001},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":4.327},"last":0.38100000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.39400000000000002,"5min":0.313,"15min":0.26500000000000001},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":4.3120000000000003},"last":0.439},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.55900000000000005,"15min":0.56399999999999995},"min":{"1min":0.40899999999999997,"5min":0.34799999999999998,"15min":0.29999999999999999},"max":{"1min":1.109,"5min":1.109,"15min":4.7309999999999999},"last":0.41499999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.55200000000000005,"15min":0.55600000000000005},"min":{"1min":0.47499999999999998,"5min":0.35299999999999998,"15min":0.27900000000000003},"max":{"1min":0.75900000000000001,"5min":0.77000000000000002,"15min":4.5190000000000001},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58099999999999996,"15min":0.60399999999999998},"min":{"1min":0.45500000000000002,"5min":0.38100000000000001,"15min":0.29699999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":9.3879999999999999},"last":0.46000000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.48099999999999998,"15min":0.496},"min":{"1min":0.32000000000000001,"5min":0.26300000000000001,"15min":0.24399999999999999},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":4.6639999999999997},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.51100000000000001,"15min":0.53000000000000003},"min":{"1min":0.34599999999999997,"5min":0.33300000000000002,"15min":0.27300000000000002},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":4.3689999999999998},"last":0.47599999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.52700000000000002,"15min":0.55200000000000005},"min":{"1min":0.371,"5min":0.32600000000000001,"15min":0.26000000000000001},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":9.3499999999999996},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52400000000000002,"15min":0.53200000000000003},"min":{"1min":0.36899999999999999,"5min":0.36199999999999999,"15min":0.26800000000000002},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":4.444},"last":0.54100000000000004}]},{"osd":6,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56499999999999995,"15min":0.58699999999999997},"min":{"1min":0.41099999999999998,"5min":0.32400000000000001,"15min":0.29199999999999998},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":9.4969999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58799999999999997,"15min":0.61499999999999999},"min":{"1min":0.40500000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":7.2039999999999997},"last":0.52700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834575032,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299544,"kb_used_data":2256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072296,"statfs":{"total":96636764160,"available":96330031104,"internally_reserved":0,"allocated":2310144,"data_stored":1070127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.42299999999999999,"5min":0.218,"15min":0.187},"max":{"1min":0.71499999999999997,"5min":1.488,"15min":9.5549999999999997},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.63200000000000001,"15min":0.59399999999999997},"min":{"1min":0.45600000000000002,"5min":0.29699999999999999,"15min":0.254},"max":{"1min":0.77200000000000002,"5min":4.9930000000000003,"15min":9.4659999999999993},"last":0.67900000000000005}]},{"osd":1,"last update":"Fri Oct 6 11:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52400000000000002,"15min":0.49199999999999999},"min":{"1min":0.35199999999999998,"5min":0.23699999999999999,"15min":0.23300000000000001},"max":{"1min":0.64300000000000002,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.75,"15min":0.59699999999999998},"min":{"1min":0.39400000000000002,"5min":0.25800000000000001,"15min":0.216},"max":{"1min":0.80200000000000005,"5min":21.306000000000001,"15min":21.306000000000001},"last":0.46100000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55500000000000005,"15min":0.52300000000000002},"min":{"1min":0.438,"5min":0.29399999999999998,"15min":0.252},"max":{"1min":0.68400000000000005,"5min":2.8250000000000002,"15min":7.0659999999999998},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.70699999999999996,"15min":0.58399999999999996},"min":{"1min":0.40600000000000003,"5min":0.27800000000000002,"15min":0.26600000000000001},"max":{"1min":0.69999999999999996,"5min":17.216000000000001,"15min":17.216000000000001},"last":0.59499999999999997}]},{"osd":3,"last update":"Fri Oct 6 11:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.58999999999999997,"15min":0.54800000000000004},"min":{"1min":0.35499999999999998,"5min":0.29999999999999999,"15min":0.25800000000000001},"max":{"1min":0.72599999999999998,"5min":4.9400000000000004,"15min":4.9400000000000004},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.68700000000000006,"15min":0.58199999999999996},"min":{"1min":0.39300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.73799999999999999,"5min":12.159000000000001,"15min":12.159000000000001},"last":0.57099999999999995}]},{"osd":4,"last update":"Fri Oct 6 11:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.498,"15min":0.47799999999999998},"min":{"1min":0.31,"5min":0.27400000000000002,"15min":0.24299999999999999},"max":{"1min":0.61299999999999999,"5min":1.669,"15min":1.669},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.58099999999999996,"15min":0.53900000000000003},"min":{"1min":0.33200000000000002,"5min":0.29699999999999999,"15min":0.27900000000000003},"max":{"1min":0.66600000000000004,"5min":4.8949999999999996,"15min":4.8949999999999996},"last":0.72499999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.53800000000000003,"15min":0.51800000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.28399999999999997},"max":{"1min":0.621,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.61399999999999999,"15min":0.59099999999999997},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.755,"5min":4.7080000000000002,"15min":7.1379999999999999},"last":0.65300000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.63800000000000001,"15min":0.58599999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.27900000000000003},"max":{"1min":0.66900000000000004,"5min":5.7709999999999999,"15min":5.7709999999999999},"last":0.755},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.63100000000000001,"15min":0.59299999999999997},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.30199999999999999},"max":{"1min":0.69199999999999995,"5min":3.5579999999999998,"15min":3.5579999999999998},"last":0.69299999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575031,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":300128,"kb_used_data":2840,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071712,"statfs":{"total":96636764160,"available":96329433088,"internally_reserved":0,"allocated":2908160,"data_stored":1661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.34599999999999997,"15min":0.379},"min":{"1min":0.27500000000000002,"5min":0.19900000000000001,"15min":0.186},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":13.393000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.36899999999999999,"15min":0.39000000000000001},"min":{"1min":0.26700000000000002,"5min":0.20599999999999999,"15min":0.19700000000000001},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":11.462},"last":0.36099999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.36099999999999999,"15min":0.37},"min":{"1min":0.30499999999999999,"5min":0.217,"15min":0.216},"max":{"1min":0.56699999999999995,"5min":0.72599999999999998,"15min":8.0470000000000006},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.40699999999999997,"15min":0.41199999999999998},"min":{"1min":0.30299999999999999,"5min":0.215,"15min":0.20999999999999999},"max":{"1min":0.61199999999999999,"5min":0.66700000000000004,"15min":4.8630000000000004},"last":0.41199999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.42399999999999999,"15min":0.42899999999999999},"min":{"1min":0.32100000000000001,"5min":0.255,"15min":0.252},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":4.8029999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.41399999999999998,"15min":0.40799999999999997},"min":{"1min":0.35099999999999998,"5min":0.23799999999999999,"15min":0.217},"max":{"1min":0.63600000000000001,"5min":0.749,"15min":5.8700000000000001},"last":0.46400000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58299999999999996,"15min":0.54400000000000004},"min":{"1min":0.435,"5min":0.28299999999999997,"15min":0.28199999999999997},"max":{"1min":0.82299999999999995,"5min":0.88400000000000001,"15min":1.264},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.59499999999999997,"15min":0.58699999999999997},"min":{"1min":0.41299999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.82499999999999996,"5min":0.92800000000000005,"15min":4.7699999999999996},"last":0.61099999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59499999999999997,"15min":0.58099999999999996},"min":{"1min":0.46100000000000002,"5min":0.378,"15min":0.32400000000000001},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":3.4390000000000001},"last":0.623},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.61399999999999999,"15min":0.61199999999999999},"min":{"1min":0.44900000000000001,"5min":0.39000000000000001,"15min":0.29499999999999998},"max":{"1min":0.88800000000000001,"5min":0.92000000000000004,"15min":9.3829999999999991},"last":0.59899999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63900000000000001,"15min":0.60999999999999999},"min":{"1min":0.51000000000000001,"5min":0.42099999999999999,"15min":0.315},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":3.4750000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65200000000000002,"15min":0.61799999999999999},"min":{"1min":0.54500000000000004,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":3.9180000000000001},"last":0.52100000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.63200000000000001,"15min":0.625},"min":{"1min":0.434,"5min":0.39800000000000002,"15min":0.38500000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":4.7290000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.63,"15min":0.60799999999999998},"min":{"1min":0.51600000000000001,"5min":0.41399999999999998,"15min":0.374},"max":{"1min":0.86099999999999999,"5min":0.89200000000000002,"15min":2.4500000000000002},"last":0.68600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834575030,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303640,"kb_used_data":2256,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068200,"statfs":{"total":96636764160,"available":96325836800,"internally_reserved":0,"allocated":2310144,"data_stored":1070127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.35699999999999998,"15min":0.47499999999999998},"min":{"1min":0.23000000000000001,"5min":0.20999999999999999,"15min":0.184},"max":{"1min":0.56799999999999995,"5min":0.60199999999999998,"15min":36.097999999999999},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.36599999999999999,"15min":0.38600000000000001},"min":{"1min":0.27700000000000002,"5min":0.23100000000000001,"15min":0.182},"max":{"1min":0.47199999999999998,"5min":0.92400000000000004,"15min":7.2990000000000004},"last":0.40000000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.372,"15min":0.504},"min":{"1min":0.29799999999999999,"5min":0.223,"15min":0.217},"max":{"1min":0.53000000000000003,"5min":0.56100000000000005,"15min":36.07},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.40600000000000003,"15min":0.41599999999999998},"min":{"1min":0.32500000000000001,"5min":0.26600000000000001,"15min":0.219},"max":{"1min":0.58799999999999997,"5min":0.94899999999999995,"15min":6.7800000000000002},"last":0.373}]},{"osd":3,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.376,"15min":0.39400000000000002},"min":{"1min":0.30599999999999999,"5min":0.253,"15min":0.223},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":8.4130000000000003},"last":0.313},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.443,"15min":0.55800000000000005},"min":{"1min":0.34699999999999998,"5min":0.27800000000000002,"15min":0.249},"max":{"1min":0.55900000000000005,"5min":1.9079999999999999,"15min":35.959000000000003},"last":0.38800000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61399999999999999,"15min":0.57999999999999996},"min":{"1min":0.39500000000000002,"5min":0.36699999999999999,"15min":0.29599999999999999},"max":{"1min":0.88600000000000001,"5min":0.93500000000000005,"15min":2.427},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.61699999999999999,"15min":0.73299999999999998},"min":{"1min":0.42399999999999999,"5min":0.41299999999999998,"15min":0.29299999999999998},"max":{"1min":0.82999999999999996,"5min":0.91100000000000003,"15min":36.005000000000003},"last":0.59899999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40400000000000003,"5min":0.374,"15min":0.32900000000000001},"max":{"1min":0.94199999999999995,"5min":0.999,"15min":6.6699999999999999},"last":0.627},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58799999999999997,"15min":0.56699999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.315},"max":{"1min":0.90200000000000002,"5min":0.99399999999999999,"15min":2.0600000000000001},"last":0.53400000000000003}]},{"osd":6,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.626,"15min":0.73699999999999999},"min":{"1min":0.498,"5min":0.39200000000000002,"15min":0.317},"max":{"1min":0.86299999999999999,"5min":0.89600000000000002,"15min":36.037999999999997},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.64300000000000002,"15min":0.64900000000000002},"min":{"1min":0.42599999999999999,"5min":0.41299999999999998,"15min":0.36399999999999999},"max":{"1min":0.89900000000000002,"5min":1.028,"15min":6.7110000000000003},"last":0.64800000000000002}]},{"osd":7,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.61899999999999999,"15min":0.627},"min":{"1min":0.44500000000000001,"5min":0.39400000000000002,"15min":0.371},"max":{"1min":0.84199999999999997,"5min":1.054,"15min":6.742},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.60999999999999999,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.39200000000000002,"15min":0.34499999999999997},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":1.917},"last":0.56100000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575031,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303640,"kb_used_data":2256,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068200,"statfs":{"total":96636764160,"available":96325836800,"internally_reserved":0,"allocated":2310144,"data_stored":1070127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.49099999999999999,"15min":0.37},"min":{"1min":0.247,"5min":0.22900000000000001,"15min":0.17999999999999999},"max":{"1min":0.443,"5min":15.228,"15min":15.228},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.433,"15min":0.39700000000000002},"min":{"1min":0.35399999999999998,"5min":0.28599999999999998,"15min":0.20999999999999999},"max":{"1min":0.58899999999999997,"5min":1.714,"15min":1.714},"last":0.35499999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.39700000000000002,"15min":0.379},"min":{"1min":0.35199999999999998,"5min":0.253,"15min":0.19900000000000001},"max":{"1min":0.55300000000000005,"5min":0.56999999999999995,"15min":0.745},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.39200000000000002,"15min":0.36599999999999999},"min":{"1min":0.29999999999999999,"5min":0.23200000000000001,"15min":0.216},"max":{"1min":0.52300000000000002,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.372}]},{"osd":3,"last update":"Fri Oct 6 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.39500000000000002,"15min":0.373},"min":{"1min":0.35999999999999999,"5min":0.255,"15min":0.23200000000000001},"max":{"1min":0.54300000000000004,"5min":0.621,"15min":0.629},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.40699999999999997,"15min":0.377},"min":{"1min":0.33800000000000002,"5min":0.26600000000000001,"15min":0.251},"max":{"1min":0.56100000000000005,"5min":0.754,"15min":0.754},"last":0.46800000000000003}]},{"osd":4,"last update":"Fri Oct 6 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.58999999999999997,"15min":0.54300000000000004},"min":{"1min":0.52900000000000003,"5min":0.35799999999999998,"15min":0.30299999999999999},"max":{"1min":0.75700000000000001,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.72099999999999997,"15min":0.59899999999999998},"min":{"1min":0.38300000000000001,"5min":0.36499999999999999,"15min":0.27900000000000003},"max":{"1min":0.92400000000000004,"5min":15.26,"15min":15.26},"last":0.41399999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.72999999999999998,"15min":0.60199999999999998},"min":{"1min":0.45000000000000001,"5min":0.38200000000000001,"15min":0.32400000000000001},"max":{"1min":0.874,"5min":15.186,"15min":15.186},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.60099999999999998,"15min":0.56899999999999995},"min":{"1min":0.47399999999999998,"5min":0.40600000000000003,"15min":0.35099999999999998},"max":{"1min":0.78300000000000003,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.39900000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.624,"15min":0.59199999999999997},"min":{"1min":0.5,"5min":0.42599999999999999,"15min":0.32600000000000001},"max":{"1min":0.90400000000000003,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.63100000000000001,"15min":0.58899999999999997},"min":{"1min":0.505,"5min":0.438,"15min":0.34200000000000003},"max":{"1min":0.82099999999999995,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.56399999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.70699999999999996,"15min":0.60899999999999999},"min":{"1min":0.47499999999999998,"5min":0.41099999999999998,"15min":0.34499999999999997},"max":{"1min":0.83599999999999997,"5min":10.977,"15min":10.977},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.60699999999999998,"15min":0.57899999999999996},"min":{"1min":0.53700000000000003,"5min":0.39600000000000002,"15min":0.38200000000000001},"max":{"1min":0.75,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.443}]}]},{"osd":3,"up_from":13,"seq":55834575031,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311832,"kb_used_data":2256,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060008,"statfs":{"total":96636764160,"available":96317448192,"internally_reserved":0,"allocated":2310144,"data_stored":1070127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.375,"15min":0.33300000000000002},"min":{"1min":0.25900000000000001,"5min":0.19500000000000001,"15min":0.18099999999999999},"max":{"1min":0.58399999999999996,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.442,"15min":0.39100000000000001},"min":{"1min":0.36499999999999999,"5min":0.23000000000000001,"15min":0.22700000000000001},"max":{"1min":0.60899999999999999,"5min":4.4820000000000002,"15min":4.4820000000000002},"last":0.30199999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.34300000000000003,"15min":0.32300000000000001},"min":{"1min":0.308,"5min":0.22800000000000001,"15min":0.21299999999999999},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.65400000000000003},"last":0.246},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.38200000000000001,"15min":0.36099999999999999},"min":{"1min":0.34100000000000003,"5min":0.251,"15min":0.188},"max":{"1min":0.52600000000000002,"5min":0.54100000000000004,"15min":1.196},"last":0.31}]},{"osd":2,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.41799999999999998,"15min":0.38},"min":{"1min":0.32900000000000001,"5min":0.23400000000000001,"15min":0.19600000000000001},"max":{"1min":0.56499999999999995,"5min":4.601,"15min":4.601},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.46600000000000003,"15min":0.42399999999999999},"min":{"1min":0.38800000000000001,"5min":0.28499999999999998,"15min":0.26100000000000001},"max":{"1min":0.66600000000000004,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.375}]},{"osd":4,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57999999999999996,"15min":0.54800000000000004},"min":{"1min":0.46300000000000002,"5min":0.378,"15min":0.311},"max":{"1min":0.79700000000000004,"5min":0.84099999999999997,"15min":1.694},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.58699999999999997,"15min":0.55000000000000004},"min":{"1min":0.40899999999999997,"5min":0.32600000000000001,"15min":0.30199999999999999},"max":{"1min":0.82299999999999995,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.46400000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.57899999999999996,"15min":0.55200000000000005},"min":{"1min":0.46899999999999997,"5min":0.34100000000000003,"15min":0.29399999999999998},"max":{"1min":0.77500000000000002,"5min":0.83999999999999997,"15min":0.878},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.58899999999999997,"15min":0.56200000000000006},"min":{"1min":0.45900000000000002,"5min":0.35699999999999998,"15min":0.29699999999999999},"max":{"1min":0.80800000000000005,"5min":0.91000000000000003,"15min":1.165},"last":0.436}]},{"osd":6,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.622,"15min":0.58699999999999997},"min":{"1min":0.496,"5min":0.42499999999999999,"15min":0.36699999999999999},"max":{"1min":0.84099999999999997,"5min":0.95399999999999996,"15min":1.1359999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.625,"15min":0.59299999999999997},"min":{"1min":0.49199999999999999,"5min":0.36799999999999999,"15min":0.34399999999999997},"max":{"1min":0.80500000000000005,"5min":1.012,"15min":1.7470000000000001},"last":0.501}]},{"osd":7,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.60899999999999999,"15min":0.57999999999999996},"min":{"1min":0.51200000000000001,"5min":0.39600000000000002,"15min":0.35599999999999998},"max":{"1min":0.83499999999999996,"5min":0.89900000000000002,"15min":1.657},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.61099999999999999,"15min":0.58399999999999996},"min":{"1min":0.53500000000000003,"5min":0.40400000000000003,"15min":0.35499999999999998},"max":{"1min":0.86699999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.42699999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575030,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307740,"kb_used_data":2260,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064100,"statfs":{"total":96636764160,"available":96321638400,"internally_reserved":0,"allocated":2314240,"data_stored":1071480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:20:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.50600000000000001,"15min":0.49399999999999999},"min":{"1min":0.39000000000000001,"5min":0.24199999999999999,"15min":0.19500000000000001},"max":{"1min":0.67500000000000004,"5min":0.76800000000000002,"15min":2.6619999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52800000000000002,"15min":0.498},"min":{"1min":0.33900000000000002,"5min":0.28899999999999998,"15min":0.215},"max":{"1min":0.65400000000000003,"5min":0.81499999999999995,"15min":0.91200000000000003},"last":0.45600000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:20:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52400000000000002,"15min":0.51300000000000001},"min":{"1min":0.35099999999999998,"5min":0.27600000000000002,"15min":0.23300000000000001},"max":{"1min":0.68000000000000005,"5min":0.94099999999999995,"15min":2.8650000000000002},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53200000000000003,"15min":0.52200000000000002},"min":{"1min":0.42599999999999999,"5min":0.27000000000000002,"15min":0.25800000000000001},"max":{"1min":0.63600000000000001,"5min":0.79800000000000004,"15min":2.7610000000000001},"last":0.42699999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:20:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55800000000000005,"15min":0.52600000000000002},"min":{"1min":0.32500000000000001,"5min":0.312,"15min":0.23100000000000001},"max":{"1min":0.72399999999999998,"5min":0.88800000000000001,"15min":1.6910000000000001},"last":0.497},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58899999999999997,"15min":0.57199999999999995},"min":{"1min":0.40200000000000002,"5min":0.38700000000000001,"15min":0.30599999999999999},"max":{"1min":0.73399999999999999,"5min":0.84999999999999998,"15min":1.718},"last":0.58599999999999997}]},{"osd":3,"last update":"Fri Oct 6 11:20:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56100000000000005,"15min":0.56399999999999995},"min":{"1min":0.46500000000000002,"5min":0.36699999999999999,"15min":0.26700000000000002},"max":{"1min":0.71799999999999997,"5min":0.79600000000000004,"15min":2.677},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56499999999999995,"15min":0.53500000000000003},"min":{"1min":0.435,"5min":0.35599999999999998,"15min":0.27500000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":1.784},"last":0.50800000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:20:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.48999999999999999,"15min":0.47699999999999998},"min":{"1min":0.34200000000000003,"5min":0.33700000000000002,"15min":0.23200000000000001},"max":{"1min":0.72899999999999998,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.54700000000000004,"15min":0.52200000000000002},"min":{"1min":0.378,"5min":0.29099999999999998,"15min":0.28399999999999997},"max":{"1min":0.76700000000000002,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.59799999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:20:02 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.54700000000000004,"15min":0.52100000000000002},"min":{"1min":0.36499999999999999,"5min":0.30199999999999999,"15min":0.252},"max":{"1min":0.86799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.62},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.56299999999999994,"15min":0.54900000000000004},"min":{"1min":0.40600000000000003,"5min":0.38700000000000001,"15min":0.29199999999999998},"max":{"1min":0.79400000000000004,"5min":0.90400000000000003,"15min":1.165},"last":0.57399999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:20:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57699999999999996,"15min":0.56100000000000005},"min":{"1min":0.438,"5min":0.312,"15min":0.312},"max":{"1min":0.80600000000000005,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.60899999999999999,"15min":0.58699999999999997},"min":{"1min":0.38500000000000001,"5min":0.34399999999999997,"15min":0.317},"max":{"1min":0.89600000000000002,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.65800000000000003}]}]},{"osd":5,"up_from":13,"seq":55834575032,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299548,"kb_used_data":2260,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072292,"statfs":{"total":96636764160,"available":96330027008,"internally_reserved":0,"allocated":2314240,"data_stored":1071480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52000000000000002,"15min":0.53100000000000003},"min":{"1min":0.29299999999999998,"5min":0.26000000000000001,"15min":0.20499999999999999},"max":{"1min":0.72699999999999998,"5min":0.752,"15min":5.0490000000000004},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51800000000000002,"15min":0.51500000000000001},"min":{"1min":0.34599999999999997,"5min":0.26600000000000001,"15min":0.22900000000000001},"max":{"1min":0.69399999999999995,"5min":0.75,"15min":5.1449999999999996},"last":0.47199999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.52600000000000002,"15min":0.49199999999999999},"min":{"1min":0.35999999999999999,"5min":0.27800000000000002,"15min":0.25},"max":{"1min":0.70299999999999996,"5min":0.76400000000000001,"15min":0.97199999999999998},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54300000000000004,"15min":0.51400000000000001},"min":{"1min":0.33500000000000002,"5min":0.29799999999999999,"15min":0.27400000000000002},"max":{"1min":0.74199999999999999,"5min":0.752,"15min":1.8799999999999999},"last":0.39600000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56799999999999995,"15min":0.55200000000000005},"min":{"1min":0.36499999999999999,"5min":0.313,"15min":0.28299999999999997},"max":{"1min":0.755,"5min":0.80700000000000005,"15min":4.234},"last":0.501},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59699999999999998,"15min":0.56299999999999994},"min":{"1min":0.438,"5min":0.35899999999999999,"15min":0.315},"max":{"1min":0.753,"5min":0.82099999999999995,"15min":1.0369999999999999},"last":0.51700000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52900000000000003,"15min":0.54200000000000004},"min":{"1min":0.34499999999999997,"5min":0.29499999999999998,"15min":0.27700000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":5.2169999999999996},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.55900000000000005,"15min":0.54000000000000004},"min":{"1min":0.372,"5min":0.32400000000000001,"15min":0.29699999999999999},"max":{"1min":0.72899999999999998,"5min":0.76000000000000001,"15min":1.008},"last":0.57199999999999995}]},{"osd":4,"last update":"Fri Oct 6 11:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.49099999999999999,"15min":0.49399999999999999},"min":{"1min":0.28699999999999998,"5min":0.26400000000000001,"15min":0.23999999999999999},"max":{"1min":0.52600000000000002,"5min":0.78000000000000003,"15min":1.917},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.50600000000000001,"15min":0.504},"min":{"1min":0.33300000000000002,"5min":0.251,"15min":0.23899999999999999},"max":{"1min":0.58299999999999996,"5min":0.77600000000000002,"15min":0.87},"last":0.625}]},{"osd":6,"last update":"Fri Oct 6 11:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.52500000000000002,"15min":0.53000000000000003},"min":{"1min":0.372,"5min":0.32700000000000001,"15min":0.27600000000000002},"max":{"1min":0.55700000000000005,"5min":0.78800000000000003,"15min":2.0139999999999998},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.59499999999999997,"15min":0.58799999999999997},"min":{"1min":0.35599999999999998,"5min":0.30299999999999999,"15min":0.29999999999999999},"max":{"1min":0.79100000000000004,"5min":0.85099999999999998,"15min":1.9470000000000001},"last":0.60199999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.55000000000000004,"15min":0.55200000000000005},"min":{"1min":0.32900000000000001,"5min":0.311,"15min":0.27700000000000002},"max":{"1min":0.73699999999999999,"5min":0.79700000000000004,"15min":0.96499999999999997},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.39700000000000002,"5min":0.29199999999999998,"15min":0.28799999999999998},"max":{"1min":0.70299999999999996,"5min":0.81399999999999995,"15min":1.4119999999999999},"last":0.442}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:20:36.549 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2023-10-06T11:05:37.304522+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=5, tm_sec=37, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=20, tm_sec=31, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T11:20:36.549 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2023-10-06T11:05:37.304522+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=5, tm_sec=37, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=20, tm_sec=31, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T11:20:36.549 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2023-10-06T11:05:37.304522+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=5, tm_sec=37, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=20, tm_sec=31, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T11:20:36.549 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-06T11:05:37.304522+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=5, tm_sec=37, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=20, tm_sec=31, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T11:20:36.550 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2023-10-06T11:05:37.304522+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=5, tm_sec=37, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=20, tm_sec=31, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T11:20:36.550 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-06T11:05:37.304522+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=5, tm_sec=37, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=20, tm_sec=31, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T11:20:36.550 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2023-10-06T11:05:37.304522+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=5, tm_sec=37, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=20, tm_sec=31, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T11:20:36.550 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2023-10-06T11:05:37.304522+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=5, tm_sec=37, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=20, tm_sec=31, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T11:20:36.550 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2023-10-06T11:05:37.304522+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=5, tm_sec=37, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=20, tm_sec=31, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T11:20:36.550 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-06T11:20:51.998 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:20:52.001 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:20:56.551 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:20:56.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.677+0000 7f2bfb321700 1 Processor -- start 2023-10-06T11:20:56.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.677+0000 7f2bfb321700 1 -- start start 2023-10-06T11:20:56.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.678+0000 7f2bfb321700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2bf41538c0 0x7f2bf4153c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:56.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.678+0000 7f2bfb321700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2bf415a940 0x7f2bf415dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:56.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.678+0000 7f2bfb321700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2bf40cac80 0x7f2bf40ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:56.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.678+0000 7f2bfb321700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bf415d270 con 0x7f2bf40cac80 2023-10-06T11:20:56.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.678+0000 7f2bfb321700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bf415d830 con 0x7f2bf415a940 2023-10-06T11:20:56.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.678+0000 7f2bfb321700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf40cb810 con 0x7f2bf41538c0 2023-10-06T11:20:56.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.678+0000 7f2bf98be700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2bf40cac80 0x7f2bf40ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:56.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.678+0000 7f2bf98be700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f2bf40cac80 0x7f2bf40ce610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40828/0 (socket says 172.21.15.146:40828) 2023-10-06T11:20:56.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.678+0000 7f2bf98be700 1 -- 172.21.15.146:0/4120466044 learned_addr learned my addr 172.21.15.146:0/4120466044 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:56.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.678+0000 7f2bf88bc700 1 --2- 172.21.15.146:0/4120466044 >> v2:172.21.15.151:3300/0 conn(0x7f2bf415a940 0x7f2bf415dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:56.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.678+0000 7f2bf90bd700 1 --2- 172.21.15.146:0/4120466044 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2bf41538c0 0x7f2bf4153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:56.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.678+0000 7f2bf98be700 1 -- 172.21.15.146:0/4120466044 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2bf41538c0 msgr2=0x7f2bf4153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:56.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.678+0000 7f2bf98be700 1 --2- 172.21.15.146:0/4120466044 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2bf41538c0 0x7f2bf4153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:56.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.678+0000 7f2bf98be700 1 -- 172.21.15.146:0/4120466044 >> v2:172.21.15.151:3300/0 conn(0x7f2bf415a940 msgr2=0x7f2bf415dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:20:56.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.678+0000 7f2bf98be700 1 --2- 172.21.15.146:0/4120466044 >> v2:172.21.15.151:3300/0 conn(0x7f2bf415a940 0x7f2bf415dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:56.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.678+0000 7f2bf98be700 1 -- 172.21.15.146:0/4120466044 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf40cbaf0 con 0x7f2bf40cac80 2023-10-06T11:20:56.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.678+0000 7f2bf90bd700 1 --2- 172.21.15.146:0/4120466044 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2bf41538c0 0x7f2bf4153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:20:56.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.678+0000 7f2bf88bc700 1 --2- 172.21.15.146:0/4120466044 >> v2:172.21.15.151:3300/0 conn(0x7f2bf415a940 0x7f2bf415dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:20:56.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.678+0000 7f2bf98be700 1 --2- 172.21.15.146:0/4120466044 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bf40cac80 0x7f2bf40ce610 secure :-1 s=READY pgs=2437 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4069760 tx=0x7f2bec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a7869f525095966 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:56.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.679+0000 7f2bebfff700 1 -- 172.21.15.146:0/4120466044 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec00e070 con 0x7f2bf40cac80 2023-10-06T11:20:56.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.679+0000 7f2bebfff700 1 -- 172.21.15.146:0/4120466044 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bec00ba50 con 0x7f2bf40cac80 2023-10-06T11:20:56.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.679+0000 7f2bebfff700 1 -- 172.21.15.146:0/4120466044 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec0092e0 con 0x7f2bf40cac80 2023-10-06T11:20:56.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.679+0000 7f2bfb321700 1 -- 172.21.15.146:0/4120466044 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bf40cac80 msgr2=0x7f2bf40ce610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:56.683 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.679+0000 7f2bfb321700 1 --2- 172.21.15.146:0/4120466044 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bf40cac80 0x7f2bf40ce610 secure :-1 s=READY pgs=2437 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4069760 tx=0x7f2bec009840 comp rx=0 tx=0).stop 2023-10-06T11:20:56.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.679+0000 7f2bfb321700 1 -- 172.21.15.146:0/4120466044 shutdown_connections 2023-10-06T11:20:56.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.679+0000 7f2bfb321700 1 --2- 172.21.15.146:0/4120466044 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bf40cac80 0x7f2bf40ce610 unknown :-1 s=CLOSED pgs=2437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:56.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.679+0000 7f2bfb321700 1 --2- 172.21.15.146:0/4120466044 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2bf41538c0 0x7f2bf4153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:56.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.679+0000 7f2bfb321700 1 --2- 172.21.15.146:0/4120466044 >> v2:172.21.15.151:3300/0 conn(0x7f2bf415a940 0x7f2bf415dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:56.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.679+0000 7f2bfb321700 1 -- 172.21.15.146:0/4120466044 >> 172.21.15.146:0/4120466044 conn(0x7f2bf406eb10 msgr2=0x7f2bf406ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:56.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.679+0000 7f2bfb321700 1 -- 172.21.15.146:0/4120466044 shutdown_connections 2023-10-06T11:20:56.684 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.679+0000 7f2bfb321700 1 -- 172.21.15.146:0/4120466044 wait complete. 2023-10-06T11:20:56.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.680+0000 7f2bfb321700 1 Processor -- start 2023-10-06T11:20:56.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.680+0000 7f2bfb321700 1 -- start start 2023-10-06T11:20:56.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.681+0000 7f2bfb321700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2bf40cac80 0x7f2bf416c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:56.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.681+0000 7f2bfb321700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2bf41538c0 0x7f2bf416a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:56.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.681+0000 7f2bfb321700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bf415a940 0x7f2bf416a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:56.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.681+0000 7f2bfb321700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf40c8790 con 0x7f2bf415a940 2023-10-06T11:20:56.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.681+0000 7f2bfb321700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf40b24b0 con 0x7f2bf40cac80 2023-10-06T11:20:56.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.681+0000 7f2bfb321700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf416a6b0 con 0x7f2bf41538c0 2023-10-06T11:20:56.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.681+0000 7f2bf98be700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bf415a940 0x7f2bf416a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:56.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.682+0000 7f2bf98be700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bf415a940 0x7f2bf416a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:40836/0 (socket says 172.21.15.146:40836) 2023-10-06T11:20:56.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.682+0000 7f2bf98be700 1 -- 172.21.15.146:0/1033104362 learned_addr learned my addr 172.21.15.146:0/1033104362 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:20:56.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.682+0000 7f2bf90bd700 1 --2- 172.21.15.146:0/1033104362 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2bf40cac80 0x7f2bf416c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:56.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.682+0000 7f2bf88bc700 1 --2- 172.21.15.146:0/1033104362 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2bf41538c0 0x7f2bf416a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:56.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.682+0000 7f2bf98be700 1 -- 172.21.15.146:0/1033104362 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2bf41538c0 msgr2=0x7f2bf416a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:56.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.682+0000 7f2bf98be700 1 --2- 172.21.15.146:0/1033104362 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2bf41538c0 0x7f2bf416a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:56.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.682+0000 7f2bf98be700 1 -- 172.21.15.146:0/1033104362 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2bf40cac80 msgr2=0x7f2bf416c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:56.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.682+0000 7f2bf98be700 1 --2- 172.21.15.146:0/1033104362 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2bf40cac80 0x7f2bf416c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:56.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.682+0000 7f2bf98be700 1 -- 172.21.15.146:0/1033104362 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bec009ae0 con 0x7f2bf415a940 2023-10-06T11:20:56.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.682+0000 7f2bf90bd700 1 --2- 172.21.15.146:0/1033104362 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2bf40cac80 0x7f2bf416c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:20:56.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.682+0000 7f2bf98be700 1 --2- 172.21.15.146:0/1033104362 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bf415a940 0x7f2bf416a910 secure :-1 s=READY pgs=2438 cs=0 l=1 rev1=1 crypto rx=0x7f2bf40c7450 tx=0x7f2bec018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:56.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.682+0000 7f2be97fa700 1 -- 172.21.15.146:0/1033104362 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec0032f0 con 0x7f2bf415a940 2023-10-06T11:20:56.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.682+0000 7f2be97fa700 1 -- 172.21.15.146:0/1033104362 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bec008e40 con 0x7f2bf415a940 2023-10-06T11:20:56.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.682+0000 7f2bfb321700 1 -- 172.21.15.146:0/1033104362 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bf40c7b80 con 0x7f2bf415a940 2023-10-06T11:20:56.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.682+0000 7f2be97fa700 1 -- 172.21.15.146:0/1033104362 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bec0266b0 con 0x7f2bf415a940 2023-10-06T11:20:56.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.682+0000 7f2bfb321700 1 -- 172.21.15.146:0/1033104362 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bf40c8140 con 0x7f2bf415a940 2023-10-06T11:20:56.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.683+0000 7f2bfb321700 1 -- 172.21.15.146:0/1033104362 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bf404c380 con 0x7f2bf415a940 2023-10-06T11:20:56.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.684+0000 7f2be97fa700 1 -- 172.21.15.146:0/1033104362 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2bec003040 con 0x7f2bf415a940 2023-10-06T11:20:56.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.684+0000 7f2be97fa700 1 --2- 172.21.15.146:0/1033104362 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2bd8066f30 0x7f2bd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:20:56.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.684+0000 7f2be97fa700 1 -- 172.21.15.146:0/1033104362 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f2bec086480 con 0x7f2bf415a940 2023-10-06T11:20:56.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.684+0000 7f2bf90bd700 1 --2- 172.21.15.146:0/1033104362 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2bd8066f30 0x7f2bd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:20:56.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.684+0000 7f2bf90bd700 1 --2- 172.21.15.146:0/1033104362 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2bd8066f30 0x7f2bd80693e0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4063e90 tx=0x7f2bf0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:20:56.690 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.688+0000 7f2be97fa700 1 -- 172.21.15.146:0/1033104362 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2bec053830 con 0x7f2bf415a940 2023-10-06T11:20:56.870 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.868+0000 7f2bfb321700 1 -- 172.21.15.146:0/1033104362 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2bf415d4c0 con 0x7f2bd8066f30 2023-10-06T11:20:56.872 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.870+0000 7f2be97fa700 1 -- 172.21.15.146:0/1033104362 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73123 (secure 0 0 0) 0x7f2bf415d4c0 con 0x7f2bd8066f30 2023-10-06T11:20:56.873 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:20:56.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.872+0000 7f2bfb321700 1 -- 172.21.15.146:0/1033104362 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2bd8066f30 msgr2=0x7f2bd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:56.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.872+0000 7f2bfb321700 1 --2- 172.21.15.146:0/1033104362 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2bd8066f30 0x7f2bd80693e0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4063e90 tx=0x7f2bf0008040 comp rx=0 tx=0).stop 2023-10-06T11:20:56.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.872+0000 7f2bfb321700 1 -- 172.21.15.146:0/1033104362 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bf415a940 msgr2=0x7f2bf416a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:20:56.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.872+0000 7f2bfb321700 1 --2- 172.21.15.146:0/1033104362 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bf415a940 0x7f2bf416a910 secure :-1 s=READY pgs=2438 cs=0 l=1 rev1=1 crypto rx=0x7f2bf40c7450 tx=0x7f2bec018000 comp rx=0 tx=0).stop 2023-10-06T11:20:56.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.873+0000 7f2bfb321700 1 -- 172.21.15.146:0/1033104362 shutdown_connections 2023-10-06T11:20:56.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.873+0000 7f2bfb321700 1 --2- 172.21.15.146:0/1033104362 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f2bd8066f30 0x7f2bd80693e0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:56.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.873+0000 7f2bfb321700 1 --2- 172.21.15.146:0/1033104362 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f2bf415a940 0x7f2bf416a910 unknown :-1 s=CLOSED pgs=2438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:56.875 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.873+0000 7f2bfb321700 1 --2- 172.21.15.146:0/1033104362 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2bf40cac80 0x7f2bf416c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:56.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.873+0000 7f2bfb321700 1 --2- 172.21.15.146:0/1033104362 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2bf41538c0 0x7f2bf416a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:20:56.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.873+0000 7f2bfb321700 1 -- 172.21.15.146:0/1033104362 >> 172.21.15.146:0/1033104362 conn(0x7f2bf406eb10 msgr2=0x7f2bf40cd590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:20:56.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.873+0000 7f2bfb321700 1 -- 172.21.15.146:0/1033104362 shutdown_connections 2023-10-06T11:20:56.876 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:20:56.873+0000 7f2bfb321700 1 -- 172.21.15.146:0/1033104362 wait complete. 2023-10-06T11:20:56.876 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:20:56.886 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":635,"stamp":"2023-10-06T11:20:55.341493+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2430296,"kb_used_data":19224,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752544424,"statfs":{"total":773094113280,"available":770605490176,"internally_reserved":0,"allocated":19685376,"data_stored":9747164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002579"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":173,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-10-06T11:20:38.202509+0000","last_change":"2023-10-06T11:20:38.202479+0000","last_active":"2023-10-06T11:20:38.202509+0000","last_peered":"2023-10-06T11:20:38.202509+0000","last_clean":"2023-10-06T11:20:38.202509+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:20:38.202509+0000","last_undegraded":"2023-10-06T11:20:38.202509+0000","last_fullsized":"2023-10-06T11:20:38.202509+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:20:38.202342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:20:38.202342+0000","last_clean_scrub_stamp":"2023-10-06T11:20:38.202342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:01:40.082036+0000","scrub_duration":0.0095400060000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":164,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-10-06T11:20:38.832169+0000","last_change":"2023-10-06T11:20:38.832138+0000","last_active":"2023-10-06T11:20:38.832169+0000","last_peered":"2023-10-06T11:20:38.832169+0000","last_clean":"2023-10-06T11:20:38.832169+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:20:38.832169+0000","last_undegraded":"2023-10-06T11:20:38.832169+0000","last_fullsized":"2023-10-06T11:20:38.832169+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:20:38.831999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:20:38.831999+0000","last_clean_scrub_stamp":"2023-10-06T11:20:38.831999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:31:15.486256+0000","scrub_duration":0.010006595,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":161,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-10-06T11:20:35.358707+0000","last_change":"2023-10-06T11:20:35.358663+0000","last_active":"2023-10-06T11:20:35.358707+0000","last_peered":"2023-10-06T11:20:35.358707+0000","last_clean":"2023-10-06T11:20:35.358707+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:20:35.358707+0000","last_undegraded":"2023-10-06T11:20:35.358707+0000","last_fullsized":"2023-10-06T11:20:35.358707+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:20:35.358563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:20:35.358563+0000","last_clean_scrub_stamp":"2023-10-06T11:20:35.358563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:26:48.914387+0000","scrub_duration":0.0068210679999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"16'117","reported_seq":295,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-10-06T11:20:27.381807+0000","last_change":"2023-10-06T11:05:38.325876+0000","last_active":"2023-10-06T11:20:27.381807+0000","last_peered":"2023-10-06T11:20:27.381807+0000","last_clean":"2023-10-06T11:20:27.381807+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:20:27.381807+0000","last_undegraded":"2023-10-06T11:20:27.381807+0000","last_fullsized":"2023-10-06T11:20:27.381807+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:05:37.304522+0000","last_clean_scrub_stamp":"2023-10-06T11:05:37.304522+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":155,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-10-06T11:20:51.258182+0000","last_change":"2023-10-06T11:20:51.258147+0000","last_active":"2023-10-06T11:20:51.258182+0000","last_peered":"2023-10-06T11:20:51.258182+0000","last_clean":"2023-10-06T11:20:51.258182+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:20:51.258182+0000","last_undegraded":"2023-10-06T11:20:51.258182+0000","last_fullsized":"2023-10-06T11:20:51.258182+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:20:51.258033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:20:51.258033+0000","last_clean_scrub_stamp":"2023-10-06T11:20:51.258033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:28:29.316460+0000","scrub_duration":0.0061420479999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":155,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-10-06T11:20:48.284111+0000","last_change":"2023-10-06T11:20:48.284080+0000","last_active":"2023-10-06T11:20:48.284111+0000","last_peered":"2023-10-06T11:20:48.284111+0000","last_clean":"2023-10-06T11:20:48.284111+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:20:48.284111+0000","last_undegraded":"2023-10-06T11:20:48.284111+0000","last_fullsized":"2023-10-06T11:20:48.284111+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:20:48.283956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:20:48.283956+0000","last_clean_scrub_stamp":"2023-10-06T11:20:48.283956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:08:43.104259+0000","scrub_duration":0.0038529250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":181,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-10-06T11:20:37.245389+0000","last_change":"2023-10-06T11:20:37.245352+0000","last_active":"2023-10-06T11:20:37.245389+0000","last_peered":"2023-10-06T11:20:37.245389+0000","last_clean":"2023-10-06T11:20:37.245389+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:20:37.245389+0000","last_undegraded":"2023-10-06T11:20:37.245389+0000","last_fullsized":"2023-10-06T11:20:37.245389+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:20:37.245241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:20:37.245241+0000","last_clean_scrub_stamp":"2023-10-06T11:20:37.245241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:03:13.359358+0000","scrub_duration":0.0092457430000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":162,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-10-06T11:20:38.749641+0000","last_change":"2023-10-06T11:20:38.749604+0000","last_active":"2023-10-06T11:20:38.749641+0000","last_peered":"2023-10-06T11:20:38.749641+0000","last_clean":"2023-10-06T11:20:38.749641+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:20:38.749641+0000","last_undegraded":"2023-10-06T11:20:38.749641+0000","last_fullsized":"2023-10-06T11:20:38.749641+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:20:38.749482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:20:38.749482+0000","last_clean_scrub_stamp":"2023-10-06T11:20:38.749482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:39.877958+0000","scrub_duration":0.0083712630000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":162,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-10-06T11:20:39.782936+0000","last_change":"2023-10-06T11:20:39.782892+0000","last_active":"2023-10-06T11:20:39.782936+0000","last_peered":"2023-10-06T11:20:39.782936+0000","last_clean":"2023-10-06T11:20:39.782936+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:20:39.782936+0000","last_undegraded":"2023-10-06T11:20:39.782936+0000","last_fullsized":"2023-10-06T11:20:39.782936+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:20:39.782763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:20:39.782763+0000","last_clean_scrub_stamp":"2023-10-06T11:20:39.782763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:59.229319+0000","scrub_duration":0.010483408,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575034,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304224,"kb_used_data":2840,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067616,"statfs":{"total":96636764160,"available":96325238784,"internally_reserved":0,"allocated":2908160,"data_stored":1661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.51300000000000001,"15min":0.63300000000000001},"min":{"1min":0.37,"5min":0.27200000000000002,"15min":0.21199999999999999},"max":{"1min":0.68500000000000005,"5min":0.71899999999999997,"15min":23.908999999999999},"last":0.748},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.54600000000000004,"15min":0.57999999999999996},"min":{"1min":0.35399999999999998,"5min":0.313,"15min":0.22500000000000001},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":9.3230000000000004},"last":0.65100000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.53200000000000003,"15min":0.55900000000000005},"min":{"1min":0.434,"5min":0.28799999999999998,"15min":0.26000000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":9.2360000000000007},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.52200000000000002,"15min":0.50900000000000001},"min":{"1min":0.41599999999999998,"5min":0.373,"15min":0.25900000000000001},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":4.327},"last":0.75900000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.39400000000000002,"5min":0.313,"15min":0.26500000000000001},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":4.3120000000000003},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.55900000000000005,"15min":0.56399999999999995},"min":{"1min":0.40899999999999997,"5min":0.34799999999999998,"15min":0.29999999999999999},"max":{"1min":1.109,"5min":1.109,"15min":4.7309999999999999},"last":0.73499999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.55200000000000005,"15min":0.55600000000000005},"min":{"1min":0.47499999999999998,"5min":0.35299999999999998,"15min":0.27900000000000003},"max":{"1min":0.75900000000000001,"5min":0.77000000000000002,"15min":4.5190000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58099999999999996,"15min":0.60399999999999998},"min":{"1min":0.45500000000000002,"5min":0.38100000000000001,"15min":0.29699999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":9.3879999999999999},"last":0.69199999999999995}]},{"osd":4,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.48099999999999998,"15min":0.496},"min":{"1min":0.32000000000000001,"5min":0.26300000000000001,"15min":0.24399999999999999},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":4.6639999999999997},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.51100000000000001,"15min":0.53000000000000003},"min":{"1min":0.34599999999999997,"5min":0.33300000000000002,"15min":0.27300000000000002},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":4.3689999999999998},"last":0.78700000000000003}]},{"osd":5,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.52700000000000002,"15min":0.55200000000000005},"min":{"1min":0.371,"5min":0.32600000000000001,"15min":0.26000000000000001},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":9.3499999999999996},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52400000000000002,"15min":0.53200000000000003},"min":{"1min":0.36899999999999999,"5min":0.36199999999999999,"15min":0.26800000000000002},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":4.444},"last":0.66100000000000003}]},{"osd":6,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56499999999999995,"15min":0.58699999999999997},"min":{"1min":0.41099999999999998,"5min":0.32400000000000001,"15min":0.29199999999999998},"max":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":9.4969999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.58799999999999997,"15min":0.61499999999999999},"min":{"1min":0.40500000000000003,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":7.2039999999999997},"last":0.81299999999999994}]}]},{"osd":6,"up_from":13,"seq":55834575036,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299544,"kb_used_data":2256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072296,"statfs":{"total":96636764160,"available":96330031104,"internally_reserved":0,"allocated":2310144,"data_stored":1070127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.53600000000000003,"15min":0.53200000000000003},"min":{"1min":0.42299999999999999,"5min":0.218,"15min":0.187},"max":{"1min":0.71499999999999997,"5min":1.488,"15min":9.5549999999999997},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.63200000000000001,"15min":0.59399999999999997},"min":{"1min":0.45600000000000002,"5min":0.29699999999999999,"15min":0.254},"max":{"1min":0.77200000000000002,"5min":4.9930000000000003,"15min":9.4659999999999993},"last":0.59599999999999997}]},{"osd":1,"last update":"Fri Oct 6 11:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.52400000000000002,"15min":0.49199999999999999},"min":{"1min":0.35199999999999998,"5min":0.23699999999999999,"15min":0.23300000000000001},"max":{"1min":0.64300000000000002,"5min":1.6080000000000001,"15min":1.6080000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.75,"15min":0.59699999999999998},"min":{"1min":0.39400000000000002,"5min":0.25800000000000001,"15min":0.216},"max":{"1min":0.80200000000000005,"5min":21.306000000000001,"15min":21.306000000000001},"last":0.55400000000000005}]},{"osd":2,"last update":"Fri Oct 6 11:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55500000000000005,"15min":0.52300000000000002},"min":{"1min":0.438,"5min":0.29399999999999998,"15min":0.252},"max":{"1min":0.68400000000000005,"5min":2.8250000000000002,"15min":7.0659999999999998},"last":0.63},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.70699999999999996,"15min":0.58399999999999996},"min":{"1min":0.40600000000000003,"5min":0.27800000000000002,"15min":0.26600000000000001},"max":{"1min":0.69999999999999996,"5min":17.216000000000001,"15min":17.216000000000001},"last":0.61499999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.58999999999999997,"15min":0.54800000000000004},"min":{"1min":0.35499999999999998,"5min":0.29999999999999999,"15min":0.25800000000000001},"max":{"1min":0.72599999999999998,"5min":4.9400000000000004,"15min":4.9400000000000004},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.68700000000000006,"15min":0.58199999999999996},"min":{"1min":0.39300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.73799999999999999,"5min":12.159000000000001,"15min":12.159000000000001},"last":0.60599999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.498,"15min":0.47799999999999998},"min":{"1min":0.31,"5min":0.27400000000000002,"15min":0.24299999999999999},"max":{"1min":0.61299999999999999,"5min":1.669,"15min":1.669},"last":0.443},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.58099999999999996,"15min":0.53900000000000003},"min":{"1min":0.33200000000000002,"5min":0.29699999999999999,"15min":0.27900000000000003},"max":{"1min":0.66600000000000004,"5min":4.8949999999999996,"15min":4.8949999999999996},"last":0.42599999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.53800000000000003,"15min":0.51800000000000002},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.28399999999999997},"max":{"1min":0.621,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.61399999999999999,"15min":0.59099999999999997},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.755,"5min":4.7080000000000002,"15min":7.1379999999999999},"last":0.52900000000000003}]},{"osd":7,"last update":"Fri Oct 6 11:19:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.63800000000000001,"15min":0.58599999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.27900000000000003},"max":{"1min":0.66900000000000004,"5min":5.7709999999999999,"15min":5.7709999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.63100000000000001,"15min":0.59299999999999997},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.30199999999999999},"max":{"1min":0.69199999999999995,"5min":3.5579999999999998,"15min":3.5579999999999998},"last":0.56200000000000006}]}]},{"osd":1,"up_from":13,"seq":55834575035,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":300128,"kb_used_data":2840,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071712,"statfs":{"total":96636764160,"available":96329433088,"internally_reserved":0,"allocated":2908160,"data_stored":1661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.34599999999999997,"15min":0.379},"min":{"1min":0.27500000000000002,"5min":0.19900000000000001,"15min":0.186},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":13.393000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.36899999999999999,"15min":0.39000000000000001},"min":{"1min":0.26700000000000002,"5min":0.20599999999999999,"15min":0.19700000000000001},"max":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":11.462},"last":0.373}]},{"osd":2,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.36099999999999999,"15min":0.37},"min":{"1min":0.30499999999999999,"5min":0.217,"15min":0.216},"max":{"1min":0.56699999999999995,"5min":0.72599999999999998,"15min":8.0470000000000006},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.40699999999999997,"15min":0.41199999999999998},"min":{"1min":0.30299999999999999,"5min":0.215,"15min":0.20999999999999999},"max":{"1min":0.61199999999999999,"5min":0.66700000000000004,"15min":4.8630000000000004},"last":0.52100000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.42399999999999999,"15min":0.42899999999999999},"min":{"1min":0.32100000000000001,"5min":0.255,"15min":0.252},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":4.8029999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.41399999999999998,"15min":0.40799999999999997},"min":{"1min":0.35099999999999998,"5min":0.23799999999999999,"15min":0.217},"max":{"1min":0.63600000000000001,"5min":0.749,"15min":5.8700000000000001},"last":0.504}]},{"osd":4,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58299999999999996,"15min":0.54400000000000004},"min":{"1min":0.435,"5min":0.28299999999999997,"15min":0.28199999999999997},"max":{"1min":0.82299999999999995,"5min":0.88400000000000001,"15min":1.264},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.59499999999999997,"15min":0.58699999999999997},"min":{"1min":0.41299999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.82499999999999996,"5min":0.92800000000000005,"15min":4.7699999999999996},"last":0.67700000000000005}]},{"osd":5,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59499999999999997,"15min":0.58099999999999996},"min":{"1min":0.46100000000000002,"5min":0.378,"15min":0.32400000000000001},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":3.4390000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.61399999999999999,"15min":0.61199999999999999},"min":{"1min":0.44900000000000001,"5min":0.39000000000000001,"15min":0.29499999999999998},"max":{"1min":0.88800000000000001,"5min":0.92000000000000004,"15min":9.3829999999999991},"last":0.60299999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.63900000000000001,"15min":0.60999999999999999},"min":{"1min":0.51000000000000001,"5min":0.42099999999999999,"15min":0.315},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":3.4750000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65200000000000002,"15min":0.61799999999999999},"min":{"1min":0.54500000000000004,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":3.9180000000000001},"last":0.70699999999999996}]},{"osd":7,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.63200000000000001,"15min":0.625},"min":{"1min":0.434,"5min":0.39800000000000002,"15min":0.38500000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":4.7290000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.63,"15min":0.60799999999999998},"min":{"1min":0.51600000000000001,"5min":0.41399999999999998,"15min":0.374},"max":{"1min":0.86099999999999999,"5min":0.89200000000000002,"15min":2.4500000000000002},"last":0.74299999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575034,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303640,"kb_used_data":2256,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068200,"statfs":{"total":96636764160,"available":96325836800,"internally_reserved":0,"allocated":2310144,"data_stored":1070127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.35699999999999998,"15min":0.47499999999999998},"min":{"1min":0.23000000000000001,"5min":0.20999999999999999,"15min":0.184},"max":{"1min":0.56799999999999995,"5min":0.60199999999999998,"15min":36.097999999999999},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.36599999999999999,"15min":0.38600000000000001},"min":{"1min":0.27700000000000002,"5min":0.23100000000000001,"15min":0.182},"max":{"1min":0.47199999999999998,"5min":0.92400000000000004,"15min":7.2990000000000004},"last":0.39000000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.372,"15min":0.504},"min":{"1min":0.29799999999999999,"5min":0.223,"15min":0.217},"max":{"1min":0.53000000000000003,"5min":0.56100000000000005,"15min":36.07},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.40600000000000003,"15min":0.41599999999999998},"min":{"1min":0.32500000000000001,"5min":0.26600000000000001,"15min":0.219},"max":{"1min":0.58799999999999997,"5min":0.94899999999999995,"15min":6.7800000000000002},"last":0.33300000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.376,"15min":0.39400000000000002},"min":{"1min":0.30599999999999999,"5min":0.253,"15min":0.223},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":8.4130000000000003},"last":0.31},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.443,"15min":0.55800000000000005},"min":{"1min":0.34699999999999998,"5min":0.27800000000000002,"15min":0.249},"max":{"1min":0.55900000000000005,"5min":1.9079999999999999,"15min":35.959000000000003},"last":0.46200000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.61399999999999999,"15min":0.57999999999999996},"min":{"1min":0.39500000000000002,"5min":0.36699999999999999,"15min":0.29599999999999999},"max":{"1min":0.88600000000000001,"5min":0.93500000000000005,"15min":2.427},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.61699999999999999,"15min":0.73299999999999998},"min":{"1min":0.42399999999999999,"5min":0.41299999999999998,"15min":0.29299999999999998},"max":{"1min":0.82999999999999996,"5min":0.91100000000000003,"15min":36.005000000000003},"last":0.59999999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.40400000000000003,"5min":0.374,"15min":0.32900000000000001},"max":{"1min":0.94199999999999995,"5min":0.999,"15min":6.6699999999999999},"last":0.439},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58799999999999997,"15min":0.56699999999999995},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.315},"max":{"1min":0.90200000000000002,"5min":0.99399999999999999,"15min":2.0600000000000001},"last":0.56100000000000005}]},{"osd":6,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.626,"15min":0.73699999999999999},"min":{"1min":0.498,"5min":0.39200000000000002,"15min":0.317},"max":{"1min":0.86299999999999999,"5min":0.89600000000000002,"15min":36.037999999999997},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.64300000000000002,"15min":0.64900000000000002},"min":{"1min":0.42599999999999999,"5min":0.41299999999999998,"15min":0.36399999999999999},"max":{"1min":0.89900000000000002,"5min":1.028,"15min":6.7110000000000003},"last":0.58299999999999996}]},{"osd":7,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.61899999999999999,"15min":0.627},"min":{"1min":0.44500000000000001,"5min":0.39400000000000002,"15min":0.371},"max":{"1min":0.84199999999999997,"5min":1.054,"15min":6.742},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.60999999999999999,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.39200000000000002,"15min":0.34499999999999997},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":1.917},"last":0.50900000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575035,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303640,"kb_used_data":2256,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068200,"statfs":{"total":96636764160,"available":96325836800,"internally_reserved":0,"allocated":2310144,"data_stored":1070127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.49099999999999999,"15min":0.37},"min":{"1min":0.247,"5min":0.22900000000000001,"15min":0.17999999999999999},"max":{"1min":0.443,"5min":15.228,"15min":15.228},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.433,"15min":0.39700000000000002},"min":{"1min":0.35399999999999998,"5min":0.28599999999999998,"15min":0.20999999999999999},"max":{"1min":0.58899999999999997,"5min":1.714,"15min":1.714},"last":0.59699999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.39700000000000002,"15min":0.379},"min":{"1min":0.35199999999999998,"5min":0.253,"15min":0.19900000000000001},"max":{"1min":0.55300000000000005,"5min":0.56999999999999995,"15min":0.745},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.436,"5min":0.39200000000000002,"15min":0.36599999999999999},"min":{"1min":0.29999999999999999,"5min":0.23200000000000001,"15min":0.216},"max":{"1min":0.52300000000000002,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.56799999999999995}]},{"osd":3,"last update":"Fri Oct 6 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.39500000000000002,"15min":0.373},"min":{"1min":0.35999999999999999,"5min":0.255,"15min":0.23200000000000001},"max":{"1min":0.54300000000000004,"5min":0.621,"15min":0.629},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.438,"5min":0.40699999999999997,"15min":0.377},"min":{"1min":0.33800000000000002,"5min":0.26600000000000001,"15min":0.251},"max":{"1min":0.56100000000000005,"5min":0.754,"15min":0.754},"last":0.495}]},{"osd":4,"last update":"Fri Oct 6 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.58999999999999997,"15min":0.54300000000000004},"min":{"1min":0.52900000000000003,"5min":0.35799999999999998,"15min":0.30299999999999999},"max":{"1min":0.75700000000000001,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.72099999999999997,"15min":0.59899999999999998},"min":{"1min":0.38300000000000001,"5min":0.36499999999999999,"15min":0.27900000000000003},"max":{"1min":0.92400000000000004,"5min":15.26,"15min":15.26},"last":0.80400000000000005}]},{"osd":5,"last update":"Fri Oct 6 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.72999999999999998,"15min":0.60199999999999998},"min":{"1min":0.45000000000000001,"5min":0.38200000000000001,"15min":0.32400000000000001},"max":{"1min":0.874,"5min":15.186,"15min":15.186},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.60099999999999998,"15min":0.56899999999999995},"min":{"1min":0.47399999999999998,"5min":0.40600000000000003,"15min":0.35099999999999998},"max":{"1min":0.78300000000000003,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.66700000000000004}]},{"osd":6,"last update":"Fri Oct 6 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.624,"15min":0.59199999999999997},"min":{"1min":0.5,"5min":0.42599999999999999,"15min":0.32600000000000001},"max":{"1min":0.90400000000000003,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.63100000000000001,"15min":0.58899999999999997},"min":{"1min":0.505,"5min":0.438,"15min":0.34200000000000003},"max":{"1min":0.82099999999999995,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.76200000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.70699999999999996,"15min":0.60899999999999999},"min":{"1min":0.47499999999999998,"5min":0.41099999999999998,"15min":0.34499999999999997},"max":{"1min":0.83599999999999997,"5min":10.977,"15min":10.977},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.60699999999999998,"15min":0.57899999999999996},"min":{"1min":0.53700000000000003,"5min":0.39600000000000002,"15min":0.38200000000000001},"max":{"1min":0.75,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.83899999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575035,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311832,"kb_used_data":2256,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060008,"statfs":{"total":96636764160,"available":96317448192,"internally_reserved":0,"allocated":2310144,"data_stored":1070127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.375,"15min":0.33300000000000002},"min":{"1min":0.25900000000000001,"5min":0.19500000000000001,"15min":0.18099999999999999},"max":{"1min":0.58399999999999996,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.442,"15min":0.39100000000000001},"min":{"1min":0.36499999999999999,"5min":0.23000000000000001,"15min":0.22700000000000001},"max":{"1min":0.60899999999999999,"5min":4.4820000000000002,"15min":4.4820000000000002},"last":0.40799999999999997}]},{"osd":1,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.34300000000000003,"15min":0.32300000000000001},"min":{"1min":0.308,"5min":0.22800000000000001,"15min":0.21299999999999999},"max":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.65400000000000003},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.38200000000000001,"15min":0.36099999999999999},"min":{"1min":0.34100000000000003,"5min":0.251,"15min":0.188},"max":{"1min":0.52600000000000002,"5min":0.54100000000000004,"15min":1.196},"last":0.46400000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.41799999999999998,"15min":0.38},"min":{"1min":0.32900000000000001,"5min":0.23400000000000001,"15min":0.19600000000000001},"max":{"1min":0.56499999999999995,"5min":4.601,"15min":4.601},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.5,"5min":0.46600000000000003,"15min":0.42399999999999999},"min":{"1min":0.38800000000000001,"5min":0.28499999999999998,"15min":0.26100000000000001},"max":{"1min":0.66600000000000004,"5min":2.6059999999999999,"15min":2.6059999999999999},"last":0.54900000000000004}]},{"osd":4,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57999999999999996,"15min":0.54800000000000004},"min":{"1min":0.46300000000000002,"5min":0.378,"15min":0.311},"max":{"1min":0.79700000000000004,"5min":0.84099999999999997,"15min":1.694},"last":0.505},{"interface":"front","average":{"1min":0.629,"5min":0.58699999999999997,"15min":0.55000000000000004},"min":{"1min":0.40899999999999997,"5min":0.32600000000000001,"15min":0.30199999999999999},"max":{"1min":0.82299999999999995,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.52100000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.57899999999999996,"15min":0.55200000000000005},"min":{"1min":0.46899999999999997,"5min":0.34100000000000003,"15min":0.29399999999999998},"max":{"1min":0.77500000000000002,"5min":0.83999999999999997,"15min":0.878},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.58899999999999997,"15min":0.56200000000000006},"min":{"1min":0.45900000000000002,"5min":0.35699999999999998,"15min":0.29699999999999999},"max":{"1min":0.80800000000000005,"5min":0.91000000000000003,"15min":1.165},"last":0.59699999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.622,"15min":0.58699999999999997},"min":{"1min":0.496,"5min":0.42499999999999999,"15min":0.36699999999999999},"max":{"1min":0.84099999999999997,"5min":0.95399999999999996,"15min":1.1359999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.625,"15min":0.59299999999999997},"min":{"1min":0.49199999999999999,"5min":0.36799999999999999,"15min":0.34399999999999997},"max":{"1min":0.80500000000000005,"5min":1.012,"15min":1.7470000000000001},"last":0.622}]},{"osd":7,"last update":"Fri Oct 6 11:20:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.60899999999999999,"15min":0.57999999999999996},"min":{"1min":0.51200000000000001,"5min":0.39600000000000002,"15min":0.35599999999999998},"max":{"1min":0.83499999999999996,"5min":0.89900000000000002,"15min":1.657},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.61099999999999999,"15min":0.58399999999999996},"min":{"1min":0.53500000000000003,"5min":0.40400000000000003,"15min":0.35499999999999998},"max":{"1min":0.86699999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.65700000000000003}]}]},{"osd":4,"up_from":13,"seq":55834575034,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307740,"kb_used_data":2260,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064100,"statfs":{"total":96636764160,"available":96321638400,"internally_reserved":0,"allocated":2314240,"data_stored":1071480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:20:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.50600000000000001,"15min":0.49399999999999999},"min":{"1min":0.39000000000000001,"5min":0.24199999999999999,"15min":0.19500000000000001},"max":{"1min":0.67500000000000004,"5min":0.76800000000000002,"15min":2.6619999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.52800000000000002,"15min":0.498},"min":{"1min":0.33900000000000002,"5min":0.28899999999999998,"15min":0.215},"max":{"1min":0.65400000000000003,"5min":0.81499999999999995,"15min":0.91200000000000003},"last":0.52400000000000002}]},{"osd":1,"last update":"Fri Oct 6 11:20:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52400000000000002,"15min":0.51300000000000001},"min":{"1min":0.35099999999999998,"5min":0.27600000000000002,"15min":0.23300000000000001},"max":{"1min":0.68000000000000005,"5min":0.94099999999999995,"15min":2.8650000000000002},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53200000000000003,"15min":0.52200000000000002},"min":{"1min":0.42599999999999999,"5min":0.27000000000000002,"15min":0.25800000000000001},"max":{"1min":0.63600000000000001,"5min":0.79800000000000004,"15min":2.7610000000000001},"last":0.48199999999999998}]},{"osd":2,"last update":"Fri Oct 6 11:20:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55800000000000005,"15min":0.52600000000000002},"min":{"1min":0.32500000000000001,"5min":0.312,"15min":0.23100000000000001},"max":{"1min":0.72399999999999998,"5min":0.88800000000000001,"15min":1.6910000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58899999999999997,"15min":0.57199999999999995},"min":{"1min":0.40200000000000002,"5min":0.38700000000000001,"15min":0.30599999999999999},"max":{"1min":0.73399999999999999,"5min":0.84999999999999998,"15min":1.718},"last":0.45000000000000001}]},{"osd":3,"last update":"Fri Oct 6 11:20:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56100000000000005,"15min":0.56399999999999995},"min":{"1min":0.46500000000000002,"5min":0.36699999999999999,"15min":0.26700000000000002},"max":{"1min":0.71799999999999997,"5min":0.79600000000000004,"15min":2.677},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56499999999999995,"15min":0.53500000000000003},"min":{"1min":0.435,"5min":0.35599999999999998,"15min":0.27500000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":1.784},"last":0.41099999999999998}]},{"osd":5,"last update":"Fri Oct 6 11:20:02 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.48999999999999999,"15min":0.47699999999999998},"min":{"1min":0.34200000000000003,"5min":0.33700000000000002,"15min":0.23200000000000001},"max":{"1min":0.72899999999999998,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.374},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.54700000000000004,"15min":0.52200000000000002},"min":{"1min":0.378,"5min":0.29099999999999998,"15min":0.28399999999999997},"max":{"1min":0.76700000000000002,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.46300000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:20:02 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.54700000000000004,"15min":0.52100000000000002},"min":{"1min":0.36499999999999999,"5min":0.30199999999999999,"15min":0.252},"max":{"1min":0.86799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.497},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.56299999999999994,"15min":0.54900000000000004},"min":{"1min":0.40600000000000003,"5min":0.38700000000000001,"15min":0.29199999999999998},"max":{"1min":0.79400000000000004,"5min":0.90400000000000003,"15min":1.165},"last":0.42299999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:20:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57699999999999996,"15min":0.56100000000000005},"min":{"1min":0.438,"5min":0.312,"15min":0.312},"max":{"1min":0.80600000000000005,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.60899999999999999,"15min":0.58699999999999997},"min":{"1min":0.38500000000000001,"5min":0.34399999999999997,"15min":0.317},"max":{"1min":0.89600000000000002,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.60399999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575036,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299548,"kb_used_data":2260,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072292,"statfs":{"total":96636764160,"available":96330027008,"internally_reserved":0,"allocated":2314240,"data_stored":1071480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52000000000000002,"15min":0.53100000000000003},"min":{"1min":0.29299999999999998,"5min":0.26000000000000001,"15min":0.20499999999999999},"max":{"1min":0.72699999999999998,"5min":0.752,"15min":5.0490000000000004},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.51800000000000002,"15min":0.51500000000000001},"min":{"1min":0.34599999999999997,"5min":0.26600000000000001,"15min":0.22900000000000001},"max":{"1min":0.69399999999999995,"5min":0.75,"15min":5.1449999999999996},"last":0.59099999999999997}]},{"osd":1,"last update":"Fri Oct 6 11:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.52600000000000002,"15min":0.49199999999999999},"min":{"1min":0.35999999999999999,"5min":0.27800000000000002,"15min":0.25},"max":{"1min":0.70299999999999996,"5min":0.76400000000000001,"15min":0.97199999999999998},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54300000000000004,"15min":0.51400000000000001},"min":{"1min":0.33500000000000002,"5min":0.29799999999999999,"15min":0.27400000000000002},"max":{"1min":0.74199999999999999,"5min":0.752,"15min":1.8799999999999999},"last":0.61399999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56799999999999995,"15min":0.55200000000000005},"min":{"1min":0.36499999999999999,"5min":0.313,"15min":0.28299999999999997},"max":{"1min":0.755,"5min":0.80700000000000005,"15min":4.234},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.59699999999999998,"15min":0.56299999999999994},"min":{"1min":0.438,"5min":0.35899999999999999,"15min":0.315},"max":{"1min":0.753,"5min":0.82099999999999995,"15min":1.0369999999999999},"last":0.60399999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52900000000000003,"15min":0.54200000000000004},"min":{"1min":0.34499999999999997,"5min":0.29499999999999998,"15min":0.27700000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":5.2169999999999996},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.55900000000000005,"15min":0.54000000000000004},"min":{"1min":0.372,"5min":0.32400000000000001,"15min":0.29699999999999999},"max":{"1min":0.72899999999999998,"5min":0.76000000000000001,"15min":1.008},"last":0.57899999999999996}]},{"osd":4,"last update":"Fri Oct 6 11:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.49099999999999999,"15min":0.49399999999999999},"min":{"1min":0.28699999999999998,"5min":0.26400000000000001,"15min":0.23999999999999999},"max":{"1min":0.52600000000000002,"5min":0.78000000000000003,"15min":1.917},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.50600000000000001,"15min":0.504},"min":{"1min":0.33300000000000002,"5min":0.251,"15min":0.23899999999999999},"max":{"1min":0.58299999999999996,"5min":0.77600000000000002,"15min":0.87},"last":0.41099999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.52500000000000002,"15min":0.53000000000000003},"min":{"1min":0.372,"5min":0.32700000000000001,"15min":0.27600000000000002},"max":{"1min":0.55700000000000005,"5min":0.78800000000000003,"15min":2.0139999999999998},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.59499999999999997,"15min":0.58799999999999997},"min":{"1min":0.35599999999999998,"5min":0.30299999999999999,"15min":0.29999999999999999},"max":{"1min":0.79100000000000004,"5min":0.85099999999999998,"15min":1.9470000000000001},"last":0.56899999999999995}]},{"osd":7,"last update":"Fri Oct 6 11:20:04 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.55000000000000004,"15min":0.55200000000000005},"min":{"1min":0.32900000000000001,"5min":0.311,"15min":0.27700000000000002},"max":{"1min":0.73699999999999999,"5min":0.79700000000000004,"15min":0.96499999999999997},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.58999999999999997,"15min":0.58599999999999997},"min":{"1min":0.39700000000000002,"5min":0.29199999999999998,"15min":0.28799999999999998},"max":{"1min":0.70299999999999996,"5min":0.81399999999999995,"15min":1.4119999999999999},"last":0.439}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:20:56.890 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-06T11:05:37.304522+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=5, tm_sec=37, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=11, tm_min=20, tm_sec=31, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T11:20:56.890 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-06T11:21:16.891 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T11:21:17.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.019+0000 7f0c64a9e700 1 Processor -- start 2023-10-06T11:21:17.021 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.019+0000 7f0c64a9e700 1 -- start start 2023-10-06T11:21:17.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.020+0000 7f0c64a9e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0c6013ff80 0x7f0c6006ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:21:17.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.020+0000 7f0c64a9e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0c6006f280 0x7f0c60159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:21:17.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.020+0000 7f0c64a9e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c600caa40 con 0x7f0c6013fbb0 2023-10-06T11:21:17.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.020+0000 7f0c64a9e700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c6006f6d0 con 0x7f0c6006f280 2023-10-06T11:21:17.023 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.020+0000 7f0c64a9e700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c600c6f10 con 0x7f0c6013ff80 2023-10-06T11:21:17.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.020+0000 7f0c5ed9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0c6006f280 0x7f0c60159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:21:17.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.020+0000 7f0c5ed9d700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f0c6006f280 0x7f0c60159fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33430/0 (socket says 172.21.15.146:33430) 2023-10-06T11:21:17.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.020+0000 7f0c5ed9d700 1 -- 172.21.15.146:0/477698638 learned_addr learned my addr 172.21.15.146:0/477698638 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:21:17.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.020+0000 7f0c5dd9b700 1 --2- 172.21.15.146:0/477698638 >> v2:172.21.15.151:3300/0 conn(0x7f0c6013ff80 0x7f0c6006ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:21:17.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.020+0000 7f0c5ed9d700 1 -- 172.21.15.146:0/477698638 >> v2:172.21.15.151:3300/0 conn(0x7f0c6013ff80 msgr2=0x7f0c6006ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:21:17.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.020+0000 7f0c5ed9d700 1 --2- 172.21.15.146:0/477698638 >> v2:172.21.15.151:3300/0 conn(0x7f0c6013ff80 0x7f0c6006ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:21:17.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.020+0000 7f0c5ed9d700 1 -- 172.21.15.146:0/477698638 >> v1:172.21.15.151:6789/0 conn(0x7f0c6013fbb0 legacy=0x7f0c600c6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:21:17.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.020+0000 7f0c5ed9d700 1 -- 172.21.15.146:0/477698638 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c6015adc0 con 0x7f0c6006f280 2023-10-06T11:21:17.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.020+0000 7f0c5ed9d700 1 --2- 172.21.15.146:0/477698638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c6006f280 0x7f0c60159fc0 secure :-1 s=READY pgs=2439 cs=0 l=1 rev1=1 crypto rx=0x7f0c6006b720 tx=0x7f0c58009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35fd806853fd5263 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:21:17.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.021+0000 7f0c5d59a700 1 -- 172.21.15.146:0/477698638 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5800e070 con 0x7f0c6006f280 2023-10-06T11:21:17.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.021+0000 7f0c5d59a700 1 -- 172.21.15.146:0/477698638 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c5800ba50 con 0x7f0c6006f280 2023-10-06T11:21:17.024 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.021+0000 7f0c5d59a700 1 -- 172.21.15.146:0/477698638 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c580092e0 con 0x7f0c6006f280 2023-10-06T11:21:17.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.021+0000 7f0c64a9e700 1 -- 172.21.15.146:0/477698638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c6006f280 msgr2=0x7f0c60159fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:21:17.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.021+0000 7f0c64a9e700 1 --2- 172.21.15.146:0/477698638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c6006f280 0x7f0c60159fc0 secure :-1 s=READY pgs=2439 cs=0 l=1 rev1=1 crypto rx=0x7f0c6006b720 tx=0x7f0c58009840 comp rx=0 tx=0).stop 2023-10-06T11:21:17.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.021+0000 7f0c64a9e700 1 -- 172.21.15.146:0/477698638 shutdown_connections 2023-10-06T11:21:17.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.021+0000 7f0c64a9e700 1 --2- 172.21.15.146:0/477698638 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c6006f280 0x7f0c60159fc0 unknown :-1 s=CLOSED pgs=2439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:21:17.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.021+0000 7f0c64a9e700 1 --2- 172.21.15.146:0/477698638 >> v2:172.21.15.151:3300/0 conn(0x7f0c6013ff80 0x7f0c6006ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:21:17.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.021+0000 7f0c64a9e700 1 -- 172.21.15.146:0/477698638 >> 172.21.15.146:0/477698638 conn(0x7f0c600cc1c0 msgr2=0x7f0c600cc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:21:17.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.021+0000 7f0c64a9e700 1 -- 172.21.15.146:0/477698638 shutdown_connections 2023-10-06T11:21:17.025 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.021+0000 7f0c64a9e700 1 -- 172.21.15.146:0/477698638 wait complete. 2023-10-06T11:21:17.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.023+0000 7f0c64a9e700 1 Processor -- start 2023-10-06T11:21:17.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.023+0000 7f0c64a9e700 1 -- start start 2023-10-06T11:21:17.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.023+0000 7f0c64a9e700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c6006f280 0x7f0c600b0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:21:17.028 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.023+0000 7f0c64a9e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c6013fbb0 0x7f0c60069ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:21:17.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.023+0000 7f0c64a9e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c6013ff80 0x7f0c6006a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:21:17.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.023+0000 7f0c64a9e700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c600af920 con 0x7f0c6013fbb0 2023-10-06T11:21:17.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.023+0000 7f0c64a9e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c600afb10 con 0x7f0c6013ff80 2023-10-06T11:21:17.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.023+0000 7f0c64a9e700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c600afdf0 con 0x7f0c6006f280 2023-10-06T11:21:17.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.023+0000 7f0c5dd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c6013fbb0 0x7f0c60069ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:21:17.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.023+0000 7f0c5dd9b700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c6013fbb0 0x7f0c60069ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33444/0 (socket says 172.21.15.146:33444) 2023-10-06T11:21:17.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.023+0000 7f0c5dd9b700 1 -- 172.21.15.146:0/1598772830 learned_addr learned my addr 172.21.15.146:0/1598772830 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:21:17.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.024+0000 7f0c5ed9d700 1 --2- 172.21.15.146:0/1598772830 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c6013ff80 0x7f0c6006a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:21:17.029 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.024+0000 7f0c5e59c700 1 --2- 172.21.15.146:0/1598772830 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c6006f280 0x7f0c600b0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:21:17.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.024+0000 7f0c5dd9b700 1 -- 172.21.15.146:0/1598772830 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c6006f280 msgr2=0x7f0c600b0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:21:17.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.024+0000 7f0c5dd9b700 1 --2- 172.21.15.146:0/1598772830 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c6006f280 0x7f0c600b0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:21:17.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.024+0000 7f0c5dd9b700 1 -- 172.21.15.146:0/1598772830 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c6013ff80 msgr2=0x7f0c6006a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:21:17.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.024+0000 7f0c5dd9b700 1 --2- 172.21.15.146:0/1598772830 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c6013ff80 0x7f0c6006a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:21:17.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.024+0000 7f0c5dd9b700 1 -- 172.21.15.146:0/1598772830 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c58009ae0 con 0x7f0c6013fbb0 2023-10-06T11:21:17.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.024+0000 7f0c5ed9d700 1 --2- 172.21.15.146:0/1598772830 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c6013ff80 0x7f0c6006a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T11:21:17.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.024+0000 7f0c5dd9b700 1 --2- 172.21.15.146:0/1598772830 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c6013fbb0 0x7f0c60069ce0 secure :-1 s=READY pgs=2440 cs=0 l=1 rev1=1 crypto rx=0x7f0c5400d7e0 tx=0x7f0c54008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:21:17.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.024+0000 7f0c4e7fc700 1 -- 172.21.15.146:0/1598772830 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c540125f0 con 0x7f0c6013fbb0 2023-10-06T11:21:17.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.024+0000 7f0c4e7fc700 1 -- 172.21.15.146:0/1598772830 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c54012750 con 0x7f0c6013fbb0 2023-10-06T11:21:17.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.024+0000 7f0c4e7fc700 1 -- 172.21.15.146:0/1598772830 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c54012b10 con 0x7f0c6013fbb0 2023-10-06T11:21:17.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.024+0000 7f0c64a9e700 1 -- 172.21.15.146:0/1598772830 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c601591a0 con 0x7f0c6013fbb0 2023-10-06T11:21:17.030 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.024+0000 7f0c64a9e700 1 -- 172.21.15.146:0/1598772830 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c60158e90 con 0x7f0c6013fbb0 2023-10-06T11:21:17.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.025+0000 7f0c64a9e700 1 -- 172.21.15.146:0/1598772830 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c601596c0 con 0x7f0c6013fbb0 2023-10-06T11:21:17.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.025+0000 7f0c4e7fc700 1 -- 172.21.15.146:0/1598772830 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0c5401e460 con 0x7f0c6013fbb0 2023-10-06T11:21:17.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.026+0000 7f0c4e7fc700 1 --2- 172.21.15.146:0/1598772830 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0c40066f30 0x7f0c400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:21:17.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.026+0000 7f0c4e7fc700 1 -- 172.21.15.146:0/1598772830 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f0c54084a50 con 0x7f0c6013fbb0 2023-10-06T11:21:17.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.026+0000 7f0c5e59c700 1 --2- 172.21.15.146:0/1598772830 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0c40066f30 0x7f0c400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:21:17.031 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.026+0000 7f0c5e59c700 1 --2- 172.21.15.146:0/1598772830 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0c40066f30 0x7f0c400693e0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f0c60158c80 tx=0x7f0c50009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:21:17.032 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.030+0000 7f0c4e7fc700 1 -- 172.21.15.146:0/1598772830 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0c601596c0 con 0x7f0c6013fbb0 2023-10-06T11:21:17.210 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.208+0000 7f0c64a9e700 1 -- 172.21.15.146:0/1598772830 --> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0c601596c0 con 0x7f0c40066f30 2023-10-06T11:21:17.213 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.211+0000 7f0c4e7fc700 1 -- 172.21.15.146:0/1598772830 <== mgr.4107 v2:172.21.15.146:6832/90434 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+73097 (secure 0 0 0) 0x7f0c601596c0 con 0x7f0c40066f30 2023-10-06T11:21:17.214 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:21:17.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.213+0000 7f0c64a9e700 1 -- 172.21.15.146:0/1598772830 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0c40066f30 msgr2=0x7f0c400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:21:17.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.213+0000 7f0c64a9e700 1 --2- 172.21.15.146:0/1598772830 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0c40066f30 0x7f0c400693e0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f0c60158c80 tx=0x7f0c50009040 comp rx=0 tx=0).stop 2023-10-06T11:21:17.215 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.213+0000 7f0c64a9e700 1 -- 172.21.15.146:0/1598772830 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c6013fbb0 msgr2=0x7f0c60069ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:21:17.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.213+0000 7f0c64a9e700 1 --2- 172.21.15.146:0/1598772830 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c6013fbb0 0x7f0c60069ce0 secure :-1 s=READY pgs=2440 cs=0 l=1 rev1=1 crypto rx=0x7f0c5400d7e0 tx=0x7f0c54008040 comp rx=0 tx=0).stop 2023-10-06T11:21:17.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.213+0000 7f0c64a9e700 1 -- 172.21.15.146:0/1598772830 shutdown_connections 2023-10-06T11:21:17.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.213+0000 7f0c64a9e700 1 --2- 172.21.15.146:0/1598772830 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f0c40066f30 0x7f0c400693e0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:21:17.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.213+0000 7f0c64a9e700 1 --2- 172.21.15.146:0/1598772830 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c6013ff80 0x7f0c6006a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:21:17.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.213+0000 7f0c64a9e700 1 --2- 172.21.15.146:0/1598772830 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0c6006f280 0x7f0c600b0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:21:17.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.213+0000 7f0c64a9e700 1 --2- 172.21.15.146:0/1598772830 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f0c6013fbb0 0x7f0c60069ce0 unknown :-1 s=CLOSED pgs=2440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:21:17.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.213+0000 7f0c64a9e700 1 -- 172.21.15.146:0/1598772830 >> 172.21.15.146:0/1598772830 conn(0x7f0c600cc1c0 msgr2=0x7f0c600c0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:21:17.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.213+0000 7f0c64a9e700 1 -- 172.21.15.146:0/1598772830 shutdown_connections 2023-10-06T11:21:17.216 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.213+0000 7f0c64a9e700 1 -- 172.21.15.146:0/1598772830 wait complete. 2023-10-06T11:21:17.217 INFO:teuthology.orchestra.run.smithi146.stderr:dumped all 2023-10-06T11:21:17.227 INFO:teuthology.orchestra.run.smithi146.stdout:{"pg_ready":true,"pg_map":{"version":645,"stamp":"2023-10-06T11:21:15.345767+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2430296,"kb_used_data":19224,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752544424,"statfs":{"total":773094113280,"available":770605490176,"internally_reserved":0,"allocated":19685376,"data_stored":9747164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002651"},"pg_stats":[{"pgid":"1.5","version":"0'0","reported_seq":173,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-10-06T11:20:38.202509+0000","last_change":"2023-10-06T11:20:38.202479+0000","last_active":"2023-10-06T11:20:38.202509+0000","last_peered":"2023-10-06T11:20:38.202509+0000","last_clean":"2023-10-06T11:20:38.202509+0000","last_became_active":"2023-10-06T11:05:38.456426+0000","last_became_peered":"2023-10-06T11:05:38.456426+0000","last_unstale":"2023-10-06T11:20:38.202509+0000","last_undegraded":"2023-10-06T11:20:38.202509+0000","last_fullsized":"2023-10-06T11:20:38.202509+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:20:38.202342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:20:38.202342+0000","last_clean_scrub_stamp":"2023-10-06T11:20:38.202342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:01:40.082036+0000","scrub_duration":0.0095400060000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":164,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-10-06T11:20:38.832169+0000","last_change":"2023-10-06T11:20:38.832138+0000","last_active":"2023-10-06T11:20:38.832169+0000","last_peered":"2023-10-06T11:20:38.832169+0000","last_clean":"2023-10-06T11:20:38.832169+0000","last_became_active":"2023-10-06T11:05:38.322617+0000","last_became_peered":"2023-10-06T11:05:38.322617+0000","last_unstale":"2023-10-06T11:20:38.832169+0000","last_undegraded":"2023-10-06T11:20:38.832169+0000","last_fullsized":"2023-10-06T11:20:38.832169+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:20:38.831999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:20:38.831999+0000","last_clean_scrub_stamp":"2023-10-06T11:20:38.831999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:31:15.486256+0000","scrub_duration":0.010006595,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":161,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-10-06T11:20:35.358707+0000","last_change":"2023-10-06T11:20:35.358663+0000","last_active":"2023-10-06T11:20:35.358707+0000","last_peered":"2023-10-06T11:20:35.358707+0000","last_clean":"2023-10-06T11:20:35.358707+0000","last_became_active":"2023-10-06T11:05:38.323610+0000","last_became_peered":"2023-10-06T11:05:38.323610+0000","last_unstale":"2023-10-06T11:20:35.358707+0000","last_undegraded":"2023-10-06T11:20:35.358707+0000","last_fullsized":"2023-10-06T11:20:35.358707+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:20:35.358563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:20:35.358563+0000","last_clean_scrub_stamp":"2023-10-06T11:20:35.358563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:26:48.914387+0000","scrub_duration":0.0068210679999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"183'119","reported_seq":307,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-10-06T11:20:53.229274+0000","last_change":"2023-10-06T11:20:53.229244+0000","last_active":"2023-10-06T11:20:53.229274+0000","last_peered":"2023-10-06T11:20:53.229274+0000","last_clean":"2023-10-06T11:20:53.229274+0000","last_became_active":"2023-10-06T11:05:38.324968+0000","last_became_peered":"2023-10-06T11:05:38.324968+0000","last_unstale":"2023-10-06T11:20:53.229274+0000","last_undegraded":"2023-10-06T11:20:53.229274+0000","last_fullsized":"2023-10-06T11:20:53.229274+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"183'119","last_scrub_stamp":"2023-10-06T11:20:53.229133+0000","last_deep_scrub":"183'119","last_deep_scrub_stamp":"2023-10-06T11:20:53.229133+0000","last_clean_scrub_stamp":"2023-10-06T11:20:53.229133+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:22:11.435847+0000","scrub_duration":0.012740712,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":155,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-10-06T11:20:51.258182+0000","last_change":"2023-10-06T11:20:51.258147+0000","last_active":"2023-10-06T11:20:51.258182+0000","last_peered":"2023-10-06T11:20:51.258182+0000","last_clean":"2023-10-06T11:20:51.258182+0000","last_became_active":"2023-10-06T11:05:38.419579+0000","last_became_peered":"2023-10-06T11:05:38.419579+0000","last_unstale":"2023-10-06T11:20:51.258182+0000","last_undegraded":"2023-10-06T11:20:51.258182+0000","last_fullsized":"2023-10-06T11:20:51.258182+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:20:51.258033+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:20:51.258033+0000","last_clean_scrub_stamp":"2023-10-06T11:20:51.258033+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T18:28:29.316460+0000","scrub_duration":0.0061420479999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":155,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-10-06T11:20:48.284111+0000","last_change":"2023-10-06T11:20:48.284080+0000","last_active":"2023-10-06T11:20:48.284111+0000","last_peered":"2023-10-06T11:20:48.284111+0000","last_clean":"2023-10-06T11:20:48.284111+0000","last_became_active":"2023-10-06T11:05:38.416842+0000","last_became_peered":"2023-10-06T11:05:38.416842+0000","last_unstale":"2023-10-06T11:20:48.284111+0000","last_undegraded":"2023-10-06T11:20:48.284111+0000","last_fullsized":"2023-10-06T11:20:48.284111+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:20:48.283956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:20:48.283956+0000","last_clean_scrub_stamp":"2023-10-06T11:20:48.283956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T20:08:43.104259+0000","scrub_duration":0.0038529250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":181,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-10-06T11:20:37.245389+0000","last_change":"2023-10-06T11:20:37.245352+0000","last_active":"2023-10-06T11:20:37.245389+0000","last_peered":"2023-10-06T11:20:37.245389+0000","last_clean":"2023-10-06T11:20:37.245389+0000","last_became_active":"2023-10-06T11:05:38.416928+0000","last_became_peered":"2023-10-06T11:05:38.416928+0000","last_unstale":"2023-10-06T11:20:37.245389+0000","last_undegraded":"2023-10-06T11:20:37.245389+0000","last_fullsized":"2023-10-06T11:20:37.245389+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:20:37.245241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:20:37.245241+0000","last_clean_scrub_stamp":"2023-10-06T11:20:37.245241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T19:03:13.359358+0000","scrub_duration":0.0092457430000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":162,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-10-06T11:20:38.749641+0000","last_change":"2023-10-06T11:20:38.749604+0000","last_active":"2023-10-06T11:20:38.749641+0000","last_peered":"2023-10-06T11:20:38.749641+0000","last_clean":"2023-10-06T11:20:38.749641+0000","last_became_active":"2023-10-06T11:05:38.419792+0000","last_became_peered":"2023-10-06T11:05:38.419792+0000","last_unstale":"2023-10-06T11:20:38.749641+0000","last_undegraded":"2023-10-06T11:20:38.749641+0000","last_fullsized":"2023-10-06T11:20:38.749641+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:20:38.749482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:20:38.749482+0000","last_clean_scrub_stamp":"2023-10-06T11:20:38.749482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T17:52:39.877958+0000","scrub_duration":0.0083712630000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":162,"reported_epoch":183,"state":"active+clean","last_fresh":"2023-10-06T11:20:39.782936+0000","last_change":"2023-10-06T11:20:39.782892+0000","last_active":"2023-10-06T11:20:39.782936+0000","last_peered":"2023-10-06T11:20:39.782936+0000","last_clean":"2023-10-06T11:20:39.782936+0000","last_became_active":"2023-10-06T11:05:38.321548+0000","last_became_peered":"2023-10-06T11:05:38.321548+0000","last_unstale":"2023-10-06T11:20:39.782936+0000","last_undegraded":"2023-10-06T11:20:39.782936+0000","last_fullsized":"2023-10-06T11:20:39.782936+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T11:20:39.782763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T11:20:39.782763+0000","last_clean_scrub_stamp":"2023-10-06T11:20:39.782763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T15:32:59.229319+0000","scrub_duration":0.010483408,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575038,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304224,"kb_used_data":2840,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067616,"statfs":{"total":96636764160,"available":96325238784,"internally_reserved":0,"allocated":2908160,"data_stored":1661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.51800000000000002,"15min":0.63600000000000001},"min":{"1min":0.317,"5min":0.27200000000000002,"15min":0.21199999999999999},"max":{"1min":0.748,"5min":0.748,"15min":23.908999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55400000000000005,"15min":0.58099999999999996},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.22500000000000001},"max":{"1min":0.72299999999999998,"5min":0.98799999999999999,"15min":9.3230000000000004},"last":0.54800000000000004}]},{"osd":1,"last update":"Fri Oct 6 11:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.54100000000000004,"15min":0.56100000000000005},"min":{"1min":0.438,"5min":0.28799999999999998,"15min":0.26000000000000001},"max":{"1min":0.747,"5min":1.0309999999999999,"15min":9.2360000000000007},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52600000000000002,"15min":0.51000000000000001},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.25900000000000001},"max":{"1min":0.75900000000000001,"5min":0.79700000000000004,"15min":4.327},"last":0.56200000000000006}]},{"osd":2,"last update":"Fri Oct 6 11:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.53600000000000003,"15min":0.52600000000000002},"min":{"1min":0.40799999999999997,"5min":0.313,"15min":0.26500000000000001},"max":{"1min":0.748,"5min":0.748,"15min":4.3120000000000003},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56699999999999995,"15min":0.56599999999999995},"min":{"1min":0.36899999999999999,"5min":0.34799999999999998,"15min":0.29999999999999999},"max":{"1min":0.75700000000000001,"5min":1.109,"15min":4.7309999999999999},"last":0.58899999999999997}]},{"osd":3,"last update":"Fri Oct 6 11:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.55800000000000005,"15min":0.56000000000000005},"min":{"1min":0.36399999999999999,"5min":0.35299999999999998,"15min":0.27900000000000003},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":4.5190000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58699999999999997,"15min":0.60699999999999998},"min":{"1min":0.46000000000000002,"5min":0.42699999999999999,"15min":0.29699999999999999},"max":{"1min":0.79300000000000004,"5min":1.0740000000000001,"15min":9.3879999999999999},"last":0.65300000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47799999999999998,"15min":0.497},"min":{"1min":0.31900000000000001,"5min":0.26300000000000001,"15min":0.24399999999999999},"max":{"1min":0.61399999999999999,"5min":1.4970000000000001,"15min":4.6639999999999997},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.50800000000000001,"15min":0.53000000000000003},"min":{"1min":0.35299999999999998,"5min":0.34599999999999997,"15min":0.27300000000000002},"max":{"1min":0.78700000000000003,"5min":0.82199999999999995,"15min":4.3689999999999998},"last":0.48699999999999999}]},{"osd":5,"last update":"Fri Oct 6 11:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52200000000000002,"15min":0.55100000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.26000000000000001},"max":{"1min":0.82299999999999995,"5min":1.1399999999999999,"15min":9.3499999999999996},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.40999999999999998,"5min":0.36199999999999999,"15min":0.26800000000000002},"max":{"1min":0.66100000000000003,"5min":1.4239999999999999,"15min":4.444},"last":0.53300000000000003}]},{"osd":6,"last update":"Fri Oct 6 11:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56200000000000006,"15min":0.58599999999999997},"min":{"1min":0.45100000000000001,"5min":0.32400000000000001,"15min":0.29199999999999998},"max":{"1min":0.72099999999999997,"5min":1.3779999999999999,"15min":9.4969999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.58699999999999997,"15min":0.61599999999999999},"min":{"1min":0.46000000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.81299999999999994,"5min":0.85799999999999998,"15min":7.2039999999999997},"last":0.66500000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575040,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299544,"kb_used_data":2256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072296,"statfs":{"total":96636764160,"available":96330031104,"internally_reserved":0,"allocated":2310144,"data_stored":1070127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.56000000000000005,"15min":0.53800000000000003},"min":{"1min":0.35399999999999998,"5min":0.218,"15min":0.187},"max":{"1min":1.073,"5min":1.488,"15min":9.5549999999999997},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.64600000000000002,"15min":0.59999999999999998},"min":{"1min":0.47099999999999997,"5min":0.29699999999999999,"15min":0.254},"max":{"1min":1.054,"5min":4.9930000000000003,"15min":9.4659999999999993},"last":0.55200000000000005}]},{"osd":1,"last update":"Fri Oct 6 11:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.56899999999999995,"15min":0.504},"min":{"1min":0.33100000000000002,"5min":0.23699999999999999,"15min":0.23300000000000001},"max":{"1min":4.0449999999999999,"5min":4.0449999999999999,"15min":4.0449999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.76600000000000001,"15min":0.60099999999999998},"min":{"1min":0.34499999999999997,"5min":0.25800000000000001,"15min":0.216},"max":{"1min":1.018,"5min":21.306000000000001,"15min":21.306000000000001},"last":0.46100000000000002}]},{"osd":2,"last update":"Fri Oct 6 11:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.56499999999999995,"15min":0.52600000000000002},"min":{"1min":0.36199999999999999,"5min":0.30199999999999999,"15min":0.252},"max":{"1min":1.04,"5min":2.8250000000000002,"15min":7.0659999999999998},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.71999999999999997,"15min":0.58699999999999997},"min":{"1min":0.44,"5min":0.27800000000000002,"15min":0.26600000000000001},"max":{"1min":0.998,"5min":17.216000000000001,"15min":17.216000000000001},"last":0.439}]},{"osd":3,"last update":"Fri Oct 6 11:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.60399999999999998,"15min":0.55400000000000005},"min":{"1min":0.41399999999999998,"5min":0.29999999999999999,"15min":0.25800000000000001},"max":{"1min":1.085,"5min":4.9400000000000004,"15min":4.9400000000000004},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.70099999999999996,"15min":0.58399999999999996},"min":{"1min":0.33600000000000002,"5min":0.308,"15min":0.308},"max":{"1min":1.0049999999999999,"5min":12.159000000000001,"15min":12.159000000000001},"last":0.59199999999999997}]},{"osd":4,"last update":"Fri Oct 6 11:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.49199999999999999,"15min":0.47299999999999998},"min":{"1min":0.372,"5min":0.31,"15min":0.24299999999999999},"max":{"1min":0.57899999999999996,"5min":1.669,"15min":1.669},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.57499999999999996,"15min":0.53400000000000003},"min":{"1min":0.33200000000000002,"5min":0.32900000000000001,"15min":0.27900000000000003},"max":{"1min":0.72499999999999998,"5min":4.8949999999999996,"15min":4.8949999999999996},"last":0.39800000000000002}]},{"osd":5,"last update":"Fri Oct 6 11:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.53200000000000003,"15min":0.51400000000000001},"min":{"1min":0.36499999999999999,"5min":0.29799999999999999,"15min":0.28399999999999997},"max":{"1min":0.64000000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":0.498},{"interface":"front","average":{"1min":0.505,"5min":0.60699999999999998,"15min":0.58499999999999996},"min":{"1min":0.39700000000000002,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.65300000000000002,"5min":4.7080000000000002,"15min":7.1379999999999999},"last":0.48399999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:21:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.63100000000000001,"15min":0.58399999999999996},"min":{"1min":0.38200000000000001,"5min":0.379,"15min":0.27900000000000003},"max":{"1min":0.755,"5min":5.7709999999999999,"15min":5.7709999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.627,"15min":0.58899999999999997},"min":{"1min":0.41599999999999998,"5min":0.32500000000000001,"15min":0.30199999999999999},"max":{"1min":0.69299999999999995,"5min":3.5579999999999998,"15min":3.5579999999999998},"last":0.56999999999999995}]}]},{"osd":1,"up_from":13,"seq":55834575039,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":300128,"kb_used_data":2840,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94071712,"statfs":{"total":96636764160,"available":96329433088,"internally_reserved":0,"allocated":2908160,"data_stored":1661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.35799999999999998,"15min":0.38100000000000001},"min":{"1min":0.248,"5min":0.19900000000000001,"15min":0.186},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":13.393000000000001},"last":0.31},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.375,"15min":0.39300000000000002},"min":{"1min":0.28599999999999998,"5min":0.20599999999999999,"15min":0.19700000000000001},"max":{"1min":0.57499999999999996,"5min":0.58699999999999997,"15min":11.462},"last":0.55000000000000004}]},{"osd":2,"last update":"Fri Oct 6 11:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.371,"15min":0.373},"min":{"1min":0.28699999999999998,"5min":0.217,"15min":0.216},"max":{"1min":0.495,"5min":0.72599999999999998,"15min":8.0470000000000006},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.41899999999999998,"15min":0.41599999999999998},"min":{"1min":0.33300000000000002,"5min":0.26500000000000001,"15min":0.20999999999999999},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":4.8630000000000004},"last":0.47799999999999998}]},{"osd":3,"last update":"Fri Oct 6 11:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.433,"15min":0.43099999999999999},"min":{"1min":0.27600000000000002,"5min":0.27500000000000002,"15min":0.252},"max":{"1min":0.60599999999999998,"5min":0.68799999999999994,"15min":4.8029999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.42999999999999999,"15min":0.41499999999999998},"min":{"1min":0.34999999999999998,"5min":0.23799999999999999,"15min":0.217},"max":{"1min":0.63700000000000001,"5min":0.749,"15min":5.8700000000000001},"last":0.44800000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.59999999999999998,"15min":0.55100000000000005},"min":{"1min":0.41199999999999998,"5min":0.38100000000000001,"15min":0.28199999999999997},"max":{"1min":0.878,"5min":0.88400000000000001,"15min":1.264},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.60599999999999998,"15min":0.59299999999999997},"min":{"1min":0.44900000000000001,"5min":0.41199999999999998,"15min":0.317},"max":{"1min":0.86699999999999999,"5min":0.92800000000000005,"15min":4.7699999999999996},"last":0.58099999999999996}]},{"osd":5,"last update":"Fri Oct 6 11:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59899999999999998,"15min":0.58399999999999996},"min":{"1min":0.433,"5min":0.39000000000000001,"15min":0.32400000000000001},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":3.4390000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.622,"15min":0.61799999999999999},"min":{"1min":0.45800000000000002,"5min":0.42699999999999999,"15min":0.29499999999999998},"max":{"1min":0.84199999999999997,"5min":0.92000000000000004,"15min":9.3829999999999991},"last":0.60599999999999998}]},{"osd":6,"last update":"Fri Oct 6 11:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.65400000000000003,"15min":0.61799999999999999},"min":{"1min":0.52200000000000002,"5min":0.42099999999999999,"15min":0.315},"max":{"1min":0.85499999999999998,"5min":0.92000000000000004,"15min":3.4750000000000001},"last":0.625},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.65400000000000003,"15min":0.623},"min":{"1min":0.49399999999999999,"5min":0.36599999999999999,"15min":0.35699999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":3.9180000000000001},"last":0.71399999999999997}]},{"osd":7,"last update":"Fri Oct 6 11:21:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64500000000000002,"15min":0.63},"min":{"1min":0.48299999999999998,"5min":0.434,"15min":0.38500000000000001},"max":{"1min":0.90500000000000003,"5min":0.92900000000000005,"15min":4.7290000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64000000000000001,"15min":0.61299999999999999},"min":{"1min":0.49399999999999999,"5min":0.41399999999999998,"15min":0.374},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":2.4500000000000002},"last":0.72999999999999998}]}]},{"osd":0,"up_from":13,"seq":55834575038,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303640,"kb_used_data":2256,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068200,"statfs":{"total":96636764160,"available":96325836800,"internally_reserved":0,"allocated":2310144,"data_stored":1070127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 11:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.375,"15min":0.47899999999999998},"min":{"1min":0.26500000000000001,"5min":0.22,"15min":0.184},"max":{"1min":0.56999999999999995,"5min":0.59599999999999997,"15min":36.097999999999999},"last":0.311},{"interface":"front","average":{"1min":0.373,"5min":0.36899999999999999,"15min":0.38800000000000001},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.182},"max":{"1min":0.49299999999999999,"5min":0.51400000000000001,"15min":7.2990000000000004},"last":0.36299999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.38500000000000001,"15min":0.505},"min":{"1min":0.25800000000000001,"5min":0.223,"15min":0.217},"max":{"1min":0.53000000000000003,"5min":0.56100000000000005,"15min":36.07},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40699999999999997,"15min":0.41899999999999998},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.219},"max":{"1min":0.55400000000000005,"5min":0.60799999999999998,"15min":6.7800000000000002},"last":0.46800000000000003}]},{"osd":3,"last update":"Fri Oct 6 11:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.38,"15min":0.39500000000000002},"min":{"1min":0.30299999999999999,"5min":0.253,"15min":0.223},"max":{"1min":0.497,"5min":0.54800000000000004,"15min":8.4130000000000003},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.442,"15min":0.55900000000000005},"min":{"1min":0.34200000000000003,"5min":0.27800000000000002,"15min":0.249},"max":{"1min":0.61499999999999999,"5min":0.65400000000000003,"15min":35.959000000000003},"last":0.43099999999999999}]},{"osd":4,"last update":"Fri Oct 6 11:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.622,"15min":0.58399999999999996},"min":{"1min":0.42299999999999999,"5min":0.36699999999999999,"15min":0.29599999999999999},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":2.427},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63300000000000001,"15min":0.73499999999999999},"min":{"1min":0.41399999999999998,"5min":0.41299999999999998,"15min":0.29299999999999998},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":36.005000000000003},"last":0.56699999999999995}]},{"osd":5,"last update":"Fri Oct 6 11:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59499999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.32900000000000001},"max":{"1min":0.93799999999999994,"5min":0.95299999999999996,"15min":6.6699999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58799999999999997,"15min":0.56999999999999995},"min":{"1min":0.40000000000000002,"5min":0.36899999999999999,"15min":0.315},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":2.0600000000000001},"last":0.64400000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.64300000000000002,"15min":0.73999999999999999},"min":{"1min":0.42999999999999999,"5min":0.42599999999999999,"15min":0.317},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":36.037999999999997},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.47699999999999998,"5min":0.41299999999999998,"15min":0.36399999999999999},"max":{"1min":1.042,"5min":1.042,"15min":6.7110000000000003},"last":0.63100000000000001}]},{"osd":7,"last update":"Fri Oct 6 11:21:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.629,"15min":0.628},"min":{"1min":0.46500000000000002,"5min":0.39400000000000002,"15min":0.371},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":6.742},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61899999999999999,"15min":0.58999999999999997},"min":{"1min":0.441,"5min":0.39200000000000002,"15min":0.34499999999999997},"max":{"1min":1.137,"5min":1.137,"15min":1.917},"last":0.52900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834575039,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303640,"kb_used_data":2256,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068200,"statfs":{"total":96636764160,"available":96325836800,"internally_reserved":0,"allocated":2310144,"data_stored":1070127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.49099999999999999,"15min":0.37},"min":{"1min":0.247,"5min":0.22900000000000001,"15min":0.17999999999999999},"max":{"1min":0.443,"5min":15.228,"15min":15.228},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.433,"15min":0.39700000000000002},"min":{"1min":0.35399999999999998,"5min":0.28599999999999998,"15min":0.20999999999999999},"max":{"1min":0.58899999999999997,"5min":1.714,"15min":1.714},"last":0.42199999999999999}]},{"osd":1,"last update":"Fri Oct 6 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.39700000000000002,"15min":0.379},"min":{"1min":0.35199999999999998,"5min":0.253,"15min":0.19900000000000001},"max":{"1min":0.55300000000000005,"5min":0.56999999999999995,"15min":0.745},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.39200000000000002,"15min":0.36599999999999999},"min":{"1min":0.29999999999999999,"5min":0.23200000000000001,"15min":0.216},"max":{"1min":0.52300000000000002,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.39800000000000002}]},{"osd":3,"last update":"Fri Oct 6 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.39500000000000002,"15min":0.373},"min":{"1min":0.35999999999999999,"5min":0.255,"15min":0.23200000000000001},"max":{"1min":0.54300000000000004,"5min":0.621,"15min":0.629},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.438,"5min":0.40699999999999997,"15min":0.377},"min":{"1min":0.33800000000000002,"5min":0.26600000000000001,"15min":0.251},"max":{"1min":0.56100000000000005,"5min":0.754,"15min":0.754},"last":0.44800000000000001}]},{"osd":4,"last update":"Fri Oct 6 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.58999999999999997,"15min":0.54300000000000004},"min":{"1min":0.52900000000000003,"5min":0.35799999999999998,"15min":0.30299999999999999},"max":{"1min":0.75700000000000001,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.72099999999999997,"15min":0.59899999999999998},"min":{"1min":0.38300000000000001,"5min":0.36499999999999999,"15min":0.27900000000000003},"max":{"1min":0.92400000000000004,"5min":15.26,"15min":15.26},"last":0.50600000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.72999999999999998,"15min":0.60199999999999998},"min":{"1min":0.45000000000000001,"5min":0.38200000000000001,"15min":0.32400000000000001},"max":{"1min":0.874,"5min":15.186,"15min":15.186},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.60099999999999998,"15min":0.56899999999999995},"min":{"1min":0.47399999999999998,"5min":0.40600000000000003,"15min":0.35099999999999998},"max":{"1min":0.78300000000000003,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.67200000000000004}]},{"osd":6,"last update":"Fri Oct 6 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.624,"15min":0.59199999999999997},"min":{"1min":0.5,"5min":0.42599999999999999,"15min":0.32600000000000001},"max":{"1min":0.90400000000000003,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.63100000000000001,"15min":0.58899999999999997},"min":{"1min":0.505,"5min":0.438,"15min":0.34200000000000003},"max":{"1min":0.82099999999999995,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.73499999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:20:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.70699999999999996,"15min":0.60899999999999999},"min":{"1min":0.47499999999999998,"5min":0.41099999999999998,"15min":0.34499999999999997},"max":{"1min":0.83599999999999997,"5min":10.977,"15min":10.977},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.60699999999999998,"15min":0.57899999999999996},"min":{"1min":0.53700000000000003,"5min":0.39600000000000002,"15min":0.38200000000000001},"max":{"1min":0.75,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.59399999999999997}]}]},{"osd":3,"up_from":13,"seq":55834575039,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":311832,"kb_used_data":2256,"kb_used_omap":0,"kb_used_meta":309568,"kb_avail":94060008,"statfs":{"total":96636764160,"available":96317448192,"internally_reserved":0,"allocated":2310144,"data_stored":1070127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":316997632},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36599999999999999,"15min":0.33400000000000002},"min":{"1min":0.25,"5min":0.19500000000000001,"15min":0.18099999999999999},"max":{"1min":0.51500000000000001,"5min":0.58399999999999996,"15min":2.2109999999999999},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41099999999999998,"15min":0.39200000000000002},"min":{"1min":0.30199999999999999,"5min":0.26800000000000002,"15min":0.22700000000000001},"max":{"1min":0.58199999999999996,"5min":0.61099999999999999,"15min":4.4820000000000002},"last":0.41999999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.35499999999999998,"15min":0.32700000000000001},"min":{"1min":0.246,"5min":0.22800000000000001,"15min":0.21299999999999999},"max":{"1min":0.48999999999999999,"5min":0.55900000000000005,"15min":0.65400000000000003},"last":0.374},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.39900000000000002,"15min":0.36399999999999999},"min":{"1min":0.29699999999999999,"5min":0.251,"15min":0.188},"max":{"1min":0.50700000000000001,"5min":0.54100000000000004,"15min":1.196},"last":0.50700000000000001}]},{"osd":2,"last update":"Fri Oct 6 11:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.38700000000000001,"15min":0.38100000000000001},"min":{"1min":0.29699999999999999,"5min":0.23400000000000001,"15min":0.19600000000000001},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":4.601},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.45800000000000002,"15min":0.42599999999999999},"min":{"1min":0.36099999999999999,"5min":0.28499999999999998,"15min":0.26100000000000001},"max":{"1min":0.61399999999999999,"5min":0.66600000000000004,"15min":2.6059999999999999},"last":0.45900000000000002}]},{"osd":4,"last update":"Fri Oct 6 11:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58599999999999997,"15min":0.54800000000000004},"min":{"1min":0.41299999999999998,"5min":0.378,"15min":0.311},"max":{"1min":0.76000000000000001,"5min":0.84099999999999997,"15min":1.694},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.59299999999999997,"15min":0.55200000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.30199999999999999},"max":{"1min":0.83899999999999997,"5min":0.85199999999999998,"15min":0.93799999999999994},"last":0.623}]},{"osd":5,"last update":"Fri Oct 6 11:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.59899999999999998,"15min":0.55800000000000005},"min":{"1min":0.46400000000000002,"5min":0.42199999999999999,"15min":0.29399999999999998},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.60999999999999999,"15min":0.56499999999999995},"min":{"1min":0.39400000000000002,"5min":0.36599999999999999,"15min":0.29699999999999999},"max":{"1min":0.82199999999999995,"5min":0.91000000000000003,"15min":1.165},"last":0.67400000000000004}]},{"osd":6,"last update":"Fri Oct 6 11:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.63900000000000001,"15min":0.58999999999999997},"min":{"1min":0.46700000000000003,"5min":0.44400000000000001,"15min":0.36699999999999999},"max":{"1min":0.86599999999999999,"5min":0.95399999999999996,"15min":1.1359999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.63300000000000001,"15min":0.59299999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.34399999999999997},"max":{"1min":0.73999999999999999,"5min":1.012,"15min":1.7470000000000001},"last":0.60299999999999998}]},{"osd":7,"last update":"Fri Oct 6 11:21:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.61799999999999999,"15min":0.57999999999999996},"min":{"1min":0.432,"5min":0.39600000000000002,"15min":0.35599999999999998},"max":{"1min":0.84999999999999998,"5min":0.86699999999999999,"15min":1.657},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.625,"15min":0.58799999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.35499999999999998},"max":{"1min":0.83799999999999997,"5min":0.89400000000000002,"15min":1.0429999999999999},"last":0.70199999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575038,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307740,"kb_used_data":2260,"kb_used_omap":0,"kb_used_meta":305472,"kb_avail":94064100,"statfs":{"total":96636764160,"available":96321638400,"internally_reserved":0,"allocated":2314240,"data_stored":1071480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312803328},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.52000000000000002,"15min":0.48699999999999999},"min":{"1min":0.42599999999999999,"5min":0.24199999999999999,"15min":0.19500000000000001},"max":{"1min":0.65800000000000003,"5min":0.76800000000000002,"15min":2.6619999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.53000000000000003,"15min":0.497},"min":{"1min":0.34399999999999997,"5min":0.28899999999999998,"15min":0.215},"max":{"1min":0.747,"5min":0.81499999999999995,"15min":0.91200000000000003},"last":0.57899999999999996}]},{"osd":1,"last update":"Fri Oct 6 11:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.52700000000000002,"15min":0.503},"min":{"1min":0.34699999999999998,"5min":0.27600000000000002,"15min":0.23300000000000001},"max":{"1min":0.64900000000000002,"5min":0.94099999999999995,"15min":2.8650000000000002},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.53900000000000003,"15min":0.51300000000000001},"min":{"1min":0.36899999999999999,"5min":0.27000000000000002,"15min":0.25800000000000001},"max":{"1min":0.69399999999999995,"5min":0.79800000000000004,"15min":2.7610000000000001},"last":0.56699999999999995}]},{"osd":2,"last update":"Fri Oct 6 11:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56799999999999995,"15min":0.52300000000000002},"min":{"1min":0.40999999999999998,"5min":0.32500000000000001,"15min":0.23100000000000001},"max":{"1min":0.71199999999999997,"5min":0.88800000000000001,"15min":1.6910000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59099999999999997,"15min":0.56899999999999995},"min":{"1min":0.378,"5min":0.378,"15min":0.30599999999999999},"max":{"1min":0.72299999999999998,"5min":0.84999999999999998,"15min":1.718},"last":0.66600000000000004}]},{"osd":3,"last update":"Fri Oct 6 11:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55800000000000005,"15min":0.55600000000000005},"min":{"1min":0.42899999999999999,"5min":0.36799999999999999,"15min":0.26700000000000002},"max":{"1min":0.70899999999999996,"5min":0.79600000000000004,"15min":2.677},"last":0.624},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.57099999999999995,"15min":0.53700000000000003},"min":{"1min":0.41099999999999998,"5min":0.40100000000000002,"15min":0.27500000000000002},"max":{"1min":0.75700000000000001,"5min":0.82399999999999995,"15min":1.784},"last":0.63400000000000001}]},{"osd":5,"last update":"Fri Oct 6 11:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47999999999999998,"15min":0.47399999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.23200000000000001},"max":{"1min":0.60999999999999999,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.55000000000000004,"15min":0.52100000000000002},"min":{"1min":0.33400000000000002,"5min":0.317,"15min":0.28399999999999997},"max":{"1min":0.75,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.51900000000000002}]},{"osd":6,"last update":"Fri Oct 6 11:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.54100000000000004,"15min":0.51900000000000002},"min":{"1min":0.34899999999999998,"5min":0.30199999999999999,"15min":0.252},"max":{"1min":0.68899999999999995,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.56000000000000005,"15min":0.54500000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.29199999999999998},"max":{"1min":0.73699999999999999,"5min":0.90400000000000003,"15min":1.165},"last":0.49199999999999999}]},{"osd":7,"last update":"Fri Oct 6 11:21:03 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57799999999999996,"15min":0.56100000000000005},"min":{"1min":0.40999999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.73699999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.441},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60899999999999999,"15min":0.58499999999999996},"min":{"1min":0.46899999999999997,"5min":0.34399999999999997,"15min":0.317},"max":{"1min":0.70599999999999996,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.54300000000000004}]}]},{"osd":5,"up_from":13,"seq":55834575040,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":299548,"kb_used_data":2260,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072292,"statfs":{"total":96636764160,"available":96330027008,"internally_reserved":0,"allocated":2314240,"data_stored":1071480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 11:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.53600000000000003,"15min":0.51800000000000002},"min":{"1min":0.38800000000000001,"5min":0.26000000000000001,"15min":0.20499999999999999},"max":{"1min":0.68799999999999994,"5min":0.752,"15min":5.0490000000000004},"last":0.442},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52800000000000002,"15min":0.503},"min":{"1min":0.39700000000000002,"5min":0.32900000000000001,"15min":0.22900000000000001},"max":{"1min":0.70099999999999996,"5min":0.75,"15min":5.1449999999999996},"last":0.47699999999999998}]},{"osd":1,"last update":"Fri Oct 6 11:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.53900000000000003,"15min":0.497},"min":{"1min":0.42799999999999999,"5min":0.27800000000000002,"15min":0.25},"max":{"1min":0.76000000000000001,"5min":0.76400000000000001,"15min":0.97199999999999998},"last":0.503},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.55600000000000005,"15min":0.51700000000000002},"min":{"1min":0.39600000000000002,"5min":0.29799999999999999,"15min":0.27400000000000002},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":1.8799999999999999},"last":0.49099999999999999}]},{"osd":2,"last update":"Fri Oct 6 11:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.58499999999999996,"15min":0.55400000000000005},"min":{"1min":0.41599999999999998,"5min":0.36499999999999999,"15min":0.28299999999999997},"max":{"1min":0.71599999999999997,"5min":0.80700000000000005,"15min":4.234},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59899999999999998,"15min":0.56399999999999995},"min":{"1min":0.46200000000000002,"5min":0.35899999999999999,"15min":0.315},"max":{"1min":0.72499999999999998,"5min":0.82099999999999995,"15min":1.0369999999999999},"last":0.35899999999999999}]},{"osd":3,"last update":"Fri Oct 6 11:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.53700000000000003,"15min":0.52700000000000002},"min":{"1min":0.41999999999999998,"5min":0.311,"15min":0.27700000000000002},"max":{"1min":0.76300000000000001,"5min":0.76800000000000002,"15min":5.2169999999999996},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56499999999999995,"15min":0.54100000000000004},"min":{"1min":0.43099999999999999,"5min":0.372,"15min":0.29699999999999999},"max":{"1min":0.68000000000000005,"5min":0.76000000000000001,"15min":1.008},"last":0.41099999999999998}]},{"osd":4,"last update":"Fri Oct 6 11:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.33600000000000002,"5min":0.28699999999999998,"15min":0.23999999999999999},"max":{"1min":0.68700000000000006,"5min":0.77900000000000003,"15min":1.917},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.505,"15min":0.499},"min":{"1min":0.38800000000000001,"5min":0.29999999999999999,"15min":0.23899999999999999},"max":{"1min":0.63900000000000001,"5min":0.77600000000000002,"15min":0.87},"last":0.42399999999999999}]},{"osd":6,"last update":"Fri Oct 6 11:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.35599999999999998,"5min":0.34799999999999998,"15min":0.27600000000000002},"max":{"1min":0.75800000000000001,"5min":0.78800000000000003,"15min":2.0139999999999998},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59699999999999998,"15min":0.58399999999999996},"min":{"1min":0.436,"5min":0.33200000000000002,"15min":0.29999999999999999},"max":{"1min":0.747,"5min":0.85099999999999998,"15min":1.9470000000000001},"last":0.624}]},{"osd":7,"last update":"Fri Oct 6 11:21:05 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.55200000000000005,"15min":0.54600000000000004},"min":{"1min":0.40100000000000002,"5min":0.32900000000000001,"15min":0.27700000000000002},"max":{"1min":0.73899999999999999,"5min":0.79700000000000004,"15min":0.96499999999999997},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.59099999999999997,"15min":0.58099999999999996},"min":{"1min":0.40000000000000002,"5min":0.39700000000000002,"15min":0.28799999999999998},"max":{"1min":0.79400000000000004,"5min":0.81399999999999995,"15min":1.4119999999999999},"last":0.66100000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T11:21:17.230 DEBUG:teuthology.orchestra.run.smithi146:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-06T11:21:17.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.342+0000 7f45b619f700 1 Processor -- start 2023-10-06T11:21:17.344 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.342+0000 7f45b619f700 1 -- start start 2023-10-06T11:21:17.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.343+0000 7f45b619f700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f45b00c9f20 0x7f45b00c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:21:17.347 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.343+0000 7f45b619f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f45b006e870 0x7f45b0067af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:21:17.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.343+0000 7f45b619f700 1 -- --> v1:172.21.15.146:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45b00c71d0 con 0x7f45b00c8010 2023-10-06T11:21:17.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.343+0000 7f45b619f700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45b00c7750 con 0x7f45b00c9f20 2023-10-06T11:21:17.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.343+0000 7f45b619f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45b00b0a30 con 0x7f45b006e870 2023-10-06T11:21:17.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.343+0000 7f45b519d700 1 --1- >> v1:172.21.15.146:6789/0 conn(0x7f45b00c8010 0x7f45b00673e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.146:6789/0 says I am v1:172.21.15.146:39428/0 (socket says 172.21.15.146:39428) 2023-10-06T11:21:17.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.343+0000 7f45b519d700 1 -- 172.21.15.146:0/3998847264 learned_addr learned my addr 172.21.15.146:0/3998847264 (peer_addr_for_me v1:172.21.15.146:0/0) 2023-10-06T11:21:17.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.343+0000 7f45b499c700 1 --2- 172.21.15.146:0/3998847264 >> v2:172.21.15.151:3300/0 conn(0x7f45b00c9f20 0x7f45b00c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:21:17.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.343+0000 7f45b599e700 1 --2- 172.21.15.146:0/3998847264 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f45b006e870 0x7f45b0067af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:21:17.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.343+0000 7f45a7fff700 1 -- 172.21.15.146:0/3998847264 <== mon.0 v1:172.21.15.146:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2175371842 0 0) 0x7f45b00c71d0 con 0x7f45b00c8010 2023-10-06T11:21:17.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.343+0000 7f45a7fff700 1 -- 172.21.15.146:0/3998847264 --> v1:172.21.15.146:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f459c003570 con 0x7f45b00c8010 2023-10-06T11:21:17.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.344+0000 7f45a7fff700 1 -- 172.21.15.146:0/3998847264 <== mon.0 v1:172.21.15.146:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2667168381 0 0) 0x7f459c003570 con 0x7f45b00c8010 2023-10-06T11:21:17.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.344+0000 7f45a7fff700 1 -- 172.21.15.146:0/3998847264 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f45b006e870 msgr2=0x7f45b0067af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:21:17.348 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.344+0000 7f45a7fff700 1 --2- 172.21.15.146:0/3998847264 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f45b006e870 0x7f45b0067af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:21:17.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.344+0000 7f45a7fff700 1 -- 172.21.15.146:0/3998847264 >> v2:172.21.15.151:3300/0 conn(0x7f45b00c9f20 msgr2=0x7f45b00c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:21:17.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.344+0000 7f45a7fff700 1 --2- 172.21.15.146:0/3998847264 >> v2:172.21.15.151:3300/0 conn(0x7f45b00c9f20 0x7f45b00c83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:21:17.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.344+0000 7f45a7fff700 1 -- 172.21.15.146:0/3998847264 --> v1:172.21.15.146:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b00c7960 con 0x7f45b00c8010 2023-10-06T11:21:17.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.344+0000 7f45a7fff700 1 -- 172.21.15.146:0/3998847264 <== mon.0 v1:172.21.15.146:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1471120620 0 0) 0x7f45ac0015f0 con 0x7f45b00c8010 2023-10-06T11:21:17.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.344+0000 7f45b499c700 1 --2- 172.21.15.146:0/3998847264 >> v2:172.21.15.151:3300/0 conn(0x7f45b00c9f20 0x7f45b00c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:21:17.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.344+0000 7f45b599e700 1 --2- 172.21.15.146:0/3998847264 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f45b006e870 0x7f45b0067af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T11:21:17.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.344+0000 7f45a7fff700 1 -- 172.21.15.146:0/3998847264 >> v1:172.21.15.146:6789/0 conn(0x7f45b00c8010 legacy=0x7f45b00673e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:21:17.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.344+0000 7f45a7fff700 1 --2- 172.21.15.146:0/3998847264 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f45b006e870 0x7f459c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:21:17.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.344+0000 7f45a7fff700 1 --2- 172.21.15.146:0/3998847264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f459c003fa0 0x7f459c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:21:17.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.344+0000 7f45a7fff700 1 --2- 172.21.15.146:0/3998847264 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f459c004d50 0x7f459c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:21:17.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.344+0000 7f45a7fff700 1 -- 172.21.15.146:0/3998847264 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b00c7750 con 0x7f459c003fa0 2023-10-06T11:21:17.349 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.344+0000 7f45a7fff700 1 -- 172.21.15.146:0/3998847264 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b00b0a30 con 0x7f459c004d50 2023-10-06T11:21:17.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.344+0000 7f45a7fff700 1 -- 172.21.15.146:0/3998847264 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f459c00ba60 con 0x7f45b006e870 2023-10-06T11:21:17.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.344+0000 7f45b499c700 1 --2- 172.21.15.146:0/3998847264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f459c003fa0 0x7f459c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:21:17.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.344+0000 7f45b599e700 1 --2- 172.21.15.146:0/3998847264 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f459c004d50 0x7f459c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:21:17.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.344+0000 7f45b519d700 1 --2- 172.21.15.146:0/3998847264 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f45b006e870 0x7f459c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:21:17.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.344+0000 7f45b499c700 1 -- 172.21.15.146:0/3998847264 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f45b006e870 msgr2=0x7f459c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:21:17.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.344+0000 7f45b499c700 1 --2- 172.21.15.146:0/3998847264 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f45b006e870 0x7f459c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:21:17.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.344+0000 7f45b499c700 1 -- 172.21.15.146:0/3998847264 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f459c004d50 msgr2=0x7f459c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:21:17.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.344+0000 7f45b499c700 1 --2- 172.21.15.146:0/3998847264 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f459c004d50 0x7f459c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:21:17.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.344+0000 7f45b499c700 1 -- 172.21.15.146:0/3998847264 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a8009a20 con 0x7f459c003fa0 2023-10-06T11:21:17.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.344+0000 7f45b499c700 1 --2- 172.21.15.146:0/3998847264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f459c003fa0 0x7f459c004810 secure :-1 s=READY pgs=2442 cs=0 l=1 rev1=1 crypto rx=0x7f45b00ca340 tx=0x7f45a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0f1b438d51b0cc3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:21:17.350 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.345+0000 7f45a7fff700 1 -- 172.21.15.146:0/3998847264 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a0009740 con 0x7f459c003fa0 2023-10-06T11:21:17.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.345+0000 7f45a7fff700 1 -- 172.21.15.146:0/3998847264 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a000e920 con 0x7f459c003fa0 2023-10-06T11:21:17.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.345+0000 7f45a7fff700 1 -- 172.21.15.146:0/3998847264 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a000ecc0 con 0x7f459c003fa0 2023-10-06T11:21:17.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.345+0000 7f45b619f700 1 -- 172.21.15.146:0/3998847264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f459c003fa0 msgr2=0x7f459c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:21:17.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.345+0000 7f45b619f700 1 --2- 172.21.15.146:0/3998847264 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f459c003fa0 0x7f459c004810 secure :-1 s=READY pgs=2442 cs=0 l=1 rev1=1 crypto rx=0x7f45b00ca340 tx=0x7f45a00091a0 comp rx=0 tx=0).stop 2023-10-06T11:21:17.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.345+0000 7f45b599e700 1 -- 172.21.15.146:0/3998847264 reap_dead start 2023-10-06T11:21:17.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.345+0000 7f45b619f700 1 -- 172.21.15.146:0/3998847264 shutdown_connections 2023-10-06T11:21:17.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.345+0000 7f45b619f700 1 -- 172.21.15.146:0/3998847264 >> 172.21.15.146:0/3998847264 conn(0x7f45b00cd320 msgr2=0x7f45b00c92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:21:17.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.345+0000 7f45b619f700 1 -- 172.21.15.146:0/3998847264 shutdown_connections 2023-10-06T11:21:17.351 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.345+0000 7f45b619f700 1 -- 172.21.15.146:0/3998847264 wait complete. 2023-10-06T11:21:17.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.346+0000 7f45b619f700 1 Processor -- start 2023-10-06T11:21:17.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.346+0000 7f45b619f700 1 -- start start 2023-10-06T11:21:17.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.347+0000 7f45b619f700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f459c003fa0 0x7f45b0151580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:21:17.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.347+0000 7f45b619f700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f45b014e4e0 0x7f45b014d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:21:17.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.347+0000 7f45b619f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f45b014ee50 0x7f45b014de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:21:17.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.347+0000 7f45b619f700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b0166910 con 0x7f459c003fa0 2023-10-06T11:21:17.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.347+0000 7f45b619f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45b0165d00 con 0x7f45b014ee50 2023-10-06T11:21:17.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.347+0000 7f45b619f700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45b0165fe0 con 0x7f45b014e4e0 2023-10-06T11:21:17.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.347+0000 7f45b519d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f459c003fa0 0x7f45b0151580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:21:17.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.347+0000 7f45b519d700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f459c003fa0 0x7f45b0151580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33464/0 (socket says 172.21.15.146:33464) 2023-10-06T11:21:17.354 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.347+0000 7f45b519d700 1 -- 172.21.15.146:0/1466694325 learned_addr learned my addr 172.21.15.146:0/1466694325 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:21:17.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.347+0000 7f45b599e700 1 --2- 172.21.15.146:0/1466694325 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f45b014ee50 0x7f45b014de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:21:17.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.347+0000 7f45b499c700 1 --2- 172.21.15.146:0/1466694325 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f45b014e4e0 0x7f45b014d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:21:17.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.348+0000 7f45b519d700 1 -- 172.21.15.146:0/1466694325 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f45b014e4e0 msgr2=0x7f45b014d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:21:17.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.348+0000 7f45b519d700 1 --2- 172.21.15.146:0/1466694325 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f45b014e4e0 0x7f45b014d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:21:17.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.348+0000 7f45b519d700 1 -- 172.21.15.146:0/1466694325 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f45b014ee50 msgr2=0x7f45b014de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:21:17.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.348+0000 7f45b519d700 1 --2- 172.21.15.146:0/1466694325 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f45b014ee50 0x7f45b014de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:21:17.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.348+0000 7f45b519d700 1 -- 172.21.15.146:0/1466694325 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45b01662c0 con 0x7f459c003fa0 2023-10-06T11:21:17.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.348+0000 7f45b519d700 1 --2- 172.21.15.146:0/1466694325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f459c003fa0 0x7f45b0151580 secure :-1 s=READY pgs=2443 cs=0 l=1 rev1=1 crypto rx=0x7f45ac0010e0 tx=0x7f45ac009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:21:17.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.348+0000 7f45a57fa700 1 -- 172.21.15.146:0/1466694325 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac0073b0 con 0x7f459c003fa0 2023-10-06T11:21:17.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.348+0000 7f45a57fa700 1 -- 172.21.15.146:0/1466694325 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45ac007550 con 0x7f459c003fa0 2023-10-06T11:21:17.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.348+0000 7f45b619f700 1 -- 172.21.15.146:0/1466694325 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45b01665a0 con 0x7f459c003fa0 2023-10-06T11:21:17.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.348+0000 7f45a57fa700 1 -- 172.21.15.146:0/1466694325 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45ac005a40 con 0x7f459c003fa0 2023-10-06T11:21:17.355 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.348+0000 7f45b619f700 1 -- 172.21.15.146:0/1466694325 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45b0151ac0 con 0x7f459c003fa0 2023-10-06T11:21:17.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.349+0000 7f45b619f700 1 -- 172.21.15.146:0/1466694325 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45b0151ce0 con 0x7f459c003fa0 2023-10-06T11:21:17.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.349+0000 7f45a57fa700 1 -- 172.21.15.146:0/1466694325 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f45ac00d5c0 con 0x7f459c003fa0 2023-10-06T11:21:17.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.350+0000 7f45a57fa700 1 --2- 172.21.15.146:0/1466694325 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4594066f60 0x7f4594069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:21:17.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.350+0000 7f45a57fa700 1 -- 172.21.15.146:0/1466694325 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f45ac084650 con 0x7f459c003fa0 2023-10-06T11:21:17.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.350+0000 7f45b499c700 1 --2- 172.21.15.146:0/1466694325 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4594066f60 0x7f4594069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:21:17.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.350+0000 7f45b499c700 1 --2- 172.21.15.146:0/1466694325 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4594066f60 0x7f4594069410 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f45a00091e0 tx=0x7f45a0019000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:21:17.356 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.354+0000 7f45a57fa700 1 -- 172.21.15.146:0/1466694325 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f45ac051a00 con 0x7f459c003fa0 2023-10-06T11:21:17.540 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.538+0000 7f45b619f700 1 -- 172.21.15.146:0/1466694325 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f45b004c380 con 0x7f459c003fa0 2023-10-06T11:21:17.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.542+0000 7f45a57fa700 1 -- 172.21.15.146:0/1466694325 <== mon.0 v2:172.21.15.146:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f45ac051a00 con 0x7f459c003fa0 2023-10-06T11:21:17.544 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.543+0000 7f45a57fa700 1 -- 172.21.15.146:0/1466694325 <== mon.0 v2:172.21.15.146:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v36)=0 v36) v1 ==== 123+0+0 (secure 0 0 0) 0x7f45ac005db0 con 0x7f459c003fa0 2023-10-06T11:21:17.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.545+0000 7f45b619f700 1 -- 172.21.15.146:0/1466694325 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4594066f60 msgr2=0x7f4594069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:21:17.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.545+0000 7f45b619f700 1 --2- 172.21.15.146:0/1466694325 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4594066f60 0x7f4594069410 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f45a00091e0 tx=0x7f45a0019000 comp rx=0 tx=0).stop 2023-10-06T11:21:17.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.545+0000 7f45b619f700 1 -- 172.21.15.146:0/1466694325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f459c003fa0 msgr2=0x7f45b0151580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:21:17.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.545+0000 7f45b619f700 1 --2- 172.21.15.146:0/1466694325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f459c003fa0 0x7f45b0151580 secure :-1 s=READY pgs=2443 cs=0 l=1 rev1=1 crypto rx=0x7f45ac0010e0 tx=0x7f45ac009040 comp rx=0 tx=0).stop 2023-10-06T11:21:17.547 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.545+0000 7f45b619f700 1 -- 172.21.15.146:0/1466694325 shutdown_connections 2023-10-06T11:21:17.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.545+0000 7f45b619f700 1 --2- 172.21.15.146:0/1466694325 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f4594066f60 0x7f4594069410 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:21:17.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.545+0000 7f45b619f700 1 --2- 172.21.15.146:0/1466694325 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f45b014ee50 0x7f45b014de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:21:17.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.545+0000 7f45b619f700 1 --2- 172.21.15.146:0/1466694325 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f459c003fa0 0x7f45b0151580 unknown :-1 s=CLOSED pgs=2443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:21:17.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.545+0000 7f45b619f700 1 --2- 172.21.15.146:0/1466694325 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f45b014e4e0 0x7f45b014d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:21:17.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.545+0000 7f45b619f700 1 -- 172.21.15.146:0/1466694325 >> 172.21.15.146:0/1466694325 conn(0x7f45b00cd320 msgr2=0x7f45b00cab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:21:17.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.545+0000 7f45b619f700 1 -- 172.21.15.146:0/1466694325 shutdown_connections 2023-10-06T11:21:17.548 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.545+0000 7f45b619f700 1 -- 172.21.15.146:0/1466694325 wait complete. 2023-10-06T11:21:17.559 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T11:21:17.560 DEBUG:teuthology.orchestra.run.smithi146:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T11:21:17.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.673+0000 7f35411aa700 1 Processor -- start 2023-10-06T11:21:17.675 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.674+0000 7f35411aa700 1 -- start start 2023-10-06T11:21:17.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.674+0000 7f35411aa700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f353c1538c0 0x7f353c153c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:21:17.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.674+0000 7f35411aa700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f353c15a940 0x7f353c15dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:21:17.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.674+0000 7f35411aa700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f353c0cac80 0x7f353c0ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:21:17.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.674+0000 7f35411aa700 1 -- --> v2:172.21.15.146:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f353c15d270 con 0x7f353c0cac80 2023-10-06T11:21:17.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.674+0000 7f35411aa700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f353c15d830 con 0x7f353c15a940 2023-10-06T11:21:17.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.674+0000 7f35411aa700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f353c0cb810 con 0x7f353c1538c0 2023-10-06T11:21:17.679 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.674+0000 7f353b59e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f353c0cac80 0x7f353c0ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:21:17.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.675+0000 7f353b59e700 1 --2- >> v2:172.21.15.146:3300/0 conn(0x7f353c0cac80 0x7f353c0ce610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33472/0 (socket says 172.21.15.146:33472) 2023-10-06T11:21:17.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.675+0000 7f353b59e700 1 -- 172.21.15.146:0/4219313657 learned_addr learned my addr 172.21.15.146:0/4219313657 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:21:17.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.675+0000 7f353ad9d700 1 --2- 172.21.15.146:0/4219313657 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f353c1538c0 0x7f353c153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:21:17.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.675+0000 7f353259c700 1 --2- 172.21.15.146:0/4219313657 >> v2:172.21.15.151:3300/0 conn(0x7f353c15a940 0x7f353c15dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:21:17.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.675+0000 7f353b59e700 1 -- 172.21.15.146:0/4219313657 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f353c1538c0 msgr2=0x7f353c153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:21:17.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.675+0000 7f353b59e700 1 --2- 172.21.15.146:0/4219313657 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f353c1538c0 0x7f353c153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:21:17.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.675+0000 7f353b59e700 1 -- 172.21.15.146:0/4219313657 >> v2:172.21.15.151:3300/0 conn(0x7f353c15a940 msgr2=0x7f353c15dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T11:21:17.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.675+0000 7f353b59e700 1 --2- 172.21.15.146:0/4219313657 >> v2:172.21.15.151:3300/0 conn(0x7f353c15a940 0x7f353c15dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:21:17.680 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.675+0000 7f353b59e700 1 -- 172.21.15.146:0/4219313657 --> v2:172.21.15.146:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f353c0cbaf0 con 0x7f353c0cac80 2023-10-06T11:21:17.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.675+0000 7f353259c700 1 --2- 172.21.15.146:0/4219313657 >> v2:172.21.15.151:3300/0 conn(0x7f353c15a940 0x7f353c15dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:21:17.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.675+0000 7f353ad9d700 1 --2- 172.21.15.146:0/4219313657 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f353c1538c0 0x7f353c153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T11:21:17.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.675+0000 7f353b59e700 1 --2- 172.21.15.146:0/4219313657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f353c0cac80 0x7f353c0ce610 secure :-1 s=READY pgs=2444 cs=0 l=1 rev1=1 crypto rx=0x7f353c069760 tx=0x7f3534009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c10b0a2e7373907 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:21:17.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.675+0000 7f353a59c700 1 -- 172.21.15.146:0/4219313657 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353400e070 con 0x7f353c0cac80 2023-10-06T11:21:17.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.675+0000 7f353a59c700 1 -- 172.21.15.146:0/4219313657 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f353400ba50 con 0x7f353c0cac80 2023-10-06T11:21:17.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.675+0000 7f353a59c700 1 -- 172.21.15.146:0/4219313657 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35340092e0 con 0x7f353c0cac80 2023-10-06T11:21:17.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.676+0000 7f35411aa700 1 -- 172.21.15.146:0/4219313657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f353c0cac80 msgr2=0x7f353c0ce610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:21:17.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.676+0000 7f35411aa700 1 --2- 172.21.15.146:0/4219313657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f353c0cac80 0x7f353c0ce610 secure :-1 s=READY pgs=2444 cs=0 l=1 rev1=1 crypto rx=0x7f353c069760 tx=0x7f3534009840 comp rx=0 tx=0).stop 2023-10-06T11:21:17.681 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.676+0000 7f35411aa700 1 -- 172.21.15.146:0/4219313657 shutdown_connections 2023-10-06T11:21:17.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.676+0000 7f35411aa700 1 --2- 172.21.15.146:0/4219313657 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f353c0cac80 0x7f353c0ce610 unknown :-1 s=CLOSED pgs=2444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:21:17.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.676+0000 7f35411aa700 1 --2- 172.21.15.146:0/4219313657 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f353c1538c0 0x7f353c153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:21:17.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.676+0000 7f35411aa700 1 --2- 172.21.15.146:0/4219313657 >> v2:172.21.15.151:3300/0 conn(0x7f353c15a940 0x7f353c15dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:21:17.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.676+0000 7f35411aa700 1 -- 172.21.15.146:0/4219313657 >> 172.21.15.146:0/4219313657 conn(0x7f353c06eb10 msgr2=0x7f353c06ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:21:17.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.676+0000 7f35411aa700 1 -- 172.21.15.146:0/4219313657 shutdown_connections 2023-10-06T11:21:17.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.676+0000 7f35411aa700 1 -- 172.21.15.146:0/4219313657 wait complete. 2023-10-06T11:21:17.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.677+0000 7f35411aa700 1 Processor -- start 2023-10-06T11:21:17.682 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.677+0000 7f35411aa700 1 -- start start 2023-10-06T11:21:17.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.678+0000 7f35411aa700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f353c0cac80 0x7f353c0b39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:21:17.685 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.678+0000 7f35411aa700 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f353c1538c0 0x7f353c0b1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:21:17.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.678+0000 7f35411aa700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f353c15a940 0x7f353c0c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:21:17.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.678+0000 7f35411aa700 1 -- --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353c0c7870 con 0x7f353c15a940 2023-10-06T11:21:17.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.678+0000 7f35411aa700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353c0c7b50 con 0x7f353c0cac80 2023-10-06T11:21:17.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.678+0000 7f35411aa700 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f353c0c7e30 con 0x7f353c1538c0 2023-10-06T11:21:17.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.678+0000 7f353b59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f353c15a940 0x7f353c0c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:21:17.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.678+0000 7f353b59e700 1 --2- >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f353c15a940 0x7f353c0c8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.146:3300/0 says I am v2:172.21.15.146:33482/0 (socket says 172.21.15.146:33482) 2023-10-06T11:21:17.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.678+0000 7f353b59e700 1 -- 172.21.15.146:0/4187918797 learned_addr learned my addr 172.21.15.146:0/4187918797 (peer_addr_for_me v2:172.21.15.146:0/0) 2023-10-06T11:21:17.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.678+0000 7f353ad9d700 1 --2- 172.21.15.146:0/4187918797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f353c0cac80 0x7f353c0b39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:21:17.686 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.678+0000 7f353259c700 1 --2- 172.21.15.146:0/4187918797 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f353c1538c0 0x7f353c0b1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:21:17.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.678+0000 7f353b59e700 1 -- 172.21.15.146:0/4187918797 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f353c1538c0 msgr2=0x7f353c0b1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:21:17.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.678+0000 7f353b59e700 1 --2- 172.21.15.146:0/4187918797 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f353c1538c0 0x7f353c0b1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:21:17.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.678+0000 7f353b59e700 1 -- 172.21.15.146:0/4187918797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f353c0cac80 msgr2=0x7f353c0b39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:21:17.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.678+0000 7f353b59e700 1 --2- 172.21.15.146:0/4187918797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f353c0cac80 0x7f353c0b39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:21:17.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.678+0000 7f353b59e700 1 -- 172.21.15.146:0/4187918797 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3534009ae0 con 0x7f353c15a940 2023-10-06T11:21:17.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.678+0000 7f353b59e700 1 --2- 172.21.15.146:0/4187918797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f353c15a940 0x7f353c0c8db0 secure :-1 s=READY pgs=2445 cs=0 l=1 rev1=1 crypto rx=0x7f3534009fd0 tx=0x7f3534009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:21:17.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.678+0000 7f35337fe700 1 -- 172.21.15.146:0/4187918797 <== mon.0 v2:172.21.15.146:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35340032f0 con 0x7f353c15a940 2023-10-06T11:21:17.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.679+0000 7f35337fe700 1 -- 172.21.15.146:0/4187918797 <== mon.0 v2:172.21.15.146:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3534025460 con 0x7f353c15a940 2023-10-06T11:21:17.687 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.679+0000 7f35411aa700 1 -- 172.21.15.146:0/4187918797 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f353c0c8110 con 0x7f353c15a940 2023-10-06T11:21:17.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.679+0000 7f35337fe700 1 -- 172.21.15.146:0/4187918797 <== mon.0 v2:172.21.15.146:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3534025820 con 0x7f353c15a940 2023-10-06T11:21:17.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.679+0000 7f35411aa700 1 -- 172.21.15.146:0/4187918797 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f353c0b1c60 con 0x7f353c15a940 2023-10-06T11:21:17.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.679+0000 7f35411aa700 1 -- 172.21.15.146:0/4187918797 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f353c0c8630 con 0x7f353c15a940 2023-10-06T11:21:17.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.680+0000 7f35337fe700 1 -- 172.21.15.146:0/4187918797 <== mon.0 v2:172.21.15.146:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3534003040 con 0x7f353c15a940 2023-10-06T11:21:17.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.680+0000 7f35337fe700 1 --2- 172.21.15.146:0/4187918797 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f351c066f30 0x7f351c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T11:21:17.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.680+0000 7f35337fe700 1 -- 172.21.15.146:0/4187918797 <== mon.0 v2:172.21.15.146:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5378+0+0 (secure 0 0 0) 0x7f3534086590 con 0x7f353c15a940 2023-10-06T11:21:17.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.680+0000 7f353ad9d700 1 --2- 172.21.15.146:0/4187918797 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f351c066f30 0x7f351c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T11:21:17.688 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.681+0000 7f353ad9d700 1 --2- 172.21.15.146:0/4187918797 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f351c066f30 0x7f351c0693e0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f352c00ab30 tx=0x7f352c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T11:21:17.689 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.685+0000 7f35337fe700 1 -- 172.21.15.146:0/4187918797 <== mon.0 v2:172.21.15.146:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f353c0c8630 con 0x7f353c15a940 2023-10-06T11:21:17.909 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.907+0000 7f35411aa700 1 -- 172.21.15.146:0/4187918797 --> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f353c0c8630 con 0x7f353c15a940 2023-10-06T11:21:17.910 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.908+0000 7f35337fe700 1 -- 172.21.15.146:0/4187918797 <== mon.0 v2:172.21.15.146:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 152 v152) v1 ==== 95+0+3544 (secure 0 0 0) 0x7f3534020df0 con 0x7f353c15a940 2023-10-06T11:21:17.910 INFO:teuthology.orchestra.run.smithi146.stdout: 2023-10-06T11:21:17.910 INFO:teuthology.orchestra.run.smithi146.stdout:{"epoch":152,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":9094,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6836/3426437100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6834","nonce":3426437100},{"type":"v1","addr":"172.21.15.146:6836","nonce":3426437100}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":139},{"gid":9106,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/3275041097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":3275041097},{"type":"v1","addr":"172.21.15.151:6835","nonce":3275041097}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":139},{"gid":9259,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/959352692","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":959352692},{"type":"v1","addr":"172.21.15.151:6834","nonce":959352692}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":146},{"gid":10968,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.146:6837/3844346970","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.146:6835","nonce":3844346970},{"type":"v1","addr":"172.21.15.146:6837","nonce":3844346970}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":152}],"filesystems":[]} 2023-10-06T11:21:17.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.910+0000 7f35411aa700 1 -- 172.21.15.146:0/4187918797 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f351c066f30 msgr2=0x7f351c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:21:17.912 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.910+0000 7f35411aa700 1 --2- 172.21.15.146:0/4187918797 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f351c066f30 0x7f351c0693e0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f352c00ab30 tx=0x7f352c008040 comp rx=0 tx=0).stop 2023-10-06T11:21:17.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.910+0000 7f35411aa700 1 -- 172.21.15.146:0/4187918797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f353c15a940 msgr2=0x7f353c0c8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T11:21:17.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.910+0000 7f35411aa700 1 --2- 172.21.15.146:0/4187918797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f353c15a940 0x7f353c0c8db0 secure :-1 s=READY pgs=2445 cs=0 l=1 rev1=1 crypto rx=0x7f3534009fd0 tx=0x7f3534009840 comp rx=0 tx=0).stop 2023-10-06T11:21:17.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.910+0000 7f35411aa700 1 -- 172.21.15.146:0/4187918797 shutdown_connections 2023-10-06T11:21:17.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.910+0000 7f35411aa700 1 --2- 172.21.15.146:0/4187918797 >> [v2:172.21.15.146:6832/90434,v1:172.21.15.146:6833/90434] conn(0x7f351c066f30 0x7f351c0693e0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:21:17.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.910+0000 7f35411aa700 1 --2- 172.21.15.146:0/4187918797 >> [v2:172.21.15.146:3300/0,v1:172.21.15.146:6789/0] conn(0x7f353c15a940 0x7f353c0c8db0 unknown :-1 s=CLOSED pgs=2445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:21:17.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.910+0000 7f35411aa700 1 --2- 172.21.15.146:0/4187918797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f353c0cac80 0x7f353c0b39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:21:17.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.910+0000 7f35411aa700 1 --2- 172.21.15.146:0/4187918797 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f353c1538c0 0x7f353c0b1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T11:21:17.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.910+0000 7f35411aa700 1 -- 172.21.15.146:0/4187918797 >> 172.21.15.146:0/4187918797 conn(0x7f353c06eb10 msgr2=0x7f353c0c6980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T11:21:17.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.910+0000 7f35411aa700 1 -- 172.21.15.146:0/4187918797 shutdown_connections 2023-10-06T11:21:17.913 INFO:teuthology.orchestra.run.smithi146.stderr:2023-10-06T11:21:17.910+0000 7f35411aa700 1 -- 172.21.15.146:0/4187918797 wait complete. 2023-10-06T11:21:17.914 INFO:teuthology.orchestra.run.smithi146.stderr:dumped fsmap epoch 152 2023-10-06T11:21:17.924 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-06T11:21:17.925 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-06T11:21:17.925 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T11:21:17.925 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:21:17.933 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T11:21:17.933 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T11:21:17.933 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:21:17.982 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T11:21:17.982 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T11:21:17.982 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:21:17.993 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T11:21:17.994 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T11:21:17.994 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:21:18.044 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T11:21:18.045 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-06T11:21:18.045 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-06T11:21:18.045 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:21:18.074 INFO:tasks.ceph.osd.0:Stopped 2023-10-06T11:21:18.075 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-06T11:21:18.075 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:21:18.143 INFO:tasks.ceph.osd.1:Stopped 2023-10-06T11:21:18.143 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-06T11:21:18.143 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:21:18.212 INFO:tasks.ceph.osd.2:Stopped 2023-10-06T11:21:18.213 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-06T11:21:18.213 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:21:18.281 INFO:tasks.ceph.osd.3:Stopped 2023-10-06T11:21:18.281 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-06T11:21:18.281 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:21:18.326 INFO:tasks.ceph.osd.4:Stopped 2023-10-06T11:21:18.326 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-06T11:21:18.326 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:21:18.363 INFO:tasks.ceph.osd.5:Stopped 2023-10-06T11:21:18.363 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-06T11:21:18.363 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:21:18.442 INFO:tasks.ceph.osd.6:Stopped 2023-10-06T11:21:18.442 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-06T11:21:18.442 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:21:18.518 INFO:tasks.ceph.osd.7:Stopped 2023-10-06T11:21:18.518 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-06T11:21:18.518 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-06T11:21:18.518 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:21:18.543 INFO:tasks.ceph.mgr.y:Stopped 2023-10-06T11:21:18.543 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-06T11:21:18.543 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:21:18.583 INFO:tasks.ceph.mgr.x:Stopped 2023-10-06T11:21:18.583 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-06T11:21:18.584 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-06T11:21:18.584 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:21:18.595 INFO:tasks.ceph.mon.a:Stopped 2023-10-06T11:21:18.595 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-06T11:21:18.595 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:21:18.635 INFO:tasks.ceph.mon.b:Stopped 2023-10-06T11:21:18.635 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-06T11:21:18.635 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T11:21:18.687 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-10-06T11:21:18.687 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-10-06T11:21:18.687 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-10-06T11:21:18.687 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-10-06T11:21:18.687 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-10-06T11:21:18.687 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-10-06T11:21:18.687 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-10-06T11:21:18.687 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-10-06T11:21:18.687 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-10-06T11:21:18.687 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-10-06T11:21:18.688 INFO:tasks.ceph.mon.c:Stopped 2023-10-06T11:21:18.688 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-06T11:21:18.688 DEBUG:teuthology.orchestra.run.smithi146:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'Replacing daemon mds' | egrep -v 'Scrub error on inode' | egrep -v 'Behind on trimming' | egrep -v 'Metadata damage detected' | egrep -v 'bad backtrace on inode' | egrep -v 'overall HEALTH_' | egrep -v '\(MDS_TRIM\)' | head -n 1 2023-10-06T11:21:18.716 INFO:teuthology.orchestra.run.smithi146.stdout:1696590343.3428388 mon.a (mon.0) 136 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T11:21:18.717 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-10-06T11:21:18.717 DEBUG:teuthology.orchestra.run.smithi146:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'Replacing daemon mds' | egrep -v 'Scrub error on inode' | egrep -v 'Behind on trimming' | egrep -v 'Metadata damage detected' | egrep -v 'bad backtrace on inode' | egrep -v 'overall HEALTH_' | egrep -v '\(MDS_TRIM\)' | head -n 1 2023-10-06T11:21:18.786 DEBUG:teuthology.orchestra.run.smithi146:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'Replacing daemon mds' | egrep -v 'Scrub error on inode' | egrep -v 'Behind on trimming' | egrep -v 'Metadata damage detected' | egrep -v 'bad backtrace on inode' | egrep -v 'overall HEALTH_' | egrep -v '\(MDS_TRIM\)' | head -n 1 2023-10-06T11:21:18.855 DEBUG:teuthology.orchestra.run.smithi146:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'Replacing daemon mds' | egrep -v 'Scrub error on inode' | egrep -v 'Behind on trimming' | egrep -v 'Metadata damage detected' | egrep -v 'bad backtrace on inode' | egrep -v 'overall HEALTH_' | egrep -v '\(MDS_TRIM\)' | head -n 1 2023-10-06T11:21:18.924 INFO:teuthology.orchestra.run.smithi146.stdout:1696590343.3428388 mon.a (mon.0) 136 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T11:21:18.924 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi146.front.sepia.ceph.com 2023-10-06T11:21:18.924 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-06T11:21:19.142 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi146.front.sepia.ceph.com 2023-10-06T11:21:19.143 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-06T11:21:19.236 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi146.front.sepia.ceph.com 2023-10-06T11:21:19.236 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-06T11:21:19.306 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi146.front.sepia.ceph.com 2023-10-06T11:21:19.307 DEBUG:teuthology.orchestra.run.smithi146:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-06T11:21:19.392 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi151.front.sepia.ceph.com 2023-10-06T11:21:19.392 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-06T11:21:19.593 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi151.front.sepia.ceph.com 2023-10-06T11:21:19.593 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-06T11:21:19.679 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi151.front.sepia.ceph.com 2023-10-06T11:21:19.679 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-06T11:21:19.744 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi151.front.sepia.ceph.com 2023-10-06T11:21:19.744 DEBUG:teuthology.orchestra.run.smithi151:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-06T11:21:19.813 INFO:tasks.ceph:Archiving mon data... 2023-10-06T11:21:19.814 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412383/data/mon.a.tgz 2023-10-06T11:21:19.814 DEBUG:teuthology.orchestra.run.smithi146:> mktemp 2023-10-06T11:21:19.829 INFO:teuthology.orchestra.run.smithi146.stdout:/tmp/tmp.JqlwMGulu4 2023-10-06T11:21:19.830 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.JqlwMGulu4 2023-10-06T11:21:20.017 DEBUG:teuthology.orchestra.run.smithi146:> sudo chmod 0666 /tmp/tmp.JqlwMGulu4 2023-10-06T11:21:20.099 DEBUG:teuthology.orchestra.remote:smithi146:/tmp/tmp.JqlwMGulu4 is 580KB 2023-10-06T11:21:20.197 DEBUG:teuthology.orchestra.run.smithi146:> rm -fr /tmp/tmp.JqlwMGulu4 2023-10-06T11:21:20.211 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412383/data/mon.b.tgz 2023-10-06T11:21:20.212 DEBUG:teuthology.orchestra.run.smithi151:> mktemp 2023-10-06T11:21:20.227 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/tmp.cusZfaxwnt 2023-10-06T11:21:20.227 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.cusZfaxwnt 2023-10-06T11:21:20.417 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0666 /tmp/tmp.cusZfaxwnt 2023-10-06T11:21:20.498 DEBUG:teuthology.orchestra.remote:smithi151:/tmp/tmp.cusZfaxwnt is 613KB 2023-10-06T11:21:20.566 DEBUG:teuthology.orchestra.run.smithi151:> rm -fr /tmp/tmp.cusZfaxwnt 2023-10-06T11:21:20.580 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412383/data/mon.c.tgz 2023-10-06T11:21:20.580 DEBUG:teuthology.orchestra.run.smithi151:> mktemp 2023-10-06T11:21:20.633 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/tmp.Gp8qlFkj5O 2023-10-06T11:21:20.634 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Gp8qlFkj5O 2023-10-06T11:21:20.814 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0666 /tmp/tmp.Gp8qlFkj5O 2023-10-06T11:21:20.895 DEBUG:teuthology.orchestra.remote:smithi151:/tmp/tmp.Gp8qlFkj5O is 613KB 2023-10-06T11:21:20.994 DEBUG:teuthology.orchestra.run.smithi151:> rm -fr /tmp/tmp.Gp8qlFkj5O 2023-10-06T11:21:21.008 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-06T11:21:21.009 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T11:21:21.011 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T11:21:21.072 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-06T11:21:21.072 DEBUG:teuthology.orchestra.run.smithi146:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T11:21:21.077 DEBUG:teuthology.orchestra.run.smithi151:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T11:21:21.101 INFO:teuthology.orchestra.run.smithi146.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T11:21:21.137 INFO:teuthology.orchestra.run.smithi151.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T11:21:21.143 INFO:tasks.ceph:Archiving crash dumps... 2023-10-06T11:21:21.144 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412383/remote/smithi146/crash 2023-10-06T11:21:21.145 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T11:21:21.172 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412383/remote/smithi151/crash 2023-10-06T11:21:21.173 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T11:21:21.206 INFO:tasks.ceph:Shutting down logrotate 2023-10-06T11:21:21.206 DEBUG:teuthology.orchestra.run.smithi146:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:21:21.216 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T11:21:21.293 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T11:21:21.318 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T11:21:21.343 INFO:tasks.ceph:Compressing logs... 2023-10-06T11:21:21.343 DEBUG:teuthology.orchestra.run.smithi146:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T11:21:21.360 DEBUG:teuthology.orchestra.run.smithi151:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T11:21:23.688 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-10-06T11:21:23.688 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-10-06T11:21:23.688 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-10-06T11:21:23.688 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-10-06T11:21:23.688 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-10-06T11:21:23.689 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-10-06T11:21:23.689 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-10-06T11:21:23.689 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2023-10-06T11:21:23.689 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2023-10-06T11:21:23.689 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2023-10-06T11:22:24.479 INFO:tasks.ceph:Archiving logs... 2023-10-06T11:22:24.480 DEBUG:teuthology.misc:Transferring archived files from smithi146:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412383/remote/smithi146/log 2023-10-06T11:22:24.481 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T11:22:32.335 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412383/remote/smithi151/log 2023-10-06T11:22:32.336 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T11:22:36.625 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-06T11:22:36.634 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-06T11:22:36.635 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T11:22:36.637 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T11:22:36.721 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-06T11:22:36.730 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-06T11:22:36.730 DEBUG:teuthology.orchestra.run.smithi146:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T11:22:36.733 DEBUG:teuthology.orchestra.run.smithi151:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T11:22:36.746 INFO:teuthology.orchestra.run.smithi151.stderr:bash: ntpq: command not found 2023-10-06T11:22:36.871 INFO:teuthology.orchestra.run.smithi146.stderr:bash: ntpq: command not found 2023-10-06T11:22:36.873 INFO:teuthology.orchestra.run.smithi151.stdout:210 Number of sources = 4 2023-10-06T11:22:36.873 INFO:teuthology.orchestra.run.smithi151.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T11:22:36.873 INFO:teuthology.orchestra.run.smithi151.stdout:=============================================================================== 2023-10-06T11:22:36.873 INFO:teuthology.orchestra.run.smithi151.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 33 -538us[ -538us] +/- 89ms 2023-10-06T11:22:36.873 INFO:teuthology.orchestra.run.smithi151.stdout:^* hv02.front.sepia.ceph.com 3 6 377 36 -444us[ -445us] +/- 54ms 2023-10-06T11:22:36.873 INFO:teuthology.orchestra.run.smithi151.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 36 +944us[ +944us] +/- 73ms 2023-10-06T11:22:36.873 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T11:22:36.873 INFO:teuthology.orchestra.run.smithi146.stdout:210 Number of sources = 4 2023-10-06T11:22:36.873 INFO:teuthology.orchestra.run.smithi146.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T11:22:36.873 INFO:teuthology.orchestra.run.smithi146.stdout:=============================================================================== 2023-10-06T11:22:36.874 INFO:teuthology.orchestra.run.smithi146.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 99 -521us[ -556us] +/- 88ms 2023-10-06T11:22:36.874 INFO:teuthology.orchestra.run.smithi146.stdout:^* hv02.front.sepia.ceph.com 3 6 377 34 -400us[ -392us] +/- 54ms 2023-10-06T11:22:36.874 INFO:teuthology.orchestra.run.smithi146.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 33 +968us[ +968us] +/- 73ms 2023-10-06T11:22:36.874 INFO:teuthology.orchestra.run.smithi146.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T11:22:36.874 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-06T11:22:36.884 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-06T11:22:36.884 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-06T11:22:36.894 DEBUG:teuthology.orchestra.run.smithi146:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-06T11:22:36.964 DEBUG:teuthology.orchestra.run.smithi151:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-06T11:22:37.099 DEBUG:teuthology.orchestra.run.smithi146:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T11:22:37.126 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:22:37.127 DEBUG:teuthology.orchestra.run.smithi151:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T11:22:37.157 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:22:37.157 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-06T11:22:37.167 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-06T11:22:37.204 INFO:teuthology.task.internal:Duration was 1696.729430 seconds 2023-10-06T11:22:37.204 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-06T11:22:37.213 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-06T11:22:37.213 DEBUG:teuthology.orchestra.run.smithi146:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T11:22:37.216 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T11:22:37.260 INFO:teuthology.orchestra.run.smithi151.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T11:22:37.260 INFO:teuthology.orchestra.run.smithi146.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T11:22:37.520 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-06T11:22:37.520 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi146.front.sepia.ceph.com 2023-10-06T11:22:37.520 DEBUG:teuthology.orchestra.run.smithi146:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T11:22:37.539 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi151.front.sepia.ceph.com 2023-10-06T11:22:37.540 DEBUG:teuthology.orchestra.run.smithi151:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T11:22:37.559 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-06T11:22:37.559 DEBUG:teuthology.orchestra.run.smithi146:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T11:22:37.582 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T11:22:37.638 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-06T11:22:37.638 DEBUG:teuthology.orchestra.run.smithi146:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T11:22:37.640 DEBUG:teuthology.orchestra.run.smithi151:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T11:22:37.752 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-06T11:22:37.762 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-06T11:22:37.763 DEBUG:teuthology.orchestra.run.smithi146:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T11:22:37.787 DEBUG:teuthology.orchestra.run.smithi151:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T11:22:37.812 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-06T11:22:37.822 DEBUG:teuthology.orchestra.run.smithi146:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T11:22:37.830 DEBUG:teuthology.orchestra.run.smithi151:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T11:22:37.851 INFO:teuthology.orchestra.run.smithi146.stdout:kernel.core_pattern = core 2023-10-06T11:22:37.875 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = core 2023-10-06T11:22:37.889 DEBUG:teuthology.orchestra.run.smithi146:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T11:22:37.918 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:22:37.918 DEBUG:teuthology.orchestra.run.smithi151:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T11:22:37.942 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T11:22:37.943 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-06T11:22:37.953 INFO:teuthology.task.internal:Transferring archived files... 2023-10-06T11:22:37.954 DEBUG:teuthology.misc:Transferring archived files from smithi146:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412383/remote/smithi146 2023-10-06T11:22:37.954 DEBUG:teuthology.orchestra.run.smithi146:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T11:22:37.991 DEBUG:teuthology.misc:Transferring archived files from smithi151:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412383/remote/smithi151 2023-10-06T11:22:37.992 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T11:22:38.027 INFO:teuthology.task.internal:Removing archive directory... 2023-10-06T11:22:38.027 DEBUG:teuthology.orchestra.run.smithi146:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T11:22:38.029 DEBUG:teuthology.orchestra.run.smithi151:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T11:22:38.076 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-06T11:22:38.086 INFO:teuthology.task.internal:Not uploading archives. 2023-10-06T11:22:38.087 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-06T11:22:38.096 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-06T11:22:38.096 DEBUG:teuthology.orchestra.run.smithi146:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T11:22:38.098 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T11:22:38.110 INFO:teuthology.orchestra.run.smithi146.stdout: 262183 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 11:22 /home/ubuntu/cephtest 2023-10-06T11:22:38.131 INFO:teuthology.orchestra.run.smithi151.stdout: 262183 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 11:22 /home/ubuntu/cephtest 2023-10-06T11:22:38.132 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-06T11:22:38.143 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-06T11:22:38.163 INFO:teuthology.nuke:Checking targets against current locks 2023-10-06T11:22:38.189 DEBUG:teuthology.nuke:shortname: smithi146 2023-10-06T11:22:38.189 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T11:22:38.212 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi146.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412383', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 10:46:51.470704', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCxrCmBNDWnrQG363rGgvq+eUam0H+vsbvn8+swaGzRgm2B7vXHGTALrWWsghB8gHDgx270VrwKGtLH1Y6/RNS0='} 2023-10-06T11:22:38.216 DEBUG:teuthology.nuke:shortname: smithi151 2023-10-06T11:22:38.216 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T11:22:38.236 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:54:57-fs-wip-yuri3-testing-2023-10-05-0943-quincy-distro-default-smithi/7412383', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 10:46:51.469335', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBETlmNbWzgqxqzZvjSqdDrYV2WKRkiFB3wtWmCw7Fa/hcUExw1PNaOi+l3Gbf6W1+rC0QmPLaTkzmyHFjATlIWA='} 2023-10-06T11:22:38.269 INFO:teuthology.orchestra.console.smithi146:Power off 2023-10-06T11:22:38.269 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T11:22:38.285 INFO:teuthology.orchestra.console.smithi151:Power off 2023-10-06T11:22:38.286 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T11:22:38.294 DEBUG:teuthology.orchestra.console.smithi146:power off output: Chassis Power Control: Down/Off 2023-10-06T11:22:38.295 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:22:38.311 DEBUG:teuthology.orchestra.console.smithi151:power off output: Chassis Power Control: Down/Off 2023-10-06T11:22:38.312 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:22:38.321 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on 2023-10-06T11:22:38.334 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2023-10-06T11:22:42.322 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:22:42.335 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:22:42.431 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is on 2023-10-06T11:22:42.443 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2023-10-06T11:22:46.435 DEBUG:teuthology.orchestra.console.smithi146:pexpect command: ipmitool -H smithi146.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:22:46.444 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:22:46.544 DEBUG:teuthology.orchestra.console.smithi146:check power output: Chassis Power is off 2023-10-06T11:22:46.553 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is on 2023-10-06T11:22:46.645 INFO:teuthology.orchestra.console.smithi146:Power off completed 2023-10-06T11:22:50.557 DEBUG:teuthology.orchestra.console.smithi151:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T11:22:50.667 DEBUG:teuthology.orchestra.console.smithi151:check power output: Chassis Power is off 2023-10-06T11:22:50.768 INFO:teuthology.orchestra.console.smithi151:Power off completed 2023-10-06T11:22:50.872 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/scrub} duration: 1696.729430437088 failure_reason: '"1696590343.3428388 mon.a (mon.0) 136 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2023-10-06T11:22:50.872 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T11:22:50.944 INFO:teuthology.run:FAIL